-- Logs begin at Thu 2021-12-09 20:34:55 UTC, end at Thu 2021-12-09 22:52:55 UTC. -- Dec 09 21:07:15.703187 n-d-713301-27 systemd[1]: Started Devstack devstack@q-svc.service. Dec 09 21:07:18.500972 n-d-713301-27 neutron-server[103328]: INFO neutron.common.config [-] Logging enabled! Dec 09 21:07:18.501627 n-d-713301-27 neutron-server[103328]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev272 Dec 09 21:07:18.501717 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=103328) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Dec 09 21:07:18.504999 n-d-713301-27 neutron-server[103328]: INFO neutron.common.config [-] Logging enabled! Dec 09 21:07:18.505254 n-d-713301-27 neutron-server[103328]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev272 Dec 09 21:07:18.505566 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=103328) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Dec 09 21:07:18.506506 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 09 21:07:18.506758 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 09 21:07:18.507228 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 09 21:07:18.507483 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 09 21:07:18.507795 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 09 21:07:18.508120 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.508558 n-d-713301-27 neutron-server[103328]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Dec 09 21:07:18.508928 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.509355 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.509772 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.510120 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.510416 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.510710 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.511001 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.511312 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.511803 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.512228 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.512674 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.513127 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.513596 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] config_source = [] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.514020 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.514464 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.514901 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] debug = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.515341 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.516169 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.516820 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.517300 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.517783 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.518264 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.518735 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.519082 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.519383 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.519749 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] host = n-d-713301-27 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.520038 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.520335 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.520641 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.520932 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.521199 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.521479 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.521765 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.522041 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] log_dir = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.522316 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] log_file = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.522596 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.522888 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.523176 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.523492 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.523722 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.523947 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.524254 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.524669 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.524910 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.525198 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.525463 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.525741 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.526017 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.526289 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.526579 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.526865 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.527149 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.527424 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.527729 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.528003 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.528273 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.528558 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.528831 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.529102 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.529376 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.529668 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.529941 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.530216 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.530517 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.530808 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.531093 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.531379 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.531686 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.531971 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.532244 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.532877 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] use_journal = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.533150 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] use_json = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.533420 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.533688 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.533977 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.534243 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.534513 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.534785 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.535055 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.535337 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:18.535659 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.535959 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.536260 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.536542 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.536845 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.537123 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.537555 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.538023 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.538527 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.539038 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.539584 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.540083 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.540607 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.541121 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.541650 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.542154 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.542652 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.543131 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.543599 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.544058 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.544506 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.544984 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.545447 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.545893 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.546360 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.546855 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.547341 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.547693 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.547998 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.548313 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.548617 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.548906 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.549197 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.549499 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.549785 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.550065 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.550349 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.550650 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.550934 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.551213 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.551539 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.551824 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.552099 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.552375 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.552655 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.552948 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.553228 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.553502 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.553774 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.554051 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.554322 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.554612 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.554894 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.555173 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.555479 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.555906 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.556357 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.556641 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.556923 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.557201 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.557483 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.557760 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.558037 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.558330 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.558586 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.558860 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.559131 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.559406 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.559715 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.559989 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.560265 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.560534 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.560814 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.561086 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.561376 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.561678 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.561958 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.562236 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.562515 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.562792 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.563067 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.563343 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.563740 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.564027 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.564302 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.564592 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.564875 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.565160 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.565442 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.565748 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.566044 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.566321 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.566606 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.566887 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.567166 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.567462 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.567759 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.568055 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.568351 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.568648 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.568941 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.569237 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.569518 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.569830 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.570111 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:18.570331 n-d-713301-27 neutron-server[103328]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 09 21:07:18.570573 n-d-713301-27 neutron-server[103328]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=103328) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Dec 09 21:07:18.999607 n-d-713301-27 neutron-server[103328]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=103328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 21:07:18.999859 n-d-713301-27 neutron-server[103328]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=103328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 21:07:19.000197 n-d-713301-27 neutron-server[103328]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=103328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 21:07:19.000545 n-d-713301-27 neutron-server[103328]: INFO neutron.manager [-] Loading core plugin: ml2 Dec 09 21:07:19.326344 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.326598 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.326899 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.328225 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.328500 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.328761 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.374432 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.374711 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.374978 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.389352 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.389629 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.389895 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.426213 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.426453 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.426744 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.464044 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.464330 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.464588 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.809459 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.810140 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.810140 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.810340 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.810949 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.910392 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.910707 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.910995 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.911265 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.911570 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.911880 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.912139 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.912393 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.912629 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.912915 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.913167 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.913429 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.913685 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.913920 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.914177 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.914442 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.914694 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.915062 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.915268 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.915686 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.915777 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.916037 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.916323 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.916704 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.916955 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.917207 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.917608 n-d-713301-27 neutron-server[103328]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=103328) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 09 21:07:19.917849 n-d-713301-27 neutron-server[103328]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=103328) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 09 21:07:19.918085 n-d-713301-27 neutron-server[103328]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=103328) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 09 21:07:19.918318 n-d-713301-27 neutron-server[103328]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=103328) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 09 21:07:19.918552 n-d-713301-27 neutron-server[103328]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=103328) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 09 21:07:19.918789 n-d-713301-27 neutron-server[103328]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=103328) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 09 21:07:19.919156 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Dec 09 21:07:19.922300 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Dec 09 21:07:19.926421 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Dec 09 21:07:19.930346 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(100, 149)])]) Dec 09 21:07:19.932061 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Dec 09 21:07:19.932533 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Dec 09 21:07:19.932878 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Dec 09 21:07:19.933257 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Dec 09 21:07:19.936110 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Dec 09 21:07:19.936365 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Dec 09 21:07:19.936719 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Dec 09 21:07:19.942060 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Dec 09 21:07:19.965208 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Dec 09 21:07:19.965660 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.965963 n-d-713301-27 neutron-server[103328]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=103328) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:88}} Dec 09 21:07:19.966325 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.967738 n-d-713301-27 neutron-server[103328]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=103328) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Dec 09 21:07:19.968013 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Dec 09 21:07:19.968260 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Dec 09 21:07:19.971559 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:19.971840 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.036494 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Dec 09 21:07:20.036718 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Dec 09 21:07:20.036979 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Dec 09 21:07:20.037357 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Dec 09 21:07:20.061129 n-d-713301-27 neutron-server[103328]: DEBUG oslo_db.sqlalchemy.engines [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103328) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 09 21:07:20.501447 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.managers [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Initializing driver for type 'gre' Dec 09 21:07:20.501974 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] gre ID ranges: [(1, 1000)] Dec 09 21:07:20.564933 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.managers [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Initializing driver for type 'local' Dec 09 21:07:20.565305 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.managers [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Initializing driver for type 'vlan' Dec 09 21:07:20.580515 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] VlanTypeDriver initialization complete Dec 09 21:07:20.580958 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.managers [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Initializing driver for type 'vxlan' Dec 09 21:07:20.581570 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] vxlan ID ranges: [(1, 1000)] Dec 09 21:07:20.641016 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.managers [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Initializing extension driver 'port_security' Dec 09 21:07:20.641359 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.extensions.port_security [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] PortSecurityExtensionDriver initialization complete Dec 09 21:07:20.641696 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.managers [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Initializing mechanism driver 'openvswitch' Dec 09 21:07:20.642045 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.managers [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Initializing mechanism driver 'hyperv' Dec 09 21:07:20.648808 n-d-713301-27 neutron-server[103328]: DEBUG neutron.plugins.ml2.plugin [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=103328) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:07:20.649753 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > port after_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.650218 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > port after_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.650572 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > port after_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.651103 n-d-713301-27 neutron-server[103328]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=103328) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 09 21:07:20.651565 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > subnet after_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.651914 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > subnet after_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.652252 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > subnet after_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.652644 n-d-713301-27 neutron-server[103328]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=103328) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 09 21:07:20.653039 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > network after_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.653379 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > network after_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.653714 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > network after_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.654103 n-d-713301-27 neutron-server[103328]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=103328) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 09 21:07:20.654498 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > security_group after_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.654839 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > security_group after_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.655171 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > security_group after_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.655591 n-d-713301-27 neutron-server[103328]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=103328) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 09 21:07:20.655987 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.656325 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.656659 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.657043 n-d-713301-27 neutron-server[103328]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=103328) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 09 21:07:20.657829 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > address_group after_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.658136 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > address_group after_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.658493 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > address_group after_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.658879 n-d-713301-27 neutron-server[103328]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=103328) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 09 21:07:20.659228 n-d-713301-27 neutron-server[103328]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] ML2 OVO RPC backend initialized. {{(pid=103328) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Dec 09 21:07:20.659953 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router_interface after_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.660320 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router_interface after_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.660725 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > network before_response 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.661064 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > networks before_response 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.661407 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > port before_response 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.661741 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > ports before_response 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.662078 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > subnet before_response 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.662412 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > subnets before_response 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.662751 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > network after_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.663082 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > network after_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.663409 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > network after_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.663759 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > port after_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.664086 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > port after_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.664412 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > port after_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.664739 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > subnet after_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.665068 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > subnet after_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.665395 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > subnet after_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.665961 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.plugin [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Modular L2 Plugin initialization complete Dec 09 21:07:20.666370 n-d-713301-27 neutron-server[103328]: DEBUG neutron.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading services supported by the core plugin {{(pid=103328) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Dec 09 21:07:20.666696 n-d-713301-27 neutron-server[103328]: INFO neutron.plugins.ml2.managers [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Got port-security extension from driver 'port_security' Dec 09 21:07:20.667158 n-d-713301-27 neutron-server[103328]: INFO neutron.extensions.vlantransparent [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Disabled vlantransparent extension. Dec 09 21:07:20.667670 n-d-713301-27 neutron-server[103328]: DEBUG neutron.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=103328) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Dec 09 21:07:20.667979 n-d-713301-27 neutron-server[103328]: INFO neutron.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading Plugin: router Dec 09 21:07:20.703715 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router_interface before_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.704096 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router after_create 55549900 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.704457 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router before_create 55549900 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.704813 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router_interface before_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.705180 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router_interface after_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.705535 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router after_delete 55549900 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.705879 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > floatingip after_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.706342 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > floatingip after_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.706696 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router after_create 55549900 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.707044 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router after_update 55549900 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.707391 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router after_update 55549900 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.707744 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.708095 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router after_update 55549900 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.708496 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router precommit_update 55549900 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.708858 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: port after_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.709191 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: port after_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.709520 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: subnet after_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.709849 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.710188 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > port precommit_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.710527 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router precommit_create 55549900 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.710859 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: port before_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.711191 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router precommit_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.711565 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router after_update 55549900 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.711887 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router precommit_delete 55549900 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.712239 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router precommit_create 55549900 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.712585 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router_interface after_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.712925 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router precommit_update 55549900 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.713278 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > agent after_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.713617 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > agent after_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.714128 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > network after_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.714912 n-d-713301-27 neutron-server[103328]: DEBUG neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Tracking information for resource: router configured {{(pid=103328) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 09 21:07:20.715243 n-d-713301-27 neutron-server[103328]: DEBUG neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Tracking information for resource: floatingip configured {{(pid=103328) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 09 21:07:20.720195 n-d-713301-27 neutron-server[103328]: INFO neutron.db.l3_agentschedulers_db [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Dec 09 21:07:20.720766 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: port after_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.721123 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: port after_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.721469 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: port after_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.721810 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: port after_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.722590 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router before_create 55550100 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.722948 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router precommit_delete 55550100 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.723300 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router precommit_create 55550100 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.723675 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > router precommit_update 55550100 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.728580 n-d-713301-27 neutron-server[103328]: DEBUG neutron.services.provider_configuration [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Service providers = [] {{(pid=103328) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Dec 09 21:07:20.728938 n-d-713301-27 neutron-server[103328]: DEBUG neutron.db.servicetype_db [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=103328) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Dec 09 21:07:20.731982 n-d-713301-27 neutron-server[103328]: DEBUG neutron.services.service_base [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=103328) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 09 21:07:20.732327 n-d-713301-27 neutron-server[103328]: DEBUG neutron.services.service_base [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=103328) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 09 21:07:20.732660 n-d-713301-27 neutron-server[103328]: DEBUG neutron.services.service_base [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=103328) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 09 21:07:20.733531 n-d-713301-27 neutron-server[103328]: DEBUG neutron.services.service_base [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=103328) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 09 21:07:20.733897 n-d-713301-27 neutron-server[103328]: INFO neutron.services.service_base [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Default provider is not specified for service type L3_ROUTER_NAT Dec 09 21:07:20.734256 n-d-713301-27 neutron-server[103328]: DEBUG neutron.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=103328) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 09 21:07:20.734565 n-d-713301-27 neutron-server[103328]: INFO neutron.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Dec 09 21:07:20.746012 n-d-713301-27 neutron-server[103328]: DEBUG neutron.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Successfully loaded METERING plugin. Description: METERING {{(pid=103328) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 09 21:07:20.746012 n-d-713301-27 neutron-server[103328]: INFO neutron.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading Plugin: auto_allocate Dec 09 21:07:20.751407 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: network precommit_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.751876 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: network precommit_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.752327 n-d-713301-27 neutron-server[103328]: DEBUG neutron.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=103328) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 09 21:07:20.752641 n-d-713301-27 neutron-server[103328]: INFO neutron.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading Plugin: tag Dec 09 21:07:20.759464 n-d-713301-27 neutron-server[103328]: DEBUG neutron.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=103328) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 09 21:07:20.759813 n-d-713301-27 neutron-server[103328]: INFO neutron.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading Plugin: timestamp Dec 09 21:07:20.763647 n-d-713301-27 neutron-server[103328]: DEBUG neutron.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=103328) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 09 21:07:20.763975 n-d-713301-27 neutron-server[103328]: INFO neutron.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading Plugin: network_ip_availability Dec 09 21:07:20.769479 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.769844 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.770199 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:20.770908 n-d-713301-27 neutron-server[103328]: DEBUG neutron.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=103328) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 09 21:07:20.771220 n-d-713301-27 neutron-server[103328]: INFO neutron.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading Plugin: flavors Dec 09 21:07:20.776248 n-d-713301-27 neutron-server[103328]: DEBUG neutron.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=103328) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 09 21:07:20.776682 n-d-713301-27 neutron-server[103328]: INFO neutron.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading Plugin: revisions Dec 09 21:07:20.781079 n-d-713301-27 neutron-server[103328]: DEBUG neutron.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=103328) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 09 21:07:20.781470 n-d-713301-27 neutron-server[103328]: DEBUG oslo_concurrency.lockutils [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.781s {{(pid=103328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 21:07:20.782217 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=103328) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Dec 09 21:07:20.782902 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Initializing extension manager. Dec 09 21:07:20.783412 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: __init__.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.783793 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: __pycache__ {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.784119 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.784447 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: address_group.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.785193 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.785763 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: address-group Dec 09 21:07:20.786079 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: address_scope.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.786780 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.787274 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: address-scope Dec 09 21:07:20.787618 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: admin_state_down_before_update.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.788528 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.789031 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: router-admin-state-down-before-update Dec 09 21:07:20.789329 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: agent.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.790013 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.790508 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: agent Dec 09 21:07:20.791057 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: agent_resources_synced.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.791975 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.792534 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: agent-resources-synced Dec 09 21:07:20.792849 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: allowedaddresspairs.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.794640 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.795138 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: allowed-address-pairs Dec 09 21:07:20.795469 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: auto_allocated_topology.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.796556 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.797057 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: auto-allocated-topology Dec 09 21:07:20.797376 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: availability_zone.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.798038 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.798532 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: availability_zone Dec 09 21:07:20.798842 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: availability_zone_filter.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.799775 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.800267 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: availability_zone_filter Dec 09 21:07:20.800584 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: data_plane_status.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.801474 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.801966 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension data-plane-status not supported by any of loaded plugins Dec 09 21:07:20.802282 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: default_subnetpools.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.803182 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.803711 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: default-subnetpools Dec 09 21:07:20.804027 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: dhcpagentscheduler.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.804834 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.805330 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: dhcp_agent_scheduler Dec 09 21:07:20.805647 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: dns.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.806543 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.807030 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension dns-integration not supported by any of loaded plugins Dec 09 21:07:20.807344 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: dns_domain_ports.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.808427 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.808919 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension dns-domain-ports not supported by any of loaded plugins Dec 09 21:07:20.809235 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.810136 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.810662 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Dec 09 21:07:20.810928 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: dvr.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.811624 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.812114 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: dvr Dec 09 21:07:20.812427 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: ecmp_routes.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.813327 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.813819 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension ecmp_routes not supported by any of loaded plugins Dec 09 21:07:20.814132 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: empty_string_filtering.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.815044 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.815563 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: empty-string-filtering Dec 09 21:07:20.815879 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.816776 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.817264 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Dec 09 21:07:20.817575 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.818469 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.818959 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Dec 09 21:07:20.819273 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: external_net.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.820194 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.820685 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: external-net Dec 09 21:07:20.820994 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: extra_dhcp_opt.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.821887 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.822377 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: extra_dhcp_opt Dec 09 21:07:20.822690 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: extraroute.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.823688 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.824179 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: extraroute Dec 09 21:07:20.824493 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: extraroute_atomic.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.827108 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.827665 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: extraroute-atomic Dec 09 21:07:20.827986 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: filter_validation.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.828661 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.829162 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: filter-validation Dec 09 21:07:20.829476 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: fip_pf_description.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.830391 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.830885 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Dec 09 21:07:20.831199 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: fip_port_details.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.832125 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.832622 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: fip-port-details Dec 09 21:07:20.832937 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: flavors.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.834157 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.834666 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: flavors Dec 09 21:07:20.834991 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.836693 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.837206 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Dec 09 21:07:20.837533 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: floatingip_pools.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.838225 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.838721 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: floatingip-pools Dec 09 21:07:20.839068 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: ip_allocation.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.840021 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.840517 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension ip_allocation not supported by any of loaded plugins Dec 09 21:07:20.840833 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: ip_substring_port_filtering.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.841746 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.842243 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: ip-substring-filtering Dec 09 21:07:20.842562 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: l2_adjacency.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.843458 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.843981 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension l2_adjacency not supported by any of loaded plugins Dec 09 21:07:20.844296 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: l3.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.845265 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.845771 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: router Dec 09 21:07:20.846089 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: l3_conntrack_helper.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.848339 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.848851 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension l3-conntrack-helper not supported by any of loaded plugins Dec 09 21:07:20.849174 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: l3_ext_gw_mode.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.850089 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.850596 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: ext-gw-mode Dec 09 21:07:20.850916 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: l3_ext_ha_mode.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.851873 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.852373 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: l3-ha Dec 09 21:07:20.852691 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: l3_flavors.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.853600 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.854099 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: l3-flavors Dec 09 21:07:20.854418 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.855364 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.855886 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: l3-port-ip-change-not-allowed Dec 09 21:07:20.856203 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: l3agentscheduler.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.857222 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.857721 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: l3_agent_scheduler Dec 09 21:07:20.858038 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: local_ip.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.859829 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.860333 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension local_ip not supported by any of loaded plugins Dec 09 21:07:20.860655 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: logging.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.862118 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.862625 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension logging not supported by any of loaded plugins Dec 09 21:07:20.862949 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: metering.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.863826 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.864400 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: metering Dec 09 21:07:20.864723 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.865799 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.866307 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: metering_source_and_destination_fields Dec 09 21:07:20.866628 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: multiprovidernet.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.867566 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.868067 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: multi-provider Dec 09 21:07:20.868383 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: netmtu.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.869289 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.869788 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: net-mtu Dec 09 21:07:20.870101 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: netmtu_writable.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.871028 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.871552 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: net-mtu-writable Dec 09 21:07:20.871868 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: network_availability_zone.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.872522 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.873013 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: network_availability_zone Dec 09 21:07:20.873321 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: network_ip_availability.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.874423 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.874923 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: network-ip-availability Dec 09 21:07:20.875236 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: network_segment_range.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.876009 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.876497 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension network-segment-range not supported by any of loaded plugins Dec 09 21:07:20.876810 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: pagination.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.877784 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.878108 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: pagination Dec 09 21:07:20.878424 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: port_device_profile.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.879316 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.879847 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: port-device-profile Dec 09 21:07:20.880170 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: port_mac_address_regenerate.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.881076 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.881574 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: port-mac-address-regenerate Dec 09 21:07:20.881887 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: port_numa_affinity_policy.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.882775 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.883273 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: port-numa-affinity-policy Dec 09 21:07:20.883626 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: port_resource_request.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.884531 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.885020 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension port-resource-request not supported by any of loaded plugins Dec 09 21:07:20.885335 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: port_resource_request_groups.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.886393 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.886810 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension port-resource-request-groups not supported by any of loaded plugins Dec 09 21:07:20.887127 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: portbindings.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.888063 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.888569 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: binding Dec 09 21:07:20.888883 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: portbindings_extended.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.890141 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.890643 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: binding-extended Dec 09 21:07:20.890959 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: portsecurity.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.891889 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.892382 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: port-security Dec 09 21:07:20.892700 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: project_id.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.893656 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.893978 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: project-id Dec 09 21:07:20.894293 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: providernet.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.895218 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.895750 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: provider Dec 09 21:07:20.896066 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: qos.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.899616 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.900135 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension qos not supported by any of loaded plugins Dec 09 21:07:20.900465 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: qos_bw_limit_direction.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.901753 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.902260 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Dec 09 21:07:20.902587 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.903517 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.904020 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Dec 09 21:07:20.904340 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: qos_default.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.905247 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.905746 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension qos-default not supported by any of loaded plugins Dec 09 21:07:20.906062 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: qos_fip.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.906702 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.907189 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension qos-fip not supported by any of loaded plugins Dec 09 21:07:20.907976 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: qos_fip_network_policy.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.908971 n-d-713301-27 neutron-server[103328]: WARNING neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension file qos_fip_network_policy.py wasn't loaded due to cannot import name 'qos_fip_network_policy' from 'neutron_lib.api.definitions' (/usr/local/lib/python3.8/dist-packages/neutron_lib/api/definitions/__init__.py) Dec 09 21:07:20.909296 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: qos_gateway_ip.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.910199 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.910704 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension qos-gateway-ip not supported by any of loaded plugins Dec 09 21:07:20.911020 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: qos_port_network_policy.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.911941 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.912441 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension qos-port-network-policy not supported by any of loaded plugins Dec 09 21:07:20.912759 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.913884 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.914400 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension qos-pps-minimum not supported by any of loaded plugins Dec 09 21:07:20.914720 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: qos_pps_rule.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.915923 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.916427 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension qos-pps not supported by any of loaded plugins Dec 09 21:07:20.916742 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: qos_rule_type_details.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.917715 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.918208 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension qos-rule-type-details not supported by any of loaded plugins Dec 09 21:07:20.918522 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: qos_rules_alias.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.919593 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.920090 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension qos-rules-alias not supported by any of loaded plugins Dec 09 21:07:20.920402 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: quota_check_limit.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.921307 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.921810 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: quota-check-limit Dec 09 21:07:20.922122 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: quotasv2.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.923048 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.923372 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: quotas Dec 09 21:07:20.923710 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: quotasv2_detail.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.926847 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.927184 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: quota_details Dec 09 21:07:20.927530 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: rbac.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.928583 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.929098 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: rbac-policies Dec 09 21:07:20.929421 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: rbac_address_group.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.930342 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.930852 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: rbac-address-group Dec 09 21:07:20.931177 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: rbac_address_scope.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.932117 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.932621 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: rbac-address-scope Dec 09 21:07:20.932984 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: rbac_security_groups.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.933901 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.934416 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: rbac-security-groups Dec 09 21:07:20.934733 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: rbac_subnetpool.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.935680 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.936179 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: rbac-subnetpool Dec 09 21:07:20.936492 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: revisionifmatch.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.937401 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.937901 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: revision-if-match Dec 09 21:07:20.938215 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: revisions.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.939311 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.939859 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: standard-attr-revisions Dec 09 21:07:20.940178 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: router_availability_zone.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.940849 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.941340 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: router_availability_zone Dec 09 21:07:20.941650 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: routerservicetype.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.942556 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.943052 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension router-service-type not supported by any of loaded plugins Dec 09 21:07:20.943364 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.944381 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.944882 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: security-groups-normalized-cidr Dec 09 21:07:20.945196 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: security_groups_port_filtering.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.946100 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.946600 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: port-security-groups-filtering Dec 09 21:07:20.946913 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: security_groups_remote_address_group.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.947852 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.948465 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: security-groups-remote-address-group Dec 09 21:07:20.948832 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: security_groups_shared_filtering.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.949756 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.950258 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: security-groups-shared-filtering Dec 09 21:07:20.950575 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.951146 n-d-713301-27 neutron-server[103328]: WARNING neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Dec 09 21:07:20.951463 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: securitygroup.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.961283 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.961800 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: security-group Dec 09 21:07:20.962130 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: segment.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.962934 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.963418 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension segment not supported by any of loaded plugins Dec 09 21:07:20.963767 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.964727 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.965224 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Dec 09 21:07:20.965549 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: servicetype.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.966637 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.967141 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: service-type Dec 09 21:07:20.967479 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: sorting.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.968464 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.968790 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: sorting Dec 09 21:07:20.969108 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: standard_attr_segment.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.969989 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.970497 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension standard-attr-segment not supported by any of loaded plugins Dec 09 21:07:20.970816 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: standardattrdescription.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.971461 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.971975 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: standard-attr-description Dec 09 21:07:20.972292 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: stateful_security_group.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.973221 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.973722 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: stateful-security-group Dec 09 21:07:20.974040 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: stdattrs_common.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.974608 n-d-713301-27 neutron-server[103328]: WARNING neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Dec 09 21:07:20.974923 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.975862 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.976381 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Dec 09 21:07:20.976680 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: subnet_onboard.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.977739 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.978238 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: subnet_onboard Dec 09 21:07:20.978556 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: subnet_segmentid_writable.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.979499 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.980077 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Dec 09 21:07:20.980433 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: subnet_service_types.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.981362 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.981863 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: subnet-service-types Dec 09 21:07:20.982190 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: subnetallocation.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.983263 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.983790 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: subnet_allocation Dec 09 21:07:20.984118 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.984790 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.985283 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: subnetpool-prefix-ops Dec 09 21:07:20.985604 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.986518 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.987009 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Dec 09 21:07:20.987320 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: tagging.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.988399 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.988906 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: standard-attr-tag Dec 09 21:07:20.989225 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: timestamp.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.990430 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.990938 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loaded extension: standard-attr-timestamp Dec 09 21:07:20.991263 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: trunk.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.992326 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.992834 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension trunk not supported by any of loaded plugins Dec 09 21:07:20.993153 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: trunk_details.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.994063 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.994565 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension trunk-details not supported by any of loaded plugins Dec 09 21:07:20.994886 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: uplink_status_propagation.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.995919 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.996421 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension uplink-status-propagation not supported by any of loaded plugins Dec 09 21:07:20.996739 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Loading extension file: vlantransparent.py {{(pid=103328) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 21:07:20.997400 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=103328) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 21:07:20.997901 n-d-713301-27 neutron-server[103328]: INFO neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extension vlan-transparent not supported by any of loaded plugins Dec 09 21:07:21.000433 n-d-713301-27 neutron-server[103328]: INFO neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Creating instance of TrackedResource for resource:network Dec 09 21:07:21.000955 n-d-713301-27 neutron-server[103328]: INFO neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Creating instance of TrackedResource for resource:subnet Dec 09 21:07:21.001365 n-d-713301-27 neutron-server[103328]: INFO neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Creating instance of TrackedResource for resource:subnetpool Dec 09 21:07:21.001759 n-d-713301-27 neutron-server[103328]: INFO neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Creating instance of TrackedResource for resource:port Dec 09 21:07:21.003034 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.v2.resource_helper [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103328) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 21:07:21.003411 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.v2.resource_helper [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Service FLAVORS assigned prefix: {{(pid=103328) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 21:07:21.004111 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.v2.resource_helper [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103328) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 21:07:21.004531 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.v2.resource_helper [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103328) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 21:07:21.004856 n-d-713301-27 neutron-server[103328]: INFO neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Creating instance of TrackedResource for resource:router Dec 09 21:07:21.005274 n-d-713301-27 neutron-server[103328]: INFO neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Creating instance of TrackedResource for resource:floatingip Dec 09 21:07:21.005762 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.v2.resource_helper [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Service METERING assigned prefix: /metering {{(pid=103328) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 21:07:21.007668 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:21.008133 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:21.008504 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103328) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:07:21.009519 n-d-713301-27 neutron-server[103328]: INFO neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Creating instance of CountableResource for resource:rbac_policy Dec 09 21:07:21.009958 n-d-713301-27 neutron-server[103328]: INFO neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Creating instance of TrackedResource for resource:security_group Dec 09 21:07:21.010376 n-d-713301-27 neutron-server[103328]: INFO neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Creating instance of TrackedResource for resource:security_group_rule Dec 09 21:07:21.011058 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.v2.resource_helper [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Service CORE assigned prefix: {{(pid=103328) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 21:07:21.011560 n-d-713301-27 neutron-server[103328]: INFO neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Creating instance of TrackedResource for resource:subnetpool Dec 09 21:07:21.011915 n-d-713301-27 neutron-server[103328]: WARNING neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] subnetpool is already registered Dec 09 21:07:21.012337 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.v2.resource_helper [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Service CORE assigned prefix: {{(pid=103328) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 21:07:21.012661 n-d-713301-27 neutron-server[103328]: INFO neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Creating instance of TrackedResource for resource:subnetpool Dec 09 21:07:21.012986 n-d-713301-27 neutron-server[103328]: WARNING neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] subnetpool is already registered Dec 09 21:07:21.015248 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.v2.resource_helper [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103328) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 21:07:21.015696 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.v2.resource_helper [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Service FLAVORS assigned prefix: {{(pid=103328) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 21:07:21.016269 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.v2.resource_helper [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103328) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 21:07:21.016678 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.v2.resource_helper [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103328) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 21:07:21.017003 n-d-713301-27 neutron-server[103328]: INFO neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Creating instance of TrackedResource for resource:router Dec 09 21:07:21.017338 n-d-713301-27 neutron-server[103328]: WARNING neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] router is already registered Dec 09 21:07:21.017733 n-d-713301-27 neutron-server[103328]: INFO neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Creating instance of TrackedResource for resource:floatingip Dec 09 21:07:21.018063 n-d-713301-27 neutron-server[103328]: WARNING neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] floatingip is already registered Dec 09 21:07:21.018505 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.v2.resource_helper [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Service METERING assigned prefix: /metering {{(pid=103328) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 21:07:21.019153 n-d-713301-27 neutron-server[103328]: INFO neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Creating instance of CountableResource for resource:rbac_policy Dec 09 21:07:21.019495 n-d-713301-27 neutron-server[103328]: WARNING neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] rbac_policy is already registered Dec 09 21:07:21.019896 n-d-713301-27 neutron-server[103328]: INFO neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Creating instance of TrackedResource for resource:security_group Dec 09 21:07:21.020225 n-d-713301-27 neutron-server[103328]: WARNING neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] security_group is already registered Dec 09 21:07:21.020616 n-d-713301-27 neutron-server[103328]: INFO neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Creating instance of TrackedResource for resource:security_group_rule Dec 09 21:07:21.020939 n-d-713301-27 neutron-server[103328]: WARNING neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] security_group_rule is already registered Dec 09 21:07:21.021558 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.v2.resource_helper [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Service CORE assigned prefix: {{(pid=103328) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 21:07:21.021881 n-d-713301-27 neutron-server[103328]: INFO neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Creating instance of TrackedResource for resource:subnetpool Dec 09 21:07:21.022231 n-d-713301-27 neutron-server[103328]: WARNING neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] subnetpool is already registered Dec 09 21:07:21.022640 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.v2.resource_helper [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Service CORE assigned prefix: {{(pid=103328) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 21:07:21.022959 n-d-713301-27 neutron-server[103328]: INFO neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Creating instance of TrackedResource for resource:subnetpool Dec 09 21:07:21.023279 n-d-713301-27 neutron-server[103328]: WARNING neutron.quota.resource_registry [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] subnetpool is already registered Dec 09 21:07:21.023760 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: extensions {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.025226 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: address-groups {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.026897 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: address-scopes {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.028264 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: agents {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.029439 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: auto-allocated-topology {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.030693 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: availability_zones {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.031948 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: dhcp-networks {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.033800 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: dhcp-agents {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.035222 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: routers {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.037533 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: flavors {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.038688 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: service_profiles {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.039934 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: next_providers {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.041378 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: service_profiles {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.043919 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: floatingip-pools {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.045149 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: routers {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.047272 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: floatingips {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.048565 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: l3-routers {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.049954 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: l3-agents {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.051372 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: metering-labels {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.052740 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: metering-label-rules {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.054007 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: network-ip-availabilities {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.055275 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: bindings {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.056953 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: quotas {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.058559 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: quotas {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.060100 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: rbac-policies {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.061386 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: security-groups {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.062571 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: security-group-rules {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.063870 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: service-providers {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.065080 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: subnetpools {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.066492 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: subnetpools {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.067983 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: tags {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.069662 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: tags {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.071480 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: tags {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.073501 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: tags {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.075181 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: tags {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.077048 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: tags {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.078709 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: tags {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.080701 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: tags {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.082469 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: tags {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.084326 n-d-713301-27 neutron-server[103328]: DEBUG neutron.api.extensions [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Extended resource: tags {{(pid=103328) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 21:07:21.090481 n-d-713301-27 neutron-server[103328]: WARNING keystonemiddleware.auth_token [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 09 21:07:21.095249 n-d-713301-27 neutron-server[103328]: WARNING keystonemiddleware.auth_token [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 09 21:07:21.104066 n-d-713301-27 neutron-server[103328]: DEBUG oslo_concurrency.lockutils [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Acquired lock "singleton_lock" {{(pid=103328) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 09 21:07:21.104531 n-d-713301-27 neutron-server[103328]: DEBUG oslo_concurrency.lockutils [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Releasing lock "singleton_lock" {{(pid=103328) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 09 21:07:21.105226 n-d-713301-27 neutron-server[103328]: INFO oslo_service.service [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Starting 2 workers Dec 09 21:07:21.110058 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Started child 103437 {{(pid=103328) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 09 21:07:21.114500 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Started child 103438 {{(pid=103328) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 09 21:07:21.115474 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:21.116228 n-d-713301-27 neutron-server[103328]: INFO neutron.service [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Neutron service started, listening on 0.0.0.0:9696 Dec 09 21:07:21.116640 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Publish callbacks [] for process, before_spawn {{(pid=103328) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:21.116864 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [-] (103437) wsgi starting up on http://0.0.0.0:9696 Dec 09 21:07:21.119005 n-d-713301-27 neutron-server[103328]: INFO oslo_service.service [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Starting 1 workers Dec 09 21:07:21.119345 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:21.120882 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [-] (103438) wsgi starting up on http://0.0.0.0:9696 Dec 09 21:07:21.124379 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Started child 103439 {{(pid=103328) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 09 21:07:21.124923 n-d-713301-27 neutron-server[103328]: INFO oslo_service.service [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Starting 1 workers Dec 09 21:07:21.127975 n-d-713301-27 neutron-server[103439]: DEBUG neutron.service [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] calling RpcWorker wait() {{(pid=103439) _wait /opt/stack/neutron/neutron/service.py:128}} Dec 09 21:07:21.128528 n-d-713301-27 neutron-server[103439]: DEBUG neutron.service [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] returning from RpcWorker wait() {{(pid=103439) _wait /opt/stack/neutron/neutron/service.py:135}} Dec 09 21:07:21.129349 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Started child 103440 {{(pid=103328) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 09 21:07:21.129897 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:21.130132 n-d-713301-27 neutron-server[103328]: DEBUG neutron_lib.callbacks.manager [None req-2d8b36c5-966b-44f7-8354-a5206d3588bd None None] Publish callbacks [] for process, after_spawn {{(pid=103328) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:21.130375 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:07:21.131993 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=103328) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Dec 09 21:07:21.132157 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 09 21:07:21.132340 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 09 21:07:21.132581 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 09 21:07:21.132943 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 09 21:07:21.133079 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 09 21:07:21.133593 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.133811 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.134099 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.134344 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:21.134852 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.134852 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.135201 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.135488 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.135761 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.136295 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.136371 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.136522 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.136685 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.136872 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.137097 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.137423 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.137647 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.137904 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.138103 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.138263 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.138525 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] config_source = [] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.138747 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.139003 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.139288 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] debug = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.139539 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.140032 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.140261 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.140491 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.140699 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.140958 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.141156 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.141408 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.141625 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.141830 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.142051 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.142303 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.142523 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.142733 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.143009 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.143157 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.143408 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.143657 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.144120 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] host = n-d-713301-27 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.144353 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.144570 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.144819 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.145067 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.145326 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.145485 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.145764 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.146015 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.146250 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.146485 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.146716 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.146961 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.147172 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] log_dir = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.147384 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] log_file = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.147560 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] log_options = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.147772 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.148042 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.148281 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.148464 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.148615 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.148800 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.149052 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.149201 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.149458 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.149672 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.149984 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.150132 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.150328 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.150565 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.150825 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.151064 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.151294 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.151634 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.151890 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.152120 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.152348 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.152593 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.152824 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.153139 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.153301 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.153471 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.153711 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.153923 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.154145 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.154399 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.154642 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.154885 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.155098 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.155342 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.155648 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.155874 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.156098 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.156309 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.156576 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.156801 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.157048 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.157673 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.157883 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.158129 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.158344 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.158572 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] use_journal = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.158799 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] use_json = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.159023 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.159249 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.159512 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.159723 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.159957 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.160180 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.160371 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.160595 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.161020 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.161277 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.161889 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.162086 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.162333 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.162684 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.163350 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.163767 n-d-713301-27 neutron-server[103440]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:07:21.164044 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.164044 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.164860 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.164860 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.164860 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.165093 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.165191 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.165628 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.165934 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.166172 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.166447 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.166701 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.167657 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.167657 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.167657 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.168080 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.168080 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.168496 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.168496 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.168898 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.169034 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.169215 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.169583 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.169583 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.170821 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.13/identity {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.170821 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.170821 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.170821 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.171565 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.171565 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.171565 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.171565 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.172595 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.172595 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.172595 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.172595 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.173104 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.173104 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.173104 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.173618 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.173618 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.174252 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.174252 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.174252 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.175324 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.175324 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.175324 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.175324 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.178107 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.178107 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.178107 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.178107 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.178107 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.178107 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.178107 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.178107 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.178107 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.178647 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.178647 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.178647 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.178647 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.179141 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.179327 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.179569 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.179777 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.179994 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.180206 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.180448 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.180663 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.180873 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.181085 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.181309 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.181516 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.181728 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.181933 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.182140 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.182365 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.182593 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.182866 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.183083 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.183294 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.183525 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.183738 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.183950 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.184220 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.184543 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.184786 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.185024 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.185236 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.185470 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.185684 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.185931 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.186141 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.186349 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.186570 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.186829 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.187055 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.187280 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.187555 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.187788 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.188064 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.188303 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.188542 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.188777 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.188982 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.189219 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.189501 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.189700 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.189926 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.190189 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.190443 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.190729 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.191659 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.191916 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.192137 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.192400 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.192716 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.192995 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.193270 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.193515 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.193760 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.194007 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.194256 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.194522 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.194897 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.195039 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.195355 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.195635 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.195856 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.196079 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.196308 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.196711 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.196856 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.197068 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.197294 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.197566 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.197793 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.198174 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.198355 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.198521 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.198755 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.198997 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.199240 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.13/identity {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.199465 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.199692 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.199918 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.200143 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.200916 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.200916 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.200916 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.201358 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.201358 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.201625 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.201625 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.202108 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.202108 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.202346 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.202466 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.203141 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.203141 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.203141 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.203542 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.203542 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.203770 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.204148 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.204148 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.204415 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.204760 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.204897 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.205343 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.205343 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.205601 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.205854 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.205987 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.206168 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.206638 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.206638 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.206898 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.207939 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.207939 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.207939 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.207939 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.207939 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.208617 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.208617 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.208617 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.208953 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.209322 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.209322 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.209581 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.209915 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.210050 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.210172 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.210788 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.210788 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.211070 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.211070 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.211305 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.211537 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.211785 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.212001 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.212208 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.212421 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.212634 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.212843 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.213271 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.213418 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.213895 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.213895 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.214277 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.214410 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.214630 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.214992 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.215244 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.215482 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.215700 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.215911 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.216210 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.216562 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.216770 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.216986 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.217371 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.217632 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.217858 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.218068 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.218278 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.218512 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.218789 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.218943 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.219160 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.219364 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.219611 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.219827 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.220037 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.220399 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.220646 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.220854 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.221143 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.221246 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.221480 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.221687 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.221978 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.222222 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.222452 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.222729 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.222953 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.223198 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.223430 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.223794 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.223998 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.224237 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.224664 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.224907 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.225124 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.225372 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.225668 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.225954 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.226206 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.226452 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.226715 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.226990 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:100:149'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.227308 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.227564 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.227852 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.228178 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.228449 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.228682 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.228908 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.229170 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.229390 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.229643 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.229860 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.230090 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.230302 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.230543 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.230765 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.230991 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.231199 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.231614 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.231834 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.232079 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.232289 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.232538 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.232767 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.232924 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 09 21:07:21.233466 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=103328) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Dec 09 21:07:21.233651 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 09 21:07:21.233765 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 09 21:07:21.233944 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 09 21:07:21.234117 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 09 21:07:21.234272 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 09 21:07:21.234478 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.234635 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.234941 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.235099 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.235260 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.235457 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.235607 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.235763 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.235912 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.236069 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.236223 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.236381 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.236535 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.236691 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.236852 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.237007 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.237162 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.237316 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.237476 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.237630 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] config_source = [] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.237784 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.237939 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.238093 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] debug = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.238248 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.238445 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.238604 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.238762 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.238917 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.239070 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.239224 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.239378 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.239555 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.239712 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.239868 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.240022 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.240177 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.240333 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.240488 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.240642 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.240798 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.240954 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.241107 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] host = n-d-713301-27 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.241260 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.241414 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.241569 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.241724 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.241883 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.242059 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.242213 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.242371 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.242515 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.242657 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.242806 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.242968 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.243114 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] log_dir = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.243254 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] log_file = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.243396 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] log_options = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.243579 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.243736 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.243876 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.244030 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.244196 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.244871 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.244871 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.245253 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.245335 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.245511 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.245697 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.245783 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.245945 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.246069 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.246223 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.246567 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.246723 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.246890 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.247041 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.247177 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.247352 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.247831 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.247831 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.247831 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.248290 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.248290 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.248290 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.249042 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.249042 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.249042 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.249042 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.249042 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.249042 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.249474 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.249474 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.249474 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.249677 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.249763 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.249917 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.250070 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.250374 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.250537 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.250681 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.250838 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.250992 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.251147 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] use_journal = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.251301 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] use_json = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.251473 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.251633 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.255516 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.255516 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.255516 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.255516 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.255516 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.255516 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 21:07:21.255516 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.255516 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.256118 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.256118 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.256118 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.256118 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.256118 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.256118 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.256118 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.256118 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.256734 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.256734 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.256734 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.256734 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.256734 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.256734 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.256734 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.256734 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.257329 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.257452 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.257763 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.257946 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.258119 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.258415 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.258755 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.259089 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.259254 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.259479 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.259642 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.259826 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.259985 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.260280 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.13/identity {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.260581 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.260767 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.261072 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.261213 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.261523 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.261818 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.262118 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.262283 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.262444 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.262604 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.262764 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.262922 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.263084 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.263243 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.263403 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.263589 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.263748 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.263906 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.264064 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.264228 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.264313 n-d-713301-27 neutron-server[103439]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:07:21.264414 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.264531 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.264688 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.264847 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.265003 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.265173 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.265334 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.265490 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.265793 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.265948 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.266102 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.266262 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.266418 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.266576 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.266733 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.266890 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.267063 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.267220 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.267379 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.267557 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.267718 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.267880 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.268039 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.268197 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.268353 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.268510 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.268667 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.268822 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.268977 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.269137 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.269295 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.269451 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.269610 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.269768 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.269923 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.270081 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.270237 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.270393 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.270550 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.270718 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.270892 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.271050 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.271208 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.271367 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.271544 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.271704 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.271876 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.272030 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.272180 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.272322 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.272464 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.272628 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.272774 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.272917 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.273070 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.273233 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.273379 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.273523 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.273674 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.273835 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.273995 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.274158 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.274318 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.274474 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.274617 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.274775 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.274963 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.275119 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.275369 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.275663 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.275880 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.276055 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.276258 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.276358 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.276610 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.276779 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.276920 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.277059 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.277214 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.277740 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.277740 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.277905 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.278054 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.278196 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.278335 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.278485 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.278668 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.278830 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.278990 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.279146 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.279303 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.279492 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.279671 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.279808 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.279958 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.280095 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.280229 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.280384 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.13/identity {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.280555 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.281155 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.281155 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.281155 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.281155 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.281673 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.281673 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.281673 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.282055 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.282055 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.282055 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.282855 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.282855 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.282855 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.283725 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.283725 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.283725 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.283725 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.283725 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.283725 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.284549 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.284549 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.284549 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.284549 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.284549 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.284549 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.285309 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.285309 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.285309 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.285309 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.285309 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.285975 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.285975 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.285975 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.285975 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.286408 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.286408 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.286408 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.286626 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.286626 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.286861 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.287004 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.287125 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.287209 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.287330 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.287487 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.287648 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.287805 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.287963 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.288120 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.288265 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.288422 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.288577 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.288733 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.288892 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.289055 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.289196 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.289353 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.289509 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.289666 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.289822 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.289980 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.290150 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.290307 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.290464 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.290620 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.290776 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.290932 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.291098 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.291255 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.291411 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.291739 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.291859 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.291964 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.292109 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.292267 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.292422 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.292664 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.292831 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.293013 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.293161 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.293318 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.293474 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.293630 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.293809 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.293936 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.294095 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.294255 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.294413 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.294568 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.294724 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.294880 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.295045 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.295201 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.295357 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.295536 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.295693 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.295849 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.296015 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.296173 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.296330 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.296495 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.296652 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.296807 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.296964 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.297133 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.297289 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.297447 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.297651 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.297776 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.297896 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.298040 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.298201 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.298367 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.298532 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.298690 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.298853 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.299020 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:100:149'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.299187 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.299344 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.299527 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.299688 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.299846 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.300005 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.300161 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.300318 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.300474 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.300633 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.300789 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.300944 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.301100 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.301256 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.301412 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.301569 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.301728 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.301884 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.302039 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.302196 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.302353 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.302508 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.302663 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 21:07:21.302813 n-d-713301-27 neutron-server[103328]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=103328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 09 21:07:21.385420 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51932) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:07:21.399390 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [-] 10.222.0.13 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0100458 Dec 09 21:07:33.020945 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c8e989c1-4508-4544-a9bc-1b74e3f2bf38 None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 21:07:33.056483 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2d790aec-eba7-43fb-913a-1b961bd08a3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-638656'] for agent, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:33.090580 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c8e989c1-4508-4544-a9bc-1b74e3f2bf38 None None] No non-hosted networks {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Dec 09 21:07:35.466138 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-34dcfe71-1851-4fc4-8e3e-0e8693bd7379 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-638656'] for agent, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:35.517270 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-56607f32-1001-45fe-878c-e1effb59dfc0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:36.462843 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-638656'] for agent, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:37.817298 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-638656'] for agent, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:39.038917 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-638656'] for agent, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:39.040487 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:39.041126 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:39.041731 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:39.042281 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:39.042840 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:39.043402 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:39.043987 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:39.044509 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:39.045070 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:39.045620 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:39.046206 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:39.046748 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:39.047163 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:39.047799 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'n-d-713301-27', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2', 'LocalIPAssociation': '1.0'}) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:07:39.053899 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'n-d-713301-27', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2', 'LocalIPAssociation': '1.0'}} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:07:39.139883 n-d-713301-27 neutron-server[103439]: INFO neutron.db.l3_hamode_db [None req-e9f6f798-92f4-406f-bcca-3d0ae7e7470d None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Dec 09 21:07:39.222270 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9f6f798-92f4-406f-bcca-3d0ae7e7470d None None] Routers set() bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:07:39.222702 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9f6f798-92f4-406f-bcca-3d0ae7e7470d None None] Router IDs set() for agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Dec 09 21:07:39.397888 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52022) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:07:39.908164 n-d-713301-27 neutron-server[103437]: WARNING oslo_policy.policy [None req-20e3930e-a247-45ae-98bf-97bf7bc8a1e2 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 09 21:07:39.908713 n-d-713301-27 neutron-server[103437]: WARNING oslo_policy.policy [None req-20e3930e-a247-45ae-98bf-97bf7bc8a1e2 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 09 21:07:40.133950 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [None req-20e3930e-a247-45ae-98bf-97bf7bc8a1e2 admin admin] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:07:40.135129 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-20e3930e-a247-45ae-98bf-97bf7bc8a1e2 admin admin] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7352202 Dec 09 21:07:42.758455 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52038) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:07:43.085083 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-00895a49-ebc1-4851-84d2-019066cce812 admin admin] Request body: {'subnetpool': {'prefixes': ['172.20.0.0/16'], 'default_prefixlen': 26, 'shared': True, 'name': 'shared-default-subnetpool-v4', 'is_default': True}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:07:43.178840 n-d-713301-27 neutron-server[103437]: DEBUG neutron.policy [None req-00895a49-ebc1-4851-84d2-019066cce812 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=103437) register_rules /opt/stack/neutron/neutron/policy.py:73}} Dec 09 21:07:43.225320 n-d-713301-27 neutron-server[103437]: WARNING oslo_policy.policy [None req-00895a49-ebc1-4851-84d2-019066cce812 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 09 21:07:43.225675 n-d-713301-27 neutron-server[103437]: WARNING oslo_policy.policy [None req-00895a49-ebc1-4851-84d2-019066cce812 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 09 21:07:43.234376 n-d-713301-27 neutron-server[103437]: INFO neutron.quota [None req-00895a49-ebc1-4851-84d2-019066cce812 admin admin] Loaded quota_driver: . Dec 09 21:07:43.333877 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-00895a49-ebc1-4851-84d2-019066cce812 admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8731649178970', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8731649172237', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8731649127642', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8731649123233', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8731649117704', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8731649141168', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-1557939', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1565920', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-457520', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-393621'] for rbac-policy, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:43.403358 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-00895a49-ebc1-4851-84d2-019066cce812 admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:43.404574 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-00895a49-ebc1-4851-84d2-019066cce812 admin admin] 10.222.0.13 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.6451628 Dec 09 21:07:46.274393 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52050) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:07:46.612276 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Request body: {'network': {'name': 'private', 'admin_state_up': True, 'project_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'tenant_id': '8cc06b5e9c5e47e593129dedf4bb894e'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:07:46.652907 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Made reservation on behalf of 8cc06b5e9c5e47e593129dedf4bb894e for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:07:46.657777 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:46.683092 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:46.796130 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:46.801566 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:46.822034 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] vlan segment allocate from pool success with {'vlan_id': 110, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:07:46.850100 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8731650051009', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:46.850604 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Unsubscribe: segment precommit_create {{(pid=103437) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Dec 09 21:07:46.851118 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Added segment b7e721f1-7e2e-412f-9cf4-f39c3c974ea7 of type vlan for network 3a283ade-1d8a-4636-9f00-66c3b921a7f6 Dec 09 21:07:46.866640 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ebf127bc-0f4e-426a-97ff-c9afda204c3a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:07:46.914431 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:46.914775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:46.915108 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:46.915460 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:46.915802 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:46.916182 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:46.916507 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:46.916824 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:46.917141 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:46.917460 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:46.917760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:46.918075 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:46.918388 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Tracked resource versions report: Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: pushed versions: Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: { 'AddressGroup': {'1.2'}, Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: 'ConntrackHelper': {'1.0'}, Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: 'LocalIPAssociation': {'1.0'}, Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: 'Log': {'1.0'}, Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: 'Network': {'1.1'}, Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: 'Port': {'1.7'}, Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: 'PortForwarding': {'1.2'}, Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: 'QosPolicy': {'1.10'}, Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: 'SecurityGroup': {'1.5'}, Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: 'SecurityGroupRule': {'1.2'}, Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: 'SubPort': {'1.0'}, Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: 'Subnet': {'1.1'}, Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: 'Trunk': {'1.1'}} Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: consumer versions: Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: { DHCP agent@n-d-713301-27: {}, Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: L3 agent@n-d-713301-27: {}, Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: Metadata agent@n-d-713301-27: {}, Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: Metering agent@n-d-713301-27: {}, Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: Open vSwitch agent@n-d-713301-27: { 'AddressGroup': '1.2', Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: 'ConntrackHelper': '1.0', Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: 'LocalIPAssociation': '1.0', Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: 'Log': '1.0', Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: 'Network': '1.1', Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: 'Port': '1.7', Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: 'PortForwarding': '1.2', Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: 'QosPolicy': '1.10', Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: 'SecurityGroup': '1.5', Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: 'SecurityGroupRule': '1.2', Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: 'SubPort': '1.0', Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: 'Subnet': '1.1', Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: 'Trunk': '1.1'}} Dec 09 21:07:46.919516 n-d-713301-27 neutron-server[103437]: {{(pid=103437) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 09 21:07:46.973756 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:47.016411 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:47.017605 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:07:47.018296 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:47.062276 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.7869167 Dec 09 21:07:47.119770 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83dbc3d7-1f8b-49ae-af72-842a8c6a54b1 admin admin] Pushing event updated for resources: {'Network': ['ID=3a283ade-1d8a-4636-9f00-66c3b921a7f6,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:07:47.135206 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 3a283ade-1d8a-4636-9f00-66c3b921a7f6 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:07:49.992348 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52064) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:07:50.570794 n-d-713301-27 neutron-server[103438]: WARNING oslo_policy.policy [None req-36f027b0-6602-462e-aee4-22966c6ed2a0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 09 21:07:50.571344 n-d-713301-27 neutron-server[103438]: WARNING oslo_policy.policy [None req-36f027b0-6602-462e-aee4-22966c6ed2a0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 09 21:07:51.020940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.policy [None req-36f027b0-6602-462e-aee4-22966c6ed2a0 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=103438) register_rules /opt/stack/neutron/neutron/policy.py:73}} Dec 09 21:07:51.067789 n-d-713301-27 neutron-server[103438]: WARNING oslo_policy.policy [None req-36f027b0-6602-462e-aee4-22966c6ed2a0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 09 21:07:51.068103 n-d-713301-27 neutron-server[103438]: WARNING oslo_policy.policy [None req-36f027b0-6602-462e-aee4-22966c6ed2a0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 09 21:07:51.076416 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-36f027b0-6602-462e-aee4-22966c6ed2a0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:07:51.078168 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-36f027b0-6602-462e-aee4-22966c6ed2a0 admin admin] 10.222.0.13 "GET /v2.0/networks/3a283ade-1d8a-4636-9f00-66c3b921a7f6 HTTP/1.1" status: 200 len: 825 time: 1.0848937 Dec 09 21:07:51.120955 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fc745b30-27c4-4d51-b49a-fe80dbb72ff8 admin admin] 10.222.0.13 "GET /v2.0/subnetpools/ffd56fd0-6947-49ef-892f-a67b8c14613d HTTP/1.1" status: 200 len: 734 time: 0.0333858 Dec 09 21:07:51.130420 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Request body: {'subnet': {'tenant_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'name': 'private-subnet', 'gateway_ip': '172.20.0.1', 'subnetpool_id': 'ffd56fd0-6947-49ef-892f-a67b8c14613d', 'ip_version': 4, 'network_id': '3a283ade-1d8a-4636-9f00-66c3b921a7f6'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:07:51.131992 n-d-713301-27 neutron-server[103438]: INFO neutron.quota [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Loaded quota_driver: . Dec 09 21:07:51.173764 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Made reservation on behalf of 8cc06b5e9c5e47e593129dedf4bb894e for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:07:51.176615 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Publish callbacks [] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:51.473244 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:51.549019 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Checking segment: {'id': 'b7e721f1-7e2e-412f-9cf4-f39c3c974ea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '3a283ade-1d8a-4636-9f00-66c3b921a7f6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:07:51.549391 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Network hostable DHCP agents. Network: 3a283ade-1d8a-4636-9f00-66c3b921a7f6, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:07:51.561750 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6bb3417d-bc3e-410b-9e93-8f7f1c1e5e9e,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:07:51.578631 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:51.578959 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:51.579277 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:51.579684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:51.580012 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:51.580329 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:51.580684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:51.580967 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:51.581317 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:51.581633 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:51.581945 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:51.582256 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:51.582573 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Tracked resource versions report: Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: pushed versions: Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: { 'AddressGroup': {'1.2'}, Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: 'ConntrackHelper': {'1.0'}, Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: 'LocalIPAssociation': {'1.0'}, Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: 'Log': {'1.0'}, Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: 'Network': {'1.1'}, Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: 'Port': {'1.7'}, Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: 'PortForwarding': {'1.2'}, Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: 'QosPolicy': {'1.10'}, Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: 'SecurityGroup': {'1.5'}, Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: 'SecurityGroupRule': {'1.2'}, Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: 'SubPort': {'1.0'}, Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: 'Subnet': {'1.1'}, Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: 'Trunk': {'1.1'}} Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: consumer versions: Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: { DHCP agent@n-d-713301-27: {}, Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: L3 agent@n-d-713301-27: {}, Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: Metadata agent@n-d-713301-27: {}, Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: Metering agent@n-d-713301-27: {}, Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: Open vSwitch agent@n-d-713301-27: { 'AddressGroup': '1.2', Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: 'ConntrackHelper': '1.0', Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: 'LocalIPAssociation': '1.0', Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: 'Log': '1.0', Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: 'Network': '1.1', Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: 'Port': '1.7', Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: 'PortForwarding': '1.2', Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: 'QosPolicy': '1.10', Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: 'SecurityGroup': '1.5', Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: 'SecurityGroupRule': '1.2', Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: 'SubPort': '1.0', Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: 'Subnet': '1.1', Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: 'Trunk': '1.1'}} Dec 09 21:07:51.583675 n-d-713301-27 neutron-server[103438]: {{(pid=103438) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 09 21:07:51.604191 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Network 3a283ade-1d8a-4636-9f00-66c3b921a7f6 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:07:51.618789 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 3a283ade-1d8a-4636-9f00-66c3b921a7f6) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:07:51.641424 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:07:51.642008 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:51.646513 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc4c34f5-118f-4f7e-9bdf-0d449206a3ea None None] Network 3a283ade-1d8a-4636-9f00-66c3b921a7f6 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:07:51.671079 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-036e4ea8-bf71-44d6-b078-182d8c310f07 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.5388415 Dec 09 21:07:51.915151 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-3a283ade-1d8a-4636-9f00-66c3b921a7f6', 'network_id': '3a283ade-1d8a-4636-9f00-66c3b921a7f6', 'project_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'fixed_ips': [{'subnet_id': '6bb3417d-bc3e-410b-9e93-8f7f1c1e5e9e'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:07:51.916498 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:52.214249 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Allocated IP 172.20.0.2 (3a283ade-1d8a-4636-9f00-66c3b921a7f6/6bb3417d-bc3e-410b-9e93-8f7f1c1e5e9e/33514cf4-079a-46db-99da-f2b8e58dcf1a) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:07:52.458650 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:52.467376 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:52.538738 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Network 3a283ade-1d8a-4636-9f00-66c3b921a7f6 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:07:52.544431 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:07:52.555148 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:07:52.558307 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Pushing event updated for resources: {'Port': ['ID=33514cf4-079a-46db-99da-f2b8e58dcf1a,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:07:52.594350 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:52.594925 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:52.595480 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:52.595895 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:52.596228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:52.596840 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:52.597214 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:52.597569 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:52.597874 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:52.598192 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:52.598512 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:52.598851 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:52.599138 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Tracked resource versions report: Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: pushed versions: Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: { 'AddressGroup': {'1.2'}, Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: 'ConntrackHelper': {'1.0'}, Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: 'LocalIPAssociation': {'1.0'}, Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: 'Log': {'1.0'}, Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: 'Network': {'1.1'}, Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: 'Port': {'1.7'}, Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: 'PortForwarding': {'1.2'}, Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: 'QosPolicy': {'1.10'}, Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: 'SecurityGroup': {'1.5'}, Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: 'SecurityGroupRule': {'1.2'}, Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: 'SubPort': {'1.0'}, Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: 'Subnet': {'1.1'}, Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: 'Trunk': {'1.1'}} Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: consumer versions: Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: { DHCP agent@n-d-713301-27: {}, Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: L3 agent@n-d-713301-27: {}, Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: Metadata agent@n-d-713301-27: {}, Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: Metering agent@n-d-713301-27: {}, Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: Open vSwitch agent@n-d-713301-27: { 'AddressGroup': '1.2', Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: 'ConntrackHelper': '1.0', Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: 'LocalIPAssociation': '1.0', Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: 'Log': '1.0', Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: 'Network': '1.1', Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: 'Port': '1.7', Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: 'PortForwarding': '1.2', Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: 'QosPolicy': '1.10', Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: 'SecurityGroup': '1.5', Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: 'SecurityGroupRule': '1.2', Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: 'SubPort': '1.0', Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: 'Subnet': '1.1', Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: 'Trunk': '1.1'}} Dec 09 21:07:52.600240 n-d-713301-27 neutron-server[103439]: {{(pid=103439) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 09 21:07:52.650387 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Attempting to bind port 33514cf4-079a-46db-99da-f2b8e58dcf1a on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:07:52.651062 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Attempting to bind port 33514cf4-079a-46db-99da-f2b8e58dcf1a by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'b7e721f1-7e2e-412f-9cf4-f39c3c974ea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '3a283ade-1d8a-4636-9f00-66c3b921a7f6'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:07:52.651174 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Attempting to bind port 33514cf4-079a-46db-99da-f2b8e58dcf1a on network 3a283ade-1d8a-4636-9f00-66c3b921a7f6 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:07:52.657078 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 7, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:07:52.657479 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Checking segment: {'id': 'b7e721f1-7e2e-412f-9cf4-f39c3c974ea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '3a283ade-1d8a-4636-9f00-66c3b921a7f6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:07:52.657960 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:52.658358 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Bound using segment: {'id': 'b7e721f1-7e2e-412f-9cf4-f39c3c974ea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '3a283ade-1d8a-4636-9f00-66c3b921a7f6'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:07:52.658855 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Bound port: 33514cf4-079a-46db-99da-f2b8e58dcf1a, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b7e721f1-7e2e-412f-9cf4-f39c3c974ea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '3a283ade-1d8a-4636-9f00-66c3b921a7f6'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:07:52.659329 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:52.723004 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] For port 33514cf4-079a-46db-99da-f2b8e58dcf1a, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:07:52.727366 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] For port 33514cf4-079a-46db-99da-f2b8e58dcf1a, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=33514cf4-079a-46db-99da-f2b8e58dcf1a,segment=NetworkSegment(b7e721f1-7e2e-412f-9cf4-f39c3c974ea7),segment_id=b7e721f1-7e2e-412f-9cf4-f39c3c974ea7)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:07:52.732106 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:07:52.793830 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c2bb66d-a470-4b9d-a993-dd526ec503bb None None] Pushing event updated for resources: {'Port': ['ID=33514cf4-079a-46db-99da-f2b8e58dcf1a,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:07:54.299212 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52086) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:07:54.634163 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-f0eaa7f2-ff9e-4fd1-ad73-1142ddff8761 admin admin] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:07:54.635696 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f0eaa7f2-ff9e-4fd1-ad73-1142ddff8761 admin admin] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3353581 Dec 09 21:07:57.269484 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52094) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:07:57.598514 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-bfd69476-5b7c-4ecf-9d4f-628a4fa107b1 admin admin] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:07:57.599491 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bfd69476-5b7c-4ecf-9d4f-628a4fa107b1 admin admin] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3290458 Dec 09 21:07:58.188892 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 5 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:08:00.438400 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52106) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:08:00.751691 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-f89752c0-ffbe-452a-9569-d91781240e6c admin admin] Request body: {'router': {'tenant_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'name': 'router1', 'admin_state_up': True}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:08:00.781252 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f89752c0-ffbe-452a-9569-d91781240e6c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:00.783658 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f89752c0-ffbe-452a-9569-d91781240e6c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:00.897054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 33514cf4-079a-46db-99da-f2b8e58dcf1a up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:08:00.943589 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f89752c0-ffbe-452a-9569-d91781240e6c admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:00.949847 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f89752c0-ffbe-452a-9569-d91781240e6c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:00.965851 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f89752c0-ffbe-452a-9569-d91781240e6c admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:00.967519 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f89752c0-ffbe-452a-9569-d91781240e6c admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.5278254 Dec 09 21:08:00.989523 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 33514cf4-079a-46db-99da-f2b8e58dcf1a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:08:00.989973 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:01.105537 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:01.143460 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 33514cf4-079a-46db-99da-f2b8e58dcf1a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=33514cf4-079a-46db-99da-f2b8e58dcf1a,segment=NetworkSegment(b7e721f1-7e2e-412f-9cf4-f39c3c974ea7),segment_id=b7e721f1-7e2e-412f-9cf4-f39c3c974ea7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:08:01.147836 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:01.203432 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=33514cf4-079a-46db-99da-f2b8e58dcf1a,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:08:01.894711 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d310731e-0935-4926-9f6c-85b04086d5b8 None None] Network 3a283ade-1d8a-4636-9f00-66c3b921a7f6 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:08:02.022453 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c3ce1d57-1c2d-43b4-9846-50a4fe6b6c97 None None] Provisioning complete for port 33514cf4-079a-46db-99da-f2b8e58dcf1a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:08:02.023153 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c3ce1d57-1c2d-43b4-9846-50a4fe6b6c97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:02.328719 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d8493c3a-800c-4de9-8c53-c9291c327f4b None None] Provisioning complete for port 33514cf4-079a-46db-99da-f2b8e58dcf1a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:08:02.329087 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d8493c3a-800c-4de9-8c53-c9291c327f4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:02.869627 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 33514cf4-079a-46db-99da-f2b8e58dcf1a up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:08:02.917981 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1988f2a2-9710-4092-aac7-d43cff7ddd62 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:02.932501 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 33514cf4-079a-46db-99da-f2b8e58dcf1a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:08:02.932881 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:03.577045 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52116) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:08:03.929867 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [None req-d406fd08-38ee-4745-a4b3-87b874ffc1e3 admin admin] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:08:03.930863 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d406fd08-38ee-4745-a4b3-87b874ffc1e3 admin admin] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3525105 Dec 09 21:08:05.464231 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f95d3f08-8f0f-4620-85c5-c286ad2f9330 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:06.397336 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:06.586576 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52134) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:08:06.732087 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-47ff824b-e324-4c12-bb9f-8303be59f2fa admin admin] Request body: {'network': {'is_default': True, 'provider:network_type': 'flat', 'router:external': True, 'name': 'public', 'admin_state_up': True, 'provider:physical_network': 'physnet1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:08:06.754109 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-47ff824b-e324-4c12-bb9f-8303be59f2fa admin admin] Made reservation on behalf of 274e9361d9a94528a70c75d3890ac6db for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:08:06.756387 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-47ff824b-e324-4c12-bb9f-8303be59f2fa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:06.764773 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-47ff824b-e324-4c12-bb9f-8303be59f2fa admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:06.845335 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-47ff824b-e324-4c12-bb9f-8303be59f2fa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:06.850325 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-47ff824b-e324-4c12-bb9f-8303be59f2fa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:06.865035 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-47ff824b-e324-4c12-bb9f-8303be59f2fa admin admin] Reserving flat network on physical network physnet1 {{(pid=103437) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Dec 09 21:08:06.890776 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ff824b-e324-4c12-bb9f-8303be59f2fa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7ae4e484-77fd-4ae2-87c0-0bafbcf52680,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:08:06.894499 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-47ff824b-e324-4c12-bb9f-8303be59f2fa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:06.894940 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-47ff824b-e324-4c12-bb9f-8303be59f2fa admin admin] Added segment f99e21fd-7aae-414e-91b6-df0c4cab3a19 of type flat for network 97925a19-460a-4476-8208-41db134b6c83 Dec 09 21:08:06.943067 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-47ff824b-e324-4c12-bb9f-8303be59f2fa admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:06.977430 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-47ff824b-e324-4c12-bb9f-8303be59f2fa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:06.978943 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47ff824b-e324-4c12-bb9f-8303be59f2fa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:08:06.979811 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-47ff824b-e324-4c12-bb9f-8303be59f2fa admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:07.017267 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-47ff824b-e324-4c12-bb9f-8303be59f2fa admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.4296086 Dec 09 21:08:07.044608 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47ff824b-e324-4c12-bb9f-8303be59f2fa admin admin] Pushing event updated for resources: {'Network': ['ID=97925a19-460a-4476-8208-41db134b6c83,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:08:07.055669 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 97925a19-460a-4476-8208-41db134b6c83 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:08:07.782867 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:09.037260 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:09.455769 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52152) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:08:09.608868 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d025d211-f03a-41a1-bc32-37ef294cee2d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:08:09.610302 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d025d211-f03a-41a1-bc32-37ef294cee2d admin admin] 10.222.0.13 "GET /v2.0/subnets/6bb3417d-bc3e-410b-9e93-8f7f1c1e5e9e HTTP/1.1" status: 200 len: 849 time: 0.1534326 Dec 09 21:08:09.791853 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-724b250e-cbdc-4fe1-b4bd-ba9ab2072566 admin admin] 10.222.0.13 "GET /v2.0/routers/4d8363bf-eaa8-4eb9-8997-abc692ca0dfc HTTP/1.1" status: 200 len: 704 time: 0.1719625 Dec 09 21:08:10.071085 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99700bf0-7c35-4688-8157-0b6f4effc2dc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:10.386574 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-99700bf0-7c35-4688-8157-0b6f4effc2dc admin admin] Allocated IP 172.20.0.1 (3a283ade-1d8a-4636-9f00-66c3b921a7f6/6bb3417d-bc3e-410b-9e93-8f7f1c1e5e9e/de43c855-5796-4bbc-964b-3637119efc40) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:08:10.573539 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99700bf0-7c35-4688-8157-0b6f4effc2dc admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:10.641224 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99700bf0-7c35-4688-8157-0b6f4effc2dc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:10.710197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99700bf0-7c35-4688-8157-0b6f4effc2dc admin admin] Network 3a283ade-1d8a-4636-9f00-66c3b921a7f6 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:08:10.714720 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-99700bf0-7c35-4688-8157-0b6f4effc2dc admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:08:10.730217 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99700bf0-7c35-4688-8157-0b6f4effc2dc admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:08:10.731313 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99700bf0-7c35-4688-8157-0b6f4effc2dc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:10.749524 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99700bf0-7c35-4688-8157-0b6f4effc2dc admin admin] Pushing event updated for resources: {'Port': ['ID=de43c855-5796-4bbc-964b-3637119efc40,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:08:10.937384 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-442943ed-5a5c-4d24-ac39-04bb513c3383 None None] Provisioning complete for port de43c855-5796-4bbc-964b-3637119efc40 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:08:10.937952 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-442943ed-5a5c-4d24-ac39-04bb513c3383 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:10.970817 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-442943ed-5a5c-4d24-ac39-04bb513c3383 None None] Port de43c855-5796-4bbc-964b-3637119efc40 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:08:10.980183 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99700bf0-7c35-4688-8157-0b6f4effc2dc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:11.192094 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99700bf0-7c35-4688-8157-0b6f4effc2dc admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:11.199489 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99700bf0-7c35-4688-8157-0b6f4effc2dc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:11.200305 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99700bf0-7c35-4688-8157-0b6f4effc2dc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:11.260155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99700bf0-7c35-4688-8157-0b6f4effc2dc admin admin] Pushing event updated for resources: {'Port': ['ID=de43c855-5796-4bbc-964b-3637119efc40,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:08:11.330017 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99700bf0-7c35-4688-8157-0b6f4effc2dc admin admin] Network 3a283ade-1d8a-4636-9f00-66c3b921a7f6 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:08:11.331545 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-99700bf0-7c35-4688-8157-0b6f4effc2dc admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:08:11.492644 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-140eb207-2e4b-4cd7-8ce2-8b2aa4fa8818 None None] Provisioning complete for port de43c855-5796-4bbc-964b-3637119efc40 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:08:11.493081 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-140eb207-2e4b-4cd7-8ce2-8b2aa4fa8818 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:11.497741 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-99700bf0-7c35-4688-8157-0b6f4effc2dc admin admin] Router 4d8363bf-eaa8-4eb9-8997-abc692ca0dfc is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:08:11.529681 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-140eb207-2e4b-4cd7-8ce2-8b2aa4fa8818 None None] Port de43c855-5796-4bbc-964b-3637119efc40 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:08:11.593148 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-99700bf0-7c35-4688-8157-0b6f4effc2dc admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:08:11.599140 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-99700bf0-7c35-4688-8157-0b6f4effc2dc admin admin] 10.222.0.13 "PUT /v2.0/routers/4d8363bf-eaa8-4eb9-8997-abc692ca0dfc/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.7985060 Dec 09 21:08:11.606090 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] Sync routers for ids ['4d8363bf-eaa8-4eb9-8997-abc692ca0dfc'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:08:11.618665 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] Routers {'4d8363bf-eaa8-4eb9-8997-abc692ca0dfc'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:08:11.619584 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:08:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4d8363bf-eaa8-4eb9-8997-abc692ca0dfc'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:08:11.808822 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] Set router 4d8363bf-eaa8-4eb9-8997-abc692ca0dfc gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:08:12.240659 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4d8363bf-eaa8-4eb9-8997-abc692ca0dfc', 'name': 'router1', 'tenant_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:08:00Z', 'updated_at': '2021-12-09T21:08:10Z', 'revision_number': 2, 'project_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'gw_port_host': None, '_interfaces': [{'id': 'de43c855-5796-4bbc-964b-3637119efc40', 'name': '', 'network_id': '3a283ade-1d8a-4636-9f00-66c3b921a7f6', 'tenant_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'mac_address': 'fa:16:3e:02:8e:ff', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4d8363bf-eaa8-4eb9-8997-abc692ca0dfc', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '6bb3417d-bc3e-410b-9e93-8f7f1c1e5e9e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:08:10Z', 'updated_at': '2021-12-09T21:08:11Z', 'revision_number': 2, 'project_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'subnets': [{'id': '6bb3417d-bc3e-410b-9e93-8f7f1c1e5e9e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'ffd56fd0-6947-49ef-892f-a67b8c14613d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:08:12.290939 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] Checking router: 4d8363bf-eaa8-4eb9-8997-abc692ca0dfc for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:08:12.291310 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] Updating router 4d8363bf-eaa8-4eb9-8997-abc692ca0dfc port de43c855-5796-4bbc-964b-3637119efc40 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:08:12.338970 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:12.844738 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:12.853720 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:13.015747 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9cd5da1-3dbe-4b2f-b7be-dcb0de0b46af None None] Pushing event updated for resources: {'Port': ['ID=de43c855-5796-4bbc-964b-3637119efc40,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:08:13.018454 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] Attempting to bind port de43c855-5796-4bbc-964b-3637119efc40 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:08:13.018874 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] Attempting to bind port de43c855-5796-4bbc-964b-3637119efc40 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'b7e721f1-7e2e-412f-9cf4-f39c3c974ea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '3a283ade-1d8a-4636-9f00-66c3b921a7f6'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:08:13.019478 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] Attempting to bind port de43c855-5796-4bbc-964b-3637119efc40 on network 3a283ade-1d8a-4636-9f00-66c3b921a7f6 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:08:13.028272 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 8, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:08:13.028673 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] Checking segment: {'id': 'b7e721f1-7e2e-412f-9cf4-f39c3c974ea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '3a283ade-1d8a-4636-9f00-66c3b921a7f6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:08:13.029176 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:13.029585 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] Bound using segment: {'id': 'b7e721f1-7e2e-412f-9cf4-f39c3c974ea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '3a283ade-1d8a-4636-9f00-66c3b921a7f6'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:08:13.030454 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] Bound port: de43c855-5796-4bbc-964b-3637119efc40, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b7e721f1-7e2e-412f-9cf4-f39c3c974ea7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 110, 'network_id': '3a283ade-1d8a-4636-9f00-66c3b921a7f6'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:08:13.030845 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:13.033466 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9cd5da1-3dbe-4b2f-b7be-dcb0de0b46af None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:08:13.033811 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9cd5da1-3dbe-4b2f-b7be-dcb0de0b46af None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:08:13.034148 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9cd5da1-3dbe-4b2f-b7be-dcb0de0b46af None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:08:13.034483 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9cd5da1-3dbe-4b2f-b7be-dcb0de0b46af None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:08:13.034816 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9cd5da1-3dbe-4b2f-b7be-dcb0de0b46af None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:08:13.035148 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9cd5da1-3dbe-4b2f-b7be-dcb0de0b46af None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:08:13.035562 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9cd5da1-3dbe-4b2f-b7be-dcb0de0b46af None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:08:13.035894 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9cd5da1-3dbe-4b2f-b7be-dcb0de0b46af None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:08:13.036220 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9cd5da1-3dbe-4b2f-b7be-dcb0de0b46af None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:08:13.036542 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9cd5da1-3dbe-4b2f-b7be-dcb0de0b46af None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:08:13.036860 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9cd5da1-3dbe-4b2f-b7be-dcb0de0b46af None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:08:13.037310 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9cd5da1-3dbe-4b2f-b7be-dcb0de0b46af None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:08:13.037549 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9cd5da1-3dbe-4b2f-b7be-dcb0de0b46af None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e9cd5da1-3dbe-4b2f-b7be-dcb0de0b46af None None] Tracked resource versions report: Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: pushed versions: Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: { 'AddressGroup': {'1.2'}, Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: 'ConntrackHelper': {'1.0'}, Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: 'LocalIPAssociation': {'1.0'}, Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: 'Log': {'1.0'}, Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: 'Network': {'1.1'}, Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: 'Port': {'1.7'}, Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: 'PortForwarding': {'1.2'}, Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: 'QosPolicy': {'1.10'}, Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: 'SecurityGroup': {'1.5'}, Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: 'SecurityGroupRule': {'1.2'}, Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: 'SubPort': {'1.0'}, Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: 'Subnet': {'1.1'}, Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: 'Trunk': {'1.1'}} Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: consumer versions: Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: { DHCP agent@n-d-713301-27: {}, Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: L3 agent@n-d-713301-27: {}, Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: Metadata agent@n-d-713301-27: {}, Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: Metering agent@n-d-713301-27: {}, Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: Open vSwitch agent@n-d-713301-27: { 'AddressGroup': '1.2', Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: 'ConntrackHelper': '1.0', Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: 'LocalIPAssociation': '1.0', Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: 'Log': '1.0', Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: 'Network': '1.1', Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: 'Port': '1.7', Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: 'PortForwarding': '1.2', Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: 'QosPolicy': '1.10', Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: 'SecurityGroup': '1.5', Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: 'SecurityGroupRule': '1.2', Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: 'SubPort': '1.0', Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: 'Subnet': '1.1', Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: 'Trunk': '1.1'}} Dec 09 21:08:13.038626 n-d-713301-27 neutron-server[103440]: {{(pid=103440) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 09 21:08:13.061918 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e3951605-dee2-481b-b627-752142d96930 None None] Provisioning complete for port de43c855-5796-4bbc-964b-3637119efc40 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:08:13.062469 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e3951605-dee2-481b-b627-752142d96930 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:13.096115 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e3951605-dee2-481b-b627-752142d96930 None None] Port de43c855-5796-4bbc-964b-3637119efc40 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:08:13.107150 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] For port de43c855-5796-4bbc-964b-3637119efc40, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:08:13.126351 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] For port de43c855-5796-4bbc-964b-3637119efc40, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=de43c855-5796-4bbc-964b-3637119efc40,segment=NetworkSegment(b7e721f1-7e2e-412f-9cf4-f39c3c974ea7),segment_id=b7e721f1-7e2e-412f-9cf4-f39c3c974ea7)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:08:13.130362 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:13.182759 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] Routers {'4d8363bf-eaa8-4eb9-8997-abc692ca0dfc'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:08:13.183384 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:08:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4d8363bf-eaa8-4eb9-8997-abc692ca0dfc'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:08:13.222129 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9cd5da1-3dbe-4b2f-b7be-dcb0de0b46af None None] Pushing event updated for resources: {'Port': ['ID=de43c855-5796-4bbc-964b-3637119efc40,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:08:13.278103 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] Set router 4d8363bf-eaa8-4eb9-8997-abc692ca0dfc gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:08:13.417795 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7c70327-387e-48e5-afd8-70250d7f0102 None None] Provisioning complete for port de43c855-5796-4bbc-964b-3637119efc40 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:08:13.418317 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7c70327-387e-48e5-afd8-70250d7f0102 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:13.497347 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7c70327-387e-48e5-afd8-70250d7f0102 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:13.497781 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4d8363bf-eaa8-4eb9-8997-abc692ca0dfc', 'name': 'router1', 'tenant_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:08:00Z', 'updated_at': '2021-12-09T21:08:10Z', 'revision_number': 2, 'project_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'gw_port_host': None, '_interfaces': [{'id': 'de43c855-5796-4bbc-964b-3637119efc40', 'name': '', 'network_id': '3a283ade-1d8a-4636-9f00-66c3b921a7f6', 'tenant_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'mac_address': 'fa:16:3e:02:8e:ff', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4d8363bf-eaa8-4eb9-8997-abc692ca0dfc', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '6bb3417d-bc3e-410b-9e93-8f7f1c1e5e9e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:08:10Z', 'updated_at': '2021-12-09T21:08:13Z', 'revision_number': 4, 'project_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'subnets': [{'id': '6bb3417d-bc3e-410b-9e93-8f7f1c1e5e9e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'ffd56fd0-6947-49ef-892f-a67b8c14613d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:08:13.525731 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-333370d4-43ff-45c2-b834-3d8133728d7d None None] The sync data for ids ['4d8363bf-eaa8-4eb9-8997-abc692ca0dfc'] in n-d-713301-27 is: [{'id': '4d8363bf-eaa8-4eb9-8997-abc692ca0dfc', 'name': 'router1', 'tenant_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:08:00Z', 'updated_at': '2021-12-09T21:08:10Z', 'revision_number': 2, 'project_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'gw_port_host': None, '_interfaces': [{'id': 'de43c855-5796-4bbc-964b-3637119efc40', 'name': '', 'network_id': '3a283ade-1d8a-4636-9f00-66c3b921a7f6', 'tenant_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'mac_address': 'fa:16:3e:02:8e:ff', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4d8363bf-eaa8-4eb9-8997-abc692ca0dfc', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '6bb3417d-bc3e-410b-9e93-8f7f1c1e5e9e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:08:10Z', 'updated_at': '2021-12-09T21:08:13Z', 'revision_number': 4, 'project_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'subnets': [{'id': '6bb3417d-bc3e-410b-9e93-8f7f1c1e5e9e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'ffd56fd0-6947-49ef-892f-a67b8c14613d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:08:13.528925 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7c70327-387e-48e5-afd8-70250d7f0102 None None] For port de43c855-5796-4bbc-964b-3637119efc40, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=de43c855-5796-4bbc-964b-3637119efc40,segment=NetworkSegment(b7e721f1-7e2e-412f-9cf4-f39c3c974ea7),segment_id=b7e721f1-7e2e-412f-9cf4-f39c3c974ea7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:08:13.534267 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7c70327-387e-48e5-afd8-70250d7f0102 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:13.585499 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7c70327-387e-48e5-afd8-70250d7f0102 None None] Pushing event updated for resources: {'Port': ['ID=de43c855-5796-4bbc-964b-3637119efc40,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:08:14.041225 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52162) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:08:14.161582 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-62d32e95-7904-46a6-a2be-bab345441871 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:08:14.163982 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-62d32e95-7904-46a6-a2be-bab345441871 admin admin] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 842 time: 0.1215794 Dec 09 21:08:14.173468 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c8e040fe-bd7a-4b39-a31d-7c01f1db6b1c admin admin] Request body: {'subnet': {'enable_dhcp': False, 'ip_version': 4, 'name': 'public-subnet', 'cidr': '172.25.3.0/24', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'gateway_ip': '172.25.3.1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:08:14.195264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c8e040fe-bd7a-4b39-a31d-7c01f1db6b1c admin admin] Made reservation on behalf of 274e9361d9a94528a70c75d3890ac6db for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:08:14.197657 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c8e040fe-bd7a-4b39-a31d-7c01f1db6b1c admin admin] Publish callbacks [] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:14.502860 n-d-713301-27 neutron-server[103438]: DEBUG neutron.objects.ports [None req-c8e040fe-bd7a-4b39-a31d-7c01f1db6b1c admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103438) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 09 21:08:14.503293 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c8e040fe-bd7a-4b39-a31d-7c01f1db6b1c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:14.556363 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8e040fe-bd7a-4b39-a31d-7c01f1db6b1c admin admin] Pushing event updated for resources: {'Subnet': ['ID=a8035714-7788-4046-9aac-8912c882c128,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:08:14.566978 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c8e040fe-bd7a-4b39-a31d-7c01f1db6b1c admin admin] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:08:14.567328 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c8e040fe-bd7a-4b39-a31d-7c01f1db6b1c admin admin] Network hostable DHCP agents. Network: 97925a19-460a-4476-8208-41db134b6c83, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:08:14.588050 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c8e040fe-bd7a-4b39-a31d-7c01f1db6b1c admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:08:14.598546 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-c8e040fe-bd7a-4b39-a31d-7c01f1db6b1c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 97925a19-460a-4476-8208-41db134b6c83) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:08:14.603032 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8e040fe-bd7a-4b39-a31d-7c01f1db6b1c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:08:14.603652 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c8e040fe-bd7a-4b39-a31d-7c01f1db6b1c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:14.609611 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-367f0263-5f1b-4b69-84de-732a0ef632c2 None None] Network 97925a19-460a-4476-8208-41db134b6c83 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:08:14.628128 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c8e040fe-bd7a-4b39-a31d-7c01f1db6b1c admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4580846 Dec 09 21:08:14.732512 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3a3eb478-7ab3-4dd6-bf59-b22c5c6f706d None None] Network 97925a19-460a-4476-8208-41db134b6c83 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:08:17.101247 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52170) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:08:17.233418 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-307120d9-470c-4235-adbd-6aa70d135810 admin admin] 10.222.0.13 "GET /v2.0/routers/4d8363bf-eaa8-4eb9-8997-abc692ca0dfc HTTP/1.1" status: 200 len: 710 time: 0.1310153 Dec 09 21:08:17.327477 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c2710b3-5f6c-40f9-bda9-689e2f8c6fff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:08:17.328917 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8c2710b3-5f6c-40f9-bda9-689e2f8c6fff admin admin] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 886 time: 0.0897355 Dec 09 21:08:17.338824 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ae99e4ed-be27-4253-b01c-3d12a112b7da admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:08:17.587966 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae99e4ed-be27-4253-b01c-3d12a112b7da admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:17.935669 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae99e4ed-be27-4253-b01c-3d12a112b7da admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:18.011233 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae99e4ed-be27-4253-b01c-3d12a112b7da admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:18.115552 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-ae99e4ed-be27-4253-b01c-3d12a112b7da admin admin] Allocated IP 172.25.3.109 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/9821c003-fbcf-44bf-bf13-f8d54c4ce218) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:08:18.222586 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae99e4ed-be27-4253-b01c-3d12a112b7da admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:18.259277 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae99e4ed-be27-4253-b01c-3d12a112b7da admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:18.293543 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ae99e4ed-be27-4253-b01c-3d12a112b7da admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:08:18.297588 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-ae99e4ed-be27-4253-b01c-3d12a112b7da admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:08:18.306087 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae99e4ed-be27-4253-b01c-3d12a112b7da admin admin] Pushing event updated for resources: {'Port': ['ID=9821c003-fbcf-44bf-bf13-f8d54c4ce218,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:08:18.318185 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae99e4ed-be27-4253-b01c-3d12a112b7da admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:08:18.564733 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae99e4ed-be27-4253-b01c-3d12a112b7da admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:18.772793 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae99e4ed-be27-4253-b01c-3d12a112b7da admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:18.776659 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae99e4ed-be27-4253-b01c-3d12a112b7da admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-640457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-640448', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-635166'] for router, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:18.888318 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ae99e4ed-be27-4253-b01c-3d12a112b7da admin admin] Router 4d8363bf-eaa8-4eb9-8997-abc692ca0dfc has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:08:18.991534 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ae99e4ed-be27-4253-b01c-3d12a112b7da admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:08:18.997004 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae99e4ed-be27-4253-b01c-3d12a112b7da admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:18.998209 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ae99e4ed-be27-4253-b01c-3d12a112b7da admin admin] 10.222.0.13 "PUT /v2.0/routers/4d8363bf-eaa8-4eb9-8997-abc692ca0dfc HTTP/1.1" status: 200 len: 890 time: 1.6629150 Dec 09 21:08:20.551142 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] Sync routers for ids ['4d8363bf-eaa8-4eb9-8997-abc692ca0dfc'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:08:20.562688 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] Routers {'4d8363bf-eaa8-4eb9-8997-abc692ca0dfc'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:08:20.563463 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:08:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4d8363bf-eaa8-4eb9-8997-abc692ca0dfc'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:08:20.768373 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] Set router 4d8363bf-eaa8-4eb9-8997-abc692ca0dfc gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:08:20.926306 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device de43c855-5796-4bbc-964b-3637119efc40 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:08:21.121020 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port de43c855-5796-4bbc-964b-3637119efc40 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:08:21.121279 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:21.367975 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4d8363bf-eaa8-4eb9-8997-abc692ca0dfc', 'name': 'router1', 'tenant_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.109'}], 'enable_snat': True}, 'gw_port_id': '9821c003-fbcf-44bf-bf13-f8d54c4ce218', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:08:00Z', 'updated_at': '2021-12-09T21:08:18Z', 'revision_number': 4, 'project_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'gw_port': {'id': '9821c003-fbcf-44bf-bf13-f8d54c4ce218', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:a3:66', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4d8363bf-eaa8-4eb9-8997-abc692ca0dfc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.109', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:08:18Z', 'updated_at': '2021-12-09T21:08:18Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'de43c855-5796-4bbc-964b-3637119efc40', 'name': '', 'network_id': '3a283ade-1d8a-4636-9f00-66c3b921a7f6', 'tenant_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'mac_address': 'fa:16:3e:02:8e:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4d8363bf-eaa8-4eb9-8997-abc692ca0dfc', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '6bb3417d-bc3e-410b-9e93-8f7f1c1e5e9e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:08:10Z', 'updated_at': '2021-12-09T21:08:13Z', 'revision_number': 5, 'project_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'subnets': [{'id': '6bb3417d-bc3e-410b-9e93-8f7f1c1e5e9e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'ffd56fd0-6947-49ef-892f-a67b8c14613d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:08:21.421268 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] Checking router: 4d8363bf-eaa8-4eb9-8997-abc692ca0dfc for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:08:21.421645 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] Updating router 4d8363bf-eaa8-4eb9-8997-abc692ca0dfc port 9821c003-fbcf-44bf-bf13-f8d54c4ce218 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:08:21.467207 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:21.618437 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52184) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:08:21.732801 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a4e5b21c-e17e-4b26-a679-a97a47936d22 admin admin] 10.222.0.13 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.1130900 Dec 09 21:08:21.785580 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:21.794798 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:21.851089 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff97c056-30dd-4a98-aa74-33c5145a37e3 None None] Pushing event updated for resources: {'Port': ['ID=9821c003-fbcf-44bf-bf13-f8d54c4ce218,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:08:21.855839 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] Attempting to bind port 9821c003-fbcf-44bf-bf13-f8d54c4ce218 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:08:21.856205 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] Attempting to bind port 9821c003-fbcf-44bf-bf13-f8d54c4ce218 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:08:21.856659 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] Attempting to bind port 9821c003-fbcf-44bf-bf13-f8d54c4ce218 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:08:21.862306 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 8, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:08:21.862725 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:08:21.863131 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:21.863551 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:08:21.864014 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] Bound port: 9821c003-fbcf-44bf-bf13-f8d54c4ce218, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:08:21.864426 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:21.919608 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] For port 9821c003-fbcf-44bf-bf13-f8d54c4ce218, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:08:21.923058 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] For port 9821c003-fbcf-44bf-bf13-f8d54c4ce218, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9821c003-fbcf-44bf-bf13-f8d54c4ce218,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:08:21.928783 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:21.988360 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff97c056-30dd-4a98-aa74-33c5145a37e3 None None] Pushing event updated for resources: {'Port': ['ID=9821c003-fbcf-44bf-bf13-f8d54c4ce218,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:08:21.991112 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] Routers {'4d8363bf-eaa8-4eb9-8997-abc692ca0dfc'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:08:21.991838 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:08:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4d8363bf-eaa8-4eb9-8997-abc692ca0dfc'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:08:22.099137 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] Set router 4d8363bf-eaa8-4eb9-8997-abc692ca0dfc gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:08:22.316457 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4d8363bf-eaa8-4eb9-8997-abc692ca0dfc', 'name': 'router1', 'tenant_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.109'}], 'enable_snat': True}, 'gw_port_id': '9821c003-fbcf-44bf-bf13-f8d54c4ce218', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:08:00Z', 'updated_at': '2021-12-09T21:08:18Z', 'revision_number': 4, 'project_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'gw_port': {'id': '9821c003-fbcf-44bf-bf13-f8d54c4ce218', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:a3:66', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4d8363bf-eaa8-4eb9-8997-abc692ca0dfc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.109', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:08:18Z', 'updated_at': '2021-12-09T21:08:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'de43c855-5796-4bbc-964b-3637119efc40', 'name': '', 'network_id': '3a283ade-1d8a-4636-9f00-66c3b921a7f6', 'tenant_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'mac_address': 'fa:16:3e:02:8e:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4d8363bf-eaa8-4eb9-8997-abc692ca0dfc', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '6bb3417d-bc3e-410b-9e93-8f7f1c1e5e9e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:08:10Z', 'updated_at': '2021-12-09T21:08:13Z', 'revision_number': 5, 'project_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'subnets': [{'id': '6bb3417d-bc3e-410b-9e93-8f7f1c1e5e9e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'ffd56fd0-6947-49ef-892f-a67b8c14613d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:08:22.343393 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-961a7244-dfcf-4331-b9da-d71dc32ba788 None None] The sync data for ids ['4d8363bf-eaa8-4eb9-8997-abc692ca0dfc'] in n-d-713301-27 is: [{'id': '4d8363bf-eaa8-4eb9-8997-abc692ca0dfc', 'name': 'router1', 'tenant_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.109'}], 'enable_snat': True}, 'gw_port_id': '9821c003-fbcf-44bf-bf13-f8d54c4ce218', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:08:00Z', 'updated_at': '2021-12-09T21:08:18Z', 'revision_number': 4, 'project_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'gw_port': {'id': '9821c003-fbcf-44bf-bf13-f8d54c4ce218', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:76:a3:66', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4d8363bf-eaa8-4eb9-8997-abc692ca0dfc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.109', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:08:18Z', 'updated_at': '2021-12-09T21:08:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'de43c855-5796-4bbc-964b-3637119efc40', 'name': '', 'network_id': '3a283ade-1d8a-4636-9f00-66c3b921a7f6', 'tenant_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'mac_address': 'fa:16:3e:02:8e:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4d8363bf-eaa8-4eb9-8997-abc692ca0dfc', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '6bb3417d-bc3e-410b-9e93-8f7f1c1e5e9e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:08:10Z', 'updated_at': '2021-12-09T21:08:13Z', 'revision_number': 5, 'project_id': '8cc06b5e9c5e47e593129dedf4bb894e', 'subnets': [{'id': '6bb3417d-bc3e-410b-9e93-8f7f1c1e5e9e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'ffd56fd0-6947-49ef-892f-a67b8c14613d'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:08:22.914022 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9821c003-fbcf-44bf-bf13-f8d54c4ce218 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:08:22.972218 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 9821c003-fbcf-44bf-bf13-f8d54c4ce218 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:08:22.972594 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:23.060659 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:23.089140 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 9821c003-fbcf-44bf-bf13-f8d54c4ce218, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9821c003-fbcf-44bf-bf13-f8d54c4ce218,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:08:23.100228 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:23.175458 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=9821c003-fbcf-44bf-bf13-f8d54c4ce218,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:08:24.910012 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9821c003-fbcf-44bf-bf13-f8d54c4ce218 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:08:24.961490 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 9821c003-fbcf-44bf-bf13-f8d54c4ce218 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:08:24.961863 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:32.906658 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-54a0a3c5-56d6-4e1a-85ae-ac74532a0ba9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:35.191461 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 5 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:08:35.466667 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-99261162-0fb0-4a65-bd44-7303174f905c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:36.409083 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:37.745285 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:08:39.046529 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:09:02.908208 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6e62659f-6694-4987-8adc-d976b4e4e2a7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:09:05.478448 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-72857faa-8c86-4e6f-b6df-2078fcdbd99f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:09:06.412558 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:09:07.741113 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:09:09.045973 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:09:12.191026 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 5 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:09:32.906029 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d53288dd-c4d1-4e23-bf05-203e0ee81f66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:09:35.485646 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-214ff425-8944-4996-a1d4-b977cd3a3f21 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:09:36.405475 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:09:37.741551 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:09:39.045700 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:09:48.020686 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52700) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:09:48.090153 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-9e5ac29f-ef8f-41f2-8df1-9d6f1882cee0 admin admin] GET failed (client error): The resource could not be found. Dec 09 21:09:48.091359 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9e5ac29f-ef8f-41f2-8df1-9d6f1882cee0 admin admin] 10.222.0.13 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0696814 Dec 09 21:09:48.256639 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2937e6ad-1d02-4f99-895e-75c3fc5eb80c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:09:48.258118 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2937e6ad-1d02-4f99-895e-75c3fc5eb80c admin admin] 10.222.0.13 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1620569 Dec 09 21:09:49.190458 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 5 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:09:50.657330 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52710) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:09:50.751390 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-982d1e5c-e651-4e8b-8ba4-63b2d1e0b769 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:09:50.752755 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-982d1e5c-e651-4e8b-8ba4-63b2d1e0b769 admin admin] 10.222.0.13 "GET /v2.0/subnets/6bb3417d-bc3e-410b-9e93-8f7f1c1e5e9e HTTP/1.1" status: 200 len: 849 time: 0.0944316 Dec 09 21:09:50.767474 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-c060d490-5a21-4a1d-8770-c3e1810e6935 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:09:50.868758 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c060d490-5a21-4a1d-8770-c3e1810e6935 admin admin] Publish callbacks [] for subnet, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:09:51.022341 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c060d490-5a21-4a1d-8770-c3e1810e6935 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8731650215464'] for subnet, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:09:51.134149 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c060d490-5a21-4a1d-8770-c3e1810e6935 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:09:51.134778 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c060d490-5a21-4a1d-8770-c3e1810e6935 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:09:51.136908 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c060d490-5a21-4a1d-8770-c3e1810e6935 admin admin] 10.222.0.13 "PUT /v2.0/subnets/6bb3417d-bc3e-410b-9e93-8f7f1c1e5e9e HTTP/1.1" status: 200 len: 868 time: 0.3750682 Dec 09 21:09:51.137882 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37c06096-7ad5-4d74-b96f-3d612653706e None None] Network 3a283ade-1d8a-4636-9f00-66c3b921a7f6 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:09:51.157366 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c060d490-5a21-4a1d-8770-c3e1810e6935 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6bb3417d-bc3e-410b-9e93-8f7f1c1e5e9e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:09:51.165702 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c060d490-5a21-4a1d-8770-c3e1810e6935 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:09:51.166051 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c060d490-5a21-4a1d-8770-c3e1810e6935 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:09:51.166379 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c060d490-5a21-4a1d-8770-c3e1810e6935 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:09:51.166720 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c060d490-5a21-4a1d-8770-c3e1810e6935 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:09:51.167056 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c060d490-5a21-4a1d-8770-c3e1810e6935 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:09:51.168166 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c060d490-5a21-4a1d-8770-c3e1810e6935 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:09:51.168166 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c060d490-5a21-4a1d-8770-c3e1810e6935 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:09:51.168166 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c060d490-5a21-4a1d-8770-c3e1810e6935 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:09:51.168458 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c060d490-5a21-4a1d-8770-c3e1810e6935 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:09:51.168707 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c060d490-5a21-4a1d-8770-c3e1810e6935 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:09:51.169031 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c060d490-5a21-4a1d-8770-c3e1810e6935 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:09:51.169353 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c060d490-5a21-4a1d-8770-c3e1810e6935 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:09:51.169675 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c060d490-5a21-4a1d-8770-c3e1810e6935 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:09:51.489657 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-99985b66-c393-4f26-8fa4-55f3bdc9189d None None] Provisioning complete for port de43c855-5796-4bbc-964b-3637119efc40 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:09:51.489991 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-99985b66-c393-4f26-8fa4-55f3bdc9189d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:09:51.584925 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-99985b66-c393-4f26-8fa4-55f3bdc9189d None None] Provisioning complete for port 33514cf4-079a-46db-99da-f2b8e58dcf1a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:09:51.585169 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-99985b66-c393-4f26-8fa4-55f3bdc9189d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:09:53.543743 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52720) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:09:53.743106 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d64d269-2c5c-4e6d-aa73-0e559139d601 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:09:53.743535 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d64d269-2c5c-4e6d-aa73-0e559139d601 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:09:53.745169 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3d64d269-2c5c-4e6d-aa73-0e559139d601 admin admin] 10.222.0.13 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2004411 Dec 09 21:09:56.196096 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52728) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:09:56.335011 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd60af0b-5c92-4d27-830e-4bf884af2b5d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:09:56.335472 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd60af0b-5c92-4d27-830e-4bf884af2b5d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:09:56.337061 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fd60af0b-5c92-4d27-830e-4bf884af2b5d admin admin] 10.222.0.13 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1398036 Dec 09 21:09:58.722210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52736) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:09:58.875392 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-210716ae-a66a-4a7d-8ae4-2501b2487692 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:09:58.876803 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-210716ae-a66a-4a7d-8ae4-2501b2487692 admin admin] 10.222.0.13 "GET /v2.0/networks/3a283ade-1d8a-4636-9f00-66c3b921a7f6 HTTP/1.1" status: 200 len: 869 time: 0.1536083 Dec 09 21:10:01.273028 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52744) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:10:01.402713 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4057791f-8390-4768-b4ac-67e6558c4be0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:10:01.404113 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4057791f-8390-4768-b4ac-67e6558c4be0 admin admin] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 886 time: 0.1301079 Dec 09 21:10:02.900316 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-db5f2e4a-a3b9-41e2-82ba-92672e96b3d8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:03.764971 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52752) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:10:03.899128 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0505b520-53a2-4179-8dfd-205c8ddc8b3e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:10:03.899785 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0505b520-53a2-4179-8dfd-205c8ddc8b3e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:10:03.901388 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0505b520-53a2-4179-8dfd-205c8ddc8b3e admin admin] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1354513 Dec 09 21:10:05.481299 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-42419642-cf1f-4336-8fa4-c6a2989b850f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:06.265724 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52760) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:10:06.373325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e6e39c59-b1fc-4c44-9cdf-b7bc722667ce admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:10:06.373769 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e6e39c59-b1fc-4c44-9cdf-b7bc722667ce admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:10:06.375275 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e6e39c59-b1fc-4c44-9cdf-b7bc722667ce admin admin] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1082406 Dec 09 21:10:06.411276 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:07.745960 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:08.743265 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52768) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:10:08.856230 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-feb05229-553a-4f0b-ab29-957baec88b8c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:10:08.858052 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-feb05229-553a-4f0b-ab29-957baec88b8c admin admin] 10.222.0.13 "GET /v2.0/subnets/6bb3417d-bc3e-410b-9e93-8f7f1c1e5e9e HTTP/1.1" status: 200 len: 868 time: 0.1138003 Dec 09 21:10:09.043027 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:11.275852 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52776) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:10:11.377729 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1726fe83-247d-492f-ae68-1a9e9c4378e1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:10:11.379127 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1726fe83-247d-492f-ae68-1a9e9c4378e1 admin admin] 10.222.0.13 "GET /v2.0/subnets/a8035714-7788-4046-9aac-8912c882c128 HTTP/1.1" status: 200 len: 816 time: 0.1022437 Dec 09 21:10:26.191483 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 5 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:10:32.903954 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-990acd8c-79b8-47dc-a3da-fe081c862670 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:35.479431 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3cc4088a-008a-46f5-8418-41426b7b8b26 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:36.411323 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:36.439719 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52830) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:10:36.490844 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [None req-55154631-55f5-4d65-8351-dde0f301af6d admin admin] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:10:36.491890 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-55154631-55f5-4d65-8351-dde0f301af6d admin admin] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0512135 Dec 09 21:10:37.749442 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:39.013493 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52838) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:10:39.043469 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:39.089214 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-d04932e2-bf4d-4546-bf31-c33eabf33cc5 admin admin] GET failed (client error): The resource could not be found. Dec 09 21:10:39.090444 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d04932e2-bf4d-4546-bf31-c33eabf33cc5 admin admin] 10.222.0.13 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0755553 Dec 09 21:10:39.210330 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cdc46350-1c9b-4cec-a571-4886d9093845 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:10:39.211851 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cdc46350-1c9b-4cec-a571-4886d9093845 admin admin] 10.222.0.13 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1165285 Dec 09 21:10:41.631246 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52846) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:10:41.689856 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Request body: {'network': {'shared': True, 'admin_state_up': True, 'name': 'shared'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:10:41.724975 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Made reservation on behalf of 274e9361d9a94528a70c75d3890ac6db for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:10:41.727267 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:41.769631 n-d-713301-27 neutron-server[103438]: WARNING neutron.services.revisions.revision_plugin [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Could not find related network for resource to bump revision. Dec 09 21:10:41.791168 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] vlan segment allocate from pool success with {'vlan_id': 114, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:10:41.809239 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8731650051009', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:41.809733 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Unsubscribe: segment precommit_create {{(pid=103438) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Dec 09 21:10:41.810253 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Added segment 21b42a1d-3e05-4768-9d37-d79980247879 of type vlan for network a65c426d-3aa0-44a9-a050-356ed74ee6a0 Dec 09 21:10:41.866193 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:41.899999 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:41.901542 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:10:41.902356 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:41.962816 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.3304007 Dec 09 21:10:42.008655 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Pushing event updated for resources: {'Network': ['ID=a65c426d-3aa0-44a9-a050-356ed74ee6a0,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:10:42.016305 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:42.016628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:42.016980 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:42.017307 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:42.017628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:42.017947 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:42.018259 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:42.018574 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:42.018888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:42.019182 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:42.019532 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:42.019862 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:42.020160 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-892150b5-1e8f-4e95-a766-143f92ea3b0b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:42.033528 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:10:44.405210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52854) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:10:44.469933 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-abe45470-388b-4daf-a0d8-c239088fb775 admin admin] GET failed (client error): The resource could not be found. Dec 09 21:10:44.471223 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-abe45470-388b-4daf-a0d8-c239088fb775 admin admin] 10.222.0.13 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0649316 Dec 09 21:10:44.588670 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4855f6cb-3409-4418-b682-0448302ec535 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:10:44.590052 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4855f6cb-3409-4418-b682-0448302ec535 admin admin] 10.222.0.13 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.1141181 Dec 09 21:10:44.600402 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-b58c2241-5ca7-4982-91f6-0a373ef88b44 admin admin] Request body: {'subnet': {'ip_version': 4, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'description': 'shared-subnet', 'name': 'shared-subnet', 'cidr': '192.168.233.0/24'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:10:44.623826 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b58c2241-5ca7-4982-91f6-0a373ef88b44 admin admin] Made reservation on behalf of 274e9361d9a94528a70c75d3890ac6db for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:10:44.626114 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b58c2241-5ca7-4982-91f6-0a373ef88b44 admin admin] Publish callbacks [] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:44.794159 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b58c2241-5ca7-4982-91f6-0a373ef88b44 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:44.844872 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b58c2241-5ca7-4982-91f6-0a373ef88b44 admin admin] Pushing event updated for resources: {'Subnet': ['ID=331e71ac-cc5a-4dd1-9d4e-e83d568ec849,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:10:44.860289 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b58c2241-5ca7-4982-91f6-0a373ef88b44 admin admin] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:10:44.860637 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b58c2241-5ca7-4982-91f6-0a373ef88b44 admin admin] Network hostable DHCP agents. Network: a65c426d-3aa0-44a9-a050-356ed74ee6a0, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:10:44.879035 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b58c2241-5ca7-4982-91f6-0a373ef88b44 admin admin] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:10:44.890308 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-b58c2241-5ca7-4982-91f6-0a373ef88b44 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, a65c426d-3aa0-44a9-a050-356ed74ee6a0) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:10:44.894454 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b58c2241-5ca7-4982-91f6-0a373ef88b44 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:10:44.895042 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b58c2241-5ca7-4982-91f6-0a373ef88b44 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:44.899556 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4852dfa2-816d-432c-90ce-af34b193d1a6 None None] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:10:44.920120 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b58c2241-5ca7-4982-91f6-0a373ef88b44 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3142183 Dec 09 21:10:45.009463 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'project_id': '274e9361d9a94528a70c75d3890ac6db', 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:10:45.010772 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:45.248196 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Allocated IP 192.168.233.2 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/9a29c703-7fc0-4bdb-98ad-d287bcff8935) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:10:45.398370 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:45.405939 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:45.448965 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:10:45.451860 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:10:45.454867 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:10:45.465771 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Pushing event updated for resources: {'Port': ['ID=9a29c703-7fc0-4bdb-98ad-d287bcff8935,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:10:45.487428 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:45.487790 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:45.488107 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:45.488441 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:45.488773 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:45.489101 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:45.489426 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:45.489750 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:45.490075 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:45.490399 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:45.490720 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:45.491056 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:45.491359 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:10:45.526188 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Attempting to bind port 9a29c703-7fc0-4bdb-98ad-d287bcff8935 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:10:45.526550 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Attempting to bind port 9a29c703-7fc0-4bdb-98ad-d287bcff8935 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:10:45.526918 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Attempting to bind port 9a29c703-7fc0-4bdb-98ad-d287bcff8935 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:10:45.532102 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 10, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:10:45.532482 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:10:45.532882 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:45.533623 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:10:45.534087 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Bound port: 9a29c703-7fc0-4bdb-98ad-d287bcff8935, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:10:45.534472 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:45.596840 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] For port 9a29c703-7fc0-4bdb-98ad-d287bcff8935, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:10:45.600550 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] For port 9a29c703-7fc0-4bdb-98ad-d287bcff8935, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9a29c703-7fc0-4bdb-98ad-d287bcff8935,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:10:45.605641 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:45.660565 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88e49b5a-79d8-4e99-ab78-c9d114c4f866 None None] Pushing event updated for resources: {'Port': ['ID=9a29c703-7fc0-4bdb-98ad-d287bcff8935,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:10:46.538997 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e04d48c3-a118-4eeb-823f-94a92212d730 None None] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:10:46.618116 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e9ba4231-985c-4163-80aa-84b790a421ba None None] Provisioning complete for port 9a29c703-7fc0-4bdb-98ad-d287bcff8935 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:10:46.618471 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e9ba4231-985c-4163-80aa-84b790a421ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:46.732394 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e9ba4231-985c-4163-80aa-84b790a421ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:46.768139 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e9ba4231-985c-4163-80aa-84b790a421ba None None] For port 9a29c703-7fc0-4bdb-98ad-d287bcff8935, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9a29c703-7fc0-4bdb-98ad-d287bcff8935,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:10:46.772876 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e9ba4231-985c-4163-80aa-84b790a421ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:46.830860 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9ba4231-985c-4163-80aa-84b790a421ba None None] Pushing event updated for resources: {'Port': ['ID=9a29c703-7fc0-4bdb-98ad-d287bcff8935,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:10:46.999053 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a982f176-f375-4549-90a1-223b2ebab4df None None] Provisioning complete for port 9a29c703-7fc0-4bdb-98ad-d287bcff8935 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:10:46.999730 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a982f176-f375-4549-90a1-223b2ebab4df None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:10:47.029393 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9a29c703-7fc0-4bdb-98ad-d287bcff8935 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:10:47.115851 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 9a29c703-7fc0-4bdb-98ad-d287bcff8935 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:10:47.116220 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:11:02.935337 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bcb59efe-5a7c-4324-9e2e-3b8eb721a087 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:11:03.195735 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 5 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:11:05.477329 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3e38abc2-0242-47b0-b8b1-f6f2cccf1052 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:11:06.416021 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:11:07.754024 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:11:09.040270 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:11:32.910443 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ac51e285-ec10-455e-98bf-e366bdfb731c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:11:35.477058 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a7f9a703-823c-457e-a2d5-ab12ae34a2e9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:11:36.418419 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:11:37.762184 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:11:39.056466 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:11:40.196050 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 5 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:12:02.919509 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8aeb94ab-3d75-4881-a058-fe737129dca3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:12:03.801193 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52898) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:12:03.807219 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-d0c77b8b-96fd-465c-a9d6-b51aeb9d59b6 tempest-verify_tempest_config-551285495 tempest-verify_tempest_config-551285495-project] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:12:03.808274 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d0c77b8b-96fd-465c-a9d6-b51aeb9d59b6 tempest-verify_tempest_config-551285495 tempest-verify_tempest_config-551285495-project] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0060713 Dec 09 21:12:04.130209 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52916) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:12:04.239860 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4bb726c1-0929-404e-a908-8a68f05b5da0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:12:04.317100 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4bb726c1-0929-404e-a908-8a68f05b5da0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:12:04.322630 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4bb726c1-0929-404e-a908-8a68f05b5da0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:12:04.368298 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4bb726c1-0929-404e-a908-8a68f05b5da0 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=df95c600a3aa4ef1a0299ec128a5defb&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2370052 Dec 09 21:12:04.369463 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bb726c1-0929-404e-a908-8a68f05b5da0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=13989c6c-a2ed-4416-bfcc-369c809003c9,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:12:04.371226 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52922) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:12:04.376392 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bb726c1-0929-404e-a908-8a68f05b5da0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.376772 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bb726c1-0929-404e-a908-8a68f05b5da0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.377116 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bb726c1-0929-404e-a908-8a68f05b5da0 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.377452 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bb726c1-0929-404e-a908-8a68f05b5da0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.377781 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bb726c1-0929-404e-a908-8a68f05b5da0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.378115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bb726c1-0929-404e-a908-8a68f05b5da0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.378437 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bb726c1-0929-404e-a908-8a68f05b5da0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.378780 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bb726c1-0929-404e-a908-8a68f05b5da0 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.379071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bb726c1-0929-404e-a908-8a68f05b5da0 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.379387 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bb726c1-0929-404e-a908-8a68f05b5da0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.379747 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bb726c1-0929-404e-a908-8a68f05b5da0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.380070 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bb726c1-0929-404e-a908-8a68f05b5da0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.380384 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bb726c1-0929-404e-a908-8a68f05b5da0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.445617 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4210c155-053e-45c5-9f8d-515fb9e9bb01 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:12:04.479809 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4210c155-053e-45c5-9f8d-515fb9e9bb01 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:12:04.592604 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4210c155-053e-45c5-9f8d-515fb9e9bb01 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:12:04.596132 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4210c155-053e-45c5-9f8d-515fb9e9bb01 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:12:04.597256 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4210c155-053e-45c5-9f8d-515fb9e9bb01 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/13989c6c-a2ed-4416-bfcc-369c809003c9 HTTP/1.1" status: 204 len: 168 time: 0.2250404 Dec 09 21:12:04.605432 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4210c155-053e-45c5-9f8d-515fb9e9bb01 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=13989c6c-a2ed-4416-bfcc-369c809003c9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:12:04.612545 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4210c155-053e-45c5-9f8d-515fb9e9bb01 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.612891 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4210c155-053e-45c5-9f8d-515fb9e9bb01 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.613235 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4210c155-053e-45c5-9f8d-515fb9e9bb01 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.613576 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4210c155-053e-45c5-9f8d-515fb9e9bb01 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.613903 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4210c155-053e-45c5-9f8d-515fb9e9bb01 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.614231 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4210c155-053e-45c5-9f8d-515fb9e9bb01 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.614560 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4210c155-053e-45c5-9f8d-515fb9e9bb01 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.614881 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4210c155-053e-45c5-9f8d-515fb9e9bb01 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.615301 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4210c155-053e-45c5-9f8d-515fb9e9bb01 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.615535 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4210c155-053e-45c5-9f8d-515fb9e9bb01 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.615863 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4210c155-053e-45c5-9f8d-515fb9e9bb01 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.616173 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4210c155-053e-45c5-9f8d-515fb9e9bb01 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:04.616496 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4210c155-053e-45c5-9f8d-515fb9e9bb01 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:12:05.472838 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5dcd89d7-7e4b-49e2-a700-d4b1cd32f748 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:12:06.423691 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:12:07.764966 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:12:09.053304 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:12:17.202051 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 5 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:12:32.922291 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4e41b6bf-6296-4941-aa34-53cf14378762 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:12:35.473189 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f8f18da2-1f90-4d6a-aa7f-d6c1bcb4224e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:12:36.434158 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:12:37.776724 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:12:39.046519 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:12:54.206593 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 5 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:13:02.945842 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-423d211f-0dcb-47c6-86c9-ca4c93792341 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:13:05.474798 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2a38c1c1-4753-4d89-9aea-17b31341b2ee None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:13:06.431181 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:13:07.775921 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:13:09.045988 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:13:31.210176 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 5 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:13:32.935212 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b806dc0f-d28b-4dd5-8159-876ba4b8f9b5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:13:35.472395 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7fc2e58a-2e3d-4f6c-b9c3-25a4ff0e5033 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:13:36.434608 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:13:37.785231 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:13:39.043183 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:14:02.928286 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-caebc60f-2ecb-4923-bbaf-42ef99484467 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:14:05.472840 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6cf9c695-571a-4967-afcc-f26735e738be None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:14:06.448201 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:14:07.787195 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:14:08.214111 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 5 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:14:09.046143 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:14:32.925897 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9131fb84-2fad-46a6-b4c7-ccd07e2e4ff5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:14:35.468216 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7ba38f94-f609-471d-9d98-c94553ded2f0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:14:36.453412 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:14:37.792045 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:14:39.047469 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:14:45.218994 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 5 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:14:56.877179 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-638656'] for agent, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:14:57.004960 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-638656'] for agent, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:15:02.995534 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-392ee899-d8b2-4941-acca-c35e8e72d0d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:15:05.477644 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2bffec15-2638-411c-af2b-6bef7de05d8c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:15:06.452939 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:15:07.795693 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:15:09.056522 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:15:22.225264 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:15:26.830544 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:15:26.973937 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:15:32.930463 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-da57c3ba-b654-4b97-8630-eb4bddf7dd98 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:15:35.480006 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b879d254-9fa3-4d60-988a-8522a93acf74 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:15:36.450555 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:15:37.792354 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:15:39.049843 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:15:48.066106 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52978) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:15:48.183023 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-424af91c-fe31-435e-8a70-8242e21b180a admin admin] 10.222.0.13 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4939 time: 0.1157851 Dec 09 21:15:50.607212 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52988) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:15:50.669127 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3f9f2779-5f6d-4773-a1ef-14e10993ee75 admin admin] 10.222.0.13 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4939 time: 0.0606904 Dec 09 21:15:56.830056 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:15:56.971773 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:15:59.222209 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:16:02.931875 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2dae64e1-a8b8-4ff2-8756-3cd51c4527b2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:16:05.480166 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1bac48b7-26c4-4214-b108-8141bc96e891 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:16:06.456340 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:16:07.798463 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:16:09.049293 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:16:26.858635 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:16:26.985222 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:16:32.930076 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-54b6c40c-723a-4cc1-99d5-0c4aabcb7949 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:16:35.474730 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3ff0045b-27d1-43f1-8971-72e65ca2c9d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:16:36.214506 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:16:36.458801 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:16:37.810232 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:16:39.044456 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:16:56.855318 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:16:56.981130 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:02.958346 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b131fb15-2ed4-4abf-aba6-d7217a077a61 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:05.470134 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e726f321-1b0e-43de-98b8-b3b8f28f6f4e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:06.459262 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:07.805744 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:09.059619 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:11.435571 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53070) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:11.633480 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Request body: {'network': {'name': 'tempest-ServersWithSpecificFlavorTestJSON-85948487-network', 'tenant_id': '615039519ef147c78eb38a1d65eac061'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:11.670203 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Made reservation on behalf of 615039519ef147c78eb38a1d65eac061 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:17:11.680275 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:11.690239 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:11.813962 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:11.817988 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:11.831550 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] vlan segment allocate from pool success with {'vlan_id': 141, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:17:11.851688 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:11.852069 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Added segment 946d0405-6c7f-49a7-81bb-30e422c98100 of type vlan for network ce6b6bd1-6a60-4cea-9b70-69fd0290796c Dec 09 21:17:11.889404 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d1cde8f1-4e89-421d-887b-12f0b0209bec,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:11.910136 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:11.910370 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:11.910704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:11.911112 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:11.911362 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:11.911708 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:11.912028 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:11.912353 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:11.912661 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:11.912975 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:11.913410 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:11.914281 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:11.914281 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Tracked resource versions report: Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: pushed versions: Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: { 'AddressGroup': {'1.2'}, Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: 'ConntrackHelper': {'1.0'}, Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: 'LocalIPAssociation': {'1.0'}, Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: 'Log': {'1.0'}, Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: 'Network': {'1.1'}, Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: 'Port': {'1.7'}, Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: 'PortForwarding': {'1.2'}, Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: 'QosPolicy': {'1.10'}, Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: 'SecurityGroup': {'1.5'}, Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: 'SecurityGroupRule': {'1.2'}, Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: 'SubPort': {'1.0'}, Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: 'Subnet': {'1.1'}, Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: 'Trunk': {'1.1'}} Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: consumer versions: Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: { DHCP agent@n-d-713301-27: {}, Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: HyperV agent@n-h1-713301-27: {}, Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: HyperV agent@n-h2-713301-27: {}, Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: L3 agent@n-d-713301-27: {}, Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: Metadata agent@n-d-713301-27: {}, Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: Metering agent@n-d-713301-27: {}, Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: Open vSwitch agent@n-d-713301-27: { 'AddressGroup': '1.2', Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: 'ConntrackHelper': '1.0', Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: 'LocalIPAssociation': '1.0', Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: 'Log': '1.0', Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: 'Network': '1.1', Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: 'Port': '1.7', Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: 'PortForwarding': '1.2', Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: 'QosPolicy': '1.10', Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: 'SecurityGroup': '1.5', Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: 'SecurityGroupRule': '1.2', Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: 'SubPort': '1.0', Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: 'Subnet': '1.1', Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: 'Trunk': '1.1'}} Dec 09 21:17:11.915115 n-d-713301-27 neutron-server[103437]: {{(pid=103437) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 09 21:17:11.921875 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:11.948919 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:11.949991 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:11.951180 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:11.994076 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 895 time: 0.5513039 Dec 09 21:17:11.994330 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53120) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:12.003221 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Request body: {'subnet': {'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-85948487-subnet', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:12.024013 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-060eb911-8fb2-4283-8349-c12a35b33094 admin admin] Pushing event updated for resources: {'Network': ['ID=ce6b6bd1-6a60-4cea-9b70-69fd0290796c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:12.029117 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Made reservation on behalf of 615039519ef147c78eb38a1d65eac061 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:17:12.032747 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Publish callbacks [] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:12.035821 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network ce6b6bd1-6a60-4cea-9b70-69fd0290796c details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:17:12.217520 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:12.269950 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Pushing event updated for resources: {'Subnet': ['ID=9755e5ea-99a7-4073-8693-293dcc00b929,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:12.283175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.283820 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.283948 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.284207 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.284708 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.285210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.285541 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.285865 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.286192 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.286518 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.286863 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.287186 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.287568 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Tracked resource versions report: Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: pushed versions: Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: { 'AddressGroup': {'1.2'}, Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: 'ConntrackHelper': {'1.0'}, Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: 'LocalIPAssociation': {'1.0'}, Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: 'Log': {'1.0'}, Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: 'Network': {'1.1'}, Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: 'Port': {'1.7'}, Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: 'PortForwarding': {'1.2'}, Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: 'QosPolicy': {'1.10'}, Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: 'SecurityGroup': {'1.5'}, Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: 'SecurityGroupRule': {'1.2'}, Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: 'SubPort': {'1.0'}, Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: 'Subnet': {'1.1'}, Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: 'Trunk': {'1.1'}} Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: consumer versions: Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: { DHCP agent@n-d-713301-27: {}, Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: HyperV agent@n-h1-713301-27: {}, Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: HyperV agent@n-h2-713301-27: {}, Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: L3 agent@n-d-713301-27: {}, Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: Metadata agent@n-d-713301-27: {}, Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: Metering agent@n-d-713301-27: {}, Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: Open vSwitch agent@n-d-713301-27: { 'AddressGroup': '1.2', Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: 'ConntrackHelper': '1.0', Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: 'LocalIPAssociation': '1.0', Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: 'Log': '1.0', Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: 'Network': '1.1', Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: 'Port': '1.7', Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: 'PortForwarding': '1.2', Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: 'QosPolicy': '1.10', Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: 'SecurityGroup': '1.5', Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: 'SecurityGroupRule': '1.2', Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: 'SubPort': '1.0', Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: 'Subnet': '1.1', Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: 'Trunk': '1.1'}} Dec 09 21:17:12.288896 n-d-713301-27 neutron-server[103438]: {{(pid=103438) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 09 21:17:12.301447 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Checking segment: {'id': '946d0405-6c7f-49a7-81bb-30e422c98100', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:17:12.301654 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Network hostable DHCP agents. Network: ce6b6bd1-6a60-4cea-9b70-69fd0290796c, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:17:12.318729 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Network ce6b6bd1-6a60-4cea-9b70-69fd0290796c is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:17:12.328531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, ce6b6bd1-6a60-4cea-9b70-69fd0290796c) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:17:12.333875 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:12.334514 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:12.341124 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4d7d99a-1128-4b20-89d1-02e6bab1d9e2 None None] Network ce6b6bd1-6a60-4cea-9b70-69fd0290796c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:17:12.354564 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-38b2da85-42a0-4884-987f-529328003edc admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 858 time: 0.3590994 Dec 09 21:17:12.359286 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53140) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:12.363746 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-e0222311-92d4-45f3-8408-b1c6a0a1374a admin admin] Request body: {'router': {'name': 'tempest-ServersWithSpecificFlavorTestJSON-85948487-router', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:12.390531 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0222311-92d4-45f3-8408-b1c6a0a1374a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:12.394065 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0222311-92d4-45f3-8408-b1c6a0a1374a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:12.464922 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'project_id': '615039519ef147c78eb38a1d65eac061', 'fixed_ips': [{'subnet_id': '9755e5ea-99a7-4073-8693-293dcc00b929'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:17:12.466053 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:12.477955 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0222311-92d4-45f3-8408-b1c6a0a1374a admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:12.620312 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Allocated IP 172.20.0.2 (ce6b6bd1-6a60-4cea-9b70-69fd0290796c/9755e5ea-99a7-4073-8693-293dcc00b929/716dcb03-4af5-4350-90fc-5640b99cb0cd) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:17:12.689356 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0222311-92d4-45f3-8408-b1c6a0a1374a admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:12.792142 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:12.804662 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:12.856079 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Pushing event updated for resources: {'Port': ['ID=716dcb03-4af5-4350-90fc-5640b99cb0cd,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:12.869263 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.869678 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.870084 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.870489 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.870887 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.871283 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.871642 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.871984 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.872288 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.872601 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.872919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.873255 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.873566 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Tracked resource versions report: Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: pushed versions: Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: { 'AddressGroup': {'1.2'}, Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: 'ConntrackHelper': {'1.0'}, Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: 'LocalIPAssociation': {'1.0'}, Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: 'Log': {'1.0'}, Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: 'Network': {'1.1'}, Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: 'Port': {'1.7'}, Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: 'PortForwarding': {'1.2'}, Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: 'QosPolicy': {'1.10'}, Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: 'SecurityGroup': {'1.5'}, Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: 'SecurityGroupRule': {'1.2'}, Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: 'SubPort': {'1.0'}, Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: 'Subnet': {'1.1'}, Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: 'Trunk': {'1.1'}} Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: consumer versions: Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: { DHCP agent@n-d-713301-27: {}, Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: HyperV agent@n-h1-713301-27: {}, Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: HyperV agent@n-h2-713301-27: {}, Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: L3 agent@n-d-713301-27: {}, Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: Metadata agent@n-d-713301-27: {}, Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: Metering agent@n-d-713301-27: {}, Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: Open vSwitch agent@n-d-713301-27: { 'AddressGroup': '1.2', Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: 'ConntrackHelper': '1.0', Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: 'LocalIPAssociation': '1.0', Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: 'Log': '1.0', Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: 'Network': '1.1', Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: 'Port': '1.7', Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: 'PortForwarding': '1.2', Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: 'QosPolicy': '1.10', Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: 'SecurityGroup': '1.5', Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: 'SecurityGroupRule': '1.2', Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: 'SubPort': '1.0', Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: 'Subnet': '1.1', Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: 'Trunk': '1.1'}} Dec 09 21:17:12.874741 n-d-713301-27 neutron-server[103439]: {{(pid=103439) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 09 21:17:12.878621 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Network ce6b6bd1-6a60-4cea-9b70-69fd0290796c is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:17:12.880423 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:17:12.882920 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:17:12.954627 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Attempting to bind port 716dcb03-4af5-4350-90fc-5640b99cb0cd on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:17:12.955004 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Attempting to bind port 716dcb03-4af5-4350-90fc-5640b99cb0cd by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '946d0405-6c7f-49a7-81bb-30e422c98100', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:17:12.955373 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Attempting to bind port 716dcb03-4af5-4350-90fc-5640b99cb0cd on network ce6b6bd1-6a60-4cea-9b70-69fd0290796c {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:17:12.966264 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 17, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:17:12.966649 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Checking segment: {'id': '946d0405-6c7f-49a7-81bb-30e422c98100', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:17:12.967247 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:12.967693 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Bound using segment: {'id': '946d0405-6c7f-49a7-81bb-30e422c98100', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:17:12.968543 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Bound port: 716dcb03-4af5-4350-90fc-5640b99cb0cd, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '946d0405-6c7f-49a7-81bb-30e422c98100', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:17:12.969311 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:12.997569 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0222311-92d4-45f3-8408-b1c6a0a1374a admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:13.035111 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0222311-92d4-45f3-8408-b1c6a0a1374a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:13.047591 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] For port 716dcb03-4af5-4350-90fc-5640b99cb0cd, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:17:13.052432 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] For port 716dcb03-4af5-4350-90fc-5640b99cb0cd, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=716dcb03-4af5-4350-90fc-5640b99cb0cd,segment=NetworkSegment(946d0405-6c7f-49a7-81bb-30e422c98100),segment_id=946d0405-6c7f-49a7-81bb-30e422c98100)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:17:13.058064 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:13.142129 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5e346fe-dac6-45e7-8aba-5374151c364b None None] Pushing event updated for resources: {'Port': ['ID=716dcb03-4af5-4350-90fc-5640b99cb0cd,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:13.218277 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:17:13.238324 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-e0222311-92d4-45f3-8408-b1c6a0a1374a admin admin] Allocated IP 172.25.3.54 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/71527fbc-15cc-46f2-a01a-e672b6c89577) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:17:13.402374 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0222311-92d4-45f3-8408-b1c6a0a1374a admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:13.477033 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53192) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:13.500052 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0222311-92d4-45f3-8408-b1c6a0a1374a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:13.680063 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e0222311-92d4-45f3-8408-b1c6a0a1374a admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:17:13.684353 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0222311-92d4-45f3-8408-b1c6a0a1374a admin admin] Pushing event updated for resources: {'Port': ['ID=71527fbc-15cc-46f2-a01a-e672b6c89577,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:13.686666 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-e0222311-92d4-45f3-8408-b1c6a0a1374a admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:17:13.689920 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0222311-92d4-45f3-8408-b1c6a0a1374a admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:17:14.016057 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0222311-92d4-45f3-8408-b1c6a0a1374a admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:14.035787 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-62edf890-5589-40ec-8b3f-9a02a0911488 tempest-AutoAllocateNetworkTest-833361441 tempest-AutoAllocateNetworkTest-833361441-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=97e6b4afebb94a21bec1df12842b5f1d&shared=False HTTP/1.1" status: 200 len: 208 time: 0.5541947 Dec 09 21:17:14.040168 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53210) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:14.258745 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e090b5e-8125-4dcc-86bc-1ad26f4d7f13 tempest-AutoAllocateNetworkTest-833361441 tempest-AutoAllocateNetworkTest-833361441-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:14.263526 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4e090b5e-8125-4dcc-86bc-1ad26f4d7f13 tempest-AutoAllocateNetworkTest-833361441 tempest-AutoAllocateNetworkTest-833361441-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 764 time: 0.2221723 Dec 09 21:17:14.264121 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53218) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:14.314001 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0222311-92d4-45f3-8408-b1c6a0a1374a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:14.322596 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8fdc2d3b-2810-4499-a086-80d77fbb37cb None None] Network ce6b6bd1-6a60-4cea-9b70-69fd0290796c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:17:14.328076 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ca3e42e7-8db7-4967-9e31-95e89febe07e tempest-AutoAllocateNetworkTest-833361441 tempest-AutoAllocateNetworkTest-833361441-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0628879 Dec 09 21:17:14.328687 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53224) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:14.361588 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-079a9712-1da2-4b2d-87eb-0954e4ef7dfa tempest-AutoAllocateNetworkTest-833361441 tempest-AutoAllocateNetworkTest-833361441-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=97e6b4afebb94a21bec1df12842b5f1d HTTP/1.1" status: 200 len: 208 time: 0.0317953 Dec 09 21:17:14.415739 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c5cc5e00-f5cd-4747-b794-29efd0d2ea80 None None] Provisioning complete for port 716dcb03-4af5-4350-90fc-5640b99cb0cd triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:14.415978 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c5cc5e00-f5cd-4747-b794-29efd0d2ea80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:14.514732 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e0222311-92d4-45f3-8408-b1c6a0a1374a admin admin] Router 3b833388-9a85-4de2-9ce7-fd22b400c313 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:17:14.550575 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c5cc5e00-f5cd-4747-b794-29efd0d2ea80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:14.597069 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c5cc5e00-f5cd-4747-b794-29efd0d2ea80 None None] For port 716dcb03-4af5-4350-90fc-5640b99cb0cd, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=716dcb03-4af5-4350-90fc-5640b99cb0cd,segment=NetworkSegment(946d0405-6c7f-49a7-81bb-30e422c98100),segment_id=946d0405-6c7f-49a7-81bb-30e422c98100)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:17:14.606958 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c5cc5e00-f5cd-4747-b794-29efd0d2ea80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:14.664852 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e0222311-92d4-45f3-8408-b1c6a0a1374a admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:17:14.676135 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] Sync routers for ids ['3b833388-9a85-4de2-9ce7-fd22b400c313'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:17:14.677613 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5cc5e00-f5cd-4747-b794-29efd0d2ea80 None None] Pushing event updated for resources: {'Port': ['ID=716dcb03-4af5-4350-90fc-5640b99cb0cd,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:14.701570 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0222311-92d4-45f3-8408-b1c6a0a1374a admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:14.704825 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] Routers {'3b833388-9a85-4de2-9ce7-fd22b400c313'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:17:14.705467 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:17:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3b833388-9a85-4de2-9ce7-fd22b400c313'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:17:14.706626 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53236) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:14.707770 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e0222311-92d4-45f3-8408-b1c6a0a1374a admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 933 time: 2.3473217 Dec 09 21:17:14.881480 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] Set router 3b833388-9a85-4de2-9ce7-fd22b400c313 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:17:14.939939 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d9d1b518-2e21-4f7c-a8ea-2feb60498496 None None] Provisioning complete for port 716dcb03-4af5-4350-90fc-5640b99cb0cd triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:14.940317 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d9d1b518-2e21-4f7c-a8ea-2feb60498496 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:15.116815 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-85948487-router', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54'}], 'enable_snat': True}, 'gw_port_id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:12Z', 'updated_at': '2021-12-09T21:17:13Z', 'revision_number': 3, 'project_id': '615039519ef147c78eb38a1d65eac061', 'gw_port': {'id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:32:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:13Z', 'updated_at': '2021-12-09T21:17:13Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:17:15.159906 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] Checking router: 3b833388-9a85-4de2-9ce7-fd22b400c313 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:17:15.163698 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] Updating router 3b833388-9a85-4de2-9ce7-fd22b400c313 port 71527fbc-15cc-46f2-a01a-e672b6c89577 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:17:15.200643 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:15.219097 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-acf9458f-e9eb-49e8-821a-144ba11ab848 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:15.271043 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 716dcb03-4af5-4350-90fc-5640b99cb0cd up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:17:15.271361 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53254) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:15.360462 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 716dcb03-4af5-4350-90fc-5640b99cb0cd triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:15.360968 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:15.623050 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-acf9458f-e9eb-49e8-821a-144ba11ab848 admin admin] Allocated IP 172.20.0.1 (ce6b6bd1-6a60-4cea-9b70-69fd0290796c/9755e5ea-99a7-4073-8693-293dcc00b929/f50209a6-36fd-4aea-927f-b79127351066) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:17:15.645359 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:15.652631 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:15.726039 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7255b9e3-b820-41e4-a718-5694c98cc6d6 None None] Pushing event updated for resources: {'Port': ['ID=71527fbc-15cc-46f2-a01a-e672b6c89577,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:15.728507 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1056ecef-2529-4429-ae67-fb9183355cdc admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:15.732289 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] Attempting to bind port 71527fbc-15cc-46f2-a01a-e672b6c89577 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:17:15.732661 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] Attempting to bind port 71527fbc-15cc-46f2-a01a-e672b6c89577 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:17:15.733030 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] Attempting to bind port 71527fbc-15cc-46f2-a01a-e672b6c89577 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:17:15.752857 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 17, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:17:15.753243 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:17:15.753644 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:15.757248 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-acf9458f-e9eb-49e8-821a-144ba11ab848 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:15.761373 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:17:15.764224 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] Bound port: 71527fbc-15cc-46f2-a01a-e672b6c89577, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:17:15.764784 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:15.768342 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7255b9e3-b820-41e4-a718-5694c98cc6d6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:15.773485 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7255b9e3-b820-41e4-a718-5694c98cc6d6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:15.775907 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7255b9e3-b820-41e4-a718-5694c98cc6d6 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:15.776260 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7255b9e3-b820-41e4-a718-5694c98cc6d6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:15.779814 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7255b9e3-b820-41e4-a718-5694c98cc6d6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:15.780432 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7255b9e3-b820-41e4-a718-5694c98cc6d6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:15.782204 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7255b9e3-b820-41e4-a718-5694c98cc6d6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:15.782650 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7255b9e3-b820-41e4-a718-5694c98cc6d6 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:15.783416 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7255b9e3-b820-41e4-a718-5694c98cc6d6 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:15.784233 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7255b9e3-b820-41e4-a718-5694c98cc6d6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:15.784906 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7255b9e3-b820-41e4-a718-5694c98cc6d6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:15.785854 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7255b9e3-b820-41e4-a718-5694c98cc6d6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:15.786752 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7255b9e3-b820-41e4-a718-5694c98cc6d6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7255b9e3-b820-41e4-a718-5694c98cc6d6 None None] Tracked resource versions report: Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: pushed versions: Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: { 'AddressGroup': {'1.2'}, Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: 'ConntrackHelper': {'1.0'}, Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: 'LocalIPAssociation': {'1.0'}, Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: 'Log': {'1.0'}, Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: 'Network': {'1.1'}, Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: 'Port': {'1.7'}, Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: 'PortForwarding': {'1.2'}, Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: 'QosPolicy': {'1.10'}, Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: 'SecurityGroup': {'1.5'}, Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: 'SecurityGroupRule': {'1.2'}, Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: 'SubPort': {'1.0'}, Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: 'Subnet': {'1.1'}, Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: 'Trunk': {'1.1'}} Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: consumer versions: Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: { DHCP agent@n-d-713301-27: {}, Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: HyperV agent@n-h1-713301-27: {}, Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: HyperV agent@n-h2-713301-27: {}, Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: L3 agent@n-d-713301-27: {}, Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: Metadata agent@n-d-713301-27: {}, Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: Metering agent@n-d-713301-27: {}, Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: Open vSwitch agent@n-d-713301-27: { 'AddressGroup': '1.2', Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: 'ConntrackHelper': '1.0', Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: 'LocalIPAssociation': '1.0', Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: 'Log': '1.0', Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: 'Network': '1.1', Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: 'Port': '1.7', Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: 'PortForwarding': '1.2', Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: 'QosPolicy': '1.10', Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: 'SecurityGroup': '1.5', Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: 'SecurityGroupRule': '1.2', Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: 'SubPort': '1.0', Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: 'Subnet': '1.1', Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: 'Trunk': '1.1'}} Dec 09 21:17:15.791610 n-d-713301-27 neutron-server[103440]: {{(pid=103440) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 09 21:17:15.818953 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-acf9458f-e9eb-49e8-821a-144ba11ab848 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:15.867931 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] For port 71527fbc-15cc-46f2-a01a-e672b6c89577, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:17:15.872706 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] For port 71527fbc-15cc-46f2-a01a-e672b6c89577, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=71527fbc-15cc-46f2-a01a-e672b6c89577,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:17:15.881925 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:15.883238 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1056ecef-2529-4429-ae67-fb9183355cdc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:15.883705 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-acf9458f-e9eb-49e8-821a-144ba11ab848 admin admin] Network ce6b6bd1-6a60-4cea-9b70-69fd0290796c is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:17:15.886926 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-acf9458f-e9eb-49e8-821a-144ba11ab848 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:17:15.890568 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acf9458f-e9eb-49e8-821a-144ba11ab848 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:17:15.891160 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-acf9458f-e9eb-49e8-821a-144ba11ab848 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:15.892133 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1056ecef-2529-4429-ae67-fb9183355cdc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:15.950873 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1056ecef-2529-4429-ae67-fb9183355cdc admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=97e6b4afebb94a21bec1df12842b5f1d&name=default HTTP/1.1" status: 200 len: 2992 time: 0.6779983 Dec 09 21:17:15.951658 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1056ecef-2529-4429-ae67-fb9183355cdc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b245484-cae6-4522-8c7a-8dc7f282afbd,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:15.961677 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53280) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:15.965679 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acf9458f-e9eb-49e8-821a-144ba11ab848 admin admin] Pushing event updated for resources: {'Port': ['ID=f50209a6-36fd-4aea-927f-b79127351066,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:16.042147 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7255b9e3-b820-41e4-a718-5694c98cc6d6 None None] Pushing event updated for resources: {'Port': ['ID=71527fbc-15cc-46f2-a01a-e672b6c89577,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:16.045299 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] Routers {'3b833388-9a85-4de2-9ce7-fd22b400c313'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:17:16.045985 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:17:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3b833388-9a85-4de2-9ce7-fd22b400c313'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:17:16.065879 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7fb0c367-fbd2-4f38-a578-2607e77de2c4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:16.100193 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7fb0c367-fbd2-4f38-a578-2607e77de2c4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:16.175919 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7fb0c367-fbd2-4f38-a578-2607e77de2c4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:16.181754 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7fb0c367-fbd2-4f38-a578-2607e77de2c4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:16.185732 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7fb0c367-fbd2-4f38-a578-2607e77de2c4 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/1b245484-cae6-4522-8c7a-8dc7f282afbd HTTP/1.1" status: 204 len: 168 time: 0.2293551 Dec 09 21:17:16.204277 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fb0c367-fbd2-4f38-a578-2607e77de2c4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b245484-cae6-4522-8c7a-8dc7f282afbd,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:16.229663 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-acf9458f-e9eb-49e8-821a-144ba11ab848 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:16.284415 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] Set router 3b833388-9a85-4de2-9ce7-fd22b400c313 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:17:16.284787 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-04f38dc3-a02b-4ce2-80d4-0ea3453d8d5b None None] Provisioning complete for port f50209a6-36fd-4aea-927f-b79127351066 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:16.285389 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-04f38dc3-a02b-4ce2-80d4-0ea3453d8d5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:16.331789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-04f38dc3-a02b-4ce2-80d4-0ea3453d8d5b None None] Port f50209a6-36fd-4aea-927f-b79127351066 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:17:16.448208 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-acf9458f-e9eb-49e8-821a-144ba11ab848 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:16.455906 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-acf9458f-e9eb-49e8-821a-144ba11ab848 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:16.457416 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-acf9458f-e9eb-49e8-821a-144ba11ab848 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:16.493164 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-85948487-router', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54'}], 'enable_snat': True}, 'gw_port_id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:12Z', 'updated_at': '2021-12-09T21:17:13Z', 'revision_number': 3, 'project_id': '615039519ef147c78eb38a1d65eac061', 'gw_port': {'id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:32:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:13Z', 'updated_at': '2021-12-09T21:17:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:17:16.524939 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acf9458f-e9eb-49e8-821a-144ba11ab848 admin admin] Pushing event updated for resources: {'Port': ['ID=f50209a6-36fd-4aea-927f-b79127351066,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:16.532672 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91356fab-0016-4b1f-95ae-eb4badadbacf None None] The sync data for ids ['3b833388-9a85-4de2-9ce7-fd22b400c313'] in n-d-713301-27 is: [{'id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-85948487-router', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54'}], 'enable_snat': True}, 'gw_port_id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:12Z', 'updated_at': '2021-12-09T21:17:13Z', 'revision_number': 3, 'project_id': '615039519ef147c78eb38a1d65eac061', 'gw_port': {'id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:32:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:13Z', 'updated_at': '2021-12-09T21:17:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:17:16.622030 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-acf9458f-e9eb-49e8-821a-144ba11ab848 admin admin] Network ce6b6bd1-6a60-4cea-9b70-69fd0290796c is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:17:16.623561 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-acf9458f-e9eb-49e8-821a-144ba11ab848 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:17:16.780336 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-acf9458f-e9eb-49e8-821a-144ba11ab848 admin admin] Router 3b833388-9a85-4de2-9ce7-fd22b400c313 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:17:16.968150 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d9124f71-2cd6-4445-9fed-a3222e52803c None None] Provisioning complete for port f50209a6-36fd-4aea-927f-b79127351066 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:16.969201 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d9124f71-2cd6-4445-9fed-a3222e52803c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:17.004037 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-acf9458f-e9eb-49e8-821a-144ba11ab848 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:17:17.009487 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-acf9458f-e9eb-49e8-821a-144ba11ab848 admin admin] 10.222.0.13 "PUT /v2.0/routers/3b833388-9a85-4de2-9ce7-fd22b400c313/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3004246 Dec 09 21:17:17.026708 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d9124f71-2cd6-4445-9fed-a3222e52803c None None] Port f50209a6-36fd-4aea-927f-b79127351066 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:17:17.249967 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 71527fbc-15cc-46f2-a01a-e672b6c89577 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:17:17.336849 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 71527fbc-15cc-46f2-a01a-e672b6c89577 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:17.337534 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:17.432198 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:17.463778 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 71527fbc-15cc-46f2-a01a-e672b6c89577, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=71527fbc-15cc-46f2-a01a-e672b6c89577,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:17:17.469393 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:17.519159 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=71527fbc-15cc-46f2-a01a-e672b6c89577,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:18.342324 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53380) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:18.347835 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a24b72e6-dfe0-4f5d-9aff-07cf06fca281 admin admin] Request body: {'network': {'name': 'tempest-ServersWithSpecificFlavorTestJSON-2036517528-network', 'tenant_id': '51b278a30cd94ca7861ad1cdecdc94d3'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:18.372992 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a24b72e6-dfe0-4f5d-9aff-07cf06fca281 admin admin] Made reservation on behalf of 51b278a30cd94ca7861ad1cdecdc94d3 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:17:18.377412 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a24b72e6-dfe0-4f5d-9aff-07cf06fca281 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:18.392025 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a24b72e6-dfe0-4f5d-9aff-07cf06fca281 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:18.394832 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] Sync routers for ids ['3b833388-9a85-4de2-9ce7-fd22b400c313'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:17:18.410303 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] Routers {'3b833388-9a85-4de2-9ce7-fd22b400c313'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:17:18.411156 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:17:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3b833388-9a85-4de2-9ce7-fd22b400c313'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:17:18.533004 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] Set router 3b833388-9a85-4de2-9ce7-fd22b400c313 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:17:18.556928 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a24b72e6-dfe0-4f5d-9aff-07cf06fca281 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:18.566194 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a24b72e6-dfe0-4f5d-9aff-07cf06fca281 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:18.640450 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a24b72e6-dfe0-4f5d-9aff-07cf06fca281 admin admin] vlan segment allocate from pool success with {'vlan_id': 101, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:17:18.643022 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a24b72e6-dfe0-4f5d-9aff-07cf06fca281 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d9593022-b0a6-4122-8646-75540c10b69e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:18.673857 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a24b72e6-dfe0-4f5d-9aff-07cf06fca281 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:18.674203 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-a24b72e6-dfe0-4f5d-9aff-07cf06fca281 admin admin] Added segment 62eb78e6-cc6d-47a2-ae0f-cbd25ddbdfa4 of type vlan for network 3d219282-fb31-40ab-a864-41f6397f4dcb Dec 09 21:17:18.725234 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a24b72e6-dfe0-4f5d-9aff-07cf06fca281 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:18.766598 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a24b72e6-dfe0-4f5d-9aff-07cf06fca281 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:18.768522 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a24b72e6-dfe0-4f5d-9aff-07cf06fca281 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:18.769131 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a24b72e6-dfe0-4f5d-9aff-07cf06fca281 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:18.833647 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a24b72e6-dfe0-4f5d-9aff-07cf06fca281 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 0.4874346 Dec 09 21:17:18.833917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53398) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:18.839598 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-3a40d6cb-2248-4f04-a51a-04bcbdb33a9b admin admin] Request body: {'subnet': {'network_id': '3d219282-fb31-40ab-a864-41f6397f4dcb', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2036517528-subnet', 'tenant_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:18.859781 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-85948487-router', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54'}], 'enable_snat': True}, 'gw_port_id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:12Z', 'updated_at': '2021-12-09T21:17:16Z', 'revision_number': 4, 'project_id': '615039519ef147c78eb38a1d65eac061', 'gw_port': {'id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:32:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:13Z', 'updated_at': '2021-12-09T21:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'f50209a6-36fd-4aea-927f-b79127351066', 'name': '', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'mac_address': 'fa:16:3e:bd:0e:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:15Z', 'updated_at': '2021-12-09T21:17:16Z', 'revision_number': 2, 'project_id': '615039519ef147c78eb38a1d65eac061', 'subnets': [{'id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:17:18.872647 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a24b72e6-dfe0-4f5d-9aff-07cf06fca281 admin admin] Pushing event updated for resources: {'Network': ['ID=3d219282-fb31-40ab-a864-41f6397f4dcb,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:18.896723 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3a40d6cb-2248-4f04-a51a-04bcbdb33a9b admin admin] Made reservation on behalf of 51b278a30cd94ca7861ad1cdecdc94d3 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:17:18.900229 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3a40d6cb-2248-4f04-a51a-04bcbdb33a9b admin admin] Publish callbacks [] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:18.900477 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] Checking router: 3b833388-9a85-4de2-9ce7-fd22b400c313 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:17:18.900981 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] Updating router 3b833388-9a85-4de2-9ce7-fd22b400c313 port f50209a6-36fd-4aea-927f-b79127351066 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:17:18.903289 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 3d219282-fb31-40ab-a864-41f6397f4dcb details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:17:18.990151 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:19.238541 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3a40d6cb-2248-4f04-a51a-04bcbdb33a9b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:19.282616 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 71527fbc-15cc-46f2-a01a-e672b6c89577 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:17:19.306428 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a40d6cb-2248-4f04-a51a-04bcbdb33a9b admin admin] Pushing event updated for resources: {'Subnet': ['ID=a89d028b-7a70-4454-ba5e-148e6d4c8d8c,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:19.309206 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a40d6cb-2248-4f04-a51a-04bcbdb33a9b admin admin] Checking segment: {'id': '62eb78e6-cc6d-47a2-ae0f-cbd25ddbdfa4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '3d219282-fb31-40ab-a864-41f6397f4dcb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:17:19.309345 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a40d6cb-2248-4f04-a51a-04bcbdb33a9b admin admin] Network hostable DHCP agents. Network: 3d219282-fb31-40ab-a864-41f6397f4dcb, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:17:19.332450 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a40d6cb-2248-4f04-a51a-04bcbdb33a9b admin admin] Network 3d219282-fb31-40ab-a864-41f6397f4dcb is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:17:19.352190 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-3a40d6cb-2248-4f04-a51a-04bcbdb33a9b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 3d219282-fb31-40ab-a864-41f6397f4dcb) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:17:19.358770 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a40d6cb-2248-4f04-a51a-04bcbdb33a9b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:19.360021 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3a40d6cb-2248-4f04-a51a-04bcbdb33a9b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:19.360423 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 71527fbc-15cc-46f2-a01a-e672b6c89577 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:19.360580 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:19.364784 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-93e535d4-72aa-45e5-bcac-b34954395d42 None None] Network 3d219282-fb31-40ab-a864-41f6397f4dcb requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:17:19.377602 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3a40d6cb-2248-4f04-a51a-04bcbdb33a9b admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 860 time: 0.5425854 Dec 09 21:17:19.380349 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53434) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:19.386627 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-d8d41955-f1eb-46ef-b72f-b1dc8b122a99 admin admin] Request body: {'router': {'name': 'tempest-ServersWithSpecificFlavorTestJSON-2036517528-router', 'tenant_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:19.411159 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8d41955-f1eb-46ef-b72f-b1dc8b122a99 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:19.412654 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8d41955-f1eb-46ef-b72f-b1dc8b122a99 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:19.447205 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:19.471855 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:19.480080 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8d41955-f1eb-46ef-b72f-b1dc8b122a99 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:19.601157 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53446) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:19.668100 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3cc824b-a1b1-4658-aad3-ef6e503ceca2 None None] Pushing event updated for resources: {'Port': ['ID=f50209a6-36fd-4aea-927f-b79127351066,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:19.707699 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53454) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:19.777537 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8d41955-f1eb-46ef-b72f-b1dc8b122a99 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:19.887388 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] Attempting to bind port f50209a6-36fd-4aea-927f-b79127351066 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:17:19.887822 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] Attempting to bind port f50209a6-36fd-4aea-927f-b79127351066 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '946d0405-6c7f-49a7-81bb-30e422c98100', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:17:19.888183 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] Attempting to bind port f50209a6-36fd-4aea-927f-b79127351066 on network ce6b6bd1-6a60-4cea-9b70-69fd0290796c {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:17:19.896196 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2aab3ed6-6235-4070-943d-697f75b39865 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-3d219282-fb31-40ab-a864-41f6397f4dcb', 'network_id': '3d219282-fb31-40ab-a864-41f6397f4dcb', 'project_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'fixed_ips': [{'subnet_id': 'a89d028b-7a70-4454-ba5e-148e6d4c8d8c'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:17:19.897788 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2aab3ed6-6235-4070-943d-697f75b39865 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:19.973457 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1bacdd12-b88d-43d9-b8a6-b2a3ad6ecdfb admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:19.977167 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 17, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:17:19.978028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] Checking segment: {'id': '946d0405-6c7f-49a7-81bb-30e422c98100', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:17:19.978652 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:19.979252 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] Bound using segment: {'id': '946d0405-6c7f-49a7-81bb-30e422c98100', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:17:19.980026 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] Bound port: f50209a6-36fd-4aea-927f-b79127351066, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '946d0405-6c7f-49a7-81bb-30e422c98100', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:17:19.980618 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:20.036447 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ef2f43c7-1468-478d-9236-1e006ddafbb0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:20.077710 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8d41955-f1eb-46ef-b72f-b1dc8b122a99 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:20.099682 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8d41955-f1eb-46ef-b72f-b1dc8b122a99 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:20.136180 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] For port f50209a6-36fd-4aea-927f-b79127351066, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:17:20.140256 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] For port f50209a6-36fd-4aea-927f-b79127351066, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f50209a6-36fd-4aea-927f-b79127351066,segment=NetworkSegment(946d0405-6c7f-49a7-81bb-30e422c98100),segment_id=946d0405-6c7f-49a7-81bb-30e422c98100)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:17:20.210710 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1bacdd12-b88d-43d9-b8a6-b2a3ad6ecdfb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:20.226032 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1bacdd12-b88d-43d9-b8a6-b2a3ad6ecdfb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:20.256159 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:20.277254 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1bacdd12-b88d-43d9-b8a6-b2a3ad6ecdfb admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=9395ff7aa2584a1db42aab4b7a53a76e&name=default HTTP/1.1" status: 200 len: 2992 time: 0.6724570 Dec 09 21:17:20.280214 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53494) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:20.299639 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bacdd12-b88d-43d9-b8a6-b2a3ad6ecdfb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c313725c-be69-4cb8-b264-0b72e40b9a27,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:20.328169 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ef2f43c7-1468-478d-9236-1e006ddafbb0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:20.334144 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ef2f43c7-1468-478d-9236-1e006ddafbb0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:20.376488 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ef2f43c7-1468-478d-9236-1e006ddafbb0 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=dc043e1ef96a4379a006dc65d0046404&name=default HTTP/1.1" status: 200 len: 2992 time: 0.6669068 Dec 09 21:17:20.381371 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53506) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:20.425274 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-d8d41955-f1eb-46ef-b72f-b1dc8b122a99 admin admin] Allocated IP 172.25.3.191 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/22b93a78-dc98-434f-95ba-67b8e9cc8249) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:17:20.431536 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef2f43c7-1468-478d-9236-1e006ddafbb0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d0a9ad79-261e-4b37-bb88-fdfdd11de309,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:20.460632 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-160561a0-0d39-4ca4-87de-faab989b6339 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:20.484044 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-002dc3d8-0f3e-4531-a442-7c4f7c160e3c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:20.531704 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-160561a0-0d39-4ca4-87de-faab989b6339 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:20.544552 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-002dc3d8-0f3e-4531-a442-7c4f7c160e3c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:20.624998 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-504624af-d1cf-476f-a97d-3d0a2d249c36 None None] Provisioning complete for port f50209a6-36fd-4aea-927f-b79127351066 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:20.625642 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-504624af-d1cf-476f-a97d-3d0a2d249c36 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:20.658779 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-160561a0-0d39-4ca4-87de-faab989b6339 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:20.661496 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-160561a0-0d39-4ca4-87de-faab989b6339 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:20.662651 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-160561a0-0d39-4ca4-87de-faab989b6339 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/d0a9ad79-261e-4b37-bb88-fdfdd11de309 HTTP/1.1" status: 204 len: 168 time: 0.2795980 Dec 09 21:17:20.674963 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-160561a0-0d39-4ca4-87de-faab989b6339 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d0a9ad79-261e-4b37-bb88-fdfdd11de309,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:20.692887 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3cc824b-a1b1-4658-aad3-ef6e503ceca2 None None] Pushing event updated for resources: {'Port': ['ID=f50209a6-36fd-4aea-927f-b79127351066,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:20.694103 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53524) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:20.732961 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8d41955-f1eb-46ef-b72f-b1dc8b122a99 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:20.750440 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-002dc3d8-0f3e-4531-a442-7c4f7c160e3c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:20.754723 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-002dc3d8-0f3e-4531-a442-7c4f7c160e3c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:20.762870 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-002dc3d8-0f3e-4531-a442-7c4f7c160e3c admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/c313725c-be69-4cb8-b264-0b72e40b9a27 HTTP/1.1" status: 204 len: 168 time: 0.4800940 Dec 09 21:17:20.776774 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-2aab3ed6-6235-4070-943d-697f75b39865 None None] Allocated IP 172.20.0.2 (3d219282-fb31-40ab-a864-41f6397f4dcb/a89d028b-7a70-4454-ba5e-148e6d4c8d8c/95ad85de-7e3e-43ef-a88a-30b13cf2dfd2) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:17:20.792018 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-002dc3d8-0f3e-4531-a442-7c4f7c160e3c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c313725c-be69-4cb8-b264-0b72e40b9a27,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:20.816853 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] Routers {'3b833388-9a85-4de2-9ce7-fd22b400c313'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:17:20.831665 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:17:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3b833388-9a85-4de2-9ce7-fd22b400c313'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:17:20.840908 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8d41955-f1eb-46ef-b72f-b1dc8b122a99 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:20.901842 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8d41955-f1eb-46ef-b72f-b1dc8b122a99 admin admin] Pushing event updated for resources: {'Port': ['ID=22b93a78-dc98-434f-95ba-67b8e9cc8249,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:20.915770 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8d41955-f1eb-46ef-b72f-b1dc8b122a99 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:17:20.918096 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-d8d41955-f1eb-46ef-b72f-b1dc8b122a99 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:17:20.924790 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8d41955-f1eb-46ef-b72f-b1dc8b122a99 admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:17:21.040189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] Set router 3b833388-9a85-4de2-9ce7-fd22b400c313 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:17:21.134614 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-504624af-d1cf-476f-a97d-3d0a2d249c36 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:21.164541 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3b649830-bd02-42fc-9b54-a4e1ccffc68a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:21.211478 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-504624af-d1cf-476f-a97d-3d0a2d249c36 None None] For port f50209a6-36fd-4aea-927f-b79127351066, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f50209a6-36fd-4aea-927f-b79127351066,segment=NetworkSegment(946d0405-6c7f-49a7-81bb-30e422c98100),segment_id=946d0405-6c7f-49a7-81bb-30e422c98100)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:17:21.242365 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8d41955-f1eb-46ef-b72f-b1dc8b122a99 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:21.271126 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-504624af-d1cf-476f-a97d-3d0a2d249c36 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:21.277477 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3b649830-bd02-42fc-9b54-a4e1ccffc68a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:21.285528 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3b649830-bd02-42fc-9b54-a4e1ccffc68a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:21.330353 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b649830-bd02-42fc-9b54-a4e1ccffc68a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8162617e-e8dc-4fdc-a047-a3d9c3711731,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:21.390899 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53544) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:21.391411 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3b649830-bd02-42fc-9b54-a4e1ccffc68a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=b60fe8ac74f3493a9e3df348f561e44a&name=default HTTP/1.1" status: 200 len: 2992 time: 0.6912069 Dec 09 21:17:21.459489 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-504624af-d1cf-476f-a97d-3d0a2d249c36 None None] Pushing event updated for resources: {'Port': ['ID=f50209a6-36fd-4aea-927f-b79127351066,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:21.515950 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53548) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:21.534551 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-769af2e4-9b95-4693-a20a-a77a03016608 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:21.538375 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2cd0719f-bdc5-4baa-968d-37ee996d497b None None] Provisioning complete for port f50209a6-36fd-4aea-927f-b79127351066 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:21.538877 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2cd0719f-bdc5-4baa-968d-37ee996d497b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:21.544011 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2aa69706-a123-4862-975c-809ee5e19a12 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:21.578509 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-769af2e4-9b95-4693-a20a-a77a03016608 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:21.599549 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2aab3ed6-6235-4070-943d-697f75b39865 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:21.618303 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2aab3ed6-6235-4070-943d-697f75b39865 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:21.626811 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8d41955-f1eb-46ef-b72f-b1dc8b122a99 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:21.692964 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2aab3ed6-6235-4070-943d-697f75b39865 None None] Pushing event updated for resources: {'Port': ['ID=95ad85de-7e3e-43ef-a88a-30b13cf2dfd2,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:21.712189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2aab3ed6-6235-4070-943d-697f75b39865 None None] Network 3d219282-fb31-40ab-a864-41f6397f4dcb is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:17:21.719205 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-85948487-router', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54'}], 'enable_snat': True}, 'gw_port_id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:12Z', 'updated_at': '2021-12-09T21:17:16Z', 'revision_number': 4, 'project_id': '615039519ef147c78eb38a1d65eac061', 'gw_port': {'id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:32:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:13Z', 'updated_at': '2021-12-09T21:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'f50209a6-36fd-4aea-927f-b79127351066', 'name': '', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'mac_address': 'fa:16:3e:bd:0e:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:15Z', 'updated_at': '2021-12-09T21:17:20Z', 'revision_number': 4, 'project_id': '615039519ef147c78eb38a1d65eac061', 'subnets': [{'id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:17:21.722832 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-2aab3ed6-6235-4070-943d-697f75b39865 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:17:21.779591 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2aa69706-a123-4862-975c-809ee5e19a12 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:21.824081 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2aa69706-a123-4862-975c-809ee5e19a12 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:21.857538 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-769af2e4-9b95-4693-a20a-a77a03016608 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:21.864030 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-769af2e4-9b95-4693-a20a-a77a03016608 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:21.869909 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-769af2e4-9b95-4693-a20a-a77a03016608 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/8162617e-e8dc-4fdc-a047-a3d9c3711731 HTTP/1.1" status: 204 len: 168 time: 0.4778476 Dec 09 21:17:21.886169 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-769af2e4-9b95-4693-a20a-a77a03016608 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8162617e-e8dc-4fdc-a047-a3d9c3711731,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:21.906737 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53570) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:21.908906 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2aa69706-a123-4862-975c-809ee5e19a12 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=72a6cae52fbf4fe7a87d509b0a670375&name=default HTTP/1.1" status: 200 len: 2992 time: 0.3917925 Dec 09 21:17:21.925624 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2aab3ed6-6235-4070-943d-697f75b39865 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:17:21.942699 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14553fae-e1b3-406c-b1c5-076d62292c7d None None] The sync data for ids ['3b833388-9a85-4de2-9ce7-fd22b400c313'] in n-d-713301-27 is: [{'id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-85948487-router', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54'}], 'enable_snat': True}, 'gw_port_id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:12Z', 'updated_at': '2021-12-09T21:17:16Z', 'revision_number': 4, 'project_id': '615039519ef147c78eb38a1d65eac061', 'gw_port': {'id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:32:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:13Z', 'updated_at': '2021-12-09T21:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'f50209a6-36fd-4aea-927f-b79127351066', 'name': '', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'mac_address': 'fa:16:3e:bd:0e:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:15Z', 'updated_at': '2021-12-09T21:17:20Z', 'revision_number': 4, 'project_id': '615039519ef147c78eb38a1d65eac061', 'subnets': [{'id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:17:21.969086 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2aa69706-a123-4862-975c-809ee5e19a12 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=55a492f6-e3f5-40b5-a7d8-adb0af4576ca,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:21.981868 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53576) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:21.997754 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-069ff5fb-e11f-4e8d-8123-7804d3234a30 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:22.094674 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2aab3ed6-6235-4070-943d-697f75b39865 None None] Attempting to bind port 95ad85de-7e3e-43ef-a88a-30b13cf2dfd2 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:17:22.095122 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2aab3ed6-6235-4070-943d-697f75b39865 None None] Attempting to bind port 95ad85de-7e3e-43ef-a88a-30b13cf2dfd2 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '62eb78e6-cc6d-47a2-ae0f-cbd25ddbdfa4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '3d219282-fb31-40ab-a864-41f6397f4dcb'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:17:22.095634 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2aab3ed6-6235-4070-943d-697f75b39865 None None] Attempting to bind port 95ad85de-7e3e-43ef-a88a-30b13cf2dfd2 on network 3d219282-fb31-40ab-a864-41f6397f4dcb {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:17:22.109654 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2aab3ed6-6235-4070-943d-697f75b39865 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 17, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:17:22.110480 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2aab3ed6-6235-4070-943d-697f75b39865 None None] Checking segment: {'id': '62eb78e6-cc6d-47a2-ae0f-cbd25ddbdfa4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '3d219282-fb31-40ab-a864-41f6397f4dcb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:17:22.110889 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2aab3ed6-6235-4070-943d-697f75b39865 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:22.111272 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2aab3ed6-6235-4070-943d-697f75b39865 None None] Bound using segment: {'id': '62eb78e6-cc6d-47a2-ae0f-cbd25ddbdfa4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '3d219282-fb31-40ab-a864-41f6397f4dcb'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:17:22.111820 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2aab3ed6-6235-4070-943d-697f75b39865 None None] Bound port: 95ad85de-7e3e-43ef-a88a-30b13cf2dfd2, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '62eb78e6-cc6d-47a2-ae0f-cbd25ddbdfa4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '3d219282-fb31-40ab-a864-41f6397f4dcb'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:17:22.112204 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2aab3ed6-6235-4070-943d-697f75b39865 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:22.126850 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d8d41955-f1eb-46ef-b72f-b1dc8b122a99 admin admin] Router 7bf902d0-926e-4187-b3f7-bce2ab0302b7 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:17:22.127532 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b33893aa-da73-4d7f-af2c-9df932e94682 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:22.203379 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-069ff5fb-e11f-4e8d-8123-7804d3234a30 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:22.219072 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-069ff5fb-e11f-4e8d-8123-7804d3234a30 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:22.265098 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b33893aa-da73-4d7f-af2c-9df932e94682 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:22.294843 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2aab3ed6-6235-4070-943d-697f75b39865 None None] For port 95ad85de-7e3e-43ef-a88a-30b13cf2dfd2, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:17:22.299326 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2aab3ed6-6235-4070-943d-697f75b39865 None None] For port 95ad85de-7e3e-43ef-a88a-30b13cf2dfd2, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=95ad85de-7e3e-43ef-a88a-30b13cf2dfd2,segment=NetworkSegment(62eb78e6-cc6d-47a2-ae0f-cbd25ddbdfa4),segment_id=62eb78e6-cc6d-47a2-ae0f-cbd25ddbdfa4)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:17:22.312839 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-069ff5fb-e11f-4e8d-8123-7804d3234a30 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4b9c05c4-8b0f-4f50-a3d0-c3ca73c99875,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:22.313585 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2aab3ed6-6235-4070-943d-697f75b39865 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:22.319918 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-069ff5fb-e11f-4e8d-8123-7804d3234a30 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=0cf31fb70bb247199fb63e68444b2ed4&name=default HTTP/1.1" status: 200 len: 2992 time: 0.3369536 Dec 09 21:17:22.322497 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53598) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:22.437159 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b33893aa-da73-4d7f-af2c-9df932e94682 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:22.440629 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b33893aa-da73-4d7f-af2c-9df932e94682 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:22.441982 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b33893aa-da73-4d7f-af2c-9df932e94682 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/55a492f6-e3f5-40b5-a7d8-adb0af4576ca HTTP/1.1" status: 204 len: 168 time: 0.5333395 Dec 09 21:17:22.472523 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b33893aa-da73-4d7f-af2c-9df932e94682 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=55a492f6-e3f5-40b5-a7d8-adb0af4576ca,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:22.475325 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-831925b6-60d3-41e2-8e69-4f4998217184 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:22.477818 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d8d41955-f1eb-46ef-b72f-b1dc8b122a99 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:17:22.491566 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] Sync routers for ids ['7bf902d0-926e-4187-b3f7-bce2ab0302b7'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:17:22.495260 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2aab3ed6-6235-4070-943d-697f75b39865 None None] Pushing event updated for resources: {'Port': ['ID=95ad85de-7e3e-43ef-a88a-30b13cf2dfd2,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:22.511047 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8d41955-f1eb-46ef-b72f-b1dc8b122a99 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:22.520696 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53612) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:22.526757 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] Routers {'7bf902d0-926e-4187-b3f7-bce2ab0302b7'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:17:22.527411 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d8d41955-f1eb-46ef-b72f-b1dc8b122a99 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 936 time: 3.1414461 Dec 09 21:17:22.527571 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:17:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7bf902d0-926e-4187-b3f7-bce2ab0302b7'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:17:22.552897 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-831925b6-60d3-41e2-8e69-4f4998217184 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:22.929143 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] Set router 7bf902d0-926e-4187-b3f7-bce2ab0302b7 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:17:23.080363 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-831925b6-60d3-41e2-8e69-4f4998217184 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:23.080363 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-831925b6-60d3-41e2-8e69-4f4998217184 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:23.083052 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-831925b6-60d3-41e2-8e69-4f4998217184 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/4b9c05c4-8b0f-4f50-a3d0-c3ca73c99875 HTTP/1.1" status: 204 len: 168 time: 0.7595403 Dec 09 21:17:23.101237 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-831925b6-60d3-41e2-8e69-4f4998217184 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4b9c05c4-8b0f-4f50-a3d0-c3ca73c99875,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:23.163328 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53636) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:23.187167 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8e199b46-b4c0-44f3-8bd4-eb5de0b20e2c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:23.331041 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7bf902d0-926e-4187-b3f7-bce2ab0302b7', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2036517528-router', 'tenant_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.191'}], 'enable_snat': True}, 'gw_port_id': '22b93a78-dc98-434f-95ba-67b8e9cc8249', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:19Z', 'updated_at': '2021-12-09T21:17:21Z', 'revision_number': 3, 'project_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'gw_port': {'id': '22b93a78-dc98-434f-95ba-67b8e9cc8249', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:05:e3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7bf902d0-926e-4187-b3f7-bce2ab0302b7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:20Z', 'updated_at': '2021-12-09T21:17:20Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:17:23.353885 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8e199b46-b4c0-44f3-8bd4-eb5de0b20e2c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:23.363713 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8e199b46-b4c0-44f3-8bd4-eb5de0b20e2c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:23.377549 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] Checking router: 7bf902d0-926e-4187-b3f7-bce2ab0302b7 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:17:23.377902 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] Updating router 7bf902d0-926e-4187-b3f7-bce2ab0302b7 port 22b93a78-dc98-434f-95ba-67b8e9cc8249 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:17:23.415753 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:23.433121 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f50209a6-36fd-4aea-927f-b79127351066 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:17:23.482750 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53642) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:23.569053 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f50209a6-36fd-4aea-927f-b79127351066 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:23.569425 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:23.741292 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e199b46-b4c0-44f3-8bd4-eb5de0b20e2c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b9fba64a-bbd7-48bc-b2ae-2326e9f34ed7,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:23.793573 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8e199b46-b4c0-44f3-8bd4-eb5de0b20e2c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=036f88f1294c44d7810e1eef731cc978&name=default HTTP/1.1" status: 200 len: 2992 time: 0.6289585 Dec 09 21:17:23.796464 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53658) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:23.841634 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 95ad85de-7e3e-43ef-a88a-30b13cf2dfd2 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:17:23.959685 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6625118a-31f3-4220-955a-acd7d4abba0d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:23.967811 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 95ad85de-7e3e-43ef-a88a-30b13cf2dfd2 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:23.968452 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:24.009041 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:24.009627 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6625118a-31f3-4220-955a-acd7d4abba0d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:24.010717 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25795716-f932-42b9-92c6-ae55d0997a31 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:24.024072 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:24.102846 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:24.123985 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6625118a-31f3-4220-955a-acd7d4abba0d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:24.126935 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6625118a-31f3-4220-955a-acd7d4abba0d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:24.131827 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6625118a-31f3-4220-955a-acd7d4abba0d admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/b9fba64a-bbd7-48bc-b2ae-2326e9f34ed7 HTTP/1.1" status: 204 len: 168 time: 0.3335807 Dec 09 21:17:24.152813 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6625118a-31f3-4220-955a-acd7d4abba0d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b9fba64a-bbd7-48bc-b2ae-2326e9f34ed7,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:24.166596 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 95ad85de-7e3e-43ef-a88a-30b13cf2dfd2, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=95ad85de-7e3e-43ef-a88a-30b13cf2dfd2,segment=NetworkSegment(62eb78e6-cc6d-47a2-ae0f-cbd25ddbdfa4),segment_id=62eb78e6-cc6d-47a2-ae0f-cbd25ddbdfa4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:17:24.170197 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90ce64c6-9ee7-4694-8fbb-c497b6b2250c None None] Pushing event updated for resources: {'Port': ['ID=22b93a78-dc98-434f-95ba-67b8e9cc8249,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:24.178768 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:24.208746 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] Attempting to bind port 22b93a78-dc98-434f-95ba-67b8e9cc8249 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:17:24.209403 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e6886b5c-9dd8-4cb5-977d-ee9b25603aa5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:24.212696 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] Attempting to bind port 22b93a78-dc98-434f-95ba-67b8e9cc8249 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:17:24.213337 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] Attempting to bind port 22b93a78-dc98-434f-95ba-67b8e9cc8249 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:17:24.237591 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 17, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:17:24.242753 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:17:24.247504 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:24.248142 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:17:24.248796 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] Bound port: 22b93a78-dc98-434f-95ba-67b8e9cc8249, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:17:24.249400 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:24.282886 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=95ad85de-7e3e-43ef-a88a-30b13cf2dfd2,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:24.290421 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e0737b20-811f-432d-9478-9994783657bd None None] Network 3d219282-fb31-40ab-a864-41f6397f4dcb requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:17:24.374235 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] For port 22b93a78-dc98-434f-95ba-67b8e9cc8249, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:17:24.385806 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] For port 22b93a78-dc98-434f-95ba-67b8e9cc8249, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=22b93a78-dc98-434f-95ba-67b8e9cc8249,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:17:24.401712 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:24.402278 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e6886b5c-9dd8-4cb5-977d-ee9b25603aa5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:24.426206 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e6886b5c-9dd8-4cb5-977d-ee9b25603aa5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:24.428109 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53676) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:24.431964 n-d-713301-27 neutron-server[103438]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Dec 09 21:17:24.485265 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a3518c1c-8f41-4d17-975a-649d790be17d None None] Provisioning complete for port 95ad85de-7e3e-43ef-a88a-30b13cf2dfd2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:24.485726 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a3518c1c-8f41-4d17-975a-649d790be17d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:24.498431 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6886b5c-9dd8-4cb5-977d-ee9b25603aa5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5525cb49-56b7-4930-9189-aa272b0223b0,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:24.517861 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-d8bc3cc4-5c40-4032-8513-e16353cc1d69 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=ccb2b63648cb4a5da382475755debe06&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0863397 Dec 09 21:17:24.527196 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e6886b5c-9dd8-4cb5-977d-ee9b25603aa5 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=df9552e237774209826c09e9a294c1b1&name=default HTTP/1.1" status: 200 len: 2992 time: 1.0396969 Dec 09 21:17:24.528300 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53682) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:24.530141 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] Routers {'7bf902d0-926e-4187-b3f7-bce2ab0302b7'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:17:24.534535 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:17:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7bf902d0-926e-4187-b3f7-bce2ab0302b7'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:17:24.582820 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-25795716-f932-42b9-92c6-ae55d0997a31 admin admin] Allocated IP 172.20.0.1 (3d219282-fb31-40ab-a864-41f6397f4dcb/a89d028b-7a70-4454-ba5e-148e6d4c8d8c/dafd2da4-b1b3-45eb-b531-31ec58a729fb) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:17:24.768905 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] Set router 7bf902d0-926e-4187-b3f7-bce2ab0302b7 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:17:24.865759 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-64cc7ef0-7cee-4407-9e25-5af7c2c160a9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:24.877462 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25795716-f932-42b9-92c6-ae55d0997a31 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:24.895101 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90ce64c6-9ee7-4694-8fbb-c497b6b2250c None None] Pushing event updated for resources: {'Port': ['ID=22b93a78-dc98-434f-95ba-67b8e9cc8249,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:24.918559 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-f707a9b7-677f-4313-a26e-4fd5179bba1e tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:24.920460 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-f707a9b7-677f-4313-a26e-4fd5179bba1e tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3931170 Dec 09 21:17:24.945117 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-64cc7ef0-7cee-4407-9e25-5af7c2c160a9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:24.960701 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25795716-f932-42b9-92c6-ae55d0997a31 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:24.968366 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-72e584c1-d745-42fb-9a54-5cf199f72edf tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/quotas/ccb2b63648cb4a5da382475755debe06 HTTP/1.1" status: 200 len: 375 time: 0.0390766 Dec 09 21:17:25.045173 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25795716-f932-42b9-92c6-ae55d0997a31 admin admin] Network 3d219282-fb31-40ab-a864-41f6397f4dcb is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:17:25.048702 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-25795716-f932-42b9-92c6-ae55d0997a31 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:17:25.062636 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25795716-f932-42b9-92c6-ae55d0997a31 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:17:25.063174 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25795716-f932-42b9-92c6-ae55d0997a31 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:25.103619 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-008282f3-93f9-4e73-80e0-a5253bd98ca7 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=ccb2b63648cb4a5da382475755debe06&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1267674 Dec 09 21:17:25.105966 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-64cc7ef0-7cee-4407-9e25-5af7c2c160a9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:25.109538 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-64cc7ef0-7cee-4407-9e25-5af7c2c160a9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:25.111084 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-64cc7ef0-7cee-4407-9e25-5af7c2c160a9 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/5525cb49-56b7-4930-9189-aa272b0223b0 HTTP/1.1" status: 204 len: 168 time: 0.5812845 Dec 09 21:17:25.122070 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64cc7ef0-7cee-4407-9e25-5af7c2c160a9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5525cb49-56b7-4930-9189-aa272b0223b0,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:25.123915 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7271644c-436e-4651-a768-8628c99a2746 None None] Provisioning complete for port 95ad85de-7e3e-43ef-a88a-30b13cf2dfd2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:25.125110 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7271644c-436e-4651-a768-8628c99a2746 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:25.139150 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7bf902d0-926e-4187-b3f7-bce2ab0302b7', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2036517528-router', 'tenant_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.191'}], 'enable_snat': True}, 'gw_port_id': '22b93a78-dc98-434f-95ba-67b8e9cc8249', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:19Z', 'updated_at': '2021-12-09T21:17:21Z', 'revision_number': 3, 'project_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'gw_port': {'id': '22b93a78-dc98-434f-95ba-67b8e9cc8249', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:05:e3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7bf902d0-926e-4187-b3f7-bce2ab0302b7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:20Z', 'updated_at': '2021-12-09T21:17:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:17:25.209669 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25795716-f932-42b9-92c6-ae55d0997a31 admin admin] Pushing event updated for resources: {'Port': ['ID=dafd2da4-b1b3-45eb-b531-31ec58a729fb,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:25.227839 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dba2c868-4ecb-442d-9b4e-8aa449978954 None None] The sync data for ids ['7bf902d0-926e-4187-b3f7-bce2ab0302b7'] in n-d-713301-27 is: [{'id': '7bf902d0-926e-4187-b3f7-bce2ab0302b7', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2036517528-router', 'tenant_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.191'}], 'enable_snat': True}, 'gw_port_id': '22b93a78-dc98-434f-95ba-67b8e9cc8249', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:19Z', 'updated_at': '2021-12-09T21:17:21Z', 'revision_number': 3, 'project_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'gw_port': {'id': '22b93a78-dc98-434f-95ba-67b8e9cc8249', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:05:e3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7bf902d0-926e-4187-b3f7-bce2ab0302b7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:20Z', 'updated_at': '2021-12-09T21:17:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:17:25.433442 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25795716-f932-42b9-92c6-ae55d0997a31 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:25.536066 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 95ad85de-7e3e-43ef-a88a-30b13cf2dfd2 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:17:25.626657 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 95ad85de-7e3e-43ef-a88a-30b13cf2dfd2 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:25.627556 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:25.715867 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-da6a777a-d7d4-4be7-8425-6042a89c062b None None] Provisioning complete for port dafd2da4-b1b3-45eb-b531-31ec58a729fb triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:25.716550 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-da6a777a-d7d4-4be7-8425-6042a89c062b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:25.752479 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25795716-f932-42b9-92c6-ae55d0997a31 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:25.772009 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25795716-f932-42b9-92c6-ae55d0997a31 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:25.773585 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25795716-f932-42b9-92c6-ae55d0997a31 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:25.777407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-da6a777a-d7d4-4be7-8425-6042a89c062b None None] Port dafd2da4-b1b3-45eb-b531-31ec58a729fb cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:17:25.836098 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25795716-f932-42b9-92c6-ae55d0997a31 admin admin] Pushing event updated for resources: {'Port': ['ID=dafd2da4-b1b3-45eb-b531-31ec58a729fb,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:25.925861 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53738) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:25.955139 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8f9f5371-57cd-4e64-a74d-8355ce93de2d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:25.987851 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25795716-f932-42b9-92c6-ae55d0997a31 admin admin] Network 3d219282-fb31-40ab-a864-41f6397f4dcb is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:17:25.993790 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-25795716-f932-42b9-92c6-ae55d0997a31 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:17:26.149529 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53746) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:26.292989 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8f9f5371-57cd-4e64-a74d-8355ce93de2d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:26.307106 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8f9f5371-57cd-4e64-a74d-8355ce93de2d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:26.334690 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-25795716-f932-42b9-92c6-ae55d0997a31 admin admin] Router 7bf902d0-926e-4187-b3f7-bce2ab0302b7 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:17:26.372902 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8f9f5371-57cd-4e64-a74d-8355ce93de2d admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=64f0befff6ff4aa3adcf01d39dee169e&name=default HTTP/1.1" status: 200 len: 2992 time: 0.4459670 Dec 09 21:17:26.373959 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f9f5371-57cd-4e64-a74d-8355ce93de2d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3d3e3264-0ed9-4f0c-8740-02fbb4d8b0ae,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:26.376674 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53758) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:26.420931 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-85459bdf-fc8a-445f-bb6d-bbe1ccbe2f4e None None] Provisioning complete for port dafd2da4-b1b3-45eb-b531-31ec58a729fb triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:26.421320 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-85459bdf-fc8a-445f-bb6d-bbe1ccbe2f4e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:26.513514 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-85459bdf-fc8a-445f-bb6d-bbe1ccbe2f4e None None] Port dafd2da4-b1b3-45eb-b531-31ec58a729fb cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:17:26.556339 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a6967ce5-8a5d-4df8-ae32-e1d60741407c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:26.595761 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-25795716-f932-42b9-92c6-ae55d0997a31 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:17:26.603852 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-25795716-f932-42b9-92c6-ae55d0997a31 admin admin] 10.222.0.13 "PUT /v2.0/routers/7bf902d0-926e-4187-b3f7-bce2ab0302b7/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.0797603 Dec 09 21:17:26.606156 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a6967ce5-8a5d-4df8-ae32-e1d60741407c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:26.696155 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a6967ce5-8a5d-4df8-ae32-e1d60741407c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:26.698754 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a6967ce5-8a5d-4df8-ae32-e1d60741407c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:26.699974 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a6967ce5-8a5d-4df8-ae32-e1d60741407c admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/3d3e3264-0ed9-4f0c-8740-02fbb4d8b0ae HTTP/1.1" status: 204 len: 168 time: 0.3204832 Dec 09 21:17:26.715923 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6967ce5-8a5d-4df8-ae32-e1d60741407c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3d3e3264-0ed9-4f0c-8740-02fbb4d8b0ae,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:26.743675 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72cbaa6c-d834-40c8-8f6e-d61e26c2ea3c req-a2d67540-58a7-4f2b-98d9-caa473345504 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 210 time: 0.5918555 Dec 09 21:17:26.860612 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:26.980126 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:27.304414 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 22b93a78-dc98-434f-95ba-67b8e9cc8249 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:17:27.402534 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 22b93a78-dc98-434f-95ba-67b8e9cc8249 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:27.403155 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:27.514933 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:27.544376 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 22b93a78-dc98-434f-95ba-67b8e9cc8249, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=22b93a78-dc98-434f-95ba-67b8e9cc8249,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:17:27.550009 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:27.609207 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=22b93a78-dc98-434f-95ba-67b8e9cc8249,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:27.664366 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] Sync routers for ids ['7bf902d0-926e-4187-b3f7-bce2ab0302b7'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:17:27.690071 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] Routers {'7bf902d0-926e-4187-b3f7-bce2ab0302b7'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:17:27.690896 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:17:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7bf902d0-926e-4187-b3f7-bce2ab0302b7'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:17:27.875071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.31', 57386) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:27.910086 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] Set router 7bf902d0-926e-4187-b3f7-bce2ab0302b7 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:17:27.931722 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-593b33c4-b533-4d46-b0ea-ab3e5b3afbff tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=ccb2b63648cb4a5da382475755debe06&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0530143 Dec 09 21:17:28.025371 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c945ff4f-1668-45c1-9c0c-807405cfaa07 req-4df30bf6-fcca-4e8b-abcf-fdf40ff94cc8 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 210 time: 0.0439110 Dec 09 21:17:28.310233 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-f5838170-5576-4cd8-ac8e-54c4faf9a0b0 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:28.311830 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-f5838170-5576-4cd8-ac8e-54c4faf9a0b0 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3769941 Dec 09 21:17:28.333193 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7bf902d0-926e-4187-b3f7-bce2ab0302b7', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2036517528-router', 'tenant_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.191'}], 'enable_snat': True}, 'gw_port_id': '22b93a78-dc98-434f-95ba-67b8e9cc8249', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:19Z', 'updated_at': '2021-12-09T21:17:25Z', 'revision_number': 4, 'project_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'gw_port': {'id': '22b93a78-dc98-434f-95ba-67b8e9cc8249', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:05:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bf902d0-926e-4187-b3f7-bce2ab0302b7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:20Z', 'updated_at': '2021-12-09T21:17:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'dafd2da4-b1b3-45eb-b531-31ec58a729fb', 'name': '', 'network_id': '3d219282-fb31-40ab-a864-41f6397f4dcb', 'tenant_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'mac_address': 'fa:16:3e:74:30:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7bf902d0-926e-4187-b3f7-bce2ab0302b7', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'a89d028b-7a70-4454-ba5e-148e6d4c8d8c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:24Z', 'updated_at': '2021-12-09T21:17:25Z', 'revision_number': 2, 'project_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'subnets': [{'id': 'a89d028b-7a70-4454-ba5e-148e6d4c8d8c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:17:28.364910 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] Checking router: 7bf902d0-926e-4187-b3f7-bce2ab0302b7 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:17:28.365354 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] Updating router 7bf902d0-926e-4187-b3f7-bce2ab0302b7 port dafd2da4-b1b3-45eb-b531-31ec58a729fb binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:17:28.397815 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-432627e0-a5ec-4ec9-8171-9c507e4973bd tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Request body: {'port': {'device_id': 'e6721efc-7196-4b31-b864-440bcc89de57', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': 'ccb2b63648cb4a5da382475755debe06'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:28.407558 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:28.489676 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53856) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:28.494741 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c4688349-efea-48b6-a078-93986165459b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Request body: {'security_group': {'name': 'tempest-securitygroup--469611586', 'description': 'tempest-description--1595482930'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:28.540232 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c4688349-efea-48b6-a078-93986165459b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:28.701550 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c4688349-efea-48b6-a078-93986165459b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:28.713226 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c4688349-efea-48b6-a078-93986165459b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:28.758386 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c4688349-efea-48b6-a078-93986165459b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:28.764012 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c4688349-efea-48b6-a078-93986165459b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.2731748 Dec 09 21:17:28.772958 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53874) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:28.786851 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-f3905354-f604-42d6-ad4f-a8e6556c44b2 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Request body: {'security_group_rule': {'security_group_id': '9798184d-82ec-4464-b3fc-95653513aba7', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:28.808984 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-432627e0-a5ec-4ec9-8171-9c507e4973bd tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Made reservation on behalf of ccb2b63648cb4a5da382475755debe06 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:17:28.812628 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-432627e0-a5ec-4ec9-8171-9c507e4973bd tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:28.827926 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-432627e0-a5ec-4ec9-8171-9c507e4973bd tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:28.850564 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f3905354-f604-42d6-ad4f-a8e6556c44b2 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:28.854940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4688349-efea-48b6-a078-93986165459b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9798184d-82ec-4464-b3fc-95653513aba7,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:28.948935 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f3905354-f604-42d6-ad4f-a8e6556c44b2 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:28.956780 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f3905354-f604-42d6-ad4f-a8e6556c44b2 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:28.968195 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-432627e0-a5ec-4ec9-8171-9c507e4973bd tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:28.978789 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-432627e0-a5ec-4ec9-8171-9c507e4973bd tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:28.997704 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3905354-f604-42d6-ad4f-a8e6556c44b2 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d5ea0f84-4917-41e8-8796-e605774834cd,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:28.999875 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:29.009918 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:29.020824 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f3905354-f604-42d6-ad4f-a8e6556c44b2 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:29.024556 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f3905354-f604-42d6-ad4f-a8e6556c44b2 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2513223 Dec 09 21:17:29.024818 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53886) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:29.032560 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-3ec259d2-72ab-4c35-a87d-072259c6c0af tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Request body: {'security_group_rule': {'security_group_id': '9798184d-82ec-4464-b3fc-95653513aba7', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:29.090187 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3ec259d2-72ab-4c35-a87d-072259c6c0af tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:29.096272 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-432627e0-a5ec-4ec9-8171-9c507e4973bd tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Pushing event updated for resources: {'SecurityGroup': ['ID=cf1d3e91-3176-48c8-adff-dd58205947d5,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:29.218218 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78b67567-d359-4c4c-8c8c-cf61cc09b3e2 None None] Pushing event updated for resources: {'Port': ['ID=dafd2da4-b1b3-45eb-b531-31ec58a729fb,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:29.222847 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3ec259d2-72ab-4c35-a87d-072259c6c0af tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:29.234763 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3ec259d2-72ab-4c35-a87d-072259c6c0af tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:29.302069 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3ec259d2-72ab-4c35-a87d-072259c6c0af tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:29.306202 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3ec259d2-72ab-4c35-a87d-072259c6c0af tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2755606 Dec 09 21:17:29.309237 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53894) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:29.313847 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-6c5eca34-26d3-43e9-b4f3-b5049870ddef tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:29.319310 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ec259d2-72ab-4c35-a87d-072259c6c0af tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=35cb730e-6978-4982-95b1-ee55ca9e162e,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:29.329014 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 22b93a78-dc98-434f-95ba-67b8e9cc8249 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:17:29.374609 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6c5eca34-26d3-43e9-b4f3-b5049870ddef tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:29.395953 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] Attempting to bind port dafd2da4-b1b3-45eb-b531-31ec58a729fb on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:17:29.399558 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] Attempting to bind port dafd2da4-b1b3-45eb-b531-31ec58a729fb by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '62eb78e6-cc6d-47a2-ae0f-cbd25ddbdfa4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '3d219282-fb31-40ab-a864-41f6397f4dcb'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:17:29.400016 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] Attempting to bind port dafd2da4-b1b3-45eb-b531-31ec58a729fb on network 3d219282-fb31-40ab-a864-41f6397f4dcb {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:17:29.426704 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 17, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:17:29.429965 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] Checking segment: {'id': '62eb78e6-cc6d-47a2-ae0f-cbd25ddbdfa4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '3d219282-fb31-40ab-a864-41f6397f4dcb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:17:29.431045 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:29.431045 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] Bound using segment: {'id': '62eb78e6-cc6d-47a2-ae0f-cbd25ddbdfa4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '3d219282-fb31-40ab-a864-41f6397f4dcb'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:17:29.432312 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] Bound port: dafd2da4-b1b3-45eb-b531-31ec58a729fb, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '62eb78e6-cc6d-47a2-ae0f-cbd25ddbdfa4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '3d219282-fb31-40ab-a864-41f6397f4dcb'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:17:29.434884 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:29.502393 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-490bb83e-7425-417c-ab1d-c034670ea33e req-20b4c63b-3598-4212-9262-23b1acee5159 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 210 time: 0.0642192 Dec 09 21:17:29.651943 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-432627e0-a5ec-4ec9-8171-9c507e4973bd tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Allocated IP 192.168.233.38 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/45acc430-900d-475a-af6a-44f47e8a8d29) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:17:29.736273 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] For port dafd2da4-b1b3-45eb-b531-31ec58a729fb, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:17:29.744446 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] For port dafd2da4-b1b3-45eb-b531-31ec58a729fb, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=dafd2da4-b1b3-45eb-b531-31ec58a729fb,segment=NetworkSegment(62eb78e6-cc6d-47a2-ae0f-cbd25ddbdfa4),segment_id=62eb78e6-cc6d-47a2-ae0f-cbd25ddbdfa4)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:17:29.766003 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6c5eca34-26d3-43e9-b4f3-b5049870ddef tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:29.776362 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:29.925210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53922) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:29.940468 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78b67567-d359-4c4c-8c8c-cf61cc09b3e2 None None] Pushing event updated for resources: {'Port': ['ID=dafd2da4-b1b3-45eb-b531-31ec58a729fb,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:29.977888 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 22b93a78-dc98-434f-95ba-67b8e9cc8249 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:29.978688 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:30.078738 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-20ca5d8e-c008-4660-9843-b3db8335c7db None None] Provisioning complete for port dafd2da4-b1b3-45eb-b531-31ec58a729fb triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:30.078738 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-20ca5d8e-c008-4660-9843-b3db8335c7db None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:30.130433 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-6c5eca34-26d3-43e9-b4f3-b5049870ddef tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Allocated IP 172.25.3.108 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/f0c87a24-0ee6-49bc-9f20-a97afbe91fa3) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:17:30.157842 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-432627e0-a5ec-4ec9-8171-9c507e4973bd tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:30.254473 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-432627e0-a5ec-4ec9-8171-9c507e4973bd tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:30.380972 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] Routers {'7bf902d0-926e-4187-b3f7-bce2ab0302b7'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:17:30.382305 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:17:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7bf902d0-926e-4187-b3f7-bce2ab0302b7'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:17:30.521028 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-432627e0-a5ec-4ec9-8171-9c507e4973bd tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:17:30.538621 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-432627e0-a5ec-4ec9-8171-9c507e4973bd tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:17:30.555641 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-432627e0-a5ec-4ec9-8171-9c507e4973bd tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:17:30.574229 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6c5eca34-26d3-43e9-b4f3-b5049870ddef tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:30.581212 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-432627e0-a5ec-4ec9-8171-9c507e4973bd tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:30.582241 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-432627e0-a5ec-4ec9-8171-9c507e4973bd tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:30.683590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-432627e0-a5ec-4ec9-8171-9c507e4973bd tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Pushing event updated for resources: {'Port': ['ID=45acc430-900d-475a-af6a-44f47e8a8d29,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:30.701015 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-432627e0-a5ec-4ec9-8171-9c507e4973bd tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 2.3075962 Dec 09 21:17:30.709956 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6c5eca34-26d3-43e9-b4f3-b5049870ddef tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:30.733276 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-96a90763-a5d0-4af6-bc55-8899e38911e1 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:17:30.736573 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-96a90763-a5d0-4af6-bc55-8899e38911e1 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0082383 Dec 09 21:17:30.852914 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c5eca34-26d3-43e9-b4f3-b5049870ddef tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Pushing event updated for resources: {'Port': ['ID=f0c87a24-0ee6-49bc-9f20-a97afbe91fa3,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:30.870859 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53954) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:30.874318 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-5a00838b-7bc7-4bc8-a531-a477ac8a9699 admin admin] Request body: {'network': {'name': 'tempest-LiveMigrationRemoteConsolesV26Test-2589652-network', 'tenant_id': '3c14281534c742718d0751894c69cb73'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:30.936550 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6c5eca34-26d3-43e9-b4f3-b5049870ddef tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:17:30.946191 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-6c5eca34-26d3-43e9-b4f3-b5049870ddef tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:17:30.950431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c5eca34-26d3-43e9-b4f3-b5049870ddef tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:17:30.984608 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-20ca5d8e-c008-4660-9843-b3db8335c7db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:31.013078 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] Set router 7bf902d0-926e-4187-b3f7-bce2ab0302b7 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:17:31.134319 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5a00838b-7bc7-4bc8-a531-a477ac8a9699 admin admin] Made reservation on behalf of 3c14281534c742718d0751894c69cb73 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:17:31.143118 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5a00838b-7bc7-4bc8-a531-a477ac8a9699 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:31.157710 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e47038d4-5efe-4b3b-ba7e-385b437344f8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:31.174288 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5a00838b-7bc7-4bc8-a531-a477ac8a9699 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:31.258338 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fb628f5-b02b-466b-9c1b-4650b505fd17 req-312ec1e9-37d4-442f-9a06-80b58eae9a35 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:31.272273 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5fb628f5-b02b-466b-9c1b-4650b505fd17 req-312ec1e9-37d4-442f-9a06-80b58eae9a35 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 935 time: 0.2463105 Dec 09 21:17:31.287674 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6c5eca34-26d3-43e9-b4f3-b5049870ddef tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:31.334433 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e47038d4-5efe-4b3b-ba7e-385b437344f8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:31.343206 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e47038d4-5efe-4b3b-ba7e-385b437344f8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:31.397537 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e47038d4-5efe-4b3b-ba7e-385b437344f8 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=06032de0ae8e49cda71f45db7e39da2b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5226507 Dec 09 21:17:31.397979 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53964) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:31.479256 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-20ca5d8e-c008-4660-9843-b3db8335c7db None None] For port dafd2da4-b1b3-45eb-b531-31ec58a729fb, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=dafd2da4-b1b3-45eb-b531-31ec58a729fb,segment=NetworkSegment(62eb78e6-cc6d-47a2-ae0f-cbd25ddbdfa4),segment_id=62eb78e6-cc6d-47a2-ae0f-cbd25ddbdfa4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:17:31.490930 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-20ca5d8e-c008-4660-9843-b3db8335c7db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:31.530727 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d6b3ec4-62a9-4210-b573-a7003bbddcbc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:31.549611 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6c5eca34-26d3-43e9-b4f3-b5049870ddef tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:31.561446 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d6b3ec4-62a9-4210-b573-a7003bbddcbc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:31.567284 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5fb628f5-b02b-466b-9c1b-4650b505fd17 req-b5884623-3570-4c3a-9c9f-d45c96851409 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/security-groups?id=cf1d3e91-3176-48c8-adff-dd58205947d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2938628 Dec 09 21:17:31.634467 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20ca5d8e-c008-4660-9843-b3db8335c7db None None] Pushing event updated for resources: {'Port': ['ID=dafd2da4-b1b3-45eb-b531-31ec58a729fb,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:31.637957 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d6b3ec4-62a9-4210-b573-a7003bbddcbc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:31.652162 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d6b3ec4-62a9-4210-b573-a7003bbddcbc admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:31.653947 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2d6b3ec4-62a9-4210-b573-a7003bbddcbc admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/b9bdd6b9-49fb-41f9-81df-75b179608a67 HTTP/1.1" status: 204 len: 168 time: 0.2530677 Dec 09 21:17:31.667301 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e47038d4-5efe-4b3b-ba7e-385b437344f8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b9bdd6b9-49fb-41f9-81df-75b179608a67,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:31.703898 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-09ef4586-2e2f-46d5-afea-ba4a937cb4a1 None None] Provisioning complete for port 45acc430-900d-475a-af6a-44f47e8a8d29 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:31.704286 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-09ef4586-2e2f-46d5-afea-ba4a937cb4a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:31.723415 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d6b3ec4-62a9-4210-b573-a7003bbddcbc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b9bdd6b9-49fb-41f9-81df-75b179608a67,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:31.760135 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-90dd2601-9562-4cc2-8392-c67488f2f829 service neutron] Request body: {'port': {'device_id': 'e6721efc-7196-4b31-b864-440bcc89de57', 'device_owner': 'compute:tempest-test_az-1650541094', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:31.807138 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7bf902d0-926e-4187-b3f7-bce2ab0302b7', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2036517528-router', 'tenant_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.191'}], 'enable_snat': True}, 'gw_port_id': '22b93a78-dc98-434f-95ba-67b8e9cc8249', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:19Z', 'updated_at': '2021-12-09T21:17:25Z', 'revision_number': 4, 'project_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'gw_port': {'id': '22b93a78-dc98-434f-95ba-67b8e9cc8249', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:05:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bf902d0-926e-4187-b3f7-bce2ab0302b7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:20Z', 'updated_at': '2021-12-09T21:17:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'dafd2da4-b1b3-45eb-b531-31ec58a729fb', 'name': '', 'network_id': '3d219282-fb31-40ab-a864-41f6397f4dcb', 'tenant_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'mac_address': 'fa:16:3e:74:30:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7bf902d0-926e-4187-b3f7-bce2ab0302b7', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'a89d028b-7a70-4454-ba5e-148e6d4c8d8c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:24Z', 'updated_at': '2021-12-09T21:17:29Z', 'revision_number': 4, 'project_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'subnets': [{'id': 'a89d028b-7a70-4454-ba5e-148e6d4c8d8c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:17:31.843887 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5a00838b-7bc7-4bc8-a531-a477ac8a9699 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:31.866747 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5a00838b-7bc7-4bc8-a531-a477ac8a9699 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:31.874276 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af181777-ae38-48d9-9ddf-b80c04ad71f3 None None] The sync data for ids ['7bf902d0-926e-4187-b3f7-bce2ab0302b7'] in n-d-713301-27 is: [{'id': '7bf902d0-926e-4187-b3f7-bce2ab0302b7', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2036517528-router', 'tenant_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.191'}], 'enable_snat': True}, 'gw_port_id': '22b93a78-dc98-434f-95ba-67b8e9cc8249', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:19Z', 'updated_at': '2021-12-09T21:17:25Z', 'revision_number': 4, 'project_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'gw_port': {'id': '22b93a78-dc98-434f-95ba-67b8e9cc8249', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:05:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bf902d0-926e-4187-b3f7-bce2ab0302b7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:20Z', 'updated_at': '2021-12-09T21:17:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'dafd2da4-b1b3-45eb-b531-31ec58a729fb', 'name': '', 'network_id': '3d219282-fb31-40ab-a864-41f6397f4dcb', 'tenant_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'mac_address': 'fa:16:3e:74:30:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7bf902d0-926e-4187-b3f7-bce2ab0302b7', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'a89d028b-7a70-4454-ba5e-148e6d4c8d8c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:24Z', 'updated_at': '2021-12-09T21:17:29Z', 'revision_number': 4, 'project_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'subnets': [{'id': 'a89d028b-7a70-4454-ba5e-148e6d4c8d8c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:17:31.881999 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-09ef4586-2e2f-46d5-afea-ba4a937cb4a1 None None] Port 45acc430-900d-475a-af6a-44f47e8a8d29 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:17:31.907464 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-09ef4586-2e2f-46d5-afea-ba4a937cb4a1 None None] Provisioning complete for port dafd2da4-b1b3-45eb-b531-31ec58a729fb triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:31.908097 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-09ef4586-2e2f-46d5-afea-ba4a937cb4a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:31.940106 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-90dd2601-9562-4cc2-8392-c67488f2f829 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:32.155696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5a00838b-7bc7-4bc8-a531-a477ac8a9699 admin admin] vlan segment allocate from pool success with {'vlan_id': 119, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:17:32.157754 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5a00838b-7bc7-4bc8-a531-a477ac8a9699 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:32.157754 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-5a00838b-7bc7-4bc8-a531-a477ac8a9699 admin admin] Added segment 19a10c74-fb9a-4880-93a3-1e2abb6672e9 of type vlan for network 14990058-14f1-45bd-b2b7-b002cb7197ed Dec 09 21:17:32.208504 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5a00838b-7bc7-4bc8-a531-a477ac8a9699 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:32.285433 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5a00838b-7bc7-4bc8-a531-a477ac8a9699 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:32.289551 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a00838b-7bc7-4bc8-a531-a477ac8a9699 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:32.290238 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5a00838b-7bc7-4bc8-a531-a477ac8a9699 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:32.441057 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5a00838b-7bc7-4bc8-a531-a477ac8a9699 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 895 time: 2.5103784 Dec 09 21:17:32.442089 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a00838b-7bc7-4bc8-a531-a477ac8a9699 admin admin] Pushing event updated for resources: {'Network': ['ID=14990058-14f1-45bd-b2b7-b002cb7197ed,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:32.446040 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54000) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:32.462635 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a00838b-7bc7-4bc8-a531-a477ac8a9699 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=63b5779c-cb87-4cdd-821a-1c3b72b9942e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:32.466964 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 14990058-14f1-45bd-b2b7-b002cb7197ed details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:17:32.534425 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54006) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:32.547771 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c22de44c-e475-4499-9139-46d745a39c76 admin admin] Request body: {'subnet': {'network_id': '14990058-14f1-45bd-b2b7-b002cb7197ed', 'cidr': '172.20.0.0/28', 'name': 'tempest-LiveMigrationRemoteConsolesV26Test-2589652-subnet', 'tenant_id': '3c14281534c742718d0751894c69cb73', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:32.627114 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bc0b70db-3c77-463c-835e-0ce5e3811044 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:32.693171 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54018) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:32.877833 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c22de44c-e475-4499-9139-46d745a39c76 admin admin] Made reservation on behalf of 3c14281534c742718d0751894c69cb73 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:17:32.886795 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c22de44c-e475-4499-9139-46d745a39c76 admin admin] Publish callbacks [] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:32.936139 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bc0b70db-3c77-463c-835e-0ce5e3811044 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:32.946849 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bc0b70db-3c77-463c-835e-0ce5e3811044 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:32.977570 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6f9cfb12-7337-491a-b223-045989f90971 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:32.989734 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-90dd2601-9562-4cc2-8392-c67488f2f829 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 45acc430-900d-475a-af6a-44f47e8a8d29 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:17:32.994341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc0b70db-3c77-463c-835e-0ce5e3811044 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d9bf9a21-9e93-42e7-9e05-0d03cc36fc4f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:33.014030 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6a21b4c7-f651-41a1-8963-a06e8990ec4c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:33.023370 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-90dd2601-9562-4cc2-8392-c67488f2f829 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:33.097994 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6c5eca34-26d3-43e9-b4f3-b5049870ddef tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:33.105740 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bc0b70db-3c77-463c-835e-0ce5e3811044 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e991a7a22dc14386a6b7960ab440594e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5639639 Dec 09 21:17:33.114392 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54036) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:33.116256 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6c5eca34-26d3-43e9-b4f3-b5049870ddef tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:33.119505 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-90dd2601-9562-4cc2-8392-c67488f2f829 service neutron] Transition to ACTIVE for port object 45acc430-900d-475a-af6a-44f47e8a8d29 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:17:33.130376 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-90dd2601-9562-4cc2-8392-c67488f2f829 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:33.259493 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6c5eca34-26d3-43e9-b4f3-b5049870ddef tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:33.332099 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90dd2601-9562-4cc2-8392-c67488f2f829 service neutron] Pushing event updated for resources: {'Port': ['ID=45acc430-900d-475a-af6a-44f47e8a8d29,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:33.378809 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-90dd2601-9562-4cc2-8392-c67488f2f829 service neutron] Attempting to bind port 45acc430-900d-475a-af6a-44f47e8a8d29 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:17:33.379221 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-90dd2601-9562-4cc2-8392-c67488f2f829 service neutron] Attempting to bind port 45acc430-900d-475a-af6a-44f47e8a8d29 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:17:33.379776 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-90dd2601-9562-4cc2-8392-c67488f2f829 service neutron] Attempting to bind port 45acc430-900d-475a-af6a-44f47e8a8d29 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:17:33.396928 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6a21b4c7-f651-41a1-8963-a06e8990ec4c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:33.397721 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-90dd2601-9562-4cc2-8392-c67488f2f829 service neutron] Port 45acc430-900d-475a-af6a-44f47e8a8d29 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:17:33.401080 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-90dd2601-9562-4cc2-8392-c67488f2f829 service neutron] Attempting to bind port 45acc430-900d-475a-af6a-44f47e8a8d29 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:17:33.406164 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6a21b4c7-f651-41a1-8963-a06e8990ec4c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:33.421881 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e40f7b3-c3a7-4b10-9010-e83560ea4f7c req-97416be8-fc50-4a11-875f-009c047f4eaf tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:33.423326 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e40f7b3-c3a7-4b10-9010-e83560ea4f7c req-97416be8-fc50-4a11-875f-009c047f4eaf tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 935 time: 0.7080810 Dec 09 21:17:33.429891 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device dafd2da4-b1b3-45eb-b531-31ec58a729fb up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:17:33.441153 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c5eca34-26d3-43e9-b4f3-b5049870ddef tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Pushing event updated for resources: {'Port': ['ID=f0c87a24-0ee6-49bc-9f20-a97afbe91fa3,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:33.465767 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6c5eca34-26d3-43e9-b4f3-b5049870ddef tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:33.501613 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6c5eca34-26d3-43e9-b4f3-b5049870ddef tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 4.1912043 Dec 09 21:17:33.517000 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a21b4c7-f651-41a1-8963-a06e8990ec4c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b852d663-eea1-4eb2-a1f2-f4a4086a574e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:33.558646 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-90dd2601-9562-4cc2-8392-c67488f2f829 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 17, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:17:33.559491 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-90dd2601-9562-4cc2-8392-c67488f2f829 service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:17:33.559610 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-90dd2601-9562-4cc2-8392-c67488f2f829 service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:17:33.563852 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-90dd2601-9562-4cc2-8392-c67488f2f829 service neutron] Bound port: 45acc430-900d-475a-af6a-44f47e8a8d29, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:17:33.564263 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-90dd2601-9562-4cc2-8392-c67488f2f829 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:33.614429 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port dafd2da4-b1b3-45eb-b531-31ec58a729fb triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:33.615077 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:33.625503 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fe45e895-a6ff-4b4f-addf-4756a8ebf7f2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:33.670379 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e40f7b3-c3a7-4b10-9010-e83560ea4f7c req-5ee958ea-7734-48b7-a931-e0b681f1203e tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/security-groups?id=cf1d3e91-3176-48c8-adff-dd58205947d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2259033 Dec 09 21:17:33.720817 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fe45e895-a6ff-4b4f-addf-4756a8ebf7f2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:33.806247 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6a21b4c7-f651-41a1-8963-a06e8990ec4c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=f96ea133bb2c4507b22099fb1fd26a8c&name=default HTTP/1.1" status: 200 len: 2996 time: 1.1075182 Dec 09 21:17:33.806456 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54060) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:33.839364 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-90dd2601-9562-4cc2-8392-c67488f2f829 service neutron] For port 45acc430-900d-475a-af6a-44f47e8a8d29, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:17:33.851466 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-90dd2601-9562-4cc2-8392-c67488f2f829 service neutron] For port 45acc430-900d-475a-af6a-44f47e8a8d29, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=45acc430-900d-475a-af6a-44f47e8a8d29,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:17:33.871173 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-90dd2601-9562-4cc2-8392-c67488f2f829 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:33.901656 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fe45e895-a6ff-4b4f-addf-4756a8ebf7f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:33.916671 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fe45e895-a6ff-4b4f-addf-4756a8ebf7f2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:33.920396 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fe45e895-a6ff-4b4f-addf-4756a8ebf7f2 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/d9bf9a21-9e93-42e7-9e05-0d03cc36fc4f HTTP/1.1" status: 204 len: 168 time: 0.7873676 Dec 09 21:17:34.040498 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe45e895-a6ff-4b4f-addf-4756a8ebf7f2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d9bf9a21-9e93-42e7-9e05-0d03cc36fc4f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:34.102337 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bb958e3f-8e93-4f43-9f11-5d561efef9c1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:34.138449 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bb958e3f-8e93-4f43-9f11-5d561efef9c1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:34.208972 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bb958e3f-8e93-4f43-9f11-5d561efef9c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:34.211938 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bb958e3f-8e93-4f43-9f11-5d561efef9c1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:34.215804 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bb958e3f-8e93-4f43-9f11-5d561efef9c1 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/b852d663-eea1-4eb2-a1f2-f4a4086a574e HTTP/1.1" status: 204 len: 168 time: 0.4057066 Dec 09 21:17:34.231638 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c22de44c-e475-4499-9139-46d745a39c76 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:34.263489 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb958e3f-8e93-4f43-9f11-5d561efef9c1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b852d663-eea1-4eb2-a1f2-f4a4086a574e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:34.358375 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90dd2601-9562-4cc2-8392-c67488f2f829 service neutron] Pushing event updated for resources: {'Port': ['ID=45acc430-900d-475a-af6a-44f47e8a8d29,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:34.359845 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-f8afa603-cbd5-4df0-8f9f-335666abdb33 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-securitygroup--469611586&fields=id&tenant_id=615039519ef147c78eb38a1d65eac061 HTTP/1.1" status: 200 len: 267 time: 0.3005271 Dec 09 21:17:34.382441 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-90dd2601-9562-4cc2-8392-c67488f2f829 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:34.383231 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-90dd2601-9562-4cc2-8392-c67488f2f829 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:34.386902 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-90dd2601-9562-4cc2-8392-c67488f2f829 service neutron] 10.222.0.31 "PUT /v2.0/ports/45acc430-900d-475a-af6a-44f47e8a8d29 HTTP/1.1" status: 200 len: 1118 time: 2.8946438 Dec 09 21:17:34.387312 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e6721efc-7196-4b31-b864-440bcc89de57', 'tag': '45acc430-900d-475a-af6a-44f47e8a8d29'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:17:34.482022 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c22de44c-e475-4499-9139-46d745a39c76 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f396214b-694d-4aab-b44b-20b9ccc68879,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:34.647209 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c22de44c-e475-4499-9139-46d745a39c76 admin admin] Checking segment: {'id': '19a10c74-fb9a-4880-93a3-1e2abb6672e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '14990058-14f1-45bd-b2b7-b002cb7197ed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:17:34.655917 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c22de44c-e475-4499-9139-46d745a39c76 admin admin] Network hostable DHCP agents. Network: 14990058-14f1-45bd-b2b7-b002cb7197ed, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:17:34.748466 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c22de44c-e475-4499-9139-46d745a39c76 admin admin] Network 14990058-14f1-45bd-b2b7-b002cb7197ed is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:17:34.762412 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-680a61bc-a348-4ee2-8920-10f994aebc58 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:34.765605 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54102) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:34.770570 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-680a61bc-a348-4ee2-8920-10f994aebc58 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/networks?id=ce6b6bd1-6a60-4cea-9b70-69fd0290796c HTTP/1.1" status: 200 len: 822 time: 0.4096510 Dec 09 21:17:34.782807 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-c22de44c-e475-4499-9139-46d745a39c76 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 14990058-14f1-45bd-b2b7-b002cb7197ed) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:17:34.792408 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-3733f706-5597-448f-ba9d-ccd4e8901628 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/quotas/615039519ef147c78eb38a1d65eac061 HTTP/1.1" status: 200 len: 375 time: 0.0206318 Dec 09 21:17:34.804381 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c22de44c-e475-4499-9139-46d745a39c76 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:34.805234 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c22de44c-e475-4499-9139-46d745a39c76 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:34.808175 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46cad274-7bdd-4912-8a50-eeb4e0858c67 None None] Network 14990058-14f1-45bd-b2b7-b002cb7197ed requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:17:34.840964 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-a693fc51-32c1-4160-8d85-e774a5db35b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:34.849954 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-a693fc51-32c1-4160-8d85-e774a5db35b3 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ccb2b63648cb4a5da382475755debe06&device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 1121 time: 0.3104770 Dec 09 21:17:34.888831 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c22de44c-e475-4499-9139-46d745a39c76 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 859 time: 2.4272294 Dec 09 21:17:34.949434 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54108) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:34.952768 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-18e460d5-5fd6-4c49-a571-e922e69ae7d2 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=615039519ef147c78eb38a1d65eac061&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1592271 Dec 09 21:17:34.978206 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e1857144-5afe-4b44-a089-b18365b8f5fb admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:34.979042 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b006d09-1274-4623-9047-840bcac34656 req-53f32e95-7369-4a40-af8b-4e6fc5d9bc7f tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:34.980775 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b006d09-1274-4623-9047-840bcac34656 req-53f32e95-7369-4a40-af8b-4e6fc5d9bc7f tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 969 time: 0.1476767 Dec 09 21:17:35.072970 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-228ce5a8-5ec4-43e4-ae93-b50e7b97788d None None] Network 14990058-14f1-45bd-b2b7-b002cb7197ed requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:17:35.107839 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b006d09-1274-4623-9047-840bcac34656 req-77d6aba2-3b0d-4bbe-810d-252f1dc480ee tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/security-groups?id=cf1d3e91-3176-48c8-adff-dd58205947d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1135924 Dec 09 21:17:35.108900 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8899baea-8d3b-457e-bdc6-32cdeef9862d" -d '{"events": [{"name": "network-changed", "server_uuid": "e6721efc-7196-4b31-b864-440bcc89de57", "tag": "45acc430-900d-475a-af6a-44f47e8a8d29"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:17:35.182581 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-03315d40-b906-4f6e-8dbe-b301505c0e7c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.38&port_id=45acc430-900d-475a-af6a-44f47e8a8d29 HTTP/1.1" status: 200 len: 217 time: 0.1882379 Dec 09 21:17:35.269937 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e1857144-5afe-4b44-a089-b18365b8f5fb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:35.282494 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e1857144-5afe-4b44-a089-b18365b8f5fb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:35.391345 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1857144-5afe-4b44-a089-b18365b8f5fb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2fd20006-acbe-4e0d-b4c9-c12642c093db,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:35.400317 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e1857144-5afe-4b44-a089-b18365b8f5fb admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=c7097786d9cf4a7db9ee0aa5b362ec6e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4464335 Dec 09 21:17:35.400716 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54118) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:35.413498 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-78bcc2ad-306e-4afc-9392-d144e0f82a49 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:35.500109 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f76d820c-4d43-4b4b-b254-ea8dc8f5564d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:35.542232 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-58ae80cb-34d6-405f-b1d6-9f7fbac0daff admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:35.601713 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-58ae80cb-34d6-405f-b1d6-9f7fbac0daff admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:35.633535 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-78bcc2ad-306e-4afc-9392-d144e0f82a49 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:35.643073 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-78bcc2ad-306e-4afc-9392-d144e0f82a49 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:35.677128 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-78bcc2ad-306e-4afc-9392-d144e0f82a49 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=892930c55f914875a2a1a9aa24bd4989&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9079337 Dec 09 21:17:35.682545 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54126) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:35.711760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78bcc2ad-306e-4afc-9392-d144e0f82a49 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=40f9ca4e-42e4-44fc-ae7e-8fb7a9881117,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:35.747786 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-58ae80cb-34d6-405f-b1d6-9f7fbac0daff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:35.750295 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-58ae80cb-34d6-405f-b1d6-9f7fbac0daff admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:35.753734 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-58ae80cb-34d6-405f-b1d6-9f7fbac0daff admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/2fd20006-acbe-4e0d-b4c9-c12642c093db HTTP/1.1" status: 204 len: 168 time: 0.3496778 Dec 09 21:17:35.767718 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58ae80cb-34d6-405f-b1d6-9f7fbac0daff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2fd20006-acbe-4e0d-b4c9-c12642c093db,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:35.819475 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26800b31-fd13-4692-89ed-eb3d63a27d89 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:35.854510 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26800b31-fd13-4692-89ed-eb3d63a27d89 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:35.858623 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:17:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-20879951-0d08-410c-a6ca-5727eb8e4f02 x-openstack-request-id: req-20879951-0d08-410c-a6ca-5727eb8e4f02 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:17:35.859620 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e6721efc-7196-4b31-b864-440bcc89de57", "tag": "45acc430-900d-475a-af6a-44f47e8a8d29", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:17:35.859620 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-20879951-0d08-410c-a6ca-5727eb8e4f02 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:17:35.859832 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e6721efc-7196-4b31-b864-440bcc89de57', 'tag': '45acc430-900d-475a-af6a-44f47e8a8d29', 'status': 'completed', 'code': 200} Dec 09 21:17:35.916512 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26800b31-fd13-4692-89ed-eb3d63a27d89 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:35.921026 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26800b31-fd13-4692-89ed-eb3d63a27d89 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:35.923293 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-26800b31-fd13-4692-89ed-eb3d63a27d89 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/40f9ca4e-42e4-44fc-ae7e-8fb7a9881117 HTTP/1.1" status: 204 len: 168 time: 0.2393970 Dec 09 21:17:35.941165 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26800b31-fd13-4692-89ed-eb3d63a27d89 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=40f9ca4e-42e4-44fc-ae7e-8fb7a9881117,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:35.964777 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-cd0d356f-3beb-4eb3-a3a2-98c8b721e72e service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:17:35.965966 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-cd0d356f-3beb-4eb3-a3a2-98c8b721e72e service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.4780931 Dec 09 21:17:36.090318 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-15ad771e-736c-494d-aec6-7a584c2cbfcb service neutron] 10.222.0.13 "GET /v2.0/networks/ce6b6bd1-6a60-4cea-9b70-69fd0290796c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1167541 Dec 09 21:17:36.220444 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-ca7211bb-56a5-4b63-8470-45fc0baa2e01 service neutron] 10.222.0.13 "GET /v2.0/networks/ce6b6bd1-6a60-4cea-9b70-69fd0290796c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1274357 Dec 09 21:17:36.288995 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cfbe606-e313-41db-8cb5-7c753bc096d5 req-7dc02453-9ffa-4d27-90f6-c8c27d671085 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:36.292138 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0cfbe606-e313-41db-8cb5-7c753bc096d5 req-7dc02453-9ffa-4d27-90f6-c8c27d671085 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 969 time: 0.0702047 Dec 09 21:17:36.370036 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0cfbe606-e313-41db-8cb5-7c753bc096d5 req-28c8f181-82a1-4f8b-9027-68dadef5d1a3 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/security-groups?id=cf1d3e91-3176-48c8-adff-dd58205947d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0722213 Dec 09 21:17:36.477907 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:36.557671 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-34ad58c0-6e50-432c-9367-5a43c1378829 req-2def1c8a-9ed8-4550-9d55-bb0e594ce282 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 210 time: 0.0580044 Dec 09 21:17:36.759367 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54164) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:36.784632 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de3e573c-18f8-4b5e-ad68-861945c0542b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:36.941774 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de3e573c-18f8-4b5e-ad68-861945c0542b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:36.951262 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de3e573c-18f8-4b5e-ad68-861945c0542b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:37.070297 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-de3e573c-18f8-4b5e-ad68-861945c0542b admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=70b95c64c55f411f99994814af9f5b22&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3070629 Dec 09 21:17:37.071155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54182) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:37.077765 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de3e573c-18f8-4b5e-ad68-861945c0542b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=77574bf1-01f2-4b16-8c1f-2f77518fe508,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:37.204865 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54190) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:37.209939 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-eba4687f-aad0-4a06-a061-e8f3c3f3a18e admin admin] Request body: {'network': {'name': 'tempest-LiveMigrationRemoteConsolesV26Test-1995674207-network', 'tenant_id': '41f02376d2904473a8d001863fffd0b5'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:37.219778 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0b570d7f-cb1c-483f-a1ca-fa29049227ce admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:37.279796 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0b570d7f-cb1c-483f-a1ca-fa29049227ce admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:37.291949 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eba4687f-aad0-4a06-a061-e8f3c3f3a18e admin admin] Made reservation on behalf of 41f02376d2904473a8d001863fffd0b5 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:17:37.295563 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eba4687f-aad0-4a06-a061-e8f3c3f3a18e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:37.319925 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eba4687f-aad0-4a06-a061-e8f3c3f3a18e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:37.397785 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0b570d7f-cb1c-483f-a1ca-fa29049227ce admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:37.407001 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0b570d7f-cb1c-483f-a1ca-fa29049227ce admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:37.411748 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0b570d7f-cb1c-483f-a1ca-fa29049227ce admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/77574bf1-01f2-4b16-8c1f-2f77518fe508 HTTP/1.1" status: 204 len: 168 time: 0.3351290 Dec 09 21:17:37.425139 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b570d7f-cb1c-483f-a1ca-fa29049227ce admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=77574bf1-01f2-4b16-8c1f-2f77518fe508,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:37.593816 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-726400e4-19c2-44d0-bae1-1b04f17c06aa req-7082d6ad-315e-4fd1-8019-e5fbcc514090 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:37.596623 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-726400e4-19c2-44d0-bae1-1b04f17c06aa req-7082d6ad-315e-4fd1-8019-e5fbcc514090 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 969 time: 0.1005900 Dec 09 21:17:37.620234 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eba4687f-aad0-4a06-a061-e8f3c3f3a18e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:37.634446 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eba4687f-aad0-4a06-a061-e8f3c3f3a18e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:37.649826 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-eba4687f-aad0-4a06-a061-e8f3c3f3a18e admin admin] vlan segment allocate from pool success with {'vlan_id': 111, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:17:37.660580 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eba4687f-aad0-4a06-a061-e8f3c3f3a18e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:37.661258 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-eba4687f-aad0-4a06-a061-e8f3c3f3a18e admin admin] Added segment 4ada96e4-3f8c-4bca-ad93-0acdb2deeb1e of type vlan for network e1ce3b56-0b6f-43ca-9ec2-9989ef3c0a1b Dec 09 21:17:37.747196 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eba4687f-aad0-4a06-a061-e8f3c3f3a18e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:37.841663 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:37.927053 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ebbb77f2-51be-41b5-bfcb-5f38bba50d2f req-f2e66e15-03f3-4613-b5e7-93d14d76af63 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 210 time: 0.1781726 Dec 09 21:17:37.966318 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.db.resource_extend [None req-eba4687f-aad0-4a06-a061-e8f3c3f3a18e admin admin] It took 0.16 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 09 21:17:37.969987 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eba4687f-aad0-4a06-a061-e8f3c3f3a18e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3cde1257-7b9e-48ec-a09c-098e721dc592,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:38.037701 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-726400e4-19c2-44d0-bae1-1b04f17c06aa req-e796e48c-7856-4718-86a7-57750a3d1b79 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/security-groups?id=cf1d3e91-3176-48c8-adff-dd58205947d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4274030 Dec 09 21:17:38.039690 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eba4687f-aad0-4a06-a061-e8f3c3f3a18e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:38.040953 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eba4687f-aad0-4a06-a061-e8f3c3f3a18e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:38.041533 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eba4687f-aad0-4a06-a061-e8f3c3f3a18e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:38.084060 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-eba4687f-aad0-4a06-a061-e8f3c3f3a18e admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.8777773 Dec 09 21:17:38.087114 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54218) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:38.101266 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-6f62cbe9-2293-43e5-ba2c-98552f8e86ca admin admin] Request body: {'subnet': {'network_id': 'e1ce3b56-0b6f-43ca-9ec2-9989ef3c0a1b', 'cidr': '172.20.0.0/28', 'name': 'tempest-LiveMigrationRemoteConsolesV26Test-1995674207-subnet', 'tenant_id': '41f02376d2904473a8d001863fffd0b5', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:38.391511 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eba4687f-aad0-4a06-a061-e8f3c3f3a18e admin admin] Pushing event updated for resources: {'Network': ['ID=e1ce3b56-0b6f-43ca-9ec2-9989ef3c0a1b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:38.407008 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network e1ce3b56-0b6f-43ca-9ec2-9989ef3c0a1b details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:17:38.420789 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6f62cbe9-2293-43e5-ba2c-98552f8e86ca admin admin] Made reservation on behalf of 41f02376d2904473a8d001863fffd0b5 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:17:38.423475 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6f62cbe9-2293-43e5-ba2c-98552f8e86ca admin admin] Publish callbacks [] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:38.641259 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.10', 63561) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:38.746988 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6f62cbe9-2293-43e5-ba2c-98552f8e86ca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:38.870007 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f62cbe9-2293-43e5-ba2c-98552f8e86ca admin admin] Pushing event updated for resources: {'Subnet': ['ID=f4f4cd99-8e93-4dc4-b1b8-bfb249ee54ea,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:38.912460 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f62cbe9-2293-43e5-ba2c-98552f8e86ca admin admin] Checking segment: {'id': '4ada96e4-3f8c-4bca-ad93-0acdb2deeb1e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'e1ce3b56-0b6f-43ca-9ec2-9989ef3c0a1b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:17:38.913112 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f62cbe9-2293-43e5-ba2c-98552f8e86ca admin admin] Network hostable DHCP agents. Network: e1ce3b56-0b6f-43ca-9ec2-9989ef3c0a1b, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:17:38.948174 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f62cbe9-2293-43e5-ba2c-98552f8e86ca admin admin] Network e1ce3b56-0b6f-43ca-9ec2-9989ef3c0a1b is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:17:38.975824 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-6f62cbe9-2293-43e5-ba2c-98552f8e86ca admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, e1ce3b56-0b6f-43ca-9ec2-9989ef3c0a1b) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:17:38.986245 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f9cfa08-f8cf-4447-86f3-8c04ad7388b3 None None] Network e1ce3b56-0b6f-43ca-9ec2-9989ef3c0a1b requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:17:38.995726 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6f62cbe9-2293-43e5-ba2c-98552f8e86ca admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:38.997050 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6f62cbe9-2293-43e5-ba2c-98552f8e86ca admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:39.038075 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c8bfff3d-d624-4e21-b23b-1fcf6ad0f462 req-1c3b70c2-fe85-43c0-9487-223ca879fcdf tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 210 time: 0.0341492 Dec 09 21:17:39.071491 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6f62cbe9-2293-43e5-ba2c-98552f8e86ca admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.9788647 Dec 09 21:17:39.136465 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-386a7aef-47ae-4fd3-8454-7e2f116246cc tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:39.138295 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-386a7aef-47ae-4fd3-8454-7e2f116246cc tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.10 "GET /v2.0/networks?id=ce6b6bd1-6a60-4cea-9b70-69fd0290796c HTTP/1.1" status: 200 len: 822 time: 0.4936612 Dec 09 21:17:39.190864 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:39.281935 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6bc94431-962d-42f5-9684-a53fa1138776 None None] Network e1ce3b56-0b6f-43ca-9ec2-9989ef3c0a1b requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:17:39.323363 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41a56559-db37-4b23-80f6-542358724000 req-264fe675-f481-4a01-a44f-674508e211fb tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:39.337047 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-41a56559-db37-4b23-80f6-542358724000 req-264fe675-f481-4a01-a44f-674508e211fb tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 969 time: 0.1588511 Dec 09 21:17:39.375432 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-fb20e5b2-14bc-4ae0-94dd-38b82b2f2bf8 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.10 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=615039519ef147c78eb38a1d65eac061 HTTP/1.1" status: 200 len: 379 time: 0.1602178 Dec 09 21:17:39.390935 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-39a74ccb-07b2-4e0a-a87e-9e5298c957cd tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Request body: {'port': {'device_id': '2c85b8fc-41be-4975-88fd-db5bc87f1f89', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'admin_state_up': True, 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'security_groups': ['9798184d-82ec-4464-b3fc-95653513aba7']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:39.421521 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54266) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:39.447388 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-41a56559-db37-4b23-80f6-542358724000 req-e6d83682-8cdd-4945-8f46-42ce73612854 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/security-groups?id=cf1d3e91-3176-48c8-adff-dd58205947d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1005280 Dec 09 21:17:39.544243 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-5c696f1f-04cf-4ec5-bc42-f1e2142c331e admin admin] Deleting subnet f396214b-694d-4aab-b44b-20b9ccc68879 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:17:39.551255 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c696f1f-04cf-4ec5-bc42-f1e2142c331e admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:39.613517 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c696f1f-04cf-4ec5-bc42-f1e2142c331e admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:39.630351 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c696f1f-04cf-4ec5-bc42-f1e2142c331e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:39.669492 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-39a74ccb-07b2-4e0a-a87e-9e5298c957cd tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Made reservation on behalf of 615039519ef147c78eb38a1d65eac061 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:17:39.674103 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-39a74ccb-07b2-4e0a-a87e-9e5298c957cd tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:39.734300 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c696f1f-04cf-4ec5-bc42-f1e2142c331e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:40.026493 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-39a74ccb-07b2-4e0a-a87e-9e5298c957cd tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Allocated IP 172.20.0.13 (ce6b6bd1-6a60-4cea-9b70-69fd0290796c/9755e5ea-99a7-4073-8693-293dcc00b929/7eb6e48f-08e3-409a-9551-0e38eb690c8b) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:17:40.185461 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c696f1f-04cf-4ec5-bc42-f1e2142c331e admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:40.191555 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5c696f1f-04cf-4ec5-bc42-f1e2142c331e admin admin] 10.222.0.13 "DELETE /v2.0/subnets/f396214b-694d-4aab-b44b-20b9ccc68879 HTTP/1.1" status: 204 len: 168 time: 0.7583537 Dec 09 21:17:40.194229 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c696f1f-04cf-4ec5-bc42-f1e2142c331e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f396214b-694d-4aab-b44b-20b9ccc68879,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:40.195464 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54290) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:40.347231 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c925c26-e92e-4110-81d8-1486fb8a72c0 req-6848e01b-c8c7-41e2-9879-700ff7a6f212 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 210 time: 0.1698811 Dec 09 21:17:40.474928 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:40.505852 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-edd4a669-9fe5-4552-9f04-735bdf15a0a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:40.507959 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-edd4a669-9fe5-4552-9f04-735bdf15a0a9 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.2263875 Dec 09 21:17:40.649596 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-39a74ccb-07b2-4e0a-a87e-9e5298c957cd tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:40.710311 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-dbb77c6d-4da4-44f5-81bb-22160f27a649 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:40.719939 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-dbb77c6d-4da4-44f5-81bb-22160f27a649 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1938884 Dec 09 21:17:40.769412 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:40.794643 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=103438) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:40.795101 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=103438) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:40.795895 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=103438) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:40.796231 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] Subscribe: > port after_create 55550000 {{(pid=103438) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:40.796627 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] Subscribe: > port after_delete 55550000 {{(pid=103438) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:40.797029 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] Subscribe: > port after_update 55550000 {{(pid=103438) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:40.797356 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=103438) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:40.797672 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=103438) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:40.797999 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=103438) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:40.798379 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=103438) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:40.954565 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-5fd39a6b-9458-411c-9e8f-a3bf0d85cd37 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2152839 Dec 09 21:17:40.957707 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-39a74ccb-07b2-4e0a-a87e-9e5298c957cd tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:41.097997 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-39a74ccb-07b2-4e0a-a87e-9e5298c957cd tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Network ce6b6bd1-6a60-4cea-9b70-69fd0290796c is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:17:41.107172 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-39a74ccb-07b2-4e0a-a87e-9e5298c957cd tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:17:41.117125 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39a74ccb-07b2-4e0a-a87e-9e5298c957cd tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Pushing event updated for resources: {'Port': ['ID=7eb6e48f-08e3-409a-9551-0e38eb690c8b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:41.120115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-39a74ccb-07b2-4e0a-a87e-9e5298c957cd tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:17:41.125840 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-39a74ccb-07b2-4e0a-a87e-9e5298c957cd tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:41.126480 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-39a74ccb-07b2-4e0a-a87e-9e5298c957cd tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:41.189419 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-39a74ccb-07b2-4e0a-a87e-9e5298c957cd tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.8061647 Dec 09 21:17:41.440758 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=103438) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:41.441338 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=103438) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:41.441767 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=103438) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:41.442203 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=103438) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:41.442707 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['14990058-14f1-45bd-b2b7-b002cb7197ed']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:17:41.471059 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '19a10c74-fb9a-4880-93a3-1e2abb6672e9') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:17:41.471510 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '19a10c74-fb9a-4880-93a3-1e2abb6672e9') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:17:41.506336 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:41.518221 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-62ad39a0-f09e-454b-ab64-088504181b6a tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:17:41.519576 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-62ad39a0-f09e-454b-ab64-088504181b6a tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.10 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0078042 Dec 09 21:17:41.519764 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f705972f-ffd3-48a2-8e68-bab56db0024a None None] Provisioning complete for port 7eb6e48f-08e3-409a-9551-0e38eb690c8b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:41.520290 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f705972f-ffd3-48a2-8e68-bab56db0024a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:41.560944 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37981e75-5b3f-4063-a910-28a46e8bd466 req-aa3cb24e-3337-4b1d-a38f-b871c96539e1 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:41.573356 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-37981e75-5b3f-4063-a910-28a46e8bd466 req-aa3cb24e-3337-4b1d-a38f-b871c96539e1 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 969 time: 0.9929051 Dec 09 21:17:41.601594 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-306a8025-6df9-43a2-96c5-1203978bedc0 req-0eabc00d-391a-4a11-8392-9ad552a928f1 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4554720 Dec 09 21:17:41.606560 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f705972f-ffd3-48a2-8e68-bab56db0024a None None] Port 7eb6e48f-08e3-409a-9551-0e38eb690c8b cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:17:41.613393 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:41.674105 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] Releasing vlan 119 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:17:41.674717 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: from cryptography.utils import int_from_bytes Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: from cryptography.utils import int_from_bytes Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:17:41.703176 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:17:41.804463 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8899baea-8d3b-457e-bdc6-32cdeef9862d req-e39721bc-295c-422d-8537-1313d01f6dbb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:41.806602 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8899baea-8d3b-457e-bdc6-32cdeef9862d req-e39721bc-295c-422d-8537-1313d01f6dbb service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ccb2b63648cb4a5da382475755debe06&device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 1121 time: 0.1078575 Dec 09 21:17:41.823850 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-37981e75-5b3f-4063-a910-28a46e8bd466 req-4ca322e8-a2b9-460a-afc4-5becfeb6db08 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/security-groups?id=cf1d3e91-3176-48c8-adff-dd58205947d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2492244 Dec 09 21:17:41.830491 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:41.840749 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:41.845143 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] 10.222.0.13 "DELETE /v2.0/networks/14990058-14f1-45bd-b2b7-b002cb7197ed HTTP/1.1" status: 204 len: 168 time: 1.6138935 Dec 09 21:17:41.861525 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54324) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:41.862948 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a23364ee-d5c6-423a-97e8-e582eea076e6 admin admin] Pushing event deleted for resources: {'Network': ['ID=14990058-14f1-45bd-b2b7-b002cb7197ed,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:41.984728 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-8ec2cb3b-630d-4f75-911c-5659d20be3a9 admin admin] Deleting subnet f4f4cd99-8e93-4dc4-b1b8-bfb249ee54ea {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:17:42.008202 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8899baea-8d3b-457e-bdc6-32cdeef9862d req-3195e44c-eb24-4560-ac82-b83645defdde service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:42.008202 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8899baea-8d3b-457e-bdc6-32cdeef9862d req-3195e44c-eb24-4560-ac82-b83645defdde service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.1848691 Dec 09 21:17:42.013256 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8ec2cb3b-630d-4f75-911c-5659d20be3a9 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:42.070077 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8899baea-8d3b-457e-bdc6-32cdeef9862d req-4073095f-8186-48e1-9e4c-da648aa98e51 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.38&port_id=45acc430-900d-475a-af6a-44f47e8a8d29 HTTP/1.1" status: 200 len: 217 time: 0.0542786 Dec 09 21:17:42.090761 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8ec2cb3b-630d-4f75-911c-5659d20be3a9 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:42.145215 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15a9cc9c-0765-4926-bf32-f3ff8f5d7d41 req-a65f35bc-6233-461e-9eb4-47565077d04c tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:42.147278 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8899baea-8d3b-457e-bdc6-32cdeef9862d req-3c8a82f7-5131-4a19-ac5e-aa187d308bab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:42.147583 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15a9cc9c-0765-4926-bf32-f3ff8f5d7d41 req-a65f35bc-6233-461e-9eb4-47565077d04c tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 932 time: 0.1665890 Dec 09 21:17:42.149327 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8899baea-8d3b-457e-bdc6-32cdeef9862d req-3c8a82f7-5131-4a19-ac5e-aa187d308bab service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0722554 Dec 09 21:17:42.194233 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8ec2cb3b-630d-4f75-911c-5659d20be3a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:42.274780 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8899baea-8d3b-457e-bdc6-32cdeef9862d req-49b4413e-f443-4b4f-9e10-c36e6af77dce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:42.277461 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8899baea-8d3b-457e-bdc6-32cdeef9862d req-49b4413e-f443-4b4f-9e10-c36e6af77dce service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1172769 Dec 09 21:17:42.278936 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3611afc-2760-4728-b179-e655cbb241e6 req-2d671b54-f2a0-4095-9afa-55633753ced2 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=97c6f11d72db4857afd32603bdfd0616&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0471830 Dec 09 21:17:42.299656 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15a9cc9c-0765-4926-bf32-f3ff8f5d7d41 req-8e885cdd-8945-4889-97e0-350ea3687c30 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1346037 Dec 09 21:17:42.418211 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8ec2cb3b-630d-4f75-911c-5659d20be3a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:42.458108 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8ec2cb3b-630d-4f75-911c-5659d20be3a9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:42.461356 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8899baea-8d3b-457e-bdc6-32cdeef9862d req-8aaea3a9-69f7-47d7-b4dd-6bc943fb3dd2 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1756094 Dec 09 21:17:42.462044 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8ec2cb3b-630d-4f75-911c-5659d20be3a9 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/f4f4cd99-8e93-4dc4-b1b8-bfb249ee54ea HTTP/1.1" status: 204 len: 168 time: 0.5949805 Dec 09 21:17:42.462833 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ec2cb3b-630d-4f75-911c-5659d20be3a9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f4f4cd99-8e93-4dc4-b1b8-bfb249ee54ea,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:42.464404 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54342) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:42.504082 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3611afc-2760-4728-b179-e655cbb241e6 req-d1ad258c-3401-48a8-aea9-c49261dcd648 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:42.513290 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3611afc-2760-4728-b179-e655cbb241e6 req-d1ad258c-3401-48a8-aea9-c49261dcd648 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2124736 Dec 09 21:17:42.530744 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3611afc-2760-4728-b179-e655cbb241e6 req-4069f952-2214-4c03-85d7-e198b747cbc3 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/quotas/97c6f11d72db4857afd32603bdfd0616 HTTP/1.1" status: 200 len: 375 time: 0.0165265 Dec 09 21:17:42.561596 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3611afc-2760-4728-b179-e655cbb241e6 req-5eef2793-968b-44e3-8e9a-d253c73a245a tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=97c6f11d72db4857afd32603bdfd0616&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0293412 Dec 09 21:17:42.609575 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:42.644088 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8899baea-8d3b-457e-bdc6-32cdeef9862d req-78f7790b-99ec-4814-bcbd-4e498dd04a54 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1559203 Dec 09 21:17:42.762366 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:42.818785 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f2a3508-819d-4087-a4fc-306297d3cb7f req-e81a2b88-42f8-4048-88fe-8e10e0e99f4f tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=548538cf-319a-4465-9a2b-f54718ee91be HTTP/1.1" status: 200 len: 210 time: 0.0616930 Dec 09 21:17:42.823989 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=103437) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:42.823989 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=103437) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:42.823989 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=103437) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:42.823989 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] Subscribe: > port after_create 55550000 {{(pid=103437) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:42.823989 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] Subscribe: > port after_delete 55550000 {{(pid=103437) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:42.824879 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] Subscribe: > port after_update 55550000 {{(pid=103437) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:42.824879 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=103437) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:42.824879 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=103437) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:42.825148 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=103437) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:42.825463 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=103437) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:42.914099 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=103437) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:42.914462 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=103437) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:42.914793 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=103437) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:42.915117 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=103437) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 21:17:42.915532 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e1ce3b56-0b6f-43ca-9ec2-9989ef3c0a1b']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:17:42.938901 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4ada96e4-3f8c-4bca-ad93-0acdb2deeb1e') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:17:42.939356 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4ada96e4-3f8c-4bca-ad93-0acdb2deeb1e') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:17:42.985101 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:43.016584 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:43.033978 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] Releasing vlan 111 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:17:43.034443 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: from cryptography.utils import int_from_bytes Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: from cryptography.utils import int_from_bytes Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:17:43.038821 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:17:43.114043 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-037eba4e-d8a7-4656-8ad5-d41a021fa1fe req-0c68d5eb-ef8b-4aad-945c-bb6567f01e8e tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:43.123108 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-037eba4e-d8a7-4656-8ad5-d41a021fa1fe req-0c68d5eb-ef8b-4aad-945c-bb6567f01e8e tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 969 time: 0.1459978 Dec 09 21:17:43.171169 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:43.201567 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] Pushing event deleted for resources: {'Network': ['ID=e1ce3b56-0b6f-43ca-9ec2-9989ef3c0a1b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:43.205473 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:43.211911 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5b20743f-1a42-4b39-86a7-3325e1ec23a2 admin admin] 10.222.0.13 "DELETE /v2.0/networks/e1ce3b56-0b6f-43ca-9ec2-9989ef3c0a1b HTTP/1.1" status: 204 len: 168 time: 0.7463202 Dec 09 21:17:43.218499 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-037eba4e-d8a7-4656-8ad5-d41a021fa1fe req-90babb75-c73f-4826-964d-824b058cba9d tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/security-groups?id=cf1d3e91-3176-48c8-adff-dd58205947d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0943801 Dec 09 21:17:43.263728 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54374) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:43.373993 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54382) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:43.515949 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-75e93399-f5d9-46d5-9be9-8564d92774e7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:43.528635 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36c91851-d3fb-48f8-b649-8f33770f4974 req-d8f874b9-f077-451a-9b99-8b0af98fdfc6 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:43.537379 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36c91851-d3fb-48f8-b649-8f33770f4974 req-d8f874b9-f077-451a-9b99-8b0af98fdfc6 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 932 time: 0.1302660 Dec 09 21:17:43.568963 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9a31bc1-4e13-4748-a545-77f4d599209a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:43.582060 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54386) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:43.604482 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36c91851-d3fb-48f8-b649-8f33770f4974 req-392484ef-f97a-4bc2-8935-c275a8dc83bd tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0612922 Dec 09 21:17:43.646323 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9137e005-7542-434b-a408-3e4a973a8bcf admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=3c14281534c742718d0751894c69cb73&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0605946 Dec 09 21:17:43.646687 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54388) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:43.731250 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9a31bc1-4e13-4748-a545-77f4d599209a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:43.745449 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9a31bc1-4e13-4748-a545-77f4d599209a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:43.754754 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7b7c397-acea-4e5a-b899-f62eaefc8b8b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:43.762428 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-75e93399-f5d9-46d5-9be9-8564d92774e7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:43.780791 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-75e93399-f5d9-46d5-9be9-8564d92774e7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:43.783544 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7b7c397-acea-4e5a-b899-f62eaefc8b8b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:43.799415 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e9a31bc1-4e13-4748-a545-77f4d599209a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=72b4ea1617c740a7943700e458a440ad&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4243438 Dec 09 21:17:43.805215 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54390) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:43.820991 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9a31bc1-4e13-4748-a545-77f4d599209a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=890238cb-b535-4de9-abd4-7c83695cd97a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:43.853125 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7b7c397-acea-4e5a-b899-f62eaefc8b8b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:43.855860 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7b7c397-acea-4e5a-b899-f62eaefc8b8b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:43.860402 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b7b7c397-acea-4e5a-b899-f62eaefc8b8b admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/63b5779c-cb87-4cdd-821a-1c3b72b9942e HTTP/1.1" status: 204 len: 168 time: 0.2092783 Dec 09 21:17:43.860575 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-75e93399-f5d9-46d5-9be9-8564d92774e7 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=4905d1a6fd5a43ffa6767320f4a6575b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5946555 Dec 09 21:17:43.863379 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54394) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:43.891523 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7b7c397-acea-4e5a-b899-f62eaefc8b8b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=63b5779c-cb87-4cdd-821a-1c3b72b9942e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:43.920086 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75e93399-f5d9-46d5-9be9-8564d92774e7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cd5d6a7b-8241-449e-b531-52a863735bbb,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:43.960484 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c9d11d1d-e071-4653-b6fc-ac32cc96b66c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:43.960484 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-52b43ade-e396-4c92-9fff-7c883ce75240 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:43.975976 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfd17d2c-ecec-4cb7-88ff-1737e4399a7f req-e25aad37-cc84-40d9-b988-fd90c7cf886b tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=548538cf-319a-4465-9a2b-f54718ee91be HTTP/1.1" status: 200 len: 210 time: 0.0396125 Dec 09 21:17:43.991462 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-52b43ade-e396-4c92-9fff-7c883ce75240 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:44.031290 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c9d11d1d-e071-4653-b6fc-ac32cc96b66c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:44.071819 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-52b43ade-e396-4c92-9fff-7c883ce75240 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:44.075278 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-52b43ade-e396-4c92-9fff-7c883ce75240 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:44.076642 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-52b43ade-e396-4c92-9fff-7c883ce75240 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/cd5d6a7b-8241-449e-b531-52a863735bbb HTTP/1.1" status: 204 len: 168 time: 0.2086952 Dec 09 21:17:44.099890 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52b43ade-e396-4c92-9fff-7c883ce75240 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cd5d6a7b-8241-449e-b531-52a863735bbb,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:44.117993 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f3611afc-2760-4728-b179-e655cbb241e6 req-437ee18a-a2d2-435c-a62f-e2ff80deee79 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=97c6f11d72db4857afd32603bdfd0616&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0399289 Dec 09 21:17:44.179267 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c9d11d1d-e071-4653-b6fc-ac32cc96b66c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:44.182975 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c9d11d1d-e071-4653-b6fc-ac32cc96b66c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:44.184264 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c9d11d1d-e071-4653-b6fc-ac32cc96b66c admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/890238cb-b535-4de9-abd4-7c83695cd97a HTTP/1.1" status: 204 len: 168 time: 0.3770509 Dec 09 21:17:44.220333 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9d11d1d-e071-4653-b6fc-ac32cc96b66c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=890238cb-b535-4de9-abd4-7c83695cd97a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:44.312935 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3611afc-2760-4728-b179-e655cbb241e6 req-c1ad1c6f-1d16-4de7-9886-a34fa07fe42d tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:44.314570 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f3611afc-2760-4728-b179-e655cbb241e6 req-c1ad1c6f-1d16-4de7-9886-a34fa07fe42d tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1905508 Dec 09 21:17:44.330668 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-f3611afc-2760-4728-b179-e655cbb241e6 req-20caeec3-37a5-4425-b847-bc4a1259ca01 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Request body: {'port': {'device_id': '548538cf-319a-4465-9a2b-f54718ee91be', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '97c6f11d72db4857afd32603bdfd0616'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:44.390858 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2440649-5841-4c9d-b901-62ad53a6974c req-f61b15e8-47b6-4232-99b8-22cf0b78f0be tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:44.393126 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2440649-5841-4c9d-b901-62ad53a6974c req-f61b15e8-47b6-4232-99b8-22cf0b78f0be tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 969 time: 0.0586638 Dec 09 21:17:44.451286 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54410) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:44.469089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2440649-5841-4c9d-b901-62ad53a6974c req-17edabe7-5b35-4d56-a34d-eb3704d3d363 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/security-groups?id=cf1d3e91-3176-48c8-adff-dd58205947d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0614791 Dec 09 21:17:44.518185 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f3611afc-2760-4728-b179-e655cbb241e6 req-20caeec3-37a5-4425-b847-bc4a1259ca01 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Made reservation on behalf of 97c6f11d72db4857afd32603bdfd0616 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:17:44.524418 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f3611afc-2760-4728-b179-e655cbb241e6 req-20caeec3-37a5-4425-b847-bc4a1259ca01 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:44.525162 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-afaef87e-f717-4cdd-96ab-b35eeb2f3743 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=41f02376d2904473a8d001863fffd0b5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0546970 Dec 09 21:17:44.525981 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54414) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:44.545173 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f3611afc-2760-4728-b179-e655cbb241e6 req-20caeec3-37a5-4425-b847-bc4a1259ca01 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:44.616129 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c9faff1-6d28-43ca-aba7-a33c00158f0a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:44.697375 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c9faff1-6d28-43ca-aba7-a33c00158f0a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:44.705279 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54420) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:44.729490 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-69e46d0f-2e07-4190-9fcf-bcd11f0646c8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:44.735992 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e298ea1-8a04-4075-8b29-e5cf1932e9de req-025d753d-23a9-4038-9571-d0407c710a4a tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:44.745458 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e298ea1-8a04-4075-8b29-e5cf1932e9de req-025d753d-23a9-4038-9571-d0407c710a4a tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 932 time: 0.0651121 Dec 09 21:17:44.788816 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f3611afc-2760-4728-b179-e655cbb241e6 req-20caeec3-37a5-4425-b847-bc4a1259ca01 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:44.804252 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f3611afc-2760-4728-b179-e655cbb241e6 req-20caeec3-37a5-4425-b847-bc4a1259ca01 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:44.805879 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e298ea1-8a04-4075-8b29-e5cf1932e9de req-3a667d9a-9647-4836-ae50-148e1f0a4bc4 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0591047 Dec 09 21:17:44.892814 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c9faff1-6d28-43ca-aba7-a33c00158f0a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:44.895361 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c9faff1-6d28-43ca-aba7-a33c00158f0a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:44.899472 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4c9faff1-6d28-43ca-aba7-a33c00158f0a admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/3cde1257-7b9e-48ec-a09c-098e721dc592 HTTP/1.1" status: 204 len: 168 time: 0.3694777 Dec 09 21:17:44.906885 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20caeec3-37a5-4425-b847-bc4a1259ca01 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:44.932818 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c9faff1-6d28-43ca-aba7-a33c00158f0a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3cde1257-7b9e-48ec-a09c-098e721dc592,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:45.012636 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-69e46d0f-2e07-4190-9fcf-bcd11f0646c8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:45.014015 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-f3611afc-2760-4728-b179-e655cbb241e6 req-20caeec3-37a5-4425-b847-bc4a1259ca01 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Allocated IP 192.168.233.107 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/37ba309b-f598-4b1e-b3e8-35aa21ab14d3) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:17:45.020037 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-69e46d0f-2e07-4190-9fcf-bcd11f0646c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:45.072466 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-69e46d0f-2e07-4190-9fcf-bcd11f0646c8 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=4193b19ca38e41d2b27636413ae0e2d7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3651536 Dec 09 21:17:45.076031 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54426) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:45.094548 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69e46d0f-2e07-4190-9fcf-bcd11f0646c8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ba6db7e8-2192-445d-b0b6-5c1e577d728c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:45.128072 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54428) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:45.142199 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec141997-4176-4d93-b58a-9333b73af87e req-b86e12fa-e025-427e-9918-734ddbc38de0 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=548538cf-319a-4465-9a2b-f54718ee91be HTTP/1.1" status: 200 len: 210 time: 0.0481410 Dec 09 21:17:45.148021 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-378ff060-8e90-4e66-98ba-9398a5578bb5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:45.176931 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b4cbf33c-66ce-4bc1-b6e5-a12c6d404c41 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:45.222979 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b4cbf33c-66ce-4bc1-b6e5-a12c6d404c41 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:45.285138 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b4cbf33c-66ce-4bc1-b6e5-a12c6d404c41 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:45.288237 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b4cbf33c-66ce-4bc1-b6e5-a12c6d404c41 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:45.291917 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b4cbf33c-66ce-4bc1-b6e5-a12c6d404c41 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/ba6db7e8-2192-445d-b0b6-5c1e577d728c HTTP/1.1" status: 204 len: 168 time: 0.2125845 Dec 09 21:17:45.307726 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f3611afc-2760-4728-b179-e655cbb241e6 req-20caeec3-37a5-4425-b847-bc4a1259ca01 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:45.318350 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4cbf33c-66ce-4bc1-b6e5-a12c6d404c41 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ba6db7e8-2192-445d-b0b6-5c1e577d728c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:45.333969 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-378ff060-8e90-4e66-98ba-9398a5578bb5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:45.348096 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-378ff060-8e90-4e66-98ba-9398a5578bb5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:45.384483 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-378ff060-8e90-4e66-98ba-9398a5578bb5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8b6e99cf-6057-4978-a378-32c6328b09cb,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:45.405107 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-378ff060-8e90-4e66-98ba-9398a5578bb5 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=096cace417324283a3ab80cb0dcbe60d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2722893 Dec 09 21:17:45.405107 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f3611afc-2760-4728-b179-e655cbb241e6 req-20caeec3-37a5-4425-b847-bc4a1259ca01 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:45.405726 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54436) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:45.476689 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f3611afc-2760-4728-b179-e655cbb241e6 req-20caeec3-37a5-4425-b847-bc4a1259ca01 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:17:45.490009 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-f3611afc-2760-4728-b179-e655cbb241e6 req-20caeec3-37a5-4425-b847-bc4a1259ca01 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:17:45.492531 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20caeec3-37a5-4425-b847-bc4a1259ca01 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Pushing event updated for resources: {'Port': ['ID=37ba309b-f598-4b1e-b3e8-35aa21ab14d3,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:45.494696 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-f3611afc-2760-4728-b179-e655cbb241e6 req-20caeec3-37a5-4425-b847-bc4a1259ca01 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:17:45.545528 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-60282652-88d0-4e22-b773-f643fa5f6cd7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:45.590066 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-60282652-88d0-4e22-b773-f643fa5f6cd7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:45.619604 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 45acc430-900d-475a-af6a-44f47e8a8d29 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:17:45.632911 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3611afc-2760-4728-b179-e655cbb241e6 req-20caeec3-37a5-4425-b847-bc4a1259ca01 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:45.633877 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f3611afc-2760-4728-b179-e655cbb241e6 req-20caeec3-37a5-4425-b847-bc4a1259ca01 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:45.671013 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f3611afc-2760-4728-b179-e655cbb241e6 req-20caeec3-37a5-4425-b847-bc4a1259ca01 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.3445845 Dec 09 21:17:45.687466 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d50b876d-24a2-4f7a-980a-d6d22204bac9 req-eda44586-847f-421d-9280-b4fd46969649 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:45.697683 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d50b876d-24a2-4f7a-980a-d6d22204bac9 req-eda44586-847f-421d-9280-b4fd46969649 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 969 time: 0.1372609 Dec 09 21:17:45.728138 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-f3611afc-2760-4728-b179-e655cbb241e6 req-a1220d42-7898-4b97-89ba-a09b9cdb1d4e service neutron] Request body: {'port': {'device_id': '548538cf-319a-4465-9a2b-f54718ee91be', 'device_owner': 'compute:tempest-test_az-1650541094', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:45.819365 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d50b876d-24a2-4f7a-980a-d6d22204bac9 req-3d804dbf-44d0-485a-99f0-ac3eab39205f tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/security-groups?id=cf1d3e91-3176-48c8-adff-dd58205947d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1205652 Dec 09 21:17:45.836288 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 45acc430-900d-475a-af6a-44f47e8a8d29, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=45acc430-900d-475a-af6a-44f47e8a8d29,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:17:45.871403 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '45acc430-900d-475a-af6a-44f47e8a8d29', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '45acc430-900d-475a-af6a-44f47e8a8d29', 'mac_address': 'fa:16:3e:69:c5:36', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.38'}], 'device_owner': 'compute:tempest-test_az-1650541094', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:17:45.899887 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-60282652-88d0-4e22-b773-f643fa5f6cd7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:45.902791 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-60282652-88d0-4e22-b773-f643fa5f6cd7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:45.904130 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-60282652-88d0-4e22-b773-f643fa5f6cd7 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/8b6e99cf-6057-4978-a378-32c6328b09cb HTTP/1.1" status: 204 len: 168 time: 0.4973247 Dec 09 21:17:45.910750 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f3611afc-2760-4728-b179-e655cbb241e6 req-a1220d42-7898-4b97-89ba-a09b9cdb1d4e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:45.932978 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60282652-88d0-4e22-b773-f643fa5f6cd7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8b6e99cf-6057-4978-a378-32c6328b09cb,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:45.944390 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:45.977857 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 45acc430-900d-475a-af6a-44f47e8a8d29 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:17:46.016665 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a0b3101-3866-48c7-959a-a8f549bc8597 req-67ca2a89-7cb9-4402-ac1d-e04782a9a3bc tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:46.018821 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a0b3101-3866-48c7-959a-a8f549bc8597 req-67ca2a89-7cb9-4402-ac1d-e04782a9a3bc tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 932 time: 0.0693283 Dec 09 21:17:46.057332 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 45acc430-900d-475a-af6a-44f47e8a8d29, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=45acc430-900d-475a-af6a-44f47e8a8d29,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:17:46.077156 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:46.138806 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a0b3101-3866-48c7-959a-a8f549bc8597 req-7e4dbb0c-832d-410d-a55c-40d24523c164 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1125748 Dec 09 21:17:46.158932 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d54abe74-8d9c-46bf-b7ec-09e5d6b02d36 None None] Provisioning complete for port 37ba309b-f598-4b1e-b3e8-35aa21ab14d3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:46.159294 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d54abe74-8d9c-46bf-b7ec-09e5d6b02d36 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:46.209776 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=45acc430-900d-475a-af6a-44f47e8a8d29,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:46.220435 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d54abe74-8d9c-46bf-b7ec-09e5d6b02d36 None None] Port 37ba309b-f598-4b1e-b3e8-35aa21ab14d3 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:17:46.335028 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-404b1445-8f9c-4824-ab6d-31436baa2b48 req-e06879ed-9476-4666-86a5-697934bc171b tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:46.336119 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-404b1445-8f9c-4824-ab6d-31436baa2b48 req-e06879ed-9476-4666-86a5-697934bc171b tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=548538cf-319a-4465-9a2b-f54718ee91be HTTP/1.1" status: 200 len: 936 time: 0.0760405 Dec 09 21:17:46.397490 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-f3611afc-2760-4728-b179-e655cbb241e6 req-a1220d42-7898-4b97-89ba-a09b9cdb1d4e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 37ba309b-f598-4b1e-b3e8-35aa21ab14d3 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:17:46.406190 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f3611afc-2760-4728-b179-e655cbb241e6 req-a1220d42-7898-4b97-89ba-a09b9cdb1d4e service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:46.417026 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-404b1445-8f9c-4824-ab6d-31436baa2b48 req-f8451fbf-f896-4f55-ad60-80b360f36c0c tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0728428 Dec 09 21:17:46.417463 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['45acc430-900d-475a-af6a-44f47e8a8d29'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:17:46.448114 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-f3611afc-2760-4728-b179-e655cbb241e6 req-a1220d42-7898-4b97-89ba-a09b9cdb1d4e service neutron] Transition to ACTIVE for port object 37ba309b-f598-4b1e-b3e8-35aa21ab14d3 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:17:46.457377 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f3611afc-2760-4728-b179-e655cbb241e6 req-a1220d42-7898-4b97-89ba-a09b9cdb1d4e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:46.532284 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1220d42-7898-4b97-89ba-a09b9cdb1d4e service neutron] Pushing event updated for resources: {'Port': ['ID=37ba309b-f598-4b1e-b3e8-35aa21ab14d3,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:46.983196 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-f3611afc-2760-4728-b179-e655cbb241e6 req-a1220d42-7898-4b97-89ba-a09b9cdb1d4e service neutron] Attempting to bind port 37ba309b-f598-4b1e-b3e8-35aa21ab14d3 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:17:46.983938 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-f3611afc-2760-4728-b179-e655cbb241e6 req-a1220d42-7898-4b97-89ba-a09b9cdb1d4e service neutron] Attempting to bind port 37ba309b-f598-4b1e-b3e8-35aa21ab14d3 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:17:46.983938 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f3611afc-2760-4728-b179-e655cbb241e6 req-a1220d42-7898-4b97-89ba-a09b9cdb1d4e service neutron] Attempting to bind port 37ba309b-f598-4b1e-b3e8-35aa21ab14d3 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:17:47.001582 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f3611afc-2760-4728-b179-e655cbb241e6 req-a1220d42-7898-4b97-89ba-a09b9cdb1d4e service neutron] Port 37ba309b-f598-4b1e-b3e8-35aa21ab14d3 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:17:47.001916 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f3611afc-2760-4728-b179-e655cbb241e6 req-a1220d42-7898-4b97-89ba-a09b9cdb1d4e service neutron] Attempting to bind port 37ba309b-f598-4b1e-b3e8-35aa21ab14d3 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:17:47.013451 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f3611afc-2760-4728-b179-e655cbb241e6 req-a1220d42-7898-4b97-89ba-a09b9cdb1d4e service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 17, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:17:47.013888 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f3611afc-2760-4728-b179-e655cbb241e6 req-a1220d42-7898-4b97-89ba-a09b9cdb1d4e service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:17:47.014295 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f3611afc-2760-4728-b179-e655cbb241e6 req-a1220d42-7898-4b97-89ba-a09b9cdb1d4e service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:17:47.014762 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-f3611afc-2760-4728-b179-e655cbb241e6 req-a1220d42-7898-4b97-89ba-a09b9cdb1d4e service neutron] Bound port: 37ba309b-f598-4b1e-b3e8-35aa21ab14d3, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:17:47.015135 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f3611afc-2760-4728-b179-e655cbb241e6 req-a1220d42-7898-4b97-89ba-a09b9cdb1d4e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:47.073110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9387bc84-f37e-430e-8c19-d58328ad76e4 req-e4742b93-6b4f-4da3-bd65-abbb0d42b555 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:47.074933 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9387bc84-f37e-430e-8c19-d58328ad76e4 req-e4742b93-6b4f-4da3-bd65-abbb0d42b555 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 970 time: 0.0745776 Dec 09 21:17:47.104564 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-f3611afc-2760-4728-b179-e655cbb241e6 req-a1220d42-7898-4b97-89ba-a09b9cdb1d4e service neutron] For port 37ba309b-f598-4b1e-b3e8-35aa21ab14d3, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:17:47.110946 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-f3611afc-2760-4728-b179-e655cbb241e6 req-a1220d42-7898-4b97-89ba-a09b9cdb1d4e service neutron] For port 37ba309b-f598-4b1e-b3e8-35aa21ab14d3, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=37ba309b-f598-4b1e-b3e8-35aa21ab14d3,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:17:47.117731 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f3611afc-2760-4728-b179-e655cbb241e6 req-a1220d42-7898-4b97-89ba-a09b9cdb1d4e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:47.197761 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3611afc-2760-4728-b179-e655cbb241e6 req-a1220d42-7898-4b97-89ba-a09b9cdb1d4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:47.199043 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f3611afc-2760-4728-b179-e655cbb241e6 req-a1220d42-7898-4b97-89ba-a09b9cdb1d4e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:47.201679 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f3611afc-2760-4728-b179-e655cbb241e6 req-a1220d42-7898-4b97-89ba-a09b9cdb1d4e service neutron] 10.222.0.31 "PUT /v2.0/ports/37ba309b-f598-4b1e-b3e8-35aa21ab14d3 HTTP/1.1" status: 200 len: 1119 time: 1.4978294 Dec 09 21:17:47.204740 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '548538cf-319a-4465-9a2b-f54718ee91be', 'tag': '37ba309b-f598-4b1e-b3e8-35aa21ab14d3'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:17:47.209412 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9c7299ba-3cfc-460c-b695-1745a5eef1db" -d '{"events": [{"name": "network-changed", "server_uuid": "548538cf-319a-4465-9a2b-f54718ee91be", "tag": "37ba309b-f598-4b1e-b3e8-35aa21ab14d3"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:17:47.276252 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9387bc84-f37e-430e-8c19-d58328ad76e4 req-1201ea9c-7951-4a4a-a8a9-e9155b9e44c8 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/security-groups?id=cf1d3e91-3176-48c8-adff-dd58205947d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1895089 Dec 09 21:17:47.390948 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1220d42-7898-4b97-89ba-a09b9cdb1d4e service neutron] Pushing event updated for resources: {'Port': ['ID=37ba309b-f598-4b1e-b3e8-35aa21ab14d3,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:47.431967 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3611afc-2760-4728-b179-e655cbb241e6 req-801c11d6-fbf5-4faa-bf48-5044ce26c7e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:47.434044 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f3611afc-2760-4728-b179-e655cbb241e6 req-801c11d6-fbf5-4faa-bf48-5044ce26c7e4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=97c6f11d72db4857afd32603bdfd0616&device_id=548538cf-319a-4465-9a2b-f54718ee91be HTTP/1.1" status: 200 len: 1122 time: 0.1578979 Dec 09 21:17:47.466879 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ab318b1-0c40-44e4-b79a-19d8b995c9da req-607a4bd6-e84e-412b-92a7-b732248a7c78 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:47.473138 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ab318b1-0c40-44e4-b79a-19d8b995c9da req-607a4bd6-e84e-412b-92a7-b732248a7c78 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 932 time: 0.1564984 Dec 09 21:17:47.532954 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f3611afc-2760-4728-b179-e655cbb241e6 req-1972aea2-a624-4365-a458-6657fc083868 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.107&port_id=37ba309b-f598-4b1e-b3e8-35aa21ab14d3 HTTP/1.1" status: 200 len: 217 time: 0.0908570 Dec 09 21:17:47.539402 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:17:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-adc3b6f0-6f6f-46fa-a21d-518c0e004166 x-openstack-request-id: req-adc3b6f0-6f6f-46fa-a21d-518c0e004166 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:17:47.539726 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "548538cf-319a-4465-9a2b-f54718ee91be", "tag": "37ba309b-f598-4b1e-b3e8-35aa21ab14d3", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:17:47.539980 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-adc3b6f0-6f6f-46fa-a21d-518c0e004166 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:17:47.540442 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '548538cf-319a-4465-9a2b-f54718ee91be', 'tag': '37ba309b-f598-4b1e-b3e8-35aa21ab14d3', 'status': 'completed', 'code': 200} Dec 09 21:17:47.606890 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 45acc430-900d-475a-af6a-44f47e8a8d29 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:17:47.625198 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ab318b1-0c40-44e4-b79a-19d8b995c9da req-7d902e33-758b-4c7a-b9ea-f6421af50204 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1448867 Dec 09 21:17:47.647745 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3611afc-2760-4728-b179-e655cbb241e6 req-7838d028-808e-4a32-83a5-ac62b1c95db1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:47.649289 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f3611afc-2760-4728-b179-e655cbb241e6 req-7838d028-808e-4a32-83a5-ac62b1c95db1 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1030412 Dec 09 21:17:47.749492 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 45acc430-900d-475a-af6a-44f47e8a8d29 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:17:47.754459 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 45acc430-900d-475a-af6a-44f47e8a8d29 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:47.755400 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:47.764461 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20c1efdf-dfcc-4355-8da5-86759c2dd5f3 req-d9561ade-5cb4-47a1-83ee-9c7bf234c272 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:47.766068 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20c1efdf-dfcc-4355-8da5-86759c2dd5f3 req-d9561ade-5cb4-47a1-83ee-9c7bf234c272 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=548538cf-319a-4465-9a2b-f54718ee91be HTTP/1.1" status: 200 len: 970 time: 0.1264999 Dec 09 21:17:47.785974 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3611afc-2760-4728-b179-e655cbb241e6 req-8351ec2e-6acb-4286-a884-f349ced625e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:47.788810 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f3611afc-2760-4728-b179-e655cbb241e6 req-8351ec2e-6acb-4286-a884-f349ced625e7 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1297166 Dec 09 21:17:47.903246 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:47.929447 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f3611afc-2760-4728-b179-e655cbb241e6 req-22bbb66c-d792-4785-aa98-9162c189cba9 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1298409 Dec 09 21:17:47.932429 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20c1efdf-dfcc-4355-8da5-86759c2dd5f3 req-a8a0532c-c91a-4be0-aa32-c54f22763493 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1505060 Dec 09 21:17:47.947104 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e6721efc-7196-4b31-b864-440bcc89de57', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '45acc430-900d-475a-af6a-44f47e8a8d29'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:17:48.052028 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f3611afc-2760-4728-b179-e655cbb241e6 req-c82a0ebb-6e8c-4b7d-bd55-0b9d1a46718f service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1140180 Dec 09 21:17:48.056751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 45acc430-900d-475a-af6a-44f47e8a8d29, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=45acc430-900d-475a-af6a-44f47e8a8d29,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:17:48.063945 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:48.131162 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=45acc430-900d-475a-af6a-44f47e8a8d29,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:48.159859 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c7299ba-3cfc-460c-b695-1745a5eef1db req-5e956f54-5809-4ba2-b282-f08fe53b0d36 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:48.162414 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9c7299ba-3cfc-460c-b695-1745a5eef1db req-5e956f54-5809-4ba2-b282-f08fe53b0d36 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=97c6f11d72db4857afd32603bdfd0616&device_id=548538cf-319a-4465-9a2b-f54718ee91be HTTP/1.1" status: 200 len: 1122 time: 0.0517724 Dec 09 21:17:48.293782 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c7299ba-3cfc-460c-b695-1745a5eef1db req-5076fe31-a43d-4ea8-a36e-8b0741110e04 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:48.295293 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9c7299ba-3cfc-460c-b695-1745a5eef1db req-5076fe31-a43d-4ea8-a36e-8b0741110e04 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.1234713 Dec 09 21:17:48.319206 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-4afd73b4-07d8-40fb-ae55-57d27a726bb7 req-306177ac-2311-427a-b690-e5e123006c8b tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Request body: {'security_group': {'name': 'tempest-securitygroup-1148762821', 'description': 'tempest-description-1082466765'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:48.344326 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1e83aa3d-3ac5-41c4-8ccf-002121182394" -d '{"events": [{"server_uuid": "e6721efc-7196-4b31-b864-440bcc89de57", "name": "network-vif-plugged", "status": "completed", "tag": "45acc430-900d-475a-af6a-44f47e8a8d29"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:17:48.357643 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9c7299ba-3cfc-460c-b695-1745a5eef1db req-cc2ca0ac-716b-4f8a-beb6-ec6f55a84abd service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.107&port_id=37ba309b-f598-4b1e-b3e8-35aa21ab14d3 HTTP/1.1" status: 200 len: 217 time: 0.0527647 Dec 09 21:17:48.361056 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4afd73b4-07d8-40fb-ae55-57d27a726bb7 req-306177ac-2311-427a-b690-e5e123006c8b tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:48.377664 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4afd73b4-07d8-40fb-ae55-57d27a726bb7 req-306177ac-2311-427a-b690-e5e123006c8b tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:48.411046 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c7299ba-3cfc-460c-b695-1745a5eef1db req-82e2837e-06b3-46db-9f01-22cd27b38615 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:48.412559 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9c7299ba-3cfc-460c-b695-1745a5eef1db req-82e2837e-06b3-46db-9f01-22cd27b38615 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0478454 Dec 09 21:17:48.478678 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c7299ba-3cfc-460c-b695-1745a5eef1db req-36b1f3cd-ecad-43f9-bf58-dcd57600c0e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:48.480409 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9c7299ba-3cfc-460c-b695-1745a5eef1db req-36b1f3cd-ecad-43f9-bf58-dcd57600c0e7 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0600274 Dec 09 21:17:48.489248 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4afd73b4-07d8-40fb-ae55-57d27a726bb7 req-306177ac-2311-427a-b690-e5e123006c8b tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:48.502223 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4afd73b4-07d8-40fb-ae55-57d27a726bb7 req-306177ac-2311-427a-b690-e5e123006c8b tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:48.563722 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-306177ac-2311-427a-b690-e5e123006c8b tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2adaaf6b-c282-4851-b515-a2fb6e63378a,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:48.592041 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bac8602c-2162-47e7-a64a-9abc2d726541 req-08c4c21f-dd22-4a24-bbf4-854844cf3111 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:48.593600 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bac8602c-2162-47e7-a64a-9abc2d726541 req-08c4c21f-dd22-4a24-bbf4-854844cf3111 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 971 time: 0.1004519 Dec 09 21:17:48.620171 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9c7299ba-3cfc-460c-b695-1745a5eef1db req-2871eee4-37fc-4dc7-adb3-827176add97a service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1314654 Dec 09 21:17:48.638856 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4afd73b4-07d8-40fb-ae55-57d27a726bb7 req-306177ac-2311-427a-b690-e5e123006c8b tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:48.649147 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4afd73b4-07d8-40fb-ae55-57d27a726bb7 req-306177ac-2311-427a-b690-e5e123006c8b tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:48.700628 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bac8602c-2162-47e7-a64a-9abc2d726541 req-54833eaf-bd84-4f57-9c4f-535c4dbe4009 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/security-groups?id=cf1d3e91-3176-48c8-adff-dd58205947d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0943620 Dec 09 21:17:48.706204 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4afd73b4-07d8-40fb-ae55-57d27a726bb7 req-306177ac-2311-427a-b690-e5e123006c8b tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:48.707368 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4afd73b4-07d8-40fb-ae55-57d27a726bb7 req-306177ac-2311-427a-b690-e5e123006c8b tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1800 time: 0.3927639 Dec 09 21:17:48.709550 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-306177ac-2311-427a-b690-e5e123006c8b tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0cf2e5ce-f15b-437a-b06e-49010a6a46a1,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:48.755592 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9c7299ba-3cfc-460c-b695-1745a5eef1db req-bc02124d-47fb-4c2d-9d47-139118ecdff3 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1274450 Dec 09 21:17:48.892319 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83f7a482-d830-41f7-83b4-159d154e8269 req-af2894d9-884d-421e-adb4-1001ebe7c32b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:48.893949 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83f7a482-d830-41f7-83b4-159d154e8269 req-af2894d9-884d-421e-adb4-1001ebe7c32b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 932 time: 0.0687244 Dec 09 21:17:48.955099 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83f7a482-d830-41f7-83b4-159d154e8269 req-d768c11a-6cb8-480c-a60f-3ae0def57379 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0466366 Dec 09 21:17:48.995389 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-4bbc78a9-efe7-4fa6-9e1a-f0f7760a5335 req-4f7cc1ad-1ce3-4740-a671-a2960382a937 tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Request body: {'security_group': {'name': 'tempest-securitygroup-525690756', 'description': 'tempest-description-1677626841'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:49.023953 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4bbc78a9-efe7-4fa6-9e1a-f0f7760a5335 req-4f7cc1ad-1ce3-4740-a671-a2960382a937 tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:49.045157 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:17:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-399f0dee-a7ca-4c6b-8faf-1b3dafc85f2a x-openstack-request-id: req-399f0dee-a7ca-4c6b-8faf-1b3dafc85f2a {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:17:49.046730 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e6721efc-7196-4b31-b864-440bcc89de57", "name": "network-vif-plugged", "status": "completed", "tag": "45acc430-900d-475a-af6a-44f47e8a8d29", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:17:49.046990 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-399f0dee-a7ca-4c6b-8faf-1b3dafc85f2a {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:17:49.047611 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e6721efc-7196-4b31-b864-440bcc89de57', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '45acc430-900d-475a-af6a-44f47e8a8d29', 'code': 200} Dec 09 21:17:49.195837 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4bbc78a9-efe7-4fa6-9e1a-f0f7760a5335 req-4f7cc1ad-1ce3-4740-a671-a2960382a937 tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:49.202154 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4bbc78a9-efe7-4fa6-9e1a-f0f7760a5335 req-4f7cc1ad-1ce3-4740-a671-a2960382a937 tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:49.212436 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-030524df-7826-4c27-8916-1e74025e6677 req-23070924-f70b-4e6d-981d-fab605b4087b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:49.215125 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-030524df-7826-4c27-8916-1e74025e6677 req-23070924-f70b-4e6d-981d-fab605b4087b service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 1123 time: 0.0907209 Dec 09 21:17:49.237006 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f7cc1ad-1ce3-4740-a671-a2960382a937 tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a870c301-a40a-4869-89f9-a046d3f81633,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:49.246813 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe4efb09-64fc-4ec1-b125-fc313d9ae694 req-71b70f10-e059-4169-b7c8-838e0e2298c6 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:49.248384 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe4efb09-64fc-4ec1-b125-fc313d9ae694 req-71b70f10-e059-4169-b7c8-838e0e2298c6 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=548538cf-319a-4465-9a2b-f54718ee91be HTTP/1.1" status: 200 len: 970 time: 0.1041677 Dec 09 21:17:49.249971 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-030524df-7826-4c27-8916-1e74025e6677 req-16c3631d-f4af-470b-ad06-b0103eeb289d service neutron] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:49.251911 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4bbc78a9-efe7-4fa6-9e1a-f0f7760a5335 req-4f7cc1ad-1ce3-4740-a671-a2960382a937 tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:49.253520 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4bbc78a9-efe7-4fa6-9e1a-f0f7760a5335 req-4f7cc1ad-1ce3-4740-a671-a2960382a937 tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1799 time: 0.2624583 Dec 09 21:17:49.303562 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe4efb09-64fc-4ec1-b125-fc313d9ae694 req-3e667b6f-1e79-403f-9ab0-f1ef88548d52 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440626 Dec 09 21:17:49.351551 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-030524df-7826-4c27-8916-1e74025e6677 req-16c3631d-f4af-470b-ad06-b0103eeb289d service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:49.357065 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-030524df-7826-4c27-8916-1e74025e6677 req-16c3631d-f4af-470b-ad06-b0103eeb289d service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:49.424255 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16c3631d-f4af-470b-ad06-b0103eeb289d service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=425ea72d-9522-4d8e-a239-f5c4faf7148d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:49.429003 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-030524df-7826-4c27-8916-1e74025e6677 req-16c3631d-f4af-470b-ad06-b0103eeb289d service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=cf1d3e91-3176-48c8-adff-dd58205947d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2056532 Dec 09 21:17:49.536162 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-f8236b4f-78ab-4906-9454-e911bd69412f req-c4b2b451-4924-4806-bf72-0f6ada9c189b tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Request body: {'security_group': {'name': 'tempest-securitygroup-1317803432', 'description': 'tempest-description-2048223093'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:49.561362 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f8236b4f-78ab-4906-9454-e911bd69412f req-c4b2b451-4924-4806-bf72-0f6ada9c189b tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:49.571190 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f8236b4f-78ab-4906-9454-e911bd69412f req-c4b2b451-4924-4806-bf72-0f6ada9c189b tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:49.670786 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f8236b4f-78ab-4906-9454-e911bd69412f req-c4b2b451-4924-4806-bf72-0f6ada9c189b tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:49.675069 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f8236b4f-78ab-4906-9454-e911bd69412f req-c4b2b451-4924-4806-bf72-0f6ada9c189b tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:49.707825 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4b2b451-4924-4806-bf72-0f6ada9c189b tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6195c935-5fc1-4c6f-b5c0-26cb2008b080,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:49.766985 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f8236b4f-78ab-4906-9454-e911bd69412f req-c4b2b451-4924-4806-bf72-0f6ada9c189b tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:49.772741 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f8236b4f-78ab-4906-9454-e911bd69412f req-c4b2b451-4924-4806-bf72-0f6ada9c189b tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:49.806842 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f8236b4f-78ab-4906-9454-e911bd69412f req-c4b2b451-4924-4806-bf72-0f6ada9c189b tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:49.817692 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8236b4f-78ab-4906-9454-e911bd69412f req-c4b2b451-4924-4806-bf72-0f6ada9c189b tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1800 time: 0.2820625 Dec 09 21:17:49.824810 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4b2b451-4924-4806-bf72-0f6ada9c189b tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9ee08e54-b743-42a7-865d-3c0c82991456,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:49.931050 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-9d18f08e-5154-4647-a9ed-d46db7ad16f7 req-e895f2ca-461e-4447-92a0-0e67b7cf0d66 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Request body: {'security_group': {'name': 'tempest-securitygroup-863347450', 'description': 'tempest-description-996395419'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:50.098807 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d7c6620-e543-4395-8851-fa9c80602a9a req-9baf57bc-df15-4474-924e-5cb412482820 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:50.100314 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3d7c6620-e543-4395-8851-fa9c80602a9a req-9baf57bc-df15-4474-924e-5cb412482820 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 971 time: 0.2044437 Dec 09 21:17:50.101513 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9d18f08e-5154-4647-a9ed-d46db7ad16f7 req-e895f2ca-461e-4447-92a0-0e67b7cf0d66 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:50.174775 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3d7c6620-e543-4395-8851-fa9c80602a9a req-d3358f34-ff69-43ed-8755-847f45eb88df tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/security-groups?id=cf1d3e91-3176-48c8-adff-dd58205947d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0643842 Dec 09 21:17:50.204306 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9d18f08e-5154-4647-a9ed-d46db7ad16f7 req-e895f2ca-461e-4447-92a0-0e67b7cf0d66 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:50.209667 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9d18f08e-5154-4647-a9ed-d46db7ad16f7 req-e895f2ca-461e-4447-92a0-0e67b7cf0d66 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:50.235929 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e895f2ca-461e-4447-92a0-0e67b7cf0d66 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fb33b704-0102-4da9-b169-b1eb2711091f,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:50.248090 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9d18f08e-5154-4647-a9ed-d46db7ad16f7 req-e895f2ca-461e-4447-92a0-0e67b7cf0d66 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:50.249466 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d18f08e-5154-4647-a9ed-d46db7ad16f7 req-e895f2ca-461e-4447-92a0-0e67b7cf0d66 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1798 time: 0.3275688 Dec 09 21:17:50.255748 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:17:50.338347 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2231d7ad-c431-4691-8c74-4b4041131bba req-870df6f8-094d-44b0-ac70-8a6ed10dc7f9 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:50.339941 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2231d7ad-c431-4691-8c74-4b4041131bba req-870df6f8-094d-44b0-ac70-8a6ed10dc7f9 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 932 time: 0.0559759 Dec 09 21:17:50.425357 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2231d7ad-c431-4691-8c74-4b4041131bba req-9ea22fdc-9822-4597-9589-21a12fdfcddf tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0779874 Dec 09 21:17:50.570900 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3236fc4f-c9c0-4337-8cfc-f9d4b56f8b4c req-59760afb-601b-46c9-82ba-cc71176cf276 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 34268 time: 0.2464571 Dec 09 21:17:50.594910 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faccdab2-1727-47a1-bdad-87e37a1a318f req-27e103c8-7c4c-44a9-932b-39a664e4c7e0 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:50.596736 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-faccdab2-1727-47a1-bdad-87e37a1a318f req-27e103c8-7c4c-44a9-932b-39a664e4c7e0 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=548538cf-319a-4465-9a2b-f54718ee91be HTTP/1.1" status: 200 len: 970 time: 0.0806859 Dec 09 21:17:50.650980 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3236fc4f-c9c0-4337-8cfc-f9d4b56f8b4c req-eb3df860-ccc5-45f0-8bda-bdd766e261e2 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "GET /v2.0/security-groups/2adaaf6b-c282-4851-b515-a2fb6e63378a HTTP/1.1" status: 200 len: 2998 time: 0.0712836 Dec 09 21:17:50.673628 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-faccdab2-1727-47a1-bdad-87e37a1a318f req-7e78fb95-ae1d-412e-ba12-156cdcdfc5b7 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0696423 Dec 09 21:17:50.704264 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3236fc4f-c9c0-4337-8cfc-f9d4b56f8b4c req-de27b86f-ad8f-4f29-867a-aaab46718e32 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "GET /v2.0/security-groups/2adaaf6b-c282-4851-b515-a2fb6e63378a HTTP/1.1" status: 200 len: 2998 time: 0.0431457 Dec 09 21:17:50.748265 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3236fc4f-c9c0-4337-8cfc-f9d4b56f8b4c req-588d1025-c1fe-4391-a70d-5ddc5c8c6e1f tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "GET /v2.0/security-groups/425ea72d-9522-4d8e-a239-f5c4faf7148d HTTP/1.1" status: 200 len: 2998 time: 0.0373442 Dec 09 21:17:50.801357 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3236fc4f-c9c0-4337-8cfc-f9d4b56f8b4c req-0b1559a5-b1fd-4145-b684-d1a5949f69ae tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "GET /v2.0/security-groups/425ea72d-9522-4d8e-a239-f5c4faf7148d HTTP/1.1" status: 200 len: 2998 time: 0.0471840 Dec 09 21:17:50.852197 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3236fc4f-c9c0-4337-8cfc-f9d4b56f8b4c req-d6439ae7-2430-4cc4-9cec-1b1ca6850518 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "GET /v2.0/security-groups/6195c935-5fc1-4c6f-b5c0-26cb2008b080 HTTP/1.1" status: 200 len: 2998 time: 0.0430093 Dec 09 21:17:50.896900 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3236fc4f-c9c0-4337-8cfc-f9d4b56f8b4c req-7012e3cc-4264-4faa-881c-513eeb7245f0 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "GET /v2.0/security-groups/6195c935-5fc1-4c6f-b5c0-26cb2008b080 HTTP/1.1" status: 200 len: 2998 time: 0.0374398 Dec 09 21:17:50.975124 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3236fc4f-c9c0-4337-8cfc-f9d4b56f8b4c req-b8770dc8-ac1b-432d-8fcf-a394526c9419 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "GET /v2.0/security-groups/7ae4e484-77fd-4ae2-87c0-0bafbcf52680 HTTP/1.1" status: 200 len: 2994 time: 0.0707955 Dec 09 21:17:51.022169 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3236fc4f-c9c0-4337-8cfc-f9d4b56f8b4c req-a04679df-9efa-4379-a596-203669f6ebec tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "GET /v2.0/security-groups/7ae4e484-77fd-4ae2-87c0-0bafbcf52680 HTTP/1.1" status: 200 len: 2994 time: 0.0456650 Dec 09 21:17:51.066809 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3236fc4f-c9c0-4337-8cfc-f9d4b56f8b4c req-2d4cf918-906d-459d-8626-a081a7f4cb6b tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "GET /v2.0/security-groups/b6f5fcbc-4de6-4e7d-bbba-67629aba06d6 HTTP/1.1" status: 200 len: 2998 time: 0.0436246 Dec 09 21:17:51.110696 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3236fc4f-c9c0-4337-8cfc-f9d4b56f8b4c req-4ffa910e-86ac-4036-9c72-d282ee552f0d tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "GET /v2.0/security-groups/b6f5fcbc-4de6-4e7d-bbba-67629aba06d6 HTTP/1.1" status: 200 len: 2998 time: 0.0427880 Dec 09 21:17:51.155106 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3236fc4f-c9c0-4337-8cfc-f9d4b56f8b4c req-8cea20d3-044f-48c5-a72b-7ba9e7d0ac1e tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "GET /v2.0/security-groups/cf1d3e91-3176-48c8-adff-dd58205947d5 HTTP/1.1" status: 200 len: 2998 time: 0.0431652 Dec 09 21:17:51.201398 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3236fc4f-c9c0-4337-8cfc-f9d4b56f8b4c req-c81b2482-829f-4350-a47f-f249e4b7ca55 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "GET /v2.0/security-groups/cf1d3e91-3176-48c8-adff-dd58205947d5 HTTP/1.1" status: 200 len: 2998 time: 0.0397949 Dec 09 21:17:51.263470 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54658) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:51.299143 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3236fc4f-c9c0-4337-8cfc-f9d4b56f8b4c req-439a1716-728c-4f0d-af65-4eebb22db46e tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "GET /v2.0/security-groups/d1cde8f1-4e89-421d-887b-12f0b0209bec HTTP/1.1" status: 200 len: 2994 time: 0.0883729 Dec 09 21:17:51.299419 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54662) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:51.330253 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67e86a91-65e2-4a84-af6a-2a0b3eb1d589 req-ca6ef0cd-5894-40c2-8966-3007893f92f7 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:51.331748 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67e86a91-65e2-4a84-af6a-2a0b3eb1d589 req-ca6ef0cd-5894-40c2-8966-3007893f92f7 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 971 time: 0.0638857 Dec 09 21:17:51.340188 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-538fcacd-617c-47a2-9116-8c3fe840f40b service neutron] Request body: {'port': {'device_id': '2c85b8fc-41be-4975-88fd-db5bc87f1f89', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:51.374023 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3236fc4f-c9c0-4337-8cfc-f9d4b56f8b4c req-0236a97f-7e78-4e20-8a54-3fd615ca93c2 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "GET /v2.0/security-groups/d1cde8f1-4e89-421d-887b-12f0b0209bec HTTP/1.1" status: 200 len: 2994 time: 0.0680003 Dec 09 21:17:51.393788 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01c264da-89b2-413b-9ef1-48b9dc52743c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:51.395565 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ff41b2d9-3615-4862-b782-79877c55b737 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:51.409119 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67e86a91-65e2-4a84-af6a-2a0b3eb1d589 req-78413900-3607-46f5-9d5b-84c4f0d5fcb6 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/security-groups?id=cf1d3e91-3176-48c8-adff-dd58205947d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0686774 Dec 09 21:17:51.430562 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3236fc4f-c9c0-4337-8cfc-f9d4b56f8b4c req-5ffe664c-1c01-4a3c-a761-788786aec5fa tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "GET /v2.0/security-groups/d9593022-b0a6-4122-8646-75540c10b69e HTTP/1.1" status: 200 len: 2994 time: 0.0486662 Dec 09 21:17:51.461065 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-538fcacd-617c-47a2-9116-8c3fe840f40b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:51.487595 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3236fc4f-c9c0-4337-8cfc-f9d4b56f8b4c req-33b7330f-3589-495f-9cee-200fa914c794 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "GET /v2.0/security-groups/d9593022-b0a6-4122-8646-75540c10b69e HTTP/1.1" status: 200 len: 2994 time: 0.0474615 Dec 09 21:17:51.578108 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3236fc4f-c9c0-4337-8cfc-f9d4b56f8b4c req-949181dd-8b16-413d-a8cf-f5f86919a00c tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "GET /v2.0/security-groups/ebf127bc-0f4e-426a-97ff-c9afda204c3a HTTP/1.1" status: 200 len: 2990 time: 0.0860314 Dec 09 21:17:51.608239 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27d8f6c2-6876-42e1-a20b-a3aa00e47008 req-915716f5-73fa-4e22-9f39-34e2d2e8c84d tempest-AggregatesAdminTestJSON-1832311216 tempest-AggregatesAdminTestJSON-1832311216-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:51.609699 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27d8f6c2-6876-42e1-a20b-a3aa00e47008 req-915716f5-73fa-4e22-9f39-34e2d2e8c84d tempest-AggregatesAdminTestJSON-1832311216 tempest-AggregatesAdminTestJSON-1832311216-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 1123 time: 0.0809917 Dec 09 21:17:51.619780 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 37ba309b-f598-4b1e-b3e8-35aa21ab14d3 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:17:51.635238 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-27d8f6c2-6876-42e1-a20b-a3aa00e47008 req-35904d38-b7af-40be-a0ad-5c1606b19c1b tempest-AggregatesAdminTestJSON-1832311216 tempest-AggregatesAdminTestJSON-1832311216-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:51.643964 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01c264da-89b2-413b-9ef1-48b9dc52743c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:51.658044 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01c264da-89b2-413b-9ef1-48b9dc52743c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:51.660201 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3236fc4f-c9c0-4337-8cfc-f9d4b56f8b4c req-45c342dc-5a1c-4b3e-961f-0dff8328c1e1 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "GET /v2.0/security-groups/ebf127bc-0f4e-426a-97ff-c9afda204c3a HTTP/1.1" status: 200 len: 2990 time: 0.0738966 Dec 09 21:17:51.677844 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ff41b2d9-3615-4862-b782-79877c55b737 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:51.700463 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ff41b2d9-3615-4862-b782-79877c55b737 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:51.741253 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-01c264da-89b2-413b-9ef1-48b9dc52743c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=edfc424655b24be79f3b3f89d759a810&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4406695 Dec 09 21:17:51.749654 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54674) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:51.750341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01c264da-89b2-413b-9ef1-48b9dc52743c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4f0777d8-3f64-415b-b13c-e84850477e61,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:51.756195 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-27d8f6c2-6876-42e1-a20b-a3aa00e47008 req-35904d38-b7af-40be-a0ad-5c1606b19c1b tempest-AggregatesAdminTestJSON-1832311216 tempest-AggregatesAdminTestJSON-1832311216-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:51.790681 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ff41b2d9-3615-4862-b782-79877c55b737 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e8d51a1780594ae0a1c45ab5ba084ff3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5236485 Dec 09 21:17:51.802513 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54676) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:51.812030 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-27d8f6c2-6876-42e1-a20b-a3aa00e47008 req-35904d38-b7af-40be-a0ad-5c1606b19c1b tempest-AggregatesAdminTestJSON-1832311216 tempest-AggregatesAdminTestJSON-1832311216-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:51.853923 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff41b2d9-3615-4862-b782-79877c55b737 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d4b3fda9-ef01-402e-bd3f-13191b685e53,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:51.876560 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35904d38-b7af-40be-a0ad-5c1606b19c1b tempest-AggregatesAdminTestJSON-1832311216 tempest-AggregatesAdminTestJSON-1832311216-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a13cfc6-b5d9-4a7a-8c45-eb1ce7c4c582,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:51.887239 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 37ba309b-f598-4b1e-b3e8-35aa21ab14d3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=37ba309b-f598-4b1e-b3e8-35aa21ab14d3,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:17:51.894844 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cc933000-38ad-49a0-a5e7-de583c09015e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:51.900618 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '37ba309b-f598-4b1e-b3e8-35aa21ab14d3', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '37ba309b-f598-4b1e-b3e8-35aa21ab14d3', 'mac_address': 'fa:16:3e:0f:a5:72', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.107'}], 'device_owner': 'compute:tempest-test_az-1650541094', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:17:51.908026 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27d8f6c2-6876-42e1-a20b-a3aa00e47008 req-35904d38-b7af-40be-a0ad-5c1606b19c1b tempest-AggregatesAdminTestJSON-1832311216 tempest-AggregatesAdminTestJSON-1832311216-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=cf1d3e91-3176-48c8-adff-dd58205947d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2909606 Dec 09 21:17:51.929323 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cd0f0de-f072-4f7a-aec0-d9b1f84d12f7 req-2f7646f7-f6c2-4f08-928d-bea3abdc2859 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:51.930884 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4cd0f0de-f072-4f7a-aec0-d9b1f84d12f7 req-2f7646f7-f6c2-4f08-928d-bea3abdc2859 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 932 time: 0.1727242 Dec 09 21:17:51.933760 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cc933000-38ad-49a0-a5e7-de583c09015e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:51.947763 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:51.963051 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 37ba309b-f598-4b1e-b3e8-35aa21ab14d3 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:17:51.963702 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f68e01c1-a6db-406d-afa2-a60b9d16a3e2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:51.984827 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-538fcacd-617c-47a2-9116-8c3fe840f40b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7eb6e48f-08e3-409a-9551-0e38eb690c8b {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:17:51.985629 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 37ba309b-f598-4b1e-b3e8-35aa21ab14d3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=37ba309b-f598-4b1e-b3e8-35aa21ab14d3,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:17:51.990742 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:51.998167 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-538fcacd-617c-47a2-9116-8c3fe840f40b service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:52.021744 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-538fcacd-617c-47a2-9116-8c3fe840f40b service neutron] Transition to ACTIVE for port object 7eb6e48f-08e3-409a-9551-0e38eb690c8b will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:17:52.025479 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cc933000-38ad-49a0-a5e7-de583c09015e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:52.028246 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cc933000-38ad-49a0-a5e7-de583c09015e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:52.029941 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cc933000-38ad-49a0-a5e7-de583c09015e admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/4f0777d8-3f64-415b-b13c-e84850477e61 HTTP/1.1" status: 204 len: 168 time: 0.2762687 Dec 09 21:17:52.034600 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-538fcacd-617c-47a2-9116-8c3fe840f40b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:52.038620 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f68e01c1-a6db-406d-afa2-a60b9d16a3e2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:52.044740 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc933000-38ad-49a0-a5e7-de583c09015e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4f0777d8-3f64-415b-b13c-e84850477e61,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:52.068197 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4cd0f0de-f072-4f7a-aec0-d9b1f84d12f7 req-c47539f1-df45-46bf-96ef-5c4a2a919c0a tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1272769 Dec 09 21:17:52.105771 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=37ba309b-f598-4b1e-b3e8-35aa21ab14d3,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:52.108143 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b067992-ed98-4ab3-bc32-2775f56d6500 req-927e7cca-dd53-43aa-8456-9a3a5dc9b381 tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=c148c9b1315b4b93a7f32aad97440e96 HTTP/1.1" status: 200 len: 6154 time: 0.1660442 Dec 09 21:17:52.118844 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-538fcacd-617c-47a2-9116-8c3fe840f40b service neutron] Pushing event updated for resources: {'Port': ['ID=7eb6e48f-08e3-409a-9551-0e38eb690c8b,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:52.168905 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b067992-ed98-4ab3-bc32-2775f56d6500 req-3f8ac943-7ead-414e-9a3b-2c56cdc1e804 tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] 10.222.0.13 "GET /v2.0/security-groups/2adaaf6b-c282-4851-b515-a2fb6e63378a HTTP/1.1" status: 200 len: 2998 time: 0.0597982 Dec 09 21:17:52.172754 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f68e01c1-a6db-406d-afa2-a60b9d16a3e2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:52.175431 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f68e01c1-a6db-406d-afa2-a60b9d16a3e2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:52.179141 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f68e01c1-a6db-406d-afa2-a60b9d16a3e2 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/d4b3fda9-ef01-402e-bd3f-13191b685e53 HTTP/1.1" status: 204 len: 168 time: 0.3726833 Dec 09 21:17:52.190994 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-538fcacd-617c-47a2-9116-8c3fe840f40b service neutron] Attempting to bind port 7eb6e48f-08e3-409a-9551-0e38eb690c8b on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:17:52.191341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-538fcacd-617c-47a2-9116-8c3fe840f40b service neutron] Attempting to bind port 7eb6e48f-08e3-409a-9551-0e38eb690c8b by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '946d0405-6c7f-49a7-81bb-30e422c98100', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:17:52.191754 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-538fcacd-617c-47a2-9116-8c3fe840f40b service neutron] Attempting to bind port 7eb6e48f-08e3-409a-9551-0e38eb690c8b on network ce6b6bd1-6a60-4cea-9b70-69fd0290796c {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:17:52.196921 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-538fcacd-617c-47a2-9116-8c3fe840f40b service neutron] Port 7eb6e48f-08e3-409a-9551-0e38eb690c8b on network ce6b6bd1-6a60-4cea-9b70-69fd0290796c not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:17:52.197258 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-538fcacd-617c-47a2-9116-8c3fe840f40b service neutron] Attempting to bind port 7eb6e48f-08e3-409a-9551-0e38eb690c8b on network ce6b6bd1-6a60-4cea-9b70-69fd0290796c {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:17:52.203362 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-538fcacd-617c-47a2-9116-8c3fe840f40b service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 17, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:17:52.203823 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-538fcacd-617c-47a2-9116-8c3fe840f40b service neutron] Checking segment: {'id': '946d0405-6c7f-49a7-81bb-30e422c98100', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:17:52.204201 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-538fcacd-617c-47a2-9116-8c3fe840f40b service neutron] Bound using segment: {'id': '946d0405-6c7f-49a7-81bb-30e422c98100', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:17:52.204627 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-538fcacd-617c-47a2-9116-8c3fe840f40b service neutron] Bound port: 7eb6e48f-08e3-409a-9551-0e38eb690c8b, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '946d0405-6c7f-49a7-81bb-30e422c98100', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:17:52.207279 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-538fcacd-617c-47a2-9116-8c3fe840f40b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:52.227666 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f68e01c1-a6db-406d-afa2-a60b9d16a3e2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d4b3fda9-ef01-402e-bd3f-13191b685e53,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:52.235838 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['37ba309b-f598-4b1e-b3e8-35aa21ab14d3'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:17:52.310391 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b067992-ed98-4ab3-bc32-2775f56d6500 req-00062f52-c586-41f0-b846-9cf34ab72fba tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] 10.222.0.13 "GET /v2.0/security-groups/2adaaf6b-c282-4851-b515-a2fb6e63378a HTTP/1.1" status: 200 len: 2998 time: 0.1404083 Dec 09 21:17:52.321279 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acf43844-ab3e-43a9-86ca-9773d71286df req-e1ac851c-1df1-4e1a-a148-dbdae46074b8 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:52.322811 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-acf43844-ab3e-43a9-86ca-9773d71286df req-e1ac851c-1df1-4e1a-a148-dbdae46074b8 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=548538cf-319a-4465-9a2b-f54718ee91be HTTP/1.1" status: 200 len: 971 time: 0.1103373 Dec 09 21:17:52.338577 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-538fcacd-617c-47a2-9116-8c3fe840f40b service neutron] For port 7eb6e48f-08e3-409a-9551-0e38eb690c8b, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:17:52.346362 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-538fcacd-617c-47a2-9116-8c3fe840f40b service neutron] For port 7eb6e48f-08e3-409a-9551-0e38eb690c8b, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=7eb6e48f-08e3-409a-9551-0e38eb690c8b,segment=NetworkSegment(946d0405-6c7f-49a7-81bb-30e422c98100),segment_id=946d0405-6c7f-49a7-81bb-30e422c98100)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:17:52.355111 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-538fcacd-617c-47a2-9116-8c3fe840f40b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:52.433499 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-538fcacd-617c-47a2-9116-8c3fe840f40b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:52.434184 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-538fcacd-617c-47a2-9116-8c3fe840f40b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:52.436209 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-538fcacd-617c-47a2-9116-8c3fe840f40b service neutron] 10.222.0.10 "PUT /v2.0/ports/7eb6e48f-08e3-409a-9551-0e38eb690c8b HTTP/1.1" status: 200 len: 1093 time: 1.4103022 Dec 09 21:17:52.438926 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2c85b8fc-41be-4975-88fd-db5bc87f1f89', 'tag': '7eb6e48f-08e3-409a-9551-0e38eb690c8b'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:17:52.441292 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1cd91248-fd06-40d2-8cd4-6b209e870e55" -d '{"events": [{"name": "network-changed", "server_uuid": "2c85b8fc-41be-4975-88fd-db5bc87f1f89", "tag": "7eb6e48f-08e3-409a-9551-0e38eb690c8b"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:17:52.466375 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-acf43844-ab3e-43a9-86ca-9773d71286df req-6f12b18b-2c24-40d9-9662-3be9852738ae tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1312428 Dec 09 21:17:52.495524 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-538fcacd-617c-47a2-9116-8c3fe840f40b service neutron] Pushing event updated for resources: {'Port': ['ID=7eb6e48f-08e3-409a-9551-0e38eb690c8b,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:52.570113 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-45aa3e68-ccac-42e4-9d3f-1b0135261b69 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:52.572437 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-45aa3e68-ccac-42e4-9d3f-1b0135261b69 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=615039519ef147c78eb38a1d65eac061&device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 1096 time: 0.0892997 Dec 09 21:17:52.593182 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-744d6e22-3866-4d3f-acee-84e79d2d15a6 req-41a00861-9f29-4d00-8a54-21679f017ecc tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "GET /v2.0/security-groups/fb33b704-0102-4da9-b169-b1eb2711091f HTTP/1.1" status: 200 len: 1793 time: 0.0716155 Dec 09 21:17:52.651856 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-744d6e22-3866-4d3f-acee-84e79d2d15a6 req-d45878f6-d6c3-47ef-9b07-4ae222bc08d1 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:52.655642 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-a5731aa4-c357-4343-a1ed-00cca671d85a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=7eb6e48f-08e3-409a-9551-0e38eb690c8b HTTP/1.1" status: 200 len: 217 time: 0.0724645 Dec 09 21:17:52.686662 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-744d6e22-3866-4d3f-acee-84e79d2d15a6 req-d45878f6-d6c3-47ef-9b07-4ae222bc08d1 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:52.743418 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54698) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:52.743951 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-744d6e22-3866-4d3f-acee-84e79d2d15a6 req-d45878f6-d6c3-47ef-9b07-4ae222bc08d1 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:52.747803 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-744d6e22-3866-4d3f-acee-84e79d2d15a6 req-d45878f6-d6c3-47ef-9b07-4ae222bc08d1 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:52.749014 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-744d6e22-3866-4d3f-acee-84e79d2d15a6 req-d45878f6-d6c3-47ef-9b07-4ae222bc08d1 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "DELETE /v2.0/security-groups/fb33b704-0102-4da9-b169-b1eb2711091f HTTP/1.1" status: 204 len: 173 time: 0.1487024 Dec 09 21:17:52.763643 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d45878f6-d6c3-47ef-9b07-4ae222bc08d1 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fb33b704-0102-4da9-b169-b1eb2711091f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:52.768212 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-d5f5d1a6-34d1-4263-86d0-882d964f783d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:52.770093 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-d5f5d1a6-34d1-4263-86d0-882d964f783d service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9755e5ea-99a7-4073-8693-293dcc00b929 HTTP/1.1" status: 200 len: 861 time: 0.1069558 Dec 09 21:17:52.770512 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf7050ab-f647-4d45-8285-f75a57d4027a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:52.840341 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:17:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a5e7250e-cfee-4270-b4e2-83af114c2319 x-openstack-request-id: req-a5e7250e-cfee-4270-b4e2-83af114c2319 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:17:52.840799 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2c85b8fc-41be-4975-88fd-db5bc87f1f89", "tag": "7eb6e48f-08e3-409a-9551-0e38eb690c8b", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:17:52.841161 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a5e7250e-cfee-4270-b4e2-83af114c2319 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:17:52.841616 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2c85b8fc-41be-4975-88fd-db5bc87f1f89', 'tag': '7eb6e48f-08e3-409a-9551-0e38eb690c8b', 'status': 'completed', 'code': 200} Dec 09 21:17:52.884080 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-0fe23342-e423-4722-a8ad-b78fc3eca2c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:52.885773 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-0fe23342-e423-4722-a8ad-b78fc3eca2c7 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=ce6b6bd1-6a60-4cea-9b70-69fd0290796c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1027610 Dec 09 21:17:52.895704 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-877dcf7c-fd85-479f-802d-9274b2eced59 req-464b8ecc-c696-403d-9973-eb02916aa616 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "GET /v2.0/security-groups/9ee08e54-b743-42a7-865d-3c0c82991456 HTTP/1.1" status: 200 len: 1795 time: 0.0472438 Dec 09 21:17:52.951404 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-877dcf7c-fd85-479f-802d-9274b2eced59 req-fccabe2a-96e7-4236-9f22-221cefc91b44 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:52.973524 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-877dcf7c-fd85-479f-802d-9274b2eced59 req-fccabe2a-96e7-4236-9f22-221cefc91b44 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:53.003825 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf7050ab-f647-4d45-8285-f75a57d4027a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:53.010606 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf7050ab-f647-4d45-8285-f75a57d4027a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:53.022890 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-877dcf7c-fd85-479f-802d-9274b2eced59 req-fccabe2a-96e7-4236-9f22-221cefc91b44 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:53.027655 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-877dcf7c-fd85-479f-802d-9274b2eced59 req-fccabe2a-96e7-4236-9f22-221cefc91b44 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:53.032979 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-877dcf7c-fd85-479f-802d-9274b2eced59 req-fccabe2a-96e7-4236-9f22-221cefc91b44 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] 10.222.0.13 "DELETE /v2.0/security-groups/9ee08e54-b743-42a7-865d-3c0c82991456 HTTP/1.1" status: 204 len: 173 time: 0.1364923 Dec 09 21:17:53.050619 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf7050ab-f647-4d45-8285-f75a57d4027a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6af61d72-9856-4fb9-9a58-0933e7cc7c6e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:53.064606 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fccabe2a-96e7-4236-9f22-221cefc91b44 tempest-SecurityGroupsTestAdminJSON-439982445 tempest-SecurityGroupsTestAdminJSON-439982445-project-admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9ee08e54-b743-42a7-865d-3c0c82991456,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:53.086428 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-fa01de22-e28e-4659-989b-52e5da8e37e6 service neutron] 10.222.0.10 "GET /v2.0/networks/ce6b6bd1-6a60-4cea-9b70-69fd0290796c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1903174 Dec 09 21:17:53.094988 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cf7050ab-f647-4d45-8285-f75a57d4027a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=14d8931c42c94bbd88edb61684cc19a5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3500760 Dec 09 21:17:53.097525 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54722) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:53.113004 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eb2bcc2c-b34c-46ab-9fb7-aca5b868d002 req-b38a19e3-db83-4bc8-842e-a635713f317f tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] 10.222.0.13 "GET /v2.0/security-groups/a870c301-a40a-4869-89f9-a046d3f81633 HTTP/1.1" status: 200 len: 1794 time: 0.0628750 Dec 09 21:17:53.177345 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-eb2bcc2c-b34c-46ab-9fb7-aca5b868d002 req-ab97cf5a-5de5-4140-a8bb-f6057e77b3d0 tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:53.207773 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-eb2bcc2c-b34c-46ab-9fb7-aca5b868d002 req-ab97cf5a-5de5-4140-a8bb-f6057e77b3d0 tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:53.212472 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-422cfa4c-31a8-4c3c-911f-a51a9d244f6b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:53.255106 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-422cfa4c-31a8-4c3c-911f-a51a9d244f6b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:53.285498 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ce45b7b3-8d36-4ef6-9f8e-6957730c3ed7 req-e3bb539a-2e36-4836-830a-89114da3277b service neutron] 10.222.0.10 "GET /v2.0/networks/ce6b6bd1-6a60-4cea-9b70-69fd0290796c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1891973 Dec 09 21:17:53.304237 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-eb2bcc2c-b34c-46ab-9fb7-aca5b868d002 req-ab97cf5a-5de5-4140-a8bb-f6057e77b3d0 tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:53.307625 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-eb2bcc2c-b34c-46ab-9fb7-aca5b868d002 req-ab97cf5a-5de5-4140-a8bb-f6057e77b3d0 tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:53.312621 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eb2bcc2c-b34c-46ab-9fb7-aca5b868d002 req-ab97cf5a-5de5-4140-a8bb-f6057e77b3d0 tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] 10.222.0.13 "DELETE /v2.0/security-groups/a870c301-a40a-4869-89f9-a046d3f81633 HTTP/1.1" status: 204 len: 173 time: 0.1982045 Dec 09 21:17:53.328444 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-422cfa4c-31a8-4c3c-911f-a51a9d244f6b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:53.331131 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-422cfa4c-31a8-4c3c-911f-a51a9d244f6b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:53.335283 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-422cfa4c-31a8-4c3c-911f-a51a9d244f6b admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/6af61d72-9856-4fb9-9a58-0933e7cc7c6e HTTP/1.1" status: 204 len: 168 time: 0.2367289 Dec 09 21:17:53.343387 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-422cfa4c-31a8-4c3c-911f-a51a9d244f6b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6af61d72-9856-4fb9-9a58-0933e7cc7c6e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:53.362797 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab97cf5a-5de5-4140-a8bb-f6057e77b3d0 tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a870c301-a40a-4869-89f9-a046d3f81633,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:53.406663 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d2e581e-8d52-4045-9879-e2058b76cc69 req-36cb224c-8f54-4477-af77-f37529c6e235 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:53.408614 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1d2e581e-8d52-4045-9879-e2058b76cc69 req-36cb224c-8f54-4477-af77-f37529c6e235 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 944 time: 0.0757036 Dec 09 21:17:53.440816 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cd91248-fd06-40d2-8cd4-6b209e870e55 req-72a5a102-065c-4768-8589-d48204159ec9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:53.442554 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1cd91248-fd06-40d2-8cd4-6b209e870e55 req-72a5a102-065c-4768-8589-d48204159ec9 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=615039519ef147c78eb38a1d65eac061&device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 1096 time: 0.0905926 Dec 09 21:17:53.503505 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1d2e581e-8d52-4045-9879-e2058b76cc69 req-f71b44d8-ae22-4bee-84ac-ff6a50a0c40a tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0868483 Dec 09 21:17:53.507590 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ee85b67a-2605-4791-b15e-8b038ec9d12d req-2d478b07-aba5-42e3-a050-5f187bffdd65 tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] 10.222.0.13 "GET /v2.0/security-groups/0cf2e5ce-f15b-437a-b06e-49010a6a46a1 HTTP/1.1" status: 200 len: 1795 time: 0.0892441 Dec 09 21:17:53.561125 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cd91248-fd06-40d2-8cd4-6b209e870e55 req-6846b321-7866-4d14-a146-6e9c7d373708 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:53.562905 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1cd91248-fd06-40d2-8cd4-6b209e870e55 req-6846b321-7866-4d14-a146-6e9c7d373708 service neutron] 10.222.0.10 "GET /v2.0/networks?id=ce6b6bd1-6a60-4cea-9b70-69fd0290796c HTTP/1.1" status: 200 len: 923 time: 0.1128268 Dec 09 21:17:53.600218 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54750) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:53.622363 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 37ba309b-f598-4b1e-b3e8-35aa21ab14d3 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:17:53.632470 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ee85b67a-2605-4791-b15e-8b038ec9d12d req-4c4fcfa7-bc0e-4227-ad0e-70fdf9974d05 tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:53.634325 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1cd91248-fd06-40d2-8cd4-6b209e870e55 req-569bf7a7-1276-4bbc-87f2-eff224bccb8c service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=7eb6e48f-08e3-409a-9551-0e38eb690c8b HTTP/1.1" status: 200 len: 217 time: 0.0597379 Dec 09 21:17:53.662637 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ee85b67a-2605-4791-b15e-8b038ec9d12d req-4c4fcfa7-bc0e-4227-ad0e-70fdf9974d05 tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:53.714233 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 37ba309b-f598-4b1e-b3e8-35aa21ab14d3 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:17:53.715281 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cd91248-fd06-40d2-8cd4-6b209e870e55 req-efdedac6-676d-4bf5-a282-8ecab2e8b63b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:53.717183 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1cd91248-fd06-40d2-8cd4-6b209e870e55 req-efdedac6-676d-4bf5-a282-8ecab2e8b63b service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9755e5ea-99a7-4073-8693-293dcc00b929 HTTP/1.1" status: 200 len: 861 time: 0.0745592 Dec 09 21:17:53.721940 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 37ba309b-f598-4b1e-b3e8-35aa21ab14d3 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:53.722154 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:53.758290 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-052e2224-3c44-4c4a-98c2-ec492be4f509 req-a5ff80d5-83fb-493b-9bc6-e8dcdd988284 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:53.759983 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-052e2224-3c44-4c4a-98c2-ec492be4f509 req-a5ff80d5-83fb-493b-9bc6-e8dcdd988284 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=548538cf-319a-4465-9a2b-f54718ee91be HTTP/1.1" status: 200 len: 971 time: 0.0646205 Dec 09 21:17:53.767109 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c8efa65a-78c2-403e-b713-a4a52738c6b3 admin admin] Request body: {'network': {'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-network', 'tenant_id': '920e0419877f4239b048e126682274e9'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:53.778189 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ee85b67a-2605-4791-b15e-8b038ec9d12d req-4c4fcfa7-bc0e-4227-ad0e-70fdf9974d05 tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:53.781355 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ee85b67a-2605-4791-b15e-8b038ec9d12d req-4c4fcfa7-bc0e-4227-ad0e-70fdf9974d05 tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:53.787615 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ee85b67a-2605-4791-b15e-8b038ec9d12d req-4c4fcfa7-bc0e-4227-ad0e-70fdf9974d05 tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] 10.222.0.13 "DELETE /v2.0/security-groups/0cf2e5ce-f15b-437a-b06e-49010a6a46a1 HTTP/1.1" status: 204 len: 173 time: 0.2697401 Dec 09 21:17:53.792236 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cd91248-fd06-40d2-8cd4-6b209e870e55 req-d6f90f3c-4060-4b8a-b731-bbd13094ead4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:53.794958 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1cd91248-fd06-40d2-8cd4-6b209e870e55 req-d6f90f3c-4060-4b8a-b731-bbd13094ead4 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=ce6b6bd1-6a60-4cea-9b70-69fd0290796c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0710263 Dec 09 21:17:53.852627 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:53.882831 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '548538cf-319a-4465-9a2b-f54718ee91be', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '37ba309b-f598-4b1e-b3e8-35aa21ab14d3'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:17:53.885702 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d8570d61-74d2-48d4-8eb1-b2c555433b3a" -d '{"events": [{"server_uuid": "548538cf-319a-4465-9a2b-f54718ee91be", "name": "network-vif-plugged", "status": "completed", "tag": "37ba309b-f598-4b1e-b3e8-35aa21ab14d3"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:17:53.902315 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 37ba309b-f598-4b1e-b3e8-35aa21ab14d3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=37ba309b-f598-4b1e-b3e8-35aa21ab14d3,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:17:53.913126 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:53.917061 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c4fcfa7-bc0e-4227-ad0e-70fdf9974d05 tempest-SecurityGroupsTestAdminJSON-1939106991 tempest-SecurityGroupsTestAdminJSON-1939106991-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0cf2e5ce-f15b-437a-b06e-49010a6a46a1,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:53.956915 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-052e2224-3c44-4c4a-98c2-ec492be4f509 req-3b4c1f3d-ec3b-4f91-8c05-29e1ffca9675 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1772020 Dec 09 21:17:53.958441 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c8efa65a-78c2-403e-b713-a4a52738c6b3 admin admin] Made reservation on behalf of 920e0419877f4239b048e126682274e9 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:17:53.965007 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c8efa65a-78c2-403e-b713-a4a52738c6b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:53.988297 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1cd91248-fd06-40d2-8cd4-6b209e870e55 req-9816b4ec-7589-4b41-9516-acd564b19dfc service neutron] 10.222.0.10 "GET /v2.0/networks/ce6b6bd1-6a60-4cea-9b70-69fd0290796c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1811669 Dec 09 21:17:53.992164 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c8efa65a-78c2-403e-b713-a4a52738c6b3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:54.012296 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:17:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dd7c4d6b-d8b9-40c3-aa8f-17a088081036 x-openstack-request-id: req-dd7c4d6b-d8b9-40c3-aa8f-17a088081036 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:17:54.012595 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "548538cf-319a-4465-9a2b-f54718ee91be", "name": "network-vif-plugged", "status": "completed", "tag": "37ba309b-f598-4b1e-b3e8-35aa21ab14d3", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:17:54.012851 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-dd7c4d6b-d8b9-40c3-aa8f-17a088081036 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:17:54.013248 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '548538cf-319a-4465-9a2b-f54718ee91be', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '37ba309b-f598-4b1e-b3e8-35aa21ab14d3', 'code': 200} Dec 09 21:17:54.067676 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=37ba309b-f598-4b1e-b3e8-35aa21ab14d3,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:54.201963 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-add169fd-7dc3-430e-beeb-7dbe8b9fe77d req-38ffeb95-b47e-482e-acf9-e2b79a7026e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:54.204501 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-add169fd-7dc3-430e-beeb-7dbe8b9fe77d req-38ffeb95-b47e-482e-acf9-e2b79a7026e2 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=548538cf-319a-4465-9a2b-f54718ee91be HTTP/1.1" status: 200 len: 1124 time: 0.0807488 Dec 09 21:17:54.211751 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1cd91248-fd06-40d2-8cd4-6b209e870e55 req-2558ad1f-fd62-4024-908f-aa3f0ac87dc9 service neutron] 10.222.0.10 "GET /v2.0/networks/ce6b6bd1-6a60-4cea-9b70-69fd0290796c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2180099 Dec 09 21:17:54.213793 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c8efa65a-78c2-403e-b713-a4a52738c6b3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:54.232460 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c8efa65a-78c2-403e-b713-a4a52738c6b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:54.281963 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54790) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:54.294759 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c8efa65a-78c2-403e-b713-a4a52738c6b3 admin admin] vlan segment allocate from pool success with {'vlan_id': 137, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:17:54.317772 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8efa65a-78c2-403e-b713-a4a52738c6b3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=174c6f0d-c012-4077-858c-aa2b94e54d38,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:54.335608 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c8efa65a-78c2-403e-b713-a4a52738c6b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:54.335957 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-c8efa65a-78c2-403e-b713-a4a52738c6b3 admin admin] Added segment c1e3b516-6ad9-46a2-acfa-cf795ad5b916 of type vlan for network eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 Dec 09 21:17:54.409357 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c8efa65a-78c2-403e-b713-a4a52738c6b3 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:54.455291 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c8efa65a-78c2-403e-b713-a4a52738c6b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:54.456649 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8efa65a-78c2-403e-b713-a4a52738c6b3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:54.457264 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c8efa65a-78c2-403e-b713-a4a52738c6b3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:54.510487 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-add169fd-7dc3-430e-beeb-7dbe8b9fe77d req-b5c6a4af-1b79-4106-9ee1-c1199a3e1afb service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2975986 Dec 09 21:17:54.566901 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c8efa65a-78c2-403e-b713-a4a52738c6b3 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 894 time: 0.9642091 Dec 09 21:17:54.570589 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54808) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:54.572884 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8efa65a-78c2-403e-b713-a4a52738c6b3 admin admin] Pushing event updated for resources: {'Network': ['ID=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:54.585125 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:17:54.588815 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-727b9749-ed5c-4a93-8233-f29783f46c1c admin admin] Request body: {'subnet': {'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'cidr': '172.20.0.0/28', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-subnet', 'tenant_id': '920e0419877f4239b048e126682274e9', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:54.663580 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-727b9749-ed5c-4a93-8233-f29783f46c1c admin admin] Made reservation on behalf of 920e0419877f4239b048e126682274e9 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:17:54.666345 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-727b9749-ed5c-4a93-8233-f29783f46c1c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:54.768879 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7bf7d97-2442-4d3b-a576-99d00a29ffc8 req-9e311b43-de51-4ad0-ae59-718c46bda725 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:54.776399 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f7bf7d97-2442-4d3b-a576-99d00a29ffc8 req-9e311b43-de51-4ad0-ae59-718c46bda725 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 944 time: 0.1482685 Dec 09 21:17:54.794477 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d77d8bbd-180e-412d-a23a-cdbf8a99ce9c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=c148c9b1315b4b93a7f32aad97440e96&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5029886 Dec 09 21:17:54.794898 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54826) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:54.854587 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b7ac3643-f39b-4d02-80a8-65bc59f40afc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:54.855679 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f7bf7d97-2442-4d3b-a576-99d00a29ffc8 req-f7f75e1c-2d2e-448c-86e6-5ccafca0cb50 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0783238 Dec 09 21:17:54.880560 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b7ac3643-f39b-4d02-80a8-65bc59f40afc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:54.952002 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b7ac3643-f39b-4d02-80a8-65bc59f40afc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:54.955162 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b7ac3643-f39b-4d02-80a8-65bc59f40afc admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:54.956342 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b7ac3643-f39b-4d02-80a8-65bc59f40afc admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/2adaaf6b-c282-4851-b515-a2fb6e63378a HTTP/1.1" status: 204 len: 168 time: 0.1603332 Dec 09 21:17:54.964952 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7ac3643-f39b-4d02-80a8-65bc59f40afc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2adaaf6b-c282-4851-b515-a2fb6e63378a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:54.983707 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-727b9749-ed5c-4a93-8233-f29783f46c1c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:55.073136 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-727b9749-ed5c-4a93-8233-f29783f46c1c admin admin] Pushing event updated for resources: {'Subnet': ['ID=3260fc19-8e10-46a2-82c6-3b2d5eda4a0e,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:55.087395 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-727b9749-ed5c-4a93-8233-f29783f46c1c admin admin] Checking segment: {'id': 'c1e3b516-6ad9-46a2-acfa-cf795ad5b916', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:17:55.087761 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-727b9749-ed5c-4a93-8233-f29783f46c1c admin admin] Network hostable DHCP agents. Network: eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:17:55.129871 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-727b9749-ed5c-4a93-8233-f29783f46c1c admin admin] Network eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:17:55.149944 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91f2254a-15ba-43d2-9647-2dca4ec4f704 req-6b7fa269-1364-4307-af29-876dde4cae99 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:55.156283 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-91f2254a-15ba-43d2-9647-2dca4ec4f704 req-6b7fa269-1364-4307-af29-876dde4cae99 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=548538cf-319a-4465-9a2b-f54718ee91be HTTP/1.1" status: 200 len: 972 time: 0.0789156 Dec 09 21:17:55.171046 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-727b9749-ed5c-4a93-8233-f29783f46c1c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:17:55.180902 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cfbeba0c-745a-45c0-b92c-0ad1b1649caa None None] Network eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:17:55.182296 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-727b9749-ed5c-4a93-8233-f29783f46c1c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:55.182895 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-727b9749-ed5c-4a93-8233-f29783f46c1c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:55.217946 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-727b9749-ed5c-4a93-8233-f29783f46c1c admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 857 time: 0.6459565 Dec 09 21:17:55.222679 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54854) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:55.233003 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ea69341e-8116-46bd-b091-a4007f1d976d admin admin] Request body: {'router': {'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:17:55.247793 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-91f2254a-15ba-43d2-9647-2dca4ec4f704 req-980c4cdd-16a6-4d49-af21-a419661b98de tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0876384 Dec 09 21:17:55.290890 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea69341e-8116-46bd-b091-a4007f1d976d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:55.292370 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea69341e-8116-46bd-b091-a4007f1d976d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:55.386191 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-47e8545a-5618-4e6e-859e-f71ae3c796ee None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'project_id': '920e0419877f4239b048e126682274e9', 'fixed_ips': [{'subnet_id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:17:55.387783 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-47e8545a-5618-4e6e-859e-f71ae3c796ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:55.422261 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea69341e-8116-46bd-b091-a4007f1d976d admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:55.566770 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-47e8545a-5618-4e6e-859e-f71ae3c796ee None None] Allocated IP 172.20.0.2 (eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3/3260fc19-8e10-46a2-82c6-3b2d5eda4a0e/83aab428-de6e-4b16-aa5f-20c9298e895e) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:17:55.627304 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea69341e-8116-46bd-b091-a4007f1d976d admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:55.721756 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54882) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:55.853548 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2d0edf55-d48f-4cf8-8bec-cb1321860575 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=c26246bc6e694696b53c96ba45506cba&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1289711 Dec 09 21:17:55.856187 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54888) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:55.869236 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-47e8545a-5618-4e6e-859e-f71ae3c796ee None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:55.883999 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-47e8545a-5618-4e6e-859e-f71ae3c796ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:55.952591 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-47e8545a-5618-4e6e-859e-f71ae3c796ee None None] Network eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:17:55.954632 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea69341e-8116-46bd-b091-a4007f1d976d admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:55.956489 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-47e8545a-5618-4e6e-859e-f71ae3c796ee None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:17:55.961462 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47e8545a-5618-4e6e-859e-f71ae3c796ee None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:17:55.975251 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47e8545a-5618-4e6e-859e-f71ae3c796ee None None] Pushing event updated for resources: {'Port': ['ID=83aab428-de6e-4b16-aa5f-20c9298e895e,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:55.985010 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a51c9b53-210d-47a7-addf-4a79746b6a8f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:55.994390 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea69341e-8116-46bd-b091-a4007f1d976d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:56.010862 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a51c9b53-210d-47a7-addf-4a79746b6a8f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:56.018418 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54896) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:56.061269 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-47e8545a-5618-4e6e-859e-f71ae3c796ee None None] Attempting to bind port 83aab428-de6e-4b16-aa5f-20c9298e895e on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:17:56.061894 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-47e8545a-5618-4e6e-859e-f71ae3c796ee None None] Attempting to bind port 83aab428-de6e-4b16-aa5f-20c9298e895e by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'c1e3b516-6ad9-46a2-acfa-cf795ad5b916', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:17:56.062457 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47e8545a-5618-4e6e-859e-f71ae3c796ee None None] Attempting to bind port 83aab428-de6e-4b16-aa5f-20c9298e895e on network eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:17:56.077174 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47e8545a-5618-4e6e-859e-f71ae3c796ee None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 17, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:17:56.079878 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47e8545a-5618-4e6e-859e-f71ae3c796ee None None] Checking segment: {'id': 'c1e3b516-6ad9-46a2-acfa-cf795ad5b916', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:17:56.080205 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-47e8545a-5618-4e6e-859e-f71ae3c796ee None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:56.080723 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47e8545a-5618-4e6e-859e-f71ae3c796ee None None] Bound using segment: {'id': 'c1e3b516-6ad9-46a2-acfa-cf795ad5b916', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:17:56.081936 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-47e8545a-5618-4e6e-859e-f71ae3c796ee None None] Bound port: 83aab428-de6e-4b16-aa5f-20c9298e895e, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c1e3b516-6ad9-46a2-acfa-cf795ad5b916', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:17:56.084243 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-47e8545a-5618-4e6e-859e-f71ae3c796ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:56.101856 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a51c9b53-210d-47a7-addf-4a79746b6a8f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:56.105260 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a51c9b53-210d-47a7-addf-4a79746b6a8f admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:56.106463 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a51c9b53-210d-47a7-addf-4a79746b6a8f admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/6195c935-5fc1-4c6f-b5c0-26cb2008b080 HTTP/1.1" status: 204 len: 168 time: 0.2491159 Dec 09 21:17:56.132994 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99b76744-8fd8-44a9-af6a-664ed6df0204 req-49b7905b-a81d-4e32-a27e-77b314846d83 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:56.134775 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99b76744-8fd8-44a9-af6a-664ed6df0204 req-49b7905b-a81d-4e32-a27e-77b314846d83 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 944 time: 0.1514025 Dec 09 21:17:56.135923 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a51c9b53-210d-47a7-addf-4a79746b6a8f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6195c935-5fc1-4c6f-b5c0-26cb2008b080,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:56.174369 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-ea69341e-8116-46bd-b091-a4007f1d976d admin admin] Allocated IP 172.25.3.107 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/83bb56df-8fc2-46ae-84d3-bda4fe854463) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:17:56.174577 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-47e8545a-5618-4e6e-859e-f71ae3c796ee None None] For port 83aab428-de6e-4b16-aa5f-20c9298e895e, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:17:56.179825 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-47e8545a-5618-4e6e-859e-f71ae3c796ee None None] For port 83aab428-de6e-4b16-aa5f-20c9298e895e, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=83aab428-de6e-4b16-aa5f-20c9298e895e,segment=NetworkSegment(c1e3b516-6ad9-46a2-acfa-cf795ad5b916),segment_id=c1e3b516-6ad9-46a2-acfa-cf795ad5b916)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:17:56.192636 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-47e8545a-5618-4e6e-859e-f71ae3c796ee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:56.205945 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93327554-f1fa-431e-ad58-deb1654a3b9a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:56.255798 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99b76744-8fd8-44a9-af6a-664ed6df0204 req-c61f3317-a081-4a94-9ecf-32310b649b1e tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1075122 Dec 09 21:17:56.298381 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47e8545a-5618-4e6e-859e-f71ae3c796ee None None] Pushing event updated for resources: {'Port': ['ID=83aab428-de6e-4b16-aa5f-20c9298e895e,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:56.433586 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea69341e-8116-46bd-b091-a4007f1d976d admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:56.491214 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93327554-f1fa-431e-ad58-deb1654a3b9a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:56.502649 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93327554-f1fa-431e-ad58-deb1654a3b9a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:56.546417 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-93327554-f1fa-431e-ad58-deb1654a3b9a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=5a6d1fe843834b08a61cfe56ac4ab442&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5268064 Dec 09 21:17:56.549596 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54926) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:56.596041 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea69341e-8116-46bd-b091-a4007f1d976d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:56.638792 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caf03437-fc1f-4414-b218-f4ff8555d6b8 req-c75e0428-31f4-4b4a-84f1-30a042837b02 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:56.655074 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-caf03437-fc1f-4414-b218-f4ff8555d6b8 req-c75e0428-31f4-4b4a-84f1-30a042837b02 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=548538cf-319a-4465-9a2b-f54718ee91be HTTP/1.1" status: 200 len: 972 time: 0.1851587 Dec 09 21:17:56.724336 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea69341e-8116-46bd-b091-a4007f1d976d admin admin] Pushing event updated for resources: {'Port': ['ID=83bb56df-8fc2-46ae-84d3-bda4fe854463,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:56.732194 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93327554-f1fa-431e-ad58-deb1654a3b9a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=67ee5aa3-ec28-4d05-b440-c6ba09893379,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:56.774232 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea69341e-8116-46bd-b091-a4007f1d976d admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:17:56.780996 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-ea69341e-8116-46bd-b091-a4007f1d976d admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:17:56.789110 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea69341e-8116-46bd-b091-a4007f1d976d admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:17:56.814255 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-caf03437-fc1f-4414-b218-f4ff8555d6b8 req-b10e6636-2b2b-4a0c-a858-6de14f92a1cc tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1578417 Dec 09 21:17:56.877603 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:56.890669 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-85c495de-4288-4c37-a9f9-18ab4d249db8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:57.005438 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-85c495de-4288-4c37-a9f9-18ab4d249db8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:57.024649 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:57.202052 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea69341e-8116-46bd-b091-a4007f1d976d admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:57.249932 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-85c495de-4288-4c37-a9f9-18ab4d249db8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:57.252649 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-85c495de-4288-4c37-a9f9-18ab4d249db8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:57.256679 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-85c495de-4288-4c37-a9f9-18ab4d249db8 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/67ee5aa3-ec28-4d05-b440-c6ba09893379 HTTP/1.1" status: 204 len: 168 time: 0.7036667 Dec 09 21:17:57.267925 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85c495de-4288-4c37-a9f9-18ab4d249db8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=67ee5aa3-ec28-4d05-b440-c6ba09893379,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:57.380197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54978) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:57.464868 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 83aab428-de6e-4b16-aa5f-20c9298e895e up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:17:57.506238 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a691da96-9ee7-4c7c-9e11-c56675495176 req-741ead55-5ae7-485f-8677-9f683dd67788 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:57.514089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a691da96-9ee7-4c7c-9e11-c56675495176 req-741ead55-5ae7-485f-8677-9f683dd67788 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 944 time: 0.1199539 Dec 09 21:17:57.546616 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54984) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:57.619822 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a691da96-9ee7-4c7c-9e11-c56675495176 req-135dc282-9e59-479d-a050-8b3877abc649 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0989902 Dec 09 21:17:57.620326 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 83aab428-de6e-4b16-aa5f-20c9298e895e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:57.620844 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:57.689829 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea69341e-8116-46bd-b091-a4007f1d976d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:57.707919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-78f93466-a10f-45e9-bb51-4dd68a59075e None None] Network eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:17:57.837301 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 7eb6e48f-08e3-409a-9551-0e38eb690c8b details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:17:57.920093 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-0b92c32f-ee6c-4e1a-9a32-55d44e9182f3 None None] Provisioning complete for port 83aab428-de6e-4b16-aa5f-20c9298e895e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:57.920724 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0b92c32f-ee6c-4e1a-9a32-55d44e9182f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:57.967334 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ea69341e-8116-46bd-b091-a4007f1d976d admin admin] Router 70ade903-ee3e-4040-8855-b2a937f2a0d9 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:17:57.980499 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-617725b6-716c-49b0-83f0-e63322a616d8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:58.050748 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0b92c32f-ee6c-4e1a-9a32-55d44e9182f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:58.126645 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0b92c32f-ee6c-4e1a-9a32-55d44e9182f3 None None] For port 83aab428-de6e-4b16-aa5f-20c9298e895e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=83aab428-de6e-4b16-aa5f-20c9298e895e,segment=NetworkSegment(c1e3b516-6ad9-46a2-acfa-cf795ad5b916),segment_id=c1e3b516-6ad9-46a2-acfa-cf795ad5b916)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:17:58.135228 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:58.149282 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0b92c32f-ee6c-4e1a-9a32-55d44e9182f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:58.249995 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 7eb6e48f-08e3-409a-9551-0e38eb690c8b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=7eb6e48f-08e3-409a-9551-0e38eb690c8b,segment=NetworkSegment(946d0405-6c7f-49a7-81bb-30e422c98100),segment_id=946d0405-6c7f-49a7-81bb-30e422c98100)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:17:58.270548 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55018) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:58.323773 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e317b70e-7306-4086-b6a4-d87d9b2dcc67 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:58.418471 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ea69341e-8116-46bd-b091-a4007f1d976d admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:17:58.429057 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] Sync routers for ids ['70ade903-ee3e-4040-8855-b2a937f2a0d9'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:17:58.429958 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b92c32f-ee6c-4e1a-9a32-55d44e9182f3 None None] Pushing event updated for resources: {'Port': ['ID=83aab428-de6e-4b16-aa5f-20c9298e895e,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:58.436831 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '7eb6e48f-08e3-409a-9551-0e38eb690c8b', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'port_id': '7eb6e48f-08e3-409a-9551-0e38eb690c8b', 'mac_address': 'fa:16:3e:9b:8e:90', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 141, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:17:58.455981 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] Routers {'70ade903-ee3e-4040-8855-b2a937f2a0d9'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:17:58.458821 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:17:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['70ade903-ee3e-4040-8855-b2a937f2a0d9'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:17:58.518782 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:58.553952 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-617725b6-716c-49b0-83f0-e63322a616d8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:58.570674 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e317b70e-7306-4086-b6a4-d87d9b2dcc67 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:58.581392 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e317b70e-7306-4086-b6a4-d87d9b2dcc67 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:58.589459 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2616e37d-99f5-477d-9057-fad4ba4af253 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:58.657554 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e317b70e-7306-4086-b6a4-d87d9b2dcc67 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=3222e204a7fd4713802fd4db1fc15c03&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3849633 Dec 09 21:17:58.671686 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-13f74890-fe66-4148-ab4f-a912be446083 req-d7aaf7f9-d82d-4f1c-ad69-2d5a4dde3448 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:17:58.674722 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-13f74890-fe66-4148-ab4f-a912be446083 req-d7aaf7f9-d82d-4f1c-ad69-2d5a4dde3448 service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.2608323 Dec 09 21:17:58.678554 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55034) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:58.783628 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2616e37d-99f5-477d-9057-fad4ba4af253 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:58.787461 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-617725b6-716c-49b0-83f0-e63322a616d8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:58.826798 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] Set router 70ade903-ee3e-4040-8855-b2a937f2a0d9 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:17:58.875187 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2616e37d-99f5-477d-9057-fad4ba4af253 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:58.882146 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:17:58.882553 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:17:58.887962 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-04672912-e133-461a-acf3-78d8dfd53954 None None] Provisioning complete for port 83aab428-de6e-4b16-aa5f-20c9298e895e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:58.888343 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-04672912-e133-461a-acf3-78d8dfd53954 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:58.892596 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e317b70e-7306-4086-b6a4-d87d9b2dcc67 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cf34fb8c-281e-495a-9bdd-aba40145bc91,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:58.928803 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7eb6e48f-08e3-409a-9551-0e38eb690c8b {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:17:58.943632 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-617725b6-716c-49b0-83f0-e63322a616d8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4c36d8d0-d781-41ef-83e0-f64368fd4b24,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:58.948452 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2616e37d-99f5-477d-9057-fad4ba4af253 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=7062e5c8b5a24f7b92cb3606a53de9ed&name=default HTTP/1.1" status: 200 len: 2996 time: 1.3986619 Dec 09 21:17:58.976070 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55046) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:58.980740 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2616e37d-99f5-477d-9057-fad4ba4af253 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1a9fe58d-068c-4770-ad08-035efac84500,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:59.009724 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 7eb6e48f-08e3-409a-9551-0e38eb690c8b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=7eb6e48f-08e3-409a-9551-0e38eb690c8b,segment=NetworkSegment(946d0405-6c7f-49a7-81bb-30e422c98100),segment_id=946d0405-6c7f-49a7-81bb-30e422c98100)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:17:59.018841 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:59.024354 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-617725b6-716c-49b0-83f0-e63322a616d8 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=daefdc24162d4cc39aa66d2401a358d5&name=default HTTP/1.1" status: 200 len: 2996 time: 1.6401653 Dec 09 21:17:59.024799 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55048) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:59.027529 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea69341e-8116-46bd-b091-a4007f1d976d admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:59.028718 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ea69341e-8116-46bd-b091-a4007f1d976d admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 933 time: 3.8029079 Dec 09 21:17:59.046029 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d75ad118-b488-40ec-91cd-9ce9b9a2d908 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:59.059165 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55050) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:17:59.079956 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5b09cb46-4391-4fd3-a3de-aa44ff60c9ad req-ce736d68-7dfa-46d5-b42d-0c55a926678d service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=e6721efc-7196-4b31-b864-440bcc89de57&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.2389812 Dec 09 21:17:59.123735 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c039af96-99ee-4597-84a2-763bc166e353 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:59.135396 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=7eb6e48f-08e3-409a-9551-0e38eb690c8b,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:59.163306 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b342f10d-70ab-4f12-8206-5386850ecd22 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:59.184148 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c039af96-99ee-4597-84a2-763bc166e353 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:59.214117 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b342f10d-70ab-4f12-8206-5386850ecd22 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:59.237358 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b09cb46-4391-4fd3-a3de-aa44ff60c9ad req-61b9fc68-f716-43f0-91d3-a6b9f6ed0c67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:59.238957 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5b09cb46-4391-4fd3-a3de-aa44ff60c9ad req-61b9fc68-f716-43f0-91d3-a6b9f6ed0c67 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ccb2b63648cb4a5da382475755debe06&device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 1123 time: 0.1081536 Dec 09 21:17:59.317732 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:17:57Z', 'revision_number': 3, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:17:56Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:17:59.323209 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['7eb6e48f-08e3-409a-9551-0e38eb690c8b'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:17:59.355585 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8cc2be5-6e79-44f5-ad2e-f5efb9489f89 req-71a7b25b-97df-45d1-b821-35d69fdef745 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:59.357780 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c8cc2be5-6e79-44f5-ad2e-f5efb9489f89 req-71a7b25b-97df-45d1-b821-35d69fdef745 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 944 time: 0.4461851 Dec 09 21:17:59.360085 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d75ad118-b488-40ec-91cd-9ce9b9a2d908 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:59.368763 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c039af96-99ee-4597-84a2-763bc166e353 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:59.373501 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] Checking router: 70ade903-ee3e-4040-8855-b2a937f2a0d9 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:17:59.373501 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] Updating router 70ade903-ee3e-4040-8855-b2a937f2a0d9 port 83bb56df-8fc2-46ae-84d3-bda4fe854463 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:17:59.383841 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fe5937c-a81f-470b-b461-584cd989e94b req-2c81bc81-f576-466e-b6df-1ea9c7292ce7 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:59.389054 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c039af96-99ee-4597-84a2-763bc166e353 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:59.391490 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fe5937c-a81f-470b-b461-584cd989e94b req-2c81bc81-f576-466e-b6df-1ea9c7292ce7 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=548538cf-319a-4465-9a2b-f54718ee91be HTTP/1.1" status: 200 len: 972 time: 0.3370857 Dec 09 21:17:59.394775 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c039af96-99ee-4597-84a2-763bc166e353 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/4c36d8d0-d781-41ef-83e0-f64368fd4b24 HTTP/1.1" status: 204 len: 168 time: 0.3635321 Dec 09 21:17:59.401947 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:59.471543 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c039af96-99ee-4597-84a2-763bc166e353 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4c36d8d0-d781-41ef-83e0-f64368fd4b24,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:59.497083 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b342f10d-70ab-4f12-8206-5386850ecd22 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:59.501498 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b342f10d-70ab-4f12-8206-5386850ecd22 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:59.505135 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b342f10d-70ab-4f12-8206-5386850ecd22 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/1a9fe58d-068c-4770-ad08-035efac84500 HTTP/1.1" status: 204 len: 168 time: 0.5221078 Dec 09 21:17:59.532514 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fe5937c-a81f-470b-b461-584cd989e94b req-6a185730-b78d-49ee-931d-d2373470b326 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1402907 Dec 09 21:17:59.535070 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b342f10d-70ab-4f12-8206-5386850ecd22 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1a9fe58d-068c-4770-ad08-035efac84500,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:59.543633 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b09cb46-4391-4fd3-a3de-aa44ff60c9ad req-c5b7f5c1-a6f4-426c-963c-d65a8e4134aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:59.548189 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5b09cb46-4391-4fd3-a3de-aa44ff60c9ad req-c5b7f5c1-a6f4-426c-963c-d65a8e4134aa service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.2818716 Dec 09 21:17:59.633725 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c8cc2be5-6e79-44f5-ad2e-f5efb9489f89 req-988c4405-ee84-4f2d-bc47-d380135352d2 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2375507 Dec 09 21:17:59.647378 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5b09cb46-4391-4fd3-a3de-aa44ff60c9ad req-2da84712-cf9f-4ea5-bab6-6b5d8cd658b4 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.38&port_id=45acc430-900d-475a-af6a-44f47e8a8d29 HTTP/1.1" status: 200 len: 217 time: 0.0903723 Dec 09 21:17:59.685517 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 83aab428-de6e-4b16-aa5f-20c9298e895e up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:17:59.750677 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d75ad118-b488-40ec-91cd-9ce9b9a2d908 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:59.754155 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d75ad118-b488-40ec-91cd-9ce9b9a2d908 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:59.756324 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d75ad118-b488-40ec-91cd-9ce9b9a2d908 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/cf34fb8c-281e-495a-9bdd-aba40145bc91 HTTP/1.1" status: 204 len: 168 time: 1.0760438 Dec 09 21:17:59.774656 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d75ad118-b488-40ec-91cd-9ce9b9a2d908 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cf34fb8c-281e-495a-9bdd-aba40145bc91,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:17:59.785066 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b09cb46-4391-4fd3-a3de-aa44ff60c9ad req-3507cf54-f67e-4a2c-a5e9-3bce08f94053 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:59.788995 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5b09cb46-4391-4fd3-a3de-aa44ff60c9ad req-3507cf54-f67e-4a2c-a5e9-3bce08f94053 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1349540 Dec 09 21:17:59.877739 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 83aab428-de6e-4b16-aa5f-20c9298e895e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:17:59.878190 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:17:59.911780 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b09cb46-4391-4fd3-a3de-aa44ff60c9ad req-f2a3950f-76fe-4501-874f-0fd111df4b83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:17:59.916825 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5b09cb46-4391-4fd3-a3de-aa44ff60c9ad req-f2a3950f-76fe-4501-874f-0fd111df4b83 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1111696 Dec 09 21:18:00.117945 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5b09cb46-4391-4fd3-a3de-aa44ff60c9ad req-e6c5f93d-3516-4ee8-b475-b76f60ab0c42 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1934433 Dec 09 21:18:00.267748 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-935a3d86-c7cb-466a-a17c-a18a1d219f10 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=97c6f11d72db4857afd32603bdfd0616&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0737050 Dec 09 21:18:00.295579 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5b09cb46-4391-4fd3-a3de-aa44ff60c9ad req-b6d70fa8-1aab-480e-a6a1-f0a24b6e7f3b service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1698806 Dec 09 21:18:00.304832 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:00.318213 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:00.433399 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58d588d3-8f6a-4a2f-a08d-f7ea61660254 None None] Pushing event updated for resources: {'Port': ['ID=83bb56df-8fc2-46ae-84d3-bda4fe854463,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:00.448414 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] Attempting to bind port 83bb56df-8fc2-46ae-84d3-bda4fe854463 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:18:00.449005 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] Attempting to bind port 83bb56df-8fc2-46ae-84d3-bda4fe854463 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:18:00.449515 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] Attempting to bind port 83bb56df-8fc2-46ae-84d3-bda4fe854463 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:00.456854 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9fe100fa-d663-4595-92e0-d96b7ea9d18f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:00.458393 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 17, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:18:00.459072 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:18:00.459680 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:00.461158 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:18:00.461848 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] Bound port: 83bb56df-8fc2-46ae-84d3-bda4fe854463, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:18:00.462424 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:00.475851 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35c7e3ea-03b1-4fd9-b1f3-1db88fb16e02 req-49781eb0-8b5f-4b97-86d0-71a7748c4aab tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:00.484336 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35c7e3ea-03b1-4fd9-b1f3-1db88fb16e02 req-49781eb0-8b5f-4b97-86d0-71a7748c4aab tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 971 time: 0.2380893 Dec 09 21:18:00.535992 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] For port 83bb56df-8fc2-46ae-84d3-bda4fe854463, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:18:00.542777 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] For port 83bb56df-8fc2-46ae-84d3-bda4fe854463, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=83bb56df-8fc2-46ae-84d3-bda4fe854463,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:18:00.548671 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:00.560658 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55102) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:00.586728 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-33be54e1-b938-4d9c-a173-45ec00b0b1c4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:00.626791 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] Routers {'70ade903-ee3e-4040-8855-b2a937f2a0d9'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:18:00.627471 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:17:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['70ade903-ee3e-4040-8855-b2a937f2a0d9'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:18:00.646049 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-d7c47745-9ee5-440b-854a-c98d5bfe0158 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:00.653765 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-d7c47745-9ee5-440b-854a-c98d5bfe0158 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3419509 Dec 09 21:18:00.678064 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35c7e3ea-03b1-4fd9-b1f3-1db88fb16e02 req-f4c798ae-9a81-4d26-824a-fd624de367f4 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/security-groups?id=cf1d3e91-3176-48c8-adff-dd58205947d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1877024 Dec 09 21:18:00.709117 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58d588d3-8f6a-4a2f-a08d-f7ea61660254 None None] Pushing event updated for resources: {'Port': ['ID=83bb56df-8fc2-46ae-84d3-bda4fe854463,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:00.721883 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-147a413a-4d76-4f5a-8b3f-5787c463c920 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/quotas/97c6f11d72db4857afd32603bdfd0616 HTTP/1.1" status: 200 len: 375 time: 0.0671263 Dec 09 21:18:00.727620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55110) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:00.796023 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3b6f9aa9-172a-47bf-8b00-fa5409365454 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:00.801709 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-33be54e1-b938-4d9c-a173-45ec00b0b1c4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:00.809658 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-33be54e1-b938-4d9c-a173-45ec00b0b1c4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:00.863806 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-33be54e1-b938-4d9c-a173-45ec00b0b1c4 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=45ca2fd53c604c92b62768f8e8f8ff1e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3010011 Dec 09 21:18:00.865354 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33be54e1-b938-4d9c-a173-45ec00b0b1c4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d5aa12c0-c4e6-4be0-9fbf-216273969271,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:00.867903 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55114) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:00.906136 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-73d350d0-e465-435d-966f-3aaa6b2614ad tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=97c6f11d72db4857afd32603bdfd0616&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1818001 Dec 09 21:18:00.907149 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] Set router 70ade903-ee3e-4040-8855-b2a937f2a0d9 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:18:00.970567 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-9fe100fa-d663-4595-92e0-d96b7ea9d18f admin admin] Allocated IP 172.20.0.1 (eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3/3260fc19-8e10-46a2-82c6-3b2d5eda4a0e/72070289-8347-44bd-bfb9-9510e94eb5bd) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:18:01.132256 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-945dad00-3576-48df-8b35-0588548e853d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:01.208602 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-945dad00-3576-48df-8b35-0588548e853d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:01.210554 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:17:57Z', 'revision_number': 3, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:18:01.264329 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce5aa4b6-0d2e-40d1-a16a-10076e238232 None None] The sync data for ids ['70ade903-ee3e-4040-8855-b2a937f2a0d9'] in n-d-713301-27 is: [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:17:57Z', 'revision_number': 3, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:18:01.277588 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3b6f9aa9-172a-47bf-8b00-fa5409365454 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:01.308073 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-b33ece05-c356-4ebd-9899-da8c5fbad607 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=6a32a636fa83452db185eb0152d6082d&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0883517 Dec 09 21:18:01.308674 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3b6f9aa9-172a-47bf-8b00-fa5409365454 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:01.421220 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3b6f9aa9-172a-47bf-8b00-fa5409365454 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=93ba2092aa9044239f41144d9f0d2f86&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6924853 Dec 09 21:18:01.423940 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55142) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:01.429957 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b6f9aa9-172a-47bf-8b00-fa5409365454 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=10bf6aa9-25e7-407d-a66a-977aaab0be8a,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:01.447774 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-639107ae-4ecd-4848-8816-8cc6c330927b req-c9eee5c8-da35-4169-8772-b107dfc65266 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:01.449602 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-639107ae-4ecd-4848-8816-8cc6c330927b req-c9eee5c8-da35-4169-8772-b107dfc65266 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 945 time: 0.2314823 Dec 09 21:18:01.495344 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9fe100fa-d663-4595-92e0-d96b7ea9d18f admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:01.515364 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-945dad00-3576-48df-8b35-0588548e853d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:01.518330 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-945dad00-3576-48df-8b35-0588548e853d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:01.520381 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-945dad00-3576-48df-8b35-0588548e853d admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/d5aa12c0-c4e6-4be0-9fbf-216273969271 HTTP/1.1" status: 204 len: 168 time: 0.6476648 Dec 09 21:18:01.543504 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-945dad00-3576-48df-8b35-0588548e853d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d5aa12c0-c4e6-4be0-9fbf-216273969271,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:01.640620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-7fe40ac1-ca0f-4254-a57b-297fa56f703e tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:01.649883 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-7fe40ac1-ca0f-4254-a57b-297fa56f703e tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3324952 Dec 09 21:18:01.683089 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eda8a6e4-a045-4f6f-8f6f-7e98404d08a1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:01.700271 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 7eb6e48f-08e3-409a-9551-0e38eb690c8b up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:18:01.728347 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-939243c5-51bb-43c5-88b4-bd87e45e3f70 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/quotas/6a32a636fa83452db185eb0152d6082d HTTP/1.1" status: 200 len: 375 time: 0.0746310 Dec 09 21:18:01.769001 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-639107ae-4ecd-4848-8816-8cc6c330927b req-55a089e4-6a23-4794-b453-132cdd942247 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2675526 Dec 09 21:18:01.822014 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e511ef4-c620-4cee-8c7e-53bceaeb8793 req-3c9bfc7f-16f5-4261-b4c4-576312733dd0 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:01.829522 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6e511ef4-c620-4cee-8c7e-53bceaeb8793 req-3c9bfc7f-16f5-4261-b4c4-576312733dd0 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.31 "GET /v2.0/ports?device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 971 time: 0.3355565 Dec 09 21:18:01.839610 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eda8a6e4-a045-4f6f-8f6f-7e98404d08a1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:01.878637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 7eb6e48f-08e3-409a-9551-0e38eb690c8b completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:18:01.888795 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 7eb6e48f-08e3-409a-9551-0e38eb690c8b triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:01.889166 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:01.889787 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-a6473c13-e959-43af-9b9a-4ac987a3ba99 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=6a32a636fa83452db185eb0152d6082d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1575336 Dec 09 21:18:01.892860 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9fe100fa-d663-4595-92e0-d96b7ea9d18f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:02.073613 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fe100fa-d663-4595-92e0-d96b7ea9d18f admin admin] Pushing event updated for resources: {'Port': ['ID=72070289-8347-44bd-bfb9-9510e94eb5bd,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:02.118095 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:02.156337 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9fe100fa-d663-4595-92e0-d96b7ea9d18f admin admin] Network eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:18:02.160728 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96119a1f-0eb8-48be-a01f-3f800659e983 req-f3081035-d28d-40bd-b1b8-ca4ea1f76ea2 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3c85c33-b0b5-4c62-8189-7ff917e062e6 HTTP/1.1" status: 200 len: 210 time: 0.0648417 Dec 09 21:18:02.161993 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-9fe100fa-d663-4595-92e0-d96b7ea9d18f admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:18:02.165831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9fe100fa-d663-4595-92e0-d96b7ea9d18f admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:18:02.177688 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2c85b8fc-41be-4975-88fd-db5bc87f1f89', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7eb6e48f-08e3-409a-9551-0e38eb690c8b'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:02.183913 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-88a96085-239d-4acf-a4dd-44e1860998e3" -d '{"events": [{"server_uuid": "2c85b8fc-41be-4975-88fd-db5bc87f1f89", "name": "network-vif-plugged", "status": "completed", "tag": "7eb6e48f-08e3-409a-9551-0e38eb690c8b"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:02.213917 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 7eb6e48f-08e3-409a-9551-0e38eb690c8b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=7eb6e48f-08e3-409a-9551-0e38eb690c8b,segment=NetworkSegment(946d0405-6c7f-49a7-81bb-30e422c98100),segment_id=946d0405-6c7f-49a7-81bb-30e422c98100)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:02.225939 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:02.275699 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9fe100fa-d663-4595-92e0-d96b7ea9d18f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:02.323979 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eda8a6e4-a045-4f6f-8f6f-7e98404d08a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:02.334250 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eda8a6e4-a045-4f6f-8f6f-7e98404d08a1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:02.342399 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-eda8a6e4-a045-4f6f-8f6f-7e98404d08a1 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/10bf6aa9-25e7-407d-a66a-977aaab0be8a HTTP/1.1" status: 204 len: 168 time: 0.9165049 Dec 09 21:18:02.359317 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e1ec30a1-70dc-4885-856f-930d0577773f x-openstack-request-id: req-e1ec30a1-70dc-4885-856f-930d0577773f {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:02.359650 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2c85b8fc-41be-4975-88fd-db5bc87f1f89", "name": "network-vif-plugged", "status": "completed", "tag": "7eb6e48f-08e3-409a-9551-0e38eb690c8b", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:02.366522 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e1ec30a1-70dc-4885-856f-930d0577773f {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:02.368532 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2c85b8fc-41be-4975-88fd-db5bc87f1f89', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7eb6e48f-08e3-409a-9551-0e38eb690c8b', 'code': 200} Dec 09 21:18:02.432418 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=7eb6e48f-08e3-409a-9551-0e38eb690c8b,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:02.484531 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eda8a6e4-a045-4f6f-8f6f-7e98404d08a1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=10bf6aa9-25e7-407d-a66a-977aaab0be8a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:02.492844 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-6e511ef4-c620-4cee-8c7e-53bceaeb8793 req-50e64834-a134-4ad0-8a04-08964b16eb3d tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Deleting port 45acc430-900d-475a-af6a-44f47e8a8d29 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:18:02.493699 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6e511ef4-c620-4cee-8c7e-53bceaeb8793 req-50e64834-a134-4ad0-8a04-08964b16eb3d tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:02.685952 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-6e511ef4-c620-4cee-8c7e-53bceaeb8793 req-50e64834-a134-4ad0-8a04-08964b16eb3d tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] For port 45acc430-900d-475a-af6a-44f47e8a8d29, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=45acc430-900d-475a-af6a-44f47e8a8d29,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:02.687246 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6e511ef4-c620-4cee-8c7e-53bceaeb8793 req-50e64834-a134-4ad0-8a04-08964b16eb3d tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:02.734692 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-6e511ef4-c620-4cee-8c7e-53bceaeb8793 req-50e64834-a134-4ad0-8a04-08964b16eb3d tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Calling delete_port for 45acc430-900d-475a-af6a-44f47e8a8d29 owned by compute:tempest-test_az-1650541094 {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:18:02.772708 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4c690629-95f0-454e-a714-ed7cfe3dca3e None None] Provisioning complete for port 72070289-8347-44bd-bfb9-9510e94eb5bd triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:02.773320 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4c690629-95f0-454e-a714-ed7cfe3dca3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:02.886253 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.31', 57399) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:02.902841 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-4c690629-95f0-454e-a714-ed7cfe3dca3e None None] Port 72070289-8347-44bd-bfb9-9510e94eb5bd cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:18:02.940796 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2cb024f7-3e43-4881-b91e-fe405149a086 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:02.979468 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-f7d82c2f-1aec-4482-b383-a304ba37fc4c tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=97c6f11d72db4857afd32603bdfd0616&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0919063 Dec 09 21:18:03.044958 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19e6dba4-cb69-4244-ba1b-b69c5ab36b69 req-ea803d13-b170-4e0a-9f5b-1495a3915b01 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:03.046882 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-19e6dba4-cb69-4244-ba1b-b69c5ab36b69 req-ea803d13-b170-4e0a-9f5b-1495a3915b01 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 1098 time: 0.6082911 Dec 09 21:18:03.225256 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-d44d17e2-68bf-4f27-966a-f0434db05a15 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:03.226755 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-d44d17e2-68bf-4f27-966a-f0434db05a15 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2353945 Dec 09 21:18:03.240911 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-19e6dba4-cb69-4244-ba1b-b69c5ab36b69 req-22cffc07-f18d-4471-8a4e-94cee49a551a service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1856956 Dec 09 21:18:03.245329 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-f83e6034-8aa7-48b4-aff7-2904e7b9aa5a tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Request body: {'port': {'device_id': 'a3c85c33-b0b5-4c62-8189-7ff917e062e6', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '97c6f11d72db4857afd32603bdfd0616'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:03.253964 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b03bcbc-3969-4474-ba51-af27009e486c req-da965ce3-1e65-454a-98a3-de3a2e82033c tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=6a32a636fa83452db185eb0152d6082d&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0666625 Dec 09 21:18:03.291490 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9fe100fa-d663-4595-92e0-d96b7ea9d18f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:03.297863 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6e511ef4-c620-4cee-8c7e-53bceaeb8793 req-50e64834-a134-4ad0-8a04-08964b16eb3d tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:03.312738 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['45acc430-900d-475a-af6a-44f47e8a8d29'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:18:03.401322 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50e64834-a134-4ad0-8a04-08964b16eb3d tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Pushing event deleted for resources: {'Port': ['ID=45acc430-900d-475a-af6a-44f47e8a8d29,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:03.421355 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b03bcbc-3969-4474-ba51-af27009e486c req-58770540-56cc-40c0-aa5e-a47faa746611 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:03.429500 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b03bcbc-3969-4474-ba51-af27009e486c req-58770540-56cc-40c0-aa5e-a47faa746611 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1736255 Dec 09 21:18:03.475999 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b03bcbc-3969-4474-ba51-af27009e486c req-4278c8ca-38fb-476c-97d2-be55e8ea4801 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/quotas/6a32a636fa83452db185eb0152d6082d HTTP/1.1" status: 200 len: 375 time: 0.0451002 Dec 09 21:18:03.484770 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6a92432-dbc3-4032-b3cc-7100fa6d0c33 req-2424bf68-a8cd-4e13-8902-a2d232b3c361 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:03.492695 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6a92432-dbc3-4032-b3cc-7100fa6d0c33 req-2424bf68-a8cd-4e13-8902-a2d232b3c361 tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6721efc-7196-4b31-b864-440bcc89de57 HTTP/1.1" status: 200 len: 889 time: 0.3431113 Dec 09 21:18:03.543001 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-6e511ef4-c620-4cee-8c7e-53bceaeb8793 req-50e64834-a134-4ad0-8a04-08964b16eb3d tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] No DVR routers for this DVR port 45acc430-900d-475a-af6a-44f47e8a8d29 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:18:03.574958 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6e511ef4-c620-4cee-8c7e-53bceaeb8793 req-50e64834-a134-4ad0-8a04-08964b16eb3d tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:03.580459 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6e511ef4-c620-4cee-8c7e-53bceaeb8793 req-50e64834-a134-4ad0-8a04-08964b16eb3d tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.31 "DELETE /v2.0/ports/45acc430-900d-475a-af6a-44f47e8a8d29 HTTP/1.1" status: 204 len: 173 time: 1.7321908 Dec 09 21:18:03.581478 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e6721efc-7196-4b31-b864-440bcc89de57', 'name': 'network-vif-deleted', 'tag': '45acc430-900d-475a-af6a-44f47e8a8d29'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:03.585717 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8c2fb19b-a9d8-4f07-bb19-eedc0474dfa7" -d '{"events": [{"server_uuid": "e6721efc-7196-4b31-b864-440bcc89de57", "name": "network-vif-deleted", "tag": "45acc430-900d-475a-af6a-44f47e8a8d29"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:03.605242 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b03bcbc-3969-4474-ba51-af27009e486c req-a902adc5-7487-4f17-86a2-d9be5878188c tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=6a32a636fa83452db185eb0152d6082d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1277616 Dec 09 21:18:03.639130 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-f83e6034-8aa7-48b4-aff7-2904e7b9aa5a tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Made reservation on behalf of 97c6f11d72db4857afd32603bdfd0616 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:18:03.652742 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-f83e6034-8aa7-48b4-aff7-2904e7b9aa5a tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:03.671501 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6a92432-dbc3-4032-b3cc-7100fa6d0c33 req-fa614995-5fc8-4e49-98d1-6812ac8b155c tempest-AggregatesAdminTestJSON-1367805697 tempest-AggregatesAdminTestJSON-1367805697-project] 10.222.0.13 "GET /v2.0/security-groups?id=cf1d3e91-3176-48c8-adff-dd58205947d5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1757128 Dec 09 21:18:03.739228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 83bb56df-8fc2-46ae-84d3-bda4fe854463 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:18:03.930658 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9fe100fa-d663-4595-92e0-d96b7ea9d18f admin admin] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:03.940579 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 83bb56df-8fc2-46ae-84d3-bda4fe854463 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:03.942384 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:03.962691 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55230) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:03.974571 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9fe100fa-d663-4595-92e0-d96b7ea9d18f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:04.089673 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fe100fa-d663-4595-92e0-d96b7ea9d18f admin admin] Pushing event updated for resources: {'Port': ['ID=72070289-8347-44bd-bfb9-9510e94eb5bd,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:04.096886 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-f83e6034-8aa7-48b4-aff7-2904e7b9aa5a tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Allocated IP 192.168.233.220 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/3fd5c53a-dd51-40cb-9c92-d83aa47ab67a) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:18:04.110792 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-12aeef2b-ab87-4979-95b5-9c344183043f req-9eb8769a-696c-4abf-8d51-0c7edffb37d6 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3c85c33-b0b5-4c62-8189-7ff917e062e6 HTTP/1.1" status: 200 len: 210 time: 0.0698459 Dec 09 21:18:04.157710 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b413499-79f4-4ef1-98cc-a80ac776c4b2 req-cddbf233-8c37-4588-8187-eb51b16f4fc7 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:04.178773 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b413499-79f4-4ef1-98cc-a80ac776c4b2 req-cddbf233-8c37-4588-8187-eb51b16f4fc7 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 946 time: 0.2445512 Dec 09 21:18:04.217043 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:04.224856 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9fe100fa-d663-4595-92e0-d96b7ea9d18f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:04.286507 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-397acca4-2d2e-43e2-9612-fe4bc95c0768 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.10 "GET /v2.0/networks?tenant_id=6a32a636fa83452db185eb0152d6082d&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0775242 Dec 09 21:18:04.299095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-6c2dad62-2142-4b3e-9c82-0f9d3d598d24 admin admin] Request body: {'network': {'name': 'tempest-LiveAutoBlockMigrationV225Test-1968455979-network', 'tenant_id': 'a306d2242b1e41c892f63c7b122cdee4'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:04.328856 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 83bb56df-8fc2-46ae-84d3-bda4fe854463, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=83bb56df-8fc2-46ae-84d3-bda4fe854463,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:04.339098 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:04.485252 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=83bb56df-8fc2-46ae-84d3-bda4fe854463,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:04.538256 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9fe100fa-d663-4595-92e0-d96b7ea9d18f admin admin] Network eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:18:04.549474 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-9fe100fa-d663-4595-92e0-d96b7ea9d18f admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:18:04.575491 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b413499-79f4-4ef1-98cc-a80ac776c4b2 req-bc8f7cb1-66fc-4728-9278-b512bc68f663 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3956826 Dec 09 21:18:04.580164 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6c2dad62-2142-4b3e-9c82-0f9d3d598d24 admin admin] Made reservation on behalf of a306d2242b1e41c892f63c7b122cdee4 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:18:04.583223 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6c2dad62-2142-4b3e-9c82-0f9d3d598d24 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:04.790284 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-b46cb854-1844-4f76-be8d-11b8ab54a872 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:04.792844 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-b46cb854-1844-4f76-be8d-11b8ab54a872 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4931619 Dec 09 21:18:04.795873 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-02690baa-33e1-426b-9352-d9620982171e x-openstack-request-id: req-02690baa-33e1-426b-9352-d9620982171e {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:04.796247 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e6721efc-7196-4b31-b864-440bcc89de57", "name": "network-vif-deleted", "tag": "45acc430-900d-475a-af6a-44f47e8a8d29", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:04.796548 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-02690baa-33e1-426b-9352-d9620982171e {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:04.796949 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e6721efc-7196-4b31-b864-440bcc89de57', 'name': 'network-vif-deleted', 'tag': '45acc430-900d-475a-af6a-44f47e8a8d29', 'status': 'completed', 'code': 200} Dec 09 21:18:04.841517 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-4432ba6d-e77c-4cc3-9eb7-cc47b05873ac tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Request body: {'port': {'device_id': '51e11d39-964b-458f-b5dc-fb020eb2c5f5', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '6a32a636fa83452db185eb0152d6082d'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:04.841887 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9fe100fa-d663-4595-92e0-d96b7ea9d18f admin admin] Router 70ade903-ee3e-4040-8855-b2a937f2a0d9 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:18:04.864219 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6c2dad62-2142-4b3e-9c82-0f9d3d598d24 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:04.919888 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-a3addd64-028d-4c4a-94c4-11ef6e117cb8 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=10c237cbfa28423ea2d1df15f60193f2&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0752172 Dec 09 21:18:04.943944 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ad29ff66-f808-4a8b-b001-fdffac1cbb88 None None] Provisioning complete for port 72070289-8347-44bd-bfb9-9510e94eb5bd triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:04.944509 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ad29ff66-f808-4a8b-b001-fdffac1cbb88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:05.038431 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ad29ff66-f808-4a8b-b001-fdffac1cbb88 None None] Port 72070289-8347-44bd-bfb9-9510e94eb5bd cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:18:05.102295 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-87d13488-4397-494b-a283-49f898b03097 req-90203db8-90d5-455a-8005-6e8b269d279e tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebcfc729-b616-4933-a43d-f707a862db78 HTTP/1.1" status: 200 len: 210 time: 0.2706385 Dec 09 21:18:05.267245 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-f83e6034-8aa7-48b4-aff7-2904e7b9aa5a tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:05.306397 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-f83e6034-8aa7-48b4-aff7-2904e7b9aa5a tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:05.316903 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50e34786-6fb6-490f-97bc-fa0607ba69b4 req-5eccb781-510d-41df-8ec2-2215725058c6 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3c85c33-b0b5-4c62-8189-7ff917e062e6 HTTP/1.1" status: 200 len: 210 time: 0.0448146 Dec 09 21:18:05.322443 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['37ba309b-f598-4b1e-b3e8-35aa21ab14d3'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:18:05.348445 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-3b4aafdc-0872-4d52-87b5-9f9b0eb1df11 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:05.357056 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-3b4aafdc-0872-4d52-87b5-9f9b0eb1df11 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4362788 Dec 09 21:18:05.372262 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f83e6034-8aa7-48b4-aff7-2904e7b9aa5a tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Pushing event updated for resources: {'Port': ['ID=3fd5c53a-dd51-40cb-9c92-d83aa47ab67a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:05.401262 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-c4e1e59d-060e-4c4e-8400-6b78747c495c tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/quotas/10c237cbfa28423ea2d1df15f60193f2 HTTP/1.1" status: 200 len: 375 time: 0.0429964 Dec 09 21:18:05.406219 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9fe100fa-d663-4595-92e0-d96b7ea9d18f admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:18:05.412664 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-f83e6034-8aa7-48b4-aff7-2904e7b9aa5a tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:18:05.417204 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-f83e6034-8aa7-48b4-aff7-2904e7b9aa5a tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:18:05.421330 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-f83e6034-8aa7-48b4-aff7-2904e7b9aa5a tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:18:05.442934 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] Sync routers for ids ['70ade903-ee3e-4040-8855-b2a937f2a0d9'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:18:05.443889 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9fe100fa-d663-4595-92e0-d96b7ea9d18f admin admin] 10.222.0.13 "PUT /v2.0/routers/70ade903-ee3e-4040-8855-b2a937f2a0d9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.3782194 Dec 09 21:18:05.466605 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55288) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:05.486853 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-7e184944-2abb-49cb-99e6-ccbe6aacf297 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=10c237cbfa28423ea2d1df15f60193f2&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0836029 Dec 09 21:18:05.568220 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6c2dad62-2142-4b3e-9c82-0f9d3d598d24 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:05.579190 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6c2dad62-2142-4b3e-9c82-0f9d3d598d24 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:05.582922 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-4432ba6d-e77c-4cc3-9eb7-cc47b05873ac tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Made reservation on behalf of 6a32a636fa83452db185eb0152d6082d for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:18:05.587760 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] Routers {'70ade903-ee3e-4040-8855-b2a937f2a0d9'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:18:05.590219 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:17:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['70ade903-ee3e-4040-8855-b2a937f2a0d9'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:18:05.599472 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-4432ba6d-e77c-4cc3-9eb7-cc47b05873ac tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:05.671772 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c2dad62-2142-4b3e-9c82-0f9d3d598d24 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=04b35e67-a28a-4586-be0f-3c4eb594dede,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:05.686181 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6c2dad62-2142-4b3e-9c82-0f9d3d598d24 admin admin] vlan segment allocate from pool success with {'vlan_id': 100, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:18:05.711402 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6c2dad62-2142-4b3e-9c82-0f9d3d598d24 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:05.713880 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-6c2dad62-2142-4b3e-9c82-0f9d3d598d24 admin admin] Added segment 4bbda46b-e2e5-4ce1-b027-3fb09391026d of type vlan for network 93378dc3-2ac5-4cf7-9ce3-d812934de40c Dec 09 21:18:05.758826 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-4432ba6d-e77c-4cc3-9eb7-cc47b05873ac tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:05.765462 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7b03bcbc-3969-4474-ba51-af27009e486c req-9846d88e-cfce-425e-91dc-f0939d9c74f1 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=6a32a636fa83452db185eb0152d6082d&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1626401 Dec 09 21:18:05.794577 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-f83e6034-8aa7-48b4-aff7-2904e7b9aa5a tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:05.794577 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-f83e6034-8aa7-48b4-aff7-2904e7b9aa5a tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:05.811107 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6c2dad62-2142-4b3e-9c82-0f9d3d598d24 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:05.825720 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-f83e6034-8aa7-48b4-aff7-2904e7b9aa5a tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.5877082 Dec 09 21:18:05.850230 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 45acc430-900d-475a-af6a-44f47e8a8d29 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:18:05.854042 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 83bb56df-8fc2-46ae-84d3-bda4fe854463 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:18:05.894825 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-a066f1a3-9d05-4acc-b457-6d642fb9fc72 service neutron] Request body: {'port': {'device_id': 'a3c85c33-b0b5-4c62-8189-7ff917e062e6', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:05.935149 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-27c6d58f-33cd-4c60-9672-06b9878269d1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:05.992008 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.db.resource_extend [None req-6c2dad62-2142-4b3e-9c82-0f9d3d598d24 admin admin] It took 0.17 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 09 21:18:06.077178 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] Set router 70ade903-ee3e-4040-8855-b2a937f2a0d9 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:18:06.080991 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b03bcbc-3969-4474-ba51-af27009e486c req-7e26a0b0-d2d4-4125-ae05-5753b9745504 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:06.082759 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7b03bcbc-3969-4474-ba51-af27009e486c req-7e26a0b0-d2d4-4125-ae05-5753b9745504 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2777736 Dec 09 21:18:06.113479 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2b6350a3-221a-4676-af59-f50874048a2a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ccb2b63648cb4a5da382475755debe06&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6243484 Dec 09 21:18:06.114609 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-7b03bcbc-3969-4474-ba51-af27009e486c req-cd8797c6-d9db-4b98-b725-e97692f0bdf8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Request body: {'port': {'device_id': 'ebcfc729-b616-4933-a43d-f707a862db78', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '6a32a636fa83452db185eb0152d6082d'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:06.121480 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55310) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:06.127590 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6c2dad62-2142-4b3e-9c82-0f9d3d598d24 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:06.129118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c2dad62-2142-4b3e-9c82-0f9d3d598d24 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:06.130230 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6c2dad62-2142-4b3e-9c82-0f9d3d598d24 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:06.165733 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-a066f1a3-9d05-4acc-b457-6d642fb9fc72 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:06.184455 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 45acc430-900d-475a-af6a-44f47e8a8d29 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:18:06.185088 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 45acc430-900d-475a-af6a-44f47e8a8d29 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:18:06.207778 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36a792b4-f04c-4aad-9ecf-b55e550e33da req-82e12c58-b1a5-403d-ae00-baa1091a0cec tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=8a7c4077-25fa-451f-8052-c1f6ec25a13a HTTP/1.1" status: 200 len: 210 time: 0.1006622 Dec 09 21:18:06.243377 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-468ba9a6-2063-43ad-b7d3-99d3ebd74a97 req-ab7051fe-04c0-4b07-9388-3c51445da248 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:06.245614 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-468ba9a6-2063-43ad-b7d3-99d3ebd74a97 req-ab7051fe-04c0-4b07-9388-3c51445da248 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 946 time: 0.2509487 Dec 09 21:18:06.251240 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6c2dad62-2142-4b3e-9c82-0f9d3d598d24 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 894 time: 2.2863705 Dec 09 21:18:06.256862 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55320) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:06.290339 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 83bb56df-8fc2-46ae-84d3-bda4fe854463 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:06.291335 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:06.297755 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c9ee12e2-5bc7-4a40-80b8-21923a6463d8 admin admin] Request body: {'subnet': {'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c', 'cidr': '172.20.0.0/28', 'name': 'tempest-LiveAutoBlockMigrationV225Test-1968455979-subnet', 'tenant_id': 'a306d2242b1e41c892f63c7b122cdee4', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:06.391301 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c9ee12e2-5bc7-4a40-80b8-21923a6463d8 admin admin] Made reservation on behalf of a306d2242b1e41c892f63c7b122cdee4 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:18:06.405878 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c9ee12e2-5bc7-4a40-80b8-21923a6463d8 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:06.419476 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-45a60ae5-90cc-48be-8bae-0a48895da3e1 None None] Provisioning complete for port 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:06.420062 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-45a60ae5-90cc-48be-8bae-0a48895da3e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:06.431757 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c2dad62-2142-4b3e-9c82-0f9d3d598d24 admin admin] Pushing event updated for resources: {'Network': ['ID=93378dc3-2ac5-4cf7-9ce3-d812934de40c,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:06.494501 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 93378dc3-2ac5-4cf7-9ce3-d812934de40c details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:18:06.581645 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55338) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:06.592607 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-a066f1a3-9d05-4acc-b457-6d642fb9fc72 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:18:06.594733 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:06.601941 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-a066f1a3-9d05-4acc-b457-6d642fb9fc72 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:06.612141 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-45a60ae5-90cc-48be-8bae-0a48895da3e1 None None] Port 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:18:06.615160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-a066f1a3-9d05-4acc-b457-6d642fb9fc72 service neutron] Transition to ACTIVE for port object 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:18:06.615491 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-468ba9a6-2063-43ad-b7d3-99d3ebd74a97 req-618d67cb-5ebc-40c8-98cb-3bee0e5ccbe0 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3588536 Dec 09 21:18:06.656302 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:18:03Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '72070289-8347-44bd-bfb9-9510e94eb5bd', 'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'tenant_id': '920e0419877f4239b048e126682274e9', 'mac_address': 'fa:16:3e:c3:24:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 264, 'fixed_ips': [{'subnet_id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:18:00Z', 'updated_at': '2021-12-09T21:18:03Z', 'revision_number': 2, 'project_id': '920e0419877f4239b048e126682274e9', 'subnets': [{'id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:18:06.677439 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-a066f1a3-9d05-4acc-b457-6d642fb9fc72 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:06.691799 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] Checking router: 70ade903-ee3e-4040-8855-b2a937f2a0d9 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:18:06.692282 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] Updating router 70ade903-ee3e-4040-8855-b2a937f2a0d9 port 72070289-8347-44bd-bfb9-9510e94eb5bd binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:18:06.751084 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bef796fb-c05d-4b3b-a21d-2c474302ec27 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:06.769228 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:06.776529 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bef796fb-c05d-4b3b-a21d-2c474302ec27 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:06.929305 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-4432ba6d-e77c-4cc3-9eb7-cc47b05873ac tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:06.938272 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a066f1a3-9d05-4acc-b457-6d642fb9fc72 service neutron] Pushing event updated for resources: {'Port': ['ID=3fd5c53a-dd51-40cb-9c92-d83aa47ab67a,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:06.957162 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-4432ba6d-e77c-4cc3-9eb7-cc47b05873ac tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:07.026901 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bef796fb-c05d-4b3b-a21d-2c474302ec27 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:07.029587 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bef796fb-c05d-4b3b-a21d-2c474302ec27 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:07.034583 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bef796fb-c05d-4b3b-a21d-2c474302ec27 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/cf1d3e91-3176-48c8-adff-dd58205947d5 HTTP/1.1" status: 204 len: 168 time: 0.9108679 Dec 09 21:18:07.043271 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4432ba6d-e77c-4cc3-9eb7-cc47b05873ac tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3de26898-1613-497e-9444-0b50b43b6cf8,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:07.110560 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bef796fb-c05d-4b3b-a21d-2c474302ec27 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cf1d3e91-3176-48c8-adff-dd58205947d5,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:07.148691 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99df2fb0-c089-487f-ac8c-283a7a2d537c req-2d3df976-d1d9-4bc6-b672-56f89255e51a tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebcfc729-b616-4933-a43d-f707a862db78 HTTP/1.1" status: 200 len: 210 time: 0.0546365 Dec 09 21:18:07.149726 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f04e916-ad87-4bc2-94c6-2102b0cab67e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:07.229472 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-821a695f-c9a0-4a62-b1f4-a3769bd17c39 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:07.237432 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-821a695f-c9a0-4a62-b1f4-a3769bd17c39 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/networks?id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 HTTP/1.1" status: 200 len: 821 time: 0.7611539 Dec 09 21:18:07.255827 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-a066f1a3-9d05-4acc-b457-6d642fb9fc72 service neutron] Attempting to bind port 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:18:07.256157 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-a066f1a3-9d05-4acc-b457-6d642fb9fc72 service neutron] Attempting to bind port 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:18:07.256490 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-a066f1a3-9d05-4acc-b457-6d642fb9fc72 service neutron] Attempting to bind port 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:07.281357 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-a066f1a3-9d05-4acc-b457-6d642fb9fc72 service neutron] Port 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:18:07.281657 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-a066f1a3-9d05-4acc-b457-6d642fb9fc72 service neutron] Attempting to bind port 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:07.320035 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-8eef1f73-a431-46bb-8d6f-3bc4a5805a92 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/quotas/920e0419877f4239b048e126682274e9 HTTP/1.1" status: 200 len: 375 time: 0.0816083 Dec 09 21:18:07.323615 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-a066f1a3-9d05-4acc-b457-6d642fb9fc72 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 17, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:18:07.324003 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-a066f1a3-9d05-4acc-b457-6d642fb9fc72 service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:18:07.324390 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-a066f1a3-9d05-4acc-b457-6d642fb9fc72 service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:18:07.324881 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-a066f1a3-9d05-4acc-b457-6d642fb9fc72 service neutron] Bound port: 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:18:07.325278 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-a066f1a3-9d05-4acc-b457-6d642fb9fc72 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:07.346260 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7b03bcbc-3969-4474-ba51-af27009e486c req-cd8797c6-d9db-4b98-b725-e97692f0bdf8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Made reservation on behalf of 6a32a636fa83452db185eb0152d6082d for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:18:07.359555 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7b03bcbc-3969-4474-ba51-af27009e486c req-cd8797c6-d9db-4b98-b725-e97692f0bdf8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:07.395250 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:07.409546 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-4432ba6d-e77c-4cc3-9eb7-cc47b05873ac tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Allocated IP 192.168.233.203 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/1cc3b771-7d24-4dfa-bbfe-6e007094c74b) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:18:07.439081 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:07.445460 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9857ae6c-9f3d-4067-aff0-e11e4f96eea3 req-c92f97a4-5202-4e3b-a935-6e6f65585044 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:07.453265 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9857ae6c-9f3d-4067-aff0-e11e4f96eea3 req-c92f97a4-5202-4e3b-a935-6e6f65585044 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3c85c33-b0b5-4c62-8189-7ff917e062e6 HTTP/1.1" status: 200 len: 948 time: 0.2083797 Dec 09 21:18:07.470475 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.10', 63574) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:07.501587 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f04e916-ad87-4bc2-94c6-2102b0cab67e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:07.502900 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c9ee12e2-5bc7-4a40-80b8-21923a6463d8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:07.542613 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-0b88e99a-7559-4206-8929-0cc5d61ce302 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=920e0419877f4239b048e126682274e9&fields=id HTTP/1.1" status: 200 len: 302 time: 0.2210102 Dec 09 21:18:07.577062 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d85b4772-5bcc-4696-8bab-c782d76cb5c0 None None] Pushing event updated for resources: {'Port': ['ID=72070289-8347-44bd-bfb9-9510e94eb5bd,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:07.589247 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-a066f1a3-9d05-4acc-b457-6d642fb9fc72 service neutron] For port 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:18:07.599695 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-a066f1a3-9d05-4acc-b457-6d642fb9fc72 service neutron] For port 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=3fd5c53a-dd51-40cb-9c92-d83aa47ab67a,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:18:07.602260 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f04e916-ad87-4bc2-94c6-2102b0cab67e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:07.611902 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-a066f1a3-9d05-4acc-b457-6d642fb9fc72 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:07.616177 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-8dcb03c4-beff-473d-bdfe-eba4ef65ed37 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.10 "GET /v2.0/networks?tenant_id=10c237cbfa28423ea2d1df15f60193f2&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1444659 Dec 09 21:18:07.694156 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] Attempting to bind port 72070289-8347-44bd-bfb9-9510e94eb5bd on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:18:07.694594 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] Attempting to bind port 72070289-8347-44bd-bfb9-9510e94eb5bd by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'c1e3b516-6ad9-46a2-acfa-cf795ad5b916', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:18:07.695054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] Attempting to bind port 72070289-8347-44bd-bfb9-9510e94eb5bd on network eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:07.714806 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 17, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:18:07.723234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] Checking segment: {'id': 'c1e3b516-6ad9-46a2-acfa-cf795ad5b916', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:18:07.724357 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:07.724991 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] Bound using segment: {'id': 'c1e3b516-6ad9-46a2-acfa-cf795ad5b916', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:18:07.725778 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] Bound port: 72070289-8347-44bd-bfb9-9510e94eb5bd, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c1e3b516-6ad9-46a2-acfa-cf795ad5b916', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:18:07.726389 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:07.734679 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55350) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:07.821384 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a066f1a3-9d05-4acc-b457-6d642fb9fc72 service neutron] Pushing event updated for resources: {'Port': ['ID=3fd5c53a-dd51-40cb-9c92-d83aa47ab67a,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:07.832145 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] For port 72070289-8347-44bd-bfb9-9510e94eb5bd, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:18:07.833254 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-a066f1a3-9d05-4acc-b457-6d642fb9fc72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:07.833936 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-a066f1a3-9d05-4acc-b457-6d642fb9fc72 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:07.836037 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-a066f1a3-9d05-4acc-b457-6d642fb9fc72 service neutron] 10.222.0.31 "PUT /v2.0/ports/3fd5c53a-dd51-40cb-9c92-d83aa47ab67a HTTP/1.1" status: 200 len: 1097 time: 1.9643929 Dec 09 21:18:07.836512 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a3c85c33-b0b5-4c62-8189-7ff917e062e6', 'tag': '3fd5c53a-dd51-40cb-9c92-d83aa47ab67a'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:07.838828 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3cee8d2d-68d8-46ad-8ec1-4f32d238967c" -d '{"events": [{"name": "network-changed", "server_uuid": "a3c85c33-b0b5-4c62-8189-7ff917e062e6", "tag": "3fd5c53a-dd51-40cb-9c92-d83aa47ab67a"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:07.844604 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] For port 72070289-8347-44bd-bfb9-9510e94eb5bd, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=72070289-8347-44bd-bfb9-9510e94eb5bd,segment=NetworkSegment(c1e3b516-6ad9-46a2-acfa-cf795ad5b916),segment_id=c1e3b516-6ad9-46a2-acfa-cf795ad5b916)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:18:07.872601 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:07.948085 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-4432ba6d-e77c-4cc3-9eb7-cc47b05873ac tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:07.982012 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55358) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:07.982545 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-39824794-6087-4080-96e7-4049f4067b37 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=fec7a5b1097f4d699d310d6bfd4743f4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2352724 Dec 09 21:18:07.983540 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9ee12e2-5bc7-4a40-80b8-21923a6463d8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c49a62cc-af1b-4958-a4a9-eb44188b8fb9,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:07.984580 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:08.000135 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9857ae6c-9f3d-4067-aff0-e11e4f96eea3 req-ee03c3be-068e-42e4-9256-ebe26bc48e1f tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5459290 Dec 09 21:18:08.012027 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1f04e916-ad87-4bc2-94c6-2102b0cab67e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e54a256e80ab4eb29b23e8ccebefd152&name=default HTTP/1.1" status: 200 len: 2996 time: 1.4258959 Dec 09 21:18:08.013043 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f04e916-ad87-4bc2-94c6-2102b0cab67e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fd4b4108-ffd7-4c01-a37b-aab9b3ebab62,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:08.033816 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55360) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:08.038005 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-43b47b4f-8589-4bd7-b6eb-96f335092326 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:08.039651 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-43b47b4f-8589-4bd7-b6eb-96f335092326 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=97c6f11d72db4857afd32603bdfd0616&device_id=a3c85c33-b0b5-4c62-8189-7ff917e062e6 HTTP/1.1" status: 200 len: 1100 time: 0.1516428 Dec 09 21:18:08.059601 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9ee12e2-5bc7-4a40-80b8-21923a6463d8 admin admin] Checking segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:18:08.059963 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c9ee12e2-5bc7-4a40-80b8-21923a6463d8 admin admin] Network hostable DHCP agents. Network: 93378dc3-2ac5-4cf7-9ce3-d812934de40c, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:18:08.115314 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-d168bb5b-532a-40f4-86e3-76b95d615e4c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.220&port_id=3fd5c53a-dd51-40cb-9c92-d83aa47ab67a HTTP/1.1" status: 200 len: 217 time: 0.0546458 Dec 09 21:18:08.120122 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-0cb2c930-ba1d-4114-8e3c-aebfdaec4b08 service neutron] 10.222.0.13 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5762932 Dec 09 21:18:08.133107 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c9ee12e2-5bc7-4a40-80b8-21923a6463d8 admin admin] Network 93378dc3-2ac5-4cf7-9ce3-d812934de40c is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:18:08.134414 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] Routers {'70ade903-ee3e-4040-8855-b2a937f2a0d9'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:18:08.135017 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:18:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['70ade903-ee3e-4040-8855-b2a937f2a0d9'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:18:08.209337 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-91f1f662-54a1-4564-a161-6f89ae2d49c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:08.210842 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-91f1f662-54a1-4564-a161-6f89ae2d49c3 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0873065 Dec 09 21:18:08.213336 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-9591139b-57e0-47fc-98d4-7d193f10cd21 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:08.213615 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d85b4772-5bcc-4696-8bab-c782d76cb5c0 None None] Pushing event updated for resources: {'Port': ['ID=72070289-8347-44bd-bfb9-9510e94eb5bd,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:08.214858 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-9591139b-57e0-47fc-98d4-7d193f10cd21 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.5801132 Dec 09 21:18:08.244190 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-10f86f73-6b1d-4683-8e47-871e073a4094 None None] Provisioning complete for port 72070289-8347-44bd-bfb9-9510e94eb5bd triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:08.244558 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-10f86f73-6b1d-4683-8e47-871e073a4094 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:08.251793 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-4e32fe91-7761-40a3-822d-96072c5589ea tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Request body: {'port': {'device_id': '8a7c4077-25fa-451f-8052-c1f6ec25a13a', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '10c237cbfa28423ea2d1df15f60193f2'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:08.256022 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-c9ee12e2-5bc7-4a40-80b8-21923a6463d8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 93378dc3-2ac5-4cf7-9ce3-d812934de40c) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:18:08.280423 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9ee12e2-5bc7-4a40-80b8-21923a6463d8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:08.280877 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c9ee12e2-5bc7-4a40-80b8-21923a6463d8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:08.293046 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3739f402-d5d5-4e2c-bf39-831ea4717587 None None] Network 93378dc3-2ac5-4cf7-9ce3-d812934de40c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:18:08.335590 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8f5afbd8-31b0-450c-b25d-17c62e45da02 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:08.341857 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-4432ba6d-e77c-4cc3-9eb7-cc47b05873ac tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:08.374302 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-096a9946-5208-4a12-8419-784031fd97ee admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:08.428929 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c9ee12e2-5bc7-4a40-80b8-21923a6463d8 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 858 time: 2.1370463 Dec 09 21:18:08.453747 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-830bf80f-d6b5-46d6-889a-b0dbf4d54512 service neutron] 10.222.0.13 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3215380 Dec 09 21:18:08.464368 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-096a9946-5208-4a12-8419-784031fd97ee admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:08.520705 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba048b8e-3fb2-4d70-93b6-714df2cfbcb1 req-9b7dd5d7-aa9c-4f3c-b6db-3f4393d261e7 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:08.522447 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba048b8e-3fb2-4d70-93b6-714df2cfbcb1 req-9b7dd5d7-aa9c-4f3c-b6db-3f4393d261e7 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 946 time: 0.2619977 Dec 09 21:18:08.532828 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55368) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:08.540022 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-5da050b7-68bb-4eca-b725-eda7caf625bb tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Request body: {'floatingip': {'port_id': '7eb6e48f-08e3-409a-9551-0e38eb690c8b'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:08.548475 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8f5afbd8-31b0-450c-b25d-17c62e45da02 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:08.667219 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-7b03bcbc-3969-4474-ba51-af27009e486c req-cd8797c6-d9db-4b98-b725-e97692f0bdf8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Allocated IP 192.168.233.144 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/b75bad0f-5d42-4305-b970-f7b7298d2231) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:18:08.697634 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5da050b7-68bb-4eca-b725-eda7caf625bb tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for floatingip, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:08.776293 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-4432ba6d-e77c-4cc3-9eb7-cc47b05873ac tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:18:08.777503 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4432ba6d-e77c-4cc3-9eb7-cc47b05873ac tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Pushing event updated for resources: {'Port': ['ID=1cc3b771-7d24-4dfa-bbfe-6e007094c74b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:08.785752 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-87605816-0720-4885-afa3-64d95c801ebe x-openstack-request-id: req-87605816-0720-4885-afa3-64d95c801ebe {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:08.786368 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a3c85c33-b0b5-4c62-8189-7ff917e062e6", "tag": "3fd5c53a-dd51-40cb-9c92-d83aa47ab67a", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:08.786652 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-87605816-0720-4885-afa3-64d95c801ebe {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:08.787157 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a3c85c33-b0b5-4c62-8189-7ff917e062e6', 'tag': '3fd5c53a-dd51-40cb-9c92-d83aa47ab67a', 'status': 'completed', 'code': 200} Dec 09 21:18:08.805642 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-4432ba6d-e77c-4cc3-9eb7-cc47b05873ac tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:18:08.808461 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-096a9946-5208-4a12-8419-784031fd97ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:08.814501 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-096a9946-5208-4a12-8419-784031fd97ee admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:08.816058 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-096a9946-5208-4a12-8419-784031fd97ee admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/fd4b4108-ffd7-4c01-a37b-aab9b3ebab62 HTTP/1.1" status: 204 len: 168 time: 0.7754722 Dec 09 21:18:08.841061 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-4432ba6d-e77c-4cc3-9eb7-cc47b05873ac tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:18:08.844656 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-394cbd6e-8713-471c-b7de-449d59e310ca req-803030ef-469d-47c3-8cf1-0ae591f43380 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=8a7c4077-25fa-451f-8052-c1f6ec25a13a HTTP/1.1" status: 200 len: 210 time: 0.1990795 Dec 09 21:18:08.861014 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-4e32fe91-7761-40a3-822d-96072c5589ea tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Made reservation on behalf of 10c237cbfa28423ea2d1df15f60193f2 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:18:08.877849 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-4e32fe91-7761-40a3-822d-96072c5589ea tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:08.982739 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8f5afbd8-31b0-450c-b25d-17c62e45da02 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:08.990245 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8f5afbd8-31b0-450c-b25d-17c62e45da02 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:08.998623 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8f5afbd8-31b0-450c-b25d-17c62e45da02 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/9a13cfc6-b5d9-4a7a-8c45-eb1ce7c4c582 HTTP/1.1" status: 204 len: 168 time: 1.0113780 Dec 09 21:18:09.005610 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-4e32fe91-7761-40a3-822d-96072c5589ea tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:09.006037 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-0eaab23f-cc72-4d24-8181-6fdc63b8aab7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:09.008969 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-0eaab23f-cc72-4d24-8181-6fdc63b8aab7 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.7651825 Dec 09 21:18:09.015233 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-4432ba6d-e77c-4cc3-9eb7-cc47b05873ac tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:09.016027 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-4432ba6d-e77c-4cc3-9eb7-cc47b05873ac tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:09.034991 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-096a9946-5208-4a12-8419-784031fd97ee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fd4b4108-ffd7-4c01-a37b-aab9b3ebab62,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:09.047304 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] Set router 70ade903-ee3e-4040-8855-b2a937f2a0d9 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:18:09.084332 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-deb3f56f-80c8-4770-9eee-84ebb7b4a299 req-979e61a4-c23f-4253-a510-f0cc1e596d00 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebcfc729-b616-4933-a43d-f707a862db78 HTTP/1.1" status: 200 len: 210 time: 0.1436303 Dec 09 21:18:09.173282 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dec2dbae-cdb2-43cd-a0be-93128292675e req-53103f54-cc30-40db-be54-5d912a410362 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 210 time: 0.1866941 Dec 09 21:18:09.257842 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-4432ba6d-e77c-4cc3-9eb7-cc47b05873ac tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 4.4550231 Dec 09 21:18:09.298848 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Request body: {'port': {'device_id': '51e11d39-964b-458f-b5dc-fb020eb2c5f5', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:09.336069 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f5afbd8-31b0-450c-b25d-17c62e45da02 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a13cfc6-b5d9-4a7a-8c45-eb1ce7c4c582,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:09.449470 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3bf9ac5-e9a2-47bc-b288-e6d7eae19b07 req-cf9aa629-e2cb-4cee-bd81-5e0576792222 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:09.459493 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b3bf9ac5-e9a2-47bc-b288-e6d7eae19b07 req-cf9aa629-e2cb-4cee-bd81-5e0576792222 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3c85c33-b0b5-4c62-8189-7ff917e062e6 HTTP/1.1" status: 200 len: 948 time: 0.2101402 Dec 09 21:18:09.463226 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-f86a15d8-c873-4d9a-adf6-fbbcb4c494d7 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4324765 Dec 09 21:18:09.543276 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fcf876f7-3631-463c-abd1-3128790c436d None None] Network 93378dc3-2ac5-4cf7-9ce3-d812934de40c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:18:09.567403 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-4e32fe91-7761-40a3-822d-96072c5589ea tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:09.636683 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:09.649862 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-4e32fe91-7761-40a3-822d-96072c5589ea tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:09.851675 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-10f86f73-6b1d-4683-8e47-871e073a4094 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:09.941099 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-10f86f73-6b1d-4683-8e47-871e073a4094 None None] For port 72070289-8347-44bd-bfb9-9510e94eb5bd, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=72070289-8347-44bd-bfb9-9510e94eb5bd,segment=NetworkSegment(c1e3b516-6ad9-46a2-acfa-cf795ad5b916),segment_id=c1e3b516-6ad9-46a2-acfa-cf795ad5b916)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:09.952142 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-10f86f73-6b1d-4683-8e47-871e073a4094 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:10.016624 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10f86f73-6b1d-4683-8e47-871e073a4094 None None] Pushing event updated for resources: {'Port': ['ID=72070289-8347-44bd-bfb9-9510e94eb5bd,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:10.044673 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:18:03Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '72070289-8347-44bd-bfb9-9510e94eb5bd', 'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'tenant_id': '920e0419877f4239b048e126682274e9', 'mac_address': 'fa:16:3e:c3:24:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 264, 'fixed_ips': [{'subnet_id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:18:00Z', 'updated_at': '2021-12-09T21:18:07Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'subnets': [{'id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:18:10.092117 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-788ac0a4-fb5c-4342-bd02-0a94818a733b None None] The sync data for ids ['70ade903-ee3e-4040-8855-b2a937f2a0d9'] in n-d-713301-27 is: [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:18:03Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '72070289-8347-44bd-bfb9-9510e94eb5bd', 'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'tenant_id': '920e0419877f4239b048e126682274e9', 'mac_address': 'fa:16:3e:c3:24:b8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 264, 'fixed_ips': [{'subnet_id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:18:00Z', 'updated_at': '2021-12-09T21:18:07Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'subnets': [{'id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:18:10.118738 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-51ee6a04-ad81-485c-989d-eae27c62e61b None None] Provisioning complete for port 72070289-8347-44bd-bfb9-9510e94eb5bd triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:10.119360 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-51ee6a04-ad81-485c-989d-eae27c62e61b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:10.230105 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55396) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:10.269523 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:10.306821 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-51ee6a04-ad81-485c-989d-eae27c62e61b None None] Provisioning complete for port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:10.307501 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-51ee6a04-ad81-485c-989d-eae27c62e61b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:10.365601 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-51ee6a04-ad81-485c-989d-eae27c62e61b None None] Port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:18:10.406667 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8556dbdd-171e-481c-b34f-a5af9a9291d2 req-3efaed6c-92b0-4c9f-b361-927eb732e378 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=8a7c4077-25fa-451f-8052-c1f6ec25a13a HTTP/1.1" status: 200 len: 210 time: 0.1581228 Dec 09 21:18:10.466681 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8941793a-5531-4069-bf94-8eff95a06e37 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:10.496124 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b3bf9ac5-e9a2-47bc-b288-e6d7eae19b07 req-8435e8e7-1088-4ae2-bf16-b8838dfb234e tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.0347188 Dec 09 21:18:10.565657 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55422) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:10.566343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.31', 57403) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:10.595612 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Request body: {'network': {'name': 'tempest-LiveAutoBlockMigrationV225Test-706619878-network', 'tenant_id': 'ada7369d6e1b4f41b54f8618cadde653'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:10.626390 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7b03bcbc-3969-4474-ba51-af27009e486c req-cd8797c6-d9db-4b98-b725-e97692f0bdf8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:10.658246 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e32fe91-7761-40a3-822d-96072c5589ea tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3997e1dc-b863-4862-a321-fb463bb4bb43,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:10.714199 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-967a1517-b92a-4b1a-8330-53be5ed4815e req-59fd4307-f5ee-4847-8396-04722c6d3871 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.1866672 Dec 09 21:18:10.729038 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7b03bcbc-3969-4474-ba51-af27009e486c req-cd8797c6-d9db-4b98-b725-e97692f0bdf8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:10.808324 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2122291f-1ec9-43f4-a252-87fe9079c9aa req-b462f581-3329-4ebc-9688-7b48cb86a00d tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebcfc729-b616-4933-a43d-f707a862db78 HTTP/1.1" status: 200 len: 210 time: 0.2257352 Dec 09 21:18:10.831089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2588b73-17b9-49b1-bcd6-509e7c6763aa req-b74cfe77-14f1-4108-84e5-e2ca039bc52b tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 210 time: 0.1920452 Dec 09 21:18:10.871748 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7b03bcbc-3969-4474-ba51-af27009e486c req-cd8797c6-d9db-4b98-b725-e97692f0bdf8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:18:10.895172 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-7b03bcbc-3969-4474-ba51-af27009e486c req-cd8797c6-d9db-4b98-b725-e97692f0bdf8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:18:10.921097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-7b03bcbc-3969-4474-ba51-af27009e486c req-cd8797c6-d9db-4b98-b725-e97692f0bdf8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:18:11.002926 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd8797c6-d9db-4b98-b725-e97692f0bdf8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Pushing event updated for resources: {'Port': ['ID=b75bad0f-5d42-4305-b970-f7b7298d2231,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:11.032248 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b03bcbc-3969-4474-ba51-af27009e486c req-cd8797c6-d9db-4b98-b725-e97692f0bdf8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:11.032925 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7b03bcbc-3969-4474-ba51-af27009e486c req-cd8797c6-d9db-4b98-b725-e97692f0bdf8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:11.035878 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Made reservation on behalf of ada7369d6e1b4f41b54f8618cadde653 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:18:11.039080 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:11.091801 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:11.138564 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7b03bcbc-3969-4474-ba51-af27009e486c req-cd8797c6-d9db-4b98-b725-e97692f0bdf8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 5.0303507 Dec 09 21:18:11.140393 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cee8d2d-68d8-46ad-8ec1-4f32d238967c req-4bcb1c24-b125-4fe8-af84-a99b319cb18a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:11.143087 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3cee8d2d-68d8-46ad-8ec1-4f32d238967c req-4bcb1c24-b125-4fe8-af84-a99b319cb18a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=97c6f11d72db4857afd32603bdfd0616&device_id=a3c85c33-b0b5-4c62-8189-7ff917e062e6 HTTP/1.1" status: 200 len: 1100 time: 0.2767794 Dec 09 21:18:11.201958 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-7b03bcbc-3969-4474-ba51-af27009e486c req-b3bd3b6e-3747-4765-9795-3b28da2d1c2d service neutron] Request body: {'port': {'device_id': 'ebcfc729-b616-4933-a43d-f707a862db78', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:11.204503 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-a3b6a486-dd28-4101-9213-1c8bc49b8b26 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:11.206732 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-a3b6a486-dd28-4101-9213-1c8bc49b8b26 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.31 "GET /v2.0/networks?id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 HTTP/1.1" status: 200 len: 821 time: 0.5965672 Dec 09 21:18:11.240326 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-af86e0be-ebd9-4b0f-88a4-c33e533fde50 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Request body: {'port': {'device_id': '17188b52-f615-49ca-8709-a3c9238c02fa', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'admin_state_up': True, 'tenant_id': '920e0419877f4239b048e126682274e9'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:11.298965 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1cc3b771-7d24-4dfa-bbfe-6e007094c74b {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:18:11.299761 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d01df554-127d-4c3c-a029-40f333906baa None None] Provisioning complete for port b75bad0f-5d42-4305-b970-f7b7298d2231 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:11.300524 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d01df554-127d-4c3c-a029-40f333906baa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:11.327629 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:11.353046 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d01df554-127d-4c3c-a029-40f333906baa None None] Port b75bad0f-5d42-4305-b970-f7b7298d2231 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:18:11.357576 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7b03bcbc-3969-4474-ba51-af27009e486c req-b3bd3b6e-3747-4765-9795-3b28da2d1c2d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:11.381882 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Transition to ACTIVE for port object 1cc3b771-7d24-4dfa-bbfe-6e007094c74b will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:18:11.391583 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.db.resource_extend [None req-5da050b7-68bb-4eca-b725-eda7caf625bb tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] It took 0.26 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 09 21:18:11.424208 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:11.462845 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cee8d2d-68d8-46ad-8ec1-4f32d238967c req-ce586deb-9061-437d-a4ca-84155594c925 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:11.465775 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3cee8d2d-68d8-46ad-8ec1-4f32d238967c req-ce586deb-9061-437d-a4ca-84155594c925 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.3092895 Dec 09 21:18:11.634992 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-af86e0be-ebd9-4b0f-88a4-c33e533fde50 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Made reservation on behalf of 920e0419877f4239b048e126682274e9 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:18:11.638592 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-af86e0be-ebd9-4b0f-88a4-c33e533fde50 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:11.664806 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8941793a-5531-4069-bf94-8eff95a06e37 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:11.670415 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5da050b7-68bb-4eca-b725-eda7caf625bb tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:11.698219 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 72070289-8347-44bd-bfb9-9510e94eb5bd up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:18:11.706724 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5da050b7-68bb-4eca-b725-eda7caf625bb tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:11.767962 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3cee8d2d-68d8-46ad-8ec1-4f32d238967c req-9cb8cc1d-188a-430b-93c6-15f6274db57f service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.220&port_id=3fd5c53a-dd51-40cb-9c92-d83aa47ab67a HTTP/1.1" status: 200 len: 217 time: 0.2582610 Dec 09 21:18:11.776831 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8941793a-5531-4069-bf94-8eff95a06e37 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:11.812943 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 72070289-8347-44bd-bfb9-9510e94eb5bd triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:11.813330 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:11.890360 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8941793a-5531-4069-bf94-8eff95a06e37 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ca6e7f5f0ab445b5aa7533cce8cb8fac&name=default HTTP/1.1" status: 200 len: 2996 time: 1.6590285 Dec 09 21:18:11.921811 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cee8d2d-68d8-46ad-8ec1-4f32d238967c req-8e476ad0-de3c-40bf-a963-a74266aa5642 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:11.923467 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3cee8d2d-68d8-46ad-8ec1-4f32d238967c req-8e476ad0-de3c-40bf-a963-a74266aa5642 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1291897 Dec 09 21:18:11.926052 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55450) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:11.944825 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Pushing event updated for resources: {'Port': ['ID=1cc3b771-7d24-4dfa-bbfe-6e007094c74b,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:11.945222 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-54e44bb1-f00f-461b-946b-286fcf4c33e0 req-f7332621-4ae6-47c0-8abf-be911fa0490c tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=8a7c4077-25fa-451f-8052-c1f6ec25a13a HTTP/1.1" status: 200 len: 210 time: 0.3164947 Dec 09 21:18:11.974766 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:12.019290 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-4e32fe91-7761-40a3-822d-96072c5589ea tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Allocated IP 192.168.233.80 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/8ea7a94c-568e-46ea-954a-d61e6f1f0b18) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:18:12.030642 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:12.031095 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:12.031475 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:12.031818 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:12.032160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:12.032500 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:12.032975 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:12.033311 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:12.033730 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:12.034072 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:12.034384 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:12.034787 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:12.035215 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:12.035545 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:12.088798 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8941793a-5531-4069-bf94-8eff95a06e37 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3a6a41e4-dc6d-4d3c-9071-423482c24eb8,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:12.105416 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] vlan segment allocate from pool success with {'vlan_id': 115, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:18:12.106293 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Attempting to bind port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:18:12.106633 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Attempting to bind port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:18:12.107074 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Attempting to bind port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:12.112469 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-5da050b7-68bb-4eca-b725-eda7caf625bb tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Floating IP 607e8ba4-01a4-4741-a885-8732f6aacd9f associated. External IP: 172.25.3.108, port: 7eb6e48f-08e3-409a-9551-0e38eb690c8b. Dec 09 21:18:12.119843 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:18:12.120205 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Attempting to bind port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:12.129606 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cee8d2d-68d8-46ad-8ec1-4f32d238967c req-e1ea7e82-ba13-4bde-9276-1ccafd397a7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:12.131641 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3cee8d2d-68d8-46ad-8ec1-4f32d238967c req-e1ea7e82-ba13-4bde-9276-1ccafd397a7b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1791663 Dec 09 21:18:12.138149 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8b51b490-5c7d-4c16-ae9f-93bcc3af468c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:12.139897 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 17, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:18:12.140233 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:18:12.140631 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:18:12.141076 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Bound port: 1cc3b771-7d24-4dfa-bbfe-6e007094c74b, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:18:12.141409 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:12.197320 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8b51b490-5c7d-4c16-ae9f-93bcc3af468c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:12.248418 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8de0311-9a46-47b9-a595-446ebde58fb8 req-b0f633ac-60e0-4f86-95f0-45d67948c608 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:12.249978 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c8de0311-9a46-47b9-a595-446ebde58fb8 req-b0f633ac-60e0-4f86-95f0-45d67948c608 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3c85c33-b0b5-4c62-8189-7ff917e062e6 HTTP/1.1" status: 200 len: 948 time: 0.5632522 Dec 09 21:18:12.254666 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:12.255042 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Added segment 0c28445d-dcad-44f8-a1e2-9f872bde8621 of type vlan for network a452c967-14e7-4e4f-b46b-3e0725f57191 Dec 09 21:18:12.282697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d65647dd-441a-4dbd-98af-9da25539b654,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:12.327899 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] For port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:18:12.331476 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] For port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1cc3b771-7d24-4dfa-bbfe-6e007094c74b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:18:12.334553 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3cee8d2d-68d8-46ad-8ec1-4f32d238967c req-8576c95f-dd1a-4dcd-9e76-8410159750b7 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1903021 Dec 09 21:18:12.342527 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:12.383167 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8b51b490-5c7d-4c16-ae9f-93bcc3af468c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:12.385827 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8b51b490-5c7d-4c16-ae9f-93bcc3af468c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:12.389625 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8b51b490-5c7d-4c16-ae9f-93bcc3af468c admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/3a6a41e4-dc6d-4d3c-9071-423482c24eb8 HTTP/1.1" status: 204 len: 168 time: 0.4472530 Dec 09 21:18:12.427806 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:12.428815 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:12.430793 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] 10.222.0.10 "PUT /v2.0/ports/1cc3b771-7d24-4dfa-bbfe-6e007094c74b HTTP/1.1" status: 200 len: 1097 time: 3.1361287 Dec 09 21:18:12.433717 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '51e11d39-964b-458f-b5dc-fb020eb2c5f5', 'tag': '1cc3b771-7d24-4dfa-bbfe-6e007094c74b'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:12.436121 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e41a66a3-cf11-4725-90e5-c60ae8343fed" -d '{"events": [{"name": "network-changed", "server_uuid": "51e11d39-964b-458f-b5dc-fb020eb2c5f5", "tag": "1cc3b771-7d24-4dfa-bbfe-6e007094c74b"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:12.452111 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b51b490-5c7d-4c16-ae9f-93bcc3af468c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3a6a41e4-dc6d-4d3c-9071-423482c24eb8,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:12.476013 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8763c1c-7670-450d-a174-b203f58c0699 service neutron] Pushing event updated for resources: {'Port': ['ID=1cc3b771-7d24-4dfa-bbfe-6e007094c74b,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:12.588784 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-cf23e8eb-0989-43fa-88bf-09f111949c64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:12.590542 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-cf23e8eb-0989-43fa-88bf-09f111949c64 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=6a32a636fa83452db185eb0152d6082d&device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 1100 time: 0.0736010 Dec 09 21:18:12.595871 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3cee8d2d-68d8-46ad-8ec1-4f32d238967c req-b18a452d-907a-4cba-ae92-06ac272e827c service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2505977 Dec 09 21:18:12.657737 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-be474cca-1ca3-4d8c-943a-46c490b89ab0 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.203&port_id=1cc3b771-7d24-4dfa-bbfe-6e007094c74b HTTP/1.1" status: 200 len: 217 time: 0.0579031 Dec 09 21:18:12.660719 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:12.663545 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-af86e0be-ebd9-4b0f-88a4-c33e533fde50 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Allocated IP 172.20.0.4 (eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3/3260fc19-8e10-46a2-82c6-3b2d5eda4a0e/b615e863-071a-473e-8d66-8f84f78d1453) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:18:12.674690 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5e8e668-8fed-4a8f-aa8f-670706ab7a14 req-fc835929-bae7-4d21-a0b6-2477f9fa9495 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:12.676485 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5e8e668-8fed-4a8f-aa8f-670706ab7a14 req-fc835929-bae7-4d21-a0b6-2477f9fa9495 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebcfc729-b616-4933-a43d-f707a862db78 HTTP/1.1" status: 200 len: 936 time: 0.6186063 Dec 09 21:18:12.732144 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-51a6461c-1165-4613-9f8c-2b8da571bdf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:12.734083 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-51a6461c-1165-4613-9f8c-2b8da571bdf3 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0702107 Dec 09 21:18:12.795309 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-5cc75aac-ab63-42f5-a5f9-9d6ca81c6843 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:12.798862 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-5cc75aac-ab63-42f5-a5f9-9d6ca81c6843 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0579503 Dec 09 21:18:12.862216 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c8de0311-9a46-47b9-a595-446ebde58fb8 req-c21d5122-981b-4a14-b48e-01bbd0908b92 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5821712 Dec 09 21:18:12.870135 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:12.871111 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:12.871776 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:12.907971 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-e1c3afaa-ce9f-4608-b2ae-f20404ad90fc service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1009364 Dec 09 21:18:13.018216 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5e8e668-8fed-4a8f-aa8f-670706ab7a14 req-451f2156-0031-4f62-b7b0-1bdd7feee1b2 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3223612 Dec 09 21:18:13.030993 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4a6fb741-0910-44c3-a8fa-ea82286b2ac2 req-ad93e227-6ece-4d06-a7ef-496f6b30a43a service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1165638 Dec 09 21:18:13.052726 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 893 time: 2.4599345 Dec 09 21:18:13.054461 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55482) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:13.061376 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b2f0bdf9-0113-4b29-98b9-4c01039c13af admin admin] Request body: {'subnet': {'network_id': 'a452c967-14e7-4e4f-b46b-3e0725f57191', 'cidr': '172.20.0.0/28', 'name': 'tempest-LiveAutoBlockMigrationV225Test-706619878-subnet', 'tenant_id': 'ada7369d6e1b4f41b54f8618cadde653', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:13.071997 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a46dc49d-b613-49bb-a562-b08de96adefb req-3f1aa96e-9387-4da5-83d6-e8be966e2e9a tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 210 time: 0.0999384 Dec 09 21:18:13.097577 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-14c73567-3af5-49f0-bb5c-d74ecc3a1665 x-openstack-request-id: req-14c73567-3af5-49f0-bb5c-d74ecc3a1665 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:13.098006 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "51e11d39-964b-458f-b5dc-fb020eb2c5f5", "tag": "1cc3b771-7d24-4dfa-bbfe-6e007094c74b", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:13.098355 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-14c73567-3af5-49f0-bb5c-d74ecc3a1665 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:13.098761 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '51e11d39-964b-458f-b5dc-fb020eb2c5f5', 'tag': '1cc3b771-7d24-4dfa-bbfe-6e007094c74b', 'status': 'completed', 'code': 200} Dec 09 21:18:13.184605 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b2f0bdf9-0113-4b29-98b9-4c01039c13af admin admin] Made reservation on behalf of ada7369d6e1b4f41b54f8618cadde653 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:18:13.187294 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b2f0bdf9-0113-4b29-98b9-4c01039c13af admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:13.206731 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Pushing event updated for resources: {'Network': ['ID=a452c967-14e7-4e4f-b46b-3e0725f57191,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:13.250967 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-4e32fe91-7761-40a3-822d-96072c5589ea tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:13.260916 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b4ca67ee-a161-4d01-ae6c-f79251385875 req-80f816a6-445a-4b99-80e0-ab88e8570a64 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=8a7c4077-25fa-451f-8052-c1f6ec25a13a HTTP/1.1" status: 200 len: 210 time: 0.0612404 Dec 09 21:18:13.274964 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:13.275299 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:13.275820 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:13.276164 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:13.276496 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e41a66a3-cf11-4725-90e5-c60ae8343fed req-f964e7e8-87bd-4a2a-8818-8c4fcbc462cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:13.276611 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:13.276949 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:13.277352 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:13.277755 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:13.278071 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:13.278285 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e41a66a3-cf11-4725-90e5-c60ae8343fed req-f964e7e8-87bd-4a2a-8818-8c4fcbc462cd service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=6a32a636fa83452db185eb0152d6082d&device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 1100 time: 0.1546142 Dec 09 21:18:13.278464 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:13.278746 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:13.279479 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:13.279815 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cef7a004-730f-4692-b9b1-3282ffffa0e5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:13.309328 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network a452c967-14e7-4e4f-b46b-3e0725f57191 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:18:13.333919 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5da050b7-68bb-4eca-b725-eda7caf625bb tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Router 3b833388-9a85-4de2-9ce7-fd22b400c313 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:18:13.387419 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-af86e0be-ebd9-4b0f-88a4-c33e533fde50 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:13.536475 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5da050b7-68bb-4eca-b725-eda7caf625bb tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:18:13.558700 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5210f49-1c6e-4ac4-a44b-4c64af7d070f None None] Sync routers for ids ['3b833388-9a85-4de2-9ce7-fd22b400c313'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:18:13.559289 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5da050b7-68bb-4eca-b725-eda7caf625bb tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:13.573783 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5210f49-1c6e-4ac4-a44b-4c64af7d070f None None] Routers {'3b833388-9a85-4de2-9ce7-fd22b400c313'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:18:13.574800 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c5210f49-1c6e-4ac4-a44b-4c64af7d070f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:18:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3b833388-9a85-4de2-9ce7-fd22b400c313'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:18:13.682707 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:18:13.693166 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5da050b7-68bb-4eca-b725-eda7caf625bb tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "PUT /v2.0/floatingips/607e8ba4-01a4-4741-a885-8732f6aacd9f HTTP/1.1" status: 200 len: 992 time: 5.1563237 Dec 09 21:18:13.693166 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-4e32fe91-7761-40a3-822d-96072c5589ea tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:13.717831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2c85b8fc-41be-4975-88fd-db5bc87f1f89', 'tag': '7eb6e48f-08e3-409a-9551-0e38eb690c8b'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:13.787518 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-c5210f49-1c6e-4ac4-a44b-4c64af7d070f None None] Set router 3b833388-9a85-4de2-9ce7-fd22b400c313 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:18:13.802977 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e41a66a3-cf11-4725-90e5-c60ae8343fed req-32c544fb-3fcd-40e7-897d-89eb00407f55 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:13.804864 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e41a66a3-cf11-4725-90e5-c60ae8343fed req-32c544fb-3fcd-40e7-897d-89eb00407f55 service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.4958739 Dec 09 21:18:13.902098 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=3fd5c53a-dd51-40cb-9c92-d83aa47ab67a,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:13.917944 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '3fd5c53a-dd51-40cb-9c92-d83aa47ab67a', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '3fd5c53a-dd51-40cb-9c92-d83aa47ab67a', 'mac_address': 'fa:16:3e:c6:fb:6f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.220'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:18:13.944572 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-4e32fe91-7761-40a3-822d-96072c5589ea tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:18:13.953362 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-4e32fe91-7761-40a3-822d-96072c5589ea tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:18:13.960397 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-af86e0be-ebd9-4b0f-88a4-c33e533fde50 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:13.962346 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-4e32fe91-7761-40a3-822d-96072c5589ea tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:18:13.967246 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e32fe91-7761-40a3-822d-96072c5589ea tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Pushing event updated for resources: {'Port': ['ID=8ea7a94c-568e-46ea-954a-d61e6f1f0b18,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:13.984116 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e41a66a3-cf11-4725-90e5-c60ae8343fed req-e5ba3589-3d07-4709-aa18-f00d95406f55 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.203&port_id=1cc3b771-7d24-4dfa-bbfe-6e007094c74b HTTP/1.1" status: 200 len: 217 time: 0.1252592 Dec 09 21:18:14.041601 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b2f0bdf9-0113-4b29-98b9-4c01039c13af admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:14.063401 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:14.078957 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:18:14.114991 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=3fd5c53a-dd51-40cb-9c92-d83aa47ab67a,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:14.131770 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:14.232865 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d89eeb5e-b0db-4278-a063-db0d9f710e28" -d '{"events": [{"name": "network-changed", "server_uuid": "2c85b8fc-41be-4975-88fd-db5bc87f1f89", "tag": "7eb6e48f-08e3-409a-9551-0e38eb690c8b"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:14.248650 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=3fd5c53a-dd51-40cb-9c92-d83aa47ab67a,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:14.249687 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-af86e0be-ebd9-4b0f-88a4-c33e533fde50 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Network eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:18:14.257043 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:14.257393 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:14.257736 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:14.258075 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:14.258407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:14.258735 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:14.259064 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:14.259388 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:14.259741 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:14.260123 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:14.260452 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:14.260811 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:14.261136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:18:14.282016 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-7b03bcbc-3969-4474-ba51-af27009e486c req-b3bd3b6e-3747-4765-9795-3b28da2d1c2d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b75bad0f-5d42-4305-b970-f7b7298d2231 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:18:14.284775 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af86e0be-ebd9-4b0f-88a4-c33e533fde50 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Pushing event updated for resources: {'Port': ['ID=b615e863-071a-473e-8d66-8f84f78d1453,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:14.293087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-af86e0be-ebd9-4b0f-88a4-c33e533fde50 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:18:14.293663 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7b03bcbc-3969-4474-ba51-af27009e486c req-b3bd3b6e-3747-4765-9795-3b28da2d1c2d service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:14.312452 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-7b03bcbc-3969-4474-ba51-af27009e486c req-b3bd3b6e-3747-4765-9795-3b28da2d1c2d service neutron] Transition to ACTIVE for port object b75bad0f-5d42-4305-b970-f7b7298d2231 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:18:14.314798 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-af86e0be-ebd9-4b0f-88a4-c33e533fde50 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:18:14.345227 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-4e32fe91-7761-40a3-822d-96072c5589ea tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:14.345882 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-4e32fe91-7761-40a3-822d-96072c5589ea tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:14.347155 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['3fd5c53a-dd51-40cb-9c92-d83aa47ab67a'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:18:14.366492 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c5210f49-1c6e-4ac4-a44b-4c64af7d070f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-85948487-router', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54'}], 'enable_snat': True}, 'gw_port_id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:12Z', 'updated_at': '2021-12-09T21:17:16Z', 'revision_number': 4, 'project_id': '615039519ef147c78eb38a1d65eac061', 'gw_port': {'id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:32:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:13Z', 'updated_at': '2021-12-09T21:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '607e8ba4-01a4-4741-a885-8732f6aacd9f', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'floating_ip_address': '172.25.3.108', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'port_id': '7eb6e48f-08e3-409a-9551-0e38eb690c8b', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 112, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'mac_address': 'fa:16:3e:9b:8e:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c85b8fc-41be-4975-88fd-db5bc87f1f89', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:17:30Z', 'updated_at': '2021-12-09T21:18:11Z', 'revision_number': 1, 'project_id': '615039519ef147c78eb38a1d65eac061', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f50209a6-36fd-4aea-927f-b79127351066', 'name': '', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'mac_address': 'fa:16:3e:bd:0e:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:15Z', 'updated_at': '2021-12-09T21:17:21Z', 'revision_number': 5, 'project_id': '615039519ef147c78eb38a1d65eac061', 'subnets': [{'id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:18:14.377150 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2f0bdf9-0113-4b29-98b9-4c01039c13af admin admin] Pushing event updated for resources: {'Subnet': ['ID=c6773439-6107-49a5-bc79-36ef3bb69ebe,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:14.395568 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7b03bcbc-3969-4474-ba51-af27009e486c req-b3bd3b6e-3747-4765-9795-3b28da2d1c2d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:14.414968 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5210f49-1c6e-4ac4-a44b-4c64af7d070f None None] Checking router: 3b833388-9a85-4de2-9ce7-fd22b400c313 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:18:14.424155 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5210f49-1c6e-4ac4-a44b-4c64af7d070f None None] Routers {'3b833388-9a85-4de2-9ce7-fd22b400c313'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:18:14.425013 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c5210f49-1c6e-4ac4-a44b-4c64af7d070f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:18:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3b833388-9a85-4de2-9ce7-fd22b400c313'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:18:14.451351 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e26e5c75-cf89-49e5-b772-bbde6aca740c req-a3cfb754-2598-4a10-a35b-8f718f0f7384 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:14.460605 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e26e5c75-cf89-49e5-b772-bbde6aca740c req-a3cfb754-2598-4a10-a35b-8f718f0f7384 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebcfc729-b616-4933-a43d-f707a862db78 HTTP/1.1" status: 200 len: 936 time: 0.2095346 Dec 09 21:18:14.465336 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-4e32fe91-7761-40a3-822d-96072c5589ea tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 6.2374203 Dec 09 21:18:14.498225 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-758aa06a-68d7-405c-9fe4-63d650211225 req-7ef424a7-710d-4cea-b76a-fcbc0e7ebc0a tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:14.507053 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-758aa06a-68d7-405c-9fe4-63d650211225 req-7ef424a7-710d-4cea-b76a-fcbc0e7ebc0a tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3c85c33-b0b5-4c62-8189-7ff917e062e6 HTTP/1.1" status: 200 len: 949 time: 0.4322083 Dec 09 21:18:14.520643 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-af86e0be-ebd9-4b0f-88a4-c33e533fde50 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:14.521510 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-af86e0be-ebd9-4b0f-88a4-c33e533fde50 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:14.523302 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-21cd42ff-ccc4-44c1-9641-bdd62a43aa6c None None] Provisioning complete for port 8ea7a94c-568e-46ea-954a-d61e6f1f0b18 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:14.523706 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-21cd42ff-ccc4-44c1-9641-bdd62a43aa6c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:14.541338 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-533ac5d6-c279-4229-8908-9059cf36cbd9 service neutron] Request body: {'port': {'device_id': '8a7c4077-25fa-451f-8052-c1f6ec25a13a', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:14.542081 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3bd3b6e-3747-4765-9795-3b28da2d1c2d service neutron] Pushing event updated for resources: {'Port': ['ID=b75bad0f-5d42-4305-b970-f7b7298d2231,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:14.552428 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-c5210f49-1c6e-4ac4-a44b-4c64af7d070f None None] Set router 3b833388-9a85-4de2-9ce7-fd22b400c313 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:18:14.581425 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-af86e0be-ebd9-4b0f-88a4-c33e533fde50 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.3529980 Dec 09 21:18:14.630614 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e41a66a3-cf11-4725-90e5-c60ae8343fed req-9f1be05b-39d2-4b70-a740-0ec20ad28d4c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:14.632207 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e41a66a3-cf11-4725-90e5-c60ae8343fed req-9f1be05b-39d2-4b70-a740-0ec20ad28d4c service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.6295433 Dec 09 21:18:14.640477 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-705bf337-03e4-4212-add9-47049c3860e7 service neutron] Request body: {'port': {'device_id': '17188b52-f615-49ca-8709-a3c9238c02fa', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:14.659324 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2f0bdf9-0113-4b29-98b9-4c01039c13af admin admin] Checking segment: {'id': '0c28445d-dcad-44f8-a1e2-9f872bde8621', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'a452c967-14e7-4e4f-b46b-3e0725f57191'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:18:14.659736 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2f0bdf9-0113-4b29-98b9-4c01039c13af admin admin] Network hostable DHCP agents. Network: a452c967-14e7-4e4f-b46b-3e0725f57191, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:18:14.727175 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e26e5c75-cf89-49e5-b772-bbde6aca740c req-b06b38bb-845e-4486-91e1-dd030d5551f7 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2649901 Dec 09 21:18:14.769711 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-7b03bcbc-3969-4474-ba51-af27009e486c req-b3bd3b6e-3747-4765-9795-3b28da2d1c2d service neutron] Attempting to bind port b75bad0f-5d42-4305-b970-f7b7298d2231 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:18:14.770060 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-7b03bcbc-3969-4474-ba51-af27009e486c req-b3bd3b6e-3747-4765-9795-3b28da2d1c2d service neutron] Attempting to bind port b75bad0f-5d42-4305-b970-f7b7298d2231 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:18:14.770439 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7b03bcbc-3969-4474-ba51-af27009e486c req-b3bd3b6e-3747-4765-9795-3b28da2d1c2d service neutron] Attempting to bind port b75bad0f-5d42-4305-b970-f7b7298d2231 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:14.794908 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7b03bcbc-3969-4474-ba51-af27009e486c req-b3bd3b6e-3747-4765-9795-3b28da2d1c2d service neutron] Port b75bad0f-5d42-4305-b970-f7b7298d2231 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:18:14.797627 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7b03bcbc-3969-4474-ba51-af27009e486c req-b3bd3b6e-3747-4765-9795-3b28da2d1c2d service neutron] Attempting to bind port b75bad0f-5d42-4305-b970-f7b7298d2231 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:14.804378 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-758aa06a-68d7-405c-9fe4-63d650211225 req-e66c74e7-0ff8-479a-8505-5c9468f2b6d5 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2815280 Dec 09 21:18:14.806263 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-21cd42ff-ccc4-44c1-9641-bdd62a43aa6c None None] Port 8ea7a94c-568e-46ea-954a-d61e6f1f0b18 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:18:14.812876 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2f0bdf9-0113-4b29-98b9-4c01039c13af admin admin] Network a452c967-14e7-4e4f-b46b-3e0725f57191 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:18:14.834181 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e41a66a3-cf11-4725-90e5-c60ae8343fed req-18e79c01-1661-4edb-994c-1ba7790a9cd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:14.835764 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e41a66a3-cf11-4725-90e5-c60ae8343fed req-18e79c01-1661-4edb-994c-1ba7790a9cd0 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1696000 Dec 09 21:18:14.837035 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7b03bcbc-3969-4474-ba51-af27009e486c req-b3bd3b6e-3747-4765-9795-3b28da2d1c2d service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 17, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:18:14.837481 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7b03bcbc-3969-4474-ba51-af27009e486c req-b3bd3b6e-3747-4765-9795-3b28da2d1c2d service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:18:14.837870 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7b03bcbc-3969-4474-ba51-af27009e486c req-b3bd3b6e-3747-4765-9795-3b28da2d1c2d service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:18:14.838365 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-7b03bcbc-3969-4474-ba51-af27009e486c req-b3bd3b6e-3747-4765-9795-3b28da2d1c2d service neutron] Bound port: b75bad0f-5d42-4305-b970-f7b7298d2231, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:18:14.838734 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7b03bcbc-3969-4474-ba51-af27009e486c req-b3bd3b6e-3747-4765-9795-3b28da2d1c2d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:14.843111 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-b2f0bdf9-0113-4b29-98b9-4c01039c13af admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, a452c967-14e7-4e4f-b46b-3e0725f57191) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:18:14.856288 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea475a58-7d9d-4738-bb36-427db2e09f20 None None] Network a452c967-14e7-4e4f-b46b-3e0725f57191 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:18:14.868328 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2f0bdf9-0113-4b29-98b9-4c01039c13af admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:14.868778 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b2f0bdf9-0113-4b29-98b9-4c01039c13af admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:14.873720 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c5210f49-1c6e-4ac4-a44b-4c64af7d070f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-85948487-router', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54'}], 'enable_snat': True}, 'gw_port_id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:12Z', 'updated_at': '2021-12-09T21:17:16Z', 'revision_number': 4, 'project_id': '615039519ef147c78eb38a1d65eac061', 'gw_port': {'id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:32:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:13Z', 'updated_at': '2021-12-09T21:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '607e8ba4-01a4-4741-a885-8732f6aacd9f', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'floating_ip_address': '172.25.3.108', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'port_id': '7eb6e48f-08e3-409a-9551-0e38eb690c8b', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 112, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'mac_address': 'fa:16:3e:9b:8e:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c85b8fc-41be-4975-88fd-db5bc87f1f89', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:17:30Z', 'updated_at': '2021-12-09T21:18:11Z', 'revision_number': 1, 'project_id': '615039519ef147c78eb38a1d65eac061', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f50209a6-36fd-4aea-927f-b79127351066', 'name': '', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'mac_address': 'fa:16:3e:bd:0e:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:15Z', 'updated_at': '2021-12-09T21:17:21Z', 'revision_number': 5, 'project_id': '615039519ef147c78eb38a1d65eac061', 'subnets': [{'id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:18:14.895240 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-533ac5d6-c279-4229-8908-9059cf36cbd9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:14.924558 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5210f49-1c6e-4ac4-a44b-4c64af7d070f None None] The sync data for ids ['3b833388-9a85-4de2-9ce7-fd22b400c313'] in n-d-713301-27 is: [{'id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-85948487-router', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54'}], 'enable_snat': True}, 'gw_port_id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:12Z', 'updated_at': '2021-12-09T21:17:16Z', 'revision_number': 4, 'project_id': '615039519ef147c78eb38a1d65eac061', 'gw_port': {'id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:32:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:13Z', 'updated_at': '2021-12-09T21:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '607e8ba4-01a4-4741-a885-8732f6aacd9f', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'floating_ip_address': '172.25.3.108', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'port_id': '7eb6e48f-08e3-409a-9551-0e38eb690c8b', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 112, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'mac_address': 'fa:16:3e:9b:8e:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c85b8fc-41be-4975-88fd-db5bc87f1f89', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:17:30Z', 'updated_at': '2021-12-09T21:18:11Z', 'revision_number': 1, 'project_id': '615039519ef147c78eb38a1d65eac061', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f50209a6-36fd-4aea-927f-b79127351066', 'name': '', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'mac_address': 'fa:16:3e:bd:0e:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:15Z', 'updated_at': '2021-12-09T21:17:21Z', 'revision_number': 5, 'project_id': '615039519ef147c78eb38a1d65eac061', 'subnets': [{'id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:18:14.968900 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-705bf337-03e4-4212-add9-47049c3860e7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:15.036743 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6334805a-d56c-4902-b4cc-0540ed9710dd None None] Provisioning complete for port b615e863-071a-473e-8d66-8f84f78d1453 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:15.037114 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6334805a-d56c-4902-b4cc-0540ed9710dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:15.038157 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b2f0bdf9-0113-4b29-98b9-4c01039c13af admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 857 time: 1.9780011 Dec 09 21:18:15.060450 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09b14554-8fc3-487d-8e77-b62f062deb7a req-e886d48e-31e8-47b1-a8ad-e460765a0d77 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:15.069551 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09b14554-8fc3-487d-8e77-b62f062deb7a req-e886d48e-31e8-47b1-a8ad-e460765a0d77 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 931 time: 0.1945636 Dec 09 21:18:15.081483 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-6334805a-d56c-4902-b4cc-0540ed9710dd None None] Port b615e863-071a-473e-8d66-8f84f78d1453 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:18:15.110774 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-7b03bcbc-3969-4474-ba51-af27009e486c req-b3bd3b6e-3747-4765-9795-3b28da2d1c2d service neutron] For port b75bad0f-5d42-4305-b970-f7b7298d2231, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:18:15.113100 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87c1ce24-5a9a-480f-a8aa-c0c2f3add618 None None] Network a452c967-14e7-4e4f-b46b-3e0725f57191 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:18:15.117038 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-7b03bcbc-3969-4474-ba51-af27009e486c req-b3bd3b6e-3747-4765-9795-3b28da2d1c2d service neutron] For port b75bad0f-5d42-4305-b970-f7b7298d2231, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b75bad0f-5d42-4305-b970-f7b7298d2231,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:18:15.121491 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e41a66a3-cf11-4725-90e5-c60ae8343fed req-d85a203d-d573-4f28-b685-6be5d872a76d service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2759938 Dec 09 21:18:15.126010 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7b03bcbc-3969-4474-ba51-af27009e486c req-b3bd3b6e-3747-4765-9795-3b28da2d1c2d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:15.189323 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3bd3b6e-3747-4765-9795-3b28da2d1c2d service neutron] Pushing event updated for resources: {'Port': ['ID=b75bad0f-5d42-4305-b970-f7b7298d2231,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:15.281669 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b03bcbc-3969-4474-ba51-af27009e486c req-b3bd3b6e-3747-4765-9795-3b28da2d1c2d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:15.282717 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7b03bcbc-3969-4474-ba51-af27009e486c req-b3bd3b6e-3747-4765-9795-3b28da2d1c2d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:15.284553 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7b03bcbc-3969-4474-ba51-af27009e486c req-b3bd3b6e-3747-4765-9795-3b28da2d1c2d service neutron] 10.222.0.31 "PUT /v2.0/ports/b75bad0f-5d42-4305-b970-f7b7298d2231 HTTP/1.1" status: 200 len: 1097 time: 4.1280556 Dec 09 21:18:15.285226 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ebcfc729-b616-4933-a43d-f707a862db78', 'tag': 'b75bad0f-5d42-4305-b970-f7b7298d2231'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:15.288709 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cd086c39-a2a8-4ab4-a19e-e2fb4207f984" -d '{"events": [{"name": "network-changed", "server_uuid": "ebcfc729-b616-4933-a43d-f707a862db78", "tag": "b75bad0f-5d42-4305-b970-f7b7298d2231"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:15.459249 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b03bcbc-3969-4474-ba51-af27009e486c req-51f97abf-23d8-4189-a667-351a7cff60de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:15.460815 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7b03bcbc-3969-4474-ba51-af27009e486c req-51f97abf-23d8-4189-a667-351a7cff60de service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6a32a636fa83452db185eb0152d6082d&device_id=ebcfc729-b616-4933-a43d-f707a862db78 HTTP/1.1" status: 200 len: 1100 time: 0.0919502 Dec 09 21:18:15.463095 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e41a66a3-cf11-4725-90e5-c60ae8343fed req-8fd607c1-e909-4fb8-ad23-4d785fe56905 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2761827 Dec 09 21:18:15.473237 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09b14554-8fc3-487d-8e77-b62f062deb7a req-5f3a7b3b-93d1-4cba-bdf4-44b2bfcf2055 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/security-groups?id=174c6f0d-c012-4077-858c-aa2b94e54d38&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3972380 Dec 09 21:18:15.523762 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fd1d856e-c203-4b8e-8f6e-38232bc0d035 x-openstack-request-id: req-fd1d856e-c203-4b8e-8f6e-38232bc0d035 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:15.524061 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2c85b8fc-41be-4975-88fd-db5bc87f1f89", "tag": "7eb6e48f-08e3-409a-9551-0e38eb690c8b", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:15.524316 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-fd1d856e-c203-4b8e-8f6e-38232bc0d035 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:15.524794 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2c85b8fc-41be-4975-88fd-db5bc87f1f89', 'tag': '7eb6e48f-08e3-409a-9551-0e38eb690c8b', 'status': 'completed', 'code': 200} Dec 09 21:18:15.528157 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7b03bcbc-3969-4474-ba51-af27009e486c req-731097fe-7c0c-4ad7-9b4e-c12d5a7a5d88 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.144&port_id=b75bad0f-5d42-4305-b970-f7b7298d2231 HTTP/1.1" status: 200 len: 217 time: 0.0584111 Dec 09 21:18:15.557809 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1261bc6e-8320-44cd-bd54-5fc864ca050f None None] New status for floating IP 607e8ba4-01a4-4741-a885-8732f6aacd9f: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:18:15.628556 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b03bcbc-3969-4474-ba51-af27009e486c req-3828cb38-c0fd-4387-8bb6-83bd576375ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:15.630693 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7b03bcbc-3969-4474-ba51-af27009e486c req-3828cb38-c0fd-4387-8bb6-83bd576375ba service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0944176 Dec 09 21:18:15.682282 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d89eeb5e-b0db-4278-a063-db0d9f710e28 req-86465f8f-a52e-411a-aaae-00694161e93a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:15.683991 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d89eeb5e-b0db-4278-a063-db0d9f710e28 req-86465f8f-a52e-411a-aaae-00694161e93a service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=615039519ef147c78eb38a1d65eac061&device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 1098 time: 0.1349778 Dec 09 21:18:15.718970 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b03bcbc-3969-4474-ba51-af27009e486c req-3780883a-d7fc-4655-83d0-b1641fa90ed0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:15.719476 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7b03bcbc-3969-4474-ba51-af27009e486c req-3780883a-d7fc-4655-83d0-b1641fa90ed0 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0797884 Dec 09 21:18:15.829262 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:18:15.829925 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7b03bcbc-3969-4474-ba51-af27009e486c req-1f938063-0d15-478b-b94f-206da6175ea7 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0965490 Dec 09 21:18:15.831413 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-00db6d4a-4050-4c35-a37e-8f5c1e49932f x-openstack-request-id: req-00db6d4a-4050-4c35-a37e-8f5c1e49932f {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:15.831722 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ebcfc729-b616-4933-a43d-f707a862db78", "tag": "b75bad0f-5d42-4305-b970-f7b7298d2231", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:15.832148 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-00db6d4a-4050-4c35-a37e-8f5c1e49932f {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:15.833128 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ebcfc729-b616-4933-a43d-f707a862db78', 'tag': 'b75bad0f-5d42-4305-b970-f7b7298d2231', 'status': 'completed', 'code': 200} Dec 09 21:18:15.833422 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1cc3b771-7d24-4dfa-bbfe-6e007094c74b details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:18:15.970523 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d89eeb5e-b0db-4278-a063-db0d9f710e28 req-9711920a-dbdd-42fa-8ce8-544237efbce4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:15.972420 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d89eeb5e-b0db-4278-a063-db0d9f710e28 req-9711920a-dbdd-42fa-8ce8-544237efbce4 service neutron] 10.222.0.10 "GET /v2.0/networks?id=ce6b6bd1-6a60-4cea-9b70-69fd0290796c HTTP/1.1" status: 200 len: 923 time: 0.2778587 Dec 09 21:18:15.986528 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:18:15.997261 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:15.997662 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:16.045480 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7b03bcbc-3969-4474-ba51-af27009e486c req-e573f703-8d1b-42c9-beb4-fc48e4d74ab6 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1819546 Dec 09 21:18:16.061408 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1cc3b771-7d24-4dfa-bbfe-6e007094c74b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:16.084706 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '1cc3b771-7d24-4dfa-bbfe-6e007094c74b', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '1cc3b771-7d24-4dfa-bbfe-6e007094c74b', 'mac_address': 'fa:16:3e:33:8a:7c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.203'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:18:16.096321 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dc5358d-d36b-4f84-840b-f2f844196596 req-cb66b05e-cc39-4799-89c6-1ad6631537b7 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:16.097926 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6dc5358d-d36b-4f84-840b-f2f844196596 req-cb66b05e-cc39-4799-89c6-1ad6631537b7 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=8a7c4077-25fa-451f-8052-c1f6ec25a13a HTTP/1.1" status: 200 len: 935 time: 0.5047259 Dec 09 21:18:16.121006 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d89eeb5e-b0db-4278-a063-db0d9f710e28 req-a4eb5c06-613a-43f2-af3d-042ae30bbc36 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=7eb6e48f-08e3-409a-9551-0e38eb690c8b HTTP/1.1" status: 200 len: 1002 time: 0.1384029 Dec 09 21:18:16.153810 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:16.167529 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:16.188664 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d89eeb5e-b0db-4278-a063-db0d9f710e28 req-2cf1988d-6b7b-4904-b01e-60d49b4995a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:16.191161 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d89eeb5e-b0db-4278-a063-db0d9f710e28 req-2cf1988d-6b7b-4904-b01e-60d49b4995a0 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9755e5ea-99a7-4073-8693-293dcc00b929 HTTP/1.1" status: 200 len: 861 time: 0.0515981 Dec 09 21:18:16.193208 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a3c85c33-b0b5-4c62-8189-7ff917e062e6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3fd5c53a-dd51-40cb-9c92-d83aa47ab67a'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:16.195874 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-def4454e-955b-42b2-a9bd-fa5f965bb805" -d '{"events": [{"server_uuid": "a3c85c33-b0b5-4c62-8189-7ff917e062e6", "name": "network-vif-plugged", "status": "completed", "tag": "3fd5c53a-dd51-40cb-9c92-d83aa47ab67a"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:16.201482 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1cc3b771-7d24-4dfa-bbfe-6e007094c74b {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:18:16.221448 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=3fd5c53a-dd51-40cb-9c92-d83aa47ab67a,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:16.228923 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:16.231858 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1cc3b771-7d24-4dfa-bbfe-6e007094c74b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:16.238873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd086c39-a2a8-4ab4-a19e-e2fb4207f984 req-26c7ec18-e307-4417-a3cc-676fe39cd78f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:16.240472 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cd086c39-a2a8-4ab4-a19e-e2fb4207f984 req-26c7ec18-e307-4417-a3cc-676fe39cd78f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6a32a636fa83452db185eb0152d6082d&device_id=ebcfc729-b616-4933-a43d-f707a862db78 HTTP/1.1" status: 200 len: 1100 time: 0.1295493 Dec 09 21:18:16.258484 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:16.270409 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-533ac5d6-c279-4229-8908-9059cf36cbd9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8ea7a94c-568e-46ea-954a-d61e6f1f0b18 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:18:16.279564 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d89eeb5e-b0db-4278-a063-db0d9f710e28 req-f88adf86-ba58-42db-ac19-aa50de436063 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:16.281228 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d89eeb5e-b0db-4278-a063-db0d9f710e28 req-f88adf86-ba58-42db-ac19-aa50de436063 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=ce6b6bd1-6a60-4cea-9b70-69fd0290796c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0807574 Dec 09 21:18:16.286781 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=3fd5c53a-dd51-40cb-9c92-d83aa47ab67a,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:16.292305 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-533ac5d6-c279-4229-8908-9059cf36cbd9 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:16.335806 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=1cc3b771-7d24-4dfa-bbfe-6e007094c74b,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:16.337723 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-71fa5b3e-3f7e-433d-b5f4-6fae688646e4 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:16.340293 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-71fa5b3e-3f7e-433d-b5f4-6fae688646e4 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 821 time: 0.3117037 Dec 09 21:18:16.342937 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-705bf337-03e4-4212-add9-47049c3860e7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b615e863-071a-473e-8d66-8f84f78d1453 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:18:16.349505 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-533ac5d6-c279-4229-8908-9059cf36cbd9 service neutron] Transition to ACTIVE for port object 8ea7a94c-568e-46ea-954a-d61e6f1f0b18 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:18:16.354028 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6dc5358d-d36b-4f84-840b-f2f844196596 req-3ba74bf5-af23-4314-b0de-f210ab56fc9a tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2367620 Dec 09 21:18:16.361051 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-705bf337-03e4-4212-add9-47049c3860e7 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:16.364271 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-533ac5d6-c279-4229-8908-9059cf36cbd9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:16.413730 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-858acdc8-dc9b-472e-87cd-0bc020a7f794 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/quotas/a306d2242b1e41c892f63c7b122cdee4 HTTP/1.1" status: 200 len: 375 time: 0.0549600 Dec 09 21:18:16.424662 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd086c39-a2a8-4ab4-a19e-e2fb4207f984 req-30496bc7-fe8d-48c5-975b-fe97a68457e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:16.424774 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-705bf337-03e4-4212-add9-47049c3860e7 service neutron] Transition to ACTIVE for port object b615e863-071a-473e-8d66-8f84f78d1453 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:18:16.426461 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cd086c39-a2a8-4ab4-a19e-e2fb4207f984 req-30496bc7-fe8d-48c5-975b-fe97a68457e4 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.1776175 Dec 09 21:18:16.433050 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d89eeb5e-b0db-4278-a063-db0d9f710e28 req-bd2788b4-8841-4bab-bf32-3e7f0a101b6c service neutron] 10.222.0.10 "GET /v2.0/networks/ce6b6bd1-6a60-4cea-9b70-69fd0290796c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1424468 Dec 09 21:18:16.436442 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-705bf337-03e4-4212-add9-47049c3860e7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:16.492582 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-533ac5d6-c279-4229-8908-9059cf36cbd9 service neutron] Pushing event updated for resources: {'Port': ['ID=8ea7a94c-568e-46ea-954a-d61e6f1f0b18,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:16.532188 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cd086c39-a2a8-4ab4-a19e-e2fb4207f984 req-00d4bd74-3f71-4ca4-afcf-c826fefb3060 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.144&port_id=b75bad0f-5d42-4305-b970-f7b7298d2231 HTTP/1.1" status: 200 len: 217 time: 0.0958788 Dec 09 21:18:16.532670 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['1cc3b771-7d24-4dfa-bbfe-6e007094c74b'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:18:16.599229 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-92afba91-3dbb-46f4-b308-f612e61a24ab tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1264272 Dec 09 21:18:16.698754 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d89eeb5e-b0db-4278-a063-db0d9f710e28 req-cac056ba-f045-4c6a-8340-f43a5fee3136 service neutron] 10.222.0.10 "GET /v2.0/networks/ce6b6bd1-6a60-4cea-9b70-69fd0290796c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2571223 Dec 09 21:18:16.752203 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd086c39-a2a8-4ab4-a19e-e2fb4207f984 req-b3de84cb-b3b5-456d-8b5d-dfc081a1eb00 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:16.758313 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cd086c39-a2a8-4ab4-a19e-e2fb4207f984 req-b3de84cb-b3b5-456d-8b5d-dfc081a1eb00 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1362481 Dec 09 21:18:16.786142 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-705bf337-03e4-4212-add9-47049c3860e7 service neutron] Pushing event updated for resources: {'Port': ['ID=b615e863-071a-473e-8d66-8f84f78d1453,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:16.819315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-533ac5d6-c279-4229-8908-9059cf36cbd9 service neutron] Attempting to bind port 8ea7a94c-568e-46ea-954a-d61e6f1f0b18 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:18:16.819697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-533ac5d6-c279-4229-8908-9059cf36cbd9 service neutron] Attempting to bind port 8ea7a94c-568e-46ea-954a-d61e6f1f0b18 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:18:16.820018 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-533ac5d6-c279-4229-8908-9059cf36cbd9 service neutron] Attempting to bind port 8ea7a94c-568e-46ea-954a-d61e6f1f0b18 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:16.830777 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-533ac5d6-c279-4229-8908-9059cf36cbd9 service neutron] Port 8ea7a94c-568e-46ea-954a-d61e6f1f0b18 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:18:16.831093 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-533ac5d6-c279-4229-8908-9059cf36cbd9 service neutron] Attempting to bind port 8ea7a94c-568e-46ea-954a-d61e6f1f0b18 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:16.853524 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd086c39-a2a8-4ab4-a19e-e2fb4207f984 req-05f913c2-03eb-43c8-8f3d-205a1d342b29 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:16.855051 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cd086c39-a2a8-4ab4-a19e-e2fb4207f984 req-05f913c2-03eb-43c8-8f3d-205a1d342b29 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0909643 Dec 09 21:18:16.884503 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-533ac5d6-c279-4229-8908-9059cf36cbd9 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 17, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:18:16.884878 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-533ac5d6-c279-4229-8908-9059cf36cbd9 service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:18:16.885385 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-533ac5d6-c279-4229-8908-9059cf36cbd9 service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:18:16.885836 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-533ac5d6-c279-4229-8908-9059cf36cbd9 service neutron] Bound port: 8ea7a94c-568e-46ea-954a-d61e6f1f0b18, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:18:16.886194 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-533ac5d6-c279-4229-8908-9059cf36cbd9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:16.903015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6360a0fc-45e2-40ec-acc3-746d8b6ce903 req-9b50e5d3-647d-43e8-ab7a-5bce1e60bbf8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:16.903579 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55590) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:16.904927 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6360a0fc-45e2-40ec-acc3-746d8b6ce903 req-9b50e5d3-647d-43e8-ab7a-5bce1e60bbf8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebcfc729-b616-4933-a43d-f707a862db78 HTTP/1.1" status: 200 len: 948 time: 0.3142090 Dec 09 21:18:16.970208 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-705bf337-03e4-4212-add9-47049c3860e7 service neutron] Attempting to bind port b615e863-071a-473e-8d66-8f84f78d1453 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:18:16.970538 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-705bf337-03e4-4212-add9-47049c3860e7 service neutron] Attempting to bind port b615e863-071a-473e-8d66-8f84f78d1453 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'c1e3b516-6ad9-46a2-acfa-cf795ad5b916', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:18:16.970863 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-705bf337-03e4-4212-add9-47049c3860e7 service neutron] Attempting to bind port b615e863-071a-473e-8d66-8f84f78d1453 on network eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:16.989811 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-128c27a0-5ee0-43a0-bab5-9f440b7f4f06 service neutron] 10.222.0.13 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3644063 Dec 09 21:18:16.995263 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cd086c39-a2a8-4ab4-a19e-e2fb4207f984 req-fa67dd39-4a94-4339-81b9-c5322d872742 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1271799 Dec 09 21:18:16.996637 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-705bf337-03e4-4212-add9-47049c3860e7 service neutron] Port b615e863-071a-473e-8d66-8f84f78d1453 on network eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:18:16.996889 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-705bf337-03e4-4212-add9-47049c3860e7 service neutron] Attempting to bind port b615e863-071a-473e-8d66-8f84f78d1453 on network eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:17.035920 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-705bf337-03e4-4212-add9-47049c3860e7 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 17, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:18:17.036257 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-705bf337-03e4-4212-add9-47049c3860e7 service neutron] Checking segment: {'id': 'c1e3b516-6ad9-46a2-acfa-cf795ad5b916', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:18:17.036631 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-705bf337-03e4-4212-add9-47049c3860e7 service neutron] Bound using segment: {'id': 'c1e3b516-6ad9-46a2-acfa-cf795ad5b916', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:18:17.037067 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-705bf337-03e4-4212-add9-47049c3860e7 service neutron] Bound port: b615e863-071a-473e-8d66-8f84f78d1453, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c1e3b516-6ad9-46a2-acfa-cf795ad5b916', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:18:17.037440 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-705bf337-03e4-4212-add9-47049c3860e7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:17.044946 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f53e706d-b244-457b-991b-5ac3b96cfedf admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:17.078957 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6360a0fc-45e2-40ec-acc3-746d8b6ce903 req-c5b6089b-56d0-4abd-91b2-7ec563b15141 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1649160 Dec 09 21:18:17.080081 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-533ac5d6-c279-4229-8908-9059cf36cbd9 service neutron] For port 8ea7a94c-568e-46ea-954a-d61e6f1f0b18, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:18:17.132100 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cd086c39-a2a8-4ab4-a19e-e2fb4207f984 req-e2800e86-4479-4ef8-bfcb-0328ae224f63 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1288943 Dec 09 21:18:17.159112 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-533ac5d6-c279-4229-8908-9059cf36cbd9 service neutron] For port 8ea7a94c-568e-46ea-954a-d61e6f1f0b18, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=8ea7a94c-568e-46ea-954a-d61e6f1f0b18,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:18:17.170910 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-533ac5d6-c279-4229-8908-9059cf36cbd9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:17.198445 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f53e706d-b244-457b-991b-5ac3b96cfedf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:17.204022 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f53e706d-b244-457b-991b-5ac3b96cfedf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:17.248625 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f53e706d-b244-457b-991b-5ac3b96cfedf admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=66041a8e0d664974a28c470d32854e09&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3427382 Dec 09 21:18:17.249332 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55596) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:17.256145 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f53e706d-b244-457b-991b-5ac3b96cfedf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=44d3a097-c659-4d14-bcfd-df112c4bdf4d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:17.264852 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-594ba20d-48bb-4887-b60f-e2d4d48cf0cd service neutron] 10.222.0.13 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2656956 Dec 09 21:18:17.270457 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-705bf337-03e4-4212-add9-47049c3860e7 service neutron] For port b615e863-071a-473e-8d66-8f84f78d1453, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:18:17.282152 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-533ac5d6-c279-4229-8908-9059cf36cbd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:17.282766 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-533ac5d6-c279-4229-8908-9059cf36cbd9 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:17.284171 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-533ac5d6-c279-4229-8908-9059cf36cbd9 service neutron] 10.222.0.10 "PUT /v2.0/ports/8ea7a94c-568e-46ea-954a-d61e6f1f0b18 HTTP/1.1" status: 200 len: 1096 time: 2.7496972 Dec 09 21:18:17.301853 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-705bf337-03e4-4212-add9-47049c3860e7 service neutron] For port b615e863-071a-473e-8d66-8f84f78d1453, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b615e863-071a-473e-8d66-8f84f78d1453,segment=NetworkSegment(c1e3b516-6ad9-46a2-acfa-cf795ad5b916),segment_id=c1e3b516-6ad9-46a2-acfa-cf795ad5b916)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:18:17.306305 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-533ac5d6-c279-4229-8908-9059cf36cbd9 service neutron] Pushing event updated for resources: {'Port': ['ID=8ea7a94c-568e-46ea-954a-d61e6f1f0b18,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:17.309827 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3d219622-7b78-4711-9f9f-0e5c7c681a40 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:17.312914 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-705bf337-03e4-4212-add9-47049c3860e7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:17.338251 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3d219622-7b78-4711-9f9f-0e5c7c681a40 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:17.368239 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb831a2a-e6c1-42ab-b1af-b0d4c7558628 req-b4ae66a9-23ff-4039-821d-c2199678f2f7 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:17.369418 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb831a2a-e6c1-42ab-b1af-b0d4c7558628 req-b4ae66a9-23ff-4039-821d-c2199678f2f7 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3c85c33-b0b5-4c62-8189-7ff917e062e6 HTTP/1.1" status: 200 len: 950 time: 0.1532786 Dec 09 21:18:17.403849 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3d219622-7b78-4711-9f9f-0e5c7c681a40 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:17.407671 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3d219622-7b78-4711-9f9f-0e5c7c681a40 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:17.413853 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3d219622-7b78-4711-9f9f-0e5c7c681a40 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/44d3a097-c659-4d14-bcfd-df112c4bdf4d HTTP/1.1" status: 204 len: 168 time: 0.1618233 Dec 09 21:18:17.422869 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d219622-7b78-4711-9f9f-0e5c7c681a40 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=44d3a097-c659-4d14-bcfd-df112c4bdf4d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:17.430271 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-705bf337-03e4-4212-add9-47049c3860e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:17.430963 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-705bf337-03e4-4212-add9-47049c3860e7 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:17.432279 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-705bf337-03e4-4212-add9-47049c3860e7 service neutron] 10.222.0.31 "PUT /v2.0/ports/b615e863-071a-473e-8d66-8f84f78d1453 HTTP/1.1" status: 200 len: 1092 time: 2.7971957 Dec 09 21:18:17.552059 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8a7c4077-25fa-451f-8052-c1f6ec25a13a', 'tag': '8ea7a94c-568e-46ea-954a-d61e6f1f0b18'}, {'name': 'network-changed', 'server_uuid': '17188b52-f615-49ca-8709-a3c9238c02fa', 'tag': 'b615e863-071a-473e-8d66-8f84f78d1453'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:17.556053 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2d96bfe8-9c17-4d74-af04-be85aaf0708b" -d '{"events": [{"name": "network-changed", "server_uuid": "8a7c4077-25fa-451f-8052-c1f6ec25a13a", "tag": "8ea7a94c-568e-46ea-954a-d61e6f1f0b18"}, {"name": "network-changed", "server_uuid": "17188b52-f615-49ca-8709-a3c9238c02fa", "tag": "b615e863-071a-473e-8d66-8f84f78d1453"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:17.562583 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-705bf337-03e4-4212-add9-47049c3860e7 service neutron] Pushing event updated for resources: {'Port': ['ID=b615e863-071a-473e-8d66-8f84f78d1453,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:17.583152 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0d02e7fd-3187-46d8-b075-fa34ebe59d7e x-openstack-request-id: req-0d02e7fd-3187-46d8-b075-fa34ebe59d7e {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:17.583777 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a3c85c33-b0b5-4c62-8189-7ff917e062e6", "name": "network-vif-plugged", "status": "completed", "tag": "3fd5c53a-dd51-40cb-9c92-d83aa47ab67a", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:17.583777 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0d02e7fd-3187-46d8-b075-fa34ebe59d7e {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:17.584111 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a3c85c33-b0b5-4c62-8189-7ff917e062e6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3fd5c53a-dd51-40cb-9c92-d83aa47ab67a', 'code': 200} Dec 09 21:18:17.634626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-fbcea072-0e17-4de1-b5f1-73e3f9109791 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:17.637746 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-fbcea072-0e17-4de1-b5f1-73e3f9109791 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=10c237cbfa28423ea2d1df15f60193f2&device_id=8a7c4077-25fa-451f-8052-c1f6ec25a13a HTTP/1.1" status: 200 len: 1099 time: 0.2870746 Dec 09 21:18:17.660873 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb831a2a-e6c1-42ab-b1af-b0d4c7558628 req-7722112b-751a-44a2-ba57-3fab90ec0071 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2576368 Dec 09 21:18:17.665225 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-900ca1e6-53a3-426f-a1c2-9ebb33cf16cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:17.667051 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-900ca1e6-53a3-426f-a1c2-9ebb33cf16cb service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=920e0419877f4239b048e126682274e9&device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 1095 time: 0.1680534 Dec 09 21:18:17.721871 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-807b2d4a-f80d-4a38-bf19-d0227d89b8fa req-23f882cd-1c7a-4947-a6b5-0e849b4bbc99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:17.726556 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-807b2d4a-f80d-4a38-bf19-d0227d89b8fa req-23f882cd-1c7a-4947-a6b5-0e849b4bbc99 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=a3c85c33-b0b5-4c62-8189-7ff917e062e6 HTTP/1.1" status: 200 len: 1102 time: 0.0844359 Dec 09 21:18:17.765629 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-226b239f-d00f-40fe-8ae7-0931a0355a30 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.80&port_id=8ea7a94c-568e-46ea-954a-d61e6f1f0b18 HTTP/1.1" status: 200 len: 217 time: 0.1033604 Dec 09 21:18:17.827695 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1cc3b771-7d24-4dfa-bbfe-6e007094c74b up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:18:17.852539 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-dd8eb5b1-6649-4d4a-ad33-68072c3f3ba7 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b615e863-071a-473e-8d66-8f84f78d1453 HTTP/1.1" status: 200 len: 217 time: 0.0831976 Dec 09 21:18:17.959788 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:18:17.964725 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:17.965511 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:17.966132 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55618) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:18.018751 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-cfef956c-f550-41e8-817e-cf5b38fc5031 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:18.021045 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-cfef956c-f550-41e8-817e-cf5b38fc5031 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=3260fc19-8e10-46a2-82c6-3b2d5eda4a0e HTTP/1.1" status: 200 len: 860 time: 0.1203721 Dec 09 21:18:18.064849 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:18.094816 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-15c48809-2f22-4516-83cb-3c0300bea887 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:18.105233 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1cc3b771-7d24-4dfa-bbfe-6e007094c74b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:18.111565 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:18.121346 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-5d7bd532-e9c3-49e0-8643-3bc8d30e2cc7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:18.123190 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-5d7bd532-e9c3-49e0-8643-3bc8d30e2cc7 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.2998896 Dec 09 21:18:18.133869 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7551bda5-14a6-4509-92d4-90136bcdb587 req-c17ca8d7-e942-4b9e-a3bc-f99ee94efec7 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:18.139812 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-807b2d4a-f80d-4a38-bf19-d0227d89b8fa req-df4e732c-319a-429c-9ee8-39b10f320a07 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3995688 Dec 09 21:18:18.144039 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7551bda5-14a6-4509-92d4-90136bcdb587 req-c17ca8d7-e942-4b9e-a3bc-f99ee94efec7 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 943 time: 0.3774121 Dec 09 21:18:18.174556 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=1cc3b771-7d24-4dfa-bbfe-6e007094c74b,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:18.424332 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-182199ea-273f-4030-a500-194ced953b46 req-6dd2f6bf-fea4-42b4-b450-62cb48c372b7 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:18.425679 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-182199ea-273f-4030-a500-194ced953b46 req-6dd2f6bf-fea4-42b4-b450-62cb48c372b7 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=8a7c4077-25fa-451f-8052-c1f6ec25a13a HTTP/1.1" status: 200 len: 947 time: 0.4605076 Dec 09 21:18:18.502641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-cd67369c-5572-4083-9ea0-9c9e6c381d9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:18.504247 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-cd67369c-5572-4083-9ea0-9c9e6c381d9b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.4520001 Dec 09 21:18:18.512653 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-252aebfc-55ed-49d7-af9a-7ae9ed94bd5f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:18.513999 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-252aebfc-55ed-49d7-af9a-7ae9ed94bd5f service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.3664520 Dec 09 21:18:18.520697 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7551bda5-14a6-4509-92d4-90136bcdb587 req-18293186-f3c1-4f3c-8810-c13636851125 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/security-groups?id=174c6f0d-c012-4077-858c-aa2b94e54d38&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3582373 Dec 09 21:18:18.595762 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-182199ea-273f-4030-a500-194ced953b46 req-7464ba3f-c2d8-4872-aed5-43bbab31d133 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1590412 Dec 09 21:18:18.660356 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 346 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9436205c-c99b-4755-842b-c301a6a4b128 x-openstack-request-id: req-9436205c-c99b-4755-842b-c301a6a4b128 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:18.660717 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8a7c4077-25fa-451f-8052-c1f6ec25a13a", "tag": "8ea7a94c-568e-46ea-954a-d61e6f1f0b18", "status": "completed", "code": 200}, {"name": "network-changed", "server_uuid": "17188b52-f615-49ca-8709-a3c9238c02fa", "tag": "b615e863-071a-473e-8d66-8f84f78d1453", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:18.660892 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-9436205c-c99b-4755-842b-c301a6a4b128 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:18.661267 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8a7c4077-25fa-451f-8052-c1f6ec25a13a', 'tag': '8ea7a94c-568e-46ea-954a-d61e6f1f0b18', 'status': 'completed', 'code': 200} Dec 09 21:18:18.661583 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '17188b52-f615-49ca-8709-a3c9238c02fa', 'tag': 'b615e863-071a-473e-8d66-8f84f78d1453', 'status': 'completed', 'code': 200} Dec 09 21:18:18.667657 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7d174fbc-15f9-4e89-a88f-c880be161dc9 req-b179974d-9f9a-4937-aa4c-d6044bb062dc tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 210 time: 0.0842669 Dec 09 21:18:18.745247 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-15c48809-2f22-4516-83cb-3c0300bea887 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:18.769175 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-15c48809-2f22-4516-83cb-3c0300bea887 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:18.863493 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-c5b0e9c6-0a0c-4f51-b108-449ca5016a1f service neutron] 10.222.0.31 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3472908 Dec 09 21:18:18.874688 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-ca95a1ef-ed4c-4a36-800e-33413b5ec483 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:18.876348 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-ca95a1ef-ed4c-4a36-800e-33413b5ec483 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.10 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 821 time: 0.1189990 Dec 09 21:18:18.890138 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c7885c40-620e-419d-aced-9e48d95801d2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Request body: {'port': {'device_id': 'd2b3d687-3a7a-44b0-b7da-ae4f7e014981', 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c', 'admin_state_up': True, 'tenant_id': 'a306d2242b1e41c892f63c7b122cdee4'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:18.899703 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-15c48809-2f22-4516-83cb-3c0300bea887 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=01a1cbe45552425c9812289bc2476463&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9300041 Dec 09 21:18:18.899703 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15c48809-2f22-4516-83cb-3c0300bea887 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8c7fc118-d4b1-41b1-b585-487ecf530ab1,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:18.903244 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-97db9a73-90da-4555-84ff-fea41288abd9 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3639779 Dec 09 21:18:18.905383 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55632) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:18.980959 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36ae7fae-2b03-4d74-8845-1bc89fb649ab req-d7429ac7-260c-47d3-9362-112cdcc9e804 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:18.982473 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36ae7fae-2b03-4d74-8845-1bc89fb649ab req-d7429ac7-260c-47d3-9362-112cdcc9e804 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebcfc729-b616-4933-a43d-f707a862db78 HTTP/1.1" status: 200 len: 948 time: 0.2358730 Dec 09 21:18:19.004878 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c7885c40-620e-419d-aced-9e48d95801d2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Made reservation on behalf of a306d2242b1e41c892f63c7b122cdee4 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:18:19.008450 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c7885c40-620e-419d-aced-9e48d95801d2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:19.090906 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ac3a322-ce47-4b1e-a132-1b890d0a1cd7 req-c5dac51c-f594-43b0-9d35-19037c8ab11a tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:19.092401 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5ac3a322-ce47-4b1e-a132-1b890d0a1cd7 req-c5dac51c-f594-43b0-9d35-19037c8ab11a tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3c85c33-b0b5-4c62-8189-7ff917e062e6 HTTP/1.1" status: 200 len: 950 time: 0.2894199 Dec 09 21:18:19.139007 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c7885c40-620e-419d-aced-9e48d95801d2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Allocated IP 172.20.0.9 (93378dc3-2ac5-4cf7-9ce3-d812934de40c/c49a62cc-af1b-4958-a4a9-eb44188b8fb9/85dcf098-2530-45e6-aecc-ec3e2e8888a6) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:18:19.181885 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb19135c-2652-4c12-9b10-64e594440bc6 req-21ff251e-4c9e-4af5-978b-84e445142ca4 service neutron] 10.222.0.31 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2974164 Dec 09 21:18:19.190834 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e5cf4180-fc2f-4d8c-a099-254558a1e285 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:19.203931 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36ae7fae-2b03-4d74-8845-1bc89fb649ab req-ed167c4a-2345-4185-8e10-3d135aca45f8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1895006 Dec 09 21:18:19.215051 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9075e40a-e87b-4980-bc17-e2cfe1612ce2 req-4157238a-420a-44fa-92bb-da43a3f6d402 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2857342 Dec 09 21:18:19.238476 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e5cf4180-fc2f-4d8c-a099-254558a1e285 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:19.248197 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5ac3a322-ce47-4b1e-a132-1b890d0a1cd7 req-f3fc19d4-cfb6-40ca-a1f2-3c9f0faecdc1 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1463172 Dec 09 21:18:19.328336 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d96bfe8-9c17-4d74-af04-be85aaf0708b req-a4c0a2f0-1f40-43da-9344-af1751bd5eb9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:19.330935 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d96bfe8-9c17-4d74-af04-be85aaf0708b req-a4c0a2f0-1f40-43da-9344-af1751bd5eb9 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=920e0419877f4239b048e126682274e9&device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 1095 time: 0.0814745 Dec 09 21:18:19.335736 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c7885c40-620e-419d-aced-9e48d95801d2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:19.378136 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c7885c40-620e-419d-aced-9e48d95801d2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:19.416529 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e5cf4180-fc2f-4d8c-a099-254558a1e285 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:19.419851 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e5cf4180-fc2f-4d8c-a099-254558a1e285 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:19.427758 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e5cf4180-fc2f-4d8c-a099-254558a1e285 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/8c7fc118-d4b1-41b1-b585-487ecf530ab1 HTTP/1.1" status: 204 len: 168 time: 0.5169542 Dec 09 21:18:19.429477 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c7885c40-620e-419d-aced-9e48d95801d2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Network 93378dc3-2ac5-4cf7-9ce3-d812934de40c is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:18:19.433784 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c7885c40-620e-419d-aced-9e48d95801d2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:18:19.446583 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c7885c40-620e-419d-aced-9e48d95801d2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:18:19.473010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5cf4180-fc2f-4d8c-a099-254558a1e285 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8c7fc118-d4b1-41b1-b585-487ecf530ab1,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:19.511547 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7885c40-620e-419d-aced-9e48d95801d2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Pushing event updated for resources: {'Port': ['ID=85dcf098-2530-45e6-aecc-ec3e2e8888a6,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:19.536659 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c7885c40-620e-419d-aced-9e48d95801d2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:19.537461 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c7885c40-620e-419d-aced-9e48d95801d2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:19.551085 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d96bfe8-9c17-4d74-af04-be85aaf0708b req-08eaad2b-c07c-4961-8bbd-ba72a9548bca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:19.552825 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d96bfe8-9c17-4d74-af04-be85aaf0708b req-08eaad2b-c07c-4961-8bbd-ba72a9548bca service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=10c237cbfa28423ea2d1df15f60193f2&device_id=8a7c4077-25fa-451f-8052-c1f6ec25a13a HTTP/1.1" status: 200 len: 1099 time: 0.2174935 Dec 09 21:18:19.558415 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c7885c40-620e-419d-aced-9e48d95801d2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6734579 Dec 09 21:18:19.575845 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c61a02cb-3568-4392-ac98-c3ed3bc2174d service neutron] Request body: {'port': {'device_id': 'd2b3d687-3a7a-44b0-b7da-ae4f7e014981', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:19.585596 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '51e11d39-964b-458f-b5dc-fb020eb2c5f5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1cc3b771-7d24-4dfa-bbfe-6e007094c74b'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:19.587926 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-11ed635b-bac5-4b81-aab6-f051f58855b0" -d '{"events": [{"server_uuid": "51e11d39-964b-458f-b5dc-fb020eb2c5f5", "name": "network-vif-plugged", "status": "completed", "tag": "1cc3b771-7d24-4dfa-bbfe-6e007094c74b"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:19.621665 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d96bfe8-9c17-4d74-af04-be85aaf0708b req-af8c886f-4ea7-4d21-a24b-a3dad42e5c1b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:19.623954 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d96bfe8-9c17-4d74-af04-be85aaf0708b req-af8c886f-4ea7-4d21-a24b-a3dad42e5c1b service neutron] 10.222.0.31 "GET /v2.0/networks?id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 HTTP/1.1" status: 200 len: 922 time: 0.2668505 Dec 09 21:18:19.638568 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c61a02cb-3568-4392-ac98-c3ed3bc2174d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:19.714091 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device b75bad0f-5d42-4305-b970-f7b7298d2231 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:18:19.724255 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d96bfe8-9c17-4d74-af04-be85aaf0708b req-dce52dab-d892-4dcc-8706-ea1b59a8436c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b615e863-071a-473e-8d66-8f84f78d1453 HTTP/1.1" status: 200 len: 217 time: 0.0705140 Dec 09 21:18:19.793092 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d96bfe8-9c17-4d74-af04-be85aaf0708b req-3399fa26-9ddd-4c41-b764-724301fa4cf9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:19.794609 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d96bfe8-9c17-4d74-af04-be85aaf0708b req-3399fa26-9ddd-4c41-b764-724301fa4cf9 service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.2271869 Dec 09 21:18:19.805004 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24ff075d-b90d-4262-9d2c-000338cb004b req-5cc17e30-94ab-44b1-8391-c20fafec280b tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:19.812277 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-24ff075d-b90d-4262-9d2c-000338cb004b req-5cc17e30-94ab-44b1-8391-c20fafec280b tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 943 time: 0.1596982 Dec 09 21:18:19.821275 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.10', 63576) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:19.885016 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port b75bad0f-5d42-4305-b970-f7b7298d2231, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b75bad0f-5d42-4305-b970-f7b7298d2231,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:19.896661 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d96bfe8-9c17-4d74-af04-be85aaf0708b req-b35c7b23-aa35-4a66-999f-6d05ac188e67 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:19.898154 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d96bfe8-9c17-4d74-af04-be85aaf0708b req-b35c7b23-aa35-4a66-999f-6d05ac188e67 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=3260fc19-8e10-46a2-82c6-3b2d5eda4a0e HTTP/1.1" status: 200 len: 860 time: 0.1641064 Dec 09 21:18:19.900582 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d96bfe8-9c17-4d74-af04-be85aaf0708b req-53007e46-6c03-4e03-b4ff-59abb07c1d0f service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.80&port_id=8ea7a94c-568e-46ea-954a-d61e6f1f0b18 HTTP/1.1" status: 200 len: 217 time: 0.0758817 Dec 09 21:18:19.905928 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f5ca067c-4c6c-4932-a957-3e476741c183 x-openstack-request-id: req-f5ca067c-4c6c-4932-a957-3e476741c183 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:19.906329 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "51e11d39-964b-458f-b5dc-fb020eb2c5f5", "name": "network-vif-plugged", "status": "completed", "tag": "1cc3b771-7d24-4dfa-bbfe-6e007094c74b", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:19.907234 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f5ca067c-4c6c-4932-a957-3e476741c183 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:19.907819 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '51e11d39-964b-458f-b5dc-fb020eb2c5f5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1cc3b771-7d24-4dfa-bbfe-6e007094c74b', 'code': 200} Dec 09 21:18:19.910420 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'b75bad0f-5d42-4305-b970-f7b7298d2231', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': 'b75bad0f-5d42-4305-b970-f7b7298d2231', 'mac_address': 'fa:16:3e:8b:5f:43', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.144'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:18:19.967180 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:19.984775 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b75bad0f-5d42-4305-b970-f7b7298d2231 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:18:19.996158 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c61a02cb-3568-4392-ac98-c3ed3bc2174d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 85dcf098-2530-45e6-aecc-ec3e2e8888a6 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:18:20.004910 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c61a02cb-3568-4392-ac98-c3ed3bc2174d service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:20.011619 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port b75bad0f-5d42-4305-b970-f7b7298d2231, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b75bad0f-5d42-4305-b970-f7b7298d2231,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:20.021704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c61a02cb-3568-4392-ac98-c3ed3bc2174d service neutron] Transition to ACTIVE for port object 85dcf098-2530-45e6-aecc-ec3e2e8888a6 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:18:20.022940 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:20.025737 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c61a02cb-3568-4392-ac98-c3ed3bc2174d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:20.057730 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-24ff075d-b90d-4262-9d2c-000338cb004b req-0a0b62e3-c0ec-4d70-bb7c-dc2915e6ac55 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/security-groups?id=174c6f0d-c012-4077-858c-aa2b94e54d38&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2444243 Dec 09 21:18:20.064861 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e12aa98-ac46-49af-9ee7-04e3b26e6912 req-93e4fb82-0996-4161-b88f-fd35bcbffc85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:20.067955 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e12aa98-ac46-49af-9ee7-04e3b26e6912 req-93e4fb82-0996-4161-b88f-fd35bcbffc85 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 1102 time: 0.2417123 Dec 09 21:18:20.090315 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=b75bad0f-5d42-4305-b970-f7b7298d2231,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:20.091189 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d96bfe8-9c17-4d74-af04-be85aaf0708b req-8bf32815-5ee1-4bb7-b9bd-a3bd7387fc13 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:20.092743 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d96bfe8-9c17-4d74-af04-be85aaf0708b req-8bf32815-5ee1-4bb7-b9bd-a3bd7387fc13 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1786392 Dec 09 21:18:20.097307 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c61a02cb-3568-4392-ac98-c3ed3bc2174d service neutron] Pushing event updated for resources: {'Port': ['ID=85dcf098-2530-45e6-aecc-ec3e2e8888a6,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:20.104703 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c97fa9ce-9432-4017-80e3-084395f1ea8e req-9fbc05de-9c33-40c9-bd63-0222e2f9f6f1 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:20.112354 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c97fa9ce-9432-4017-80e3-084395f1ea8e req-9fbc05de-9c33-40c9-bd63-0222e2f9f6f1 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=8a7c4077-25fa-451f-8052-c1f6ec25a13a HTTP/1.1" status: 200 len: 947 time: 0.2299809 Dec 09 21:18:20.139512 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d96bfe8-9c17-4d74-af04-be85aaf0708b req-13eea6eb-ef17-4f65-96d3-fb1064589857 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:20.141104 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d96bfe8-9c17-4d74-af04-be85aaf0708b req-13eea6eb-ef17-4f65-96d3-fb1064589857 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2259383 Dec 09 21:18:20.186649 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c61a02cb-3568-4392-ac98-c3ed3bc2174d service neutron] Attempting to bind port 85dcf098-2530-45e6-aecc-ec3e2e8888a6 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:18:20.187001 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c61a02cb-3568-4392-ac98-c3ed3bc2174d service neutron] Attempting to bind port 85dcf098-2530-45e6-aecc-ec3e2e8888a6 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:18:20.187410 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c61a02cb-3568-4392-ac98-c3ed3bc2174d service neutron] Attempting to bind port 85dcf098-2530-45e6-aecc-ec3e2e8888a6 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:20.192654 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c61a02cb-3568-4392-ac98-c3ed3bc2174d service neutron] Port 85dcf098-2530-45e6-aecc-ec3e2e8888a6 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:18:20.193115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c61a02cb-3568-4392-ac98-c3ed3bc2174d service neutron] Attempting to bind port 85dcf098-2530-45e6-aecc-ec3e2e8888a6 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:20.198492 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c61a02cb-3568-4392-ac98-c3ed3bc2174d service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 17, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:18:20.198957 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c61a02cb-3568-4392-ac98-c3ed3bc2174d service neutron] Checking segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:18:20.200221 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c61a02cb-3568-4392-ac98-c3ed3bc2174d service neutron] Bound using segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:18:20.200221 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c61a02cb-3568-4392-ac98-c3ed3bc2174d service neutron] Bound port: 85dcf098-2530-45e6-aecc-ec3e2e8888a6, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:18:20.200221 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c61a02cb-3568-4392-ac98-c3ed3bc2174d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:20.263854 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['b75bad0f-5d42-4305-b970-f7b7298d2231'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:18:20.315899 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c61a02cb-3568-4392-ac98-c3ed3bc2174d service neutron] For port 85dcf098-2530-45e6-aecc-ec3e2e8888a6, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:18:20.322406 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c61a02cb-3568-4392-ac98-c3ed3bc2174d service neutron] For port 85dcf098-2530-45e6-aecc-ec3e2e8888a6, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=85dcf098-2530-45e6-aecc-ec3e2e8888a6,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:18:20.331619 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c61a02cb-3568-4392-ac98-c3ed3bc2174d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:20.385623 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c61a02cb-3568-4392-ac98-c3ed3bc2174d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:20.388108 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c61a02cb-3568-4392-ac98-c3ed3bc2174d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:20.390021 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-c61a02cb-3568-4392-ac98-c3ed3bc2174d service neutron] 10.222.0.10 "PUT /v2.0/ports/85dcf098-2530-45e6-aecc-ec3e2e8888a6 HTTP/1.1" status: 200 len: 1092 time: 0.8210170 Dec 09 21:18:20.393631 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd2b3d687-3a7a-44b0-b7da-ae4f7e014981', 'tag': '85dcf098-2530-45e6-aecc-ec3e2e8888a6'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:20.399252 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-508d2e89-582f-4b04-972a-f14a0c0386e5" -d '{"events": [{"name": "network-changed", "server_uuid": "d2b3d687-3a7a-44b0-b7da-ae4f7e014981", "tag": "85dcf098-2530-45e6-aecc-ec3e2e8888a6"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:20.432716 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c61a02cb-3568-4392-ac98-c3ed3bc2174d service neutron] Pushing event updated for resources: {'Port': ['ID=85dcf098-2530-45e6-aecc-ec3e2e8888a6,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:20.486939 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-865ce510-11fd-4cf4-b746-0f95628b2d75 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:20.489014 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-865ce510-11fd-4cf4-b746-0f95628b2d75 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 1095 time: 0.0459383 Dec 09 21:18:20.539327 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55680) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:20.547021 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-5b9acf00-4e96-476e-b0bc-9ba60f9269ce service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=85dcf098-2530-45e6-aecc-ec3e2e8888a6 HTTP/1.1" status: 200 len: 217 time: 0.0500031 Dec 09 21:18:20.577028 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d96bfe8-9c17-4d74-af04-be85aaf0708b req-5b28c860-f622-49b4-88ed-4ef3fc88223d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:20.578512 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d96bfe8-9c17-4d74-af04-be85aaf0708b req-5b28c860-f622-49b4-88ed-4ef3fc88223d service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.4578278 Dec 09 21:18:20.580546 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e12aa98-ac46-49af-9ee7-04e3b26e6912 req-7145cf2c-6d26-4f90-af86-35de5f90490e service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5005000 Dec 09 21:18:20.588096 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c97fa9ce-9432-4017-80e3-084395f1ea8e req-3b88adc6-68e9-4b4c-9404-c3e65f6fb83a tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4749193 Dec 09 21:18:20.601363 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-97084a75-69ac-4d60-9f15-24957e2d93e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:20.602872 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-97084a75-69ac-4d60-9f15-24957e2d93e8 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=c49a62cc-af1b-4958-a4a9-eb44188b8fb9 HTTP/1.1" status: 200 len: 861 time: 0.0484693 Dec 09 21:18:20.624253 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0ad7867-80c1-41c3-ac8b-c9e94daf69f5 req-783b8d39-911a-4178-86a9-3c89d7c90d54 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:20.625745 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d0ad7867-80c1-41c3-ac8b-c9e94daf69f5 req-783b8d39-911a-4178-86a9-3c89d7c90d54 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 943 time: 0.4126434 Dec 09 21:18:20.627958 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d96bfe8-9c17-4d74-af04-be85aaf0708b req-1d62e182-fda5-4918-87ec-45bf6c15d65a service neutron] 10.222.0.31 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4553680 Dec 09 21:18:20.653243 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-013401b2-517b-4238-a915-ab1fb9d6adf4 admin admin] Request body: {'network': {'name': 'tempest-LiveMigrationTest-660761479-network', 'tenant_id': 'ac5b7cefd8cc48cc83f38d3923aae132'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:20.676925 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-013401b2-517b-4238-a915-ab1fb9d6adf4 admin admin] Made reservation on behalf of ac5b7cefd8cc48cc83f38d3923aae132 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:18:20.679414 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-013401b2-517b-4238-a915-ab1fb9d6adf4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:20.689571 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-013401b2-517b-4238-a915-ab1fb9d6adf4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:20.764223 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-013401b2-517b-4238-a915-ab1fb9d6adf4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:20.765332 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d0ad7867-80c1-41c3-ac8b-c9e94daf69f5 req-a42cc775-69a4-4226-b1a2-357e8f690753 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1321552 Dec 09 21:18:20.770894 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-013401b2-517b-4238-a915-ab1fb9d6adf4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:20.807249 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-d9711ae8-5643-4f33-8153-a94087772317 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=93378dc3-2ac5-4cf7-9ce3-d812934de40c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0329654 Dec 09 21:18:20.836639 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-013401b2-517b-4238-a915-ab1fb9d6adf4 admin admin] vlan segment allocate from pool success with {'vlan_id': 138, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:18:20.843762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2322270-e923-4dc2-9408-04b056a93e99 req-e27e8210-cf4d-47c7-83d2-c4a92219952a tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:20.847952 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2322270-e923-4dc2-9408-04b056a93e99 req-e27e8210-cf4d-47c7-83d2-c4a92219952a tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebcfc729-b616-4933-a43d-f707a862db78 HTTP/1.1" status: 200 len: 949 time: 0.1527851 Dec 09 21:18:20.858306 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-013401b2-517b-4238-a915-ab1fb9d6adf4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6091baef-c025-46e8-8fcd-f3a6a8cc904a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:20.869377 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-013401b2-517b-4238-a915-ab1fb9d6adf4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:20.869769 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-013401b2-517b-4238-a915-ab1fb9d6adf4 admin admin] Added segment 8f944fa4-4b9c-4641-8eba-ea83e62520ce of type vlan for network 04fa749a-9f72-4a2c-a725-feab917f99ef Dec 09 21:18:20.877632 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d96bfe8-9c17-4d74-af04-be85aaf0708b req-558c7ac8-860b-43c0-8222-10bf175fdc1d service neutron] 10.222.0.31 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2367322 Dec 09 21:18:20.942156 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-013401b2-517b-4238-a915-ab1fb9d6adf4 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:20.970100 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d96bfe8-9c17-4d74-af04-be85aaf0708b req-1abd02c8-6969-4ba3-8752-16eafeff5e0e service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2016079 Dec 09 21:18:20.976971 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-18a94edd-c63e-4174-8610-b14c3a0ed3e4 service neutron] 10.222.0.10 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1608922 Dec 09 21:18:20.977590 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2322270-e923-4dc2-9408-04b056a93e99 req-b1a9cd36-9d3e-4564-b961-db6629d6a3e7 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1022823 Dec 09 21:18:20.994087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b2bfc66-e733-4cd0-a9a2-1ec0f78fe4c1 req-b577e47a-877e-49a5-97de-ff6f24075667 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:21.001238 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b2bfc66-e733-4cd0-a9a2-1ec0f78fe4c1 req-b577e47a-877e-49a5-97de-ff6f24075667 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3c85c33-b0b5-4c62-8189-7ff917e062e6 HTTP/1.1" status: 200 len: 950 time: 0.1520114 Dec 09 21:18:21.001849 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-013401b2-517b-4238-a915-ab1fb9d6adf4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:21.002876 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-013401b2-517b-4238-a915-ab1fb9d6adf4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:21.003649 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-013401b2-517b-4238-a915-ab1fb9d6adf4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:21.071525 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-013401b2-517b-4238-a915-ab1fb9d6adf4 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 880 time: 0.5309973 Dec 09 21:18:21.076784 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55686) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:21.082980 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ecb49270-a9d6-41a7-a3ae-d00cb3cc6699 admin admin] Request body: {'subnet': {'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef', 'cidr': '172.20.0.0/28', 'name': 'tempest-LiveMigrationTest-660761479-subnet', 'tenant_id': 'ac5b7cefd8cc48cc83f38d3923aae132', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:21.104338 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b2bfc66-e733-4cd0-a9a2-1ec0f78fe4c1 req-1d23b876-3de5-4e4d-ae5e-62643440ae81 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1022162 Dec 09 21:18:21.127917 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d96bfe8-9c17-4d74-af04-be85aaf0708b req-90bd91a1-e2e6-488a-806a-5f5b141bf9d3 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1485882 Dec 09 21:18:21.134669 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c68776eb-2a7e-4962-b432-74884b1a3a01 x-openstack-request-id: req-c68776eb-2a7e-4962-b432-74884b1a3a01 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:21.134941 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d2b3d687-3a7a-44b0-b7da-ae4f7e014981", "tag": "85dcf098-2530-45e6-aecc-ec3e2e8888a6", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:21.135200 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c68776eb-2a7e-4962-b432-74884b1a3a01 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:21.135627 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd2b3d687-3a7a-44b0-b7da-ae4f7e014981', 'tag': '85dcf098-2530-45e6-aecc-ec3e2e8888a6', 'status': 'completed', 'code': 200} Dec 09 21:18:21.141394 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-013401b2-517b-4238-a915-ab1fb9d6adf4 admin admin] Pushing event updated for resources: {'Network': ['ID=04fa749a-9f72-4a2c-a725-feab917f99ef,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:21.156835 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 04fa749a-9f72-4a2c-a725-feab917f99ef details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:18:21.169834 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-19c2ffdb-2c6c-47b5-bf19-fa4a0515bfd9 req-67f4f35c-1d12-443a-a182-34f93b0a4ab7 service neutron] 10.222.0.10 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1853204 Dec 09 21:18:21.174013 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ecb49270-a9d6-41a7-a3ae-d00cb3cc6699 admin admin] Made reservation on behalf of ac5b7cefd8cc48cc83f38d3923aae132 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:18:21.176817 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ecb49270-a9d6-41a7-a3ae-d00cb3cc6699 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:21.265062 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3b24507-a81e-471a-b997-393a5843420e req-cc98de20-4e00-44fa-a7cf-3fec7f5692c5 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:21.272435 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b3b24507-a81e-471a-b997-393a5843420e req-cc98de20-4e00-44fa-a7cf-3fec7f5692c5 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 943 time: 0.0636027 Dec 09 21:18:21.320423 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b3b24507-a81e-471a-b997-393a5843420e req-e8db58f0-bf2a-42c9-8ee7-7404b08ed290 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/security-groups?id=174c6f0d-c012-4077-858c-aa2b94e54d38&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0466027 Dec 09 21:18:21.327804 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-508d2e89-582f-4b04-972a-f14a0c0386e5 req-731c77d1-1459-45ec-af90-06eeef3583b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:21.329330 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-508d2e89-582f-4b04-972a-f14a0c0386e5 req-731c77d1-1459-45ec-af90-06eeef3583b8 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 1095 time: 0.1038413 Dec 09 21:18:21.497274 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-508d2e89-582f-4b04-972a-f14a0c0386e5 req-d78c991a-5cc5-4121-bf25-3c712b6545eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:21.499430 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-508d2e89-582f-4b04-972a-f14a0c0386e5 req-d78c991a-5cc5-4121-bf25-3c712b6545eb service neutron] 10.222.0.10 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 922 time: 0.1599090 Dec 09 21:18:21.500357 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ecb49270-a9d6-41a7-a3ae-d00cb3cc6699 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:21.583091 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-508d2e89-582f-4b04-972a-f14a0c0386e5 req-e9a1e3df-ab6f-4840-b06d-4ac2758e754c service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=85dcf098-2530-45e6-aecc-ec3e2e8888a6 HTTP/1.1" status: 200 len: 217 time: 0.0559657 Dec 09 21:18:21.609306 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecb49270-a9d6-41a7-a3ae-d00cb3cc6699 admin admin] Pushing event updated for resources: {'Subnet': ['ID=eae2438b-9fcc-44ef-a172-6c4911cad13f,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:21.648455 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ecb49270-a9d6-41a7-a3ae-d00cb3cc6699 admin admin] Checking segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:18:21.648828 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ecb49270-a9d6-41a7-a3ae-d00cb3cc6699 admin admin] Network hostable DHCP agents. Network: 04fa749a-9f72-4a2c-a725-feab917f99ef, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:18:21.662393 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18a2b78e-5993-4680-ab8f-14fc8fcc54eb req-edb15f77-da82-4374-8007-c9b467e0f0dd tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:21.664287 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-18a2b78e-5993-4680-ab8f-14fc8fcc54eb req-edb15f77-da82-4374-8007-c9b467e0f0dd tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3c85c33-b0b5-4c62-8189-7ff917e062e6 HTTP/1.1" status: 200 len: 950 time: 0.0549490 Dec 09 21:18:21.669736 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-508d2e89-582f-4b04-972a-f14a0c0386e5 req-3f855bc6-fab6-4fc5-8739-c1573385eea8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:21.671205 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-508d2e89-582f-4b04-972a-f14a0c0386e5 req-3f855bc6-fab6-4fc5-8739-c1573385eea8 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=c49a62cc-af1b-4958-a4a9-eb44188b8fb9 HTTP/1.1" status: 200 len: 861 time: 0.0788107 Dec 09 21:18:21.680848 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ecb49270-a9d6-41a7-a3ae-d00cb3cc6699 admin admin] Network 04fa749a-9f72-4a2c-a725-feab917f99ef is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:18:21.713795 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-508d2e89-582f-4b04-972a-f14a0c0386e5 req-471a3afa-f372-4ebe-a6c1-e5a56e6c3664 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=93378dc3-2ac5-4cf7-9ce3-d812934de40c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0304065 Dec 09 21:18:21.716123 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-ecb49270-a9d6-41a7-a3ae-d00cb3cc6699 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 04fa749a-9f72-4a2c-a725-feab917f99ef) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:18:21.729485 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-192288c4-aea0-4e70-b0ff-ed7f61a01715 None None] Network 04fa749a-9f72-4a2c-a725-feab917f99ef requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:18:21.730341 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-18a2b78e-5993-4680-ab8f-14fc8fcc54eb req-1b1ec46d-6073-4368-9dcb-b6608c323c7f tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0594134 Dec 09 21:18:21.737069 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device b75bad0f-5d42-4305-b970-f7b7298d2231 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:18:21.744290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ecb49270-a9d6-41a7-a3ae-d00cb3cc6699 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:21.745111 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ecb49270-a9d6-41a7-a3ae-d00cb3cc6699 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:21.855459 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 8ea7a94c-568e-46ea-954a-d61e6f1f0b18 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:18:21.886314 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ecb49270-a9d6-41a7-a3ae-d00cb3cc6699 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.8070674 Dec 09 21:18:21.895996 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37c5f28d-40f2-4e4a-9693-42ef5ee44290 req-0ba74545-0c1d-4311-ab8b-217610609db6 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:21.901445 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port b75bad0f-5d42-4305-b970-f7b7298d2231 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:18:21.905053 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-37c5f28d-40f2-4e4a-9693-42ef5ee44290 req-0ba74545-0c1d-4311-ab8b-217610609db6 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=8a7c4077-25fa-451f-8052-c1f6ec25a13a HTTP/1.1" status: 200 len: 947 time: 0.0750864 Dec 09 21:18:21.920726 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port b75bad0f-5d42-4305-b970-f7b7298d2231 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:21.921349 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:21.925974 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-508d2e89-582f-4b04-972a-f14a0c0386e5 req-c212b605-6476-4599-ab75-c66029b7f7a3 service neutron] 10.222.0.10 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1987078 Dec 09 21:18:21.964759 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f9ff1e21-4ef5-4619-acea-0b5c808ea5c1 None None] Network 04fa749a-9f72-4a2c-a725-feab917f99ef requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:18:22.034635 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-37c5f28d-40f2-4e4a-9693-42ef5ee44290 req-2be083b5-e3b0-496d-ac88-e312a283f198 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1285765 Dec 09 21:18:22.072527 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-508d2e89-582f-4b04-972a-f14a0c0386e5 req-f9a740f9-c31e-4c8f-85f3-b2eb5cf3a831 service neutron] 10.222.0.10 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1384742 Dec 09 21:18:22.075607 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-772250d4-dac1-4df3-acfc-066a95e3fbaa req-e6f9e3f0-73a3-4fe1-8214-6a35cf70cef7 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:22.077143 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-772250d4-dac1-4df3-acfc-066a95e3fbaa req-e6f9e3f0-73a3-4fe1-8214-6a35cf70cef7 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 943 time: 0.1949236 Dec 09 21:18:22.159295 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55740) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:22.213274 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-772250d4-dac1-4df3-acfc-066a95e3fbaa req-0c0b45d1-42fb-4f7c-a3c9-014987be0366 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1244493 Dec 09 21:18:22.248846 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7f9f744-db5e-4db4-b604-c8b8143355b4 req-27f4137e-e884-4e6b-9c49-b25822dd9db8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:22.258391 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a7f9f744-db5e-4db4-b604-c8b8143355b4 req-27f4137e-e884-4e6b-9c49-b25822dd9db8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebcfc729-b616-4933-a43d-f707a862db78 HTTP/1.1" status: 200 len: 949 time: 0.0805233 Dec 09 21:18:22.315604 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a7f9f744-db5e-4db4-b604-c8b8143355b4 req-ed04b470-1d9f-48ab-8ffb-66ae48e7516a tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0561364 Dec 09 21:18:22.337890 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 8ea7a94c-568e-46ea-954a-d61e6f1f0b18, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=8ea7a94c-568e-46ea-954a-d61e6f1f0b18,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:22.404485 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '8ea7a94c-568e-46ea-954a-d61e6f1f0b18', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '8ea7a94c-568e-46ea-954a-d61e6f1f0b18', 'mac_address': 'fa:16:3e:32:97:63', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.80'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:18:22.412096 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:22.429972 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59d92f89-22c1-4211-8dfa-e0c9628e9f78 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:22.469335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11a79c0f-fd33-4c66-9dce-179e10d8f2f7 req-e738e551-4011-4f16-b8c1-9ee5631bf2b4 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:22.471406 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ebcfc729-b616-4933-a43d-f707a862db78', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b75bad0f-5d42-4305-b970-f7b7298d2231'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:22.472139 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11a79c0f-fd33-4c66-9dce-179e10d8f2f7 req-e738e551-4011-4f16-b8c1-9ee5631bf2b4 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 943 time: 0.0723755 Dec 09 21:18:22.473856 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-11945af3-b5ec-4b38-a0d3-737a0d0d7bc6" -d '{"events": [{"server_uuid": "ebcfc729-b616-4933-a43d-f707a862db78", "name": "network-vif-plugged", "status": "completed", "tag": "b75bad0f-5d42-4305-b970-f7b7298d2231"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:22.517456 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port b75bad0f-5d42-4305-b970-f7b7298d2231, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b75bad0f-5d42-4305-b970-f7b7298d2231,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:22.519180 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:22.534026 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11a79c0f-fd33-4c66-9dce-179e10d8f2f7 req-771829c9-3a94-4018-b24b-fc0aff6f779f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/security-groups?id=174c6f0d-c012-4077-858c-aa2b94e54d38&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547769 Dec 09 21:18:22.535539 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:22.538018 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59d92f89-22c1-4211-8dfa-e0c9628e9f78 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:22.545269 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59d92f89-22c1-4211-8dfa-e0c9628e9f78 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:22.550184 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2bd12ed1-8ebb-4a43-8455-eb56d315c12f x-openstack-request-id: req-2bd12ed1-8ebb-4a43-8455-eb56d315c12f {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:22.550604 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ebcfc729-b616-4933-a43d-f707a862db78", "name": "network-vif-plugged", "status": "completed", "tag": "b75bad0f-5d42-4305-b970-f7b7298d2231", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:22.550866 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-2bd12ed1-8ebb-4a43-8455-eb56d315c12f {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:22.551635 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ebcfc729-b616-4933-a43d-f707a862db78', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b75bad0f-5d42-4305-b970-f7b7298d2231', 'code': 200} Dec 09 21:18:22.578234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8ea7a94c-568e-46ea-954a-d61e6f1f0b18 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:18:22.604075 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-59d92f89-22c1-4211-8dfa-e0c9628e9f78 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=28dd69f88fe54d26ab73133226507b73&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4431214 Dec 09 21:18:22.604924 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59d92f89-22c1-4211-8dfa-e0c9628e9f78 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dcc085d5-f66b-45f8-a33c-f94163bf8d97,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:22.606593 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55756) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:22.608286 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 8ea7a94c-568e-46ea-954a-d61e6f1f0b18, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=8ea7a94c-568e-46ea-954a-d61e6f1f0b18,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:22.621367 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:22.627497 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=b75bad0f-5d42-4305-b970-f7b7298d2231,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:22.682033 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=8ea7a94c-568e-46ea-954a-d61e6f1f0b18,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:22.692235 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-280d3316-e441-4749-93af-2e4aea714002 req-5c18253d-a217-41f4-8b78-7cde10e49ecc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:22.693822 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-280d3316-e441-4749-93af-2e4aea714002 req-5c18253d-a217-41f4-8b78-7cde10e49ecc service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=ebcfc729-b616-4933-a43d-f707a862db78 HTTP/1.1" status: 200 len: 1102 time: 0.0692010 Dec 09 21:18:22.696706 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-00996b34-f7b6-4f5b-957e-b51a799deeea admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:22.708811 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55760) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:22.713801 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-31f343ed-34a7-43c4-a2f0-70262a47204c admin admin] Request body: {'network': {'name': 'tempest-LiveMigrationTest-579167856-network', 'tenant_id': '09cced989021427a89fdd2d3c31740b1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:22.735085 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-00996b34-f7b6-4f5b-957e-b51a799deeea admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:22.736660 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-31f343ed-34a7-43c4-a2f0-70262a47204c admin admin] Made reservation on behalf of 09cced989021427a89fdd2d3c31740b1 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:18:22.739202 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31f343ed-34a7-43c4-a2f0-70262a47204c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:22.747774 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31f343ed-34a7-43c4-a2f0-70262a47204c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:22.790610 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-280d3316-e441-4749-93af-2e4aea714002 req-611e6b8b-01eb-4545-ba2f-4a079d65c18d service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0894225 Dec 09 21:18:22.847689 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e85e7f93-995c-400a-95ad-10e5c8f5d995 req-4f910914-9cb7-42e8-89b4-37576cb9c0b2 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:22.849312 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e85e7f93-995c-400a-95ad-10e5c8f5d995 req-4f910914-9cb7-42e8-89b4-37576cb9c0b2 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3c85c33-b0b5-4c62-8189-7ff917e062e6 HTTP/1.1" status: 200 len: 950 time: 0.0558331 Dec 09 21:18:22.856970 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['8ea7a94c-568e-46ea-954a-d61e6f1f0b18'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:18:22.862803 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31f343ed-34a7-43c4-a2f0-70262a47204c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:22.866454 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-00996b34-f7b6-4f5b-957e-b51a799deeea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:22.869444 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-00996b34-f7b6-4f5b-957e-b51a799deeea admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:22.869844 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31f343ed-34a7-43c4-a2f0-70262a47204c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:22.873082 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-00996b34-f7b6-4f5b-957e-b51a799deeea admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/dcc085d5-f66b-45f8-a33c-f94163bf8d97 HTTP/1.1" status: 204 len: 168 time: 0.2629256 Dec 09 21:18:22.886549 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-31f343ed-34a7-43c4-a2f0-70262a47204c admin admin] vlan segment allocate from pool success with {'vlan_id': 125, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:18:22.896071 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00996b34-f7b6-4f5b-957e-b51a799deeea admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dcc085d5-f66b-45f8-a33c-f94163bf8d97,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:22.899029 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31f343ed-34a7-43c4-a2f0-70262a47204c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:22.899622 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-31f343ed-34a7-43c4-a2f0-70262a47204c admin admin] Added segment b5734691-66f6-4b4b-a586-41f19d3e0ac6 of type vlan for network 52073bfa-9dac-4974-a609-004d90980633 Dec 09 21:18:22.932142 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e85e7f93-995c-400a-95ad-10e5c8f5d995 req-8b342dad-be7f-4e94-a34c-f906998cd27d tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0759020 Dec 09 21:18:22.967000 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31f343ed-34a7-43c4-a2f0-70262a47204c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:23.023841 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31f343ed-34a7-43c4-a2f0-70262a47204c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=93693cad-b812-4fa5-8eba-d6aea76820ed,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:23.055889 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31f343ed-34a7-43c4-a2f0-70262a47204c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:23.058040 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-31f343ed-34a7-43c4-a2f0-70262a47204c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:23.058817 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31f343ed-34a7-43c4-a2f0-70262a47204c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:23.114284 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc9258bc-9eef-4713-a44b-c596bf50004c req-dc4a373d-438e-4e24-a65b-0e2a836a6a95 tempest-LiveMigrationNegativeTest-1711148301 tempest-LiveMigrationNegativeTest-1711148301-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:23.117130 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fc9258bc-9eef-4713-a44b-c596bf50004c req-dc4a373d-438e-4e24-a65b-0e2a836a6a95 tempest-LiveMigrationNegativeTest-1711148301 tempest-LiveMigrationNegativeTest-1711148301-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=a3c85c33-b0b5-4c62-8189-7ff917e062e6 HTTP/1.1" status: 200 len: 1102 time: 0.0528309 Dec 09 21:18:23.150874 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-31f343ed-34a7-43c4-a2f0-70262a47204c admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 880 time: 0.4408901 Dec 09 21:18:23.157185 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55772) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:23.158308 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fc9258bc-9eef-4713-a44b-c596bf50004c req-ba678e8f-d92e-4314-b481-149c81221c67 tempest-LiveMigrationNegativeTest-1711148301 tempest-LiveMigrationNegativeTest-1711148301-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:23.166123 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-da97015c-beca-4a00-a456-1485c6b314f5 admin admin] Request body: {'subnet': {'network_id': '52073bfa-9dac-4974-a609-004d90980633', 'cidr': '172.20.0.0/28', 'name': 'tempest-LiveMigrationTest-579167856-subnet', 'tenant_id': '09cced989021427a89fdd2d3c31740b1', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:23.210020 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31f343ed-34a7-43c4-a2f0-70262a47204c admin admin] Pushing event updated for resources: {'Network': ['ID=52073bfa-9dac-4974-a609-004d90980633,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:23.224801 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 52073bfa-9dac-4974-a609-004d90980633 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:18:23.245163 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-da97015c-beca-4a00-a456-1485c6b314f5 admin admin] Made reservation on behalf of 09cced989021427a89fdd2d3c31740b1 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:18:23.247747 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3e61ae0-7b95-4cb8-890f-19d904850e91 req-4f898a14-1d0f-4b21-80f1-778c8545debb tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:23.248143 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-da97015c-beca-4a00-a456-1485c6b314f5 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:23.255501 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a3e61ae0-7b95-4cb8-890f-19d904850e91 req-4f898a14-1d0f-4b21-80f1-778c8545debb tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=8a7c4077-25fa-451f-8052-c1f6ec25a13a HTTP/1.1" status: 200 len: 948 time: 0.0936384 Dec 09 21:18:23.324289 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a3e61ae0-7b95-4cb8-890f-19d904850e91 req-78e0b4ef-cc41-47f3-a544-4ad33eaa613d tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0680385 Dec 09 21:18:23.336342 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fc9258bc-9eef-4713-a44b-c596bf50004c req-ba678e8f-d92e-4314-b481-149c81221c67 tempest-LiveMigrationNegativeTest-1711148301 tempest-LiveMigrationNegativeTest-1711148301-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:23.342647 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fc9258bc-9eef-4713-a44b-c596bf50004c req-ba678e8f-d92e-4314-b481-149c81221c67 tempest-LiveMigrationNegativeTest-1711148301 tempest-LiveMigrationNegativeTest-1711148301-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:23.386104 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55780) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:23.397193 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fc9258bc-9eef-4713-a44b-c596bf50004c req-ba678e8f-d92e-4314-b481-149c81221c67 tempest-LiveMigrationNegativeTest-1711148301 tempest-LiveMigrationNegativeTest-1711148301-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2706671 Dec 09 21:18:23.413626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba678e8f-d92e-4314-b481-149c81221c67 tempest-LiveMigrationNegativeTest-1711148301 tempest-LiveMigrationNegativeTest-1711148301-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ec910aa3-96ca-49e3-aec9-22c8522deec8,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:23.418183 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-aafaeab0-4bfb-4f28-80b5-b155f283f956 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:23.467837 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-da97015c-beca-4a00-a456-1485c6b314f5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:23.513633 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ab4d047-35d2-4a6a-8bf4-7cfceb45666d req-891d2928-1ff9-4d59-bf55-aa54fee4a926 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:23.515172 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5ab4d047-35d2-4a6a-8bf4-7cfceb45666d req-891d2928-1ff9-4d59-bf55-aa54fee4a926 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 943 time: 0.1172109 Dec 09 21:18:23.537401 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da97015c-beca-4a00-a456-1485c6b314f5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d6ed3c41-a3b8-44b3-8276-7d8de4956a93,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:23.541143 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da97015c-beca-4a00-a456-1485c6b314f5 admin admin] Checking segment: {'id': 'b5734691-66f6-4b4b-a586-41f19d3e0ac6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '52073bfa-9dac-4974-a609-004d90980633'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:18:23.541785 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da97015c-beca-4a00-a456-1485c6b314f5 admin admin] Network hostable DHCP agents. Network: 52073bfa-9dac-4974-a609-004d90980633, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:18:23.562112 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da97015c-beca-4a00-a456-1485c6b314f5 admin admin] Network 52073bfa-9dac-4974-a609-004d90980633 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:18:23.573297 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-da97015c-beca-4a00-a456-1485c6b314f5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 52073bfa-9dac-4974-a609-004d90980633) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:18:23.577551 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-da97015c-beca-4a00-a456-1485c6b314f5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:23.578157 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-da97015c-beca-4a00-a456-1485c6b314f5 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:23.580458 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5970a12-7efe-4485-b5ea-1828a917ff5b req-81cce36c-56d7-4f75-b8a1-856a7225e0c0 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:23.582157 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c5970a12-7efe-4485-b5ea-1828a917ff5b req-81cce36c-56d7-4f75-b8a1-856a7225e0c0 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebcfc729-b616-4933-a43d-f707a862db78 HTTP/1.1" status: 200 len: 950 time: 0.1127388 Dec 09 21:18:23.591869 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4444cbd7-bf6c-494a-b128-3fb1dc7a9443 None None] Network 52073bfa-9dac-4974-a609-004d90980633 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:18:23.604472 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-da97015c-beca-4a00-a456-1485c6b314f5 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.4374626 Dec 09 21:18:23.631661 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5ab4d047-35d2-4a6a-8bf4-7cfceb45666d req-c9da659e-92ba-4b56-a53d-2324566c9508 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1087854 Dec 09 21:18:23.643596 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-aafaeab0-4bfb-4f28-80b5-b155f283f956 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:23.650595 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-aafaeab0-4bfb-4f28-80b5-b155f283f956 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:23.695877 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c5970a12-7efe-4485-b5ea-1828a917ff5b req-8cc3ea7b-7902-4689-95fe-175ec8e529ba tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1057014 Dec 09 21:18:23.711954 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-aafaeab0-4bfb-4f28-80b5-b155f283f956 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=3c138106600c46bc9efaa31327e9db29&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3247797 Dec 09 21:18:23.712858 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aafaeab0-4bfb-4f28-80b5-b155f283f956 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=91c417ac-ad0b-4f80-b92d-78349515e9bf,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:23.714657 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55788) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:23.764056 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device b615e863-071a-473e-8d66-8f84f78d1453 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:18:23.779842 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20778305-2a50-4a45-a74e-e6cec7e6adb7 None None] Network 52073bfa-9dac-4974-a609-004d90980633 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:18:23.824295 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a986198-09da-45d3-ac5d-4b013d5f334f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:23.861288 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 85dcf098-2530-45e6-aecc-ec3e2e8888a6 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:18:23.889676 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a986198-09da-45d3-ac5d-4b013d5f334f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:23.920041 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc80ea9d-f936-4b95-9f20-35a043c0e924 req-870e0894-7db3-4a90-8d7f-20cf478a02e8 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:23.922289 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc80ea9d-f936-4b95-9f20-35a043c0e924 req-870e0894-7db3-4a90-8d7f-20cf478a02e8 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 943 time: 0.0825706 Dec 09 21:18:23.953400 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a986198-09da-45d3-ac5d-4b013d5f334f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:23.958201 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a986198-09da-45d3-ac5d-4b013d5f334f admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:23.962072 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 8ea7a94c-568e-46ea-954a-d61e6f1f0b18 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:18:23.969785 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5a986198-09da-45d3-ac5d-4b013d5f334f admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/91c417ac-ad0b-4f80-b92d-78349515e9bf HTTP/1.1" status: 204 len: 168 time: 0.2516787 Dec 09 21:18:23.980451 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a986198-09da-45d3-ac5d-4b013d5f334f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=91c417ac-ad0b-4f80-b92d-78349515e9bf,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:24.010528 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc80ea9d-f936-4b95-9f20-35a043c0e924 req-8138fc27-dfd4-4d99-a707-1b0ea7fa9bce tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/security-groups?id=174c6f0d-c012-4077-858c-aa2b94e54d38&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0691674 Dec 09 21:18:24.039385 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.resource_extend [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] It took 0.18 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 09 21:18:24.219020 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78b33a38-1778-4f95-8897-793ddad775ae req-ad143b02-0580-424e-9ba7-b4ad9064b5e1 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:24.221755 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78b33a38-1778-4f95-8897-793ddad775ae req-ad143b02-0580-424e-9ba7-b4ad9064b5e1 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3c85c33-b0b5-4c62-8189-7ff917e062e6 HTTP/1.1" status: 200 len: 950 time: 0.0604515 Dec 09 21:18:24.232643 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 85dcf098-2530-45e6-aecc-ec3e2e8888a6, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=85dcf098-2530-45e6-aecc-ec3e2e8888a6,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:24.254649 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port b615e863-071a-473e-8d66-8f84f78d1453, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b615e863-071a-473e-8d66-8f84f78d1453,segment=NetworkSegment(c1e3b516-6ad9-46a2-acfa-cf795ad5b916),segment_id=c1e3b516-6ad9-46a2-acfa-cf795ad5b916)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:24.257587 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 8ea7a94c-568e-46ea-954a-d61e6f1f0b18 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:18:24.265254 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '85dcf098-2530-45e6-aecc-ec3e2e8888a6', 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c', 'port_id': '85dcf098-2530-45e6-aecc-ec3e2e8888a6', 'mac_address': 'fa:16:3e:19:50:48', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 100, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c49a62cc-af1b-4958-a4a9-eb44188b8fb9', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:18:24.271689 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 8ea7a94c-568e-46ea-954a-d61e6f1f0b18 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:24.272070 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:24.274022 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'b615e863-071a-473e-8d66-8f84f78d1453', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'port_id': 'b615e863-071a-473e-8d66-8f84f78d1453', 'mac_address': 'fa:16:3e:d2:df:2a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 137, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:18:24.297819 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78b33a38-1778-4f95-8897-793ddad775ae req-4a82b83d-e3b7-457f-8df5-d7416a420bb6 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0694792 Dec 09 21:18:24.370523 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:24.401229 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:24.408091 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 85dcf098-2530-45e6-aecc-ec3e2e8888a6 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:18:24.460750 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b615e863-071a-473e-8d66-8f84f78d1453 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:18:24.466648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 85dcf098-2530-45e6-aecc-ec3e2e8888a6, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=85dcf098-2530-45e6-aecc-ec3e2e8888a6,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:24.474634 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55820) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:24.478350 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:24.488591 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b9f007e4-f68d-4bef-9dbb-76441986d639 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:24.488814 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:24.524181 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port b615e863-071a-473e-8d66-8f84f78d1453, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b615e863-071a-473e-8d66-8f84f78d1453,segment=NetworkSegment(c1e3b516-6ad9-46a2-acfa-cf795ad5b916),segment_id=c1e3b516-6ad9-46a2-acfa-cf795ad5b916)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:24.540888 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:24.547925 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e175560-e1d2-42a6-93dc-55b18a1051a3 req-2bce0d25-31d5-42f3-b013-f921c1d3f45b tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:24.553938 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8a7c4077-25fa-451f-8052-c1f6ec25a13a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8ea7a94c-568e-46ea-954a-d61e6f1f0b18'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:24.556091 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e175560-e1d2-42a6-93dc-55b18a1051a3 req-2bce0d25-31d5-42f3-b013-f921c1d3f45b tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=8a7c4077-25fa-451f-8052-c1f6ec25a13a HTTP/1.1" status: 200 len: 948 time: 0.1361396 Dec 09 21:18:24.556291 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-30495835-eced-41df-b504-3a4715b6018e" -d '{"events": [{"server_uuid": "8a7c4077-25fa-451f-8052-c1f6ec25a13a", "name": "network-vif-plugged", "status": "completed", "tag": "8ea7a94c-568e-46ea-954a-d61e6f1f0b18"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:24.575816 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b9f007e4-f68d-4bef-9dbb-76441986d639 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:24.580164 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 8ea7a94c-568e-46ea-954a-d61e6f1f0b18, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=8ea7a94c-568e-46ea-954a-d61e6f1f0b18,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:24.582988 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b9f007e4-f68d-4bef-9dbb-76441986d639 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:24.584346 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=85dcf098-2530-45e6-aecc-ec3e2e8888a6,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:24.592778 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:24.634078 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-e0b09748-04f1-4c10-839f-75e2d74ea2fc tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:24.635945 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-e0b09748-04f1-4c10-839f-75e2d74ea2fc tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 807 time: 0.2013199 Dec 09 21:18:24.640540 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b9f007e4-f68d-4bef-9dbb-76441986d639 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=a69ebf146bca42428f9db7b0b858e036&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1643734 Dec 09 21:18:24.641154 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55824) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:24.643846 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=b615e863-071a-473e-8d66-8f84f78d1453,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:24.652759 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e175560-e1d2-42a6-93dc-55b18a1051a3 req-577a03a4-45db-4b16-924c-51ae0f11580e tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0957098 Dec 09 21:18:24.655538 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9f007e4-f68d-4bef-9dbb-76441986d639 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=89934f14-1717-4639-b36d-3d5c82cc4b0e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:24.671602 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-87cf7389-afd7-4447-aecb-90f97ab46674 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/quotas/ac5b7cefd8cc48cc83f38d3923aae132 HTTP/1.1" status: 200 len: 375 time: 0.0177526 Dec 09 21:18:24.700687 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-269923b2-b158-4ec3-a26c-ec9430329911 x-openstack-request-id: req-269923b2-b158-4ec3-a26c-ec9430329911 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:24.701012 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8a7c4077-25fa-451f-8052-c1f6ec25a13a", "name": "network-vif-plugged", "status": "completed", "tag": "8ea7a94c-568e-46ea-954a-d61e6f1f0b18", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:24.701318 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-269923b2-b158-4ec3-a26c-ec9430329911 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:24.701988 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8a7c4077-25fa-451f-8052-c1f6ec25a13a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8ea7a94c-568e-46ea-954a-d61e6f1f0b18', 'code': 200} Dec 09 21:18:24.702541 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94f0f449-dbef-4401-95aa-f41235683b38 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:24.726038 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-1b6ec862-a905-448b-b46e-aad7ac896860 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0453186 Dec 09 21:18:24.728482 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94f0f449-dbef-4401-95aa-f41235683b38 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:24.750901 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['85dcf098-2530-45e6-aecc-ec3e2e8888a6'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:18:24.793291 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=8ea7a94c-568e-46ea-954a-d61e6f1f0b18,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:24.814062 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['b615e863-071a-473e-8d66-8f84f78d1453'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:18:24.818457 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94f0f449-dbef-4401-95aa-f41235683b38 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:24.821435 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94f0f449-dbef-4401-95aa-f41235683b38 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:24.825669 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-94f0f449-dbef-4401-95aa-f41235683b38 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/89934f14-1717-4639-b36d-3d5c82cc4b0e HTTP/1.1" status: 204 len: 168 time: 0.1825488 Dec 09 21:18:24.836867 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c74cb6f-f7f2-46fa-842c-38f6e5cd5806 req-c86848eb-3dca-4b1e-9b19-3420248f1fc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:24.838588 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6c74cb6f-f7f2-46fa-842c-38f6e5cd5806 req-c86848eb-3dca-4b1e-9b19-3420248f1fc0 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=8a7c4077-25fa-451f-8052-c1f6ec25a13a HTTP/1.1" status: 200 len: 1101 time: 0.0683427 Dec 09 21:18:24.839768 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94f0f449-dbef-4401-95aa-f41235683b38 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=89934f14-1717-4639-b36d-3d5c82cc4b0e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:24.887317 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-0bc90e81-4daa-42cf-a1a0-80ca39b4e718 service neutron] 10.222.0.13 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1505096 Dec 09 21:18:24.906657 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6c74cb6f-f7f2-46fa-842c-38f6e5cd5806 req-80b249df-0a85-4718-9d76-d0c577f2ca8b service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0606985 Dec 09 21:18:24.938543 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8e0be38-0f37-4b56-8420-2c2738b95c93 req-e6fcec06-b657-438e-bed4-707de0e70e24 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:24.939781 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a8e0be38-0f37-4b56-8420-2c2738b95c93 req-e6fcec06-b657-438e-bed4-707de0e70e24 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 944 time: 0.0957446 Dec 09 21:18:25.032065 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-fa458372-dd5c-432a-871f-01ae773dfb4e service neutron] 10.222.0.13 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1365495 Dec 09 21:18:25.036338 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a8e0be38-0f37-4b56-8420-2c2738b95c93 req-f27f5aa1-6adb-4d2d-9ba3-c78ce3c0d28a tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0674090 Dec 09 21:18:25.183587 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b26f2f5-97a3-4267-a9e8-4dfcb7c2a1bb req-1b224c49-088c-413f-a567-62fb17cd1f9a tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:25.184672 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b26f2f5-97a3-4267-a9e8-4dfcb7c2a1bb req-1b224c49-088c-413f-a567-62fb17cd1f9a tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebcfc729-b616-4933-a43d-f707a862db78 HTTP/1.1" status: 200 len: 950 time: 0.0701630 Dec 09 21:18:25.253295 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b26f2f5-97a3-4267-a9e8-4dfcb7c2a1bb req-80070cb4-1a1e-46b9-982f-abdf8969f105 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0569165 Dec 09 21:18:25.338505 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4636aff8-f192-4228-ad87-eaea00eb039f req-a523f8db-3c63-4625-bd1d-23d006999f17 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 210 time: 0.0412157 Dec 09 21:18:25.383113 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8aceff1-e32a-4a1b-933e-c899eb91b7da req-fbf29b6a-2efa-4c3b-8e64-93d740dcc334 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:25.387931 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a8aceff1-e32a-4a1b-933e-c899eb91b7da req-fbf29b6a-2efa-4c3b-8e64-93d740dcc334 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 944 time: 0.0821314 Dec 09 21:18:25.496107 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a8aceff1-e32a-4a1b-933e-c899eb91b7da req-2bd2ea65-3472-4e0c-ac38-a7ae11053b10 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/security-groups?id=174c6f0d-c012-4077-858c-aa2b94e54d38&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0992627 Dec 09 21:18:25.509342 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56fb0bd3-44e7-4e21-beaa-b585f107de50 req-5327c5c2-838c-44c0-8053-05ee8b6f01fd tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:25.517885 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56fb0bd3-44e7-4e21-beaa-b585f107de50 req-5327c5c2-838c-44c0-8053-05ee8b6f01fd tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.0945659 Dec 09 21:18:25.578320 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56fb0bd3-44e7-4e21-beaa-b585f107de50 req-63df2033-f86f-4ea9-8e88-c59961cede6e tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0559411 Dec 09 21:18:25.703960 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40dac3bf-b208-4ba7-a5d9-69bc95cdfefa req-4d6cfdb9-fccd-403d-a58d-94a6e7a8385c tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:25.705799 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-40dac3bf-b208-4ba7-a5d9-69bc95cdfefa req-4d6cfdb9-fccd-403d-a58d-94a6e7a8385c tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3c85c33-b0b5-4c62-8189-7ff917e062e6 HTTP/1.1" status: 200 len: 950 time: 0.1100457 Dec 09 21:18:25.716044 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f62ed7dc-ac88-4d94-9f8f-63cbfd308c12 req-647c1550-73f1-4d03-b187-b6762ba91270 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:25.727023 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f62ed7dc-ac88-4d94-9f8f-63cbfd308c12 req-647c1550-73f1-4d03-b187-b6762ba91270 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.31 "GET /v2.0/ports?device_id=a3c85c33-b0b5-4c62-8189-7ff917e062e6 HTTP/1.1" status: 200 len: 950 time: 0.1203017 Dec 09 21:18:25.751553 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device b615e863-071a-473e-8d66-8f84f78d1453 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:18:25.824414 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port b615e863-071a-473e-8d66-8f84f78d1453 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:18:25.828563 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port b615e863-071a-473e-8d66-8f84f78d1453 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:25.828999 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:25.856191 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 85dcf098-2530-45e6-aecc-ec3e2e8888a6 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:18:25.858126 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-40dac3bf-b208-4ba7-a5d9-69bc95cdfefa req-0ba131ed-9333-4fd1-af6b-788e066b60d6 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1299438 Dec 09 21:18:25.969395 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-584e3bf4-750f-47aa-a968-b4581a663517 req-dab2b8d6-fe95-4add-a803-54a658198005 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:25.978772 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-584e3bf4-750f-47aa-a968-b4581a663517 req-dab2b8d6-fe95-4add-a803-54a658198005 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=8a7c4077-25fa-451f-8052-c1f6ec25a13a HTTP/1.1" status: 200 len: 949 time: 0.2492499 Dec 09 21:18:26.003710 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 85dcf098-2530-45e6-aecc-ec3e2e8888a6 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:18:26.012397 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 85dcf098-2530-45e6-aecc-ec3e2e8888a6 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:26.012774 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:26.058899 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-62751c57-bd77-4b76-aad2-8bc445332383 req-355c31c0-ac6e-4bf5-927e-0c24081fa463 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=6a32a636fa83452db185eb0152d6082d&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0636442 Dec 09 21:18:26.060010 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:26.090389 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-f62ed7dc-ac88-4d94-9f8f-63cbfd308c12 req-e8822f45-4d12-469d-989a-b224094d833d tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Deleting port 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:18:26.090865 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f62ed7dc-ac88-4d94-9f8f-63cbfd308c12 req-e8822f45-4d12-469d-989a-b224094d833d tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:26.111781 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port b615e863-071a-473e-8d66-8f84f78d1453, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b615e863-071a-473e-8d66-8f84f78d1453,segment=NetworkSegment(c1e3b516-6ad9-46a2-acfa-cf795ad5b916),segment_id=c1e3b516-6ad9-46a2-acfa-cf795ad5b916)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:26.133932 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:26.174608 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:26.188041 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-584e3bf4-750f-47aa-a968-b4581a663517 req-f2030f58-a1c5-458e-afc4-6dd695f7298e tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2083628 Dec 09 21:18:26.214320 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=b615e863-071a-473e-8d66-8f84f78d1453,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:26.232980 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 85dcf098-2530-45e6-aecc-ec3e2e8888a6, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=85dcf098-2530-45e6-aecc-ec3e2e8888a6,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:26.241671 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:26.292392 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62751c57-bd77-4b76-aad2-8bc445332383 req-9d4ef1c0-3823-4655-92d7-19a70d8a2d70 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:26.294245 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-62751c57-bd77-4b76-aad2-8bc445332383 req-9d4ef1c0-3823-4655-92d7-19a70d8a2d70 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2265267 Dec 09 21:18:26.329846 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-f62ed7dc-ac88-4d94-9f8f-63cbfd308c12 req-e8822f45-4d12-469d-989a-b224094d833d tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] For port 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=3fd5c53a-dd51-40cb-9c92-d83aa47ab67a,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:26.329846 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f62ed7dc-ac88-4d94-9f8f-63cbfd308c12 req-e8822f45-4d12-469d-989a-b224094d833d tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:26.356006 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-62751c57-bd77-4b76-aad2-8bc445332383 req-daa02d9e-21ab-4f51-9b51-7c8ff8acc45d tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/quotas/6a32a636fa83452db185eb0152d6082d HTTP/1.1" status: 200 len: 375 time: 0.0547540 Dec 09 21:18:26.364605 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-f62ed7dc-ac88-4d94-9f8f-63cbfd308c12 req-e8822f45-4d12-469d-989a-b224094d833d tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Calling delete_port for 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:18:26.449958 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=85dcf098-2530-45e6-aecc-ec3e2e8888a6,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:26.494598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-285de2b3-cd68-49ed-9dcf-8d90d95e7b05 req-f1088484-6a7b-4469-99ff-bf8688377932 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:26.496460 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-285de2b3-cd68-49ed-9dcf-8d90d95e7b05 req-f1088484-6a7b-4469-99ff-bf8688377932 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 945 time: 0.1914952 Dec 09 21:18:26.548554 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-62751c57-bd77-4b76-aad2-8bc445332383 req-550363a7-fde6-4ae8-ab81-ded4544995e4 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=6a32a636fa83452db185eb0152d6082d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1783314 Dec 09 21:18:26.567828 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-3cb6c273-1ad8-4c95-bd56-192e3a60a135 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:26.570526 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-3cb6c273-1ad8-4c95-bd56-192e3a60a135 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.31 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 807 time: 0.1356874 Dec 09 21:18:26.590343 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-a9d75b92-2e20-40b5-81e2-e4ce09fca7ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Request body: {'port': {'device_id': '0d277843-0a85-41b3-add1-0e319baac5d2', 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef', 'admin_state_up': True, 'tenant_id': 'ac5b7cefd8cc48cc83f38d3923aae132'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:26.590568 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-285de2b3-cd68-49ed-9dcf-8d90d95e7b05 req-d310c117-0c8b-445e-b629-5a439719fe70 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0810907 Dec 09 21:18:26.674285 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f62ed7dc-ac88-4d94-9f8f-63cbfd308c12 req-e8822f45-4d12-469d-989a-b224094d833d tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:26.690019 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['37ba309b-f598-4b1e-b3e8-35aa21ab14d3', '3fd5c53a-dd51-40cb-9c92-d83aa47ab67a'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:18:26.706225 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8822f45-4d12-469d-989a-b224094d833d tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Pushing event deleted for resources: {'Port': ['ID=3fd5c53a-dd51-40cb-9c92-d83aa47ab67a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:26.773398 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '17188b52-f615-49ca-8709-a3c9238c02fa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b615e863-071a-473e-8d66-8f84f78d1453'}, {'server_uuid': 'd2b3d687-3a7a-44b0-b7da-ae4f7e014981', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '85dcf098-2530-45e6-aecc-ec3e2e8888a6'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:26.780408 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b83f9914-cc44-4215-8047-c03fb1a8affc" -d '{"events": [{"server_uuid": "17188b52-f615-49ca-8709-a3c9238c02fa", "name": "network-vif-plugged", "status": "completed", "tag": "b615e863-071a-473e-8d66-8f84f78d1453"}, {"server_uuid": "d2b3d687-3a7a-44b0-b7da-ae4f7e014981", "name": "network-vif-plugged", "status": "completed", "tag": "85dcf098-2530-45e6-aecc-ec3e2e8888a6"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:26.813632 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-f62ed7dc-ac88-4d94-9f8f-63cbfd308c12 req-e8822f45-4d12-469d-989a-b224094d833d tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] No DVR routers for this DVR port 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:18:26.828753 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f62ed7dc-ac88-4d94-9f8f-63cbfd308c12 req-e8822f45-4d12-469d-989a-b224094d833d tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:26.833856 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f62ed7dc-ac88-4d94-9f8f-63cbfd308c12 req-e8822f45-4d12-469d-989a-b224094d833d tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.31 "DELETE /v2.0/ports/3fd5c53a-dd51-40cb-9c92-d83aa47ab67a HTTP/1.1" status: 204 len: 173 time: 1.0886972 Dec 09 21:18:26.834622 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-a9d75b92-2e20-40b5-81e2-e4ce09fca7ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Made reservation on behalf of ac5b7cefd8cc48cc83f38d3923aae132 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:18:26.835742 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a3c85c33-b0b5-4c62-8189-7ff917e062e6', 'name': 'network-vif-deleted', 'tag': '3fd5c53a-dd51-40cb-9c92-d83aa47ab67a'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:26.839033 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-43aaedb7-490b-47e8-a880-ceeab9741d06" -d '{"events": [{"server_uuid": "a3c85c33-b0b5-4c62-8189-7ff917e062e6", "name": "network-vif-deleted", "tag": "3fd5c53a-dd51-40cb-9c92-d83aa47ab67a"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:26.839372 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-a9d75b92-2e20-40b5-81e2-e4ce09fca7ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:26.931997 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:26.952942 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-512777c6-c36e-4b6b-bc22-a5715212ee97 req-bacc6f29-fd6a-4643-b233-3a7164c106c7 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 210 time: 0.1256392 Dec 09 21:18:27.011012 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-a9d75b92-2e20-40b5-81e2-e4ce09fca7ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Allocated IP 172.20.0.11 (04fa749a-9f72-4a2c-a725-feab917f99ef/eae2438b-9fcc-44ef-a172-6c4911cad13f/ecb95cc0-98d6-4980-b73e-2bc2c2df48f3) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:18:27.120392 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:27.133069 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9c475df-e12b-46fb-b24a-ad5438c3e5e6 req-1d354d1a-4c28-41da-9444-2089b99b983c tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:27.140805 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d9c475df-e12b-46fb-b24a-ad5438c3e5e6 req-1d354d1a-4c28-41da-9444-2089b99b983c tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 945 time: 0.0647488 Dec 09 21:18:27.193147 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-a9d75b92-2e20-40b5-81e2-e4ce09fca7ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:27.217916 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:18:27.220460 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-456c46bf-565e-4409-a6a8-5423a214e883 req-4cb2f278-3d7b-41ab-b390-12149c1b5758 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=8c21856f-2254-41e8-941c-2f4471714942 HTTP/1.1" status: 200 len: 210 time: 0.0432284 Dec 09 21:18:27.224598 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d9c475df-e12b-46fb-b24a-ad5438c3e5e6 req-ab9b1214-b8b0-4211-bd7b-4aed74b420b8 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/security-groups?id=174c6f0d-c012-4077-858c-aa2b94e54d38&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0827074 Dec 09 21:18:27.240753 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-a9d75b92-2e20-40b5-81e2-e4ce09fca7ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:27.281416 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-a9d75b92-2e20-40b5-81e2-e4ce09fca7ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Network 04fa749a-9f72-4a2c-a725-feab917f99ef is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:18:27.284872 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-a9d75b92-2e20-40b5-81e2-e4ce09fca7ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:18:27.288838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-a9d75b92-2e20-40b5-81e2-e4ce09fca7ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:18:27.295595 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cbed3f50-dc66-40a6-92de-405c2010e678 x-openstack-request-id: req-cbed3f50-dc66-40a6-92de-405c2010e678 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:27.296129 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "17188b52-f615-49ca-8709-a3c9238c02fa", "name": "network-vif-plugged", "status": "completed", "tag": "b615e863-071a-473e-8d66-8f84f78d1453", "code": 200}, {"server_uuid": "d2b3d687-3a7a-44b0-b7da-ae4f7e014981", "name": "network-vif-plugged", "status": "completed", "tag": "85dcf098-2530-45e6-aecc-ec3e2e8888a6", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:27.297349 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-cbed3f50-dc66-40a6-92de-405c2010e678 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:27.306152 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '17188b52-f615-49ca-8709-a3c9238c02fa', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b615e863-071a-473e-8d66-8f84f78d1453', 'code': 200} Dec 09 21:18:27.307202 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd2b3d687-3a7a-44b0-b7da-ae4f7e014981', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '85dcf098-2530-45e6-aecc-ec3e2e8888a6', 'code': 200} Dec 09 21:18:27.327349 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b636dcff-5e7b-42c8-88de-8d15a470ecaa x-openstack-request-id: req-b636dcff-5e7b-42c8-88de-8d15a470ecaa {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:27.327666 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a3c85c33-b0b5-4c62-8189-7ff917e062e6", "name": "network-vif-deleted", "tag": "3fd5c53a-dd51-40cb-9c92-d83aa47ab67a", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:27.327913 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-b636dcff-5e7b-42c8-88de-8d15a470ecaa {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:27.328303 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a3c85c33-b0b5-4c62-8189-7ff917e062e6', 'name': 'network-vif-deleted', 'tag': '3fd5c53a-dd51-40cb-9c92-d83aa47ab67a', 'status': 'completed', 'code': 200} Dec 09 21:18:27.339350 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9d75b92-2e20-40b5-81e2-e4ce09fca7ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Pushing event updated for resources: {'Port': ['ID=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:27.420274 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-a9d75b92-2e20-40b5-81e2-e4ce09fca7ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:27.424266 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-a9d75b92-2e20-40b5-81e2-e4ce09fca7ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:27.481382 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-08c4700a-ad08-4568-bf81-ba74a52a75f3 req-14d40b27-60e6-4b2f-a0ae-48c280d40114 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=a3c85c33-b0b5-4c62-8189-7ff917e062e6 HTTP/1.1" status: 200 len: 210 time: 0.0864499 Dec 09 21:18:27.499577 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b477f0c5-cbdc-4f17-a8e4-fe3ecc3e48be req-9af2772d-6ac7-4a4c-a214-a84d29701be2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:27.501076 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b477f0c5-cbdc-4f17-a8e4-fe3ecc3e48be req-9af2772d-6ac7-4a4c-a214-a84d29701be2 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 1097 time: 0.1091220 Dec 09 21:18:27.514602 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e990ba30-1669-421d-ab90-ce6882ef7abc req-63956563-869e-4925-8528-d45ed76ff17c tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:27.516205 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e990ba30-1669-421d-ab90-ce6882ef7abc req-63956563-869e-4925-8528-d45ed76ff17c tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=8a7c4077-25fa-451f-8052-c1f6ec25a13a HTTP/1.1" status: 200 len: 949 time: 0.0855732 Dec 09 21:18:27.608008 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b477f0c5-cbdc-4f17-a8e4-fe3ecc3e48be req-9e265cab-5a1a-4a30-bf2d-5bd4facbf8ca service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=174c6f0d-c012-4077-858c-aa2b94e54d38&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0907848 Dec 09 21:18:27.611896 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e990ba30-1669-421d-ab90-ce6882ef7abc req-b656b6bc-8ca5-4524-95eb-c371f72ffe91 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0753715 Dec 09 21:18:27.699742 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-a9d75b92-2e20-40b5-81e2-e4ce09fca7ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.1169057 Dec 09 21:18:27.712528 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-169ae71b-0446-49b5-9aaa-6dc36f73efb3 req-c68feb85-189e-4706-910b-343b308c36c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:27.714612 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-169ae71b-0446-49b5-9aaa-6dc36f73efb3 req-c68feb85-189e-4706-910b-343b308c36c5 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 1097 time: 0.3263359 Dec 09 21:18:27.750262 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aa59bb7-397e-4a4b-bcab-a7efc5d9b3b7 req-898f1a10-80a3-4b35-a4fd-5cb8093a6aeb tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:27.751898 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5aa59bb7-397e-4a4b-bcab-a7efc5d9b3b7 req-898f1a10-80a3-4b35-a4fd-5cb8093a6aeb tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 945 time: 0.0662336 Dec 09 21:18:27.764172 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-169ae71b-0446-49b5-9aaa-6dc36f73efb3 req-8f9f52b7-e181-4d2f-8c96-28c626fd680b service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415726 Dec 09 21:18:27.806792 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5aa59bb7-397e-4a4b-bcab-a7efc5d9b3b7 req-507e4b8f-7c78-49a2-ae6a-63567ab40602 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0480435 Dec 09 21:18:27.807582 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-afc0995a-61bf-43eb-9cc4-7f91982af493 service neutron] Request body: {'port': {'device_id': '0d277843-0a85-41b3-add1-0e319baac5d2', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:27.868313 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-afc0995a-61bf-43eb-9cc4-7f91982af493 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:28.069568 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ae6a60d-61c9-48ed-9f85-667cc04c0aaf req-460916c2-1f5f-4ad4-9e35-be066f2c1dd2 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:28.071145 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0ae6a60d-61c9-48ed-9f85-667cc04c0aaf req-460916c2-1f5f-4ad4-9e35-be066f2c1dd2 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=8a7c4077-25fa-451f-8052-c1f6ec25a13a HTTP/1.1" status: 200 len: 949 time: 0.0558605 Dec 09 21:18:28.121361 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0ae6a60d-61c9-48ed-9f85-667cc04c0aaf req-a9f58f40-c53f-4fa3-b7c6-c0d8bc05bb27 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437291 Dec 09 21:18:28.167950 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-afc0995a-61bf-43eb-9cc4-7f91982af493 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:18:28.176166 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-afc0995a-61bf-43eb-9cc4-7f91982af493 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:28.189079 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-afc0995a-61bf-43eb-9cc4-7f91982af493 service neutron] Transition to ACTIVE for port object ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:18:28.193380 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-afc0995a-61bf-43eb-9cc4-7f91982af493 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:28.246443 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afc0995a-61bf-43eb-9cc4-7f91982af493 service neutron] Pushing event updated for resources: {'Port': ['ID=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:28.319967 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-afc0995a-61bf-43eb-9cc4-7f91982af493 service neutron] Attempting to bind port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:18:28.320167 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-afc0995a-61bf-43eb-9cc4-7f91982af493 service neutron] Attempting to bind port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:18:28.320986 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-afc0995a-61bf-43eb-9cc4-7f91982af493 service neutron] Attempting to bind port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:28.325767 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-afc0995a-61bf-43eb-9cc4-7f91982af493 service neutron] Port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 on network 04fa749a-9f72-4a2c-a725-feab917f99ef not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:18:28.326130 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-afc0995a-61bf-43eb-9cc4-7f91982af493 service neutron] Attempting to bind port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:28.331743 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-afc0995a-61bf-43eb-9cc4-7f91982af493 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 18, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:18:28.332162 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-afc0995a-61bf-43eb-9cc4-7f91982af493 service neutron] Checking segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:18:28.332480 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-afc0995a-61bf-43eb-9cc4-7f91982af493 service neutron] Bound using segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:18:28.332929 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-afc0995a-61bf-43eb-9cc4-7f91982af493 service neutron] Bound port: ecb95cc0-98d6-4980-b73e-2bc2c2df48f3, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:18:28.333269 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-afc0995a-61bf-43eb-9cc4-7f91982af493 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:28.415627 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-afc0995a-61bf-43eb-9cc4-7f91982af493 service neutron] For port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:18:28.419127 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-afc0995a-61bf-43eb-9cc4-7f91982af493 service neutron] For port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:18:28.426077 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-afc0995a-61bf-43eb-9cc4-7f91982af493 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:28.464795 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-afc0995a-61bf-43eb-9cc4-7f91982af493 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:28.465684 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-afc0995a-61bf-43eb-9cc4-7f91982af493 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:28.467373 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-afc0995a-61bf-43eb-9cc4-7f91982af493 service neutron] 10.222.0.31 "PUT /v2.0/ports/ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 HTTP/1.1" status: 200 len: 1093 time: 0.6651907 Dec 09 21:18:28.467878 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0d277843-0a85-41b3-add1-0e319baac5d2', 'tag': 'ecb95cc0-98d6-4980-b73e-2bc2c2df48f3'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:28.470133 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-390cc69a-f9b7-41f7-80d4-565f994c5708" -d '{"events": [{"name": "network-changed", "server_uuid": "0d277843-0a85-41b3-add1-0e319baac5d2", "tag": "ecb95cc0-98d6-4980-b73e-2bc2c2df48f3"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:28.475471 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-70c2db87-007c-403a-8f2a-376d86aeacc1 req-bc3ba768-0501-4812-98de-0e443095d8aa tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=8c21856f-2254-41e8-941c-2f4471714942 HTTP/1.1" status: 200 len: 210 time: 0.0305402 Dec 09 21:18:28.484308 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab0d6ace-2ec6-4d3a-bde9-b2a851a6c6a2 req-8568c964-c555-4740-8891-bad3285ce5cf tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:28.499497 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab0d6ace-2ec6-4d3a-bde9-b2a851a6c6a2 req-8568c964-c555-4740-8891-bad3285ce5cf tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 932 time: 0.3279576 Dec 09 21:18:28.535478 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-62751c57-bd77-4b76-aad2-8bc445332383 req-2239fd57-51cb-4e82-bea5-0ddffec0b146 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.10 "GET /v2.0/networks?tenant_id=6a32a636fa83452db185eb0152d6082d&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0301301 Dec 09 21:18:28.546988 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55968) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:28.568040 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab0d6ace-2ec6-4d3a-bde9-b2a851a6c6a2 req-6bbfefee-dff7-4177-b86c-350b2847968d tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0751476 Dec 09 21:18:28.580008 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afc0995a-61bf-43eb-9cc4-7f91982af493 service neutron] Pushing event updated for resources: {'Port': ['ID=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:28.714472 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-859a00f1-579d-4fb0-82bd-31967fd04b49 req-2d22e64f-8280-49b7-a5ef-2ac12ffda220 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:28.718453 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-859a00f1-579d-4fb0-82bd-31967fd04b49 req-2d22e64f-8280-49b7-a5ef-2ac12ffda220 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 945 time: 0.1017714 Dec 09 21:18:28.744635 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62751c57-bd77-4b76-aad2-8bc445332383 req-782484ba-cc04-4845-a234-0e37966a10b4 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:28.747003 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-62751c57-bd77-4b76-aad2-8bc445332383 req-782484ba-cc04-4845-a234-0e37966a10b4 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1686852 Dec 09 21:18:28.752476 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6f2507ea-abc2-477d-b918-94b2585ad55b x-openstack-request-id: req-6f2507ea-abc2-477d-b918-94b2585ad55b {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:28.753122 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0d277843-0a85-41b3-add1-0e319baac5d2", "tag": "ecb95cc0-98d6-4980-b73e-2bc2c2df48f3", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:28.753678 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-6f2507ea-abc2-477d-b918-94b2585ad55b {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:28.754442 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0d277843-0a85-41b3-add1-0e319baac5d2', 'tag': 'ecb95cc0-98d6-4980-b73e-2bc2c2df48f3', 'status': 'completed', 'code': 200} Dec 09 21:18:28.771153 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-77d007fe-3941-4b61-955f-6ce3665ac451 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:28.773508 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-62751c57-bd77-4b76-aad2-8bc445332383 req-d846b1cf-1643-4dad-8239-7e9bd874e4b3 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Request body: {'port': {'device_id': '8c21856f-2254-41e8-941c-2f4471714942', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '6a32a636fa83452db185eb0152d6082d'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:28.778420 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-ac13362f-b887-4b20-9b5b-ffe42e7d9b6d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:28.779870 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-ac13362f-b887-4b20-9b5b-ffe42e7d9b6d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 1096 time: 0.2415392 Dec 09 21:18:28.813512 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-859a00f1-579d-4fb0-82bd-31967fd04b49 req-53847bf8-7557-47ed-baac-3d226194f70d tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/security-groups?id=174c6f0d-c012-4077-858c-aa2b94e54d38&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0868821 Dec 09 21:18:28.853607 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-d4e33390-be7e-4cf8-a277-e74af26feae0 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 HTTP/1.1" status: 200 len: 217 time: 0.0590191 Dec 09 21:18:28.937414 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-77d007fe-3941-4b61-955f-6ce3665ac451 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:28.947938 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-77d007fe-3941-4b61-955f-6ce3665ac451 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:28.989212 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-8b6bc005-f808-4392-97d9-879fb4cf961e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:28.991362 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-8b6bc005-f808-4392-97d9-879fb4cf961e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=eae2438b-9fcc-44ef-a172-6c4911cad13f HTTP/1.1" status: 200 len: 847 time: 0.1302669 Dec 09 21:18:29.008601 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81b2270e-d9ae-4e9b-b941-1ad34fe92190 req-b87f2efa-8881-448d-8785-20d78b8d7f18 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:29.010303 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-81b2270e-d9ae-4e9b-b941-1ad34fe92190 req-b87f2efa-8881-448d-8785-20d78b8d7f18 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 945 time: 0.1111145 Dec 09 21:18:29.028016 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-77d007fe-3941-4b61-955f-6ce3665ac451 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=326ae1994f9b4556b8d438d7db49a9ec&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4799409 Dec 09 21:18:29.032786 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55978) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:29.037139 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-d1edd763-ef5b-4236-a95a-9dbf0b9f4a04 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=04fa749a-9f72-4a2c-a725-feab917f99ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0365837 Dec 09 21:18:29.045333 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77d007fe-3941-4b61-955f-6ce3665ac451 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d04fc557-c5f3-48d2-b8b9-cd5484c27aff,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:29.073069 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-62751c57-bd77-4b76-aad2-8bc445332383 req-d846b1cf-1643-4dad-8239-7e9bd874e4b3 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Made reservation on behalf of 6a32a636fa83452db185eb0152d6082d for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:18:29.077439 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-62751c57-bd77-4b76-aad2-8bc445332383 req-d846b1cf-1643-4dad-8239-7e9bd874e4b3 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:29.115138 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-105e4c6d-0b87-4e8f-9dc9-c9d97381ed6b req-99656401-3075-4a4f-be79-a8b1ab3613e0 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:29.117485 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-105e4c6d-0b87-4e8f-9dc9-c9d97381ed6b req-99656401-3075-4a4f-be79-a8b1ab3613e0 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=548538cf-319a-4465-9a2b-f54718ee91be HTTP/1.1" status: 200 len: 972 time: 0.1448357 Dec 09 21:18:29.140154 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-81b2270e-d9ae-4e9b-b941-1ad34fe92190 req-e0a57545-cbc5-4e9c-aa1a-e123892a0d79 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1098433 Dec 09 21:18:29.189140 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5afcc470-9e2a-46da-9aa1-5e7da2841b31 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:29.215622 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-105e4c6d-0b87-4e8f-9dc9-c9d97381ed6b req-a8b98e75-e9f3-468a-9f19-fd9eb33ff88e tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0883653 Dec 09 21:18:29.225515 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5afcc470-9e2a-46da-9aa1-5e7da2841b31 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:29.227455 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-d1b5ceee-1e1e-4ba5-9372-0d94c9e461c8 service neutron] 10.222.0.31 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1772542 Dec 09 21:18:29.286006 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5afcc470-9e2a-46da-9aa1-5e7da2841b31 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:29.289940 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5afcc470-9e2a-46da-9aa1-5e7da2841b31 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:29.291240 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5afcc470-9e2a-46da-9aa1-5e7da2841b31 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/d04fc557-c5f3-48d2-b8b9-cd5484c27aff HTTP/1.1" status: 204 len: 168 time: 0.2575512 Dec 09 21:18:29.311335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5afcc470-9e2a-46da-9aa1-5e7da2841b31 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d04fc557-c5f3-48d2-b8b9-cd5484c27aff,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:29.354930 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19988e4f-b138-4845-9b61-10e21c07c8d9 req-69935dc9-2a47-494d-9e50-3006ffa323bd tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:29.357316 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-62751c57-bd77-4b76-aad2-8bc445332383 req-d846b1cf-1643-4dad-8239-7e9bd874e4b3 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Allocated IP 192.168.233.9 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/0fd74259-b2a4-42ff-b424-909c8f53a26a) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:18:29.362430 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19988e4f-b138-4845-9b61-10e21c07c8d9 req-69935dc9-2a47-494d-9e50-3006ffa323bd tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=8a7c4077-25fa-451f-8052-c1f6ec25a13a HTTP/1.1" status: 200 len: 949 time: 0.0700011 Dec 09 21:18:29.406482 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fba66b41-2b31-4963-8f26-7ad4bc0f98e2 req-69168619-79b7-4a1f-8b6e-2c82261e8e70 service neutron] 10.222.0.31 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1437624 Dec 09 21:18:29.408459 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19988e4f-b138-4845-9b61-10e21c07c8d9 req-5a14c0df-b116-48ed-841b-ebee67b91fe3 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448987 Dec 09 21:18:29.558740 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-390cc69a-f9b7-41f7-80d4-565f994c5708 req-69ccb4f6-db76-4e71-b956-b6338dd7d93c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:29.560259 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-390cc69a-f9b7-41f7-80d4-565f994c5708 req-69ccb4f6-db76-4e71-b956-b6338dd7d93c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 1096 time: 0.0697455 Dec 09 21:18:29.570398 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-62751c57-bd77-4b76-aad2-8bc445332383 req-d846b1cf-1643-4dad-8239-7e9bd874e4b3 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:29.610293 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09f7a2bd-2a20-4f3f-b0b9-7981af501916 req-203687f1-de02-4a0a-bd85-4ed1adc21f50 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=8c21856f-2254-41e8-941c-2f4471714942 HTTP/1.1" status: 200 len: 210 time: 0.0361309 Dec 09 21:18:29.664292 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55992) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:29.685381 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a7c05000-4050-43fb-819a-1f36c2e8a4d1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:29.688542 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7bb758d-a9e1-43de-9e77-62eb0eb44999 req-35ce0bb0-40a0-4879-8997-8e109c34eec1 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:29.690033 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a7bb758d-a9e1-43de-9e77-62eb0eb44999 req-35ce0bb0-40a0-4879-8997-8e109c34eec1 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 944 time: 0.0523093 Dec 09 21:18:29.698582 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-62751c57-bd77-4b76-aad2-8bc445332383 req-d846b1cf-1643-4dad-8239-7e9bd874e4b3 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:29.711551 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['1cc3b771-7d24-4dfa-bbfe-6e007094c74b'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:18:29.714905 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['b75bad0f-5d42-4305-b970-f7b7298d2231'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:18:29.745085 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a7bb758d-a9e1-43de-9e77-62eb0eb44999 req-bf3eaa30-c845-4373-be77-5468cb987520 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0472989 Dec 09 21:18:29.779895 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:18:29.782052 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-62751c57-bd77-4b76-aad2-8bc445332383 req-d846b1cf-1643-4dad-8239-7e9bd874e4b3 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:18:29.783603 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-390cc69a-f9b7-41f7-80d4-565f994c5708 req-22a15474-c6bb-4c58-a94f-3c3ae0779158 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:29.785329 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-390cc69a-f9b7-41f7-80d4-565f994c5708 req-22a15474-c6bb-4c58-a94f-3c3ae0779158 service neutron] 10.222.0.31 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 908 time: 0.2091653 Dec 09 21:18:29.793542 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-62751c57-bd77-4b76-aad2-8bc445332383 req-d846b1cf-1643-4dad-8239-7e9bd874e4b3 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:18:29.795523 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f388c89b-f183-45c0-a887-e215e8f543b6 req-0acfbb31-86ba-4ec5-acf6-aff63119da94 tempest-DeleteServersAdminTestJSON-2035750040 tempest-DeleteServersAdminTestJSON-2035750040-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:29.797120 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f388c89b-f183-45c0-a887-e215e8f543b6 req-0acfbb31-86ba-4ec5-acf6-aff63119da94 tempest-DeleteServersAdminTestJSON-2035750040 tempest-DeleteServersAdminTestJSON-2035750040-project-admin] 10.222.0.10 "GET /v2.0/ports?device_id=8a7c4077-25fa-451f-8052-c1f6ec25a13a HTTP/1.1" status: 200 len: 1101 time: 0.0508714 Dec 09 21:18:29.804697 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-62751c57-bd77-4b76-aad2-8bc445332383 req-d846b1cf-1643-4dad-8239-7e9bd874e4b3 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:18:29.807019 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d846b1cf-1643-4dad-8239-7e9bd874e4b3 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Pushing event updated for resources: {'Port': ['ID=0fd74259-b2a4-42ff-b424-909c8f53a26a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:29.835332 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:18:29.835603 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 3fd5c53a-dd51-40cb-9c92-d83aa47ab67a not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:18:29.902239 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-f388c89b-f183-45c0-a887-e215e8f543b6 req-d988af26-5daa-433c-93b2-f700bc7c605d tempest-DeleteServersAdminTestJSON-2035750040 tempest-DeleteServersAdminTestJSON-2035750040-project-admin] Deleting port 8ea7a94c-568e-46ea-954a-d61e6f1f0b18 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:18:29.902757 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f388c89b-f183-45c0-a887-e215e8f543b6 req-d988af26-5daa-433c-93b2-f700bc7c605d tempest-DeleteServersAdminTestJSON-2035750040 tempest-DeleteServersAdminTestJSON-2035750040-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:29.911761 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62751c57-bd77-4b76-aad2-8bc445332383 req-d846b1cf-1643-4dad-8239-7e9bd874e4b3 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:29.912920 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-62751c57-bd77-4b76-aad2-8bc445332383 req-d846b1cf-1643-4dad-8239-7e9bd874e4b3 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:29.924728 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-390cc69a-f9b7-41f7-80d4-565f994c5708 req-c1e29648-08c5-4092-9b09-a5c0380a01df service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 HTTP/1.1" status: 200 len: 217 time: 0.1279187 Dec 09 21:18:29.961347 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-62751c57-bd77-4b76-aad2-8bc445332383 req-d846b1cf-1643-4dad-8239-7e9bd874e4b3 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 936 time: 1.1944344 Dec 09 21:18:29.986400 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-62751c57-bd77-4b76-aad2-8bc445332383 req-c19471f6-1f49-4732-8bad-76ed0642840b service neutron] Request body: {'port': {'device_id': '8c21856f-2254-41e8-941c-2f4471714942', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:30.023149 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f5660e5-4d8f-4472-8376-b8479902db83 req-a4cc91d1-2190-40b2-b540-8aa2a54ce12b tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:30.031653 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f5660e5-4d8f-4472-8376-b8479902db83 req-a4cc91d1-2190-40b2-b540-8aa2a54ce12b tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 945 time: 0.1145453 Dec 09 21:18:30.062626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-f388c89b-f183-45c0-a887-e215e8f543b6 req-d988af26-5daa-433c-93b2-f700bc7c605d tempest-DeleteServersAdminTestJSON-2035750040 tempest-DeleteServersAdminTestJSON-2035750040-project-admin] For port 8ea7a94c-568e-46ea-954a-d61e6f1f0b18, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=8ea7a94c-568e-46ea-954a-d61e6f1f0b18,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:30.062995 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f388c89b-f183-45c0-a887-e215e8f543b6 req-d988af26-5daa-433c-93b2-f700bc7c605d tempest-DeleteServersAdminTestJSON-2035750040 tempest-DeleteServersAdminTestJSON-2035750040-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:30.084149 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-f388c89b-f183-45c0-a887-e215e8f543b6 req-d988af26-5daa-433c-93b2-f700bc7c605d tempest-DeleteServersAdminTestJSON-2035750040 tempest-DeleteServersAdminTestJSON-2035750040-project-admin] Calling delete_port for 8ea7a94c-568e-46ea-954a-d61e6f1f0b18 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:18:30.090261 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-62751c57-bd77-4b76-aad2-8bc445332383 req-c19471f6-1f49-4732-8bad-76ed0642840b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:30.095377 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-390cc69a-f9b7-41f7-80d4-565f994c5708 req-07375178-3364-4ed7-85ec-ca7df7f36e96 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:30.096915 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-390cc69a-f9b7-41f7-80d4-565f994c5708 req-07375178-3364-4ed7-85ec-ca7df7f36e96 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=eae2438b-9fcc-44ef-a172-6c4911cad13f HTTP/1.1" status: 200 len: 847 time: 0.1523983 Dec 09 21:18:30.098991 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a7c05000-4050-43fb-819a-1f36c2e8a4d1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:30.111848 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f5660e5-4d8f-4472-8376-b8479902db83 req-d8ca6abd-a6b7-4b12-844a-739fb31f424a tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/security-groups?id=174c6f0d-c012-4077-858c-aa2b94e54d38&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0792549 Dec 09 21:18:30.117645 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a7c05000-4050-43fb-819a-1f36c2e8a4d1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:30.154778 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-120262c0-2474-46d3-a16b-0fe4e5f4c838 None None] Provisioning complete for port 0fd74259-b2a4-42ff-b424-909c8f53a26a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:30.155646 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-120262c0-2474-46d3-a16b-0fe4e5f4c838 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:30.158549 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-390cc69a-f9b7-41f7-80d4-565f994c5708 req-77fb6125-ff76-4029-b3ab-7467b194dacc service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=04fa749a-9f72-4a2c-a725-feab917f99ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0512969 Dec 09 21:18:30.207312 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-120262c0-2474-46d3-a16b-0fe4e5f4c838 None None] Port 0fd74259-b2a4-42ff-b424-909c8f53a26a cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:18:30.222638 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7c05000-4050-43fb-819a-1f36c2e8a4d1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a05fed77-7445-4600-9e36-06273c240858,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:30.231311 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a7c05000-4050-43fb-819a-1f36c2e8a4d1 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ff4ae5d1f07b459e82737774d2447296&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5659771 Dec 09 21:18:30.233882 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56000) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:30.425332 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea7787ad-cf58-4c0f-ae3a-d7cae652492c req-24049746-884d-4d58-ae67-93e9089894c8 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:30.426236 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8a336c4-3da6-4b76-93ba-fa34cc97273a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:30.427061 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea7787ad-cf58-4c0f-ae3a-d7cae652492c req-24049746-884d-4d58-ae67-93e9089894c8 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 945 time: 0.2002082 Dec 09 21:18:30.433769 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-30d7c2ca-2aa9-416f-a3f8-ac5477294195 req-352fdd16-cf81-4088-b39f-35493807dd22 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 0.2873609 Dec 09 21:18:30.436530 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-390cc69a-f9b7-41f7-80d4-565f994c5708 req-6b684347-f0a2-45c8-9fdf-6048e1fb63c3 service neutron] 10.222.0.31 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2435064 Dec 09 21:18:30.456991 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-30d7c2ca-2aa9-416f-a3f8-ac5477294195 req-c5c89d8d-76fe-4806-9eee-9fb504d3b314 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:30.474774 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f388c89b-f183-45c0-a887-e215e8f543b6 req-d988af26-5daa-433c-93b2-f700bc7c605d tempest-DeleteServersAdminTestJSON-2035750040 tempest-DeleteServersAdminTestJSON-2035750040-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:30.497262 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['8ea7a94c-568e-46ea-954a-d61e6f1f0b18'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:18:30.521534 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8a336c4-3da6-4b76-93ba-fa34cc97273a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:30.524003 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d988af26-5daa-433c-93b2-f700bc7c605d tempest-DeleteServersAdminTestJSON-2035750040 tempest-DeleteServersAdminTestJSON-2035750040-project-admin] Pushing event deleted for resources: {'Port': ['ID=8ea7a94c-568e-46ea-954a-d61e6f1f0b18,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:30.529458 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-30d7c2ca-2aa9-416f-a3f8-ac5477294195 req-c5c89d8d-76fe-4806-9eee-9fb504d3b314 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:30.538237 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea7787ad-cf58-4c0f-ae3a-d7cae652492c req-a1dde6f3-b3f4-4c91-a85c-e36983d51b46 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1034727 Dec 09 21:18:30.591867 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-f388c89b-f183-45c0-a887-e215e8f543b6 req-d988af26-5daa-433c-93b2-f700bc7c605d tempest-DeleteServersAdminTestJSON-2035750040 tempest-DeleteServersAdminTestJSON-2035750040-project-admin] No DVR routers for this DVR port 8ea7a94c-568e-46ea-954a-d61e6f1f0b18 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:18:30.611297 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f388c89b-f183-45c0-a887-e215e8f543b6 req-d988af26-5daa-433c-93b2-f700bc7c605d tempest-DeleteServersAdminTestJSON-2035750040 tempest-DeleteServersAdminTestJSON-2035750040-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:30.615636 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f388c89b-f183-45c0-a887-e215e8f543b6 req-d988af26-5daa-433c-93b2-f700bc7c605d tempest-DeleteServersAdminTestJSON-2035750040 tempest-DeleteServersAdminTestJSON-2035750040-project-admin] 10.222.0.10 "DELETE /v2.0/ports/8ea7a94c-568e-46ea-954a-d61e6f1f0b18 HTTP/1.1" status: 204 len: 173 time: 0.8105345 Dec 09 21:18:30.637059 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8a7c4077-25fa-451f-8052-c1f6ec25a13a', 'name': 'network-vif-deleted', 'tag': '8ea7a94c-568e-46ea-954a-d61e6f1f0b18'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:30.640155 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e99861de-aad9-40a8-bcc1-18bddf9def25" -d '{"events": [{"server_uuid": "8a7c4077-25fa-451f-8052-c1f6ec25a13a", "name": "network-vif-deleted", "tag": "8ea7a94c-568e-46ea-954a-d61e6f1f0b18"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:30.713343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9672747f-fda9-4aa6-bfbb-a07fc667013f req-e88aa36b-f875-4e68-a874-b049111e9c2c tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:30.715185 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9672747f-fda9-4aa6-bfbb-a07fc667013f req-e88aa36b-f875-4e68-a874-b049111e9c2c tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.31 "GET /v2.0/ports?device_id=548538cf-319a-4465-9a2b-f54718ee91be HTTP/1.1" status: 200 len: 972 time: 0.1243885 Dec 09 21:18:30.735025 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-390cc69a-f9b7-41f7-80d4-565f994c5708 req-6b9b3d6b-5505-4b7f-9014-5eea29481c49 service neutron] 10.222.0.31 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2857273 Dec 09 21:18:30.742764 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8a336c4-3da6-4b76-93ba-fa34cc97273a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:30.747138 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8a336c4-3da6-4b76-93ba-fa34cc97273a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:30.759793 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f8a336c4-3da6-4b76-93ba-fa34cc97273a admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/a05fed77-7445-4600-9e36-06273c240858 HTTP/1.1" status: 204 len: 168 time: 0.5221593 Dec 09 21:18:30.790938 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8a336c4-3da6-4b76-93ba-fa34cc97273a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a05fed77-7445-4600-9e36-06273c240858,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:30.836250 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-62751c57-bd77-4b76-aad2-8bc445332383 req-c19471f6-1f49-4732-8bad-76ed0642840b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0fd74259-b2a4-42ff-b424-909c8f53a26a {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:18:30.848676 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-62751c57-bd77-4b76-aad2-8bc445332383 req-c19471f6-1f49-4732-8bad-76ed0642840b service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:30.862130 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-62751c57-bd77-4b76-aad2-8bc445332383 req-c19471f6-1f49-4732-8bad-76ed0642840b service neutron] Transition to ACTIVE for port object 0fd74259-b2a4-42ff-b424-909c8f53a26a will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:18:30.866454 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-62751c57-bd77-4b76-aad2-8bc445332383 req-c19471f6-1f49-4732-8bad-76ed0642840b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:30.898152 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a10ada65-8d14-41f9-8e92-ad0ec17251b8 req-f850c67f-a076-4f07-8cbc-02ba2338f835 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:30.899931 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a10ada65-8d14-41f9-8e92-ad0ec17251b8 req-f850c67f-a076-4f07-8cbc-02ba2338f835 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/ports?device_id=548538cf-319a-4465-9a2b-f54718ee91be HTTP/1.1" status: 200 len: 972 time: 0.1372497 Dec 09 21:18:30.902790 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-30d7c2ca-2aa9-416f-a3f8-ac5477294195 req-c5c89d8d-76fe-4806-9eee-9fb504d3b314 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:30.983725 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-9672747f-fda9-4aa6-bfbb-a07fc667013f req-ce5f313a-738a-4b09-a550-40761d499596 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Deleting port 37ba309b-f598-4b1e-b3e8-35aa21ab14d3 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:18:30.984057 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9672747f-fda9-4aa6-bfbb-a07fc667013f req-ce5f313a-738a-4b09-a550-40761d499596 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:31.085840 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a10ada65-8d14-41f9-8e92-ad0ec17251b8 req-44db77f6-8fd5-4175-80a6-bcbfed4b8c2d tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.13 "GET /v2.0/security-groups?id=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1757455 Dec 09 21:18:31.150211 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-9672747f-fda9-4aa6-bfbb-a07fc667013f req-ce5f313a-738a-4b09-a550-40761d499596 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] For port 37ba309b-f598-4b1e-b3e8-35aa21ab14d3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=37ba309b-f598-4b1e-b3e8-35aa21ab14d3,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:31.150575 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9672747f-fda9-4aa6-bfbb-a07fc667013f req-ce5f313a-738a-4b09-a550-40761d499596 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:31.168638 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-30d7c2ca-2aa9-416f-a3f8-ac5477294195 req-c5c89d8d-76fe-4806-9eee-9fb504d3b314 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Allocated IP 172.25.3.216 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/d5b810b2-1858-4439-ae58-52254c24a838) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:18:31.175643 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-9672747f-fda9-4aa6-bfbb-a07fc667013f req-ce5f313a-738a-4b09-a550-40761d499596 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Calling delete_port for 37ba309b-f598-4b1e-b3e8-35aa21ab14d3 owned by compute:tempest-test_az-1650541094 {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:18:31.217341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c19471f6-1f49-4732-8bad-76ed0642840b service neutron] Pushing event updated for resources: {'Port': ['ID=0fd74259-b2a4-42ff-b424-909c8f53a26a,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:31.307265 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-62751c57-bd77-4b76-aad2-8bc445332383 req-c19471f6-1f49-4732-8bad-76ed0642840b service neutron] Attempting to bind port 0fd74259-b2a4-42ff-b424-909c8f53a26a on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:18:31.307638 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-62751c57-bd77-4b76-aad2-8bc445332383 req-c19471f6-1f49-4732-8bad-76ed0642840b service neutron] Attempting to bind port 0fd74259-b2a4-42ff-b424-909c8f53a26a by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:18:31.307972 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62751c57-bd77-4b76-aad2-8bc445332383 req-c19471f6-1f49-4732-8bad-76ed0642840b service neutron] Attempting to bind port 0fd74259-b2a4-42ff-b424-909c8f53a26a on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:31.320912 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62751c57-bd77-4b76-aad2-8bc445332383 req-c19471f6-1f49-4732-8bad-76ed0642840b service neutron] Port 0fd74259-b2a4-42ff-b424-909c8f53a26a on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:18:31.321255 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62751c57-bd77-4b76-aad2-8bc445332383 req-c19471f6-1f49-4732-8bad-76ed0642840b service neutron] Attempting to bind port 0fd74259-b2a4-42ff-b424-909c8f53a26a on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:31.327519 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62751c57-bd77-4b76-aad2-8bc445332383 req-c19471f6-1f49-4732-8bad-76ed0642840b service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 18, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:18:31.327868 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62751c57-bd77-4b76-aad2-8bc445332383 req-c19471f6-1f49-4732-8bad-76ed0642840b service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:18:31.328269 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62751c57-bd77-4b76-aad2-8bc445332383 req-c19471f6-1f49-4732-8bad-76ed0642840b service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:18:31.328759 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-62751c57-bd77-4b76-aad2-8bc445332383 req-c19471f6-1f49-4732-8bad-76ed0642840b service neutron] Bound port: 0fd74259-b2a4-42ff-b424-909c8f53a26a, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:18:31.329169 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-62751c57-bd77-4b76-aad2-8bc445332383 req-c19471f6-1f49-4732-8bad-76ed0642840b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:31.335305 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c3f25f4-1168-4514-962d-4351b9bbfebb req-31e0a042-7fad-40d0-bfa9-52aacf556fe6 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=8a7c4077-25fa-451f-8052-c1f6ec25a13a HTTP/1.1" status: 200 len: 210 time: 0.0792494 Dec 09 21:18:31.428816 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-62751c57-bd77-4b76-aad2-8bc445332383 req-c19471f6-1f49-4732-8bad-76ed0642840b service neutron] For port 0fd74259-b2a4-42ff-b424-909c8f53a26a, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:18:31.435523 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-30d7c2ca-2aa9-416f-a3f8-ac5477294195 req-c5c89d8d-76fe-4806-9eee-9fb504d3b314 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:31.438794 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-62751c57-bd77-4b76-aad2-8bc445332383 req-c19471f6-1f49-4732-8bad-76ed0642840b service neutron] For port 0fd74259-b2a4-42ff-b424-909c8f53a26a, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=0fd74259-b2a4-42ff-b424-909c8f53a26a,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:18:31.448633 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-62751c57-bd77-4b76-aad2-8bc445332383 req-c19471f6-1f49-4732-8bad-76ed0642840b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:31.487425 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62751c57-bd77-4b76-aad2-8bc445332383 req-c19471f6-1f49-4732-8bad-76ed0642840b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:31.488128 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-62751c57-bd77-4b76-aad2-8bc445332383 req-c19471f6-1f49-4732-8bad-76ed0642840b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:31.489535 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-62751c57-bd77-4b76-aad2-8bc445332383 req-c19471f6-1f49-4732-8bad-76ed0642840b service neutron] 10.222.0.10 "PUT /v2.0/ports/0fd74259-b2a4-42ff-b424-909c8f53a26a HTTP/1.1" status: 200 len: 1095 time: 1.5084183 Dec 09 21:18:31.490068 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8c21856f-2254-41e8-941c-2f4471714942', 'tag': '0fd74259-b2a4-42ff-b424-909c8f53a26a'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:31.492310 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-404d71af-f4ac-464f-8103-16c95e5b647e" -d '{"events": [{"name": "network-changed", "server_uuid": "8c21856f-2254-41e8-941c-2f4471714942", "tag": "0fd74259-b2a4-42ff-b424-909c8f53a26a"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:31.541326 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c19471f6-1f49-4732-8bad-76ed0642840b service neutron] Pushing event updated for resources: {'Port': ['ID=0fd74259-b2a4-42ff-b424-909c8f53a26a,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:31.587115 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9672747f-fda9-4aa6-bfbb-a07fc667013f req-ce5f313a-738a-4b09-a550-40761d499596 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:31.596531 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-30d7c2ca-2aa9-416f-a3f8-ac5477294195 req-c5c89d8d-76fe-4806-9eee-9fb504d3b314 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:31.603512 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['37ba309b-f598-4b1e-b3e8-35aa21ab14d3'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:18:31.636264 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62751c57-bd77-4b76-aad2-8bc445332383 req-b007b3b8-6489-4459-9142-1f9522ae685c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:31.639237 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-62751c57-bd77-4b76-aad2-8bc445332383 req-b007b3b8-6489-4459-9142-1f9522ae685c service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=6a32a636fa83452db185eb0152d6082d&device_id=8c21856f-2254-41e8-941c-2f4471714942 HTTP/1.1" status: 200 len: 1098 time: 0.0839624 Dec 09 21:18:31.641473 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce5f313a-738a-4b09-a550-40761d499596 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Pushing event deleted for resources: {'Port': ['ID=37ba309b-f598-4b1e-b3e8-35aa21ab14d3,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:31.692131 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-62751c57-bd77-4b76-aad2-8bc445332383 req-8f6cc136-68eb-405a-943b-95ae5b6ebdb4 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.9&port_id=0fd74259-b2a4-42ff-b424-909c8f53a26a HTTP/1.1" status: 200 len: 217 time: 0.0409234 Dec 09 21:18:31.706625 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5c89d8d-76fe-4806-9eee-9fb504d3b314 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Pushing event updated for resources: {'Port': ['ID=d5b810b2-1858-4439-ae58-52254c24a838,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:31.739404 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-30d7c2ca-2aa9-416f-a3f8-ac5477294195 req-c5c89d8d-76fe-4806-9eee-9fb504d3b314 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:18:31.767282 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-30d7c2ca-2aa9-416f-a3f8-ac5477294195 req-c5c89d8d-76fe-4806-9eee-9fb504d3b314 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:18:31.776459 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62751c57-bd77-4b76-aad2-8bc445332383 req-c3a5257d-8ce6-49a8-8ba7-3b89c180bdbc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:31.777953 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-62751c57-bd77-4b76-aad2-8bc445332383 req-c3a5257d-8ce6-49a8-8ba7-3b89c180bdbc service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0765429 Dec 09 21:18:31.782657 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-9672747f-fda9-4aa6-bfbb-a07fc667013f req-ce5f313a-738a-4b09-a550-40761d499596 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] No DVR routers for this DVR port 37ba309b-f598-4b1e-b3e8-35aa21ab14d3 on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:18:31.784623 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-30d7c2ca-2aa9-416f-a3f8-ac5477294195 req-c5c89d8d-76fe-4806-9eee-9fb504d3b314 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:18:31.788309 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9672747f-fda9-4aa6-bfbb-a07fc667013f req-ce5f313a-738a-4b09-a550-40761d499596 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:31.791609 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9672747f-fda9-4aa6-bfbb-a07fc667013f req-ce5f313a-738a-4b09-a550-40761d499596 tempest-LiveMigrationNegativeTest-1615694518 tempest-LiveMigrationNegativeTest-1615694518-project] 10.222.0.31 "DELETE /v2.0/ports/37ba309b-f598-4b1e-b3e8-35aa21ab14d3 HTTP/1.1" status: 204 len: 173 time: 1.0685549 Dec 09 21:18:31.845239 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62751c57-bd77-4b76-aad2-8bc445332383 req-0ed98106-6d8b-47d4-8044-895d568e8fba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:31.848141 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-62751c57-bd77-4b76-aad2-8bc445332383 req-0ed98106-6d8b-47d4-8044-895d568e8fba service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0624180 Dec 09 21:18:31.848764 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51ab7b0b-6520-4f0a-b4b6-9802031d4b17 req-5a6533ca-2596-467f-8451-2b31f13e265d tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:31.856292 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51ab7b0b-6520-4f0a-b4b6-9802031d4b17 req-5a6533ca-2596-467f-8451-2b31f13e265d tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 1097 time: 0.1223524 Dec 09 21:18:31.945726 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51ab7b0b-6520-4f0a-b4b6-9802031d4b17 req-c85b5fd0-f074-4603-857f-b6d16a35ee4d tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0832243 Dec 09 21:18:31.951154 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-30d7c2ca-2aa9-416f-a3f8-ac5477294195 req-c5c89d8d-76fe-4806-9eee-9fb504d3b314 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:31.980962 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-62751c57-bd77-4b76-aad2-8bc445332383 req-f9147e4d-72c4-484c-a7bc-d6b69fb3a739 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1199040 Dec 09 21:18:32.015944 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-30d7c2ca-2aa9-416f-a3f8-ac5477294195 req-c5c89d8d-76fe-4806-9eee-9fb504d3b314 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:32.155115 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-62751c57-bd77-4b76-aad2-8bc445332383 req-6c175f5e-a7c9-44d5-9658-e44c947e05d3 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1584699 Dec 09 21:18:32.238208 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0801f96-2d16-419d-8ebb-c38073029026 req-50080cf7-475e-4521-a12d-8502c5eabd48 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:32.239252 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c0801f96-2d16-419d-8ebb-c38073029026 req-50080cf7-475e-4521-a12d-8502c5eabd48 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=8c21856f-2254-41e8-941c-2f4471714942 HTTP/1.1" status: 200 len: 946 time: 0.0886467 Dec 09 21:18:32.290106 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-30d7c2ca-2aa9-416f-a3f8-ac5477294195 req-c5c89d8d-76fe-4806-9eee-9fb504d3b314 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:32.299303 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-30d7c2ca-2aa9-416f-a3f8-ac5477294195 req-c5c89d8d-76fe-4806-9eee-9fb504d3b314 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:32.445369 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c0801f96-2d16-419d-8ebb-c38073029026 req-9abe3dce-2258-4c3f-b367-e184e0d50e73 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1921644 Dec 09 21:18:32.449994 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5c89d8d-76fe-4806-9eee-9fb504d3b314 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Pushing event updated for resources: {'Port': ['ID=d5b810b2-1858-4439-ae58-52254c24a838,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:32.462352 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-30d7c2ca-2aa9-416f-a3f8-ac5477294195 req-c5c89d8d-76fe-4806-9eee-9fb504d3b314 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:32.489230 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-30d7c2ca-2aa9-416f-a3f8-ac5477294195 req-c5c89d8d-76fe-4806-9eee-9fb504d3b314 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:32.490785 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-30d7c2ca-2aa9-416f-a3f8-ac5477294195 req-c5c89d8d-76fe-4806-9eee-9fb504d3b314 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 698 time: 2.0463946 Dec 09 21:18:32.533894 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-27083db3-f0df-4fce-97b9-60991b035ab4 x-openstack-request-id: req-27083db3-f0df-4fce-97b9-60991b035ab4 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:32.534198 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8a7c4077-25fa-451f-8052-c1f6ec25a13a", "name": "network-vif-deleted", "tag": "8ea7a94c-568e-46ea-954a-d61e6f1f0b18", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:32.534478 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-27083db3-f0df-4fce-97b9-60991b035ab4 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:32.534871 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8a7c4077-25fa-451f-8052-c1f6ec25a13a', 'name': 'network-vif-deleted', 'tag': '8ea7a94c-568e-46ea-954a-d61e6f1f0b18', 'status': 'completed', 'code': 200} Dec 09 21:18:32.578720 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-30d7c2ca-2aa9-416f-a3f8-ac5477294195 req-8907175d-8e7e-494f-b2fa-76b54b4e002c tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.216 HTTP/1.1" status: 200 len: 696 time: 0.0802546 Dec 09 21:18:32.927705 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6ae779d1-ee32-4a42-a330-e256d3e31c7a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:32.952275 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c292bf5-f813-499f-8832-1425913c5097 req-55700fb6-c00f-4b58-97d3-41ebb2829001 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:32.953759 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c292bf5-f813-499f-8832-1425913c5097 req-55700fb6-c00f-4b58-97d3-41ebb2829001 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 944 time: 0.3591840 Dec 09 21:18:32.986715 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30d7c2ca-2aa9-416f-a3f8-ac5477294195 req-f9dc8dd4-b22c-40f2-8430-5056a34fcffe tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:32.988021 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-30d7c2ca-2aa9-416f-a3f8-ac5477294195 req-f9dc8dd4-b22c-40f2-8430-5056a34fcffe tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.4029987 Dec 09 21:18:33.005133 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-30d7c2ca-2aa9-416f-a3f8-ac5477294195 req-d6944916-acf1-4d3a-a96d-c9f49291b019 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:18:33.006101 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-30d7c2ca-2aa9-416f-a3f8-ac5477294195 req-d6944916-acf1-4d3a-a96d-c9f49291b019 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0108893 Dec 09 21:18:33.047900 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c292bf5-f813-499f-8832-1425913c5097 req-3436b41a-4883-43c2-9518-7176505f3316 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0786903 Dec 09 21:18:33.055534 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3fe33086-5fdb-4cc3-baaa-c524e3fe7926 x-openstack-request-id: req-3fe33086-5fdb-4cc3-baaa-c524e3fe7926 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:33.056103 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8c21856f-2254-41e8-941c-2f4471714942", "tag": "0fd74259-b2a4-42ff-b424-909c8f53a26a", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:33.056103 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-3fe33086-5fdb-4cc3-baaa-c524e3fe7926 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:33.056468 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8c21856f-2254-41e8-941c-2f4471714942', 'tag': '0fd74259-b2a4-42ff-b424-909c8f53a26a', 'status': 'completed', 'code': 200} Dec 09 21:18:33.141287 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-404d71af-f4ac-464f-8103-16c95e5b647e req-8503a6ef-3ab4-4b64-af99-cfba82088ca8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:33.143964 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-404d71af-f4ac-464f-8103-16c95e5b647e req-8503a6ef-3ab4-4b64-af99-cfba82088ca8 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=6a32a636fa83452db185eb0152d6082d&device_id=8c21856f-2254-41e8-941c-2f4471714942 HTTP/1.1" status: 200 len: 1098 time: 0.0515313 Dec 09 21:18:33.183164 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-685b65d4-c587-4cc0-8457-e83475fbaac3 req-3499a71c-e75b-451d-b62a-19e8a1415729 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:33.190895 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-685b65d4-c587-4cc0-8457-e83475fbaac3 req-3499a71c-e75b-451d-b62a-19e8a1415729 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 1097 time: 0.0697553 Dec 09 21:18:33.272268 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-685b65d4-c587-4cc0-8457-e83475fbaac3 req-d167feb0-becc-4d12-babb-35363a294002 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0804641 Dec 09 21:18:33.371178 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-404d71af-f4ac-464f-8103-16c95e5b647e req-359df7a3-ca4a-446a-86d9-5c9c634f189d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:33.372780 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-404d71af-f4ac-464f-8103-16c95e5b647e req-359df7a3-ca4a-446a-86d9-5c9c634f189d service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.2212975 Dec 09 21:18:33.436342 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-404d71af-f4ac-464f-8103-16c95e5b647e req-ec8a610d-e421-4ee9-bdfe-4c37a645d6d4 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.9&port_id=0fd74259-b2a4-42ff-b424-909c8f53a26a HTTP/1.1" status: 200 len: 217 time: 0.0552220 Dec 09 21:18:33.511699 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-404d71af-f4ac-464f-8103-16c95e5b647e req-751378a6-0f53-4aaa-a1e8-b5b7e2778ae8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:33.513292 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-404d71af-f4ac-464f-8103-16c95e5b647e req-751378a6-0f53-4aaa-a1e8-b5b7e2778ae8 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0695188 Dec 09 21:18:33.587646 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-404d71af-f4ac-464f-8103-16c95e5b647e req-988ccae6-cbc9-4e16-a01f-18637a2d3045 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:33.589170 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-404d71af-f4ac-464f-8103-16c95e5b647e req-988ccae6-cbc9-4e16-a01f-18637a2d3045 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0678203 Dec 09 21:18:33.598734 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56100) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:33.685828 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-4a0c0ae2-e318-466e-a111-59875408cc2a tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:33.695029 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-4a0c0ae2-e318-466e-a111-59875408cc2a tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/networks?id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 HTTP/1.1" status: 200 len: 821 time: 0.2064497 Dec 09 21:18:33.699306 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-404d71af-f4ac-464f-8103-16c95e5b647e req-6617170f-4d7b-4aca-81d3-3f4f12615700 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1020770 Dec 09 21:18:33.716320 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-aa408186-b226-4661-99e8-67fd783c626f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/quotas/920e0419877f4239b048e126682274e9 HTTP/1.1" status: 200 len: 375 time: 0.0200400 Dec 09 21:18:33.798411 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:18:33.832955 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-1587edaf-4056-42c1-9bec-9d6eddc5901b tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=920e0419877f4239b048e126682274e9&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1141307 Dec 09 21:18:33.866526 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 8ea7a94c-568e-46ea-954a-d61e6f1f0b18 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:18:33.874127 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-404d71af-f4ac-464f-8103-16c95e5b647e req-75d6de46-6541-41e8-9f72-9b509b459668 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1656318 Dec 09 21:18:33.884730 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8bbda2bc-7791-43a0-aa46-a449ca27ea67 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=97c6f11d72db4857afd32603bdfd0616&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2639313 Dec 09 21:18:33.884977 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56114) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:33.926070 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 8ea7a94c-568e-46ea-954a-d61e6f1f0b18 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:18:33.926963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 8ea7a94c-568e-46ea-954a-d61e6f1f0b18 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:18:33.942153 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-35e0c08d-20ba-4de9-a3b7-5f21375af6d3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:33.958046 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-257514bc-98a2-4a47-8465-e6f7454bbf6b tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=10c237cbfa28423ea2d1df15f60193f2&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0513642 Dec 09 21:18:33.965891 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-35e0c08d-20ba-4de9-a3b7-5f21375af6d3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:33.991371 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:34.004413 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'ecb95cc0-98d6-4980-b73e-2bc2c2df48f3', 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef', 'port_id': 'ecb95cc0-98d6-4980-b73e-2bc2c2df48f3', 'mac_address': 'fa:16:3e:6a:74:f1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 138, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'eae2438b-9fcc-44ef-a172-6c4911cad13f', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:18:34.024085 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-35e0c08d-20ba-4de9-a3b7-5f21375af6d3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:34.026783 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-35e0c08d-20ba-4de9-a3b7-5f21375af6d3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:34.027526 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-b4037030-ccb8-47c1-ad44-c37f743e2d2a service neutron] 10.222.0.13 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1857400 Dec 09 21:18:34.030832 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-35e0c08d-20ba-4de9-a3b7-5f21375af6d3 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/b6f5fcbc-4de6-4e7d-bbba-67629aba06d6 HTTP/1.1" status: 204 len: 168 time: 0.1419902 Dec 09 21:18:34.037168 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35e0c08d-20ba-4de9-a3b7-5f21375af6d3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b6f5fcbc-4de6-4e7d-bbba-67629aba06d6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:34.068137 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:34.082357 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:18:34.102937 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:34.108549 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:34.163354 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:34.184282 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-fffd110e-066c-46e3-86f8-26291b4ff668 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:34.185766 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-fffd110e-066c-46e3-86f8-26291b4ff668 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2213278 Dec 09 21:18:34.217647 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-9a0f87c5-13a5-480b-8ea5-3763b194a1b0 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/quotas/10c237cbfa28423ea2d1df15f60193f2 HTTP/1.1" status: 200 len: 375 time: 0.0247810 Dec 09 21:18:34.220125 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-beddd61b-b6b2-49e6-86e7-0def8cef329e service neutron] 10.222.0.13 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1913714 Dec 09 21:18:34.268029 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-fcc46df2-8003-45b2-85ee-55a0918dc1b3 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=10c237cbfa28423ea2d1df15f60193f2&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0360663 Dec 09 21:18:34.351823 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['ecb95cc0-98d6-4980-b73e-2bc2c2df48f3'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:18:34.430155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56132) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:34.531667 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1897568f-579b-4fc2-892c-e2ba01b7832c req-efe95e27-b06f-4459-85f2-e9ee32fbf843 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:34.541769 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1897568f-579b-4fc2-892c-e2ba01b7832c req-efe95e27-b06f-4459-85f2-e9ee32fbf843 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=8c21856f-2254-41e8-941c-2f4471714942 HTTP/1.1" status: 200 len: 946 time: 0.0793872 Dec 09 21:18:34.543712 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '548538cf-319a-4465-9a2b-f54718ee91be', 'name': 'network-vif-deleted', 'tag': '37ba309b-f598-4b1e-b3e8-35aa21ab14d3'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:34.546132 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-55fce4f5-75b5-4b4f-bc1c-3d55dd83352c" -d '{"events": [{"server_uuid": "548538cf-319a-4465-9a2b-f54718ee91be", "name": "network-vif-deleted", "tag": "37ba309b-f598-4b1e-b3e8-35aa21ab14d3"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:34.570196 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-288923b9-1b67-4314-9d42-ba60b2ec1558 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=9e543d4f99f846bbb59e4629db9f3499&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1366584 Dec 09 21:18:34.571920 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56144) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:34.614921 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1897568f-579b-4fc2-892c-e2ba01b7832c req-903c950f-6cde-4631-a495-f06087b46f30 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0724733 Dec 09 21:18:34.627360 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd9e384a-3fe1-429f-9055-23efb4423138 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:34.652224 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd9e384a-3fe1-429f-9055-23efb4423138 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:34.718876 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd9e384a-3fe1-429f-9055-23efb4423138 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:34.723522 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd9e384a-3fe1-429f-9055-23efb4423138 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:34.725023 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fd9e384a-3fe1-429f-9055-23efb4423138 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/ec910aa3-96ca-49e3-aec9-22c8522deec8 HTTP/1.1" status: 204 len: 168 time: 0.1520135 Dec 09 21:18:34.737115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9e384a-3fe1-429f-9055-23efb4423138 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ec910aa3-96ca-49e3-aec9-22c8522deec8,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:34.758457 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab12e42e-e5a6-4a65-b249-1d4bce054d84 req-af403cc2-dede-4c1c-a37b-105229b57f77 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:34.768524 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab12e42e-e5a6-4a65-b249-1d4bce054d84 req-af403cc2-dede-4c1c-a37b-105229b57f77 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 945 time: 0.0801930 Dec 09 21:18:34.852081 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab12e42e-e5a6-4a65-b249-1d4bce054d84 req-7b8e7297-7a43-4272-a601-c3283348838d tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0761094 Dec 09 21:18:35.021180 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2400df8d-b8c4-4b78-a003-25492f14a7b7 req-590e4be6-39fe-4879-8d4b-38d458c7e8bc tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=3d45a57e-5f03-4541-88f7-1194f195f63e HTTP/1.1" status: 200 len: 210 time: 0.0509005 Dec 09 21:18:35.139781 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-418dc2a6-9dcb-4655-b1a1-8e9ef8189199 req-8b7b2a6d-6292-45d4-84d2-6313340fe938 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=a40f9b82-e796-4cd4-b12e-cd2089ff7c19 HTTP/1.1" status: 200 len: 210 time: 0.0438242 Dec 09 21:18:35.187596 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a1a30f5b-9dd8-4d0e-912a-daf158791830 x-openstack-request-id: req-a1a30f5b-9dd8-4d0e-912a-daf158791830 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:35.188204 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "548538cf-319a-4465-9a2b-f54718ee91be", "name": "network-vif-deleted", "tag": "37ba309b-f598-4b1e-b3e8-35aa21ab14d3", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:35.188469 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a1a30f5b-9dd8-4d0e-912a-daf158791830 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:35.189166 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '548538cf-319a-4465-9a2b-f54718ee91be', 'name': 'network-vif-deleted', 'tag': '37ba309b-f598-4b1e-b3e8-35aa21ab14d3', 'status': 'completed', 'code': 200} Dec 09 21:18:35.474335 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c2d7b404-77ac-4f15-90d9-64a37f0735ac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:35.754805 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-645390e0-06b5-4b3f-90e2-c186ca319287 req-ab0413cc-c95f-4c35-8949-fd883bf5de3d tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:35.761916 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-645390e0-06b5-4b3f-90e2-c186ca319287 req-ab0413cc-c95f-4c35-8949-fd883bf5de3d tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=8c21856f-2254-41e8-941c-2f4471714942 HTTP/1.1" status: 200 len: 946 time: 0.0689373 Dec 09 21:18:35.811157 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:18:35.816813 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-a640bfd7-d7d7-44c4-a567-9e4a0c50aaab tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=10c237cbfa28423ea2d1df15f60193f2&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0534976 Dec 09 21:18:35.860948 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 0fd74259-b2a4-42ff-b424-909c8f53a26a details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:18:35.968333 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-645390e0-06b5-4b3f-90e2-c186ca319287 req-f25e78e8-c9fc-41c8-b800-3e52b88b47a7 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1603289 Dec 09 21:18:36.041121 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:18:36.057990 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:36.058603 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:36.117206 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 0fd74259-b2a4-42ff-b424-909c8f53a26a, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=0fd74259-b2a4-42ff-b424-909c8f53a26a,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:36.136717 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '0fd74259-b2a4-42ff-b424-909c8f53a26a', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '0fd74259-b2a4-42ff-b424-909c8f53a26a', 'mac_address': 'fa:16:3e:7a:3d:cb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:18:36.156325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-5fce0807-a100-4743-b710-361f4b0edc9a tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:36.172022 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-5fce0807-a100-4743-b710-361f4b0edc9a tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3470933 Dec 09 21:18:36.186550 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-f22fcb1b-5f26-4021-9c58-0697e9b6e026 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Request body: {'port': {'device_id': 'a40f9b82-e796-4cd4-b12e-cd2089ff7c19', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '10c237cbfa28423ea2d1df15f60193f2'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:36.209500 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:36.229276 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0fd74259-b2a4-42ff-b424-909c8f53a26a {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:18:36.250535 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:36.267009 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 0fd74259-b2a4-42ff-b424-909c8f53a26a, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=0fd74259-b2a4-42ff-b424-909c8f53a26a,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:36.279606 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:36.292717 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0d277843-0a85-41b3-add1-0e319baac5d2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ecb95cc0-98d6-4980-b73e-2bc2c2df48f3'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:36.295204 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bde3a348-c4c4-4f5a-8103-2c3c0c899257" -d '{"events": [{"server_uuid": "0d277843-0a85-41b3-add1-0e319baac5d2", "name": "network-vif-plugged", "status": "completed", "tag": "ecb95cc0-98d6-4980-b73e-2bc2c2df48f3"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:36.328865 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:36.354389 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:36.355172 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 37ba309b-f598-4b1e-b3e8-35aa21ab14d3 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:18:36.384713 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 37ba309b-f598-4b1e-b3e8-35aa21ab14d3 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:18:36.385250 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 37ba309b-f598-4b1e-b3e8-35aa21ab14d3 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:18:36.387217 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=0fd74259-b2a4-42ff-b424-909c8f53a26a,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:36.486381 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-f22fcb1b-5f26-4021-9c58-0697e9b6e026 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Made reservation on behalf of 10c237cbfa28423ea2d1df15f60193f2 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:18:36.490168 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-f22fcb1b-5f26-4021-9c58-0697e9b6e026 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:36.494257 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:36.538564 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['0fd74259-b2a4-42ff-b424-909c8f53a26a'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:18:36.580280 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-9e549187-0ea0-49d6-898f-d611cc4e8805 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:36.586795 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-9e549187-0ea0-49d6-898f-d611cc4e8805 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.31 "GET /v2.0/networks?id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 HTTP/1.1" status: 200 len: 821 time: 0.2616072 Dec 09 21:18:36.603062 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-2b287c79-8348-435d-9a2d-b9dcdeaca4d8 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Request body: {'port': {'device_id': '3d45a57e-5f03-4541-88f7-1194f195f63e', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'admin_state_up': True, 'tenant_id': '920e0419877f4239b048e126682274e9'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:36.632151 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:36.699087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0544f8dd-3168-4b6d-8119-896bc3bfe234 req-59dc3b01-deac-4515-80c6-8cb90605aadb tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:36.707201 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0544f8dd-3168-4b6d-8119-896bc3bfe234 req-59dc3b01-deac-4515-80c6-8cb90605aadb tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 946 time: 0.1005027 Dec 09 21:18:36.764035 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-f22fcb1b-5f26-4021-9c58-0697e9b6e026 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Allocated IP 192.168.233.59 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/0dc8dc0a-1841-4d79-82ba-8d7ab787a13a) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:18:36.897491 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-2b287c79-8348-435d-9a2d-b9dcdeaca4d8 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Made reservation on behalf of 920e0419877f4239b048e126682274e9 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:18:36.904248 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-2b287c79-8348-435d-9a2d-b9dcdeaca4d8 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:36.909156 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0544f8dd-3168-4b6d-8119-896bc3bfe234 req-88aa07af-38e8-4301-adb4-96a0bbd46409 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2011652 Dec 09 21:18:37.123308 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c71d24b-57a4-40b6-b60b-e8e0bda666b5 req-ed53c232-756a-49c3-8f09-e04d182a8ca0 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=3d45a57e-5f03-4541-88f7-1194f195f63e HTTP/1.1" status: 200 len: 210 time: 0.0321136 Dec 09 21:18:37.136756 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-2b287c79-8348-435d-9a2d-b9dcdeaca4d8 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Allocated IP 172.20.0.14 (eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3/3260fc19-8e10-46a2-82c6-3b2d5eda4a0e/d0cf802e-891b-41ee-8585-48a361e5265d) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:18:37.154172 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-f22fcb1b-5f26-4021-9c58-0697e9b6e026 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:37.211483 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-f22fcb1b-5f26-4021-9c58-0697e9b6e026 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:37.279480 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56268) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:37.290242 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-f22fcb1b-5f26-4021-9c58-0697e9b6e026 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:18:37.301442 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c61ffc6c-c8d9-4bb4-ad1b-d5ab32cd4007 req-a2a808e2-b316-4b07-aecd-ab99f4ee9257 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:37.302972 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c61ffc6c-c8d9-4bb4-ad1b-d5ab32cd4007 req-a2a808e2-b316-4b07-aecd-ab99f4ee9257 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=a40f9b82-e796-4cd4-b12e-cd2089ff7c19 HTTP/1.1" status: 200 len: 935 time: 0.1028585 Dec 09 21:18:37.304987 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-2b287c79-8348-435d-9a2d-b9dcdeaca4d8 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:37.312539 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-f22fcb1b-5f26-4021-9c58-0697e9b6e026 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:18:37.319641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-f22fcb1b-5f26-4021-9c58-0697e9b6e026 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:18:37.322158 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f22fcb1b-5f26-4021-9c58-0697e9b6e026 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Pushing event updated for resources: {'Port': ['ID=0dc8dc0a-1841-4d79-82ba-8d7ab787a13a,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:37.343948 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-2b287c79-8348-435d-9a2d-b9dcdeaca4d8 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:37.357490 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['b615e863-071a-473e-8d66-8f84f78d1453'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:18:37.389230 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-2b287c79-8348-435d-9a2d-b9dcdeaca4d8 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Network eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:18:37.392673 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-2b287c79-8348-435d-9a2d-b9dcdeaca4d8 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:18:37.398952 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-2b287c79-8348-435d-9a2d-b9dcdeaca4d8 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:18:37.415370 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-f22fcb1b-5f26-4021-9c58-0697e9b6e026 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:37.416048 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-f22fcb1b-5f26-4021-9c58-0697e9b6e026 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:37.444121 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c61ffc6c-c8d9-4bb4-ad1b-d5ab32cd4007 req-2941687c-b200-4f2f-83bd-09099d382649 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1327531 Dec 09 21:18:37.458601 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-f22fcb1b-5f26-4021-9c58-0697e9b6e026 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.2777646 Dec 09 21:18:37.472753 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-b5cf8d11-911c-4300-9b81-cb93e2ee6836 service neutron] Request body: {'port': {'device_id': 'a40f9b82-e796-4cd4-b12e-cd2089ff7c19', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:37.505793 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-2b287c79-8348-435d-9a2d-b9dcdeaca4d8 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:37.506720 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-2b287c79-8348-435d-9a2d-b9dcdeaca4d8 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:37.528236 n-d-713301-27 neutron-server[103437]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Dec 09 21:18:37.529388 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b287c79-8348-435d-9a2d-b9dcdeaca4d8 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Pushing event updated for resources: {'Port': ['ID=d0cf802e-891b-41ee-8585-48a361e5265d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:37.540208 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-c719c5dc-905b-4eaf-8278-5c474f3b1ce5 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:18:37.541247 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-c719c5dc-905b-4eaf-8278-5c474f3b1ce5 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.2608223 Dec 09 21:18:37.545466 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-2b287c79-8348-435d-9a2d-b9dcdeaca4d8 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9496596 Dec 09 21:18:37.564777 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-8d0ebe73-7c4f-464a-8487-79d45f0eab3c service neutron] Request body: {'port': {'device_id': '3d45a57e-5f03-4541-88f7-1194f195f63e', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:37.600405 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-b5cf8d11-911c-4300-9b81-cb93e2ee6836 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:37.627257 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3ab8b937-efcd-4a99-a855-753fd8087fb3 x-openstack-request-id: req-3ab8b937-efcd-4a99-a855-753fd8087fb3 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:37.628319 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0d277843-0a85-41b3-add1-0e319baac5d2", "name": "network-vif-plugged", "status": "completed", "tag": "ecb95cc0-98d6-4980-b73e-2bc2c2df48f3", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:37.628801 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-3ab8b937-efcd-4a99-a855-753fd8087fb3 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:37.629584 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0d277843-0a85-41b3-add1-0e319baac5d2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ecb95cc0-98d6-4980-b73e-2bc2c2df48f3', 'code': 200} Dec 09 21:18:37.710817 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-8d0ebe73-7c4f-464a-8487-79d45f0eab3c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:37.788958 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9b0f8666-c810-4804-bd28-0d34f14f588e None None] Provisioning complete for port d0cf802e-891b-41ee-8585-48a361e5265d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:37.789539 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9b0f8666-c810-4804-bd28-0d34f14f588e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:37.799895 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8699681-cf59-4486-adb6-1c00291faa5b req-b994de64-a349-474e-be61-0def8060aac7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:37.801784 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8699681-cf59-4486-adb6-1c00291faa5b req-b994de64-a349-474e-be61-0def8060aac7 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 1098 time: 0.1363454 Dec 09 21:18:37.828896 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4268b193-bda1-4d21-b21d-35bb5aaed057 req-65a71884-c538-42f6-b278-5f7490c9bd35 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:37.830532 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4268b193-bda1-4d21-b21d-35bb5aaed057 req-65a71884-c538-42f6-b278-5f7490c9bd35 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=8c21856f-2254-41e8-941c-2f4471714942 HTTP/1.1" status: 200 len: 947 time: 0.1364422 Dec 09 21:18:37.843242 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:37.844441 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9b0f8666-c810-4804-bd28-0d34f14f588e None None] Port d0cf802e-891b-41ee-8585-48a361e5265d cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:18:37.844946 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-b55d81c5-3aad-4d9d-8c7f-7ec5794fff09 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:37.846539 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-b55d81c5-3aad-4d9d-8c7f-7ec5794fff09 service neutron] 10.222.0.13 "GET /v2.0/ports/85dcf098-2530-45e6-aecc-ec3e2e8888a6 HTTP/1.1" status: 200 len: 1094 time: 0.1792443 Dec 09 21:18:37.857167 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9b0f8666-c810-4804-bd28-0d34f14f588e None None] Provisioning complete for port 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:37.857694 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9b0f8666-c810-4804-bd28-0d34f14f588e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:37.879379 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 0fd74259-b2a4-42ff-b424-909c8f53a26a up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:18:37.922893 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9b0f8666-c810-4804-bd28-0d34f14f588e None None] Port 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:18:37.936337 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4268b193-bda1-4d21-b21d-35bb5aaed057 req-841f4a6f-8d1b-40d1-bb61-3a72d1bf14ea tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0850778 Dec 09 21:18:37.948300 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 0fd74259-b2a4-42ff-b424-909c8f53a26a completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:18:37.951821 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-0eeaf990-ba56-46af-ad6d-975bead164a3 service neutron] Request body: {'binding': {'host': 'n-h1-713301-27', 'vnic_type': 'normal', 'profile': {}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:37.952346 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-0eeaf990-ba56-46af-ad6d-975bead164a3 service neutron] Unknown quota resources ['binding']. {{(pid=103437) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 09 21:18:37.953330 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 0fd74259-b2a4-42ff-b424-909c8f53a26a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:37.953709 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:38.039979 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-b5cf8d11-911c-4300-9b81-cb93e2ee6836 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:18:38.050781 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-b5cf8d11-911c-4300-9b81-cb93e2ee6836 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:38.052940 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:38.072100 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-b5cf8d11-911c-4300-9b81-cb93e2ee6836 service neutron] Transition to ACTIVE for port object 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:18:38.080433 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-b5cf8d11-911c-4300-9b81-cb93e2ee6836 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:38.096150 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 0fd74259-b2a4-42ff-b424-909c8f53a26a, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=0fd74259-b2a4-42ff-b424-909c8f53a26a,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:38.102710 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:38.113456 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8699681-cf59-4486-adb6-1c00291faa5b req-6e94be49-8fd2-40a6-a07b-6ab0d942502c service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3026178 Dec 09 21:18:38.138956 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5cf8d11-911c-4300-9b81-cb93e2ee6836 service neutron] Pushing event updated for resources: {'Port': ['ID=0dc8dc0a-1841-4d79-82ba-8d7ab787a13a,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:38.196786 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=0fd74259-b2a4-42ff-b424-909c8f53a26a,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:38.238519 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-b5cf8d11-911c-4300-9b81-cb93e2ee6836 service neutron] Attempting to bind port 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:18:38.238786 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-0eeaf990-ba56-46af-ad6d-975bead164a3 service neutron] Attempting to bind port 85dcf098-2530-45e6-aecc-ec3e2e8888a6 on host n-h1-713301-27 for vnic_type normal with profile None {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:18:38.239027 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-0eeaf990-ba56-46af-ad6d-975bead164a3 service neutron] Attempting to bind port 85dcf098-2530-45e6-aecc-ec3e2e8888a6 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:18:38.239239 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-b5cf8d11-911c-4300-9b81-cb93e2ee6836 service neutron] Attempting to bind port 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:18:38.239356 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-0eeaf990-ba56-46af-ad6d-975bead164a3 service neutron] Attempting to bind port 85dcf098-2530-45e6-aecc-ec3e2e8888a6 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:38.239785 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-b5cf8d11-911c-4300-9b81-cb93e2ee6836 service neutron] Attempting to bind port 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:38.245230 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-b5cf8d11-911c-4300-9b81-cb93e2ee6836 service neutron] Port 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:18:38.245404 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-b5cf8d11-911c-4300-9b81-cb93e2ee6836 service neutron] Attempting to bind port 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:38.245924 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-0eeaf990-ba56-46af-ad6d-975bead164a3 service neutron] Port 85dcf098-2530-45e6-aecc-ec3e2e8888a6 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:18:38.246249 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-0eeaf990-ba56-46af-ad6d-975bead164a3 service neutron] Attempting to bind port 85dcf098-2530-45e6-aecc-ec3e2e8888a6 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:38.252425 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-b5cf8d11-911c-4300-9b81-cb93e2ee6836 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 18, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:18:38.252974 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-b5cf8d11-911c-4300-9b81-cb93e2ee6836 service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:18:38.253358 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-b5cf8d11-911c-4300-9b81-cb93e2ee6836 service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:18:38.253793 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-b5cf8d11-911c-4300-9b81-cb93e2ee6836 service neutron] Bound port: 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:18:38.253966 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-0eeaf990-ba56-46af-ad6d-975bead164a3 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 18, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:18:38.254165 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-0eeaf990-ba56-46af-ad6d-975bead164a3 service neutron] Checking segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:18:38.254277 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-b5cf8d11-911c-4300-9b81-cb93e2ee6836 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:38.254504 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-0eeaf990-ba56-46af-ad6d-975bead164a3 service neutron] Bound using segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:18:38.254931 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-0eeaf990-ba56-46af-ad6d-975bead164a3 service neutron] Bound port: 85dcf098-2530-45e6-aecc-ec3e2e8888a6, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:18:38.264774 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-8d0ebe73-7c4f-464a-8487-79d45f0eab3c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d0cf802e-891b-41ee-8585-48a361e5265d {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:18:38.310347 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-8d0ebe73-7c4f-464a-8487-79d45f0eab3c service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:38.346894 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-b5cf8d11-911c-4300-9b81-cb93e2ee6836 service neutron] For port 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:18:38.349280 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-8d0ebe73-7c4f-464a-8487-79d45f0eab3c service neutron] Transition to ACTIVE for port object d0cf802e-891b-41ee-8585-48a361e5265d will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:18:38.351853 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-b5cf8d11-911c-4300-9b81-cb93e2ee6836 service neutron] For port 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=0dc8dc0a-1841-4d79-82ba-8d7ab787a13a,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:18:38.356484 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-8d0ebe73-7c4f-464a-8487-79d45f0eab3c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:38.359642 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-b5cf8d11-911c-4300-9b81-cb93e2ee6836 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:38.394702 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-0eeaf990-ba56-46af-ad6d-975bead164a3 service neutron] For port 85dcf098-2530-45e6-aecc-ec3e2e8888a6, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=85dcf098-2530-45e6-aecc-ec3e2e8888a6,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:18:38.405927 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-0eeaf990-ba56-46af-ad6d-975bead164a3 service neutron] Publish callbacks [] for binding, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:38.407898 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-0eeaf990-ba56-46af-ad6d-975bead164a3 service neutron] 10.222.0.13 "POST /v2.0/ports/85dcf098-2530-45e6-aecc-ec3e2e8888a6/bindings HTTP/1.1" status: 201 len: 390 time: 0.4627426 Dec 09 21:18:38.417036 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a9db85ce-c245-4c30-a8bc-e226b5378a37 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=857de64ecc3946e3b92655f639d782df&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0471554 Dec 09 21:18:38.420865 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-b5cf8d11-911c-4300-9b81-cb93e2ee6836 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:38.421583 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-b5cf8d11-911c-4300-9b81-cb93e2ee6836 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:38.422943 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-b5cf8d11-911c-4300-9b81-cb93e2ee6836 service neutron] 10.222.0.31 "PUT /v2.0/ports/0dc8dc0a-1841-4d79-82ba-8d7ab787a13a HTTP/1.1" status: 200 len: 1096 time: 0.9549544 Dec 09 21:18:38.423383 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a40f9b82-e796-4cd4-b12e-cd2089ff7c19', 'tag': '0dc8dc0a-1841-4d79-82ba-8d7ab787a13a'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:38.426086 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-02473e46-7ab7-4edd-b3b9-1b53880ebb80" -d '{"events": [{"name": "network-changed", "server_uuid": "a40f9b82-e796-4cd4-b12e-cd2089ff7c19", "tag": "0dc8dc0a-1841-4d79-82ba-8d7ab787a13a"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:38.459159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d0ebe73-7c4f-464a-8487-79d45f0eab3c service neutron] Pushing event updated for resources: {'Port': ['ID=d0cf802e-891b-41ee-8585-48a361e5265d,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:38.587320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-8d0ebe73-7c4f-464a-8487-79d45f0eab3c service neutron] Attempting to bind port d0cf802e-891b-41ee-8585-48a361e5265d on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:18:38.587839 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-8d0ebe73-7c4f-464a-8487-79d45f0eab3c service neutron] Attempting to bind port d0cf802e-891b-41ee-8585-48a361e5265d by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'c1e3b516-6ad9-46a2-acfa-cf795ad5b916', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:18:38.588270 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-8d0ebe73-7c4f-464a-8487-79d45f0eab3c service neutron] Attempting to bind port d0cf802e-891b-41ee-8585-48a361e5265d on network eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:38.594273 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-8d0ebe73-7c4f-464a-8487-79d45f0eab3c service neutron] Port d0cf802e-891b-41ee-8585-48a361e5265d on network eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:18:38.594736 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-8d0ebe73-7c4f-464a-8487-79d45f0eab3c service neutron] Attempting to bind port d0cf802e-891b-41ee-8585-48a361e5265d on network eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:38.606806 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-8d0ebe73-7c4f-464a-8487-79d45f0eab3c service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 18, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:18:38.607153 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-8d0ebe73-7c4f-464a-8487-79d45f0eab3c service neutron] Checking segment: {'id': 'c1e3b516-6ad9-46a2-acfa-cf795ad5b916', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:18:38.607727 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-8d0ebe73-7c4f-464a-8487-79d45f0eab3c service neutron] Bound using segment: {'id': 'c1e3b516-6ad9-46a2-acfa-cf795ad5b916', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:18:38.608171 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-8d0ebe73-7c4f-464a-8487-79d45f0eab3c service neutron] Bound port: d0cf802e-891b-41ee-8585-48a361e5265d, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c1e3b516-6ad9-46a2-acfa-cf795ad5b916', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:18:38.608526 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-8d0ebe73-7c4f-464a-8487-79d45f0eab3c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:38.614427 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5cf8d11-911c-4300-9b81-cb93e2ee6836 service neutron] Pushing event updated for resources: {'Port': ['ID=0dc8dc0a-1841-4d79-82ba-8d7ab787a13a,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:38.688168 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-268867c5-a801-4839-a317-151b67870d03 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:38.689731 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-268867c5-a801-4839-a317-151b67870d03 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10c237cbfa28423ea2d1df15f60193f2&device_id=a40f9b82-e796-4cd4-b12e-cd2089ff7c19 HTTP/1.1" status: 200 len: 1099 time: 0.1871011 Dec 09 21:18:38.770162 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-0a354b95-500d-4b34-a671-2b7fbf51c537 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.59&port_id=0dc8dc0a-1841-4d79-82ba-8d7ab787a13a HTTP/1.1" status: 200 len: 217 time: 0.0643184 Dec 09 21:18:38.773595 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-8d0ebe73-7c4f-464a-8487-79d45f0eab3c service neutron] For port d0cf802e-891b-41ee-8585-48a361e5265d, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:18:38.783664 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fee8653-a452-4c31-b669-20f9873d706c req-de39edba-55b6-461c-b968-cec477ecefea tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:38.785503 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7fee8653-a452-4c31-b669-20f9873d706c req-de39edba-55b6-461c-b968-cec477ecefea tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 946 time: 0.1819913 Dec 09 21:18:38.801625 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-8d0ebe73-7c4f-464a-8487-79d45f0eab3c service neutron] For port d0cf802e-891b-41ee-8585-48a361e5265d, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=d0cf802e-891b-41ee-8585-48a361e5265d,segment=NetworkSegment(c1e3b516-6ad9-46a2-acfa-cf795ad5b916),segment_id=c1e3b516-6ad9-46a2-acfa-cf795ad5b916)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:18:38.811517 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-8d0ebe73-7c4f-464a-8487-79d45f0eab3c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:38.815879 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-9a7b1da0-e09c-4452-97f0-e9a4b82582a2 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:38.817373 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-9a7b1da0-e09c-4452-97f0-e9a4b82582a2 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3781998 Dec 09 21:18:38.823016 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-29ae2a44-999c-43c4-b15f-ed2009c3235e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:38.826258 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-29ae2a44-999c-43c4-b15f-ed2009c3235e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 1097 time: 0.0910454 Dec 09 21:18:38.857057 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-8d0ebe73-7c4f-464a-8487-79d45f0eab3c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:38.857561 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-8d0ebe73-7c4f-464a-8487-79d45f0eab3c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:38.859123 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-8d0ebe73-7c4f-464a-8487-79d45f0eab3c service neutron] 10.222.0.31 "PUT /v2.0/ports/d0cf802e-891b-41ee-8585-48a361e5265d HTTP/1.1" status: 200 len: 1093 time: 1.2987516 Dec 09 21:18:38.862605 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3d45a57e-5f03-4541-88f7-1194f195f63e', 'tag': 'd0cf802e-891b-41ee-8585-48a361e5265d'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:38.868243 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-da1a0b87-dea0-477a-a277-9a286bc32b95" -d '{"events": [{"name": "network-changed", "server_uuid": "3d45a57e-5f03-4541-88f7-1194f195f63e", "tag": "d0cf802e-891b-41ee-8585-48a361e5265d"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:38.873423 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-7b4bed1a-acbd-409b-b460-fc27430ef53f tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/quotas/857de64ecc3946e3b92655f639d782df HTTP/1.1" status: 200 len: 375 time: 0.0368302 Dec 09 21:18:38.892161 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-a8acb65e-5897-4eca-ac42-cfc99c479e26 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:38.894902 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-a8acb65e-5897-4eca-ac42-cfc99c479e26 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1083508 Dec 09 21:18:38.937092 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-b5ca1998-d815-4f64-8230-3bbb3f733b3c tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0511024 Dec 09 21:18:38.942146 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7fee8653-a452-4c31-b669-20f9873d706c req-8dd4b11a-ce2c-47e2-be44-57b12589b874 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1349480 Dec 09 21:18:38.954329 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d0ebe73-7c4f-464a-8487-79d45f0eab3c service neutron] Pushing event updated for resources: {'Port': ['ID=d0cf802e-891b-41ee-8585-48a361e5265d,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:38.989958 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-d58c8882-2ecd-4e8c-b81c-ed3cb5b484fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:38.992310 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-d58c8882-2ecd-4e8c-b81c-ed3cb5b484fb service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0789776 Dec 09 21:18:39.044741 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-e25ad7be-9951-431d-82fe-a566d69f9827 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:39.047173 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-e25ad7be-9951-431d-82fe-a566d69f9827 service neutron] 10.222.0.31 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 922 time: 0.2040062 Dec 09 21:18:39.111264 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-6e984eb5-f4df-47c8-99e2-31d41c4d14af service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=85dcf098-2530-45e6-aecc-ec3e2e8888a6 HTTP/1.1" status: 200 len: 217 time: 0.0537333 Dec 09 21:18:39.119188 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-76988e3d-328b-4580-bc0a-dc240d4873a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:39.120750 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-76988e3d-328b-4580-bc0a-dc240d4873a3 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=920e0419877f4239b048e126682274e9&device_id=3d45a57e-5f03-4541-88f7-1194f195f63e HTTP/1.1" status: 200 len: 1096 time: 0.2123537 Dec 09 21:18:39.202178 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-1e5bddce-2ce8-449c-a41b-51daa4d9a6c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:39.204977 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-1e5bddce-2ce8-449c-a41b-51daa4d9a6c4 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=c49a62cc-af1b-4958-a4a9-eb44188b8fb9 HTTP/1.1" status: 200 len: 861 time: 0.0827610 Dec 09 21:18:39.249649 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-67b1c261-c80b-4373-ae2a-4a7e52ee64b2 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2465925 Dec 09 21:18:39.307595 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-1cf260fa-7b20-4101-b3c4-bb515509d004 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=d0cf802e-891b-41ee-8585-48a361e5265d HTTP/1.1" status: 200 len: 217 time: 0.0927866 Dec 09 21:18:39.307961 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:39.359055 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-72f07236-420d-4fce-b2b9-a645eaee4ba8 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=93378dc3-2ac5-4cf7-9ce3-d812934de40c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0693045 Dec 09 21:18:39.368880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f797b11-0715-4ff4-9551-3cd3f8218330 req-539cb1ec-a871-4dc5-aef1-942d4f7ee3b3 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:39.370837 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2f797b11-0715-4ff4-9551-3cd3f8218330 req-539cb1ec-a871-4dc5-aef1-942d4f7ee3b3 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=3d45a57e-5f03-4541-88f7-1194f195f63e HTTP/1.1" status: 200 len: 944 time: 0.1735456 Dec 09 21:18:39.374044 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cefef760-3c74-45b0-88da-296353be892c x-openstack-request-id: req-cefef760-3c74-45b0-88da-296353be892c {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:39.374400 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a40f9b82-e796-4cd4-b12e-cd2089ff7c19", "tag": "0dc8dc0a-1841-4d79-82ba-8d7ab787a13a", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:39.374581 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-cefef760-3c74-45b0-88da-296353be892c {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:39.374975 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a40f9b82-e796-4cd4-b12e-cd2089ff7c19', 'tag': '0dc8dc0a-1841-4d79-82ba-8d7ab787a13a', 'status': 'completed', 'code': 200} Dec 09 21:18:39.474124 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-e378c860-e69b-493c-9d71-349aec8c432a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:39.476109 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-e378c860-e69b-493c-9d71-349aec8c432a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=3260fc19-8e10-46a2-82c6-3b2d5eda4a0e HTTP/1.1" status: 200 len: 860 time: 0.1686938 Dec 09 21:18:39.539513 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fda3d8b-fb42-4d10-b798-209f60f2cc92 req-78ef8041-1785-4835-a8f4-506130f6becf service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2738307 Dec 09 21:18:39.553220 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaa2f7b2-3f81-41a0-978b-ca2ec582a84f req-dc0bef1a-3cd2-4c60-be6e-337114057a4f tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:39.559970 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eaa2f7b2-3f81-41a0-978b-ca2ec582a84f req-dc0bef1a-3cd2-4c60-be6e-337114057a4f tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=a40f9b82-e796-4cd4-b12e-cd2089ff7c19 HTTP/1.1" status: 200 len: 947 time: 0.1388760 Dec 09 21:18:39.561895 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-4f7da86b-c51f-4816-be3c-10527e83db67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:39.563731 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-4f7da86b-c51f-4816-be3c-10527e83db67 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0605185 Dec 09 21:18:39.569628 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-5ab3b05d-e1f5-4df7-97b0-e6bf33123d0b service neutron] 10.222.0.31 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1499336 Dec 09 21:18:39.572270 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2f797b11-0715-4ff4-9551-3cd3f8218330 req-fae49fe1-836f-4101-b2a2-e70615c3edb3 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/security-groups?id=174c6f0d-c012-4077-858c-aa2b94e54d38&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1500697 Dec 09 21:18:39.631048 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8c21856f-2254-41e8-941c-2f4471714942', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0fd74259-b2a4-42ff-b424-909c8f53a26a'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:39.631614 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eaa2f7b2-3f81-41a0-978b-ca2ec582a84f req-b86281ba-87f6-4782-b53e-8380015f6e40 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0702438 Dec 09 21:18:39.633498 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2888460c-0ce6-4b8b-a7fb-6cbe18beff05" -d '{"events": [{"server_uuid": "8c21856f-2254-41e8-941c-2f4471714942", "name": "network-vif-plugged", "status": "completed", "tag": "0fd74259-b2a4-42ff-b424-909c8f53a26a"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:39.719308 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84bbf709-c8f8-4f15-91fe-aed5438e9d89 req-f8a614d1-690b-4913-abd4-c5ac9cdd75f0 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:39.720928 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84bbf709-c8f8-4f15-91fe-aed5438e9d89 req-f8a614d1-690b-4913-abd4-c5ac9cdd75f0 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 945 time: 0.0795987 Dec 09 21:18:39.728016 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02473e46-7ab7-4edd-b3b9-1b53880ebb80 req-d02d818a-a4e8-44c9-a3a1-c76c15b4b29c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:39.729389 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02473e46-7ab7-4edd-b3b9-1b53880ebb80 req-d02d818a-a4e8-44c9-a3a1-c76c15b4b29c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=10c237cbfa28423ea2d1df15f60193f2&device_id=a40f9b82-e796-4cd4-b12e-cd2089ff7c19 HTTP/1.1" status: 200 len: 1099 time: 0.0963953 Dec 09 21:18:39.741124 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-54c58718-d1e7-4d49-b289-6fd6c6a32c4b x-openstack-request-id: req-54c58718-d1e7-4d49-b289-6fd6c6a32c4b {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:39.741416 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3d45a57e-5f03-4541-88f7-1194f195f63e", "tag": "d0cf802e-891b-41ee-8585-48a361e5265d", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:39.741798 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-54c58718-d1e7-4d49-b289-6fd6c6a32c4b {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:39.742203 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3d45a57e-5f03-4541-88f7-1194f195f63e', 'tag': 'd0cf802e-891b-41ee-8585-48a361e5265d', 'status': 'completed', 'code': 200} Dec 09 21:18:39.893330 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84bbf709-c8f8-4f15-91fe-aed5438e9d89 req-6d7435b1-5748-433f-87f4-bb0de724005a tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1626854 Dec 09 21:18:39.936649 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e48a66e4-4b6c-4809-b51d-419b8d2990e1 req-8da314c7-3d24-4219-b0e7-ce0ddbc12fcc tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:39.938284 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e48a66e4-4b6c-4809-b51d-419b8d2990e1 req-8da314c7-3d24-4219-b0e7-ce0ddbc12fcc tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=8c21856f-2254-41e8-941c-2f4471714942 HTTP/1.1" status: 200 len: 948 time: 0.1872993 Dec 09 21:18:39.939924 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02473e46-7ab7-4edd-b3b9-1b53880ebb80 req-97d2c154-0193-4f05-83d1-71fdbb621ef0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:39.941311 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02473e46-7ab7-4edd-b3b9-1b53880ebb80 req-97d2c154-0193-4f05-83d1-71fdbb621ef0 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.1879289 Dec 09 21:18:40.019218 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02473e46-7ab7-4edd-b3b9-1b53880ebb80 req-9b15b870-23e2-4090-8bda-d330f0e7e3a1 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.59&port_id=0dc8dc0a-1841-4d79-82ba-8d7ab787a13a HTTP/1.1" status: 200 len: 217 time: 0.0659580 Dec 09 21:18:40.025017 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-2c2ca7f3-0b93-46de-b7f2-9e7a5fa02d9d service neutron] 10.222.0.31 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4420116 Dec 09 21:18:40.026886 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-262592c4-6d0a-4c90-9384-b4eab3eafe44 service neutron] 10.222.0.31 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4213371 Dec 09 21:18:40.063797 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4d12037-44a0-4ff9-9105-342fc11c8632 req-6486f4cf-0be7-4b0d-8375-d60d1611eea0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 210 time: 0.0481133 Dec 09 21:18:40.099756 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e48a66e4-4b6c-4809-b51d-419b8d2990e1 req-2004fe40-9226-4055-a8a1-fdd62b0cd3a8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1549191 Dec 09 21:18:40.118304 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02473e46-7ab7-4edd-b3b9-1b53880ebb80 req-ed4b2139-4e60-4e14-bdea-4eeb19aa4774 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:40.119781 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02473e46-7ab7-4edd-b3b9-1b53880ebb80 req-ed4b2139-4e60-4e14-bdea-4eeb19aa4774 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0699079 Dec 09 21:18:40.133543 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ca418c24-f35b-48ea-8b1b-7aa748f3205e req-fa365cfc-bf59-450a-bdb6-4b9949dac530 service neutron] 10.222.0.31 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0933609 Dec 09 21:18:40.151621 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-85463151-fb0c-4244-bfe9-8358be3d9ac9 x-openstack-request-id: req-85463151-fb0c-4244-bfe9-8358be3d9ac9 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:40.152145 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8c21856f-2254-41e8-941c-2f4471714942", "name": "network-vif-plugged", "status": "completed", "tag": "0fd74259-b2a4-42ff-b424-909c8f53a26a", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:40.152426 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-85463151-fb0c-4244-bfe9-8358be3d9ac9 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:40.152940 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8c21856f-2254-41e8-941c-2f4471714942', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0fd74259-b2a4-42ff-b424-909c8f53a26a', 'code': 200} Dec 09 21:18:40.268235 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02473e46-7ab7-4edd-b3b9-1b53880ebb80 req-c6355a6c-cff8-4b67-b109-2a118bfd0a26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:40.270230 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02473e46-7ab7-4edd-b3b9-1b53880ebb80 req-c6355a6c-cff8-4b67-b109-2a118bfd0a26 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0884433 Dec 09 21:18:40.282865 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c652fa-25cf-4b1f-be7c-f0e74ad45727 req-b2935022-035a-4b63-a3ff-a0b376b1f638 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:40.284444 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-95c652fa-25cf-4b1f-be7c-f0e74ad45727 req-b2935022-035a-4b63-a3ff-a0b376b1f638 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 946 time: 0.0599821 Dec 09 21:18:40.385759 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-95c652fa-25cf-4b1f-be7c-f0e74ad45727 req-d4bc84ac-7c05-4af8-a376-100bbdf0833c tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0926003 Dec 09 21:18:40.431683 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-829f54d6-a5f9-46f9-8dc0-d78013fa61f0 req-88b4f6e6-b863-46fd-a479-b4505071efd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:40.433877 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-829f54d6-a5f9-46f9-8dc0-d78013fa61f0 req-88b4f6e6-b863-46fd-a479-b4505071efd9 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=8c21856f-2254-41e8-941c-2f4471714942 HTTP/1.1" status: 200 len: 1100 time: 0.1904538 Dec 09 21:18:40.436130 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-a30cb6b6-ba19-4a54-a696-c067a84999ac tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:40.437528 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-a30cb6b6-ba19-4a54-a696-c067a84999ac tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981&tenant_id=a306d2242b1e41c892f63c7b122cdee4&binding%3Ahost_id=n-h2-713301-27 HTTP/1.1" status: 200 len: 1097 time: 0.1822541 Dec 09 21:18:40.440445 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da1a0b87-dea0-477a-a277-9a286bc32b95 req-4ed85132-9234-4ae4-88c4-ca7bd30da533 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:40.441867 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-da1a0b87-dea0-477a-a277-9a286bc32b95 req-4ed85132-9234-4ae4-88c4-ca7bd30da533 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=920e0419877f4239b048e126682274e9&device_id=3d45a57e-5f03-4541-88f7-1194f195f63e HTTP/1.1" status: 200 len: 1096 time: 0.1876743 Dec 09 21:18:40.447560 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02473e46-7ab7-4edd-b3b9-1b53880ebb80 req-54085a95-dce9-4508-b05d-e82304383ce8 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1612606 Dec 09 21:18:40.472594 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-59a949f8-53e6-416f-9eee-1b158e9937cb service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h1-713301-27'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:40.522292 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-543c8f98-8695-49b5-8d9e-3379ff99499e tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.10 "GET /v2.0/networks?tenant_id=857de64ecc3946e3b92655f639d782df&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0723403 Dec 09 21:18:40.637723 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-829f54d6-a5f9-46f9-8dc0-d78013fa61f0 req-367bf38f-a987-4faf-8657-d06fb79a3d5e service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1882038 Dec 09 21:18:40.642134 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-59a949f8-53e6-416f-9eee-1b158e9937cb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:40.699780 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da1a0b87-dea0-477a-a277-9a286bc32b95 req-be51ae67-20b9-460e-acd1-b9419535f933 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:40.701302 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-da1a0b87-dea0-477a-a277-9a286bc32b95 req-be51ae67-20b9-460e-acd1-b9419535f933 service neutron] 10.222.0.31 "GET /v2.0/networks?id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 HTTP/1.1" status: 200 len: 922 time: 0.2229867 Dec 09 21:18:40.748076 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02473e46-7ab7-4edd-b3b9-1b53880ebb80 req-ec7dd1d0-13a0-4f0b-b5e3-ab28878f950d service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2719078 Dec 09 21:18:40.766272 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-da1a0b87-dea0-477a-a277-9a286bc32b95 req-71015888-6f1c-416f-acba-d483522a47af service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=d0cf802e-891b-41ee-8585-48a361e5265d HTTP/1.1" status: 200 len: 217 time: 0.0538571 Dec 09 21:18:40.773768 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fb67b87-f926-44d7-b44c-9dbbc2386905 req-d944c3e5-c626-4aca-8bde-877d36c33feb tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:40.775172 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0fb67b87-f926-44d7-b44c-9dbbc2386905 req-d944c3e5-c626-4aca-8bde-877d36c33feb tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 1098 time: 0.1164227 Dec 09 21:18:40.786877 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-de210ad9-5ade-44d6-a783-e70f67184e6f tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:40.788375 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-de210ad9-5ade-44d6-a783-e70f67184e6f tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2517111 Dec 09 21:18:40.811792 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95f7b334-8c7b-44bf-bdbe-abd59d00c47b req-1abfbf90-ce08-4985-adfd-54a8ba27f6d7 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:40.813625 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-95f7b334-8c7b-44bf-bdbe-abd59d00c47b req-1abfbf90-ce08-4985-adfd-54a8ba27f6d7 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=3d45a57e-5f03-4541-88f7-1194f195f63e HTTP/1.1" status: 200 len: 944 time: 0.1176009 Dec 09 21:18:40.844289 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-c8d51abf-0f83-4880-84c5-296612527156 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Request body: {'port': {'device_id': 'e6fbd1df-a53f-4f75-810f-f90ea3677ac8', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '857de64ecc3946e3b92655f639d782df'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:40.879037 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da1a0b87-dea0-477a-a277-9a286bc32b95 req-6baf26d0-103c-49b6-b507-57a00f31eaa9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:40.880570 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-da1a0b87-dea0-477a-a277-9a286bc32b95 req-6baf26d0-103c-49b6-b507-57a00f31eaa9 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=3260fc19-8e10-46a2-82c6-3b2d5eda4a0e HTTP/1.1" status: 200 len: 860 time: 0.0664089 Dec 09 21:18:40.882309 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-59a949f8-53e6-416f-9eee-1b158e9937cb service neutron] For port 85dcf098-2530-45e6-aecc-ec3e2e8888a6, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=85dcf098-2530-45e6-aecc-ec3e2e8888a6,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:40.937739 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0fb67b87-f926-44d7-b44c-9dbbc2386905 req-eaa646df-648f-4e52-aeb6-a8c9c4837721 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1475039 Dec 09 21:18:40.946098 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-95f7b334-8c7b-44bf-bdbe-abd59d00c47b req-64a18756-3357-4a2f-aba8-fde4c7af776f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/security-groups?id=174c6f0d-c012-4077-858c-aa2b94e54d38&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1257489 Dec 09 21:18:40.953121 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-59a949f8-53e6-416f-9eee-1b158e9937cb service neutron] For port 85dcf098-2530-45e6-aecc-ec3e2e8888a6, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:18:40.969086 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da1a0b87-dea0-477a-a277-9a286bc32b95 req-19e81460-f245-4fc2-94c1-97051d444065 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:40.971085 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-da1a0b87-dea0-477a-a277-9a286bc32b95 req-19e81460-f245-4fc2-94c1-97051d444065 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0785527 Dec 09 21:18:41.007699 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-c8d51abf-0f83-4880-84c5-296612527156 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Made reservation on behalf of 857de64ecc3946e3b92655f639d782df for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:18:41.014660 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-c8d51abf-0f83-4880-84c5-296612527156 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:41.034172 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-c8d51abf-0f83-4880-84c5-296612527156 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:41.075024 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-59a949f8-53e6-416f-9eee-1b158e9937cb service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:41.085999 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-59a949f8-53e6-416f-9eee-1b158e9937cb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:41.132592 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0be2a7a0-53eb-42bc-8260-670d13b880e5 req-b6a6260d-ee3c-40e4-bea8-8928481cd3c9 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:41.134082 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0be2a7a0-53eb-42bc-8260-670d13b880e5 req-b6a6260d-ee3c-40e4-bea8-8928481cd3c9 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 945 time: 0.1026974 Dec 09 21:18:41.147972 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-da1a0b87-dea0-477a-a277-9a286bc32b95 req-eadd7c27-850a-4e5c-8040-ae69a7d4271e service neutron] 10.222.0.31 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1554515 Dec 09 21:18:41.172802 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcfe9f9b-2f77-49d3-b274-4539c161e2e7 req-e2b398c9-5c6a-4767-b816-4c54360075ac tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:41.174273 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bcfe9f9b-2f77-49d3-b274-4539c161e2e7 req-e2b398c9-5c6a-4767-b816-4c54360075ac tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=a40f9b82-e796-4cd4-b12e-cd2089ff7c19 HTTP/1.1" status: 200 len: 947 time: 0.1082091 Dec 09 21:18:41.216711 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59a949f8-53e6-416f-9eee-1b158e9937cb service neutron] Pushing event updated for resources: {'Port': ['ID=85dcf098-2530-45e6-aecc-ec3e2e8888a6,revision_number=7']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:41.235116 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0be2a7a0-53eb-42bc-8260-670d13b880e5 req-a839d624-7f13-41c4-9b1e-e80d61087eee tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0925531 Dec 09 21:18:41.258202 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-59a949f8-53e6-416f-9eee-1b158e9937cb service neutron] Attempting to bind port 85dcf098-2530-45e6-aecc-ec3e2e8888a6 on host n-h2-713301-27 for vnic_type normal with profile {"migrating_to": "n-h1-713301-27"} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:18:41.258533 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-59a949f8-53e6-416f-9eee-1b158e9937cb service neutron] Attempting to bind port 85dcf098-2530-45e6-aecc-ec3e2e8888a6 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:18:41.258865 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-59a949f8-53e6-416f-9eee-1b158e9937cb service neutron] Attempting to bind port 85dcf098-2530-45e6-aecc-ec3e2e8888a6 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:41.271499 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-59a949f8-53e6-416f-9eee-1b158e9937cb service neutron] Port 85dcf098-2530-45e6-aecc-ec3e2e8888a6 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:18:41.271674 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-c8d51abf-0f83-4880-84c5-296612527156 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:41.271764 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-59a949f8-53e6-416f-9eee-1b158e9937cb service neutron] Attempting to bind port 85dcf098-2530-45e6-aecc-ec3e2e8888a6 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:41.275558 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bcfe9f9b-2f77-49d3-b274-4539c161e2e7 req-d9208adc-c050-41b6-9b77-68edf1de2f21 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0945537 Dec 09 21:18:41.277845 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-c8d51abf-0f83-4880-84c5-296612527156 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:41.292753 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-59a949f8-53e6-416f-9eee-1b158e9937cb service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 18, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:18:41.301099 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-59a949f8-53e6-416f-9eee-1b158e9937cb service neutron] Checking segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:18:41.301588 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-59a949f8-53e6-416f-9eee-1b158e9937cb service neutron] Bound using segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:18:41.302067 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-59a949f8-53e6-416f-9eee-1b158e9937cb service neutron] Bound port: 85dcf098-2530-45e6-aecc-ec3e2e8888a6, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:18:41.302453 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-59a949f8-53e6-416f-9eee-1b158e9937cb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:41.358081 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-da1a0b87-dea0-477a-a277-9a286bc32b95 req-122ab574-3552-49cc-a2ea-7ad88fa18369 service neutron] 10.222.0.31 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1980045 Dec 09 21:18:41.358535 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8d51abf-0f83-4880-84c5-296612527156 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f29e6584-b652-4b5d-8afa-c1d6228ef778,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:41.408144 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-59a949f8-53e6-416f-9eee-1b158e9937cb service neutron] For port 85dcf098-2530-45e6-aecc-ec3e2e8888a6, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:18:41.412153 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-59a949f8-53e6-416f-9eee-1b158e9937cb service neutron] For port 85dcf098-2530-45e6-aecc-ec3e2e8888a6, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=85dcf098-2530-45e6-aecc-ec3e2e8888a6,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:18:41.417619 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-59a949f8-53e6-416f-9eee-1b158e9937cb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:41.429624 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dd85855-282b-41b9-95a3-9615e853cb23 req-d8d20073-ad1d-4dd5-a055-9f52ec0f73be tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:41.431141 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4dd85855-282b-41b9-95a3-9615e853cb23 req-d8d20073-ad1d-4dd5-a055-9f52ec0f73be tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 1098 time: 0.0895042 Dec 09 21:18:41.461842 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-c8d51abf-0f83-4880-84c5-296612527156 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Allocated IP 192.168.233.145 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/204e6970-8ed3-4e91-9792-52401052a153) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:18:41.506728 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-59a949f8-53e6-416f-9eee-1b158e9937cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:41.507470 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-59a949f8-53e6-416f-9eee-1b158e9937cb service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:41.509041 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-59a949f8-53e6-416f-9eee-1b158e9937cb service neutron] 10.222.0.31 "PUT /v2.0/ports/85dcf098-2530-45e6-aecc-ec3e2e8888a6 HTTP/1.1" status: 200 len: 1123 time: 1.0415077 Dec 09 21:18:41.510171 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59a949f8-53e6-416f-9eee-1b158e9937cb service neutron] Pushing event updated for resources: {'Port': ['ID=85dcf098-2530-45e6-aecc-ec3e2e8888a6,revision_number=8']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:41.514549 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4dd85855-282b-41b9-95a3-9615e853cb23 req-d87b10b6-5d31-4f93-a27e-b49e61cccfaf tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0727818 Dec 09 21:18:41.617076 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['85dcf098-2530-45e6-aecc-ec3e2e8888a6'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:18:41.652557 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7db95d4c-ce0f-4c06-8674-7acd0d76f0f8 req-537c64e7-79bd-4ebf-84a7-fe7b5371040e tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 210 time: 0.0608029 Dec 09 21:18:41.743589 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd2b3d687-3a7a-44b0-b7da-ae4f7e014981', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '85dcf098-2530-45e6-aecc-ec3e2e8888a6'}, {'name': 'network-changed', 'server_uuid': 'd2b3d687-3a7a-44b0-b7da-ae4f7e014981', 'tag': '85dcf098-2530-45e6-aecc-ec3e2e8888a6'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:41.746164 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0805c4c1-dbee-4480-b358-46f9692f0f69" -d '{"events": [{"server_uuid": "d2b3d687-3a7a-44b0-b7da-ae4f7e014981", "name": "network-vif-unplugged", "status": "completed", "tag": "85dcf098-2530-45e6-aecc-ec3e2e8888a6"}, {"name": "network-changed", "server_uuid": "d2b3d687-3a7a-44b0-b7da-ae4f7e014981", "tag": "85dcf098-2530-45e6-aecc-ec3e2e8888a6"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:42.019898 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b3d4e2f-3140-4a99-9fe0-1346ad32a33d req-6e11bd96-323f-457a-ac48-6f7a140cc0c0 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:42.021432 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b3d4e2f-3140-4a99-9fe0-1346ad32a33d req-6e11bd96-323f-457a-ac48-6f7a140cc0c0 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=8c21856f-2254-41e8-941c-2f4471714942 HTTP/1.1" status: 200 len: 948 time: 0.4161685 Dec 09 21:18:42.024525 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-c8d51abf-0f83-4880-84c5-296612527156 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:42.090585 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b3d4e2f-3140-4a99-9fe0-1346ad32a33d req-53512f24-cc4e-4ab0-81c9-b098f03929f8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0584378 Dec 09 21:18:42.097297 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-c8d51abf-0f83-4880-84c5-296612527156 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:42.101453 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 352 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-49042f89-85cb-4b4b-bef5-f7b9ef182ade x-openstack-request-id: req-49042f89-85cb-4b4b-bef5-f7b9ef182ade {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:42.102131 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d2b3d687-3a7a-44b0-b7da-ae4f7e014981", "name": "network-vif-unplugged", "status": "completed", "tag": "85dcf098-2530-45e6-aecc-ec3e2e8888a6", "code": 200}, {"name": "network-changed", "server_uuid": "d2b3d687-3a7a-44b0-b7da-ae4f7e014981", "tag": "85dcf098-2530-45e6-aecc-ec3e2e8888a6", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:42.102389 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-49042f89-85cb-4b4b-bef5-f7b9ef182ade {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:42.102808 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd2b3d687-3a7a-44b0-b7da-ae4f7e014981', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '85dcf098-2530-45e6-aecc-ec3e2e8888a6', 'code': 200} Dec 09 21:18:42.103085 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd2b3d687-3a7a-44b0-b7da-ae4f7e014981', 'tag': '85dcf098-2530-45e6-aecc-ec3e2e8888a6', 'status': 'completed', 'code': 200} Dec 09 21:18:42.158745 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8d51abf-0f83-4880-84c5-296612527156 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Pushing event updated for resources: {'Port': ['ID=204e6970-8ed3-4e91-9792-52401052a153,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:42.177023 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0805c4c1-dbee-4480-b358-46f9692f0f69 req-3b34d4f4-17db-4867-b74c-2cb0385a194a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:42.178634 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0805c4c1-dbee-4480-b358-46f9692f0f69 req-3b34d4f4-17db-4867-b74c-2cb0385a194a service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 1126 time: 0.0453682 Dec 09 21:18:42.190415 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-c8d51abf-0f83-4880-84c5-296612527156 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:18:42.205438 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-c8d51abf-0f83-4880-84c5-296612527156 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:18:42.209953 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-c8d51abf-0f83-4880-84c5-296612527156 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:18:42.278657 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eab95f47-81e3-433a-a2d1-9dd7f9291bd7 req-8eb00c59-6f96-4146-aab8-69146feb571f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:42.280150 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eab95f47-81e3-433a-a2d1-9dd7f9291bd7 req-8eb00c59-6f96-4146-aab8-69146feb571f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=3d45a57e-5f03-4541-88f7-1194f195f63e HTTP/1.1" status: 200 len: 944 time: 0.1055610 Dec 09 21:18:42.289087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-c8d51abf-0f83-4880-84c5-296612527156 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:42.289742 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-c8d51abf-0f83-4880-84c5-296612527156 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:42.315693 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0805c4c1-dbee-4480-b358-46f9692f0f69 req-f2625d71-37a8-42be-902a-791065d052df service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:42.317881 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-c8d51abf-0f83-4880-84c5-296612527156 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.4788828 Dec 09 21:18:42.318005 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0805c4c1-dbee-4480-b358-46f9692f0f69 req-f2625d71-37a8-42be-902a-791065d052df service neutron] 10.222.0.10 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 922 time: 0.1286385 Dec 09 21:18:42.345161 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a7512e6e-d09a-4e97-a670-fc934fb9d22f service neutron] Request body: {'port': {'device_id': 'e6fbd1df-a53f-4f75-810f-f90ea3677ac8', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:42.376841 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0805c4c1-dbee-4480-b358-46f9692f0f69 req-84cf5a34-fdbf-47b3-b636-b57842404ded service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=85dcf098-2530-45e6-aecc-ec3e2e8888a6 HTTP/1.1" status: 200 len: 217 time: 0.0407364 Dec 09 21:18:42.380965 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eab95f47-81e3-433a-a2d1-9dd7f9291bd7 req-7667b1b0-c9cb-45ec-bee4-3006de336169 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/security-groups?id=174c6f0d-c012-4077-858c-aa2b94e54d38&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0830975 Dec 09 21:18:42.422882 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a7512e6e-d09a-4e97-a670-fc934fb9d22f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:42.460474 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0805c4c1-dbee-4480-b358-46f9692f0f69 req-aed2cd51-9c80-416b-8d62-14c63cb7ab2b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:42.463889 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0805c4c1-dbee-4480-b358-46f9692f0f69 req-aed2cd51-9c80-416b-8d62-14c63cb7ab2b service neutron] 10.222.0.10 "GET /v2.0/subnets?id=c49a62cc-af1b-4958-a4a9-eb44188b8fb9 HTTP/1.1" status: 200 len: 861 time: 0.0754147 Dec 09 21:18:42.487384 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d07cc656-b2e1-4877-9758-d4b89584c4ae None None] Provisioning complete for port 204e6970-8ed3-4e91-9792-52401052a153 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:42.487665 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d07cc656-b2e1-4877-9758-d4b89584c4ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:42.508163 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0805c4c1-dbee-4480-b358-46f9692f0f69 req-66460f30-1981-4d03-8cd7-94713f1ead69 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=93378dc3-2ac5-4cf7-9ce3-d812934de40c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0327165 Dec 09 21:18:42.522523 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d07cc656-b2e1-4877-9758-d4b89584c4ae None None] Port 204e6970-8ed3-4e91-9792-52401052a153 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:18:42.638033 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0805c4c1-dbee-4480-b358-46f9692f0f69 req-b0459fec-5382-476b-bcc9-c56ef5071e44 service neutron] 10.222.0.10 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1166816 Dec 09 21:18:42.754410 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0805c4c1-dbee-4480-b358-46f9692f0f69 req-2cfcdb6f-b515-4426-acee-a8cd7e649303 service neutron] 10.222.0.10 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1042104 Dec 09 21:18:42.814714 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a7512e6e-d09a-4e97-a670-fc934fb9d22f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 204e6970-8ed3-4e91-9792-52401052a153 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:18:42.826623 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a569bbbd-04f3-4c0d-8040-7e5e2b519da2 req-49a0ae3c-69be-41b9-b861-73f833b71e71 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:42.831955 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a569bbbd-04f3-4c0d-8040-7e5e2b519da2 req-49a0ae3c-69be-41b9-b861-73f833b71e71 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 943 time: 0.1080484 Dec 09 21:18:42.839012 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a7512e6e-d09a-4e97-a670-fc934fb9d22f service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:42.866810 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a7512e6e-d09a-4e97-a670-fc934fb9d22f service neutron] Transition to ACTIVE for port object 204e6970-8ed3-4e91-9792-52401052a153 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:18:42.872034 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a7512e6e-d09a-4e97-a670-fc934fb9d22f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:42.930400 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a569bbbd-04f3-4c0d-8040-7e5e2b519da2 req-bdf025e1-fcbb-43b7-bed9-1011f606f7b4 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0946417 Dec 09 21:18:42.942804 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7512e6e-d09a-4e97-a670-fc934fb9d22f service neutron] Pushing event updated for resources: {'Port': ['ID=204e6970-8ed3-4e91-9792-52401052a153,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:42.989192 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56424) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:43.033008 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a7512e6e-d09a-4e97-a670-fc934fb9d22f service neutron] Attempting to bind port 204e6970-8ed3-4e91-9792-52401052a153 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:18:43.033591 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a7512e6e-d09a-4e97-a670-fc934fb9d22f service neutron] Attempting to bind port 204e6970-8ed3-4e91-9792-52401052a153 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:18:43.033851 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a7512e6e-d09a-4e97-a670-fc934fb9d22f service neutron] Attempting to bind port 204e6970-8ed3-4e91-9792-52401052a153 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:43.050916 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a7512e6e-d09a-4e97-a670-fc934fb9d22f service neutron] Port 204e6970-8ed3-4e91-9792-52401052a153 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:18:43.050916 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a7512e6e-d09a-4e97-a670-fc934fb9d22f service neutron] Attempting to bind port 204e6970-8ed3-4e91-9792-52401052a153 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:43.072856 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a7512e6e-d09a-4e97-a670-fc934fb9d22f service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 18, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:18:43.073255 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a7512e6e-d09a-4e97-a670-fc934fb9d22f service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:18:43.073588 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a7512e6e-d09a-4e97-a670-fc934fb9d22f service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:18:43.074023 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a7512e6e-d09a-4e97-a670-fc934fb9d22f service neutron] Bound port: 204e6970-8ed3-4e91-9792-52401052a153, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:18:43.074379 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a7512e6e-d09a-4e97-a670-fc934fb9d22f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:43.104212 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd0ad522-7f1d-4788-b309-639ab9a4a795 req-c9fb8ace-d8b1-4ab7-84b1-57373400976a tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:43.105774 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd0ad522-7f1d-4788-b309-639ab9a4a795 req-c9fb8ace-d8b1-4ab7-84b1-57373400976a tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=a40f9b82-e796-4cd4-b12e-cd2089ff7c19 HTTP/1.1" status: 200 len: 947 time: 0.0739429 Dec 09 21:18:43.137234 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25234c85-a41f-42e2-899d-d1d920e3b7f5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:43.206229 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a7512e6e-d09a-4e97-a670-fc934fb9d22f service neutron] For port 204e6970-8ed3-4e91-9792-52401052a153, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:18:43.209628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a7512e6e-d09a-4e97-a670-fc934fb9d22f service neutron] For port 204e6970-8ed3-4e91-9792-52401052a153, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=204e6970-8ed3-4e91-9792-52401052a153,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:18:43.220044 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd0ad522-7f1d-4788-b309-639ab9a4a795 req-e9c5f25a-62ff-42ee-8f56-706fed0789a5 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0897398 Dec 09 21:18:43.222571 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a7512e6e-d09a-4e97-a670-fc934fb9d22f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:43.261309 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25234c85-a41f-42e2-899d-d1d920e3b7f5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:43.267145 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25234c85-a41f-42e2-899d-d1d920e3b7f5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:43.279106 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a7512e6e-d09a-4e97-a670-fc934fb9d22f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:43.279836 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a7512e6e-d09a-4e97-a670-fc934fb9d22f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:43.281412 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a7512e6e-d09a-4e97-a670-fc934fb9d22f service neutron] 10.222.0.10 "PUT /v2.0/ports/204e6970-8ed3-4e91-9792-52401052a153 HTTP/1.1" status: 200 len: 1097 time: 0.9415495 Dec 09 21:18:43.281906 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e6fbd1df-a53f-4f75-810f-f90ea3677ac8', 'tag': '204e6970-8ed3-4e91-9792-52401052a153'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:43.284347 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3a580ca5-7206-470f-9cdb-ccf8de63635b" -d '{"events": [{"name": "network-changed", "server_uuid": "e6fbd1df-a53f-4f75-810f-f90ea3677ac8", "tag": "204e6970-8ed3-4e91-9792-52401052a153"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:43.316763 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7512e6e-d09a-4e97-a670-fc934fb9d22f service neutron] Pushing event updated for resources: {'Port': ['ID=204e6970-8ed3-4e91-9792-52401052a153,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:43.337722 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-25234c85-a41f-42e2-899d-d1d920e3b7f5 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=4c6247717cb84cdbad2e41d8cc161eba&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3471143 Dec 09 21:18:43.340341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25234c85-a41f-42e2-899d-d1d920e3b7f5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=842dd884-9598-4694-ba95-35a2df7db97e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:43.343099 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56436) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:43.471528 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4df966bc-40ed-462f-96d2-9404260ade65 req-cdfb39a4-2cd1-4796-8dfc-b0e0608a5555 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:43.473300 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4df966bc-40ed-462f-96d2-9404260ade65 req-cdfb39a4-2cd1-4796-8dfc-b0e0608a5555 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 948 time: 0.1515439 Dec 09 21:18:43.477837 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a082eb98-408d-4e9f-a3d5-8e9e2ba9cc43 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:43.479354 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-a082eb98-408d-4e9f-a3d5-8e9e2ba9cc43 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 1100 time: 0.1272049 Dec 09 21:18:43.506609 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-0acc072a-4a65-4a9e-bc5d-5546bcff212d tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:18:43.507799 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-0acc072a-4a65-4a9e-bc5d-5546bcff212d tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0062945 Dec 09 21:18:43.543630 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-782151b7-0dd3-49ea-b35a-1cf14133c533 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:43.548683 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-d3aac1ba-f934-424d-9266-dd888eae72b0 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.145&port_id=204e6970-8ed3-4e91-9792-52401052a153 HTTP/1.1" status: 200 len: 217 time: 0.0511975 Dec 09 21:18:43.552009 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-ca5e9ba9-6824-4410-b4df-fb90bd1347a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:43.553407 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-ca5e9ba9-6824-4410-b4df-fb90bd1347a6 service neutron] 10.222.0.13 "GET /v2.0/ports/ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 HTTP/1.1" status: 200 len: 1095 time: 0.0328500 Dec 09 21:18:43.563194 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-85b5cd63-6945-4568-8212-a69375126cfa service neutron] Request body: {'binding': {'host': 'n-h2-713301-27', 'vnic_type': 'normal', 'profile': {}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:43.563820 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-85b5cd63-6945-4568-8212-a69375126cfa service neutron] Unknown quota resources ['binding']. {{(pid=103437) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 09 21:18:43.602890 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-782151b7-0dd3-49ea-b35a-1cf14133c533 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:43.636840 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4df966bc-40ed-462f-96d2-9404260ade65 req-8eea791f-872b-4e94-b475-4e9c5397eab4 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1551640 Dec 09 21:18:43.659147 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-caf2b860-7301-4252-a5ea-3304478a80aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:43.660633 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-caf2b860-7301-4252-a5ea-3304478a80aa service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0974624 Dec 09 21:18:43.700175 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-85b5cd63-6945-4568-8212-a69375126cfa service neutron] Attempting to bind port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 on host n-h2-713301-27 for vnic_type normal with profile None {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:18:43.700520 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-85b5cd63-6945-4568-8212-a69375126cfa service neutron] Attempting to bind port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:18:43.700852 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-85b5cd63-6945-4568-8212-a69375126cfa service neutron] Attempting to bind port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:43.705215 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-85b5cd63-6945-4568-8212-a69375126cfa service neutron] Port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 on network 04fa749a-9f72-4a2c-a725-feab917f99ef not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:18:43.705570 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-85b5cd63-6945-4568-8212-a69375126cfa service neutron] Attempting to bind port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:43.711131 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-85b5cd63-6945-4568-8212-a69375126cfa service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 18, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:18:43.711553 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-85b5cd63-6945-4568-8212-a69375126cfa service neutron] Checking segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:18:43.712002 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-85b5cd63-6945-4568-8212-a69375126cfa service neutron] Bound using segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:18:43.713109 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-85b5cd63-6945-4568-8212-a69375126cfa service neutron] Bound port: ecb95cc0-98d6-4980-b73e-2bc2c2df48f3, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:18:43.716488 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-782151b7-0dd3-49ea-b35a-1cf14133c533 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:43.719787 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-782151b7-0dd3-49ea-b35a-1cf14133c533 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:43.723973 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-782151b7-0dd3-49ea-b35a-1cf14133c533 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/842dd884-9598-4694-ba95-35a2df7db97e HTTP/1.1" status: 204 len: 168 time: 0.3749607 Dec 09 21:18:43.743864 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-e31a0908-46ce-4eff-909e-84c9a14e0e7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:43.745880 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-e31a0908-46ce-4eff-909e-84c9a14e0e7f service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0769038 Dec 09 21:18:43.754512 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-782151b7-0dd3-49ea-b35a-1cf14133c533 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=842dd884-9598-4694-ba95-35a2df7db97e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:43.783563 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-85b5cd63-6945-4568-8212-a69375126cfa service neutron] For port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:18:43.793687 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-85b5cd63-6945-4568-8212-a69375126cfa service neutron] Publish callbacks [] for binding, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:43.795963 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-85b5cd63-6945-4568-8212-a69375126cfa service neutron] 10.222.0.13 "POST /v2.0/ports/ecb95cc0-98d6-4980-b73e-2bc2c2df48f3/bindings HTTP/1.1" status: 201 len: 390 time: 0.2360518 Dec 09 21:18:43.855648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device d0cf802e-891b-41ee-8585-48a361e5265d details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:18:43.929287 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed4f6852-b1e0-4f96-914f-15889e7b4cc8 req-83c0628b-3789-4afe-9dd0-3e518c96e167 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:43.941335 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ed4f6852-b1e0-4f96-914f-15889e7b4cc8 req-83c0628b-3789-4afe-9dd0-3e518c96e167 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=8c21856f-2254-41e8-941c-2f4471714942 HTTP/1.1" status: 200 len: 948 time: 0.1338317 Dec 09 21:18:43.944762 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-665b9d09-45cb-45cf-b2b0-75d9638237ac x-openstack-request-id: req-665b9d09-45cb-45cf-b2b0-75d9638237ac {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:43.945033 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e6fbd1df-a53f-4f75-810f-f90ea3677ac8", "tag": "204e6970-8ed3-4e91-9792-52401052a153", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:43.945282 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-665b9d09-45cb-45cf-b2b0-75d9638237ac {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:43.945679 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e6fbd1df-a53f-4f75-810f-f90ea3677ac8', 'tag': '204e6970-8ed3-4e91-9792-52401052a153', 'status': 'completed', 'code': 200} Dec 09 21:18:43.964072 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-33bb8271-218e-40be-b353-d567d423841f service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1888282 Dec 09 21:18:44.014644 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port d0cf802e-891b-41ee-8585-48a361e5265d, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=d0cf802e-891b-41ee-8585-48a361e5265d,segment=NetworkSegment(c1e3b516-6ad9-46a2-acfa-cf795ad5b916),segment_id=c1e3b516-6ad9-46a2-acfa-cf795ad5b916)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:44.028042 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'd0cf802e-891b-41ee-8585-48a361e5265d', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'port_id': 'd0cf802e-891b-41ee-8585-48a361e5265d', 'mac_address': 'fa:16:3e:b6:c6:a5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 137, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:18:44.040102 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ed4f6852-b1e0-4f96-914f-15889e7b4cc8 req-e696d0dc-5ab7-4e84-9bc8-b6c4da83d086 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0974813 Dec 09 21:18:44.093397 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:44.118556 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d0cf802e-891b-41ee-8585-48a361e5265d {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:18:44.147521 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port d0cf802e-891b-41ee-8585-48a361e5265d, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=d0cf802e-891b-41ee-8585-48a361e5265d,segment=NetworkSegment(c1e3b516-6ad9-46a2-acfa-cf795ad5b916),segment_id=c1e3b516-6ad9-46a2-acfa-cf795ad5b916)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:44.153132 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:44.154275 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:18:44.161624 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-83a45865-fba1-45ae-b6dd-0f417913b18a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:44.161624 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-83a45865-fba1-45ae-b6dd-0f417913b18a service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 1098 time: 0.0679984 Dec 09 21:18:44.162190 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56452) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:44.182291 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4189b460-b449-48b9-b9de-af167c71f836 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:44.204421 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a6c6227-8075-4ef6-aee7-cebd678560e1 req-3d2382c3-1bc7-46ae-9c8c-abc94719886e tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:44.206150 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a6c6227-8075-4ef6-aee7-cebd678560e1 req-3d2382c3-1bc7-46ae-9c8c-abc94719886e tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=3d45a57e-5f03-4541-88f7-1194f195f63e HTTP/1.1" status: 200 len: 944 time: 0.1643090 Dec 09 21:18:44.212361 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b50edb90-647d-44fb-9f0f-c6cd7fa3260c req-cfeb6770-374b-4867-b975-c107a33e642d service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2337213 Dec 09 21:18:44.245270 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7158b18-ed9c-4eb6-ad59-2b4938200988 req-dd581dfa-a4a3-4ea4-89e6-6aecd671852f tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:44.248581 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7158b18-ed9c-4eb6-ad59-2b4938200988 req-dd581dfa-a4a3-4ea4-89e6-6aecd671852f tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 946 time: 0.1333055 Dec 09 21:18:44.274747 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=d0cf802e-891b-41ee-8585-48a361e5265d,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:44.310223 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-bed279fe-f3bf-4862-9979-9535d56e5623 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:44.311055 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=0dc8dc0a-1841-4d79-82ba-8d7ab787a13a,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:44.312338 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-bed279fe-f3bf-4862-9979-9535d56e5623 service neutron] 10.222.0.10 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 908 time: 0.1429276 Dec 09 21:18:44.325727 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '0dc8dc0a-1841-4d79-82ba-8d7ab787a13a', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '0dc8dc0a-1841-4d79-82ba-8d7ab787a13a', 'mac_address': 'fa:16:3e:0d:85:05', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.59'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:18:44.334829 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a6c6227-8075-4ef6-aee7-cebd678560e1 req-f2bd6535-0ebd-4c6f-8420-c5766964c717 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/security-groups?id=174c6f0d-c012-4077-858c-aa2b94e54d38&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1202607 Dec 09 21:18:44.366013 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a580ca5-7206-470f-9cdb-ccf8de63635b req-8387119e-06a2-41fd-99e5-499dcd0ae8db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:44.367516 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a580ca5-7206-470f-9cdb-ccf8de63635b req-8387119e-06a2-41fd-99e5-499dcd0ae8db service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 1100 time: 0.0743306 Dec 09 21:18:44.371738 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:44.381634 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-2a44bbc3-5b9a-4f46-8a6f-cdec8857745e service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 HTTP/1.1" status: 200 len: 217 time: 0.0599802 Dec 09 21:18:44.389787 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:18:44.400909 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7158b18-ed9c-4eb6-ad59-2b4938200988 req-c0175e1f-0914-457f-a2b5-ac52d3984a09 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1225753 Dec 09 21:18:44.428686 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=0dc8dc0a-1841-4d79-82ba-8d7ab787a13a,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:44.441268 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:44.444263 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4189b460-b449-48b9-b9de-af167c71f836 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:44.453490 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4189b460-b449-48b9-b9de-af167c71f836 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:44.481412 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-4c5b9dd6-4e1d-454c-beed-ee526269f607 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:44.482922 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-4c5b9dd6-4e1d-454c-beed-ee526269f607 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=eae2438b-9fcc-44ef-a172-6c4911cad13f HTTP/1.1" status: 200 len: 847 time: 0.0940583 Dec 09 21:18:44.505574 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=0dc8dc0a-1841-4d79-82ba-8d7ab787a13a,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:44.525137 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62ae1d97-f2ab-4f6e-aabb-48d1631ba6d6 req-e18b2a21-e8b4-4d84-8920-e7edc7ace034 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:44.526685 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-62ae1d97-f2ab-4f6e-aabb-48d1631ba6d6 req-e18b2a21-e8b4-4d84-8920-e7edc7ace034 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 943 time: 0.1035714 Dec 09 21:18:44.532298 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4189b460-b449-48b9-b9de-af167c71f836 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=7f9b149494e7482ea1daa3115220005a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3695011 Dec 09 21:18:44.535687 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-46982412-060a-48ee-bc02-886b7bfe7f99 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=04fa749a-9f72-4a2c-a725-feab917f99ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0380225 Dec 09 21:18:44.536317 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4189b460-b449-48b9-b9de-af167c71f836 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5fb6f714-bed2-4ac2-8788-0f9fe89e71c6,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:44.538717 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56458) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:44.562859 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a580ca5-7206-470f-9cdb-ccf8de63635b req-c9e8410d-f371-4d88-8a3c-1eff9acf6870 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:44.564387 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a580ca5-7206-470f-9cdb-ccf8de63635b req-c9e8410d-f371-4d88-8a3c-1eff9acf6870 service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.1701844 Dec 09 21:18:44.633762 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a580ca5-7206-470f-9cdb-ccf8de63635b req-3fac7527-06d9-419a-900c-49111551d0d4 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.145&port_id=204e6970-8ed3-4e91-9792-52401052a153 HTTP/1.1" status: 200 len: 217 time: 0.0603576 Dec 09 21:18:44.645227 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-6c5c02cf-8f8d-42e6-a045-ac8e796d9a7d service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0969713 Dec 09 21:18:44.684762 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-62ae1d97-f2ab-4f6e-aabb-48d1631ba6d6 req-9dac5779-c990-47d5-a40f-3d62cabbe7c0 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1450408 Dec 09 21:18:44.700247 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e66af3fe-fe1b-4cc0-ba46-90ff7899afbd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:44.733003 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['d0cf802e-891b-41ee-8585-48a361e5265d'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:18:44.767277 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-2f144fb4-b050-40a4-b075-8e2fcd540b86 service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1142457 Dec 09 21:18:44.769531 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e66af3fe-fe1b-4cc0-ba46-90ff7899afbd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:44.773759 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a580ca5-7206-470f-9cdb-ccf8de63635b req-43f5bff7-147f-4f2e-9287-5b1398ddc428 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:44.775318 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a580ca5-7206-470f-9cdb-ccf8de63635b req-43f5bff7-147f-4f2e-9287-5b1398ddc428 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1298509 Dec 09 21:18:44.804681 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['0dc8dc0a-1841-4d79-82ba-8d7ab787a13a'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:18:44.889539 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01a66346-c1a6-4ae8-87e4-be0f1fe8a7c0 req-1c70cb36-a852-47ee-b326-90de1ba6dae8 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:44.890950 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-01a66346-c1a6-4ae8-87e4-be0f1fe8a7c0 req-1c70cb36-a852-47ee-b326-90de1ba6dae8 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=a40f9b82-e796-4cd4-b12e-cd2089ff7c19 HTTP/1.1" status: 200 len: 948 time: 0.1189709 Dec 09 21:18:44.934671 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a580ca5-7206-470f-9cdb-ccf8de63635b req-ad1cb906-f2f8-4789-a079-951c323a0f83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:44.936168 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a580ca5-7206-470f-9cdb-ccf8de63635b req-ad1cb906-f2f8-4789-a079-951c323a0f83 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1204822 Dec 09 21:18:44.947169 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e66af3fe-fe1b-4cc0-ba46-90ff7899afbd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:44.949673 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e66af3fe-fe1b-4cc0-ba46-90ff7899afbd admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:44.950760 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e66af3fe-fe1b-4cc0-ba46-90ff7899afbd admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/5fb6f714-bed2-4ac2-8788-0f9fe89e71c6 HTTP/1.1" status: 204 len: 168 time: 0.4098732 Dec 09 21:18:44.985330 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e66af3fe-fe1b-4cc0-ba46-90ff7899afbd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5fb6f714-bed2-4ac2-8788-0f9fe89e71c6,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:45.020018 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-5f0be385-f509-423c-b414-071092de3e4b tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:45.025227 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-5f0be385-f509-423c-b414-071092de3e4b tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.10 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2&tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&binding%3Ahost_id=n-h1-713301-27 HTTP/1.1" status: 200 len: 1098 time: 0.0707242 Dec 09 21:18:45.039206 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-0bdc06b4-e7b4-4124-8d41-ca6c783c883e service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h2-713301-27'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:45.058708 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f34bc1ce-ab87-4411-a5e8-dc0b3136c441 req-172a5bc8-eb1a-4a85-befc-957d2b43d709 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:45.060343 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f34bc1ce-ab87-4411-a5e8-dc0b3136c441 req-172a5bc8-eb1a-4a85-befc-957d2b43d709 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 948 time: 0.1643815 Dec 09 21:18:45.079405 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-01a66346-c1a6-4ae8-87e4-be0f1fe8a7c0 req-7ff77c55-9fb3-4fa8-9afb-e057df01d1e0 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1723402 Dec 09 21:18:45.126683 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-0bdc06b4-e7b4-4124-8d41-ca6c783c883e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:45.172578 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a580ca5-7206-470f-9cdb-ccf8de63635b req-16b98b11-f911-4993-bbdd-6e320115649a service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2171390 Dec 09 21:18:45.178821 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f34bc1ce-ab87-4411-a5e8-dc0b3136c441 req-9f284b27-b4c9-47ed-beed-f075476676d3 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0826154 Dec 09 21:18:45.285934 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a580ca5-7206-470f-9cdb-ccf8de63635b req-293e60f4-a012-4aa4-8080-cafa9b095149 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1047971 Dec 09 21:18:45.327645 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-0bdc06b4-e7b4-4124-8d41-ca6c783c883e service neutron] For port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:45.386616 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-0bdc06b4-e7b4-4124-8d41-ca6c783c883e service neutron] For port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:18:45.464916 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-0bdc06b4-e7b4-4124-8d41-ca6c783c883e service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:45.468118 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0d277843-0a85-41b3-add1-0e319baac5d2', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'ecb95cc0-98d6-4980-b73e-2bc2c2df48f3'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:45.472053 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0282c3b5-f672-4453-8947-4f90b7975349" -d '{"events": [{"server_uuid": "0d277843-0a85-41b3-add1-0e319baac5d2", "name": "network-vif-unplugged", "status": "completed", "tag": "ecb95cc0-98d6-4980-b73e-2bc2c2df48f3"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:45.474681 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ee90e15-6158-4cb8-9152-b7a822bfe85b req-20b28bec-efb3-4b4d-b203-0e6186850289 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:45.476544 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ee90e15-6158-4cb8-9152-b7a822bfe85b req-20b28bec-efb3-4b4d-b203-0e6186850289 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=3d45a57e-5f03-4541-88f7-1194f195f63e HTTP/1.1" status: 200 len: 945 time: 0.0608835 Dec 09 21:18:45.479748 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-0bdc06b4-e7b4-4124-8d41-ca6c783c883e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:45.555995 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ee90e15-6158-4cb8-9152-b7a822bfe85b req-50bc77fe-f74f-482d-b929-d49942222f8e tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/security-groups?id=174c6f0d-c012-4077-858c-aa2b94e54d38&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0722620 Dec 09 21:18:45.567362 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bdc06b4-e7b4-4124-8d41-ca6c783c883e service neutron] Pushing event updated for resources: {'Port': ['ID=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3,revision_number=7']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:45.608593 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-742e0f18-0184-47d0-929c-b56b1a36d6aa req-872aef49-a3cd-4573-a8e7-51b0bd7dcd1a tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:45.609158 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-742e0f18-0184-47d0-929c-b56b1a36d6aa req-872aef49-a3cd-4573-a8e7-51b0bd7dcd1a tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:45.609622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-742e0f18-0184-47d0-929c-b56b1a36d6aa req-872aef49-a3cd-4573-a8e7-51b0bd7dcd1a tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:45.610079 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-742e0f18-0184-47d0-929c-b56b1a36d6aa req-872aef49-a3cd-4573-a8e7-51b0bd7dcd1a tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:45.610531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-742e0f18-0184-47d0-929c-b56b1a36d6aa req-872aef49-a3cd-4573-a8e7-51b0bd7dcd1a tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:45.610982 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-742e0f18-0184-47d0-929c-b56b1a36d6aa req-872aef49-a3cd-4573-a8e7-51b0bd7dcd1a tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:45.611233 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-0bdc06b4-e7b4-4124-8d41-ca6c783c883e service neutron] Attempting to bind port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 on host n-h1-713301-27 for vnic_type normal with profile {"migrating_to": "n-h2-713301-27"} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:18:45.611537 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-742e0f18-0184-47d0-929c-b56b1a36d6aa req-872aef49-a3cd-4573-a8e7-51b0bd7dcd1a tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:45.611643 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-0bdc06b4-e7b4-4124-8d41-ca6c783c883e service neutron] Attempting to bind port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:18:45.611967 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-0bdc06b4-e7b4-4124-8d41-ca6c783c883e service neutron] Attempting to bind port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:45.612132 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-742e0f18-0184-47d0-929c-b56b1a36d6aa req-872aef49-a3cd-4573-a8e7-51b0bd7dcd1a tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:45.612679 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-742e0f18-0184-47d0-929c-b56b1a36d6aa req-872aef49-a3cd-4573-a8e7-51b0bd7dcd1a tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:45.613137 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-742e0f18-0184-47d0-929c-b56b1a36d6aa req-872aef49-a3cd-4573-a8e7-51b0bd7dcd1a tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:45.615901 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-742e0f18-0184-47d0-929c-b56b1a36d6aa req-872aef49-a3cd-4573-a8e7-51b0bd7dcd1a tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8&device_id=3d45a57e-5f03-4541-88f7-1194f195f63e&device_id=a40f9b82-e796-4cd4-b12e-cd2089ff7c19&device_id=8c21856f-2254-41e8-941c-2f4471714942&device_id=0d277843-0a85-41b3-add1-0e319baac5d2&device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981&device_id=17188b52-f615-49ca-8709-a3c9238c02fa&device_id=ebcfc729-b616-4933-a43d-f707a862db78&device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5&device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 9118 time: 0.0756352 Dec 09 21:18:45.621412 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-0bdc06b4-e7b4-4124-8d41-ca6c783c883e service neutron] Port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 on network 04fa749a-9f72-4a2c-a725-feab917f99ef not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:18:45.621819 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-0bdc06b4-e7b4-4124-8d41-ca6c783c883e service neutron] Attempting to bind port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:18:45.627032 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-0bdc06b4-e7b4-4124-8d41-ca6c783c883e service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 18, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:18:45.627383 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-0bdc06b4-e7b4-4124-8d41-ca6c783c883e service neutron] Checking segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:18:45.627911 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-0bdc06b4-e7b4-4124-8d41-ca6c783c883e service neutron] Bound using segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:18:45.628338 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-0bdc06b4-e7b4-4124-8d41-ca6c783c883e service neutron] Bound port: ecb95cc0-98d6-4980-b73e-2bc2c2df48f3, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:18:45.628883 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-0bdc06b4-e7b4-4124-8d41-ca6c783c883e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:45.636756 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-742e0f18-0184-47d0-929c-b56b1a36d6aa req-e76e664e-1173-4a59-8d89-79d2bd9775f3 tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:45.697626 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-0bdc06b4-e7b4-4124-8d41-ca6c783c883e service neutron] For port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:18:45.701087 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-0bdc06b4-e7b4-4124-8d41-ca6c783c883e service neutron] For port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:18:45.706596 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-0bdc06b4-e7b4-4124-8d41-ca6c783c883e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:45.708676 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-348ea79e-0d39-426d-b10a-f9d198da078e req-b73c62ff-5b8c-4a7f-9aec-8918a20ad270 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:45.710199 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-348ea79e-0d39-426d-b10a-f9d198da078e req-b73c62ff-5b8c-4a7f-9aec-8918a20ad270 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 944 time: 0.0647018 Dec 09 21:18:45.780150 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-348ea79e-0d39-426d-b10a-f9d198da078e req-19085747-a314-4e31-98ae-d4f66b2bf72d tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0596530 Dec 09 21:18:45.791579 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-0bdc06b4-e7b4-4124-8d41-ca6c783c883e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:45.792689 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-0bdc06b4-e7b4-4124-8d41-ca6c783c883e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:45.794117 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-0bdc06b4-e7b4-4124-8d41-ca6c783c883e service neutron] 10.222.0.10 "PUT /v2.0/ports/ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 HTTP/1.1" status: 200 len: 1124 time: 0.7611656 Dec 09 21:18:45.795227 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bdc06b4-e7b4-4124-8d41-ca6c783c883e service neutron] Pushing event updated for resources: {'Port': ['ID=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3,revision_number=8']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:45.809200 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-742e0f18-0184-47d0-929c-b56b1a36d6aa req-e76e664e-1173-4a59-8d89-79d2bd9775f3 tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:45.815875 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-742e0f18-0184-47d0-929c-b56b1a36d6aa req-e76e664e-1173-4a59-8d89-79d2bd9775f3 tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:45.871230 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-41af252c-2c39-4733-a72a-cf1dc9b808d7 x-openstack-request-id: req-41af252c-2c39-4733-a72a-cf1dc9b808d7 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:45.871570 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0d277843-0a85-41b3-add1-0e319baac5d2", "name": "network-vif-unplugged", "status": "completed", "tag": "ecb95cc0-98d6-4980-b73e-2bc2c2df48f3", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:45.871995 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-41af252c-2c39-4733-a72a-cf1dc9b808d7 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:45.872418 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0d277843-0a85-41b3-add1-0e319baac5d2', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'ecb95cc0-98d6-4980-b73e-2bc2c2df48f3', 'code': 200} Dec 09 21:18:45.876187 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 85dcf098-2530-45e6-aecc-ec3e2e8888a6 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:18:45.892014 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e76e664e-1173-4a59-8d89-79d2bd9775f3 tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=85968342-4a71-4b1b-a267-865ecfb988e1,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:45.973736 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['ecb95cc0-98d6-4980-b73e-2bc2c2df48f3'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:18:45.986022 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-742e0f18-0184-47d0-929c-b56b1a36d6aa req-e76e664e-1173-4a59-8d89-79d2bd9775f3 tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&id=3997e1dc-b863-4862-a321-fb463bb4bb43&id=f29e6584-b652-4b5d-8afa-c1d6228ef778&id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&id=9798184d-82ec-4464-b3fc-95653513aba7&id=174c6f0d-c012-4077-858c-aa2b94e54d38&id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 714 time: 0.3620906 Dec 09 21:18:45.999488 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b384d44d-0e9a-4815-9fec-6c1a2dff7f2d req-8839759d-738a-4221-afe1-4ef99fbb35b3 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:46.001012 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b384d44d-0e9a-4815-9fec-6c1a2dff7f2d req-8839759d-738a-4221-afe1-4ef99fbb35b3 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 943 time: 0.0806913 Dec 09 21:18:46.047228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 85dcf098-2530-45e6-aecc-ec3e2e8888a6, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=85dcf098-2530-45e6-aecc-ec3e2e8888a6,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:46.065056 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b384d44d-0e9a-4815-9fec-6c1a2dff7f2d req-53ad55f7-d8ca-463f-9911-65af6458efe2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0569086 Dec 09 21:18:46.084394 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 85dcf098-2530-45e6-aecc-ec3e2e8888a6 has no active binding in host n-h1-713301-27 {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:158}} Dec 09 21:18:46.201345 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aa03d44-f20a-4dd3-b68f-cdb8364f7c17 req-94cd8616-d81e-48c6-b148-09ae1b748c08 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:46.202864 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8aa03d44-f20a-4dd3-b68f-cdb8364f7c17 req-94cd8616-d81e-48c6-b148-09ae1b748c08 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=a40f9b82-e796-4cd4-b12e-cd2089ff7c19 HTTP/1.1" status: 200 len: 948 time: 0.0547287 Dec 09 21:18:46.281475 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8aa03d44-f20a-4dd3-b68f-cdb8364f7c17 req-fd858b72-5be6-45f7-9f97-719698df7b90 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0713151 Dec 09 21:18:46.304722 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32eb990b-4ff4-44b8-a948-666135c37a84 req-71cefea5-7479-46b7-8452-2eaca9f1f730 tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:46.305205 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32eb990b-4ff4-44b8-a948-666135c37a84 req-71cefea5-7479-46b7-8452-2eaca9f1f730 tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:46.305662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32eb990b-4ff4-44b8-a948-666135c37a84 req-71cefea5-7479-46b7-8452-2eaca9f1f730 tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:46.307725 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32eb990b-4ff4-44b8-a948-666135c37a84 req-71cefea5-7479-46b7-8452-2eaca9f1f730 tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=8c21856f-2254-41e8-941c-2f4471714942&device_id=ebcfc729-b616-4933-a43d-f707a862db78&device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 2885 time: 0.0678332 Dec 09 21:18:46.381076 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32eb990b-4ff4-44b8-a948-666135c37a84 req-ef7324ed-a2e1-4543-a839-966868c99362 tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0646968 Dec 09 21:18:46.401107 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9685a00d-57df-433b-bc62-28505834f41a req-be5f1aa1-a7cc-47bc-86af-641507ff339c tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:46.402689 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9685a00d-57df-433b-bc62-28505834f41a req-be5f1aa1-a7cc-47bc-86af-641507ff339c tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 948 time: 0.0621414 Dec 09 21:18:46.460205 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9685a00d-57df-433b-bc62-28505834f41a req-a3866e71-5d9f-47ca-bf39-a99a8de6e5a0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499983 Dec 09 21:18:46.688925 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07622105-337c-4cb1-a24b-0a546b717420 req-710de051-b52c-41f9-9f81-ca027ffdc2ac tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:46.690428 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07622105-337c-4cb1-a24b-0a546b717420 req-710de051-b52c-41f9-9f81-ca027ffdc2ac tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=3d45a57e-5f03-4541-88f7-1194f195f63e HTTP/1.1" status: 200 len: 945 time: 0.0516939 Dec 09 21:18:46.737709 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07622105-337c-4cb1-a24b-0a546b717420 req-e8413196-20fa-49b1-abe3-5843b1a50152 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/security-groups?id=174c6f0d-c012-4077-858c-aa2b94e54d38&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408814 Dec 09 21:18:46.980194 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1776dbf-723b-472f-ad4e-ae825ffa606d req-4f84093a-086f-41bd-9de0-3f83f7a88532 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:46.981671 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a1776dbf-723b-472f-ad4e-ae825ffa606d req-4f84093a-086f-41bd-9de0-3f83f7a88532 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 944 time: 0.0483003 Dec 09 21:18:47.052063 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a1776dbf-723b-472f-ad4e-ae825ffa606d req-f905d841-57a8-4d7b-95c9-a6c465296af5 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0643101 Dec 09 21:18:47.057942 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49d379ab-d752-4e30-b1dd-220817b856aa req-702f3c47-39d8-4378-9c54-5c6ccb92cad2 tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:47.059336 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-49d379ab-d752-4e30-b1dd-220817b856aa req-702f3c47-39d8-4378-9c54-5c6ccb92cad2 tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 1102 time: 0.0659733 Dec 09 21:18:47.109155 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-49d379ab-d752-4e30-b1dd-220817b856aa req-1c139f4a-8cd8-45a1-a1c6-f1d5e31138c7 tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430226 Dec 09 21:18:47.214433 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6e8f664-4471-4108-8b04-10e0cb1085dd req-4dc3c53d-0864-47b1-89fa-00673dc379e4 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:47.216240 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6e8f664-4471-4108-8b04-10e0cb1085dd req-4dc3c53d-0864-47b1-89fa-00673dc379e4 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 943 time: 0.0508869 Dec 09 21:18:47.289244 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6e8f664-4471-4108-8b04-10e0cb1085dd req-9b8a266f-b5da-4871-8648-a21c179d0096 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0670075 Dec 09 21:18:47.302290 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-695985ce-1510-4910-a2a5-8eb9fecb897b req-a1e5d643-b7c3-45ac-8d34-4bbb4bc459a1 tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:47.304653 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-695985ce-1510-4910-a2a5-8eb9fecb897b req-a1e5d643-b7c3-45ac-8d34-4bbb4bc459a1 tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 1102 time: 0.0576985 Dec 09 21:18:47.350858 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-695985ce-1510-4910-a2a5-8eb9fecb897b req-f6dd7257-7d96-49b9-a430-3242058b3972 tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0376818 Dec 09 21:18:47.459577 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1c447588-82bd-431b-918f-168f55b16e4a req-205983f5-49b3-4eb9-ad94-a6dc7deca013 tempest-QuotasAdminNegativeTest-1354435892 tempest-QuotasAdminNegativeTest-1354435892-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=784092c4d36a4f9ebac1dc4da55056f3&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0411835 Dec 09 21:18:47.507043 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ec89b67-b41d-4f73-a4a4-a1f84d96c29f req-4ad1c1a3-2894-4567-b98f-b1aa42706fba tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:47.508511 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ec89b67-b41d-4f73-a4a4-a1f84d96c29f req-4ad1c1a3-2894-4567-b98f-b1aa42706fba tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=a40f9b82-e796-4cd4-b12e-cd2089ff7c19 HTTP/1.1" status: 200 len: 948 time: 0.0992963 Dec 09 21:18:47.625895 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ec89b67-b41d-4f73-a4a4-a1f84d96c29f req-3af983bc-94e0-4402-9e35-e62620af3061 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1074932 Dec 09 21:18:47.632580 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c447588-82bd-431b-918f-168f55b16e4a req-c4771af6-38b4-431e-a789-31681b0659d1 tempest-QuotasAdminNegativeTest-1354435892 tempest-QuotasAdminNegativeTest-1354435892-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:47.633977 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1c447588-82bd-431b-918f-168f55b16e4a req-c4771af6-38b4-431e-a789-31681b0659d1 tempest-QuotasAdminNegativeTest-1354435892 tempest-QuotasAdminNegativeTest-1354435892-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1681442 Dec 09 21:18:47.654077 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1c447588-82bd-431b-918f-168f55b16e4a req-e5f09613-e248-4cf6-b0ee-1a6c4aefc76c tempest-QuotasAdminNegativeTest-1354435892 tempest-QuotasAdminNegativeTest-1354435892-project] 10.222.0.13 "GET /v2.0/quotas/784092c4d36a4f9ebac1dc4da55056f3 HTTP/1.1" status: 200 len: 375 time: 0.0130460 Dec 09 21:18:47.685776 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1c447588-82bd-431b-918f-168f55b16e4a req-d83a818f-4ee6-432a-ba85-be427ef2d6fc tempest-QuotasAdminNegativeTest-1354435892 tempest-QuotasAdminNegativeTest-1354435892-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=784092c4d36a4f9ebac1dc4da55056f3&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0272782 Dec 09 21:18:47.873273 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0d277843-0a85-41b3-add1-0e319baac5d2', 'tag': 'ecb95cc0-98d6-4980-b73e-2bc2c2df48f3'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:47.875710 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0e3f3b48-6c16-4206-8294-4878f8bd1a8c" -d '{"events": [{"name": "network-changed", "server_uuid": "0d277843-0a85-41b3-add1-0e319baac5d2", "tag": "ecb95cc0-98d6-4980-b73e-2bc2c2df48f3"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:47.892195 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device d0cf802e-891b-41ee-8585-48a361e5265d up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:18:47.922178 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 204e6970-8ed3-4e91-9792-52401052a153 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:18:47.925373 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9ce1e05-f782-48dc-9424-a1bb58a3645e req-57f8b041-515c-4e87-9bf9-08397f3d94c0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:47.927763 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a9ce1e05-f782-48dc-9424-a1bb58a3645e req-57f8b041-515c-4e87-9bf9-08397f3d94c0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 948 time: 0.0693443 Dec 09 21:18:47.985894 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a9ce1e05-f782-48dc-9424-a1bb58a3645e req-947d4897-a4f0-43ab-9e37-1111a33bf672 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494125 Dec 09 21:18:48.032324 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port d0cf802e-891b-41ee-8585-48a361e5265d completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:18:48.041484 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port d0cf802e-891b-41ee-8585-48a361e5265d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:48.042008 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:48.115204 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 204e6970-8ed3-4e91-9792-52401052a153, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=204e6970-8ed3-4e91-9792-52401052a153,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:48.118348 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da9da618-68b8-4227-914d-987b1ab2d0b5 req-d9a6cd63-3ad7-41e4-99d7-5f54406c190b tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:48.121104 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da9da618-68b8-4227-914d-987b1ab2d0b5 req-d9a6cd63-3ad7-41e4-99d7-5f54406c190b tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=3d45a57e-5f03-4541-88f7-1194f195f63e HTTP/1.1" status: 200 len: 945 time: 0.0625339 Dec 09 21:18:48.136252 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '204e6970-8ed3-4e91-9792-52401052a153', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '204e6970-8ed3-4e91-9792-52401052a153', 'mac_address': 'fa:16:3e:2d:bf:13', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.145'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:18:48.167213 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-48537ecf-7264-4757-a427-a1b31e5081fc x-openstack-request-id: req-48537ecf-7264-4757-a427-a1b31e5081fc {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:48.168256 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0d277843-0a85-41b3-add1-0e319baac5d2", "tag": "ecb95cc0-98d6-4980-b73e-2bc2c2df48f3", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:48.168698 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-48537ecf-7264-4757-a427-a1b31e5081fc {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:48.169414 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0d277843-0a85-41b3-add1-0e319baac5d2', 'tag': 'ecb95cc0-98d6-4980-b73e-2bc2c2df48f3', 'status': 'completed', 'code': 200} Dec 09 21:18:48.209736 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da9da618-68b8-4227-914d-987b1ab2d0b5 req-b95e9b83-1b4b-46ac-ad51-1aeec98a8d68 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/security-groups?id=174c6f0d-c012-4077-858c-aa2b94e54d38&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0749466 Dec 09 21:18:48.218086 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:48.248843 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:48.261996 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e3f3b48-6c16-4206-8294-4878f8bd1a8c req-3864e7dc-f605-46dc-b1c1-ce2ed02c1c7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:48.264592 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0e3f3b48-6c16-4206-8294-4878f8bd1a8c req-3864e7dc-f605-46dc-b1c1-ce2ed02c1c7c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 1127 time: 0.0659561 Dec 09 21:18:48.266397 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3d45a57e-5f03-4541-88f7-1194f195f63e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd0cf802e-891b-41ee-8585-48a361e5265d'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:48.269138 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e140b068-0efd-4fa8-8d44-e4fce7cb60c3" -d '{"events": [{"server_uuid": "3d45a57e-5f03-4541-88f7-1194f195f63e", "name": "network-vif-plugged", "status": "completed", "tag": "d0cf802e-891b-41ee-8585-48a361e5265d"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:48.287652 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port d0cf802e-891b-41ee-8585-48a361e5265d, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=d0cf802e-891b-41ee-8585-48a361e5265d,segment=NetworkSegment(c1e3b516-6ad9-46a2-acfa-cf795ad5b916),segment_id=c1e3b516-6ad9-46a2-acfa-cf795ad5b916)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:48.291597 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 204e6970-8ed3-4e91-9792-52401052a153 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:18:48.300683 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:48.302018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:18:48.359576 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3702b72-1eae-4d4f-90f0-a6158351f3bc req-3425222f-13b4-4785-9b68-2ead6f42a2a4 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:48.368178 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3702b72-1eae-4d4f-90f0-a6158351f3bc req-3425222f-13b4-4785-9b68-2ead6f42a2a4 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 944 time: 0.0798919 Dec 09 21:18:48.382870 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 204e6970-8ed3-4e91-9792-52401052a153, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=204e6970-8ed3-4e91-9792-52401052a153,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:48.394081 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:48.414809 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e3f3b48-6c16-4206-8294-4878f8bd1a8c req-7ad4634d-2e1e-417b-9b7f-bff3626750a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:48.416551 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0e3f3b48-6c16-4206-8294-4878f8bd1a8c req-7ad4634d-2e1e-417b-9b7f-bff3626750a5 service neutron] 10.222.0.31 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 908 time: 0.1440840 Dec 09 21:18:48.428665 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=d0cf802e-891b-41ee-8585-48a361e5265d,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:48.430738 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3702b72-1eae-4d4f-90f0-a6158351f3bc req-e52afa92-bef0-44ca-9567-7b10af9f20bc tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0593357 Dec 09 21:18:48.474268 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:18:48.490743 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:48.491213 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:48.504382 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bd845a73-8da5-4659-800c-2ea72448541a x-openstack-request-id: req-bd845a73-8da5-4659-800c-2ea72448541a {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:48.504791 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3d45a57e-5f03-4541-88f7-1194f195f63e", "name": "network-vif-plugged", "status": "completed", "tag": "d0cf802e-891b-41ee-8585-48a361e5265d", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:48.505131 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-bd845a73-8da5-4659-800c-2ea72448541a {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:48.505604 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3d45a57e-5f03-4541-88f7-1194f195f63e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd0cf802e-891b-41ee-8585-48a361e5265d', 'code': 200} Dec 09 21:18:48.518166 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0e3f3b48-6c16-4206-8294-4878f8bd1a8c req-9c38953a-f343-431d-badf-a504aab056e0 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 HTTP/1.1" status: 200 len: 217 time: 0.0789986 Dec 09 21:18:48.536366 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=204e6970-8ed3-4e91-9792-52401052a153,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:48.624791 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e3f3b48-6c16-4206-8294-4878f8bd1a8c req-d5cf0776-2ccc-4eb2-bbbd-a2560df9d11a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:48.625434 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4838742-00c4-4ea7-b94d-aee06d5eadad req-ca3eac2f-fc77-4a6b-973e-dbf174f164d9 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:48.626275 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0e3f3b48-6c16-4206-8294-4878f8bd1a8c req-d5cf0776-2ccc-4eb2-bbbd-a2560df9d11a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=eae2438b-9fcc-44ef-a172-6c4911cad13f HTTP/1.1" status: 200 len: 847 time: 0.0910051 Dec 09 21:18:48.639789 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08008ff1-753b-4ebc-ac8b-ef3a22f759a5 req-3135e35f-dcba-4af5-be3d-ab372cdbbda3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:48.641052 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4838742-00c4-4ea7-b94d-aee06d5eadad req-ca3eac2f-fc77-4a6b-973e-dbf174f164d9 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 943 time: 0.0749383 Dec 09 21:18:48.641242 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-08008ff1-753b-4ebc-ac8b-ef3a22f759a5 req-3135e35f-dcba-4af5-be3d-ab372cdbbda3 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=3d45a57e-5f03-4541-88f7-1194f195f63e HTTP/1.1" status: 200 len: 1098 time: 0.0519385 Dec 09 21:18:48.692275 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:48.697443 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0e3f3b48-6c16-4206-8294-4878f8bd1a8c req-0edaebdf-e2d5-4809-977a-e4c9057a58bd service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=04fa749a-9f72-4a2c-a725-feab917f99ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0551121 Dec 09 21:18:48.716130 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4838742-00c4-4ea7-b94d-aee06d5eadad req-da31ba96-956f-40a1-954f-3a31dfb7f89d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0737886 Dec 09 21:18:48.739599 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=0dc8dc0a-1841-4d79-82ba-8d7ab787a13a,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:48.744410 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-08008ff1-753b-4ebc-ac8b-ef3a22f759a5 req-6fe1a7be-e422-42a1-8c30-4efe0df4a44d service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=174c6f0d-c012-4077-858c-aa2b94e54d38&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0941103 Dec 09 21:18:48.746470 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:48.817204 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['204e6970-8ed3-4e91-9792-52401052a153'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:18:48.827194 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0e3f3b48-6c16-4206-8294-4878f8bd1a8c req-64927172-4a1a-4949-a3e3-671c6bea6134 service neutron] 10.222.0.31 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1191728 Dec 09 21:18:48.846945 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2042ab7-1f24-49a3-a4ff-e315b3d18154 req-5abaea74-b178-4b00-9ddf-f95d7cb20b01 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:48.848068 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b2042ab7-1f24-49a3-a4ff-e315b3d18154 req-5abaea74-b178-4b00-9ddf-f95d7cb20b01 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=a40f9b82-e796-4cd4-b12e-cd2089ff7c19 HTTP/1.1" status: 200 len: 949 time: 0.0621786 Dec 09 21:18:48.867751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=0dc8dc0a-1841-4d79-82ba-8d7ab787a13a,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:48.925693 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b2042ab7-1f24-49a3-a4ff-e315b3d18154 req-110927d9-e305-41d3-aaa9-f66469574f8f tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0668592 Dec 09 21:18:48.976977 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e6d890e-6d48-43f1-93d5-302a2c7ed36c req-be174950-5fc7-4fe2-8130-7a6d5e15d07f tempest-QuotasAdminNegativeTest-1354435892 tempest-QuotasAdminNegativeTest-1354435892-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=784092c4d36a4f9ebac1dc4da55056f3&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0253835 Dec 09 21:18:49.096555 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0e3f3b48-6c16-4206-8294-4878f8bd1a8c req-325e86a0-d7aa-49db-ab2e-640569a1c4d8 service neutron] 10.222.0.31 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1174877 Dec 09 21:18:49.394796 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e6d890e-6d48-43f1-93d5-302a2c7ed36c req-e2d22751-57e4-491d-a6b2-30c88b7fa5d3 tempest-QuotasAdminNegativeTest-1354435892 tempest-QuotasAdminNegativeTest-1354435892-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:49.396309 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e6d890e-6d48-43f1-93d5-302a2c7ed36c req-e2d22751-57e4-491d-a6b2-30c88b7fa5d3 tempest-QuotasAdminNegativeTest-1354435892 tempest-QuotasAdminNegativeTest-1354435892-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3993523 Dec 09 21:18:49.408990 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ea17d01-c4fb-40ae-9678-18fd147b8385 req-b6891d86-6af4-48a6-9237-637411f1084c tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:49.410434 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ea17d01-c4fb-40ae-9678-18fd147b8385 req-b6891d86-6af4-48a6-9237-637411f1084c tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.0811765 Dec 09 21:18:49.426632 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e6d890e-6d48-43f1-93d5-302a2c7ed36c req-d3cc16d0-ac17-4a25-97cf-4b825a4b2b1d tempest-QuotasAdminNegativeTest-1354435892 tempest-QuotasAdminNegativeTest-1354435892-project] 10.222.0.13 "GET /v2.0/quotas/784092c4d36a4f9ebac1dc4da55056f3 HTTP/1.1" status: 200 len: 375 time: 0.0153034 Dec 09 21:18:49.462574 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e6d890e-6d48-43f1-93d5-302a2c7ed36c req-fd6121d3-c231-42cb-9d10-c2f9903c27b8 tempest-QuotasAdminNegativeTest-1354435892 tempest-QuotasAdminNegativeTest-1354435892-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=784092c4d36a4f9ebac1dc4da55056f3&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0298271 Dec 09 21:18:49.485470 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ea17d01-c4fb-40ae-9678-18fd147b8385 req-da5c6398-3dcb-401d-874e-1476c01b5ed3 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0680141 Dec 09 21:18:49.591469 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-87b456d3-22a2-4689-8894-7b35226d1dc1 service neutron] 10.222.0.10 "GET /v2.0/ports/85dcf098-2530-45e6-aecc-ec3e2e8888a6/bindings/n-h1-713301-27 HTTP/1.1" status: 200 len: 385 time: 0.0710113 Dec 09 21:18:49.620785 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69bb074d-119a-4abc-82f8-3f6ed4502c3a req-7a275e0a-22ca-40fd-989c-2ee8a43cbae3 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:49.622237 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69bb074d-119a-4abc-82f8-3f6ed4502c3a req-7a275e0a-22ca-40fd-989c-2ee8a43cbae3 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 949 time: 0.0790832 Dec 09 21:18:49.647465 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67416aa0-4530-47d6-986f-adfbce75f75b req-bfe861db-7ed7-43a0-89bb-db9afa5a609e tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:49.648881 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67416aa0-4530-47d6-986f-adfbce75f75b req-bfe861db-7ed7-43a0-89bb-db9afa5a609e tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=3d45a57e-5f03-4541-88f7-1194f195f63e HTTP/1.1" status: 200 len: 946 time: 0.0699427 Dec 09 21:18:49.705108 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69bb074d-119a-4abc-82f8-3f6ed4502c3a req-e174a63f-d43a-400c-85b6-5c7f091bd8ab tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0741973 Dec 09 21:18:49.721672 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67416aa0-4530-47d6-986f-adfbce75f75b req-f7289f7c-1ff2-4de2-a08a-45610efd4ed6 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/security-groups?id=174c6f0d-c012-4077-858c-aa2b94e54d38&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0642796 Dec 09 21:18:49.797050 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-d179468e-d36e-4024-a2b5-b950a9a547d4 service neutron] For port 85dcf098-2530-45e6-aecc-ec3e2e8888a6, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=85dcf098-2530-45e6-aecc-ec3e2e8888a6,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:49.816926 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-d179468e-d36e-4024-a2b5-b950a9a547d4 service neutron] For port 85dcf098-2530-45e6-aecc-ec3e2e8888a6, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:18:49.829662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b110914b-b1b0-4257-b4c9-0203c3ceee52 req-17dddb08-e635-4302-9bf2-77944226239a tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:49.831685 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b110914b-b1b0-4257-b4c9-0203c3ceee52 req-17dddb08-e635-4302-9bf2-77944226239a tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 944 time: 0.0637052 Dec 09 21:18:49.854228 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-d179468e-d36e-4024-a2b5-b950a9a547d4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 85dcf098-2530-45e6-aecc-ec3e2e8888a6 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:18:49.867969 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-d179468e-d36e-4024-a2b5-b950a9a547d4 service neutron] For port 85dcf098-2530-45e6-aecc-ec3e2e8888a6, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=85dcf098-2530-45e6-aecc-ec3e2e8888a6,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:49.885078 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b110914b-b1b0-4257-b4c9-0203c3ceee52 req-a686d59d-9c36-4380-a723-f042bd1cde6d tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468118 Dec 09 21:18:49.892519 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-d179468e-d36e-4024-a2b5-b950a9a547d4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:49.935044 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:18:49.940680 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 204e6970-8ed3-4e91-9792-52401052a153 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:18:49.987119 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-d179468e-d36e-4024-a2b5-b950a9a547d4 service neutron] Transition to ACTIVE for port object 85dcf098-2530-45e6-aecc-ec3e2e8888a6 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:18:49.993737 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-d179468e-d36e-4024-a2b5-b950a9a547d4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:50.045986 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fee93b48-dc5e-493c-864b-0c938a686e39 req-2ac73c1f-9cca-4893-9b1c-d721e8dd879c tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:50.048088 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fee93b48-dc5e-493c-864b-0c938a686e39 req-2ac73c1f-9cca-4893-9b1c-d721e8dd879c tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 943 time: 0.0948167 Dec 09 21:18:50.064516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-d179468e-d36e-4024-a2b5-b950a9a547d4 service neutron] No DVR routers for this DVR port 85dcf098-2530-45e6-aecc-ec3e2e8888a6 on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:18:50.073222 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 204e6970-8ed3-4e91-9792-52401052a153 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:18:50.087711 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 204e6970-8ed3-4e91-9792-52401052a153 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:18:50.088229 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:50.106422 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d179468e-d36e-4024-a2b5-b950a9a547d4 service neutron] Pushing event updated for resources: {'Port': ['ID=85dcf098-2530-45e6-aecc-ec3e2e8888a6,revision_number=10']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:50.116083 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-d179468e-d36e-4024-a2b5-b950a9a547d4 service neutron] 10.222.0.10 "PUT /v2.0/ports/85dcf098-2530-45e6-aecc-ec3e2e8888a6/bindings/n-h1-713301-27/activate HTTP/1.1" status: 200 len: 370 time: 0.4992447 Dec 09 21:18:50.140886 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:50.146738 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fee93b48-dc5e-493c-864b-0c938a686e39 req-f085e3a4-cdb3-4c9c-975b-9cd400df899c tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0922158 Dec 09 21:18:50.157012 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-565c3028-e610-42be-9518-8e61d255bc8b req-f500d7b2-aaa1-41aa-aca2-f1aa7556cc86 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:50.158662 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-565c3028-e610-42be-9518-8e61d255bc8b req-f500d7b2-aaa1-41aa-aca2-f1aa7556cc86 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=a40f9b82-e796-4cd4-b12e-cd2089ff7c19 HTTP/1.1" status: 200 len: 949 time: 0.0877001 Dec 09 21:18:50.159962 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 has no active binding in host n-h2-713301-27 {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:158}} Dec 09 21:18:50.212711 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:50.249298 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 204e6970-8ed3-4e91-9792-52401052a153, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=204e6970-8ed3-4e91-9792-52401052a153,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:50.258413 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:50.270031 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-565c3028-e610-42be-9518-8e61d255bc8b req-0fbaf47b-3ceb-4ddf-b9bf-9fcecf882a7c tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0879731 Dec 09 21:18:50.291847 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-872ec117-142c-439b-803c-53c8bb592015 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:50.293527 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-872ec117-142c-439b-803c-53c8bb592015 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981&tenant_id=a306d2242b1e41c892f63c7b122cdee4&binding%3Ahost_id=n-h2-713301-27 HTTP/1.1" status: 200 len: 1096 time: 0.0899460 Dec 09 21:18:50.331739 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=204e6970-8ed3-4e91-9792-52401052a153,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:50.394588 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-c79941bd-d9f5-4a6b-b3d9-6dc6d0143a2d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:50.396125 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-c79941bd-d9f5-4a6b-b3d9-6dc6d0143a2d service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981&tenant_id=a306d2242b1e41c892f63c7b122cdee4 HTTP/1.1" status: 200 len: 1096 time: 0.0899971 Dec 09 21:18:50.466552 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-bc7cfb4c-7931-4371-9609-48ba22977a77 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:50.468109 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-bc7cfb4c-7931-4371-9609-48ba22977a77 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 1096 time: 0.0444481 Dec 09 21:18:50.506926 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a40f9b82-e796-4cd4-b12e-cd2089ff7c19', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0dc8dc0a-1841-4d79-82ba-8d7ab787a13a'}, {'server_uuid': 'e6fbd1df-a53f-4f75-810f-f90ea3677ac8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '204e6970-8ed3-4e91-9792-52401052a153'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:50.509453 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c5054d00-2a2d-4cf5-b120-cc515851de5f" -d '{"events": [{"server_uuid": "a40f9b82-e796-4cd4-b12e-cd2089ff7c19", "name": "network-vif-plugged", "status": "completed", "tag": "0dc8dc0a-1841-4d79-82ba-8d7ab787a13a"}, {"server_uuid": "e6fbd1df-a53f-4f75-810f-f90ea3677ac8", "name": "network-vif-plugged", "status": "completed", "tag": "204e6970-8ed3-4e91-9792-52401052a153"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:50.519507 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3fe2ee3b-224e-4efb-b37e-7006abed6c5b req-b3c9d925-f1f0-4f7e-9ef6-8d54435aa095 tempest-QuotasAdminNegativeTest-1354435892 tempest-QuotasAdminNegativeTest-1354435892-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=784092c4d36a4f9ebac1dc4da55056f3&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0243464 Dec 09 21:18:50.665583 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b38ae14e-0d1a-4dd1-8cd4-d402d8d82a41 req-d06d13bf-bd47-4e65-8a51-7abf4eb5abbd tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:50.667136 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b38ae14e-0d1a-4dd1-8cd4-d402d8d82a41 req-d06d13bf-bd47-4e65-8a51-7abf4eb5abbd tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.0996044 Dec 09 21:18:50.683167 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fe2ee3b-224e-4efb-b37e-7006abed6c5b req-9188b9de-7eaa-4aeb-ba45-95e86d11357b tempest-QuotasAdminNegativeTest-1354435892 tempest-QuotasAdminNegativeTest-1354435892-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:50.684546 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3fe2ee3b-224e-4efb-b37e-7006abed6c5b req-9188b9de-7eaa-4aeb-ba45-95e86d11357b tempest-QuotasAdminNegativeTest-1354435892 tempest-QuotasAdminNegativeTest-1354435892-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1589677 Dec 09 21:18:50.713080 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3fe2ee3b-224e-4efb-b37e-7006abed6c5b req-f3628601-5e58-4329-a656-8c79c0964889 tempest-QuotasAdminNegativeTest-1354435892 tempest-QuotasAdminNegativeTest-1354435892-project] 10.222.0.13 "GET /v2.0/quotas/784092c4d36a4f9ebac1dc4da55056f3 HTTP/1.1" status: 200 len: 375 time: 0.0215068 Dec 09 21:18:50.757368 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3fe2ee3b-224e-4efb-b37e-7006abed6c5b req-e6e7ce86-a5b8-4618-9ce6-88eb59dfea53 tempest-QuotasAdminNegativeTest-1354435892 tempest-QuotasAdminNegativeTest-1354435892-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=784092c4d36a4f9ebac1dc4da55056f3&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0385220 Dec 09 21:18:50.762044 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b38ae14e-0d1a-4dd1-8cd4-d402d8d82a41 req-5af1f8f9-c452-4f82-b6bf-895ef9b5431d tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0878711 Dec 09 21:18:50.766399 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-e0a3b7b1-de1c-42ea-8d65-8a8ec2c46ecf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:50.767919 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-e0a3b7b1-de1c-42ea-8d65-8a8ec2c46ecf service neutron] 10.222.0.31 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 922 time: 0.2910662 Dec 09 21:18:50.813142 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3eacd532-34a7-474a-ac72-23a3a219fc97 x-openstack-request-id: req-3eacd532-34a7-474a-ac72-23a3a219fc97 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:50.814057 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a40f9b82-e796-4cd4-b12e-cd2089ff7c19", "name": "network-vif-plugged", "status": "completed", "tag": "0dc8dc0a-1841-4d79-82ba-8d7ab787a13a", "code": 200}, {"server_uuid": "e6fbd1df-a53f-4f75-810f-f90ea3677ac8", "name": "network-vif-plugged", "status": "completed", "tag": "204e6970-8ed3-4e91-9792-52401052a153", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:50.814464 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-3eacd532-34a7-474a-ac72-23a3a219fc97 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:50.815184 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a40f9b82-e796-4cd4-b12e-cd2089ff7c19', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0dc8dc0a-1841-4d79-82ba-8d7ab787a13a', 'code': 200} Dec 09 21:18:50.815734 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e6fbd1df-a53f-4f75-810f-f90ea3677ac8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '204e6970-8ed3-4e91-9792-52401052a153', 'code': 200} Dec 09 21:18:50.827791 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-91314ba6-d9b7-4328-a5df-2a8e98ef59d0 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=85dcf098-2530-45e6-aecc-ec3e2e8888a6 HTTP/1.1" status: 200 len: 217 time: 0.0506208 Dec 09 21:18:50.890986 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-b565d6e5-4d36-4c15-947f-57f474e3f926 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:50.893218 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-b565d6e5-4d36-4c15-947f-57f474e3f926 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=c49a62cc-af1b-4958-a4a9-eb44188b8fb9 HTTP/1.1" status: 200 len: 861 time: 0.0561728 Dec 09 21:18:50.956894 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c61638f-1ba3-4d9d-9640-918d230d7837 req-6e9d7799-6e33-4ada-a192-e464469c0318 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:50.958517 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c61638f-1ba3-4d9d-9640-918d230d7837 req-6e9d7799-6e33-4ada-a192-e464469c0318 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 950 time: 0.0830815 Dec 09 21:18:50.971634 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4812b1-4571-4d1a-9f59-de5f09402d1d req-02e723d9-0b44-43a1-a90a-bdf3580aca26 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:50.973396 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4812b1-4571-4d1a-9f59-de5f09402d1d req-02e723d9-0b44-43a1-a90a-bdf3580aca26 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=3d45a57e-5f03-4541-88f7-1194f195f63e HTTP/1.1" status: 200 len: 946 time: 0.0693586 Dec 09 21:18:50.975058 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-79d000fb-1b8d-4b27-8f0c-9a230d766e77 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=93378dc3-2ac5-4cf7-9ce3-d812934de40c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0550158 Dec 09 21:18:50.997721 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ef66363-fa60-4f2d-b4c2-78941c7676c4 req-5c37750d-28c0-4da2-a629-f4abc2ec1139 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:50.999506 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5ef66363-fa60-4f2d-b4c2-78941c7676c4 req-5c37750d-28c0-4da2-a629-f4abc2ec1139 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 1102 time: 0.1049957 Dec 09 21:18:51.023826 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93cee140-1993-47fe-928b-a21418f777c5 req-b99cb96b-e357-472c-b47f-4479aea54fc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:51.025276 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-93cee140-1993-47fe-928b-a21418f777c5 req-b99cb96b-e357-472c-b47f-4479aea54fc4 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=a40f9b82-e796-4cd4-b12e-cd2089ff7c19 HTTP/1.1" status: 200 len: 1101 time: 0.1064255 Dec 09 21:18:51.044708 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c61638f-1ba3-4d9d-9640-918d230d7837 req-649d1bfa-74a3-4530-902a-5ce3a0adeb64 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0706151 Dec 09 21:18:51.049775 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4812b1-4571-4d1a-9f59-de5f09402d1d req-ffb335af-ed3e-44b7-9d91-e2f4490bf0ab tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/security-groups?id=174c6f0d-c012-4077-858c-aa2b94e54d38&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0690053 Dec 09 21:18:51.145062 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-2cb2b7c3-16f1-41b8-bab7-25461526491e service neutron] 10.222.0.31 "GET /v2.0/ports/ecb95cc0-98d6-4980-b73e-2bc2c2df48f3/bindings/n-h2-713301-27 HTTP/1.1" status: 200 len: 385 time: 0.0777361 Dec 09 21:18:51.145932 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5ef66363-fa60-4f2d-b4c2-78941c7676c4 req-2c42f773-35c4-4bb2-8c4a-a69a96cbbcfa service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1337109 Dec 09 21:18:51.169837 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-aff96b99-1db2-4bc1-b6dd-bb2e314f514b service neutron] 10.222.0.31 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1836951 Dec 09 21:18:51.176819 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-93cee140-1993-47fe-928b-a21418f777c5 req-8c3868a1-099d-496d-a533-13f0fd85bc73 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1086547 Dec 09 21:18:51.239926 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7458af68-fcf4-48d7-ab6d-481e37f3d6f3 req-2218764e-7574-46af-bf77-79993b73c1e6 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:51.241934 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7458af68-fcf4-48d7-ab6d-481e37f3d6f3 req-2218764e-7574-46af-bf77-79993b73c1e6 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 944 time: 0.0913033 Dec 09 21:18:51.284335 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-1dd3d4e5-3f38-40bf-8b30-f9dc6103a48c service neutron] 10.222.0.31 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1049814 Dec 09 21:18:51.401372 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7458af68-fcf4-48d7-ab6d-481e37f3d6f3 req-c22827ae-b3d1-4798-b369-7777b91e4d03 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1499987 Dec 09 21:18:51.453722 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-ede9a14a-71f1-4250-bb09-634de78881ab tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:51.455190 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-ede9a14a-71f1-4250-bb09-634de78881ab tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=17188b52-f615-49ca-8709-a3c9238c02fa&device_owner=compute%3Anova HTTP/1.1" status: 200 len: 945 time: 0.1634629 Dec 09 21:18:51.538112 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-2b7dcf85-d196-485c-8a12-6840f2913a29 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.216 HTTP/1.1" status: 200 len: 696 time: 0.0764210 Dec 09 21:18:51.556705 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-f9405a90-1d6e-497b-a159-185c9312f544 service neutron] For port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:51.561316 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-bdc8398a-6d82-49e2-b1b4-47279136e2fc tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Request body: {'floatingip': {'port_id': 'b615e863-071a-473e-8d66-8f84f78d1453', 'fixed_ip_address': '172.20.0.4'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:51.616415 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-bdc8398a-6d82-49e2-b1b4-47279136e2fc tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks [] for floatingip, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:51.651089 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-f9405a90-1d6e-497b-a159-185c9312f544 service neutron] For port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:18:51.663194 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-572e49db-a85b-4f14-b196-1f15b0ec72e7 req-09ec197e-54f0-44d2-9519-4c51e3363d02 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:51.664690 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-572e49db-a85b-4f14-b196-1f15b0ec72e7 req-09ec197e-54f0-44d2-9519-4c51e3363d02 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 944 time: 0.1955254 Dec 09 21:18:51.665043 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-e52fa78e-8a87-48bc-8017-7c23e2d2df9e tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:51.666548 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-e52fa78e-8a87-48bc-8017-7c23e2d2df9e tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981&tenant_id=a306d2242b1e41c892f63c7b122cdee4&binding%3Ahost_id=n-h1-713301-27 HTTP/1.1" status: 200 len: 1096 time: 0.0485830 Dec 09 21:18:51.774710 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-f9405a90-1d6e-497b-a159-185c9312f544 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:18:51.782247 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-aebb7b3f-67c9-4e6e-b7a3-68e772c13eab service neutron] For port 85dcf098-2530-45e6-aecc-ec3e2e8888a6, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:18:51.785895 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-aebb7b3f-67c9-4e6e-b7a3-68e772c13eab service neutron] Publish callbacks [] for binding, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:51.786968 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c68541ea-3397-49e3-b7f7-0629d70322ac req-aebb7b3f-67c9-4e6e-b7a3-68e772c13eab service neutron] 10.222.0.31 "DELETE /v2.0/ports/85dcf098-2530-45e6-aecc-ec3e2e8888a6/bindings/n-h2-713301-27 HTTP/1.1" status: 204 len: 173 time: 0.1119728 Dec 09 21:18:51.802809 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-f9405a90-1d6e-497b-a159-185c9312f544 service neutron] For port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:18:51.819636 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-572e49db-a85b-4f14-b196-1f15b0ec72e7 req-e10bc50f-0155-488b-8f18-4614ba30ac49 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1154459 Dec 09 21:18:51.832573 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-f9405a90-1d6e-497b-a159-185c9312f544 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:52.061490 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-f9405a90-1d6e-497b-a159-185c9312f544 service neutron] Transition to ACTIVE for port object ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:18:52.102016 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-f9405a90-1d6e-497b-a159-185c9312f544 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:52.114602 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56716) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:52.161229 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4824f2a-76a5-4f36-a5a0-dc2fe2f9652d req-2714ab1b-21fa-4ad3-b1f1-c7bfbca95ce0 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:52.162859 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4824f2a-76a5-4f36-a5a0-dc2fe2f9652d req-2714ab1b-21fa-4ad3-b1f1-c7bfbca95ce0 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=a40f9b82-e796-4cd4-b12e-cd2089ff7c19 HTTP/1.1" status: 200 len: 949 time: 0.1982031 Dec 09 21:18:52.227279 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-126a26c5-98ff-422c-b5bf-f1e5956a9b03 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:52.245704 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-f9405a90-1d6e-497b-a159-185c9312f544 service neutron] No DVR routers for this DVR port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:18:52.270075 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9405a90-1d6e-497b-a159-185c9312f544 service neutron] Pushing event updated for resources: {'Port': ['ID=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3,revision_number=10']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:52.317447 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-f9405a90-1d6e-497b-a159-185c9312f544 service neutron] 10.222.0.31 "PUT /v2.0/ports/ecb95cc0-98d6-4980-b73e-2bc2c2df48f3/bindings/n-h2-713301-27/activate HTTP/1.1" status: 200 len: 370 time: 1.1578941 Dec 09 21:18:52.322957 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-126a26c5-98ff-422c-b5bf-f1e5956a9b03 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:52.327736 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-126a26c5-98ff-422c-b5bf-f1e5956a9b03 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:52.360148 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4824f2a-76a5-4f36-a5a0-dc2fe2f9652d req-91344620-5df9-471c-907f-9a25b83dc2fe tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1796503 Dec 09 21:18:52.374187 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-126a26c5-98ff-422c-b5bf-f1e5956a9b03 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=00d46950-3478-486d-9f7a-2531f6e1c8be,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:52.381026 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-126a26c5-98ff-422c-b5bf-f1e5956a9b03 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=784092c4d36a4f9ebac1dc4da55056f3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2652500 Dec 09 21:18:52.390334 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56720) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:52.453678 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.db.resource_extend [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-bdc8398a-6d82-49e2-b1b4-47279136e2fc tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 09 21:18:52.498843 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-64e6d665-d73c-40b3-b0a4-21e2ef74d9f1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:52.525552 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-51f35972-8bc0-4f83-999e-e77a4f6cb1b9 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:52.527186 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-51f35972-8bc0-4f83-999e-e77a4f6cb1b9 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.10 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2&tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&binding%3Ahost_id=n-h1-713301-27 HTTP/1.1" status: 200 len: 1097 time: 0.0735259 Dec 09 21:18:52.529412 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-64e6d665-d73c-40b3-b0a4-21e2ef74d9f1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:52.542254 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-bdc8398a-6d82-49e2-b1b4-47279136e2fc tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:52.547188 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-bdc8398a-6d82-49e2-b1b4-47279136e2fc tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:52.558475 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f72e7104-0a2d-4caa-a782-e5e343dd20ca req-fb4ed791-6e3a-40e7-9139-6e659675024a tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:52.559970 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f72e7104-0a2d-4caa-a782-e5e343dd20ca req-fb4ed791-6e3a-40e7-9139-6e659675024a tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.0714765 Dec 09 21:18:52.593793 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-11a24593-c1db-4358-ad26-94a07eb79b6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:52.595298 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-11a24593-c1db-4358-ad26-94a07eb79b6e service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2&tenant_id=ac5b7cefd8cc48cc83f38d3923aae132 HTTP/1.1" status: 200 len: 1097 time: 0.0595987 Dec 09 21:18:52.606738 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-64e6d665-d73c-40b3-b0a4-21e2ef74d9f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:52.609372 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-64e6d665-d73c-40b3-b0a4-21e2ef74d9f1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:52.612979 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-64e6d665-d73c-40b3-b0a4-21e2ef74d9f1 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/00d46950-3478-486d-9f7a-2531f6e1c8be HTTP/1.1" status: 204 len: 168 time: 0.2136705 Dec 09 21:18:52.638267 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64e6d665-d73c-40b3-b0a4-21e2ef74d9f1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=00d46950-3478-486d-9f7a-2531f6e1c8be,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:52.691621 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f72e7104-0a2d-4caa-a782-e5e343dd20ca req-5de2e2f1-7a7a-45f2-9d2c-44896505f3d4 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0940568 Dec 09 21:18:52.693341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-c3da2787-24a6-4d0b-93c3-f0fcea3fce7d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:52.694940 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-c3da2787-24a6-4d0b-93c3-f0fcea3fce7d service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 1097 time: 0.0645056 Dec 09 21:18:52.704064 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-bdc8398a-6d82-49e2-b1b4-47279136e2fc tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Floating IP 3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5 associated. External IP: 172.25.3.216, port: b615e863-071a-473e-8d66-8f84f78d1453. Dec 09 21:18:52.827777 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-f0719d00-90cd-4561-93b0-2ce7d5ab2dc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:52.830547 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-f0719d00-90cd-4561-93b0-2ce7d5ab2dc4 service neutron] 10.222.0.10 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 908 time: 0.1206110 Dec 09 21:18:52.908388 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-8e618819-8808-46fe-8245-8d5e9d70677c service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 HTTP/1.1" status: 200 len: 217 time: 0.0625081 Dec 09 21:18:52.924734 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e275b909-5491-45a9-8b93-3412620714ba req-0f4cf2c1-49e3-49ed-806e-dd6d1920fe97 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:52.932191 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e275b909-5491-45a9-8b93-3412620714ba req-0f4cf2c1-49e3-49ed-806e-dd6d1920fe97 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 950 time: 0.1172636 Dec 09 21:18:52.954422 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56734) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:52.967222 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-2c64be06-5890-4561-85e8-6f31450f985c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:52.968917 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-2c64be06-5890-4561-85e8-6f31450f985c service neutron] 10.222.0.10 "GET /v2.0/subnets?id=eae2438b-9fcc-44ef-a172-6c4911cad13f HTTP/1.1" status: 200 len: 847 time: 0.0518014 Dec 09 21:18:52.983871 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0f1b183-549b-4929-b3d8-0ccba2f8a005 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:53.000790 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-4db39552-92a7-4db3-9dc1-00aa3c08119c service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=04fa749a-9f72-4a2c-a725-feab917f99ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0242555 Dec 09 21:18:53.052425 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e275b909-5491-45a9-8b93-3412620714ba req-f9ec5c4c-eb80-4dcd-b990-12b9bbd2b135 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1195221 Dec 09 21:18:53.091780 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-bdc8398a-6d82-49e2-b1b4-47279136e2fc tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Router 70ade903-ee3e-4040-8855-b2a937f2a0d9 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:18:53.101406 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-b1c1af17-e2e1-4b72-8a1f-6c1e9e22fb3b service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0910399 Dec 09 21:18:53.176388 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0f1b183-549b-4929-b3d8-0ccba2f8a005 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:53.194517 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-cab50c25-e990-4218-a6d4-dd287c6995e1 service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0837224 Dec 09 21:18:53.196550 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0f1b183-549b-4929-b3d8-0ccba2f8a005 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:53.483737 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-d4eade7d-151b-4b1c-923f-832b262e4b1f tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:53.485905 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-d4eade7d-151b-4b1c-923f-832b262e4b1f tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.10 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2&tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&binding%3Ahost_id=n-h2-713301-27 HTTP/1.1" status: 200 len: 1097 time: 0.0492241 Dec 09 21:18:53.538720 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f0f1b183-549b-4929-b3d8-0ccba2f8a005 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=b34c29a96d6d445aa8dfd7c437b42de8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5813963 Dec 09 21:18:53.542479 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56738) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:18:53.551291 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0f1b183-549b-4929-b3d8-0ccba2f8a005 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c1e83ceb-54cc-4c1f-9d22-f3097d2f6239,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:53.557153 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-bdc8398a-6d82-49e2-b1b4-47279136e2fc tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:18:53.565961 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edd9565e-084a-4df5-8bc2-479374326a84 req-1fb588d2-5d9e-40a9-a6cc-ef1c5b161177 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:53.567505 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-edd9565e-084a-4df5-8bc2-479374326a84 req-1fb588d2-5d9e-40a9-a6cc-ef1c5b161177 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 945 time: 0.4155760 Dec 09 21:18:53.570870 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ad8b634-25ad-44e4-9d59-f982b2c859f9 None None] Sync routers for ids ['70ade903-ee3e-4040-8855-b2a937f2a0d9'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:18:53.581993 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-bdc8398a-6d82-49e2-b1b4-47279136e2fc tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:53.588693 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ad8b634-25ad-44e4-9d59-f982b2c859f9 None None] Routers {'70ade903-ee3e-4040-8855-b2a937f2a0d9'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:18:53.589666 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-1ad8b634-25ad-44e4-9d59-f982b2c859f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:18:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['70ade903-ee3e-4040-8855-b2a937f2a0d9'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:18:53.621683 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-bdc8398a-6d82-49e2-b1b4-47279136e2fc tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "PUT /v2.0/floatingips/3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5 HTTP/1.1" status: 200 len: 996 time: 2.0689962 Dec 09 21:18:53.623209 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '17188b52-f615-49ca-8709-a3c9238c02fa', 'tag': 'b615e863-071a-473e-8d66-8f84f78d1453'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:53.624501 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9e3edb5-f1d2-44f4-957a-c0c00845c31d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:53.625883 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-20d12715-21f1-4d93-a895-daba18c76bf4" -d '{"events": [{"name": "network-changed", "server_uuid": "17188b52-f615-49ca-8709-a3c9238c02fa", "tag": "b615e863-071a-473e-8d66-8f84f78d1453"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:53.661927 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9e3edb5-f1d2-44f4-957a-c0c00845c31d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:53.687321 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-c0f47115-a1ee-4298-8732-deee889b88d9 service neutron] For port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:18:53.692665 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-edd9565e-084a-4df5-8bc2-479374326a84 req-625b2051-722a-4814-939b-97214f508768 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0982108 Dec 09 21:18:53.695907 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-c0f47115-a1ee-4298-8732-deee889b88d9 service neutron] Publish callbacks [] for binding, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:53.697033 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-21dd5fc4-3a7d-4eb8-a817-fcd90d43998c req-c0f47115-a1ee-4298-8732-deee889b88d9 service neutron] 10.222.0.10 "DELETE /v2.0/ports/ecb95cc0-98d6-4980-b73e-2bc2c2df48f3/bindings/n-h1-713301-27 HTTP/1.1" status: 204 len: 173 time: 0.2017851 Dec 09 21:18:53.728565 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-37674b8a-7192-4b79-9619-4a99e2e54c5b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:53.730381 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-37674b8a-7192-4b79-9619-4a99e2e54c5b service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=920e0419877f4239b048e126682274e9&device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 1097 time: 0.0687335 Dec 09 21:18:53.742091 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9e3edb5-f1d2-44f4-957a-c0c00845c31d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:53.745038 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9e3edb5-f1d2-44f4-957a-c0c00845c31d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:53.746191 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e9e3edb5-f1d2-44f4-957a-c0c00845c31d admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/c1e83ceb-54cc-4c1f-9d22-f3097d2f6239 HTTP/1.1" status: 204 len: 168 time: 0.2027521 Dec 09 21:18:53.753959 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-1ad8b634-25ad-44e4-9d59-f982b2c859f9 None None] Set router 70ade903-ee3e-4040-8855-b2a937f2a0d9 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:18:53.756442 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9e3edb5-f1d2-44f4-957a-c0c00845c31d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c1e83ceb-54cc-4c1f-9d22-f3097d2f6239,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:53.900286 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b042ec7-e579-4602-98a8-dfe1ac396db9 req-9f768612-36f9-4de1-9c0f-615fcb261ba2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:53.907888 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b042ec7-e579-4602-98a8-dfe1ac396db9 req-9f768612-36f9-4de1-9c0f-615fcb261ba2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 944 time: 0.1205232 Dec 09 21:18:53.930786 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-a88401a6-3095-4d6a-924a-cc605f702f43 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:53.932387 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-a88401a6-3095-4d6a-924a-cc605f702f43 service neutron] 10.222.0.13 "GET /v2.0/networks?id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 HTTP/1.1" status: 200 len: 922 time: 0.1936798 Dec 09 21:18:53.969992 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 85dcf098-2530-45e6-aecc-ec3e2e8888a6 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:18:54.013916 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 85dcf098-2530-45e6-aecc-ec3e2e8888a6 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:18:54.016599 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-1ad8b634-25ad-44e4-9d59-f982b2c859f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:18:03Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5', 'tenant_id': '920e0419877f4239b048e126682274e9', 'floating_ip_address': '172.25.3.216', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'port_id': 'b615e863-071a-473e-8d66-8f84f78d1453', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 376, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'mac_address': 'fa:16:3e:d2:df:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '17188b52-f615-49ca-8709-a3c9238c02fa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:18:31Z', 'updated_at': '2021-12-09T21:18:52Z', 'revision_number': 1, 'project_id': '920e0419877f4239b048e126682274e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '72070289-8347-44bd-bfb9-9510e94eb5bd', 'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'tenant_id': '920e0419877f4239b048e126682274e9', 'mac_address': 'fa:16:3e:c3:24:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 264, 'fixed_ips': [{'subnet_id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:18:00Z', 'updated_at': '2021-12-09T21:18:09Z', 'revision_number': 5, 'project_id': '920e0419877f4239b048e126682274e9', 'subnets': [{'id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:18:54.024178 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b042ec7-e579-4602-98a8-dfe1ac396db9 req-26a155e7-ca4c-4938-9c2d-c5253a00f20b tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1152229 Dec 09 21:18:54.045698 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ad8b634-25ad-44e4-9d59-f982b2c859f9 None None] Checking router: 70ade903-ee3e-4040-8855-b2a937f2a0d9 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:18:54.057027 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ad8b634-25ad-44e4-9d59-f982b2c859f9 None None] Routers {'70ade903-ee3e-4040-8855-b2a937f2a0d9'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:18:54.058065 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-1ad8b634-25ad-44e4-9d59-f982b2c859f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:18:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['70ade903-ee3e-4040-8855-b2a937f2a0d9'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:18:54.092756 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-81f1f9b9-d734-43dd-b907-66284e71925d service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b615e863-071a-473e-8d66-8f84f78d1453 HTTP/1.1" status: 200 len: 999 time: 0.1428981 Dec 09 21:18:54.148452 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-91284950-a288-4bd1-9385-dc9e73fcccf7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:54.156235 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-91284950-a288-4bd1-9385-dc9e73fcccf7 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=3260fc19-8e10-46a2-82c6-3b2d5eda4a0e HTTP/1.1" status: 200 len: 860 time: 0.0625746 Dec 09 21:18:54.208820 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-4733a0c0-156e-446c-b596-9e89fb20daed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:54.213074 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-4733a0c0-156e-446c-b596-9e89fb20daed service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0558817 Dec 09 21:18:54.234121 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-1ad8b634-25ad-44e4-9d59-f982b2c859f9 None None] Set router 70ade903-ee3e-4040-8855-b2a937f2a0d9 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:18:54.236793 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-cf456e0d-afe8-4a90-950a-25c5a02cdbc3 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:18:54.237775 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-cf456e0d-afe8-4a90-950a-25c5a02cdbc3 service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0072150 Dec 09 21:18:54.300780 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af4ed7de-bf4b-4344-8001-8ce36e4ebbc0 req-f4008221-3b09-4b46-b432-996f31429bfe tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:54.302314 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af4ed7de-bf4b-4344-8001-8ce36e4ebbc0 req-f4008221-3b09-4b46-b432-996f31429bfe tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=a40f9b82-e796-4cd4-b12e-cd2089ff7c19 HTTP/1.1" status: 200 len: 949 time: 0.1084375 Dec 09 21:18:54.395668 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-c63e0672-f6e0-409b-a13e-9c11f1cb1acc service neutron] 10.222.0.13 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1509249 Dec 09 21:18:54.399138 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af4ed7de-bf4b-4344-8001-8ce36e4ebbc0 req-65409454-15b4-41fb-9fc6-c5d34477039f tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0679686 Dec 09 21:18:54.485550 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-50486953-b330-44d0-a7a7-526189f5e0e8 x-openstack-request-id: req-50486953-b330-44d0-a7a7-526189f5e0e8 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:54.485898 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "17188b52-f615-49ca-8709-a3c9238c02fa", "tag": "b615e863-071a-473e-8d66-8f84f78d1453", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:54.486356 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-50486953-b330-44d0-a7a7-526189f5e0e8 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:54.488125 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '17188b52-f615-49ca-8709-a3c9238c02fa', 'tag': 'b615e863-071a-473e-8d66-8f84f78d1453', 'status': 'completed', 'code': 200} Dec 09 21:18:54.513446 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-1ad8b634-25ad-44e4-9d59-f982b2c859f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:18:03Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5', 'tenant_id': '920e0419877f4239b048e126682274e9', 'floating_ip_address': '172.25.3.216', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'port_id': 'b615e863-071a-473e-8d66-8f84f78d1453', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 376, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'mac_address': 'fa:16:3e:d2:df:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '17188b52-f615-49ca-8709-a3c9238c02fa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:18:31Z', 'updated_at': '2021-12-09T21:18:52Z', 'revision_number': 1, 'project_id': '920e0419877f4239b048e126682274e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '72070289-8347-44bd-bfb9-9510e94eb5bd', 'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'tenant_id': '920e0419877f4239b048e126682274e9', 'mac_address': 'fa:16:3e:c3:24:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 264, 'fixed_ips': [{'subnet_id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:18:00Z', 'updated_at': '2021-12-09T21:18:09Z', 'revision_number': 5, 'project_id': '920e0419877f4239b048e126682274e9', 'subnets': [{'id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:18:54.547832 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ad8b634-25ad-44e4-9d59-f982b2c859f9 None None] The sync data for ids ['70ade903-ee3e-4040-8855-b2a937f2a0d9'] in n-d-713301-27 is: [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:18:03Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5', 'tenant_id': '920e0419877f4239b048e126682274e9', 'floating_ip_address': '172.25.3.216', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'port_id': 'b615e863-071a-473e-8d66-8f84f78d1453', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 376, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'mac_address': 'fa:16:3e:d2:df:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '17188b52-f615-49ca-8709-a3c9238c02fa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:18:31Z', 'updated_at': '2021-12-09T21:18:52Z', 'revision_number': 1, 'project_id': '920e0419877f4239b048e126682274e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '72070289-8347-44bd-bfb9-9510e94eb5bd', 'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'tenant_id': '920e0419877f4239b048e126682274e9', 'mac_address': 'fa:16:3e:c3:24:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 264, 'fixed_ips': [{'subnet_id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:18:00Z', 'updated_at': '2021-12-09T21:18:09Z', 'revision_number': 5, 'project_id': '920e0419877f4239b048e126682274e9', 'subnets': [{'id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:18:54.576495 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbf1602e-d4e6-48d9-b020-1a345d1c17de req-95ef7b94-a498-4011-9e89-dddbdf5d9d39 service neutron] 10.222.0.13 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1735165 Dec 09 21:18:54.594340 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20d12715-21f1-4d93-a895-daba18c76bf4 req-379433ff-f7a3-4aa7-8bab-d81b56076d15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:54.595923 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20d12715-21f1-4d93-a895-daba18c76bf4 req-379433ff-f7a3-4aa7-8bab-d81b56076d15 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=920e0419877f4239b048e126682274e9&device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 1097 time: 0.0976102 Dec 09 21:18:54.622888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a161f979-432a-43c9-ab5a-5e10bd5b05d6 req-b9978456-230a-42c6-bbd8-0cbb2ab57003 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:54.625417 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a161f979-432a-43c9-ab5a-5e10bd5b05d6 req-b9978456-230a-42c6-bbd8-0cbb2ab57003 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.0902340 Dec 09 21:18:54.697829 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a161f979-432a-43c9-ab5a-5e10bd5b05d6 req-0cbcb7be-4eb6-4a79-b0ab-02c3761e721b tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0578136 Dec 09 21:18:54.775209 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20d12715-21f1-4d93-a895-daba18c76bf4 req-b0db6c48-b5a1-40b3-b700-13bb91c6368b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:54.776714 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20d12715-21f1-4d93-a895-daba18c76bf4 req-b0db6c48-b5a1-40b3-b700-13bb91c6368b service neutron] 10.222.0.31 "GET /v2.0/networks?id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 HTTP/1.1" status: 200 len: 922 time: 0.1502621 Dec 09 21:18:54.870450 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ff735b1-858a-4810-a2e5-ec3a0d11ffdf None None] New status for floating IP 3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:18:54.904805 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61a73119-e9d7-4380-8dbc-3dbcdd70e990 req-02568980-1006-4c26-a624-75364b13977b tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:54.906453 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-61a73119-e9d7-4380-8dbc-3dbcdd70e990 req-02568980-1006-4c26-a624-75364b13977b tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 950 time: 0.1981037 Dec 09 21:18:54.913421 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20d12715-21f1-4d93-a895-daba18c76bf4 req-eddcc2d1-a47f-4be5-bdfc-bb5d1871449c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b615e863-071a-473e-8d66-8f84f78d1453 HTTP/1.1" status: 200 len: 999 time: 0.1027288 Dec 09 21:18:55.022172 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20d12715-21f1-4d93-a895-daba18c76bf4 req-ee6dc609-65e3-4da6-a2db-99917234e703 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:55.023840 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20d12715-21f1-4d93-a895-daba18c76bf4 req-ee6dc609-65e3-4da6-a2db-99917234e703 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=3260fc19-8e10-46a2-82c6-3b2d5eda4a0e HTTP/1.1" status: 200 len: 860 time: 0.0873728 Dec 09 21:18:55.027272 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-61a73119-e9d7-4380-8dbc-3dbcdd70e990 req-69d458a9-5f18-4a2a-998a-f65e627795bc tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1120539 Dec 09 21:18:55.084537 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-d5dbba6b-96c9-4b1a-a370-131dd82d11cb tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:55.086231 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-d5dbba6b-96c9-4b1a-a370-131dd82d11cb tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=3d45a57e-5f03-4541-88f7-1194f195f63e&device_owner=compute%3Anova HTTP/1.1" status: 200 len: 946 time: 0.1105556 Dec 09 21:18:55.099454 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20d12715-21f1-4d93-a895-daba18c76bf4 req-e446db88-3111-41d7-8b3a-bf5f6186f09a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:55.101073 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20d12715-21f1-4d93-a895-daba18c76bf4 req-e446db88-3111-41d7-8b3a-bf5f6186f09a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0688746 Dec 09 21:18:55.259411 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-4395a24c-6e92-477a-a786-ee6163f71634 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.216 HTTP/1.1" status: 200 len: 1001 time: 0.1532683 Dec 09 21:18:55.270898 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-7b576e9f-06e7-4181-b981-8f99fbe26783 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Request body: {'floatingip': {'port_id': 'd0cf802e-891b-41ee-8585-48a361e5265d', 'fixed_ip_address': '172.20.0.14'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:55.351270 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20d12715-21f1-4d93-a895-daba18c76bf4 req-5af4782b-803b-4dbe-a4ea-73a2bd50e285 service neutron] 10.222.0.31 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2354150 Dec 09 21:18:55.392566 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-7b576e9f-06e7-4181-b981-8f99fbe26783 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks [] for floatingip, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:55.438541 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-625decb1-0250-4a01-9286-27e0e2dab8f0 req-96507be4-2e65-4117-96e8-a3ae4b63e7cf tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:55.440367 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-625decb1-0250-4a01-9286-27e0e2dab8f0 req-96507be4-2e65-4117-96e8-a3ae4b63e7cf tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 1096 time: 0.1285112 Dec 09 21:18:55.578172 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20d12715-21f1-4d93-a895-daba18c76bf4 req-274977f8-0978-4d73-9c74-5efb9941767f service neutron] 10.222.0.31 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2185218 Dec 09 21:18:55.596677 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-625decb1-0250-4a01-9286-27e0e2dab8f0 req-f431367c-36d5-4ff1-a12a-00db3bdec0c6 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1255455 Dec 09 21:18:55.785676 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe0d95f8-a8ce-4805-9f5f-a8a730c0096c req-6c7aa8c8-eac4-4127-aee6-a8f83b769abb tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:55.787097 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe0d95f8-a8ce-4805-9f5f-a8a730c0096c req-6c7aa8c8-eac4-4127-aee6-a8f83b769abb tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 945 time: 0.0988214 Dec 09 21:18:55.884399 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe0d95f8-a8ce-4805-9f5f-a8a730c0096c req-3d707794-e613-47aa-ad87-1bd2d2711d30 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0890493 Dec 09 21:18:55.973745 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:18:56.014270 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:18:56.287747 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-7b576e9f-06e7-4181-b981-8f99fbe26783 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:56.293054 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-7b576e9f-06e7-4181-b981-8f99fbe26783 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:56.301821 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6989997-3fef-45e8-b8d7-3e9c26145ac6 req-3e34be8d-9d82-475b-beff-a995864a0d6d tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:56.303314 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d6989997-3fef-45e8-b8d7-3e9c26145ac6 req-3e34be8d-9d82-475b-beff-a995864a0d6d tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=a40f9b82-e796-4cd4-b12e-cd2089ff7c19 HTTP/1.1" status: 200 len: 949 time: 0.3383250 Dec 09 21:18:56.416839 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d6989997-3fef-45e8-b8d7-3e9c26145ac6 req-8ca1552c-e5a2-4246-b21f-4b6c35a1be13 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0806668 Dec 09 21:18:56.430362 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-7b576e9f-06e7-4181-b981-8f99fbe26783 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Floating IP 3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5 associated. External IP: 172.25.3.216, port: b615e863-071a-473e-8d66-8f84f78d1453. Dec 09 21:18:56.642879 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-7b576e9f-06e7-4181-b981-8f99fbe26783 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Router 70ade903-ee3e-4040-8855-b2a937f2a0d9 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:18:56.728163 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9e84c05-15a7-4133-878d-fed50e6bab75 req-92416a55-cd9b-47fb-9ef2-0a1fdf8eb584 tempest-MigrationsAdminTest-775845712 tempest-MigrationsAdminTest-775845712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:56.729687 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e9e84c05-15a7-4133-878d-fed50e6bab75 req-92416a55-cd9b-47fb-9ef2-0a1fdf8eb584 tempest-MigrationsAdminTest-775845712 tempest-MigrationsAdminTest-775845712-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 1102 time: 0.0831690 Dec 09 21:18:56.776153 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e9e84c05-15a7-4133-878d-fed50e6bab75 req-ace17191-6bf7-4f3a-9bb2-56d9504deb6c tempest-MigrationsAdminTest-775845712 tempest-MigrationsAdminTest-775845712-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:56.801712 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-7b576e9f-06e7-4181-b981-8f99fbe26783 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:18:56.812291 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc2c31d6-8abd-411d-878e-1e9c7dd71ff4 None None] Sync routers for ids ['70ade903-ee3e-4040-8855-b2a937f2a0d9'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:18:56.823618 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc2c31d6-8abd-411d-878e-1e9c7dd71ff4 None None] Routers {'70ade903-ee3e-4040-8855-b2a937f2a0d9'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:18:56.824223 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-dc2c31d6-8abd-411d-878e-1e9c7dd71ff4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:18:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['70ade903-ee3e-4040-8855-b2a937f2a0d9'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:18:56.901164 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:56.934033 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-dc2c31d6-8abd-411d-878e-1e9c7dd71ff4 None None] Set router 70ade903-ee3e-4040-8855-b2a937f2a0d9 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:18:56.947801 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e9e84c05-15a7-4133-878d-fed50e6bab75 req-ace17191-6bf7-4f3a-9bb2-56d9504deb6c tempest-MigrationsAdminTest-775845712 tempest-MigrationsAdminTest-775845712-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:56.983880 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e9e84c05-15a7-4133-878d-fed50e6bab75 req-ace17191-6bf7-4f3a-9bb2-56d9504deb6c tempest-MigrationsAdminTest-775845712 tempest-MigrationsAdminTest-775845712-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:57.024080 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:57.034012 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e9e84c05-15a7-4133-878d-fed50e6bab75 req-ace17191-6bf7-4f3a-9bb2-56d9504deb6c tempest-MigrationsAdminTest-775845712 tempest-MigrationsAdminTest-775845712-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2974763 Dec 09 21:18:57.036372 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ace17191-6bf7-4f3a-9bb2-56d9504deb6c tempest-MigrationsAdminTest-775845712 tempest-MigrationsAdminTest-775845712-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0e5166ed-8577-46e1-978d-4e8877505e53,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:18:57.092476 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-7b576e9f-06e7-4181-b981-8f99fbe26783 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Router 70ade903-ee3e-4040-8855-b2a937f2a0d9 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:18:57.183573 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-dc2c31d6-8abd-411d-878e-1e9c7dd71ff4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:18:03Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5', 'tenant_id': '920e0419877f4239b048e126682274e9', 'floating_ip_address': '172.25.3.216', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'port_id': 'd0cf802e-891b-41ee-8585-48a361e5265d', 'fixed_ip_address': '172.20.0.14', 'status': 'ACTIVE', 'standard_attr_id': 376, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'mac_address': 'fa:16:3e:b6:c6:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d45a57e-5f03-4541-88f7-1194f195f63e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:18:31Z', 'updated_at': '2021-12-09T21:18:55Z', 'revision_number': 3, 'project_id': '920e0419877f4239b048e126682274e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '72070289-8347-44bd-bfb9-9510e94eb5bd', 'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'tenant_id': '920e0419877f4239b048e126682274e9', 'mac_address': 'fa:16:3e:c3:24:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 264, 'fixed_ips': [{'subnet_id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:18:00Z', 'updated_at': '2021-12-09T21:18:09Z', 'revision_number': 5, 'project_id': '920e0419877f4239b048e126682274e9', 'subnets': [{'id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:18:57.202108 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-7b576e9f-06e7-4181-b981-8f99fbe26783 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:18:57.206552 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-7b576e9f-06e7-4181-b981-8f99fbe26783 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:57.213833 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc2c31d6-8abd-411d-878e-1e9c7dd71ff4 None None] Checking router: 70ade903-ee3e-4040-8855-b2a937f2a0d9 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:18:57.222916 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc2c31d6-8abd-411d-878e-1e9c7dd71ff4 None None] Routers {'70ade903-ee3e-4040-8855-b2a937f2a0d9'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:18:57.224043 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-dc2c31d6-8abd-411d-878e-1e9c7dd71ff4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:18:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['70ade903-ee3e-4040-8855-b2a937f2a0d9'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:18:57.234753 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '17188b52-f615-49ca-8709-a3c9238c02fa', 'tag': 'b615e863-071a-473e-8d66-8f84f78d1453'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:18:57.237205 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1f9ff492-3449-45e8-a6bd-f38d4f9ed929" -d '{"events": [{"name": "network-changed", "server_uuid": "17188b52-f615-49ca-8709-a3c9238c02fa", "tag": "b615e863-071a-473e-8d66-8f84f78d1453"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:18:57.281184 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-282bca67-023a-4b20-992a-04033178c87b req-e1d81240-ba26-4f6a-a304-a48153223fad tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=d035bde1be0e46a6977e6cc6f45495c7&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0471213 Dec 09 21:18:57.284762 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-7b576e9f-06e7-4181-b981-8f99fbe26783 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "PUT /v2.0/floatingips/3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5 HTTP/1.1" status: 200 len: 999 time: 2.0193186 Dec 09 21:18:57.391657 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-984a70ae-179e-47aa-8510-eb62617e4735 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:57.393060 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-984a70ae-179e-47aa-8510-eb62617e4735 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports/b615e863-071a-473e-8d66-8f84f78d1453 HTTP/1.1" status: 200 len: 942 time: 0.0966165 Dec 09 21:18:57.417225 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-dc2c31d6-8abd-411d-878e-1e9c7dd71ff4 None None] Set router 70ade903-ee3e-4040-8855-b2a937f2a0d9 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:18:57.434276 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-282bca67-023a-4b20-992a-04033178c87b req-dabf3704-3585-4114-809c-f7ba4204bd2c tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:57.435782 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-282bca67-023a-4b20-992a-04033178c87b req-dabf3704-3585-4114-809c-f7ba4204bd2c tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1483181 Dec 09 21:18:57.451674 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-282bca67-023a-4b20-992a-04033178c87b req-eac7f8e8-7193-4953-bcf9-4bfea48fad29 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/quotas/d035bde1be0e46a6977e6cc6f45495c7 HTTP/1.1" status: 200 len: 375 time: 0.0097294 Dec 09 21:18:57.499271 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-282bca67-023a-4b20-992a-04033178c87b req-bc9efb88-a44c-4dfd-b318-4efd8d6d12f5 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=d035bde1be0e46a6977e6cc6f45495c7&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0380363 Dec 09 21:18:57.514289 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-bc1b741a-d6be-4170-8066-915a77df1dfb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:57.515845 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-bc1b741a-d6be-4170-8066-915a77df1dfb service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=920e0419877f4239b048e126682274e9&device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 1097 time: 0.0623012 Dec 09 21:18:57.617799 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-789b7bf3-2566-4c47-a6bb-112b9f72405f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:57.619467 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-789b7bf3-2566-4c47-a6bb-112b9f72405f service neutron] 10.222.0.13 "GET /v2.0/networks?id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 HTTP/1.1" status: 200 len: 922 time: 0.0975676 Dec 09 21:18:57.671090 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-dc2c31d6-8abd-411d-878e-1e9c7dd71ff4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:18:03Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5', 'tenant_id': '920e0419877f4239b048e126682274e9', 'floating_ip_address': '172.25.3.216', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'port_id': 'd0cf802e-891b-41ee-8585-48a361e5265d', 'fixed_ip_address': '172.20.0.14', 'status': 'ACTIVE', 'standard_attr_id': 376, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'mac_address': 'fa:16:3e:b6:c6:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d45a57e-5f03-4541-88f7-1194f195f63e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:18:31Z', 'updated_at': '2021-12-09T21:18:55Z', 'revision_number': 3, 'project_id': '920e0419877f4239b048e126682274e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '72070289-8347-44bd-bfb9-9510e94eb5bd', 'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'tenant_id': '920e0419877f4239b048e126682274e9', 'mac_address': 'fa:16:3e:c3:24:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 264, 'fixed_ips': [{'subnet_id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:18:00Z', 'updated_at': '2021-12-09T21:18:09Z', 'revision_number': 5, 'project_id': '920e0419877f4239b048e126682274e9', 'subnets': [{'id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:18:57.692033 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-383e9a03-ae91-4907-bceb-80a587150773 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b615e863-071a-473e-8d66-8f84f78d1453 HTTP/1.1" status: 200 len: 217 time: 0.0595148 Dec 09 21:18:57.702493 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc2c31d6-8abd-411d-878e-1e9c7dd71ff4 None None] The sync data for ids ['70ade903-ee3e-4040-8855-b2a937f2a0d9'] in n-d-713301-27 is: [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:18:03Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5', 'tenant_id': '920e0419877f4239b048e126682274e9', 'floating_ip_address': '172.25.3.216', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'port_id': 'd0cf802e-891b-41ee-8585-48a361e5265d', 'fixed_ip_address': '172.20.0.14', 'status': 'ACTIVE', 'standard_attr_id': 376, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'mac_address': 'fa:16:3e:b6:c6:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d45a57e-5f03-4541-88f7-1194f195f63e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:18:31Z', 'updated_at': '2021-12-09T21:18:55Z', 'revision_number': 3, 'project_id': '920e0419877f4239b048e126682274e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '72070289-8347-44bd-bfb9-9510e94eb5bd', 'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'tenant_id': '920e0419877f4239b048e126682274e9', 'mac_address': 'fa:16:3e:c3:24:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 264, 'fixed_ips': [{'subnet_id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:18:00Z', 'updated_at': '2021-12-09T21:18:09Z', 'revision_number': 5, 'project_id': '920e0419877f4239b048e126682274e9', 'subnets': [{'id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:18:57.769702 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-5ce4807a-e78f-4bb9-bc7a-a2772a7d3c3f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:57.771235 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-5ce4807a-e78f-4bb9-bc7a-a2772a7d3c3f service neutron] 10.222.0.13 "GET /v2.0/subnets?id=3260fc19-8e10-46a2-82c6-3b2d5eda4a0e HTTP/1.1" status: 200 len: 860 time: 0.0619166 Dec 09 21:18:57.779331 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9274b01-2029-4847-a7bd-bdf4e83f08b4 req-d7f0a588-c879-4219-bc1d-23956b3961ce tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:57.784112 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9274b01-2029-4847-a7bd-bdf4e83f08b4 req-d7f0a588-c879-4219-bc1d-23956b3961ce tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.1074045 Dec 09 21:18:57.855805 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-fbf5c7a2-8e6a-416d-b2b2-2382d2c0f8d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:57.863986 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-fbf5c7a2-8e6a-416d-b2b2-2382d2c0f8d5 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0786662 Dec 09 21:18:57.869389 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-c92c0836-f609-4c99-b719-3b0229d7b8df service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:18:57.876444 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-c92c0836-f609-4c99-b719-3b0229d7b8df service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0115652 Dec 09 21:18:57.881694 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9274b01-2029-4847-a7bd-bdf4e83f08b4 req-a93fa1e8-b5db-4940-94ad-4846a6206d76 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0883849 Dec 09 21:18:57.927843 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03569065-285c-40a3-ab40-3018c0064685 None None] New status for floating IP 3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:18:58.021749 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-e153fd5f-b492-4d5b-92cd-ccfe758114aa service neutron] 10.222.0.13 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1443148 Dec 09 21:18:58.142922 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-32970fc1-4836-4b5f-85d5-a9f7b7ff76d8 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:58.144918 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-32970fc1-4836-4b5f-85d5-a9f7b7ff76d8 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 821 time: 0.1740046 Dec 09 21:18:58.167062 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-cc225cc1-3e6c-4444-ad78-14ff314fe755 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/quotas/a306d2242b1e41c892f63c7b122cdee4 HTTP/1.1" status: 200 len: 375 time: 0.0159440 Dec 09 21:18:58.187562 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-f4478417-4997-4ab6-93a8-05826bef91fd service neutron] 10.222.0.13 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1395144 Dec 09 21:18:58.255950 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-3884e83b-a191-4014-b9f6-1351519fbffa tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0827360 Dec 09 21:18:58.330123 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6b3800b-0cbe-43ca-9ae0-6056fd6a4d1c None None] Sync routers for ids ['70ade903-ee3e-4040-8855-b2a937f2a0d9'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:18:58.334428 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-6a1063b3-378e-4c29-bbb9-e548a5c2a681 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:58.335975 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-6a1063b3-378e-4c29-bbb9-e548a5c2a681 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=920e0419877f4239b048e126682274e9&device_id=3d45a57e-5f03-4541-88f7-1194f195f63e HTTP/1.1" status: 200 len: 1098 time: 0.1184161 Dec 09 21:18:58.341188 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6b3800b-0cbe-43ca-9ae0-6056fd6a4d1c None None] Routers {'70ade903-ee3e-4040-8855-b2a937f2a0d9'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:18:58.341999 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c6b3800b-0cbe-43ca-9ae0-6056fd6a4d1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:18:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['70ade903-ee3e-4040-8855-b2a937f2a0d9'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:18:58.392568 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-acd00082-e0e8-4eb8-afd6-2e0041322b1a service neutron] 10.222.0.13 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1356072 Dec 09 21:18:58.459861 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-c6b3800b-0cbe-43ca-9ae0-6056fd6a4d1c None None] Set router 70ade903-ee3e-4040-8855-b2a937f2a0d9 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:18:58.510207 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-1b3f6908-e898-4e6f-a4bc-7abbf86c4244 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:58.513721 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-1b3f6908-e898-4e6f-a4bc-7abbf86c4244 service neutron] 10.222.0.13 "GET /v2.0/networks?id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 HTTP/1.1" status: 200 len: 922 time: 0.1656184 Dec 09 21:18:58.575052 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-ba52cffc-0fbd-4bfd-bd6d-6602cfb68a3e service neutron] 10.222.0.13 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1522267 Dec 09 21:18:58.595795 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-cd5b94dd-32a6-43d3-98ef-d9eef9e4f816 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=d0cf802e-891b-41ee-8585-48a361e5265d HTTP/1.1" status: 200 len: 1002 time: 0.0741737 Dec 09 21:18:58.673416 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-252d3997-ba87-45f9-b900-8e9e4ee86003 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:58.674983 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-252d3997-ba87-45f9-b900-8e9e4ee86003 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=3260fc19-8e10-46a2-82c6-3b2d5eda4a0e HTTP/1.1" status: 200 len: 860 time: 0.0694072 Dec 09 21:18:58.727524 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-a7c42bae-11f7-4ad6-9daa-4e857bf94541 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:58.729039 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-a7c42bae-11f7-4ad6-9daa-4e857bf94541 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0417902 Dec 09 21:18:58.742224 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c6b3800b-0cbe-43ca-9ae0-6056fd6a4d1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:18:03Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5', 'tenant_id': '920e0419877f4239b048e126682274e9', 'floating_ip_address': '172.25.3.216', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'port_id': 'd0cf802e-891b-41ee-8585-48a361e5265d', 'fixed_ip_address': '172.20.0.14', 'status': 'ACTIVE', 'standard_attr_id': 376, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'mac_address': 'fa:16:3e:b6:c6:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d45a57e-5f03-4541-88f7-1194f195f63e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:18:31Z', 'updated_at': '2021-12-09T21:18:58Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '72070289-8347-44bd-bfb9-9510e94eb5bd', 'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'tenant_id': '920e0419877f4239b048e126682274e9', 'mac_address': 'fa:16:3e:c3:24:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 264, 'fixed_ips': [{'subnet_id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:18:00Z', 'updated_at': '2021-12-09T21:18:09Z', 'revision_number': 5, 'project_id': '920e0419877f4239b048e126682274e9', 'subnets': [{'id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:18:58.799694 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6b3800b-0cbe-43ca-9ae0-6056fd6a4d1c None None] Checking router: 70ade903-ee3e-4040-8855-b2a937f2a0d9 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:18:58.809100 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6b3800b-0cbe-43ca-9ae0-6056fd6a4d1c None None] Routers {'70ade903-ee3e-4040-8855-b2a937f2a0d9'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:18:58.809709 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c6b3800b-0cbe-43ca-9ae0-6056fd6a4d1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:18:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['70ade903-ee3e-4040-8855-b2a937f2a0d9'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:18:58.907801 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-282bca67-023a-4b20-992a-04033178c87b req-40c32aae-4d30-4b1d-ab00-20f3bcc5ed4f tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=d035bde1be0e46a6977e6cc6f45495c7&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0410454 Dec 09 21:18:58.913922 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-937a3cf3-1f41-4ec8-9f9a-a2a7ec799ceb service neutron] 10.222.0.13 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1727009 Dec 09 21:18:59.014667 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-c6b3800b-0cbe-43ca-9ae0-6056fd6a4d1c None None] Set router 70ade903-ee3e-4040-8855-b2a937f2a0d9 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:18:59.056205 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-8479db5a-cb7f-4345-b90c-bb47bc86e5ff req-bfb2efd1-a2b6-4765-9fbe-b82afe2b0420 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:18:59.057300 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8479db5a-cb7f-4345-b90c-bb47bc86e5ff req-bfb2efd1-a2b6-4765-9fbe-b82afe2b0420 service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0079670 Dec 09 21:18:59.114732 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-282bca67-023a-4b20-992a-04033178c87b req-22766361-b20d-4ce6-bdd3-be41a5af44f3 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:59.116373 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-282bca67-023a-4b20-992a-04033178c87b req-22766361-b20d-4ce6-bdd3-be41a5af44f3 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2008681 Dec 09 21:18:59.118452 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b0fbdf4-75bd-4d13-8789-1a917c4465f3 req-cefd9818-a2a4-4368-aee4-9137a43a67d8 service neutron] 10.222.0.13 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1926289 Dec 09 21:18:59.154684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-282bca67-023a-4b20-992a-04033178c87b req-449d6264-af21-4c4c-969b-bd5f3000cf94 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Request body: {'port': {'device_id': '7c63014a-f387-496c-bd49-f1ae415a0bba', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': 'd035bde1be0e46a6977e6cc6f45495c7'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:18:59.236245 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:18:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1f5f4aae-a40a-4e9e-8b8b-8f9278157bd9 x-openstack-request-id: req-1f5f4aae-a40a-4e9e-8b8b-8f9278157bd9 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:18:59.236684 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "17188b52-f615-49ca-8709-a3c9238c02fa", "tag": "b615e863-071a-473e-8d66-8f84f78d1453", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:18:59.236956 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-1f5f4aae-a40a-4e9e-8b8b-8f9278157bd9 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:18:59.237341 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '17188b52-f615-49ca-8709-a3c9238c02fa', 'tag': 'b615e863-071a-473e-8d66-8f84f78d1453', 'status': 'completed', 'code': 200} Dec 09 21:18:59.307880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-282bca67-023a-4b20-992a-04033178c87b req-449d6264-af21-4c4c-969b-bd5f3000cf94 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Made reservation on behalf of d035bde1be0e46a6977e6cc6f45495c7 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:18:59.311663 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-282bca67-023a-4b20-992a-04033178c87b req-449d6264-af21-4c4c-969b-bd5f3000cf94 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:59.324638 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-282bca67-023a-4b20-992a-04033178c87b req-449d6264-af21-4c4c-969b-bd5f3000cf94 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:59.350405 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c6b3800b-0cbe-43ca-9ae0-6056fd6a4d1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:18:03Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5', 'tenant_id': '920e0419877f4239b048e126682274e9', 'floating_ip_address': '172.25.3.216', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'port_id': 'd0cf802e-891b-41ee-8585-48a361e5265d', 'fixed_ip_address': '172.20.0.14', 'status': 'ACTIVE', 'standard_attr_id': 376, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'mac_address': 'fa:16:3e:b6:c6:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d45a57e-5f03-4541-88f7-1194f195f63e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:18:31Z', 'updated_at': '2021-12-09T21:18:58Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '72070289-8347-44bd-bfb9-9510e94eb5bd', 'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'tenant_id': '920e0419877f4239b048e126682274e9', 'mac_address': 'fa:16:3e:c3:24:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 264, 'fixed_ips': [{'subnet_id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:18:00Z', 'updated_at': '2021-12-09T21:18:09Z', 'revision_number': 5, 'project_id': '920e0419877f4239b048e126682274e9', 'subnets': [{'id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:18:59.389022 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f9ff492-3449-45e8-a6bd-f38d4f9ed929 req-1d6b7d4b-2904-48d5-9656-83c0beff938b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:59.391149 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1f9ff492-3449-45e8-a6bd-f38d4f9ed929 req-1d6b7d4b-2904-48d5-9656-83c0beff938b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=920e0419877f4239b048e126682274e9&device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 1097 time: 0.0469620 Dec 09 21:18:59.397115 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6b3800b-0cbe-43ca-9ae0-6056fd6a4d1c None None] The sync data for ids ['70ade903-ee3e-4040-8855-b2a937f2a0d9'] in n-d-713301-27 is: [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:18:03Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5', 'tenant_id': '920e0419877f4239b048e126682274e9', 'floating_ip_address': '172.25.3.216', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'port_id': 'd0cf802e-891b-41ee-8585-48a361e5265d', 'fixed_ip_address': '172.20.0.14', 'status': 'ACTIVE', 'standard_attr_id': 376, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'mac_address': 'fa:16:3e:b6:c6:a5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3d45a57e-5f03-4541-88f7-1194f195f63e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:18:31Z', 'updated_at': '2021-12-09T21:18:58Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '72070289-8347-44bd-bfb9-9510e94eb5bd', 'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'tenant_id': '920e0419877f4239b048e126682274e9', 'mac_address': 'fa:16:3e:c3:24:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 264, 'fixed_ips': [{'subnet_id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:18:00Z', 'updated_at': '2021-12-09T21:18:09Z', 'revision_number': 5, 'project_id': '920e0419877f4239b048e126682274e9', 'subnets': [{'id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:18:59.422079 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-12dec177-ff87-4ee5-b6c8-0234b3575b20 req-c19972b1-01ba-408e-bb57-c7a5afc142b5 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/ports?device_id=7c63014a-f387-496c-bd49-f1ae415a0bba HTTP/1.1" status: 200 len: 210 time: 0.0996668 Dec 09 21:18:59.543198 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-282bca67-023a-4b20-992a-04033178c87b req-449d6264-af21-4c4c-969b-bd5f3000cf94 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:59.547369 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f9ff492-3449-45e8-a6bd-f38d4f9ed929 req-38fabfa9-4cf5-4d7d-85f0-961b13df412a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:59.549662 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1f9ff492-3449-45e8-a6bd-f38d4f9ed929 req-38fabfa9-4cf5-4d7d-85f0-961b13df412a service neutron] 10.222.0.31 "GET /v2.0/networks?id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 HTTP/1.1" status: 200 len: 922 time: 0.1347761 Dec 09 21:18:59.551786 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-282bca67-023a-4b20-992a-04033178c87b req-449d6264-af21-4c4c-969b-bd5f3000cf94 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:18:59.649225 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1f9ff492-3449-45e8-a6bd-f38d4f9ed929 req-7a6d5d20-2511-4535-ac1a-b7fa98d53ee2 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b615e863-071a-473e-8d66-8f84f78d1453 HTTP/1.1" status: 200 len: 217 time: 0.0774066 Dec 09 21:18:59.762824 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f9ff492-3449-45e8-a6bd-f38d4f9ed929 req-98b4c5c4-dab3-442b-a010-ce53cbe83f32 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:59.764618 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1f9ff492-3449-45e8-a6bd-f38d4f9ed929 req-98b4c5c4-dab3-442b-a010-ce53cbe83f32 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=3260fc19-8e10-46a2-82c6-3b2d5eda4a0e HTTP/1.1" status: 200 len: 860 time: 0.0987735 Dec 09 21:18:59.768051 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-cfd10fb0-849c-4bf4-be52-be78d002886e service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0540280 Dec 09 21:18:59.780775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-6d2c8b88-1d60-4439-9223-03aeb8160451 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:18:59.781789 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-6d2c8b88-1d60-4439-9223-03aeb8160451 service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0060475 Dec 09 21:18:59.838415 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f9ff492-3449-45e8-a6bd-f38d4f9ed929 req-0c464f45-520a-48ec-95b3-1b519923775c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:18:59.840293 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1f9ff492-3449-45e8-a6bd-f38d4f9ed929 req-0c464f45-520a-48ec-95b3-1b519923775c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0576451 Dec 09 21:18:59.980121 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1f9ff492-3449-45e8-a6bd-f38d4f9ed929 req-3f8c59b2-3746-4850-a458-a5262f984ce6 service neutron] 10.222.0.31 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0988679 Dec 09 21:19:00.013786 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1bf95be7-73af-4487-9610-c49274f0e961 req-c9777839-804d-4ec4-8c7a-0909e86a3bdf tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 210 time: 0.3620806 Dec 09 21:19:00.044413 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-282bca67-023a-4b20-992a-04033178c87b req-449d6264-af21-4c4c-969b-bd5f3000cf94 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Allocated IP 192.168.233.4 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/2dae91d7-35c0-4f49-bedd-e9ae0003a027) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:19:00.072863 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-449d6264-af21-4c4c-969b-bd5f3000cf94 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Pushing event updated for resources: {'SecurityGroup': ['ID=afb99149-6cda-47e0-9a86-3163c9902e77,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:00.107351 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4769d878-b1c1-4298-8ded-00abb69c8838 req-c2823dcd-05a7-46a9-b15d-0bcad5a20af0 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:00.108600 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1f9ff492-3449-45e8-a6bd-f38d4f9ed929 req-822dfdb1-82c5-4d3d-b8ac-bd62453a8ff1 service neutron] 10.222.0.31 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1208901 Dec 09 21:19:00.108865 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4769d878-b1c1-4298-8ded-00abb69c8838 req-c2823dcd-05a7-46a9-b15d-0bcad5a20af0 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 1097 time: 0.4521515 Dec 09 21:19:00.240879 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4769d878-b1c1-4298-8ded-00abb69c8838 req-a4371e3b-58c0-4693-ab2b-6075410179b9 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0997894 Dec 09 21:19:00.255473 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15079f21-d7f4-42a4-9edd-da21872d9b50 req-f10cd9d1-f3ca-4c2b-9263-815399aa27ef tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:00.276067 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15079f21-d7f4-42a4-9edd-da21872d9b50 req-f10cd9d1-f3ca-4c2b-9263-815399aa27ef tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.1842055 Dec 09 21:19:00.398906 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-cc410655-31c6-429a-a97d-b9e0bb2683d5 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:00.400480 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-cc410655-31c6-429a-a97d-b9e0bb2683d5 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.31 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 821 time: 0.1767416 Dec 09 21:19:00.426012 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-282bca67-023a-4b20-992a-04033178c87b req-449d6264-af21-4c4c-969b-bd5f3000cf94 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:00.428211 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-794ca45a-226a-4c4a-aa24-0d475d2b3525 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Request body: {'port': {'device_id': 'd0cb5c61-bab4-4b8b-aa1e-0efbe9992f42', 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c', 'admin_state_up': True, 'tenant_id': 'a306d2242b1e41c892f63c7b122cdee4'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:00.480864 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15079f21-d7f4-42a4-9edd-da21872d9b50 req-3183ba50-8bbd-4236-8550-25176e4acabc tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2038398 Dec 09 21:19:00.515766 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44e90da0-004e-47fc-8577-8b503623f121 req-c17ea887-4545-48cd-ae69-44131b04de2e tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:00.517842 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44e90da0-004e-47fc-8577-8b503623f121 req-c17ea887-4545-48cd-ae69-44131b04de2e tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/ports?device_id=a40f9b82-e796-4cd4-b12e-cd2089ff7c19 HTTP/1.1" status: 200 len: 949 time: 0.1198249 Dec 09 21:19:00.554841 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-282bca67-023a-4b20-992a-04033178c87b req-449d6264-af21-4c4c-969b-bd5f3000cf94 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:00.567703 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-794ca45a-226a-4c4a-aa24-0d475d2b3525 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Made reservation on behalf of a306d2242b1e41c892f63c7b122cdee4 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:19:00.571307 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-794ca45a-226a-4c4a-aa24-0d475d2b3525 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:00.671296 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-282bca67-023a-4b20-992a-04033178c87b req-449d6264-af21-4c4c-969b-bd5f3000cf94 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:19:00.685501 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-282bca67-023a-4b20-992a-04033178c87b req-449d6264-af21-4c4c-969b-bd5f3000cf94 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:19:00.688433 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-282bca67-023a-4b20-992a-04033178c87b req-449d6264-af21-4c4c-969b-bd5f3000cf94 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:19:00.696309 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44e90da0-004e-47fc-8577-8b503623f121 req-5d8a2696-fbad-4258-b448-e3f87fba0b4f tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.13 "GET /v2.0/security-groups?id=3997e1dc-b863-4862-a321-fb463bb4bb43&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1659591 Dec 09 21:19:00.704665 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-449d6264-af21-4c4c-969b-bd5f3000cf94 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Pushing event updated for resources: {'Port': ['ID=2dae91d7-35c0-4f49-bedd-e9ae0003a027,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:00.732710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-794ca45a-226a-4c4a-aa24-0d475d2b3525 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Allocated IP 172.20.0.6 (93378dc3-2ac5-4cf7-9ce3-d812934de40c/c49a62cc-af1b-4958-a4a9-eb44188b8fb9/2ba5fd1c-0009-4970-b169-7f8dca923e34) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:19:00.755194 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4329c9a7-e0b3-4aed-8a0b-a4970beff705 req-08470100-09f0-4a34-b519-3aa3a7bd7472 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.216 HTTP/1.1" status: 200 len: 1002 time: 0.2041183 Dec 09 21:19:00.840235 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4329c9a7-e0b3-4aed-8a0b-a4970beff705 req-855e0687-2b0a-48b8-99d4-028433baaedd tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:00.847180 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4329c9a7-e0b3-4aed-8a0b-a4970beff705 req-855e0687-2b0a-48b8-99d4-028433baaedd tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports/d0cf802e-891b-41ee-8585-48a361e5265d HTTP/1.1" status: 200 len: 943 time: 0.0898578 Dec 09 21:19:00.861666 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-282bca67-023a-4b20-992a-04033178c87b req-449d6264-af21-4c4c-969b-bd5f3000cf94 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:00.862309 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-282bca67-023a-4b20-992a-04033178c87b req-449d6264-af21-4c4c-969b-bd5f3000cf94 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:00.939493 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-282bca67-023a-4b20-992a-04033178c87b req-449d6264-af21-4c4c-969b-bd5f3000cf94 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 936 time: 1.7903945 Dec 09 21:19:00.986032 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-282bca67-023a-4b20-992a-04033178c87b req-347abcfb-2acc-4972-a145-0a1317e4988a service neutron] Request body: {'port': {'device_id': '7c63014a-f387-496c-bd49-f1ae415a0bba', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:00.996437 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-20b50508-26f1-46d6-ae24-a8d1f6287d86 None None] Provisioning complete for port 2dae91d7-35c0-4f49-bedd-e9ae0003a027 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:00.997090 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-794ca45a-226a-4c4a-aa24-0d475d2b3525 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:00.998440 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-20b50508-26f1-46d6-ae24-a8d1f6287d86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:01.037690 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bc8e417-bff7-43db-9672-6c87fc72fd09 req-4bc89982-c03d-472f-a240-8003f3fe36d8 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:01.045546 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bc8e417-bff7-43db-9672-6c87fc72fd09 req-4bc89982-c03d-472f-a240-8003f3fe36d8 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 950 time: 0.2134991 Dec 09 21:19:01.055814 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-20b50508-26f1-46d6-ae24-a8d1f6287d86 None None] Port 2dae91d7-35c0-4f49-bedd-e9ae0003a027 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:19:01.098406 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4329c9a7-e0b3-4aed-8a0b-a4970beff705 req-ccaafa6d-cd19-43eb-8f1f-eaf2859977e6 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.216 HTTP/1.1" status: 200 len: 1002 time: 0.1629555 Dec 09 21:19:01.121688 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c180467-a949-44ab-836e-e3eb18103c3f req-157d907b-c5e3-47b6-9818-548abfbf26e6 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:01.123284 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7c180467-a949-44ab-836e-e3eb18103c3f req-157d907b-c5e3-47b6-9818-548abfbf26e6 tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.31 "GET /v2.0/ports?device_id=a40f9b82-e796-4cd4-b12e-cd2089ff7c19 HTTP/1.1" status: 200 len: 949 time: 0.1310322 Dec 09 21:19:01.130513 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52de5b00-f4a4-41fb-8ea4-b526611dae4d req-eaf41091-8df0-48a8-a247-8d99c8dee647 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0814705 Dec 09 21:19:01.155222 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bc8e417-bff7-43db-9672-6c87fc72fd09 req-25aa2edd-9d8d-4215-94b3-7db69a826175 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1088109 Dec 09 21:19:01.168002 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-794ca45a-226a-4c4a-aa24-0d475d2b3525 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:01.179152 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-282bca67-023a-4b20-992a-04033178c87b req-347abcfb-2acc-4972-a145-0a1317e4988a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:01.248520 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3d45a57e-5f03-4541-88f7-1194f195f63e', 'tag': 'd0cf802e-891b-41ee-8585-48a361e5265d'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:01.250762 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e69706e6-14eb-435a-9094-750ea92901a1" -d '{"events": [{"name": "network-changed", "server_uuid": "3d45a57e-5f03-4541-88f7-1194f195f63e", "tag": "d0cf802e-891b-41ee-8585-48a361e5265d"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:01.262652 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-794ca45a-226a-4c4a-aa24-0d475d2b3525 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Network 93378dc3-2ac5-4cf7-9ce3-d812934de40c is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:19:01.275031 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-794ca45a-226a-4c4a-aa24-0d475d2b3525 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:19:01.280100 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-794ca45a-226a-4c4a-aa24-0d475d2b3525 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:19:01.309981 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-794ca45a-226a-4c4a-aa24-0d475d2b3525 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Pushing event updated for resources: {'Port': ['ID=2ba5fd1c-0009-4970-b169-7f8dca923e34,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:01.335772 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4329c9a7-e0b3-4aed-8a0b-a4970beff705 req-924fbb4c-da29-4eb0-a24b-bd6c5ef72058 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:01.337116 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4329c9a7-e0b3-4aed-8a0b-a4970beff705 req-924fbb4c-da29-4eb0-a24b-bd6c5ef72058 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.2201359 Dec 09 21:19:01.345760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-794ca45a-226a-4c4a-aa24-0d475d2b3525 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:01.346397 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-794ca45a-226a-4c4a-aa24-0d475d2b3525 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:01.356310 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52de5b00-f4a4-41fb-8ea4-b526611dae4d req-70c7497f-4f22-4f36-8677-ef73b061c82c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:01.357820 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52de5b00-f4a4-41fb-8ea4-b526611dae4d req-70c7497f-4f22-4f36-8677-ef73b061c82c service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=615039519ef147c78eb38a1d65eac061&device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 1098 time: 0.1537805 Dec 09 21:19:01.372372 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-7c180467-a949-44ab-836e-e3eb18103c3f req-c6177b5c-543e-44d9-8608-79191b63f75a tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Deleting port 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:19:01.372833 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7c180467-a949-44ab-836e-e3eb18103c3f req-c6177b5c-543e-44d9-8608-79191b63f75a tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:01.403077 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-794ca45a-226a-4c4a-aa24-0d475d2b3525 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9821920 Dec 09 21:19:01.429171 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-3073d6f5-2d3b-424f-870e-2ef282879780 service neutron] Request body: {'port': {'device_id': 'd0cb5c61-bab4-4b8b-aa1e-0efbe9992f42', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:01.569042 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-0d92b746-a7d3-4bd8-8bda-49853c1ad803 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:01.570526 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-0d92b746-a7d3-4bd8-8bda-49853c1ad803 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 807 time: 0.3164327 Dec 09 21:19:01.597077 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-3073d6f5-2d3b-424f-870e-2ef282879780 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:01.607177 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-7c180467-a949-44ab-836e-e3eb18103c3f req-c6177b5c-543e-44d9-8608-79191b63f75a tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] For port 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=0dc8dc0a-1841-4d79-82ba-8d7ab787a13a,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:01.608068 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7c180467-a949-44ab-836e-e3eb18103c3f req-c6177b5c-543e-44d9-8608-79191b63f75a tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:01.615421 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-f1d3d54c-85d3-4185-ba9c-67727a1297cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:01.616906 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-f1d3d54c-85d3-4185-ba9c-67727a1297cc service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 1102 time: 0.1674397 Dec 09 21:19:01.629198 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ca5a900-225f-4217-8d12-d464d22700a7 req-0bac8f6b-a048-4973-8230-63becbb000ac tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:01.630763 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ca5a900-225f-4217-8d12-d464d22700a7 req-0bac8f6b-a048-4973-8230-63becbb000ac tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/ports?device_id=7c63014a-f387-496c-bd49-f1ae415a0bba HTTP/1.1" status: 200 len: 934 time: 0.1995039 Dec 09 21:19:01.646514 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-c52da5f4-2ffe-430b-9f74-04d99749bc1a tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/quotas/ac5b7cefd8cc48cc83f38d3923aae132 HTTP/1.1" status: 200 len: 375 time: 0.0466144 Dec 09 21:19:01.839036 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-7c180467-a949-44ab-836e-e3eb18103c3f req-c6177b5c-543e-44d9-8608-79191b63f75a tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Calling delete_port for 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:19:01.841109 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52de5b00-f4a4-41fb-8ea4-b526611dae4d req-9a42ada0-8449-4dde-ba2f-ffafc69fb733 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:01.842594 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52de5b00-f4a4-41fb-8ea4-b526611dae4d req-9a42ada0-8449-4dde-ba2f-ffafc69fb733 service neutron] 10.222.0.10 "GET /v2.0/networks?id=ce6b6bd1-6a60-4cea-9b70-69fd0290796c HTTP/1.1" status: 200 len: 923 time: 0.4386191 Dec 09 21:19:01.863080 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-f6039a2a-573a-473c-a080-855ec2952b19 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1888011 Dec 09 21:19:01.866137 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ca5a900-225f-4217-8d12-d464d22700a7 req-ecbcc101-6916-4db0-83cc-880e7c392f75 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/security-groups?id=afb99149-6cda-47e0-9a86-3163c9902e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2222078 Dec 09 21:19:01.873562 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-506eab05-7927-4d1c-99d2-7f1358e4f16f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:01.874994 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-506eab05-7927-4d1c-99d2-7f1358e4f16f service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.2433195 Dec 09 21:19:01.891352 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-282bca67-023a-4b20-992a-04033178c87b req-347abcfb-2acc-4972-a145-0a1317e4988a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2dae91d7-35c0-4f49-bedd-e9ae0003a027 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:19:01.941572 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-282bca67-023a-4b20-992a-04033178c87b req-347abcfb-2acc-4972-a145-0a1317e4988a service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:01.956720 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-37dbaa01-2176-4f73-82ca-f21889521359 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.145&port_id=204e6970-8ed3-4e91-9792-52401052a153 HTTP/1.1" status: 200 len: 217 time: 0.0686066 Dec 09 21:19:02.010255 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-282bca67-023a-4b20-992a-04033178c87b req-347abcfb-2acc-4972-a145-0a1317e4988a service neutron] Transition to ACTIVE for port object 2dae91d7-35c0-4f49-bedd-e9ae0003a027 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:19:02.041904 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52de5b00-f4a4-41fb-8ea4-b526611dae4d req-e98a33d7-65f1-4fcf-a8c8-cdda4cdf403e service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=7eb6e48f-08e3-409a-9551-0e38eb690c8b HTTP/1.1" status: 200 len: 1002 time: 0.1731391 Dec 09 21:19:02.042612 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-282bca67-023a-4b20-992a-04033178c87b req-347abcfb-2acc-4972-a145-0a1317e4988a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:02.125471 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-563596f3-683d-4577-83cb-5c9a1befa5d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:02.127114 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-563596f3-683d-4577-83cb-5c9a1befa5d5 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1362576 Dec 09 21:19:02.138972 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-cce86536-ac41-4887-926f-253c6e480d8f service neutron] 10.222.0.13 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2630153 Dec 09 21:19:02.156670 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-347abcfb-2acc-4972-a145-0a1317e4988a service neutron] Pushing event updated for resources: {'Port': ['ID=2dae91d7-35c0-4f49-bedd-e9ae0003a027,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:02.172155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52de5b00-f4a4-41fb-8ea4-b526611dae4d req-a070d237-2397-4543-8f90-f0e2a5f54b83 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:02.173782 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52de5b00-f4a4-41fb-8ea4-b526611dae4d req-a070d237-2397-4543-8f90-f0e2a5f54b83 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9755e5ea-99a7-4073-8693-293dcc00b929 HTTP/1.1" status: 200 len: 861 time: 0.1175673 Dec 09 21:19:02.195642 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5048f65a-ef74-4b3d-b1ca-a1d9fe1cbf5e req-a6ba714b-2ba9-4e98-b0e5-300601129ff2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:02.197140 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5048f65a-ef74-4b3d-b1ca-a1d9fe1cbf5e req-a6ba714b-2ba9-4e98-b0e5-300601129ff2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 931 time: 0.1921842 Dec 09 21:19:02.303156 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7c180467-a949-44ab-836e-e3eb18103c3f req-c6177b5c-543e-44d9-8608-79191b63f75a tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:02.306036 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52de5b00-f4a4-41fb-8ea4-b526611dae4d req-773474bb-937e-4872-94c7-c88f9d3aecf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:02.307822 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52de5b00-f4a4-41fb-8ea4-b526611dae4d req-773474bb-937e-4872-94c7-c88f9d3aecf3 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=ce6b6bd1-6a60-4cea-9b70-69fd0290796c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1029105 Dec 09 21:19:02.316047 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['0dc8dc0a-1841-4d79-82ba-8d7ab787a13a'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:19:02.327235 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-14111d98-c839-4fcd-b786-25451cc916a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:02.328759 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-14111d98-c839-4fcd-b786-25451cc916a6 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1864691 Dec 09 21:19:02.373792 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6177b5c-543e-44d9-8608-79191b63f75a tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Pushing event deleted for resources: {'Port': ['ID=0dc8dc0a-1841-4d79-82ba-8d7ab787a13a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:02.400997 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5048f65a-ef74-4b3d-b1ca-a1d9fe1cbf5e req-e2bba430-a3d3-4998-8939-c017e0fb3b83 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1810749 Dec 09 21:19:02.406807 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-63fd86df-438d-4b8e-af05-0ece76938785 service neutron] 10.222.0.13 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2532787 Dec 09 21:19:02.463885 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-3073d6f5-2d3b-424f-870e-2ef282879780 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2ba5fd1c-0009-4970-b169-7f8dca923e34 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:19:02.496236 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-3073d6f5-2d3b-424f-870e-2ef282879780 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:02.498755 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-7c180467-a949-44ab-836e-e3eb18103c3f req-c6177b5c-543e-44d9-8608-79191b63f75a tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] No DVR routers for this DVR port 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:19:02.500620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-282bca67-023a-4b20-992a-04033178c87b req-347abcfb-2acc-4972-a145-0a1317e4988a service neutron] Attempting to bind port 2dae91d7-35c0-4f49-bedd-e9ae0003a027 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:19:02.500620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-282bca67-023a-4b20-992a-04033178c87b req-347abcfb-2acc-4972-a145-0a1317e4988a service neutron] Attempting to bind port 2dae91d7-35c0-4f49-bedd-e9ae0003a027 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:19:02.500620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-282bca67-023a-4b20-992a-04033178c87b req-347abcfb-2acc-4972-a145-0a1317e4988a service neutron] Attempting to bind port 2dae91d7-35c0-4f49-bedd-e9ae0003a027 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:02.502038 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.31', 57441) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:02.506574 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7c180467-a949-44ab-836e-e3eb18103c3f req-c6177b5c-543e-44d9-8608-79191b63f75a tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:02.508180 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-45abf505-d8e3-4969-a222-b483da680d0a service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1676903 Dec 09 21:19:02.509738 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cd01923e-17be-44bc-97f2-054a70fe8c68 x-openstack-request-id: req-cd01923e-17be-44bc-97f2-054a70fe8c68 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:02.510022 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3d45a57e-5f03-4541-88f7-1194f195f63e", "tag": "d0cf802e-891b-41ee-8585-48a361e5265d", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:02.510265 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-cd01923e-17be-44bc-97f2-054a70fe8c68 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:02.510633 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3d45a57e-5f03-4541-88f7-1194f195f63e', 'tag': 'd0cf802e-891b-41ee-8585-48a361e5265d', 'status': 'completed', 'code': 200} Dec 09 21:19:02.510981 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7c180467-a949-44ab-836e-e3eb18103c3f req-c6177b5c-543e-44d9-8608-79191b63f75a tempest-DeleteServersAdminTestJSON-101104451 tempest-DeleteServersAdminTestJSON-101104451-project] 10.222.0.31 "DELETE /v2.0/ports/0dc8dc0a-1841-4d79-82ba-8d7ab787a13a HTTP/1.1" status: 204 len: 173 time: 1.3781235 Dec 09 21:19:02.512248 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-282bca67-023a-4b20-992a-04033178c87b req-347abcfb-2acc-4972-a145-0a1317e4988a service neutron] Port 2dae91d7-35c0-4f49-bedd-e9ae0003a027 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:19:02.512563 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-282bca67-023a-4b20-992a-04033178c87b req-347abcfb-2acc-4972-a145-0a1317e4988a service neutron] Attempting to bind port 2dae91d7-35c0-4f49-bedd-e9ae0003a027 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:02.523074 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a40f9b82-e796-4cd4-b12e-cd2089ff7c19', 'name': 'network-vif-deleted', 'tag': '0dc8dc0a-1841-4d79-82ba-8d7ab787a13a'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:02.525830 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0434b9b5-576d-4766-a87a-f370c7491b88" -d '{"events": [{"server_uuid": "a40f9b82-e796-4cd4-b12e-cd2089ff7c19", "name": "network-vif-deleted", "tag": "0dc8dc0a-1841-4d79-82ba-8d7ab787a13a"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:02.560501 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-3073d6f5-2d3b-424f-870e-2ef282879780 service neutron] Transition to ACTIVE for port object 2ba5fd1c-0009-4970-b169-7f8dca923e34 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:19:02.572996 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-3073d6f5-2d3b-424f-870e-2ef282879780 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:02.655407 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52de5b00-f4a4-41fb-8ea4-b526611dae4d req-7d31f56b-71e0-4659-a26f-11efe40c991f service neutron] 10.222.0.10 "GET /v2.0/networks/ce6b6bd1-6a60-4cea-9b70-69fd0290796c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3060951 Dec 09 21:19:02.716419 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e69706e6-14eb-435a-9094-750ea92901a1 req-5e1fa364-d1f3-44bd-8433-40b27d294193 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:02.718271 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e69706e6-14eb-435a-9094-750ea92901a1 req-5e1fa364-d1f3-44bd-8433-40b27d294193 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=920e0419877f4239b048e126682274e9&device_id=3d45a57e-5f03-4541-88f7-1194f195f63e HTTP/1.1" status: 200 len: 1098 time: 0.2134628 Dec 09 21:19:02.722058 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3073d6f5-2d3b-424f-870e-2ef282879780 service neutron] Pushing event updated for resources: {'Port': ['ID=2ba5fd1c-0009-4970-b169-7f8dca923e34,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:02.909378 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-f5da76e2-5d0a-405b-9638-03d33d34aaef tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.216 HTTP/1.1" status: 200 len: 1002 time: 0.3978238 Dec 09 21:19:02.921680 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-282bca67-023a-4b20-992a-04033178c87b req-347abcfb-2acc-4972-a145-0a1317e4988a service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 18, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:19:02.922014 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-282bca67-023a-4b20-992a-04033178c87b req-347abcfb-2acc-4972-a145-0a1317e4988a service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:19:02.922387 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-282bca67-023a-4b20-992a-04033178c87b req-347abcfb-2acc-4972-a145-0a1317e4988a service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:19:02.922834 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-282bca67-023a-4b20-992a-04033178c87b req-347abcfb-2acc-4972-a145-0a1317e4988a service neutron] Bound port: 2dae91d7-35c0-4f49-bedd-e9ae0003a027, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:19:02.923189 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-282bca67-023a-4b20-992a-04033178c87b req-347abcfb-2acc-4972-a145-0a1317e4988a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:02.962863 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e69706e6-14eb-435a-9094-750ea92901a1 req-5bb4fa95-e137-4b35-993a-3e5c737f2eb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:02.964568 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e69706e6-14eb-435a-9094-750ea92901a1 req-5bb4fa95-e137-4b35-993a-3e5c737f2eb7 service neutron] 10.222.0.31 "GET /v2.0/networks?id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 HTTP/1.1" status: 200 len: 922 time: 0.2334230 Dec 09 21:19:02.966527 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52de5b00-f4a4-41fb-8ea4-b526611dae4d req-ba82fca6-444a-4721-be33-ee9920751e73 service neutron] 10.222.0.10 "GET /v2.0/networks/ce6b6bd1-6a60-4cea-9b70-69fd0290796c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3030951 Dec 09 21:19:02.967802 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-3073d6f5-2d3b-424f-870e-2ef282879780 service neutron] Attempting to bind port 2ba5fd1c-0009-4970-b169-7f8dca923e34 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:19:02.968232 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-3073d6f5-2d3b-424f-870e-2ef282879780 service neutron] Attempting to bind port 2ba5fd1c-0009-4970-b169-7f8dca923e34 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:19:02.968655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-3073d6f5-2d3b-424f-870e-2ef282879780 service neutron] Attempting to bind port 2ba5fd1c-0009-4970-b169-7f8dca923e34 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:03.000923 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7da181f5-3a67-4974-9a6b-7e3d6235c6ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:03.001538 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-3073d6f5-2d3b-424f-870e-2ef282879780 service neutron] Port 2ba5fd1c-0009-4970-b169-7f8dca923e34 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:19:03.001971 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-3073d6f5-2d3b-424f-870e-2ef282879780 service neutron] Attempting to bind port 2ba5fd1c-0009-4970-b169-7f8dca923e34 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:03.071940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-6fdd0472-9f8f-4338-a5c7-14121dead01f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:03.078548 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-3073d6f5-2d3b-424f-870e-2ef282879780 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 18, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:19:03.079216 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-3073d6f5-2d3b-424f-870e-2ef282879780 service neutron] Checking segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:19:03.079974 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-3073d6f5-2d3b-424f-870e-2ef282879780 service neutron] Bound using segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:19:03.080796 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-3073d6f5-2d3b-424f-870e-2ef282879780 service neutron] Bound port: 2ba5fd1c-0009-4970-b169-7f8dca923e34, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:19:03.081419 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-3073d6f5-2d3b-424f-870e-2ef282879780 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:03.087791 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-6fdd0472-9f8f-4338-a5c7-14121dead01f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports/d0cf802e-891b-41ee-8585-48a361e5265d HTTP/1.1" status: 200 len: 943 time: 0.1680450 Dec 09 21:19:03.132863 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dbd7eaf-b6f5-4fd0-b807-0fd2998284ba req-210436d0-dc42-4149-995a-39a01a6c290a tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:03.140219 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6dbd7eaf-b6f5-4fd0-b807-0fd2998284ba req-210436d0-dc42-4149-995a-39a01a6c290a tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.2280841 Dec 09 21:19:03.144739 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e69706e6-14eb-435a-9094-750ea92901a1 req-a8f47d5e-5365-4bf3-94a6-1801305cd2c9 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=d0cf802e-891b-41ee-8585-48a361e5265d HTTP/1.1" status: 200 len: 1002 time: 0.1490636 Dec 09 21:19:03.213450 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-3073d6f5-2d3b-424f-870e-2ef282879780 service neutron] For port 2ba5fd1c-0009-4970-b169-7f8dca923e34, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:03.219708 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-4bd5ee71-8d22-4597-b6cb-fa7c15262a0e service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6971312 Dec 09 21:19:03.235040 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-3073d6f5-2d3b-424f-870e-2ef282879780 service neutron] For port 2ba5fd1c-0009-4970-b169-7f8dca923e34, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2ba5fd1c-0009-4970-b169-7f8dca923e34,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:19:03.237735 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e69706e6-14eb-435a-9094-750ea92901a1 req-d02a24c1-4e92-44ec-bf7e-921fba7cf89a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:03.239429 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e69706e6-14eb-435a-9094-750ea92901a1 req-d02a24c1-4e92-44ec-bf7e-921fba7cf89a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=3260fc19-8e10-46a2-82c6-3b2d5eda4a0e HTTP/1.1" status: 200 len: 860 time: 0.0748324 Dec 09 21:19:03.243717 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-3073d6f5-2d3b-424f-870e-2ef282879780 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:03.258876 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-282bca67-023a-4b20-992a-04033178c87b req-347abcfb-2acc-4972-a145-0a1317e4988a service neutron] For port 2dae91d7-35c0-4f49-bedd-e9ae0003a027, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:03.296068 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6dbd7eaf-b6f5-4fd0-b807-0fd2998284ba req-4b5d4bae-807b-4aa9-9c9b-7cd27c64c0c9 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1548979 Dec 09 21:19:03.308258 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-282bca67-023a-4b20-992a-04033178c87b req-347abcfb-2acc-4972-a145-0a1317e4988a service neutron] For port 2dae91d7-35c0-4f49-bedd-e9ae0003a027, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2dae91d7-35c0-4f49-bedd-e9ae0003a027,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:19:03.316650 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-3073d6f5-2d3b-424f-870e-2ef282879780 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:03.317425 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-3073d6f5-2d3b-424f-870e-2ef282879780 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:03.319240 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-3073d6f5-2d3b-424f-870e-2ef282879780 service neutron] 10.222.0.31 "PUT /v2.0/ports/2ba5fd1c-0009-4970-b169-7f8dca923e34 HTTP/1.1" status: 200 len: 1092 time: 1.9026625 Dec 09 21:19:03.321332 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-9396e403-37e4-431b-9667-13e2c7673257 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.216 HTTP/1.1" status: 200 len: 1002 time: 0.1614175 Dec 09 21:19:03.323684 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-282bca67-023a-4b20-992a-04033178c87b req-347abcfb-2acc-4972-a145-0a1317e4988a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:03.344907 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3073d6f5-2d3b-424f-870e-2ef282879780 service neutron] Pushing event updated for resources: {'Port': ['ID=2ba5fd1c-0009-4970-b169-7f8dca923e34,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:03.353585 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e69706e6-14eb-435a-9094-750ea92901a1 req-1ff60b02-e018-4bcb-975b-c7e86e129501 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:03.358968 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e69706e6-14eb-435a-9094-750ea92901a1 req-1ff60b02-e018-4bcb-975b-c7e86e129501 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1039348 Dec 09 21:19:03.441983 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-282bca67-023a-4b20-992a-04033178c87b req-347abcfb-2acc-4972-a145-0a1317e4988a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:03.442639 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-282bca67-023a-4b20-992a-04033178c87b req-347abcfb-2acc-4972-a145-0a1317e4988a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:03.444233 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-282bca67-023a-4b20-992a-04033178c87b req-347abcfb-2acc-4972-a145-0a1317e4988a service neutron] 10.222.0.31 "PUT /v2.0/ports/2dae91d7-35c0-4f49-bedd-e9ae0003a027 HTTP/1.1" status: 200 len: 1095 time: 2.4652236 Dec 09 21:19:03.502419 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-f2da2b2d-2f38-481c-acde-93646d7ff632 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:03.503379 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-347abcfb-2acc-4972-a145-0a1317e4988a service neutron] Pushing event updated for resources: {'Port': ['ID=2dae91d7-35c0-4f49-bedd-e9ae0003a027,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:03.504769 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-f2da2b2d-2f38-481c-acde-93646d7ff632 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 1095 time: 0.1326768 Dec 09 21:19:03.566449 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e69706e6-14eb-435a-9094-750ea92901a1 req-0355b64f-436f-4bea-93e6-c453fafe3eb3 service neutron] 10.222.0.31 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2030988 Dec 09 21:19:03.568408 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-c090d248-d718-494e-82e0-ee4ec6d66f5e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=2ba5fd1c-0009-4970-b169-7f8dca923e34 HTTP/1.1" status: 200 len: 217 time: 0.0488145 Dec 09 21:19:03.615901 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a7c9be-2541-43ad-8274-8fa8497a3517 req-76fd63c3-15cc-4d01-93fd-5a753fb8d2bd tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:03.623525 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1a7c9be-2541-43ad-8274-8fa8497a3517 req-76fd63c3-15cc-4d01-93fd-5a753fb8d2bd tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 950 time: 0.1781890 Dec 09 21:19:03.680402 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-282bca67-023a-4b20-992a-04033178c87b req-65997dcf-9b46-409d-9711-aa0eb11c7d43 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:03.681968 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-282bca67-023a-4b20-992a-04033178c87b req-65997dcf-9b46-409d-9711-aa0eb11c7d43 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d035bde1be0e46a6977e6cc6f45495c7&device_id=7c63014a-f387-496c-bd49-f1ae415a0bba HTTP/1.1" status: 200 len: 1098 time: 0.1571932 Dec 09 21:19:03.714768 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-5e19bea6-da36-48c1-b5ee-e08bf41205a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:03.716313 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-5e19bea6-da36-48c1-b5ee-e08bf41205a5 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=c49a62cc-af1b-4958-a4a9-eb44188b8fb9 HTTP/1.1" status: 200 len: 861 time: 0.1344969 Dec 09 21:19:03.717499 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-46fb1eae-a5ce-46a3-ab85-e18068edecda tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:03.719698 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-46fb1eae-a5ce-46a3-ab85-e18068edecda tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.3830040 Dec 09 21:19:03.758396 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-282bca67-023a-4b20-992a-04033178c87b req-7e9528d8-b325-467a-8904-4841b5d67999 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.4&port_id=2dae91d7-35c0-4f49-bedd-e9ae0003a027 HTTP/1.1" status: 200 len: 217 time: 0.0578585 Dec 09 21:19:03.763615 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-fd0c77b3-33df-48f8-af28-31e53841803c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=93378dc3-2ac5-4cf7-9ce3-d812934de40c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0350041 Dec 09 21:19:03.765491 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e69706e6-14eb-435a-9094-750ea92901a1 req-fb39b2e5-27ce-4453-9c5d-0da49d4d4975 service neutron] 10.222.0.31 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1863520 Dec 09 21:19:03.767512 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1a7c9be-2541-43ad-8274-8fa8497a3517 req-e2b03c68-da0d-4355-b238-862319e06ced tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1427391 Dec 09 21:19:03.823146 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e4a93499-3d1c-4a78-aa6b-ce62d4a3e750 x-openstack-request-id: req-e4a93499-3d1c-4a78-aa6b-ce62d4a3e750 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:03.823458 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a40f9b82-e796-4cd4-b12e-cd2089ff7c19", "name": "network-vif-deleted", "tag": "0dc8dc0a-1841-4d79-82ba-8d7ab787a13a", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:03.823717 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e4a93499-3d1c-4a78-aa6b-ce62d4a3e750 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:03.824514 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a40f9b82-e796-4cd4-b12e-cd2089ff7c19', 'name': 'network-vif-deleted', 'tag': '0dc8dc0a-1841-4d79-82ba-8d7ab787a13a', 'status': 'completed', 'code': 200} Dec 09 21:19:03.878824 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-4c42fd29-9ea5-4482-89e0-98a5373a7353 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.216 HTTP/1.1" status: 200 len: 1002 time: 0.1240511 Dec 09 21:19:03.890485 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-2b6330fd-1a83-4b22-9415-fb34ace4c5e0 service neutron] 10.222.0.31 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0909975 Dec 09 21:19:03.894356 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-282bca67-023a-4b20-992a-04033178c87b req-49cd8143-0836-4a9d-9f59-dbf25bf12463 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:03.895778 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-282bca67-023a-4b20-992a-04033178c87b req-49cd8143-0836-4a9d-9f59-dbf25bf12463 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0882740 Dec 09 21:19:03.898700 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-89bb537a-24a9-437a-90a0-40b32e21fa7a tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Request body: {'floatingip': {'port_id': None}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:03.958190 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-359eefbd-64d3-4f9a-9cb9-15668ab35b18 req-b603b7f1-d5f4-4977-9123-574a5f440400 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 210 time: 0.0850589 Dec 09 21:19:03.996317 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9f5a1060-f28b-45f2-8a82-7f38c94f3f8f req-8f1a33ec-c701-4a65-95e3-8842540f02b4 service neutron] 10.222.0.31 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0900488 Dec 09 21:19:04.008054 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-89bb537a-24a9-437a-90a0-40b32e21fa7a tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks [] for floatingip, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:04.011909 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1cc3b771-7d24-4dfa-bbfe-6e007094c74b details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:19:04.054600 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-282bca67-023a-4b20-992a-04033178c87b req-8908f416-5ad5-4a64-bfac-1cde0e181596 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:04.056171 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-282bca67-023a-4b20-992a-04033178c87b req-8908f416-5ad5-4a64-bfac-1cde0e181596 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1393132 Dec 09 21:19:04.116517 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1cc3b771-7d24-4dfa-bbfe-6e007094c74b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:04.128197 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '1cc3b771-7d24-4dfa-bbfe-6e007094c74b', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '1cc3b771-7d24-4dfa-bbfe-6e007094c74b', 'mac_address': 'fa:16:3e:33:8a:7c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.203'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:19:04.171778 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:04.184606 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 1cc3b771-7d24-4dfa-bbfe-6e007094c74b {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:19:04.204190 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1cc3b771-7d24-4dfa-bbfe-6e007094c74b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:04.209585 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:04.216696 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:19:04.257594 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=1cc3b771-7d24-4dfa-bbfe-6e007094c74b,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:04.265184 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f4a5542-e74a-4a57-9a26-b0f535ba8a0d req-ae385112-39b3-4929-91dc-ad6008e6e8d5 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:04.267941 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f4a5542-e74a-4a57-9a26-b0f535ba8a0d req-ae385112-39b3-4929-91dc-ad6008e6e8d5 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/ports?device_id=7c63014a-f387-496c-bd49-f1ae415a0bba HTTP/1.1" status: 200 len: 946 time: 0.2157423 Dec 09 21:19:04.274655 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-89bb537a-24a9-437a-90a0-40b32e21fa7a tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:04.291741 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-89bb537a-24a9-437a-90a0-40b32e21fa7a tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:04.292078 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-89bb537a-24a9-437a-90a0-40b32e21fa7a tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Floating IP 3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5 disassociated. External IP: 172.25.3.216, port: d0cf802e-891b-41ee-8585-48a361e5265d. Dec 09 21:19:04.337575 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-282bca67-023a-4b20-992a-04033178c87b req-cb8b4c43-f773-4223-8086-6c4e510a747e service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2712672 Dec 09 21:19:04.420814 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f4a5542-e74a-4a57-9a26-b0f535ba8a0d req-93997d22-3d19-419e-a504-5b18ab686692 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/security-groups?id=afb99149-6cda-47e0-9a86-3163c9902e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1403992 Dec 09 21:19:04.491885 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['1cc3b771-7d24-4dfa-bbfe-6e007094c74b'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:19:04.513431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7c63014a-f387-496c-bd49-f1ae415a0bba', 'tag': '2dae91d7-35c0-4f49-bedd-e9ae0003a027'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:04.515717 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f79644de-7328-4f15-98bb-1d515199df71" -d '{"events": [{"name": "network-changed", "server_uuid": "7c63014a-f387-496c-bd49-f1ae415a0bba", "tag": "2dae91d7-35c0-4f49-bedd-e9ae0003a027"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:04.635589 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-282bca67-023a-4b20-992a-04033178c87b req-272c45b3-521c-48aa-9ac5-1ff2a92ffabe service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2881680 Dec 09 21:19:04.675582 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-c5877658-6a86-4478-aef4-257671e3d4d0 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:04.677025 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-c5877658-6a86-4478-aef4-257671e3d4d0 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.10 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 807 time: 0.2413020 Dec 09 21:19:04.714972 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-b2b624aa-278a-4ee7-a8ce-30638efdbdf3 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Request body: {'port': {'device_id': '9f03f0c3-a9b7-47c8-84b7-e9329ceed834', 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef', 'admin_state_up': True, 'tenant_id': 'ac5b7cefd8cc48cc83f38d3923aae132'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:04.765927 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d2c5dec-18a4-4cba-a04c-de9aafa3917c req-fc705d82-0a32-45fb-9084-daa90d46ae45 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:04.767347 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d2c5dec-18a4-4cba-a04c-de9aafa3917c req-fc705d82-0a32-45fb-9084-daa90d46ae45 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 943 time: 0.1543915 Dec 09 21:19:04.819685 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-89bb537a-24a9-437a-90a0-40b32e21fa7a tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Router 70ade903-ee3e-4040-8855-b2a937f2a0d9 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:19:04.882210 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d2c5dec-18a4-4cba-a04c-de9aafa3917c req-5613f68e-255d-48ac-9eaf-078ebdb66590 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1066182 Dec 09 21:19:04.941260 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-b2b624aa-278a-4ee7-a8ce-30638efdbdf3 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Made reservation on behalf of ac5b7cefd8cc48cc83f38d3923aae132 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:19:04.944961 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-b2b624aa-278a-4ee7-a8ce-30638efdbdf3 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:05.303528 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-89bb537a-24a9-437a-90a0-40b32e21fa7a tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:19:05.310308 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-89bb537a-24a9-437a-90a0-40b32e21fa7a tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:05.314523 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bca99fd8-cd7e-429b-981d-adbfa523c2bd None None] Sync routers for ids ['70ade903-ee3e-4040-8855-b2a937f2a0d9'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:19:05.325768 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bca99fd8-cd7e-429b-981d-adbfa523c2bd None None] Routers {'70ade903-ee3e-4040-8855-b2a937f2a0d9'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:19:05.326400 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-bca99fd8-cd7e-429b-981d-adbfa523c2bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:18:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['70ade903-ee3e-4040-8855-b2a937f2a0d9'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:05.365163 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22a54efc-8055-4780-81f6-ec94ba886246 req-e41fd659-639d-46ae-a355-361b68678885 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:05.366625 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22a54efc-8055-4780-81f6-ec94ba886246 req-e41fd659-639d-46ae-a355-361b68678885 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 949 time: 0.1493757 Dec 09 21:19:05.370098 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-89bb537a-24a9-437a-90a0-40b32e21fa7a tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "PUT /v2.0/floatingips/3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5 HTTP/1.1" status: 200 len: 695 time: 1.4785237 Dec 09 21:19:05.434803 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-bca99fd8-cd7e-429b-981d-adbfa523c2bd None None] Set router 70ade903-ee3e-4040-8855-b2a937f2a0d9 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:19:05.469912 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-b2b624aa-278a-4ee7-a8ce-30638efdbdf3 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Allocated IP 172.20.0.5 (04fa749a-9f72-4a2c-a725-feab917f99ef/eae2438b-9fcc-44ef-a172-6c4911cad13f/cb941377-5fe0-4e9e-9ac5-1fb6253c78d7) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:19:05.488766 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22a54efc-8055-4780-81f6-ec94ba886246 req-46d87274-1842-440b-a437-8972511fd702 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1142542 Dec 09 21:19:05.492541 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-84c4bd6b-45df-400d-85ad-daeffc4788b0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:05.497772 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-6d27bb77-d070-46dc-95bd-9ab2fb6dc5ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:05.499269 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-6d27bb77-d070-46dc-95bd-9ab2fb6dc5ac service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=920e0419877f4239b048e126682274e9&device_id=3d45a57e-5f03-4541-88f7-1194f195f63e HTTP/1.1" status: 200 len: 1098 time: 0.1018226 Dec 09 21:19:05.597121 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-93b6a792-29cf-4609-86c1-b05d9028decc x-openstack-request-id: req-93b6a792-29cf-4609-86c1-b05d9028decc {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:05.597388 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7c63014a-f387-496c-bd49-f1ae415a0bba", "tag": "2dae91d7-35c0-4f49-bedd-e9ae0003a027", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:05.597775 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-93b6a792-29cf-4609-86c1-b05d9028decc {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:05.598251 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7c63014a-f387-496c-bd49-f1ae415a0bba', 'tag': '2dae91d7-35c0-4f49-bedd-e9ae0003a027', 'status': 'completed', 'code': 200} Dec 09 21:19:05.671054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-bca99fd8-cd7e-429b-981d-adbfa523c2bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:18:03Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '72070289-8347-44bd-bfb9-9510e94eb5bd', 'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'tenant_id': '920e0419877f4239b048e126682274e9', 'mac_address': 'fa:16:3e:c3:24:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 264, 'fixed_ips': [{'subnet_id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:18:00Z', 'updated_at': '2021-12-09T21:18:09Z', 'revision_number': 5, 'project_id': '920e0419877f4239b048e126682274e9', 'subnets': [{'id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:05.697427 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bca99fd8-cd7e-429b-981d-adbfa523c2bd None None] Checking router: 70ade903-ee3e-4040-8855-b2a937f2a0d9 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:19:05.705769 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bca99fd8-cd7e-429b-981d-adbfa523c2bd None None] Routers {'70ade903-ee3e-4040-8855-b2a937f2a0d9'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:19:05.706373 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-bca99fd8-cd7e-429b-981d-adbfa523c2bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:19:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['70ade903-ee3e-4040-8855-b2a937f2a0d9'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:05.739701 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-bb21b376-9070-4bff-a3c2-c81992b434db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:05.741182 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-bb21b376-9070-4bff-a3c2-c81992b434db service neutron] 10.222.0.13 "GET /v2.0/networks?id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 HTTP/1.1" status: 200 len: 922 time: 0.2334607 Dec 09 21:19:05.801232 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f79644de-7328-4f15-98bb-1d515199df71 req-2104ff17-d2b3-4a71-b897-7e6785a58a6b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:05.802694 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f79644de-7328-4f15-98bb-1d515199df71 req-2104ff17-d2b3-4a71-b897-7e6785a58a6b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d035bde1be0e46a6977e6cc6f45495c7&device_id=7c63014a-f387-496c-bd49-f1ae415a0bba HTTP/1.1" status: 200 len: 1098 time: 0.1866271 Dec 09 21:19:05.809107 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-5eaf178a-fb64-47ff-b22a-695d5a6fe2c0 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=d0cf802e-891b-41ee-8585-48a361e5265d HTTP/1.1" status: 200 len: 217 time: 0.0577540 Dec 09 21:19:05.813032 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-bca99fd8-cd7e-429b-981d-adbfa523c2bd None None] Set router 70ade903-ee3e-4040-8855-b2a937f2a0d9 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:19:05.825605 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd0cb5c61-bab4-4b8b-aa1e-0efbe9992f42', 'tag': '2ba5fd1c-0009-4970-b169-7f8dca923e34'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:05.828558 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e90ed137-9765-469a-a24c-f1e76bf1a2d4" -d '{"events": [{"name": "network-changed", "server_uuid": "d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42", "tag": "2ba5fd1c-0009-4970-b169-7f8dca923e34"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:05.867416 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-b2b624aa-278a-4ee7-a8ce-30638efdbdf3 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:05.880369 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40ee35ae-e261-48d0-a502-ef59d15a9c93 req-e9e3e0b5-fc8e-4292-ab83-90d5c5f39b12 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:05.881869 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-40ee35ae-e261-48d0-a502-ef59d15a9c93 req-e9e3e0b5-fc8e-4292-ab83-90d5c5f39b12 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 950 time: 0.2249019 Dec 09 21:19:05.980833 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-4762e7ab-b40b-4db9-b239-78350e946886 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:05.982215 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-4762e7ab-b40b-4db9-b239-78350e946886 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=3260fc19-8e10-46a2-82c6-3b2d5eda4a0e HTTP/1.1" status: 200 len: 860 time: 0.1631575 Dec 09 21:19:06.011105 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:19:06.039111 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1cc3b771-7d24-4dfa-bbfe-6e007094c74b up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:19:06.039370 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f79644de-7328-4f15-98bb-1d515199df71 req-c1a008c9-0037-4d8c-8a8d-b4d5edf72c49 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:06.040638 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f79644de-7328-4f15-98bb-1d515199df71 req-c1a008c9-0037-4d8c-8a8d-b4d5edf72c49 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.2273161 Dec 09 21:19:06.042147 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-bca99fd8-cd7e-429b-981d-adbfa523c2bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:18:03Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '72070289-8347-44bd-bfb9-9510e94eb5bd', 'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'tenant_id': '920e0419877f4239b048e126682274e9', 'mac_address': 'fa:16:3e:c3:24:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 264, 'fixed_ips': [{'subnet_id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:18:00Z', 'updated_at': '2021-12-09T21:18:09Z', 'revision_number': 5, 'project_id': '920e0419877f4239b048e126682274e9', 'subnets': [{'id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:06.043952 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-40ee35ae-e261-48d0-a502-ef59d15a9c93 req-4a533bd1-78d4-41ef-91dd-18c867400bbf tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1484728 Dec 09 21:19:06.044991 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:19:06.045326 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 0dc8dc0a-1841-4d79-82ba-8d7ab787a13a not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:19:06.050812 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-b2b624aa-278a-4ee7-a8ce-30638efdbdf3 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:06.093795 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bca99fd8-cd7e-429b-981d-adbfa523c2bd None None] The sync data for ids ['70ade903-ee3e-4040-8855-b2a937f2a0d9'] in n-d-713301-27 is: [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:18:03Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '72070289-8347-44bd-bfb9-9510e94eb5bd', 'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'tenant_id': '920e0419877f4239b048e126682274e9', 'mac_address': 'fa:16:3e:c3:24:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 264, 'fixed_ips': [{'subnet_id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:18:00Z', 'updated_at': '2021-12-09T21:18:09Z', 'revision_number': 5, 'project_id': '920e0419877f4239b048e126682274e9', 'subnets': [{'id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:19:06.121411 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:06.121934 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:06.143684 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f79644de-7328-4f15-98bb-1d515199df71 req-cc51577c-d043-4a6b-8b84-8c75499bd1ce service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.4&port_id=2dae91d7-35c0-4f49-bedd-e9ae0003a027 HTTP/1.1" status: 200 len: 217 time: 0.0901253 Dec 09 21:19:06.152511 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-2458d1a8-1009-4b90-b9af-8f1e9a0d7260 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:06.154404 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-2458d1a8-1009-4b90-b9af-8f1e9a0d7260 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1616411 Dec 09 21:19:06.171611 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-b2b624aa-278a-4ee7-a8ce-30638efdbdf3 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Network 04fa749a-9f72-4a2c-a725-feab917f99ef is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:19:06.195593 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-b2b624aa-278a-4ee7-a8ce-30638efdbdf3 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:19:06.218617 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-b2b624aa-278a-4ee7-a8ce-30638efdbdf3 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:19:06.221227 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2b624aa-278a-4ee7-a8ce-30638efdbdf3 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Pushing event updated for resources: {'Port': ['ID=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:06.335341 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f79644de-7328-4f15-98bb-1d515199df71 req-18ce3d76-38e8-4ab1-b26e-dd1cf16e52ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:06.336883 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f79644de-7328-4f15-98bb-1d515199df71 req-18ce3d76-38e8-4ab1-b26e-dd1cf16e52ba service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1797774 Dec 09 21:19:06.342622 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:06.348733 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eae189d6-db1f-47c0-a64a-21f2fa99c4ee req-efe03764-1a96-4b7f-b908-7a55a3892d53 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:06.350280 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eae189d6-db1f-47c0-a64a-21f2fa99c4ee req-efe03764-1a96-4b7f-b908-7a55a3892d53 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 931 time: 0.2276542 Dec 09 21:19:06.365995 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '51e11d39-964b-458f-b5dc-fb020eb2c5f5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1cc3b771-7d24-4dfa-bbfe-6e007094c74b'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:06.367103 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-b2b624aa-278a-4ee7-a8ce-30638efdbdf3 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:06.367761 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-b2b624aa-278a-4ee7-a8ce-30638efdbdf3 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:06.368270 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4e74f96f-6344-4bc5-8607-bca386c64cc1" -d '{"events": [{"server_uuid": "51e11d39-964b-458f-b5dc-fb020eb2c5f5", "name": "network-vif-plugged", "status": "completed", "tag": "1cc3b771-7d24-4dfa-bbfe-6e007094c74b"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:06.382314 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1cc3b771-7d24-4dfa-bbfe-6e007094c74b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:06.385629 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74259510-fed7-4108-93c7-5aba73c3e212 None None] New status for floating IP 3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5: DOWN {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:19:06.387546 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:06.433642 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-b2b624aa-278a-4ee7-a8ce-30638efdbdf3 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.7225382 Dec 09 21:19:06.436650 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-077fc186-5aa1-46e7-aee9-fd087fecd0d5 service neutron] 10.222.0.13 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2571926 Dec 09 21:19:06.437388 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=1cc3b771-7d24-4dfa-bbfe-6e007094c74b,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:06.461245 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-47dcd7e1-7079-431d-ade1-10fb0102ffac service neutron] Request body: {'port': {'device_id': '9f03f0c3-a9b7-47c8-84b7-e9329ceed834', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:06.468069 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:06.504034 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f79644de-7328-4f15-98bb-1d515199df71 req-01c8c82b-ea13-4b8f-bae6-9c1ff2e019c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:06.505447 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f79644de-7328-4f15-98bb-1d515199df71 req-01c8c82b-ea13-4b8f-bae6-9c1ff2e019c0 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1523557 Dec 09 21:19:06.514385 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eae189d6-db1f-47c0-a64a-21f2fa99c4ee req-1f695605-ca2f-42c3-889b-cafed849fab7 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1439927 Dec 09 21:19:06.672848 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-47dcd7e1-7079-431d-ade1-10fb0102ffac service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:06.707308 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9df0aff2-4e23-4ef7-bf8a-3de60ea492a1 req-43651e66-7456-403e-93f9-48d0285be50b service neutron] 10.222.0.13 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2560310 Dec 09 21:19:06.760454 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6eaf1f54-4ad2-4dc7-9bd0-352f6d332a24 req-83157361-edf0-40cc-b389-d9ea63f490ce tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:06.761894 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6eaf1f54-4ad2-4dc7-9bd0-352f6d332a24 req-83157361-edf0-40cc-b389-d9ea63f490ce tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/ports?device_id=7c63014a-f387-496c-bd49-f1ae415a0bba HTTP/1.1" status: 200 len: 946 time: 0.1659169 Dec 09 21:19:06.763807 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f79644de-7328-4f15-98bb-1d515199df71 req-3f94d9d9-1b2c-4a8b-8a3f-5b60bfbbfe8c service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2472050 Dec 09 21:19:06.878438 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c76a16e2-af6a-44a9-87d4-d6c928999ce2 x-openstack-request-id: req-c76a16e2-af6a-44a9-87d4-d6c928999ce2 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:06.878958 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42", "tag": "2ba5fd1c-0009-4970-b169-7f8dca923e34", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:06.878958 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c76a16e2-af6a-44a9-87d4-d6c928999ce2 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:06.879348 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd0cb5c61-bab4-4b8b-aa1e-0efbe9992f42', 'tag': '2ba5fd1c-0009-4970-b169-7f8dca923e34', 'status': 'completed', 'code': 200} Dec 09 21:19:06.971174 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e90ed137-9765-469a-a24c-f1e76bf1a2d4 req-d90aa51a-b7a7-4ac1-9d77-ec909a175404 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:06.972986 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e90ed137-9765-469a-a24c-f1e76bf1a2d4 req-d90aa51a-b7a7-4ac1-9d77-ec909a175404 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 1095 time: 0.0548909 Dec 09 21:19:06.973637 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6eaf1f54-4ad2-4dc7-9bd0-352f6d332a24 req-7fddb03f-85c3-4df6-9319-9ef28bc1becb tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/security-groups?id=afb99149-6cda-47e0-9a86-3163c9902e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2024724 Dec 09 21:19:07.032424 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f79644de-7328-4f15-98bb-1d515199df71 req-ae76d5ac-9402-4651-896a-526e9de3b663 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2535408 Dec 09 21:19:07.033813 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-738da04b-2860-45e2-9e84-a3b0478ed869 x-openstack-request-id: req-738da04b-2860-45e2-9e84-a3b0478ed869 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:07.034405 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "51e11d39-964b-458f-b5dc-fb020eb2c5f5", "name": "network-vif-plugged", "status": "completed", "tag": "1cc3b771-7d24-4dfa-bbfe-6e007094c74b", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:07.034757 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-738da04b-2860-45e2-9e84-a3b0478ed869 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:07.035266 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '51e11d39-964b-458f-b5dc-fb020eb2c5f5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1cc3b771-7d24-4dfa-bbfe-6e007094c74b', 'code': 200} Dec 09 21:19:07.084825 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5570df1e-e636-4d0a-b677-86622e4f0316 req-5109dba1-f6af-43e8-a6c6-030c7ec6b9cd tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:07.092716 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5570df1e-e636-4d0a-b677-86622e4f0316 req-5109dba1-f6af-43e8-a6c6-030c7ec6b9cd tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 943 time: 0.1612298 Dec 09 21:19:07.099052 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e90ed137-9765-469a-a24c-f1e76bf1a2d4 req-3076ec01-812a-4cdd-bb49-4ef718fe28d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:07.100550 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e90ed137-9765-469a-a24c-f1e76bf1a2d4 req-3076ec01-812a-4cdd-bb49-4ef718fe28d4 service neutron] 10.222.0.31 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 922 time: 0.1138227 Dec 09 21:19:07.158418 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e90ed137-9765-469a-a24c-f1e76bf1a2d4 req-c2cb3367-4f7c-476f-84a3-ad22fa5828dc service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=2ba5fd1c-0009-4970-b169-7f8dca923e34 HTTP/1.1" status: 200 len: 217 time: 0.0458577 Dec 09 21:19:07.214172 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5570df1e-e636-4d0a-b677-86622e4f0316 req-2c36718d-943d-4c97-a68f-cd9bf5a95708 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1150825 Dec 09 21:19:07.218296 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e90ed137-9765-469a-a24c-f1e76bf1a2d4 req-39b5cf7e-2a59-4fee-a0b8-9cdd5b58b984 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:07.220141 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e90ed137-9765-469a-a24c-f1e76bf1a2d4 req-39b5cf7e-2a59-4fee-a0b8-9cdd5b58b984 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=c49a62cc-af1b-4958-a4a9-eb44188b8fb9 HTTP/1.1" status: 200 len: 861 time: 0.0529239 Dec 09 21:19:07.236109 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27ab55dd-2ce9-4e48-b096-7ab262ee29f8 req-f3bc5c1c-e5eb-4570-aab8-ab8e89d61023 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:07.237528 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27ab55dd-2ce9-4e48-b096-7ab262ee29f8 req-f3bc5c1c-e5eb-4570-aab8-ab8e89d61023 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.1256428 Dec 09 21:19:07.265694 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e90ed137-9765-469a-a24c-f1e76bf1a2d4 req-bf265aac-cff1-4a6c-8845-c3262aedc45f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=93378dc3-2ac5-4cf7-9ce3-d812934de40c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0354536 Dec 09 21:19:07.361462 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ed75cf0-375a-4538-9ba0-362efa15ae83 req-55bf3ac9-4d48-4dd5-b4c6-3c2dd283ab9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:07.362792 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0ed75cf0-375a-4538-9ba0-362efa15ae83 req-55bf3ac9-4d48-4dd5-b4c6-3c2dd283ab9c service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 1102 time: 0.1060424 Dec 09 21:19:07.419786 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e90ed137-9765-469a-a24c-f1e76bf1a2d4 req-cd85e9c4-4420-4c7e-927d-490a6e33e680 service neutron] 10.222.0.31 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1330936 Dec 09 21:19:07.467348 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0ed75cf0-375a-4538-9ba0-362efa15ae83 req-afc643da-407b-44c1-b34e-72d23d3399da service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0931101 Dec 09 21:19:07.576993 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e90ed137-9765-469a-a24c-f1e76bf1a2d4 req-056a9a22-4cca-48d3-b526-a19ba3f20723 service neutron] 10.222.0.31 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1462028 Dec 09 21:19:07.612529 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3d45a57e-5f03-4541-88f7-1194f195f63e', 'tag': 'd0cf802e-891b-41ee-8585-48a361e5265d'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:07.614783 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6de369bb-a38d-4cd6-97bd-f5c239ef36ec" -d '{"events": [{"name": "network-changed", "server_uuid": "3d45a57e-5f03-4541-88f7-1194f195f63e", "tag": "d0cf802e-891b-41ee-8585-48a361e5265d"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:07.635185 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-47dcd7e1-7079-431d-ade1-10fb0102ffac service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:19:07.650659 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-47dcd7e1-7079-431d-ade1-10fb0102ffac service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:07.690554 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aecfc6c-9d86-4a8e-b728-4c0201cb80dc req-bc18fcfa-37b1-4195-bb18-5401d9d488b6 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:07.692107 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1aecfc6c-9d86-4a8e-b728-4c0201cb80dc req-bc18fcfa-37b1-4195-bb18-5401d9d488b6 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 950 time: 0.1105447 Dec 09 21:19:07.708528 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27ab55dd-2ce9-4e48-b096-7ab262ee29f8 req-02fe9da3-2a48-4b8d-b195-55fd55e7bf91 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4598300 Dec 09 21:19:07.710998 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-47dcd7e1-7079-431d-ade1-10fb0102ffac service neutron] Transition to ACTIVE for port object cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:19:07.739739 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-47dcd7e1-7079-431d-ade1-10fb0102ffac service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:07.775190 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56988) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:07.797491 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47dcd7e1-7079-431d-ade1-10fb0102ffac service neutron] Pushing event updated for resources: {'Port': ['ID=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:07.822349 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:07.869597 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1aecfc6c-9d86-4a8e-b728-4c0201cb80dc req-b5e66921-5447-4c42-bed0-2d09da3428df tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1599505 Dec 09 21:19:07.939920 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d382c4cb-c9c5-46b8-9062-4df3ed666944 req-bbba5a03-b996-416b-86c0-8c01bc33d4c4 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:07.941471 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d382c4cb-c9c5-46b8-9062-4df3ed666944 req-bbba5a03-b996-416b-86c0-8c01bc33d4c4 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=17188b52-f615-49ca-8709-a3c9238c02fa&device_owner=compute%3Anova HTTP/1.1" status: 200 len: 945 time: 0.1366158 Dec 09 21:19:07.954895 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-36656395-2fcd-4e61-af0f-ae33a6adc77a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=10c237cbfa28423ea2d1df15f60193f2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1779768 Dec 09 21:19:07.957036 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56994) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:08.006898 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ebc529eb-5c15-4ea8-a374-ee9e69545b31 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:08.010004 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 2ba5fd1c-0009-4970-b169-7f8dca923e34 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:19:08.030097 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d382c4cb-c9c5-46b8-9062-4df3ed666944 req-51ac8fe3-90cf-4f59-b1d9-f98ea563eb97 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.216 HTTP/1.1" status: 200 len: 696 time: 0.0735233 Dec 09 21:19:08.033953 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ebc529eb-5c15-4ea8-a374-ee9e69545b31 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:08.051556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-d382c4cb-c9c5-46b8-9062-4df3ed666944 req-90987765-c7d5-42e3-b24e-294baed650c7 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Request body: {'floatingip': {'port_id': 'b615e863-071a-473e-8d66-8f84f78d1453', 'fixed_ip_address': '172.20.0.4'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:08.088562 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-47dcd7e1-7079-431d-ade1-10fb0102ffac service neutron] Attempting to bind port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:19:08.088912 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-47dcd7e1-7079-431d-ade1-10fb0102ffac service neutron] Attempting to bind port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:19:08.089249 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-47dcd7e1-7079-431d-ade1-10fb0102ffac service neutron] Attempting to bind port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:08.089719 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ebc529eb-5c15-4ea8-a374-ee9e69545b31 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:08.092830 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ebc529eb-5c15-4ea8-a374-ee9e69545b31 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:08.094103 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ebc529eb-5c15-4ea8-a374-ee9e69545b31 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/3997e1dc-b863-4862-a321-fb463bb4bb43 HTTP/1.1" status: 204 len: 168 time: 0.1359787 Dec 09 21:19:08.103332 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebc529eb-5c15-4ea8-a374-ee9e69545b31 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3997e1dc-b863-4862-a321-fb463bb4bb43,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:08.116662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5eade21-a735-4df6-b5da-f3af84ac3a6e req-ae97081d-84a3-40c9-b235-53453f4eedf0 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:08.117799 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 2ba5fd1c-0009-4970-b169-7f8dca923e34, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2ba5fd1c-0009-4970-b169-7f8dca923e34,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:08.118757 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c5eade21-a735-4df6-b5da-f3af84ac3a6e req-ae97081d-84a3-40c9-b235-53453f4eedf0 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 943 time: 0.1762652 Dec 09 21:19:08.122399 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d382c4cb-c9c5-46b8-9062-4df3ed666944 req-90987765-c7d5-42e3-b24e-294baed650c7 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks [] for floatingip, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:08.125661 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-47dcd7e1-7079-431d-ade1-10fb0102ffac service neutron] Port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 on network 04fa749a-9f72-4a2c-a725-feab917f99ef not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:19:08.125992 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-47dcd7e1-7079-431d-ade1-10fb0102ffac service neutron] Attempting to bind port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:08.139704 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '2ba5fd1c-0009-4970-b169-7f8dca923e34', 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c', 'port_id': '2ba5fd1c-0009-4970-b169-7f8dca923e34', 'mac_address': 'fa:16:3e:01:1f:b9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 100, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c49a62cc-af1b-4958-a4a9-eb44188b8fb9', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:19:08.190768 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:08.196221 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-47dcd7e1-7079-431d-ade1-10fb0102ffac service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 18, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:19:08.196221 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-47dcd7e1-7079-431d-ade1-10fb0102ffac service neutron] Checking segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:19:08.196571 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-47dcd7e1-7079-431d-ade1-10fb0102ffac service neutron] Bound using segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:19:08.197024 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-47dcd7e1-7079-431d-ade1-10fb0102ffac service neutron] Bound port: cb941377-5fe0-4e9e-9ac5-1fb6253c78d7, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:19:08.197383 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-47dcd7e1-7079-431d-ade1-10fb0102ffac service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:08.211965 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2ba5fd1c-0009-4970-b169-7f8dca923e34 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:19:08.237786 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 2ba5fd1c-0009-4970-b169-7f8dca923e34, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2ba5fd1c-0009-4970-b169-7f8dca923e34,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:08.242447 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:08.243116 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 2dae91d7-35c0-4f49-bedd-e9ae0003a027 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:19:08.316331 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c5eade21-a735-4df6-b5da-f3af84ac3a6e req-64d91499-0ae8-4506-99cd-903f9686ce4a tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1537907 Dec 09 21:19:08.323350 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=2ba5fd1c-0009-4970-b169-7f8dca923e34,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:08.391411 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-47dcd7e1-7079-431d-ade1-10fb0102ffac service neutron] For port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:08.396391 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7e08636a-9b40-4220-9249-31139b3d1bea x-openstack-request-id: req-7e08636a-9b40-4220-9249-31139b3d1bea {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:08.396391 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3d45a57e-5f03-4541-88f7-1194f195f63e", "tag": "d0cf802e-891b-41ee-8585-48a361e5265d", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:08.396692 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-7e08636a-9b40-4220-9249-31139b3d1bea {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:08.396955 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3d45a57e-5f03-4541-88f7-1194f195f63e', 'tag': 'd0cf802e-891b-41ee-8585-48a361e5265d', 'status': 'completed', 'code': 200} Dec 09 21:19:08.404868 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 2dae91d7-35c0-4f49-bedd-e9ae0003a027, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2dae91d7-35c0-4f49-bedd-e9ae0003a027,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:08.420329 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '2dae91d7-35c0-4f49-bedd-e9ae0003a027', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '2dae91d7-35c0-4f49-bedd-e9ae0003a027', 'mac_address': 'fa:16:3e:81:dd:7f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:19:08.444640 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-47dcd7e1-7079-431d-ade1-10fb0102ffac service neutron] For port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:19:08.454654 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-47dcd7e1-7079-431d-ade1-10fb0102ffac service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:08.474920 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:08.491686 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2dae91d7-35c0-4f49-bedd-e9ae0003a027 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:19:08.507787 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6de369bb-a38d-4cd6-97bd-f5c239ef36ec req-16e25f8a-b6dc-4fa0-a10c-d1244406ad19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:08.512931 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6de369bb-a38d-4cd6-97bd-f5c239ef36ec req-16e25f8a-b6dc-4fa0-a10c-d1244406ad19 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=920e0419877f4239b048e126682274e9&device_id=3d45a57e-5f03-4541-88f7-1194f195f63e HTTP/1.1" status: 200 len: 1098 time: 0.0819235 Dec 09 21:19:08.515069 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57004) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:08.515307 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 2dae91d7-35c0-4f49-bedd-e9ae0003a027, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2dae91d7-35c0-4f49-bedd-e9ae0003a027,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:08.517700 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47dcd7e1-7079-431d-ade1-10fb0102ffac service neutron] Pushing event updated for resources: {'Port': ['ID=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:08.521359 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:08.555851 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-08b07c2f-bb1d-462a-8f3f-75762c300f81 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:08.582831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-47dcd7e1-7079-431d-ade1-10fb0102ffac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:08.583398 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-47dcd7e1-7079-431d-ade1-10fb0102ffac service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:08.584791 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-47dcd7e1-7079-431d-ade1-10fb0102ffac service neutron] 10.222.0.10 "PUT /v2.0/ports/cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 HTTP/1.1" status: 200 len: 1092 time: 2.1355345 Dec 09 21:19:08.587717 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=2dae91d7-35c0-4f49-bedd-e9ae0003a027,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:08.687714 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6de369bb-a38d-4cd6-97bd-f5c239ef36ec req-8490d051-512a-4ec7-9254-1e1e21349c6a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:08.689544 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6de369bb-a38d-4cd6-97bd-f5c239ef36ec req-8490d051-512a-4ec7-9254-1e1e21349c6a service neutron] 10.222.0.31 "GET /v2.0/networks?id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 HTTP/1.1" status: 200 len: 922 time: 0.1502397 Dec 09 21:19:08.745734 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78105345-6468-421d-9b49-20af44a493ad req-35dea7ed-32ba-4ec6-b3fe-390ce7a27bd8 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:08.747258 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78105345-6468-421d-9b49-20af44a493ad req-35dea7ed-32ba-4ec6-b3fe-390ce7a27bd8 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/ports?device_id=7c63014a-f387-496c-bd49-f1ae415a0bba HTTP/1.1" status: 200 len: 947 time: 0.1696203 Dec 09 21:19:08.762057 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6de369bb-a38d-4cd6-97bd-f5c239ef36ec req-6439b569-99a6-4b1c-8c85-6d3d8075ac46 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=d0cf802e-891b-41ee-8585-48a361e5265d HTTP/1.1" status: 200 len: 217 time: 0.0605590 Dec 09 21:19:08.772484 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-08b07c2f-bb1d-462a-8f3f-75762c300f81 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:08.781808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-f6e8ec75-9c06-468a-af2d-c6c5dcbb524d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:08.784233 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-f6e8ec75-9c06-468a-af2d-c6c5dcbb524d service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 1095 time: 0.1319027 Dec 09 21:19:08.806494 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-08b07c2f-bb1d-462a-8f3f-75762c300f81 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:08.860876 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6de369bb-a38d-4cd6-97bd-f5c239ef36ec req-7032d872-f120-499f-b8a4-16b2730478bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:08.862559 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6de369bb-a38d-4cd6-97bd-f5c239ef36ec req-7032d872-f120-499f-b8a4-16b2730478bd service neutron] 10.222.0.31 "GET /v2.0/subnets?id=3260fc19-8e10-46a2-82c6-3b2d5eda4a0e HTTP/1.1" status: 200 len: 860 time: 0.0887980 Dec 09 21:19:08.868322 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-2fddd653-1c27-41f5-96fd-529f31e85681 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 HTTP/1.1" status: 200 len: 217 time: 0.0725889 Dec 09 21:19:08.868915 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-08b07c2f-bb1d-462a-8f3f-75762c300f81 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ecdfb2ca4b9943248243f945eaab81b7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3527019 Dec 09 21:19:08.870984 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08b07c2f-bb1d-462a-8f3f-75762c300f81 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8432b4fe-51d1-4b04-9c20-b36de2e18919,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:08.877500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57008) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:08.879699 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['2ba5fd1c-0009-4970-b169-7f8dca923e34'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:19:08.906524 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78105345-6468-421d-9b49-20af44a493ad req-ebeee904-778f-49d2-98d0-360b79264847 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/security-groups?id=afb99149-6cda-47e0-9a86-3163c9902e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1520982 Dec 09 21:19:08.907338 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['2dae91d7-35c0-4f49-bedd-e9ae0003a027'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:19:08.926368 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.db.resource_extend [req-d382c4cb-c9c5-46b8-9062-4df3ed666944 req-90987765-c7d5-42e3-b24e-294baed650c7 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 09 21:19:08.977683 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6de369bb-a38d-4cd6-97bd-f5c239ef36ec req-b3f26c27-268a-450f-9d73-2280b49d43e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:08.982421 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6de369bb-a38d-4cd6-97bd-f5c239ef36ec req-b3f26c27-268a-450f-9d73-2280b49d43e7 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1085384 Dec 09 21:19:09.010035 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d382c4cb-c9c5-46b8-9062-4df3ed666944 req-90987765-c7d5-42e3-b24e-294baed650c7 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:09.011960 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-1a888bb7-e4ba-4181-991d-f050f638103a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:09.013444 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-1a888bb7-e4ba-4181-991d-f050f638103a service neutron] 10.222.0.10 "GET /v2.0/subnets?id=eae2438b-9fcc-44ef-a172-6c4911cad13f HTTP/1.1" status: 200 len: 847 time: 0.1350741 Dec 09 21:19:09.024525 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d382c4cb-c9c5-46b8-9062-4df3ed666944 req-90987765-c7d5-42e3-b24e-294baed650c7 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:09.104014 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6de369bb-a38d-4cd6-97bd-f5c239ef36ec req-3d7828bf-88a8-4289-933d-2beab7b3e50b service neutron] 10.222.0.31 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1133039 Dec 09 21:19:09.112983 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-2caf7886-e2a1-406f-8fb1-9e492217a562 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=04fa749a-9f72-4a2c-a725-feab917f99ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0842001 Dec 09 21:19:09.122440 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ce5efc95-5e4c-4c55-8d70-79b6c7b64789 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:09.201494 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6de369bb-a38d-4cd6-97bd-f5c239ef36ec req-57126485-5675-4b04-81a9-78e541301645 service neutron] 10.222.0.31 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0887399 Dec 09 21:19:09.239873 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bd9962d-2b5e-4ab5-8701-5cdf7d37718d req-facde308-13b3-4f13-bf84-5f2aded630c5 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:09.241359 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8bd9962d-2b5e-4ab5-8701-5cdf7d37718d req-facde308-13b3-4f13-bf84-5f2aded630c5 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 944 time: 0.2270145 Dec 09 21:19:09.243163 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ce5efc95-5e4c-4c55-8d70-79b6c7b64789 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:09.267242 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:09.353752 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [req-d382c4cb-c9c5-46b8-9062-4df3ed666944 req-90987765-c7d5-42e3-b24e-294baed650c7 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Floating IP 3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5 associated. External IP: 172.25.3.216, port: b615e863-071a-473e-8d66-8f84f78d1453. Dec 09 21:19:09.378873 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02e48eda-bb95-48ed-8af9-c0b0c4d6e918 req-69a1cb89-bf87-4dbf-bbd3-19d9e6e00c0c tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:09.380284 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02e48eda-bb95-48ed-8af9-c0b0c4d6e918 req-69a1cb89-bf87-4dbf-bbd3-19d9e6e00c0c tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.31 "GET /v2.0/ports?device_id=3d45a57e-5f03-4541-88f7-1194f195f63e HTTP/1.1" status: 200 len: 946 time: 0.2540512 Dec 09 21:19:09.474803 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8bd9962d-2b5e-4ab5-8701-5cdf7d37718d req-28d1075c-388f-4518-a870-13d4700593bb tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2197609 Dec 09 21:19:09.482954 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-eed0ca28-a7be-4fcf-9238-f7407f9cde6e service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3364651 Dec 09 21:19:09.487764 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ce5efc95-5e4c-4c55-8d70-79b6c7b64789 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:09.490327 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ce5efc95-5e4c-4c55-8d70-79b6c7b64789 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:09.491419 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ce5efc95-5e4c-4c55-8d70-79b6c7b64789 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/8432b4fe-51d1-4b04-9c20-b36de2e18919 HTTP/1.1" status: 204 len: 168 time: 0.6093457 Dec 09 21:19:09.576478 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce5efc95-5e4c-4c55-8d70-79b6c7b64789 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8432b4fe-51d1-4b04-9c20-b36de2e18919,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:09.980124 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5170d662-135d-4eb5-8f46-afbf1725d5ce req-bd3bc920-f204-40db-a540-73d1e026e2dd tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:09.981602 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5170d662-135d-4eb5-8f46-afbf1725d5ce req-bd3bc920-f204-40db-a540-73d1e026e2dd tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.4183106 Dec 09 21:19:10.016486 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-02e48eda-bb95-48ed-8af9-c0b0c4d6e918 req-1b69490e-039b-4b28-b704-411104246543 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Deleting port d0cf802e-891b-41ee-8585-48a361e5265d {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:19:10.016636 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-02e48eda-bb95-48ed-8af9-c0b0c4d6e918 req-1b69490e-039b-4b28-b704-411104246543 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:10.021050 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-532125f2-770d-4c35-ad96-52abdb9d7a47 req-a6195c7b-913e-458b-bb66-314b510fa322 service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5000763 Dec 09 21:19:10.025557 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 2ba5fd1c-0009-4970-b169-7f8dca923e34 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:19:10.089281 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 2ba5fd1c-0009-4970-b169-7f8dca923e34 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:19:10.093600 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 2ba5fd1c-0009-4970-b169-7f8dca923e34 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:10.093994 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:10.176050 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5170d662-135d-4eb5-8f46-afbf1725d5ce req-298fafc5-19ed-473e-8b2a-105591d077d3 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1784234 Dec 09 21:19:10.196251 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:10.206872 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [req-d382c4cb-c9c5-46b8-9062-4df3ed666944 req-90987765-c7d5-42e3-b24e-294baed650c7 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Router 70ade903-ee3e-4040-8855-b2a937f2a0d9 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:19:10.213406 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-02e48eda-bb95-48ed-8af9-c0b0c4d6e918 req-1b69490e-039b-4b28-b704-411104246543 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] For port d0cf802e-891b-41ee-8585-48a361e5265d, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=d0cf802e-891b-41ee-8585-48a361e5265d,segment=NetworkSegment(c1e3b516-6ad9-46a2-acfa-cf795ad5b916),segment_id=c1e3b516-6ad9-46a2-acfa-cf795ad5b916)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:10.213776 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-02e48eda-bb95-48ed-8af9-c0b0c4d6e918 req-1b69490e-039b-4b28-b704-411104246543 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:10.215640 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd0cb5c61-bab4-4b8b-aa1e-0efbe9992f42', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2ba5fd1c-0009-4970-b169-7f8dca923e34'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:10.218860 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-342c0235-58dd-4ea4-93dd-6743b340883d" -d '{"events": [{"server_uuid": "d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42", "name": "network-vif-plugged", "status": "completed", "tag": "2ba5fd1c-0009-4970-b169-7f8dca923e34"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:10.232432 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-02e48eda-bb95-48ed-8af9-c0b0c4d6e918 req-1b69490e-039b-4b28-b704-411104246543 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Calling delete_port for d0cf802e-891b-41ee-8585-48a361e5265d owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:19:10.239943 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 2ba5fd1c-0009-4970-b169-7f8dca923e34, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2ba5fd1c-0009-4970-b169-7f8dca923e34,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:10.248463 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:10.249606 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 2dae91d7-35c0-4f49-bedd-e9ae0003a027 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:19:10.328695 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=2ba5fd1c-0009-4970-b169-7f8dca923e34,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:10.348030 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 2dae91d7-35c0-4f49-bedd-e9ae0003a027 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:19:10.352608 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 2dae91d7-35c0-4f49-bedd-e9ae0003a027 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:10.352969 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:10.398889 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9f03f0c3-a9b7-47c8-84b7-e9329ceed834', 'tag': 'cb941377-5fe0-4e9e-9ac5-1fb6253c78d7'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:10.401349 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f7702c86-7d49-4497-a9a7-46cd840a0662" -d '{"events": [{"name": "network-changed", "server_uuid": "9f03f0c3-a9b7-47c8-84b7-e9329ceed834", "tag": "cb941377-5fe0-4e9e-9ac5-1fb6253c78d7"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:10.431921 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54c0b428-e151-433a-853e-ba6ef1233b65 req-de4d7932-0ee1-4b91-aa86-9e1d9fabbcbf tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:10.433443 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-54c0b428-e151-433a-853e-ba6ef1233b65 req-de4d7932-0ee1-4b91-aa86-9e1d9fabbcbf tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 950 time: 0.1563158 Dec 09 21:19:10.443304 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:10.456701 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-d382c4cb-c9c5-46b8-9062-4df3ed666944 req-90987765-c7d5-42e3-b24e-294baed650c7 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:19:10.461532 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d382c4cb-c9c5-46b8-9062-4df3ed666944 req-90987765-c7d5-42e3-b24e-294baed650c7 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:10.477969 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68afbeb9-77f4-426a-90c0-9e5c65fb824c None None] Sync routers for ids ['70ade903-ee3e-4040-8855-b2a937f2a0d9'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:19:10.484262 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 2dae91d7-35c0-4f49-bedd-e9ae0003a027, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2dae91d7-35c0-4f49-bedd-e9ae0003a027,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:10.491421 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:10.496769 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68afbeb9-77f4-426a-90c0-9e5c65fb824c None None] Routers {'70ade903-ee3e-4040-8855-b2a937f2a0d9'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:19:10.497510 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-68afbeb9-77f4-426a-90c0-9e5c65fb824c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:19:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['70ade903-ee3e-4040-8855-b2a937f2a0d9'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:10.543035 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d382c4cb-c9c5-46b8-9062-4df3ed666944 req-90987765-c7d5-42e3-b24e-294baed650c7 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "PUT /v2.0/floatingips/3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5 HTTP/1.1" status: 200 len: 996 time: 2.4997606 Dec 09 21:19:10.561399 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-54c0b428-e151-433a-853e-ba6ef1233b65 req-5d06706f-68a8-4b5b-9c48-158e45515e4d tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1154602 Dec 09 21:19:10.615136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=2dae91d7-35c0-4f49-bedd-e9ae0003a027,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:10.617637 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-02e48eda-bb95-48ed-8af9-c0b0c4d6e918 req-1b69490e-039b-4b28-b704-411104246543 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:10.652845 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['b615e863-071a-473e-8d66-8f84f78d1453', 'd0cf802e-891b-41ee-8585-48a361e5265d'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:19:10.662248 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d382c4cb-c9c5-46b8-9062-4df3ed666944 req-ae77029c-3ac8-43a6-9a66-6191d086ddc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:10.663829 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d382c4cb-c9c5-46b8-9062-4df3ed666944 req-ae77029c-3ac8-43a6-9a66-6191d086ddc9 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=920e0419877f4239b048e126682274e9&device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 1097 time: 0.1063764 Dec 09 21:19:10.668738 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b69490e-039b-4b28-b704-411104246543 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Pushing event deleted for resources: {'Port': ['ID=d0cf802e-891b-41ee-8585-48a361e5265d,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:10.718534 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-68afbeb9-77f4-426a-90c0-9e5c65fb824c None None] Set router 70ade903-ee3e-4040-8855-b2a937f2a0d9 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:19:10.764155 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-02e48eda-bb95-48ed-8af9-c0b0c4d6e918 req-1b69490e-039b-4b28-b704-411104246543 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] No DVR routers for this DVR port d0cf802e-891b-41ee-8585-48a361e5265d on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:19:10.776176 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-02e48eda-bb95-48ed-8af9-c0b0c4d6e918 req-1b69490e-039b-4b28-b704-411104246543 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:10.780461 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02e48eda-bb95-48ed-8af9-c0b0c4d6e918 req-1b69490e-039b-4b28-b704-411104246543 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.31 "DELETE /v2.0/ports/d0cf802e-891b-41ee-8585-48a361e5265d HTTP/1.1" status: 204 len: 173 time: 1.3590953 Dec 09 21:19:10.844075 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f68764e7-73ce-485f-b785-631e06623271 req-b575db07-e9ae-423c-b4bd-c61b7d646b21 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:10.845836 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f68764e7-73ce-485f-b785-631e06623271 req-b575db07-e9ae-423c-b4bd-c61b7d646b21 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 943 time: 0.1793740 Dec 09 21:19:10.897139 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d382c4cb-c9c5-46b8-9062-4df3ed666944 req-51014801-c892-4955-950e-254196fd6fa8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:10.905944 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d382c4cb-c9c5-46b8-9062-4df3ed666944 req-51014801-c892-4955-950e-254196fd6fa8 service neutron] 10.222.0.13 "GET /v2.0/networks?id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 HTTP/1.1" status: 200 len: 922 time: 0.2018275 Dec 09 21:19:10.983411 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d382c4cb-c9c5-46b8-9062-4df3ed666944 req-3ce77b34-5e1b-4636-a5f4-4b1958c93b59 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b615e863-071a-473e-8d66-8f84f78d1453 HTTP/1.1" status: 200 len: 999 time: 0.0693808 Dec 09 21:19:11.028909 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f68764e7-73ce-485f-b785-631e06623271 req-e879a116-be73-4d4b-a01e-00aab31e0b80 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1743166 Dec 09 21:19:11.047283 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d382c4cb-c9c5-46b8-9062-4df3ed666944 req-b1dfeaf1-5fcf-46eb-9855-2139e6250a89 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:11.049523 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d382c4cb-c9c5-46b8-9062-4df3ed666944 req-b1dfeaf1-5fcf-46eb-9855-2139e6250a89 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=3260fc19-8e10-46a2-82c6-3b2d5eda4a0e HTTP/1.1" status: 200 len: 860 time: 0.0579414 Dec 09 21:19:11.100282 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d382c4cb-c9c5-46b8-9062-4df3ed666944 req-1552657d-10f9-4fa9-a2ff-e0ee9ec904e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:11.101941 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d382c4cb-c9c5-46b8-9062-4df3ed666944 req-1552657d-10f9-4fa9-a2ff-e0ee9ec904e9 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0417259 Dec 09 21:19:11.163170 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-68afbeb9-77f4-426a-90c0-9e5c65fb824c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:18:03Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5', 'tenant_id': '920e0419877f4239b048e126682274e9', 'floating_ip_address': '172.25.3.216', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'port_id': 'b615e863-071a-473e-8d66-8f84f78d1453', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 376, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'mac_address': 'fa:16:3e:d2:df:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '17188b52-f615-49ca-8709-a3c9238c02fa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:18:31Z', 'updated_at': '2021-12-09T21:19:08Z', 'revision_number': 8, 'project_id': '920e0419877f4239b048e126682274e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '72070289-8347-44bd-bfb9-9510e94eb5bd', 'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'tenant_id': '920e0419877f4239b048e126682274e9', 'mac_address': 'fa:16:3e:c3:24:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 264, 'fixed_ips': [{'subnet_id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:18:00Z', 'updated_at': '2021-12-09T21:18:09Z', 'revision_number': 5, 'project_id': '920e0419877f4239b048e126682274e9', 'subnets': [{'id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:11.189973 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68afbeb9-77f4-426a-90c0-9e5c65fb824c None None] Checking router: 70ade903-ee3e-4040-8855-b2a937f2a0d9 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:19:11.198630 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68afbeb9-77f4-426a-90c0-9e5c65fb824c None None] Routers {'70ade903-ee3e-4040-8855-b2a937f2a0d9'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:19:11.199238 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-68afbeb9-77f4-426a-90c0-9e5c65fb824c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:19:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['70ade903-ee3e-4040-8855-b2a937f2a0d9'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:11.225103 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d382c4cb-c9c5-46b8-9062-4df3ed666944 req-cf70ed8a-b55b-4b21-ae39-631f9c149b1d service neutron] 10.222.0.13 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1159368 Dec 09 21:19:11.265863 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b6652d1-9ad4-4264-b365-250bfcec8381 req-3bc5d26c-ac27-4955-bfef-475a0586d659 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:11.267636 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b6652d1-9ad4-4264-b365-250bfcec8381 req-3bc5d26c-ac27-4955-bfef-475a0586d659 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/ports?device_id=7c63014a-f387-496c-bd49-f1ae415a0bba HTTP/1.1" status: 200 len: 948 time: 0.0861783 Dec 09 21:19:11.311227 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-68afbeb9-77f4-426a-90c0-9e5c65fb824c None None] Set router 70ade903-ee3e-4040-8855-b2a937f2a0d9 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:19:11.367520 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b6652d1-9ad4-4264-b365-250bfcec8381 req-80c56834-3d6a-4291-bf03-b3563e215313 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/security-groups?id=afb99149-6cda-47e0-9a86-3163c9902e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0928342 Dec 09 21:19:11.369569 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d382c4cb-c9c5-46b8-9062-4df3ed666944 req-6738d270-6eac-4f3a-9cea-32c5af3d7b49 service neutron] 10.222.0.13 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1382990 Dec 09 21:19:11.490324 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-806083de-f422-47ef-919f-31de82d57472 x-openstack-request-id: req-806083de-f422-47ef-919f-31de82d57472 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:11.490770 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9f03f0c3-a9b7-47c8-84b7-e9329ceed834", "tag": "cb941377-5fe0-4e9e-9ac5-1fb6253c78d7", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:11.490902 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-806083de-f422-47ef-919f-31de82d57472 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:11.491250 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9f03f0c3-a9b7-47c8-84b7-e9329ceed834', 'tag': 'cb941377-5fe0-4e9e-9ac5-1fb6253c78d7', 'status': 'completed', 'code': 200} Dec 09 21:19:11.510132 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0795a951-2fed-4a59-822d-651d4e161ada req-ed8477c6-b69a-4466-9042-5e743fc9c20b tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:11.511761 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0795a951-2fed-4a59-822d-651d4e161ada req-ed8477c6-b69a-4466-9042-5e743fc9c20b tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.0709107 Dec 09 21:19:11.552339 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c690a9b4-ad57-4cd3-845c-37550764cf99 x-openstack-request-id: req-c690a9b4-ad57-4cd3-845c-37550764cf99 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:11.553191 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42", "name": "network-vif-plugged", "status": "completed", "tag": "2ba5fd1c-0009-4970-b169-7f8dca923e34", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:11.553724 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c690a9b4-ad57-4cd3-845c-37550764cf99 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:11.554951 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd0cb5c61-bab4-4b8b-aa1e-0efbe9992f42', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2ba5fd1c-0009-4970-b169-7f8dca923e34', 'code': 200} Dec 09 21:19:11.654483 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7702c86-7d49-4497-a9a7-46cd840a0662 req-001daaf8-710f-4424-890b-9cedc25be6ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:11.656016 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f7702c86-7d49-4497-a9a7-46cd840a0662 req-001daaf8-710f-4424-890b-9cedc25be6ab service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 1095 time: 0.1330526 Dec 09 21:19:11.660289 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5a0fe8a-4537-4a6d-89ee-dfa042068bf8 req-a3b61ffc-08ce-48a4-9ddd-0fb270b3b0cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:11.661736 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c5a0fe8a-4537-4a6d-89ee-dfa042068bf8 req-a3b61ffc-08ce-48a4-9ddd-0fb270b3b0cf service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 1097 time: 0.1480920 Dec 09 21:19:11.665987 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0795a951-2fed-4a59-822d-651d4e161ada req-ae0337ef-38e2-4fdb-9fe1-6676637776d2 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1419089 Dec 09 21:19:11.709571 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abaf06c7-55b0-43ce-b610-371700361561 req-c43e1987-2bf4-4b83-ab8b-caf5f44166aa tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:11.711100 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-abaf06c7-55b0-43ce-b610-371700361561 req-c43e1987-2bf4-4b83-ab8b-caf5f44166aa tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 945 time: 0.1386962 Dec 09 21:19:11.720404 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-68afbeb9-77f4-426a-90c0-9e5c65fb824c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:18:03Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5', 'tenant_id': '920e0419877f4239b048e126682274e9', 'floating_ip_address': '172.25.3.216', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'port_id': 'b615e863-071a-473e-8d66-8f84f78d1453', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 376, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'mac_address': 'fa:16:3e:d2:df:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '17188b52-f615-49ca-8709-a3c9238c02fa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:18:31Z', 'updated_at': '2021-12-09T21:19:08Z', 'revision_number': 8, 'project_id': '920e0419877f4239b048e126682274e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '72070289-8347-44bd-bfb9-9510e94eb5bd', 'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'tenant_id': '920e0419877f4239b048e126682274e9', 'mac_address': 'fa:16:3e:c3:24:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 264, 'fixed_ips': [{'subnet_id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:18:00Z', 'updated_at': '2021-12-09T21:18:09Z', 'revision_number': 5, 'project_id': '920e0419877f4239b048e126682274e9', 'subnets': [{'id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:11.750735 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68afbeb9-77f4-426a-90c0-9e5c65fb824c None None] The sync data for ids ['70ade903-ee3e-4040-8855-b2a937f2a0d9'] in n-d-713301-27 is: [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:18:03Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5', 'tenant_id': '920e0419877f4239b048e126682274e9', 'floating_ip_address': '172.25.3.216', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'port_id': 'b615e863-071a-473e-8d66-8f84f78d1453', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 376, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'mac_address': 'fa:16:3e:d2:df:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '17188b52-f615-49ca-8709-a3c9238c02fa', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:18:31Z', 'updated_at': '2021-12-09T21:19:08Z', 'revision_number': 8, 'project_id': '920e0419877f4239b048e126682274e9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '72070289-8347-44bd-bfb9-9510e94eb5bd', 'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'tenant_id': '920e0419877f4239b048e126682274e9', 'mac_address': 'fa:16:3e:c3:24:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 264, 'fixed_ips': [{'subnet_id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:18:00Z', 'updated_at': '2021-12-09T21:18:09Z', 'revision_number': 5, 'project_id': '920e0419877f4239b048e126682274e9', 'subnets': [{'id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:19:11.827129 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c5a0fe8a-4537-4a6d-89ee-dfa042068bf8 req-116d0ce0-c193-4acb-8d59-548026b62f69 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1510274 Dec 09 21:19:11.845362 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-abaf06c7-55b0-43ce-b610-371700361561 req-4800d483-fbca-400e-83e1-2b9d0154bd69 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1197217 Dec 09 21:19:11.853275 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7702c86-7d49-4497-a9a7-46cd840a0662 req-32af59f1-b6b6-4cb2-9027-4b01e10ce9b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:11.854760 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f7702c86-7d49-4497-a9a7-46cd840a0662 req-32af59f1-b6b6-4cb2-9027-4b01e10ce9b8 service neutron] 10.222.0.10 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 908 time: 0.1878009 Dec 09 21:19:11.947529 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f7702c86-7d49-4497-a9a7-46cd840a0662 req-4b1b0ab9-28e7-4047-a271-eb4dbfb17e00 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 HTTP/1.1" status: 200 len: 217 time: 0.0828247 Dec 09 21:19:11.967310 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8449d300-976f-4522-9661-4ad07b756bd8 None None] New status for floating IP 3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5: ACTIVE {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:19:12.026564 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ed3be23-4275-46be-9984-65e2b56fc389 req-00c4c46f-0240-4440-8448-ee93fa0553a9 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/floatingips/3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5 HTTP/1.1" status: 200 len: 996 time: 0.1629257 Dec 09 21:19:12.036785 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7702c86-7d49-4497-a9a7-46cd840a0662 req-897b4b21-9046-4bf9-9c39-596cb6debfa2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:12.038179 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f7702c86-7d49-4497-a9a7-46cd840a0662 req-897b4b21-9046-4bf9-9c39-596cb6debfa2 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=eae2438b-9fcc-44ef-a172-6c4911cad13f HTTP/1.1" status: 200 len: 847 time: 0.0708053 Dec 09 21:19:12.067847 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7c18dac-7b1e-4b52-a287-d19ef8c2e894 req-c6ab1f2f-d011-422d-8b9b-818e6b9b7596 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:12.069368 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7c18dac-7b1e-4b52-a287-d19ef8c2e894 req-c6ab1f2f-d011-422d-8b9b-818e6b9b7596 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 950 time: 0.1351793 Dec 09 21:19:12.093561 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f7702c86-7d49-4497-a9a7-46cd840a0662 req-d8f977b9-ffe6-4dd5-8faa-e324b2c3aeec service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=04fa749a-9f72-4a2c-a725-feab917f99ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0438919 Dec 09 21:19:12.249716 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7c18dac-7b1e-4b52-a287-d19ef8c2e894 req-52b94107-9084-4e2b-b362-12fa44ef9c09 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1584687 Dec 09 21:19:12.262737 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ed3be23-4275-46be-9984-65e2b56fc389 req-aeed9c66-5d03-4a4c-83f5-ea38605e05b5 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:12.264251 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ed3be23-4275-46be-9984-65e2b56fc389 req-aeed9c66-5d03-4a4c-83f5-ea38605e05b5 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.2302732 Dec 09 21:19:12.276655 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-8ed3be23-4275-46be-9984-65e2b56fc389 req-39abfd0c-bbfa-48d7-8324-54e49e536c9d tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:19:12.278033 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ed3be23-4275-46be-9984-65e2b56fc389 req-39abfd0c-bbfa-48d7-8324-54e49e536c9d tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0063279 Dec 09 21:19:12.294815 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f7702c86-7d49-4497-a9a7-46cd840a0662 req-298ccf86-1b2f-49f7-a7e7-725787f6edb1 service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1854191 Dec 09 21:19:12.393127 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f7702c86-7d49-4497-a9a7-46cd840a0662 req-ee17d83a-554b-4fbb-9833-479d4ae819cc service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0878284 Dec 09 21:19:12.510624 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40935f97-aa3b-48e5-99d6-11d22a308e20 req-1836df39-428d-42f3-90ad-60737b87b7b4 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:12.512253 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-40935f97-aa3b-48e5-99d6-11d22a308e20 req-1836df39-428d-42f3-90ad-60737b87b7b4 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 943 time: 0.0586915 Dec 09 21:19:12.572086 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-40935f97-aa3b-48e5-99d6-11d22a308e20 req-93f8784b-5174-4af7-b564-a3b05b2a5401 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516214 Dec 09 21:19:12.631745 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-393d470a-d147-4b85-8578-0cd1fb8c6e16 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.216 HTTP/1.1" status: 200 len: 1001 time: 0.0734820 Dec 09 21:19:12.704735 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-41078f7f-d514-461f-83d6-f6153e111b59 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:12.706162 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-41078f7f-d514-461f-83d6-f6153e111b59 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports/b615e863-071a-473e-8d66-8f84f78d1453 HTTP/1.1" status: 200 len: 942 time: 0.0640793 Dec 09 21:19:12.718511 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bafaede-e294-4e77-a6de-0ccbffa90432 req-83f11443-9f90-4a83-af42-b7ec44ec2562 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:12.720019 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8bafaede-e294-4e77-a6de-0ccbffa90432 req-83f11443-9f90-4a83-af42-b7ec44ec2562 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/ports?device_id=7c63014a-f387-496c-bd49-f1ae415a0bba HTTP/1.1" status: 200 len: 948 time: 0.0873485 Dec 09 21:19:12.808528 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8bafaede-e294-4e77-a6de-0ccbffa90432 req-e1d8871a-fd56-46bf-8144-321a031e9538 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/security-groups?id=afb99149-6cda-47e0-9a86-3163c9902e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0820081 Dec 09 21:19:12.835320 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-dcdf936f-158a-4f70-913e-1348937f1b8c tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.216 HTTP/1.1" status: 200 len: 1001 time: 0.0868931 Dec 09 21:19:12.968040 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-d9a20f63-2000-42ee-95a3-120ba793c106 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:12.969411 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-d9a20f63-2000-42ee-95a3-120ba793c106 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.1332746 Dec 09 21:19:12.982040 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f584a94-7653-4a30-93b1-ccb7b88d1394 req-983be421-155d-4e07-86a6-bc71dbf6c5df tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:12.983479 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f584a94-7653-4a30-93b1-ccb7b88d1394 req-983be421-155d-4e07-86a6-bc71dbf6c5df tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.0824723 Dec 09 21:19:13.076074 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-9ca2e4be-08f0-4a8e-90dc-ff12aa20ee65 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.216 HTTP/1.1" status: 200 len: 1001 time: 0.0903628 Dec 09 21:19:13.079245 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f584a94-7653-4a30-93b1-ccb7b88d1394 req-bf144c94-378f-456a-9242-10df425aecb7 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0871804 Dec 09 21:19:13.085924 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-64fb776e-e797-4f7d-86cd-49d40c017e44 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Request body: {'floatingip': {'port_id': None}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:13.150155 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-64fb776e-e797-4f7d-86cd-49d40c017e44 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks [] for floatingip, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:13.283959 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0a0faf8-2541-4dc0-8458-ced0da1631b9 req-778e40a6-ebb6-44aa-85f4-3bafd780a78b tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:13.285424 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0a0faf8-2541-4dc0-8458-ced0da1631b9 req-778e40a6-ebb6-44aa-85f4-3bafd780a78b tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 945 time: 0.1052518 Dec 09 21:19:13.350755 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-64fb776e-e797-4f7d-86cd-49d40c017e44 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:13.364742 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-64fb776e-e797-4f7d-86cd-49d40c017e44 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:13.365279 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-64fb776e-e797-4f7d-86cd-49d40c017e44 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Floating IP 3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5 disassociated. External IP: 172.25.3.216, port: b615e863-071a-473e-8d66-8f84f78d1453. Dec 09 21:19:13.556563 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7c63014a-f387-496c-bd49-f1ae415a0bba', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2dae91d7-35c0-4f49-bedd-e9ae0003a027'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:13.559502 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9bd850e8-e3d9-4501-b526-106c44c200d6" -d '{"events": [{"server_uuid": "7c63014a-f387-496c-bd49-f1ae415a0bba", "name": "network-vif-plugged", "status": "completed", "tag": "2dae91d7-35c0-4f49-bedd-e9ae0003a027"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:13.655827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '17188b52-f615-49ca-8709-a3c9238c02fa', 'tag': 'b615e863-071a-473e-8d66-8f84f78d1453'}, {'server_uuid': '3d45a57e-5f03-4541-88f7-1194f195f63e', 'name': 'network-vif-deleted', 'tag': 'd0cf802e-891b-41ee-8585-48a361e5265d'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:13.658132 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-54fe8869-bf11-4c2d-9d7d-545b91f484a1" -d '{"events": [{"name": "network-changed", "server_uuid": "17188b52-f615-49ca-8709-a3c9238c02fa", "tag": "b615e863-071a-473e-8d66-8f84f78d1453"}, {"server_uuid": "3d45a57e-5f03-4541-88f7-1194f195f63e", "name": "network-vif-deleted", "tag": "d0cf802e-891b-41ee-8585-48a361e5265d"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:13.676856 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0a0faf8-2541-4dc0-8458-ced0da1631b9 req-f9eda5ae-00ab-4150-892e-f7122f4be4c7 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3850210 Dec 09 21:19:13.867916 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3764dbcf-59f9-4151-81ed-4a1de035b98a req-bea62561-bc36-414b-ba04-3a98c2a1cf80 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:13.869369 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3764dbcf-59f9-4151-81ed-4a1de035b98a req-bea62561-bc36-414b-ba04-3a98c2a1cf80 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 950 time: 0.0960279 Dec 09 21:19:13.885072 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-64fb776e-e797-4f7d-86cd-49d40c017e44 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Router 70ade903-ee3e-4040-8855-b2a937f2a0d9 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:19:13.960013 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3764dbcf-59f9-4151-81ed-4a1de035b98a req-8492c906-0340-4c5f-8603-fe4172774d8b tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0838404 Dec 09 21:19:14.019913 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-64fb776e-e797-4f7d-86cd-49d40c017e44 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:19:14.024597 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-64fb776e-e797-4f7d-86cd-49d40c017e44 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:14.030464 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-248cf1c8-fa8c-4cd6-abc1-ba282244c9b4 None None] Sync routers for ids ['70ade903-ee3e-4040-8855-b2a937f2a0d9'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:19:14.042834 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-248cf1c8-fa8c-4cd6-abc1-ba282244c9b4 None None] Routers {'70ade903-ee3e-4040-8855-b2a937f2a0d9'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:19:14.043639 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-248cf1c8-fa8c-4cd6-abc1-ba282244c9b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:19:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['70ade903-ee3e-4040-8855-b2a937f2a0d9'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:14.053535 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-64fb776e-e797-4f7d-86cd-49d40c017e44 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "PUT /v2.0/floatingips/3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5 HTTP/1.1" status: 200 len: 696 time: 0.9714525 Dec 09 21:19:14.090637 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2ca7a074-9f7b-4d72-ae8c-208dd6a54cf6 x-openstack-request-id: req-2ca7a074-9f7b-4d72-ae8c-208dd6a54cf6 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:14.091023 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7c63014a-f387-496c-bd49-f1ae415a0bba", "name": "network-vif-plugged", "status": "completed", "tag": "2dae91d7-35c0-4f49-bedd-e9ae0003a027", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:14.091346 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-2ca7a074-9f7b-4d72-ae8c-208dd6a54cf6 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:14.091835 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7c63014a-f387-496c-bd49-f1ae415a0bba', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2dae91d7-35c0-4f49-bedd-e9ae0003a027', 'code': 200} Dec 09 21:19:14.095170 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:19:14.097785 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device d0cf802e-891b-41ee-8585-48a361e5265d no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:19:14.117492 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-e2cfff17-56cf-4303-a9d8-21ecd8317c5f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:14.119038 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-e2cfff17-56cf-4303-a9d8-21ecd8317c5f service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=920e0419877f4239b048e126682274e9&device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 1097 time: 0.0516860 Dec 09 21:19:14.134223 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: d0cf802e-891b-41ee-8585-48a361e5265d {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:19:14.134571 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device d0cf802e-891b-41ee-8585-48a361e5265d not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:19:14.250995 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-248cf1c8-fa8c-4cd6-abc1-ba282244c9b4 None None] Set router 70ade903-ee3e-4040-8855-b2a937f2a0d9 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:19:14.262057 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49da8f59-7c18-48f0-978f-17e5a6a84a09 req-4311a383-3738-4fbd-ba8b-4db3008e0db7 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:14.263600 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-49da8f59-7c18-48f0-978f-17e5a6a84a09 req-4311a383-3738-4fbd-ba8b-4db3008e0db7 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 943 time: 0.1436112 Dec 09 21:19:14.284286 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14357817-5cb9-42e8-92e1-e3f61a0ac5c9 req-7e8b3a48-b5af-4ffa-b521-36097034f5b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:14.285736 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-14357817-5cb9-42e8-92e1-e3f61a0ac5c9 req-7e8b3a48-b5af-4ffa-b521-36097034f5b1 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7c63014a-f387-496c-bd49-f1ae415a0bba HTTP/1.1" status: 200 len: 1100 time: 0.1307638 Dec 09 21:19:14.295790 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-68717c69-c5a7-44ad-80b0-237a646dd1e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:14.297181 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-68717c69-c5a7-44ad-80b0-237a646dd1e0 service neutron] 10.222.0.13 "GET /v2.0/networks?id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 HTTP/1.1" status: 200 len: 922 time: 0.1669242 Dec 09 21:19:14.350429 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-2e7e5163-f52a-45bc-b2bf-b8a04e515fb9 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b615e863-071a-473e-8d66-8f84f78d1453 HTTP/1.1" status: 200 len: 217 time: 0.0458651 Dec 09 21:19:14.371741 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:14.414045 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'cb941377-5fe0-4e9e-9ac5-1fb6253c78d7', 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef', 'port_id': 'cb941377-5fe0-4e9e-9ac5-1fb6253c78d7', 'mac_address': 'fa:16:3e:be:c0:da', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 138, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'eae2438b-9fcc-44ef-a172-6c4911cad13f', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:19:14.423130 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-49da8f59-7c18-48f0-978f-17e5a6a84a09 req-d4baa3f6-dc1e-4959-a7d2-07e3e78af5e1 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1494284 Dec 09 21:19:14.428697 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-14357817-5cb9-42e8-92e1-e3f61a0ac5c9 req-0fe04751-0e22-42ca-b37b-15f0b3e763a9 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=afb99149-6cda-47e0-9a86-3163c9902e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1342437 Dec 09 21:19:14.441223 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-aeb9e5dd-dde6-49a5-bc21-b167dd3abdf6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:14.441223 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-aeb9e5dd-dde6-49a5-bc21-b167dd3abdf6 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=3260fc19-8e10-46a2-82c6-3b2d5eda4a0e HTTP/1.1" status: 200 len: 860 time: 0.0800865 Dec 09 21:19:14.473705 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:14.479269 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 350 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-85cb67c5-fdfb-4ff7-acd2-48e54d6cc42a x-openstack-request-id: req-85cb67c5-fdfb-4ff7-acd2-48e54d6cc42a {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:14.479606 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "17188b52-f615-49ca-8709-a3c9238c02fa", "tag": "b615e863-071a-473e-8d66-8f84f78d1453", "status": "completed", "code": 200}, {"server_uuid": "3d45a57e-5f03-4541-88f7-1194f195f63e", "name": "network-vif-deleted", "tag": "d0cf802e-891b-41ee-8585-48a361e5265d", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:14.479845 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-85cb67c5-fdfb-4ff7-acd2-48e54d6cc42a {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:14.480380 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '17188b52-f615-49ca-8709-a3c9238c02fa', 'tag': 'b615e863-071a-473e-8d66-8f84f78d1453', 'status': 'completed', 'code': 200} Dec 09 21:19:14.480657 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3d45a57e-5f03-4541-88f7-1194f195f63e', 'name': 'network-vif-deleted', 'tag': 'd0cf802e-891b-41ee-8585-48a361e5265d', 'status': 'completed', 'code': 200} Dec 09 21:19:14.497434 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-fe2009f6-c869-45b1-8e8a-0acb764ea8e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:14.499243 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-fe2009f6-c869-45b1-8e8a-0acb764ea8e0 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0491865 Dec 09 21:19:14.505150 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:19:14.530893 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:14.537744 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:14.581653 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-248cf1c8-fa8c-4cd6-abc1-ba282244c9b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:18:03Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '72070289-8347-44bd-bfb9-9510e94eb5bd', 'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'tenant_id': '920e0419877f4239b048e126682274e9', 'mac_address': 'fa:16:3e:c3:24:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 264, 'fixed_ips': [{'subnet_id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:18:00Z', 'updated_at': '2021-12-09T21:18:09Z', 'revision_number': 5, 'project_id': '920e0419877f4239b048e126682274e9', 'subnets': [{'id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:14.619242 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-248cf1c8-fa8c-4cd6-abc1-ba282244c9b4 None None] Checking router: 70ade903-ee3e-4040-8855-b2a937f2a0d9 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:19:14.622019 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df124f0d-c8b7-4b67-964b-9282feba0165 req-4a0717e7-647e-455a-963c-8fef028fe6b7 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:14.623572 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df124f0d-c8b7-4b67-964b-9282feba0165 req-4a0717e7-647e-455a-963c-8fef028fe6b7 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 1097 time: 0.0986464 Dec 09 21:19:14.628045 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:14.629103 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-ba0e450c-71f5-42da-9bf4-f6d3d8625d16 service neutron] 10.222.0.13 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1220012 Dec 09 21:19:14.641400 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:14.641937 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:14.642248 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:14.642594 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:14.642906 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:14.643231 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:14.643579 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:14.643898 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:14.644232 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:14.644539 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:14.644880 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:14.645191 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:14.645501 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:14.649096 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-248cf1c8-fa8c-4cd6-abc1-ba282244c9b4 None None] Routers {'70ade903-ee3e-4040-8855-b2a937f2a0d9'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:19:14.649787 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-248cf1c8-fa8c-4cd6-abc1-ba282244c9b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:19:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['70ade903-ee3e-4040-8855-b2a937f2a0d9'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:14.758890 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-248cf1c8-fa8c-4cd6-abc1-ba282244c9b4 None None] Set router 70ade903-ee3e-4040-8855-b2a937f2a0d9 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:19:14.779996 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df124f0d-c8b7-4b67-964b-9282feba0165 req-d15c7917-a60a-4274-bd70-57afc2e44cce tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1360230 Dec 09 21:19:14.782875 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54fe8869-bf11-4c2d-9d7d-545b91f484a1 req-d191928e-a2f8-4df8-8f7c-7bd5754080f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:14.784330 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-54fe8869-bf11-4c2d-9d7d-545b91f484a1 req-d191928e-a2f8-4df8-8f7c-7bd5754080f3 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=920e0419877f4239b048e126682274e9&device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 1097 time: 0.1236763 Dec 09 21:19:14.786279 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d66ec270-023e-4e57-975b-a0b0002ede8c req-09fda61d-e573-4673-b413-048959d7f5e5 service neutron] 10.222.0.13 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1501811 Dec 09 21:19:14.862037 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['cb941377-5fe0-4e9e-9ac5-1fb6253c78d7'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:19:14.935511 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54fe8869-bf11-4c2d-9d7d-545b91f484a1 req-81a9db02-9f15-41d8-84cc-baee8246d7e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:14.936969 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-54fe8869-bf11-4c2d-9d7d-545b91f484a1 req-81a9db02-9f15-41d8-84cc-baee8246d7e3 service neutron] 10.222.0.31 "GET /v2.0/networks?id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 HTTP/1.1" status: 200 len: 922 time: 0.1398730 Dec 09 21:19:14.995807 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-54fe8869-bf11-4c2d-9d7d-545b91f484a1 req-5c38b9da-392f-4b7c-beb6-4e73ca70a2a3 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b615e863-071a-473e-8d66-8f84f78d1453 HTTP/1.1" status: 200 len: 217 time: 0.0438302 Dec 09 21:19:15.017204 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c91858f-5348-45c4-abaa-47a312242706 req-b4e7e44f-2a9f-4cb1-b4c0-df82f160d48d tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:15.018538 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c91858f-5348-45c4-abaa-47a312242706 req-b4e7e44f-2a9f-4cb1-b4c0-df82f160d48d tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/ports?device_id=7c63014a-f387-496c-bd49-f1ae415a0bba HTTP/1.1" status: 200 len: 948 time: 0.1204319 Dec 09 21:19:15.032504 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf80c489-8544-4918-8713-56218c14ec2d req-eb84c014-47ea-469b-9214-f35e506ce38b tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:15.033920 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf80c489-8544-4918-8713-56218c14ec2d req-eb84c014-47ea-469b-9214-f35e506ce38b tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.1219850 Dec 09 21:19:15.072498 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-248cf1c8-fa8c-4cd6-abc1-ba282244c9b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:18:03Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '72070289-8347-44bd-bfb9-9510e94eb5bd', 'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'tenant_id': '920e0419877f4239b048e126682274e9', 'mac_address': 'fa:16:3e:c3:24:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 264, 'fixed_ips': [{'subnet_id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:18:00Z', 'updated_at': '2021-12-09T21:18:09Z', 'revision_number': 5, 'project_id': '920e0419877f4239b048e126682274e9', 'subnets': [{'id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:15.105460 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-248cf1c8-fa8c-4cd6-abc1-ba282244c9b4 None None] The sync data for ids ['70ade903-ee3e-4040-8855-b2a937f2a0d9'] in n-d-713301-27 is: [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:18:03Z', 'revision_number': 4, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '72070289-8347-44bd-bfb9-9510e94eb5bd', 'name': '', 'network_id': 'eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3', 'tenant_id': '920e0419877f4239b048e126682274e9', 'mac_address': 'fa:16:3e:c3:24:b8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_interface', 'standard_attr_id': 264, 'fixed_ips': [{'subnet_id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:18:00Z', 'updated_at': '2021-12-09T21:18:09Z', 'revision_number': 5, 'project_id': '920e0419877f4239b048e126682274e9', 'subnets': [{'id': '3260fc19-8e10-46a2-82c6-3b2d5eda4a0e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:19:15.115969 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54fe8869-bf11-4c2d-9d7d-545b91f484a1 req-ea9613c4-94eb-4e63-bae0-a89cb078cf3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:15.117443 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-54fe8869-bf11-4c2d-9d7d-545b91f484a1 req-ea9613c4-94eb-4e63-bae0-a89cb078cf3b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=3260fc19-8e10-46a2-82c6-3b2d5eda4a0e HTTP/1.1" status: 200 len: 860 time: 0.1089938 Dec 09 21:19:15.149017 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c91858f-5348-45c4-abaa-47a312242706 req-11969546-fe3c-44b1-a421-eb288c1f0ff0 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/security-groups?id=afb99149-6cda-47e0-9a86-3163c9902e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1141331 Dec 09 21:19:15.167612 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf80c489-8544-4918-8713-56218c14ec2d req-c59fc1b6-3d14-42c6-a8fb-a8fea30e0e0b tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1087809 Dec 09 21:19:15.190562 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54fe8869-bf11-4c2d-9d7d-545b91f484a1 req-10a03001-2f1d-4b63-8a08-b60bc11f13c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:15.192598 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-54fe8869-bf11-4c2d-9d7d-545b91f484a1 req-10a03001-2f1d-4b63-8a08-b60bc11f13c6 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0632293 Dec 09 21:19:15.355952 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02b3682e-f264-47c8-b009-794f4ee4b3c3 req-1ba96e44-ab99-47d1-8b96-6e891cbf76e1 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:15.357462 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02b3682e-f264-47c8-b009-794f4ee4b3c3 req-1ba96e44-ab99-47d1-8b96-6e891cbf76e1 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 1097 time: 0.1179192 Dec 09 21:19:15.366879 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-54fe8869-bf11-4c2d-9d7d-545b91f484a1 req-ce11ea48-793c-4dec-8617-6bd19589dc79 service neutron] 10.222.0.31 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1642857 Dec 09 21:19:15.370811 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-108a4ae6-b9e5-49e0-83ca-2ac250ae401f None None] New status for floating IP 3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5: DOWN {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:19:15.379696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f71a29f0-d7ad-48bb-8eae-73de41ee1298 req-6d343ca9-1f93-47d2-acd8-81cbae06d2af tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:15.381096 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f71a29f0-d7ad-48bb-8eae-73de41ee1298 req-6d343ca9-1f93-47d2-acd8-81cbae06d2af tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 950 time: 0.0886946 Dec 09 21:19:15.497138 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02b3682e-f264-47c8-b009-794f4ee4b3c3 req-bfbdbd97-2de3-4ed2-9896-c3c507356428 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1323216 Dec 09 21:19:15.513802 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f71a29f0-d7ad-48bb-8eae-73de41ee1298 req-1f16bd75-7878-4fd5-8f5b-013ef1b0c9fc tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1148393 Dec 09 21:19:15.529944 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-54fe8869-bf11-4c2d-9d7d-545b91f484a1 req-e7bd7f36-e39b-4393-bbf6-e88b02faa558 service neutron] 10.222.0.31 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1468058 Dec 09 21:19:15.726716 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86e48af3-8843-43d0-9e58-b549b978212c req-00b2b131-2adb-4120-a877-28f3a5c1b010 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/floatingips/3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5 HTTP/1.1" status: 200 len: 694 time: 0.0493164 Dec 09 21:19:15.738237 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31649c86-5655-474e-9a4c-1d8699578675 req-b6926d90-59cf-4482-9cf2-8083b66f1c80 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:15.739784 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31649c86-5655-474e-9a4c-1d8699578675 req-b6926d90-59cf-4482-9cf2-8083b66f1c80 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 944 time: 0.0952728 Dec 09 21:19:15.847790 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31649c86-5655-474e-9a4c-1d8699578675 req-356d5fa8-c455-4e1c-8354-a893e4ca246b tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0984607 Dec 09 21:19:15.870931 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86e48af3-8843-43d0-9e58-b549b978212c req-eeee3f88-02bf-4e92-9499-0a480d7a82d7 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:15.872313 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86e48af3-8843-43d0-9e58-b549b978212c req-eeee3f88-02bf-4e92-9499-0a480d7a82d7 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.1316662 Dec 09 21:19:15.883871 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-86e48af3-8843-43d0-9e58-b549b978212c req-c31a6ad5-5ce3-40a4-a0fa-3b04464d2dc8 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:19:15.885111 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86e48af3-8843-43d0-9e58-b549b978212c req-c31a6ad5-5ce3-40a4-a0fa-3b04464d2dc8 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0060735 Dec 09 21:19:15.935177 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86e48af3-8843-43d0-9e58-b549b978212c req-27cdecb6-90d9-46b9-b1ba-8f0e52b0af7d tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.216 HTTP/1.1" status: 200 len: 697 time: 0.0438163 Dec 09 21:19:15.994746 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86e48af3-8843-43d0-9e58-b549b978212c req-2defed65-66c4-45d4-8aec-da2723e4ee9c tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.216 HTTP/1.1" status: 200 len: 697 time: 0.0516326 Dec 09 21:19:16.079486 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:19:16.136499 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:19:16.138799 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4623b1da-d5ce-442e-8947-d6fb1bd9959b req-f44828bd-0a39-4ff3-870d-7feb53b14622 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:16.140320 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4623b1da-d5ce-442e-8947-d6fb1bd9959b req-f44828bd-0a39-4ff3-870d-7feb53b14622 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 1097 time: 0.1002409 Dec 09 21:19:16.141195 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:16.141482 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:16.175781 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-86e48af3-8843-43d0-9e58-b549b978212c req-844b54ab-d533-4004-9237-941880f2114f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Deleting port d5b810b2-1858-4439-ae58-52254c24a838 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:19:16.176406 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-86e48af3-8843-43d0-9e58-b549b978212c req-844b54ab-d533-4004-9237-941880f2114f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:16.216282 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4623b1da-d5ce-442e-8947-d6fb1bd9959b req-d80c475c-7d3a-4899-9121-133d2add417d tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0662823 Dec 09 21:19:16.234683 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:16.271662 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9f03f0c3-a9b7-47c8-84b7-e9329ceed834', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cb941377-5fe0-4e9e-9ac5-1fb6253c78d7'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:16.274135 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-66c6362e-7ab9-48c9-b960-3b0a9bd3bc6a" -d '{"events": [{"server_uuid": "9f03f0c3-a9b7-47c8-84b7-e9329ceed834", "name": "network-vif-plugged", "status": "completed", "tag": "cb941377-5fe0-4e9e-9ac5-1fb6253c78d7"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:16.291069 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:16.296861 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:16.348626 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:16.496545 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '17188b52-f615-49ca-8709-a3c9238c02fa', 'tag': 'b615e863-071a-473e-8d66-8f84f78d1453'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:16.498823 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2a7f9978-41e3-4d5c-86a7-e6951f6fbde9" -d '{"events": [{"name": "network-changed", "server_uuid": "17188b52-f615-49ca-8709-a3c9238c02fa", "tag": "b615e863-071a-473e-8d66-8f84f78d1453"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:16.550821 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-86e48af3-8843-43d0-9e58-b549b978212c req-844b54ab-d533-4004-9237-941880f2114f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:16.551139 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-86e48af3-8843-43d0-9e58-b549b978212c req-844b54ab-d533-4004-9237-941880f2114f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:16.565707 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-86e48af3-8843-43d0-9e58-b549b978212c req-844b54ab-d533-4004-9237-941880f2114f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Calling delete_port for d5b810b2-1858-4439-ae58-52254c24a838 owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:19:16.582569 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2ad011d-6995-4435-91b0-b7a16e201a74 req-3a8d1815-470c-442d-978b-f71854787415 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:16.584061 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b2ad011d-6995-4435-91b0-b7a16e201a74 req-3a8d1815-470c-442d-978b-f71854787415 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/ports?device_id=7c63014a-f387-496c-bd49-f1ae415a0bba HTTP/1.1" status: 200 len: 948 time: 0.0803378 Dec 09 21:19:16.696192 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b2ad011d-6995-4435-91b0-b7a16e201a74 req-caa85ba2-aea9-4b72-8c9f-075ecb259860 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/security-groups?id=afb99149-6cda-47e0-9a86-3163c9902e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0743575 Dec 09 21:19:16.763211 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-86e48af3-8843-43d0-9e58-b549b978212c req-844b54ab-d533-4004-9237-941880f2114f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:16.807242 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-844b54ab-d533-4004-9237-941880f2114f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Pushing event deleted for resources: {'Port': ['ID=d5b810b2-1858-4439-ae58-52254c24a838,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:16.820524 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-844b54ab-d533-4004-9237-941880f2114f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:16.820873 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-844b54ab-d533-4004-9237-941880f2114f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:16.821201 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-844b54ab-d533-4004-9237-941880f2114f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:16.821531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-844b54ab-d533-4004-9237-941880f2114f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:16.821855 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-844b54ab-d533-4004-9237-941880f2114f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:16.822180 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-844b54ab-d533-4004-9237-941880f2114f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:16.822528 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-844b54ab-d533-4004-9237-941880f2114f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:16.822821 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-844b54ab-d533-4004-9237-941880f2114f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:16.823145 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-844b54ab-d533-4004-9237-941880f2114f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:16.823449 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-844b54ab-d533-4004-9237-941880f2114f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:16.823775 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-844b54ab-d533-4004-9237-941880f2114f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:16.824089 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-844b54ab-d533-4004-9237-941880f2114f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:16.824402 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-844b54ab-d533-4004-9237-941880f2114f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:16.879952 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef4efa18-dfdd-40a0-83db-5d0411e8cb68 req-aa49bc2a-f578-4998-965f-0d4d56eed952 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:16.881426 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef4efa18-dfdd-40a0-83db-5d0411e8cb68 req-aa49bc2a-f578-4998-965f-0d4d56eed952 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.1282992 Dec 09 21:19:16.905113 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-86e48af3-8843-43d0-9e58-b549b978212c req-844b54ab-d533-4004-9237-941880f2114f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:16.907748 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-86e48af3-8843-43d0-9e58-b549b978212c req-844b54ab-d533-4004-9237-941880f2114f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:16.908833 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86e48af3-8843-43d0-9e58-b549b978212c req-844b54ab-d533-4004-9237-941880f2114f tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "DELETE /v2.0/floatingips/3e1f78fb-eb2f-4c48-8e8c-a1fdaa0f12e5 HTTP/1.1" status: 204 len: 173 time: 0.9083202 Dec 09 21:19:16.939181 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef4efa18-dfdd-40a0-83db-5d0411e8cb68 req-e23060ef-0344-484a-a3f1-e62014828c9b tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516191 Dec 09 21:19:16.947232 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ebc98fe7-39bf-40a9-acc5-020f433c12b4 x-openstack-request-id: req-ebc98fe7-39bf-40a9-acc5-020f433c12b4 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:16.947717 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9f03f0c3-a9b7-47c8-84b7-e9329ceed834", "name": "network-vif-plugged", "status": "completed", "tag": "cb941377-5fe0-4e9e-9ac5-1fb6253c78d7", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:16.948124 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-ebc98fe7-39bf-40a9-acc5-020f433c12b4 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:16.948733 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9f03f0c3-a9b7-47c8-84b7-e9329ceed834', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cb941377-5fe0-4e9e-9ac5-1fb6253c78d7', 'code': 200} Dec 09 21:19:17.000838 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-438a3970-2c00-4c65-94e5-d07641886319 x-openstack-request-id: req-438a3970-2c00-4c65-94e5-d07641886319 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:17.000838 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "17188b52-f615-49ca-8709-a3c9238c02fa", "tag": "b615e863-071a-473e-8d66-8f84f78d1453", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:17.000838 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-438a3970-2c00-4c65-94e5-d07641886319 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:17.000838 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '17188b52-f615-49ca-8709-a3c9238c02fa', 'tag': 'b615e863-071a-473e-8d66-8f84f78d1453', 'status': 'completed', 'code': 200} Dec 09 21:19:17.135409 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39f0de6f-8b61-42e6-835a-3fc18f924df5 req-aa07ef81-d16d-4a98-b0c2-0fbef85aff8c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:17.136956 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-39f0de6f-8b61-42e6-835a-3fc18f924df5 req-aa07ef81-d16d-4a98-b0c2-0fbef85aff8c service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 1097 time: 0.1023901 Dec 09 21:19:17.138556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a7f9978-41e3-4d5c-86a7-e6951f6fbde9 req-1e67b248-a2d5-4e9e-b322-8883437c5eaa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:17.139883 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2a7f9978-41e3-4d5c-86a7-e6951f6fbde9 req-1e67b248-a2d5-4e9e-b322-8883437c5eaa service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=920e0419877f4239b048e126682274e9&device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 1097 time: 0.1164391 Dec 09 21:19:17.148110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9adb256-7ab9-4e05-a0c2-e133993915e1 req-d3b3b1fc-e39b-489e-8b11-40c174905e58 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:17.149575 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e9adb256-7ab9-4e05-a0c2-e133993915e1 req-d3b3b1fc-e39b-489e-8b11-40c174905e58 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 950 time: 0.1047347 Dec 09 21:19:17.272393 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57184) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:17.305594 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-39f0de6f-8b61-42e6-835a-3fc18f924df5 req-bde2519e-da3b-45c4-8dd7-e1d461bb1a05 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1550257 Dec 09 21:19:17.334167 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e9adb256-7ab9-4e05-a0c2-e133993915e1 req-6e791ca4-0064-4ad5-a5ff-65051f5d6de0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1698225 Dec 09 21:19:17.343996 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34921b81-a409-4c6a-a176-3fbbcbced28c req-78f2725a-5907-4d3b-9599-c7c29c189ab4 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:17.345523 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-34921b81-a409-4c6a-a176-3fbbcbced28c req-78f2725a-5907-4d3b-9599-c7c29c189ab4 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 945 time: 0.1681802 Dec 09 21:19:17.348559 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a7f9978-41e3-4d5c-86a7-e6951f6fbde9 req-d7cd0e1c-440d-4306-90c5-61dc2ae1fa95 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:17.349911 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2a7f9978-41e3-4d5c-86a7-e6951f6fbde9 req-d7cd0e1c-440d-4306-90c5-61dc2ae1fa95 service neutron] 10.222.0.31 "GET /v2.0/networks?id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 HTTP/1.1" status: 200 len: 922 time: 0.1983466 Dec 09 21:19:17.393361 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-80b36d49-11a9-4c83-ac7d-eff16774d9c6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:17.403401 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2a7f9978-41e3-4d5c-86a7-e6951f6fbde9 req-1054c254-5547-4556-9e66-109cccb09358 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=b615e863-071a-473e-8d66-8f84f78d1453 HTTP/1.1" status: 200 len: 217 time: 0.0456419 Dec 09 21:19:17.466139 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-34921b81-a409-4c6a-a176-3fbbcbced28c req-5ae0dcc6-0916-48d0-b795-a1898844a024 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1141956 Dec 09 21:19:17.476197 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a7f9978-41e3-4d5c-86a7-e6951f6fbde9 req-19a7c7c5-eb4a-4569-bb1a-0ba273ef9d01 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:17.478528 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-80b36d49-11a9-4c83-ac7d-eff16774d9c6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:17.479474 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2a7f9978-41e3-4d5c-86a7-e6951f6fbde9 req-19a7c7c5-eb4a-4569-bb1a-0ba273ef9d01 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=3260fc19-8e10-46a2-82c6-3b2d5eda4a0e HTTP/1.1" status: 200 len: 860 time: 0.0651791 Dec 09 21:19:17.482561 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-80b36d49-11a9-4c83-ac7d-eff16774d9c6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:17.514090 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80b36d49-11a9-4c83-ac7d-eff16774d9c6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9394b801-3a2c-40ed-b673-7b0b89073ef5,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:17.527114 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80b36d49-11a9-4c83-ac7d-eff16774d9c6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:17.528041 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80b36d49-11a9-4c83-ac7d-eff16774d9c6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:17.528569 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80b36d49-11a9-4c83-ac7d-eff16774d9c6 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:17.529062 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80b36d49-11a9-4c83-ac7d-eff16774d9c6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:17.529546 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80b36d49-11a9-4c83-ac7d-eff16774d9c6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:17.530516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80b36d49-11a9-4c83-ac7d-eff16774d9c6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:17.531034 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80b36d49-11a9-4c83-ac7d-eff16774d9c6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:17.531536 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80b36d49-11a9-4c83-ac7d-eff16774d9c6 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:17.532211 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80b36d49-11a9-4c83-ac7d-eff16774d9c6 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:17.532990 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80b36d49-11a9-4c83-ac7d-eff16774d9c6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:17.533599 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80b36d49-11a9-4c83-ac7d-eff16774d9c6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:17.534121 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80b36d49-11a9-4c83-ac7d-eff16774d9c6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:17.534627 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-80b36d49-11a9-4c83-ac7d-eff16774d9c6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:17.551359 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a7f9978-41e3-4d5c-86a7-e6951f6fbde9 req-082623ab-bda2-4f69-a9ef-415546bbb615 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:17.552923 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2a7f9978-41e3-4d5c-86a7-e6951f6fbde9 req-082623ab-bda2-4f69-a9ef-415546bbb615 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0586259 Dec 09 21:19:17.577525 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-80b36d49-11a9-4c83-ac7d-eff16774d9c6 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=65c80e4550a643f2a2e06643c92aaaba&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3039882 Dec 09 21:19:17.578320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57190) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:17.628632 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02dc8c0b-2182-4444-ad1f-2b2f4f9dea65 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:17.651843 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02dc8c0b-2182-4444-ad1f-2b2f4f9dea65 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:17.673569 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dee08065-a192-4c80-b4aa-12ed23c7d1fc req-81cbf849-f3a1-491d-8ff9-db9f1ee7f5ae tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:17.675087 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dee08065-a192-4c80-b4aa-12ed23c7d1fc req-81cbf849-f3a1-491d-8ff9-db9f1ee7f5ae tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 1097 time: 0.1091332 Dec 09 21:19:17.706437 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02dc8c0b-2182-4444-ad1f-2b2f4f9dea65 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:17.709498 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02dc8c0b-2182-4444-ad1f-2b2f4f9dea65 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:17.710658 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-02dc8c0b-2182-4444-ad1f-2b2f4f9dea65 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/9394b801-3a2c-40ed-b673-7b0b89073ef5 HTTP/1.1" status: 204 len: 168 time: 0.1312358 Dec 09 21:19:17.718930 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02dc8c0b-2182-4444-ad1f-2b2f4f9dea65 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9394b801-3a2c-40ed-b673-7b0b89073ef5,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:17.719911 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2a7f9978-41e3-4d5c-86a7-e6951f6fbde9 req-8908b25a-5251-412f-88e1-e0761c6c6d5c service neutron] 10.222.0.31 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1564443 Dec 09 21:19:17.833513 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dee08065-a192-4c80-b4aa-12ed23c7d1fc req-817fcfc0-9264-4086-a7f2-37c00edaee54 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1521337 Dec 09 21:19:17.851015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-120e5d4d-c91b-46b7-8c46-c3fa7e9622a0 req-e653d061-dff8-4bd1-ac77-d463c6eda683 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:17.852551 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-120e5d4d-c91b-46b7-8c46-c3fa7e9622a0 req-e653d061-dff8-4bd1-ac77-d463c6eda683 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 945 time: 0.1530654 Dec 09 21:19:17.905807 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2a7f9978-41e3-4d5c-86a7-e6951f6fbde9 req-3b727510-cee3-4d10-8e19-99e57d70ee53 service neutron] 10.222.0.31 "GET /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1728466 Dec 09 21:19:17.955071 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-120e5d4d-c91b-46b7-8c46-c3fa7e9622a0 req-6a363212-f88e-4016-a18d-b5694f8ab7c4 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/security-groups?id=174c6f0d-c012-4077-858c-aa2b94e54d38&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0966671 Dec 09 21:19:17.988399 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ed1cbd7-21c9-4d7b-a769-e78da87b845b req-57a0175b-2f00-44fe-ac06-daa96236eadf tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:17.990128 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1ed1cbd7-21c9-4d7b-a769-e78da87b845b req-57a0175b-2f00-44fe-ac06-daa96236eadf tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/ports?device_id=7c63014a-f387-496c-bd49-f1ae415a0bba HTTP/1.1" status: 200 len: 948 time: 0.0717781 Dec 09 21:19:18.031128 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57202) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:18.044364 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9a732d4f-1445-4e58-8a0a-c0111d93019f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:18.049614 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1ed1cbd7-21c9-4d7b-a769-e78da87b845b req-fa1a37af-16f6-4491-854a-7913332d2a7a tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/security-groups?id=afb99149-6cda-47e0-9a86-3163c9902e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516036 Dec 09 21:19:18.128349 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9a732d4f-1445-4e58-8a0a-c0111d93019f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:18.134493 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9a732d4f-1445-4e58-8a0a-c0111d93019f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:18.169555 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3dca3fb-1924-494e-841b-fffcc189274d req-5595d316-ba87-4385-a4d5-53e2bfe13408 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:18.170807 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a732d4f-1445-4e58-8a0a-c0111d93019f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f78fb071-c7b3-4b4d-bc16-85e09da821bc,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:18.171470 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3dca3fb-1924-494e-841b-fffcc189274d req-5595d316-ba87-4385-a4d5-53e2bfe13408 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.0570855 Dec 09 21:19:18.193480 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9a732d4f-1445-4e58-8a0a-c0111d93019f admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=24732b695efd40908f881c255c29d01b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1612120 Dec 09 21:19:18.196282 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57208) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:18.230788 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3dca3fb-1924-494e-841b-fffcc189274d req-c127d80d-54cf-4fd4-9ce7-3d57f6d3d24f tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0530701 Dec 09 21:19:18.251639 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bb2c07fa-0981-4465-a989-a5ee86d13b74 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:18.274736 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bb2c07fa-0981-4465-a989-a5ee86d13b74 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:18.325032 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bb2c07fa-0981-4465-a989-a5ee86d13b74 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:18.327701 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bb2c07fa-0981-4465-a989-a5ee86d13b74 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:18.328904 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bb2c07fa-0981-4465-a989-a5ee86d13b74 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/f78fb071-c7b3-4b4d-bc16-85e09da821bc HTTP/1.1" status: 204 len: 168 time: 0.1316931 Dec 09 21:19:18.337020 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb2c07fa-0981-4465-a989-a5ee86d13b74 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f78fb071-c7b3-4b4d-bc16-85e09da821bc,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:18.462662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cd3f0b4-39b2-40db-9618-6a7b1499725f req-9fa40146-f00b-400c-bda4-01bcef4c2f26 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:18.464230 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7cd3f0b4-39b2-40db-9618-6a7b1499725f req-9fa40146-f00b-400c-bda4-01bcef4c2f26 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 950 time: 0.0563059 Dec 09 21:19:18.518923 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7cd3f0b4-39b2-40db-9618-6a7b1499725f req-95cbe408-ddac-4cfe-a221-6789e4d3ad8d tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0487406 Dec 09 21:19:18.634504 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1ea3435-70cd-4c4a-b1ce-430479a7c8f5 req-99f5876d-3cd9-4e0b-9069-18986205045f tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:18.642738 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e1ea3435-70cd-4c4a-b1ce-430479a7c8f5 req-99f5876d-3cd9-4e0b-9069-18986205045f tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 945 time: 0.0590575 Dec 09 21:19:18.712279 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e1ea3435-70cd-4c4a-b1ce-430479a7c8f5 req-5d176657-1af4-42ca-ac8d-0aa4c1cfd83f tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0681403 Dec 09 21:19:18.938746 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-633512fb-64a9-49ea-b2bf-da3df1e7de7e req-db4d6cd2-cb2a-48e8-a250-38a219fa7481 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:18.940257 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-633512fb-64a9-49ea-b2bf-da3df1e7de7e req-db4d6cd2-cb2a-48e8-a250-38a219fa7481 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.31 "GET /v2.0/ports?device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 945 time: 0.0557959 Dec 09 21:19:19.077548 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-633512fb-64a9-49ea-b2bf-da3df1e7de7e req-8b3871c1-37af-4f38-aa45-c798b239b281 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Deleting port b615e863-071a-473e-8d66-8f84f78d1453 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:19:19.077890 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-633512fb-64a9-49ea-b2bf-da3df1e7de7e req-8b3871c1-37af-4f38-aa45-c798b239b281 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:19.125874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2114955f-39bd-4b5b-8b19-0df6ca784289 req-f82242c1-a69b-46f6-933e-488c5576f74c tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:19.127967 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2114955f-39bd-4b5b-8b19-0df6ca784289 req-f82242c1-a69b-46f6-933e-488c5576f74c tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.31 "GET /v2.0/ports?device_id=7c63014a-f387-496c-bd49-f1ae415a0bba HTTP/1.1" status: 200 len: 948 time: 0.0623167 Dec 09 21:19:19.160548 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edf68bf9-613b-4cbc-a6c8-64cbf2b01755 req-d58cb69e-6d12-4d8f-abdf-f1f43350c464 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:19.162119 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-edf68bf9-613b-4cbc-a6c8-64cbf2b01755 req-d58cb69e-6d12-4d8f-abdf-f1f43350c464 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/ports?device_id=17188b52-f615-49ca-8709-a3c9238c02fa HTTP/1.1" status: 200 len: 945 time: 0.1232457 Dec 09 21:19:19.212916 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-633512fb-64a9-49ea-b2bf-da3df1e7de7e req-8b3871c1-37af-4f38-aa45-c798b239b281 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] For port b615e863-071a-473e-8d66-8f84f78d1453, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b615e863-071a-473e-8d66-8f84f78d1453,segment=NetworkSegment(c1e3b516-6ad9-46a2-acfa-cf795ad5b916),segment_id=c1e3b516-6ad9-46a2-acfa-cf795ad5b916)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:19.213288 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-633512fb-64a9-49ea-b2bf-da3df1e7de7e req-8b3871c1-37af-4f38-aa45-c798b239b281 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:19.237543 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-633512fb-64a9-49ea-b2bf-da3df1e7de7e req-8b3871c1-37af-4f38-aa45-c798b239b281 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Calling delete_port for b615e863-071a-473e-8d66-8f84f78d1453 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:19:19.238390 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57266) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:19.246531 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-edf68bf9-613b-4cbc-a6c8-64cbf2b01755 req-3d4432cc-a5a4-44d2-bec3-df288a44c991 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.13 "GET /v2.0/security-groups?id=174c6f0d-c012-4077-858c-aa2b94e54d38&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0769832 Dec 09 21:19:19.293082 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-2114955f-39bd-4b5b-8b19-0df6ca784289 req-37eaef99-3b2a-4ac9-8a74-3a51cd306556 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Deleting port 2dae91d7-35c0-4f49-bedd-e9ae0003a027 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:19:19.293595 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2114955f-39bd-4b5b-8b19-0df6ca784289 req-37eaef99-3b2a-4ac9-8a74-3a51cd306556 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:19.406026 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-2114955f-39bd-4b5b-8b19-0df6ca784289 req-37eaef99-3b2a-4ac9-8a74-3a51cd306556 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] For port 2dae91d7-35c0-4f49-bedd-e9ae0003a027, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2dae91d7-35c0-4f49-bedd-e9ae0003a027,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:19.407589 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2114955f-39bd-4b5b-8b19-0df6ca784289 req-37eaef99-3b2a-4ac9-8a74-3a51cd306556 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:19.422705 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-2114955f-39bd-4b5b-8b19-0df6ca784289 req-37eaef99-3b2a-4ac9-8a74-3a51cd306556 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Calling delete_port for 2dae91d7-35c0-4f49-bedd-e9ae0003a027 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:19:19.431142 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6447c38b-35d9-4911-81a2-d1145f461268 req-3fd8c2b2-a476-4ebb-b306-38ae18559713 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:19.435257 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6447c38b-35d9-4911-81a2-d1145f461268 req-3fd8c2b2-a476-4ebb-b306-38ae18559713 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/ports?device_id=7c63014a-f387-496c-bd49-f1ae415a0bba HTTP/1.1" status: 200 len: 948 time: 0.0920005 Dec 09 21:19:19.436325 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-633512fb-64a9-49ea-b2bf-da3df1e7de7e req-8b3871c1-37af-4f38-aa45-c798b239b281 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:19.449187 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['b615e863-071a-473e-8d66-8f84f78d1453'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:19:19.475677 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b3871c1-37af-4f38-aa45-c798b239b281 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Pushing event deleted for resources: {'Port': ['ID=b615e863-071a-473e-8d66-8f84f78d1453,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:19.550200 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-633512fb-64a9-49ea-b2bf-da3df1e7de7e req-8b3871c1-37af-4f38-aa45-c798b239b281 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] No DVR routers for this DVR port b615e863-071a-473e-8d66-8f84f78d1453 on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:19:19.555311 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-633512fb-64a9-49ea-b2bf-da3df1e7de7e req-8b3871c1-37af-4f38-aa45-c798b239b281 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:19.558972 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-633512fb-64a9-49ea-b2bf-da3df1e7de7e req-8b3871c1-37af-4f38-aa45-c798b239b281 tempest-FloatingIPsAssociationTestJSON-1178305279 tempest-FloatingIPsAssociationTestJSON-1178305279-project] 10.222.0.31 "DELETE /v2.0/ports/b615e863-071a-473e-8d66-8f84f78d1453 HTTP/1.1" status: 204 len: 173 time: 0.6114447 Dec 09 21:19:19.559367 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '17188b52-f615-49ca-8709-a3c9238c02fa', 'name': 'network-vif-deleted', 'tag': 'b615e863-071a-473e-8d66-8f84f78d1453'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:19.561767 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e8e1d60c-89c7-4aa8-a5b6-109939ae57a9" -d '{"events": [{"server_uuid": "17188b52-f615-49ca-8709-a3c9238c02fa", "name": "network-vif-deleted", "tag": "b615e863-071a-473e-8d66-8f84f78d1453"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:19.591668 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6447c38b-35d9-4911-81a2-d1145f461268 req-8711b5c1-a0bf-45d8-b54a-99c9cdf79444 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.13 "GET /v2.0/security-groups?id=afb99149-6cda-47e0-9a86-3163c9902e77&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1471262 Dec 09 21:19:19.741325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbfda558-4227-44ec-b689-6d3779cec164 req-34b3d302-54ac-462d-9fc8-b24ef435f95a tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:19.743795 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bbfda558-4227-44ec-b689-6d3779cec164 req-34b3d302-54ac-462d-9fc8-b24ef435f95a tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.0763385 Dec 09 21:19:19.778399 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-5b47ebf9-5115-43df-8086-5fbc5a5e0c01 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:19:19.779462 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-5b47ebf9-5115-43df-8086-5fbc5a5e0c01 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.5391765 Dec 09 21:19:19.809643 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bbfda558-4227-44ec-b689-6d3779cec164 req-30fefe58-3f6f-4c82-9e11-8f2d2cc46b84 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0592692 Dec 09 21:19:19.883836 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2114955f-39bd-4b5b-8b19-0df6ca784289 req-37eaef99-3b2a-4ac9-8a74-3a51cd306556 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:19.896193 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['2dae91d7-35c0-4f49-bedd-e9ae0003a027'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:19:19.952157 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37eaef99-3b2a-4ac9-8a74-3a51cd306556 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Pushing event deleted for resources: {'Port': ['ID=2dae91d7-35c0-4f49-bedd-e9ae0003a027,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:20.036104 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-2114955f-39bd-4b5b-8b19-0df6ca784289 req-37eaef99-3b2a-4ac9-8a74-3a51cd306556 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] No DVR routers for this DVR port 2dae91d7-35c0-4f49-bedd-e9ae0003a027 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:19:20.042231 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2114955f-39bd-4b5b-8b19-0df6ca784289 req-37eaef99-3b2a-4ac9-8a74-3a51cd306556 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:20.045853 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2114955f-39bd-4b5b-8b19-0df6ca784289 req-37eaef99-3b2a-4ac9-8a74-3a51cd306556 tempest-ServerDiagnosticsNegativeTest-866936718 tempest-ServerDiagnosticsNegativeTest-866936718-project] 10.222.0.31 "DELETE /v2.0/ports/2dae91d7-35c0-4f49-bedd-e9ae0003a027 HTTP/1.1" status: 204 len: 173 time: 0.9103887 Dec 09 21:19:20.046326 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7c63014a-f387-496c-bd49-f1ae415a0bba', 'name': 'network-vif-deleted', 'tag': '2dae91d7-35c0-4f49-bedd-e9ae0003a027'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:20.048842 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0574be04-cd0c-44e0-af16-f7be58c6efcf" -d '{"events": [{"server_uuid": "7c63014a-f387-496c-bd49-f1ae415a0bba", "name": "network-vif-deleted", "tag": "2dae91d7-35c0-4f49-bedd-e9ae0003a027"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:20.061709 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-3b15ead2-46b1-43f4-8475-8f76ab311332 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:20.063836 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-3b15ead2-46b1-43f4-8475-8f76ab311332 service neutron] 10.222.0.13 "GET /v2.0/ports/2ba5fd1c-0009-4970-b169-7f8dca923e34 HTTP/1.1" status: 200 len: 1094 time: 0.1326878 Dec 09 21:19:20.075989 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-873e5904-0347-4d37-88bb-8dba5923e654 req-8a5bffcf-cae0-41b6-96a7-568ddc7a616f tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:20.077746 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-873e5904-0347-4d37-88bb-8dba5923e654 req-8a5bffcf-cae0-41b6-96a7-568ddc7a616f tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 950 time: 0.0855086 Dec 09 21:19:20.082786 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-558f1e66-f935-49e8-b706-0129beeb2a17 service neutron] Request body: {'binding': {'host': 'n-h2-713301-27', 'vnic_type': 'normal', 'profile': {}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:20.083252 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-558f1e66-f935-49e8-b706-0129beeb2a17 service neutron] Unknown quota resources ['binding']. {{(pid=103437) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 09 21:19:20.185362 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-873e5904-0347-4d37-88bb-8dba5923e654 req-3ad9220b-5ddd-4729-8a8f-6c84bd37d5a5 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0958982 Dec 09 21:19:20.239186 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5b7019df-f1df-4caa-8ec7-ee1fad121264 x-openstack-request-id: req-5b7019df-f1df-4caa-8ec7-ee1fad121264 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:20.239820 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "17188b52-f615-49ca-8709-a3c9238c02fa", "name": "network-vif-deleted", "tag": "b615e863-071a-473e-8d66-8f84f78d1453", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:20.240280 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-5b7019df-f1df-4caa-8ec7-ee1fad121264 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:20.241697 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '17188b52-f615-49ca-8709-a3c9238c02fa', 'name': 'network-vif-deleted', 'tag': 'b615e863-071a-473e-8d66-8f84f78d1453', 'status': 'completed', 'code': 200} Dec 09 21:19:20.289761 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-558f1e66-f935-49e8-b706-0129beeb2a17 service neutron] Attempting to bind port 2ba5fd1c-0009-4970-b169-7f8dca923e34 on host n-h2-713301-27 for vnic_type normal with profile None {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:19:20.290096 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-558f1e66-f935-49e8-b706-0129beeb2a17 service neutron] Attempting to bind port 2ba5fd1c-0009-4970-b169-7f8dca923e34 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:19:20.290510 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-558f1e66-f935-49e8-b706-0129beeb2a17 service neutron] Attempting to bind port 2ba5fd1c-0009-4970-b169-7f8dca923e34 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:20.294779 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-558f1e66-f935-49e8-b706-0129beeb2a17 service neutron] Port 2ba5fd1c-0009-4970-b169-7f8dca923e34 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:19:20.295373 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-558f1e66-f935-49e8-b706-0129beeb2a17 service neutron] Attempting to bind port 2ba5fd1c-0009-4970-b169-7f8dca923e34 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:20.300227 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-558f1e66-f935-49e8-b706-0129beeb2a17 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 18, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:19:20.300568 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-558f1e66-f935-49e8-b706-0129beeb2a17 service neutron] Checking segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:19:20.300947 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-558f1e66-f935-49e8-b706-0129beeb2a17 service neutron] Bound using segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:19:20.301377 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-558f1e66-f935-49e8-b706-0129beeb2a17 service neutron] Bound port: 2ba5fd1c-0009-4970-b169-7f8dca923e34, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:19:20.336687 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee719718-c42e-4000-ae15-dabb9d046f00 req-98168a33-c7ff-44dd-bba0-c113722262bf tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:20.338181 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ee719718-c42e-4000-ae15-dabb9d046f00 req-98168a33-c7ff-44dd-bba0-c113722262bf tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 945 time: 0.0522158 Dec 09 21:19:20.353136 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-558f1e66-f935-49e8-b706-0129beeb2a17 service neutron] For port 2ba5fd1c-0009-4970-b169-7f8dca923e34, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=2ba5fd1c-0009-4970-b169-7f8dca923e34,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:19:20.359698 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-558f1e66-f935-49e8-b706-0129beeb2a17 service neutron] Publish callbacks [] for binding, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:20.361380 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-558f1e66-f935-49e8-b706-0129beeb2a17 service neutron] 10.222.0.13 "POST /v2.0/ports/2ba5fd1c-0009-4970-b169-7f8dca923e34/bindings HTTP/1.1" status: 201 len: 390 time: 0.2915869 Dec 09 21:19:20.388247 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ee719718-c42e-4000-ae15-dabb9d046f00 req-66da2af5-9634-4bfd-b47c-8cf5befd4c6c tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436952 Dec 09 21:19:20.457936 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-27693a9b-c86c-4a1a-8ba2-6e061008c4b3 x-openstack-request-id: req-27693a9b-c86c-4a1a-8ba2-6e061008c4b3 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:20.458453 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7c63014a-f387-496c-bd49-f1ae415a0bba", "name": "network-vif-deleted", "tag": "2dae91d7-35c0-4f49-bedd-e9ae0003a027", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:20.458886 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-27693a9b-c86c-4a1a-8ba2-6e061008c4b3 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:20.459547 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7c63014a-f387-496c-bd49-f1ae415a0bba', 'name': 'network-vif-deleted', 'tag': '2dae91d7-35c0-4f49-bedd-e9ae0003a027', 'status': 'completed', 'code': 200} Dec 09 21:19:20.463681 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57308) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:20.598266 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deec53b9-8ed9-45f4-bcec-032d6774d83d req-52061e47-25cd-4a87-aa82-790f41d92ccb tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:20.606772 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-deec53b9-8ed9-45f4-bcec-032d6774d83d req-52061e47-25cd-4a87-aa82-790f41d92ccb tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 1097 time: 0.0934091 Dec 09 21:19:20.627520 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46b2ae1b-8c9e-48cf-94d9-59f773a0a958 req-59af412e-5d94-4c97-8ebd-fc938b03fef2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:20.636033 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46b2ae1b-8c9e-48cf-94d9-59f773a0a958 req-59af412e-5d94-4c97-8ebd-fc938b03fef2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 945 time: 0.1071577 Dec 09 21:19:20.736147 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-deec53b9-8ed9-45f4-bcec-032d6774d83d req-3a60cfeb-d40f-4340-9539-626f34b82ef6 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1283431 Dec 09 21:19:20.748920 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57314) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:20.763420 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-fe83be1f-6fb9-424c-af30-e044715cce5d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:20.765108 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-fe83be1f-6fb9-424c-af30-e044715cce5d service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 1097 time: 0.0730128 Dec 09 21:19:20.773305 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46b2ae1b-8c9e-48cf-94d9-59f773a0a958 req-93b95342-a2de-4419-8626-7da1a5420f6c tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1221955 Dec 09 21:19:20.932437 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-b4dce62c-fac5-4ed4-8cdd-1ad1819f48a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:20.933875 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-b4dce62c-fac5-4ed4-8cdd-1ad1819f48a7 service neutron] 10.222.0.10 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 922 time: 0.1592629 Dec 09 21:19:20.949682 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ff34e84-fdaf-4ad8-b6af-15f918bf6f99 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:21.011066 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-95f3c936-8a62-484e-9796-6090b16e28bd service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=2ba5fd1c-0009-4970-b169-7f8dca923e34 HTTP/1.1" status: 200 len: 217 time: 0.0617952 Dec 09 21:19:21.058004 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ae2d618-5eba-4616-ba4c-3666a13ce739 req-3edcf890-4160-4b94-b42f-7dd9a3cc548b tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:21.059607 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ae2d618-5eba-4616-ba4c-3666a13ce739 req-3edcf890-4160-4b94-b42f-7dd9a3cc548b tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 1097 time: 0.1558425 Dec 09 21:19:21.079122 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d2395ca-f5dc-4d55-bc5b-d67780f0c912 req-cad5c16c-01d9-4c41-8112-f6f23f9cd3bd tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:21.080912 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7d2395ca-f5dc-4d55-bc5b-d67780f0c912 req-cad5c16c-01d9-4c41-8112-f6f23f9cd3bd tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.1500127 Dec 09 21:19:21.113395 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-e1998242-cf5a-4f19-8d30-d5c1b13d5f9c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:21.114861 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-e1998242-cf5a-4f19-8d30-d5c1b13d5f9c service neutron] 10.222.0.10 "GET /v2.0/subnets?id=c49a62cc-af1b-4958-a4a9-eb44188b8fb9 HTTP/1.1" status: 200 len: 861 time: 0.0934849 Dec 09 21:19:21.115581 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57328) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:21.125453 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ff34e84-fdaf-4ad8-b6af-15f918bf6f99 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:21.133089 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ff34e84-fdaf-4ad8-b6af-15f918bf6f99 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:21.171104 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-185c349a-307d-4cbf-8678-209de3f10b05 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=93378dc3-2ac5-4cf7-9ce3-d812934de40c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0389013 Dec 09 21:19:21.172116 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ce2a49c6-4bc4-40a6-b362-bf6e2053613b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:21.211695 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ae2d618-5eba-4616-ba4c-3666a13ce739 req-137ba340-2515-4e80-97c9-857ee8597236 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1278465 Dec 09 21:19:21.214925 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7d2395ca-f5dc-4d55-bc5b-d67780f0c912 req-f835d84b-6013-4ef4-9eb8-6cb43edd3020 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1123574 Dec 09 21:19:21.229740 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2ff34e84-fdaf-4ad8-b6af-15f918bf6f99 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=d351814eab7f4662a302417c9b773806&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4797328 Dec 09 21:19:21.232909 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57334) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:21.233439 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ff34e84-fdaf-4ad8-b6af-15f918bf6f99 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b62db7d6-6ba9-4598-998f-2c5094d44fa0,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:21.404472 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1b5110ce-4916-4045-a9cd-3f3f9883ef52 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=d035bde1be0e46a6977e6cc6f45495c7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2842317 Dec 09 21:19:21.404472 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-c2fc125e-fde4-4b7d-9831-af834ff69d6a service neutron] 10.222.0.10 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2177153 Dec 09 21:19:21.412016 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57342) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:21.438995 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-08a2423f-4d57-4f3c-83e9-a1e9b7010814 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:21.466030 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c6e932b-f3bd-411f-a79a-80c73735bd3d req-54419482-ed1f-4604-ba76-ec658d91d198 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:21.467685 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7c6e932b-f3bd-411f-a79a-80c73735bd3d req-54419482-ed1f-4604-ba76-ec658d91d198 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 950 time: 0.1446466 Dec 09 21:19:21.515582 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-08a2423f-4d57-4f3c-83e9-a1e9b7010814 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:21.546775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-ce2a49c6-4bc4-40a6-b362-bf6e2053613b admin admin] Deleting port 72070289-8347-44bd-bfb9-9510e94eb5bd {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:19:21.547589 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ce2a49c6-4bc4-40a6-b362-bf6e2053613b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:21.638335 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-ce2a49c6-4bc4-40a6-b362-bf6e2053613b admin admin] For port 72070289-8347-44bd-bfb9-9510e94eb5bd, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=72070289-8347-44bd-bfb9-9510e94eb5bd,segment=NetworkSegment(c1e3b516-6ad9-46a2-acfa-cf795ad5b916),segment_id=c1e3b516-6ad9-46a2-acfa-cf795ad5b916)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:21.638700 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ce2a49c6-4bc4-40a6-b362-bf6e2053613b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:21.651186 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-ce2a49c6-4bc4-40a6-b362-bf6e2053613b admin admin] Calling delete_port for 72070289-8347-44bd-bfb9-9510e94eb5bd owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:19:21.667192 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ba5c302b-78f0-4764-94e2-03813490bf05 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:21.675505 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7c6e932b-f3bd-411f-a79a-80c73735bd3d req-afd88cd5-4a32-462c-b3e7-99c3faba31d5 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1926692 Dec 09 21:19:21.685990 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-fdc7114f-1ed3-4565-9381-0c1cef873914 service neutron] 10.222.0.10 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2631636 Dec 09 21:19:21.705845 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95648ec7-20cb-4d8b-9b7b-3cf161d738f2 req-3f236cd9-72ac-43ff-b7d1-a931af7caa1f tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:21.706983 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-95648ec7-20cb-4d8b-9b7b-3cf161d738f2 req-3f236cd9-72ac-43ff-b7d1-a931af7caa1f tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 1097 time: 0.1479292 Dec 09 21:19:21.714569 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ba5c302b-78f0-4764-94e2-03813490bf05 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:21.729822 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-08a2423f-4d57-4f3c-83e9-a1e9b7010814 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:21.732625 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-08a2423f-4d57-4f3c-83e9-a1e9b7010814 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:21.736357 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-08a2423f-4d57-4f3c-83e9-a1e9b7010814 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/b62db7d6-6ba9-4598-998f-2c5094d44fa0 HTTP/1.1" status: 204 len: 168 time: 0.4998629 Dec 09 21:19:21.780700 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08a2423f-4d57-4f3c-83e9-a1e9b7010814 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b62db7d6-6ba9-4598-998f-2c5094d44fa0,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:21.909544 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ce2a49c6-4bc4-40a6-b362-bf6e2053613b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:21.916789 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-95648ec7-20cb-4d8b-9b7b-3cf161d738f2 req-3fd56360-e0bb-451e-97a9-5245281094b1 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2089536 Dec 09 21:19:21.941766 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce2a49c6-4bc4-40a6-b362-bf6e2053613b admin admin] Pushing event deleted for resources: {'Port': ['ID=72070289-8347-44bd-bfb9-9510e94eb5bd,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:21.943826 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ba5c302b-78f0-4764-94e2-03813490bf05 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:21.945364 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ba5c302b-78f0-4764-94e2-03813490bf05 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:21.949585 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ba5c302b-78f0-4764-94e2-03813490bf05 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/afb99149-6cda-47e0-9a86-3163c9902e77 HTTP/1.1" status: 204 len: 168 time: 0.5325496 Dec 09 21:19:21.951949 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-62876669-439d-4bf1-bb93-33df89c92204 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:21.953516 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-62876669-439d-4bf1-bb93-33df89c92204 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.10 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42&tenant_id=a306d2242b1e41c892f63c7b122cdee4&binding%3Ahost_id=n-h1-713301-27 HTTP/1.1" status: 200 len: 1097 time: 0.1753531 Dec 09 21:19:21.961390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba5c302b-78f0-4764-94e2-03813490bf05 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=afb99149-6cda-47e0-9a86-3163c9902e77,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:21.968200 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-aece42a1-243f-4a69-9ac6-8b640b0bfd40 service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h2-713301-27'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:22.005806 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1dd09cd-4d93-47e6-a338-9bc74914911a req-ebfe2fe4-c8e4-44fd-851d-09b7e23214bf tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:22.007361 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c1dd09cd-4d93-47e6-a338-9bc74914911a req-ebfe2fe4-c8e4-44fd-851d-09b7e23214bf tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 945 time: 0.1126196 Dec 09 21:19:22.114369 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-aece42a1-243f-4a69-9ac6-8b640b0bfd40 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:22.135927 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57354) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:22.167479 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c1dd09cd-4d93-47e6-a338-9bc74914911a req-d0d68369-5756-4225-8f1d-110210a0f87d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1431706 Dec 09 21:19:22.185997 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f0577b7-3d82-44ab-884a-b57b3831cf20 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:22.208540 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ce2a49c6-4bc4-40a6-b362-bf6e2053613b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:22.479955 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ce2a49c6-4bc4-40a6-b362-bf6e2053613b admin admin] Router 70ade903-ee3e-4040-8855-b2a937f2a0d9 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:19:22.484712 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57362) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:22.504703 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ecf30e3-0b17-4606-8bf6-2abe62640c66 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:22.638232 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ce2a49c6-4bc4-40a6-b362-bf6e2053613b admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:19:22.646419 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ce2a49c6-4bc4-40a6-b362-bf6e2053613b admin admin] 10.222.0.13 "PUT /v2.0/routers/70ade903-ee3e-4040-8855-b2a937f2a0d9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1790411 Dec 09 21:19:22.648114 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-aece42a1-243f-4a69-9ac6-8b640b0bfd40 service neutron] For port 2ba5fd1c-0009-4970-b169-7f8dca923e34, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2ba5fd1c-0009-4970-b169-7f8dca923e34,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:22.648405 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57364) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:22.655083 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e50f858-9455-4d54-a8b9-e38f0022adb7 None None] Sync routers for ids ['70ade903-ee3e-4040-8855-b2a937f2a0d9'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:19:22.667349 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e50f858-9455-4d54-a8b9-e38f0022adb7 None None] Routers {'70ade903-ee3e-4040-8855-b2a937f2a0d9'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:19:22.668274 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-3e50f858-9455-4d54-a8b9-e38f0022adb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:19:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['70ade903-ee3e-4040-8855-b2a937f2a0d9'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:22.675346 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f0577b7-3d82-44ab-884a-b57b3831cf20 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:22.683655 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1a63b23-13b2-47b2-835b-170adf622b8d req-265c47f6-a5be-44df-9dd0-50ffbd257feb tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:22.685218 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c1a63b23-13b2-47b2-835b-170adf622b8d req-265c47f6-a5be-44df-9dd0-50ffbd257feb tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.3858447 Dec 09 21:19:22.688859 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f0577b7-3d82-44ab-884a-b57b3831cf20 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:22.772842 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c1a63b23-13b2-47b2-835b-170adf622b8d req-441b4a8b-c12c-4bb7-b17b-4e300711231f tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0748103 Dec 09 21:19:22.819471 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7f0577b7-3d82-44ab-884a-b57b3831cf20 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=13c4c8a997ce4a55ae000985295411ee&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6814170 Dec 09 21:19:22.825003 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57368) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:22.826103 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f0577b7-3d82-44ab-884a-b57b3831cf20 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7f90b84e-edcf-49ec-aecd-63eca8b0fa6b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:22.839555 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-aece42a1-243f-4a69-9ac6-8b640b0bfd40 service neutron] For port 2ba5fd1c-0009-4970-b169-7f8dca923e34, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:22.936616 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ecf30e3-0b17-4606-8bf6-2abe62640c66 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:22.936884 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-3e50f858-9455-4d54-a8b9-e38f0022adb7 None None] Set router 70ade903-ee3e-4040-8855-b2a937f2a0d9 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:19:22.945634 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ecf30e3-0b17-4606-8bf6-2abe62640c66 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:22.955171 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd0cb5c61-bab4-4b8b-aa1e-0efbe9992f42', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2ba5fd1c-0009-4970-b169-7f8dca923e34'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:22.957483 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6a738c86-3b43-42c9-9138-455658f16acf" -d '{"events": [{"server_uuid": "d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42", "name": "network-vif-unplugged", "status": "completed", "tag": "2ba5fd1c-0009-4970-b169-7f8dca923e34"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:22.961500 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-aece42a1-243f-4a69-9ac6-8b640b0bfd40 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:22.978374 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae11d5b0-780c-42c6-aaee-37cd0cd66028 req-ec0fb374-7cb5-4500-aff0-28f7bcb7d87d tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:22.979971 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae11d5b0-780c-42c6-aaee-37cd0cd66028 req-ec0fb374-7cb5-4500-aff0-28f7bcb7d87d tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 950 time: 0.1634409 Dec 09 21:19:22.983155 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-aece42a1-243f-4a69-9ac6-8b640b0bfd40 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:23.025489 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8ecf30e3-0b17-4606-8bf6-2abe62640c66 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=8ea42b7eaa1a480b8110e2c6b600764c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5392129 Dec 09 21:19:23.031255 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ecf30e3-0b17-4606-8bf6-2abe62640c66 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=893a48be-e7f7-4267-89cf-1871b557e48d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:23.033950 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57374) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:23.042191 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-23aa97be-7058-4ea4-9742-a3b544ec1bde admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:23.052072 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e42e2adf-9dcb-4cf8-9023-b57128cc7bc5 admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:23.070253 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-23aa97be-7058-4ea4-9742-a3b544ec1bde admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:23.141045 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-3e50f858-9455-4d54-a8b9-e38f0022adb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:19:21Z', 'revision_number': 5, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:23.161688 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf55e335-7915-48ee-b4e2-6d09735ae803 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:23.169447 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e50f858-9455-4d54-a8b9-e38f0022adb7 None None] Checking router: 70ade903-ee3e-4040-8855-b2a937f2a0d9 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:19:23.179527 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e50f858-9455-4d54-a8b9-e38f0022adb7 None None] Routers {'70ade903-ee3e-4040-8855-b2a937f2a0d9'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:19:23.180423 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-3e50f858-9455-4d54-a8b9-e38f0022adb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:19:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['70ade903-ee3e-4040-8855-b2a937f2a0d9'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:23.194899 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf55e335-7915-48ee-b4e2-6d09735ae803 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:23.195870 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aece42a1-243f-4a69-9ac6-8b640b0bfd40 service neutron] Pushing event updated for resources: {'Port': ['ID=2ba5fd1c-0009-4970-b169-7f8dca923e34,revision_number=7']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:23.211379 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e42e2adf-9dcb-4cf8-9023-b57128cc7bc5 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:23.233054 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae11d5b0-780c-42c6-aaee-37cd0cd66028 req-3e92e2d8-05f4-4123-8c4d-dbeeff7cfdb6 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2274947 Dec 09 21:19:23.238017 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-aece42a1-243f-4a69-9ac6-8b640b0bfd40 service neutron] Attempting to bind port 2ba5fd1c-0009-4970-b169-7f8dca923e34 on host n-h1-713301-27 for vnic_type normal with profile {"migrating_to": "n-h2-713301-27"} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:19:23.238017 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-aece42a1-243f-4a69-9ac6-8b640b0bfd40 service neutron] Attempting to bind port 2ba5fd1c-0009-4970-b169-7f8dca923e34 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:19:23.238260 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-aece42a1-243f-4a69-9ac6-8b640b0bfd40 service neutron] Attempting to bind port 2ba5fd1c-0009-4970-b169-7f8dca923e34 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:23.245711 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-aece42a1-243f-4a69-9ac6-8b640b0bfd40 service neutron] Port 2ba5fd1c-0009-4970-b169-7f8dca923e34 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:19:23.246155 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-aece42a1-243f-4a69-9ac6-8b640b0bfd40 service neutron] Attempting to bind port 2ba5fd1c-0009-4970-b169-7f8dca923e34 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:23.249728 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a7393d3-a2fc-4b09-b844-a3c04ab08b5d req-565e2306-82e1-4fcd-af7f-f61c5baf44c1 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:23.257132 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4a7393d3-a2fc-4b09-b844-a3c04ab08b5d req-565e2306-82e1-4fcd-af7f-f61c5baf44c1 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 1097 time: 0.1685514 Dec 09 21:19:23.289917 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-aece42a1-243f-4a69-9ac6-8b640b0bfd40 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 18, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:19:23.290399 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-aece42a1-243f-4a69-9ac6-8b640b0bfd40 service neutron] Checking segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:19:23.290791 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-aece42a1-243f-4a69-9ac6-8b640b0bfd40 service neutron] Bound using segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:19:23.291606 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-aece42a1-243f-4a69-9ac6-8b640b0bfd40 service neutron] Bound port: 2ba5fd1c-0009-4970-b169-7f8dca923e34, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:19:23.291728 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-aece42a1-243f-4a69-9ac6-8b640b0bfd40 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:23.295419 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-e42e2adf-9dcb-4cf8-9023-b57128cc7bc5 admin admin] Deleting port 83bb56df-8fc2-46ae-84d3-bda4fe854463 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:19:23.296104 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e42e2adf-9dcb-4cf8-9023-b57128cc7bc5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:23.300665 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf55e335-7915-48ee-b4e2-6d09735ae803 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:23.303935 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf55e335-7915-48ee-b4e2-6d09735ae803 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:23.305663 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cf55e335-7915-48ee-b4e2-6d09735ae803 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/893a48be-e7f7-4267-89cf-1871b557e48d HTTP/1.1" status: 204 len: 168 time: 0.2684956 Dec 09 21:19:23.327777 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4e1dacb6-0d16-4d61-a565-0cfe0a134332 x-openstack-request-id: req-4e1dacb6-0d16-4d61-a565-0cfe0a134332 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:23.327934 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf55e335-7915-48ee-b4e2-6d09735ae803 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=893a48be-e7f7-4267-89cf-1871b557e48d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:23.328103 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42", "name": "network-vif-unplugged", "status": "completed", "tag": "2ba5fd1c-0009-4970-b169-7f8dca923e34", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:23.328361 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-4e1dacb6-0d16-4d61-a565-0cfe0a134332 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:23.328925 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd0cb5c61-bab4-4b8b-aa1e-0efbe9992f42', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2ba5fd1c-0009-4970-b169-7f8dca923e34', 'code': 200} Dec 09 21:19:23.335626 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-23aa97be-7058-4ea4-9742-a3b544ec1bde admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:23.340725 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-3e50f858-9455-4d54-a8b9-e38f0022adb7 None None] Set router 70ade903-ee3e-4040-8855-b2a937f2a0d9 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:19:23.342661 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-23aa97be-7058-4ea4-9742-a3b544ec1bde admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:23.346310 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-23aa97be-7058-4ea4-9742-a3b544ec1bde admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/7f90b84e-edcf-49ec-aecd-63eca8b0fa6b HTTP/1.1" status: 204 len: 168 time: 0.5134439 Dec 09 21:19:23.416317 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-e42e2adf-9dcb-4cf8-9023-b57128cc7bc5 admin admin] For port 83bb56df-8fc2-46ae-84d3-bda4fe854463, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=83bb56df-8fc2-46ae-84d3-bda4fe854463,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:23.417200 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e42e2adf-9dcb-4cf8-9023-b57128cc7bc5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:23.434204 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-e42e2adf-9dcb-4cf8-9023-b57128cc7bc5 admin admin] Calling delete_port for 83bb56df-8fc2-46ae-84d3-bda4fe854463 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:19:23.463457 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23aa97be-7058-4ea4-9742-a3b544ec1bde admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7f90b84e-edcf-49ec-aecd-63eca8b0fa6b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:23.495932 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4a7393d3-a2fc-4b09-b844-a3c04ab08b5d req-6e9305f9-7c38-42a1-806f-d331e0786187 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2378159 Dec 09 21:19:23.571541 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-aece42a1-243f-4a69-9ac6-8b640b0bfd40 service neutron] For port 2ba5fd1c-0009-4970-b169-7f8dca923e34, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:23.575422 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-aece42a1-243f-4a69-9ac6-8b640b0bfd40 service neutron] For port 2ba5fd1c-0009-4970-b169-7f8dca923e34, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2ba5fd1c-0009-4970-b169-7f8dca923e34,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:19:23.589739 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-aece42a1-243f-4a69-9ac6-8b640b0bfd40 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:23.629682 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1324c1e6-d7af-4f8a-9061-319aeb6f39a6 req-8e4530fb-401c-4b2c-9399-20c9ee8afb64 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:23.637506 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1324c1e6-d7af-4f8a-9061-319aeb6f39a6 req-8e4530fb-401c-4b2c-9399-20c9ee8afb64 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 943 time: 0.2126989 Dec 09 21:19:23.647308 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-3e50f858-9455-4d54-a8b9-e38f0022adb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:19:21Z', 'revision_number': 5, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:23.730306 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3e50f858-9455-4d54-a8b9-e38f0022adb7 None None] The sync data for ids ['70ade903-ee3e-4040-8855-b2a937f2a0d9'] in n-d-713301-27 is: [{'id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'name': 'tempest-FloatingIPsAssociationTestJSON-1292926441-router', 'tenant_id': '920e0419877f4239b048e126682274e9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107'}], 'enable_snat': True}, 'gw_port_id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:55Z', 'updated_at': '2021-12-09T21:19:21Z', 'revision_number': 5, 'project_id': '920e0419877f4239b048e126682274e9', 'gw_port': {'id': '83bb56df-8fc2-46ae-84d3-bda4fe854463', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:b9:b0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '70ade903-ee3e-4040-8855-b2a937f2a0d9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 243, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:56Z', 'updated_at': '2021-12-09T21:18:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:19:23.759185 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e42e2adf-9dcb-4cf8-9023-b57128cc7bc5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:23.791613 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aece42a1-243f-4a69-9ac6-8b640b0bfd40 service neutron] Pushing event updated for resources: {'Port': ['ID=2ba5fd1c-0009-4970-b169-7f8dca923e34,revision_number=8']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:23.798387 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-aece42a1-243f-4a69-9ac6-8b640b0bfd40 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:23.799386 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-aece42a1-243f-4a69-9ac6-8b640b0bfd40 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:23.801205 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-aece42a1-243f-4a69-9ac6-8b640b0bfd40 service neutron] 10.222.0.10 "PUT /v2.0/ports/2ba5fd1c-0009-4970-b169-7f8dca923e34 HTTP/1.1" status: 200 len: 1123 time: 1.8377149 Dec 09 21:19:23.814943 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1324c1e6-d7af-4f8a-9061-319aeb6f39a6 req-3c9d04d5-50a3-402e-9779-fa089bac8b33 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1759903 Dec 09 21:19:23.855664 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e42e2adf-9dcb-4cf8-9023-b57128cc7bc5 admin admin] Pushing event deleted for resources: {'Port': ['ID=83bb56df-8fc2-46ae-84d3-bda4fe854463,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:23.870872 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['2ba5fd1c-0009-4970-b169-7f8dca923e34'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:19:23.963831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f04a206c-9932-4fc0-9135-311a9815e1c2 req-1927cf58-b5be-4cd2-a714-25538cea1c40 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:23.966074 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f04a206c-9932-4fc0-9135-311a9815e1c2 req-1927cf58-b5be-4cd2-a714-25538cea1c40 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.0718033 Dec 09 21:19:23.984459 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e42e2adf-9dcb-4cf8-9023-b57128cc7bc5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:24.063258 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f04a206c-9932-4fc0-9135-311a9815e1c2 req-f62dafb3-d01f-4fa3-aa06-a5161a6899f6 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0901673 Dec 09 21:19:24.146937 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device b615e863-071a-473e-8d66-8f84f78d1453 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:19:24.147640 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e42e2adf-9dcb-4cf8-9023-b57128cc7bc5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:24.150027 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e42e2adf-9dcb-4cf8-9023-b57128cc7bc5 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:24.173911 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: b615e863-071a-473e-8d66-8f84f78d1453 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:19:24.174509 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device b615e863-071a-473e-8d66-8f84f78d1453 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:19:24.175088 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 2dae91d7-35c0-4f49-bedd-e9ae0003a027 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:19:24.198342 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 2dae91d7-35c0-4f49-bedd-e9ae0003a027 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:19:24.198857 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 2dae91d7-35c0-4f49-bedd-e9ae0003a027 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:19:24.252063 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e42e2adf-9dcb-4cf8-9023-b57128cc7bc5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:24.252794 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e42e2adf-9dcb-4cf8-9023-b57128cc7bc5 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 70ade903-ee3e-4040-8855-b2a937f2a0d9 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:19:24.276390 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e42e2adf-9dcb-4cf8-9023-b57128cc7bc5 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:24.281825 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e42e2adf-9dcb-4cf8-9023-b57128cc7bc5 admin admin] 10.222.0.13 "DELETE /v2.0/routers/70ade903-ee3e-4040-8855-b2a937f2a0d9 HTTP/1.1" status: 204 len: 168 time: 1.6323349 Dec 09 21:19:24.285651 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57422) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:24.346127 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-6e5ef358-d875-41c2-842f-e350012a0a31 admin admin] Deleting subnet 3260fc19-8e10-46a2-82c6-3b2d5eda4a0e {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:19:24.355912 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6e5ef358-d875-41c2-842f-e350012a0a31 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:24.424718 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6e5ef358-d875-41c2-842f-e350012a0a31 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:24.461742 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e6d3f3c-08e6-45bd-bbb3-9c337d7bcc2b req-3bbb841c-1d64-465a-92c2-3b2911b0d1e6 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:24.465030 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e6d3f3c-08e6-45bd-bbb3-9c337d7bcc2b req-3bbb841c-1d64-465a-92c2-3b2911b0d1e6 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 950 time: 0.1131806 Dec 09 21:19:24.601189 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e6d3f3c-08e6-45bd-bbb3-9c337d7bcc2b req-5e179e04-78b1-4f55-869e-9085ca1dcd3a tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1241968 Dec 09 21:19:24.622193 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6e5ef358-d875-41c2-842f-e350012a0a31 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:24.721836 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6e5ef358-d875-41c2-842f-e350012a0a31 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:24.760879 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6e5ef358-d875-41c2-842f-e350012a0a31 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:24.764128 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6e5ef358-d875-41c2-842f-e350012a0a31 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/3260fc19-8e10-46a2-82c6-3b2d5eda4a0e HTTP/1.1" status: 204 len: 168 time: 0.4772954 Dec 09 21:19:24.765181 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e5ef358-d875-41c2-842f-e350012a0a31 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3260fc19-8e10-46a2-82c6-3b2d5eda4a0e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:24.767423 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57452) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:24.769227 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71eab165-dbf6-4f83-843d-ada68a4f132a None None] Network eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:19:24.918846 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0832b49d-b72a-4a3e-9db5-aa34db795935 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:25.002962 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-0832b49d-b72a-4a3e-9db5-aa34db795935 admin admin] Deleting port 83aab428-de6e-4b16-aa5f-20c9298e895e {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:19:25.004794 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0832b49d-b72a-4a3e-9db5-aa34db795935 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:25.031867 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6996b0a0-d470-48c5-9f09-78ab743cac7d req-2300cb37-7bd2-4796-8375-74a51001f840 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:25.034536 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6996b0a0-d470-48c5-9f09-78ab743cac7d req-2300cb37-7bd2-4796-8375-74a51001f840 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 943 time: 0.1015968 Dec 09 21:19:25.058492 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8213fe9e-6c2a-4200-aaba-15ec870d2216 None None] DHCP port deletion for eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:19:25.137524 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6996b0a0-d470-48c5-9f09-78ab743cac7d req-2dec2df2-4b77-4299-ba44-db144c9accff tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0972285 Dec 09 21:19:25.149443 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-0832b49d-b72a-4a3e-9db5-aa34db795935 admin admin] For port 83aab428-de6e-4b16-aa5f-20c9298e895e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=83aab428-de6e-4b16-aa5f-20c9298e895e,segment=NetworkSegment(c1e3b516-6ad9-46a2-acfa-cf795ad5b916),segment_id=c1e3b516-6ad9-46a2-acfa-cf795ad5b916)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:25.150364 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0832b49d-b72a-4a3e-9db5-aa34db795935 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:25.174117 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-0832b49d-b72a-4a3e-9db5-aa34db795935 admin admin] Calling delete_port for 83aab428-de6e-4b16-aa5f-20c9298e895e owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:19:25.185364 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-c76c59a5-1096-4c21-85d2-f3b1cbcac397 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:19:25.185504 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-8213fe9e-6c2a-4200-aaba-15ec870d2216 None None] Deleting port 83aab428-de6e-4b16-aa5f-20c9298e895e {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:19:25.185825 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8213fe9e-6c2a-4200-aaba-15ec870d2216 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:25.186367 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-c76c59a5-1096-4c21-85d2-f3b1cbcac397 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0081143 Dec 09 21:19:25.268868 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-8213fe9e-6c2a-4200-aaba-15ec870d2216 None None] For port 83aab428-de6e-4b16-aa5f-20c9298e895e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=83aab428-de6e-4b16-aa5f-20c9298e895e,segment=NetworkSegment(c1e3b516-6ad9-46a2-acfa-cf795ad5b916),segment_id=c1e3b516-6ad9-46a2-acfa-cf795ad5b916)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:25.269675 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8213fe9e-6c2a-4200-aaba-15ec870d2216 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:25.288587 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-8213fe9e-6c2a-4200-aaba-15ec870d2216 None None] Calling delete_port for 83aab428-de6e-4b16-aa5f-20c9298e895e owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:19:25.296770 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-dd48a00f-4e89-4f4c-9fea-371807fc2592 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:25.298333 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-dd48a00f-4e89-4f4c-9fea-371807fc2592 service neutron] 10.222.0.13 "GET /v2.0/ports/cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 HTTP/1.1" status: 200 len: 1094 time: 0.1031625 Dec 09 21:19:25.314737 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-d6ddd7c1-55a3-411f-ac60-a639af1b5058 service neutron] Request body: {'binding': {'host': 'n-h1-713301-27', 'vnic_type': 'normal', 'profile': {}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:25.315200 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-d6ddd7c1-55a3-411f-ac60-a639af1b5058 service neutron] Unknown quota resources ['binding']. {{(pid=103437) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 09 21:19:25.329991 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd0cb5c61-bab4-4b8b-aa1e-0efbe9992f42', 'tag': '2ba5fd1c-0009-4970-b169-7f8dca923e34'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:25.332785 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-15fc8ea6-4ab1-4c83-922e-34ff43a7d6ac" -d '{"events": [{"name": "network-changed", "server_uuid": "d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42", "tag": "2ba5fd1c-0009-4970-b169-7f8dca923e34"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:25.352864 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e090e9c2-eb1c-47d7-9d6b-987f41f81cfb req-a294ddce-c742-4f27-86a6-8522eb233d46 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:25.355233 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0832b49d-b72a-4a3e-9db5-aa34db795935 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:25.356135 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e090e9c2-eb1c-47d7-9d6b-987f41f81cfb req-a294ddce-c742-4f27-86a6-8522eb233d46 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.0949612 Dec 09 21:19:25.399623 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0832b49d-b72a-4a3e-9db5-aa34db795935 admin admin] Pushing event deleted for resources: {'Port': ['ID=83aab428-de6e-4b16-aa5f-20c9298e895e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:25.407214 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0832b49d-b72a-4a3e-9db5-aa34db795935 admin admin] No DVR routers for this DVR port 83aab428-de6e-4b16-aa5f-20c9298e895e on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:19:25.425068 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e090e9c2-eb1c-47d7-9d6b-987f41f81cfb req-80e959f3-acf0-4bad-a16c-ee2f29163c4d tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0614946 Dec 09 21:19:25.517566 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8213fe9e-6c2a-4200-aaba-15ec870d2216 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:25.560805 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8213fe9e-6c2a-4200-aaba-15ec870d2216 None None] Pushing event deleted for resources: {'Port': ['ID=83aab428-de6e-4b16-aa5f-20c9298e895e,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:25.567663 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8213fe9e-6c2a-4200-aaba-15ec870d2216 None None] No DVR routers for this DVR port 83aab428-de6e-4b16-aa5f-20c9298e895e on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:19:25.574020 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8b825426-5402-4da6-a0b4-22e6f0d08a2b x-openstack-request-id: req-8b825426-5402-4da6-a0b4-22e6f0d08a2b {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:25.574847 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42", "tag": "2ba5fd1c-0009-4970-b169-7f8dca923e34", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:25.575241 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8b825426-5402-4da6-a0b4-22e6f0d08a2b {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:25.575749 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd0cb5c61-bab4-4b8b-aa1e-0efbe9992f42', 'tag': '2ba5fd1c-0009-4970-b169-7f8dca923e34', 'status': 'completed', 'code': 200} Dec 09 21:19:25.580174 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-59fe8186-335f-4a83-b744-52127de0f084 service neutron] show failed (client error): The resource could not be found. Dec 09 21:19:25.581837 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-59fe8186-335f-4a83-b744-52127de0f084 service neutron] 10.222.0.10 "GET /v2.0/ports/204e6970-8ed3-4e91-9792-52401052a153/bindings/n-h1-713301-27 HTTP/1.1" status: 404 len: 381 time: 0.0710418 Dec 09 21:19:25.584818 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0832b49d-b72a-4a3e-9db5-aa34db795935 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:25.665750 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-0832b49d-b72a-4a3e-9db5-aa34db795935 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:25.675873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-d6ddd7c1-55a3-411f-ac60-a639af1b5058 service neutron] Attempting to bind port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 on host n-h1-713301-27 for vnic_type normal with profile None {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:19:25.677445 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-d6ddd7c1-55a3-411f-ac60-a639af1b5058 service neutron] Attempting to bind port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:19:25.677885 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-d6ddd7c1-55a3-411f-ac60-a639af1b5058 service neutron] Attempting to bind port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:25.713529 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 72070289-8347-44bd-bfb9-9510e94eb5bd no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:19:25.718446 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-d6ddd7c1-55a3-411f-ac60-a639af1b5058 service neutron] Port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 on network 04fa749a-9f72-4a2c-a725-feab917f99ef not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:19:25.718775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-d6ddd7c1-55a3-411f-ac60-a639af1b5058 service neutron] Attempting to bind port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:25.723855 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-0832b49d-b72a-4a3e-9db5-aa34db795935 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c1e3b516-6ad9-46a2-acfa-cf795ad5b916') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:25.724160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-0832b49d-b72a-4a3e-9db5-aa34db795935 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c1e3b516-6ad9-46a2-acfa-cf795ad5b916') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:25.747905 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 72070289-8347-44bd-bfb9-9510e94eb5bd {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:19:25.749399 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 72070289-8347-44bd-bfb9-9510e94eb5bd not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:19:25.750046 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 83bb56df-8fc2-46ae-84d3-bda4fe854463 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:19:25.758342 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0832b49d-b72a-4a3e-9db5-aa34db795935 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:25.762268 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-d6ddd7c1-55a3-411f-ac60-a639af1b5058 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 18, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:19:25.762487 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc8c8868-e1e7-4ed8-9c83-81d30005e8a0 req-693b6090-22ff-4980-be35-1fd8838df29d tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:25.762719 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-d6ddd7c1-55a3-411f-ac60-a639af1b5058 service neutron] Checking segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:19:25.763128 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-d6ddd7c1-55a3-411f-ac60-a639af1b5058 service neutron] Bound using segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:19:25.763877 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-d6ddd7c1-55a3-411f-ac60-a639af1b5058 service neutron] Bound port: cb941377-5fe0-4e9e-9ac5-1fb6253c78d7, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:19:25.764084 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc8c8868-e1e7-4ed8-9c83-81d30005e8a0 req-693b6090-22ff-4980-be35-1fd8838df29d tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 950 time: 0.0629356 Dec 09 21:19:25.774642 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15fc8ea6-4ab1-4c83-922e-34ff43a7d6ac req-d6c792bf-da8d-4969-aacd-dd599a753403 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:25.776350 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-15fc8ea6-4ab1-4c83-922e-34ff43a7d6ac req-d6c792bf-da8d-4969-aacd-dd599a753403 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 1126 time: 0.2097437 Dec 09 21:19:25.779198 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 83bb56df-8fc2-46ae-84d3-bda4fe854463 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:19:25.780628 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 83bb56df-8fc2-46ae-84d3-bda4fe854463 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:19:25.781362 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 83aab428-de6e-4b16-aa5f-20c9298e895e no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:19:25.803609 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 83aab428-de6e-4b16-aa5f-20c9298e895e {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:19:25.804094 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 83aab428-de6e-4b16-aa5f-20c9298e895e not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:19:25.834961 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc8c8868-e1e7-4ed8-9c83-81d30005e8a0 req-1666638e-2bad-4ecf-bd13-73fadaf9a38e tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0644085 Dec 09 21:19:25.874115 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0832b49d-b72a-4a3e-9db5-aa34db795935 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:25.882335 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0832b49d-b72a-4a3e-9db5-aa34db795935 admin admin] Releasing vlan 137 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:19:25.883143 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0832b49d-b72a-4a3e-9db5-aa34db795935 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:19:25.942155 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:19:25.972976 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0832b49d-b72a-4a3e-9db5-aa34db795935 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:25.975194 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-ba1db90b-175a-466d-a039-a75963901f41 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:25.977112 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-ba1db90b-175a-466d-a039-a75963901f41 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8&tenant_id=857de64ecc3946e3b92655f639d782df HTTP/1.1" status: 200 len: 1102 time: 0.1077628 Dec 09 21:19:25.990216 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] Request body: {'port': {'binding:host_id': 'n-h1-713301-27', 'device_owner': 'compute:nova'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:26.026878 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-d6ddd7c1-55a3-411f-ac60-a639af1b5058 service neutron] For port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:19:26.031430 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0832b49d-b72a-4a3e-9db5-aa34db795935 admin admin] Pushing event deleted for resources: {'Network': ['ID=eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:26.034146 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0832b49d-b72a-4a3e-9db5-aa34db795935 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:26.038785 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0832b49d-b72a-4a3e-9db5-aa34db795935 admin admin] 10.222.0.13 "DELETE /v2.0/networks/eaf04329-3b6b-4ebc-9828-8e1ddfeb46d3 HTTP/1.1" status: 204 len: 168 time: 1.2699716 Dec 09 21:19:26.047373 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-d6ddd7c1-55a3-411f-ac60-a639af1b5058 service neutron] Publish callbacks [] for binding, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:26.048798 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-d6ddd7c1-55a3-411f-ac60-a639af1b5058 service neutron] 10.222.0.13 "POST /v2.0/ports/cb941377-5fe0-4e9e-9ac5-1fb6253c78d7/bindings HTTP/1.1" status: 201 len: 390 time: 0.7382076 Dec 09 21:19:26.062276 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:26.077171 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15fc8ea6-4ab1-4c83-922e-34ff43a7d6ac req-3042cfc8-90bb-4362-9878-7a64a9091d1b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:26.078651 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-15fc8ea6-4ab1-4c83-922e-34ff43a7d6ac req-3042cfc8-90bb-4362-9878-7a64a9091d1b service neutron] 10.222.0.31 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 922 time: 0.2526472 Dec 09 21:19:26.123965 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 2ba5fd1c-0009-4970-b169-7f8dca923e34 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:19:26.129723 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-15fc8ea6-4ab1-4c83-922e-34ff43a7d6ac req-44858509-13a8-431e-ab45-8d488c1c8e35 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=2ba5fd1c-0009-4970-b169-7f8dca923e34 HTTP/1.1" status: 200 len: 217 time: 0.0434539 Dec 09 21:19:26.268590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15fc8ea6-4ab1-4c83-922e-34ff43a7d6ac req-f5095ace-4f74-4c51-a8bb-9d4d729ff3e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:26.273249 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-15fc8ea6-4ab1-4c83-922e-34ff43a7d6ac req-f5095ace-4f74-4c51-a8bb-9d4d729ff3e6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=c49a62cc-af1b-4958-a4a9-eb44188b8fb9 HTTP/1.1" status: 200 len: 861 time: 0.1365519 Dec 09 21:19:26.351577 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-15fc8ea6-4ab1-4c83-922e-34ff43a7d6ac req-4ea95e59-9484-420e-8e01-4d8f5af5aebd service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=93378dc3-2ac5-4cf7-9ce3-d812934de40c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0669737 Dec 09 21:19:26.358130 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 2ba5fd1c-0009-4970-b169-7f8dca923e34, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2ba5fd1c-0009-4970-b169-7f8dca923e34,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:26.387128 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 2ba5fd1c-0009-4970-b169-7f8dca923e34 has no active binding in host n-h2-713301-27 {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:158}} Dec 09 21:19:26.399234 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] For port 204e6970-8ed3-4e91-9792-52401052a153, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=204e6970-8ed3-4e91-9792-52401052a153,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:26.465305 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-67d72c74-e5d8-4d32-9916-70f036eb1bd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:26.466874 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-67d72c74-e5d8-4d32-9916-70f036eb1bd1 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 1097 time: 0.1185734 Dec 09 21:19:26.483116 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57508) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:26.501723 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-15fc8ea6-4ab1-4c83-922e-34ff43a7d6ac req-7f8fae10-9b78-4461-b70f-792382e3e18f service neutron] 10.222.0.31 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1401422 Dec 09 21:19:26.501950 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f49e74a1-1a02-4ae1-b1e7-6d8e33abde42 req-6c96194d-4e91-458d-8ac7-9a4fd17c09c3 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:26.503506 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f49e74a1-1a02-4ae1-b1e7-6d8e33abde42 req-6c96194d-4e91-458d-8ac7-9a4fd17c09c3 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 945 time: 0.1122723 Dec 09 21:19:26.523148 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] For port 204e6970-8ed3-4e91-9792-52401052a153, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:26.556223 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f33431e-3cfa-4074-bc6a-830b0482f775 req-cb08b33d-b1d5-47c5-8004-e6439bac24b4 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:26.557574 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f33431e-3cfa-4074-bc6a-830b0482f775 req-cb08b33d-b1d5-47c5-8004-e6439bac24b4 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 943 time: 0.1651034 Dec 09 21:19:26.634319 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-d41f9ff3-2074-47b4-b513-0e3390839ae6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:26.634617 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:26.635815 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-d41f9ff3-2074-47b4-b513-0e3390839ae6 service neutron] 10.222.0.31 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 908 time: 0.1613653 Dec 09 21:19:26.647646 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-39a25cce-f82d-4053-ba72-5b756450c1d2 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=920e0419877f4239b048e126682274e9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1617196 Dec 09 21:19:26.654205 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57510) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:26.668516 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f49e74a1-1a02-4ae1-b1e7-6d8e33abde42 req-e36a9e6b-986c-4e53-8981-99512388471a tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1466296 Dec 09 21:19:26.677307 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] Transition to ACTIVE for port object 204e6970-8ed3-4e91-9792-52401052a153 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:19:26.682571 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f33431e-3cfa-4074-bc6a-830b0482f775 req-29a044ef-fb86-4831-aab8-32a17a098d09 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1113324 Dec 09 21:19:26.691558 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:26.696378 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-15fc8ea6-4ab1-4c83-922e-34ff43a7d6ac req-f86d9c32-03db-4de7-8355-3bab68bdea31 service neutron] 10.222.0.31 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1822088 Dec 09 21:19:26.699282 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-8484f5c3-7b69-4bde-8629-9e0316888c5c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 HTTP/1.1" status: 200 len: 217 time: 0.0521276 Dec 09 21:19:26.799169 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] No DVR routers for this DVR port 204e6970-8ed3-4e91-9792-52401052a153 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:19:26.804145 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] Pushing event updated for resources: {'Port': ['ID=204e6970-8ed3-4e91-9792-52401052a153,revision_number=6']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:26.830655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-0442674e-faf0-44e5-a9da-cd00299d3b82 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:26.832640 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-0442674e-faf0-44e5-a9da-cd00299d3b82 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=eae2438b-9fcc-44ef-a172-6c4911cad13f HTTP/1.1" status: 200 len: 847 time: 0.1253831 Dec 09 21:19:26.876359 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de167c43-dd7a-44b4-8550-f9caae56a83f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:26.881181 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-6983dacb-e91e-4ea5-a674-75dbebb3f50b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=04fa749a-9f72-4a2c-a725-feab917f99ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0403199 Dec 09 21:19:26.883017 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] Attempting to bind port 204e6970-8ed3-4e91-9792-52401052a153 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:19:26.883306 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] Attempting to bind port 204e6970-8ed3-4e91-9792-52401052a153 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:19:26.883888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] Attempting to bind port 204e6970-8ed3-4e91-9792-52401052a153 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:26.893675 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] Port 204e6970-8ed3-4e91-9792-52401052a153 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:19:26.894002 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] Attempting to bind port 204e6970-8ed3-4e91-9792-52401052a153 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:26.900960 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 18, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:19:26.901302 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:19:26.901691 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:19:26.902508 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] Bound port: 204e6970-8ed3-4e91-9792-52401052a153, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:19:26.902900 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:26.905156 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:26.930097 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de167c43-dd7a-44b4-8550-f9caae56a83f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:26.967272 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d95c13c2-3aeb-4e8f-bb7e-e2d011113c0d req-93a36f94-6ff8-46aa-b560-570b0c4a041c tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:26.975472 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d95c13c2-3aeb-4e8f-bb7e-e2d011113c0d req-93a36f94-6ff8-46aa-b560-570b0c4a041c tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.1312842 Dec 09 21:19:27.030334 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:27.048763 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d95c13c2-3aeb-4e8f-bb7e-e2d011113c0d req-9ef86c94-02d0-4aa5-b1cd-a7e91bc925df tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0717824 Dec 09 21:19:27.068268 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] For port 204e6970-8ed3-4e91-9792-52401052a153, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:27.091943 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] For port 204e6970-8ed3-4e91-9792-52401052a153, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=204e6970-8ed3-4e91-9792-52401052a153,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:19:27.100603 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:27.165122 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:27.168070 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:27.169728 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] 10.222.0.31 "PUT /v2.0/ports/204e6970-8ed3-4e91-9792-52401052a153 HTTP/1.1" status: 200 len: 1097 time: 1.1842780 Dec 09 21:19:27.269500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-804861ae-481d-4fae-a698-71923ea5edb0 service neutron] Pushing event updated for resources: {'Port': ['ID=204e6970-8ed3-4e91-9792-52401052a153,revision_number=7']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:27.273344 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-914c62ca-f367-464c-9619-985ad267d981 service neutron] 10.222.0.31 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3815544 Dec 09 21:19:27.288916 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84999848-1b63-4abc-8338-cc965d793e14 req-95d7699f-2f0c-4089-a65b-41d7970faa16 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:27.291612 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84999848-1b63-4abc-8338-cc965d793e14 req-95d7699f-2f0c-4089-a65b-41d7970faa16 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 948 time: 0.1207473 Dec 09 21:19:27.304292 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-274f6833-4634-4c29-86dd-030ac657d646 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:27.306895 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-274f6833-4634-4c29-86dd-030ac657d646 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 1100 time: 0.0973096 Dec 09 21:19:27.363952 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de167c43-dd7a-44b4-8550-f9caae56a83f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:27.366639 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de167c43-dd7a-44b4-8550-f9caae56a83f admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:27.370434 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-de167c43-dd7a-44b4-8550-f9caae56a83f admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/174c6f0d-c012-4077-858c-aa2b94e54d38 HTTP/1.1" status: 204 len: 168 time: 0.7112131 Dec 09 21:19:27.390710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de167c43-dd7a-44b4-8550-f9caae56a83f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=174c6f0d-c012-4077-858c-aa2b94e54d38,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:27.396747 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-84baa8a3-89f7-4d98-b162-6c1f665bb7c5 service neutron] 10.222.0.31 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1148310 Dec 09 21:19:27.502339 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84999848-1b63-4abc-8338-cc965d793e14 req-402d30fe-b332-4b42-a2b8-caa781fe6453 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1941097 Dec 09 21:19:27.523530 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-7bc2ba7b-89e0-448c-aa2a-6101d9ca30dd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:27.525478 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-7bc2ba7b-89e0-448c-aa2a-6101d9ca30dd service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.2070863 Dec 09 21:19:27.569813 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-a857031c-e8cf-4d1c-968b-7fa795699349 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:27.571378 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-a857031c-e8cf-4d1c-968b-7fa795699349 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834&tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&binding%3Ahost_id=n-h2-713301-27 HTTP/1.1" status: 200 len: 1097 time: 0.0995965 Dec 09 21:19:27.578113 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e6fbd1df-a53f-4f75-810f-f90ea3677ac8', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '204e6970-8ed3-4e91-9792-52401052a153'}, {'name': 'network-changed', 'server_uuid': 'e6fbd1df-a53f-4f75-810f-f90ea3677ac8', 'tag': '204e6970-8ed3-4e91-9792-52401052a153'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:27.580797 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-27efb2e2-4b61-4ae4-8700-cf1367c8198a" -d '{"events": [{"server_uuid": "e6fbd1df-a53f-4f75-810f-f90ea3677ac8", "name": "network-vif-unplugged", "status": "completed", "tag": "204e6970-8ed3-4e91-9792-52401052a153"}, {"name": "network-changed", "server_uuid": "e6fbd1df-a53f-4f75-810f-f90ea3677ac8", "tag": "204e6970-8ed3-4e91-9792-52401052a153"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:27.585650 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-5c017d69-3c60-4b5c-b277-18eb71eddb8a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.145&port_id=204e6970-8ed3-4e91-9792-52401052a153 HTTP/1.1" status: 200 len: 217 time: 0.0518837 Dec 09 21:19:27.603500 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-5f819812-fa7d-49cd-8416-d58adc8c4557 service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h1-713301-27'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:27.659989 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-55e0fa85-786a-4716-9685-71e7d8b880d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:27.661675 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-55e0fa85-786a-4716-9685-71e7d8b880d8 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0686591 Dec 09 21:19:27.695356 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 352 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0af39220-ab4a-4659-9b72-f4e946f40166 x-openstack-request-id: req-0af39220-ab4a-4659-9b72-f4e946f40166 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:27.695356 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e6fbd1df-a53f-4f75-810f-f90ea3677ac8", "name": "network-vif-unplugged", "status": "completed", "tag": "204e6970-8ed3-4e91-9792-52401052a153", "code": 200}, {"name": "network-changed", "server_uuid": "e6fbd1df-a53f-4f75-810f-f90ea3677ac8", "tag": "204e6970-8ed3-4e91-9792-52401052a153", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:27.704856 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0af39220-ab4a-4659-9b72-f4e946f40166 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:27.705132 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e6fbd1df-a53f-4f75-810f-f90ea3677ac8', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '204e6970-8ed3-4e91-9792-52401052a153', 'code': 200} Dec 09 21:19:27.707597 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e6fbd1df-a53f-4f75-810f-f90ea3677ac8', 'tag': '204e6970-8ed3-4e91-9792-52401052a153', 'status': 'completed', 'code': 200} Dec 09 21:19:27.737902 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-5f819812-fa7d-49cd-8416-d58adc8c4557 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:27.906722 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-5f819812-fa7d-49cd-8416-d58adc8c4557 service neutron] For port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:27.919667 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57556) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:27.939487 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-8d15e852-ea5e-47a6-940b-d95aeff6328c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:27.941384 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-8d15e852-ea5e-47a6-940b-d95aeff6328c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.2719736 Dec 09 21:19:27.970916 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27efb2e2-4b61-4ae4-8700-cf1367c8198a req-48b9e591-bee2-4b2a-b89f-00b7e28605e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:27.972659 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27efb2e2-4b61-4ae4-8700-cf1367c8198a req-48b9e591-bee2-4b2a-b89f-00b7e28605e7 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 1100 time: 0.2641816 Dec 09 21:19:27.976132 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-5f819812-fa7d-49cd-8416-d58adc8c4557 service neutron] For port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:28.008264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16293e2a-71f8-475b-bb11-51a804f59ca3 req-40940a0b-8fcc-4129-bb89-32756f5bc1c8 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:28.015501 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-16293e2a-71f8-475b-bb11-51a804f59ca3 req-40940a0b-8fcc-4129-bb89-32756f5bc1c8 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 943 time: 0.1735110 Dec 09 21:19:28.029235 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9f03f0c3-a9b7-47c8-84b7-e9329ceed834', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'cb941377-5fe0-4e9e-9ac5-1fb6253c78d7'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:28.031561 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5805081e-ddb9-4fb6-a6d2-3666523eb8c6 req-e6800bdb-d728-4913-8e54-da59f5bef509 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:28.033099 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ed63c71d-494c-45ac-a84f-8e3988f131ba" -d '{"events": [{"server_uuid": "9f03f0c3-a9b7-47c8-84b7-e9329ceed834", "name": "network-vif-unplugged", "status": "completed", "tag": "cb941377-5fe0-4e9e-9ac5-1fb6253c78d7"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:28.033261 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5805081e-ddb9-4fb6-a6d2-3666523eb8c6 req-e6800bdb-d728-4913-8e54-da59f5bef509 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 945 time: 0.1938794 Dec 09 21:19:28.038645 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-5f819812-fa7d-49cd-8416-d58adc8c4557 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:28.048153 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-5f819812-fa7d-49cd-8416-d58adc8c4557 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:28.179496 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-5f819812-fa7d-49cd-8416-d58adc8c4557 service neutron] Attempting to bind port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 on host n-h2-713301-27 for vnic_type normal with profile {"migrating_to": "n-h1-713301-27"} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:19:28.180037 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-5f819812-fa7d-49cd-8416-d58adc8c4557 service neutron] Attempting to bind port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:19:28.180576 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-5f819812-fa7d-49cd-8416-d58adc8c4557 service neutron] Attempting to bind port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:28.182930 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f819812-fa7d-49cd-8416-d58adc8c4557 service neutron] Pushing event updated for resources: {'Port': ['ID=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7,revision_number=7']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:28.188495 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c54e6cda-230e-4d54-b0ab-c62af29ce546 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:28.191489 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57570) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:28.208439 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-5f819812-fa7d-49cd-8416-d58adc8c4557 service neutron] Port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 on network 04fa749a-9f72-4a2c-a725-feab917f99ef not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:19:28.208767 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-5f819812-fa7d-49cd-8416-d58adc8c4557 service neutron] Attempting to bind port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:28.218205 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-5f819812-fa7d-49cd-8416-d58adc8c4557 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 19, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:19:28.218553 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-5f819812-fa7d-49cd-8416-d58adc8c4557 service neutron] Checking segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:19:28.218993 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-5f819812-fa7d-49cd-8416-d58adc8c4557 service neutron] Bound using segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:19:28.219755 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-5f819812-fa7d-49cd-8416-d58adc8c4557 service neutron] Bound port: cb941377-5fe0-4e9e-9ac5-1fb6253c78d7, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:19:28.220172 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-5f819812-fa7d-49cd-8416-d58adc8c4557 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:28.248820 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27efb2e2-4b61-4ae4-8700-cf1367c8198a req-5b588e0b-7054-4784-a226-4f8bce39edcb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:28.251109 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27efb2e2-4b61-4ae4-8700-cf1367c8198a req-5b588e0b-7054-4784-a226-4f8bce39edcb service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.2627544 Dec 09 21:19:28.279570 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-16293e2a-71f8-475b-bb11-51a804f59ca3 req-352e783d-b767-46bd-9674-32a5a4fbca15 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2630529 Dec 09 21:19:28.331823 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-5f819812-fa7d-49cd-8416-d58adc8c4557 service neutron] For port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:28.336126 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-5f819812-fa7d-49cd-8416-d58adc8c4557 service neutron] For port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:19:28.346725 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eb39b8b5-7995-4bac-9f16-58b5170f4b37 x-openstack-request-id: req-eb39b8b5-7995-4bac-9f16-58b5170f4b37 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:28.347049 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9f03f0c3-a9b7-47c8-84b7-e9329ceed834", "name": "network-vif-unplugged", "status": "completed", "tag": "cb941377-5fe0-4e9e-9ac5-1fb6253c78d7", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:28.347265 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-eb39b8b5-7995-4bac-9f16-58b5170f4b37 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:28.348142 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9f03f0c3-a9b7-47c8-84b7-e9329ceed834', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'cb941377-5fe0-4e9e-9ac5-1fb6253c78d7', 'code': 200} Dec 09 21:19:28.370838 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5805081e-ddb9-4fb6-a6d2-3666523eb8c6 req-b949331d-5242-4427-8a7f-917271d0401b tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3152084 Dec 09 21:19:28.372189 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27efb2e2-4b61-4ae4-8700-cf1367c8198a req-015e9f31-d379-4c23-a0d1-657c080421ba service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.145&port_id=204e6970-8ed3-4e91-9792-52401052a153 HTTP/1.1" status: 200 len: 217 time: 0.1076820 Dec 09 21:19:28.375042 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-c326b4e8-9087-4585-acd6-4c13ec12a2d0 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4204624 Dec 09 21:19:28.385176 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-5f819812-fa7d-49cd-8416-d58adc8c4557 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:28.418679 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c54e6cda-230e-4d54-b0ab-c62af29ce546 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:28.445939 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c54e6cda-230e-4d54-b0ab-c62af29ce546 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:28.521656 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d0882b7-e44d-45a6-abe1-4a8f9593bcc0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:28.558522 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c54e6cda-230e-4d54-b0ab-c62af29ce546 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=78fbdd273e6b49efb85a00803d6bc0a2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6374075 Dec 09 21:19:28.563681 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-5f819812-fa7d-49cd-8416-d58adc8c4557 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:28.564343 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-5f819812-fa7d-49cd-8416-d58adc8c4557 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:28.565725 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-5f819812-fa7d-49cd-8416-d58adc8c4557 service neutron] 10.222.0.31 "PUT /v2.0/ports/cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 HTTP/1.1" status: 200 len: 1123 time: 0.9733553 Dec 09 21:19:28.566450 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57586) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:28.583697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27efb2e2-4b61-4ae4-8700-cf1367c8198a req-d5c0a9b7-1726-457f-893d-eba5e64b55da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:28.585390 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27efb2e2-4b61-4ae4-8700-cf1367c8198a req-d5c0a9b7-1726-457f-893d-eba5e64b55da service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.2031498 Dec 09 21:19:28.604976 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c54e6cda-230e-4d54-b0ab-c62af29ce546 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=518fd732-25cc-4cf3-a853-df6030266696,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:28.606149 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-019a17e8-bb0c-4d29-8c14-7b29c66ee2c4 req-efafa523-0cc1-41c1-a771-a9b0cba40e9f tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:28.608417 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-8aabae8f-871d-4882-8636-23faa3aebd4c service neutron] 10.222.0.31 "GET /v2.0/ports/2ba5fd1c-0009-4970-b169-7f8dca923e34/bindings/n-h2-713301-27 HTTP/1.1" status: 200 len: 385 time: 0.2590590 Dec 09 21:19:28.613792 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f819812-fa7d-49cd-8416-d58adc8c4557 service neutron] Pushing event updated for resources: {'Port': ['ID=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7,revision_number=8']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:28.620163 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-019a17e8-bb0c-4d29-8c14-7b29c66ee2c4 req-efafa523-0cc1-41c1-a771-a9b0cba40e9f tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.1935451 Dec 09 21:19:28.655739 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['cb941377-5fe0-4e9e-9ac5-1fb6253c78d7'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:19:28.675552 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6155700d-4e94-4996-bdcd-9d18aa932d1f req-9945c166-22e9-4226-9ba3-53820ef8088e service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2804816 Dec 09 21:19:28.708361 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27efb2e2-4b61-4ae4-8700-cf1367c8198a req-bd7ba75e-7acd-4fa3-ac9d-9f1b0e5e7e89 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:28.710085 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27efb2e2-4b61-4ae4-8700-cf1367c8198a req-bd7ba75e-7acd-4fa3-ac9d-9f1b0e5e7e89 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0875916 Dec 09 21:19:28.743615 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1df9daa6-7f8b-4fdb-b02e-632ad8e4efc3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:28.815812 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57590) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:28.844290 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1df9daa6-7f8b-4fdb-b02e-632ad8e4efc3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:28.854089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-019a17e8-bb0c-4d29-8c14-7b29c66ee2c4 req-747b3e0c-7cf3-4efa-b6e4-13981f778d3f tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2018795 Dec 09 21:19:28.916890 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d0882b7-e44d-45a6-abe1-4a8f9593bcc0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:28.921615 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27efb2e2-4b61-4ae4-8700-cf1367c8198a req-06990efe-818b-4527-af2d-60e84bd69cb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:28.923770 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27efb2e2-4b61-4ae4-8700-cf1367c8198a req-06990efe-818b-4527-af2d-60e84bd69cb0 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 1100 time: 0.1503499 Dec 09 21:19:28.939784 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d0882b7-e44d-45a6-abe1-4a8f9593bcc0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:28.940697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89f93600-cc72-461f-b499-aae913a65eaf req-a51a5f0c-04ff-41c5-bd80-c9692c9bf8de tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:28.942411 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89f93600-cc72-461f-b499-aae913a65eaf req-a51a5f0c-04ff-41c5-bd80-c9692c9bf8de tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 948 time: 0.1844954 Dec 09 21:19:29.010088 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d0882b7-e44d-45a6-abe1-4a8f9593bcc0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ea772ff4-8413-4e3b-bdfc-3c7eea976634,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:29.022513 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-8e6443f3-d348-45c4-8ac6-5c23911b6f17 admin admin] Request body: {'network': {'name': 'tempest-ImagesTestJSON-1101278167-network', 'tenant_id': '7233ac85d55e4123a22cfa34bc1ee70e'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:29.055644 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9d0882b7-e44d-45a6-abe1-4a8f9593bcc0 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=32883360a95747ab996365f20a0f5fe3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8596907 Dec 09 21:19:29.059469 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57594) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:29.096717 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1df9daa6-7f8b-4fdb-b02e-632ad8e4efc3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:29.099700 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1df9daa6-7f8b-4fdb-b02e-632ad8e4efc3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:29.100851 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1df9daa6-7f8b-4fdb-b02e-632ad8e4efc3 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/518fd732-25cc-4cf3-a853-df6030266696 HTTP/1.1" status: 204 len: 168 time: 0.5241005 Dec 09 21:19:29.102863 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-7af63fbf-4384-45be-a07d-f1a60e17a149 service neutron] For port 2ba5fd1c-0009-4970-b169-7f8dca923e34, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2ba5fd1c-0009-4970-b169-7f8dca923e34,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:29.109337 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8e6443f3-d348-45c4-8ac6-5c23911b6f17 admin admin] Made reservation on behalf of 7233ac85d55e4123a22cfa34bc1ee70e for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:19:29.111728 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e6443f3-d348-45c4-8ac6-5c23911b6f17 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:29.161820 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e6443f3-d348-45c4-8ac6-5c23911b6f17 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:29.163826 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1df9daa6-7f8b-4fdb-b02e-632ad8e4efc3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=518fd732-25cc-4cf3-a853-df6030266696,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:29.187718 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-7af63fbf-4384-45be-a07d-f1a60e17a149 service neutron] For port 2ba5fd1c-0009-4970-b169-7f8dca923e34, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:29.236941 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a4e453f1-d47f-47bf-a628-1b38f9a5cc45 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:29.248745 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27efb2e2-4b61-4ae4-8700-cf1367c8198a req-bbbcea71-0526-4695-82a5-14bedfcb5335 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5181422 Dec 09 21:19:29.250340 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-7af63fbf-4384-45be-a07d-f1a60e17a149 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2ba5fd1c-0009-4970-b169-7f8dca923e34 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:19:29.276522 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-7af63fbf-4384-45be-a07d-f1a60e17a149 service neutron] For port 2ba5fd1c-0009-4970-b169-7f8dca923e34, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=2ba5fd1c-0009-4970-b169-7f8dca923e34,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:29.301648 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a4e453f1-d47f-47bf-a628-1b38f9a5cc45 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:29.312919 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-7af63fbf-4384-45be-a07d-f1a60e17a149 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:29.371940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27efb2e2-4b61-4ae4-8700-cf1367c8198a req-cf9b0b06-c2a6-4361-a8f3-87bb6c96b884 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:29.373419 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27efb2e2-4b61-4ae4-8700-cf1367c8198a req-cf9b0b06-c2a6-4361-a8f3-87bb6c96b884 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.4268830 Dec 09 21:19:29.412758 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e6443f3-d348-45c4-8ac6-5c23911b6f17 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:29.425473 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e6443f3-d348-45c4-8ac6-5c23911b6f17 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:29.462900 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a4e453f1-d47f-47bf-a628-1b38f9a5cc45 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:29.465517 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a4e453f1-d47f-47bf-a628-1b38f9a5cc45 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:29.466531 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a4e453f1-d47f-47bf-a628-1b38f9a5cc45 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/ea772ff4-8413-4e3b-bdfc-3c7eea976634 HTTP/1.1" status: 204 len: 168 time: 0.4048359 Dec 09 21:19:29.479102 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8e6443f3-d348-45c4-8ac6-5c23911b6f17 admin admin] vlan segment allocate from pool success with {'vlan_id': 122, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:19:29.481061 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e6443f3-d348-45c4-8ac6-5c23911b6f17 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bb79590c-1611-4a8a-896f-563610f46135,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:29.492150 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57606) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:29.509933 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-7af63fbf-4384-45be-a07d-f1a60e17a149 service neutron] Transition to ACTIVE for port object 2ba5fd1c-0009-4970-b169-7f8dca923e34 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:19:29.510903 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4e453f1-d47f-47bf-a628-1b38f9a5cc45 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ea772ff4-8413-4e3b-bdfc-3c7eea976634,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:29.520505 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e6443f3-d348-45c4-8ac6-5c23911b6f17 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:29.520849 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-8e6443f3-d348-45c4-8ac6-5c23911b6f17 admin admin] Added segment 41babb3e-048d-47f5-b92c-d4cf9897cc70 of type vlan for network 8e0b26d7-eefe-4c85-b535-944f3c15f0f6 Dec 09 21:19:29.531562 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-7af63fbf-4384-45be-a07d-f1a60e17a149 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:29.533617 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8e673ea-99a8-4fbe-9c0f-f185d80e8b1d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:29.535344 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27efb2e2-4b61-4ae4-8700-cf1367c8198a req-27499db8-a80e-42b0-8f8b-7b4390ef0f7e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.145&port_id=204e6970-8ed3-4e91-9792-52401052a153 HTTP/1.1" status: 200 len: 217 time: 0.1000378 Dec 09 21:19:29.547699 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89f93600-cc72-461f-b499-aae913a65eaf req-a9b13b2e-5b7f-444a-a59d-9d22f3b23fc1 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3217473 Dec 09 21:19:29.614231 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27efb2e2-4b61-4ae4-8700-cf1367c8198a req-8ba409f1-f3b9-410d-96bf-601a255ff5bd service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3499765 Dec 09 21:19:29.633150 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e6443f3-d348-45c4-8ac6-5c23911b6f17 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:29.634146 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-933bcd4c-8659-43b1-bcc9-6fe099a3b61f req-4a5f5e7a-a7b0-4c52-bc0a-8a4970bfff14 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:29.635731 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-933bcd4c-8659-43b1-bcc9-6fe099a3b61f req-4a5f5e7a-a7b0-4c52-bc0a-8a4970bfff14 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 943 time: 0.2173262 Dec 09 21:19:29.637430 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27efb2e2-4b61-4ae4-8700-cf1367c8198a req-0254656c-95b5-489a-a94c-997086ae51af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:29.638809 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27efb2e2-4b61-4ae4-8700-cf1367c8198a req-0254656c-95b5-489a-a94c-997086ae51af service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0875931 Dec 09 21:19:29.673801 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-7af63fbf-4384-45be-a07d-f1a60e17a149 service neutron] No DVR routers for this DVR port 2ba5fd1c-0009-4970-b169-7f8dca923e34 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:19:29.718284 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7af63fbf-4384-45be-a07d-f1a60e17a149 service neutron] Pushing event updated for resources: {'Port': ['ID=2ba5fd1c-0009-4970-b169-7f8dca923e34,revision_number=10']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:29.758553 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-7af63fbf-4384-45be-a07d-f1a60e17a149 service neutron] 10.222.0.31 "PUT /v2.0/ports/2ba5fd1c-0009-4970-b169-7f8dca923e34/bindings/n-h2-713301-27/activate HTTP/1.1" status: 200 len: 370 time: 1.1331258 Dec 09 21:19:29.765545 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e6443f3-d348-45c4-8ac6-5c23911b6f17 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:29.767330 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e6443f3-d348-45c4-8ac6-5c23911b6f17 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:29.767999 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e6443f3-d348-45c4-8ac6-5c23911b6f17 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:29.772353 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-933bcd4c-8659-43b1-bcc9-6fe099a3b61f req-74ed884f-85d1-422b-88c3-dfc31d16d84c tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1263692 Dec 09 21:19:29.779843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27efb2e2-4b61-4ae4-8700-cf1367c8198a req-9e6565c0-1b59-49fe-be93-77a572175580 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:29.787638 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27efb2e2-4b61-4ae4-8700-cf1367c8198a req-9e6565c0-1b59-49fe-be93-77a572175580 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1376705 Dec 09 21:19:29.791012 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8e6443f3-d348-45c4-8ac6-5c23911b6f17 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 878 time: 0.9590249 Dec 09 21:19:29.806128 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57612) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:29.821229 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a7aab937-74b4-4669-92cf-5c3bb52c3834 admin admin] Request body: {'subnet': {'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6', 'cidr': '172.20.0.0/28', 'name': 'tempest-ImagesTestJSON-1101278167-subnet', 'tenant_id': '7233ac85d55e4123a22cfa34bc1ee70e', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:29.846509 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17ce6d08-6461-4c3d-8fe3-46ad2b3cb73a req-a75b1986-02a2-4f8d-9dae-fa013efd691e tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:29.853815 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-17ce6d08-6461-4c3d-8fe3-46ad2b3cb73a req-a75b1986-02a2-4f8d-9dae-fa013efd691e tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 943 time: 0.1697216 Dec 09 21:19:29.898031 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8e673ea-99a8-4fbe-9c0f-f185d80e8b1d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:29.901523 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e6443f3-d348-45c4-8ac6-5c23911b6f17 admin admin] Pushing event updated for resources: {'Network': ['ID=8e0b26d7-eefe-4c85-b535-944f3c15f0f6,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:29.910134 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8e673ea-99a8-4fbe-9c0f-f185d80e8b1d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:29.913193 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 8e0b26d7-eefe-4c85-b535-944f3c15f0f6 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:19:29.925968 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a7aab937-74b4-4669-92cf-5c3bb52c3834 admin admin] Made reservation on behalf of 7233ac85d55e4123a22cfa34bc1ee70e for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:19:29.928649 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a7aab937-74b4-4669-92cf-5c3bb52c3834 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:30.001619 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a8e673ea-99a8-4fbe-9c0f-f185d80e8b1d admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=dd46c2d5e7d44e6ca5a7b11c9f9be57a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5037007 Dec 09 21:19:30.004564 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57616) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:30.019782 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8e673ea-99a8-4fbe-9c0f-f185d80e8b1d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=40ad6d7d-cd7d-421c-869b-dca4971c8526,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:30.047232 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57618) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:30.083336 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-17ce6d08-6461-4c3d-8fe3-46ad2b3cb73a req-795bb195-ed3e-49fe-a6c3-ac1071a0a04c tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2284048 Dec 09 21:19:30.090613 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f42e0a73-19f5-4faa-8fe7-6ebe1f8b802a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:30.113221 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-a6050034-80f5-4285-8000-2114909304d1 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:30.114732 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-a6050034-80f5-4285-8000-2114909304d1 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.10 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42&tenant_id=a306d2242b1e41c892f63c7b122cdee4&binding%3Ahost_id=n-h1-713301-27 HTTP/1.1" status: 200 len: 1096 time: 0.2530081 Dec 09 21:19:30.115109 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3835d0c3-b0cf-47b8-8565-6fd58adbb167 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:30.120238 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27efb2e2-4b61-4ae4-8700-cf1367c8198a req-a1185255-8b4e-4898-95c5-3fa8b5333abc service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3252325 Dec 09 21:19:30.145474 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 204e6970-8ed3-4e91-9792-52401052a153 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:19:30.148652 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deb3f83d-a340-4430-bac9-71f6509c1609 req-7e1ecf53-b733-4855-afe3-68614aefff8f tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:30.149969 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-deb3f83d-a340-4430-bac9-71f6509c1609 req-7e1ecf53-b733-4855-afe3-68614aefff8f tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.1508062 Dec 09 21:19:30.163986 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3835d0c3-b0cf-47b8-8565-6fd58adbb167 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:30.185189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 204e6970-8ed3-4e91-9792-52401052a153 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:19:30.248780 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a7aab937-74b4-4669-92cf-5c3bb52c3834 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:30.284576 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3835d0c3-b0cf-47b8-8565-6fd58adbb167 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:30.287975 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3835d0c3-b0cf-47b8-8565-6fd58adbb167 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:30.289229 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3835d0c3-b0cf-47b8-8565-6fd58adbb167 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/40ad6d7d-cd7d-421c-869b-dca4971c8526 HTTP/1.1" status: 204 len: 168 time: 0.2835150 Dec 09 21:19:30.308527 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-d8da62f1-2b7b-4ade-94e4-f87cac9e088a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:30.310390 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-d8da62f1-2b7b-4ade-94e4-f87cac9e088a service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42&tenant_id=a306d2242b1e41c892f63c7b122cdee4 HTTP/1.1" status: 200 len: 1096 time: 0.1851480 Dec 09 21:19:30.311490 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3835d0c3-b0cf-47b8-8565-6fd58adbb167 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=40ad6d7d-cd7d-421c-869b-dca4971c8526,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:30.317339 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7aab937-74b4-4669-92cf-5c3bb52c3834 admin admin] Pushing event updated for resources: {'Subnet': ['ID=63e7603a-bb11-4d1a-8d84-55456d81931c,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:30.339940 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a7aab937-74b4-4669-92cf-5c3bb52c3834 admin admin] Checking segment: {'id': '41babb3e-048d-47f5-b92c-d4cf9897cc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:19:30.340312 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7aab937-74b4-4669-92cf-5c3bb52c3834 admin admin] Network hostable DHCP agents. Network: 8e0b26d7-eefe-4c85-b535-944f3c15f0f6, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:19:30.355497 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9f03f0c3-a9b7-47c8-84b7-e9329ceed834', 'tag': 'cb941377-5fe0-4e9e-9ac5-1fb6253c78d7'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:30.358057 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e2c684d1-8467-43cc-96d3-9c2b3334303b" -d '{"events": [{"name": "network-changed", "server_uuid": "9f03f0c3-a9b7-47c8-84b7-e9329ceed834", "tag": "cb941377-5fe0-4e9e-9ac5-1fb6253c78d7"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:30.360977 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-deb3f83d-a340-4430-bac9-71f6509c1609 req-3d1fae0b-d926-4618-94f9-f320c7ae8342 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1798787 Dec 09 21:19:30.394685 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27efb2e2-4b61-4ae4-8700-cf1367c8198a req-51098100-68f0-4ef9-b59b-2a2eff25096d service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2576580 Dec 09 21:19:30.403464 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7aab937-74b4-4669-92cf-5c3bb52c3834 admin admin] Network 8e0b26d7-eefe-4c85-b535-944f3c15f0f6 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:19:30.421354 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-a7aab937-74b4-4669-92cf-5c3bb52c3834 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 8e0b26d7-eefe-4c85-b535-944f3c15f0f6) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:19:30.430006 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28a85217-d7dc-4016-bb97-313cbe599b32 None None] Network 8e0b26d7-eefe-4c85-b535-944f3c15f0f6 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:19:30.439734 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f6324f34-3b90-486a-ad4f-cbbaa65cd629 x-openstack-request-id: req-f6324f34-3b90-486a-ad4f-cbbaa65cd629 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:30.440025 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9f03f0c3-a9b7-47c8-84b7-e9329ceed834", "tag": "cb941377-5fe0-4e9e-9ac5-1fb6253c78d7", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:30.440282 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f6324f34-3b90-486a-ad4f-cbbaa65cd629 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:30.440442 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f42e0a73-19f5-4faa-8fe7-6ebe1f8b802a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:30.440823 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9f03f0c3-a9b7-47c8-84b7-e9329ceed834', 'tag': 'cb941377-5fe0-4e9e-9ac5-1fb6253c78d7', 'status': 'completed', 'code': 200} Dec 09 21:19:30.444547 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a7aab937-74b4-4669-92cf-5c3bb52c3834 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:30.445543 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a7aab937-74b4-4669-92cf-5c3bb52c3834 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:30.449532 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f42e0a73-19f5-4faa-8fe7-6ebe1f8b802a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:30.458689 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-48d6494b-4dcc-4bfc-beb8-78dc009b9e79 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:30.460518 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-48d6494b-4dcc-4bfc-beb8-78dc009b9e79 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 1096 time: 0.0934091 Dec 09 21:19:30.502669 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a7aab937-74b4-4669-92cf-5c3bb52c3834 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 842 time: 0.6951134 Dec 09 21:19:30.555783 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2c684d1-8467-43cc-96d3-9c2b3334303b req-b9bf84cd-d219-4fc4-b1e2-fa01f31801a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:30.557792 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e2c684d1-8467-43cc-96d3-9c2b3334303b req-b9bf84cd-d219-4fc4-b1e2-fa01f31801a6 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 1126 time: 0.0859606 Dec 09 21:19:30.557972 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f42e0a73-19f5-4faa-8fe7-6ebe1f8b802a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bfb1f5a6-79e4-4909-831c-d81bc4d8f3d7,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:30.598185 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57628) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:30.604108 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f42e0a73-19f5-4faa-8fe7-6ebe1f8b802a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=5827100270aa43a2a72568d050bc7230&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5512767 Dec 09 21:19:30.604885 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2423a9d1-a9e2-476b-a011-230d2caa107e None None] Network 8e0b26d7-eefe-4c85-b535-944f3c15f0f6 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:19:30.706631 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a1a9caa-4cd3-4522-a020-68297671557d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:30.714215 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2c684d1-8467-43cc-96d3-9c2b3334303b req-7852f369-4ca7-43b5-8e31-9891cfe444ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:30.715747 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e2c684d1-8467-43cc-96d3-9c2b3334303b req-7852f369-4ca7-43b5-8e31-9891cfe444ed service neutron] 10.222.0.10 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 908 time: 0.1501904 Dec 09 21:19:30.721081 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-7b72a00d-6455-45ee-95c6-06f2ebd2070f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:30.725022 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-7b72a00d-6455-45ee-95c6-06f2ebd2070f service neutron] 10.222.0.10 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 922 time: 0.2445154 Dec 09 21:19:30.742379 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a1a9caa-4cd3-4522-a020-68297671557d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:30.774788 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e2c684d1-8467-43cc-96d3-9c2b3334303b req-2a9e9a9f-0bb1-4dbe-ab70-56aba0774cee service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 HTTP/1.1" status: 200 len: 217 time: 0.0491841 Dec 09 21:19:30.809685 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-49d2492c-7f86-4927-bbae-877b1c23b73d service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=2ba5fd1c-0009-4970-b169-7f8dca923e34 HTTP/1.1" status: 200 len: 217 time: 0.0729814 Dec 09 21:19:30.870173 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef50ae98-46e0-46bf-a138-31b83f98dd94 req-b5995c46-a2f2-417d-8bbf-cec38f3d39ff tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:30.871853 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef50ae98-46e0-46bf-a138-31b83f98dd94 req-b5995c46-a2f2-417d-8bbf-cec38f3d39ff tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 948 time: 0.1888325 Dec 09 21:19:30.874758 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2c684d1-8467-43cc-96d3-9c2b3334303b req-c972a6c6-5dbb-44c8-8868-636c9214b310 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:30.877418 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e2c684d1-8467-43cc-96d3-9c2b3334303b req-c972a6c6-5dbb-44c8-8868-636c9214b310 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=eae2438b-9fcc-44ef-a172-6c4911cad13f HTTP/1.1" status: 200 len: 847 time: 0.0742898 Dec 09 21:19:30.906834 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-7f06ffdf-df8b-4c39-bf92-0ec940908b0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:30.908341 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-7f06ffdf-df8b-4c39-bf92-0ec940908b0c service neutron] 10.222.0.10 "GET /v2.0/subnets?id=c49a62cc-af1b-4958-a4a9-eb44188b8fb9 HTTP/1.1" status: 200 len: 861 time: 0.0916064 Dec 09 21:19:30.916392 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e2c684d1-8467-43cc-96d3-9c2b3334303b req-e6d59470-55e8-4ad6-930e-3146fa7a1b34 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=04fa749a-9f72-4a2c-a725-feab917f99ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0316331 Dec 09 21:19:30.917128 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a1a9caa-4cd3-4522-a020-68297671557d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:30.920342 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a1a9caa-4cd3-4522-a020-68297671557d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:30.921726 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8a1a9caa-4cd3-4522-a020-68297671557d admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/bfb1f5a6-79e4-4909-831c-d81bc4d8f3d7 HTTP/1.1" status: 204 len: 168 time: 0.3225622 Dec 09 21:19:30.941745 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a1a9caa-4cd3-4522-a020-68297671557d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bfb1f5a6-79e4-4909-831c-d81bc4d8f3d7,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:30.993456 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-6dad1991-f8d6-4c85-80a7-221ce0201f0d service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=93378dc3-2ac5-4cf7-9ce3-d812934de40c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0749705 Dec 09 21:19:31.005705 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef50ae98-46e0-46bf-a138-31b83f98dd94 req-7a0c9fe0-c926-4969-a06a-6a7e2b651395 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1200500 Dec 09 21:19:31.048131 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f58bc5e9-8260-4534-bac3-e128633c4165 req-aaa1d8dc-e6cd-43c3-a50c-f5cdc2352098 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:31.049700 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f58bc5e9-8260-4534-bac3-e128633c4165 req-aaa1d8dc-e6cd-43c3-a50c-f5cdc2352098 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 944 time: 0.1341105 Dec 09 21:19:31.069903 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e2c684d1-8467-43cc-96d3-9c2b3334303b req-59ceab61-748f-423b-9ddc-997d4a054e88 service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1386569 Dec 09 21:19:31.148570 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-df7420e9-68a2-417b-a361-76fb22c55e42 service neutron] 10.222.0.10 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1406469 Dec 09 21:19:31.152521 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f58bc5e9-8260-4534-bac3-e128633c4165 req-3f15b5b0-b3cc-4e7f-b1bc-2b5e27ba0c28 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0718391 Dec 09 21:19:31.202338 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e2c684d1-8467-43cc-96d3-9c2b3334303b req-e7e97816-5bf1-4b7c-a718-5c443cbd7429 service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1215365 Dec 09 21:19:31.274357 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-4ecf0097-7e46-493e-b2f3-ec6b6379afd2 service neutron] 10.222.0.10 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1157422 Dec 09 21:19:31.650863 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2dab90a-2491-4480-b11d-d7622f537fee req-713465bb-6191-4adb-95d4-ef35551b1c48 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:31.653155 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2dab90a-2491-4480-b11d-d7622f537fee req-713465bb-6191-4adb-95d4-ef35551b1c48 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 943 time: 0.1897969 Dec 09 21:19:31.674783 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-d98f1204-a6f3-42c3-8c2e-426bb16cdbdd tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:31.676938 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-d98f1204-a6f3-42c3-8c2e-426bb16cdbdd tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.10 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42&tenant_id=a306d2242b1e41c892f63c7b122cdee4&binding%3Ahost_id=n-h2-713301-27 HTTP/1.1" status: 200 len: 1096 time: 0.0593460 Dec 09 21:19:31.678353 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57686) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:31.750318 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f70029a2-4fde-4ff8-937a-f6401e0a4484 req-5fdbdff9-4c88-46bd-b9cb-922f4cad99eb tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:31.751854 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f70029a2-4fde-4ff8-937a-f6401e0a4484 req-5fdbdff9-4c88-46bd-b9cb-922f4cad99eb tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.10 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8&tenant_id=857de64ecc3946e3b92655f639d782df&binding%3Ahost_id=n-h1-713301-27 HTTP/1.1" status: 200 len: 948 time: 0.1468117 Dec 09 21:19:31.768812 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-d9caaf5c-7032-4d0c-9ef7-51372b0bf90a tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:31.775785 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-d9caaf5c-7032-4d0c-9ef7-51372b0bf90a tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/networks?id=8e0b26d7-eefe-4c85-b535-944f3c15f0f6 HTTP/1.1" status: 200 len: 805 time: 0.2816231 Dec 09 21:19:31.816475 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-d0de34d4-2cb8-4ac1-9509-f2b7f0bf745c admin admin] Request body: {'network': {'name': 'tempest-AttachSCSIVolumeTestJSON-1560467054-network', 'tenant_id': '913fcb9b5aab4356999ade167d5148c6'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:31.839211 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-df57d333-247b-4731-b5f7-15b6922b2c51 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/quotas/7233ac85d55e4123a22cfa34bc1ee70e HTTP/1.1" status: 200 len: 375 time: 0.0624568 Dec 09 21:19:31.845901 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-564878b4-0c8d-4fb5-b9c2-051bd088abfd service neutron] For port 2ba5fd1c-0009-4970-b169-7f8dca923e34, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:31.847566 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2dab90a-2491-4480-b11d-d7622f537fee req-5aea75c7-bcf0-4ad5-ac36-178bcf7f10a2 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1742921 Dec 09 21:19:31.849876 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-564878b4-0c8d-4fb5-b9c2-051bd088abfd service neutron] Publish callbacks [] for binding, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:31.851263 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6c466823-b15c-4cec-863b-0b697a2d0dff req-564878b4-0c8d-4fb5-b9c2-051bd088abfd service neutron] 10.222.0.10 "DELETE /v2.0/ports/2ba5fd1c-0009-4970-b169-7f8dca923e34/bindings/n-h1-713301-27 HTTP/1.1" status: 204 len: 173 time: 0.1659694 Dec 09 21:19:31.852490 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d0de34d4-2cb8-4ac1-9509-f2b7f0bf745c admin admin] Made reservation on behalf of 913fcb9b5aab4356999ade167d5148c6 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:19:31.856295 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d0de34d4-2cb8-4ac1-9509-f2b7f0bf745c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:31.871427 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d0de34d4-2cb8-4ac1-9509-f2b7f0bf745c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:31.901667 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-c5c6308a-d3fe-4927-a034-7884675fae85 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=7233ac85d55e4123a22cfa34bc1ee70e&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0514257 Dec 09 21:19:31.982710 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d0de34d4-2cb8-4ac1-9509-f2b7f0bf745c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:31.987935 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-f70029a2-4fde-4ff8-937a-f6401e0a4484 req-a578f581-b9fa-422b-b45b-364d92ee2dd7 service neutron] delete failed (client error): The resource could not be found. Dec 09 21:19:31.988832 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d0de34d4-2cb8-4ac1-9509-f2b7f0bf745c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:31.988976 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f70029a2-4fde-4ff8-937a-f6401e0a4484 req-a578f581-b9fa-422b-b45b-364d92ee2dd7 service neutron] 10.222.0.10 "DELETE /v2.0/ports/204e6970-8ed3-4e91-9792-52401052a153/bindings/n-h2-713301-27 HTTP/1.1" status: 404 len: 381 time: 0.2101433 Dec 09 21:19:32.028698 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d0de34d4-2cb8-4ac1-9509-f2b7f0bf745c admin admin] vlan segment allocate from pool success with {'vlan_id': 146, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:19:32.035824 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0de34d4-2cb8-4ac1-9509-f2b7f0bf745c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dea88e67-805c-4990-af94-aeeaf2d8e160,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:32.042590 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ea2b23f-1430-4cf7-99ea-8550d0030285 req-746c3d5b-66b4-433b-9b52-d959ca84ed1f tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:32.044296 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0ea2b23f-1430-4cf7-99ea-8550d0030285 req-746c3d5b-66b4-433b-9b52-d959ca84ed1f tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 948 time: 0.1118093 Dec 09 21:19:32.047353 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d0de34d4-2cb8-4ac1-9509-f2b7f0bf745c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:32.047800 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-d0de34d4-2cb8-4ac1-9509-f2b7f0bf745c admin admin] Added segment 5c779566-9ab2-470d-8b5d-c18c1d216fd1 of type vlan for network 1444d8a7-187f-473b-be08-dce40f6ae8ea Dec 09 21:19:32.082672 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-b7c530f9-5e9b-4e02-9ae7-ff293bf1d059 service neutron] 10.222.0.13 "GET /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1665609 Dec 09 21:19:32.105227 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d0de34d4-2cb8-4ac1-9509-f2b7f0bf745c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:32.165335 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0ea2b23f-1430-4cf7-99ea-8550d0030285 req-f336ced0-ddc1-4683-af7c-ee5046784c01 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1074502 Dec 09 21:19:32.169153 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d0de34d4-2cb8-4ac1-9509-f2b7f0bf745c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:32.170401 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d0de34d4-2cb8-4ac1-9509-f2b7f0bf745c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:32.171098 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d0de34d4-2cb8-4ac1-9509-f2b7f0bf745c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:32.193480 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f70029a2-4fde-4ff8-937a-f6401e0a4484 req-fe5a075f-0acc-49b2-8fd6-c5be36d481be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:32.195324 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f70029a2-4fde-4ff8-937a-f6401e0a4484 req-fe5a075f-0acc-49b2-8fd6-c5be36d481be service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 1100 time: 0.0728233 Dec 09 21:19:32.235186 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 204e6970-8ed3-4e91-9792-52401052a153 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:19:32.240677 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 2ba5fd1c-0009-4970-b169-7f8dca923e34 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:19:32.256163 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-79aac979-0916-4a76-a9c3-92c8bb45c6b8 service neutron] 10.222.0.13 "GET /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1576693 Dec 09 21:19:32.257455 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-329fc36a-c0a3-463e-8872-7ae27e3f61b6 service neutron] 10.222.0.10 "GET /v2.0/ports/cb941377-5fe0-4e9e-9ac5-1fb6253c78d7/bindings/n-h1-713301-27 HTTP/1.1" status: 200 len: 385 time: 0.1361766 Dec 09 21:19:32.277738 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d0de34d4-2cb8-4ac1-9509-f2b7f0bf745c admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.5953646 Dec 09 21:19:32.283794 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57704) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:32.290239 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0de34d4-2cb8-4ac1-9509-f2b7f0bf745c admin admin] Pushing event updated for resources: {'Network': ['ID=1444d8a7-187f-473b-be08-dce40f6ae8ea,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:32.297078 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-ee25138c-21cf-42c3-8fba-8e136dd2b635 admin admin] Request body: {'subnet': {'network_id': '1444d8a7-187f-473b-be08-dce40f6ae8ea', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachSCSIVolumeTestJSON-1560467054-subnet', 'tenant_id': '913fcb9b5aab4356999ade167d5148c6', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:32.331950 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 1444d8a7-187f-473b-be08-dce40f6ae8ea details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:19:32.460242 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ee25138c-21cf-42c3-8fba-8e136dd2b635 admin admin] Made reservation on behalf of 913fcb9b5aab4356999ade167d5148c6 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:19:32.463503 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee25138c-21cf-42c3-8fba-8e136dd2b635 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:32.472442 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f70029a2-4fde-4ff8-937a-f6401e0a4484 req-717c230f-0346-409f-a35f-ad4d867a8896 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:32.476596 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f70029a2-4fde-4ff8-937a-f6401e0a4484 req-717c230f-0346-409f-a35f-ad4d867a8896 service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.2668440 Dec 09 21:19:32.514620 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.resource_extend [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 09 21:19:32.522523 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92282a99-e947-4620-9405-498c090c7f3a req-41d7eb59-a2fc-4859-a321-ef7fb91a92bd tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:32.532011 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-92282a99-e947-4620-9405-498c090c7f3a req-41d7eb59-a2fc-4859-a321-ef7fb91a92bd tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.1760881 Dec 09 21:19:32.569079 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f70029a2-4fde-4ff8-937a-f6401e0a4484 req-0bfbd794-0337-4661-ab1e-86a3c7a2cca3 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.145&port_id=204e6970-8ed3-4e91-9792-52401052a153 HTTP/1.1" status: 200 len: 217 time: 0.0747542 Dec 09 21:19:32.575926 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 2ba5fd1c-0009-4970-b169-7f8dca923e34 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:19:32.634148 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f70029a2-4fde-4ff8-937a-f6401e0a4484 req-fe0ebc24-4b2d-43fd-886e-0808536bc5ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:32.635918 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f70029a2-4fde-4ff8-937a-f6401e0a4484 req-fe0ebc24-4b2d-43fd-886e-0808536bc5ee service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0585144 Dec 09 21:19:32.712736 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-92282a99-e947-4620-9405-498c090c7f3a req-46141d8b-fa57-4f3c-b869-217832ae8f89 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1741962 Dec 09 21:19:32.713597 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 204e6970-8ed3-4e91-9792-52401052a153, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=204e6970-8ed3-4e91-9792-52401052a153,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:32.747792 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '204e6970-8ed3-4e91-9792-52401052a153', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '204e6970-8ed3-4e91-9792-52401052a153', 'mac_address': 'fa:16:3e:2d:bf:13', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.145'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:19:32.801008 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f70029a2-4fde-4ff8-937a-f6401e0a4484 req-0ee9bc05-9f37-467e-8eeb-bf7d6b8d1b65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:32.803100 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f49404c-740d-4029-a917-351b97e51cde req-bbc72388-588a-4c0b-99b6-b688b9cf878d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:32.810767 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f70029a2-4fde-4ff8-937a-f6401e0a4484 req-0ee9bc05-9f37-467e-8eeb-bf7d6b8d1b65 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1572745 Dec 09 21:19:32.811430 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1f49404c-740d-4029-a917-351b97e51cde req-bbc72388-588a-4c0b-99b6-b688b9cf878d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 944 time: 0.2698157 Dec 09 21:19:32.846838 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:32.928091 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 204e6970-8ed3-4e91-9792-52401052a153 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:19:32.954082 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 204e6970-8ed3-4e91-9792-52401052a153, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=204e6970-8ed3-4e91-9792-52401052a153,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:32.969564 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:32.970845 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:19:32.975866 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f70029a2-4fde-4ff8-937a-f6401e0a4484 req-d2743fee-4592-4771-88c2-010afbdfd0c0 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1611276 Dec 09 21:19:32.982740 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-2d939fa2-98de-4a0e-8732-20dd63a09a9b service neutron] For port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:33.090513 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:33.114186 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 has no active binding in host n-h1-713301-27 {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:158}} Dec 09 21:19:33.129307 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f70029a2-4fde-4ff8-937a-f6401e0a4484 req-5b9acac9-7a57-4c27-b2bd-9b5fd8794ada service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1432495 Dec 09 21:19:33.324265 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b7b7b5f3-010f-4e7d-81a4-2f06a9f7d06c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:33.328012 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c806f0d-429c-486e-89ec-41bcf8ea1b55 req-dfbb5ff7-e0b5-44fc-977e-b07c2c14f9f9 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=eac884a1-b960-4dfb-9337-7c68c9f0acca HTTP/1.1" status: 200 len: 210 time: 0.0376065 Dec 09 21:19:33.345882 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1f49404c-740d-4029-a917-351b97e51cde req-88391ba7-c05c-49ed-90f5-cdd2478402fc tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5332270 Dec 09 21:19:33.356928 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=204e6970-8ed3-4e91-9792-52401052a153,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:33.360319 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-2d939fa2-98de-4a0e-8732-20dd63a09a9b service neutron] For port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:33.407705 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['204e6970-8ed3-4e91-9792-52401052a153'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:19:33.436531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-2d939fa2-98de-4a0e-8732-20dd63a09a9b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:19:33.461550 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee25138c-21cf-42c3-8fba-8e136dd2b635 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:33.472176 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-2d939fa2-98de-4a0e-8732-20dd63a09a9b service neutron] For port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:33.551107 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-2d939fa2-98de-4a0e-8732-20dd63a09a9b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:33.584076 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee25138c-21cf-42c3-8fba-8e136dd2b635 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f2e816c0-e7a2-4010-b2b9-8d7f39c3a318,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:33.604102 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e51c1223-cbca-4eb0-8c9f-4d232b1ed48d req-d0d2e5c1-7585-4f42-b312-fd3a18302972 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:33.606302 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e51c1223-cbca-4eb0-8c9f-4d232b1ed48d req-d0d2e5c1-7585-4f42-b312-fd3a18302972 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 943 time: 0.1901114 Dec 09 21:19:33.674849 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15d2987a-310c-4cc4-b498-2c9dae63c326 req-ee99f509-d325-4c50-ad7a-4f76cf90255d tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:33.676433 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15d2987a-310c-4cc4-b498-2c9dae63c326 req-ee99f509-d325-4c50-ad7a-4f76cf90255d tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 949 time: 0.2108171 Dec 09 21:19:33.689386 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee25138c-21cf-42c3-8fba-8e136dd2b635 admin admin] Checking segment: {'id': '5c779566-9ab2-470d-8b5d-c18c1d216fd1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '1444d8a7-187f-473b-be08-dce40f6ae8ea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:19:33.689744 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee25138c-21cf-42c3-8fba-8e136dd2b635 admin admin] Network hostable DHCP agents. Network: 1444d8a7-187f-473b-be08-dce40f6ae8ea, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:19:33.771589 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-2d939fa2-98de-4a0e-8732-20dd63a09a9b service neutron] Transition to ACTIVE for port object cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:19:33.774532 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee25138c-21cf-42c3-8fba-8e136dd2b635 admin admin] Network 1444d8a7-187f-473b-be08-dce40f6ae8ea is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:19:33.782643 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e51c1223-cbca-4eb0-8c9f-4d232b1ed48d req-61d77e4f-1ea3-4264-9c1e-0a9d6c5f87d7 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1664555 Dec 09 21:19:33.795465 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-2d939fa2-98de-4a0e-8732-20dd63a09a9b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:33.809736 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15d2987a-310c-4cc4-b498-2c9dae63c326 req-672f93f9-a926-4792-a7c2-ca1a074724ce tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1152320 Dec 09 21:19:33.826284 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-ee25138c-21cf-42c3-8fba-8e136dd2b635 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 1444d8a7-187f-473b-be08-dce40f6ae8ea) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:19:33.835227 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee25138c-21cf-42c3-8fba-8e136dd2b635 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:33.835870 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee25138c-21cf-42c3-8fba-8e136dd2b635 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:33.840112 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71a1a28a-d67d-4452-93f5-eea95125239f None None] Network 1444d8a7-187f-473b-be08-dce40f6ae8ea requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:19:33.876307 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-2d939fa2-98de-4a0e-8732-20dd63a09a9b service neutron] No DVR routers for this DVR port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:19:33.888803 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ee25138c-21cf-42c3-8fba-8e136dd2b635 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 1.6002631 Dec 09 21:19:33.889373 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57744) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:33.894926 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-32cd063d-bc76-49e2-8453-34abd19aeed0 admin admin] Request body: {'router': {'name': 'tempest-AttachSCSIVolumeTestJSON-1560467054-router', 'tenant_id': '913fcb9b5aab4356999ade167d5148c6', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:33.901755 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d939fa2-98de-4a0e-8732-20dd63a09a9b service neutron] Pushing event updated for resources: {'Port': ['ID=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7,revision_number=10']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:33.939640 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-32cd063d-bc76-49e2-8453-34abd19aeed0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:33.941247 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-32cd063d-bc76-49e2-8453-34abd19aeed0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:33.978751 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-2d939fa2-98de-4a0e-8732-20dd63a09a9b service neutron] 10.222.0.10 "PUT /v2.0/ports/cb941377-5fe0-4e9e-9ac5-1fb6253c78d7/bindings/n-h1-713301-27/activate HTTP/1.1" status: 200 len: 370 time: 1.7132659 Dec 09 21:19:33.997165 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb350c66-c6af-4111-badd-a1a76e2de15e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-1444d8a7-187f-473b-be08-dce40f6ae8ea', 'network_id': '1444d8a7-187f-473b-be08-dce40f6ae8ea', 'project_id': '913fcb9b5aab4356999ade167d5148c6', 'fixed_ips': [{'subnet_id': 'f2e816c0-e7a2-4010-b2b9-8d7f39c3a318'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:19:33.998046 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cb350c66-c6af-4111-badd-a1a76e2de15e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:34.038809 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-32cd063d-bc76-49e2-8453-34abd19aeed0 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:34.157843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb7d86d4-c053-446c-9c42-1ed8f513c3ca req-34aaab7f-be77-4718-9398-9e72a6b34e4f tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:34.166068 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb7d86d4-c053-446c-9c42-1ed8f513c3ca req-34aaab7f-be77-4718-9398-9e72a6b34e4f tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.1393692 Dec 09 21:19:34.176696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-0f0e1a27-135b-4fa7-a7c2-d3d7ee0d2df5 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:34.178333 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-0f0e1a27-135b-4fa7-a7c2-d3d7ee0d2df5 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.31 "GET /v2.0/networks?id=8e0b26d7-eefe-4c85-b535-944f3c15f0f6 HTTP/1.1" status: 200 len: 805 time: 0.2153380 Dec 09 21:19:34.212141 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-d939ee5b-468c-4581-8e93-d70a6328801b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Request body: {'port': {'device_id': 'eac884a1-b960-4dfb-9337-7c68c9f0acca', 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6', 'admin_state_up': True, 'tenant_id': '7233ac85d55e4123a22cfa34bc1ee70e'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:34.223681 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-23fe9c94-3906-4630-8806-940ac979bc92 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=669b986126134ec0a75d9f954a17ffa1&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0542481 Dec 09 21:19:34.228259 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-32cd063d-bc76-49e2-8453-34abd19aeed0 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:34.238825 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-c1e2b6be-6831-4cc1-8f79-679ee7552116 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:34.240647 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-c1e2b6be-6831-4cc1-8f79-679ee7552116 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834&tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&binding%3Ahost_id=n-h2-713301-27 HTTP/1.1" status: 200 len: 1096 time: 0.1155980 Dec 09 21:19:34.243128 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-cb350c66-c6af-4111-badd-a1a76e2de15e None None] Allocated IP 172.20.0.2 (1444d8a7-187f-473b-be08-dce40f6ae8ea/f2e816c0-e7a2-4010-b2b9-8d7f39c3a318/0fa51266-e039-4a6c-b933-24080a940ed9) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:19:34.256312 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 204e6970-8ed3-4e91-9792-52401052a153 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:19:34.309157 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-e0687a58-242a-4104-9451-a5b2a797db5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:34.310679 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-e0687a58-242a-4104-9451-a5b2a797db5a service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834&tenant_id=ac5b7cefd8cc48cc83f38d3923aae132 HTTP/1.1" status: 200 len: 1096 time: 0.0545447 Dec 09 21:19:34.390511 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-108aadd6-b80e-474b-b088-07ff890e0e39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:34.391375 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 204e6970-8ed3-4e91-9792-52401052a153 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:19:34.392207 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-108aadd6-b80e-474b-b088-07ff890e0e39 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 1096 time: 0.0551310 Dec 09 21:19:34.397120 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 204e6970-8ed3-4e91-9792-52401052a153 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:34.397492 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:34.407945 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb7d86d4-c053-446c-9c42-1ed8f513c3ca req-b599f063-96ee-4733-9264-84fc487310e1 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2408998 Dec 09 21:19:34.418828 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-94e1bd31-d966-45bf-b8c8-695e624575b5 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:34.420625 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-94e1bd31-d966-45bf-b8c8-695e624575b5 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1838870 Dec 09 21:19:34.457359 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-3d1c80eb-6f4c-4c4c-9be4-b390f59d845c tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/quotas/669b986126134ec0a75d9f954a17ffa1 HTTP/1.1" status: 200 len: 375 time: 0.0179977 Dec 09 21:19:34.498206 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cb350c66-c6af-4111-badd-a1a76e2de15e None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:34.509858 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-b26b828d-f71b-4ebb-9657-b86e9be26e2d tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=669b986126134ec0a75d9f954a17ffa1&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0307102 Dec 09 21:19:34.510198 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-d939ee5b-468c-4581-8e93-d70a6328801b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Made reservation on behalf of 7233ac85d55e4123a22cfa34bc1ee70e for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:19:34.514247 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-d939ee5b-468c-4581-8e93-d70a6328801b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:34.530035 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cb350c66-c6af-4111-badd-a1a76e2de15e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:34.594462 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-05186ed5-e9e8-4504-ba89-da91a8098e02 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:34.595877 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb350c66-c6af-4111-badd-a1a76e2de15e None None] Network 1444d8a7-187f-473b-be08-dce40f6ae8ea is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:19:34.596123 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-05186ed5-e9e8-4504-ba89-da91a8098e02 service neutron] 10.222.0.31 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 908 time: 0.1959543 Dec 09 21:19:34.599980 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:34.602023 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-32cd063d-bc76-49e2-8453-34abd19aeed0 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:34.602168 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-cb350c66-c6af-4111-badd-a1a76e2de15e None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:19:34.607022 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb350c66-c6af-4111-badd-a1a76e2de15e None None] Pushing event updated for resources: {'Port': ['ID=0fa51266-e039-4a6c-b933-24080a940ed9,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:34.611174 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb350c66-c6af-4111-badd-a1a76e2de15e None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:19:34.678340 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e6fbd1df-a53f-4f75-810f-f90ea3677ac8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '204e6970-8ed3-4e91-9792-52401052a153'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:34.681222 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-16a4111a-4b79-4665-87a4-bbe38d68475c" -d '{"events": [{"server_uuid": "e6fbd1df-a53f-4f75-810f-f90ea3677ac8", "name": "network-vif-plugged", "status": "completed", "tag": "204e6970-8ed3-4e91-9792-52401052a153"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:34.707520 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 204e6970-8ed3-4e91-9792-52401052a153, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=204e6970-8ed3-4e91-9792-52401052a153,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:34.711398 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-cb350c66-c6af-4111-badd-a1a76e2de15e None None] Attempting to bind port 0fa51266-e039-4a6c-b933-24080a940ed9 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:19:34.712202 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-cb350c66-c6af-4111-badd-a1a76e2de15e None None] Attempting to bind port 0fa51266-e039-4a6c-b933-24080a940ed9 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '5c779566-9ab2-470d-8b5d-c18c1d216fd1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '1444d8a7-187f-473b-be08-dce40f6ae8ea'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:19:34.712622 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cb350c66-c6af-4111-badd-a1a76e2de15e None None] Attempting to bind port 0fa51266-e039-4a6c-b933-24080a940ed9 on network 1444d8a7-187f-473b-be08-dce40f6ae8ea {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:34.718758 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cb350c66-c6af-4111-badd-a1a76e2de15e None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 19, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:19:34.719181 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cb350c66-c6af-4111-badd-a1a76e2de15e None None] Checking segment: {'id': '5c779566-9ab2-470d-8b5d-c18c1d216fd1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '1444d8a7-187f-473b-be08-dce40f6ae8ea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:19:34.720016 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cb350c66-c6af-4111-badd-a1a76e2de15e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:34.720173 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cb350c66-c6af-4111-badd-a1a76e2de15e None None] Bound using segment: {'id': '5c779566-9ab2-470d-8b5d-c18c1d216fd1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '1444d8a7-187f-473b-be08-dce40f6ae8ea'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:19:34.720657 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-cb350c66-c6af-4111-badd-a1a76e2de15e None None] Bound port: 0fa51266-e039-4a6c-b933-24080a940ed9, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5c779566-9ab2-470d-8b5d-c18c1d216fd1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '1444d8a7-187f-473b-be08-dce40f6ae8ea'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:19:34.721139 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cb350c66-c6af-4111-badd-a1a76e2de15e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:34.725167 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:34.789593 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-d939ee5b-468c-4581-8e93-d70a6328801b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Allocated IP 172.20.0.14 (8e0b26d7-eefe-4c85-b535-944f3c15f0f6/63e7603a-bb11-4d1a-8d84-55456d81931c/84ad33bd-6ab4-41c4-91dc-7edb7fd59e12) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:19:34.832759 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=204e6970-8ed3-4e91-9792-52401052a153,revision_number=9']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:34.868135 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-cb350c66-c6af-4111-badd-a1a76e2de15e None None] For port 0fa51266-e039-4a6c-b933-24080a940ed9, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:34.872958 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-cb350c66-c6af-4111-badd-a1a76e2de15e None None] For port 0fa51266-e039-4a6c-b933-24080a940ed9, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=0fa51266-e039-4a6c-b933-24080a940ed9,segment=NetworkSegment(5c779566-9ab2-470d-8b5d-c18c1d216fd1),segment_id=5c779566-9ab2-470d-8b5d-c18c1d216fd1)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:19:34.882237 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cb350c66-c6af-4111-badd-a1a76e2de15e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:34.987958 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-d939ee5b-468c-4581-8e93-d70a6328801b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:34.991850 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-32cd063d-bc76-49e2-8453-34abd19aeed0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:34.995655 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-91a9d66f-c4b5-4888-b988-eefc1eaf2b5b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 HTTP/1.1" status: 200 len: 217 time: 0.3914824 Dec 09 21:19:35.005457 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb350c66-c6af-4111-badd-a1a76e2de15e None None] Pushing event updated for resources: {'Port': ['ID=0fa51266-e039-4a6c-b933-24080a940ed9,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:35.033691 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-d939ee5b-468c-4581-8e93-d70a6328801b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:35.140437 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-d939ee5b-468c-4581-8e93-d70a6328801b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Network 8e0b26d7-eefe-4c85-b535-944f3c15f0f6 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:19:35.152928 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-d939ee5b-468c-4581-8e93-d70a6328801b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:19:35.156800 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-4990803a-d8a5-42ad-b528-2794a7d2a62a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:35.158888 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-4990803a-d8a5-42ad-b528-2794a7d2a62a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=eae2438b-9fcc-44ef-a172-6c4911cad13f HTTP/1.1" status: 200 len: 847 time: 0.1490338 Dec 09 21:19:35.174920 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-d939ee5b-468c-4581-8e93-d70a6328801b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:19:35.213831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86f6e970-e738-4da4-a4e3-7bebd46615f1 req-cf1d8409-02c0-4ead-885c-5bc11499c1b2 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:35.218414 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-22665e5f-6c46-4ef4-b991-1ddfcac9765a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=04fa749a-9f72-4a2c-a725-feab917f99ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0320611 Dec 09 21:19:35.224467 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86f6e970-e738-4da4-a4e3-7bebd46615f1 req-cf1d8409-02c0-4ead-885c-5bc11499c1b2 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=eac884a1-b960-4dfb-9337-7c68c9f0acca HTTP/1.1" status: 200 len: 932 time: 0.1884975 Dec 09 21:19:35.234075 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e9be376-1c9f-4d41-bf7e-e216f3f79179 req-7aa3de3f-3a58-41fe-b53c-ac01d037a2ab tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:35.235936 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e9be376-1c9f-4d41-bf7e-e216f3f79179 req-7aa3de3f-3a58-41fe-b53c-ac01d037a2ab tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 1096 time: 0.2142510 Dec 09 21:19:35.247032 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d939ee5b-468c-4581-8e93-d70a6328801b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Pushing event updated for resources: {'Port': ['ID=84ad33bd-6ab4-41c4-91dc-7edb7fd59e12,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:35.261868 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-32cd063d-bc76-49e2-8453-34abd19aeed0 admin admin] Allocated IP 172.25.3.216 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/bfb54d46-9eb4-4f0f-a20d-de24e82762cc) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:19:35.308183 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-d939ee5b-468c-4581-8e93-d70a6328801b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:35.308183 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-d939ee5b-468c-4581-8e93-d70a6328801b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:35.350331 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86f6e970-e738-4da4-a4e3-7bebd46615f1 req-62af414d-0621-4ab8-8356-2f3ca57167f0 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1245081 Dec 09 21:19:35.356633 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-d939ee5b-468c-4581-8e93-d70a6328801b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.1486337 Dec 09 21:19:35.364139 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e9be376-1c9f-4d41-bf7e-e216f3f79179 req-86cb49ef-aa5e-4ebd-acc5-aa6b52cb89ce tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1106186 Dec 09 21:19:35.385985 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-4d099499-e902-49d0-a7b9-f9b4c239e2b1 service neutron] Request body: {'port': {'device_id': 'eac884a1-b960-4dfb-9337-7c68c9f0acca', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:35.443368 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-63a95cde-c4cc-40ad-a299-7ccf25f1980c service neutron] 10.222.0.31 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2171719 Dec 09 21:19:35.480526 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a6e76587-2450-4e5d-8532-6e9ebfe99bf6 x-openstack-request-id: req-a6e76587-2450-4e5d-8532-6e9ebfe99bf6 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:35.481064 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e6fbd1df-a53f-4f75-810f-f90ea3677ac8", "name": "network-vif-plugged", "status": "completed", "tag": "204e6970-8ed3-4e91-9792-52401052a153", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:35.481064 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a6e76587-2450-4e5d-8532-6e9ebfe99bf6 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:35.481470 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e6fbd1df-a53f-4f75-810f-f90ea3677ac8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '204e6970-8ed3-4e91-9792-52401052a153', 'code': 200} Dec 09 21:19:35.498764 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bada80e2-c7bd-420f-b73b-4f3a79c02c4d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:35.573984 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b88907f1-7bd3-4ad3-a7bb-5ba8bb422f6c req-1cce0d96-70c0-4e7a-811d-b520e7ca9539 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a8ab99b-8927-4f89-9ef5-773ea7697c2b HTTP/1.1" status: 200 len: 210 time: 0.0753443 Dec 09 21:19:35.608877 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-4d099499-e902-49d0-a7b9-f9b4c239e2b1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:35.670218 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b624c91a-985b-4d8f-a7cc-25ef34b7fcd3 req-7d3aaa7c-0bac-46ba-b149-f25aa7527a51 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:35.671906 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b624c91a-985b-4d8f-a7cc-25ef34b7fcd3 req-7d3aaa7c-0bac-46ba-b149-f25aa7527a51 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 944 time: 0.1278386 Dec 09 21:19:35.672794 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-32cd063d-bc76-49e2-8453-34abd19aeed0 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:35.751515 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0fa51266-e039-4a6c-b933-24080a940ed9 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:19:35.755556 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-32cd063d-bc76-49e2-8453-34abd19aeed0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:35.818296 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-32cd063d-bc76-49e2-8453-34abd19aeed0 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:19:35.823404 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-c7694483-7fdf-4346-a009-e2bdaa1b5fc6 service neutron] 10.222.0.31 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3468401 Dec 09 21:19:35.843093 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-32cd063d-bc76-49e2-8453-34abd19aeed0 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:19:35.843093 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32cd063d-bc76-49e2-8453-34abd19aeed0 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:19:35.868277 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 0fa51266-e039-4a6c-b933-24080a940ed9 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:35.868798 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:35.869291 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b624c91a-985b-4d8f-a7cc-25ef34b7fcd3 req-dbd78635-87f4-42f8-beee-51c8438948df tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1848168 Dec 09 21:19:35.873833 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32cd063d-bc76-49e2-8453-34abd19aeed0 admin admin] Pushing event updated for resources: {'Port': ['ID=bfb54d46-9eb4-4f0f-a20d-de24e82762cc,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:35.899088 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c065959-0664-4fe4-99a3-6c823297e68e req-cfeba26a-1ef7-494e-8b1d-0be7e96e1d77 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:35.911402 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3c065959-0664-4fe4-99a3-6c823297e68e req-cfeba26a-1ef7-494e-8b1d-0be7e96e1d77 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 950 time: 0.2098093 Dec 09 21:19:36.018878 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:36.062870 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3c065959-0664-4fe4-99a3-6c823297e68e req-70563948-de1e-49d1-b4f4-c3a5c0f54a0f tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1395028 Dec 09 21:19:36.065729 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 0fa51266-e039-4a6c-b933-24080a940ed9, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=0fa51266-e039-4a6c-b933-24080a940ed9,segment=NetworkSegment(5c779566-9ab2-470d-8b5d-c18c1d216fd1),segment_id=5c779566-9ab2-470d-8b5d-c18c1d216fd1)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:36.072229 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:36.110855 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-521463d8-f9fe-403c-be39-ebe46dcbf301 req-d1f2bbf1-014e-49b1-bd9e-ce8871df78db tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:36.124739 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-521463d8-f9fe-403c-be39-ebe46dcbf301 req-d1f2bbf1-014e-49b1-bd9e-ce8871df78db tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.1514969 Dec 09 21:19:36.161877 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-32cd063d-bc76-49e2-8453-34abd19aeed0 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:36.216972 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=0fa51266-e039-4a6c-b933-24080a940ed9,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:36.236385 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:19:36.267946 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-4d099499-e902-49d0-a7b9-f9b4c239e2b1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:19:36.296338 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-521463d8-f9fe-403c-be39-ebe46dcbf301 req-117ea295-832e-4842-8aae-46cba2e70ef7 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1639295 Dec 09 21:19:36.299811 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-4d099499-e902-49d0-a7b9-f9b4c239e2b1 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:36.309699 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:19:36.367023 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-4d099499-e902-49d0-a7b9-f9b4c239e2b1 service neutron] Transition to ACTIVE for port object 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:19:36.379463 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-bbda6552-67a6-4cb1-9b12-b7c33421b702 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=669b986126134ec0a75d9f954a17ffa1&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0696113 Dec 09 21:19:36.411471 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-4d099499-e902-49d0-a7b9-f9b4c239e2b1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:36.479022 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:36.521116 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a7a1beb-317e-4413-a034-87ef44d24294 None None] Network 1444d8a7-187f-473b-be08-dce40f6ae8ea requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:19:36.535813 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d099499-e902-49d0-a7b9-f9b4c239e2b1 service neutron] Pushing event updated for resources: {'Port': ['ID=84ad33bd-6ab4-41c4-91dc-7edb7fd59e12,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:36.563998 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-0e44fee4-0721-4178-b4f4-45e7a3b53da3 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:36.565507 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-0e44fee4-0721-4178-b4f4-45e7a3b53da3 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 821 time: 0.2756114 Dec 09 21:19:36.570310 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fcb27f1-40a1-4020-a3cb-caeb6c1229fe req-aa2ec8f1-05da-49af-852d-434c4a36ca0f tempest-MigrationsAdminTest-775845712 tempest-MigrationsAdminTest-775845712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:36.577461 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2fcb27f1-40a1-4020-a3cb-caeb6c1229fe req-aa2ec8f1-05da-49af-852d-434c4a36ca0f tempest-MigrationsAdminTest-775845712 tempest-MigrationsAdminTest-775845712-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 1102 time: 0.1675193 Dec 09 21:19:36.585308 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-e6023c58-c86f-420f-b378-13931725b40a tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:36.586852 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-e6023c58-c86f-420f-b378-13931725b40a tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834&tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&binding%3Ahost_id=n-h1-713301-27 HTTP/1.1" status: 200 len: 1096 time: 0.2307265 Dec 09 21:19:36.626742 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-82c9b22e-327f-4fd0-a275-602578db959a tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/quotas/a306d2242b1e41c892f63c7b122cdee4 HTTP/1.1" status: 200 len: 375 time: 0.0303242 Dec 09 21:19:36.629861 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-759e1caf-4a9a-4e66-8297-b9a997a78bd0 None None] Provisioning complete for port 0fa51266-e039-4a6c-b933-24080a940ed9 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:36.630228 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-759e1caf-4a9a-4e66-8297-b9a997a78bd0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:36.665472 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-e6554713-f7b6-45da-b474-65ececa395f9 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:36.667002 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-e6554713-f7b6-45da-b474-65ececa395f9 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2748554 Dec 09 21:19:36.668241 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-32cd063d-bc76-49e2-8453-34abd19aeed0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:36.686256 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-08c40164-e323-4643-bea6-f84466db7266 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Request body: {'port': {'device_id': '1a8ab99b-8927-4f89-9ef5-773ea7697c2b', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '669b986126134ec0a75d9f954a17ffa1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:36.688352 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-4d099499-e902-49d0-a7b9-f9b4c239e2b1 service neutron] Attempting to bind port 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:19:36.688699 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-4d099499-e902-49d0-a7b9-f9b4c239e2b1 service neutron] Attempting to bind port 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '41babb3e-048d-47f5-b92c-d4cf9897cc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:19:36.689043 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-4d099499-e902-49d0-a7b9-f9b4c239e2b1 service neutron] Attempting to bind port 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 on network 8e0b26d7-eefe-4c85-b535-944f3c15f0f6 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:36.695880 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2fcb27f1-40a1-4020-a3cb-caeb6c1229fe req-de2d7247-8fca-4cb7-9290-f39407c6e753 tempest-MigrationsAdminTest-775845712 tempest-MigrationsAdminTest-775845712-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1175902 Dec 09 21:19:36.700834 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-4d099499-e902-49d0-a7b9-f9b4c239e2b1 service neutron] Port 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 on network 8e0b26d7-eefe-4c85-b535-944f3c15f0f6 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:19:36.701158 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-4d099499-e902-49d0-a7b9-f9b4c239e2b1 service neutron] Attempting to bind port 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 on network 8e0b26d7-eefe-4c85-b535-944f3c15f0f6 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:36.713311 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-4d099499-e902-49d0-a7b9-f9b4c239e2b1 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 19, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:19:36.713877 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-4d099499-e902-49d0-a7b9-f9b4c239e2b1 service neutron] Checking segment: {'id': '41babb3e-048d-47f5-b92c-d4cf9897cc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:19:36.714661 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-4d099499-e902-49d0-a7b9-f9b4c239e2b1 service neutron] Bound using segment: {'id': '41babb3e-048d-47f5-b92c-d4cf9897cc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:19:36.715515 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-4d099499-e902-49d0-a7b9-f9b4c239e2b1 service neutron] Bound port: 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '41babb3e-048d-47f5-b92c-d4cf9897cc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:19:36.716349 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-4d099499-e902-49d0-a7b9-f9b4c239e2b1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:36.754207 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-f26554b6-a613-4e1e-878b-65ca2722f908 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1098511 Dec 09 21:19:36.923094 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-4d099499-e902-49d0-a7b9-f9b4c239e2b1 service neutron] For port 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:36.930918 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-4d099499-e902-49d0-a7b9-f9b4c239e2b1 service neutron] For port 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=84ad33bd-6ab4-41c4-91dc-7edb7fd59e12,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:19:36.940717 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-4d099499-e902-49d0-a7b9-f9b4c239e2b1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:36.947484 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-64cc3ed0-c36b-491d-9dc3-8177cbad3081 service neutron] 10.222.0.13 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1921730 Dec 09 21:19:36.957418 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6772b5a0-0a84-4c52-8349-ed4e7aa7b1d3 req-cdab81a9-57b6-424b-8e8e-19e563ba9e0f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:36.958412 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-1e864e8d-940f-4d30-b5ff-166759d4e8f3 service neutron] For port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:36.958886 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6772b5a0-0a84-4c52-8349-ed4e7aa7b1d3 req-cdab81a9-57b6-424b-8e8e-19e563ba9e0f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=eac884a1-b960-4dfb-9337-7c68c9f0acca HTTP/1.1" status: 200 len: 944 time: 0.1058986 Dec 09 21:19:36.971022 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-1e864e8d-940f-4d30-b5ff-166759d4e8f3 service neutron] Publish callbacks [] for binding, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:36.972181 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aed477e2-c835-4aa4-9dfe-c4930df4f352 req-1e864e8d-940f-4d30-b5ff-166759d4e8f3 service neutron] 10.222.0.31 "DELETE /v2.0/ports/cb941377-5fe0-4e9e-9ac5-1fb6253c78d7/bindings/n-h2-713301-27 HTTP/1.1" status: 204 len: 173 time: 0.3731883 Dec 09 21:19:36.973512 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ba10ca92-f90d-420a-ac48-1504fda773b0 None None] Provisioning complete for port 0fa51266-e039-4a6c-b933-24080a940ed9 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:36.973986 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ba10ca92-f90d-420a-ac48-1504fda773b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:37.006720 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-08c40164-e323-4643-bea6-f84466db7266 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Made reservation on behalf of 669b986126134ec0a75d9f954a17ffa1 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:19:37.014476 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-08c40164-e323-4643-bea6-f84466db7266 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:37.033905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-4d099499-e902-49d0-a7b9-f9b4c239e2b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:37.034834 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-4d099499-e902-49d0-a7b9-f9b4c239e2b1 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:37.035196 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-08c40164-e323-4643-bea6-f84466db7266 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:37.040069 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-4d099499-e902-49d0-a7b9-f9b4c239e2b1 service neutron] 10.222.0.31 "PUT /v2.0/ports/84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 HTTP/1.1" status: 200 len: 1093 time: 1.6744554 Dec 09 21:19:37.046348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-32cd063d-bc76-49e2-8453-34abd19aeed0 admin admin] Router 0d220f39-aeac-4dc5-ac16-e4d907702583 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:19:37.049703 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'eac884a1-b960-4dfb-9337-7c68c9f0acca', 'tag': '84ad33bd-6ab4-41c4-91dc-7edb7fd59e12'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:37.052829 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e3867090-eaca-4f15-b868-ddf2c4356eae" -d '{"events": [{"name": "network-changed", "server_uuid": "eac884a1-b960-4dfb-9337-7c68c9f0acca", "tag": "84ad33bd-6ab4-41c4-91dc-7edb7fd59e12"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:37.123532 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d099499-e902-49d0-a7b9-f9b4c239e2b1 service neutron] Pushing event updated for resources: {'Port': ['ID=84ad33bd-6ab4-41c4-91dc-7edb7fd59e12,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:37.164382 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6772b5a0-0a84-4c52-8349-ed4e7aa7b1d3 req-cbfba689-1bd6-4367-a4e0-b82b24d5ab4c tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1832874 Dec 09 21:19:37.177785 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-01f3492f-4486-4d78-bb31-18d54da9b768 service neutron] 10.222.0.13 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1978548 Dec 09 21:19:37.196084 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-0d69d19a-2f38-4197-8ef2-b714f045d9ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:37.198294 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-0d69d19a-2f38-4197-8ef2-b714f045d9ef service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7233ac85d55e4123a22cfa34bc1ee70e&device_id=eac884a1-b960-4dfb-9337-7c68c9f0acca HTTP/1.1" status: 200 len: 1096 time: 0.0945649 Dec 09 21:19:37.205394 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-32cd063d-bc76-49e2-8453-34abd19aeed0 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:19:37.218945 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] Sync routers for ids ['0d220f39-aeac-4dc5-ac16-e4d907702583'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:19:37.237291 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] Routers {'0d220f39-aeac-4dc5-ac16-e4d907702583'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:19:37.237661 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-08c40164-e323-4643-bea6-f84466db7266 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:37.237926 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:19:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['0d220f39-aeac-4dc5-ac16-e4d907702583'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:37.243920 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-32cd063d-bc76-49e2-8453-34abd19aeed0 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:37.246069 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-32cd063d-bc76-49e2-8453-34abd19aeed0 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 3.3554225 Dec 09 21:19:37.248913 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57804) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:37.254642 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-aba4c28f-89ed-42a4-bc02-1d4b79f290a3 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 HTTP/1.1" status: 200 len: 217 time: 0.0475495 Dec 09 21:19:37.257583 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-08c40164-e323-4643-bea6-f84466db7266 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:37.335117 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-094588a9-e73d-49ac-be76-f4f2b6e7a261 req-15367bea-a6a1-4793-818b-0b407f1aa010 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a8ab99b-8927-4f89-9ef5-773ea7697c2b HTTP/1.1" status: 200 len: 210 time: 0.0631261 Dec 09 21:19:37.355198 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-2348e428-9605-4547-9996-a753561429da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:37.357568 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-2348e428-9605-4547-9996-a753561429da service neutron] 10.222.0.31 "GET /v2.0/subnets?id=63e7603a-bb11-4d1a-8d84-55456d81931c HTTP/1.1" status: 200 len: 845 time: 0.0965405 Dec 09 21:19:37.373731 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08c40164-e323-4643-bea6-f84466db7266 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3564cbaa-b044-4bce-988d-93357d77088a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:37.442086 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] Set router 0d220f39-aeac-4dc5-ac16-e4d907702583 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:19:37.467203 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-9a6f0e6c-5f23-4097-8697-7dd78f8eda39 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=8e0b26d7-eefe-4c85-b535-944f3c15f0f6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1017318 Dec 09 21:19:37.557949 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9a675112-fd2e-48f3-a045-339955ae2067 x-openstack-request-id: req-9a675112-fd2e-48f3-a045-339955ae2067 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:37.558419 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "eac884a1-b960-4dfb-9337-7c68c9f0acca", "tag": "84ad33bd-6ab4-41c4-91dc-7edb7fd59e12", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:37.558760 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-9a675112-fd2e-48f3-a045-339955ae2067 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:37.560578 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'eac884a1-b960-4dfb-9337-7c68c9f0acca', 'tag': '84ad33bd-6ab4-41c4-91dc-7edb7fd59e12', 'status': 'completed', 'code': 200} Dec 09 21:19:37.618667 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a542a206-4b77-4244-9448-fb8efd222ef6 req-0a8e97e0-ff2d-4918-aa65-ca9778e5dc17 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:37.624319 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a542a206-4b77-4244-9448-fb8efd222ef6 req-0a8e97e0-ff2d-4918-aa65-ca9778e5dc17 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 944 time: 0.0788977 Dec 09 21:19:37.695291 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-08c40164-e323-4643-bea6-f84466db7266 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Allocated IP 192.168.233.192 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/1c5817d2-0469-4f14-9ffd-a7e8649e3bb6) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:19:37.716322 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0fa51266-e039-4a6c-b933-24080a940ed9 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:19:37.819414 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a542a206-4b77-4244-9448-fb8efd222ef6 req-4e506bb7-324b-4d43-8880-6b7ad320be49 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1875198 Dec 09 21:19:37.822860 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-1367c2e2-fae3-407b-99e1-13623a4cc09b service neutron] 10.222.0.31 "GET /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3474977 Dec 09 21:19:37.843954 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d220f39-aeac-4dc5-ac16-e4d907702583', 'name': 'tempest-AttachSCSIVolumeTestJSON-1560467054-router', 'tenant_id': '913fcb9b5aab4356999ade167d5148c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.216'}], 'enable_snat': True}, 'gw_port_id': 'bfb54d46-9eb4-4f0f-a20d-de24e82762cc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:19:33Z', 'updated_at': '2021-12-09T21:19:35Z', 'revision_number': 3, 'project_id': '913fcb9b5aab4356999ade167d5148c6', 'gw_port': {'id': 'bfb54d46-9eb4-4f0f-a20d-de24e82762cc', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:42:ee', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0d220f39-aeac-4dc5-ac16-e4d907702583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 492, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.216', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:19:35Z', 'updated_at': '2021-12-09T21:19:35Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:37.857055 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:37.866957 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 0fa51266-e039-4a6c-b933-24080a940ed9 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:37.867324 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:37.898704 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] Checking router: 0d220f39-aeac-4dc5-ac16-e4d907702583 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:19:37.899057 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] Updating router 0d220f39-aeac-4dc5-ac16-e4d907702583 port bfb54d46-9eb4-4f0f-a20d-de24e82762cc binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:19:37.949930 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:38.023392 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89dba041-141b-4b38-be4f-8903ee486a93 req-c01250a6-49ce-4980-a633-2297aab550a2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 210 time: 0.0991940 Dec 09 21:19:38.041289 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-08c40164-e323-4643-bea6-f84466db7266 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:38.062507 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19305775-6889-46df-8cf6-2d863a834ede req-2486c4df-1c43-4f56-b6e4-64cdd65f1456 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:38.070093 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19305775-6889-46df-8cf6-2d863a834ede req-2486c4df-1c43-4f56-b6e4-64cdd65f1456 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.3345890 Dec 09 21:19:38.090166 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-08c40164-e323-4643-bea6-f84466db7266 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:38.139396 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19305775-6889-46df-8cf6-2d863a834ede req-4ff85d8d-f366-4b86-ae1e-4d8dc78a7954 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0638306 Dec 09 21:19:38.152632 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-08c40164-e323-4643-bea6-f84466db7266 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:19:38.161405 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbe1a40f-8643-47d3-b699-766846cf5893 req-5a9a54fc-50ea-48d9-ba15-c29708c20836 service neutron] 10.222.0.31 "GET /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2658141 Dec 09 21:19:38.433996 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-08c40164-e323-4643-bea6-f84466db7266 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:19:38.442070 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-08c40164-e323-4643-bea6-f84466db7266 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:19:38.480029 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08c40164-e323-4643-bea6-f84466db7266 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Pushing event updated for resources: {'Port': ['ID=1c5817d2-0469-4f14-9ffd-a7e8649e3bb6,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:38.495953 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:38.504586 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:38.540292 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-08c40164-e323-4643-bea6-f84466db7266 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:38.540978 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-08c40164-e323-4643-bea6-f84466db7266 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:38.558866 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bf37e6d-1730-4f4b-b486-7d5e8be0e309 None None] Pushing event updated for resources: {'Port': ['ID=bfb54d46-9eb4-4f0f-a20d-de24e82762cc,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:38.570533 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-08c40164-e323-4643-bea6-f84466db7266 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.8923287 Dec 09 21:19:38.571197 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf37e6d-1730-4f4b-b486-7d5e8be0e309 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:38.571651 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf37e6d-1730-4f4b-b486-7d5e8be0e309 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:38.571949 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf37e6d-1730-4f4b-b486-7d5e8be0e309 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:38.572328 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf37e6d-1730-4f4b-b486-7d5e8be0e309 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:38.572704 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf37e6d-1730-4f4b-b486-7d5e8be0e309 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:38.573025 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf37e6d-1730-4f4b-b486-7d5e8be0e309 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:38.573345 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf37e6d-1730-4f4b-b486-7d5e8be0e309 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:38.573717 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf37e6d-1730-4f4b-b486-7d5e8be0e309 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:38.574034 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf37e6d-1730-4f4b-b486-7d5e8be0e309 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:38.574402 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf37e6d-1730-4f4b-b486-7d5e8be0e309 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:38.574766 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf37e6d-1730-4f4b-b486-7d5e8be0e309 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:38.575081 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf37e6d-1730-4f4b-b486-7d5e8be0e309 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:38.575392 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf37e6d-1730-4f4b-b486-7d5e8be0e309 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:19:38.596237 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-0100304c-fd97-488e-9f88-11e8cce98a00 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=857de64ecc3946e3b92655f639d782df&shared=False HTTP/1.1" status: 200 len: 213 time: 0.3603117 Dec 09 21:19:38.597799 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] Attempting to bind port bfb54d46-9eb4-4f0f-a20d-de24e82762cc on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:19:38.598175 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] Attempting to bind port bfb54d46-9eb4-4f0f-a20d-de24e82762cc by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:19:38.598570 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] Attempting to bind port bfb54d46-9eb4-4f0f-a20d-de24e82762cc on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:38.604078 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 19, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:19:38.604441 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:19:38.604840 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:38.605501 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:19:38.605672 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] Bound port: bfb54d46-9eb4-4f0f-a20d-de24e82762cc, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:19:38.606085 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:38.631599 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-61f285f0-716b-4885-a4b1-30beb2b2e612 service neutron] Request body: {'port': {'device_id': '1a8ab99b-8927-4f89-9ef5-773ea7697c2b', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:38.666036 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] For port bfb54d46-9eb4-4f0f-a20d-de24e82762cc, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:38.670478 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] For port bfb54d46-9eb4-4f0f-a20d-de24e82762cc, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=bfb54d46-9eb4-4f0f-a20d-de24e82762cc,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:19:38.678383 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:38.705126 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-4b4c01e7-c060-4c12-a892-8bbaccaa7379 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:38.712392 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-4b4c01e7-c060-4c12-a892-8bbaccaa7379 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1153347 Dec 09 21:19:38.727970 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6e490291-64df-4851-a8a2-5a712f121f5a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:38.729796 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] Routers {'0d220f39-aeac-4dc5-ac16-e4d907702583'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:19:38.730495 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:19:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['0d220f39-aeac-4dc5-ac16-e4d907702583'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:38.748850 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-cddd7c3a-1b43-431f-ab90-894f912d81f1 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/quotas/857de64ecc3946e3b92655f639d782df HTTP/1.1" status: 200 len: 375 time: 0.0355501 Dec 09 21:19:38.751581 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-61f285f0-716b-4885-a4b1-30beb2b2e612 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:38.774785 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3867090-eaca-4f15-b868-ddf2c4356eae req-7d1a8069-0c27-417c-9435-847739c2bedc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:38.776246 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3867090-eaca-4f15-b868-ddf2c4356eae req-7d1a8069-0c27-417c-9435-847739c2bedc service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7233ac85d55e4123a22cfa34bc1ee70e&device_id=eac884a1-b960-4dfb-9337-7c68c9f0acca HTTP/1.1" status: 200 len: 1096 time: 0.5507989 Dec 09 21:19:38.791554 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42160da8-6d47-44b3-9a15-757988294448 req-b1ccf866-e390-4424-aaee-631888ad570c tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:38.799702 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42160da8-6d47-44b3-9a15-757988294448 req-b1ccf866-e390-4424-aaee-631888ad570c tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 1096 time: 0.2215316 Dec 09 21:19:38.816759 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bf37e6d-1730-4f4b-b486-7d5e8be0e309 None None] Pushing event updated for resources: {'Port': ['ID=bfb54d46-9eb4-4f0f-a20d-de24e82762cc,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:38.924366 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] Set router 0d220f39-aeac-4dc5-ac16-e4d907702583 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:19:38.926057 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42160da8-6d47-44b3-9a15-757988294448 req-04de1edc-5d1d-4c3e-980f-adbfa5e1374b tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1204860 Dec 09 21:19:38.926227 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b98ef443-78eb-4717-92d7-2677d9e11c47 None None] Provisioning complete for port 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:38.926715 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b98ef443-78eb-4717-92d7-2677d9e11c47 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:39.004045 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-b98ef443-78eb-4717-92d7-2677d9e11c47 None None] Port 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:19:39.070710 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-d8f204de-ddf3-44cc-b594-b2140a8916e9 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2993815 Dec 09 21:19:39.165256 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-6e490291-64df-4851-a8a2-5a712f121f5a admin admin] Allocated IP 172.20.0.1 (1444d8a7-187f-473b-be08-dce40f6ae8ea/f2e816c0-e7a2-4010-b2b9-8d7f39c3a318/012d7306-fba8-43d4-80e6-3acf4ac3f98c) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:19:39.232313 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3867090-eaca-4f15-b868-ddf2c4356eae req-949fbb86-f0c3-4b3b-bb3e-2acdbd0d9569 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:39.233919 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3867090-eaca-4f15-b868-ddf2c4356eae req-949fbb86-f0c3-4b3b-bb3e-2acdbd0d9569 service neutron] 10.222.0.31 "GET /v2.0/networks?id=8e0b26d7-eefe-4c85-b535-944f3c15f0f6 HTTP/1.1" status: 200 len: 906 time: 0.4449179 Dec 09 21:19:39.247811 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4778a63c-0b71-4831-a9bb-9b0edb64ec0c req-a66cda5e-282b-4524-9413-28fe9128ef34 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:39.259300 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4778a63c-0b71-4831-a9bb-9b0edb64ec0c req-a66cda5e-282b-4524-9413-28fe9128ef34 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=eac884a1-b960-4dfb-9337-7c68c9f0acca HTTP/1.1" status: 200 len: 944 time: 0.2144241 Dec 09 21:19:39.285887 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:39.374322 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-61f285f0-716b-4885-a4b1-30beb2b2e612 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:19:39.390724 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-61f285f0-716b-4885-a4b1-30beb2b2e612 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:39.391417 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3867090-eaca-4f15-b868-ddf2c4356eae req-7c64c578-4bb8-4788-8084-ae25e535d26b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 HTTP/1.1" status: 200 len: 217 time: 0.1205256 Dec 09 21:19:39.397972 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6e490291-64df-4851-a8a2-5a712f121f5a admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:39.410767 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d220f39-aeac-4dc5-ac16-e4d907702583', 'name': 'tempest-AttachSCSIVolumeTestJSON-1560467054-router', 'tenant_id': '913fcb9b5aab4356999ade167d5148c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.216'}], 'enable_snat': True}, 'gw_port_id': 'bfb54d46-9eb4-4f0f-a20d-de24e82762cc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:19:33Z', 'updated_at': '2021-12-09T21:19:35Z', 'revision_number': 3, 'project_id': '913fcb9b5aab4356999ade167d5148c6', 'gw_port': {'id': 'bfb54d46-9eb4-4f0f-a20d-de24e82762cc', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:42:ee', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0d220f39-aeac-4dc5-ac16-e4d907702583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 492, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.216', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:19:35Z', 'updated_at': '2021-12-09T21:19:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:39.413437 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-61f285f0-716b-4885-a4b1-30beb2b2e612 service neutron] Transition to ACTIVE for port object 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:19:39.431480 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-61f285f0-716b-4885-a4b1-30beb2b2e612 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:39.433422 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-10c92f40-b453-4b4c-9d5e-2d932fcc4b65 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:39.435315 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-10c92f40-b453-4b4c-9d5e-2d932fcc4b65 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.10 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 821 time: 0.5044868 Dec 09 21:19:39.453333 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf510984-738d-48b4-ad90-b91cbaaf9b63 None None] The sync data for ids ['0d220f39-aeac-4dc5-ac16-e4d907702583'] in n-d-713301-27 is: [{'id': '0d220f39-aeac-4dc5-ac16-e4d907702583', 'name': 'tempest-AttachSCSIVolumeTestJSON-1560467054-router', 'tenant_id': '913fcb9b5aab4356999ade167d5148c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.216'}], 'enable_snat': True}, 'gw_port_id': 'bfb54d46-9eb4-4f0f-a20d-de24e82762cc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:19:33Z', 'updated_at': '2021-12-09T21:19:35Z', 'revision_number': 3, 'project_id': '913fcb9b5aab4356999ade167d5148c6', 'gw_port': {'id': 'bfb54d46-9eb4-4f0f-a20d-de24e82762cc', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:42:ee', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0d220f39-aeac-4dc5-ac16-e4d907702583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 492, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.216', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:19:35Z', 'updated_at': '2021-12-09T21:19:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:19:39.485475 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-ca488f61-c861-43d4-9ba7-1f709861dd20 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Request body: {'port': {'device_id': '18c57a12-fe06-4b8d-93c7-e3121619fa56', 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c', 'admin_state_up': True, 'tenant_id': 'a306d2242b1e41c892f63c7b122cdee4'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:39.514562 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61f285f0-716b-4885-a4b1-30beb2b2e612 service neutron] Pushing event updated for resources: {'Port': ['ID=1c5817d2-0469-4f14-9ffd-a7e8649e3bb6,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:39.529888 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6e490291-64df-4851-a8a2-5a712f121f5a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:39.550119 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4778a63c-0b71-4831-a9bb-9b0edb64ec0c req-bac45514-88f6-4541-92fc-aa67d72ab68d tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2875299 Dec 09 21:19:39.623643 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31f242dd-23db-4d59-b36f-c00784e5ddd3 req-dd94265d-0fe2-4e71-985f-be84df2517d3 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:39.626040 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31f242dd-23db-4d59-b36f-c00784e5ddd3 req-dd94265d-0fe2-4e71-985f-be84df2517d3 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a8ab99b-8927-4f89-9ef5-773ea7697c2b HTTP/1.1" status: 200 len: 936 time: 0.2540829 Dec 09 21:19:39.634550 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3867090-eaca-4f15-b868-ddf2c4356eae req-41419cb0-38db-4bb2-bfbc-e0a9ad90c31f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:39.636531 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3867090-eaca-4f15-b868-ddf2c4356eae req-41419cb0-38db-4bb2-bfbc-e0a9ad90c31f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=63e7603a-bb11-4d1a-8d84-55456d81931c HTTP/1.1" status: 200 len: 845 time: 0.2215171 Dec 09 21:19:39.641919 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e490291-64df-4851-a8a2-5a712f121f5a admin admin] Pushing event updated for resources: {'Port': ['ID=012d7306-fba8-43d4-80e6-3acf4ac3f98c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:39.659838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6e490291-64df-4851-a8a2-5a712f121f5a admin admin] Network 1444d8a7-187f-473b-be08-dce40f6ae8ea is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:19:39.662920 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-6e490291-64df-4851-a8a2-5a712f121f5a admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:19:39.667253 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e490291-64df-4851-a8a2-5a712f121f5a admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:19:39.726312 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3867090-eaca-4f15-b868-ddf2c4356eae req-e435e09f-351f-4dd2-99db-139b1452d343 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=8e0b26d7-eefe-4c85-b535-944f3c15f0f6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0729468 Dec 09 21:19:39.753611 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-61f285f0-716b-4885-a4b1-30beb2b2e612 service neutron] Attempting to bind port 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:19:39.754192 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-61f285f0-716b-4885-a4b1-30beb2b2e612 service neutron] Attempting to bind port 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:19:39.754534 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-61f285f0-716b-4885-a4b1-30beb2b2e612 service neutron] Attempting to bind port 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:39.756962 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6e490291-64df-4851-a8a2-5a712f121f5a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:39.762752 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-61f285f0-716b-4885-a4b1-30beb2b2e612 service neutron] Port 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:19:39.763184 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-61f285f0-716b-4885-a4b1-30beb2b2e612 service neutron] Attempting to bind port 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:39.816602 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-61f285f0-716b-4885-a4b1-30beb2b2e612 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 19, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:19:39.817119 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-61f285f0-716b-4885-a4b1-30beb2b2e612 service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:19:39.817667 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-61f285f0-716b-4885-a4b1-30beb2b2e612 service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:19:39.818216 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-61f285f0-716b-4885-a4b1-30beb2b2e612 service neutron] Bound port: 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:19:39.818684 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-61f285f0-716b-4885-a4b1-30beb2b2e612 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:39.896027 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31f242dd-23db-4d59-b36f-c00784e5ddd3 req-2917a186-8bbf-416c-85d9-22770ce1304f tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/security-groups?id=3564cbaa-b044-4bce-988d-93357d77088a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2577398 Dec 09 21:19:39.930691 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-61f285f0-716b-4885-a4b1-30beb2b2e612 service neutron] For port 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:39.944465 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-61f285f0-716b-4885-a4b1-30beb2b2e612 service neutron] For port 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1c5817d2-0469-4f14-9ffd-a7e8649e3bb6,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:19:39.954546 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-61f285f0-716b-4885-a4b1-30beb2b2e612 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:40.097738 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-362851c7-4cd2-4786-8659-4c28be6573fb req-2106da4e-db24-44ac-87c6-d8e3b704d588 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 210 time: 0.2278383 Dec 09 21:19:40.149476 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2053e063-453d-44f4-aa55-f0cf26166bc3 None None] Provisioning complete for port 012d7306-fba8-43d4-80e6-3acf4ac3f98c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:40.150707 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2053e063-453d-44f4-aa55-f0cf26166bc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:40.184869 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-ca488f61-c861-43d4-9ba7-1f709861dd20 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Made reservation on behalf of a306d2242b1e41c892f63c7b122cdee4 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:19:40.189137 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-ca488f61-c861-43d4-9ba7-1f709861dd20 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:40.198236 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-61f285f0-716b-4885-a4b1-30beb2b2e612 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:40.198793 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-61f285f0-716b-4885-a4b1-30beb2b2e612 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:40.200324 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-61f285f0-716b-4885-a4b1-30beb2b2e612 service neutron] 10.222.0.31 "PUT /v2.0/ports/1c5817d2-0469-4f14-9ffd-a7e8649e3bb6 HTTP/1.1" status: 200 len: 1097 time: 1.5752800 Dec 09 21:19:40.200822 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1a8ab99b-8927-4f89-9ef5-773ea7697c2b', 'tag': '1c5817d2-0469-4f14-9ffd-a7e8649e3bb6'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:40.203237 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f6c71adc-1406-40bc-83fd-82b74c051b14" -d '{"events": [{"name": "network-changed", "server_uuid": "1a8ab99b-8927-4f89-9ef5-773ea7697c2b", "tag": "1c5817d2-0469-4f14-9ffd-a7e8649e3bb6"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:40.215132 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02b530a1-e598-42a8-aa92-83d4fc9ecfa4 req-48cc1947-e5a9-4754-9c8d-63c075197a0c tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:40.216824 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02b530a1-e598-42a8-aa92-83d4fc9ecfa4 req-48cc1947-e5a9-4754-9c8d-63c075197a0c tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.1307569 Dec 09 21:19:40.242042 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61f285f0-716b-4885-a4b1-30beb2b2e612 service neutron] Pushing event updated for resources: {'Port': ['ID=1c5817d2-0469-4f14-9ffd-a7e8649e3bb6,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:40.255632 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-2053e063-453d-44f4-aa55-f0cf26166bc3 None None] Port 012d7306-fba8-43d4-80e6-3acf4ac3f98c cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:19:40.270871 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3867090-eaca-4f15-b868-ddf2c4356eae req-c62ca8e9-e357-4c84-819f-95112e1554d1 service neutron] 10.222.0.31 "GET /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5162296 Dec 09 21:19:40.367019 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6e490291-64df-4851-a8a2-5a712f121f5a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:40.392766 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-5ee9aa68-429e-4003-8c5a-811c07851ac7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:40.394321 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-5ee9aa68-429e-4003-8c5a-811c07851ac7 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=669b986126134ec0a75d9f954a17ffa1&device_id=1a8ab99b-8927-4f89-9ef5-773ea7697c2b HTTP/1.1" status: 200 len: 1100 time: 0.1288886 Dec 09 21:19:40.471868 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-32946971-6778-456e-bcb2-32366b51d8eb service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.192&port_id=1c5817d2-0469-4f14-9ffd-a7e8649e3bb6 HTTP/1.1" status: 200 len: 217 time: 0.0419674 Dec 09 21:19:40.583479 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-97ec5c76-2240-48e8-a488-85165d199c48 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:40.584961 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-97ec5c76-2240-48e8-a488-85165d199c48 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1011963 Dec 09 21:19:40.604721 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02b530a1-e598-42a8-aa92-83d4fc9ecfa4 req-d106e94d-6649-42bd-8bc4-fdd397e41bd6 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3510749 Dec 09 21:19:40.675980 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-8a1f6905-5a4b-4750-a649-fbd48833cc3f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:40.677620 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-8a1f6905-5a4b-4750-a649-fbd48833cc3f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0834882 Dec 09 21:19:40.699690 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6e490291-64df-4851-a8a2-5a712f121f5a admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:40.719153 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6e490291-64df-4851-a8a2-5a712f121f5a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:40.740509 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-06c2a95d-2e1a-48d1-b315-632fcd2ab948 req-1e3b2c4a-c55c-40aa-a1dc-1d69b937f950 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 210 time: 0.0494661 Dec 09 21:19:40.753515 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3867090-eaca-4f15-b868-ddf2c4356eae req-f25df4e6-dd0b-48d8-8342-646a9d22bed8 service neutron] 10.222.0.31 "GET /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4308231 Dec 09 21:19:40.783977 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-ee52278a-6953-4395-b6ec-40fb99c28a1b tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:40.786684 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-ee52278a-6953-4395-b6ec-40fb99c28a1b tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 807 time: 0.5339971 Dec 09 21:19:40.822042 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-17742e36-9077-4c10-94b7-96b548669f0b x-openstack-request-id: req-17742e36-9077-4c10-94b7-96b548669f0b {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:40.822606 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1a8ab99b-8927-4f89-9ef5-773ea7697c2b", "tag": "1c5817d2-0469-4f14-9ffd-a7e8649e3bb6", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:40.822816 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-17742e36-9077-4c10-94b7-96b548669f0b {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:40.823310 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1a8ab99b-8927-4f89-9ef5-773ea7697c2b', 'tag': '1c5817d2-0469-4f14-9ffd-a7e8649e3bb6', 'status': 'completed', 'code': 200} Dec 09 21:19:40.830429 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-3ece6f4a-e750-4115-8988-dcce82cdca90 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/quotas/ac5b7cefd8cc48cc83f38d3923aae132 HTTP/1.1" status: 200 len: 375 time: 0.0148573 Dec 09 21:19:40.861751 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-ca488f61-c861-43d4-9ba7-1f709861dd20 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Allocated IP 172.20.0.12 (93378dc3-2ac5-4cf7-9ce3-d812934de40c/c49a62cc-af1b-4958-a4a9-eb44188b8fb9/40468c91-ccde-4d96-b234-0e326a1de103) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:19:40.877712 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6e490291-64df-4851-a8a2-5a712f121f5a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:40.881002 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e490291-64df-4851-a8a2-5a712f121f5a admin admin] Pushing event updated for resources: {'Port': ['ID=012d7306-fba8-43d4-80e6-3acf4ac3f98c,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:40.897653 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-0eafab9f-605f-44dc-9bc1-07ee531a5bbd tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=857de64ecc3946e3b92655f639d782df&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1074440 Dec 09 21:19:40.935163 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-faf72ae3-33c4-4515-b10f-a7ded10a0faf service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2481086 Dec 09 21:19:40.972189 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-b3d6eb1b-848c-45c1-8a58-70b7b76a24f4 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1273916 Dec 09 21:19:41.068782 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6e490291-64df-4851-a8a2-5a712f121f5a admin admin] Network 1444d8a7-187f-473b-be08-dce40f6ae8ea is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:19:41.074265 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-6e490291-64df-4851-a8a2-5a712f121f5a admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:19:41.089151 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-37c1609f-c53c-437d-b310-53aa1b16c979 req-69b734ff-85a0-43ac-b8cb-ba1c505026c6 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1433139 Dec 09 21:19:41.191686 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b261732f-a199-4945-a895-cbb56b6f4d3e req-cb00fb58-7da4-4b54-b5a1-dcdaaf29abbc tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:41.193283 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b261732f-a199-4945-a895-cbb56b6f4d3e req-cb00fb58-7da4-4b54-b5a1-dcdaaf29abbc tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=eac884a1-b960-4dfb-9337-7c68c9f0acca HTTP/1.1" status: 200 len: 944 time: 0.2496848 Dec 09 21:19:41.216542 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:19:41.244374 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6c71adc-1406-40bc-83fd-82b74c051b14 req-b25dbb22-2df4-4de9-af16-f2a808bfd51b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:41.246013 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f6c71adc-1406-40bc-83fd-82b74c051b14 req-b25dbb22-2df4-4de9-af16-f2a808bfd51b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=669b986126134ec0a75d9f954a17ffa1&device_id=1a8ab99b-8927-4f89-9ef5-773ea7697c2b HTTP/1.1" status: 200 len: 1100 time: 0.0974281 Dec 09 21:19:41.249371 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6e490291-64df-4851-a8a2-5a712f121f5a admin admin] Router 0d220f39-aeac-4dc5-ac16-e4d907702583 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:19:41.254307 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-11916c72-98d6-451b-a9e4-98ac18707658 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:41.255837 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-11916c72-98d6-451b-a9e4-98ac18707658 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3464952 Dec 09 21:19:41.273046 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-71bdc359-536f-47bd-bb54-110a4e3ac45a tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Request body: {'port': {'device_id': '89bd78b4-a499-4908-8ee4-7b3f64653d0b', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '857de64ecc3946e3b92655f639d782df'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:41.318090 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-eeffc0d2-e8cc-4212-9a2e-2b48f9ae8021 service neutron] 10.222.0.13 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3225207 Dec 09 21:19:41.414211 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d45b3b18-3a2a-4614-92eb-000ba1a624c8 None None] Provisioning complete for port 012d7306-fba8-43d4-80e6-3acf4ac3f98c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:41.415321 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d45b3b18-3a2a-4614-92eb-000ba1a624c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:41.423731 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b261732f-a199-4945-a895-cbb56b6f4d3e req-4b58cbc7-3c80-489e-aae1-9ac98bfed62a tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2182810 Dec 09 21:19:41.436819 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6c71adc-1406-40bc-83fd-82b74c051b14 req-55739023-c9b8-4b77-b83b-0a964f0369bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:41.438088 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f6c71adc-1406-40bc-83fd-82b74c051b14 req-55739023-c9b8-4b77-b83b-0a964f0369bd service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.1843643 Dec 09 21:19:41.452582 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d45b3b18-3a2a-4614-92eb-000ba1a624c8 None None] Port 012d7306-fba8-43d4-80e6-3acf4ac3f98c cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:19:41.468769 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6e490291-64df-4851-a8a2-5a712f121f5a admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:19:41.475398 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-ca488f61-c861-43d4-9ba7-1f709861dd20 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:41.512046 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6e490291-64df-4851-a8a2-5a712f121f5a admin admin] 10.222.0.13 "PUT /v2.0/routers/0d220f39-aeac-4dc5-ac16-e4d907702583/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.2602410 Dec 09 21:19:41.516063 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f6c71adc-1406-40bc-83fd-82b74c051b14 req-e6cbcc80-34fe-4320-a6c6-95f2eb84bf70 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.192&port_id=1c5817d2-0469-4f14-9ffd-a7e8649e3bb6 HTTP/1.1" status: 200 len: 217 time: 0.0552905 Dec 09 21:19:41.561080 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-b16ceafa-61aa-40b8-bbc4-0b4989c46cac service neutron] 10.222.0.13 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2319682 Dec 09 21:19:41.563861 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-71bdc359-536f-47bd-bb54-110a4e3ac45a tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Made reservation on behalf of 857de64ecc3946e3b92655f639d782df for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:19:41.567571 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-71bdc359-536f-47bd-bb54-110a4e3ac45a tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:41.583830 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6c71adc-1406-40bc-83fd-82b74c051b14 req-681e3512-a500-4311-9b8f-0005b83e123e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:41.585817 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f6c71adc-1406-40bc-83fd-82b74c051b14 req-681e3512-a500-4311-9b8f-0005b83e123e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0602469 Dec 09 21:19:41.595407 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-ca488f61-c861-43d4-9ba7-1f709861dd20 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:41.680518 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6c71adc-1406-40bc-83fd-82b74c051b14 req-e5ce6e0e-788f-414e-b41e-3569167ec2eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:41.682096 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f6c71adc-1406-40bc-83fd-82b74c051b14 req-e5ce6e0e-788f-414e-b41e-3569167ec2eb service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0863800 Dec 09 21:19:41.688392 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-ca488f61-c861-43d4-9ba7-1f709861dd20 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Network 93378dc3-2ac5-4cf7-9ce3-d812934de40c is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:19:41.704084 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-ca488f61-c861-43d4-9ba7-1f709861dd20 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:19:41.731700 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-ca488f61-c861-43d4-9ba7-1f709861dd20 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:19:41.782385 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device bfb54d46-9eb4-4f0f-a20d-de24e82762cc up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:19:41.786874 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-ca488f61-c861-43d4-9ba7-1f709861dd20 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:41.790258 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-ca488f61-c861-43d4-9ba7-1f709861dd20 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:41.801920 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca488f61-c861-43d4-9ba7-1f709861dd20 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Pushing event updated for resources: {'Port': ['ID=40468c91-ccde-4d96-b234-0e326a1de103,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:41.877057 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f6c71adc-1406-40bc-83fd-82b74c051b14 req-aaf9b0a8-0839-4de9-a90f-7e9d8e838068 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1868346 Dec 09 21:19:41.878521 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-ca488f61-c861-43d4-9ba7-1f709861dd20 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.4263937 Dec 09 21:19:41.892483 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] Sync routers for ids ['0d220f39-aeac-4dc5-ac16-e4d907702583'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:19:41.894346 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-cb2d823a-5dc1-4102-bbf3-1e98c783e97e service neutron] Request body: {'port': {'device_id': '18c57a12-fe06-4b8d-93c7-e3121619fa56', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:41.922069 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] Routers {'0d220f39-aeac-4dc5-ac16-e4d907702583'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:19:41.922753 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:19:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['0d220f39-aeac-4dc5-ac16-e4d907702583'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:41.929101 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18f7d4d8-1100-4c95-95d3-9d3de74176d0 req-4ce999f7-c336-4f12-9976-2b8007a9fbf5 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:41.936160 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-18f7d4d8-1100-4c95-95d3-9d3de74176d0 req-4ce999f7-c336-4f12-9976-2b8007a9fbf5 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a8ab99b-8927-4f89-9ef5-773ea7697c2b HTTP/1.1" status: 200 len: 948 time: 0.2529032 Dec 09 21:19:41.976003 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-71bdc359-536f-47bd-bb54-110a4e3ac45a tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Allocated IP 192.168.233.140 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/36925110-4ed7-49f6-b07d-d998896a74cc) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:19:42.005328 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port bfb54d46-9eb4-4f0f-a20d-de24e82762cc triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:42.005699 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:42.064622 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f6c71adc-1406-40bc-83fd-82b74c051b14 req-3442d801-f8e3-4edb-9d3c-570732d663a9 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1766226 Dec 09 21:19:42.137100 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] Set router 0d220f39-aeac-4dc5-ac16-e4d907702583 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:19:42.173618 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:42.240911 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port bfb54d46-9eb4-4f0f-a20d-de24e82762cc, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=bfb54d46-9eb4-4f0f-a20d-de24e82762cc,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:42.242220 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1cc3b771-7d24-4dfa-bbfe-6e007094c74b details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:19:42.269450 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:42.316718 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:19:42.416028 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aacc1c1a-5d43-4b77-9b24-674ea1c4b555 req-5f646efe-b50b-4b77-b4c5-3a9155a78740 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:42.417834 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aacc1c1a-5d43-4b77-9b24-674ea1c4b555 req-5f646efe-b50b-4b77-b4c5-3a9155a78740 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 932 time: 0.4696491 Dec 09 21:19:42.427084 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-cb2d823a-5dc1-4102-bbf3-1e98c783e97e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:42.456781 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-18f7d4d8-1100-4c95-95d3-9d3de74176d0 req-1e0b423c-083c-4bc6-a509-add208a48054 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/security-groups?id=3564cbaa-b044-4bce-988d-93357d77088a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5197103 Dec 09 21:19:42.490290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57906) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:42.498249 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2e1d495b-fe05-4259-8066-12cc993bcf8d admin admin] Request body: {'network': {'name': 'tempest-AttachSCSIVolumeTestJSON-882207386-network', 'tenant_id': '638a9d4528c04bcc89501243ebdb6eda'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:42.523127 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.resource_extend [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] It took 0.25 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 09 21:19:42.531244 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e1d495b-fe05-4259-8066-12cc993bcf8d admin admin] Made reservation on behalf of 638a9d4528c04bcc89501243ebdb6eda for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:19:42.535138 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2e1d495b-fe05-4259-8066-12cc993bcf8d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:42.556694 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2e1d495b-fe05-4259-8066-12cc993bcf8d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:42.620593 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=bfb54d46-9eb4-4f0f-a20d-de24e82762cc,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:42.662811 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2e1d495b-fe05-4259-8066-12cc993bcf8d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:42.670412 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2e1d495b-fe05-4259-8066-12cc993bcf8d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:42.705378 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2e1d495b-fe05-4259-8066-12cc993bcf8d admin admin] vlan segment allocate from pool success with {'vlan_id': 106, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:19:42.716895 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e1d495b-fe05-4259-8066-12cc993bcf8d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fc11eea2-09b0-4d07-acd7-a78f1f8d99c1,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:42.735276 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2e1d495b-fe05-4259-8066-12cc993bcf8d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:42.737032 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-2e1d495b-fe05-4259-8066-12cc993bcf8d admin admin] Added segment cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9 of type vlan for network 8d988748-159b-463d-bdf5-500e0ea1b879 Dec 09 21:19:42.748168 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1cc3b771-7d24-4dfa-bbfe-6e007094c74b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:42.769142 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '1cc3b771-7d24-4dfa-bbfe-6e007094c74b', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '1cc3b771-7d24-4dfa-bbfe-6e007094c74b', 'mac_address': 'fa:16:3e:33:8a:7c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.203'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:19:42.787732 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2e1d495b-fe05-4259-8066-12cc993bcf8d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:42.791136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=84ad33bd-6ab4-41c4-91dc-7edb7fd59e12,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:42.821013 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2e1d495b-fe05-4259-8066-12cc993bcf8d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:42.822588 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e1d495b-fe05-4259-8066-12cc993bcf8d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:42.826094 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2e1d495b-fe05-4259-8066-12cc993bcf8d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:42.832955 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '84ad33bd-6ab4-41c4-91dc-7edb7fd59e12', 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6', 'port_id': '84ad33bd-6ab4-41c4-91dc-7edb7fd59e12', 'mac_address': 'fa:16:3e:03:d1:de', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 122, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '63e7603a-bb11-4d1a-8d84-55456d81931c', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:19:42.838631 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aacc1c1a-5d43-4b77-9b24-674ea1c4b555 req-a1705d53-ba14-45f2-816b-206d31dafd9b tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4073267 Dec 09 21:19:42.851361 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-71bdc359-536f-47bd-bb54-110a4e3ac45a tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:42.866791 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2e1d495b-fe05-4259-8066-12cc993bcf8d admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.3750534 Dec 09 21:19:42.869374 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57910) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:42.882712 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc8a85cc-5557-4973-ad69-093ba23a06bd req-fae8bd3c-a796-4be1-a448-6c6d6b656095 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:42.884824 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc8a85cc-5557-4973-ad69-093ba23a06bd req-fae8bd3c-a796-4be1-a448-6c6d6b656095 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 950 time: 0.2886198 Dec 09 21:19:42.892234 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:42.908201 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-0f4df662-3031-4e5c-a899-9c7b6641fc50 admin admin] Request body: {'subnet': {'network_id': '8d988748-159b-463d-bdf5-500e0ea1b879', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachSCSIVolumeTestJSON-882207386-subnet', 'tenant_id': '638a9d4528c04bcc89501243ebdb6eda', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:42.914227 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d220f39-aeac-4dc5-ac16-e4d907702583', 'name': 'tempest-AttachSCSIVolumeTestJSON-1560467054-router', 'tenant_id': '913fcb9b5aab4356999ade167d5148c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.216'}], 'enable_snat': True}, 'gw_port_id': 'bfb54d46-9eb4-4f0f-a20d-de24e82762cc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:19:33Z', 'updated_at': '2021-12-09T21:19:40Z', 'revision_number': 4, 'project_id': '913fcb9b5aab4356999ade167d5148c6', 'gw_port': {'id': 'bfb54d46-9eb4-4f0f-a20d-de24e82762cc', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:42:ee', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0d220f39-aeac-4dc5-ac16-e4d907702583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 492, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.216', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:19:35Z', 'updated_at': '2021-12-09T21:19:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '012d7306-fba8-43d4-80e6-3acf4ac3f98c', 'name': '', 'network_id': '1444d8a7-187f-473b-be08-dce40f6ae8ea', 'tenant_id': '913fcb9b5aab4356999ade167d5148c6', 'mac_address': 'fa:16:3e:f3:18:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0d220f39-aeac-4dc5-ac16-e4d907702583', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': 'f2e816c0-e7a2-4010-b2b9-8d7f39c3a318', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:19:38Z', 'updated_at': '2021-12-09T21:19:40Z', 'revision_number': 2, 'project_id': '913fcb9b5aab4356999ade167d5148c6', 'subnets': [{'id': 'f2e816c0-e7a2-4010-b2b9-8d7f39c3a318', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:42.918903 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e1d495b-fe05-4259-8066-12cc993bcf8d admin admin] Pushing event updated for resources: {'Network': ['ID=8d988748-159b-463d-bdf5-500e0ea1b879,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:42.940922 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0f4df662-3031-4e5c-a899-9c7b6641fc50 admin admin] Made reservation on behalf of 638a9d4528c04bcc89501243ebdb6eda for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:19:42.945282 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0f4df662-3031-4e5c-a899-9c7b6641fc50 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:42.948076 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] Checking router: 0d220f39-aeac-4dc5-ac16-e4d907702583 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:19:42.948629 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] Updating router 0d220f39-aeac-4dc5-ac16-e4d907702583 port 012d7306-fba8-43d4-80e6-3acf4ac3f98c binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:19:42.950809 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 8d988748-159b-463d-bdf5-500e0ea1b879 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:19:42.971126 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:42.989689 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 1cc3b771-7d24-4dfa-bbfe-6e007094c74b {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:19:43.033557 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:43.039822 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ee448b5c-b433-40b6-9103-36268b10edf9 req-bd44caf8-c72e-4a95-8888-271982fad0dc tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 210 time: 0.0840535 Dec 09 21:19:43.056731 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc8a85cc-5557-4973-ad69-093ba23a06bd req-7b34736a-0268-44c8-bde4-96a4fc5e6303 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1603513 Dec 09 21:19:43.072332 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-71bdc359-536f-47bd-bb54-110a4e3ac45a tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:43.095526 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1cc3b771-7d24-4dfa-bbfe-6e007094c74b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:43.097355 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:19:43.113892 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['204e6970-8ed3-4e91-9792-52401052a153'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:19:43.152116 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:43.172688 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71bdc359-536f-47bd-bb54-110a4e3ac45a tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Pushing event updated for resources: {'Port': ['ID=36925110-4ed7-49f6-b07d-d998896a74cc,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:43.209929 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=84ad33bd-6ab4-41c4-91dc-7edb7fd59e12,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:43.229328 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:43.278791 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e515e98a-539c-42a6-a592-b901b154277f req-542055b3-c1b2-468b-85f8-cb48391664b7 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 210 time: 0.0871439 Dec 09 21:19:43.345415 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-71bdc359-536f-47bd-bb54-110a4e3ac45a tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:19:43.347124 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=1cc3b771-7d24-4dfa-bbfe-6e007094c74b,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:43.372789 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-71bdc359-536f-47bd-bb54-110a4e3ac45a tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:19:43.378153 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-71bdc359-536f-47bd-bb54-110a4e3ac45a tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:19:43.446568 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['1cc3b771-7d24-4dfa-bbfe-6e007094c74b'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:19:43.461771 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c88c5ac-6c7d-4c32-ae59-fc8573c2e9d7 req-b690441d-168c-4ae0-952d-bea96ed79466 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:43.463553 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3c88c5ac-6c7d-4c32-ae59-fc8573c2e9d7 req-b690441d-168c-4ae0-952d-bea96ed79466 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=eac884a1-b960-4dfb-9337-7c68c9f0acca HTTP/1.1" status: 200 len: 945 time: 0.2731550 Dec 09 21:19:43.484434 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-cb2d823a-5dc1-4102-bbf3-1e98c783e97e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 40468c91-ccde-4d96-b234-0e326a1de103 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:19:43.502941 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-cb2d823a-5dc1-4102-bbf3-1e98c783e97e service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:43.512662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-71bdc359-536f-47bd-bb54-110a4e3ac45a tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:43.513315 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-71bdc359-536f-47bd-bb54-110a4e3ac45a tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:43.523590 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['84ad33bd-6ab4-41c4-91dc-7edb7fd59e12'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:19:43.567575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-cb2d823a-5dc1-4102-bbf3-1e98c783e97e service neutron] Transition to ACTIVE for port object 40468c91-ccde-4d96-b234-0e326a1de103 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:19:43.573709 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3c88c5ac-6c7d-4c32-ae59-fc8573c2e9d7 req-5fe4b802-1f4f-4bc6-bbd9-c20c7e71994e tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0937533 Dec 09 21:19:43.577947 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-71bdc359-536f-47bd-bb54-110a4e3ac45a tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.3086879 Dec 09 21:19:43.583997 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=84ad33bd-6ab4-41c4-91dc-7edb7fd59e12,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:43.592982 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-0404a9de-ff3f-45f0-86bd-6cc13e531ddc service neutron] Request body: {'port': {'device_id': '89bd78b4-a499-4908-8ee4-7b3f64653d0b', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:43.595921 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-cb2d823a-5dc1-4102-bbf3-1e98c783e97e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:43.614133 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-0068054a-b8fc-4414-b374-dff126749e75 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:43.615863 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-0068054a-b8fc-4414-b374-dff126749e75 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.10 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 807 time: 0.4300089 Dec 09 21:19:43.636054 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-6f93d6d6-b484-49a2-82d3-ae0047f897ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Request body: {'port': {'device_id': 'b061c5ff-772f-4909-950e-39d066fb05c2', 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef', 'admin_state_up': True, 'tenant_id': 'ac5b7cefd8cc48cc83f38d3923aae132'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:43.687661 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0f4df662-3031-4e5c-a899-9c7b6641fc50 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:43.730974 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bfca5b5-9d84-4d92-919c-ae78d0626686 req-167c3302-0978-46a5-bf61-b358f7aca2a3 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:43.740561 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5bfca5b5-9d84-4d92-919c-ae78d0626686 req-167c3302-0978-46a5-bf61-b358f7aca2a3 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a8ab99b-8927-4f89-9ef5-773ea7697c2b HTTP/1.1" status: 200 len: 948 time: 0.1717517 Dec 09 21:19:43.762169 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb2d823a-5dc1-4102-bbf3-1e98c783e97e service neutron] Pushing event updated for resources: {'Port': ['ID=40468c91-ccde-4d96-b234-0e326a1de103,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:43.772469 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device bfb54d46-9eb4-4f0f-a20d-de24e82762cc up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:19:43.800149 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5bfca5b5-9d84-4d92-919c-ae78d0626686 req-4e57e490-01e9-4088-99df-5a1ed2e223bb tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/security-groups?id=3564cbaa-b044-4bce-988d-93357d77088a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0582800 Dec 09 21:19:43.808992 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f4df662-3031-4e5c-a899-9c7b6641fc50 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1caf9086-38c1-45a4-b64b-d3475b50f4b1,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:43.854439 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f4df662-3031-4e5c-a899-9c7b6641fc50 admin admin] Checking segment: {'id': 'cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '8d988748-159b-463d-bdf5-500e0ea1b879'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:19:43.854796 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f4df662-3031-4e5c-a899-9c7b6641fc50 admin admin] Network hostable DHCP agents. Network: 8d988748-159b-463d-bdf5-500e0ea1b879, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:19:43.855332 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-0404a9de-ff3f-45f0-86bd-6cc13e531ddc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:43.883363 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-6f93d6d6-b484-49a2-82d3-ae0047f897ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Made reservation on behalf of ac5b7cefd8cc48cc83f38d3923aae132 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:19:43.887572 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-6f93d6d6-b484-49a2-82d3-ae0047f897ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:43.891711 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f4df662-3031-4e5c-a899-9c7b6641fc50 admin admin] Network 8d988748-159b-463d-bdf5-500e0ea1b879 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:19:43.920579 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-0f4df662-3031-4e5c-a899-9c7b6641fc50 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 8d988748-159b-463d-bdf5-500e0ea1b879) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:19:43.927260 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f4df662-3031-4e5c-a899-9c7b6641fc50 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:43.927956 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0f4df662-3031-4e5c-a899-9c7b6641fc50 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:43.928074 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-846158f4-2c87-4b6c-88aa-3874ab4b96c2 None None] Provisioning complete for port 36925110-4ed7-49f6-b07d-d998896a74cc triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:43.928404 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-846158f4-2c87-4b6c-88aa-3874ab4b96c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:43.968912 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a8ab25cf-a8c1-42ed-a98f-0f4cd36b51e2 None None] Network 8d988748-159b-463d-bdf5-500e0ea1b879 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:19:44.023551 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0f4df662-3031-4e5c-a899-9c7b6641fc50 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 1.1525087 Dec 09 21:19:44.026303 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57918) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:44.031933 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-bf4ccdf8-5f57-4ad7-b645-bc24bd7da116 admin admin] Request body: {'router': {'name': 'tempest-AttachSCSIVolumeTestJSON-882207386-router', 'tenant_id': '638a9d4528c04bcc89501243ebdb6eda', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:44.056988 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-6f93d6d6-b484-49a2-82d3-ae0047f897ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Allocated IP 172.20.0.6 (04fa749a-9f72-4a2c-a725-feab917f99ef/eae2438b-9fcc-44ef-a172-6c4911cad13f/6166c639-9f87-4254-af88-12c4be868be5) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:19:44.067153 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:44.106833 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:44.117708 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-cb2d823a-5dc1-4102-bbf3-1e98c783e97e service neutron] Attempting to bind port 40468c91-ccde-4d96-b234-0e326a1de103 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:19:44.118060 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-cb2d823a-5dc1-4102-bbf3-1e98c783e97e service neutron] Attempting to bind port 40468c91-ccde-4d96-b234-0e326a1de103 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:19:44.118393 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-cb2d823a-5dc1-4102-bbf3-1e98c783e97e service neutron] Attempting to bind port 40468c91-ccde-4d96-b234-0e326a1de103 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:44.136874 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c112d78-07ca-4001-9a37-7476f4366698 req-cdccc75a-f97f-4504-a5a8-2d835d1a1678 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:44.138400 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c112d78-07ca-4001-9a37-7476f4366698 req-cdccc75a-f97f-4504-a5a8-2d835d1a1678 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 944 time: 0.1897030 Dec 09 21:19:44.149347 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-846158f4-2c87-4b6c-88aa-3874ab4b96c2 None None] Port 36925110-4ed7-49f6-b07d-d998896a74cc cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:19:44.159766 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-cb2d823a-5dc1-4102-bbf3-1e98c783e97e service neutron] Port 40468c91-ccde-4d96-b234-0e326a1de103 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:19:44.160083 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-cb2d823a-5dc1-4102-bbf3-1e98c783e97e service neutron] Attempting to bind port 40468c91-ccde-4d96-b234-0e326a1de103 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:44.177395 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-248ee7fc-82db-4e5a-a4e0-710205aca1fc None None] Pushing event updated for resources: {'Port': ['ID=012d7306-fba8-43d4-80e6-3acf4ac3f98c,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:44.188724 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf4ccdf8-5f57-4ad7-b645-bc24bd7da116 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:44.188931 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port bfb54d46-9eb4-4f0f-a20d-de24e82762cc triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:44.189114 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:44.190151 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf4ccdf8-5f57-4ad7-b645-bc24bd7da116 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:44.224172 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-cb2d823a-5dc1-4102-bbf3-1e98c783e97e service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 19, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:19:44.224353 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-cb2d823a-5dc1-4102-bbf3-1e98c783e97e service neutron] Checking segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:19:44.224714 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-cb2d823a-5dc1-4102-bbf3-1e98c783e97e service neutron] Bound using segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:19:44.225159 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-cb2d823a-5dc1-4102-bbf3-1e98c783e97e service neutron] Bound port: 40468c91-ccde-4d96-b234-0e326a1de103, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:19:44.225512 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-cb2d823a-5dc1-4102-bbf3-1e98c783e97e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:44.237472 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1cc3b771-7d24-4dfa-bbfe-6e007094c74b no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:19:44.280765 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-6f93d6d6-b484-49a2-82d3-ae0047f897ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:44.329625 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:19:44.332019 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-6f93d6d6-b484-49a2-82d3-ae0047f897ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:44.367022 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1bcc54e6-428d-42a4-b24e-87053a0dd6f2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-8d988748-159b-463d-bdf5-500e0ea1b879', 'network_id': '8d988748-159b-463d-bdf5-500e0ea1b879', 'project_id': '638a9d4528c04bcc89501243ebdb6eda', 'fixed_ips': [{'subnet_id': '1caf9086-38c1-45a4-b64b-d3475b50f4b1'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:19:44.367965 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1bcc54e6-428d-42a4-b24e-87053a0dd6f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:44.390590 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf4ccdf8-5f57-4ad7-b645-bc24bd7da116 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:44.401142 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-6f93d6d6-b484-49a2-82d3-ae0047f897ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Network 04fa749a-9f72-4a2c-a725-feab917f99ef is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:19:44.405532 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba4d8e62-cfa3-4436-ab73-28386af487df req-53608f3f-1a22-41ab-ba25-e85da836203f tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:44.407409 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba4d8e62-cfa3-4436-ab73-28386af487df req-53608f3f-1a22-41ab-ba25-e85da836203f tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 936 time: 0.2681026 Dec 09 21:19:44.418118 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c112d78-07ca-4001-9a37-7476f4366698 req-f70affea-1f70-4c7f-9440-24814ae00882 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2706511 Dec 09 21:19:44.447888 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f93d6d6-b484-49a2-82d3-ae0047f897ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Pushing event updated for resources: {'Port': ['ID=6166c639-9f87-4254-af88-12c4be868be5,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:44.458946 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-6f93d6d6-b484-49a2-82d3-ae0047f897ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:19:44.464198 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-6f93d6d6-b484-49a2-82d3-ae0047f897ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:19:44.545272 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-6f93d6d6-b484-49a2-82d3-ae0047f897ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:44.545962 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-6f93d6d6-b484-49a2-82d3-ae0047f897ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:44.565249 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-6f93d6d6-b484-49a2-82d3-ae0047f897ed tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9347739 Dec 09 21:19:44.578859 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-5fab0fd0-c009-4e48-adf7-9c22207a7d27 service neutron] Request body: {'port': {'device_id': 'b061c5ff-772f-4909-950e-39d066fb05c2', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:44.646117 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-5fab0fd0-c009-4e48-adf7-9c22207a7d27 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:44.676278 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-cb2d823a-5dc1-4102-bbf3-1e98c783e97e service neutron] For port 40468c91-ccde-4d96-b234-0e326a1de103, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:44.682271 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] Attempting to bind port 012d7306-fba8-43d4-80e6-3acf4ac3f98c on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:19:44.682813 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] Attempting to bind port 012d7306-fba8-43d4-80e6-3acf4ac3f98c by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '5c779566-9ab2-470d-8b5d-c18c1d216fd1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '1444d8a7-187f-473b-be08-dce40f6ae8ea'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:19:44.682976 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] Attempting to bind port 012d7306-fba8-43d4-80e6-3acf4ac3f98c on network 1444d8a7-187f-473b-be08-dce40f6ae8ea {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:44.686105 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba4d8e62-cfa3-4436-ab73-28386af487df req-799f6f64-b856-41be-867a-53434e41fe35 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2650483 Dec 09 21:19:44.738784 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-cb2d823a-5dc1-4102-bbf3-1e98c783e97e service neutron] For port 40468c91-ccde-4d96-b234-0e326a1de103, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=40468c91-ccde-4d96-b234-0e326a1de103,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:19:44.778213 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-0404a9de-ff3f-45f0-86bd-6cc13e531ddc service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 36925110-4ed7-49f6-b07d-d998896a74cc {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:19:44.784823 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-cb2d823a-5dc1-4102-bbf3-1e98c783e97e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:44.792260 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf4ccdf8-5f57-4ad7-b645-bc24bd7da116 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:44.812538 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-0404a9de-ff3f-45f0-86bd-6cc13e531ddc service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:44.822511 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 19, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:19:44.822889 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] Checking segment: {'id': '5c779566-9ab2-470d-8b5d-c18c1d216fd1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '1444d8a7-187f-473b-be08-dce40f6ae8ea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:19:44.824560 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:44.824560 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] Bound using segment: {'id': '5c779566-9ab2-470d-8b5d-c18c1d216fd1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '1444d8a7-187f-473b-be08-dce40f6ae8ea'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:19:44.824560 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] Bound port: 012d7306-fba8-43d4-80e6-3acf4ac3f98c, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5c779566-9ab2-470d-8b5d-c18c1d216fd1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '1444d8a7-187f-473b-be08-dce40f6ae8ea'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:19:44.824908 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:44.869347 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-33bfe948-9920-4337-b8bf-ad293712751f None None] Provisioning complete for port 012d7306-fba8-43d4-80e6-3acf4ac3f98c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:44.869765 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-33bfe948-9920-4337-b8bf-ad293712751f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:44.870523 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fee6a05-2280-43e4-9d0a-2939db0a1a6a req-c86c2008-770d-486c-b218-26d3722f233f tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:44.872192 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fee6a05-2280-43e4-9d0a-2939db0a1a6a req-c86c2008-770d-486c-b218-26d3722f233f tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 949 time: 0.3052444 Dec 09 21:19:44.899572 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-cb2d823a-5dc1-4102-bbf3-1e98c783e97e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:44.900220 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-cb2d823a-5dc1-4102-bbf3-1e98c783e97e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:44.902016 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-cb2d823a-5dc1-4102-bbf3-1e98c783e97e service neutron] 10.222.0.10 "PUT /v2.0/ports/40468c91-ccde-4d96-b234-0e326a1de103 HTTP/1.1" status: 200 len: 1093 time: 3.0126426 Dec 09 21:19:44.905364 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '18c57a12-fe06-4b8d-93c7-e3121619fa56', 'tag': '40468c91-ccde-4d96-b234-0e326a1de103'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:44.908190 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8926dd58-f72c-4d1e-9375-4a66dd1dd351" -d '{"events": [{"name": "network-changed", "server_uuid": "18c57a12-fe06-4b8d-93c7-e3121619fa56", "tag": "40468c91-ccde-4d96-b234-0e326a1de103"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:44.922612 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-0404a9de-ff3f-45f0-86bd-6cc13e531ddc service neutron] Transition to ACTIVE for port object 36925110-4ed7-49f6-b07d-d998896a74cc will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:19:44.947593 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-0404a9de-ff3f-45f0-86bd-6cc13e531ddc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:44.977390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb2d823a-5dc1-4102-bbf3-1e98c783e97e service neutron] Pushing event updated for resources: {'Port': ['ID=40468c91-ccde-4d96-b234-0e326a1de103,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:45.008628 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:45.034728 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-5fab0fd0-c009-4e48-adf7-9c22207a7d27 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6166c639-9f87-4254-af88-12c4be868be5 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:19:45.043199 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-5fab0fd0-c009-4e48-adf7-9c22207a7d27 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:45.044773 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aad1c42a-ed61-483f-9358-bc48c4ff7e7a req-b5b5f862-682f-4a60-9311-b7ef12d19533 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:45.046408 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aad1c42a-ed61-483f-9358-bc48c4ff7e7a req-b5b5f862-682f-4a60-9311-b7ef12d19533 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 931 time: 0.2630694 Dec 09 21:19:45.067541 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-5fab0fd0-c009-4e48-adf7-9c22207a7d27 service neutron] Transition to ACTIVE for port object 6166c639-9f87-4254-af88-12c4be868be5 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:19:45.067897 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] For port 012d7306-fba8-43d4-80e6-3acf4ac3f98c, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:45.076149 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-5fab0fd0-c009-4e48-adf7-9c22207a7d27 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:45.085162 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] For port 012d7306-fba8-43d4-80e6-3acf4ac3f98c, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=012d7306-fba8-43d4-80e6-3acf4ac3f98c,segment=NetworkSegment(5c779566-9ab2-470d-8b5d-c18c1d216fd1),segment_id=5c779566-9ab2-470d-8b5d-c18c1d216fd1)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:19:45.091845 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1c5817d2-0469-4f14-9ffd-a7e8649e3bb6,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:45.095934 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-33bfe948-9920-4337-b8bf-ad293712751f None None] Port 012d7306-fba8-43d4-80e6-3acf4ac3f98c cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:19:45.107543 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:45.115352 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: BUILD current_port_status: DOWN port_id 1cc3b771-7d24-4dfa-bbfe-6e007094c74b {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:19:45.132122 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fee6a05-2280-43e4-9d0a-2939db0a1a6a req-86563724-a271-4f16-a73e-b8b97a16d104 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2376454 Dec 09 21:19:45.150036 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '1c5817d2-0469-4f14-9ffd-a7e8649e3bb6', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '1c5817d2-0469-4f14-9ffd-a7e8649e3bb6', 'mac_address': 'fa:16:3e:75:0d:71', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.192'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:19:45.157930 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0404a9de-ff3f-45f0-86bd-6cc13e531ddc service neutron] Pushing event updated for resources: {'Port': ['ID=36925110-4ed7-49f6-b07d-d998896a74cc,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:45.166923 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fab0fd0-c009-4e48-adf7-9c22207a7d27 service neutron] Pushing event updated for resources: {'Port': ['ID=6166c639-9f87-4254-af88-12c4be868be5,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:45.210999 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-3db109d9-b267-4620-bf01-13d97f25711c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:45.212608 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-3db109d9-b267-4620-bf01-13d97f25711c service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 1096 time: 0.2563868 Dec 09 21:19:45.219636 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-1bcc54e6-428d-42a4-b24e-87053a0dd6f2 None None] Allocated IP 172.20.0.2 (8d988748-159b-463d-bdf5-500e0ea1b879/1caf9086-38c1-45a4-b64b-d3475b50f4b1/a16da251-6252-45d6-bcbb-fb07065870ab) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:19:45.266745 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1cc3b771-7d24-4dfa-bbfe-6e007094c74b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:45.283393 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:45.295614 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] Routers {'0d220f39-aeac-4dc5-ac16-e4d907702583'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:19:45.296783 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:19:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['0d220f39-aeac-4dc5-ac16-e4d907702583'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:45.304129 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-248ee7fc-82db-4e5a-a4e0-710205aca1fc None None] Pushing event updated for resources: {'Port': ['ID=012d7306-fba8-43d4-80e6-3acf4ac3f98c,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:45.310874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-5fab0fd0-c009-4e48-adf7-9c22207a7d27 service neutron] Attempting to bind port 6166c639-9f87-4254-af88-12c4be868be5 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:19:45.311273 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-5fab0fd0-c009-4e48-adf7-9c22207a7d27 service neutron] Attempting to bind port 6166c639-9f87-4254-af88-12c4be868be5 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:19:45.311664 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-5fab0fd0-c009-4e48-adf7-9c22207a7d27 service neutron] Attempting to bind port 6166c639-9f87-4254-af88-12c4be868be5 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:45.317037 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-5fab0fd0-c009-4e48-adf7-9c22207a7d27 service neutron] Port 6166c639-9f87-4254-af88-12c4be868be5 on network 04fa749a-9f72-4a2c-a725-feab917f99ef not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:19:45.317367 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-5fab0fd0-c009-4e48-adf7-9c22207a7d27 service neutron] Attempting to bind port 6166c639-9f87-4254-af88-12c4be868be5 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:45.324580 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-5fab0fd0-c009-4e48-adf7-9c22207a7d27 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 19, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:19:45.324915 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-5fab0fd0-c009-4e48-adf7-9c22207a7d27 service neutron] Checking segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:19:45.325298 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-5fab0fd0-c009-4e48-adf7-9c22207a7d27 service neutron] Bound using segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:19:45.325738 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-5fab0fd0-c009-4e48-adf7-9c22207a7d27 service neutron] Bound port: 6166c639-9f87-4254-af88-12c4be868be5, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:19:45.326090 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-5fab0fd0-c009-4e48-adf7-9c22207a7d27 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:45.355825 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aad1c42a-ed61-483f-9358-bc48c4ff7e7a req-abeb4235-66e7-4ad7-8874-cea7d808ed22 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2965889 Dec 09 21:19:45.360697 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-ab9ad874-c083-4ed2-8b59-571cc0cfa9ae service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=40468c91-ccde-4d96-b234-0e326a1de103 HTTP/1.1" status: 200 len: 217 time: 0.1042116 Dec 09 21:19:45.412286 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:45.471622 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-5fab0fd0-c009-4e48-adf7-9c22207a7d27 service neutron] For port 6166c639-9f87-4254-af88-12c4be868be5, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:45.474890 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-5fab0fd0-c009-4e48-adf7-9c22207a7d27 service neutron] For port 6166c639-9f87-4254-af88-12c4be868be5, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=6166c639-9f87-4254-af88-12c4be868be5,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:19:45.484302 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-5fab0fd0-c009-4e48-adf7-9c22207a7d27 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:45.523557 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-5fab0fd0-c009-4e48-adf7-9c22207a7d27 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:45.524255 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-5fab0fd0-c009-4e48-adf7-9c22207a7d27 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:45.525772 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-5fab0fd0-c009-4e48-adf7-9c22207a7d27 service neutron] 10.222.0.10 "PUT /v2.0/ports/6166c639-9f87-4254-af88-12c4be868be5 HTTP/1.1" status: 200 len: 1092 time: 0.9516032 Dec 09 21:19:45.526164 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b061c5ff-772f-4909-950e-39d066fb05c2', 'tag': '6166c639-9f87-4254-af88-12c4be868be5'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:45.529049 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e78993d4-59f3-4436-8082-f677a0886e1c" -d '{"events": [{"name": "network-changed", "server_uuid": "b061c5ff-772f-4909-950e-39d066fb05c2", "tag": "6166c639-9f87-4254-af88-12c4be868be5"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:45.553782 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fab0fd0-c009-4e48-adf7-9c22207a7d27 service neutron] Pushing event updated for resources: {'Port': ['ID=6166c639-9f87-4254-af88-12c4be868be5,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:45.612367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:19:45.624948 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=1cc3b771-7d24-4dfa-bbfe-6e007094c74b,revision_number=9']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:45.637122 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-df4715f1-dcdf-4716-b3ff-d05c5c211019 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:45.639101 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-df4715f1-dcdf-4716-b3ff-d05c5c211019 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 1095 time: 0.0551357 Dec 09 21:19:45.690156 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-6fbc3bf9-e5f2-4363-83bc-255ff3d4a106 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=6166c639-9f87-4254-af88-12c4be868be5 HTTP/1.1" status: 200 len: 217 time: 0.0421124 Dec 09 21:19:45.693370 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] Set router 0d220f39-aeac-4dc5-ac16-e4d907702583 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:19:45.701473 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1c5817d2-0469-4f14-9ffd-a7e8649e3bb6,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:45.729758 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:45.751381 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-3c357b88-8e15-4ef1-be64-11061c5f4b87 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:45.751779 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1bcc54e6-428d-42a4-b24e-87053a0dd6f2 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:45.751876 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-3c357b88-8e15-4ef1-be64-11061c5f4b87 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=eae2438b-9fcc-44ef-a172-6c4911cad13f HTTP/1.1" status: 200 len: 847 time: 0.0534368 Dec 09 21:19:45.787315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-0404a9de-ff3f-45f0-86bd-6cc13e531ddc service neutron] Attempting to bind port 36925110-4ed7-49f6-b07d-d998896a74cc on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:19:45.788054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-0404a9de-ff3f-45f0-86bd-6cc13e531ddc service neutron] Attempting to bind port 36925110-4ed7-49f6-b07d-d998896a74cc by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:19:45.788054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-0404a9de-ff3f-45f0-86bd-6cc13e531ddc service neutron] Attempting to bind port 36925110-4ed7-49f6-b07d-d998896a74cc on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:45.789255 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-c72d575d-6df6-4db1-8cfd-288163b1dc27 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=04fa749a-9f72-4a2c-a725-feab917f99ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0280180 Dec 09 21:19:45.797779 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1bcc54e6-428d-42a4-b24e-87053a0dd6f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:45.822933 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-90c45cb6-3071-49bf-9752-3a2a7eafe9b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:45.822933 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-90c45cb6-3071-49bf-9752-3a2a7eafe9b4 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=c49a62cc-af1b-4958-a4a9-eb44188b8fb9 HTTP/1.1" status: 200 len: 861 time: 0.4483848 Dec 09 21:19:45.822933 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-0404a9de-ff3f-45f0-86bd-6cc13e531ddc service neutron] Port 36925110-4ed7-49f6-b07d-d998896a74cc on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:19:45.822933 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-0404a9de-ff3f-45f0-86bd-6cc13e531ddc service neutron] Attempting to bind port 36925110-4ed7-49f6-b07d-d998896a74cc on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:45.858006 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-faec3e80-fd83-436c-b889-4a7571c635e3 None None] Provisioning complete for port 012d7306-fba8-43d4-80e6-3acf4ac3f98c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:45.858496 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-faec3e80-fd83-436c-b889-4a7571c635e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:45.879853 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-0404a9de-ff3f-45f0-86bd-6cc13e531ddc service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 19, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:19:45.879853 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-0404a9de-ff3f-45f0-86bd-6cc13e531ddc service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:19:45.879853 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-0404a9de-ff3f-45f0-86bd-6cc13e531ddc service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:19:45.879853 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-0404a9de-ff3f-45f0-86bd-6cc13e531ddc service neutron] Bound port: 36925110-4ed7-49f6-b07d-d998896a74cc, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:19:45.879853 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-0404a9de-ff3f-45f0-86bd-6cc13e531ddc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:45.906102 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-6b6ffd0d-0639-4f9f-ab83-6e5cc3130cf5 service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1074562 Dec 09 21:19:45.916803 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1bcc54e6-428d-42a4-b24e-87053a0dd6f2 None None] Network 8d988748-159b-463d-bdf5-500e0ea1b879 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:19:45.924646 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-1bcc54e6-428d-42a4-b24e-87053a0dd6f2 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:19:45.926393 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=1c5817d2-0469-4f14-9ffd-a7e8649e3bb6,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:45.940680 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89f28d04-d4d8-4130-b35b-59025a807cdb req-618ed389-9035-494f-833f-b2f62e9c7299 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:45.942167 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89f28d04-d4d8-4130-b35b-59025a807cdb req-618ed389-9035-494f-833f-b2f62e9c7299 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=eac884a1-b960-4dfb-9337-7c68c9f0acca HTTP/1.1" status: 200 len: 945 time: 0.5584817 Dec 09 21:19:45.944042 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-cafd5197-f9c7-44c5-a7e3-52272c844a66 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=93378dc3-2ac5-4cf7-9ce3-d812934de40c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1139288 Dec 09 21:19:45.958045 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1bcc54e6-428d-42a4-b24e-87053a0dd6f2 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:19:46.014477 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-237a33bb-37a1-4cfb-9073-a3720945ff87 req-8ee49d33-9bce-45f6-84c4-5c51577d2da2 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:46.016220 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-237a33bb-37a1-4cfb-9073-a3720945ff87 req-8ee49d33-9bce-45f6-84c4-5c51577d2da2 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a8ab99b-8927-4f89-9ef5-773ea7697c2b HTTP/1.1" status: 200 len: 949 time: 0.2532134 Dec 09 21:19:46.017015 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b9f70e44-4154-465f-a6f3-c622a7ed470f req-90f68ab6-be66-442a-b4ba-b849eb1e061b service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1043479 Dec 09 21:19:46.028732 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['1c5817d2-0469-4f14-9ffd-a7e8649e3bb6'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:19:46.119201 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bcc54e6-428d-42a4-b24e-87053a0dd6f2 None None] Pushing event updated for resources: {'Port': ['ID=a16da251-6252-45d6-bcbb-fb07065870ab,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:46.155372 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf4ccdf8-5f57-4ad7-b645-bc24bd7da116 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:46.162763 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-1bcc54e6-428d-42a4-b24e-87053a0dd6f2 None None] Attempting to bind port a16da251-6252-45d6-bcbb-fb07065870ab on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:19:46.162944 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-1bcc54e6-428d-42a4-b24e-87053a0dd6f2 None None] Attempting to bind port a16da251-6252-45d6-bcbb-fb07065870ab by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '8d988748-159b-463d-bdf5-500e0ea1b879'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:19:46.163162 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bcc54e6-428d-42a4-b24e-87053a0dd6f2 None None] Attempting to bind port a16da251-6252-45d6-bcbb-fb07065870ab on network 8d988748-159b-463d-bdf5-500e0ea1b879 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:46.189552 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89f28d04-d4d8-4130-b35b-59025a807cdb req-0f1c974b-3ba9-4511-9752-c5e0d39e5339 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2380641 Dec 09 21:19:46.195697 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bcc54e6-428d-42a4-b24e-87053a0dd6f2 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 19, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:19:46.195986 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bcc54e6-428d-42a4-b24e-87053a0dd6f2 None None] Checking segment: {'id': 'cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '8d988748-159b-463d-bdf5-500e0ea1b879'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:19:46.196664 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1bcc54e6-428d-42a4-b24e-87053a0dd6f2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:46.196819 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bcc54e6-428d-42a4-b24e-87053a0dd6f2 None None] Bound using segment: {'id': 'cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '8d988748-159b-463d-bdf5-500e0ea1b879'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:19:46.197640 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-1bcc54e6-428d-42a4-b24e-87053a0dd6f2 None None] Bound port: a16da251-6252-45d6-bcbb-fb07065870ab, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '8d988748-159b-463d-bdf5-500e0ea1b879'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:19:46.197793 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1bcc54e6-428d-42a4-b24e-87053a0dd6f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:46.198546 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf4ccdf8-5f57-4ad7-b645-bc24bd7da116 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:46.224407 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-0404a9de-ff3f-45f0-86bd-6cc13e531ddc service neutron] For port 36925110-4ed7-49f6-b07d-d998896a74cc, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:46.236970 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1cc3b771-7d24-4dfa-bbfe-6e007094c74b up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:19:46.273316 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d578430e-e80e-43db-9760-f8c0b878f8a8 x-openstack-request-id: req-d578430e-e80e-43db-9760-f8c0b878f8a8 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:46.273669 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "18c57a12-fe06-4b8d-93c7-e3121619fa56", "tag": "40468c91-ccde-4d96-b234-0e326a1de103", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:46.273864 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-d578430e-e80e-43db-9760-f8c0b878f8a8 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:46.274267 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '18c57a12-fe06-4b8d-93c7-e3121619fa56', 'tag': '40468c91-ccde-4d96-b234-0e326a1de103', 'status': 'completed', 'code': 200} Dec 09 21:19:46.277015 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-910ecc06-8c54-46b1-948e-498994c38277 service neutron] 10.222.0.10 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3223112 Dec 09 21:19:46.283362 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-faec3e80-fd83-436c-b889-4a7571c635e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:46.285062 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-237a33bb-37a1-4cfb-9073-a3720945ff87 req-2a64fc49-5657-41b7-8cc9-ed23d2d6da9a tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/security-groups?id=3564cbaa-b044-4bce-988d-93357d77088a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2414041 Dec 09 21:19:46.288136 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-0404a9de-ff3f-45f0-86bd-6cc13e531ddc service neutron] For port 36925110-4ed7-49f6-b07d-d998896a74cc, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=36925110-4ed7-49f6-b07d-d998896a74cc,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:19:46.330330 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-0404a9de-ff3f-45f0-86bd-6cc13e531ddc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:46.356937 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e71f90e6-e1e7-4706-b110-7079b22fb75e x-openstack-request-id: req-e71f90e6-e1e7-4706-b110-7079b22fb75e {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:46.357428 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b061c5ff-772f-4909-950e-39d066fb05c2", "tag": "6166c639-9f87-4254-af88-12c4be868be5", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:46.357529 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:19:46.357800 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e71f90e6-e1e7-4706-b110-7079b22fb75e {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:46.358283 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b061c5ff-772f-4909-950e-39d066fb05c2', 'tag': '6166c639-9f87-4254-af88-12c4be868be5', 'status': 'completed', 'code': 200} Dec 09 21:19:46.436080 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e78993d4-59f3-4436-8082-f677a0886e1c req-80259652-ab8e-420c-93a0-4c7dbc112f7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:46.437964 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e78993d4-59f3-4436-8082-f677a0886e1c req-80259652-ab8e-420c-93a0-4c7dbc112f7a service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 1095 time: 0.0438290 Dec 09 21:19:46.445049 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-faec3e80-fd83-436c-b889-4a7571c635e3 None None] For port 012d7306-fba8-43d4-80e6-3acf4ac3f98c, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=012d7306-fba8-43d4-80e6-3acf4ac3f98c,segment=NetworkSegment(5c779566-9ab2-470d-8b5d-c18c1d216fd1),segment_id=5c779566-9ab2-470d-8b5d-c18c1d216fd1)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:46.448183 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-1bcc54e6-428d-42a4-b24e-87053a0dd6f2 None None] For port a16da251-6252-45d6-bcbb-fb07065870ab, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:46.456074 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d220f39-aeac-4dc5-ac16-e4d907702583', 'name': 'tempest-AttachSCSIVolumeTestJSON-1560467054-router', 'tenant_id': '913fcb9b5aab4356999ade167d5148c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.216'}], 'enable_snat': True}, 'gw_port_id': 'bfb54d46-9eb4-4f0f-a20d-de24e82762cc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:19:33Z', 'updated_at': '2021-12-09T21:19:40Z', 'revision_number': 4, 'project_id': '913fcb9b5aab4356999ade167d5148c6', 'gw_port': {'id': 'bfb54d46-9eb4-4f0f-a20d-de24e82762cc', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:42:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d220f39-aeac-4dc5-ac16-e4d907702583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 492, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.216', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:19:35Z', 'updated_at': '2021-12-09T21:19:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '012d7306-fba8-43d4-80e6-3acf4ac3f98c', 'name': '', 'network_id': '1444d8a7-187f-473b-be08-dce40f6ae8ea', 'tenant_id': '913fcb9b5aab4356999ade167d5148c6', 'mac_address': 'fa:16:3e:f3:18:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0d220f39-aeac-4dc5-ac16-e4d907702583', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': 'f2e816c0-e7a2-4010-b2b9-8d7f39c3a318', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:19:38Z', 'updated_at': '2021-12-09T21:19:45Z', 'revision_number': 4, 'project_id': '913fcb9b5aab4356999ade167d5148c6', 'subnets': [{'id': 'f2e816c0-e7a2-4010-b2b9-8d7f39c3a318', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:46.472302 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-faec3e80-fd83-436c-b889-4a7571c635e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:46.509054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-1bcc54e6-428d-42a4-b24e-87053a0dd6f2 None None] For port a16da251-6252-45d6-bcbb-fb07065870ab, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a16da251-6252-45d6-bcbb-fb07065870ab,segment=NetworkSegment(cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9),segment_id=cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:19:46.541654 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a69a74c-1b68-4b21-ba8f-9430e27c9d7f None None] The sync data for ids ['0d220f39-aeac-4dc5-ac16-e4d907702583'] in n-d-713301-27 is: [{'id': '0d220f39-aeac-4dc5-ac16-e4d907702583', 'name': 'tempest-AttachSCSIVolumeTestJSON-1560467054-router', 'tenant_id': '913fcb9b5aab4356999ade167d5148c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.216'}], 'enable_snat': True}, 'gw_port_id': 'bfb54d46-9eb4-4f0f-a20d-de24e82762cc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:19:33Z', 'updated_at': '2021-12-09T21:19:40Z', 'revision_number': 4, 'project_id': '913fcb9b5aab4356999ade167d5148c6', 'gw_port': {'id': 'bfb54d46-9eb4-4f0f-a20d-de24e82762cc', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:42:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d220f39-aeac-4dc5-ac16-e4d907702583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 492, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.216', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:19:35Z', 'updated_at': '2021-12-09T21:19:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '012d7306-fba8-43d4-80e6-3acf4ac3f98c', 'name': '', 'network_id': '1444d8a7-187f-473b-be08-dce40f6ae8ea', 'tenant_id': '913fcb9b5aab4356999ade167d5148c6', 'mac_address': 'fa:16:3e:f3:18:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0d220f39-aeac-4dc5-ac16-e4d907702583', 'device_owner': 'network:router_interface', 'standard_attr_id': 499, 'fixed_ips': [{'subnet_id': 'f2e816c0-e7a2-4010-b2b9-8d7f39c3a318', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:19:38Z', 'updated_at': '2021-12-09T21:19:45Z', 'revision_number': 4, 'project_id': '913fcb9b5aab4356999ade167d5148c6', 'subnets': [{'id': 'f2e816c0-e7a2-4010-b2b9-8d7f39c3a318', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:19:46.542433 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a1ccf833-40c9-4613-8324-720ceb2f7352 req-f02337d8-a8f6-4a48-9cef-a85ede3bfcc2 service neutron] 10.222.0.10 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2560117 Dec 09 21:19:46.554320 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1bcc54e6-428d-42a4-b24e-87053a0dd6f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:46.561315 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e78993d4-59f3-4436-8082-f677a0886e1c req-458a15ef-ba99-488b-92ce-5b1297f30948 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:46.562749 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:46.563125 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:46.570095 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e78993d4-59f3-4436-8082-f677a0886e1c req-458a15ef-ba99-488b-92ce-5b1297f30948 service neutron] 10.222.0.10 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 908 time: 0.1169012 Dec 09 21:19:46.646498 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e78993d4-59f3-4436-8082-f677a0886e1c req-c0e211db-df0e-4ad8-b9a5-49fae09cfb47 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=6166c639-9f87-4254-af88-12c4be868be5 HTTP/1.1" status: 200 len: 217 time: 0.0681543 Dec 09 21:19:46.670997 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-0404a9de-ff3f-45f0-86bd-6cc13e531ddc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:46.672431 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-0404a9de-ff3f-45f0-86bd-6cc13e531ddc service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:46.674154 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-0404a9de-ff3f-45f0-86bd-6cc13e531ddc service neutron] 10.222.0.31 "PUT /v2.0/ports/36925110-4ed7-49f6-b07d-d998896a74cc HTTP/1.1" status: 200 len: 1097 time: 3.0878503 Dec 09 21:19:46.688593 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:19:46.734033 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faec3e80-fd83-436c-b889-4a7571c635e3 None None] Pushing event updated for resources: {'Port': ['ID=012d7306-fba8-43d4-80e6-3acf4ac3f98c,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:46.736708 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e78993d4-59f3-4436-8082-f677a0886e1c req-dee08762-d57c-41d2-9b50-f60cdc115b03 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:46.740179 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e78993d4-59f3-4436-8082-f677a0886e1c req-dee08762-d57c-41d2-9b50-f60cdc115b03 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=eae2438b-9fcc-44ef-a172-6c4911cad13f HTTP/1.1" status: 200 len: 847 time: 0.0857933 Dec 09 21:19:46.769015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-bf4ccdf8-5f57-4ad7-b645-bc24bd7da116 admin admin] Allocated IP 172.25.3.46 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:19:46.802389 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e78993d4-59f3-4436-8082-f677a0886e1c req-25ea4b1c-4bc1-4bd7-82e4-8851fec25a67 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=04fa749a-9f72-4a2c-a725-feab917f99ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0530260 Dec 09 21:19:46.943178 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:46.943574 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:46.973621 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf4ccdf8-5f57-4ad7-b645-bc24bd7da116 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:46.998393 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e78993d4-59f3-4436-8082-f677a0886e1c req-469abb44-8921-49b3-92be-c2aa7f26d7c0 service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1815245 Dec 09 21:19:47.060806 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bcc54e6-428d-42a4-b24e-87053a0dd6f2 None None] Pushing event updated for resources: {'Port': ['ID=a16da251-6252-45d6-bcbb-fb07065870ab,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:47.090627 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf4ccdf8-5f57-4ad7-b645-bc24bd7da116 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:47.104662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cd37d7c-2a8d-416e-a095-a79aa9be6e61 req-b0fd0d69-f83b-45fa-b74c-698468ad1807 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:47.106537 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1cd37d7c-2a8d-416e-a095-a79aa9be6e61 req-b0fd0d69-f83b-45fa-b74c-698468ad1807 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 944 time: 0.8057253 Dec 09 21:19:47.110279 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:47.124160 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0404a9de-ff3f-45f0-86bd-6cc13e531ddc service neutron] Pushing event updated for resources: {'Port': ['ID=36925110-4ed7-49f6-b07d-d998896a74cc,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:47.175095 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '51e11d39-964b-458f-b5dc-fb020eb2c5f5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1cc3b771-7d24-4dfa-bbfe-6e007094c74b'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:47.182304 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4af04c70-04ae-4701-9332-a8064973f00b" -d '{"events": [{"server_uuid": "51e11d39-964b-458f-b5dc-fb020eb2c5f5", "name": "network-vif-plugged", "status": "completed", "tag": "1cc3b771-7d24-4dfa-bbfe-6e007094c74b"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:47.189011 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e78993d4-59f3-4436-8082-f677a0886e1c req-6c8ff289-3a7a-484c-a250-9d2324945590 service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1780558 Dec 09 21:19:47.206170 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:47.209454 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1cc3b771-7d24-4dfa-bbfe-6e007094c74b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:47.212124 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-431e82ab-cc6e-4ee7-b359-04da4c9f2bf7 req-ebab31f1-fd33-4714-9068-89906f2a62cc tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:47.216115 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-431e82ab-cc6e-4ee7-b359-04da4c9f2bf7 req-ebab31f1-fd33-4714-9068-89906f2a62cc tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 948 time: 0.6983848 Dec 09 21:19:47.221352 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:47.276384 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-b2f650dd-026e-4b81-974b-cc020e890784 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:47.278268 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-b2f650dd-026e-4b81-974b-cc020e890784 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 1100 time: 0.2397413 Dec 09 21:19:47.281446 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=84ad33bd-6ab4-41c4-91dc-7edb7fd59e12,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:47.282968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf4ccdf8-5f57-4ad7-b645-bc24bd7da116 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:19:47.292916 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:47.293086 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8926dd58-f72c-4d1e-9375-4a66dd1dd351 req-a1bda7a1-c64f-4954-b72c-3b8a050f97f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:47.294724 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8926dd58-f72c-4d1e-9375-4a66dd1dd351 req-a1bda7a1-c64f-4954-b72c-3b8a050f97f7 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 1096 time: 0.6143577 Dec 09 21:19:47.298752 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=1cc3b771-7d24-4dfa-bbfe-6e007094c74b,revision_number=10']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:47.342738 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-bf4ccdf8-5f57-4ad7-b645-bc24bd7da116 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:19:47.357431 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-6788785f-63cc-46d7-8323-a8b17b4f7051 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.140&port_id=36925110-4ed7-49f6-b07d-d998896a74cc HTTP/1.1" status: 200 len: 217 time: 0.0699737 Dec 09 21:19:47.360336 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=84ad33bd-6ab4-41c4-91dc-7edb7fd59e12,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:47.362089 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf4ccdf8-5f57-4ad7-b645-bc24bd7da116 admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:19:47.381033 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf4ccdf8-5f57-4ad7-b645-bc24bd7da116 admin admin] Pushing event updated for resources: {'Port': ['ID=f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:47.468572 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-431e82ab-cc6e-4ee7-b359-04da4c9f2bf7 req-63eb655a-9ef4-4d71-881c-6c028237f100 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2394283 Dec 09 21:19:47.496272 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1cd37d7c-2a8d-416e-a095-a79aa9be6e61 req-71a8870b-9b55-4c69-b616-05ae91f0886b tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3731241 Dec 09 21:19:47.596815 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-287bf406-d0d5-4beb-ad04-99679da01a09 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:47.598433 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-287bf406-d0d5-4beb-ad04-99679da01a09 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.2259972 Dec 09 21:19:47.720195 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8926dd58-f72c-4d1e-9375-4a66dd1dd351 req-37c81b49-916f-4e06-884c-53ca78b12535 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:47.721633 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8926dd58-f72c-4d1e-9375-4a66dd1dd351 req-37c81b49-916f-4e06-884c-53ca78b12535 service neutron] 10.222.0.10 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 922 time: 0.3743708 Dec 09 21:19:47.817348 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a16da251-6252-45d6-bcbb-fb07065870ab up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:19:47.836041 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8926dd58-f72c-4d1e-9375-4a66dd1dd351 req-af20e134-53f3-4a28-8487-075e29dab293 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=40468c91-ccde-4d96-b234-0e326a1de103 HTTP/1.1" status: 200 len: 217 time: 0.0777185 Dec 09 21:19:47.891914 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port a16da251-6252-45d6-bcbb-fb07065870ab triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:47.892425 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:47.926972 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-716f5bd9-a464-4b50-8bf6-98e989300973 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:47.928533 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-716f5bd9-a464-4b50-8bf6-98e989300973 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.2892606 Dec 09 21:19:47.977034 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:47.983504 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60b6d145-9d9c-4ada-b48b-235c193e1ed8 req-c2d93f4a-1b6b-42ee-99f8-2c2d8a0cc6db tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:47.991259 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60b6d145-9d9c-4ada-b48b-235c193e1ed8 req-c2d93f4a-1b6b-42ee-99f8-2c2d8a0cc6db tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 951 time: 0.4439335 Dec 09 21:19:48.006043 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa6685d0-b577-40c6-8c9e-3177027bf526 req-3a4a4307-1d52-4bc1-a8f4-3c44d388de7b tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:48.007615 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aa6685d0-b577-40c6-8c9e-3177027bf526 req-3a4a4307-1d52-4bc1-a8f4-3c44d388de7b tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 943 time: 0.2850766 Dec 09 21:19:48.012866 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port a16da251-6252-45d6-bcbb-fb07065870ab, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a16da251-6252-45d6-bcbb-fb07065870ab,segment=NetworkSegment(cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9),segment_id=cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:48.018473 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:48.019622 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 012d7306-fba8-43d4-80e6-3acf4ac3f98c up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:19:48.025279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-63b972d3-adf6-40a0-ae1d-26d921a5a64d None None] Network 8d988748-159b-463d-bdf5-500e0ea1b879 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:19:48.059001 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8926dd58-f72c-4d1e-9375-4a66dd1dd351 req-58294a56-490e-4cd5-a00c-f71e9917ebad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:48.060795 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8926dd58-f72c-4d1e-9375-4a66dd1dd351 req-58294a56-490e-4cd5-a00c-f71e9917ebad service neutron] 10.222.0.10 "GET /v2.0/subnets?id=c49a62cc-af1b-4958-a4a9-eb44188b8fb9 HTTP/1.1" status: 200 len: 861 time: 0.2147155 Dec 09 21:19:48.183838 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-bce1423b-1f0b-4971-a658-44e227cd427b None None] Provisioning complete for port a16da251-6252-45d6-bcbb-fb07065870ab triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:48.184216 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bce1423b-1f0b-4971-a658-44e227cd427b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:48.187660 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=a16da251-6252-45d6-bcbb-fb07065870ab,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:48.248674 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 6166c639-9f87-4254-af88-12c4be868be5 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:19:48.260527 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 012d7306-fba8-43d4-80e6-3acf4ac3f98c triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:48.260873 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:48.349402 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:19:48.453891 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '89bd78b4-a499-4908-8ee4-7b3f64653d0b', 'tag': '36925110-4ed7-49f6-b07d-d998896a74cc'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:48.456419 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4035cc2d-36dd-4c1e-9787-57e0a7281eaa" -d '{"events": [{"name": "network-changed", "server_uuid": "89bd78b4-a499-4908-8ee4-7b3f64653d0b", "tag": "36925110-4ed7-49f6-b07d-d998896a74cc"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:48.497086 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8926dd58-f72c-4d1e-9375-4a66dd1dd351 req-3d014e12-9bbd-4a71-b48b-947cb2226ba2 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=93378dc3-2ac5-4cf7-9ce3-d812934de40c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.4203126 Dec 09 21:19:48.527030 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60b6d145-9d9c-4ada-b48b-235c193e1ed8 req-add14b85-a587-42b1-b856-4239c4cdf72d tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5343528 Dec 09 21:19:48.535282 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 6166c639-9f87-4254-af88-12c4be868be5, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=6166c639-9f87-4254-af88-12c4be868be5,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:48.555056 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '6166c639-9f87-4254-af88-12c4be868be5', 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef', 'port_id': '6166c639-9f87-4254-af88-12c4be868be5', 'mac_address': 'fa:16:3e:aa:78:b3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 138, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'eae2438b-9fcc-44ef-a172-6c4911cad13f', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:19:48.563072 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:19:48.567918 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aa6685d0-b577-40c6-8c9e-3177027bf526 req-3f16bfc3-0b04-48d3-8b66-442588c2e871 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5392532 Dec 09 21:19:48.568891 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf4ccdf8-5f57-4ad7-b645-bc24bd7da116 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:48.609865 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:48.610252 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:48.615525 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b56b96e1-5de9-4cbe-9ffe-5be73543f19c x-openstack-request-id: req-b56b96e1-5de9-4cbe-9ffe-5be73543f19c {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:48.615859 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "51e11d39-964b-458f-b5dc-fb020eb2c5f5", "name": "network-vif-plugged", "status": "completed", "tag": "1cc3b771-7d24-4dfa-bbfe-6e007094c74b", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:48.616120 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-b56b96e1-5de9-4cbe-9ffe-5be73543f19c {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:48.616634 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '51e11d39-964b-458f-b5dc-fb020eb2c5f5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1cc3b771-7d24-4dfa-bbfe-6e007094c74b', 'code': 200} Dec 09 21:19:48.693284 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-25fba9b1-666d-4b2a-bc15-031126e29a2e service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7282586 Dec 09 21:19:48.696244 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:48.721466 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-07ae7cbf-48bf-4ffc-bb08-713d67a9d76b None None] Provisioning complete for port a16da251-6252-45d6-bcbb-fb07065870ab triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:48.721940 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-07ae7cbf-48bf-4ffc-bb08-713d67a9d76b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:48.726866 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6166c639-9f87-4254-af88-12c4be868be5 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:19:48.791502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 6166c639-9f87-4254-af88-12c4be868be5, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=6166c639-9f87-4254-af88-12c4be868be5,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:48.800361 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:48.886781 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8926dd58-f72c-4d1e-9375-4a66dd1dd351 req-da9f8871-b580-4bab-8f8a-42261ffc0736 service neutron] 10.222.0.10 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3803854 Dec 09 21:19:48.924803 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fed7d16-d4dc-403a-85c5-8876597cd50d req-3fa2a9e8-02f8-4509-8afd-587c562ae142 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:48.925823 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:48.927637 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6fed7d16-d4dc-403a-85c5-8876597cd50d req-3fa2a9e8-02f8-4509-8afd-587c562ae142 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 1103 time: 0.0610127 Dec 09 21:19:48.943404 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=6166c639-9f87-4254-af88-12c4be868be5,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:48.966415 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-230632bb-8201-401c-8237-e44b29f23c60 req-0a10d8db-afe2-4846-a32d-cf496fabd705 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:48.968023 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-230632bb-8201-401c-8237-e44b29f23c60 req-0a10d8db-afe2-4846-a32d-cf496fabd705 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a8ab99b-8927-4f89-9ef5-773ea7697c2b HTTP/1.1" status: 200 len: 949 time: 0.2536607 Dec 09 21:19:48.994010 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1c5817d2-0469-4f14-9ffd-a7e8649e3bb6,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:49.000828 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:49.009946 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6fed7d16-d4dc-403a-85c5-8876597cd50d req-44ba558b-2585-4e56-b9ad-3b9a9227db17 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0730715 Dec 09 21:19:49.053890 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['6166c639-9f87-4254-af88-12c4be868be5'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:19:49.082647 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f424b65-af07-4206-8334-2da56e7a0af2 req-b19b5dd7-5058-48c4-9831-a47992716cfa tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:49.084896 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f424b65-af07-4206-8334-2da56e7a0af2 req-b19b5dd7-5058-48c4-9831-a47992716cfa tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=eac884a1-b960-4dfb-9337-7c68c9f0acca HTTP/1.1" status: 200 len: 946 time: 0.2990475 Dec 09 21:19:49.090085 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=1c5817d2-0469-4f14-9ffd-a7e8649e3bb6,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:49.111924 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd87ae8d-7909-4c96-9356-43aebc7af891 req-9d35958a-abcd-4424-95b8-66e284e7e0c3 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4074566 Dec 09 21:19:49.184687 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8926dd58-f72c-4d1e-9375-4a66dd1dd351 req-547ad162-189e-4fe9-b5b0-4e985741c1d8 service neutron] 10.222.0.10 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2841790 Dec 09 21:19:49.218681 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-230632bb-8201-401c-8237-e44b29f23c60 req-ed72e477-866b-4e85-80db-787988750e48 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/security-groups?id=3564cbaa-b044-4bce-988d-93357d77088a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1838906 Dec 09 21:19:49.233357 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf4ccdf8-5f57-4ad7-b645-bc24bd7da116 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:49.241678 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f424b65-af07-4206-8334-2da56e7a0af2 req-ae1f1af8-6dd9-4d9c-91a0-c66ab687bc58 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1490345 Dec 09 21:19:49.302717 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ea1a575c-d65a-4806-8d3d-a47178fbfc01 x-openstack-request-id: req-ea1a575c-d65a-4806-8d3d-a47178fbfc01 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:49.303155 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "89bd78b4-a499-4908-8ee4-7b3f64653d0b", "tag": "36925110-4ed7-49f6-b07d-d998896a74cc", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:49.303583 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-ea1a575c-d65a-4806-8d3d-a47178fbfc01 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:49.304294 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '89bd78b4-a499-4908-8ee4-7b3f64653d0b', 'tag': '36925110-4ed7-49f6-b07d-d998896a74cc', 'status': 'completed', 'code': 200} Dec 09 21:19:49.485474 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2126b63a-717e-4305-92d2-41dfe1a538de req-6cf455f6-1788-4704-a76f-23295fa6d5dc tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:49.487001 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2126b63a-717e-4305-92d2-41dfe1a538de req-6cf455f6-1788-4704-a76f-23295fa6d5dc tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 946 time: 0.1973917 Dec 09 21:19:49.513558 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4035cc2d-36dd-4c1e-9787-57e0a7281eaa req-4fbf7fe2-86f7-4844-9eef-f83df5453661 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:49.515269 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4035cc2d-36dd-4c1e-9787-57e0a7281eaa req-4fbf7fe2-86f7-4844-9eef-f83df5453661 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 1100 time: 0.1867764 Dec 09 21:19:49.556666 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be97be07-2847-4c98-afa9-5be0d7523f3d req-a47bf944-699c-43e0-9e85-477c594ea774 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:49.558023 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-be97be07-2847-4c98-afa9-5be0d7523f3d req-a47bf944-699c-43e0-9e85-477c594ea774 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 948 time: 0.2028434 Dec 09 21:19:49.664314 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a16da251-6252-45d6-bcbb-fb07065870ab up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:19:49.676672 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2126b63a-717e-4305-92d2-41dfe1a538de req-f30ca542-2bb6-46cb-82c9-25831d37c511 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1804361 Dec 09 21:19:49.680593 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bf4ccdf8-5f57-4ad7-b645-bc24bd7da116 admin admin] Router aa2e8458-6c79-4f94-bedc-deca697e49ed is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:19:49.726525 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port a16da251-6252-45d6-bcbb-fb07065870ab triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:49.727115 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:49.733236 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-be97be07-2847-4c98-afa9-5be0d7523f3d req-1283e815-13c3-43f9-b0b0-b1c4e1b05dc0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1608243 Dec 09 21:19:49.734683 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4035cc2d-36dd-4c1e-9787-57e0a7281eaa req-ac25746d-b5e1-48e0-a861-8faef3c8371a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:49.736191 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4035cc2d-36dd-4c1e-9787-57e0a7281eaa req-ac25746d-b5e1-48e0-a861-8faef3c8371a service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.2028880 Dec 09 21:19:49.835228 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4035cc2d-36dd-4c1e-9787-57e0a7281eaa req-02bb8b62-37c3-44c1-a9e8-005398cccc53 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.140&port_id=36925110-4ed7-49f6-b07d-d998896a74cc HTTP/1.1" status: 200 len: 217 time: 0.0904202 Dec 09 21:19:49.982333 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4035cc2d-36dd-4c1e-9787-57e0a7281eaa req-133ac4ed-a907-4c7c-9f88-4c466d827ca4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:49.983850 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4035cc2d-36dd-4c1e-9787-57e0a7281eaa req-133ac4ed-a907-4c7c-9f88-4c466d827ca4 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1289790 Dec 09 21:19:50.015599 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fe8409b-5025-4c80-89e7-f05e6002b017 req-6f009032-c715-4bb9-be38-2366a402410b tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:50.017092 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fe8409b-5025-4c80-89e7-f05e6002b017 req-6f009032-c715-4bb9-be38-2366a402410b tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 951 time: 0.1874976 Dec 09 21:19:50.038645 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f005dd61-c361-4827-8daa-56dabadbd8b2 req-2dc23bdd-b69f-46f1-86eb-8c4d4fd1705e tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:50.040138 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f005dd61-c361-4827-8daa-56dabadbd8b2 req-2dc23bdd-b69f-46f1-86eb-8c4d4fd1705e tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 944 time: 0.2091284 Dec 09 21:19:50.042629 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bf4ccdf8-5f57-4ad7-b645-bc24bd7da116 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:19:50.052778 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] Sync routers for ids ['aa2e8458-6c79-4f94-bedc-deca697e49ed'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:19:50.066441 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] Routers {'aa2e8458-6c79-4f94-bedc-deca697e49ed'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:19:50.067093 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:19:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['aa2e8458-6c79-4f94-bedc-deca697e49ed'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:50.103742 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf4ccdf8-5f57-4ad7-b645-bc24bd7da116 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:50.107699 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bf4ccdf8-5f57-4ad7-b645-bc24bd7da116 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 6.0800231 Dec 09 21:19:50.108116 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57968) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:19:50.120637 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4035cc2d-36dd-4c1e-9787-57e0a7281eaa req-2a429cb1-f183-4250-b3a8-272e784b572d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:50.122126 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4035cc2d-36dd-4c1e-9787-57e0a7281eaa req-2a429cb1-f183-4250-b3a8-272e784b572d service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1275423 Dec 09 21:19:50.171049 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fe8409b-5025-4c80-89e7-f05e6002b017 req-43df4e5d-f3ee-448f-8dfb-50ced421e0df tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1294732 Dec 09 21:19:50.190086 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f005dd61-c361-4827-8daa-56dabadbd8b2 req-6c682b0a-16da-4c29-9844-bff940e15bd5 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1353703 Dec 09 21:19:50.199240 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] Set router aa2e8458-6c79-4f94-bedc-deca697e49ed gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:19:50.256806 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 40468c91-ccde-4d96-b234-0e326a1de103 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:19:50.259807 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 6166c639-9f87-4254-af88-12c4be868be5 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:19:50.293382 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4035cc2d-36dd-4c1e-9787-57e0a7281eaa req-4e031a9e-7bc9-4435-ac45-2481071274d7 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1567097 Dec 09 21:19:50.399118 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'aa2e8458-6c79-4f94-bedc-deca697e49ed', 'name': 'tempest-AttachSCSIVolumeTestJSON-882207386-router', 'tenant_id': '638a9d4528c04bcc89501243ebdb6eda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.46'}], 'enable_snat': True}, 'gw_port_id': 'f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:19:44Z', 'updated_at': '2021-12-09T21:19:47Z', 'revision_number': 3, 'project_id': '638a9d4528c04bcc89501243ebdb6eda', 'gw_port': {'id': 'f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:33:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aa2e8458-6c79-4f94-bedc-deca697e49ed', 'device_owner': 'network:router_gateway', 'standard_attr_id': 513, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:19:46Z', 'updated_at': '2021-12-09T21:19:46Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:50.422626 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 6166c639-9f87-4254-af88-12c4be868be5 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:19:50.431038 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 6166c639-9f87-4254-af88-12c4be868be5 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:50.431827 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:50.431943 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] Checking router: aa2e8458-6c79-4f94-bedc-deca697e49ed for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:19:50.432228 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] Updating router aa2e8458-6c79-4f94-bedc-deca697e49ed port f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:19:50.445677 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c22dd92d-6b04-401d-b4ff-485aa0844a55 req-5df66fce-9006-4a9d-87e8-d48ccb941385 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:50.453488 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c22dd92d-6b04-401d-b4ff-485aa0844a55 req-5df66fce-9006-4a9d-87e8-d48ccb941385 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 944 time: 0.1672220 Dec 09 21:19:50.459912 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:50.472657 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af7a3716-26c0-4f8e-916d-2723da0040a9 req-5f9a89eb-321d-473d-bfd0-80eaa64d6833 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:50.480451 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af7a3716-26c0-4f8e-916d-2723da0040a9 req-5f9a89eb-321d-473d-bfd0-80eaa64d6833 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a8ab99b-8927-4f89-9ef5-773ea7697c2b HTTP/1.1" status: 200 len: 950 time: 0.1703186 Dec 09 21:19:50.534881 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4035cc2d-36dd-4c1e-9787-57e0a7281eaa req-e5506a46-f492-4adf-8929-4053223480ed service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2238123 Dec 09 21:19:50.583025 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c22dd92d-6b04-401d-b4ff-485aa0844a55 req-f52b30e8-67ef-4e3b-ba13-e310163164e9 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1285443 Dec 09 21:19:50.604298 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af7a3716-26c0-4f8e-916d-2723da0040a9 req-77f8dbe9-4151-4d0f-bfe2-45f28fc64cc6 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/security-groups?id=3564cbaa-b044-4bce-988d-93357d77088a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1229300 Dec 09 21:19:50.648522 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'eac884a1-b960-4dfb-9337-7c68c9f0acca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '84ad33bd-6ab4-41c4-91dc-7edb7fd59e12'}, {'server_uuid': '1a8ab99b-8927-4f89-9ef5-773ea7697c2b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1c5817d2-0469-4f14-9ffd-a7e8649e3bb6'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:50.652473 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a18d89de-f80a-474a-8b1c-86a27f78e05e" -d '{"events": [{"server_uuid": "eac884a1-b960-4dfb-9337-7c68c9f0acca", "name": "network-vif-plugged", "status": "completed", "tag": "84ad33bd-6ab4-41c4-91dc-7edb7fd59e12"}, {"server_uuid": "1a8ab99b-8927-4f89-9ef5-773ea7697c2b", "name": "network-vif-plugged", "status": "completed", "tag": "1c5817d2-0469-4f14-9ffd-a7e8649e3bb6"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:50.681846 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 40468c91-ccde-4d96-b234-0e326a1de103, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=40468c91-ccde-4d96-b234-0e326a1de103,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:50.715619 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '40468c91-ccde-4d96-b234-0e326a1de103', 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c', 'port_id': '40468c91-ccde-4d96-b234-0e326a1de103', 'mac_address': 'fa:16:3e:70:52:15', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 100, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c49a62cc-af1b-4958-a4a9-eb44188b8fb9', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:19:50.721128 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2e90cb2-8d8d-484a-aae7-a098a5583ab2 req-ca900d59-2d40-4620-b699-f54ab6087b16 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:50.731246 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2e90cb2-8d8d-484a-aae7-a098a5583ab2 req-ca900d59-2d40-4620-b699-f54ab6087b16 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=eac884a1-b960-4dfb-9337-7c68c9f0acca HTTP/1.1" status: 200 len: 946 time: 0.0671232 Dec 09 21:19:50.782609 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:50.786203 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2e90cb2-8d8d-484a-aae7-a098a5583ab2 req-3d673494-8b71-4cbb-8b32-13491b959367 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0539520 Dec 09 21:19:50.798858 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:50.803656 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:50.842264 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] Attempting to bind port f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:19:50.842634 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] Attempting to bind port f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:19:50.845632 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] Attempting to bind port f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:50.855057 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:50.873055 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 19, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:19:50.873464 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:19:50.874501 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:50.875870 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:19:50.876529 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] Bound port: f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:19:50.876970 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:50.882973 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b0588205-f299-4d05-b256-fb313f3361ab admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:50.893790 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 40468c91-ccde-4d96-b234-0e326a1de103 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:19:50.924433 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0550518e-eda1-44c8-b1c8-75b50d9fa494 None None] Pushing event updated for resources: {'Port': ['ID=f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:50.948041 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 40468c91-ccde-4d96-b234-0e326a1de103, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=40468c91-ccde-4d96-b234-0e326a1de103,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:50.952486 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aa9aa636-9b21-4d1c-90f5-0b87c94b526e x-openstack-request-id: req-aa9aa636-9b21-4d1c-90f5-0b87c94b526e {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:50.952860 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "eac884a1-b960-4dfb-9337-7c68c9f0acca", "name": "network-vif-plugged", "status": "completed", "tag": "84ad33bd-6ab4-41c4-91dc-7edb7fd59e12", "code": 200}, {"server_uuid": "1a8ab99b-8927-4f89-9ef5-773ea7697c2b", "name": "network-vif-plugged", "status": "completed", "tag": "1c5817d2-0469-4f14-9ffd-a7e8649e3bb6", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:50.953120 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] For port f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:50.953433 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-aa9aa636-9b21-4d1c-90f5-0b87c94b526e {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:50.953850 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'eac884a1-b960-4dfb-9337-7c68c9f0acca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '84ad33bd-6ab4-41c4-91dc-7edb7fd59e12', 'code': 200} Dec 09 21:19:50.954929 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1a8ab99b-8927-4f89-9ef5-773ea7697c2b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1c5817d2-0469-4f14-9ffd-a7e8649e3bb6', 'code': 200} Dec 09 21:19:50.957587 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 6166c639-9f87-4254-af88-12c4be868be5, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=6166c639-9f87-4254-af88-12c4be868be5,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:50.957741 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] For port f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:19:50.958659 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:50.967903 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:51.033410 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:51.034904 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0550518e-eda1-44c8-b1c8-75b50d9fa494 None None] Pushing event updated for resources: {'Port': ['ID=f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:51.066152 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] Routers {'aa2e8458-6c79-4f94-bedc-deca697e49ed'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:19:51.067297 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:19:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['aa2e8458-6c79-4f94-bedc-deca697e49ed'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:51.094269 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=40468c91-ccde-4d96-b234-0e326a1de103,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:51.161481 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64edbe10-84ca-4081-b770-bfe64e08ffa2 req-94025d47-c1ab-4f11-81b0-6d4605e0cbd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:51.162956 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-64edbe10-84ca-4081-b770-bfe64e08ffa2 req-94025d47-c1ab-4f11-81b0-6d4605e0cbd4 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=eac884a1-b960-4dfb-9337-7c68c9f0acca HTTP/1.1" status: 200 len: 1098 time: 0.1257961 Dec 09 21:19:51.168787 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=6166c639-9f87-4254-af88-12c4be868be5,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:51.171665 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a34f6d50-11c1-44f7-8ffa-0a2e6dda253f req-fd0d4848-fa71-43bd-b43a-7947ee1765bc tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:51.179968 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a34f6d50-11c1-44f7-8ffa-0a2e6dda253f req-fd0d4848-fa71-43bd-b43a-7947ee1765bc tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 948 time: 0.1829939 Dec 09 21:19:51.189645 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f9f4f51-1ce1-4f85-85ca-3a0cfec4524a req-9ea1ecf4-8091-4295-8be6-72640c3f0a8b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:51.191640 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f9f4f51-1ce1-4f85-85ca-3a0cfec4524a req-9ea1ecf4-8091-4295-8be6-72640c3f0a8b service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=1a8ab99b-8927-4f89-9ef5-773ea7697c2b HTTP/1.1" status: 200 len: 1102 time: 0.1613638 Dec 09 21:19:51.200887 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-b0588205-f299-4d05-b256-fb313f3361ab admin admin] Allocated IP 172.20.0.1 (8d988748-159b-463d-bdf5-500e0ea1b879/1caf9086-38c1-45a4-b64b-d3475b50f4b1/71a637ea-1689-4659-a9f6-a49f876ed699) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:19:51.233325 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] Set router aa2e8458-6c79-4f94-bedc-deca697e49ed gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:19:51.242972 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-64edbe10-84ca-4081-b770-bfe64e08ffa2 req-2e8e2a52-7a5f-4a85-8b4d-5b7c4fa19461 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0721896 Dec 09 21:19:51.244484 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['40468c91-ccde-4d96-b234-0e326a1de103'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:19:51.285994 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-9c65df13-cde9-4a26-88e4-33faebb1c137 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-securitygroup--469611586&fields=id&tenant_id=615039519ef147c78eb38a1d65eac061 HTTP/1.1" status: 200 len: 267 time: 0.1741250 Dec 09 21:19:51.308065 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a34f6d50-11c1-44f7-8ffa-0a2e6dda253f req-5f186b12-8a47-4dc2-b29e-48a1d090213c tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1135364 Dec 09 21:19:51.350089 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b0588205-f299-4d05-b256-fb313f3361ab admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:51.358072 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f9f4f51-1ce1-4f85-85ca-3a0cfec4524a req-62abd9a6-3dd6-4759-ad39-75a2dded669b service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=3564cbaa-b044-4bce-988d-93357d77088a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1533563 Dec 09 21:19:51.415037 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b0588205-f299-4d05-b256-fb313f3361ab admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:51.448558 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'aa2e8458-6c79-4f94-bedc-deca697e49ed', 'name': 'tempest-AttachSCSIVolumeTestJSON-882207386-router', 'tenant_id': '638a9d4528c04bcc89501243ebdb6eda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.46'}], 'enable_snat': True}, 'gw_port_id': 'f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:19:44Z', 'updated_at': '2021-12-09T21:19:47Z', 'revision_number': 3, 'project_id': '638a9d4528c04bcc89501243ebdb6eda', 'gw_port': {'id': 'f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:33:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aa2e8458-6c79-4f94-bedc-deca697e49ed', 'device_owner': 'network:router_gateway', 'standard_attr_id': 513, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:19:46Z', 'updated_at': '2021-12-09T21:19:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:51.468679 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b0588205-f299-4d05-b256-fb313f3361ab admin admin] Network 8d988748-159b-463d-bdf5-500e0ea1b879 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:19:51.473046 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-b0588205-f299-4d05-b256-fb313f3361ab admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:19:51.476542 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0588205-f299-4d05-b256-fb313f3361ab admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:19:51.479328 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0588205-f299-4d05-b256-fb313f3361ab admin admin] Pushing event updated for resources: {'Port': ['ID=71a637ea-1689-4659-a9f6-a49f876ed699,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:51.479687 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c4f81d8-2ba7-484f-b2f9-a17a745bf466 None None] The sync data for ids ['aa2e8458-6c79-4f94-bedc-deca697e49ed'] in n-d-713301-27 is: [{'id': 'aa2e8458-6c79-4f94-bedc-deca697e49ed', 'name': 'tempest-AttachSCSIVolumeTestJSON-882207386-router', 'tenant_id': '638a9d4528c04bcc89501243ebdb6eda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.46'}], 'enable_snat': True}, 'gw_port_id': 'f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:19:44Z', 'updated_at': '2021-12-09T21:19:47Z', 'revision_number': 3, 'project_id': '638a9d4528c04bcc89501243ebdb6eda', 'gw_port': {'id': 'f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:33:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aa2e8458-6c79-4f94-bedc-deca697e49ed', 'device_owner': 'network:router_gateway', 'standard_attr_id': 513, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:19:46Z', 'updated_at': '2021-12-09T21:19:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:19:51.537178 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b0588205-f299-4d05-b256-fb313f3361ab admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:51.697598 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b0588205-f299-4d05-b256-fb313f3361ab admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:51.733585 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ea27f741-e3e3-41a0-b252-5c90ef1918b3 None None] Provisioning complete for port 71a637ea-1689-4659-a9f6-a49f876ed699 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:51.734817 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ea27f741-e3e3-41a0-b252-5c90ef1918b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:51.789545 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ea27f741-e3e3-41a0-b252-5c90ef1918b3 None None] Port 71a637ea-1689-4659-a9f6-a49f876ed699 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:19:51.815133 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d512b4d9-b260-459b-b9c4-050b7880fda3 req-f7773c11-4d0e-4ae4-bb7f-e3ba3949be32 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:51.824892 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d512b4d9-b260-459b-b9c4-050b7880fda3 req-f7773c11-4d0e-4ae4-bb7f-e3ba3949be32 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 951 time: 0.4443545 Dec 09 21:19:51.841793 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-f3c1d909-1c72-43bf-a549-bdaa296da413 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:51.843855 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-f3c1d909-1c72-43bf-a549-bdaa296da413 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/networks?id=ce6b6bd1-6a60-4cea-9b70-69fd0290796c HTTP/1.1" status: 200 len: 822 time: 0.5336406 Dec 09 21:19:51.878944 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-f7d97ea5-45f1-4ac4-bd6e-b510c0c8efe8 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/quotas/615039519ef147c78eb38a1d65eac061 HTTP/1.1" status: 200 len: 375 time: 0.0186553 Dec 09 21:19:51.925053 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d512b4d9-b260-459b-b9c4-050b7880fda3 req-625515cb-9827-4b7b-93e2-dc8514b890b4 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0991719 Dec 09 21:19:51.927987 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b0588205-f299-4d05-b256-fb313f3361ab admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:51.936107 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b0588205-f299-4d05-b256-fb313f3361ab admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:51.966853 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-818b7398-6304-4171-abd3-71fc073ce22f tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=615039519ef147c78eb38a1d65eac061&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0805352 Dec 09 21:19:51.985898 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-8c6e8ae5-aa55-4b86-bb27-d1b91e2e5864 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:19:51.986886 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-8c6e8ae5-aa55-4b86-bb27-d1b91e2e5864 service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0061007 Dec 09 21:19:52.038983 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b0588205-f299-4d05-b256-fb313f3361ab admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:52.041376 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0588205-f299-4d05-b256-fb313f3361ab admin admin] Pushing event updated for resources: {'Port': ['ID=71a637ea-1689-4659-a9f6-a49f876ed699,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:52.111646 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-050e2040-ba24-4e41-b6e7-f947ff14f52f req-56371e06-a24b-4fa5-9289-90f719925ee8 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:52.113193 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-050e2040-ba24-4e41-b6e7-f947ff14f52f req-56371e06-a24b-4fa5-9289-90f719925ee8 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 945 time: 0.1008515 Dec 09 21:19:52.136101 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-94371dfc-4039-46a7-b912-9d999bad570a service neutron] 10.222.0.13 "GET /v2.0/networks/ce6b6bd1-6a60-4cea-9b70-69fd0290796c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1420708 Dec 09 21:19:52.144874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b0588205-f299-4d05-b256-fb313f3361ab admin admin] Network 8d988748-159b-463d-bdf5-500e0ea1b879 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:19:52.146366 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-b0588205-f299-4d05-b256-fb313f3361ab admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:19:52.269245 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 40468c91-ccde-4d96-b234-0e326a1de103 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:19:52.274296 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b0588205-f299-4d05-b256-fb313f3361ab admin admin] Router aa2e8458-6c79-4f94-bedc-deca697e49ed has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:19:52.285218 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-050e2040-ba24-4e41-b6e7-f947ff14f52f req-3457a937-0d3f-4963-a1e5-fa8e56254978 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1575449 Dec 09 21:19:52.300674 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d077d04-ea91-473f-a2da-ee28174dd401 req-89119ded-8af6-497e-b049-04881f307fcd tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:52.302238 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d077d04-ea91-473f-a2da-ee28174dd401 req-89119ded-8af6-497e-b049-04881f307fcd tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.10 "GET /v2.0/ports?device_id=2c85b8fc-41be-4975-88fd-db5bc87f1f89 HTTP/1.1" status: 200 len: 946 time: 0.1471720 Dec 09 21:19:52.372067 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 36925110-4ed7-49f6-b07d-d998896a74cc details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:19:52.392429 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 40468c91-ccde-4d96-b234-0e326a1de103 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:19:52.451909 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 40468c91-ccde-4d96-b234-0e326a1de103 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:52.453194 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:52.454808 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b0588205-f299-4d05-b256-fb313f3361ab admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:19:52.459982 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b0588205-f299-4d05-b256-fb313f3361ab admin admin] 10.222.0.13 "PUT /v2.0/routers/aa2e8458-6c79-4f94-bedc-deca697e49ed/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3495960 Dec 09 21:19:52.480160 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-1a4fbb82-4dee-4f61-ad75-ed6c4162b101 service neutron] 10.222.0.13 "GET /v2.0/networks/ce6b6bd1-6a60-4cea-9b70-69fd0290796c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3363955 Dec 09 21:19:52.576801 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-740bcdd6-60ed-4c0e-b520-efbdb971930b req-6571e19b-2aed-4373-9088-ce735ba8698f tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:52.578777 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-740bcdd6-60ed-4c0e-b520-efbdb971930b req-6571e19b-2aed-4373-9088-ce735ba8698f tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.1957452 Dec 09 21:19:52.588207 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-334ea1df-9ca6-4ca4-93eb-36f41b567d65 None None] Provisioning complete for port 71a637ea-1689-4659-a9f6-a49f876ed699 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:52.588576 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-334ea1df-9ca6-4ca4-93eb-36f41b567d65 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:52.644751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 36925110-4ed7-49f6-b07d-d998896a74cc, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=36925110-4ed7-49f6-b07d-d998896a74cc,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:52.658219 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-2d077d04-ea91-473f-a2da-ee28174dd401 req-5bbdd993-e5bc-4725-8d3a-b013997ea451 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Deleting port 7eb6e48f-08e3-409a-9551-0e38eb690c8b {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:19:52.661704 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2d077d04-ea91-473f-a2da-ee28174dd401 req-5bbdd993-e5bc-4725-8d3a-b013997ea451 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:52.668618 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '36925110-4ed7-49f6-b07d-d998896a74cc', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '36925110-4ed7-49f6-b07d-d998896a74cc', 'mac_address': 'fa:16:3e:9f:a4:77', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.140'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:19:52.673762 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-334ea1df-9ca6-4ca4-93eb-36f41b567d65 None None] Port 71a637ea-1689-4659-a9f6-a49f876ed699 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:19:52.802389 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:52.837169 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:52.868086 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 36925110-4ed7-49f6-b07d-d998896a74cc {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:19:52.888609 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-740bcdd6-60ed-4c0e-b520-efbdb971930b req-2e5559ee-22af-4afb-bb4d-1563d76f8963 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2908723 Dec 09 21:19:52.898334 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 40468c91-ccde-4d96-b234-0e326a1de103, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=40468c91-ccde-4d96-b234-0e326a1de103,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:52.929334 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:52.943191 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 36925110-4ed7-49f6-b07d-d998896a74cc, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=36925110-4ed7-49f6-b07d-d998896a74cc,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:52.958542 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-2d077d04-ea91-473f-a2da-ee28174dd401 req-5bbdd993-e5bc-4725-8d3a-b013997ea451 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] For port 7eb6e48f-08e3-409a-9551-0e38eb690c8b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=7eb6e48f-08e3-409a-9551-0e38eb690c8b,segment=NetworkSegment(946d0405-6c7f-49a7-81bb-30e422c98100),segment_id=946d0405-6c7f-49a7-81bb-30e422c98100)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:52.958899 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2d077d04-ea91-473f-a2da-ee28174dd401 req-5bbdd993-e5bc-4725-8d3a-b013997ea451 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:52.969131 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b061c5ff-772f-4909-950e-39d066fb05c2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6166c639-9f87-4254-af88-12c4be868be5'}, {'server_uuid': '18c57a12-fe06-4b8d-93c7-e3121619fa56', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '40468c91-ccde-4d96-b234-0e326a1de103'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:52.969422 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf69aa85-dfdc-47fb-8dcd-95247c8e4b0d req-98bb1aca-9e5b-4b52-8bf0-23a3facb0755 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:52.972394 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d53bce51-3a60-4a07-b2f0-07cf9d467949" -d '{"events": [{"server_uuid": "b061c5ff-772f-4909-950e-39d066fb05c2", "name": "network-vif-plugged", "status": "completed", "tag": "6166c639-9f87-4254-af88-12c4be868be5"}, {"server_uuid": "18c57a12-fe06-4b8d-93c7-e3121619fa56", "name": "network-vif-plugged", "status": "completed", "tag": "40468c91-ccde-4d96-b234-0e326a1de103"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:52.977400 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf69aa85-dfdc-47fb-8dcd-95247c8e4b0d req-98bb1aca-9e5b-4b52-8bf0-23a3facb0755 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a8ab99b-8927-4f89-9ef5-773ea7697c2b HTTP/1.1" status: 200 len: 950 time: 0.1276650 Dec 09 21:19:52.991714 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:53.058832 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=40468c91-ccde-4d96-b234-0e326a1de103,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:53.149440 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=36925110-4ed7-49f6-b07d-d998896a74cc,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:53.218230 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf69aa85-dfdc-47fb-8dcd-95247c8e4b0d req-78268e5a-1ea0-488c-ab2a-0e817bbc027e tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/security-groups?id=3564cbaa-b044-4bce-988d-93357d77088a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2392397 Dec 09 21:19:53.246994 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caf5a2fc-6e37-4751-b9cc-4ce01c9fed20 req-8ab9b099-2952-4cf6-9733-7e2a294e8977 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:53.262945 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-caf5a2fc-6e37-4751-b9cc-4ce01c9fed20 req-8ab9b099-2952-4cf6-9733-7e2a294e8977 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=eac884a1-b960-4dfb-9337-7c68c9f0acca HTTP/1.1" status: 200 len: 946 time: 0.2275901 Dec 09 21:19:53.283502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['36925110-4ed7-49f6-b07d-d998896a74cc'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:19:53.617477 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-caf5a2fc-6e37-4751-b9cc-4ce01c9fed20 req-f0380f2c-d9b8-4ee8-8c3d-442941e3594a tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3531070 Dec 09 21:19:53.733520 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2d077d04-ea91-473f-a2da-ee28174dd401 req-5bbdd993-e5bc-4725-8d3a-b013997ea451 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:53.735878 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2d077d04-ea91-473f-a2da-ee28174dd401 req-5bbdd993-e5bc-4725-8d3a-b013997ea451 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:53.737825 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [req-2d077d04-ea91-473f-a2da-ee28174dd401 req-5bbdd993-e5bc-4725-8d3a-b013997ea451 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Floating IP 607e8ba4-01a4-4741-a885-8732f6aacd9f disassociated. External IP: 172.25.3.108, port: 7eb6e48f-08e3-409a-9551-0e38eb690c8b. Dec 09 21:19:53.740775 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-2d077d04-ea91-473f-a2da-ee28174dd401 req-5bbdd993-e5bc-4725-8d3a-b013997ea451 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Calling delete_port for 7eb6e48f-08e3-409a-9551-0e38eb690c8b owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:19:53.791821 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6e22515-0de7-49c5-b38f-dd5e8f8898fd req-9cee38ab-30fe-4d85-b066-5b7ac8e033c5 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:53.802101 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6e22515-0de7-49c5-b38f-dd5e8f8898fd req-9cee38ab-30fe-4d85-b066-5b7ac8e033c5 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 949 time: 0.2133019 Dec 09 21:19:53.816334 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:19:53.895490 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:53.895897 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:53.930153 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-302916d3-10aa-4c23-b61f-4d907f394d9c req-f513de44-3fda-42c8-bbc9-8bba08bb42f8 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2df58aab-ff2e-4d37-87f8-fb38b11756c0 HTTP/1.1" status: 200 len: 210 time: 0.1682050 Dec 09 21:19:54.002308 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:54.052152 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9139dfb3-8a67-4d41-9d54-ce2a82a6f498 x-openstack-request-id: req-9139dfb3-8a67-4d41-9d54-ce2a82a6f498 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:54.052788 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b061c5ff-772f-4909-950e-39d066fb05c2", "name": "network-vif-plugged", "status": "completed", "tag": "6166c639-9f87-4254-af88-12c4be868be5", "code": 200}, {"server_uuid": "18c57a12-fe06-4b8d-93c7-e3121619fa56", "name": "network-vif-plugged", "status": "completed", "tag": "40468c91-ccde-4d96-b234-0e326a1de103", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:54.053280 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-9139dfb3-8a67-4d41-9d54-ce2a82a6f498 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:54.053877 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b061c5ff-772f-4909-950e-39d066fb05c2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6166c639-9f87-4254-af88-12c4be868be5', 'code': 200} Dec 09 21:19:54.054364 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '18c57a12-fe06-4b8d-93c7-e3121619fa56', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '40468c91-ccde-4d96-b234-0e326a1de103', 'code': 200} Dec 09 21:19:54.071178 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6e22515-0de7-49c5-b38f-dd5e8f8898fd req-f9bf98fa-acb8-4dc7-876e-16e5ccabd7c8 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2671430 Dec 09 21:19:54.072089 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:54.086408 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] Sync routers for ids ['aa2e8458-6c79-4f94-bedc-deca697e49ed'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:19:54.108566 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:54.189118 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] Routers {'aa2e8458-6c79-4f94-bedc-deca697e49ed'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:19:54.190132 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:19:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['aa2e8458-6c79-4f94-bedc-deca697e49ed'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:54.241211 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58550cee-b409-44c0-aa7e-68399fe44d1e req-a8826ba2-69c3-417d-bc40-54e905ffe4b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:54.245605 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-58550cee-b409-44c0-aa7e-68399fe44d1e req-a8826ba2-69c3-417d-bc40-54e905ffe4b0 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 1097 time: 0.0974524 Dec 09 21:19:54.251903 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2d077d04-ea91-473f-a2da-ee28174dd401 req-5bbdd993-e5bc-4725-8d3a-b013997ea451 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:54.409179 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-58550cee-b409-44c0-aa7e-68399fe44d1e req-76d3817d-e556-4d69-922a-f78a14e6e89b service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1560431 Dec 09 21:19:54.430375 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] Set router aa2e8458-6c79-4f94-bedc-deca697e49ed gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:19:54.478640 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 36925110-4ed7-49f6-b07d-d998896a74cc up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:19:54.482904 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bbdd993-e5bc-4725-8d3a-b013997ea451 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Pushing event deleted for resources: {'Port': ['ID=7eb6e48f-08e3-409a-9551-0e38eb690c8b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:54.564920 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:54.618708 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d040a79-139e-44ad-8ff6-bd1e270d3e3d req-f5e9fb45-1c59-45f4-8759-071fbe31a420 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:54.620294 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5d040a79-139e-44ad-8ff6-bd1e270d3e3d req-f5e9fb45-1c59-45f4-8759-071fbe31a420 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 1098 time: 0.3810203 Dec 09 21:19:54.628792 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30a7cad5-90d7-4efe-b7b8-b23678e81273 req-34c39ecb-2914-4ce6-86d1-c2f4ea90f5bc tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:54.630457 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-30a7cad5-90d7-4efe-b7b8-b23678e81273 req-34c39ecb-2914-4ce6-86d1-c2f4ea90f5bc tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 946 time: 0.3925364 Dec 09 21:19:54.650124 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 36925110-4ed7-49f6-b07d-d998896a74cc completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:19:54.661870 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 36925110-4ed7-49f6-b07d-d998896a74cc triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:54.662248 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:54.671551 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c4f46cf-98e2-46c4-9df0-fd6c76c11c64 req-6bbfede1-6535-4023-b615-e337b2cc5a8c tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:54.684612 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c4f46cf-98e2-46c4-9df0-fd6c76c11c64 req-6bbfede1-6535-4023-b615-e337b2cc5a8c tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 1103 time: 0.3850141 Dec 09 21:19:54.872843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-862ec62f-2514-4d02-babc-e366cb5b9d94 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:54.874541 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-862ec62f-2514-4d02-babc-e366cb5b9d94 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.31 "GET /v2.0/networks?id=ce6b6bd1-6a60-4cea-9b70-69fd0290796c HTTP/1.1" status: 200 len: 822 time: 0.4100327 Dec 09 21:19:54.876646 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:54.880580 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'aa2e8458-6c79-4f94-bedc-deca697e49ed', 'name': 'tempest-AttachSCSIVolumeTestJSON-882207386-router', 'tenant_id': '638a9d4528c04bcc89501243ebdb6eda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.46'}], 'enable_snat': True}, 'gw_port_id': 'f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:19:44Z', 'updated_at': '2021-12-09T21:19:51Z', 'revision_number': 4, 'project_id': '638a9d4528c04bcc89501243ebdb6eda', 'gw_port': {'id': 'f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:33:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa2e8458-6c79-4f94-bedc-deca697e49ed', 'device_owner': 'network:router_gateway', 'standard_attr_id': 513, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:19:46Z', 'updated_at': '2021-12-09T21:19:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '71a637ea-1689-4659-a9f6-a49f876ed699', 'name': '', 'network_id': '8d988748-159b-463d-bdf5-500e0ea1b879', 'tenant_id': '638a9d4528c04bcc89501243ebdb6eda', 'mac_address': 'fa:16:3e:03:c5:b0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aa2e8458-6c79-4f94-bedc-deca697e49ed', 'device_owner': 'network:router_interface', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '1caf9086-38c1-45a4-b64b-d3475b50f4b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:19:50Z', 'updated_at': '2021-12-09T21:19:51Z', 'revision_number': 2, 'project_id': '638a9d4528c04bcc89501243ebdb6eda', 'subnets': [{'id': '1caf9086-38c1-45a4-b64b-d3475b50f4b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:54.945931 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] Checking router: aa2e8458-6c79-4f94-bedc-deca697e49ed for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:19:54.946299 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] Updating router aa2e8458-6c79-4f94-bedc-deca697e49ed port 71a637ea-1689-4659-a9f6-a49f876ed699 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:19:54.951613 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-30a7cad5-90d7-4efe-b7b8-b23678e81273 req-f8c353c2-0a66-40c1-bf9a-10b2f691f196 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2628112 Dec 09 21:19:54.992894 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [req-2d077d04-ea91-473f-a2da-ee28174dd401 req-5bbdd993-e5bc-4725-8d3a-b013997ea451 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Router 3b833388-9a85-4de2-9ce7-fd22b400c313 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:19:55.020378 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c4f46cf-98e2-46c4-9df0-fd6c76c11c64 req-ab48a6aa-246e-4f19-9363-cff0d3797e20 tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3349459 Dec 09 21:19:55.041343 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5d040a79-139e-44ad-8ff6-bd1e270d3e3d req-db62d5aa-26da-4e03-b068-4924d671fe57 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3412061 Dec 09 21:19:55.073658 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-c5b93bf7-8bcc-4b7f-98d3-bf9d85c00b0b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=615039519ef147c78eb38a1d65eac061 HTTP/1.1" status: 200 len: 379 time: 0.1800399 Dec 09 21:19:55.089954 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-e8fe8ce5-66e4-46de-a87a-95bd7a83cc5b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Request body: {'port': {'device_id': '2df58aab-ff2e-4d37-87f8-fb38b11756c0', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'admin_state_up': True, 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'security_groups': ['9798184d-82ec-4464-b3fc-95653513aba7']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:55.126357 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:55.133813 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 36925110-4ed7-49f6-b07d-d998896a74cc, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=36925110-4ed7-49f6-b07d-d998896a74cc,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:55.183562 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:55.411503 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=36925110-4ed7-49f6-b07d-d998896a74cc,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:55.440478 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e2a3a94-b523-4dfc-9ba8-d8ffbc017ff4 req-a460d45b-cc93-4ee0-90a9-c61c9b6b8b53 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:55.442074 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0e2a3a94-b523-4dfc-9ba8-d8ffbc017ff4 req-a460d45b-cc93-4ee0-90a9-c61c9b6b8b53 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.2217090 Dec 09 21:19:55.453753 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-2d077d04-ea91-473f-a2da-ee28174dd401 req-5bbdd993-e5bc-4725-8d3a-b013997ea451 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:19:55.468615 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c8636d5-5ecf-49ee-98c2-c46e9573e0bf None None] Sync routers for ids ['3b833388-9a85-4de2-9ce7-fd22b400c313'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:19:55.502370 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c8636d5-5ecf-49ee-98c2-c46e9573e0bf None None] Routers {'3b833388-9a85-4de2-9ce7-fd22b400c313'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:19:55.502370 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-8c8636d5-5ecf-49ee-98c2-c46e9573e0bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:19:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3b833388-9a85-4de2-9ce7-fd22b400c313'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:55.618730 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-2d077d04-ea91-473f-a2da-ee28174dd401 req-5bbdd993-e5bc-4725-8d3a-b013997ea451 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] No DVR routers for this DVR port 7eb6e48f-08e3-409a-9551-0e38eb690c8b on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:19:55.628846 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41adaba6-f1b6-49e8-a3b0-3625e88ef5d6 req-a83898ad-d853-4755-ab36-d3a83e023e5c tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:55.636918 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-41adaba6-f1b6-49e8-a3b0-3625e88ef5d6 req-a83898ad-d853-4755-ab36-d3a83e023e5c tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a8ab99b-8927-4f89-9ef5-773ea7697c2b HTTP/1.1" status: 200 len: 950 time: 0.2980103 Dec 09 21:19:55.648051 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2d077d04-ea91-473f-a2da-ee28174dd401 req-5bbdd993-e5bc-4725-8d3a-b013997ea451 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:55.652116 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d077d04-ea91-473f-a2da-ee28174dd401 req-5bbdd993-e5bc-4725-8d3a-b013997ea451 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.10 "DELETE /v2.0/ports/7eb6e48f-08e3-409a-9551-0e38eb690c8b HTTP/1.1" status: 204 len: 173 time: 3.3403132 Dec 09 21:19:55.652733 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2c85b8fc-41be-4975-88fd-db5bc87f1f89', 'name': 'network-vif-deleted', 'tag': '7eb6e48f-08e3-409a-9551-0e38eb690c8b'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:55.655222 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-413721b4-e746-4df9-be99-523c10c82de0" -d '{"events": [{"server_uuid": "2c85b8fc-41be-4975-88fd-db5bc87f1f89", "name": "network-vif-deleted", "tag": "7eb6e48f-08e3-409a-9551-0e38eb690c8b"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:55.662155 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-e8fe8ce5-66e4-46de-a87a-95bd7a83cc5b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Made reservation on behalf of 615039519ef147c78eb38a1d65eac061 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:19:55.665750 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-e8fe8ce5-66e4-46de-a87a-95bd7a83cc5b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:55.752532 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-8c8636d5-5ecf-49ee-98c2-c46e9573e0bf None None] Set router 3b833388-9a85-4de2-9ce7-fd22b400c313 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:19:55.821189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:19:55.870132 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-e8fe8ce5-66e4-46de-a87a-95bd7a83cc5b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Allocated IP 172.20.0.11 (ce6b6bd1-6a60-4cea-9b70-69fd0290796c/9755e5ea-99a7-4073-8693-293dcc00b929/80dde595-a3d7-4c03-aa66-d9fc5b2f340c) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:19:56.047812 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-e8fe8ce5-66e4-46de-a87a-95bd7a83cc5b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:56.062259 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0e2a3a94-b523-4dfc-9ba8-d8ffbc017ff4 req-1a549861-008c-4f91-84cd-df99360d01c2 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6053150 Dec 09 21:19:56.067739 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '89bd78b4-a499-4908-8ee4-7b3f64653d0b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '36925110-4ed7-49f6-b07d-d998896a74cc'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:56.074678 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-46fcc0e1-907e-480f-8dd8-721b2224976b" -d '{"events": [{"server_uuid": "89bd78b4-a499-4908-8ee4-7b3f64653d0b", "name": "network-vif-plugged", "status": "completed", "tag": "36925110-4ed7-49f6-b07d-d998896a74cc"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:19:56.102456 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-41adaba6-f1b6-49e8-a3b0-3625e88ef5d6 req-e00bba8c-54d5-409e-8691-309b88804fc9 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/security-groups?id=3564cbaa-b044-4bce-988d-93357d77088a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4589694 Dec 09 21:19:56.184977 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:56.196080 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:56.196718 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:56.225738 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-e8fe8ce5-66e4-46de-a87a-95bd7a83cc5b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:56.246906 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:56.337976 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06109c00-ba52-43cf-8181-43683ce3f874 None None] Pushing event updated for resources: {'Port': ['ID=71a637ea-1689-4659-a9f6-a49f876ed699,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:56.342256 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 7eb6e48f-08e3-409a-9551-0e38eb690c8b no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:19:56.405207 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-e8fe8ce5-66e4-46de-a87a-95bd7a83cc5b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Network ce6b6bd1-6a60-4cea-9b70-69fd0290796c is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:19:56.413648 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-e8fe8ce5-66e4-46de-a87a-95bd7a83cc5b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:19:56.428810 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-e8fe8ce5-66e4-46de-a87a-95bd7a83cc5b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:19:56.464461 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f1daa6d-b9da-46f2-83f0-54cb2ab9a41d req-e13d62ca-fdea-4289-a114-3eb174228f80 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:56.479851 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f1daa6d-b9da-46f2-83f0-54cb2ab9a41d req-e13d62ca-fdea-4289-a114-3eb174228f80 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2df58aab-ff2e-4d37-87f8-fb38b11756c0 HTTP/1.1" status: 200 len: 932 time: 0.2779591 Dec 09 21:19:56.556273 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8fe8ce5-66e4-46de-a87a-95bd7a83cc5b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Pushing event updated for resources: {'Port': ['ID=80dde595-a3d7-4c03-aa66-d9fc5b2f340c,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:56.661570 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-8c8636d5-5ecf-49ee-98c2-c46e9573e0bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-85948487-router', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54'}], 'enable_snat': True}, 'gw_port_id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:12Z', 'updated_at': '2021-12-09T21:17:16Z', 'revision_number': 4, 'project_id': '615039519ef147c78eb38a1d65eac061', 'gw_port': {'id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:32:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:13Z', 'updated_at': '2021-12-09T21:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'f50209a6-36fd-4aea-927f-b79127351066', 'name': '', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'mac_address': 'fa:16:3e:bd:0e:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:15Z', 'updated_at': '2021-12-09T21:17:21Z', 'revision_number': 5, 'project_id': '615039519ef147c78eb38a1d65eac061', 'subnets': [{'id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:56.711842 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-e8fe8ce5-66e4-46de-a87a-95bd7a83cc5b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:56.715234 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-e8fe8ce5-66e4-46de-a87a-95bd7a83cc5b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:56.719939 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c8636d5-5ecf-49ee-98c2-c46e9573e0bf None None] Checking router: 3b833388-9a85-4de2-9ce7-fd22b400c313 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:19:56.744431 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c8636d5-5ecf-49ee-98c2-c46e9573e0bf None None] Routers {'3b833388-9a85-4de2-9ce7-fd22b400c313'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:19:56.745083 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-8c8636d5-5ecf-49ee-98c2-c46e9573e0bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:19:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3b833388-9a85-4de2-9ce7-fd22b400c313'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:56.754644 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] Attempting to bind port 71a637ea-1689-4659-a9f6-a49f876ed699 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:19:56.756938 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] Attempting to bind port 71a637ea-1689-4659-a9f6-a49f876ed699 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '8d988748-159b-463d-bdf5-500e0ea1b879'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:19:56.757463 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] Attempting to bind port 71a637ea-1689-4659-a9f6-a49f876ed699 on network 8d988748-159b-463d-bdf5-500e0ea1b879 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:56.771340 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 7eb6e48f-08e3-409a-9551-0e38eb690c8b {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:19:56.771920 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 7eb6e48f-08e3-409a-9551-0e38eb690c8b not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:19:56.775747 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 19, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:19:56.777548 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] Checking segment: {'id': 'cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '8d988748-159b-463d-bdf5-500e0ea1b879'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:19:56.778047 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:56.780721 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] Bound using segment: {'id': 'cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '8d988748-159b-463d-bdf5-500e0ea1b879'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:19:56.782394 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] Bound port: 71a637ea-1689-4659-a9f6-a49f876ed699, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '8d988748-159b-463d-bdf5-500e0ea1b879'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:19:56.782880 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:56.829891 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f1daa6d-b9da-46f2-83f0-54cb2ab9a41d req-f3670fca-32cf-4cdb-8153-9bba490b28d7 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3512800 Dec 09 21:19:56.838942 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-e8fe8ce5-66e4-46de-a87a-95bd7a83cc5b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.7543416 Dec 09 21:19:56.863628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-fc12bb6a-6919-409e-9213-77ac424829d6 service neutron] Request body: {'port': {'device_id': '2df58aab-ff2e-4d37-87f8-fb38b11756c0', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:19:56.944345 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] For port 71a637ea-1689-4659-a9f6-a49f876ed699, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:56.951706 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] For port 71a637ea-1689-4659-a9f6-a49f876ed699, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=71a637ea-1689-4659-a9f6-a49f876ed699,segment=NetworkSegment(cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9),segment_id=cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:19:56.959793 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2b250c5-6b69-45ad-90f1-9bfaf39f004b req-9bdbeb05-6762-4653-8e41-098e18f82007 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:56.970680 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2b250c5-6b69-45ad-90f1-9bfaf39f004b req-9bdbeb05-6762-4653-8e41-098e18f82007 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 950 time: 0.4196172 Dec 09 21:19:57.007503 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-8c8636d5-5ecf-49ee-98c2-c46e9573e0bf None None] Set router 3b833388-9a85-4de2-9ce7-fd22b400c313 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:19:57.023906 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:57.053651 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5864cb05-b1ae-4080-bb2e-d556b7559825 None None] Provisioning complete for port 71a637ea-1689-4659-a9f6-a49f876ed699 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:57.055168 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5864cb05-b1ae-4080-bb2e-d556b7559825 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:57.241021 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:57.302530 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] Routers {'aa2e8458-6c79-4f94-bedc-deca697e49ed'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:19:57.303729 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:19:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['aa2e8458-6c79-4f94-bedc-deca697e49ed'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:57.331694 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-8c8636d5-5ecf-49ee-98c2-c46e9573e0bf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-85948487-router', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54'}], 'enable_snat': True}, 'gw_port_id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:12Z', 'updated_at': '2021-12-09T21:17:16Z', 'revision_number': 4, 'project_id': '615039519ef147c78eb38a1d65eac061', 'gw_port': {'id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:32:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:13Z', 'updated_at': '2021-12-09T21:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'f50209a6-36fd-4aea-927f-b79127351066', 'name': '', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'mac_address': 'fa:16:3e:bd:0e:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:15Z', 'updated_at': '2021-12-09T21:17:21Z', 'revision_number': 5, 'project_id': '615039519ef147c78eb38a1d65eac061', 'subnets': [{'id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:57.412594 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c8636d5-5ecf-49ee-98c2-c46e9573e0bf None None] The sync data for ids ['3b833388-9a85-4de2-9ce7-fd22b400c313'] in n-d-713301-27 is: [{'id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-85948487-router', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54'}], 'enable_snat': True}, 'gw_port_id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:12Z', 'updated_at': '2021-12-09T21:17:16Z', 'revision_number': 4, 'project_id': '615039519ef147c78eb38a1d65eac061', 'gw_port': {'id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:32:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:13Z', 'updated_at': '2021-12-09T21:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'f50209a6-36fd-4aea-927f-b79127351066', 'name': '', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'mac_address': 'fa:16:3e:bd:0e:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:15Z', 'updated_at': '2021-12-09T21:17:21Z', 'revision_number': 5, 'project_id': '615039519ef147c78eb38a1d65eac061', 'subnets': [{'id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:19:57.672886 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2b250c5-6b69-45ad-90f1-9bfaf39f004b req-88275b12-af49-4be6-ae09-3d5c1ca17ccd tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6997409 Dec 09 21:19:57.674839 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-fc12bb6a-6919-409e-9213-77ac424829d6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:57.684691 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87ef230f-7f70-46b7-badc-735901bdb552 req-bf6d02dd-4bad-4a53-95df-bacecd5a2779 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:57.698999 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-87ef230f-7f70-46b7-badc-735901bdb552 req-bf6d02dd-4bad-4a53-95df-bacecd5a2779 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=eac884a1-b960-4dfb-9337-7c68c9f0acca HTTP/1.1" status: 200 len: 946 time: 0.6727684 Dec 09 21:19:57.732978 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:57.763333 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06109c00-ba52-43cf-8181-43683ce3f874 None None] Pushing event updated for resources: {'Port': ['ID=71a637ea-1689-4659-a9f6-a49f876ed699,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:57.820224 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] Set router aa2e8458-6c79-4f94-bedc-deca697e49ed gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:19:57.870163 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5864cb05-b1ae-4080-bb2e-d556b7559825 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:57.890818 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b03571c3-41a1-45e8-896b-347934ad8dcb None None] New status for floating IP 607e8ba4-01a4-4741-a885-8732f6aacd9f: DOWN {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:19:57.906389 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0bc5b59e-ec0d-4cea-a457-1e52f89e8edb x-openstack-request-id: req-0bc5b59e-ec0d-4cea-a457-1e52f89e8edb {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:57.907013 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2c85b8fc-41be-4975-88fd-db5bc87f1f89", "name": "network-vif-deleted", "tag": "7eb6e48f-08e3-409a-9551-0e38eb690c8b", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:57.907013 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0bc5b59e-ec0d-4cea-a457-1e52f89e8edb {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:57.907334 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2c85b8fc-41be-4975-88fd-db5bc87f1f89', 'name': 'network-vif-deleted', 'tag': '7eb6e48f-08e3-409a-9551-0e38eb690c8b', 'status': 'completed', 'code': 200} Dec 09 21:19:57.911106 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-87ef230f-7f70-46b7-badc-735901bdb552 req-8aed9ee9-c17b-440a-8012-7f4e5bb8c115 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2113335 Dec 09 21:19:58.012886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2ccced3-7baf-4f9d-8684-d5a5b85548e2 req-4bc1abf0-53f5-4d8f-98e7-48b6ccb80f8c tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:58.025262 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f2ccced3-7baf-4f9d-8684-d5a5b85548e2 req-4bc1abf0-53f5-4d8f-98e7-48b6ccb80f8c tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 946 time: 0.1067789 Dec 09 21:19:58.027187 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e7a71483-4c56-40fb-aada-30f48debdcbc x-openstack-request-id: req-e7a71483-4c56-40fb-aada-30f48debdcbc {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:19:58.027530 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "89bd78b4-a499-4908-8ee4-7b3f64653d0b", "name": "network-vif-plugged", "status": "completed", "tag": "36925110-4ed7-49f6-b07d-d998896a74cc", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:19:58.027803 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e7a71483-4c56-40fb-aada-30f48debdcbc {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:19:58.028171 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '89bd78b4-a499-4908-8ee4-7b3f64653d0b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '36925110-4ed7-49f6-b07d-d998896a74cc', 'code': 200} Dec 09 21:19:58.079018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-5864cb05-b1ae-4080-bb2e-d556b7559825 None None] For port 71a637ea-1689-4659-a9f6-a49f876ed699, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=71a637ea-1689-4659-a9f6-a49f876ed699,segment=NetworkSegment(cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9),segment_id=cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:19:58.140181 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f2ccced3-7baf-4f9d-8684-d5a5b85548e2 req-795645cf-7937-4eee-bfc1-649d5e2b1862 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1117163 Dec 09 21:19:58.147317 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10820c81-87d7-4051-8d4f-01641d682db4 req-6be6c985-fd6f-451e-8671-6e1a5bb314a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:58.149054 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-10820c81-87d7-4051-8d4f-01641d682db4 req-6be6c985-fd6f-451e-8671-6e1a5bb314a9 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 1102 time: 0.0675781 Dec 09 21:19:58.167070 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5864cb05-b1ae-4080-bb2e-d556b7559825 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:58.262764 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-10820c81-87d7-4051-8d4f-01641d682db4 req-81b110d1-2583-487b-a537-ada6c2ad8765 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1021800 Dec 09 21:19:58.315111 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5864cb05-b1ae-4080-bb2e-d556b7559825 None None] Pushing event updated for resources: {'Port': ['ID=71a637ea-1689-4659-a9f6-a49f876ed699,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:58.328648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e73ee7e6-33df-48cd-9300-1f32fe58ccca None None] Provisioning complete for port 80dde595-a3d7-4c03-aa66-d9fc5b2f340c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:58.328910 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e73ee7e6-33df-48cd-9300-1f32fe58ccca None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:58.363131 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-fc12bb6a-6919-409e-9213-77ac424829d6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 80dde595-a3d7-4c03-aa66-d9fc5b2f340c {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:19:58.374098 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-fc12bb6a-6919-409e-9213-77ac424829d6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:58.386079 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26a63211-226b-4149-a6e1-2fba84f8a9d1 req-ce6eb694-3304-4962-b3be-840565888ca4 tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:58.393734 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-26a63211-226b-4149-a6e1-2fba84f8a9d1 req-ce6eb694-3304-4962-b3be-840565888ca4 tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 1103 time: 0.1140099 Dec 09 21:19:58.411987 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e73ee7e6-33df-48cd-9300-1f32fe58ccca None None] Port 80dde595-a3d7-4c03-aa66-d9fc5b2f340c cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:19:58.421302 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-fc12bb6a-6919-409e-9213-77ac424829d6 service neutron] Transition to ACTIVE for port object 80dde595-a3d7-4c03-aa66-d9fc5b2f340c will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:19:58.434604 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-fc12bb6a-6919-409e-9213-77ac424829d6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:58.439383 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e73ee7e6-33df-48cd-9300-1f32fe58ccca None None] Provisioning complete for port 71a637ea-1689-4659-a9f6-a49f876ed699 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:58.439842 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e73ee7e6-33df-48cd-9300-1f32fe58ccca None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:58.501462 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'aa2e8458-6c79-4f94-bedc-deca697e49ed', 'name': 'tempest-AttachSCSIVolumeTestJSON-882207386-router', 'tenant_id': '638a9d4528c04bcc89501243ebdb6eda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.46'}], 'enable_snat': True}, 'gw_port_id': 'f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:19:44Z', 'updated_at': '2021-12-09T21:19:51Z', 'revision_number': 4, 'project_id': '638a9d4528c04bcc89501243ebdb6eda', 'gw_port': {'id': 'f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:33:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa2e8458-6c79-4f94-bedc-deca697e49ed', 'device_owner': 'network:router_gateway', 'standard_attr_id': 513, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:19:46Z', 'updated_at': '2021-12-09T21:19:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '71a637ea-1689-4659-a9f6-a49f876ed699', 'name': '', 'network_id': '8d988748-159b-463d-bdf5-500e0ea1b879', 'tenant_id': '638a9d4528c04bcc89501243ebdb6eda', 'mac_address': 'fa:16:3e:03:c5:b0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aa2e8458-6c79-4f94-bedc-deca697e49ed', 'device_owner': 'network:router_interface', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '1caf9086-38c1-45a4-b64b-d3475b50f4b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:19:50Z', 'updated_at': '2021-12-09T21:19:56Z', 'revision_number': 4, 'project_id': '638a9d4528c04bcc89501243ebdb6eda', 'subnets': [{'id': '1caf9086-38c1-45a4-b64b-d3475b50f4b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:19:58.502986 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-26a63211-226b-4149-a6e1-2fba84f8a9d1 req-392ae11f-9569-43a4-b108-474bd9dba4c9 tempest-ServersAdminTestJSON-1709995220 tempest-ServersAdminTestJSON-1709995220-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1030529 Dec 09 21:19:58.535344 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12359e34-5735-4daf-aeb3-ff8d2d52d045 None None] The sync data for ids ['aa2e8458-6c79-4f94-bedc-deca697e49ed'] in n-d-713301-27 is: [{'id': 'aa2e8458-6c79-4f94-bedc-deca697e49ed', 'name': 'tempest-AttachSCSIVolumeTestJSON-882207386-router', 'tenant_id': '638a9d4528c04bcc89501243ebdb6eda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.46'}], 'enable_snat': True}, 'gw_port_id': 'f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:19:44Z', 'updated_at': '2021-12-09T21:19:51Z', 'revision_number': 4, 'project_id': '638a9d4528c04bcc89501243ebdb6eda', 'gw_port': {'id': 'f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:33:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa2e8458-6c79-4f94-bedc-deca697e49ed', 'device_owner': 'network:router_gateway', 'standard_attr_id': 513, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:19:46Z', 'updated_at': '2021-12-09T21:19:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '71a637ea-1689-4659-a9f6-a49f876ed699', 'name': '', 'network_id': '8d988748-159b-463d-bdf5-500e0ea1b879', 'tenant_id': '638a9d4528c04bcc89501243ebdb6eda', 'mac_address': 'fa:16:3e:03:c5:b0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'aa2e8458-6c79-4f94-bedc-deca697e49ed', 'device_owner': 'network:router_interface', 'standard_attr_id': 514, 'fixed_ips': [{'subnet_id': '1caf9086-38c1-45a4-b64b-d3475b50f4b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:19:50Z', 'updated_at': '2021-12-09T21:19:56Z', 'revision_number': 4, 'project_id': '638a9d4528c04bcc89501243ebdb6eda', 'subnets': [{'id': '1caf9086-38c1-45a4-b64b-d3475b50f4b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:19:58.589170 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc12bb6a-6919-409e-9213-77ac424829d6 service neutron] Pushing event updated for resources: {'Port': ['ID=80dde595-a3d7-4c03-aa66-d9fc5b2f340c,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:58.707209 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6265c074-b8bc-4890-b70a-7836bd05f97e req-667a6e6f-caf9-40cf-a57b-b2250c12cc51 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:58.712670 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6265c074-b8bc-4890-b70a-7836bd05f97e req-667a6e6f-caf9-40cf-a57b-b2250c12cc51 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.2453983 Dec 09 21:19:58.815466 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6265c074-b8bc-4890-b70a-7836bd05f97e req-c8c7c2a8-c070-4fda-aad8-b6ec1ec1a20f tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0946922 Dec 09 21:19:58.891548 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-fc12bb6a-6919-409e-9213-77ac424829d6 service neutron] Attempting to bind port 80dde595-a3d7-4c03-aa66-d9fc5b2f340c on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:19:58.892934 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-fc12bb6a-6919-409e-9213-77ac424829d6 service neutron] Attempting to bind port 80dde595-a3d7-4c03-aa66-d9fc5b2f340c by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '946d0405-6c7f-49a7-81bb-30e422c98100', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:19:58.893728 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-fc12bb6a-6919-409e-9213-77ac424829d6 service neutron] Attempting to bind port 80dde595-a3d7-4c03-aa66-d9fc5b2f340c on network ce6b6bd1-6a60-4cea-9b70-69fd0290796c {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:58.928798 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-510b0d69-6a6d-4b19-87e9-579bb4ab4296 req-fe8a5b73-0366-4954-890c-2cc3543f3c0b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:58.941645 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-510b0d69-6a6d-4b19-87e9-579bb4ab4296 req-fe8a5b73-0366-4954-890c-2cc3543f3c0b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2df58aab-ff2e-4d37-87f8-fb38b11756c0 HTTP/1.1" status: 200 len: 944 time: 0.2962239 Dec 09 21:19:58.995565 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-fc12bb6a-6919-409e-9213-77ac424829d6 service neutron] Port 80dde595-a3d7-4c03-aa66-d9fc5b2f340c on network ce6b6bd1-6a60-4cea-9b70-69fd0290796c not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:19:58.996260 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-fc12bb6a-6919-409e-9213-77ac424829d6 service neutron] Attempting to bind port 80dde595-a3d7-4c03-aa66-d9fc5b2f340c on network ce6b6bd1-6a60-4cea-9b70-69fd0290796c {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:19:59.014581 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-fc12bb6a-6919-409e-9213-77ac424829d6 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 19, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:19:59.014996 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-fc12bb6a-6919-409e-9213-77ac424829d6 service neutron] Checking segment: {'id': '946d0405-6c7f-49a7-81bb-30e422c98100', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:19:59.015312 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-fc12bb6a-6919-409e-9213-77ac424829d6 service neutron] Bound using segment: {'id': '946d0405-6c7f-49a7-81bb-30e422c98100', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:19:59.016940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-fc12bb6a-6919-409e-9213-77ac424829d6 service neutron] Bound port: 80dde595-a3d7-4c03-aa66-d9fc5b2f340c, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '946d0405-6c7f-49a7-81bb-30e422c98100', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:19:59.016940 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-fc12bb6a-6919-409e-9213-77ac424829d6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:59.119015 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-510b0d69-6a6d-4b19-87e9-579bb4ab4296 req-6cb79756-cd8e-435c-921f-c109986eb6c6 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1763225 Dec 09 21:19:59.213981 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-fc12bb6a-6919-409e-9213-77ac424829d6 service neutron] For port 80dde595-a3d7-4c03-aa66-d9fc5b2f340c, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:19:59.239648 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-fc12bb6a-6919-409e-9213-77ac424829d6 service neutron] For port 80dde595-a3d7-4c03-aa66-d9fc5b2f340c, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=80dde595-a3d7-4c03-aa66-d9fc5b2f340c,segment=NetworkSegment(946d0405-6c7f-49a7-81bb-30e422c98100),segment_id=946d0405-6c7f-49a7-81bb-30e422c98100)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:19:59.255465 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-fc12bb6a-6919-409e-9213-77ac424829d6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:59.321936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc12bb6a-6919-409e-9213-77ac424829d6 service neutron] Pushing event updated for resources: {'Port': ['ID=80dde595-a3d7-4c03-aa66-d9fc5b2f340c,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:19:59.348383 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-fc12bb6a-6919-409e-9213-77ac424829d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:59.354114 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-fc12bb6a-6919-409e-9213-77ac424829d6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:59.368904 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-fc12bb6a-6919-409e-9213-77ac424829d6 service neutron] 10.222.0.31 "PUT /v2.0/ports/80dde595-a3d7-4c03-aa66-d9fc5b2f340c HTTP/1.1" status: 200 len: 1093 time: 2.5140479 Dec 09 21:19:59.492271 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-696eeb2c-a160-4e25-b803-6b3041c110ca req-5f4e7375-cb0b-4e0e-a06d-a7ac9a0806ba tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:59.501934 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-696eeb2c-a160-4e25-b803-6b3041c110ca req-5f4e7375-cb0b-4e0e-a06d-a7ac9a0806ba tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 1098 time: 0.2364500 Dec 09 21:19:59.562137 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-8e4a38ac-6ea3-457e-90e8-b4f1d5f3216b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:59.563613 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-8e4a38ac-6ea3-457e-90e8-b4f1d5f3216b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=615039519ef147c78eb38a1d65eac061&device_id=2df58aab-ff2e-4d37-87f8-fb38b11756c0 HTTP/1.1" status: 200 len: 1096 time: 0.1489806 Dec 09 21:19:59.729036 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-a322f611-77d3-40f4-8ae5-0fe68758a9eb service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=80dde595-a3d7-4c03-aa66-d9fc5b2f340c HTTP/1.1" status: 200 len: 217 time: 0.1538987 Dec 09 21:19:59.842913 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 71a637ea-1689-4659-a9f6-a49f876ed699 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:19:59.870735 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-696eeb2c-a160-4e25-b803-6b3041c110ca req-79a45f39-b855-4a9b-b505-18b8e7562254 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3531554 Dec 09 21:19:59.897578 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-ca382bcd-aaea-4a5d-9793-48ae784af302 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:19:59.900443 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-ca382bcd-aaea-4a5d-9793-48ae784af302 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=9755e5ea-99a7-4073-8693-293dcc00b929 HTTP/1.1" status: 200 len: 861 time: 0.1590276 Dec 09 21:19:59.911628 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 71a637ea-1689-4659-a9f6-a49f876ed699 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:19:59.912010 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:19:59.923304 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2df58aab-ff2e-4d37-87f8-fb38b11756c0', 'tag': '80dde595-a3d7-4c03-aa66-d9fc5b2f340c'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:19:59.924267 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-15ad9fce-0c4d-4071-81d0-75ff1f99f67e" -d '{"events": [{"name": "network-changed", "server_uuid": "2df58aab-ff2e-4d37-87f8-fb38b11756c0", "tag": "80dde595-a3d7-4c03-aa66-d9fc5b2f340c"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:20:00.046382 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87f5cff2-18a1-4d54-9787-2d964d7682a3 req-01625dd0-c21c-48ce-80c5-a730f9ad6ad0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:00.052233 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-87f5cff2-18a1-4d54-9787-2d964d7682a3 req-01625dd0-c21c-48ce-80c5-a730f9ad6ad0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 950 time: 0.1246548 Dec 09 21:20:00.105723 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-f27dc1c0-40a3-41ef-a2a7-133da230c01b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:00.105723 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-f27dc1c0-40a3-41ef-a2a7-133da230c01b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ce6b6bd1-6a60-4cea-9b70-69fd0290796c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1945987 Dec 09 21:20:00.162450 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-145d5291-2e06-4b4c-9a1c-5fa9073d7862 req-8928b16d-1709-45b2-857d-7cb384c24fb3 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:00.164065 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-145d5291-2e06-4b4c-9a1c-5fa9073d7862 req-8928b16d-1709-45b2-857d-7cb384c24fb3 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 1097 time: 0.1500163 Dec 09 21:20:00.210525 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-87f5cff2-18a1-4d54-9787-2d964d7682a3 req-ad188249-f62d-4fca-99a7-dbcb15517d0c tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1516342 Dec 09 21:20:00.266473 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-145d5291-2e06-4b4c-9a1c-5fa9073d7862 req-c44ab551-c7ab-4d4a-a0cb-fd20c38a0c84 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0682399 Dec 09 21:20:00.292966 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-0f0f317c-1298-44e4-ad84-fded7b0a4fa0 service neutron] 10.222.0.31 "GET /v2.0/networks/ce6b6bd1-6a60-4cea-9b70-69fd0290796c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1786137 Dec 09 21:20:00.426925 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1573c29-9cce-462b-a6ca-6657dad1dc4d req-0141aaae-d82a-4dd8-beaa-53d74a180d30 service neutron] 10.222.0.31 "GET /v2.0/networks/ce6b6bd1-6a60-4cea-9b70-69fd0290796c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1149442 Dec 09 21:20:00.515713 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7428b67e-773c-4d8b-9c29-5df9c2b7f66f req-84f9d2fc-d116-4524-87f8-d0d10d34a026 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:00.517088 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7428b67e-773c-4d8b-9c29-5df9c2b7f66f req-84f9d2fc-d116-4524-87f8-d0d10d34a026 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=8c21856f-2254-41e8-941c-2f4471714942 HTTP/1.1" status: 200 len: 948 time: 0.0934105 Dec 09 21:20:00.609986 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:19:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-78de9aac-46ba-4e8d-9502-6ec328ffe651 x-openstack-request-id: req-78de9aac-46ba-4e8d-9502-6ec328ffe651 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:20:00.610287 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2df58aab-ff2e-4d37-87f8-fb38b11756c0", "tag": "80dde595-a3d7-4c03-aa66-d9fc5b2f340c", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:20:00.610540 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-78de9aac-46ba-4e8d-9502-6ec328ffe651 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:20:00.610942 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2df58aab-ff2e-4d37-87f8-fb38b11756c0', 'tag': '80dde595-a3d7-4c03-aa66-d9fc5b2f340c', 'status': 'completed', 'code': 200} Dec 09 21:20:00.661822 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7428b67e-773c-4d8b-9c29-5df9c2b7f66f req-e6a140bd-e04d-418f-bf1f-f0bf7a35a843 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1333532 Dec 09 21:20:00.727303 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15ad9fce-0c4d-4071-81d0-75ff1f99f67e req-780fface-eb45-4560-af50-83a17a503d72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:00.729489 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15ad9fce-0c4d-4071-81d0-75ff1f99f67e req-780fface-eb45-4560-af50-83a17a503d72 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=615039519ef147c78eb38a1d65eac061&device_id=2df58aab-ff2e-4d37-87f8-fb38b11756c0 HTTP/1.1" status: 200 len: 1096 time: 0.1168323 Dec 09 21:20:00.755083 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d31ca126-b43d-48ef-8d41-c2fde201f77f req-bc8d6544-d638-4c12-9fae-18e2a9af0c13 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:00.759529 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d31ca126-b43d-48ef-8d41-c2fde201f77f req-bc8d6544-d638-4c12-9fae-18e2a9af0c13 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2df58aab-ff2e-4d37-87f8-fb38b11756c0 HTTP/1.1" status: 200 len: 944 time: 0.0842717 Dec 09 21:20:00.869133 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-0c2394a8-6286-4d09-825b-79522a7caa76 req-9438ec8b-e6b6-4584-ae58-8ab461a2f24b service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:20:00.870102 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c2394a8-6286-4d09-825b-79522a7caa76 req-9438ec8b-e6b6-4584-ae58-8ab461a2f24b service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0051928 Dec 09 21:20:00.949693 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d31ca126-b43d-48ef-8d41-c2fde201f77f req-fdb59a8d-82d1-4c60-b0e8-d147fd63bbc6 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1795349 Dec 09 21:20:00.999843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15ad9fce-0c4d-4071-81d0-75ff1f99f67e req-7043436a-f5de-4249-a565-24c4d3eaa764 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:01.017133 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15ad9fce-0c4d-4071-81d0-75ff1f99f67e req-7043436a-f5de-4249-a565-24c4d3eaa764 service neutron] 10.222.0.31 "GET /v2.0/networks?id=ce6b6bd1-6a60-4cea-9b70-69fd0290796c HTTP/1.1" status: 200 len: 923 time: 0.2743804 Dec 09 21:20:01.178333 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15ad9fce-0c4d-4071-81d0-75ff1f99f67e req-b0e47043-b154-427a-8e05-512d7929f781 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=80dde595-a3d7-4c03-aa66-d9fc5b2f340c HTTP/1.1" status: 200 len: 217 time: 0.1384201 Dec 09 21:20:01.254430 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-79455526-ff42-48d6-8a49-8535f710b40d req-5e25f363-b885-4f21-9e66-c3e4b38d34b2 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0981042 Dec 09 21:20:01.270852 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-79455526-ff42-48d6-8a49-8535f710b40d req-3aacff4b-33b7-4ab7-9e29-74948c4a27ad service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:20:01.284668 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-79455526-ff42-48d6-8a49-8535f710b40d req-3aacff4b-33b7-4ab7-9e29-74948c4a27ad service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0190673 Dec 09 21:20:01.553099 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15ad9fce-0c4d-4071-81d0-75ff1f99f67e req-6f3986b5-793d-44a9-9cd8-c1d397ab7831 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:01.555623 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15ad9fce-0c4d-4071-81d0-75ff1f99f67e req-6f3986b5-793d-44a9-9cd8-c1d397ab7831 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=9755e5ea-99a7-4073-8693-293dcc00b929 HTTP/1.1" status: 200 len: 861 time: 0.3808262 Dec 09 21:20:01.702325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f209d4a5-d38a-441c-8d3c-ea5a7dd38847 req-902c6fc2-7d7f-43f1-b5ce-79b4d2d6205b tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:01.705614 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f209d4a5-d38a-441c-8d3c-ea5a7dd38847 req-902c6fc2-7d7f-43f1-b5ce-79b4d2d6205b tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.10 "GET /v2.0/ports?device_id=8c21856f-2254-41e8-941c-2f4471714942 HTTP/1.1" status: 200 len: 948 time: 0.3133626 Dec 09 21:20:01.841773 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acf588eb-e1fb-43f3-a2fb-ed64fa037278 req-dd4cf122-1320-460e-bf5a-34e2cef0a8a5 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:01.850246 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-acf588eb-e1fb-43f3-a2fb-ed64fa037278 req-dd4cf122-1320-460e-bf5a-34e2cef0a8a5 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 950 time: 0.5764191 Dec 09 21:20:01.958116 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ffb219c6-483d-4cb8-ae97-97014ba52972 req-962432ac-e049-4a53-b3d5-554fca7b5470 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=ebcfc729-b616-4933-a43d-f707a862db78&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0989082 Dec 09 21:20:01.968276 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15ad9fce-0c4d-4071-81d0-75ff1f99f67e req-962016a9-90c5-493a-8db3-696103a14fb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:01.970354 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15ad9fce-0c4d-4071-81d0-75ff1f99f67e req-962016a9-90c5-493a-8db3-696103a14fb8 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ce6b6bd1-6a60-4cea-9b70-69fd0290796c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.3777573 Dec 09 21:20:02.173008 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffb219c6-483d-4cb8-ae97-97014ba52972 req-0267d8fb-4274-45b2-a223-432a4e669d7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:02.174577 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-acf588eb-e1fb-43f3-a2fb-ed64fa037278 req-3df02191-f7bf-40a0-89d5-bc2bdb68aabf tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3231015 Dec 09 21:20:02.177982 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ffb219c6-483d-4cb8-ae97-97014ba52972 req-0267d8fb-4274-45b2-a223-432a4e669d7c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6a32a636fa83452db185eb0152d6082d&device_id=ebcfc729-b616-4933-a43d-f707a862db78 HTTP/1.1" status: 200 len: 1102 time: 0.1453393 Dec 09 21:20:02.195664 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c979f75f-c644-4356-91da-0f5e22bf31ec req-b3bacf9f-7a51-420c-b739-ced695f6e357 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:02.209498 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c979f75f-c644-4356-91da-0f5e22bf31ec req-b3bacf9f-7a51-420c-b739-ced695f6e357 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a8ab99b-8927-4f89-9ef5-773ea7697c2b HTTP/1.1" status: 200 len: 950 time: 0.4034905 Dec 09 21:20:02.218931 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15ad9fce-0c4d-4071-81d0-75ff1f99f67e req-339dbcaf-e206-44fe-aa27-8dc848d29e77 service neutron] 10.222.0.31 "GET /v2.0/networks/ce6b6bd1-6a60-4cea-9b70-69fd0290796c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2050560 Dec 09 21:20:02.395538 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:20:02.413340 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c979f75f-c644-4356-91da-0f5e22bf31ec req-5577fc46-ec90-4be1-a2fb-2d8f3a3eb7b1 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/security-groups?id=3564cbaa-b044-4bce-988d-93357d77088a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1891327 Dec 09 21:20:02.581640 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffb219c6-483d-4cb8-ae97-97014ba52972 req-d54d807e-699b-4fc6-9c40-70ff58a6c395 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:02.596401 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ffb219c6-483d-4cb8-ae97-97014ba52972 req-d54d807e-699b-4fc6-9c40-70ff58a6c395 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.3596232 Dec 09 21:20:02.611895 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-f209d4a5-d38a-441c-8d3c-ea5a7dd38847 req-beeebc8f-d276-4b01-b28d-db59680d64a8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Deleting port 0fd74259-b2a4-42ff-b424-909c8f53a26a {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:20:02.611895 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f209d4a5-d38a-441c-8d3c-ea5a7dd38847 req-beeebc8f-d276-4b01-b28d-db59680d64a8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:02.821364 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ffb219c6-483d-4cb8-ae97-97014ba52972 req-a5899100-7339-422c-a0e2-14e0f8e0587a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.144&port_id=b75bad0f-5d42-4305-b970-f7b7298d2231 HTTP/1.1" status: 200 len: 217 time: 0.2213745 Dec 09 21:20:02.863196 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=84ad33bd-6ab4-41c4-91dc-7edb7fd59e12,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:02.894159 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '84ad33bd-6ab4-41c4-91dc-7edb7fd59e12', 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6', 'port_id': '84ad33bd-6ab4-41c4-91dc-7edb7fd59e12', 'mac_address': 'fa:16:3e:03:d1:de', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 122, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '63e7603a-bb11-4d1a-8d84-55456d81931c', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:20:02.985855 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-f209d4a5-d38a-441c-8d3c-ea5a7dd38847 req-beeebc8f-d276-4b01-b28d-db59680d64a8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] For port 0fd74259-b2a4-42ff-b424-909c8f53a26a, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=0fd74259-b2a4-42ff-b424-909c8f53a26a,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:02.989746 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f209d4a5-d38a-441c-8d3c-ea5a7dd38847 req-beeebc8f-d276-4b01-b28d-db59680d64a8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:03.019278 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffb219c6-483d-4cb8-ae97-97014ba52972 req-0accb0b1-efa8-4e15-9427-6b6b2d4154ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:03.027092 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ffb219c6-483d-4cb8-ae97-97014ba52972 req-0accb0b1-efa8-4e15-9427-6b6b2d4154ee service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1915972 Dec 09 21:20:03.032526 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-f209d4a5-d38a-441c-8d3c-ea5a7dd38847 req-beeebc8f-d276-4b01-b28d-db59680d64a8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Calling delete_port for 0fd74259-b2a4-42ff-b424-909c8f53a26a owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:20:03.032863 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:03.094301 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffb219c6-483d-4cb8-ae97-97014ba52972 req-ff33feb9-a906-4d30-8b5d-b3555fd82d6d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:03.096041 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ffb219c6-483d-4cb8-ae97-97014ba52972 req-ff33feb9-a906-4d30-8b5d-b3555fd82d6d service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0636706 Dec 09 21:20:03.097744 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:20:03.187886 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=84ad33bd-6ab4-41c4-91dc-7edb7fd59e12,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:03.212237 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:03.327164 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b75ae628-97a0-47b8-95bd-39ce70e77d50 req-763813b3-4cbe-429f-a7b4-2acc4b0f4943 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:03.329464 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b75ae628-97a0-47b8-95bd-39ce70e77d50 req-763813b3-4cbe-429f-a7b4-2acc4b0f4943 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.31 "GET /v2.0/ports?device_id=1a8ab99b-8927-4f89-9ef5-773ea7697c2b HTTP/1.1" status: 200 len: 950 time: 0.1765411 Dec 09 21:20:03.427819 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=84ad33bd-6ab4-41c4-91dc-7edb7fd59e12,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:03.447794 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['84ad33bd-6ab4-41c4-91dc-7edb7fd59e12'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:20:03.477910 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f62c709b-bba2-4ac5-ab96-d2a923def8e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:03.680915 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15ad9fce-0c4d-4071-81d0-75ff1f99f67e req-441a7386-476e-426d-9d79-d8698271f383 service neutron] 10.222.0.31 "GET /v2.0/networks/ce6b6bd1-6a60-4cea-9b70-69fd0290796c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.3274226 Dec 09 21:20:03.751728 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f209d4a5-d38a-441c-8d3c-ea5a7dd38847 req-beeebc8f-d276-4b01-b28d-db59680d64a8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:03.771073 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['0fd74259-b2a4-42ff-b424-909c8f53a26a', '1cc3b771-7d24-4dfa-bbfe-6e007094c74b'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:20:03.830330 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1339d884-ff1b-4477-b57f-84f05c3d9533 req-f8f4da01-238a-4d8f-bf16-59059fad3241 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:03.845888 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1339d884-ff1b-4477-b57f-84f05c3d9533 req-f8f4da01-238a-4d8f-bf16-59059fad3241 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=8c21856f-2254-41e8-941c-2f4471714942 HTTP/1.1" status: 200 len: 948 time: 1.4788036 Dec 09 21:20:04.010006 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ffb219c6-483d-4cb8-ae97-97014ba52972 req-caf3eca8-64b1-48af-8d52-b3a378d8bb65 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9018607 Dec 09 21:20:04.116093 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['b75bad0f-5d42-4305-b970-f7b7298d2231'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:20:04.171402 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3e3761c-4c5f-4388-9e70-cdd5020bd1bf req-63db6b82-287e-410d-8733-9a3fff2bf029 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:04.189084 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3e3761c-4c5f-4388-9e70-cdd5020bd1bf req-63db6b82-287e-410d-8733-9a3fff2bf029 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2df58aab-ff2e-4d37-87f8-fb38b11756c0 HTTP/1.1" status: 200 len: 944 time: 1.4284251 Dec 09 21:20:04.207425 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1339d884-ff1b-4477-b57f-84f05c3d9533 req-8286ccd3-75d2-4585-b660-25f0a3827fdf tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3587205 Dec 09 21:20:04.208343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-beeebc8f-d276-4b01-b28d-db59680d64a8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Pushing event deleted for resources: {'Port': ['ID=0fd74259-b2a4-42ff-b424-909c8f53a26a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:04.361842 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ffb219c6-483d-4cb8-ae97-97014ba52972 req-b98b8053-f18b-4458-93d3-305ae7d86023 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3186042 Dec 09 21:20:04.459960 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-b75ae628-97a0-47b8-95bd-39ce70e77d50 req-67dde433-5c71-4582-8533-d6db609baa14 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Deleting port 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:20:04.460307 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b75ae628-97a0-47b8-95bd-39ce70e77d50 req-67dde433-5c71-4582-8533-d6db609baa14 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:04.470219 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 80dde595-a3d7-4c03-aa66-d9fc5b2f340c details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:20:04.473093 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:20:04.546254 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-f209d4a5-d38a-441c-8d3c-ea5a7dd38847 req-beeebc8f-d276-4b01-b28d-db59680d64a8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] No DVR routers for this DVR port 0fd74259-b2a4-42ff-b424-909c8f53a26a on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:20:04.556959 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f209d4a5-d38a-441c-8d3c-ea5a7dd38847 req-beeebc8f-d276-4b01-b28d-db59680d64a8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:04.567512 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f209d4a5-d38a-441c-8d3c-ea5a7dd38847 req-beeebc8f-d276-4b01-b28d-db59680d64a8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.10 "DELETE /v2.0/ports/0fd74259-b2a4-42ff-b424-909c8f53a26a HTTP/1.1" status: 204 len: 173 time: 2.8468239 Dec 09 21:20:04.590255 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c2c8f5ab-7e21-466e-9f9d-4bacc89ea751 req-454839c4-768c-44fe-a779-26a6d8076089 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.8700407 Dec 09 21:20:04.591499 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8c21856f-2254-41e8-941c-2f4471714942', 'name': 'network-vif-deleted', 'tag': '0fd74259-b2a4-42ff-b424-909c8f53a26a'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:20:04.607475 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b021d907-91fc-4329-9c41-1972d1cc37e2" -d '{"events": [{"server_uuid": "8c21856f-2254-41e8-941c-2f4471714942", "name": "network-vif-deleted", "tag": "0fd74259-b2a4-42ff-b424-909c8f53a26a"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:20:04.720036 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-b75ae628-97a0-47b8-95bd-39ce70e77d50 req-67dde433-5c71-4582-8533-d6db609baa14 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] For port 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1c5817d2-0469-4f14-9ffd-a7e8649e3bb6,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:04.720395 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b75ae628-97a0-47b8-95bd-39ce70e77d50 req-67dde433-5c71-4582-8533-d6db609baa14 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:04.761055 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-b75ae628-97a0-47b8-95bd-39ce70e77d50 req-67dde433-5c71-4582-8533-d6db609baa14 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Calling delete_port for 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:20:05.041099 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b75ae628-97a0-47b8-95bd-39ce70e77d50 req-67dde433-5c71-4582-8533-d6db609baa14 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:05.058492 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.resource_extend [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] It took 0.16 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 09 21:20:05.240853 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-b75ae628-97a0-47b8-95bd-39ce70e77d50 req-67dde433-5c71-4582-8533-d6db609baa14 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] No DVR routers for this DVR port 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:20:05.245979 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67dde433-5c71-4582-8533-d6db609baa14 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Pushing event deleted for resources: {'Port': ['ID=1c5817d2-0469-4f14-9ffd-a7e8649e3bb6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:05.252055 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b75ae628-97a0-47b8-95bd-39ce70e77d50 req-67dde433-5c71-4582-8533-d6db609baa14 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:05.259493 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b75ae628-97a0-47b8-95bd-39ce70e77d50 req-67dde433-5c71-4582-8533-d6db609baa14 tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.31 "DELETE /v2.0/ports/1c5817d2-0469-4f14-9ffd-a7e8649e3bb6 HTTP/1.1" status: 204 len: 173 time: 1.9222932 Dec 09 21:20:05.264133 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1a8ab99b-8927-4f89-9ef5-773ea7697c2b', 'name': 'network-vif-deleted', 'tag': '1c5817d2-0469-4f14-9ffd-a7e8649e3bb6'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:20:05.270212 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1029d813-c769-46a4-a83f-77d0fa116d21" -d '{"events": [{"server_uuid": "1a8ab99b-8927-4f89-9ef5-773ea7697c2b", "name": "network-vif-deleted", "tag": "1c5817d2-0469-4f14-9ffd-a7e8649e3bb6"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:20:05.324621 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 80dde595-a3d7-4c03-aa66-d9fc5b2f340c, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=80dde595-a3d7-4c03-aa66-d9fc5b2f340c,segment=NetworkSegment(946d0405-6c7f-49a7-81bb-30e422c98100),segment_id=946d0405-6c7f-49a7-81bb-30e422c98100)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:05.339781 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '80dde595-a3d7-4c03-aa66-d9fc5b2f340c', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'port_id': '80dde595-a3d7-4c03-aa66-d9fc5b2f340c', 'mac_address': 'fa:16:3e:9f:fa:07', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 141, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:20:05.379342 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79455526-ff42-48d6-8a49-8535f710b40d req-0148e851-0c2d-4383-8756-eca0bc98a39d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:05.382129 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-79455526-ff42-48d6-8a49-8535f710b40d req-0148e851-0c2d-4383-8756-eca0bc98a39d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 1102 time: 1.2519600 Dec 09 21:20:05.390370 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3e3761c-4c5f-4388-9e70-cdd5020bd1bf req-4e7a1a67-d4df-4d5e-ada7-b3adef34f43a tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 1.2003505 Dec 09 21:20:05.428293 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:05.428678 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:05.478008 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2c8f5ab-7e21-466e-9f9d-4bacc89ea751 req-83fe2de1-9a25-4875-9c61-baca4c595636 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:05.482053 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c2c8f5ab-7e21-466e-9f9d-4bacc89ea751 req-83fe2de1-9a25-4875-9c61-baca4c595636 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=6a32a636fa83452db185eb0152d6082d&device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 1103 time: 0.8495333 Dec 09 21:20:05.567682 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e56c0550-3522-4c48-9b10-25bc17661b47 req-890c0dfb-77db-4254-a92e-ca12bbd3d5c3 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:05.575782 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e56c0550-3522-4c48-9b10-25bc17661b47 req-890c0dfb-77db-4254-a92e-ca12bbd3d5c3 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 950 time: 0.6941116 Dec 09 21:20:05.591660 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:05.629516 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-05857091-a963-4518-a608-8920c037f9c6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:05.675522 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 80dde595-a3d7-4c03-aa66-d9fc5b2f340c {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:20:05.829344 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 80dde595-a3d7-4c03-aa66-d9fc5b2f340c, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=80dde595-a3d7-4c03-aa66-d9fc5b2f340c,segment=NetworkSegment(946d0405-6c7f-49a7-81bb-30e422c98100),segment_id=946d0405-6c7f-49a7-81bb-30e422c98100)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:05.835159 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e56c0550-3522-4c48-9b10-25bc17661b47 req-52fa1b99-f13f-4577-8798-5b2c962d615a tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2580943 Dec 09 21:20:05.861683 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:05.880131 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['1c5817d2-0469-4f14-9ffd-a7e8649e3bb6'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:20:05.995311 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:06.004234 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79455526-ff42-48d6-8a49-8535f710b40d req-80cd11cf-d1ae-49c2-93e6-ec16524f1a3e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:06.008895 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-79455526-ff42-48d6-8a49-8535f710b40d req-80cd11cf-d1ae-49c2-93e6-ec16524f1a3e service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.6038828 Dec 09 21:20:06.011933 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:20:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9471d389-0d08-4723-8e7b-4793049dddae x-openstack-request-id: req-9471d389-0d08-4723-8e7b-4793049dddae {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:20:06.012228 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8c21856f-2254-41e8-941c-2f4471714942", "name": "network-vif-deleted", "tag": "0fd74259-b2a4-42ff-b424-909c8f53a26a", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:20:06.012498 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-9471d389-0d08-4723-8e7b-4793049dddae {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:20:06.015798 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8c21856f-2254-41e8-941c-2f4471714942', 'name': 'network-vif-deleted', 'tag': '0fd74259-b2a4-42ff-b424-909c8f53a26a', 'status': 'completed', 'code': 200} Dec 09 21:20:06.040479 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-55b55d86-5097-49d0-8835-786e0f2ba299 req-42a1990c-9096-49f7-8a70-a529fb536dbe tempest-TenantUsagesTestJSON-1522084432 tempest-TenantUsagesTestJSON-1522084432-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a8ab99b-8927-4f89-9ef5-773ea7697c2b HTTP/1.1" status: 200 len: 210 time: 0.1820505 Dec 09 21:20:06.052929 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'eac884a1-b960-4dfb-9337-7c68c9f0acca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '84ad33bd-6ab4-41c4-91dc-7edb7fd59e12'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:20:06.057812 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-acd304a0-607c-458e-8b82-d22d40defb37" -d '{"events": [{"server_uuid": "eac884a1-b960-4dfb-9337-7c68c9f0acca", "name": "network-vif-plugged", "status": "completed", "tag": "84ad33bd-6ab4-41c4-91dc-7edb7fd59e12"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:20:06.157099 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=84ad33bd-6ab4-41c4-91dc-7edb7fd59e12,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:06.181018 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:06.197028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=80dde595-a3d7-4c03-aa66-d9fc5b2f340c,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:06.239582 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:20:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e1ba293a-979b-475d-bfcb-153f8704865f x-openstack-request-id: req-e1ba293a-979b-475d-bfcb-153f8704865f {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:20:06.240134 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1a8ab99b-8927-4f89-9ef5-773ea7697c2b", "name": "network-vif-deleted", "tag": "1c5817d2-0469-4f14-9ffd-a7e8649e3bb6", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:20:06.240259 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e1ba293a-979b-475d-bfcb-153f8704865f {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:20:06.240853 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1a8ab99b-8927-4f89-9ef5-773ea7697c2b', 'name': 'network-vif-deleted', 'tag': '1c5817d2-0469-4f14-9ffd-a7e8649e3bb6', 'status': 'completed', 'code': 200} Dec 09 21:20:06.321825 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['80dde595-a3d7-4c03-aa66-d9fc5b2f340c'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:20:06.381610 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2c8f5ab-7e21-466e-9f9d-4bacc89ea751 req-6fdf3cf3-f7c9-493e-8489-69e0e4e1c70c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:06.383751 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c2c8f5ab-7e21-466e-9f9d-4bacc89ea751 req-6fdf3cf3-f7c9-493e-8489-69e0e4e1c70c service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.7002981 Dec 09 21:20:06.386323 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-79455526-ff42-48d6-8a49-8535f710b40d req-f14a7520-3930-496d-8537-6bae098bdb6d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.140&port_id=36925110-4ed7-49f6-b07d-d998896a74cc HTTP/1.1" status: 200 len: 217 time: 0.3410892 Dec 09 21:20:06.395317 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:20:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4c607fdc-f91a-4cae-9b4d-ea49aaff9707 x-openstack-request-id: req-4c607fdc-f91a-4cae-9b4d-ea49aaff9707 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:20:06.398805 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "eac884a1-b960-4dfb-9337-7c68c9f0acca", "name": "network-vif-plugged", "status": "completed", "tag": "84ad33bd-6ab4-41c4-91dc-7edb7fd59e12", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:20:06.400011 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-4c607fdc-f91a-4cae-9b4d-ea49aaff9707 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:20:06.400595 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'eac884a1-b960-4dfb-9337-7c68c9f0acca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '84ad33bd-6ab4-41c4-91dc-7edb7fd59e12', 'code': 200} Dec 09 21:20:06.416396 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 0fd74259-b2a4-42ff-b424-909c8f53a26a no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:20:06.432378 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:20:06.501607 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c2c8f5ab-7e21-466e-9f9d-4bacc89ea751 req-c9c76cea-c4cd-4c70-a00c-7683dbcd97d7 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.203&port_id=1cc3b771-7d24-4dfa-bbfe-6e007094c74b HTTP/1.1" status: 200 len: 217 time: 0.1060741 Dec 09 21:20:06.527729 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79455526-ff42-48d6-8a49-8535f710b40d req-39d1bb7e-2ef1-4f6d-9b32-fea9b596d7a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:06.529642 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-79455526-ff42-48d6-8a49-8535f710b40d req-39d1bb7e-2ef1-4f6d-9b32-fea9b596d7a9 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1274426 Dec 09 21:20:06.608530 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:20:06.609911 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1c5817d2-0469-4f14-9ffd-a7e8649e3bb6 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:20:06.611732 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 0fd74259-b2a4-42ff-b424-909c8f53a26a {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:20:06.614734 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 0fd74259-b2a4-42ff-b424-909c8f53a26a not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:20:06.650435 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=84ad33bd-6ab4-41c4-91dc-7edb7fd59e12,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:06.658900 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:06.713037 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2c8f5ab-7e21-466e-9f9d-4bacc89ea751 req-5f077f33-c325-4d7d-9dc5-1f33cf151c9e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:06.714835 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c2c8f5ab-7e21-466e-9f9d-4bacc89ea751 req-5f077f33-c325-4d7d-9dc5-1f33cf151c9e service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1833556 Dec 09 21:20:06.718775 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79455526-ff42-48d6-8a49-8535f710b40d req-41ff06df-0287-4108-b376-3468a774a30c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:06.720527 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-79455526-ff42-48d6-8a49-8535f710b40d req-41ff06df-0287-4108-b376-3468a774a30c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1460967 Dec 09 21:20:06.920980 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-79455526-ff42-48d6-8a49-8535f710b40d req-57b68036-39ab-4f71-a1c9-e46837e291dc service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1799679 Dec 09 21:20:07.104776 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-79455526-ff42-48d6-8a49-8535f710b40d req-1bc17420-e37a-4586-9ab7-0b938942f3aa service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1588001 Dec 09 21:20:07.158418 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2c8f5ab-7e21-466e-9f9d-4bacc89ea751 req-b32b7e12-bc92-45ca-9c1a-95194573856b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:07.159968 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c2c8f5ab-7e21-466e-9f9d-4bacc89ea751 req-b32b7e12-bc92-45ca-9c1a-95194573856b service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.4343615 Dec 09 21:20:07.741338 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94695a7e-11e4-4250-9246-c20296f720ff req-9871b64b-897b-4e9b-84dc-0ae393430644 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:07.752504 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94695a7e-11e4-4250-9246-c20296f720ff req-9871b64b-897b-4e9b-84dc-0ae393430644 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2df58aab-ff2e-4d37-87f8-fb38b11756c0 HTTP/1.1" status: 200 len: 945 time: 0.8080404 Dec 09 21:20:07.839193 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:07.861141 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94695a7e-11e4-4250-9246-c20296f720ff req-926e6f7b-d92e-4984-ae4a-102ca79ce950 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1072264 Dec 09 21:20:07.928947 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c2c8f5ab-7e21-466e-9f9d-4bacc89ea751 req-074a516d-d2e4-4655-85ad-e110bb454118 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7589121 Dec 09 21:20:08.147583 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c2c8f5ab-7e21-466e-9f9d-4bacc89ea751 req-3ef29397-ce38-4272-9df1-b669d2367c76 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2073712 Dec 09 21:20:08.300680 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caeb251c-e818-4ff8-ae0e-972c434c1770 req-eb58f0a8-aab5-4748-a270-f98ded088f8b tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:08.312345 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-caeb251c-e818-4ff8-ae0e-972c434c1770 req-eb58f0a8-aab5-4748-a270-f98ded088f8b tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebcfc729-b616-4933-a43d-f707a862db78 HTTP/1.1" status: 200 len: 950 time: 0.1637237 Dec 09 21:20:08.418073 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 80dde595-a3d7-4c03-aa66-d9fc5b2f340c up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:20:08.434758 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-caeb251c-e818-4ff8-ae0e-972c434c1770 req-3b2119f7-074e-474e-bbbe-fbffc20b9635 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1211982 Dec 09 21:20:08.548268 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 80dde595-a3d7-4c03-aa66-d9fc5b2f340c completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:20:08.553947 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 80dde595-a3d7-4c03-aa66-d9fc5b2f340c triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:08.554578 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:08.560654 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25c829a3-77b3-4396-9f3e-8517433f4936 req-096dd5a5-b810-4f30-91ce-80eeca32892a tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:08.562541 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25c829a3-77b3-4396-9f3e-8517433f4936 req-096dd5a5-b810-4f30-91ce-80eeca32892a tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.31 "GET /v2.0/ports?device_id=ebcfc729-b616-4933-a43d-f707a862db78 HTTP/1.1" status: 200 len: 950 time: 0.1139615 Dec 09 21:20:08.685596 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:08.714067 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2df58aab-ff2e-4d37-87f8-fb38b11756c0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '80dde595-a3d7-4c03-aa66-d9fc5b2f340c'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:20:08.725174 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1035dc2d-7948-42f6-9760-94b9afdd7547" -d '{"events": [{"server_uuid": "2df58aab-ff2e-4d37-87f8-fb38b11756c0", "name": "network-vif-plugged", "status": "completed", "tag": "80dde595-a3d7-4c03-aa66-d9fc5b2f340c"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:20:08.745152 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 80dde595-a3d7-4c03-aa66-d9fc5b2f340c, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=80dde595-a3d7-4c03-aa66-d9fc5b2f340c,segment=NetworkSegment(946d0405-6c7f-49a7-81bb-30e422c98100),segment_id=946d0405-6c7f-49a7-81bb-30e422c98100)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:08.754906 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:08.806453 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49f9feb0-afc0-4e2e-8f04-7692bfd6db96 req-ebe761da-39d1-494b-b7d0-f4f6eccb22e8 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:08.815307 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-49f9feb0-afc0-4e2e-8f04-7692bfd6db96 req-ebe761da-39d1-494b-b7d0-f4f6eccb22e8 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 950 time: 0.1357563 Dec 09 21:20:08.863367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=80dde595-a3d7-4c03-aa66-d9fc5b2f340c,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:08.876363 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-49f9feb0-afc0-4e2e-8f04-7692bfd6db96 req-f15d703e-7258-4222-ab16-b9631090e1b0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0600874 Dec 09 21:20:08.917389 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-25c829a3-77b3-4396-9f3e-8517433f4936 req-90ce77a9-7f2d-4215-a49e-a9a3685fbc8d tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Deleting port b75bad0f-5d42-4305-b970-f7b7298d2231 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:20:08.923650 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-25c829a3-77b3-4396-9f3e-8517433f4936 req-90ce77a9-7f2d-4215-a49e-a9a3685fbc8d tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:09.094740 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-25c829a3-77b3-4396-9f3e-8517433f4936 req-90ce77a9-7f2d-4215-a49e-a9a3685fbc8d tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] For port b75bad0f-5d42-4305-b970-f7b7298d2231, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b75bad0f-5d42-4305-b970-f7b7298d2231,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:09.095278 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-25c829a3-77b3-4396-9f3e-8517433f4936 req-90ce77a9-7f2d-4215-a49e-a9a3685fbc8d tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:09.114332 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-25c829a3-77b3-4396-9f3e-8517433f4936 req-90ce77a9-7f2d-4215-a49e-a9a3685fbc8d tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Calling delete_port for b75bad0f-5d42-4305-b970-f7b7298d2231 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:20:09.283329 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:09.452467 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-25c829a3-77b3-4396-9f3e-8517433f4936 req-90ce77a9-7f2d-4215-a49e-a9a3685fbc8d tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:09.465954 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['1cc3b771-7d24-4dfa-bbfe-6e007094c74b'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:20:09.545704 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['b75bad0f-5d42-4305-b970-f7b7298d2231'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:20:09.577965 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90ce77a9-7f2d-4215-a49e-a9a3685fbc8d tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Pushing event deleted for resources: {'Port': ['ID=b75bad0f-5d42-4305-b970-f7b7298d2231,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:09.614587 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58314) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:09.704976 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-25c829a3-77b3-4396-9f3e-8517433f4936 req-90ce77a9-7f2d-4215-a49e-a9a3685fbc8d tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] No DVR routers for this DVR port b75bad0f-5d42-4305-b970-f7b7298d2231 on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:20:09.708130 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-25c829a3-77b3-4396-9f3e-8517433f4936 req-90ce77a9-7f2d-4215-a49e-a9a3685fbc8d tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:09.712669 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25c829a3-77b3-4396-9f3e-8517433f4936 req-90ce77a9-7f2d-4215-a49e-a9a3685fbc8d tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.31 "DELETE /v2.0/ports/b75bad0f-5d42-4305-b970-f7b7298d2231 HTTP/1.1" status: 204 len: 173 time: 1.1380348 Dec 09 21:20:09.713148 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ebcfc729-b616-4933-a43d-f707a862db78', 'name': 'network-vif-deleted', 'tag': 'b75bad0f-5d42-4305-b970-f7b7298d2231'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:20:09.715451 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c2ea4df3-daac-4e17-b5e7-465d6f7ef629" -d '{"events": [{"server_uuid": "ebcfc729-b616-4933-a43d-f707a862db78", "name": "network-vif-deleted", "tag": "b75bad0f-5d42-4305-b970-f7b7298d2231"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:20:10.094911 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f1122b34-5d51-4d07-b7ce-2097e7a7ca0f admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=669b986126134ec0a75d9f954a17ffa1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4775040 Dec 09 21:20:10.097300 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58330) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:10.246925 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ca4e1056-1ab7-45f1-bc6a-605c23acc1d8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:10.366690 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ca4e1056-1ab7-45f1-bc6a-605c23acc1d8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:10.506871 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:20:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2cf7f7c2-7487-4542-8dfb-11c10877d4f9 x-openstack-request-id: req-2cf7f7c2-7487-4542-8dfb-11c10877d4f9 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:20:10.508760 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2df58aab-ff2e-4d37-87f8-fb38b11756c0", "name": "network-vif-plugged", "status": "completed", "tag": "80dde595-a3d7-4c03-aa66-d9fc5b2f340c", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:20:10.509258 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-2cf7f7c2-7487-4542-8dfb-11c10877d4f9 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:20:10.509378 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ca4e1056-1ab7-45f1-bc6a-605c23acc1d8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:10.510117 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2df58aab-ff2e-4d37-87f8-fb38b11756c0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '80dde595-a3d7-4c03-aa66-d9fc5b2f340c', 'code': 200} Dec 09 21:20:10.517528 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ca4e1056-1ab7-45f1-bc6a-605c23acc1d8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:10.524585 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ca4e1056-1ab7-45f1-bc6a-605c23acc1d8 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/3564cbaa-b044-4bce-988d-93357d77088a HTTP/1.1" status: 204 len: 168 time: 0.4259231 Dec 09 21:20:10.556880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca4e1056-1ab7-45f1-bc6a-605c23acc1d8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3564cbaa-b044-4bce-988d-93357d77088a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:10.785623 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-821718f8-c9b2-4ef8-b6dd-c2ebdddfcd3b req-cbaf4cd7-aaaa-42d4-8181-039392b6792e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:10.796459 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-821718f8-c9b2-4ef8-b6dd-c2ebdddfcd3b req-cbaf4cd7-aaaa-42d4-8181-039392b6792e service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=2df58aab-ff2e-4d37-87f8-fb38b11756c0 HTTP/1.1" status: 200 len: 1098 time: 0.1355338 Dec 09 21:20:10.848708 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-256a73b3-e84d-4869-80fa-26bff25b7d6e req-b32ec6f1-ed27-42d1-8d49-8e91ced5cd43 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:10.851678 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-256a73b3-e84d-4869-80fa-26bff25b7d6e req-b32ec6f1-ed27-42d1-8d49-8e91ced5cd43 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2df58aab-ff2e-4d37-87f8-fb38b11756c0 HTTP/1.1" status: 200 len: 946 time: 0.2171657 Dec 09 21:20:10.996099 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-821718f8-c9b2-4ef8-b6dd-c2ebdddfcd3b req-21bd43c4-3f69-4cce-b60e-a14564e4d59c service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1992507 Dec 09 21:20:11.102373 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-256a73b3-e84d-4869-80fa-26bff25b7d6e req-e69f8a4b-abe8-48f0-aa17-0a6ef4eae96b tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2338364 Dec 09 21:20:11.340980 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:20:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f829910e-ac04-42e1-a50e-31aa0217db60 x-openstack-request-id: req-f829910e-ac04-42e1-a50e-31aa0217db60 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:20:11.341305 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ebcfc729-b616-4933-a43d-f707a862db78", "name": "network-vif-deleted", "tag": "b75bad0f-5d42-4305-b970-f7b7298d2231", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:20:11.341563 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f829910e-ac04-42e1-a50e-31aa0217db60 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:20:11.342086 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ebcfc729-b616-4933-a43d-f707a862db78', 'name': 'network-vif-deleted', 'tag': 'b75bad0f-5d42-4305-b970-f7b7298d2231', 'status': 'completed', 'code': 200} Dec 09 21:20:11.532738 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58348) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:11.556654 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ac9a815-95d6-4f46-bb6c-d7c22a902e8a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:11.659122 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f154f21-2fad-4f0f-b912-2e5667e5ab33 req-6c9d0d89-aa73-4819-a3ff-dddb59c8f59a tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:11.673823 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f154f21-2fad-4f0f-b912-2e5667e5ab33 req-6c9d0d89-aa73-4819-a3ff-dddb59c8f59a tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 950 time: 0.1172402 Dec 09 21:20:11.692811 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ac9a815-95d6-4f46-bb6c-d7c22a902e8a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:11.705746 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ac9a815-95d6-4f46-bb6c-d7c22a902e8a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:11.783011 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f154f21-2fad-4f0f-b912-2e5667e5ab33 req-860883ad-902e-4353-8d55-4efe1b8ac965 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1019773 Dec 09 21:20:11.810121 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ac9a815-95d6-4f46-bb6c-d7c22a902e8a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3a4f72d8-17d3-43df-808f-88c290f64f32,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:11.896543 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3ac9a815-95d6-4f46-bb6c-d7c22a902e8a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=8a1c1b023d484573946cba38827f9362&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3613594 Dec 09 21:20:11.898438 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58358) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:12.003310 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0fba33e4-2189-4f1e-960d-558f89d5505a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:12.098310 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0fba33e4-2189-4f1e-960d-558f89d5505a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:12.266709 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0fba33e4-2189-4f1e-960d-558f89d5505a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:12.270783 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0fba33e4-2189-4f1e-960d-558f89d5505a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:12.272149 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0fba33e4-2189-4f1e-960d-558f89d5505a admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/3a4f72d8-17d3-43df-808f-88c290f64f32 HTTP/1.1" status: 204 len: 168 time: 0.3725491 Dec 09 21:20:12.285107 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fba33e4-2189-4f1e-960d-558f89d5505a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3a4f72d8-17d3-43df-808f-88c290f64f32,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:12.397745 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5391236-0901-476f-babf-b3fa9b08fb2d req-9ad39224-24e0-41ea-90fc-690a74d4e896 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:12.401391 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5391236-0901-476f-babf-b3fa9b08fb2d req-9ad39224-24e0-41ea-90fc-690a74d4e896 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2df58aab-ff2e-4d37-87f8-fb38b11756c0 HTTP/1.1" status: 200 len: 946 time: 0.1681855 Dec 09 21:20:12.427471 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device b75bad0f-5d42-4305-b970-f7b7298d2231 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:20:12.471189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: b75bad0f-5d42-4305-b970-f7b7298d2231 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:20:12.471823 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device b75bad0f-5d42-4305-b970-f7b7298d2231 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:20:12.555034 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5391236-0901-476f-babf-b3fa9b08fb2d req-6c6c1ad1-ace9-4424-81ad-b3f54a7f8546 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1475708 Dec 09 21:20:12.758045 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fe40c42-9f9b-4bf0-9cea-8c9e13301a9c req-32ad4dc5-37fd-494b-af3a-c26a739b7e11 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:12.769017 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fe40c42-9f9b-4bf0-9cea-8c9e13301a9c req-32ad4dc5-37fd-494b-af3a-c26a739b7e11 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 951 time: 0.0974615 Dec 09 21:20:12.856984 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fe40c42-9f9b-4bf0-9cea-8c9e13301a9c req-0c3d3842-00b8-4deb-9164-d77c9fecbd03 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0860584 Dec 09 21:20:12.976439 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec304a02-ca96-41ad-b616-7ad46908f448 req-763cc60a-a290-42fc-8438-b16f86f184a5 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:12.992494 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec304a02-ca96-41ad-b616-7ad46908f448 req-763cc60a-a290-42fc-8438-b16f86f184a5 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 950 time: 0.0714743 Dec 09 21:20:13.085339 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec304a02-ca96-41ad-b616-7ad46908f448 req-308f6269-f705-4da1-92e4-da22368a1d9f tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0918906 Dec 09 21:20:13.874604 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e27b137f-0e7c-4e28-a135-62ca68151dbd req-b8bfb470-1c14-4b5f-b44b-7080fc712f46 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:13.887124 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e27b137f-0e7c-4e28-a135-62ca68151dbd req-b8bfb470-1c14-4b5f-b44b-7080fc712f46 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.10 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 951 time: 0.2486129 Dec 09 21:20:14.106693 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c236ea31-41e0-4227-91e6-48e1808a8aed req-eebaaf48-772d-4f88-9651-77fe8e951fc5 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:14.119313 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c236ea31-41e0-4227-91e6-48e1808a8aed req-eebaaf48-772d-4f88-9651-77fe8e951fc5 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2df58aab-ff2e-4d37-87f8-fb38b11756c0 HTTP/1.1" status: 200 len: 946 time: 0.4052675 Dec 09 21:20:14.247602 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-e27b137f-0e7c-4e28-a135-62ca68151dbd req-57c764b2-81f8-49be-ac94-8ed01c59be77 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Deleting port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:20:14.248305 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e27b137f-0e7c-4e28-a135-62ca68151dbd req-57c764b2-81f8-49be-ac94-8ed01c59be77 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:14.300124 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c236ea31-41e0-4227-91e6-48e1808a8aed req-11975445-9e92-40a9-b596-bbab872911ee tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1746805 Dec 09 21:20:14.502411 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-e27b137f-0e7c-4e28-a135-62ca68151dbd req-57c764b2-81f8-49be-ac94-8ed01c59be77 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] For port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1cc3b771-7d24-4dfa-bbfe-6e007094c74b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:14.503397 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e27b137f-0e7c-4e28-a135-62ca68151dbd req-57c764b2-81f8-49be-ac94-8ed01c59be77 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:14.536592 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-e27b137f-0e7c-4e28-a135-62ca68151dbd req-57c764b2-81f8-49be-ac94-8ed01c59be77 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Calling delete_port for 1cc3b771-7d24-4dfa-bbfe-6e007094c74b owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:20:14.938076 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af73e448-56f1-4507-b246-fc0a5524a87b req-5b65e66c-59aa-4b0e-a23e-6c194272e4f8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:14.946641 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af73e448-56f1-4507-b246-fc0a5524a87b req-5b65e66c-59aa-4b0e-a23e-6c194272e4f8 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/ports?device_id=51e11d39-964b-458f-b5dc-fb020eb2c5f5 HTTP/1.1" status: 200 len: 951 time: 0.2022276 Dec 09 21:20:14.954261 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e27b137f-0e7c-4e28-a135-62ca68151dbd req-57c764b2-81f8-49be-ac94-8ed01c59be77 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:14.969954 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['1cc3b771-7d24-4dfa-bbfe-6e007094c74b'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:20:15.059013 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57c764b2-81f8-49be-ac94-8ed01c59be77 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Pushing event deleted for resources: {'Port': ['ID=1cc3b771-7d24-4dfa-bbfe-6e007094c74b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:15.163371 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af73e448-56f1-4507-b246-fc0a5524a87b req-d79ff26c-e199-4491-848f-72350fbe699f tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.13 "GET /v2.0/security-groups?id=3de26898-1613-497e-9444-0b50b43b6cf8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2157114 Dec 09 21:20:15.202773 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58402) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:15.250471 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-e27b137f-0e7c-4e28-a135-62ca68151dbd req-57c764b2-81f8-49be-ac94-8ed01c59be77 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] No DVR routers for this DVR port 1cc3b771-7d24-4dfa-bbfe-6e007094c74b on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:20:15.267893 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e27b137f-0e7c-4e28-a135-62ca68151dbd req-57c764b2-81f8-49be-ac94-8ed01c59be77 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:15.285664 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e27b137f-0e7c-4e28-a135-62ca68151dbd req-57c764b2-81f8-49be-ac94-8ed01c59be77 tempest-ServersAdminTestJSON-809478495 tempest-ServersAdminTestJSON-809478495-project] 10.222.0.10 "DELETE /v2.0/ports/1cc3b771-7d24-4dfa-bbfe-6e007094c74b HTTP/1.1" status: 204 len: 173 time: 1.3893175 Dec 09 21:20:15.286112 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '51e11d39-964b-458f-b5dc-fb020eb2c5f5', 'name': 'network-vif-deleted', 'tag': '1cc3b771-7d24-4dfa-bbfe-6e007094c74b'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:20:15.292971 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-77392ae7-cb8e-470e-8621-b887e41dc92f" -d '{"events": [{"server_uuid": "51e11d39-964b-458f-b5dc-fb020eb2c5f5", "name": "network-vif-deleted", "tag": "1cc3b771-7d24-4dfa-bbfe-6e007094c74b"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:20:15.499934 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbdfb812-b62b-4f1c-a149-7dbd5390f62d req-11abe640-4799-4157-84bc-dc36343cc982 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:15.504790 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bbdfb812-b62b-4f1c-a149-7dbd5390f62d req-11abe640-4799-4157-84bc-dc36343cc982 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 950 time: 0.1478617 Dec 09 21:20:15.540674 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-43239c55-bf6d-4865-bdb3-9d76e53efbb0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:15.679357 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bbdfb812-b62b-4f1c-a149-7dbd5390f62d req-91d2910e-d299-4feb-b012-2afc73fe6d6b tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1657798 Dec 09 21:20:15.858867 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-43239c55-bf6d-4865-bdb3-9d76e53efbb0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:15.873586 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-43239c55-bf6d-4865-bdb3-9d76e53efbb0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:15.913399 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c44b1f8-8153-438f-b689-e0d5e03cab95 req-21e747f1-96fa-40ac-b067-7d56204a36de tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:15.928100 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c44b1f8-8153-438f-b689-e0d5e03cab95 req-21e747f1-96fa-40ac-b067-7d56204a36de tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2df58aab-ff2e-4d37-87f8-fb38b11756c0 HTTP/1.1" status: 200 len: 946 time: 0.0923009 Dec 09 21:20:15.930416 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58410) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:15.942758 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-b7e20d42-93a7-48be-9b60-301866f46b47 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Request body: {'floatingip': {'port_id': '80dde595-a3d7-4c03-aa66-d9fc5b2f340c'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:15.965864 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43239c55-bf6d-4865-bdb3-9d76e53efbb0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=329a1fd6-71c8-47f3-a20f-f470edc59764,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:16.015074 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:20:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c2adb25b-e866-448c-a2e6-691846bf0a26 x-openstack-request-id: req-c2adb25b-e866-448c-a2e6-691846bf0a26 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:20:16.015368 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "51e11d39-964b-458f-b5dc-fb020eb2c5f5", "name": "network-vif-deleted", "tag": "1cc3b771-7d24-4dfa-bbfe-6e007094c74b", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:20:16.015741 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c2adb25b-e866-448c-a2e6-691846bf0a26 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:20:16.016147 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '51e11d39-964b-458f-b5dc-fb020eb2c5f5', 'name': 'network-vif-deleted', 'tag': '1cc3b771-7d24-4dfa-bbfe-6e007094c74b', 'status': 'completed', 'code': 200} Dec 09 21:20:16.040996 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7e20d42-93a7-48be-9b60-301866f46b47 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for floatingip, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:16.049541 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-43239c55-bf6d-4865-bdb3-9d76e53efbb0 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=a87098a3ea964c7ab644904a566699b4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8420124 Dec 09 21:20:16.052149 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58412) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:16.137912 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a0c69ff-562d-4915-a4ba-fa14661fcac6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:16.239877 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a0c69ff-562d-4915-a4ba-fa14661fcac6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:16.353700 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a0c69ff-562d-4915-a4ba-fa14661fcac6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:16.356348 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a0c69ff-562d-4915-a4ba-fa14661fcac6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:16.375970 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8a0c69ff-562d-4915-a4ba-fa14661fcac6 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/329a1fd6-71c8-47f3-a20f-f470edc59764 HTTP/1.1" status: 204 len: 168 time: 0.3058972 Dec 09 21:20:16.397346 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a0c69ff-562d-4915-a4ba-fa14661fcac6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=329a1fd6-71c8-47f3-a20f-f470edc59764,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:16.820694 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58430) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:16.893467 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7e20d42-93a7-48be-9b60-301866f46b47 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:16.929219 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7e20d42-93a7-48be-9b60-301866f46b47 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:17.013205 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c53135af-a319-4a64-b73b-8b55b6440c07 req-20245bd4-1739-4c95-b0da-1dc8c76022d0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:17.019687 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c53135af-a319-4a64-b73b-8b55b6440c07 req-20245bd4-1739-4c95-b0da-1dc8c76022d0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 950 time: 0.1237347 Dec 09 21:20:17.087093 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c53135af-a319-4a64-b73b-8b55b6440c07 req-116969e0-d05c-412e-b32b-4fd2201bf79c tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0643060 Dec 09 21:20:17.192401 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-b7e20d42-93a7-48be-9b60-301866f46b47 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Floating IP 607e8ba4-01a4-4741-a885-8732f6aacd9f associated. External IP: 172.25.3.108, port: 80dde595-a3d7-4c03-aa66-d9fc5b2f340c. Dec 09 21:20:17.267685 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bd173de0-e62f-4287-9e64-6d6752f9bb2f admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=6a32a636fa83452db185eb0152d6082d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4452186 Dec 09 21:20:17.268259 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58442) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:17.383876 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-537cd941-776b-4eab-b15e-a0f66ae00219 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:17.496393 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-537cd941-776b-4eab-b15e-a0f66ae00219 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:17.664539 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-537cd941-776b-4eab-b15e-a0f66ae00219 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:17.667258 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b7e20d42-93a7-48be-9b60-301866f46b47 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Router 3b833388-9a85-4de2-9ce7-fd22b400c313 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:20:17.668418 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-537cd941-776b-4eab-b15e-a0f66ae00219 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:17.670041 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-537cd941-776b-4eab-b15e-a0f66ae00219 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/3de26898-1613-497e-9444-0b50b43b6cf8 HTTP/1.1" status: 204 len: 168 time: 0.4004891 Dec 09 21:20:17.686791 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-537cd941-776b-4eab-b15e-a0f66ae00219 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3de26898-1613-497e-9444-0b50b43b6cf8,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:17.719801 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537cd941-776b-4eab-b15e-a0f66ae00219 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:17.720207 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537cd941-776b-4eab-b15e-a0f66ae00219 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:17.720556 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537cd941-776b-4eab-b15e-a0f66ae00219 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:17.720902 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537cd941-776b-4eab-b15e-a0f66ae00219 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:17.721240 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537cd941-776b-4eab-b15e-a0f66ae00219 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:17.721575 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537cd941-776b-4eab-b15e-a0f66ae00219 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:17.726592 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537cd941-776b-4eab-b15e-a0f66ae00219 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:17.726953 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537cd941-776b-4eab-b15e-a0f66ae00219 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:17.727304 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537cd941-776b-4eab-b15e-a0f66ae00219 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:17.728820 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537cd941-776b-4eab-b15e-a0f66ae00219 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:17.729175 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537cd941-776b-4eab-b15e-a0f66ae00219 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:17.729520 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537cd941-776b-4eab-b15e-a0f66ae00219 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:17.729859 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-537cd941-776b-4eab-b15e-a0f66ae00219 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:18.019963 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58460) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:18.071263 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b7e20d42-93a7-48be-9b60-301866f46b47 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:20:18.089204 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed3c4471-0d34-48df-8802-08a51b563ce9 None None] Sync routers for ids ['3b833388-9a85-4de2-9ce7-fd22b400c313'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:20:18.126768 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7e20d42-93a7-48be-9b60-301866f46b47 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:18.163284 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed3c4471-0d34-48df-8802-08a51b563ce9 None None] Routers {'3b833388-9a85-4de2-9ce7-fd22b400c313'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:20:18.167980 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-ed3c4471-0d34-48df-8802-08a51b563ce9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:20:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3b833388-9a85-4de2-9ce7-fd22b400c313'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:18.220713 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58466) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:18.274001 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b7e20d42-93a7-48be-9b60-301866f46b47 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "PUT /v2.0/floatingips/607e8ba4-01a4-4741-a885-8732f6aacd9f HTTP/1.1" status: 200 len: 992 time: 2.3422873 Dec 09 21:20:18.280077 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2df58aab-ff2e-4d37-87f8-fb38b11756c0', 'tag': '80dde595-a3d7-4c03-aa66-d9fc5b2f340c'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:20:18.285921 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c5d738db-8f97-4e27-8998-960a6d2a80d1" -d '{"events": [{"name": "network-changed", "server_uuid": "2df58aab-ff2e-4d37-87f8-fb38b11756c0", "tag": "80dde595-a3d7-4c03-aa66-d9fc5b2f340c"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:20:18.349320 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3d10b1c0-490c-4890-ba5e-d79782906273 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=fc6055b5c94b449eac052a871204bc9d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1248412 Dec 09 21:20:18.351576 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58472) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:18.425695 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02675952-56ce-4a9c-b438-cbc2b9ba6822 req-0951af99-156e-46c7-a1cc-c3b4cdea9985 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:18.440651 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1cc3b771-7d24-4dfa-bbfe-6e007094c74b no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:20:18.448820 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02675952-56ce-4a9c-b438-cbc2b9ba6822 req-0951af99-156e-46c7-a1cc-c3b4cdea9985 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 950 time: 0.1496401 Dec 09 21:20:18.479216 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 1cc3b771-7d24-4dfa-bbfe-6e007094c74b {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:20:18.480084 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1cc3b771-7d24-4dfa-bbfe-6e007094c74b not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:20:18.490701 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-21383e26-01b9-4ad1-b214-cfeff0c77428 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:18.542800 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-ed3c4471-0d34-48df-8802-08a51b563ce9 None None] Set router 3b833388-9a85-4de2-9ce7-fd22b400c313 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:20:18.545329 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-21383e26-01b9-4ad1-b214-cfeff0c77428 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:18.611095 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02675952-56ce-4a9c-b438-cbc2b9ba6822 req-734bcbee-377b-4661-9616-c8f29b5ee68e tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1609716 Dec 09 21:20:18.641267 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-21383e26-01b9-4ad1-b214-cfeff0c77428 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:18.644509 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-21383e26-01b9-4ad1-b214-cfeff0c77428 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:18.648568 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-21383e26-01b9-4ad1-b214-cfeff0c77428 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/85968342-4a71-4b1b-a267-865ecfb988e1 HTTP/1.1" status: 204 len: 168 time: 0.2959018 Dec 09 21:20:18.660487 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21383e26-01b9-4ad1-b214-cfeff0c77428 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=85968342-4a71-4b1b-a267-865ecfb988e1,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:18.805593 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-327ddde1-6ab5-4cf9-aa8b-e4e2248de261 admin admin] Request body: {'network': {'name': 'tempest-SecurityGroupRulesTestJSON-914958266-network', 'tenant_id': 'e025a7c9b8e843eeb18b06f2f222f6fc'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:18.874298 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-327ddde1-6ab5-4cf9-aa8b-e4e2248de261 admin admin] Made reservation on behalf of e025a7c9b8e843eeb18b06f2f222f6fc for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:20:18.876990 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-327ddde1-6ab5-4cf9-aa8b-e4e2248de261 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:18.906840 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-327ddde1-6ab5-4cf9-aa8b-e4e2248de261 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:18.957405 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:20:19.000701 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:20:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0f1f9d09-e6e3-4c01-a961-2a034235c29b x-openstack-request-id: req-0f1f9d09-e6e3-4c01-a961-2a034235c29b {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:20:19.001238 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2df58aab-ff2e-4d37-87f8-fb38b11756c0", "tag": "80dde595-a3d7-4c03-aa66-d9fc5b2f340c", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:20:19.001683 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0f1f9d09-e6e3-4c01-a961-2a034235c29b {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:20:19.002280 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2df58aab-ff2e-4d37-87f8-fb38b11756c0', 'tag': '80dde595-a3d7-4c03-aa66-d9fc5b2f340c', 'status': 'completed', 'code': 200} Dec 09 21:20:19.102682 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-327ddde1-6ab5-4cf9-aa8b-e4e2248de261 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:19.114966 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-327ddde1-6ab5-4cf9-aa8b-e4e2248de261 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:19.146409 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5d738db-8f97-4e27-8998-960a6d2a80d1 req-3c0437a0-2e7e-4466-8411-9166829449b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:19.156180 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c5d738db-8f97-4e27-8998-960a6d2a80d1 req-3c0437a0-2e7e-4466-8411-9166829449b9 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=615039519ef147c78eb38a1d65eac061&device_id=2df58aab-ff2e-4d37-87f8-fb38b11756c0 HTTP/1.1" status: 200 len: 1098 time: 0.1341579 Dec 09 21:20:19.171481 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-327ddde1-6ab5-4cf9-aa8b-e4e2248de261 admin admin] vlan segment allocate from pool success with {'vlan_id': 142, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:20:19.234183 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-327ddde1-6ab5-4cf9-aa8b-e4e2248de261 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=07ef3f3f-76b2-4d39-8035-da97760a9b14,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:19.246955 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-327ddde1-6ab5-4cf9-aa8b-e4e2248de261 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:19.255324 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-327ddde1-6ab5-4cf9-aa8b-e4e2248de261 admin admin] Added segment b70f29bc-4beb-48f2-8103-60378159b4bc of type vlan for network 876ab953-3db4-46d2-9330-49972e15ea26 Dec 09 21:20:19.379503 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-327ddde1-6ab5-4cf9-aa8b-e4e2248de261 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:19.420107 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5d738db-8f97-4e27-8998-960a6d2a80d1 req-873aad5d-a4ad-4985-8a58-13f8dc8c9bfa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:19.431035 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c5d738db-8f97-4e27-8998-960a6d2a80d1 req-873aad5d-a4ad-4985-8a58-13f8dc8c9bfa service neutron] 10.222.0.31 "GET /v2.0/networks?id=ce6b6bd1-6a60-4cea-9b70-69fd0290796c HTTP/1.1" status: 200 len: 923 time: 0.2586253 Dec 09 21:20:19.480925 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-327ddde1-6ab5-4cf9-aa8b-e4e2248de261 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:19.482247 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-327ddde1-6ab5-4cf9-aa8b-e4e2248de261 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:19.483371 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-327ddde1-6ab5-4cf9-aa8b-e4e2248de261 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:19.531029 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-ed3c4471-0d34-48df-8802-08a51b563ce9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-85948487-router', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54'}], 'enable_snat': True}, 'gw_port_id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:12Z', 'updated_at': '2021-12-09T21:17:16Z', 'revision_number': 4, 'project_id': '615039519ef147c78eb38a1d65eac061', 'gw_port': {'id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:32:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:13Z', 'updated_at': '2021-12-09T21:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '607e8ba4-01a4-4741-a885-8732f6aacd9f', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'floating_ip_address': '172.25.3.108', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'port_id': '80dde595-a3d7-4c03-aa66-d9fc5b2f340c', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 112, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'mac_address': 'fa:16:3e:9f:fa:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2df58aab-ff2e-4d37-87f8-fb38b11756c0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:17:30Z', 'updated_at': '2021-12-09T21:20:16Z', 'revision_number': 5, 'project_id': '615039519ef147c78eb38a1d65eac061', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f50209a6-36fd-4aea-927f-b79127351066', 'name': '', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'mac_address': 'fa:16:3e:bd:0e:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:15Z', 'updated_at': '2021-12-09T21:17:21Z', 'revision_number': 5, 'project_id': '615039519ef147c78eb38a1d65eac061', 'subnets': [{'id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:19.570334 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c5d738db-8f97-4e27-8998-960a6d2a80d1 req-e3ed7d84-3a0a-4cfb-ad3c-6936553c843a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=80dde595-a3d7-4c03-aa66-d9fc5b2f340c HTTP/1.1" status: 200 len: 1000 time: 0.1314068 Dec 09 21:20:19.653241 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed3c4471-0d34-48df-8802-08a51b563ce9 None None] Checking router: 3b833388-9a85-4de2-9ce7-fd22b400c313 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:20:19.655211 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-327ddde1-6ab5-4cf9-aa8b-e4e2248de261 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 1.6340384 Dec 09 21:20:19.655916 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58484) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:19.674317 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed3c4471-0d34-48df-8802-08a51b563ce9 None None] Routers {'3b833388-9a85-4de2-9ce7-fd22b400c313'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:20:19.675370 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-ed3c4471-0d34-48df-8802-08a51b563ce9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:20:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3b833388-9a85-4de2-9ce7-fd22b400c313'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:19.682558 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-e9edc5a5-d1f3-43be-92d4-45df5695b84c admin admin] Request body: {'subnet': {'network_id': '876ab953-3db4-46d2-9330-49972e15ea26', 'cidr': '172.20.0.0/28', 'name': 'tempest-SecurityGroupRulesTestJSON-914958266-subnet', 'tenant_id': 'e025a7c9b8e843eeb18b06f2f222f6fc', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:19.727942 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5d738db-8f97-4e27-8998-960a6d2a80d1 req-abaf11ee-bae9-4237-8267-ffcd6225f7ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:19.727942 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c5d738db-8f97-4e27-8998-960a6d2a80d1 req-abaf11ee-bae9-4237-8267-ffcd6225f7ba service neutron] 10.222.0.31 "GET /v2.0/subnets?id=9755e5ea-99a7-4073-8693-293dcc00b929 HTTP/1.1" status: 200 len: 861 time: 0.1489215 Dec 09 21:20:19.780449 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-327ddde1-6ab5-4cf9-aa8b-e4e2248de261 admin admin] Pushing event updated for resources: {'Network': ['ID=876ab953-3db4-46d2-9330-49972e15ea26,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:19.813250 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e9edc5a5-d1f3-43be-92d4-45df5695b84c admin admin] Made reservation on behalf of e025a7c9b8e843eeb18b06f2f222f6fc for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:20:19.816010 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 876ab953-3db4-46d2-9330-49972e15ea26 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:20:19.816798 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9edc5a5-d1f3-43be-92d4-45df5695b84c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:19.949633 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6cee801-fe47-440d-ab96-f7040cdeb6ce req-132577c0-caba-45a3-b0ff-d6a5ff08d274 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:19.964862 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6cee801-fe47-440d-ab96-f7040cdeb6ce req-132577c0-caba-45a3-b0ff-d6a5ff08d274 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 950 time: 0.1818371 Dec 09 21:20:19.977186 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5d738db-8f97-4e27-8998-960a6d2a80d1 req-ca7402f6-eea9-45fa-a263-bbe2149e18f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:19.978967 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c5d738db-8f97-4e27-8998-960a6d2a80d1 req-ca7402f6-eea9-45fa-a263-bbe2149e18f1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ce6b6bd1-6a60-4cea-9b70-69fd0290796c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2430575 Dec 09 21:20:20.016967 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-ed3c4471-0d34-48df-8802-08a51b563ce9 None None] Set router 3b833388-9a85-4de2-9ce7-fd22b400c313 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:20:20.245473 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9edc5a5-d1f3-43be-92d4-45df5695b84c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:20.268989 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6cee801-fe47-440d-ab96-f7040cdeb6ce req-aad87fbb-b537-4322-94f5-0c53daaf5445 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3014219 Dec 09 21:20:20.351278 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c5d738db-8f97-4e27-8998-960a6d2a80d1 req-07fe1847-d75f-488b-963d-341374a37ca7 service neutron] 10.222.0.31 "GET /v2.0/networks/ce6b6bd1-6a60-4cea-9b70-69fd0290796c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3604360 Dec 09 21:20:20.411681 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9edc5a5-d1f3-43be-92d4-45df5695b84c admin admin] Checking segment: {'id': 'b70f29bc-4beb-48f2-8103-60378159b4bc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '876ab953-3db4-46d2-9330-49972e15ea26'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:20:20.412297 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9edc5a5-d1f3-43be-92d4-45df5695b84c admin admin] Network hostable DHCP agents. Network: 876ab953-3db4-46d2-9330-49972e15ea26, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:20:20.457353 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9edc5a5-d1f3-43be-92d4-45df5695b84c admin admin] Pushing event updated for resources: {'Subnet': ['ID=14f445fe-22fb-4d4f-9165-d9c08a7d0946,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:20.480009 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9edc5a5-d1f3-43be-92d4-45df5695b84c admin admin] Network 876ab953-3db4-46d2-9330-49972e15ea26 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:20:20.497222 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-e9edc5a5-d1f3-43be-92d4-45df5695b84c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 876ab953-3db4-46d2-9330-49972e15ea26) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:20:20.502737 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e9edc5a5-d1f3-43be-92d4-45df5695b84c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:20.503430 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9edc5a5-d1f3-43be-92d4-45df5695b84c admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:20.508249 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8856e572-3a83-4f0f-8ae2-c2814e797940 None None] Network 876ab953-3db4-46d2-9330-49972e15ea26 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:20:20.542947 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e9edc5a5-d1f3-43be-92d4-45df5695b84c admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 0.8746898 Dec 09 21:20:20.581444 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c5d738db-8f97-4e27-8998-960a6d2a80d1 req-340484b4-6910-49ef-976c-dc9d06f92626 service neutron] 10.222.0.31 "GET /v2.0/networks/ce6b6bd1-6a60-4cea-9b70-69fd0290796c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2197108 Dec 09 21:20:20.932117 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-ed3c4471-0d34-48df-8802-08a51b563ce9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-85948487-router', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54'}], 'enable_snat': True}, 'gw_port_id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:12Z', 'updated_at': '2021-12-09T21:17:16Z', 'revision_number': 4, 'project_id': '615039519ef147c78eb38a1d65eac061', 'gw_port': {'id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:32:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:13Z', 'updated_at': '2021-12-09T21:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '607e8ba4-01a4-4741-a885-8732f6aacd9f', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'floating_ip_address': '172.25.3.108', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'port_id': '80dde595-a3d7-4c03-aa66-d9fc5b2f340c', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 112, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'mac_address': 'fa:16:3e:9f:fa:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2df58aab-ff2e-4d37-87f8-fb38b11756c0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:17:30Z', 'updated_at': '2021-12-09T21:20:16Z', 'revision_number': 5, 'project_id': '615039519ef147c78eb38a1d65eac061', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f50209a6-36fd-4aea-927f-b79127351066', 'name': '', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'mac_address': 'fa:16:3e:bd:0e:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:15Z', 'updated_at': '2021-12-09T21:17:21Z', 'revision_number': 5, 'project_id': '615039519ef147c78eb38a1d65eac061', 'subnets': [{'id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:21.067063 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed3c4471-0d34-48df-8802-08a51b563ce9 None None] The sync data for ids ['3b833388-9a85-4de2-9ce7-fd22b400c313'] in n-d-713301-27 is: [{'id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-85948487-router', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54'}], 'enable_snat': True}, 'gw_port_id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:12Z', 'updated_at': '2021-12-09T21:17:16Z', 'revision_number': 4, 'project_id': '615039519ef147c78eb38a1d65eac061', 'gw_port': {'id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:32:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:13Z', 'updated_at': '2021-12-09T21:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '607e8ba4-01a4-4741-a885-8732f6aacd9f', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'floating_ip_address': '172.25.3.108', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'port_id': '80dde595-a3d7-4c03-aa66-d9fc5b2f340c', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 112, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'mac_address': 'fa:16:3e:9f:fa:07', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2df58aab-ff2e-4d37-87f8-fb38b11756c0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:17:30Z', 'updated_at': '2021-12-09T21:20:16Z', 'revision_number': 5, 'project_id': '615039519ef147c78eb38a1d65eac061', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f50209a6-36fd-4aea-927f-b79127351066', 'name': '', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'mac_address': 'fa:16:3e:bd:0e:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:15Z', 'updated_at': '2021-12-09T21:17:21Z', 'revision_number': 5, 'project_id': '615039519ef147c78eb38a1d65eac061', 'subnets': [{'id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:20:21.270289 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0c6958b1-1c51-44b2-bb7f-d070f913580f None None] Network 876ab953-3db4-46d2-9330-49972e15ea26 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:20:21.468237 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-ae7fe144-7bb6-4e00-b700-3de700fd0d2f req-321d1990-1699-44e7-b097-bd79536063cd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesTestJSON-securitygroup-1460492087', 'description': 'tempest-description-889727609'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:21.537707 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae7fe144-7bb6-4e00-b700-3de700fd0d2f req-321d1990-1699-44e7-b097-bd79536063cd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:21.575711 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c35b26f3-95a0-43ed-8993-adad7766b2b7 None None] New status for floating IP 607e8ba4-01a4-4741-a885-8732f6aacd9f: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:20:21.667042 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae7fe144-7bb6-4e00-b700-3de700fd0d2f req-321d1990-1699-44e7-b097-bd79536063cd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:21.680420 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae7fe144-7bb6-4e00-b700-3de700fd0d2f req-321d1990-1699-44e7-b097-bd79536063cd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:21.745105 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae7fe144-7bb6-4e00-b700-3de700fd0d2f req-321d1990-1699-44e7-b097-bd79536063cd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:21.752112 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae7fe144-7bb6-4e00-b700-3de700fd0d2f req-321d1990-1699-44e7-b097-bd79536063cd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1826 time: 0.2915411 Dec 09 21:20:21.811171 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-321d1990-1699-44e7-b097-bd79536063cd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8e5e855e-c31f-46ae-b20b-fc5e1c98740c,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:21.839913 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-321d1990-1699-44e7-b097-bd79536063cd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:21.840823 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-321d1990-1699-44e7-b097-bd79536063cd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:21.841505 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-321d1990-1699-44e7-b097-bd79536063cd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:21.842068 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-321d1990-1699-44e7-b097-bd79536063cd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:21.842633 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-321d1990-1699-44e7-b097-bd79536063cd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:21.843182 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-321d1990-1699-44e7-b097-bd79536063cd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:21.843773 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-321d1990-1699-44e7-b097-bd79536063cd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:21.844345 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-321d1990-1699-44e7-b097-bd79536063cd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:21.844891 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-321d1990-1699-44e7-b097-bd79536063cd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:21.845442 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-321d1990-1699-44e7-b097-bd79536063cd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:21.846004 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-321d1990-1699-44e7-b097-bd79536063cd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:21.846541 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-321d1990-1699-44e7-b097-bd79536063cd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:21.847077 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-321d1990-1699-44e7-b097-bd79536063cd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:21.996450 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d80b0f36-782d-47f4-9985-847e866ffd1c req-79bb114f-7bf5-45f1-a07e-dc1be07a6c88 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:21.998301 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d80b0f36-782d-47f4-9985-847e866ffd1c req-79bb114f-7bf5-45f1-a07e-dc1be07a6c88 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 950 time: 0.0979471 Dec 09 21:20:22.102444 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d80b0f36-782d-47f4-9985-847e866ffd1c req-64bd105d-a7fb-44cc-9066-eaefee7ceea9 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0940130 Dec 09 21:20:22.323269 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98b4c7ab-4255-4d4d-b542-7dd8ba3da47d req-b2939223-1906-427b-8f6f-b9bbd19d440f tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "GET /v2.0/security-groups/8e5e855e-c31f-46ae-b20b-fc5e1c98740c HTTP/1.1" status: 200 len: 1821 time: 0.0617950 Dec 09 21:20:22.329148 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-98b4c7ab-4255-4d4d-b542-7dd8ba3da47d req-c7582b45-ca0d-4185-8750-c2614c7082e6 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Request body: {'security_group_rules': [{'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': '8e5e855e-c31f-46ae-b20b-fc5e1c98740c', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}]} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:22.329945 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-98b4c7ab-4255-4d4d-b542-7dd8ba3da47d req-c7582b45-ca0d-4185-8750-c2614c7082e6 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Request body: {'security_group_rule': {'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': '8e5e855e-c31f-46ae-b20b-fc5e1c98740c', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:22.438409 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-98b4c7ab-4255-4d4d-b542-7dd8ba3da47d req-c7582b45-ca0d-4185-8750-c2614c7082e6 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:22.550682 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-98b4c7ab-4255-4d4d-b542-7dd8ba3da47d req-c7582b45-ca0d-4185-8750-c2614c7082e6 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:22.570555 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-98b4c7ab-4255-4d4d-b542-7dd8ba3da47d req-c7582b45-ca0d-4185-8750-c2614c7082e6 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:22.608667 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7582b45-ca0d-4185-8750-c2614c7082e6 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e42a2d19-143a-4144-a8a0-5b6b12462302,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:22.627076 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-98b4c7ab-4255-4d4d-b542-7dd8ba3da47d req-c7582b45-ca0d-4185-8750-c2614c7082e6 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:22.637523 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98b4c7ab-4255-4d4d-b542-7dd8ba3da47d req-c7582b45-ca0d-4185-8750-c2614c7082e6 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 0.3081493 Dec 09 21:20:22.940978 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-815ca354-5db4-489c-9d3c-a4d397c8c2c8 req-8c16b752-1803-4f7b-add0-467715f79b5b tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesTestJSON-securitygroup-1742523195', 'description': 'tempest-description-1727249853'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:22.978279 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-815ca354-5db4-489c-9d3c-a4d397c8c2c8 req-8c16b752-1803-4f7b-add0-467715f79b5b tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:23.069485 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-815ca354-5db4-489c-9d3c-a4d397c8c2c8 req-8c16b752-1803-4f7b-add0-467715f79b5b tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:23.077831 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-815ca354-5db4-489c-9d3c-a4d397c8c2c8 req-8c16b752-1803-4f7b-add0-467715f79b5b tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:23.130625 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-815ca354-5db4-489c-9d3c-a4d397c8c2c8 req-8c16b752-1803-4f7b-add0-467715f79b5b tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:23.133218 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-815ca354-5db4-489c-9d3c-a4d397c8c2c8 req-8c16b752-1803-4f7b-add0-467715f79b5b tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1827 time: 0.1968486 Dec 09 21:20:23.176809 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c16b752-1803-4f7b-add0-467715f79b5b tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6fd2cf2d-4873-49e5-a2ac-07e9dfe556d1,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:23.430566 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8fb9512-b35d-4812-9260-3257f86b56c5 req-4f6d14b0-5346-458a-bb13-afbd3e3a5d5e tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:23.432261 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c8fb9512-b35d-4812-9260-3257f86b56c5 req-4f6d14b0-5346-458a-bb13-afbd3e3a5d5e tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 950 time: 0.1017802 Dec 09 21:20:23.491508 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c8fb9512-b35d-4812-9260-3257f86b56c5 req-6e0a4e77-acda-4f73-922b-e18734ccb774 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0515449 Dec 09 21:20:23.577925 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-65aa31b1-2760-4d84-92bc-fbdeabfe078e req-9f6031ec-d777-4c1f-a6f1-1488d83102a1 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "GET /v2.0/security-groups/6fd2cf2d-4873-49e5-a2ac-07e9dfe556d1 HTTP/1.1" status: 200 len: 1822 time: 0.0488503 Dec 09 21:20:23.583185 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-65aa31b1-2760-4d84-92bc-fbdeabfe078e req-48c53127-7c9b-4a23-afc2-59ffef26878d tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Request body: {'security_group_rules': [{'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '10.2.3.124/24', 'security_group_id': '6fd2cf2d-4873-49e5-a2ac-07e9dfe556d1', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}]} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:23.583627 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-65aa31b1-2760-4d84-92bc-fbdeabfe078e req-48c53127-7c9b-4a23-afc2-59ffef26878d tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Request body: {'security_group_rule': {'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '10.2.3.124/24', 'security_group_id': '6fd2cf2d-4873-49e5-a2ac-07e9dfe556d1', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:23.650053 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-65aa31b1-2760-4d84-92bc-fbdeabfe078e req-48c53127-7c9b-4a23-afc2-59ffef26878d tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:23.695165 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-65aa31b1-2760-4d84-92bc-fbdeabfe078e req-48c53127-7c9b-4a23-afc2-59ffef26878d tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:23.702556 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-65aa31b1-2760-4d84-92bc-fbdeabfe078e req-48c53127-7c9b-4a23-afc2-59ffef26878d tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:23.727132 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c53127-7c9b-4a23-afc2-59ffef26878d tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=04788acd-fc3e-43f2-9343-30aa2b75209d,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:23.738943 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-65aa31b1-2760-4d84-92bc-fbdeabfe078e req-48c53127-7c9b-4a23-afc2-59ffef26878d tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:23.752032 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-65aa31b1-2760-4d84-92bc-fbdeabfe078e req-48c53127-7c9b-4a23-afc2-59ffef26878d tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 792 time: 0.1731234 Dec 09 21:20:23.832039 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-19be0da0-a854-4f13-a1da-0e3c5184aaa9 req-be3ece47-68ff-415c-921e-670b6ff8e675 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesTestJSON-securitygroup-1428090365', 'description': 'tempest-description-1860596499'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:23.871070 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-19be0da0-a854-4f13-a1da-0e3c5184aaa9 req-be3ece47-68ff-415c-921e-670b6ff8e675 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:23.961802 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-19be0da0-a854-4f13-a1da-0e3c5184aaa9 req-be3ece47-68ff-415c-921e-670b6ff8e675 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:23.976250 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-19be0da0-a854-4f13-a1da-0e3c5184aaa9 req-be3ece47-68ff-415c-921e-670b6ff8e675 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:24.003693 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-19be0da0-a854-4f13-a1da-0e3c5184aaa9 req-be3ece47-68ff-415c-921e-670b6ff8e675 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:24.004947 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19be0da0-a854-4f13-a1da-0e3c5184aaa9 req-be3ece47-68ff-415c-921e-670b6ff8e675 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1827 time: 0.1772614 Dec 09 21:20:24.036052 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be3ece47-68ff-415c-921e-670b6ff8e675 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0e5e71a8-eae0-4fdc-9e1b-5c8cb776ae60,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:24.112160 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-53411efa-743b-4aac-813c-4008fb725ed0 req-20946097-5791-493c-a1b2-b938fc825c6b tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesTestJSON-securitygroup-1848590912', 'description': 'tempest-description-566426393'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:24.146678 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-53411efa-743b-4aac-813c-4008fb725ed0 req-20946097-5791-493c-a1b2-b938fc825c6b tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:24.602644 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-53411efa-743b-4aac-813c-4008fb725ed0 req-20946097-5791-493c-a1b2-b938fc825c6b tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:24.609624 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-53411efa-743b-4aac-813c-4008fb725ed0 req-20946097-5791-493c-a1b2-b938fc825c6b tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:24.647606 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-53411efa-743b-4aac-813c-4008fb725ed0 req-20946097-5791-493c-a1b2-b938fc825c6b tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:24.655999 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-53411efa-743b-4aac-813c-4008fb725ed0 req-20946097-5791-493c-a1b2-b938fc825c6b tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1826 time: 0.5486190 Dec 09 21:20:24.658384 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20946097-5791-493c-a1b2-b938fc825c6b tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Pushing event updated for resources: {'SecurityGroup': ['ID=16a7305d-f042-4f37-93cc-e29aad98055c,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:24.839988 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c7cb672-567e-4a16-b523-cc554e140506 req-54fe1504-f8d1-4446-819a-997ed6aa598e tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:24.841568 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c7cb672-567e-4a16-b523-cc554e140506 req-54fe1504-f8d1-4446-819a-997ed6aa598e tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 950 time: 0.0544500 Dec 09 21:20:24.917580 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c7cb672-567e-4a16-b523-cc554e140506 req-4a1cd976-730e-4afe-9574-65e859fe1fec tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0684834 Dec 09 21:20:24.920379 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b4590d8-94ba-412c-a63e-1d78a15668f9 req-8d46766a-aabe-47c4-97eb-33aa5b46b609 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "GET /v2.0/security-groups/0e5e71a8-eae0-4fdc-9e1b-5c8cb776ae60 HTTP/1.1" status: 200 len: 1822 time: 0.0652590 Dec 09 21:20:24.972137 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b4590d8-94ba-412c-a63e-1d78a15668f9 req-09641466-7426-44be-a759-e7979da2b419 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "GET /v2.0/security-groups/16a7305d-f042-4f37-93cc-e29aad98055c HTTP/1.1" status: 200 len: 1821 time: 0.0446219 Dec 09 21:20:24.984299 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-7b4590d8-94ba-412c-a63e-1d78a15668f9 req-17b14cbc-9e28-44d0-8797-733da3ee2b0f tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Request body: {'security_group_rules': [{'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': None, 'security_group_id': '0e5e71a8-eae0-4fdc-9e1b-5c8cb776ae60', 'remote_group_id': '16a7305d-f042-4f37-93cc-e29aad98055c', 'port_range_min': 22, 'port_range_max': 22}]} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:24.984612 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-7b4590d8-94ba-412c-a63e-1d78a15668f9 req-17b14cbc-9e28-44d0-8797-733da3ee2b0f tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Request body: {'security_group_rule': {'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': None, 'security_group_id': '0e5e71a8-eae0-4fdc-9e1b-5c8cb776ae60', 'remote_group_id': '16a7305d-f042-4f37-93cc-e29aad98055c', 'port_range_min': 22, 'port_range_max': 22}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:25.062777 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7b4590d8-94ba-412c-a63e-1d78a15668f9 req-17b14cbc-9e28-44d0-8797-733da3ee2b0f tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:25.112639 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7b4590d8-94ba-412c-a63e-1d78a15668f9 req-17b14cbc-9e28-44d0-8797-733da3ee2b0f tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:25.119557 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7b4590d8-94ba-412c-a63e-1d78a15668f9 req-17b14cbc-9e28-44d0-8797-733da3ee2b0f tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:25.145268 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17b14cbc-9e28-44d0-8797-733da3ee2b0f tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=12c242eb-8948-4db5-9f29-fdb4a421e9f5,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:25.152902 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7b4590d8-94ba-412c-a63e-1d78a15668f9 req-17b14cbc-9e28-44d0-8797-733da3ee2b0f tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:25.154485 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b4590d8-94ba-412c-a63e-1d78a15668f9 req-17b14cbc-9e28-44d0-8797-733da3ee2b0f tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 806 time: 0.1747680 Dec 09 21:20:25.355250 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-8e5b3177-9d2f-4172-b5fd-20f44bf3c952 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:25.356974 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-8e5b3177-9d2f-4172-b5fd-20f44bf3c952 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/networks?id=1444d8a7-187f-473b-be08-dce40f6ae8ea HTTP/1.1" status: 200 len: 815 time: 0.1440718 Dec 09 21:20:25.396356 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-e4ef84dd-a401-4960-aed9-1f0407c96d59 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/quotas/913fcb9b5aab4356999ade167d5148c6 HTTP/1.1" status: 200 len: 375 time: 0.0267169 Dec 09 21:20:25.497590 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-8cf4b911-a270-4549-a1fd-ea9505cca0a8 req-ea5e3bf8-7045-4a67-8358-71765dac30f6 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesTestJSON-securitygroup-1241019162', 'description': 'tempest-description-169135819'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:25.513603 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-1bb19abf-ab3c-4ef3-92de-99afe61de355 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=913fcb9b5aab4356999ade167d5148c6&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1089287 Dec 09 21:20:25.544051 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58676) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:25.564966 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8cf4b911-a270-4549-a1fd-ea9505cca0a8 req-ea5e3bf8-7045-4a67-8358-71765dac30f6 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:25.651593 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-babd60e6-875b-4e72-93c4-ee966fe5d191 service neutron] 10.222.0.13 "GET /v2.0/networks/1444d8a7-187f-473b-be08-dce40f6ae8ea?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1283729 Dec 09 21:20:25.712526 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8cf4b911-a270-4549-a1fd-ea9505cca0a8 req-ea5e3bf8-7045-4a67-8358-71765dac30f6 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:25.728689 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-37777738-957a-4c0c-be21-1a5e8f8c5585 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:25.737160 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8cf4b911-a270-4549-a1fd-ea9505cca0a8 req-ea5e3bf8-7045-4a67-8358-71765dac30f6 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:25.783274 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8cf4b911-a270-4549-a1fd-ea9505cca0a8 req-ea5e3bf8-7045-4a67-8358-71765dac30f6 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:25.784528 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8cf4b911-a270-4549-a1fd-ea9505cca0a8 req-ea5e3bf8-7045-4a67-8358-71765dac30f6 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1826 time: 0.2923222 Dec 09 21:20:25.788490 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea5e3bf8-7045-4a67-8358-71765dac30f6 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Pushing event updated for resources: {'SecurityGroup': ['ID=202ae0e3-f7fd-460c-9e6d-273d51a2135a,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:25.814529 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-c456e5d9-ddc1-463a-afc0-82585a717baf service neutron] 10.222.0.13 "GET /v2.0/networks/1444d8a7-187f-473b-be08-dce40f6ae8ea?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1556444 Dec 09 21:20:25.833381 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-37777738-957a-4c0c-be21-1a5e8f8c5585 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:25.847635 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-37777738-957a-4c0c-be21-1a5e8f8c5585 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:25.901493 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-37777738-957a-4c0c-be21-1a5e8f8c5585 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=66d398a80b714f86bd8dcb1c4a79f4ce&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3562641 Dec 09 21:20:25.902688 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37777738-957a-4c0c-be21-1a5e8f8c5585 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d19ec679-8245-4e57-9701-ceb83543269c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:25.904832 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58690) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:25.983595 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-aad92223-5435-4b1b-b76a-a054e8eaf2f1 req-786dab22-ca70-490b-8b96-2629b45916ce tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesTestJSON-securitygroup-4649651', 'description': 'tempest-description-794740439'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:26.070734 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d55c7486-f238-4f72-a6be-8596834736b4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:26.086810 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-aad92223-5435-4b1b-b76a-a054e8eaf2f1 req-786dab22-ca70-490b-8b96-2629b45916ce tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:26.118969 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-f56ce5c8-bc97-4823-8ef5-1a3cfbdbd994 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:26.120489 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-f56ce5c8-bc97-4823-8ef5-1a3cfbdbd994 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/networks?id=8e0b26d7-eefe-4c85-b535-944f3c15f0f6 HTTP/1.1" status: 200 len: 805 time: 0.1890600 Dec 09 21:20:26.124436 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d55c7486-f238-4f72-a6be-8596834736b4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:26.162023 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-db16e7e8-7f23-4baa-8768-b6b42686d823 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/quotas/7233ac85d55e4123a22cfa34bc1ee70e HTTP/1.1" status: 200 len: 375 time: 0.0296974 Dec 09 21:20:26.272708 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-df7f2f44-3637-41b5-a0c1-9a9ca8412774 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=7233ac85d55e4123a22cfa34bc1ee70e&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1030457 Dec 09 21:20:26.273391 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d55c7486-f238-4f72-a6be-8596834736b4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:26.277795 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d55c7486-f238-4f72-a6be-8596834736b4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:26.278939 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d55c7486-f238-4f72-a6be-8596834736b4 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/d19ec679-8245-4e57-9701-ceb83543269c HTTP/1.1" status: 204 len: 168 time: 0.3728178 Dec 09 21:20:26.281887 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-aad92223-5435-4b1b-b76a-a054e8eaf2f1 req-786dab22-ca70-490b-8b96-2629b45916ce tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:26.309330 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-aad92223-5435-4b1b-b76a-a054e8eaf2f1 req-786dab22-ca70-490b-8b96-2629b45916ce tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:26.315575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d55c7486-f238-4f72-a6be-8596834736b4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d19ec679-8245-4e57-9701-ceb83543269c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:26.383538 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-aad92223-5435-4b1b-b76a-a054e8eaf2f1 req-786dab22-ca70-490b-8b96-2629b45916ce tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:26.384802 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aad92223-5435-4b1b-b76a-a054e8eaf2f1 req-786dab22-ca70-490b-8b96-2629b45916ce tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1823 time: 0.4144769 Dec 09 21:20:26.401243 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786dab22-ca70-490b-8b96-2629b45916ce tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fcef09b2-6be7-417f-bbda-9d0481c9379d,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:26.441050 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-d44a5063-585f-4fb8-941d-e058c71d962c service neutron] 10.222.0.13 "GET /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1547189 Dec 09 21:20:26.602232 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7970bc19-b0d5-42b3-b04c-b04f04bcd2c8 req-0e219409-59e5-488b-a144-d38f120f5676 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:26.604001 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7970bc19-b0d5-42b3-b04c-b04f04bcd2c8 req-0e219409-59e5-488b-a144-d38f120f5676 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 950 time: 0.0874894 Dec 09 21:20:26.632236 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-20722a3c-f61f-4f95-bf7e-5417bc3bbd07 service neutron] 10.222.0.13 "GET /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1896551 Dec 09 21:20:26.699060 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7970bc19-b0d5-42b3-b04c-b04f04bcd2c8 req-d1e1d636-6afd-4b0e-939b-7e50e27e2cbb tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0620356 Dec 09 21:20:26.743640 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58716) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:26.760913 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ab7dc62b-d8d7-45d6-9b06-b5dabd79b509 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:26.840089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3eb0701d-e83a-4e8d-aae5-838d2755adde req-3d68ac6d-4bed-4c89-9c77-3baebd46d7cc tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/ports?device_id=a007b30a-1cc1-4d65-b263-1bd9d1a84b3b HTTP/1.1" status: 200 len: 210 time: 0.0541520 Dec 09 21:20:26.942338 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:26.969849 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72575e41-bc45-43d3-ae2b-78e5d08e117e req-cbae5fa4-6886-44cd-ad09-9119f71199a9 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "GET /v2.0/security-groups/202ae0e3-f7fd-460c-9e6d-273d51a2135a HTTP/1.1" status: 200 len: 1821 time: 0.0796537 Dec 09 21:20:26.980259 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ab7dc62b-d8d7-45d6-9b06-b5dabd79b509 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:27.006732 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ab7dc62b-d8d7-45d6-9b06-b5dabd79b509 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:27.044651 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:27.100982 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5bfa4631-c678-4193-b77c-27001d8a644a req-d45a8887-f510-40b8-82e3-0d81d44e92cb tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 210 time: 0.0632973 Dec 09 21:20:27.114230 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72575e41-bc45-43d3-ae2b-78e5d08e117e req-9e2f78f0-a1a7-4fdd-9bb1-6339dfa3cf47 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "GET /v2.0/security-groups/fcef09b2-6be7-417f-bbda-9d0481c9379d HTTP/1.1" status: 200 len: 1818 time: 0.1360843 Dec 09 21:20:27.125949 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ab7dc62b-d8d7-45d6-9b06-b5dabd79b509 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=1abc0356c6854483ae0d9f8d98e13ec9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3742063 Dec 09 21:20:27.125949 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab7dc62b-d8d7-45d6-9b06-b5dabd79b509 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bf096785-5549-431e-968b-8cb6e34d5070,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:27.125949 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58726) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:27.141100 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-72575e41-bc45-43d3-ae2b-78e5d08e117e req-85d4f0f2-9d27-4a9c-ae1e-9d02f6a1b367 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Request body: {'security_group_rules': [{'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': None, 'security_group_id': '202ae0e3-f7fd-460c-9e6d-273d51a2135a', 'remote_group_id': 'fcef09b2-6be7-417f-bbda-9d0481c9379d', 'port_range_min': 22, 'port_range_max': 22}]} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:27.141639 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-72575e41-bc45-43d3-ae2b-78e5d08e117e req-85d4f0f2-9d27-4a9c-ae1e-9d02f6a1b367 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Request body: {'security_group_rule': {'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': None, 'security_group_id': '202ae0e3-f7fd-460c-9e6d-273d51a2135a', 'remote_group_id': 'fcef09b2-6be7-417f-bbda-9d0481c9379d', 'port_range_min': 22, 'port_range_max': 22}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:27.217736 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-36053eec-2488-4f1b-a079-628e105af786 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:27.280144 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-36053eec-2488-4f1b-a079-628e105af786 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:27.308145 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-72575e41-bc45-43d3-ae2b-78e5d08e117e req-85d4f0f2-9d27-4a9c-ae1e-9d02f6a1b367 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:27.443232 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38cf4186-0850-4578-af7c-466d0bc67696 req-d6964f30-c1e2-4f93-87cb-7040ae537ad9 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:27.444613 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38cf4186-0850-4578-af7c-466d0bc67696 req-d6964f30-c1e2-4f93-87cb-7040ae537ad9 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.31 "GET /v2.0/ports?device_id=eac884a1-b960-4dfb-9337-7c68c9f0acca HTTP/1.1" status: 200 len: 946 time: 0.1788478 Dec 09 21:20:27.457897 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-72575e41-bc45-43d3-ae2b-78e5d08e117e req-85d4f0f2-9d27-4a9c-ae1e-9d02f6a1b367 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:27.470550 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-72575e41-bc45-43d3-ae2b-78e5d08e117e req-85d4f0f2-9d27-4a9c-ae1e-9d02f6a1b367 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:27.506151 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-36053eec-2488-4f1b-a079-628e105af786 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:27.508640 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-36053eec-2488-4f1b-a079-628e105af786 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:27.509780 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-36053eec-2488-4f1b-a079-628e105af786 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/bf096785-5549-431e-968b-8cb6e34d5070 HTTP/1.1" status: 204 len: 168 time: 0.3850057 Dec 09 21:20:27.545354 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-c0559884-5376-4ed5-88e0-0c6b97b4b285 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:27.546901 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-c0559884-5376-4ed5-88e0-0c6b97b4b285 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.10 "GET /v2.0/networks?id=1444d8a7-187f-473b-be08-dce40f6ae8ea HTTP/1.1" status: 200 len: 815 time: 0.2337139 Dec 09 21:20:27.547521 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85d4f0f2-9d27-4a9c-ae1e-9d02f6a1b367 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=02f3ff93-c735-44e8-829f-48c532053d7f,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:27.556769 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36053eec-2488-4f1b-a079-628e105af786 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bf096785-5549-431e-968b-8cb6e34d5070,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:27.580368 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-72575e41-bc45-43d3-ae2b-78e5d08e117e req-85d4f0f2-9d27-4a9c-ae1e-9d02f6a1b367 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:27.585459 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72575e41-bc45-43d3-ae2b-78e5d08e117e req-85d4f0f2-9d27-4a9c-ae1e-9d02f6a1b367 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 806 time: 0.4621933 Dec 09 21:20:27.591955 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-ba701992-f22d-4d76-bbcd-82906bcbafa0 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Request body: {'port': {'device_id': 'a007b30a-1cc1-4d65-b263-1bd9d1a84b3b', 'network_id': '1444d8a7-187f-473b-be08-dce40f6ae8ea', 'admin_state_up': True, 'tenant_id': '913fcb9b5aab4356999ade167d5148c6'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:27.735916 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c44f0a62-5a40-48cd-a1b1-2a51102d25a1 req-dc6c7c3c-dac5-40dc-aba8-13aa60626545 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "GET /v2.0/security-groups/fcef09b2-6be7-417f-bbda-9d0481c9379d HTTP/1.1" status: 200 len: 1818 time: 0.1259062 Dec 09 21:20:27.842371 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-38cf4186-0850-4578-af7c-466d0bc67696 req-997f82d8-bfe1-4529-94ca-cd54a84184fd tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Deleting port 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:20:27.842627 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-38cf4186-0850-4578-af7c-466d0bc67696 req-997f82d8-bfe1-4529-94ca-cd54a84184fd tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:27.959793 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-ba701992-f22d-4d76-bbcd-82906bcbafa0 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Made reservation on behalf of 913fcb9b5aab4356999ade167d5148c6 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:20:27.963290 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-ba701992-f22d-4d76-bbcd-82906bcbafa0 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:27.982964 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c44f0a62-5a40-48cd-a1b1-2a51102d25a1 req-3675a8a4-d706-44b4-99bd-c79c6ab8b579 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:27.995034 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2754545-4355-48ee-87a5-059eea89fa13 req-9df086d5-f96d-47ad-a4bf-893dd5c548e3 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:28.002780 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2754545-4355-48ee-87a5-059eea89fa13 req-9df086d5-f96d-47ad-a4bf-893dd5c548e3 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 950 time: 0.1934807 Dec 09 21:20:28.063346 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c44f0a62-5a40-48cd-a1b1-2a51102d25a1 req-3675a8a4-d706-44b4-99bd-c79c6ab8b579 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:28.073456 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-38cf4186-0850-4578-af7c-466d0bc67696 req-997f82d8-bfe1-4529-94ca-cd54a84184fd tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] For port 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=84ad33bd-6ab4-41c4-91dc-7edb7fd59e12,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:28.074205 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-38cf4186-0850-4578-af7c-466d0bc67696 req-997f82d8-bfe1-4529-94ca-cd54a84184fd tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:28.137222 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-38cf4186-0850-4578-af7c-466d0bc67696 req-997f82d8-bfe1-4529-94ca-cd54a84184fd tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Calling delete_port for 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:20:28.228600 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2754545-4355-48ee-87a5-059eea89fa13 req-f7d0594f-7eb9-44e8-8b32-17f597186652 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2229347 Dec 09 21:20:28.397808 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8e311cce-515a-4832-85f5-a4d8545a35e7 req-466303fb-b95d-4572-887e-9244ba12e4b2 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/ports?device_id=a007b30a-1cc1-4d65-b263-1bd9d1a84b3b HTTP/1.1" status: 200 len: 210 time: 0.0861456 Dec 09 21:20:28.457577 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:20:28.462451 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-ba701992-f22d-4d76-bbcd-82906bcbafa0 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Allocated IP 172.20.0.14 (1444d8a7-187f-473b-be08-dce40f6ae8ea/f2e816c0-e7a2-4010-b2b9-8d7f39c3a318/3eba2279-4b83-4ab6-bde7-0305ee1eda1f) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:20:28.485229 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c44f0a62-5a40-48cd-a1b1-2a51102d25a1 req-3675a8a4-d706-44b4-99bd-c79c6ab8b579 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:28.487957 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c44f0a62-5a40-48cd-a1b1-2a51102d25a1 req-3675a8a4-d706-44b4-99bd-c79c6ab8b579 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:28.501499 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c44f0a62-5a40-48cd-a1b1-2a51102d25a1 req-3675a8a4-d706-44b4-99bd-c79c6ab8b579 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "DELETE /v2.0/security-groups/fcef09b2-6be7-417f-bbda-9d0481c9379d HTTP/1.1" status: 204 len: 173 time: 0.7646189 Dec 09 21:20:28.600293 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58784) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:28.617653 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3675a8a4-d706-44b4-99bd-c79c6ab8b579 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fcef09b2-6be7-417f-bbda-9d0481c9379d,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:28.647991 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-5b438bf9-d430-4809-806e-5690f61cbf25 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:28.649621 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-5b438bf9-d430-4809-806e-5690f61cbf25 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.10 "GET /v2.0/networks?id=8e0b26d7-eefe-4c85-b535-944f3c15f0f6 HTTP/1.1" status: 200 len: 805 time: 0.4759116 Dec 09 21:20:28.729666 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:28.780171 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a165df85-70af-4b16-8421-d0613fa47106 req-1379c9a2-d827-4bc0-9651-b13aed683b75 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 210 time: 0.1536665 Dec 09 21:20:28.780657 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ebb162d1-d34e-4986-9bdb-6bf0bb59482c admin admin] Request body: {'network': {'name': 'tempest-FloatingIPDetailsNegativeTestJSON-1508066431-network', 'tenant_id': '7d5e8ae60543498f8ee03684e80c1aa1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:28.782019 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'eac884a1-b960-4dfb-9337-7c68c9f0acca', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '84ad33bd-6ab4-41c4-91dc-7edb7fd59e12'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:20:28.798455 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-71c938fc-6191-4a0a-8f02-95785f9f21ca" -d '{"events": [{"server_uuid": "eac884a1-b960-4dfb-9337-7c68c9f0acca", "name": "network-vif-unplugged", "status": "completed", "tag": "84ad33bd-6ab4-41c4-91dc-7edb7fd59e12"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:20:28.832011 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=84ad33bd-6ab4-41c4-91dc-7edb7fd59e12,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:28.838779 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:28.845880 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ebb162d1-d34e-4986-9bdb-6bf0bb59482c admin admin] Made reservation on behalf of 7d5e8ae60543498f8ee03684e80c1aa1 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:20:28.853104 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ebb162d1-d34e-4986-9bdb-6bf0bb59482c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:28.884289 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ebb162d1-d34e-4986-9bdb-6bf0bb59482c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:28.896641 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:20:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ffb88f65-2467-4faa-877a-ebe0b2268b98 x-openstack-request-id: req-ffb88f65-2467-4faa-877a-ebe0b2268b98 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:20:28.897256 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "eac884a1-b960-4dfb-9337-7c68c9f0acca", "name": "network-vif-unplugged", "status": "completed", "tag": "84ad33bd-6ab4-41c4-91dc-7edb7fd59e12", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:20:28.897686 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-ffb88f65-2467-4faa-877a-ebe0b2268b98 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:20:28.898322 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'eac884a1-b960-4dfb-9337-7c68c9f0acca', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '84ad33bd-6ab4-41c4-91dc-7edb7fd59e12', 'code': 200} Dec 09 21:20:28.926926 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5ae1e19f-3a84-43d7-86b7-b19c15d3f4c4 req-c63db0b2-a4a5-4387-8c16-2ad4eba99dea tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "GET /v2.0/security-groups/202ae0e3-f7fd-460c-9e6d-273d51a2135a HTTP/1.1" status: 200 len: 1821 time: 0.3739734 Dec 09 21:20:28.935429 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=84ad33bd-6ab4-41c4-91dc-7edb7fd59e12,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:28.951025 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:28.952274 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:28.953312 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:28.955586 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:28.956740 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:28.957827 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:28.958939 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:28.960782 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:28.961155 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:28.961487 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:28.961816 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:28.962140 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:28.962488 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:28.986440 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-e09befb1-267e-45db-b5c2-a114fdeb94c6 req-97246ed2-cfe2-446a-853b-71a7230248ef tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesTestJSON-securitygroup-685984871', 'description': 'tempest-description-1060294126'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:29.032209 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ebb162d1-d34e-4986-9bdb-6bf0bb59482c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:29.041149 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ebb162d1-d34e-4986-9bdb-6bf0bb59482c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:29.076745 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ebb162d1-d34e-4986-9bdb-6bf0bb59482c admin admin] vlan segment allocate from pool success with {'vlan_id': 130, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:20:29.082716 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-38cf4186-0850-4578-af7c-466d0bc67696 req-997f82d8-bfe1-4529-94ca-cd54a84184fd tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:29.094782 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebb162d1-d34e-4986-9bdb-6bf0bb59482c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=17337e1e-a772-4027-b63b-76b0cb195e20,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:29.112077 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ebb162d1-d34e-4986-9bdb-6bf0bb59482c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:29.112427 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-ebb162d1-d34e-4986-9bdb-6bf0bb59482c admin admin] Added segment af4025cf-5dc2-4085-8a58-84ccccefa44e of type vlan for network ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b Dec 09 21:20:29.128842 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-997f82d8-bfe1-4529-94ca-cd54a84184fd tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Pushing event deleted for resources: {'Port': ['ID=84ad33bd-6ab4-41c4-91dc-7edb7fd59e12,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:29.137307 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e09befb1-267e-45db-b5c2-a114fdeb94c6 req-97246ed2-cfe2-446a-853b-71a7230248ef tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:29.183756 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ebb162d1-d34e-4986-9bdb-6bf0bb59482c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:29.203951 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-38cf4186-0850-4578-af7c-466d0bc67696 req-997f82d8-bfe1-4529-94ca-cd54a84184fd tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] No DVR routers for this DVR port 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:20:29.208200 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-38cf4186-0850-4578-af7c-466d0bc67696 req-997f82d8-bfe1-4529-94ca-cd54a84184fd tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:29.211789 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38cf4186-0850-4578-af7c-466d0bc67696 req-997f82d8-bfe1-4529-94ca-cd54a84184fd tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.31 "DELETE /v2.0/ports/84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 HTTP/1.1" status: 204 len: 173 time: 1.7575397 Dec 09 21:20:29.217256 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'eac884a1-b960-4dfb-9337-7c68c9f0acca', 'name': 'network-vif-deleted', 'tag': '84ad33bd-6ab4-41c4-91dc-7edb7fd59e12'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:20:29.219482 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9722d7b8-aee8-4c22-9c62-afe85b1a82b9" -d '{"events": [{"server_uuid": "eac884a1-b960-4dfb-9337-7c68c9f0acca", "name": "network-vif-deleted", "tag": "84ad33bd-6ab4-41c4-91dc-7edb7fd59e12"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:20:29.229598 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-ba701992-f22d-4d76-bbcd-82906bcbafa0 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:29.235065 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ebb162d1-d34e-4986-9bdb-6bf0bb59482c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:29.237888 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ebb162d1-d34e-4986-9bdb-6bf0bb59482c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:29.238578 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ebb162d1-d34e-4986-9bdb-6bf0bb59482c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:29.307497 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:20:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-82e72201-2983-4224-a021-d04047eccb8f x-openstack-request-id: req-82e72201-2983-4224-a021-d04047eccb8f {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:20:29.307970 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "eac884a1-b960-4dfb-9337-7c68c9f0acca", "name": "network-vif-deleted", "tag": "84ad33bd-6ab4-41c4-91dc-7edb7fd59e12", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:20:29.308287 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-82e72201-2983-4224-a021-d04047eccb8f {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:20:29.308746 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'eac884a1-b960-4dfb-9337-7c68c9f0acca', 'name': 'network-vif-deleted', 'tag': '84ad33bd-6ab4-41c4-91dc-7edb7fd59e12', 'status': 'completed', 'code': 200} Dec 09 21:20:29.322264 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e09befb1-267e-45db-b5c2-a114fdeb94c6 req-97246ed2-cfe2-446a-853b-71a7230248ef tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:29.328058 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-ba701992-f22d-4d76-bbcd-82906bcbafa0 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:29.330442 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e09befb1-267e-45db-b5c2-a114fdeb94c6 req-97246ed2-cfe2-446a-853b-71a7230248ef tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:29.401387 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e09befb1-267e-45db-b5c2-a114fdeb94c6 req-97246ed2-cfe2-446a-853b-71a7230248ef tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:29.406582 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e09befb1-267e-45db-b5c2-a114fdeb94c6 req-97246ed2-cfe2-446a-853b-71a7230248ef tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1826 time: 0.4335425 Dec 09 21:20:29.437924 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-ba701992-f22d-4d76-bbcd-82906bcbafa0 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Network 1444d8a7-187f-473b-be08-dce40f6ae8ea is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:20:29.460273 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97246ed2-cfe2-446a-853b-71a7230248ef tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Pushing event updated for resources: {'SecurityGroup': ['ID=babc3cc1-ed3d-478a-9f4a-d8d46a2a4cf6,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:29.469069 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ebb162d1-d34e-4986-9bdb-6bf0bb59482c admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 0.8661098 Dec 09 21:20:29.469474 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-ba701992-f22d-4d76-bbcd-82906bcbafa0 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:20:29.471711 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58804) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:29.474530 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba701992-f22d-4d76-bbcd-82906bcbafa0 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Pushing event updated for resources: {'Port': ['ID=3eba2279-4b83-4ab6-bde7-0305ee1eda1f,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:29.485212 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-532e6159-bdc1-4589-b1ba-0f7080557ed2 admin admin] Request body: {'subnet': {'network_id': 'ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b', 'cidr': '172.20.0.0/28', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-1508066431-subnet', 'tenant_id': '7d5e8ae60543498f8ee03684e80c1aa1', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:29.489212 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebb162d1-d34e-4986-9bdb-6bf0bb59482c admin admin] Pushing event updated for resources: {'Network': ['ID=ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:29.502711 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:20:29.508531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-ba701992-f22d-4d76-bbcd-82906bcbafa0 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:20:29.857578 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b4dc82a6-60db-40f5-802e-e9d4c2111fa8 None None] Provisioning complete for port 3eba2279-4b83-4ab6-bde7-0305ee1eda1f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:29.858953 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b4dc82a6-60db-40f5-802e-e9d4c2111fa8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:29.949686 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-ba701992-f22d-4d76-bbcd-82906bcbafa0 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:29.950465 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-ba701992-f22d-4d76-bbcd-82906bcbafa0 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:29.969392 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-b4dc82a6-60db-40f5-802e-e9d4c2111fa8 None None] Port 3eba2279-4b83-4ab6-bde7-0305ee1eda1f cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:20:30.009362 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-48e37d33-5712-41ab-b584-3749340a8dcb req-35da0c04-53e0-4b36-b426-773e9631c98a tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "GET /v2.0/security-groups/babc3cc1-ed3d-478a-9f4a-d8d46a2a4cf6 HTTP/1.1" status: 200 len: 1821 time: 0.5823381 Dec 09 21:20:30.018711 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d9947d-148f-489b-933e-7c620a0c268d req-312814d4-46ee-407f-baf0-6a75f0234a6b tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:30.020341 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9d9947d-148f-489b-933e-7c620a0c268d req-312814d4-46ee-407f-baf0-6a75f0234a6b tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 950 time: 0.5852516 Dec 09 21:20:30.022493 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-532e6159-bdc1-4589-b1ba-0f7080557ed2 admin admin] Made reservation on behalf of 7d5e8ae60543498f8ee03684e80c1aa1 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:20:30.024777 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-532e6159-bdc1-4589-b1ba-0f7080557ed2 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:30.032987 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-ba701992-f22d-4d76-bbcd-82906bcbafa0 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.4742553 Dec 09 21:20:30.045375 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-48e37d33-5712-41ab-b584-3749340a8dcb req-c3a873f2-044f-4709-9b6f-84ce1ed72f80 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Request body: {'security_group_rules': [{'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': 'babc3cc1-ed3d-478a-9f4a-d8d46a2a4cf6', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}]} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:30.045787 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-48e37d33-5712-41ab-b584-3749340a8dcb req-c3a873f2-044f-4709-9b6f-84ce1ed72f80 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Request body: {'security_group_rule': {'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': 'babc3cc1-ed3d-478a-9f4a-d8d46a2a4cf6', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:30.161755 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9d9947d-148f-489b-933e-7c620a0c268d req-df94cef5-ad08-40d7-8f96-628247c16193 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1323466 Dec 09 21:20:30.227543 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-48e37d33-5712-41ab-b584-3749340a8dcb req-c3a873f2-044f-4709-9b6f-84ce1ed72f80 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:30.295604 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-48e37d33-5712-41ab-b584-3749340a8dcb req-c3a873f2-044f-4709-9b6f-84ce1ed72f80 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:30.328348 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-48e37d33-5712-41ab-b584-3749340a8dcb req-c3a873f2-044f-4709-9b6f-84ce1ed72f80 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:30.382887 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd8ed34d-b2a2-40b7-9b87-5a4ef709f473 req-fd03ccb1-9ed4-4f0b-9613-6d8faf1785c4 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:30.384391 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dd8ed34d-b2a2-40b7-9b87-5a4ef709f473 req-fd03ccb1-9ed4-4f0b-9613-6d8faf1785c4 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/ports?device_id=a007b30a-1cc1-4d65-b263-1bd9d1a84b3b HTTP/1.1" status: 200 len: 932 time: 0.1586289 Dec 09 21:20:30.390467 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-48e37d33-5712-41ab-b584-3749340a8dcb req-c3a873f2-044f-4709-9b6f-84ce1ed72f80 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:30.394624 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-48e37d33-5712-41ab-b584-3749340a8dcb req-c3a873f2-044f-4709-9b6f-84ce1ed72f80 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 0.3702624 Dec 09 21:20:30.394624 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3a873f2-044f-4709-9b6f-84ce1ed72f80 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6b129256-03b8-4423-b8ca-33ce759ea11e,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:30.400901 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-532e6159-bdc1-4589-b1ba-0f7080557ed2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:30.480073 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-532e6159-bdc1-4589-b1ba-0f7080557ed2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=15309006-587d-43b0-b8f1-2fa0af9cd690,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:30.503509 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dd8ed34d-b2a2-40b7-9b87-5a4ef709f473 req-3d9ed88c-142a-44a3-88d2-879fd4827237 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/security-groups?id=dea88e67-805c-4990-af94-aeeaf2d8e160&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1102538 Dec 09 21:20:30.513641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-532e6159-bdc1-4589-b1ba-0f7080557ed2 admin admin] Checking segment: {'id': 'af4025cf-5dc2-4085-8a58-84ccccefa44e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:20:30.514073 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-532e6159-bdc1-4589-b1ba-0f7080557ed2 admin admin] Network hostable DHCP agents. Network: ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:20:30.542449 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-532e6159-bdc1-4589-b1ba-0f7080557ed2 admin admin] Network ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:20:30.565672 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-532e6159-bdc1-4589-b1ba-0f7080557ed2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:20:30.573988 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42823d67-ffb9-441c-8b44-b03feb4ca2bb None None] Network ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:20:30.587420 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-45f34b77-cc63-4a75-b271-85455c9b826a req-698a9340-bd0d-4d4c-97ab-14eecb752b04 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 210 time: 0.0364201 Dec 09 21:20:30.588868 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-532e6159-bdc1-4589-b1ba-0f7080557ed2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:30.589217 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-532e6159-bdc1-4589-b1ba-0f7080557ed2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:30.626501 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-532e6159-bdc1-4589-b1ba-0f7080557ed2 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 860 time: 1.1492209 Dec 09 21:20:30.629332 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58816) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:30.634659 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-290cef97-2d3c-4128-844e-f93fc0a3c0d9 admin admin] Request body: {'router': {'name': 'tempest-FloatingIPDetailsNegativeTestJSON-1508066431-router', 'tenant_id': '7d5e8ae60543498f8ee03684e80c1aa1', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:30.645589 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-435fdd49-f290-4214-9819-740ec9770c14 req-85da77e8-26a4-4ac0-9256-1d03ee994519 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "GET /v2.0/security-groups/babc3cc1-ed3d-478a-9f4a-d8d46a2a4cf6 HTTP/1.1" status: 200 len: 2414 time: 0.0838037 Dec 09 21:20:30.663323 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-435fdd49-f290-4214-9819-740ec9770c14 req-7af34566-240d-4150-81ab-e2a158a25689 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Request body: {'security_group_rules': [{'direction': 'ingress', 'protocol': 'icmp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': 'babc3cc1-ed3d-478a-9f4a-d8d46a2a4cf6', 'remote_group_id': None}]} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:30.664478 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-435fdd49-f290-4214-9819-740ec9770c14 req-7af34566-240d-4150-81ab-e2a158a25689 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Request body: {'security_group_rule': {'direction': 'ingress', 'protocol': 'icmp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': 'babc3cc1-ed3d-478a-9f4a-d8d46a2a4cf6', 'remote_group_id': None}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:30.674439 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-290cef97-2d3c-4128-844e-f93fc0a3c0d9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:30.676055 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-290cef97-2d3c-4128-844e-f93fc0a3c0d9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:30.733701 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da42c471-1d68-4d56-9040-ac3e623e8a3b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b', 'network_id': 'ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b', 'project_id': '7d5e8ae60543498f8ee03684e80c1aa1', 'fixed_ips': [{'subnet_id': '15309006-587d-43b0-b8f1-2fa0af9cd690'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:20:30.734913 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-da42c471-1d68-4d56-9040-ac3e623e8a3b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:30.751451 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-435fdd49-f290-4214-9819-740ec9770c14 req-7af34566-240d-4150-81ab-e2a158a25689 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:30.756444 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-290cef97-2d3c-4128-844e-f93fc0a3c0d9 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:30.783347 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-435fdd49-f290-4214-9819-740ec9770c14 req-7af34566-240d-4150-81ab-e2a158a25689 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:30.788358 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-435fdd49-f290-4214-9819-740ec9770c14 req-7af34566-240d-4150-81ab-e2a158a25689 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:30.805517 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7af34566-240d-4150-81ab-e2a158a25689 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6be085a8-b2e6-4773-b603-2d71deb594be,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:30.823931 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-435fdd49-f290-4214-9819-740ec9770c14 req-7af34566-240d-4150-81ab-e2a158a25689 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:30.826064 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-435fdd49-f290-4214-9819-740ec9770c14 req-7af34566-240d-4150-81ab-e2a158a25689 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 791 time: 0.1669753 Dec 09 21:20:30.896343 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c54e50ef-8ccb-49f7-bb6f-c850a4800e44 req-c0640c53-0eb5-4969-8b64-e868fb336030 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "GET /v2.0/security-groups/babc3cc1-ed3d-478a-9f4a-d8d46a2a4cf6 HTTP/1.1" status: 200 len: 3012 time: 0.0469630 Dec 09 21:20:30.946686 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-162380aa-97fe-428c-8c00-f1d9c1398bcc req-939378be-7f8b-4c8b-a5c6-16454f2bb92f tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "GET /v2.0/security-group-rules/6be085a8-b2e6-4773-b603-2d71deb594be HTTP/1.1" status: 200 len: 783 time: 0.0274436 Dec 09 21:20:30.949105 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-da42c471-1d68-4d56-9040-ac3e623e8a3b None None] Allocated IP 172.20.0.2 (ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b/15309006-587d-43b0-b8f1-2fa0af9cd690/04ab76ac-be82-4c9f-a935-d29a4a2961c7) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:20:31.036952 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-162380aa-97fe-428c-8c00-f1d9c1398bcc req-6e026bdb-235e-4a21-b1ca-8d33101db172 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "GET /v2.0/security-groups/babc3cc1-ed3d-478a-9f4a-d8d46a2a4cf6 HTTP/1.1" status: 200 len: 3012 time: 0.0814950 Dec 09 21:20:31.037819 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-290cef97-2d3c-4128-844e-f93fc0a3c0d9 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:31.074401 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-162380aa-97fe-428c-8c00-f1d9c1398bcc req-037474b9-f33a-47bd-8329-52c5d4c8a9bd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:31.083495 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-162380aa-97fe-428c-8c00-f1d9c1398bcc req-037474b9-f33a-47bd-8329-52c5d4c8a9bd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:31.113585 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-162380aa-97fe-428c-8c00-f1d9c1398bcc req-037474b9-f33a-47bd-8329-52c5d4c8a9bd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:31.121915 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-162380aa-97fe-428c-8c00-f1d9c1398bcc req-037474b9-f33a-47bd-8329-52c5d4c8a9bd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:31.123662 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-162380aa-97fe-428c-8c00-f1d9c1398bcc req-037474b9-f33a-47bd-8329-52c5d4c8a9bd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "DELETE /v2.0/security-group-rules/6be085a8-b2e6-4773-b603-2d71deb594be HTTP/1.1" status: 204 len: 173 time: 0.0858619 Dec 09 21:20:31.132016 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-037474b9-f33a-47bd-8329-52c5d4c8a9bd tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=6be085a8-b2e6-4773-b603-2d71deb594be,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:31.215949 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2b6d96ab-0f6e-49ab-adc7-d7db6342e634 req-ac656568-a8ab-4664-bfca-566148392ec3 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "GET /v2.0/security-groups/babc3cc1-ed3d-478a-9f4a-d8d46a2a4cf6 HTTP/1.1" status: 200 len: 2414 time: 0.0641506 Dec 09 21:20:31.243367 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-da42c471-1d68-4d56-9040-ac3e623e8a3b None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:31.252276 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-da42c471-1d68-4d56-9040-ac3e623e8a3b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:31.334472 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da42c471-1d68-4d56-9040-ac3e623e8a3b None None] Pushing event updated for resources: {'Port': ['ID=04ab76ac-be82-4c9f-a935-d29a4a2961c7,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:31.341593 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da42c471-1d68-4d56-9040-ac3e623e8a3b None None] Network ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:20:31.343324 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-da42c471-1d68-4d56-9040-ac3e623e8a3b None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:20:31.347683 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da42c471-1d68-4d56-9040-ac3e623e8a3b None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:20:31.351200 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2b6d96ab-0f6e-49ab-adc7-d7db6342e634 req-66f4c565-1dd8-42b8-bfc6-9e532c10b234 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:31.366130 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7851061a-7071-4cc9-b64b-89c891a4e0ec req-d09e7c7d-ea21-4203-92a7-5742ecec5c6e tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:31.367726 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7851061a-7071-4cc9-b64b-89c891a4e0ec req-d09e7c7d-ea21-4203-92a7-5742ecec5c6e tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 950 time: 0.0865700 Dec 09 21:20:31.383077 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-290cef97-2d3c-4128-844e-f93fc0a3c0d9 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:31.404414 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-290cef97-2d3c-4128-844e-f93fc0a3c0d9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:31.415724 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-da42c471-1d68-4d56-9040-ac3e623e8a3b None None] Attempting to bind port 04ab76ac-be82-4c9f-a935-d29a4a2961c7 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:20:31.416348 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-da42c471-1d68-4d56-9040-ac3e623e8a3b None None] Attempting to bind port 04ab76ac-be82-4c9f-a935-d29a4a2961c7 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'af4025cf-5dc2-4085-8a58-84ccccefa44e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:20:31.416865 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da42c471-1d68-4d56-9040-ac3e623e8a3b None None] Attempting to bind port 04ab76ac-be82-4c9f-a935-d29a4a2961c7 on network ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:20:31.419284 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2b6d96ab-0f6e-49ab-adc7-d7db6342e634 req-66f4c565-1dd8-42b8-bfc6-9e532c10b234 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:31.423175 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da42c471-1d68-4d56-9040-ac3e623e8a3b None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 20, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:20:31.423826 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da42c471-1d68-4d56-9040-ac3e623e8a3b None None] Checking segment: {'id': 'af4025cf-5dc2-4085-8a58-84ccccefa44e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:20:31.424495 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-da42c471-1d68-4d56-9040-ac3e623e8a3b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:31.425044 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da42c471-1d68-4d56-9040-ac3e623e8a3b None None] Bound using segment: {'id': 'af4025cf-5dc2-4085-8a58-84ccccefa44e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:20:31.425731 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-da42c471-1d68-4d56-9040-ac3e623e8a3b None None] Bound port: 04ab76ac-be82-4c9f-a935-d29a4a2961c7, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af4025cf-5dc2-4085-8a58-84ccccefa44e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:20:31.426342 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-da42c471-1d68-4d56-9040-ac3e623e8a3b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:31.493661 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7851061a-7071-4cc9-b64b-89c891a4e0ec req-065d05a3-d7ef-48ea-8c5a-b0b637736fa1 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1191511 Dec 09 21:20:31.510383 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2b6d96ab-0f6e-49ab-adc7-d7db6342e634 req-66f4c565-1dd8-42b8-bfc6-9e532c10b234 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:31.515266 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2b6d96ab-0f6e-49ab-adc7-d7db6342e634 req-66f4c565-1dd8-42b8-bfc6-9e532c10b234 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:31.516588 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2b6d96ab-0f6e-49ab-adc7-d7db6342e634 req-66f4c565-1dd8-42b8-bfc6-9e532c10b234 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "DELETE /v2.0/security-groups/babc3cc1-ed3d-478a-9f4a-d8d46a2a4cf6 HTTP/1.1" status: 204 len: 173 time: 0.2919114 Dec 09 21:20:31.523386 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-da42c471-1d68-4d56-9040-ac3e623e8a3b None None] For port 04ab76ac-be82-4c9f-a935-d29a4a2961c7, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:20:31.536431 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-da42c471-1d68-4d56-9040-ac3e623e8a3b None None] For port 04ab76ac-be82-4c9f-a935-d29a4a2961c7, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=04ab76ac-be82-4c9f-a935-d29a4a2961c7,segment=NetworkSegment(af4025cf-5dc2-4085-8a58-84ccccefa44e),segment_id=af4025cf-5dc2-4085-8a58-84ccccefa44e)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:20:31.539119 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66f4c565-1dd8-42b8-bfc6-9e532c10b234 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=babc3cc1-ed3d-478a-9f4a-d8d46a2a4cf6,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:31.546586 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-da42c471-1d68-4d56-9040-ac3e623e8a3b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:31.562904 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-290cef97-2d3c-4128-844e-f93fc0a3c0d9 admin admin] Allocated IP 172.25.3.157 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/5c493b55-ee04-4498-9f43-08b4368cccc7) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:20:31.593525 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-23e1d393-a31e-45f2-a5ef-df7129000686 req-f6dce026-bdc1-453e-982d-7545ace91269 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] show failed (client error): The resource could not be found. Dec 09 21:20:31.595190 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-23e1d393-a31e-45f2-a5ef-df7129000686 req-f6dce026-bdc1-453e-982d-7545ace91269 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "GET /v2.0/security-groups/fcef09b2-6be7-417f-bbda-9d0481c9379d HTTP/1.1" status: 404 len: 352 time: 0.0343184 Dec 09 21:20:31.641124 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da42c471-1d68-4d56-9040-ac3e623e8a3b None None] Pushing event updated for resources: {'Port': ['ID=04ab76ac-be82-4c9f-a935-d29a4a2961c7,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:31.761820 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-290cef97-2d3c-4128-844e-f93fc0a3c0d9 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:31.810624 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c7b9421f-73f1-4db9-bac3-db525dc5df6c req-8feda50d-5e4a-4502-9c5a-74db1d35cc73 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 210 time: 0.0816298 Dec 09 21:20:31.816861 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-290cef97-2d3c-4128-844e-f93fc0a3c0d9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:31.900648 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-290cef97-2d3c-4128-844e-f93fc0a3c0d9 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:20:31.911278 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-290cef97-2d3c-4128-844e-f93fc0a3c0d9 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:20:31.914231 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-290cef97-2d3c-4128-844e-f93fc0a3c0d9 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:20:31.937167 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49e622e8-4194-4dfe-b54f-cbeb233c8b16 req-b4878100-aed5-4809-a510-7173698add88 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:31.938916 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-49e622e8-4194-4dfe-b54f-cbeb233c8b16 req-b4878100-aed5-4809-a510-7173698add88 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/ports?device_id=a007b30a-1cc1-4d65-b263-1bd9d1a84b3b HTTP/1.1" status: 200 len: 932 time: 0.1715338 Dec 09 21:20:31.955410 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-290cef97-2d3c-4128-844e-f93fc0a3c0d9 admin admin] Pushing event updated for resources: {'Port': ['ID=5c493b55-ee04-4498-9f43-08b4368cccc7,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:31.971762 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc329d0c-3b75-4123-b9a1-481483b81853 req-1fc597d5-d094-47ef-801a-6ded59d267ec tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "GET /v2.0/security-groups/202ae0e3-f7fd-460c-9e6d-273d51a2135a HTTP/1.1" status: 200 len: 1821 time: 0.1203086 Dec 09 21:20:32.056293 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-49e622e8-4194-4dfe-b54f-cbeb233c8b16 req-5a509707-2cd4-49be-aea1-5a1737ac9f9b tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/security-groups?id=dea88e67-805c-4990-af94-aeeaf2d8e160&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0969379 Dec 09 21:20:32.168403 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-dc329d0c-3b75-4123-b9a1-481483b81853 req-22dfe80d-392e-4305-90a2-18bf7cdd906b tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:32.194875 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-dc329d0c-3b75-4123-b9a1-481483b81853 req-22dfe80d-392e-4305-90a2-18bf7cdd906b tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:32.248666 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-dc329d0c-3b75-4123-b9a1-481483b81853 req-22dfe80d-392e-4305-90a2-18bf7cdd906b tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:32.251277 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-dc329d0c-3b75-4123-b9a1-481483b81853 req-22dfe80d-392e-4305-90a2-18bf7cdd906b tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:32.252470 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc329d0c-3b75-4123-b9a1-481483b81853 req-22dfe80d-392e-4305-90a2-18bf7cdd906b tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "DELETE /v2.0/security-groups/202ae0e3-f7fd-460c-9e6d-273d51a2135a HTTP/1.1" status: 204 len: 173 time: 0.2709503 Dec 09 21:20:32.267377 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22dfe80d-392e-4305-90a2-18bf7cdd906b tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=202ae0e3-f7fd-460c-9e6d-273d51a2135a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:32.342306 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5fbad651-9767-47c2-afe0-c588f445ee4a req-00248c2d-5d0d-4615-9b29-5e21d6a0436e tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "GET /v2.0/security-groups/16a7305d-f042-4f37-93cc-e29aad98055c HTTP/1.1" status: 200 len: 1821 time: 0.0668561 Dec 09 21:20:32.357158 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-290cef97-2d3c-4128-844e-f93fc0a3c0d9 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:32.414938 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5fbad651-9767-47c2-afe0-c588f445ee4a req-63bcc3c2-ec6a-44e2-b531-e91df6835be1 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:32.440448 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5fbad651-9767-47c2-afe0-c588f445ee4a req-63bcc3c2-ec6a-44e2-b531-e91df6835be1 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:32.508526 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:20:32.530661 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5fbad651-9767-47c2-afe0-c588f445ee4a req-63bcc3c2-ec6a-44e2-b531-e91df6835be1 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:32.533536 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5fbad651-9767-47c2-afe0-c588f445ee4a req-63bcc3c2-ec6a-44e2-b531-e91df6835be1 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:32.534953 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5fbad651-9767-47c2-afe0-c588f445ee4a req-63bcc3c2-ec6a-44e2-b531-e91df6835be1 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "DELETE /v2.0/security-groups/16a7305d-f042-4f37-93cc-e29aad98055c HTTP/1.1" status: 204 len: 173 time: 0.1843164 Dec 09 21:20:32.560169 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63bcc3c2-ec6a-44e2-b531-e91df6835be1 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=16a7305d-f042-4f37-93cc-e29aad98055c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:32.563490 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:20:32.563846 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 84ad33bd-6ab4-41c4-91dc-7edb7fd59e12 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:20:32.663990 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-290cef97-2d3c-4128-844e-f93fc0a3c0d9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:32.674845 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea03f188-fcad-4ead-a2ce-ed20676bed34 req-86ea4f22-ee3f-4e4d-9e68-59fc9fa9382e tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "GET /v2.0/security-groups/0e5e71a8-eae0-4fdc-9e1b-5c8cb776ae60 HTTP/1.1" status: 200 len: 1822 time: 0.1034794 Dec 09 21:20:32.694865 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5585f259-cb89-4a9a-b907-81e0f9ecfd3f req-5a0e048f-fec5-401f-912b-2362492eaa1c tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:32.696660 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5585f259-cb89-4a9a-b907-81e0f9ecfd3f req-5a0e048f-fec5-401f-912b-2362492eaa1c tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 950 time: 0.0897126 Dec 09 21:20:32.796150 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5585f259-cb89-4a9a-b907-81e0f9ecfd3f req-6d95b53d-e05d-41a6-84b3-a3026bb730f4 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0873916 Dec 09 21:20:32.846668 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ea03f188-fcad-4ead-a2ce-ed20676bed34 req-97f9a59d-0604-419c-83ce-4c42d01c6645 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:32.864222 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-290cef97-2d3c-4128-844e-f93fc0a3c0d9 admin admin] Router 25046774-92e5-4d58-9896-0cb0ec8db37d is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:20:32.908230 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ea03f188-fcad-4ead-a2ce-ed20676bed34 req-97f9a59d-0604-419c-83ce-4c42d01c6645 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:32.951598 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8d969619-8ea3-482d-ae82-8b6999431a7f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:32.985126 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ea03f188-fcad-4ead-a2ce-ed20676bed34 req-97f9a59d-0604-419c-83ce-4c42d01c6645 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:32.988204 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b3374f0-8d6f-4eae-9b6c-b2847f96ef3f None None] Network ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:20:32.994155 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ea03f188-fcad-4ead-a2ce-ed20676bed34 req-97f9a59d-0604-419c-83ce-4c42d01c6645 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:32.998225 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea03f188-fcad-4ead-a2ce-ed20676bed34 req-97f9a59d-0604-419c-83ce-4c42d01c6645 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "DELETE /v2.0/security-groups/0e5e71a8-eae0-4fdc-9e1b-5c8cb776ae60 HTTP/1.1" status: 204 len: 173 time: 0.3092308 Dec 09 21:20:33.063649 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-290cef97-2d3c-4128-844e-f93fc0a3c0d9 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:20:33.073325 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] Sync routers for ids ['25046774-92e5-4d58-9896-0cb0ec8db37d'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:20:33.083418 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8381aaa5-30aa-4666-8dd5-8d7ab90ab0d9 req-cd392562-1f85-42ca-9bd5-79efb01177c3 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 210 time: 0.0841186 Dec 09 21:20:33.084155 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97f9a59d-0604-419c-83ce-4c42d01c6645 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e5e71a8-eae0-4fdc-9e1b-5c8cb776ae60,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:33.094076 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-290cef97-2d3c-4128-844e-f93fc0a3c0d9 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:33.094377 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] Routers {'25046774-92e5-4d58-9896-0cb0ec8db37d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:20:33.095005 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:20:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['25046774-92e5-4d58-9896-0cb0ec8db37d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:33.096166 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-290cef97-2d3c-4128-844e-f93fc0a3c0d9 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 936 time: 2.4657950 Dec 09 21:20:33.099627 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58858) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:33.109586 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4158d1fd-355f-4c7b-adff-f3e09b4b49f5 req-1e8ce4ab-c1a3-4231-a2dc-381b20866706 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "GET /v2.0/security-groups/6fd2cf2d-4873-49e5-a2ac-07e9dfe556d1 HTTP/1.1" status: 200 len: 2421 time: 0.0833664 Dec 09 21:20:33.125763 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a9fe451b-fe19-48bb-8b13-cd40ceb9736a None None] Provisioning complete for port 04ab76ac-be82-4c9f-a935-d29a4a2961c7 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:33.135572 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a9fe451b-fe19-48bb-8b13-cd40ceb9736a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:33.243007 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4158d1fd-355f-4c7b-adff-f3e09b4b49f5 req-aa5027ce-6b4b-4dfa-b0f0-81212bae7546 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:33.329841 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4158d1fd-355f-4c7b-adff-f3e09b4b49f5 req-aa5027ce-6b4b-4dfa-b0f0-81212bae7546 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:33.391873 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] Set router 25046774-92e5-4d58-9896-0cb0ec8db37d gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:20:33.392606 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a9fe451b-fe19-48bb-8b13-cd40ceb9736a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:33.447977 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a9fe451b-fe19-48bb-8b13-cd40ceb9736a None None] For port 04ab76ac-be82-4c9f-a935-d29a4a2961c7, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=04ab76ac-be82-4c9f-a935-d29a4a2961c7,segment=NetworkSegment(af4025cf-5dc2-4085-8a58-84ccccefa44e),segment_id=af4025cf-5dc2-4085-8a58-84ccccefa44e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:33.464976 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a9fe451b-fe19-48bb-8b13-cd40ceb9736a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:33.474833 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d97e85a2-e02a-4db1-a833-8da76c9a0468 req-d5021592-442f-4801-8db7-77adf6199e8c tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:33.483908 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d97e85a2-e02a-4db1-a833-8da76c9a0468 req-d5021592-442f-4801-8db7-77adf6199e8c tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/ports?device_id=a007b30a-1cc1-4d65-b263-1bd9d1a84b3b HTTP/1.1" status: 200 len: 932 time: 0.1386764 Dec 09 21:20:33.496718 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4158d1fd-355f-4c7b-adff-f3e09b4b49f5 req-aa5027ce-6b4b-4dfa-b0f0-81212bae7546 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:33.499923 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4158d1fd-355f-4c7b-adff-f3e09b4b49f5 req-aa5027ce-6b4b-4dfa-b0f0-81212bae7546 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:33.504589 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4158d1fd-355f-4c7b-adff-f3e09b4b49f5 req-aa5027ce-6b4b-4dfa-b0f0-81212bae7546 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "DELETE /v2.0/security-groups/6fd2cf2d-4873-49e5-a2ac-07e9dfe556d1 HTTP/1.1" status: 204 len: 173 time: 0.3885100 Dec 09 21:20:33.592736 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9fe451b-fe19-48bb-8b13-cd40ceb9736a None None] Pushing event updated for resources: {'Port': ['ID=04ab76ac-be82-4c9f-a935-d29a4a2961c7,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:33.631997 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cc2b9a90-4cb0-4046-9cc2-fd3fc7963b1a req-1506d521-a1e9-44c9-b8a5-e174f2b80048 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "GET /v2.0/security-groups/8e5e855e-c31f-46ae-b20b-fc5e1c98740c HTTP/1.1" status: 200 len: 2414 time: 0.0962017 Dec 09 21:20:33.633458 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa5027ce-6b4b-4dfa-b0f0-81212bae7546 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=6fd2cf2d-4873-49e5-a2ac-07e9dfe556d1,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:33.749725 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '25046774-92e5-4d58-9896-0cb0ec8db37d', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-1508066431-router', 'tenant_id': '7d5e8ae60543498f8ee03684e80c1aa1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.157'}], 'enable_snat': True}, 'gw_port_id': '5c493b55-ee04-4498-9f43-08b4368cccc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:20:30Z', 'updated_at': '2021-12-09T21:20:32Z', 'revision_number': 3, 'project_id': '7d5e8ae60543498f8ee03684e80c1aa1', 'gw_port': {'id': '5c493b55-ee04-4498-9f43-08b4368cccc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:d1:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '25046774-92e5-4d58-9896-0cb0ec8db37d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:31Z', 'updated_at': '2021-12-09T21:20:31Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:33.830059 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] Checking router: 25046774-92e5-4d58-9896-0cb0ec8db37d for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:20:33.830599 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] Updating router 25046774-92e5-4d58-9896-0cb0ec8db37d port 5c493b55-ee04-4498-9f43-08b4368cccc7 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:20:33.860442 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:33.863863 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d97e85a2-e02a-4db1-a833-8da76c9a0468 req-29f63ff7-9435-4396-abd4-78f739412a59 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/security-groups?id=dea88e67-805c-4990-af94-aeeaf2d8e160&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3787000 Dec 09 21:20:33.898396 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 04ab76ac-be82-4c9f-a935-d29a4a2961c7 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:20:33.946504 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cc2b9a90-4cb0-4046-9cc2-fd3fc7963b1a req-d65224eb-6c20-418a-9574-d3b072963cf9 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:33.990962 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cc2b9a90-4cb0-4046-9cc2-fd3fc7963b1a req-d65224eb-6c20-418a-9574-d3b072963cf9 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:34.031129 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-456fc782-ccdd-4bd4-bcc6-0ca2070b6d1c None None] Provisioning complete for port 04ab76ac-be82-4c9f-a935-d29a4a2961c7 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:34.031761 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-456fc782-ccdd-4bd4-bcc6-0ca2070b6d1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:34.040173 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 04ab76ac-be82-4c9f-a935-d29a4a2961c7 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:34.040525 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:34.139973 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f35181d4-c68b-4337-a68a-a4ba8d127637 req-d260672d-fff6-4631-a52f-f42047a3556e tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:34.147909 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f35181d4-c68b-4337-a68a-a4ba8d127637 req-d260672d-fff6-4631-a52f-f42047a3556e tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 950 time: 0.1006653 Dec 09 21:20:34.156200 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cc2b9a90-4cb0-4046-9cc2-fd3fc7963b1a req-d65224eb-6c20-418a-9574-d3b072963cf9 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:34.158709 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cc2b9a90-4cb0-4046-9cc2-fd3fc7963b1a req-d65224eb-6c20-418a-9574-d3b072963cf9 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:34.159838 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cc2b9a90-4cb0-4046-9cc2-fd3fc7963b1a req-d65224eb-6c20-418a-9574-d3b072963cf9 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] 10.222.0.13 "DELETE /v2.0/security-groups/8e5e855e-c31f-46ae-b20b-fc5e1c98740c HTTP/1.1" status: 204 len: 173 time: 0.5156665 Dec 09 21:20:34.171659 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58874) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:34.197682 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d65224eb-6c20-418a-9574-d3b072963cf9 tempest-SecurityGroupRulesTestJSON-1549001553 tempest-SecurityGroupRulesTestJSON-1549001553-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8e5e855e-c31f-46ae-b20b-fc5e1c98740c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:34.267935 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f35181d4-c68b-4337-a68a-a4ba8d127637 req-a797b631-4792-4910-884b-31186b6f2c04 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1140866 Dec 09 21:20:34.409844 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-aebd0912-1d4d-4d5f-a7b7-34225ae0af6d admin admin] Deleting subnet 14f445fe-22fb-4d4f-9165-d9c08a7d0946 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:20:34.410803 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-79455526-ff42-48d6-8a49-8535f710b40d req-513f2c1b-1da9-4524-b885-be0aa6e7d68f service neutron] show failed (client error): The resource could not be found. Dec 09 21:20:34.412410 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-79455526-ff42-48d6-8a49-8535f710b40d req-513f2c1b-1da9-4524-b885-be0aa6e7d68f service neutron] 10.222.0.31 "GET /v2.0/ports/36925110-4ed7-49f6-b07d-d998896a74cc/bindings/n-h2-713301-27 HTTP/1.1" status: 404 len: 381 time: 0.1714725 Dec 09 21:20:34.415745 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aebd0912-1d4d-4d5f-a7b7-34225ae0af6d admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:34.474098 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae9ef787-bbb9-41bd-a3b4-b7f40a40039e req-a44a62bc-0e28-4aa3-a5dc-9b55ecf86b83 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 210 time: 0.0445971 Dec 09 21:20:34.476415 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aebd0912-1d4d-4d5f-a7b7-34225ae0af6d admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:34.516898 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:34.527643 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:34.577759 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aebd0912-1d4d-4d5f-a7b7-34225ae0af6d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:34.580302 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2590aab5-52f2-44aa-92f6-1661d8dbc85c None None] Pushing event updated for resources: {'Port': ['ID=5c493b55-ee04-4498-9f43-08b4368cccc7,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:34.611700 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] Attempting to bind port 5c493b55-ee04-4498-9f43-08b4368cccc7 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:20:34.612189 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] Attempting to bind port 5c493b55-ee04-4498-9f43-08b4368cccc7 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:20:34.612658 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] Attempting to bind port 5c493b55-ee04-4498-9f43-08b4368cccc7 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:20:34.628522 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 20, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:20:34.628927 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:20:34.629453 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:34.630063 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:20:34.630770 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] Bound port: 5c493b55-ee04-4498-9f43-08b4368cccc7, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:20:34.630946 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:34.638222 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d7b5422c-88f7-48c5-8cbb-89a2ae78fd29 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:34.707593 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] For port 5c493b55-ee04-4498-9f43-08b4368cccc7, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:20:34.708501 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aebd0912-1d4d-4d5f-a7b7-34225ae0af6d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:34.711253 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] For port 5c493b55-ee04-4498-9f43-08b4368cccc7, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5c493b55-ee04-4498-9f43-08b4368cccc7,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:20:34.718636 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:34.752819 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aebd0912-1d4d-4d5f-a7b7-34225ae0af6d admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:34.756294 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-aebd0912-1d4d-4d5f-a7b7-34225ae0af6d admin admin] 10.222.0.13 "DELETE /v2.0/subnets/14f445fe-22fb-4d4f-9165-d9c08a7d0946 HTTP/1.1" status: 204 len: 168 time: 0.5835123 Dec 09 21:20:34.757407 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aebd0912-1d4d-4d5f-a7b7-34225ae0af6d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=14f445fe-22fb-4d4f-9165-d9c08a7d0946,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:34.759172 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58880) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:34.807677 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2590aab5-52f2-44aa-92f6-1661d8dbc85c None None] Pushing event updated for resources: {'Port': ['ID=5c493b55-ee04-4498-9f43-08b4368cccc7,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:34.826777 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] Routers {'25046774-92e5-4d58-9896-0cb0ec8db37d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:20:34.827602 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:20:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['25046774-92e5-4d58-9896-0cb0ec8db37d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:34.885102 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3c16c6ab-6c13-48d1-bd4d-5ccd2817eddc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:34.918154 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-d7b5422c-88f7-48c5-8cbb-89a2ae78fd29 admin admin] Allocated IP 172.20.0.1 (ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b/15309006-587d-43b0-b8f1-2fa0af9cd690/043c272b-5b0f-4228-8f3e-d5f6d766f6f1) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:20:34.994745 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] Set router 25046774-92e5-4d58-9896-0cb0ec8db37d gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:20:35.027373 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3c16c6ab-6c13-48d1-bd4d-5ccd2817eddc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:35.073404 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-3c16c6ab-6c13-48d1-bd4d-5ccd2817eddc admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['876ab953-3db4-46d2-9330-49972e15ea26']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:35.087471 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-3c16c6ab-6c13-48d1-bd4d-5ccd2817eddc admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b70f29bc-4beb-48f2-8103-60378159b4bc') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:35.087912 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-3c16c6ab-6c13-48d1-bd4d-5ccd2817eddc admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b70f29bc-4beb-48f2-8103-60378159b4bc') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:35.101009 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3c16c6ab-6c13-48d1-bd4d-5ccd2817eddc admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:35.111842 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d7b5422c-88f7-48c5-8cbb-89a2ae78fd29 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:35.125041 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c571e3fc-1324-4869-a83b-666281fa9d98 req-fdca9145-750b-46ad-86e0-dfbc51184be7 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:35.127501 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c571e3fc-1324-4869-a83b-666281fa9d98 req-fdca9145-750b-46ad-86e0-dfbc51184be7 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/ports?device_id=a007b30a-1cc1-4d65-b263-1bd9d1a84b3b HTTP/1.1" status: 200 len: 932 time: 0.1030686 Dec 09 21:20:35.128281 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3c16c6ab-6c13-48d1-bd4d-5ccd2817eddc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:35.136284 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3c16c6ab-6c13-48d1-bd4d-5ccd2817eddc admin admin] Releasing vlan 142 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:20:35.136998 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3c16c6ab-6c13-48d1-bd4d-5ccd2817eddc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:20:35.139384 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:20:35.178740 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d7b5422c-88f7-48c5-8cbb-89a2ae78fd29 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:35.220092 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7b5422c-88f7-48c5-8cbb-89a2ae78fd29 admin admin] Network ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:20:35.225454 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-d7b5422c-88f7-48c5-8cbb-89a2ae78fd29 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:20:35.226404 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3c16c6ab-6c13-48d1-bd4d-5ccd2817eddc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:35.232396 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7b5422c-88f7-48c5-8cbb-89a2ae78fd29 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:20:35.239238 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c571e3fc-1324-4869-a83b-666281fa9d98 req-3f810a83-4289-49ef-b611-cc85831ccd8b tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/security-groups?id=dea88e67-805c-4990-af94-aeeaf2d8e160&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1043217 Dec 09 21:20:35.241759 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3c16c6ab-6c13-48d1-bd4d-5ccd2817eddc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:35.245189 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3c16c6ab-6c13-48d1-bd4d-5ccd2817eddc admin admin] 10.222.0.13 "DELETE /v2.0/networks/876ab953-3db4-46d2-9330-49972e15ea26 HTTP/1.1" status: 204 len: 168 time: 0.4839563 Dec 09 21:20:35.256044 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c16c6ab-6c13-48d1-bd4d-5ccd2817eddc admin admin] Pushing event deleted for resources: {'Network': ['ID=876ab953-3db4-46d2-9330-49972e15ea26,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:35.316015 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7b5422c-88f7-48c5-8cbb-89a2ae78fd29 admin admin] Pushing event updated for resources: {'Port': ['ID=043c272b-5b0f-4228-8f3e-d5f6d766f6f1,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:35.316874 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '25046774-92e5-4d58-9896-0cb0ec8db37d', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-1508066431-router', 'tenant_id': '7d5e8ae60543498f8ee03684e80c1aa1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.157'}], 'enable_snat': True}, 'gw_port_id': '5c493b55-ee04-4498-9f43-08b4368cccc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:20:30Z', 'updated_at': '2021-12-09T21:20:32Z', 'revision_number': 3, 'project_id': '7d5e8ae60543498f8ee03684e80c1aa1', 'gw_port': {'id': '5c493b55-ee04-4498-9f43-08b4368cccc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:d1:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '25046774-92e5-4d58-9896-0cb0ec8db37d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:31Z', 'updated_at': '2021-12-09T21:20:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:35.346108 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d7b5422c-88f7-48c5-8cbb-89a2ae78fd29 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:35.362150 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-210c1266-738f-482b-be9b-a835e1b24baa None None] The sync data for ids ['25046774-92e5-4d58-9896-0cb0ec8db37d'] in n-d-713301-27 is: [{'id': '25046774-92e5-4d58-9896-0cb0ec8db37d', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-1508066431-router', 'tenant_id': '7d5e8ae60543498f8ee03684e80c1aa1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.157'}], 'enable_snat': True}, 'gw_port_id': '5c493b55-ee04-4498-9f43-08b4368cccc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:20:30Z', 'updated_at': '2021-12-09T21:20:32Z', 'revision_number': 3, 'project_id': '7d5e8ae60543498f8ee03684e80c1aa1', 'gw_port': {'id': '5c493b55-ee04-4498-9f43-08b4368cccc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:d1:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '25046774-92e5-4d58-9896-0cb0ec8db37d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:31Z', 'updated_at': '2021-12-09T21:20:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:20:35.492061 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-75bf3027-da5f-4a34-9097-0ffd04ac55e9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:35.555381 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e525a275-638a-4fe7-981c-c559e91689da req-93c516d7-dfe4-4a67-aa5a-d63563c5acbe tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:35.571469 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e525a275-638a-4fe7-981c-c559e91689da req-93c516d7-dfe4-4a67-aa5a-d63563c5acbe tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 950 time: 0.1617012 Dec 09 21:20:35.621363 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58898) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:35.703480 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d7b5422c-88f7-48c5-8cbb-89a2ae78fd29 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:35.733994 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ab2db610-1910-4894-ac7b-c2098c97167a None None] Provisioning complete for port 043c272b-5b0f-4228-8f3e-d5f6d766f6f1 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:35.734901 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ab2db610-1910-4894-ac7b-c2098c97167a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:35.741967 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e525a275-638a-4fe7-981c-c559e91689da req-25dad4ca-25b6-4a51-91be-d598aec7da6c tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1695218 Dec 09 21:20:35.790024 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9861a701-c2d9-498d-a1a3-1b8fb8898b11 req-a48bf26b-6085-41c5-ae41-d76b18cd7cdf tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 210 time: 0.0949342 Dec 09 21:20:35.812647 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58900) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:35.848476 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ab2db610-1910-4894-ac7b-c2098c97167a None None] Port 043c272b-5b0f-4228-8f3e-d5f6d766f6f1 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:20:35.867140 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bb9eb137-7800-4e25-9ccd-b84f27354404 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e025a7c9b8e843eeb18b06f2f222f6fc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1826560 Dec 09 21:20:36.090166 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b942f7c1-6ee3-4304-b5a7-c3219b03fac6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:36.128922 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b942f7c1-6ee3-4304-b5a7-c3219b03fac6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:36.131870 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d7b5422c-88f7-48c5-8cbb-89a2ae78fd29 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:36.142905 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d7b5422c-88f7-48c5-8cbb-89a2ae78fd29 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:36.195801 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d7b5422c-88f7-48c5-8cbb-89a2ae78fd29 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:36.377887 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7b5422c-88f7-48c5-8cbb-89a2ae78fd29 admin admin] Pushing event updated for resources: {'Port': ['ID=043c272b-5b0f-4228-8f3e-d5f6d766f6f1,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:36.398763 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7b5422c-88f7-48c5-8cbb-89a2ae78fd29 admin admin] Network ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:20:36.400807 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-d7b5422c-88f7-48c5-8cbb-89a2ae78fd29 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:20:36.418837 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5d1be56-00c9-4f50-bb21-5d73efc60acf req-cf03f274-a4eb-4072-aefc-3801a07d5a4f tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:36.426943 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b5d1be56-00c9-4f50-bb21-5d73efc60acf req-cf03f274-a4eb-4072-aefc-3801a07d5a4f tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/ports?device_id=a007b30a-1cc1-4d65-b263-1bd9d1a84b3b HTTP/1.1" status: 200 len: 932 time: 0.0788734 Dec 09 21:20:36.506795 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:36.519788 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b942f7c1-6ee3-4304-b5a7-c3219b03fac6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:36.527846 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b942f7c1-6ee3-4304-b5a7-c3219b03fac6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:36.535096 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b942f7c1-6ee3-4304-b5a7-c3219b03fac6 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/07ef3f3f-76b2-4d39-8035-da97760a9b14 HTTP/1.1" status: 204 len: 168 time: 0.7211699 Dec 09 21:20:36.546485 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b5d1be56-00c9-4f50-bb21-5d73efc60acf req-8618f298-63fd-4db5-b150-ae0de169c29c tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/security-groups?id=dea88e67-805c-4990-af94-aeeaf2d8e160&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1171386 Dec 09 21:20:36.720864 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b942f7c1-6ee3-4304-b5a7-c3219b03fac6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=07ef3f3f-76b2-4d39-8035-da97760a9b14,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:36.732796 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d7b5422c-88f7-48c5-8cbb-89a2ae78fd29 admin admin] Router 25046774-92e5-4d58-9896-0cb0ec8db37d has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:20:36.898016 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8adf32e3-be31-44b8-96bb-3816e34e174c None None] Provisioning complete for port 043c272b-5b0f-4228-8f3e-d5f6d766f6f1 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:36.904908 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8adf32e3-be31-44b8-96bb-3816e34e174c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:36.974154 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d7b5422c-88f7-48c5-8cbb-89a2ae78fd29 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:20:36.979215 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d7b5422c-88f7-48c5-8cbb-89a2ae78fd29 admin admin] 10.222.0.13 "PUT /v2.0/routers/25046774-92e5-4d58-9896-0cb0ec8db37d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.8782940 Dec 09 21:20:36.995739 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-8adf32e3-be31-44b8-96bb-3816e34e174c None None] Port 043c272b-5b0f-4228-8f3e-d5f6d766f6f1 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:20:37.074931 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e6114bd-0388-4cfb-809b-3759f859890d req-ff74b442-1a41-4256-a8a6-a2589d623895 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 210 time: 0.0872519 Dec 09 21:20:37.114939 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1712e5a5-bfb5-41e9-b730-b7f853cbbb0b req-621c198c-9980-4cf1-90c0-7088422a4021 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:37.116859 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1712e5a5-bfb5-41e9-b730-b7f853cbbb0b req-621c198c-9980-4cf1-90c0-7088422a4021 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 950 time: 0.1993177 Dec 09 21:20:37.230478 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1712e5a5-bfb5-41e9-b730-b7f853cbbb0b req-02636157-38db-4a7d-9452-aa1eb79edafa tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1070623 Dec 09 21:20:37.662363 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-70c1a876-90f0-42c6-aac6-4ed12f70bb7b req-baf1bee8-9129-465c-b4fa-65ed8b75e121 tempest-FloatingIPDetailsNegativeTestJSON-55182134 tempest-FloatingIPDetailsNegativeTestJSON-55182134-project] show failed (client error): The resource could not be found. Dec 09 21:20:37.680858 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58946) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:37.704047 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-70c1a876-90f0-42c6-aac6-4ed12f70bb7b req-baf1bee8-9129-465c-b4fa-65ed8b75e121 tempest-FloatingIPDetailsNegativeTestJSON-55182134 tempest-FloatingIPDetailsNegativeTestJSON-55182134-project] 10.222.0.13 "GET /v2.0/floatingips/47bd2a15-087f-43a7-8edf-d5265ec543ba HTTP/1.1" status: 404 len: 350 time: 0.1494126 Dec 09 21:20:37.843253 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eeff082-e0b2-4c50-8f5d-5157c53f6273 req-9bcdcc53-6ba7-43b3-bc99-0ba4e819f034 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:37.845302 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:37.861511 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0eeff082-e0b2-4c50-8f5d-5157c53f6273 req-9bcdcc53-6ba7-43b3-bc99-0ba4e819f034 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/ports?device_id=a007b30a-1cc1-4d65-b263-1bd9d1a84b3b HTTP/1.1" status: 200 len: 932 time: 0.2018547 Dec 09 21:20:37.904831 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5c493b55-ee04-4498-9f43-08b4368cccc7 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:20:37.937081 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58950) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:37.984730 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0eeff082-e0b2-4c50-8f5d-5157c53f6273 req-172cfd54-b6ed-41be-951c-324e75d52971 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/security-groups?id=dea88e67-805c-4990-af94-aeeaf2d8e160&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1223938 Dec 09 21:20:37.998442 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 5c493b55-ee04-4498-9f43-08b4368cccc7 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:37.999013 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:38.043488 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] Sync routers for ids ['25046774-92e5-4d58-9896-0cb0ec8db37d'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:20:38.069159 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] Routers {'25046774-92e5-4d58-9896-0cb0ec8db37d'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:20:38.069807 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:20:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['25046774-92e5-4d58-9896-0cb0ec8db37d'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:38.186986 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] Set router 25046774-92e5-4d58-9896-0cb0ec8db37d gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:20:38.216208 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-f1f90dab-a9ea-4d29-be61-7cb0e33c4c18 admin admin] Request body: {'network': {'name': 'tempest-ServersTestJSON-799420296-network', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:38.270137 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fbecc63-2264-438c-b6a0-6a2f27ecd931 req-50455c75-a9b9-45ad-add8-81e33931e53f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 210 time: 0.0602734 Dec 09 21:20:38.386173 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb1f4d27-ed11-4dc0-829e-9543641237eb req-ad806440-a88d-41d8-9a25-002c1e1fd52e tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:38.396145 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eb1f4d27-ed11-4dc0-829e-9543641237eb req-ad806440-a88d-41d8-9a25-002c1e1fd52e tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 950 time: 0.0787494 Dec 09 21:20:38.484687 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eb1f4d27-ed11-4dc0-829e-9543641237eb req-67306a8c-12ea-4530-be00-bddd990f4a27 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0820875 Dec 09 21:20:38.559150 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f1f90dab-a9ea-4d29-be61-7cb0e33c4c18 admin admin] Made reservation on behalf of 9f7c325888174a43bdb0cea626873b0e for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:20:38.561853 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f1f90dab-a9ea-4d29-be61-7cb0e33c4c18 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:38.574333 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f1f90dab-a9ea-4d29-be61-7cb0e33c4c18 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:38.601824 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 36925110-4ed7-49f6-b07d-d998896a74cc no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:20:38.666833 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:38.745423 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 5c493b55-ee04-4498-9f43-08b4368cccc7, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5c493b55-ee04-4498-9f43-08b4368cccc7,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:38.783537 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:38.787031 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e76ceb81-9105-4a5b-bfd8-4d1179446c44 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:38.845900 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:38.866051 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f1f90dab-a9ea-4d29-be61-7cb0e33c4c18 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:38.875478 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f1f90dab-a9ea-4d29-be61-7cb0e33c4c18 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:38.876439 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=5c493b55-ee04-4498-9f43-08b4368cccc7,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:38.912560 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '89bd78b4-a499-4908-8ee4-7b3f64653d0b', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '36925110-4ed7-49f6-b07d-d998896a74cc'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:20:38.917534 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8d9e2e84-74de-4fc3-99fe-81df0033a0e6" -d '{"events": [{"server_uuid": "89bd78b4-a499-4908-8ee4-7b3f64653d0b", "name": "network-vif-unplugged", "status": "completed", "tag": "36925110-4ed7-49f6-b07d-d998896a74cc"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:20:38.935109 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '25046774-92e5-4d58-9896-0cb0ec8db37d', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-1508066431-router', 'tenant_id': '7d5e8ae60543498f8ee03684e80c1aa1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.157'}], 'enable_snat': True}, 'gw_port_id': '5c493b55-ee04-4498-9f43-08b4368cccc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:20:30Z', 'updated_at': '2021-12-09T21:20:35Z', 'revision_number': 4, 'project_id': '7d5e8ae60543498f8ee03684e80c1aa1', 'gw_port': {'id': '5c493b55-ee04-4498-9f43-08b4368cccc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:d1:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '25046774-92e5-4d58-9896-0cb0ec8db37d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:31Z', 'updated_at': '2021-12-09T21:20:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '043c272b-5b0f-4228-8f3e-d5f6d766f6f1', 'name': '', 'network_id': 'ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b', 'tenant_id': '7d5e8ae60543498f8ee03684e80c1aa1', 'mac_address': 'fa:16:3e:11:2d:0f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '25046774-92e5-4d58-9896-0cb0ec8db37d', 'device_owner': 'network:router_interface', 'standard_attr_id': 583, 'fixed_ips': [{'subnet_id': '15309006-587d-43b0-b8f1-2fa0af9cd690', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:34Z', 'updated_at': '2021-12-09T21:20:35Z', 'revision_number': 2, 'project_id': '7d5e8ae60543498f8ee03684e80c1aa1', 'subnets': [{'id': '15309006-587d-43b0-b8f1-2fa0af9cd690', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:38.953384 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f1f90dab-a9ea-4d29-be61-7cb0e33c4c18 admin admin] vlan segment allocate from pool success with {'vlan_id': 145, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:20:38.986982 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f1f90dab-a9ea-4d29-be61-7cb0e33c4c18 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:38.987552 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-f1f90dab-a9ea-4d29-be61-7cb0e33c4c18 admin admin] Added segment 6827180a-5aaf-4697-a7f8-e56a6f614fc7 of type vlan for network 0a4691ff-8eab-4fe6-bec4-b1a20a69fce2 Dec 09 21:20:38.989465 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1f90dab-a9ea-4d29-be61-7cb0e33c4c18 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3850674a-96dd-4357-ad3f-a74e629c98a6,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:38.991676 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] Checking router: 25046774-92e5-4d58-9896-0cb0ec8db37d for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:20:38.992473 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] Updating router 25046774-92e5-4d58-9896-0cb0ec8db37d port 043c272b-5b0f-4228-8f3e-d5f6d766f6f1 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:20:38.995495 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:20:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3a701ebd-b51e-4410-9f99-57a7a9da0dab x-openstack-request-id: req-3a701ebd-b51e-4410-9f99-57a7a9da0dab {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:20:38.996017 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "89bd78b4-a499-4908-8ee4-7b3f64653d0b", "name": "network-vif-unplugged", "status": "completed", "tag": "36925110-4ed7-49f6-b07d-d998896a74cc", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:20:38.996447 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-3a701ebd-b51e-4410-9f99-57a7a9da0dab {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:20:38.997166 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '89bd78b4-a499-4908-8ee4-7b3f64653d0b', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '36925110-4ed7-49f6-b07d-d998896a74cc', 'code': 200} Dec 09 21:20:39.000151 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 36925110-4ed7-49f6-b07d-d998896a74cc, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=36925110-4ed7-49f6-b07d-d998896a74cc,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:39.020027 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:39.053282 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f1f90dab-a9ea-4d29-be61-7cb0e33c4c18 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:39.054437 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:39.122134 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=36925110-4ed7-49f6-b07d-d998896a74cc,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:39.140698 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-448e6c1a-5983-4e5b-aca5-c30a8886acfc req-12161d2c-259a-4247-bbf7-d0c77dc36545 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:39.142417 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-448e6c1a-5983-4e5b-aca5-c30a8886acfc req-12161d2c-259a-4247-bbf7-d0c77dc36545 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/ports?device_id=a007b30a-1cc1-4d65-b263-1bd9d1a84b3b HTTP/1.1" status: 200 len: 932 time: 0.0645783 Dec 09 21:20:39.146100 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f1f90dab-a9ea-4d29-be61-7cb0e33c4c18 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:39.147211 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1f90dab-a9ea-4d29-be61-7cb0e33c4c18 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:39.147808 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f1f90dab-a9ea-4d29-be61-7cb0e33c4c18 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:39.195413 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58974) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:39.196023 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f1f90dab-a9ea-4d29-be61-7cb0e33c4c18 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 878 time: 1.2572138 Dec 09 21:20:39.205569 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-f44f5635-efde-453c-bedb-b5e30ae2c8f1 admin admin] Request body: {'subnet': {'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestJSON-799420296-subnet', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:39.215601 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-448e6c1a-5983-4e5b-aca5-c30a8886acfc req-67835c7e-d269-4b99-ba88-59a6dea21fcb tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/security-groups?id=dea88e67-805c-4990-af94-aeeaf2d8e160&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0642965 Dec 09 21:20:39.235900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1f90dab-a9ea-4d29-be61-7cb0e33c4c18 admin admin] Pushing event updated for resources: {'Network': ['ID=0a4691ff-8eab-4fe6-bec4-b1a20a69fce2,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:39.242974 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f44f5635-efde-453c-bedb-b5e30ae2c8f1 admin admin] Made reservation on behalf of 9f7c325888174a43bdb0cea626873b0e for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:20:39.246104 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f44f5635-efde-453c-bedb-b5e30ae2c8f1 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:39.252217 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 0a4691ff-8eab-4fe6-bec4-b1a20a69fce2 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:20:39.347572 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-e76ceb81-9105-4a5b-bfd8-4d1179446c44 admin admin] Deleting port 043c272b-5b0f-4228-8f3e-d5f6d766f6f1 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:20:39.347951 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e76ceb81-9105-4a5b-bfd8-4d1179446c44 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:39.380850 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:39.403920 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-199a0b32-23f9-4514-bdf8-a5ebb16baf5e req-c20d2831-4867-4a5d-9750-189ea9c86cb9 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 210 time: 0.0500212 Dec 09 21:20:39.450838 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e76ceb81-9105-4a5b-bfd8-4d1179446c44 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:39.464253 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-e76ceb81-9105-4a5b-bfd8-4d1179446c44 admin admin] Calling delete_port for 043c272b-5b0f-4228-8f3e-d5f6d766f6f1 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:20:39.468729 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f44f5635-efde-453c-bedb-b5e30ae2c8f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:39.478013 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:39.483545 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:39.534869 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f44f5635-efde-453c-bedb-b5e30ae2c8f1 admin admin] Checking segment: {'id': '6827180a-5aaf-4697-a7f8-e56a6f614fc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:20:39.535046 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f44f5635-efde-453c-bedb-b5e30ae2c8f1 admin admin] Network hostable DHCP agents. Network: 0a4691ff-8eab-4fe6-bec4-b1a20a69fce2, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:20:39.537671 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4138d939-bba6-4ec5-8ea4-a060f2c614bf None None] Pushing event updated for resources: {'Port': ['ID=043c272b-5b0f-4228-8f3e-d5f6d766f6f1,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:39.537979 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f44f5635-efde-453c-bedb-b5e30ae2c8f1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=006a974f-ca2f-40a9-b5ee-25ae5235c5b1,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:39.562758 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f44f5635-efde-453c-bedb-b5e30ae2c8f1 admin admin] Network 0a4691ff-8eab-4fe6-bec4-b1a20a69fce2 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:20:39.578309 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-f44f5635-efde-453c-bedb-b5e30ae2c8f1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 0a4691ff-8eab-4fe6-bec4-b1a20a69fce2) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:20:39.583832 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f44f5635-efde-453c-bedb-b5e30ae2c8f1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:39.584434 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f44f5635-efde-453c-bedb-b5e30ae2c8f1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:39.604938 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] Attempting to bind port 043c272b-5b0f-4228-8f3e-d5f6d766f6f1 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:20:39.605397 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] Attempting to bind port 043c272b-5b0f-4228-8f3e-d5f6d766f6f1 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'af4025cf-5dc2-4085-8a58-84ccccefa44e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:20:39.605849 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] Attempting to bind port 043c272b-5b0f-4228-8f3e-d5f6d766f6f1 on network ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:20:39.616940 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 20, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:20:39.617437 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] Checking segment: {'id': 'af4025cf-5dc2-4085-8a58-84ccccefa44e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:20:39.618931 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:39.619076 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] Bound using segment: {'id': 'af4025cf-5dc2-4085-8a58-84ccccefa44e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:20:39.619555 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] Bound port: 043c272b-5b0f-4228-8f3e-d5f6d766f6f1, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'af4025cf-5dc2-4085-8a58-84ccccefa44e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:20:39.619961 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:39.629126 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bad5422f-ffb4-4459-98da-e95a20f4cc0c None None] Network 0a4691ff-8eab-4fe6-bec4-b1a20a69fce2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:20:39.634166 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f44f5635-efde-453c-bedb-b5e30ae2c8f1 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 841 time: 0.4347270 Dec 09 21:20:39.636977 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-2352b9d6-7089-4791-8b3d-54d2f22d7558 service neutron] Request body: {'port': {'device_id': 'a007b30a-1cc1-4d65-b263-1bd9d1a84b3b', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:39.658092 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-556c7715-60c7-4aef-82d9-7d102f3813e8 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Request body: {'port': {'device_id': 'e9419ae1-ea8a-47ae-82d5-b82f1353ca2f', 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6', 'admin_state_up': True, 'tenant_id': '7233ac85d55e4123a22cfa34bc1ee70e'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:39.668746 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58980) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:39.706600 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e76ceb81-9105-4a5b-bfd8-4d1179446c44 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:39.758485 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c58442b8-dc66-4022-b614-63a60ff3c594 admin admin] Request body: {'router': {'name': 'tempest-ServersTestJSON-799420296-router', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:39.766181 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e76ceb81-9105-4a5b-bfd8-4d1179446c44 admin admin] Pushing event deleted for resources: {'Port': ['ID=043c272b-5b0f-4228-8f3e-d5f6d766f6f1,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:39.804077 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] Port 043c272b-5b0f-4228-8f3e-d5f6d766f6f1 has been deleted concurrently {{(pid=103439) _commit_port_binding /opt/stack/neutron/neutron/plugins/ml2/plugin.py:665}} Dec 09 21:20:39.817345 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c58442b8-dc66-4022-b614-63a60ff3c594 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:39.818436 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c58442b8-dc66-4022-b614-63a60ff3c594 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:39.844200 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5c493b55-ee04-4498-9f43-08b4368cccc7 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:20:39.881690 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79455526-ff42-48d6-8a49-8535f710b40d req-d388812f-8aaf-4077-8254-033646005943 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:39.883242 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-79455526-ff42-48d6-8a49-8535f710b40d req-d388812f-8aaf-4077-8254-033646005943 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b&tenant_id=857de64ecc3946e3b92655f639d782df HTTP/1.1" status: 200 len: 1100 time: 0.1351740 Dec 09 21:20:39.910413 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] Routers {'25046774-92e5-4d58-9896-0cb0ec8db37d'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:20:39.911061 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:20:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['25046774-92e5-4d58-9896-0cb0ec8db37d'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:39.969961 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-242ffe72-6eb7-46ed-94a3-3a1751fb0e7d req-0580c3ae-3cb3-4244-935f-81e579cc19b0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:39.971966 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] Request body: {'port': {'binding:host_id': 'n-h2-713301-27', 'device_owner': 'compute:nova'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:39.977370 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-242ffe72-6eb7-46ed-94a3-3a1751fb0e7d req-0580c3ae-3cb3-4244-935f-81e579cc19b0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 948 time: 0.3105338 Dec 09 21:20:39.983524 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-2352b9d6-7089-4791-8b3d-54d2f22d7558 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:39.995630 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-db838106-8481-411b-b4a9-86d717a2b7b8 None None] Could not find standard attr ID for object 043c272b-5b0f-4228-8f3e-d5f6d766f6f1. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:20:40.039398 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c58442b8-dc66-4022-b614-63a60ff3c594 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:40.063830 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7eed7421-2f3d-424c-80d9-545e7b319bf4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-0a4691ff-8eab-4fe6-bec4-b1a20a69fce2', 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2', 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'fixed_ips': [{'subnet_id': '006a974f-ca2f-40a9-b5ee-25ae5235c5b1'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:20:40.064672 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7eed7421-2f3d-424c-80d9-545e7b319bf4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:40.109771 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 5c493b55-ee04-4498-9f43-08b4368cccc7 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:40.110330 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:40.137091 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e76ceb81-9105-4a5b-bfd8-4d1179446c44 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:40.152677 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:40.196791 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c58442b8-dc66-4022-b614-63a60ff3c594 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:40.225523 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] Set router 25046774-92e5-4d58-9896-0cb0ec8db37d gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:20:40.383863 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-242ffe72-6eb7-46ed-94a3-3a1751fb0e7d req-3ab4653e-da5b-476e-bb49-7ba890022cf6 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4055645 Dec 09 21:20:40.408562 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-556c7715-60c7-4aef-82d9-7d102f3813e8 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Made reservation on behalf of 7233ac85d55e4123a22cfa34bc1ee70e for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:20:40.412570 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-556c7715-60c7-4aef-82d9-7d102f3813e8 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:40.479879 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-7eed7421-2f3d-424c-80d9-545e7b319bf4 None None] Allocated IP 172.20.0.2 (0a4691ff-8eab-4fe6-bec4-b1a20a69fce2/006a974f-ca2f-40a9-b5ee-25ae5235c5b1/2785f38a-e3ed-4484-b164-42ca4115087e) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:20:40.533118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7019c3a9-8da5-4fd4-a5cc-aa20cd27d127 req-fc6fde15-be68-41ff-be5b-db3b234b4a16 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:40.534498 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7019c3a9-8da5-4fd4-a5cc-aa20cd27d127 req-fc6fde15-be68-41ff-be5b-db3b234b4a16 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/ports?device_id=a007b30a-1cc1-4d65-b263-1bd9d1a84b3b HTTP/1.1" status: 200 len: 932 time: 0.1921780 Dec 09 21:20:40.567043 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] For port 36925110-4ed7-49f6-b07d-d998896a74cc, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=36925110-4ed7-49f6-b07d-d998896a74cc,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:40.591402 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e76ceb81-9105-4a5b-bfd8-4d1179446c44 admin admin] Router 25046774-92e5-4d58-9896-0cb0ec8db37d has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:20:40.617677 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] For port 36925110-4ed7-49f6-b07d-d998896a74cc, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:20:40.633595 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1ab8afa9-04c8-474e-9860-269bcd0f73f1 req-d5cec705-4372-4f39-8596-01f35c8ecc7c tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 210 time: 0.0634162 Dec 09 21:20:40.690406 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 36925110-4ed7-49f6-b07d-d998896a74cc {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:20:40.701370 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:40.752484 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] Transition to ACTIVE for port object 36925110-4ed7-49f6-b07d-d998896a74cc will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:20:40.764464 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:40.767735 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7019c3a9-8da5-4fd4-a5cc-aa20cd27d127 req-3a9a9a14-f50c-4820-9ba6-c1d504195bd8 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/security-groups?id=dea88e67-805c-4990-af94-aeeaf2d8e160&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1989763 Dec 09 21:20:40.787025 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '25046774-92e5-4d58-9896-0cb0ec8db37d', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-1508066431-router', 'tenant_id': '7d5e8ae60543498f8ee03684e80c1aa1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.157'}], 'enable_snat': True}, 'gw_port_id': '5c493b55-ee04-4498-9f43-08b4368cccc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:20:30Z', 'updated_at': '2021-12-09T21:20:39Z', 'revision_number': 5, 'project_id': '7d5e8ae60543498f8ee03684e80c1aa1', 'gw_port': {'id': '5c493b55-ee04-4498-9f43-08b4368cccc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:d1:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25046774-92e5-4d58-9896-0cb0ec8db37d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:31Z', 'updated_at': '2021-12-09T21:20:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:40.792436 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-556c7715-60c7-4aef-82d9-7d102f3813e8 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Allocated IP 172.20.0.2 (8e0b26d7-eefe-4c85-b535-944f3c15f0f6/63e7603a-bb11-4d1a-8d84-55456d81931c/b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:20:40.797561 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e76ceb81-9105-4a5b-bfd8-4d1179446c44 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:20:40.818986 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58992) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:40.826588 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e76ceb81-9105-4a5b-bfd8-4d1179446c44 admin admin] 10.222.0.13 "PUT /v2.0/routers/25046774-92e5-4d58-9896-0cb0ec8db37d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1261923 Dec 09 21:20:40.845537 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0cc4af3e-3963-4d5d-a150-a49b686c5c3a None None] The sync data for ids ['25046774-92e5-4d58-9896-0cb0ec8db37d'] in n-d-713301-27 is: [{'id': '25046774-92e5-4d58-9896-0cb0ec8db37d', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-1508066431-router', 'tenant_id': '7d5e8ae60543498f8ee03684e80c1aa1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.157'}], 'enable_snat': True}, 'gw_port_id': '5c493b55-ee04-4498-9f43-08b4368cccc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:20:30Z', 'updated_at': '2021-12-09T21:20:39Z', 'revision_number': 5, 'project_id': '7d5e8ae60543498f8ee03684e80c1aa1', 'gw_port': {'id': '5c493b55-ee04-4498-9f43-08b4368cccc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:d1:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25046774-92e5-4d58-9896-0cb0ec8db37d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:31Z', 'updated_at': '2021-12-09T21:20:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:20:40.893792 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] No DVR routers for this DVR port 36925110-4ed7-49f6-b07d-d998896a74cc on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:20:40.896643 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] Pushing event updated for resources: {'Port': ['ID=36925110-4ed7-49f6-b07d-d998896a74cc,revision_number=7']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:40.921695 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-2352b9d6-7089-4791-8b3d-54d2f22d7558 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3eba2279-4b83-4ab6-bde7-0305ee1eda1f {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:20:40.927930 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7eed7421-2f3d-424c-80d9-545e7b319bf4 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:40.933924 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-2352b9d6-7089-4791-8b3d-54d2f22d7558 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:40.941233 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7eed7421-2f3d-424c-80d9-545e7b319bf4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:40.953131 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-2352b9d6-7089-4791-8b3d-54d2f22d7558 service neutron] Transition to ACTIVE for port object 3eba2279-4b83-4ab6-bde7-0305ee1eda1f will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:20:41.002148 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] Attempting to bind port 36925110-4ed7-49f6-b07d-d998896a74cc on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:20:41.002555 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] Attempting to bind port 36925110-4ed7-49f6-b07d-d998896a74cc by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:20:41.007695 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] Attempting to bind port 36925110-4ed7-49f6-b07d-d998896a74cc on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:20:41.021527 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] Port 36925110-4ed7-49f6-b07d-d998896a74cc on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:20:41.022380 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] Attempting to bind port 36925110-4ed7-49f6-b07d-d998896a74cc on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:20:41.041739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 20, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:20:41.053996 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:20:41.056406 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:20:41.057668 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] Bound port: 36925110-4ed7-49f6-b07d-d998896a74cc, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:20:41.058922 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:41.071019 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eed7421-2f3d-424c-80d9-545e7b319bf4 None None] Pushing event updated for resources: {'Port': ['ID=2785f38a-e3ed-4484-b164-42ca4115087e,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:41.130813 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7eed7421-2f3d-424c-80d9-545e7b319bf4 None None] Network 0a4691ff-8eab-4fe6-bec4-b1a20a69fce2 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:20:41.132659 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-7eed7421-2f3d-424c-80d9-545e7b319bf4 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:20:41.144435 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7eed7421-2f3d-424c-80d9-545e7b319bf4 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:20:41.169480 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a778b7e-33e9-4a2b-adde-8eacfff50f90 admin admin] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:41.208464 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] For port 36925110-4ed7-49f6-b07d-d998896a74cc, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:20:41.217613 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] For port 36925110-4ed7-49f6-b07d-d998896a74cc, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=36925110-4ed7-49f6-b07d-d998896a74cc,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:20:41.228903 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:41.273898 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-7eed7421-2f3d-424c-80d9-545e7b319bf4 None None] Attempting to bind port 2785f38a-e3ed-4484-b164-42ca4115087e on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:20:41.275147 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-7eed7421-2f3d-424c-80d9-545e7b319bf4 None None] Attempting to bind port 2785f38a-e3ed-4484-b164-42ca4115087e by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '6827180a-5aaf-4697-a7f8-e56a6f614fc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:20:41.275821 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7eed7421-2f3d-424c-80d9-545e7b319bf4 None None] Attempting to bind port 2785f38a-e3ed-4484-b164-42ca4115087e on network 0a4691ff-8eab-4fe6-bec4-b1a20a69fce2 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:20:41.290002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7eed7421-2f3d-424c-80d9-545e7b319bf4 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 20, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:20:41.290836 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7eed7421-2f3d-424c-80d9-545e7b319bf4 None None] Checking segment: {'id': '6827180a-5aaf-4697-a7f8-e56a6f614fc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:20:41.291632 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7eed7421-2f3d-424c-80d9-545e7b319bf4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:41.292257 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7eed7421-2f3d-424c-80d9-545e7b319bf4 None None] Bound using segment: {'id': '6827180a-5aaf-4697-a7f8-e56a6f614fc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:20:41.292961 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-7eed7421-2f3d-424c-80d9-545e7b319bf4 None None] Bound port: 2785f38a-e3ed-4484-b164-42ca4115087e, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6827180a-5aaf-4697-a7f8-e56a6f614fc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:20:41.293763 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7eed7421-2f3d-424c-80d9-545e7b319bf4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:41.314113 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:41.318688 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:41.320366 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-79455526-ff42-48d6-8a49-8535f710b40d req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] 10.222.0.10 "PUT /v2.0/ports/36925110-4ed7-49f6-b07d-d998896a74cc HTTP/1.1" status: 200 len: 1097 time: 1.3559856 Dec 09 21:20:41.322892 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '89bd78b4-a499-4908-8ee4-7b3f64653d0b', 'tag': '36925110-4ed7-49f6-b07d-d998896a74cc'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:20:41.325313 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f6616973-cfea-4763-ab18-cd80533a5717" -d '{"events": [{"name": "network-changed", "server_uuid": "89bd78b4-a499-4908-8ee4-7b3f64653d0b", "tag": "36925110-4ed7-49f6-b07d-d998896a74cc"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:20:41.400249 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-7eed7421-2f3d-424c-80d9-545e7b319bf4 None None] For port 2785f38a-e3ed-4484-b164-42ca4115087e, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:20:41.412860 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-7eed7421-2f3d-424c-80d9-545e7b319bf4 None None] For port 2785f38a-e3ed-4484-b164-42ca4115087e, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2785f38a-e3ed-4484-b164-42ca4115087e,segment=NetworkSegment(6827180a-5aaf-4697-a7f8-e56a6f614fc7),segment_id=6827180a-5aaf-4697-a7f8-e56a6f614fc7)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:20:41.425490 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7eed7421-2f3d-424c-80d9-545e7b319bf4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:41.464186 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7d6704a-0822-491e-8fad-d8badbc4cc7c service neutron] Pushing event updated for resources: {'Port': ['ID=36925110-4ed7-49f6-b07d-d998896a74cc,revision_number=8']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:41.470734 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79455526-ff42-48d6-8a49-8535f710b40d req-7fc2a7b8-72b2-4879-ab02-e96256a27c35 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:41.472694 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-79455526-ff42-48d6-8a49-8535f710b40d req-7fc2a7b8-72b2-4879-ab02-e96256a27c35 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 1100 time: 0.1219976 Dec 09 21:20:41.542257 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:20:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a3d8405a-99c8-4b44-9dde-a94d9618734f x-openstack-request-id: req-a3d8405a-99c8-4b44-9dde-a94d9618734f {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:20:41.542550 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "89bd78b4-a499-4908-8ee4-7b3f64653d0b", "tag": "36925110-4ed7-49f6-b07d-d998896a74cc", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:20:41.542819 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a3d8405a-99c8-4b44-9dde-a94d9618734f {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:20:41.543560 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '89bd78b4-a499-4908-8ee4-7b3f64653d0b', 'tag': '36925110-4ed7-49f6-b07d-d998896a74cc', 'status': 'completed', 'code': 200} Dec 09 21:20:41.609350 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eed7421-2f3d-424c-80d9-545e7b319bf4 None None] Pushing event updated for resources: {'Port': ['ID=2785f38a-e3ed-4484-b164-42ca4115087e,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:41.696129 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79455526-ff42-48d6-8a49-8535f710b40d req-e305cb04-4391-4373-8a71-84756ee99c1c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:41.697480 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-79455526-ff42-48d6-8a49-8535f710b40d req-e305cb04-4391-4373-8a71-84756ee99c1c service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.2157049 Dec 09 21:20:41.760046 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-79455526-ff42-48d6-8a49-8535f710b40d req-707b4815-dd1c-4bbf-b765-eefe0580945a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.140&port_id=36925110-4ed7-49f6-b07d-d998896a74cc HTTP/1.1" status: 200 len: 217 time: 0.0542650 Dec 09 21:20:41.832367 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79455526-ff42-48d6-8a49-8535f710b40d req-dfcf6b77-5207-4be9-ae4c-a73a018af907 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:41.833983 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-79455526-ff42-48d6-8a49-8535f710b40d req-dfcf6b77-5207-4be9-ae4c-a73a018af907 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0648861 Dec 09 21:20:41.877251 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-2352b9d6-7089-4791-8b3d-54d2f22d7558 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:41.901585 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79455526-ff42-48d6-8a49-8535f710b40d req-5aafead4-1dd4-4013-b3ec-8f90886a97f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:41.903228 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-79455526-ff42-48d6-8a49-8535f710b40d req-5aafead4-1dd4-4013-b3ec-8f90886a97f2 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0606830 Dec 09 21:20:42.016389 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a778b7e-33e9-4a2b-adde-8eacfff50f90 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:42.018205 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-79455526-ff42-48d6-8a49-8535f710b40d req-eb2c0373-84d5-42dc-a48c-8d23c678ecab service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1056535 Dec 09 21:20:42.020980 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-732ad0dc-4279-4e0e-942a-41d9d620384b None None] Sync routers for ids ['25046774-92e5-4d58-9896-0cb0ec8db37d'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:20:42.031166 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-732ad0dc-4279-4e0e-942a-41d9d620384b None None] Routers {'25046774-92e5-4d58-9896-0cb0ec8db37d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:20:42.031838 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-732ad0dc-4279-4e0e-942a-41d9d620384b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:20:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['25046774-92e5-4d58-9896-0cb0ec8db37d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:42.045735 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-26d684f9-6d44-4474-9a60-5ed06ed775be req-859bf6c5-ef7c-4a50-9e44-668c46cfd794 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 210 time: 0.1708128 Dec 09 21:20:42.179409 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-732ad0dc-4279-4e0e-942a-41d9d620384b None None] Set router 25046774-92e5-4d58-9896-0cb0ec8db37d gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:20:42.245087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2352b9d6-7089-4791-8b3d-54d2f22d7558 service neutron] Pushing event updated for resources: {'Port': ['ID=3eba2279-4b83-4ab6-bde7-0305ee1eda1f,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:42.251204 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-79455526-ff42-48d6-8a49-8535f710b40d req-2babca57-839e-4ebc-a688-2043734fde1f service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2249727 Dec 09 21:20:42.280836 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6616973-cfea-4763-ab18-cd80533a5717 req-ecbeba97-a338-4e05-8856-2f96d0d7db86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:42.282397 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6616973-cfea-4763-ab18-cd80533a5717 req-ecbeba97-a338-4e05-8856-2f96d0d7db86 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 1100 time: 0.4154875 Dec 09 21:20:42.431278 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6616973-cfea-4763-ab18-cd80533a5717 req-fbcabb79-7fba-4c61-840b-27a69de7d34a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:42.433418 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f6616973-cfea-4763-ab18-cd80533a5717 req-fbcabb79-7fba-4c61-840b-27a69de7d34a service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 1100 time: 0.0874145 Dec 09 21:20:42.483566 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-732ad0dc-4279-4e0e-942a-41d9d620384b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '25046774-92e5-4d58-9896-0cb0ec8db37d', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-1508066431-router', 'tenant_id': '7d5e8ae60543498f8ee03684e80c1aa1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.157'}], 'enable_snat': True}, 'gw_port_id': '5c493b55-ee04-4498-9f43-08b4368cccc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:20:30Z', 'updated_at': '2021-12-09T21:20:39Z', 'revision_number': 5, 'project_id': '7d5e8ae60543498f8ee03684e80c1aa1', 'gw_port': {'id': '5c493b55-ee04-4498-9f43-08b4368cccc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:fd:d1:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '25046774-92e5-4d58-9896-0cb0ec8db37d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 582, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:31Z', 'updated_at': '2021-12-09T21:20:38Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:42.488252 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b55fcd9-aa63-4279-97e9-23021c5685de req-5d3f0056-437f-45f8-beb3-a6c58af1cf15 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:42.495728 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4b55fcd9-aa63-4279-97e9-23021c5685de req-5d3f0056-437f-45f8-beb3-a6c58af1cf15 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 948 time: 0.6194577 Dec 09 21:20:42.592631 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6616973-cfea-4763-ab18-cd80533a5717 req-475ed5e2-52bf-4297-b592-d3429b2e9b54 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:42.594351 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f6616973-cfea-4763-ab18-cd80533a5717 req-475ed5e2-52bf-4297-b592-d3429b2e9b54 service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.1473382 Dec 09 21:20:42.637132 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-732ad0dc-4279-4e0e-942a-41d9d620384b None None] Checking router: 25046774-92e5-4d58-9896-0cb0ec8db37d for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:20:42.646966 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-732ad0dc-4279-4e0e-942a-41d9d620384b None None] Routers {'25046774-92e5-4d58-9896-0cb0ec8db37d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:20:42.647624 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-732ad0dc-4279-4e0e-942a-41d9d620384b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:20:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['25046774-92e5-4d58-9896-0cb0ec8db37d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:42.652105 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f6616973-cfea-4763-ab18-cd80533a5717 req-ee4d56e6-69c8-47ae-b01e-c2a3b94ad2c0 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.140&port_id=36925110-4ed7-49f6-b07d-d998896a74cc HTTP/1.1" status: 200 len: 217 time: 0.0488582 Dec 09 21:20:42.685820 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c58442b8-dc66-4022-b614-63a60ff3c594 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:42.702565 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54b89571-761e-40f7-a90c-888e511264fb req-3d283770-9bf8-4217-9573-f8038fc5d9d6 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:42.710086 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-54b89571-761e-40f7-a90c-888e511264fb req-3d283770-9bf8-4217-9573-f8038fc5d9d6 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/ports?device_id=a007b30a-1cc1-4d65-b263-1bd9d1a84b3b HTTP/1.1" status: 200 len: 944 time: 0.4381070 Dec 09 21:20:42.723066 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6616973-cfea-4763-ab18-cd80533a5717 req-662e5ab8-6adb-4405-9e2b-147e37a1d6eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:42.724632 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f6616973-cfea-4763-ab18-cd80533a5717 req-662e5ab8-6adb-4405-9e2b-147e37a1d6eb service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0648637 Dec 09 21:20:42.745266 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-732ad0dc-4279-4e0e-942a-41d9d620384b None None] Set router 25046774-92e5-4d58-9896-0cb0ec8db37d gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:20:42.745489 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-556c7715-60c7-4aef-82d9-7d102f3813e8 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:42.770823 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c58442b8-dc66-4022-b614-63a60ff3c594 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:42.787998 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4b55fcd9-aa63-4279-97e9-23021c5685de req-43e431f2-1aaf-4e57-ab5f-d2e3e0dccaba tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2864103 Dec 09 21:20:42.802805 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6616973-cfea-4763-ab18-cd80533a5717 req-ef390e4f-c557-49c6-a62a-3389b9a7d631 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:42.804399 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f6616973-cfea-4763-ab18-cd80533a5717 req-ef390e4f-c557-49c6-a62a-3389b9a7d631 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0710266 Dec 09 21:20:42.813439 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-732ad0dc-4279-4e0e-942a-41d9d620384b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '25046774-92e5-4d58-9896-0cb0ec8db37d', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-1508066431-router', 'tenant_id': '7d5e8ae60543498f8ee03684e80c1aa1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:20:30Z', 'updated_at': '2021-12-09T21:20:42Z', 'revision_number': 6, 'project_id': '7d5e8ae60543498f8ee03684e80c1aa1', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:42.815694 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-8a778b7e-33e9-4a2b-adde-8eacfff50f90 admin admin] Deleting port 5c493b55-ee04-4498-9f43-08b4368cccc7 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:20:42.816103 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a778b7e-33e9-4a2b-adde-8eacfff50f90 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:42.839892 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-2352b9d6-7089-4791-8b3d-54d2f22d7558 service neutron] Attempting to bind port 3eba2279-4b83-4ab6-bde7-0305ee1eda1f on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:20:42.840264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-2352b9d6-7089-4791-8b3d-54d2f22d7558 service neutron] Attempting to bind port 3eba2279-4b83-4ab6-bde7-0305ee1eda1f by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '5c779566-9ab2-470d-8b5d-c18c1d216fd1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '1444d8a7-187f-473b-be08-dce40f6ae8ea'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:20:42.840607 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-2352b9d6-7089-4791-8b3d-54d2f22d7558 service neutron] Attempting to bind port 3eba2279-4b83-4ab6-bde7-0305ee1eda1f on network 1444d8a7-187f-473b-be08-dce40f6ae8ea {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:20:42.854673 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-732ad0dc-4279-4e0e-942a-41d9d620384b None None] The sync data for ids ['25046774-92e5-4d58-9896-0cb0ec8db37d'] in n-d-713301-27 is: [{'id': '25046774-92e5-4d58-9896-0cb0ec8db37d', 'name': 'tempest-FloatingIPDetailsNegativeTestJSON-1508066431-router', 'tenant_id': '7d5e8ae60543498f8ee03684e80c1aa1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:20:30Z', 'updated_at': '2021-12-09T21:20:42Z', 'revision_number': 6, 'project_id': '7d5e8ae60543498f8ee03684e80c1aa1', 'gw_port_host': None}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:20:42.915196 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cba3ef8d-1de8-49e5-af5c-2d330208b3da None None] Network 0a4691ff-8eab-4fe6-bec4-b1a20a69fce2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:20:42.925007 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-2352b9d6-7089-4791-8b3d-54d2f22d7558 service neutron] Port 3eba2279-4b83-4ab6-bde7-0305ee1eda1f on network 1444d8a7-187f-473b-be08-dce40f6ae8ea not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:20:42.925943 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-2352b9d6-7089-4791-8b3d-54d2f22d7558 service neutron] Attempting to bind port 3eba2279-4b83-4ab6-bde7-0305ee1eda1f on network 1444d8a7-187f-473b-be08-dce40f6ae8ea {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:20:42.928530 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6616973-cfea-4763-ab18-cd80533a5717 req-cafd9181-7daf-4dd2-bb69-60f052af9509 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:42.930030 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6616973-cfea-4763-ab18-cd80533a5717 req-cafd9181-7daf-4dd2-bb69-60f052af9509 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.6316555 Dec 09 21:20:42.971193 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f6616973-cfea-4763-ab18-cd80533a5717 req-0c44044c-cea1-4d92-8051-a48efd547255 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1432166 Dec 09 21:20:43.019037 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-98b7e039-b802-491a-af50-32c88328b7eb None None] Provisioning complete for port 2785f38a-e3ed-4484-b164-42ca4115087e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:43.019410 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-98b7e039-b802-491a-af50-32c88328b7eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:43.035003 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-2352b9d6-7089-4791-8b3d-54d2f22d7558 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 20, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:20:43.035346 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-2352b9d6-7089-4791-8b3d-54d2f22d7558 service neutron] Checking segment: {'id': '5c779566-9ab2-470d-8b5d-c18c1d216fd1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '1444d8a7-187f-473b-be08-dce40f6ae8ea'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:20:43.035915 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-2352b9d6-7089-4791-8b3d-54d2f22d7558 service neutron] Bound using segment: {'id': '5c779566-9ab2-470d-8b5d-c18c1d216fd1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '1444d8a7-187f-473b-be08-dce40f6ae8ea'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:20:43.036430 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-2352b9d6-7089-4791-8b3d-54d2f22d7558 service neutron] Bound port: 3eba2279-4b83-4ab6-bde7-0305ee1eda1f, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5c779566-9ab2-470d-8b5d-c18c1d216fd1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '1444d8a7-187f-473b-be08-dce40f6ae8ea'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:20:43.036855 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-2352b9d6-7089-4791-8b3d-54d2f22d7558 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:43.073056 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6616973-cfea-4763-ab18-cd80533a5717 req-c93cab56-6c37-4555-9884-0a95867e7ebd service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.140&port_id=36925110-4ed7-49f6-b07d-d998896a74cc HTTP/1.1" status: 200 len: 217 time: 0.1295536 Dec 09 21:20:43.080486 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f6616973-cfea-4763-ab18-cd80533a5717 req-06065cf4-1d5c-40d8-bc20-b2e76503315d service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1012220 Dec 09 21:20:43.098101 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-54b89571-761e-40f7-a90c-888e511264fb req-c904b9ec-8feb-4a85-8edd-bc3579b46079 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/security-groups?id=dea88e67-805c-4990-af94-aeeaf2d8e160&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3870556 Dec 09 21:20:43.177111 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-98b7e039-b802-491a-af50-32c88328b7eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:43.219687 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-98b7e039-b802-491a-af50-32c88328b7eb None None] For port 2785f38a-e3ed-4484-b164-42ca4115087e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2785f38a-e3ed-4484-b164-42ca4115087e,segment=NetworkSegment(6827180a-5aaf-4697-a7f8-e56a6f614fc7),segment_id=6827180a-5aaf-4697-a7f8-e56a6f614fc7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:43.225095 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-98b7e039-b802-491a-af50-32c88328b7eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:43.227821 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-556c7715-60c7-4aef-82d9-7d102f3813e8 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:43.231049 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-8a778b7e-33e9-4a2b-adde-8eacfff50f90 admin admin] For port 5c493b55-ee04-4498-9f43-08b4368cccc7, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5c493b55-ee04-4498-9f43-08b4368cccc7,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:43.231706 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a778b7e-33e9-4a2b-adde-8eacfff50f90 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:43.309572 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98b7e039-b802-491a-af50-32c88328b7eb None None] Pushing event updated for resources: {'Port': ['ID=2785f38a-e3ed-4484-b164-42ca4115087e,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:43.343608 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-8a778b7e-33e9-4a2b-adde-8eacfff50f90 admin admin] Calling delete_port for 5c493b55-ee04-4498-9f43-08b4368cccc7 owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:20:43.353285 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a475c8a-6f6d-47f9-bcd6-983b45e8c529 req-78a27438-c467-4850-b989-3b0c84b50ed0 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:43.362327 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2a475c8a-6f6d-47f9-bcd6-983b45e8c529 req-78a27438-c467-4850-b989-3b0c84b50ed0 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 1098 time: 0.3445349 Dec 09 21:20:43.382949 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6616973-cfea-4763-ab18-cd80533a5717 req-96ffb9bb-e0ad-4c0f-ba3f-1c092afbf95a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:43.384443 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6616973-cfea-4763-ab18-cd80533a5717 req-96ffb9bb-e0ad-4c0f-ba3f-1c092afbf95a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.2788854 Dec 09 21:20:43.390628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-2352b9d6-7089-4791-8b3d-54d2f22d7558 service neutron] For port 3eba2279-4b83-4ab6-bde7-0305ee1eda1f, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:20:43.440637 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-c58442b8-dc66-4022-b614-63a60ff3c594 admin admin] Allocated IP 172.25.3.66 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/3d871078-9873-42c7-9428-2cbedc035380) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:20:43.452383 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4bd7cef3-cd91-4087-b83f-b0dc25bcfcca None None] Provisioning complete for port 2785f38a-e3ed-4484-b164-42ca4115087e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:43.452750 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4bd7cef3-cd91-4087-b83f-b0dc25bcfcca None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:43.471023 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-556c7715-60c7-4aef-82d9-7d102f3813e8 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Network 8e0b26d7-eefe-4c85-b535-944f3c15f0f6 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:20:43.473877 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-2352b9d6-7089-4791-8b3d-54d2f22d7558 service neutron] For port 3eba2279-4b83-4ab6-bde7-0305ee1eda1f, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3eba2279-4b83-4ab6-bde7-0305ee1eda1f,segment=NetworkSegment(5c779566-9ab2-470d-8b5d-c18c1d216fd1),segment_id=5c779566-9ab2-470d-8b5d-c18c1d216fd1)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:20:43.519241 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-556c7715-60c7-4aef-82d9-7d102f3813e8 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Pushing event updated for resources: {'Port': ['ID=b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:43.531673 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-556c7715-60c7-4aef-82d9-7d102f3813e8 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:20:43.540110 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-2352b9d6-7089-4791-8b3d-54d2f22d7558 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:43.543058 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e7c0734-846e-4b2c-8d5d-b960c2233ae8 req-38d6037a-114d-4e91-8475-84165263ab20 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:43.544822 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e7c0734-846e-4b2c-8d5d-b960c2233ae8 req-38d6037a-114d-4e91-8475-84165263ab20 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 1097 time: 0.3782830 Dec 09 21:20:43.555104 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-556c7715-60c7-4aef-82d9-7d102f3813e8 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:20:43.665637 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2a475c8a-6f6d-47f9-bcd6-983b45e8c529 req-42c53dd2-063c-4e32-aae8-27f39772501f tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3024285 Dec 09 21:20:43.677714 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-2352b9d6-7089-4791-8b3d-54d2f22d7558 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:43.678355 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-2352b9d6-7089-4791-8b3d-54d2f22d7558 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:43.681642 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-2352b9d6-7089-4791-8b3d-54d2f22d7558 service neutron] 10.222.0.10 "PUT /v2.0/ports/3eba2279-4b83-4ab6-bde7-0305ee1eda1f HTTP/1.1" status: 200 len: 1093 time: 4.0573390 Dec 09 21:20:43.696249 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a007b30a-1cc1-4d65-b263-1bd9d1a84b3b', 'tag': '3eba2279-4b83-4ab6-bde7-0305ee1eda1f'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:20:43.701327 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-de655082-ec7d-4c8f-a2cd-493fd8f8be10" -d '{"events": [{"name": "network-changed", "server_uuid": "a007b30a-1cc1-4d65-b263-1bd9d1a84b3b", "tag": "3eba2279-4b83-4ab6-bde7-0305ee1eda1f"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:20:43.775951 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6616973-cfea-4763-ab18-cd80533a5717 req-fc8570a9-00e2-43a4-8611-f1da06948701 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:43.777439 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6616973-cfea-4763-ab18-cd80533a5717 req-fc8570a9-00e2-43a4-8611-f1da06948701 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.3691943 Dec 09 21:20:43.806055 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-556c7715-60c7-4aef-82d9-7d102f3813e8 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:43.806684 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-556c7715-60c7-4aef-82d9-7d102f3813e8 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:43.813913 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2785f38a-e3ed-4484-b164-42ca4115087e up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:20:43.872133 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 2785f38a-e3ed-4484-b164-42ca4115087e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:43.872503 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:44.014925 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5c493b55-ee04-4498-9f43-08b4368cccc7 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:20:44.103120 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:44.129767 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 5c493b55-ee04-4498-9f43-08b4368cccc7, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5c493b55-ee04-4498-9f43-08b4368cccc7,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:44.134607 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:44.166588 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2352b9d6-7089-4791-8b3d-54d2f22d7558 service neutron] Pushing event updated for resources: {'Port': ['ID=3eba2279-4b83-4ab6-bde7-0305ee1eda1f,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:44.191997 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=5c493b55-ee04-4498-9f43-08b4368cccc7,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:44.231721 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e7c0734-846e-4b2c-8d5d-b960c2233ae8 req-bd8b94fe-6907-4479-907a-430beda7c4f1 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6596322 Dec 09 21:20:44.266948 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-556c7715-60c7-4aef-82d9-7d102f3813e8 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 4.6460795 Dec 09 21:20:44.295905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-48aa45eb-7952-4b24-9c6a-548d40b7d416 service neutron] Request body: {'port': {'device_id': 'e9419ae1-ea8a-47ae-82d5-b82f1353ca2f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:44.304136 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c58442b8-dc66-4022-b614-63a60ff3c594 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:44.331840 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-663d4925-11be-4334-a20d-d4b10fc69411 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:44.333449 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-663d4925-11be-4334-a20d-d4b10fc69411 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=913fcb9b5aab4356999ade167d5148c6&device_id=a007b30a-1cc1-4d65-b263-1bd9d1a84b3b HTTP/1.1" status: 200 len: 1096 time: 0.5841997 Dec 09 21:20:44.402369 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f7362b4-c0c5-480d-bc59-8673750d68ee req-e2979f0f-fd40-4534-92dc-1baa9382e57f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:44.403926 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f7362b4-c0c5-480d-bc59-8673750d68ee req-e2979f0f-fd40-4534-92dc-1baa9382e57f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 931 time: 0.6046681 Dec 09 21:20:44.448932 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-e12ace06-fd1d-458f-b37a-8fe447fedf12 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=3eba2279-4b83-4ab6-bde7-0305ee1eda1f HTTP/1.1" status: 200 len: 217 time: 0.0833917 Dec 09 21:20:44.473264 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6616973-cfea-4763-ab18-cd80533a5717 req-54c0b6c1-78dd-433c-821f-2019da457cf2 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6441972 Dec 09 21:20:44.552158 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a778b7e-33e9-4a2b-adde-8eacfff50f90 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:44.576239 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-48aa45eb-7952-4b24-9c6a-548d40b7d416 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:44.640306 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c58442b8-dc66-4022-b614-63a60ff3c594 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:44.651073 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a778b7e-33e9-4a2b-adde-8eacfff50f90 admin admin] Pushing event deleted for resources: {'Port': ['ID=5c493b55-ee04-4498-9f43-08b4368cccc7,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:44.671684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-e7f90249-158a-43cf-8a94-2a7cbaae874b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:44.673161 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-e7f90249-158a-43cf-8a94-2a7cbaae874b service neutron] 10.222.0.10 "GET /v2.0/subnets?id=f2e816c0-e7a2-4010-b2b9-8d7f39c3a318 HTTP/1.1" status: 200 len: 854 time: 0.1914504 Dec 09 21:20:44.793663 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f7362b4-c0c5-480d-bc59-8673750d68ee req-cd91c9da-1c77-4070-b6ee-0005eb642515 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3543875 Dec 09 21:20:44.797231 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c58442b8-dc66-4022-b614-63a60ff3c594 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:20:44.816602 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-c58442b8-dc66-4022-b614-63a60ff3c594 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:20:44.832335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c58442b8-dc66-4022-b614-63a60ff3c594 admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:20:44.843933 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:20:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4a1991f2-893f-4408-86e0-f2ff00873636 x-openstack-request-id: req-4a1991f2-893f-4408-86e0-f2ff00873636 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:20:44.844247 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a007b30a-1cc1-4d65-b263-1bd9d1a84b3b", "tag": "3eba2279-4b83-4ab6-bde7-0305ee1eda1f", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:20:44.844501 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-4a1991f2-893f-4408-86e0-f2ff00873636 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:20:44.844915 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a007b30a-1cc1-4d65-b263-1bd9d1a84b3b', 'tag': '3eba2279-4b83-4ab6-bde7-0305ee1eda1f', 'status': 'completed', 'code': 200} Dec 09 21:20:44.931493 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c58442b8-dc66-4022-b614-63a60ff3c594 admin admin] Pushing event updated for resources: {'Port': ['ID=3d871078-9873-42c7-9428-2cbedc035380,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:44.935325 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6616973-cfea-4763-ab18-cd80533a5717 req-41583dfd-4fdd-4ed3-b8b4-c747cb100910 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4417675 Dec 09 21:20:45.004047 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a778b7e-33e9-4a2b-adde-8eacfff50f90 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:45.007106 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-d9411b22-b0ea-48fc-85e3-1f8deb2299ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:45.008803 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-d9411b22-b0ea-48fc-85e3-1f8deb2299ae service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=1444d8a7-187f-473b-be08-dce40f6ae8ea&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2915380 Dec 09 21:20:45.116413 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-deace608-b7bc-4b38-a13f-7a1874387014 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:20:45.117466 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-deace608-b7bc-4b38-a13f-7a1874387014 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0059066 Dec 09 21:20:45.157159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-19b0d7a5-b2dd-4627-a85f-d1f0af70eb83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:45.158510 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-19b0d7a5-b2dd-4627-a85f-d1f0af70eb83 service neutron] 10.222.0.13 "GET /v2.0/ports/40468c91-ccde-4d96-b234-0e326a1de103 HTTP/1.1" status: 200 len: 1095 time: 0.0337510 Dec 09 21:20:45.168659 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-54046b71-6efc-4b6a-887a-ea78ba4a7422 service neutron] Request body: {'binding': {'host': 'n-h1-713301-27', 'vnic_type': 'normal', 'profile': {}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:45.169291 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-54046b71-6efc-4b6a-887a-ea78ba4a7422 service neutron] Unknown quota resources ['binding']. {{(pid=103437) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 09 21:20:45.203882 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a778b7e-33e9-4a2b-adde-8eacfff50f90 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:45.259003 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a778b7e-33e9-4a2b-adde-8eacfff50f90 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:45.308053 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-54046b71-6efc-4b6a-887a-ea78ba4a7422 service neutron] Attempting to bind port 40468c91-ccde-4d96-b234-0e326a1de103 on host n-h1-713301-27 for vnic_type normal with profile None {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:20:45.308395 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-54046b71-6efc-4b6a-887a-ea78ba4a7422 service neutron] Attempting to bind port 40468c91-ccde-4d96-b234-0e326a1de103 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:20:45.308742 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-54046b71-6efc-4b6a-887a-ea78ba4a7422 service neutron] Attempting to bind port 40468c91-ccde-4d96-b234-0e326a1de103 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:20:45.313213 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-54046b71-6efc-4b6a-887a-ea78ba4a7422 service neutron] Port 40468c91-ccde-4d96-b234-0e326a1de103 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:20:45.313543 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-54046b71-6efc-4b6a-887a-ea78ba4a7422 service neutron] Attempting to bind port 40468c91-ccde-4d96-b234-0e326a1de103 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:20:45.318408 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-54046b71-6efc-4b6a-887a-ea78ba4a7422 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 20, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:20:45.318748 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-54046b71-6efc-4b6a-887a-ea78ba4a7422 service neutron] Checking segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:20:45.319135 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-54046b71-6efc-4b6a-887a-ea78ba4a7422 service neutron] Bound using segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:20:45.319593 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-54046b71-6efc-4b6a-887a-ea78ba4a7422 service neutron] Bound port: 40468c91-ccde-4d96-b234-0e326a1de103, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:20:45.377269 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-54046b71-6efc-4b6a-887a-ea78ba4a7422 service neutron] For port 40468c91-ccde-4d96-b234-0e326a1de103, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=40468c91-ccde-4d96-b234-0e326a1de103,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:20:45.379779 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53207205-b77d-4fd3-991e-3d9ad7da0558 req-360a93cf-c5f7-405b-ae6f-b6ddde0a7650 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:45.381395 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-53207205-b77d-4fd3-991e-3d9ad7da0558 req-360a93cf-c5f7-405b-ae6f-b6ddde0a7650 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 948 time: 0.4355304 Dec 09 21:20:45.384109 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-54046b71-6efc-4b6a-887a-ea78ba4a7422 service neutron] Publish callbacks [] for binding, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:45.386048 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-54046b71-6efc-4b6a-887a-ea78ba4a7422 service neutron] 10.222.0.13 "POST /v2.0/ports/40468c91-ccde-4d96-b234-0e326a1de103/bindings HTTP/1.1" status: 201 len: 390 time: 0.2204604 Dec 09 21:20:45.426637 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a778b7e-33e9-4a2b-adde-8eacfff50f90 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:45.427183 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8a778b7e-33e9-4a2b-adde-8eacfff50f90 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 25046774-92e5-4d58-9896-0cb0ec8db37d {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:20:45.460369 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a778b7e-33e9-4a2b-adde-8eacfff50f90 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:45.462207 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8a778b7e-33e9-4a2b-adde-8eacfff50f90 admin admin] 10.222.0.13 "DELETE /v2.0/routers/25046774-92e5-4d58-9896-0cb0ec8db37d HTTP/1.1" status: 204 len: 168 time: 4.6422338 Dec 09 21:20:45.465484 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59058) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:45.493323 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-175a584b-1145-40db-81f1-473fad2049a9 service neutron] 10.222.0.10 "GET /v2.0/networks/1444d8a7-187f-473b-be08-dce40f6ae8ea?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4660897 Dec 09 21:20:45.553253 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-93a179bd-0a66-41af-9207-427c998ff020 admin admin] Deleting subnet 15309006-587d-43b0-b8f1-2fa0af9cd690 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:20:45.557836 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93a179bd-0a66-41af-9207-427c998ff020 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:45.606102 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-53207205-b77d-4fd3-991e-3d9ad7da0558 req-2fa9d43c-b092-4bae-8998-50fea0ca27e5 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2137437 Dec 09 21:20:45.618061 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93a179bd-0a66-41af-9207-427c998ff020 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:45.772317 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-48aa45eb-7952-4b24-9c6a-548d40b7d416 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:20:45.805373 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-48aa45eb-7952-4b24-9c6a-548d40b7d416 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:45.852824 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-48aa45eb-7952-4b24-9c6a-548d40b7d416 service neutron] Transition to ACTIVE for port object b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:20:45.865787 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c58442b8-dc66-4022-b614-63a60ff3c594 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:45.872912 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-48aa45eb-7952-4b24-9c6a-548d40b7d416 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:45.882202 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-933a30c9-a35e-4380-b229-730c70beca06 req-0c3e4c6f-0373-406a-87da-99fe88650bcf tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:45.890030 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-933a30c9-a35e-4380-b229-730c70beca06 req-0c3e4c6f-0373-406a-87da-99fe88650bcf tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/ports?device_id=a007b30a-1cc1-4d65-b263-1bd9d1a84b3b HTTP/1.1" status: 200 len: 944 time: 0.2280359 Dec 09 21:20:45.947576 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db98f8cd-a858-49a1-b8a4-8f6b27e744dc req-34eb7aa2-d781-406d-b80a-633fe32eb950 service neutron] 10.222.0.10 "GET /v2.0/networks/1444d8a7-187f-473b-be08-dce40f6ae8ea?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4417164 Dec 09 21:20:45.949590 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-90c53139-deb8-46bc-81f3-efe6c696d830 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:45.951015 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-90c53139-deb8-46bc-81f3-efe6c696d830 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 1098 time: 0.2284644 Dec 09 21:20:46.010446 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93a179bd-0a66-41af-9207-427c998ff020 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:46.068740 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93a179bd-0a66-41af-9207-427c998ff020 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:46.095241 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93a179bd-0a66-41af-9207-427c998ff020 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=15309006-587d-43b0-b8f1-2fa0af9cd690,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:46.098895 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93a179bd-0a66-41af-9207-427c998ff020 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:46.102282 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-93a179bd-0a66-41af-9207-427c998ff020 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/15309006-587d-43b0-b8f1-2fa0af9cd690 HTTP/1.1" status: 204 len: 168 time: 0.6354947 Dec 09 21:20:46.105142 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59080) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:46.111134 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1548044-43cc-4d3a-b0bb-514309e1bd61 None None] Network ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:20:46.190946 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a5812b98-ffc0-409d-b3ad-9de323671d9d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:46.275929 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-a5812b98-ffc0-409d-b3ad-9de323671d9d admin admin] Deleting port 04ab76ac-be82-4c9f-a935-d29a4a2961c7 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:20:46.276501 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a5812b98-ffc0-409d-b3ad-9de323671d9d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:46.300161 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9fcdcd0f-aa26-44a8-8064-2a26f8f424a1 None None] DHCP port deletion for ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:20:46.354191 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-a5812b98-ffc0-409d-b3ad-9de323671d9d admin admin] For port 04ab76ac-be82-4c9f-a935-d29a4a2961c7, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=04ab76ac-be82-4c9f-a935-d29a4a2961c7,segment=NetworkSegment(af4025cf-5dc2-4085-8a58-84ccccefa44e),segment_id=af4025cf-5dc2-4085-8a58-84ccccefa44e)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:46.354643 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a5812b98-ffc0-409d-b3ad-9de323671d9d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:46.363262 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9fcdcd0f-aa26-44a8-8064-2a26f8f424a1 None None] Deleting port 04ab76ac-be82-4c9f-a935-d29a4a2961c7 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:20:46.364040 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9fcdcd0f-aa26-44a8-8064-2a26f8f424a1 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:46.372610 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-a5812b98-ffc0-409d-b3ad-9de323671d9d admin admin] Calling delete_port for 04ab76ac-be82-4c9f-a935-d29a4a2961c7 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:20:46.453757 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-9fcdcd0f-aa26-44a8-8064-2a26f8f424a1 None None] For port 04ab76ac-be82-4c9f-a935-d29a4a2961c7, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=04ab76ac-be82-4c9f-a935-d29a4a2961c7,segment=NetworkSegment(af4025cf-5dc2-4085-8a58-84ccccefa44e),segment_id=af4025cf-5dc2-4085-8a58-84ccccefa44e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:46.457662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48aa45eb-7952-4b24-9c6a-548d40b7d416 service neutron] Pushing event updated for resources: {'Port': ['ID=b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:46.458645 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9fcdcd0f-aa26-44a8-8064-2a26f8f424a1 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:46.471676 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-933a30c9-a35e-4380-b229-730c70beca06 req-2ca341cf-1104-443e-999c-4ecda30dc38b tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/security-groups?id=dea88e67-805c-4990-af94-aeeaf2d8e160&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5798378 Dec 09 21:20:46.481157 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9fcdcd0f-aa26-44a8-8064-2a26f8f424a1 None None] Calling delete_port for 04ab76ac-be82-4c9f-a935-d29a4a2961c7 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:20:46.484586 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a5812b98-ffc0-409d-b3ad-9de323671d9d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:46.530996 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de655082-ec7d-4c8f-a2cd-493fd8f8be10 req-5708e42a-997e-436a-a27b-1c7195232557 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:46.532570 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de655082-ec7d-4c8f-a2cd-493fd8f8be10 req-5708e42a-997e-436a-a27b-1c7195232557 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=913fcb9b5aab4356999ade167d5148c6&device_id=a007b30a-1cc1-4d65-b263-1bd9d1a84b3b HTTP/1.1" status: 200 len: 1096 time: 0.2288578 Dec 09 21:20:46.542843 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5812b98-ffc0-409d-b3ad-9de323671d9d admin admin] No DVR routers for this DVR port 04ab76ac-be82-4c9f-a935-d29a4a2961c7 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:20:46.544714 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5812b98-ffc0-409d-b3ad-9de323671d9d admin admin] Pushing event deleted for resources: {'Port': ['ID=04ab76ac-be82-4c9f-a935-d29a4a2961c7,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:46.564993 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 36925110-4ed7-49f6-b07d-d998896a74cc details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:20:46.666176 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a5812b98-ffc0-409d-b3ad-9de323671d9d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:46.686930 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9fcdcd0f-aa26-44a8-8064-2a26f8f424a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:46.692714 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-07dd5975-5db0-4cb2-aadc-6307a4b1cffb tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:20:46.693788 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-07dd5975-5db0-4cb2-aadc-6307a4b1cffb tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0116041 Dec 09 21:20:46.704206 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-a5812b98-ffc0-409d-b3ad-9de323671d9d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:46.726639 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fcdcd0f-aa26-44a8-8064-2a26f8f424a1 None None] Pushing event deleted for resources: {'Port': ['ID=04ab76ac-be82-4c9f-a935-d29a4a2961c7,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:46.728773 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9fcdcd0f-aa26-44a8-8064-2a26f8f424a1 None None] No DVR routers for this DVR port 04ab76ac-be82-4c9f-a935-d29a4a2961c7 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:20:46.736307 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-7bf98a06-1f20-4646-90f9-710fcbf2385d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:46.737935 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-7bf98a06-1f20-4646-90f9-710fcbf2385d service neutron] 10.222.0.31 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 922 time: 0.4353502 Dec 09 21:20:46.738279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 36925110-4ed7-49f6-b07d-d998896a74cc, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=36925110-4ed7-49f6-b07d-d998896a74cc,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:46.746670 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-a5812b98-ffc0-409d-b3ad-9de323671d9d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'af4025cf-5dc2-4085-8a58-84ccccefa44e') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:46.747893 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-a5812b98-ffc0-409d-b3ad-9de323671d9d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'af4025cf-5dc2-4085-8a58-84ccccefa44e') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:46.753019 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '36925110-4ed7-49f6-b07d-d998896a74cc', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '36925110-4ed7-49f6-b07d-d998896a74cc', 'mac_address': 'fa:16:3e:9f:a4:77', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.140'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:20:46.761276 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-48aa45eb-7952-4b24-9c6a-548d40b7d416 service neutron] Attempting to bind port b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:20:46.761671 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-48aa45eb-7952-4b24-9c6a-548d40b7d416 service neutron] Attempting to bind port b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '41babb3e-048d-47f5-b92c-d4cf9897cc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:20:46.762155 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-48aa45eb-7952-4b24-9c6a-548d40b7d416 service neutron] Attempting to bind port b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 on network 8e0b26d7-eefe-4c85-b535-944f3c15f0f6 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:20:46.764026 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a5812b98-ffc0-409d-b3ad-9de323671d9d admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:46.766888 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-ce984d36-1073-44a3-adfe-3803491ad680 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:46.768586 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-ce984d36-1073-44a3-adfe-3803491ad680 service neutron] 10.222.0.13 "GET /v2.0/ports/6166c639-9f87-4254-af88-12c4be868be5 HTTP/1.1" status: 200 len: 1094 time: 0.0619488 Dec 09 21:20:46.784721 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-00cf67a4-4956-4f62-bad0-80353c571a4e service neutron] Request body: {'binding': {'host': 'n-h1-713301-27', 'vnic_type': 'normal', 'profile': {}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:46.785202 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-00cf67a4-4956-4f62-bad0-80353c571a4e service neutron] Unknown quota resources ['binding']. {{(pid=103437) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 09 21:20:46.805598 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:46.815229 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a5812b98-ffc0-409d-b3ad-9de323671d9d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:46.819475 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 36925110-4ed7-49f6-b07d-d998896a74cc {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:20:46.828708 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a5812b98-ffc0-409d-b3ad-9de323671d9d admin admin] Releasing vlan 130 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:20:46.828852 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a5812b98-ffc0-409d-b3ad-9de323671d9d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:46.830562 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-54476040-6a02-4907-bab7-7d3908c40383 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=40468c91-ccde-4d96-b234-0e326a1de103 HTTP/1.1" status: 200 len: 217 time: 0.0702944 Dec 09 21:20:46.840612 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 36925110-4ed7-49f6-b07d-d998896a74cc, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=36925110-4ed7-49f6-b07d-d998896a74cc,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/neutron_lib/db/model_query.py:331: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: items = [ Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:20:46.841473 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:20:46.848559 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:46.887878 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-209073b4-922f-4a04-9ed9-4c6a1d6e9620 req-f974e392-e89b-4b81-84cf-2f27a7eddd7d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:46.891168 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-209073b4-922f-4a04-9ed9-4c6a1d6e9620 req-f974e392-e89b-4b81-84cf-2f27a7eddd7d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 946 time: 0.3318560 Dec 09 21:20:46.908403 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=36925110-4ed7-49f6-b07d-d998896a74cc,revision_number=9']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:46.915418 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-48aa45eb-7952-4b24-9c6a-548d40b7d416 service neutron] Port b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 on network 8e0b26d7-eefe-4c85-b535-944f3c15f0f6 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:20:46.915779 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-48aa45eb-7952-4b24-9c6a-548d40b7d416 service neutron] Attempting to bind port b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 on network 8e0b26d7-eefe-4c85-b535-944f3c15f0f6 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:20:46.935126 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a5812b98-ffc0-409d-b3ad-9de323671d9d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:46.942144 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a5812b98-ffc0-409d-b3ad-9de323671d9d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:46.945381 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a5812b98-ffc0-409d-b3ad-9de323671d9d admin admin] 10.222.0.13 "DELETE /v2.0/networks/ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b HTTP/1.1" status: 204 len: 168 time: 0.8393826 Dec 09 21:20:46.952179 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c58442b8-dc66-4022-b614-63a60ff3c594 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:46.959285 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-48aa45eb-7952-4b24-9c6a-548d40b7d416 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 20, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:20:46.959763 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-48aa45eb-7952-4b24-9c6a-548d40b7d416 service neutron] Checking segment: {'id': '41babb3e-048d-47f5-b92c-d4cf9897cc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:20:46.960238 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-48aa45eb-7952-4b24-9c6a-548d40b7d416 service neutron] Bound using segment: {'id': '41babb3e-048d-47f5-b92c-d4cf9897cc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:20:46.960798 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-48aa45eb-7952-4b24-9c6a-548d40b7d416 service neutron] Bound port: b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '41babb3e-048d-47f5-b92c-d4cf9897cc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:20:46.961050 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5812b98-ffc0-409d-b3ad-9de323671d9d admin admin] Pushing event deleted for resources: {'Network': ['ID=ed055ddc-b0ca-428a-a148-fa1b7e2a7f7b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:46.961325 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-48aa45eb-7952-4b24-9c6a-548d40b7d416 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:46.987348 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de655082-ec7d-4c8f-a2cd-493fd8f8be10 req-75b6ce2d-84b4-47b8-8414-67903de3ec13 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:46.988878 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de655082-ec7d-4c8f-a2cd-493fd8f8be10 req-75b6ce2d-84b4-47b8-8414-67903de3ec13 service neutron] 10.222.0.10 "GET /v2.0/networks?id=1444d8a7-187f-473b-be08-dce40f6ae8ea HTTP/1.1" status: 200 len: 916 time: 0.4208388 Dec 09 21:20:47.008731 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-00cf67a4-4956-4f62-bad0-80353c571a4e service neutron] Attempting to bind port 6166c639-9f87-4254-af88-12c4be868be5 on host n-h1-713301-27 for vnic_type normal with profile None {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:20:47.009106 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-00cf67a4-4956-4f62-bad0-80353c571a4e service neutron] Attempting to bind port 6166c639-9f87-4254-af88-12c4be868be5 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:20:47.009446 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-00cf67a4-4956-4f62-bad0-80353c571a4e service neutron] Attempting to bind port 6166c639-9f87-4254-af88-12c4be868be5 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:20:47.014487 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-00cf67a4-4956-4f62-bad0-80353c571a4e service neutron] Port 6166c639-9f87-4254-af88-12c4be868be5 on network 04fa749a-9f72-4a2c-a725-feab917f99ef not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:20:47.014802 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-00cf67a4-4956-4f62-bad0-80353c571a4e service neutron] Attempting to bind port 6166c639-9f87-4254-af88-12c4be868be5 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:20:47.020502 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-00cf67a4-4956-4f62-bad0-80353c571a4e service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 20, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:20:47.020824 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-00cf67a4-4956-4f62-bad0-80353c571a4e service neutron] Checking segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:20:47.021203 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-00cf67a4-4956-4f62-bad0-80353c571a4e service neutron] Bound using segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:20:47.021631 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-00cf67a4-4956-4f62-bad0-80353c571a4e service neutron] Bound port: 6166c639-9f87-4254-af88-12c4be868be5, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:20:47.027108 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-4ea2fed4-1357-4505-8c70-089ba6917aec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:47.028888 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-4ea2fed4-1357-4505-8c70-089ba6917aec service neutron] 10.222.0.31 "GET /v2.0/subnets?id=c49a62cc-af1b-4958-a4a9-eb44188b8fb9 HTTP/1.1" status: 200 len: 861 time: 0.1896515 Dec 09 21:20:47.080789 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-00cf67a4-4956-4f62-bad0-80353c571a4e service neutron] For port 6166c639-9f87-4254-af88-12c4be868be5, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6166c639-9f87-4254-af88-12c4be868be5,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:20:47.089418 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-00cf67a4-4956-4f62-bad0-80353c571a4e service neutron] Publish callbacks [] for binding, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:47.091866 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-00cf67a4-4956-4f62-bad0-80353c571a4e service neutron] 10.222.0.13 "POST /v2.0/ports/6166c639-9f87-4254-af88-12c4be868be5/bindings HTTP/1.1" status: 201 len: 390 time: 0.3113778 Dec 09 21:20:47.092429 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59090) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:47.134793 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de655082-ec7d-4c8f-a2cd-493fd8f8be10 req-574c2f2e-7665-496d-a9fd-e165b3fec708 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=3eba2279-4b83-4ab6-bde7-0305ee1eda1f HTTP/1.1" status: 200 len: 217 time: 0.1047566 Dec 09 21:20:47.136711 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-2233c7e9-a3a0-45cf-a586-f90794cb9861 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=93378dc3-2ac5-4cf7-9ce3-d812934de40c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0931113 Dec 09 21:20:47.139609 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['36925110-4ed7-49f6-b07d-d998896a74cc'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:20:47.145221 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7346db75-f5e1-444a-b302-64b410207ef4 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=7d5e8ae60543498f8ee03684e80c1aa1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0493937 Dec 09 21:20:47.146357 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59092) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:47.188959 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-209073b4-922f-4a04-9ed9-4c6a1d6e9620 req-39b95d94-fa4b-45e3-b9c6-682e36025669 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2637410 Dec 09 21:20:47.234555 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3bb70f9f-2f04-41e3-93d9-89a073c44931 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:47.282684 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3bb70f9f-2f04-41e3-93d9-89a073c44931 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:47.306817 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-48aa45eb-7952-4b24-9c6a-548d40b7d416 service neutron] For port b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:20:47.313262 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-48aa45eb-7952-4b24-9c6a-548d40b7d416 service neutron] For port b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:20:47.364346 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-48aa45eb-7952-4b24-9c6a-548d40b7d416 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:47.366316 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3bb70f9f-2f04-41e3-93d9-89a073c44931 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:47.369424 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3bb70f9f-2f04-41e3-93d9-89a073c44931 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:47.373146 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3bb70f9f-2f04-41e3-93d9-89a073c44931 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/17337e1e-a772-4027-b63b-76b0cb195e20 HTTP/1.1" status: 204 len: 168 time: 0.2233527 Dec 09 21:20:47.387267 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bb70f9f-2f04-41e3-93d9-89a073c44931 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=17337e1e-a772-4027-b63b-76b0cb195e20,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:47.530768 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-48aa45eb-7952-4b24-9c6a-548d40b7d416 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:47.531408 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-48aa45eb-7952-4b24-9c6a-548d40b7d416 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:47.533026 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-48aa45eb-7952-4b24-9c6a-548d40b7d416 service neutron] 10.222.0.10 "PUT /v2.0/ports/b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 HTTP/1.1" status: 200 len: 1092 time: 3.2475595 Dec 09 21:20:47.542145 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e9419ae1-ea8a-47ae-82d5-b82f1353ca2f', 'tag': 'b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:20:47.546202 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9d13ddb4-8db4-46f4-b575-dbbcba8b3b0f" -d '{"events": [{"name": "network-changed", "server_uuid": "e9419ae1-ea8a-47ae-82d5-b82f1353ca2f", "tag": "b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:20:47.594265 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de655082-ec7d-4c8f-a2cd-493fd8f8be10 req-46ac4935-667f-4f6b-9bbb-6fa1704d2736 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:47.595759 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ec90d2e-8258-4e3c-b27b-74e05f25cec8 req-bc49d2ea-c520-4bde-93b0-a73915559693 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:47.595935 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de655082-ec7d-4c8f-a2cd-493fd8f8be10 req-46ac4935-667f-4f6b-9bbb-6fa1704d2736 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=f2e816c0-e7a2-4010-b2b9-8d7f39c3a318 HTTP/1.1" status: 200 len: 854 time: 0.4324827 Dec 09 21:20:47.597758 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4ec90d2e-8258-4e3c-b27b-74e05f25cec8 req-bc49d2ea-c520-4bde-93b0-a73915559693 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.31 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b&tenant_id=857de64ecc3946e3b92655f639d782df&binding%3Ahost_id=n-h2-713301-27 HTTP/1.1" status: 200 len: 949 time: 0.1457131 Dec 09 21:20:47.629701 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f39755f7-40df-4787-b7a9-0bd2740e5f21 req-48938968-4243-445c-a0cc-8d10b62d0cf2 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:47.637264 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f39755f7-40df-4787-b7a9-0bd2740e5f21 req-48938968-4243-445c-a0cc-8d10b62d0cf2 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 943 time: 0.2999165 Dec 09 21:20:47.684110 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [req-4ec90d2e-8258-4e3c-b27b-74e05f25cec8 req-68023fc6-d147-4621-9e72-1f7249b33285 service neutron] delete failed (client error): The resource could not be found. Dec 09 21:20:47.685767 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4ec90d2e-8258-4e3c-b27b-74e05f25cec8 req-68023fc6-d147-4621-9e72-1f7249b33285 service neutron] 10.222.0.31 "DELETE /v2.0/ports/36925110-4ed7-49f6-b07d-d998896a74cc/bindings/n-h1-713301-27 HTTP/1.1" status: 404 len: 381 time: 0.0799682 Dec 09 21:20:47.730215 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48aa45eb-7952-4b24-9c6a-548d40b7d416 service neutron] Pushing event updated for resources: {'Port': ['ID=b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:47.743881 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-57192d36-2ddd-411c-b8f5-aa68bd02da2c service neutron] 10.222.0.31 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5956273 Dec 09 21:20:47.764445 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17a4de45-a49e-4a47-bf1b-a4bae4e79543 req-7f581c50-178c-415b-95b6-5eda8791cc5f tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:47.769786 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 04ab76ac-be82-4c9f-a935-d29a4a2961c7 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:20:47.771402 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-17a4de45-a49e-4a47-bf1b-a4bae4e79543 req-7f581c50-178c-415b-95b6-5eda8791cc5f tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.3406866 Dec 09 21:20:47.806564 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 04ab76ac-be82-4c9f-a935-d29a4a2961c7 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:20:47.807149 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 04ab76ac-be82-4c9f-a935-d29a4a2961c7 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:20:47.839972 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ec90d2e-8258-4e3c-b27b-74e05f25cec8 req-b700e8da-1cf0-4d69-8eeb-1ab50e31f743 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:47.841747 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4ec90d2e-8258-4e3c-b27b-74e05f25cec8 req-b700e8da-1cf0-4d69-8eeb-1ab50e31f743 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 1101 time: 0.0675454 Dec 09 21:20:47.853366 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-ecccd7dd-34c1-4dfb-b261-392998fe99f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:47.854859 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-ecccd7dd-34c1-4dfb-b261-392998fe99f7 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=7233ac85d55e4123a22cfa34bc1ee70e&device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 1095 time: 0.2581940 Dec 09 21:20:47.864129 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f39755f7-40df-4787-b7a9-0bd2740e5f21 req-b943f79a-890c-4c2f-9e11-1e2692a0e63f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2259521 Dec 09 21:20:47.868308 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de655082-ec7d-4c8f-a2cd-493fd8f8be10 req-2625b429-9aa3-4c46-a1dd-221351f1ed9f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:47.869814 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de655082-ec7d-4c8f-a2cd-493fd8f8be10 req-2625b429-9aa3-4c46-a1dd-221351f1ed9f service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=1444d8a7-187f-473b-be08-dce40f6ae8ea&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2204399 Dec 09 21:20:47.909093 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c58442b8-dc66-4022-b614-63a60ff3c594 admin admin] Router a54b1faf-ab53-4950-be39-e5e79b3d7ed9 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:20:47.967260 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ec90d2e-8258-4e3c-b27b-74e05f25cec8 req-d63f99a2-2c9b-4fef-aab8-df47d5bfcddd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:47.968926 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4ec90d2e-8258-4e3c-b27b-74e05f25cec8 req-d63f99a2-2c9b-4fef-aab8-df47d5bfcddd service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.1189790 Dec 09 21:20:47.974021 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-aed10ad8-88f5-4e7c-ab25-42fd15a7f13b service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 HTTP/1.1" status: 200 len: 217 time: 0.1032650 Dec 09 21:20:48.015331 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4ec90d2e-8258-4e3c-b27b-74e05f25cec8 req-2e8449ca-b45d-4e62-8547-141421b365b1 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.140&port_id=36925110-4ed7-49f6-b07d-d998896a74cc HTTP/1.1" status: 200 len: 217 time: 0.0381296 Dec 09 21:20:48.079152 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ec90d2e-8258-4e3c-b27b-74e05f25cec8 req-58878f26-cb9a-4173-80f1-a83038359952 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:48.081265 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4ec90d2e-8258-4e3c-b27b-74e05f25cec8 req-58878f26-cb9a-4173-80f1-a83038359952 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0576704 Dec 09 21:20:48.084411 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-17a4de45-a49e-4a47-bf1b-a4bae4e79543 req-69cdf47c-67d4-4a0c-a5c8-016e882f5df7 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3121369 Dec 09 21:20:48.158369 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ec90d2e-8258-4e3c-b27b-74e05f25cec8 req-9d3d7ef3-e2bc-4e85-9300-be56c5aa0190 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:48.160853 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4ec90d2e-8258-4e3c-b27b-74e05f25cec8 req-9d3d7ef3-e2bc-4e85-9300-be56c5aa0190 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0687525 Dec 09 21:20:48.259830 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4ec90d2e-8258-4e3c-b27b-74e05f25cec8 req-8cf408e7-5c45-47ad-9c49-08102e29d0b7 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0916078 Dec 09 21:20:48.361633 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4ec90d2e-8258-4e3c-b27b-74e05f25cec8 req-0932c70f-acd8-4d8f-851b-9842a6f1aea9 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0937939 Dec 09 21:20:48.444823 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-739ea6f4-c128-49ef-b707-5799746aa26b service neutron] 10.222.0.31 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6706913 Dec 09 21:20:48.491749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-24f6aac8-954f-4f2c-a197-b0fc53b464be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:48.493303 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-24f6aac8-954f-4f2c-a197-b0fc53b464be service neutron] 10.222.0.10 "GET /v2.0/subnets?id=63e7603a-bb11-4d1a-8d84-55456d81931c HTTP/1.1" status: 200 len: 845 time: 0.5018234 Dec 09 21:20:48.532004 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 3eba2279-4b83-4ab6-bde7-0305ee1eda1f details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:20:48.535062 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 36925110-4ed7-49f6-b07d-d998896a74cc up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:20:48.540131 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de655082-ec7d-4c8f-a2cd-493fd8f8be10 req-67afc2f3-9e36-4792-869d-0f5cc84a3480 service neutron] 10.222.0.10 "GET /v2.0/networks/1444d8a7-187f-473b-be08-dce40f6ae8ea?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6371188 Dec 09 21:20:48.570574 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b92baf42-bc7d-4494-b055-597f94d8cad1 req-e161ff4c-8c62-4f0c-a901-582ec453a5f8 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:48.572048 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b92baf42-bc7d-4494-b055-597f94d8cad1 req-e161ff4c-8c62-4f0c-a901-582ec453a5f8 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 949 time: 0.5934336 Dec 09 21:20:48.582243 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-52d58572-4f10-4e99-a51f-82b8e2d7db53 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=8e0b26d7-eefe-4c85-b535-944f3c15f0f6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0559933 Dec 09 21:20:48.641900 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c58442b8-dc66-4022-b614-63a60ff3c594 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:20:48.653418 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b36a27f3-3426-4c47-9198-ef769dd0275c req-617f5d38-4878-4b0a-ae06-0526a524af30 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:48.657058 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b36a27f3-3426-4c47-9198-ef769dd0275c req-617f5d38-4878-4b0a-ae06-0526a524af30 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/ports?device_id=a007b30a-1cc1-4d65-b263-1bd9d1a84b3b HTTP/1.1" status: 200 len: 944 time: 0.2416601 Dec 09 21:20:48.659520 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] Sync routers for ids ['a54b1faf-ab53-4950-be39-e5e79b3d7ed9'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:20:48.670151 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 36925110-4ed7-49f6-b07d-d998896a74cc completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:20:48.681802 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 36925110-4ed7-49f6-b07d-d998896a74cc triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:48.682171 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:48.718450 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] Routers {'a54b1faf-ab53-4950-be39-e5e79b3d7ed9'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:20:48.719101 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:20:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a54b1faf-ab53-4950-be39-e5e79b3d7ed9'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:48.729337 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 3eba2279-4b83-4ab6-bde7-0305ee1eda1f, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3eba2279-4b83-4ab6-bde7-0305ee1eda1f,segment=NetworkSegment(5c779566-9ab2-470d-8b5d-c18c1d216fd1),segment_id=5c779566-9ab2-470d-8b5d-c18c1d216fd1)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:48.787373 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '3eba2279-4b83-4ab6-bde7-0305ee1eda1f', 'network_id': '1444d8a7-187f-473b-be08-dce40f6ae8ea', 'port_id': '3eba2279-4b83-4ab6-bde7-0305ee1eda1f', 'mac_address': 'fa:16:3e:cb:c2:86', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 146, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f2e816c0-e7a2-4010-b2b9-8d7f39c3a318', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:20:48.803779 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c58442b8-dc66-4022-b614-63a60ff3c594 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:48.805028 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c58442b8-dc66-4022-b614-63a60ff3c594 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 916 time: 9.1342781 Dec 09 21:20:48.809153 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59130) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:48.884261 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b92baf42-bc7d-4494-b055-597f94d8cad1 req-41ba5382-b8e9-4189-9869-7b0d7f82553b tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3009694 Dec 09 21:20:48.917087 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:48.965157 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de655082-ec7d-4c8f-a2cd-493fd8f8be10 req-090905ec-4cce-4fe5-b003-461b5d4c3777 service neutron] 10.222.0.10 "GET /v2.0/networks/1444d8a7-187f-473b-be08-dce40f6ae8ea?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4040771 Dec 09 21:20:48.983695 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:48.995812 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b36a27f3-3426-4c47-9198-ef769dd0275c req-b7db2550-013b-447d-9729-9c288927a913 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/security-groups?id=dea88e67-805c-4990-af94-aeeaf2d8e160&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3172872 Dec 09 21:20:49.012346 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:20:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6c18468f-22f8-44ab-806b-740eed848b93 x-openstack-request-id: req-6c18468f-22f8-44ab-806b-740eed848b93 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:20:49.015422 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e9419ae1-ea8a-47ae-82d5-b82f1353ca2f", "tag": "b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:20:49.015869 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-6c18468f-22f8-44ab-806b-740eed848b93 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:20:49.016429 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e9419ae1-ea8a-47ae-82d5-b82f1353ca2f', 'tag': 'b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8', 'status': 'completed', 'code': 200} Dec 09 21:20:49.020737 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3eba2279-4b83-4ab6-bde7-0305ee1eda1f {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:20:49.028236 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-9c7dfe49-db1a-46ee-97ae-df8838f42e04 service neutron] 10.222.0.10 "GET /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4241781 Dec 09 21:20:49.038522 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '89bd78b4-a499-4908-8ee4-7b3f64653d0b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '36925110-4ed7-49f6-b07d-d998896a74cc'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:20:49.044290 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7ea2bf88-202b-4e0f-bbf1-d7247e3ca95f" -d '{"events": [{"server_uuid": "89bd78b4-a499-4908-8ee4-7b3f64653d0b", "name": "network-vif-plugged", "status": "completed", "tag": "36925110-4ed7-49f6-b07d-d998896a74cc"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:20:49.086044 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] Set router a54b1faf-ab53-4950-be39-e5e79b3d7ed9 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:20:49.126771 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 36925110-4ed7-49f6-b07d-d998896a74cc, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=36925110-4ed7-49f6-b07d-d998896a74cc,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:49.173951 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:49.193280 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 3eba2279-4b83-4ab6-bde7-0305ee1eda1f, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3eba2279-4b83-4ab6-bde7-0305ee1eda1f,segment=NetworkSegment(5c779566-9ab2-470d-8b5d-c18c1d216fd1),segment_id=5c779566-9ab2-470d-8b5d-c18c1d216fd1)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:49.229565 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:49.318479 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=36925110-4ed7-49f6-b07d-d998896a74cc,revision_number=10']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:49.323573 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3114abd9-a0c1-4bca-b30d-30c86d7bbe1a req-8d9f0ed0-ec07-47f4-8de9-3c6d71a320b5 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:49.331938 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3114abd9-a0c1-4bca-b30d-30c86d7bbe1a req-8d9f0ed0-ec07-47f4-8de9-3c6d71a320b5 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 946 time: 0.2400835 Dec 09 21:20:49.362217 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-841fc764-5ceb-4537-a4cc-b0d958f365de req-04c087c7-953e-4616-b1d8-0e88d56581be service neutron] 10.222.0.10 "GET /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3206186 Dec 09 21:20:49.386482 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=3eba2279-4b83-4ab6-bde7-0305ee1eda1f,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:49.427122 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3114abd9-a0c1-4bca-b30d-30c86d7bbe1a req-4f05f9ba-3a47-45f0-a995-b0f11bb686b3 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0918090 Dec 09 21:20:49.532363 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['3eba2279-4b83-4ab6-bde7-0305ee1eda1f'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:20:49.595731 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'name': 'tempest-ServersTestJSON-799420296-router', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66'}], 'enable_snat': True}, 'gw_port_id': '3d871078-9873-42c7-9428-2cbedc035380', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:20:39Z', 'updated_at': '2021-12-09T21:20:45Z', 'revision_number': 3, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'gw_port': {'id': '3d871078-9873-42c7-9428-2cbedc035380', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:25:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 595, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:42Z', 'updated_at': '2021-12-09T21:20:43Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:49.620505 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f057f967-b1c7-490d-b019-fc4e446fccee req-53f10b94-09c5-4e97-adec-af203bb8f750 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=494d068aa26b47f382490c9700cd369a&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1018808 Dec 09 21:20:49.634153 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] Checking router: a54b1faf-ab53-4950-be39-e5e79b3d7ed9 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:20:49.634504 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] Updating router a54b1faf-ab53-4950-be39-e5e79b3d7ed9 port 3d871078-9873-42c7-9428-2cbedc035380 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:20:49.702906 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:49.729545 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d13ddb4-8db4-46f4-b575-dbbcba8b3b0f req-97d7ad5e-cc2f-48fa-8640-183584ac804b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:49.732143 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d13ddb4-8db4-46f4-b575-dbbcba8b3b0f req-97d7ad5e-cc2f-48fa-8640-183584ac804b service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=7233ac85d55e4123a22cfa34bc1ee70e&device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 1095 time: 0.2311275 Dec 09 21:20:49.812642 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1cf35bbc-2911-4649-9f36-340e6a97b168 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:49.876131 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-681114b8-2a7c-426b-bb9a-f9e9af4f03c4 req-f4647d2e-416f-4e63-b532-951ebf6da7b0 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:49.883552 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-681114b8-2a7c-426b-bb9a-f9e9af4f03c4 req-f4647d2e-416f-4e63-b532-951ebf6da7b0 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 943 time: 0.2057943 Dec 09 21:20:49.926161 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f057f967-b1c7-490d-b019-fc4e446fccee req-433339f2-62fa-44b4-8e74-543ba0c6bea7 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:49.927620 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f057f967-b1c7-490d-b019-fc4e446fccee req-433339f2-62fa-44b4-8e74-543ba0c6bea7 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2987494 Dec 09 21:20:49.959518 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d13ddb4-8db4-46f4-b575-dbbcba8b3b0f req-0fceafc8-d9ce-4231-ae65-baa252aac856 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:49.960970 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d13ddb4-8db4-46f4-b575-dbbcba8b3b0f req-0fceafc8-d9ce-4231-ae65-baa252aac856 service neutron] 10.222.0.10 "GET /v2.0/networks?id=8e0b26d7-eefe-4c85-b535-944f3c15f0f6 HTTP/1.1" status: 200 len: 906 time: 0.1925876 Dec 09 21:20:49.962162 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f057f967-b1c7-490d-b019-fc4e446fccee req-1f945d74-3a24-4e1e-b519-190a5e3773c1 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/quotas/494d068aa26b47f382490c9700cd369a HTTP/1.1" status: 200 len: 375 time: 0.0283065 Dec 09 21:20:50.017151 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-681114b8-2a7c-426b-bb9a-f9e9af4f03c4 req-40328d76-38d7-4816-9131-1febae081865 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1326494 Dec 09 21:20:50.018065 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-1cf35bbc-2911-4649-9f36-340e6a97b168 admin admin] Allocated IP 172.20.0.1 (0a4691ff-8eab-4fe6-bec4-b1a20a69fce2/006a974f-ca2f-40a9-b5ee-25ae5235c5b1/aada448e-8a62-400c-91ba-1ae577560497) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:20:50.081377 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f057f967-b1c7-490d-b019-fc4e446fccee req-5987fb95-ccac-4000-9fad-5ece294b43cb tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=494d068aa26b47f382490c9700cd369a&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1110070 Dec 09 21:20:50.082978 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d13ddb4-8db4-46f4-b575-dbbcba8b3b0f req-52541329-8281-4168-9eaf-a6d326359b4b service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 HTTP/1.1" status: 200 len: 217 time: 0.1116965 Dec 09 21:20:50.142622 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1cf35bbc-2911-4649-9f36-340e6a97b168 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:50.148651 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:50.153162 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:20:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-55198b89-c8a5-4b84-9818-5ffc24afbbe6 x-openstack-request-id: req-55198b89-c8a5-4b84-9818-5ffc24afbbe6 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:20:50.153621 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "89bd78b4-a499-4908-8ee4-7b3f64653d0b", "name": "network-vif-plugged", "status": "completed", "tag": "36925110-4ed7-49f6-b07d-d998896a74cc", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:20:50.153941 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-55198b89-c8a5-4b84-9818-5ffc24afbbe6 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:20:50.155081 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '89bd78b4-a499-4908-8ee4-7b3f64653d0b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '36925110-4ed7-49f6-b07d-d998896a74cc', 'code': 200} Dec 09 21:20:50.165746 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:50.185835 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1cf35bbc-2911-4649-9f36-340e6a97b168 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:50.190749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d13ddb4-8db4-46f4-b575-dbbcba8b3b0f req-368ed866-171e-4e69-940e-69859727a816 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:50.192897 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d13ddb4-8db4-46f4-b575-dbbcba8b3b0f req-368ed866-171e-4e69-940e-69859727a816 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=63e7603a-bb11-4d1a-8d84-55456d81931c HTTP/1.1" status: 200 len: 845 time: 0.0997686 Dec 09 21:20:50.220215 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6970c0e2-072a-49cc-83f3-8537318101ec None None] Pushing event updated for resources: {'Port': ['ID=3d871078-9873-42c7-9428-2cbedc035380,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:50.240965 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1cf35bbc-2911-4649-9f36-340e6a97b168 admin admin] Network 0a4691ff-8eab-4fe6-bec4-b1a20a69fce2 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:20:50.244490 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-1cf35bbc-2911-4649-9f36-340e6a97b168 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:20:50.258925 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d13ddb4-8db4-46f4-b575-dbbcba8b3b0f req-80fd8a85-a595-4018-8ee3-81805d512374 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=8e0b26d7-eefe-4c85-b535-944f3c15f0f6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0529747 Dec 09 21:20:50.262994 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1cf35bbc-2911-4649-9f36-340e6a97b168 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:20:50.272046 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] Attempting to bind port 3d871078-9873-42c7-9428-2cbedc035380 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:20:50.272420 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] Attempting to bind port 3d871078-9873-42c7-9428-2cbedc035380 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:20:50.272792 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] Attempting to bind port 3d871078-9873-42c7-9428-2cbedc035380 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:20:50.286855 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 20, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:20:50.287239 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:20:50.287676 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:50.288074 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:20:50.288695 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] Bound port: 3d871078-9873-42c7-9428-2cbedc035380, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:20:50.289085 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:50.352816 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d0c6832-8f19-4b00-8a53-15fc2227715f req-7f569926-a4e1-4585-adbc-69c85b11f11d tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:50.358394 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3d0c6832-8f19-4b00-8a53-15fc2227715f req-7f569926-a4e1-4585-adbc-69c85b11f11d tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.1587563 Dec 09 21:20:50.362688 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cf35bbc-2911-4649-9f36-340e6a97b168 admin admin] Pushing event updated for resources: {'Port': ['ID=aada448e-8a62-400c-91ba-1ae577560497,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:50.374338 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1cf35bbc-2911-4649-9f36-340e6a97b168 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:50.456512 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] For port 3d871078-9873-42c7-9428-2cbedc035380, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:20:50.501865 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] For port 3d871078-9873-42c7-9428-2cbedc035380, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=3d871078-9873-42c7-9428-2cbedc035380,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:20:50.513365 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:50.585205 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] Routers {'a54b1faf-ab53-4950-be39-e5e79b3d7ed9'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:20:50.585832 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:20:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a54b1faf-ab53-4950-be39-e5e79b3d7ed9'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:50.589224 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6970c0e2-072a-49cc-83f3-8537318101ec None None] Pushing event updated for resources: {'Port': ['ID=3d871078-9873-42c7-9428-2cbedc035380,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:50.602163 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1cf35bbc-2911-4649-9f36-340e6a97b168 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:50.606869 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d13ddb4-8db4-46f4-b575-dbbcba8b3b0f req-1dc74658-f4fa-4bf7-b9b2-c2c0f0e16e29 service neutron] 10.222.0.10 "GET /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3401489 Dec 09 21:20:50.624331 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3d0c6832-8f19-4b00-8a53-15fc2227715f req-37f6a566-1aad-4bd0-8b05-c6949a632381 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1733978 Dec 09 21:20:50.650890 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-101b0b6b-63f2-4955-a5b8-2ecf3c56b370 req-8b504eb3-9eed-4032-9826-2c93d1dd335e tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:50.652566 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-101b0b6b-63f2-4955-a5b8-2ecf3c56b370 req-8b504eb3-9eed-4032-9826-2c93d1dd335e tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 951 time: 0.2060194 Dec 09 21:20:50.733935 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7282cadd-75a8-4afd-8790-a81284c41853 None None] Provisioning complete for port aada448e-8a62-400c-91ba-1ae577560497 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:50.734443 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7282cadd-75a8-4afd-8790-a81284c41853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:50.809295 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-7282cadd-75a8-4afd-8790-a81284c41853 None None] Port aada448e-8a62-400c-91ba-1ae577560497 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:20:50.813114 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] Set router a54b1faf-ab53-4950-be39-e5e79b3d7ed9 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:20:50.859807 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-101b0b6b-63f2-4955-a5b8-2ecf3c56b370 req-d9a75cb1-a4c8-4f70-904e-438215fb8d3c tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1689937 Dec 09 21:20:50.895477 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e5f9cd9-4b9d-4fda-8a62-2496813e29a8 req-228e5c07-2441-4bd7-af16-6c9533b8abe8 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:50.895477 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e5f9cd9-4b9d-4fda-8a62-2496813e29a8 req-228e5c07-2441-4bd7-af16-6c9533b8abe8 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/ports?device_id=a007b30a-1cc1-4d65-b263-1bd9d1a84b3b HTTP/1.1" status: 200 len: 945 time: 0.1664605 Dec 09 21:20:50.903250 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d13ddb4-8db4-46f4-b575-dbbcba8b3b0f req-cf3c0c4e-1727-4b68-828b-5239d54404e8 service neutron] 10.222.0.10 "GET /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2496595 Dec 09 21:20:50.986313 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-326d755b-0ee8-4055-900b-8588a673534d req-6cf5ebaa-180e-49e0-b86e-af81a5b14e5b tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/ports?device_id=f557bb48-79b5-4aa9-b1e7-72fc54f16eff HTTP/1.1" status: 200 len: 210 time: 0.0407681 Dec 09 21:20:51.012019 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1cf35bbc-2911-4649-9f36-340e6a97b168 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:51.017100 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1cf35bbc-2911-4649-9f36-340e6a97b168 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:51.085975 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e5f9cd9-4b9d-4fda-8a62-2496813e29a8 req-fce5cbb6-bd17-4865-81fa-80b04209dbeb tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/security-groups?id=dea88e67-805c-4990-af94-aeeaf2d8e160&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1866720 Dec 09 21:20:51.133054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a945b99d-fed2-40c7-905f-b3dc3907b63b req-46233e20-2a44-4d37-ba0c-2e9f909bfbf3 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:51.136500 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a945b99d-fed2-40c7-905f-b3dc3907b63b req-46233e20-2a44-4d37-ba0c-2e9f909bfbf3 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 946 time: 0.0696537 Dec 09 21:20:51.154632 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'name': 'tempest-ServersTestJSON-799420296-router', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66'}], 'enable_snat': True}, 'gw_port_id': '3d871078-9873-42c7-9428-2cbedc035380', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:20:39Z', 'updated_at': '2021-12-09T21:20:50Z', 'revision_number': 4, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'gw_port': {'id': '3d871078-9873-42c7-9428-2cbedc035380', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:25:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 595, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:42Z', 'updated_at': '2021-12-09T21:20:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'aada448e-8a62-400c-91ba-1ae577560497', 'name': '', 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'mac_address': 'fa:16:3e:0f:c5:a0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'device_owner': 'network:router_interface', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '006a974f-ca2f-40a9-b5ee-25ae5235c5b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:49Z', 'updated_at': '2021-12-09T21:20:50Z', 'revision_number': 1, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'subnets': [{'id': '006a974f-ca2f-40a9-b5ee-25ae5235c5b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:51.185670 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5c505472-dbff-44bb-a1c5-0f5f3f52ecc3 None None] The sync data for ids ['a54b1faf-ab53-4950-be39-e5e79b3d7ed9'] in n-d-713301-27 is: [{'id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'name': 'tempest-ServersTestJSON-799420296-router', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66'}], 'enable_snat': True}, 'gw_port_id': '3d871078-9873-42c7-9428-2cbedc035380', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:20:39Z', 'updated_at': '2021-12-09T21:20:50Z', 'revision_number': 4, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'gw_port': {'id': '3d871078-9873-42c7-9428-2cbedc035380', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:25:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 595, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:42Z', 'updated_at': '2021-12-09T21:20:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'aada448e-8a62-400c-91ba-1ae577560497', 'name': '', 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'mac_address': 'fa:16:3e:0f:c5:a0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'device_owner': 'network:router_interface', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '006a974f-ca2f-40a9-b5ee-25ae5235c5b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:49Z', 'updated_at': '2021-12-09T21:20:50Z', 'revision_number': 1, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'subnets': [{'id': '006a974f-ca2f-40a9-b5ee-25ae5235c5b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:20:51.204705 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a945b99d-fed2-40c7-905f-b3dc3907b63b req-da00ba9f-ce26-4a27-af0b-2996075e9e70 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0550277 Dec 09 21:20:51.264936 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cf35bbc-2911-4649-9f36-340e6a97b168 admin admin] Pushing event updated for resources: {'Port': ['ID=aada448e-8a62-400c-91ba-1ae577560497,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:51.267818 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1cf35bbc-2911-4649-9f36-340e6a97b168 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:51.387924 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2b1df5e-5b16-4faf-aab5-d94564be33f5 req-7a0fa05a-c717-4571-8e4d-8662c8d98f77 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:51.395489 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f2b1df5e-5b16-4faf-aab5-d94564be33f5 req-7a0fa05a-c717-4571-8e4d-8662c8d98f77 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 951 time: 0.0960159 Dec 09 21:20:51.400148 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1cf35bbc-2911-4649-9f36-340e6a97b168 admin admin] Network 0a4691ff-8eab-4fe6-bec4-b1a20a69fce2 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:20:51.402161 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-1cf35bbc-2911-4649-9f36-340e6a97b168 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:20:51.447108 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1d97043-46fa-4c95-804a-babf1397d57d req-ba3cfc41-8835-422d-9a5a-1c850478d0d4 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:51.460092 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f1d97043-46fa-4c95-804a-babf1397d57d req-ba3cfc41-8835-422d-9a5a-1c850478d0d4 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 943 time: 0.1454775 Dec 09 21:20:51.500995 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f2b1df5e-5b16-4faf-aab5-d94564be33f5 req-8e5239a0-294c-40aa-9f42-ce885459b6c1 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1043723 Dec 09 21:20:51.613711 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f1d97043-46fa-4c95-804a-babf1397d57d req-b3b91c57-6149-4dc9-b179-4457e96d6abb tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1527357 Dec 09 21:20:51.699389 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1cf35bbc-2911-4649-9f36-340e6a97b168 admin admin] Router a54b1faf-ab53-4950-be39-e5e79b3d7ed9 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:20:51.847832 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-899e0a08-84bd-464b-83ea-da06c740e775 None None] Provisioning complete for port aada448e-8a62-400c-91ba-1ae577560497 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:51.848990 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-899e0a08-84bd-464b-83ea-da06c740e775 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:51.853819 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4459dc86-7207-4c0f-9269-5ee13974aa66 req-6fe26f8c-c445-4cce-b09a-a55ee841e05a tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:51.861619 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4459dc86-7207-4c0f-9269-5ee13974aa66 req-6fe26f8c-c445-4cce-b09a-a55ee841e05a tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.1526239 Dec 09 21:20:51.908546 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-899e0a08-84bd-464b-83ea-da06c740e775 None None] Port aada448e-8a62-400c-91ba-1ae577560497 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:20:51.945198 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f057f967-b1c7-490d-b019-fc4e446fccee req-cb4c12f4-7a5e-49dd-8e84-47a6cc06196a tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=494d068aa26b47f382490c9700cd369a&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0760384 Dec 09 21:20:52.013563 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1cf35bbc-2911-4649-9f36-340e6a97b168 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:20:52.030186 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1cf35bbc-2911-4649-9f36-340e6a97b168 admin admin] 10.222.0.13 "PUT /v2.0/routers/a54b1faf-ab53-4950-be39-e5e79b3d7ed9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2196870 Dec 09 21:20:52.055545 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-4b9773a0-4507-48dc-b65e-2122a764a622 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=857de64ecc3946e3b92655f639d782df&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0549235 Dec 09 21:20:52.173686 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4459dc86-7207-4c0f-9269-5ee13974aa66 req-0217a295-5a19-442b-b22b-71e35f02e1e8 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2798638 Dec 09 21:20:52.259350 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-29156050-85cb-41c6-9846-780fd742b270 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:52.271425 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-29156050-85cb-41c6-9846-780fd742b270 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2148273 Dec 09 21:20:52.328042 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-a00d2741-3a03-49be-960f-c6d8c3f0f4c8 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/quotas/857de64ecc3946e3b92655f639d782df HTTP/1.1" status: 200 len: 375 time: 0.0553143 Dec 09 21:20:52.339063 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b4056df6-8c52-4f65-a933-b9faf05043fe req-be8d7c00-19dd-43ad-b6e5-26630f023e0e tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/ports?device_id=f557bb48-79b5-4aa9-b1e7-72fc54f16eff HTTP/1.1" status: 200 len: 210 time: 0.0626457 Dec 09 21:20:52.363198 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f057f967-b1c7-490d-b019-fc4e446fccee req-26981043-390c-43d3-8bf0-3b30d54e19ee tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:52.364883 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f057f967-b1c7-490d-b019-fc4e446fccee req-26981043-390c-43d3-8bf0-3b30d54e19ee tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3942156 Dec 09 21:20:52.401492 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-f057f967-b1c7-490d-b019-fc4e446fccee req-576810b8-729d-4490-8312-2a4b46e109e8 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Request body: {'port': {'device_id': 'f557bb48-79b5-4aa9-b1e7-72fc54f16eff', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '494d068aa26b47f382490c9700cd369a'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:52.539164 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-8c64e99e-1efd-4be3-a332-388ecf2bdb78 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1985319 Dec 09 21:20:52.557179 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:20:52.561113 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 3eba2279-4b83-4ab6-bde7-0305ee1eda1f up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:20:52.562624 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ba3202-9746-4a63-b457-0c07c9c493c8 req-b135f4ae-9da2-4ed9-8ff7-75b03b3a36bb tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:52.569882 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09ba3202-9746-4a63-b457-0c07c9c493c8 req-b135f4ae-9da2-4ed9-8ff7-75b03b3a36bb tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/ports?device_id=a007b30a-1cc1-4d65-b263-1bd9d1a84b3b HTTP/1.1" status: 200 len: 945 time: 0.1461389 Dec 09 21:20:52.625668 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f057f967-b1c7-490d-b019-fc4e446fccee req-576810b8-729d-4490-8312-2a4b46e109e8 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Made reservation on behalf of 494d068aa26b47f382490c9700cd369a for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:20:52.629852 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f057f967-b1c7-490d-b019-fc4e446fccee req-576810b8-729d-4490-8312-2a4b46e109e8 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:52.641949 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09ba3202-9746-4a63-b457-0c07c9c493c8 req-558fcfff-a629-48cb-98b2-69d1f48b28e2 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/security-groups?id=dea88e67-805c-4990-af94-aeeaf2d8e160&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0711272 Dec 09 21:20:52.664187 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f057f967-b1c7-490d-b019-fc4e446fccee req-576810b8-729d-4490-8312-2a4b46e109e8 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:52.763337 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 3eba2279-4b83-4ab6-bde7-0305ee1eda1f completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:20:52.771777 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 3eba2279-4b83-4ab6-bde7-0305ee1eda1f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:52.772157 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:52.794942 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f057f967-b1c7-490d-b019-fc4e446fccee req-576810b8-729d-4490-8312-2a4b46e109e8 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:52.810413 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f057f967-b1c7-490d-b019-fc4e446fccee req-576810b8-729d-4490-8312-2a4b46e109e8 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:52.904942 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-576810b8-729d-4490-8312-2a4b46e109e8 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Pushing event updated for resources: {'SecurityGroup': ['ID=836eb753-a7a8-4b32-9ae9-0184b8831ca8,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:52.967935 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:53.019700 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:53.078652 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 3eba2279-4b83-4ab6-bde7-0305ee1eda1f, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3eba2279-4b83-4ab6-bde7-0305ee1eda1f,segment=NetworkSegment(5c779566-9ab2-470d-8b5d-c18c1d216fd1),segment_id=5c779566-9ab2-470d-8b5d-c18c1d216fd1)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:53.081610 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a007b30a-1cc1-4d65-b263-1bd9d1a84b3b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3eba2279-4b83-4ab6-bde7-0305ee1eda1f'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:20:53.084824 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-39d03249-8f96-4628-b292-6509d3f815e9" -d '{"events": [{"server_uuid": "a007b30a-1cc1-4d65-b263-1bd9d1a84b3b", "name": "network-vif-plugged", "status": "completed", "tag": "3eba2279-4b83-4ab6-bde7-0305ee1eda1f"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:20:53.097592 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:53.102259 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8', 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6', 'port_id': 'b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8', 'mac_address': 'fa:16:3e:04:b4:ba', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 122, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '63e7603a-bb11-4d1a-8d84-55456d81931c', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:20:53.141663 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43131de9-adad-452a-a177-279f98d7fd71 req-8aa0d4cb-4235-4054-9f21-2c60f18f9063 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:53.146681 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43131de9-adad-452a-a177-279f98d7fd71 req-8aa0d4cb-4235-4054-9f21-2c60f18f9063 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 946 time: 0.2370317 Dec 09 21:20:53.168767 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-f057f967-b1c7-490d-b019-fc4e446fccee req-576810b8-729d-4490-8312-2a4b46e109e8 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Allocated IP 192.168.233.116 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/6d291946-2d01-4e98-9924-23ab0f560c19) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:20:53.193682 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:53.220058 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=3eba2279-4b83-4ab6-bde7-0305ee1eda1f,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:53.227618 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:20:53.243118 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59220) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:53.251701 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-f11abd79-b571-4771-bf30-70cb70fa6953 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1678666858', 'description': 'tempest-description--458987662'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:53.293484 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:53.302904 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:53.335299 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f11abd79-b571-4771-bf30-70cb70fa6953 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:53.370992 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43131de9-adad-452a-a177-279f98d7fd71 req-f3b4c478-eca0-43a5-94ef-2ab4ea2dd417 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2027597 Dec 09 21:20:53.418097 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:53.449953 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f11abd79-b571-4771-bf30-70cb70fa6953 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:53.458248 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f11abd79-b571-4771-bf30-70cb70fa6953 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:53.490357 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f11abd79-b571-4771-bf30-70cb70fa6953 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:53.492188 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f11abd79-b571-4771-bf30-70cb70fa6953 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.2472980 Dec 09 21:20:53.495315 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59226) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:53.502995 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-86c4f0db-8251-4287-bbed-84e991840326 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Request body: {'security_group_rule': {'security_group_id': 'c7a6979c-1873-4716-8479-de619cf4fcc0', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:53.526107 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f11abd79-b571-4771-bf30-70cb70fa6953 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c7a6979c-1873-4716-8479-de619cf4fcc0,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:53.557267 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86c4f0db-8251-4287-bbed-84e991840326 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:53.566182 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:20:53.613648 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bda280f0-618b-4066-b57c-76244c2ba73b req-a58cb416-35de-4099-9473-6d70b6931760 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 210 time: 0.1081312 Dec 09 21:20:53.648206 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0355cd38-6c46-4b05-87bc-aca5465d7f84 req-ce913508-428d-4549-ac41-af594335d422 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:53.660021 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0355cd38-6c46-4b05-87bc-aca5465d7f84 req-ce913508-428d-4549-ac41-af594335d422 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 944 time: 0.1557291 Dec 09 21:20:53.716937 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:20:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c4260b43-c95e-4da9-aa9e-ff3d42ea1a37 x-openstack-request-id: req-c4260b43-c95e-4da9-aa9e-ff3d42ea1a37 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:20:53.717349 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a007b30a-1cc1-4d65-b263-1bd9d1a84b3b", "name": "network-vif-plugged", "status": "completed", "tag": "3eba2279-4b83-4ab6-bde7-0305ee1eda1f", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:20:53.717719 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c4260b43-c95e-4da9-aa9e-ff3d42ea1a37 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:20:53.718202 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a007b30a-1cc1-4d65-b263-1bd9d1a84b3b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3eba2279-4b83-4ab6-bde7-0305ee1eda1f', 'code': 200} Dec 09 21:20:53.719005 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86c4f0db-8251-4287-bbed-84e991840326 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:53.728829 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86c4f0db-8251-4287-bbed-84e991840326 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:53.741575 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f057f967-b1c7-490d-b019-fc4e446fccee req-576810b8-729d-4490-8312-2a4b46e109e8 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:53.789345 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86c4f0db-8251-4287-bbed-84e991840326 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d5b0a628-164f-4d0b-b043-e74e4a902148,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:53.807977 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86c4f0db-8251-4287-bbed-84e991840326 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:53.812568 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-86c4f0db-8251-4287-bbed-84e991840326 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3159969 Dec 09 21:20:53.813195 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59230) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:53.822803 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-537f6eae-eb1b-4b17-adf5-6f3b02a347fc tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Request body: {'security_group_rule': {'security_group_id': 'c7a6979c-1873-4716-8479-de619cf4fcc0', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:53.854050 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 3d871078-9873-42c7-9428-2cbedc035380 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:20:53.902955 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f057f967-b1c7-490d-b019-fc4e446fccee req-576810b8-729d-4490-8312-2a4b46e109e8 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:53.916350 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-537f6eae-eb1b-4b17-adf5-6f3b02a347fc tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:53.936511 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 3d871078-9873-42c7-9428-2cbedc035380 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:53.937418 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:53.992193 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0355cd38-6c46-4b05-87bc-aca5465d7f84 req-8bbd016d-838c-4aa4-9598-89b061163528 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1972046 Dec 09 21:20:54.028968 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-537f6eae-eb1b-4b17-adf5-6f3b02a347fc tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:54.035244 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-537f6eae-eb1b-4b17-adf5-6f3b02a347fc tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:54.059356 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:54.065086 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-537f6eae-eb1b-4b17-adf5-6f3b02a347fc tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4f6009bb-2524-4ea5-9208-bf627a4a03b1,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:54.074533 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-537f6eae-eb1b-4b17-adf5-6f3b02a347fc tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:54.076085 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-537f6eae-eb1b-4b17-adf5-6f3b02a347fc tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2617848 Dec 09 21:20:54.080769 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59232) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:20:54.086308 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-d5d108db-bd3a-4926-8636-bcffd319eeb9 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:54.102254 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 3d871078-9873-42c7-9428-2cbedc035380, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=3d871078-9873-42c7-9428-2cbedc035380,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:54.108968 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:54.138360 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5d108db-bd3a-4926-8636-bcffd319eeb9 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks [] for floatingip, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:54.186851 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=3d871078-9873-42c7-9428-2cbedc035380,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:54.267076 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5d108db-bd3a-4926-8636-bcffd319eeb9 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:54.412757 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-d5d108db-bd3a-4926-8636-bcffd319eeb9 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Allocated IP 172.25.3.113 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/4eaead15-fa81-43b7-8704-393ca917038c) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:20:54.460794 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f057f967-b1c7-490d-b019-fc4e446fccee req-576810b8-729d-4490-8312-2a4b46e109e8 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:20:54.484974 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-f057f967-b1c7-490d-b019-fc4e446fccee req-576810b8-729d-4490-8312-2a4b46e109e8 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:20:54.488004 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-da28f06a-520a-4fc5-b3e4-146efca85a60 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.10 "GET /v2.0/networks?tenant_id=857de64ecc3946e3b92655f639d782df&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0418880 Dec 09 21:20:54.488775 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-f057f967-b1c7-490d-b019-fc4e446fccee req-576810b8-729d-4490-8312-2a4b46e109e8 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:20:54.491912 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] Sync routers for ids ['a54b1faf-ab53-4950-be39-e5e79b3d7ed9'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:20:54.502221 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bceb1766-9e6b-4d29-a2bb-d8482b91165d req-34515b28-8194-49a2-bb08-9e95688fe715 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:54.503788 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bceb1766-9e6b-4d29-a2bb-d8482b91165d req-34515b28-8194-49a2-bb08-9e95688fe715 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=a007b30a-1cc1-4d65-b263-1bd9d1a84b3b HTTP/1.1" status: 200 len: 1098 time: 0.6767380 Dec 09 21:20:54.520916 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] Routers {'a54b1faf-ab53-4950-be39-e5e79b3d7ed9'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:20:54.521767 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:20:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a54b1faf-ab53-4950-be39-e5e79b3d7ed9'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:54.563951 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5d108db-bd3a-4926-8636-bcffd319eeb9 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:54.609759 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5d108db-bd3a-4926-8636-bcffd319eeb9 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:54.678890 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-ae73a438-1783-4f81-a5b5-6b4f7b922f19 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:54.680460 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-ae73a438-1783-4f81-a5b5-6b4f7b922f19 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1733861 Dec 09 21:20:54.683633 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d5d108db-bd3a-4926-8636-bcffd319eeb9 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:20:54.686161 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5d108db-bd3a-4926-8636-bcffd319eeb9 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Pushing event updated for resources: {'Port': ['ID=4eaead15-fa81-43b7-8704-393ca917038c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:54.697080 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-d5d108db-bd3a-4926-8636-bcffd319eeb9 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:20:54.700047 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5d108db-bd3a-4926-8636-bcffd319eeb9 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:20:54.707820 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] Set router a54b1faf-ab53-4950-be39-e5e79b3d7ed9 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:20:54.729176 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-ff88e53f-bbfe-4137-a847-6dd63b12e3f4 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Request body: {'port': {'device_id': '8bbb9251-ec6e-45d8-b751-2b2b490cbe3b', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '857de64ecc3946e3b92655f639d782df'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:54.751472 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da25c470-fabc-4eff-920c-9b109a13f23b req-4fc459f5-39a5-4794-a91a-c90598a56305 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:54.758841 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da25c470-fabc-4eff-920c-9b109a13f23b req-4fc459f5-39a5-4794-a91a-c90598a56305 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.8475304 Dec 09 21:20:54.778122 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-576810b8-729d-4490-8312-2a4b46e109e8 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Pushing event updated for resources: {'Port': ['ID=6d291946-2d01-4e98-9924-23ab0f560c19,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:54.878686 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da25c470-fabc-4eff-920c-9b109a13f23b req-21fe4704-11d7-4814-95e4-59131b236907 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1108913 Dec 09 21:20:54.879010 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5d108db-bd3a-4926-8636-bcffd319eeb9 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:54.927267 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5d108db-bd3a-4926-8636-bcffd319eeb9 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:54.954752 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-bb966889-2285-4676-aab2-8150eaa7f055 None None] Provisioning complete for port 6d291946-2d01-4e98-9924-23ab0f560c19 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:54.955116 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bb966889-2285-4676-aab2-8150eaa7f055 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:54.958416 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f057f967-b1c7-490d-b019-fc4e446fccee req-576810b8-729d-4490-8312-2a4b46e109e8 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:54.959104 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f057f967-b1c7-490d-b019-fc4e446fccee req-576810b8-729d-4490-8312-2a4b46e109e8 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:55.011639 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0528002c-34a7-496e-b97a-b662f0a1b09b req-2b90d1c4-ae79-4477-9caa-dfd1c20fdf33 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:55.019325 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0528002c-34a7-496e-b97a-b662f0a1b09b req-2b90d1c4-ae79-4477-9caa-dfd1c20fdf33 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/ports?device_id=f557bb48-79b5-4aa9-b1e7-72fc54f16eff HTTP/1.1" status: 200 len: 936 time: 0.5719171 Dec 09 21:20:55.031669 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f057f967-b1c7-490d-b019-fc4e446fccee req-576810b8-729d-4490-8312-2a4b46e109e8 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.6553247 Dec 09 21:20:55.046215 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-bb966889-2285-4676-aab2-8150eaa7f055 None None] Port 6d291946-2d01-4e98-9924-23ab0f560c19 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:20:55.074481 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-f057f967-b1c7-490d-b019-fc4e446fccee req-f84d461d-6dea-4577-beb9-8609efcf9b1e service neutron] Request body: {'port': {'device_id': 'f557bb48-79b5-4aa9-b1e7-72fc54f16eff', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:55.104868 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'name': 'tempest-ServersTestJSON-799420296-router', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66'}], 'enable_snat': True}, 'gw_port_id': '3d871078-9873-42c7-9428-2cbedc035380', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:20:39Z', 'updated_at': '2021-12-09T21:20:50Z', 'revision_number': 4, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'gw_port': {'id': '3d871078-9873-42c7-9428-2cbedc035380', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:25:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 595, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:42Z', 'updated_at': '2021-12-09T21:20:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'aada448e-8a62-400c-91ba-1ae577560497', 'name': '', 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'mac_address': 'fa:16:3e:0f:c5:a0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'device_owner': 'network:router_interface', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '006a974f-ca2f-40a9-b5ee-25ae5235c5b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:49Z', 'updated_at': '2021-12-09T21:20:50Z', 'revision_number': 2, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'subnets': [{'id': '006a974f-ca2f-40a9-b5ee-25ae5235c5b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:55.119129 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bceb1766-9e6b-4d29-a2bb-d8482b91165d req-4df28e6c-c795-4140-b776-9ad964064ba4 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=dea88e67-805c-4990-af94-aeeaf2d8e160&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4308901 Dec 09 21:20:55.150884 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] Checking router: a54b1faf-ab53-4950-be39-e5e79b3d7ed9 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:20:55.151422 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] Updating router a54b1faf-ab53-4950-be39-e5e79b3d7ed9 port aada448e-8a62-400c-91ba-1ae577560497 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:20:55.182895 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0528002c-34a7-496e-b97a-b662f0a1b09b req-9ca6332d-8e76-42d8-8d6c-531867d2bb1c tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/security-groups?id=836eb753-a7a8-4b32-9ae9-0184b8831ca8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1625555 Dec 09 21:20:55.183036 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:55.281638 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cf96a7c-c7a4-48e9-98b8-5a94b126b26e req-5da5ec37-e14f-4b20-8d1e-0fbc08ac50d1 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:55.289050 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2cf96a7c-c7a4-48e9-98b8-5a94b126b26e req-5da5ec37-e14f-4b20-8d1e-0fbc08ac50d1 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/ports?device_id=a007b30a-1cc1-4d65-b263-1bd9d1a84b3b HTTP/1.1" status: 200 len: 946 time: 0.3131769 Dec 09 21:20:55.355538 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2cf96a7c-c7a4-48e9-98b8-5a94b126b26e req-719b3a75-c0f9-4507-9294-4f70c9ed2788 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/security-groups?id=dea88e67-805c-4990-af94-aeeaf2d8e160&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0633698 Dec 09 21:20:55.358241 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f057f967-b1c7-490d-b019-fc4e446fccee req-f84d461d-6dea-4577-beb9-8609efcf9b1e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:55.407730 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-ff88e53f-bbfe-4137-a847-6dd63b12e3f4 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Made reservation on behalf of 857de64ecc3946e3b92655f639d782df for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:20:55.411425 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-ff88e53f-bbfe-4137-a847-6dd63b12e3f4 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:55.451612 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5d108db-bd3a-4926-8636-bcffd319eeb9 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:55.461076 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5d108db-bd3a-4926-8636-bcffd319eeb9 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:55.511176 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0f112e74-b9d0-4d8e-bd07-b0d744bb8c8c req-f5cee7c9-225c-4c63-a47b-8c93fb361d64 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 210 time: 0.0664530 Dec 09 21:20:55.558896 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35c5be0a-05d4-4eb6-a208-b98d3c366d0a req-f17bf042-392a-4c6f-8576-6a045df8c328 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:55.560679 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35c5be0a-05d4-4eb6-a208-b98d3c366d0a req-f17bf042-392a-4c6f-8576-6a045df8c328 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 946 time: 0.1868546 Dec 09 21:20:55.563922 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:55.574140 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:55.588202 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5d108db-bd3a-4926-8636-bcffd319eeb9 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Pushing event updated for resources: {'Port': ['ID=4eaead15-fa81-43b7-8704-393ca917038c,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:55.617401 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5d108db-bd3a-4926-8636-bcffd319eeb9 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:55.640644 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5d108db-bd3a-4926-8636-bcffd319eeb9 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:55.641289 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d5d108db-bd3a-4926-8636-bcffd319eeb9 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.5593956 Dec 09 21:20:55.746736 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-539a9155-153c-4d8a-9739-bbde7ed74880 None None] Pushing event updated for resources: {'Port': ['ID=aada448e-8a62-400c-91ba-1ae577560497,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:55.758840 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 3d871078-9873-42c7-9428-2cbedc035380 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:20:55.773429 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-539a9155-153c-4d8a-9739-bbde7ed74880 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:55.773858 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-539a9155-153c-4d8a-9739-bbde7ed74880 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:55.774318 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-539a9155-153c-4d8a-9739-bbde7ed74880 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:55.775116 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-539a9155-153c-4d8a-9739-bbde7ed74880 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:55.775541 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-539a9155-153c-4d8a-9739-bbde7ed74880 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:55.775933 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-539a9155-153c-4d8a-9739-bbde7ed74880 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:55.776327 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-539a9155-153c-4d8a-9739-bbde7ed74880 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:55.776850 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-539a9155-153c-4d8a-9739-bbde7ed74880 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:55.777137 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-539a9155-153c-4d8a-9739-bbde7ed74880 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:55.777526 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-539a9155-153c-4d8a-9739-bbde7ed74880 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:55.777907 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-539a9155-153c-4d8a-9739-bbde7ed74880 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:55.778291 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-539a9155-153c-4d8a-9739-bbde7ed74880 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:55.778682 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-539a9155-153c-4d8a-9739-bbde7ed74880 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:20:55.796211 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] Attempting to bind port aada448e-8a62-400c-91ba-1ae577560497 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:20:55.796566 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] Attempting to bind port aada448e-8a62-400c-91ba-1ae577560497 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '6827180a-5aaf-4697-a7f8-e56a6f614fc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:20:55.796995 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] Attempting to bind port aada448e-8a62-400c-91ba-1ae577560497 on network 0a4691ff-8eab-4fe6-bec4-b1a20a69fce2 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:20:55.802280 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 20, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:20:55.803066 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] Checking segment: {'id': '6827180a-5aaf-4697-a7f8-e56a6f614fc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:20:55.803066 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:55.803619 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] Bound using segment: {'id': '6827180a-5aaf-4697-a7f8-e56a6f614fc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:20:55.804711 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] Bound port: aada448e-8a62-400c-91ba-1ae577560497, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6827180a-5aaf-4697-a7f8-e56a6f614fc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:20:55.804711 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:55.842818 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35c5be0a-05d4-4eb6-a208-b98d3c366d0a req-04364f52-11d6-420b-98da-8d312bf3d521 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2505829 Dec 09 21:20:55.857529 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 3d871078-9873-42c7-9428-2cbedc035380 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:55.857753 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:55.893531 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] For port aada448e-8a62-400c-91ba-1ae577560497, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:20:55.900605 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] For port aada448e-8a62-400c-91ba-1ae577560497, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=aada448e-8a62-400c-91ba-1ae577560497,segment=NetworkSegment(6827180a-5aaf-4697-a7f8-e56a6f614fc7),segment_id=6827180a-5aaf-4697-a7f8-e56a6f614fc7)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:20:55.916747 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfdd98bd-9463-48a7-8af9-3f0cb9e19ddc req-0068f8e3-aeca-4bd0-9533-13a08ffce6fe tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:55.921103 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:20:55.924545 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cfdd98bd-9463-48a7-8af9-3f0cb9e19ddc req-0068f8e3-aeca-4bd0-9533-13a08ffce6fe tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 944 time: 0.2592652 Dec 09 21:20:55.925754 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:55.942911 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-ff88e53f-bbfe-4137-a847-6dd63b12e3f4 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Allocated IP 192.168.233.184 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/e145c03d-6648-46c7-8b51-c9e9acd70ff2) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:20:56.017739 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] Routers {'a54b1faf-ab53-4950-be39-e5e79b3d7ed9'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:20:56.018905 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:20:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a54b1faf-ab53-4950-be39-e5e79b3d7ed9'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:56.022065 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-539a9155-153c-4d8a-9739-bbde7ed74880 None None] Pushing event updated for resources: {'Port': ['ID=aada448e-8a62-400c-91ba-1ae577560497,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:56.030896 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cfdd98bd-9463-48a7-8af9-3f0cb9e19ddc req-0cce081e-2f93-4c5b-a6bc-5d934180f15e tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1054640 Dec 09 21:20:56.093757 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-fdfd671d-ddba-4efe-a57c-d2ed5746cf1c None None] Provisioning complete for port aada448e-8a62-400c-91ba-1ae577560497 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:56.094135 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fdfd671d-ddba-4efe-a57c-d2ed5746cf1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:56.166741 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] Set router a54b1faf-ab53-4950-be39-e5e79b3d7ed9 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:20:56.186747 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-9e487cfa-aed7-4ce0-aab5-c2fe25d7cdcc tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-securitygroup--1678666858&fields=id&tenant_id=9f7c325888174a43bdb0cea626873b0e HTTP/1.1" status: 200 len: 267 time: 0.1494427 Dec 09 21:20:56.255654 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fdfd671d-ddba-4efe-a57c-d2ed5746cf1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:56.298082 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-fdfd671d-ddba-4efe-a57c-d2ed5746cf1c None None] For port aada448e-8a62-400c-91ba-1ae577560497, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=aada448e-8a62-400c-91ba-1ae577560497,segment=NetworkSegment(6827180a-5aaf-4697-a7f8-e56a6f614fc7),segment_id=6827180a-5aaf-4697-a7f8-e56a6f614fc7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:56.308833 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fdfd671d-ddba-4efe-a57c-d2ed5746cf1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:56.367195 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-225d71e8-2700-47f5-9f40-5968584771f5 req-a2a7e940-b488-4869-a0f0-966c8c9a229a tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:56.371120 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdfd671d-ddba-4efe-a57c-d2ed5746cf1c None None] Pushing event updated for resources: {'Port': ['ID=aada448e-8a62-400c-91ba-1ae577560497,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:56.371676 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-225d71e8-2700-47f5-9f40-5968584771f5 req-a2a7e940-b488-4869-a0f0-966c8c9a229a tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.1919923 Dec 09 21:20:56.430924 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-ff88e53f-bbfe-4137-a847-6dd63b12e3f4 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:56.431353 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e902fad8-75af-430c-8d6a-f3d1698e5c44 None None] Provisioning complete for port aada448e-8a62-400c-91ba-1ae577560497 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:56.431782 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e902fad8-75af-430c-8d6a-f3d1698e5c44 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:56.492745 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-c30eabd7-a801-4e96-951d-2b1c38d101f0 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:56.494390 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-c30eabd7-a801-4e96-951d-2b1c38d101f0 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/networks?id=0a4691ff-8eab-4fe6-bec4-b1a20a69fce2 HTTP/1.1" status: 200 len: 805 time: 0.2890873 Dec 09 21:20:56.523420 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-225d71e8-2700-47f5-9f40-5968584771f5 req-0f663932-b0ef-40dc-a8e1-51fcc730aa17 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1323199 Dec 09 21:20:56.528527 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'name': 'tempest-ServersTestJSON-799420296-router', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66'}], 'enable_snat': True}, 'gw_port_id': '3d871078-9873-42c7-9428-2cbedc035380', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:20:39Z', 'updated_at': '2021-12-09T21:20:50Z', 'revision_number': 4, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'gw_port': {'id': '3d871078-9873-42c7-9428-2cbedc035380', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:25:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 595, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:42Z', 'updated_at': '2021-12-09T21:20:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'aada448e-8a62-400c-91ba-1ae577560497', 'name': '', 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'mac_address': 'fa:16:3e:0f:c5:a0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'device_owner': 'network:router_interface', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '006a974f-ca2f-40a9-b5ee-25ae5235c5b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:49Z', 'updated_at': '2021-12-09T21:20:55Z', 'revision_number': 4, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'subnets': [{'id': '006a974f-ca2f-40a9-b5ee-25ae5235c5b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:20:56.544836 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-fb6ec176-54b6-42df-b12f-e3f59f2f6b9c tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/quotas/9f7c325888174a43bdb0cea626873b0e HTTP/1.1" status: 200 len: 375 time: 0.0383897 Dec 09 21:20:56.557470 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:20:56.558960 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd825e5b-8ef3-4fea-b652-fa4b47ce226d None None] The sync data for ids ['a54b1faf-ab53-4950-be39-e5e79b3d7ed9'] in n-d-713301-27 is: [{'id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'name': 'tempest-ServersTestJSON-799420296-router', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66'}], 'enable_snat': True}, 'gw_port_id': '3d871078-9873-42c7-9428-2cbedc035380', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:20:39Z', 'updated_at': '2021-12-09T21:20:50Z', 'revision_number': 4, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'gw_port': {'id': '3d871078-9873-42c7-9428-2cbedc035380', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:25:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 595, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:42Z', 'updated_at': '2021-12-09T21:20:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'aada448e-8a62-400c-91ba-1ae577560497', 'name': '', 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'mac_address': 'fa:16:3e:0f:c5:a0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'device_owner': 'network:router_interface', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '006a974f-ca2f-40a9-b5ee-25ae5235c5b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:49Z', 'updated_at': '2021-12-09T21:20:55Z', 'revision_number': 4, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'subnets': [{'id': '006a974f-ca2f-40a9-b5ee-25ae5235c5b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:20:56.579923 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-ff88e53f-bbfe-4137-a847-6dd63b12e3f4 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:56.681894 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-ff88e53f-bbfe-4137-a847-6dd63b12e3f4 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:20:56.721342 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-ff88e53f-bbfe-4137-a847-6dd63b12e3f4 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:20:56.729144 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-ff88e53f-bbfe-4137-a847-6dd63b12e3f4 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:20:56.778085 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['204e6970-8ed3-4e91-9792-52401052a153'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:20:56.810313 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-bc0cf045-2b73-44f7-8c2f-180517118a38 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=9f7c325888174a43bdb0cea626873b0e&fields=id HTTP/1.1" status: 200 len: 302 time: 0.2462637 Dec 09 21:20:56.810978 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff88e53f-bbfe-4137-a847-6dd63b12e3f4 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Pushing event updated for resources: {'Port': ['ID=e145c03d-6648-46c7-8b51-c9e9acd70ff2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:56.854575 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['36925110-4ed7-49f6-b07d-d998896a74cc'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:20:56.892630 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-ff88e53f-bbfe-4137-a847-6dd63b12e3f4 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:56.893911 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-ff88e53f-bbfe-4137-a847-6dd63b12e3f4 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:56.932631 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-ff88e53f-bbfe-4137-a847-6dd63b12e3f4 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.2309151 Dec 09 21:20:56.958034 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-0325d069-4005-4adc-818c-6ceb6cc3634c service neutron] Request body: {'port': {'device_id': '8bbb9251-ec6e-45d8-b751-2b2b490cbe3b', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:57.020253 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:57.049352 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:57.053588 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:20:57.081590 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:57.082024 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:57.105700 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05425a12-8122-4657-ad82-031c086b3629 req-9af83c4a-f486-49af-8d73-25ca014538bc tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:57.107236 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-05425a12-8122-4657-ad82-031c086b3629 req-9af83c4a-f486-49af-8d73-25ca014538bc tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/ports?device_id=f557bb48-79b5-4aa9-b1e7-72fc54f16eff HTTP/1.1" status: 200 len: 936 time: 0.3912032 Dec 09 21:20:57.124306 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-f057f967-b1c7-490d-b019-fc4e446fccee req-f84d461d-6dea-4577-beb9-8609efcf9b1e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6d291946-2d01-4e98-9924-23ab0f560c19 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:20:57.139684 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-94ddc530-39ce-467f-926b-ea38bd2b08fc None None] Provisioning complete for port e145c03d-6648-46c7-8b51-c9e9acd70ff2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:57.140058 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-94ddc530-39ce-467f-926b-ea38bd2b08fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:57.140728 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f057f967-b1c7-490d-b019-fc4e446fccee req-f84d461d-6dea-4577-beb9-8609efcf9b1e service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:57.185635 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-0325d069-4005-4adc-818c-6ceb6cc3634c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:57.207911 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-f057f967-b1c7-490d-b019-fc4e446fccee req-f84d461d-6dea-4577-beb9-8609efcf9b1e service neutron] Transition to ACTIVE for port object 6d291946-2d01-4e98-9924-23ab0f560c19 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:20:57.210650 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-11a2555f-ec70-42be-ba08-2734812f935c service neutron] 10.222.0.13 "GET /v2.0/networks/0a4691ff-8eab-4fe6-bec4-b1a20a69fce2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2951200 Dec 09 21:20:57.217993 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f057f967-b1c7-490d-b019-fc4e446fccee req-f84d461d-6dea-4577-beb9-8609efcf9b1e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:57.236044 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-05425a12-8122-4657-ad82-031c086b3629 req-35e3a809-8e7c-4c41-9bf0-80cc9155075a tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/security-groups?id=836eb753-a7a8-4b32-9ae9-0184b8831ca8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1070850 Dec 09 21:20:57.239430 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-94ddc530-39ce-467f-926b-ea38bd2b08fc None None] Port e145c03d-6648-46c7-8b51-c9e9acd70ff2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:20:57.336949 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:57.365403 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e9419ae1-ea8a-47ae-82d5-b82f1353ca2f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:20:57.373336 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1ca1d3fd-12fd-4287-9f85-99150e24b0a5" -d '{"events": [{"server_uuid": "e9419ae1-ea8a-47ae-82d5-b82f1353ca2f", "name": "network-vif-plugged", "status": "completed", "tag": "b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:20:57.390347 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:20:57.398862 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:57.460921 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:57.476149 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f84d461d-6dea-4577-beb9-8609efcf9b1e service neutron] Pushing event updated for resources: {'Port': ['ID=6d291946-2d01-4e98-9924-23ab0f560c19,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:57.527026 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-72c8ce8b-2f25-4d57-bef5-89d7c017dc66 service neutron] 10.222.0.13 "GET /v2.0/networks/0a4691ff-8eab-4fe6-bec4-b1a20a69fce2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3039684 Dec 09 21:20:57.616056 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8f277d6-cc2c-488e-929d-a97487120596 req-4626ee47-a9b4-4d68-bdfa-19019557dc31 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:57.617529 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8f277d6-cc2c-488e-929d-a97487120596 req-4626ee47-a9b4-4d68-bdfa-19019557dc31 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/ports?device_id=a007b30a-1cc1-4d65-b263-1bd9d1a84b3b HTTP/1.1" status: 200 len: 946 time: 0.2078698 Dec 09 21:20:57.711393 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-f057f967-b1c7-490d-b019-fc4e446fccee req-f84d461d-6dea-4577-beb9-8609efcf9b1e service neutron] Attempting to bind port 6d291946-2d01-4e98-9924-23ab0f560c19 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:20:57.711743 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-f057f967-b1c7-490d-b019-fc4e446fccee req-f84d461d-6dea-4577-beb9-8609efcf9b1e service neutron] Attempting to bind port 6d291946-2d01-4e98-9924-23ab0f560c19 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:20:57.712070 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f057f967-b1c7-490d-b019-fc4e446fccee req-f84d461d-6dea-4577-beb9-8609efcf9b1e service neutron] Attempting to bind port 6d291946-2d01-4e98-9924-23ab0f560c19 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:20:57.751204 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f057f967-b1c7-490d-b019-fc4e446fccee req-f84d461d-6dea-4577-beb9-8609efcf9b1e service neutron] Port 6d291946-2d01-4e98-9924-23ab0f560c19 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:20:57.752368 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f057f967-b1c7-490d-b019-fc4e446fccee req-f84d461d-6dea-4577-beb9-8609efcf9b1e service neutron] Attempting to bind port 6d291946-2d01-4e98-9924-23ab0f560c19 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:20:57.785982 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f057f967-b1c7-490d-b019-fc4e446fccee req-f84d461d-6dea-4577-beb9-8609efcf9b1e service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 20, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:20:57.786351 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f057f967-b1c7-490d-b019-fc4e446fccee req-f84d461d-6dea-4577-beb9-8609efcf9b1e service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:20:57.786901 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f057f967-b1c7-490d-b019-fc4e446fccee req-f84d461d-6dea-4577-beb9-8609efcf9b1e service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:20:57.787211 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-f057f967-b1c7-490d-b019-fc4e446fccee req-f84d461d-6dea-4577-beb9-8609efcf9b1e service neutron] Bound port: 6d291946-2d01-4e98-9924-23ab0f560c19, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:20:57.787596 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f057f967-b1c7-490d-b019-fc4e446fccee req-f84d461d-6dea-4577-beb9-8609efcf9b1e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:57.793383 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8f277d6-cc2c-488e-929d-a97487120596 req-45be5441-2a83-484c-9ad3-481979dac26e tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/security-groups?id=dea88e67-805c-4990-af94-aeeaf2d8e160&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1629863 Dec 09 21:20:57.823892 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device aada448e-8a62-400c-91ba-1ae577560497 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:20:57.902195 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port aada448e-8a62-400c-91ba-1ae577560497 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:20:57.902682 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:58.200060 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ab46ad1-f022-4150-82ef-96201b8ca01e req-892956ff-7f24-4b85-be79-0732059e9d29 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:58.208419 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ab46ad1-f022-4150-82ef-96201b8ca01e req-892956ff-7f24-4b85-be79-0732059e9d29 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 936 time: 0.4676483 Dec 09 21:20:58.317237 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-0325d069-4005-4adc-818c-6ceb6cc3634c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e145c03d-6648-46c7-8b51-c9e9acd70ff2 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:20:58.321814 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-f057f967-b1c7-490d-b019-fc4e446fccee req-f84d461d-6dea-4577-beb9-8609efcf9b1e service neutron] For port 6d291946-2d01-4e98-9924-23ab0f560c19, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:20:58.343004 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-0325d069-4005-4adc-818c-6ceb6cc3634c service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:58.357583 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f20906b6-9873-44df-bf0a-1f09f0c9a3f4 req-c62c5739-c7c3-46b2-8d2d-8a2bd0aa9ac8 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:58.359153 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f20906b6-9873-44df-bf0a-1f09f0c9a3f4 req-c62c5739-c7c3-46b2-8d2d-8a2bd0aa9ac8 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 946 time: 0.2250106 Dec 09 21:20:58.363401 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-f057f967-b1c7-490d-b019-fc4e446fccee req-f84d461d-6dea-4577-beb9-8609efcf9b1e service neutron] For port 6d291946-2d01-4e98-9924-23ab0f560c19, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6d291946-2d01-4e98-9924-23ab0f560c19,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:20:58.367989 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ab46ad1-f022-4150-82ef-96201b8ca01e req-f791f5f7-e21a-4e0d-b668-e70880cb88c7 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1586514 Dec 09 21:20:58.389054 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f057f967-b1c7-490d-b019-fc4e446fccee req-f84d461d-6dea-4577-beb9-8609efcf9b1e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:58.453626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-0325d069-4005-4adc-818c-6ceb6cc3634c service neutron] Transition to ACTIVE for port object e145c03d-6648-46c7-8b51-c9e9acd70ff2 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:20:58.491097 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-0325d069-4005-4adc-818c-6ceb6cc3634c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:58.508535 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f84d461d-6dea-4577-beb9-8609efcf9b1e service neutron] Pushing event updated for resources: {'Port': ['ID=6d291946-2d01-4e98-9924-23ab0f560c19,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:58.551925 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f057f967-b1c7-490d-b019-fc4e446fccee req-f84d461d-6dea-4577-beb9-8609efcf9b1e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:58.552586 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f057f967-b1c7-490d-b019-fc4e446fccee req-f84d461d-6dea-4577-beb9-8609efcf9b1e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:58.553986 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f057f967-b1c7-490d-b019-fc4e446fccee req-f84d461d-6dea-4577-beb9-8609efcf9b1e service neutron] 10.222.0.31 "PUT /v2.0/ports/6d291946-2d01-4e98-9924-23ab0f560c19 HTTP/1.1" status: 200 len: 1097 time: 3.5013185 Dec 09 21:20:58.556601 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f557bb48-79b5-4aa9-b1e7-72fc54f16eff', 'tag': '6d291946-2d01-4e98-9924-23ab0f560c19'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:20:58.559077 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-06d629e1-8e27-49d7-b8b8-7144667199da" -d '{"events": [{"name": "network-changed", "server_uuid": "f557bb48-79b5-4aa9-b1e7-72fc54f16eff", "tag": "6d291946-2d01-4e98-9924-23ab0f560c19"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:20:58.617030 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f20906b6-9873-44df-bf0a-1f09f0c9a3f4 req-5eeadb56-24eb-4e37-b1fd-36dafe111fce tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2479622 Dec 09 21:20:58.625134 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04cdf6a9-3421-4df3-8b02-9bc9fa8968f0 req-2e502dc7-abdc-49eb-a180-7418c40aa47a tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:58.637114 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04cdf6a9-3421-4df3-8b02-9bc9fa8968f0 req-2e502dc7-abdc-49eb-a180-7418c40aa47a tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.1923213 Dec 09 21:20:58.669017 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:20:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ba0dbf82-0433-438f-a01a-fe9a3e93897b x-openstack-request-id: req-ba0dbf82-0433-438f-a01a-fe9a3e93897b {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:20:58.669316 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e9419ae1-ea8a-47ae-82d5-b82f1353ca2f", "name": "network-vif-plugged", "status": "completed", "tag": "b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:20:58.669568 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-ba0dbf82-0433-438f-a01a-fe9a3e93897b {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:20:58.669964 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e9419ae1-ea8a-47ae-82d5-b82f1353ca2f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8', 'code': 200} Dec 09 21:20:58.678742 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0325d069-4005-4adc-818c-6ceb6cc3634c service neutron] Pushing event updated for resources: {'Port': ['ID=e145c03d-6648-46c7-8b51-c9e9acd70ff2,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:58.817270 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f057f967-b1c7-490d-b019-fc4e446fccee req-68604288-ae4f-4265-92d4-05c2d7ab8101 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:58.818798 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f057f967-b1c7-490d-b019-fc4e446fccee req-68604288-ae4f-4265-92d4-05c2d7ab8101 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=494d068aa26b47f382490c9700cd369a&device_id=f557bb48-79b5-4aa9-b1e7-72fc54f16eff HTTP/1.1" status: 200 len: 1100 time: 0.1773522 Dec 09 21:20:58.838278 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04cdf6a9-3421-4df3-8b02-9bc9fa8968f0 req-766d76c0-4221-409f-b389-4203996c5c8f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2008395 Dec 09 21:20:58.874255 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-0325d069-4005-4adc-818c-6ceb6cc3634c service neutron] Attempting to bind port e145c03d-6648-46c7-8b51-c9e9acd70ff2 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:20:58.878945 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-0325d069-4005-4adc-818c-6ceb6cc3634c service neutron] Attempting to bind port e145c03d-6648-46c7-8b51-c9e9acd70ff2 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:20:58.879469 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-0325d069-4005-4adc-818c-6ceb6cc3634c service neutron] Attempting to bind port e145c03d-6648-46c7-8b51-c9e9acd70ff2 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:20:58.931099 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-0325d069-4005-4adc-818c-6ceb6cc3634c service neutron] Port e145c03d-6648-46c7-8b51-c9e9acd70ff2 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:20:58.931447 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-0325d069-4005-4adc-818c-6ceb6cc3634c service neutron] Attempting to bind port e145c03d-6648-46c7-8b51-c9e9acd70ff2 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:20:58.938031 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f057f967-b1c7-490d-b019-fc4e446fccee req-725bcf7c-c93c-4538-a4c7-4046784a695c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.116&port_id=6d291946-2d01-4e98-9924-23ab0f560c19 HTTP/1.1" status: 200 len: 217 time: 0.0899863 Dec 09 21:20:58.953054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c6584a5-a880-4b42-95c2-bb468cb5496a req-c1f6dfc8-2686-44ea-8376-9d6ffde6eb1d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:58.954587 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c6584a5-a880-4b42-95c2-bb468cb5496a req-c1f6dfc8-2686-44ea-8376-9d6ffde6eb1d service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 1097 time: 0.2045794 Dec 09 21:20:58.974717 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-0325d069-4005-4adc-818c-6ceb6cc3634c service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 20, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:20:58.975066 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-0325d069-4005-4adc-818c-6ceb6cc3634c service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:20:58.975470 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-0325d069-4005-4adc-818c-6ceb6cc3634c service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:20:58.975942 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-0325d069-4005-4adc-818c-6ceb6cc3634c service neutron] Bound port: e145c03d-6648-46c7-8b51-c9e9acd70ff2, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:20:58.976300 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-0325d069-4005-4adc-818c-6ceb6cc3634c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:58.991547 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faabc468-f095-4279-8bdb-40209e3f5950 req-f73375cc-ae01-4aa6-8901-c70ced02a964 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:58.993911 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-faabc468-f095-4279-8bdb-40209e3f5950 req-f73375cc-ae01-4aa6-8901-c70ced02a964 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.2290702 Dec 09 21:20:59.075613 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab00855d-53b6-4adf-8a28-5e8decf02080 req-e1666f0f-426c-43e4-b073-4c165eb441e2 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/ports?device_id=ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4 HTTP/1.1" status: 200 len: 210 time: 0.1199172 Dec 09 21:20:59.143176 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-8c635e09-8a69-4b73-90df-891780dd65cd tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:59.145280 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-8c635e09-8a69-4b73-90df-891780dd65cd tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.31 "GET /v2.0/networks?id=0a4691ff-8eab-4fe6-bec4-b1a20a69fce2 HTTP/1.1" status: 200 len: 805 time: 0.2194605 Dec 09 21:20:59.184316 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c6584a5-a880-4b42-95c2-bb468cb5496a req-7fa17285-27c6-4414-b3e6-34f0f8830d8f service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1653302 Dec 09 21:20:59.186066 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f057f967-b1c7-490d-b019-fc4e446fccee req-d0fab107-0d23-438a-8323-166d2abf8cb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:59.188027 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f057f967-b1c7-490d-b019-fc4e446fccee req-d0fab107-0d23-438a-8323-166d2abf8cb0 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.2229371 Dec 09 21:20:59.239980 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-a02a2ed7-36e8-4d72-9206-423e3f103953 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=9f7c325888174a43bdb0cea626873b0e HTTP/1.1" status: 200 len: 380 time: 0.0819683 Dec 09 21:20:59.244263 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-faabc468-f095-4279-8bdb-40209e3f5950 req-809603d3-25b7-4bb9-8a66-61471ba9cc5d tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2167299 Dec 09 21:20:59.270379 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-40f727eb-2c41-4e79-b472-0a92f97dd950 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Request body: {'port': {'device_id': 'ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4', 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2', 'admin_state_up': True, 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'security_groups': ['c7a6979c-1873-4716-8479-de619cf4fcc0']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:20:59.287241 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-0325d069-4005-4adc-818c-6ceb6cc3634c service neutron] For port e145c03d-6648-46c7-8b51-c9e9acd70ff2, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:20:59.312074 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-0325d069-4005-4adc-818c-6ceb6cc3634c service neutron] For port e145c03d-6648-46c7-8b51-c9e9acd70ff2, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e145c03d-6648-46c7-8b51-c9e9acd70ff2,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:20:59.327174 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-0325d069-4005-4adc-818c-6ceb6cc3634c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:59.341637 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f057f967-b1c7-490d-b019-fc4e446fccee req-d9082657-3194-4e0f-be2e-9c869646b134 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:59.343225 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f057f967-b1c7-490d-b019-fc4e446fccee req-d9082657-3194-4e0f-be2e-9c869646b134 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1437106 Dec 09 21:20:59.390301 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-0325d069-4005-4adc-818c-6ceb6cc3634c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:59.393925 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-0325d069-4005-4adc-818c-6ceb6cc3634c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:59.395654 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-0325d069-4005-4adc-818c-6ceb6cc3634c service neutron] 10.222.0.10 "PUT /v2.0/ports/e145c03d-6648-46c7-8b51-c9e9acd70ff2 HTTP/1.1" status: 200 len: 1097 time: 2.4467797 Dec 09 21:20:59.409175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aeb41f3-3864-4e0b-9662-b84787513bf0 req-7e6955b7-24bf-424d-8209-374490adedb3 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:59.414899 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5aeb41f3-3864-4e0b-9662-b84787513bf0 req-7e6955b7-24bf-424d-8209-374490adedb3 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/ports?device_id=f557bb48-79b5-4aa9-b1e7-72fc54f16eff HTTP/1.1" status: 200 len: 948 time: 0.2173116 Dec 09 21:20:59.463014 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-40f727eb-2c41-4e79-b472-0a92f97dd950 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Made reservation on behalf of 9f7c325888174a43bdb0cea626873b0e for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:20:59.472097 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-40f727eb-2c41-4e79-b472-0a92f97dd950 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:59.477328 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:20:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-466b6e0b-6ae4-470b-a592-ce5fa4acf6b7 x-openstack-request-id: req-466b6e0b-6ae4-470b-a592-ce5fa4acf6b7 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:20:59.477615 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f557bb48-79b5-4aa9-b1e7-72fc54f16eff", "tag": "6d291946-2d01-4e98-9924-23ab0f560c19", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:20:59.478528 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-466b6e0b-6ae4-470b-a592-ce5fa4acf6b7 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:20:59.478827 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f557bb48-79b5-4aa9-b1e7-72fc54f16eff', 'tag': '6d291946-2d01-4e98-9924-23ab0f560c19', 'status': 'completed', 'code': 200} Dec 09 21:20:59.567160 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0325d069-4005-4adc-818c-6ceb6cc3634c service neutron] Pushing event updated for resources: {'Port': ['ID=e145c03d-6648-46c7-8b51-c9e9acd70ff2,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:59.669003 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5aeb41f3-3864-4e0b-9662-b84787513bf0 req-2e187a8b-3a79-4651-8e35-d33d7035969c tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/security-groups?id=836eb753-a7a8-4b32-9ae9-0184b8831ca8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2375371 Dec 09 21:20:59.675709 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-967e50e3-1318-4680-9915-10140292057d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:59.677198 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-967e50e3-1318-4680-9915-10140292057d service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 1100 time: 0.2179718 Dec 09 21:20:59.684682 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f057f967-b1c7-490d-b019-fc4e446fccee req-111ef88b-94a1-47ba-9bab-8e74836ce3af service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3162267 Dec 09 21:20:59.700429 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-40f727eb-2c41-4e79-b472-0a92f97dd950 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Allocated IP 172.20.0.9 (0a4691ff-8eab-4fe6-bec4-b1a20a69fce2/006a974f-ca2f-40a9-b5ee-25ae5235c5b1/487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:20:59.741489 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-33131026-37e5-49a7-a59b-26e64716e21a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.184&port_id=e145c03d-6648-46c7-8b51-c9e9acd70ff2 HTTP/1.1" status: 200 len: 217 time: 0.0520463 Dec 09 21:20:59.838140 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef750919-bf66-4ef9-8f31-ee32011eb70d req-8aabf982-b886-423a-9577-93829bab076a tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:59.839965 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef750919-bf66-4ef9-8f31-ee32011eb70d req-8aabf982-b886-423a-9577-93829bab076a tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 948 time: 0.2697375 Dec 09 21:20:59.861962 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-40f727eb-2c41-4e79-b472-0a92f97dd950 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:59.901199 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-40f727eb-2c41-4e79-b472-0a92f97dd950 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:20:59.918501 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-bdcb98f0-6e8c-48c1-83a3-4ab3db00a7f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:59.920007 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-bdcb98f0-6e8c-48c1-83a3-4ab3db00a7f8 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1583033 Dec 09 21:20:59.943548 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-40f727eb-2c41-4e79-b472-0a92f97dd950 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Network 0a4691ff-8eab-4fe6-bec4-b1a20a69fce2 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:20:59.946564 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-40f727eb-2c41-4e79-b472-0a92f97dd950 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:20:59.953345 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-40f727eb-2c41-4e79-b472-0a92f97dd950 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:20:59.959574 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40f727eb-2c41-4e79-b472-0a92f97dd950 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Pushing event updated for resources: {'Port': ['ID=487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:20:59.997476 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b2a352a-1c22-4aa8-bd23-f176a900474d req-7248f10b-7134-4f74-8ec1-6b24fd75dd9b tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:20:59.999039 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8b2a352a-1c22-4aa8-bd23-f176a900474d req-7248f10b-7134-4f74-8ec1-6b24fd75dd9b tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 946 time: 0.2172830 Dec 09 21:21:00.002666 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f057f967-b1c7-490d-b019-fc4e446fccee req-2ea8dc90-6e4b-479b-84a5-83dbe77db651 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2587388 Dec 09 21:21:00.005058 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-40f727eb-2c41-4e79-b472-0a92f97dd950 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:00.005710 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-40f727eb-2c41-4e79-b472-0a92f97dd950 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:00.007630 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef750919-bf66-4ef9-8f31-ee32011eb70d req-c34300c8-b740-4e10-813e-db7760b4bc3f tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1505544 Dec 09 21:21:00.038493 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-40f727eb-2c41-4e79-b472-0a92f97dd950 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7760847 Dec 09 21:21:00.038743 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-95533565-1d5c-41ba-9b02-81e2e5385ddb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:00.038743 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-95533565-1d5c-41ba-9b02-81e2e5385ddb service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1037836 Dec 09 21:21:00.050836 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-d8232dae-a508-4128-8caa-9dd4eead3a65 service neutron] Request body: {'port': {'device_id': 'ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:21:00.118021 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-d8232dae-a508-4128-8caa-9dd4eead3a65 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:00.119902 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8b2a352a-1c22-4aa8-bd23-f176a900474d req-a39e8859-7fe5-449b-a7c0-aa55f1fb359f tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1103086 Dec 09 21:21:00.247683 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06d629e1-8e27-49d7-b8b8-7144667199da req-c2104c67-cce2-415e-9f17-3c7d93d70d85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:00.249095 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-06d629e1-8e27-49d7-b8b8-7144667199da req-c2104c67-cce2-415e-9f17-3c7d93d70d85 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=494d068aa26b47f382490c9700cd369a&device_id=f557bb48-79b5-4aa9-b1e7-72fc54f16eff HTTP/1.1" status: 200 len: 1100 time: 0.1784220 Dec 09 21:21:00.285367 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-736547aa-b2ef-4d59-a196-9465cbb78293 req-c6f81ecd-851a-4d27-ad7b-e178d82f26f8 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:00.286332 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-736547aa-b2ef-4d59-a196-9465cbb78293 req-c6f81ecd-851a-4d27-ad7b-e178d82f26f8 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.1703892 Dec 09 21:21:00.288689 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-7805ab4a-10ce-4878-af49-9ee03015aafe service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2348437 Dec 09 21:21:00.318556 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f82a65cc-15a6-4ae8-949d-371db9c90784 None None] Provisioning complete for port 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:21:00.319581 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f82a65cc-15a6-4ae8-949d-371db9c90784 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:00.357740 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f82a65cc-15a6-4ae8-949d-371db9c90784 None None] Port 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:21:00.403197 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab48e4dd-16bb-4bdc-894c-2fc62bcf5692 req-b3ec3e34-6a1e-46cd-b14f-6ddf8bae3a28 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:00.404926 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab48e4dd-16bb-4bdc-894c-2fc62bcf5692 req-b3ec3e34-6a1e-46cd-b14f-6ddf8bae3a28 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/ports?device_id=ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4 HTTP/1.1" status: 200 len: 931 time: 0.2104518 Dec 09 21:21:00.437210 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-d8232dae-a508-4128-8caa-9dd4eead3a65 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:21:00.445264 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-d8232dae-a508-4128-8caa-9dd4eead3a65 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:00.458535 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-d8232dae-a508-4128-8caa-9dd4eead3a65 service neutron] Transition to ACTIVE for port object 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:21:00.464733 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-d8232dae-a508-4128-8caa-9dd4eead3a65 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:00.513887 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-736547aa-b2ef-4d59-a196-9465cbb78293 req-abc0ce78-06d0-4ae1-8ec0-ed187f72aeb2 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2125034 Dec 09 21:21:00.520186 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8232dae-a508-4128-8caa-9dd4eead3a65 service neutron] Pushing event updated for resources: {'Port': ['ID=487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:00.555796 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06d629e1-8e27-49d7-b8b8-7144667199da req-a1c21bb1-9766-43dc-be57-90d340313294 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:00.557387 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-06d629e1-8e27-49d7-b8b8-7144667199da req-a1c21bb1-9766-43dc-be57-90d340313294 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.2925720 Dec 09 21:21:00.579795 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab48e4dd-16bb-4bdc-894c-2fc62bcf5692 req-52e42402-41c0-4723-96cf-011770a1d7e1 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/security-groups?id=c7a6979c-1873-4716-8479-de619cf4fcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1579123 Dec 09 21:21:00.584126 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96cc4ee6-cd02-45a6-8cac-bd4b1a98f210 req-e21528b4-dc63-4326-b539-3a4556c85d3d service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2727735 Dec 09 21:21:00.616129 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-06d629e1-8e27-49d7-b8b8-7144667199da req-d241cd16-1287-45ac-b8cc-1fa4b4f7df73 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.116&port_id=6d291946-2d01-4e98-9924-23ab0f560c19 HTTP/1.1" status: 200 len: 217 time: 0.0459330 Dec 09 21:21:00.624569 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-d8232dae-a508-4128-8caa-9dd4eead3a65 service neutron] Attempting to bind port 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:21:00.625024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-d8232dae-a508-4128-8caa-9dd4eead3a65 service neutron] Attempting to bind port 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '6827180a-5aaf-4697-a7f8-e56a6f614fc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:21:00.625419 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-d8232dae-a508-4128-8caa-9dd4eead3a65 service neutron] Attempting to bind port 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 on network 0a4691ff-8eab-4fe6-bec4-b1a20a69fce2 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:21:00.636305 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-d8232dae-a508-4128-8caa-9dd4eead3a65 service neutron] Port 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 on network 0a4691ff-8eab-4fe6-bec4-b1a20a69fce2 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:21:00.636773 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-d8232dae-a508-4128-8caa-9dd4eead3a65 service neutron] Attempting to bind port 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 on network 0a4691ff-8eab-4fe6-bec4-b1a20a69fce2 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:21:00.643274 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-d8232dae-a508-4128-8caa-9dd4eead3a65 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 20, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:21:00.643761 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-d8232dae-a508-4128-8caa-9dd4eead3a65 service neutron] Checking segment: {'id': '6827180a-5aaf-4697-a7f8-e56a6f614fc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:21:00.644243 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-d8232dae-a508-4128-8caa-9dd4eead3a65 service neutron] Bound using segment: {'id': '6827180a-5aaf-4697-a7f8-e56a6f614fc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:21:00.644786 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-d8232dae-a508-4128-8caa-9dd4eead3a65 service neutron] Bound port: 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6827180a-5aaf-4697-a7f8-e56a6f614fc7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:21:00.645239 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-d8232dae-a508-4128-8caa-9dd4eead3a65 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:00.674318 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06d629e1-8e27-49d7-b8b8-7144667199da req-509f39ad-6638-4ebf-b245-dc314b855127 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:00.675743 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-06d629e1-8e27-49d7-b8b8-7144667199da req-509f39ad-6638-4ebf-b245-dc314b855127 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0493197 Dec 09 21:21:00.712945 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-d8232dae-a508-4128-8caa-9dd4eead3a65 service neutron] For port 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:21:00.716789 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-d8232dae-a508-4128-8caa-9dd4eead3a65 service neutron] For port 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5,segment=NetworkSegment(6827180a-5aaf-4697-a7f8-e56a6f614fc7),segment_id=6827180a-5aaf-4697-a7f8-e56a6f614fc7)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:21:00.728997 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-d8232dae-a508-4128-8caa-9dd4eead3a65 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:00.764914 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-d8232dae-a508-4128-8caa-9dd4eead3a65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:00.765804 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-d8232dae-a508-4128-8caa-9dd4eead3a65 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:00.767426 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-d8232dae-a508-4128-8caa-9dd4eead3a65 service neutron] 10.222.0.31 "PUT /v2.0/ports/487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 HTTP/1.1" status: 200 len: 1092 time: 0.7215195 Dec 09 21:21:00.767989 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4', 'tag': '487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:21:00.770249 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0521edc1-f659-427e-837e-0badbff077fd req-22beebc4-b343-4c38-afea-b18beb7806b3 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:00.770567 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b4ea66c4-7794-4070-b2ee-9b22d95579a3" -d '{"events": [{"name": "network-changed", "server_uuid": "ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4", "tag": "487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:21:00.777881 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0521edc1-f659-427e-837e-0badbff077fd req-22beebc4-b343-4c38-afea-b18beb7806b3 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.1587439 Dec 09 21:21:00.823819 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06d629e1-8e27-49d7-b8b8-7144667199da req-e6568d09-e705-4232-89b3-d6ad082351da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:00.825719 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-06d629e1-8e27-49d7-b8b8-7144667199da req-e6568d09-e705-4232-89b3-d6ad082351da service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1358759 Dec 09 21:21:00.850383 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8232dae-a508-4128-8caa-9dd4eead3a65 service neutron] Pushing event updated for resources: {'Port': ['ID=487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:00.868104 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-2353e2a6-a996-4822-9df8-cc6cb25e27a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:00.869708 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-2353e2a6-a996-4822-9df8-cc6cb25e27a4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=9f7c325888174a43bdb0cea626873b0e&device_id=ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4 HTTP/1.1" status: 200 len: 1095 time: 0.0556428 Dec 09 21:21:00.923162 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-ba51ba82-c8e2-4024-a762-4ca7a0f94c0b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 HTTP/1.1" status: 200 len: 217 time: 0.0444183 Dec 09 21:21:00.949846 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0521edc1-f659-427e-837e-0badbff077fd req-8ac91e41-a330-4470-a83a-7d0b5f0b7826 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1556969 Dec 09 21:21:00.978027 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-06d629e1-8e27-49d7-b8b8-7144667199da req-23a69774-75f0-4c4c-95b4-539748742622 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1430187 Dec 09 21:21:00.998325 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-e8d1f557-9e38-466f-9c0a-8ab8e6babe26 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:00.999912 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-e8d1f557-9e38-466f-9c0a-8ab8e6babe26 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=006a974f-ca2f-40a9-b5ee-25ae5235c5b1 HTTP/1.1" status: 200 len: 844 time: 0.0692425 Dec 09 21:21:01.089401 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-0a8c9e0a-f701-410f-89a2-f867d60caf3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:01.091224 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-0a8c9e0a-f701-410f-89a2-f867d60caf3e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=0a4691ff-8eab-4fe6-bec4-b1a20a69fce2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0806334 Dec 09 21:21:01.118613 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:21:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aea1690b-9a7a-4d60-bf0a-a7e3f8695b41 x-openstack-request-id: req-aea1690b-9a7a-4d60-bf0a-a7e3f8695b41 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:21:01.118918 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4", "tag": "487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:21:01.119266 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-aea1690b-9a7a-4d60-bf0a-a7e3f8695b41 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:21:01.119596 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4', 'tag': '487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5', 'status': 'completed', 'code': 200} Dec 09 21:21:01.233293 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-0912f11d-bbdb-463f-816d-8517ee1577f4 service neutron] 10.222.0.31 "GET /v2.0/networks/0a4691ff-8eab-4fe6-bec4-b1a20a69fce2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1335230 Dec 09 21:21:01.330685 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b7d0fdf7-c781-49ba-b527-71d2154dcf24 req-a571ba29-0381-4d93-bd37-9b1ec48c06bc service neutron] 10.222.0.31 "GET /v2.0/networks/0a4691ff-8eab-4fe6-bec4-b1a20a69fce2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0895412 Dec 09 21:21:01.431392 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4ea66c4-7794-4070-b2ee-9b22d95579a3 req-f5fbace9-5f31-451e-8b7c-525fb96d28da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:01.433137 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b4ea66c4-7794-4070-b2ee-9b22d95579a3 req-f5fbace9-5f31-451e-8b7c-525fb96d28da service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=9f7c325888174a43bdb0cea626873b0e&device_id=ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4 HTTP/1.1" status: 200 len: 1095 time: 0.0500631 Dec 09 21:21:01.454725 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b102db44-f806-425e-bbea-47b8d636472a req-28d7a774-0779-4530-93c8-3bf457ab158d tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:01.462071 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b102db44-f806-425e-bbea-47b8d636472a req-28d7a774-0779-4530-93c8-3bf457ab158d tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/ports?device_id=f557bb48-79b5-4aa9-b1e7-72fc54f16eff HTTP/1.1" status: 200 len: 948 time: 0.1350458 Dec 09 21:21:01.483833 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de5c8cb3-7b36-4fe2-81a2-d53a3b0f7eb8 req-98c28ecf-efcb-48e5-9861-2582e0a9ef9c tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:01.485418 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de5c8cb3-7b36-4fe2-81a2-d53a3b0f7eb8 req-98c28ecf-efcb-48e5-9861-2582e0a9ef9c tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 948 time: 0.1595404 Dec 09 21:21:01.488345 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8bbb9251-ec6e-45d8-b751-2b2b490cbe3b', 'tag': 'e145c03d-6648-46c7-8b51-c9e9acd70ff2'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:21:01.490571 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b0fd1562-f7cd-4c5d-938b-2f125e978d1b" -d '{"events": [{"name": "network-changed", "server_uuid": "8bbb9251-ec6e-45d8-b751-2b2b490cbe3b", "tag": "e145c03d-6648-46c7-8b51-c9e9acd70ff2"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:21:01.505254 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-06d629e1-8e27-49d7-b8b8-7144667199da req-9466e33a-1f03-4bc7-ae2e-49d0c529307f service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5191004 Dec 09 21:21:01.553894 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4ea66c4-7794-4070-b2ee-9b22d95579a3 req-467833f4-a7e8-4d8d-b976-2dc1f4e721ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:01.555534 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b4ea66c4-7794-4070-b2ee-9b22d95579a3 req-467833f4-a7e8-4d8d-b976-2dc1f4e721ef service neutron] 10.222.0.31 "GET /v2.0/networks?id=0a4691ff-8eab-4fe6-bec4-b1a20a69fce2 HTTP/1.1" status: 200 len: 906 time: 0.1141083 Dec 09 21:21:01.565889 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b102db44-f806-425e-bbea-47b8d636472a req-53d6fbfe-9d62-4347-b600-146177cc16a3 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/security-groups?id=836eb753-a7a8-4b32-9ae9-0184b8831ca8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1028936 Dec 09 21:21:01.581733 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de5c8cb3-7b36-4fe2-81a2-d53a3b0f7eb8 req-c59ce7e4-2142-44e5-949f-1c54767ed80d tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0780933 Dec 09 21:21:01.627046 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b4ea66c4-7794-4070-b2ee-9b22d95579a3 req-5dfdb9f9-05a6-4619-82d0-54b8fb21bf8b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 HTTP/1.1" status: 200 len: 217 time: 0.0639825 Dec 09 21:21:01.633829 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:21:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a7488608-d7af-4bb8-b765-b2c503cac20f x-openstack-request-id: req-a7488608-d7af-4bb8-b765-b2c503cac20f {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:21:01.634248 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8bbb9251-ec6e-45d8-b751-2b2b490cbe3b", "tag": "e145c03d-6648-46c7-8b51-c9e9acd70ff2", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:21:01.634587 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a7488608-d7af-4bb8-b765-b2c503cac20f {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:21:01.635092 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8bbb9251-ec6e-45d8-b751-2b2b490cbe3b', 'tag': 'e145c03d-6648-46c7-8b51-c9e9acd70ff2', 'status': 'completed', 'code': 200} Dec 09 21:21:01.694772 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4ea66c4-7794-4070-b2ee-9b22d95579a3 req-bf274b22-8450-47d7-a31a-5e055a9f6b7a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:01.696546 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b4ea66c4-7794-4070-b2ee-9b22d95579a3 req-bf274b22-8450-47d7-a31a-5e055a9f6b7a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=006a974f-ca2f-40a9-b5ee-25ae5235c5b1 HTTP/1.1" status: 200 len: 844 time: 0.0614736 Dec 09 21:21:01.745334 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4ea66c4-7794-4070-b2ee-9b22d95579a3 req-d2b301c7-1acf-40ad-9e3b-9b599221aeab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:01.747339 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b4ea66c4-7794-4070-b2ee-9b22d95579a3 req-d2b301c7-1acf-40ad-9e3b-9b599221aeab service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=0a4691ff-8eab-4fe6-bec4-b1a20a69fce2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0428250 Dec 09 21:21:01.758441 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2603ab6e-3030-4036-a2fd-1eb4d1974f2b req-ae067af1-b6e0-4ed4-8d22-5514027901f9 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:01.763927 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2603ab6e-3030-4036-a2fd-1eb4d1974f2b req-ae067af1-b6e0-4ed4-8d22-5514027901f9 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 946 time: 0.1324220 Dec 09 21:21:01.766840 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0fd1562-f7cd-4c5d-938b-2f125e978d1b req-c2bc14cc-df73-4c82-8a26-5844e4d6836b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:01.768297 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b0fd1562-f7cd-4c5d-938b-2f125e978d1b req-c2bc14cc-df73-4c82-8a26-5844e4d6836b service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 1100 time: 0.1017985 Dec 09 21:21:01.837661 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de7f6bd4-a4ce-45be-8b84-90304b6363f3 req-7e00914d-4139-44af-a78b-cf027a9f596e tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:01.839187 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de7f6bd4-a4ce-45be-8b84-90304b6363f3 req-7e00914d-4139-44af-a78b-cf027a9f596e tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.1350386 Dec 09 21:21:01.848970 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b4ea66c4-7794-4070-b2ee-9b22d95579a3 req-2c2e73f0-463c-482b-aa94-b568de4ff445 service neutron] 10.222.0.31 "GET /v2.0/networks/0a4691ff-8eab-4fe6-bec4-b1a20a69fce2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0932713 Dec 09 21:21:01.901971 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2603ab6e-3030-4036-a2fd-1eb4d1974f2b req-ad688fc7-d605-49d6-9cee-8a959a92bc90 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1324368 Dec 09 21:21:01.952944 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b4ea66c4-7794-4070-b2ee-9b22d95579a3 req-057acb47-b133-482e-b34c-3a4f83dcee81 service neutron] 10.222.0.31 "GET /v2.0/networks/0a4691ff-8eab-4fe6-bec4-b1a20a69fce2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0961599 Dec 09 21:21:01.954418 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de7f6bd4-a4ce-45be-8b84-90304b6363f3 req-3b57af74-2681-4a1b-9001-8b48a7c5fec1 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0998309 Dec 09 21:21:02.004654 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7f4f15a7-be52-47d8-b251-7eacbb137259 req-cdb787c0-b382-4f05-aad8-c1cb9b19b7a8 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0938506 Dec 09 21:21:02.005536 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0fd1562-f7cd-4c5d-938b-2f125e978d1b req-c240d7bb-24bb-4047-8c7a-7ff8acf63650 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:02.006851 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b0fd1562-f7cd-4c5d-938b-2f125e978d1b req-c240d7bb-24bb-4047-8c7a-7ff8acf63650 service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.2105973 Dec 09 21:21:02.061951 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b0fd1562-f7cd-4c5d-938b-2f125e978d1b req-33d86b43-9203-4642-82aa-7b39fd03a1a2 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.184&port_id=e145c03d-6648-46c7-8b51-c9e9acd70ff2 HTTP/1.1" status: 200 len: 217 time: 0.0450981 Dec 09 21:21:02.200749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-907cd403-f47f-4839-9081-0f1bebc7d013 req-d5e410a3-0776-4b3f-a6e1-25b2f404e608 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:02.202178 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-907cd403-f47f-4839-9081-0f1bebc7d013 req-d5e410a3-0776-4b3f-a6e1-25b2f404e608 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/ports?device_id=ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4 HTTP/1.1" status: 200 len: 943 time: 0.1460421 Dec 09 21:21:02.203587 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0fd1562-f7cd-4c5d-938b-2f125e978d1b req-c86eea98-52b5-4d7b-b8aa-5bfd99b9fdc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:02.204870 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b0fd1562-f7cd-4c5d-938b-2f125e978d1b req-c86eea98-52b5-4d7b-b8aa-5bfd99b9fdc6 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1229768 Dec 09 21:21:02.220781 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f4f15a7-be52-47d8-b251-7eacbb137259 req-c848fcc5-2b3e-45e1-a4ba-434246aad489 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:02.222211 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7f4f15a7-be52-47d8-b251-7eacbb137259 req-c848fcc5-2b3e-45e1-a4ba-434246aad489 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 1097 time: 0.1636941 Dec 09 21:21:02.238790 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89adc05d-e344-4dbc-a60a-388abb38ad1b req-549f99cf-80dc-431e-8892-eb97460b1d07 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:02.240313 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89adc05d-e344-4dbc-a60a-388abb38ad1b req-549f99cf-80dc-431e-8892-eb97460b1d07 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.1828103 Dec 09 21:21:02.394525 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-907cd403-f47f-4839-9081-0f1bebc7d013 req-52d81bec-e34d-4dca-8cd3-62d137326b14 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/security-groups?id=c7a6979c-1873-4716-8479-de619cf4fcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1844227 Dec 09 21:21:02.402631 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89adc05d-e344-4dbc-a60a-388abb38ad1b req-1678fa3f-3a2b-4f75-9892-da8b5cf62e4e tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1544230 Dec 09 21:21:02.406202 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0fd1562-f7cd-4c5d-938b-2f125e978d1b req-b9a1beee-954c-401b-bb5e-4041445efe8b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:02.407703 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b0fd1562-f7cd-4c5d-938b-2f125e978d1b req-b9a1beee-954c-401b-bb5e-4041445efe8b service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1897964 Dec 09 21:21:02.435377 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f4f15a7-be52-47d8-b251-7eacbb137259 req-bec52c44-631b-4df3-b92b-16d30d119480 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:02.437725 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7f4f15a7-be52-47d8-b251-7eacbb137259 req-bec52c44-631b-4df3-b92b-16d30d119480 service neutron] 10.222.0.10 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 908 time: 0.1871803 Dec 09 21:21:02.500418 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7f4f15a7-be52-47d8-b251-7eacbb137259 req-8e989ce1-e402-4ee0-979d-7d2b25336671 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 HTTP/1.1" status: 200 len: 217 time: 0.0478492 Dec 09 21:21:02.590723 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f4f15a7-be52-47d8-b251-7eacbb137259 req-30007c99-5111-4c21-a8f8-07d039613df7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:02.593973 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7f4f15a7-be52-47d8-b251-7eacbb137259 req-30007c99-5111-4c21-a8f8-07d039613df7 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=eae2438b-9fcc-44ef-a172-6c4911cad13f HTTP/1.1" status: 200 len: 847 time: 0.0651510 Dec 09 21:21:02.598966 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b0fd1562-f7cd-4c5d-938b-2f125e978d1b req-ea0eb771-5325-4341-a066-fa968b1a0fd9 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1780870 Dec 09 21:21:02.630897 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6d291946-2d01-4e98-9924-23ab0f560c19 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:21:02.660123 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7f4f15a7-be52-47d8-b251-7eacbb137259 req-0ade520f-3044-40b9-a5ea-b4185c206613 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=04fa749a-9f72-4a2c-a725-feab917f99ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0538363 Dec 09 21:21:02.789773 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6d291946-2d01-4e98-9924-23ab0f560c19, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6d291946-2d01-4e98-9924-23ab0f560c19,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:02.802748 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '6d291946-2d01-4e98-9924-23ab0f560c19', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '6d291946-2d01-4e98-9924-23ab0f560c19', 'mac_address': 'fa:16:3e:34:e6:eb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.116'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:21:02.868290 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b0fd1562-f7cd-4c5d-938b-2f125e978d1b req-1b2b689f-69c1-4194-8038-6f9ed40c42fa service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2513254 Dec 09 21:21:02.880292 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43619583-923e-4899-91aa-e2c177ca1cf7 req-2718065b-b0c9-4cb4-a354-a17c9a07b328 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:02.882342 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43619583-923e-4899-91aa-e2c177ca1cf7 req-2718065b-b0c9-4cb4-a354-a17c9a07b328 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/ports?device_id=f557bb48-79b5-4aa9-b1e7-72fc54f16eff HTTP/1.1" status: 200 len: 948 time: 0.2248337 Dec 09 21:21:02.897618 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de973d91-18c0-4b06-9e86-180fcf2de1bd req-7bc75b01-cd11-4827-b303-ec7d02c5b987 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:02.899850 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de973d91-18c0-4b06-9e86-180fcf2de1bd req-7bc75b01-cd11-4827-b303-ec7d02c5b987 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.2097845 Dec 09 21:21:02.901237 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:02.914946 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7f4f15a7-be52-47d8-b251-7eacbb137259 req-0b832100-f31a-4320-8d29-74dcb323694d service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2234960 Dec 09 21:21:02.918496 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6d291946-2d01-4e98-9924-23ab0f560c19 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:21:02.951576 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6d291946-2d01-4e98-9924-23ab0f560c19, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6d291946-2d01-4e98-9924-23ab0f560c19,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:02.958993 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:02.982254 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3125e733-b947-4229-83c3-8809a3ad19cd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:03.020283 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=6d291946-2d01-4e98-9924-23ab0f560c19,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:03.048357 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de973d91-18c0-4b06-9e86-180fcf2de1bd req-14c6cea9-82d9-4f45-a67c-577809fd21e9 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1356339 Dec 09 21:21:03.073161 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43619583-923e-4899-91aa-e2c177ca1cf7 req-b21048c7-e2e2-4396-a353-34965a271cc8 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/security-groups?id=836eb753-a7a8-4b32-9ae9-0184b8831ca8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1559277 Dec 09 21:21:03.111680 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7f4f15a7-be52-47d8-b251-7eacbb137259 req-ef21db63-b01f-4e35-b491-4185fc6cdf49 service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1804104 Dec 09 21:21:03.225509 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['6d291946-2d01-4e98-9924-23ab0f560c19'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:21:03.250209 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c68f7fe2-03f9-49db-af1e-4dac0c96cdb6 req-3b2ba47e-4c2d-46a7-96a2-bc94582d2b95 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:03.259293 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c68f7fe2-03f9-49db-af1e-4dac0c96cdb6 req-3b2ba47e-4c2d-46a7-96a2-bc94582d2b95 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 948 time: 0.0968480 Dec 09 21:21:03.315122 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16e979b3-3cba-4260-b183-703ff9e23160 req-826ae676-e075-49ff-96c5-d3ddcc169782 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:03.319415 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-16e979b3-3cba-4260-b183-703ff9e23160 req-826ae676-e075-49ff-96c5-d3ddcc169782 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 946 time: 0.1464298 Dec 09 21:21:03.373103 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c68f7fe2-03f9-49db-af1e-4dac0c96cdb6 req-afe79420-f653-49e3-9daa-cc23155bc36f tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1067660 Dec 09 21:21:03.424188 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-16e979b3-3cba-4260-b183-703ff9e23160 req-505f5ed8-a102-41c5-aa8b-7a2c2857d1ac tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0774734 Dec 09 21:21:03.558419 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f26cf729-f1af-4f5f-a749-718778e3ef4f req-25929db3-4df6-4e9d-979d-f13def4cf10c tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:03.560225 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f26cf729-f1af-4f5f-a749-718778e3ef4f req-25929db3-4df6-4e9d-979d-f13def4cf10c tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/ports?device_id=ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4 HTTP/1.1" status: 200 len: 943 time: 0.0914392 Dec 09 21:21:03.575996 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e1dd1fe-2a07-4d85-a7ce-848183554c10 req-f048f0f1-a1f8-4f0c-89f9-6f377742da8b tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:03.579986 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0e1dd1fe-2a07-4d85-a7ce-848183554c10 req-f048f0f1-a1f8-4f0c-89f9-6f377742da8b tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.0743842 Dec 09 21:21:03.664812 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f26cf729-f1af-4f5f-a749-718778e3ef4f req-4528d74f-5790-43e4-a371-2609235d54ea tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/security-groups?id=c7a6979c-1873-4716-8479-de619cf4fcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0972924 Dec 09 21:21:03.668785 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0e1dd1fe-2a07-4d85-a7ce-848183554c10 req-487a90a8-4861-436c-86d1-26ff1cf98d0b tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0799053 Dec 09 21:21:03.988652 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-7ad02597-ed50-4484-b294-35ac7609be32 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:03.990774 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-7ad02597-ed50-4484-b294-35ac7609be32 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56&tenant_id=a306d2242b1e41c892f63c7b122cdee4&binding%3Ahost_id=n-h2-713301-27 HTTP/1.1" status: 200 len: 1098 time: 0.0474946 Dec 09 21:21:04.002265 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-8f9185b2-01d1-4038-aae4-09fb5d4f706f service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h1-713301-27'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:21:04.060704 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-8f9185b2-01d1-4038-aae4-09fb5d4f706f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:04.195295 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6425b7a9-add5-49b6-87f9-6c8449e87244 req-f5cdc62a-6a71-4571-8023-c73e0a0377a7 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:04.199633 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6425b7a9-add5-49b6-87f9-6c8449e87244 req-f5cdc62a-6a71-4571-8023-c73e0a0377a7 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.0765641 Dec 09 21:21:04.202494 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-8f9185b2-01d1-4038-aae4-09fb5d4f706f service neutron] For port 40468c91-ccde-4d96-b234-0e326a1de103, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=40468c91-ccde-4d96-b234-0e326a1de103,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:04.239531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed28315f-2e8a-428f-a2ec-7445a9b82b2c req-38e5c1de-840e-496e-9663-9bc71288c1e8 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:04.240932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-8f9185b2-01d1-4038-aae4-09fb5d4f706f service neutron] For port 40468c91-ccde-4d96-b234-0e326a1de103, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:21:04.242811 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ed28315f-2e8a-428f-a2ec-7445a9b82b2c req-38e5c1de-840e-496e-9663-9bc71288c1e8 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/ports?device_id=f557bb48-79b5-4aa9-b1e7-72fc54f16eff HTTP/1.1" status: 200 len: 949 time: 0.1096914 Dec 09 21:21:04.280970 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '18c57a12-fe06-4b8d-93c7-e3121619fa56', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '40468c91-ccde-4d96-b234-0e326a1de103'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:21:04.283215 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b3defeb9-d693-4ab8-b22e-44fa01faab4b" -d '{"events": [{"server_uuid": "18c57a12-fe06-4b8d-93c7-e3121619fa56", "name": "network-vif-unplugged", "status": "completed", "tag": "40468c91-ccde-4d96-b234-0e326a1de103"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:21:04.287797 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-8f9185b2-01d1-4038-aae4-09fb5d4f706f service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:04.293315 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6425b7a9-add5-49b6-87f9-6c8449e87244 req-9a0a8e8c-cda2-4856-aa4d-2b24588d4181 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0887039 Dec 09 21:21:04.294802 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-8f9185b2-01d1-4038-aae4-09fb5d4f706f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:04.360123 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ed28315f-2e8a-428f-a2ec-7445a9b82b2c req-2fb2edb9-22da-4f44-a086-bfcc01bcc19d tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/security-groups?id=836eb753-a7a8-4b32-9ae9-0184b8831ca8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1063213 Dec 09 21:21:04.404085 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:21:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cd74f0cd-f844-4b15-a707-2e74949e2b18 x-openstack-request-id: req-cd74f0cd-f844-4b15-a707-2e74949e2b18 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:21:04.404501 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "18c57a12-fe06-4b8d-93c7-e3121619fa56", "name": "network-vif-unplugged", "status": "completed", "tag": "40468c91-ccde-4d96-b234-0e326a1de103", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:21:04.404820 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-cd74f0cd-f844-4b15-a707-2e74949e2b18 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:21:04.405280 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '18c57a12-fe06-4b8d-93c7-e3121619fa56', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '40468c91-ccde-4d96-b234-0e326a1de103', 'code': 200} Dec 09 21:21:04.413492 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f9185b2-01d1-4038-aae4-09fb5d4f706f service neutron] Pushing event updated for resources: {'Port': ['ID=40468c91-ccde-4d96-b234-0e326a1de103,revision_number=7']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:04.420029 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-8f9185b2-01d1-4038-aae4-09fb5d4f706f service neutron] Attempting to bind port 40468c91-ccde-4d96-b234-0e326a1de103 on host n-h2-713301-27 for vnic_type normal with profile {"migrating_to": "n-h1-713301-27"} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:21:04.420467 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-8f9185b2-01d1-4038-aae4-09fb5d4f706f service neutron] Attempting to bind port 40468c91-ccde-4d96-b234-0e326a1de103 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:21:04.421268 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-8f9185b2-01d1-4038-aae4-09fb5d4f706f service neutron] Attempting to bind port 40468c91-ccde-4d96-b234-0e326a1de103 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:21:04.426516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-8f9185b2-01d1-4038-aae4-09fb5d4f706f service neutron] Port 40468c91-ccde-4d96-b234-0e326a1de103 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:21:04.426516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-8f9185b2-01d1-4038-aae4-09fb5d4f706f service neutron] Attempting to bind port 40468c91-ccde-4d96-b234-0e326a1de103 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:21:04.431558 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-8f9185b2-01d1-4038-aae4-09fb5d4f706f service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 20, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:21:04.431962 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-8f9185b2-01d1-4038-aae4-09fb5d4f706f service neutron] Checking segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:21:04.432411 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-8f9185b2-01d1-4038-aae4-09fb5d4f706f service neutron] Bound using segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:21:04.433071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-8f9185b2-01d1-4038-aae4-09fb5d4f706f service neutron] Bound port: 40468c91-ccde-4d96-b234-0e326a1de103, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:21:04.433495 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-8f9185b2-01d1-4038-aae4-09fb5d4f706f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:04.495290 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e789558-3d40-43f0-a9d8-474596562dc0 req-a533a46f-daaa-4035-bb01-e239fdc91135 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:04.497545 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0e789558-3d40-43f0-a9d8-474596562dc0 req-a533a46f-daaa-4035-bb01-e239fdc91135 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 948 time: 0.0597095 Dec 09 21:21:04.504694 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-8f9185b2-01d1-4038-aae4-09fb5d4f706f service neutron] For port 40468c91-ccde-4d96-b234-0e326a1de103, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:21:04.507927 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-8f9185b2-01d1-4038-aae4-09fb5d4f706f service neutron] For port 40468c91-ccde-4d96-b234-0e326a1de103, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=40468c91-ccde-4d96-b234-0e326a1de103,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:21:04.513581 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-8f9185b2-01d1-4038-aae4-09fb5d4f706f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:04.563461 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e145c03d-6648-46c7-8b51-c9e9acd70ff2 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:21:04.574098 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d2e6202-6f39-4bc1-afc0-758089936374 req-784cd18e-6785-4e65-959c-2a32ee312694 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:04.582264 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0d2e6202-6f39-4bc1-afc0-758089936374 req-784cd18e-6785-4e65-959c-2a32ee312694 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 944 time: 0.0831447 Dec 09 21:21:04.599775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f9185b2-01d1-4038-aae4-09fb5d4f706f service neutron] Pushing event updated for resources: {'Port': ['ID=40468c91-ccde-4d96-b234-0e326a1de103,revision_number=8']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:04.604844 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-8f9185b2-01d1-4038-aae4-09fb5d4f706f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:04.607043 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-8f9185b2-01d1-4038-aae4-09fb5d4f706f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:04.608411 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-8f9185b2-01d1-4038-aae4-09fb5d4f706f service neutron] 10.222.0.31 "PUT /v2.0/ports/40468c91-ccde-4d96-b234-0e326a1de103 HTTP/1.1" status: 200 len: 1124 time: 0.6101985 Dec 09 21:21:04.616501 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0e789558-3d40-43f0-a9d8-474596562dc0 req-359a7888-ddf8-4cc6-bd6a-d66ba45bc299 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1063833 Dec 09 21:21:04.650220 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:21:04.652985 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6d291946-2d01-4e98-9924-23ab0f560c19 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:21:04.668274 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0d2e6202-6f39-4bc1-afc0-758089936374 req-22c38569-e3ec-437b-ad0c-d8e69c0347e7 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0853693 Dec 09 21:21:04.756240 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['40468c91-ccde-4d96-b234-0e326a1de103'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:21:04.776090 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['40468c91-ccde-4d96-b234-0e326a1de103'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:21:04.862948 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9c1bf17e-11cc-49b4-be3e-46abb2466f53 req-71073833-51b2-4161-8369-41a393339990 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0507123 Dec 09 21:21:04.877792 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afa3b03e-ca1b-483d-9271-ece50715403d req-bd079a42-6f40-46b9-8bf5-04e4e3de0a63 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:04.879464 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-afa3b03e-ca1b-483d-9271-ece50715403d req-bd079a42-6f40-46b9-8bf5-04e4e3de0a63 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.1160243 Dec 09 21:21:04.916469 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.resource_extend [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 09 21:21:04.921487 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-895e6406-f245-4538-91b8-a6665b971da7 req-0927444c-6512-447b-9b71-1724069a004b tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:04.921734 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-895e6406-f245-4538-91b8-a6665b971da7 req-0927444c-6512-447b-9b71-1724069a004b tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/ports?device_id=ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4 HTTP/1.1" status: 200 len: 943 time: 0.1236258 Dec 09 21:21:04.950172 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c1bf17e-11cc-49b4-be3e-46abb2466f53 req-1afadc59-607c-4aae-9323-a95711ff310d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:04.951966 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9c1bf17e-11cc-49b4-be3e-46abb2466f53 req-1afadc59-607c-4aae-9323-a95711ff310d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 1096 time: 0.0551784 Dec 09 21:21:05.007239 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-afa3b03e-ca1b-483d-9271-ece50715403d req-090947fa-4cb2-419a-b80c-ed12fa31e39c tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1200681 Dec 09 21:21:05.058058 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port e145c03d-6648-46c7-8b51-c9e9acd70ff2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e145c03d-6648-46c7-8b51-c9e9acd70ff2,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:05.059926 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-895e6406-f245-4538-91b8-a6665b971da7 req-89000e20-986f-48c2-afe1-ab57e27f0909 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/security-groups?id=c7a6979c-1873-4716-8479-de619cf4fcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1107774 Dec 09 21:21:05.095874 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 6d291946-2d01-4e98-9924-23ab0f560c19 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:21:05.105704 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 6d291946-2d01-4e98-9924-23ab0f560c19 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:21:05.106481 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:05.113295 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c1bf17e-11cc-49b4-be3e-46abb2466f53 req-5d186d1d-c07d-4f1a-8ee8-64180931171b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:05.119110 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9c1bf17e-11cc-49b4-be3e-46abb2466f53 req-5d186d1d-c07d-4f1a-8ee8-64180931171b service neutron] 10.222.0.31 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 922 time: 0.1415308 Dec 09 21:21:05.151122 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'e145c03d-6648-46c7-8b51-c9e9acd70ff2', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': 'e145c03d-6648-46c7-8b51-c9e9acd70ff2', 'mac_address': 'fa:16:3e:ef:72:31', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.184'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:21:05.162699 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9c1bf17e-11cc-49b4-be3e-46abb2466f53 req-4c927851-6ad5-4b8a-9dc9-0c19afe1e3b0 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=85dcf098-2530-45e6-aecc-ec3e2e8888a6 HTTP/1.1" status: 200 len: 217 time: 0.0389369 Dec 09 21:21:05.212725 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c1bf17e-11cc-49b4-be3e-46abb2466f53 req-3863743d-e347-4a02-8096-fffd96084209 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:05.214534 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9c1bf17e-11cc-49b4-be3e-46abb2466f53 req-3863743d-e347-4a02-8096-fffd96084209 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=c49a62cc-af1b-4958-a4a9-eb44188b8fb9 HTTP/1.1" status: 200 len: 861 time: 0.0444851 Dec 09 21:21:05.216563 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5,segment=NetworkSegment(6827180a-5aaf-4697-a7f8-e56a6f614fc7),segment_id=6827180a-5aaf-4697-a7f8-e56a6f614fc7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:05.249411 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9c1bf17e-11cc-49b4-be3e-46abb2466f53 req-7a754045-e98e-434e-a5fb-fcafcc9ecbcf service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=93378dc3-2ac5-4cf7-9ce3-d812934de40c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0262067 Dec 09 21:21:05.275981 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5', 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2', 'port_id': '487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5', 'mac_address': 'fa:16:3e:f2:32:b4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 145, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '006a974f-ca2f-40a9-b5ee-25ae5235c5b1', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:21:05.277474 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:05.324366 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e145c03d-6648-46c7-8b51-c9e9acd70ff2 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:21:05.368996 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9c1bf17e-11cc-49b4-be3e-46abb2466f53 req-a7cae0f9-d619-4b7d-987a-37bb98c5b2c8 service neutron] 10.222.0.31 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1113267 Dec 09 21:21:05.401847 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port e145c03d-6648-46c7-8b51-c9e9acd70ff2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e145c03d-6648-46c7-8b51-c9e9acd70ff2,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:05.508652 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8c4c778-7a65-4edc-990a-c80e2f55dfe4 req-feed85c1-2c34-4960-bed6-b0c3059d2a61 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:05.517501 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8c4c778-7a65-4edc-990a-c80e2f55dfe4 req-feed85c1-2c34-4960-bed6-b0c3059d2a61 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.1509180 Dec 09 21:21:05.538376 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9c1bf17e-11cc-49b4-be3e-46abb2466f53 req-dfaad67c-a60c-432c-ad95-626ec4a9b768 service neutron] 10.222.0.31 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1575954 Dec 09 21:21:05.556298 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34e472a7-bcdb-40b9-ace2-17c79593c3d8 req-f8fd5fc0-b54e-4fd4-a29d-949eb528743c tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:05.558504 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-34e472a7-bcdb-40b9-ace2-17c79593c3d8 req-f8fd5fc0-b54e-4fd4-a29d-949eb528743c tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/ports?device_id=f557bb48-79b5-4aa9-b1e7-72fc54f16eff HTTP/1.1" status: 200 len: 949 time: 0.1207197 Dec 09 21:21:05.601095 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8c4c778-7a65-4edc-990a-c80e2f55dfe4 req-d5d58b25-d087-4763-bf83-b6c386ecf350 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0821397 Dec 09 21:21:05.615233 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:05.635789 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-34e472a7-bcdb-40b9-ace2-17c79593c3d8 req-e6d107aa-a4a1-4560-8b37-5cb7aeae237c tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/security-groups?id=836eb753-a7a8-4b32-9ae9-0184b8831ca8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0670400 Dec 09 21:21:05.657201 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:05.709926 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:05.736753 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9204d238-6237-4816-ae0e-39cf1dcffb8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:05.762009 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6d291946-2d01-4e98-9924-23ab0f560c19, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6d291946-2d01-4e98-9924-23ab0f560c19,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:05.766593 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f557bb48-79b5-4aa9-b1e7-72fc54f16eff', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6d291946-2d01-4e98-9924-23ab0f560c19'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:21:05.769124 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6acbbb51-1182-42ac-b409-0da357105629" -d '{"events": [{"server_uuid": "f557bb48-79b5-4aa9-b1e7-72fc54f16eff", "name": "network-vif-plugged", "status": "completed", "tag": "6d291946-2d01-4e98-9924-23ab0f560c19"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:21:05.773231 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8127c70-0df2-4778-996e-fa7b3655b8a5 req-8705de4a-e734-4f16-9e9f-6ac2a6c383b8 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:05.775301 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8127c70-0df2-4778-996e-fa7b3655b8a5 req-8705de4a-e734-4f16-9e9f-6ac2a6c383b8 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 949 time: 0.0654078 Dec 09 21:21:05.777949 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:21:05.786234 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:05.832485 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5,segment=NetworkSegment(6827180a-5aaf-4697-a7f8-e56a6f614fc7),segment_id=6827180a-5aaf-4697-a7f8-e56a6f614fc7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:05.834060 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=e145c03d-6648-46c7-8b51-c9e9acd70ff2,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:05.841276 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:05.882440 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8127c70-0df2-4778-996e-fa7b3655b8a5 req-55acfc22-ab64-4d0b-a271-690f5718a8ef tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0961297 Dec 09 21:21:05.890095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-658ad2a0-c0f8-410e-976a-20961c36089f req-584777a8-8916-4a7f-a147-ad277e720692 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:05.895951 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=6d291946-2d01-4e98-9924-23ab0f560c19,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:05.898872 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-658ad2a0-c0f8-410e-976a-20961c36089f req-584777a8-8916-4a7f-a147-ad277e720692 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 944 time: 0.1217749 Dec 09 21:21:05.954752 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:05.959516 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:21:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dfd2bab8-aa21-4881-b6ec-4fb16d4da97b x-openstack-request-id: req-dfd2bab8-aa21-4881-b6ec-4fb16d4da97b {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:21:05.959984 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f557bb48-79b5-4aa9-b1e7-72fc54f16eff", "name": "network-vif-plugged", "status": "completed", "tag": "6d291946-2d01-4e98-9924-23ab0f560c19", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:21:05.960397 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-dfd2bab8-aa21-4881-b6ec-4fb16d4da97b {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:21:05.961076 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f557bb48-79b5-4aa9-b1e7-72fc54f16eff', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6d291946-2d01-4e98-9924-23ab0f560c19', 'code': 200} Dec 09 21:21:05.962122 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-658ad2a0-c0f8-410e-976a-20961c36089f req-b625aa69-646d-4109-84bf-5cf968b68e07 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0630939 Dec 09 21:21:06.000441 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['e145c03d-6648-46c7-8b51-c9e9acd70ff2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:21:06.087220 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-879ec36d-3ae4-45f7-9347-8fc88426b9c8 req-99b15185-9e21-4f27-b3d9-f5b191590168 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:06.089439 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-879ec36d-3ae4-45f7-9347-8fc88426b9c8 req-99b15185-9e21-4f27-b3d9-f5b191590168 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=f557bb48-79b5-4aa9-b1e7-72fc54f16eff HTTP/1.1" status: 200 len: 1102 time: 0.0550311 Dec 09 21:21:06.150021 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:21:06.152001 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-879ec36d-3ae4-45f7-9347-8fc88426b9c8 req-375d5510-722b-4cdd-a788-8531f45f84d2 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=836eb753-a7a8-4b32-9ae9-0184b8831ca8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0537317 Dec 09 21:21:06.157486 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe4b3d80-f8c6-4679-a884-721b7b0218dc req-09bf370d-6d05-44b4-ab2e-aef2deb83fc7 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:06.164654 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe4b3d80-f8c6-4679-a884-721b7b0218dc req-09bf370d-6d05-44b4-ab2e-aef2deb83fc7 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.0638056 Dec 09 21:21:06.240270 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe4b3d80-f8c6-4679-a884-721b7b0218dc req-355ed312-865e-4dab-8a94-a9e00ecdf760 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0734921 Dec 09 21:21:06.249145 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7de9c651-b09a-48ae-a80a-654558b22068 req-90519a1b-046e-4ee3-8269-f3fd9ff84fc7 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:06.257227 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7de9c651-b09a-48ae-a80a-654558b22068 req-90519a1b-046e-4ee3-8269-f3fd9ff84fc7 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/ports?device_id=ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4 HTTP/1.1" status: 200 len: 944 time: 0.0885041 Dec 09 21:21:06.317986 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7de9c651-b09a-48ae-a80a-654558b22068 req-7f8edb75-7d76-4db0-b419-2720479d4c45 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/security-groups?id=c7a6979c-1873-4716-8479-de619cf4fcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0596697 Dec 09 21:21:06.406390 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '18c57a12-fe06-4b8d-93c7-e3121619fa56', 'tag': '40468c91-ccde-4d96-b234-0e326a1de103'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:21:06.408913 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d74a7169-6640-4c77-bc87-c7fcec10d5b3" -d '{"events": [{"name": "network-changed", "server_uuid": "18c57a12-fe06-4b8d-93c7-e3121619fa56", "tag": "40468c91-ccde-4d96-b234-0e326a1de103"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:21:06.445124 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:21:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-50189637-18d1-4d76-8474-9324c3dea290 x-openstack-request-id: req-50189637-18d1-4d76-8474-9324c3dea290 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:21:06.445419 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "18c57a12-fe06-4b8d-93c7-e3121619fa56", "tag": "40468c91-ccde-4d96-b234-0e326a1de103", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:21:06.445675 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-50189637-18d1-4d76-8474-9324c3dea290 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:21:06.446048 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '18c57a12-fe06-4b8d-93c7-e3121619fa56', 'tag': '40468c91-ccde-4d96-b234-0e326a1de103', 'status': 'completed', 'code': 200} Dec 09 21:21:06.483952 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:06.517212 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d74a7169-6640-4c77-bc87-c7fcec10d5b3 req-7a8c601a-d184-4d3c-b363-56e32eff7ebd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:06.518961 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d74a7169-6640-4c77-bc87-c7fcec10d5b3 req-7a8c601a-d184-4d3c-b363-56e32eff7ebd service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 1127 time: 0.0464125 Dec 09 21:21:06.621885 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d74a7169-6640-4c77-bc87-c7fcec10d5b3 req-6dbbdfb6-88a0-4770-a851-2944156191df service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:06.623862 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d74a7169-6640-4c77-bc87-c7fcec10d5b3 req-6dbbdfb6-88a0-4770-a851-2944156191df service neutron] 10.222.0.10 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 922 time: 0.0964291 Dec 09 21:21:06.648480 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 40468c91-ccde-4d96-b234-0e326a1de103 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:21:06.677801 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d74a7169-6640-4c77-bc87-c7fcec10d5b3 req-84d5e449-a680-400d-98ce-8dac8dc24e48 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=40468c91-ccde-4d96-b234-0e326a1de103 HTTP/1.1" status: 200 len: 217 time: 0.0445042 Dec 09 21:21:06.783906 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 40468c91-ccde-4d96-b234-0e326a1de103, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=40468c91-ccde-4d96-b234-0e326a1de103,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:06.803980 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 40468c91-ccde-4d96-b234-0e326a1de103 has no active binding in host n-h1-713301-27 {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:158}} Dec 09 21:21:06.818437 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d74a7169-6640-4c77-bc87-c7fcec10d5b3 req-3343d519-b3b2-448c-93d5-d611694b6d75 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:06.823575 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d74a7169-6640-4c77-bc87-c7fcec10d5b3 req-3343d519-b3b2-448c-93d5-d611694b6d75 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=c49a62cc-af1b-4958-a4a9-eb44188b8fb9 HTTP/1.1" status: 200 len: 861 time: 0.1219945 Dec 09 21:21:06.836886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57502319-f6eb-497e-b9f5-0705c688a775 req-4da51ceb-5881-4eae-9663-aa86daa2aee8 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:06.838427 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-57502319-f6eb-497e-b9f5-0705c688a775 req-4da51ceb-5881-4eae-9663-aa86daa2aee8 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/ports?device_id=f557bb48-79b5-4aa9-b1e7-72fc54f16eff HTTP/1.1" status: 200 len: 950 time: 0.1032054 Dec 09 21:21:06.856366 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-193933ec-8ea8-41b7-b455-5db12460ae02 req-fe4fcef6-28a4-47ef-9e62-adfe3951ae0c tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:06.857982 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-193933ec-8ea8-41b7-b455-5db12460ae02 req-fe4fcef6-28a4-47ef-9e62-adfe3951ae0c tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.1213117 Dec 09 21:21:06.877999 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d74a7169-6640-4c77-bc87-c7fcec10d5b3 req-86186f08-480e-4ecb-9d67-bc0d6ac5498f service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=93378dc3-2ac5-4cf7-9ce3-d812934de40c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0490026 Dec 09 21:21:06.994632 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-57502319-f6eb-497e-b9f5-0705c688a775 req-08fa559a-865f-4557-899f-3610c3d5b592 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/security-groups?id=836eb753-a7a8-4b32-9ae9-0184b8831ca8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1467214 Dec 09 21:21:07.020923 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-193933ec-8ea8-41b7-b455-5db12460ae02 req-25430076-84a5-44f0-a612-8ef9f071efae tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1446500 Dec 09 21:21:07.044621 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d74a7169-6640-4c77-bc87-c7fcec10d5b3 req-b30eab27-c28e-46c9-9ceb-cc662f596df0 service neutron] 10.222.0.10 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1530740 Dec 09 21:21:07.474152 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d74a7169-6640-4c77-bc87-c7fcec10d5b3 req-87153020-4d70-45e1-b467-50f08cfa683f service neutron] 10.222.0.10 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4202180 Dec 09 21:21:07.487223 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e67b5021-9969-43c3-ba74-ec5f545b691a req-ee6d373e-8ded-4785-ae40-4d73d4fce1e3 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:07.488662 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e67b5021-9969-43c3-ba74-ec5f545b691a req-ee6d373e-8ded-4785-ae40-4d73d4fce1e3 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 949 time: 0.4012518 Dec 09 21:21:07.498261 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e048eff-3711-47ca-8296-19476bd43e85 req-dbc59b59-156b-44b7-9882-cf5d75fb442f tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:07.499782 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e048eff-3711-47ca-8296-19476bd43e85 req-dbc59b59-156b-44b7-9882-cf5d75fb442f tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 944 time: 0.3773184 Dec 09 21:21:07.568291 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e67b5021-9969-43c3-ba74-ec5f545b691a req-59ce77a8-6702-4db7-9184-89c123f45a53 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0675156 Dec 09 21:21:07.581454 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e048eff-3711-47ca-8296-19476bd43e85 req-1f6d46d0-f5a5-45aa-9c1b-374edba9e9c7 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0738001 Dec 09 21:21:07.741255 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e46fb111-c0cd-4869-b5e0-95c966b6f2e5 req-2db1db0f-4ce0-4fb8-afec-1f5565c1f3cb tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:07.742767 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e46fb111-c0cd-4869-b5e0-95c966b6f2e5 req-2db1db0f-4ce0-4fb8-afec-1f5565c1f3cb tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.0983355 Dec 09 21:21:07.754620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a4ca927-798c-4d33-b615-e7b98b6528ac req-85a155e3-6123-45c9-9b20-5f92c1eaddd5 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:07.756152 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a4ca927-798c-4d33-b615-e7b98b6528ac req-85a155e3-6123-45c9-9b20-5f92c1eaddd5 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/ports?device_id=ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4 HTTP/1.1" status: 200 len: 944 time: 0.0807807 Dec 09 21:21:07.832256 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a4ca927-798c-4d33-b615-e7b98b6528ac req-4f86c7bf-9e29-4721-9b6d-b265e4b455f2 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/security-groups?id=c7a6979c-1873-4716-8479-de619cf4fcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0687010 Dec 09 21:21:07.834397 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:07.837016 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e46fb111-c0cd-4869-b5e0-95c966b6f2e5 req-56dc01b3-7e42-4244-ac36-d37d18da2a30 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0799675 Dec 09 21:21:08.149917 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da20267f-f5f3-4fcc-b213-c109ecf417b5 req-34d50cf8-7c4e-453a-a00e-75044b103c5d tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:08.151430 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da20267f-f5f3-4fcc-b213-c109ecf417b5 req-34d50cf8-7c4e-453a-a00e-75044b103c5d tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/ports?device_id=f557bb48-79b5-4aa9-b1e7-72fc54f16eff HTTP/1.1" status: 200 len: 950 time: 0.0758030 Dec 09 21:21:08.163182 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5b0d2d1-4c71-4a19-943e-5da7f98d834c req-541a02b4-fdd6-427b-90b2-116dd942e1b4 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:08.164600 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b5b0d2d1-4c71-4a19-943e-5da7f98d834c req-541a02b4-fdd6-427b-90b2-116dd942e1b4 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.0633087 Dec 09 21:21:08.236401 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da20267f-f5f3-4fcc-b213-c109ecf417b5 req-fc5bfb11-a795-41be-a88a-da976e0af4b7 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/security-groups?id=836eb753-a7a8-4b32-9ae9-0184b8831ca8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0707526 Dec 09 21:21:08.239765 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b5b0d2d1-4c71-4a19-943e-5da7f98d834c req-0b5078fc-c697-4785-b9a6-8aacec05f1e1 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0685897 Dec 09 21:21:08.580575 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e145c03d-6648-46c7-8b51-c9e9acd70ff2 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:21:08.653507 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:21:08.721376 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:21:08.724909 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port e145c03d-6648-46c7-8b51-c9e9acd70ff2 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:21:08.726764 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e376de37-8beb-4952-8ee3-530af1d7bcb8 req-7dfafd85-1300-4581-a428-2ec8356a1e38 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:08.728182 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:21:08.728423 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e376de37-8beb-4952-8ee3-530af1d7bcb8 req-7dfafd85-1300-4581-a428-2ec8356a1e38 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 949 time: 0.0533092 Dec 09 21:21:08.728540 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:08.732486 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port e145c03d-6648-46c7-8b51-c9e9acd70ff2 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:21:08.732486 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:08.806472 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acd857a9-85f8-4826-a49c-66f0bb96c382 req-2a51edea-b0dd-40c9-80e4-72e383f901eb tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:08.808118 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-acd857a9-85f8-4826-a49c-66f0bb96c382 req-2a51edea-b0dd-40c9-80e4-72e383f901eb tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 944 time: 0.0786901 Dec 09 21:21:08.811758 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e376de37-8beb-4952-8ee3-530af1d7bcb8 req-793e497f-1026-4111-9101-ab8f6cb938c7 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0739217 Dec 09 21:21:08.870444 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-acd857a9-85f8-4826-a49c-66f0bb96c382 req-483c08be-4f21-43fe-8a82-48bad5d6e6a0 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547349 Dec 09 21:21:08.890327 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:08.921883 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:08.928089 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:21:08.930333 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-53192476-8072-4905-a8c1-f7eb47c1ab1e" -d '{"events": [{"server_uuid": "ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4", "name": "network-vif-plugged", "status": "completed", "tag": "487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:21:08.950318 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5,segment=NetworkSegment(6827180a-5aaf-4697-a7f8-e56a6f614fc7),segment_id=6827180a-5aaf-4697-a7f8-e56a6f614fc7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:08.957899 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:08.982180 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5e082fb-1906-4154-a07e-951d7f351ed0 req-808dff4e-90de-4e1f-ba13-e98bdc6dc289 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:08.983615 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5e082fb-1906-4154-a07e-951d7f351ed0 req-808dff4e-90de-4e1f-ba13-e98bdc6dc289 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/ports?device_id=ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4 HTTP/1.1" status: 200 len: 944 time: 0.0777147 Dec 09 21:21:08.994143 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port e145c03d-6648-46c7-8b51-c9e9acd70ff2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e145c03d-6648-46c7-8b51-c9e9acd70ff2,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:08.999478 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:09.005968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-838344f1-f3f9-46c7-92b8-4f51d84f2cb4 req-2c8f7a4b-4239-4525-877b-0386d7c9b0c4 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:09.007422 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-838344f1-f3f9-46c7-92b8-4f51d84f2cb4 req-2c8f7a4b-4239-4525-877b-0386d7c9b0c4 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.0701828 Dec 09 21:21:09.018183 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:09.070217 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=e145c03d-6648-46c7-8b51-c9e9acd70ff2,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:09.076123 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5e082fb-1906-4154-a07e-951d7f351ed0 req-5ab1b31b-7331-4d48-ab6c-f9ca7f42812d tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/security-groups?id=c7a6979c-1873-4716-8479-de619cf4fcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0841131 Dec 09 21:21:09.080549 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-838344f1-f3f9-46c7-92b8-4f51d84f2cb4 req-43e6da8e-5364-4fed-8a7a-93c655076e80 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0655365 Dec 09 21:21:09.140463 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:21:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-234f0524-19e5-475a-bf0e-d96d8f13c9e1 x-openstack-request-id: req-234f0524-19e5-475a-bf0e-d96d8f13c9e1 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:21:09.140768 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4", "name": "network-vif-plugged", "status": "completed", "tag": "487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:21:09.141009 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-234f0524-19e5-475a-bf0e-d96d8f13c9e1 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:21:09.141388 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5', 'code': 200} Dec 09 21:21:09.275304 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:09.282477 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aef82e5d-962b-40e8-a4a5-7f5ddcfbe23f req-1e965f27-d1c7-45bb-9ff8-e8ce420fa0fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:09.284047 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aef82e5d-962b-40e8-a4a5-7f5ddcfbe23f req-1e965f27-d1c7-45bb-9ff8-e8ce420fa0fc service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4 HTTP/1.1" status: 200 len: 1097 time: 0.0511618 Dec 09 21:21:09.336756 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aef82e5d-962b-40e8-a4a5-7f5ddcfbe23f req-bc28bea6-7ca0-4c83-a8bf-cafdb942fc4f service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=c7a6979c-1873-4716-8479-de619cf4fcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396945 Dec 09 21:21:09.362210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1565fa57-4405-4cb2-8a95-11179fcf78a4 req-b2dae17c-57e4-40e4-a376-6671cc49b61c tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:09.363712 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1565fa57-4405-4cb2-8a95-11179fcf78a4 req-b2dae17c-57e4-40e4-a376-6671cc49b61c tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.0528474 Dec 09 21:21:09.418715 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1565fa57-4405-4cb2-8a95-11179fcf78a4 req-aa7670ff-be0c-4998-b489-8ff18b734be7 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463483 Dec 09 21:21:09.934775 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f8c7a5f-1f81-448f-aff2-29aedfb4c745 req-0fdd8054-1c89-4ce2-9fff-5ab6db7f90d2 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:09.936331 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f8c7a5f-1f81-448f-aff2-29aedfb4c745 req-0fdd8054-1c89-4ce2-9fff-5ab6db7f90d2 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.0514708 Dec 09 21:21:10.014610 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f8c7a5f-1f81-448f-aff2-29aedfb4c745 req-b8b3e341-5101-4c44-9353-1939c5e91126 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0716584 Dec 09 21:21:10.022745 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57e62155-a7b2-45d5-b1b8-53ea0ad25f66 req-609ec623-2941-4de1-b0e8-d9a55b7e9b0e tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:10.024575 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-57e62155-a7b2-45d5-b1b8-53ea0ad25f66 req-609ec623-2941-4de1-b0e8-d9a55b7e9b0e tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 944 time: 0.0751486 Dec 09 21:21:10.076035 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-57e62155-a7b2-45d5-b1b8-53ea0ad25f66 req-ddd0c68c-a051-4823-bb34-7e5e2d431fa3 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450637 Dec 09 21:21:10.218483 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84b59e54-ce81-4384-a4a9-a01c4fefa81b req-5427385e-0725-4cdc-a607-3a5a029514cd tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:10.219901 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84b59e54-ce81-4384-a4a9-a01c4fefa81b req-5427385e-0725-4cdc-a607-3a5a029514cd tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/ports?device_id=ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4 HTTP/1.1" status: 200 len: 945 time: 0.0747204 Dec 09 21:21:10.231325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7323af02-00c1-4d73-9d7a-fb0b958cb934 req-664e19ce-f45c-44c1-b28d-9786c545ee02 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:10.232778 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7323af02-00c1-4d73-9d7a-fb0b958cb934 req-664e19ce-f45c-44c1-b28d-9786c545ee02 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.0771170 Dec 09 21:21:10.302524 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84b59e54-ce81-4384-a4a9-a01c4fefa81b req-a65996dd-ee12-4be0-8150-d2860efa2dfd tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/security-groups?id=c7a6979c-1873-4716-8479-de619cf4fcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0687923 Dec 09 21:21:10.306037 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7323af02-00c1-4d73-9d7a-fb0b958cb934 req-93a9c5be-487f-4948-8576-dae868e35332 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0667737 Dec 09 21:21:10.550483 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ea3dca2-69cf-4fd7-9aaa-d9023afe8144 req-2ed619bf-888e-497b-9869-e5355fd3c084 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:10.551875 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ea3dca2-69cf-4fd7-9aaa-d9023afe8144 req-2ed619bf-888e-497b-9869-e5355fd3c084 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.0548868 Dec 09 21:21:10.602687 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ea3dca2-69cf-4fd7-9aaa-d9023afe8144 req-da43a6c7-a915-4c83-872d-b838ca60be8b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421472 Dec 09 21:21:11.140429 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ecb1f89-b23a-4ee0-a821-08511d844ad9 req-1c0f6409-5b6c-452d-85be-59a3b5b7bed0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:11.141932 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0ecb1f89-b23a-4ee0-a821-08511d844ad9 req-1c0f6409-5b6c-452d-85be-59a3b5b7bed0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.0504992 Dec 09 21:21:11.142716 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8bbb9251-ec6e-45d8-b751-2b2b490cbe3b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e145c03d-6648-46c7-8b51-c9e9acd70ff2'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:21:11.145030 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f4844f8b-38f7-42b5-9867-65100e757f9a" -d '{"events": [{"server_uuid": "8bbb9251-ec6e-45d8-b751-2b2b490cbe3b", "name": "network-vif-plugged", "status": "completed", "tag": "e145c03d-6648-46c7-8b51-c9e9acd70ff2"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:21:11.215174 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0ecb1f89-b23a-4ee0-a821-08511d844ad9 req-649fb095-2501-4ae5-a5f6-760ed5b81f48 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0659530 Dec 09 21:21:11.230385 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-417a35ca-99d1-4c5f-aa97-94b28d5710ff req-14450984-9135-49af-b016-4b91d01d1959 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:11.232106 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-417a35ca-99d1-4c5f-aa97-94b28d5710ff req-14450984-9135-49af-b016-4b91d01d1959 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 944 time: 0.0691411 Dec 09 21:21:11.260558 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:21:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-91f3c829-38fa-42a1-afd1-4fae65fac65c x-openstack-request-id: req-91f3c829-38fa-42a1-afd1-4fae65fac65c {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:21:11.260930 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8bbb9251-ec6e-45d8-b751-2b2b490cbe3b", "name": "network-vif-plugged", "status": "completed", "tag": "e145c03d-6648-46c7-8b51-c9e9acd70ff2", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:21:11.261221 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-91f3c829-38fa-42a1-afd1-4fae65fac65c {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:21:11.261745 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8bbb9251-ec6e-45d8-b751-2b2b490cbe3b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e145c03d-6648-46c7-8b51-c9e9acd70ff2', 'code': 200} Dec 09 21:21:11.289088 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-417a35ca-99d1-4c5f-aa97-94b28d5710ff req-19c00ac4-60f9-46da-a33d-f670ce3708e6 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501022 Dec 09 21:21:11.379088 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6e72019-f974-4f8e-9830-0fca720dc6e0 req-a5d51b44-bec8-42d2-a164-305e8b1887fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:11.381087 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a6e72019-f974-4f8e-9830-0fca720dc6e0 req-a5d51b44-bec8-42d2-a164-305e8b1887fe service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 1102 time: 0.0492053 Dec 09 21:21:11.487745 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a6e72019-f974-4f8e-9830-0fca720dc6e0 req-4627656f-c309-4335-a469-457359008fbd service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0937266 Dec 09 21:21:11.496002 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5a13b12-bc75-45b1-a663-488bc70cd215 req-f9f54a93-3123-40ae-85cf-3a960cceb30c tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:11.497416 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5a13b12-bc75-45b1-a663-488bc70cd215 req-f9f54a93-3123-40ae-85cf-3a960cceb30c tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.1046054 Dec 09 21:21:11.504725 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44bf1f76-7eba-4dc6-9eff-e6b53e7a9814 req-dffa42cf-0268-477a-b16a-518a6df67f2e tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:11.506109 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44bf1f76-7eba-4dc6-9eff-e6b53e7a9814 req-dffa42cf-0268-477a-b16a-518a6df67f2e tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/ports?device_id=ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4 HTTP/1.1" status: 200 len: 945 time: 0.1217542 Dec 09 21:21:11.574847 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5a13b12-bc75-45b1-a663-488bc70cd215 req-16045dc4-7967-4797-b50a-d97e37c4a833 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0677760 Dec 09 21:21:11.582197 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44bf1f76-7eba-4dc6-9eff-e6b53e7a9814 req-75b7b121-c5d3-449d-b9c5-16103d3079e7 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/security-groups?id=c7a6979c-1873-4716-8479-de619cf4fcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0693212 Dec 09 21:21:11.712383 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcbf6dcc-ded8-4ba3-905e-8f620bb0fe5c req-ebb6b4d9-e0b5-499c-a8de-ac9be39203aa tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:11.717737 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fcbf6dcc-ded8-4ba3-905e-8f620bb0fe5c req-ebb6b4d9-e0b5-499c-a8de-ac9be39203aa tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/ports?device_id=ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4 HTTP/1.1" status: 200 len: 945 time: 0.0648391 Dec 09 21:21:11.722591 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59512) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:21:11.727857 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-804fd2a8-2ded-4bc2-93f7-99b9661d1f02 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Request body: {'floatingip': {'port_id': '487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:21:11.787347 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a401d204-eb3b-4319-bada-f87388c0fb0f req-5ef2ea66-a2e6-49cc-ad5d-50215da2d338 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:11.789051 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a401d204-eb3b-4319-bada-f87388c0fb0f req-5ef2ea66-a2e6-49cc-ad5d-50215da2d338 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.0610251 Dec 09 21:21:11.837758 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-804fd2a8-2ded-4bc2-93f7-99b9661d1f02 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks [] for floatingip, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:11.891115 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a401d204-eb3b-4319-bada-f87388c0fb0f req-bb4a1490-e777-4cfd-b597-73b640b4e256 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0871241 Dec 09 21:21:12.413928 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1978b4b2-dd44-4b3c-9613-b572049dad1b req-117504d3-664b-4186-9213-2e746476cebc tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:12.424727 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1978b4b2-dd44-4b3c-9613-b572049dad1b req-117504d3-664b-4186-9213-2e746476cebc tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.0985253 Dec 09 21:21:12.561563 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1978b4b2-dd44-4b3c-9613-b572049dad1b req-90b4ac2a-842e-450c-96db-40e1a11cbd66 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1340587 Dec 09 21:21:12.578194 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c22013b-b2c8-4b68-808d-485e1f54718a req-c8bc2036-35a7-4d25-95bb-69e95be723ad tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:12.580343 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4c22013b-b2c8-4b68-808d-485e1f54718a req-c8bc2036-35a7-4d25-95bb-69e95be723ad tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 944 time: 0.1243100 Dec 09 21:21:12.651856 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4c22013b-b2c8-4b68-808d-485e1f54718a req-d0bf1820-fdf0-43cb-9d1e-eb90ff4bdba6 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0633242 Dec 09 21:21:12.677178 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6d291946-2d01-4e98-9924-23ab0f560c19 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:21:12.918172 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-804fd2a8-2ded-4bc2-93f7-99b9661d1f02 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:12.925527 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-804fd2a8-2ded-4bc2-93f7-99b9661d1f02 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:12.949664 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1146a614-0bf1-4ac1-9612-f98b504138c3 req-4d434e8b-e2b7-4c6a-a8bc-07344f4d284a tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:12.952203 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1146a614-0bf1-4ac1-9612-f98b504138c3 req-4d434e8b-e2b7-4c6a-a8bc-07344f4d284a tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.1706822 Dec 09 21:21:12.969956 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6d291946-2d01-4e98-9924-23ab0f560c19, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6d291946-2d01-4e98-9924-23ab0f560c19,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:13.015277 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '6d291946-2d01-4e98-9924-23ab0f560c19', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '6d291946-2d01-4e98-9924-23ab0f560c19', 'mac_address': 'fa:16:3e:34:e6:eb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.116'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:21:13.101426 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1146a614-0bf1-4ac1-9612-f98b504138c3 req-9b20cd4a-2d6b-408a-82a0-7006ccd1a65e tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1400342 Dec 09 21:21:13.141149 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:13.159519 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 6d291946-2d01-4e98-9924-23ab0f560c19 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:21:13.185588 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6d291946-2d01-4e98-9924-23ab0f560c19, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6d291946-2d01-4e98-9924-23ab0f560c19,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:13.189726 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-804fd2a8-2ded-4bc2-93f7-99b9661d1f02 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Floating IP 757e5c65-9ddd-46bb-9620-1e7a796dd3fa associated. External IP: 172.25.3.113, port: 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5. Dec 09 21:21:13.191949 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:13.239153 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4755b04d-d9ab-4f53-b6d6-b92d477ab525 req-cceb689e-15ee-498e-85c5-1be317f397ff tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:13.244987 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4755b04d-d9ab-4f53-b6d6-b92d477ab525 req-cceb689e-15ee-498e-85c5-1be317f397ff tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.0975192 Dec 09 21:21:13.266055 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=6d291946-2d01-4e98-9924-23ab0f560c19,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:13.318189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['6d291946-2d01-4e98-9924-23ab0f560c19'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:21:13.352258 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4755b04d-d9ab-4f53-b6d6-b92d477ab525 req-c781ace1-bceb-4cd1-ab09-d488407ae332 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1005991 Dec 09 21:21:13.568419 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-804fd2a8-2ded-4bc2-93f7-99b9661d1f02 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Router a54b1faf-ab53-4950-be39-e5e79b3d7ed9 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:21:13.755782 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-804fd2a8-2ded-4bc2-93f7-99b9661d1f02 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:21:13.766634 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-804fd2a8-2ded-4bc2-93f7-99b9661d1f02 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:13.769473 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9dae354-4177-4114-ac0d-8fdafc3079b9 req-26492178-dd7d-44f8-81ae-70c29ce7337e tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:13.772964 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32379cf2-1882-4fb7-a602-4eb3fcf165a7 None None] Sync routers for ids ['a54b1faf-ab53-4950-be39-e5e79b3d7ed9'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:21:13.784149 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9dae354-4177-4114-ac0d-8fdafc3079b9 req-26492178-dd7d-44f8-81ae-70c29ce7337e tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.1137354 Dec 09 21:21:13.788768 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32379cf2-1882-4fb7-a602-4eb3fcf165a7 None None] Routers {'a54b1faf-ab53-4950-be39-e5e79b3d7ed9'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:21:13.789726 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-32379cf2-1882-4fb7-a602-4eb3fcf165a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:21:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a54b1faf-ab53-4950-be39-e5e79b3d7ed9'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:21:13.832033 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-804fd2a8-2ded-4bc2-93f7-99b9661d1f02 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "PUT /v2.0/floatingips/757e5c65-9ddd-46bb-9620-1e7a796dd3fa HTTP/1.1" status: 200 len: 991 time: 2.1082985 Dec 09 21:21:13.832657 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4', 'tag': '487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:21:13.846955 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-887c6ae4-2f4c-4058-b78a-941c0966a566" -d '{"events": [{"name": "network-changed", "server_uuid": "ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4", "tag": "487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:21:13.939848 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-048b80a6-925c-4cac-b5c8-04259425402e service neutron] 10.222.0.10 "GET /v2.0/ports/40468c91-ccde-4d96-b234-0e326a1de103/bindings/n-h1-713301-27 HTTP/1.1" status: 200 len: 385 time: 0.2145696 Dec 09 21:21:14.013481 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-32379cf2-1882-4fb7-a602-4eb3fcf165a7 None None] Set router a54b1faf-ab53-4950-be39-e5e79b3d7ed9 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:21:14.022853 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9dae354-4177-4114-ac0d-8fdafc3079b9 req-fa7534eb-b564-42c7-a2fe-915107d767a6 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2204998 Dec 09 21:21:14.083043 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ab0e583-5366-4284-aa03-61f8bde5575d req-51699cbb-12e1-417a-adda-2f50de032fd8 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:14.086084 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ab0e583-5366-4284-aa03-61f8bde5575d req-51699cbb-12e1-417a-adda-2f50de032fd8 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 944 time: 0.1683846 Dec 09 21:21:14.176159 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:21:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4e86d888-df6d-4892-8312-48de4c08b3bc x-openstack-request-id: req-4e86d888-df6d-4892-8312-48de4c08b3bc {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:21:14.176678 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4", "tag": "487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:21:14.176786 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-4e86d888-df6d-4892-8312-48de4c08b3bc {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:21:14.177105 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4', 'tag': '487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5', 'status': 'completed', 'code': 200} Dec 09 21:21:14.215918 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ab0e583-5366-4284-aa03-61f8bde5575d req-3bc8baf3-ce82-4f37-9d6d-fd6ff4222963 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0752182 Dec 09 21:21:14.341326 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-3df6eaef-9e7f-4673-ad82-61b43d0d1c13 service neutron] For port 40468c91-ccde-4d96-b234-0e326a1de103, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=40468c91-ccde-4d96-b234-0e326a1de103,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:14.345350 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-887c6ae4-2f4c-4058-b78a-941c0966a566 req-81f3547b-bd28-4612-b9b1-20f59ef741d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:14.346888 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-887c6ae4-2f4c-4058-b78a-941c0966a566 req-81f3547b-bd28-4612-b9b1-20f59ef741d5 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=9f7c325888174a43bdb0cea626873b0e&device_id=ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4 HTTP/1.1" status: 200 len: 1097 time: 0.1439202 Dec 09 21:21:14.367917 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-3df6eaef-9e7f-4673-ad82-61b43d0d1c13 service neutron] For port 40468c91-ccde-4d96-b234-0e326a1de103, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:21:14.396242 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-32379cf2-1882-4fb7-a602-4eb3fcf165a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'name': 'tempest-ServersTestJSON-799420296-router', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66'}], 'enable_snat': True}, 'gw_port_id': '3d871078-9873-42c7-9428-2cbedc035380', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:20:39Z', 'updated_at': '2021-12-09T21:20:50Z', 'revision_number': 4, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'gw_port': {'id': '3d871078-9873-42c7-9428-2cbedc035380', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:25:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 595, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:42Z', 'updated_at': '2021-12-09T21:20:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '757e5c65-9ddd-46bb-9620-1e7a796dd3fa', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'floating_ip_address': '172.25.3.113', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'port_id': '487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 609, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2', 'mac_address': 'fa:16:3e:f2:32:b4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:20:54Z', 'updated_at': '2021-12-09T21:21:12Z', 'revision_number': 1, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aada448e-8a62-400c-91ba-1ae577560497', 'name': '', 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'mac_address': 'fa:16:3e:0f:c5:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'device_owner': 'network:router_interface', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '006a974f-ca2f-40a9-b5ee-25ae5235c5b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:49Z', 'updated_at': '2021-12-09T21:20:56Z', 'revision_number': 5, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'subnets': [{'id': '006a974f-ca2f-40a9-b5ee-25ae5235c5b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:21:14.455647 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32379cf2-1882-4fb7-a602-4eb3fcf165a7 None None] Checking router: a54b1faf-ab53-4950-be39-e5e79b3d7ed9 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:21:14.465130 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-3df6eaef-9e7f-4673-ad82-61b43d0d1c13 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 40468c91-ccde-4d96-b234-0e326a1de103 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:21:14.473785 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32379cf2-1882-4fb7-a602-4eb3fcf165a7 None None] Routers {'a54b1faf-ab53-4950-be39-e5e79b3d7ed9'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:21:14.474090 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-32379cf2-1882-4fb7-a602-4eb3fcf165a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:21:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a54b1faf-ab53-4950-be39-e5e79b3d7ed9'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:21:14.489447 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-887c6ae4-2f4c-4058-b78a-941c0966a566 req-7b2233ba-cec3-4a63-ae5f-3f07f4d36c54 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:14.494341 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-887c6ae4-2f4c-4058-b78a-941c0966a566 req-7b2233ba-cec3-4a63-ae5f-3f07f4d36c54 service neutron] 10.222.0.31 "GET /v2.0/networks?id=0a4691ff-8eab-4fe6-bec4-b1a20a69fce2 HTTP/1.1" status: 200 len: 906 time: 0.1326771 Dec 09 21:21:14.502531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-3df6eaef-9e7f-4673-ad82-61b43d0d1c13 service neutron] For port 40468c91-ccde-4d96-b234-0e326a1de103, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=40468c91-ccde-4d96-b234-0e326a1de103,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:14.524849 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ad18094-7650-435b-9f6e-2100762c9b5f req-5bc4f971-8ac7-4a9d-a34b-aaa004c32b48 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:14.532381 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3ad18094-7650-435b-9f6e-2100762c9b5f req-5bc4f971-8ac7-4a9d-a34b-aaa004c32b48 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.1273916 Dec 09 21:21:14.574009 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df20f7d2-870f-4c63-bdae-0e55aec1f562 req-aa6aa036-eb77-4cb1-8c6f-d35b79abf039 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:14.581767 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df20f7d2-870f-4c63-bdae-0e55aec1f562 req-aa6aa036-eb77-4cb1-8c6f-d35b79abf039 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.1415772 Dec 09 21:21:14.592788 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-3df6eaef-9e7f-4673-ad82-61b43d0d1c13 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:14.616543 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-887c6ae4-2f4c-4058-b78a-941c0966a566 req-ce9cb0dd-05f3-4898-80ad-ac7525c2cb43 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 HTTP/1.1" status: 200 len: 999 time: 0.1128139 Dec 09 21:21:14.631244 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-32379cf2-1882-4fb7-a602-4eb3fcf165a7 None None] Set router a54b1faf-ab53-4950-be39-e5e79b3d7ed9 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:21:14.657543 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3ad18094-7650-435b-9f6e-2100762c9b5f req-64b2bde7-ce55-4e0d-861e-a630cf7be479 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1242645 Dec 09 21:21:14.665473 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 40468c91-ccde-4d96-b234-0e326a1de103 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:21:14.701401 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6d291946-2d01-4e98-9924-23ab0f560c19 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:21:14.737088 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-887c6ae4-2f4c-4058-b78a-941c0966a566 req-994f6cdb-42ca-4d48-bd8f-e8223a6e51a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:14.738903 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-887c6ae4-2f4c-4058-b78a-941c0966a566 req-994f6cdb-42ca-4d48-bd8f-e8223a6e51a8 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=006a974f-ca2f-40a9-b5ee-25ae5235c5b1 HTTP/1.1" status: 200 len: 844 time: 0.1120555 Dec 09 21:21:14.785728 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-3df6eaef-9e7f-4673-ad82-61b43d0d1c13 service neutron] Transition to ACTIVE for port object 40468c91-ccde-4d96-b234-0e326a1de103 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:21:14.823341 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-3df6eaef-9e7f-4673-ad82-61b43d0d1c13 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:14.827774 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-887c6ae4-2f4c-4058-b78a-941c0966a566 req-1783cbd8-fc1b-4e81-9d21-9569bc29d2c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:14.830047 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-887c6ae4-2f4c-4058-b78a-941c0966a566 req-1783cbd8-fc1b-4e81-9d21-9569bc29d2c2 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=0a4691ff-8eab-4fe6-bec4-b1a20a69fce2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0760317 Dec 09 21:21:14.840112 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 40468c91-ccde-4d96-b234-0e326a1de103 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:21:14.879791 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 6d291946-2d01-4e98-9924-23ab0f560c19 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:21:14.880233 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:14.939939 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-887c6ae4-2f4c-4058-b78a-941c0966a566 req-dbce7063-7154-4fe0-8c54-5afe26017465 service neutron] 10.222.0.31 "GET /v2.0/networks/0a4691ff-8eab-4fe6-bec4-b1a20a69fce2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1021495 Dec 09 21:21:14.989791 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3df6eaef-9e7f-4673-ad82-61b43d0d1c13 service neutron] Pushing event updated for resources: {'Port': ['ID=40468c91-ccde-4d96-b234-0e326a1de103,revision_number=10']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:15.055772 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:15.069653 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-887c6ae4-2f4c-4058-b78a-941c0966a566 req-56669709-ae96-4e10-bd5b-44808b67ce7e service neutron] 10.222.0.31 "GET /v2.0/networks/0a4691ff-8eab-4fe6-bec4-b1a20a69fce2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1213458 Dec 09 21:21:15.098426 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-3df6eaef-9e7f-4673-ad82-61b43d0d1c13 service neutron] No DVR routers for this DVR port 40468c91-ccde-4d96-b234-0e326a1de103 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:21:15.118168 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2518268-c7aa-4916-ac20-1ce0f923f963 req-69f28040-ec36-40e0-b061-1ea9ef45e4b8 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:15.120140 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f2518268-c7aa-4916-ac20-1ce0f923f963 req-69f28040-ec36-40e0-b061-1ea9ef45e4b8 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.3244102 Dec 09 21:21:15.139371 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df20f7d2-870f-4c63-bdae-0e55aec1f562 req-b4b43be4-9906-4ddf-b1cc-f104fe190345 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5532134 Dec 09 21:21:15.220736 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-3df6eaef-9e7f-4673-ad82-61b43d0d1c13 service neutron] 10.222.0.10 "PUT /v2.0/ports/40468c91-ccde-4d96-b234-0e326a1de103/bindings/n-h1-713301-27/activate HTTP/1.1" status: 200 len: 370 time: 1.2594888 Dec 09 21:21:15.304147 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f2518268-c7aa-4916-ac20-1ce0f923f963 req-a72a4b18-86f1-4481-a699-953733d49299 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1623635 Dec 09 21:21:15.350213 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f557bb48-79b5-4aa9-b1e7-72fc54f16eff', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6d291946-2d01-4e98-9924-23ab0f560c19'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:21:15.352100 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4b1b74af-0a8f-436d-a4a4-33d8c7c2cb91" -d '{"events": [{"server_uuid": "f557bb48-79b5-4aa9-b1e7-72fc54f16eff", "name": "network-vif-plugged", "status": "completed", "tag": "6d291946-2d01-4e98-9924-23ab0f560c19"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:21:15.376985 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6d291946-2d01-4e98-9924-23ab0f560c19, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6d291946-2d01-4e98-9924-23ab0f560c19,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:15.393391 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:15.409672 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-32379cf2-1882-4fb7-a602-4eb3fcf165a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'name': 'tempest-ServersTestJSON-799420296-router', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66'}], 'enable_snat': True}, 'gw_port_id': '3d871078-9873-42c7-9428-2cbedc035380', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:20:39Z', 'updated_at': '2021-12-09T21:20:50Z', 'revision_number': 4, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'gw_port': {'id': '3d871078-9873-42c7-9428-2cbedc035380', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:25:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 595, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:42Z', 'updated_at': '2021-12-09T21:20:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '757e5c65-9ddd-46bb-9620-1e7a796dd3fa', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'floating_ip_address': '172.25.3.113', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'port_id': '487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 609, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2', 'mac_address': 'fa:16:3e:f2:32:b4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:20:54Z', 'updated_at': '2021-12-09T21:21:12Z', 'revision_number': 1, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aada448e-8a62-400c-91ba-1ae577560497', 'name': '', 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'mac_address': 'fa:16:3e:0f:c5:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'device_owner': 'network:router_interface', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '006a974f-ca2f-40a9-b5ee-25ae5235c5b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:49Z', 'updated_at': '2021-12-09T21:20:56Z', 'revision_number': 5, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'subnets': [{'id': '006a974f-ca2f-40a9-b5ee-25ae5235c5b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:21:15.436308 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-18239ff7-b7b4-48e3-9828-8cac8084c07b tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:15.440172 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32379cf2-1882-4fb7-a602-4eb3fcf165a7 None None] The sync data for ids ['a54b1faf-ab53-4950-be39-e5e79b3d7ed9'] in n-d-713301-27 is: [{'id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'name': 'tempest-ServersTestJSON-799420296-router', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66'}], 'enable_snat': True}, 'gw_port_id': '3d871078-9873-42c7-9428-2cbedc035380', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:20:39Z', 'updated_at': '2021-12-09T21:20:50Z', 'revision_number': 4, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'gw_port': {'id': '3d871078-9873-42c7-9428-2cbedc035380', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:25:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 595, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:42Z', 'updated_at': '2021-12-09T21:20:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '757e5c65-9ddd-46bb-9620-1e7a796dd3fa', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'floating_ip_address': '172.25.3.113', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'port_id': '487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 609, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2', 'mac_address': 'fa:16:3e:f2:32:b4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:20:54Z', 'updated_at': '2021-12-09T21:21:12Z', 'revision_number': 1, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aada448e-8a62-400c-91ba-1ae577560497', 'name': '', 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'mac_address': 'fa:16:3e:0f:c5:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'device_owner': 'network:router_interface', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '006a974f-ca2f-40a9-b5ee-25ae5235c5b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:49Z', 'updated_at': '2021-12-09T21:20:56Z', 'revision_number': 5, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'subnets': [{'id': '006a974f-ca2f-40a9-b5ee-25ae5235c5b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:21:15.440417 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-18239ff7-b7b4-48e3-9828-8cac8084c07b tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56&tenant_id=a306d2242b1e41c892f63c7b122cdee4&binding%3Ahost_id=n-h2-713301-27 HTTP/1.1" status: 200 len: 1097 time: 0.1476793 Dec 09 21:21:15.547869 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=6d291946-2d01-4e98-9924-23ab0f560c19,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:15.550073 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-202d7577-3a89-49a0-82c6-20f954831d2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:15.551777 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-202d7577-3a89-49a0-82c6-20f954831d2a service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56&tenant_id=a306d2242b1e41c892f63c7b122cdee4 HTTP/1.1" status: 200 len: 1097 time: 0.0997255 Dec 09 21:21:15.617405 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72ccf0cc-f5f1-4893-95cd-720c7f8340cb req-7356bab7-0207-4d80-b919-b63e83fa82b0 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:15.628802 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72ccf0cc-f5f1-4893-95cd-720c7f8340cb req-7356bab7-0207-4d80-b919-b63e83fa82b0 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 945 time: 0.1389956 Dec 09 21:21:15.644425 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:21:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-28c8c728-a1e7-43ee-85c3-40278cf96674 x-openstack-request-id: req-28c8c728-a1e7-43ee-85c3-40278cf96674 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:21:15.645098 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f557bb48-79b5-4aa9-b1e7-72fc54f16eff", "name": "network-vif-plugged", "status": "completed", "tag": "6d291946-2d01-4e98-9924-23ab0f560c19", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:21:15.645563 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-28c8c728-a1e7-43ee-85c3-40278cf96674 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:21:15.646151 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f557bb48-79b5-4aa9-b1e7-72fc54f16eff', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6d291946-2d01-4e98-9924-23ab0f560c19', 'code': 200} Dec 09 21:21:15.646461 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-343c0122-d6c9-406b-be0c-86ebdba4ee67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:15.648020 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-343c0122-d6c9-406b-be0c-86ebdba4ee67 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 1097 time: 0.0704451 Dec 09 21:21:15.730301 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72ccf0cc-f5f1-4893-95cd-720c7f8340cb req-84e60e28-fd47-40ad-bf93-7b9a910052e4 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0991426 Dec 09 21:21:15.809595 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-18cf7d2b-9651-464a-b8ae-5cff8ddba2ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:15.811112 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-18cf7d2b-9651-464a-b8ae-5cff8ddba2ea service neutron] 10.222.0.31 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 922 time: 0.1468911 Dec 09 21:21:15.813390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-822d94fc-ace0-4687-8553-dbe9a899fe36 req-92ca9f4c-8f3b-4cf3-9c11-e35e6b5526d0 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:21:15.814554 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-822d94fc-ace0-4687-8553-dbe9a899fe36 req-92ca9f4c-8f3b-4cf3-9c11-e35e6b5526d0 service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0072496 Dec 09 21:21:15.827972 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa746c22-accd-49a3-bc4c-526029a95820 None None] New status for floating IP 757e5c65-9ddd-46bb-9620-1e7a796dd3fa: ACTIVE {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:21:15.892664 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-38e20d6f-a7e8-423b-91d0-9030b5505ab4 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=40468c91-ccde-4d96-b234-0e326a1de103 HTTP/1.1" status: 200 len: 217 time: 0.0675323 Dec 09 21:21:15.982573 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-cb87f8fb-dc9e-4e33-89b7-aead7fdce413 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:15.984125 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-cb87f8fb-dc9e-4e33-89b7-aead7fdce413 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=c49a62cc-af1b-4958-a4a9-eb44188b8fb9 HTTP/1.1" status: 200 len: 861 time: 0.0839441 Dec 09 21:21:15.989407 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a94d6a75-ecbe-4562-9009-77c8713c53f1 req-72099c2b-e77b-4b83-944d-44d28af96a57 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:15.998003 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a94d6a75-ecbe-4562-9009-77c8713c53f1 req-72099c2b-e77b-4b83-944d-44d28af96a57 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.1065605 Dec 09 21:21:16.052354 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-53483f89-9304-45a6-be42-9c7da692efe2 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=93378dc3-2ac5-4cf7-9ce3-d812934de40c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0535803 Dec 09 21:21:16.151947 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a94d6a75-ecbe-4562-9009-77c8713c53f1 req-b9f05fce-27c9-43e8-a50b-f9d190acfda5 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1409009 Dec 09 21:21:16.312945 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-b3b515eb-5a4c-475a-a91d-c5d4e24aa992 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0977473 Dec 09 21:21:16.330685 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-ccc3aeee-e7a6-4f53-85d1-70d32f8743d4 service neutron] 10.222.0.31 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2664497 Dec 09 21:21:16.335211 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5359b26e-5761-4f54-bc6b-a618251779cb req-18b658a9-39dc-4370-ab97-abdae3e92ef5 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:16.348020 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5359b26e-5761-4f54-bc6b-a618251779cb req-18b658a9-39dc-4370-ab97-abdae3e92ef5 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.0996234 Dec 09 21:21:16.435760 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5359b26e-5761-4f54-bc6b-a618251779cb req-3959a473-6334-4846-b28f-bd8d224b9b3c tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0862970 Dec 09 21:21:16.502593 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-d0cec087-5e50-49f6-96cc-021201f34195 service neutron] 10.222.0.31 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1617553 Dec 09 21:21:16.581255 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce948345-d47c-4e86-b6d8-8392c31a9977 req-3933035c-6bf2-463c-ad02-f09cc01e3602 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:16.608479 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ce948345-d47c-4e86-b6d8-8392c31a9977 req-3933035c-6bf2-463c-ad02-f09cc01e3602 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.1119621 Dec 09 21:21:16.736879 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ce948345-d47c-4e86-b6d8-8392c31a9977 req-d41d2bae-e08b-428f-9efd-6070cf65619c tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1231644 Dec 09 21:21:16.920974 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-52b3e30a-db94-4bc9-a29d-2be719bdaf54 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:16.923267 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-52b3e30a-db94-4bc9-a29d-2be719bdaf54 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56&tenant_id=a306d2242b1e41c892f63c7b122cdee4&binding%3Ahost_id=n-h1-713301-27 HTTP/1.1" status: 200 len: 1097 time: 0.0651851 Dec 09 21:21:16.985806 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08fa49d6-12ce-4f94-bd0d-7de54eda2110 req-5968e562-25f6-4efc-ab74-f6fb93a21cae tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:16.993892 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-08fa49d6-12ce-4f94-bd0d-7de54eda2110 req-5968e562-25f6-4efc-ab74-f6fb93a21cae tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 945 time: 0.0976250 Dec 09 21:21:17.083771 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-08fa49d6-12ce-4f94-bd0d-7de54eda2110 req-7456a7dd-d212-413a-b859-e1c36fcdc712 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0888429 Dec 09 21:21:17.089300 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-a2c339bd-0754-48c0-b0c1-06c0449faea7 service neutron] For port 40468c91-ccde-4d96-b234-0e326a1de103, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:21:17.092713 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-a2c339bd-0754-48c0-b0c1-06c0449faea7 service neutron] Publish callbacks [] for binding, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:17.093892 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b332bfab-03f1-45c9-b7e6-f993b5e93098 req-a2c339bd-0754-48c0-b0c1-06c0449faea7 service neutron] 10.222.0.31 "DELETE /v2.0/ports/40468c91-ccde-4d96-b234-0e326a1de103/bindings/n-h2-713301-27 HTTP/1.1" status: 204 len: 173 time: 0.1627812 Dec 09 21:21:17.297017 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fa6da76-e381-452c-aa8d-b21bc3cfeffb req-ef172f6b-861f-448d-980e-f3bc108b873d tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:17.312937 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8fa6da76-e381-452c-aa8d-b21bc3cfeffb req-ef172f6b-861f-448d-980e-f3bc108b873d tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.0862498 Dec 09 21:21:17.382139 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8fa6da76-e381-452c-aa8d-b21bc3cfeffb req-3eb8db01-c2ce-4c7d-a30f-0b9062aeb8a6 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0681539 Dec 09 21:21:17.638116 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f3de3c2-7bef-4c78-b756-1520bf2ad963 req-3c48555d-2b5d-40f7-aacb-229b55c4db69 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:17.640368 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f3de3c2-7bef-4c78-b756-1520bf2ad963 req-3c48555d-2b5d-40f7-aacb-229b55c4db69 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.1009724 Dec 09 21:21:17.714482 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f3de3c2-7bef-4c78-b756-1520bf2ad963 req-63bdf8af-9447-49c5-b32e-d5bbd11c09ec tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0620191 Dec 09 21:21:17.893226 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaac2d9a-74e4-41c5-96aa-b22fb61f2508 req-b958d15c-9a66-484b-8f25-909e99592e07 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:17.893226 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eaac2d9a-74e4-41c5-96aa-b22fb61f2508 req-b958d15c-9a66-484b-8f25-909e99592e07 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.0745018 Dec 09 21:21:17.971656 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eaac2d9a-74e4-41c5-96aa-b22fb61f2508 req-0a4da0d1-6d1b-4c82-970f-5eb3c4fd1e75 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0724781 Dec 09 21:21:18.281482 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ac3dea5-f45b-4164-8784-fd3bfe9c927f req-ced69a25-1e04-4a98-b70e-b141280e2c77 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:18.294638 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1ac3dea5-f45b-4164-8784-fd3bfe9c927f req-ced69a25-1e04-4a98-b70e-b141280e2c77 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 945 time: 0.1013482 Dec 09 21:21:18.357193 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1ac3dea5-f45b-4164-8784-fd3bfe9c927f req-75cdec28-c5db-4b87-a30b-a8ac1fca39e7 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0600591 Dec 09 21:21:18.516057 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-417fb274-daa2-425e-8a32-1aaa6d687b44 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:18.519574 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-417fb274-daa2-425e-8a32-1aaa6d687b44 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 1097 time: 0.0769367 Dec 09 21:21:18.647374 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b22e244-e2a4-408b-864f-dd2b90755fa5 req-443709f7-767c-4123-b246-f70b71110d9c tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:18.647374 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b22e244-e2a4-408b-864f-dd2b90755fa5 req-443709f7-767c-4123-b246-f70b71110d9c tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.1060483 Dec 09 21:21:18.674118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49e4c838-c082-4cf0-9bfa-4f43c886a7d8 req-1596b956-372c-4253-a729-ba91f99cb1c8 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:18.675767 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-49e4c838-c082-4cf0-9bfa-4f43c886a7d8 req-1596b956-372c-4253-a729-ba91f99cb1c8 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 1097 time: 0.1174006 Dec 09 21:21:18.693356 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-22ed6664-f1eb-4044-9ec7-47eb23206b6d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:18.695001 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-22ed6664-f1eb-4044-9ec7-47eb23206b6d service neutron] 10.222.0.31 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 908 time: 0.1676061 Dec 09 21:21:18.748065 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-43c43f77-9239-476c-b5ce-7112f014b936 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=6166c639-9f87-4254-af88-12c4be868be5 HTTP/1.1" status: 200 len: 217 time: 0.0453925 Dec 09 21:21:18.813590 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b22e244-e2a4-408b-864f-dd2b90755fa5 req-2706be0f-740f-4720-8226-feca63d8983a tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1487346 Dec 09 21:21:18.837134 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-c40fef48-90b6-4405-9a87-5220c3b28c83 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:18.839353 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-c40fef48-90b6-4405-9a87-5220c3b28c83 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=eae2438b-9fcc-44ef-a172-6c4911cad13f HTTP/1.1" status: 200 len: 847 time: 0.0842445 Dec 09 21:21:18.879747 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-2516db11-b3b2-4160-94bd-1ec04ad9b0ca service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=04fa749a-9f72-4a2c-a725-feab917f99ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0311949 Dec 09 21:21:18.900910 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-49e4c838-c082-4cf0-9bfa-4f43c886a7d8 req-7b1e1b10-9cf1-408d-a014-984a8ad98969 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1906993 Dec 09 21:21:18.908472 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-3f986112-d20f-44d9-b4cc-18a1099dec72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:18.910063 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-3f986112-d20f-44d9-b4cc-18a1099dec72 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 1102 time: 0.1768734 Dec 09 21:21:19.108537 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-793e8d61-d632-4bcb-9d18-3b521decc012 service neutron] 10.222.0.31 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2166319 Dec 09 21:21:19.145015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0abbbee2-02fc-4c41-a60f-a93e4e198073 req-6bed99e6-8482-4861-a1b4-bc1041002716 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:19.153442 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0abbbee2-02fc-4c41-a60f-a93e4e198073 req-6bed99e6-8482-4861-a1b4-bc1041002716 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.0974305 Dec 09 21:21:19.169322 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-dffac550-4fdb-4134-84de-9b04bd050ac1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:19.171250 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-dffac550-4fdb-4134-84de-9b04bd050ac1 service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.2471011 Dec 09 21:21:19.263163 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-d5e4ae7f-0149-47ae-8c5c-b22ece36687f service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.184&port_id=e145c03d-6648-46c7-8b51-c9e9acd70ff2 HTTP/1.1" status: 200 len: 217 time: 0.0760393 Dec 09 21:21:19.287011 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-bcbf3191-2c00-40f6-aa84-d00a2e415248 service neutron] 10.222.0.31 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1679962 Dec 09 21:21:19.307692 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0abbbee2-02fc-4c41-a60f-a93e4e198073 req-359f359a-9ec0-4514-935a-2a941f27ae4e tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1528838 Dec 09 21:21:19.368823 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f0a17d-3e7b-4ea5-a864-6cee501e02a6 req-a9905e8a-cfee-40f0-95bc-eb4580debad4 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:19.376409 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52f0a17d-3e7b-4ea5-a864-6cee501e02a6 req-a9905e8a-cfee-40f0-95bc-eb4580debad4 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 1097 time: 0.1798644 Dec 09 21:21:19.468561 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52f0a17d-3e7b-4ea5-a864-6cee501e02a6 req-dc4421f9-3dfa-4aca-a3bf-d1a31540dc8c tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0864935 Dec 09 21:21:19.470204 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-d05f9a4a-8a6f-4879-9ffd-80d3ff710019 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:19.471692 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-d05f9a4a-8a6f-4879-9ffd-80d3ff710019 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1925812 Dec 09 21:21:19.539758 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0201feaa-1eba-417c-89ea-368b95ade4e2 req-900c238c-0dab-485f-91f1-4e57f94282bd tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:19.541619 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0201feaa-1eba-417c-89ea-368b95ade4e2 req-900c238c-0dab-485f-91f1-4e57f94282bd tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.1567590 Dec 09 21:21:19.584187 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-b72656ca-0d56-4872-bcbe-3571153b9c62 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:19.585688 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-b72656ca-0d56-4872-bcbe-3571153b9c62 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0878198 Dec 09 21:21:19.673204 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0201feaa-1eba-417c-89ea-368b95ade4e2 req-604ad7ef-6a48-4a97-b4ad-5c1f96bae93b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1240535 Dec 09 21:21:19.740463 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-0737b2b2-a766-44fe-b4b4-73d6109e2ed6 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1424282 Dec 09 21:21:19.868408 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-37785605-8060-492c-9cfb-7c667870d8ff service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1119874 Dec 09 21:21:20.026854 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a0b15fd-fee7-43c6-a64b-f7e0669a0893 req-2fb4b0cd-45da-41d6-825f-9cc7563a74fa tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:20.036116 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a0b15fd-fee7-43c6-a64b-f7e0669a0893 req-2fb4b0cd-45da-41d6-825f-9cc7563a74fa tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.1507852 Dec 09 21:21:20.147994 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a0b15fd-fee7-43c6-a64b-f7e0669a0893 req-d30928fc-2bea-4738-876a-4e2390c78b1a tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1107476 Dec 09 21:21:20.444412 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f6e788e-2087-4139-b75b-4c443bd2f002 req-3434a962-97a2-4493-91ef-e79aaa0a9ed1 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:20.452138 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f6e788e-2087-4139-b75b-4c443bd2f002 req-3434a962-97a2-4493-91ef-e79aaa0a9ed1 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.0634024 Dec 09 21:21:20.510529 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f6e788e-2087-4139-b75b-4c443bd2f002 req-2ab72a9f-b2e3-46eb-a62e-dd22dfd99050 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0574212 Dec 09 21:21:20.791293 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-222f6ecc-08ae-4fec-ad4a-8d295701a9dc req-f3628400-f948-40d1-bff3-39477708d9ad tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:20.799258 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-222f6ecc-08ae-4fec-ad4a-8d295701a9dc req-f3628400-f948-40d1-bff3-39477708d9ad tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.0679841 Dec 09 21:21:20.850946 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-222f6ecc-08ae-4fec-ad4a-8d295701a9dc req-3451e6f2-35f5-45fd-8b7a-398644b556aa tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0507603 Dec 09 21:21:21.326186 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bef9749b-fa16-47ae-b910-bda0693db5d0 req-168a7578-a013-4086-93b2-593b77ea669a tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:21.328650 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bef9749b-fa16-47ae-b910-bda0693db5d0 req-168a7578-a013-4086-93b2-593b77ea669a tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.0577440 Dec 09 21:21:21.439961 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bef9749b-fa16-47ae-b910-bda0693db5d0 req-9a72134c-6dd7-40b5-9de8-dd3ecc2c97f7 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1026509 Dec 09 21:21:21.716400 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ebf2d95-54de-4476-8209-97a4ce6cb923 req-c6f18077-c7a6-4906-babc-916227649491 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:21.720271 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ebf2d95-54de-4476-8209-97a4ce6cb923 req-c6f18077-c7a6-4906-babc-916227649491 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.0965493 Dec 09 21:21:21.794867 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ebf2d95-54de-4476-8209-97a4ce6cb923 req-b0dcec45-cb8c-46c1-aa10-062e92214757 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0559232 Dec 09 21:21:22.087965 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3ecf747-2f3e-4005-af86-ef3f9a1f2cf0 req-97139b52-0e96-4fdf-98f0-4e40493819dc tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:22.097923 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3ecf747-2f3e-4005-af86-ef3f9a1f2cf0 req-97139b52-0e96-4fdf-98f0-4e40493819dc tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.0771453 Dec 09 21:21:22.157420 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3ecf747-2f3e-4005-af86-ef3f9a1f2cf0 req-405eab22-d96d-4c4a-8c31-a3b2824308eb tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0576267 Dec 09 21:21:22.226813 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c7a20c8-504c-4e83-9e2d-309c8b01066e req-fcd87149-6f94-4e37-895c-e2f46c2efb24 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:22.228385 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7c7a20c8-504c-4e83-9e2d-309c8b01066e req-fcd87149-6f94-4e37-895c-e2f46c2efb24 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/ports?device_id=a007b30a-1cc1-4d65-b263-1bd9d1a84b3b HTTP/1.1" status: 200 len: 946 time: 0.0629444 Dec 09 21:21:22.324754 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7c7a20c8-504c-4e83-9e2d-309c8b01066e req-32894649-90f3-4754-aeb2-74abb958a85e tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/security-groups?id=dea88e67-805c-4990-af94-aeeaf2d8e160&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0856922 Dec 09 21:21:22.602476 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-285518b0-303b-428b-aa11-212f7277eed3 req-80f27b97-07c7-474f-bdcf-fd8689d7a952 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:22.604237 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-285518b0-303b-428b-aa11-212f7277eed3 req-80f27b97-07c7-474f-bdcf-fd8689d7a952 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.0589199 Dec 09 21:21:22.678882 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-285518b0-303b-428b-aa11-212f7277eed3 req-73cf0e24-256e-4195-8164-858e543859f1 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0642071 Dec 09 21:21:22.921450 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-accc1fd9-6e39-460f-ba7f-1ac5c039d2f8 req-a93d0bf9-a26d-40be-89d3-2465960f0a34 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:22.923268 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-accc1fd9-6e39-460f-ba7f-1ac5c039d2f8 req-a93d0bf9-a26d-40be-89d3-2465960f0a34 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.0574570 Dec 09 21:21:23.011002 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-accc1fd9-6e39-460f-ba7f-1ac5c039d2f8 req-17a49f1a-ba3a-4bb9-b23c-aac53cd0f709 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0806255 Dec 09 21:21:23.346934 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d2e53aa-27e5-4f92-960b-c67c2e26ced9 req-2a4a3c09-f39b-4c6f-9bd4-91c26d7397c6 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:23.354049 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d2e53aa-27e5-4f92-960b-c67c2e26ced9 req-2a4a3c09-f39b-4c6f-9bd4-91c26d7397c6 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.0909433 Dec 09 21:21:23.426402 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d2e53aa-27e5-4f92-960b-c67c2e26ced9 req-28f5bd3e-5a7b-4bde-8b4a-1a6e43142bae tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0695183 Dec 09 21:21:23.560397 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8168c28a-8307-4844-92b8-a5536e15105f req-9aafe057-cc62-432c-9eb5-634b70ba96f8 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:23.561859 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8168c28a-8307-4844-92b8-a5536e15105f req-9aafe057-cc62-432c-9eb5-634b70ba96f8 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/ports?device_id=a007b30a-1cc1-4d65-b263-1bd9d1a84b3b HTTP/1.1" status: 200 len: 946 time: 0.0633571 Dec 09 21:21:23.642602 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8168c28a-8307-4844-92b8-a5536e15105f req-7eb59893-167a-49c4-aa27-ce026817ba4b tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/security-groups?id=dea88e67-805c-4990-af94-aeeaf2d8e160&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0730820 Dec 09 21:21:23.838009 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cd7adc-6ac0-454d-9b2b-d2505985784f req-4486f2bb-1ba9-45ab-a8f8-11cf80fdd2c9 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:23.840003 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-14cd7adc-6ac0-454d-9b2b-d2505985784f req-4486f2bb-1ba9-45ab-a8f8-11cf80fdd2c9 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.0791540 Dec 09 21:21:23.893733 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-14cd7adc-6ac0-454d-9b2b-d2505985784f req-b3f16506-8b94-4a2e-8fe5-5fa4be2826f5 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471163 Dec 09 21:21:24.004970 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bc19c07-7567-451f-af3e-bd7112b9d601 req-15af20ef-ba7e-4435-87a5-1df88a777b6e tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:24.007560 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4bc19c07-7567-451f-af3e-bd7112b9d601 req-15af20ef-ba7e-4435-87a5-1df88a777b6e tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.10 "GET /v2.0/ports?device_id=a007b30a-1cc1-4d65-b263-1bd9d1a84b3b HTTP/1.1" status: 200 len: 946 time: 0.0670404 Dec 09 21:21:24.199844 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-4bc19c07-7567-451f-af3e-bd7112b9d601 req-3bc286b1-51f0-47df-be25-1c1d8546d147 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Deleting port 3eba2279-4b83-4ab6-bde7-0305ee1eda1f {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:21:24.200279 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4bc19c07-7567-451f-af3e-bd7112b9d601 req-3bc286b1-51f0-47df-be25-1c1d8546d147 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:24.242964 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96356cbe-c02a-4d10-ace0-ed8bac164465 req-b9ef2dd2-921c-4be7-9990-55ff5cf77a26 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:24.244601 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96356cbe-c02a-4d10-ace0-ed8bac164465 req-b9ef2dd2-921c-4be7-9990-55ff5cf77a26 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.1130950 Dec 09 21:21:24.329325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4bc19c07-7567-451f-af3e-bd7112b9d601 req-3bc286b1-51f0-47df-be25-1c1d8546d147 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] For port 3eba2279-4b83-4ab6-bde7-0305ee1eda1f, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3eba2279-4b83-4ab6-bde7-0305ee1eda1f,segment=NetworkSegment(5c779566-9ab2-470d-8b5d-c18c1d216fd1),segment_id=5c779566-9ab2-470d-8b5d-c18c1d216fd1)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:24.329563 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4bc19c07-7567-451f-af3e-bd7112b9d601 req-3bc286b1-51f0-47df-be25-1c1d8546d147 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:24.363540 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-4bc19c07-7567-451f-af3e-bd7112b9d601 req-3bc286b1-51f0-47df-be25-1c1d8546d147 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Calling delete_port for 3eba2279-4b83-4ab6-bde7-0305ee1eda1f owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:21:24.488385 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96356cbe-c02a-4d10-ace0-ed8bac164465 req-92b87b9f-249f-48b4-acb6-06718d54db4a tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1614578 Dec 09 21:21:24.614839 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4bc19c07-7567-451f-af3e-bd7112b9d601 req-3bc286b1-51f0-47df-be25-1c1d8546d147 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:24.628793 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['3eba2279-4b83-4ab6-bde7-0305ee1eda1f'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:21:24.693993 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bc286b1-51f0-47df-be25-1c1d8546d147 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Pushing event deleted for resources: {'Port': ['ID=3eba2279-4b83-4ab6-bde7-0305ee1eda1f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:25.055197 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bc286b1-51f0-47df-be25-1c1d8546d147 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:25.055982 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bc286b1-51f0-47df-be25-1c1d8546d147 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:25.055982 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bc286b1-51f0-47df-be25-1c1d8546d147 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:25.056286 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bc286b1-51f0-47df-be25-1c1d8546d147 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:25.056510 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bc286b1-51f0-47df-be25-1c1d8546d147 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:25.056819 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bc286b1-51f0-47df-be25-1c1d8546d147 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:25.057258 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bc286b1-51f0-47df-be25-1c1d8546d147 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:25.059721 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bc286b1-51f0-47df-be25-1c1d8546d147 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:25.060419 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bc286b1-51f0-47df-be25-1c1d8546d147 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:25.060850 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bc286b1-51f0-47df-be25-1c1d8546d147 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:25.062167 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bc286b1-51f0-47df-be25-1c1d8546d147 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:25.062666 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bc286b1-51f0-47df-be25-1c1d8546d147 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:25.063182 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3bc286b1-51f0-47df-be25-1c1d8546d147 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:25.088066 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77d29d04-e5ea-4776-aa08-141cd75dd12a req-9d156077-6a34-44f6-aa84-d3d7219043df tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:25.090086 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-77d29d04-e5ea-4776-aa08-141cd75dd12a req-9d156077-6a34-44f6-aa84-d3d7219043df tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.5423107 Dec 09 21:21:25.130599 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-4bc19c07-7567-451f-af3e-bd7112b9d601 req-3bc286b1-51f0-47df-be25-1c1d8546d147 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] No DVR routers for this DVR port 3eba2279-4b83-4ab6-bde7-0305ee1eda1f on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:21:25.171577 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-555510e1-7ce0-4d91-8d40-6aaca2d15bb2 req-26e5a237-b868-4206-b57d-f711d09a21ee tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.13 "GET /v2.0/ports?device_id=a007b30a-1cc1-4d65-b263-1bd9d1a84b3b HTTP/1.1" status: 200 len: 210 time: 0.0992811 Dec 09 21:21:25.176089 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4bc19c07-7567-451f-af3e-bd7112b9d601 req-3bc286b1-51f0-47df-be25-1c1d8546d147 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:25.179326 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4bc19c07-7567-451f-af3e-bd7112b9d601 req-3bc286b1-51f0-47df-be25-1c1d8546d147 tempest-AttachSCSIVolumeTestJSON-20585676 tempest-AttachSCSIVolumeTestJSON-20585676-project] 10.222.0.10 "DELETE /v2.0/ports/3eba2279-4b83-4ab6-bde7-0305ee1eda1f HTTP/1.1" status: 204 len: 173 time: 1.1649754 Dec 09 21:21:25.193603 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a007b30a-1cc1-4d65-b263-1bd9d1a84b3b', 'name': 'network-vif-deleted', 'tag': '3eba2279-4b83-4ab6-bde7-0305ee1eda1f'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:21:25.197526 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-059b4ccf-a6a2-4186-9f61-865013b4c464" -d '{"events": [{"server_uuid": "a007b30a-1cc1-4d65-b263-1bd9d1a84b3b", "name": "network-vif-deleted", "tag": "3eba2279-4b83-4ab6-bde7-0305ee1eda1f"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:21:25.257187 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-77d29d04-e5ea-4776-aa08-141cd75dd12a req-5a60c573-a6e2-4b39-a44f-13b80efa3909 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1277728 Dec 09 21:21:25.391186 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86d63e6b-8088-4f08-bca1-9d4f37d7eeb8 req-6041a0f3-554d-4b43-898a-a345dcf0d9f4 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:25.396972 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86d63e6b-8088-4f08-bca1-9d4f37d7eeb8 req-6041a0f3-554d-4b43-898a-a345dcf0d9f4 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.1160705 Dec 09 21:21:25.465459 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:21:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e6dbe187-c014-41ed-9aaf-9722f9384283 x-openstack-request-id: req-e6dbe187-c014-41ed-9aaf-9722f9384283 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:21:25.466234 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a007b30a-1cc1-4d65-b263-1bd9d1a84b3b", "name": "network-vif-deleted", "tag": "3eba2279-4b83-4ab6-bde7-0305ee1eda1f", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:21:25.466970 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e6dbe187-c014-41ed-9aaf-9722f9384283 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:21:25.467602 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a007b30a-1cc1-4d65-b263-1bd9d1a84b3b', 'name': 'network-vif-deleted', 'tag': '3eba2279-4b83-4ab6-bde7-0305ee1eda1f', 'status': 'completed', 'code': 200} Dec 09 21:21:25.497588 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86d63e6b-8088-4f08-bca1-9d4f37d7eeb8 req-38274c26-33bc-48be-8c1d-bcbf1878dcfe tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0927110 Dec 09 21:21:25.622846 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28de7b94-d9f8-472a-b844-106acc3be9b4 req-1059f7de-fd03-4c62-b9a0-226297e82794 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:25.631059 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-28de7b94-d9f8-472a-b844-106acc3be9b4 req-1059f7de-fd03-4c62-b9a0-226297e82794 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.0644236 Dec 09 21:21:25.716061 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-28de7b94-d9f8-472a-b844-106acc3be9b4 req-b7b73936-8e0c-41f3-9161-1a6567cdf131 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0838468 Dec 09 21:21:26.415335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-095a1f6a-babf-422c-afd3-b98c2f0aa259 req-18bf231f-0d14-4d2d-b45b-8b216c0e2000 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:26.425209 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-095a1f6a-babf-422c-afd3-b98c2f0aa259 req-18bf231f-0d14-4d2d-b45b-8b216c0e2000 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.0986500 Dec 09 21:21:26.481698 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-095a1f6a-babf-422c-afd3-b98c2f0aa259 req-982b16f9-2aa8-461f-8786-7bf609f87a63 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0553963 Dec 09 21:21:26.713044 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-287b580b-53be-474c-8396-78c182056583 req-d5c8c8d8-9d66-4419-8e0a-c68dfa9330b1 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:26.713044 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-287b580b-53be-474c-8396-78c182056583 req-d5c8c8d8-9d66-4419-8e0a-c68dfa9330b1 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.1103063 Dec 09 21:21:26.740194 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-287b580b-53be-474c-8396-78c182056583 req-d10ed8ea-8951-40ff-a929-31d77f5aa8dd tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0552337 Dec 09 21:21:26.891468 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93741722-4f8a-444e-8041-a2e867792fb9 req-dffd0904-68ec-4da3-8a20-77bc12352747 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:26.893779 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-93741722-4f8a-444e-8041-a2e867792fb9 req-dffd0904-68ec-4da3-8a20-77bc12352747 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.0603836 Dec 09 21:21:26.966115 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:26.982473 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-93741722-4f8a-444e-8041-a2e867792fb9 req-d3bec5e4-cbf4-4864-9a22-193d0f336df4 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0790002 Dec 09 21:21:27.033204 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:27.618261 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4f9adae-7195-4ec3-804a-9a83fa692093 req-2ed58bd2-5e85-4be6-adfc-b3d1c7fc16bd tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:27.619781 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d4f9adae-7195-4ec3-804a-9a83fa692093 req-2ed58bd2-5e85-4be6-adfc-b3d1c7fc16bd tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.0526979 Dec 09 21:21:27.668332 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d4f9adae-7195-4ec3-804a-9a83fa692093 req-4d5c48e1-321d-4fae-a5c2-24acee07c4f0 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419612 Dec 09 21:21:27.864423 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29a75f42-1609-4052-b1a1-ba17e3ab3700 req-fcaa0ae7-8fdf-4d77-ba92-e295e4016383 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:27.865897 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-29a75f42-1609-4052-b1a1-ba17e3ab3700 req-fcaa0ae7-8fdf-4d77-ba92-e295e4016383 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.0502498 Dec 09 21:21:27.921590 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-29a75f42-1609-4052-b1a1-ba17e3ab3700 req-5d688b0e-243b-416f-b45f-097732dcb5ef tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493248 Dec 09 21:21:28.101861 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26f0ea2f-ee37-4594-9343-49270e339692 req-aabd4c93-06c3-4fbd-ae80-035d684898a9 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:28.103678 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-26f0ea2f-ee37-4594-9343-49270e339692 req-aabd4c93-06c3-4fbd-ae80-035d684898a9 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.0505455 Dec 09 21:21:28.161662 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-26f0ea2f-ee37-4594-9343-49270e339692 req-e46a4f69-1912-494a-ae40-baa1b8d2a022 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503569 Dec 09 21:21:28.574334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba4450ea-2cc4-428c-a295-869512298bbf req-035d27f9-c8a3-4d66-9808-2edf7106253a tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:28.575898 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba4450ea-2cc4-428c-a295-869512298bbf req-035d27f9-c8a3-4d66-9808-2edf7106253a tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/ports?device_id=f557bb48-79b5-4aa9-b1e7-72fc54f16eff HTTP/1.1" status: 200 len: 950 time: 0.0524211 Dec 09 21:21:28.626729 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba4450ea-2cc4-428c-a295-869512298bbf req-91bdd713-6322-4efb-aaf9-f1d0ccbd943b tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/security-groups?id=836eb753-a7a8-4b32-9ae9-0184b8831ca8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448067 Dec 09 21:21:28.702357 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 3eba2279-4b83-4ab6-bde7-0305ee1eda1f no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:21:28.725302 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 3eba2279-4b83-4ab6-bde7-0305ee1eda1f {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:21:28.725828 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 3eba2279-4b83-4ab6-bde7-0305ee1eda1f not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:21:28.815728 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9366729d-d6a5-436e-aea8-eeeebc2b6d19 req-9d0e5c4b-9694-4fa9-beab-96b7cea702fe tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:28.817815 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9366729d-d6a5-436e-aea8-eeeebc2b6d19 req-9d0e5c4b-9694-4fa9-beab-96b7cea702fe tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.0743043 Dec 09 21:21:28.883747 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9366729d-d6a5-436e-aea8-eeeebc2b6d19 req-3dacc548-232b-4a73-aaad-7eff4bfa9bf6 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0513496 Dec 09 21:21:29.084647 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a90b5b9f-9f09-4bec-a189-adcacaa3f29a req-35522adf-e98d-4f71-9c40-f4055818d0bb tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:29.092182 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a90b5b9f-9f09-4bec-a189-adcacaa3f29a req-35522adf-e98d-4f71-9c40-f4055818d0bb tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.0656919 Dec 09 21:21:29.186605 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a90b5b9f-9f09-4bec-a189-adcacaa3f29a req-6516cb7e-16d5-488f-9bdd-183b66eeb483 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0853093 Dec 09 21:21:29.365306 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70b7e1e7-d2da-4a8b-adf6-46e244d23687 req-9860a497-a3b0-4baa-9f4c-d90c6d870fd3 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:29.366902 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-70b7e1e7-d2da-4a8b-adf6-46e244d23687 req-9860a497-a3b0-4baa-9f4c-d90c6d870fd3 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.0512412 Dec 09 21:21:29.417254 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-70b7e1e7-d2da-4a8b-adf6-46e244d23687 req-3f7daadd-d2f5-466a-b00c-6e70bb2d0a26 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438166 Dec 09 21:21:30.020215 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58b6c82a-0425-4686-91bd-432e436cd6c5 req-d96f9184-dcd2-4dcc-a191-03c117e0bb1f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:30.022543 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-58b6c82a-0425-4686-91bd-432e436cd6c5 req-d96f9184-dcd2-4dcc-a191-03c117e0bb1f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.0657833 Dec 09 21:21:30.077217 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-58b6c82a-0425-4686-91bd-432e436cd6c5 req-ed9d9bc6-e362-47c7-88c7-dd72af79c0e2 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476017 Dec 09 21:21:30.591626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5e89af3-e963-493f-889b-d2d44e2df9b8 req-2f4e783e-f304-4786-99c7-5cddc2d7f4f3 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:30.593178 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5e89af3-e963-493f-889b-d2d44e2df9b8 req-2f4e783e-f304-4786-99c7-5cddc2d7f4f3 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.0803645 Dec 09 21:21:30.627623 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b12fca0-bccf-4732-a1ca-e8e50a58c9be req-359efb39-cf23-45bf-9027-3a074666487f tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:30.630498 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b12fca0-bccf-4732-a1ca-e8e50a58c9be req-359efb39-cf23-45bf-9027-3a074666487f tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.0886507 Dec 09 21:21:30.678346 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5e89af3-e963-493f-889b-d2d44e2df9b8 req-078d3afb-1b65-4958-a61b-09b243e1124b tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0778105 Dec 09 21:21:30.706594 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b12fca0-bccf-4732-a1ca-e8e50a58c9be req-808332a1-3994-4dd0-b3f0-b9f9b2d2004d tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0630074 Dec 09 21:21:31.213544 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-892d7236-708e-464d-9c86-689fd3073e4f req-872ca5a0-65a7-4896-8d52-841ef78d7c2d tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:31.215265 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-892d7236-708e-464d-9c86-689fd3073e4f req-872ca5a0-65a7-4896-8d52-841ef78d7c2d tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.0590427 Dec 09 21:21:31.277224 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-892d7236-708e-464d-9c86-689fd3073e4f req-b55eadf9-1294-490f-930a-ee5db407d57b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0556283 Dec 09 21:21:31.824430 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-848ee254-0fee-4df0-aa2d-dd120d59bcd9 req-f2009a3f-edde-41aa-8251-5958c1d6eac1 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:31.830780 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-848ee254-0fee-4df0-aa2d-dd120d59bcd9 req-f2009a3f-edde-41aa-8251-5958c1d6eac1 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.0680854 Dec 09 21:21:31.920382 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11b4ea45-8161-458a-9386-5ee33a26cf05 req-12848846-81ce-4ecb-9dd9-8b3148051246 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:31.921945 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11b4ea45-8161-458a-9386-5ee33a26cf05 req-12848846-81ce-4ecb-9dd9-8b3148051246 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.0900233 Dec 09 21:21:31.931810 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-848ee254-0fee-4df0-aa2d-dd120d59bcd9 req-76f35b5a-1d7e-4b5f-b84d-92b1bea4b613 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0902781 Dec 09 21:21:31.999738 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11b4ea45-8161-458a-9386-5ee33a26cf05 req-0ebac6a8-d0d6-491a-81aa-30762bb5774c tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0611393 Dec 09 21:21:32.408652 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f998987a-f3d6-437e-9243-ac25dcd20a8b req-3937b8c3-d90c-4b95-a60e-80126f06b5a5 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:32.410179 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f998987a-f3d6-437e-9243-ac25dcd20a8b req-3937b8c3-d90c-4b95-a60e-80126f06b5a5 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.0669057 Dec 09 21:21:32.471744 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f998987a-f3d6-437e-9243-ac25dcd20a8b req-f9ed0cdc-aced-4b4c-8650-1cd6b75047e1 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547516 Dec 09 21:21:32.769146 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6d291946-2d01-4e98-9924-23ab0f560c19 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:21:32.775347 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6d291946-2d01-4e98-9924-23ab0f560c19 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:21:32.912692 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:21:32.934206 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:32.961872 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c36e0e96-9492-4908-90f5-5bc986e455e2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:32.977006 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6d291946-2d01-4e98-9924-23ab0f560c19, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6d291946-2d01-4e98-9924-23ab0f560c19,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:32.988651 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f557bb48-79b5-4aa9-b1e7-72fc54f16eff', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '6d291946-2d01-4e98-9924-23ab0f560c19'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:21:32.991185 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f4060a4d-c5b4-485f-84a7-c7f463e2c1f0" -d '{"events": [{"server_uuid": "f557bb48-79b5-4aa9-b1e7-72fc54f16eff", "name": "network-vif-unplugged", "status": "completed", "tag": "6d291946-2d01-4e98-9924-23ab0f560c19"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:21:33.005421 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '6d291946-2d01-4e98-9924-23ab0f560c19', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '6d291946-2d01-4e98-9924-23ab0f560c19', 'mac_address': 'fa:16:3e:34:e6:eb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.116'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:21:33.010822 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6d291946-2d01-4e98-9924-23ab0f560c19, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6d291946-2d01-4e98-9924-23ab0f560c19,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:33.056178 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:33.065672 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:21:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-382c1012-55b3-4600-b870-913caad9f9e8 x-openstack-request-id: req-382c1012-55b3-4600-b870-913caad9f9e8 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:21:33.066159 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f557bb48-79b5-4aa9-b1e7-72fc54f16eff", "name": "network-vif-unplugged", "status": "completed", "tag": "6d291946-2d01-4e98-9924-23ab0f560c19", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:21:33.066549 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-382c1012-55b3-4600-b870-913caad9f9e8 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:21:33.067593 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f557bb48-79b5-4aa9-b1e7-72fc54f16eff', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '6d291946-2d01-4e98-9924-23ab0f560c19', 'code': 200} Dec 09 21:21:33.113408 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:33.131659 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37973a0e-8009-4b8c-8568-194b407bbee4 req-b905c782-200b-4b40-b555-accbcad6ccca tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:33.134337 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 6d291946-2d01-4e98-9924-23ab0f560c19 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:21:33.147486 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-37973a0e-8009-4b8c-8568-194b407bbee4 req-b905c782-200b-4b40-b555-accbcad6ccca tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.1206656 Dec 09 21:21:33.225508 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:21:33.226114 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:21:33.235499 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=6d291946-2d01-4e98-9924-23ab0f560c19,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:33.248288 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:33.248691 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-37973a0e-8009-4b8c-8568-194b407bbee4 req-f12b4ee7-e600-4c8a-95de-28dea60b682a tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1002121 Dec 09 21:21:33.249237 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:33.260963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:33.260963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:33.260963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:33.260963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:33.260963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:33.260963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:33.260963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:33.260963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:33.260963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:33.260963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:33.260963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:33.354168 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85f07f64-9bc6-4782-b730-94505d210e79 req-6a522629-0b7a-4860-b4ad-b51de7798cb0 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:33.356145 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85f07f64-9bc6-4782-b730-94505d210e79 req-6a522629-0b7a-4860-b4ad-b51de7798cb0 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 945 time: 0.0646067 Dec 09 21:21:33.421170 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85f07f64-9bc6-4782-b730-94505d210e79 req-047bf28c-ed51-4e5a-8343-5e8ad9ab21c9 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0543733 Dec 09 21:21:33.675512 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f279046-eda4-4b76-bb9c-70a18f85f7a1 req-c8f05f12-72ae-4c99-b8e3-0312e942e42c tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:33.677112 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f279046-eda4-4b76-bb9c-70a18f85f7a1 req-c8f05f12-72ae-4c99-b8e3-0312e942e42c tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.0648344 Dec 09 21:21:33.757918 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f279046-eda4-4b76-bb9c-70a18f85f7a1 req-7322881c-97a0-48c9-b3d9-1f648bdf68ee tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0681806 Dec 09 21:21:33.795249 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:33.833455 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6d291946-2d01-4e98-9924-23ab0f560c19 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:21:33.884779 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6d291946-2d01-4e98-9924-23ab0f560c19, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6d291946-2d01-4e98-9924-23ab0f560c19,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:33.890831 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:33.953852 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=6d291946-2d01-4e98-9924-23ab0f560c19,revision_number=9']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:34.015329 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['6d291946-2d01-4e98-9924-23ab0f560c19'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:21:35.488998 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4b048b82-5ec6-434c-afda-f2dd0ce42493 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:36.486092 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:36.778760 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6d291946-2d01-4e98-9924-23ab0f560c19 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:21:36.849038 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 6d291946-2d01-4e98-9924-23ab0f560c19 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:21:36.849434 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:36.940526 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:36.969249 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f557bb48-79b5-4aa9-b1e7-72fc54f16eff', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6d291946-2d01-4e98-9924-23ab0f560c19'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:21:36.971952 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-030b6138-8de0-4aa0-899f-f3e809fb5b92" -d '{"events": [{"server_uuid": "f557bb48-79b5-4aa9-b1e7-72fc54f16eff", "name": "network-vif-plugged", "status": "completed", "tag": "6d291946-2d01-4e98-9924-23ab0f560c19"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:21:36.992413 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6d291946-2d01-4e98-9924-23ab0f560c19, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6d291946-2d01-4e98-9924-23ab0f560c19,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:36.998353 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:37.059128 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=6d291946-2d01-4e98-9924-23ab0f560c19,revision_number=10']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:37.156172 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-1cf24a1c-96b7-4a7a-b856-dcb3a22e6698 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:37.158757 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-1cf24a1c-96b7-4a7a-b856-dcb3a22e6698 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2&tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&binding%3Ahost_id=n-h2-713301-27 HTTP/1.1" status: 200 len: 1097 time: 0.0674524 Dec 09 21:21:37.174416 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h1-713301-27'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:21:37.233797 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:37.382739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] For port 6166c639-9f87-4254-af88-12c4be868be5, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=6166c639-9f87-4254-af88-12c4be868be5,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:37.444890 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] For port 6166c639-9f87-4254-af88-12c4be868be5, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:21:37.511336 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b061c5ff-772f-4909-950e-39d066fb05c2', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '6166c639-9f87-4254-af88-12c4be868be5'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:21:37.514053 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-80f76b3c-591d-4130-8110-6d8e6423a67f" -d '{"events": [{"server_uuid": "b061c5ff-772f-4909-950e-39d066fb05c2", "name": "network-vif-unplugged", "status": "completed", "tag": "6166c639-9f87-4254-af88-12c4be868be5"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:21:37.520880 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:37.532766 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:37.645017 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Attempting to bind port 6166c639-9f87-4254-af88-12c4be868be5 on host n-h2-713301-27 for vnic_type normal with profile {"migrating_to": "n-h1-713301-27"} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:21:37.645540 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Attempting to bind port 6166c639-9f87-4254-af88-12c4be868be5 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:21:37.646233 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Attempting to bind port 6166c639-9f87-4254-af88-12c4be868be5 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:21:37.651612 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Pushing event updated for resources: {'Port': ['ID=6166c639-9f87-4254-af88-12c4be868be5,revision_number=7']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:37.654693 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Port 6166c639-9f87-4254-af88-12c4be868be5 on network 04fa749a-9f72-4a2c-a725-feab917f99ef not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:21:37.655018 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Attempting to bind port 6166c639-9f87-4254-af88-12c4be868be5 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:21:37.663557 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 21, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:21:37.663905 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Checking segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:21:37.664280 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Bound using segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:21:37.664712 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Bound port: 6166c639-9f87-4254-af88-12c4be868be5, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:21:37.665069 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:37.669518 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:37.669875 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:37.670221 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:37.670564 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:37.670900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:37.671230 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:37.671596 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:37.671932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:37.672251 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:37.672580 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:37.673177 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:37.673269 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:37.673594 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:21:37.789041 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] For port 6166c639-9f87-4254-af88-12c4be868be5, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:21:37.795165 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] For port 6166c639-9f87-4254-af88-12c4be868be5, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=6166c639-9f87-4254-af88-12c4be868be5,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:21:37.805476 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:37.860505 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:37.917281 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Pushing event updated for resources: {'Port': ['ID=6166c639-9f87-4254-af88-12c4be868be5,revision_number=8']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:37.922722 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:37.923383 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:37.924816 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-f67372b0-3c58-4fad-a8ec-fb8b63bf3137 service neutron] 10.222.0.31 "PUT /v2.0/ports/6166c639-9f87-4254-af88-12c4be868be5 HTTP/1.1" status: 200 len: 1123 time: 0.7545912 Dec 09 21:21:38.017982 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['6166c639-9f87-4254-af88-12c4be868be5'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:21:38.066278 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['6166c639-9f87-4254-af88-12c4be868be5'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:21:38.799832 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6166c639-9f87-4254-af88-12c4be868be5 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:21:38.925695 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6166c639-9f87-4254-af88-12c4be868be5, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=6166c639-9f87-4254-af88-12c4be868be5,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:38.939934 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6166c639-9f87-4254-af88-12c4be868be5 has no active binding in host n-h1-713301-27 {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:158}} Dec 09 21:21:39.281143 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:42.765200 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07f63083-7c78-4fe9-a14c-aa3f8e34476a req-5c5d8a72-ff01-45ef-8676-98fdaa540ae1 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:42.774014 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07f63083-7c78-4fe9-a14c-aa3f8e34476a req-5c5d8a72-ff01-45ef-8676-98fdaa540ae1 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.0605810 Dec 09 21:21:42.833271 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07f63083-7c78-4fe9-a14c-aa3f8e34476a req-0d1b80b6-1eae-4972-9ba7-7972fbec02cf tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0580611 Dec 09 21:21:43.055785 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-354231c7-f56d-4583-8124-3b0a511d587c req-8e8a28a5-f1df-49d9-a992-d81be098bf7b tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:43.065703 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-354231c7-f56d-4583-8124-3b0a511d587c req-8e8a28a5-f1df-49d9-a992-d81be098bf7b tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 943 time: 0.0812919 Dec 09 21:21:43.121180 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-354231c7-f56d-4583-8124-3b0a511d587c req-8903f072-8dd7-4e00-ab4e-d63c00ccdc81 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0551288 Dec 09 21:21:43.169769 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:21:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a1d99e8c-616d-46ea-86b1-16bdf1fa408e x-openstack-request-id: req-a1d99e8c-616d-46ea-86b1-16bdf1fa408e {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:21:43.170320 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f557bb48-79b5-4aa9-b1e7-72fc54f16eff", "name": "network-vif-plugged", "status": "completed", "tag": "6d291946-2d01-4e98-9924-23ab0f560c19", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:21:43.170320 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a1d99e8c-616d-46ea-86b1-16bdf1fa408e {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:21:43.170777 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f557bb48-79b5-4aa9-b1e7-72fc54f16eff', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6d291946-2d01-4e98-9924-23ab0f560c19', 'code': 200} Dec 09 21:21:43.206249 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:21:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-caf74acb-4dc7-4b9a-a037-3500ae086719 x-openstack-request-id: req-caf74acb-4dc7-4b9a-a037-3500ae086719 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:21:43.207663 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b061c5ff-772f-4909-950e-39d066fb05c2", "name": "network-vif-unplugged", "status": "completed", "tag": "6166c639-9f87-4254-af88-12c4be868be5", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:21:43.208143 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-caf74acb-4dc7-4b9a-a037-3500ae086719 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:21:43.208770 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b061c5ff-772f-4909-950e-39d066fb05c2', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '6166c639-9f87-4254-af88-12c4be868be5', 'code': 200} Dec 09 21:21:43.250985 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60362) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:21:43.640050 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3190eb53-a215-458c-b4eb-3f4b5d8373b5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:43.942729 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-3190eb53-a215-458c-b4eb-3f4b5d8373b5 admin admin] Deleting port 012d7306-fba8-43d4-80e6-3acf4ac3f98c {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:21:43.942977 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3190eb53-a215-458c-b4eb-3f4b5d8373b5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:43.958911 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bec289f-5f08-4c41-9bbb-aa65135dd231 req-02674f4e-3ebf-4cef-91eb-d83079e49cc2 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:43.960450 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5bec289f-5f08-4c41-9bbb-aa65135dd231 req-02674f4e-3ebf-4cef-91eb-d83079e49cc2 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/ports?device_id=f557bb48-79b5-4aa9-b1e7-72fc54f16eff HTTP/1.1" status: 200 len: 951 time: 0.0988767 Dec 09 21:21:43.997350 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec0dc186-3281-4f17-bd2f-6395449a8e9f req-7c1ac27d-0cea-483e-906c-56cc62f412bd tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:43.998825 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec0dc186-3281-4f17-bd2f-6395449a8e9f req-7c1ac27d-0cea-483e-906c-56cc62f412bd tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.0795019 Dec 09 21:21:44.022754 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-3190eb53-a215-458c-b4eb-3f4b5d8373b5 admin admin] For port 012d7306-fba8-43d4-80e6-3acf4ac3f98c, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=012d7306-fba8-43d4-80e6-3acf4ac3f98c,segment=NetworkSegment(5c779566-9ab2-470d-8b5d-c18c1d216fd1),segment_id=5c779566-9ab2-470d-8b5d-c18c1d216fd1)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:44.023623 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3190eb53-a215-458c-b4eb-3f4b5d8373b5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:44.037845 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-3190eb53-a215-458c-b4eb-3f4b5d8373b5 admin admin] Calling delete_port for 012d7306-fba8-43d4-80e6-3acf4ac3f98c owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:21:44.038603 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5bec289f-5f08-4c41-9bbb-aa65135dd231 req-3996cb0c-cab7-4a07-98d3-e7ac662c7ee8 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/security-groups?id=836eb753-a7a8-4b32-9ae9-0184b8831ca8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0719147 Dec 09 21:21:44.068648 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec0dc186-3281-4f17-bd2f-6395449a8e9f req-615ce3ef-0358-4204-bc34-f88b675a31d7 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0623198 Dec 09 21:21:44.262998 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c81f9c0a-15c1-48e5-a48a-e234791e303a req-e6cc8d13-8d76-4c38-be68-6626c3e8c698 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:44.268003 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c81f9c0a-15c1-48e5-a48a-e234791e303a req-e6cc8d13-8d76-4c38-be68-6626c3e8c698 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 943 time: 0.0592086 Dec 09 21:21:44.329842 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c81f9c0a-15c1-48e5-a48a-e234791e303a req-94968457-1e8e-4a9e-86eb-7f8ecc9a7540 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0585449 Dec 09 21:21:44.487783 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3190eb53-a215-458c-b4eb-3f4b5d8373b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:44.515829 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3190eb53-a215-458c-b4eb-3f4b5d8373b5 admin admin] Pushing event deleted for resources: {'Port': ['ID=012d7306-fba8-43d4-80e6-3acf4ac3f98c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:44.679588 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3190eb53-a215-458c-b4eb-3f4b5d8373b5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:44.788456 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:21:44.904906 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3190eb53-a215-458c-b4eb-3f4b5d8373b5 admin admin] Router 0d220f39-aeac-4dc5-ac16-e4d907702583 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:21:44.905613 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:44.920711 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8', 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6', 'port_id': 'b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8', 'mac_address': 'fa:16:3e:04:b4:ba', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 122, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '63e7603a-bb11-4d1a-8d84-55456d81931c', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:21:44.964389 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:44.979862 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:21:45.005133 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:45.010652 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:45.024059 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3190eb53-a215-458c-b4eb-3f4b5d8373b5 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:21:45.029998 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3190eb53-a215-458c-b4eb-3f4b5d8373b5 admin admin] 10.222.0.13 "PUT /v2.0/routers/0d220f39-aeac-4dc5-ac16-e4d907702583/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7774012 Dec 09 21:21:45.032484 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60428) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:21:45.048194 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b198538a-582d-49d7-a735-1f5d8ec76292 None None] Sync routers for ids ['0d220f39-aeac-4dc5-ac16-e4d907702583'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:21:45.090214 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b198538a-582d-49d7-a735-1f5d8ec76292 None None] Routers {'0d220f39-aeac-4dc5-ac16-e4d907702583'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:21:45.091526 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b198538a-582d-49d7-a735-1f5d8ec76292 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:21:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['0d220f39-aeac-4dc5-ac16-e4d907702583'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:21:45.157458 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6d6c3657-b1e6-4bd4-943e-b393085a6237 admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:45.254488 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:45.266887 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:21:45.276921 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b061c5ff-772f-4909-950e-39d066fb05c2', 'tag': '6166c639-9f87-4254-af88-12c4be868be5'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:21:45.301134 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fa556aae-3975-4166-8362-4db6ff78f6c8" -d '{"events": [{"name": "network-changed", "server_uuid": "b061c5ff-772f-4909-950e-39d066fb05c2", "tag": "6166c639-9f87-4254-af88-12c4be868be5"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:21:45.325437 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fda4ab3-c2e1-4f97-9bef-69106137086f req-6a29e11a-4b7e-4f13-b7fa-3c668eaf9875 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:45.333001 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5fda4ab3-c2e1-4f97-9bef-69106137086f req-6a29e11a-4b7e-4f13-b7fa-3c668eaf9875 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/ports?device_id=f557bb48-79b5-4aa9-b1e7-72fc54f16eff HTTP/1.1" status: 200 len: 951 time: 0.1618016 Dec 09 21:21:45.364508 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6d6c3657-b1e6-4bd4-943e-b393085a6237 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:45.365694 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-b198538a-582d-49d7-a735-1f5d8ec76292 None None] Set router 0d220f39-aeac-4dc5-ac16-e4d907702583 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:21:45.384355 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3863706b-42bf-4689-9428-d025db43d581 req-99b0e91f-801c-4af2-8fd7-e232040c1e71 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:45.392298 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3863706b-42bf-4689-9428-d025db43d581 req-99b0e91f-801c-4af2-8fd7-e232040c1e71 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.1757152 Dec 09 21:21:45.451324 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5fda4ab3-c2e1-4f97-9bef-69106137086f req-22f18d2d-07b1-4152-bb8a-c863c2f81822 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/security-groups?id=836eb753-a7a8-4b32-9ae9-0184b8831ca8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1122584 Dec 09 21:21:45.510469 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-6d6c3657-b1e6-4bd4-943e-b393085a6237 admin admin] Deleting port bfb54d46-9eb4-4f0f-a20d-de24e82762cc {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:21:45.511009 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6d6c3657-b1e6-4bd4-943e-b393085a6237 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:45.514835 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3863706b-42bf-4689-9428-d025db43d581 req-5c940a54-bff6-4fe4-8795-e61ad97bd0ee tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1215777 Dec 09 21:21:45.644918 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-6d6c3657-b1e6-4bd4-943e-b393085a6237 admin admin] For port bfb54d46-9eb4-4f0f-a20d-de24e82762cc, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=bfb54d46-9eb4-4f0f-a20d-de24e82762cc,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:45.645478 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6d6c3657-b1e6-4bd4-943e-b393085a6237 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:45.679215 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-6d6c3657-b1e6-4bd4-943e-b393085a6237 admin admin] Calling delete_port for bfb54d46-9eb4-4f0f-a20d-de24e82762cc owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:21:45.683750 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:21:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-82ff5507-1ed3-4e65-ba64-5f78eee0aedc x-openstack-request-id: req-82ff5507-1ed3-4e65-ba64-5f78eee0aedc {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:21:45.684049 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b061c5ff-772f-4909-950e-39d066fb05c2", "tag": "6166c639-9f87-4254-af88-12c4be868be5", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:21:45.684308 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-82ff5507-1ed3-4e65-ba64-5f78eee0aedc {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:21:45.687704 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b061c5ff-772f-4909-950e-39d066fb05c2', 'tag': '6166c639-9f87-4254-af88-12c4be868be5', 'status': 'completed', 'code': 200} Dec 09 21:21:45.903731 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa556aae-3975-4166-8362-4db6ff78f6c8 req-48784bde-2abb-481d-ba1e-3031f8bcd8ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:45.905947 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fa556aae-3975-4166-8362-4db6ff78f6c8 req-48784bde-2abb-481d-ba1e-3031f8bcd8ad service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 1126 time: 0.2006776 Dec 09 21:21:45.954670 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b198538a-582d-49d7-a735-1f5d8ec76292 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d220f39-aeac-4dc5-ac16-e4d907702583', 'name': 'tempest-AttachSCSIVolumeTestJSON-1560467054-router', 'tenant_id': '913fcb9b5aab4356999ade167d5148c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.216'}], 'enable_snat': True}, 'gw_port_id': 'bfb54d46-9eb4-4f0f-a20d-de24e82762cc', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:19:33Z', 'updated_at': '2021-12-09T21:21:44Z', 'revision_number': 5, 'project_id': '913fcb9b5aab4356999ade167d5148c6', 'gw_port': {'id': 'bfb54d46-9eb4-4f0f-a20d-de24e82762cc', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:42:ee', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d220f39-aeac-4dc5-ac16-e4d907702583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 492, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.216', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:19:35Z', 'updated_at': '2021-12-09T21:19:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:21:46.028987 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b198538a-582d-49d7-a735-1f5d8ec76292 None None] Checking router: 0d220f39-aeac-4dc5-ac16-e4d907702583 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:21:46.046318 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b198538a-582d-49d7-a735-1f5d8ec76292 None None] Routers {'0d220f39-aeac-4dc5-ac16-e4d907702583'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:21:46.048189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b198538a-582d-49d7-a735-1f5d8ec76292 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:21:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['0d220f39-aeac-4dc5-ac16-e4d907702583'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:21:46.154184 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa556aae-3975-4166-8362-4db6ff78f6c8 req-009abecd-aea6-428e-9287-9835252d9682 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:46.160968 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fa556aae-3975-4166-8362-4db6ff78f6c8 req-009abecd-aea6-428e-9287-9835252d9682 service neutron] 10.222.0.10 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 908 time: 0.2436383 Dec 09 21:21:46.175834 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c6a62a0-488a-44cd-a2b2-ff1667da164c req-ac8e94a1-d53d-4bfd-8c2b-fc31ea8553af tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:46.187426 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c6a62a0-488a-44cd-a2b2-ff1667da164c req-ac8e94a1-d53d-4bfd-8c2b-fc31ea8553af tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 943 time: 0.3846178 Dec 09 21:21:46.240957 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-b198538a-582d-49d7-a735-1f5d8ec76292 None None] Set router 0d220f39-aeac-4dc5-ac16-e4d907702583 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:21:46.297719 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fa556aae-3975-4166-8362-4db6ff78f6c8 req-f42b87bf-2929-4adb-8f2a-31edcdc4c0e9 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=6166c639-9f87-4254-af88-12c4be868be5 HTTP/1.1" status: 200 len: 217 time: 0.0996261 Dec 09 21:21:46.318037 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b198538a-582d-49d7-a735-1f5d8ec76292 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d220f39-aeac-4dc5-ac16-e4d907702583', 'name': 'tempest-AttachSCSIVolumeTestJSON-1560467054-router', 'tenant_id': '913fcb9b5aab4356999ade167d5148c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:19:33Z', 'updated_at': '2021-12-09T21:21:45Z', 'revision_number': 6, 'project_id': '913fcb9b5aab4356999ade167d5148c6', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:21:46.357650 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6d6c3657-b1e6-4bd4-943e-b393085a6237 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:46.377010 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b198538a-582d-49d7-a735-1f5d8ec76292 None None] The sync data for ids ['0d220f39-aeac-4dc5-ac16-e4d907702583'] in n-d-713301-27 is: [{'id': '0d220f39-aeac-4dc5-ac16-e4d907702583', 'name': 'tempest-AttachSCSIVolumeTestJSON-1560467054-router', 'tenant_id': '913fcb9b5aab4356999ade167d5148c6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:19:33Z', 'updated_at': '2021-12-09T21:21:45Z', 'revision_number': 6, 'project_id': '913fcb9b5aab4356999ade167d5148c6', 'gw_port_host': None}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:21:46.434015 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d6c3657-b1e6-4bd4-943e-b393085a6237 admin admin] Pushing event deleted for resources: {'Port': ['ID=bfb54d46-9eb4-4f0f-a20d-de24e82762cc,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:46.510528 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c6a62a0-488a-44cd-a2b2-ff1667da164c req-2f10e4dd-54ea-478b-a030-c493f4f0b4a9 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3220081 Dec 09 21:21:46.523840 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa556aae-3975-4166-8362-4db6ff78f6c8 req-3d5e5271-e030-4d16-a084-2f3a6fd6b54a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:46.525584 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fa556aae-3975-4166-8362-4db6ff78f6c8 req-3d5e5271-e030-4d16-a084-2f3a6fd6b54a service neutron] 10.222.0.10 "GET /v2.0/subnets?id=eae2438b-9fcc-44ef-a172-6c4911cad13f HTTP/1.1" status: 200 len: 847 time: 0.1910818 Dec 09 21:21:46.575384 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6d6c3657-b1e6-4bd4-943e-b393085a6237 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:46.598462 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fa556aae-3975-4166-8362-4db6ff78f6c8 req-09d0167c-f361-4128-b7c0-1c0dc441f6cd service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=04fa749a-9f72-4a2c-a725-feab917f99ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0637450 Dec 09 21:21:46.705568 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6d6c3657-b1e6-4bd4-943e-b393085a6237 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:46.708286 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6d6c3657-b1e6-4bd4-943e-b393085a6237 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:46.728280 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76c6af16-1578-43c1-ad04-d12e7dce12dd req-48ea60ac-7d06-4e7b-bd16-693591aa7908 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:46.740350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-76c6af16-1578-43c1-ad04-d12e7dce12dd req-48ea60ac-7d06-4e7b-bd16-693591aa7908 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.1213529 Dec 09 21:21:46.781325 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6d6c3657-b1e6-4bd4-943e-b393085a6237 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:46.782286 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6d6c3657-b1e6-4bd4-943e-b393085a6237 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0d220f39-aeac-4dc5-ac16-e4d907702583 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:21:46.792009 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6d6c3657-b1e6-4bd4-943e-b393085a6237 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:46.797272 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6d6c3657-b1e6-4bd4-943e-b393085a6237 admin admin] 10.222.0.13 "DELETE /v2.0/routers/0d220f39-aeac-4dc5-ac16-e4d907702583 HTTP/1.1" status: 204 len: 168 time: 1.7636356 Dec 09 21:21:46.801154 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60530) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:21:46.807961 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:21:46.856063 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-76c6af16-1578-43c1-ad04-d12e7dce12dd req-2b66e5b2-e2bf-49c1-b7bc-9b2c9fdbf166 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1070869 Dec 09 21:21:46.872385 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fa556aae-3975-4166-8362-4db6ff78f6c8 req-4674414b-5f46-42bb-a800-9e8ff9404328 service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2652283 Dec 09 21:21:46.965190 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6d291946-2d01-4e98-9924-23ab0f560c19 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:21:46.986181 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-d1488c58-b981-4bfd-9eee-04605250d7a9 admin admin] Deleting subnet f2e816c0-e7a2-4010-b2b9-8d7f39c3a318 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:21:46.993484 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d1488c58-b981-4bfd-9eee-04605250d7a9 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:47.099328 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d1488c58-b981-4bfd-9eee-04605250d7a9 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:47.161102 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fa556aae-3975-4166-8362-4db6ff78f6c8 req-232f1aea-5d7b-4aa7-aa84-1da1c3acfe52 service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2792342 Dec 09 21:21:47.167534 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:21:47.167924 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:47.319364 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d1488c58-b981-4bfd-9eee-04605250d7a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:47.362136 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:47.398918 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:47.405657 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f557bb48-79b5-4aa9-b1e7-72fc54f16eff', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '6d291946-2d01-4e98-9924-23ab0f560c19'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:21:47.408266 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-63ee02c0-9f53-4050-9300-faace2f930b1" -d '{"events": [{"server_uuid": "f557bb48-79b5-4aa9-b1e7-72fc54f16eff", "name": "network-vif-unplugged", "status": "completed", "tag": "6d291946-2d01-4e98-9924-23ab0f560c19"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:21:47.462239 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d1488c58-b981-4bfd-9eee-04605250d7a9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:47.506329 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6d291946-2d01-4e98-9924-23ab0f560c19, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6d291946-2d01-4e98-9924-23ab0f560c19,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:47.510064 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:21:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-185c863f-5557-4af3-8638-43dd762905af x-openstack-request-id: req-185c863f-5557-4af3-8638-43dd762905af {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:21:47.510652 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f557bb48-79b5-4aa9-b1e7-72fc54f16eff", "name": "network-vif-unplugged", "status": "completed", "tag": "6d291946-2d01-4e98-9924-23ab0f560c19", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:21:47.511112 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-185c863f-5557-4af3-8638-43dd762905af {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:21:47.511835 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f557bb48-79b5-4aa9-b1e7-72fc54f16eff', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '6d291946-2d01-4e98-9924-23ab0f560c19', 'code': 200} Dec 09 21:21:47.519153 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:47.527854 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1488c58-b981-4bfd-9eee-04605250d7a9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f2e816c0-e7a2-4010-b2b9-8d7f39c3a318,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:47.541348 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d1488c58-b981-4bfd-9eee-04605250d7a9 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:47.545250 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d1488c58-b981-4bfd-9eee-04605250d7a9 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/f2e816c0-e7a2-4010-b2b9-8d7f39c3a318 HTTP/1.1" status: 204 len: 168 time: 0.7429824 Dec 09 21:21:47.550448 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60560) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:21:47.784264 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7379ea47-6a6d-4d3c-a2e8-86b2e68c0de5 None None] Network 1444d8a7-187f-473b-be08-dce40f6ae8ea requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:21:47.789008 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:47.827869 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:47.828995 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 6166c639-9f87-4254-af88-12c4be868be5 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:21:47.854628 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53f22d7d-8758-41dd-823c-09d4f2a9801f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:47.988177 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=6d291946-2d01-4e98-9924-23ab0f560c19,revision_number=11']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:48.023809 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b3c19aa-0164-4884-b5ba-d271bc66f84b req-4b278c06-0207-4b62-906a-e07eb6109434 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:48.026313 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b3c19aa-0164-4884-b5ba-d271bc66f84b req-4b278c06-0207-4b62-906a-e07eb6109434 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/ports?device_id=f557bb48-79b5-4aa9-b1e7-72fc54f16eff HTTP/1.1" status: 200 len: 949 time: 0.5250936 Dec 09 21:21:48.030718 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device bfb54d46-9eb4-4f0f-a20d-de24e82762cc no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:21:48.050071 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aef35d66-7ea2-40bd-b77a-f703bda4eb86 req-6f5cc2dc-679f-4537-aa20-dacd1bc2af5e tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:48.051661 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aef35d66-7ea2-40bd-b77a-f703bda4eb86 req-6f5cc2dc-679f-4537-aa20-dacd1bc2af5e tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 943 time: 0.3549507 Dec 09 21:21:48.126359 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: bfb54d46-9eb4-4f0f-a20d-de24e82762cc {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:21:48.136573 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device bfb54d46-9eb4-4f0f-a20d-de24e82762cc not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:21:48.137586 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 012d7306-fba8-43d4-80e6-3acf4ac3f98c no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:21:48.220272 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 012d7306-fba8-43d4-80e6-3acf4ac3f98c {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:21:48.223867 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 012d7306-fba8-43d4-80e6-3acf4ac3f98c not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:21:48.260051 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aef35d66-7ea2-40bd-b77a-f703bda4eb86 req-aa900e60-0d85-4d8e-b2df-9909eb8dfa49 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1309087 Dec 09 21:21:48.278346 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b3c19aa-0164-4884-b5ba-d271bc66f84b req-81fabdcb-87ed-4756-bb68-bb9345523be6 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/security-groups?id=836eb753-a7a8-4b32-9ae9-0184b8831ca8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2246103 Dec 09 21:21:48.327486 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-53f22d7d-8758-41dd-823c-09d4f2a9801f admin admin] Deleting port 0fa51266-e039-4a6c-b933-24080a940ed9 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:21:48.327860 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53f22d7d-8758-41dd-823c-09d4f2a9801f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:48.374155 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:48.464469 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-53f22d7d-8758-41dd-823c-09d4f2a9801f admin admin] For port 0fa51266-e039-4a6c-b933-24080a940ed9, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=0fa51266-e039-4a6c-b933-24080a940ed9,segment=NetworkSegment(5c779566-9ab2-470d-8b5d-c18c1d216fd1),segment_id=5c779566-9ab2-470d-8b5d-c18c1d216fd1)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:48.465094 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53f22d7d-8758-41dd-823c-09d4f2a9801f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:48.487019 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-53f22d7d-8758-41dd-823c-09d4f2a9801f admin admin] Calling delete_port for 0fa51266-e039-4a6c-b933-24080a940ed9 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:21:48.500583 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07c34702-ebbf-435f-8138-8ebe65c60d07 None None] DHCP port deletion for 1444d8a7-187f-473b-be08-dce40f6ae8ea request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:21:48.612592 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-07c34702-ebbf-435f-8138-8ebe65c60d07 None None] Deleting port 0fa51266-e039-4a6c-b933-24080a940ed9 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:21:48.614158 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-07c34702-ebbf-435f-8138-8ebe65c60d07 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:48.730515 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-07c34702-ebbf-435f-8138-8ebe65c60d07 None None] For port 0fa51266-e039-4a6c-b933-24080a940ed9, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=0fa51266-e039-4a6c-b933-24080a940ed9,segment=NetworkSegment(5c779566-9ab2-470d-8b5d-c18c1d216fd1),segment_id=5c779566-9ab2-470d-8b5d-c18c1d216fd1)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:48.730515 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-07c34702-ebbf-435f-8138-8ebe65c60d07 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:48.742463 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-07c34702-ebbf-435f-8138-8ebe65c60d07 None None] Calling delete_port for 0fa51266-e039-4a6c-b933-24080a940ed9 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:21:48.764729 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53f22d7d-8758-41dd-823c-09d4f2a9801f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:48.831528 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53f22d7d-8758-41dd-823c-09d4f2a9801f admin admin] No DVR routers for this DVR port 0fa51266-e039-4a6c-b933-24080a940ed9 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:21:48.853268 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c044e220-ecb3-452c-b588-f1cb0a860138 req-ccecfba2-7041-41c1-9e8e-b8534e901ab4 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:48.855704 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c044e220-ecb3-452c-b588-f1cb0a860138 req-ccecfba2-7041-41c1-9e8e-b8534e901ab4 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.3254800 Dec 09 21:21:48.857030 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53f22d7d-8758-41dd-823c-09d4f2a9801f admin admin] Pushing event deleted for resources: {'Port': ['ID=0fa51266-e039-4a6c-b933-24080a940ed9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:48.858034 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-07c34702-ebbf-435f-8138-8ebe65c60d07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:48.898058 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07c34702-ebbf-435f-8138-8ebe65c60d07 None None] Pushing event deleted for resources: {'Port': ['ID=0fa51266-e039-4a6c-b933-24080a940ed9,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:48.904373 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07c34702-ebbf-435f-8138-8ebe65c60d07 None None] No DVR routers for this DVR port 0fa51266-e039-4a6c-b933-24080a940ed9 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:21:48.932808 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-b5ca5506-0277-48de-9143-3b5b9f61b786 service neutron] 10.222.0.10 "GET /v2.0/ports/6166c639-9f87-4254-af88-12c4be868be5/bindings/n-h1-713301-27 HTTP/1.1" status: 200 len: 385 time: 0.2627361 Dec 09 21:21:48.969371 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c044e220-ecb3-452c-b588-f1cb0a860138 req-37ed1413-93e8-4d5f-9fb8-ab82771b2cd2 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0994759 Dec 09 21:21:49.060054 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53f22d7d-8758-41dd-823c-09d4f2a9801f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:49.108127 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-53f22d7d-8758-41dd-823c-09d4f2a9801f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1444d8a7-187f-473b-be08-dce40f6ae8ea']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:21:49.122836 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-53f22d7d-8758-41dd-823c-09d4f2a9801f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5c779566-9ab2-470d-8b5d-c18c1d216fd1') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:21:49.123643 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-53f22d7d-8758-41dd-823c-09d4f2a9801f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5c779566-9ab2-470d-8b5d-c18c1d216fd1') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:21:49.137534 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53f22d7d-8758-41dd-823c-09d4f2a9801f admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:49.179311 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53f22d7d-8758-41dd-823c-09d4f2a9801f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:49.202585 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-53f22d7d-8758-41dd-823c-09d4f2a9801f admin admin] Releasing vlan 146 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:21:49.203046 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53f22d7d-8758-41dd-823c-09d4f2a9801f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:21:49.207798 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:21:49.383462 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-b2784ba0-e3a9-4d86-b5fa-044385c238a4 service neutron] For port 6166c639-9f87-4254-af88-12c4be868be5, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=6166c639-9f87-4254-af88-12c4be868be5,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:49.399058 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53f22d7d-8758-41dd-823c-09d4f2a9801f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:49.442558 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53f22d7d-8758-41dd-823c-09d4f2a9801f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:49.443999 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f169963-aea8-422c-a231-cdaee0bd9ffc req-0dee8743-3fdd-441c-8c6d-d64e7e92ec63 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:49.445792 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2f169963-aea8-422c-a231-cdaee0bd9ffc req-0dee8743-3fdd-441c-8c6d-d64e7e92ec63 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.31 "GET /v2.0/ports?device_id=f557bb48-79b5-4aa9-b1e7-72fc54f16eff HTTP/1.1" status: 200 len: 949 time: 0.0592663 Dec 09 21:21:49.448309 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-53f22d7d-8758-41dd-823c-09d4f2a9801f admin admin] 10.222.0.13 "DELETE /v2.0/networks/1444d8a7-187f-473b-be08-dce40f6ae8ea HTTP/1.1" status: 204 len: 168 time: 1.8939559 Dec 09 21:21:49.457188 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60586) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:21:49.513250 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e9419ae1-ea8a-47ae-82d5-b82f1353ca2f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:21:49.515528 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7c77adf9-acd6-417a-8163-dc3e4d837ed5" -d '{"events": [{"server_uuid": "e9419ae1-ea8a-47ae-82d5-b82f1353ca2f", "name": "network-vif-plugged", "status": "completed", "tag": "b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:21:49.537950 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53f22d7d-8758-41dd-823c-09d4f2a9801f admin admin] Pushing event deleted for resources: {'Network': ['ID=1444d8a7-187f-473b-be08-dce40f6ae8ea,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:49.549943 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-b2784ba0-e3a9-4d86-b5fa-044385c238a4 service neutron] For port 6166c639-9f87-4254-af88-12c4be868be5, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:21:49.612521 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-b2784ba0-e3a9-4d86-b5fa-044385c238a4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6166c639-9f87-4254-af88-12c4be868be5 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:21:49.633651 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c4b3a23-4803-4fee-8b0e-21a046e92122 req-915a9911-4a36-4b58-a6ad-830c28e84587 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:49.636071 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c4b3a23-4803-4fee-8b0e-21a046e92122 req-915a9911-4a36-4b58-a6ad-830c28e84587 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/ports?device_id=f557bb48-79b5-4aa9-b1e7-72fc54f16eff HTTP/1.1" status: 200 len: 949 time: 0.2286036 Dec 09 21:21:49.649334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f8bdf65-9fc3-4e53-866a-dfc15bd6df7e req-0eac765f-70f8-464b-8a6a-2b1c7a1abca1 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:49.652009 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f8bdf65-9fc3-4e53-866a-dfc15bd6df7e req-0eac765f-70f8-464b-8a6a-2b1c7a1abca1 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 943 time: 0.2466290 Dec 09 21:21:49.660225 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-b2784ba0-e3a9-4d86-b5fa-044385c238a4 service neutron] For port 6166c639-9f87-4254-af88-12c4be868be5, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6166c639-9f87-4254-af88-12c4be868be5,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:49.743781 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-b2784ba0-e3a9-4d86-b5fa-044385c238a4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:49.763538 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-2f169963-aea8-422c-a231-cdaee0bd9ffc req-9f418468-f820-4352-bafd-2c837ba8f7d5 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Deleting port 6d291946-2d01-4e98-9924-23ab0f560c19 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:21:49.764112 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2f169963-aea8-422c-a231-cdaee0bd9ffc req-9f418468-f820-4352-bafd-2c837ba8f7d5 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:49.782313 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f8bdf65-9fc3-4e53-866a-dfc15bd6df7e req-5a1253a3-c4f8-4746-b38a-1459a25a55a3 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1178038 Dec 09 21:21:49.844184 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c4b3a23-4803-4fee-8b0e-21a046e92122 req-d7925cb5-4ec8-4a53-9003-8f0f1f16ccf8 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/security-groups?id=836eb753-a7a8-4b32-9ae9-0184b8831ca8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1909301 Dec 09 21:21:49.877141 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-2f169963-aea8-422c-a231-cdaee0bd9ffc req-9f418468-f820-4352-bafd-2c837ba8f7d5 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] For port 6d291946-2d01-4e98-9924-23ab0f560c19, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6d291946-2d01-4e98-9924-23ab0f560c19,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:49.877141 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2f169963-aea8-422c-a231-cdaee0bd9ffc req-9f418468-f820-4352-bafd-2c837ba8f7d5 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:49.897458 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-2f169963-aea8-422c-a231-cdaee0bd9ffc req-9f418468-f820-4352-bafd-2c837ba8f7d5 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Calling delete_port for 6d291946-2d01-4e98-9924-23ab0f560c19 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:21:49.902145 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0fa51266-e039-4a6c-b933-24080a940ed9 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:21:49.962558 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 0fa51266-e039-4a6c-b933-24080a940ed9 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:21:49.966894 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0fa51266-e039-4a6c-b933-24080a940ed9 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:21:49.996911 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:21:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a80eab9b-2096-45c0-9d63-47f8fc0be4dd x-openstack-request-id: req-a80eab9b-2096-45c0-9d63-47f8fc0be4dd {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:21:49.997501 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e9419ae1-ea8a-47ae-82d5-b82f1353ca2f", "name": "network-vif-plugged", "status": "completed", "tag": "b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:21:49.998077 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a80eab9b-2096-45c0-9d63-47f8fc0be4dd {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:21:49.998694 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e9419ae1-ea8a-47ae-82d5-b82f1353ca2f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8', 'code': 200} Dec 09 21:21:49.999283 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-b2784ba0-e3a9-4d86-b5fa-044385c238a4 service neutron] Transition to ACTIVE for port object 6166c639-9f87-4254-af88-12c4be868be5 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:21:50.012058 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-b2784ba0-e3a9-4d86-b5fa-044385c238a4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:50.140598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2784ba0-e3a9-4d86-b5fa-044385c238a4 service neutron] Pushing event updated for resources: {'Port': ['ID=6166c639-9f87-4254-af88-12c4be868be5,revision_number=10']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:50.190687 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-b2784ba0-e3a9-4d86-b5fa-044385c238a4 service neutron] No DVR routers for this DVR port 6166c639-9f87-4254-af88-12c4be868be5 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:21:50.267759 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-b2784ba0-e3a9-4d86-b5fa-044385c238a4 service neutron] 10.222.0.10 "PUT /v2.0/ports/6166c639-9f87-4254-af88-12c4be868be5/bindings/n-h1-713301-27/activate HTTP/1.1" status: 200 len: 370 time: 1.3043213 Dec 09 21:21:50.337197 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29b1dfcd-b159-4b67-a150-bc5c4ca90477 req-e5b98bb0-dc4f-44e0-80ee-f9aceeafe3c1 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:50.343153 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-29b1dfcd-b159-4b67-a150-bc5c4ca90477 req-e5b98bb0-dc4f-44e0-80ee-f9aceeafe3c1 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.1272349 Dec 09 21:21:50.468166 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-816f236d-420d-46ab-845e-dc23828a353c tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:50.469767 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-816f236d-420d-46ab-845e-dc23828a353c tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2&tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&binding%3Ahost_id=n-h2-713301-27 HTTP/1.1" status: 200 len: 1096 time: 0.1255305 Dec 09 21:21:50.504616 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-29b1dfcd-b159-4b67-a150-bc5c4ca90477 req-e5fd8ba0-a1d3-4d65-b246-a5ed8aab809e tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1382182 Dec 09 21:21:50.555888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-ef51277c-df0d-4820-96cd-d2edc9904ad4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:50.557812 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-ef51277c-df0d-4820-96cd-d2edc9904ad4 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2&tenant_id=ac5b7cefd8cc48cc83f38d3923aae132 HTTP/1.1" status: 200 len: 1096 time: 0.0519190 Dec 09 21:21:50.567025 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2f169963-aea8-422c-a231-cdaee0bd9ffc req-9f418468-f820-4352-bafd-2c837ba8f7d5 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:50.669952 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-f6e9eadc-81ef-4bb0-a9b5-2461e215334d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:50.672407 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-f6e9eadc-81ef-4bb0-a9b5-2461e215334d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 1096 time: 0.0826292 Dec 09 21:21:50.683156 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f418468-f820-4352-bafd-2c837ba8f7d5 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Pushing event deleted for resources: {'Port': ['ID=6d291946-2d01-4e98-9924-23ab0f560c19,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:50.717973 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-2f169963-aea8-422c-a231-cdaee0bd9ffc req-9f418468-f820-4352-bafd-2c837ba8f7d5 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] No DVR routers for this DVR port 6d291946-2d01-4e98-9924-23ab0f560c19 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:21:50.721764 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2f169963-aea8-422c-a231-cdaee0bd9ffc req-9f418468-f820-4352-bafd-2c837ba8f7d5 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:50.725795 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2f169963-aea8-422c-a231-cdaee0bd9ffc req-9f418468-f820-4352-bafd-2c837ba8f7d5 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.31 "DELETE /v2.0/ports/6d291946-2d01-4e98-9924-23ab0f560c19 HTTP/1.1" status: 204 len: 173 time: 1.2695930 Dec 09 21:21:50.726568 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f557bb48-79b5-4aa9-b1e7-72fc54f16eff', 'name': 'network-vif-deleted', 'tag': '6d291946-2d01-4e98-9924-23ab0f560c19'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:21:50.737666 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-107403b1-c912-46ed-86da-7a142f804cfc" -d '{"events": [{"server_uuid": "f557bb48-79b5-4aa9-b1e7-72fc54f16eff", "name": "network-vif-deleted", "tag": "6d291946-2d01-4e98-9924-23ab0f560c19"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:21:50.931064 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:21:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-765b9878-f822-42b2-92bf-08815059df0f x-openstack-request-id: req-765b9878-f822-42b2-92bf-08815059df0f {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:21:50.931541 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f557bb48-79b5-4aa9-b1e7-72fc54f16eff", "name": "network-vif-deleted", "tag": "6d291946-2d01-4e98-9924-23ab0f560c19", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:21:50.939959 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-765b9878-f822-42b2-92bf-08815059df0f {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:21:50.940483 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f557bb48-79b5-4aa9-b1e7-72fc54f16eff', 'name': 'network-vif-deleted', 'tag': '6d291946-2d01-4e98-9924-23ab0f560c19', 'status': 'completed', 'code': 200} Dec 09 21:21:51.066619 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d9e30bc9-a09f-43f2-a02e-91c1dd7a9a15 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:51.211648 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-2d187963-5649-480b-8132-150e75a51551 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:51.214733 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-2d187963-5649-480b-8132-150e75a51551 service neutron] 10.222.0.31 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 908 time: 0.5343161 Dec 09 21:21:51.251554 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6dc8110-6e79-4d68-ab82-2365bfb858b7 req-72fc5df9-5eab-43e5-8239-3849f002f784 tempest-ImagesOneServerTestJSON-1963744715 tempest-ImagesOneServerTestJSON-1963744715-project] 10.222.0.13 "GET /v2.0/ports?device_id=f557bb48-79b5-4aa9-b1e7-72fc54f16eff HTTP/1.1" status: 200 len: 210 time: 0.0690391 Dec 09 21:21:51.378423 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-dffbc809-75a5-4f88-80c3-9e49e9789bec service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=6166c639-9f87-4254-af88-12c4be868be5 HTTP/1.1" status: 200 len: 217 time: 0.1429787 Dec 09 21:21:51.396940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92656bd5-572d-4c08-813f-4d4cf58068af req-1c2de922-0f4c-4a37-861f-1a2d0d79804c tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:51.402335 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-92656bd5-572d-4c08-813f-4d4cf58068af req-1c2de922-0f4c-4a37-861f-1a2d0d79804c tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 944 time: 0.3206115 Dec 09 21:21:51.722235 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-d9e30bc9-a09f-43f2-a02e-91c1dd7a9a15 admin admin] Deleting port 71a637ea-1689-4659-a9f6-a49f876ed699 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:21:51.722868 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d9e30bc9-a09f-43f2-a02e-91c1dd7a9a15 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:51.928849 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-d9e30bc9-a09f-43f2-a02e-91c1dd7a9a15 admin admin] For port 71a637ea-1689-4659-a9f6-a49f876ed699, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=71a637ea-1689-4659-a9f6-a49f876ed699,segment=NetworkSegment(cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9),segment_id=cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:51.929007 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d9e30bc9-a09f-43f2-a02e-91c1dd7a9a15 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:51.965339 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-d9e30bc9-a09f-43f2-a02e-91c1dd7a9a15 admin admin] Calling delete_port for 71a637ea-1689-4659-a9f6-a49f876ed699 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:21:52.090854 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-46f1266f-0d54-4c8c-bfe8-296e3da9c183 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:52.092343 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-46f1266f-0d54-4c8c-bfe8-296e3da9c183 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=eae2438b-9fcc-44ef-a172-6c4911cad13f HTTP/1.1" status: 200 len: 847 time: 0.6899829 Dec 09 21:21:52.239426 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d9e30bc9-a09f-43f2-a02e-91c1dd7a9a15 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:52.250755 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-e8e14792-c81f-46cb-a4d9-a8e71baebfaa service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=04fa749a-9f72-4a2c-a725-feab917f99ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1016936 Dec 09 21:21:52.269904 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9e30bc9-a09f-43f2-a02e-91c1dd7a9a15 admin admin] Pushing event deleted for resources: {'Port': ['ID=71a637ea-1689-4659-a9f6-a49f876ed699,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:52.328693 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-92656bd5-572d-4c08-813f-4d4cf58068af req-567950af-eefb-4a5e-95c2-b33e7e6bd665 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.9035544 Dec 09 21:21:52.499759 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-98dd7847-526f-4e9b-b21a-a4d53f43647a service neutron] 10.222.0.31 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2357752 Dec 09 21:21:52.554129 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e71bf759-e0a0-41a8-93e0-016fa1ef7372 req-6ef7aeea-d932-440a-bdf7-1f3ff24b5106 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:52.572668 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e71bf759-e0a0-41a8-93e0-016fa1ef7372 req-6ef7aeea-d932-440a-bdf7-1f3ff24b5106 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.5027277 Dec 09 21:21:52.631998 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-0ec43584-8124-4fc8-8f1b-1379706c1463 service neutron] 10.222.0.10 "GET /v2.0/ports/e145c03d-6648-46c7-8b51-c9e9acd70ff2/bindings/n-h2-713301-27 HTTP/1.1" status: 200 len: 383 time: 0.5588074 Dec 09 21:21:52.641730 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d9e30bc9-a09f-43f2-a02e-91c1dd7a9a15 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:52.780614 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e71bf759-e0a0-41a8-93e0-016fa1ef7372 req-26c5ce3f-022a-4d11-9412-0c8b507d6daf tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2065372 Dec 09 21:21:52.832766 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6d291946-2d01-4e98-9924-23ab0f560c19 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:21:52.890640 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-989fb8d3-3beb-46b9-92c1-90675d85e1a9 service neutron] 10.222.0.31 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3828783 Dec 09 21:21:52.907782 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 6d291946-2d01-4e98-9924-23ab0f560c19 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:21:52.908129 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6d291946-2d01-4e98-9924-23ab0f560c19 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:21:52.992175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60662) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:21:53.004249 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-00a4924c-20be-49f5-bf9f-07af9b822079 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:53.006352 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-00a4924c-20be-49f5-bf9f-07af9b822079 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b&tenant_id=857de64ecc3946e3b92655f639d782df HTTP/1.1" status: 200 len: 1102 time: 0.0851505 Dec 09 21:21:53.153582 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-422a79b5-6abd-4293-8ffe-708bdf569eca req-0ea9dc72-2693-4aab-8bc5-55dbb2fc5c13 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:53.155256 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-422a79b5-6abd-4293-8ffe-708bdf569eca req-0ea9dc72-2693-4aab-8bc5-55dbb2fc5c13 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2df58aab-ff2e-4d37-87f8-fb38b11756c0 HTTP/1.1" status: 200 len: 946 time: 0.1202054 Dec 09 21:21:53.157457 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-294a06f2-00da-4d46-b6e7-212fe257ec5b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:53.158926 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-294a06f2-00da-4d46-b6e7-212fe257ec5b service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 1102 time: 0.0917072 Dec 09 21:21:53.199741 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d9e30bc9-a09f-43f2-a02e-91c1dd7a9a15 admin admin] Router aa2e8458-6c79-4f94-bedc-deca697e49ed has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:21:53.364752 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-422a79b5-6abd-4293-8ffe-708bdf569eca req-8697dcfa-5937-4b89-8b9a-715adc534ab1 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2024307 Dec 09 21:21:53.394589 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d9e30bc9-a09f-43f2-a02e-91c1dd7a9a15 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:21:53.395696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-2fad02a3-6076-4fea-8418-31aed28d1673 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:53.397236 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-2fad02a3-6076-4fea-8418-31aed28d1673 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2&tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&binding%3Ahost_id=n-h1-713301-27 HTTP/1.1" status: 200 len: 1096 time: 0.1171353 Dec 09 21:21:53.401138 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-df496ce5-951f-41c5-a05d-47403826ad2c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=494d068aa26b47f382490c9700cd369a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4077389 Dec 09 21:21:53.402362 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-43be1869-ec07-4ad2-9c48-e934039c0645 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:53.403828 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-43be1869-ec07-4ad2-9c48-e934039c0645 service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.2322595 Dec 09 21:21:53.403982 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60668) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:21:53.422401 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10e8765d-64e1-4118-ad22-91e07202a9c5 None None] Sync routers for ids ['aa2e8458-6c79-4f94-bedc-deca697e49ed'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:21:53.438488 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10e8765d-64e1-4118-ad22-91e07202a9c5 None None] Routers {'aa2e8458-6c79-4f94-bedc-deca697e49ed'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:21:53.439283 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-10e8765d-64e1-4118-ad22-91e07202a9c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:21:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['aa2e8458-6c79-4f94-bedc-deca697e49ed'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:21:53.450401 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d9e30bc9-a09f-43f2-a02e-91c1dd7a9a15 admin admin] 10.222.0.13 "PUT /v2.0/routers/aa2e8458-6c79-4f94-bedc-deca697e49ed/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.9921200 Dec 09 21:21:53.451362 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60672) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:21:53.493974 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-7b43ca76-4a64-48a4-8d66-242b3cc2de56 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.184&port_id=e145c03d-6648-46c7-8b51-c9e9acd70ff2 HTTP/1.1" status: 200 len: 217 time: 0.0821946 Dec 09 21:21:53.563059 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-10e8765d-64e1-4118-ad22-91e07202a9c5 None None] Set router aa2e8458-6c79-4f94-bedc-deca697e49ed gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:21:53.607423 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cca0c4c1-6d4f-4859-8aa2-50773d837a89 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:53.631164 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-589c4d91-ebff-4fd1-9231-9de32ffaa8e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:53.632611 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-589c4d91-ebff-4fd1-9231-9de32ffaa8e9 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1261680 Dec 09 21:21:53.648707 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeea60da-72e2-4086-b338-84a4354ff675 req-b0bdcff4-95ad-4d21-b389-c89df2946517 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:53.650327 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aeea60da-72e2-4086-b338-84a4354ff675 req-b0bdcff4-95ad-4d21-b389-c89df2946517 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 944 time: 0.1619880 Dec 09 21:21:53.693825 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cca0c4c1-6d4f-4859-8aa2-50773d837a89 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:53.719962 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a00d4b1-a817-4f70-a76e-5d48771cb894 admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:53.809089 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-10e8765d-64e1-4118-ad22-91e07202a9c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'aa2e8458-6c79-4f94-bedc-deca697e49ed', 'name': 'tempest-AttachSCSIVolumeTestJSON-882207386-router', 'tenant_id': '638a9d4528c04bcc89501243ebdb6eda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.46'}], 'enable_snat': True}, 'gw_port_id': 'f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:19:44Z', 'updated_at': '2021-12-09T21:21:52Z', 'revision_number': 5, 'project_id': '638a9d4528c04bcc89501243ebdb6eda', 'gw_port': {'id': 'f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:33:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa2e8458-6c79-4f94-bedc-deca697e49ed', 'device_owner': 'network:router_gateway', 'standard_attr_id': 513, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:19:46Z', 'updated_at': '2021-12-09T21:19:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:21:53.864302 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10e8765d-64e1-4118-ad22-91e07202a9c5 None None] Checking router: aa2e8458-6c79-4f94-bedc-deca697e49ed for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:21:53.874877 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10e8765d-64e1-4118-ad22-91e07202a9c5 None None] Routers {'aa2e8458-6c79-4f94-bedc-deca697e49ed'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:21:53.876463 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-10e8765d-64e1-4118-ad22-91e07202a9c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:21:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['aa2e8458-6c79-4f94-bedc-deca697e49ed'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:21:53.975229 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cca0c4c1-6d4f-4859-8aa2-50773d837a89 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:53.978208 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cca0c4c1-6d4f-4859-8aa2-50773d837a89 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:53.984319 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cca0c4c1-6d4f-4859-8aa2-50773d837a89 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/836eb753-a7a8-4b32-9ae9-0184b8831ca8 HTTP/1.1" status: 204 len: 168 time: 0.5767658 Dec 09 21:21:53.997758 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cca0c4c1-6d4f-4859-8aa2-50773d837a89 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=836eb753-a7a8-4b32-9ae9-0184b8831ca8,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:54.000591 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a00d4b1-a817-4f70-a76e-5d48771cb894 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:54.003368 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-10e8765d-64e1-4118-ad22-91e07202a9c5 None None] Set router aa2e8458-6c79-4f94-bedc-deca697e49ed gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:21:54.149639 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-5a00d4b1-a817-4f70-a76e-5d48771cb894 admin admin] Deleting port f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:21:54.151189 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a00d4b1-a817-4f70-a76e-5d48771cb894 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:54.159614 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-adb3efa5-2991-43b0-a5bb-32d92cc0a66d service neutron] For port 6166c639-9f87-4254-af88-12c4be868be5, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:21:54.163122 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-a72730df-2146-40f2-aead-6669f6987fd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:54.164975 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-a72730df-2146-40f2-aead-6669f6987fd4 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.5136027 Dec 09 21:21:54.173249 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-adb3efa5-2991-43b0-a5bb-32d92cc0a66d service neutron] Publish callbacks [] for binding, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:54.174730 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8475a8d3-77c0-479f-9c60-b7bbd3863de4 req-adb3efa5-2991-43b0-a5bb-32d92cc0a66d service neutron] 10.222.0.31 "DELETE /v2.0/ports/6166c639-9f87-4254-af88-12c4be868be5/bindings/n-h2-713301-27 HTTP/1.1" status: 204 len: 173 time: 0.7681444 Dec 09 21:21:54.195534 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aeea60da-72e2-4086-b338-84a4354ff675 req-d8b42454-a29b-4ab5-8cae-45dede1e6a6c tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5326569 Dec 09 21:21:54.235520 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6c8d557-ae31-4bce-b280-c6d62a9f61b1 req-49718b03-148b-4527-b959-87ace824f7b9 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:54.240734 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c6c8d557-ae31-4bce-b280-c6d62a9f61b1 req-49718b03-148b-4527-b959-87ace824f7b9 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.3066695 Dec 09 21:21:54.350757 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-5a00d4b1-a817-4f70-a76e-5d48771cb894 admin admin] For port f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:54.351300 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a00d4b1-a817-4f70-a76e-5d48771cb894 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:54.375565 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-5a00d4b1-a817-4f70-a76e-5d48771cb894 admin admin] Calling delete_port for f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:21:54.411108 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c6c8d557-ae31-4bce-b280-c6d62a9f61b1 req-5540dec2-70e6-4b79-970f-990d3684b9fd tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1568303 Dec 09 21:21:54.431744 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-e32246ce-9bdc-4d45-91fa-96a0ea2e5b0c service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2553926 Dec 09 21:21:54.488537 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-10e8765d-64e1-4118-ad22-91e07202a9c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'aa2e8458-6c79-4f94-bedc-deca697e49ed', 'name': 'tempest-AttachSCSIVolumeTestJSON-882207386-router', 'tenant_id': '638a9d4528c04bcc89501243ebdb6eda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.46'}], 'enable_snat': True}, 'gw_port_id': 'f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:19:44Z', 'updated_at': '2021-12-09T21:21:52Z', 'revision_number': 5, 'project_id': '638a9d4528c04bcc89501243ebdb6eda', 'gw_port': {'id': 'f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:33:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa2e8458-6c79-4f94-bedc-deca697e49ed', 'device_owner': 'network:router_gateway', 'standard_attr_id': 513, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:19:46Z', 'updated_at': '2021-12-09T21:19:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:21:54.584618 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10e8765d-64e1-4118-ad22-91e07202a9c5 None None] The sync data for ids ['aa2e8458-6c79-4f94-bedc-deca697e49ed'] in n-d-713301-27 is: [{'id': 'aa2e8458-6c79-4f94-bedc-deca697e49ed', 'name': 'tempest-AttachSCSIVolumeTestJSON-882207386-router', 'tenant_id': '638a9d4528c04bcc89501243ebdb6eda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.46'}], 'enable_snat': True}, 'gw_port_id': 'f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:19:44Z', 'updated_at': '2021-12-09T21:21:52Z', 'revision_number': 5, 'project_id': '638a9d4528c04bcc89501243ebdb6eda', 'gw_port': {'id': 'f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:42:33:27', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa2e8458-6c79-4f94-bedc-deca697e49ed', 'device_owner': 'network:router_gateway', 'standard_attr_id': 513, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.46', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:19:46Z', 'updated_at': '2021-12-09T21:19:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:21:54.696549 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a00d4b1-a817-4f70-a76e-5d48771cb894 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:54.773988 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a00d4b1-a817-4f70-a76e-5d48771cb894 admin admin] Pushing event deleted for resources: {'Port': ['ID=f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:54.784225 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b252c60-22ad-4556-b2ff-821d7f27a72d req-50cac546-abb0-4291-b75e-a68dc2bf7826 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3442013 Dec 09 21:21:54.812637 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0863a9ec-5370-4b87-9b93-503d6c6cd777 req-86af5808-ed89-4c7e-9444-a9e1d7862dbe tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:54.831880 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0863a9ec-5370-4b87-9b93-503d6c6cd777 req-86af5808-ed89-4c7e-9444-a9e1d7862dbe tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 1096 time: 0.2397172 Dec 09 21:21:54.833214 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e145c03d-6648-46c7-8b51-c9e9acd70ff2 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:21:54.910206 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a00d4b1-a817-4f70-a76e-5d48771cb894 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:54.974922 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0863a9ec-5370-4b87-9b93-503d6c6cd777 req-56c34781-b7e3-407d-b4c5-37dd4c1b8490 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1337049 Dec 09 21:21:55.146227 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:55.180842 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a00d4b1-a817-4f70-a76e-5d48771cb894 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:55.184360 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a00d4b1-a817-4f70-a76e-5d48771cb894 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:55.269161 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a00d4b1-a817-4f70-a76e-5d48771cb894 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:55.269865 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8bbb9251-ec6e-45d8-b751-2b2b490cbe3b', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e145c03d-6648-46c7-8b51-c9e9acd70ff2'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:21:55.270468 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5a00d4b1-a817-4f70-a76e-5d48771cb894 admin admin] Fanout notify agent at l3_agent the message router_deleted on router aa2e8458-6c79-4f94-bedc-deca697e49ed {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:21:55.275047 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-17bbc704-799b-4663-831f-a1a8272d2479" -d '{"events": [{"server_uuid": "8bbb9251-ec6e-45d8-b751-2b2b490cbe3b", "name": "network-vif-unplugged", "status": "completed", "tag": "e145c03d-6648-46c7-8b51-c9e9acd70ff2"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:21:55.282225 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a00d4b1-a817-4f70-a76e-5d48771cb894 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:55.284984 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5a00d4b1-a817-4f70-a76e-5d48771cb894 admin admin] 10.222.0.13 "DELETE /v2.0/routers/aa2e8458-6c79-4f94-bedc-deca697e49ed HTTP/1.1" status: 204 len: 168 time: 1.8272326 Dec 09 21:21:55.287786 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60722) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:21:55.288405 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e90c66f-10ed-44bd-9dc5-58f40ab5e491 req-a39a9f9a-73b1-4cf3-866c-ffd793f12745 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:55.292485 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8e90c66f-10ed-44bd-9dc5-58f40ab5e491 req-a39a9f9a-73b1-4cf3-866c-ffd793f12745 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2df58aab-ff2e-4d37-87f8-fb38b11756c0 HTTP/1.1" status: 200 len: 946 time: 0.1721282 Dec 09 21:21:55.305053 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af5f9044-19aa-4ec0-9f94-29d24aa6c116 req-7c09bfd9-afe0-4add-a5db-2dc54e6e9ee4 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:55.317837 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af5f9044-19aa-4ec0-9f94-29d24aa6c116 req-7c09bfd9-afe0-4add-a5db-2dc54e6e9ee4 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 1096 time: 0.1159120 Dec 09 21:21:55.332107 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port e145c03d-6648-46c7-8b51-c9e9acd70ff2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e145c03d-6648-46c7-8b51-c9e9acd70ff2,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:55.348573 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:55.383220 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-eb325102-5dc8-4fdc-8d8e-1cdb6289a012 admin admin] Deleting subnet 1caf9086-38c1-45a4-b64b-d3475b50f4b1 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:21:55.392021 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb325102-5dc8-4fdc-8d8e-1cdb6289a012 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:55.425027 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=e145c03d-6648-46c7-8b51-c9e9acd70ff2,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:55.474012 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb325102-5dc8-4fdc-8d8e-1cdb6289a012 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:55.513712 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8e90c66f-10ed-44bd-9dc5-58f40ab5e491 req-7abfcb7d-c9c4-4c28-84f6-064d8bc13f25 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1937718 Dec 09 21:21:55.520806 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af5f9044-19aa-4ec0-9f94-29d24aa6c116 req-95e7289a-8a0a-4802-8d01-5e979489871a tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2021012 Dec 09 21:21:55.615474 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60738) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:21:55.624808 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:21:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f0b7f4db-185d-4fdc-8416-8e139d2b3fce x-openstack-request-id: req-f0b7f4db-185d-4fdc-8416-8e139d2b3fce {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:21:55.625778 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8bbb9251-ec6e-45d8-b751-2b2b490cbe3b", "name": "network-vif-unplugged", "status": "completed", "tag": "e145c03d-6648-46c7-8b51-c9e9acd70ff2", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:21:55.626857 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f0b7f4db-185d-4fdc-8416-8e139d2b3fce {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:21:55.627855 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8bbb9251-ec6e-45d8-b751-2b2b490cbe3b', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e145c03d-6648-46c7-8b51-c9e9acd70ff2', 'code': 200} Dec 09 21:21:55.745522 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb325102-5dc8-4fdc-8d8e-1cdb6289a012 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:55.859543 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-10880e87-a3bb-404e-8802-e8f014c52d78 admin admin] Request body: {'network': {'name': 'tempest-ServersTestManualDisk-255636487-network', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:21:55.871495 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb325102-5dc8-4fdc-8d8e-1cdb6289a012 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:55.906367 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb325102-5dc8-4fdc-8d8e-1cdb6289a012 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:55.912383 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-eb325102-5dc8-4fdc-8d8e-1cdb6289a012 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/1caf9086-38c1-45a4-b64b-d3475b50f4b1 HTTP/1.1" status: 204 len: 168 time: 0.6206927 Dec 09 21:21:55.912383 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb325102-5dc8-4fdc-8d8e-1cdb6289a012 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1caf9086-38c1-45a4-b64b-d3475b50f4b1,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:55.913728 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60752) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:21:55.928211 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c260dc7-e958-4b17-ae59-da00b3a64a7e None None] Network 8d988748-159b-463d-bdf5-500e0ea1b879 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:21:55.949431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-80400593-9824-4f0d-bd5c-e3f392b0d703 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:55.951136 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-80400593-9824-4f0d-bd5c-e3f392b0d703 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 821 time: 0.2609546 Dec 09 21:21:55.972265 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-10880e87-a3bb-404e-8802-e8f014c52d78 admin admin] Made reservation on behalf of 2429d4a7c27042e7ab6a04a9cf722b47 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:21:55.974647 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-10880e87-a3bb-404e-8802-e8f014c52d78 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:55.984630 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-10880e87-a3bb-404e-8802-e8f014c52d78 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:55.993695 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a88eafc3-c527-4499-94e2-a2bf22f9346b req-8cac3774-7277-493f-b417-40dc61c3ae74 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:55.996101 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a88eafc3-c527-4499-94e2-a2bf22f9346b req-8cac3774-7277-493f-b417-40dc61c3ae74 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 948 time: 0.1257656 Dec 09 21:21:56.000346 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-db5e9a83-818b-4110-b3fb-413a93743527 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/quotas/a306d2242b1e41c892f63c7b122cdee4 HTTP/1.1" status: 200 len: 375 time: 0.0415604 Dec 09 21:21:56.030842 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b7280450-e9c8-4a78-ad70-a64f5b495aad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:56.097141 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-b7280450-e9c8-4a78-ad70-a64f5b495aad admin admin] Deleting port a16da251-6252-45d6-bcbb-fb07065870ab {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:21:56.099472 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b7280450-e9c8-4a78-ad70-a64f5b495aad admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:56.158371 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-43a47469-3ae4-4ab9-96d3-32bed120e00e tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1492953 Dec 09 21:21:56.184678 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a88eafc3-c527-4499-94e2-a2bf22f9346b req-e443c65b-03ce-4b61-954e-982e2d59691d tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1639662 Dec 09 21:21:56.210410 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 71a637ea-1689-4659-a9f6-a49f876ed699 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:21:56.271733 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4121fb52-063a-4483-b9db-7469a463fad2 None None] DHCP port deletion for 8d988748-159b-463d-bdf5-500e0ea1b879 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:21:56.274399 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 71a637ea-1689-4659-a9f6-a49f876ed699 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:21:56.275036 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 71a637ea-1689-4659-a9f6-a49f876ed699 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:21:56.315722 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-b7280450-e9c8-4a78-ad70-a64f5b495aad admin admin] For port a16da251-6252-45d6-bcbb-fb07065870ab, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a16da251-6252-45d6-bcbb-fb07065870ab,segment=NetworkSegment(cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9),segment_id=cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:56.316078 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b7280450-e9c8-4a78-ad70-a64f5b495aad admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:56.334637 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-b7280450-e9c8-4a78-ad70-a64f5b495aad admin admin] Calling delete_port for a16da251-6252-45d6-bcbb-fb07065870ab owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:21:56.346854 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-4121fb52-063a-4483-b9db-7469a463fad2 None None] Deleting port a16da251-6252-45d6-bcbb-fb07065870ab {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:21:56.347231 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4121fb52-063a-4483-b9db-7469a463fad2 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:56.402886 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-10880e87-a3bb-404e-8802-e8f014c52d78 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:56.421433 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-10880e87-a3bb-404e-8802-e8f014c52d78 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:56.426498 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-4121fb52-063a-4483-b9db-7469a463fad2 None None] For port a16da251-6252-45d6-bcbb-fb07065870ab, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a16da251-6252-45d6-bcbb-fb07065870ab,segment=NetworkSegment(cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9),segment_id=cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:56.427651 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4121fb52-063a-4483-b9db-7469a463fad2 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:56.443740 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-4121fb52-063a-4483-b9db-7469a463fad2 None None] Calling delete_port for a16da251-6252-45d6-bcbb-fb07065870ab owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:21:56.454488 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10880e87-a3bb-404e-8802-e8f014c52d78 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=25ccb671-1195-4405-86b6-3eebd3a51ec7,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:56.488248 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-10880e87-a3bb-404e-8802-e8f014c52d78 admin admin] vlan segment allocate from pool success with {'vlan_id': 124, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:21:56.496297 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b7280450-e9c8-4a78-ad70-a64f5b495aad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:56.509721 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-290fae99-6cb3-4f1f-add3-bc29226e664b req-8e9b3820-9359-4160-adc3-89e6dd469981 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:56.512565 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-290fae99-6cb3-4f1f-add3-bc29226e664b req-8e9b3820-9359-4160-adc3-89e6dd469981 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.31 "GET /v2.0/ports?device_id=2df58aab-ff2e-4d37-87f8-fb38b11756c0 HTTP/1.1" status: 200 len: 946 time: 0.1391046 Dec 09 21:21:56.516458 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-3cfd819e-c6de-46ec-95c2-07c6d7425b76 service neutron] 10.222.0.13 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3433461 Dec 09 21:21:56.519976 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-10880e87-a3bb-404e-8802-e8f014c52d78 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:56.521002 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-10880e87-a3bb-404e-8802-e8f014c52d78 admin admin] Added segment e74944d5-8114-4627-bc98-88385d8b16f0 of type vlan for network 6b0e1b89-20b6-4a70-94cb-58b2b1f77a20 Dec 09 21:21:56.586395 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7280450-e9c8-4a78-ad70-a64f5b495aad admin admin] Pushing event deleted for resources: {'Port': ['ID=a16da251-6252-45d6-bcbb-fb07065870ab,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:56.588579 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7280450-e9c8-4a78-ad70-a64f5b495aad admin admin] No DVR routers for this DVR port a16da251-6252-45d6-bcbb-fb07065870ab on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:21:56.604159 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4121fb52-063a-4483-b9db-7469a463fad2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:56.660733 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-bc36e7e3-92df-4a0d-80b8-2b8901ca3fd6 service neutron] 10.222.0.13 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1146870 Dec 09 21:21:56.698668 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4121fb52-063a-4483-b9db-7469a463fad2 None None] Pushing event deleted for resources: {'Port': ['ID=a16da251-6252-45d6-bcbb-fb07065870ab,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:56.702399 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4121fb52-063a-4483-b9db-7469a463fad2 None None] No DVR routers for this DVR port a16da251-6252-45d6-bcbb-fb07065870ab on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:21:56.770578 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-10880e87-a3bb-404e-8802-e8f014c52d78 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:56.834748 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b7280450-e9c8-4a78-ad70-a64f5b495aad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:56.873741 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-10880e87-a3bb-404e-8802-e8f014c52d78 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:56.874963 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-10880e87-a3bb-404e-8802-e8f014c52d78 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:56.875722 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-10880e87-a3bb-404e-8802-e8f014c52d78 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:56.925483 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-b7280450-e9c8-4a78-ad70-a64f5b495aad admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8d988748-159b-463d-bdf5-500e0ea1b879']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:21:56.950100 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-b7280450-e9c8-4a78-ad70-a64f5b495aad admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:21:56.950506 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-b7280450-e9c8-4a78-ad70-a64f5b495aad admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cf9b1ea5-ae71-40f5-ba2d-393c5d2ca3f9') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:21:56.974894 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:56.981084 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b7280450-e9c8-4a78-ad70-a64f5b495aad admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:57.027393 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b7280450-e9c8-4a78-ad70-a64f5b495aad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:57.029038 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10880e87-a3bb-404e-8802-e8f014c52d78 admin admin] Pushing event updated for resources: {'Network': ['ID=6b0e1b89-20b6-4a70-94cb-58b2b1f77a20,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:57.044680 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 6b0e1b89-20b6-4a70-94cb-58b2b1f77a20 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:21:57.046003 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b7280450-e9c8-4a78-ad70-a64f5b495aad admin admin] Releasing vlan 106 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:21:57.046448 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b7280450-e9c8-4a78-ad70-a64f5b495aad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:21:57.077034 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:21:57.098275 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-290fae99-6cb3-4f1f-add3-bc29226e664b req-9dd98d5d-eb01-41bc-9361-5b99c92ce73f tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Deleting port 80dde595-a3d7-4c03-aa66-d9fc5b2f340c {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:21:57.099071 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-290fae99-6cb3-4f1f-add3-bc29226e664b req-9dd98d5d-eb01-41bc-9361-5b99c92ce73f tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:57.106451 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:57.156908 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b7280450-e9c8-4a78-ad70-a64f5b495aad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:57.204700 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b7280450-e9c8-4a78-ad70-a64f5b495aad admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:57.227232 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-10880e87-a3bb-404e-8802-e8f014c52d78 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 1.6106362 Dec 09 21:21:57.237431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60776) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:21:57.239953 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b7280450-e9c8-4a78-ad70-a64f5b495aad admin admin] 10.222.0.13 "DELETE /v2.0/networks/8d988748-159b-463d-bdf5-500e0ea1b879 HTTP/1.1" status: 204 len: 168 time: 1.3198543 Dec 09 21:21:57.243490 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7280450-e9c8-4a78-ad70-a64f5b495aad admin admin] Pushing event deleted for resources: {'Network': ['ID=8d988748-159b-463d-bdf5-500e0ea1b879,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:57.257076 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-2d8a8868-625b-43f7-9724-e41386167f42 admin admin] Request body: {'subnet': {'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestManualDisk-255636487-subnet', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:21:57.274227 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-290fae99-6cb3-4f1f-add3-bc29226e664b req-9dd98d5d-eb01-41bc-9361-5b99c92ce73f tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] For port 80dde595-a3d7-4c03-aa66-d9fc5b2f340c, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=80dde595-a3d7-4c03-aa66-d9fc5b2f340c,segment=NetworkSegment(946d0405-6c7f-49a7-81bb-30e422c98100),segment_id=946d0405-6c7f-49a7-81bb-30e422c98100)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:57.274777 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-290fae99-6cb3-4f1f-add3-bc29226e664b req-9dd98d5d-eb01-41bc-9361-5b99c92ce73f tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:57.469267 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60790) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:21:57.572993 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-145be3a6-d618-497b-ab37-dd1e51d9ebb7 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=913fcb9b5aab4356999ade167d5148c6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1021161 Dec 09 21:21:57.575758 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60796) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:21:57.647234 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ced91ed2-6d68-45f9-8ceb-244917fd8d70 req-6e97ba21-7d7c-44bf-b413-0a3fe3d46803 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:57.668927 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-62415bb3-1ff8-49d6-bb2e-73b142006b73 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:57.669179 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ced91ed2-6d68-45f9-8ceb-244917fd8d70 req-6e97ba21-7d7c-44bf-b413-0a3fe3d46803 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2df58aab-ff2e-4d37-87f8-fb38b11756c0 HTTP/1.1" status: 200 len: 946 time: 0.6681044 Dec 09 21:21:57.695789 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-62415bb3-1ff8-49d6-bb2e-73b142006b73 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:57.737848 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2d8a8868-625b-43f7-9724-e41386167f42 admin admin] Made reservation on behalf of 2429d4a7c27042e7ab6a04a9cf722b47 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:21:57.740365 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2d8a8868-625b-43f7-9724-e41386167f42 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:57.781393 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-62415bb3-1ff8-49d6-bb2e-73b142006b73 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:57.784375 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-62415bb3-1ff8-49d6-bb2e-73b142006b73 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:57.796251 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-62415bb3-1ff8-49d6-bb2e-73b142006b73 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/dea88e67-805c-4990-af94-aeeaf2d8e160 HTTP/1.1" status: 204 len: 168 time: 0.2145045 Dec 09 21:21:57.823337 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62415bb3-1ff8-49d6-bb2e-73b142006b73 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dea88e67-805c-4990-af94-aeeaf2d8e160,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:57.891325 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a16da251-6252-45d6-bcbb-fb07065870ab no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:21:57.899550 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ced91ed2-6d68-45f9-8ceb-244917fd8d70 req-ae92a93c-bf01-4131-a63a-ac13f3f83b76 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups?id=9798184d-82ec-4464-b3fc-95653513aba7&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2032583 Dec 09 21:21:57.951237 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: a16da251-6252-45d6-bcbb-fb07065870ab {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:21:57.951622 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a16da251-6252-45d6-bcbb-fb07065870ab not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:21:57.952047 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:21:58.011690 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:21:58.012425 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f3c7178f-9bb3-4c3a-b5c5-8d204ebeef24 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:21:58.059208 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-533fff87-5428-49ab-9a64-3499dcef3ee1 req-16620b26-4344-422d-951d-259cfe970e3c tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:58.061064 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-533fff87-5428-49ab-9a64-3499dcef3ee1 req-16620b26-4344-422d-951d-259cfe970e3c tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 948 time: 0.4448795 Dec 09 21:21:58.098244 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-290fae99-6cb3-4f1f-add3-bc29226e664b req-9dd98d5d-eb01-41bc-9361-5b99c92ce73f tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:58.098795 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-290fae99-6cb3-4f1f-add3-bc29226e664b req-9dd98d5d-eb01-41bc-9361-5b99c92ce73f tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:58.099256 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [req-290fae99-6cb3-4f1f-add3-bc29226e664b req-9dd98d5d-eb01-41bc-9361-5b99c92ce73f tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Floating IP 607e8ba4-01a4-4741-a885-8732f6aacd9f disassociated. External IP: 172.25.3.108, port: 80dde595-a3d7-4c03-aa66-d9fc5b2f340c. Dec 09 21:21:58.099624 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-290fae99-6cb3-4f1f-add3-bc29226e664b req-9dd98d5d-eb01-41bc-9361-5b99c92ce73f tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Calling delete_port for 80dde595-a3d7-4c03-aa66-d9fc5b2f340c owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:21:58.133672 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f66fbb0-07a3-467c-a997-65718e7dbd6d req-297c84cf-e6a5-4f4c-b36c-9c76e763b625 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 210 time: 0.1341457 Dec 09 21:21:58.252447 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-533fff87-5428-49ab-9a64-3499dcef3ee1 req-97bf2db7-9f58-4175-a133-b25564be0d02 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1598530 Dec 09 21:21:58.412704 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2d8a8868-625b-43f7-9724-e41386167f42 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:58.515768 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d8a8868-625b-43f7-9724-e41386167f42 admin admin] Pushing event updated for resources: {'Subnet': ['ID=069b1784-6c14-42f6-a10c-b0d4447b6091,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:58.523694 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-290fae99-6cb3-4f1f-add3-bc29226e664b req-9dd98d5d-eb01-41bc-9361-5b99c92ce73f tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:58.572939 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dd98d5d-eb01-41bc-9361-5b99c92ce73f tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Pushing event deleted for resources: {'Port': ['ID=80dde595-a3d7-4c03-aa66-d9fc5b2f340c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:58.582344 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2d8a8868-625b-43f7-9724-e41386167f42 admin admin] Checking segment: {'id': 'e74944d5-8114-4627-bc98-88385d8b16f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:21:58.582629 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d8a8868-625b-43f7-9724-e41386167f42 admin admin] Network hostable DHCP agents. Network: 6b0e1b89-20b6-4a70-94cb-58b2b1f77a20, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:21:58.696118 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60820) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:21:58.776545 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8a1fa97d-6aa8-464a-a47d-1c7493eecb49 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=638a9d4528c04bcc89501243ebdb6eda&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0784247 Dec 09 21:21:58.779216 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60824) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:21:58.843741 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e145c03d-6648-46c7-8b51-c9e9acd70ff2 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:21:58.912733 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70efeebd-3830-46a0-8a98-4f8215c79fb5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:58.990183 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70efeebd-3830-46a0-8a98-4f8215c79fb5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:59.097577 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70efeebd-3830-46a0-8a98-4f8215c79fb5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:59.103012 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70efeebd-3830-46a0-8a98-4f8215c79fb5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:59.111502 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-70efeebd-3830-46a0-8a98-4f8215c79fb5 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/fc11eea2-09b0-4d07-acd7-a78f1f8d99c1 HTTP/1.1" status: 204 len: 168 time: 0.3279202 Dec 09 21:21:59.134617 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port e145c03d-6648-46c7-8b51-c9e9acd70ff2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e145c03d-6648-46c7-8b51-c9e9acd70ff2,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:59.150482 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70efeebd-3830-46a0-8a98-4f8215c79fb5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fc11eea2-09b0-4d07-acd7-a78f1f8d99c1,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:59.192787 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'e145c03d-6648-46c7-8b51-c9e9acd70ff2', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': 'e145c03d-6648-46c7-8b51-c9e9acd70ff2', 'mac_address': 'fa:16:3e:ef:72:31', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.184'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:21:59.344142 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:59.368732 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b6e2314-d9aa-4efe-aa3e-bf5880bc3f26 req-e6fa278f-0541-4de7-8172-095837f81ccd tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2df58aab-ff2e-4d37-87f8-fb38b11756c0 HTTP/1.1" status: 200 len: 210 time: 0.1771741 Dec 09 21:21:59.381505 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e145c03d-6648-46c7-8b51-c9e9acd70ff2 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:21:59.436788 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port e145c03d-6648-46c7-8b51-c9e9acd70ff2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e145c03d-6648-46c7-8b51-c9e9acd70ff2,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:21:59.450423 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:59.584560 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=e145c03d-6648-46c7-8b51-c9e9acd70ff2,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:21:59.589414 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc9384db-b102-4974-b024-f8bb5b99cf1f req-e8da4d11-5491-4881-83db-4cfc2046eaf5 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 210 time: 0.1059773 Dec 09 21:21:59.658413 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d8a8868-625b-43f7-9724-e41386167f42 admin admin] Network 6b0e1b89-20b6-4a70-94cb-58b2b1f77a20 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:21:59.699849 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-2d8a8868-625b-43f7-9724-e41386167f42 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 6b0e1b89-20b6-4a70-94cb-58b2b1f77a20) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:21:59.712802 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49e7f5f0-d34e-413a-bc99-6c1b253dfa20 None None] Network 6b0e1b89-20b6-4a70-94cb-58b2b1f77a20 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:21:59.715725 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95e1b5d7-5151-434b-a17b-36d226e5c3a5 req-ef6d8c2d-a94d-45e8-a363-7b1b9a50ff02 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:59.724752 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-95e1b5d7-5151-434b-a17b-36d226e5c3a5 req-ef6d8c2d-a94d-45e8-a363-7b1b9a50ff02 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 948 time: 0.3778312 Dec 09 21:21:59.746471 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-416abdcf-3ec2-4f75-8dad-5b2bc332ff72 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:59.751369 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-416abdcf-3ec2-4f75-8dad-5b2bc332ff72 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.10 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b&tenant_id=857de64ecc3946e3b92655f639d782df&binding%3Ahost_id=n-h2-713301-27 HTTP/1.1" status: 200 len: 948 time: 0.4450617 Dec 09 21:21:59.764960 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['e145c03d-6648-46c7-8b51-c9e9acd70ff2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:21:59.773029 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2d8a8868-625b-43f7-9724-e41386167f42 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:21:59.777944 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2d8a8868-625b-43f7-9724-e41386167f42 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:59.845060 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [req-290fae99-6cb3-4f1f-add3-bc29226e664b req-9dd98d5d-eb01-41bc-9361-5b99c92ce73f tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Router 3b833388-9a85-4de2-9ce7-fd22b400c313 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:21:59.866799 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2d8a8868-625b-43f7-9724-e41386167f42 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 2.6267874 Dec 09 21:21:59.869892 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60848) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:21:59.875148 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-f9bbeca0-4ef9-48ff-9c3f-b2b1721c989c admin admin] Request body: {'router': {'name': 'tempest-ServersTestManualDisk-255636487-router', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:21:59.936005 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f9bbeca0-4ef9-48ff-9c3f-b2b1721c989c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:21:59.941637 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f9bbeca0-4ef9-48ff-9c3f-b2b1721c989c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:00.113500 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f9bbeca0-4ef9-48ff-9c3f-b2b1721c989c admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:00.251740 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-23040a99-c9b7-46ae-8f01-c6863d91749d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:00.264276 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-23040a99-c9b7-46ae-8f01-c6863d91749d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.10 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 821 time: 1.0264990 Dec 09 21:22:00.290824 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-95080804-da51-4dc2-a370-96f18b095feb service neutron] 10.222.0.10 "GET /v2.0/ports/e145c03d-6648-46c7-8b51-c9e9acd70ff2/bindings/n-h2-713301-27 HTTP/1.1" status: 200 len: 383 time: 0.4810512 Dec 09 21:22:00.300120 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aaba0e90-99e5-4ee1-9f3d-8fbc7df27611 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-6b0e1b89-20b6-4a70-94cb-58b2b1f77a20', 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20', 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'fixed_ips': [{'subnet_id': '069b1784-6c14-42f6-a10c-b0d4447b6091'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:22:00.304336 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aaba0e90-99e5-4ee1-9f3d-8fbc7df27611 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:00.443829 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-14013783-fe02-444b-91e7-204bffecb89c tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Request body: {'port': {'device_id': '5105efab-9ee1-4a74-9a45-e77c38549362', 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c', 'admin_state_up': True, 'tenant_id': 'a306d2242b1e41c892f63c7b122cdee4'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:22:00.451307 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-95e1b5d7-5151-434b-a17b-36d226e5c3a5 req-c512511b-ba84-47f7-a59e-7abca9fa4adf tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7251992 Dec 09 21:22:00.453306 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-290fae99-6cb3-4f1f-add3-bc29226e664b req-9dd98d5d-eb01-41bc-9361-5b99c92ce73f tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:22:00.556776 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-290fae99-6cb3-4f1f-add3-bc29226e664b req-9dd98d5d-eb01-41bc-9361-5b99c92ce73f tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] No DVR routers for this DVR port 80dde595-a3d7-4c03-aa66-d9fc5b2f340c on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:22:00.563358 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-290fae99-6cb3-4f1f-add3-bc29226e664b req-9dd98d5d-eb01-41bc-9361-5b99c92ce73f tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:00.567107 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-290fae99-6cb3-4f1f-add3-bc29226e664b req-9dd98d5d-eb01-41bc-9361-5b99c92ce73f tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.31 "DELETE /v2.0/ports/80dde595-a3d7-4c03-aa66-d9fc5b2f340c HTTP/1.1" status: 204 len: 173 time: 4.0436587 Dec 09 21:22:00.568641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2df58aab-ff2e-4d37-87f8-fb38b11756c0', 'name': 'network-vif-deleted', 'tag': '80dde595-a3d7-4c03-aa66-d9fc5b2f340c'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:22:00.571310 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dcf89e7b-b085-4ad1-b515-da6d31ad1f98" -d '{"events": [{"server_uuid": "2df58aab-ff2e-4d37-87f8-fb38b11756c0", "name": "network-vif-deleted", "tag": "80dde595-a3d7-4c03-aa66-d9fc5b2f340c"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:22:00.690030 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f9bbeca0-4ef9-48ff-9c3f-b2b1721c989c admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:00.728206 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:22:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0e10561c-3662-43cb-9c2b-37cd0cdac993 x-openstack-request-id: req-0e10561c-3662-43cb-9c2b-37cd0cdac993 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:22:00.743912 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2df58aab-ff2e-4d37-87f8-fb38b11756c0", "name": "network-vif-deleted", "tag": "80dde595-a3d7-4c03-aa66-d9fc5b2f340c", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:22:00.744437 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0e10561c-3662-43cb-9c2b-37cd0cdac993 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:22:00.745053 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2df58aab-ff2e-4d37-87f8-fb38b11756c0', 'name': 'network-vif-deleted', 'tag': '80dde595-a3d7-4c03-aa66-d9fc5b2f340c', 'status': 'completed', 'code': 200} Dec 09 21:22:00.747961 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-027bcaaa-6c0a-4c1f-b1cd-621785ce74e3 None None] Sync routers for ids ['3b833388-9a85-4de2-9ce7-fd22b400c313'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:22:00.760369 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4c10289-b4b8-4098-8b8f-2aa1482d4ac6 req-bd3dadde-1907-4904-a893-c4a8c20ef610 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/ports?device_id=2df58aab-ff2e-4d37-87f8-fb38b11756c0 HTTP/1.1" status: 200 len: 210 time: 0.1125016 Dec 09 21:22:00.809890 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-027bcaaa-6c0a-4c1f-b1cd-621785ce74e3 None None] Routers {'3b833388-9a85-4de2-9ce7-fd22b400c313'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:22:00.813988 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-027bcaaa-6c0a-4c1f-b1cd-621785ce74e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:21:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3b833388-9a85-4de2-9ce7-fd22b400c313'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:00.842249 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af77f0ef-244d-4112-8722-7c6c4cb6d664 req-d06d2b43-604d-4252-953c-f01fc61d8edd tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 210 time: 0.0737321 Dec 09 21:22:00.888368 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-e00c09e3-750c-4b25-98f7-d3742310de9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:00.891554 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-e00c09e3-750c-4b25-98f7-d3742310de9a service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 1101 time: 0.4368525 Dec 09 21:22:00.999574 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-aaba0e90-99e5-4ee1-9f3d-8fbc7df27611 None None] Allocated IP 172.20.0.2 (6b0e1b89-20b6-4a70-94cb-58b2b1f77a20/069b1784-6c14-42f6-a10c-b0d4447b6091/b422c8d4-8903-4efb-9419-9a433fd1506b) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:22:01.013398 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 80dde595-a3d7-4c03-aa66-d9fc5b2f340c no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:22:01.044174 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-14013783-fe02-444b-91e7-204bffecb89c tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Made reservation on behalf of a306d2242b1e41c892f63c7b122cdee4 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:22:01.052198 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-14013783-fe02-444b-91e7-204bffecb89c tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:01.062308 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 80dde595-a3d7-4c03-aa66-d9fc5b2f340c {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:22:01.062978 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 80dde595-a3d7-4c03-aa66-d9fc5b2f340c not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:22:01.221280 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-8673bb01-8d2b-4d4f-9381-e5efc94527a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:01.223051 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-8673bb01-8d2b-4d4f-9381-e5efc94527a7 service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.3189633 Dec 09 21:22:01.348892 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-5bfa468b-f817-4e7f-9cc5-c6b84c4d95ca service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.184&port_id=e145c03d-6648-46c7-8b51-c9e9acd70ff2 HTTP/1.1" status: 200 len: 217 time: 0.1085348 Dec 09 21:22:01.355504 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-027bcaaa-6c0a-4c1f-b1cd-621785ce74e3 None None] Set router 3b833388-9a85-4de2-9ce7-fd22b400c313 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:22:01.449390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-e239e8e2-f08d-4e8a-98d8-dbb8fc145617 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:01.450817 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-e239e8e2-f08d-4e8a-98d8-dbb8fc145617 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0570769 Dec 09 21:22:01.552044 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-0675ee1a-e15a-4bf0-97dd-0820acfdcf73 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:01.557840 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-0675ee1a-e15a-4bf0-97dd-0820acfdcf73 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0958452 Dec 09 21:22:01.702223 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-14013783-fe02-444b-91e7-204bffecb89c tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Allocated IP 172.20.0.11 (93378dc3-2ac5-4cf7-9ce3-d812934de40c/c49a62cc-af1b-4958-a4a9-eb44188b8fb9/cd5af376-d278-48fb-8867-a970b71280d9) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:22:01.861864 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aaba0e90-99e5-4ee1-9f3d-8fbc7df27611 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:01.874833 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aaba0e90-99e5-4ee1-9f3d-8fbc7df27611 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:01.929013 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aaba0e90-99e5-4ee1-9f3d-8fbc7df27611 None None] Network 6b0e1b89-20b6-4a70-94cb-58b2b1f77a20 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:22:01.967941 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-aaba0e90-99e5-4ee1-9f3d-8fbc7df27611 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:22:01.974025 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aaba0e90-99e5-4ee1-9f3d-8fbc7df27611 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:22:02.019606 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaba0e90-99e5-4ee1-9f3d-8fbc7df27611 None None] Pushing event updated for resources: {'Port': ['ID=b422c8d4-8903-4efb-9419-9a433fd1506b,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:02.070331 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-14013783-fe02-444b-91e7-204bffecb89c tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:02.076567 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f9bbeca0-4ef9-48ff-9c3f-b2b1721c989c admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:02.077459 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-aaba0e90-99e5-4ee1-9f3d-8fbc7df27611 None None] Attempting to bind port b422c8d4-8903-4efb-9419-9a433fd1506b on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:22:02.077840 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-aaba0e90-99e5-4ee1-9f3d-8fbc7df27611 None None] Attempting to bind port b422c8d4-8903-4efb-9419-9a433fd1506b by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'e74944d5-8114-4627-bc98-88385d8b16f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:22:02.078260 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aaba0e90-99e5-4ee1-9f3d-8fbc7df27611 None None] Attempting to bind port b422c8d4-8903-4efb-9419-9a433fd1506b on network 6b0e1b89-20b6-4a70-94cb-58b2b1f77a20 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:22:02.117694 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aaba0e90-99e5-4ee1-9f3d-8fbc7df27611 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 21, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:22:02.118239 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aaba0e90-99e5-4ee1-9f3d-8fbc7df27611 None None] Checking segment: {'id': 'e74944d5-8114-4627-bc98-88385d8b16f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:22:02.118692 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aaba0e90-99e5-4ee1-9f3d-8fbc7df27611 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:02.119430 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aaba0e90-99e5-4ee1-9f3d-8fbc7df27611 None None] Bound using segment: {'id': 'e74944d5-8114-4627-bc98-88385d8b16f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:22:02.119907 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-aaba0e90-99e5-4ee1-9f3d-8fbc7df27611 None None] Bound port: b422c8d4-8903-4efb-9419-9a433fd1506b, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e74944d5-8114-4627-bc98-88385d8b16f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:22:02.122531 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aaba0e90-99e5-4ee1-9f3d-8fbc7df27611 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:02.194252 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f9bbeca0-4ef9-48ff-9c3f-b2b1721c989c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:02.252153 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-b148adb8-facf-4bdf-9c37-00cbe77cbb02 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6800413 Dec 09 21:22:02.284296 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-14013783-fe02-444b-91e7-204bffecb89c tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:02.331028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['40468c91-ccde-4d96-b234-0e326a1de103'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:22:02.455910 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-f9bbeca0-4ef9-48ff-9c3f-b2b1721c989c admin admin] Allocated IP 172.25.3.26 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/49e167c2-19e7-4bc9-9de1-decd671125c0) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:22:02.500025 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-aaba0e90-99e5-4ee1-9f3d-8fbc7df27611 None None] For port b422c8d4-8903-4efb-9419-9a433fd1506b, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:22:02.509191 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-14013783-fe02-444b-91e7-204bffecb89c tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Network 93378dc3-2ac5-4cf7-9ce3-d812934de40c is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:22:02.516987 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-14013783-fe02-444b-91e7-204bffecb89c tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:22:02.570751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-aaba0e90-99e5-4ee1-9f3d-8fbc7df27611 None None] For port b422c8d4-8903-4efb-9419-9a433fd1506b, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b422c8d4-8903-4efb-9419-9a433fd1506b,segment=NetworkSegment(e74944d5-8114-4627-bc98-88385d8b16f0),segment_id=e74944d5-8114-4627-bc98-88385d8b16f0)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:22:02.599073 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aaba0e90-99e5-4ee1-9f3d-8fbc7df27611 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:02.599403 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-14013783-fe02-444b-91e7-204bffecb89c tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:22:02.612511 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f9bbeca0-4ef9-48ff-9c3f-b2b1721c989c admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:02.659243 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f9bbeca0-4ef9-48ff-9c3f-b2b1721c989c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:02.672429 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-14013783-fe02-444b-91e7-204bffecb89c tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:02.673067 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-14013783-fe02-444b-91e7-204bffecb89c tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:02.694581 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaba0e90-99e5-4ee1-9f3d-8fbc7df27611 None None] Pushing event updated for resources: {'Port': ['ID=b422c8d4-8903-4efb-9419-9a433fd1506b,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:02.695605 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efd419b8-4b06-480d-86af-07bed1910eed req-9e28ae26-20f5-471d-b925-e36e86df6c4b tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:02.701790 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-027bcaaa-6c0a-4c1f-b1cd-621785ce74e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-85948487-router', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54'}], 'enable_snat': True}, 'gw_port_id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:12Z', 'updated_at': '2021-12-09T21:17:16Z', 'revision_number': 4, 'project_id': '615039519ef147c78eb38a1d65eac061', 'gw_port': {'id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:32:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:13Z', 'updated_at': '2021-12-09T21:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'f50209a6-36fd-4aea-927f-b79127351066', 'name': '', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'mac_address': 'fa:16:3e:bd:0e:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:15Z', 'updated_at': '2021-12-09T21:17:21Z', 'revision_number': 5, 'project_id': '615039519ef147c78eb38a1d65eac061', 'subnets': [{'id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:02.720957 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-efd419b8-4b06-480d-86af-07bed1910eed req-9e28ae26-20f5-471d-b925-e36e86df6c4b tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 932 time: 0.4468524 Dec 09 21:22:02.745912 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9bbeca0-4ef9-48ff-9c3f-b2b1721c989c admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:22:02.750498 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-027bcaaa-6c0a-4c1f-b1cd-621785ce74e3 None None] Checking router: 3b833388-9a85-4de2-9ce7-fd22b400c313 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:22:02.753311 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-f9bbeca0-4ef9-48ff-9c3f-b2b1721c989c admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:22:02.760926 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9bbeca0-4ef9-48ff-9c3f-b2b1721c989c admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:22:02.831844 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-027bcaaa-6c0a-4c1f-b1cd-621785ce74e3 None None] Routers {'3b833388-9a85-4de2-9ce7-fd22b400c313'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:22:02.833078 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-027bcaaa-6c0a-4c1f-b1cd-621785ce74e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:21:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3b833388-9a85-4de2-9ce7-fd22b400c313'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:02.872571 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1f87edc-b81e-4662-87d6-fb449401a250 req-da9a157f-7283-43ff-a905-6b2c5d0cf24b tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:02.888526 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e1f87edc-b81e-4662-87d6-fb449401a250 req-da9a157f-7283-43ff-a905-6b2c5d0cf24b tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 949 time: 1.2286062 Dec 09 21:22:02.901933 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9bbeca0-4ef9-48ff-9c3f-b2b1721c989c admin admin] Pushing event updated for resources: {'Port': ['ID=49e167c2-19e7-4bc9-9de1-decd671125c0,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:02.909113 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14013783-fe02-444b-91e7-204bffecb89c tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Pushing event updated for resources: {'Port': ['ID=cd5af376-d278-48fb-8867-a970b71280d9,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:02.967177 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-14013783-fe02-444b-91e7-204bffecb89c tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.6896489 Dec 09 21:22:02.998089 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e145c03d-6648-46c7-8b51-c9e9acd70ff2 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:22:03.003108 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-9c67dc87-6fa2-40ec-953b-cfc8df62dd45 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7487869 Dec 09 21:22:03.038690 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-ac06f55a-8d80-47ee-a4bc-06bf20a0b2a4 service neutron] Request body: {'port': {'device_id': '5105efab-9ee1-4a74-9a45-e77c38549362', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:22:03.182370 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-efd419b8-4b06-480d-86af-07bed1910eed req-86a32417-7ce5-4416-8b0f-e7529a4af2f5 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4600832 Dec 09 21:22:03.201481 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7b532289-8929-4cd0-a5dc-647899041a5d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:03.216804 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e1f87edc-b81e-4662-87d6-fb449401a250 req-e90d94e6-af09-430a-9bfd-2e0973c0bfc5 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3273602 Dec 09 21:22:03.248534 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-ac06f55a-8d80-47ee-a4bc-06bf20a0b2a4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:03.457325 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port e145c03d-6648-46c7-8b51-c9e9acd70ff2 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:03.457745 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:03.470781 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f9bbeca0-4ef9-48ff-9c3f-b2b1721c989c admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:03.557648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-027bcaaa-6c0a-4c1f-b1cd-621785ce74e3 None None] Set router 3b833388-9a85-4de2-9ce7-fd22b400c313 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:22:03.782300 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60962) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:03.872567 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a0c273ef-5769-40d2-ad68-4c636241ec39 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:03.904650 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a0c273ef-5769-40d2-ad68-4c636241ec39 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:03.966466 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a0c273ef-5769-40d2-ad68-4c636241ec39 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:03.969918 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a0c273ef-5769-40d2-ad68-4c636241ec39 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:03.972559 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-ac06f55a-8d80-47ee-a4bc-06bf20a0b2a4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cd5af376-d278-48fb-8867-a970b71280d9 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:22:03.974127 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a0c273ef-5769-40d2-ad68-4c636241ec39 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "DELETE /v2.0/security-groups/9798184d-82ec-4464-b3fc-95653513aba7 HTTP/1.1" status: 204 len: 168 time: 0.1905859 Dec 09 21:22:03.977410 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60964) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:03.992066 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-ac06f55a-8d80-47ee-a4bc-06bf20a0b2a4 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:04.023913 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0c273ef-5769-40d2-ad68-4c636241ec39 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9798184d-82ec-4464-b3fc-95653513aba7,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:04.039465 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-5354f453-8834-4284-9f96-f180fda7fde9 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] show failed (client error): The resource could not be found. Dec 09 21:22:04.044549 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b422c8d4-8903-4efb-9419-9a433fd1506b up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:22:04.045112 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5354f453-8834-4284-9f96-f180fda7fde9 tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "GET /v2.0/security-groups/9798184d-82ec-4464-b3fc-95653513aba7 HTTP/1.1" status: 404 len: 347 time: 0.0574639 Dec 09 21:22:04.047910 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60966) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:04.054889 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-ac06f55a-8d80-47ee-a4bc-06bf20a0b2a4 service neutron] Transition to ACTIVE for port object cd5af376-d278-48fb-8867-a970b71280d9 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:22:04.071636 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-ac06f55a-8d80-47ee-a4bc-06bf20a0b2a4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:04.157343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac06f55a-8d80-47ee-a4bc-06bf20a0b2a4 service neutron] Pushing event updated for resources: {'Port': ['ID=cd5af376-d278-48fb-8867-a970b71280d9,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:04.167066 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:04.233744 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f9bbeca0-4ef9-48ff-9c3f-b2b1721c989c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:04.269654 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-027bcaaa-6c0a-4c1f-b1cd-621785ce74e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-85948487-router', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54'}], 'enable_snat': True}, 'gw_port_id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:12Z', 'updated_at': '2021-12-09T21:17:16Z', 'revision_number': 4, 'project_id': '615039519ef147c78eb38a1d65eac061', 'gw_port': {'id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:32:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:13Z', 'updated_at': '2021-12-09T21:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'f50209a6-36fd-4aea-927f-b79127351066', 'name': '', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'mac_address': 'fa:16:3e:bd:0e:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:15Z', 'updated_at': '2021-12-09T21:17:21Z', 'revision_number': 5, 'project_id': '615039519ef147c78eb38a1d65eac061', 'subnets': [{'id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:04.309641 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-90aab617-4694-45aa-8677-cf83fe53f48a tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Deleting port f0c87a24-0ee6-49bc-9f20-a97afbe91fa3 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:22:04.310049 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-90aab617-4694-45aa-8677-cf83fe53f48a tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:04.390301 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-027bcaaa-6c0a-4c1f-b1cd-621785ce74e3 None None] The sync data for ids ['3b833388-9a85-4de2-9ce7-fd22b400c313'] in n-d-713301-27 is: [{'id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-85948487-router', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54'}], 'enable_snat': True}, 'gw_port_id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:12Z', 'updated_at': '2021-12-09T21:17:16Z', 'revision_number': 4, 'project_id': '615039519ef147c78eb38a1d65eac061', 'gw_port': {'id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:32:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:13Z', 'updated_at': '2021-12-09T21:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'f50209a6-36fd-4aea-927f-b79127351066', 'name': '', 'network_id': 'ce6b6bd1-6a60-4cea-9b70-69fd0290796c', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'mac_address': 'fa:16:3e:bd:0e:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_interface', 'standard_attr_id': 42, 'fixed_ips': [{'subnet_id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:15Z', 'updated_at': '2021-12-09T21:17:21Z', 'revision_number': 5, 'project_id': '615039519ef147c78eb38a1d65eac061', 'subnets': [{'id': '9755e5ea-99a7-4073-8693-293dcc00b929', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:22:04.395162 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-ac06f55a-8d80-47ee-a4bc-06bf20a0b2a4 service neutron] Attempting to bind port cd5af376-d278-48fb-8867-a970b71280d9 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:22:04.395812 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-ac06f55a-8d80-47ee-a4bc-06bf20a0b2a4 service neutron] Attempting to bind port cd5af376-d278-48fb-8867-a970b71280d9 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:22:04.396070 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-ac06f55a-8d80-47ee-a4bc-06bf20a0b2a4 service neutron] Attempting to bind port cd5af376-d278-48fb-8867-a970b71280d9 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:22:04.400951 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8bbb9251-ec6e-45d8-b751-2b2b490cbe3b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e145c03d-6648-46c7-8b51-c9e9acd70ff2'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:22:04.405291 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7ed505d9-dc3c-4da1-9a4b-867e603e77b8" -d '{"events": [{"server_uuid": "8bbb9251-ec6e-45d8-b751-2b2b490cbe3b", "name": "network-vif-plugged", "status": "completed", "tag": "e145c03d-6648-46c7-8b51-c9e9acd70ff2"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:22:04.416676 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-ac06f55a-8d80-47ee-a4bc-06bf20a0b2a4 service neutron] Port cd5af376-d278-48fb-8867-a970b71280d9 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:22:04.417006 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-ac06f55a-8d80-47ee-a4bc-06bf20a0b2a4 service neutron] Attempting to bind port cd5af376-d278-48fb-8867-a970b71280d9 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:22:04.485482 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port e145c03d-6648-46c7-8b51-c9e9acd70ff2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e145c03d-6648-46c7-8b51-c9e9acd70ff2,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:04.508124 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-ac06f55a-8d80-47ee-a4bc-06bf20a0b2a4 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 21, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:22:04.509220 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-ac06f55a-8d80-47ee-a4bc-06bf20a0b2a4 service neutron] Checking segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:22:04.509959 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-ac06f55a-8d80-47ee-a4bc-06bf20a0b2a4 service neutron] Bound using segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:22:04.510498 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:04.510753 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-ac06f55a-8d80-47ee-a4bc-06bf20a0b2a4 service neutron] Bound port: cd5af376-d278-48fb-8867-a970b71280d9, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:22:04.511279 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-ac06f55a-8d80-47ee-a4bc-06bf20a0b2a4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:04.526413 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port b422c8d4-8903-4efb-9419-9a433fd1506b triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:04.527024 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:04.538971 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-90aab617-4694-45aa-8677-cf83fe53f48a tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:04.543610 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-90aab617-4694-45aa-8677-cf83fe53f48a tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:04.606007 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-90aab617-4694-45aa-8677-cf83fe53f48a tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Calling delete_port for f0c87a24-0ee6-49bc-9f20-a97afbe91fa3 owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:22:04.638328 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-350ab61d-de7e-4786-9282-2a55bb582ae3 None None] Network 6b0e1b89-20b6-4a70-94cb-58b2b1f77a20 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:22:04.680324 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-ac06f55a-8d80-47ee-a4bc-06bf20a0b2a4 service neutron] For port cd5af376-d278-48fb-8867-a970b71280d9, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:22:04.696044 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-ac06f55a-8d80-47ee-a4bc-06bf20a0b2a4 service neutron] For port cd5af376-d278-48fb-8867-a970b71280d9, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=cd5af376-d278-48fb-8867-a970b71280d9,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:22:04.718823 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-ac06f55a-8d80-47ee-a4bc-06bf20a0b2a4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:04.830540 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a20e8179-9334-4ab5-a00f-e0acbc6bfe9b req-2afb8375-b7be-49d8-8170-4afd7e7ba172 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:04.847116 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a20e8179-9334-4ab5-a00f-e0acbc6bfe9b req-2afb8375-b7be-49d8-8170-4afd7e7ba172 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 949 time: 0.4539936 Dec 09 21:22:04.906094 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f9bbeca0-4ef9-48ff-9c3f-b2b1721c989c admin admin] Router 5cb2944b-70be-4f74-b4d0-e06f75765688 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:22:04.938967 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e44bc5c-6905-4a85-95a6-59ed342606fa None None] New status for floating IP 607e8ba4-01a4-4741-a885-8732f6aacd9f: DOWN {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:22:04.943426 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80d05040-f335-4401-af72-3d6a448d21d0 req-afa8cec8-65f8-41b6-aa4e-79addfaf73a2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:04.949356 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-80d05040-f335-4401-af72-3d6a448d21d0 req-afa8cec8-65f8-41b6-aa4e-79addfaf73a2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 944 time: 0.5542822 Dec 09 21:22:05.124082 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-ac06f55a-8d80-47ee-a4bc-06bf20a0b2a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:05.127329 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-ac06f55a-8d80-47ee-a4bc-06bf20a0b2a4 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:05.129087 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-ac06f55a-8d80-47ee-a4bc-06bf20a0b2a4 service neutron] 10.222.0.10 "PUT /v2.0/ports/cd5af376-d278-48fb-8867-a970b71280d9 HTTP/1.1" status: 200 len: 1093 time: 2.1216841 Dec 09 21:22:05.142513 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5105efab-9ee1-4a74-9a45-e77c38549362', 'tag': 'cd5af376-d278-48fb-8867-a970b71280d9'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:22:05.152169 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c97622ca-9a4d-4d14-abea-fbd5cd50daa8" -d '{"events": [{"name": "network-changed", "server_uuid": "5105efab-9ee1-4a74-9a45-e77c38549362", "tag": "cd5af376-d278-48fb-8867-a970b71280d9"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:22:05.248522 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac06f55a-8d80-47ee-a4bc-06bf20a0b2a4 service neutron] Pushing event updated for resources: {'Port': ['ID=cd5af376-d278-48fb-8867-a970b71280d9,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:05.256096 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=e145c03d-6648-46c7-8b51-c9e9acd70ff2,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:05.290888 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a8845160-09ee-40c9-8923-4db9a0817934 None None] Provisioning complete for port b422c8d4-8903-4efb-9419-9a433fd1506b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:05.291237 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a8845160-09ee-40c9-8923-4db9a0817934 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:05.293856 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a20e8179-9334-4ab5-a00f-e0acbc6bfe9b req-6a4d4227-5511-4bc8-af22-99f6e821bc06 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4447074 Dec 09 21:22:05.310366 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f9bbeca0-4ef9-48ff-9c3f-b2b1721c989c admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:22:05.410536 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f9bbeca0-4ef9-48ff-9c3f-b2b1721c989c admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:05.420870 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f9bbeca0-4ef9-48ff-9c3f-b2b1721c989c admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 5.5492399 Dec 09 21:22:05.424777 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60998) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:05.427253 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e8834a5-f9b9-4b57-91b6-40e3593ad26d req-30153c12-c4a0-4396-a62c-a6cfa664877a service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.5056224 Dec 09 21:22:05.450194 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] Sync routers for ids ['5cb2944b-70be-4f74-b4d0-e06f75765688'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:22:05.463509 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-80d05040-f335-4401-af72-3d6a448d21d0 req-076e6db7-5ee9-417e-9ac8-dbf1166e8ab5 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4246390 Dec 09 21:22:05.479308 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-482aa9ea-635d-47cd-9015-f48b76d23750 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:05.488416 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-482aa9ea-635d-47cd-9015-f48b76d23750 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 1096 time: 0.2472489 Dec 09 21:22:05.505647 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:22:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b0d7696f-d3f5-44a1-92d6-3d6d7fec6b78 x-openstack-request-id: req-b0d7696f-d3f5-44a1-92d6-3d6d7fec6b78 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:22:05.507252 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8bbb9251-ec6e-45d8-b751-2b2b490cbe3b", "name": "network-vif-plugged", "status": "completed", "tag": "e145c03d-6648-46c7-8b51-c9e9acd70ff2", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:22:05.509407 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-b0d7696f-d3f5-44a1-92d6-3d6d7fec6b78 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:22:05.510011 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8bbb9251-ec6e-45d8-b751-2b2b490cbe3b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e145c03d-6648-46c7-8b51-c9e9acd70ff2', 'code': 200} Dec 09 21:22:05.556515 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-90aab617-4694-45aa-8677-cf83fe53f48a tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:05.558011 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-77fd96ac-70a5-4761-a42f-37bf811c2323 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:05.653650 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] Routers {'5cb2944b-70be-4f74-b4d0-e06f75765688'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:22:05.654325 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:21:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['5cb2944b-70be-4f74-b4d0-e06f75765688'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:05.711495 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-c32e98e3-6ab8-42a6-b390-321ce4442a6f service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=cd5af376-d278-48fb-8867-a970b71280d9 HTTP/1.1" status: 200 len: 217 time: 0.1424513 Dec 09 21:22:05.719100 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90aab617-4694-45aa-8677-cf83fe53f48a tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Pushing event deleted for resources: {'Port': ['ID=f0c87a24-0ee6-49bc-9f20-a97afbe91fa3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:05.817834 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e8834a5-f9b9-4b57-91b6-40e3593ad26d req-12003e40-761d-4892-9dbe-8abb12f055ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:05.827691 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e8834a5-f9b9-4b57-91b6-40e3593ad26d req-12003e40-761d-4892-9dbe-8abb12f055ce service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 1102 time: 0.3615801 Dec 09 21:22:05.854297 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:22:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-348a8c5f-f9f8-4439-9a37-120db71cc85c x-openstack-request-id: req-348a8c5f-f9f8-4439-9a37-120db71cc85c {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:22:05.854587 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5105efab-9ee1-4a74-9a45-e77c38549362", "tag": "cd5af376-d278-48fb-8867-a970b71280d9", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:22:05.854833 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-348a8c5f-f9f8-4439-9a37-120db71cc85c {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:22:05.855227 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5105efab-9ee1-4a74-9a45-e77c38549362', 'tag': 'cd5af376-d278-48fb-8867-a970b71280d9', 'status': 'completed', 'code': 200} Dec 09 21:22:05.866931 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-fdf55775-e768-4b81-8965-278d048119c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:05.871240 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-fdf55775-e768-4b81-8965-278d048119c9 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b&tenant_id=857de64ecc3946e3b92655f639d782df HTTP/1.1" status: 200 len: 1102 time: 0.4040215 Dec 09 21:22:05.895291 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:06.036255 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-90aab617-4694-45aa-8677-cf83fe53f48a tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:06.041130 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-90aab617-4694-45aa-8677-cf83fe53f48a tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:06.049455 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-90aab617-4694-45aa-8677-cf83fe53f48a tempest-ServersWithSpecificFlavorTestJSON-227039153 tempest-ServersWithSpecificFlavorTestJSON-227039153-project] 10.222.0.13 "DELETE /v2.0/floatingips/607e8ba4-01a4-4741-a885-8732f6aacd9f HTTP/1.1" status: 204 len: 168 time: 2.0006731 Dec 09 21:22:06.111115 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e8834a5-f9b9-4b57-91b6-40e3593ad26d req-116d11b4-469a-44cc-a8a3-8355ea3083fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:06.112903 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e8834a5-f9b9-4b57-91b6-40e3593ad26d req-116d11b4-469a-44cc-a8a3-8355ea3083fb service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.2390697 Dec 09 21:22:06.219093 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-de97c6c2-59f1-49a7-81d6-eb1aaf38f2ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:06.222025 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-de97c6c2-59f1-49a7-81d6-eb1aaf38f2ba service neutron] 10.222.0.10 "GET /v2.0/subnets?id=c49a62cc-af1b-4958-a4a9-eb44188b8fb9 HTTP/1.1" status: 200 len: 861 time: 0.4869463 Dec 09 21:22:06.223653 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e8834a5-f9b9-4b57-91b6-40e3593ad26d req-30c9ebd1-9e0d-4887-abad-e9d33775056f service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.145&port_id=204e6970-8ed3-4e91-9792-52401052a153 HTTP/1.1" status: 200 len: 217 time: 0.0878866 Dec 09 21:22:06.331184 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-bc6623e0-c955-4a75-ad0c-97829624942e service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=93378dc3-2ac5-4cf7-9ce3-d812934de40c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0944114 Dec 09 21:22:06.344067 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e8834a5-f9b9-4b57-91b6-40e3593ad26d req-443d4bc1-2509-4450-b1e9-81defbaf502a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:06.361445 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e8834a5-f9b9-4b57-91b6-40e3593ad26d req-443d4bc1-2509-4450-b1e9-81defbaf502a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1232142 Dec 09 21:22:06.453327 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-f03c6edd-79a0-4fdb-bb2b-2d050a61f657 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:06.457600 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-f03c6edd-79a0-4fdb-bb2b-2d050a61f657 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 1102 time: 0.5463021 Dec 09 21:22:06.486144 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a8845160-09ee-40c9-8923-4db9a0817934 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:06.643866 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port b422c8d4-8903-4efb-9419-9a433fd1506b, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b422c8d4-8903-4efb-9419-9a433fd1506b,segment=NetworkSegment(e74944d5-8114-4627-bc98-88385d8b16f0),segment_id=e74944d5-8114-4627-bc98-88385d8b16f0)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:06.650149 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:06.656717 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] Set router 5cb2944b-70be-4f74-b4d0-e06f75765688 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:22:06.795922 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea1fb248-5a63-46de-8f8c-7056e7a69d33 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:06.805405 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:06.898034 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-a8845160-09ee-40c9-8923-4db9a0817934 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:22:06.898374 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-a8845160-09ee-40c9-8923-4db9a0817934 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:22:06.929023 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=b422c8d4-8903-4efb-9419-9a433fd1506b,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:07.006029 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'name': 'tempest-ServersTestManualDisk-255636487-router', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26'}], 'enable_snat': True}, 'gw_port_id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:21:59Z', 'updated_at': '2021-12-09T21:22:03Z', 'revision_number': 3, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'gw_port': {'id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:cd:fd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'device_owner': 'network:router_gateway', 'standard_attr_id': 623, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:22:02Z', 'updated_at': '2021-12-09T21:22:02Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:07.061474 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] Checking router: 5cb2944b-70be-4f74-b4d0-e06f75765688 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:22:07.062694 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] Updating router 5cb2944b-70be-4f74-b4d0-e06f75765688 port 49e167c2-19e7-4bc9-9de1-decd671125c0 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:22:07.129157 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:07.177745 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-ea1fb248-5a63-46de-8f8c-7056e7a69d33 admin admin] Allocated IP 172.20.0.1 (6b0e1b89-20b6-4a70-94cb-58b2b1f77a20/069b1784-6c14-42f6-a10c-b0d4447b6091/cd61cf32-db9c-49d2-8b1c-50a6abb2e135) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:22:07.357842 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea1fb248-5a63-46de-8f8c-7056e7a69d33 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:07.400490 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea1fb248-5a63-46de-8f8c-7056e7a69d33 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:07.431884 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-155afaed-fbcc-40d4-a4f6-c2a0ac2aef1e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:07.433566 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-155afaed-fbcc-40d4-a4f6-c2a0ac2aef1e service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.9285476 Dec 09 21:22:07.509226 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea1fb248-5a63-46de-8f8c-7056e7a69d33 admin admin] Network 6b0e1b89-20b6-4a70-94cb-58b2b1f77a20 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:22:07.520155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-ea1fb248-5a63-46de-8f8c-7056e7a69d33 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:22:07.542920 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea1fb248-5a63-46de-8f8c-7056e7a69d33 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:22:07.609621 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-5f68cdf8-4aa5-4b98-a5d1-8b0978b54d11 service neutron] 10.222.0.10 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.2462966 Dec 09 21:22:07.702577 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea1fb248-5a63-46de-8f8c-7056e7a69d33 admin admin] Pushing event updated for resources: {'Port': ['ID=cd61cf32-db9c-49d2-8b1c-50a6abb2e135,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:07.748826 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea1fb248-5a63-46de-8f8c-7056e7a69d33 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:07.758372 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-de2194c1-a649-4b22-abca-34c5c4ea5ee2 None None] Provisioning complete for port b422c8d4-8903-4efb-9419-9a433fd1506b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:07.769827 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-de2194c1-a649-4b22-abca-34c5c4ea5ee2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:07.905107 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-40d89963-7c6f-4ccd-b145-03fd90305d8f service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.184&port_id=e145c03d-6648-46c7-8b51-c9e9acd70ff2 HTTP/1.1" status: 200 len: 217 time: 0.2922201 Dec 09 21:22:07.908371 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef5808bc-234f-4707-99fa-4dd98859dc9f req-53ae0e28-96bf-4c87-9406-808bed937f2d service neutron] 10.222.0.10 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2769158 Dec 09 21:22:07.991370 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e8834a5-f9b9-4b57-91b6-40e3593ad26d req-799ffed0-a1ed-481d-a26d-050deaf38c21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:07.993784 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e8834a5-f9b9-4b57-91b6-40e3593ad26d req-799ffed0-a1ed-481d-a26d-050deaf38c21 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 1.6079311 Dec 09 21:22:08.063664 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea1fb248-5a63-46de-8f8c-7056e7a69d33 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:08.087878 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:08.117328 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:08.126123 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:08.160213 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] Attempting to bind port 49e167c2-19e7-4bc9-9de1-decd671125c0 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:22:08.160590 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] Attempting to bind port 49e167c2-19e7-4bc9-9de1-decd671125c0 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:22:08.160954 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] Attempting to bind port 49e167c2-19e7-4bc9-9de1-decd671125c0 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:22:08.187421 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 21, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:22:08.188337 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:22:08.188808 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:08.189821 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:22:08.190391 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] Bound port: 49e167c2-19e7-4bc9-9de1-decd671125c0, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:22:08.190848 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:08.221703 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62a296eb-c327-471d-8440-15345436de97 req-2f5783c0-1a5f-4546-ade7-adbb08b02bdc tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:08.230146 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-62a296eb-c327-471d-8440-15345436de97 req-2f5783c0-1a5f-4546-ade7-adbb08b02bdc tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 944 time: 0.6518247 Dec 09 21:22:08.274869 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a501a2f-b4fd-4c43-b95e-c401dafd1b98 req-9df20fb4-3d32-4120-a653-f0a516442c7e tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:08.276646 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a501a2f-b4fd-4c43-b95e-c401dafd1b98 req-9df20fb4-3d32-4120-a653-f0a516442c7e tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 1.7874236 Dec 09 21:22:08.282532 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7bc4441-6ad7-4f9c-b0b0-2b5a086b0f5b None None] Pushing event updated for resources: {'Port': ['ID=49e167c2-19e7-4bc9-9de1-decd671125c0,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:08.288451 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f300d24d-26de-415e-af07-34d46eebe426 None None] Provisioning complete for port cd61cf32-db9c-49d2-8b1c-50a6abb2e135 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:08.289306 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f300d24d-26de-415e-af07-34d46eebe426 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:08.327066 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] For port 49e167c2-19e7-4bc9-9de1-decd671125c0, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:22:08.352794 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] For port 49e167c2-19e7-4bc9-9de1-decd671125c0, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=49e167c2-19e7-4bc9-9de1-decd671125c0,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:22:08.354808 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f300d24d-26de-415e-af07-34d46eebe426 None None] Port cd61cf32-db9c-49d2-8b1c-50a6abb2e135 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:22:08.367478 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:08.403327 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e8834a5-f9b9-4b57-91b6-40e3593ad26d req-8d79c0d6-d889-4096-a5d0-66c1e1620075 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3845272 Dec 09 21:22:08.423774 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea1fb248-5a63-46de-8f8c-7056e7a69d33 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:08.435072 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea1fb248-5a63-46de-8f8c-7056e7a69d33 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:08.468755 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-cdef985a-b213-4ea3-b2a7-380e2af003a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:08.470227 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-cdef985a-b213-4ea3-b2a7-380e2af003a9 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.5368497 Dec 09 21:22:08.518948 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] Routers {'5cb2944b-70be-4f74-b4d0-e06f75765688'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:22:08.519588 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:22:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['5cb2944b-70be-4f74-b4d0-e06f75765688'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:08.532907 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7bc4441-6ad7-4f9c-b0b0-2b5a086b0f5b None None] Pushing event updated for resources: {'Port': ['ID=49e167c2-19e7-4bc9-9de1-decd671125c0,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:08.534873 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea1fb248-5a63-46de-8f8c-7056e7a69d33 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:08.588275 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-62a296eb-c327-471d-8440-15345436de97 req-dc39bff8-9ba9-4be4-9df2-40cb578412f2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3040330 Dec 09 21:22:08.665915 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a501a2f-b4fd-4c43-b95e-c401dafd1b98 req-2a0f67af-ed1b-4640-9b2b-34691e2e4050 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3751872 Dec 09 21:22:08.713449 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea1fb248-5a63-46de-8f8c-7056e7a69d33 admin admin] Pushing event updated for resources: {'Port': ['ID=cd61cf32-db9c-49d2-8b1c-50a6abb2e135,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:08.731155 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c97622ca-9a4d-4d14-abea-fbd5cd50daa8 req-73d6cbc3-345a-480a-85cd-0965d490eae5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:08.732234 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32844) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:08.732906 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c97622ca-9a4d-4d14-abea-fbd5cd50daa8 req-73d6cbc3-345a-480a-85cd-0965d490eae5 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 1096 time: 0.7335908 Dec 09 21:22:08.815575 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] Set router 5cb2944b-70be-4f74-b4d0-e06f75765688 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:22:08.935631 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e145c03d-6648-46c7-8b51-c9e9acd70ff2 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:22:09.020551 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c97622ca-9a4d-4d14-abea-fbd5cd50daa8 req-7c278544-0667-4c2a-983d-e3aa2b4854ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:09.036583 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c97622ca-9a4d-4d14-abea-fbd5cd50daa8 req-7c278544-0667-4c2a-983d-e3aa2b4854ee service neutron] 10.222.0.10 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 922 time: 0.2700870 Dec 09 21:22:09.061132 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b422c8d4-8903-4efb-9419-9a433fd1506b up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:22:09.293910 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c97622ca-9a4d-4d14-abea-fbd5cd50daa8 req-edbf29a9-8476-4218-94f3-0c03c43a9cbd service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=cd5af376-d278-48fb-8867-a970b71280d9 HTTP/1.1" status: 200 len: 217 time: 0.2494409 Dec 09 21:22:09.366346 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:09.382524 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port b422c8d4-8903-4efb-9419-9a433fd1506b triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:09.383205 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:09.425147 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:09.495625 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8bbb9251-ec6e-45d8-b751-2b2b490cbe3b', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e145c03d-6648-46c7-8b51-c9e9acd70ff2'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:22:09.501816 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2026ba41-a775-4a4e-9f5f-1db033a05b6e" -d '{"events": [{"server_uuid": "8bbb9251-ec6e-45d8-b751-2b2b490cbe3b", "name": "network-vif-unplugged", "status": "completed", "tag": "e145c03d-6648-46c7-8b51-c9e9acd70ff2"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:22:09.525320 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port e145c03d-6648-46c7-8b51-c9e9acd70ff2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e145c03d-6648-46c7-8b51-c9e9acd70ff2,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:09.539700 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:09.594035 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-dbe8aeac-8bef-472e-9e37-b7f4a3c1dfe9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:09.610733 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-dbe8aeac-8bef-472e-9e37-b7f4a3c1dfe9 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 1.0367377 Dec 09 21:22:09.646692 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:22:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e1cf75ef-4029-42ee-ac38-04143897184e x-openstack-request-id: req-e1cf75ef-4029-42ee-ac38-04143897184e {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:22:09.647004 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8bbb9251-ec6e-45d8-b751-2b2b490cbe3b", "name": "network-vif-unplugged", "status": "completed", "tag": "e145c03d-6648-46c7-8b51-c9e9acd70ff2", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:22:09.647641 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e1cf75ef-4029-42ee-ac38-04143897184e {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:22:09.650892 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8bbb9251-ec6e-45d8-b751-2b2b490cbe3b', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e145c03d-6648-46c7-8b51-c9e9acd70ff2', 'code': 200} Dec 09 21:22:09.667191 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'name': 'tempest-ServersTestManualDisk-255636487-router', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26'}], 'enable_snat': True}, 'gw_port_id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:21:59Z', 'updated_at': '2021-12-09T21:22:07Z', 'revision_number': 4, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'gw_port': {'id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:cd:fd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'device_owner': 'network:router_gateway', 'standard_attr_id': 623, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:22:02Z', 'updated_at': '2021-12-09T21:22:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'cd61cf32-db9c-49d2-8b1c-50a6abb2e135', 'name': '', 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'mac_address': 'fa:16:3e:e5:cc:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'device_owner': 'network:router_interface', 'standard_attr_id': 624, 'fixed_ips': [{'subnet_id': '069b1784-6c14-42f6-a10c-b0d4447b6091', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:22:06Z', 'updated_at': '2021-12-09T21:22:08Z', 'revision_number': 2, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'subnets': [{'id': '069b1784-6c14-42f6-a10c-b0d4447b6091', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:09.723387 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f13981c6-6307-41ec-959b-1c7d5e2175f6 None None] The sync data for ids ['5cb2944b-70be-4f74-b4d0-e06f75765688'] in n-d-713301-27 is: [{'id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'name': 'tempest-ServersTestManualDisk-255636487-router', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26'}], 'enable_snat': True}, 'gw_port_id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:21:59Z', 'updated_at': '2021-12-09T21:22:07Z', 'revision_number': 4, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'gw_port': {'id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:cd:fd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'device_owner': 'network:router_gateway', 'standard_attr_id': 623, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:22:02Z', 'updated_at': '2021-12-09T21:22:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'cd61cf32-db9c-49d2-8b1c-50a6abb2e135', 'name': '', 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'mac_address': 'fa:16:3e:e5:cc:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'device_owner': 'network:router_interface', 'standard_attr_id': 624, 'fixed_ips': [{'subnet_id': '069b1784-6c14-42f6-a10c-b0d4447b6091', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:22:06Z', 'updated_at': '2021-12-09T21:22:08Z', 'revision_number': 2, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'subnets': [{'id': '069b1784-6c14-42f6-a10c-b0d4447b6091', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:22:09.739637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=e145c03d-6648-46c7-8b51-c9e9acd70ff2,revision_number=9']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:09.918485 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:22:09.955837 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e8834a5-f9b9-4b57-91b6-40e3593ad26d req-9026dcec-178b-4c53-ab73-70f26c23dde7 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.5420606 Dec 09 21:22:09.989421 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-a4754090-b12d-4830-b081-71ebdcfabad6 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=06bbcbacf3914054b6d39114daad8f77&shared=False HTTP/1.1" status: 200 len: 213 time: 0.4570966 Dec 09 21:22:10.037603 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c97622ca-9a4d-4d14-abea-fbd5cd50daa8 req-78201056-6711-457e-88d8-27bfb2beb79d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:10.040075 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c97622ca-9a4d-4d14-abea-fbd5cd50daa8 req-78201056-6711-457e-88d8-27bfb2beb79d service neutron] 10.222.0.10 "GET /v2.0/subnets?id=c49a62cc-af1b-4958-a4a9-eb44188b8fb9 HTTP/1.1" status: 200 len: 861 time: 0.7343397 Dec 09 21:22:10.048093 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-ad88b5ed-e03f-42fa-9e33-548d7a6df59e service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4084597 Dec 09 21:22:10.304750 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1abdf62e-943c-4ac2-8c68-08458fefc377 req-96a98000-432c-4d6f-a11f-eb03c6ad70bf service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2406669 Dec 09 21:22:10.361566 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c97622ca-9a4d-4d14-abea-fbd5cd50daa8 req-4d9451b0-8ad3-4c78-b65e-3af76a30328d service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=93378dc3-2ac5-4cf7-9ce3-d812934de40c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.3095856 Dec 09 21:22:10.468161 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea1fb248-5a63-46de-8f8c-7056e7a69d33 admin admin] Network 6b0e1b89-20b6-4a70-94cb-58b2b1f77a20 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:22:10.510653 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-ea1fb248-5a63-46de-8f8c-7056e7a69d33 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:22:10.526669 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-4e28634e-3dc1-47eb-b372-5374895eeac8 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:10.529352 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-4e28634e-3dc1-47eb-b372-5374895eeac8 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.5391243 Dec 09 21:22:10.567265 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-851010ef-bdeb-4658-a569-96c88c9a7c3e req-2060ab52-3961-422e-9edf-ec0833cb3fdb tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:10.570353 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-851010ef-bdeb-4658-a569-96c88c9a7c3e req-2060ab52-3961-422e-9edf-ec0833cb3fdb tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 944 time: 0.6470852 Dec 09 21:22:10.687918 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-dda8a2c4-3768-4346-aa63-c76d78dea9f4 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/quotas/06bbcbacf3914054b6d39114daad8f77 HTTP/1.1" status: 200 len: 375 time: 0.1315699 Dec 09 21:22:10.761240 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-f8612900-8d42-42ef-a244-215ee6210627 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=06bbcbacf3914054b6d39114daad8f77&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0532134 Dec 09 21:22:10.794323 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-851010ef-bdeb-4658-a569-96c88c9a7c3e req-e7c31dd4-13a9-455a-83d0-dd5a121812ef tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2013810 Dec 09 21:22:10.830276 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c97622ca-9a4d-4d14-abea-fbd5cd50daa8 req-646049f6-40a2-4122-b60d-0433f01801d2 service neutron] 10.222.0.10 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4220486 Dec 09 21:22:10.845643 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ea1fb248-5a63-46de-8f8c-7056e7a69d33 admin admin] Router 5cb2944b-70be-4f74-b4d0-e06f75765688 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:22:11.001484 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2bd2ac4b-3f98-4b90-ae0b-3df9e1f27f51 None None] Provisioning complete for port cd61cf32-db9c-49d2-8b1c-50a6abb2e135 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:11.002070 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2bd2ac4b-3f98-4b90-ae0b-3df9e1f27f51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:11.137503 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-2bd2ac4b-3f98-4b90-ae0b-3df9e1f27f51 None None] Port cd61cf32-db9c-49d2-8b1c-50a6abb2e135 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:22:11.264573 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c97622ca-9a4d-4d14-abea-fbd5cd50daa8 req-3b4470a7-7c42-4dae-bfbf-50b768bc01ac service neutron] 10.222.0.10 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4251499 Dec 09 21:22:11.332096 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-697f07dd-78f3-4226-a762-6afbc861f177 req-960b6bee-9bfc-4b4a-9547-c3e863f50993 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:11.340151 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-697f07dd-78f3-4226-a762-6afbc861f177 req-960b6bee-9bfc-4b4a-9547-c3e863f50993 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 948 time: 0.3108861 Dec 09 21:22:11.416759 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ea1fb248-5a63-46de-8f8c-7056e7a69d33 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:22:11.430760 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ea1fb248-5a63-46de-8f8c-7056e7a69d33 admin admin] 10.222.0.13 "PUT /v2.0/routers/5cb2944b-70be-4f74-b4d0-e06f75765688/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.9924753 Dec 09 21:22:11.438966 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e5c0d4f-3ec5-48e7-97ea-5cb8930ef637 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:11.490460 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-697f07dd-78f3-4226-a762-6afbc861f177 req-85fd7ed5-1ea8-4c75-b0e4-94f456f68719 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1493111 Dec 09 21:22:12.060033 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-8e5c0d4f-3ec5-48e7-97ea-5cb8930ef637 admin admin] Deleting port f50209a6-36fd-4aea-927f-b79127351066 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:22:12.060646 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e5c0d4f-3ec5-48e7-97ea-5cb8930ef637 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:12.247343 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-90e9800f-4f6c-4127-973c-73fede340b0d tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=06bbcbacf3914054b6d39114daad8f77&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0702085 Dec 09 21:22:12.320530 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-8e5c0d4f-3ec5-48e7-97ea-5cb8930ef637 admin admin] For port f50209a6-36fd-4aea-927f-b79127351066, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f50209a6-36fd-4aea-927f-b79127351066,segment=NetworkSegment(946d0405-6c7f-49a7-81bb-30e422c98100),segment_id=946d0405-6c7f-49a7-81bb-30e422c98100)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:12.333562 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e5c0d4f-3ec5-48e7-97ea-5cb8930ef637 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:12.396298 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-8e5c0d4f-3ec5-48e7-97ea-5cb8930ef637 admin admin] Calling delete_port for f50209a6-36fd-4aea-927f-b79127351066 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:22:12.524001 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-8a326f8d-966a-4e97-9925-8f062bece1fe tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:12.525915 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-8a326f8d-966a-4e97-9925-8f062bece1fe tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2711644 Dec 09 21:22:12.556975 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-bce742ec-a15d-4a2c-b05c-7f8530c7d151 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/quotas/06bbcbacf3914054b6d39114daad8f77 HTTP/1.1" status: 200 len: 375 time: 0.0178523 Dec 09 21:22:12.613262 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-8327fa1d-c97f-4037-ad71-26f1caef115a tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=06bbcbacf3914054b6d39114daad8f77&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0522437 Dec 09 21:22:12.878819 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-500832b2-1113-4ffb-b552-a5528de4f8ef tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=06bbcbacf3914054b6d39114daad8f77&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0580969 Dec 09 21:22:12.941154 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e145c03d-6648-46c7-8b51-c9e9acd70ff2 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:22:12.956156 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e5c0d4f-3ec5-48e7-97ea-5cb8930ef637 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:13.037057 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e5c0d4f-3ec5-48e7-97ea-5cb8930ef637 admin admin] Pushing event deleted for resources: {'Port': ['ID=f50209a6-36fd-4aea-927f-b79127351066,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:13.114345 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33040) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:13.122456 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2fd01525-95ea-4fa1-ac37-900bfe098de1 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Request body: {'security_group': {'name': 'tempest-securitygroup--98681430', 'description': 'tempest-description--889714388'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:22:13.201948 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2fd01525-95ea-4fa1-ac37-900bfe098de1 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:13.254922 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa220786-15c4-4436-a5de-2d214297bfa8 req-f18bfc8d-209b-4bab-b365-f88a1617add0 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:13.267327 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aa220786-15c4-4436-a5de-2d214297bfa8 req-f18bfc8d-209b-4bab-b365-f88a1617add0 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 944 time: 0.3836906 Dec 09 21:22:13.483165 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 49e167c2-19e7-4bc9-9de1-decd671125c0 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:22:13.484193 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-74b8d0d4-e86f-4f52-9a30-16343e63ace7 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:13.488697 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-74b8d0d4-e86f-4f52-9a30-16343e63ace7 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.5971370 Dec 09 21:22:13.516075 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aa220786-15c4-4436-a5de-2d214297bfa8 req-a601c273-aeff-456d-9bc8-cd4407d25309 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2438819 Dec 09 21:22:13.540134 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-b510aaec-c82e-46e3-b4df-97ae213165c5 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Request body: {'port': {'device_id': '8f48a806-013e-480e-81ac-1a7f5f10c155', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '06bbcbacf3914054b6d39114daad8f77'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:22:13.626524 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 49e167c2-19e7-4bc9-9de1-decd671125c0 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:13.627300 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:13.647431 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2fd01525-95ea-4fa1-ac37-900bfe098de1 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:13.661861 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2fd01525-95ea-4fa1-ac37-900bfe098de1 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:13.726280 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port e145c03d-6648-46c7-8b51-c9e9acd70ff2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e145c03d-6648-46c7-8b51-c9e9acd70ff2,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:13.751541 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'e145c03d-6648-46c7-8b51-c9e9acd70ff2', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': 'e145c03d-6648-46c7-8b51-c9e9acd70ff2', 'mac_address': 'fa:16:3e:ef:72:31', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.184'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:22:13.845395 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:13.849203 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f0526d9f-bb26-4bd7-a4ad-44df33bbc4c7 req-cd542ea4-d63e-40b8-b32e-c09f222f1099 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/ports?device_id=63d23827-0eb3-4c4c-87f7-698524a008f5 HTTP/1.1" status: 200 len: 210 time: 0.1458454 Dec 09 21:22:13.868730 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] Sync routers for ids ['5cb2944b-70be-4f74-b4d0-e06f75765688'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:22:13.869660 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2fd01525-95ea-4fa1-ac37-900bfe098de1 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:13.880241 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2fd01525-95ea-4fa1-ac37-900bfe098de1 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.7643769 Dec 09 21:22:13.881332 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33058) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:13.884098 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 49e167c2-19e7-4bc9-9de1-decd671125c0, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=49e167c2-19e7-4bc9-9de1-decd671125c0,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:13.886918 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd01525-95ea-4fa1-ac37-900bfe098de1 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Pushing event updated for resources: {'SecurityGroup': ['ID=47b47381-681d-49da-8acd-4d26ea16fbc0,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:13.892066 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] Routers {'5cb2944b-70be-4f74-b4d0-e06f75765688'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:22:13.894003 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:22:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['5cb2944b-70be-4f74-b4d0-e06f75765688'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:13.917663 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-5047ea61-34d8-4970-88b2-226c8964cb04 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Request body: {'security_group_rule': {'security_group_id': '47b47381-681d-49da-8acd-4d26ea16fbc0', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:22:13.926354 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:13.940647 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e5c0d4f-3ec5-48e7-97ea-5cb8930ef637 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:13.972008 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:14.001149 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e145c03d-6648-46c7-8b51-c9e9acd70ff2 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:22:14.014253 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=49e167c2-19e7-4bc9-9de1-decd671125c0,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:14.035030 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port e145c03d-6648-46c7-8b51-c9e9acd70ff2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e145c03d-6648-46c7-8b51-c9e9acd70ff2,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:14.045106 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:14.067599 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5047ea61-34d8-4970-88b2-226c8964cb04 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:14.077335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6077d07-8c93-4ca0-a106-c925dd9a8c6c req-12c15234-59b7-4318-8e6e-f8c01cced242 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:14.078961 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c6077d07-8c93-4ca0-a106-c925dd9a8c6c req-12c15234-59b7-4318-8e6e-f8c01cced242 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 948 time: 0.5294905 Dec 09 21:22:14.173297 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] Set router 5cb2944b-70be-4f74-b4d0-e06f75765688 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:22:14.200206 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=e145c03d-6648-46c7-8b51-c9e9acd70ff2,revision_number=10']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:14.289274 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c6077d07-8c93-4ca0-a106-c925dd9a8c6c req-c5f5f760-4a87-49bc-acee-3e423dd6ebfd tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1954350 Dec 09 21:22:14.302465 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['e145c03d-6648-46c7-8b51-c9e9acd70ff2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:22:14.387418 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5047ea61-34d8-4970-88b2-226c8964cb04 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:14.396788 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5047ea61-34d8-4970-88b2-226c8964cb04 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:14.423672 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5047ea61-34d8-4970-88b2-226c8964cb04 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=959a15ff-bd11-4da1-be30-985a33a2861b,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:14.454929 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-b510aaec-c82e-46e3-b4df-97ae213165c5 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Made reservation on behalf of 06bbcbacf3914054b6d39114daad8f77 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:22:14.458489 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-b510aaec-c82e-46e3-b4df-97ae213165c5 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:14.480857 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-b510aaec-c82e-46e3-b4df-97ae213165c5 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:14.530911 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5047ea61-34d8-4970-88b2-226c8964cb04 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:14.537290 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5047ea61-34d8-4970-88b2-226c8964cb04 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6404896 Dec 09 21:22:14.543986 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33090) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:14.558638 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-1e573c4b-ea8d-4f07-b64e-24346455a361 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Request body: {'security_group_rule': {'security_group_id': '47b47381-681d-49da-8acd-4d26ea16fbc0', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:22:14.675176 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-b510aaec-c82e-46e3-b4df-97ae213165c5 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:14.776928 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-b510aaec-c82e-46e3-b4df-97ae213165c5 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:14.821251 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e573c4b-ea8d-4f07-b64e-24346455a361 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:14.830688 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b8a175c9-bce3-4d64-8587-ec2fbb07c894 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.10 "GET /v2.0/networks?tenant_id=06bbcbacf3914054b6d39114daad8f77&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0786829 Dec 09 21:22:14.893604 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8e5c0d4f-3ec5-48e7-97ea-5cb8930ef637 admin admin] Router 3b833388-9a85-4de2-9ce7-fd22b400c313 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:22:15.027888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b8a512c5-03b2-4125-a8fb-4b0a99df0d46 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:15.030176 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b8a512c5-03b2-4125-a8fb-4b0a99df0d46 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1913161 Dec 09 21:22:15.049109 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'name': 'tempest-ServersTestManualDisk-255636487-router', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26'}], 'enable_snat': True}, 'gw_port_id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:21:59Z', 'updated_at': '2021-12-09T21:22:07Z', 'revision_number': 4, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'gw_port': {'id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:cd:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'device_owner': 'network:router_gateway', 'standard_attr_id': 623, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:22:02Z', 'updated_at': '2021-12-09T21:22:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'cd61cf32-db9c-49d2-8b1c-50a6abb2e135', 'name': '', 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'mac_address': 'fa:16:3e:e5:cc:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'device_owner': 'network:router_interface', 'standard_attr_id': 624, 'fixed_ips': [{'subnet_id': '069b1784-6c14-42f6-a10c-b0d4447b6091', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:22:06Z', 'updated_at': '2021-12-09T21:22:08Z', 'revision_number': 2, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'subnets': [{'id': '069b1784-6c14-42f6-a10c-b0d4447b6091', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:15.054081 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 49e167c2-19e7-4bc9-9de1-decd671125c0 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:22:15.065333 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-836a7ba8-ddbd-49f7-b0f0-c9cc24d0ea3c tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Request body: {'port': {'device_id': '63d23827-0eb3-4c4c-87f7-698524a008f5', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '06bbcbacf3914054b6d39114daad8f77'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:22:15.106000 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] Checking router: 5cb2944b-70be-4f74-b4d0-e06f75765688 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:22:15.108030 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] Updating router 5cb2944b-70be-4f74-b4d0-e06f75765688 port cd61cf32-db9c-49d2-8b1c-50a6abb2e135 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:22:15.138886 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8e5c0d4f-3ec5-48e7-97ea-5cb8930ef637 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:22:15.151900 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8e5c0d4f-3ec5-48e7-97ea-5cb8930ef637 admin admin] 10.222.0.13 "PUT /v2.0/routers/3b833388-9a85-4de2-9ce7-fd22b400c313/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 6.4096241 Dec 09 21:22:15.154094 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33110) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:15.168894 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:15.181803 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2a8bb7f-ba0e-49b0-93b8-93ffb44f191a None None] Sync routers for ids ['3b833388-9a85-4de2-9ce7-fd22b400c313'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:22:15.205134 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2a8bb7f-ba0e-49b0-93b8-93ffb44f191a None None] Routers {'3b833388-9a85-4de2-9ce7-fd22b400c313'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:22:15.207318 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-d2a8bb7f-ba0e-49b0-93b8-93ffb44f191a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:22:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3b833388-9a85-4de2-9ce7-fd22b400c313'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:15.225847 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c1277d3-4c5d-4896-b31f-de15cc0a9920 req-c34669cc-4cb1-4b51-b032-98c353201ccb tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:15.240110 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c1277d3-4c5d-4896-b31f-de15cc0a9920 req-c34669cc-4cb1-4b51-b032-98c353201ccb tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 950 time: 0.5632608 Dec 09 21:22:15.261348 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e573c4b-ea8d-4f07-b64e-24346455a361 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:15.273077 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e573c4b-ea8d-4f07-b64e-24346455a361 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:15.322454 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e573c4b-ea8d-4f07-b64e-24346455a361 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:15.322622 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 49e167c2-19e7-4bc9-9de1-decd671125c0 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:15.324639 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1e573c4b-ea8d-4f07-b64e-24346455a361 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.7785778 Dec 09 21:22:15.328031 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e573c4b-ea8d-4f07-b64e-24346455a361 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cbaa7785-a4e5-4855-863d-a5b5e5e6a865,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:15.328191 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:15.334738 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33114) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:15.341420 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-f5fcfd19-ed7f-466d-a556-d3e241afb4fc tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:22:15.399821 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5fcfd19-ed7f-466d-a556-d3e241afb4fc tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks [] for floatingip, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:15.414163 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c1277d3-4c5d-4896-b31f-de15cc0a9920 req-aa4a4b46-290d-4369-a911-f8e0223970eb tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1726565 Dec 09 21:22:15.445804 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b510aaec-c82e-46e3-b4df-97ae213165c5 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Pushing event updated for resources: {'SecurityGroup': ['ID=24094cbf-e652-478e-bb06-edc8eb774ee3,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:15.531060 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-d2a8bb7f-ba0e-49b0-93b8-93ffb44f191a None None] Set router 3b833388-9a85-4de2-9ce7-fd22b400c313 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:22:15.682822 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-b510aaec-c82e-46e3-b4df-97ae213165c5 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Allocated IP 192.168.233.242 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/4425d491-9b2e-48a2-8fb6-ead05da81dba) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:22:15.742106 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:15.765242 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:15.791512 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5fcfd19-ed7f-466d-a556-d3e241afb4fc tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:15.811276 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56b375f4-461f-47ac-ac70-2b33cacd9f54 admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:15.906165 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-d2a8bb7f-ba0e-49b0-93b8-93ffb44f191a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-85948487-router', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54'}], 'enable_snat': True}, 'gw_port_id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:12Z', 'updated_at': '2021-12-09T21:22:12Z', 'revision_number': 5, 'project_id': '615039519ef147c78eb38a1d65eac061', 'gw_port': {'id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:32:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:13Z', 'updated_at': '2021-12-09T21:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:15.923922 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b499420f-6dc8-45f8-9537-4e35f538fd16 None None] Pushing event updated for resources: {'Port': ['ID=cd61cf32-db9c-49d2-8b1c-50a6abb2e135,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:15.931578 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] Attempting to bind port cd61cf32-db9c-49d2-8b1c-50a6abb2e135 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:22:15.932219 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] Attempting to bind port cd61cf32-db9c-49d2-8b1c-50a6abb2e135 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'e74944d5-8114-4627-bc98-88385d8b16f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:22:15.932734 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] Attempting to bind port cd61cf32-db9c-49d2-8b1c-50a6abb2e135 on network 6b0e1b89-20b6-4a70-94cb-58b2b1f77a20 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:22:15.939138 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b499420f-6dc8-45f8-9537-4e35f538fd16 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:15.939663 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b499420f-6dc8-45f8-9537-4e35f538fd16 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:15.940144 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b499420f-6dc8-45f8-9537-4e35f538fd16 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:15.940619 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b499420f-6dc8-45f8-9537-4e35f538fd16 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:15.941109 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b499420f-6dc8-45f8-9537-4e35f538fd16 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:15.941577 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b499420f-6dc8-45f8-9537-4e35f538fd16 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:15.942043 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b499420f-6dc8-45f8-9537-4e35f538fd16 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:15.942519 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b499420f-6dc8-45f8-9537-4e35f538fd16 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:15.942984 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b499420f-6dc8-45f8-9537-4e35f538fd16 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:15.943478 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b499420f-6dc8-45f8-9537-4e35f538fd16 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:15.943943 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b499420f-6dc8-45f8-9537-4e35f538fd16 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:15.944434 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b499420f-6dc8-45f8-9537-4e35f538fd16 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:15.944892 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b499420f-6dc8-45f8-9537-4e35f538fd16 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:15.948560 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 22, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:22:15.949212 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] Checking segment: {'id': 'e74944d5-8114-4627-bc98-88385d8b16f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:22:15.949840 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:15.950425 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] Bound using segment: {'id': 'e74944d5-8114-4627-bc98-88385d8b16f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:22:15.951124 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] Bound port: cd61cf32-db9c-49d2-8b1c-50a6abb2e135, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e74944d5-8114-4627-bc98-88385d8b16f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:22:15.951765 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:15.986651 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2a8bb7f-ba0e-49b0-93b8-93ffb44f191a None None] Checking router: 3b833388-9a85-4de2-9ce7-fd22b400c313 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:22:16.007074 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2a8bb7f-ba0e-49b0-93b8-93ffb44f191a None None] Routers {'3b833388-9a85-4de2-9ce7-fd22b400c313'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:22:16.009861 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-d2a8bb7f-ba0e-49b0-93b8-93ffb44f191a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:22:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3b833388-9a85-4de2-9ce7-fd22b400c313'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:16.033907 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] For port cd61cf32-db9c-49d2-8b1c-50a6abb2e135, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:22:16.038151 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] For port cd61cf32-db9c-49d2-8b1c-50a6abb2e135, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=cd61cf32-db9c-49d2-8b1c-50a6abb2e135,segment=NetworkSegment(e74944d5-8114-4627-bc98-88385d8b16f0),segment_id=e74944d5-8114-4627-bc98-88385d8b16f0)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:22:16.048296 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:16.092256 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-b510aaec-c82e-46e3-b4df-97ae213165c5 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:16.118675 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b499420f-6dc8-45f8-9537-4e35f538fd16 None None] Pushing event updated for resources: {'Port': ['ID=cd61cf32-db9c-49d2-8b1c-50a6abb2e135,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:16.170191 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] Routers {'5cb2944b-70be-4f74-b4d0-e06f75765688'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:22:16.171325 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:22:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['5cb2944b-70be-4f74-b4d0-e06f75765688'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:16.194322 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab84a2f1-acfe-4055-ba46-18811e983f48 req-de670cb7-af5a-4657-bb24-453ae22bdd43 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/ports?device_id=63d23827-0eb3-4c4c-87f7-698524a008f5 HTTP/1.1" status: 200 len: 210 time: 0.3601203 Dec 09 21:22:16.224613 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-b510aaec-c82e-46e3-b4df-97ae213165c5 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:16.293553 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56b375f4-461f-47ac-ac70-2b33cacd9f54 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:16.310393 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-58b1818e-5708-424b-8c62-d59a2efa91e6 None None] Provisioning complete for port cd61cf32-db9c-49d2-8b1c-50a6abb2e135 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:16.318697 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-58b1818e-5708-424b-8c62-d59a2efa91e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:16.341140 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-f5fcfd19-ed7f-466d-a556-d3e241afb4fc tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Allocated IP 172.25.3.9 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/d198bf95-9a77-4ca5-b505-50c064e2e08b) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:22:16.384892 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] Set router 5cb2944b-70be-4f74-b4d0-e06f75765688 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:22:16.394768 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-d2a8bb7f-ba0e-49b0-93b8-93ffb44f191a None None] Set router 3b833388-9a85-4de2-9ce7-fd22b400c313 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:22:16.409696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-836a7ba8-ddbd-49f7-b0f0-c9cc24d0ea3c tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Made reservation on behalf of 06bbcbacf3914054b6d39114daad8f77 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:22:16.419600 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-836a7ba8-ddbd-49f7-b0f0-c9cc24d0ea3c tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:16.448589 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c6a36f4-293b-4c1d-b859-2f17573b26e5 req-e69ef5b8-cd88-46cf-8f84-f0ff84148fad tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:16.465185 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7c6a36f4-293b-4c1d-b859-2f17573b26e5 req-e69ef5b8-cd88-46cf-8f84-f0ff84148fad tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 944 time: 1.2225771 Dec 09 21:22:16.642171 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-b510aaec-c82e-46e3-b4df-97ae213165c5 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:22:16.740888 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5fcfd19-ed7f-466d-a556-d3e241afb4fc tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:16.815231 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5fcfd19-ed7f-466d-a556-d3e241afb4fc tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:16.822747 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'name': 'tempest-ServersTestManualDisk-255636487-router', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26'}], 'enable_snat': True}, 'gw_port_id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:21:59Z', 'updated_at': '2021-12-09T21:22:07Z', 'revision_number': 4, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'gw_port': {'id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:cd:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'device_owner': 'network:router_gateway', 'standard_attr_id': 623, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:22:02Z', 'updated_at': '2021-12-09T21:22:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'cd61cf32-db9c-49d2-8b1c-50a6abb2e135', 'name': '', 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'mac_address': 'fa:16:3e:e5:cc:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'device_owner': 'network:router_interface', 'standard_attr_id': 624, 'fixed_ips': [{'subnet_id': '069b1784-6c14-42f6-a10c-b0d4447b6091', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:22:06Z', 'updated_at': '2021-12-09T21:22:16Z', 'revision_number': 4, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'subnets': [{'id': '069b1784-6c14-42f6-a10c-b0d4447b6091', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:16.884161 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-58b1818e-5708-424b-8c62-d59a2efa91e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:16.893805 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8fe3352-d1f4-4e00-a6ef-4e10328ad421 None None] The sync data for ids ['5cb2944b-70be-4f74-b4d0-e06f75765688'] in n-d-713301-27 is: [{'id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'name': 'tempest-ServersTestManualDisk-255636487-router', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26'}], 'enable_snat': True}, 'gw_port_id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:21:59Z', 'updated_at': '2021-12-09T21:22:07Z', 'revision_number': 4, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'gw_port': {'id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:cd:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'device_owner': 'network:router_gateway', 'standard_attr_id': 623, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:22:02Z', 'updated_at': '2021-12-09T21:22:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'cd61cf32-db9c-49d2-8b1c-50a6abb2e135', 'name': '', 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'mac_address': 'fa:16:3e:e5:cc:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'device_owner': 'network:router_interface', 'standard_attr_id': 624, 'fixed_ips': [{'subnet_id': '069b1784-6c14-42f6-a10c-b0d4447b6091', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:22:06Z', 'updated_at': '2021-12-09T21:22:16Z', 'revision_number': 4, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'subnets': [{'id': '069b1784-6c14-42f6-a10c-b0d4447b6091', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:22:16.917144 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5fcfd19-ed7f-466d-a556-d3e241afb4fc tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:22:16.937617 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-f5fcfd19-ed7f-466d-a556-d3e241afb4fc tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:22:16.985126 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e145c03d-6648-46c7-8b51-c9e9acd70ff2 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:22:17.005710 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-836a7ba8-ddbd-49f7-b0f0-c9cc24d0ea3c tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Allocated IP 192.168.233.49 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/66544e42-b228-4e80-9ed2-bc699bb1993e) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:22:17.014980 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5fcfd19-ed7f-466d-a556-d3e241afb4fc tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:22:17.028016 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-d2a8bb7f-ba0e-49b0-93b8-93ffb44f191a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-85948487-router', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54'}], 'enable_snat': True}, 'gw_port_id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:12Z', 'updated_at': '2021-12-09T21:22:12Z', 'revision_number': 5, 'project_id': '615039519ef147c78eb38a1d65eac061', 'gw_port': {'id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:32:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:13Z', 'updated_at': '2021-12-09T21:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:17.128983 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-58b1818e-5708-424b-8c62-d59a2efa91e6 None None] For port cd61cf32-db9c-49d2-8b1c-50a6abb2e135, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=cd61cf32-db9c-49d2-8b1c-50a6abb2e135,segment=NetworkSegment(e74944d5-8114-4627-bc98-88385d8b16f0),segment_id=e74944d5-8114-4627-bc98-88385d8b16f0)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:17.130159 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2a8bb7f-ba0e-49b0-93b8-93ffb44f191a None None] The sync data for ids ['3b833388-9a85-4de2-9ce7-fd22b400c313'] in n-d-713301-27 is: [{'id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-85948487-router', 'tenant_id': '615039519ef147c78eb38a1d65eac061', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54'}], 'enable_snat': True}, 'gw_port_id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:12Z', 'updated_at': '2021-12-09T21:22:12Z', 'revision_number': 5, 'project_id': '615039519ef147c78eb38a1d65eac061', 'gw_port': {'id': '71527fbc-15cc-46f2-a01a-e672b6c89577', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:54:32:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3b833388-9a85-4de2-9ce7-fd22b400c313', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.54', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:13Z', 'updated_at': '2021-12-09T21:17:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:22:17.138894 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5fcfd19-ed7f-466d-a556-d3e241afb4fc tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Pushing event updated for resources: {'Port': ['ID=d198bf95-9a77-4ca5-b505-50c064e2e08b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:17.141834 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device cd61cf32-db9c-49d2-8b1c-50a6abb2e135 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:22:17.153044 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-56b375f4-461f-47ac-ac70-2b33cacd9f54 admin admin] Deleting port 71527fbc-15cc-46f2-a01a-e672b6c89577 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:22:17.153383 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56b375f4-461f-47ac-ac70-2b33cacd9f54 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:17.201321 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-58b1818e-5708-424b-8c62-d59a2efa91e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:17.324213 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5fcfd19-ed7f-466d-a556-d3e241afb4fc tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:17.355519 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-56b375f4-461f-47ac-ac70-2b33cacd9f54 admin admin] For port 71527fbc-15cc-46f2-a01a-e672b6c89577, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=71527fbc-15cc-46f2-a01a-e672b6c89577,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:17.355925 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56b375f4-461f-47ac-ac70-2b33cacd9f54 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:17.392035 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-56b375f4-461f-47ac-ac70-2b33cacd9f54 admin admin] Calling delete_port for 71527fbc-15cc-46f2-a01a-e672b6c89577 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:22:17.427972 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5fcfd19-ed7f-466d-a556-d3e241afb4fc tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:17.620096 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58b1818e-5708-424b-8c62-d59a2efa91e6 None None] Pushing event updated for resources: {'Port': ['ID=cd61cf32-db9c-49d2-8b1c-50a6abb2e135,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:17.692734 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port cd61cf32-db9c-49d2-8b1c-50a6abb2e135 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:17.693551 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:17.756197 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b18aa12d-edc6-44a3-ba42-dbab0c55bdb5 None None] Provisioning complete for port cd61cf32-db9c-49d2-8b1c-50a6abb2e135 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:17.756575 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b18aa12d-edc6-44a3-ba42-dbab0c55bdb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:17.777343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b510aaec-c82e-46e3-b4df-97ae213165c5 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Pushing event updated for resources: {'Port': ['ID=4425d491-9b2e-48a2-8fb6-ead05da81dba,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:17.812197 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-b510aaec-c82e-46e3-b4df-97ae213165c5 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:22:17.823737 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-b510aaec-c82e-46e3-b4df-97ae213165c5 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:22:17.849427 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port e145c03d-6648-46c7-8b51-c9e9acd70ff2 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:17.849427 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:18.152803 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:18.193783 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8bbb9251-ec6e-45d8-b751-2b2b490cbe3b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e145c03d-6648-46c7-8b51-c9e9acd70ff2'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:22:18.203423 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-36147fdb-6367-4ff3-994c-c28679963b5f" -d '{"events": [{"server_uuid": "8bbb9251-ec6e-45d8-b751-2b2b490cbe3b", "name": "network-vif-plugged", "status": "completed", "tag": "e145c03d-6648-46c7-8b51-c9e9acd70ff2"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:22:18.228734 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port e145c03d-6648-46c7-8b51-c9e9acd70ff2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e145c03d-6648-46c7-8b51-c9e9acd70ff2,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:18.237836 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:18.240108 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:22:18.253354 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7c6a36f4-293b-4c1d-b859-2f17573b26e5 req-806305e0-a8db-4625-a000-dbf079fe3945 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.7871349 Dec 09 21:22:18.322528 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-b510aaec-c82e-46e3-b4df-97ae213165c5 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:18.323215 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-b510aaec-c82e-46e3-b4df-97ae213165c5 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:18.383712 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-030690ad-8341-4f8b-99ec-08f84cc1aef3 req-8b7ccd35-0234-4707-b79d-c8fe039c1a03 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:18.385185 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-030690ad-8341-4f8b-99ec-08f84cc1aef3 req-8b7ccd35-0234-4707-b79d-c8fe039c1a03 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.10 "GET /v2.0/ports?device_id=e9419ae1-ea8a-47ae-82d5-b82f1353ca2f HTTP/1.1" status: 200 len: 945 time: 0.4138014 Dec 09 21:22:18.415396 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=e145c03d-6648-46c7-8b51-c9e9acd70ff2,revision_number=11']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:18.460538 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-239753c1-0202-4833-a53c-8ed10059c104 None None] Provisioning complete for port 4425d491-9b2e-48a2-8fb6-ead05da81dba triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:18.461584 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-239753c1-0202-4833-a53c-8ed10059c104 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:18.495791 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-b510aaec-c82e-46e3-b4df-97ae213165c5 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 4.9776573 Dec 09 21:22:18.508592 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56b375f4-461f-47ac-ac70-2b33cacd9f54 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:18.526434 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-836a7ba8-ddbd-49f7-b0f0-c9cc24d0ea3c tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:18.532495 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-c19dce08-bf7a-46c9-b14f-afd59106691b service neutron] Request body: {'port': {'device_id': '8f48a806-013e-480e-81ac-1a7f5f10c155', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:22:18.542028 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56b375f4-461f-47ac-ac70-2b33cacd9f54 admin admin] Pushing event deleted for resources: {'Port': ['ID=71527fbc-15cc-46f2-a01a-e672b6c89577,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:18.543586 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-a1796bfa-f2cb-4abc-80ac-cb88ee65fe4f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:18.552384 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-a1796bfa-f2cb-4abc-80ac-cb88ee65fe4f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/networks?id=8e0b26d7-eefe-4c85-b535-944f3c15f0f6 HTTP/1.1" status: 200 len: 805 time: 1.4359233 Dec 09 21:22:18.555688 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-788b5a2e-8c00-4e5a-ae18-33fa1bd1c524 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=857de64ecc3946e3b92655f639d782df&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1220405 Dec 09 21:22:18.568987 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-239753c1-0202-4833-a53c-8ed10059c104 None None] Port 4425d491-9b2e-48a2-8fb6-ead05da81dba cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:22:18.575530 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-c983a099-b984-488f-a608-fb47d238848f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/quotas/7233ac85d55e4123a22cfa34bc1ee70e HTTP/1.1" status: 200 len: 375 time: 0.0221767 Dec 09 21:22:18.594627 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:18.635036 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56b375f4-461f-47ac-ac70-2b33cacd9f54 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:18.648685 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:18.659719 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:18.736770 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:18.740887 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5fcfd19-ed7f-466d-a556-d3e241afb4fc tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:18.746317 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56b375f4-461f-47ac-ac70-2b33cacd9f54 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:18.748870 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56b375f4-461f-47ac-ac70-2b33cacd9f54 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:18.750541 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5fcfd19-ed7f-466d-a556-d3e241afb4fc tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:18.796823 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-eed921ad-b0fb-4057-b3e8-0ee21ecfc85c tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=7233ac85d55e4123a22cfa34bc1ee70e&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2202997 Dec 09 21:22:18.823035 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-c19dce08-bf7a-46c9-b14f-afd59106691b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:18.854721 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56b375f4-461f-47ac-ac70-2b33cacd9f54 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:18.855193 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-56b375f4-461f-47ac-ac70-2b33cacd9f54 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3b833388-9a85-4de2-9ce7-fd22b400c313 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:22:18.856879 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5fcfd19-ed7f-466d-a556-d3e241afb4fc tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Pushing event updated for resources: {'Port': ['ID=d198bf95-9a77-4ca5-b505-50c064e2e08b,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:18.861371 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56b375f4-461f-47ac-ac70-2b33cacd9f54 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:18.865306 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-56b375f4-461f-47ac-ac70-2b33cacd9f54 admin admin] 10.222.0.13 "DELETE /v2.0/routers/3b833388-9a85-4de2-9ce7-fd22b400c313 HTTP/1.1" status: 204 len: 168 time: 3.7073088 Dec 09 21:22:18.866524 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33158) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:18.912826 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5fcfd19-ed7f-466d-a556-d3e241afb4fc tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:18.919913 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-32222aa1-1145-4865-8451-707d12c1e639 service neutron] 10.222.0.13 "GET /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0889447 Dec 09 21:22:18.937334 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-7330ebc7-fd86-47ae-884d-d2c86346906e admin admin] Deleting subnet 9755e5ea-99a7-4073-8693-293dcc00b929 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:22:18.941100 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7330ebc7-fd86-47ae-884d-d2c86346906e admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:18.954310 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-836a7ba8-ddbd-49f7-b0f0-c9cc24d0ea3c tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:18.974744 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5fcfd19-ed7f-466d-a556-d3e241afb4fc tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:18.981353 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f5fcfd19-ed7f-466d-a556-d3e241afb4fc tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 691 time: 3.6455081 Dec 09 21:22:19.011698 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7330ebc7-fd86-47ae-884d-d2c86346906e admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:19.035728 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-df5a1af6-0af6-4af5-bb3b-ecdcd7ba2f16 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:19.037314 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-df5a1af6-0af6-4af5-bb3b-ecdcd7ba2f16 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4462862 Dec 09 21:22:19.149626 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7330ebc7-fd86-47ae-884d-d2c86346906e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:19.156250 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-030690ad-8341-4f8b-99ec-08f84cc1aef3 req-8436fe0e-d201-4bfa-9e77-6caf93ed2d8b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Deleting port b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:22:19.156586 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-030690ad-8341-4f8b-99ec-08f84cc1aef3 req-8436fe0e-d201-4bfa-9e77-6caf93ed2d8b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:19.162125 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-836a7ba8-ddbd-49f7-b0f0-c9cc24d0ea3c tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:22:19.169307 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-b8095fb8-8841-4ea5-bf46-efc460dea798 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/quotas/857de64ecc3946e3b92655f639d782df HTTP/1.1" status: 200 len: 375 time: 0.0987699 Dec 09 21:22:19.173734 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-836a7ba8-ddbd-49f7-b0f0-c9cc24d0ea3c tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Pushing event updated for resources: {'Port': ['ID=66544e42-b228-4e80-9ed2-bc699bb1993e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:19.191900 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-836a7ba8-ddbd-49f7-b0f0-c9cc24d0ea3c tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:22:19.231041 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7330ebc7-fd86-47ae-884d-d2c86346906e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:19.240420 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-836a7ba8-ddbd-49f7-b0f0-c9cc24d0ea3c tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:22:19.264433 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7330ebc7-fd86-47ae-884d-d2c86346906e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9755e5ea-99a7-4073-8693-293dcc00b929,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:19.271594 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7330ebc7-fd86-47ae-884d-d2c86346906e admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:19.276358 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7330ebc7-fd86-47ae-884d-d2c86346906e admin admin] 10.222.0.13 "DELETE /v2.0/subnets/9755e5ea-99a7-4073-8693-293dcc00b929 HTTP/1.1" status: 204 len: 168 time: 0.4083183 Dec 09 21:22:19.278730 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33166) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:19.284989 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c8ee3b7-1e83-429d-ab34-2c30567c6dc7 None None] Network ce6b6bd1-6a60-4cea-9b70-69fd0290796c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:22:19.373514 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f95003c1-3e35-4f31-8c3a-3118af9ef8f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:19.457136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device cd61cf32-db9c-49d2-8b1c-50a6abb2e135 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:22:19.486711 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-f95003c1-3e35-4f31-8c3a-3118af9ef8f1 admin admin] Deleting port 716dcb03-4af5-4350-90fc-5640b99cb0cd {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:22:19.487050 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f95003c1-3e35-4f31-8c3a-3118af9ef8f1 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:19.519920 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-8d95d97d-7a4a-403f-95e5-73dadd59b2d1 service neutron] 10.222.0.13 "GET /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5777338 Dec 09 21:22:19.574819 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port cd61cf32-db9c-49d2-8b1c-50a6abb2e135 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:19.575338 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:19.602179 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9785a365-21d8-4202-befd-d0e56725aa1f None None] DHCP port deletion for ce6b6bd1-6a60-4cea-9b70-69fd0290796c request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:22:19.608658 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-836a7ba8-ddbd-49f7-b0f0-c9cc24d0ea3c tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:19.609327 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-836a7ba8-ddbd-49f7-b0f0-c9cc24d0ea3c tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:19.632748 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-43c339b5-bcf8-4ac4-8b7f-b4c0fa59adfc tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&fields=id HTTP/1.1" status: 200 len: 348 time: 0.4561372 Dec 09 21:22:19.645447 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-f95003c1-3e35-4f31-8c3a-3118af9ef8f1 admin admin] For port 716dcb03-4af5-4350-90fc-5640b99cb0cd, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=716dcb03-4af5-4350-90fc-5640b99cb0cd,segment=NetworkSegment(946d0405-6c7f-49a7-81bb-30e422c98100),segment_id=946d0405-6c7f-49a7-81bb-30e422c98100)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:19.646021 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f95003c1-3e35-4f31-8c3a-3118af9ef8f1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:19.646123 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-030690ad-8341-4f8b-99ec-08f84cc1aef3 req-8436fe0e-d201-4bfa-9e77-6caf93ed2d8b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] For port b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:19.646388 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-030690ad-8341-4f8b-99ec-08f84cc1aef3 req-8436fe0e-d201-4bfa-9e77-6caf93ed2d8b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:19.669163 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-f95003c1-3e35-4f31-8c3a-3118af9ef8f1 admin admin] Calling delete_port for 716dcb03-4af5-4350-90fc-5640b99cb0cd owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:22:19.669790 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-836a7ba8-ddbd-49f7-b0f0-c9cc24d0ea3c tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 4.6091642 Dec 09 21:22:19.671179 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-030690ad-8341-4f8b-99ec-08f84cc1aef3 req-8436fe0e-d201-4bfa-9e77-6caf93ed2d8b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Calling delete_port for b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:22:19.678108 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6e492eb7-2d1c-4cb3-9f9c-4120a27017ba None None] Provisioning complete for port 66544e42-b228-4e80-9ed2-bc699bb1993e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:19.678682 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6e492eb7-2d1c-4cb3-9f9c-4120a27017ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:19.687854 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b17225b8-102d-4440-baf9-7f8637216f28 service neutron] Request body: {'port': {'device_id': '63d23827-0eb3-4c4c-87f7-698524a008f5', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:22:19.769796 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-6e492eb7-2d1c-4cb3-9f9c-4120a27017ba None None] Port 66544e42-b228-4e80-9ed2-bc699bb1993e cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:22:19.801847 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9785a365-21d8-4202-befd-d0e56725aa1f None None] Deleting port 716dcb03-4af5-4350-90fc-5640b99cb0cd {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:22:19.802271 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9785a365-21d8-4202-befd-d0e56725aa1f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:19.829264 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f50209a6-36fd-4aea-927f-b79127351066 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:22:19.891013 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f95003c1-3e35-4f31-8c3a-3118af9ef8f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:19.892623 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-c19dce08-bf7a-46c9-b14f-afd59106691b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4425d491-9b2e-48a2-8fb6-ead05da81dba {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:22:19.902764 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b17225b8-102d-4440-baf9-7f8637216f28 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:19.912060 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-c19dce08-bf7a-46c9-b14f-afd59106691b service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:19.960619 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f95003c1-3e35-4f31-8c3a-3118af9ef8f1 admin admin] Pushing event deleted for resources: {'Port': ['ID=716dcb03-4af5-4350-90fc-5640b99cb0cd,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:19.985434 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f95003c1-3e35-4f31-8c3a-3118af9ef8f1 admin admin] No DVR routers for this DVR port 716dcb03-4af5-4350-90fc-5640b99cb0cd on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:22:19.987820 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: f50209a6-36fd-4aea-927f-b79127351066 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:22:19.988162 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f50209a6-36fd-4aea-927f-b79127351066 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:22:20.018269 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-c19dce08-bf7a-46c9-b14f-afd59106691b service neutron] Transition to ACTIVE for port object 4425d491-9b2e-48a2-8fb6-ead05da81dba will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:22:20.070389 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-c19dce08-bf7a-46c9-b14f-afd59106691b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:20.102246 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-9785a365-21d8-4202-befd-d0e56725aa1f None None] For port 716dcb03-4af5-4350-90fc-5640b99cb0cd, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=716dcb03-4af5-4350-90fc-5640b99cb0cd,segment=NetworkSegment(946d0405-6c7f-49a7-81bb-30e422c98100),segment_id=946d0405-6c7f-49a7-81bb-30e422c98100)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:20.105906 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9785a365-21d8-4202-befd-d0e56725aa1f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:20.140775 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9785a365-21d8-4202-befd-d0e56725aa1f None None] Calling delete_port for 716dcb03-4af5-4350-90fc-5640b99cb0cd owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:22:20.206332 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:22:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9726bdb2-a395-4145-9213-058957b7072d x-openstack-request-id: req-9726bdb2-a395-4145-9213-058957b7072d {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:22:20.206878 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8bbb9251-ec6e-45d8-b751-2b2b490cbe3b", "name": "network-vif-plugged", "status": "completed", "tag": "e145c03d-6648-46c7-8b51-c9e9acd70ff2", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:22:20.207276 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-9726bdb2-a395-4145-9213-058957b7072d {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:22:20.207838 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8bbb9251-ec6e-45d8-b751-2b2b490cbe3b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e145c03d-6648-46c7-8b51-c9e9acd70ff2', 'code': 200} Dec 09 21:22:20.260286 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f95003c1-3e35-4f31-8c3a-3118af9ef8f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:20.288164 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9785a365-21d8-4202-befd-d0e56725aa1f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:20.312848 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-f95003c1-3e35-4f31-8c3a-3118af9ef8f1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ce6b6bd1-6a60-4cea-9b70-69fd0290796c']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:20.329223 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-f95003c1-3e35-4f31-8c3a-3118af9ef8f1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '946d0405-6c7f-49a7-81bb-30e422c98100') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:20.329837 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-f95003c1-3e35-4f31-8c3a-3118af9ef8f1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '946d0405-6c7f-49a7-81bb-30e422c98100') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:20.351589 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f95003c1-3e35-4f31-8c3a-3118af9ef8f1 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:20.363341 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9785a365-21d8-4202-befd-d0e56725aa1f None None] Pushing event deleted for resources: {'Port': ['ID=716dcb03-4af5-4350-90fc-5640b99cb0cd,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:20.369214 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9785a365-21d8-4202-befd-d0e56725aa1f None None] No DVR routers for this DVR port 716dcb03-4af5-4350-90fc-5640b99cb0cd on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:22:20.405387 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f95003c1-3e35-4f31-8c3a-3118af9ef8f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:20.433261 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f95003c1-3e35-4f31-8c3a-3118af9ef8f1 admin admin] Releasing vlan 141 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:22:20.433700 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f95003c1-3e35-4f31-8c3a-3118af9ef8f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:22:20.435886 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:22:20.578722 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f95003c1-3e35-4f31-8c3a-3118af9ef8f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:20.589998 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f95003c1-3e35-4f31-8c3a-3118af9ef8f1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:20.596571 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f95003c1-3e35-4f31-8c3a-3118af9ef8f1 admin admin] 10.222.0.13 "DELETE /v2.0/networks/ce6b6bd1-6a60-4cea-9b70-69fd0290796c HTTP/1.1" status: 204 len: 168 time: 1.3133395 Dec 09 21:22:20.596888 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33200) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:20.615020 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f95003c1-3e35-4f31-8c3a-3118af9ef8f1 admin admin] Pushing event deleted for resources: {'Network': ['ID=ce6b6bd1-6a60-4cea-9b70-69fd0290796c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:20.672471 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-030690ad-8341-4f8b-99ec-08f84cc1aef3 req-8436fe0e-d201-4bfa-9e77-6caf93ed2d8b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:20.674272 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c19dce08-bf7a-46c9-b14f-afd59106691b service neutron] Pushing event updated for resources: {'Port': ['ID=4425d491-9b2e-48a2-8fb6-ead05da81dba,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:20.705479 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ed63d19-f89e-43f1-a063-5f1c12471dd9 req-63c5a482-4de5-4633-baef-3b94cc4cb69b tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:20.714125 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3ed63d19-f89e-43f1-a063-5f1c12471dd9 req-63c5a482-4de5-4633-baef-3b94cc4cb69b tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/ports?device_id=63d23827-0eb3-4c4c-87f7-698524a008f5 HTTP/1.1" status: 200 len: 935 time: 0.6799593 Dec 09 21:22:20.793988 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8436fe0e-d201-4bfa-9e77-6caf93ed2d8b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Pushing event deleted for resources: {'Port': ['ID=b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:20.916833 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-8a6bb5a5-d061-41f9-a222-d9b97f50de30 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-securitygroup--98681430&fields=id&tenant_id=2429d4a7c27042e7ab6a04a9cf722b47 HTTP/1.1" status: 200 len: 267 time: 0.4718189 Dec 09 21:22:20.974496 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:22:21.031689 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 71527fbc-15cc-46f2-a01a-e672b6c89577 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:22:21.058325 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:22:21.058985 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:22:21.061989 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 71527fbc-15cc-46f2-a01a-e672b6c89577 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:22:21.062570 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 71527fbc-15cc-46f2-a01a-e672b6c89577 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:22:21.063318 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 716dcb03-4af5-4350-90fc-5640b99cb0cd no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:22:21.089519 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 716dcb03-4af5-4350-90fc-5640b99cb0cd {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:22:21.090304 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 716dcb03-4af5-4350-90fc-5640b99cb0cd not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:22:21.195057 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-faaa0538-f3a9-4edd-93da-487c16183cbf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:21.259742 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-030690ad-8341-4f8b-99ec-08f84cc1aef3 req-8436fe0e-d201-4bfa-9e77-6caf93ed2d8b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] No DVR routers for this DVR port b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:22:21.278581 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-030690ad-8341-4f8b-99ec-08f84cc1aef3 req-8436fe0e-d201-4bfa-9e77-6caf93ed2d8b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:21.281887 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-030690ad-8341-4f8b-99ec-08f84cc1aef3 req-8436fe0e-d201-4bfa-9e77-6caf93ed2d8b tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.10 "DELETE /v2.0/ports/b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8 HTTP/1.1" status: 204 len: 173 time: 2.8765724 Dec 09 21:22:21.282567 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-c19dce08-bf7a-46c9-b14f-afd59106691b service neutron] Attempting to bind port 4425d491-9b2e-48a2-8fb6-ead05da81dba on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:22:21.282892 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-c19dce08-bf7a-46c9-b14f-afd59106691b service neutron] Attempting to bind port 4425d491-9b2e-48a2-8fb6-ead05da81dba by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:22:21.283216 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-c19dce08-bf7a-46c9-b14f-afd59106691b service neutron] Attempting to bind port 4425d491-9b2e-48a2-8fb6-ead05da81dba on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:22:21.285109 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e9419ae1-ea8a-47ae-82d5-b82f1353ca2f', 'name': 'network-vif-deleted', 'tag': 'b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:22:21.287372 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aa7cf7da-89d3-4dd4-8206-5f9b11a30994" -d '{"events": [{"server_uuid": "e9419ae1-ea8a-47ae-82d5-b82f1353ca2f", "name": "network-vif-deleted", "tag": "b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:22:21.316540 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3ed63d19-f89e-43f1-a063-5f1c12471dd9 req-af1a9d73-e5aa-420d-9af6-f43af94ee832 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/security-groups?id=24094cbf-e652-478e-bb06-edc8eb774ee3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5995951 Dec 09 21:22:21.331290 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-c19dce08-bf7a-46c9-b14f-afd59106691b service neutron] Port 4425d491-9b2e-48a2-8fb6-ead05da81dba on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:22:21.341054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-c19dce08-bf7a-46c9-b14f-afd59106691b service neutron] Attempting to bind port 4425d491-9b2e-48a2-8fb6-ead05da81dba on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:22:21.481635 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-c19dce08-bf7a-46c9-b14f-afd59106691b service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 21, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:22:21.483408 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-c19dce08-bf7a-46c9-b14f-afd59106691b service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:22:21.483880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-c19dce08-bf7a-46c9-b14f-afd59106691b service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:22:21.484324 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-c19dce08-bf7a-46c9-b14f-afd59106691b service neutron] Bound port: 4425d491-9b2e-48a2-8fb6-ead05da81dba, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:22:21.484725 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-c19dce08-bf7a-46c9-b14f-afd59106691b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:21.623736 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-ab76f093-7e6a-4b81-96be-33dc81c22551 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:21.630958 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-ab76f093-7e6a-4b81-96be-33dc81c22551 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/networks?id=6b0e1b89-20b6-4a70-94cb-58b2b1f77a20 HTTP/1.1" status: 200 len: 811 time: 0.7125964 Dec 09 21:22:21.650828 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-faaa0538-f3a9-4edd-93da-487c16183cbf admin admin] Deleting port dafd2da4-b1b3-45eb-b531-31ec58a729fb {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:22:21.651461 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-faaa0538-f3a9-4edd-93da-487c16183cbf admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:21.669120 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5755995b-c968-4507-87f9-f37fd322554a req-c9204413-46e0-4e93-825e-252b9d6c51de tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:21.676388 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5755995b-c968-4507-87f9-f37fd322554a req-c9204413-46e0-4e93-825e-252b9d6c51de tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 944 time: 0.2224185 Dec 09 21:22:21.712309 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-1b7e7b7d-b2fb-4112-a762-a523452dc841 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/quotas/2429d4a7c27042e7ab6a04a9cf722b47 HTTP/1.1" status: 200 len: 375 time: 0.0803373 Dec 09 21:22:21.737979 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-c07859ee-40e6-4d61-83a3-64c324705adf tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:21.740389 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-c07859ee-40e6-4d61-83a3-64c324705adf tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.31 "GET /v2.0/networks?id=8e0b26d7-eefe-4c85-b535-944f3c15f0f6 HTTP/1.1" status: 200 len: 805 time: 0.2295542 Dec 09 21:22:21.759147 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b17225b8-102d-4440-baf9-7f8637216f28 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 66544e42-b228-4e80-9ed2-bc699bb1993e {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:22:21.765625 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-b0146ab5-2738-4782-bd3f-cfc9f3af470f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Request body: {'port': {'device_id': 'b9b4e0ee-aaae-4214-be9d-1af0b5120e5d', 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6', 'admin_state_up': True, 'tenant_id': '7233ac85d55e4123a22cfa34bc1ee70e'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:22:21.776897 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b17225b8-102d-4440-baf9-7f8637216f28 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:21.784951 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-c19dce08-bf7a-46c9-b14f-afd59106691b service neutron] For port 4425d491-9b2e-48a2-8fb6-ead05da81dba, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:22:21.814071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-faaa0538-f3a9-4edd-93da-487c16183cbf admin admin] For port dafd2da4-b1b3-45eb-b531-31ec58a729fb, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=dafd2da4-b1b3-45eb-b531-31ec58a729fb,segment=NetworkSegment(62eb78e6-cc6d-47a2-ae0f-cbd25ddbdfa4),segment_id=62eb78e6-cc6d-47a2-ae0f-cbd25ddbdfa4)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:21.818493 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-c19dce08-bf7a-46c9-b14f-afd59106691b service neutron] For port 4425d491-9b2e-48a2-8fb6-ead05da81dba, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=4425d491-9b2e-48a2-8fb6-ead05da81dba,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:22:21.821630 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-faaa0538-f3a9-4edd-93da-487c16183cbf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:21.832612 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b17225b8-102d-4440-baf9-7f8637216f28 service neutron] Transition to ACTIVE for port object 66544e42-b228-4e80-9ed2-bc699bb1993e will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:22:21.837448 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-c19dce08-bf7a-46c9-b14f-afd59106691b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:21.854672 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-faaa0538-f3a9-4edd-93da-487c16183cbf admin admin] Calling delete_port for dafd2da4-b1b3-45eb-b531-31ec58a729fb owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:22:21.883924 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5755995b-c968-4507-87f9-f37fd322554a req-cb7a9e1f-90ff-4081-809b-5f1346f774c3 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1985347 Dec 09 21:22:21.884740 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b17225b8-102d-4440-baf9-7f8637216f28 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:21.918301 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-8ba9cedb-aa93-48e6-a81c-4091de287fdc tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=2429d4a7c27042e7ab6a04a9cf722b47&fields=id HTTP/1.1" status: 200 len: 302 time: 0.2050664 Dec 09 21:22:21.983414 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-c19dce08-bf7a-46c9-b14f-afd59106691b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:21.984393 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-c19dce08-bf7a-46c9-b14f-afd59106691b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:21.986201 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-c19dce08-bf7a-46c9-b14f-afd59106691b service neutron] 10.222.0.31 "PUT /v2.0/ports/4425d491-9b2e-48a2-8fb6-ead05da81dba HTTP/1.1" status: 200 len: 1097 time: 3.4578576 Dec 09 21:22:22.122133 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c19dce08-bf7a-46c9-b14f-afd59106691b service neutron] Pushing event updated for resources: {'Port': ['ID=4425d491-9b2e-48a2-8fb6-ead05da81dba,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:22.126390 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-572c5d8e-4c60-4910-8432-5360b7b0b3d0 req-4dfeeb4c-394d-4ffc-8750-225aabae7e07 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=b9b4e0ee-aaae-4214-be9d-1af0b5120e5d HTTP/1.1" status: 200 len: 210 time: 0.0743361 Dec 09 21:22:22.139129 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-65511c34-38f3-4ece-a4f5-8d194133e2f3 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=857de64ecc3946e3b92655f639d782df&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1089461 Dec 09 21:22:22.209171 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e9419ae1-ea8a-47ae-82d5-b82f1353ca2f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:22:22.212385 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6bd126b2-bd97-4b5a-a27a-3f07888c8ed6" -d '{"events": [{"server_uuid": "e9419ae1-ea8a-47ae-82d5-b82f1353ca2f", "name": "network-vif-unplugged", "status": "completed", "tag": "b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:22:22.300287 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-09f61438-6802-4ca1-83af-b0c47ea89582 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:22.302497 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-09f61438-6802-4ca1-83af-b0c47ea89582 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=06bbcbacf3914054b6d39114daad8f77&device_id=8f48a806-013e-480e-81ac-1a7f5f10c155 HTTP/1.1" status: 200 len: 1100 time: 0.1966119 Dec 09 21:22:22.334936 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-b0146ab5-2738-4782-bd3f-cfc9f3af470f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Made reservation on behalf of 7233ac85d55e4123a22cfa34bc1ee70e for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:22:22.339007 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-b0146ab5-2738-4782-bd3f-cfc9f3af470f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:22.356615 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b17225b8-102d-4440-baf9-7f8637216f28 service neutron] Pushing event updated for resources: {'Port': ['ID=66544e42-b228-4e80-9ed2-bc699bb1993e,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:22.361189 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-412a0c50-3b83-4d95-9f3f-542912edcea4 req-caf6fe88-a6c7-4cec-8737-dddd354e8940 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 210 time: 0.0874319 Dec 09 21:22:22.380569 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-4707b8a1-eb77-4ba4-a5b9-0d4374b453fc service neutron] 10.222.0.13 "GET /v2.0/networks/6b0e1b89-20b6-4a70-94cb-58b2b1f77a20?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4412727 Dec 09 21:22:22.407257 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-ee3c98e2-c705-4dc9-a3b5-b5bfb6e680c3 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.242&port_id=4425d491-9b2e-48a2-8fb6-ead05da81dba HTTP/1.1" status: 200 len: 217 time: 0.0834453 Dec 09 21:22:22.474215 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-faaa0538-f3a9-4edd-93da-487c16183cbf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:22.491122 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-ac343393-b439-4e00-86b7-d6e3f8415c43 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:22.494261 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-ac343393-b439-4e00-86b7-d6e3f8415c43 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3370829 Dec 09 21:22:22.499552 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b17225b8-102d-4440-baf9-7f8637216f28 service neutron] Attempting to bind port 66544e42-b228-4e80-9ed2-bc699bb1993e on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:22:22.500143 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b17225b8-102d-4440-baf9-7f8637216f28 service neutron] Attempting to bind port 66544e42-b228-4e80-9ed2-bc699bb1993e by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:22:22.501682 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b17225b8-102d-4440-baf9-7f8637216f28 service neutron] Attempting to bind port 66544e42-b228-4e80-9ed2-bc699bb1993e on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:22:22.517980 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-647e18c5-9c64-4f7c-a320-d9c0ec62a263 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Request body: {'port': {'device_id': '7604cfe7-6a20-4212-ac7d-57d16969b9fd', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '857de64ecc3946e3b92655f639d782df'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:22:22.521987 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b17225b8-102d-4440-baf9-7f8637216f28 service neutron] Port 66544e42-b228-4e80-9ed2-bc699bb1993e on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:22:22.522496 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b17225b8-102d-4440-baf9-7f8637216f28 service neutron] Attempting to bind port 66544e42-b228-4e80-9ed2-bc699bb1993e on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:22:22.563700 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b17225b8-102d-4440-baf9-7f8637216f28 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 21, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:22:22.563960 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b17225b8-102d-4440-baf9-7f8637216f28 service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:22:22.564441 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b17225b8-102d-4440-baf9-7f8637216f28 service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:22:22.564955 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b17225b8-102d-4440-baf9-7f8637216f28 service neutron] Bound port: 66544e42-b228-4e80-9ed2-bc699bb1993e, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:22:22.565565 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b17225b8-102d-4440-baf9-7f8637216f28 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:22.629021 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faaa0538-f3a9-4edd-93da-487c16183cbf admin admin] Pushing event deleted for resources: {'Port': ['ID=dafd2da4-b1b3-45eb-b531-31ec58a729fb,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:22.660138 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:22:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3835962a-cf08-4039-9aff-2c66833c1f89 x-openstack-request-id: req-3835962a-cf08-4039-9aff-2c66833c1f89 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:22:22.660436 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e9419ae1-ea8a-47ae-82d5-b82f1353ca2f", "name": "network-vif-deleted", "tag": "b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:22:22.660692 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-3835962a-cf08-4039-9aff-2c66833c1f89 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:22:22.661091 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e9419ae1-ea8a-47ae-82d5-b82f1353ca2f', 'name': 'network-vif-deleted', 'tag': 'b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8', 'status': 'completed', 'code': 200} Dec 09 21:22:22.677652 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:22:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c9997a76-5e4e-42ca-a2b5-d944a765c49a x-openstack-request-id: req-c9997a76-5e4e-42ca-a2b5-d944a765c49a {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:22:22.678684 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e9419ae1-ea8a-47ae-82d5-b82f1353ca2f", "name": "network-vif-unplugged", "status": "completed", "tag": "b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:22:22.679107 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c9997a76-5e4e-42ca-a2b5-d944a765c49a {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:22:22.680993 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e9419ae1-ea8a-47ae-82d5-b82f1353ca2f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b838adf8-01a3-4c6b-a3bc-6f75d8bb6cf8', 'code': 200} Dec 09 21:22:22.692061 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-fae7878a-6a95-41c9-9a3e-a15286730d73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:22.696122 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-fae7878a-6a95-41c9-9a3e-a15286730d73 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.2790837 Dec 09 21:22:22.727155 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-de5acee1-7aa7-49ac-a7d5-6ebdfbbec3ad service neutron] 10.222.0.13 "GET /v2.0/networks/6b0e1b89-20b6-4a70-94cb-58b2b1f77a20?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3432820 Dec 09 21:22:22.864969 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b17225b8-102d-4440-baf9-7f8637216f28 service neutron] For port 66544e42-b228-4e80-9ed2-bc699bb1993e, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:22:22.930834 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b17225b8-102d-4440-baf9-7f8637216f28 service neutron] For port 66544e42-b228-4e80-9ed2-bc699bb1993e, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=66544e42-b228-4e80-9ed2-bc699bb1993e,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:22:22.952411 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b17225b8-102d-4440-baf9-7f8637216f28 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:23.000531 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-b0146ab5-2738-4782-bd3f-cfc9f3af470f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Allocated IP 172.20.0.3 (8e0b26d7-eefe-4c85-b535-944f3c15f0f6/63e7603a-bb11-4d1a-8d84-55456d81931c/7f26d4c2-71a3-44d0-bf00-8c0c0833f323) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:22:23.006495 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-87483780-66f9-4c50-ac25-ae5da46693ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:23.008603 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-87483780-66f9-4c50-ac25-ae5da46693ce service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.3033521 Dec 09 21:22:23.146041 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edfa8ef1-4a77-477f-9a4c-9f0b9687c42b req-ea03a567-2cac-4dfb-b99d-f17afa3418f4 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:23.149756 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-edfa8ef1-4a77-477f-9a4c-9f0b9687c42b req-ea03a567-2cac-4dfb-b99d-f17afa3418f4 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/ports?device_id=63d23827-0eb3-4c4c-87f7-698524a008f5 HTTP/1.1" status: 200 len: 947 time: 0.3690176 Dec 09 21:22:23.169550 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-647e18c5-9c64-4f7c-a320-d9c0ec62a263 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Made reservation on behalf of 857de64ecc3946e3b92655f639d782df for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:22:23.176564 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-647e18c5-9c64-4f7c-a320-d9c0ec62a263 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:23.208907 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-faaa0538-f3a9-4edd-93da-487c16183cbf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:23.239775 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b17225b8-102d-4440-baf9-7f8637216f28 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:23.240859 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b17225b8-102d-4440-baf9-7f8637216f28 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:23.242576 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-b17225b8-102d-4440-baf9-7f8637216f28 service neutron] 10.222.0.10 "PUT /v2.0/ports/66544e42-b228-4e80-9ed2-bc699bb1993e HTTP/1.1" status: 200 len: 1096 time: 3.5598524 Dec 09 21:22:23.248031 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-a7c75e6f-9ff6-46f2-82bd-b993a58ce8bf service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2315369 Dec 09 21:22:23.323496 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-edfa8ef1-4a77-477f-9a4c-9f0b9687c42b req-9d846ae5-197c-45fe-b3ab-97128d6c1f48 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/security-groups?id=24094cbf-e652-478e-bb06-edc8eb774ee3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1201293 Dec 09 21:22:23.430824 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b17225b8-102d-4440-baf9-7f8637216f28 service neutron] Pushing event updated for resources: {'Port': ['ID=66544e42-b228-4e80-9ed2-bc699bb1993e,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:23.492496 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dbe21ad1-ecd2-4f28-bc70-0216530a5a12 req-9d4d3ddf-0fa0-4599-b6bf-fe14651dacc6 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/ports?device_id=a49420b5-3789-4863-bf0c-65a787f7fc78 HTTP/1.1" status: 200 len: 210 time: 0.0713813 Dec 09 21:22:23.517038 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19a9e268-e59f-485b-af5f-f91c6dbacfbf req-4f65ac7a-1163-4971-8647-64bbc63dc74e tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:23.527769 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19a9e268-e59f-485b-af5f-f91c6dbacfbf req-4f65ac7a-1163-4971-8647-64bbc63dc74e tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 944 time: 0.4380841 Dec 09 21:22:23.679784 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-3b98ffb5-af65-4a58-b39c-5f73581a3728 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:23.681874 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-3b98ffb5-af65-4a58-b39c-5f73581a3728 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=06bbcbacf3914054b6d39114daad8f77&device_id=63d23827-0eb3-4c4c-87f7-698524a008f5 HTTP/1.1" status: 200 len: 1099 time: 0.3633952 Dec 09 21:22:23.712178 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7f385988-9aa8-493f-970b-4fa813a4913c req-ea3bff82-aeff-4fae-8775-ee243b219445 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=b9b4e0ee-aaae-4214-be9d-1af0b5120e5d HTTP/1.1" status: 200 len: 210 time: 0.0597055 Dec 09 21:22:23.793848 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19a9e268-e59f-485b-af5f-f91c6dbacfbf req-9db19966-c5a0-41f1-a831-9c0688751b8b tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2595978 Dec 09 21:22:23.795680 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-551c28f3-4f91-44d3-972e-9a5458ff73d2 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.49&port_id=66544e42-b228-4e80-9ed2-bc699bb1993e HTTP/1.1" status: 200 len: 217 time: 0.0882609 Dec 09 21:22:23.810214 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-647e18c5-9c64-4f7c-a320-d9c0ec62a263 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Allocated IP 192.168.233.12 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/6f6b3fc9-0b99-4cad-869c-ed52dde9578b) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:22:23.860010 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-b0146ab5-2738-4782-bd3f-cfc9f3af470f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:23.932111 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2fb65bc4-626f-4d30-ad63-6eeff95706c4 req-d2269c84-f0ee-4f3f-a46d-77d50e5fc193 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 210 time: 0.0847526 Dec 09 21:22:23.933039 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8eed7d89-2d6f-4aef-9acd-acb244ba12bb req-cf8be596-cb74-4b8e-a700-fb8ce9981603 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6407785 Dec 09 21:22:23.965011 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-8b625cd5-bdfd-4d86-817b-21bf99565c1d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:23.966787 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-8b625cd5-bdfd-4d86-817b-21bf99565c1d service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1580796 Dec 09 21:22:24.025449 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-b0146ab5-2738-4782-bd3f-cfc9f3af470f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:24.076425 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-faaa0538-f3a9-4edd-93da-487c16183cbf admin admin] Router 7bf902d0-926e-4187-b3f7-bce2ab0302b7 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:22:24.078355 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-b0146ab5-2738-4782-bd3f-cfc9f3af470f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Network 8e0b26d7-eefe-4c85-b535-944f3c15f0f6 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:22:24.085752 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-b0146ab5-2738-4782-bd3f-cfc9f3af470f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:22:24.091064 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-b0146ab5-2738-4782-bd3f-cfc9f3af470f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:22:24.117101 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-89ff2dde-287a-440d-a379-3851e18446bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:24.118921 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-89ff2dde-287a-440d-a379-3851e18446bd service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1315219 Dec 09 21:22:24.125633 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0146ab5-2738-4782-bd3f-cfc9f3af470f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Pushing event updated for resources: {'Port': ['ID=7f26d4c2-71a3-44d0-bf00-8c0c0833f323,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:24.194788 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-b0146ab5-2738-4782-bd3f-cfc9f3af470f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:24.195465 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-b0146ab5-2738-4782-bd3f-cfc9f3af470f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:24.222025 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-b0146ab5-2738-4782-bd3f-cfc9f3af470f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.4614878 Dec 09 21:22:24.246398 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-647e18c5-9c64-4f7c-a320-d9c0ec62a263 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:24.253866 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-0cf75929-0aa0-41ca-b004-8bf660919e6e service neutron] Request body: {'port': {'device_id': 'b9b4e0ee-aaae-4214-be9d-1af0b5120e5d', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:22:24.266210 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-e08f386a-04a7-42d8-b174-56dc2a8a70fb service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1346769 Dec 09 21:22:24.303284 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-faaa0538-f3a9-4edd-93da-487c16183cbf admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:22:24.323370 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90173452-2d7f-4991-8b41-6861de8bef4a None None] Sync routers for ids ['7bf902d0-926e-4187-b3f7-bce2ab0302b7'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:22:24.327160 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-faaa0538-f3a9-4edd-93da-487c16183cbf admin admin] 10.222.0.13 "PUT /v2.0/routers/7bf902d0-926e-4187-b3f7-bce2ab0302b7/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.7261724 Dec 09 21:22:24.327160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33234) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:24.345667 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90173452-2d7f-4991-8b41-6861de8bef4a None None] Routers {'7bf902d0-926e-4187-b3f7-bce2ab0302b7'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:22:24.346801 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-90173452-2d7f-4991-8b41-6861de8bef4a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:22:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7bf902d0-926e-4187-b3f7-bce2ab0302b7'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:24.366949 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-647e18c5-9c64-4f7c-a320-d9c0ec62a263 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:24.372859 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-0cf75929-0aa0-41ca-b004-8bf660919e6e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:24.381922 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['36925110-4ed7-49f6-b07d-d998896a74cc', 'e145c03d-6648-46c7-8b51-c9e9acd70ff2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:22:24.415426 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-647e18c5-9c64-4f7c-a320-d9c0ec62a263 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:22:24.423746 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-647e18c5-9c64-4f7c-a320-d9c0ec62a263 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:22:24.436039 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-647e18c5-9c64-4f7c-a320-d9c0ec62a263 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:22:24.455379 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['204e6970-8ed3-4e91-9792-52401052a153'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:22:24.469696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-647e18c5-9c64-4f7c-a320-d9c0ec62a263 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Pushing event updated for resources: {'Port': ['ID=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:24.476900 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e837189-d6ef-4421-8ce2-434f4c2e422f req-d8d2cf51-147c-495c-9404-2584708c2b88 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2034316 Dec 09 21:22:24.548455 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-647e18c5-9c64-4f7c-a320-d9c0ec62a263 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:24.551620 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-647e18c5-9c64-4f7c-a320-d9c0ec62a263 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:24.592147 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-647e18c5-9c64-4f7c-a320-d9c0ec62a263 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 2.0780256 Dec 09 21:22:24.616318 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Request body: {'port': {'device_id': '7604cfe7-6a20-4212-ac7d-57d16969b9fd', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:22:24.629023 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1d6c611e-ba0c-463a-a421-a9f781fc1252 admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:24.681259 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8f48a806-013e-480e-81ac-1a7f5f10c155', 'tag': '4425d491-9b2e-48a2-8fb6-ead05da81dba'}, {'name': 'network-changed', 'server_uuid': '63d23827-0eb3-4c4c-87f7-698524a008f5', 'tag': '66544e42-b228-4e80-9ed2-bc699bb1993e'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:22:24.683809 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-316b0753-f49b-4f27-bb34-5ded6a1bf7de" -d '{"events": [{"name": "network-changed", "server_uuid": "8f48a806-013e-480e-81ac-1a7f5f10c155", "tag": "4425d491-9b2e-48a2-8fb6-ead05da81dba"}, {"name": "network-changed", "server_uuid": "63d23827-0eb3-4c4c-87f7-698524a008f5", "tag": "66544e42-b228-4e80-9ed2-bc699bb1993e"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:22:24.780416 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-90173452-2d7f-4991-8b41-6861de8bef4a None None] Set router 7bf902d0-926e-4187-b3f7-bce2ab0302b7 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:22:24.909382 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f9b117c0-f200-456b-9850-7aa020720344 req-341f7f67-b9b4-4a6f-b360-09ed4437b8c2 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/ports?device_id=a49420b5-3789-4863-bf0c-65a787f7fc78 HTTP/1.1" status: 200 len: 210 time: 0.2797287 Dec 09 21:22:24.996530 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 346 Content-Type: application/json Date: Thu, 09 Dec 2021 21:22:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1d032a13-5822-4423-bd8f-7410b927609f x-openstack-request-id: req-1d032a13-5822-4423-bd8f-7410b927609f {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:22:24.997542 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8f48a806-013e-480e-81ac-1a7f5f10c155", "tag": "4425d491-9b2e-48a2-8fb6-ead05da81dba", "status": "completed", "code": 200}, {"name": "network-changed", "server_uuid": "63d23827-0eb3-4c4c-87f7-698524a008f5", "tag": "66544e42-b228-4e80-9ed2-bc699bb1993e", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:22:24.997968 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-1d032a13-5822-4423-bd8f-7410b927609f {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:22:24.998536 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8f48a806-013e-480e-81ac-1a7f5f10c155', 'tag': '4425d491-9b2e-48a2-8fb6-ead05da81dba', 'status': 'completed', 'code': 200} Dec 09 21:22:24.998953 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '63d23827-0eb3-4c4c-87f7-698524a008f5', 'tag': '66544e42-b228-4e80-9ed2-bc699bb1993e', 'status': 'completed', 'code': 200} Dec 09 21:22:25.021904 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-bd7b734a-947d-40b1-81ab-d13bdec06f46 None None] Provisioning complete for port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:25.024675 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bd7b734a-947d-40b1-81ab-d13bdec06f46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:25.034028 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:25.054762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84e97df3-18a8-4ca5-b269-c02e22d07cad req-831cbbaa-51e6-43e3-b39d-790025b61e80 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:25.064688 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84e97df3-18a8-4ca5-b269-c02e22d07cad req-831cbbaa-51e6-43e3-b39d-790025b61e80 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/ports?device_id=63d23827-0eb3-4c4c-87f7-698524a008f5 HTTP/1.1" status: 200 len: 947 time: 0.4776952 Dec 09 21:22:25.103069 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-bd7b734a-947d-40b1-81ab-d13bdec06f46 None None] Port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:22:25.111318 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-90173452-2d7f-4991-8b41-6861de8bef4a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7bf902d0-926e-4187-b3f7-bce2ab0302b7', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2036517528-router', 'tenant_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.191'}], 'enable_snat': True}, 'gw_port_id': '22b93a78-dc98-434f-95ba-67b8e9cc8249', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:19Z', 'updated_at': '2021-12-09T21:22:22Z', 'revision_number': 5, 'project_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'gw_port': {'id': '22b93a78-dc98-434f-95ba-67b8e9cc8249', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:05:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bf902d0-926e-4187-b3f7-bce2ab0302b7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 59, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.191', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:17:20Z', 'updated_at': '2021-12-09T21:17:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:25.167933 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1d6c611e-ba0c-463a-a421-a9f781fc1252 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:25.186092 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-316b0753-f49b-4f27-bb34-5ded6a1bf7de req-9635e251-d407-4033-9e49-48bbe9f2684b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:25.188431 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-316b0753-f49b-4f27-bb34-5ded6a1bf7de req-9635e251-d407-4033-9e49-48bbe9f2684b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=06bbcbacf3914054b6d39114daad8f77&device_id=8f48a806-013e-480e-81ac-1a7f5f10c155 HTTP/1.1" status: 200 len: 1100 time: 0.1809170 Dec 09 21:22:25.206842 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90173452-2d7f-4991-8b41-6861de8bef4a None None] Checking router: 7bf902d0-926e-4187-b3f7-bce2ab0302b7 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:22:25.219238 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90173452-2d7f-4991-8b41-6861de8bef4a None None] Routers {'7bf902d0-926e-4187-b3f7-bce2ab0302b7'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:22:25.220214 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-90173452-2d7f-4991-8b41-6861de8bef4a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:22:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7bf902d0-926e-4187-b3f7-bce2ab0302b7'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:25.280602 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-748d19fb-89f7-4314-b314-28d35032f114 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:25.282241 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-748d19fb-89f7-4314-b314-28d35032f114 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.10 "GET /v2.0/networks?id=6b0e1b89-20b6-4a70-94cb-58b2b1f77a20 HTTP/1.1" status: 200 len: 811 time: 0.6308761 Dec 09 21:22:25.395609 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-0cf75929-0aa0-41ca-b004-8bf660919e6e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7f26d4c2-71a3-44d0-bf00-8c0c0833f323 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:22:25.401479 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-316b0753-f49b-4f27-bb34-5ded6a1bf7de req-4d16b9ba-baee-4eba-a948-c0d960ce0390 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:25.403402 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-316b0753-f49b-4f27-bb34-5ded6a1bf7de req-4d16b9ba-baee-4eba-a948-c0d960ce0390 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.2021105 Dec 09 21:22:25.410026 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-0cf75929-0aa0-41ca-b004-8bf660919e6e service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:25.415095 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1d6c611e-ba0c-463a-a421-a9f781fc1252 admin admin] Deleting port 22b93a78-dc98-434f-95ba-67b8e9cc8249 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:22:25.415588 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1d6c611e-ba0c-463a-a421-a9f781fc1252 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:25.455124 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-90173452-2d7f-4991-8b41-6861de8bef4a None None] Set router 7bf902d0-926e-4187-b3f7-bce2ab0302b7 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:22:25.477016 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-316b0753-f49b-4f27-bb34-5ded6a1bf7de req-da3462bf-d04c-48b6-b4ff-c9b527f4a667 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.242&port_id=4425d491-9b2e-48a2-8fb6-ead05da81dba HTTP/1.1" status: 200 len: 217 time: 0.0638535 Dec 09 21:22:25.478098 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-0cf75929-0aa0-41ca-b004-8bf660919e6e service neutron] Transition to ACTIVE for port object 7f26d4c2-71a3-44d0-bf00-8c0c0833f323 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:22:25.497656 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-0cf75929-0aa0-41ca-b004-8bf660919e6e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:25.537891 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-90173452-2d7f-4991-8b41-6861de8bef4a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7bf902d0-926e-4187-b3f7-bce2ab0302b7', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2036517528-router', 'tenant_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:19Z', 'updated_at': '2021-12-09T21:22:25Z', 'revision_number': 6, 'project_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:25.579195 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90173452-2d7f-4991-8b41-6861de8bef4a None None] The sync data for ids ['7bf902d0-926e-4187-b3f7-bce2ab0302b7'] in n-d-713301-27 is: [{'id': '7bf902d0-926e-4187-b3f7-bce2ab0302b7', 'name': 'tempest-ServersWithSpecificFlavorTestJSON-2036517528-router', 'tenant_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:17:19Z', 'updated_at': '2021-12-09T21:22:25Z', 'revision_number': 6, 'project_id': '51b278a30cd94ca7861ad1cdecdc94d3', 'gw_port_host': None}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:22:25.627763 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-316b0753-f49b-4f27-bb34-5ded6a1bf7de req-a9cdba33-faca-412a-8f88-006d007f99b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:25.629937 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-316b0753-f49b-4f27-bb34-5ded6a1bf7de req-a9cdba33-faca-412a-8f88-006d007f99b1 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1419399 Dec 09 21:22:25.630171 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cf75929-0aa0-41ca-b004-8bf660919e6e service neutron] Pushing event updated for resources: {'Port': ['ID=7f26d4c2-71a3-44d0-bf00-8c0c0833f323,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:25.660950 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-1d6c611e-ba0c-463a-a421-a9f781fc1252 admin admin] For port 22b93a78-dc98-434f-95ba-67b8e9cc8249, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=22b93a78-dc98-434f-95ba-67b8e9cc8249,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:25.661376 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1d6c611e-ba0c-463a-a421-a9f781fc1252 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:25.696775 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-316b0753-f49b-4f27-bb34-5ded6a1bf7de req-983caaef-07ab-4da6-bf61-dd61a7b35578 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:25.698295 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-316b0753-f49b-4f27-bb34-5ded6a1bf7de req-983caaef-07ab-4da6-bf61-dd61a7b35578 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=06bbcbacf3914054b6d39114daad8f77&device_id=63d23827-0eb3-4c4c-87f7-698524a008f5 HTTP/1.1" status: 200 len: 1099 time: 0.6921480 Dec 09 21:22:25.716350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84e97df3-18a8-4ca5-b269-c02e22d07cad req-56ecc23c-dc24-4d26-8b8a-8a8c2f043bfc tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/security-groups?id=24094cbf-e652-478e-bb06-edc8eb774ee3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6479344 Dec 09 21:22:25.722883 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1d6c611e-ba0c-463a-a421-a9f781fc1252 admin admin] Calling delete_port for 22b93a78-dc98-434f-95ba-67b8e9cc8249 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:22:25.746105 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83713920-1aa9-41f5-9bf1-1b84dfbf0264 req-faf4e44a-246c-4a73-b479-2868102ea75a tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:25.747690 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83713920-1aa9-41f5-9bf1-1b84dfbf0264 req-faf4e44a-246c-4a73-b479-2868102ea75a tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=b9b4e0ee-aaae-4214-be9d-1af0b5120e5d HTTP/1.1" status: 200 len: 931 time: 0.6372039 Dec 09 21:22:25.791630 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-316b0753-f49b-4f27-bb34-5ded6a1bf7de req-6a8db04c-2506-4e7f-9b73-861722406633 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:25.793075 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-316b0753-f49b-4f27-bb34-5ded6a1bf7de req-6a8db04c-2506-4e7f-9b73-861722406633 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1515844 Dec 09 21:22:25.827497 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-0cf75929-0aa0-41ca-b004-8bf660919e6e service neutron] Attempting to bind port 7f26d4c2-71a3-44d0-bf00-8c0c0833f323 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:22:25.827876 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-0cf75929-0aa0-41ca-b004-8bf660919e6e service neutron] Attempting to bind port 7f26d4c2-71a3-44d0-bf00-8c0c0833f323 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '41babb3e-048d-47f5-b92c-d4cf9897cc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:22:25.828287 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-0cf75929-0aa0-41ca-b004-8bf660919e6e service neutron] Attempting to bind port 7f26d4c2-71a3-44d0-bf00-8c0c0833f323 on network 8e0b26d7-eefe-4c85-b535-944f3c15f0f6 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:22:25.852390 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-0cf75929-0aa0-41ca-b004-8bf660919e6e service neutron] Port 7f26d4c2-71a3-44d0-bf00-8c0c0833f323 on network 8e0b26d7-eefe-4c85-b535-944f3c15f0f6 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:22:25.852803 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-0cf75929-0aa0-41ca-b004-8bf660919e6e service neutron] Attempting to bind port 7f26d4c2-71a3-44d0-bf00-8c0c0833f323 on network 8e0b26d7-eefe-4c85-b535-944f3c15f0f6 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:22:25.903421 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-0cf75929-0aa0-41ca-b004-8bf660919e6e service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 21, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:22:25.903874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-0cf75929-0aa0-41ca-b004-8bf660919e6e service neutron] Checking segment: {'id': '41babb3e-048d-47f5-b92c-d4cf9897cc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:22:25.904327 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-0cf75929-0aa0-41ca-b004-8bf660919e6e service neutron] Bound using segment: {'id': '41babb3e-048d-47f5-b92c-d4cf9897cc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:22:25.904849 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-0cf75929-0aa0-41ca-b004-8bf660919e6e service neutron] Bound port: 7f26d4c2-71a3-44d0-bf00-8c0c0833f323, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '41babb3e-048d-47f5-b92c-d4cf9897cc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:22:25.905253 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-0cf75929-0aa0-41ca-b004-8bf660919e6e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:25.962846 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-ad356280-de8a-42e4-a05d-1f3dec81e00d tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.10 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2429d4a7c27042e7ab6a04a9cf722b47 HTTP/1.1" status: 200 len: 378 time: 0.6658578 Dec 09 21:22:25.982364 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-40d73f38-9ab5-4bcd-ac21-0a9ac251e4cd tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Request body: {'port': {'device_id': 'a49420b5-3789-4863-bf0c-65a787f7fc78', 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20', 'admin_state_up': True, 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'security_groups': ['47b47381-681d-49da-8acd-4d26ea16fbc0']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:22:26.047719 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-316b0753-f49b-4f27-bb34-5ded6a1bf7de req-f226bb93-e30a-4a79-a41a-72a0d35cc6f1 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2433770 Dec 09 21:22:26.053986 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-0cf75929-0aa0-41ca-b004-8bf660919e6e service neutron] For port 7f26d4c2-71a3-44d0-bf00-8c0c0833f323, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:22:26.060325 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-0cf75929-0aa0-41ca-b004-8bf660919e6e service neutron] For port 7f26d4c2-71a3-44d0-bf00-8c0c0833f323, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=7f26d4c2-71a3-44d0-bf00-8c0c0833f323,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:22:26.093554 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-0cf75929-0aa0-41ca-b004-8bf660919e6e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:26.144636 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83713920-1aa9-41f5-9bf1-1b84dfbf0264 req-dfdb6720-cfa5-4832-8f41-206fde808d51 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3839283 Dec 09 21:22:26.145684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-316b0753-f49b-4f27-bb34-5ded6a1bf7de req-7c6809f5-178a-41d5-b396-07d87d2ec786 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:26.147431 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-316b0753-f49b-4f27-bb34-5ded6a1bf7de req-7c6809f5-178a-41d5-b396-07d87d2ec786 service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.4398062 Dec 09 21:22:26.164671 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c91f15d1-110f-4895-aaad-cbd71c78123c req-92aed6cb-fa30-4a99-bc17-83887346ec48 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:26.172106 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c91f15d1-110f-4895-aaad-cbd71c78123c req-92aed6cb-fa30-4a99-bc17-83887346ec48 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 944 time: 0.3504226 Dec 09 21:22:26.248586 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-316b0753-f49b-4f27-bb34-5ded6a1bf7de req-e6ca13fe-2604-46cb-b0b1-78ef0e4fae54 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.49&port_id=66544e42-b228-4e80-9ed2-bc699bb1993e HTTP/1.1" status: 200 len: 217 time: 0.0675175 Dec 09 21:22:26.414732 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c91f15d1-110f-4895-aaad-cbd71c78123c req-41b1698a-d0e5-438b-ab4e-c06ac4e4b6ff tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2410583 Dec 09 21:22:26.421441 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-316b0753-f49b-4f27-bb34-5ded6a1bf7de req-3e806666-d7fa-4ed5-8c1b-8d5a61473a04 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:26.422920 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-316b0753-f49b-4f27-bb34-5ded6a1bf7de req-3e806666-d7fa-4ed5-8c1b-8d5a61473a04 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1601224 Dec 09 21:22:26.433666 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-40d73f38-9ab5-4bcd-ac21-0a9ac251e4cd tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Made reservation on behalf of 2429d4a7c27042e7ab6a04a9cf722b47 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:22:26.437266 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-40d73f38-9ab5-4bcd-ac21-0a9ac251e4cd tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:26.524384 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-0cf75929-0aa0-41ca-b004-8bf660919e6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:26.525029 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-0cf75929-0aa0-41ca-b004-8bf660919e6e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:26.530083 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-0cf75929-0aa0-41ca-b004-8bf660919e6e service neutron] 10.222.0.31 "PUT /v2.0/ports/7f26d4c2-71a3-44d0-bf00-8c0c0833f323 HTTP/1.1" status: 200 len: 1092 time: 2.2804582 Dec 09 21:22:26.548641 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b9b4e0ee-aaae-4214-be9d-1af0b5120e5d', 'tag': '7f26d4c2-71a3-44d0-bf00-8c0c0833f323'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:22:26.551366 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6f6b3fc9-0b99-4cad-869c-ed52dde9578b {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:22:26.554810 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7dc313c5-e19f-4fa1-a4d1-021df2e30639" -d '{"events": [{"name": "network-changed", "server_uuid": "b9b4e0ee-aaae-4214-be9d-1af0b5120e5d", "tag": "7f26d4c2-71a3-44d0-bf00-8c0c0833f323"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:22:26.563786 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3001ea43-dfe5-498c-ab01-428cb7e5c67e req-bb84b629-7123-44ba-a812-3f32903b9c0c tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:26.572009 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3001ea43-dfe5-498c-ab01-428cb7e5c67e req-bb84b629-7123-44ba-a812-3f32903b9c0c tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 935 time: 0.2288365 Dec 09 21:22:26.579066 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cf75929-0aa0-41ca-b004-8bf660919e6e service neutron] Pushing event updated for resources: {'Port': ['ID=7f26d4c2-71a3-44d0-bf00-8c0c0833f323,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:26.587948 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:26.627804 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1d6c611e-ba0c-463a-a421-a9f781fc1252 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:26.638647 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-316b0753-f49b-4f27-bb34-5ded6a1bf7de req-702ced6c-3075-41bf-922c-458f2fc7c3de service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5780406 Dec 09 21:22:26.651714 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Transition to ACTIVE for port object 6f6b3fc9-0b99-4cad-869c-ed52dde9578b will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:22:26.668581 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d6c611e-ba0c-463a-a421-a9f781fc1252 admin admin] Pushing event deleted for resources: {'Port': ['ID=22b93a78-dc98-434f-95ba-67b8e9cc8249,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:26.671968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-316b0753-f49b-4f27-bb34-5ded6a1bf7de req-36416a9c-93d1-4a8a-ae47-26034dcd5020 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:26.673839 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-316b0753-f49b-4f27-bb34-5ded6a1bf7de req-36416a9c-93d1-4a8a-ae47-26034dcd5020 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.2299299 Dec 09 21:22:26.683719 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:26.723392 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71869f50-a48a-4235-b985-74b5959fd7b4 req-c4d41bbf-96de-4161-a35c-7df8b786d3e4 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/ports?device_id=a49420b5-3789-4863-bf0c-65a787f7fc78 HTTP/1.1" status: 200 len: 210 time: 0.2030461 Dec 09 21:22:26.741520 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-6e129efe-56ac-45f9-b234-39cb55c3d30e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:26.752382 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-6e129efe-56ac-45f9-b234-39cb55c3d30e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7233ac85d55e4123a22cfa34bc1ee70e&device_id=b9b4e0ee-aaae-4214-be9d-1af0b5120e5d HTTP/1.1" status: 200 len: 1095 time: 0.1575394 Dec 09 21:22:26.833466 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3001ea43-dfe5-498c-ab01-428cb7e5c67e req-6c8eb1cc-1d70-4de2-a253-fa970c2706f2 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2604704 Dec 09 21:22:26.841086 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-5599fd4d-f536-4d9b-a6cd-6eee00382ab5 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=7f26d4c2-71a3-44d0-bf00-8c0c0833f323 HTTP/1.1" status: 200 len: 217 time: 0.0799451 Dec 09 21:22:26.842050 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1d6c611e-ba0c-463a-a421-a9f781fc1252 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:26.904002 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:22:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-17fb2cd7-9cb1-475d-b15b-c9b96bce17c9 x-openstack-request-id: req-17fb2cd7-9cb1-475d-b15b-c9b96bce17c9 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:22:26.904310 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b9b4e0ee-aaae-4214-be9d-1af0b5120e5d", "tag": "7f26d4c2-71a3-44d0-bf00-8c0c0833f323", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:22:26.908846 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-17fb2cd7-9cb1-475d-b15b-c9b96bce17c9 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:22:26.909332 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b9b4e0ee-aaae-4214-be9d-1af0b5120e5d', 'tag': '7f26d4c2-71a3-44d0-bf00-8c0c0833f323', 'status': 'completed', 'code': 200} Dec 09 21:22:26.968632 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:26.969713 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-40d73f38-9ab5-4bcd-ac21-0a9ac251e4cd tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Allocated IP 172.20.0.14 (6b0e1b89-20b6-4a70-94cb-58b2b1f77a20/069b1784-6c14-42f6-a10c-b0d4447b6091/54e32685-83f3-47e4-883f-d0d7b2a9e798) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:22:26.994720 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 66544e42-b228-4e80-9ed2-bc699bb1993e details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:22:27.065523 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1d6c611e-ba0c-463a-a421-a9f781fc1252 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:27.069222 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 4425d491-9b2e-48a2-8fb6-ead05da81dba details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:22:27.078014 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1d6c611e-ba0c-463a-a421-a9f781fc1252 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:27.080706 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device dafd2da4-b1b3-45eb-b531-31ec58a729fb no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:22:27.112917 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: dafd2da4-b1b3-45eb-b531-31ec58a729fb {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:22:27.113518 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device dafd2da4-b1b3-45eb-b531-31ec58a729fb not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:22:27.114156 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 22b93a78-dc98-434f-95ba-67b8e9cc8249 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:22:27.124082 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Pushing event updated for resources: {'Port': ['ID=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:27.149684 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-98bc18e4-4d98-46b0-ba4f-259114db65a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:27.151781 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-98bc18e4-4d98-46b0-ba4f-259114db65a3 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=63e7603a-bb11-4d1a-8d84-55456d81931c HTTP/1.1" status: 200 len: 845 time: 0.2415764 Dec 09 21:22:27.155746 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1d6c611e-ba0c-463a-a421-a9f781fc1252 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:27.156459 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1d6c611e-ba0c-463a-a421-a9f781fc1252 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7bf902d0-926e-4187-b3f7-bce2ab0302b7 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:22:27.161036 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1d6c611e-ba0c-463a-a421-a9f781fc1252 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:27.162445 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1d6c611e-ba0c-463a-a421-a9f781fc1252 admin admin] 10.222.0.13 "DELETE /v2.0/routers/7bf902d0-926e-4187-b3f7-bce2ab0302b7 HTTP/1.1" status: 204 len: 168 time: 2.8346801 Dec 09 21:22:27.165134 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33266) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:27.218152 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-2861f88b-4875-468e-bdd8-d850139487d8 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=8e0b26d7-eefe-4c85-b535-944f3c15f0f6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0544305 Dec 09 21:22:27.244089 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:27.247044 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:27.248298 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:27.251463 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:27.251914 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:27.252387 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:27.253487 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:27.254601 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:27.255033 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:27.256590 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:27.257966 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:27.258144 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:27.259096 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:27.270713 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-3be7443e-d15b-4001-8455-237c5e32b602 admin admin] Deleting subnet a89d028b-7a70-4454-ba5e-148e6d4c8d8c {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:22:27.283004 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3be7443e-d15b-4001-8455-237c5e32b602 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:27.307149 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 4425d491-9b2e-48a2-8fb6-ead05da81dba, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=4425d491-9b2e-48a2-8fb6-ead05da81dba,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:27.322558 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '4425d491-9b2e-48a2-8fb6-ead05da81dba', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '4425d491-9b2e-48a2-8fb6-ead05da81dba', 'mac_address': 'fa:16:3e:11:c7:48', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.242'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:22:27.333653 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 22b93a78-dc98-434f-95ba-67b8e9cc8249 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:22:27.334570 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 22b93a78-dc98-434f-95ba-67b8e9cc8249 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:22:27.339019 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:27.391899 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3be7443e-d15b-4001-8455-237c5e32b602 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:27.402187 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-316b0753-f49b-4f27-bb34-5ded6a1bf7de req-69bbe788-ebfe-4131-8869-274df7853b6e service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7101755 Dec 09 21:22:27.412473 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:27.428520 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4425d491-9b2e-48a2-8fb6-ead05da81dba {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:22:27.433913 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-a0c0d5f2-0002-43c6-8241-ac8c6c0017d8 service neutron] 10.222.0.31 "GET /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2083678 Dec 09 21:22:27.439470 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 66544e42-b228-4e80-9ed2-bc699bb1993e, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=66544e42-b228-4e80-9ed2-bc699bb1993e,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:27.446644 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-40d73f38-9ab5-4bcd-ac21-0a9ac251e4cd tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:27.467977 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '66544e42-b228-4e80-9ed2-bc699bb1993e', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '66544e42-b228-4e80-9ed2-bc699bb1993e', 'mac_address': 'fa:16:3e:cb:27:b9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.49'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:22:27.473708 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 4425d491-9b2e-48a2-8fb6-ead05da81dba, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=4425d491-9b2e-48a2-8fb6-ead05da81dba,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:27.489877 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-627b3689-c951-44ef-9a3c-72e89695bb75 req-922fc6e0-ac1d-4019-90d5-c53763c4b304 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:27.491401 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-627b3689-c951-44ef-9a3c-72e89695bb75 req-922fc6e0-ac1d-4019-90d5-c53763c4b304 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/ports?device_id=63d23827-0eb3-4c4c-87f7-698524a008f5 HTTP/1.1" status: 200 len: 947 time: 0.3747687 Dec 09 21:22:27.504250 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:27.509328 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Attempting to bind port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:22:27.509664 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Attempting to bind port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:22:27.509994 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Attempting to bind port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:22:27.564928 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3be7443e-d15b-4001-8455-237c5e32b602 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:27.574886 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=4425d491-9b2e-48a2-8fb6-ead05da81dba,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:27.580768 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:22:27.581094 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Attempting to bind port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:22:27.586684 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:27.607401 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3e7fb26-c999-41e7-98e1-3c34b3a21f3f req-b6ed2bc3-35d3-45c8-970e-e4861521a918 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:27.610541 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 66544e42-b228-4e80-9ed2-bc699bb1993e {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:22:27.611691 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fe4a7b49-de5d-47b2-bc88-b21fb3df681a req-2d3a6e49-2c35-4e65-9e63-5be8f0c45357 service neutron] 10.222.0.31 "GET /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1668777 Dec 09 21:22:27.614761 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a3e7fb26-c999-41e7-98e1-3c34b3a21f3f req-b6ed2bc3-35d3-45c8-970e-e4861521a918 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=b9b4e0ee-aaae-4214-be9d-1af0b5120e5d HTTP/1.1" status: 200 len: 943 time: 0.2960413 Dec 09 21:22:27.636625 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 22, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:22:27.637055 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:22:27.637419 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:22:27.637890 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Bound port: 6f6b3fc9-0b99-4cad-869c-ed52dde9578b, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:22:27.638069 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 66544e42-b228-4e80-9ed2-bc699bb1993e, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=66544e42-b228-4e80-9ed2-bc699bb1993e,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:27.638233 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:27.643252 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:27.643754 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device cd5af376-d278-48fb-8867-a970b71280d9 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:22:27.663653 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3be7443e-d15b-4001-8455-237c5e32b602 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:27.705310 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-627b3689-c951-44ef-9a3c-72e89695bb75 req-332b5926-d03e-4592-8e5c-93ed099f9cc9 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/security-groups?id=24094cbf-e652-478e-bb06-edc8eb774ee3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2030888 Dec 09 21:22:27.709649 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-316b0753-f49b-4f27-bb34-5ded6a1bf7de req-7fde1ae6-db49-445e-8309-84b9e752fbc2 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2794907 Dec 09 21:22:27.739408 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3be7443e-d15b-4001-8455-237c5e32b602 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a89d028b-7a70-4454-ba5e-148e6d4c8d8c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:27.750102 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-40d73f38-9ab5-4bcd-ac21-0a9ac251e4cd tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:27.771919 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3be7443e-d15b-4001-8455-237c5e32b602 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:27.776667 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3be7443e-d15b-4001-8455-237c5e32b602 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/a89d028b-7a70-4454-ba5e-148e6d4c8d8c HTTP/1.1" status: 204 len: 168 time: 0.6104279 Dec 09 21:22:27.791785 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33274) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:27.867753 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dc313c5-e19f-4fa1-a4d1-021df2e30639 req-c781da44-e4cd-40e6-a357-99b43e2cd916 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:27.869782 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7dc313c5-e19f-4fa1-a4d1-021df2e30639 req-c781da44-e4cd-40e6-a357-99b43e2cd916 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7233ac85d55e4123a22cfa34bc1ee70e&device_id=b9b4e0ee-aaae-4214-be9d-1af0b5120e5d HTTP/1.1" status: 200 len: 1095 time: 0.2016892 Dec 09 21:22:27.873187 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port cd5af376-d278-48fb-8867-a970b71280d9, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=cd5af376-d278-48fb-8867-a970b71280d9,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:27.877166 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d40dd54-d074-4914-8706-0346e831203d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:27.882117 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a3e7fb26-c999-41e7-98e1-3c34b3a21f3f req-13e57971-af6c-441a-809b-3ff8ae6adf25 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2619169 Dec 09 21:22:27.887507 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-40d73f38-9ab5-4bcd-ac21-0a9ac251e4cd tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Network 6b0e1b89-20b6-4a70-94cb-58b2b1f77a20 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:22:27.889653 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c10d9d9-5786-4b63-979c-c37449db8d1c None None] Network 3d219282-fb31-40ab-a864-41f6397f4dcb requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:22:27.905550 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'cd5af376-d278-48fb-8867-a970b71280d9', 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c', 'port_id': 'cd5af376-d278-48fb-8867-a970b71280d9', 'mac_address': 'fa:16:3e:a7:28:41', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 100, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c49a62cc-af1b-4958-a4a9-eb44188b8fb9', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:22:27.909089 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40d73f38-9ab5-4bcd-ac21-0a9ac251e4cd tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Pushing event updated for resources: {'Port': ['ID=54e32685-83f3-47e4-883f-d0d7b2a9e798,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:27.920856 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-40d73f38-9ab5-4bcd-ac21-0a9ac251e4cd tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:22:27.924940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-40d73f38-9ab5-4bcd-ac21-0a9ac251e4cd tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:22:27.972767 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] For port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:22:28.005156 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['4425d491-9b2e-48a2-8fb6-ead05da81dba'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:22:28.028706 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] For port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:22:28.063631 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:28.072383 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dc313c5-e19f-4fa1-a4d1-021df2e30639 req-74d7a9cc-82b2-49bd-9445-0bf84e9aa139 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:28.077285 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7dc313c5-e19f-4fa1-a4d1-021df2e30639 req-74d7a9cc-82b2-49bd-9445-0bf84e9aa139 service neutron] 10.222.0.31 "GET /v2.0/networks?id=8e0b26d7-eefe-4c85-b535-944f3c15f0f6 HTTP/1.1" status: 200 len: 906 time: 0.1979041 Dec 09 21:22:28.140996 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-0d40dd54-d074-4914-8706-0346e831203d admin admin] Deleting port 95ad85de-7e3e-43ef-a88a-30b13cf2dfd2 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:22:28.141442 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d40dd54-d074-4914-8706-0346e831203d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:28.144528 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7dc313c5-e19f-4fa1-a4d1-021df2e30639 req-e170c54d-8a41-45b5-9f4d-9e8fbaf689f4 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=7f26d4c2-71a3-44d0-bf00-8c0c0833f323 HTTP/1.1" status: 200 len: 217 time: 0.0547731 Dec 09 21:22:28.151392 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-40d73f38-9ab5-4bcd-ac21-0a9ac251e4cd tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:28.152132 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-40d73f38-9ab5-4bcd-ac21-0a9ac251e4cd tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:28.179988 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:28.180857 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:28.186090 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=66544e42-b228-4e80-9ed2-bc699bb1993e,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:28.196029 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] 10.222.0.31 "PUT /v2.0/ports/6f6b3fc9-0b99-4cad-869c-ed52dde9578b HTTP/1.1" status: 200 len: 1096 time: 3.5703516 Dec 09 21:22:28.197724 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7604cfe7-6a20-4212-ac7d-57d16969b9fd', 'tag': '6f6b3fc9-0b99-4cad-869c-ed52dde9578b'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:22:28.200248 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-256bd0f3-2543-49eb-acb1-42cc164b4b1c" -d '{"events": [{"name": "network-changed", "server_uuid": "7604cfe7-6a20-4212-ac7d-57d16969b9fd", "tag": "6f6b3fc9-0b99-4cad-869c-ed52dde9578b"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:22:28.236563 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14e09820-be86-48d7-811c-1f6efc0a2140 req-a20df394-6d0d-469a-962d-253dbf39bd66 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:28.238424 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-14e09820-be86-48d7-811c-1f6efc0a2140 req-a20df394-6d0d-469a-962d-253dbf39bd66 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/ports?device_id=a49420b5-3789-4863-bf0c-65a787f7fc78 HTTP/1.1" status: 200 len: 932 time: 0.2580693 Dec 09 21:22:28.270648 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:28.278559 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-0d40dd54-d074-4914-8706-0346e831203d admin admin] For port 95ad85de-7e3e-43ef-a88a-30b13cf2dfd2, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=95ad85de-7e3e-43ef-a88a-30b13cf2dfd2,segment=NetworkSegment(62eb78e6-cc6d-47a2-ae0f-cbd25ddbdfa4),segment_id=62eb78e6-cc6d-47a2-ae0f-cbd25ddbdfa4)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:28.279772 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d40dd54-d074-4914-8706-0346e831203d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:28.288275 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cd5af376-d278-48fb-8867-a970b71280d9 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:22:28.290587 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92c954de-467c-4a6b-8123-679154e8beed req-1aed8a08-658e-49ea-892f-c134c14e020c tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:28.295673 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dc313c5-e19f-4fa1-a4d1-021df2e30639 req-2833a308-7728-4825-ad08-04bbc30b57f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:28.298174 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-92c954de-467c-4a6b-8123-679154e8beed req-1aed8a08-658e-49ea-892f-c134c14e020c tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 944 time: 0.3267472 Dec 09 21:22:28.298499 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7dc313c5-e19f-4fa1-a4d1-021df2e30639 req-2833a308-7728-4825-ad08-04bbc30b57f6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=63e7603a-bb11-4d1a-8d84-55456d81931c HTTP/1.1" status: 200 len: 845 time: 0.1421278 Dec 09 21:22:28.308596 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-40d73f38-9ab5-4bcd-ac21-0a9ac251e4cd tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.3334734 Dec 09 21:22:28.352917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-0d40dd54-d074-4914-8706-0346e831203d admin admin] Calling delete_port for 95ad85de-7e3e-43ef-a88a-30b13cf2dfd2 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:22:28.356713 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7dc313c5-e19f-4fa1-a4d1-021df2e30639 req-0b315836-4413-44ac-8688-8e315e693362 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=8e0b26d7-eefe-4c85-b535-944f3c15f0f6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0407064 Dec 09 21:22:28.359008 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6310d01f-38f3-480f-9649-f63f122d37c2 service neutron] Pushing event updated for resources: {'Port': ['ID=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:28.374255 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-7e317f9d-d009-4508-893f-22ba97303217 service neutron] Request body: {'port': {'device_id': 'a49420b5-3789-4863-bf0c-65a787f7fc78', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:22:28.397101 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca360576-b59a-420b-8f1c-cb991dd0816c None None] Provisioning complete for port 54e32685-83f3-47e4-883f-d0d7b2a9e798 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:28.397101 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca360576-b59a-420b-8f1c-cb991dd0816c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:28.444520 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port cd5af376-d278-48fb-8867-a970b71280d9, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=cd5af376-d278-48fb-8867-a970b71280d9,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:28.473066 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:28.494961 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca360576-b59a-420b-8f1c-cb991dd0816c None None] Port 54e32685-83f3-47e4-883f-d0d7b2a9e798 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:22:28.531088 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-3f8b9cc0-fab9-431f-a411-501e9068d207 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:28.533406 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-3f8b9cc0-fab9-431f-a411-501e9068d207 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 1099 time: 0.2940514 Dec 09 21:22:28.539149 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-92c954de-467c-4a6b-8123-679154e8beed req-16df30e0-5f48-4341-b9c7-d9a672a4f300 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2396624 Dec 09 21:22:28.573846 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-14e09820-be86-48d7-811c-1f6efc0a2140 req-a39909f3-f1f4-4a3b-8bb6-030c3267f036 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/security-groups?id=47b47381-681d-49da-8acd-4d26ea16fbc0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.2936392 Dec 09 21:22:28.588501 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=cd5af376-d278-48fb-8867-a970b71280d9,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:28.650595 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7dc313c5-e19f-4fa1-a4d1-021df2e30639 req-424a1b01-dc95-48de-a636-723e95beeb3b service neutron] 10.222.0.31 "GET /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2851145 Dec 09 21:22:28.684477 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-0a9b8abd-b4b1-410b-9f1f-d2cac5891a0b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.12&port_id=6f6b3fc9-0b99-4cad-869c-ed52dde9578b HTTP/1.1" status: 200 len: 217 time: 0.1366558 Dec 09 21:22:28.730803 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f4868a8-bda0-45a2-8530-981f02dba357 None None] DHCP port deletion for 3d219282-fb31-40ab-a864-41f6397f4dcb request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:22:28.784081 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:22:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eb71c021-adba-4236-8699-f852c9d2f001 x-openstack-request-id: req-eb71c021-adba-4236-8699-f852c9d2f001 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:22:28.784081 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7604cfe7-6a20-4212-ac7d-57d16969b9fd", "tag": "6f6b3fc9-0b99-4cad-869c-ed52dde9578b", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:22:28.784081 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-eb71c021-adba-4236-8699-f852c9d2f001 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:22:28.784765 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7604cfe7-6a20-4212-ac7d-57d16969b9fd', 'tag': '6f6b3fc9-0b99-4cad-869c-ed52dde9578b', 'status': 'completed', 'code': 200} Dec 09 21:22:28.786026 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-7e317f9d-d009-4508-893f-22ba97303217 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:28.805771 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['66544e42-b228-4e80-9ed2-bc699bb1993e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:22:28.808929 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['cd5af376-d278-48fb-8867-a970b71280d9'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:22:28.870969 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7dc313c5-e19f-4fa1-a4d1-021df2e30639 req-c39c58df-a40d-4108-ba39-163b8e6f9970 service neutron] 10.222.0.31 "GET /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2133174 Dec 09 21:22:28.871792 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d40dd54-d074-4914-8706-0346e831203d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:28.898749 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d40dd54-d074-4914-8706-0346e831203d admin admin] Pushing event deleted for resources: {'Port': ['ID=95ad85de-7e3e-43ef-a88a-30b13cf2dfd2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:28.909816 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d40dd54-d074-4914-8706-0346e831203d admin admin] No DVR routers for this DVR port 95ad85de-7e3e-43ef-a88a-30b13cf2dfd2 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:22:28.910366 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-1500814a-f601-4539-a802-6a8d4092c559 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:28.913072 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-1500814a-f601-4539-a802-6a8d4092c559 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.2188632 Dec 09 21:22:29.014972 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d40dd54-d074-4914-8706-0346e831203d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:29.043173 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-0d40dd54-d074-4914-8706-0346e831203d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3d219282-fb31-40ab-a864-41f6397f4dcb']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:29.054263 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-0d40dd54-d074-4914-8706-0346e831203d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '62eb78e6-cc6d-47a2-ae0f-cbd25ddbdfa4') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:29.054823 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-0d40dd54-d074-4914-8706-0346e831203d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '62eb78e6-cc6d-47a2-ae0f-cbd25ddbdfa4') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:29.060793 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 95ad85de-7e3e-43ef-a88a-30b13cf2dfd2 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:22:29.067224 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d40dd54-d074-4914-8706-0346e831203d admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:29.083145 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d40dd54-d074-4914-8706-0346e831203d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:29.088213 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 95ad85de-7e3e-43ef-a88a-30b13cf2dfd2 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:22:29.088906 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 95ad85de-7e3e-43ef-a88a-30b13cf2dfd2 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:22:29.092886 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0d40dd54-d074-4914-8706-0346e831203d admin admin] Releasing vlan 101 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:22:29.093123 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d40dd54-d074-4914-8706-0346e831203d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:22:29.096531 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:22:29.226337 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d40dd54-d074-4914-8706-0346e831203d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:29.232736 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d40dd54-d074-4914-8706-0346e831203d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:29.241554 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0d40dd54-d074-4914-8706-0346e831203d admin admin] 10.222.0.13 "DELETE /v2.0/networks/3d219282-fb31-40ab-a864-41f6397f4dcb HTTP/1.1" status: 204 len: 168 time: 1.4459291 Dec 09 21:22:29.282971 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d40dd54-d074-4914-8706-0346e831203d admin admin] Pushing event deleted for resources: {'Network': ['ID=3d219282-fb31-40ab-a864-41f6397f4dcb,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:29.384567 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33294) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:29.394950 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ef889f6-06f5-4e88-b006-4a43fc8037c3 req-de1d07a9-a274-420d-9ce0-82076f393540 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:29.396855 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1ef889f6-06f5-4e88-b006-4a43fc8037c3 req-de1d07a9-a274-420d-9ce0-82076f393540 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 947 time: 0.6114399 Dec 09 21:22:29.407594 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b281b64d-e071-4fde-9e9d-f900ca340bfd req-22d05e98-1908-490b-9a47-1b771d0e77fa tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:29.415047 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b281b64d-e071-4fde-9e9d-f900ca340bfd req-22d05e98-1908-490b-9a47-1b771d0e77fa tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/ports?device_id=63d23827-0eb3-4c4c-87f7-698524a008f5 HTTP/1.1" status: 200 len: 948 time: 0.5327985 Dec 09 21:22:29.430678 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e6ba1490-254e-4c82-be3e-633370e16d08 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=615039519ef147c78eb38a1d65eac061&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0448453 Dec 09 21:22:29.433180 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33296) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:29.483019 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-40df514a-662b-4293-8abb-56a015b86476 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:29.505279 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-40df514a-662b-4293-8abb-56a015b86476 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:29.524936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-81732322-abed-4f88-a77f-614d15be2414 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:29.526359 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-81732322-abed-4f88-a77f-614d15be2414 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.5428178 Dec 09 21:22:29.558291 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-40df514a-662b-4293-8abb-56a015b86476 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:29.561405 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-40df514a-662b-4293-8abb-56a015b86476 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:29.562977 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-40df514a-662b-4293-8abb-56a015b86476 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/d1cde8f1-4e89-421d-887b-12f0b0209bec HTTP/1.1" status: 204 len: 168 time: 0.1284928 Dec 09 21:22:29.573842 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40df514a-662b-4293-8abb-56a015b86476 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d1cde8f1-4e89-421d-887b-12f0b0209bec,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:29.606902 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1ef889f6-06f5-4e88-b006-4a43fc8037c3 req-67d7f34b-c421-4470-92cc-9163eede34db tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1898365 Dec 09 21:22:29.624562 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b281b64d-e071-4fde-9e9d-f900ca340bfd req-af6e4bff-886c-408a-a5d5-026739276b77 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/security-groups?id=24094cbf-e652-478e-bb06-edc8eb774ee3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2037187 Dec 09 21:22:29.826695 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-972d9d6f-092f-4e1b-a081-2a7f28d92a47 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2877667 Dec 09 21:22:29.907617 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fbd2bdf-ca59-4758-aed7-52b109b3336a req-337d7066-5b19-4dfb-a64c-5ac227ef7e37 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:29.908487 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0fbd2bdf-ca59-4758-aed7-52b109b3336a req-337d7066-5b19-4dfb-a64c-5ac227ef7e37 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=b9b4e0ee-aaae-4214-be9d-1af0b5120e5d HTTP/1.1" status: 200 len: 943 time: 0.1725583 Dec 09 21:22:29.973669 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50d9a79e-abed-41b1-a807-9c9f74433517 req-1a761c76-a1d6-4bb3-ac97-c3a64b50fcef tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:29.975284 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50d9a79e-abed-41b1-a807-9c9f74433517 req-1a761c76-a1d6-4bb3-ac97-c3a64b50fcef tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/ports?device_id=a49420b5-3789-4863-bf0c-65a787f7fc78 HTTP/1.1" status: 200 len: 932 time: 0.1993783 Dec 09 21:22:29.988349 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33306) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:29.988911 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-7e317f9d-d009-4508-893f-22ba97303217 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 54e32685-83f3-47e4-883f-d0d7b2a9e798 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:22:30.010014 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-7e317f9d-d009-4508-893f-22ba97303217 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:30.044181 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7d13c09b-13f1-4911-9d3d-aea6ee688aa3 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=51b278a30cd94ca7861ad1cdecdc94d3&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0545061 Dec 09 21:22:30.044898 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33316) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:30.061424 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-7e317f9d-d009-4508-893f-22ba97303217 service neutron] Transition to ACTIVE for port object 54e32685-83f3-47e4-883f-d0d7b2a9e798 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:22:30.084494 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0fbd2bdf-ca59-4758-aed7-52b109b3336a req-de19849a-5327-47b1-a97e-8388e937d6ae tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1671071 Dec 09 21:22:30.085114 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-7e317f9d-d009-4508-893f-22ba97303217 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:30.113922 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7566d757-9665-476f-b526-28bfeea14edd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:30.136093 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50d9a79e-abed-41b1-a807-9c9f74433517 req-6353c740-2e4e-44b9-b02f-4f68029d5e98 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/security-groups?id=47b47381-681d-49da-8acd-4d26ea16fbc0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1500347 Dec 09 21:22:30.144274 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3a71deb-99f1-4a8b-899c-c439f161f443 req-93d8b06a-c315-4cc9-92e5-fd090919a67a service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3042393 Dec 09 21:22:30.179287 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e317f9d-d009-4508-893f-22ba97303217 service neutron] Pushing event updated for resources: {'Port': ['ID=54e32685-83f3-47e4-883f-d0d7b2a9e798,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:30.179987 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7566d757-9665-476f-b526-28bfeea14edd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:30.268492 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7566d757-9665-476f-b526-28bfeea14edd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:30.272847 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7566d757-9665-476f-b526-28bfeea14edd admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:30.274088 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7566d757-9665-476f-b526-28bfeea14edd admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/d9593022-b0a6-4122-8646-75540c10b69e HTTP/1.1" status: 204 len: 168 time: 0.2282088 Dec 09 21:22:30.283075 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7566d757-9665-476f-b526-28bfeea14edd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d9593022-b0a6-4122-8646-75540c10b69e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:30.336413 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98356c96-d6d0-4ce4-8794-1253848166b4 req-d8605c21-cd06-435d-b110-a3c9494f26aa tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:30.338174 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98356c96-d6d0-4ce4-8794-1253848166b4 req-d8605c21-cd06-435d-b110-a3c9494f26aa tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 945 time: 0.1724606 Dec 09 21:22:30.359866 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-256bd0f3-2543-49eb-acb1-42cc164b4b1c req-a1af3c7d-3aff-4f25-a110-c0cc5fe732b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:30.361459 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-256bd0f3-2543-49eb-acb1-42cc164b4b1c req-a1af3c7d-3aff-4f25-a110-c0cc5fe732b8 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 1099 time: 0.1474528 Dec 09 21:22:30.368615 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-7e317f9d-d009-4508-893f-22ba97303217 service neutron] Attempting to bind port 54e32685-83f3-47e4-883f-d0d7b2a9e798 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:22:30.369125 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-7e317f9d-d009-4508-893f-22ba97303217 service neutron] Attempting to bind port 54e32685-83f3-47e4-883f-d0d7b2a9e798 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'e74944d5-8114-4627-bc98-88385d8b16f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:22:30.369525 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-7e317f9d-d009-4508-893f-22ba97303217 service neutron] Attempting to bind port 54e32685-83f3-47e4-883f-d0d7b2a9e798 on network 6b0e1b89-20b6-4a70-94cb-58b2b1f77a20 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:22:30.401554 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-7e317f9d-d009-4508-893f-22ba97303217 service neutron] Port 54e32685-83f3-47e4-883f-d0d7b2a9e798 on network 6b0e1b89-20b6-4a70-94cb-58b2b1f77a20 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:22:30.402151 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-7e317f9d-d009-4508-893f-22ba97303217 service neutron] Attempting to bind port 54e32685-83f3-47e4-883f-d0d7b2a9e798 on network 6b0e1b89-20b6-4a70-94cb-58b2b1f77a20 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:22:30.427894 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-7e317f9d-d009-4508-893f-22ba97303217 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 22, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:22:30.428230 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-7e317f9d-d009-4508-893f-22ba97303217 service neutron] Checking segment: {'id': 'e74944d5-8114-4627-bc98-88385d8b16f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:22:30.428788 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-7e317f9d-d009-4508-893f-22ba97303217 service neutron] Bound using segment: {'id': 'e74944d5-8114-4627-bc98-88385d8b16f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:22:30.429606 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-7e317f9d-d009-4508-893f-22ba97303217 service neutron] Bound port: 54e32685-83f3-47e4-883f-d0d7b2a9e798, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e74944d5-8114-4627-bc98-88385d8b16f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:22:30.430106 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-7e317f9d-d009-4508-893f-22ba97303217 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:30.473239 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98356c96-d6d0-4ce4-8794-1253848166b4 req-ce5b8541-1d38-498f-89cb-c66ce0984431 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1265020 Dec 09 21:22:30.557779 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-256bd0f3-2543-49eb-acb1-42cc164b4b1c req-77ec6bdc-4c84-48a0-a073-177f90c63fd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:30.559267 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-256bd0f3-2543-49eb-acb1-42cc164b4b1c req-77ec6bdc-4c84-48a0-a073-177f90c63fd0 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.1870995 Dec 09 21:22:30.563877 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-7e317f9d-d009-4508-893f-22ba97303217 service neutron] For port 54e32685-83f3-47e4-883f-d0d7b2a9e798, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:22:30.567349 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-7e317f9d-d009-4508-893f-22ba97303217 service neutron] For port 54e32685-83f3-47e4-883f-d0d7b2a9e798, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=54e32685-83f3-47e4-883f-d0d7b2a9e798,segment=NetworkSegment(e74944d5-8114-4627-bc98-88385d8b16f0),segment_id=e74944d5-8114-4627-bc98-88385d8b16f0)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:22:30.577422 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-7e317f9d-d009-4508-893f-22ba97303217 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:30.628398 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-256bd0f3-2543-49eb-acb1-42cc164b4b1c req-bd64188b-2b63-4300-b700-9b99f7121304 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.12&port_id=6f6b3fc9-0b99-4cad-869c-ed52dde9578b HTTP/1.1" status: 200 len: 217 time: 0.0596478 Dec 09 21:22:30.712616 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-7e317f9d-d009-4508-893f-22ba97303217 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:30.713485 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-7e317f9d-d009-4508-893f-22ba97303217 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:30.715190 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-7e317f9d-d009-4508-893f-22ba97303217 service neutron] 10.222.0.10 "PUT /v2.0/ports/54e32685-83f3-47e4-883f-d0d7b2a9e798 HTTP/1.1" status: 200 len: 1093 time: 2.3665447 Dec 09 21:22:30.792286 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a49420b5-3789-4863-bf0c-65a787f7fc78', 'tag': '54e32685-83f3-47e4-883f-d0d7b2a9e798'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:22:30.795796 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-df19546e-7b62-40b5-857a-2cc38b532e42" -d '{"events": [{"name": "network-changed", "server_uuid": "a49420b5-3789-4863-bf0c-65a787f7fc78", "tag": "54e32685-83f3-47e4-883f-d0d7b2a9e798"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:22:30.855152 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e317f9d-d009-4508-893f-22ba97303217 service neutron] Pushing event updated for resources: {'Port': ['ID=54e32685-83f3-47e4-883f-d0d7b2a9e798,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:30.869381 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-256bd0f3-2543-49eb-acb1-42cc164b4b1c req-c85fdc06-b812-4931-9089-4aa403a075b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:30.870882 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-256bd0f3-2543-49eb-acb1-42cc164b4b1c req-c85fdc06-b812-4931-9089-4aa403a075b1 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.2339120 Dec 09 21:22:30.921397 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d09a1991-e389-4378-afbc-abd5f20f3d7d req-37478bbd-f735-4b7f-b209-732bb1eb93ad tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:30.922959 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d09a1991-e389-4378-afbc-abd5f20f3d7d req-37478bbd-f735-4b7f-b209-732bb1eb93ad tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/ports?device_id=63d23827-0eb3-4c4c-87f7-698524a008f5 HTTP/1.1" status: 200 len: 948 time: 0.2065988 Dec 09 21:22:30.968464 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-cb6bbcfe-662e-4af3-8d29-ae353a7202bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:30.970140 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-cb6bbcfe-662e-4af3-8d29-ae353a7202bd service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=2429d4a7c27042e7ab6a04a9cf722b47&device_id=a49420b5-3789-4863-bf0c-65a787f7fc78 HTTP/1.1" status: 200 len: 1096 time: 0.1874592 Dec 09 21:22:30.982118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdfc9239-7fcc-4209-8c7d-c97cd59e1c8c req-dd3651cc-c46c-4cfa-b28f-451eba2d787d tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:30.983786 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fdfc9239-7fcc-4209-8c7d-c97cd59e1c8c req-dd3651cc-c46c-4cfa-b28f-451eba2d787d tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 947 time: 0.2112334 Dec 09 21:22:30.996651 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 66544e42-b228-4e80-9ed2-bc699bb1993e up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:22:31.025490 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-9a8ab658-7aff-4d9b-a73e-a64283d4ec61 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=54e32685-83f3-47e4-883f-d0d7b2a9e798 HTTP/1.1" status: 200 len: 217 time: 0.0398903 Dec 09 21:22:31.049716 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 7f26d4c2-71a3-44d0-bf00-8c0c0833f323 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:22:31.115175 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fdfc9239-7fcc-4209-8c7d-c97cd59e1c8c req-2a30bfa4-14a4-437c-b5b2-0e58e87ed3f1 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0884662 Dec 09 21:22:31.156402 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 7f26d4c2-71a3-44d0-bf00-8c0c0833f323, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=7f26d4c2-71a3-44d0-bf00-8c0c0833f323,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:31.175718 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 4425d491-9b2e-48a2-8fb6-ead05da81dba up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:22:31.179899 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '7f26d4c2-71a3-44d0-bf00-8c0c0833f323', 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6', 'port_id': '7f26d4c2-71a3-44d0-bf00-8c0c0833f323', 'mac_address': 'fa:16:3e:31:d2:96', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 122, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '63e7603a-bb11-4d1a-8d84-55456d81931c', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:22:31.197256 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d09a1991-e389-4378-afbc-abd5f20f3d7d req-83b741dd-ae44-4dd3-ada2-1d425d3b1d90 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/security-groups?id=24094cbf-e652-478e-bb06-edc8eb774ee3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2467215 Dec 09 21:22:31.222047 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-256bd0f3-2543-49eb-acb1-42cc164b4b1c req-36ce7799-72be-40a7-a53e-27773983857c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:31.223289 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-256bd0f3-2543-49eb-acb1-42cc164b4b1c req-36ce7799-72be-40a7-a53e-27773983857c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.3421614 Dec 09 21:22:31.290808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-b5d737ff-84b6-447b-bad9-5a43f05cb487 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:31.294860 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-b5d737ff-84b6-447b-bad9-5a43f05cb487 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=069b1784-6c14-42f6-a10c-b0d4447b6091 HTTP/1.1" status: 200 len: 850 time: 0.2155795 Dec 09 21:22:31.375938 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:31.376425 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:22:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f9dc30ce-1468-4585-8e03-67e9f3edf120 x-openstack-request-id: req-f9dc30ce-1468-4585-8e03-67e9f3edf120 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:22:31.376726 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a49420b5-3789-4863-bf0c-65a787f7fc78", "tag": "54e32685-83f3-47e4-883f-d0d7b2a9e798", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:22:31.377201 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f9dc30ce-1468-4585-8e03-67e9f3edf120 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:22:31.377602 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a49420b5-3789-4863-bf0c-65a787f7fc78', 'tag': '54e32685-83f3-47e4-883f-d0d7b2a9e798', 'status': 'completed', 'code': 200} Dec 09 21:22:31.378982 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 66544e42-b228-4e80-9ed2-bc699bb1993e completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:22:31.395680 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 66544e42-b228-4e80-9ed2-bc699bb1993e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:31.396047 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:31.399871 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7f26d4c2-71a3-44d0-bf00-8c0c0833f323 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:22:31.423580 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 4425d491-9b2e-48a2-8fb6-ead05da81dba completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:22:31.444192 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 4425d491-9b2e-48a2-8fb6-ead05da81dba triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:31.445259 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:31.449666 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 7f26d4c2-71a3-44d0-bf00-8c0c0833f323, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=7f26d4c2-71a3-44d0-bf00-8c0c0833f323,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:31.480246 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:31.531674 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-649d342e-788f-4e4b-9839-4b349d28295b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:31.533365 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-649d342e-788f-4e4b-9839-4b349d28295b service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=6b0e1b89-20b6-4a70-94cb-58b2b1f77a20&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2240846 Dec 09 21:22:31.584611 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=7f26d4c2-71a3-44d0-bf00-8c0c0833f323,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:31.618854 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:31.635981 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-256bd0f3-2543-49eb-acb1-42cc164b4b1c req-f71a25e6-6f85-4cc7-bb16-0483ad338d9b service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4039199 Dec 09 21:22:31.643403 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5f21474-6cbb-422f-bb31-8c976aa5ef6a req-a2edf0af-3d6b-48d5-8e90-25e9ea190e99 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:31.645388 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d5f21474-6cbb-422f-bb31-8c976aa5ef6a req-a2edf0af-3d6b-48d5-8e90-25e9ea190e99 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=b9b4e0ee-aaae-4214-be9d-1af0b5120e5d HTTP/1.1" status: 200 len: 943 time: 0.2666397 Dec 09 21:22:31.654025 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:31.661803 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '63d23827-0eb3-4c4c-87f7-698524a008f5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '66544e42-b228-4e80-9ed2-bc699bb1993e'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:22:31.665652 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-005109c5-f482-4767-82a6-f8e1dc0bfcca" -d '{"events": [{"server_uuid": "63d23827-0eb3-4c4c-87f7-698524a008f5", "name": "network-vif-plugged", "status": "completed", "tag": "66544e42-b228-4e80-9ed2-bc699bb1993e"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:22:31.684661 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7f3889a-370c-4cc3-a633-03201f680ec2 req-a46966e4-fb52-45b3-b07d-b61d62b4817c tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:31.686728 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a7f3889a-370c-4cc3-a633-03201f680ec2 req-a46966e4-fb52-45b3-b07d-b61d62b4817c tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/ports?device_id=a49420b5-3789-4863-bf0c-65a787f7fc78 HTTP/1.1" status: 200 len: 944 time: 0.2438183 Dec 09 21:22:31.686997 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 66544e42-b228-4e80-9ed2-bc699bb1993e, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=66544e42-b228-4e80-9ed2-bc699bb1993e,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:31.705966 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:31.706813 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device cd5af376-d278-48fb-8867-a970b71280d9 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:22:31.738874 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-74f355df-aabe-4717-a875-c82c55ff6202 service neutron] 10.222.0.10 "GET /v2.0/networks/6b0e1b89-20b6-4a70-94cb-58b2b1f77a20?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1870241 Dec 09 21:22:31.796095 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d5f21474-6cbb-422f-bb31-8c976aa5ef6a req-f12f248f-6ae1-4e9c-9bc4-0be8b08c15e1 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1367683 Dec 09 21:22:31.802741 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['7f26d4c2-71a3-44d0-bf00-8c0c0833f323'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:22:31.804059 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a7f3889a-370c-4cc3-a633-03201f680ec2 req-b6882712-17f0-40fd-868b-68cb1bbaa2e8 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/security-groups?id=47b47381-681d-49da-8acd-4d26ea16fbc0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1026561 Dec 09 21:22:31.869186 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 4425d491-9b2e-48a2-8fb6-ead05da81dba, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=4425d491-9b2e-48a2-8fb6-ead05da81dba,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:31.906355 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e6bde02-eccb-493b-b6e7-339f6dd7a670 req-0a239861-e5d9-4dde-90b4-a4a763ab0d69 service neutron] 10.222.0.10 "GET /v2.0/networks/6b0e1b89-20b6-4a70-94cb-58b2b1f77a20?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1481035 Dec 09 21:22:31.914288 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:31.935890 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:22:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-704f9b01-095e-4c3b-8b11-a94df729771e x-openstack-request-id: req-704f9b01-095e-4c3b-8b11-a94df729771e {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:22:31.936187 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "63d23827-0eb3-4c4c-87f7-698524a008f5", "name": "network-vif-plugged", "status": "completed", "tag": "66544e42-b228-4e80-9ed2-bc699bb1993e", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:22:31.936438 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-704f9b01-095e-4c3b-8b11-a94df729771e {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:22:31.936838 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '63d23827-0eb3-4c4c-87f7-698524a008f5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '66544e42-b228-4e80-9ed2-bc699bb1993e', 'code': 200} Dec 09 21:22:32.002309 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=66544e42-b228-4e80-9ed2-bc699bb1993e,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:32.054205 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port cd5af376-d278-48fb-8867-a970b71280d9 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:22:32.079126 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port cd5af376-d278-48fb-8867-a970b71280d9 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:32.079751 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:32.104942 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=4425d491-9b2e-48a2-8fb6-ead05da81dba,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:32.125194 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf139988-a2fd-49a2-a1be-b55ffd4b72ae req-22cfa96f-8b1b-4d68-ab5d-39ba41e57fe8 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:32.132608 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf139988-a2fd-49a2-a1be-b55ffd4b72ae req-22cfa96f-8b1b-4d68-ab5d-39ba41e57fe8 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 945 time: 0.1785848 Dec 09 21:22:32.139010 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-256bd0f3-2543-49eb-acb1-42cc164b4b1c req-885a5485-bca1-43fb-8bfc-7b8f7edea4d2 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4889629 Dec 09 21:22:32.150397 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df19546e-7b62-40b5-857a-2cc38b532e42 req-bff92595-f394-471e-bedb-a10105531de0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:32.151946 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df19546e-7b62-40b5-857a-2cc38b532e42 req-bff92595-f394-471e-bedb-a10105531de0 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=2429d4a7c27042e7ab6a04a9cf722b47&device_id=a49420b5-3789-4863-bf0c-65a787f7fc78 HTTP/1.1" status: 200 len: 1096 time: 0.1637292 Dec 09 21:22:32.161233 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3412089-0e5c-4064-b4af-9818d53bd443 req-63454b21-faea-4b63-badf-c31b52a8476a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:32.162735 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c3412089-0e5c-4064-b4af-9818d53bd443 req-63454b21-faea-4b63-badf-c31b52a8476a service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=63d23827-0eb3-4c4c-87f7-698524a008f5 HTTP/1.1" status: 200 len: 1101 time: 0.1168516 Dec 09 21:22:32.233888 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:32.262435 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf139988-a2fd-49a2-a1be-b55ffd4b72ae req-8a69cfe9-9ab2-49e3-9980-08b57c314c74 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1288853 Dec 09 21:22:32.268577 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port cd5af376-d278-48fb-8867-a970b71280d9, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=cd5af376-d278-48fb-8867-a970b71280d9,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:32.276597 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:32.334516 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=cd5af376-d278-48fb-8867-a970b71280d9,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:32.397411 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c3412089-0e5c-4064-b4af-9818d53bd443 req-5122a294-4085-4889-8e9e-d6f605aeee6d service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=24094cbf-e652-478e-bb06-edc8eb774ee3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2202373 Dec 09 21:22:32.430654 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df19546e-7b62-40b5-857a-2cc38b532e42 req-1728592d-503c-4856-8921-9ebf5e2bf887 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:32.432188 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df19546e-7b62-40b5-857a-2cc38b532e42 req-1728592d-503c-4856-8921-9ebf5e2bf887 service neutron] 10.222.0.10 "GET /v2.0/networks?id=6b0e1b89-20b6-4a70-94cb-58b2b1f77a20 HTTP/1.1" status: 200 len: 912 time: 0.2673109 Dec 09 21:22:32.441519 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4538e6a2-8a39-4df4-9506-e405032f5d37 req-2ab96baa-478f-44e9-843b-59bcb680f8ba tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:32.442992 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4538e6a2-8a39-4df4-9506-e405032f5d37 req-2ab96baa-478f-44e9-843b-59bcb680f8ba tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 947 time: 0.2080729 Dec 09 21:22:32.453766 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aee121e9-bdfe-45f8-8a8d-38cfa78a81e2 req-a97b5f68-d3ec-486e-8862-128c29d105ae tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:32.455194 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aee121e9-bdfe-45f8-8a8d-38cfa78a81e2 req-a97b5f68-d3ec-486e-8862-128c29d105ae tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/ports?device_id=63d23827-0eb3-4c4c-87f7-698524a008f5 HTTP/1.1" status: 200 len: 949 time: 0.1029887 Dec 09 21:22:32.532343 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4538e6a2-8a39-4df4-9506-e405032f5d37 req-64d8bd44-f386-4150-999a-2a407753a232 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0760641 Dec 09 21:22:32.536370 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aee121e9-bdfe-45f8-8a8d-38cfa78a81e2 req-3520f0f8-84dd-4b76-a0a1-5c2972202086 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/security-groups?id=24094cbf-e652-478e-bb06-edc8eb774ee3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0729213 Dec 09 21:22:32.639491 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df19546e-7b62-40b5-857a-2cc38b532e42 req-e4d706bf-4e52-4689-aa97-bfc1e16d0a79 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=54e32685-83f3-47e4-883f-d0d7b2a9e798 HTTP/1.1" status: 200 len: 217 time: 0.0429082 Dec 09 21:22:32.947458 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b7baf8a9-f422-4d27-81fb-5b34d40566f6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:32.996723 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df19546e-7b62-40b5-857a-2cc38b532e42 req-82bf86c6-665c-4e23-9628-015d1c6e3224 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:32.998083 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df19546e-7b62-40b5-857a-2cc38b532e42 req-82bf86c6-665c-4e23-9628-015d1c6e3224 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=069b1784-6c14-42f6-a10c-b0d4447b6091 HTTP/1.1" status: 200 len: 850 time: 0.3504024 Dec 09 21:22:33.062550 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6f6b3fc9-0b99-4cad-869c-ed52dde9578b details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:22:33.065620 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 7f26d4c2-71a3-44d0-bf00-8c0c0833f323 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:22:33.104975 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d4919a2-8f17-4d7c-b607-9657515a5acb req-aa6097eb-523c-4d7f-9071-18558ed22bf6 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:33.106497 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0d4919a2-8f17-4d7c-b607-9657515a5acb req-aa6097eb-523c-4d7f-9071-18558ed22bf6 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/ports?device_id=a49420b5-3789-4863-bf0c-65a787f7fc78 HTTP/1.1" status: 200 len: 944 time: 0.1075158 Dec 09 21:22:33.124442 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df19546e-7b62-40b5-857a-2cc38b532e42 req-a6d74546-66d9-420f-a0d9-a92fd69cbaa3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:33.125797 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df19546e-7b62-40b5-857a-2cc38b532e42 req-a6d74546-66d9-420f-a0d9-a92fd69cbaa3 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=6b0e1b89-20b6-4a70-94cb-58b2b1f77a20&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1155159 Dec 09 21:22:33.134298 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4ef40e3-466f-498e-955a-938022c5a677 req-98491ec4-d167-47ef-bd91-c79690d83240 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:33.135829 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4ef40e3-466f-498e-955a-938022c5a677 req-98491ec4-d167-47ef-bd91-c79690d83240 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=b9b4e0ee-aaae-4214-be9d-1af0b5120e5d HTTP/1.1" status: 200 len: 944 time: 0.1020579 Dec 09 21:22:33.208903 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 7f26d4c2-71a3-44d0-bf00-8c0c0833f323 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:22:33.221356 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 7f26d4c2-71a3-44d0-bf00-8c0c0833f323 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:33.221987 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:33.228889 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:33.262366 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0d4919a2-8f17-4d7c-b607-9657515a5acb req-5c157df7-6c0f-4927-b80c-fa79202d7680 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/security-groups?id=47b47381-681d-49da-8acd-4d26ea16fbc0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1488154 Dec 09 21:22:33.266273 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '6f6b3fc9-0b99-4cad-869c-ed52dde9578b', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '6f6b3fc9-0b99-4cad-869c-ed52dde9578b', 'mac_address': 'fa:16:3e:67:2a:05', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:22:33.274223 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4ef40e3-466f-498e-955a-938022c5a677 req-084b4758-a38f-4bf4-b4ff-08619ac3edab tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1234746 Dec 09 21:22:33.290350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df19546e-7b62-40b5-857a-2cc38b532e42 req-eb78ae78-e7e3-44d8-8736-5aacdf39cedd service neutron] 10.222.0.10 "GET /v2.0/networks/6b0e1b89-20b6-4a70-94cb-58b2b1f77a20?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1535482 Dec 09 21:22:33.354101 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:33.389159 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6f6b3fc9-0b99-4cad-869c-ed52dde9578b {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:22:33.396030 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:33.425757 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:33.437056 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df19546e-7b62-40b5-857a-2cc38b532e42 req-c6055aa5-026a-487b-969f-55668581fed0 service neutron] 10.222.0.10 "GET /v2.0/networks/6b0e1b89-20b6-4a70-94cb-58b2b1f77a20?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1330662 Dec 09 21:22:33.441951 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:33.497928 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 7f26d4c2-71a3-44d0-bf00-8c0c0833f323, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=7f26d4c2-71a3-44d0-bf00-8c0c0833f323,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:33.509954 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:33.511940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cf10712-aa11-422d-be31-ea284b4702ef req-a75bed8e-460a-4574-b657-ab6f0fa9541d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:33.520193 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5cf10712-aa11-422d-be31-ea284b4702ef req-a75bed8e-460a-4574-b657-ab6f0fa9541d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 946 time: 0.1282487 Dec 09 21:22:33.522785 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:33.531551 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:33.532017 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:33.532360 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:33.532694 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:33.533081 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:33.533330 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:33.533653 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:33.533974 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:33.534291 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:33.534610 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:33.534928 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:33.535244 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:33.535588 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:33.578958 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5cf10712-aa11-422d-be31-ea284b4702ef req-0363d22c-c401-4307-9364-28f76241667e tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0577056 Dec 09 21:22:33.621441 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=7f26d4c2-71a3-44d0-bf00-8c0c0833f323,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:33.687757 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-567cac17-6763-47cd-ad53-e54a93812949 req-13400ea4-559c-48bc-9e74-065fe6664d88 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:33.689263 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-567cac17-6763-47cd-ad53-e54a93812949 req-13400ea4-559c-48bc-9e74-065fe6664d88 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 948 time: 0.0580926 Dec 09 21:22:33.724506 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['6f6b3fc9-0b99-4cad-869c-ed52dde9578b'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:22:33.763584 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-567cac17-6763-47cd-ad53-e54a93812949 req-091b8a14-c294-4f40-93c1-c7e50004deea tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0646186 Dec 09 21:22:33.776030 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da717bad-af21-49c2-a9b5-d79604080fac req-7ad89a12-a271-4d6c-9419-2c9632707db5 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:33.786342 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da717bad-af21-49c2-a9b5-d79604080fac req-7ad89a12-a271-4d6c-9419-2c9632707db5 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/ports?device_id=63d23827-0eb3-4c4c-87f7-698524a008f5 HTTP/1.1" status: 200 len: 949 time: 0.0876534 Dec 09 21:22:33.831820 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da717bad-af21-49c2-a9b5-d79604080fac req-7781cd9e-9305-4714-bd32-6e42a9a5b9d8 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/security-groups?id=24094cbf-e652-478e-bb06-edc8eb774ee3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450730 Dec 09 21:22:33.937364 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8f48a806-013e-480e-81ac-1a7f5f10c155', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4425d491-9b2e-48a2-8fb6-ead05da81dba'}, {'server_uuid': '5105efab-9ee1-4a74-9a45-e77c38549362', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cd5af376-d278-48fb-8867-a970b71280d9'}, {'server_uuid': 'b9b4e0ee-aaae-4214-be9d-1af0b5120e5d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7f26d4c2-71a3-44d0-bf00-8c0c0833f323'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:22:33.939664 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-221d13d5-fffe-4eb7-b883-bbb41b3592d0" -d '{"events": [{"server_uuid": "8f48a806-013e-480e-81ac-1a7f5f10c155", "name": "network-vif-plugged", "status": "completed", "tag": "4425d491-9b2e-48a2-8fb6-ead05da81dba"}, {"server_uuid": "5105efab-9ee1-4a74-9a45-e77c38549362", "name": "network-vif-plugged", "status": "completed", "tag": "cd5af376-d278-48fb-8867-a970b71280d9"}, {"server_uuid": "b9b4e0ee-aaae-4214-be9d-1af0b5120e5d", "name": "network-vif-plugged", "status": "completed", "tag": "7f26d4c2-71a3-44d0-bf00-8c0c0833f323"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:22:33.987268 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 525 Content-Type: application/json Date: Thu, 09 Dec 2021 21:22:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-158f8987-dc7a-47b0-98a7-ca15c3a3be5f x-openstack-request-id: req-158f8987-dc7a-47b0-98a7-ca15c3a3be5f {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:22:33.987608 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8f48a806-013e-480e-81ac-1a7f5f10c155", "name": "network-vif-plugged", "status": "completed", "tag": "4425d491-9b2e-48a2-8fb6-ead05da81dba", "code": 200}, {"server_uuid": "5105efab-9ee1-4a74-9a45-e77c38549362", "name": "network-vif-plugged", "status": "completed", "tag": "cd5af376-d278-48fb-8867-a970b71280d9", "code": 200}, {"server_uuid": "b9b4e0ee-aaae-4214-be9d-1af0b5120e5d", "name": "network-vif-plugged", "status": "completed", "tag": "7f26d4c2-71a3-44d0-bf00-8c0c0833f323", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:22:33.988297 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-158f8987-dc7a-47b0-98a7-ca15c3a3be5f {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:22:33.988297 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8f48a806-013e-480e-81ac-1a7f5f10c155', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4425d491-9b2e-48a2-8fb6-ead05da81dba', 'code': 200} Dec 09 21:22:33.988508 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5105efab-9ee1-4a74-9a45-e77c38549362', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cd5af376-d278-48fb-8867-a970b71280d9', 'code': 200} Dec 09 21:22:33.988756 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b9b4e0ee-aaae-4214-be9d-1af0b5120e5d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7f26d4c2-71a3-44d0-bf00-8c0c0833f323', 'code': 200} Dec 09 21:22:34.112740 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd642a44-b5ae-41c9-a5eb-a838c4e4ed67 req-fa714d7b-4975-46e5-b61f-bc4a28fb2ab2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:34.114289 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fd642a44-b5ae-41c9-a5eb-a838c4e4ed67 req-fa714d7b-4975-46e5-b61f-bc4a28fb2ab2 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=b9b4e0ee-aaae-4214-be9d-1af0b5120e5d HTTP/1.1" status: 200 len: 1097 time: 0.0475049 Dec 09 21:22:34.139527 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cd5a25c-3cbc-4edc-8449-76cb2723eda0 req-fccae7de-a081-44af-b966-e82cc0c089f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:34.141653 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7cd5a25c-3cbc-4edc-8449-76cb2723eda0 req-fccae7de-a081-44af-b966-e82cc0c089f3 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 1098 time: 0.0774679 Dec 09 21:22:34.158919 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1edfddb1-1c80-4add-93dc-ade197f2f591 req-fa2cce78-f000-43ce-861e-eaf95a971e46 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:34.160783 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1edfddb1-1c80-4add-93dc-ade197f2f591 req-fa2cce78-f000-43ce-861e-eaf95a971e46 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=8f48a806-013e-480e-81ac-1a7f5f10c155 HTTP/1.1" status: 200 len: 1102 time: 0.0632339 Dec 09 21:22:34.171324 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fd642a44-b5ae-41c9-a5eb-a838c4e4ed67 req-07ce9936-7d2b-44b8-b11e-09e13580fcab service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486965 Dec 09 21:22:34.231908 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7cd5a25c-3cbc-4edc-8449-76cb2723eda0 req-e1127f42-28b7-4660-906e-970b64322c5b service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0811539 Dec 09 21:22:34.234103 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1edfddb1-1c80-4add-93dc-ade197f2f591 req-f260cbf3-580b-4236-9c5c-d4e51133fed5 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=24094cbf-e652-478e-bb06-edc8eb774ee3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0654800 Dec 09 21:22:34.311361 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33458) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:34.441649 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-967447d0-e471-4aa0-9003-5a1fa0f09c77 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:34.445915 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4031997a-7403-41c7-97b5-6409e685954b req-9a580ba6-db5c-4456-8e21-03780e21956e tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:34.447641 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4031997a-7403-41c7-97b5-6409e685954b req-9a580ba6-db5c-4456-8e21-03780e21956e tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=b9b4e0ee-aaae-4214-be9d-1af0b5120e5d HTTP/1.1" status: 200 len: 945 time: 0.0845127 Dec 09 21:22:34.455968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e66c0574-e97c-445b-a8f0-3ebba9b05aa8 req-209c6df8-2be5-45db-aeef-534561f7749b tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:34.457497 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e66c0574-e97c-445b-a8f0-3ebba9b05aa8 req-209c6df8-2be5-45db-aeef-534561f7749b tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/ports?device_id=a49420b5-3789-4863-bf0c-65a787f7fc78 HTTP/1.1" status: 200 len: 944 time: 0.0842743 Dec 09 21:22:34.529287 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-967447d0-e471-4aa0-9003-5a1fa0f09c77 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:34.539720 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-967447d0-e471-4aa0-9003-5a1fa0f09c77 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:34.563484 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4031997a-7403-41c7-97b5-6409e685954b req-9ceaee25-2830-4245-8d7b-9dd54357af2f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1043413 Dec 09 21:22:34.566995 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e66c0574-e97c-445b-a8f0-3ebba9b05aa8 req-5426e2ff-1d4c-49aa-bd6b-36794b776a4b tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/security-groups?id=47b47381-681d-49da-8acd-4d26ea16fbc0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0941968 Dec 09 21:22:34.582518 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-967447d0-e471-4aa0-9003-5a1fa0f09c77 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=f030561e11b64ef9bb09ace78f7c3051&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2700083 Dec 09 21:22:34.582721 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33464) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:34.585580 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-967447d0-e471-4aa0-9003-5a1fa0f09c77 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=20467440-4a78-4288-a972-e7d32d5307fb,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:34.646753 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3c7f2dcb-4e94-4579-ab5e-1d28b302a64a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:34.668310 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3c7f2dcb-4e94-4579-ab5e-1d28b302a64a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:34.747997 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dca51b9-9499-473c-a856-3d91a520eb1e req-e0901f22-44be-4cfa-ab72-a90d37d77817 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:34.749574 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2dca51b9-9499-473c-a856-3d91a520eb1e req-e0901f22-44be-4cfa-ab72-a90d37d77817 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 946 time: 0.0793731 Dec 09 21:22:34.778413 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3c7f2dcb-4e94-4579-ab5e-1d28b302a64a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:34.781025 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3c7f2dcb-4e94-4579-ab5e-1d28b302a64a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:34.784611 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3c7f2dcb-4e94-4579-ab5e-1d28b302a64a admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/20467440-4a78-4288-a972-e7d32d5307fb HTTP/1.1" status: 204 len: 168 time: 0.1986032 Dec 09 21:22:34.801668 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c7f2dcb-4e94-4579-ab5e-1d28b302a64a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=20467440-4a78-4288-a972-e7d32d5307fb,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:34.818017 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2dca51b9-9499-473c-a856-3d91a520eb1e req-ee85817a-73e8-452b-99ad-4f6a48863a51 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0621071 Dec 09 21:22:34.972282 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25ce4d04-746d-4224-a2aa-622c3cd0699e req-851caef8-3855-4fdd-b47e-ffcdf4ddd3a4 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:34.973786 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25ce4d04-746d-4224-a2aa-622c3cd0699e req-851caef8-3855-4fdd-b47e-ffcdf4ddd3a4 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 948 time: 0.0902219 Dec 09 21:22:34.995642 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9db949f-9d97-4e86-9e2e-86ad4010b220 req-97d75628-0be2-471c-9548-16b9f7a1b6b1 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:34.997661 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e9db949f-9d97-4e86-9e2e-86ad4010b220 req-97d75628-0be2-471c-9548-16b9f7a1b6b1 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/ports?device_id=63d23827-0eb3-4c4c-87f7-698524a008f5 HTTP/1.1" status: 200 len: 949 time: 0.0749149 Dec 09 21:22:35.010863 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 54e32685-83f3-47e4-883f-d0d7b2a9e798 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:22:35.073030 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25ce4d04-746d-4224-a2aa-622c3cd0699e req-c6ffdf90-ac87-4b00-9993-985da9b1e80f tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0907161 Dec 09 21:22:35.082393 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e9db949f-9d97-4e86-9e2e-86ad4010b220 req-a7ff26ac-3e56-4585-90ac-45ee018fa513 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/security-groups?id=24094cbf-e652-478e-bb06-edc8eb774ee3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0768020 Dec 09 21:22:35.105512 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6f6b3fc9-0b99-4cad-869c-ed52dde9578b up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:22:35.177750 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 54e32685-83f3-47e4-883f-d0d7b2a9e798, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=54e32685-83f3-47e4-883f-d0d7b2a9e798,segment=NetworkSegment(e74944d5-8114-4627-bc98-88385d8b16f0),segment_id=e74944d5-8114-4627-bc98-88385d8b16f0)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:35.193501 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '54e32685-83f3-47e4-883f-d0d7b2a9e798', 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20', 'port_id': '54e32685-83f3-47e4-883f-d0d7b2a9e798', 'mac_address': 'fa:16:3e:07:db:35', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '069b1784-6c14-42f6-a10c-b0d4447b6091', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:22:35.225666 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:22:35.234391 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:35.234960 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:35.238141 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33480) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:35.252710 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f04892c9-1bc0-42f6-8d7c-a8fd043bed76 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:35.255842 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-520a4338-97eb-4fc5-9c0b-e6eccf4b9227 req-be3f0216-21a2-405e-b890-b44c0dce9f84 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:35.263115 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-520a4338-97eb-4fc5-9c0b-e6eccf4b9227 req-be3f0216-21a2-405e-b890-b44c0dce9f84 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/ports?device_id=8f48a806-013e-480e-81ac-1a7f5f10c155 HTTP/1.1" status: 200 len: 950 time: 0.0742416 Dec 09 21:22:35.264481 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:35.294267 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 54e32685-83f3-47e4-883f-d0d7b2a9e798 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:22:35.318485 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 54e32685-83f3-47e4-883f-d0d7b2a9e798, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=54e32685-83f3-47e4-883f-d0d7b2a9e798,segment=NetworkSegment(e74944d5-8114-4627-bc98-88385d8b16f0),segment_id=e74944d5-8114-4627-bc98-88385d8b16f0)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:35.335937 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-520a4338-97eb-4fc5-9c0b-e6eccf4b9227 req-363b75c1-48be-467e-a8db-e0337ac3126a tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/security-groups?id=24094cbf-e652-478e-bb06-edc8eb774ee3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0714514 Dec 09 21:22:35.338231 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:35.388177 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:35.418258 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f04892c9-1bc0-42f6-8d7c-a8fd043bed76 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:35.426758 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f04892c9-1bc0-42f6-8d7c-a8fd043bed76 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:35.476243 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f04892c9-1bc0-42f6-8d7c-a8fd043bed76 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=1e4e3c9588c340a9b7f0e760c7a32ddb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2363241 Dec 09 21:22:35.479280 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33482) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:35.480574 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f04892c9-1bc0-42f6-8d7c-a8fd043bed76 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=59a0093c-effb-47d4-988b-a7ff733e0f35,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:35.549245 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:35.552269 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=54e32685-83f3-47e4-883f-d0d7b2a9e798,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:35.560115 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bf8e6b5e-a98d-40f8-ba63-49f77d260d13 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:35.563012 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:35.621991 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ec0f89a5-3173-4858-b539-fd18b5ddb17a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:35.649456 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ec0f89a5-3173-4858-b539-fd18b5ddb17a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:35.660259 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['54e32685-83f3-47e4-883f-d0d7b2a9e798'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:22:35.708535 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:35.770854 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ec0f89a5-3173-4858-b539-fd18b5ddb17a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:35.774494 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ec0f89a5-3173-4858-b539-fd18b5ddb17a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:35.775834 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ec0f89a5-3173-4858-b539-fd18b5ddb17a admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/59a0093c-effb-47d4-988b-a7ff733e0f35 HTTP/1.1" status: 204 len: 168 time: 0.2950563 Dec 09 21:22:35.812172 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec0f89a5-3173-4858-b539-fd18b5ddb17a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=59a0093c-effb-47d4-988b-a7ff733e0f35,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:35.840562 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ecfa57c-2fe1-4d23-a4a0-124f8cd68ad1 req-37821471-05da-45ed-8f23-8ce9b586d4e9 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:35.842192 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0ecfa57c-2fe1-4d23-a4a0-124f8cd68ad1 req-37821471-05da-45ed-8f23-8ce9b586d4e9 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/ports?device_id=a49420b5-3789-4863-bf0c-65a787f7fc78 HTTP/1.1" status: 200 len: 945 time: 0.1294858 Dec 09 21:22:35.854383 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7cb715c-3f40-4695-a014-79f5f671612a req-637905c6-0f22-4a92-8f61-14e8e15ac786 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:35.856105 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7cb715c-3f40-4695-a014-79f5f671612a req-637905c6-0f22-4a92-8f61-14e8e15ac786 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=b9b4e0ee-aaae-4214-be9d-1af0b5120e5d HTTP/1.1" status: 200 len: 945 time: 0.1227126 Dec 09 21:22:35.947758 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7cb715c-3f40-4695-a014-79f5f671612a req-0e513618-7aad-4292-8fed-ebfaffab8ae0 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0839186 Dec 09 21:22:35.958514 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0ecfa57c-2fe1-4d23-a4a0-124f8cd68ad1 req-ea09e5bb-6aed-41c9-b511-f1501531a623 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/security-groups?id=47b47381-681d-49da-8acd-4d26ea16fbc0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1012120 Dec 09 21:22:36.014942 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7604cfe7-6a20-4212-ac7d-57d16969b9fd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6f6b3fc9-0b99-4cad-869c-ed52dde9578b'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:22:36.017745 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-934ea268-d391-4da8-aa2c-76f2b68d72de" -d '{"events": [{"server_uuid": "7604cfe7-6a20-4212-ac7d-57d16969b9fd", "name": "network-vif-plugged", "status": "completed", "tag": "6f6b3fc9-0b99-4cad-869c-ed52dde9578b"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:22:36.121464 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-437e266b-0365-4930-bd7e-5422fa64a2e9 req-c301097b-4211-4d2c-9bb5-e40197c64852 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:36.124063 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-437e266b-0365-4930-bd7e-5422fa64a2e9 req-c301097b-4211-4d2c-9bb5-e40197c64852 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 946 time: 0.1031973 Dec 09 21:22:36.197628 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-437e266b-0365-4930-bd7e-5422fa64a2e9 req-7a76b1fa-1c52-44b3-908b-a6ca92192302 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0630155 Dec 09 21:22:36.273704 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:22:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c05deb20-673b-4e30-9fe1-abf86f3c725a x-openstack-request-id: req-c05deb20-673b-4e30-9fe1-abf86f3c725a {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:22:36.274121 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7604cfe7-6a20-4212-ac7d-57d16969b9fd", "name": "network-vif-plugged", "status": "completed", "tag": "6f6b3fc9-0b99-4cad-869c-ed52dde9578b", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:22:36.274234 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c05deb20-673b-4e30-9fe1-abf86f3c725a {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:22:36.274650 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7604cfe7-6a20-4212-ac7d-57d16969b9fd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6f6b3fc9-0b99-4cad-869c-ed52dde9578b', 'code': 200} Dec 09 21:22:36.423163 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b8da04b-345f-46cb-9e5e-7fb9855c8a0a req-526169fb-9fd5-4dc3-b234-93a9e50018d6 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:36.425009 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4b8da04b-345f-46cb-9e5e-7fb9855c8a0a req-526169fb-9fd5-4dc3-b234-93a9e50018d6 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 949 time: 0.0785537 Dec 09 21:22:36.492180 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcc1fb41-0786-438c-9c8e-47a503b6392a req-acbdf627-7408-43cc-958e-9d42c4cf9e86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:36.492407 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:36.493698 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bcc1fb41-0786-438c-9c8e-47a503b6392a req-acbdf627-7408-43cc-958e-9d42c4cf9e86 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 1101 time: 0.1370332 Dec 09 21:22:36.510825 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e11e33dc-0a76-47d4-873e-b3d9dda30ef2 req-8db0f0e4-a2d2-4d8e-8fd1-861743232a6f tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:36.512433 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e11e33dc-0a76-47d4-873e-b3d9dda30ef2 req-8db0f0e4-a2d2-4d8e-8fd1-861743232a6f tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 1098 time: 0.0748508 Dec 09 21:22:36.560016 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4b8da04b-345f-46cb-9e5e-7fb9855c8a0a req-e081b42c-bd02-443f-b993-0a3d73d21eed tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1212583 Dec 09 21:22:36.607336 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bcc1fb41-0786-438c-9c8e-47a503b6392a req-b2a8b98c-6726-468a-b6ff-b25df29e80dc service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0939498 Dec 09 21:22:36.611283 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e11e33dc-0a76-47d4-873e-b3d9dda30ef2 req-0c13506f-42a6-4603-aa5a-c086fc2b3b4d tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0900064 Dec 09 21:22:36.709309 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3761aef-e300-4257-bf94-53cb606b7805 req-0f495d60-6f4a-4a39-bd95-72a1e8b7149d tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:36.712010 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b3761aef-e300-4257-bf94-53cb606b7805 req-0f495d60-6f4a-4a39-bd95-72a1e8b7149d tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=b9b4e0ee-aaae-4214-be9d-1af0b5120e5d HTTP/1.1" status: 200 len: 945 time: 0.0737259 Dec 09 21:22:36.819988 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b3761aef-e300-4257-bf94-53cb606b7805 req-72d929c7-6639-47bc-9ebe-d5ee832dd115 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1019621 Dec 09 21:22:36.859759 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6858fa17-97f4-4d82-b2d8-6d92d7661ea2 req-ce13b538-ac14-4d3c-aaa5-54c7b8e2c133 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:36.870630 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6858fa17-97f4-4d82-b2d8-6d92d7661ea2 req-ce13b538-ac14-4d3c-aaa5-54c7b8e2c133 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/ports?device_id=8f48a806-013e-480e-81ac-1a7f5f10c155 HTTP/1.1" status: 200 len: 950 time: 0.1192911 Dec 09 21:22:36.938715 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6858fa17-97f4-4d82-b2d8-6d92d7661ea2 req-5c21c09b-cf60-4812-a324-6148b4c22b71 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/security-groups?id=24094cbf-e652-478e-bb06-edc8eb774ee3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0643401 Dec 09 21:22:37.000552 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6a62bef-7792-47c7-a687-1ac7a2ad4103 req-e3bcde4b-906a-4dd8-8af0-d4e5c32a0569 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:37.009830 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6a62bef-7792-47c7-a687-1ac7a2ad4103 req-e3bcde4b-906a-4dd8-8af0-d4e5c32a0569 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 1098 time: 0.0690088 Dec 09 21:22:37.015130 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 54e32685-83f3-47e4-883f-d0d7b2a9e798 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:22:37.066988 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6a62bef-7792-47c7-a687-1ac7a2ad4103 req-b9017acf-cb35-4f10-aebc-06eadf95db51 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0556836 Dec 09 21:22:37.078514 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 54e32685-83f3-47e4-883f-d0d7b2a9e798 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:22:37.095250 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 54e32685-83f3-47e4-883f-d0d7b2a9e798 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:37.095726 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:37.182855 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:37.219658 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 54e32685-83f3-47e4-883f-d0d7b2a9e798, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=54e32685-83f3-47e4-883f-d0d7b2a9e798,segment=NetworkSegment(e74944d5-8114-4627-bc98-88385d8b16f0),segment_id=e74944d5-8114-4627-bc98-88385d8b16f0)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:37.225793 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:37.271043 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b21da7cf-c7e6-4851-9b4a-6a73b7e3dc97 req-e3e62f5f-9456-4a92-bd54-36b5391ae7e7 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:37.280769 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b21da7cf-c7e6-4851-9b4a-6a73b7e3dc97 req-e3e62f5f-9456-4a92-bd54-36b5391ae7e7 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/ports?device_id=a49420b5-3789-4863-bf0c-65a787f7fc78 HTTP/1.1" status: 200 len: 945 time: 0.0819211 Dec 09 21:22:37.298469 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=54e32685-83f3-47e4-883f-d0d7b2a9e798,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:37.356327 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b21da7cf-c7e6-4851-9b4a-6a73b7e3dc97 req-be4bfeb1-689d-4337-950d-4bc8e63f9b91 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/security-groups?id=47b47381-681d-49da-8acd-4d26ea16fbc0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0745037 Dec 09 21:22:37.692592 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ffe3430-80cd-4d32-a54b-db88bd3a9d97 req-4ca577a6-b132-4de6-8b33-b49cdb9e0688 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:37.694240 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ffe3430-80cd-4d32-a54b-db88bd3a9d97 req-4ca577a6-b132-4de6-8b33-b49cdb9e0688 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 949 time: 0.0500419 Dec 09 21:22:37.752365 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ffe3430-80cd-4d32-a54b-db88bd3a9d97 req-393726fc-9358-4daf-85af-1bf995e47512 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0519011 Dec 09 21:22:37.842684 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:38.112917 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-d9f45d0e-1e1e-49dd-bab2-22b961d3a971 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:38.114390 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-d9f45d0e-1e1e-49dd-bab2-22b961d3a971 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 807 time: 0.1081181 Dec 09 21:22:38.129970 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-575d36a6-fc11-4519-89db-136c8e457eda tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/quotas/ac5b7cefd8cc48cc83f38d3923aae132 HTTP/1.1" status: 200 len: 375 time: 0.0092163 Dec 09 21:22:38.188998 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-de1e718c-5637-4e5b-b965-75b06303e72d tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0526254 Dec 09 21:22:38.276090 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a49420b5-3789-4863-bf0c-65a787f7fc78', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '54e32685-83f3-47e4-883f-d0d7b2a9e798'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:22:38.279138 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ffabd3e4-225c-468b-9735-5e340ddd6dd2" -d '{"events": [{"server_uuid": "a49420b5-3789-4863-bf0c-65a787f7fc78", "name": "network-vif-plugged", "status": "completed", "tag": "54e32685-83f3-47e4-883f-d0d7b2a9e798"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:22:38.284595 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-ea7f2614-5a18-49ea-a486-b3e290df4500 service neutron] 10.222.0.13 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0869195 Dec 09 21:22:38.388160 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-c1c33331-92d6-4fec-bfdf-a4ef1245754c service neutron] 10.222.0.13 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0945427 Dec 09 21:22:38.404769 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-183b6b34-ae94-4225-b8a3-9dc85e65ed16 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:22:38.405813 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-183b6b34-ae94-4225-b8a3-9dc85e65ed16 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0058689 Dec 09 21:22:38.445204 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-d6aeb2f6-dc06-4cd1-acfa-e8313f881d5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:38.446633 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-d6aeb2f6-dc06-4cd1-acfa-e8313f881d5e service neutron] 10.222.0.13 "GET /v2.0/ports/cd5af376-d278-48fb-8867-a970b71280d9 HTTP/1.1" status: 200 len: 1095 time: 0.0339744 Dec 09 21:22:38.455769 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1bbd1108-02d0-44df-abab-370f8b1a00e7 service neutron] Request body: {'binding': {'host': 'n-h1-713301-27', 'vnic_type': 'normal', 'profile': {}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:22:38.456225 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1bbd1108-02d0-44df-abab-370f8b1a00e7 service neutron] Unknown quota resources ['binding']. {{(pid=103437) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 09 21:22:38.591818 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1bbd1108-02d0-44df-abab-370f8b1a00e7 service neutron] Attempting to bind port cd5af376-d278-48fb-8867-a970b71280d9 on host n-h1-713301-27 for vnic_type normal with profile None {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:22:38.592186 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1bbd1108-02d0-44df-abab-370f8b1a00e7 service neutron] Attempting to bind port cd5af376-d278-48fb-8867-a970b71280d9 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:22:38.592545 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1bbd1108-02d0-44df-abab-370f8b1a00e7 service neutron] Attempting to bind port cd5af376-d278-48fb-8867-a970b71280d9 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:22:38.597225 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1bbd1108-02d0-44df-abab-370f8b1a00e7 service neutron] Port cd5af376-d278-48fb-8867-a970b71280d9 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:22:38.597555 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1bbd1108-02d0-44df-abab-370f8b1a00e7 service neutron] Attempting to bind port cd5af376-d278-48fb-8867-a970b71280d9 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:22:38.602945 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1bbd1108-02d0-44df-abab-370f8b1a00e7 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 22, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:22:38.603338 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1bbd1108-02d0-44df-abab-370f8b1a00e7 service neutron] Checking segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:22:38.603780 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1bbd1108-02d0-44df-abab-370f8b1a00e7 service neutron] Bound using segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:22:38.604217 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1bbd1108-02d0-44df-abab-370f8b1a00e7 service neutron] Bound port: cd5af376-d278-48fb-8867-a970b71280d9, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:22:38.664641 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1bbd1108-02d0-44df-abab-370f8b1a00e7 service neutron] For port cd5af376-d278-48fb-8867-a970b71280d9, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=cd5af376-d278-48fb-8867-a970b71280d9,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:22:38.675356 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1bbd1108-02d0-44df-abab-370f8b1a00e7 service neutron] Publish callbacks [] for binding, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:38.679339 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1bbd1108-02d0-44df-abab-370f8b1a00e7 service neutron] 10.222.0.13 "POST /v2.0/ports/cd5af376-d278-48fb-8867-a970b71280d9/bindings HTTP/1.1" status: 201 len: 390 time: 0.2268822 Dec 09 21:22:38.715298 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-973a89c6-cd2f-4635-a175-a95b6e326506 req-9d85c439-4147-48ae-b544-0e92200984be tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:38.716945 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-973a89c6-cd2f-4635-a175-a95b6e326506 req-9d85c439-4147-48ae-b544-0e92200984be tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=b9b4e0ee-aaae-4214-be9d-1af0b5120e5d HTTP/1.1" status: 200 len: 945 time: 0.0501618 Dec 09 21:22:38.813819 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-973a89c6-cd2f-4635-a175-a95b6e326506 req-8b4bd5da-a77a-44f9-9401-53b72e8ca3f1 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0876760 Dec 09 21:22:38.846571 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:22:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9e63a1e3-fe20-4fed-a986-571cc3fbf06b x-openstack-request-id: req-9e63a1e3-fe20-4fed-a986-571cc3fbf06b {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:22:38.848096 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a49420b5-3789-4863-bf0c-65a787f7fc78", "name": "network-vif-plugged", "status": "completed", "tag": "54e32685-83f3-47e4-883f-d0d7b2a9e798", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:22:38.848510 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-9e63a1e3-fe20-4fed-a986-571cc3fbf06b {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:22:38.849089 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a49420b5-3789-4863-bf0c-65a787f7fc78', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '54e32685-83f3-47e4-883f-d0d7b2a9e798', 'code': 200} Dec 09 21:22:39.032592 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-227db4d5-7aaa-48ae-a645-a99eb8247e8e req-525d472e-4b5e-46aa-a6ed-726471249224 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:39.034135 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-227db4d5-7aaa-48ae-a645-a99eb8247e8e req-525d472e-4b5e-46aa-a6ed-726471249224 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/ports?device_id=a49420b5-3789-4863-bf0c-65a787f7fc78 HTTP/1.1" status: 200 len: 946 time: 0.1251407 Dec 09 21:22:39.050369 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c7c495a-fef7-4567-9f80-b0b0879daa64 req-c0f45124-8ec6-4c98-a087-ac503059548b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:39.052168 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c7c495a-fef7-4567-9f80-b0b0879daa64 req-c0f45124-8ec6-4c98-a087-ac503059548b service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=a49420b5-3789-4863-bf0c-65a787f7fc78 HTTP/1.1" status: 200 len: 1098 time: 0.0928662 Dec 09 21:22:39.073361 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-e185914f-2ef9-4de2-b299-681d14422986 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:39.074813 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-e185914f-2ef9-4de2-b299-681d14422986 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 1098 time: 0.1281457 Dec 09 21:22:39.076595 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-facc3471-7652-47f9-9967-13f94c6c8fe5 req-f86d2d56-febf-48df-a5bb-3cd12c5c5189 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 210 time: 0.0547931 Dec 09 21:22:39.235619 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-227db4d5-7aaa-48ae-a645-a99eb8247e8e req-2900f1e3-e2ea-4b4b-ae0f-f252276b9bbf tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/security-groups?id=47b47381-681d-49da-8acd-4d26ea16fbc0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1882746 Dec 09 21:22:39.237498 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c7c495a-fef7-4567-9f80-b0b0879daa64 req-9be0dda3-3f3d-48d0-bf86-23c86a136266 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=47b47381-681d-49da-8acd-4d26ea16fbc0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1710949 Dec 09 21:22:39.263509 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-90f1f2c9-425b-47b7-8e58-254bb8e93c0b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:39.265005 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-90f1f2c9-425b-47b7-8e58-254bb8e93c0b service neutron] 10.222.0.31 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 922 time: 0.1724167 Dec 09 21:22:39.274482 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9db013db-3673-47b5-b808-69c4a840c5f7 req-b0a161e9-98a3-4165-9df5-d163f2170e33 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:39.276101 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9db013db-3673-47b5-b808-69c4a840c5f7 req-b0a161e9-98a3-4165-9df5-d163f2170e33 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 946 time: 0.1345441 Dec 09 21:22:39.283605 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:39.327133 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-83d6d06b-42ef-40ea-ac01-8c6bf901f84c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=cd5af376-d278-48fb-8867-a970b71280d9 HTTP/1.1" status: 200 len: 217 time: 0.0472188 Dec 09 21:22:39.419518 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-02922f62-e96e-45f5-8bf1-79e68f2f6962 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:39.420983 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-02922f62-e96e-45f5-8bf1-79e68f2f6962 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=c49a62cc-af1b-4958-a4a9-eb44188b8fb9 HTTP/1.1" status: 200 len: 861 time: 0.0835993 Dec 09 21:22:39.426060 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9db013db-3673-47b5-b808-69c4a840c5f7 req-6bae5129-3068-4e03-8b1b-ce00d97ae0e9 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1400383 Dec 09 21:22:39.450376 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04d97cf0-d9c3-4911-878e-d16bb4b9ff64 req-132791ff-02ae-4f81-9833-d0d33d20a3c7 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:39.453235 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04d97cf0-d9c3-4911-878e-d16bb4b9ff64 req-132791ff-02ae-4f81-9833-d0d33d20a3c7 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 949 time: 0.1338325 Dec 09 21:22:39.474614 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-528b55ff-6698-4ddd-b74e-39d7facdab09 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=93378dc3-2ac5-4cf7-9ce3-d812934de40c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0441377 Dec 09 21:22:39.573776 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04d97cf0-d9c3-4911-878e-d16bb4b9ff64 req-bd9b9d91-b18e-4f95-9010-489b90bc107b tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1014519 Dec 09 21:22:39.598661 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-6bc46ca1-644d-4653-9114-4213fddd82aa service neutron] 10.222.0.31 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1105034 Dec 09 21:22:39.731959 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-3afffa80-afe5-49ac-80e9-e05328edead5 service neutron] 10.222.0.31 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1235614 Dec 09 21:22:39.736277 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d907e45-effe-4729-84b5-640f96ff1b67 req-50918c02-f998-45c9-b5a4-203f8adf8568 tempest-MigrationsAdminTest-775845712 tempest-MigrationsAdminTest-775845712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:39.737806 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d907e45-effe-4729-84b5-640f96ff1b67 req-50918c02-f998-45c9-b5a4-203f8adf8568 tempest-MigrationsAdminTest-775845712 tempest-MigrationsAdminTest-775845712-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 1101 time: 0.0621510 Dec 09 21:22:39.797322 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d907e45-effe-4729-84b5-640f96ff1b67 req-fcbe571a-7529-4a8d-a370-2026852c550b tempest-MigrationsAdminTest-775845712 tempest-MigrationsAdminTest-775845712-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0523477 Dec 09 21:22:40.201936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-fdced5e6-bbea-42fd-8a0f-b9c719539efd tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:40.203462 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-fdced5e6-bbea-42fd-8a0f-b9c719539efd tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.10 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 807 time: 0.1852453 Dec 09 21:22:40.223150 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-efaf0327-080d-4d84-bc89-b31319d1b0d5 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Request body: {'port': {'device_id': '7300996b-d799-47a2-9728-a8551719a88f', 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef', 'admin_state_up': True, 'tenant_id': 'ac5b7cefd8cc48cc83f38d3923aae132'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:22:40.230179 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-1fb266a8-255e-4bbb-a514-0a37c8f5c4c7 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0763943 Dec 09 21:22:40.478115 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fb88c166-119e-44e2-8b50-86fbe1dcc549 req-05cf7a8a-19b7-423c-bb4f-b26205d56434 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 210 time: 0.0944865 Dec 09 21:22:40.673047 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8312f10-e4db-4253-8000-cc9eba5150c4 req-ab6cec9f-3d96-49ac-bc84-e01d5ac3a7da tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:40.681594 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8312f10-e4db-4253-8000-cc9eba5150c4 req-ab6cec9f-3d96-49ac-bc84-e01d5ac3a7da tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 949 time: 0.2792354 Dec 09 21:22:40.713682 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c886843d-0e3c-40ce-87b3-c42f4871e440 req-42293fb5-cc2b-41ac-b57d-6ceaa544c71e tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:40.721425 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c886843d-0e3c-40ce-87b3-c42f4871e440 req-42293fb5-cc2b-41ac-b57d-6ceaa544c71e tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/ports?device_id=a49420b5-3789-4863-bf0c-65a787f7fc78 HTTP/1.1" status: 200 len: 946 time: 0.1377878 Dec 09 21:22:40.733317 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-efaf0327-080d-4d84-bc89-b31319d1b0d5 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Made reservation on behalf of ac5b7cefd8cc48cc83f38d3923aae132 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:22:40.737377 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-efaf0327-080d-4d84-bc89-b31319d1b0d5 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:40.834041 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c886843d-0e3c-40ce-87b3-c42f4871e440 req-e5a7f30f-46e2-4e64-8647-7d254a64705c tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/security-groups?id=47b47381-681d-49da-8acd-4d26ea16fbc0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1117189 Dec 09 21:22:40.838753 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8312f10-e4db-4253-8000-cc9eba5150c4 req-7e8e405b-eacb-4400-9c1a-8d5376e6992d tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1563079 Dec 09 21:22:41.081100 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 4425d491-9b2e-48a2-8fb6-ead05da81dba details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:22:41.177706 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-efaf0327-080d-4d84-bc89-b31319d1b0d5 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Allocated IP 172.20.0.10 (04fa749a-9f72-4a2c-a725-feab917f99ef/eae2438b-9fcc-44ef-a172-6c4911cad13f/13499602-258c-4839-b928-17aef0d24310) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:22:41.382999 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-efaf0327-080d-4d84-bc89-b31319d1b0d5 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:41.435483 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-efaf0327-080d-4d84-bc89-b31319d1b0d5 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:41.457523 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 4425d491-9b2e-48a2-8fb6-ead05da81dba, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=4425d491-9b2e-48a2-8fb6-ead05da81dba,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:41.493115 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '4425d491-9b2e-48a2-8fb6-ead05da81dba', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '4425d491-9b2e-48a2-8fb6-ead05da81dba', 'mac_address': 'fa:16:3e:11:c7:48', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.242'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:22:41.503700 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['6166c639-9f87-4254-af88-12c4be868be5'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:22:41.579193 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-efaf0327-080d-4d84-bc89-b31319d1b0d5 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Network 04fa749a-9f72-4a2c-a725-feab917f99ef is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:22:41.623747 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4183b1c3-6a71-4bff-b3b9-dd0934a7d280 req-8fab20c8-fc13-4311-88ba-341d9017abe1 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:41.626160 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4183b1c3-6a71-4bff-b3b9-dd0934a7d280 req-8fab20c8-fc13-4311-88ba-341d9017abe1 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 946 time: 0.6105018 Dec 09 21:22:41.631538 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-efaf0327-080d-4d84-bc89-b31319d1b0d5 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:22:41.723325 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:41.748992 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-efaf0327-080d-4d84-bc89-b31319d1b0d5 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:22:41.780230 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efaf0327-080d-4d84-bc89-b31319d1b0d5 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Pushing event updated for resources: {'Port': ['ID=13499602-258c-4839-b928-17aef0d24310,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:41.805668 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 4425d491-9b2e-48a2-8fb6-ead05da81dba {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:22:41.830551 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33790) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:41.910504 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 4425d491-9b2e-48a2-8fb6-ead05da81dba, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=4425d491-9b2e-48a2-8fb6-ead05da81dba,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:41.911411 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-efaf0327-080d-4d84-bc89-b31319d1b0d5 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:41.912397 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-efaf0327-080d-4d84-bc89-b31319d1b0d5 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:41.923877 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:41.949987 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4183b1c3-6a71-4bff-b3b9-dd0934a7d280 req-6161da11-47ef-4d88-b5ef-73bd1ae1b712 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2832668 Dec 09 21:22:41.969040 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-663a0cd6-6d75-4c71-8b73-26251446ebbb req-20db0d82-8979-4c08-92ba-574304fa3099 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:41.982914 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-663a0cd6-6d75-4c71-8b73-26251446ebbb req-20db0d82-8979-4c08-92ba-574304fa3099 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 932 time: 0.2606568 Dec 09 21:22:41.993773 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-efaf0327-080d-4d84-bc89-b31319d1b0d5 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.7747564 Dec 09 21:22:42.031308 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-113e2d18-dcb2-40c5-80ca-907439ff0160 service neutron] Request body: {'port': {'device_id': '7300996b-d799-47a2-9728-a8551719a88f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:22:42.042665 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=4425d491-9b2e-48a2-8fb6-ead05da81dba,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:42.121973 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['4425d491-9b2e-48a2-8fb6-ead05da81dba'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:22:42.180776 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4664ada5-a605-4498-918a-2806a5bfd464 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:42.340030 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4664ada5-a605-4498-918a-2806a5bfd464 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:42.355393 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4664ada5-a605-4498-918a-2806a5bfd464 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:42.424436 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4664ada5-a605-4498-918a-2806a5bfd464 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=4009981eeee9439ba61b9179452eb108&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5927463 Dec 09 21:22:42.441064 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33810) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:42.497212 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4664ada5-a605-4498-918a-2806a5bfd464 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=212ffc68-a328-4018-a363-21a05e6dc5af,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:42.535002 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4664ada5-a605-4498-918a-2806a5bfd464 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:42.536830 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4664ada5-a605-4498-918a-2806a5bfd464 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:42.537363 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4664ada5-a605-4498-918a-2806a5bfd464 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:42.538797 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4664ada5-a605-4498-918a-2806a5bfd464 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:42.539842 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4664ada5-a605-4498-918a-2806a5bfd464 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:42.540345 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4664ada5-a605-4498-918a-2806a5bfd464 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:42.541367 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4664ada5-a605-4498-918a-2806a5bfd464 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:42.542032 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4664ada5-a605-4498-918a-2806a5bfd464 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:42.542793 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4664ada5-a605-4498-918a-2806a5bfd464 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:42.543293 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4664ada5-a605-4498-918a-2806a5bfd464 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:42.543865 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4664ada5-a605-4498-918a-2806a5bfd464 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:42.544727 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4664ada5-a605-4498-918a-2806a5bfd464 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:42.545214 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4664ada5-a605-4498-918a-2806a5bfd464 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:22:42.592930 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-663a0cd6-6d75-4c71-8b73-26251446ebbb req-8f82eaf7-585a-441a-a7b9-5a4f0218385f tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6075282 Dec 09 21:22:42.612000 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1be5975c-1d0c-48ed-b2ec-b0ca9b8069b3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:42.671077 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1be5975c-1d0c-48ed-b2ec-b0ca9b8069b3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:42.706954 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-113e2d18-dcb2-40c5-80ca-907439ff0160 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:42.783459 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca04d9d0-c0a2-4581-807a-acc5c0840b0e req-82361478-a111-4287-a80f-d0b9a0ea10ec tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:42.792171 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ca04d9d0-c0a2-4581-807a-acc5c0840b0e req-82361478-a111-4287-a80f-d0b9a0ea10ec tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 949 time: 0.6842344 Dec 09 21:22:42.802867 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1be5975c-1d0c-48ed-b2ec-b0ca9b8069b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:42.807371 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1be5975c-1d0c-48ed-b2ec-b0ca9b8069b3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:42.809794 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1be5975c-1d0c-48ed-b2ec-b0ca9b8069b3 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/212ffc68-a328-4018-a363-21a05e6dc5af HTTP/1.1" status: 204 len: 168 time: 0.3677278 Dec 09 21:22:42.822260 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1be5975c-1d0c-48ed-b2ec-b0ca9b8069b3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=212ffc68-a328-4018-a363-21a05e6dc5af,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:42.836889 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-876a897a-7758-417e-bc00-cc1af18e3b28 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:42.842871 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-876a897a-7758-417e-bc00-cc1af18e3b28 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 1101 time: 0.3885045 Dec 09 21:22:43.083952 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 7f26d4c2-71a3-44d0-bf00-8c0c0833f323 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:22:43.094578 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 4425d491-9b2e-48a2-8fb6-ead05da81dba up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:22:43.188557 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5296613e-119d-42d4-85b8-004a6fb31b24 req-ff6c0a6c-09a5-4503-8c2b-b3068c8bf94b tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:43.198075 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5296613e-119d-42d4-85b8-004a6fb31b24 req-ff6c0a6c-09a5-4503-8c2b-b3068c8bf94b tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/ports?device_id=a49420b5-3789-4863-bf0c-65a787f7fc78 HTTP/1.1" status: 200 len: 946 time: 0.4772265 Dec 09 21:22:43.314647 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ca04d9d0-c0a2-4581-807a-acc5c0840b0e req-47af8d29-0498-4814-b3ce-c6e1872301c5 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4687359 Dec 09 21:22:43.362161 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 7f26d4c2-71a3-44d0-bf00-8c0c0833f323, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=7f26d4c2-71a3-44d0-bf00-8c0c0833f323,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:43.377116 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '7f26d4c2-71a3-44d0-bf00-8c0c0833f323', 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6', 'port_id': '7f26d4c2-71a3-44d0-bf00-8c0c0833f323', 'mac_address': 'fa:16:3e:31:d2:96', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 122, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '63e7603a-bb11-4d1a-8d84-55456d81931c', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:22:43.408675 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-f871a17a-8ac7-4ba4-9dd5-61ef782189e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:43.410188 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-f871a17a-8ac7-4ba4-9dd5-61ef782189e5 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.5162611 Dec 09 21:22:43.445138 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:43.466665 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 4425d491-9b2e-48a2-8fb6-ead05da81dba triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:43.467413 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:43.471348 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 7f26d4c2-71a3-44d0-bf00-8c0c0833f323 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:22:43.531088 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 7f26d4c2-71a3-44d0-bf00-8c0c0833f323, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=7f26d4c2-71a3-44d0-bf00-8c0c0833f323,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:43.544374 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:43.569481 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33834) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:43.584695 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a706be29-9541-4f4f-a71f-e21114277d1e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:43.604457 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-8769eb9c-9219-4382-a6e3-3aceee0c5de9 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.12&port_id=6f6b3fc9-0b99-4cad-869c-ed52dde9578b HTTP/1.1" status: 200 len: 217 time: 0.1767313 Dec 09 21:22:43.617831 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5296613e-119d-42d4-85b8-004a6fb31b24 req-9be65a82-18f1-43d3-9c7f-f63e37c134b4 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/security-groups?id=47b47381-681d-49da-8acd-4d26ea16fbc0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.3763783 Dec 09 21:22:43.675259 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:43.688835 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['7f26d4c2-71a3-44d0-bf00-8c0c0833f323'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:22:43.816959 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=7f26d4c2-71a3-44d0-bf00-8c0c0833f323,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:43.826005 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a706be29-9541-4f4f-a71f-e21114277d1e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:43.837289 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a706be29-9541-4f4f-a71f-e21114277d1e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:43.862271 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-0d798b34-553d-464c-b556-e013a7110aec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:43.863534 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-0d798b34-553d-464c-b556-e013a7110aec service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.2090752 Dec 09 21:22:43.883198 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8f48a806-013e-480e-81ac-1a7f5f10c155', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4425d491-9b2e-48a2-8fb6-ead05da81dba'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:22:43.885934 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9a8f608d-871b-4b37-9f21-8f34cc3243a1" -d '{"events": [{"server_uuid": "8f48a806-013e-480e-81ac-1a7f5f10c155", "name": "network-vif-plugged", "status": "completed", "tag": "4425d491-9b2e-48a2-8fb6-ead05da81dba"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:22:43.907944 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 4425d491-9b2e-48a2-8fb6-ead05da81dba, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=4425d491-9b2e-48a2-8fb6-ead05da81dba,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:43.929591 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:43.935141 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a706be29-9541-4f4f-a71f-e21114277d1e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eae03418-b72b-42f2-9ddd-7f16aeb98466,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:43.949584 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a706be29-9541-4f4f-a71f-e21114277d1e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=8bbe13dcb0ca4e40aa0fe4e9060c3e24&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3790324 Dec 09 21:22:43.950187 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33850) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:44.037911 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-11b15bee-f29a-4ff6-9023-0728cc3b2061 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:44.065264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-f1162422-57dd-4862-be9d-707ba7483b96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:44.095055 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-f1162422-57dd-4862-be9d-707ba7483b96 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.2239835 Dec 09 21:22:44.112087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-113e2d18-dcb2-40c5-80ca-907439ff0160 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 13499602-258c-4839-b928-17aef0d24310 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:22:44.119665 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-11b15bee-f29a-4ff6-9023-0728cc3b2061 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:44.135047 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=4425d491-9b2e-48a2-8fb6-ead05da81dba,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:44.187318 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-113e2d18-dcb2-40c5-80ca-907439ff0160 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:44.223797 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-11b15bee-f29a-4ff6-9023-0728cc3b2061 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:44.226883 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-11b15bee-f29a-4ff6-9023-0728cc3b2061 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:44.228220 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-11b15bee-f29a-4ff6-9023-0728cc3b2061 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/eae03418-b72b-42f2-9ddd-7f16aeb98466 HTTP/1.1" status: 204 len: 168 time: 0.2770634 Dec 09 21:22:44.261762 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11b15bee-f29a-4ff6-9023-0728cc3b2061 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eae03418-b72b-42f2-9ddd-7f16aeb98466,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:44.306752 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-113e2d18-dcb2-40c5-80ca-907439ff0160 service neutron] Transition to ACTIVE for port object 13499602-258c-4839-b928-17aef0d24310 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:22:44.325023 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-113e2d18-dcb2-40c5-80ca-907439ff0160 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:44.478619 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-d611b419-cdde-4266-92be-aff94ef66cfe service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3612752 Dec 09 21:22:44.485825 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-113e2d18-dcb2-40c5-80ca-907439ff0160 service neutron] Pushing event updated for resources: {'Port': ['ID=13499602-258c-4839-b928-17aef0d24310,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:44.746582 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-113e2d18-dcb2-40c5-80ca-907439ff0160 service neutron] Attempting to bind port 13499602-258c-4839-b928-17aef0d24310 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:22:44.747771 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-113e2d18-dcb2-40c5-80ca-907439ff0160 service neutron] Attempting to bind port 13499602-258c-4839-b928-17aef0d24310 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:22:44.748311 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-113e2d18-dcb2-40c5-80ca-907439ff0160 service neutron] Attempting to bind port 13499602-258c-4839-b928-17aef0d24310 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:22:44.759339 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-113e2d18-dcb2-40c5-80ca-907439ff0160 service neutron] Port 13499602-258c-4839-b928-17aef0d24310 on network 04fa749a-9f72-4a2c-a725-feab917f99ef not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:22:44.759972 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-113e2d18-dcb2-40c5-80ca-907439ff0160 service neutron] Attempting to bind port 13499602-258c-4839-b928-17aef0d24310 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:22:44.776255 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-d4dc6aab-35e0-47f5-bfde-b6838fb93a5a service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2750793 Dec 09 21:22:44.777259 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-113e2d18-dcb2-40c5-80ca-907439ff0160 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 22, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:22:44.777786 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-113e2d18-dcb2-40c5-80ca-907439ff0160 service neutron] Checking segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:22:44.778354 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-113e2d18-dcb2-40c5-80ca-907439ff0160 service neutron] Bound using segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:22:44.778994 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-113e2d18-dcb2-40c5-80ca-907439ff0160 service neutron] Bound port: 13499602-258c-4839-b928-17aef0d24310, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:22:44.779549 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-113e2d18-dcb2-40c5-80ca-907439ff0160 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:44.954693 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-113e2d18-dcb2-40c5-80ca-907439ff0160 service neutron] For port 13499602-258c-4839-b928-17aef0d24310, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:22:44.969482 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-113e2d18-dcb2-40c5-80ca-907439ff0160 service neutron] For port 13499602-258c-4839-b928-17aef0d24310, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=13499602-258c-4839-b928-17aef0d24310,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:22:44.980119 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-113e2d18-dcb2-40c5-80ca-907439ff0160 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:45.060043 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-113e2d18-dcb2-40c5-80ca-907439ff0160 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:45.060734 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-113e2d18-dcb2-40c5-80ca-907439ff0160 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:45.062895 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-113e2d18-dcb2-40c5-80ca-907439ff0160 service neutron] 10.222.0.10 "PUT /v2.0/ports/13499602-258c-4839-b928-17aef0d24310 HTTP/1.1" status: 200 len: 1093 time: 3.0522172 Dec 09 21:22:45.063391 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7300996b-d799-47a2-9728-a8551719a88f', 'tag': '13499602-258c-4839-b928-17aef0d24310'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:22:45.070431 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b020943e-ccda-4148-9a2c-256aa336805e" -d '{"events": [{"name": "network-changed", "server_uuid": "7300996b-d799-47a2-9728-a8551719a88f", "tag": "13499602-258c-4839-b928-17aef0d24310"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:22:45.092168 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 7f26d4c2-71a3-44d0-bf00-8c0c0833f323 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:22:45.185940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-113e2d18-dcb2-40c5-80ca-907439ff0160 service neutron] Pushing event updated for resources: {'Port': ['ID=13499602-258c-4839-b928-17aef0d24310,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:45.246204 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 7f26d4c2-71a3-44d0-bf00-8c0c0833f323 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:22:45.246540 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-564629c4-ee1e-4013-b6e5-0956885c4fbd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:45.246658 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:45.255000 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-564629c4-ee1e-4013-b6e5-0956885c4fbd service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 1096 time: 0.1343460 Dec 09 21:22:45.328128 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-e15f63eb-f1a0-499a-9b0f-eb95da463f1c service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=13499602-258c-4839-b928-17aef0d24310 HTTP/1.1" status: 200 len: 217 time: 0.0628018 Dec 09 21:22:45.419170 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-2fd2dc10-44e1-44bb-9270-bb5889218391 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:45.420798 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-2fd2dc10-44e1-44bb-9270-bb5889218391 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=eae2438b-9fcc-44ef-a172-6c4911cad13f HTTP/1.1" status: 200 len: 847 time: 0.0808742 Dec 09 21:22:45.439007 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:45.499726 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-b042490f-bd63-4c28-ac34-102a024bda01 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=04fa749a-9f72-4a2c-a725-feab917f99ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0658314 Dec 09 21:22:45.503029 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 7f26d4c2-71a3-44d0-bf00-8c0c0833f323, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=7f26d4c2-71a3-44d0-bf00-8c0c0833f323,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:45.510983 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:45.607711 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=7f26d4c2-71a3-44d0-bf00-8c0c0833f323,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:45.742089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-adca38c7-96da-430c-a22d-865a0de6c4f3 service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2307637 Dec 09 21:22:45.956806 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b25b2ec-0be6-48cd-b8eb-70c59a8276c9 req-8ca864f3-9f07-4231-8475-360636faa251 service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2037632 Dec 09 21:22:46.923598 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:22:54.605325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b1ade5c-fa57-4798-ae87-cbb3684ee2b1 req-9206b3b1-0063-4cda-89ad-e0f92c8249f4 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:54.616801 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b1ade5c-fa57-4798-ae87-cbb3684ee2b1 req-9206b3b1-0063-4cda-89ad-e0f92c8249f4 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 946 time: 0.0651588 Dec 09 21:22:54.707301 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b1ade5c-fa57-4798-ae87-cbb3684ee2b1 req-aadf7137-2bf9-47f7-8301-88c0d15bbde2 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0890827 Dec 09 21:22:54.732354 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-369625e7-24f2-46c8-9a7c-91a12f5d0cfb req-c8836060-0993-4d19-a56d-314c3075293b tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:54.741321 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-369625e7-24f2-46c8-9a7c-91a12f5d0cfb req-c8836060-0993-4d19-a56d-314c3075293b tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 944 time: 0.1064899 Dec 09 21:22:54.805909 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-369625e7-24f2-46c8-9a7c-91a12f5d0cfb req-6de651a0-0177-4808-9b74-2628a4a4524f tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0634477 Dec 09 21:22:54.918978 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7397edb4-608f-477e-a1f1-747782897cb6 req-d183e04c-aab0-4c38-8ef0-91ac8d8205c3 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:54.920850 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7397edb4-608f-477e-a1f1-747782897cb6 req-d183e04c-aab0-4c38-8ef0-91ac8d8205c3 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/ports?device_id=a49420b5-3789-4863-bf0c-65a787f7fc78 HTTP/1.1" status: 200 len: 946 time: 0.0662704 Dec 09 21:22:54.931160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33934) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:54.936821 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-02abb300-39db-40ee-a88b-af3d2d992600 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Request body: {'floatingip': {'port_id': '54e32685-83f3-47e4-883f-d0d7b2a9e798'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:22:55.023549 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02abb300-39db-40ee-a88b-af3d2d992600 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks [] for floatingip, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:55.045845 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:22:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b0a8daff-8c66-4024-be86-adaa434acff2 x-openstack-request-id: req-b0a8daff-8c66-4024-be86-adaa434acff2 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:22:55.046364 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8f48a806-013e-480e-81ac-1a7f5f10c155", "name": "network-vif-plugged", "status": "completed", "tag": "4425d491-9b2e-48a2-8fb6-ead05da81dba", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:22:55.046364 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-b0a8daff-8c66-4024-be86-adaa434acff2 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:22:55.046776 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8f48a806-013e-480e-81ac-1a7f5f10c155', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4425d491-9b2e-48a2-8fb6-ead05da81dba', 'code': 200} Dec 09 21:22:55.095137 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcf72ac4-30ea-4133-8958-485e3b2acc28 req-fef274a4-fd21-4f33-bf16-e4d3cf40a49f tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:55.097549 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fcf72ac4-30ea-4133-8958-485e3b2acc28 req-fef274a4-fd21-4f33-bf16-e4d3cf40a49f tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 949 time: 0.1052320 Dec 09 21:22:55.100540 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:22:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dc884450-34aa-4593-b542-649e498bfec8 x-openstack-request-id: req-dc884450-34aa-4593-b542-649e498bfec8 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:22:55.101477 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7300996b-d799-47a2-9728-a8551719a88f", "tag": "13499602-258c-4839-b928-17aef0d24310", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:22:55.101944 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-dc884450-34aa-4593-b542-649e498bfec8 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:22:55.102799 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7300996b-d799-47a2-9728-a8551719a88f', 'tag': '13499602-258c-4839-b928-17aef0d24310', 'status': 'completed', 'code': 200} Dec 09 21:22:55.206988 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fcf72ac4-30ea-4133-8958-485e3b2acc28 req-d659625a-e1d2-4c3f-b713-054033253d00 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1026514 Dec 09 21:22:55.452061 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b020943e-ccda-4148-9a2c-256aa336805e req-f8ec9403-95c3-4d04-a068-0af4a2146889 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:55.453611 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b020943e-ccda-4148-9a2c-256aa336805e req-f8ec9403-95c3-4d04-a068-0af4a2146889 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 1096 time: 0.3387873 Dec 09 21:22:55.484811 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a2bdb67-7d28-477e-97d0-fe90679cf7a1 req-a16e55ff-4d31-40ac-b1d6-2413fd29f807 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:55.492714 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5a2bdb67-7d28-477e-97d0-fe90679cf7a1 req-a16e55ff-4d31-40ac-b1d6-2413fd29f807 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/ports?device_id=8f48a806-013e-480e-81ac-1a7f5f10c155 HTTP/1.1" status: 200 len: 950 time: 0.1411569 Dec 09 21:22:55.610015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b020943e-ccda-4148-9a2c-256aa336805e req-bfde7194-6d53-4916-814e-724fdc234a2b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:55.611180 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b020943e-ccda-4148-9a2c-256aa336805e req-bfde7194-6d53-4916-814e-724fdc234a2b service neutron] 10.222.0.10 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 908 time: 0.1432421 Dec 09 21:22:55.676163 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5a2bdb67-7d28-477e-97d0-fe90679cf7a1 req-7c8e72b0-991f-420f-9994-940fb53e1caf tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/security-groups?id=24094cbf-e652-478e-bb06-edc8eb774ee3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1794364 Dec 09 21:22:55.680147 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b020943e-ccda-4148-9a2c-256aa336805e req-9e005f37-d942-4025-a1b0-3913f4649b92 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=13499602-258c-4839-b928-17aef0d24310 HTTP/1.1" status: 200 len: 217 time: 0.0590587 Dec 09 21:22:55.772905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b020943e-ccda-4148-9a2c-256aa336805e req-470be620-b64c-42e8-8b4d-7f95f3359c60 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:55.774900 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b020943e-ccda-4148-9a2c-256aa336805e req-470be620-b64c-42e8-8b4d-7f95f3359c60 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=eae2438b-9fcc-44ef-a172-6c4911cad13f HTTP/1.1" status: 200 len: 847 time: 0.0864329 Dec 09 21:22:55.866376 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b020943e-ccda-4148-9a2c-256aa336805e req-14066146-9db8-488d-af1f-afa459010db3 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=04fa749a-9f72-4a2c-a725-feab917f99ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0840693 Dec 09 21:22:55.900191 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02abb300-39db-40ee-a88b-af3d2d992600 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:55.914468 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02abb300-39db-40ee-a88b-af3d2d992600 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:56.027997 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33986) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:56.059657 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-02abb300-39db-40ee-a88b-af3d2d992600 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Floating IP fd7bddb5-c30c-4ada-80cf-a847d82e6b6e associated. External IP: 172.25.3.9, port: 54e32685-83f3-47e4-883f-d0d7b2a9e798. Dec 09 21:22:56.079148 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6657e8f-b562-493e-8be2-bfe87f7001ff req-22ea921d-b74a-4589-961f-39aed5fe42ab tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:56.087309 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6657e8f-b562-493e-8be2-bfe87f7001ff req-22ea921d-b74a-4589-961f-39aed5fe42ab tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 946 time: 0.2121615 Dec 09 21:22:56.153301 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b020943e-ccda-4148-9a2c-256aa336805e req-0e2f49d7-6635-40a4-b8ab-6ef00242934a service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2769492 Dec 09 21:22:56.192744 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6657e8f-b562-493e-8be2-bfe87f7001ff req-064a4eb1-e905-4656-836d-c37680b65733 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1042671 Dec 09 21:22:56.209725 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2bb8f010-10f7-4a2b-bb0d-709551abd813 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:56.324770 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2bb8f010-10f7-4a2b-bb0d-709551abd813 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:56.368881 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2bb8f010-10f7-4a2b-bb0d-709551abd813 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:56.383717 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b020943e-ccda-4148-9a2c-256aa336805e req-bae7c5b9-2ebb-44d0-89f0-1a03d8370b0c service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2215755 Dec 09 21:22:56.430400 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2bb8f010-10f7-4a2b-bb0d-709551abd813 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e6cda191fe554eebb50e699a21ba1a0b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3982110 Dec 09 21:22:56.437207 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33998) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:56.460567 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83fad9bc-9062-499d-845a-b7659f8a6515 req-6a0b24d1-c0c7-403b-9ea5-1bedef179ce5 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:56.467993 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83fad9bc-9062-499d-845a-b7659f8a6515 req-6a0b24d1-c0c7-403b-9ea5-1bedef179ce5 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 944 time: 0.1485443 Dec 09 21:22:56.508057 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13541b87-9852-45d0-8e07-a226382a7389 req-e6fa5fd5-347b-4eb8-9141-dbc13da6bfb6 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:56.516544 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-13541b87-9852-45d0-8e07-a226382a7389 req-e6fa5fd5-347b-4eb8-9141-dbc13da6bfb6 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 949 time: 0.1107919 Dec 09 21:22:56.576507 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83fad9bc-9062-499d-845a-b7659f8a6515 req-a69aaa16-4237-47ac-8a32-eb34a5e5c82a tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1074293 Dec 09 21:22:56.625020 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-13541b87-9852-45d0-8e07-a226382a7389 req-73e02cbe-e5f5-4a6d-ad12-fe459332e324 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1070056 Dec 09 21:22:56.801636 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bb8f010-10f7-4a2b-bb0d-709551abd813 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ed6cc828-d7dd-42dd-a900-a21d38ee771b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:56.862548 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-02abb300-39db-40ee-a88b-af3d2d992600 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Router 5cb2944b-70be-4f74-b4d0-e06f75765688 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:22:56.867457 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-833856b7-2942-4d6a-b3cb-9bc581e41d1b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:56.926900 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-833856b7-2942-4d6a-b3cb-9bc581e41d1b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:56.977166 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:57.013351 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-02abb300-39db-40ee-a88b-af3d2d992600 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:22:57.018092 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02abb300-39db-40ee-a88b-af3d2d992600 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:57.025738 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9657374-fc1c-4285-8901-820e8c86b1ab None None] Sync routers for ids ['5cb2944b-70be-4f74-b4d0-e06f75765688'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:22:57.039524 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-833856b7-2942-4d6a-b3cb-9bc581e41d1b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:57.042123 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-833856b7-2942-4d6a-b3cb-9bc581e41d1b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:57.045838 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9657374-fc1c-4285-8901-820e8c86b1ab None None] Routers {'5cb2944b-70be-4f74-b4d0-e06f75765688'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:22:57.046085 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-833856b7-2942-4d6a-b3cb-9bc581e41d1b admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/ed6cc828-d7dd-42dd-a900-a21d38ee771b HTTP/1.1" status: 204 len: 168 time: 0.6050286 Dec 09 21:22:57.046218 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-e9657374-fc1c-4285-8901-820e8c86b1ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:22:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['5cb2944b-70be-4f74-b4d0-e06f75765688'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:57.056372 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-833856b7-2942-4d6a-b3cb-9bc581e41d1b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ed6cc828-d7dd-42dd-a900-a21d38ee771b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:57.062035 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-02abb300-39db-40ee-a88b-af3d2d992600 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "PUT /v2.0/floatingips/fd7bddb5-c30c-4ada-80cf-a847d82e6b6e HTTP/1.1" status: 200 len: 990 time: 2.1269181 Dec 09 21:22:57.062035 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a49420b5-3789-4863-bf0c-65a787f7fc78', 'tag': '54e32685-83f3-47e4-883f-d0d7b2a9e798'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:22:57.062259 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7ad8d162-54e2-4c5f-8ffc-07e85ff56fa6" -d '{"events": [{"name": "network-changed", "server_uuid": "a49420b5-3789-4863-bf0c-65a787f7fc78", "tag": "54e32685-83f3-47e4-883f-d0d7b2a9e798"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:22:57.131457 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b9b4e0ee-aaae-4214-be9d-1af0b5120e5d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7f26d4c2-71a3-44d0-bf00-8c0c0833f323'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:22:57.134674 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0977ca16-6d36-4bfa-9d14-dd358f5ebf0a" -d '{"events": [{"server_uuid": "b9b4e0ee-aaae-4214-be9d-1af0b5120e5d", "name": "network-vif-plugged", "status": "completed", "tag": "7f26d4c2-71a3-44d0-bf00-8c0c0833f323"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:22:57.203712 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:57.229138 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:22:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-418e5358-5cdc-4681-92b2-45407830fc6d x-openstack-request-id: req-418e5358-5cdc-4681-92b2-45407830fc6d {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:22:57.229617 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b9b4e0ee-aaae-4214-be9d-1af0b5120e5d", "name": "network-vif-plugged", "status": "completed", "tag": "7f26d4c2-71a3-44d0-bf00-8c0c0833f323", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:22:57.229884 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-418e5358-5cdc-4681-92b2-45407830fc6d {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:22:57.230279 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b9b4e0ee-aaae-4214-be9d-1af0b5120e5d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7f26d4c2-71a3-44d0-bf00-8c0c0833f323', 'code': 200} Dec 09 21:22:57.242872 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-e9657374-fc1c-4285-8901-820e8c86b1ab None None] Set router 5cb2944b-70be-4f74-b4d0-e06f75765688 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:22:57.343408 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b1f456d-8ec6-4d3c-819b-07efdfd6cd61 req-c12b3d72-2d2d-496d-9522-b47809bc0fab tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:57.353518 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b1f456d-8ec6-4d3c-819b-07efdfd6cd61 req-c12b3d72-2d2d-496d-9522-b47809bc0fab tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 946 time: 0.0695925 Dec 09 21:22:57.418921 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b1f456d-8ec6-4d3c-819b-07efdfd6cd61 req-7f0f378a-8b01-4488-b96f-3a6f18a100b3 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0641699 Dec 09 21:22:57.487222 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34044) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:57.502966 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-e9657374-fc1c-4285-8901-820e8c86b1ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'name': 'tempest-ServersTestManualDisk-255636487-router', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26'}], 'enable_snat': True}, 'gw_port_id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:21:59Z', 'updated_at': '2021-12-09T21:22:07Z', 'revision_number': 4, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'gw_port': {'id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:cd:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'device_owner': 'network:router_gateway', 'standard_attr_id': 623, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:22:02Z', 'updated_at': '2021-12-09T21:22:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'fd7bddb5-c30c-4ada-80cf-a847d82e6b6e', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'floating_ip_address': '172.25.3.9', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'port_id': '54e32685-83f3-47e4-883f-d0d7b2a9e798', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 638, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20', 'mac_address': 'fa:16:3e:07:db:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a49420b5-3789-4863-bf0c-65a787f7fc78', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:22:17Z', 'updated_at': '2021-12-09T21:22:55Z', 'revision_number': 1, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'cd61cf32-db9c-49d2-8b1c-50a6abb2e135', 'name': '', 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'mac_address': 'fa:16:3e:e5:cc:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'device_owner': 'network:router_interface', 'standard_attr_id': 624, 'fixed_ips': [{'subnet_id': '069b1784-6c14-42f6-a10c-b0d4447b6091', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:22:06Z', 'updated_at': '2021-12-09T21:22:16Z', 'revision_number': 5, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'subnets': [{'id': '069b1784-6c14-42f6-a10c-b0d4447b6091', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:57.504688 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8086dab-d8a8-41d0-9691-7e3df1d92f1c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:57.527294 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:22:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-69372373-05b8-4e8e-a25f-f9d433224469 x-openstack-request-id: req-69372373-05b8-4e8e-a25f-f9d433224469 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:22:57.527628 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a49420b5-3789-4863-bf0c-65a787f7fc78", "tag": "54e32685-83f3-47e4-883f-d0d7b2a9e798", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:22:57.527878 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-69372373-05b8-4e8e-a25f-f9d433224469 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:22:57.528279 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a49420b5-3789-4863-bf0c-65a787f7fc78', 'tag': '54e32685-83f3-47e4-883f-d0d7b2a9e798', 'status': 'completed', 'code': 200} Dec 09 21:22:57.534824 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9657374-fc1c-4285-8901-820e8c86b1ab None None] Checking router: 5cb2944b-70be-4f74-b4d0-e06f75765688 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:22:57.544639 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9657374-fc1c-4285-8901-820e8c86b1ab None None] Routers {'5cb2944b-70be-4f74-b4d0-e06f75765688'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:22:57.545367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-e9657374-fc1c-4285-8901-820e8c86b1ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:22:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['5cb2944b-70be-4f74-b4d0-e06f75765688'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:57.599987 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ad8d162-54e2-4c5f-8ffc-07e85ff56fa6 req-9b959648-04c3-474a-bb40-a4a344797753 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:57.601860 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ad8d162-54e2-4c5f-8ffc-07e85ff56fa6 req-9b959648-04c3-474a-bb40-a4a344797753 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=2429d4a7c27042e7ab6a04a9cf722b47&device_id=a49420b5-3789-4863-bf0c-65a787f7fc78 HTTP/1.1" status: 200 len: 1098 time: 0.0495398 Dec 09 21:22:57.607658 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8086dab-d8a8-41d0-9691-7e3df1d92f1c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:57.612771 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8086dab-d8a8-41d0-9691-7e3df1d92f1c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:57.673299 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f8086dab-d8a8-41d0-9691-7e3df1d92f1c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=452711e82de241709c80d5fdc36c767e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1847816 Dec 09 21:22:57.674323 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8086dab-d8a8-41d0-9691-7e3df1d92f1c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=da9e6fca-af87-452c-8869-54d9fdfab2c2,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:57.677979 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34050) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:22:57.741391 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70e0eebd-5650-4c9f-9038-1ce58f153948 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:57.768264 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70e0eebd-5650-4c9f-9038-1ce58f153948 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:57.807060 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ad8d162-54e2-4c5f-8ffc-07e85ff56fa6 req-f1b4b1ce-61cf-4144-b98c-50cbb0013937 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:57.808756 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ad8d162-54e2-4c5f-8ffc-07e85ff56fa6 req-f1b4b1ce-61cf-4144-b98c-50cbb0013937 service neutron] 10.222.0.10 "GET /v2.0/networks?id=6b0e1b89-20b6-4a70-94cb-58b2b1f77a20 HTTP/1.1" status: 200 len: 912 time: 0.1948478 Dec 09 21:22:57.825557 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70e0eebd-5650-4c9f-9038-1ce58f153948 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:57.827116 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64cee9e2-59a3-4d89-94f1-a11d0fd7afcd req-3136c8e3-b576-403d-b73e-2e4df0a8a3c1 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:57.828197 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70e0eebd-5650-4c9f-9038-1ce58f153948 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:57.832024 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-70e0eebd-5650-4c9f-9038-1ce58f153948 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/da9e6fca-af87-452c-8869-54d9fdfab2c2 HTTP/1.1" status: 204 len: 168 time: 0.1498849 Dec 09 21:22:57.835844 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-64cee9e2-59a3-4d89-94f1-a11d0fd7afcd req-3136c8e3-b576-403d-b73e-2e4df0a8a3c1 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 944 time: 0.1478641 Dec 09 21:22:57.837556 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70e0eebd-5650-4c9f-9038-1ce58f153948 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=da9e6fca-af87-452c-8869-54d9fdfab2c2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:57.855157 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-e9657374-fc1c-4285-8901-820e8c86b1ab None None] Set router 5cb2944b-70be-4f74-b4d0-e06f75765688 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:22:57.937545 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9269a00a-2bc5-4c26-80c9-6a9c25aa9c76 req-08bafae2-60d9-4918-94c6-2d3a147475be tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:57.939074 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9269a00a-2bc5-4c26-80c9-6a9c25aa9c76 req-08bafae2-60d9-4918-94c6-2d3a147475be tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 949 time: 0.1907959 Dec 09 21:22:57.966886 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ad8d162-54e2-4c5f-8ffc-07e85ff56fa6 req-14d06ff2-ed52-434c-aec8-21c4375a6292 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=54e32685-83f3-47e4-883f-d0d7b2a9e798 HTTP/1.1" status: 200 len: 998 time: 0.1213024 Dec 09 21:22:57.977941 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-64cee9e2-59a3-4d89-94f1-a11d0fd7afcd req-e71c6caf-3ffa-4d4b-afe1-11b49933c2cb tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1410637 Dec 09 21:22:58.050076 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9269a00a-2bc5-4c26-80c9-6a9c25aa9c76 req-51d498a7-9b89-4c7e-b436-0531fd7c7712 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0979316 Dec 09 21:22:58.070285 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ad8d162-54e2-4c5f-8ffc-07e85ff56fa6 req-05adc456-387b-4bab-9130-dd834eb900d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:58.071981 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ad8d162-54e2-4c5f-8ffc-07e85ff56fa6 req-05adc456-387b-4bab-9130-dd834eb900d1 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=069b1784-6c14-42f6-a10c-b0d4447b6091 HTTP/1.1" status: 200 len: 850 time: 0.0875416 Dec 09 21:22:58.142161 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ad8d162-54e2-4c5f-8ffc-07e85ff56fa6 req-71a85a1f-71f9-4e19-9072-3b7ee1fd8893 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:58.143715 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ad8d162-54e2-4c5f-8ffc-07e85ff56fa6 req-71a85a1f-71f9-4e19-9072-3b7ee1fd8893 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=6b0e1b89-20b6-4a70-94cb-58b2b1f77a20&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0630007 Dec 09 21:22:58.162212 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-e9657374-fc1c-4285-8901-820e8c86b1ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'name': 'tempest-ServersTestManualDisk-255636487-router', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26'}], 'enable_snat': True}, 'gw_port_id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:21:59Z', 'updated_at': '2021-12-09T21:22:07Z', 'revision_number': 4, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'gw_port': {'id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:cd:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'device_owner': 'network:router_gateway', 'standard_attr_id': 623, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:22:02Z', 'updated_at': '2021-12-09T21:22:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'fd7bddb5-c30c-4ada-80cf-a847d82e6b6e', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'floating_ip_address': '172.25.3.9', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'port_id': '54e32685-83f3-47e4-883f-d0d7b2a9e798', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 638, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20', 'mac_address': 'fa:16:3e:07:db:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a49420b5-3789-4863-bf0c-65a787f7fc78', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:22:17Z', 'updated_at': '2021-12-09T21:22:55Z', 'revision_number': 1, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'cd61cf32-db9c-49d2-8b1c-50a6abb2e135', 'name': '', 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'mac_address': 'fa:16:3e:e5:cc:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'device_owner': 'network:router_interface', 'standard_attr_id': 624, 'fixed_ips': [{'subnet_id': '069b1784-6c14-42f6-a10c-b0d4447b6091', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:22:06Z', 'updated_at': '2021-12-09T21:22:16Z', 'revision_number': 5, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'subnets': [{'id': '069b1784-6c14-42f6-a10c-b0d4447b6091', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:22:58.212055 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9657374-fc1c-4285-8901-820e8c86b1ab None None] The sync data for ids ['5cb2944b-70be-4f74-b4d0-e06f75765688'] in n-d-713301-27 is: [{'id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'name': 'tempest-ServersTestManualDisk-255636487-router', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26'}], 'enable_snat': True}, 'gw_port_id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:21:59Z', 'updated_at': '2021-12-09T21:22:07Z', 'revision_number': 4, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'gw_port': {'id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:cd:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'device_owner': 'network:router_gateway', 'standard_attr_id': 623, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:22:02Z', 'updated_at': '2021-12-09T21:22:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'fd7bddb5-c30c-4ada-80cf-a847d82e6b6e', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'floating_ip_address': '172.25.3.9', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'port_id': '54e32685-83f3-47e4-883f-d0d7b2a9e798', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 638, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20', 'mac_address': 'fa:16:3e:07:db:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a49420b5-3789-4863-bf0c-65a787f7fc78', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:22:17Z', 'updated_at': '2021-12-09T21:22:55Z', 'revision_number': 1, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'cd61cf32-db9c-49d2-8b1c-50a6abb2e135', 'name': '', 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'mac_address': 'fa:16:3e:e5:cc:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'device_owner': 'network:router_interface', 'standard_attr_id': 624, 'fixed_ips': [{'subnet_id': '069b1784-6c14-42f6-a10c-b0d4447b6091', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:22:06Z', 'updated_at': '2021-12-09T21:22:16Z', 'revision_number': 5, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'subnets': [{'id': '069b1784-6c14-42f6-a10c-b0d4447b6091', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:22:58.291323 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ad8d162-54e2-4c5f-8ffc-07e85ff56fa6 req-a590f562-d2b4-431c-a7cb-33b6d2b42ebe service neutron] 10.222.0.10 "GET /v2.0/networks/6b0e1b89-20b6-4a70-94cb-58b2b1f77a20?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1320872 Dec 09 21:22:58.393679 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ad8d162-54e2-4c5f-8ffc-07e85ff56fa6 req-f083efc9-3ac6-4470-97d6-b4dfd3fa40cb service neutron] 10.222.0.10 "GET /v2.0/networks/6b0e1b89-20b6-4a70-94cb-58b2b1f77a20?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0928895 Dec 09 21:22:58.509834 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d60ce9b-64ab-4c0c-b458-82b79f3901f8 None None] New status for floating IP fd7bddb5-c30c-4ada-80cf-a847d82e6b6e: ACTIVE {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:22:58.601423 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4f1ee38-ae86-4645-ac51-7d0c2fe5ce3c req-debac5e3-ed33-44ff-b3ef-1fe91bd73c55 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:58.602960 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4f1ee38-ae86-4645-ac51-7d0c2fe5ce3c req-debac5e3-ed33-44ff-b3ef-1fe91bd73c55 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 946 time: 0.0729668 Dec 09 21:22:58.662159 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4f1ee38-ae86-4645-ac51-7d0c2fe5ce3c req-a83343d3-cebf-4ee0-8afb-093c0bef6ee1 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473852 Dec 09 21:22:58.901888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-90c4653d-66ac-4411-b690-f7b7801efc86 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:58.904093 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-90c4653d-66ac-4411-b690-f7b7801efc86 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362&tenant_id=a306d2242b1e41c892f63c7b122cdee4&binding%3Ahost_id=n-h2-713301-27 HTTP/1.1" status: 200 len: 1098 time: 0.0514412 Dec 09 21:22:58.918798 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1f553390-3c73-4451-b74d-b624923a3f24 service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h1-713301-27'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:22:58.977803 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1f553390-3c73-4451-b74d-b624923a3f24 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:59.091419 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 66544e42-b228-4e80-9ed2-bc699bb1993e details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:22:59.297218 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 4425d491-9b2e-48a2-8fb6-ead05da81dba no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:22:59.349878 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 66544e42-b228-4e80-9ed2-bc699bb1993e, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=66544e42-b228-4e80-9ed2-bc699bb1993e,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:59.365114 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '66544e42-b228-4e80-9ed2-bc699bb1993e', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '66544e42-b228-4e80-9ed2-bc699bb1993e', 'mac_address': 'fa:16:3e:cb:27:b9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.49'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:22:59.436242 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:59.439021 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:59.468503 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 66544e42-b228-4e80-9ed2-bc699bb1993e {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:22:59.499653 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8f48a806-013e-480e-81ac-1a7f5f10c155', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4425d491-9b2e-48a2-8fb6-ead05da81dba'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:22:59.501247 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1f553390-3c73-4451-b74d-b624923a3f24 service neutron] For port cd5af376-d278-48fb-8867-a970b71280d9, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=cd5af376-d278-48fb-8867-a970b71280d9,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:59.502350 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ccde30bc-620d-4362-ab11-b5d5e31e6ff9" -d '{"events": [{"server_uuid": "8f48a806-013e-480e-81ac-1a7f5f10c155", "name": "network-vif-unplugged", "status": "completed", "tag": "4425d491-9b2e-48a2-8fb6-ead05da81dba"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:22:59.510171 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c557db5-2561-4a84-8953-6b2a1a4da05f req-645cea6f-a82c-4290-a456-0c9a78772333 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:59.510358 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 66544e42-b228-4e80-9ed2-bc699bb1993e, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=66544e42-b228-4e80-9ed2-bc699bb1993e,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:59.511709 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c557db5-2561-4a84-8953-6b2a1a4da05f req-645cea6f-a82c-4290-a456-0c9a78772333 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 944 time: 0.4556704 Dec 09 21:22:59.519426 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:59.523139 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 4425d491-9b2e-48a2-8fb6-ead05da81dba, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=4425d491-9b2e-48a2-8fb6-ead05da81dba,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:22:59.553368 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:59.567411 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f5dc1a2-1ce9-435b-b720-d4b5d9cf0284 req-25db3f7a-ac4b-4755-acb8-cbd465721e6b tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:22:59.568998 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f5dc1a2-1ce9-435b-b720-d4b5d9cf0284 req-25db3f7a-ac4b-4755-acb8-cbd465721e6b tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 949 time: 0.1417861 Dec 09 21:22:59.579560 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=66544e42-b228-4e80-9ed2-bc699bb1993e,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:59.601387 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1f553390-3c73-4451-b74d-b624923a3f24 service neutron] For port cd5af376-d278-48fb-8867-a970b71280d9, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:22:59.635212 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=4425d491-9b2e-48a2-8fb6-ead05da81dba,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:59.658683 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c557db5-2561-4a84-8953-6b2a1a4da05f req-e3aa57b4-44dd-4586-8fa6-df03c4242203 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1337540 Dec 09 21:22:59.671305 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['66544e42-b228-4e80-9ed2-bc699bb1993e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:22:59.687791 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f5dc1a2-1ce9-435b-b720-d4b5d9cf0284 req-07775b4a-0c95-4960-8eef-85da2e8051d1 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1098094 Dec 09 21:22:59.690418 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5105efab-9ee1-4a74-9a45-e77c38549362', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'cd5af376-d278-48fb-8867-a970b71280d9'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:22:59.692692 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b4c19aad-90e4-44a2-a169-1e2b97343892" -d '{"events": [{"server_uuid": "5105efab-9ee1-4a74-9a45-e77c38549362", "name": "network-vif-unplugged", "status": "completed", "tag": "cd5af376-d278-48fb-8867-a970b71280d9"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:22:59.696972 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1f553390-3c73-4451-b74d-b624923a3f24 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:59.717142 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1f553390-3c73-4451-b74d-b624923a3f24 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:22:59.860808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f553390-3c73-4451-b74d-b624923a3f24 service neutron] Pushing event updated for resources: {'Port': ['ID=cd5af376-d278-48fb-8867-a970b71280d9,revision_number=7']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:22:59.865943 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1f553390-3c73-4451-b74d-b624923a3f24 service neutron] Attempting to bind port cd5af376-d278-48fb-8867-a970b71280d9 on host n-h2-713301-27 for vnic_type normal with profile {"migrating_to": "n-h1-713301-27"} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:22:59.866304 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1f553390-3c73-4451-b74d-b624923a3f24 service neutron] Attempting to bind port cd5af376-d278-48fb-8867-a970b71280d9 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:22:59.866637 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1f553390-3c73-4451-b74d-b624923a3f24 service neutron] Attempting to bind port cd5af376-d278-48fb-8867-a970b71280d9 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:22:59.873233 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:22:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-30edf402-e146-4d9c-9831-a33f5886369b x-openstack-request-id: req-30edf402-e146-4d9c-9831-a33f5886369b {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:22:59.873537 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8f48a806-013e-480e-81ac-1a7f5f10c155", "name": "network-vif-unplugged", "status": "completed", "tag": "4425d491-9b2e-48a2-8fb6-ead05da81dba", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:22:59.873821 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-30edf402-e146-4d9c-9831-a33f5886369b {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:22:59.875126 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1f553390-3c73-4451-b74d-b624923a3f24 service neutron] Port cd5af376-d278-48fb-8867-a970b71280d9 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:22:59.875603 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1f553390-3c73-4451-b74d-b624923a3f24 service neutron] Attempting to bind port cd5af376-d278-48fb-8867-a970b71280d9 on network 93378dc3-2ac5-4cf7-9ce3-d812934de40c {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:22:59.878369 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8f48a806-013e-480e-81ac-1a7f5f10c155', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4425d491-9b2e-48a2-8fb6-ead05da81dba', 'code': 200} Dec 09 21:22:59.885680 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1f553390-3c73-4451-b74d-b624923a3f24 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 22, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:22:59.886563 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1f553390-3c73-4451-b74d-b624923a3f24 service neutron] Checking segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:22:59.887145 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1f553390-3c73-4451-b74d-b624923a3f24 service neutron] Bound using segment: {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:22:59.887737 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1f553390-3c73-4451-b74d-b624923a3f24 service neutron] Bound port: cd5af376-d278-48fb-8867-a970b71280d9, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4bbda46b-e2e5-4ce1-b027-3fb09391026d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '93378dc3-2ac5-4cf7-9ce3-d812934de40c'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:22:59.888297 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1f553390-3c73-4451-b74d-b624923a3f24 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:00.085825 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f161cf17-200e-4ded-8ae9-bcb636e67152 req-b924d36e-003a-459c-8816-4ff54be50f08 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:00.087358 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f161cf17-200e-4ded-8ae9-bcb636e67152 req-b924d36e-003a-459c-8816-4ff54be50f08 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 944 time: 0.1709723 Dec 09 21:23:00.093082 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1f553390-3c73-4451-b74d-b624923a3f24 service neutron] For port cd5af376-d278-48fb-8867-a970b71280d9, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:23:00.134350 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-336ae757-629f-4e32-9712-c7bb49829cc4 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:00.136009 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-336ae757-629f-4e32-9712-c7bb49829cc4 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/networks?id=8e0b26d7-eefe-4c85-b535-944f3c15f0f6 HTTP/1.1" status: 200 len: 805 time: 0.2352173 Dec 09 21:23:00.137754 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1f553390-3c73-4451-b74d-b624923a3f24 service neutron] For port cd5af376-d278-48fb-8867-a970b71280d9, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=cd5af376-d278-48fb-8867-a970b71280d9,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:23:00.148488 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1f553390-3c73-4451-b74d-b624923a3f24 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:00.206023 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-0aa3570b-e3a0-475d-ab47-d3e9351190d8 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/quotas/7233ac85d55e4123a22cfa34bc1ee70e HTTP/1.1" status: 200 len: 375 time: 0.0620139 Dec 09 21:23:00.239875 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f161cf17-200e-4ded-8ae9-bcb636e67152 req-5225d3cc-efca-4fb8-a7c8-0eb091601584 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1393390 Dec 09 21:23:00.284445 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f553390-3c73-4451-b74d-b624923a3f24 service neutron] Pushing event updated for resources: {'Port': ['ID=cd5af376-d278-48fb-8867-a970b71280d9,revision_number=8']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:00.308066 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:22:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f0eafb3e-58b3-4f8e-9379-505e956bfa2e x-openstack-request-id: req-f0eafb3e-58b3-4f8e-9379-505e956bfa2e {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:00.308369 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5105efab-9ee1-4a74-9a45-e77c38549362", "name": "network-vif-unplugged", "status": "completed", "tag": "cd5af376-d278-48fb-8867-a970b71280d9", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:00.308622 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f0eafb3e-58b3-4f8e-9379-505e956bfa2e {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:00.309194 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5105efab-9ee1-4a74-9a45-e77c38549362', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'cd5af376-d278-48fb-8867-a970b71280d9', 'code': 200} Dec 09 21:23:00.312620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1f553390-3c73-4451-b74d-b624923a3f24 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:00.313473 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1f553390-3c73-4451-b74d-b624923a3f24 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:00.314818 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1f553390-3c73-4451-b74d-b624923a3f24 service neutron] 10.222.0.31 "PUT /v2.0/ports/cd5af376-d278-48fb-8867-a970b71280d9 HTTP/1.1" status: 200 len: 1124 time: 1.4007235 Dec 09 21:23:00.330078 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-ac3a96e2-f9ed-487f-bca7-6a788b641cd4 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=7233ac85d55e4123a22cfa34bc1ee70e&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1119499 Dec 09 21:23:00.470720 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['cd5af376-d278-48fb-8867-a970b71280d9'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:23:00.507068 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['cd5af376-d278-48fb-8867-a970b71280d9'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:23:00.747195 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-810a333c-a5ae-4759-9571-ae5d53db41af service neutron] 10.222.0.13 "GET /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4076905 Dec 09 21:23:00.972610 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-e3f9970d-0c1c-4ba4-a0a8-00a3d3657024 service neutron] 10.222.0.13 "GET /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2204602 Dec 09 21:23:01.038814 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a57b91b-84a6-4e52-8457-081d874c17ba req-2b8e83d1-1fa1-43b3-8082-a94f9de0ac04 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:01.040454 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a57b91b-84a6-4e52-8457-081d874c17ba req-2b8e83d1-1fa1-43b3-8082-a94f9de0ac04 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 944 time: 0.0585625 Dec 09 21:23:01.104421 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 66544e42-b228-4e80-9ed2-bc699bb1993e up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:23:01.123590 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a57b91b-84a6-4e52-8457-081d874c17ba req-56b947bf-d806-46ef-8bf6-0debc8eab68e tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0706820 Dec 09 21:23:01.182627 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 66544e42-b228-4e80-9ed2-bc699bb1993e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:23:01.182896 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:01.228510 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device cd5af376-d278-48fb-8867-a970b71280d9 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:23:01.231372 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 7f26d4c2-71a3-44d0-bf00-8c0c0833f323 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:23:01.294070 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbf8b979-d4a1-45b8-ac00-cce12751a74e req-978bec4c-8308-4aba-99f5-ca58b3657901 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:01.296629 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbf8b979-d4a1-45b8-ac00-cce12751a74e req-978bec4c-8308-4aba-99f5-ca58b3657901 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 949 time: 0.0875480 Dec 09 21:23:01.415064 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bba8b75-7a2d-471a-a57c-4f939b62463c req-c36b2488-9273-4005-a829-4411d20e6aa0 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:01.417051 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0bba8b75-7a2d-471a-a57c-4f939b62463c req-c36b2488-9273-4005-a829-4411d20e6aa0 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.31 "GET /v2.0/ports?device_id=b9b4e0ee-aaae-4214-be9d-1af0b5120e5d HTTP/1.1" status: 200 len: 945 time: 0.1193221 Dec 09 21:23:01.421718 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbf8b979-d4a1-45b8-ac00-cce12751a74e req-c1a03a02-aa12-4b51-b6c1-3f4cc121900f tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1115766 Dec 09 21:23:01.448408 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:01.531210 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port cd5af376-d278-48fb-8867-a970b71280d9, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=cd5af376-d278-48fb-8867-a970b71280d9,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:01.554386 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:01.564234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device cd5af376-d278-48fb-8867-a970b71280d9 has no active binding in host n-h1-713301-27 {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:158}} Dec 09 21:23:01.585753 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 66544e42-b228-4e80-9ed2-bc699bb1993e, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=66544e42-b228-4e80-9ed2-bc699bb1993e,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:01.593767 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:01.644048 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 7f26d4c2-71a3-44d0-bf00-8c0c0833f323, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=7f26d4c2-71a3-44d0-bf00-8c0c0833f323,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:01.653617 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e849f70-ca16-4123-8781-278e6c19e8f2 req-b2915df0-04c3-42bf-a2a3-3e7f415a6d97 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=d6767f88-ed3b-4855-99f9-59acc491c8cd HTTP/1.1" status: 200 len: 210 time: 0.0650895 Dec 09 21:23:01.658789 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:01.689629 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=66544e42-b228-4e80-9ed2-bc699bb1993e,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:01.715832 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-0bba8b75-7a2d-471a-a57c-4f939b62463c req-b4746572-61f4-41f9-87ab-871ae6171f82 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Deleting port 7f26d4c2-71a3-44d0-bf00-8c0c0833f323 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:23:01.716198 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0bba8b75-7a2d-471a-a57c-4f939b62463c req-b4746572-61f4-41f9-87ab-871ae6171f82 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:01.834286 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=7f26d4c2-71a3-44d0-bf00-8c0c0833f323,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:01.879583 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '63d23827-0eb3-4c4c-87f7-698524a008f5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '66544e42-b228-4e80-9ed2-bc699bb1993e'}, {'server_uuid': 'b9b4e0ee-aaae-4214-be9d-1af0b5120e5d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '7f26d4c2-71a3-44d0-bf00-8c0c0833f323'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:01.884386 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e1da795b-b980-4b91-95c9-c24459fe92a9" -d '{"events": [{"server_uuid": "63d23827-0eb3-4c4c-87f7-698524a008f5", "name": "network-vif-plugged", "status": "completed", "tag": "66544e42-b228-4e80-9ed2-bc699bb1993e"}, {"server_uuid": "b9b4e0ee-aaae-4214-be9d-1af0b5120e5d", "name": "network-vif-unplugged", "status": "completed", "tag": "7f26d4c2-71a3-44d0-bf00-8c0c0833f323"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:01.947080 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-0bba8b75-7a2d-471a-a57c-4f939b62463c req-b4746572-61f4-41f9-87ab-871ae6171f82 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] For port 7f26d4c2-71a3-44d0-bf00-8c0c0833f323, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=7f26d4c2-71a3-44d0-bf00-8c0c0833f323,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:01.947552 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0bba8b75-7a2d-471a-a57c-4f939b62463c req-b4746572-61f4-41f9-87ab-871ae6171f82 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:01.963335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9340e26f-69b1-437e-b645-5845895981b8 req-84363be9-af62-4a63-91c1-2895f5425f2d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:01.968862 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 356 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1111e0e9-1c13-4e19-ab3d-b9e492955908 x-openstack-request-id: req-1111e0e9-1c13-4e19-ab3d-b9e492955908 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:01.969162 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "63d23827-0eb3-4c4c-87f7-698524a008f5", "name": "network-vif-plugged", "status": "completed", "tag": "66544e42-b228-4e80-9ed2-bc699bb1993e", "code": 200}, {"server_uuid": "b9b4e0ee-aaae-4214-be9d-1af0b5120e5d", "name": "network-vif-unplugged", "status": "completed", "tag": "7f26d4c2-71a3-44d0-bf00-8c0c0833f323", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:01.969425 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-1111e0e9-1c13-4e19-ab3d-b9e492955908 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:01.969824 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '63d23827-0eb3-4c4c-87f7-698524a008f5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '66544e42-b228-4e80-9ed2-bc699bb1993e', 'code': 200} Dec 09 21:23:01.970082 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b9b4e0ee-aaae-4214-be9d-1af0b5120e5d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '7f26d4c2-71a3-44d0-bf00-8c0c0833f323', 'code': 200} Dec 09 21:23:01.971336 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9340e26f-69b1-437e-b645-5845895981b8 req-84363be9-af62-4a63-91c1-2895f5425f2d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 944 time: 0.1846859 Dec 09 21:23:01.985007 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-0bba8b75-7a2d-471a-a57c-4f939b62463c req-b4746572-61f4-41f9-87ab-871ae6171f82 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Calling delete_port for 7f26d4c2-71a3-44d0-bf00-8c0c0833f323 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:23:02.276885 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9340e26f-69b1-437e-b645-5845895981b8 req-e68770b8-27bb-4ac6-b0d6-8f945f011b02 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3022864 Dec 09 21:23:02.276885 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0bba8b75-7a2d-471a-a57c-4f939b62463c req-b4746572-61f4-41f9-87ab-871ae6171f82 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:02.309830 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5105efab-9ee1-4a74-9a45-e77c38549362', 'tag': 'cd5af376-d278-48fb-8867-a970b71280d9'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:02.315781 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-46c92ad4-e5ef-4415-8b27-0b254f25a646" -d '{"events": [{"name": "network-changed", "server_uuid": "5105efab-9ee1-4a74-9a45-e77c38549362", "tag": "cd5af376-d278-48fb-8867-a970b71280d9"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:02.319983 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4746572-61f4-41f9-87ab-871ae6171f82 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Pushing event deleted for resources: {'Port': ['ID=7f26d4c2-71a3-44d0-bf00-8c0c0833f323,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:02.451693 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-0bba8b75-7a2d-471a-a57c-4f939b62463c req-b4746572-61f4-41f9-87ab-871ae6171f82 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] No DVR routers for this DVR port 7f26d4c2-71a3-44d0-bf00-8c0c0833f323 on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:23:02.454913 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0bba8b75-7a2d-471a-a57c-4f939b62463c req-b4746572-61f4-41f9-87ab-871ae6171f82 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:02.459015 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0bba8b75-7a2d-471a-a57c-4f939b62463c req-b4746572-61f4-41f9-87ab-871ae6171f82 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.31 "DELETE /v2.0/ports/7f26d4c2-71a3-44d0-bf00-8c0c0833f323 HTTP/1.1" status: 204 len: 173 time: 1.0228932 Dec 09 21:23:02.531822 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d44642c6-1fb6-4014-adf9-9273c3039633 req-e4a3c1fc-fe40-4bc3-99df-1bf8c312e399 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:02.541845 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d44642c6-1fb6-4014-adf9-9273c3039633 req-e4a3c1fc-fe40-4bc3-99df-1bf8c312e399 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 944 time: 0.1401572 Dec 09 21:23:02.647376 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d44642c6-1fb6-4014-adf9-9273c3039633 req-18ad09ea-1a17-419a-8ef2-173f9aafeb52 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0870171 Dec 09 21:23:02.660052 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-654792ee-d1b4-474d-a0c3-84b8e6c432ff x-openstack-request-id: req-654792ee-d1b4-474d-a0c3-84b8e6c432ff {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:02.660361 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5105efab-9ee1-4a74-9a45-e77c38549362", "tag": "cd5af376-d278-48fb-8867-a970b71280d9", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:02.660640 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-654792ee-d1b4-474d-a0c3-84b8e6c432ff {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:02.661138 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5105efab-9ee1-4a74-9a45-e77c38549362', 'tag': 'cd5af376-d278-48fb-8867-a970b71280d9', 'status': 'completed', 'code': 200} Dec 09 21:23:02.790571 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46c92ad4-e5ef-4415-8b27-0b254f25a646 req-6fa9a50f-764a-4542-8790-8f76c294c313 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:02.792543 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46c92ad4-e5ef-4415-8b27-0b254f25a646 req-6fa9a50f-764a-4542-8790-8f76c294c313 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 1127 time: 0.1024632 Dec 09 21:23:02.818955 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba40b29b-3df2-4c48-bc21-173c669f9712 req-de4de7f4-0441-4938-b75e-4dde2e3eb652 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:02.827486 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba40b29b-3df2-4c48-bc21-173c669f9712 req-de4de7f4-0441-4938-b75e-4dde2e3eb652 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 949 time: 0.0946963 Dec 09 21:23:02.963575 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba40b29b-3df2-4c48-bc21-173c669f9712 req-15b6097a-d465-4913-8516-a57b73c210ca tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1351268 Dec 09 21:23:03.043674 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a5f14289-fe60-4355-a76d-7cf052af46f7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:03.100402 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-79b82cb6-d9f7-4794-a710-4499fe2f1eb3 req-2c61c063-ef19-445b-a239-846ea5b8f561 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=d6767f88-ed3b-4855-99f9-59acc491c8cd HTTP/1.1" status: 200 len: 210 time: 0.1281450 Dec 09 21:23:03.161673 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46c92ad4-e5ef-4415-8b27-0b254f25a646 req-7dbea095-5494-47b6-8641-0a6d95c973fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:03.163253 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46c92ad4-e5ef-4415-8b27-0b254f25a646 req-7dbea095-5494-47b6-8641-0a6d95c973fa service neutron] 10.222.0.10 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 922 time: 0.3598840 Dec 09 21:23:03.192466 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 13499602-258c-4839-b928-17aef0d24310 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:23:03.344165 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46c92ad4-e5ef-4415-8b27-0b254f25a646 req-6cfe692e-5ebf-44ae-bc9a-a91e9f04d437 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=cd5af376-d278-48fb-8867-a970b71280d9 HTTP/1.1" status: 200 len: 217 time: 0.1716104 Dec 09 21:23:03.409372 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a387116-fda6-4ac3-b2bb-400f279c8591 req-8617cbf0-893c-47cd-b4a1-1b610f86bdd8 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:03.422015 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a387116-fda6-4ac3-b2bb-400f279c8591 req-8617cbf0-893c-47cd-b4a1-1b610f86bdd8 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/ports?device_id=ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4 HTTP/1.1" status: 200 len: 945 time: 0.3201785 Dec 09 21:23:03.441224 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 13499602-258c-4839-b928-17aef0d24310, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=13499602-258c-4839-b928-17aef0d24310,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:03.468926 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '13499602-258c-4839-b928-17aef0d24310', 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef', 'port_id': '13499602-258c-4839-b928-17aef0d24310', 'mac_address': 'fa:16:3e:d0:d6:a5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 138, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'eae2438b-9fcc-44ef-a172-6c4911cad13f', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:23:03.540772 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:03.544671 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46c92ad4-e5ef-4415-8b27-0b254f25a646 req-051eff77-02f2-40d5-ac19-e8a3810af1f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:03.546160 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46c92ad4-e5ef-4415-8b27-0b254f25a646 req-051eff77-02f2-40d5-ac19-e8a3810af1f0 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=c49a62cc-af1b-4958-a4a9-eb44188b8fb9 HTTP/1.1" status: 200 len: 861 time: 0.1795852 Dec 09 21:23:03.577889 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 13499602-258c-4839-b928-17aef0d24310 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:23:03.607130 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 13499602-258c-4839-b928-17aef0d24310, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=13499602-258c-4839-b928-17aef0d24310,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:03.614915 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:03.671587 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46c92ad4-e5ef-4415-8b27-0b254f25a646 req-c59432dd-c77f-4307-a93b-524b3c6913df service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=93378dc3-2ac5-4cf7-9ce3-d812934de40c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1082067 Dec 09 21:23:03.710570 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=13499602-258c-4839-b928-17aef0d24310,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:03.728130 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9997afa-e961-49c3-8dcd-6d73998b9776 req-9d1d58f4-eb61-45ab-b814-8a254022228f tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:03.735407 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9997afa-e961-49c3-8dcd-6d73998b9776 req-9d1d58f4-eb61-45ab-b814-8a254022228f tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 944 time: 0.1823545 Dec 09 21:23:03.743524 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-b7262bd4-c124-4343-a36b-048f3c41e7e4 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:03.744964 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-b7262bd4-c124-4343-a36b-048f3c41e7e4 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.31 "GET /v2.0/networks?id=8e0b26d7-eefe-4c85-b535-944f3c15f0f6 HTTP/1.1" status: 200 len: 805 time: 0.6745551 Dec 09 21:23:03.748353 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a387116-fda6-4ac3-b2bb-400f279c8591 req-750fbebc-ed57-4652-9b8f-0e3cce67f369 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/security-groups?id=c7a6979c-1873-4716-8479-de619cf4fcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3247223 Dec 09 21:23:03.815246 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-68630a5c-a8d3-4056-a8f9-bfe310d7328a tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Request body: {'port': {'device_id': 'd6767f88-ed3b-4855-99f9-59acc491c8cd', 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6', 'admin_state_up': True, 'tenant_id': '7233ac85d55e4123a22cfa34bc1ee70e'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:23:03.838362 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34342) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:03.924149 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9997afa-e961-49c3-8dcd-6d73998b9776 req-98fb6b71-9eb1-4c89-80bf-37fae6ecee68 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1787426 Dec 09 21:23:04.003055 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['13499602-258c-4839-b928-17aef0d24310'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:23:04.065002 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-afe39a26-6af0-48cc-8951-08c931930057 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:04.096627 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46c92ad4-e5ef-4415-8b27-0b254f25a646 req-6db62bc8-8355-4be9-9add-c2309c4a78e2 service neutron] 10.222.0.10 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4038467 Dec 09 21:23:04.213946 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-afe39a26-6af0-48cc-8951-08c931930057 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:04.221844 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-afe39a26-6af0-48cc-8951-08c931930057 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:04.290185 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-afe39a26-6af0-48cc-8951-08c931930057 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ce21dd7b7ea541a8af242c4026565ff3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4496207 Dec 09 21:23:04.293448 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-796fa3e6-cb90-490f-9a15-1e9d08272326 req-03e77611-64da-479e-a0f7-21868af42691 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:04.298237 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34350) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:04.302459 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-796fa3e6-cb90-490f-9a15-1e9d08272326 req-03e77611-64da-479e-a0f7-21868af42691 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 945 time: 0.2335453 Dec 09 21:23:04.315481 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f71bb82-3a42-484c-af19-fe642491a7c3 req-f2220cac-8ada-48b1-a58c-18cc53eadc8c tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:04.323325 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7f71bb82-3a42-484c-af19-fe642491a7c3 req-f2220cac-8ada-48b1-a58c-18cc53eadc8c tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 949 time: 0.2533727 Dec 09 21:23:04.352427 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afe39a26-6af0-48cc-8951-08c931930057 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ae782db3-891b-4811-8970-aa6477033153,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:04.355410 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-68630a5c-a8d3-4056-a8f9-bfe310d7328a tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Made reservation on behalf of 7233ac85d55e4123a22cfa34bc1ee70e for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:23:04.359648 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-68630a5c-a8d3-4056-a8f9-bfe310d7328a tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:04.421593 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bb7b42b7-6074-4240-a617-1e10a9e2d6a0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:04.451176 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bb7b42b7-6074-4240-a617-1e10a9e2d6a0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:04.457970 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46c92ad4-e5ef-4415-8b27-0b254f25a646 req-605c801d-82bc-4f90-b642-dc5b5595794b service neutron] 10.222.0.10 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3144698 Dec 09 21:23:04.511017 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-796fa3e6-cb90-490f-9a15-1e9d08272326 req-81e8dfa6-6720-4c4c-acca-24af5c97e81d tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2078059 Dec 09 21:23:04.575784 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7f71bb82-3a42-484c-af19-fe642491a7c3 req-64a10365-4467-4779-838d-cd4806072e41 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2499235 Dec 09 21:23:04.578370 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bb7b42b7-6074-4240-a617-1e10a9e2d6a0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:04.593665 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bb7b42b7-6074-4240-a617-1e10a9e2d6a0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:04.594249 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bb7b42b7-6074-4240-a617-1e10a9e2d6a0 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/ae782db3-891b-4811-8970-aa6477033153 HTTP/1.1" status: 204 len: 168 time: 0.2936511 Dec 09 21:23:04.622782 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb7b42b7-6074-4240-a617-1e10a9e2d6a0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ae782db3-891b-4811-8970-aa6477033153,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:04.677672 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b9b4e0ee-aaae-4214-be9d-1af0b5120e5d', 'name': 'network-vif-deleted', 'tag': '7f26d4c2-71a3-44d0-bf00-8c0c0833f323'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:04.680242 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e0c19621-b803-4a49-940c-d15632a1546f" -d '{"events": [{"server_uuid": "b9b4e0ee-aaae-4214-be9d-1af0b5120e5d", "name": "network-vif-deleted", "tag": "7f26d4c2-71a3-44d0-bf00-8c0c0833f323"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:04.789855 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-256d195b-fd29-4349-a28e-6978c033afa7 req-8c903481-3475-478e-9ca8-f7a35ba6fbc0 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=d6767f88-ed3b-4855-99f9-59acc491c8cd HTTP/1.1" status: 200 len: 210 time: 0.1306705 Dec 09 21:23:04.849511 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-68630a5c-a8d3-4056-a8f9-bfe310d7328a tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Allocated IP 172.20.0.13 (8e0b26d7-eefe-4c85-b535-944f3c15f0f6/63e7603a-bb11-4d1a-8d84-55456d81931c/1af41bb4-4236-45bb-a843-1062b6baf435) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:23:04.909672 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-59c77b2c-1750-4014-9292-d76588023c30 x-openstack-request-id: req-59c77b2c-1750-4014-9292-d76588023c30 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:04.910277 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b9b4e0ee-aaae-4214-be9d-1af0b5120e5d", "name": "network-vif-deleted", "tag": "7f26d4c2-71a3-44d0-bf00-8c0c0833f323", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:04.910735 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-59c77b2c-1750-4014-9292-d76588023c30 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:04.911329 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b9b4e0ee-aaae-4214-be9d-1af0b5120e5d', 'name': 'network-vif-deleted', 'tag': '7f26d4c2-71a3-44d0-bf00-8c0c0833f323', 'status': 'completed', 'code': 200} Dec 09 21:23:05.122185 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 13499602-258c-4839-b928-17aef0d24310 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:23:05.250006 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 7f26d4c2-71a3-44d0-bf00-8c0c0833f323 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:23:05.252658 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34376) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:05.270169 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-948b9fc0-1502-4b7f-9e88-d403bbe2aa36 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:05.308570 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 7f26d4c2-71a3-44d0-bf00-8c0c0833f323 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:23:05.311530 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 7f26d4c2-71a3-44d0-bf00-8c0c0833f323 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:23:05.352551 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 13499602-258c-4839-b928-17aef0d24310 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:23:05.361757 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 13499602-258c-4839-b928-17aef0d24310 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:23:05.363089 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:05.450507 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ee0578d-401b-4d2e-b08a-b2348cc5d360 req-9ce3d459-6dfb-48f3-8905-cd7d1e144b4f service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.3226652 Dec 09 21:23:05.490885 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-68630a5c-a8d3-4056-a8f9-bfe310d7328a tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:05.515322 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-948b9fc0-1502-4b7f-9e88-d403bbe2aa36 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:05.537581 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-948b9fc0-1502-4b7f-9e88-d403bbe2aa36 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:05.540611 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-568fe681-5441-47b4-a316-9f91d6d06446 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:05.570944 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aad09d5c-3eb2-4378-91b1-b123571ee784 req-15b32895-9f10-4de7-93c3-45dfe8f014fe tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:05.579134 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aad09d5c-3eb2-4378-91b1-b123571ee784 req-15b32895-9f10-4de7-93c3-45dfe8f014fe tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 944 time: 0.3065524 Dec 09 21:23:05.639967 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:05.647378 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-948b9fc0-1502-4b7f-9e88-d403bbe2aa36 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=28ad155cfb354058b067c40755ccd019&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3899019 Dec 09 21:23:05.651091 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34382) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:05.684460 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-948b9fc0-1502-4b7f-9e88-d403bbe2aa36 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fe5ee113-89eb-4fc4-8a46-c67da3e0b016,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:05.742605 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 13499602-258c-4839-b928-17aef0d24310, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=13499602-258c-4839-b928-17aef0d24310,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:05.744207 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7300996b-d799-47a2-9728-a8551719a88f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '13499602-258c-4839-b928-17aef0d24310'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:05.747906 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-10cdf3cb-35d9-45fa-a10d-9caa0a9c5650" -d '{"events": [{"server_uuid": "7300996b-d799-47a2-9728-a8551719a88f", "name": "network-vif-plugged", "status": "completed", "tag": "13499602-258c-4839-b928-17aef0d24310"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:05.754190 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:05.756078 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device cd5af376-d278-48fb-8867-a970b71280d9 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:23:05.907002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=13499602-258c-4839-b928-17aef0d24310,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:06.045863 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ee0578d-401b-4d2e-b08a-b2348cc5d360 req-c6fe6024-b1ce-4de4-9434-918f801dfbe1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:06.047681 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ee0578d-401b-4d2e-b08a-b2348cc5d360 req-c6fe6024-b1ce-4de4-9434-918f801dfbe1 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 1097 time: 0.5185513 Dec 09 21:23:06.071735 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aad09d5c-3eb2-4378-91b1-b123571ee784 req-0d48aee3-7547-4726-959a-6847a1b4789d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4912469 Dec 09 21:23:06.112699 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-68630a5c-a8d3-4056-a8f9-bfe310d7328a tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:06.124705 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-92ba7cc3-9d48-415a-a2b7-59b269a5ffb0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:06.259522 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-92ba7cc3-9d48-415a-a2b7-59b269a5ffb0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:06.272584 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d480ffd-eb85-405f-9323-551d8a1c38b1 req-64578000-85e8-4f66-8758-d1ab4788928d tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:06.274168 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4d480ffd-eb85-405f-9323-551d8a1c38b1 req-64578000-85e8-4f66-8758-d1ab4788928d tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/ports?device_id=ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4 HTTP/1.1" status: 200 len: 945 time: 0.2392459 Dec 09 21:23:06.286743 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-68630a5c-a8d3-4056-a8f9-bfe310d7328a tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Network 8e0b26d7-eefe-4c85-b535-944f3c15f0f6 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:23:06.312626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68630a5c-a8d3-4056-a8f9-bfe310d7328a tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Pushing event updated for resources: {'Port': ['ID=1af41bb4-4236-45bb-a843-1062b6baf435,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:06.332817 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-68630a5c-a8d3-4056-a8f9-bfe310d7328a tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:23:06.361869 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-68630a5c-a8d3-4056-a8f9-bfe310d7328a tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:23:06.426705 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ee0578d-401b-4d2e-b08a-b2348cc5d360 req-459c0ac7-f8e0-4f74-9c46-354fe8d3d8d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:06.428533 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ee0578d-401b-4d2e-b08a-b2348cc5d360 req-459c0ac7-f8e0-4f74-9c46-354fe8d3d8d9 service neutron] 10.222.0.10 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 908 time: 0.3425400 Dec 09 21:23:06.470633 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-68630a5c-a8d3-4056-a8f9-bfe310d7328a tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:06.471340 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-68630a5c-a8d3-4056-a8f9-bfe310d7328a tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:06.480968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24d9d1c6-e776-4170-8505-a1e6518a9ccc req-68e249ee-fce2-48cf-8406-7e940535eb17 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:06.482469 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-24d9d1c6-e776-4170-8505-a1e6518a9ccc req-68e249ee-fce2-48cf-8406-7e940535eb17 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 946 time: 0.2636008 Dec 09 21:23:06.499948 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4d480ffd-eb85-405f-9323-551d8a1c38b1 req-6ac8acff-1e8a-4aab-9ce2-c56974f09f66 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/security-groups?id=c7a6979c-1873-4716-8479-de619cf4fcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1906106 Dec 09 21:23:06.565826 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:06.574939 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ee0578d-401b-4d2e-b08a-b2348cc5d360 req-3ee7335e-7f3c-4b1e-a699-7288a8b60a2f service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 HTTP/1.1" status: 200 len: 217 time: 0.1348855 Dec 09 21:23:06.618046 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-92ba7cc3-9d48-415a-a2b7-59b269a5ffb0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:06.621194 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-92ba7cc3-9d48-415a-a2b7-59b269a5ffb0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:06.626341 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-92ba7cc3-9d48-415a-a2b7-59b269a5ffb0 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/fe5ee113-89eb-4fc4-8a46-c67da3e0b016 HTTP/1.1" status: 204 len: 168 time: 0.9705570 Dec 09 21:23:06.668246 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ee0578d-401b-4d2e-b08a-b2348cc5d360 req-4ca6cd38-ef39-402e-a0cb-fe685b067707 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:06.670030 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ee0578d-401b-4d2e-b08a-b2348cc5d360 req-4ca6cd38-ef39-402e-a0cb-fe685b067707 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=eae2438b-9fcc-44ef-a172-6c4911cad13f HTTP/1.1" status: 200 len: 847 time: 0.0835018 Dec 09 21:23:06.677032 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-68630a5c-a8d3-4056-a8f9-bfe310d7328a tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.8692358 Dec 09 21:23:06.745346 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-6c8a3c2e-18bf-4bec-8721-6e1ce6aa6b9f service neutron] Request body: {'port': {'device_id': 'd6767f88-ed3b-4855-99f9-59acc491c8cd', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:23:06.748138 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92ba7cc3-9d48-415a-a2b7-59b269a5ffb0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe5ee113-89eb-4fc4-8a46-c67da3e0b016,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:06.760024 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ee0578d-401b-4d2e-b08a-b2348cc5d360 req-286f5bd9-58e3-432d-9662-f6c7664b41e2 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=04fa749a-9f72-4a2c-a725-feab917f99ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0784926 Dec 09 21:23:06.860477 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-24d9d1c6-e776-4170-8505-a1e6518a9ccc req-501a3849-1acd-42c2-b7f9-7287c32f5377 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3558078 Dec 09 21:23:06.918334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7b4866e-1bff-411a-9d4f-16b04954d484 req-8c4a0b0e-8ac0-447d-a83a-bbeb5d2aea72 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:06.920021 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a7b4866e-1bff-411a-9d4f-16b04954d484 req-8c4a0b0e-8ac0-447d-a83a-bbeb5d2aea72 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 949 time: 0.2664249 Dec 09 21:23:07.033043 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-56410568-78fb-4085-b921-534e5e91c17b x-openstack-request-id: req-56410568-78fb-4085-b921-534e5e91c17b {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:07.033371 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7300996b-d799-47a2-9728-a8551719a88f", "name": "network-vif-plugged", "status": "completed", "tag": "13499602-258c-4839-b928-17aef0d24310", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:07.033689 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-56410568-78fb-4085-b921-534e5e91c17b {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:07.034172 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7300996b-d799-47a2-9728-a8551719a88f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '13499602-258c-4839-b928-17aef0d24310', 'code': 200} Dec 09 21:23:07.114064 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-6c8a3c2e-18bf-4bec-8721-6e1ce6aa6b9f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:07.152259 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-c0b11dad-6add-4e1b-afdf-e66608a375ae service neutron] 10.222.0.10 "GET /v2.0/ports/cd5af376-d278-48fb-8867-a970b71280d9/bindings/n-h1-713301-27 HTTP/1.1" status: 200 len: 385 time: 0.3959785 Dec 09 21:23:07.184656 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6327c63a-1274-40f8-87a2-0d694e3259cf req-1fd2d184-ebbe-4c3b-abdb-7d9bbd97e87c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:07.187145 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6327c63a-1274-40f8-87a2-0d694e3259cf req-1fd2d184-ebbe-4c3b-abdb-7d9bbd97e87c service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 1098 time: 0.0707605 Dec 09 21:23:07.242949 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6327c63a-1274-40f8-87a2-0d694e3259cf req-f2073f81-803a-4067-a5ee-f6b2f5b7a68f service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457990 Dec 09 21:23:07.399959 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ee0578d-401b-4d2e-b08a-b2348cc5d360 req-ff8c5445-6d5a-460b-bbc2-78b3ddcba028 service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6119285 Dec 09 21:23:07.455370 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a7b4866e-1bff-411a-9d4f-16b04954d484 req-7241f583-b047-4a05-bf37-2430a62a7dff tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5078263 Dec 09 21:23:07.694468 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ee0578d-401b-4d2e-b08a-b2348cc5d360 req-c0cc5d31-2fb4-4f0a-9eda-e81bb4116e31 service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1734822 Dec 09 21:23:07.781006 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61bff9aa-ed37-4766-82d5-e21f21de2306 req-15b7d52b-fdf1-4b83-a734-d3246491630f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:07.783202 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-61bff9aa-ed37-4766-82d5-e21f21de2306 req-15b7d52b-fdf1-4b83-a734-d3246491630f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=d6767f88-ed3b-4855-99f9-59acc491c8cd HTTP/1.1" status: 200 len: 932 time: 0.6086717 Dec 09 21:23:07.857494 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:07.989713 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7fbb12d8-8400-4037-9a11-10bd82c1691e req-999b1f4e-5657-4e6e-b2d2-a4c1835aba18 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1082716 Dec 09 21:23:08.077528 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fbb12d8-8400-4037-9a11-10bd82c1691e req-6cfade86-8eb4-4d9f-9375-e1eb32c31068 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:08.080375 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7fbb12d8-8400-4037-9a11-10bd82c1691e req-6cfade86-8eb4-4d9f-9375-e1eb32c31068 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 1096 time: 0.0655735 Dec 09 21:23:08.152079 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77a86b60-91c4-443c-b9c7-a055dd6d1c18 req-e228af91-11ac-4998-82b4-1cbb13071007 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:08.165498 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-77a86b60-91c4-443c-b9c7-a055dd6d1c18 req-e228af91-11ac-4998-82b4-1cbb13071007 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 944 time: 0.4617643 Dec 09 21:23:08.234856 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-5242ab9c-4b72-468b-a40a-e40496525563 service neutron] For port cd5af376-d278-48fb-8867-a970b71280d9, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=cd5af376-d278-48fb-8867-a970b71280d9,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:08.308463 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-77a86b60-91c4-443c-b9c7-a055dd6d1c18 req-8c8e7160-40ed-44db-a704-8762015531e0 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1419735 Dec 09 21:23:08.370456 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fbb12d8-8400-4037-9a11-10bd82c1691e req-7639eaa5-d04f-47e5-abf7-65d597a16cdf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:08.373377 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7fbb12d8-8400-4037-9a11-10bd82c1691e req-7639eaa5-d04f-47e5-abf7-65d597a16cdf service neutron] 10.222.0.31 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 908 time: 0.2656248 Dec 09 21:23:08.406054 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-61bff9aa-ed37-4766-82d5-e21f21de2306 req-a18fe118-aba4-4caf-95bd-72d1b78ac8e7 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6067958 Dec 09 21:23:08.462333 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-5242ab9c-4b72-468b-a40a-e40496525563 service neutron] For port cd5af376-d278-48fb-8867-a970b71280d9, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:23:08.598114 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-5242ab9c-4b72-468b-a40a-e40496525563 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cd5af376-d278-48fb-8867-a970b71280d9 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:23:08.616405 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-5242ab9c-4b72-468b-a40a-e40496525563 service neutron] For port cd5af376-d278-48fb-8867-a970b71280d9, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=cd5af376-d278-48fb-8867-a970b71280d9,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:08.640074 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7fbb12d8-8400-4037-9a11-10bd82c1691e req-570df19a-289b-4066-9a06-de57e1da05fe service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 HTTP/1.1" status: 200 len: 217 time: 0.2424600 Dec 09 21:23:08.677960 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02d76ffd-b6be-4e8f-8ae7-cd4c018a846a req-3309ee42-a351-42ce-83bc-18d9ad8f0c95 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:08.690140 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02d76ffd-b6be-4e8f-8ae7-cd4c018a846a req-3309ee42-a351-42ce-83bc-18d9ad8f0c95 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 946 time: 0.1842036 Dec 09 21:23:08.713547 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-5242ab9c-4b72-468b-a40a-e40496525563 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:08.725485 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-6c8a3c2e-18bf-4bec-8721-6e1ce6aa6b9f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1af41bb4-4236-45bb-a843-1062b6baf435 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:23:08.744253 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-6c8a3c2e-18bf-4bec-8721-6e1ce6aa6b9f service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:08.783084 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fbb12d8-8400-4037-9a11-10bd82c1691e req-af16a21d-1468-407f-a525-a6ca3ecd632e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:08.787716 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7fbb12d8-8400-4037-9a11-10bd82c1691e req-af16a21d-1468-407f-a525-a6ca3ecd632e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=eae2438b-9fcc-44ef-a172-6c4911cad13f HTTP/1.1" status: 200 len: 847 time: 0.1395142 Dec 09 21:23:08.790922 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02d76ffd-b6be-4e8f-8ae7-cd4c018a846a req-168527ad-a8dd-4f7a-a30a-b02f1a8ddd14 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1008034 Dec 09 21:23:08.839420 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-6c8a3c2e-18bf-4bec-8721-6e1ce6aa6b9f service neutron] Transition to ACTIVE for port object 1af41bb4-4236-45bb-a843-1062b6baf435 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:23:08.866829 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-6c8a3c2e-18bf-4bec-8721-6e1ce6aa6b9f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:08.878274 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7fbb12d8-8400-4037-9a11-10bd82c1691e req-99207c33-dd8a-4e70-b709-de7681341e33 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=04fa749a-9f72-4a2c-a725-feab917f99ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0687933 Dec 09 21:23:09.056310 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7fbb12d8-8400-4037-9a11-10bd82c1691e req-644a7023-0e42-429f-86ed-548c57e061d9 service neutron] 10.222.0.31 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1681566 Dec 09 21:23:09.071296 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c8a3c2e-18bf-4bec-8721-6e1ce6aa6b9f service neutron] Pushing event updated for resources: {'Port': ['ID=1af41bb4-4236-45bb-a843-1062b6baf435,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:09.147125 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-5242ab9c-4b72-468b-a40a-e40496525563 service neutron] Transition to ACTIVE for port object cd5af376-d278-48fb-8867-a970b71280d9 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:23:09.159381 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-5242ab9c-4b72-468b-a40a-e40496525563 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:09.180981 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06652687-f17e-4292-94f2-aa899b34682f req-f7b2598b-7779-4e04-921e-6c7f340820d0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:09.181740 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7fbb12d8-8400-4037-9a11-10bd82c1691e req-551fbecf-94c0-42e2-9dd3-ee58d106e9ef service neutron] 10.222.0.31 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1171482 Dec 09 21:23:09.183021 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-06652687-f17e-4292-94f2-aa899b34682f req-f7b2598b-7779-4e04-921e-6c7f340820d0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 949 time: 0.1668031 Dec 09 21:23:09.277407 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:09.305017 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-6c8a3c2e-18bf-4bec-8721-6e1ce6aa6b9f service neutron] Attempting to bind port 1af41bb4-4236-45bb-a843-1062b6baf435 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:23:09.305501 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-6c8a3c2e-18bf-4bec-8721-6e1ce6aa6b9f service neutron] Attempting to bind port 1af41bb4-4236-45bb-a843-1062b6baf435 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '41babb3e-048d-47f5-b92c-d4cf9897cc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:23:09.305952 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-6c8a3c2e-18bf-4bec-8721-6e1ce6aa6b9f service neutron] Attempting to bind port 1af41bb4-4236-45bb-a843-1062b6baf435 on network 8e0b26d7-eefe-4c85-b535-944f3c15f0f6 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:23:09.354334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-5242ab9c-4b72-468b-a40a-e40496525563 service neutron] No DVR routers for this DVR port cd5af376-d278-48fb-8867-a970b71280d9 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:23:09.363668 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-06652687-f17e-4292-94f2-aa899b34682f req-66ab2cc8-91af-4b48-9720-4cdb2358faf4 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1549883 Dec 09 21:23:09.364519 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5242ab9c-4b72-468b-a40a-e40496525563 service neutron] Pushing event updated for resources: {'Port': ['ID=cd5af376-d278-48fb-8867-a970b71280d9,revision_number=10']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:09.368168 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-6c8a3c2e-18bf-4bec-8721-6e1ce6aa6b9f service neutron] Port 1af41bb4-4236-45bb-a843-1062b6baf435 on network 8e0b26d7-eefe-4c85-b535-944f3c15f0f6 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:23:09.368539 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-6c8a3c2e-18bf-4bec-8721-6e1ce6aa6b9f service neutron] Attempting to bind port 1af41bb4-4236-45bb-a843-1062b6baf435 on network 8e0b26d7-eefe-4c85-b535-944f3c15f0f6 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:23:09.377656 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-6c8a3c2e-18bf-4bec-8721-6e1ce6aa6b9f service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 22, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:23:09.378101 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-6c8a3c2e-18bf-4bec-8721-6e1ce6aa6b9f service neutron] Checking segment: {'id': '41babb3e-048d-47f5-b92c-d4cf9897cc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:23:09.378588 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-6c8a3c2e-18bf-4bec-8721-6e1ce6aa6b9f service neutron] Bound using segment: {'id': '41babb3e-048d-47f5-b92c-d4cf9897cc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:23:09.379123 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-6c8a3c2e-18bf-4bec-8721-6e1ce6aa6b9f service neutron] Bound port: 1af41bb4-4236-45bb-a843-1062b6baf435, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '41babb3e-048d-47f5-b92c-d4cf9897cc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:23:09.379618 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-6c8a3c2e-18bf-4bec-8721-6e1ce6aa6b9f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:09.421553 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ca14089-98bf-4700-9c21-5271a107b5dd req-3960ebdb-f8a9-4c20-98b4-73b4d6da59b5 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:09.429754 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0ca14089-98bf-4700-9c21-5271a107b5dd req-3960ebdb-f8a9-4c20-98b4-73b4d6da59b5 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/ports?device_id=ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4 HTTP/1.1" status: 200 len: 945 time: 0.1910496 Dec 09 21:23:09.446006 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-5242ab9c-4b72-468b-a40a-e40496525563 service neutron] 10.222.0.10 "PUT /v2.0/ports/cd5af376-d278-48fb-8867-a970b71280d9/bindings/n-h1-713301-27/activate HTTP/1.1" status: 200 len: 370 time: 2.2751076 Dec 09 21:23:09.510798 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0ca14089-98bf-4700-9c21-5271a107b5dd req-a06e820d-6d89-4616-a258-0f5a25cce191 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/security-groups?id=c7a6979c-1873-4716-8479-de619cf4fcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0799518 Dec 09 21:23:09.555205 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-6c8a3c2e-18bf-4bec-8721-6e1ce6aa6b9f service neutron] For port 1af41bb4-4236-45bb-a843-1062b6baf435, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:23:09.559189 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-6c8a3c2e-18bf-4bec-8721-6e1ce6aa6b9f service neutron] For port 1af41bb4-4236-45bb-a843-1062b6baf435, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1af41bb4-4236-45bb-a843-1062b6baf435,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:23:09.569289 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-6c8a3c2e-18bf-4bec-8721-6e1ce6aa6b9f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:09.600646 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-f00dce98-52b4-47a5-8fb5-07d526a9c13b tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:09.602219 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-f00dce98-52b4-47a5-8fb5-07d526a9c13b tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362&tenant_id=a306d2242b1e41c892f63c7b122cdee4&binding%3Ahost_id=n-h2-713301-27 HTTP/1.1" status: 200 len: 1097 time: 0.0810277 Dec 09 21:23:09.629416 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-6c8a3c2e-18bf-4bec-8721-6e1ce6aa6b9f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:09.630207 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-6c8a3c2e-18bf-4bec-8721-6e1ce6aa6b9f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:09.632252 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-6c8a3c2e-18bf-4bec-8721-6e1ce6aa6b9f service neutron] 10.222.0.31 "PUT /v2.0/ports/1af41bb4-4236-45bb-a843-1062b6baf435 HTTP/1.1" status: 200 len: 1093 time: 2.9256577 Dec 09 21:23:09.645393 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd6767f88-ed3b-4855-99f9-59acc491c8cd', 'tag': '1af41bb4-4236-45bb-a843-1062b6baf435'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:09.649970 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f8e0fa0c-6016-42e9-bf3a-e20b3f3c1a75" -d '{"events": [{"name": "network-changed", "server_uuid": "d6767f88-ed3b-4855-99f9-59acc491c8cd", "tag": "1af41bb4-4236-45bb-a843-1062b6baf435"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:09.685946 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-518f51fd-1d2e-4a3e-bb8b-5fad1c5f0ea7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:09.687517 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-518f51fd-1d2e-4a3e-bb8b-5fad1c5f0ea7 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362&tenant_id=a306d2242b1e41c892f63c7b122cdee4 HTTP/1.1" status: 200 len: 1097 time: 0.0698526 Dec 09 21:23:09.784615 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-d7634974-603d-4687-8e42-5cfe234c8ec5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:09.787085 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-d7634974-603d-4687-8e42-5cfe234c8ec5 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a306d2242b1e41c892f63c7b122cdee4&device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 1097 time: 0.0578549 Dec 09 21:23:09.807684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c8a3c2e-18bf-4bec-8721-6e1ce6aa6b9f service neutron] Pushing event updated for resources: {'Port': ['ID=1af41bb4-4236-45bb-a843-1062b6baf435,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:09.838804 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6891f323-334b-4a83-bfd7-d9f470e16f1c req-fbb1fabd-f3e8-4aa5-b0f8-b7ca2be6eda3 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:09.846116 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6891f323-334b-4a83-bfd7-d9f470e16f1c req-fbb1fabd-f3e8-4aa5-b0f8-b7ca2be6eda3 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 945 time: 0.2328467 Dec 09 21:23:09.856801 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-90747a53-bff4-4980-a635-2afac5c95298 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:09.858244 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-90747a53-bff4-4980-a635-2afac5c95298 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7233ac85d55e4123a22cfa34bc1ee70e&device_id=d6767f88-ed3b-4855-99f9-59acc491c8cd HTTP/1.1" status: 200 len: 1096 time: 0.1373477 Dec 09 21:23:09.888817 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51678b5e-edd6-46ed-9652-746da94c686d req-af19119d-9223-4622-b592-53ae88fd3df0 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:09.890344 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51678b5e-edd6-46ed-9652-746da94c686d req-af19119d-9223-4622-b592-53ae88fd3df0 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=d6767f88-ed3b-4855-99f9-59acc491c8cd HTTP/1.1" status: 200 len: 944 time: 0.1548147 Dec 09 21:23:09.922704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1aaaeb6e-a8f1-4ae9-9d31-143e39b63171 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:09.925692 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-1aaaeb6e-a8f1-4ae9-9d31-143e39b63171 service neutron] 10.222.0.31 "GET /v2.0/networks?id=93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 200 len: 922 time: 0.1267104 Dec 09 21:23:09.937962 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-6ccc7b3f-5b30-4783-8032-04bd9287a509 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=1af41bb4-4236-45bb-a843-1062b6baf435 HTTP/1.1" status: 200 len: 217 time: 0.0675611 Dec 09 21:23:09.974644 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-6913caf1-6513-47c9-91f5-f645dce32e5b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=cd5af376-d278-48fb-8867-a970b71280d9 HTTP/1.1" status: 200 len: 217 time: 0.0411124 Dec 09 21:23:09.988032 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6891f323-334b-4a83-bfd7-d9f470e16f1c req-109b33c8-e778-46b2-91f6-ebdff62bd25f tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1404572 Dec 09 21:23:10.023762 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51678b5e-edd6-46ed-9652-746da94c686d req-a18843a7-3f24-4e20-bfa7-f6abe84b8997 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1010897 Dec 09 21:23:10.025301 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-eb4882f4-24d7-4883-9907-12a79ccaa4ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:10.026638 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-eb4882f4-24d7-4883-9907-12a79ccaa4ec service neutron] 10.222.0.31 "GET /v2.0/subnets?id=63e7603a-bb11-4d1a-8d84-55456d81931c HTTP/1.1" status: 200 len: 845 time: 0.0800085 Dec 09 21:23:10.080038 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-e612c80e-baae-44cd-8201-e61a2d6351b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:10.081631 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-e612c80e-baae-44cd-8201-e61a2d6351b7 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=c49a62cc-af1b-4958-a4a9-eb44188b8fb9 HTTP/1.1" status: 200 len: 861 time: 0.0901906 Dec 09 21:23:10.105463 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-58eba366-abc1-4943-bb44-055b7f4d5764 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=8e0b26d7-eefe-4c85-b535-944f3c15f0f6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0658479 Dec 09 21:23:10.118154 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-38a15910-4fc0-4c7c-b053-3251d05e8e9b x-openstack-request-id: req-38a15910-4fc0-4c7c-b053-3251d05e8e9b {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:10.118643 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d6767f88-ed3b-4855-99f9-59acc491c8cd", "tag": "1af41bb4-4236-45bb-a843-1062b6baf435", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:10.118900 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-38a15910-4fc0-4c7c-b053-3251d05e8e9b {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:10.119302 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd6767f88-ed3b-4855-99f9-59acc491c8cd', 'tag': '1af41bb4-4236-45bb-a843-1062b6baf435', 'status': 'completed', 'code': 200} Dec 09 21:23:10.129901 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-c3cf441c-c580-48c6-b0e3-0f1e5c207a80 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=93378dc3-2ac5-4cf7-9ce3-d812934de40c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0406604 Dec 09 21:23:10.236318 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-677714e2-e086-4ef3-b9ea-386f63d7e274 service neutron] 10.222.0.31 "GET /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1149523 Dec 09 21:23:10.307520 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-7d8fa100-29d3-43c0-9bfa-b21d4c9f4e8f service neutron] 10.222.0.31 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1584494 Dec 09 21:23:10.484153 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-e1e7ce36-885b-4476-806a-c938663c8ab6 service neutron] 10.222.0.31 "GET /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1673503 Dec 09 21:23:10.635495 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7ef9ea8-fb1b-4e7d-9fbf-1f74fc5aabfe req-c57054fc-816b-46d9-bb2e-1a8e774f6eda tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:10.637401 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d7ef9ea8-fb1b-4e7d-9fbf-1f74fc5aabfe req-c57054fc-816b-46d9-bb2e-1a8e774f6eda tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.31 "GET /v2.0/ports?device_id=ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4 HTTP/1.1" status: 200 len: 945 time: 0.1026914 Dec 09 21:23:10.646433 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08164786-7ca2-49cc-817b-994ecb3191c2 req-5f40a859-38b2-45fa-be2b-db4df491e5db tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:10.653949 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-08164786-7ca2-49cc-817b-994ecb3191c2 req-5f40a859-38b2-45fa-be2b-db4df491e5db tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 946 time: 0.5336339 Dec 09 21:23:10.799870 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-08164786-7ca2-49cc-817b-994ecb3191c2 req-e10cac27-2b14-4a36-87bc-c617161d14b1 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1437008 Dec 09 21:23:10.821308 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-437a0644-130e-4c68-b3a0-8e659cb5fb0d req-5b578746-1a7f-4bf3-9fec-2e7a76615c4a tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:10.828907 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-437a0644-130e-4c68-b3a0-8e659cb5fb0d req-5b578746-1a7f-4bf3-9fec-2e7a76615c4a tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 949 time: 0.1635888 Dec 09 21:23:10.846333 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fedab8a2-cef4-465f-8898-8f7901919fb8 req-12f4968f-8189-48bd-a46a-32d6bba76860 service neutron] 10.222.0.31 "GET /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5931242 Dec 09 21:23:10.928462 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34512) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:10.952552 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-437a0644-130e-4c68-b3a0-8e659cb5fb0d req-b11f209c-b433-4d7e-a9d6-011ce51cedeb tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1226766 Dec 09 21:23:10.965379 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-d7ef9ea8-fb1b-4e7d-9fbf-1f74fc5aabfe req-f2c1512d-d0bd-45a2-8e59-6af4254e3884 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Deleting port 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:23:10.966878 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d7ef9ea8-fb1b-4e7d-9fbf-1f74fc5aabfe req-f2c1512d-d0bd-45a2-8e59-6af4254e3884 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:11.010286 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-2ad365a3-b8e1-4bcc-9e43-61a2c7347a10 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:11.012296 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-2ad365a3-b8e1-4bcc-9e43-61a2c7347a10 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362&tenant_id=a306d2242b1e41c892f63c7b122cdee4&binding%3Ahost_id=n-h1-713301-27 HTTP/1.1" status: 200 len: 1097 time: 0.2353258 Dec 09 21:23:11.013424 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33a73a9d-2380-4617-950f-22edd5361bcb req-24f0b414-590b-448e-bc51-34059b2e2cbc tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:11.014976 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-33a73a9d-2380-4617-950f-22edd5361bcb req-24f0b414-590b-448e-bc51-34059b2e2cbc tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/ports?device_id=ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4 HTTP/1.1" status: 200 len: 945 time: 0.1201966 Dec 09 21:23:11.044831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e0fa0c-6016-42e9-bf3a-e20b3f3c1a75 req-c3e53151-7dc3-4518-a695-93db7e5c1f58 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:11.050949 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8e0fa0c-6016-42e9-bf3a-e20b3f3c1a75 req-c3e53151-7dc3-4518-a695-93db7e5c1f58 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=7233ac85d55e4123a22cfa34bc1ee70e&device_id=d6767f88-ed3b-4855-99f9-59acc491c8cd HTTP/1.1" status: 200 len: 1096 time: 0.1144266 Dec 09 21:23:11.167428 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fca74dc1-7a03-4c84-bc21-e767853a9fc0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:11.201993 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e0fa0c-6016-42e9-bf3a-e20b3f3c1a75 req-a53a6c23-fa57-4cb1-adaf-78091238aadc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:11.203554 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8e0fa0c-6016-42e9-bf3a-e20b3f3c1a75 req-a53a6c23-fa57-4cb1-adaf-78091238aadc service neutron] 10.222.0.31 "GET /v2.0/networks?id=8e0b26d7-eefe-4c85-b535-944f3c15f0f6 HTTP/1.1" status: 200 len: 906 time: 0.1376116 Dec 09 21:23:11.280538 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8e0fa0c-6016-42e9-bf3a-e20b3f3c1a75 req-ef2ede28-ca04-467b-873b-60e902484dec service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=1af41bb4-4236-45bb-a843-1062b6baf435 HTTP/1.1" status: 200 len: 217 time: 0.0545137 Dec 09 21:23:11.300888 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-d7ef9ea8-fb1b-4e7d-9fbf-1f74fc5aabfe req-f2c1512d-d0bd-45a2-8e59-6af4254e3884 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] For port 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5,segment=NetworkSegment(6827180a-5aaf-4697-a7f8-e56a6f614fc7),segment_id=6827180a-5aaf-4697-a7f8-e56a6f614fc7)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:11.301389 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-33a73a9d-2380-4617-950f-22edd5361bcb req-21a07b51-691b-4b71-932f-48cbacce5b0e tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/security-groups?id=c7a6979c-1873-4716-8479-de619cf4fcc0&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2729161 Dec 09 21:23:11.308386 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d7ef9ea8-fb1b-4e7d-9fbf-1f74fc5aabfe req-f2c1512d-d0bd-45a2-8e59-6af4254e3884 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:11.348799 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77df8161-a9a7-49ca-bdba-63ea49d93611 req-fb1fd5d5-2e54-41a5-9194-bcd65d1562e7 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:11.353047 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-77df8161-a9a7-49ca-bdba-63ea49d93611 req-fb1fd5d5-2e54-41a5-9194-bcd65d1562e7 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 1098 time: 0.2799034 Dec 09 21:23:11.382307 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e0fa0c-6016-42e9-bf3a-e20b3f3c1a75 req-4b52ed2e-4b40-408e-8468-b0c660f7a42f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:11.383869 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8e0fa0c-6016-42e9-bf3a-e20b3f3c1a75 req-4b52ed2e-4b40-408e-8468-b0c660f7a42f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=63e7603a-bb11-4d1a-8d84-55456d81931c HTTP/1.1" status: 200 len: 845 time: 0.0940437 Dec 09 21:23:11.414524 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-53ab97da-30a7-4576-93a5-02f0173f89cd service neutron] For port cd5af376-d278-48fb-8867-a970b71280d9, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:23:11.425349 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-53ab97da-30a7-4576-93a5-02f0173f89cd service neutron] Publish callbacks [] for binding, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:11.426590 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b6c52bb6-d892-437a-8d72-e50dcbde0d16 req-53ab97da-30a7-4576-93a5-02f0173f89cd service neutron] 10.222.0.31 "DELETE /v2.0/ports/cd5af376-d278-48fb-8867-a970b71280d9/bindings/n-h2-713301-27 HTTP/1.1" status: 204 len: 173 time: 0.3802371 Dec 09 21:23:11.475416 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8e0fa0c-6016-42e9-bf3a-e20b3f3c1a75 req-5d95c569-a49b-4d88-93fc-038bef350756 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=8e0b26d7-eefe-4c85-b535-944f3c15f0f6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0458016 Dec 09 21:23:11.523099 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-77df8161-a9a7-49ca-bdba-63ea49d93611 req-6c4e8562-27fd-4be7-ac85-264099c4ed38 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1302884 Dec 09 21:23:11.556248 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fca74dc1-7a03-4c84-bc21-e767853a9fc0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:11.563099 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fca74dc1-7a03-4c84-bc21-e767853a9fc0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:11.580140 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa095590-1900-47ba-817e-fbd687cfbed5 req-4db41391-c98e-424c-b3e7-7221f2eb2b9f tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:11.588827 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aa095590-1900-47ba-817e-fbd687cfbed5 req-4db41391-c98e-424c-b3e7-7221f2eb2b9f tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 945 time: 0.1247211 Dec 09 21:23:11.596050 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fca74dc1-7a03-4c84-bc21-e767853a9fc0 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=fba6d52229794c8090ff91c0845fab66&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6648788 Dec 09 21:23:11.634900 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34526) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:11.727713 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d7ef9ea8-fb1b-4e7d-9fbf-1f74fc5aabfe req-f2c1512d-d0bd-45a2-8e59-6af4254e3884 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:11.729308 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d7ef9ea8-fb1b-4e7d-9fbf-1f74fc5aabfe req-f2c1512d-d0bd-45a2-8e59-6af4254e3884 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:11.729308 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [req-d7ef9ea8-fb1b-4e7d-9fbf-1f74fc5aabfe req-f2c1512d-d0bd-45a2-8e59-6af4254e3884 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Floating IP 757e5c65-9ddd-46bb-9620-1e7a796dd3fa disassociated. External IP: 172.25.3.113, port: 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5. Dec 09 21:23:11.730889 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-d7ef9ea8-fb1b-4e7d-9fbf-1f74fc5aabfe req-f2c1512d-d0bd-45a2-8e59-6af4254e3884 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Calling delete_port for 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:23:11.757935 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fca74dc1-7a03-4c84-bc21-e767853a9fc0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=001f36b5-4633-4381-8d68-15be2862524c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:11.773081 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aa095590-1900-47ba-817e-fbd687cfbed5 req-12f4e8aa-971b-4248-b16c-7eea11bcbf78 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1833482 Dec 09 21:23:11.822207 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6405c45d-d2ce-4307-b503-8ce2d3b9371b req-5f63315a-be64-4705-947d-8f2f641c4f48 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:11.834375 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6405c45d-d2ce-4307-b503-8ce2d3b9371b req-5f63315a-be64-4705-947d-8f2f641c4f48 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=d6767f88-ed3b-4855-99f9-59acc491c8cd HTTP/1.1" status: 200 len: 944 time: 0.1864927 Dec 09 21:23:11.863002 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8e0fa0c-6016-42e9-bf3a-e20b3f3c1a75 req-6781c340-7b57-4f13-9512-a350bbbdc8e3 service neutron] 10.222.0.31 "GET /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3664811 Dec 09 21:23:11.970116 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d7ef9ea8-fb1b-4e7d-9fbf-1f74fc5aabfe req-f2c1512d-d0bd-45a2-8e59-6af4254e3884 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:11.984315 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-496da725-3ab5-43c6-b811-a1162959cf01 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:12.016019 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-496da725-3ab5-43c6-b811-a1162959cf01 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:12.031703 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2c1512d-d0bd-45a2-8e59-6af4254e3884 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Pushing event deleted for resources: {'Port': ['ID=487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:12.098719 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6405c45d-d2ce-4307-b503-8ce2d3b9371b req-6f80f21d-540f-46fd-92de-920729fff1f1 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2632132 Dec 09 21:23:12.159549 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-496da725-3ab5-43c6-b811-a1162959cf01 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:12.172906 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-496da725-3ab5-43c6-b811-a1162959cf01 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:12.177143 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-496da725-3ab5-43c6-b811-a1162959cf01 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/001f36b5-4633-4381-8d68-15be2862524c HTTP/1.1" status: 204 len: 168 time: 0.5386949 Dec 09 21:23:12.191669 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-496da725-3ab5-43c6-b811-a1162959cf01 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=001f36b5-4633-4381-8d68-15be2862524c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:12.233471 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46c7be38-5b01-4c7f-86fc-4a798b7507b3 req-6eb65a80-2e8e-467e-bad7-ce9383971a65 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:12.242801 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46c7be38-5b01-4c7f-86fc-4a798b7507b3 req-6eb65a80-2e8e-467e-bad7-ce9383971a65 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 1098 time: 0.1489034 Dec 09 21:23:12.262969 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8e0fa0c-6016-42e9-bf3a-e20b3f3c1a75 req-e3c369ad-509d-471e-a874-c323e3eaf353 service neutron] 10.222.0.31 "GET /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3836455 Dec 09 21:23:12.341605 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46c7be38-5b01-4c7f-86fc-4a798b7507b3 req-5a92ba69-d029-4ffb-8039-f3364e0fbb03 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0975800 Dec 09 21:23:12.353650 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [req-d7ef9ea8-fb1b-4e7d-9fbf-1f74fc5aabfe req-f2c1512d-d0bd-45a2-8e59-6af4254e3884 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Router a54b1faf-ab53-4950-be39-e5e79b3d7ed9 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:23:12.373749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-056522b0-4798-4653-b599-8b8c99fcf6ba req-13192747-4128-4532-8f1b-6dbbda79e124 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:12.377913 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-056522b0-4798-4653-b599-8b8c99fcf6ba req-13192747-4128-4532-8f1b-6dbbda79e124 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 949 time: 0.1139476 Dec 09 21:23:12.603589 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-056522b0-4798-4653-b599-8b8c99fcf6ba req-a8e63245-a1e6-43b0-8010-5d823dfe72de tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2122965 Dec 09 21:23:12.635721 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-627fc220-c9fc-4198-8ca6-370896c5ed28 req-902df1f4-0ec4-4de8-bf42-4dfefaabe463 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:12.640929 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-627fc220-c9fc-4198-8ca6-370896c5ed28 req-902df1f4-0ec4-4de8-bf42-4dfefaabe463 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 1097 time: 0.1818805 Dec 09 21:23:12.670131 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-d7ef9ea8-fb1b-4e7d-9fbf-1f74fc5aabfe req-f2c1512d-d0bd-45a2-8e59-6af4254e3884 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:23:12.697518 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7234f4b5-4bd9-4afe-972a-53bd1cd34be9 None None] Sync routers for ids ['a54b1faf-ab53-4950-be39-e5e79b3d7ed9'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:23:12.717349 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7234f4b5-4bd9-4afe-972a-53bd1cd34be9 None None] Routers {'a54b1faf-ab53-4950-be39-e5e79b3d7ed9'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:23:12.721280 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-7234f4b5-4bd9-4afe-972a-53bd1cd34be9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:23:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a54b1faf-ab53-4950-be39-e5e79b3d7ed9'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:12.752136 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-627fc220-c9fc-4198-8ca6-370896c5ed28 req-79b5eeb5-d7fa-4958-97d9-06daf78a8922 tempest-LiveAutoBlockMigrationV225Test-878646764 tempest-LiveAutoBlockMigrationV225Test-878646764-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0983877 Dec 09 21:23:12.753019 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34556) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:12.777886 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-76915240-f22f-4ca3-86f7-7e65f97a0463 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:12.793189 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-d7ef9ea8-fb1b-4e7d-9fbf-1f74fc5aabfe req-f2c1512d-d0bd-45a2-8e59-6af4254e3884 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] No DVR routers for this DVR port 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:23:12.795762 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d7ef9ea8-fb1b-4e7d-9fbf-1f74fc5aabfe req-f2c1512d-d0bd-45a2-8e59-6af4254e3884 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:12.799734 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d7ef9ea8-fb1b-4e7d-9fbf-1f74fc5aabfe req-f2c1512d-d0bd-45a2-8e59-6af4254e3884 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.31 "DELETE /v2.0/ports/487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 HTTP/1.1" status: 204 len: 173 time: 2.1503885 Dec 09 21:23:12.800290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4', 'name': 'network-vif-deleted', 'tag': '487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:12.803076 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-80c55399-fbeb-4f67-ae24-8252b2a7081c" -d '{"events": [{"server_uuid": "ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4", "name": "network-vif-deleted", "tag": "487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:12.889633 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32affab4-3635-4428-98a3-fd447d37d519 req-b1bda709-f0a8-4a72-b0dc-ba800d59974a tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/ports?device_id=ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4 HTTP/1.1" status: 200 len: 210 time: 0.0418673 Dec 09 21:23:12.912529 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ed2500e3-2cbd-48fd-beb2-107408add3de x-openstack-request-id: req-ed2500e3-2cbd-48fd-beb2-107408add3de {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:12.912903 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4", "name": "network-vif-deleted", "tag": "487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:12.913219 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-ed2500e3-2cbd-48fd-beb2-107408add3de {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:12.913613 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ac3b3164-435a-4da5-81aa-d2ee9bcd3bf4', 'name': 'network-vif-deleted', 'tag': '487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5', 'status': 'completed', 'code': 200} Dec 09 21:23:12.965345 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-76915240-f22f-4ca3-86f7-7e65f97a0463 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:12.972072 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-76915240-f22f-4ca3-86f7-7e65f97a0463 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:13.078882 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-76915240-f22f-4ca3-86f7-7e65f97a0463 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=025e8d27675c43649759d3d2fff40f39&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3246551 Dec 09 21:23:13.080269 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76915240-f22f-4ca3-86f7-7e65f97a0463 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=426f81e9-b17b-4268-b2eb-b69cdb39ac09,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:13.081587 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34570) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:13.146047 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-7234f4b5-4bd9-4afe-972a-53bd1cd34be9 None None] Set router a54b1faf-ab53-4950-be39-e5e79b3d7ed9 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:23:13.198866 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b0ae71f1-8985-4b2a-bcbe-8731832e1aab admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:13.252316 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b0ae71f1-8985-4b2a-bcbe-8731832e1aab admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:13.312391 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b0ae71f1-8985-4b2a-bcbe-8731832e1aab admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:13.317176 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b0ae71f1-8985-4b2a-bcbe-8731832e1aab admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:13.319078 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b0ae71f1-8985-4b2a-bcbe-8731832e1aab admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/426f81e9-b17b-4268-b2eb-b69cdb39ac09 HTTP/1.1" status: 204 len: 168 time: 0.2339151 Dec 09 21:23:13.328817 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0ae71f1-8985-4b2a-bcbe-8731832e1aab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=426f81e9-b17b-4268-b2eb-b69cdb39ac09,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:13.361969 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1af41bb4-4236-45bb-a843-1062b6baf435 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:23:13.511679 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 1af41bb4-4236-45bb-a843-1062b6baf435, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1af41bb4-4236-45bb-a843-1062b6baf435,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:13.515800 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eadaf02-789d-4a07-8e3b-3ffc7e87f1b5 req-7a57ba2a-9dc6-437e-940e-2f114b1b3ed8 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:13.526074 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5eadaf02-789d-4a07-8e3b-3ffc7e87f1b5 req-7a57ba2a-9dc6-437e-940e-2f114b1b3ed8 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=d6767f88-ed3b-4855-99f9-59acc491c8cd HTTP/1.1" status: 200 len: 944 time: 0.1346030 Dec 09 21:23:13.526302 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:23:13.545955 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '1af41bb4-4236-45bb-a843-1062b6baf435', 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6', 'port_id': '1af41bb4-4236-45bb-a843-1062b6baf435', 'mac_address': 'fa:16:3e:6c:92:d4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 122, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '63e7603a-bb11-4d1a-8d84-55456d81931c', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:23:13.597700 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:23:13.598086 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 487c7a16-9ffa-4a93-bcd1-5e4d5d2972b5 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:23:13.660498 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:13.675590 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1af41bb4-4236-45bb-a843-1062b6baf435 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:23:13.677368 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5eadaf02-789d-4a07-8e3b-3ffc7e87f1b5 req-25caba89-99d5-4b96-b2c4-09b26c46be25 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1457260 Dec 09 21:23:13.711605 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 1af41bb4-4236-45bb-a843-1062b6baf435, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1af41bb4-4236-45bb-a843-1062b6baf435,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:13.727353 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:13.795873 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=1af41bb4-4236-45bb-a843-1062b6baf435,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:13.854007 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f59583d6-393f-4faf-8eef-80f5bc475427 req-4260fe66-bc5e-4766-a6d4-17dda52c133f tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:13.856028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-7234f4b5-4bd9-4afe-972a-53bd1cd34be9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'name': 'tempest-ServersTestJSON-799420296-router', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66'}], 'enable_snat': True}, 'gw_port_id': '3d871078-9873-42c7-9428-2cbedc035380', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:20:39Z', 'updated_at': '2021-12-09T21:20:50Z', 'revision_number': 4, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'gw_port': {'id': '3d871078-9873-42c7-9428-2cbedc035380', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:25:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 595, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:42Z', 'updated_at': '2021-12-09T21:20:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'aada448e-8a62-400c-91ba-1ae577560497', 'name': '', 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'mac_address': 'fa:16:3e:0f:c5:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'device_owner': 'network:router_interface', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '006a974f-ca2f-40a9-b5ee-25ae5235c5b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:49Z', 'updated_at': '2021-12-09T21:20:56Z', 'revision_number': 5, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'subnets': [{'id': '006a974f-ca2f-40a9-b5ee-25ae5235c5b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:13.856596 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f59583d6-393f-4faf-8eef-80f5bc475427 req-4260fe66-bc5e-4766-a6d4-17dda52c133f tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 945 time: 0.0976613 Dec 09 21:23:13.900218 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7234f4b5-4bd9-4afe-972a-53bd1cd34be9 None None] Checking router: a54b1faf-ab53-4950-be39-e5e79b3d7ed9 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:23:13.916585 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7234f4b5-4bd9-4afe-972a-53bd1cd34be9 None None] Routers {'a54b1faf-ab53-4950-be39-e5e79b3d7ed9'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:23:13.924961 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-7234f4b5-4bd9-4afe-972a-53bd1cd34be9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:23:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a54b1faf-ab53-4950-be39-e5e79b3d7ed9'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:13.989140 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a36b1452-897f-4a45-a28d-b60fa7e557a1 req-251c06f1-394b-4231-b505-92ff227f56e6 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:13.991016 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a36b1452-897f-4a45-a28d-b60fa7e557a1 req-251c06f1-394b-4231-b505-92ff227f56e6 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.31 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 945 time: 0.1305094 Dec 09 21:23:14.045342 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f59583d6-393f-4faf-8eef-80f5bc475427 req-c3cc784b-2b71-4a9b-b44d-09fa933cde20 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1410632 Dec 09 21:23:14.080377 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['1af41bb4-4236-45bb-a843-1062b6baf435'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:23:14.165863 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-a36b1452-897f-4a45-a28d-b60fa7e557a1 req-65c54067-0c02-4057-a6fb-f86228234e7d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Deleting port cd5af376-d278-48fb-8867-a970b71280d9 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:23:14.170240 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-7234f4b5-4bd9-4afe-972a-53bd1cd34be9 None None] Set router a54b1faf-ab53-4950-be39-e5e79b3d7ed9 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:23:14.185188 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a36b1452-897f-4a45-a28d-b60fa7e557a1 req-65c54067-0c02-4057-a6fb-f86228234e7d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:14.236639 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-708a761c-0396-4565-b12a-9b465c113905 req-b27284a0-a773-48e0-87d5-edd137ef3f28 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:14.261994 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-708a761c-0396-4565-b12a-9b465c113905 req-b27284a0-a773-48e0-87d5-edd137ef3f28 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 949 time: 0.1084609 Dec 09 21:23:14.341490 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-708a761c-0396-4565-b12a-9b465c113905 req-dac92458-bd42-4c6a-9d33-a1bc693c9419 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0745628 Dec 09 21:23:14.430827 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-a36b1452-897f-4a45-a28d-b60fa7e557a1 req-65c54067-0c02-4057-a6fb-f86228234e7d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] For port cd5af376-d278-48fb-8867-a970b71280d9, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=cd5af376-d278-48fb-8867-a970b71280d9,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:14.436367 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a36b1452-897f-4a45-a28d-b60fa7e557a1 req-65c54067-0c02-4057-a6fb-f86228234e7d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:14.459284 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-a36b1452-897f-4a45-a28d-b60fa7e557a1 req-65c54067-0c02-4057-a6fb-f86228234e7d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Calling delete_port for cd5af376-d278-48fb-8867-a970b71280d9 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:23:14.547093 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-7234f4b5-4bd9-4afe-972a-53bd1cd34be9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'name': 'tempest-ServersTestJSON-799420296-router', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66'}], 'enable_snat': True}, 'gw_port_id': '3d871078-9873-42c7-9428-2cbedc035380', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:20:39Z', 'updated_at': '2021-12-09T21:20:50Z', 'revision_number': 4, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'gw_port': {'id': '3d871078-9873-42c7-9428-2cbedc035380', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:25:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 595, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:42Z', 'updated_at': '2021-12-09T21:20:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'aada448e-8a62-400c-91ba-1ae577560497', 'name': '', 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'mac_address': 'fa:16:3e:0f:c5:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'device_owner': 'network:router_interface', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '006a974f-ca2f-40a9-b5ee-25ae5235c5b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:49Z', 'updated_at': '2021-12-09T21:20:56Z', 'revision_number': 5, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'subnets': [{'id': '006a974f-ca2f-40a9-b5ee-25ae5235c5b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:14.619277 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7234f4b5-4bd9-4afe-972a-53bd1cd34be9 None None] The sync data for ids ['a54b1faf-ab53-4950-be39-e5e79b3d7ed9'] in n-d-713301-27 is: [{'id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'name': 'tempest-ServersTestJSON-799420296-router', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66'}], 'enable_snat': True}, 'gw_port_id': '3d871078-9873-42c7-9428-2cbedc035380', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:20:39Z', 'updated_at': '2021-12-09T21:20:50Z', 'revision_number': 4, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'gw_port': {'id': '3d871078-9873-42c7-9428-2cbedc035380', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:25:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 595, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:42Z', 'updated_at': '2021-12-09T21:20:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'aada448e-8a62-400c-91ba-1ae577560497', 'name': '', 'network_id': '0a4691ff-8eab-4fe6-bec4-b1a20a69fce2', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'mac_address': 'fa:16:3e:0f:c5:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'device_owner': 'network:router_interface', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '006a974f-ca2f-40a9-b5ee-25ae5235c5b1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:49Z', 'updated_at': '2021-12-09T21:20:56Z', 'revision_number': 5, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'subnets': [{'id': '006a974f-ca2f-40a9-b5ee-25ae5235c5b1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:23:14.737744 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a36b1452-897f-4a45-a28d-b60fa7e557a1 req-65c54067-0c02-4057-a6fb-f86228234e7d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:14.744930 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34644) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:14.804546 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65c54067-0c02-4057-a6fb-f86228234e7d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Pushing event deleted for resources: {'Port': ['ID=cd5af376-d278-48fb-8867-a970b71280d9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:14.813726 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-de464add-c143-43cd-8739-50a5aa4d689e tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:23:14.823914 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-de464add-c143-43cd-8739-50a5aa4d689e tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0210354 Dec 09 21:23:14.834574 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34646) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:14.888339 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-46cd611d-f0a7-42e2-a8ea-0793c7924231 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:14.907676 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-a36b1452-897f-4a45-a28d-b60fa7e557a1 req-65c54067-0c02-4057-a6fb-f86228234e7d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] No DVR routers for this DVR port cd5af376-d278-48fb-8867-a970b71280d9 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:23:14.912143 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a36b1452-897f-4a45-a28d-b60fa7e557a1 req-65c54067-0c02-4057-a6fb-f86228234e7d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:14.918498 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a36b1452-897f-4a45-a28d-b60fa7e557a1 req-65c54067-0c02-4057-a6fb-f86228234e7d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.31 "DELETE /v2.0/ports/cd5af376-d278-48fb-8867-a970b71280d9 HTTP/1.1" status: 204 len: 173 time: 0.9176934 Dec 09 21:23:14.918981 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5105efab-9ee1-4a74-9a45-e77c38549362', 'name': 'network-vif-deleted', 'tag': 'cd5af376-d278-48fb-8867-a970b71280d9'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:14.921253 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-46de2aef-1afa-4661-bedb-1c63bc58748e" -d '{"events": [{"server_uuid": "5105efab-9ee1-4a74-9a45-e77c38549362", "name": "network-vif-deleted", "tag": "cd5af376-d278-48fb-8867-a970b71280d9"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:14.940542 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-204a09aa-3bd9-4054-8709-5bab52045600 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:14.953283 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-204a09aa-3bd9-4054-8709-5bab52045600 service neutron] 10.222.0.13 "GET /v2.0/ports/13499602-258c-4839-b928-17aef0d24310 HTTP/1.1" status: 200 len: 1095 time: 0.1301682 Dec 09 21:23:14.954861 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-46cd611d-f0a7-42e2-a8ea-0793c7924231 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:14.957636 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-4b86a111-0d3c-479d-870d-21e57c0a10c6 service neutron] Request body: {'binding': {'host': 'n-h1-713301-27', 'vnic_type': 'normal', 'profile': {}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:23:14.958256 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-4b86a111-0d3c-479d-870d-21e57c0a10c6 service neutron] Unknown quota resources ['binding']. {{(pid=103437) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 09 21:23:15.013988 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89e13093-e700-4b75-93a3-df77fea3ab77 req-d924d9d0-ee22-46e6-afb0-788da0616825 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:15.029109 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89e13093-e700-4b75-93a3-df77fea3ab77 req-d924d9d0-ee22-46e6-afb0-788da0616825 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=d6767f88-ed3b-4855-99f9-59acc491c8cd HTTP/1.1" status: 200 len: 945 time: 0.1536481 Dec 09 21:23:15.050298 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['40468c91-ccde-4d96-b234-0e326a1de103', 'cd5af376-d278-48fb-8867-a970b71280d9'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:23:15.133218 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fdbbca72-ada8-4394-ada5-7ccac08eeac1 None None] New status for floating IP 757e5c65-9ddd-46bb-9620-1e7a796dd3fa: DOWN {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:23:15.135101 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-3fab362c-2c91-4728-a97e-ff980c4fd1b6 admin admin] Request body: {'network': {'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1528769429-network', 'tenant_id': '768655d2ebd74340a90f65fc3007118f'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:23:15.164415 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3fab362c-2c91-4728-a97e-ff980c4fd1b6 admin admin] Made reservation on behalf of 768655d2ebd74340a90f65fc3007118f for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:23:15.166769 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3fab362c-2c91-4728-a97e-ff980c4fd1b6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:15.173112 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89e13093-e700-4b75-93a3-df77fea3ab77 req-9719024d-f5ec-4bac-b118-1045da6326fa tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1431801 Dec 09 21:23:15.177088 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-46cd611d-f0a7-42e2-a8ea-0793c7924231 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:15.188052 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-46cd611d-f0a7-42e2-a8ea-0793c7924231 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:15.192383 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3fab362c-2c91-4728-a97e-ff980c4fd1b6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:15.195059 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34654) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:15.198349 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-46cd611d-f0a7-42e2-a8ea-0793c7924231 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "DELETE /v2.0/security-groups/c7a6979c-1873-4716-8479-de619cf4fcc0 HTTP/1.1" status: 204 len: 168 time: 0.4431741 Dec 09 21:23:15.227545 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46cd611d-f0a7-42e2-a8ea-0793c7924231 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c7a6979c-1873-4716-8479-de619cf4fcc0,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:15.230669 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-821ff437-5574-4927-b18b-ecadfbdf1a2d tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] show failed (client error): The resource could not be found. Dec 09 21:23:15.234970 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-821ff437-5574-4927-b18b-ecadfbdf1a2d tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "GET /v2.0/security-groups/c7a6979c-1873-4716-8479-de619cf4fcc0 HTTP/1.1" status: 404 len: 347 time: 0.0361769 Dec 09 21:23:15.235140 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34656) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:15.284404 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1af41bb4-4236-45bb-a843-1062b6baf435 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:23:15.290076 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-95bbde22-505e-49c5-9294-9b9b7123d790 x-openstack-request-id: req-95bbde22-505e-49c5-9294-9b9b7123d790 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:15.290375 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5105efab-9ee1-4a74-9a45-e77c38549362", "name": "network-vif-deleted", "tag": "cd5af376-d278-48fb-8867-a970b71280d9", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:15.299980 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-95bbde22-505e-49c5-9294-9b9b7123d790 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:15.300424 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5105efab-9ee1-4a74-9a45-e77c38549362', 'name': 'network-vif-deleted', 'tag': 'cd5af376-d278-48fb-8867-a970b71280d9', 'status': 'completed', 'code': 200} Dec 09 21:23:15.342121 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-4b86a111-0d3c-479d-870d-21e57c0a10c6 service neutron] Attempting to bind port 13499602-258c-4839-b928-17aef0d24310 on host n-h1-713301-27 for vnic_type normal with profile None {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:23:15.342449 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-4b86a111-0d3c-479d-870d-21e57c0a10c6 service neutron] Attempting to bind port 13499602-258c-4839-b928-17aef0d24310 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:23:15.342989 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-4b86a111-0d3c-479d-870d-21e57c0a10c6 service neutron] Attempting to bind port 13499602-258c-4839-b928-17aef0d24310 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:23:15.378358 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-4b86a111-0d3c-479d-870d-21e57c0a10c6 service neutron] Port 13499602-258c-4839-b928-17aef0d24310 on network 04fa749a-9f72-4a2c-a725-feab917f99ef not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:23:15.379006 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-4b86a111-0d3c-479d-870d-21e57c0a10c6 service neutron] Attempting to bind port 13499602-258c-4839-b928-17aef0d24310 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:23:15.399032 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-4b86a111-0d3c-479d-870d-21e57c0a10c6 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 22, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:23:15.402016 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-4b86a111-0d3c-479d-870d-21e57c0a10c6 service neutron] Checking segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:23:15.403169 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-4b86a111-0d3c-479d-870d-21e57c0a10c6 service neutron] Bound using segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:23:15.403815 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-4b86a111-0d3c-479d-870d-21e57c0a10c6 service neutron] Bound port: 13499602-258c-4839-b928-17aef0d24310, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:23:15.430297 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 1af41bb4-4236-45bb-a843-1062b6baf435 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:23:15.435102 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 1af41bb4-4236-45bb-a843-1062b6baf435 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:23:15.435643 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:15.552302 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:15.579319 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3bb8319-79cb-4a0d-9e29-a33ed7522092 req-de052ded-596c-4f4e-af8e-529c554bc25b tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 210 time: 0.1350861 Dec 09 21:23:15.600674 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd6767f88-ed3b-4855-99f9-59acc491c8cd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1af41bb4-4236-45bb-a843-1062b6baf435'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:15.605263 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a8926076-4b76-4403-8840-4b2bb495e774" -d '{"events": [{"server_uuid": "d6767f88-ed3b-4855-99f9-59acc491c8cd", "name": "network-vif-plugged", "status": "completed", "tag": "1af41bb4-4236-45bb-a843-1062b6baf435"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:15.620625 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 1af41bb4-4236-45bb-a843-1062b6baf435, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1af41bb4-4236-45bb-a843-1062b6baf435,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:15.637142 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:15.639049 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device cd5af376-d278-48fb-8867-a970b71280d9 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:23:15.640219 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-cdb651cd-4278-43a3-b5b0-4bf1613df449 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Deleting port 4eaead15-fa81-43b7-8704-393ca917038c {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:23:15.643661 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cdb651cd-4278-43a3-b5b0-4bf1613df449 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:15.656562 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3fab362c-2c91-4728-a97e-ff980c4fd1b6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:15.667615 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-4b86a111-0d3c-479d-870d-21e57c0a10c6 service neutron] For port 13499602-258c-4839-b928-17aef0d24310, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=13499602-258c-4839-b928-17aef0d24310,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:23:15.678335 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3fab362c-2c91-4728-a97e-ff980c4fd1b6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:15.690581 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: cd5af376-d278-48fb-8867-a970b71280d9 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:23:15.690972 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device cd5af376-d278-48fb-8867-a970b71280d9 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:23:15.730627 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=1af41bb4-4236-45bb-a843-1062b6baf435,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:15.734312 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3fab362c-2c91-4728-a97e-ff980c4fd1b6 admin admin] vlan segment allocate from pool success with {'vlan_id': 139, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:23:15.768998 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fab362c-2c91-4728-a97e-ff980c4fd1b6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=502403b3-5851-499b-ae86-dd222b0f8aab,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:15.787778 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-4b86a111-0d3c-479d-870d-21e57c0a10c6 service neutron] Publish callbacks [] for binding, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:15.793860 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-4b86a111-0d3c-479d-870d-21e57c0a10c6 service neutron] 10.222.0.13 "POST /v2.0/ports/13499602-258c-4839-b928-17aef0d24310/bindings HTTP/1.1" status: 201 len: 390 time: 0.8397195 Dec 09 21:23:15.804593 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3fab362c-2c91-4728-a97e-ff980c4fd1b6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:15.805291 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-3fab362c-2c91-4728-a97e-ff980c4fd1b6 admin admin] Added segment 2d25d46c-e6fd-49a0-8d61-31fba8f6eefc of type vlan for network 9b3c0886-168c-4d9c-83a4-145e87393715 Dec 09 21:23:15.878712 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cdb651cd-4278-43a3-b5b0-4bf1613df449 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:15.879096 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cdb651cd-4278-43a3-b5b0-4bf1613df449 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:15.907605 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-040d3852-6764-4f9a-97d3-bf37b68befbc req-c995ea03-1a92-4b67-983e-1917e33949d0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:15.916086 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-040d3852-6764-4f9a-97d3-bf37b68befbc req-c995ea03-1a92-4b67-983e-1917e33949d0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 949 time: 0.1963151 Dec 09 21:23:15.929029 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-cdb651cd-4278-43a3-b5b0-4bf1613df449 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Calling delete_port for 4eaead15-fa81-43b7-8704-393ca917038c owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:23:15.993396 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-040d3852-6764-4f9a-97d3-bf37b68befbc req-50d37f40-4a9d-48fe-b333-caa2e2e5c049 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0727351 Dec 09 21:23:16.009870 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3fab362c-2c91-4728-a97e-ff980c4fd1b6 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:16.077705 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-457e4195-2b57-40df-9279-aef4e183393d x-openstack-request-id: req-457e4195-2b57-40df-9279-aef4e183393d {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:16.078561 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d6767f88-ed3b-4855-99f9-59acc491c8cd", "name": "network-vif-plugged", "status": "completed", "tag": "1af41bb4-4236-45bb-a843-1062b6baf435", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:16.078996 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-457e4195-2b57-40df-9279-aef4e183393d {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:16.079595 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd6767f88-ed3b-4855-99f9-59acc491c8cd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1af41bb4-4236-45bb-a843-1062b6baf435', 'code': 200} Dec 09 21:23:16.124746 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3fab362c-2c91-4728-a97e-ff980c4fd1b6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:16.127757 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3fab362c-2c91-4728-a97e-ff980c4fd1b6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:16.134200 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3fab362c-2c91-4728-a97e-ff980c4fd1b6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:16.264257 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3fab362c-2c91-4728-a97e-ff980c4fd1b6 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 902 time: 1.4285674 Dec 09 21:23:16.269048 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34678) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:16.311504 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2ba14ef4-5dd1-4a13-8134-bef7aa301a7e admin admin] Request body: {'subnet': {'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715', 'cidr': '172.20.0.0/28', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1528769429-subnet', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:23:16.360292 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2ba14ef4-5dd1-4a13-8134-bef7aa301a7e admin admin] Made reservation on behalf of 768655d2ebd74340a90f65fc3007118f for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:23:16.363026 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ba14ef4-5dd1-4a13-8134-bef7aa301a7e admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:16.383714 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fab362c-2c91-4728-a97e-ff980c4fd1b6 admin admin] Pushing event updated for resources: {'Network': ['ID=9b3c0886-168c-4d9c-83a4-145e87393715,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:16.398733 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 9b3c0886-168c-4d9c-83a4-145e87393715 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:23:16.411803 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-b26ee4fa-5242-4dac-99fb-f6c62e05a628 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:16.413614 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-b26ee4fa-5242-4dac-99fb-f6c62e05a628 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 1098 time: 0.2075815 Dec 09 21:23:16.457470 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cdb651cd-4278-43a3-b5b0-4bf1613df449 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:16.575615 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdb651cd-4278-43a3-b5b0-4bf1613df449 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Pushing event deleted for resources: {'Port': ['ID=4eaead15-fa81-43b7-8704-393ca917038c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:16.612449 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-4f40b323-bf18-4a42-bc02-88e542b40d98 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:16.614252 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-4f40b323-bf18-4a42-bc02-88e542b40d98 service neutron] 10.222.0.31 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 908 time: 0.1733973 Dec 09 21:23:16.617136 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6fbdef3-baaa-453e-90e7-9cc2d9b598a0 req-526142c1-3340-4fd8-8fa1-6721bd8b05a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:16.618973 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d6fbdef3-baaa-453e-90e7-9cc2d9b598a0 req-526142c1-3340-4fd8-8fa1-6721bd8b05a9 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=d6767f88-ed3b-4855-99f9-59acc491c8cd HTTP/1.1" status: 200 len: 1098 time: 0.3699906 Dec 09 21:23:16.664611 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37842fb4-91e4-444a-81ca-851296b27db6 req-85cf68c6-323e-42a9-a862-d5c4a9ecdf0e tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:16.666547 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-37842fb4-91e4-444a-81ca-851296b27db6 req-85cf68c6-323e-42a9-a862-d5c4a9ecdf0e tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 946 time: 0.4583361 Dec 09 21:23:16.674078 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-bbb5f263-b9ec-4abe-ae90-80a916fa11f2 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=13499602-258c-4839-b928-17aef0d24310 HTTP/1.1" status: 200 len: 217 time: 0.0441132 Dec 09 21:23:16.766277 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cdb651cd-4278-43a3-b5b0-4bf1613df449 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:16.769614 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cdb651cd-4278-43a3-b5b0-4bf1613df449 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:16.774687 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cdb651cd-4278-43a3-b5b0-4bf1613df449 tempest-ServersTestJSON-1376451205 tempest-ServersTestJSON-1376451205-project] 10.222.0.13 "DELETE /v2.0/floatingips/757e5c65-9ddd-46bb-9620-1e7a796dd3fa HTTP/1.1" status: 204 len: 168 time: 1.5338240 Dec 09 21:23:16.775181 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ba14ef4-5dd1-4a13-8134-bef7aa301a7e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:16.779139 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-09c883e4-e63b-444f-bc94-71ec93092c35 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:16.780176 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34682) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:16.780726 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-09c883e4-e63b-444f-bc94-71ec93092c35 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=eae2438b-9fcc-44ef-a172-6c4911cad13f HTTP/1.1" status: 200 len: 847 time: 0.0981770 Dec 09 21:23:16.806865 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76b31326-682c-4a2b-ac26-56dd9f78e552 req-71de92c8-25d7-486f-b0ad-f1596287b1b4 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:16.808354 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-76b31326-682c-4a2b-ac26-56dd9f78e552 req-71de92c8-25d7-486f-b0ad-f1596287b1b4 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=d6767f88-ed3b-4855-99f9-59acc491c8cd HTTP/1.1" status: 200 len: 946 time: 0.4439166 Dec 09 21:23:16.869994 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-1223ae0d-a0b6-4542-b36f-ef65fde3858f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=04fa749a-9f72-4a2c-a725-feab917f99ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0354729 Dec 09 21:23:16.914067 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ba14ef4-5dd1-4a13-8134-bef7aa301a7e admin admin] Pushing event updated for resources: {'Subnet': ['ID=176a8001-d04b-4c22-9715-06327ff3546d,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:16.924938 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ba14ef4-5dd1-4a13-8134-bef7aa301a7e admin admin] Checking segment: {'id': '2d25d46c-e6fd-49a0-8d61-31fba8f6eefc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:23:16.925307 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ba14ef4-5dd1-4a13-8134-bef7aa301a7e admin admin] Network hostable DHCP agents. Network: 9b3c0886-168c-4d9c-83a4-145e87393715, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:23:17.026369 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ba14ef4-5dd1-4a13-8134-bef7aa301a7e admin admin] Network 9b3c0886-168c-4d9c-83a4-145e87393715 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:23:17.053577 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-3819248b-8942-42b6-9753-d1a482581d2c service neutron] 10.222.0.31 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1694221 Dec 09 21:23:17.059492 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-2ba14ef4-5dd1-4a13-8134-bef7aa301a7e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 9b3c0886-168c-4d9c-83a4-145e87393715) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:23:17.064978 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ba14ef4-5dd1-4a13-8134-bef7aa301a7e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:17.065916 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ba14ef4-5dd1-4a13-8134-bef7aa301a7e admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:17.072304 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e9430d8f-5f8e-41a1-9bfc-6bfc1ef08e6e None None] Network 9b3c0886-168c-4d9c-83a4-145e87393715 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:23:17.078513 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-1211bfa3-2a2b-40e5-a8ea-22258d097c7d service neutron] show failed (client error): The resource could not be found. Dec 09 21:23:17.079521 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-1211bfa3-2a2b-40e5-a8ea-22258d097c7d service neutron] 10.222.0.31 "GET /v2.0/ports/6f6b3fc9-0b99-4cad-869c-ed52dde9578b/bindings/n-h2-713301-27 HTTP/1.1" status: 404 len: 381 time: 0.1410475 Dec 09 21:23:17.126279 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2ba14ef4-5dd1-4a13-8134-bef7aa301a7e admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 865 time: 0.8181982 Dec 09 21:23:17.204300 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34688) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:17.225611 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b84fb045-6b67-4b28-975a-95ebbcf83208 admin admin] Request body: {'router': {'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1528769429-router', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:23:17.282979 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-6ac39a49-7534-4d0e-ab50-d3efc1612168 service neutron] 10.222.0.31 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2142889 Dec 09 21:23:17.283939 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b84fb045-6b67-4b28-975a-95ebbcf83208 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:17.285125 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b84fb045-6b67-4b28-975a-95ebbcf83208 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:17.336884 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d6fbdef3-baaa-453e-90e7-9cc2d9b598a0 req-2c1d4d2b-bc34-40e5-bc88-25e64d8baf15 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6820440 Dec 09 21:23:17.384053 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-37842fb4-91e4-444a-81ca-851296b27db6 req-c04aab71-9f95-48b3-866f-19c8188d46a7 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7007639 Dec 09 21:23:17.454571 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b84fb045-6b67-4b28-975a-95ebbcf83208 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:17.586445 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba3778a0-e738-4565-ad93-6b973aaa3273 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-9b3c0886-168c-4d9c-83a4-145e87393715', 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715', 'project_id': '768655d2ebd74340a90f65fc3007118f', 'fixed_ips': [{'subnet_id': '176a8001-d04b-4c22-9715-06327ff3546d'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:23:17.589081 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ba3778a0-e738-4565-ad93-6b973aaa3273 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:17.595955 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-76b31326-682c-4a2b-ac26-56dd9f78e552 req-4be252e8-f096-4897-8281-a7d6c2fcbaff tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7410707 Dec 09 21:23:17.647823 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-6213c305-e80e-4858-b9b0-9986c6e57866 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:17.650354 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-6213c305-e80e-4858-b9b0-9986c6e57866 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd&tenant_id=857de64ecc3946e3b92655f639d782df HTTP/1.1" status: 200 len: 1101 time: 0.2526715 Dec 09 21:23:17.712165 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] Request body: {'port': {'binding:host_id': 'n-h2-713301-27', 'device_owner': 'compute:nova'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:23:17.965745 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-ba3778a0-e738-4565-ad93-6b973aaa3273 None None] Allocated IP 172.20.0.2 (9b3c0886-168c-4d9c-83a4-145e87393715/176a8001-d04b-4c22-9715-06327ff3546d/b707cd85-774f-4b55-8f13-4dfb4ce90ff5) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:23:18.062591 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:18.225776 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b84fb045-6b67-4b28-975a-95ebbcf83208 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:18.422090 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ba3778a0-e738-4565-ad93-6b973aaa3273 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:18.433970 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ba3778a0-e738-4565-ad93-6b973aaa3273 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:18.492248 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba3778a0-e738-4565-ad93-6b973aaa3273 None None] Pushing event updated for resources: {'Port': ['ID=b707cd85-774f-4b55-8f13-4dfb4ce90ff5,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:18.494893 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5366b98c-20cc-41fe-923e-9c317bc79e5f req-79f1dcf8-eb50-4213-9cbe-c47cdaf4fe43 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:18.496713 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5366b98c-20cc-41fe-923e-9c317bc79e5f req-79f1dcf8-eb50-4213-9cbe-c47cdaf4fe43 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 949 time: 0.7285638 Dec 09 21:23:18.519623 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba3778a0-e738-4565-ad93-6b973aaa3273 None None] Network 9b3c0886-168c-4d9c-83a4-145e87393715 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:23:18.532505 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-ba3778a0-e738-4565-ad93-6b973aaa3273 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:23:18.535760 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba3778a0-e738-4565-ad93-6b973aaa3273 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:23:18.587725 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b83537c0-15d9-4155-93fb-0d110b5baddc req-34ffe998-5553-4e9f-9e9c-2c1672bce697 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 210 time: 0.0895500 Dec 09 21:23:18.640471 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-ba3778a0-e738-4565-ad93-6b973aaa3273 None None] Attempting to bind port b707cd85-774f-4b55-8f13-4dfb4ce90ff5 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:23:18.641131 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-ba3778a0-e738-4565-ad93-6b973aaa3273 None None] Attempting to bind port b707cd85-774f-4b55-8f13-4dfb4ce90ff5 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '2d25d46c-e6fd-49a0-8d61-31fba8f6eefc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:23:18.641270 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba3778a0-e738-4565-ad93-6b973aaa3273 None None] Attempting to bind port b707cd85-774f-4b55-8f13-4dfb4ce90ff5 on network 9b3c0886-168c-4d9c-83a4-145e87393715 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:23:18.653244 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba3778a0-e738-4565-ad93-6b973aaa3273 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 23, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:23:18.653638 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba3778a0-e738-4565-ad93-6b973aaa3273 None None] Checking segment: {'id': '2d25d46c-e6fd-49a0-8d61-31fba8f6eefc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:23:18.654053 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ba3778a0-e738-4565-ad93-6b973aaa3273 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:18.656669 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ba3778a0-e738-4565-ad93-6b973aaa3273 None None] Bound using segment: {'id': '2d25d46c-e6fd-49a0-8d61-31fba8f6eefc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:23:18.657199 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-ba3778a0-e738-4565-ad93-6b973aaa3273 None None] Bound port: b707cd85-774f-4b55-8f13-4dfb4ce90ff5, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2d25d46c-e6fd-49a0-8d61-31fba8f6eefc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:23:18.657606 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ba3778a0-e738-4565-ad93-6b973aaa3273 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:18.813745 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ba3778a0-e738-4565-ad93-6b973aaa3273 None None] For port b707cd85-774f-4b55-8f13-4dfb4ce90ff5, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:23:18.828536 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ba3778a0-e738-4565-ad93-6b973aaa3273 None None] For port b707cd85-774f-4b55-8f13-4dfb4ce90ff5, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b707cd85-774f-4b55-8f13-4dfb4ce90ff5,segment=NetworkSegment(2d25d46c-e6fd-49a0-8d61-31fba8f6eefc),segment_id=2d25d46c-e6fd-49a0-8d61-31fba8f6eefc)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:23:18.840088 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ba3778a0-e738-4565-ad93-6b973aaa3273 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:18.852119 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b84fb045-6b67-4b28-975a-95ebbcf83208 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:18.907165 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5366b98c-20cc-41fe-923e-9c317bc79e5f req-fdc30e1c-0498-4bfa-b49c-bd2d2efe56aa tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3733380 Dec 09 21:23:18.920632 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b84fb045-6b67-4b28-975a-95ebbcf83208 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:18.965506 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c67c91f4-ceaf-4d4a-a072-bd51ddb7a4cd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:18.995250 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba3778a0-e738-4565-ad93-6b973aaa3273 None None] Pushing event updated for resources: {'Port': ['ID=b707cd85-774f-4b55-8f13-4dfb4ce90ff5,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:19.180629 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-b84fb045-6b67-4b28-975a-95ebbcf83208 admin admin] Allocated IP 172.25.3.42 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/040a0b14-be1d-4499-a020-cb7c6ac7914f) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:23:19.301609 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de249e9d-4c50-4322-ab4f-de625a727122 req-dcb22c7e-524d-4b32-a5dd-56ede9f53ac7 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:19.309004 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de249e9d-4c50-4322-ab4f-de625a727122 req-dcb22c7e-524d-4b32-a5dd-56ede9f53ac7 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 946 time: 0.3304393 Dec 09 21:23:19.373961 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b84fb045-6b67-4b28-975a-95ebbcf83208 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:19.381079 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2e7ec2f-a613-4985-81a8-d58f881b602c req-e5aa28e3-b7c3-46d2-8124-6280f2d612c5 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:19.384531 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2e7ec2f-a613-4985-81a8-d58f881b602c req-e5aa28e3-b7c3-46d2-8124-6280f2d612c5 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=d6767f88-ed3b-4855-99f9-59acc491c8cd HTTP/1.1" status: 200 len: 946 time: 0.3393373 Dec 09 21:23:19.431546 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b84fb045-6b67-4b28-975a-95ebbcf83208 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:19.439244 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de249e9d-4c50-4322-ab4f-de625a727122 req-d5e36fa2-81cb-4454-9b2e-0e262b0eeec9 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1293733 Dec 09 21:23:19.501748 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b84fb045-6b67-4b28-975a-95ebbcf83208 admin admin] Pushing event updated for resources: {'Port': ['ID=040a0b14-be1d-4499-a020-cb7c6ac7914f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:19.524796 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b84fb045-6b67-4b28-975a-95ebbcf83208 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:23:19.527215 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-b84fb045-6b67-4b28-975a-95ebbcf83208 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:23:19.529790 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] For port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:19.532771 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b84fb045-6b67-4b28-975a-95ebbcf83208 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:23:19.639180 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2e7ec2f-a613-4985-81a8-d58f881b602c req-a52f4edd-f56d-47e4-94e8-424c9eef4f77 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2101889 Dec 09 21:23:19.830235 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] For port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:23:19.883521 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:19.899471 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] Transition to ACTIVE for port object 6f6b3fc9-0b99-4cad-869c-ed52dde9578b will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:23:19.907378 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7604cfe7-6a20-4212-ac7d-57d16969b9fd', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '6f6b3fc9-0b99-4cad-869c-ed52dde9578b'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:19.910202 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-507ffff8-b7e9-4508-86e8-e08b387b36a6" -d '{"events": [{"server_uuid": "7604cfe7-6a20-4212-ac7d-57d16969b9fd", "name": "network-vif-unplugged", "status": "completed", "tag": "6f6b3fc9-0b99-4cad-869c-ed52dde9578b"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:19.922261 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c99f47de-c038-413f-8dae-5c7d7539ce67 req-82138f0a-16de-4c50-a14a-cd996c0eafc8 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 210 time: 0.1960320 Dec 09 21:23:19.963149 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:20.070633 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b84fb045-6b67-4b28-975a-95ebbcf83208 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:20.147391 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] No DVR routers for this DVR port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:23:20.337717 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] Pushing event updated for resources: {'Port': ['ID=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,revision_number=6']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:20.389007 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] Attempting to bind port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:23:20.389539 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] Attempting to bind port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:23:20.389907 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] Attempting to bind port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:23:20.444300 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] Port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:23:20.444759 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] Attempting to bind port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:23:20.535185 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 22, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:23:20.535611 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:23:20.535978 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:23:20.536438 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] Bound port: 6f6b3fc9-0b99-4cad-869c-ed52dde9578b, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:23:20.537094 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:20.599655 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-c67c91f4-ceaf-4d4a-a072-bd51ddb7a4cd admin admin] Deleting port aada448e-8a62-400c-91ba-1ae577560497 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:23:20.600486 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c67c91f4-ceaf-4d4a-a072-bd51ddb7a4cd admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:20.619810 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b84fb045-6b67-4b28-975a-95ebbcf83208 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:20.797607 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-78b4a823-9e69-402a-961d-c2ec76de0e0a x-openstack-request-id: req-78b4a823-9e69-402a-961d-c2ec76de0e0a {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:20.798386 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7604cfe7-6a20-4212-ac7d-57d16969b9fd", "name": "network-vif-unplugged", "status": "completed", "tag": "6f6b3fc9-0b99-4cad-869c-ed52dde9578b", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:20.798857 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-78b4a823-9e69-402a-961d-c2ec76de0e0a {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:20.799950 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7604cfe7-6a20-4212-ac7d-57d16969b9fd', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '6f6b3fc9-0b99-4cad-869c-ed52dde9578b', 'code': 200} Dec 09 21:23:20.872910 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28ba8153-92e8-42e0-a5bc-37f367b6ca6c None None] Network 9b3c0886-168c-4d9c-83a4-145e87393715 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:23:20.898495 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f25c925d-4e2e-46f5-9381-f85c7ee703d3 req-bd2f47e2-9eca-4733-b7a7-fcf194e926d5 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:20.910753 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f25c925d-4e2e-46f5-9381-f85c7ee703d3 req-bd2f47e2-9eca-4733-b7a7-fcf194e926d5 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 947 time: 0.4725287 Dec 09 21:23:21.038658 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b84fb045-6b67-4b28-975a-95ebbcf83208 admin admin] Router 88041dd4-3b62-47ec-ab19-cf438d19e15b is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:23:21.082469 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e559b0d9-fec8-4c86-b0c8-c87300dea7ba None None] Provisioning complete for port b707cd85-774f-4b55-8f13-4dfb4ce90ff5 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:23:21.082811 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e559b0d9-fec8-4c86-b0c8-c87300dea7ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:21.170559 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-c67c91f4-ceaf-4d4a-a072-bd51ddb7a4cd admin admin] For port aada448e-8a62-400c-91ba-1ae577560497, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=aada448e-8a62-400c-91ba-1ae577560497,segment=NetworkSegment(6827180a-5aaf-4697-a7f8-e56a6f614fc7),segment_id=6827180a-5aaf-4697-a7f8-e56a6f614fc7)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:21.171352 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c67c91f4-ceaf-4d4a-a072-bd51ddb7a4cd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:21.179013 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b707cd85-774f-4b55-8f13-4dfb4ce90ff5 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:23:21.187187 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-c67c91f4-ceaf-4d4a-a072-bd51ddb7a4cd admin admin] Calling delete_port for aada448e-8a62-400c-91ba-1ae577560497 owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:23:21.257320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b84fb045-6b67-4b28-975a-95ebbcf83208 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:23:21.283113 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f25c925d-4e2e-46f5-9381-f85c7ee703d3 req-f7b7503a-15fc-4aa8-9324-bbd72599d3cf tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3675404 Dec 09 21:23:21.284713 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] Sync routers for ids ['88041dd4-3b62-47ec-ab19-cf438d19e15b'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:23:21.287476 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b84fb045-6b67-4b28-975a-95ebbcf83208 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:21.289988 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b84fb045-6b67-4b28-975a-95ebbcf83208 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 940 time: 4.0838394 Dec 09 21:23:21.294417 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34760) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:21.308602 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] For port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:23:21.323933 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] For port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:23:21.360508 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6f6b3fc9-0b99-4cad-869c-ed52dde9578b no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:23:21.374213 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:21.412219 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-641b0179-5699-452f-8712-c4f7449817a2 req-a260d65b-b9cf-4cf1-bf0e-21b9330a5985 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:21.425335 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-641b0179-5699-452f-8712-c4f7449817a2 req-a260d65b-b9cf-4cf1-bf0e-21b9330a5985 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 946 time: 0.4207344 Dec 09 21:23:21.447997 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] Routers {'88041dd4-3b62-47ec-ab19-cf438d19e15b'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:23:21.448711 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:23:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['88041dd4-3b62-47ec-ab19-cf438d19e15b'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:21.583228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6f6b3fc9-0b99-4cad-869c-ed52dde9578b not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:23:21.602297 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-641b0179-5699-452f-8712-c4f7449817a2 req-a5a66713-cb5d-4c2b-9248-c885084835fb tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1730175 Dec 09 21:23:21.680648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port b707cd85-774f-4b55-8f13-4dfb4ce90ff5 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:23:21.681576 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:21.746913 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e559b0d9-fec8-4c86-b0c8-c87300dea7ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:21.798365 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b303b1d-c1e1-4a86-b9dd-0121dc2e3364 req-80c45e95-403c-4846-a018-095f071f8b9c tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=5105efab-9ee1-4a74-9a45-e77c38549362 HTTP/1.1" status: 200 len: 210 time: 0.2489803 Dec 09 21:23:21.800438 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:21.801370 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:21.803056 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] 10.222.0.10 "PUT /v2.0/ports/6f6b3fc9-0b99-4cad-869c-ed52dde9578b HTTP/1.1" status: 200 len: 1096 time: 4.1092155 Dec 09 21:23:21.863695 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb155e7f-0b6f-49b9-baf0-2c97ba29212f service neutron] Pushing event updated for resources: {'Port': ['ID=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,revision_number=7']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:21.927390 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e559b0d9-fec8-4c86-b0c8-c87300dea7ba None None] For port b707cd85-774f-4b55-8f13-4dfb4ce90ff5, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b707cd85-774f-4b55-8f13-4dfb4ce90ff5,segment=NetworkSegment(2d25d46c-e6fd-49a0-8d61-31fba8f6eefc),segment_id=2d25d46c-e6fd-49a0-8d61-31fba8f6eefc)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:21.963852 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e559b0d9-fec8-4c86-b0c8-c87300dea7ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:22.035147 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c67c91f4-ceaf-4d4a-a072-bd51ddb7a4cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:22.089756 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e559b0d9-fec8-4c86-b0c8-c87300dea7ba None None] Pushing event updated for resources: {'Port': ['ID=b707cd85-774f-4b55-8f13-4dfb4ce90ff5,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:22.108234 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c67c91f4-ceaf-4d4a-a072-bd51ddb7a4cd admin admin] Pushing event deleted for resources: {'Port': ['ID=aada448e-8a62-400c-91ba-1ae577560497,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:22.215279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] Set router 88041dd4-3b62-47ec-ab19-cf438d19e15b gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:23:22.330387 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7d639124-5cde-4bb4-b0da-d383cffa34e3 None None] Provisioning complete for port b707cd85-774f-4b55-8f13-4dfb4ce90ff5 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:23:22.330755 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7d639124-5cde-4bb4-b0da-d383cffa34e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:22.342047 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-125b4972-2fe0-4cda-baee-79056f2427a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:22.362209 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-be36f4e8-230b-4fc4-bc86-cc9f7f1f694c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:22.363876 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-be36f4e8-230b-4fc4-bc86-cc9f7f1f694c service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 1099 time: 0.3858242 Dec 09 21:23:22.507162 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-227f0574-a3a1-4a7e-a0a9-56c333e040ee req-9609596e-427d-4294-8c62-9a85a6315b56 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:22.508774 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-227f0574-a3a1-4a7e-a0a9-56c333e040ee req-9609596e-427d-4294-8c62-9a85a6315b56 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/ports?device_id=63d23827-0eb3-4c4c-87f7-698524a008f5 HTTP/1.1" status: 200 len: 949 time: 0.2258263 Dec 09 21:23:22.591085 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-125b4972-2fe0-4cda-baee-79056f2427a6 admin admin] Allocated IP 172.20.0.1 (9b3c0886-168c-4d9c-83a4-145e87393715/176a8001-d04b-4c22-9715-06327ff3546d/047fd970-b4fd-4fa7-81e7-fba0167dbce6) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:23:22.592225 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcf6970b-9e15-4dc7-a5a9-22991e5e89f6 req-77fb4ba6-75ef-4909-8c32-423e406c0700 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:22.599799 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dcf6970b-9e15-4dc7-a5a9-22991e5e89f6 req-77fb4ba6-75ef-4909-8c32-423e406c0700 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=d6767f88-ed3b-4855-99f9-59acc491c8cd HTTP/1.1" status: 200 len: 946 time: 0.1969454 Dec 09 21:23:22.660343 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1528769429-router', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42'}], 'enable_snat': True}, 'gw_port_id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:23:17Z', 'updated_at': '2021-12-09T21:23:19Z', 'revision_number': 3, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'gw_port': {'id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:c0:45:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:23:18Z', 'updated_at': '2021-12-09T21:23:19Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:22.690981 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-1d374dca-d13a-4162-9baa-30d441050a02 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:22.692503 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-1d374dca-d13a-4162-9baa-30d441050a02 service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.3063231 Dec 09 21:23:22.704554 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] Checking router: 88041dd4-3b62-47ec-ab19-cf438d19e15b for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:23:22.705180 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] Updating router 88041dd4-3b62-47ec-ab19-cf438d19e15b port 040a0b14-be1d-4499-a020-cb7c6ac7914f binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:23:22.723966 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-227f0574-a3a1-4a7e-a0a9-56c333e040ee req-cab6ada6-97b2-442b-971d-a3b69ba3b7e3 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/security-groups?id=24094cbf-e652-478e-bb06-edc8eb774ee3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1801045 Dec 09 21:23:22.734100 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-125b4972-2fe0-4cda-baee-79056f2427a6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:22.768585 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:22.784975 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-125b4972-2fe0-4cda-baee-79056f2427a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:22.785270 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-2bf45059-7f05-4bcd-a269-a22d770ba8e8 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.12&port_id=6f6b3fc9-0b99-4cad-869c-ed52dde9578b HTTP/1.1" status: 200 len: 217 time: 0.0835226 Dec 09 21:23:22.786173 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c67c91f4-ceaf-4d4a-a072-bd51ddb7a4cd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:22.820125 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dcf6970b-9e15-4dc7-a5a9-22991e5e89f6 req-1121f3a8-2d93-4728-ba37-5dd2c497716f tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2176943 Dec 09 21:23:22.821011 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7604cfe7-6a20-4212-ac7d-57d16969b9fd', 'tag': '6f6b3fc9-0b99-4cad-869c-ed52dde9578b'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:22.823662 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e2d3a05d-9446-4d51-b379-1e2bd38c5ce3" -d '{"events": [{"name": "network-changed", "server_uuid": "7604cfe7-6a20-4212-ac7d-57d16969b9fd", "tag": "6f6b3fc9-0b99-4cad-869c-ed52dde9578b"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:22.857907 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-125b4972-2fe0-4cda-baee-79056f2427a6 admin admin] Network 9b3c0886-168c-4d9c-83a4-145e87393715 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:23:22.862436 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-125b4972-2fe0-4cda-baee-79056f2427a6 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:23:22.865142 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-125b4972-2fe0-4cda-baee-79056f2427a6 admin admin] Pushing event updated for resources: {'Port': ['ID=047fd970-b4fd-4fa7-81e7-fba0167dbce6,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:22.874188 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-125b4972-2fe0-4cda-baee-79056f2427a6 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:23:22.927900 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-125b4972-2fe0-4cda-baee-79056f2427a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:23.175161 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:23.187843 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b707cd85-774f-4b55-8f13-4dfb4ce90ff5 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:23:23.206535 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-125b4972-2fe0-4cda-baee-79056f2427a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:23.231169 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:23.350650 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] Attempting to bind port 040a0b14-be1d-4499-a020-cb7c6ac7914f on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:23:23.351041 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] Attempting to bind port 040a0b14-be1d-4499-a020-cb7c6ac7914f by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:23:23.351405 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] Attempting to bind port 040a0b14-be1d-4499-a020-cb7c6ac7914f on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:23:23.365568 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 23, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:23:23.365996 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:23:23.366706 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:23.366949 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:23:23.368742 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] Bound port: 040a0b14-be1d-4499-a020-cb7c6ac7914f, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:23:23.368742 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:23.377540 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1af41bb4-4236-45bb-a843-1062b6baf435 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:23:23.408259 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-125b4972-2fe0-4cda-baee-79056f2427a6 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:23.421756 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-125b4972-2fe0-4cda-baee-79056f2427a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:23.436223 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-16d07e07-837d-4a10-b84a-3d62857df2ae None None] Provisioning complete for port 047fd970-b4fd-4fa7-81e7-fba0167dbce6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:23:23.437027 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-16d07e07-837d-4a10-b84a-3d62857df2ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:23.474946 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d17cada0-ed2f-4f89-b580-4f3cb19dc93f None None] Pushing event updated for resources: {'Port': ['ID=040a0b14-be1d-4499-a020-cb7c6ac7914f,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:23.480674 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-16d07e07-837d-4a10-b84a-3d62857df2ae None None] Port 047fd970-b4fd-4fa7-81e7-fba0167dbce6 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:23:23.530197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-125b4972-2fe0-4cda-baee-79056f2427a6 admin admin] Pushing event updated for resources: {'Port': ['ID=047fd970-b4fd-4fa7-81e7-fba0167dbce6,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:23.540863 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-125b4972-2fe0-4cda-baee-79056f2427a6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:23.545412 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port b707cd85-774f-4b55-8f13-4dfb4ce90ff5 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:23:23.546446 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:23.564662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7ec143e-f7fb-4188-8ea4-fce5176c6ddd req-3e93c581-dbb5-4d10-a7ec-f98e0fdf79f7 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:23.567625 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7ec143e-f7fb-4188-8ea4-fce5176c6ddd req-3e93c581-dbb5-4d10-a7ec-f98e0fdf79f7 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 947 time: 0.7326198 Dec 09 21:23:23.568959 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] For port 040a0b14-be1d-4499-a020-cb7c6ac7914f, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:23:23.588284 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-1f616f88-6ad8-4805-ab90-26f11b0e5103 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:23.589837 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-1f616f88-6ad8-4805-ab90-26f11b0e5103 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.7927542 Dec 09 21:23:23.647772 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] For port 040a0b14-be1d-4499-a020-cb7c6ac7914f, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=040a0b14-be1d-4499-a020-cb7c6ac7914f,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:23:23.662757 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:23.673958 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b3b1413-b253-4f4b-88eb-4081960be212 req-bfe9e6a2-7f7a-476c-a1eb-c5d17b883044 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:23.683693 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b3b1413-b253-4f4b-88eb-4081960be212 req-bfe9e6a2-7f7a-476c-a1eb-c5d17b883044 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 946 time: 0.7256050 Dec 09 21:23:23.695202 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 1af41bb4-4236-45bb-a843-1062b6baf435, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1af41bb4-4236-45bb-a843-1062b6baf435,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:23.721757 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-125b4972-2fe0-4cda-baee-79056f2427a6 admin admin] Network 9b3c0886-168c-4d9c-83a4-145e87393715 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:23:23.723383 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-125b4972-2fe0-4cda-baee-79056f2427a6 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:23:23.733644 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '1af41bb4-4236-45bb-a843-1062b6baf435', 'network_id': '8e0b26d7-eefe-4c85-b535-944f3c15f0f6', 'port_id': '1af41bb4-4236-45bb-a843-1062b6baf435', 'mac_address': 'fa:16:3e:6c:92:d4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 122, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '63e7603a-bb11-4d1a-8d84-55456d81931c', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:23:23.846486 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] Routers {'88041dd4-3b62-47ec-ab19-cf438d19e15b'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:23:23.847124 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:23:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['88041dd4-3b62-47ec-ab19-cf438d19e15b'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:23.915228 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-35e723eb-4a44-4531-8c26-b43431f9337b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:23.920567 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-35e723eb-4a44-4531-8c26-b43431f9337b service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.3115942 Dec 09 21:23:23.930973 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:23:23.938176 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7ec143e-f7fb-4188-8ea4-fce5176c6ddd req-b2e1d7b6-b984-436f-95f6-61284bd4f583 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3629313 Dec 09 21:23:24.008363 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-125b4972-2fe0-4cda-baee-79056f2427a6 admin admin] Router 88041dd4-3b62-47ec-ab19-cf438d19e15b has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:23:24.057634 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b3b1413-b253-4f4b-88eb-4081960be212 req-24fc0b8c-fdd4-4c4f-8b04-39ec467e6b5c tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3721826 Dec 09 21:23:24.156910 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2fcc8653-226c-4e9c-b987-8c8c2898091f x-openstack-request-id: req-2fcc8653-226c-4e9c-b987-8c8c2898091f {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:24.157411 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7604cfe7-6a20-4212-ac7d-57d16969b9fd", "tag": "6f6b3fc9-0b99-4cad-869c-ed52dde9578b", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:24.157750 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-2fcc8653-226c-4e9c-b987-8c8c2898091f {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:24.158249 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7604cfe7-6a20-4212-ac7d-57d16969b9fd', 'tag': '6f6b3fc9-0b99-4cad-869c-ed52dde9578b', 'status': 'completed', 'code': 200} Dec 09 21:23:24.309014 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d17cada0-ed2f-4f89-b580-4f3cb19dc93f None None] Pushing event updated for resources: {'Port': ['ID=040a0b14-be1d-4499-a020-cb7c6ac7914f,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:24.323911 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:24.356873 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 1af41bb4-4236-45bb-a843-1062b6baf435 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:23:24.385486 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9cc98569-aa2e-45e8-b010-66f559b76570 None None] Provisioning complete for port 047fd970-b4fd-4fa7-81e7-fba0167dbce6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:23:24.386120 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9cc98569-aa2e-45e8-b010-66f559b76570 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:24.476799 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9cc98569-aa2e-45e8-b010-66f559b76570 None None] Port 047fd970-b4fd-4fa7-81e7-fba0167dbce6 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:23:24.480432 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c67c91f4-ceaf-4d4a-a072-bd51ddb7a4cd admin admin] Router a54b1faf-ab53-4950-be39-e5e79b3d7ed9 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:23:24.482889 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-2c3b7402-d543-45da-a09d-f9940640302c service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5272732 Dec 09 21:23:24.505159 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2d3a05d-9446-4d51-b379-1e2bd38c5ce3 req-178781a2-98bb-49bb-8381-0154473227a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:24.506761 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2d3a05d-9446-4d51-b379-1e2bd38c5ce3 req-178781a2-98bb-49bb-8381-0154473227a0 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 1099 time: 0.2805216 Dec 09 21:23:24.515064 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62603495-14e9-4e94-b301-d6fcc7e64c45 req-69824038-a865-4734-9f89-6bca09d9c0c6 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:24.523741 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-62603495-14e9-4e94-b301-d6fcc7e64c45 req-69824038-a865-4734-9f89-6bca09d9c0c6 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=d6767f88-ed3b-4855-99f9-59acc491c8cd HTTP/1.1" status: 200 len: 946 time: 0.1406410 Dec 09 21:23:24.576988 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 1af41bb4-4236-45bb-a843-1062b6baf435, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1af41bb4-4236-45bb-a843-1062b6baf435,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:24.595809 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:24.672086 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] Set router 88041dd4-3b62-47ec-ab19-cf438d19e15b gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:23:24.693211 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04f5b1eb-ba3c-417a-b11f-08b5ebd1a3ee req-1fee74da-3e7f-4389-b5f0-d6d8ac8827ec service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1979036 Dec 09 21:23:24.697701 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-125b4972-2fe0-4cda-baee-79056f2427a6 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:23:24.703193 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-125b4972-2fe0-4cda-baee-79056f2427a6 admin admin] 10.222.0.13 "PUT /v2.0/routers/88041dd4-3b62-47ec-ab19-cf438d19e15b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4074740 Dec 09 21:23:24.786728 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['1af41bb4-4236-45bb-a843-1062b6baf435'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:23:24.895521 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=1af41bb4-4236-45bb-a843-1062b6baf435,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:24.932808 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-62603495-14e9-4e94-b301-d6fcc7e64c45 req-a20c49eb-6b44-4be0-b17b-06230a1f47e8 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4082212 Dec 09 21:23:25.010937 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c67c91f4-ceaf-4d4a-a072-bd51ddb7a4cd admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:23:25.021341 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef1025b8-f165-4999-af54-f8cba9499722 None None] Sync routers for ids ['a54b1faf-ab53-4950-be39-e5e79b3d7ed9'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:23:25.024654 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c67c91f4-ceaf-4d4a-a072-bd51ddb7a4cd admin admin] 10.222.0.13 "PUT /v2.0/routers/a54b1faf-ab53-4950-be39-e5e79b3d7ed9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 8.2430401 Dec 09 21:23:25.027195 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34864) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:25.031388 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2d3a05d-9446-4d51-b379-1e2bd38c5ce3 req-03ae95a0-b337-46ca-8b3e-43c5e39d08fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:25.033436 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2d3a05d-9446-4d51-b379-1e2bd38c5ce3 req-03ae95a0-b337-46ca-8b3e-43c5e39d08fa service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.4921565 Dec 09 21:23:25.039695 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef1025b8-f165-4999-af54-f8cba9499722 None None] Routers {'a54b1faf-ab53-4950-be39-e5e79b3d7ed9'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:23:25.039840 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2d3a05d-9446-4d51-b379-1e2bd38c5ce3 req-97e2fa49-2482-4a43-ac52-b62af63e83d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:25.041749 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2d3a05d-9446-4d51-b379-1e2bd38c5ce3 req-97e2fa49-2482-4a43-ac52-b62af63e83d3 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 1099 time: 0.2180467 Dec 09 21:23:25.044204 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-ef1025b8-f165-4999-af54-f8cba9499722 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:23:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a54b1faf-ab53-4950-be39-e5e79b3d7ed9'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:25.090043 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2d3a05d-9446-4d51-b379-1e2bd38c5ce3 req-0505d1e3-8163-4cf4-85b6-d2f48e879e6d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.12&port_id=6f6b3fc9-0b99-4cad-869c-ed52dde9578b HTTP/1.1" status: 200 len: 217 time: 0.0472088 Dec 09 21:23:25.182080 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-ef1025b8-f165-4999-af54-f8cba9499722 None None] Set router a54b1faf-ab53-4950-be39-e5e79b3d7ed9 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:23:25.230189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 66544e42-b228-4e80-9ed2-bc699bb1993e no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:23:25.256822 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99609c6c-1e50-4baf-b5e7-edf7bae7b95d admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:25.287049 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1528769429-router', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42'}], 'enable_snat': True}, 'gw_port_id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:23:17Z', 'updated_at': '2021-12-09T21:23:23Z', 'revision_number': 4, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'gw_port': {'id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:c0:45:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:23:18Z', 'updated_at': '2021-12-09T21:23:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '047fd970-b4fd-4fa7-81e7-fba0167dbce6', 'name': '', 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'mac_address': 'fa:16:3e:a3:36:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'device_owner': 'network:router_interface', 'standard_attr_id': 705, 'fixed_ips': [{'subnet_id': '176a8001-d04b-4c22-9715-06327ff3546d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:23:22Z', 'updated_at': '2021-12-09T21:23:23Z', 'revision_number': 2, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'subnets': [{'id': '176a8001-d04b-4c22-9715-06327ff3546d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:25.324540 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59ae28ef-7574-4fe7-94ce-09e46bfbbb35 None None] The sync data for ids ['88041dd4-3b62-47ec-ab19-cf438d19e15b'] in n-d-713301-27 is: [{'id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1528769429-router', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42'}], 'enable_snat': True}, 'gw_port_id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:23:17Z', 'updated_at': '2021-12-09T21:23:23Z', 'revision_number': 4, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'gw_port': {'id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:c0:45:f8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:23:18Z', 'updated_at': '2021-12-09T21:23:23Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '047fd970-b4fd-4fa7-81e7-fba0167dbce6', 'name': '', 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'mac_address': 'fa:16:3e:a3:36:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'device_owner': 'network:router_interface', 'standard_attr_id': 705, 'fixed_ips': [{'subnet_id': '176a8001-d04b-4c22-9715-06327ff3546d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:23:22Z', 'updated_at': '2021-12-09T21:23:23Z', 'revision_number': 2, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'subnets': [{'id': '176a8001-d04b-4c22-9715-06327ff3546d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:23:25.402705 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:25.405379 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1af41bb4-4236-45bb-a843-1062b6baf435 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:23:25.448382 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-ef1025b8-f165-4999-af54-f8cba9499722 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'name': 'tempest-ServersTestJSON-799420296-router', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66'}], 'enable_snat': True}, 'gw_port_id': '3d871078-9873-42c7-9428-2cbedc035380', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:20:39Z', 'updated_at': '2021-12-09T21:23:21Z', 'revision_number': 5, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'gw_port': {'id': '3d871078-9873-42c7-9428-2cbedc035380', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:25:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 595, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.66', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:20:42Z', 'updated_at': '2021-12-09T21:20:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:25.472341 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99609c6c-1e50-4baf-b5e7-edf7bae7b95d admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:25.499193 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef1025b8-f165-4999-af54-f8cba9499722 None None] Checking router: a54b1faf-ab53-4950-be39-e5e79b3d7ed9 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:23:25.510280 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef1025b8-f165-4999-af54-f8cba9499722 None None] Routers {'a54b1faf-ab53-4950-be39-e5e79b3d7ed9'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:23:25.511426 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-ef1025b8-f165-4999-af54-f8cba9499722 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:23:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a54b1faf-ab53-4950-be39-e5e79b3d7ed9'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:25.546591 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2d3a05d-9446-4d51-b379-1e2bd38c5ce3 req-7f5741de-bbe4-4d1f-a3bc-f9adaa32c0a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:25.551381 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2d3a05d-9446-4d51-b379-1e2bd38c5ce3 req-7f5741de-bbe4-4d1f-a3bc-f9adaa32c0a1 service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.4493501 Dec 09 21:23:25.559057 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '63d23827-0eb3-4c4c-87f7-698524a008f5', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '66544e42-b228-4e80-9ed2-bc699bb1993e'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:25.562516 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2d3a05d-9446-4d51-b379-1e2bd38c5ce3 req-48d1848f-6963-43b6-8a2d-0b52a49716ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:25.564272 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2d3a05d-9446-4d51-b379-1e2bd38c5ce3 req-48d1848f-6963-43b6-8a2d-0b52a49716ba service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.4391847 Dec 09 21:23:25.564503 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bacd7c0c-f684-4c2c-b053-532c74a9d65b" -d '{"events": [{"server_uuid": "63d23827-0eb3-4c4c-87f7-698524a008f5", "name": "network-vif-unplugged", "status": "completed", "tag": "66544e42-b228-4e80-9ed2-bc699bb1993e"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:25.577824 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-99609c6c-1e50-4baf-b5e7-edf7bae7b95d admin admin] Deleting port 3d871078-9873-42c7-9428-2cbedc035380 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:23:25.578247 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99609c6c-1e50-4baf-b5e7-edf7bae7b95d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:25.603552 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 66544e42-b228-4e80-9ed2-bc699bb1993e, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=66544e42-b228-4e80-9ed2-bc699bb1993e,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:25.606757 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 1af41bb4-4236-45bb-a843-1062b6baf435 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:23:25.608258 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:25.623760 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-ef1025b8-f165-4999-af54-f8cba9499722 None None] Set router a54b1faf-ab53-4950-be39-e5e79b3d7ed9 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:23:25.642908 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2d3a05d-9446-4d51-b379-1e2bd38c5ce3 req-13ceed9b-4d80-4ac0-b7e2-c1e693640fd9 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.12&port_id=6f6b3fc9-0b99-4cad-869c-ed52dde9578b HTTP/1.1" status: 200 len: 217 time: 0.0682201 Dec 09 21:23:25.653792 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:25.698474 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d849e711-c279-41bc-9fa9-521636f8acd0 req-00dbd328-22b0-43b1-bb7e-17e146605e22 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:25.706063 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d849e711-c279-41bc-9fa9-521636f8acd0 req-00dbd328-22b0-43b1-bb7e-17e146605e22 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 947 time: 0.6144531 Dec 09 21:23:25.735555 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-ef1025b8-f165-4999-af54-f8cba9499722 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'name': 'tempest-ServersTestJSON-799420296-router', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:20:39Z', 'updated_at': '2021-12-09T21:23:25Z', 'revision_number': 6, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:25.781294 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef1025b8-f165-4999-af54-f8cba9499722 None None] The sync data for ids ['a54b1faf-ab53-4950-be39-e5e79b3d7ed9'] in n-d-713301-27 is: [{'id': 'a54b1faf-ab53-4950-be39-e5e79b3d7ed9', 'name': 'tempest-ServersTestJSON-799420296-router', 'tenant_id': '9f7c325888174a43bdb0cea626873b0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:20:39Z', 'updated_at': '2021-12-09T21:23:25Z', 'revision_number': 6, 'project_id': '9f7c325888174a43bdb0cea626873b0e', 'gw_port_host': None}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:23:25.786374 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-99609c6c-1e50-4baf-b5e7-edf7bae7b95d admin admin] For port 3d871078-9873-42c7-9428-2cbedc035380, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=3d871078-9873-42c7-9428-2cbedc035380,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:25.786851 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99609c6c-1e50-4baf-b5e7-edf7bae7b95d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:25.841099 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-99609c6c-1e50-4baf-b5e7-edf7bae7b95d admin admin] Calling delete_port for 3d871078-9873-42c7-9428-2cbedc035380 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:23:25.866079 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:25.883349 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-d2df9529-2c0d-4047-b0cf-01512801a101 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:25.885733 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=66544e42-b228-4e80-9ed2-bc699bb1993e,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:25.891277 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-d2df9529-2c0d-4047-b0cf-01512801a101 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/networks?id=9b3c0886-168c-4d9c-83a4-145e87393715 HTTP/1.1" status: 200 len: 829 time: 0.7779322 Dec 09 21:23:25.930136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 1af41bb4-4236-45bb-a843-1062b6baf435, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1af41bb4-4236-45bb-a843-1062b6baf435,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:25.931995 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2d3a05d-9446-4d51-b379-1e2bd38c5ce3 req-0081ec9b-4055-4ac7-86f0-93156c46b6dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:25.934038 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2d3a05d-9446-4d51-b379-1e2bd38c5ce3 req-0081ec9b-4055-4ac7-86f0-93156c46b6dc service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.2903125 Dec 09 21:23:25.938265 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:25.950072 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-259377f5-cd29-4d3d-8383-4053030a68cf tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/quotas/768655d2ebd74340a90f65fc3007118f HTTP/1.1" status: 200 len: 375 time: 0.0574229 Dec 09 21:23:26.042967 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=1af41bb4-4236-45bb-a843-1062b6baf435,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:26.076271 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2d3a05d-9446-4d51-b379-1e2bd38c5ce3 req-10d617bb-c5e4-452f-9f54-1a3911341eb1 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1074924 Dec 09 21:23:26.089916 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99609c6c-1e50-4baf-b5e7-edf7bae7b95d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:26.105577 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2d3a05d-9446-4d51-b379-1e2bd38c5ce3 req-65b62907-7863-4a64-97a3-c801d9894d64 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:26.107054 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2d3a05d-9446-4d51-b379-1e2bd38c5ce3 req-65b62907-7863-4a64-97a3-c801d9894d64 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.3906441 Dec 09 21:23:26.134086 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99609c6c-1e50-4baf-b5e7-edf7bae7b95d admin admin] Pushing event deleted for resources: {'Port': ['ID=3d871078-9873-42c7-9428-2cbedc035380,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:26.198274 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d849e711-c279-41bc-9fa9-521636f8acd0 req-0b9a3d0b-c99a-4dd4-8688-95455f061463 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4911520 Dec 09 21:23:26.200369 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99609c6c-1e50-4baf-b5e7-edf7bae7b95d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:26.303776 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-4ee638dc-750f-4e20-92ea-de6c1d9a6f23 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=768655d2ebd74340a90f65fc3007118f&fields=id HTTP/1.1" status: 200 len: 302 time: 0.3523371 Dec 09 21:23:26.359307 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2d3a05d-9446-4d51-b379-1e2bd38c5ce3 req-b6920dc6-11b9-4229-9b72-19cb76974b46 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:26.361389 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2d3a05d-9446-4d51-b379-1e2bd38c5ce3 req-b6920dc6-11b9-4229-9b72-19cb76974b46 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.2424171 Dec 09 21:23:26.372660 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99609c6c-1e50-4baf-b5e7-edf7bae7b95d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:26.375632 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99609c6c-1e50-4baf-b5e7-edf7bae7b95d admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:26.493976 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99609c6c-1e50-4baf-b5e7-edf7bae7b95d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:26.494538 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-99609c6c-1e50-4baf-b5e7-edf7bae7b95d admin admin] Fanout notify agent at l3_agent the message router_deleted on router a54b1faf-ab53-4950-be39-e5e79b3d7ed9 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:23:26.499959 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99609c6c-1e50-4baf-b5e7-edf7bae7b95d admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:26.503407 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-99609c6c-1e50-4baf-b5e7-edf7bae7b95d admin admin] 10.222.0.13 "DELETE /v2.0/routers/a54b1faf-ab53-4950-be39-e5e79b3d7ed9 HTTP/1.1" status: 204 len: 168 time: 1.4729078 Dec 09 21:23:26.503709 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34890) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:26.552818 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-fce71d15-4ba5-43c0-aafd-dcf52279c3b1 admin admin] Deleting subnet 006a974f-ca2f-40a9-b5ee-25ae5235c5b1 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:23:26.560346 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fce71d15-4ba5-43c0-aafd-dcf52279c3b1 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:26.599807 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fce71d15-4ba5-43c0-aafd-dcf52279c3b1 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:26.634291 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2d3a05d-9446-4d51-b379-1e2bd38c5ce3 req-5d000a1d-5cb5-439b-82ed-3037a4468982 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1977744 Dec 09 21:23:26.664824 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2d3a05d-9446-4d51-b379-1e2bd38c5ce3 req-e7bba942-acfb-450f-a601-5a5aab11794e service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5705998 Dec 09 21:23:26.758419 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fce71d15-4ba5-43c0-aafd-dcf52279c3b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:26.784202 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-ff642542-5378-4723-895c-d5c7ad55c24f service neutron] 10.222.0.13 "GET /v2.0/networks/9b3c0886-168c-4d9c-83a4-145e87393715?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4784987 Dec 09 21:23:26.918998 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fce71d15-4ba5-43c0-aafd-dcf52279c3b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:26.978123 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fce71d15-4ba5-43c0-aafd-dcf52279c3b1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=006a974f-ca2f-40a9-b5ee-25ae5235c5b1,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:27.004291 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fce71d15-4ba5-43c0-aafd-dcf52279c3b1 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:27.006688 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6972f9a5-3bf0-4882-b9b9-4457bf132b85 None None] Network 0a4691ff-8eab-4fe6-bec4-b1a20a69fce2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:23:27.009502 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:27.014677 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fce71d15-4ba5-43c0-aafd-dcf52279c3b1 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/006a974f-ca2f-40a9-b5ee-25ae5235c5b1 HTTP/1.1" status: 204 len: 168 time: 0.5094049 Dec 09 21:23:27.020916 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34892) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:27.129527 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:27.153155 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-9c67c7a6-200d-47bf-9a2c-cad18a246b94 service neutron] 10.222.0.13 "GET /v2.0/networks/9b3c0886-168c-4d9c-83a4-145e87393715?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3678062 Dec 09 21:23:27.156517 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 040a0b14-be1d-4499-a020-cb7c6ac7914f up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:23:27.177607 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-094a3ec2-f520-4eb8-ae7e-280196630f11 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:27.188162 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69dafb83-30c3-4f9d-bb08-5684fe62f85f req-51d8f69c-c191-429d-8198-6570f329e944 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:27.189747 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69dafb83-30c3-4f9d-bb08-5684fe62f85f req-51d8f69c-c191-429d-8198-6570f329e944 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 946 time: 0.3748298 Dec 09 21:23:27.196866 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2d3a05d-9446-4d51-b379-1e2bd38c5ce3 req-7428018a-f1b0-43c9-b628-c61b7446b23a service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5468869 Dec 09 21:23:27.246159 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 6f6b3fc9-0b99-4cad-869c-ed52dde9578b details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:23:27.296716 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69dafb83-30c3-4f9d-bb08-5684fe62f85f req-9e4f5334-3d7b-42c5-a56a-faf5af3a8a42 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0988600 Dec 09 21:23:27.384795 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:27.387711 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-094a3ec2-f520-4eb8-ae7e-280196630f11 admin admin] Deleting port 2785f38a-e3ed-4484-b164-42ca4115087e {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:23:27.388029 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-094a3ec2-f520-4eb8-ae7e-280196630f11 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:27.430116 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '6f6b3fc9-0b99-4cad-869c-ed52dde9578b', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '6f6b3fc9-0b99-4cad-869c-ed52dde9578b', 'mac_address': 'fa:16:3e:67:2a:05', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:23:27.446877 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 4425d491-9b2e-48a2-8fb6-ead05da81dba details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:23:27.454215 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1af41bb4-4236-45bb-a843-1062b6baf435 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:23:27.545916 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f906aff2-8bc9-4f22-99bf-e08e2b71c08b x-openstack-request-id: req-f906aff2-8bc9-4f22-99bf-e08e2b71c08b {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:27.546236 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "63d23827-0eb3-4c4c-87f7-698524a008f5", "name": "network-vif-unplugged", "status": "completed", "tag": "66544e42-b228-4e80-9ed2-bc699bb1993e", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:27.546486 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f906aff2-8bc9-4f22-99bf-e08e2b71c08b {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:27.546901 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '63d23827-0eb3-4c4c-87f7-698524a008f5', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '66544e42-b228-4e80-9ed2-bc699bb1993e', 'code': 200} Dec 09 21:23:27.561397 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3844bbcb-ef77-46de-bfb5-2b7981d9fc12 None None] DHCP port deletion for 0a4691ff-8eab-4fe6-bec4-b1a20a69fce2 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:23:27.629891 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-094a3ec2-f520-4eb8-ae7e-280196630f11 admin admin] For port 2785f38a-e3ed-4484-b164-42ca4115087e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2785f38a-e3ed-4484-b164-42ca4115087e,segment=NetworkSegment(6827180a-5aaf-4697-a7f8-e56a6f614fc7),segment_id=6827180a-5aaf-4697-a7f8-e56a6f614fc7)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:27.633076 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-094a3ec2-f520-4eb8-ae7e-280196630f11 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:27.647896 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 040a0b14-be1d-4499-a020-cb7c6ac7914f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:23:27.664959 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-094a3ec2-f520-4eb8-ae7e-280196630f11 admin admin] Calling delete_port for 2785f38a-e3ed-4484-b164-42ca4115087e owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:23:27.672375 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:27.696323 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.resource_extend [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] It took 0.12 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 09 21:23:27.716582 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-10a60924-40e8-4313-a448-757da414b059 req-421f30b5-ad3e-4633-9b7a-c9190a246d48 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/ports?device_id=99185349-bf6b-4cb8-a80b-ebf360aecfbb HTTP/1.1" status: 200 len: 210 time: 0.0673358 Dec 09 21:23:27.747993 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:27.839156 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ad39a24-eb8d-4ba2-bd2f-8fe28d6886fd req-3248f1f2-49aa-409f-b19d-dc248b5fa714 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:27.852624 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-094a3ec2-f520-4eb8-ae7e-280196630f11 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:27.857970 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ad39a24-eb8d-4ba2-bd2f-8fe28d6886fd req-3248f1f2-49aa-409f-b19d-dc248b5fa714 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 947 time: 0.1988041 Dec 09 21:23:27.960770 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-094a3ec2-f520-4eb8-ae7e-280196630f11 admin admin] Pushing event deleted for resources: {'Port': ['ID=2785f38a-e3ed-4484-b164-42ca4115087e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:27.971038 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-094a3ec2-f520-4eb8-ae7e-280196630f11 admin admin] No DVR routers for this DVR port 2785f38a-e3ed-4484-b164-42ca4115087e on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:23:27.986291 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ad39a24-eb8d-4ba2-bd2f-8fe28d6886fd req-b6215f76-83af-4c03-9cf2-a549a9c3402c tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1268814 Dec 09 21:23:28.002965 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6f6b3fc9-0b99-4cad-869c-ed52dde9578b {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:23:28.054560 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:28.111809 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-422d9d8e-3801-4441-ab65-a13acee72082 req-1ad36517-25a5-426c-a39b-7169ae48362d tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:28.121648 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-422d9d8e-3801-4441-ab65-a13acee72082 req-1ad36517-25a5-426c-a39b-7169ae48362d tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=d6767f88-ed3b-4855-99f9-59acc491c8cd HTTP/1.1" status: 200 len: 946 time: 0.0901487 Dec 09 21:23:28.132350 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:28.167020 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-094a3ec2-f520-4eb8-ae7e-280196630f11 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:28.216270 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-422d9d8e-3801-4441-ab65-a13acee72082 req-1701b0f1-38cd-4fb9-9852-0a5ca6c00b32 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0875037 Dec 09 21:23:28.247115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-094a3ec2-f520-4eb8-ae7e-280196630f11 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0a4691ff-8eab-4fe6-bec4-b1a20a69fce2']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:28.270769 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 4425d491-9b2e-48a2-8fb6-ead05da81dba, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=4425d491-9b2e-48a2-8fb6-ead05da81dba,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:28.279468 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-3844bbcb-ef77-46de-bfb5-2b7981d9fc12 None None] Deleting port 2785f38a-e3ed-4484-b164-42ca4115087e {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:23:28.279829 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3844bbcb-ef77-46de-bfb5-2b7981d9fc12 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:28.288837 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-094a3ec2-f520-4eb8-ae7e-280196630f11 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6827180a-5aaf-4697-a7f8-e56a6f614fc7') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:28.289187 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:28.292647 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-094a3ec2-f520-4eb8-ae7e-280196630f11 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6827180a-5aaf-4697-a7f8-e56a6f614fc7') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:28.324205 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:28.387146 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bb6ca3f-b31a-4beb-9916-04d30524b7e3 req-e6cc00f3-d4c2-42dd-b7a9-4a6a6a6fc389 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:28.388722 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3bb6ca3f-b31a-4beb-9916-04d30524b7e3 req-e6cc00f3-d4c2-42dd-b7a9-4a6a6a6fc389 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.31 "GET /v2.0/ports?device_id=d6767f88-ed3b-4855-99f9-59acc491c8cd HTTP/1.1" status: 200 len: 946 time: 0.1302371 Dec 09 21:23:28.393485 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-094a3ec2-f520-4eb8-ae7e-280196630f11 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:28.446114 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-094a3ec2-f520-4eb8-ae7e-280196630f11 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:28.470482 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-094a3ec2-f520-4eb8-ae7e-280196630f11 admin admin] Releasing vlan 145 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:23:28.471898 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-094a3ec2-f520-4eb8-ae7e-280196630f11 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:23:28.478032 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:23:28.630258 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-094a3ec2-f520-4eb8-ae7e-280196630f11 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:28.643544 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-094a3ec2-f520-4eb8-ae7e-280196630f11 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:28.655091 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-094a3ec2-f520-4eb8-ae7e-280196630f11 admin admin] 10.222.0.13 "DELETE /v2.0/networks/0a4691ff-8eab-4fe6-bec4-b1a20a69fce2 HTTP/1.1" status: 204 len: 168 time: 1.6329770 Dec 09 21:23:28.673743 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '4425d491-9b2e-48a2-8fb6-ead05da81dba', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '4425d491-9b2e-48a2-8fb6-ead05da81dba', 'mac_address': 'fa:16:3e:11:c7:48', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.242'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:23:28.688780 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-094a3ec2-f520-4eb8-ae7e-280196630f11 admin admin] Pushing event deleted for resources: {'Network': ['ID=0a4691ff-8eab-4fe6-bec4-b1a20a69fce2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:28.693061 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['6f6b3fc9-0b99-4cad-869c-ed52dde9578b'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:23:28.918516 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 1af41bb4-4236-45bb-a843-1062b6baf435, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1af41bb4-4236-45bb-a843-1062b6baf435,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:28.919717 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-3844bbcb-ef77-46de-bfb5-2b7981d9fc12 None None] For port 2785f38a-e3ed-4484-b164-42ca4115087e, host n-d-713301-27, got binding levels [] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:28.920172 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3844bbcb-ef77-46de-bfb5-2b7981d9fc12 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:28.927071 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:28.946352 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:28.954095 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34958) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:28.970732 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-3844bbcb-ef77-46de-bfb5-2b7981d9fc12 None None] Calling delete_port for 2785f38a-e3ed-4484-b164-42ca4115087e owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:23:29.008646 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.ipam_backend_mixin [None req-3844bbcb-ef77-46de-bfb5-2b7981d9fc12 None None] Port 2785f38a-e3ed-4484-b164-42ca4115087e was not found and therefore no delete operation was performed {{(pid=103439) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 09 21:23:29.017365 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 040a0b14-be1d-4499-a020-cb7c6ac7914f, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=040a0b14-be1d-4499-a020-cb7c6ac7914f,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:29.024239 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3844bbcb-ef77-46de-bfb5-2b7981d9fc12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:29.032344 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:29.034508 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:29.090382 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-3844bbcb-ef77-46de-bfb5-2b7981d9fc12 None None] Network 0a4691ff-8eab-4fe6-bec4-b1a20a69fce2 is not hosted by any dhcp agent {{(pid=103439) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 09 21:23:29.097230 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3844bbcb-ef77-46de-bfb5-2b7981d9fc12 None None] No DVR routers for this DVR port 2785f38a-e3ed-4484-b164-42ca4115087e on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:23:29.109762 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4425d491-9b2e-48a2-8fb6-ead05da81dba {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:23:29.125102 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-93d9ea73-c224-4df7-82e0-3c6dabd3bdb2 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=9f7c325888174a43bdb0cea626873b0e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1690009 Dec 09 21:23:29.128069 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=1af41bb4-4236-45bb-a843-1062b6baf435,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:29.128687 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34960) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:29.210712 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device aada448e-8a62-400c-91ba-1ae577560497 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:23:29.268712 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3844bbcb-ef77-46de-bfb5-2b7981d9fc12 None None] Pushing event deleted for resources: {'Port': ['ID=2785f38a-e3ed-4484-b164-42ca4115087e,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:29.309483 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9bfa34c9-7fee-4d35-b8b1-e9d8e80796b8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:29.326199 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: aada448e-8a62-400c-91ba-1ae577560497 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:23:29.330247 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device aada448e-8a62-400c-91ba-1ae577560497 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:23:29.330247 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 3d871078-9873-42c7-9428-2cbedc035380 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:23:29.351376 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9bfa34c9-7fee-4d35-b8b1-e9d8e80796b8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:29.401081 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 4425d491-9b2e-48a2-8fb6-ead05da81dba, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=4425d491-9b2e-48a2-8fb6-ead05da81dba,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:29.434679 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9bfa34c9-7fee-4d35-b8b1-e9d8e80796b8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:29.441894 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9bfa34c9-7fee-4d35-b8b1-e9d8e80796b8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:29.445505 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9bfa34c9-7fee-4d35-b8b1-e9d8e80796b8 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/3850674a-96dd-4357-ad3f-a74e629c98a6 HTTP/1.1" status: 204 len: 168 time: 0.3026886 Dec 09 21:23:29.454472 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bfa34c9-7fee-4d35-b8b1-e9d8e80796b8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3850674a-96dd-4357-ad3f-a74e629c98a6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:29.473493 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 3d871078-9873-42c7-9428-2cbedc035380 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:23:29.473720 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 3d871078-9873-42c7-9428-2cbedc035380 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:23:29.535746 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] Sync routers for ids ['88041dd4-3b62-47ec-ab19-cf438d19e15b'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:23:29.576929 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd6767f88-ed3b-4855-99f9-59acc491c8cd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1af41bb4-4236-45bb-a843-1062b6baf435'}, {'server_uuid': 'd6767f88-ed3b-4855-99f9-59acc491c8cd', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '1af41bb4-4236-45bb-a843-1062b6baf435'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:29.580623 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9b6c7540-9ddb-4597-b804-2c44f2aa0a19" -d '{"events": [{"server_uuid": "d6767f88-ed3b-4855-99f9-59acc491c8cd", "name": "network-vif-plugged", "status": "completed", "tag": "1af41bb4-4236-45bb-a843-1062b6baf435"}, {"server_uuid": "d6767f88-ed3b-4855-99f9-59acc491c8cd", "name": "network-vif-unplugged", "status": "completed", "tag": "1af41bb4-4236-45bb-a843-1062b6baf435"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:29.584708 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:29.587405 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=040a0b14-be1d-4499-a020-cb7c6ac7914f,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:29.684507 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2785f38a-e3ed-4484-b164-42ca4115087e no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:23:29.693495 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-054a61dd-2e74-479c-8ee9-3eda2e0f4411 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:29.694989 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-054a61dd-2e74-479c-8ee9-3eda2e0f4411 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.10 "GET /v2.0/networks?id=9b3c0886-168c-4d9c-83a4-145e87393715 HTTP/1.1" status: 200 len: 829 time: 0.3632360 Dec 09 21:23:29.749660 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-31d1277c-060a-495f-b7c1-f35ce2682d81 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:29.751783 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-31d1277c-060a-495f-b7c1-f35ce2682d81 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.10 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd&tenant_id=857de64ecc3946e3b92655f639d782df&binding%3Ahost_id=n-h2-713301-27 HTTP/1.1" status: 200 len: 948 time: 1.3620815 Dec 09 21:23:29.766192 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Request body: {'port': {'device_id': '99185349-bf6b-4cb8-a80b-ebf360aecfbb', 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715', 'admin_state_up': True, 'tenant_id': '768655d2ebd74340a90f65fc3007118f'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:23:29.796619 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74c5bd83-8452-4b07-92bc-b492d57787bd req-733e56ca-737b-46ad-b0fa-87c08418ea37 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:29.807808 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-74c5bd83-8452-4b07-92bc-b492d57787bd req-733e56ca-737b-46ad-b0fa-87c08418ea37 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 946 time: 1.3438289 Dec 09 21:23:29.854904 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['4425d491-9b2e-48a2-8fb6-ead05da81dba'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:23:29.899889 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] Routers {'88041dd4-3b62-47ec-ab19-cf438d19e15b'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:23:29.901059 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:23:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['88041dd4-3b62-47ec-ab19-cf438d19e15b'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:29.906035 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5374e189-187d-416d-a1f1-e82f4eea98b8 req-52bd7ef6-9270-4107-ae5e-5fb48e5d8a65 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:29.912356 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5374e189-187d-416d-a1f1-e82f4eea98b8 req-52bd7ef6-9270-4107-ae5e-5fb48e5d8a65 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 948 time: 1.3872762 Dec 09 21:23:30.054382 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-3bb6ca3f-b31a-4beb-9916-04d30524b7e3 req-9b112cd7-9f13-4de8-be78-4abc8430f8b5 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Deleting port 1af41bb4-4236-45bb-a843-1062b6baf435 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:23:30.054783 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3bb6ca3f-b31a-4beb-9916-04d30524b7e3 req-9b112cd7-9f13-4de8-be78-4abc8430f8b5 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:30.102850 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] Set router 88041dd4-3b62-47ec-ab19-cf438d19e15b gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:23:30.387685 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 2785f38a-e3ed-4484-b164-42ca4115087e {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:23:30.388446 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2785f38a-e3ed-4484-b164-42ca4115087e not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:23:30.482153 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-3bb6ca3f-b31a-4beb-9916-04d30524b7e3 req-9b112cd7-9f13-4de8-be78-4abc8430f8b5 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] For port 1af41bb4-4236-45bb-a843-1062b6baf435, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1af41bb4-4236-45bb-a843-1062b6baf435,segment=NetworkSegment(41babb3e-048d-47f5-b92c-d4cf9897cc70),segment_id=41babb3e-048d-47f5-b92c-d4cf9897cc70)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:30.482613 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3bb6ca3f-b31a-4beb-9916-04d30524b7e3 req-9b112cd7-9f13-4de8-be78-4abc8430f8b5 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:30.651572 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Made reservation on behalf of 768655d2ebd74340a90f65fc3007118f for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:23:30.655966 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:30.661957 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=4425d491-9b2e-48a2-8fb6-ead05da81dba,revision_number=9']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:30.710490 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-3bb6ca3f-b31a-4beb-9916-04d30524b7e3 req-9b112cd7-9f13-4de8-be78-4abc8430f8b5 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Calling delete_port for 1af41bb4-4236-45bb-a843-1062b6baf435 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:23:30.820552 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1528769429-router', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42'}], 'enable_snat': True}, 'gw_port_id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:23:17Z', 'updated_at': '2021-12-09T21:23:23Z', 'revision_number': 4, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'gw_port': {'id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:c0:45:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:23:18Z', 'updated_at': '2021-12-09T21:23:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '047fd970-b4fd-4fa7-81e7-fba0167dbce6', 'name': '', 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'mac_address': 'fa:16:3e:a3:36:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'device_owner': 'network:router_interface', 'standard_attr_id': 705, 'fixed_ips': [{'subnet_id': '176a8001-d04b-4c22-9715-06327ff3546d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:23:22Z', 'updated_at': '2021-12-09T21:23:23Z', 'revision_number': 2, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'subnets': [{'id': '176a8001-d04b-4c22-9715-06327ff3546d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:30.898126 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] Checking router: 88041dd4-3b62-47ec-ab19-cf438d19e15b for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:23:30.900710 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] Updating router 88041dd4-3b62-47ec-ab19-cf438d19e15b port 047fd970-b4fd-4fa7-81e7-fba0167dbce6 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:23:30.933135 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Allocated IP 172.20.0.5 (9b3c0886-168c-4d9c-83a4-145e87393715/176a8001-d04b-4c22-9715-06327ff3546d/2f1265f7-0579-475d-9faa-f23ade6ec46b) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:23:30.948945 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:31.084434 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34994) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:31.183289 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5374e189-187d-416d-a1f1-e82f4eea98b8 req-8daba221-1ed4-4b04-b09d-6b81626f18d0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.2103567 Dec 09 21:23:31.252481 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-c95cb1a4-502d-430e-93e6-6e18e3655c2c service neutron] 10.222.0.10 "GET /v2.0/ports/6f6b3fc9-0b99-4cad-869c-ed52dde9578b/bindings/n-h2-713301-27 HTTP/1.1" status: 200 len: 383 time: 1.4274061 Dec 09 21:23:31.274132 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-74c5bd83-8452-4b07-92bc-b492d57787bd req-348b111a-7dab-46c9-a811-284b60c903b6 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.4648008 Dec 09 21:23:31.363981 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-7db2b557-66dd-4304-abab-e2a61c51edee admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1001358866-network', 'tenant_id': '1b7916b634f74760a565cfeaef510cd9'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:23:31.416571 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7db2b557-66dd-4304-abab-e2a61c51edee admin admin] Made reservation on behalf of 1b7916b634f74760a565cfeaef510cd9 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:23:31.419422 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7db2b557-66dd-4304-abab-e2a61c51edee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:31.448212 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7db2b557-66dd-4304-abab-e2a61c51edee admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:31.526946 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:31.594112 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7db2b557-66dd-4304-abab-e2a61c51edee admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:31.600340 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7db2b557-66dd-4304-abab-e2a61c51edee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:31.614043 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 4425d491-9b2e-48a2-8fb6-ead05da81dba up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:23:31.657565 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7db2b557-66dd-4304-abab-e2a61c51edee admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d2724709-ec49-467a-ab5e-5283cd267185,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:31.684741 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7db2b557-66dd-4304-abab-e2a61c51edee admin admin] vlan segment allocate from pool success with {'vlan_id': 101, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:23:31.694376 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 040a0b14-be1d-4499-a020-cb7c6ac7914f up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:23:31.725647 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7db2b557-66dd-4304-abab-e2a61c51edee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:31.727323 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-7db2b557-66dd-4304-abab-e2a61c51edee admin admin] Added segment d383c8e8-889c-4799-8949-cba737586b7e of type vlan for network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb Dec 09 21:23:31.872544 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7db2b557-66dd-4304-abab-e2a61c51edee admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:31.902222 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 4425d491-9b2e-48a2-8fb6-ead05da81dba triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:23:31.903158 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:31.908191 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:31.931325 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7db2b557-66dd-4304-abab-e2a61c51edee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:31.932761 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7db2b557-66dd-4304-abab-e2a61c51edee admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:31.933507 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7db2b557-66dd-4304-abab-e2a61c51edee admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:31.991925 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3bb6ca3f-b31a-4beb-9916-04d30524b7e3 req-9b112cd7-9f13-4de8-be78-4abc8430f8b5 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:32.007533 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 040a0b14-be1d-4499-a020-cb7c6ac7914f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:23:32.008056 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:32.018575 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7db2b557-66dd-4304-abab-e2a61c51edee admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.9329755 Dec 09 21:23:32.023003 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35008) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:32.028664 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9031125-0cc9-4804-9523-612b4ba944c8 req-12b40a29-3be6-4a62-b4d8-0cbc6884ffeb tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/ports?device_id=99185349-bf6b-4cb8-a80b-ebf360aecfbb HTTP/1.1" status: 200 len: 210 time: 0.4971211 Dec 09 21:23:32.035860 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Pushing event updated for resources: {'Port': ['ID=2f1265f7-0579-475d-9faa-f23ade6ec46b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:32.043252 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2e539cf3-24ed-438a-9255-739647d12e59 admin admin] Request body: {'subnet': {'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1001358866-subnet', 'tenant_id': '1b7916b634f74760a565cfeaef510cd9', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:23:32.065188 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-f018d129-ace8-4c8e-8946-8724afc18d2e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:32.072040 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-f018d129-ace8-4c8e-8946-8724afc18d2e service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 1100 time: 0.7409410 Dec 09 21:23:32.146408 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 356 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d0cea620-cd26-40d8-ac42-422afa4c5c7d x-openstack-request-id: req-d0cea620-cd26-40d8-ac42-422afa4c5c7d {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:32.146780 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d6767f88-ed3b-4855-99f9-59acc491c8cd", "name": "network-vif-plugged", "status": "completed", "tag": "1af41bb4-4236-45bb-a843-1062b6baf435", "code": 200}, {"server_uuid": "d6767f88-ed3b-4855-99f9-59acc491c8cd", "name": "network-vif-unplugged", "status": "completed", "tag": "1af41bb4-4236-45bb-a843-1062b6baf435", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:32.147596 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-d0cea620-cd26-40d8-ac42-422afa4c5c7d {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:32.150031 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd6767f88-ed3b-4855-99f9-59acc491c8cd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1af41bb4-4236-45bb-a843-1062b6baf435', 'code': 200} Dec 09 21:23:32.150267 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd6767f88-ed3b-4855-99f9-59acc491c8cd', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '1af41bb4-4236-45bb-a843-1062b6baf435', 'code': 200} Dec 09 21:23:32.173852 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7db2b557-66dd-4304-abab-e2a61c51edee admin admin] Pushing event updated for resources: {'Network': ['ID=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:32.208607 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:23:32.229782 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e539cf3-24ed-438a-9255-739647d12e59 admin admin] Made reservation on behalf of 1b7916b634f74760a565cfeaef510cd9 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:23:32.232311 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2e539cf3-24ed-438a-9255-739647d12e59 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:32.308982 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-3bb6ca3f-b31a-4beb-9916-04d30524b7e3 req-9b112cd7-9f13-4de8-be78-4abc8430f8b5 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] No DVR routers for this DVR port 1af41bb4-4236-45bb-a843-1062b6baf435 on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:23:32.323525 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:32.329459 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:32.329459 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:32.329820 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:32.330157 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:32.330495 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:32.341317 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:32.341705 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:32.342055 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:32.342394 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:32.342727 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:32.343056 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:32.343388 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:32.368786 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3bb6ca3f-b31a-4beb-9916-04d30524b7e3 req-9b112cd7-9f13-4de8-be78-4abc8430f8b5 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:32.372922 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3bb6ca3f-b31a-4beb-9916-04d30524b7e3 req-9b112cd7-9f13-4de8-be78-4abc8430f8b5 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.31 "DELETE /v2.0/ports/1af41bb4-4236-45bb-a843-1062b6baf435 HTTP/1.1" status: 204 len: 173 time: 3.9121695 Dec 09 21:23:32.377359 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd6767f88-ed3b-4855-99f9-59acc491c8cd', 'name': 'network-vif-deleted', 'tag': '1af41bb4-4236-45bb-a843-1062b6baf435'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:32.383721 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8339aae3-3ade-4a70-b9e8-5a3602992626" -d '{"events": [{"server_uuid": "d6767f88-ed3b-4855-99f9-59acc491c8cd", "name": "network-vif-deleted", "tag": "1af41bb4-4236-45bb-a843-1062b6baf435"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:32.402011 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Network 9b3c0886-168c-4d9c-83a4-145e87393715 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:23:32.486879 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:23:32.538344 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:32.632878 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:32.682983 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b112cd7-9f13-4de8-be78-4abc8430f8b5 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Pushing event deleted for resources: {'Port': ['ID=1af41bb4-4236-45bb-a843-1062b6baf435,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:32.699584 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:23:32.751797 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8389b48-0132-43ab-b4b7-aab08c806b35 None None] Pushing event updated for resources: {'Port': ['ID=047fd970-b4fd-4fa7-81e7-fba0167dbce6,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:32.785635 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cd051d6-7c9a-4c10-b0c5-7ee7a3af5598 req-d245d784-fb19-40e2-bbf2-2ff5f47da355 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:32.794453 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6cd051d6-7c9a-4c10-b0c5-7ee7a3af5598 req-d245d784-fb19-40e2-bbf2-2ff5f47da355 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/ports?device_id=d6767f88-ed3b-4855-99f9-59acc491c8cd HTTP/1.1" status: 200 len: 865 time: 1.2610965 Dec 09 21:23:32.840323 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2e539cf3-24ed-438a-9255-739647d12e59 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:32.930148 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba0ec90e-bda4-4340-b9fc-86f3afd81321 req-5cc2718e-ed86-4752-a45d-6da1e0f6ed28 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:32.944369 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba0ec90e-bda4-4340-b9fc-86f3afd81321 req-5cc2718e-ed86-4752-a45d-6da1e0f6ed28 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 948 time: 0.5818510 Dec 09 21:23:32.967538 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:32.968792 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:32.985108 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-85f463e8-5b49-46b5-88c0-96704ecc27b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:32.987203 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-85f463e8-5b49-46b5-88c0-96704ecc27b1 service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.8242249 Dec 09 21:23:33.047524 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e539cf3-24ed-438a-9255-739647d12e59 admin admin] Pushing event updated for resources: {'Subnet': ['ID=50496955-1646-4079-acd4-a47e8cd175cb,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:33.093119 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e539cf3-24ed-438a-9255-739647d12e59 admin admin] Checking segment: {'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:23:33.096359 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e539cf3-24ed-438a-9255-739647d12e59 admin admin] Network hostable DHCP agents. Network: 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:23:33.150825 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e539cf3-24ed-438a-9255-739647d12e59 admin admin] Network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:23:33.171263 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-2e539cf3-24ed-438a-9255-739647d12e59 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:23:33.187623 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e539cf3-24ed-438a-9255-739647d12e59 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:33.190605 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2e539cf3-24ed-438a-9255-739647d12e59 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:33.234283 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9de83b80-d99e-4421-8a44-8a2b5ec3d5e8 None None] Network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:23:33.249623 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2e539cf3-24ed-438a-9255-739647d12e59 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.2102952 Dec 09 21:23:33.327536 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 6f6b3fc9-0b99-4cad-869c-ed52dde9578b up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:23:33.356235 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6cd051d6-7c9a-4c10-b0c5-7ee7a3af5598 req-36689545-537a-4c3a-bb32-2c63819f9362 tempest-ImagesTestJSON-596284305 tempest-ImagesTestJSON-596284305-project] 10.222.0.13 "GET /v2.0/security-groups?id=bb79590c-1611-4a8a-896f-563610f46135&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5604458 Dec 09 21:23:33.363226 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-d2b38b0e-fb74-400f-8b3e-6a832bd95a1c service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.12&port_id=6f6b3fc9-0b99-4cad-869c-ed52dde9578b HTTP/1.1" status: 200 len: 217 time: 0.3313951 Dec 09 21:23:33.368282 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fc460e31-04ce-4695-bb08-d217ff9bbd77 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:33.382886 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-9fe402d9-9d28-4c0d-8bd4-08a40063201e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.6277142 Dec 09 21:23:33.398455 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:33.469051 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-22d7194d-7205-41af-ad03-05ffeaf1d7b4 service neutron] Request body: {'port': {'device_id': '99185349-bf6b-4cb8-a80b-ebf360aecfbb', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:23:33.522376 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba0ec90e-bda4-4340-b9fc-86f3afd81321 req-7b052ecf-7683-48de-8911-e5743af699c6 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5701346 Dec 09 21:23:33.561022 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b2afec8d-bfd0-49e2-ada8-1b0efeb57613 None None] Provisioning complete for port 2f1265f7-0579-475d-9faa-f23ade6ec46b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:23:33.561553 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b2afec8d-bfd0-49e2-ada8-1b0efeb57613 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:33.887866 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1d1d136c-ac66-4ea7-a117-82cda6e4c29d x-openstack-request-id: req-1d1d136c-ac66-4ea7-a117-82cda6e4c29d {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:33.888459 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d6767f88-ed3b-4855-99f9-59acc491c8cd", "name": "network-vif-deleted", "tag": "1af41bb4-4236-45bb-a843-1062b6baf435", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:33.888459 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-1d1d136c-ac66-4ea7-a117-82cda6e4c29d {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:33.888921 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd6767f88-ed3b-4855-99f9-59acc491c8cd', 'name': 'network-vif-deleted', 'tag': '1af41bb4-4236-45bb-a843-1062b6baf435', 'status': 'completed', 'code': 200} Dec 09 21:23:33.892699 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-fb03d5bc-867b-4c26-81ce-713a5075bc33 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:33.894227 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-fb03d5bc-867b-4c26-81ce-713a5075bc33 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.5094516 Dec 09 21:23:34.041237 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-22d7194d-7205-41af-ad03-05ffeaf1d7b4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:34.064431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a88b8478-a5e4-43f0-b1fa-d9fe6fc6f08e req-13b1d7bc-8501-4e1d-9360-8a2446a1ddc4 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:34.074187 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a88b8478-a5e4-43f0-b1fa-d9fe6fc6f08e req-13b1d7bc-8501-4e1d-9360-8a2446a1ddc4 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 946 time: 0.5505133 Dec 09 21:23:34.127587 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-b2afec8d-bfd0-49e2-ada8-1b0efeb57613 None None] Port 2f1265f7-0579-475d-9faa-f23ade6ec46b cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:23:34.172950 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8f48a806-013e-480e-81ac-1a7f5f10c155', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4425d491-9b2e-48a2-8fb6-ead05da81dba'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:34.179236 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-465b5fc4-2d59-43f3-943a-3486b7d22c21" -d '{"events": [{"server_uuid": "8f48a806-013e-480e-81ac-1a7f5f10c155", "name": "network-vif-plugged", "status": "completed", "tag": "4425d491-9b2e-48a2-8fb6-ead05da81dba"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:34.203801 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] Attempting to bind port 047fd970-b4fd-4fa7-81e7-fba0167dbce6 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:23:34.205493 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a88b8478-a5e4-43f0-b1fa-d9fe6fc6f08e req-ece6edd6-843f-49ac-bb90-115628459a96 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1302977 Dec 09 21:23:34.213584 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-4102b7ff-90ab-47f2-b448-4e74e42decd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:34.215672 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-4102b7ff-90ab-47f2-b448-4e74e42decd9 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.2877872 Dec 09 21:23:34.216329 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] Attempting to bind port 047fd970-b4fd-4fa7-81e7-fba0167dbce6 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '2d25d46c-e6fd-49a0-8d61-31fba8f6eefc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:23:34.219070 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] Attempting to bind port 047fd970-b4fd-4fa7-81e7-fba0167dbce6 on network 9b3c0886-168c-4d9c-83a4-145e87393715 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:23:34.240131 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5b7cdb4-bb79-4a40-907b-c33834115450 req-129cbc83-790e-4343-944e-ba964904da6c tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:34.247070 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5b7cdb4-bb79-4a40-907b-c33834115450 req-129cbc83-790e-4343-944e-ba964904da6c tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/ports?device_id=99185349-bf6b-4cb8-a80b-ebf360aecfbb HTTP/1.1" status: 200 len: 931 time: 0.2941566 Dec 09 21:23:34.249861 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 4425d491-9b2e-48a2-8fb6-ead05da81dba, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=4425d491-9b2e-48a2-8fb6-ead05da81dba,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:34.315095 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:34.324703 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1af41bb4-4236-45bb-a843-1062b6baf435 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:23:34.333664 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 23, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:23:34.350519 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] Checking segment: {'id': '2d25d46c-e6fd-49a0-8d61-31fba8f6eefc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:23:34.351202 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:34.351788 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] Bound using segment: {'id': '2d25d46c-e6fd-49a0-8d61-31fba8f6eefc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:23:34.355119 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] Bound port: 047fd970-b4fd-4fa7-81e7-fba0167dbce6, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2d25d46c-e6fd-49a0-8d61-31fba8f6eefc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:23:34.355785 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:34.496827 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 1af41bb4-4236-45bb-a843-1062b6baf435 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:23:34.510471 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1af41bb4-4236-45bb-a843-1062b6baf435 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:23:34.556135 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:23:34.561756 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7a95ffe0-88a0-49c6-8360-108c68b486e2 None None] Network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:23:34.617961 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5b7cdb4-bb79-4a40-907b-c33834115450 req-94725693-b5d8-4939-a4fd-948cd097e787 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/security-groups?id=502403b3-5851-499b-ae86-dd222b0f8aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3670392 Dec 09 21:23:34.740527 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a3cbf75a-473f-4a89-854f-4ecc9d0a5118 x-openstack-request-id: req-a3cbf75a-473f-4a89-854f-4ecc9d0a5118 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:34.740895 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8f48a806-013e-480e-81ac-1a7f5f10c155", "name": "network-vif-plugged", "status": "completed", "tag": "4425d491-9b2e-48a2-8fb6-ead05da81dba", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:34.741159 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a3cbf75a-473f-4a89-854f-4ecc9d0a5118 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:34.741708 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8f48a806-013e-480e-81ac-1a7f5f10c155', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4425d491-9b2e-48a2-8fb6-ead05da81dba', 'code': 200} Dec 09 21:23:34.760623 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-323c08f0-9277-4c13-8f8d-f81b1325a810 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5030856 Dec 09 21:23:34.772528 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:23:34.773936 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:34.865930 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-74ece4f1-95e5-4355-8015-663262a08ba4 None None] Provisioning complete for port 047fd970-b4fd-4fa7-81e7-fba0167dbce6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:23:34.866316 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-74ece4f1-95e5-4355-8015-663262a08ba4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:34.869142 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=4425d491-9b2e-48a2-8fb6-ead05da81dba,revision_number=10']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:34.905352 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:34.905617 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:34.905960 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:34.906362 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:34.906696 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:34.907025 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:34.907352 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:34.907817 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:34.908141 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:34.908598 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:34.908924 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:34.909242 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:34.910095 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:35.114462 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:35.172577 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca19fb2a-a2b9-4005-acb7-9e07cad56195 req-44506f27-0746-444e-bccb-c9a9191a8d04 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:35.178516 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:35.182456 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ca19fb2a-a2b9-4005-acb7-9e07cad56195 req-44506f27-0746-444e-bccb-c9a9191a8d04 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 948 time: 0.2350597 Dec 09 21:23:35.194772 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:35.197114 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-54f486a4-53dd-4551-b0f8-993ba93b4a3f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:35.198875 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-54f486a4-53dd-4551-b0f8-993ba93b4a3f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/networks?id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb HTTP/1.1" status: 200 len: 812 time: 0.4848270 Dec 09 21:23:35.224465 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-f1cb943a-3f3b-4536-bbfc-d8a53dd82a55 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/quotas/1b7916b634f74760a565cfeaef510cd9 HTTP/1.1" status: 200 len: 375 time: 0.0127101 Dec 09 21:23:35.230157 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-1873584b-e998-4b35-95c3-16497de45fbc service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4499543 Dec 09 21:23:35.247712 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-22d7194d-7205-41af-ad03-05ffeaf1d7b4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2f1265f7-0579-475d-9faa-f23ade6ec46b {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:23:35.313278 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-22d7194d-7205-41af-ad03-05ffeaf1d7b4 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:35.343838 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-9515f97f-b873-4fba-8d1b-3be27aabdcad tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=1b7916b634f74760a565cfeaef510cd9&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1068699 Dec 09 21:23:35.382327 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-22d7194d-7205-41af-ad03-05ffeaf1d7b4 service neutron] Transition to ACTIVE for port object 2f1265f7-0579-475d-9faa-f23ade6ec46b will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:23:35.396941 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-22d7194d-7205-41af-ad03-05ffeaf1d7b4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:35.421316 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,revision_number=9']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:35.442179 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-74ece4f1-95e5-4355-8015-663262a08ba4 None None] Port 047fd970-b4fd-4fa7-81e7-fba0167dbce6 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:23:35.543561 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] For port 047fd970-b4fd-4fa7-81e7-fba0167dbce6, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:23:35.579109 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ca19fb2a-a2b9-4005-acb7-9e07cad56195 req-894db737-cb80-4381-b6e7-f43d7c7841df tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3954856 Dec 09 21:23:35.590165 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] For port 047fd970-b4fd-4fa7-81e7-fba0167dbce6, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=047fd970-b4fd-4fa7-81e7-fba0167dbce6,segment=NetworkSegment(2d25d46c-e6fd-49a0-8d61-31fba8f6eefc),segment_id=2d25d46c-e6fd-49a0-8d61-31fba8f6eefc)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:23:35.595062 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-faf90403-594b-475f-8ba3-316e7580cb47 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:35.607918 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:35.796943 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22d7194d-7205-41af-ad03-05ffeaf1d7b4 service neutron] Pushing event updated for resources: {'Port': ['ID=2f1265f7-0579-475d-9faa-f23ade6ec46b,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:35.807739 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] Routers {'88041dd4-3b62-47ec-ab19-cf438d19e15b'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:23:35.808387 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:23:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['88041dd4-3b62-47ec-ab19-cf438d19e15b'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:35.973765 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8389b48-0132-43ab-b4b7-aab08c806b35 None None] Pushing event updated for resources: {'Port': ['ID=047fd970-b4fd-4fa7-81e7-fba0167dbce6,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:36.012984 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-22d7194d-7205-41af-ad03-05ffeaf1d7b4 service neutron] Attempting to bind port 2f1265f7-0579-475d-9faa-f23ade6ec46b on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:23:36.013511 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-22d7194d-7205-41af-ad03-05ffeaf1d7b4 service neutron] Attempting to bind port 2f1265f7-0579-475d-9faa-f23ade6ec46b by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '2d25d46c-e6fd-49a0-8d61-31fba8f6eefc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:23:36.013852 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-22d7194d-7205-41af-ad03-05ffeaf1d7b4 service neutron] Attempting to bind port 2f1265f7-0579-475d-9faa-f23ade6ec46b on network 9b3c0886-168c-4d9c-83a4-145e87393715 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:23:36.025545 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-b5c0a032-72f5-4c95-aa2a-ef6d6334de51 service neutron] 10.222.0.13 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6395283 Dec 09 21:23:36.029738 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-22d7194d-7205-41af-ad03-05ffeaf1d7b4 service neutron] Port 2f1265f7-0579-475d-9faa-f23ade6ec46b on network 9b3c0886-168c-4d9c-83a4-145e87393715 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:23:36.030173 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-22d7194d-7205-41af-ad03-05ffeaf1d7b4 service neutron] Attempting to bind port 2f1265f7-0579-475d-9faa-f23ade6ec46b on network 9b3c0886-168c-4d9c-83a4-145e87393715 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:23:36.127887 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] Set router 88041dd4-3b62-47ec-ab19-cf438d19e15b gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:23:36.148162 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-22d7194d-7205-41af-ad03-05ffeaf1d7b4 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 23, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:23:36.148501 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-22d7194d-7205-41af-ad03-05ffeaf1d7b4 service neutron] Checking segment: {'id': '2d25d46c-e6fd-49a0-8d61-31fba8f6eefc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:23:36.148884 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-22d7194d-7205-41af-ad03-05ffeaf1d7b4 service neutron] Bound using segment: {'id': '2d25d46c-e6fd-49a0-8d61-31fba8f6eefc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:23:36.149347 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-22d7194d-7205-41af-ad03-05ffeaf1d7b4 service neutron] Bound port: 2f1265f7-0579-475d-9faa-f23ade6ec46b, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2d25d46c-e6fd-49a0-8d61-31fba8f6eefc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:23:36.149707 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-22d7194d-7205-41af-ad03-05ffeaf1d7b4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:36.273290 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fc4396b-6660-4363-96ab-73d5eb2c5d3d req-7c7f220a-4929-405e-9e05-388cbdd8d6fb tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:36.282338 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2fc4396b-6660-4363-96ab-73d5eb2c5d3d req-7c7f220a-4929-405e-9e05-388cbdd8d6fb tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 946 time: 0.2125521 Dec 09 21:23:36.371786 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-691abd6a-44e4-4318-a43f-5f0a3cd2c056 service neutron] 10.222.0.13 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3285053 Dec 09 21:23:36.399741 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2fc4396b-6660-4363-96ab-73d5eb2c5d3d req-4bb46678-a7d7-454b-8d44-906b7ee0f286 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1163576 Dec 09 21:23:36.416948 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-22d7194d-7205-41af-ad03-05ffeaf1d7b4 service neutron] For port 2f1265f7-0579-475d-9faa-f23ade6ec46b, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:23:36.423841 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-22d7194d-7205-41af-ad03-05ffeaf1d7b4 service neutron] For port 2f1265f7-0579-475d-9faa-f23ade6ec46b, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=2f1265f7-0579-475d-9faa-f23ade6ec46b,segment=NetworkSegment(2d25d46c-e6fd-49a0-8d61-31fba8f6eefc),segment_id=2d25d46c-e6fd-49a0-8d61-31fba8f6eefc)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:23:36.432763 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-22d7194d-7205-41af-ad03-05ffeaf1d7b4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:36.590413 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-22d7194d-7205-41af-ad03-05ffeaf1d7b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:36.591191 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-22d7194d-7205-41af-ad03-05ffeaf1d7b4 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:36.595404 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-22d7194d-7205-41af-ad03-05ffeaf1d7b4 service neutron] 10.222.0.10 "PUT /v2.0/ports/2f1265f7-0579-475d-9faa-f23ade6ec46b HTTP/1.1" status: 200 len: 1092 time: 3.1569154 Dec 09 21:23:36.651683 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:36.714831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '99185349-bf6b-4cb8-a80b-ebf360aecfbb', 'tag': '2f1265f7-0579-475d-9faa-f23ade6ec46b'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:36.719248 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c9b9944c-6878-45f6-812f-93e435597ca7" -d '{"events": [{"name": "network-changed", "server_uuid": "99185349-bf6b-4cb8-a80b-ebf360aecfbb", "tag": "2f1265f7-0579-475d-9faa-f23ade6ec46b"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:36.751089 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7604cfe7-6a20-4212-ac7d-57d16969b9fd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6f6b3fc9-0b99-4cad-869c-ed52dde9578b'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:36.753316 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-404eeea5-5588-48c0-a43d-dde5889ebdf5" -d '{"events": [{"server_uuid": "7604cfe7-6a20-4212-ac7d-57d16969b9fd", "name": "network-vif-plugged", "status": "completed", "tag": "6f6b3fc9-0b99-4cad-869c-ed52dde9578b"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:36.841037 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1528769429-router', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42'}], 'enable_snat': True}, 'gw_port_id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:23:17Z', 'updated_at': '2021-12-09T21:23:23Z', 'revision_number': 4, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'gw_port': {'id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:c0:45:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:23:18Z', 'updated_at': '2021-12-09T21:23:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '047fd970-b4fd-4fa7-81e7-fba0167dbce6', 'name': '', 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'mac_address': 'fa:16:3e:a3:36:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'device_owner': 'network:router_interface', 'standard_attr_id': 705, 'fixed_ips': [{'subnet_id': '176a8001-d04b-4c22-9715-06327ff3546d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:23:22Z', 'updated_at': '2021-12-09T21:23:35Z', 'revision_number': 4, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'subnets': [{'id': '176a8001-d04b-4c22-9715-06327ff3546d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:36.912183 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-397ad64b-9180-4cc5-be82-058b12f4cbe0 None None] The sync data for ids ['88041dd4-3b62-47ec-ab19-cf438d19e15b'] in n-d-713301-27 is: [{'id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1528769429-router', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42'}], 'enable_snat': True}, 'gw_port_id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:23:17Z', 'updated_at': '2021-12-09T21:23:23Z', 'revision_number': 4, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'gw_port': {'id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:c0:45:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:23:18Z', 'updated_at': '2021-12-09T21:23:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '047fd970-b4fd-4fa7-81e7-fba0167dbce6', 'name': '', 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'mac_address': 'fa:16:3e:a3:36:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'device_owner': 'network:router_interface', 'standard_attr_id': 705, 'fixed_ips': [{'subnet_id': '176a8001-d04b-4c22-9715-06327ff3546d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:23:22Z', 'updated_at': '2021-12-09T21:23:35Z', 'revision_number': 4, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'subnets': [{'id': '176a8001-d04b-4c22-9715-06327ff3546d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:23:36.915675 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5ee0ad15-87af-444e-b033-544afba212e9 None None] Provisioning complete for port 047fd970-b4fd-4fa7-81e7-fba0167dbce6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:23:36.916574 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5ee0ad15-87af-444e-b033-544afba212e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:37.111617 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5ee0ad15-87af-444e-b033-544afba212e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:37.209085 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec00f004-ae22-4e0b-9a39-8732af3b4cd5 req-02951586-e974-4691-967e-9aa5df42863b tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:37.221964 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec00f004-ae22-4e0b-9a39-8732af3b4cd5 req-02951586-e974-4691-967e-9aa5df42863b tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/ports?device_id=99185349-bf6b-4cb8-a80b-ebf360aecfbb HTTP/1.1" status: 200 len: 943 time: 0.6551056 Dec 09 21:23:37.249642 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22d7194d-7205-41af-ad03-05ffeaf1d7b4 service neutron] Pushing event updated for resources: {'Port': ['ID=2f1265f7-0579-475d-9faa-f23ade6ec46b,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:37.259743 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-5ee0ad15-87af-444e-b033-544afba212e9 None None] For port 047fd970-b4fd-4fa7-81e7-fba0167dbce6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=047fd970-b4fd-4fa7-81e7-fba0167dbce6,segment=NetworkSegment(2d25d46c-e6fd-49a0-8d61-31fba8f6eefc),segment_id=2d25d46c-e6fd-49a0-8d61-31fba8f6eefc)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:37.270165 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5ee0ad15-87af-444e-b033-544afba212e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:37.302904 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-6605c526-39ac-4377-941d-b4889769af23 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:37.306835 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-6605c526-39ac-4377-941d-b4889769af23 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=768655d2ebd74340a90f65fc3007118f&device_id=99185349-bf6b-4cb8-a80b-ebf360aecfbb HTTP/1.1" status: 200 len: 1095 time: 0.5235918 Dec 09 21:23:37.428369 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ee0ad15-87af-444e-b033-544afba212e9 None None] Pushing event updated for resources: {'Port': ['ID=047fd970-b4fd-4fa7-81e7-fba0167dbce6,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:37.868874 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 047fd970-b4fd-4fa7-81e7-fba0167dbce6 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:23:37.952865 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:38.030251 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-3a306d07-3839-4de9-93d6-f95eabae03be service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=2f1265f7-0579-475d-9faa-f23ade6ec46b HTTP/1.1" status: 200 len: 217 time: 0.7141528 Dec 09 21:23:38.041695 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 047fd970-b4fd-4fa7-81e7-fba0167dbce6 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:23:38.042319 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:38.105732 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-25d32f5d-0bcd-4a8d-83af-5ece29bd8153 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:38.116409 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec00f004-ae22-4e0b-9a39-8732af3b4cd5 req-b58cc1af-380e-4b77-9ddc-3f9eb41094aa tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/security-groups?id=502403b3-5851-499b-ae86-dd222b0f8aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.8909733 Dec 09 21:23:38.123158 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-25d32f5d-0bcd-4a8d-83af-5ece29bd8153 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd&tenant_id=857de64ecc3946e3b92655f639d782df HTTP/1.1" status: 200 len: 1101 time: 0.0967503 Dec 09 21:23:38.138826 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] Request body: {'port': {'binding:host_id': 'n-h1-713301-27', 'device_owner': 'compute:nova'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:23:38.301733 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99b756e3-8f30-4a8a-a260-07a388b9a2e4 req-39406361-1f36-4e77-a82c-3eb60da6992d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:38.303467 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99b756e3-8f30-4a8a-a260-07a388b9a2e4 req-39406361-1f36-4e77-a82c-3eb60da6992d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.31 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 945 time: 0.2958939 Dec 09 21:23:38.309703 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-f82256f4-5fee-444c-a5c2-12df469419fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:38.311703 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-f82256f4-5fee-444c-a5c2-12df469419fc service neutron] 10.222.0.10 "GET /v2.0/subnets?id=176a8001-d04b-4c22-9715-06327ff3546d HTTP/1.1" status: 200 len: 868 time: 0.2366145 Dec 09 21:23:38.312703 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:38.526870 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b14665ae-25aa-4834-95a9-7c57d05d5e10 req-357dd1e4-76a4-46bd-b77a-224c19224fb8 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=b7584b26-427d-42a9-a7d7-2fbd2f063a84 HTTP/1.1" status: 200 len: 210 time: 0.1865144 Dec 09 21:23:38.714822 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-d1fbdecd-6c9d-4922-9930-836f9e7d9aea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:38.716361 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-d1fbdecd-6c9d-4922-9930-836f9e7d9aea service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=9b3c0886-168c-4d9c-83a4-145e87393715&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.3825910 Dec 09 21:23:38.736480 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] For port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:38.759611 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-03e48144-7354-42aa-8df7-e2f31c960b15 x-openstack-request-id: req-03e48144-7354-42aa-8df7-e2f31c960b15 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:38.759910 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7604cfe7-6a20-4212-ac7d-57d16969b9fd", "name": "network-vif-plugged", "status": "completed", "tag": "6f6b3fc9-0b99-4cad-869c-ed52dde9578b", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:38.760164 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-03e48144-7354-42aa-8df7-e2f31c960b15 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:38.760558 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7604cfe7-6a20-4212-ac7d-57d16969b9fd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6f6b3fc9-0b99-4cad-869c-ed52dde9578b', 'code': 200} Dec 09 21:23:38.808609 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f68de14-9a12-4caf-99e9-a08391f7b49d req-52e4f924-54fa-43b3-9f74-ca9cd7225e7b tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:38.811009 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f68de14-9a12-4caf-99e9-a08391f7b49d req-52e4f924-54fa-43b3-9f74-ca9cd7225e7b tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 949 time: 0.8015928 Dec 09 21:23:38.828849 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] For port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:23:38.914019 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7604cfe7-6a20-4212-ac7d-57d16969b9fd', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '6f6b3fc9-0b99-4cad-869c-ed52dde9578b'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:38.919284 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-919a388f-c0f6-4e8d-a16c-7ebefca01a6b x-openstack-request-id: req-919a388f-c0f6-4e8d-a16c-7ebefca01a6b {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:38.919598 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "99185349-bf6b-4cb8-a80b-ebf360aecfbb", "tag": "2f1265f7-0579-475d-9faa-f23ade6ec46b", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:38.919708 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-919a388f-c0f6-4e8d-a16c-7ebefca01a6b {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:38.920069 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '99185349-bf6b-4cb8-a80b-ebf360aecfbb', 'tag': '2f1265f7-0579-475d-9faa-f23ade6ec46b', 'status': 'completed', 'code': 200} Dec 09 21:23:38.922794 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fe0b80a5-0fb9-4644-8143-0ef2c3501d12" -d '{"events": [{"server_uuid": "7604cfe7-6a20-4212-ac7d-57d16969b9fd", "name": "network-vif-unplugged", "status": "completed", "tag": "6f6b3fc9-0b99-4cad-869c-ed52dde9578b"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:38.927096 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:38.958794 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] Transition to ACTIVE for port object 6f6b3fc9-0b99-4cad-869c-ed52dde9578b will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:23:38.964678 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:39.084594 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-72760a75-2547-4f2b-b534-80d702f644b1 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:39.089350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-72760a75-2547-4f2b-b534-80d702f644b1 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.10 "GET /v2.0/networks?id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb HTTP/1.1" status: 200 len: 812 time: 0.5101123 Dec 09 21:23:39.108129 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] No DVR routers for this DVR port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:23:39.122641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-99b756e3-8f30-4a8a-a260-07a388b9a2e4 req-98765458-e45e-4475-92dd-1aae1c3ec906 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Deleting port 40468c91-ccde-4d96-b234-0e326a1de103 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:23:39.123046 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-99b756e3-8f30-4a8a-a260-07a388b9a2e4 req-98765458-e45e-4475-92dd-1aae1c3ec906 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:39.129379 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] Pushing event updated for resources: {'Port': ['ID=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,revision_number=10']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:39.134493 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-36da9a59-acd3-43ec-b605-e2ee6f38d3a4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Request body: {'port': {'device_id': 'b7584b26-427d-42a9-a7d7-2fbd2f063a84', 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb', 'admin_state_up': True, 'tenant_id': '1b7916b634f74760a565cfeaef510cd9'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:23:39.180006 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f68de14-9a12-4caf-99e9-a08391f7b49d req-d4dd1cb5-15d3-42c4-af87-52012261d036 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3369734 Dec 09 21:23:39.239892 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] Attempting to bind port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:23:39.242152 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] Attempting to bind port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:23:39.243614 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] Attempting to bind port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:23:39.256482 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] Port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:23:39.258669 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] Attempting to bind port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:23:39.268082 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 23, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:23:39.270878 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:23:39.272871 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:23:39.273761 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] Bound port: 6f6b3fc9-0b99-4cad-869c-ed52dde9578b, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:23:39.275164 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:39.302206 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 6f6b3fc9-0b99-4cad-869c-ed52dde9578b no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:23:39.311404 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-99b756e3-8f30-4a8a-a260-07a388b9a2e4 req-98765458-e45e-4475-92dd-1aae1c3ec906 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] For port 40468c91-ccde-4d96-b234-0e326a1de103, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=40468c91-ccde-4d96-b234-0e326a1de103,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:39.312138 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-99b756e3-8f30-4a8a-a260-07a388b9a2e4 req-98765458-e45e-4475-92dd-1aae1c3ec906 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:39.326030 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-99b756e3-8f30-4a8a-a260-07a388b9a2e4 req-98765458-e45e-4475-92dd-1aae1c3ec906 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Calling delete_port for 40468c91-ccde-4d96-b234-0e326a1de103 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:23:39.364925 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:39.383484 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] For port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:23:39.388620 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] For port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:23:39.398198 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 6f6b3fc9-0b99-4cad-869c-ed52dde9578b not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:23:39.401992 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:39.433480 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-4d55e4de-0b6b-4e4f-8ff6-64d727d61adb service neutron] 10.222.0.10 "GET /v2.0/networks/9b3c0886-168c-4d9c-83a4-145e87393715?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6933274 Dec 09 21:23:39.444242 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:39.444956 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:39.446476 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] 10.222.0.31 "PUT /v2.0/ports/6f6b3fc9-0b99-4cad-869c-ed52dde9578b HTTP/1.1" status: 200 len: 1097 time: 1.3163009 Dec 09 21:23:39.478994 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c169bb7-9f57-46f8-aa16-15a059cf837c service neutron] Pushing event updated for resources: {'Port': ['ID=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,revision_number=11']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:39.580051 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-cee34cef-f578-48e6-b697-be4be46ff49b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:39.582972 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-cee34cef-f578-48e6-b697-be4be46ff49b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 1100 time: 0.0838652 Dec 09 21:23:39.694281 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c423d876-ea0c-4fea-b1d1-3e63734fada7 req-50c475f4-75bc-4720-a436-b34f8bb34535 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:39.695375 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c423d876-ea0c-4fea-b1d1-3e63734fada7 req-50c475f4-75bc-4720-a436-b34f8bb34535 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 945 time: 0.5754488 Dec 09 21:23:39.730297 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-9e69beca-12e5-4f44-a86c-7b0413aedadc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:39.732437 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-9e69beca-12e5-4f44-a86c-7b0413aedadc service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.1386819 Dec 09 21:23:39.747975 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14c2d011-8f3f-4cc1-9412-c188a2a7e3fc req-c78f6f14-0b44-483c-b350-ff0e7818daea tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:39.749512 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-14c2d011-8f3f-4cc1-9412-c188a2a7e3fc req-c78f6f14-0b44-483c-b350-ff0e7818daea tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 946 time: 0.4165053 Dec 09 21:23:39.751360 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c96ea29-c5f6-4a25-9f09-db322cc0e7f9 req-cca79ac7-67e0-40a8-a1d9-a2cb455302a1 service neutron] 10.222.0.10 "GET /v2.0/networks/9b3c0886-168c-4d9c-83a4-145e87393715?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2942083 Dec 09 21:23:39.806048 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-96866fdd-c004-4de2-89c1-072f063ff144 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.12&port_id=6f6b3fc9-0b99-4cad-869c-ed52dde9578b HTTP/1.1" status: 200 len: 217 time: 0.0667477 Dec 09 21:23:39.875732 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-a407f8f8-8a53-4f5d-8c24-b3735f62fcb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:39.877515 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-a407f8f8-8a53-4f5d-8c24-b3735f62fcb2 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0648735 Dec 09 21:23:39.880398 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-36da9a59-acd3-43ec-b605-e2ee6f38d3a4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Made reservation on behalf of 1b7916b634f74760a565cfeaef510cd9 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:23:39.884755 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-36da9a59-acd3-43ec-b605-e2ee6f38d3a4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:39.942353 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-f6213495-0595-474b-8c55-2a399bfce6b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:39.946447 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-f6213495-0595-474b-8c55-2a399bfce6b4 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0602612 Dec 09 21:23:39.984532 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-99b756e3-8f30-4a8a-a260-07a388b9a2e4 req-98765458-e45e-4475-92dd-1aae1c3ec906 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:40.016848 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c423d876-ea0c-4fea-b1d1-3e63734fada7 req-75159e3e-dcc5-42c1-bfb3-d4e19b6b57d6 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2971985 Dec 09 21:23:40.068966 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-702307a4-b1d0-4870-b1e2-da4815318df6 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1153333 Dec 09 21:23:40.087661 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-14c2d011-8f3f-4cc1-9412-c188a2a7e3fc req-78ed8c62-2746-469f-b753-17f31f98a068 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3245571 Dec 09 21:23:40.220236 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-53480a75-1d86-44d5-aab0-ae13aaeab353 x-openstack-request-id: req-53480a75-1d86-44d5-aab0-ae13aaeab353 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:40.220815 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7604cfe7-6a20-4212-ac7d-57d16969b9fd", "name": "network-vif-unplugged", "status": "completed", "tag": "6f6b3fc9-0b99-4cad-869c-ed52dde9578b", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:40.220815 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-53480a75-1d86-44d5-aab0-ae13aaeab353 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:40.221175 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7604cfe7-6a20-4212-ac7d-57d16969b9fd', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '6f6b3fc9-0b99-4cad-869c-ed52dde9578b', 'code': 200} Dec 09 21:23:40.224452 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98765458-e45e-4475-92dd-1aae1c3ec906 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Pushing event deleted for resources: {'Port': ['ID=40468c91-ccde-4d96-b234-0e326a1de103,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:40.264322 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-78fc0e34-27af-4c9f-a172-9cc354ea19bf req-7756f8a2-f604-4ab9-a150-2c69825d949b service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1871018 Dec 09 21:23:40.353119 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-99b756e3-8f30-4a8a-a260-07a388b9a2e4 req-98765458-e45e-4475-92dd-1aae1c3ec906 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] No DVR routers for this DVR port 40468c91-ccde-4d96-b234-0e326a1de103 on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:23:40.372935 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-99b756e3-8f30-4a8a-a260-07a388b9a2e4 req-98765458-e45e-4475-92dd-1aae1c3ec906 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:40.376485 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99b756e3-8f30-4a8a-a260-07a388b9a2e4 req-98765458-e45e-4475-92dd-1aae1c3ec906 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.31 "DELETE /v2.0/ports/40468c91-ccde-4d96-b234-0e326a1de103 HTTP/1.1" status: 204 len: 173 time: 2.0641136 Dec 09 21:23:40.382983 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9b9944c-6878-45f6-812f-93e435597ca7 req-8b5b989e-feab-42bb-bc59-1becfb3187c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:40.384505 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9b9944c-6878-45f6-812f-93e435597ca7 req-8b5b989e-feab-42bb-bc59-1becfb3187c8 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=768655d2ebd74340a90f65fc3007118f&device_id=99185349-bf6b-4cb8-a80b-ebf360aecfbb HTTP/1.1" status: 200 len: 1095 time: 0.4850748 Dec 09 21:23:40.386454 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60c2074a-dc5b-482b-9ac4-494232f0180b req-6e79043d-943f-4d63-8f74-b552c088ed9e tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=b7584b26-427d-42a9-a7d7-2fbd2f063a84 HTTP/1.1" status: 200 len: 210 time: 0.0828576 Dec 09 21:23:40.405803 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-36da9a59-acd3-43ec-b605-e2ee6f38d3a4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Allocated IP 172.20.0.4 (43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb/50496955-1646-4079-acd4-a47e8cd175cb/df55306b-f9c9-42b2-a899-aa67e74612f6) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:23:40.460546 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ff66760-dc8e-4442-9c4c-4c476a22d334 req-f262df43-6eef-4aeb-bb87-372832041560 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:40.462129 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3ff66760-dc8e-4442-9c4c-4c476a22d334 req-f262df43-6eef-4aeb-bb87-372832041560 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/ports?device_id=99185349-bf6b-4cb8-a80b-ebf360aecfbb HTTP/1.1" status: 200 len: 943 time: 0.2446306 Dec 09 21:23:40.678815 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9b9944c-6878-45f6-812f-93e435597ca7 req-2d4baf28-dfa4-4401-b069-eb6b92d46605 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:40.680856 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9b9944c-6878-45f6-812f-93e435597ca7 req-2d4baf28-dfa4-4401-b069-eb6b92d46605 service neutron] 10.222.0.10 "GET /v2.0/networks?id=9b3c0886-168c-4d9c-83a4-145e87393715 HTTP/1.1" status: 200 len: 930 time: 0.2833147 Dec 09 21:23:40.686986 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3ff66760-dc8e-4442-9c4c-4c476a22d334 req-89ac7707-b22d-4540-8122-ac5400aa14eb tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/security-groups?id=502403b3-5851-499b-ae86-dd222b0f8aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1918085 Dec 09 21:23:40.740080 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9b9944c-6878-45f6-812f-93e435597ca7 req-b17b86e1-55e2-44fa-ba18-7b2f5547995c service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=2f1265f7-0579-475d-9faa-f23ade6ec46b HTTP/1.1" status: 200 len: 217 time: 0.0519760 Dec 09 21:23:40.779211 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-36da9a59-acd3-43ec-b605-e2ee6f38d3a4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:40.870805 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9b9944c-6878-45f6-812f-93e435597ca7 req-92997e41-aa59-4e71-8673-efe7961c775d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:40.873068 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9b9944c-6878-45f6-812f-93e435597ca7 req-92997e41-aa59-4e71-8673-efe7961c775d service neutron] 10.222.0.10 "GET /v2.0/subnets?id=176a8001-d04b-4c22-9715-06327ff3546d HTTP/1.1" status: 200 len: 868 time: 0.1081548 Dec 09 21:23:40.896561 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6ed22f8-1643-4cb2-afe1-017eaebd06f3 req-9f63e987-06c4-4e6d-a583-55a1e44a98e1 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:40.898856 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c6ed22f8-1643-4cb2-afe1-017eaebd06f3 req-9f63e987-06c4-4e6d-a583-55a1e44a98e1 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 948 time: 0.1498024 Dec 09 21:23:40.944011 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '18c57a12-fe06-4b8d-93c7-e3121619fa56', 'name': 'network-vif-deleted', 'tag': '40468c91-ccde-4d96-b234-0e326a1de103'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:40.952283 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d734bf86-42f9-486c-bbf6-9cbfb8ae66f1" -d '{"events": [{"server_uuid": "18c57a12-fe06-4b8d-93c7-e3121619fa56", "name": "network-vif-deleted", "tag": "40468c91-ccde-4d96-b234-0e326a1de103"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:41.000790 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c6ed22f8-1643-4cb2-afe1-017eaebd06f3 req-0a636805-a214-4175-b3a9-ea0a60aa644d tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0936904 Dec 09 21:23:41.022486 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35170) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:41.029398 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-36da9a59-acd3-43ec-b605-e2ee6f38d3a4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:41.132348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-92b8bd2a-edfb-4d13-b4b9-4697d22ba289 admin admin] Deleting subnet 63e7603a-bb11-4d1a-8d84-55456d81931c {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:23:41.136360 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9125d4e3-a214-4c85-951f-beda57f83b62 x-openstack-request-id: req-9125d4e3-a214-4c85-951f-beda57f83b62 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:41.137211 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92b8bd2a-edfb-4d13-b4b9-4697d22ba289 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:41.137683 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "18c57a12-fe06-4b8d-93c7-e3121619fa56", "name": "network-vif-deleted", "tag": "40468c91-ccde-4d96-b234-0e326a1de103", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:41.138158 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-9125d4e3-a214-4c85-951f-beda57f83b62 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:41.140160 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '18c57a12-fe06-4b8d-93c7-e3121619fa56', 'name': 'network-vif-deleted', 'tag': '40468c91-ccde-4d96-b234-0e326a1de103', 'status': 'completed', 'code': 200} Dec 09 21:23:41.144848 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9b9944c-6878-45f6-812f-93e435597ca7 req-4dac5d13-3105-4f1d-85b3-f4acd8b3cc3c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:41.149293 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9b9944c-6878-45f6-812f-93e435597ca7 req-4dac5d13-3105-4f1d-85b3-f4acd8b3cc3c service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=9b3c0886-168c-4d9c-83a4-145e87393715&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2492464 Dec 09 21:23:41.206034 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92b8bd2a-edfb-4d13-b4b9-4697d22ba289 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:41.245022 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-36da9a59-acd3-43ec-b605-e2ee6f38d3a4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:23:41.268528 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92b8bd2a-edfb-4d13-b4b9-4697d22ba289 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:41.302520 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef0a480f-adbd-4492-932e-df0583d81225 req-b356ce67-beea-4760-bd6c-0ea5d8dfdfdc tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=18c57a12-fe06-4b8d-93c7-e3121619fa56 HTTP/1.1" status: 200 len: 210 time: 0.0656536 Dec 09 21:23:41.302822 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 2f1265f7-0579-475d-9faa-f23ade6ec46b details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:23:41.306026 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-36da9a59-acd3-43ec-b605-e2ee6f38d3a4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:23:41.325738 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36da9a59-acd3-43ec-b605-e2ee6f38d3a4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Pushing event updated for resources: {'Port': ['ID=df55306b-f9c9-42b2-a899-aa67e74612f6,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:41.328469 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-36da9a59-acd3-43ec-b605-e2ee6f38d3a4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:23:41.368794 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92b8bd2a-edfb-4d13-b4b9-4697d22ba289 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:41.422855 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 2f1265f7-0579-475d-9faa-f23ade6ec46b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=2f1265f7-0579-475d-9faa-f23ade6ec46b,segment=NetworkSegment(2d25d46c-e6fd-49a0-8d61-31fba8f6eefc),segment_id=2d25d46c-e6fd-49a0-8d61-31fba8f6eefc)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:41.424450 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92b8bd2a-edfb-4d13-b4b9-4697d22ba289 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=63e7603a-bb11-4d1a-8d84-55456d81931c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:41.429475 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92b8bd2a-edfb-4d13-b4b9-4697d22ba289 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:41.440024 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-92b8bd2a-edfb-4d13-b4b9-4697d22ba289 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/63e7603a-bb11-4d1a-8d84-55456d81931c HTTP/1.1" status: 204 len: 168 time: 0.4161618 Dec 09 21:23:41.442049 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35180) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:41.449038 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '2f1265f7-0579-475d-9faa-f23ade6ec46b', 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715', 'port_id': '2f1265f7-0579-475d-9faa-f23ade6ec46b', 'mac_address': 'fa:16:3e:e3:12:7e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '176a8001-d04b-4c22-9715-06327ff3546d', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:23:41.495472 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-36da9a59-acd3-43ec-b605-e2ee6f38d3a4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:41.496264 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-36da9a59-acd3-43ec-b605-e2ee6f38d3a4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:41.518418 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:41.537259 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2f1265f7-0579-475d-9faa-f23ade6ec46b {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:23:41.553891 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cf121dd-dbe7-4e89-b495-97b20dc3a28a req-296b9802-076d-4612-baa1-2b1e23a36277 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:41.555665 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0cf121dd-dbe7-4e89-b495-97b20dc3a28a req-296b9802-076d-4612-baa1-2b1e23a36277 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 946 time: 0.3095388 Dec 09 21:23:41.560782 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26396b86-162d-4c8b-9388-16c7263e75ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:41.604783 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9b9944c-6878-45f6-812f-93e435597ca7 req-468be665-b4c6-4638-9808-ab1aa1539acc service neutron] 10.222.0.10 "GET /v2.0/networks/9b3c0886-168c-4d9c-83a4-145e87393715?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4415219 Dec 09 21:23:41.607783 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 2f1265f7-0579-475d-9faa-f23ade6ec46b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=2f1265f7-0579-475d-9faa-f23ade6ec46b,segment=NetworkSegment(2d25d46c-e6fd-49a0-8d61-31fba8f6eefc),segment_id=2d25d46c-e6fd-49a0-8d61-31fba8f6eefc)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:41.620945 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:41.647646 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-36da9a59-acd3-43ec-b605-e2ee6f38d3a4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.5279770 Dec 09 21:23:41.667786 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26396b86-162d-4c8b-9388-16c7263e75ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:41.680512 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-94ea13cd-7e1b-4d1c-81c2-4e2d58fe1feb service neutron] Request body: {'port': {'device_id': 'b7584b26-427d-42a9-a7d7-2fbd2f063a84', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:23:41.689588 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 40468c91-ccde-4d96-b234-0e326a1de103 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:23:41.697634 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-26396b86-162d-4c8b-9388-16c7263e75ee admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8e0b26d7-eefe-4c85-b535-944f3c15f0f6']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:41.709713 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-26396b86-162d-4c8b-9388-16c7263e75ee admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '41babb3e-048d-47f5-b92c-d4cf9897cc70') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:41.710071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-26396b86-162d-4c8b-9388-16c7263e75ee admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '41babb3e-048d-47f5-b92c-d4cf9897cc70') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:41.721519 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26396b86-162d-4c8b-9388-16c7263e75ee admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:41.738582 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26396b86-162d-4c8b-9388-16c7263e75ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:41.747128 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-26396b86-162d-4c8b-9388-16c7263e75ee admin admin] Releasing vlan 122 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:23:41.747128 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26396b86-162d-4c8b-9388-16c7263e75ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:41.752326 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 40468c91-ccde-4d96-b234-0e326a1de103 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:23:41.752956 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 40468c91-ccde-4d96-b234-0e326a1de103 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:23:41.773450 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=2f1265f7-0579-475d-9faa-f23ade6ec46b,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:23:41.812720 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:23:41.818075 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26396b86-162d-4c8b-9388-16c7263e75ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:41.827070 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26396b86-162d-4c8b-9388-16c7263e75ee admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:41.830788 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-26396b86-162d-4c8b-9388-16c7263e75ee admin admin] 10.222.0.13 "DELETE /v2.0/networks/8e0b26d7-eefe-4c85-b535-944f3c15f0f6 HTTP/1.1" status: 204 len: 168 time: 0.3854332 Dec 09 21:23:41.850141 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-927f53cb-d454-4037-aefc-c5ff111f3ff0 req-f39c92bc-3404-49be-9662-88d2f9cdb0f0 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:41.851371 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26396b86-162d-4c8b-9388-16c7263e75ee admin admin] Pushing event deleted for resources: {'Network': ['ID=8e0b26d7-eefe-4c85-b535-944f3c15f0f6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:41.860952 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-927f53cb-d454-4037-aefc-c5ff111f3ff0 req-f39c92bc-3404-49be-9662-88d2f9cdb0f0 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=b7584b26-427d-42a9-a7d7-2fbd2f063a84 HTTP/1.1" status: 200 len: 931 time: 0.2924905 Dec 09 21:23:41.964329 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0cf121dd-dbe7-4e89-b495-97b20dc3a28a req-25708417-5839-4a96-ba82-6a1f384dde1a tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3574872 Dec 09 21:23:41.966206 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-94ea13cd-7e1b-4d1c-81c2-4e2d58fe1feb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:41.999150 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35190) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:42.021443 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-0c91271d-28cf-4e89-85f7-ec584040edba tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:42.036642 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['2f1265f7-0579-475d-9faa-f23ade6ec46b'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:23:42.039034 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-0c91271d-28cf-4e89-85f7-ec584040edba tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f&tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&binding%3Ahost_id=n-h2-713301-27 HTTP/1.1" status: 200 len: 1098 time: 0.6187563 Dec 09 21:23:42.064227 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-fafc2e9f-ac37-4e58-ada0-ee3658ad270f service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h1-713301-27'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:23:42.084266 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-927f53cb-d454-4037-aefc-c5ff111f3ff0 req-53a99151-fd00-44fd-95b1-9a4d9e16a854 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2222121 Dec 09 21:23:42.097584 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ed866114-cd00-4fe4-b291-61c51768dbd0 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=7233ac85d55e4123a22cfa34bc1ee70e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0951111 Dec 09 21:23:42.100219 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35194) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:42.224376 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7604cfe7-6a20-4212-ac7d-57d16969b9fd', 'tag': '6f6b3fc9-0b99-4cad-869c-ed52dde9578b'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:42.226613 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d05edefe-5e80-45b7-8302-01a824053758" -d '{"events": [{"name": "network-changed", "server_uuid": "7604cfe7-6a20-4212-ac7d-57d16969b9fd", "tag": "6f6b3fc9-0b99-4cad-869c-ed52dde9578b"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:42.271938 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de722f2f-2d02-4f00-9e53-4ecb486e1e66 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:42.307356 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de722f2f-2d02-4f00-9e53-4ecb486e1e66 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:42.373984 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de722f2f-2d02-4f00-9e53-4ecb486e1e66 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:42.378409 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de722f2f-2d02-4f00-9e53-4ecb486e1e66 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:42.383090 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-de722f2f-2d02-4f00-9e53-4ecb486e1e66 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/bb79590c-1611-4a8a-896f-563610f46135 HTTP/1.1" status: 204 len: 168 time: 0.2813160 Dec 09 21:23:42.404209 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de722f2f-2d02-4f00-9e53-4ecb486e1e66 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bb79590c-1611-4a8a-896f-563610f46135,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:42.414304 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9b9944c-6878-45f6-812f-93e435597ca7 req-d5227f84-c111-4c87-86e3-ca110e35ea70 service neutron] 10.222.0.10 "GET /v2.0/networks/9b3c0886-168c-4d9c-83a4-145e87393715?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7956026 Dec 09 21:23:42.888727 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-fafc2e9f-ac37-4e58-ada0-ee3658ad270f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:42.933773 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a56055eb-8a51-4f7e-bb52-cdd4cae6cfe5 req-df0e4c1b-c7a0-4851-a070-1adb211846ca tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:42.935580 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a56055eb-8a51-4f7e-bb52-cdd4cae6cfe5 req-df0e4c1b-c7a0-4851-a070-1adb211846ca tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/ports?device_id=99185349-bf6b-4cb8-a80b-ebf360aecfbb HTTP/1.1" status: 200 len: 944 time: 0.6372440 Dec 09 21:23:42.951913 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e538bac8-d691-4a98-8ea7-a22b8b36cd18 req-04327acb-f0ed-444f-80a1-e9ee0ea4640d tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:42.960287 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e538bac8-d691-4a98-8ea7-a22b8b36cd18 req-04327acb-f0ed-444f-80a1-e9ee0ea4640d tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 948 time: 0.5961647 Dec 09 21:23:43.164132 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e538bac8-d691-4a98-8ea7-a22b8b36cd18 req-fee013f9-0f1a-4a53-a237-87d3ea9a065d tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2015545 Dec 09 21:23:43.240016 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e077e18b-29ac-43c8-8d5c-732b57934349 x-openstack-request-id: req-e077e18b-29ac-43c8-8d5c-732b57934349 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:43.240398 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7604cfe7-6a20-4212-ac7d-57d16969b9fd", "tag": "6f6b3fc9-0b99-4cad-869c-ed52dde9578b", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:43.240663 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e077e18b-29ac-43c8-8d5c-732b57934349 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:43.241129 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7604cfe7-6a20-4212-ac7d-57d16969b9fd', 'tag': '6f6b3fc9-0b99-4cad-869c-ed52dde9578b', 'status': 'completed', 'code': 200} Dec 09 21:23:43.254879 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a56055eb-8a51-4f7e-bb52-cdd4cae6cfe5 req-7dd21f04-7110-4b1e-8394-02bc697d6883 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/security-groups?id=502403b3-5851-499b-ae86-dd222b0f8aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2907705 Dec 09 21:23:43.320217 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 2f1265f7-0579-475d-9faa-f23ade6ec46b up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:23:43.357563 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-94ea13cd-7e1b-4d1c-81c2-4e2d58fe1feb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id df55306b-f9c9-42b2-a899-aa67e74612f6 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:23:43.366206 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-94ea13cd-7e1b-4d1c-81c2-4e2d58fe1feb service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:43.375331 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d05edefe-5e80-45b7-8302-01a824053758 req-1e6f5e41-a3a3-4687-8200-9b3518f18a78 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:43.379540 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-94ea13cd-7e1b-4d1c-81c2-4e2d58fe1feb service neutron] Transition to ACTIVE for port object df55306b-f9c9-42b2-a899-aa67e74612f6 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:23:43.381565 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d05edefe-5e80-45b7-8302-01a824053758 req-1e6f5e41-a3a3-4687-8200-9b3518f18a78 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=857de64ecc3946e3b92655f639d782df&device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 1100 time: 0.1052418 Dec 09 21:23:43.424317 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-fafc2e9f-ac37-4e58-ada0-ee3658ad270f service neutron] For port 13499602-258c-4839-b928-17aef0d24310, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=13499602-258c-4839-b928-17aef0d24310,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:43.451476 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-94ea13cd-7e1b-4d1c-81c2-4e2d58fe1feb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:43.476398 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 2f1265f7-0579-475d-9faa-f23ade6ec46b completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:23:43.480835 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 2f1265f7-0579-475d-9faa-f23ade6ec46b triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:23:43.481237 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:43.493613 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35238) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:43.542877 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d05edefe-5e80-45b7-8302-01a824053758 req-63e585d0-2167-4bfc-ae1c-4d69a9e919f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:43.544492 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d05edefe-5e80-45b7-8302-01a824053758 req-63e585d0-2167-4bfc-ae1c-4d69a9e919f8 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.1544082 Dec 09 21:23:43.597486 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d05edefe-5e80-45b7-8302-01a824053758 req-aa5fb7d1-5fe1-4581-bbe3-ed7a3623e981 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.12&port_id=6f6b3fc9-0b99-4cad-869c-ed52dde9578b HTTP/1.1" status: 200 len: 217 time: 0.0454683 Dec 09 21:23:43.632948 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:43.665281 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d05edefe-5e80-45b7-8302-01a824053758 req-fddb842c-db64-4725-8e49-9fae4b8c9e57 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:43.669332 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d05edefe-5e80-45b7-8302-01a824053758 req-fddb842c-db64-4725-8e49-9fae4b8c9e57 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0654557 Dec 09 21:23:43.669689 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6f6b3fc9-0b99-4cad-869c-ed52dde9578b details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:23:43.680805 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Request body: {'network': {'name': 'tempest-ImagesOneServerNegativeTestJSON-793564544-network', 'tenant_id': '6b406d0a75bb4ddd96157ff43fd37096'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:23:43.682316 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '99185349-bf6b-4cb8-a80b-ebf360aecfbb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2f1265f7-0579-475d-9faa-f23ade6ec46b'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:43.685295 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7cab8fe4-a83a-48dc-a93b-f95c2de03db0" -d '{"events": [{"server_uuid": "99185349-bf6b-4cb8-a80b-ebf360aecfbb", "name": "network-vif-plugged", "status": "completed", "tag": "2f1265f7-0579-475d-9faa-f23ade6ec46b"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:43.709039 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 2f1265f7-0579-475d-9faa-f23ade6ec46b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=2f1265f7-0579-475d-9faa-f23ade6ec46b,segment=NetworkSegment(2d25d46c-e6fd-49a0-8d61-31fba8f6eefc),segment_id=2d25d46c-e6fd-49a0-8d61-31fba8f6eefc)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:43.717638 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:43.741558 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Made reservation on behalf of 6b406d0a75bb4ddd96157ff43fd37096 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:23:43.744166 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:43.755211 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:43.755880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-fafc2e9f-ac37-4e58-ada0-ee3658ad270f service neutron] For port 13499602-258c-4839-b928-17aef0d24310, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:23:43.770208 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d05edefe-5e80-45b7-8302-01a824053758 req-53f123f8-f342-4471-abac-52db9c09f825 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:43.772002 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d05edefe-5e80-45b7-8302-01a824053758 req-53f123f8-f342-4471-abac-52db9c09f825 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0871983 Dec 09 21:23:43.778355 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ed8b54f-bd72-4f22-b94a-07f6b0f118fc req-4bab857c-9860-409b-8952-66afae992abf tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:43.788500 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5ed8b54f-bd72-4f22-b94a-07f6b0f118fc req-4bab857c-9860-409b-8952-66afae992abf tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=b7584b26-427d-42a9-a7d7-2fbd2f063a84 HTTP/1.1" status: 200 len: 943 time: 0.4048014 Dec 09 21:23:43.822697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94ea13cd-7e1b-4d1c-81c2-4e2d58fe1feb service neutron] Pushing event updated for resources: {'Port': ['ID=df55306b-f9c9-42b2-a899-aa67e74612f6,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:43.854591 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d83a1eb4-1d7d-49ad-adce-4937f7f2863c req-04c67598-e431-4b60-a88e-e2331e05a260 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:43.856228 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d83a1eb4-1d7d-49ad-adce-4937f7f2863c req-04c67598-e431-4b60-a88e-e2331e05a260 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 946 time: 0.4094801 Dec 09 21:23:43.929358 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d05edefe-5e80-45b7-8302-01a824053758 req-d8552ab2-0ccd-47c0-b648-2085e1152731 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1489141 Dec 09 21:23:43.960851 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7300996b-d799-47a2-9728-a8551719a88f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '13499602-258c-4839-b928-17aef0d24310'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:43.963373 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-99a45744-cfbc-4cdb-b832-bd5b8186af41" -d '{"events": [{"server_uuid": "7300996b-d799-47a2-9728-a8551719a88f", "name": "network-vif-unplugged", "status": "completed", "tag": "13499602-258c-4839-b928-17aef0d24310"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:43.983543 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-fafc2e9f-ac37-4e58-ada0-ee3658ad270f service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:44.012103 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-fafc2e9f-ac37-4e58-ada0-ee3658ad270f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:44.018497 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-94ea13cd-7e1b-4d1c-81c2-4e2d58fe1feb service neutron] Attempting to bind port df55306b-f9c9-42b2-a899-aa67e74612f6 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:23:44.019301 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-94ea13cd-7e1b-4d1c-81c2-4e2d58fe1feb service neutron] Attempting to bind port df55306b-f9c9-42b2-a899-aa67e74612f6 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:23:44.020087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-94ea13cd-7e1b-4d1c-81c2-4e2d58fe1feb service neutron] Attempting to bind port df55306b-f9c9-42b2-a899-aa67e74612f6 on network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:23:44.032497 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-94ea13cd-7e1b-4d1c-81c2-4e2d58fe1feb service neutron] Port df55306b-f9c9-42b2-a899-aa67e74612f6 on network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:23:44.032906 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-94ea13cd-7e1b-4d1c-81c2-4e2d58fe1feb service neutron] Attempting to bind port df55306b-f9c9-42b2-a899-aa67e74612f6 on network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:23:44.056556 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d05edefe-5e80-45b7-8302-01a824053758 req-16caf4aa-aa97-480e-94eb-979734695429 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1173596 Dec 09 21:23:44.058727 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:44.066361 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:44.087473 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5ed8b54f-bd72-4f22-b94a-07f6b0f118fc req-163da175-31e5-4ae4-87f0-09d8fedea219 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2978590 Dec 09 21:23:44.108263 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=2f1265f7-0579-475d-9faa-f23ade6ec46b,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:44.129342 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] vlan segment allocate from pool success with {'vlan_id': 147, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:23:44.149159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=47e50f10-7095-4f13-aafe-6bb7c79987c2,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:44.154086 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:44.162869 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:44.163553 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:44.164079 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:44.164645 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:44.165278 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:44.166665 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:44.167197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:44.167778 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:44.167911 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '6f6b3fc9-0b99-4cad-869c-ed52dde9578b', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '6f6b3fc9-0b99-4cad-869c-ed52dde9578b', 'mac_address': 'fa:16:3e:67:2a:05', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:23:44.168071 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-94ea13cd-7e1b-4d1c-81c2-4e2d58fe1feb service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 23, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:23:44.168395 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-94ea13cd-7e1b-4d1c-81c2-4e2d58fe1feb service neutron] Checking segment: {'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:23:44.168792 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:44.169506 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:44.170028 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:44.170941 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:44.171617 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:23:44.173575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-94ea13cd-7e1b-4d1c-81c2-4e2d58fe1feb service neutron] Bound using segment: {'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:23:44.174113 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-94ea13cd-7e1b-4d1c-81c2-4e2d58fe1feb service neutron] Bound port: df55306b-f9c9-42b2-a899-aa67e74612f6, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:23:44.174426 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-94ea13cd-7e1b-4d1c-81c2-4e2d58fe1feb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:44.184126 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:44.186815 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Added segment 77d1b765-2404-4dd1-ab6e-956ebecc3e04 of type vlan for network c2615978-1c59-4fbb-826b-fc6aec14e987 Dec 09 21:23:44.230127 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d83a1eb4-1d7d-49ad-adce-4937f7f2863c req-ff99cb5a-4e95-4ccb-b938-7c5ecf653aa5 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3505297 Dec 09 21:23:44.249500 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:44.277018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6f6b3fc9-0b99-4cad-869c-ed52dde9578b {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:23:44.305469 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:44.308443 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:44.317004 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:44.318920 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 13499602-258c-4839-b928-17aef0d24310 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:23:44.338678 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fafc2e9f-ac37-4e58-ada0-ee3658ad270f service neutron] Pushing event updated for resources: {'Port': ['ID=13499602-258c-4839-b928-17aef0d24310,revision_number=7']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:44.367787 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:44.368924 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:44.369775 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:44.427926 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e33f2346-2da9-4276-be4c-c1604d7f89b4 x-openstack-request-id: req-e33f2346-2da9-4276-be4c-c1604d7f89b4 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:44.428646 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "99185349-bf6b-4cb8-a80b-ebf360aecfbb", "name": "network-vif-plugged", "status": "completed", "tag": "2f1265f7-0579-475d-9faa-f23ade6ec46b", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:44.428646 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e33f2346-2da9-4276-be4c-c1604d7f89b4 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:44.429032 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '99185349-bf6b-4cb8-a80b-ebf360aecfbb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2f1265f7-0579-475d-9faa-f23ade6ec46b', 'code': 200} Dec 09 21:23:44.461439 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-fafc2e9f-ac37-4e58-ada0-ee3658ad270f service neutron] Attempting to bind port 13499602-258c-4839-b928-17aef0d24310 on host n-h2-713301-27 for vnic_type normal with profile {"migrating_to": "n-h1-713301-27"} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:23:44.465782 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-fafc2e9f-ac37-4e58-ada0-ee3658ad270f service neutron] Attempting to bind port 13499602-258c-4839-b928-17aef0d24310 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:23:44.467820 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-fafc2e9f-ac37-4e58-ada0-ee3658ad270f service neutron] Attempting to bind port 13499602-258c-4839-b928-17aef0d24310 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:23:44.476302 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 894 time: 0.9790158 Dec 09 21:23:44.481932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35258) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:44.507179 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-46a3eb49-f180-4452-bcf7-e0e35b90486a admin admin] Request body: {'subnet': {'network_id': 'c2615978-1c59-4fbb-826b-fc6aec14e987', 'cidr': '172.20.0.0/28', 'name': 'tempest-ImagesOneServerNegativeTestJSON-793564544-subnet', 'tenant_id': '6b406d0a75bb4ddd96157ff43fd37096', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:23:44.528705 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-fafc2e9f-ac37-4e58-ada0-ee3658ad270f service neutron] Port 13499602-258c-4839-b928-17aef0d24310 on network 04fa749a-9f72-4a2c-a725-feab917f99ef not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:23:44.529201 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-fafc2e9f-ac37-4e58-ada0-ee3658ad270f service neutron] Attempting to bind port 13499602-258c-4839-b928-17aef0d24310 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:23:44.552617 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-fafc2e9f-ac37-4e58-ada0-ee3658ad270f service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 23, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:23:44.553192 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-fafc2e9f-ac37-4e58-ada0-ee3658ad270f service neutron] Checking segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:23:44.553620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-fafc2e9f-ac37-4e58-ada0-ee3658ad270f service neutron] Bound using segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:23:44.554178 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-fafc2e9f-ac37-4e58-ada0-ee3658ad270f service neutron] Bound port: 13499602-258c-4839-b928-17aef0d24310, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:23:44.554633 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-fafc2e9f-ac37-4e58-ada0-ee3658ad270f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:44.561061 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5ca12534-048f-4a7a-99c1-a8a4241d6291 x-openstack-request-id: req-5ca12534-048f-4a7a-99c1-a8a4241d6291 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:44.561580 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7300996b-d799-47a2-9728-a8551719a88f", "name": "network-vif-unplugged", "status": "completed", "tag": "13499602-258c-4839-b928-17aef0d24310", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:44.561923 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-5ca12534-048f-4a7a-99c1-a8a4241d6291 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:44.562510 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7300996b-d799-47a2-9728-a8551719a88f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '13499602-258c-4839-b928-17aef0d24310', 'code': 200} Dec 09 21:23:44.566350 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-978de87a-a796-48a9-9f24-44664d6610bd admin admin] Pushing event updated for resources: {'Network': ['ID=c2615978-1c59-4fbb-826b-fc6aec14e987,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:44.573741 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,revision_number=12']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:44.590694 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-94ea13cd-7e1b-4d1c-81c2-4e2d58fe1feb service neutron] For port df55306b-f9c9-42b2-a899-aa67e74612f6, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:23:44.593974 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network c2615978-1c59-4fbb-826b-fc6aec14e987 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:23:44.617567 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-46a3eb49-f180-4452-bcf7-e0e35b90486a admin admin] Made reservation on behalf of 6b406d0a75bb4ddd96157ff43fd37096 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:23:44.624003 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-46a3eb49-f180-4452-bcf7-e0e35b90486a admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:44.635178 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-94ea13cd-7e1b-4d1c-81c2-4e2d58fe1feb service neutron] For port df55306b-f9c9-42b2-a899-aa67e74612f6, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=df55306b-f9c9-42b2-a899-aa67e74612f6,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:23:44.652184 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-94ea13cd-7e1b-4d1c-81c2-4e2d58fe1feb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:44.733088 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-94ea13cd-7e1b-4d1c-81c2-4e2d58fe1feb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:44.736233 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-94ea13cd-7e1b-4d1c-81c2-4e2d58fe1feb service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:44.738065 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-94ea13cd-7e1b-4d1c-81c2-4e2d58fe1feb service neutron] 10.222.0.10 "PUT /v2.0/ports/df55306b-f9c9-42b2-a899-aa67e74612f6 HTTP/1.1" status: 200 len: 1092 time: 3.0621166 Dec 09 21:23:44.898582 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 13499602-258c-4839-b928-17aef0d24310, host n-h2-713301-27, got binding levels [] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:44.920565 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-790b898a-633d-41ab-9e53-aea20c2e0dfa req-65e5dc8a-0152-4553-bdbd-0725957b8590 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:44.922180 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-790b898a-633d-41ab-9e53-aea20c2e0dfa req-65e5dc8a-0152-4553-bdbd-0725957b8590 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=99185349-bf6b-4cb8-a80b-ebf360aecfbb HTTP/1.1" status: 200 len: 1097 time: 0.4164717 Dec 09 21:23:44.943247 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Attempting to bind port 13499602-258c-4839-b928-17aef0d24310 on host n-h2-713301-27 for vnic_type normal with profile {"migrating_to": "n-h1-713301-27"} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:23:44.943701 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Attempting to bind port 13499602-258c-4839-b928-17aef0d24310 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:23:44.944070 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Attempting to bind port 13499602-258c-4839-b928-17aef0d24310 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:23:44.949000 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Port 13499602-258c-4839-b928-17aef0d24310 on network 04fa749a-9f72-4a2c-a725-feab917f99ef not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:23:44.949359 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Attempting to bind port 13499602-258c-4839-b928-17aef0d24310 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:23:44.954972 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 23, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:23:44.955350 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Checking segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:23:44.957665 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Bound using segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:23:44.958154 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Bound port: 13499602-258c-4839-b928-17aef0d24310, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:23:44.958556 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:45.015537 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-46a3eb49-f180-4452-bcf7-e0e35b90486a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:45.045661 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-8d4e6f96-a298-47d2-84bc-0c3d2c7c9366 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:45.045661 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-8d4e6f96-a298-47d2-84bc-0c3d2c7c9366 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=1b7916b634f74760a565cfeaef510cd9&device_id=b7584b26-427d-42a9-a7d7-2fbd2f063a84 HTTP/1.1" status: 200 len: 1095 time: 0.1828120 Dec 09 21:23:45.063480 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-fafc2e9f-ac37-4e58-ada0-ee3658ad270f service neutron] For port 13499602-258c-4839-b928-17aef0d24310, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:23:45.099729 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94ea13cd-7e1b-4d1c-81c2-4e2d58fe1feb service neutron] Pushing event updated for resources: {'Port': ['ID=df55306b-f9c9-42b2-a899-aa67e74612f6,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:45.163481 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-758528b4-b3ae-4374-9950-0950499fa90f req-b0475b76-4ed0-4217-941b-b0811fc25ac1 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:45.163481 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-758528b4-b3ae-4374-9950-0950499fa90f req-b0475b76-4ed0-4217-941b-b0811fc25ac1 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/ports?device_id=99185349-bf6b-4cb8-a80b-ebf360aecfbb HTTP/1.1" status: 200 len: 945 time: 0.4032779 Dec 09 21:23:45.171971 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-fafc2e9f-ac37-4e58-ada0-ee3658ad270f service neutron] For port 13499602-258c-4839-b928-17aef0d24310, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=13499602-258c-4839-b928-17aef0d24310,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:23:45.177252 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46a3eb49-f180-4452-bcf7-e0e35b90486a admin admin] Pushing event updated for resources: {'Subnet': ['ID=1f5c65f5-5864-4e4e-bede-1bfc7f6e8e68,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:45.199216 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19bd78a7-09b6-44cf-8912-788bb145d268 req-52cd07e6-b4c7-495a-b6d9-26959955f797 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:45.199216 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19bd78a7-09b6-44cf-8912-788bb145d268 req-52cd07e6-b4c7-495a-b6d9-26959955f797 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 949 time: 0.5192060 Dec 09 21:23:45.203395 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-9af5bfb9-92a2-48dc-86f9-ffce4b8e6a56 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=df55306b-f9c9-42b2-a899-aa67e74612f6 HTTP/1.1" status: 200 len: 217 time: 0.1512790 Dec 09 21:23:45.236061 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 13499602-258c-4839-b928-17aef0d24310, host n-h2-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:23:45.239629 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67498ce6-2592-432f-92ca-366614da2975 req-ecb51040-ea01-46df-afca-8b2eb37c9769 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:45.241376 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-67498ce6-2592-432f-92ca-366614da2975 req-ecb51040-ea01-46df-afca-8b2eb37c9769 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.10 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 944 time: 0.2322311 Dec 09 21:23:45.243921 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Retry wrapper got retriable exception: Failed to create a duplicate PortBindingLevel: for attribute(s) ['ml2_port_binding_levels.PRIMARY'] with value(s) 13499602-258c-4839-b928-17aef0d24310-n-h2-713301-27-0 {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:23:45.244409 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin._bind_port_if_needed {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:23:45.265044 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-790b898a-633d-41ab-9e53-aea20c2e0dfa req-4de21744-9042-47c5-9ea5-d5806284aafc service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=502403b3-5851-499b-ae86-dd222b0f8aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3121049 Dec 09 21:23:45.266247 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-fafc2e9f-ac37-4e58-ada0-ee3658ad270f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:45.268327 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-46a3eb49-f180-4452-bcf7-e0e35b90486a admin admin] Checking segment: {'id': '77d1b765-2404-4dd1-ab6e-956ebecc3e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'c2615978-1c59-4fbb-826b-fc6aec14e987'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:23:45.269802 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46a3eb49-f180-4452-bcf7-e0e35b90486a admin admin] Network hostable DHCP agents. Network: c2615978-1c59-4fbb-826b-fc6aec14e987, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:23:45.331894 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46a3eb49-f180-4452-bcf7-e0e35b90486a admin admin] Network c2615978-1c59-4fbb-826b-fc6aec14e987 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:23:45.365053 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-46a3eb49-f180-4452-bcf7-e0e35b90486a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, c2615978-1c59-4fbb-826b-fc6aec14e987) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:23:45.370969 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46a3eb49-f180-4452-bcf7-e0e35b90486a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:45.371878 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-46a3eb49-f180-4452-bcf7-e0e35b90486a admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:45.384201 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e0074c9-c093-4656-94df-a0d6c2ad988c None None] Network c2615978-1c59-4fbb-826b-fc6aec14e987 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:23:45.406990 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-46a3eb49-f180-4452-bcf7-e0e35b90486a admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 858 time: 0.9200108 Dec 09 21:23:45.419698 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-758528b4-b3ae-4374-9950-0950499fa90f req-fd4ef06d-1cab-468a-8d6e-1e707aff53ce tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/security-groups?id=502403b3-5851-499b-ae86-dd222b0f8aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2501590 Dec 09 21:23:45.420823 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-67498ce6-2592-432f-92ca-366614da2975 req-e8461075-f984-4269-93b4-ddcebb6334e1 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Deleting port 2ba5fd1c-0009-4970-b169-7f8dca923e34 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:23:45.421230 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-67498ce6-2592-432f-92ca-366614da2975 req-e8461075-f984-4269-93b4-ddcebb6334e1 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:45.428215 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-2cce8714-3be1-4d46-bc33-763535278945 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:45.429694 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-2cce8714-3be1-4d46-bc33-763535278945 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=50496955-1646-4079-acd4-a47e8cd175cb HTTP/1.1" status: 200 len: 852 time: 0.1919448 Dec 09 21:23:45.476092 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19bd78a7-09b6-44cf-8912-788bb145d268 req-723e59c8-ff44-46f2-8c02-7d5ae7686ce7 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2807312 Dec 09 21:23:45.487545 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fafc2e9f-ac37-4e58-ada0-ee3658ad270f service neutron] Pushing event updated for resources: {'Port': ['ID=13499602-258c-4839-b928-17aef0d24310,revision_number=8']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:45.505224 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-fafc2e9f-ac37-4e58-ada0-ee3658ad270f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:45.505857 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-fafc2e9f-ac37-4e58-ada0-ee3658ad270f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:45.507277 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-fafc2e9f-ac37-4e58-ada0-ee3658ad270f service neutron] 10.222.0.31 "PUT /v2.0/ports/13499602-258c-4839-b928-17aef0d24310 HTTP/1.1" status: 200 len: 1124 time: 3.4600244 Dec 09 21:23:45.578106 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-7aeee030-c249-4625-b701-b1eaa01fb062 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0938795 Dec 09 21:23:45.609035 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-67498ce6-2592-432f-92ca-366614da2975 req-e8461075-f984-4269-93b4-ddcebb6334e1 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] For port 2ba5fd1c-0009-4970-b169-7f8dca923e34, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=2ba5fd1c-0009-4970-b169-7f8dca923e34,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:45.609714 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-67498ce6-2592-432f-92ca-366614da2975 req-e8461075-f984-4269-93b4-ddcebb6334e1 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:45.625760 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['13499602-258c-4839-b928-17aef0d24310'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:23:45.629258 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['13499602-258c-4839-b928-17aef0d24310'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:23:45.656843 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-67498ce6-2592-432f-92ca-366614da2975 req-e8461075-f984-4269-93b4-ddcebb6334e1 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Calling delete_port for 2ba5fd1c-0009-4970-b169-7f8dca923e34 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:23:45.700807 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5e8a260b-732f-4d52-a555-e73ea6df2af2 None None] Network c2615978-1c59-4fbb-826b-fc6aec14e987 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:23:45.800600 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65ba04ab-f059-4c93-80f5-d63c337493d9 req-fdcc1499-8bdd-4ccd-b9c9-0b56f06d63ae tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:45.808904 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-65ba04ab-f059-4c93-80f5-d63c337493d9 req-fdcc1499-8bdd-4ccd-b9c9-0b56f06d63ae tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42 HTTP/1.1" status: 200 len: 944 time: 0.2296762 Dec 09 21:23:45.828067 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Attempting to bind port 13499602-258c-4839-b928-17aef0d24310 on host n-h2-713301-27 for vnic_type normal with profile {"migrating_to": "n-h1-713301-27"} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:23:45.828450 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Attempting to bind port 13499602-258c-4839-b928-17aef0d24310 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:23:45.829039 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Attempting to bind port 13499602-258c-4839-b928-17aef0d24310 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:23:45.851521 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Port 13499602-258c-4839-b928-17aef0d24310 on network 04fa749a-9f72-4a2c-a725-feab917f99ef not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:23:45.852008 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Attempting to bind port 13499602-258c-4839-b928-17aef0d24310 on network 04fa749a-9f72-4a2c-a725-feab917f99ef {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:23:45.887466 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dcb62c1-3da3-4c21-9dc1-abbf1dde97fc req-4922be4c-6d7d-49bb-8366-93124e46bc9c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:45.889371 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6dcb62c1-3da3-4c21-9dc1-abbf1dde97fc req-4922be4c-6d7d-49bb-8366-93124e46bc9c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=b7584b26-427d-42a9-a7d7-2fbd2f063a84 HTTP/1.1" status: 200 len: 943 time: 0.3092766 Dec 09 21:23:45.900040 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 23, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:23:45.900565 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-67498ce6-2592-432f-92ca-366614da2975 req-e8461075-f984-4269-93b4-ddcebb6334e1 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:45.900708 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Checking segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:23:45.901158 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Bound using segment: {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:23:45.904530 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Bound port: 13499602-258c-4839-b928-17aef0d24310, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8f944fa4-4b9c-4641-8eba-ea83e62520ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '04fa749a-9f72-4a2c-a725-feab917f99ef'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:23:45.905085 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:45.936526 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-65ba04ab-f059-4c93-80f5-d63c337493d9 req-db7f863f-5c4a-4acc-acfc-04cf78226f8a tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1244626 Dec 09 21:23:45.937102 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8461075-f984-4269-93b4-ddcebb6334e1 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Pushing event deleted for resources: {'Port': ['ID=2ba5fd1c-0009-4970-b169-7f8dca923e34,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:45.999355 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-67498ce6-2592-432f-92ca-366614da2975 req-e8461075-f984-4269-93b4-ddcebb6334e1 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] No DVR routers for this DVR port 2ba5fd1c-0009-4970-b169-7f8dca923e34 on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:23:46.004107 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-67498ce6-2592-432f-92ca-366614da2975 req-e8461075-f984-4269-93b4-ddcebb6334e1 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:46.008079 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-67498ce6-2592-432f-92ca-366614da2975 req-e8461075-f984-4269-93b4-ddcebb6334e1 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.10 "DELETE /v2.0/ports/2ba5fd1c-0009-4970-b169-7f8dca923e34 HTTP/1.1" status: 204 len: 173 time: 0.7598488 Dec 09 21:23:46.008504 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-d1d0afd5-9046-4b40-bf82-e828f821126a service neutron] 10.222.0.10 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4013348 Dec 09 21:23:46.008930 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd0cb5c61-bab4-4b8b-aa1e-0efbe9992f42', 'name': 'network-vif-deleted', 'tag': '2ba5fd1c-0009-4970-b169-7f8dca923e34'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:46.013109 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1f111845-31fd-40ed-975a-4df27b85b5d1" -d '{"events": [{"server_uuid": "d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42", "name": "network-vif-deleted", "tag": "2ba5fd1c-0009-4970-b169-7f8dca923e34"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:46.053184 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6dcb62c1-3da3-4c21-9dc1-abbf1dde97fc req-81afbf72-f227-4b1c-95cb-655cca1b07b2 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1526697 Dec 09 21:23:46.101275 n-d-713301-27 neutron-server[103439]: WARNING neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Concurrent port binding operations failed on port 13499602-258c-4839-b928-17aef0d24310 Dec 09 21:23:46.155344 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 13499602-258c-4839-b928-17aef0d24310, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=13499602-258c-4839-b928-17aef0d24310,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:46.169695 n-d-713301-27 neutron-server[103439]: INFO neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Attempt 2 to bind port 13499602-258c-4839-b928-17aef0d24310 Dec 09 21:23:46.170452 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 13499602-258c-4839-b928-17aef0d24310 has no active binding in host n-h1-713301-27 {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:158}} Dec 09 21:23:46.290379 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a15af9-0099-4b29-b0a0-f9d53cf2d8fa req-b58efcd6-a068-4a70-a4d2-8e7551828afa tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:46.296165 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-95a15af9-0099-4b29-b0a0-f9d53cf2d8fa req-b58efcd6-a068-4a70-a4d2-8e7551828afa tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 944 time: 0.1071155 Dec 09 21:23:46.312318 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-065b201e-43ae-405f-9cd4-8e1eccc178f2 req-067c0398-195c-4ffd-9104-eb7647d87213 service neutron] 10.222.0.10 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2848160 Dec 09 21:23:46.385558 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-95a15af9-0099-4b29-b0a0-f9d53cf2d8fa req-adec64b0-e513-462f-ad8d-8d260d426863 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0856502 Dec 09 21:23:46.387655 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16ec5cd5-7b6e-417d-8a62-71decc3b7475 req-f75f8d80-a9a2-44eb-85ef-8632896a7a6d tempest-MigrationsAdminTest-775845712 tempest-MigrationsAdminTest-775845712-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:46.396820 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-16ec5cd5-7b6e-417d-8a62-71decc3b7475 req-f75f8d80-a9a2-44eb-85ef-8632896a7a6d tempest-MigrationsAdminTest-775845712 tempest-MigrationsAdminTest-775845712-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 1101 time: 0.0979588 Dec 09 21:23:46.473178 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-16ec5cd5-7b6e-417d-8a62-71decc3b7475 req-c6ced793-9afa-4386-aaee-0f14ef22e8fc tempest-MigrationsAdminTest-775845712 tempest-MigrationsAdminTest-775845712-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0697036 Dec 09 21:23:46.529891 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4d573981-4555-4e21-ada8-5fd1d609dc58 x-openstack-request-id: req-4d573981-4555-4e21-ada8-5fd1d609dc58 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:46.530177 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d0cb5c61-bab4-4b8b-aa1e-0efbe9992f42", "name": "network-vif-deleted", "tag": "2ba5fd1c-0009-4970-b169-7f8dca923e34", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:46.530434 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-4d573981-4555-4e21-ada8-5fd1d609dc58 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:46.530839 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd0cb5c61-bab4-4b8b-aa1e-0efbe9992f42', 'name': 'network-vif-deleted', 'tag': '2ba5fd1c-0009-4970-b169-7f8dca923e34', 'status': 'completed', 'code': 200} Dec 09 21:23:46.532878 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['6f6b3fc9-0b99-4cad-869c-ed52dde9578b'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:23:46.563900 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b7584b26-427d-42a9-a7d7-2fbd2f063a84', 'tag': 'df55306b-f9c9-42b2-a899-aa67e74612f6'}, {'name': 'network-changed', 'server_uuid': '7300996b-d799-47a2-9728-a8551719a88f', 'tag': '13499602-258c-4839-b928-17aef0d24310'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:46.566667 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-66740aeb-11ac-4ce7-88e4-9a0211917d6d" -d '{"events": [{"name": "network-changed", "server_uuid": "b7584b26-427d-42a9-a7d7-2fbd2f063a84", "tag": "df55306b-f9c9-42b2-a899-aa67e74612f6"}, {"name": "network-changed", "server_uuid": "7300996b-d799-47a2-9728-a8551719a88f", "tag": "13499602-258c-4839-b928-17aef0d24310"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:46.764414 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7366c29a-9eb7-41f1-976c-ccdbdff0d51f req-c5da87e3-040e-4ac2-a4e5-778a55bc93c6 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:46.767811 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7366c29a-9eb7-41f1-976c-ccdbdff0d51f req-c5da87e3-040e-4ac2-a4e5-778a55bc93c6 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/ports?device_id=99185349-bf6b-4cb8-a80b-ebf360aecfbb HTTP/1.1" status: 200 len: 945 time: 0.1493888 Dec 09 21:23:46.913225 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7366c29a-9eb7-41f1-976c-ccdbdff0d51f req-06430d44-d751-40cf-940d-fbfdf503fe96 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/security-groups?id=502403b3-5851-499b-ae86-dd222b0f8aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1284537 Dec 09 21:23:46.959961 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-b66280ec-04c8-446b-be1c-2ea0195b9a4e tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:46.961533 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-b66280ec-04c8-446b-be1c-2ea0195b9a4e tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/networks?id=c2615978-1c59-4fbb-826b-fc6aec14e987 HTTP/1.1" status: 200 len: 821 time: 0.1923652 Dec 09 21:23:46.977968 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-86c51b2c-a70e-4b3e-90d2-8e3414234621 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/quotas/6b406d0a75bb4ddd96157ff43fd37096 HTTP/1.1" status: 200 len: 375 time: 0.0101657 Dec 09 21:23:47.017735 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-82aa0eaf-a0cc-4e2f-9689-b24de01e5766 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=6b406d0a75bb4ddd96157ff43fd37096&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0324624 Dec 09 21:23:47.146536 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-a958b7a2-c83a-47d8-9ed9-d8f13ff444de service neutron] 10.222.0.13 "GET /v2.0/networks/c2615978-1c59-4fbb-826b-fc6aec14e987?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1182954 Dec 09 21:23:47.157538 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 346 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9ebd25b3-42f9-417e-b790-6ec195be10cf x-openstack-request-id: req-9ebd25b3-42f9-417e-b790-6ec195be10cf {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:47.157838 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b7584b26-427d-42a9-a7d7-2fbd2f063a84", "tag": "df55306b-f9c9-42b2-a899-aa67e74612f6", "status": "completed", "code": 200}, {"name": "network-changed", "server_uuid": "7300996b-d799-47a2-9728-a8551719a88f", "tag": "13499602-258c-4839-b928-17aef0d24310", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:47.158247 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-9ebd25b3-42f9-417e-b790-6ec195be10cf {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:47.158624 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b7584b26-427d-42a9-a7d7-2fbd2f063a84', 'tag': 'df55306b-f9c9-42b2-a899-aa67e74612f6', 'status': 'completed', 'code': 200} Dec 09 21:23:47.158880 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7300996b-d799-47a2-9728-a8551719a88f', 'tag': '13499602-258c-4839-b928-17aef0d24310', 'status': 'completed', 'code': 200} Dec 09 21:23:47.308632 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66740aeb-11ac-4ce7-88e4-9a0211917d6d req-4dffba9f-6cfc-4424-b07a-90bc7eaf879d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:47.310277 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66740aeb-11ac-4ce7-88e4-9a0211917d6d req-4dffba9f-6cfc-4424-b07a-90bc7eaf879d service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=1b7916b634f74760a565cfeaef510cd9&device_id=b7584b26-427d-42a9-a7d7-2fbd2f063a84 HTTP/1.1" status: 200 len: 1095 time: 0.1299474 Dec 09 21:23:47.340626 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 2ba5fd1c-0009-4970-b169-7f8dca923e34 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:23:47.360935 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-5f9d3d4e-c9d0-438e-9fe4-7f9e8076b38b service neutron] 10.222.0.13 "GET /v2.0/networks/c2615978-1c59-4fbb-826b-fc6aec14e987?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2125483 Dec 09 21:23:47.384442 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afb60643-e6c9-4e26-85c0-7483b22c860d req-6a5bd5ff-db60-4c4d-a804-36163c24c275 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:47.387008 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-afb60643-e6c9-4e26-85c0-7483b22c860d req-6a5bd5ff-db60-4c4d-a804-36163c24c275 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=b7584b26-427d-42a9-a7d7-2fbd2f063a84 HTTP/1.1" status: 200 len: 943 time: 0.1305802 Dec 09 21:23:47.398060 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 2ba5fd1c-0009-4970-b169-7f8dca923e34 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:23:47.398415 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 2ba5fd1c-0009-4970-b169-7f8dca923e34 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:23:47.485185 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66740aeb-11ac-4ce7-88e4-9a0211917d6d req-968a7691-8055-4993-9fee-9a20be4fb12d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:47.486822 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66740aeb-11ac-4ce7-88e4-9a0211917d6d req-968a7691-8055-4993-9fee-9a20be4fb12d service neutron] 10.222.0.10 "GET /v2.0/networks?id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb HTTP/1.1" status: 200 len: 913 time: 0.1676745 Dec 09 21:23:47.603059 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66740aeb-11ac-4ce7-88e4-9a0211917d6d req-00649161-c716-4b5d-928e-ada951a53a1b service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=df55306b-f9c9-42b2-a899-aa67e74612f6 HTTP/1.1" status: 200 len: 217 time: 0.1053386 Dec 09 21:23:47.606610 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-afb60643-e6c9-4e26-85c0-7483b22c860d req-46a101be-8203-465d-a978-d0fed4e1ea32 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1508255 Dec 09 21:23:47.733003 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66740aeb-11ac-4ce7-88e4-9a0211917d6d req-e412945a-ab0c-48c4-a27d-f385385eb5ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:47.733900 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66740aeb-11ac-4ce7-88e4-9a0211917d6d req-e412945a-ab0c-48c4-a27d-f385385eb5ff service neutron] 10.222.0.10 "GET /v2.0/subnets?id=50496955-1646-4079-acd4-a47e8cd175cb HTTP/1.1" status: 200 len: 852 time: 0.1168072 Dec 09 21:23:47.742689 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05c400a3-0bc1-479e-8f40-9fb8e900411a req-7efafef0-2a71-4ffb-a49a-47be58cb1841 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:47.744272 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-05c400a3-0bc1-479e-8f40-9fb8e900411a req-7efafef0-2a71-4ffb-a49a-47be58cb1841 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 949 time: 0.1367650 Dec 09 21:23:47.772992 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66740aeb-11ac-4ce7-88e4-9a0211917d6d req-48bd4593-5746-44a3-85fe-e5d90713a466 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0276566 Dec 09 21:23:47.866269 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-05c400a3-0bc1-479e-8f40-9fb8e900411a req-f71700b2-b265-4bbc-8733-b8c7436a027f tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0908792 Dec 09 21:23:48.026777 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66740aeb-11ac-4ce7-88e4-9a0211917d6d req-c6443dcb-2656-4a44-99a8-8f8e25c5a657 service neutron] 10.222.0.10 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2441871 Dec 09 21:23:48.170492 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-587b2b4b-4431-41e2-87b3-289834a3f080 req-20a3700c-8d59-4940-ab90-3648b60e5d91 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07 HTTP/1.1" status: 200 len: 210 time: 0.0539734 Dec 09 21:23:48.190823 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6f6b3fc9-0b99-4cad-869c-ed52dde9578b up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:23:48.258655 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6af87a90-0438-40c0-a9e5-032f2e6359d8 req-7836d606-bda6-42f9-8ccb-dfb16b096dc1 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:48.260945 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6af87a90-0438-40c0-a9e5-032f2e6359d8 req-7836d606-bda6-42f9-8ccb-dfb16b096dc1 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 944 time: 0.1729951 Dec 09 21:23:48.298376 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66740aeb-11ac-4ce7-88e4-9a0211917d6d req-05d292d2-3195-4056-b31d-c8f5c2d9a631 service neutron] 10.222.0.10 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2642949 Dec 09 21:23:48.325775 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:23:48.330281 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:23:48.330734 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:48.463861 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6af87a90-0438-40c0-a9e5-032f2e6359d8 req-1b17cb1e-b283-4d71-9434-7a927ae8fb2a tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1920342 Dec 09 21:23:48.476297 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e28fd693-63c2-4a96-9b52-c5bc141b823b req-77661ad8-490d-4f62-a49d-f501848a3bfa tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:48.488928 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e28fd693-63c2-4a96-9b52-c5bc141b823b req-77661ad8-490d-4f62-a49d-f501848a3bfa tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/ports?device_id=99185349-bf6b-4cb8-a80b-ebf360aecfbb HTTP/1.1" status: 200 len: 945 time: 0.1620016 Dec 09 21:23:48.518283 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:48.531140 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66740aeb-11ac-4ce7-88e4-9a0211917d6d req-27edee04-feef-4bf0-a3fd-54c5643e8366 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:48.535872 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66740aeb-11ac-4ce7-88e4-9a0211917d6d req-27edee04-feef-4bf0-a3fd-54c5643e8366 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 1127 time: 0.1643703 Dec 09 21:23:48.562715 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7604cfe7-6a20-4212-ac7d-57d16969b9fd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6f6b3fc9-0b99-4cad-869c-ed52dde9578b'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:48.565248 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-735b73f1-674c-4b91-aa22-8a83cec32047" -d '{"events": [{"server_uuid": "7604cfe7-6a20-4212-ac7d-57d16969b9fd", "name": "network-vif-plugged", "status": "completed", "tag": "6f6b3fc9-0b99-4cad-869c-ed52dde9578b"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:48.599913 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:48.607901 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:48.671162 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,revision_number=13']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:49.001637 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e28fd693-63c2-4a96-9b52-c5bc141b823b req-b70c13f9-9597-4150-bd8c-93665251f395 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/security-groups?id=502403b3-5851-499b-ae86-dd222b0f8aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5117807 Dec 09 21:23:49.035138 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-814a63c6-8137-4f7b-9f6a-79efe5ae05a4 req-daf30d9d-c2e5-47ed-8e55-1bf9359352bc tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:49.051120 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-814a63c6-8137-4f7b-9f6a-79efe5ae05a4 req-daf30d9d-c2e5-47ed-8e55-1bf9359352bc tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 944 time: 0.4635620 Dec 09 21:23:49.112826 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b2bd9cb-9721-40e3-9086-36eff91fa367 req-e6c4a2c7-f32b-4181-8ed4-cb4d1bc85bea tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:49.114404 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b2bd9cb-9721-40e3-9086-36eff91fa367 req-e6c4a2c7-f32b-4181-8ed4-cb4d1bc85bea tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.31 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 944 time: 0.2141225 Dec 09 21:23:49.125932 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2c2a9d18-3c6e-414f-a5a2-8e3e3b75602d x-openstack-request-id: req-2c2a9d18-3c6e-414f-a5a2-8e3e3b75602d {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:49.126302 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7604cfe7-6a20-4212-ac7d-57d16969b9fd", "name": "network-vif-plugged", "status": "completed", "tag": "6f6b3fc9-0b99-4cad-869c-ed52dde9578b", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:49.126599 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-2c2a9d18-3c6e-414f-a5a2-8e3e3b75602d {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:49.127196 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7604cfe7-6a20-4212-ac7d-57d16969b9fd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6f6b3fc9-0b99-4cad-869c-ed52dde9578b', 'code': 200} Dec 09 21:23:49.145917 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66740aeb-11ac-4ce7-88e4-9a0211917d6d req-a3c8a549-9c1d-4934-8a9a-ea368f7ea369 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:49.147108 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66740aeb-11ac-4ce7-88e4-9a0211917d6d req-a3c8a549-9c1d-4934-8a9a-ea368f7ea369 service neutron] 10.222.0.10 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 908 time: 0.6034391 Dec 09 21:23:49.179880 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e03eafd-341b-4c6a-804e-846e00c0b0a2 req-0a034bb9-3d62-4d2f-bc4a-b03786004365 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:49.181483 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5e03eafd-341b-4c6a-804e-846e00c0b0a2 req-0a034bb9-3d62-4d2f-bc4a-b03786004365 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.31 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 950 time: 0.1382451 Dec 09 21:23:49.350307 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device df55306b-f9c9-42b2-a899-aa67e74612f6 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:23:49.367269 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-814a63c6-8137-4f7b-9f6a-79efe5ae05a4 req-8a7bbe05-efb1-4ba4-8a9e-0d24855a362f tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3150928 Dec 09 21:23:49.380679 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-c605a45b-67e4-4375-aa6e-1425417ab7c1 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:49.382517 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-c605a45b-67e4-4375-aa6e-1425417ab7c1 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.31 "GET /v2.0/networks?id=c2615978-1c59-4fbb-826b-fc6aec14e987 HTTP/1.1" status: 200 len: 821 time: 0.2780056 Dec 09 21:23:49.413067 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-3fca1094-0fbe-42cb-b180-d83031c4bcba tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Request body: {'port': {'device_id': '2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07', 'network_id': 'c2615978-1c59-4fbb-826b-fc6aec14e987', 'admin_state_up': True, 'tenant_id': '6b406d0a75bb4ddd96157ff43fd37096'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:23:49.424838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-5e03eafd-341b-4c6a-804e-846e00c0b0a2 req-3e1f741e-d555-408b-b191-454b7a0bb492 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Deleting port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:23:49.426406 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5e03eafd-341b-4c6a-804e-846e00c0b0a2 req-3e1f741e-d555-408b-b191-454b7a0bb492 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:49.430045 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66740aeb-11ac-4ce7-88e4-9a0211917d6d req-d131a0ba-02c6-4409-b173-37b4c9f6d48e service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=13499602-258c-4839-b928-17aef0d24310 HTTP/1.1" status: 200 len: 217 time: 0.2377317 Dec 09 21:23:49.516677 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port df55306b-f9c9-42b2-a899-aa67e74612f6, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=df55306b-f9c9-42b2-a899-aa67e74612f6,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:49.555762 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'df55306b-f9c9-42b2-a899-aa67e74612f6', 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb', 'port_id': 'df55306b-f9c9-42b2-a899-aa67e74612f6', 'mac_address': 'fa:16:3e:90:10:1f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 101, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '50496955-1646-4079-acd4-a47e8cd175cb', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:23:49.629968 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:49.653581 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id df55306b-f9c9-42b2-a899-aa67e74612f6 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:23:49.703782 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port df55306b-f9c9-42b2-a899-aa67e74612f6, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=df55306b-f9c9-42b2-a899-aa67e74612f6,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:49.714483 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:49.720652 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88be74d6-c467-4a2e-85d4-75bdce49cd80 req-5fe0f68d-edf3-4e1a-aff6-42c47e9830f8 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:49.731209 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-88be74d6-c467-4a2e-85d4-75bdce49cd80 req-5fe0f68d-edf3-4e1a-aff6-42c47e9830f8 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=b7584b26-427d-42a9-a7d7-2fbd2f063a84 HTTP/1.1" status: 200 len: 943 time: 0.3552747 Dec 09 21:23:49.788892 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f505c9a-83ff-455a-8618-dba3f9c9b1db req-eb71d18e-cd87-4a7d-be39-191d5a963473 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:49.793954 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f505c9a-83ff-455a-8618-dba3f9c9b1db req-eb71d18e-cd87-4a7d-be39-191d5a963473 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=7604cfe7-6a20-4212-ac7d-57d16969b9fd HTTP/1.1" status: 200 len: 950 time: 0.1569760 Dec 09 21:23:49.819359 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66740aeb-11ac-4ce7-88e4-9a0211917d6d req-364d517c-0a7c-4497-8779-61933ac40c42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:49.821590 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66740aeb-11ac-4ce7-88e4-9a0211917d6d req-364d517c-0a7c-4497-8779-61933ac40c42 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=eae2438b-9fcc-44ef-a172-6c4911cad13f HTTP/1.1" status: 200 len: 847 time: 0.3489003 Dec 09 21:23:49.931390 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=df55306b-f9c9-42b2-a899-aa67e74612f6,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:49.938861 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-9b2bd9cb-9721-40e3-9086-36eff91fa367 req-ed0b05ac-ce88-44b8-908d-a3b11d87189d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Deleting port 85dcf098-2530-45e6-aecc-ec3e2e8888a6 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:23:49.940879 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9b2bd9cb-9721-40e3-9086-36eff91fa367 req-ed0b05ac-ce88-44b8-908d-a3b11d87189d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:50.028426 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66740aeb-11ac-4ce7-88e4-9a0211917d6d req-f9aad115-1d2b-4a1d-9979-498808e95992 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=04fa749a-9f72-4a2c-a725-feab917f99ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1939874 Dec 09 21:23:50.035394 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['df55306b-f9c9-42b2-a899-aa67e74612f6'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:23:50.058737 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-5e03eafd-341b-4c6a-804e-846e00c0b0a2 req-3e1f741e-d555-408b-b191-454b7a0bb492 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] For port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:50.059410 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5e03eafd-341b-4c6a-804e-846e00c0b0a2 req-3e1f741e-d555-408b-b191-454b7a0bb492 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:50.062072 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-88be74d6-c467-4a2e-85d4-75bdce49cd80 req-211a03a7-fbee-4a8f-b0b0-f8aebb5b5eb5 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3245902 Dec 09 21:23:50.109512 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-5e03eafd-341b-4c6a-804e-846e00c0b0a2 req-3e1f741e-d555-408b-b191-454b7a0bb492 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Calling delete_port for 6f6b3fc9-0b99-4cad-869c-ed52dde9578b owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:23:50.122456 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-3fca1094-0fbe-42cb-b180-d83031c4bcba tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Made reservation on behalf of 6b406d0a75bb4ddd96157ff43fd37096 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:23:50.126539 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-3fca1094-0fbe-42cb-b180-d83031c4bcba tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:50.181166 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f505c9a-83ff-455a-8618-dba3f9c9b1db req-47d731cc-aee9-4913-9622-c9cda4485fc9 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3725004 Dec 09 21:23:50.363570 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66740aeb-11ac-4ce7-88e4-9a0211917d6d req-13971dd7-1b7f-4540-bc00-12f2644c88ae service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3001192 Dec 09 21:23:50.417600 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-9b2bd9cb-9721-40e3-9086-36eff91fa367 req-ed0b05ac-ce88-44b8-908d-a3b11d87189d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] For port 85dcf098-2530-45e6-aecc-ec3e2e8888a6, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=85dcf098-2530-45e6-aecc-ec3e2e8888a6,segment=NetworkSegment(4bbda46b-e2e5-4ce1-b027-3fb09391026d),segment_id=4bbda46b-e2e5-4ce1-b027-3fb09391026d)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:50.418308 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9b2bd9cb-9721-40e3-9086-36eff91fa367 req-ed0b05ac-ce88-44b8-908d-a3b11d87189d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:50.491031 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71942081-7806-4ecf-bc31-9b947580a75e req-63d9a699-6bd3-4ef6-8a79-e9fa95d34990 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07 HTTP/1.1" status: 200 len: 210 time: 0.1241302 Dec 09 21:23:50.526465 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-3fca1094-0fbe-42cb-b180-d83031c4bcba tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Allocated IP 172.20.0.11 (c2615978-1c59-4fbb-826b-fc6aec14e987/1f5c65f5-5864-4e4e-bede-1bfc7f6e8e68/10a46e5c-6c20-45c6-bb7c-767cb5043f63) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:23:50.558265 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5e03eafd-341b-4c6a-804e-846e00c0b0a2 req-3e1f741e-d555-408b-b191-454b7a0bb492 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:50.570603 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['204e6970-8ed3-4e91-9792-52401052a153'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:23:50.593926 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-9b2bd9cb-9721-40e3-9086-36eff91fa367 req-ed0b05ac-ce88-44b8-908d-a3b11d87189d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Calling delete_port for 85dcf098-2530-45e6-aecc-ec3e2e8888a6 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:23:50.621992 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e1f741e-d555-408b-b191-454b7a0bb492 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Pushing event deleted for resources: {'Port': ['ID=6f6b3fc9-0b99-4cad-869c-ed52dde9578b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:50.701508 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-5e03eafd-341b-4c6a-804e-846e00c0b0a2 req-3e1f741e-d555-408b-b191-454b7a0bb492 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] No DVR routers for this DVR port 6f6b3fc9-0b99-4cad-869c-ed52dde9578b on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:23:50.716195 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5e03eafd-341b-4c6a-804e-846e00c0b0a2 req-3e1f741e-d555-408b-b191-454b7a0bb492 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:50.719011 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5e03eafd-341b-4c6a-804e-846e00c0b0a2 req-3e1f741e-d555-408b-b191-454b7a0bb492 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.31 "DELETE /v2.0/ports/6f6b3fc9-0b99-4cad-869c-ed52dde9578b HTTP/1.1" status: 204 len: 173 time: 1.5230522 Dec 09 21:23:50.719488 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7604cfe7-6a20-4212-ac7d-57d16969b9fd', 'name': 'network-vif-deleted', 'tag': '6f6b3fc9-0b99-4cad-869c-ed52dde9578b'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:50.722825 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-12c2ddbc-a57e-4910-9839-f23323149e09" -d '{"events": [{"server_uuid": "7604cfe7-6a20-4212-ac7d-57d16969b9fd", "name": "network-vif-deleted", "tag": "6f6b3fc9-0b99-4cad-869c-ed52dde9578b"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:50.853988 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['36925110-4ed7-49f6-b07d-d998896a74cc', 'e145c03d-6648-46c7-8b51-c9e9acd70ff2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:23:51.032334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6b3ffec-6803-43b0-94e4-f7f489ddab27 req-5f39a4dd-ad6f-4f7e-8748-49c49f635d1b tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:51.040383 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6b3ffec-6803-43b0-94e4-f7f489ddab27 req-5f39a4dd-ad6f-4f7e-8748-49c49f635d1b tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 944 time: 0.3853223 Dec 09 21:23:51.055982 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66740aeb-11ac-4ce7-88e4-9a0211917d6d req-1b9095bc-1cb6-44bd-9ec3-d3d7205d85b0 service neutron] 10.222.0.10 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6591868 Dec 09 21:23:51.100971 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-3fca1094-0fbe-42cb-b180-d83031c4bcba tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:51.105689 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ccd3e2c-3108-4f78-9317-74fb8a6c8af5 req-e4a18d61-1eaf-4de4-82d3-323ab7218382 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True&fields=id&id=97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 258 time: 0.8843303 Dec 09 21:23:51.111228 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-2ccd3e2c-3108-4f78-9317-74fb8a6c8af5 req-3aca0ce1-e124-487f-893f-9353b94cf216 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:23:51.187351 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6b3ffec-6803-43b0-94e4-f7f489ddab27 req-bc7e1024-7111-41a5-8cdc-e687b1e62aa2 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1458888 Dec 09 21:23:51.199576 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2ccd3e2c-3108-4f78-9317-74fb8a6c8af5 req-3aca0ce1-e124-487f-893f-9353b94cf216 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:51.237795 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-3fca1094-0fbe-42cb-b180-d83031c4bcba tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:51.357518 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device df55306b-f9c9-42b2-a899-aa67e74612f6 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:23:51.364728 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-3fca1094-0fbe-42cb-b180-d83031c4bcba tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Network c2615978-1c59-4fbb-826b-fc6aec14e987 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:23:51.368123 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-3fca1094-0fbe-42cb-b180-d83031c4bcba tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:23:51.380260 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-3fca1094-0fbe-42cb-b180-d83031c4bcba tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:23:51.491152 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de0542ec-33df-421e-acfd-2978aa3ce864 req-dd2013db-dfaf-4110-a2c5-00c91f71554d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:51.500250 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de0542ec-33df-421e-acfd-2978aa3ce864 req-dd2013db-dfaf-4110-a2c5-00c91f71554d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/ports?device_id=d2b3d687-3a7a-44b0-b7da-ae4f7e014981 HTTP/1.1" status: 200 len: 944 time: 0.1814992 Dec 09 21:23:51.510953 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9b2bd9cb-9721-40e3-9086-36eff91fa367 req-ed0b05ac-ce88-44b8-908d-a3b11d87189d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:51.548440 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-3fca1094-0fbe-42cb-b180-d83031c4bcba tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:51.549123 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-3fca1094-0fbe-42cb-b180-d83031c4bcba tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:51.551976 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port df55306b-f9c9-42b2-a899-aa67e74612f6 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:23:51.557783 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port df55306b-f9c9-42b2-a899-aa67e74612f6 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:23:51.558156 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:51.606926 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed0b05ac-ce88-44b8-908d-a3b11d87189d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Pushing event deleted for resources: {'Port': ['ID=85dcf098-2530-45e6-aecc-ec3e2e8888a6,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:51.614567 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-3fca1094-0fbe-42cb-b180-d83031c4bcba tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.2134950 Dec 09 21:23:51.615772 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fca1094-0fbe-42cb-b180-d83031c4bcba tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Pushing event updated for resources: {'Port': ['ID=10a46e5c-6c20-45c6-bb7c-767cb5043f63,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:51.627793 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-5f4d916b-cd3d-4372-a1b7-ff5e44c6cd31 service neutron] Request body: {'port': {'device_id': '2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:23:51.663620 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:51.706017 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de0542ec-33df-421e-acfd-2978aa3ce864 req-d7f7f303-bfce-4bda-8e04-b2e1920599f3 tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.13 "GET /v2.0/security-groups?id=04b35e67-a28a-4586-be0f-3c4eb594dede&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2038887 Dec 09 21:23:51.712833 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b7584b26-427d-42a9-a7d7-2fbd2f063a84', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'df55306b-f9c9-42b2-a899-aa67e74612f6'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:51.746778 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6e5f3881-bbd3-4234-9178-3327be2e694c" -d '{"events": [{"server_uuid": "b7584b26-427d-42a9-a7d7-2fbd2f063a84", "name": "network-vif-plugged", "status": "completed", "tag": "df55306b-f9c9-42b2-a899-aa67e74612f6"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:51.747513 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-5f4d916b-cd3d-4372-a1b7-ff5e44c6cd31 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:51.747806 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port df55306b-f9c9-42b2-a899-aa67e74612f6, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=df55306b-f9c9-42b2-a899-aa67e74612f6,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:51.762662 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:51.764635 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 13499602-258c-4839-b928-17aef0d24310 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:23:51.773293 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-9b2bd9cb-9721-40e3-9086-36eff91fa367 req-ed0b05ac-ce88-44b8-908d-a3b11d87189d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] No DVR routers for this DVR port 85dcf098-2530-45e6-aecc-ec3e2e8888a6 on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:23:51.777991 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9b2bd9cb-9721-40e3-9086-36eff91fa367 req-ed0b05ac-ce88-44b8-908d-a3b11d87189d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:51.781413 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b2bd9cb-9721-40e3-9086-36eff91fa367 req-ed0b05ac-ce88-44b8-908d-a3b11d87189d tempest-LiveAutoBlockMigrationV225Test-1081807675 tempest-LiveAutoBlockMigrationV225Test-1081807675-project] 10.222.0.31 "DELETE /v2.0/ports/85dcf098-2530-45e6-aecc-ec3e2e8888a6 HTTP/1.1" status: 204 len: 173 time: 2.6495788 Dec 09 21:23:51.789006 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd2b3d687-3a7a-44b0-b7da-ae4f7e014981', 'name': 'network-vif-deleted', 'tag': '85dcf098-2530-45e6-aecc-ec3e2e8888a6'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:51.795744 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d5387d5c-187e-4b49-9910-d60a6a4e25ec" -d '{"events": [{"server_uuid": "d2b3d687-3a7a-44b0-b7da-ae4f7e014981", "name": "network-vif-deleted", "tag": "85dcf098-2530-45e6-aecc-ec3e2e8888a6"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:51.828523 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2ccd3e2c-3108-4f78-9317-74fb8a6c8af5 req-3aca0ce1-e124-487f-893f-9353b94cf216 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:51.980605 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-50dc4560-e983-4330-985f-6fc5670f4ff3 x-openstack-request-id: req-50dc4560-e983-4330-985f-6fc5670f4ff3 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:51.980876 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7604cfe7-6a20-4212-ac7d-57d16969b9fd", "name": "network-vif-deleted", "tag": "6f6b3fc9-0b99-4cad-869c-ed52dde9578b", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:51.981133 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-50dc4560-e983-4330-985f-6fc5670f4ff3 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:51.981886 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7604cfe7-6a20-4212-ac7d-57d16969b9fd', 'name': 'network-vif-deleted', 'tag': '6f6b3fc9-0b99-4cad-869c-ed52dde9578b', 'status': 'completed', 'code': 200} Dec 09 21:23:51.987005 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=df55306b-f9c9-42b2-a899-aa67e74612f6,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:52.131888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-2ccd3e2c-3108-4f78-9317-74fb8a6c8af5 req-3aca0ce1-e124-487f-893f-9353b94cf216 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Allocated IP 172.25.3.8 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/b0884215-a314-4214-87fe-6402950b361a) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:23:52.143036 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-42574e97-efdb-4c48-a6e5-4a6e3b6dd272 service neutron] 10.222.0.10 "GET /v2.0/ports/13499602-258c-4839-b928-17aef0d24310/bindings/n-h1-713301-27 HTTP/1.1" status: 200 len: 385 time: 0.1817069 Dec 09 21:23:52.169566 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c45fc2a-33ae-45d1-a163-2756d810e2c0 req-d8fefba6-ca01-4f05-8822-3dda64dd71e2 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:52.171045 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7c45fc2a-33ae-45d1-a163-2756d810e2c0 req-d8fefba6-ca01-4f05-8822-3dda64dd71e2 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=b7584b26-427d-42a9-a7d7-2fbd2f063a84 HTTP/1.1" status: 200 len: 945 time: 0.1201153 Dec 09 21:23:52.187472 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-5f4d916b-cd3d-4372-a1b7-ff5e44c6cd31 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 10a46e5c-6c20-45c6-bb7c-767cb5043f63 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:23:52.195324 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-5f4d916b-cd3d-4372-a1b7-ff5e44c6cd31 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:52.207650 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-5f4d916b-cd3d-4372-a1b7-ff5e44c6cd31 service neutron] Transition to ACTIVE for port object 10a46e5c-6c20-45c6-bb7c-767cb5043f63 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:23:52.209320 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6f6b3fc9-0b99-4cad-869c-ed52dde9578b no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:23:52.213165 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-5f4d916b-cd3d-4372-a1b7-ff5e44c6cd31 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:52.244000 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 6f6b3fc9-0b99-4cad-869c-ed52dde9578b {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:23:52.244334 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6f6b3fc9-0b99-4cad-869c-ed52dde9578b not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:23:52.244715 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 85dcf098-2530-45e6-aecc-ec3e2e8888a6 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:23:52.269259 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 85dcf098-2530-45e6-aecc-ec3e2e8888a6 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:23:52.269500 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 85dcf098-2530-45e6-aecc-ec3e2e8888a6 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:23:52.303342 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f4d916b-cd3d-4372-a1b7-ff5e44c6cd31 service neutron] Pushing event updated for resources: {'Port': ['ID=10a46e5c-6c20-45c6-bb7c-767cb5043f63,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:52.318203 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7c45fc2a-33ae-45d1-a163-2756d810e2c0 req-83c55e9a-9b67-42f5-ad8a-79f3a9f7be2d tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1207392 Dec 09 21:23:52.336201 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-5f4d916b-cd3d-4372-a1b7-ff5e44c6cd31 service neutron] Attempting to bind port 10a46e5c-6c20-45c6-bb7c-767cb5043f63 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:23:52.336793 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-5f4d916b-cd3d-4372-a1b7-ff5e44c6cd31 service neutron] Attempting to bind port 10a46e5c-6c20-45c6-bb7c-767cb5043f63 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '77d1b765-2404-4dd1-ab6e-956ebecc3e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'c2615978-1c59-4fbb-826b-fc6aec14e987'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:23:52.337475 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-5f4d916b-cd3d-4372-a1b7-ff5e44c6cd31 service neutron] Attempting to bind port 10a46e5c-6c20-45c6-bb7c-767cb5043f63 on network c2615978-1c59-4fbb-826b-fc6aec14e987 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:23:52.342248 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-5f4d916b-cd3d-4372-a1b7-ff5e44c6cd31 service neutron] Port 10a46e5c-6c20-45c6-bb7c-767cb5043f63 on network c2615978-1c59-4fbb-826b-fc6aec14e987 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:23:52.342636 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-5f4d916b-cd3d-4372-a1b7-ff5e44c6cd31 service neutron] Attempting to bind port 10a46e5c-6c20-45c6-bb7c-767cb5043f63 on network c2615978-1c59-4fbb-826b-fc6aec14e987 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:23:52.349161 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-5f4d916b-cd3d-4372-a1b7-ff5e44c6cd31 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 23, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:23:52.349605 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-5f4d916b-cd3d-4372-a1b7-ff5e44c6cd31 service neutron] Checking segment: {'id': '77d1b765-2404-4dd1-ab6e-956ebecc3e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'c2615978-1c59-4fbb-826b-fc6aec14e987'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:23:52.350083 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-5f4d916b-cd3d-4372-a1b7-ff5e44c6cd31 service neutron] Bound using segment: {'id': '77d1b765-2404-4dd1-ab6e-956ebecc3e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'c2615978-1c59-4fbb-826b-fc6aec14e987'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:23:52.350608 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-5f4d916b-cd3d-4372-a1b7-ff5e44c6cd31 service neutron] Bound port: 10a46e5c-6c20-45c6-bb7c-767cb5043f63, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '77d1b765-2404-4dd1-ab6e-956ebecc3e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'c2615978-1c59-4fbb-826b-fc6aec14e987'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:23:52.351061 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-5f4d916b-cd3d-4372-a1b7-ff5e44c6cd31 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:52.361375 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2ccd3e2c-3108-4f78-9317-74fb8a6c8af5 req-3aca0ce1-e124-487f-893f-9353b94cf216 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:52.441838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-5f4d916b-cd3d-4372-a1b7-ff5e44c6cd31 service neutron] For port 10a46e5c-6c20-45c6-bb7c-767cb5043f63, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:23:52.446604 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-5f4d916b-cd3d-4372-a1b7-ff5e44c6cd31 service neutron] For port 10a46e5c-6c20-45c6-bb7c-767cb5043f63, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=10a46e5c-6c20-45c6-bb7c-767cb5043f63,segment=NetworkSegment(77d1b765-2404-4dd1-ab6e-956ebecc3e04),segment_id=77d1b765-2404-4dd1-ab6e-956ebecc3e04)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:23:52.470711 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2ccd3e2c-3108-4f78-9317-74fb8a6c8af5 req-3aca0ce1-e124-487f-893f-9353b94cf216 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:52.472238 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-5f4d916b-cd3d-4372-a1b7-ff5e44c6cd31 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:52.519940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-3910d86f-1838-40b9-be85-5c1bf714e858 service neutron] For port 13499602-258c-4839-b928-17aef0d24310, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=13499602-258c-4839-b928-17aef0d24310,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:52.536431 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-5f4d916b-cd3d-4372-a1b7-ff5e44c6cd31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:52.537070 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-5f4d916b-cd3d-4372-a1b7-ff5e44c6cd31 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:52.538593 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-5f4d916b-cd3d-4372-a1b7-ff5e44c6cd31 service neutron] 10.222.0.31 "PUT /v2.0/ports/10a46e5c-6c20-45c6-bb7c-767cb5043f63 HTTP/1.1" status: 200 len: 1093 time: 0.9152455 Dec 09 21:23:52.551617 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f4d916b-cd3d-4372-a1b7-ff5e44c6cd31 service neutron] Pushing event updated for resources: {'Port': ['ID=10a46e5c-6c20-45c6-bb7c-767cb5043f63,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:52.571954 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2ccd3e2c-3108-4f78-9317-74fb8a6c8af5 req-3aca0ce1-e124-487f-893f-9353b94cf216 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:23:52.583004 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-3910d86f-1838-40b9-be85-5c1bf714e858 service neutron] For port 13499602-258c-4839-b928-17aef0d24310, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:23:52.585836 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-2ccd3e2c-3108-4f78-9317-74fb8a6c8af5 req-3aca0ce1-e124-487f-893f-9353b94cf216 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:23:52.609820 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-2ccd3e2c-3108-4f78-9317-74fb8a6c8af5 req-3aca0ce1-e124-487f-893f-9353b94cf216 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:23:52.615467 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3aca0ce1-e124-487f-893f-9353b94cf216 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Pushing event updated for resources: {'Port': ['ID=b0884215-a314-4214-87fe-6402950b361a,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:52.638102 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-40839e32-a4f6-4864-95c8-a4002c48045e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:52.640051 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-40839e32-a4f6-4864-95c8-a4002c48045e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6b406d0a75bb4ddd96157ff43fd37096&device_id=2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07 HTTP/1.1" status: 200 len: 1096 time: 0.0451393 Dec 09 21:23:52.664775 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-3910d86f-1838-40b9-be85-5c1bf714e858 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 13499602-258c-4839-b928-17aef0d24310 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:23:52.676081 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b9c5d89-0836-4d8e-92df-25199ff81eb4 req-4cc0424f-958f-4521-9c5b-c5348f579925 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:52.677563 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b9c5d89-0836-4d8e-92df-25199ff81eb4 req-4cc0424f-958f-4521-9c5b-c5348f579925 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07 HTTP/1.1" status: 200 len: 944 time: 0.1486518 Dec 09 21:23:52.688650 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-78e84418-e0ef-4645-82a5-eb4380c257a1 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=10a46e5c-6c20-45c6-bb7c-767cb5043f63 HTTP/1.1" status: 200 len: 217 time: 0.0387707 Dec 09 21:23:52.690622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-3910d86f-1838-40b9-be85-5c1bf714e858 service neutron] For port 13499602-258c-4839-b928-17aef0d24310, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=13499602-258c-4839-b928-17aef0d24310,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:52.722644 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-3910d86f-1838-40b9-be85-5c1bf714e858 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:52.740019 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-10121cda-8237-4993-af1a-b744d484961e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:52.741508 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-10121cda-8237-4993-af1a-b744d484961e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=1f5c65f5-5864-4e4e-bede-1bfc7f6e8e68 HTTP/1.1" status: 200 len: 861 time: 0.0462749 Dec 09 21:23:52.774457 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-a85fd796-d25e-4dc8-9a4a-5c4440ad70cc service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=c2615978-1c59-4fbb-826b-fc6aec14e987&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0250809 Dec 09 21:23:52.819174 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b9c5d89-0836-4d8e-92df-25199ff81eb4 req-f8d64b20-0798-4867-babc-c5f685ff4254 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1312146 Dec 09 21:23:52.834454 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2ccd3e2c-3108-4f78-9317-74fb8a6c8af5 req-3aca0ce1-e124-487f-893f-9353b94cf216 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:52.882658 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c9220e4f-b1c4-40b0-8fd6-67536f55f424 x-openstack-request-id: req-c9220e4f-b1c4-40b0-8fd6-67536f55f424 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:52.883186 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b7584b26-427d-42a9-a7d7-2fbd2f063a84", "name": "network-vif-plugged", "status": "completed", "tag": "df55306b-f9c9-42b2-a899-aa67e74612f6", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:52.883287 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c9220e4f-b1c4-40b0-8fd6-67536f55f424 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:52.884052 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b7584b26-427d-42a9-a7d7-2fbd2f063a84', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'df55306b-f9c9-42b2-a899-aa67e74612f6', 'code': 200} Dec 09 21:23:52.885946 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-6ff87b06-9ba1-4576-8360-fdb5da4932b5 service neutron] 10.222.0.31 "GET /v2.0/networks/c2615978-1c59-4fbb-826b-fc6aec14e987?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1038239 Dec 09 21:23:53.028112 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0be70fa3-d2c9-4446-b7e9-bac80bae3dbd req-f6cd4451-86b7-44a1-8e6f-3ba8e7c7b5d9 service neutron] 10.222.0.31 "GET /v2.0/networks/c2615978-1c59-4fbb-826b-fc6aec14e987?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1347518 Dec 09 21:23:53.030855 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1869212-a4ce-440a-b9c2-6d469aba4c30 req-3edf3b45-2316-4b1b-a50a-42c99667d582 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:53.033796 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a1869212-a4ce-440a-b9c2-6d469aba4c30 req-3edf3b45-2316-4b1b-a50a-42c99667d582 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=b7584b26-427d-42a9-a7d7-2fbd2f063a84 HTTP/1.1" status: 200 len: 1097 time: 0.0679684 Dec 09 21:23:53.087029 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a1869212-a4ce-440a-b9c2-6d469aba4c30 req-b411ebd0-3565-45d0-a7b0-ccf3af623f8a service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457175 Dec 09 21:23:53.172040 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0bcb6d64-c715-47b9-9eb8-804d4d6f2d51 x-openstack-request-id: req-0bcb6d64-c715-47b9-9eb8-804d4d6f2d51 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:53.172308 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d2b3d687-3a7a-44b0-b7da-ae4f7e014981", "name": "network-vif-deleted", "tag": "85dcf098-2530-45e6-aecc-ec3e2e8888a6", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:53.172567 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0bcb6d64-c715-47b9-9eb8-804d4d6f2d51 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:53.173014 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd2b3d687-3a7a-44b0-b7da-ae4f7e014981', 'name': 'network-vif-deleted', 'tag': '85dcf098-2530-45e6-aecc-ec3e2e8888a6', 'status': 'completed', 'code': 200} Dec 09 21:23:53.196796 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-3910d86f-1838-40b9-be85-5c1bf714e858 service neutron] Transition to ACTIVE for port object 13499602-258c-4839-b928-17aef0d24310 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:23:53.213973 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-3910d86f-1838-40b9-be85-5c1bf714e858 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:53.215813 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2ccd3e2c-3108-4f78-9317-74fb8a6c8af5 req-3aca0ce1-e124-487f-893f-9353b94cf216 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:53.332171 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-3910d86f-1838-40b9-be85-5c1bf714e858 service neutron] No DVR routers for this DVR port 13499602-258c-4839-b928-17aef0d24310 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:23:53.347263 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-539a2a77-307a-40f6-b4ac-691932a31b23 req-1c074778-3ed3-42a5-86ae-3a5b38af0f16 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:53.348782 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-539a2a77-307a-40f6-b4ac-691932a31b23 req-1c074778-3ed3-42a5-86ae-3a5b38af0f16 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 944 time: 0.1725636 Dec 09 21:23:53.358802 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3910d86f-1838-40b9-be85-5c1bf714e858 service neutron] Pushing event updated for resources: {'Port': ['ID=13499602-258c-4839-b928-17aef0d24310,revision_number=10']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:53.457174 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-3910d86f-1838-40b9-be85-5c1bf714e858 service neutron] 10.222.0.10 "PUT /v2.0/ports/13499602-258c-4839-b928-17aef0d24310/bindings/n-h1-713301-27/activate HTTP/1.1" status: 200 len: 370 time: 1.3034761 Dec 09 21:23:53.505587 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-539a2a77-307a-40f6-b4ac-691932a31b23 req-a35e1c21-64b2-4cb3-ac14-6b174df083e0 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1433475 Dec 09 21:23:53.541624 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2ccd3e2c-3108-4f78-9317-74fb8a6c8af5 req-3aca0ce1-e124-487f-893f-9353b94cf216 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:53.548204 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2ccd3e2c-3108-4f78-9317-74fb8a6c8af5 req-3aca0ce1-e124-487f-893f-9353b94cf216 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:53.586171 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-81791329-1eda-4241-8864-8f052926f09e tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:53.587680 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-81791329-1eda-4241-8864-8f052926f09e tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f&tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&binding%3Ahost_id=n-h2-713301-27 HTTP/1.1" status: 200 len: 1097 time: 0.0726111 Dec 09 21:23:53.631866 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3aca0ce1-e124-487f-893f-9353b94cf216 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Pushing event updated for resources: {'Port': ['ID=b0884215-a314-4214-87fe-6402950b361a,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:53.647185 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2ccd3e2c-3108-4f78-9317-74fb8a6c8af5 req-3aca0ce1-e124-487f-893f-9353b94cf216 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:53.654459 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-49d8646d-e0f1-4cc7-af5c-b5c6ccb30262 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:53.656439 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-49d8646d-e0f1-4cc7-af5c-b5c6ccb30262 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f&tenant_id=ac5b7cefd8cc48cc83f38d3923aae132 HTTP/1.1" status: 200 len: 1097 time: 0.0565686 Dec 09 21:23:53.664608 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2ccd3e2c-3108-4f78-9317-74fb8a6c8af5 req-3aca0ce1-e124-487f-893f-9353b94cf216 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:53.665901 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ccd3e2c-3108-4f78-9317-74fb8a6c8af5 req-3aca0ce1-e124-487f-893f-9353b94cf216 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 696 time: 2.5592597 Dec 09 21:23:53.728047 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ccd3e2c-3108-4f78-9317-74fb8a6c8af5 req-c382f0ed-b34b-4a5a-873b-fa9feace57f9 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.8 HTTP/1.1" status: 200 len: 694 time: 0.0543427 Dec 09 21:23:53.730310 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-98deb72c-1a54-427d-b7be-54ab245e0502 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:53.731888 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-98deb72c-1a54-427d-b7be-54ab245e0502 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 1097 time: 0.0501423 Dec 09 21:23:53.823398 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35432) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:53.878444 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-07fdce8b-4821-440d-8920-adff3a496a89 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:53.880390 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-07fdce8b-4821-440d-8920-adff3a496a89 service neutron] 10.222.0.31 "GET /v2.0/networks?id=04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 200 len: 908 time: 0.1409931 Dec 09 21:23:53.887797 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ccd3e2c-3108-4f78-9317-74fb8a6c8af5 req-58c4c254-8a5a-436e-b622-5183e2a6f5fc tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:53.890189 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ccd3e2c-3108-4f78-9317-74fb8a6c8af5 req-58c4c254-8a5a-436e-b622-5183e2a6f5fc tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.1549473 Dec 09 21:23:53.974806 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-158e2901-3686-426d-85c7-93c7404080ae service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=13499602-258c-4839-b928-17aef0d24310 HTTP/1.1" status: 200 len: 217 time: 0.0874119 Dec 09 21:23:53.982784 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07', 'tag': '10a46e5c-6c20-45c6-bb7c-767cb5043f63'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:53.986608 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-44e87948-5860-4eb6-a5e2-0f17693d6c4d" -d '{"events": [{"name": "network-changed", "server_uuid": "2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07", "tag": "10a46e5c-6c20-45c6-bb7c-767cb5043f63"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:54.046659 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-d1c93e82-ea4b-43ec-baa4-ccc9454145ad admin admin] Deleting subnet c49a62cc-af1b-4958-a4a9-eb44188b8fb9 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:23:54.054440 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d1c93e82-ea4b-43ec-baa4-ccc9454145ad admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:54.055824 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a38f76e3-3144-48c0-a006-66b206a6ac0b req-aec2ea47-31d4-4c95-ba49-768609069445 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:54.057404 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a38f76e3-3144-48c0-a006-66b206a6ac0b req-aec2ea47-31d4-4c95-ba49-768609069445 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=b7584b26-427d-42a9-a7d7-2fbd2f063a84 HTTP/1.1" status: 200 len: 945 time: 0.0948486 Dec 09 21:23:54.066018 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9038007e-ace4-41fe-b5a4-a4ca025f7195 req-e80963be-bedc-4588-9142-d423fab76ac9 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:54.067539 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9038007e-ace4-41fe-b5a4-a4ca025f7195 req-e80963be-bedc-4588-9142-d423fab76ac9 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/ports?device_id=8f48a806-013e-480e-81ac-1a7f5f10c155 HTTP/1.1" status: 200 len: 951 time: 0.1067278 Dec 09 21:23:54.090516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-5123af8f-182a-433d-b3f8-53cd6f2e6ec5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:54.091932 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-5123af8f-182a-433d-b3f8-53cd6f2e6ec5 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=eae2438b-9fcc-44ef-a172-6c4911cad13f HTTP/1.1" status: 200 len: 847 time: 0.1034701 Dec 09 21:23:54.101052 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d1c93e82-ea4b-43ec-baa4-ccc9454145ad admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:54.158786 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a38f76e3-3144-48c0-a006-66b206a6ac0b req-81eb41f8-49cb-4a60-93e1-a74c60e63401 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0900855 Dec 09 21:23:54.165185 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-d0f84819-81f5-456a-b164-406f63183d22 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=04fa749a-9f72-4a2c-a725-feab917f99ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0611663 Dec 09 21:23:54.167595 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9038007e-ace4-41fe-b5a4-a4ca025f7195 req-4af039a3-6387-4901-b79c-a5b2bd5a6048 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/security-groups?id=24094cbf-e652-478e-bb06-edc8eb774ee3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0919194 Dec 09 21:23:54.213988 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d1c93e82-ea4b-43ec-baa4-ccc9454145ad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:54.322669 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-6ae0ee99-e3fc-4507-af99-8791a0ae87de service neutron] 10.222.0.31 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1503692 Dec 09 21:23:54.358349 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d1c93e82-ea4b-43ec-baa4-ccc9454145ad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:54.361966 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec309e65-a216-4a80-a51a-f28b7612ebc6 req-17f06a04-98d9-40c5-93a3-c931cf050d57 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:54.364340 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec309e65-a216-4a80-a51a-f28b7612ebc6 req-17f06a04-98d9-40c5-93a3-c931cf050d57 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 951 time: 0.0981739 Dec 09 21:23:54.384004 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b7199eb-a7d5-46cd-9674-83f64f22619f req-be9ed6b7-6a5c-4b39-b1f9-4ab4b2ce0163 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:54.386302 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b7199eb-a7d5-46cd-9674-83f64f22619f req-be9ed6b7-6a5c-4b39-b1f9-4ab4b2ce0163 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07 HTTP/1.1" status: 200 len: 944 time: 0.0858822 Dec 09 21:23:54.401816 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d1c93e82-ea4b-43ec-baa4-ccc9454145ad admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:54.405781 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d1c93e82-ea4b-43ec-baa4-ccc9454145ad admin admin] 10.222.0.13 "DELETE /v2.0/subnets/c49a62cc-af1b-4958-a4a9-eb44188b8fb9 HTTP/1.1" status: 204 len: 168 time: 0.5808415 Dec 09 21:23:54.409563 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1c93e82-ea4b-43ec-baa4-ccc9454145ad admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c49a62cc-af1b-4958-a4a9-eb44188b8fb9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:54.412310 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35444) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:54.476220 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec309e65-a216-4a80-a51a-f28b7612ebc6 req-48e63183-c32d-49a2-a3b9-7e8ade3efe9e tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1033709 Dec 09 21:23:54.481370 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b7199eb-a7d5-46cd-9674-83f64f22619f req-7dcc94e8-123b-4196-82b5-c53e0c327990 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0887330 Dec 09 21:23:54.544945 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-98d130fc-744e-4075-9fd6-725d02cd432d x-openstack-request-id: req-98d130fc-744e-4075-9fd6-725d02cd432d {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:54.545269 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07", "tag": "10a46e5c-6c20-45c6-bb7c-767cb5043f63", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:54.545619 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-98d130fc-744e-4075-9fd6-725d02cd432d {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:54.546123 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07', 'tag': '10a46e5c-6c20-45c6-bb7c-767cb5043f63', 'status': 'completed', 'code': 200} Dec 09 21:23:54.554403 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4b678c51-e0ea-4932-ad47-6cf916e8ec61 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:54.559991 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-50500bd1-1a1b-4e66-9ebd-3b278934b77a service neutron] 10.222.0.31 "GET /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2267854 Dec 09 21:23:54.623306 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7711acb4-512a-4092-abf2-c048cf94982a req-74427921-f5f9-49fd-9296-aa7f1ab1ca0e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:54.625301 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7711acb4-512a-4092-abf2-c048cf94982a req-74427921-f5f9-49fd-9296-aa7f1ab1ca0e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/ports?device_id=99185349-bf6b-4cb8-a80b-ebf360aecfbb&device_owner=compute%3Anova HTTP/1.1" status: 200 len: 945 time: 0.0598717 Dec 09 21:23:54.660152 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44e87948-5860-4eb6-a5e2-0f17693d6c4d req-ed057e79-0e1e-4900-a6ef-6c0b69bc1d32 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:54.661708 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-44e87948-5860-4eb6-a5e2-0f17693d6c4d req-ed057e79-0e1e-4900-a6ef-6c0b69bc1d32 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6b406d0a75bb4ddd96157ff43fd37096&device_id=2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07 HTTP/1.1" status: 200 len: 1096 time: 0.0914650 Dec 09 21:23:54.701942 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4b678c51-e0ea-4932-ad47-6cf916e8ec61 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:54.711603 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7711acb4-512a-4092-abf2-c048cf94982a req-12d85d9f-328b-41cb-af88-fd1779b6d852 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.8 HTTP/1.1" status: 200 len: 694 time: 0.0792482 Dec 09 21:23:54.717070 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-7711acb4-512a-4092-abf2-c048cf94982a req-9faf7214-8669-4fb1-a68f-3f130618cf60 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Request body: {'floatingip': {'port_id': '2f1265f7-0579-475d-9faa-f23ade6ec46b', 'fixed_ip_address': '172.20.0.5'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:23:54.742912 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-4b678c51-e0ea-4932-ad47-6cf916e8ec61 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['93378dc3-2ac5-4cf7-9ce3-d812934de40c']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:54.778639 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-4b678c51-e0ea-4932-ad47-6cf916e8ec61 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4bbda46b-e2e5-4ce1-b027-3fb09391026d') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:54.779038 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-4b678c51-e0ea-4932-ad47-6cf916e8ec61 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4bbda46b-e2e5-4ce1-b027-3fb09391026d') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:54.794172 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4b678c51-e0ea-4932-ad47-6cf916e8ec61 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:54.799349 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7711acb4-512a-4092-abf2-c048cf94982a req-9faf7214-8669-4fb1-a68f-3f130618cf60 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks [] for floatingip, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:54.813622 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4b678c51-e0ea-4932-ad47-6cf916e8ec61 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:54.824928 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4b678c51-e0ea-4932-ad47-6cf916e8ec61 admin admin] Releasing vlan 100 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:23:54.825337 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4b678c51-e0ea-4932-ad47-6cf916e8ec61 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:23:54.827168 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:23:54.841833 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44e87948-5860-4eb6-a5e2-0f17693d6c4d req-811a984d-9237-4e15-b596-fa5ac42e67aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:54.843327 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-44e87948-5860-4eb6-a5e2-0f17693d6c4d req-811a984d-9237-4e15-b596-fa5ac42e67aa service neutron] 10.222.0.31 "GET /v2.0/networks?id=c2615978-1c59-4fbb-826b-fc6aec14e987 HTTP/1.1" status: 200 len: 922 time: 0.1501865 Dec 09 21:23:54.916072 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-44e87948-5860-4eb6-a5e2-0f17693d6c4d req-935b7fe5-3d20-41c0-9041-9dc8124b624d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=10a46e5c-6c20-45c6-bb7c-767cb5043f63 HTTP/1.1" status: 200 len: 217 time: 0.0647733 Dec 09 21:23:54.916390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44b84959-f714-4724-a885-b7eda3dc6ef2 req-080b9bc8-f083-4bea-b16d-e2603896352e tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:54.917698 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44b84959-f714-4724-a885-b7eda3dc6ef2 req-080b9bc8-f083-4bea-b16d-e2603896352e tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 945 time: 0.1613851 Dec 09 21:23:54.921815 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4b678c51-e0ea-4932-ad47-6cf916e8ec61 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:54.928160 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4b678c51-e0ea-4932-ad47-6cf916e8ec61 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:54.934056 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4b678c51-e0ea-4932-ad47-6cf916e8ec61 admin admin] 10.222.0.13 "DELETE /v2.0/networks/93378dc3-2ac5-4cf7-9ce3-d812934de40c HTTP/1.1" status: 204 len: 168 time: 0.4941545 Dec 09 21:23:54.941228 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35460) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:54.979255 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-5ea2918f-6d53-4094-bb4a-99f8f17b525f tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:54.979861 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b678c51-e0ea-4932-ad47-6cf916e8ec61 admin admin] Pushing event deleted for resources: {'Network': ['ID=93378dc3-2ac5-4cf7-9ce3-d812934de40c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:54.980837 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-5ea2918f-6d53-4094-bb4a-99f8f17b525f tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f&tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&binding%3Ahost_id=n-h1-713301-27 HTTP/1.1" status: 200 len: 1097 time: 0.1786270 Dec 09 21:23:55.023585 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44e87948-5860-4eb6-a5e2-0f17693d6c4d req-d0a0c477-ee3e-4368-848a-643817322504 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:55.025271 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-44e87948-5860-4eb6-a5e2-0f17693d6c4d req-d0a0c477-ee3e-4368-848a-643817322504 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=1f5c65f5-5864-4e4e-bede-1bfc7f6e8e68 HTTP/1.1" status: 200 len: 861 time: 0.1015999 Dec 09 21:23:55.038952 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-1b12f4e2-d290-455f-ab7c-d23d13df0519 admin admin] Deleting subnet c6773439-6107-49a5-bc79-36ef3bb69ebe {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:23:55.049686 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b12f4e2-d290-455f-ab7c-d23d13df0519 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:55.091112 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-44e87948-5860-4eb6-a5e2-0f17693d6c4d req-00b7ac3b-41b4-44f2-b99f-92ab334122eb service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=c2615978-1c59-4fbb-826b-fc6aec14e987&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0584459 Dec 09 21:23:55.126532 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b12f4e2-d290-455f-ab7c-d23d13df0519 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:55.130903 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44b84959-f714-4724-a885-b7eda3dc6ef2 req-7c5c6e13-8f9e-4019-9bf2-f02bf3060347 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1682575 Dec 09 21:23:55.232089 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b12f4e2-d290-455f-ab7c-d23d13df0519 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:55.291413 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-44e87948-5860-4eb6-a5e2-0f17693d6c4d req-4a687ba5-0205-42a1-a978-60a25953d26b service neutron] 10.222.0.31 "GET /v2.0/networks/c2615978-1c59-4fbb-826b-fc6aec14e987?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1917377 Dec 09 21:23:55.309577 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-58141d48-65cb-471b-b194-44628eaba79f service neutron] For port 13499602-258c-4839-b928-17aef0d24310, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:23:55.319501 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-58141d48-65cb-471b-b194-44628eaba79f service neutron] Publish callbacks [] for binding, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:55.320723 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f78013d-d67f-47ef-9e8c-808bf57fe671 req-58141d48-65cb-471b-b194-44628eaba79f service neutron] 10.222.0.31 "DELETE /v2.0/ports/13499602-258c-4839-b928-17aef0d24310/bindings/n-h2-713301-27 HTTP/1.1" status: 204 len: 173 time: 0.3280456 Dec 09 21:23:55.378383 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5b8e92d-476f-4b61-b5f6-f2ef58272cf8 req-acc9d9c2-31dc-4625-859e-289e855d5810 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:55.380080 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b5b8e92d-476f-4b61-b5f6-f2ef58272cf8 req-acc9d9c2-31dc-4625-859e-289e855d5810 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.10 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 951 time: 0.1764901 Dec 09 21:23:55.405100 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b12f4e2-d290-455f-ab7c-d23d13df0519 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:55.444002 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b12f4e2-d290-455f-ab7c-d23d13df0519 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c6773439-6107-49a5-bc79-36ef3bb69ebe,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:55.449364 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b12f4e2-d290-455f-ab7c-d23d13df0519 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:55.453192 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1b12f4e2-d290-455f-ab7c-d23d13df0519 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/c6773439-6107-49a5-bc79-36ef3bb69ebe HTTP/1.1" status: 204 len: 168 time: 0.5092316 Dec 09 21:23:55.459647 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35474) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:55.474408 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-44e87948-5860-4eb6-a5e2-0f17693d6c4d req-ffb63c6a-4e9c-4d0f-9384-a9d0517a18fd service neutron] 10.222.0.31 "GET /v2.0/networks/c2615978-1c59-4fbb-826b-fc6aec14e987?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1755216 Dec 09 21:23:55.549188 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-603dc516-e653-40ca-9808-6d91e976cddc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:55.552018 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cbe202f-45db-45cc-8d21-6c876b14b2dd req-b1d703b2-969f-4069-a527-6617858e4674 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:55.553559 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4cbe202f-45db-45cc-8d21-6c876b14b2dd req-b1d703b2-969f-4069-a527-6617858e4674 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=b7584b26-427d-42a9-a7d7-2fbd2f063a84 HTTP/1.1" status: 200 len: 945 time: 0.1872327 Dec 09 21:23:55.632780 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-603dc516-e653-40ca-9808-6d91e976cddc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:55.653899 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-603dc516-e653-40ca-9808-6d91e976cddc admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a452c967-14e7-4e4f-b46b-3e0725f57191']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:55.663708 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-603dc516-e653-40ca-9808-6d91e976cddc admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0c28445d-dcad-44f8-a1e2-9f872bde8621') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:55.664394 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-603dc516-e653-40ca-9808-6d91e976cddc admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0c28445d-dcad-44f8-a1e2-9f872bde8621') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:55.673953 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-603dc516-e653-40ca-9808-6d91e976cddc admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:55.682894 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-b5b8e92d-476f-4b61-b5f6-f2ef58272cf8 req-f36a7dec-431a-4a20-8890-37570d8ae7c2 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Deleting port e145c03d-6648-46c7-8b51-c9e9acd70ff2 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:23:55.683518 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b5b8e92d-476f-4b61-b5f6-f2ef58272cf8 req-f36a7dec-431a-4a20-8890-37570d8ae7c2 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:55.688937 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-603dc516-e653-40ca-9808-6d91e976cddc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:55.694413 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7711acb4-512a-4092-abf2-c048cf94982a req-9faf7214-8669-4fb1-a68f-3f130618cf60 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:55.696607 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-603dc516-e653-40ca-9808-6d91e976cddc admin admin] Releasing vlan 115 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:23:55.697283 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-603dc516-e653-40ca-9808-6d91e976cddc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:55.720028 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4cbe202f-45db-45cc-8d21-6c876b14b2dd req-048c494f-beb9-4421-b50b-68a7bd714285 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1433530 Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:23:55.753753 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:23:55.770345 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-603dc516-e653-40ca-9808-6d91e976cddc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:55.776308 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7711acb4-512a-4092-abf2-c048cf94982a req-9faf7214-8669-4fb1-a68f-3f130618cf60 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:55.778509 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-603dc516-e653-40ca-9808-6d91e976cddc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:55.783001 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-603dc516-e653-40ca-9808-6d91e976cddc admin admin] 10.222.0.13 "DELETE /v2.0/networks/a452c967-14e7-4e4f-b46b-3e0725f57191 HTTP/1.1" status: 204 len: 168 time: 0.3223414 Dec 09 21:23:55.813699 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-603dc516-e653-40ca-9808-6d91e976cddc admin admin] Pushing event deleted for resources: {'Network': ['ID=a452c967-14e7-4e4f-b46b-3e0725f57191,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:55.924996 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35494) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:55.939913 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-b5b8e92d-476f-4b61-b5f6-f2ef58272cf8 req-f36a7dec-431a-4a20-8890-37570d8ae7c2 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] For port e145c03d-6648-46c7-8b51-c9e9acd70ff2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e145c03d-6648-46c7-8b51-c9e9acd70ff2,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:55.940387 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b5b8e92d-476f-4b61-b5f6-f2ef58272cf8 req-f36a7dec-431a-4a20-8890-37570d8ae7c2 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:55.958736 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-b5b8e92d-476f-4b61-b5f6-f2ef58272cf8 req-f36a7dec-431a-4a20-8890-37570d8ae7c2 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Calling delete_port for e145c03d-6648-46c7-8b51-c9e9acd70ff2 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:23:55.961578 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [req-7711acb4-512a-4092-abf2-c048cf94982a req-9faf7214-8669-4fb1-a68f-3f130618cf60 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Floating IP 175fadfc-f0ea-4d39-b7c2-2f94e3c75833 associated. External IP: 172.25.3.8, port: 2f1265f7-0579-475d-9faa-f23ade6ec46b. Dec 09 21:23:55.964434 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-98b02d0a-46d8-413b-aba5-30c4f4a4a258 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=a306d2242b1e41c892f63c7b122cdee4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0382054 Dec 09 21:23:55.967030 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35496) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:56.014492 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fb9e75c8-9438-4092-9c0d-0afe851b8edf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:56.022526 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6320e972-43e0-418b-9b6e-0a3d0a7a9669 req-ba5dc6fe-9dda-41ea-8a7a-5df7b239182f tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:56.024054 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6320e972-43e0-418b-9b6e-0a3d0a7a9669 req-ba5dc6fe-9dda-41ea-8a7a-5df7b239182f tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bbb9251-ec6e-45d8-b751-2b2b490cbe3b HTTP/1.1" status: 200 len: 951 time: 0.1372087 Dec 09 21:23:56.037737 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fb9e75c8-9438-4092-9c0d-0afe851b8edf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:56.094852 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fb9e75c8-9438-4092-9c0d-0afe851b8edf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:56.098634 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fb9e75c8-9438-4092-9c0d-0afe851b8edf admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:56.102209 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fb9e75c8-9438-4092-9c0d-0afe851b8edf admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/04b35e67-a28a-4586-be0f-3c4eb594dede HTTP/1.1" status: 204 len: 168 time: 0.1318877 Dec 09 21:23:56.117014 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb9e75c8-9438-4092-9c0d-0afe851b8edf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=04b35e67-a28a-4586-be0f-3c4eb594dede,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:56.200872 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6320e972-43e0-418b-9b6e-0a3d0a7a9669 req-e85f44cc-ac41-42d3-857c-f452cdc2a0a2 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1466265 Dec 09 21:23:56.244729 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 10a46e5c-6c20-45c6-bb7c-767cb5043f63 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:23:56.247625 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 4425d491-9b2e-48a2-8fb6-ead05da81dba no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:23:56.404629 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:56.429917 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 10a46e5c-6c20-45c6-bb7c-767cb5043f63, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=10a46e5c-6c20-45c6-bb7c-767cb5043f63,segment=NetworkSegment(77d1b765-2404-4dd1-ab6e-956ebecc3e04),segment_id=77d1b765-2404-4dd1-ab6e-956ebecc3e04)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:56.451749 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8f48a806-013e-480e-81ac-1a7f5f10c155', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4425d491-9b2e-48a2-8fb6-ead05da81dba'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:56.454390 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a904cad8-0aaf-42ae-ab97-3897b5941252" -d '{"events": [{"server_uuid": "8f48a806-013e-480e-81ac-1a7f5f10c155", "name": "network-vif-unplugged", "status": "completed", "tag": "4425d491-9b2e-48a2-8fb6-ead05da81dba"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:56.459992 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '10a46e5c-6c20-45c6-bb7c-767cb5043f63', 'network_id': 'c2615978-1c59-4fbb-826b-fc6aec14e987', 'port_id': '10a46e5c-6c20-45c6-bb7c-767cb5043f63', 'mac_address': 'fa:16:3e:36:ae:7c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 147, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1f5c65f5-5864-4e4e-bede-1bfc7f6e8e68', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:23:56.471528 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 4425d491-9b2e-48a2-8fb6-ead05da81dba, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=4425d491-9b2e-48a2-8fb6-ead05da81dba,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:56.506094 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35508) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:56.558468 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-71c5018c-005a-4778-8df6-fa48685f9a46 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ada7369d6e1b4f41b54f8618cadde653&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0508728 Dec 09 21:23:56.561009 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35510) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:23:56.612497 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-73a3912f-80d5-42cd-9abc-cd598abc0738 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:56.637063 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-73a3912f-80d5-42cd-9abc-cd598abc0738 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:56.666911 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:56.693379 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-73a3912f-80d5-42cd-9abc-cd598abc0738 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:56.696043 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-73a3912f-80d5-42cd-9abc-cd598abc0738 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:56.697180 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-73a3912f-80d5-42cd-9abc-cd598abc0738 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/d65647dd-441a-4dbd-98af-9da25539b654 HTTP/1.1" status: 204 len: 168 time: 0.1352055 Dec 09 21:23:56.700475 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ba88bb2-33bc-40e4-b3ed-9e09c72a35b8 req-ee0259f9-375d-4123-8f50-bde4ddb1539d tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:56.702013 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ba88bb2-33bc-40e4-b3ed-9e09c72a35b8 req-ee0259f9-375d-4123-8f50-bde4ddb1539d tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07 HTTP/1.1" status: 200 len: 944 time: 0.4234669 Dec 09 21:23:56.705222 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a3912f-80d5-42cd-9abc-cd598abc0738 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d65647dd-441a-4dbd-98af-9da25539b654,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:56.707350 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b5b8e92d-476f-4b61-b5f6-f2ef58272cf8 req-f36a7dec-431a-4a20-8890-37570d8ae7c2 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:56.724049 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['204e6970-8ed3-4e91-9792-52401052a153'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:23:56.726270 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['36925110-4ed7-49f6-b07d-d998896a74cc'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:23:56.739628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f36a7dec-431a-4a20-8890-37570d8ae7c2 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Pushing event deleted for resources: {'Port': ['ID=e145c03d-6648-46c7-8b51-c9e9acd70ff2,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:56.774939 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [req-7711acb4-512a-4092-abf2-c048cf94982a req-9faf7214-8669-4fb1-a68f-3f130618cf60 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Router 88041dd4-3b62-47ec-ab19-cf438d19e15b has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:23:56.798502 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:56.833125 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-b5b8e92d-476f-4b61-b5f6-f2ef58272cf8 req-f36a7dec-431a-4a20-8890-37570d8ae7c2 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] No DVR routers for this DVR port e145c03d-6648-46c7-8b51-c9e9acd70ff2 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:23:56.840746 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b5b8e92d-476f-4b61-b5f6-f2ef58272cf8 req-f36a7dec-431a-4a20-8890-37570d8ae7c2 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:56.841719 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=4425d491-9b2e-48a2-8fb6-ead05da81dba,revision_number=11']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:56.844113 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b5b8e92d-476f-4b61-b5f6-f2ef58272cf8 req-f36a7dec-431a-4a20-8890-37570d8ae7c2 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.10 "DELETE /v2.0/ports/e145c03d-6648-46c7-8b51-c9e9acd70ff2 HTTP/1.1" status: 204 len: 173 time: 1.4543931 Dec 09 21:23:56.848013 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8bbb9251-ec6e-45d8-b751-2b2b490cbe3b', 'name': 'network-vif-deleted', 'tag': 'e145c03d-6648-46c7-8b51-c9e9acd70ff2'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:56.850146 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cc3f8d1f-6317-400c-8158-6b7767f77907" -d '{"events": [{"server_uuid": "8bbb9251-ec6e-45d8-b751-2b2b490cbe3b", "name": "network-vif-deleted", "tag": "e145c03d-6648-46c7-8b51-c9e9acd70ff2"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:56.859910 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 10a46e5c-6c20-45c6-bb7c-767cb5043f63 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:23:56.870743 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ba88bb2-33bc-40e4-b3ed-9e09c72a35b8 req-da48c323-6e17-4daa-886a-f3770d7e6415 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1324522 Dec 09 21:23:56.899926 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 10a46e5c-6c20-45c6-bb7c-767cb5043f63, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=10a46e5c-6c20-45c6-bb7c-767cb5043f63,segment=NetworkSegment(77d1b765-2404-4dd1-ab6e-956ebecc3e04),segment_id=77d1b765-2404-4dd1-ab6e-956ebecc3e04)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:56.911271 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:57.015539 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-7711acb4-512a-4092-abf2-c048cf94982a req-9faf7214-8669-4fb1-a68f-3f130618cf60 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:23:57.021304 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7711acb4-512a-4092-abf2-c048cf94982a req-9faf7214-8669-4fb1-a68f-3f130618cf60 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:57.031012 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b92ba832-ce3b-406c-b3ff-9313d2665cdf None None] Sync routers for ids ['88041dd4-3b62-47ec-ab19-cf438d19e15b'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:23:57.050294 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b92ba832-ce3b-406c-b3ff-9313d2665cdf None None] Routers {'88041dd4-3b62-47ec-ab19-cf438d19e15b'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:23:57.051224 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-b92ba832-ce3b-406c-b3ff-9313d2665cdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:23:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['88041dd4-3b62-47ec-ab19-cf438d19e15b'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:57.055526 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7711acb4-512a-4092-abf2-c048cf94982a req-9faf7214-8669-4fb1-a68f-3f130618cf60 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "PUT /v2.0/floatingips/175fadfc-f0ea-4d39-b7c2-2f94e3c75833 HTTP/1.1" status: 200 len: 994 time: 2.3428767 Dec 09 21:23:57.100632 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=10a46e5c-6c20-45c6-bb7c-767cb5043f63,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:57.136981 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:57.176385 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:57.176755 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7711acb4-512a-4092-abf2-c048cf94982a req-da1d4929-788b-4da3-97b5-698d2288f1c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:57.178289 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7711acb4-512a-4092-abf2-c048cf94982a req-da1d4929-788b-4da3-97b5-698d2288f1c1 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=768655d2ebd74340a90f65fc3007118f&device_id=99185349-bf6b-4cb8-a80b-ebf360aecfbb HTTP/1.1" status: 200 len: 1097 time: 0.0954020 Dec 09 21:23:57.223030 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['10a46e5c-6c20-45c6-bb7c-767cb5043f63'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:23:57.301513 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-b92ba832-ce3b-406c-b3ff-9313d2665cdf None None] Set router 88041dd4-3b62-47ec-ab19-cf438d19e15b gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:23:57.388689 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e145c03d-6648-46c7-8b51-c9e9acd70ff2 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:23:57.416470 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7711acb4-512a-4092-abf2-c048cf94982a req-8c88e6e4-77c2-4a75-8442-6c1f98cf2348 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:57.418937 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7711acb4-512a-4092-abf2-c048cf94982a req-8c88e6e4-77c2-4a75-8442-6c1f98cf2348 service neutron] 10.222.0.13 "GET /v2.0/networks?id=9b3c0886-168c-4d9c-83a4-145e87393715 HTTP/1.1" status: 200 len: 930 time: 0.2335565 Dec 09 21:23:57.499976 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: e145c03d-6648-46c7-8b51-c9e9acd70ff2 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:23:57.500321 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e145c03d-6648-46c7-8b51-c9e9acd70ff2 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:23:57.522140 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-768f4ecd-48a1-4beb-8daa-b68455245e73 req-170b6dbd-19b7-4262-801d-fff0b8451a1d tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:57.531412 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-768f4ecd-48a1-4beb-8daa-b68455245e73 req-170b6dbd-19b7-4262-801d-fff0b8451a1d tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 945 time: 0.1304944 Dec 09 21:23:57.562822 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7711acb4-512a-4092-abf2-c048cf94982a req-5d3b31f9-799f-47f4-8684-e637602ccf84 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=2f1265f7-0579-475d-9faa-f23ade6ec46b HTTP/1.1" status: 200 len: 997 time: 0.1283901 Dec 09 21:23:57.629182 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-768f4ecd-48a1-4beb-8daa-b68455245e73 req-714e99c3-6f92-4113-aef2-9ae34f47d493 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0935247 Dec 09 21:23:57.641204 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7711acb4-512a-4092-abf2-c048cf94982a req-a4ebd090-cec5-4793-b19d-bb74c51d4b8f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:57.644270 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7711acb4-512a-4092-abf2-c048cf94982a req-a4ebd090-cec5-4793-b19d-bb74c51d4b8f service neutron] 10.222.0.13 "GET /v2.0/subnets?id=176a8001-d04b-4c22-9715-06327ff3546d HTTP/1.1" status: 200 len: 868 time: 0.0694108 Dec 09 21:23:57.702405 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7711acb4-512a-4092-abf2-c048cf94982a req-493a5474-35f7-45eb-8c2e-3d2e5ba95df2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:57.704143 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7711acb4-512a-4092-abf2-c048cf94982a req-493a5474-35f7-45eb-8c2e-3d2e5ba95df2 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=9b3c0886-168c-4d9c-83a4-145e87393715&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0538459 Dec 09 21:23:57.766343 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dfeeef92-744f-4246-a316-b9ffe29e3b43 x-openstack-request-id: req-dfeeef92-744f-4246-a316-b9ffe29e3b43 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:57.766827 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8f48a806-013e-480e-81ac-1a7f5f10c155", "name": "network-vif-unplugged", "status": "completed", "tag": "4425d491-9b2e-48a2-8fb6-ead05da81dba", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:57.767255 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-dfeeef92-744f-4246-a316-b9ffe29e3b43 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:57.767700 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8f48a806-013e-480e-81ac-1a7f5f10c155', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4425d491-9b2e-48a2-8fb6-ead05da81dba', 'code': 200} Dec 09 21:23:57.803609 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-65b42924-fe68-41e0-8910-6107ad4f5a02 x-openstack-request-id: req-65b42924-fe68-41e0-8910-6107ad4f5a02 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:23:57.803903 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8bbb9251-ec6e-45d8-b751-2b2b490cbe3b", "name": "network-vif-deleted", "tag": "e145c03d-6648-46c7-8b51-c9e9acd70ff2", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:23:57.804366 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-65b42924-fe68-41e0-8910-6107ad4f5a02 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:23:57.804643 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8bbb9251-ec6e-45d8-b751-2b2b490cbe3b', 'name': 'network-vif-deleted', 'tag': 'e145c03d-6648-46c7-8b51-c9e9acd70ff2', 'status': 'completed', 'code': 200} Dec 09 21:23:57.811293 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7711acb4-512a-4092-abf2-c048cf94982a req-04d5cf36-b39a-40d5-b85d-c83c479e09f6 service neutron] 10.222.0.13 "GET /v2.0/networks/9b3c0886-168c-4d9c-83a4-145e87393715?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0990789 Dec 09 21:23:57.858904 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-b92ba832-ce3b-406c-b3ff-9313d2665cdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1528769429-router', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42'}], 'enable_snat': True}, 'gw_port_id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:23:17Z', 'updated_at': '2021-12-09T21:23:23Z', 'revision_number': 4, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'gw_port': {'id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:c0:45:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:23:18Z', 'updated_at': '2021-12-09T21:23:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '175fadfc-f0ea-4d39-b7c2-2f94e3c75833', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'floating_ip_address': '172.25.3.8', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'port_id': '2f1265f7-0579-475d-9faa-f23ade6ec46b', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 726, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715', 'mac_address': 'fa:16:3e:e3:12:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99185349-bf6b-4cb8-a80b-ebf360aecfbb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:23:52Z', 'updated_at': '2021-12-09T21:23:55Z', 'revision_number': 1, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '047fd970-b4fd-4fa7-81e7-fba0167dbce6', 'name': '', 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'mac_address': 'fa:16:3e:a3:36:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'device_owner': 'network:router_interface', 'standard_attr_id': 705, 'fixed_ips': [{'subnet_id': '176a8001-d04b-4c22-9715-06327ff3546d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:23:22Z', 'updated_at': '2021-12-09T21:23:37Z', 'revision_number': 5, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'subnets': [{'id': '176a8001-d04b-4c22-9715-06327ff3546d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:57.889268 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b92ba832-ce3b-406c-b3ff-9313d2665cdf None None] Checking router: 88041dd4-3b62-47ec-ab19-cf438d19e15b for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:23:57.898883 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b92ba832-ce3b-406c-b3ff-9313d2665cdf None None] Routers {'88041dd4-3b62-47ec-ab19-cf438d19e15b'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:23:57.899769 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-b92ba832-ce3b-406c-b3ff-9313d2665cdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:23:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['88041dd4-3b62-47ec-ab19-cf438d19e15b'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:57.948108 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7711acb4-512a-4092-abf2-c048cf94982a req-fc1de79f-1f91-4527-b06e-4210995803eb service neutron] 10.222.0.13 "GET /v2.0/networks/9b3c0886-168c-4d9c-83a4-145e87393715?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1163361 Dec 09 21:23:57.965212 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d6bb8dc-d2c5-4ad5-84f6-713c9d3216da req-d390c50a-89fa-4338-bb8a-169950d17154 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:57.977125 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1d6bb8dc-d2c5-4ad5-84f6-713c9d3216da req-d390c50a-89fa-4338-bb8a-169950d17154 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=b7584b26-427d-42a9-a7d7-2fbd2f063a84 HTTP/1.1" status: 200 len: 945 time: 0.0871918 Dec 09 21:23:58.028522 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1d6bb8dc-d2c5-4ad5-84f6-713c9d3216da req-4c0ab473-e639-4dad-9a1c-6dd1d92c5537 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505207 Dec 09 21:23:58.054510 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-b92ba832-ce3b-406c-b3ff-9313d2665cdf None None] Set router 88041dd4-3b62-47ec-ab19-cf438d19e15b gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:23:58.250520 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28904789-7373-4490-8e5b-17672b685490 req-f72534c5-024d-4fa6-b586-a739c462aca7 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:58.252131 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-28904789-7373-4490-8e5b-17672b685490 req-f72534c5-024d-4fa6-b586-a739c462aca7 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07 HTTP/1.1" status: 200 len: 945 time: 0.1013465 Dec 09 21:23:58.260894 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89389a2d-8cb4-4c9b-92b7-ed2f77bd7e90 req-3aa2b6d6-0ed0-44bb-b0c6-26bd1187b7bb tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True&fields=id&id=97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 258 time: 0.1488473 Dec 09 21:23:58.267692 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 10a46e5c-6c20-45c6-bb7c-767cb5043f63 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:23:58.286069 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-89389a2d-8cb4-4c9b-92b7-ed2f77bd7e90 req-2588c5b7-f5f8-4486-9e8d-5d5226fd8b09 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:23:58.323698 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-b92ba832-ce3b-406c-b3ff-9313d2665cdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1528769429-router', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42'}], 'enable_snat': True}, 'gw_port_id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:23:17Z', 'updated_at': '2021-12-09T21:23:23Z', 'revision_number': 4, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'gw_port': {'id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:c0:45:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:23:18Z', 'updated_at': '2021-12-09T21:23:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '175fadfc-f0ea-4d39-b7c2-2f94e3c75833', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'floating_ip_address': '172.25.3.8', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'port_id': '2f1265f7-0579-475d-9faa-f23ade6ec46b', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 726, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715', 'mac_address': 'fa:16:3e:e3:12:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99185349-bf6b-4cb8-a80b-ebf360aecfbb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:23:52Z', 'updated_at': '2021-12-09T21:23:55Z', 'revision_number': 1, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '047fd970-b4fd-4fa7-81e7-fba0167dbce6', 'name': '', 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'mac_address': 'fa:16:3e:a3:36:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'device_owner': 'network:router_interface', 'standard_attr_id': 705, 'fixed_ips': [{'subnet_id': '176a8001-d04b-4c22-9715-06327ff3546d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:23:22Z', 'updated_at': '2021-12-09T21:23:37Z', 'revision_number': 5, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'subnets': [{'id': '176a8001-d04b-4c22-9715-06327ff3546d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:23:58.326996 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-28904789-7373-4490-8e5b-17672b685490 req-471de832-b5f0-4a7d-8437-2fbf2253e0a7 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0654128 Dec 09 21:23:58.331365 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89389a2d-8cb4-4c9b-92b7-ed2f77bd7e90 req-2588c5b7-f5f8-4486-9e8d-5d5226fd8b09 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:58.351460 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 10a46e5c-6c20-45c6-bb7c-767cb5043f63 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:23:58.365359 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 10a46e5c-6c20-45c6-bb7c-767cb5043f63 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:23:58.366194 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:58.369983 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b92ba832-ce3b-406c-b3ff-9313d2665cdf None None] The sync data for ids ['88041dd4-3b62-47ec-ab19-cf438d19e15b'] in n-d-713301-27 is: [{'id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1528769429-router', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42'}], 'enable_snat': True}, 'gw_port_id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:23:17Z', 'updated_at': '2021-12-09T21:23:23Z', 'revision_number': 4, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'gw_port': {'id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:c0:45:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:23:18Z', 'updated_at': '2021-12-09T21:23:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '175fadfc-f0ea-4d39-b7c2-2f94e3c75833', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'floating_ip_address': '172.25.3.8', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'port_id': '2f1265f7-0579-475d-9faa-f23ade6ec46b', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 726, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715', 'mac_address': 'fa:16:3e:e3:12:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '99185349-bf6b-4cb8-a80b-ebf360aecfbb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:23:52Z', 'updated_at': '2021-12-09T21:23:55Z', 'revision_number': 1, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '047fd970-b4fd-4fa7-81e7-fba0167dbce6', 'name': '', 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'mac_address': 'fa:16:3e:a3:36:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'device_owner': 'network:router_interface', 'standard_attr_id': 705, 'fixed_ips': [{'subnet_id': '176a8001-d04b-4c22-9715-06327ff3546d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:23:22Z', 'updated_at': '2021-12-09T21:23:37Z', 'revision_number': 5, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'subnets': [{'id': '176a8001-d04b-4c22-9715-06327ff3546d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:23:58.486843 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89389a2d-8cb4-4c9b-92b7-ed2f77bd7e90 req-2588c5b7-f5f8-4486-9e8d-5d5226fd8b09 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:58.517832 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:58.557937 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 10a46e5c-6c20-45c6-bb7c-767cb5043f63, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=10a46e5c-6c20-45c6-bb7c-767cb5043f63,segment=NetworkSegment(77d1b765-2404-4dd1-ab6e-956ebecc3e04),segment_id=77d1b765-2404-4dd1-ab6e-956ebecc3e04)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:58.570046 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:58.630386 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=10a46e5c-6c20-45c6-bb7c-767cb5043f63,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:58.689626 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45bb80fa-fec8-4ad9-ad7b-886929da7091 None None] New status for floating IP 175fadfc-f0ea-4d39-b7c2-2f94e3c75833: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:23:58.722589 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-89389a2d-8cb4-4c9b-92b7-ed2f77bd7e90 req-2588c5b7-f5f8-4486-9e8d-5d5226fd8b09 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Allocated IP 172.25.3.154 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/a6150448-434c-428b-92c0-be0829bc4724) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:23:58.735241 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1e4bcaa-784b-4050-8ac7-4e6737cff78a req-e52a6ae1-8897-49cf-8a6b-762c871323f4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:58.736784 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1e4bcaa-784b-4050-8ac7-4e6737cff78a req-e52a6ae1-8897-49cf-8a6b-762c871323f4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.10 "GET /v2.0/ports?device_id=b7584b26-427d-42a9-a7d7-2fbd2f063a84 HTTP/1.1" status: 200 len: 945 time: 0.1802042 Dec 09 21:23:58.757875 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72a54d64-5e20-4321-ac84-21427c133eeb req-9786c4ed-4f38-481e-a081-356b8c9052f3 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:58.759358 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72a54d64-5e20-4321-ac84-21427c133eeb req-9786c4ed-4f38-481e-a081-356b8c9052f3 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 1097 time: 0.1017156 Dec 09 21:23:58.914155 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72a54d64-5e20-4321-ac84-21427c133eeb req-89b7d3b6-3421-4f2c-8741-ddd28a37d823 tempest-LiveMigrationTest-43651942 tempest-LiveMigrationTest-43651942-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1364617 Dec 09 21:23:58.940465 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89389a2d-8cb4-4c9b-92b7-ed2f77bd7e90 req-2588c5b7-f5f8-4486-9e8d-5d5226fd8b09 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:58.958060 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-b1e4bcaa-784b-4050-8ac7-4e6737cff78a req-6e0deb7d-5fac-4571-b3ef-618a1de1d483 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Deleting port df55306b-f9c9-42b2-a899-aa67e74612f6 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:23:58.958392 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b1e4bcaa-784b-4050-8ac7-4e6737cff78a req-6e0deb7d-5fac-4571-b3ef-618a1de1d483 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:59.045091 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89389a2d-8cb4-4c9b-92b7-ed2f77bd7e90 req-2588c5b7-f5f8-4486-9e8d-5d5226fd8b09 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:59.091208 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-b1e4bcaa-784b-4050-8ac7-4e6737cff78a req-6e0deb7d-5fac-4571-b3ef-618a1de1d483 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] For port df55306b-f9c9-42b2-a899-aa67e74612f6, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=df55306b-f9c9-42b2-a899-aa67e74612f6,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:23:59.091498 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b1e4bcaa-784b-4050-8ac7-4e6737cff78a req-6e0deb7d-5fac-4571-b3ef-618a1de1d483 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:59.122675 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-89389a2d-8cb4-4c9b-92b7-ed2f77bd7e90 req-2588c5b7-f5f8-4486-9e8d-5d5226fd8b09 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:23:59.147136 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-b1e4bcaa-784b-4050-8ac7-4e6737cff78a req-6e0deb7d-5fac-4571-b3ef-618a1de1d483 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Calling delete_port for df55306b-f9c9-42b2-a899-aa67e74612f6 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:23:59.150076 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-89389a2d-8cb4-4c9b-92b7-ed2f77bd7e90 req-2588c5b7-f5f8-4486-9e8d-5d5226fd8b09 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:23:59.155142 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2588c5b7-f5f8-4486-9e8d-5d5226fd8b09 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Pushing event updated for resources: {'Port': ['ID=a6150448-434c-428b-92c0-be0829bc4724,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:59.159385 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-89389a2d-8cb4-4c9b-92b7-ed2f77bd7e90 req-2588c5b7-f5f8-4486-9e8d-5d5226fd8b09 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:23:59.258881 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45adb2e7-8159-4939-babe-c5070e2201b0 req-3926c874-f694-4a20-b35a-fa583d93cb34 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:59.260390 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-45adb2e7-8159-4939-babe-c5070e2201b0 req-3926c874-f694-4a20-b35a-fa583d93cb34 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 951 time: 0.1633322 Dec 09 21:23:59.346896 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89389a2d-8cb4-4c9b-92b7-ed2f77bd7e90 req-2588c5b7-f5f8-4486-9e8d-5d5226fd8b09 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:59.383842 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-45adb2e7-8159-4939-babe-c5070e2201b0 req-580e7291-e057-4e71-a90c-6ae001a1b7cc tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1163316 Dec 09 21:23:59.423570 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89389a2d-8cb4-4c9b-92b7-ed2f77bd7e90 req-2588c5b7-f5f8-4486-9e8d-5d5226fd8b09 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:59.445442 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b1e4bcaa-784b-4050-8ac7-4e6737cff78a req-6e0deb7d-5fac-4571-b3ef-618a1de1d483 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:59.481601 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e0deb7d-5fac-4571-b3ef-618a1de1d483 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Pushing event deleted for resources: {'Port': ['ID=df55306b-f9c9-42b2-a899-aa67e74612f6,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:59.553951 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-b1e4bcaa-784b-4050-8ac7-4e6737cff78a req-6e0deb7d-5fac-4571-b3ef-618a1de1d483 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] No DVR routers for this DVR port df55306b-f9c9-42b2-a899-aa67e74612f6 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:23:59.563760 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b1e4bcaa-784b-4050-8ac7-4e6737cff78a req-6e0deb7d-5fac-4571-b3ef-618a1de1d483 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:59.567090 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1e4bcaa-784b-4050-8ac7-4e6737cff78a req-6e0deb7d-5fac-4571-b3ef-618a1de1d483 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.10 "DELETE /v2.0/ports/df55306b-f9c9-42b2-a899-aa67e74612f6 HTTP/1.1" status: 204 len: 173 time: 0.8234169 Dec 09 21:23:59.769454 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '10a46e5c-6c20-45c6-bb7c-767cb5043f63'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:59.771818 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6ac110c4-87ce-40d6-bc15-1b27c26ae622" -d '{"events": [{"server_uuid": "2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07", "name": "network-vif-plugged", "status": "completed", "tag": "10a46e5c-6c20-45c6-bb7c-767cb5043f63"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:59.792792 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca585d1-eebf-4224-b39b-5217b0ede5b5 req-5dce51e8-bac9-436a-89d1-a297dc3c8f8e tempest-NetworksTest-1904895965 tempest-NetworksTest-1904895965-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:59.793385 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca585d1-eebf-4224-b39b-5217b0ede5b5 req-5dce51e8-bac9-436a-89d1-a297dc3c8f8e tempest-NetworksTest-1904895965 tempest-NetworksTest-1904895965-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:59.793693 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca585d1-eebf-4224-b39b-5217b0ede5b5 req-5dce51e8-bac9-436a-89d1-a297dc3c8f8e tempest-NetworksTest-1904895965 tempest-NetworksTest-1904895965-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:59.794135 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca585d1-eebf-4224-b39b-5217b0ede5b5 req-5dce51e8-bac9-436a-89d1-a297dc3c8f8e tempest-NetworksTest-1904895965 tempest-NetworksTest-1904895965-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:59.794575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca585d1-eebf-4224-b39b-5217b0ede5b5 req-5dce51e8-bac9-436a-89d1-a297dc3c8f8e tempest-NetworksTest-1904895965 tempest-NetworksTest-1904895965-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:59.795018 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca585d1-eebf-4224-b39b-5217b0ede5b5 req-5dce51e8-bac9-436a-89d1-a297dc3c8f8e tempest-NetworksTest-1904895965 tempest-NetworksTest-1904895965-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:59.795528 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca585d1-eebf-4224-b39b-5217b0ede5b5 req-5dce51e8-bac9-436a-89d1-a297dc3c8f8e tempest-NetworksTest-1904895965 tempest-NetworksTest-1904895965-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:59.796249 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca585d1-eebf-4224-b39b-5217b0ede5b5 req-5dce51e8-bac9-436a-89d1-a297dc3c8f8e tempest-NetworksTest-1904895965 tempest-NetworksTest-1904895965-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:59.796390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca585d1-eebf-4224-b39b-5217b0ede5b5 req-5dce51e8-bac9-436a-89d1-a297dc3c8f8e tempest-NetworksTest-1904895965 tempest-NetworksTest-1904895965-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:23:59.798165 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cca585d1-eebf-4224-b39b-5217b0ede5b5 req-5dce51e8-bac9-436a-89d1-a297dc3c8f8e tempest-NetworksTest-1904895965 tempest-NetworksTest-1904895965-project-admin] 10.222.0.13 "GET /v2.0/networks HTTP/1.1" status: 200 len: 6421 time: 0.2745790 Dec 09 21:23:59.806173 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '99185349-bf6b-4cb8-a80b-ebf360aecfbb', 'tag': '2f1265f7-0579-475d-9faa-f23ade6ec46b'}, {'server_uuid': 'b7584b26-427d-42a9-a7d7-2fbd2f063a84', 'name': 'network-vif-deleted', 'tag': 'df55306b-f9c9-42b2-a899-aa67e74612f6'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:23:59.808838 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2ea703fd-6eb1-42c9-ad17-186f53c50075" -d '{"events": [{"name": "network-changed", "server_uuid": "99185349-bf6b-4cb8-a80b-ebf360aecfbb", "tag": "2f1265f7-0579-475d-9faa-f23ade6ec46b"}, {"server_uuid": "b7584b26-427d-42a9-a7d7-2fbd2f063a84", "name": "network-vif-deleted", "tag": "df55306b-f9c9-42b2-a899-aa67e74612f6"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:23:59.815592 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89389a2d-8cb4-4c9b-92b7-ed2f77bd7e90 req-2588c5b7-f5f8-4486-9e8d-5d5226fd8b09 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:59.822427 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89389a2d-8cb4-4c9b-92b7-ed2f77bd7e90 req-2588c5b7-f5f8-4486-9e8d-5d5226fd8b09 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:59.896133 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2588c5b7-f5f8-4486-9e8d-5d5226fd8b09 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Pushing event updated for resources: {'Port': ['ID=a6150448-434c-428b-92c0-be0829bc4724,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:23:59.908293 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89389a2d-8cb4-4c9b-92b7-ed2f77bd7e90 req-2588c5b7-f5f8-4486-9e8d-5d5226fd8b09 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:59.924002 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89389a2d-8cb4-4c9b-92b7-ed2f77bd7e90 req-2588c5b7-f5f8-4486-9e8d-5d5226fd8b09 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:23:59.925292 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89389a2d-8cb4-4c9b-92b7-ed2f77bd7e90 req-2588c5b7-f5f8-4486-9e8d-5d5226fd8b09 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 698 time: 1.6447148 Dec 09 21:23:59.977000 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89389a2d-8cb4-4c9b-92b7-ed2f77bd7e90 req-62556edc-de87-448a-b3c2-8b07e154dd11 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.154 HTTP/1.1" status: 200 len: 696 time: 0.0452859 Dec 09 21:24:00.104572 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f61723e3-cd70-494e-b2fc-35547ecaf0ea req-0bcc29d8-eb5e-41f0-889c-5bd9f3247172 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:00.106060 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f61723e3-cd70-494e-b2fc-35547ecaf0ea req-0bcc29d8-eb5e-41f0-889c-5bd9f3247172 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.10 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 951 time: 0.1326394 Dec 09 21:24:00.179315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89389a2d-8cb4-4c9b-92b7-ed2f77bd7e90 req-fdaa2c79-87c4-4f8a-8d8f-a69967bea1ec tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:00.181507 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89389a2d-8cb4-4c9b-92b7-ed2f77bd7e90 req-fdaa2c79-87c4-4f8a-8d8f-a69967bea1ec tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.1968002 Dec 09 21:24:00.206606 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0e3af64f-5bd8-4f7b-ae49-2226db7aebc6 req-7da47adb-a56e-4f70-b4db-307a4a478041 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=b7584b26-427d-42a9-a7d7-2fbd2f063a84 HTTP/1.1" status: 200 len: 210 time: 0.0507386 Dec 09 21:24:00.227208 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-89389a2d-8cb4-4c9b-92b7-ed2f77bd7e90 req-f9e1e56f-6cae-481f-8123-15e3433027f3 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:24:00.227324 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89389a2d-8cb4-4c9b-92b7-ed2f77bd7e90 req-f9e1e56f-6cae-481f-8123-15e3433027f3 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0247374 Dec 09 21:24:00.260805 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-f61723e3-cd70-494e-b2fc-35547ecaf0ea req-b73d6333-9a59-4237-bd4d-1b5c6c482900 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Deleting port 36925110-4ed7-49f6-b07d-d998896a74cc {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:00.261227 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f61723e3-cd70-494e-b2fc-35547ecaf0ea req-b73d6333-9a59-4237-bd4d-1b5c6c482900 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:00.264756 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-11255e0f-57fc-4b5c-982a-b74767174d03 x-openstack-request-id: req-11255e0f-57fc-4b5c-982a-b74767174d03 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:24:00.265128 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07", "name": "network-vif-plugged", "status": "completed", "tag": "10a46e5c-6c20-45c6-bb7c-767cb5043f63", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:24:00.265476 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-11255e0f-57fc-4b5c-982a-b74767174d03 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:24:00.266082 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '10a46e5c-6c20-45c6-bb7c-767cb5043f63', 'code': 200} Dec 09 21:24:00.378307 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cc6403f-a7b4-4487-95b9-fc26a4eefe5d req-65123954-894b-4968-8a3f-6e4a5e05e408 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:00.379901 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6cc6403f-a7b4-4487-95b9-fc26a4eefe5d req-65123954-894b-4968-8a3f-6e4a5e05e408 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07 HTTP/1.1" status: 200 len: 1098 time: 0.0420129 Dec 09 21:24:00.428994 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6cc6403f-a7b4-4487-95b9-fc26a4eefe5d req-91f01ec2-2795-425b-b994-ba1a393d4808 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413787 Dec 09 21:24:00.453523 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-f61723e3-cd70-494e-b2fc-35547ecaf0ea req-b73d6333-9a59-4237-bd4d-1b5c6c482900 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] For port 36925110-4ed7-49f6-b07d-d998896a74cc, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=36925110-4ed7-49f6-b07d-d998896a74cc,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:00.453889 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f61723e3-cd70-494e-b2fc-35547ecaf0ea req-b73d6333-9a59-4237-bd4d-1b5c6c482900 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:00.470576 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cbdb57b-f8f9-41cd-b242-7b66e8d2a606 req-2578a988-c609-4a50-a5f5-da1bbee2fe08 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:00.472123 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3cbdb57b-f8f9-41cd-b242-7b66e8d2a606 req-2578a988-c609-4a50-a5f5-da1bbee2fe08 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07 HTTP/1.1" status: 200 len: 946 time: 0.1741426 Dec 09 21:24:00.477249 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-f61723e3-cd70-494e-b2fc-35547ecaf0ea req-b73d6333-9a59-4237-bd4d-1b5c6c482900 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Calling delete_port for 36925110-4ed7-49f6-b07d-d998896a74cc owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:00.514042 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b83d6a7-efb8-44cb-a3ac-222640bc5d4f req-3ca029a9-be36-4a17-b8ec-58797a9d4dcb tempest-NetworksTest-1904895965 tempest-NetworksTest-1904895965-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:00.515296 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8b83d6a7-efb8-44cb-a3ac-222640bc5d4f req-3ca029a9-be36-4a17-b8ec-58797a9d4dcb tempest-NetworksTest-1904895965 tempest-NetworksTest-1904895965-project-admin] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 886 time: 0.2162039 Dec 09 21:24:00.559513 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 350 Content-Type: application/json Date: Thu, 09 Dec 2021 21:23:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-076e2cce-8cbf-4391-9c01-1ca30df240ea x-openstack-request-id: req-076e2cce-8cbf-4391-9c01-1ca30df240ea {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:24:00.559810 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "99185349-bf6b-4cb8-a80b-ebf360aecfbb", "tag": "2f1265f7-0579-475d-9faa-f23ade6ec46b", "status": "completed", "code": 200}, {"server_uuid": "b7584b26-427d-42a9-a7d7-2fbd2f063a84", "name": "network-vif-deleted", "tag": "df55306b-f9c9-42b2-a899-aa67e74612f6", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:24:00.560057 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-076e2cce-8cbf-4391-9c01-1ca30df240ea {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:24:00.560457 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '99185349-bf6b-4cb8-a80b-ebf360aecfbb', 'tag': '2f1265f7-0579-475d-9faa-f23ade6ec46b', 'status': 'completed', 'code': 200} Dec 09 21:24:00.560725 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b7584b26-427d-42a9-a7d7-2fbd2f063a84', 'name': 'network-vif-deleted', 'tag': 'df55306b-f9c9-42b2-a899-aa67e74612f6', 'status': 'completed', 'code': 200} Dec 09 21:24:00.584357 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3cbdb57b-f8f9-41cd-b242-7b66e8d2a606 req-487b1ff4-949e-4c1a-a683-2541c694fae6 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1023905 Dec 09 21:24:00.677929 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ea703fd-6eb1-42c9-ad17-186f53c50075 req-b1873fe8-ed3b-436d-b0b3-e25c79593954 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:00.679504 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2ea703fd-6eb1-42c9-ad17-186f53c50075 req-b1873fe8-ed3b-436d-b0b3-e25c79593954 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=768655d2ebd74340a90f65fc3007118f&device_id=99185349-bf6b-4cb8-a80b-ebf360aecfbb HTTP/1.1" status: 200 len: 1097 time: 0.0472453 Dec 09 21:24:00.689642 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f61723e3-cd70-494e-b2fc-35547ecaf0ea req-b73d6333-9a59-4237-bd4d-1b5c6c482900 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:00.703867 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['36925110-4ed7-49f6-b07d-d998896a74cc'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:24:00.704910 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7af21dd-c59b-42f9-8607-2744fa435550 req-e2cd4b39-dc3b-49e8-8b99-d5c8b59ca19d tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:00.706731 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7af21dd-c59b-42f9-8607-2744fa435550 req-e2cd4b39-dc3b-49e8-8b99-d5c8b59ca19d tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 945 time: 0.0771768 Dec 09 21:24:00.707569 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['204e6970-8ed3-4e91-9792-52401052a153'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:24:00.730638 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b73d6333-9a59-4237-bd4d-1b5c6c482900 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Pushing event deleted for resources: {'Port': ['ID=36925110-4ed7-49f6-b07d-d998896a74cc,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:00.801556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-f61723e3-cd70-494e-b2fc-35547ecaf0ea req-b73d6333-9a59-4237-bd4d-1b5c6c482900 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] No DVR routers for this DVR port 36925110-4ed7-49f6-b07d-d998896a74cc on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:24:00.810193 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ea703fd-6eb1-42c9-ad17-186f53c50075 req-67c2ee3b-3cbc-49b0-a498-dc92a7c2e01e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:00.811100 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f61723e3-cd70-494e-b2fc-35547ecaf0ea req-b73d6333-9a59-4237-bd4d-1b5c6c482900 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:00.812309 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2ea703fd-6eb1-42c9-ad17-186f53c50075 req-67c2ee3b-3cbc-49b0-a498-dc92a7c2e01e service neutron] 10.222.0.10 "GET /v2.0/networks?id=9b3c0886-168c-4d9c-83a4-145e87393715 HTTP/1.1" status: 200 len: 930 time: 0.1241572 Dec 09 21:24:00.814398 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f61723e3-cd70-494e-b2fc-35547ecaf0ea req-b73d6333-9a59-4237-bd4d-1b5c6c482900 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.10 "DELETE /v2.0/ports/36925110-4ed7-49f6-b07d-d998896a74cc HTTP/1.1" status: 204 len: 173 time: 0.7006943 Dec 09 21:24:00.829971 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7af21dd-c59b-42f9-8607-2744fa435550 req-cdb1caf5-02c3-4c04-ba9f-e4aba25ea4d6 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1029489 Dec 09 21:24:00.880791 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feb8c895-e0e7-4313-a9bd-cf4ef5ed0f23 req-1f908b4d-98e0-4bbc-8224-8e7282f7b79a tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:00.882696 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-feb8c895-e0e7-4313-a9bd-cf4ef5ed0f23 req-1f908b4d-98e0-4bbc-8224-8e7282f7b79a tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/ports?device_id=99185349-bf6b-4cb8-a80b-ebf360aecfbb&device_owner=compute%3Anova HTTP/1.1" status: 200 len: 945 time: 0.0866976 Dec 09 21:24:00.920911 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:24:00.944023 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2ea703fd-6eb1-42c9-ad17-186f53c50075 req-2fd9544f-2c5f-4ddd-a9ae-4dcba64c9b08 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=2f1265f7-0579-475d-9faa-f23ade6ec46b HTTP/1.1" status: 200 len: 999 time: 0.1211278 Dec 09 21:24:00.973732 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-01f02223-ec64-467e-9404-4ddd2b5ac997 req-f456735e-4933-470e-ae3b-02fe90d4bd82 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=89bd78b4-a499-4908-8ee4-7b3f64653d0b HTTP/1.1" status: 200 len: 210 time: 0.0374355 Dec 09 21:24:00.983770 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-feb8c895-e0e7-4313-a9bd-cf4ef5ed0f23 req-82c32eb1-cc6a-4261-9cb4-d58e7e30a7cd tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.154 HTTP/1.1" status: 200 len: 696 time: 0.0937536 Dec 09 21:24:00.989193 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-feb8c895-e0e7-4313-a9bd-cf4ef5ed0f23 req-2b6edfe0-43e7-449d-8a49-deff8529ad05 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Request body: {'floatingip': {'port_id': '2f1265f7-0579-475d-9faa-f23ade6ec46b', 'fixed_ip_address': '172.20.0.5'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:01.002828 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ea703fd-6eb1-42c9-ad17-186f53c50075 req-755906b6-997c-4bf5-bce4-64130a7a7b96 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:01.005030 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2ea703fd-6eb1-42c9-ad17-186f53c50075 req-755906b6-997c-4bf5-bce4-64130a7a7b96 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=176a8001-d04b-4c22-9715-06327ff3546d HTTP/1.1" status: 200 len: 868 time: 0.0499678 Dec 09 21:24:01.017869 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-186341ff-a9dd-4d69-864c-50448675ccde req-895bfd8b-6b44-4457-b770-7c43f77de700 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:01.017869 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-186341ff-a9dd-4d69-864c-50448675ccde req-895bfd8b-6b44-4457-b770-7c43f77de700 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.31 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 945 time: 0.1317503 Dec 09 21:24:01.144084 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ea703fd-6eb1-42c9-ad17-186f53c50075 req-51221cf7-4c5a-442a-ab61-6b6b176fa6d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:01.145742 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2ea703fd-6eb1-42c9-ad17-186f53c50075 req-51221cf7-4c5a-442a-ab61-6b6b176fa6d8 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=9b3c0886-168c-4d9c-83a4-145e87393715&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1280253 Dec 09 21:24:01.242166 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-186341ff-a9dd-4d69-864c-50448675ccde req-a0d47ee0-fd64-4fe4-9995-9e6ee146af08 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Deleting port 13499602-258c-4839-b928-17aef0d24310 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:01.242588 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-186341ff-a9dd-4d69-864c-50448675ccde req-a0d47ee0-fd64-4fe4-9995-9e6ee146af08 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:01.338467 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2ea703fd-6eb1-42c9-ad17-186f53c50075 req-3745b7ee-4775-4d74-979e-723542bdb656 service neutron] 10.222.0.10 "GET /v2.0/networks/9b3c0886-168c-4d9c-83a4-145e87393715?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1787727 Dec 09 21:24:01.402290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-186341ff-a9dd-4d69-864c-50448675ccde req-a0d47ee0-fd64-4fe4-9995-9e6ee146af08 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] For port 13499602-258c-4839-b928-17aef0d24310, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=13499602-258c-4839-b928-17aef0d24310,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:01.403380 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-186341ff-a9dd-4d69-864c-50448675ccde req-a0d47ee0-fd64-4fe4-9995-9e6ee146af08 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:01.414390 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device df55306b-f9c9-42b2-a899-aa67e74612f6 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:24:01.439051 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: df55306b-f9c9-42b2-a899-aa67e74612f6 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:24:01.439836 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device df55306b-f9c9-42b2-a899-aa67e74612f6 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:24:01.447145 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-186341ff-a9dd-4d69-864c-50448675ccde req-a0d47ee0-fd64-4fe4-9995-9e6ee146af08 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Calling delete_port for 13499602-258c-4839-b928-17aef0d24310 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:01.448737 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-feb8c895-e0e7-4313-a9bd-cf4ef5ed0f23 req-2b6edfe0-43e7-449d-8a49-deff8529ad05 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks [] for floatingip, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:01.516631 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2ea703fd-6eb1-42c9-ad17-186f53c50075 req-8f87380f-0a11-4c28-abc1-87792d74c9cb service neutron] 10.222.0.10 "GET /v2.0/networks/9b3c0886-168c-4d9c-83a4-145e87393715?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1633892 Dec 09 21:24:01.613554 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-186341ff-a9dd-4d69-864c-50448675ccde req-a0d47ee0-fd64-4fe4-9995-9e6ee146af08 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:01.625730 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['6166c639-9f87-4254-af88-12c4be868be5', '13499602-258c-4839-b928-17aef0d24310'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:24:01.645220 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0d47ee0-fd64-4fe4-9995-9e6ee146af08 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Pushing event deleted for resources: {'Port': ['ID=13499602-258c-4839-b928-17aef0d24310,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:01.687465 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-186341ff-a9dd-4d69-864c-50448675ccde req-a0d47ee0-fd64-4fe4-9995-9e6ee146af08 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] No DVR routers for this DVR port 13499602-258c-4839-b928-17aef0d24310 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:24:01.691471 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-186341ff-a9dd-4d69-864c-50448675ccde req-a0d47ee0-fd64-4fe4-9995-9e6ee146af08 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:01.694857 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-186341ff-a9dd-4d69-864c-50448675ccde req-a0d47ee0-fd64-4fe4-9995-9e6ee146af08 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.31 "DELETE /v2.0/ports/13499602-258c-4839-b928-17aef0d24310 HTTP/1.1" status: 204 len: 173 time: 0.6574399 Dec 09 21:24:01.695426 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7300996b-d799-47a2-9728-a8551719a88f', 'name': 'network-vif-deleted', 'tag': '13499602-258c-4839-b928-17aef0d24310'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:24:01.698428 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e8444852-51db-4be5-9162-a55e537f8f12" -d '{"events": [{"server_uuid": "7300996b-d799-47a2-9728-a8551719a88f", "name": "network-vif-deleted", "tag": "13499602-258c-4839-b928-17aef0d24310"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:24:01.704688 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f120e53-25f0-4908-9480-2b28b4637ae1 req-7434334a-59f4-4a4c-b55f-630ff02f5e61 tempest-NetworksTest-1904895965 tempest-NetworksTest-1904895965-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:01.705920 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f120e53-25f0-4908-9480-2b28b4637ae1 req-7434334a-59f4-4a4c-b55f-630ff02f5e61 tempest-NetworksTest-1904895965 tempest-NetworksTest-1904895965-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:01.705920 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f120e53-25f0-4908-9480-2b28b4637ae1 req-7434334a-59f4-4a4c-b55f-630ff02f5e61 tempest-NetworksTest-1904895965 tempest-NetworksTest-1904895965-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:01.706188 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f120e53-25f0-4908-9480-2b28b4637ae1 req-7434334a-59f4-4a4c-b55f-630ff02f5e61 tempest-NetworksTest-1904895965 tempest-NetworksTest-1904895965-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:01.706617 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f120e53-25f0-4908-9480-2b28b4637ae1 req-7434334a-59f4-4a4c-b55f-630ff02f5e61 tempest-NetworksTest-1904895965 tempest-NetworksTest-1904895965-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:01.707071 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f120e53-25f0-4908-9480-2b28b4637ae1 req-7434334a-59f4-4a4c-b55f-630ff02f5e61 tempest-NetworksTest-1904895965 tempest-NetworksTest-1904895965-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:01.707701 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f120e53-25f0-4908-9480-2b28b4637ae1 req-7434334a-59f4-4a4c-b55f-630ff02f5e61 tempest-NetworksTest-1904895965 tempest-NetworksTest-1904895965-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:01.708022 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f120e53-25f0-4908-9480-2b28b4637ae1 req-7434334a-59f4-4a4c-b55f-630ff02f5e61 tempest-NetworksTest-1904895965 tempest-NetworksTest-1904895965-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:01.708505 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f120e53-25f0-4908-9480-2b28b4637ae1 req-7434334a-59f4-4a4c-b55f-630ff02f5e61 tempest-NetworksTest-1904895965 tempest-NetworksTest-1904895965-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:01.710676 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f120e53-25f0-4908-9480-2b28b4637ae1 req-7434334a-59f4-4a4c-b55f-630ff02f5e61 tempest-NetworksTest-1904895965 tempest-NetworksTest-1904895965-project-admin] 10.222.0.13 "GET /v2.0/networks HTTP/1.1" status: 200 len: 6421 time: 0.2656860 Dec 09 21:24:01.784430 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-feb8c895-e0e7-4313-a9bd-cf4ef5ed0f23 req-2b6edfe0-43e7-449d-8a49-deff8529ad05 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] update failed (client error): There was a conflict when trying to complete your request. Dec 09 21:24:01.785521 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-feb8c895-e0e7-4313-a9bd-cf4ef5ed0f23 req-2b6edfe0-43e7-449d-8a49-deff8529ad05 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "PUT /v2.0/floatingips/848cf8a7-6ddc-439f-8fbf-20335e1c2b1d HTTP/1.1" status: 409 len: 550 time: 0.8007803 Dec 09 21:24:02.014973 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:24:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ae82b7d6-f344-48b4-8632-343a9e5ca1c3 x-openstack-request-id: req-ae82b7d6-f344-48b4-8632-343a9e5ca1c3 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:24:02.015295 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7300996b-d799-47a2-9728-a8551719a88f", "name": "network-vif-deleted", "tag": "13499602-258c-4839-b928-17aef0d24310", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:24:02.015589 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-ae82b7d6-f344-48b4-8632-343a9e5ca1c3 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:24:02.015948 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7300996b-d799-47a2-9728-a8551719a88f', 'name': 'network-vif-deleted', 'tag': '13499602-258c-4839-b928-17aef0d24310', 'status': 'completed', 'code': 200} Dec 09 21:24:02.028659 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0535205-1808-4906-8019-3bc63bc6b607 req-895d2083-287a-42dd-a2c2-1e952ae633bd tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:02.031919 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0535205-1808-4906-8019-3bc63bc6b607 req-895d2083-287a-42dd-a2c2-1e952ae633bd tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07 HTTP/1.1" status: 200 len: 946 time: 0.0675623 Dec 09 21:24:02.098981 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35670) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:02.128740 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ec7128f-670e-46cd-9aed-408e78a67700 req-79512a0e-ac28-4b9f-a8a3-e0d3b477b9f9 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/floatingips/848cf8a7-6ddc-439f-8fbf-20335e1c2b1d HTTP/1.1" status: 200 len: 693 time: 0.0826197 Dec 09 21:24:02.136286 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0535205-1808-4906-8019-3bc63bc6b607 req-6d813c8d-fe53-4366-830b-7ee8f0fd05fc tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0981920 Dec 09 21:24:02.270561 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1230374a-2efb-462f-b070-f4ae837a5319 req-891d3451-5c37-4f1c-81e0-0626a898a3fb tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 210 time: 0.0428629 Dec 09 21:24:02.273229 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0f5641a-1af7-4784-b951-e80443b45ace admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:02.318726 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ec7128f-670e-46cd-9aed-408e78a67700 req-617185d8-93ca-4fec-bf54-cb84b3ed9347 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:02.320299 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ec7128f-670e-46cd-9aed-408e78a67700 req-617185d8-93ca-4fec-bf54-cb84b3ed9347 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.1831622 Dec 09 21:24:02.408087 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ec7128f-670e-46cd-9aed-408e78a67700 req-b8daaf70-4133-4c1f-9e57-608b51f1ff08 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.154 HTTP/1.1" status: 200 len: 696 time: 0.0757289 Dec 09 21:24:02.500938 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ec7128f-670e-46cd-9aed-408e78a67700 req-8055412c-0849-463b-900f-777201580536 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.154 HTTP/1.1" status: 200 len: 696 time: 0.0724475 Dec 09 21:24:02.514919 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0f5641a-1af7-4784-b951-e80443b45ace admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:02.558245 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0f5641a-1af7-4784-b951-e80443b45ace admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:02.570186 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '89bd78b4-a499-4908-8ee4-7b3f64653d0b', 'name': 'network-vif-deleted', 'tag': '36925110-4ed7-49f6-b07d-d998896a74cc'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:24:02.572440 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a25d469c-dd27-479e-af81-2dcc622d1e89" -d '{"events": [{"server_uuid": "89bd78b4-a499-4908-8ee4-7b3f64653d0b", "name": "network-vif-deleted", "tag": "36925110-4ed7-49f6-b07d-d998896a74cc"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:24:02.688289 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0f5641a-1af7-4784-b951-e80443b45ace admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f2ca10bb-7d0e-4d90-943b-b5a5bb3cecbf,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:02.705422 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e0f5641a-1af7-4784-b951-e80443b45ace admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=228356da13d647f6a39d5824bc56f29e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6044519 Dec 09 21:24:02.709653 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35700) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:02.743463 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-cdc352cd-781a-4d88-8a83-599295389b88 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:02.744970 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-cdc352cd-781a-4d88-8a83-599295389b88 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/networks?id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb HTTP/1.1" status: 200 len: 812 time: 0.2756116 Dec 09 21:24:02.767000 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-6f6ff25d-7283-4bd9-a674-b5f46e34fe75 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/quotas/1b7916b634f74760a565cfeaef510cd9 HTTP/1.1" status: 200 len: 375 time: 0.0131471 Dec 09 21:24:02.772008 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-84d79f7b-6328-4885-9cb8-c73f2324f419 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:02.790106 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-6ec7128f-670e-46cd-9aed-408e78a67700 req-72931770-d1b1-4687-a01e-dd1368e3ff60 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Deleting port a6150448-434c-428b-92c0-be0829bc4724 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:02.790450 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6ec7128f-670e-46cd-9aed-408e78a67700 req-72931770-d1b1-4687-a01e-dd1368e3ff60 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:02.798603 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-84d79f7b-6328-4885-9cb8-c73f2324f419 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:02.807426 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-198a6a2a-3e27-40a7-981a-39478740cddc tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=1b7916b634f74760a565cfeaef510cd9&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0311673 Dec 09 21:24:02.861746 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-84d79f7b-6328-4885-9cb8-c73f2324f419 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:02.865419 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-84d79f7b-6328-4885-9cb8-c73f2324f419 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:02.867183 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-84d79f7b-6328-4885-9cb8-c73f2324f419 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/f2ca10bb-7d0e-4d90-943b-b5a5bb3cecbf HTTP/1.1" status: 204 len: 168 time: 0.1572428 Dec 09 21:24:02.877255 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84d79f7b-6328-4885-9cb8-c73f2324f419 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f2ca10bb-7d0e-4d90-943b-b5a5bb3cecbf,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:02.951169 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6ec7128f-670e-46cd-9aed-408e78a67700 req-72931770-d1b1-4687-a01e-dd1368e3ff60 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:02.951389 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6ec7128f-670e-46cd-9aed-408e78a67700 req-72931770-d1b1-4687-a01e-dd1368e3ff60 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:02.952443 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1d307c22-fc1b-470e-91be-7ed2ea1d7674 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:02.974794 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-6ec7128f-670e-46cd-9aed-408e78a67700 req-72931770-d1b1-4687-a01e-dd1368e3ff60 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Calling delete_port for a6150448-434c-428b-92c0-be0829bc4724 owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:02.978000 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-b6476ede-a633-4ca2-b415-bcb9b52905f5 service neutron] 10.222.0.13 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1604035 Dec 09 21:24:03.132742 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-e7e47b50-71f7-46c7-988d-3e09c4407ddf service neutron] 10.222.0.13 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1461101 Dec 09 21:24:03.215778 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6ec7128f-670e-46cd-9aed-408e78a67700 req-72931770-d1b1-4687-a01e-dd1368e3ff60 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:03.220147 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35708) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:03.262271 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-be041aea-b958-48a3-8fcb-8ab1975d57e4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:03.317127 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72931770-d1b1-4687-a01e-dd1368e3ff60 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Pushing event deleted for resources: {'Port': ['ID=a6150448-434c-428b-92c0-be0829bc4724,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:03.319612 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6ec7128f-670e-46cd-9aed-408e78a67700 req-72931770-d1b1-4687-a01e-dd1368e3ff60 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:03.322140 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6ec7128f-670e-46cd-9aed-408e78a67700 req-72931770-d1b1-4687-a01e-dd1368e3ff60 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:03.323405 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ec7128f-670e-46cd-9aed-408e78a67700 req-72931770-d1b1-4687-a01e-dd1368e3ff60 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "DELETE /v2.0/floatingips/848cf8a7-6ddc-439f-8fbf-20335e1c2b1d HTTP/1.1" status: 204 len: 173 time: 0.8071740 Dec 09 21:24:03.413177 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 36925110-4ed7-49f6-b07d-d998896a74cc no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:24:03.469099 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1069a299-b422-4425-b761-43570d4d940d req-0ed641d5-6202-4411-871b-7ef0baa511fd tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:03.476445 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1069a299-b422-4425-b761-43570d4d940d req-0ed641d5-6202-4411-871b-7ef0baa511fd tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07 HTTP/1.1" status: 200 len: 946 time: 0.1238043 Dec 09 21:24:03.496202 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 36925110-4ed7-49f6-b07d-d998896a74cc {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:24:03.496952 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 36925110-4ed7-49f6-b07d-d998896a74cc not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:24:03.523970 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-be041aea-b958-48a3-8fcb-8ab1975d57e4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:03.531365 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-be041aea-b958-48a3-8fcb-8ab1975d57e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:03.572858 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1069a299-b422-4425-b761-43570d4d940d req-f79be475-4fe1-4677-aba0-d518a2419c33 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0882535 Dec 09 21:24:03.610410 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-be041aea-b958-48a3-8fcb-8ab1975d57e4 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=425df806712f4fee8cf1ef0ebb1648d3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3877585 Dec 09 21:24:03.611727 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be041aea-b958-48a3-8fcb-8ab1975d57e4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=75b60134-f27a-41cf-ac90-48f08c8af77e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:03.614144 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35734) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:03.680489 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:24:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4bafe53f-d609-4f5c-be9e-d3e7f28f7dd4 x-openstack-request-id: req-4bafe53f-d609-4f5c-be9e-d3e7f28f7dd4 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:24:03.681176 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "89bd78b4-a499-4908-8ee4-7b3f64653d0b", "name": "network-vif-deleted", "tag": "36925110-4ed7-49f6-b07d-d998896a74cc", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:24:03.681807 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-4bafe53f-d609-4f5c-be9e-d3e7f28f7dd4 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:24:03.682455 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '89bd78b4-a499-4908-8ee4-7b3f64653d0b', 'name': 'network-vif-deleted', 'tag': '36925110-4ed7-49f6-b07d-d998896a74cc', 'status': 'completed', 'code': 200} Dec 09 21:24:03.729447 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-827f658a-f966-4232-b28f-b59c6a1c85a5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:03.734608 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b5aaf941-e1a8-4ac3-8bf9-d3d13c9cc3a8 req-819efcc5-1406-43e5-98a9-2a1eadf42c22 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f7517580-ddaa-48b1-9288-a3db030a3443 HTTP/1.1" status: 200 len: 210 time: 0.0493164 Dec 09 21:24:03.814182 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-827f658a-f966-4232-b28f-b59c6a1c85a5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:03.898434 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c58fac33-47c3-4718-9542-82cde918497a req-52a73c58-1564-4b3e-9c26-1859eb41ad21 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 210 time: 0.0936522 Dec 09 21:24:03.938034 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-fc8e1578-8c0e-4c63-b872-3a3571ea5e5b tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.8 HTTP/1.1" status: 200 len: 999 time: 0.1621737 Dec 09 21:24:04.027851 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-827f658a-f966-4232-b28f-b59c6a1c85a5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:04.030801 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-827f658a-f966-4232-b28f-b59c6a1c85a5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:04.032069 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-827f658a-f966-4232-b28f-b59c6a1c85a5 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/75b60134-f27a-41cf-ac90-48f08c8af77e HTTP/1.1" status: 204 len: 168 time: 0.4166901 Dec 09 21:24:04.056686 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-827f658a-f966-4232-b28f-b59c6a1c85a5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=75b60134-f27a-41cf-ac90-48f08c8af77e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:04.097924 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-54971322-b0bc-4fe1-a2bb-239bbe9dd87f tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:04.099927 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-54971322-b0bc-4fe1-a2bb-239bbe9dd87f tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/ports/2f1265f7-0579-475d-9faa-f23ade6ec46b HTTP/1.1" status: 200 len: 942 time: 0.1611307 Dec 09 21:24:04.173343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-687c0b76-c11a-44d2-b577-76548db5e283 req-7bcb35a5-fb62-4ace-9e0d-aac2e76dc5b1 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:04.175747 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-687c0b76-c11a-44d2-b577-76548db5e283 req-7bcb35a5-fb62-4ace-9e0d-aac2e76dc5b1 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 950 time: 0.0742927 Dec 09 21:24:04.264532 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-8d965fa4-801b-4cf5-95dc-c4f342c3ef62 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.8 HTTP/1.1" status: 200 len: 999 time: 0.0877306 Dec 09 21:24:04.290870 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-687c0b76-c11a-44d2-b577-76548db5e283 req-3bc2ade7-ac0b-4101-8835-09c28a960bc6 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/security-groups?id=f29e6584-b652-4b5d-8afa-c1d6228ef778&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1051085 Dec 09 21:24:04.309578 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 13499602-258c-4839-b928-17aef0d24310 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:24:04.337696 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 13499602-258c-4839-b928-17aef0d24310 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:24:04.338131 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 13499602-258c-4839-b928-17aef0d24310 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:24:04.407057 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-c6ffcfe1-61df-49d8-8a8f-ec5384145bb4 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:04.408749 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-c6ffcfe1-61df-49d8-8a8f-ec5384145bb4 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.1357915 Dec 09 21:24:04.557868 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-cd2e1bea-da02-4d00-a0b1-dd87ca47d6bc tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.8 HTTP/1.1" status: 200 len: 999 time: 0.1419601 Dec 09 21:24:04.565083 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-d04b714f-0f0e-4561-978c-4f3dd50e7150 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Request body: {'floatingip': {'port_id': None}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:04.752050 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2c19546-4ed8-48f7-b8ae-0bcd93bf78b4 req-ace0f5d7-09dc-44cd-84ec-1ef080777c84 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:04.753700 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2c19546-4ed8-48f7-b8ae-0bcd93bf78b4 req-ace0f5d7-09dc-44cd-84ec-1ef080777c84 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07 HTTP/1.1" status: 200 len: 946 time: 0.1233914 Dec 09 21:24:04.756303 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-d04b714f-0f0e-4561-978c-4f3dd50e7150 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks [] for floatingip, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:04.891802 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2c19546-4ed8-48f7-b8ae-0bcd93bf78b4 req-d36a9f21-523e-4bfb-b5d6-9ce1d3bfec55 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0701358 Dec 09 21:24:04.999505 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-1d2d299e-430e-4c84-8811-d9f87869411f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:05.008064 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-1d2d299e-430e-4c84-8811-d9f87869411f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.10 "GET /v2.0/networks?id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb HTTP/1.1" status: 200 len: 812 time: 0.5241051 Dec 09 21:24:05.022888 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-d04b714f-0f0e-4561-978c-4f3dd50e7150 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:05.030655 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-d04b714f-0f0e-4561-978c-4f3dd50e7150 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:05.031008 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-d04b714f-0f0e-4561-978c-4f3dd50e7150 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Floating IP 175fadfc-f0ea-4d39-b7c2-2f94e3c75833 disassociated. External IP: 172.25.3.8, port: 2f1265f7-0579-475d-9faa-f23ade6ec46b. Dec 09 21:24:05.071758 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-e8322eec-ed4f-45c1-855f-692ed4439c59 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Request body: {'port': {'device_id': 'f7517580-ddaa-48b1-9288-a3db030a3443', 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb', 'admin_state_up': True, 'tenant_id': '1b7916b634f74760a565cfeaef510cd9'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:05.139825 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cfc4806-e208-4a3e-adba-7f0afcb5fca2 req-60f185c5-310a-45f0-a034-0b0a7263bed5 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:05.141500 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2cfc4806-e208-4a3e-adba-7f0afcb5fca2 req-60f185c5-310a-45f0-a034-0b0a7263bed5 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.31 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 950 time: 0.1848056 Dec 09 21:24:05.232052 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df6b1ef4-e49d-4eab-96f6-8249f11f2da6 req-dd150411-c759-431f-85cd-536a75f37373 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f7517580-ddaa-48b1-9288-a3db030a3443 HTTP/1.1" status: 200 len: 210 time: 0.0268209 Dec 09 21:24:05.374266 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-2cfc4806-e208-4a3e-adba-7f0afcb5fca2 req-621464f4-19fb-4098-8ace-3fc5122500b0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Deleting port 204e6970-8ed3-4e91-9792-52401052a153 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:05.374792 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2cfc4806-e208-4a3e-adba-7f0afcb5fca2 req-621464f4-19fb-4098-8ace-3fc5122500b0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:05.391021 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-e8322eec-ed4f-45c1-855f-692ed4439c59 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Made reservation on behalf of 1b7916b634f74760a565cfeaef510cd9 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:24:05.395763 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-e8322eec-ed4f-45c1-855f-692ed4439c59 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:05.439697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-d04b714f-0f0e-4561-978c-4f3dd50e7150 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Router 88041dd4-3b62-47ec-ab19-cf438d19e15b has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:24:05.489675 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e27e0fbb-2326-4533-9ace-ce785748ee77 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:05.552891 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-2cfc4806-e208-4a3e-adba-7f0afcb5fca2 req-621464f4-19fb-4098-8ace-3fc5122500b0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] For port 204e6970-8ed3-4e91-9792-52401052a153, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=204e6970-8ed3-4e91-9792-52401052a153,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:05.553821 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2cfc4806-e208-4a3e-adba-7f0afcb5fca2 req-621464f4-19fb-4098-8ace-3fc5122500b0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:05.567355 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-753d3600-a19e-4af3-bbf0-676dd993f96f req-79882c8f-50e7-4f57-b15c-f14bb24497ed tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:05.569709 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-753d3600-a19e-4af3-bbf0-676dd993f96f req-79882c8f-50e7-4f57-b15c-f14bb24497ed tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07 HTTP/1.1" status: 200 len: 946 time: 0.1656539 Dec 09 21:24:05.615950 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-e8322eec-ed4f-45c1-855f-692ed4439c59 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Allocated IP 172.20.0.14 (43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb/50496955-1646-4079-acd4-a47e8cd175cb/e588819c-5a89-4820-82c6-5ac8ba582aa1) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:24:05.628557 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-2cfc4806-e208-4a3e-adba-7f0afcb5fca2 req-621464f4-19fb-4098-8ace-3fc5122500b0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Calling delete_port for 204e6970-8ed3-4e91-9792-52401052a153 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:05.652003 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-753d3600-a19e-4af3-bbf0-676dd993f96f req-ed0cf65b-bb85-448e-bd88-b803af186acb tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0728993 Dec 09 21:24:05.725156 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-d04b714f-0f0e-4561-978c-4f3dd50e7150 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:24:05.732604 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-d04b714f-0f0e-4561-978c-4f3dd50e7150 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:05.736851 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2806e47a-6c8b-40c9-8e22-3e37af71a95e None None] Sync routers for ids ['88041dd4-3b62-47ec-ab19-cf438d19e15b'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:24:05.748910 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2806e47a-6c8b-40c9-8e22-3e37af71a95e None None] Routers {'88041dd4-3b62-47ec-ab19-cf438d19e15b'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:24:05.749569 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2806e47a-6c8b-40c9-8e22-3e37af71a95e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['88041dd4-3b62-47ec-ab19-cf438d19e15b'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:05.810405 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-d04b714f-0f0e-4561-978c-4f3dd50e7150 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "PUT /v2.0/floatingips/175fadfc-f0ea-4d39-b7c2-2f94e3c75833 HTTP/1.1" status: 200 len: 693 time: 1.2505779 Dec 09 21:24:05.813280 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '99185349-bf6b-4cb8-a80b-ebf360aecfbb', 'tag': '2f1265f7-0579-475d-9faa-f23ade6ec46b'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:24:05.823846 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8ebbcf70-7df6-4e99-8949-54e7a984f463" -d '{"events": [{"name": "network-changed", "server_uuid": "99185349-bf6b-4cb8-a80b-ebf360aecfbb", "tag": "2f1265f7-0579-475d-9faa-f23ade6ec46b"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:24:05.930528 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bdda1721-92ee-48c2-beb6-52620cdab570 req-7b471891-6e45-44db-857a-df25156ed91a tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=7300996b-d799-47a2-9728-a8551719a88f HTTP/1.1" status: 200 len: 210 time: 0.1185648 Dec 09 21:24:05.956081 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-2806e47a-6c8b-40c9-8e22-3e37af71a95e None None] Set router 88041dd4-3b62-47ec-ab19-cf438d19e15b gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:24:05.988694 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-e8322eec-ed4f-45c1-855f-692ed4439c59 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:05.994785 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2cfc4806-e208-4a3e-adba-7f0afcb5fca2 req-621464f4-19fb-4098-8ace-3fc5122500b0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:06.007367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['204e6970-8ed3-4e91-9792-52401052a153'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:24:06.067877 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-621464f4-19fb-4098-8ace-3fc5122500b0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Pushing event deleted for resources: {'Port': ['ID=204e6970-8ed3-4e91-9792-52401052a153,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:06.106933 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-19a7e272-948b-46fa-b27b-860b450efb9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:06.109460 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-19a7e272-948b-46fa-b27b-860b450efb9b service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=768655d2ebd74340a90f65fc3007118f&device_id=99185349-bf6b-4cb8-a80b-ebf360aecfbb HTTP/1.1" status: 200 len: 1097 time: 0.2588861 Dec 09 21:24:06.188499 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-938361ff-d139-4580-be19-db5a03dd4eb1 req-07142432-908a-432b-9cbe-504260756777 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=63d23827-0eb3-4c4c-87f7-698524a008f5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1441548 Dec 09 21:24:06.191533 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-951d7e20-4481-4cc8-8cae-4cb7ef0f5e1c req-5683ad64-9d49-4f51-a629-812b3943b3d2 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.13 "GET /v2.0/ports?device_id=e6fbd1df-a53f-4f75-810f-f90ea3677ac8 HTTP/1.1" status: 200 len: 210 time: 0.0482652 Dec 09 21:24:06.203627 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-2cfc4806-e208-4a3e-adba-7f0afcb5fca2 req-621464f4-19fb-4098-8ace-3fc5122500b0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] No DVR routers for this DVR port 204e6970-8ed3-4e91-9792-52401052a153 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:24:06.210592 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2cfc4806-e208-4a3e-adba-7f0afcb5fca2 req-621464f4-19fb-4098-8ace-3fc5122500b0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:06.214849 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2cfc4806-e208-4a3e-adba-7f0afcb5fca2 req-621464f4-19fb-4098-8ace-3fc5122500b0 tempest-MigrationsAdminTest-1663897922 tempest-MigrationsAdminTest-1663897922-project] 10.222.0.31 "DELETE /v2.0/ports/204e6970-8ed3-4e91-9792-52401052a153 HTTP/1.1" status: 204 len: 173 time: 1.0595138 Dec 09 21:24:06.216974 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e6fbd1df-a53f-4f75-810f-f90ea3677ac8', 'name': 'network-vif-deleted', 'tag': '204e6970-8ed3-4e91-9792-52401052a153'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:24:06.228916 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9a008d51-997d-4114-930d-e4986dbccb86" -d '{"events": [{"server_uuid": "e6fbd1df-a53f-4f75-810f-f90ea3677ac8", "name": "network-vif-deleted", "tag": "204e6970-8ed3-4e91-9792-52401052a153"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:24:06.264403 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-e8322eec-ed4f-45c1-855f-692ed4439c59 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:06.386282 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-e8322eec-ed4f-45c1-855f-692ed4439c59 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:06.387814 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8322eec-ed4f-45c1-855f-692ed4439c59 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Pushing event updated for resources: {'Port': ['ID=e588819c-5a89-4820-82c6-5ac8ba582aa1,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:06.402250 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-e8322eec-ed4f-45c1-855f-692ed4439c59 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:06.404721 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-e8322eec-ed4f-45c1-855f-692ed4439c59 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:24:06.405104 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-9f41e7cf-5e3b-4f81-9461-a7f66c0f21f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:06.428009 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-9f41e7cf-5e3b-4f81-9461-a7f66c0f21f7 service neutron] 10.222.0.13 "GET /v2.0/networks?id=9b3c0886-168c-4d9c-83a4-145e87393715 HTTP/1.1" status: 200 len: 930 time: 0.2904615 Dec 09 21:24:06.433099 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:24:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-424e13a5-e3dc-4e8a-b4d6-5246ac073947 x-openstack-request-id: req-424e13a5-e3dc-4e8a-b4d6-5246ac073947 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:24:06.440344 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "99185349-bf6b-4cb8-a80b-ebf360aecfbb", "tag": "2f1265f7-0579-475d-9faa-f23ade6ec46b", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:24:06.440680 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-424e13a5-e3dc-4e8a-b4d6-5246ac073947 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:24:06.441532 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '99185349-bf6b-4cb8-a80b-ebf360aecfbb', 'tag': '2f1265f7-0579-475d-9faa-f23ade6ec46b', 'status': 'completed', 'code': 200} Dec 09 21:24:06.450724 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2806e47a-6c8b-40c9-8e22-3e37af71a95e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1528769429-router', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42'}], 'enable_snat': True}, 'gw_port_id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:23:17Z', 'updated_at': '2021-12-09T21:23:23Z', 'revision_number': 4, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'gw_port': {'id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:c0:45:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:23:18Z', 'updated_at': '2021-12-09T21:23:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '047fd970-b4fd-4fa7-81e7-fba0167dbce6', 'name': '', 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'mac_address': 'fa:16:3e:a3:36:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'device_owner': 'network:router_interface', 'standard_attr_id': 705, 'fixed_ips': [{'subnet_id': '176a8001-d04b-4c22-9715-06327ff3546d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:23:22Z', 'updated_at': '2021-12-09T21:23:37Z', 'revision_number': 5, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'subnets': [{'id': '176a8001-d04b-4c22-9715-06327ff3546d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:06.523669 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2806e47a-6c8b-40c9-8e22-3e37af71a95e None None] Checking router: 88041dd4-3b62-47ec-ab19-cf438d19e15b for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:24:06.543481 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:06.550685 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2806e47a-6c8b-40c9-8e22-3e37af71a95e None None] Routers {'88041dd4-3b62-47ec-ab19-cf438d19e15b'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:24:06.554098 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2806e47a-6c8b-40c9-8e22-3e37af71a95e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['88041dd4-3b62-47ec-ab19-cf438d19e15b'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:06.570434 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-e8322eec-ed4f-45c1-855f-692ed4439c59 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:06.571128 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-e8322eec-ed4f-45c1-855f-692ed4439c59 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:06.575277 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-fc08f8f7-304b-48b5-ad2c-828a6c378748 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=2f1265f7-0579-475d-9faa-f23ade6ec46b HTTP/1.1" status: 200 len: 217 time: 0.1456029 Dec 09 21:24:06.612664 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-e8322eec-ed4f-45c1-855f-692ed4439c59 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.5772517 Dec 09 21:24:06.630847 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-158125c5-7a3e-4f0f-9330-05b64ed8e02f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:06.633558 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-58449679-0799-43de-983f-60cb79610e15 service neutron] Request body: {'port': {'device_id': 'f7517580-ddaa-48b1-9288-a3db030a3443', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:06.642805 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-158125c5-7a3e-4f0f-9330-05b64ed8e02f service neutron] 10.222.0.13 "GET /v2.0/subnets?id=176a8001-d04b-4c22-9715-06327ff3546d HTTP/1.1" status: 200 len: 868 time: 0.0660887 Dec 09 21:24:06.687543 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-938361ff-d139-4580-be19-db5a03dd4eb1 req-de0419ee-739d-4a8e-94fc-5d7983705bf2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:06.689770 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-938361ff-d139-4580-be19-db5a03dd4eb1 req-de0419ee-739d-4a8e-94fc-5d7983705bf2 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=06bbcbacf3914054b6d39114daad8f77&device_id=63d23827-0eb3-4c4c-87f7-698524a008f5 HTTP/1.1" status: 200 len: 1099 time: 0.4307909 Dec 09 21:24:06.710982 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ebbcf70-7df6-4e99-8949-54e7a984f463 req-88105f02-6c09-4219-8ec6-14d2ac6c118b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:06.712403 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ebbcf70-7df6-4e99-8949-54e7a984f463 req-88105f02-6c09-4219-8ec6-14d2ac6c118b service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=768655d2ebd74340a90f65fc3007118f&device_id=99185349-bf6b-4cb8-a80b-ebf360aecfbb HTTP/1.1" status: 200 len: 1097 time: 0.2700758 Dec 09 21:24:06.798888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35852) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:06.811641 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-2806e47a-6c8b-40c9-8e22-3e37af71a95e None None] Set router 88041dd4-3b62-47ec-ab19-cf438d19e15b gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:24:06.815684 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:24:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-525cbfa7-a98a-4682-8075-a365d224eaa9 x-openstack-request-id: req-525cbfa7-a98a-4682-8075-a365d224eaa9 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:24:06.815684 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e6fbd1df-a53f-4f75-810f-f90ea3677ac8", "name": "network-vif-deleted", "tag": "204e6970-8ed3-4e91-9792-52401052a153", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:24:06.815936 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-525cbfa7-a98a-4682-8075-a365d224eaa9 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:24:06.816237 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e6fbd1df-a53f-4f75-810f-f90ea3677ac8', 'name': 'network-vif-deleted', 'tag': '204e6970-8ed3-4e91-9792-52401052a153', 'status': 'completed', 'code': 200} Dec 09 21:24:06.817011 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-58449679-0799-43de-983f-60cb79610e15 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:07.083909 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-be7b385b-af7f-483e-8c01-ba9e3c06901e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:07.087680 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-be7b385b-af7f-483e-8c01-ba9e3c06901e service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=9b3c0886-168c-4d9c-83a4-145e87393715&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.4435179 Dec 09 21:24:07.089754 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2806e47a-6c8b-40c9-8e22-3e37af71a95e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1528769429-router', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42'}], 'enable_snat': True}, 'gw_port_id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:23:17Z', 'updated_at': '2021-12-09T21:23:23Z', 'revision_number': 4, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'gw_port': {'id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:c0:45:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:23:18Z', 'updated_at': '2021-12-09T21:23:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '047fd970-b4fd-4fa7-81e7-fba0167dbce6', 'name': '', 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'mac_address': 'fa:16:3e:a3:36:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'device_owner': 'network:router_interface', 'standard_attr_id': 705, 'fixed_ips': [{'subnet_id': '176a8001-d04b-4c22-9715-06327ff3546d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:23:22Z', 'updated_at': '2021-12-09T21:23:37Z', 'revision_number': 5, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'subnets': [{'id': '176a8001-d04b-4c22-9715-06327ff3546d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:07.146362 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2806e47a-6c8b-40c9-8e22-3e37af71a95e None None] The sync data for ids ['88041dd4-3b62-47ec-ab19-cf438d19e15b'] in n-d-713301-27 is: [{'id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1528769429-router', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42'}], 'enable_snat': True}, 'gw_port_id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:23:17Z', 'updated_at': '2021-12-09T21:23:23Z', 'revision_number': 4, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'gw_port': {'id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:c0:45:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:23:18Z', 'updated_at': '2021-12-09T21:23:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '047fd970-b4fd-4fa7-81e7-fba0167dbce6', 'name': '', 'network_id': '9b3c0886-168c-4d9c-83a4-145e87393715', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'mac_address': 'fa:16:3e:a3:36:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'device_owner': 'network:router_interface', 'standard_attr_id': 705, 'fixed_ips': [{'subnet_id': '176a8001-d04b-4c22-9715-06327ff3546d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:23:22Z', 'updated_at': '2021-12-09T21:23:37Z', 'revision_number': 5, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'subnets': [{'id': '176a8001-d04b-4c22-9715-06327ff3546d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:24:07.164405 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-58449679-0799-43de-983f-60cb79610e15 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e588819c-5a89-4820-82c6-5ac8ba582aa1 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:24:07.172829 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-58449679-0799-43de-983f-60cb79610e15 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:07.202814 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-58449679-0799-43de-983f-60cb79610e15 service neutron] Transition to ACTIVE for port object e588819c-5a89-4820-82c6-5ac8ba582aa1 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:24:07.212355 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-58449679-0799-43de-983f-60cb79610e15 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:07.384107 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58449679-0799-43de-983f-60cb79610e15 service neutron] Pushing event updated for resources: {'Port': ['ID=e588819c-5a89-4820-82c6-5ac8ba582aa1,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:07.411314 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-58449679-0799-43de-983f-60cb79610e15 service neutron] Attempting to bind port e588819c-5a89-4820-82c6-5ac8ba582aa1 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:24:07.412313 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-58449679-0799-43de-983f-60cb79610e15 service neutron] Attempting to bind port e588819c-5a89-4820-82c6-5ac8ba582aa1 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:24:07.412662 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-58449679-0799-43de-983f-60cb79610e15 service neutron] Attempting to bind port e588819c-5a89-4820-82c6-5ac8ba582aa1 on network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:24:07.417990 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-58449679-0799-43de-983f-60cb79610e15 service neutron] Port e588819c-5a89-4820-82c6-5ac8ba582aa1 on network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:24:07.418320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-58449679-0799-43de-983f-60cb79610e15 service neutron] Attempting to bind port e588819c-5a89-4820-82c6-5ac8ba582aa1 on network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:24:07.424342 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-58449679-0799-43de-983f-60cb79610e15 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 23, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:24:07.424941 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-58449679-0799-43de-983f-60cb79610e15 service neutron] Checking segment: {'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:24:07.425334 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-58449679-0799-43de-983f-60cb79610e15 service neutron] Bound using segment: {'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:24:07.425909 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-58449679-0799-43de-983f-60cb79610e15 service neutron] Bound port: e588819c-5a89-4820-82c6-5ac8ba582aa1, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:24:07.426438 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-58449679-0799-43de-983f-60cb79610e15 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:07.500443 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-58449679-0799-43de-983f-60cb79610e15 service neutron] For port e588819c-5a89-4820-82c6-5ac8ba582aa1, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:24:07.504734 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-58449679-0799-43de-983f-60cb79610e15 service neutron] For port e588819c-5a89-4820-82c6-5ac8ba582aa1, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e588819c-5a89-4820-82c6-5ac8ba582aa1,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:24:07.513286 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-58449679-0799-43de-983f-60cb79610e15 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:07.557848 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ebd4f2e-40ad-4a47-a81f-ee10bf44f8e5 None None] New status for floating IP 175fadfc-f0ea-4d39-b7c2-2f94e3c75833: DOWN {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:24:07.584766 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-58449679-0799-43de-983f-60cb79610e15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:07.585412 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-58449679-0799-43de-983f-60cb79610e15 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:07.586986 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-58449679-0799-43de-983f-60cb79610e15 service neutron] 10.222.0.10 "PUT /v2.0/ports/e588819c-5a89-4820-82c6-5ac8ba582aa1 HTTP/1.1" status: 200 len: 1093 time: 0.9621718 Dec 09 21:24:07.642294 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58449679-0799-43de-983f-60cb79610e15 service neutron] Pushing event updated for resources: {'Port': ['ID=e588819c-5a89-4820-82c6-5ac8ba582aa1,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:07.744640 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70c64627-ab9a-4066-8c24-35d77b5b6905 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:07.749225 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-8e50d518-04da-449b-a80b-32f1af37b180 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:07.753572 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-8e50d518-04da-449b-a80b-32f1af37b180 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=1b7916b634f74760a565cfeaef510cd9&device_id=f7517580-ddaa-48b1-9288-a3db030a3443 HTTP/1.1" status: 200 len: 1096 time: 0.1124413 Dec 09 21:24:07.807991 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-938361ff-d139-4580-be19-db5a03dd4eb1 req-4921cd57-1e1d-4bff-bef9-419cf612b177 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:07.809498 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-938361ff-d139-4580-be19-db5a03dd4eb1 req-4921cd57-1e1d-4bff-bef9-419cf612b177 service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 1.0960257 Dec 09 21:24:07.843466 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-17716500-8a1f-4377-bb9c-c8879f65f68c service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e588819c-5a89-4820-82c6-5ac8ba582aa1 HTTP/1.1" status: 200 len: 217 time: 0.0775034 Dec 09 21:24:07.876382 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:07.877107 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-148c46d6-e36e-462a-abbe-d025c76e0f6b req-f1149fc6-ab70-4842-9b12-e76b46d18928 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:07.885304 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-148c46d6-e36e-462a-abbe-d025c76e0f6b req-f1149fc6-ab70-4842-9b12-e76b46d18928 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07 HTTP/1.1" status: 200 len: 946 time: 0.8900583 Dec 09 21:24:07.927280 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ebbcf70-7df6-4e99-8949-54e7a984f463 req-04a8d51e-6d27-4ed3-b38b-3a4a45509120 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:07.928772 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ebbcf70-7df6-4e99-8949-54e7a984f463 req-04a8d51e-6d27-4ed3-b38b-3a4a45509120 service neutron] 10.222.0.10 "GET /v2.0/networks?id=9b3c0886-168c-4d9c-83a4-145e87393715 HTTP/1.1" status: 200 len: 930 time: 1.1467440 Dec 09 21:24:07.936909 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-938361ff-d139-4580-be19-db5a03dd4eb1 req-038d2fbc-068f-4ed9-9d67-c43e00dc5246 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.49&port_id=66544e42-b228-4e80-9ed2-bc699bb1993e HTTP/1.1" status: 200 len: 217 time: 0.0992270 Dec 09 21:24:07.940211 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-928e7308-fb1d-4350-a6a4-80ca2835569e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:07.941970 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-928e7308-fb1d-4350-a6a4-80ca2835569e service neutron] 10.222.0.10 "GET /v2.0/subnets?id=50496955-1646-4079-acd4-a47e8cd175cb HTTP/1.1" status: 200 len: 852 time: 0.0915959 Dec 09 21:24:08.000993 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-01ae93ea-1886-456d-b9f2-b297ac4942e4 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0505979 Dec 09 21:24:08.053271 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-fe236cc0-4123-4f71-b38a-7ec207a578ff service neutron] 10.222.0.13 "GET /v2.0/networks/9b3c0886-168c-4d9c-83a4-145e87393715?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9225111 Dec 09 21:24:08.054717 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ebbcf70-7df6-4e99-8949-54e7a984f463 req-f8d60743-0bd0-4d7f-9260-dd543375f68a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=2f1265f7-0579-475d-9faa-f23ade6ec46b HTTP/1.1" status: 200 len: 217 time: 0.1134531 Dec 09 21:24:08.124372 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-5e74665d-aeb7-425a-af22-e8f51663f36a service neutron] 10.222.0.10 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1141229 Dec 09 21:24:08.194518 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-148c46d6-e36e-462a-abbe-d025c76e0f6b req-da19ba08-6d95-4585-8468-0a4be7eb34c9 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2918360 Dec 09 21:24:08.265653 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-53cca3d4-2ea5-4a3e-9337-d3f04b533177 req-002e724b-c9de-4e98-8b18-a163200b136c service neutron] 10.222.0.10 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1333113 Dec 09 21:24:08.314042 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-938361ff-d139-4580-be19-db5a03dd4eb1 req-c630cf81-b8b3-41e8-964a-fafeb9e3194e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:08.316274 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-938361ff-d139-4580-be19-db5a03dd4eb1 req-c630cf81-b8b3-41e8-964a-fafeb9e3194e service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.3531873 Dec 09 21:24:08.319133 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 204e6970-8ed3-4e91-9792-52401052a153 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:24:08.344755 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 204e6970-8ed3-4e91-9792-52401052a153 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:24:08.345294 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 204e6970-8ed3-4e91-9792-52401052a153 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:24:08.366683 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ebbcf70-7df6-4e99-8949-54e7a984f463 req-ac18a3d3-f8bc-45d0-b809-4ba9c8e2c2d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:08.368525 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ebbcf70-7df6-4e99-8949-54e7a984f463 req-ac18a3d3-f8bc-45d0-b809-4ba9c8e2c2d5 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=176a8001-d04b-4c22-9715-06327ff3546d HTTP/1.1" status: 200 len: 868 time: 0.3046381 Dec 09 21:24:08.387794 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2314d3c7-1607-47d4-af3d-17c7d61b79fd req-4d3dfa96-a9d2-49bf-ad44-097fcc32ee41 service neutron] 10.222.0.13 "GET /v2.0/networks/9b3c0886-168c-4d9c-83a4-145e87393715?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3082731 Dec 09 21:24:08.438800 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70c64627-ab9a-4066-8c24-35d77b5b6905 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:08.453940 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70c64627-ab9a-4066-8c24-35d77b5b6905 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:08.495469 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aec7422-8595-41c1-abae-23e4e20797c6 req-20c829c8-7958-446c-be44-dcb6cce8e6a7 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:08.497049 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7aec7422-8595-41c1-abae-23e4e20797c6 req-20c829c8-7958-446c-be44-dcb6cce8e6a7 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f7517580-ddaa-48b1-9288-a3db030a3443 HTTP/1.1" status: 200 len: 944 time: 0.1962061 Dec 09 21:24:08.524220 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-938361ff-d139-4580-be19-db5a03dd4eb1 req-a1f8aadc-26b2-41bc-b518-ed740bd5bd22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:08.533058 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-938361ff-d139-4580-be19-db5a03dd4eb1 req-a1f8aadc-26b2-41bc-b518-ed740bd5bd22 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1975210 Dec 09 21:24:08.546385 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ebbcf70-7df6-4e99-8949-54e7a984f463 req-4900124e-bd06-41bc-9f5e-dca5f6482ad3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:08.549083 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ebbcf70-7df6-4e99-8949-54e7a984f463 req-4900124e-bd06-41bc-9f5e-dca5f6482ad3 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=9b3c0886-168c-4d9c-83a4-145e87393715&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1589940 Dec 09 21:24:08.552767 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-70c64627-ab9a-4066-8c24-35d77b5b6905 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=d6685ab9df864cf398a5fc91652e8ccb&name=default HTTP/1.1" status: 200 len: 2996 time: 1.7477970 Dec 09 21:24:08.555481 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35872) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:08.585322 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70c64627-ab9a-4066-8c24-35d77b5b6905 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=23c3225c-0f4d-4b5a-99fc-b6695cc40280,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:08.630824 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4feec6a3-a56d-4aaf-86c7-414bc82e4dd1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:08.673120 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4feec6a3-a56d-4aaf-86c7-414bc82e4dd1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:08.732902 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4feec6a3-a56d-4aaf-86c7-414bc82e4dd1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:08.737997 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4feec6a3-a56d-4aaf-86c7-414bc82e4dd1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:08.756172 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4feec6a3-a56d-4aaf-86c7-414bc82e4dd1 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/23c3225c-0f4d-4b5a-99fc-b6695cc40280 HTTP/1.1" status: 204 len: 168 time: 0.1865497 Dec 09 21:24:08.757681 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7aec7422-8595-41c1-abae-23e4e20797c6 req-a5283221-3ee2-4aaa-9947-5994d4d2df1e tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2413549 Dec 09 21:24:08.790062 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4feec6a3-a56d-4aaf-86c7-414bc82e4dd1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=23c3225c-0f4d-4b5a-99fc-b6695cc40280,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:08.817533 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f7517580-ddaa-48b1-9288-a3db030a3443', 'tag': 'e588819c-5a89-4820-82c6-5ac8ba582aa1'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:24:08.817676 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ebbcf70-7df6-4e99-8949-54e7a984f463 req-abc0feee-f8c8-47b5-a49b-54f12a8fee0f service neutron] 10.222.0.10 "GET /v2.0/networks/9b3c0886-168c-4d9c-83a4-145e87393715?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2395368 Dec 09 21:24:08.820679 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a6f76acb-8fe7-4204-a78f-4bd04349cf37" -d '{"events": [{"name": "network-changed", "server_uuid": "f7517580-ddaa-48b1-9288-a3db030a3443", "tag": "e588819c-5a89-4820-82c6-5ac8ba582aa1"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:24:08.868498 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-938361ff-d139-4580-be19-db5a03dd4eb1 req-b6774cd5-c80d-42c7-9938-a736c43c1d23 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3141570 Dec 09 21:24:09.033695 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-938361ff-d139-4580-be19-db5a03dd4eb1 req-d7afc8b9-2b03-48d3-ba36-1da342c04073 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1153641 Dec 09 21:24:09.115656 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ebbcf70-7df6-4e99-8949-54e7a984f463 req-d524199c-5595-4a39-9ec8-1515d28d164a service neutron] 10.222.0.10 "GET /v2.0/networks/9b3c0886-168c-4d9c-83a4-145e87393715?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2839346 Dec 09 21:24:09.286133 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:09.303732 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ce840c2-11d5-446d-9d10-2f4df095eb15 req-1d508da3-336e-4529-9acf-3cf3fc036104 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:09.305369 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ce840c2-11d5-446d-9d10-2f4df095eb15 req-1d508da3-336e-4529-9acf-3cf3fc036104 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07 HTTP/1.1" status: 200 len: 946 time: 0.1270840 Dec 09 21:24:09.337362 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35916) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:09.361702 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-becabda1-8890-449f-b017-2b82fee80569 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:09.428048 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ce840c2-11d5-446d-9d10-2f4df095eb15 req-5f740d01-d510-4506-9919-723bf1d6e894 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1143775 Dec 09 21:24:09.521628 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96a83bc2-4ca4-4f62-b9b2-4ad2e51bdff8 req-cbca43e2-d88a-44d0-986f-5f015b91be63 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/floatingips/175fadfc-f0ea-4d39-b7c2-2f94e3c75833 HTTP/1.1" status: 200 len: 691 time: 0.1039817 Dec 09 21:24:09.525527 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35924) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:09.537021 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:24:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f6b1ecc9-8aeb-48f7-b278-4c1246d7f1ab x-openstack-request-id: req-f6b1ecc9-8aeb-48f7-b278-4c1246d7f1ab {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:24:09.537328 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f7517580-ddaa-48b1-9288-a3db030a3443", "tag": "e588819c-5a89-4820-82c6-5ac8ba582aa1", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:24:09.537562 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f6b1ecc9-8aeb-48f7-b278-4c1246d7f1ab {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:24:09.537971 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f7517580-ddaa-48b1-9288-a3db030a3443', 'tag': 'e588819c-5a89-4820-82c6-5ac8ba582aa1', 'status': 'completed', 'code': 200} Dec 09 21:24:09.540726 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-becabda1-8890-449f-b017-2b82fee80569 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:09.550245 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-becabda1-8890-449f-b017-2b82fee80569 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:09.591397 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-becabda1-8890-449f-b017-2b82fee80569 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=25052e44-c88b-4691-980b-9291223403b7,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:09.600717 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-becabda1-8890-449f-b017-2b82fee80569 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=0bf8ad8c7bd04026801623d7f7411d43&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2622590 Dec 09 21:24:09.602613 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35936) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:09.667255 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-37755379-7c97-454d-9473-224ae00e282b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:09.708295 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-37755379-7c97-454d-9473-224ae00e282b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:09.769613 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6f76acb-8fe7-4204-a78f-4bd04349cf37 req-67d6b44a-d510-4e41-8d63-b00bc9323fa6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:09.772088 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a6f76acb-8fe7-4204-a78f-4bd04349cf37 req-67d6b44a-d510-4e41-8d63-b00bc9323fa6 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=1b7916b634f74760a565cfeaef510cd9&device_id=f7517580-ddaa-48b1-9288-a3db030a3443 HTTP/1.1" status: 200 len: 1096 time: 0.2484696 Dec 09 21:24:09.775989 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-37755379-7c97-454d-9473-224ae00e282b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:09.779260 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-37755379-7c97-454d-9473-224ae00e282b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:09.783216 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-37755379-7c97-454d-9473-224ae00e282b admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/25052e44-c88b-4691-980b-9291223403b7 HTTP/1.1" status: 204 len: 168 time: 0.1787429 Dec 09 21:24:09.804750 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37755379-7c97-454d-9473-224ae00e282b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=25052e44-c88b-4691-980b-9291223403b7,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:09.914914 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35946) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:09.915162 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5a6a5d9f-91a1-4049-ba34-1bf6c6c33988 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=857de64ecc3946e3b92655f639d782df&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3878710 Dec 09 21:24:09.978665 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96a83bc2-4ca4-4f62-b9b2-4ad2e51bdff8 req-ac70cef8-de76-4d73-b114-0dff62f0f95c tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:09.987016 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96a83bc2-4ca4-4f62-b9b2-4ad2e51bdff8 req-ac70cef8-de76-4d73-b114-0dff62f0f95c tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.4644091 Dec 09 21:24:09.994987 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-96a83bc2-4ca4-4f62-b9b2-4ad2e51bdff8 req-0852d4cf-3874-43a8-8e0a-1d255dbf5bf8 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:24:10.001692 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1fc5e9a4-f8b6-42ed-9a87-5cc4b7697ba6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:10.003535 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96a83bc2-4ca4-4f62-b9b2-4ad2e51bdff8 req-0852d4cf-3874-43a8-8e0a-1d255dbf5bf8 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0153377 Dec 09 21:24:10.089216 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1fc5e9a4-f8b6-42ed-9a87-5cc4b7697ba6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:10.096468 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96a83bc2-4ca4-4f62-b9b2-4ad2e51bdff8 req-5c9f699d-6ce4-4cf6-909a-41727d0714d6 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.8 HTTP/1.1" status: 200 len: 694 time: 0.0914605 Dec 09 21:24:10.109486 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6f76acb-8fe7-4204-a78f-4bd04349cf37 req-feeb1ca9-5523-4157-b9da-d27673f7ba31 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:10.110872 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a6f76acb-8fe7-4204-a78f-4bd04349cf37 req-feeb1ca9-5523-4157-b9da-d27673f7ba31 service neutron] 10.222.0.10 "GET /v2.0/networks?id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb HTTP/1.1" status: 200 len: 913 time: 0.3242338 Dec 09 21:24:10.211753 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96a83bc2-4ca4-4f62-b9b2-4ad2e51bdff8 req-155a2f90-ba22-496c-b2ac-a35654caf673 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.8 HTTP/1.1" status: 200 len: 694 time: 0.1116083 Dec 09 21:24:10.259038 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1fc5e9a4-f8b6-42ed-9a87-5cc4b7697ba6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:10.262489 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1fc5e9a4-f8b6-42ed-9a87-5cc4b7697ba6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:10.270788 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1fc5e9a4-f8b6-42ed-9a87-5cc4b7697ba6 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/f29e6584-b652-4b5d-8afa-c1d6228ef778 HTTP/1.1" status: 204 len: 168 time: 0.3484306 Dec 09 21:24:10.307655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fc5e9a4-f8b6-42ed-9a87-5cc4b7697ba6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f29e6584-b652-4b5d-8afa-c1d6228ef778,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:10.395184 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a6f76acb-8fe7-4204-a78f-4bd04349cf37 req-7f102365-d959-44cf-b8fd-bee614a83d50 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=e588819c-5a89-4820-82c6-5ac8ba582aa1 HTTP/1.1" status: 200 len: 217 time: 0.2480958 Dec 09 21:24:10.512904 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-96a83bc2-4ca4-4f62-b9b2-4ad2e51bdff8 req-e989501f-bd27-4336-98ee-23cb1a33f485 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Deleting port b0884215-a314-4214-87fe-6402950b361a {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:10.513282 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-96a83bc2-4ca4-4f62-b9b2-4ad2e51bdff8 req-e989501f-bd27-4336-98ee-23cb1a33f485 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:10.645798 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-96a83bc2-4ca4-4f62-b9b2-4ad2e51bdff8 req-e989501f-bd27-4336-98ee-23cb1a33f485 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:10.647853 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-96a83bc2-4ca4-4f62-b9b2-4ad2e51bdff8 req-e989501f-bd27-4336-98ee-23cb1a33f485 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:10.680712 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-96a83bc2-4ca4-4f62-b9b2-4ad2e51bdff8 req-e989501f-bd27-4336-98ee-23cb1a33f485 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Calling delete_port for b0884215-a314-4214-87fe-6402950b361a owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:10.710384 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6f76acb-8fe7-4204-a78f-4bd04349cf37 req-04686d0a-aef2-40c9-b90c-5c3d54d2e096 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:10.711898 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a6f76acb-8fe7-4204-a78f-4bd04349cf37 req-04686d0a-aef2-40c9-b90c-5c3d54d2e096 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=50496955-1646-4079-acd4-a47e8cd175cb HTTP/1.1" status: 200 len: 852 time: 0.3090768 Dec 09 21:24:10.793235 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36000) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:10.848286 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a6f76acb-8fe7-4204-a78f-4bd04349cf37 req-32a7bf85-f720-4884-bbb8-99f6b54b81f5 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1268027 Dec 09 21:24:10.876159 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0a7609ea-18a8-430c-bd60-05542d1feb02 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=f6646c522c904c729007c23e264b8ecd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0811696 Dec 09 21:24:10.878987 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36002) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:10.946357 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-81ecd546-340f-4bb3-956b-46ce5856da67 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:10.975341 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-81ecd546-340f-4bb3-956b-46ce5856da67 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:11.003185 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2bb3e6c-8f73-42bc-be99-396bfd45dee6 req-10fef628-92b7-49b7-b70f-27a21610f14a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:11.010762 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2bb3e6c-8f73-42bc-be99-396bfd45dee6 req-10fef628-92b7-49b7-b70f-27a21610f14a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f7517580-ddaa-48b1-9288-a3db030a3443 HTTP/1.1" status: 200 len: 944 time: 0.2715838 Dec 09 21:24:11.068602 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a6f76acb-8fe7-4204-a78f-4bd04349cf37 req-8d18320c-6771-4a03-a4fe-d66d398d4bfc service neutron] 10.222.0.10 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1984820 Dec 09 21:24:11.090360 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-81ecd546-340f-4bb3-956b-46ce5856da67 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:11.096305 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-81ecd546-340f-4bb3-956b-46ce5856da67 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:11.099028 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-81ecd546-340f-4bb3-956b-46ce5856da67 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/0e5166ed-8577-46e1-978d-4e8877505e53 HTTP/1.1" status: 204 len: 168 time: 0.2178335 Dec 09 21:24:11.122731 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36010) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:11.130512 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2bb3e6c-8f73-42bc-be99-396bfd45dee6 req-4a31de96-204a-4e83-95a0-d8f5483bbfdb tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1186783 Dec 09 21:24:11.149934 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81ecd546-340f-4bb3-956b-46ce5856da67 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e5166ed-8577-46e1-978d-4e8877505e53,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:11.328433 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a6f76acb-8fe7-4204-a78f-4bd04349cf37 req-ae71f79d-17e5-4643-8f9d-952550fa7fcf service neutron] 10.222.0.10 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2430308 Dec 09 21:24:11.364071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-92832219-e330-411b-afc2-a1a6afa0dda0 admin admin] Request body: {'network': {'name': 'tempest-FloatingIPsTestJSON-2142506536-network', 'tenant_id': 'f3017ec6ec044e6ea364d4db8048d68d'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:11.365807 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-96a83bc2-4ca4-4f62-b9b2-4ad2e51bdff8 req-e989501f-bd27-4336-98ee-23cb1a33f485 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:11.391490 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-92832219-e330-411b-afc2-a1a6afa0dda0 admin admin] Made reservation on behalf of f3017ec6ec044e6ea364d4db8048d68d for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:24:11.395378 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92832219-e330-411b-afc2-a1a6afa0dda0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:11.408339 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92832219-e330-411b-afc2-a1a6afa0dda0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:11.444659 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e588819c-5a89-4820-82c6-5ac8ba582aa1 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:24:11.490331 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e989501f-bd27-4336-98ee-23cb1a33f485 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Pushing event deleted for resources: {'Port': ['ID=b0884215-a314-4214-87fe-6402950b361a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:11.596288 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92832219-e330-411b-afc2-a1a6afa0dda0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:11.607896 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92832219-e330-411b-afc2-a1a6afa0dda0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:11.610194 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-96a83bc2-4ca4-4f62-b9b2-4ad2e51bdff8 req-e989501f-bd27-4336-98ee-23cb1a33f485 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:11.617085 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-96a83bc2-4ca4-4f62-b9b2-4ad2e51bdff8 req-e989501f-bd27-4336-98ee-23cb1a33f485 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:11.621845 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96a83bc2-4ca4-4f62-b9b2-4ad2e51bdff8 req-e989501f-bd27-4336-98ee-23cb1a33f485 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "DELETE /v2.0/floatingips/175fadfc-f0ea-4d39-b7c2-2f94e3c75833 HTTP/1.1" status: 204 len: 173 time: 1.4097822 Dec 09 21:24:11.664509 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-92832219-e330-411b-afc2-a1a6afa0dda0 admin admin] vlan segment allocate from pool success with {'vlan_id': 149, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:24:11.679256 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92832219-e330-411b-afc2-a1a6afa0dda0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=16976c1a-3621-4c1e-aa98-5f60173982d7,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:11.705930 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92832219-e330-411b-afc2-a1a6afa0dda0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:11.706417 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-92832219-e330-411b-afc2-a1a6afa0dda0 admin admin] Added segment f50abd2e-e599-448f-8441-67314ef9ac54 of type vlan for network 07db6bfe-0f5b-4d09-85c8-6bcad2644162 Dec 09 21:24:11.735564 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port e588819c-5a89-4820-82c6-5ac8ba582aa1, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e588819c-5a89-4820-82c6-5ac8ba582aa1,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:11.760980 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'e588819c-5a89-4820-82c6-5ac8ba582aa1', 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb', 'port_id': 'e588819c-5a89-4820-82c6-5ac8ba582aa1', 'mac_address': 'fa:16:3e:03:e0:83', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 101, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '50496955-1646-4079-acd4-a47e8cd175cb', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:24:11.768715 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92832219-e330-411b-afc2-a1a6afa0dda0 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:11.804956 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92832219-e330-411b-afc2-a1a6afa0dda0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:11.807755 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-92832219-e330-411b-afc2-a1a6afa0dda0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:11.808757 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92832219-e330-411b-afc2-a1a6afa0dda0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:11.833225 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:11.843649 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-92832219-e330-411b-afc2-a1a6afa0dda0 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.7010064 Dec 09 21:24:11.844541 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36040) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:11.871351 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e588819c-5a89-4820-82c6-5ac8ba582aa1 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:24:11.876041 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-f1680d4b-a98e-436f-9671-8ede8c6db4fb admin admin] Request body: {'subnet': {'network_id': '07db6bfe-0f5b-4d09-85c8-6bcad2644162', 'cidr': '172.20.0.0/28', 'name': 'tempest-FloatingIPsTestJSON-2142506536-subnet', 'tenant_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:11.906059 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eef9f1cb-9eec-4bac-8e21-8ada6a406dcf req-f5498484-a6d5-4dc9-b93a-4d218b5e31ac tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:11.907879 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eef9f1cb-9eec-4bac-8e21-8ada6a406dcf req-f5498484-a6d5-4dc9-b93a-4d218b5e31ac tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07 HTTP/1.1" status: 200 len: 946 time: 0.1409166 Dec 09 21:24:11.921324 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port e588819c-5a89-4820-82c6-5ac8ba582aa1, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e588819c-5a89-4820-82c6-5ac8ba582aa1,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:11.935170 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:12.007948 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f1680d4b-a98e-436f-9671-8ede8c6db4fb admin admin] Made reservation on behalf of f3017ec6ec044e6ea364d4db8048d68d for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:24:12.011643 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f1680d4b-a98e-436f-9671-8ede8c6db4fb admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:12.032508 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=e588819c-5a89-4820-82c6-5ac8ba582aa1,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:12.038901 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92832219-e330-411b-afc2-a1a6afa0dda0 admin admin] Pushing event updated for resources: {'Network': ['ID=07db6bfe-0f5b-4d09-85c8-6bcad2644162,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:12.053776 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eef9f1cb-9eec-4bac-8e21-8ada6a406dcf req-c4ae7f26-b876-41ae-8beb-4fca1cc00a0b tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1380477 Dec 09 21:24:12.077368 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 07db6bfe-0f5b-4d09-85c8-6bcad2644162 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:24:12.227412 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9de613d-dae9-4ac3-b0d0-aec5b8216c8c req-a236680f-a080-453d-a09b-7e284852ccc7 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:12.238216 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9de613d-dae9-4ac3-b0d0-aec5b8216c8c req-a236680f-a080-453d-a09b-7e284852ccc7 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07 HTTP/1.1" status: 200 len: 946 time: 0.0733337 Dec 09 21:24:12.245331 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['e588819c-5a89-4820-82c6-5ac8ba582aa1'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:24:12.373457 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9de613d-dae9-4ac3-b0d0-aec5b8216c8c req-99e9e1c6-6f94-4141-841e-b055ade6b742 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1340792 Dec 09 21:24:12.461641 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f1680d4b-a98e-436f-9671-8ede8c6db4fb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:12.609485 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1680d4b-a98e-436f-9671-8ede8c6db4fb admin admin] Pushing event updated for resources: {'Subnet': ['ID=433e7096-4021-4933-b1ca-57165b00a150,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:12.621236 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f1680d4b-a98e-436f-9671-8ede8c6db4fb admin admin] Checking segment: {'id': 'f50abd2e-e599-448f-8441-67314ef9ac54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '07db6bfe-0f5b-4d09-85c8-6bcad2644162'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:24:12.621875 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f1680d4b-a98e-436f-9671-8ede8c6db4fb admin admin] Network hostable DHCP agents. Network: 07db6bfe-0f5b-4d09-85c8-6bcad2644162, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:24:12.646936 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f1680d4b-a98e-436f-9671-8ede8c6db4fb admin admin] Network 07db6bfe-0f5b-4d09-85c8-6bcad2644162 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:24:12.660734 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-f1680d4b-a98e-436f-9671-8ede8c6db4fb admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 07db6bfe-0f5b-4d09-85c8-6bcad2644162) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:12.668244 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1680d4b-a98e-436f-9671-8ede8c6db4fb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:12.669110 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f1680d4b-a98e-436f-9671-8ede8c6db4fb admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:12.675517 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-722d50c8-d10c-46fe-84b0-83deda57bab1 None None] Network 07db6bfe-0f5b-4d09-85c8-6bcad2644162 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:24:12.715569 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2bd65b4-89a5-4338-9d76-b1217f5b9646 req-f178541d-c193-40d7-a223-349e2a2bd64b tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:12.719808 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f1680d4b-a98e-436f-9671-8ede8c6db4fb admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.8713069 Dec 09 21:24:12.720540 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36092) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:12.728512 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-9e63eec3-80c8-45e9-a22f-6a327f0749e9 admin admin] Request body: {'router': {'name': 'tempest-FloatingIPsTestJSON-2142506536-router', 'tenant_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:12.737006 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2bd65b4-89a5-4338-9d76-b1217f5b9646 req-f178541d-c193-40d7-a223-349e2a2bd64b tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f7517580-ddaa-48b1-9288-a3db030a3443 HTTP/1.1" status: 200 len: 945 time: 0.1145954 Dec 09 21:24:12.744843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5652528b-8c94-401c-8107-c339f3029d3a req-e259e7b7-9526-4ce3-9275-6083d5ac9798 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:12.746993 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5652528b-8c94-401c-8107-c339f3029d3a req-e259e7b7-9526-4ce3-9275-6083d5ac9798 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/ports?device_id=99185349-bf6b-4cb8-a80b-ebf360aecfbb&device_owner=compute%3Anova HTTP/1.1" status: 200 len: 945 time: 0.1646216 Dec 09 21:24:12.780726 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e63eec3-80c8-45e9-a22f-6a327f0749e9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:12.782723 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e63eec3-80c8-45e9-a22f-6a327f0749e9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:12.828077 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5652528b-8c94-401c-8107-c339f3029d3a req-06279121-30fb-419a-ac10-d047122b7085 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=0.0.0.0 HTTP/1.1" status: 200 len: 217 time: 0.0731864 Dec 09 21:24:12.848570 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e63eec3-80c8-45e9-a22f-6a327f0749e9 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:12.879996 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2bd65b4-89a5-4338-9d76-b1217f5b9646 req-46cd3195-49ec-4510-83cb-720035b8272d tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1318858 Dec 09 21:24:12.932904 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6b3f23e-6344-442e-9018-76abb43297a4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-07db6bfe-0f5b-4d09-85c8-6bcad2644162', 'network_id': '07db6bfe-0f5b-4d09-85c8-6bcad2644162', 'project_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'fixed_ips': [{'subnet_id': '433e7096-4021-4933-b1ca-57165b00a150'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:24:12.934232 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b6b3f23e-6344-442e-9018-76abb43297a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:13.197390 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e63eec3-80c8-45e9-a22f-6a327f0749e9 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:13.250630 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-b6b3f23e-6344-442e-9018-76abb43297a4 None None] Allocated IP 172.20.0.2 (07db6bfe-0f5b-4d09-85c8-6bcad2644162/433e7096-4021-4933-b1ca-57165b00a150/2d7c3530-6978-4b69-922b-c7cebee631c8) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:24:13.329192 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-92f0707c-7fb7-4143-bccd-b4c900431ae4 req-f74640d4-6228-4233-9077-7b92fdc372f0 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=0.0.0.0 HTTP/1.1" status: 200 len: 217 time: 0.0671237 Dec 09 21:24:13.466205 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e588819c-5a89-4820-82c6-5ac8ba582aa1 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:24:13.487476 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8f7f875-fb7c-49c4-b758-4babf0c0dc90 req-d09f200f-f2f2-4be2-9982-25b8102878e1 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:13.489087 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c8f7f875-fb7c-49c4-b758-4babf0c0dc90 req-d09f200f-f2f2-4be2-9982-25b8102878e1 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/ports?device_id=63d23827-0eb3-4c4c-87f7-698524a008f5 HTTP/1.1" status: 200 len: 947 time: 0.1011090 Dec 09 21:24:13.621340 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b6b3f23e-6344-442e-9018-76abb43297a4 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:13.633743 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b6b3f23e-6344-442e-9018-76abb43297a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:13.635509 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c8f7f875-fb7c-49c4-b758-4babf0c0dc90 req-8ba5cf52-3234-4db2-ae5c-52a362292b1f tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/security-groups?id=24094cbf-e652-478e-bb06-edc8eb774ee3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1283686 Dec 09 21:24:13.652845 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port e588819c-5a89-4820-82c6-5ac8ba582aa1 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:24:13.685657 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port e588819c-5a89-4820-82c6-5ac8ba582aa1 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:13.686280 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:13.733970 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b6b3f23e-6344-442e-9018-76abb43297a4 None None] Network 07db6bfe-0f5b-4d09-85c8-6bcad2644162 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:13.739710 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e63eec3-80c8-45e9-a22f-6a327f0749e9 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:13.746041 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-b6b3f23e-6344-442e-9018-76abb43297a4 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:13.760856 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6b3f23e-6344-442e-9018-76abb43297a4 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:24:13.767475 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6b3f23e-6344-442e-9018-76abb43297a4 None None] Pushing event updated for resources: {'Port': ['ID=2d7c3530-6978-4b69-922b-c7cebee631c8,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:13.796986 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e63eec3-80c8-45e9-a22f-6a327f0749e9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:13.952258 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-9e63eec3-80c8-45e9-a22f-6a327f0749e9 admin admin] Allocated IP 172.25.3.254 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/df5c9696-5b31-485a-855f-3e6a07c94a2f) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:24:14.075643 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-b6b3f23e-6344-442e-9018-76abb43297a4 None None] Attempting to bind port 2d7c3530-6978-4b69-922b-c7cebee631c8 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:24:14.076195 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-b6b3f23e-6344-442e-9018-76abb43297a4 None None] Attempting to bind port 2d7c3530-6978-4b69-922b-c7cebee631c8 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f50abd2e-e599-448f-8441-67314ef9ac54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '07db6bfe-0f5b-4d09-85c8-6bcad2644162'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:24:14.076658 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6b3f23e-6344-442e-9018-76abb43297a4 None None] Attempting to bind port 2d7c3530-6978-4b69-922b-c7cebee631c8 on network 07db6bfe-0f5b-4d09-85c8-6bcad2644162 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:24:14.090421 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6b3f23e-6344-442e-9018-76abb43297a4 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 24, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:24:14.090929 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6b3f23e-6344-442e-9018-76abb43297a4 None None] Checking segment: {'id': 'f50abd2e-e599-448f-8441-67314ef9ac54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '07db6bfe-0f5b-4d09-85c8-6bcad2644162'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:24:14.091602 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b6b3f23e-6344-442e-9018-76abb43297a4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:14.092101 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6b3f23e-6344-442e-9018-76abb43297a4 None None] Bound using segment: {'id': 'f50abd2e-e599-448f-8441-67314ef9ac54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '07db6bfe-0f5b-4d09-85c8-6bcad2644162'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:24:14.092698 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-b6b3f23e-6344-442e-9018-76abb43297a4 None None] Bound port: 2d7c3530-6978-4b69-922b-c7cebee631c8, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f50abd2e-e599-448f-8441-67314ef9ac54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '07db6bfe-0f5b-4d09-85c8-6bcad2644162'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:24:14.093178 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b6b3f23e-6344-442e-9018-76abb43297a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:14.108100 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:14.199965 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0da1fdd9-943d-49e2-8032-b7680e00feba req-275d742f-30d2-4665-8a70-3a9c9d9b90bf tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:14.200205 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port e588819c-5a89-4820-82c6-5ac8ba582aa1, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e588819c-5a89-4820-82c6-5ac8ba582aa1,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:14.201734 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0da1fdd9-943d-49e2-8032-b7680e00feba req-275d742f-30d2-4665-8a70-3a9c9d9b90bf tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f7517580-ddaa-48b1-9288-a3db030a3443 HTTP/1.1" status: 200 len: 945 time: 0.0739183 Dec 09 21:24:14.203623 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f7517580-ddaa-48b1-9288-a3db030a3443', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e588819c-5a89-4820-82c6-5ac8ba582aa1'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:24:14.208851 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-327a5ebb-378a-4268-bba3-101525819b27" -d '{"events": [{"server_uuid": "f7517580-ddaa-48b1-9288-a3db030a3443", "name": "network-vif-plugged", "status": "completed", "tag": "e588819c-5a89-4820-82c6-5ac8ba582aa1"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:24:14.218705 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:14.239197 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e63eec3-80c8-45e9-a22f-6a327f0749e9 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:14.269000 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0da1fdd9-943d-49e2-8032-b7680e00feba req-87cf7a53-c183-44c5-b5fa-960e99565981 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0581443 Dec 09 21:24:14.300747 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e63eec3-80c8-45e9-a22f-6a327f0749e9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:14.326871 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=e588819c-5a89-4820-82c6-5ac8ba582aa1,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:14.349125 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9e63eec3-80c8-45e9-a22f-6a327f0749e9 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:14.352541 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-9e63eec3-80c8-45e9-a22f-6a327f0749e9 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:14.353944 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-b6b3f23e-6344-442e-9018-76abb43297a4 None None] For port 2d7c3530-6978-4b69-922b-c7cebee631c8, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:24:14.357197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e63eec3-80c8-45e9-a22f-6a327f0749e9 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:24:14.364973 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-b6b3f23e-6344-442e-9018-76abb43297a4 None None] For port 2d7c3530-6978-4b69-922b-c7cebee631c8, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2d7c3530-6978-4b69-922b-c7cebee631c8,segment=NetworkSegment(f50abd2e-e599-448f-8441-67314ef9ac54),segment_id=f50abd2e-e599-448f-8441-67314ef9ac54)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:24:14.374747 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b6b3f23e-6344-442e-9018-76abb43297a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:14.394321 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e63eec3-80c8-45e9-a22f-6a327f0749e9 admin admin] Pushing event updated for resources: {'Port': ['ID=df5c9696-5b31-485a-855f-3e6a07c94a2f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:14.466468 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfde051b-7e20-47d7-816c-0230ddd32e62 req-9f48d087-a652-4c18-9799-9a69d16dfa5a tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:14.474004 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6b3f23e-6344-442e-9018-76abb43297a4 None None] Pushing event updated for resources: {'Port': ['ID=2d7c3530-6978-4b69-922b-c7cebee631c8,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:14.487182 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cfde051b-7e20-47d7-816c-0230ddd32e62 req-9f48d087-a652-4c18-9799-9a69d16dfa5a tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/ports?device_id=99185349-bf6b-4cb8-a80b-ebf360aecfbb HTTP/1.1" status: 200 len: 945 time: 0.1749029 Dec 09 21:24:14.596550 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cfde051b-7e20-47d7-816c-0230ddd32e62 req-f8881c87-1a44-4df9-bbed-c9de68d04c7b tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/security-groups?id=502403b3-5851-499b-ae86-dd222b0f8aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1083341 Dec 09 21:24:14.741867 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adec7ac2-9896-4009-a865-639bfeb88112 req-c39a845c-25dd-49b9-be3b-3dae1a5043b4 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:14.751114 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-adec7ac2-9896-4009-a865-639bfeb88112 req-c39a845c-25dd-49b9-be3b-3dae1a5043b4 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07 HTTP/1.1" status: 200 len: 946 time: 0.0883050 Dec 09 21:24:14.772402 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e63eec3-80c8-45e9-a22f-6a327f0749e9 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:14.837222 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-adec7ac2-9896-4009-a865-639bfeb88112 req-f9281b55-7cf7-4931-a5bf-e37c5fc4bcad tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0846541 Dec 09 21:24:14.946323 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:24:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-725d1786-10f3-44b4-a506-6f6ead0f7075 x-openstack-request-id: req-725d1786-10f3-44b4-a506-6f6ead0f7075 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:24:14.946832 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f7517580-ddaa-48b1-9288-a3db030a3443", "name": "network-vif-plugged", "status": "completed", "tag": "e588819c-5a89-4820-82c6-5ac8ba582aa1", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:24:14.946832 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-725d1786-10f3-44b4-a506-6f6ead0f7075 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:24:14.947331 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f7517580-ddaa-48b1-9288-a3db030a3443', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e588819c-5a89-4820-82c6-5ac8ba582aa1', 'code': 200} Dec 09 21:24:15.084782 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0579f096-84b6-49b9-bba7-c3fb27d78a77 req-d36b98e2-fda1-447e-bc08-427a5c9863de tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:15.086671 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0579f096-84b6-49b9-bba7-c3fb27d78a77 req-d36b98e2-fda1-447e-bc08-427a5c9863de tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.10 "GET /v2.0/ports?device_id=63d23827-0eb3-4c4c-87f7-698524a008f5 HTTP/1.1" status: 200 len: 947 time: 0.1797738 Dec 09 21:24:15.164714 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e63eec3-80c8-45e9-a22f-6a327f0749e9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:15.212023 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b669afc-a9cb-4f8f-9f30-16906dd21db6 req-0a7c80e5-279a-4320-b019-78fafc84db9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:15.213527 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b669afc-a9cb-4f8f-9f30-16906dd21db6 req-0a7c80e5-279a-4320-b019-78fafc84db9d service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=f7517580-ddaa-48b1-9288-a3db030a3443 HTTP/1.1" status: 200 len: 1098 time: 0.1999352 Dec 09 21:24:15.276572 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b669afc-a9cb-4f8f-9f30-16906dd21db6 req-1ef6cea9-c9ce-44b9-9cd5-da5a2fff6fdf service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0525823 Dec 09 21:24:15.353227 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e10d7a29-e1fc-47c1-b3a6-55c69ec5426f req-435d0dfc-7213-40c6-926b-640f29258693 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:15.358876 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9e63eec3-80c8-45e9-a22f-6a327f0749e9 admin admin] Router 0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:24:15.371090 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e10d7a29-e1fc-47c1-b3a6-55c69ec5426f req-435d0dfc-7213-40c6-926b-640f29258693 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/ports?device_id=63d23827-0eb3-4c4c-87f7-698524a008f5 HTTP/1.1" status: 200 len: 947 time: 0.2623496 Dec 09 21:24:15.500766 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c3ba580-83d5-4866-8111-b9a035379d6c req-536e79c3-09bc-4077-8784-a48ea62d55d8 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:15.508222 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c3ba580-83d5-4866-8111-b9a035379d6c req-536e79c3-09bc-4077-8784-a48ea62d55d8 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 944 time: 0.0956955 Dec 09 21:24:15.574532 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e10d7a29-e1fc-47c1-b3a6-55c69ec5426f req-0bdbf07d-e2e7-47c9-9573-70f9ecf6c5fd tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/security-groups?id=24094cbf-e652-478e-bb06-edc8eb774ee3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2007296 Dec 09 21:24:15.640504 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c3ba580-83d5-4866-8111-b9a035379d6c req-84bc13f4-7c27-47cd-883f-41a295691947 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1311846 Dec 09 21:24:15.658848 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-0579f096-84b6-49b9-bba7-c3fb27d78a77 req-85f9d7bb-9b0a-4d7e-b99d-bce8788a4fcf tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Deleting port 66544e42-b228-4e80-9ed2-bc699bb1993e {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:15.659192 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0579f096-84b6-49b9-bba7-c3fb27d78a77 req-85f9d7bb-9b0a-4d7e-b99d-bce8788a4fcf tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:15.743320 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2d7c3530-6978-4b69-922b-c7cebee631c8 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:24:15.948870 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 2d7c3530-6978-4b69-922b-c7cebee631c8 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:15.949505 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:16.036683 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9e63eec3-80c8-45e9-a22f-6a327f0749e9 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:24:16.053507 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] Sync routers for ids ['0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:24:16.054265 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-733cb2d3-c171-4f37-9ae8-dcf7793f4f22 req-8ffd3c40-cdf6-43e8-8185-a387e99a06f5 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:16.056313 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-733cb2d3-c171-4f37-9ae8-dcf7793f4f22 req-8ffd3c40-cdf6-43e8-8185-a387e99a06f5 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.31 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 944 time: 0.0908883 Dec 09 21:24:16.082824 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] Routers {'0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:24:16.084651 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:16.156197 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e63eec3-80c8-45e9-a22f-6a327f0749e9 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:16.157522 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9e63eec3-80c8-45e9-a22f-6a327f0749e9 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 3.4358535 Dec 09 21:24:16.160843 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36188) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:16.178704 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:16.216864 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-943bd5ef-41d3-4d01-bfc7-1dadcfeb332d None None] Network 07db6bfe-0f5b-4d09-85c8-6bcad2644162 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:24:16.349832 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-733cb2d3-c171-4f37-9ae8-dcf7793f4f22 req-34d2f204-20a5-465f-83a5-acf6bf15b802 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Deleting port 6166c639-9f87-4254-af88-12c4be868be5 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:16.351953 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa002d45-2e79-4500-bf4a-f77ca911773d req-6d72616b-7b70-4a29-b9fa-d669a09c5f79 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:16.353552 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fa002d45-2e79-4500-bf4a-f77ca911773d req-6d72616b-7b70-4a29-b9fa-d669a09c5f79 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.10 "GET /v2.0/ports?device_id=99185349-bf6b-4cb8-a80b-ebf360aecfbb HTTP/1.1" status: 200 len: 945 time: 0.6872015 Dec 09 21:24:16.354370 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-733cb2d3-c171-4f37-9ae8-dcf7793f4f22 req-34d2f204-20a5-465f-83a5-acf6bf15b802 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:16.405550 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3cebe20-f1b8-4d23-8013-7015d7a0188d req-275e25ce-2ccc-4d66-a427-1a0d9fa7e7c9 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:16.407165 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3cebe20-f1b8-4d23-8013-7015d7a0188d req-275e25ce-2ccc-4d66-a427-1a0d9fa7e7c9 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f7517580-ddaa-48b1-9288-a3db030a3443 HTTP/1.1" status: 200 len: 946 time: 0.2008996 Dec 09 21:24:16.496108 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 10a46e5c-6c20-45c6-bb7c-767cb5043f63 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:24:16.550018 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-0579f096-84b6-49b9-bba7-c3fb27d78a77 req-85f9d7bb-9b0a-4d7e-b99d-bce8788a4fcf tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] For port 66544e42-b228-4e80-9ed2-bc699bb1993e, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=66544e42-b228-4e80-9ed2-bc699bb1993e,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:16.550544 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0579f096-84b6-49b9-bba7-c3fb27d78a77 req-85f9d7bb-9b0a-4d7e-b99d-bce8788a4fcf tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:16.558598 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 2d7c3530-6978-4b69-922b-c7cebee631c8, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2d7c3530-6978-4b69-922b-c7cebee631c8,segment=NetworkSegment(f50abd2e-e599-448f-8441-67314ef9ac54),segment_id=f50abd2e-e599-448f-8441-67314ef9ac54)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:16.565842 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] Set router 0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:24:16.566077 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c1166635-7958-4ada-b12d-8dd20d54c988 None None] Provisioning complete for port 2d7c3530-6978-4b69-922b-c7cebee631c8 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:16.566655 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c1166635-7958-4ada-b12d-8dd20d54c988 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:16.577938 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-0579f096-84b6-49b9-bba7-c3fb27d78a77 req-85f9d7bb-9b0a-4d7e-b99d-bce8788a4fcf tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Calling delete_port for 66544e42-b228-4e80-9ed2-bc699bb1993e owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:16.596347 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-733cb2d3-c171-4f37-9ae8-dcf7793f4f22 req-34d2f204-20a5-465f-83a5-acf6bf15b802 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] For port 6166c639-9f87-4254-af88-12c4be868be5, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6166c639-9f87-4254-af88-12c4be868be5,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:16.596347 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-733cb2d3-c171-4f37-9ae8-dcf7793f4f22 req-34d2f204-20a5-465f-83a5-acf6bf15b802 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:16.603754 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76dfac6e-d62b-4273-bedf-e253920401b9 req-23684fd8-1343-4c36-8649-96fe27449539 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:16.604499 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:16.606506 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-76dfac6e-d62b-4273-bedf-e253920401b9 req-23684fd8-1343-4c36-8649-96fe27449539 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/ports?device_id=99185349-bf6b-4cb8-a80b-ebf360aecfbb HTTP/1.1" status: 200 len: 945 time: 0.1595895 Dec 09 21:24:16.617911 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-733cb2d3-c171-4f37-9ae8-dcf7793f4f22 req-34d2f204-20a5-465f-83a5-acf6bf15b802 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Calling delete_port for 6166c639-9f87-4254-af88-12c4be868be5 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:16.761105 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3cebe20-f1b8-4d23-8013-7015d7a0188d req-7d2d63cf-6e72-4903-89de-a643cbf9f858 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3172495 Dec 09 21:24:16.799635 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5', 'name': 'tempest-FloatingIPsTestJSON-2142506536-router', 'tenant_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.254'}], 'enable_snat': True}, 'gw_port_id': 'df5c9696-5b31-485a-855f-3e6a07c94a2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:12Z', 'updated_at': '2021-12-09T21:24:14Z', 'revision_number': 3, 'project_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'gw_port': {'id': 'df5c9696-5b31-485a-855f-3e6a07c94a2f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:9f:7d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 760, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:13Z', 'updated_at': '2021-12-09T21:24:13Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:16.868766 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-76dfac6e-d62b-4273-bedf-e253920401b9 req-6b61595e-beca-4326-8ccf-a541ab44b5ae tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/security-groups?id=502403b3-5851-499b-ae86-dd222b0f8aab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2514400 Dec 09 21:24:16.874840 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] Checking router: 0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:24:16.875267 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] Updating router 0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5 port df5c9696-5b31-485a-855f-3e6a07c94a2f binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:24:16.890618 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 10a46e5c-6c20-45c6-bb7c-767cb5043f63, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=10a46e5c-6c20-45c6-bb7c-767cb5043f63,segment=NetworkSegment(77d1b765-2404-4dd1-ab6e-956ebecc3e04),segment_id=77d1b765-2404-4dd1-ab6e-956ebecc3e04)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:16.905654 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '10a46e5c-6c20-45c6-bb7c-767cb5043f63', 'network_id': 'c2615978-1c59-4fbb-826b-fc6aec14e987', 'port_id': '10a46e5c-6c20-45c6-bb7c-767cb5043f63', 'mac_address': 'fa:16:3e:36:ae:7c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 147, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1f5c65f5-5864-4e4e-bede-1bfc7f6e8e68', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:24:16.935327 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:16.952460 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-fa002d45-2e79-4500-bf4a-f77ca911773d req-baa7cdfe-a83c-4712-b746-87a2d981b8b0 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Deleting port 2f1265f7-0579-475d-9faa-f23ade6ec46b {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:16.953120 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fa002d45-2e79-4500-bf4a-f77ca911773d req-baa7cdfe-a83c-4712-b746-87a2d981b8b0 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:16.979919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=2d7c3530-6978-4b69-922b-c7cebee631c8,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:17.030667 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:17.053189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 10a46e5c-6c20-45c6-bb7c-767cb5043f63 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:24:17.074300 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-733cb2d3-c171-4f37-9ae8-dcf7793f4f22 req-34d2f204-20a5-465f-83a5-acf6bf15b802 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:17.086694 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 10a46e5c-6c20-45c6-bb7c-767cb5043f63, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=10a46e5c-6c20-45c6-bb7c-767cb5043f63,segment=NetworkSegment(77d1b765-2404-4dd1-ab6e-956ebecc3e04),segment_id=77d1b765-2404-4dd1-ab6e-956ebecc3e04)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:17.091061 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['6166c639-9f87-4254-af88-12c4be868be5'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:24:17.119482 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:17.159153 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34d2f204-20a5-465f-83a5-acf6bf15b802 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Pushing event deleted for resources: {'Port': ['ID=6166c639-9f87-4254-af88-12c4be868be5,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:17.191787 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=10a46e5c-6c20-45c6-bb7c-767cb5043f63,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:17.211545 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c08d9ffe-6c89-476b-8e68-e8405409e8c3 None None] Provisioning complete for port 2d7c3530-6978-4b69-922b-c7cebee631c8 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:17.211930 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c08d9ffe-6c89-476b-8e68-e8405409e8c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:17.242241 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['10a46e5c-6c20-45c6-bb7c-767cb5043f63'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:24:17.256330 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-733cb2d3-c171-4f37-9ae8-dcf7793f4f22 req-34d2f204-20a5-465f-83a5-acf6bf15b802 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] No DVR routers for this DVR port 6166c639-9f87-4254-af88-12c4be868be5 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:24:17.261975 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-733cb2d3-c171-4f37-9ae8-dcf7793f4f22 req-34d2f204-20a5-465f-83a5-acf6bf15b802 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:17.265562 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-733cb2d3-c171-4f37-9ae8-dcf7793f4f22 req-34d2f204-20a5-465f-83a5-acf6bf15b802 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.31 "DELETE /v2.0/ports/6166c639-9f87-4254-af88-12c4be868be5 HTTP/1.1" status: 204 len: 173 time: 1.2005973 Dec 09 21:24:17.266101 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b061c5ff-772f-4909-950e-39d066fb05c2', 'name': 'network-vif-deleted', 'tag': '6166c639-9f87-4254-af88-12c4be868be5'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:24:17.269269 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d2cb9ad0-e758-4e24-a3c6-32cf060ba3e7" -d '{"events": [{"server_uuid": "b061c5ff-772f-4909-950e-39d066fb05c2", "name": "network-vif-deleted", "tag": "6166c639-9f87-4254-af88-12c4be868be5"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:24:17.293435 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c7ed3b99-22a0-4571-b334-fa53420876e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:17.357312 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-094861c2-f827-475a-8efc-b0cbe6afc1b0 req-16010b82-cfdc-43fd-a385-fc8f6c4df04f tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:17.358841 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-094861c2-f827-475a-8efc-b0cbe6afc1b0 req-16010b82-cfdc-43fd-a385-fc8f6c4df04f tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07 HTTP/1.1" status: 200 len: 946 time: 0.4379666 Dec 09 21:24:17.372895 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-fa002d45-2e79-4500-bf4a-f77ca911773d req-baa7cdfe-a83c-4712-b746-87a2d981b8b0 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] For port 2f1265f7-0579-475d-9faa-f23ade6ec46b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=2f1265f7-0579-475d-9faa-f23ade6ec46b,segment=NetworkSegment(2d25d46c-e6fd-49a0-8d61-31fba8f6eefc),segment_id=2d25d46c-e6fd-49a0-8d61-31fba8f6eefc)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:17.373376 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fa002d45-2e79-4500-bf4a-f77ca911773d req-baa7cdfe-a83c-4712-b746-87a2d981b8b0 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:17.404503 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-fa002d45-2e79-4500-bf4a-f77ca911773d req-baa7cdfe-a83c-4712-b746-87a2d981b8b0 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Calling delete_port for 2f1265f7-0579-475d-9faa-f23ade6ec46b owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:17.437466 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c8f3e5e-f124-48b3-9a5f-c1378ab4a0b9 req-4c088301-abd1-4bee-94c2-09b85e7fade4 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:17.444967 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c8f3e5e-f124-48b3-9a5f-c1378ab4a0b9 req-4c088301-abd1-4bee-94c2-09b85e7fade4 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/ports?device_id=63d23827-0eb3-4c4c-87f7-698524a008f5 HTTP/1.1" status: 200 len: 947 time: 0.2595994 Dec 09 21:24:17.457686 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0579f096-84b6-49b9-bba7-c3fb27d78a77 req-85f9d7bb-9b0a-4d7e-b99d-bce8788a4fcf tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:17.469436 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 66544e42-b228-4e80-9ed2-bc699bb1993e no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:24:17.540369 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85f9d7bb-9b0a-4d7e-b99d-bce8788a4fcf tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Pushing event deleted for resources: {'Port': ['ID=66544e42-b228-4e80-9ed2-bc699bb1993e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:17.554536 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:17.560427 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 66544e42-b228-4e80-9ed2-bc699bb1993e {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:24:17.561363 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 66544e42-b228-4e80-9ed2-bc699bb1993e not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:24:17.562037 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 2f1265f7-0579-475d-9faa-f23ade6ec46b no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:24:17.566983 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:17.598478 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-c7ed3b99-22a0-4571-b334-fa53420876e0 admin admin] Allocated IP 172.20.0.1 (07db6bfe-0f5b-4d09-85c8-6bcad2644162/433e7096-4021-4933-b1ca-57165b00a150/afee0969-5b9e-4462-8043-47c41260d6aa) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:24:17.631044 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-094861c2-f827-475a-8efc-b0cbe6afc1b0 req-88c5cdfe-d894-4021-a76a-6a97db5b90ac tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2548251 Dec 09 21:24:17.670414 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-0579f096-84b6-49b9-bba7-c3fb27d78a77 req-85f9d7bb-9b0a-4d7e-b99d-bce8788a4fcf tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] No DVR routers for this DVR port 66544e42-b228-4e80-9ed2-bc699bb1993e on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:24:17.681204 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0579f096-84b6-49b9-bba7-c3fb27d78a77 req-85f9d7bb-9b0a-4d7e-b99d-bce8788a4fcf tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:17.684892 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0579f096-84b6-49b9-bba7-c3fb27d78a77 req-85f9d7bb-9b0a-4d7e-b99d-bce8788a4fcf tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.10 "DELETE /v2.0/ports/66544e42-b228-4e80-9ed2-bc699bb1993e HTTP/1.1" status: 204 len: 173 time: 2.5897362 Dec 09 21:24:17.685525 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '63d23827-0eb3-4c4c-87f7-698524a008f5', 'name': 'network-vif-deleted', 'tag': '66544e42-b228-4e80-9ed2-bc699bb1993e'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:24:17.689442 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-31359042-e324-4222-940b-6da5cd70c846" -d '{"events": [{"server_uuid": "63d23827-0eb3-4c4c-87f7-698524a008f5", "name": "network-vif-deleted", "tag": "66544e42-b228-4e80-9ed2-bc699bb1993e"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:24:17.695138 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] Attempting to bind port df5c9696-5b31-485a-855f-3e6a07c94a2f on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:24:17.696101 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] Attempting to bind port df5c9696-5b31-485a-855f-3e6a07c94a2f by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:24:17.696610 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] Attempting to bind port df5c9696-5b31-485a-855f-3e6a07c94a2f on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:24:17.698807 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf73505e-b058-44b9-a575-5377d82b4b06 None None] Pushing event updated for resources: {'Port': ['ID=df5c9696-5b31-485a-855f-3e6a07c94a2f,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:17.710485 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 24, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:24:17.710942 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:24:17.711342 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:17.711947 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:24:17.712433 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] Bound port: df5c9696-5b31-485a-855f-3e6a07c94a2f, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:24:17.712817 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:17.717526 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf73505e-b058-44b9-a575-5377d82b4b06 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:17.717875 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf73505e-b058-44b9-a575-5377d82b4b06 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:17.718215 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf73505e-b058-44b9-a575-5377d82b4b06 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:17.718548 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf73505e-b058-44b9-a575-5377d82b4b06 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:17.718877 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf73505e-b058-44b9-a575-5377d82b4b06 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:17.719203 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf73505e-b058-44b9-a575-5377d82b4b06 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:17.719962 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf73505e-b058-44b9-a575-5377d82b4b06 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:17.720273 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c8f3e5e-f124-48b3-9a5f-c1378ab4a0b9 req-e4333d30-9742-4abf-bc79-664ba4f7c9e5 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/security-groups?id=24094cbf-e652-478e-bb06-edc8eb774ee3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2680368 Dec 09 21:24:17.720400 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf73505e-b058-44b9-a575-5377d82b4b06 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:17.720723 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf73505e-b058-44b9-a575-5377d82b4b06 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:17.721116 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf73505e-b058-44b9-a575-5377d82b4b06 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:17.721364 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf73505e-b058-44b9-a575-5377d82b4b06 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:17.721683 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf73505e-b058-44b9-a575-5377d82b4b06 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:17.722055 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf73505e-b058-44b9-a575-5377d82b4b06 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:17.731549 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2d7c3530-6978-4b69-922b-c7cebee631c8 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:24:17.807574 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] For port df5c9696-5b31-485a-855f-3e6a07c94a2f, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:24:17.813704 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] For port df5c9696-5b31-485a-855f-3e6a07c94a2f, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=df5c9696-5b31-485a-855f-3e6a07c94a2f,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:24:17.824622 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:17.919166 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fa002d45-2e79-4500-bf4a-f77ca911773d req-baa7cdfe-a83c-4712-b746-87a2d981b8b0 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:17.958587 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c7ed3b99-22a0-4571-b334-fa53420876e0 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:17.998200 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:17.999942 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf73505e-b058-44b9-a575-5377d82b4b06 None None] Pushing event updated for resources: {'Port': ['ID=df5c9696-5b31-485a-855f-3e6a07c94a2f,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:18.013117 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baa7cdfe-a83c-4712-b746-87a2d981b8b0 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Pushing event deleted for resources: {'Port': ['ID=2f1265f7-0579-475d-9faa-f23ade6ec46b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:18.028574 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] Routers {'0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:24:18.029331 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:18.051319 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:24:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c48c1756-48a2-4d3b-975a-a45ffc53434f x-openstack-request-id: req-c48c1756-48a2-4d3b-975a-a45ffc53434f {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:24:18.051687 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b061c5ff-772f-4909-950e-39d066fb05c2", "name": "network-vif-deleted", "tag": "6166c639-9f87-4254-af88-12c4be868be5", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:24:18.051949 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c48c1756-48a2-4d3b-975a-a45ffc53434f {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:24:18.052363 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b061c5ff-772f-4909-950e-39d066fb05c2', 'name': 'network-vif-deleted', 'tag': '6166c639-9f87-4254-af88-12c4be868be5', 'status': 'completed', 'code': 200} Dec 09 21:24:18.054147 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c7ed3b99-22a0-4571-b334-fa53420876e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:18.086366 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 2d7c3530-6978-4b69-922b-c7cebee631c8 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:18.096610 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:18.175600 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bbd1fe2c-e928-4548-8225-b873d518f921 req-904bb24e-9463-4020-9716-ba5380f1f3c6 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=b061c5ff-772f-4909-950e-39d066fb05c2 HTTP/1.1" status: 200 len: 210 time: 0.1836214 Dec 09 21:24:18.222995 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c7ed3b99-22a0-4571-b334-fa53420876e0 admin admin] Network 07db6bfe-0f5b-4d09-85c8-6bcad2644162 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:18.228633 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7ed3b99-22a0-4571-b334-fa53420876e0 admin admin] Pushing event updated for resources: {'Port': ['ID=afee0969-5b9e-4462-8043-47c41260d6aa,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:18.231327 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-c7ed3b99-22a0-4571-b334-fa53420876e0 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:18.251594 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-fa002d45-2e79-4500-bf4a-f77ca911773d req-baa7cdfe-a83c-4712-b746-87a2d981b8b0 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] No DVR routers for this DVR port 2f1265f7-0579-475d-9faa-f23ade6ec46b on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:24:18.258842 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fa002d45-2e79-4500-bf4a-f77ca911773d req-baa7cdfe-a83c-4712-b746-87a2d981b8b0 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:18.262380 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fa002d45-2e79-4500-bf4a-f77ca911773d req-baa7cdfe-a83c-4712-b746-87a2d981b8b0 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.10 "DELETE /v2.0/ports/2f1265f7-0579-475d-9faa-f23ade6ec46b HTTP/1.1" status: 204 len: 173 time: 1.8990622 Dec 09 21:24:18.262568 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7ed3b99-22a0-4571-b334-fa53420876e0 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:24:18.289809 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:24:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7f512388-31f4-4217-a93f-c4576531210e x-openstack-request-id: req-7f512388-31f4-4217-a93f-c4576531210e {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:24:18.290328 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "63d23827-0eb3-4c4c-87f7-698524a008f5", "name": "network-vif-deleted", "tag": "66544e42-b228-4e80-9ed2-bc699bb1993e", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:24:18.290975 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-7f512388-31f4-4217-a93f-c4576531210e {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:24:18.291742 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '63d23827-0eb3-4c4c-87f7-698524a008f5', 'name': 'network-vif-deleted', 'tag': '66544e42-b228-4e80-9ed2-bc699bb1993e', 'status': 'completed', 'code': 200} Dec 09 21:24:18.300433 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] Set router 0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:24:18.401208 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c7ed3b99-22a0-4571-b334-fa53420876e0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:18.406592 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 10a46e5c-6c20-45c6-bb7c-767cb5043f63 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:24:18.465696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44cba9a8-d300-4850-a444-e0f39df2ccd4 req-6738d0fe-4ef0-40cc-b633-4090f086cb00 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:18.477760 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44cba9a8-d300-4850-a444-e0f39df2ccd4 req-6738d0fe-4ef0-40cc-b633-4090f086cb00 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f7517580-ddaa-48b1-9288-a3db030a3443 HTTP/1.1" status: 200 len: 946 time: 0.1056964 Dec 09 21:24:18.594879 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 10a46e5c-6c20-45c6-bb7c-767cb5043f63 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:18.595599 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:18.605736 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44cba9a8-d300-4850-a444-e0f39df2ccd4 req-c7dbc824-a389-4656-a007-f2d3cc612ab9 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1268017 Dec 09 21:24:18.624602 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36224) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:18.693209 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4312684d-d506-4dd7-9910-46ec1703db95 req-0b065797-3437-41d3-bc7e-4ce886eb2d6e tempest-FloatingIPsAssociationNegativeTestJSON-1238456014 tempest-FloatingIPsAssociationNegativeTestJSON-1238456014-project] 10.222.0.13 "GET /v2.0/ports?device_id=99185349-bf6b-4cb8-a80b-ebf360aecfbb HTTP/1.1" status: 200 len: 210 time: 0.0860412 Dec 09 21:24:18.760987 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c7ed3b99-22a0-4571-b334-fa53420876e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:18.814977 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5', 'name': 'tempest-FloatingIPsTestJSON-2142506536-router', 'tenant_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.254'}], 'enable_snat': True}, 'gw_port_id': 'df5c9696-5b31-485a-855f-3e6a07c94a2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:12Z', 'updated_at': '2021-12-09T21:24:14Z', 'revision_number': 3, 'project_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'gw_port': {'id': 'df5c9696-5b31-485a-855f-3e6a07c94a2f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:9f:7d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 760, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:13Z', 'updated_at': '2021-12-09T21:24:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:18.893500 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:18.913250 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f6dcdf9-f788-492d-8d09-9b6561223eab None None] The sync data for ids ['0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5'] in n-d-713301-27 is: [{'id': '0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5', 'name': 'tempest-FloatingIPsTestJSON-2142506536-router', 'tenant_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.254'}], 'enable_snat': True}, 'gw_port_id': 'df5c9696-5b31-485a-855f-3e6a07c94a2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:12Z', 'updated_at': '2021-12-09T21:24:14Z', 'revision_number': 3, 'project_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'gw_port': {'id': 'df5c9696-5b31-485a-855f-3e6a07c94a2f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:9f:7d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 760, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:13Z', 'updated_at': '2021-12-09T21:24:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:24:18.941421 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2b7a6a4d-5e2e-4692-ac22-cbeaf82d3c74 req-ab73505e-db00-4073-865c-b3628456fe4e tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/ports?device_id=63d23827-0eb3-4c4c-87f7-698524a008f5 HTTP/1.1" status: 200 len: 210 time: 0.0736403 Dec 09 21:24:18.981621 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '10a46e5c-6c20-45c6-bb7c-767cb5043f63'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:24:18.993523 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0ee1dde3-3d62-4e1b-8c19-48bd75a3eecb" -d '{"events": [{"server_uuid": "2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07", "name": "network-vif-plugged", "status": "completed", "tag": "10a46e5c-6c20-45c6-bb7c-767cb5043f63"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:24:19.003367 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05ccef17-b308-4626-b4f1-401fd59fa4da req-39377dc6-4d51-4dd4-b5fb-49d83e62b322 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:19.014540 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-05ccef17-b308-4626-b4f1-401fd59fa4da req-39377dc6-4d51-4dd4-b5fb-49d83e62b322 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07 HTTP/1.1" status: 200 len: 945 time: 0.2277126 Dec 09 21:24:19.044936 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f0a19e39-d3e7-43b4-83f1-b4011e16e913 None None] Provisioning complete for port afee0969-5b9e-4462-8043-47c41260d6aa triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:19.045648 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f0a19e39-d3e7-43b4-83f1-b4011e16e913 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:19.099162 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-05ccef17-b308-4626-b4f1-401fd59fa4da req-82ce82a7-bd3c-4d6b-8faa-5953d13c9006 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0809276 Dec 09 21:24:19.138373 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 10a46e5c-6c20-45c6-bb7c-767cb5043f63, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=10a46e5c-6c20-45c6-bb7c-767cb5043f63,segment=NetworkSegment(77d1b765-2404-4dd1-ab6e-956ebecc3e04),segment_id=77d1b765-2404-4dd1-ab6e-956ebecc3e04)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:19.147303 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f0a19e39-d3e7-43b4-83f1-b4011e16e913 None None] Port afee0969-5b9e-4462-8043-47c41260d6aa cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:24:19.156157 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:24:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-22b570e7-74a0-4583-a205-8ee7ac402d09 x-openstack-request-id: req-22b570e7-74a0-4583-a205-8ee7ac402d09 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:24:19.156471 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07", "name": "network-vif-plugged", "status": "completed", "tag": "10a46e5c-6c20-45c6-bb7c-767cb5043f63", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:24:19.158624 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-22b570e7-74a0-4583-a205-8ee7ac402d09 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:24:19.159071 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '10a46e5c-6c20-45c6-bb7c-767cb5043f63', 'code': 200} Dec 09 21:24:19.159762 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:19.160570 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6166c639-9f87-4254-af88-12c4be868be5 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:24:19.161952 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf0e0322-8334-42aa-8993-2b659ecc02fb admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:19.269466 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c7ed3b99-22a0-4571-b334-fa53420876e0 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:19.277428 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 6166c639-9f87-4254-af88-12c4be868be5 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:24:19.278803 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6166c639-9f87-4254-af88-12c4be868be5 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:24:19.283431 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c7ed3b99-22a0-4571-b334-fa53420876e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:19.362150 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=10a46e5c-6c20-45c6-bb7c-767cb5043f63,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:19.372637 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7ed3b99-22a0-4571-b334-fa53420876e0 admin admin] Pushing event updated for resources: {'Port': ['ID=afee0969-5b9e-4462-8043-47c41260d6aa,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:19.430026 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf0e0322-8334-42aa-8993-2b659ecc02fb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:19.434268 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c7ed3b99-22a0-4571-b334-fa53420876e0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:19.443503 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf0e0322-8334-42aa-8993-2b659ecc02fb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:19.539035 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cf0e0322-8334-42aa-8993-2b659ecc02fb admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=61680a68a50243d0be2adf01826350af&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9132266 Dec 09 21:24:19.542224 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf0e0322-8334-42aa-8993-2b659ecc02fb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=50938381-0293-4e2f-8182-2d6f24fadec4,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:19.545061 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36248) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:19.579941 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86cd1a13-04bf-445f-96ab-8a9767700a73 req-3851b2b6-1995-42c8-b37c-a1aab5e96c5f tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:19.590066 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86cd1a13-04bf-445f-96ab-8a9767700a73 req-3851b2b6-1995-42c8-b37c-a1aab5e96c5f tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 944 time: 0.0681269 Dec 09 21:24:19.671633 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c7ed3b99-22a0-4571-b334-fa53420876e0 admin admin] Network 07db6bfe-0f5b-4d09-85c8-6bcad2644162 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:19.676802 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-c7ed3b99-22a0-4571-b334-fa53420876e0 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:19.685380 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86cd1a13-04bf-445f-96ab-8a9767700a73 req-d1a537ec-2ad8-4356-b391-f7e3cffecf10 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0912185 Dec 09 21:24:19.702802 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device df5c9696-5b31-485a-855f-3e6a07c94a2f up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:24:19.726740 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-73ebe6d8-bf2a-4f53-a113-1c319f8956db admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:19.767535 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36252) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:19.793292 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port df5c9696-5b31-485a-855f-3e6a07c94a2f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:19.793961 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:19.929086 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c7ed3b99-22a0-4571-b334-fa53420876e0 admin admin] Router 0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:24:19.953007 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:19.977238 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port df5c9696-5b31-485a-855f-3e6a07c94a2f, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=df5c9696-5b31-485a-855f-3e6a07c94a2f,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:19.993091 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:20.043555 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-73ebe6d8-bf2a-4f53-a113-1c319f8956db admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:20.082635 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=df5c9696-5b31-485a-855f-3e6a07c94a2f,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:20.100090 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1ebb8a3a-502b-4cae-94f8-dd0c182d475d None None] Provisioning complete for port afee0969-5b9e-4462-8043-47c41260d6aa triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:20.100569 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1ebb8a3a-502b-4cae-94f8-dd0c182d475d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:20.112965 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-73ebe6d8-bf2a-4f53-a113-1c319f8956db admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:20.121897 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-73ebe6d8-bf2a-4f53-a113-1c319f8956db admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:20.126230 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-73ebe6d8-bf2a-4f53-a113-1c319f8956db admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/50938381-0293-4e2f-8182-2d6f24fadec4 HTTP/1.1" status: 204 len: 168 time: 0.5784249 Dec 09 21:24:20.169695 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-1ebb8a3a-502b-4cae-94f8-dd0c182d475d None None] Port afee0969-5b9e-4462-8043-47c41260d6aa cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:24:20.198739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e9af1fb-41f0-4664-b091-c9cd323b9cb3 req-514ce8e8-51b1-4c6a-9743-4efe576e6576 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:20.200702 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1e9af1fb-41f0-4664-b091-c9cd323b9cb3 req-514ce8e8-51b1-4c6a-9743-4efe576e6576 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.31 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 944 time: 0.2349572 Dec 09 21:24:20.205555 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73ebe6d8-bf2a-4f53-a113-1c319f8956db admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=50938381-0293-4e2f-8182-2d6f24fadec4,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:20.270788 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4248377-c67e-4091-ae37-786b05f78ba5 req-399e26d2-89c2-44f7-86ae-529e2588b46e tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:20.272509 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c4248377-c67e-4091-ae37-786b05f78ba5 req-399e26d2-89c2-44f7-86ae-529e2588b46e tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.31 "GET /v2.0/ports?device_id=2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07 HTTP/1.1" status: 200 len: 946 time: 0.2058487 Dec 09 21:24:20.326890 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '99185349-bf6b-4cb8-a80b-ebf360aecfbb', 'name': 'network-vif-deleted', 'tag': '2f1265f7-0579-475d-9faa-f23ade6ec46b'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:24:20.329869 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7ae34352-9e08-4f90-8e9f-3a7e31216f2a" -d '{"events": [{"server_uuid": "99185349-bf6b-4cb8-a80b-ebf360aecfbb", "name": "network-vif-deleted", "tag": "2f1265f7-0579-475d-9faa-f23ade6ec46b"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:24:20.358995 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c7ed3b99-22a0-4571-b334-fa53420876e0 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:24:20.391658 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c7ed3b99-22a0-4571-b334-fa53420876e0 admin admin] 10.222.0.13 "PUT /v2.0/routers/0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.2278907 Dec 09 21:24:20.406042 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 10a46e5c-6c20-45c6-bb7c-767cb5043f63 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:24:20.523727 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-1e9af1fb-41f0-4664-b091-c9cd323b9cb3 req-d9a31683-9615-4a6b-bbe7-600576d97676 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Deleting port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:20.525128 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1e9af1fb-41f0-4664-b091-c9cd323b9cb3 req-d9a31683-9615-4a6b-bbe7-600576d97676 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:20.548710 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf0f5302-84a8-49db-a06b-518ac877d577 req-0c66d36c-a761-4394-bf7c-a624baecad38 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:20.555421 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf0f5302-84a8-49db-a06b-518ac877d577 req-0c66d36c-a761-4394-bf7c-a624baecad38 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07 HTTP/1.1" status: 200 len: 946 time: 0.2786853 Dec 09 21:24:20.628626 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:20.672435 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 10a46e5c-6c20-45c6-bb7c-767cb5043f63, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=10a46e5c-6c20-45c6-bb7c-767cb5043f63,segment=NetworkSegment(77d1b765-2404-4dd1-ab6e-956ebecc3e04),segment_id=77d1b765-2404-4dd1-ab6e-956ebecc3e04)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:20.680320 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:20.746661 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=10a46e5c-6c20-45c6-bb7c-767cb5043f63,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:20.779712 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-1e9af1fb-41f0-4664-b091-c9cd323b9cb3 req-d9a31683-9615-4a6b-bbe7-600576d97676 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] For port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:20.780433 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1e9af1fb-41f0-4664-b091-c9cd323b9cb3 req-d9a31683-9615-4a6b-bbe7-600576d97676 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:20.804210 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-1e9af1fb-41f0-4664-b091-c9cd323b9cb3 req-d9a31683-9615-4a6b-bbe7-600576d97676 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Calling delete_port for cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:20.827072 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5e55bf6-6739-4d64-ad94-cd63b793f948 req-497776e7-6c4e-4ce4-a365-3dd5cb2f4591 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:20.835380 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5e55bf6-6739-4d64-ad94-cd63b793f948 req-497776e7-6c4e-4ce4-a365-3dd5cb2f4591 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/ports?device_id=8f48a806-013e-480e-81ac-1a7f5f10c155 HTTP/1.1" status: 200 len: 949 time: 0.3134947 Dec 09 21:24:20.858077 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf0f5302-84a8-49db-a06b-518ac877d577 req-557d3484-66b1-4057-9c14-0830c469d745 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2493870 Dec 09 21:24:20.880262 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-c4248377-c67e-4091-ae37-786b05f78ba5 req-21cb5d5f-4199-4687-8374-10b6a79b1333 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Deleting port 10a46e5c-6c20-45c6-bb7c-767cb5043f63 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:20.880602 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c4248377-c67e-4091-ae37-786b05f78ba5 req-21cb5d5f-4199-4687-8374-10b6a79b1333 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:20.904333 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36278) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:20.931208 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6d1beb18-9263-4608-ad3d-905197bb73f3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:20.940915 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:24:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1a094e9e-ccf8-44bf-aeb7-c27b0c7927ee x-openstack-request-id: req-1a094e9e-ccf8-44bf-aeb7-c27b0c7927ee {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:24:20.941206 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "99185349-bf6b-4cb8-a80b-ebf360aecfbb", "name": "network-vif-deleted", "tag": "2f1265f7-0579-475d-9faa-f23ade6ec46b", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:24:20.941788 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-1a094e9e-ccf8-44bf-aeb7-c27b0c7927ee {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:24:20.942188 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '99185349-bf6b-4cb8-a80b-ebf360aecfbb', 'name': 'network-vif-deleted', 'tag': '2f1265f7-0579-475d-9faa-f23ade6ec46b', 'status': 'completed', 'code': 200} Dec 09 21:24:20.976473 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5e55bf6-6739-4d64-ad94-cd63b793f948 req-d3ca760f-098a-4608-8482-c19eb5ac9d21 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/security-groups?id=24094cbf-e652-478e-bb06-edc8eb774ee3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1401813 Dec 09 21:24:21.050507 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-c4248377-c67e-4091-ae37-786b05f78ba5 req-21cb5d5f-4199-4687-8374-10b6a79b1333 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] For port 10a46e5c-6c20-45c6-bb7c-767cb5043f63, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=10a46e5c-6c20-45c6-bb7c-767cb5043f63,segment=NetworkSegment(77d1b765-2404-4dd1-ab6e-956ebecc3e04),segment_id=77d1b765-2404-4dd1-ab6e-956ebecc3e04)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:21.051274 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c4248377-c67e-4091-ae37-786b05f78ba5 req-21cb5d5f-4199-4687-8374-10b6a79b1333 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:21.067225 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-c4248377-c67e-4091-ae37-786b05f78ba5 req-21cb5d5f-4199-4687-8374-10b6a79b1333 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Calling delete_port for 10a46e5c-6c20-45c6-bb7c-767cb5043f63 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:21.068586 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1e9af1fb-41f0-4664-b091-c9cd323b9cb3 req-d9a31683-9615-4a6b-bbe7-600576d97676 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:21.109044 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9a31683-9615-4a6b-bbe7-600576d97676 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Pushing event deleted for resources: {'Port': ['ID=cb941377-5fe0-4e9e-9ac5-1fb6253c78d7,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:21.114149 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb65ad90-e4df-4e7c-994e-4e2eaca89835 req-0dd9063e-6f56-4f83-80c1-227087a19522 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=9f03f0c3-a9b7-47c8-84b7-e9329ceed834 HTTP/1.1" status: 200 len: 210 time: 0.0482931 Dec 09 21:24:21.152953 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6d1beb18-9263-4608-ad3d-905197bb73f3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:21.160959 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '10a46e5c-6c20-45c6-bb7c-767cb5043f63'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:24:21.166248 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ca4ce409-4f27-40a8-a596-223a021660ad" -d '{"events": [{"server_uuid": "2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07", "name": "network-vif-unplugged", "status": "completed", "tag": "10a46e5c-6c20-45c6-bb7c-767cb5043f63"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:24:21.184111 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0468e63e-6f50-4012-b642-824373c936cc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:21.189629 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-1e9af1fb-41f0-4664-b091-c9cd323b9cb3 req-d9a31683-9615-4a6b-bbe7-600576d97676 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] No DVR routers for this DVR port cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:24:21.192714 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1e9af1fb-41f0-4664-b091-c9cd323b9cb3 req-d9a31683-9615-4a6b-bbe7-600576d97676 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:21.198826 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1e9af1fb-41f0-4664-b091-c9cd323b9cb3 req-d9a31683-9615-4a6b-bbe7-600576d97676 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.31 "DELETE /v2.0/ports/cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 HTTP/1.1" status: 204 len: 173 time: 0.9863791 Dec 09 21:24:21.199020 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9f03f0c3-a9b7-47c8-84b7-e9329ceed834', 'name': 'network-vif-deleted', 'tag': 'cb941377-5fe0-4e9e-9ac5-1fb6253c78d7'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:24:21.202529 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-58733ced-bbfe-4b89-a5aa-80f600894a1c" -d '{"events": [{"server_uuid": "9f03f0c3-a9b7-47c8-84b7-e9329ceed834", "name": "network-vif-deleted", "tag": "cb941377-5fe0-4e9e-9ac5-1fb6253c78d7"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:24:21.206182 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6d1beb18-9263-4608-ad3d-905197bb73f3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:21.235118 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:24:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4f994d0e-5fa9-4b28-8fd7-e755fa4869a9 x-openstack-request-id: req-4f994d0e-5fa9-4b28-8fd7-e755fa4869a9 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:24:21.235530 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07", "name": "network-vif-unplugged", "status": "completed", "tag": "10a46e5c-6c20-45c6-bb7c-767cb5043f63", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:24:21.235794 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-4f994d0e-5fa9-4b28-8fd7-e755fa4869a9 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:24:21.236207 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '10a46e5c-6c20-45c6-bb7c-767cb5043f63', 'code': 200} Dec 09 21:24:21.286522 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6d1beb18-9263-4608-ad3d-905197bb73f3 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=46fa2c99c5b449deb29670d1dc31cf92&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3806894 Dec 09 21:24:21.290273 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36286) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:21.313905 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d1beb18-9263-4608-ad3d-905197bb73f3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4424ee47-a340-4b07-99ca-ea395d9c2514,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:21.318323 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:24:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8bc170a3-077c-4662-931c-37631ae766de x-openstack-request-id: req-8bc170a3-077c-4662-931c-37631ae766de {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:24:21.318600 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9f03f0c3-a9b7-47c8-84b7-e9329ceed834", "name": "network-vif-deleted", "tag": "cb941377-5fe0-4e9e-9ac5-1fb6253c78d7", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:24:21.318855 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8bc170a3-077c-4662-931c-37631ae766de {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:24:21.319917 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9f03f0c3-a9b7-47c8-84b7-e9329ceed834', 'name': 'network-vif-deleted', 'tag': 'cb941377-5fe0-4e9e-9ac5-1fb6253c78d7', 'status': 'completed', 'code': 200} Dec 09 21:24:21.358979 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-716ed2b5-4616-4e07-8250-e7d3f8cb62d0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:21.382828 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-716ed2b5-4616-4e07-8250-e7d3f8cb62d0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:21.450468 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-716ed2b5-4616-4e07-8250-e7d3f8cb62d0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:21.453147 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-716ed2b5-4616-4e07-8250-e7d3f8cb62d0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:21.454438 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-716ed2b5-4616-4e07-8250-e7d3f8cb62d0 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/4424ee47-a340-4b07-99ca-ea395d9c2514 HTTP/1.1" status: 204 len: 168 time: 0.1631210 Dec 09 21:24:21.477130 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-716ed2b5-4616-4e07-8250-e7d3f8cb62d0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4424ee47-a340-4b07-99ca-ea395d9c2514,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:21.544879 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c4248377-c67e-4091-ae37-786b05f78ba5 req-21cb5d5f-4199-4687-8374-10b6a79b1333 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:21.589383 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21cb5d5f-4199-4687-8374-10b6a79b1333 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Pushing event deleted for resources: {'Port': ['ID=10a46e5c-6c20-45c6-bb7c-767cb5043f63,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:21.596060 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ddd21609-0b0d-4764-a988-d33e39aa66bd req-017ffc06-9a8c-4f99-b70f-c3134ce46e67 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 0.2672942 Dec 09 21:24:21.610189 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-ddd21609-0b0d-4764-a988-d33e39aa66bd req-1c9b30f8-4e02-47e9-a839-a81e61002290 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:21.659429 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-c4248377-c67e-4091-ae37-786b05f78ba5 req-21cb5d5f-4199-4687-8374-10b6a79b1333 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] No DVR routers for this DVR port 10a46e5c-6c20-45c6-bb7c-767cb5043f63 on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:24:21.664488 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c4248377-c67e-4091-ae37-786b05f78ba5 req-21cb5d5f-4199-4687-8374-10b6a79b1333 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:21.668912 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c4248377-c67e-4091-ae37-786b05f78ba5 req-21cb5d5f-4199-4687-8374-10b6a79b1333 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.31 "DELETE /v2.0/ports/10a46e5c-6c20-45c6-bb7c-767cb5043f63 HTTP/1.1" status: 204 len: 173 time: 1.3263853 Dec 09 21:24:21.689345 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ddd21609-0b0d-4764-a988-d33e39aa66bd req-1c9b30f8-4e02-47e9-a839-a81e61002290 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:21.714867 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device df5c9696-5b31-485a-855f-3e6a07c94a2f up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:24:21.814494 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port df5c9696-5b31-485a-855f-3e6a07c94a2f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:21.815245 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:21.849442 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-0468e63e-6f50-4012-b642-824373c936cc admin admin] Deleting port 047fd970-b4fd-4fa7-81e7-fba0167dbce6 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:21.850042 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0468e63e-6f50-4012-b642-824373c936cc admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:21.909502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] Sync routers for ids ['0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:24:21.930638 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ddd21609-0b0d-4764-a988-d33e39aa66bd req-1c9b30f8-4e02-47e9-a839-a81e61002290 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:21.940086 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] Routers {'0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:24:21.941121 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:22.000754 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-0468e63e-6f50-4012-b642-824373c936cc admin admin] For port 047fd970-b4fd-4fa7-81e7-fba0167dbce6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=047fd970-b4fd-4fa7-81e7-fba0167dbce6,segment=NetworkSegment(2d25d46c-e6fd-49a0-8d61-31fba8f6eefc),segment_id=2d25d46c-e6fd-49a0-8d61-31fba8f6eefc)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:22.000754 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0468e63e-6f50-4012-b642-824373c936cc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:22.018306 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-0468e63e-6f50-4012-b642-824373c936cc admin admin] Calling delete_port for 047fd970-b4fd-4fa7-81e7-fba0167dbce6 owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:22.101295 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] Set router 0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:24:22.213319 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-ddd21609-0b0d-4764-a988-d33e39aa66bd req-1c9b30f8-4e02-47e9-a839-a81e61002290 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Allocated IP 172.25.3.71 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/40e3d6c1-bc8a-4078-b004-a7a4b144590d) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:24:22.283526 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-584f75f9-989b-4ed2-9f95-7f757c9f3fa1 req-914e6870-ea0c-40f8-a269-af6cbb066668 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07 HTTP/1.1" status: 200 len: 210 time: 0.0675554 Dec 09 21:24:22.627311 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5', 'name': 'tempest-FloatingIPsTestJSON-2142506536-router', 'tenant_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.254'}], 'enable_snat': True}, 'gw_port_id': 'df5c9696-5b31-485a-855f-3e6a07c94a2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:12Z', 'updated_at': '2021-12-09T21:24:18Z', 'revision_number': 4, 'project_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'gw_port': {'id': 'df5c9696-5b31-485a-855f-3e6a07c94a2f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:9f:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 760, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:13Z', 'updated_at': '2021-12-09T21:24:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'afee0969-5b9e-4462-8043-47c41260d6aa', 'name': '', 'network_id': '07db6bfe-0f5b-4d09-85c8-6bcad2644162', 'tenant_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'mac_address': 'fa:16:3e:86:f0:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5', 'device_owner': 'network:router_interface', 'standard_attr_id': 761, 'fixed_ips': [{'subnet_id': '433e7096-4021-4933-b1ca-57165b00a150', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:17Z', 'updated_at': '2021-12-09T21:24:18Z', 'revision_number': 2, 'project_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'subnets': [{'id': '433e7096-4021-4933-b1ca-57165b00a150', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:22.666111 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] Checking router: 0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:24:22.666924 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] Updating router 0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5 port afee0969-5b9e-4462-8043-47c41260d6aa binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:24:22.697905 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:22.800393 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d79326ec-344c-41eb-9b71-7569f3fcbf08 req-44bbd25b-d21b-4137-b943-1dbbec02626d tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:22.801814 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d79326ec-344c-41eb-9b71-7569f3fcbf08 req-44bbd25b-d21b-4137-b943-1dbbec02626d tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.31 "GET /v2.0/ports?device_id=8f48a806-013e-480e-81ac-1a7f5f10c155 HTTP/1.1" status: 200 len: 949 time: 0.6101537 Dec 09 21:24:22.896600 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98275b26-8637-490e-8686-867db4269208 req-d07fb5de-6c35-4ea4-ac92-42f6b3ad2c93 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:22.904548 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98275b26-8637-490e-8686-867db4269208 req-d07fb5de-6c35-4ea4-ac92-42f6b3ad2c93 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/ports?device_id=8f48a806-013e-480e-81ac-1a7f5f10c155 HTTP/1.1" status: 200 len: 949 time: 0.1978581 Dec 09 21:24:22.961654 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07', 'name': 'network-vif-deleted', 'tag': '10a46e5c-6c20-45c6-bb7c-767cb5043f63'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:24:22.963926 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-60d38996-4b38-43fc-aae7-6cc7bfcf0ef4" -d '{"events": [{"server_uuid": "2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07", "name": "network-vif-deleted", "tag": "10a46e5c-6c20-45c6-bb7c-767cb5043f63"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:24:23.016493 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ddd21609-0b0d-4764-a988-d33e39aa66bd req-1c9b30f8-4e02-47e9-a839-a81e61002290 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:23.078131 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98275b26-8637-490e-8686-867db4269208 req-9500cb53-b3b3-480c-807d-975205af912b tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.13 "GET /v2.0/security-groups?id=24094cbf-e652-478e-bb06-edc8eb774ee3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1703589 Dec 09 21:24:23.084080 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0468e63e-6f50-4012-b642-824373c936cc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:23.137720 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:23.147233 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:23.177751 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0468e63e-6f50-4012-b642-824373c936cc admin admin] Pushing event deleted for resources: {'Port': ['ID=047fd970-b4fd-4fa7-81e7-fba0167dbce6,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:23.181892 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-d79326ec-344c-41eb-9b71-7569f3fcbf08 req-9c8bcf38-0ba6-4cc6-8e6f-a5e17f3c15b4 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Deleting port 4425d491-9b2e-48a2-8fb6-ead05da81dba {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:23.182230 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d79326ec-344c-41eb-9b71-7569f3fcbf08 req-9c8bcf38-0ba6-4cc6-8e6f-a5e17f3c15b4 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:23.229380 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-147a08de-3959-4371-aa5c-171ddf78f25d None None] Pushing event updated for resources: {'Port': ['ID=afee0969-5b9e-4462-8043-47c41260d6aa,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:23.325250 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] Attempting to bind port afee0969-5b9e-4462-8043-47c41260d6aa on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:24:23.325616 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] Attempting to bind port afee0969-5b9e-4462-8043-47c41260d6aa by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f50abd2e-e599-448f-8441-67314ef9ac54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '07db6bfe-0f5b-4d09-85c8-6bcad2644162'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:24:23.326042 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] Attempting to bind port afee0969-5b9e-4462-8043-47c41260d6aa on network 07db6bfe-0f5b-4d09-85c8-6bcad2644162 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:24:23.332637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 24, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:24:23.332910 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] Checking segment: {'id': 'f50abd2e-e599-448f-8441-67314ef9ac54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '07db6bfe-0f5b-4d09-85c8-6bcad2644162'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:24:23.333325 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:23.333843 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] Bound using segment: {'id': 'f50abd2e-e599-448f-8441-67314ef9ac54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '07db6bfe-0f5b-4d09-85c8-6bcad2644162'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:24:23.334359 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] Bound port: afee0969-5b9e-4462-8043-47c41260d6aa, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f50abd2e-e599-448f-8441-67314ef9ac54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '07db6bfe-0f5b-4d09-85c8-6bcad2644162'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:24:23.334624 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:23.422907 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:24:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-abc0f56b-3d9c-4000-a323-50a22d588f05 x-openstack-request-id: req-abc0f56b-3d9c-4000-a323-50a22d588f05 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:24:23.423249 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07", "name": "network-vif-deleted", "tag": "10a46e5c-6c20-45c6-bb7c-767cb5043f63", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:24:23.424198 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-abc0f56b-3d9c-4000-a323-50a22d588f05 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:24:23.424198 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2f469f4e-6c7a-4cc1-aa66-f9a8fe15ef07', 'name': 'network-vif-deleted', 'tag': '10a46e5c-6c20-45c6-bb7c-767cb5043f63', 'status': 'completed', 'code': 200} Dec 09 21:24:23.429350 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ddd21609-0b0d-4764-a988-d33e39aa66bd req-1c9b30f8-4e02-47e9-a839-a81e61002290 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:23.441676 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-d79326ec-344c-41eb-9b71-7569f3fcbf08 req-9c8bcf38-0ba6-4cc6-8e6f-a5e17f3c15b4 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] For port 4425d491-9b2e-48a2-8fb6-ead05da81dba, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=4425d491-9b2e-48a2-8fb6-ead05da81dba,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:23.442046 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d79326ec-344c-41eb-9b71-7569f3fcbf08 req-9c8bcf38-0ba6-4cc6-8e6f-a5e17f3c15b4 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:23.478632 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] For port afee0969-5b9e-4462-8043-47c41260d6aa, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:24:23.488902 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] For port afee0969-5b9e-4462-8043-47c41260d6aa, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=afee0969-5b9e-4462-8043-47c41260d6aa,segment=NetworkSegment(f50abd2e-e599-448f-8441-67314ef9ac54),segment_id=f50abd2e-e599-448f-8441-67314ef9ac54)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:24:23.501556 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:23.649679 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-d79326ec-344c-41eb-9b71-7569f3fcbf08 req-9c8bcf38-0ba6-4cc6-8e6f-a5e17f3c15b4 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Calling delete_port for 4425d491-9b2e-48a2-8fb6-ead05da81dba owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:23.675389 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] Routers {'0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:24:23.675389 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:23.685179 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ddd21609-0b0d-4764-a988-d33e39aa66bd req-1c9b30f8-4e02-47e9-a839-a81e61002290 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:23.718994 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-ddd21609-0b0d-4764-a988-d33e39aa66bd req-1c9b30f8-4e02-47e9-a839-a81e61002290 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:23.745737 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-147a08de-3959-4371-aa5c-171ddf78f25d None None] Pushing event updated for resources: {'Port': ['ID=afee0969-5b9e-4462-8043-47c41260d6aa,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:23.749232 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-ddd21609-0b0d-4764-a988-d33e39aa66bd req-1c9b30f8-4e02-47e9-a839-a81e61002290 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:24:23.769464 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-dcfc193a-cf28-4f54-9858-8b90e4cb9bb5 None None] Provisioning complete for port afee0969-5b9e-4462-8043-47c41260d6aa triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:23.769791 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dcfc193a-cf28-4f54-9858-8b90e4cb9bb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:23.858401 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c9b30f8-4e02-47e9-a839-a81e61002290 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Pushing event updated for resources: {'Port': ['ID=40e3d6c1-bc8a-4078-b004-a7a4b144590d,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:23.910448 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0468e63e-6f50-4012-b642-824373c936cc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:23.951070 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] Set router 0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:24:23.953471 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dcfc193a-cf28-4f54-9858-8b90e4cb9bb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:24.050347 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-dcfc193a-cf28-4f54-9858-8b90e4cb9bb5 None None] For port afee0969-5b9e-4462-8043-47c41260d6aa, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=afee0969-5b9e-4462-8043-47c41260d6aa,segment=NetworkSegment(f50abd2e-e599-448f-8441-67314ef9ac54),segment_id=f50abd2e-e599-448f-8441-67314ef9ac54)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:24.054842 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dcfc193a-cf28-4f54-9858-8b90e4cb9bb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:24.065193 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ddd21609-0b0d-4764-a988-d33e39aa66bd req-1c9b30f8-4e02-47e9-a839-a81e61002290 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:24.161038 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcfc193a-cf28-4f54-9858-8b90e4cb9bb5 None None] Pushing event updated for resources: {'Port': ['ID=afee0969-5b9e-4462-8043-47c41260d6aa,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:24.215473 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-fd6518d2-6170-4c2f-a049-f6f969bf6af7 None None] Provisioning complete for port afee0969-5b9e-4462-8043-47c41260d6aa triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:24.215869 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fd6518d2-6170-4c2f-a049-f6f969bf6af7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:24.216772 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1454bd44-6c42-4ac8-a5b6-99004df5a158 req-4e97f4b1-f071-4b52-ad35-f455d51c8c13 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:24.218300 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1454bd44-6c42-4ac8-a5b6-99004df5a158 req-4e97f4b1-f071-4b52-ad35-f455d51c8c13 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 945 time: 0.2578111 Dec 09 21:24:24.224437 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ddd21609-0b0d-4764-a988-d33e39aa66bd req-1c9b30f8-4e02-47e9-a839-a81e61002290 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:24.280053 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5', 'name': 'tempest-FloatingIPsTestJSON-2142506536-router', 'tenant_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.254'}], 'enable_snat': True}, 'gw_port_id': 'df5c9696-5b31-485a-855f-3e6a07c94a2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:12Z', 'updated_at': '2021-12-09T21:24:18Z', 'revision_number': 4, 'project_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'gw_port': {'id': 'df5c9696-5b31-485a-855f-3e6a07c94a2f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:9f:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 760, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:13Z', 'updated_at': '2021-12-09T21:24:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'afee0969-5b9e-4462-8043-47c41260d6aa', 'name': '', 'network_id': '07db6bfe-0f5b-4d09-85c8-6bcad2644162', 'tenant_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'mac_address': 'fa:16:3e:86:f0:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5', 'device_owner': 'network:router_interface', 'standard_attr_id': 761, 'fixed_ips': [{'subnet_id': '433e7096-4021-4933-b1ca-57165b00a150', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:17Z', 'updated_at': '2021-12-09T21:24:23Z', 'revision_number': 4, 'project_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'subnets': [{'id': '433e7096-4021-4933-b1ca-57165b00a150', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:24.310858 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d79326ec-344c-41eb-9b71-7569f3fcbf08 req-9c8bcf38-0ba6-4cc6-8e6f-a5e17f3c15b4 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:24.312968 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97bd420b-8104-4bf9-9384-f6228fd22c3e None None] The sync data for ids ['0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5'] in n-d-713301-27 is: [{'id': '0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5', 'name': 'tempest-FloatingIPsTestJSON-2142506536-router', 'tenant_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.254'}], 'enable_snat': True}, 'gw_port_id': 'df5c9696-5b31-485a-855f-3e6a07c94a2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:12Z', 'updated_at': '2021-12-09T21:24:18Z', 'revision_number': 4, 'project_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'gw_port': {'id': 'df5c9696-5b31-485a-855f-3e6a07c94a2f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:9f:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 760, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:13Z', 'updated_at': '2021-12-09T21:24:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'afee0969-5b9e-4462-8043-47c41260d6aa', 'name': '', 'network_id': '07db6bfe-0f5b-4d09-85c8-6bcad2644162', 'tenant_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'mac_address': 'fa:16:3e:86:f0:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5', 'device_owner': 'network:router_interface', 'standard_attr_id': 761, 'fixed_ips': [{'subnet_id': '433e7096-4021-4933-b1ca-57165b00a150', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:17Z', 'updated_at': '2021-12-09T21:24:23Z', 'revision_number': 4, 'project_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'subnets': [{'id': '433e7096-4021-4933-b1ca-57165b00a150', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:24:24.414874 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 4425d491-9b2e-48a2-8fb6-ead05da81dba no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:24:24.415049 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c8bcf38-0ba6-4cc6-8e6f-a5e17f3c15b4 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Pushing event deleted for resources: {'Port': ['ID=4425d491-9b2e-48a2-8fb6-ead05da81dba,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:24.450478 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 4425d491-9b2e-48a2-8fb6-ead05da81dba {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:24:24.450865 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 4425d491-9b2e-48a2-8fb6-ead05da81dba not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:24:24.451220 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 10a46e5c-6c20-45c6-bb7c-767cb5043f63 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:24:24.478120 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 10a46e5c-6c20-45c6-bb7c-767cb5043f63 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:24:24.478767 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 10a46e5c-6c20-45c6-bb7c-767cb5043f63 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:24:24.479274 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:24:24.499254 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1454bd44-6c42-4ac8-a5b6-99004df5a158 req-2725dfc1-7f9f-40b7-8649-7e3b358fdd9d tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/security-groups?id=6091baef-c025-46e8-8fcd-f3a6a8cc904a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2659087 Dec 09 21:24:24.509687 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff4682d0-6954-45f3-935a-09ddc2b927bd req-ab231715-4a93-4ba9-83f2-973116f7c0e7 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:24.511626 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ff4682d0-6954-45f3-935a-09ddc2b927bd req-ab231715-4a93-4ba9-83f2-973116f7c0e7 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.10 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 945 time: 0.4287963 Dec 09 21:24:24.536416 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:24:24.538446 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device cb941377-5fe0-4e9e-9ac5-1fb6253c78d7 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:24:24.633451 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-d79326ec-344c-41eb-9b71-7569f3fcbf08 req-9c8bcf38-0ba6-4cc6-8e6f-a5e17f3c15b4 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] No DVR routers for this DVR port 4425d491-9b2e-48a2-8fb6-ead05da81dba on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:24:24.670388 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d79326ec-344c-41eb-9b71-7569f3fcbf08 req-9c8bcf38-0ba6-4cc6-8e6f-a5e17f3c15b4 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:24.674904 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d79326ec-344c-41eb-9b71-7569f3fcbf08 req-9c8bcf38-0ba6-4cc6-8e6f-a5e17f3c15b4 tempest-ListImageFiltersTestJSON-1353729237 tempest-ListImageFiltersTestJSON-1353729237-project] 10.222.0.31 "DELETE /v2.0/ports/4425d491-9b2e-48a2-8fb6-ead05da81dba HTTP/1.1" status: 204 len: 173 time: 1.8631501 Dec 09 21:24:24.816365 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ddd21609-0b0d-4764-a988-d33e39aa66bd req-1c9b30f8-4e02-47e9-a839-a81e61002290 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:24.843373 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ddd21609-0b0d-4764-a988-d33e39aa66bd req-1c9b30f8-4e02-47e9-a839-a81e61002290 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:24.852513 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0468e63e-6f50-4012-b642-824373c936cc admin admin] Router 88041dd4-3b62-47ec-ab19-cf438d19e15b has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:24:25.014720 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c9b30f8-4e02-47e9-a839-a81e61002290 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Pushing event updated for resources: {'Port': ['ID=40e3d6c1-bc8a-4078-b004-a7a4b144590d,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:25.040297 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36366) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:25.040854 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-ff4682d0-6954-45f3-935a-09ddc2b927bd req-7ff2d9f6-12d9-456b-9d0d-90bce85ad5fd tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Deleting port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:25.041277 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ff4682d0-6954-45f3-935a-09ddc2b927bd req-7ff2d9f6-12d9-456b-9d0d-90bce85ad5fd tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:25.047290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-868d3606-a823-4f72-a769-ed71374f1b47 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1398190605', 'description': 'tempest-description--883587351'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:25.084164 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ddd21609-0b0d-4764-a988-d33e39aa66bd req-1c9b30f8-4e02-47e9-a839-a81e61002290 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:25.101486 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-868d3606-a823-4f72-a769-ed71374f1b47 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:25.252210 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ddd21609-0b0d-4764-a988-d33e39aa66bd req-1c9b30f8-4e02-47e9-a839-a81e61002290 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:25.259376 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-868d3606-a823-4f72-a769-ed71374f1b47 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:25.264699 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ddd21609-0b0d-4764-a988-d33e39aa66bd req-1c9b30f8-4e02-47e9-a839-a81e61002290 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 697 time: 3.6607475 Dec 09 21:24:25.278394 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-868d3606-a823-4f72-a769-ed71374f1b47 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:25.283104 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0468e63e-6f50-4012-b642-824373c936cc admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:24:25.293360 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25d8a346-12a4-49b7-9bd9-822b8f9f6044 None None] Sync routers for ids ['88041dd4-3b62-47ec-ab19-cf438d19e15b'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:24:25.294881 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0468e63e-6f50-4012-b642-824373c936cc admin admin] 10.222.0.13 "PUT /v2.0/routers/88041dd4-3b62-47ec-ab19-cf438d19e15b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.5249097 Dec 09 21:24:25.303644 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36370) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:25.320559 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25d8a346-12a4-49b7-9bd9-822b8f9f6044 None None] Routers {'88041dd4-3b62-47ec-ab19-cf438d19e15b'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:24:25.321729 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-25d8a346-12a4-49b7-9bd9-822b8f9f6044 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['88041dd4-3b62-47ec-ab19-cf438d19e15b'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:25.379237 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-ff4682d0-6954-45f3-935a-09ddc2b927bd req-7ff2d9f6-12d9-456b-9d0d-90bce85ad5fd tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] For port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3,segment=NetworkSegment(8f944fa4-4b9c-4641-8eba-ea83e62520ce),segment_id=8f944fa4-4b9c-4641-8eba-ea83e62520ce)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:25.379942 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ff4682d0-6954-45f3-935a-09ddc2b927bd req-7ff2d9f6-12d9-456b-9d0d-90bce85ad5fd tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:25.385630 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ddd21609-0b0d-4764-a988-d33e39aa66bd req-0058d5fb-e704-42bd-90fd-9178e452b464 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.71 HTTP/1.1" status: 200 len: 695 time: 0.0987036 Dec 09 21:24:25.410016 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-ff4682d0-6954-45f3-935a-09ddc2b927bd req-7ff2d9f6-12d9-456b-9d0d-90bce85ad5fd tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Calling delete_port for ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:25.425232 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8f48a806-013e-480e-81ac-1a7f5f10c155', 'name': 'network-vif-deleted', 'tag': '4425d491-9b2e-48a2-8fb6-ead05da81dba'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:24:25.427553 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dfdad0d0-9754-4018-a058-60ca0dd6cf9f" -d '{"events": [{"server_uuid": "8f48a806-013e-480e-81ac-1a7f5f10c155", "name": "network-vif-deleted", "tag": "4425d491-9b2e-48a2-8fb6-ead05da81dba"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:24:25.465048 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-182c96f9-3cad-452d-9df2-bc9c7edf1ffa admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:25.469186 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-868d3606-a823-4f72-a769-ed71374f1b47 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:25.473631 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-868d3606-a823-4f72-a769-ed71374f1b47 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.4281430 Dec 09 21:24:25.476701 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36380) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:25.488051 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-2f3c9901-e7a9-4860-be0e-752997adbf4d tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Request body: {'security_group_rule': {'security_group_id': 'a70cef89-7037-4b4e-877a-dc5c63664110', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:25.545243 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-868d3606-a823-4f72-a769-ed71374f1b47 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a70cef89-7037-4b4e-877a-dc5c63664110,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:25.621292 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-25d8a346-12a4-49b7-9bd9-822b8f9f6044 None None] Set router 88041dd4-3b62-47ec-ab19-cf438d19e15b gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:24:25.651781 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-182c96f9-3cad-452d-9df2-bc9c7edf1ffa admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:25.730028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device afee0969-5b9e-4462-8043-47c41260d6aa up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:24:25.736101 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-182c96f9-3cad-452d-9df2-bc9c7edf1ffa admin admin] Deleting port 040a0b14-be1d-4499-a020-cb7c6ac7914f {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:25.736557 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-182c96f9-3cad-452d-9df2-bc9c7edf1ffa admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:25.842126 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port afee0969-5b9e-4462-8043-47c41260d6aa triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:25.842507 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:25.897769 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-25d8a346-12a4-49b7-9bd9-822b8f9f6044 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1528769429-router', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42'}], 'enable_snat': True}, 'gw_port_id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:23:17Z', 'updated_at': '2021-12-09T21:24:22Z', 'revision_number': 5, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'gw_port': {'id': '040a0b14-be1d-4499-a020-cb7c6ac7914f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:c0:45:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 704, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.42', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:23:18Z', 'updated_at': '2021-12-09T21:23:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:25.911717 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-182c96f9-3cad-452d-9df2-bc9c7edf1ffa admin admin] For port 040a0b14-be1d-4499-a020-cb7c6ac7914f, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=040a0b14-be1d-4499-a020-cb7c6ac7914f,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:25.913085 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-182c96f9-3cad-452d-9df2-bc9c7edf1ffa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:25.917684 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-2afcbff2-84fc-417d-a0b8-34d6a0478395 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=3329fed690514d85b98adeb6691d89f2&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1181118 Dec 09 21:24:25.925453 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ff4682d0-6954-45f3-935a-09ddc2b927bd req-7ff2d9f6-12d9-456b-9d0d-90bce85ad5fd tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:25.942156 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-182c96f9-3cad-452d-9df2-bc9c7edf1ffa admin admin] Calling delete_port for 040a0b14-be1d-4499-a020-cb7c6ac7914f owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:26.029946 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ff2d9f6-12d9-456b-9d0d-90bce85ad5fd tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Pushing event deleted for resources: {'Port': ['ID=ecb95cc0-98d6-4980-b73e-2bc2c2df48f3,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:26.051864 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f3c9901-e7a9-4860-be0e-752997adbf4d tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:26.065432 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddd21609-0b0d-4764-a988-d33e39aa66bd req-73abd280-c874-412c-addb-6ac7b6de4a30 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:26.066921 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ddd21609-0b0d-4764-a988-d33e39aa66bd req-73abd280-c874-412c-addb-6ac7b6de4a30 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.6718950 Dec 09 21:24:26.114401 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25d8a346-12a4-49b7-9bd9-822b8f9f6044 None None] Checking router: 88041dd4-3b62-47ec-ab19-cf438d19e15b for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:24:26.133741 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25d8a346-12a4-49b7-9bd9-822b8f9f6044 None None] Routers {'88041dd4-3b62-47ec-ab19-cf438d19e15b'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:24:26.135108 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-25d8a346-12a4-49b7-9bd9-822b8f9f6044 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['88041dd4-3b62-47ec-ab19-cf438d19e15b'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:26.207382 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-182c96f9-3cad-452d-9df2-bc9c7edf1ffa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:26.239347 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-182c96f9-3cad-452d-9df2-bc9c7edf1ffa admin admin] Pushing event deleted for resources: {'Port': ['ID=040a0b14-be1d-4499-a020-cb7c6ac7914f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:26.265448 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-25d8a346-12a4-49b7-9bd9-822b8f9f6044 None None] Set router 88041dd4-3b62-47ec-ab19-cf438d19e15b gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:24:26.286513 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-d2fd0930-35a7-437a-b5b3-ee6cfbc28e60 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:26.295282 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-d2fd0930-35a7-437a-b5b3-ee6cfbc28e60 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3678224 Dec 09 21:24:26.300759 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-ff4682d0-6954-45f3-935a-09ddc2b927bd req-7ff2d9f6-12d9-456b-9d0d-90bce85ad5fd tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] No DVR routers for this DVR port ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:24:26.304328 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ff4682d0-6954-45f3-935a-09ddc2b927bd req-7ff2d9f6-12d9-456b-9d0d-90bce85ad5fd tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:26.308319 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ff4682d0-6954-45f3-935a-09ddc2b927bd req-7ff2d9f6-12d9-456b-9d0d-90bce85ad5fd tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.10 "DELETE /v2.0/ports/ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 HTTP/1.1" status: 204 len: 173 time: 1.7540348 Dec 09 21:24:26.322246 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-25d8a346-12a4-49b7-9bd9-822b8f9f6044 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1528769429-router', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:23:17Z', 'updated_at': '2021-12-09T21:24:25Z', 'revision_number': 6, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:26.332750 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-2a4dc54f-b8d2-4e85-aaa8-f5a3c9601790 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/quotas/3329fed690514d85b98adeb6691d89f2 HTTP/1.1" status: 200 len: 375 time: 0.0363331 Dec 09 21:24:26.336635 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:24:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a8b3931c-1b3c-4520-a45e-086c0757254a x-openstack-request-id: req-a8b3931c-1b3c-4520-a45e-086c0757254a {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:24:26.336919 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8f48a806-013e-480e-81ac-1a7f5f10c155", "name": "network-vif-deleted", "tag": "4425d491-9b2e-48a2-8fb6-ead05da81dba", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:24:26.337168 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a8b3931c-1b3c-4520-a45e-086c0757254a {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:24:26.337686 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8f48a806-013e-480e-81ac-1a7f5f10c155', 'name': 'network-vif-deleted', 'tag': '4425d491-9b2e-48a2-8fb6-ead05da81dba', 'status': 'completed', 'code': 200} Dec 09 21:24:26.358865 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25d8a346-12a4-49b7-9bd9-822b8f9f6044 None None] The sync data for ids ['88041dd4-3b62-47ec-ab19-cf438d19e15b'] in n-d-713301-27 is: [{'id': '88041dd4-3b62-47ec-ab19-cf438d19e15b', 'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-1528769429-router', 'tenant_id': '768655d2ebd74340a90f65fc3007118f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:23:17Z', 'updated_at': '2021-12-09T21:24:25Z', 'revision_number': 6, 'project_id': '768655d2ebd74340a90f65fc3007118f', 'gw_port_host': None}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:24:26.384863 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-c495e52d-f429-4100-b1de-36695277fa3a tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=3329fed690514d85b98adeb6691d89f2&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0501058 Dec 09 21:24:26.402442 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-182c96f9-3cad-452d-9df2-bc9c7edf1ffa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:26.490663 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab956516-ec9b-45e3-8f0c-3cdb62159e79 req-f769e02c-b97a-4899-9570-3e7aa8a544c9 tempest-LiveMigrationTest-112193787 tempest-LiveMigrationTest-112193787-project] 10.222.0.13 "GET /v2.0/ports?device_id=0d277843-0a85-41b3-add1-0e319baac5d2 HTTP/1.1" status: 200 len: 210 time: 0.0876641 Dec 09 21:24:26.523942 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f3c9901-e7a9-4860-be0e-752997adbf4d tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:26.539161 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f3c9901-e7a9-4860-be0e-752997adbf4d tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:26.567413 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-182c96f9-3cad-452d-9df2-bc9c7edf1ffa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:26.570254 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-182c96f9-3cad-452d-9df2-bc9c7edf1ffa admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:26.648154 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-182c96f9-3cad-452d-9df2-bc9c7edf1ffa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:26.650094 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-182c96f9-3cad-452d-9df2-bc9c7edf1ffa admin admin] Fanout notify agent at l3_agent the message router_deleted on router 88041dd4-3b62-47ec-ab19-cf438d19e15b {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:24:26.665251 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-182c96f9-3cad-452d-9df2-bc9c7edf1ffa admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:26.669247 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-182c96f9-3cad-452d-9df2-bc9c7edf1ffa admin admin] 10.222.0.13 "DELETE /v2.0/routers/88041dd4-3b62-47ec-ab19-cf438d19e15b HTTP/1.1" status: 204 len: 168 time: 1.3407385 Dec 09 21:24:26.669555 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36406) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:26.729694 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-7cdbca92-00ec-4c93-a455-8b3677469050 admin admin] Deleting subnet 176a8001-d04b-4c22-9715-06327ff3546d {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:24:26.739254 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7cdbca92-00ec-4c93-a455-8b3677469050 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:26.871614 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7cdbca92-00ec-4c93-a455-8b3677469050 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:27.073267 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:27.082475 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7cdbca92-00ec-4c93-a455-8b3677469050 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:27.099410 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:27.183216 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7cdbca92-00ec-4c93-a455-8b3677469050 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:27.184178 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f2b7163e-28de-480e-8bde-365cc5058480 req-c2c7f13a-eaf7-4f84-9cd3-a89e696cdd26 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "GET /v2.0/floatingips/95d40a1f-4bb0-4c0b-a7ba-ddb48356f0a0 HTTP/1.1" status: 200 len: 692 time: 0.6549098 Dec 09 21:24:27.187688 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f3c9901-e7a9-4860-be0e-752997adbf4d tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f127dd94-ecc6-4549-ac4f-cc79ad221f2a,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:27.213383 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7cdbca92-00ec-4c93-a455-8b3677469050 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:27.218339 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7cdbca92-00ec-4c93-a455-8b3677469050 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/176a8001-d04b-4c22-9715-06327ff3546d HTTP/1.1" status: 204 len: 168 time: 0.5468044 Dec 09 21:24:27.223554 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36422) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:27.224865 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2245997c-925e-4e9c-99dc-018861027c81 None None] Network 9b3c0886-168c-4d9c-83a4-145e87393715 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:24:27.225124 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f3c9901-e7a9-4860-be0e-752997adbf4d tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:27.226595 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2f3c9901-e7a9-4860-be0e-752997adbf4d tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.7490690 Dec 09 21:24:27.230422 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36424) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:27.242387 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-0dfb8812-4744-42db-9b93-287b52f49098 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Request body: {'security_group_rule': {'security_group_id': 'a70cef89-7037-4b4e-877a-dc5c63664110', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:27.266692 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cdbca92-00ec-4c93-a455-8b3677469050 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=176a8001-d04b-4c22-9715-06327ff3546d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:27.387997 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42037d09-7891-4e58-97af-d60d6774f749 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:27.451151 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0dfb8812-4744-42db-9b93-287b52f49098 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:27.466616 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2b7163e-28de-480e-8bde-365cc5058480 req-a9747e58-4995-4a08-834c-22ec67bc327e tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:27.474664 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f2b7163e-28de-480e-8bde-365cc5058480 req-a9747e58-4995-4a08-834c-22ec67bc327e tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.2894752 Dec 09 21:24:27.512253 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-f2b7163e-28de-480e-8bde-365cc5058480 req-cf75b2ff-7e1a-4204-b72e-fb8a423749d8 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:24:27.513468 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f2b7163e-28de-480e-8bde-365cc5058480 req-cf75b2ff-7e1a-4204-b72e-fb8a423749d8 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0230849 Dec 09 21:24:27.526239 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:24:27.595923 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-525a528a-f7ae-4044-8ea9-ce46d723164f req-c4466885-046b-4a30-b111-fcb068bb932f tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:27.606550 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-525a528a-f7ae-4044-8ea9-ce46d723164f req-c4466885-046b-4a30-b111-fcb068bb932f tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/ports?device_id=a49420b5-3789-4863-bf0c-65a787f7fc78 HTTP/1.1" status: 200 len: 946 time: 0.2256293 Dec 09 21:24:27.613181 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ee70ee94-4c29-4350-aeaa-72d9b52bcb2a None None] DHCP port deletion for 9b3c0886-168c-4d9c-83a4-145e87393715 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:24:27.637754 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:24:27.638010 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device ecb95cc0-98d6-4980-b73e-2bc2c2df48f3 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:24:27.702009 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0dfb8812-4744-42db-9b93-287b52f49098 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:27.713852 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 040a0b14-be1d-4499-a020-cb7c6ac7914f no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:24:27.727483 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0dfb8812-4744-42db-9b93-287b52f49098 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:27.796126 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4607ad4-d73a-4ead-9d66-786703a7190c req-4b82ac1d-8623-40a7-b319-901d65a8b0ea tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/ports?device_id=9012a4aa-4a6a-4b44-b9a8-35264565fa33 HTTP/1.1" status: 200 len: 210 time: 0.0889430 Dec 09 21:24:27.884810 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-525a528a-f7ae-4044-8ea9-ce46d723164f req-3b949cff-ce41-476b-98f7-30e9689cfa09 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/security-groups?id=47b47381-681d-49da-8acd-4d26ea16fbc0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.2764957 Dec 09 21:24:27.899487 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dfb8812-4744-42db-9b93-287b52f49098 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=04beccc4-f76e-41fc-9518-a45bacbeed47,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:27.918826 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0dfb8812-4744-42db-9b93-287b52f49098 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:27.921239 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0dfb8812-4744-42db-9b93-287b52f49098 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.6888289 Dec 09 21:24:27.928325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36444) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:27.933898 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-da4e646e-e976-49be-8e25-d40a07155866 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:27.947698 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 040a0b14-be1d-4499-a020-cb7c6ac7914f {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:24:27.948051 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 040a0b14-be1d-4499-a020-cb7c6ac7914f not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:24:27.948461 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b707cd85-774f-4b55-8f13-4dfb4ce90ff5 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:24:27.979187 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36448) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:28.032247 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da4e646e-e976-49be-8e25-d40a07155866 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:28.054472 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-42037d09-7891-4e58-97af-d60d6774f749 admin admin] Deleting port b707cd85-774f-4b55-8f13-4dfb4ce90ff5 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:28.054819 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42037d09-7891-4e58-97af-d60d6774f749 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:28.065110 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ee70ee94-4c29-4350-aeaa-72d9b52bcb2a None None] Deleting port b707cd85-774f-4b55-8f13-4dfb4ce90ff5 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:28.065786 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ee70ee94-4c29-4350-aeaa-72d9b52bcb2a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:28.187587 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:28.191239 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-42037d09-7891-4e58-97af-d60d6774f749 admin admin] For port b707cd85-774f-4b55-8f13-4dfb4ce90ff5, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b707cd85-774f-4b55-8f13-4dfb4ce90ff5,segment=NetworkSegment(2d25d46c-e6fd-49a0-8d61-31fba8f6eefc),segment_id=2d25d46c-e6fd-49a0-8d61-31fba8f6eefc)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:28.191966 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42037d09-7891-4e58-97af-d60d6774f749 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:28.193206 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ee70ee94-4c29-4350-aeaa-72d9b52bcb2a None None] For port b707cd85-774f-4b55-8f13-4dfb4ce90ff5, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b707cd85-774f-4b55-8f13-4dfb4ce90ff5,segment=NetworkSegment(2d25d46c-e6fd-49a0-8d61-31fba8f6eefc),segment_id=2d25d46c-e6fd-49a0-8d61-31fba8f6eefc)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:28.193790 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ee70ee94-4c29-4350-aeaa-72d9b52bcb2a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:28.194015 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c1f4b1ca-8f34-4be5-92d6-c1470ff3c60a req-bda35f8d-39ff-41fa-8de6-54590e4f5270 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "GET /v2.0/floatingips?tenant_id=f3017ec6ec044e6ea364d4db8048d68d HTTP/1.1" status: 200 len: 695 time: 0.1907659 Dec 09 21:24:28.212658 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-42037d09-7891-4e58-97af-d60d6774f749 admin admin] Calling delete_port for b707cd85-774f-4b55-8f13-4dfb4ce90ff5 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:28.217435 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ee70ee94-4c29-4350-aeaa-72d9b52bcb2a None None] Calling delete_port for b707cd85-774f-4b55-8f13-4dfb4ce90ff5 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:28.281211 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port b707cd85-774f-4b55-8f13-4dfb4ce90ff5, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b707cd85-774f-4b55-8f13-4dfb4ce90ff5,segment=NetworkSegment(2d25d46c-e6fd-49a0-8d61-31fba8f6eefc),segment_id=2d25d46c-e6fd-49a0-8d61-31fba8f6eefc)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:28.292876 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:28.293894 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 047fd970-b4fd-4fa7-81e7-fba0167dbce6 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:24:28.331565 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 047fd970-b4fd-4fa7-81e7-fba0167dbce6 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:24:28.332677 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 047fd970-b4fd-4fa7-81e7-fba0167dbce6 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:24:28.333056 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-10f91cc1-4086-4d5f-b8a1-9a1d80bf7d99 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=3329fed690514d85b98adeb6691d89f2&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1333332 Dec 09 21:24:28.345331 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0d277843-0a85-41b3-add1-0e319baac5d2', 'name': 'network-vif-deleted', 'tag': 'ecb95cc0-98d6-4980-b73e-2bc2c2df48f3'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:24:28.345628 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42037d09-7891-4e58-97af-d60d6774f749 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:28.349676 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8406b404-3ac0-4755-9a85-db2c62acf948" -d '{"events": [{"server_uuid": "0d277843-0a85-41b3-add1-0e319baac5d2", "name": "network-vif-deleted", "tag": "ecb95cc0-98d6-4980-b73e-2bc2c2df48f3"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:24:28.361963 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-42037d09-7891-4e58-97af-d60d6774f749 admin admin] No DVR routers for this DVR port b707cd85-774f-4b55-8f13-4dfb4ce90ff5 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:24:28.410369 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=b707cd85-774f-4b55-8f13-4dfb4ce90ff5,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:28.422055 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ee70ee94-4c29-4350-aeaa-72d9b52bcb2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:28.423838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42037d09-7891-4e58-97af-d60d6774f749 admin admin] Pushing event deleted for resources: {'Port': ['ID=b707cd85-774f-4b55-8f13-4dfb4ce90ff5,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:28.459242 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee70ee94-4c29-4350-aeaa-72d9b52bcb2a None None] Pushing event deleted for resources: {'Port': ['ID=b707cd85-774f-4b55-8f13-4dfb4ce90ff5,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:28.467750 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee70ee94-4c29-4350-aeaa-72d9b52bcb2a None None] No DVR routers for this DVR port b707cd85-774f-4b55-8f13-4dfb4ce90ff5 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:24:28.511045 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42037d09-7891-4e58-97af-d60d6774f749 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:28.536248 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-42037d09-7891-4e58-97af-d60d6774f749 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9b3c0886-168c-4d9c-83a4-145e87393715']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:28.546966 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-42037d09-7891-4e58-97af-d60d6774f749 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2d25d46c-e6fd-49a0-8d61-31fba8f6eefc') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:28.547166 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-42037d09-7891-4e58-97af-d60d6774f749 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2d25d46c-e6fd-49a0-8d61-31fba8f6eefc') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:28.565198 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42037d09-7891-4e58-97af-d60d6774f749 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:28.580645 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42037d09-7891-4e58-97af-d60d6774f749 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:28.588553 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-42037d09-7891-4e58-97af-d60d6774f749 admin admin] Releasing vlan 139 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:24:28.589039 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42037d09-7891-4e58-97af-d60d6774f749 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:24:28.590981 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:24:28.679482 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-f2a69cce-07eb-481e-9631-ab480a6e0ec4 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:28.681233 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-f2a69cce-07eb-481e-9631-ab480a6e0ec4 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3220298 Dec 09 21:24:28.695479 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42037d09-7891-4e58-97af-d60d6774f749 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:28.702167 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42037d09-7891-4e58-97af-d60d6774f749 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:28.703559 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:24:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-362a9626-67d6-48ac-ab8b-e3a6cc8244d6 x-openstack-request-id: req-362a9626-67d6-48ac-ab8b-e3a6cc8244d6 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:24:28.704153 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0d277843-0a85-41b3-add1-0e319baac5d2", "name": "network-vif-deleted", "tag": "ecb95cc0-98d6-4980-b73e-2bc2c2df48f3", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:24:28.704153 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-362a9626-67d6-48ac-ab8b-e3a6cc8244d6 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:24:28.704939 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0d277843-0a85-41b3-add1-0e319baac5d2', 'name': 'network-vif-deleted', 'tag': 'ecb95cc0-98d6-4980-b73e-2bc2c2df48f3', 'status': 'completed', 'code': 200} Dec 09 21:24:28.707960 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-42037d09-7891-4e58-97af-d60d6774f749 admin admin] 10.222.0.13 "DELETE /v2.0/networks/9b3c0886-168c-4d9c-83a4-145e87393715 HTTP/1.1" status: 204 len: 168 time: 1.4539578 Dec 09 21:24:28.716808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-eae42eb6-c168-47c6-9d88-5419a314067f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Request body: {'port': {'device_id': '9012a4aa-4a6a-4b44-b9a8-35264565fa33', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '3329fed690514d85b98adeb6691d89f2'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:28.741679 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42037d09-7891-4e58-97af-d60d6774f749 admin admin] Pushing event deleted for resources: {'Network': ['ID=9b3c0886-168c-4d9c-83a4-145e87393715,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:28.890693 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-af6a2245-5472-4fa3-b574-70160f1627f3 admin admin] Deleting subnet eae2438b-9fcc-44ef-a172-6c4911cad13f {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:24:28.902417 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-af6a2245-5472-4fa3-b574-70160f1627f3 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:28.932300 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36492) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:28.997024 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1f4b1ca-8f34-4be5-92d6-c1470ff3c60a req-9c68168e-8cb8-4eb3-9bcb-de273eeeaced tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:29.004948 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c1f4b1ca-8f34-4be5-92d6-c1470ff3c60a req-9c68168e-8cb8-4eb3-9bcb-de273eeeaced tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "GET /v2.0/networks?id=97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 787 time: 0.8098707 Dec 09 21:24:29.014900 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-af6a2245-5472-4fa3-b574-70160f1627f3 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:29.028091 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36496) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:29.044568 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ac9a0a08-17fa-4da1-9480-150456bdfbca admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=768655d2ebd74340a90f65fc3007118f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1098018 Dec 09 21:24:29.046236 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36500) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:29.049885 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-c1f4b1ca-8f34-4be5-92d6-c1470ff3c60a req-e2950a0a-2ca5-4c58-881f-f0a82c345a3f tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:24:29.063204 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c1f4b1ca-8f34-4be5-92d6-c1470ff3c60a req-e2950a0a-2ca5-4c58-881f-f0a82c345a3f tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0572689 Dec 09 21:24:29.127096 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b3c98bc3-a97e-4c33-b46e-39ae1a133d0b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:29.149634 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-af6a2245-5472-4fa3-b574-70160f1627f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:29.173841 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b3c98bc3-a97e-4c33-b46e-39ae1a133d0b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:29.243757 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b3c98bc3-a97e-4c33-b46e-39ae1a133d0b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:29.247001 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b3c98bc3-a97e-4c33-b46e-39ae1a133d0b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:29.247151 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e99f2d1-8a43-460e-b05f-83299bf36bf7 req-8f2f3b90-27bb-4846-82a7-615d880e2cde tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/ports?device_id=9012a4aa-4a6a-4b44-b9a8-35264565fa33 HTTP/1.1" status: 200 len: 210 time: 0.1794984 Dec 09 21:24:29.248349 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b3c98bc3-a97e-4c33-b46e-39ae1a133d0b admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/502403b3-5851-499b-ae86-dd222b0f8aab HTTP/1.1" status: 204 len: 168 time: 0.2011786 Dec 09 21:24:29.258370 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3c98bc3-a97e-4c33-b46e-39ae1a133d0b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=502403b3-5851-499b-ae86-dd222b0f8aab,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:29.258521 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da4e646e-e976-49be-8e25-d40a07155866 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:29.260777 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-af6a2245-5472-4fa3-b574-70160f1627f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:29.344917 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c164c869-22f2-479a-b4ca-de2a25c8ce4f admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=06bbcbacf3914054b6d39114daad8f77&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3155472 Dec 09 21:24:29.345856 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36506) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:29.365201 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af6a2245-5472-4fa3-b574-70160f1627f3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=eae2438b-9fcc-44ef-a172-6c4911cad13f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:29.389841 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-af6a2245-5472-4fa3-b574-70160f1627f3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:29.396693 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-af6a2245-5472-4fa3-b574-70160f1627f3 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/eae2438b-9fcc-44ef-a172-6c4911cad13f HTTP/1.1" status: 204 len: 168 time: 1.4119902 Dec 09 21:24:29.406567 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36508) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:29.407654 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-994f2607-c7d8-4f95-96e8-32d5ef77c0d0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:29.421567 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-eae42eb6-c168-47c6-9d88-5419a314067f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Made reservation on behalf of 3329fed690514d85b98adeb6691d89f2 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:24:29.425193 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-eae42eb6-c168-47c6-9d88-5419a314067f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:29.464633 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-050bc44a-f2c6-4078-9354-e24dc2766ee7 req-f502b1b0-c82f-4cc5-abf1-c6f11adbdc68 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "GET /v2.0/floatingips/95d40a1f-4bb0-4c0b-a7ba-ddb48356f0a0 HTTP/1.1" status: 200 len: 692 time: 0.1329007 Dec 09 21:24:29.467942 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-994f2607-c7d8-4f95-96e8-32d5ef77c0d0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:29.505060 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-eae42eb6-c168-47c6-9d88-5419a314067f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:29.529705 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56d50a74-4da0-4c35-9586-75cf119088e9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:29.616019 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44bc2ea3-d95f-45fc-8603-077f463663e0 req-25b10575-35fa-4a5b-9d63-404ef1dc475c tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:29.624664 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44bc2ea3-d95f-45fc-8603-077f463663e0 req-25b10575-35fa-4a5b-9d63-404ef1dc475c tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/ports?device_id=a49420b5-3789-4863-bf0c-65a787f7fc78 HTTP/1.1" status: 200 len: 946 time: 0.4114511 Dec 09 21:24:29.626815 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-994f2607-c7d8-4f95-96e8-32d5ef77c0d0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:29.629950 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-994f2607-c7d8-4f95-96e8-32d5ef77c0d0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:29.634335 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-994f2607-c7d8-4f95-96e8-32d5ef77c0d0 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/24094cbf-e652-478e-bb06-edc8eb774ee3 HTTP/1.1" status: 204 len: 168 time: 0.2849751 Dec 09 21:24:29.647524 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-994f2607-c7d8-4f95-96e8-32d5ef77c0d0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=24094cbf-e652-478e-bb06-edc8eb774ee3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:29.705429 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56d50a74-4da0-4c35-9586-75cf119088e9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:29.728580 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-56d50a74-4da0-4c35-9586-75cf119088e9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['04fa749a-9f72-4a2c-a725-feab917f99ef']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:29.740585 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-56d50a74-4da0-4c35-9586-75cf119088e9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8f944fa4-4b9c-4641-8eba-ea83e62520ce') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:29.740943 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-56d50a74-4da0-4c35-9586-75cf119088e9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8f944fa4-4b9c-4641-8eba-ea83e62520ce') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:29.753509 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56d50a74-4da0-4c35-9586-75cf119088e9 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:29.773772 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56d50a74-4da0-4c35-9586-75cf119088e9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:29.790121 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-da4e646e-e976-49be-8e25-d40a07155866 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Allocated IP 172.25.3.250 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/a921ba4f-8ccd-4406-8858-6c571f296262) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:24:29.791054 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-56d50a74-4da0-4c35-9586-75cf119088e9 admin admin] Releasing vlan 138 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:24:29.791515 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56d50a74-4da0-4c35-9586-75cf119088e9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:29.814664 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-050bc44a-f2c6-4078-9354-e24dc2766ee7 req-a7d20163-e301-4416-86b6-390c8d0f79be tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:24:29.814839 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:24:29.825443 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-050bc44a-f2c6-4078-9354-e24dc2766ee7 req-a7d20163-e301-4416-86b6-390c8d0f79be tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.3502436 Dec 09 21:24:29.944939 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-eae42eb6-c168-47c6-9d88-5419a314067f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:29.949975 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56d50a74-4da0-4c35-9586-75cf119088e9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:29.986167 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56d50a74-4da0-4c35-9586-75cf119088e9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:29.995035 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-56d50a74-4da0-4c35-9586-75cf119088e9 admin admin] 10.222.0.13 "DELETE /v2.0/networks/04fa749a-9f72-4a2c-a725-feab917f99ef HTTP/1.1" status: 204 len: 168 time: 0.5822158 Dec 09 21:24:29.996058 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56d50a74-4da0-4c35-9586-75cf119088e9 admin admin] Pushing event deleted for resources: {'Network': ['ID=04fa749a-9f72-4a2c-a725-feab917f99ef,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:30.005706 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36530) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:30.079374 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da4e646e-e976-49be-8e25-d40a07155866 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:30.083803 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44bc2ea3-d95f-45fc-8603-077f463663e0 req-84366bcc-2ec3-4e07-a1a0-d6b6fbe41036 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/security-groups?id=47b47381-681d-49da-8acd-4d26ea16fbc0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.4582675 Dec 09 21:24:30.099639 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-eae42eb6-c168-47c6-9d88-5419a314067f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:30.113561 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-a8dc62e2-95b7-40ca-b34d-fd90667344c3 admin admin] Deleting subnet d6ed3c41-a3b8-44b3-8276-7d8de4956a93 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:24:30.117733 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8dc62e2-95b7-40ca-b34d-fd90667344c3 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:30.166856 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8dc62e2-95b7-40ca-b34d-fd90667344c3 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:30.214812 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8dc62e2-95b7-40ca-b34d-fd90667344c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:30.214954 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-050bc44a-f2c6-4078-9354-e24dc2766ee7 req-8030b69f-0a88-4788-b1e5-84263af40c75 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.71 HTTP/1.1" status: 200 len: 695 time: 0.3883729 Dec 09 21:24:30.274948 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8dc62e2-95b7-40ca-b34d-fd90667344c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:30.330501 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36550) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:30.339326 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8dc62e2-95b7-40ca-b34d-fd90667344c3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d6ed3c41-a3b8-44b3-8276-7d8de4956a93,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:30.357651 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8dc62e2-95b7-40ca-b34d-fd90667344c3 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:30.363716 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a8dc62e2-95b7-40ca-b34d-fd90667344c3 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/d6ed3c41-a3b8-44b3-8276-7d8de4956a93 HTTP/1.1" status: 204 len: 168 time: 0.3538346 Dec 09 21:24:30.364461 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36556) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:30.424467 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-050bc44a-f2c6-4078-9354-e24dc2766ee7 req-ee5e1380-ad53-472d-9f1e-492be8313691 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.71 HTTP/1.1" status: 200 len: 695 time: 0.2087085 Dec 09 21:24:30.450858 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eae42eb6-c168-47c6-9d88-5419a314067f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Pushing event updated for resources: {'SecurityGroup': ['ID=50885dec-ee01-4c11-bc49-430c219f37b2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:30.483046 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9743279e-1dd1-43d3-8fa2-ecf1947e3e9e req-5aab3805-af4b-43ce-9c04-fcd48b49b8a7 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/ports?device_id=9012a4aa-4a6a-4b44-b9a8-35264565fa33 HTTP/1.1" status: 200 len: 210 time: 0.0912118 Dec 09 21:24:30.501402 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f9176ef9-915f-464d-8551-eafe49de6cc1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:30.537604 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da4e646e-e976-49be-8e25-d40a07155866 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:30.543238 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-eae42eb6-c168-47c6-9d88-5419a314067f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Allocated IP 192.168.233.161 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/f53b5ffa-c2e5-4ee2-84c4-f0439be955b2) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:24:30.587944 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ae7f75d8-66fc-466f-8d42-9299d97ffb72 admin admin] Request body: {'network': {'name': 'tempest-FloatingIPDetailsTestJSON-407064217-network', 'tenant_id': 'df9831f9ad4847c8afaf37f22e8d18a9'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:30.641908 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da4e646e-e976-49be-8e25-d40a07155866 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:30.681057 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f9176ef9-915f-464d-8551-eafe49de6cc1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:30.702774 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ae7f75d8-66fc-466f-8d42-9299d97ffb72 admin admin] Made reservation on behalf of df9831f9ad4847c8afaf37f22e8d18a9 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:24:30.705730 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae7f75d8-66fc-466f-8d42-9299d97ffb72 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:30.710746 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-f9176ef9-915f-464d-8551-eafe49de6cc1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['52073bfa-9dac-4974-a609-004d90980633']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:30.714622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-da4e646e-e976-49be-8e25-d40a07155866 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:30.720264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da4e646e-e976-49be-8e25-d40a07155866 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:24:30.723667 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36566) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:30.726057 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da4e646e-e976-49be-8e25-d40a07155866 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Pushing event updated for resources: {'Port': ['ID=a921ba4f-8ccd-4406-8858-6c571f296262,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:30.732839 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae7f75d8-66fc-466f-8d42-9299d97ffb72 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:30.754692 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-f9176ef9-915f-464d-8551-eafe49de6cc1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b5734691-66f6-4b4b-a586-41f19d3e0ac6') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:30.755026 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-f9176ef9-915f-464d-8551-eafe49de6cc1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b5734691-66f6-4b4b-a586-41f19d3e0ac6') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:30.794798 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f9176ef9-915f-464d-8551-eafe49de6cc1 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:30.836480 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f9176ef9-915f-464d-8551-eafe49de6cc1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:30.854238 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f9176ef9-915f-464d-8551-eafe49de6cc1 admin admin] Releasing vlan 125 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:24:30.854761 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f9176ef9-915f-464d-8551-eafe49de6cc1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:24:30.860296 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:24:30.923906 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2eee5f94-68b5-43df-b563-22826f8483b3 admin admin] Request body: {'network': {'name': 'tempest-ServersTestFqdnHostnames-1853275289-network', 'tenant_id': 'dd631239105645b6b7088738a5229b7f'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:30.924910 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-050bc44a-f2c6-4078-9354-e24dc2766ee7 req-bc7d283c-3f83-4d72-8eed-c635cc27cf52 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Deleting port 40e3d6c1-bc8a-4078-b004-a7a4b144590d {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:30.925286 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-050bc44a-f2c6-4078-9354-e24dc2766ee7 req-bc7d283c-3f83-4d72-8eed-c635cc27cf52 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:30.995106 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f9176ef9-915f-464d-8551-eafe49de6cc1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:30.996710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2eee5f94-68b5-43df-b563-22826f8483b3 admin admin] Made reservation on behalf of dd631239105645b6b7088738a5229b7f for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:24:30.998925 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2eee5f94-68b5-43df-b563-22826f8483b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.002253 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da4e646e-e976-49be-8e25-d40a07155866 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.022612 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f9176ef9-915f-464d-8551-eafe49de6cc1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.025919 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f9176ef9-915f-464d-8551-eafe49de6cc1 admin admin] 10.222.0.13 "DELETE /v2.0/networks/52073bfa-9dac-4974-a609-004d90980633 HTTP/1.1" status: 204 len: 168 time: 0.6534784 Dec 09 21:24:31.034367 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9176ef9-915f-464d-8551-eafe49de6cc1 admin admin] Pushing event deleted for resources: {'Network': ['ID=52073bfa-9dac-4974-a609-004d90980633,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:31.037696 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae7f75d8-66fc-466f-8d42-9299d97ffb72 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.038664 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2eee5f94-68b5-43df-b563-22826f8483b3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.044268 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ac201df-d0ce-4684-9110-40c9593ee5ea req-c30305fe-db55-4949-9141-2107eece92ee tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:31.045877 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ac201df-d0ce-4684-9110-40c9593ee5ea req-c30305fe-db55-4949-9141-2107eece92ee tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/ports?device_id=a49420b5-3789-4863-bf0c-65a787f7fc78 HTTP/1.1" status: 200 len: 946 time: 0.2180619 Dec 09 21:24:31.051470 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae7f75d8-66fc-466f-8d42-9299d97ffb72 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.082975 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ae7f75d8-66fc-466f-8d42-9299d97ffb72 admin admin] vlan segment allocate from pool success with {'vlan_id': 122, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:24:31.101139 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-eae42eb6-c168-47c6-9d88-5419a314067f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.104922 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae7f75d8-66fc-466f-8d42-9299d97ffb72 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1e19db3b-b607-448e-bd9c-c7f8c4afe5f1,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:31.113316 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae7f75d8-66fc-466f-8d42-9299d97ffb72 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.113693 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-ae7f75d8-66fc-466f-8d42-9299d97ffb72 admin admin] Added segment 7cdf46cd-1cf9-47c2-bde8-571e75cabe6a of type vlan for network 31f694ab-9ca7-4e6a-a3ee-21a21efff365 Dec 09 21:24:31.131669 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-050bc44a-f2c6-4078-9354-e24dc2766ee7 req-bc7d283c-3f83-4d72-8eed-c635cc27cf52 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.131994 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-050bc44a-f2c6-4078-9354-e24dc2766ee7 req-bc7d283c-3f83-4d72-8eed-c635cc27cf52 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.134479 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da4e646e-e976-49be-8e25-d40a07155866 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.167023 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae7f75d8-66fc-466f-8d42-9299d97ffb72 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.177147 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-050bc44a-f2c6-4078-9354-e24dc2766ee7 req-bc7d283c-3f83-4d72-8eed-c635cc27cf52 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Calling delete_port for 40e3d6c1-bc8a-4078-b004-a7a4b144590d owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:31.189858 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36576) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:31.224156 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2eee5f94-68b5-43df-b563-22826f8483b3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.230570 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2eee5f94-68b5-43df-b563-22826f8483b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.233588 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ac201df-d0ce-4684-9110-40c9593ee5ea req-75e3d946-ed78-4b7c-8e0f-c5816f6e1990 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/security-groups?id=47b47381-681d-49da-8acd-4d26ea16fbc0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1745317 Dec 09 21:24:31.244142 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae7f75d8-66fc-466f-8d42-9299d97ffb72 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.245182 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae7f75d8-66fc-466f-8d42-9299d97ffb72 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:31.245712 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae7f75d8-66fc-466f-8d42-9299d97ffb72 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.282866 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2eee5f94-68b5-43df-b563-22826f8483b3 admin admin] vlan segment allocate from pool success with {'vlan_id': 109, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:24:31.300222 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-eae42eb6-c168-47c6-9d88-5419a314067f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.320255 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ae7f75d8-66fc-466f-8d42-9299d97ffb72 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.9894507 Dec 09 21:24:31.325076 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-75b11ebf-12d2-474a-ab8f-1a1c9c7e367c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ac5b7cefd8cc48cc83f38d3923aae132&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1318376 Dec 09 21:24:31.326192 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36578) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:31.326521 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36580) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:31.329814 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2eee5f94-68b5-43df-b563-22826f8483b3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eb498b70-4d2c-4ede-b27d-8f7d694bece9,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:31.335119 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b51b38dc-51d8-413f-a8e9-bb2c99729630 admin admin] Request body: {'subnet': {'network_id': '31f694ab-9ca7-4e6a-a3ee-21a21efff365', 'cidr': '172.20.0.0/28', 'name': 'tempest-FloatingIPDetailsTestJSON-407064217-subnet', 'tenant_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:31.341388 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2eee5f94-68b5-43df-b563-22826f8483b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.341744 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-2eee5f94-68b5-43df-b563-22826f8483b3 admin admin] Added segment 51116481-b9d7-45e1-bfed-86b419caae01 of type vlan for network ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c Dec 09 21:24:31.389036 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae7f75d8-66fc-466f-8d42-9299d97ffb72 admin admin] Pushing event updated for resources: {'Network': ['ID=31f694ab-9ca7-4e6a-a3ee-21a21efff365,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:31.399022 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-eae42eb6-c168-47c6-9d88-5419a314067f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:31.401949 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 31f694ab-9ca7-4e6a-a3ee-21a21efff365 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:24:31.410369 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-eae42eb6-c168-47c6-9d88-5419a314067f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:31.415942 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-eae42eb6-c168-47c6-9d88-5419a314067f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:24:31.421770 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eae42eb6-c168-47c6-9d88-5419a314067f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Pushing event updated for resources: {'Port': ['ID=f53b5ffa-c2e5-4ee2-84c4-f0439be955b2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:31.448830 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2eee5f94-68b5-43df-b563-22826f8483b3 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.474736 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b51b38dc-51d8-413f-a8e9-bb2c99729630 admin admin] Made reservation on behalf of df9831f9ad4847c8afaf37f22e8d18a9 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:24:31.477559 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b51b38dc-51d8-413f-a8e9-bb2c99729630 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.518685 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-acc271c0-cb9b-40b1-adab-32f9140e2517 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.556707 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2eee5f94-68b5-43df-b563-22826f8483b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.557676 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2eee5f94-68b5-43df-b563-22826f8483b3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:31.558265 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2eee5f94-68b5-43df-b563-22826f8483b3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.581587 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-eae42eb6-c168-47c6-9d88-5419a314067f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:31.582241 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-eae42eb6-c168-47c6-9d88-5419a314067f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.591224 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da4e646e-e976-49be-8e25-d40a07155866 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.592708 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-050bc44a-f2c6-4078-9354-e24dc2766ee7 req-bc7d283c-3f83-4d72-8eed-c635cc27cf52 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.610411 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-acc271c0-cb9b-40b1-adab-32f9140e2517 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.636993 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2eee5f94-68b5-43df-b563-22826f8483b3 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.9122052 Dec 09 21:24:31.641667 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36586) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:31.645977 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da4e646e-e976-49be-8e25-d40a07155866 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.670392 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-eae42eb6-c168-47c6-9d88-5419a314067f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.9686518 Dec 09 21:24:31.678228 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-7d54f45f-fbbb-43d7-b46f-a37c883c91a8 admin admin] Request body: {'subnet': {'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestFqdnHostnames-1853275289-subnet', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:31.681866 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7d283c-3f83-4d72-8eed-c635cc27cf52 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Pushing event deleted for resources: {'Port': ['ID=40e3d6c1-bc8a-4078-b004-a7a4b144590d,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:31.705142 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2eee5f94-68b5-43df-b563-22826f8483b3 admin admin] Pushing event updated for resources: {'Network': ['ID=ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:31.705508 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-9ddcd6b0-4d14-40ec-87e1-b38a13816f50 service neutron] Request body: {'port': {'device_id': '9012a4aa-4a6a-4b44-b9a8-35264565fa33', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:31.716242 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:24:31.755185 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7d54f45f-fbbb-43d7-b46f-a37c883c91a8 admin admin] Made reservation on behalf of dd631239105645b6b7088738a5229b7f for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:24:31.757649 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7d54f45f-fbbb-43d7-b46f-a37c883c91a8 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.799754 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-acc271c0-cb9b-40b1-adab-32f9140e2517 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.802375 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-acc271c0-cb9b-40b1-adab-32f9140e2517 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.805369 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-acc271c0-cb9b-40b1-adab-32f9140e2517 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/6091baef-c025-46e8-8fcd-f3a6a8cc904a HTTP/1.1" status: 204 len: 168 time: 0.4749572 Dec 09 21:24:31.806788 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-db362757-31a9-4fd0-b928-6d5d330a3184 None None] Provisioning complete for port f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:31.807273 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-db362757-31a9-4fd0-b928-6d5d330a3184 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.843698 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-db362757-31a9-4fd0-b928-6d5d330a3184 None None] Port f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:24:31.877701 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acc271c0-cb9b-40b1-adab-32f9140e2517 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6091baef-c025-46e8-8fcd-f3a6a8cc904a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:31.897202 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f69f28a-42f2-451a-9287-52d18e8facdd req-21e8ec76-5023-4772-a578-cbe17f7f13c6 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:31.900506 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f69f28a-42f2-451a-9287-52d18e8facdd req-21e8ec76-5023-4772-a578-cbe17f7f13c6 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/ports?device_id=9012a4aa-4a6a-4b44-b9a8-35264565fa33 HTTP/1.1" status: 200 len: 936 time: 0.3153834 Dec 09 21:24:31.905444 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b51b38dc-51d8-413f-a8e9-bb2c99729630 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.937234 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-050bc44a-f2c6-4078-9354-e24dc2766ee7 req-bc7d283c-3f83-4d72-8eed-c635cc27cf52 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.941214 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-050bc44a-f2c6-4078-9354-e24dc2766ee7 req-bc7d283c-3f83-4d72-8eed-c635cc27cf52 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:31.942444 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-050bc44a-f2c6-4078-9354-e24dc2766ee7 req-bc7d283c-3f83-4d72-8eed-c635cc27cf52 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "DELETE /v2.0/floatingips/95d40a1f-4bb0-4c0b-a7ba-ddb48356f0a0 HTTP/1.1" status: 204 len: 173 time: 1.5015695 Dec 09 21:24:31.954175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da4e646e-e976-49be-8e25-d40a07155866 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Pushing event updated for resources: {'Port': ['ID=a921ba4f-8ccd-4406-8858-6c571f296262,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:31.957592 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da4e646e-e976-49be-8e25-d40a07155866 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:32.009993 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-9ddcd6b0-4d14-40ec-87e1-b38a13816f50 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:32.057420 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b51b38dc-51d8-413f-a8e9-bb2c99729630 admin admin] Pushing event updated for resources: {'Subnet': ['ID=9a606ad9-369f-4ab7-a435-14aa18212259,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:32.081752 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b51b38dc-51d8-413f-a8e9-bb2c99729630 admin admin] Checking segment: {'id': '7cdf46cd-1cf9-47c2-bde8-571e75cabe6a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '31f694ab-9ca7-4e6a-a3ee-21a21efff365'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:24:32.082174 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b51b38dc-51d8-413f-a8e9-bb2c99729630 admin admin] Network hostable DHCP agents. Network: 31f694ab-9ca7-4e6a-a3ee-21a21efff365, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:24:32.093715 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7d54f45f-fbbb-43d7-b46f-a37c883c91a8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:32.128841 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b51b38dc-51d8-413f-a8e9-bb2c99729630 admin admin] Network 31f694ab-9ca7-4e6a-a3ee-21a21efff365 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:24:32.159462 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-b51b38dc-51d8-413f-a8e9-bb2c99729630 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 31f694ab-9ca7-4e6a-a3ee-21a21efff365) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:32.167786 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d54f45f-fbbb-43d7-b46f-a37c883c91a8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=9125b460-598b-4793-bfb4-08b07155042a,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:32.168028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f3c2ea18-55ff-476a-924c-b74feb23ee20 None None] Network 31f694ab-9ca7-4e6a-a3ee-21a21efff365 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:24:32.172234 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b51b38dc-51d8-413f-a8e9-bb2c99729630 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:32.172867 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b51b38dc-51d8-413f-a8e9-bb2c99729630 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:32.188243 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d54f45f-fbbb-43d7-b46f-a37c883c91a8 admin admin] Checking segment: {'id': '51116481-b9d7-45e1-bfed-86b419caae01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:24:32.188515 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d54f45f-fbbb-43d7-b46f-a37c883c91a8 admin admin] Network hostable DHCP agents. Network: ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:24:32.207652 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b51b38dc-51d8-413f-a8e9-bb2c99729630 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.8774111 Dec 09 21:24:32.208462 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36596) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:32.221433 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-c72cf0b8-ffd1-43a6-a30c-5606230f5ecf admin admin] Request body: {'router': {'name': 'tempest-FloatingIPDetailsTestJSON-407064217-router', 'tenant_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:32.252927 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d54f45f-fbbb-43d7-b46f-a37c883c91a8 admin admin] Network ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:24:32.282704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-7d54f45f-fbbb-43d7-b46f-a37c883c91a8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:32.292345 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7d54f45f-fbbb-43d7-b46f-a37c883c91a8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:32.293100 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7d54f45f-fbbb-43d7-b46f-a37c883c91a8 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:32.298721 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c72cf0b8-ffd1-43a6-a30c-5606230f5ecf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:32.299726 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c72cf0b8-ffd1-43a6-a30c-5606230f5ecf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:32.303727 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e7af0619-a1c3-4e9a-8c10-ee2d533e973e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-31f694ab-9ca7-4e6a-a3ee-21a21efff365', 'network_id': '31f694ab-9ca7-4e6a-a3ee-21a21efff365', 'project_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'fixed_ips': [{'subnet_id': '9a606ad9-369f-4ab7-a435-14aa18212259'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:24:32.304775 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e7af0619-a1c3-4e9a-8c10-ee2d533e973e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:32.326263 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7d54f45f-fbbb-43d7-b46f-a37c883c91a8 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.6813018 Dec 09 21:24:32.330470 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3afc3e98-7a72-4006-9b52-945d3f16f130 None None] Network ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:24:32.336655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36600) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:32.337017 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36602) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:32.344901 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a04d049e-8737-457c-9899-17fa3b9bbda7 admin admin] Request body: {'router': {'name': 'tempest-ServersTestFqdnHostnames-1853275289-router', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:32.399211 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c72cf0b8-ffd1-43a6-a30c-5606230f5ecf admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:32.409012 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da4e646e-e976-49be-8e25-d40a07155866 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:32.410415 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-da4e646e-e976-49be-8e25-d40a07155866 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 4.4805458 Dec 09 21:24:32.464315 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-be33a21f-bf1d-4bd2-b83a-1b1b181a7819 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=09cced989021427a89fdd2d3c31740b1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1225519 Dec 09 21:24:32.493714 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36606) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:32.524002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd105463-33ce-4980-9918-148339a71b30 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c', 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c', 'project_id': 'dd631239105645b6b7088738a5229b7f', 'fixed_ips': [{'subnet_id': '9125b460-598b-4793-bfb4-08b07155042a'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:24:32.524898 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cd105463-33ce-4980-9918-148339a71b30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:32.536176 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f69f28a-42f2-451a-9287-52d18e8facdd req-8accd9af-cf8f-4d3b-920b-5c33eeaa303b tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/security-groups?id=50885dec-ee01-4c11-bc49-430c219f37b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6046805 Dec 09 21:24:32.568729 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-e7af0619-a1c3-4e9a-8c10-ee2d533e973e None None] Allocated IP 172.20.0.2 (31f694ab-9ca7-4e6a-a3ee-21a21efff365/9a606ad9-369f-4ab7-a435-14aa18212259/fe58d238-e077-4ba7-a721-ae6bf5d3b9ae) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:24:32.595109 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a04d049e-8737-457c-9899-17fa3b9bbda7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:32.597198 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a04d049e-8737-457c-9899-17fa3b9bbda7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:32.598219 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d951c5a0-8332-4cae-8f0a-d6048ce0d657 req-dd4cffd3-d7c5-4f30-b7d4-fe4f01b14dcf tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 0.6042733 Dec 09 21:24:32.632751 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-d951c5a0-8332-4cae-8f0a-d6048ce0d657 req-07f76e6a-7d02-41ae-8eeb-2ebeb4e4d2ef tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:32.703278 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a04d049e-8737-457c-9899-17fa3b9bbda7 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:32.729722 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-318ac043-7546-46c4-b38f-3a1d7c87c01b req-1c0d675e-f3c2-4d40-9006-103617698c0e tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:32.731185 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-318ac043-7546-46c4-b38f-3a1d7c87c01b req-1c0d675e-f3c2-4d40-9006-103617698c0e tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.10 "GET /v2.0/ports?device_id=a49420b5-3789-4863-bf0c-65a787f7fc78 HTTP/1.1" status: 200 len: 946 time: 0.3433592 Dec 09 21:24:32.738689 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c72cf0b8-ffd1-43a6-a30c-5606230f5ecf admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:32.773857 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e7af0619-a1c3-4e9a-8c10-ee2d533e973e None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:32.786283 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e7af0619-a1c3-4e9a-8c10-ee2d533e973e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:32.806100 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-26c28af5-ff41-4155-ad44-6c5be61c0b84 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:32.838822 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d951c5a0-8332-4cae-8f0a-d6048ce0d657 req-07f76e6a-7d02-41ae-8eeb-2ebeb4e4d2ef tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:32.860093 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7af0619-a1c3-4e9a-8c10-ee2d533e973e None None] Network 31f694ab-9ca7-4e6a-a3ee-21a21efff365 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:32.868383 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-e7af0619-a1c3-4e9a-8c10-ee2d533e973e None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:32.874412 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7af0619-a1c3-4e9a-8c10-ee2d533e973e None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:24:32.881844 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7af0619-a1c3-4e9a-8c10-ee2d533e973e None None] Pushing event updated for resources: {'Port': ['ID=fe58d238-e077-4ba7-a721-ae6bf5d3b9ae,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:32.887092 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a04d049e-8737-457c-9899-17fa3b9bbda7 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:32.889175 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-cd105463-33ce-4980-9918-148339a71b30 None None] Allocated IP 172.20.0.2 (ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c/9125b460-598b-4793-bfb4-08b07155042a/4223f93e-2b4f-4613-877b-54f472a974d6) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:24:32.913149 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea9838ad-35da-4509-a46d-297a353e65ba req-7b072202-afed-4476-b8d4-f958c1386174 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:32.914727 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea9838ad-35da-4509-a46d-297a353e65ba req-7b072202-afed-4476-b8d4-f958c1386174 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/ports?device_id=a49420b5-3789-4863-bf0c-65a787f7fc78 HTTP/1.1" status: 200 len: 946 time: 0.2940936 Dec 09 21:24:32.939936 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-26c28af5-ff41-4155-ad44-6c5be61c0b84 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:32.980172 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e7af0619-a1c3-4e9a-8c10-ee2d533e973e None None] Attempting to bind port fe58d238-e077-4ba7-a721-ae6bf5d3b9ae on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:24:32.981148 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e7af0619-a1c3-4e9a-8c10-ee2d533e973e None None] Attempting to bind port fe58d238-e077-4ba7-a721-ae6bf5d3b9ae by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '7cdf46cd-1cf9-47c2-bde8-571e75cabe6a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '31f694ab-9ca7-4e6a-a3ee-21a21efff365'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:24:32.982129 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7af0619-a1c3-4e9a-8c10-ee2d533e973e None None] Attempting to bind port fe58d238-e077-4ba7-a721-ae6bf5d3b9ae on network 31f694ab-9ca7-4e6a-a3ee-21a21efff365 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:24:32.989164 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c9fe18bc-b5c0-4488-8ad9-940bf485490e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:32.997929 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7af0619-a1c3-4e9a-8c10-ee2d533e973e None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 24, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:24:32.998618 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7af0619-a1c3-4e9a-8c10-ee2d533e973e None None] Checking segment: {'id': '7cdf46cd-1cf9-47c2-bde8-571e75cabe6a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '31f694ab-9ca7-4e6a-a3ee-21a21efff365'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:24:32.999187 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e7af0619-a1c3-4e9a-8c10-ee2d533e973e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:32.999783 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7af0619-a1c3-4e9a-8c10-ee2d533e973e None None] Bound using segment: {'id': '7cdf46cd-1cf9-47c2-bde8-571e75cabe6a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '31f694ab-9ca7-4e6a-a3ee-21a21efff365'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:24:33.000502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e7af0619-a1c3-4e9a-8c10-ee2d533e973e None None] Bound port: fe58d238-e077-4ba7-a721-ae6bf5d3b9ae, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7cdf46cd-1cf9-47c2-bde8-571e75cabe6a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '31f694ab-9ca7-4e6a-a3ee-21a21efff365'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:24:33.001060 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e7af0619-a1c3-4e9a-8c10-ee2d533e973e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:33.121036 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e7af0619-a1c3-4e9a-8c10-ee2d533e973e None None] For port fe58d238-e077-4ba7-a721-ae6bf5d3b9ae, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:24:33.130274 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e7af0619-a1c3-4e9a-8c10-ee2d533e973e None None] For port fe58d238-e077-4ba7-a721-ae6bf5d3b9ae, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=fe58d238-e077-4ba7-a721-ae6bf5d3b9ae,segment=NetworkSegment(7cdf46cd-1cf9-47c2-bde8-571e75cabe6a),segment_id=7cdf46cd-1cf9-47c2-bde8-571e75cabe6a)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:24:33.132946 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c72cf0b8-ffd1-43a6-a30c-5606230f5ecf admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:33.155625 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c72cf0b8-ffd1-43a6-a30c-5606230f5ecf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:33.160657 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea9838ad-35da-4509-a46d-297a353e65ba req-9f91aab3-171f-4abd-90db-1b73588ec5dc tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/security-groups?id=47b47381-681d-49da-8acd-4d26ea16fbc0&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.2119200 Dec 09 21:24:33.161723 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e7af0619-a1c3-4e9a-8c10-ee2d533e973e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:33.174637 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-26c28af5-ff41-4155-ad44-6c5be61c0b84 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:33.177343 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-26c28af5-ff41-4155-ad44-6c5be61c0b84 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:33.178496 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-26c28af5-ff41-4155-ad44-6c5be61c0b84 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/93693cad-b812-4fa5-8eba-d6aea76820ed HTTP/1.1" status: 204 len: 168 time: 0.6798780 Dec 09 21:24:33.180877 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-318ac043-7546-46c4-b38f-3a1d7c87c01b req-4a2f41fe-38c8-4e23-a1fe-19c7635931be tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Deleting port 54e32685-83f3-47e4-883f-d0d7b2a9e798 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:33.181198 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-318ac043-7546-46c4-b38f-3a1d7c87c01b req-4a2f41fe-38c8-4e23-a1fe-19c7635931be tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:33.245595 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26c28af5-ff41-4155-ad44-6c5be61c0b84 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=93693cad-b812-4fa5-8eba-d6aea76820ed,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:33.318432 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26c28af5-ff41-4155-ad44-6c5be61c0b84 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:33.318780 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26c28af5-ff41-4155-ad44-6c5be61c0b84 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:33.319115 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26c28af5-ff41-4155-ad44-6c5be61c0b84 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:33.319477 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26c28af5-ff41-4155-ad44-6c5be61c0b84 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:33.319797 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26c28af5-ff41-4155-ad44-6c5be61c0b84 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:33.320128 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26c28af5-ff41-4155-ad44-6c5be61c0b84 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:33.320500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26c28af5-ff41-4155-ad44-6c5be61c0b84 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:33.320825 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26c28af5-ff41-4155-ad44-6c5be61c0b84 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:33.321622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26c28af5-ff41-4155-ad44-6c5be61c0b84 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:33.321622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26c28af5-ff41-4155-ad44-6c5be61c0b84 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:33.321813 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26c28af5-ff41-4155-ad44-6c5be61c0b84 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:33.322135 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26c28af5-ff41-4155-ad44-6c5be61c0b84 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:33.322430 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-26c28af5-ff41-4155-ad44-6c5be61c0b84 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:33.335513 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cd105463-33ce-4980-9918-148339a71b30 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:33.361474 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-9ddcd6b0-4d14-40ec-87e1-b38a13816f50 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:24:33.382753 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-9ddcd6b0-4d14-40ec-87e1-b38a13816f50 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:33.397982 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d951c5a0-8332-4cae-8f0a-d6048ce0d657 req-07f76e6a-7d02-41ae-8eeb-2ebeb4e4d2ef tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:33.399098 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7af0619-a1c3-4e9a-8c10-ee2d533e973e None None] Pushing event updated for resources: {'Port': ['ID=fe58d238-e077-4ba7-a721-ae6bf5d3b9ae,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:33.418729 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cd105463-33ce-4980-9918-148339a71b30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:33.487293 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cd105463-33ce-4980-9918-148339a71b30 None None] Network ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:33.487849 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-9ddcd6b0-4d14-40ec-87e1-b38a13816f50 service neutron] Transition to ACTIVE for port object f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:24:33.492862 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-cd105463-33ce-4980-9918-148339a71b30 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:33.494249 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-318ac043-7546-46c4-b38f-3a1d7c87c01b req-4a2f41fe-38c8-4e23-a1fe-19c7635931be tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] For port 54e32685-83f3-47e4-883f-d0d7b2a9e798, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=54e32685-83f3-47e4-883f-d0d7b2a9e798,segment=NetworkSegment(e74944d5-8114-4627-bc98-88385d8b16f0),segment_id=e74944d5-8114-4627-bc98-88385d8b16f0)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:33.494769 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-318ac043-7546-46c4-b38f-3a1d7c87c01b req-4a2f41fe-38c8-4e23-a1fe-19c7635931be tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:33.503038 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd105463-33ce-4980-9918-148339a71b30 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:24:33.518264 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd105463-33ce-4980-9918-148339a71b30 None None] Pushing event updated for resources: {'Port': ['ID=4223f93e-2b4f-4613-877b-54f472a974d6,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:33.600178 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-cd105463-33ce-4980-9918-148339a71b30 None None] Attempting to bind port 4223f93e-2b4f-4613-877b-54f472a974d6 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:24:33.600740 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-cd105463-33ce-4980-9918-148339a71b30 None None] Attempting to bind port 4223f93e-2b4f-4613-877b-54f472a974d6 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '51116481-b9d7-45e1-bfed-86b419caae01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:24:33.600937 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd105463-33ce-4980-9918-148339a71b30 None None] Attempting to bind port 4223f93e-2b4f-4613-877b-54f472a974d6 on network ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:24:33.606554 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd105463-33ce-4980-9918-148339a71b30 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 24, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:24:33.606926 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd105463-33ce-4980-9918-148339a71b30 None None] Checking segment: {'id': '51116481-b9d7-45e1-bfed-86b419caae01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:24:33.607331 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cd105463-33ce-4980-9918-148339a71b30 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:33.607751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cd105463-33ce-4980-9918-148339a71b30 None None] Bound using segment: {'id': '51116481-b9d7-45e1-bfed-86b419caae01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:24:33.608287 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-cd105463-33ce-4980-9918-148339a71b30 None None] Bound port: 4223f93e-2b4f-4613-877b-54f472a974d6, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '51116481-b9d7-45e1-bfed-86b419caae01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:24:33.608586 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cd105463-33ce-4980-9918-148339a71b30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:33.683656 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-9ddcd6b0-4d14-40ec-87e1-b38a13816f50 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:33.694072 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a04d049e-8737-457c-9899-17fa3b9bbda7 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:33.728728 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a04d049e-8737-457c-9899-17fa3b9bbda7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:33.732226 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-cd105463-33ce-4980-9918-148339a71b30 None None] For port 4223f93e-2b4f-4613-877b-54f472a974d6, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:24:33.738038 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-cd105463-33ce-4980-9918-148339a71b30 None None] For port 4223f93e-2b4f-4613-877b-54f472a974d6, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=4223f93e-2b4f-4613-877b-54f472a974d6,segment=NetworkSegment(51116481-b9d7-45e1-bfed-86b419caae01),segment_id=51116481-b9d7-45e1-bfed-86b419caae01)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:24:33.753100 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-c72cf0b8-ffd1-43a6-a30c-5606230f5ecf admin admin] Allocated IP 172.25.3.86 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/b850be71-e07d-41b3-a3f1-34aa5c56525f) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:24:33.753671 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cd105463-33ce-4980-9918-148339a71b30 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:33.815055 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ddcd6b0-4d14-40ec-87e1-b38a13816f50 service neutron] Pushing event updated for resources: {'Port': ['ID=f53b5ffa-c2e5-4ee2-84c4-f0439be955b2,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:33.884801 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd105463-33ce-4980-9918-148339a71b30 None None] Pushing event updated for resources: {'Port': ['ID=4223f93e-2b4f-4613-877b-54f472a974d6,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:34.061674 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-814ffe7c-94ef-4d14-a970-826109854704 req-9349176b-c111-43dc-9f8d-2443108f13fd tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:34.066172 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-814ffe7c-94ef-4d14-a970-826109854704 req-9349176b-c111-43dc-9f8d-2443108f13fd tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/networks?id=c2615978-1c59-4fbb-826b-fc6aec14e987 HTTP/1.1" status: 200 len: 821 time: 0.6789796 Dec 09 21:24:34.093259 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c72cf0b8-ffd1-43a6-a30c-5606230f5ecf admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:34.129687 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-814ffe7c-94ef-4d14-a970-826109854704 req-7a73b113-1361-41a1-88ba-f35f77d22caa tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/quotas/6b406d0a75bb4ddd96157ff43fd37096 HTTP/1.1" status: 200 len: 375 time: 0.0523846 Dec 09 21:24:34.148690 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-9ddcd6b0-4d14-40ec-87e1-b38a13816f50 service neutron] Attempting to bind port f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:24:34.149154 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-9ddcd6b0-4d14-40ec-87e1-b38a13816f50 service neutron] Attempting to bind port f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:24:34.149388 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-9ddcd6b0-4d14-40ec-87e1-b38a13816f50 service neutron] Attempting to bind port f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:24:34.151006 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c72cf0b8-ffd1-43a6-a30c-5606230f5ecf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:34.185037 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-814ffe7c-94ef-4d14-a970-826109854704 req-191ddb45-6664-4f43-96a7-184b9ba427c1 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=6b406d0a75bb4ddd96157ff43fd37096&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0520184 Dec 09 21:24:34.214734 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-9ddcd6b0-4d14-40ec-87e1-b38a13816f50 service neutron] Port f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:24:34.215169 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-9ddcd6b0-4d14-40ec-87e1-b38a13816f50 service neutron] Attempting to bind port f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:24:34.243192 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-318ac043-7546-46c4-b38f-3a1d7c87c01b req-4a2f41fe-38c8-4e23-a1fe-19c7635931be tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:34.243582 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-318ac043-7546-46c4-b38f-3a1d7c87c01b req-4a2f41fe-38c8-4e23-a1fe-19c7635931be tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:34.243896 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [req-318ac043-7546-46c4-b38f-3a1d7c87c01b req-4a2f41fe-38c8-4e23-a1fe-19c7635931be tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Floating IP fd7bddb5-c30c-4ada-80cf-a847d82e6b6e disassociated. External IP: 172.25.3.9, port: 54e32685-83f3-47e4-883f-d0d7b2a9e798. Dec 09 21:24:34.244231 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-318ac043-7546-46c4-b38f-3a1d7c87c01b req-4a2f41fe-38c8-4e23-a1fe-19c7635931be tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Calling delete_port for 54e32685-83f3-47e4-883f-d0d7b2a9e798 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:34.255404 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-9ddcd6b0-4d14-40ec-87e1-b38a13816f50 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 24, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:24:34.255775 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-9ddcd6b0-4d14-40ec-87e1-b38a13816f50 service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:24:34.256249 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-9ddcd6b0-4d14-40ec-87e1-b38a13816f50 service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:24:34.256637 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-9ddcd6b0-4d14-40ec-87e1-b38a13816f50 service neutron] Bound port: f53b5ffa-c2e5-4ee2-84c4-f0439be955b2, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:24:34.257141 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-9ddcd6b0-4d14-40ec-87e1-b38a13816f50 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:34.316486 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c72cf0b8-ffd1-43a6-a30c-5606230f5ecf admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:34.321774 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-c72cf0b8-ffd1-43a6-a30c-5606230f5ecf admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:34.333503 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c72cf0b8-ffd1-43a6-a30c-5606230f5ecf admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:24:34.390600 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-a04d049e-8737-457c-9899-17fa3b9bbda7 admin admin] Allocated IP 172.25.3.149 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:24:34.465109 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c72cf0b8-ffd1-43a6-a30c-5606230f5ecf admin admin] Pushing event updated for resources: {'Port': ['ID=b850be71-e07d-41b3-a3f1-34aa5c56525f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:34.497615 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-9ddcd6b0-4d14-40ec-87e1-b38a13816f50 service neutron] For port f53b5ffa-c2e5-4ee2-84c4-f0439be955b2, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:24:34.503740 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-9ddcd6b0-4d14-40ec-87e1-b38a13816f50 service neutron] For port f53b5ffa-c2e5-4ee2-84c4-f0439be955b2, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=f53b5ffa-c2e5-4ee2-84c4-f0439be955b2,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:24:34.509728 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-814ffe7c-94ef-4d14-a970-826109854704 req-ea7dc36a-3def-48de-a6c1-08cbac96d33b service neutron] 10.222.0.13 "GET /v2.0/networks/c2615978-1c59-4fbb-826b-fc6aec14e987?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3289673 Dec 09 21:24:34.517225 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-9ddcd6b0-4d14-40ec-87e1-b38a13816f50 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:34.595623 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-9ddcd6b0-4d14-40ec-87e1-b38a13816f50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:34.595992 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-9ddcd6b0-4d14-40ec-87e1-b38a13816f50 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:34.597446 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-9ddcd6b0-4d14-40ec-87e1-b38a13816f50 service neutron] 10.222.0.31 "PUT /v2.0/ports/f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 HTTP/1.1" status: 200 len: 1097 time: 2.9129040 Dec 09 21:24:34.608343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9012a4aa-4a6a-4b44-b9a8-35264565fa33', 'tag': 'f53b5ffa-c2e5-4ee2-84c4-f0439be955b2'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:24:34.610958 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-84eaa050-1118-4d24-8d9d-6a6c2de329e2" -d '{"events": [{"name": "network-changed", "server_uuid": "9012a4aa-4a6a-4b44-b9a8-35264565fa33", "tag": "f53b5ffa-c2e5-4ee2-84c4-f0439be955b2"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:24:34.775986 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ddcd6b0-4d14-40ec-87e1-b38a13816f50 service neutron] Pushing event updated for resources: {'Port': ['ID=f53b5ffa-c2e5-4ee2-84c4-f0439be955b2,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:34.843005 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-976fa1a7-8561-4138-834a-ce4b1b0a4ba8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:34.845476 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-976fa1a7-8561-4138-834a-ce4b1b0a4ba8 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3329fed690514d85b98adeb6691d89f2&device_id=9012a4aa-4a6a-4b44-b9a8-35264565fa33 HTTP/1.1" status: 200 len: 1100 time: 0.1747615 Dec 09 21:24:34.848895 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-814ffe7c-94ef-4d14-a970-826109854704 req-55f56d95-8276-419f-a6a2-96923cc416f7 service neutron] 10.222.0.13 "GET /v2.0/networks/c2615978-1c59-4fbb-826b-fc6aec14e987?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3250568 Dec 09 21:24:34.850521 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-318ac043-7546-46c4-b38f-3a1d7c87c01b req-4a2f41fe-38c8-4e23-a1fe-19c7635931be tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:34.929408 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c72cf0b8-ffd1-43a6-a30c-5606230f5ecf admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:34.955833 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a04d049e-8737-457c-9899-17fa3b9bbda7 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:34.962258 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a2f41fe-38c8-4e23-a1fe-19c7635931be tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Pushing event deleted for resources: {'Port': ['ID=54e32685-83f3-47e4-883f-d0d7b2a9e798,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:34.972290 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-684f388a-cd86-4b51-9621-ba7cee2c1954 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.161&port_id=f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 HTTP/1.1" status: 200 len: 217 time: 0.1149182 Dec 09 21:24:35.078880 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d2eae037-c8ce-40af-a104-0adfff3bac5f None None] Network 31f694ab-9ca7-4e6a-a3ee-21a21efff365 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:24:35.181374 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a04d049e-8737-457c-9899-17fa3b9bbda7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:35.242802 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a04d049e-8737-457c-9899-17fa3b9bbda7 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:35.256571 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-a04d049e-8737-457c-9899-17fa3b9bbda7 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:35.258938 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-d951c5a0-8332-4cae-8f0a-d6048ce0d657 req-07f76e6a-7d02-41ae-8eeb-2ebeb4e4d2ef tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Allocated IP 172.25.3.64 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/775d398b-7748-4020-b82b-f98e57700c89) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:24:35.275536 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a04d049e-8737-457c-9899-17fa3b9bbda7 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:24:35.309647 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-637903a0-5db6-4466-a054-d7fd87e80617 None None] Provisioning complete for port fe58d238-e077-4ba7-a721-ae6bf5d3b9ae triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:35.310349 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-637903a0-5db6-4466-a054-d7fd87e80617 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:35.449341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a04d049e-8737-457c-9899-17fa3b9bbda7 admin admin] Pushing event updated for resources: {'Port': ['ID=709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:35.539537 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d951c5a0-8332-4cae-8f0a-d6048ce0d657 req-07f76e6a-7d02-41ae-8eeb-2ebeb4e4d2ef tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:35.573164 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 54e32685-83f3-47e4-883f-d0d7b2a9e798 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:24:35.611690 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 54e32685-83f3-47e4-883f-d0d7b2a9e798 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:24:35.612279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 54e32685-83f3-47e4-883f-d0d7b2a9e798 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:24:35.632857 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-637903a0-5db6-4466-a054-d7fd87e80617 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:35.635528 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-e389f780-17d8-4af6-a373-c0804ebecbf6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:35.640106 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-e389f780-17d8-4af6-a373-c0804ebecbf6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.6597264 Dec 09 21:24:35.643134 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-53d15df6-a298-47ae-a36b-e4b9cebd7eec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:35.663650 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-56c68fac-5f9e-4968-86f9-c90bf3c90493 None None] Network ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:24:35.698692 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d951c5a0-8332-4cae-8f0a-d6048ce0d657 req-07f76e6a-7d02-41ae-8eeb-2ebeb4e4d2ef tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:35.745760 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-637903a0-5db6-4466-a054-d7fd87e80617 None None] For port fe58d238-e077-4ba7-a721-ae6bf5d3b9ae, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=fe58d238-e077-4ba7-a721-ae6bf5d3b9ae,segment=NetworkSegment(7cdf46cd-1cf9-47c2-bde8-571e75cabe6a),segment_id=7cdf46cd-1cf9-47c2-bde8-571e75cabe6a)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:35.758655 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-637903a0-5db6-4466-a054-d7fd87e80617 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:35.764207 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d951c5a0-8332-4cae-8f0a-d6048ce0d657 req-07f76e6a-7d02-41ae-8eeb-2ebeb4e4d2ef tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:35.782816 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-d951c5a0-8332-4cae-8f0a-d6048ce0d657 req-07f76e6a-7d02-41ae-8eeb-2ebeb4e4d2ef tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:35.786370 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-d951c5a0-8332-4cae-8f0a-d6048ce0d657 req-07f76e6a-7d02-41ae-8eeb-2ebeb4e4d2ef tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:24:35.868037 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c72cf0b8-ffd1-43a6-a30c-5606230f5ecf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:35.964104 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d951c5a0-8332-4cae-8f0a-d6048ce0d657 req-07f76e6a-7d02-41ae-8eeb-2ebeb4e4d2ef tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:36.018178 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-7d3fc8fc-94a6-4f0b-8e04-1fb75b0f733b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:36.020072 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-7d3fc8fc-94a6-4f0b-8e04-1fb75b0f733b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.3065071 Dec 09 21:24:36.032940 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a04d049e-8737-457c-9899-17fa3b9bbda7 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:36.051662 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 4223f93e-2b4f-4613-877b-54f472a974d6 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:24:36.090557 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f43702d-96a2-4678-a181-acf530a50452 req-89b00f03-9d3d-4bea-8067-2279bfa9e56b tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:36.092737 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f43702d-96a2-4678-a181-acf530a50452 req-89b00f03-9d3d-4bea-8067-2279bfa9e56b tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/ports?device_id=9012a4aa-4a6a-4b44-b9a8-35264565fa33 HTTP/1.1" status: 200 len: 948 time: 0.9045930 Dec 09 21:24:36.101135 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [req-318ac043-7546-46c4-b38f-3a1d7c87c01b req-4a2f41fe-38c8-4e23-a1fe-19c7635931be tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Router 5cb2944b-70be-4f74-b4d0-e06f75765688 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:24:36.112053 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07f76e6a-7d02-41ae-8eeb-2ebeb4e4d2ef tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Pushing event updated for resources: {'Port': ['ID=775d398b-7748-4020-b82b-f98e57700c89,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:36.128369 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d951c5a0-8332-4cae-8f0a-d6048ce0d657 req-07f76e6a-7d02-41ae-8eeb-2ebeb4e4d2ef tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:36.143061 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-56993e33-eca6-4b92-8d6e-e9ead1bc5f28 None None] Provisioning complete for port 4223f93e-2b4f-4613-877b-54f472a974d6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:36.143691 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-56993e33-eca6-4b92-8d6e-e9ead1bc5f28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:36.215919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-637903a0-5db6-4466-a054-d7fd87e80617 None None] Pushing event updated for resources: {'Port': ['ID=fe58d238-e077-4ba7-a721-ae6bf5d3b9ae,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:36.230061 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637903a0-5db6-4466-a054-d7fd87e80617 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:36.230409 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637903a0-5db6-4466-a054-d7fd87e80617 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:36.230748 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637903a0-5db6-4466-a054-d7fd87e80617 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:36.231084 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637903a0-5db6-4466-a054-d7fd87e80617 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:36.231473 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637903a0-5db6-4466-a054-d7fd87e80617 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:36.231810 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637903a0-5db6-4466-a054-d7fd87e80617 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:36.232546 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637903a0-5db6-4466-a054-d7fd87e80617 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:36.232546 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637903a0-5db6-4466-a054-d7fd87e80617 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:36.232821 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637903a0-5db6-4466-a054-d7fd87e80617 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:36.233172 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637903a0-5db6-4466-a054-d7fd87e80617 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:36.233547 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637903a0-5db6-4466-a054-d7fd87e80617 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:36.233871 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637903a0-5db6-4466-a054-d7fd87e80617 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:36.234239 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-637903a0-5db6-4466-a054-d7fd87e80617 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:36.254989 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 4223f93e-2b4f-4613-877b-54f472a974d6 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:36.255242 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:36.311094 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c72cf0b8-ffd1-43a6-a30c-5606230f5ecf admin admin] Router d9739f4a-16b6-4e7e-8a7e-71716eacbe2d is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:24:36.316265 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-56993e33-eca6-4b92-8d6e-e9ead1bc5f28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:36.344101 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f43702d-96a2-4678-a181-acf530a50452 req-145782e8-8905-4b26-b023-307bc09f78e7 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/security-groups?id=50885dec-ee01-4c11-bc49-430c219f37b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2330694 Dec 09 21:24:36.433707 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a04d049e-8737-457c-9899-17fa3b9bbda7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:36.448460 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-56993e33-eca6-4b92-8d6e-e9ead1bc5f28 None None] For port 4223f93e-2b4f-4613-877b-54f472a974d6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=4223f93e-2b4f-4613-877b-54f472a974d6,segment=NetworkSegment(51116481-b9d7-45e1-bfed-86b419caae01),segment_id=51116481-b9d7-45e1-bfed-86b419caae01)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:36.463420 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-56993e33-eca6-4b92-8d6e-e9ead1bc5f28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:36.471527 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:36.597852 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56993e33-eca6-4b92-8d6e-e9ead1bc5f28 None None] Pushing event updated for resources: {'Port': ['ID=4223f93e-2b4f-4613-877b-54f472a974d6,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:36.664925 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:24:36.665842 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:24:36.673383 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:36.691266 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-bd116b97-ffed-4a61-b546-d51a3dde00bc None None] Provisioning complete for port fe58d238-e077-4ba7-a721-ae6bf5d3b9ae triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:36.692418 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bd116b97-ffed-4a61-b546-d51a3dde00bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:36.762069 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c72cf0b8-ffd1-43a6-a30c-5606230f5ecf admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:24:36.800413 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] Sync routers for ids ['d9739f4a-16b6-4e7e-8a7e-71716eacbe2d'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:24:36.800666 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c72cf0b8-ffd1-43a6-a30c-5606230f5ecf admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:36.804286 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c72cf0b8-ffd1-43a6-a30c-5606230f5ecf admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 4.5926113 Dec 09 21:24:36.809827 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36678) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:36.828475 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] Routers {'d9739f4a-16b6-4e7e-8a7e-71716eacbe2d'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:24:36.829219 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['d9739f4a-16b6-4e7e-8a7e-71716eacbe2d'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:36.888420 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-127e9730-6f58-4825-9aaa-99554d332b3f service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8351927 Dec 09 21:24:36.954944 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] Set router d9739f4a-16b6-4e7e-8a7e-71716eacbe2d gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:24:36.964872 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d16531f-1ed9-44f6-8d3c-6f59f283da07 req-55622eb9-cccb-4c37-bfd2-9ff15c579869 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/ports?device_id=a49420b5-3789-4863-bf0c-65a787f7fc78 HTTP/1.1" status: 200 len: 210 time: 0.0803862 Dec 09 21:24:37.008049 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-318ac043-7546-46c4-b38f-3a1d7c87c01b req-4a2f41fe-38c8-4e23-a1fe-19c7635931be tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:24:37.023395 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ef9c94d1-6f66-4f7c-967d-728cc4408428 None None] Provisioning complete for port 4223f93e-2b4f-4613-877b-54f472a974d6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:37.023685 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ef9c94d1-6f66-4f7c-967d-728cc4408428 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:37.025111 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6534b5af-4684-49ad-ace6-801d2af8b0ed None None] Sync routers for ids ['5cb2944b-70be-4f74-b4d0-e06f75765688'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:24:37.047046 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6534b5af-4684-49ad-ace6-801d2af8b0ed None None] Routers {'5cb2944b-70be-4f74-b4d0-e06f75765688'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:24:37.047748 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-6534b5af-4684-49ad-ace6-801d2af8b0ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['5cb2944b-70be-4f74-b4d0-e06f75765688'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:37.085340 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:24:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-08090afb-8765-4b4f-84ab-0ad0d6801447 x-openstack-request-id: req-08090afb-8765-4b4f-84ab-0ad0d6801447 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:24:37.085340 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9012a4aa-4a6a-4b44-b9a8-35264565fa33", "tag": "f53b5ffa-c2e5-4ee2-84c4-f0439be955b2", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:24:37.085340 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-08090afb-8765-4b4f-84ab-0ad0d6801447 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:24:37.085784 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9012a4aa-4a6a-4b44-b9a8-35264565fa33', 'tag': 'f53b5ffa-c2e5-4ee2-84c4-f0439be955b2', 'status': 'completed', 'code': 200} Dec 09 21:24:37.141109 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-814ffe7c-94ef-4d14-a970-826109854704 req-344c9dbf-7820-40c8-91c6-c323baa9c886 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:37.142965 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-814ffe7c-94ef-4d14-a970-826109854704 req-344c9dbf-7820-40c8-91c6-c323baa9c886 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.31 "GET /v2.0/networks?id=c2615978-1c59-4fbb-826b-fc6aec14e987 HTTP/1.1" status: 200 len: 821 time: 0.5141525 Dec 09 21:24:37.161496 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-318ac043-7546-46c4-b38f-3a1d7c87c01b req-4a2f41fe-38c8-4e23-a1fe-19c7635931be tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] No DVR routers for this DVR port 54e32685-83f3-47e4-883f-d0d7b2a9e798 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:24:37.175255 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a04d049e-8737-457c-9899-17fa3b9bbda7 admin admin] Router 48f26966-6ebd-4ded-9b83-e7fdb71c4bf7 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:24:37.187747 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-318ac043-7546-46c4-b38f-3a1d7c87c01b req-4a2f41fe-38c8-4e23-a1fe-19c7635931be tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:37.191249 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-318ac043-7546-46c4-b38f-3a1d7c87c01b req-4a2f41fe-38c8-4e23-a1fe-19c7635931be tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.10 "DELETE /v2.0/ports/54e32685-83f3-47e4-883f-d0d7b2a9e798 HTTP/1.1" status: 204 len: 173 time: 4.4526470 Dec 09 21:24:37.193264 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6719ad1-c8a3-48cc-9d7c-8e0ff73adfbf req-e2b448d4-06a1-412a-9ebb-59586c9978a7 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=73466791-f610-4f93-892b-3077db341121 HTTP/1.1" status: 200 len: 210 time: 0.0490901 Dec 09 21:24:37.210465 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-814ffe7c-94ef-4d14-a970-826109854704 req-60d234c8-85ae-4eed-b308-ac006075b61a tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Request body: {'port': {'device_id': '73466791-f610-4f93-892b-3077db341121', 'network_id': 'c2615978-1c59-4fbb-826b-fc6aec14e987', 'admin_state_up': True, 'tenant_id': '6b406d0a75bb4ddd96157ff43fd37096'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:37.241750 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba8b5755-3be6-4f3d-84e4-271ec2a5004c req-f65f1641-9fba-4191-ab6f-4af773a46005 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3125603 Dec 09 21:24:37.259011 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d951c5a0-8332-4cae-8f0a-d6048ce0d657 req-07f76e6a-7d02-41ae-8eeb-2ebeb4e4d2ef tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:37.282417 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d951c5a0-8332-4cae-8f0a-d6048ce0d657 req-07f76e6a-7d02-41ae-8eeb-2ebeb4e4d2ef tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:37.291463 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-6534b5af-4684-49ad-ace6-801d2af8b0ed None None] Set router 5cb2944b-70be-4f74-b4d0-e06f75765688 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:24:37.348877 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device fe58d238-e077-4ba7-a721-ae6bf5d3b9ae up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:24:37.419087 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9739f4a-16b6-4e7e-8a7e-71716eacbe2d', 'name': 'tempest-FloatingIPDetailsTestJSON-407064217-router', 'tenant_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.86'}], 'enable_snat': True}, 'gw_port_id': 'b850be71-e07d-41b3-a3f1-34aa5c56525f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:32Z', 'updated_at': '2021-12-09T21:24:34Z', 'revision_number': 3, 'project_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'gw_port': {'id': 'b850be71-e07d-41b3-a3f1-34aa5c56525f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:2a:04', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9739f4a-16b6-4e7e-8a7e-71716eacbe2d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 807, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:33Z', 'updated_at': '2021-12-09T21:24:33Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:37.454624 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] Checking router: d9739f4a-16b6-4e7e-8a7e-71716eacbe2d for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:24:37.455024 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] Updating router d9739f4a-16b6-4e7e-8a7e-71716eacbe2d port b850be71-e07d-41b3-a3f1-34aa5c56525f binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:24:37.459147 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port fe58d238-e077-4ba7-a721-ae6bf5d3b9ae triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:37.459588 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:37.475416 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07f76e6a-7d02-41ae-8eeb-2ebeb4e4d2ef tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Pushing event updated for resources: {'Port': ['ID=775d398b-7748-4020-b82b-f98e57700c89,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:37.507629 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d951c5a0-8332-4cae-8f0a-d6048ce0d657 req-07f76e6a-7d02-41ae-8eeb-2ebeb4e4d2ef tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:37.511211 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84eaa050-1118-4d24-8d9d-6a6c2de329e2 req-9b1b7de8-8cf3-4c8b-b3b0-9d17e8add1a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:37.531080 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:37.534828 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84eaa050-1118-4d24-8d9d-6a6c2de329e2 req-9b1b7de8-8cf3-4c8b-b3b0-9d17e8add1a4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3329fed690514d85b98adeb6691d89f2&device_id=9012a4aa-4a6a-4b44-b9a8-35264565fa33 HTTP/1.1" status: 200 len: 1100 time: 0.1645548 Dec 09 21:24:37.698509 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a04d049e-8737-457c-9899-17fa3b9bbda7 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:24:37.707347 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-6534b5af-4684-49ad-ace6-801d2af8b0ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'name': 'tempest-ServersTestManualDisk-255636487-router', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26'}], 'enable_snat': True}, 'gw_port_id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:21:59Z', 'updated_at': '2021-12-09T21:22:07Z', 'revision_number': 4, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'gw_port': {'id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:cd:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'device_owner': 'network:router_gateway', 'standard_attr_id': 623, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:22:02Z', 'updated_at': '2021-12-09T21:22:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'cd61cf32-db9c-49d2-8b1c-50a6abb2e135', 'name': '', 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'mac_address': 'fa:16:3e:e5:cc:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'device_owner': 'network:router_interface', 'standard_attr_id': 624, 'fixed_ips': [{'subnet_id': '069b1784-6c14-42f6-a10c-b0d4447b6091', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:22:06Z', 'updated_at': '2021-12-09T21:22:16Z', 'revision_number': 5, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'subnets': [{'id': '069b1784-6c14-42f6-a10c-b0d4447b6091', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:37.781125 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6534b5af-4684-49ad-ace6-801d2af8b0ed None None] Checking router: 5cb2944b-70be-4f74-b4d0-e06f75765688 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:24:37.785315 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d951c5a0-8332-4cae-8f0a-d6048ce0d657 req-07f76e6a-7d02-41ae-8eeb-2ebeb4e4d2ef tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:37.788244 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d951c5a0-8332-4cae-8f0a-d6048ce0d657 req-07f76e6a-7d02-41ae-8eeb-2ebeb4e4d2ef tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 697 time: 5.1715724 Dec 09 21:24:37.791326 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-814ffe7c-94ef-4d14-a970-826109854704 req-60d234c8-85ae-4eed-b308-ac006075b61a tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Made reservation on behalf of 6b406d0a75bb4ddd96157ff43fd37096 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:24:37.795183 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-814ffe7c-94ef-4d14-a970-826109854704 req-60d234c8-85ae-4eed-b308-ac006075b61a tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:37.808822 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6534b5af-4684-49ad-ace6-801d2af8b0ed None None] Routers {'5cb2944b-70be-4f74-b4d0-e06f75765688'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:24:37.811172 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-6534b5af-4684-49ad-ace6-801d2af8b0ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['5cb2944b-70be-4f74-b4d0-e06f75765688'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:37.833021 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 4223f93e-2b4f-4613-877b-54f472a974d6 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:24:37.843686 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] Sync routers for ids ['48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:24:37.898244 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d951c5a0-8332-4cae-8f0a-d6048ce0d657 req-d03c28b4-76a3-4244-b9ad-1fea69004c08 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.64 HTTP/1.1" status: 200 len: 695 time: 0.0929880 Dec 09 21:24:37.933787 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e636eb75-4590-44ad-9ca2-100c2a8c9590 req-3aa95173-60c9-4731-800e-3680b04ef334 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:37.935415 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e636eb75-4590-44ad-9ca2-100c2a8c9590 req-3aa95173-60c9-4731-800e-3680b04ef334 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/ports?device_id=9012a4aa-4a6a-4b44-b9a8-35264565fa33 HTTP/1.1" status: 200 len: 948 time: 0.2282860 Dec 09 21:24:37.959508 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-6534b5af-4684-49ad-ace6-801d2af8b0ed None None] Set router 5cb2944b-70be-4f74-b4d0-e06f75765688 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:24:37.984190 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a04d049e-8737-457c-9899-17fa3b9bbda7 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:37.985539 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a04d049e-8737-457c-9899-17fa3b9bbda7 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 5.6476033 Dec 09 21:24:37.988628 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36692) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:38.067144 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d951c5a0-8332-4cae-8f0a-d6048ce0d657 req-0857f2e2-1d24-47a8-b82f-5ed8af6c6f26 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:38.069223 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d951c5a0-8332-4cae-8f0a-d6048ce0d657 req-0857f2e2-1d24-47a8-b82f-5ed8af6c6f26 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.1539283 Dec 09 21:24:38.075602 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:38.082080 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84eaa050-1118-4d24-8d9d-6a6c2de329e2 req-d808a809-1c98-4dda-a13e-eba398b86fdd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:38.085918 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84eaa050-1118-4d24-8d9d-6a6c2de329e2 req-d808a809-1c98-4dda-a13e-eba398b86fdd service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.5378406 Dec 09 21:24:38.093911 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:38.095011 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b08fcb4-040f-42a5-aafd-924e648c4982 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:38.117964 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:24:38.143114 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] Routers {'48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:24:38.145204 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:38.157288 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e636eb75-4590-44ad-9ca2-100c2a8c9590 req-a22e5b7f-657a-4d40-b0b7-764c8e6e20ed tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/security-groups?id=50885dec-ee01-4c11-bc49-430c219f37b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0865328 Dec 09 21:24:38.201918 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84eaa050-1118-4d24-8d9d-6a6c2de329e2 req-73028cbb-1206-4f06-b76e-cba72fdded96 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.161&port_id=f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 HTTP/1.1" status: 200 len: 217 time: 0.0491447 Dec 09 21:24:38.231138 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:38.272387 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-6534b5af-4684-49ad-ace6-801d2af8b0ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'name': 'tempest-ServersTestManualDisk-255636487-router', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26'}], 'enable_snat': True}, 'gw_port_id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:21:59Z', 'updated_at': '2021-12-09T21:22:07Z', 'revision_number': 4, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'gw_port': {'id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:cd:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'device_owner': 'network:router_gateway', 'standard_attr_id': 623, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:22:02Z', 'updated_at': '2021-12-09T21:22:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'cd61cf32-db9c-49d2-8b1c-50a6abb2e135', 'name': '', 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'mac_address': 'fa:16:3e:e5:cc:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'device_owner': 'network:router_interface', 'standard_attr_id': 624, 'fixed_ips': [{'subnet_id': '069b1784-6c14-42f6-a10c-b0d4447b6091', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:22:06Z', 'updated_at': '2021-12-09T21:22:16Z', 'revision_number': 5, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'subnets': [{'id': '069b1784-6c14-42f6-a10c-b0d4447b6091', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:38.280942 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 4223f93e-2b4f-4613-877b-54f472a974d6 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:38.281554 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:38.334160 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6534b5af-4684-49ad-ace6-801d2af8b0ed None None] The sync data for ids ['5cb2944b-70be-4f74-b4d0-e06f75765688'] in n-d-713301-27 is: [{'id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'name': 'tempest-ServersTestManualDisk-255636487-router', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26'}], 'enable_snat': True}, 'gw_port_id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:21:59Z', 'updated_at': '2021-12-09T21:22:07Z', 'revision_number': 4, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'gw_port': {'id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:cd:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'device_owner': 'network:router_gateway', 'standard_attr_id': 623, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:22:02Z', 'updated_at': '2021-12-09T21:22:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'cd61cf32-db9c-49d2-8b1c-50a6abb2e135', 'name': '', 'network_id': '6b0e1b89-20b6-4a70-94cb-58b2b1f77a20', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'mac_address': 'fa:16:3e:e5:cc:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'device_owner': 'network:router_interface', 'standard_attr_id': 624, 'fixed_ips': [{'subnet_id': '069b1784-6c14-42f6-a10c-b0d4447b6091', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:22:06Z', 'updated_at': '2021-12-09T21:22:16Z', 'revision_number': 5, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'subnets': [{'id': '069b1784-6c14-42f6-a10c-b0d4447b6091', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:24:38.342730 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e4c2ec69-5a9a-4426-a21d-198f64fcbcde req-8bc98ab3-b7aa-48ea-9828-e7af7d35587e tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "GET /v2.0/floatingips/3ffdb105-0d1a-407d-afe7-115247f07838 HTTP/1.1" status: 200 len: 692 time: 0.0828631 Dec 09 21:24:38.349492 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84eaa050-1118-4d24-8d9d-6a6c2de329e2 req-5d2d9c3f-9b84-4917-b291-ea1a5320e5ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:38.351381 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84eaa050-1118-4d24-8d9d-6a6c2de329e2 req-5d2d9c3f-9b84-4917-b291-ea1a5320e5ad service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1423330 Dec 09 21:24:38.376452 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7603807-91e3-4180-9810-6ef61983adca None None] Pushing event updated for resources: {'Port': ['ID=b850be71-e07d-41b3-a3f1-34aa5c56525f,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:38.389582 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] Attempting to bind port b850be71-e07d-41b3-a3f1-34aa5c56525f on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:24:38.389959 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] Attempting to bind port b850be71-e07d-41b3-a3f1-34aa5c56525f by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:24:38.390330 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] Attempting to bind port b850be71-e07d-41b3-a3f1-34aa5c56525f on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:24:38.443067 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-814ffe7c-94ef-4d14-a970-826109854704 req-60d234c8-85ae-4eed-b308-ac006075b61a tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Allocated IP 172.20.0.8 (c2615978-1c59-4fbb-826b-fc6aec14e987/1f5c65f5-5864-4e4e-bede-1bfc7f6e8e68/378fa265-e1b8-415f-9f0c-2bff04df170a) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:24:38.450369 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 24, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:24:38.451785 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:24:38.452199 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:38.452604 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:24:38.453526 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] Bound port: b850be71-e07d-41b3-a3f1-34aa5c56525f, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:24:38.454235 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:38.475571 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36708) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:38.491490 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] Set router 48f26966-6ebd-4ded-9b83-e7fdb71c4bf7 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:24:38.641071 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c8ed5135-03c7-4207-97e9-018402dfb724 req-ed19f09a-3317-4002-9932-fab459a06bd0 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=73466791-f610-4f93-892b-3077db341121 HTTP/1.1" status: 200 len: 210 time: 0.0766187 Dec 09 21:24:38.653019 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4c2ec69-5a9a-4426-a21d-198f64fcbcde req-2964aeba-49a1-42c2-a6e0-a63666cf84c4 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:38.662323 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e4c2ec69-5a9a-4426-a21d-198f64fcbcde req-2964aeba-49a1-42c2-a6e0-a63666cf84c4 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.3053594 Dec 09 21:24:38.678180 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84eaa050-1118-4d24-8d9d-6a6c2de329e2 req-7df0d84c-eaf8-45b8-8f12-6c80eb5a87d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:38.678180 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84eaa050-1118-4d24-8d9d-6a6c2de329e2 req-7df0d84c-eaf8-45b8-8f12-6c80eb5a87d1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1955874 Dec 09 21:24:38.731768 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device fe58d238-e077-4ba7-a721-ae6bf5d3b9ae up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:24:38.801765 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9426793-ebf6-4cba-8aa1-351f26aae0c6 None None] New status for floating IP fd7bddb5-c30c-4ada-80cf-a847d82e6b6e: DOWN {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:24:38.831589 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-5b08fcb4-040f-42a5-aafd-924e648c4982 admin admin] Allocated IP 172.20.0.1 (31f694ab-9ca7-4e6a-a3ee-21a21efff365/9a606ad9-369f-4ab7-a435-14aa18212259/20d7dfe6-d481-4b2c-879f-23bab4173d92) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:24:38.834631 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] For port b850be71-e07d-41b3-a3f1-34aa5c56525f, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:24:38.859247 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] For port b850be71-e07d-41b3-a3f1-34aa5c56525f, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b850be71-e07d-41b3-a3f1-34aa5c56525f,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:24:38.864507 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84eaa050-1118-4d24-8d9d-6a6c2de329e2 req-36b70c81-3d30-4b58-9683-d09524c174e4 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1806817 Dec 09 21:24:38.869637 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e4c2ec69-5a9a-4426-a21d-198f64fcbcde req-3e8e2ef9-5b9e-40ea-9488-e83163b3ac89 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.64 HTTP/1.1" status: 200 len: 695 time: 0.2062938 Dec 09 21:24:38.877764 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:38.945758 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port fe58d238-e077-4ba7-a721-ae6bf5d3b9ae triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:38.945758 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:39.015526 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84eaa050-1118-4d24-8d9d-6a6c2de329e2 req-17d8cb8d-cf2a-41d1-86e5-e662f257ac11 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1434515 Dec 09 21:24:39.017046 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c3fec6ed-57f0-49f1-930b-6aa746f67c83 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:39.048606 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7603807-91e3-4180-9810-6ef61983adca None None] Pushing event updated for resources: {'Port': ['ID=b850be71-e07d-41b3-a3f1-34aa5c56525f,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:39.054487 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] Routers {'d9739f4a-16b6-4e7e-8a7e-71716eacbe2d'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:24:39.055117 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['d9739f4a-16b6-4e7e-8a7e-71716eacbe2d'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:39.065125 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-814ffe7c-94ef-4d14-a970-826109854704 req-60d234c8-85ae-4eed-b308-ac006075b61a tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:39.087129 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a49420b5-3789-4863-bf0c-65a787f7fc78', 'name': 'network-vif-deleted', 'tag': '54e32685-83f3-47e4-883f-d0d7b2a9e798'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:24:39.089737 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c8efa666-c61e-4c4f-8105-ebe0ce99526e" -d '{"events": [{"server_uuid": "a49420b5-3789-4863-bf0c-65a787f7fc78", "name": "network-vif-deleted", "tag": "54e32685-83f3-47e4-883f-d0d7b2a9e798"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:24:39.117975 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e4c2ec69-5a9a-4426-a21d-198f64fcbcde req-bcfdd934-e9e4-4873-8f6b-5d7d3a3184c2 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.64 HTTP/1.1" status: 200 len: 695 time: 0.1064141 Dec 09 21:24:39.132502 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77b71ae8-25ec-473e-8092-991d8307fe25 req-3760619b-1044-43e9-ad21-0cbf69040366 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:39.134287 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-77b71ae8-25ec-473e-8092-991d8307fe25 req-3760619b-1044-43e9-ad21-0cbf69040366 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f7517580-ddaa-48b1-9288-a3db030a3443 HTTP/1.1" status: 200 len: 946 time: 0.2584836 Dec 09 21:24:39.136137 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c3fec6ed-57f0-49f1-930b-6aa746f67c83 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:39.143057 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'name': 'tempest-ServersTestFqdnHostnames-1853275289-router', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149'}], 'enable_snat': True}, 'gw_port_id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:32Z', 'updated_at': '2021-12-09T21:24:35Z', 'revision_number': 3, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'gw_port': {'id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:92:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 809, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:33Z', 'updated_at': '2021-12-09T21:24:34Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:39.207674 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] Checking router: 48f26966-6ebd-4ded-9b83-e7fdb71c4bf7 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:24:39.208079 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] Updating router 48f26966-6ebd-4ded-9b83-e7fdb71c4bf7 port 709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:24:39.222176 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b08fcb4-040f-42a5-aafd-924e648c4982 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:39.231607 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-814ffe7c-94ef-4d14-a970-826109854704 req-60d234c8-85ae-4eed-b308-ac006075b61a tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:39.258732 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:39.291467 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] Set router d9739f4a-16b6-4e7e-8a7e-71716eacbe2d gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:24:39.330142 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-77b71ae8-25ec-473e-8092-991d8307fe25 req-81e31747-3d20-454d-8c0a-0ed07844b1c8 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1388755 Dec 09 21:24:39.331159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-814ffe7c-94ef-4d14-a970-826109854704 req-60d234c8-85ae-4eed-b308-ac006075b61a tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Network c2615978-1c59-4fbb-826b-fc6aec14e987 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:39.344539 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-814ffe7c-94ef-4d14-a970-826109854704 req-60d234c8-85ae-4eed-b308-ac006075b61a tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:39.345539 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-e4c2ec69-5a9a-4426-a21d-198f64fcbcde req-a80ab3e8-4abc-47c9-9103-b09a7b0ce809 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Deleting port 775d398b-7748-4020-b82b-f98e57700c89 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:39.345945 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e4c2ec69-5a9a-4426-a21d-198f64fcbcde req-a80ab3e8-4abc-47c9-9103-b09a7b0ce809 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:39.352069 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-814ffe7c-94ef-4d14-a970-826109854704 req-60d234c8-85ae-4eed-b308-ac006075b61a tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:24:39.375865 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c3fec6ed-57f0-49f1-930b-6aa746f67c83 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:39.378681 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c3fec6ed-57f0-49f1-930b-6aa746f67c83 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:39.382357 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c3fec6ed-57f0-49f1-930b-6aa746f67c83 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "DELETE /v2.0/security-groups/47b47381-681d-49da-8acd-4d26ea16fbc0 HTTP/1.1" status: 204 len: 168 time: 0.9021909 Dec 09 21:24:39.384105 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36714) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:39.426107 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3fec6ed-57f0-49f1-930b-6aa746f67c83 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=47b47381-681d-49da-8acd-4d26ea16fbc0,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:39.428037 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:39.431851 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60d234c8-85ae-4eed-b308-ac006075b61a tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Pushing event updated for resources: {'Port': ['ID=378fa265-e1b8-415f-9f0c-2bff04df170a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:39.459898 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-a7f82f45-bd01-4b8d-8a11-0d51a2391232 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] show failed (client error): The resource could not be found. Dec 09 21:24:39.465401 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a7f82f45-bd01-4b8d-8a11-0d51a2391232 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "GET /v2.0/security-groups/47b47381-681d-49da-8acd-4d26ea16fbc0 HTTP/1.1" status: 404 len: 347 time: 0.0556648 Dec 09 21:24:39.466169 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36716) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:39.472721 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e4c2ec69-5a9a-4426-a21d-198f64fcbcde req-a80ab3e8-4abc-47c9-9103-b09a7b0ce809 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:39.473157 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e4c2ec69-5a9a-4426-a21d-198f64fcbcde req-a80ab3e8-4abc-47c9-9103-b09a7b0ce809 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:39.477234 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:39.484511 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b08fcb4-040f-42a5-aafd-924e648c4982 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:39.494844 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-e4c2ec69-5a9a-4426-a21d-198f64fcbcde req-a80ab3e8-4abc-47c9-9103-b09a7b0ce809 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Calling delete_port for 775d398b-7748-4020-b82b-f98e57700c89 owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:39.556296 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-814ffe7c-94ef-4d14-a970-826109854704 req-60d234c8-85ae-4eed-b308-ac006075b61a tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:39.557095 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-814ffe7c-94ef-4d14-a970-826109854704 req-60d234c8-85ae-4eed-b308-ac006075b61a tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:39.591396 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:24:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5101db33-d53e-4548-b46d-67d31eb53555 x-openstack-request-id: req-5101db33-d53e-4548-b46d-67d31eb53555 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:24:39.592041 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a49420b5-3789-4863-bf0c-65a787f7fc78", "name": "network-vif-deleted", "tag": "54e32685-83f3-47e4-883f-d0d7b2a9e798", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:24:39.592288 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-5101db33-d53e-4548-b46d-67d31eb53555 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:24:39.592997 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a49420b5-3789-4863-bf0c-65a787f7fc78', 'name': 'network-vif-deleted', 'tag': '54e32685-83f3-47e4-883f-d0d7b2a9e798', 'status': 'completed', 'code': 200} Dec 09 21:24:39.652726 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9739f4a-16b6-4e7e-8a7e-71716eacbe2d', 'name': 'tempest-FloatingIPDetailsTestJSON-407064217-router', 'tenant_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.86'}], 'enable_snat': True}, 'gw_port_id': 'b850be71-e07d-41b3-a3f1-34aa5c56525f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:32Z', 'updated_at': '2021-12-09T21:24:34Z', 'revision_number': 3, 'project_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'gw_port': {'id': 'b850be71-e07d-41b3-a3f1-34aa5c56525f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:2a:04', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9739f4a-16b6-4e7e-8a7e-71716eacbe2d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 807, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:33Z', 'updated_at': '2021-12-09T21:24:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:39.653787 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b08fcb4-040f-42a5-aafd-924e648c4982 admin admin] Network 31f694ab-9ca7-4e6a-a3ee-21a21efff365 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:39.660264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03293fab-e0af-4873-ab7d-552fad018ec5 req-970cd601-7e8a-4e23-8bb8-f011df556245 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:39.667887 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-03293fab-e0af-4873-ab7d-552fad018ec5 req-970cd601-7e8a-4e23-8bb8-f011df556245 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/ports?device_id=9012a4aa-4a6a-4b44-b9a8-35264565fa33 HTTP/1.1" status: 200 len: 948 time: 0.0741878 Dec 09 21:24:39.674879 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-5b08fcb4-040f-42a5-aafd-924e648c4982 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:39.679548 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-814ffe7c-94ef-4d14-a970-826109854704 req-60d234c8-85ae-4eed-b308-ac006075b61a tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.4741259 Dec 09 21:24:39.682428 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b08fcb4-040f-42a5-aafd-924e648c4982 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:24:39.714247 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b08fcb4-040f-42a5-aafd-924e648c4982 admin admin] Pushing event updated for resources: {'Port': ['ID=20d7dfe6-d481-4b2c-879f-23bab4173d92,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:39.725485 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb95af89-79a8-4665-9dbf-ec82ea8b1216 None None] The sync data for ids ['d9739f4a-16b6-4e7e-8a7e-71716eacbe2d'] in n-d-713301-27 is: [{'id': 'd9739f4a-16b6-4e7e-8a7e-71716eacbe2d', 'name': 'tempest-FloatingIPDetailsTestJSON-407064217-router', 'tenant_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.86'}], 'enable_snat': True}, 'gw_port_id': 'b850be71-e07d-41b3-a3f1-34aa5c56525f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:32Z', 'updated_at': '2021-12-09T21:24:34Z', 'revision_number': 3, 'project_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'gw_port': {'id': 'b850be71-e07d-41b3-a3f1-34aa5c56525f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:2a:04', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9739f4a-16b6-4e7e-8a7e-71716eacbe2d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 807, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:33Z', 'updated_at': '2021-12-09T21:24:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:24:39.761626 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e4c2ec69-5a9a-4426-a21d-198f64fcbcde req-a80ab3e8-4abc-47c9-9103-b09a7b0ce809 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:39.787779 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-03293fab-e0af-4873-ab7d-552fad018ec5 req-857a5e76-6ae8-41d5-bdda-aae14ccd1dbb tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/security-groups?id=50885dec-ee01-4c11-bc49-430c219f37b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1186488 Dec 09 21:24:39.811767 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:39.826917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-814ffe7c-94ef-4d14-a970-826109854704 req-5e458bf9-d2d7-4455-befd-1cbf06c788a2 service neutron] Request body: {'port': {'device_id': '73466791-f610-4f93-892b-3077db341121', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:39.829213 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:39.859977 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a80ab3e8-4abc-47c9-9103-b09a7b0ce809 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Pushing event deleted for resources: {'Port': ['ID=775d398b-7748-4020-b82b-f98e57700c89,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:39.889148 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] Attempting to bind port 709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:24:39.889148 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] Attempting to bind port 709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:24:39.889498 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] Attempting to bind port 709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:24:39.904657 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07910758-cee7-4c25-adb4-19197a8e874f None None] Pushing event updated for resources: {'Port': ['ID=709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:39.907885 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 24, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:24:39.908426 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:24:39.908670 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:39.909058 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:24:39.909548 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] Bound port: 709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:24:39.910194 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:40.018730 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] For port 709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:24:40.022964 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] For port 709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:24:40.028914 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e4c2ec69-5a9a-4426-a21d-198f64fcbcde req-a80ab3e8-4abc-47c9-9103-b09a7b0ce809 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:40.030027 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:40.033084 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e4c2ec69-5a9a-4426-a21d-198f64fcbcde req-a80ab3e8-4abc-47c9-9103-b09a7b0ce809 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:40.034747 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e4c2ec69-5a9a-4426-a21d-198f64fcbcde req-a80ab3e8-4abc-47c9-9103-b09a7b0ce809 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "DELETE /v2.0/floatingips/3ffdb105-0d1a-407d-afe7-115247f07838 HTTP/1.1" status: 204 len: 173 time: 0.9156010 Dec 09 21:24:40.056521 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-029642a3-b6c2-4b57-a7ec-51c4012b5ccb req-c6ca04ba-ffdf-4130-b416-39a0ed18117e tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:40.058270 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-029642a3-b6c2-4b57-a7ec-51c4012b5ccb req-c6ca04ba-ffdf-4130-b416-39a0ed18117e tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=73466791-f610-4f93-892b-3077db341121 HTTP/1.1" status: 200 len: 931 time: 0.0810025 Dec 09 21:24:40.121048 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-aa7449c6-c036-4137-809c-7f4b79f1ad04 None None] Provisioning complete for port 20d7dfe6-d481-4b2c-879f-23bab4173d92 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:40.121444 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aa7449c6-c036-4137-809c-7f4b79f1ad04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:40.178514 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0ca50f7-bfd4-43fe-9bd3-61c7059f1225 req-bea76987-6802-4f11-adb6-5ecc64a3ab46 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:40.180713 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0ca50f7-bfd4-43fe-9bd3-61c7059f1225 req-bea76987-6802-4f11-adb6-5ecc64a3ab46 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.10 "GET /v2.0/ports?device_id=f7517580-ddaa-48b1-9288-a3db030a3443 HTTP/1.1" status: 200 len: 946 time: 0.1212983 Dec 09 21:24:40.201092 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-029642a3-b6c2-4b57-a7ec-51c4012b5ccb req-e19763f7-0c5d-4c27-8039-b713f552e7cb tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1320372 Dec 09 21:24:40.212748 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] Routers {'48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:24:40.213395 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:40.217939 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07910758-cee7-4c25-adb4-19197a8e874f None None] Pushing event updated for resources: {'Port': ['ID=709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:40.301638 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-aa7449c6-c036-4137-809c-7f4b79f1ad04 None None] Port 20d7dfe6-d481-4b2c-879f-23bab4173d92 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:24:40.337659 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-a6722eef-3315-4dc5-a8a8-1cedec5922e2 req-6709422f-3e2e-4b53-a440-34574383fc32 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] show failed (client error): The resource could not be found. Dec 09 21:24:40.354723 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a6722eef-3315-4dc5-a8a8-1cedec5922e2 req-6709422f-3e2e-4b53-a440-34574383fc32 tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "GET /v2.0/floatingips/3ffdb105-0d1a-407d-afe7-115247f07838 HTTP/1.1" status: 404 len: 350 time: 0.1525307 Dec 09 21:24:40.358410 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Allocated IP 172.20.0.1 (ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c/9125b460-598b-4793-bfb4-08b07155042a/0c3b6cc8-3628-4374-be2a-ae9bb603880e) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:24:40.402600 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] Set router 48f26966-6ebd-4ded-9b83-e7fdb71c4bf7 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:24:40.422206 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-5596b23b-2c34-4623-a474-59223d4fcf28 req-af3dc8f2-1b3b-4561-92c5-1ff9ae31c9cd tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] show failed (client error): The resource could not be found. Dec 09 21:24:40.440075 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5596b23b-2c34-4623-a474-59223d4fcf28 req-af3dc8f2-1b3b-4561-92c5-1ff9ae31c9cd tempest-FloatingIPsTestJSON-470990611 tempest-FloatingIPsTestJSON-470990611-project] 10.222.0.13 "GET /v2.0/floatingips/3ffdb105-0d1a-407d-afe7-115247f07838 HTTP/1.1" status: 404 len: 350 time: 0.0691297 Dec 09 21:24:40.445333 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36748) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:40.531795 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:24:40.571669 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-a0ca50f7-bfd4-43fe-9bd3-61c7059f1225 req-7aa5422c-e938-42e7-80a6-cf69e08e2f27 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Deleting port e588819c-5a89-4820-82c6-5ac8ba582aa1 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:40.571786 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a0ca50f7-bfd4-43fe-9bd3-61c7059f1225 req-7aa5422c-e938-42e7-80a6-cf69e08e2f27 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:40.603187 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-25136782-da58-4c06-bcb8-65284f255679 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Deleting port d198bf95-9a77-4ca5-b505-50c064e2e08b {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:40.604074 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25136782-da58-4c06-bcb8-65284f255679 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:40.722765 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25136782-da58-4c06-bcb8-65284f255679 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:40.723253 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25136782-da58-4c06-bcb8-65284f255679 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:40.740719 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-25136782-da58-4c06-bcb8-65284f255679 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Calling delete_port for d198bf95-9a77-4ca5-b505-50c064e2e08b owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:40.746753 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-814ffe7c-94ef-4d14-a970-826109854704 req-5e458bf9-d2d7-4455-befd-1cbf06c788a2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:40.754964 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b08fcb4-040f-42a5-aafd-924e648c4982 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:40.821957 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7080cd5f-e8b9-4b97-b101-0a856b9ba492 req-da59dc8f-4ac1-46af-b5b3-3c054192c182 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:40.832399 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7080cd5f-e8b9-4b97-b101-0a856b9ba492 req-da59dc8f-4ac1-46af-b5b3-3c054192c182 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f7517580-ddaa-48b1-9288-a3db030a3443 HTTP/1.1" status: 200 len: 946 time: 0.3154533 Dec 09 21:24:40.977377 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-a0ca50f7-bfd4-43fe-9bd3-61c7059f1225 req-7aa5422c-e938-42e7-80a6-cf69e08e2f27 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] For port e588819c-5a89-4820-82c6-5ac8ba582aa1, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e588819c-5a89-4820-82c6-5ac8ba582aa1,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:40.977924 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a0ca50f7-bfd4-43fe-9bd3-61c7059f1225 req-7aa5422c-e938-42e7-80a6-cf69e08e2f27 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:40.993153 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-a0ca50f7-bfd4-43fe-9bd3-61c7059f1225 req-7aa5422c-e938-42e7-80a6-cf69e08e2f27 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Calling delete_port for e588819c-5a89-4820-82c6-5ac8ba582aa1 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:41.009084 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port f53b5ffa-c2e5-4ee2-84c4-f0439be955b2, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=f53b5ffa-c2e5-4ee2-84c4-f0439be955b2,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:41.012001 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36760) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:41.023644 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'f53b5ffa-c2e5-4ee2-84c4-f0439be955b2', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': 'f53b5ffa-c2e5-4ee2-84c4-f0439be955b2', 'mac_address': 'fa:16:3e:5f:1c:17', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.161'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:24:41.037966 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:41.117365 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:41.147132 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:24:41.181993 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port f53b5ffa-c2e5-4ee2-84c4-f0439be955b2, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=f53b5ffa-c2e5-4ee2-84c4-f0439be955b2,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:41.194161 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'name': 'tempest-ServersTestFqdnHostnames-1853275289-router', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149'}], 'enable_snat': True}, 'gw_port_id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:32Z', 'updated_at': '2021-12-09T21:24:35Z', 'revision_number': 3, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'gw_port': {'id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:92:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 809, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:33Z', 'updated_at': '2021-12-09T21:24:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:41.207970 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6815977a-eb5a-46dd-8539-8dd059628ee8 req-689ba5e8-fa3e-4f72-a5d2-e6e042d078e7 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:41.210572 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6815977a-eb5a-46dd-8539-8dd059628ee8 req-689ba5e8-fa3e-4f72-a5d2-e6e042d078e7 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/ports?device_id=9012a4aa-4a6a-4b44-b9a8-35264565fa33 HTTP/1.1" status: 200 len: 948 time: 0.2106979 Dec 09 21:24:41.219685 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7080cd5f-e8b9-4b97-b101-0a856b9ba492 req-8a2e84a6-505e-4a2e-9a2d-3be89e46e5b8 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3856721 Dec 09 21:24:41.227740 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87f8dc81-c4fc-4b53-be12-acad7420e630 None None] The sync data for ids ['48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'] in n-d-713301-27 is: [{'id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'name': 'tempest-ServersTestFqdnHostnames-1853275289-router', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149'}], 'enable_snat': True}, 'gw_port_id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:32Z', 'updated_at': '2021-12-09T21:24:35Z', 'revision_number': 3, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'gw_port': {'id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:92:53', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 809, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:33Z', 'updated_at': '2021-12-09T21:24:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:24:41.230696 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:41.303601 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=f53b5ffa-c2e5-4ee2-84c4-f0439be955b2,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:41.349563 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6815977a-eb5a-46dd-8539-8dd059628ee8 req-c8d701af-35de-489b-b4e1-ab6dd820c9b7 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/security-groups?id=50885dec-ee01-4c11-bc49-430c219f37b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1246662 Dec 09 21:24:41.385701 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2625b6a8-cf92-4653-9cc1-af736edfd577 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:41.423702 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['f53b5ffa-c2e5-4ee2-84c4-f0439be955b2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:24:41.468446 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61cd59ed-b088-4888-8823-57c5add3cfd5 req-6dacbfd9-6d50-4c91-95dd-5e76231a95eb tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:41.470091 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-61cd59ed-b088-4888-8823-57c5add3cfd5 req-6dacbfd9-6d50-4c91-95dd-5e76231a95eb tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=73466791-f610-4f93-892b-3077db341121 HTTP/1.1" status: 200 len: 931 time: 0.1266246 Dec 09 21:24:41.492309 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:41.530164 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a0ca50f7-bfd4-43fe-9bd3-61c7059f1225 req-7aa5422c-e938-42e7-80a6-cf69e08e2f27 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:41.569894 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['e588819c-5a89-4820-82c6-5ac8ba582aa1'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:24:41.617252 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7aa5422c-e938-42e7-80a6-cf69e08e2f27 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Pushing event deleted for resources: {'Port': ['ID=e588819c-5a89-4820-82c6-5ac8ba582aa1,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:41.619764 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Network ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:41.634096 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Pushing event updated for resources: {'Port': ['ID=0c3b6cc8-3628-4374-be2a-ae9bb603880e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:41.638208 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:41.640854 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:24:41.643584 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b08fcb4-040f-42a5-aafd-924e648c4982 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:41.653792 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25136782-da58-4c06-bcb8-65284f255679 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:41.684671 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-61cd59ed-b088-4888-8823-57c5add3cfd5 req-c1cbd5ca-1a68-4de5-9f4e-e69f38e802ef tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1963174 Dec 09 21:24:41.707055 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-a0ca50f7-bfd4-43fe-9bd3-61c7059f1225 req-7aa5422c-e938-42e7-80a6-cf69e08e2f27 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] No DVR routers for this DVR port e588819c-5a89-4820-82c6-5ac8ba582aa1 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:24:41.710691 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a0ca50f7-bfd4-43fe-9bd3-61c7059f1225 req-7aa5422c-e938-42e7-80a6-cf69e08e2f27 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:41.714266 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0ca50f7-bfd4-43fe-9bd3-61c7059f1225 req-7aa5422c-e938-42e7-80a6-cf69e08e2f27 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.10 "DELETE /v2.0/ports/e588819c-5a89-4820-82c6-5ac8ba582aa1 HTTP/1.1" status: 204 len: 173 time: 1.5095289 Dec 09 21:24:41.714751 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f7517580-ddaa-48b1-9288-a3db030a3443', 'name': 'network-vif-deleted', 'tag': 'e588819c-5a89-4820-82c6-5ac8ba582aa1'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:24:41.717194 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e69a1a2d-fefb-4ebd-8869-f50baa8da019" -d '{"events": [{"server_uuid": "f7517580-ddaa-48b1-9288-a3db030a3443", "name": "network-vif-deleted", "tag": "e588819c-5a89-4820-82c6-5ac8ba582aa1"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:24:41.762255 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-177ea9e8-5f0b-47fd-85cf-3aa02da26cd2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:41.803018 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25136782-da58-4c06-bcb8-65284f255679 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Pushing event deleted for resources: {'Port': ['ID=d198bf95-9a77-4ca5-b505-50c064e2e08b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:41.961729 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:24:42.063111 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:42.100734 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:42.101568 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:42.205964 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-0f182dcc-39a4-4ea1-bf30-d33fef3ab608 None None] Provisioning complete for port 0c3b6cc8-3628-4374-be2a-ae9bb603880e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:42.206688 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0f182dcc-39a4-4ea1-bf30-d33fef3ab608 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:42.225949 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2625b6a8-cf92-4653-9cc1-af736edfd577 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:42.241335 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25136782-da58-4c06-bcb8-65284f255679 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:42.244653 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25136782-da58-4c06-bcb8-65284f255679 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:42.249235 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-25136782-da58-4c06-bcb8-65284f255679 tempest-ServersTestManualDisk-1669661401 tempest-ServersTestManualDisk-1669661401-project] 10.222.0.13 "DELETE /v2.0/floatingips/fd7bddb5-c30c-4ada-80cf-a847d82e6b6e HTTP/1.1" status: 204 len: 168 time: 2.7790434 Dec 09 21:24:42.251893 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36768) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:42.309621 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2625b6a8-cf92-4653-9cc1-af736edfd577 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:42.327688 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:42.416751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:42.434851 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:42.438842 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b850be71-e07d-41b3-a3f1-34aa5c56525f up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:24:42.525023 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-814ffe7c-94ef-4d14-a970-826109854704 req-5e458bf9-d2d7-4455-befd-1cbf06c788a2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 378fa265-e1b8-415f-9f0c-2bff04df170a {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:24:42.545077 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:24:42.567805 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-814ffe7c-94ef-4d14-a970-826109854704 req-5e458bf9-d2d7-4455-befd-1cbf06c788a2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:42.572928 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:24:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d94ea49f-a2f3-4448-b3e5-53b8816404b6 x-openstack-request-id: req-d94ea49f-a2f3-4448-b3e5-53b8816404b6 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:24:42.573498 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f7517580-ddaa-48b1-9288-a3db030a3443", "name": "network-vif-deleted", "tag": "e588819c-5a89-4820-82c6-5ac8ba582aa1", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:24:42.573590 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-d94ea49f-a2f3-4448-b3e5-53b8816404b6 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:24:42.573992 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f7517580-ddaa-48b1-9288-a3db030a3443', 'name': 'network-vif-deleted', 'tag': 'e588819c-5a89-4820-82c6-5ac8ba582aa1', 'status': 'completed', 'code': 200} Dec 09 21:24:42.601938 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2625b6a8-cf92-4653-9cc1-af736edfd577 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=d32be1138c874281bc26abb84ebaa66b&name=default HTTP/1.1" status: 200 len: 2996 time: 1.5802410 Dec 09 21:24:42.616082 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2625b6a8-cf92-4653-9cc1-af736edfd577 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=85b78320-b877-491f-8ad9-5490602e5b54,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:42.625129 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36774) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:42.632948 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-0f182dcc-39a4-4ea1-bf30-d33fef3ab608 None None] Port 0c3b6cc8-3628-4374-be2a-ae9bb603880e cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:24:42.635072 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec777553-1b74-4ae0-998c-e828c19b51e7 req-c6ea062a-17c8-40ff-a024-6f6abce8bdba tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f7517580-ddaa-48b1-9288-a3db030a3443 HTTP/1.1" status: 200 len: 210 time: 0.0644116 Dec 09 21:24:42.666489 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port b850be71-e07d-41b3-a3f1-34aa5c56525f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:42.667210 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:42.731740 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:42.752800 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-439100ae-126a-4186-ae80-440fad6c036a req-8f11818e-8466-4286-8360-1516d95733f3 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:42.754543 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-439100ae-126a-4186-ae80-440fad6c036a req-8f11818e-8466-4286-8360-1516d95733f3 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/ports?device_id=9012a4aa-4a6a-4b44-b9a8-35264565fa33 HTTP/1.1" status: 200 len: 949 time: 0.1852055 Dec 09 21:24:42.763811 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:24:42.806888 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-814ffe7c-94ef-4d14-a970-826109854704 req-5e458bf9-d2d7-4455-befd-1cbf06c788a2 service neutron] Transition to ACTIVE for port object 378fa265-e1b8-415f-9f0c-2bff04df170a will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:24:42.815506 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:42.822418 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:42.822418 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:42.852559 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-814ffe7c-94ef-4d14-a970-826109854704 req-5e458bf9-d2d7-4455-befd-1cbf06c788a2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:42.874109 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port b850be71-e07d-41b3-a3f1-34aa5c56525f, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b850be71-e07d-41b3-a3f1-34aa5c56525f,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:42.886469 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:42.893962 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-439100ae-126a-4186-ae80-440fad6c036a req-1a4cdcce-a048-4278-b258-bd4959773fc9 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/security-groups?id=50885dec-ee01-4c11-bc49-430c219f37b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1309958 Dec 09 21:24:42.947873 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:42.955045 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b08fcb4-040f-42a5-aafd-924e648c4982 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:42.965991 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:42.998255 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9012a4aa-4a6a-4b44-b9a8-35264565fa33', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f53b5ffa-c2e5-4ee2-84c4-f0439be955b2'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:24:43.000928 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fb86983b-ca00-43be-bd35-bd8db6367dd3" -d '{"events": [{"server_uuid": "9012a4aa-4a6a-4b44-b9a8-35264565fa33", "name": "network-vif-plugged", "status": "completed", "tag": "f53b5ffa-c2e5-4ee2-84c4-f0439be955b2"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:24:43.025367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port f53b5ffa-c2e5-4ee2-84c4-f0439be955b2, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=f53b5ffa-c2e5-4ee2-84c4-f0439be955b2,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:43.031715 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=b850be71-e07d-41b3-a3f1-34aa5c56525f,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:43.035788 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:43.062677 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fb71aef-1c98-43d9-ae23-8fecbee3a06d req-427ab10b-66ab-4eaf-9df0-d30d8d588600 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:43.066013 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6fb71aef-1c98-43d9-ae23-8fecbee3a06d req-427ab10b-66ab-4eaf-9df0-d30d8d588600 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=73466791-f610-4f93-892b-3077db341121 HTTP/1.1" status: 200 len: 943 time: 0.2746270 Dec 09 21:24:43.070776 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:24:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-79bff7ac-cd0c-40cb-872e-2c6c5c5ca582 x-openstack-request-id: req-79bff7ac-cd0c-40cb-872e-2c6c5c5ca582 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:24:43.071221 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9012a4aa-4a6a-4b44-b9a8-35264565fa33", "name": "network-vif-plugged", "status": "completed", "tag": "f53b5ffa-c2e5-4ee2-84c4-f0439be955b2", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:24:43.071401 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-79bff7ac-cd0c-40cb-872e-2c6c5c5ca582 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:24:43.071814 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9012a4aa-4a6a-4b44-b9a8-35264565fa33', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f53b5ffa-c2e5-4ee2-84c4-f0439be955b2', 'code': 200} Dec 09 21:24:43.072289 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-19057a98-a364-4450-b6de-60b88918b715 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:43.074540 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b08fcb4-040f-42a5-aafd-924e648c4982 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:43.130099 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b08fcb4-040f-42a5-aafd-924e648c4982 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:43.130731 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=f53b5ffa-c2e5-4ee2-84c4-f0439be955b2,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:43.148250 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-177ea9e8-5f0b-47fd-85cf-3aa02da26cd2 admin admin] Deleting port afee0969-5b9e-4462-8043-47c41260d6aa {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:43.149518 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-177ea9e8-5f0b-47fd-85cf-3aa02da26cd2 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:43.179008 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e458bf9-d2d7-4455-befd-1cbf06c788a2 service neutron] Pushing event updated for resources: {'Port': ['ID=378fa265-e1b8-415f-9f0c-2bff04df170a,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:43.214636 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6fb71aef-1c98-43d9-ae23-8fecbee3a06d req-7663ab73-344e-456d-9bfd-7f92eab9a8bb tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1407282 Dec 09 21:24:43.227463 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-19057a98-a364-4450-b6de-60b88918b715 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:43.277743 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ab4a03f-f1fc-4884-aedc-c9d6430d6bcb req-8f299a84-3baa-49cd-965d-871de1d232d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:43.279967 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ab4a03f-f1fc-4884-aedc-c9d6430d6bcb req-8f299a84-3baa-49cd-965d-871de1d232d5 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=9012a4aa-4a6a-4b44-b9a8-35264565fa33 HTTP/1.1" status: 200 len: 1102 time: 0.1247382 Dec 09 21:24:43.309820 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-177ea9e8-5f0b-47fd-85cf-3aa02da26cd2 admin admin] For port afee0969-5b9e-4462-8043-47c41260d6aa, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=afee0969-5b9e-4462-8043-47c41260d6aa,segment=NetworkSegment(f50abd2e-e599-448f-8441-67314ef9ac54),segment_id=f50abd2e-e599-448f-8441-67314ef9ac54)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:43.310180 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-177ea9e8-5f0b-47fd-85cf-3aa02da26cd2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:43.336029 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-177ea9e8-5f0b-47fd-85cf-3aa02da26cd2 admin admin] Calling delete_port for afee0969-5b9e-4462-8043-47c41260d6aa owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:43.360166 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ab4a03f-f1fc-4884-aedc-c9d6430d6bcb req-b84b3954-4086-4a5a-bf49-be19c701ca48 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=50885dec-ee01-4c11-bc49-430c219f37b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0680234 Dec 09 21:24:43.546281 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-177ea9e8-5f0b-47fd-85cf-3aa02da26cd2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:43.573390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-177ea9e8-5f0b-47fd-85cf-3aa02da26cd2 admin admin] Pushing event deleted for resources: {'Port': ['ID=afee0969-5b9e-4462-8043-47c41260d6aa,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:43.583537 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e588819c-5a89-4820-82c6-5ac8ba582aa1 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:24:43.674820 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: e588819c-5a89-4820-82c6-5ac8ba582aa1 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:24:43.675519 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e588819c-5a89-4820-82c6-5ac8ba582aa1 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:24:43.780063 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b08fcb4-040f-42a5-aafd-924e648c4982 admin admin] Pushing event updated for resources: {'Port': ['ID=20d7dfe6-d481-4b2c-879f-23bab4173d92,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:43.896224 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b64e909-f7f6-4a8d-b7c8-0ab6290328a2 req-ae73a0ec-9ac4-43cc-866b-b3b5897deff8 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f7517580-ddaa-48b1-9288-a3db030a3443 HTTP/1.1" status: 200 len: 210 time: 0.0917454 Dec 09 21:24:43.958364 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-177ea9e8-5f0b-47fd-85cf-3aa02da26cd2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:43.966446 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-814ffe7c-94ef-4d14-a970-826109854704 req-5e458bf9-d2d7-4455-befd-1cbf06c788a2 service neutron] Attempting to bind port 378fa265-e1b8-415f-9f0c-2bff04df170a on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:24:43.966787 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-814ffe7c-94ef-4d14-a970-826109854704 req-5e458bf9-d2d7-4455-befd-1cbf06c788a2 service neutron] Attempting to bind port 378fa265-e1b8-415f-9f0c-2bff04df170a by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '77d1b765-2404-4dd1-ab6e-956ebecc3e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'c2615978-1c59-4fbb-826b-fc6aec14e987'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:24:43.967152 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-814ffe7c-94ef-4d14-a970-826109854704 req-5e458bf9-d2d7-4455-befd-1cbf06c788a2 service neutron] Attempting to bind port 378fa265-e1b8-415f-9f0c-2bff04df170a on network c2615978-1c59-4fbb-826b-fc6aec14e987 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:24:43.976638 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:24:44.011931 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-19057a98-a364-4450-b6de-60b88918b715 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:44.018893 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-19057a98-a364-4450-b6de-60b88918b715 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:44.020150 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-19057a98-a364-4450-b6de-60b88918b715 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/85b78320-b877-491f-8ad9-5490602e5b54 HTTP/1.1" status: 204 len: 168 time: 1.3052385 Dec 09 21:24:44.037859 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-814ffe7c-94ef-4d14-a970-826109854704 req-5e458bf9-d2d7-4455-befd-1cbf06c788a2 service neutron] Port 378fa265-e1b8-415f-9f0c-2bff04df170a on network c2615978-1c59-4fbb-826b-fc6aec14e987 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:24:44.038191 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-814ffe7c-94ef-4d14-a970-826109854704 req-5e458bf9-d2d7-4455-befd-1cbf06c788a2 service neutron] Attempting to bind port 378fa265-e1b8-415f-9f0c-2bff04df170a on network c2615978-1c59-4fbb-826b-fc6aec14e987 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:24:44.056637 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b08fcb4-040f-42a5-aafd-924e648c4982 admin admin] Network 31f694ab-9ca7-4e6a-a3ee-21a21efff365 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:44.067777 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19057a98-a364-4450-b6de-60b88918b715 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=85b78320-b877-491f-8ad9-5490602e5b54,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:44.071194 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-5b08fcb4-040f-42a5-aafd-924e648c4982 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:44.074762 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-814ffe7c-94ef-4d14-a970-826109854704 req-5e458bf9-d2d7-4455-befd-1cbf06c788a2 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 24, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:24:44.075103 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-814ffe7c-94ef-4d14-a970-826109854704 req-5e458bf9-d2d7-4455-befd-1cbf06c788a2 service neutron] Checking segment: {'id': '77d1b765-2404-4dd1-ab6e-956ebecc3e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'c2615978-1c59-4fbb-826b-fc6aec14e987'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:24:44.076083 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-814ffe7c-94ef-4d14-a970-826109854704 req-5e458bf9-d2d7-4455-befd-1cbf06c788a2 service neutron] Bound using segment: {'id': '77d1b765-2404-4dd1-ab6e-956ebecc3e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'c2615978-1c59-4fbb-826b-fc6aec14e987'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:24:44.076554 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-814ffe7c-94ef-4d14-a970-826109854704 req-5e458bf9-d2d7-4455-befd-1cbf06c788a2 service neutron] Bound port: 378fa265-e1b8-415f-9f0c-2bff04df170a, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '77d1b765-2404-4dd1-ab6e-956ebecc3e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'c2615978-1c59-4fbb-826b-fc6aec14e987'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:24:44.076887 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-814ffe7c-94ef-4d14-a970-826109854704 req-5e458bf9-d2d7-4455-befd-1cbf06c788a2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:44.145575 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:44.145955 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:44.160776 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d91be68-ba6b-45a0-bc5e-56008ed252dd req-cc24df6c-0f2d-40b3-8db5-661f238ad8ab tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:44.162724 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d91be68-ba6b-45a0-bc5e-56008ed252dd req-cc24df6c-0f2d-40b3-8db5-661f238ad8ab tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/ports?device_id=9012a4aa-4a6a-4b44-b9a8-35264565fa33 HTTP/1.1" status: 200 len: 950 time: 0.1282387 Dec 09 21:24:44.321287 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b850be71-e07d-41b3-a3f1-34aa5c56525f up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:24:44.432402 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port b850be71-e07d-41b3-a3f1-34aa5c56525f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:44.432835 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:44.443520 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:44.468361 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:44.472536 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5b08fcb4-040f-42a5-aafd-924e648c4982 admin admin] Router d9739f4a-16b6-4e7e-8a7e-71716eacbe2d has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:24:44.498951 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d91be68-ba6b-45a0-bc5e-56008ed252dd req-ef46b2d3-cb2c-4e35-bcf4-bab11208a1e1 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/security-groups?id=50885dec-ee01-4c11-bc49-430c219f37b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3242347 Dec 09 21:24:44.523058 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dddf4140-8223-4566-8f9e-b19725427595 req-42bed0bf-acfc-460c-99fb-e4d1eb80899f tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:44.525089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dddf4140-8223-4566-8f9e-b19725427595 req-42bed0bf-acfc-460c-99fb-e4d1eb80899f tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=73466791-f610-4f93-892b-3077db341121 HTTP/1.1" status: 200 len: 943 time: 0.1946225 Dec 09 21:24:44.530255 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4faefdf4-3c34-46e2-aa78-44ca5c3b9f70 None None] Provisioning complete for port 20d7dfe6-d481-4b2c-879f-23bab4173d92 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:44.530632 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4faefdf4-3c34-46e2-aa78-44ca5c3b9f70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:44.567673 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-177ea9e8-5f0b-47fd-85cf-3aa02da26cd2 admin admin] Router 0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:24:44.580972 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Pushing event updated for resources: {'Port': ['ID=0c3b6cc8-3628-4374-be2a-ae9bb603880e,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:44.600012 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36792) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:44.605326 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dddf4140-8223-4566-8f9e-b19725427595 req-a1a97c85-f862-41f9-92a0-ec6647e23af7 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0690136 Dec 09 21:24:44.631571 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-296c7573-3312-4e6e-af6c-2dfcc42b379e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:44.631873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:44.631873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:44.631873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:44.631873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:44.631873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:44.631873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:44.631873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:44.631873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:44.631873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:44.631873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:44.631873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:44.632857 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:44.632857 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:24:44.636774 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-4faefdf4-3c34-46e2-aa78-44ca5c3b9f70 None None] Port 20d7dfe6-d481-4b2c-879f-23bab4173d92 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:24:44.667976 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-814ffe7c-94ef-4d14-a970-826109854704 req-5e458bf9-d2d7-4455-befd-1cbf06c788a2 service neutron] For port 378fa265-e1b8-415f-9f0c-2bff04df170a, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:24:44.675109 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-814ffe7c-94ef-4d14-a970-826109854704 req-5e458bf9-d2d7-4455-befd-1cbf06c788a2 service neutron] For port 378fa265-e1b8-415f-9f0c-2bff04df170a, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=378fa265-e1b8-415f-9f0c-2bff04df170a,segment=NetworkSegment(77d1b765-2404-4dd1-ab6e-956ebecc3e04),segment_id=77d1b765-2404-4dd1-ab6e-956ebecc3e04)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:24:44.709834 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:44.714591 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-814ffe7c-94ef-4d14-a970-826109854704 req-5e458bf9-d2d7-4455-befd-1cbf06c788a2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:44.803379 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-814ffe7c-94ef-4d14-a970-826109854704 req-5e458bf9-d2d7-4455-befd-1cbf06c788a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:44.804095 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-814ffe7c-94ef-4d14-a970-826109854704 req-5e458bf9-d2d7-4455-befd-1cbf06c788a2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:44.805512 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-814ffe7c-94ef-4d14-a970-826109854704 req-5e458bf9-d2d7-4455-befd-1cbf06c788a2 service neutron] 10.222.0.31 "PUT /v2.0/ports/378fa265-e1b8-415f-9f0c-2bff04df170a HTTP/1.1" status: 200 len: 1092 time: 5.0943191 Dec 09 21:24:44.806071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '73466791-f610-4f93-892b-3077db341121', 'tag': '378fa265-e1b8-415f-9f0c-2bff04df170a'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:24:44.808370 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3c6d1e04-8957-45eb-8668-9b9713541e31" -d '{"events": [{"name": "network-changed", "server_uuid": "73466791-f610-4f93-892b-3077db341121", "tag": "378fa265-e1b8-415f-9f0c-2bff04df170a"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:24:44.809658 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-177ea9e8-5f0b-47fd-85cf-3aa02da26cd2 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:24:44.817584 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-177ea9e8-5f0b-47fd-85cf-3aa02da26cd2 admin admin] 10.222.0.13 "PUT /v2.0/routers/0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.3675253 Dec 09 21:24:44.823959 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36796) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:44.845847 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63cefbbc-4e01-45f8-8fa4-b960149c2c01 None None] Sync routers for ids ['0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:24:44.873578 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63cefbbc-4e01-45f8-8fa4-b960149c2c01 None None] Routers {'0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:24:44.876547 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-63cefbbc-4e01-45f8-8fa4-b960149c2c01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:44.901936 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-296c7573-3312-4e6e-af6c-2dfcc42b379e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:44.911821 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-296c7573-3312-4e6e-af6c-2dfcc42b379e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:44.989060 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-296c7573-3312-4e6e-af6c-2dfcc42b379e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ca31c1f76ab743d48a09adb25fa416a1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3823380 Dec 09 21:24:44.996675 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36800) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:45.010660 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-296c7573-3312-4e6e-af6c-2dfcc42b379e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a79d8dab-54b8-47c5-8ea1-0d07b25c33ba,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:45.020337 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78fd0071-2928-4f39-b5c1-fec2af913f61 admin admin] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:45.033475 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Network ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:45.035195 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5b08fcb4-040f-42a5-aafd-924e648c4982 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:24:45.051101 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5b08fcb4-040f-42a5-aafd-924e648c4982 admin admin] 10.222.0.13 "PUT /v2.0/routers/d9739f4a-16b6-4e7e-8a7e-71716eacbe2d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.2386949 Dec 09 21:24:45.054451 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6805644-d888-4953-93f2-92b757273979 None None] Sync routers for ids ['d9739f4a-16b6-4e7e-8a7e-71716eacbe2d'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:24:45.056766 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:24:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f386dcf9-ebf4-4ca0-bef2-1ca4aa125c50 x-openstack-request-id: req-f386dcf9-ebf4-4ca0-bef2-1ca4aa125c50 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:24:45.057060 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "73466791-f610-4f93-892b-3077db341121", "tag": "378fa265-e1b8-415f-9f0c-2bff04df170a", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:24:45.057310 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f386dcf9-ebf4-4ca0-bef2-1ca4aa125c50 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:24:45.057705 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '73466791-f610-4f93-892b-3077db341121', 'tag': '378fa265-e1b8-415f-9f0c-2bff04df170a', 'status': 'completed', 'code': 200} Dec 09 21:24:45.073325 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6805644-d888-4953-93f2-92b757273979 None None] Routers {'d9739f4a-16b6-4e7e-8a7e-71716eacbe2d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:24:45.076998 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a6805644-d888-4953-93f2-92b757273979 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['d9739f4a-16b6-4e7e-8a7e-71716eacbe2d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:45.100661 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:45.105392 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1953755a-9c1a-4190-99bc-f24d56be8e4b req-848e3147-a15b-494d-8a03-da2d557297fe tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f7517580-ddaa-48b1-9288-a3db030a3443 HTTP/1.1" status: 200 len: 210 time: 0.0782204 Dec 09 21:24:45.150349 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-63cefbbc-4e01-45f8-8fa4-b960149c2c01 None None] Set router 0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:24:45.210343 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78fd0071-2928-4f39-b5c1-fec2af913f61 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:45.238846 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c369dff9-f53d-4d05-94d3-b2f6c91babd8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:45.278181 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e458bf9-d2d7-4455-befd-1cbf06c788a2 service neutron] Pushing event updated for resources: {'Port': ['ID=378fa265-e1b8-415f-9f0c-2bff04df170a,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:45.305098 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-814ffe7c-94ef-4d14-a970-826109854704 req-fddfc832-77fb-4477-bcca-103c31a2fe78 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:45.306748 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-814ffe7c-94ef-4d14-a970-826109854704 req-fddfc832-77fb-4477-bcca-103c31a2fe78 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6b406d0a75bb4ddd96157ff43fd37096&device_id=73466791-f610-4f93-892b-3077db341121 HTTP/1.1" status: 200 len: 1095 time: 0.2482500 Dec 09 21:24:45.314841 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ec026541-8d85-4ca5-aff6-7d62c0afec61 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:45.333812 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-a6805644-d888-4953-93f2-92b757273979 None None] Set router d9739f4a-16b6-4e7e-8a7e-71716eacbe2d gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:24:45.411079 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c369dff9-f53d-4d05-94d3-b2f6c91babd8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:45.482048 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-814ffe7c-94ef-4d14-a970-826109854704 req-9cc91781-8a18-4424-97d4-9c2db737739c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=378fa265-e1b8-415f-9f0c-2bff04df170a HTTP/1.1" status: 200 len: 217 time: 0.1642103 Dec 09 21:24:45.571062 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-78fd0071-2928-4f39-b5c1-fec2af913f61 admin admin] Deleting port df5c9696-5b31-485a-855f-3e6a07c94a2f {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:45.571473 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78fd0071-2928-4f39-b5c1-fec2af913f61 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:45.596208 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Router 48f26966-6ebd-4ded-9b83-e7fdb71c4bf7 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:24:45.603953 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-0e1acde7-c2ee-4e49-9008-e980c1f1a1c0 None None] Provisioning complete for port 0c3b6cc8-3628-4374-be2a-ae9bb603880e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:45.610188 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-814ffe7c-94ef-4d14-a970-826109854704 req-2f6707dc-65c0-4bb5-bb3c-a5e1b3d470b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:45.610899 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0e1acde7-c2ee-4e49-9008-e980c1f1a1c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:45.611560 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-814ffe7c-94ef-4d14-a970-826109854704 req-2f6707dc-65c0-4bb5-bb3c-a5e1b3d470b9 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=1f5c65f5-5864-4e4e-bede-1bfc7f6e8e68 HTTP/1.1" status: 200 len: 861 time: 0.1191108 Dec 09 21:24:45.690834 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c369dff9-f53d-4d05-94d3-b2f6c91babd8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:45.693795 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c369dff9-f53d-4d05-94d3-b2f6c91babd8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:45.698003 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c369dff9-f53d-4d05-94d3-b2f6c91babd8 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/a79d8dab-54b8-47c5-8ea1-0d07b25c33ba HTTP/1.1" status: 204 len: 168 time: 0.7003784 Dec 09 21:24:45.708303 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-814ffe7c-94ef-4d14-a970-826109854704 req-a545efb8-414a-4552-a814-5bfe1edb8534 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=c2615978-1c59-4fbb-826b-fc6aec14e987&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0762708 Dec 09 21:24:45.742027 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-0e1acde7-c2ee-4e49-9008-e980c1f1a1c0 None None] Port 0c3b6cc8-3628-4374-be2a-ae9bb603880e cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:24:45.768709 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-63cefbbc-4e01-45f8-8fa4-b960149c2c01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5', 'name': 'tempest-FloatingIPsTestJSON-2142506536-router', 'tenant_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.254'}], 'enable_snat': True}, 'gw_port_id': 'df5c9696-5b31-485a-855f-3e6a07c94a2f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:12Z', 'updated_at': '2021-12-09T21:24:43Z', 'revision_number': 5, 'project_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'gw_port': {'id': 'df5c9696-5b31-485a-855f-3e6a07c94a2f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:03:9f:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 760, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.254', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:13Z', 'updated_at': '2021-12-09T21:24:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:45.807829 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c369dff9-f53d-4d05-94d3-b2f6c91babd8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a79d8dab-54b8-47c5-8ea1-0d07b25c33ba,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:45.815425 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63cefbbc-4e01-45f8-8fa4-b960149c2c01 None None] Checking router: 0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:24:45.845073 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-78fd0071-2928-4f39-b5c1-fec2af913f61 admin admin] For port df5c9696-5b31-485a-855f-3e6a07c94a2f, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=df5c9696-5b31-485a-855f-3e6a07c94a2f,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:45.846024 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78fd0071-2928-4f39-b5c1-fec2af913f61 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:45.857663 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63cefbbc-4e01-45f8-8fa4-b960149c2c01 None None] Routers {'0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:24:45.859330 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-63cefbbc-4e01-45f8-8fa4-b960149c2c01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:45.867226 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a6805644-d888-4953-93f2-92b757273979 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9739f4a-16b6-4e7e-8a7e-71716eacbe2d', 'name': 'tempest-FloatingIPDetailsTestJSON-407064217-router', 'tenant_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.86'}], 'enable_snat': True}, 'gw_port_id': 'b850be71-e07d-41b3-a3f1-34aa5c56525f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:32Z', 'updated_at': '2021-12-09T21:24:41Z', 'revision_number': 4, 'project_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'gw_port': {'id': 'b850be71-e07d-41b3-a3f1-34aa5c56525f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:2a:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9739f4a-16b6-4e7e-8a7e-71716eacbe2d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 807, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:33Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '20d7dfe6-d481-4b2c-879f-23bab4173d92', 'name': '', 'network_id': '31f694ab-9ca7-4e6a-a3ee-21a21efff365', 'tenant_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'mac_address': 'fa:16:3e:2a:bc:3e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9739f4a-16b6-4e7e-8a7e-71716eacbe2d', 'device_owner': 'network:router_interface', 'standard_attr_id': 812, 'fixed_ips': [{'subnet_id': '9a606ad9-369f-4ab7-a435-14aa18212259', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:38Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 2, 'project_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'subnets': [{'id': '9a606ad9-369f-4ab7-a435-14aa18212259', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:45.908610 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-78fd0071-2928-4f39-b5c1-fec2af913f61 admin admin] Calling delete_port for df5c9696-5b31-485a-855f-3e6a07c94a2f owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:45.938173 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6805644-d888-4953-93f2-92b757273979 None None] Checking router: d9739f4a-16b6-4e7e-8a7e-71716eacbe2d for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:24:45.938460 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6805644-d888-4953-93f2-92b757273979 None None] Updating router d9739f4a-16b6-4e7e-8a7e-71716eacbe2d port 20d7dfe6-d481-4b2c-879f-23bab4173d92 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:24:45.994553 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-a6805644-d888-4953-93f2-92b757273979 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:46.001415 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-63cefbbc-4e01-45f8-8fa4-b960149c2c01 None None] Set router 0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:24:46.056888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6ffc64e-ad99-4e50-8cf8-841536215a52 req-3e5ec107-038e-48f4-aa21-37cd8e17f101 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:46.058538 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6ffc64e-ad99-4e50-8cf8-841536215a52 req-3e5ec107-038e-48f4-aa21-37cd8e17f101 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/ports?device_id=9012a4aa-4a6a-4b44-b9a8-35264565fa33 HTTP/1.1" status: 200 len: 950 time: 0.3593962 Dec 09 21:24:46.099294 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-63cefbbc-4e01-45f8-8fa4-b960149c2c01 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5', 'name': 'tempest-FloatingIPsTestJSON-2142506536-router', 'tenant_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:12Z', 'updated_at': '2021-12-09T21:24:45Z', 'revision_number': 6, 'project_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:46.114403 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-814ffe7c-94ef-4d14-a970-826109854704 req-d2a503bb-cbdf-4662-a580-6a2d1980c325 service neutron] 10.222.0.31 "GET /v2.0/networks/c2615978-1c59-4fbb-826b-fc6aec14e987?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3909547 Dec 09 21:24:46.120238 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:24:46.136182 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2ca2983a-81b0-4f3c-9f97-20b8b10dabda admin admin] 10.222.0.13 "PUT /v2.0/routers/48f26966-6ebd-4ded-9b83-e7fdb71c4bf7/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.1043670 Dec 09 21:24:46.138989 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] Sync routers for ids ['48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:24:46.150221 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63cefbbc-4e01-45f8-8fa4-b960149c2c01 None None] The sync data for ids ['0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5'] in n-d-713301-27 is: [{'id': '0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5', 'name': 'tempest-FloatingIPsTestJSON-2142506536-router', 'tenant_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:12Z', 'updated_at': '2021-12-09T21:24:45Z', 'revision_number': 6, 'project_id': 'f3017ec6ec044e6ea364d4db8048d68d', 'gw_port_host': None}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:24:46.153205 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] Routers {'48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:24:46.153812 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:46.284913 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cc38869f-31c8-4ea5-a001-683a5e81cfbd req-00277b33-6f41-4656-a654-68ac662f7730 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 0.5844562 Dec 09 21:24:46.295215 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-814ffe7c-94ef-4d14-a970-826109854704 req-5b93d9fc-b8f9-4144-9e44-ed3e66ec4dab service neutron] 10.222.0.31 "GET /v2.0/networks/c2615978-1c59-4fbb-826b-fc6aec14e987?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1717687 Dec 09 21:24:46.298850 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-cc38869f-31c8-4ea5-a001-683a5e81cfbd req-091ec060-c513-47d1-b657-fa1801fd37f6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:46.316691 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-ec026541-8d85-4ca5-aff6-7d62c0afec61 admin admin] Deleting port cd61cf32-db9c-49d2-8b1c-50a6abb2e135 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:46.317035 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ec026541-8d85-4ca5-aff6-7d62c0afec61 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:46.418700 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6ffc64e-ad99-4e50-8cf8-841536215a52 req-b363dade-166b-4a9e-a761-24d938ddf68b tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/security-groups?id=50885dec-ee01-4c11-bc49-430c219f37b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3400931 Dec 09 21:24:46.421943 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] Set router 48f26966-6ebd-4ded-9b83-e7fdb71c4bf7 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:24:46.472651 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-a6805644-d888-4953-93f2-92b757273979 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:46.486313 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-a6805644-d888-4953-93f2-92b757273979 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:46.518461 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cc38869f-31c8-4ea5-a001-683a5e81cfbd req-091ec060-c513-47d1-b657-fa1801fd37f6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:46.584649 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-ec026541-8d85-4ca5-aff6-7d62c0afec61 admin admin] For port cd61cf32-db9c-49d2-8b1c-50a6abb2e135, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=cd61cf32-db9c-49d2-8b1c-50a6abb2e135,segment=NetworkSegment(e74944d5-8114-4627-bc98-88385d8b16f0),segment_id=e74944d5-8114-4627-bc98-88385d8b16f0)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:46.585041 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ec026541-8d85-4ca5-aff6-7d62c0afec61 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:46.591269 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-995d6d4c-8161-4a31-898d-cb683610c955 None None] Pushing event updated for resources: {'Port': ['ID=20d7dfe6-d481-4b2c-879f-23bab4173d92,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:46.598493 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-ec026541-8d85-4ca5-aff6-7d62c0afec61 admin admin] Calling delete_port for cd61cf32-db9c-49d2-8b1c-50a6abb2e135 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:46.738148 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ce39381-a451-4556-a4ce-8383806187f6 req-e1efbd60-3140-4921-9472-4bb6b936b292 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:46.742476 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ce39381-a451-4556-a4ce-8383806187f6 req-e1efbd60-3140-4921-9472-4bb6b936b292 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=73466791-f610-4f93-892b-3077db341121 HTTP/1.1" status: 200 len: 943 time: 0.1742864 Dec 09 21:24:46.755481 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-a6805644-d888-4953-93f2-92b757273979 None None] Attempting to bind port 20d7dfe6-d481-4b2c-879f-23bab4173d92 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:24:46.755934 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-a6805644-d888-4953-93f2-92b757273979 None None] Attempting to bind port 20d7dfe6-d481-4b2c-879f-23bab4173d92 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '7cdf46cd-1cf9-47c2-bde8-571e75cabe6a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '31f694ab-9ca7-4e6a-a3ee-21a21efff365'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:24:46.756222 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a6805644-d888-4953-93f2-92b757273979 None None] Attempting to bind port 20d7dfe6-d481-4b2c-879f-23bab4173d92 on network 31f694ab-9ca7-4e6a-a3ee-21a21efff365 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:24:46.767611 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a6805644-d888-4953-93f2-92b757273979 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 24, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:24:46.768083 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a6805644-d888-4953-93f2-92b757273979 None None] Checking segment: {'id': '7cdf46cd-1cf9-47c2-bde8-571e75cabe6a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '31f694ab-9ca7-4e6a-a3ee-21a21efff365'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:24:46.768475 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-a6805644-d888-4953-93f2-92b757273979 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:46.768869 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a6805644-d888-4953-93f2-92b757273979 None None] Bound using segment: {'id': '7cdf46cd-1cf9-47c2-bde8-571e75cabe6a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '31f694ab-9ca7-4e6a-a3ee-21a21efff365'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:24:46.769337 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-a6805644-d888-4953-93f2-92b757273979 None None] Bound port: 20d7dfe6-d481-4b2c-879f-23bab4173d92, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7cdf46cd-1cf9-47c2-bde8-571e75cabe6a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '31f694ab-9ca7-4e6a-a3ee-21a21efff365'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:24:46.769779 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-a6805644-d888-4953-93f2-92b757273979 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:46.927520 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c6d1e04-8957-45eb-8668-9b9713541e31 req-bd17bcbf-e5ad-4ad1-9cf6-39f4081c6417 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:46.930078 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3c6d1e04-8957-45eb-8668-9b9713541e31 req-bd17bcbf-e5ad-4ad1-9cf6-39f4081c6417 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6b406d0a75bb4ddd96157ff43fd37096&device_id=73466791-f610-4f93-892b-3077db341121 HTTP/1.1" status: 200 len: 1095 time: 0.5686903 Dec 09 21:24:46.931278 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ec026541-8d85-4ca5-aff6-7d62c0afec61 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:46.963800 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec026541-8d85-4ca5-aff6-7d62c0afec61 admin admin] Pushing event deleted for resources: {'Port': ['ID=cd61cf32-db9c-49d2-8b1c-50a6abb2e135,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:46.995172 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-a6805644-d888-4953-93f2-92b757273979 None None] For port 20d7dfe6-d481-4b2c-879f-23bab4173d92, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:24:47.000848 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-a6805644-d888-4953-93f2-92b757273979 None None] For port 20d7dfe6-d481-4b2c-879f-23bab4173d92, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=20d7dfe6-d481-4b2c-879f-23bab4173d92,segment=NetworkSegment(7cdf46cd-1cf9-47c2-bde8-571e75cabe6a),segment_id=7cdf46cd-1cf9-47c2-bde8-571e75cabe6a)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:24:47.011109 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78fd0071-2928-4f39-b5c1-fec2af913f61 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:47.018206 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-a6805644-d888-4953-93f2-92b757273979 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:47.101620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78fd0071-2928-4f39-b5c1-fec2af913f61 admin admin] Pushing event deleted for resources: {'Port': ['ID=df5c9696-5b31-485a-855f-3e6a07c94a2f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:47.134040 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ce39381-a451-4556-a4ce-8383806187f6 req-c5304ff8-17aa-4173-b983-aa04141b0aa2 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3789966 Dec 09 21:24:47.174390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36840) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:47.190675 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6805644-d888-4953-93f2-92b757273979 None None] Routers {'d9739f4a-16b6-4e7e-8a7e-71716eacbe2d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:24:47.191184 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a6805644-d888-4953-93f2-92b757273979 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['d9739f4a-16b6-4e7e-8a7e-71716eacbe2d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:47.316826 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-995d6d4c-8161-4a31-898d-cb683610c955 None None] Pushing event updated for resources: {'Port': ['ID=20d7dfe6-d481-4b2c-879f-23bab4173d92,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:47.423039 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-17d3ebac-2f58-44ed-9a9b-bba7863a9780 req-3c4ac825-dc4a-4fd8-abdb-2179ead97c26 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f7517580-ddaa-48b1-9288-a3db030a3443 HTTP/1.1" status: 200 len: 210 time: 0.1136560 Dec 09 21:24:47.424520 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c6d1e04-8957-45eb-8668-9b9713541e31 req-bd56d67f-3764-40c5-bd5a-1e6cbbafe807 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:47.428756 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3c6d1e04-8957-45eb-8668-9b9713541e31 req-bd56d67f-3764-40c5-bd5a-1e6cbbafe807 service neutron] 10.222.0.31 "GET /v2.0/networks?id=c2615978-1c59-4fbb-826b-fc6aec14e987 HTTP/1.1" status: 200 len: 922 time: 0.4688594 Dec 09 21:24:47.431693 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78fd0071-2928-4f39-b5c1-fec2af913f61 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:47.518306 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-a6805644-d888-4953-93f2-92b757273979 None None] Set router d9739f4a-16b6-4e7e-8a7e-71716eacbe2d gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:24:47.577087 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f789d0cf-bdd7-492b-889f-f8dcf8beeb87 None None] Provisioning complete for port 20d7dfe6-d481-4b2c-879f-23bab4173d92 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:47.577731 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f789d0cf-bdd7-492b-889f-f8dcf8beeb87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:47.595097 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cc38869f-31c8-4ea5-a001-683a5e81cfbd req-091ec060-c513-47d1-b657-fa1801fd37f6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:47.606253 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-16dcf949-b0e4-48ad-b69e-4baf7bf676fa admin admin] Request body: {'network': {'name': 'tempest-VolumesAdminNegativeTest-860805887-network', 'tenant_id': '87694f06f4144186aac9c50bac43d5ec'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:47.697245 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'name': 'tempest-ServersTestFqdnHostnames-1853275289-router', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149'}], 'enable_snat': True}, 'gw_port_id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:32Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'gw_port': {'id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:92:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 809, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:33Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '0c3b6cc8-3628-4374-be2a-ae9bb603880e', 'name': '', 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'mac_address': 'fa:16:3e:01:4d:1c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 813, 'fixed_ips': [{'subnet_id': '9125b460-598b-4793-bfb4-08b07155042a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:39Z', 'updated_at': '2021-12-09T21:24:43Z', 'revision_number': 2, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'subnets': [{'id': '9125b460-598b-4793-bfb4-08b07155042a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:47.737937 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78fd0071-2928-4f39-b5c1-fec2af913f61 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:47.766241 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78fd0071-2928-4f39-b5c1-fec2af913f61 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:47.786500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-16dcf949-b0e4-48ad-b69e-4baf7bf676fa admin admin] Made reservation on behalf of 87694f06f4144186aac9c50bac43d5ec for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:24:47.789395 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-16dcf949-b0e4-48ad-b69e-4baf7bf676fa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:47.824468 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] Checking router: 48f26966-6ebd-4ded-9b83-e7fdb71c4bf7 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:24:47.824823 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] Updating router 48f26966-6ebd-4ded-9b83-e7fdb71c4bf7 port 0c3b6cc8-3628-4374-be2a-ae9bb603880e binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:24:47.846053 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-16dcf949-b0e4-48ad-b69e-4baf7bf676fa admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:47.883946 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78fd0071-2928-4f39-b5c1-fec2af913f61 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:47.884468 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-78fd0071-2928-4f39-b5c1-fec2af913f61 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:24:47.897420 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78fd0071-2928-4f39-b5c1-fec2af913f61 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:47.898568 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-78fd0071-2928-4f39-b5c1-fec2af913f61 admin admin] 10.222.0.13 "DELETE /v2.0/routers/0b40f0ce-d4cc-4486-94ef-a3d01a5d63f5 HTTP/1.1" status: 204 len: 168 time: 3.0761902 Dec 09 21:24:47.907416 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36850) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:47.929015 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a6805644-d888-4953-93f2-92b757273979 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9739f4a-16b6-4e7e-8a7e-71716eacbe2d', 'name': 'tempest-FloatingIPDetailsTestJSON-407064217-router', 'tenant_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.86'}], 'enable_snat': True}, 'gw_port_id': 'b850be71-e07d-41b3-a3f1-34aa5c56525f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:32Z', 'updated_at': '2021-12-09T21:24:41Z', 'revision_number': 4, 'project_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'gw_port': {'id': 'b850be71-e07d-41b3-a3f1-34aa5c56525f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:2a:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9739f4a-16b6-4e7e-8a7e-71716eacbe2d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 807, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:33Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '20d7dfe6-d481-4b2c-879f-23bab4173d92', 'name': '', 'network_id': '31f694ab-9ca7-4e6a-a3ee-21a21efff365', 'tenant_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'mac_address': 'fa:16:3e:2a:bc:3e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9739f4a-16b6-4e7e-8a7e-71716eacbe2d', 'device_owner': 'network:router_interface', 'standard_attr_id': 812, 'fixed_ips': [{'subnet_id': '9a606ad9-369f-4ab7-a435-14aa18212259', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:38Z', 'updated_at': '2021-12-09T21:24:46Z', 'revision_number': 4, 'project_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'subnets': [{'id': '9a606ad9-369f-4ab7-a435-14aa18212259', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:47.989227 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6805644-d888-4953-93f2-92b757273979 None None] The sync data for ids ['d9739f4a-16b6-4e7e-8a7e-71716eacbe2d'] in n-d-713301-27 is: [{'id': 'd9739f4a-16b6-4e7e-8a7e-71716eacbe2d', 'name': 'tempest-FloatingIPDetailsTestJSON-407064217-router', 'tenant_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.86'}], 'enable_snat': True}, 'gw_port_id': 'b850be71-e07d-41b3-a3f1-34aa5c56525f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:32Z', 'updated_at': '2021-12-09T21:24:41Z', 'revision_number': 4, 'project_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'gw_port': {'id': 'b850be71-e07d-41b3-a3f1-34aa5c56525f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:2a:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9739f4a-16b6-4e7e-8a7e-71716eacbe2d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 807, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:33Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '20d7dfe6-d481-4b2c-879f-23bab4173d92', 'name': '', 'network_id': '31f694ab-9ca7-4e6a-a3ee-21a21efff365', 'tenant_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'mac_address': 'fa:16:3e:2a:bc:3e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9739f4a-16b6-4e7e-8a7e-71716eacbe2d', 'device_owner': 'network:router_interface', 'standard_attr_id': 812, 'fixed_ips': [{'subnet_id': '9a606ad9-369f-4ab7-a435-14aa18212259', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:38Z', 'updated_at': '2021-12-09T21:24:46Z', 'revision_number': 4, 'project_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'subnets': [{'id': '9a606ad9-369f-4ab7-a435-14aa18212259', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:24:48.023289 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-cc38869f-31c8-4ea5-a001-683a5e81cfbd req-091ec060-c513-47d1-b657-fa1801fd37f6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Allocated IP 172.25.3.29 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/e3d18e33-189c-4e89-8b19-fbf11cce673b) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:24:48.024896 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device df5c9696-5b31-485a-855f-3e6a07c94a2f no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:24:48.030021 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:48.113306 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-5fcb604b-7647-4153-91df-24c13703f1c5 admin admin] Deleting subnet 433e7096-4021-4933-b1ca-57165b00a150 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:24:48.130086 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fcb604b-7647-4153-91df-24c13703f1c5 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:48.146486 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: df5c9696-5b31-485a-855f-3e6a07c94a2f {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:24:48.151120 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device df5c9696-5b31-485a-855f-3e6a07c94a2f not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:24:48.151776 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device afee0969-5b9e-4462-8043-47c41260d6aa no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:24:48.153909 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f789d0cf-bdd7-492b-889f-f8dcf8beeb87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:48.243348 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: afee0969-5b9e-4462-8043-47c41260d6aa {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:24:48.244938 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device afee0969-5b9e-4462-8043-47c41260d6aa not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:24:48.259519 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3c6d1e04-8957-45eb-8668-9b9713541e31 req-f772de28-e82d-4da7-b901-a7457f28ee33 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=378fa265-e1b8-415f-9f0c-2bff04df170a HTTP/1.1" status: 200 len: 217 time: 0.8153143 Dec 09 21:24:48.311201 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-16dcf949-b0e4-48ad-b69e-4baf7bf676fa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:48.329910 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c6d1e04-8957-45eb-8668-9b9713541e31 req-43c4a9c5-f68c-4830-92bd-12dfb43b80cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:48.331866 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3c6d1e04-8957-45eb-8668-9b9713541e31 req-43c4a9c5-f68c-4830-92bd-12dfb43b80cb service neutron] 10.222.0.31 "GET /v2.0/subnets?id=1f5c65f5-5864-4e4e-bede-1bfc7f6e8e68 HTTP/1.1" status: 200 len: 861 time: 0.0632892 Dec 09 21:24:48.416547 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cc38869f-31c8-4ea5-a001-683a5e81cfbd req-091ec060-c513-47d1-b657-fa1801fd37f6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:48.456252 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ec026541-8d85-4ca5-aff6-7d62c0afec61 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:48.458986 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-16dcf949-b0e4-48ad-b69e-4baf7bf676fa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:48.472318 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3c6d1e04-8957-45eb-8668-9b9713541e31 req-d549f21c-dc3d-44a7-a9cb-636f715de288 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=c2615978-1c59-4fbb-826b-fc6aec14e987&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0993268 Dec 09 21:24:48.531781 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16dcf949-b0e4-48ad-b69e-4baf7bf676fa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b7152147-ed7a-4a1f-b140-69adad7d753f,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:48.562566 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cc38869f-31c8-4ea5-a001-683a5e81cfbd req-091ec060-c513-47d1-b657-fa1801fd37f6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:48.655672 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:48.662611 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cc38869f-31c8-4ea5-a001-683a5e81cfbd req-091ec060-c513-47d1-b657-fa1801fd37f6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:48.665443 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 378fa265-e1b8-415f-9f0c-2bff04df170a details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:24:48.672508 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-091ec060-c513-47d1-b657-fa1801fd37f6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Pushing event updated for resources: {'Port': ['ID=e3d18e33-189c-4e89-8b19-fbf11cce673b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:48.684374 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-cc38869f-31c8-4ea5-a001-683a5e81cfbd req-091ec060-c513-47d1-b657-fa1801fd37f6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:48.690454 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-cc38869f-31c8-4ea5-a001-683a5e81cfbd req-091ec060-c513-47d1-b657-fa1801fd37f6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:24:48.741118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36858) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:48.794394 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 378fa265-e1b8-415f-9f0c-2bff04df170a, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=378fa265-e1b8-415f-9f0c-2bff04df170a,segment=NetworkSegment(77d1b765-2404-4dd1-ab6e-956ebecc3e04),segment_id=77d1b765-2404-4dd1-ab6e-956ebecc3e04)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:48.813987 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '378fa265-e1b8-415f-9f0c-2bff04df170a', 'network_id': 'c2615978-1c59-4fbb-826b-fc6aec14e987', 'port_id': '378fa265-e1b8-415f-9f0c-2bff04df170a', 'mac_address': 'fa:16:3e:c1:c4:63', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 147, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1f5c65f5-5864-4e4e-bede-1bfc7f6e8e68', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:24:48.816092 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:48.836862 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f789d0cf-bdd7-492b-889f-f8dcf8beeb87 None None] For port 20d7dfe6-d481-4b2c-879f-23bab4173d92, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=20d7dfe6-d481-4b2c-879f-23bab4173d92,segment=NetworkSegment(7cdf46cd-1cf9-47c2-bde8-571e75cabe6a),segment_id=7cdf46cd-1cf9-47c2-bde8-571e75cabe6a)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:48.862780 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cc38869f-31c8-4ea5-a001-683a5e81cfbd req-091ec060-c513-47d1-b657-fa1801fd37f6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:48.875121 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-456790b9-eb24-4691-9ac1-2e900fe2b264 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1684175526', 'description': 'tempest-description--1128862259'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:48.895026 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3c6d1e04-8957-45eb-8668-9b9713541e31 req-e242fbe1-ec91-4275-80b6-55abcffbf91a service neutron] 10.222.0.31 "GET /v2.0/networks/c2615978-1c59-4fbb-826b-fc6aec14e987?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4101210 Dec 09 21:24:48.898940 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:48.904413 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fcb604b-7647-4153-91df-24c13703f1c5 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:48.904645 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f789d0cf-bdd7-492b-889f-f8dcf8beeb87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:48.913190 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-16dcf949-b0e4-48ad-b69e-4baf7bf676fa admin admin] vlan segment allocate from pool success with {'vlan_id': 144, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:24:48.950132 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 378fa265-e1b8-415f-9f0c-2bff04df170a {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:24:48.986382 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 378fa265-e1b8-415f-9f0c-2bff04df170a, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=378fa265-e1b8-415f-9f0c-2bff04df170a,segment=NetworkSegment(77d1b765-2404-4dd1-ab6e-956ebecc3e04),segment_id=77d1b765-2404-4dd1-ab6e-956ebecc3e04)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:49.007825 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-67974239-83b8-4874-8b4c-2b457727f18d tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=3329fed690514d85b98adeb6691d89f2&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0795321 Dec 09 21:24:49.040247 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:49.051597 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-155ac339-8cb0-4967-984d-a7e43706ca40 None None] Pushing event updated for resources: {'Port': ['ID=0c3b6cc8-3628-4374-be2a-ae9bb603880e,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:49.059292 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3c6d1e04-8957-45eb-8668-9b9713541e31 req-56e51758-3495-40fc-bd64-09f2c970d405 service neutron] 10.222.0.31 "GET /v2.0/networks/c2615978-1c59-4fbb-826b-fc6aec14e987?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1578152 Dec 09 21:24:49.117600 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cc38869f-31c8-4ea5-a001-683a5e81cfbd req-091ec060-c513-47d1-b657-fa1801fd37f6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:49.135009 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-456790b9-eb24-4691-9ac1-2e900fe2b264 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:49.215165 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f789d0cf-bdd7-492b-889f-f8dcf8beeb87 None None] Pushing event updated for resources: {'Port': ['ID=20d7dfe6-d481-4b2c-879f-23bab4173d92,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:49.241649 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] Attempting to bind port 0c3b6cc8-3628-4374-be2a-ae9bb603880e on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:24:49.244507 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] Attempting to bind port 0c3b6cc8-3628-4374-be2a-ae9bb603880e by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '51116481-b9d7-45e1-bfed-86b419caae01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:24:49.245061 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] Attempting to bind port 0c3b6cc8-3628-4374-be2a-ae9bb603880e on network ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:24:49.275152 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 24, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:24:49.275896 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] Checking segment: {'id': '51116481-b9d7-45e1-bfed-86b419caae01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:24:49.276482 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:49.277283 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] Bound using segment: {'id': '51116481-b9d7-45e1-bfed-86b419caae01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:24:49.278111 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] Bound port: 0c3b6cc8-3628-4374-be2a-ae9bb603880e, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '51116481-b9d7-45e1-bfed-86b419caae01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:24:49.278702 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:49.280310 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ec026541-8d85-4ca5-aff6-7d62c0afec61 admin admin] Router 5cb2944b-70be-4f74-b4d0-e06f75765688 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:24:49.305701 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-400fbd0e-22f6-4de9-88df-e6c41ef417de None None] Provisioning complete for port 20d7dfe6-d481-4b2c-879f-23bab4173d92 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:49.306336 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-400fbd0e-22f6-4de9-88df-e6c41ef417de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:49.379410 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['378fa265-e1b8-415f-9f0c-2bff04df170a'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:24:49.467027 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] For port 0c3b6cc8-3628-4374-be2a-ae9bb603880e, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:24:49.471465 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] For port 0c3b6cc8-3628-4374-be2a-ae9bb603880e, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=0c3b6cc8-3628-4374-be2a-ae9bb603880e,segment=NetworkSegment(51116481-b9d7-45e1-bfed-86b419caae01),segment_id=51116481-b9d7-45e1-bfed-86b419caae01)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:24:49.489084 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ec026541-8d85-4ca5-aff6-7d62c0afec61 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:24:49.489669 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:49.508205 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5cba23f4-f601-4ba8-88f7-4b5a821ce5c7 None None] Sync routers for ids ['5cb2944b-70be-4f74-b4d0-e06f75765688'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:24:49.520751 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ec026541-8d85-4ca5-aff6-7d62c0afec61 admin admin] 10.222.0.13 "PUT /v2.0/routers/5cb2944b-70be-4f74-b4d0-e06f75765688/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.2606506 Dec 09 21:24:49.522678 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36868) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:49.552625 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5cba23f4-f601-4ba8-88f7-4b5a821ce5c7 None None] Routers {'5cb2944b-70be-4f74-b4d0-e06f75765688'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:24:49.555015 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5cba23f4-f601-4ba8-88f7-4b5a821ce5c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['5cb2944b-70be-4f74-b4d0-e06f75765688'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:49.556321 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=378fa265-e1b8-415f-9f0c-2bff04df170a,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:49.620681 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-155ac339-8cb0-4967-984d-a7e43706ca40 None None] Pushing event updated for resources: {'Port': ['ID=0c3b6cc8-3628-4374-be2a-ae9bb603880e,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:49.661697 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] Routers {'48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:24:49.662343 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:49.855035 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 20d7dfe6-d481-4b2c-879f-23bab4173d92 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:24:49.875154 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-55aa9e89-d351-461f-9027-c5ea35205661 admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:49.908751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ada4507e-0ecf-4782-83f7-45e83cf448df None None] Provisioning complete for port 0c3b6cc8-3628-4374-be2a-ae9bb603880e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:49.908751 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ada4507e-0ecf-4782-83f7-45e83cf448df None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:49.924884 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-5cba23f4-f601-4ba8-88f7-4b5a821ce5c7 None None] Set router 5cb2944b-70be-4f74-b4d0-e06f75765688 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:24:49.927259 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-16dcf949-b0e4-48ad-b69e-4baf7bf676fa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:49.927775 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-16dcf949-b0e4-48ad-b69e-4baf7bf676fa admin admin] Added segment 7ba7eff4-a37f-4acb-b160-b374a7d3afdf of type vlan for network 419425e5-89f0-4884-91f7-260c4b9d176a Dec 09 21:24:50.077307 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] Set router 48f26966-6ebd-4ded-9b83-e7fdb71c4bf7 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:24:50.084061 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-16dcf949-b0e4-48ad-b69e-4baf7bf676fa admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:50.092624 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-55aa9e89-d351-461f-9027-c5ea35205661 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:50.146163 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 20d7dfe6-d481-4b2c-879f-23bab4173d92 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:50.146550 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:50.158769 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-9bbfa88f-f376-4e28-8753-d7394ef01218 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:50.167129 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-9bbfa88f-f376-4e28-8753-d7394ef01218 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 1.1583650 Dec 09 21:24:50.186926 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-55aa9e89-d351-461f-9027-c5ea35205661 admin admin] Deleting port 49e167c2-19e7-4bc9-9de1-decd671125c0 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:50.188047 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-55aa9e89-d351-461f-9027-c5ea35205661 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:50.247162 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-2671efa3-88af-49f5-afbc-3216d12f26e2 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/quotas/3329fed690514d85b98adeb6691d89f2 HTTP/1.1" status: 200 len: 375 time: 0.0790749 Dec 09 21:24:50.306872 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-55aa9e89-d351-461f-9027-c5ea35205661 admin admin] For port 49e167c2-19e7-4bc9-9de1-decd671125c0, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=49e167c2-19e7-4bc9-9de1-decd671125c0,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:50.307676 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-55aa9e89-d351-461f-9027-c5ea35205661 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:50.321578 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5cba23f4-f601-4ba8-88f7-4b5a821ce5c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'name': 'tempest-ServersTestManualDisk-255636487-router', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26'}], 'enable_snat': True}, 'gw_port_id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:21:59Z', 'updated_at': '2021-12-09T21:24:46Z', 'revision_number': 5, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'gw_port': {'id': '49e167c2-19e7-4bc9-9de1-decd671125c0', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:df:cd:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'device_owner': 'network:router_gateway', 'standard_attr_id': 623, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.26', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:22:02Z', 'updated_at': '2021-12-09T21:22:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:50.333992 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-55aa9e89-d351-461f-9027-c5ea35205661 admin admin] Calling delete_port for 49e167c2-19e7-4bc9-9de1-decd671125c0 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:50.372033 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5cba23f4-f601-4ba8-88f7-4b5a821ce5c7 None None] Checking router: 5cb2944b-70be-4f74-b4d0-e06f75765688 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:24:50.381127 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fcb604b-7647-4153-91df-24c13703f1c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:50.384145 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5cba23f4-f601-4ba8-88f7-4b5a821ce5c7 None None] Routers {'5cb2944b-70be-4f74-b4d0-e06f75765688'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:24:50.384938 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5cba23f4-f601-4ba8-88f7-4b5a821ce5c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['5cb2944b-70be-4f74-b4d0-e06f75765688'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:50.386742 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-16dcf949-b0e4-48ad-b69e-4baf7bf676fa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:50.387760 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16dcf949-b0e4-48ad-b69e-4baf7bf676fa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:50.388347 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-16dcf949-b0e4-48ad-b69e-4baf7bf676fa admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:50.420594 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-456790b9-eb24-4691-9ac1-2e900fe2b264 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:50.465428 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-456790b9-eb24-4691-9ac1-2e900fe2b264 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:50.499042 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ada4507e-0ecf-4782-83f7-45e83cf448df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:50.509008 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-5cba23f4-f601-4ba8-88f7-4b5a821ce5c7 None None] Set router 5cb2944b-70be-4f74-b4d0-e06f75765688 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:24:50.526498 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 378fa265-e1b8-415f-9f0c-2bff04df170a up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:24:50.526752 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-16dcf949-b0e4-48ad-b69e-4baf7bf676fa admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 3.3384714 Dec 09 21:24:50.535804 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36870) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:50.562458 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5cba23f4-f601-4ba8-88f7-4b5a821ce5c7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'name': 'tempest-ServersTestManualDisk-255636487-router', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:21:59Z', 'updated_at': '2021-12-09T21:24:50Z', 'revision_number': 6, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:50.570060 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-456790b9-eb24-4691-9ac1-2e900fe2b264 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4aaea988-139c-4402-b4d7-14ee4ed56291,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:50.576386 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-c28d98db-0f83-4264-bf38-bf39eb00dd1e tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=3329fed690514d85b98adeb6691d89f2&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2608435 Dec 09 21:24:50.586817 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a90cb694-f283-421e-95af-c3e2f9a91124 admin admin] Request body: {'subnet': {'network_id': '419425e5-89f0-4884-91f7-260c4b9d176a', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesAdminNegativeTest-860805887-subnet', 'tenant_id': '87694f06f4144186aac9c50bac43d5ec', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:50.604725 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16dcf949-b0e4-48ad-b69e-4baf7bf676fa admin admin] Pushing event updated for resources: {'Network': ['ID=419425e5-89f0-4884-91f7-260c4b9d176a,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:50.609391 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-456790b9-eb24-4691-9ac1-2e900fe2b264 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:50.615927 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-456790b9-eb24-4691-9ac1-2e900fe2b264 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 1.7459373 Dec 09 21:24:50.619775 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36872) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:50.622502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ada4507e-0ecf-4782-83f7-45e83cf448df None None] For port 0c3b6cc8-3628-4374-be2a-ae9bb603880e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=0c3b6cc8-3628-4374-be2a-ae9bb603880e,segment=NetworkSegment(51116481-b9d7-45e1-bfed-86b419caae01),segment_id=51116481-b9d7-45e1-bfed-86b419caae01)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:50.634032 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-98759a58-2e99-46c3-8358-220ce16032d7 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Request body: {'security_group_rule': {'security_group_id': '4aaea988-139c-4402-b4d7-14ee4ed56291', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:50.637698 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5cba23f4-f601-4ba8-88f7-4b5a821ce5c7 None None] The sync data for ids ['5cb2944b-70be-4f74-b4d0-e06f75765688'] in n-d-713301-27 is: [{'id': '5cb2944b-70be-4f74-b4d0-e06f75765688', 'name': 'tempest-ServersTestManualDisk-255636487-router', 'tenant_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:21:59Z', 'updated_at': '2021-12-09T21:24:50Z', 'revision_number': 6, 'project_id': '2429d4a7c27042e7ab6a04a9cf722b47', 'gw_port_host': None}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:24:50.675507 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 419425e5-89f0-4884-91f7-260c4b9d176a details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:24:50.685061 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ada4507e-0ecf-4782-83f7-45e83cf448df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:50.694464 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a90cb694-f283-421e-95af-c3e2f9a91124 admin admin] Made reservation on behalf of 87694f06f4144186aac9c50bac43d5ec for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:24:50.697961 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a90cb694-f283-421e-95af-c3e2f9a91124 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:50.705928 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cc38869f-31c8-4ea5-a001-683a5e81cfbd req-091ec060-c513-47d1-b657-fa1801fd37f6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:50.708779 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fcb604b-7647-4153-91df-24c13703f1c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:50.731465 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cc38869f-31c8-4ea5-a001-683a5e81cfbd req-091ec060-c513-47d1-b657-fa1801fd37f6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:50.773741 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fcb604b-7647-4153-91df-24c13703f1c5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=433e7096-4021-4933-b1ca-57165b00a150,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:50.787536 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-55aa9e89-d351-461f-9027-c5ea35205661 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:50.808212 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fcb604b-7647-4153-91df-24c13703f1c5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:50.814950 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5fcb604b-7647-4153-91df-24c13703f1c5 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/433e7096-4021-4933-b1ca-57165b00a150 HTTP/1.1" status: 204 len: 168 time: 2.9032409 Dec 09 21:24:50.822496 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-98759a58-2e99-46c3-8358-220ce16032d7 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:50.872031 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36874) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:50.875159 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51d76b49-23d3-42f6-a9e5-e3ce18867184 None None] Network 07db6bfe-0f5b-4d09-85c8-6bcad2644162 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:24:50.899118 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55aa9e89-d351-461f-9027-c5ea35205661 admin admin] Pushing event deleted for resources: {'Port': ['ID=49e167c2-19e7-4bc9-9de1-decd671125c0,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:50.985647 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-091ec060-c513-47d1-b657-fa1801fd37f6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Pushing event updated for resources: {'Port': ['ID=e3d18e33-189c-4e89-8b19-fbf11cce673b,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:51.022189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ada4507e-0ecf-4782-83f7-45e83cf448df None None] Pushing event updated for resources: {'Port': ['ID=0c3b6cc8-3628-4374-be2a-ae9bb603880e,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:51.032107 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 378fa265-e1b8-415f-9f0c-2bff04df170a completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:24:51.033896 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-55aa9e89-d351-461f-9027-c5ea35205661 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.078296 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e3827626-92df-4e8b-b823-e93610761483 None None] Provisioning complete for port 0c3b6cc8-3628-4374-be2a-ae9bb603880e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:51.085792 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e3827626-92df-4e8b-b823-e93610761483 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.091233 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 378fa265-e1b8-415f-9f0c-2bff04df170a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:51.091638 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.133350 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cc38869f-31c8-4ea5-a001-683a5e81cfbd req-091ec060-c513-47d1-b657-fa1801fd37f6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.179063 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-55aa9e89-d351-461f-9027-c5ea35205661 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.182144 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-55aa9e89-d351-461f-9027-c5ea35205661 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.207641 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-98759a58-2e99-46c3-8358-220ce16032d7 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.227044 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'name': 'tempest-ServersTestFqdnHostnames-1853275289-router', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149'}], 'enable_snat': True}, 'gw_port_id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:32Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'gw_port': {'id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:92:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 809, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:33Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '0c3b6cc8-3628-4374-be2a-ae9bb603880e', 'name': '', 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'mac_address': 'fa:16:3e:01:4d:1c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 813, 'fixed_ips': [{'subnet_id': '9125b460-598b-4793-bfb4-08b07155042a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:39Z', 'updated_at': '2021-12-09T21:24:49Z', 'revision_number': 4, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'subnets': [{'id': '9125b460-598b-4793-bfb4-08b07155042a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:51.236237 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cc38869f-31c8-4ea5-a001-683a5e81cfbd req-091ec060-c513-47d1-b657-fa1801fd37f6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.237733 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cc38869f-31c8-4ea5-a001-683a5e81cfbd req-091ec060-c513-47d1-b657-fa1801fd37f6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 697 time: 4.9482298 Dec 09 21:24:51.246931 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-55aa9e89-d351-461f-9027-c5ea35205661 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.247770 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-55aa9e89-d351-461f-9027-c5ea35205661 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 5cb2944b-70be-4f74-b4d0-e06f75765688 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:24:51.253412 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-55aa9e89-d351-461f-9027-c5ea35205661 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.258111 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-55aa9e89-d351-461f-9027-c5ea35205661 admin admin] 10.222.0.13 "DELETE /v2.0/routers/5cb2944b-70be-4f74-b4d0-e06f75765688 HTTP/1.1" status: 204 len: 168 time: 1.7315757 Dec 09 21:24:51.258377 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36884) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:51.271337 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f3ceb16-3939-4c91-b001-9d6338503cde None None] The sync data for ids ['48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'] in n-d-713301-27 is: [{'id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'name': 'tempest-ServersTestFqdnHostnames-1853275289-router', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149'}], 'enable_snat': True}, 'gw_port_id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:32Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'gw_port': {'id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:92:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 809, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:33Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '0c3b6cc8-3628-4374-be2a-ae9bb603880e', 'name': '', 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'mac_address': 'fa:16:3e:01:4d:1c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 813, 'fixed_ips': [{'subnet_id': '9125b460-598b-4793-bfb4-08b07155042a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:39Z', 'updated_at': '2021-12-09T21:24:49Z', 'revision_number': 4, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'subnets': [{'id': '9125b460-598b-4793-bfb4-08b07155042a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:24:51.275548 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-98759a58-2e99-46c3-8358-220ce16032d7 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.286431 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a07f8839-e88e-4ce2-b68e-5083f203fd05 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.319219 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98759a58-2e99-46c3-8358-220ce16032d7 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=89fe82dc-dd8e-4412-92ce-c146e347e8f4,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:51.364973 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-0aff92d8-16dc-4f35-88fa-3996ed5c8305 admin admin] Deleting subnet 069b1784-6c14-42f6-a10c-b0d4447b6091 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:24:51.372159 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0aff92d8-16dc-4f35-88fa-3996ed5c8305 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.377770 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.399428 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cc38869f-31c8-4ea5-a001-683a5e81cfbd req-d0bb4118-5619-49ca-ad4a-2a23a7ea38b4 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.29 HTTP/1.1" status: 200 len: 695 time: 0.1070514 Dec 09 21:24:51.407777 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '73466791-f610-4f93-892b-3077db341121', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '378fa265-e1b8-415f-9f0c-2bff04df170a'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:24:51.408998 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64f9e1fb-da1a-4801-b25f-a0c6e80a9ca9 req-dc693aed-93c4-4341-b02a-106540d7ef2e tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:51.410448 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7254f9e9-135d-4206-85fd-4f3076232d4e" -d '{"events": [{"server_uuid": "73466791-f610-4f93-892b-3077db341121", "name": "network-vif-plugged", "status": "completed", "tag": "378fa265-e1b8-415f-9f0c-2bff04df170a"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:24:51.410684 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-64f9e1fb-da1a-4801-b25f-a0c6e80a9ca9 req-dc693aed-93c4-4341-b02a-106540d7ef2e tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=73466791-f610-4f93-892b-3077db341121 HTTP/1.1" status: 200 len: 944 time: 0.4211259 Dec 09 21:24:51.425016 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 378fa265-e1b8-415f-9f0c-2bff04df170a, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=378fa265-e1b8-415f-9f0c-2bff04df170a,segment=NetworkSegment(77d1b765-2404-4dd1-ab6e-956ebecc3e04),segment_id=77d1b765-2404-4dd1-ab6e-956ebecc3e04)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:51.432277 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.438837 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0aff92d8-16dc-4f35-88fa-3996ed5c8305 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.487121 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-98759a58-2e99-46c3-8358-220ce16032d7 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.491201 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-98759a58-2e99-46c3-8358-220ce16032d7 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.8658345 Dec 09 21:24:51.492587 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36890) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:51.499400 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-f0b59325-ac48-42d6-b093-9b94cd13db3c tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Request body: {'security_group_rule': {'security_group_id': '4aaea988-139c-4402-b4d7-14ee4ed56291', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:51.509224 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=378fa265-e1b8-415f-9f0c-2bff04df170a,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:51.564376 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f56f64cd-4b68-4758-97b6-dc8cbc24e8ff None None] DHCP port deletion for 07db6bfe-0f5b-4d09-85c8-6bcad2644162 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:24:51.624839 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0aff92d8-16dc-4f35-88fa-3996ed5c8305 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.694318 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f0b59325-ac48-42d6-b093-9b94cd13db3c tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.711798 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f56f64cd-4b68-4758-97b6-dc8cbc24e8ff None None] Deleting port 2d7c3530-6978-4b69-922b-c7cebee631c8 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:51.712316 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f56f64cd-4b68-4758-97b6-dc8cbc24e8ff None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.719954 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a90cb694-f283-421e-95af-c3e2f9a91124 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.808148 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc38869f-31c8-4ea5-a001-683a5e81cfbd req-268dbd20-5e56-4d32-9f43-570e7724172a tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:51.810831 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cc38869f-31c8-4ea5-a001-683a5e81cfbd req-268dbd20-5e56-4d32-9f43-570e7724172a tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.3969212 Dec 09 21:24:51.818255 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0aff92d8-16dc-4f35-88fa-3996ed5c8305 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.829786 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f0b59325-ac48-42d6-b093-9b94cd13db3c tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.834000 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-64f9e1fb-da1a-4801-b25f-a0c6e80a9ca9 req-40264cd8-df95-4f33-b71f-5cf8932a3325 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4005411 Dec 09 21:24:51.835272 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0aff92d8-16dc-4f35-88fa-3996ed5c8305 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.842262 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0aff92d8-16dc-4f35-88fa-3996ed5c8305 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/069b1784-6c14-42f6-a10c-b0d4447b6091 HTTP/1.1" status: 204 len: 168 time: 0.5823362 Dec 09 21:24:51.843021 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36894) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:51.869431 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f0b59325-ac48-42d6-b093-9b94cd13db3c tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.897134 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0aff92d8-16dc-4f35-88fa-3996ed5c8305 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=069b1784-6c14-42f6-a10c-b0d4447b6091,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:51.906000 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a90cb694-f283-421e-95af-c3e2f9a91124 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ffbc2156-2e0a-4a3b-8e1a-215cf8f39866,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:51.921428 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-a07f8839-e88e-4ce2-b68e-5083f203fd05 admin admin] Deleting port 2d7c3530-6978-4b69-922b-c7cebee631c8 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:51.921428 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a07f8839-e88e-4ce2-b68e-5083f203fd05 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.958119 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0b59325-ac48-42d6-b093-9b94cd13db3c tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1623e277-ce4f-49bb-b7bc-f6aeb60e9324,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:51.981395 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f0b59325-ac48-42d6-b093-9b94cd13db3c tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:51.985729 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f0b59325-ac48-42d6-b093-9b94cd13db3c tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4890490 Dec 09 21:24:51.989057 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1895ba2d-380f-464d-b299-be1ff031e0da None None] Network 6b0e1b89-20b6-4a70-94cb-58b2b1f77a20 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:24:51.991390 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0c3b6cc8-3628-4374-be2a-ae9bb603880e up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:24:52.019381 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36898) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:52.021736 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a90cb694-f283-421e-95af-c3e2f9a91124 admin admin] Checking segment: {'id': '7ba7eff4-a37f-4acb-b160-b374a7d3afdf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '419425e5-89f0-4884-91f7-260c4b9d176a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:24:52.022105 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a90cb694-f283-421e-95af-c3e2f9a91124 admin admin] Network hostable DHCP agents. Network: 419425e5-89f0-4884-91f7-260c4b9d176a, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:24:52.032635 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-775cd806-e0a8-4bd2-85a9-436671ba878a tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:52.074294 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:24:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dab6eda3-ac19-431b-8cac-6f5b68689a61 x-openstack-request-id: req-dab6eda3-ac19-431b-8cac-6f5b68689a61 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:24:52.074580 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "73466791-f610-4f93-892b-3077db341121", "name": "network-vif-plugged", "status": "completed", "tag": "378fa265-e1b8-415f-9f0c-2bff04df170a", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:24:52.075958 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-dab6eda3-ac19-431b-8cac-6f5b68689a61 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:24:52.076597 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '73466791-f610-4f93-892b-3077db341121', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '378fa265-e1b8-415f-9f0c-2bff04df170a', 'code': 200} Dec 09 21:24:52.098939 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f56f64cd-4b68-4758-97b6-dc8cbc24e8ff None None] For port 2d7c3530-6978-4b69-922b-c7cebee631c8, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2d7c3530-6978-4b69-922b-c7cebee631c8,segment=NetworkSegment(f50abd2e-e599-448f-8441-67314ef9ac54),segment_id=f50abd2e-e599-448f-8441-67314ef9ac54)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:52.099657 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f56f64cd-4b68-4758-97b6-dc8cbc24e8ff None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:52.119161 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94a303bf-e569-4371-941c-4b9cdf8d7384 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:52.214938 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9eb04e7b-1f23-4006-a1f2-eea748e208d6 req-3197f821-a5b6-4589-9a0a-a9b8d39afb32 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/ports?device_id=f0e077f0-ebc8-425d-939f-f2a18284a3b6 HTTP/1.1" status: 200 len: 210 time: 0.1608155 Dec 09 21:24:52.238316 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89ddc0fb-b89e-4855-bd61-d0d577b00231 req-8cba1199-9a0e-4b95-ab46-6efaed1b97ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:52.238316 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-89ddc0fb-b89e-4855-bd61-d0d577b00231 req-8cba1199-9a0e-4b95-ab46-6efaed1b97ed service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=73466791-f610-4f93-892b-3077db341121 HTTP/1.1" status: 200 len: 1097 time: 0.0974269 Dec 09 21:24:52.254215 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f56f64cd-4b68-4758-97b6-dc8cbc24e8ff None None] Calling delete_port for 2d7c3530-6978-4b69-922b-c7cebee631c8 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:52.260137 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-94a303bf-e569-4371-941c-4b9cdf8d7384 admin admin] Deleting port b422c8d4-8903-4efb-9419-9a433fd1506b {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:24:52.260479 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94a303bf-e569-4371-941c-4b9cdf8d7384 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:52.357545 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-a07f8839-e88e-4ce2-b68e-5083f203fd05 admin admin] For port 2d7c3530-6978-4b69-922b-c7cebee631c8, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2d7c3530-6978-4b69-922b-c7cebee631c8,segment=NetworkSegment(f50abd2e-e599-448f-8441-67314ef9ac54),segment_id=f50abd2e-e599-448f-8441-67314ef9ac54)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:52.358027 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a07f8839-e88e-4ce2-b68e-5083f203fd05 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:52.394783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a90cb694-f283-421e-95af-c3e2f9a91124 admin admin] Network 419425e5-89f0-4884-91f7-260c4b9d176a is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:24:52.398331 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 0c3b6cc8-3628-4374-be2a-ae9bb603880e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:52.398713 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:52.428182 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-89ddc0fb-b89e-4855-bd61-d0d577b00231 req-f66c3319-a925-4ee2-a589-cd6097cc8e85 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1789098 Dec 09 21:24:52.436400 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-775cd806-e0a8-4bd2-85a9-436671ba878a tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:52.440111 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-94a303bf-e569-4371-941c-4b9cdf8d7384 admin admin] For port b422c8d4-8903-4efb-9419-9a433fd1506b, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b422c8d4-8903-4efb-9419-9a433fd1506b,segment=NetworkSegment(e74944d5-8114-4627-bc98-88385d8b16f0),segment_id=e74944d5-8114-4627-bc98-88385d8b16f0)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:52.440492 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94a303bf-e569-4371-941c-4b9cdf8d7384 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:52.451171 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-a90cb694-f283-421e-95af-c3e2f9a91124 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 419425e5-89f0-4884-91f7-260c4b9d176a) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:52.486762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-a07f8839-e88e-4ce2-b68e-5083f203fd05 admin admin] Calling delete_port for 2d7c3530-6978-4b69-922b-c7cebee631c8 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:52.502919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-139d6a19-5e17-4254-98d0-dcf614abc2c6 None None] Network 419425e5-89f0-4884-91f7-260c4b9d176a requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:24:52.508455 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-94a303bf-e569-4371-941c-4b9cdf8d7384 admin admin] Calling delete_port for b422c8d4-8903-4efb-9419-9a433fd1506b owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:24:52.537340 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f56f64cd-4b68-4758-97b6-dc8cbc24e8ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:52.570532 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a90cb694-f283-421e-95af-c3e2f9a91124 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:52.590474 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a90cb694-f283-421e-95af-c3e2f9a91124 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:52.592078 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0cfdc79c-3aa1-4b30-8592-c14683d4368b None None] DHCP port deletion for 6b0e1b89-20b6-4a70-94cb-58b2b1f77a20 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:24:52.598296 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f56f64cd-4b68-4758-97b6-dc8cbc24e8ff None None] Pushing event deleted for resources: {'Port': ['ID=2d7c3530-6978-4b69-922b-c7cebee631c8,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:52.612648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f56f64cd-4b68-4758-97b6-dc8cbc24e8ff None None] No DVR routers for this DVR port 2d7c3530-6978-4b69-922b-c7cebee631c8 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:24:52.654350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-4a9c6201-4dad-497e-bf6f-184017c26efa tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.10 "GET /v2.0/networks?tenant_id=3329fed690514d85b98adeb6691d89f2&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1579533 Dec 09 21:24:52.656903 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94a303bf-e569-4371-941c-4b9cdf8d7384 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:52.701182 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94a303bf-e569-4371-941c-4b9cdf8d7384 admin admin] Pushing event deleted for resources: {'Port': ['ID=b422c8d4-8903-4efb-9419-9a433fd1506b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:52.713757 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94a303bf-e569-4371-941c-4b9cdf8d7384 admin admin] No DVR routers for this DVR port b422c8d4-8903-4efb-9419-9a433fd1506b on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:24:52.729064 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-0cfdc79c-3aa1-4b30-8592-c14683d4368b None None] The port 'b422c8d4-8903-4efb-9419-9a433fd1506b' was deleted {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1958}} Dec 09 21:24:52.781490 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ace4de6f-2111-471a-a68b-9c0eb62db568 req-980ff736-465c-451b-8e9b-65c789ad2cee tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 0.6349983 Dec 09 21:24:52.805654 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3ce3d0b-109f-44a9-9f11-c52eee1cf977 None None] Network 419425e5-89f0-4884-91f7-260c4b9d176a requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:24:52.839903 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a90cb694-f283-421e-95af-c3e2f9a91124 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 2.2707582 Dec 09 21:24:52.912085 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-ace4de6f-2111-471a-a68b-9c0eb62db568 req-ec8e41a8-9d34-4f8e-9ec4-0158efb30ab7 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:52.919312 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94a303bf-e569-4371-941c-4b9cdf8d7384 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:52.932001 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device cd61cf32-db9c-49d2-8b1c-50a6abb2e135 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:24:52.964320 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: cd61cf32-db9c-49d2-8b1c-50a6abb2e135 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:24:52.964789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device cd61cf32-db9c-49d2-8b1c-50a6abb2e135 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:24:52.965385 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 49e167c2-19e7-4bc9-9de1-decd671125c0 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:24:52.977148 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-94a303bf-e569-4371-941c-4b9cdf8d7384 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6b0e1b89-20b6-4a70-94cb-58b2b1f77a20']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:52.994146 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 49e167c2-19e7-4bc9-9de1-decd671125c0 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:24:52.994942 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 49e167c2-19e7-4bc9-9de1-decd671125c0 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:24:52.995636 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2d7c3530-6978-4b69-922b-c7cebee631c8 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:24:53.000909 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-94a303bf-e569-4371-941c-4b9cdf8d7384 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e74944d5-8114-4627-bc98-88385d8b16f0') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:53.001221 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-94a303bf-e569-4371-941c-4b9cdf8d7384 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e74944d5-8114-4627-bc98-88385d8b16f0') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:53.018319 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 2d7c3530-6978-4b69-922b-c7cebee631c8 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:24:53.018657 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2d7c3530-6978-4b69-922b-c7cebee631c8 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:24:53.027191 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94a303bf-e569-4371-941c-4b9cdf8d7384 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:53.043753 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94a303bf-e569-4371-941c-4b9cdf8d7384 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:53.051023 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-94a303bf-e569-4371-941c-4b9cdf8d7384 admin admin] Releasing vlan 124 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:24:53.051588 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94a303bf-e569-4371-941c-4b9cdf8d7384 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:24:53.054033 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:24:53.083279 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ace4de6f-2111-471a-a68b-9c0eb62db568 req-ec8e41a8-9d34-4f8e-9ec4-0158efb30ab7 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:53.135581 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94a303bf-e569-4371-941c-4b9cdf8d7384 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:53.142503 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94a303bf-e569-4371-941c-4b9cdf8d7384 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:53.145858 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-1b99a8bd-c57a-4136-a022-e158340a9181 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:53.147860 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-1b99a8bd-c57a-4136-a022-e158340a9181 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4323630 Dec 09 21:24:53.149167 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-94a303bf-e569-4371-941c-4b9cdf8d7384 admin admin] 10.222.0.13 "DELETE /v2.0/networks/6b0e1b89-20b6-4a70-94cb-58b2b1f77a20 HTTP/1.1" status: 204 len: 168 time: 1.2811911 Dec 09 21:24:53.161745 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94a303bf-e569-4371-941c-4b9cdf8d7384 admin admin] Pushing event deleted for resources: {'Network': ['ID=6b0e1b89-20b6-4a70-94cb-58b2b1f77a20,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:53.162644 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a07f8839-e88e-4ce2-b68e-5083f203fd05 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:53.187083 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-be1567fe-6472-490b-b7d2-39eda1e1a9da tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Request body: {'port': {'device_id': 'f0e077f0-ebc8-425d-939f-f2a18284a3b6', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '3329fed690514d85b98adeb6691d89f2'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:53.300576 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-068374fb-c630-42db-822b-bcd305b67ecb req-25e63db1-583d-48a8-af0f-75aa99641aba tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:53.307610 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-068374fb-c630-42db-822b-bcd305b67ecb req-25e63db1-583d-48a8-af0f-75aa99641aba tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/networks?id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb HTTP/1.1" status: 200 len: 812 time: 0.5860600 Dec 09 21:24:53.317349 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a07f8839-e88e-4ce2-b68e-5083f203fd05 admin admin] Pushing event deleted for resources: {'Port': ['ID=2d7c3530-6978-4b69-922b-c7cebee631c8,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:53.324787 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a07f8839-e88e-4ce2-b68e-5083f203fd05 admin admin] No DVR routers for this DVR port 2d7c3530-6978-4b69-922b-c7cebee631c8 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:24:53.336660 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-068374fb-c630-42db-822b-bcd305b67ecb req-3630f452-c5dd-40a5-af3a-11134add9307 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/quotas/1b7916b634f74760a565cfeaef510cd9 HTTP/1.1" status: 200 len: 375 time: 0.0281835 Dec 09 21:24:53.414972 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36934) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:53.433436 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-775cd806-e0a8-4bd2-85a9-436671ba878a tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:53.465279 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a92cdabe-e376-4497-a4a7-006bbce2c5e6 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=2429d4a7c27042e7ab6a04a9cf722b47&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0489438 Dec 09 21:24:53.466157 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36936) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:53.478149 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-068374fb-c630-42db-822b-bcd305b67ecb req-e7a1b8c8-1397-4c18-8807-509dfdbfd369 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=1b7916b634f74760a565cfeaef510cd9&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1332407 Dec 09 21:24:53.529044 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cb2bfb7-877f-4915-b3d8-c770695510b1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:53.554455 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cb2bfb7-877f-4915-b3d8-c770695510b1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:53.603403 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a07f8839-e88e-4ce2-b68e-5083f203fd05 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:53.624488 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cb2bfb7-877f-4915-b3d8-c770695510b1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:53.631542 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cb2bfb7-877f-4915-b3d8-c770695510b1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:53.636104 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9cb2bfb7-877f-4915-b3d8-c770695510b1 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/25ccb671-1195-4405-86b6-3eebd3a51ec7 HTTP/1.1" status: 204 len: 168 time: 0.1681561 Dec 09 21:24:53.648597 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cb2bfb7-877f-4915-b3d8-c770695510b1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=25ccb671-1195-4405-86b6-3eebd3a51ec7,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:53.671789 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-a07f8839-e88e-4ce2-b68e-5083f203fd05 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['07db6bfe-0f5b-4d09-85c8-6bcad2644162']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:53.699302 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-a07f8839-e88e-4ce2-b68e-5083f203fd05 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f50abd2e-e599-448f-8441-67314ef9ac54') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:53.699631 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-a07f8839-e88e-4ce2-b68e-5083f203fd05 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f50abd2e-e599-448f-8441-67314ef9ac54') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:53.715465 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-be1567fe-6472-490b-b7d2-39eda1e1a9da tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Made reservation on behalf of 3329fed690514d85b98adeb6691d89f2 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:24:53.718973 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-be1567fe-6472-490b-b7d2-39eda1e1a9da tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:53.752892 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a07f8839-e88e-4ce2-b68e-5083f203fd05 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:53.757573 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36944) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:53.760295 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b422c8d4-8903-4efb-9419-9a433fd1506b no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:24:53.765464 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-acbf79a5-8b47-405b-befb-7fd9e09a0288 admin admin] Request body: {'network': {'name': 'tempest-VolumesAdminNegativeTest-1100965258-network', 'tenant_id': '851eb4460eb14a8ab38ec00fdc320526'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:53.807326 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a07f8839-e88e-4ce2-b68e-5083f203fd05 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:53.815547 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-acbf79a5-8b47-405b-befb-7fd9e09a0288 admin admin] Made reservation on behalf of 851eb4460eb14a8ab38ec00fdc320526 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:24:53.825659 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-acbf79a5-8b47-405b-befb-7fd9e09a0288 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:53.831092 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-068374fb-c630-42db-822b-bcd305b67ecb req-5ef22470-dc8d-462c-bcf3-d30d65c0a4c4 service neutron] 10.222.0.13 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3409493 Dec 09 21:24:53.839833 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-acbf79a5-8b47-405b-befb-7fd9e09a0288 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:53.849058 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a07f8839-e88e-4ce2-b68e-5083f203fd05 admin admin] Releasing vlan 149 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:24:53.849436 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a07f8839-e88e-4ce2-b68e-5083f203fd05 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:24:53.859172 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:24:53.873881 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-775cd806-e0a8-4bd2-85a9-436671ba878a tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Allocated IP 172.25.3.79 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/e1a65c12-f2dd-4a5f-b3f3-e42bd0c43d20) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:24:53.922429 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ace4de6f-2111-471a-a68b-9c0eb62db568 req-ec8e41a8-9d34-4f8e-9ec4-0158efb30ab7 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:53.968129 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: b422c8d4-8903-4efb-9419-9a433fd1506b {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:24:53.968722 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b422c8d4-8903-4efb-9419-9a433fd1506b not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:24:54.010974 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-acbf79a5-8b47-405b-befb-7fd9e09a0288 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:54.016944 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-acbf79a5-8b47-405b-befb-7fd9e09a0288 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:54.047384 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-acbf79a5-8b47-405b-befb-7fd9e09a0288 admin admin] vlan segment allocate from pool success with {'vlan_id': 104, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:24:54.054313 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbf79a5-8b47-405b-befb-7fd9e09a0288 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a235b45a-06c4-4ee6-bb6e-606b9200bc9d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:54.061050 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-acbf79a5-8b47-405b-befb-7fd9e09a0288 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:54.061368 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-acbf79a5-8b47-405b-befb-7fd9e09a0288 admin admin] Added segment f36b93d7-1714-4a6f-87e4-8efd31b62bf6 of type vlan for network 6ec183b6-af32-41ca-8fac-dabe007f5a94 Dec 09 21:24:54.106406 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a07f8839-e88e-4ce2-b68e-5083f203fd05 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:54.109009 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-acbf79a5-8b47-405b-befb-7fd9e09a0288 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:54.141373 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-acbf79a5-8b47-405b-befb-7fd9e09a0288 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:54.142872 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-acbf79a5-8b47-405b-befb-7fd9e09a0288 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:54.143510 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-acbf79a5-8b47-405b-befb-7fd9e09a0288 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:54.181870 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-acbf79a5-8b47-405b-befb-7fd9e09a0288 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.4226716 Dec 09 21:24:54.184641 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36952) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:54.189741 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-8fb2722b-b94f-41f3-a4a5-4171402b8a21 admin admin] Request body: {'subnet': {'network_id': '6ec183b6-af32-41ca-8fac-dabe007f5a94', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesAdminNegativeTest-1100965258-subnet', 'tenant_id': '851eb4460eb14a8ab38ec00fdc320526', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:54.227429 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acbf79a5-8b47-405b-befb-7fd9e09a0288 admin admin] Pushing event updated for resources: {'Network': ['ID=6ec183b6-af32-41ca-8fac-dabe007f5a94,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:54.243269 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8fb2722b-b94f-41f3-a4a5-4171402b8a21 admin admin] Made reservation on behalf of 851eb4460eb14a8ab38ec00fdc320526 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:24:54.244349 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 6ec183b6-af32-41ca-8fac-dabe007f5a94 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:24:54.246274 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8fb2722b-b94f-41f3-a4a5-4171402b8a21 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:54.466024 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8fb2722b-b94f-41f3-a4a5-4171402b8a21 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:54.500210 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a07f8839-e88e-4ce2-b68e-5083f203fd05 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:54.503788 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a07f8839-e88e-4ce2-b68e-5083f203fd05 admin admin] 10.222.0.13 "DELETE /v2.0/networks/07db6bfe-0f5b-4d09-85c8-6bcad2644162 HTTP/1.1" status: 204 len: 168 time: 3.6280925 Dec 09 21:24:54.528623 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fb2722b-b94f-41f3-a4a5-4171402b8a21 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1703b2e6-892a-4fb8-a0e6-a752e0e8e836,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:54.539277 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fb2722b-b94f-41f3-a4a5-4171402b8a21 admin admin] Checking segment: {'id': 'f36b93d7-1714-4a6f-87e4-8efd31b62bf6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '6ec183b6-af32-41ca-8fac-dabe007f5a94'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:24:54.539468 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8fb2722b-b94f-41f3-a4a5-4171402b8a21 admin admin] Network hostable DHCP agents. Network: 6ec183b6-af32-41ca-8fac-dabe007f5a94, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:24:54.565434 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8fb2722b-b94f-41f3-a4a5-4171402b8a21 admin admin] Network 6ec183b6-af32-41ca-8fac-dabe007f5a94 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:24:54.570992 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a07f8839-e88e-4ce2-b68e-5083f203fd05 admin admin] Pushing event deleted for resources: {'Network': ['ID=07db6bfe-0f5b-4d09-85c8-6bcad2644162,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:54.585967 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-8fb2722b-b94f-41f3-a4a5-4171402b8a21 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 6ec183b6-af32-41ca-8fac-dabe007f5a94) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:54.594215 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-068374fb-c630-42db-822b-bcd305b67ecb req-5d215884-6ae7-40bf-aa23-55d6c629815f service neutron] 10.222.0.13 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7621365 Dec 09 21:24:54.609247 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-004113c1-3a8a-4bde-b63f-bdaf1b6fb223 None None] Network 6ec183b6-af32-41ca-8fac-dabe007f5a94 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:24:54.609665 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8fb2722b-b94f-41f3-a4a5-4171402b8a21 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:54.610630 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8fb2722b-b94f-41f3-a4a5-4171402b8a21 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:54.610798 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-be1567fe-6472-490b-b7d2-39eda1e1a9da tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Allocated IP 192.168.233.18 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/9ff7db85-9b93-4216-acdd-9338d10a0970) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:24:54.649366 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8fb2722b-b94f-41f3-a4a5-4171402b8a21 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.4636185 Dec 09 21:24:54.677890 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-775cd806-e0a8-4bd2-85a9-436671ba878a tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:54.753640 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36970) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:54.782894 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e1e9ce44-36ec-403c-9fa3-9a4c098d1813 None None] Network 6ec183b6-af32-41ca-8fac-dabe007f5a94 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:24:54.783510 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36972) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:54.840402 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-775cd806-e0a8-4bd2-85a9-436671ba878a tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:54.856916 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f21ab03d-0b5e-4824-abf3-b5dad28143ea admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=f3017ec6ec044e6ea364d4db8048d68d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1001318 Dec 09 21:24:54.859214 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36976) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:54.942782 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-775cd806-e0a8-4bd2-85a9-436671ba878a tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:54.996346 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-775cd806-e0a8-4bd2-85a9-436671ba878a tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:55.022906 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-44dfa41b-1574-4345-accb-f516498536ac admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:55.023568 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-775cd806-e0a8-4bd2-85a9-436671ba878a tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:24:55.032823 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-ace4de6f-2111-471a-a68b-9c0eb62db568 req-ec8e41a8-9d34-4f8e-9ec4-0158efb30ab7 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Allocated IP 172.25.3.101 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/27374f77-dc74-4170-9448-e028b879b7fc) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:24:55.070324 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-44dfa41b-1574-4345-accb-f516498536ac admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:55.103921 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-775cd806-e0a8-4bd2-85a9-436671ba878a tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Pushing event updated for resources: {'Port': ['ID=e1a65c12-f2dd-4a5f-b3f3-e42bd0c43d20,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:55.150625 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-be1567fe-6472-490b-b7d2-39eda1e1a9da tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:55.164590 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-44dfa41b-1574-4345-accb-f516498536ac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:55.170080 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-44dfa41b-1574-4345-accb-f516498536ac admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:55.178320 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-44dfa41b-1574-4345-accb-f516498536ac admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/16976c1a-3621-4c1e-aa98-5f60173982d7 HTTP/1.1" status: 204 len: 168 time: 0.3152826 Dec 09 21:24:55.188883 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44dfa41b-1574-4345-accb-f516498536ac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=16976c1a-3621-4c1e-aa98-5f60173982d7,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:55.254530 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c63d4bbd-9157-43cd-82f0-ed09ae5aebf0 req-b75f845e-ed85-49e6-be2d-35ed03f3fd7d tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:55.256633 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c63d4bbd-9157-43cd-82f0-ed09ae5aebf0 req-b75f845e-ed85-49e6-be2d-35ed03f3fd7d tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=73466791-f610-4f93-892b-3077db341121 HTTP/1.1" status: 200 len: 945 time: 0.2289689 Dec 09 21:24:55.262346 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a647f297-b06d-48f0-adde-afe32f52dfeb admin admin] Request body: {'network': {'name': 'tempest-ServersTestMultiNic-285103454-network', 'tenant_id': '73812a0c336d4768b029fd6459a1ae9e'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:55.296308 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a647f297-b06d-48f0-adde-afe32f52dfeb admin admin] Made reservation on behalf of 73812a0c336d4768b029fd6459a1ae9e for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:24:55.299721 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a647f297-b06d-48f0-adde-afe32f52dfeb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:55.312564 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a647f297-b06d-48f0-adde-afe32f52dfeb admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:55.360781 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-be1567fe-6472-490b-b7d2-39eda1e1a9da tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:55.365697 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-775cd806-e0a8-4bd2-85a9-436671ba878a tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:55.377062 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['f53b5ffa-c2e5-4ee2-84c4-f0439be955b2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:24:55.447246 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ace4de6f-2111-471a-a68b-9c0eb62db568 req-ec8e41a8-9d34-4f8e-9ec4-0158efb30ab7 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:55.469487 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a647f297-b06d-48f0-adde-afe32f52dfeb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:55.478697 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a647f297-b06d-48f0-adde-afe32f52dfeb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:55.504129 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a647f297-b06d-48f0-adde-afe32f52dfeb admin admin] vlan segment allocate from pool success with {'vlan_id': 100, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:24:55.518983 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c63d4bbd-9157-43cd-82f0-ed09ae5aebf0 req-5c38d0a2-6af0-426b-9470-cae20bcf75e8 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2527506 Dec 09 21:24:55.539970 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a647f297-b06d-48f0-adde-afe32f52dfeb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:55.539970 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-a647f297-b06d-48f0-adde-afe32f52dfeb admin admin] Added segment ad3b787d-bad8-49ed-bf29-13e361e4a583 of type vlan for network 5b690ccc-3b51-4e15-887f-038429ce13f5 Dec 09 21:24:55.548380 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-be1567fe-6472-490b-b7d2-39eda1e1a9da tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:55.550761 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be1567fe-6472-490b-b7d2-39eda1e1a9da tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Pushing event updated for resources: {'Port': ['ID=9ff7db85-9b93-4216-acdd-9338d10a0970,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:55.575739 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-775cd806-e0a8-4bd2-85a9-436671ba878a tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:55.582750 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-be1567fe-6472-490b-b7d2-39eda1e1a9da tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:55.608940 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a647f297-b06d-48f0-adde-afe32f52dfeb admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:55.611085 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a647f297-b06d-48f0-adde-afe32f52dfeb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:55.624135 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-be1567fe-6472-490b-b7d2-39eda1e1a9da tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:24:55.653854 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a647f297-b06d-48f0-adde-afe32f52dfeb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:55.655402 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a647f297-b06d-48f0-adde-afe32f52dfeb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:55.656383 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a647f297-b06d-48f0-adde-afe32f52dfeb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:55.769642 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a647f297-b06d-48f0-adde-afe32f52dfeb admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.9845362 Dec 09 21:24:55.770970 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36998) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:55.841269 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-03dc9d5a-554c-489f-ad38-0f218b0ca6ee admin admin] Request body: {'subnet': {'network_id': '5b690ccc-3b51-4e15-887f-038429ce13f5', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestMultiNic-285103454-subnet', 'tenant_id': '73812a0c336d4768b029fd6459a1ae9e', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:55.843143 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-be1567fe-6472-490b-b7d2-39eda1e1a9da tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:55.848934 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-be1567fe-6472-490b-b7d2-39eda1e1a9da tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:55.859098 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a647f297-b06d-48f0-adde-afe32f52dfeb admin admin] Pushing event updated for resources: {'Network': ['ID=5b690ccc-3b51-4e15-887f-038429ce13f5,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:55.860584 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ace4de6f-2111-471a-a68b-9c0eb62db568 req-ec8e41a8-9d34-4f8e-9ec4-0158efb30ab7 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:55.876421 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 5b690ccc-3b51-4e15-887f-038429ce13f5 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:24:55.884698 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-03dc9d5a-554c-489f-ad38-0f218b0ca6ee admin admin] Made reservation on behalf of 73812a0c336d4768b029fd6459a1ae9e for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:24:55.888104 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03dc9d5a-554c-489f-ad38-0f218b0ca6ee admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:55.981508 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9416625f-0758-45bb-83b4-0586e39c73d4 req-c0df2a8a-4bb9-4a29-935a-ac540b80a8b1 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:55.989908 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9416625f-0758-45bb-83b4-0586e39c73d4 req-c0df2a8a-4bb9-4a29-935a-ac540b80a8b1 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/ports?device_id=f0e077f0-ebc8-425d-939f-f2a18284a3b6 HTTP/1.1" status: 200 len: 935 time: 0.2946317 Dec 09 21:24:56.000188 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-31bd2416-41e5-42c6-b8bb-9fab5b29c6eb None None] Provisioning complete for port 9ff7db85-9b93-4216-acdd-9338d10a0970 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:56.000623 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-31bd2416-41e5-42c6-b8bb-9fab5b29c6eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:56.013213 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-be1567fe-6472-490b-b7d2-39eda1e1a9da tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 2.8371763 Dec 09 21:24:56.050406 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-31bd2416-41e5-42c6-b8bb-9fab5b29c6eb None None] Port 9ff7db85-9b93-4216-acdd-9338d10a0970 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:24:56.067285 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-167b92c1-a1f6-46f3-abbd-ffea007027f6 service neutron] Request body: {'port': {'device_id': 'f0e077f0-ebc8-425d-939f-f2a18284a3b6', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:56.079971 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ace4de6f-2111-471a-a68b-9c0eb62db568 req-ec8e41a8-9d34-4f8e-9ec4-0158efb30ab7 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:56.109479 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-ace4de6f-2111-471a-a68b-9c0eb62db568 req-ec8e41a8-9d34-4f8e-9ec4-0158efb30ab7 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:56.115016 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec8e41a8-9d34-4f8e-9ec4-0158efb30ab7 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Pushing event updated for resources: {'Port': ['ID=27374f77-dc74-4170-9448-e028b879b7fc,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:56.119227 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-ace4de6f-2111-471a-a68b-9c0eb62db568 req-ec8e41a8-9d34-4f8e-9ec4-0158efb30ab7 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:24:56.134805 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03dc9d5a-554c-489f-ad38-0f218b0ca6ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:56.195000 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03dc9d5a-554c-489f-ad38-0f218b0ca6ee admin admin] Pushing event updated for resources: {'Subnet': ['ID=65af9a54-bf8f-4f71-97a2-68f4a31a18ad,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:56.205515 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03dc9d5a-554c-489f-ad38-0f218b0ca6ee admin admin] Checking segment: {'id': 'ad3b787d-bad8-49ed-bf29-13e361e4a583', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '5b690ccc-3b51-4e15-887f-038429ce13f5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:24:56.205875 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-03dc9d5a-554c-489f-ad38-0f218b0ca6ee admin admin] Network hostable DHCP agents. Network: 5b690ccc-3b51-4e15-887f-038429ce13f5, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:24:56.229365 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-03dc9d5a-554c-489f-ad38-0f218b0ca6ee admin admin] Network 5b690ccc-3b51-4e15-887f-038429ce13f5 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:24:56.233211 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9416625f-0758-45bb-83b4-0586e39c73d4 req-0d994035-1326-4523-aa00-9ab83937e1ae tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/security-groups?id=50885dec-ee01-4c11-bc49-430c219f37b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2421899 Dec 09 21:24:56.239015 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-167b92c1-a1f6-46f3-abbd-ffea007027f6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:56.242007 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-03dc9d5a-554c-489f-ad38-0f218b0ca6ee admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 5b690ccc-3b51-4e15-887f-038429ce13f5) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:56.248781 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03dc9d5a-554c-489f-ad38-0f218b0ca6ee admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:56.250191 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03dc9d5a-554c-489f-ad38-0f218b0ca6ee admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:56.258709 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f419f9f1-b7e4-41f7-91b1-3388658f2cd3 None None] Network 5b690ccc-3b51-4e15-887f-038429ce13f5 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:24:56.299560 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-03dc9d5a-554c-489f-ad38-0f218b0ca6ee admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.4660676 Dec 09 21:24:56.302410 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37014) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:56.311796 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-aa4f079d-6d3a-40c0-897e-ed8a380a5368 admin admin] Request body: {'router': {'name': 'tempest-ServersTestMultiNic-285103454-router', 'tenant_id': '73812a0c336d4768b029fd6459a1ae9e', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:56.316559 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-775cd806-e0a8-4bd2-85a9-436671ba878a tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:56.345192 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa4f079d-6d3a-40c0-897e-ed8a380a5368 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:56.347019 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa4f079d-6d3a-40c0-897e-ed8a380a5368 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:56.352618 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-775cd806-e0a8-4bd2-85a9-436671ba878a tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:56.419341 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ace4de6f-2111-471a-a68b-9c0eb62db568 req-ec8e41a8-9d34-4f8e-9ec4-0158efb30ab7 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:56.472141 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa4f079d-6d3a-40c0-897e-ed8a380a5368 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:56.473274 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37018) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:56.477726 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-76f3fa6e-96cf-4237-ac58-f49ab52d7117 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-5b690ccc-3b51-4e15-887f-038429ce13f5', 'network_id': '5b690ccc-3b51-4e15-887f-038429ce13f5', 'project_id': '73812a0c336d4768b029fd6459a1ae9e', 'fixed_ips': [{'subnet_id': '65af9a54-bf8f-4f71-97a2-68f4a31a18ad'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:24:56.478994 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-76f3fa6e-96cf-4237-ac58-f49ab52d7117 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:56.594115 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd59274c-7b20-4946-ba2d-1c93361686ef req-8e6a9f4a-43bf-4a7f-99c7-b74a63710a53 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=6fc3ad38-60ed-42b3-8c67-af66849bcbaf HTTP/1.1" status: 200 len: 210 time: 0.1869092 Dec 09 21:24:56.642270 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-007725b5-1aac-462e-9b1c-e8c8e0a5a49b admin admin] Request body: {'network': {'name': 'tempest-FloatingIPsNegativeTestJSON-1102779277-network', 'tenant_id': '6133c356707e42408885bbdcb5f67413'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:56.655253 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-775cd806-e0a8-4bd2-85a9-436671ba878a tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Pushing event updated for resources: {'Port': ['ID=e1a65c12-f2dd-4a5f-b3f3-e42bd0c43d20,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:56.658448 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-76f3fa6e-96cf-4237-ac58-f49ab52d7117 None None] Allocated IP 172.20.0.2 (5b690ccc-3b51-4e15-887f-038429ce13f5/65af9a54-bf8f-4f71-97a2-68f4a31a18ad/9db6e7df-0c6c-4376-ab3e-76509fe7fcd0) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:24:56.707471 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ace4de6f-2111-471a-a68b-9c0eb62db568 req-ec8e41a8-9d34-4f8e-9ec4-0158efb30ab7 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:56.744172 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-775cd806-e0a8-4bd2-85a9-436671ba878a tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:56.784772 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa4f079d-6d3a-40c0-897e-ed8a380a5368 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:56.790796 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-007725b5-1aac-462e-9b1c-e8c8e0a5a49b admin admin] Made reservation on behalf of 6133c356707e42408885bbdcb5f67413 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:24:56.794341 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-007725b5-1aac-462e-9b1c-e8c8e0a5a49b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:56.821910 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-007725b5-1aac-462e-9b1c-e8c8e0a5a49b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:56.856821 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-775cd806-e0a8-4bd2-85a9-436671ba878a tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:56.858038 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-775cd806-e0a8-4bd2-85a9-436671ba878a tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 4.8374953 Dec 09 21:24:56.870136 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-76f3fa6e-96cf-4237-ac58-f49ab52d7117 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:56.882443 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-76f3fa6e-96cf-4237-ac58-f49ab52d7117 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:56.947644 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-76f3fa6e-96cf-4237-ac58-f49ab52d7117 None None] Network 5b690ccc-3b51-4e15-887f-038429ce13f5 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:56.951390 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-76f3fa6e-96cf-4237-ac58-f49ab52d7117 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:56.960435 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76f3fa6e-96cf-4237-ac58-f49ab52d7117 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:24:56.977461 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76f3fa6e-96cf-4237-ac58-f49ab52d7117 None None] Pushing event updated for resources: {'Port': ['ID=9db6e7df-0c6c-4376-ab3e-76509fe7fcd0,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:57.010666 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ace4de6f-2111-471a-a68b-9c0eb62db568 req-ec8e41a8-9d34-4f8e-9ec4-0158efb30ab7 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:57.054729 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:57.057925 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-76f3fa6e-96cf-4237-ac58-f49ab52d7117 None None] Attempting to bind port 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:24:57.058556 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-76f3fa6e-96cf-4237-ac58-f49ab52d7117 None None] Attempting to bind port 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'ad3b787d-bad8-49ed-bf29-13e361e4a583', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '5b690ccc-3b51-4e15-887f-038429ce13f5'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:24:57.059184 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76f3fa6e-96cf-4237-ac58-f49ab52d7117 None None] Attempting to bind port 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0 on network 5b690ccc-3b51-4e15-887f-038429ce13f5 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:24:57.069582 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76f3fa6e-96cf-4237-ac58-f49ab52d7117 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 24, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:24:57.070320 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76f3fa6e-96cf-4237-ac58-f49ab52d7117 None None] Checking segment: {'id': 'ad3b787d-bad8-49ed-bf29-13e361e4a583', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '5b690ccc-3b51-4e15-887f-038429ce13f5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:24:57.070731 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-76f3fa6e-96cf-4237-ac58-f49ab52d7117 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:57.071207 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76f3fa6e-96cf-4237-ac58-f49ab52d7117 None None] Bound using segment: {'id': 'ad3b787d-bad8-49ed-bf29-13e361e4a583', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '5b690ccc-3b51-4e15-887f-038429ce13f5'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:24:57.071670 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-76f3fa6e-96cf-4237-ac58-f49ab52d7117 None None] Bound port: 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ad3b787d-bad8-49ed-bf29-13e361e4a583', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '5b690ccc-3b51-4e15-887f-038429ce13f5'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:24:57.072060 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-76f3fa6e-96cf-4237-ac58-f49ab52d7117 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:57.076918 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:57.112085 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-167b92c1-a1f6-46f3-abbd-ffea007027f6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9ff7db85-9b93-4216-acdd-9338d10a0970 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:24:57.120229 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-167b92c1-a1f6-46f3-abbd-ffea007027f6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:57.145445 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-76f3fa6e-96cf-4237-ac58-f49ab52d7117 None None] For port 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:24:57.149016 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-76f3fa6e-96cf-4237-ac58-f49ab52d7117 None None] For port 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9db6e7df-0c6c-4376-ab3e-76509fe7fcd0,segment=NetworkSegment(ad3b787d-bad8-49ed-bf29-13e361e4a583),segment_id=ad3b787d-bad8-49ed-bf29-13e361e4a583)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:24:57.153725 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-76f3fa6e-96cf-4237-ac58-f49ab52d7117 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:57.212036 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76f3fa6e-96cf-4237-ac58-f49ab52d7117 None None] Pushing event updated for resources: {'Port': ['ID=9db6e7df-0c6c-4376-ab3e-76509fe7fcd0,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:57.224441 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-068374fb-c630-42db-822b-bcd305b67ecb req-6ce0708b-b1f7-4aac-b882-1622c799fac2 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:57.225812 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-068374fb-c630-42db-822b-bcd305b67ecb req-6ce0708b-b1f7-4aac-b882-1622c799fac2 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.10 "GET /v2.0/networks?id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb HTTP/1.1" status: 200 len: 812 time: 0.8159528 Dec 09 21:24:57.235107 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-167b92c1-a1f6-46f3-abbd-ffea007027f6 service neutron] Transition to ACTIVE for port object 9ff7db85-9b93-4216-acdd-9338d10a0970 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:24:57.236884 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ace4de6f-2111-471a-a68b-9c0eb62db568 req-ec8e41a8-9d34-4f8e-9ec4-0158efb30ab7 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:57.256620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-068374fb-c630-42db-822b-bcd305b67ecb req-455a414c-00d2-4717-a6c3-1e5b707d235c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Request body: {'port': {'device_id': '6fc3ad38-60ed-42b3-8c67-af66849bcbaf', 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb', 'admin_state_up': True, 'tenant_id': '1b7916b634f74760a565cfeaef510cd9'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:57.281764 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-167b92c1-a1f6-46f3-abbd-ffea007027f6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:57.307811 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-ac45afba-54da-4070-be9f-9761986437ef tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:57.309307 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-ac45afba-54da-4070-be9f-9761986437ef tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.13 "GET /v2.0/networks?id=419425e5-89f0-4884-91f7-260c4b9d176a HTTP/1.1" status: 200 len: 814 time: 0.1779041 Dec 09 21:24:57.317490 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-007725b5-1aac-462e-9b1c-e8c8e0a5a49b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:57.378739 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec8e41a8-9d34-4f8e-9ec4-0158efb30ab7 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Pushing event updated for resources: {'Port': ['ID=27374f77-dc74-4170-9448-e028b879b7fc,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:57.381833 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-f48a6664-e464-4473-b8d0-29ea8cd92606 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.13 "GET /v2.0/quotas/87694f06f4144186aac9c50bac43d5ec HTTP/1.1" status: 200 len: 375 time: 0.0619774 Dec 09 21:24:57.404503 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-007725b5-1aac-462e-9b1c-e8c8e0a5a49b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:57.486578 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-007725b5-1aac-462e-9b1c-e8c8e0a5a49b admin admin] vlan segment allocate from pool success with {'vlan_id': 142, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:24:57.517360 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa4f079d-6d3a-40c0-897e-ed8a380a5368 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:57.520772 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-007725b5-1aac-462e-9b1c-e8c8e0a5a49b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:57.521136 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-007725b5-1aac-462e-9b1c-e8c8e0a5a49b admin admin] Added segment 1acd79aa-cd7a-4fee-a7fc-139e8b6382c5 of type vlan for network 78764042-44c4-4593-a775-1545766ca91c Dec 09 21:24:57.522409 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-007725b5-1aac-462e-9b1c-e8c8e0a5a49b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=235b4b94-ef9b-4160-b058-7d1ee5628dff,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:57.528619 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-ce67c707-f491-43cc-8f34-e42aea6e363c tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=87694f06f4144186aac9c50bac43d5ec&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1056781 Dec 09 21:24:57.549974 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa4f079d-6d3a-40c0-897e-ed8a380a5368 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:57.571203 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ace4de6f-2111-471a-a68b-9c0eb62db568 req-ec8e41a8-9d34-4f8e-9ec4-0158efb30ab7 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:57.596472 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-167b92c1-a1f6-46f3-abbd-ffea007027f6 service neutron] Pushing event updated for resources: {'Port': ['ID=9ff7db85-9b93-4216-acdd-9338d10a0970,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:57.624537 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-007725b5-1aac-462e-9b1c-e8c8e0a5a49b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:57.685769 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ace4de6f-2111-471a-a68b-9c0eb62db568 req-ec8e41a8-9d34-4f8e-9ec4-0158efb30ab7 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:57.687640 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ace4de6f-2111-471a-a68b-9c0eb62db568 req-ec8e41a8-9d34-4f8e-9ec4-0158efb30ab7 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 698 time: 4.8403113 Dec 09 21:24:57.702955 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-007725b5-1aac-462e-9b1c-e8c8e0a5a49b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:57.704328 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-007725b5-1aac-462e-9b1c-e8c8e0a5a49b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:57.704925 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-007725b5-1aac-462e-9b1c-e8c8e0a5a49b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:57.757890 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-aa4f079d-6d3a-40c0-897e-ed8a380a5368 admin admin] Allocated IP 172.25.3.220 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/0c193336-bbb6-4822-b85a-c96594bf8ca5) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:24:57.804432 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-007725b5-1aac-462e-9b1c-e8c8e0a5a49b admin admin] Pushing event updated for resources: {'Network': ['ID=78764042-44c4-4593-a775-1545766ca91c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:57.819055 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 78764042-44c4-4593-a775-1545766ca91c details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:24:57.902697 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:24:57.968725 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa4f079d-6d3a-40c0-897e-ed8a380a5368 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:57.981857 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:57.982235 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:58.007736 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa4f079d-6d3a-40c0-897e-ed8a380a5368 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:58.053215 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa4f079d-6d3a-40c0-897e-ed8a380a5368 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:58.056453 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-aa4f079d-6d3a-40c0-897e-ed8a380a5368 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:58.062715 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa4f079d-6d3a-40c0-897e-ed8a380a5368 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:24:58.068672 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:58.085917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa4f079d-6d3a-40c0-897e-ed8a380a5368 admin admin] Pushing event updated for resources: {'Port': ['ID=0c193336-bbb6-4822-b85a-c96594bf8ca5,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:58.111143 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9db6e7df-0c6c-4376-ab3e-76509fe7fcd0,segment=NetworkSegment(ad3b787d-bad8-49ed-bf29-13e361e4a583),segment_id=ad3b787d-bad8-49ed-bf29-13e361e4a583)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:24:58.117648 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:58.155944 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-167b92c1-a1f6-46f3-abbd-ffea007027f6 service neutron] Attempting to bind port 9ff7db85-9b93-4216-acdd-9338d10a0970 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:24:58.156697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-167b92c1-a1f6-46f3-abbd-ffea007027f6 service neutron] Attempting to bind port 9ff7db85-9b93-4216-acdd-9338d10a0970 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:24:58.157096 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-167b92c1-a1f6-46f3-abbd-ffea007027f6 service neutron] Attempting to bind port 9ff7db85-9b93-4216-acdd-9338d10a0970 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:24:58.164844 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ace4de6f-2111-471a-a68b-9c0eb62db568 req-035b2627-6768-4330-9f5b-6fe9010947af tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.101 HTTP/1.1" status: 200 len: 696 time: 0.4491043 Dec 09 21:24:58.165738 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-068374fb-c630-42db-822b-bcd305b67ecb req-455a414c-00d2-4717-a6c3-1e5b707d235c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Made reservation on behalf of 1b7916b634f74760a565cfeaef510cd9 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:24:58.169488 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-068374fb-c630-42db-822b-bcd305b67ecb req-455a414c-00d2-4717-a6c3-1e5b707d235c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:58.191711 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-167b92c1-a1f6-46f3-abbd-ffea007027f6 service neutron] Port 9ff7db85-9b93-4216-acdd-9338d10a0970 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:24:58.192347 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-167b92c1-a1f6-46f3-abbd-ffea007027f6 service neutron] Attempting to bind port 9ff7db85-9b93-4216-acdd-9338d10a0970 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:24:58.193943 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=9db6e7df-0c6c-4376-ab3e-76509fe7fcd0,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:58.194699 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-007725b5-1aac-462e-9b1c-e8c8e0a5a49b admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 1.7200694 Dec 09 21:24:58.197193 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-89ee3076-3372-430f-beea-a6d38ea437bd service neutron] 10.222.0.13 "GET /v2.0/networks/419425e5-89f0-4884-91f7-260c4b9d176a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6677692 Dec 09 21:24:58.199296 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37040) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:58.207188 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-b073f130-2ddd-48f7-beb2-0daad7e2f547 admin admin] Request body: {'subnet': {'network_id': '78764042-44c4-4593-a775-1545766ca91c', 'cidr': '172.20.0.0/28', 'name': 'tempest-FloatingIPsNegativeTestJSON-1102779277-subnet', 'tenant_id': '6133c356707e42408885bbdcb5f67413', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:24:58.236916 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-167b92c1-a1f6-46f3-abbd-ffea007027f6 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 24, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:24:58.237640 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-167b92c1-a1f6-46f3-abbd-ffea007027f6 service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:24:58.237640 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-167b92c1-a1f6-46f3-abbd-ffea007027f6 service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:24:58.238077 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-167b92c1-a1f6-46f3-abbd-ffea007027f6 service neutron] Bound port: 9ff7db85-9b93-4216-acdd-9338d10a0970, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:24:58.238440 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-167b92c1-a1f6-46f3-abbd-ffea007027f6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:58.360369 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa4f079d-6d3a-40c0-897e-ed8a380a5368 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:58.428375 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b073f130-2ddd-48f7-beb2-0daad7e2f547 admin admin] Made reservation on behalf of 6133c356707e42408885bbdcb5f67413 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:24:58.430700 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b073f130-2ddd-48f7-beb2-0daad7e2f547 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:58.512025 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b7939721-0748-4f38-b781-27d98b164b05 None None] Network 5b690ccc-3b51-4e15-887f-038429ce13f5 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:24:58.572463 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa4f079d-6d3a-40c0-897e-ed8a380a5368 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:58.595826 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-14849a64-a3ed-4786-a4a5-d14039878b88 None None] Provisioning complete for port 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:58.596209 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-14849a64-a3ed-4786-a4a5-d14039878b88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:58.606848 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-cf190ee0-0ea8-4551-8a81-c9f3e18da563 service neutron] 10.222.0.13 "GET /v2.0/networks/419425e5-89f0-4884-91f7-260c4b9d176a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3825171 Dec 09 21:24:58.611948 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-167b92c1-a1f6-46f3-abbd-ffea007027f6 service neutron] For port 9ff7db85-9b93-4216-acdd-9338d10a0970, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:24:58.620840 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ace4de6f-2111-471a-a68b-9c0eb62db568 req-8924d86d-fc90-4209-9f0c-3cc4a8dd61ea tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:58.622268 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ace4de6f-2111-471a-a68b-9c0eb62db568 req-8924d86d-fc90-4209-9f0c-3cc4a8dd61ea tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.4499583 Dec 09 21:24:58.632812 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-167b92c1-a1f6-46f3-abbd-ffea007027f6 service neutron] For port 9ff7db85-9b93-4216-acdd-9338d10a0970, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=9ff7db85-9b93-4216-acdd-9338d10a0970,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:24:58.648759 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-068374fb-c630-42db-822b-bcd305b67ecb req-455a414c-00d2-4717-a6c3-1e5b707d235c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Allocated IP 172.20.0.12 (43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb/50496955-1646-4079-acd4-a47e8cd175cb/a0305bf6-a5f5-4907-b32b-a04b1fb34872) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:24:58.651363 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-167b92c1-a1f6-46f3-abbd-ffea007027f6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:58.708888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-167b92c1-a1f6-46f3-abbd-ffea007027f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:58.709815 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-167b92c1-a1f6-46f3-abbd-ffea007027f6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:58.712176 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-167b92c1-a1f6-46f3-abbd-ffea007027f6 service neutron] 10.222.0.10 "PUT /v2.0/ports/9ff7db85-9b93-4216-acdd-9338d10a0970 HTTP/1.1" status: 200 len: 1096 time: 2.6840122 Dec 09 21:24:58.716301 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aa4f079d-6d3a-40c0-897e-ed8a380a5368 admin admin] Router 290dc430-7830-4b38-89f7-0330682d7558 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:24:58.720176 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f0e077f0-ebc8-425d-939f-f2a18284a3b6', 'tag': '9ff7db85-9b93-4216-acdd-9338d10a0970'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:24:58.722606 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5689b656-5749-49dd-902c-24c1b76d15d4" -d '{"events": [{"name": "network-changed", "server_uuid": "f0e077f0-ebc8-425d-939f-f2a18284a3b6", "tag": "9ff7db85-9b93-4216-acdd-9338d10a0970"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:24:58.917697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-167b92c1-a1f6-46f3-abbd-ffea007027f6 service neutron] Pushing event updated for resources: {'Port': ['ID=9ff7db85-9b93-4216-acdd-9338d10a0970,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:58.956994 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aa4f079d-6d3a-40c0-897e-ed8a380a5368 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:24:58.967155 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] Sync routers for ids ['290dc430-7830-4b38-89f7-0330682d7558'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:24:58.989348 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] Routers {'290dc430-7830-4b38-89f7-0330682d7558'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:24:58.991481 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['290dc430-7830-4b38-89f7-0330682d7558'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:59.004400 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa4f079d-6d3a-40c0-897e-ed8a380a5368 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:59.011044 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-aa4f079d-6d3a-40c0-897e-ed8a380a5368 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 2.7051752 Dec 09 21:24:59.011401 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37050) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:24:59.136707 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62cdc68d-59e5-47a6-94de-7c62a1a89836 req-e2d9f449-b5d4-458e-987f-3c430b09bbee tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:59.138249 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-62cdc68d-59e5-47a6-94de-7c62a1a89836 req-e2d9f449-b5d4-458e-987f-3c430b09bbee tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=73466791-f610-4f93-892b-3077db341121 HTTP/1.1" status: 200 len: 945 time: 0.3485339 Dec 09 21:24:59.140415 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-c74ea16c-5745-40c6-b885-09c834c3c3df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:59.142164 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-c74ea16c-5745-40c6-b885-09c834c3c3df service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=3329fed690514d85b98adeb6691d89f2&device_id=f0e077f0-ebc8-425d-939f-f2a18284a3b6 HTTP/1.1" status: 200 len: 1099 time: 0.3679121 Dec 09 21:24:59.227604 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b073f130-2ddd-48f7-beb2-0daad7e2f547 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:59.229918 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-51cbfd19-1992-4a52-beda-522d282eb350 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.18&port_id=9ff7db85-9b93-4216-acdd-9338d10a0970 HTTP/1.1" status: 200 len: 217 time: 0.0771127 Dec 09 21:24:59.234720 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] Set router 290dc430-7830-4b38-89f7-0330682d7558 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:24:59.341224 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-91258202-7f0d-4665-96bd-0371e80d5f7f None None] Provisioning complete for port 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:24:59.341646 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-91258202-7f0d-4665-96bd-0371e80d5f7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:59.387748 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b073f130-2ddd-48f7-beb2-0daad7e2f547 admin admin] Pushing event updated for resources: {'Subnet': ['ID=746a03de-007e-4d48-91db-784f6fe01ab8,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:59.399704 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-068374fb-c630-42db-822b-bcd305b67ecb req-455a414c-00d2-4717-a6c3-1e5b707d235c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:59.411689 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-62cdc68d-59e5-47a6-94de-7c62a1a89836 req-c812040e-c2d1-4ce8-95ce-dff68bf97b4d tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2616816 Dec 09 21:24:59.427587 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-8e0c2c5c-229f-4342-8bbd-138483e423f1 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-securitygroup--1684175526&fields=id&tenant_id=dd631239105645b6b7088738a5229b7f HTTP/1.1" status: 200 len: 267 time: 0.2083142 Dec 09 21:24:59.507681 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-172c6d2b-e61f-4039-8313-0d564b9a46de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:59.509309 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-172c6d2b-e61f-4039-8313-0d564b9a46de service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.2254021 Dec 09 21:24:59.531921 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '290dc430-7830-4b38-89f7-0330682d7558', 'name': 'tempest-ServersTestMultiNic-285103454-router', 'tenant_id': '73812a0c336d4768b029fd6459a1ae9e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.220'}], 'enable_snat': True}, 'gw_port_id': '0c193336-bbb6-4822-b85a-c96594bf8ca5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:56Z', 'updated_at': '2021-12-09T21:24:58Z', 'revision_number': 3, 'project_id': '73812a0c336d4768b029fd6459a1ae9e', 'gw_port': {'id': '0c193336-bbb6-4822-b85a-c96594bf8ca5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:81:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '290dc430-7830-4b38-89f7-0330682d7558', 'device_owner': 'network:router_gateway', 'standard_attr_id': 869, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:57Z', 'updated_at': '2021-12-09T21:24:57Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:24:59.561143 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] Checking router: 290dc430-7830-4b38-89f7-0330682d7558 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:24:59.561811 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] Updating router 290dc430-7830-4b38-89f7-0330682d7558 port 0c193336-bbb6-4822-b85a-c96594bf8ca5 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:24:59.578465 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b073f130-2ddd-48f7-beb2-0daad7e2f547 admin admin] Checking segment: {'id': '1acd79aa-cd7a-4fee-a7fc-139e8b6382c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '78764042-44c4-4593-a775-1545766ca91c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:24:59.579152 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b073f130-2ddd-48f7-beb2-0daad7e2f547 admin admin] Network hostable DHCP agents. Network: 78764042-44c4-4593-a775-1545766ca91c, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:24:59.594371 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:59.691008 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-068374fb-c630-42db-822b-bcd305b67ecb req-455a414c-00d2-4717-a6c3-1e5b707d235c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:59.753663 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b073f130-2ddd-48f7-beb2-0daad7e2f547 admin admin] Network 78764042-44c4-4593-a775-1545766ca91c is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:24:59.760505 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:24:59.762115 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2c288abf-9d99-40af-9b4b-cd711427ed71 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:59.796320 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8563ce6-8ecb-4220-8779-adabeb500603 req-62f9d53f-03fe-4a30-ba1a-51cf8624806f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:59.798088 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8563ce6-8ecb-4220-8779-adabeb500603 req-62f9d53f-03fe-4a30-ba1a-51cf8624806f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/ports?device_id=f0e077f0-ebc8-425d-939f-f2a18284a3b6 HTTP/1.1" status: 200 len: 947 time: 0.2612572 Dec 09 21:24:59.813594 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-f96b4370-6331-4873-ac9f-6801a74e9db6 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:59.821171 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-f96b4370-6331-4873-ac9f-6801a74e9db6 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "GET /v2.0/networks?id=ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c HTTP/1.1" status: 200 len: 815 time: 0.3926668 Dec 09 21:24:59.824756 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-85e7a99b-e71a-4cea-9b68-347bbe915cc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:59.827553 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-85e7a99b-e71a-4cea-9b68-347bbe915cc3 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.2844393 Dec 09 21:24:59.827553 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-b073f130-2ddd-48f7-beb2-0daad7e2f547 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 78764042-44c4-4593-a775-1545766ca91c) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:59.831045 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-068374fb-c630-42db-822b-bcd305b67ecb req-455a414c-00d2-4717-a6c3-1e5b707d235c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:24:59.846051 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d6df94ba-a5e2-49dc-9d83-3f324520ed9d None None] Network 78764042-44c4-4593-a775-1545766ca91c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:24:59.850634 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b073f130-2ddd-48f7-beb2-0daad7e2f547 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:24:59.851231 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b073f130-2ddd-48f7-beb2-0daad7e2f547 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:24:59.853898 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-068374fb-c630-42db-822b-bcd305b67ecb req-455a414c-00d2-4717-a6c3-1e5b707d235c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:24:59.855747 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-455a414c-00d2-4717-a6c3-1e5b707d235c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Pushing event updated for resources: {'Port': ['ID=a0305bf6-a5f5-4907-b32b-a04b1fb34872,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:24:59.880558 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-068374fb-c630-42db-822b-bcd305b67ecb req-455a414c-00d2-4717-a6c3-1e5b707d235c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:24:59.933053 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-4df33429-d894-410a-9f1b-ed189560603e tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "GET /v2.0/quotas/dd631239105645b6b7088738a5229b7f HTTP/1.1" status: 200 len: 375 time: 0.1106479 Dec 09 21:24:59.989396 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-2c288abf-9d99-40af-9b4b-cd711427ed71 admin admin] Allocated IP 172.20.0.1 (5b690ccc-3b51-4e15-887f-038429ce13f5/65af9a54-bf8f-4f71-97a2-68f4a31a18ad/91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:25:00.002170 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b073f130-2ddd-48f7-beb2-0daad7e2f547 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 1.7987292 Dec 09 21:25:00.006759 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37070) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:00.013686 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-1a17ca6f-9b2c-44b0-bce3-4773406ba024 admin admin] Request body: {'router': {'name': 'tempest-FloatingIPsNegativeTestJSON-1102779277-router', 'tenant_id': '6133c356707e42408885bbdcb5f67413', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:00.060641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-068374fb-c630-42db-822b-bcd305b67ecb req-455a414c-00d2-4717-a6c3-1e5b707d235c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:00.061615 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-068374fb-c630-42db-822b-bcd305b67ecb req-455a414c-00d2-4717-a6c3-1e5b707d235c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:00.085600 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8563ce6-8ecb-4220-8779-adabeb500603 req-ba3f241d-433c-410f-b1d4-3286900dcad2 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/security-groups?id=50885dec-ee01-4c11-bc49-430c219f37b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2491906 Dec 09 21:25:00.093589 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a17ca6f-9b2c-44b0-bce3-4773406ba024 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:00.095791 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a17ca6f-9b2c-44b0-bce3-4773406ba024 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:00.116148 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:00.116774 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:00.124825 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-eba50300-981e-4479-8eef-5c3c74e94eff tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=dd631239105645b6b7088738a5229b7f&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1877854 Dec 09 21:25:00.146686 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-068374fb-c630-42db-822b-bcd305b67ecb req-455a414c-00d2-4717-a6c3-1e5b707d235c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.9068000 Dec 09 21:25:00.169682 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2c288abf-9d99-40af-9b4b-cd711427ed71 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:00.182885 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-507c46af-401d-4f66-91cb-b71fded9abd9 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3366671 Dec 09 21:25:00.200658 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a17ca6f-9b2c-44b0-bce3-4773406ba024 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:00.228087 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04bea437-07bb-4cf6-aabd-d63f57b950db None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-78764042-44c4-4593-a775-1545766ca91c', 'network_id': '78764042-44c4-4593-a775-1545766ca91c', 'project_id': '6133c356707e42408885bbdcb5f67413', 'fixed_ips': [{'subnet_id': '746a03de-007e-4d48-91db-784f6fe01ab8'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:25:00.228962 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-04bea437-07bb-4cf6-aabd-d63f57b950db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:00.305062 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:00.318438 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-068374fb-c630-42db-822b-bcd305b67ecb req-f4e6e12e-9bfb-4c93-9195-fc04f811f200 service neutron] Request body: {'port': {'device_id': '6fc3ad38-60ed-42b3-8c67-af66849bcbaf', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:00.382165 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:00.503518 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] Attempting to bind port 0c193336-bbb6-4822-b85a-c96594bf8ca5 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:25:00.504003 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] Attempting to bind port 0c193336-bbb6-4822-b85a-c96594bf8ca5 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:25:00.504337 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] Attempting to bind port 0c193336-bbb6-4822-b85a-c96594bf8ca5 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:00.512971 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c521d79f-d724-4b82-9abf-784b93f3ea05 None None] Pushing event updated for resources: {'Port': ['ID=0c193336-bbb6-4822-b85a-c96594bf8ca5,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:00.531576 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8cc265a-4a23-481c-a007-d1c96746da09 req-1fa99b1f-2bb5-4b00-91a3-ad0d31378390 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 0.3471329 Dec 09 21:25:00.537763 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 24, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:25:00.538549 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:25:00.539221 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:00.539892 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:25:00.540609 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] Bound port: 0c193336-bbb6-4822-b85a-c96594bf8ca5, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:25:00.541280 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:00.549153 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a17ca6f-9b2c-44b0-bce3-4773406ba024 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:00.550590 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-b8cc265a-4a23-481c-a007-d1c96746da09 req-4ff1177a-128e-4abc-9e20-a217a3fae34e tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:00.556152 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2c288abf-9d99-40af-9b4b-cd711427ed71 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:00.556783 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-068374fb-c630-42db-822b-bcd305b67ecb req-f4e6e12e-9bfb-4c93-9195-fc04f811f200 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:00.613256 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-785510de-607c-4bff-bf3e-0dcbc979df72 service neutron] 10.222.0.13 "GET /v2.0/networks/ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4613988 Dec 09 21:25:00.635467 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4e7c69-dac0-41e7-b285-29c255062aaa req-2e25c376-14d4-4e4f-8755-6c2a94733030 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3137362 Dec 09 21:25:00.640039 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] For port 0c193336-bbb6-4822-b85a-c96594bf8ca5, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:25:00.655589 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c288abf-9d99-40af-9b4b-cd711427ed71 admin admin] Network 5b690ccc-3b51-4e15-887f-038429ce13f5 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:25:00.658384 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] For port 0c193336-bbb6-4822-b85a-c96594bf8ca5, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=0c193336-bbb6-4822-b85a-c96594bf8ca5,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:25:00.668088 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-2c288abf-9d99-40af-9b4b-cd711427ed71 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:00.668802 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b8cc265a-4a23-481c-a007-d1c96746da09 req-4ff1177a-128e-4abc-9e20-a217a3fae34e tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:00.676776 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-04bea437-07bb-4cf6-aabd-d63f57b950db None None] Allocated IP 172.20.0.2 (78764042-44c4-4593-a775-1545766ca91c/746a03de-007e-4d48-91db-784f6fe01ab8/739045da-de08-4bd9-8441-0e750354346e) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:25:00.694796 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-a56adbcd-89e5-4a2a-9a6c-dff324ca21be tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:00.698024 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-a56adbcd-89e5-4a2a-9a6c-dff324ca21be tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.31 "GET /v2.0/networks?id=419425e5-89f0-4884-91f7-260c4b9d176a HTTP/1.1" status: 200 len: 814 time: 0.3487675 Dec 09 21:25:00.699025 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c288abf-9d99-40af-9b4b-cd711427ed71 admin admin] Pushing event updated for resources: {'Port': ['ID=91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:00.706355 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c288abf-9d99-40af-9b4b-cd711427ed71 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:25:00.741389 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:00.744366 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-f3aaca96-1be9-48f4-b5d7-380c30e2d92e tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Request body: {'port': {'device_id': '97debe2b-c2b5-48af-a541-3e55e73d399f', 'network_id': '419425e5-89f0-4884-91f7-260c4b9d176a', 'admin_state_up': True, 'tenant_id': '87694f06f4144186aac9c50bac43d5ec'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:00.941694 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-6ae1c51a-c603-41a5-ab10-eed5b763c6ff service neutron] 10.222.0.13 "GET /v2.0/networks/ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3019249 Dec 09 21:25:00.947330 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c521d79f-d724-4b82-9abf-784b93f3ea05 None None] Pushing event updated for resources: {'Port': ['ID=0c193336-bbb6-4822-b85a-c96594bf8ca5,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:00.994630 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] Routers {'290dc430-7830-4b38-89f7-0330682d7558'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:25:00.995791 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['290dc430-7830-4b38-89f7-0330682d7558'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:01.146271 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b8cc265a-4a23-481c-a007-d1c96746da09 req-4ff1177a-128e-4abc-9e20-a217a3fae34e tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:01.265496 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] Set router 290dc430-7830-4b38-89f7-0330682d7558 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:25:01.307888 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:24:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4108e1be-84d7-4018-b348-5249693a590c x-openstack-request-id: req-4108e1be-84d7-4018-b348-5249693a590c {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:01.315472 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f0e077f0-ebc8-425d-939f-f2a18284a3b6", "tag": "9ff7db85-9b93-4216-acdd-9338d10a0970", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:01.315994 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-4108e1be-84d7-4018-b348-5249693a590c {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:01.316599 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f0e077f0-ebc8-425d-939f-f2a18284a3b6', 'tag': '9ff7db85-9b93-4216-acdd-9338d10a0970', 'status': 'completed', 'code': 200} Dec 09 21:25:01.324186 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-068374fb-c630-42db-822b-bcd305b67ecb req-f4e6e12e-9bfb-4c93-9195-fc04f811f200 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a0305bf6-a5f5-4907-b32b-a04b1fb34872 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:01.355818 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-068374fb-c630-42db-822b-bcd305b67ecb req-f4e6e12e-9bfb-4c93-9195-fc04f811f200 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:01.410773 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-04bea437-07bb-4cf6-aabd-d63f57b950db None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:01.422762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-068374fb-c630-42db-822b-bcd305b67ecb req-f4e6e12e-9bfb-4c93-9195-fc04f811f200 service neutron] Transition to ACTIVE for port object a0305bf6-a5f5-4907-b32b-a04b1fb34872 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:25:01.424003 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c8518924-3b5a-4702-8424-b6eb369eb726 None None] Provisioning complete for port 91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:01.424559 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c8518924-3b5a-4702-8424-b6eb369eb726 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:01.481942 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-04bea437-07bb-4cf6-aabd-d63f57b950db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:01.565084 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04bea437-07bb-4cf6-aabd-d63f57b950db None None] Pushing event updated for resources: {'Port': ['ID=739045da-de08-4bd9-8441-0e750354346e,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:01.577484 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-b8cc265a-4a23-481c-a007-d1c96746da09 req-4ff1177a-128e-4abc-9e20-a217a3fae34e tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Allocated IP 172.25.3.143 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/1a557782-cea6-4c8f-bfcf-437174910bee) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:25:01.631190 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2c288abf-9d99-40af-9b4b-cd711427ed71 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:01.684032 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-c8518924-3b5a-4702-8424-b6eb369eb726 None None] Port 91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:25:01.745678 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b8cc265a-4a23-481c-a007-d1c96746da09 req-4ff1177a-128e-4abc-9e20-a217a3fae34e tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:01.748442 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04bea437-07bb-4cf6-aabd-d63f57b950db None None] Network 78764042-44c4-4593-a775-1545766ca91c is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:25:01.751991 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-04bea437-07bb-4cf6-aabd-d63f57b950db None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:01.762388 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04bea437-07bb-4cf6-aabd-d63f57b950db None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:25:01.813134 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-068374fb-c630-42db-822b-bcd305b67ecb req-f4e6e12e-9bfb-4c93-9195-fc04f811f200 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:01.916519 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b8cc265a-4a23-481c-a007-d1c96746da09 req-4ff1177a-128e-4abc-9e20-a217a3fae34e tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:01.917443 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-04bea437-07bb-4cf6-aabd-d63f57b950db None None] Attempting to bind port 739045da-de08-4bd9-8441-0e750354346e on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:25:01.917848 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-04bea437-07bb-4cf6-aabd-d63f57b950db None None] Attempting to bind port 739045da-de08-4bd9-8441-0e750354346e by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '1acd79aa-cd7a-4fee-a7fc-139e8b6382c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '78764042-44c4-4593-a775-1545766ca91c'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:25:01.918243 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04bea437-07bb-4cf6-aabd-d63f57b950db None None] Attempting to bind port 739045da-de08-4bd9-8441-0e750354346e on network 78764042-44c4-4593-a775-1545766ca91c {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:01.926831 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04bea437-07bb-4cf6-aabd-d63f57b950db None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 24, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:25:01.927222 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04bea437-07bb-4cf6-aabd-d63f57b950db None None] Checking segment: {'id': '1acd79aa-cd7a-4fee-a7fc-139e8b6382c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '78764042-44c4-4593-a775-1545766ca91c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:25:01.928188 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-04bea437-07bb-4cf6-aabd-d63f57b950db None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:01.928188 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04bea437-07bb-4cf6-aabd-d63f57b950db None None] Bound using segment: {'id': '1acd79aa-cd7a-4fee-a7fc-139e8b6382c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '78764042-44c4-4593-a775-1545766ca91c'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:25:01.928852 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-04bea437-07bb-4cf6-aabd-d63f57b950db None None] Bound port: 739045da-de08-4bd9-8441-0e750354346e, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1acd79aa-cd7a-4fee-a7fc-139e8b6382c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '78764042-44c4-4593-a775-1545766ca91c'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:25:01.929262 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-04bea437-07bb-4cf6-aabd-d63f57b950db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:01.933872 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4e6e12e-9bfb-4c93-9195-fc04f811f200 service neutron] Pushing event updated for resources: {'Port': ['ID=a0305bf6-a5f5-4907-b32b-a04b1fb34872,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:01.953279 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d0639b3f-f1d0-4ea0-a432-576cdc619d52 req-726c97fa-2ea6-4f67-9388-1ec6889f8b45 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.13 "GET /v2.0/ports?device_id=97debe2b-c2b5-48af-a541-3e55e73d399f HTTP/1.1" status: 200 len: 210 time: 0.5294695 Dec 09 21:25:02.030337 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-04bea437-07bb-4cf6-aabd-d63f57b950db None None] For port 739045da-de08-4bd9-8441-0e750354346e, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:25:02.034081 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-04bea437-07bb-4cf6-aabd-d63f57b950db None None] For port 739045da-de08-4bd9-8441-0e750354346e, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=739045da-de08-4bd9-8441-0e750354346e,segment=NetworkSegment(1acd79aa-cd7a-4fee-a7fc-139e8b6382c5),segment_id=1acd79aa-cd7a-4fee-a7fc-139e8b6382c5)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:25:02.039368 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '290dc430-7830-4b38-89f7-0330682d7558', 'name': 'tempest-ServersTestMultiNic-285103454-router', 'tenant_id': '73812a0c336d4768b029fd6459a1ae9e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.220'}], 'enable_snat': True}, 'gw_port_id': '0c193336-bbb6-4822-b85a-c96594bf8ca5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:56Z', 'updated_at': '2021-12-09T21:24:58Z', 'revision_number': 3, 'project_id': '73812a0c336d4768b029fd6459a1ae9e', 'gw_port': {'id': '0c193336-bbb6-4822-b85a-c96594bf8ca5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:81:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '290dc430-7830-4b38-89f7-0330682d7558', 'device_owner': 'network:router_gateway', 'standard_attr_id': 869, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:57Z', 'updated_at': '2021-12-09T21:25:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:02.084614 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-04bea437-07bb-4cf6-aabd-d63f57b950db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:02.089966 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8dcf0a9-2c57-4ab5-93c5-f4dc1f000456 None None] The sync data for ids ['290dc430-7830-4b38-89f7-0330682d7558'] in n-d-713301-27 is: [{'id': '290dc430-7830-4b38-89f7-0330682d7558', 'name': 'tempest-ServersTestMultiNic-285103454-router', 'tenant_id': '73812a0c336d4768b029fd6459a1ae9e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.220'}], 'enable_snat': True}, 'gw_port_id': '0c193336-bbb6-4822-b85a-c96594bf8ca5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:56Z', 'updated_at': '2021-12-09T21:24:58Z', 'revision_number': 3, 'project_id': '73812a0c336d4768b029fd6459a1ae9e', 'gw_port': {'id': '0c193336-bbb6-4822-b85a-c96594bf8ca5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:81:60', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '290dc430-7830-4b38-89f7-0330682d7558', 'device_owner': 'network:router_gateway', 'standard_attr_id': 869, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:57Z', 'updated_at': '2021-12-09T21:25:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:25:02.193399 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04bea437-07bb-4cf6-aabd-d63f57b950db None None] Pushing event updated for resources: {'Port': ['ID=739045da-de08-4bd9-8441-0e750354346e,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:02.235357 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2c288abf-9d99-40af-9b4b-cd711427ed71 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:02.405182 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-f3aaca96-1be9-48f4-b5d7-380c30e2d92e tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Made reservation on behalf of 87694f06f4144186aac9c50bac43d5ec for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:25:02.409250 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-f3aaca96-1be9-48f4-b5d7-380c30e2d92e tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:02.661822 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b8cc265a-4a23-481c-a007-d1c96746da09 req-4ff1177a-128e-4abc-9e20-a217a3fae34e tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:25:02.665257 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5689b656-5749-49dd-902c-24c1b76d15d4 req-c87651ad-98b5-4483-9a40-f7125c6ec662 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:02.666942 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5689b656-5749-49dd-902c-24c1b76d15d4 req-c87651ad-98b5-4483-9a40-f7125c6ec662 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=3329fed690514d85b98adeb6691d89f2&device_id=f0e077f0-ebc8-425d-939f-f2a18284a3b6 HTTP/1.1" status: 200 len: 1099 time: 1.3080449 Dec 09 21:25:02.667947 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ff1177a-128e-4abc-9e20-a217a3fae34e tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Pushing event updated for resources: {'Port': ['ID=1a557782-cea6-4c8f-bfcf-437174910bee,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:02.671814 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-b8cc265a-4a23-481c-a007-d1c96746da09 req-4ff1177a-128e-4abc-9e20-a217a3fae34e tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:02.674816 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-b8cc265a-4a23-481c-a007-d1c96746da09 req-4ff1177a-128e-4abc-9e20-a217a3fae34e tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:25:02.724713 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a17ca6f-9b2c-44b0-bce3-4773406ba024 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:02.826844 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a17ca6f-9b2c-44b0-bce3-4773406ba024 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:02.843511 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-f3aaca96-1be9-48f4-b5d7-380c30e2d92e tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Allocated IP 172.20.0.11 (419425e5-89f0-4884-91f7-260c4b9d176a/ffbc2156-2e0a-4a3b-8e1a-215cf8f39866/90eef560-add6-4b61-8d08-f04574a6a893) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:25:02.873022 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-533a5219-b3b9-41e5-a2ee-3dcb1fa478bb req-8a94bafd-4c27-4f2f-8b97-617ebd4182ac tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:02.882170 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-533a5219-b3b9-41e5-a2ee-3dcb1fa478bb req-8a94bafd-4c27-4f2f-8b97-617ebd4182ac tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=6fc3ad38-60ed-42b3-8c67-af66849bcbaf HTTP/1.1" status: 200 len: 944 time: 0.1986921 Dec 09 21:25:03.040426 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3dca9b46-0ebf-46b0-8d8f-dab3dbaceb37 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:03.045182 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b8cc265a-4a23-481c-a007-d1c96746da09 req-4ff1177a-128e-4abc-9e20-a217a3fae34e tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:03.078593 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2c288abf-9d99-40af-9b4b-cd711427ed71 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:03.079762 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-533a5219-b3b9-41e5-a2ee-3dcb1fa478bb req-a069ce50-a7fe-4987-b9ef-a861ce9eedef tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1926308 Dec 09 21:25:03.102059 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2c288abf-9d99-40af-9b4b-cd711427ed71 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:03.126339 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-068374fb-c630-42db-822b-bcd305b67ecb req-f4e6e12e-9bfb-4c93-9195-fc04f811f200 service neutron] Attempting to bind port a0305bf6-a5f5-4907-b32b-a04b1fb34872 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:25:03.126672 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-068374fb-c630-42db-822b-bcd305b67ecb req-f4e6e12e-9bfb-4c93-9195-fc04f811f200 service neutron] Attempting to bind port a0305bf6-a5f5-4907-b32b-a04b1fb34872 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:25:03.127003 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-068374fb-c630-42db-822b-bcd305b67ecb req-f4e6e12e-9bfb-4c93-9195-fc04f811f200 service neutron] Attempting to bind port a0305bf6-a5f5-4907-b32b-a04b1fb34872 on network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:03.187585 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-068374fb-c630-42db-822b-bcd305b67ecb req-f4e6e12e-9bfb-4c93-9195-fc04f811f200 service neutron] Port a0305bf6-a5f5-4907-b32b-a04b1fb34872 on network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:25:03.187901 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-068374fb-c630-42db-822b-bcd305b67ecb req-f4e6e12e-9bfb-4c93-9195-fc04f811f200 service neutron] Attempting to bind port a0305bf6-a5f5-4907-b32b-a04b1fb34872 on network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:03.224072 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5689b656-5749-49dd-902c-24c1b76d15d4 req-3b985227-6cc9-4aee-93a4-8fe389051f71 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:03.226114 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5689b656-5749-49dd-902c-24c1b76d15d4 req-3b985227-6cc9-4aee-93a4-8fe389051f71 service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.5159047 Dec 09 21:25:03.229713 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-068374fb-c630-42db-822b-bcd305b67ecb req-f4e6e12e-9bfb-4c93-9195-fc04f811f200 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 24, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:25:03.234843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-068374fb-c630-42db-822b-bcd305b67ecb req-f4e6e12e-9bfb-4c93-9195-fc04f811f200 service neutron] Checking segment: {'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:25:03.235559 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-068374fb-c630-42db-822b-bcd305b67ecb req-f4e6e12e-9bfb-4c93-9195-fc04f811f200 service neutron] Bound using segment: {'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:25:03.237175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-068374fb-c630-42db-822b-bcd305b67ecb req-f4e6e12e-9bfb-4c93-9195-fc04f811f200 service neutron] Bound port: a0305bf6-a5f5-4907-b32b-a04b1fb34872, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:25:03.239061 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-1a17ca6f-9b2c-44b0-bce3-4773406ba024 admin admin] Allocated IP 172.25.3.73 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/6ab9bd80-c278-4b58-a046-303d80c95939) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:25:03.239678 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-068374fb-c630-42db-822b-bcd305b67ecb req-f4e6e12e-9bfb-4c93-9195-fc04f811f200 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:03.274438 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c288abf-9d99-40af-9b4b-cd711427ed71 admin admin] Pushing event updated for resources: {'Port': ['ID=91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:03.289509 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2c288abf-9d99-40af-9b4b-cd711427ed71 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:03.322573 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b8cc265a-4a23-481c-a007-d1c96746da09 req-4ff1177a-128e-4abc-9e20-a217a3fae34e tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:03.575019 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5689b656-5749-49dd-902c-24c1b76d15d4 req-42cdb5f8-b7e9-4fb3-ab53-b2289a76ec01 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.18&port_id=9ff7db85-9b93-4216-acdd-9338d10a0970 HTTP/1.1" status: 200 len: 217 time: 0.3252749 Dec 09 21:25:03.657770 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-f3aaca96-1be9-48f4-b5d7-380c30e2d92e tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:03.666481 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c45e0793-61b0-477a-8128-f480f481a0a7 None None] Network 78764042-44c4-4593-a775-1545766ca91c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:25:03.698565 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a17ca6f-9b2c-44b0-bce3-4773406ba024 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:03.711485 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5689b656-5749-49dd-902c-24c1b76d15d4 req-e3713517-e40a-4fc9-802b-1ddcc9f75a7b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:03.714247 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5689b656-5749-49dd-902c-24c1b76d15d4 req-e3713517-e40a-4fc9-802b-1ddcc9f75a7b service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0588605 Dec 09 21:25:03.721180 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 9ff7db85-9b93-4216-acdd-9338d10a0970 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:25:03.750944 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a17ca6f-9b2c-44b0-bce3-4773406ba024 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:03.816169 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-068374fb-c630-42db-822b-bcd305b67ecb req-f4e6e12e-9bfb-4c93-9195-fc04f811f200 service neutron] For port a0305bf6-a5f5-4907-b32b-a04b1fb34872, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:25:03.854415 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-068374fb-c630-42db-822b-bcd305b67ecb req-f4e6e12e-9bfb-4c93-9195-fc04f811f200 service neutron] For port a0305bf6-a5f5-4907-b32b-a04b1fb34872, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=a0305bf6-a5f5-4907-b32b-a04b1fb34872,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:25:03.910012 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a17ca6f-9b2c-44b0-bce3-4773406ba024 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:25:03.918964 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-068374fb-c630-42db-822b-bcd305b67ecb req-f4e6e12e-9bfb-4c93-9195-fc04f811f200 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:03.925217 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c288abf-9d99-40af-9b4b-cd711427ed71 admin admin] Network 5b690ccc-3b51-4e15-887f-038429ce13f5 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:25:03.936713 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-1a17ca6f-9b2c-44b0-bce3-4773406ba024 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:03.948243 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 9ff7db85-9b93-4216-acdd-9338d10a0970, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=9ff7db85-9b93-4216-acdd-9338d10a0970,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:03.956038 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5689b656-5749-49dd-902c-24c1b76d15d4 req-8f503dd7-68d9-4dca-a826-0f7fc7186a29 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:03.957549 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5689b656-5749-49dd-902c-24c1b76d15d4 req-8f503dd7-68d9-4dca-a826-0f7fc7186a29 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.2243729 Dec 09 21:25:03.958184 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-2c288abf-9d99-40af-9b4b-cd711427ed71 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:03.963262 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a17ca6f-9b2c-44b0-bce3-4773406ba024 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:25:03.967061 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a17ca6f-9b2c-44b0-bce3-4773406ba024 admin admin] Pushing event updated for resources: {'Port': ['ID=6ab9bd80-c278-4b58-a046-303d80c95939,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:03.987029 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '9ff7db85-9b93-4216-acdd-9338d10a0970', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '9ff7db85-9b93-4216-acdd-9338d10a0970', 'mac_address': 'fa:16:3e:2e:79:70', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.18'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:25:04.005546 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fc9efaa-2ffe-4384-a07e-05e11a1e0a83 req-78d335e7-b7b3-4942-a395-cbe3b5a49bcb tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:04.007225 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9fc9efaa-2ffe-4384-a07e-05e11a1e0a83 req-78d335e7-b7b3-4942-a395-cbe3b5a49bcb tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/ports?device_id=f0e077f0-ebc8-425d-939f-f2a18284a3b6 HTTP/1.1" status: 200 len: 947 time: 0.2890778 Dec 09 21:25:04.009586 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-068374fb-c630-42db-822b-bcd305b67ecb req-f4e6e12e-9bfb-4c93-9195-fc04f811f200 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:04.009586 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-068374fb-c630-42db-822b-bcd305b67ecb req-f4e6e12e-9bfb-4c93-9195-fc04f811f200 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:04.010942 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-068374fb-c630-42db-822b-bcd305b67ecb req-f4e6e12e-9bfb-4c93-9195-fc04f811f200 service neutron] 10.222.0.10 "PUT /v2.0/ports/a0305bf6-a5f5-4907-b32b-a04b1fb34872 HTTP/1.1" status: 200 len: 1093 time: 3.6975737 Dec 09 21:25:04.020143 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0c193336-bbb6-4822-b85a-c96594bf8ca5 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:04.036236 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6fc3ad38-60ed-42b3-8c67-af66849bcbaf', 'tag': 'a0305bf6-a5f5-4907-b32b-a04b1fb34872'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:04.038538 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2563120b-15f0-4af7-880d-680576e7eea7" -d '{"events": [{"name": "network-changed", "server_uuid": "6fc3ad38-60ed-42b3-8c67-af66849bcbaf", "tag": "a0305bf6-a5f5-4907-b32b-a04b1fb34872"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:04.044720 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b8cc265a-4a23-481c-a007-d1c96746da09 req-4ff1177a-128e-4abc-9e20-a217a3fae34e tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:04.089583 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b8cc265a-4a23-481c-a007-d1c96746da09 req-4ff1177a-128e-4abc-9e20-a217a3fae34e tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:04.095657 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-f6ea7725-79ae-455b-b202-ca53985e8169 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:04.097111 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-f6ea7725-79ae-455b-b202-ca53985e8169 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.10 "GET /v2.0/networks?id=ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c HTTP/1.1" status: 200 len: 815 time: 0.5144694 Dec 09 21:25:04.098299 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-f3aaca96-1be9-48f4-b5d7-380c30e2d92e tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:04.166093 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4e6e12e-9bfb-4c93-9195-fc04f811f200 service neutron] Pushing event updated for resources: {'Port': ['ID=a0305bf6-a5f5-4907-b32b-a04b1fb34872,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:04.281648 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-f3aaca96-1be9-48f4-b5d7-380c30e2d92e tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Network 419425e5-89f0-4884-91f7-260c4b9d176a is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:25:04.321131 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9fc9efaa-2ffe-4384-a07e-05e11a1e0a83 req-01fe20a3-e988-4fab-8b2b-d454f9d857f8 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/security-groups?id=50885dec-ee01-4c11-bc49-430c219f37b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2738311 Dec 09 21:25:04.322700 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-068374fb-c630-42db-822b-bcd305b67ecb req-a67cfdf0-d82d-49c1-b781-ac87bafaca2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:04.324265 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-068374fb-c630-42db-822b-bcd305b67ecb req-a67cfdf0-d82d-49c1-b781-ac87bafaca2c service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=1b7916b634f74760a565cfeaef510cd9&device_id=6fc3ad38-60ed-42b3-8c67-af66849bcbaf HTTP/1.1" status: 200 len: 1096 time: 0.2547417 Dec 09 21:25:04.326958 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-f3aaca96-1be9-48f4-b5d7-380c30e2d92e tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:04.337662 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-f3aaca96-1be9-48f4-b5d7-380c30e2d92e tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:25:04.351200 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ff1177a-128e-4abc-9e20-a217a3fae34e tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Pushing event updated for resources: {'Port': ['ID=1a557782-cea6-4c8f-bfcf-437174910bee,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:04.379255 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8a1abb3e-cf0f-464f-ac64-a4f7ffd2c4dd None None] Provisioning complete for port 739045da-de08-4bd9-8441-0e750354346e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:04.380314 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8a1abb3e-cf0f-464f-ac64-a4f7ffd2c4dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:04.385657 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:04.391669 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-068374fb-c630-42db-822b-bcd305b67ecb req-4d51eeb4-6b35-4b10-86a1-0e99ae89f736 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=a0305bf6-a5f5-4907-b32b-a04b1fb34872 HTTP/1.1" status: 200 len: 217 time: 0.0549569 Dec 09 21:25:04.393784 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b8cc265a-4a23-481c-a007-d1c96746da09 req-4ff1177a-128e-4abc-9e20-a217a3fae34e tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:04.408249 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3aaca96-1be9-48f4-b5d7-380c30e2d92e tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Pushing event updated for resources: {'Port': ['ID=90eef560-add6-4b61-8d08-f04574a6a893,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:04.417026 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5689b656-5749-49dd-902c-24c1b76d15d4 req-238de94f-0665-4bc5-937f-91287671bf4e service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4408336 Dec 09 21:25:04.425334 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9ff7db85-9b93-4216-acdd-9338d10a0970 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:04.435977 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2c288abf-9d99-40af-9b4b-cd711427ed71 admin admin] Router 290dc430-7830-4b38-89f7-0330682d7558 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:25:04.446200 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b8cc265a-4a23-481c-a007-d1c96746da09 req-4ff1177a-128e-4abc-9e20-a217a3fae34e tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:04.447744 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8cc265a-4a23-481c-a007-d1c96746da09 req-4ff1177a-128e-4abc-9e20-a217a3fae34e tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 698 time: 3.9031980 Dec 09 21:25:04.475887 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-f3aaca96-1be9-48f4-b5d7-380c30e2d92e tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:04.476545 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-f3aaca96-1be9-48f4-b5d7-380c30e2d92e tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:04.483136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 9ff7db85-9b93-4216-acdd-9338d10a0970, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=9ff7db85-9b93-4216-acdd-9338d10a0970,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:04.487105 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-90761cbd-abb8-497a-ad8d-ffbbacdb392e tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.10 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=dd631239105645b6b7088738a5229b7f HTTP/1.1" status: 200 len: 380 time: 0.3753135 Dec 09 21:25:04.497885 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:04.502284 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-c814a56c-b99e-4041-8705-db64e99e6cfa tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Request body: {'port': {'device_id': 'a0e7c231-5917-4aec-89da-a4a946e66c69', 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c', 'admin_state_up': True, 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'security_groups': ['4aaea988-139c-4402-b4d7-14ee4ed56291']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:04.550670 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 0c193336-bbb6-4822-b85a-c96594bf8ca5 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:04.551786 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:04.592895 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=9ff7db85-9b93-4216-acdd-9338d10a0970,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:04.605972 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9a98519-47d8-48c2-9a94-f506d81b9136 req-709b21c6-0d28-4c71-8542-e7fbdd04e1b6 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "GET /v2.0/ports?device_id=a0e7c231-5917-4aec-89da-a4a946e66c69 HTTP/1.1" status: 200 len: 210 time: 0.0539770 Dec 09 21:25:04.609138 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8cc265a-4a23-481c-a007-d1c96746da09 req-c915171e-2ee5-4a99-9499-83ef3aab89ca tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.143 HTTP/1.1" status: 200 len: 696 time: 0.1457267 Dec 09 21:25:04.647331 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-f3aaca96-1be9-48f4-b5d7-380c30e2d92e tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.9151869 Dec 09 21:25:04.706038 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8a1abb3e-cf0f-464f-ac64-a4f7ffd2c4dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:04.710340 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['9ff7db85-9b93-4216-acdd-9338d10a0970'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:25:04.712722 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5689b656-5749-49dd-902c-24c1b76d15d4 req-74e5d926-3443-4f12-982a-51e0a214645b service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2638948 Dec 09 21:25:04.763700 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-8a10f4d4-f190-4a2e-9762-2042ee51a438 service neutron] Request body: {'port': {'device_id': '97debe2b-c2b5-48af-a541-3e55e73d399f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:04.860112 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-068374fb-c630-42db-822b-bcd305b67ecb req-c8d6aca0-5729-4261-a5e4-fcdc5e525976 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:04.861811 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-068374fb-c630-42db-822b-bcd305b67ecb req-c8d6aca0-5729-4261-a5e4-fcdc5e525976 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=50496955-1646-4079-acd4-a47e8cd175cb HTTP/1.1" status: 200 len: 852 time: 0.4575875 Dec 09 21:25:04.882110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8cc265a-4a23-481c-a007-d1c96746da09 req-29c9e1c6-ec40-491e-b2e9-df14cc61ef60 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:04.888743 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8cc265a-4a23-481c-a007-d1c96746da09 req-29c9e1c6-ec40-491e-b2e9-df14cc61ef60 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.1649868 Dec 09 21:25:04.896044 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a17ca6f-9b2c-44b0-bce3-4773406ba024 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:04.904191 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-8a1abb3e-cf0f-464f-ac64-a4f7ffd2c4dd None None] For port 739045da-de08-4bd9-8441-0e750354346e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=739045da-de08-4bd9-8441-0e750354346e,segment=NetworkSegment(1acd79aa-cd7a-4fee-a7fc-139e8b6382c5),segment_id=1acd79aa-cd7a-4fee-a7fc-139e8b6382c5)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:04.914717 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:04.922345 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8a1abb3e-cf0f-464f-ac64-a4f7ffd2c4dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:04.960474 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-068374fb-c630-42db-822b-bcd305b67ecb req-3a6652db-475b-49ca-af64-0149f24ac18a service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0411546 Dec 09 21:25:04.972853 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 0c193336-bbb6-4822-b85a-c96594bf8ca5, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=0c193336-bbb6-4822-b85a-c96594bf8ca5,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:04.987696 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-8a10f4d4-f190-4a2e-9762-2042ee51a438 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:04.991233 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:04.992084 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 739045da-de08-4bd9-8441-0e750354346e up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:04.997750 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2b508cb-7f05-482f-8763-2b5db91b6b25 req-bd2662b6-42e8-410a-a301-a8f4bd033767 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:05.004233 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2b508cb-7f05-482f-8763-2b5db91b6b25 req-bd2662b6-42e8-410a-a301-a8f4bd033767 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.13 "GET /v2.0/ports?device_id=97debe2b-c2b5-48af-a541-3e55e73d399f HTTP/1.1" status: 200 len: 932 time: 0.1396360 Dec 09 21:25:05.084452 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a1abb3e-cf0f-464f-ac64-a4f7ffd2c4dd None None] Pushing event updated for resources: {'Port': ['ID=739045da-de08-4bd9-8441-0e750354346e,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:05.156789 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2b508cb-7f05-482f-8763-2b5db91b6b25 req-aa061ba4-5d96-4e79-babe-d3c2273801e0 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.13 "GET /v2.0/security-groups?id=b7152147-ed7a-4a1f-b140-69adad7d753f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1330478 Dec 09 21:25:05.175107 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b67cd49b-5782-4a62-849c-8b415ca21b07 x-openstack-request-id: req-b67cd49b-5782-4a62-849c-8b415ca21b07 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:05.176011 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6fc3ad38-60ed-42b3-8c67-af66849bcbaf", "tag": "a0305bf6-a5f5-4907-b32b-a04b1fb34872", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:05.176011 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-b67cd49b-5782-4a62-849c-8b415ca21b07 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:05.176255 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6fc3ad38-60ed-42b3-8c67-af66849bcbaf', 'tag': 'a0305bf6-a5f5-4907-b32b-a04b1fb34872', 'status': 'completed', 'code': 200} Dec 09 21:25:05.176981 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9ee9e025-6c80-4a79-8e57-e91d3470bd01 None None] Provisioning complete for port 739045da-de08-4bd9-8441-0e750354346e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:05.177362 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9ee9e025-6c80-4a79-8e57-e91d3470bd01 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:05.197649 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-068374fb-c630-42db-822b-bcd305b67ecb req-95bf173e-d508-48a1-bd5e-f9510a68861e service neutron] 10.222.0.10 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2252772 Dec 09 21:25:05.289737 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=0c193336-bbb6-4822-b85a-c96594bf8ca5,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:05.325434 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 739045da-de08-4bd9-8441-0e750354346e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:05.325434 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:05.427768 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-068374fb-c630-42db-822b-bcd305b67ecb req-302ed359-8386-4d11-bea3-4656c370f577 service neutron] 10.222.0.10 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2211487 Dec 09 21:25:05.434250 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2c288abf-9d99-40af-9b4b-cd711427ed71 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:25:05.440670 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b4ae1e1-e3da-4f51-8ba7-c8bdfdc984dc req-a241d1f0-4d3b-4ce8-8166-941597f1fe44 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:05.442607 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b4ae1e1-e3da-4f51-8ba7-c8bdfdc984dc req-a241d1f0-4d3b-4ce8-8166-941597f1fe44 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=6fc3ad38-60ed-42b3-8c67-af66849bcbaf HTTP/1.1" status: 200 len: 944 time: 0.1656725 Dec 09 21:25:05.451537 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8edf7ac0-9936-4f49-b7b0-f27ac37c15b6 req-3c8c04bf-b06c-4fbd-8ba3-187c1c6d3793 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 0.2228563 Dec 09 21:25:05.454296 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] Sync routers for ids ['290dc430-7830-4b38-89f7-0330682d7558'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:25:05.463405 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-8edf7ac0-9936-4f49-b7b0-f27ac37c15b6 req-59c535d3-93f2-4339-85db-1ae3271ba5d4 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:05.479737 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] Routers {'290dc430-7830-4b38-89f7-0330682d7558'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:25:05.481207 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:24:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['290dc430-7830-4b38-89f7-0330682d7558'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:05.502158 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2c288abf-9d99-40af-9b4b-cd711427ed71 admin admin] 10.222.0.13 "PUT /v2.0/routers/290dc430-7830-4b38-89f7-0330682d7558/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.4892325 Dec 09 21:25:05.505443 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-c814a56c-b99e-4041-8705-db64e99e6cfa tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Made reservation on behalf of dd631239105645b6b7088738a5229b7f for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:25:05.509828 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-c814a56c-b99e-4041-8705-db64e99e6cfa tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:05.534748 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9ee9e025-6c80-4a79-8e57-e91d3470bd01 None None] Provisioning complete for port 91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:05.535918 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9ee9e025-6c80-4a79-8e57-e91d3470bd01 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:05.546015 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2a31cdcc-f3a0-4a83-81ea-84690f069e91 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:05.606294 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8edf7ac0-9936-4f49-b7b0-f27ac37c15b6 req-59c535d3-93f2-4339-85db-1ae3271ba5d4 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:05.618243 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b4ae1e1-e3da-4f51-8ba7-c8bdfdc984dc req-2b9e374b-8705-44b9-8cf6-d019c38672f1 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1656592 Dec 09 21:25:05.667101 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9ee9e025-6c80-4a79-8e57-e91d3470bd01 None None] Port 91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:25:05.689466 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2563120b-15f0-4af7-880d-680576e7eea7 req-53e032aa-0c44-4acd-b982-0c80db591547 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:05.690948 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2563120b-15f0-4af7-880d-680576e7eea7 req-53e032aa-0c44-4acd-b982-0c80db591547 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=1b7916b634f74760a565cfeaef510cd9&device_id=6fc3ad38-60ed-42b3-8c67-af66849bcbaf HTTP/1.1" status: 200 len: 1096 time: 0.1667831 Dec 09 21:25:05.710331 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 9ff7db85-9b93-4216-acdd-9338d10a0970 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:05.714130 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37120) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:05.844076 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-c814a56c-b99e-4041-8705-db64e99e6cfa tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Allocated IP 172.20.0.11 (ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c/9125b460-598b-4793-bfb4-08b07155042a/78afd497-51cf-40c2-9eaf-ee2f42951961) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:25:05.852082 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 9ff7db85-9b93-4216-acdd-9338d10a0970 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:25:05.855051 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0c193336-bbb6-4822-b85a-c96594bf8ca5 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:05.866995 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] Set router 290dc430-7830-4b38-89f7-0330682d7558 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:25:05.883169 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 9ff7db85-9b93-4216-acdd-9338d10a0970 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:05.883902 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:05.908791 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2563120b-15f0-4af7-880d-680576e7eea7 req-5d810b74-3af3-4ade-999f-071eabdf0f71 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:05.910571 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2563120b-15f0-4af7-880d-680576e7eea7 req-5d810b74-3af3-4ade-999f-071eabdf0f71 service neutron] 10.222.0.10 "GET /v2.0/networks?id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb HTTP/1.1" status: 200 len: 913 time: 0.2109282 Dec 09 21:25:05.917029 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a17ca6f-9b2c-44b0-bce3-4773406ba024 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:05.970551 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-8fe59cf8-d8e9-4410-9e49-ef4f752e91da tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Request body: {'network': {'name': 'tempest-ServersTestMultiNic-193197482'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:05.976251 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 0c193336-bbb6-4822-b85a-c96594bf8ca5 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:05.976749 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.016916 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.018776 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8fe59cf8-d8e9-4410-9e49-ef4f752e91da tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Made reservation on behalf of 73812a0c336d4768b029fd6459a1ae9e for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:25:06.024198 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fe59cf8-d8e9-4410-9e49-ef4f752e91da tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.048326 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f0e077f0-ebc8-425d-939f-f2a18284a3b6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9ff7db85-9b93-4216-acdd-9338d10a0970'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:06.050832 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0bcf4b0f-775c-4739-b859-56e1e6d845be" -d '{"events": [{"server_uuid": "f0e077f0-ebc8-425d-939f-f2a18284a3b6", "name": "network-vif-plugged", "status": "completed", "tag": "9ff7db85-9b93-4216-acdd-9338d10a0970"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:06.064894 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 9ff7db85-9b93-4216-acdd-9338d10a0970, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=9ff7db85-9b93-4216-acdd-9338d10a0970,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:06.072982 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.110260 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8fe59cf8-d8e9-4410-9e49-ef4f752e91da tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] vlan segment allocate from pool success with {'vlan_id': 137, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:25:06.113728 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-c814a56c-b99e-4041-8705-db64e99e6cfa tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.121308 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fe59cf8-d8e9-4410-9e49-ef4f752e91da tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.122353 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-8fe59cf8-d8e9-4410-9e49-ef4f752e91da tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Added segment 3e23a057-7b71-4625-891b-f66fd33737f2 of type vlan for network 6a0b092d-9731-4bc3-9661-8d5436bc9f71 Dec 09 21:25:06.142702 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 739045da-de08-4bd9-8441-0e750354346e up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:06.149909 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '290dc430-7830-4b38-89f7-0330682d7558', 'name': 'tempest-ServersTestMultiNic-285103454-router', 'tenant_id': '73812a0c336d4768b029fd6459a1ae9e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.220'}], 'enable_snat': True}, 'gw_port_id': '0c193336-bbb6-4822-b85a-c96594bf8ca5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:56Z', 'updated_at': '2021-12-09T21:25:01Z', 'revision_number': 4, 'project_id': '73812a0c336d4768b029fd6459a1ae9e', 'gw_port': {'id': '0c193336-bbb6-4822-b85a-c96594bf8ca5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:81:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '290dc430-7830-4b38-89f7-0330682d7558', 'device_owner': 'network:router_gateway', 'standard_attr_id': 869, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:57Z', 'updated_at': '2021-12-09T21:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1', 'name': '', 'network_id': '5b690ccc-3b51-4e15-887f-038429ce13f5', 'tenant_id': '73812a0c336d4768b029fd6459a1ae9e', 'mac_address': 'fa:16:3e:ed:75:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '290dc430-7830-4b38-89f7-0330682d7558', 'device_owner': 'network:router_interface', 'standard_attr_id': 872, 'fixed_ips': [{'subnet_id': '65af9a54-bf8f-4f71-97a2-68f4a31a18ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:59Z', 'updated_at': '2021-12-09T21:25:02Z', 'revision_number': 2, 'project_id': '73812a0c336d4768b029fd6459a1ae9e', 'subnets': [{'id': '65af9a54-bf8f-4f71-97a2-68f4a31a18ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:06.175504 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fe59cf8-d8e9-4410-9e49-ef4f752e91da tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.179123 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=9ff7db85-9b93-4216-acdd-9338d10a0970,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:06.183428 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] Checking router: 290dc430-7830-4b38-89f7-0330682d7558 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:25:06.184038 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] Updating router 290dc430-7830-4b38-89f7-0330682d7558 port 91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:25:06.199385 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-8a10f4d4-f190-4a2e-9762-2042ee51a438 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 90eef560-add6-4b61-8d08-f04574a6a893 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:06.211861 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-8a10f4d4-f190-4a2e-9762-2042ee51a438 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.215737 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.216225 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 739045da-de08-4bd9-8441-0e750354346e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:06.216577 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.218747 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2563120b-15f0-4af7-880d-680576e7eea7 req-c8742baa-8311-4b62-9a00-c8ae3973a07c service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=a0305bf6-a5f5-4907-b32b-a04b1fb34872 HTTP/1.1" status: 200 len: 217 time: 0.2139964 Dec 09 21:25:06.219580 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fe59cf8-d8e9-4410-9e49-ef4f752e91da tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.226059 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8fe59cf8-d8e9-4410-9e49-ef4f752e91da tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:06.226364 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fe59cf8-d8e9-4410-9e49-ef4f752e91da tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.227718 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-8a10f4d4-f190-4a2e-9762-2042ee51a438 service neutron] Transition to ACTIVE for port object 90eef560-add6-4b61-8d08-f04574a6a893 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:25:06.232110 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-c814a56c-b99e-4041-8705-db64e99e6cfa tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.245320 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-8a10f4d4-f190-4a2e-9762-2042ee51a438 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.342730 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b8d3c70-69b4-44df-9658-62dc19136bc9 req-8eebaaf5-32ca-46b3-ab63-9728303e84d2 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:06.344095 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b8d3c70-69b4-44df-9658-62dc19136bc9 req-8eebaaf5-32ca-46b3-ab63-9728303e84d2 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/ports?device_id=f0e077f0-ebc8-425d-939f-f2a18284a3b6 HTTP/1.1" status: 200 len: 948 time: 0.4326098 Dec 09 21:25:06.360474 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-c814a56c-b99e-4041-8705-db64e99e6cfa tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Network ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:25:06.378152 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8fe59cf8-d8e9-4410-9e49-ef4f752e91da tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 773 time: 0.6535425 Dec 09 21:25:06.384174 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-c814a56c-b99e-4041-8705-db64e99e6cfa tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:06.386663 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-c814a56c-b99e-4041-8705-db64e99e6cfa tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:25:06.390982 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37130) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:06.423944 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8edf7ac0-9936-4f49-b7b0-f27ac37c15b6 req-59c535d3-93f2-4339-85db-1ae3271ba5d4 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.425677 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fe59cf8-d8e9-4410-9e49-ef4f752e91da tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event updated for resources: {'Network': ['ID=6a0b092d-9731-4bc3-9661-8d5436bc9f71,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:06.427181 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-73bebd24-f554-47b2-b549-7c2bb2def51b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Request body: {'subnet': {'network_id': '6a0b092d-9731-4bc3-9661-8d5436bc9f71', 'cidr': '19.80.0.0/24', 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:06.437118 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 6a0b092d-9731-4bc3-9661-8d5436bc9f71 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:25:06.460169 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2563120b-15f0-4af7-880d-680576e7eea7 req-435d27c1-9a3b-46b8-bf8d-be26ce67ba35 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:06.461884 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2563120b-15f0-4af7-880d-680576e7eea7 req-435d27c1-9a3b-46b8-bf8d-be26ce67ba35 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=50496955-1646-4079-acd4-a47e8cd175cb HTTP/1.1" status: 200 len: 852 time: 0.2322745 Dec 09 21:25:06.476635 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c814a56c-b99e-4041-8705-db64e99e6cfa tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Pushing event updated for resources: {'Port': ['ID=78afd497-51cf-40c2-9eaf-ee2f42951961,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:06.560615 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.586593 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2563120b-15f0-4af7-880d-680576e7eea7 req-cb885cff-0daa-4954-9c9f-f6bcc697d026 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1010535 Dec 09 21:25:06.597763 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 378fa265-e1b8-415f-9f0c-2bff04df170a details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:25:06.622100 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.645807 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.647372 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b8d3c70-69b4-44df-9658-62dc19136bc9 req-29ed49c7-8507-40e2-ad62-442f9cf2f181 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/security-groups?id=50885dec-ee01-4c11-bc49-430c219f37b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2881579 Dec 09 21:25:06.666145 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-c814a56c-b99e-4041-8705-db64e99e6cfa tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:06.666606 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-c814a56c-b99e-4041-8705-db64e99e6cfa tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.762578 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a10f4d4-f190-4a2e-9762-2042ee51a438 service neutron] Pushing event updated for resources: {'Port': ['ID=90eef560-add6-4b61-8d08-f04574a6a893,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:06.785637 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-8a10f4d4-f190-4a2e-9762-2042ee51a438 service neutron] Attempting to bind port 90eef560-add6-4b61-8d08-f04574a6a893 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:25:06.785985 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-8a10f4d4-f190-4a2e-9762-2042ee51a438 service neutron] Attempting to bind port 90eef560-add6-4b61-8d08-f04574a6a893 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '7ba7eff4-a37f-4acb-b160-b374a7d3afdf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '419425e5-89f0-4884-91f7-260c4b9d176a'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:25:06.786319 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-8a10f4d4-f190-4a2e-9762-2042ee51a438 service neutron] Attempting to bind port 90eef560-add6-4b61-8d08-f04574a6a893 on network 419425e5-89f0-4884-91f7-260c4b9d176a {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:06.794119 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 378fa265-e1b8-415f-9f0c-2bff04df170a, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=378fa265-e1b8-415f-9f0c-2bff04df170a,segment=NetworkSegment(77d1b765-2404-4dd1-ab6e-956ebecc3e04),segment_id=77d1b765-2404-4dd1-ab6e-956ebecc3e04)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:06.821237 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '378fa265-e1b8-415f-9f0c-2bff04df170a', 'network_id': 'c2615978-1c59-4fbb-826b-fc6aec14e987', 'port_id': '378fa265-e1b8-415f-9f0c-2bff04df170a', 'mac_address': 'fa:16:3e:c1:c4:63', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 147, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1f5c65f5-5864-4e4e-bede-1bfc7f6e8e68', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:25:06.826536 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-8a10f4d4-f190-4a2e-9762-2042ee51a438 service neutron] Port 90eef560-add6-4b61-8d08-f04574a6a893 on network 419425e5-89f0-4884-91f7-260c4b9d176a not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:25:06.829206 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-8a10f4d4-f190-4a2e-9762-2042ee51a438 service neutron] Attempting to bind port 90eef560-add6-4b61-8d08-f04574a6a893 on network 419425e5-89f0-4884-91f7-260c4b9d176a {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:06.861961 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-8a10f4d4-f190-4a2e-9762-2042ee51a438 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 24, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:25:06.862645 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2563120b-15f0-4af7-880d-680576e7eea7 req-d7ef6534-7e85-482f-9a7f-4df6e78e6e51 service neutron] 10.222.0.10 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2659924 Dec 09 21:25:06.863110 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-8a10f4d4-f190-4a2e-9762-2042ee51a438 service neutron] Checking segment: {'id': '7ba7eff4-a37f-4acb-b160-b374a7d3afdf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '419425e5-89f0-4884-91f7-260c4b9d176a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:25:06.863110 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-8a10f4d4-f190-4a2e-9762-2042ee51a438 service neutron] Bound using segment: {'id': '7ba7eff4-a37f-4acb-b160-b374a7d3afdf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '419425e5-89f0-4884-91f7-260c4b9d176a'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:25:06.863353 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-8a10f4d4-f190-4a2e-9762-2042ee51a438 service neutron] Bound port: 90eef560-add6-4b61-8d08-f04574a6a893, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7ba7eff4-a37f-4acb-b160-b374a7d3afdf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '419425e5-89f0-4884-91f7-260c4b9d176a'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:25:06.863574 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-8a10f4d4-f190-4a2e-9762-2042ee51a438 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.883538 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-73bebd24-f554-47b2-b549-7c2bb2def51b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Made reservation on behalf of 73812a0c336d4768b029fd6459a1ae9e for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:25:06.889058 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81b6feb6-3b11-4338-8d3f-11986440030d None None] Pushing event updated for resources: {'Port': ['ID=91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:06.890974 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-73bebd24-f554-47b2-b549-7c2bb2def51b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.919843 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-c814a56c-b99e-4041-8705-db64e99e6cfa tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.4236002 Dec 09 21:25:06.922534 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.945147 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1a17ca6f-9b2c-44b0-bce3-4773406ba024 admin admin] Router 7762495d-a37c-420e-b273-375d531a1e3b is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:25:06.955523 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-11ac7451-259c-49d1-a08b-3158359dba98 service neutron] Request body: {'port': {'device_id': 'a0e7c231-5917-4aec-89da-a4a946e66c69', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:06.959405 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] Attempting to bind port 91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:25:06.959765 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] Attempting to bind port 91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'ad3b787d-bad8-49ed-bf29-13e361e4a583', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '5b690ccc-3b51-4e15-887f-038429ce13f5'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:25:06.960135 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] Attempting to bind port 91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1 on network 5b690ccc-3b51-4e15-887f-038429ce13f5 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:06.962067 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7f8ef83c-017a-43d5-bc24-9907e6ee7f7c None None] Provisioning complete for port 78afd497-51cf-40c2-9eaf-ee2f42951961 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:06.963963 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7f8ef83c-017a-43d5-bc24-9907e6ee7f7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.967464 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 24, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:25:06.968833 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] Checking segment: {'id': 'ad3b787d-bad8-49ed-bf29-13e361e4a583', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '5b690ccc-3b51-4e15-887f-038429ce13f5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:25:06.969287 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.969693 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] Bound using segment: {'id': 'ad3b787d-bad8-49ed-bf29-13e361e4a583', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '5b690ccc-3b51-4e15-887f-038429ce13f5'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:25:06.970178 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] Bound port: 91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ad3b787d-bad8-49ed-bf29-13e361e4a583', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': '5b690ccc-3b51-4e15-887f-038429ce13f5'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:25:06.971661 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:06.973590 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 378fa265-e1b8-415f-9f0c-2bff04df170a {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:07.049915 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-8edf7ac0-9936-4f49-b7b0-f27ac37c15b6 req-59c535d3-93f2-4339-85db-1ae3271ba5d4 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Allocated IP 172.25.3.202 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/0d94b355-e3e2-4552-ada7-444ebd4040e4) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:25:07.084659 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] For port 91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:25:07.091656 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 378fa265-e1b8-415f-9f0c-2bff04df170a, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=378fa265-e1b8-415f-9f0c-2bff04df170a,segment=NetworkSegment(77d1b765-2404-4dd1-ab6e-956ebecc3e04),segment_id=77d1b765-2404-4dd1-ab6e-956ebecc3e04)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:07.093387 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] For port 91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1,segment=NetworkSegment(ad3b787d-bad8-49ed-bf29-13e361e4a583),segment_id=ad3b787d-bad8-49ed-bf29-13e361e4a583)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:25:07.095640 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-7f8ef83c-017a-43d5-bc24-9907e6ee7f7c None None] Port 78afd497-51cf-40c2-9eaf-ee2f42951961 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:25:07.103144 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:07.105487 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:07.248499 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['378fa265-e1b8-415f-9f0c-2bff04df170a'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:25:07.268032 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] Routers {'290dc430-7830-4b38-89f7-0330682d7558'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:25:07.268760 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:25:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['290dc430-7830-4b38-89f7-0330682d7558'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:07.302389 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=378fa265-e1b8-415f-9f0c-2bff04df170a,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:07.331776 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-de2b1268-01e4-4c1c-a6f6-0e23661ef0f4 None None] Provisioning complete for port 91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:07.332467 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-de2b1268-01e4-4c1c-a6f6-0e23661ef0f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:07.466970 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] Set router 290dc430-7830-4b38-89f7-0330682d7558 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:25:07.600176 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-de2b1268-01e4-4c1c-a6f6-0e23661ef0f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:07.663241 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-de2b1268-01e4-4c1c-a6f6-0e23661ef0f4 None None] For port 91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1,segment=NetworkSegment(ad3b787d-bad8-49ed-bf29-13e361e4a583),segment_id=ad3b787d-bad8-49ed-bf29-13e361e4a583)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:07.686362 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81b6feb6-3b11-4338-8d3f-11986440030d None None] Pushing event updated for resources: {'Port': ['ID=91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:07.688695 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-73bebd24-f554-47b2-b549-7c2bb2def51b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:07.689094 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-de2b1268-01e4-4c1c-a6f6-0e23661ef0f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:07.712613 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8edf7ac0-9936-4f49-b7b0-f27ac37c15b6 req-59c535d3-93f2-4339-85db-1ae3271ba5d4 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:07.719713 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '290dc430-7830-4b38-89f7-0330682d7558', 'name': 'tempest-ServersTestMultiNic-285103454-router', 'tenant_id': '73812a0c336d4768b029fd6459a1ae9e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.220'}], 'enable_snat': True}, 'gw_port_id': '0c193336-bbb6-4822-b85a-c96594bf8ca5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:56Z', 'updated_at': '2021-12-09T21:25:01Z', 'revision_number': 4, 'project_id': '73812a0c336d4768b029fd6459a1ae9e', 'gw_port': {'id': '0c193336-bbb6-4822-b85a-c96594bf8ca5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:81:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '290dc430-7830-4b38-89f7-0330682d7558', 'device_owner': 'network:router_gateway', 'standard_attr_id': 869, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:57Z', 'updated_at': '2021-12-09T21:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1', 'name': '', 'network_id': '5b690ccc-3b51-4e15-887f-038429ce13f5', 'tenant_id': '73812a0c336d4768b029fd6459a1ae9e', 'mac_address': 'fa:16:3e:ed:75:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '290dc430-7830-4b38-89f7-0330682d7558', 'device_owner': 'network:router_interface', 'standard_attr_id': 872, 'fixed_ips': [{'subnet_id': '65af9a54-bf8f-4f71-97a2-68f4a31a18ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:59Z', 'updated_at': '2021-12-09T21:25:07Z', 'revision_number': 4, 'project_id': '73812a0c336d4768b029fd6459a1ae9e', 'subnets': [{'id': '65af9a54-bf8f-4f71-97a2-68f4a31a18ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:07.760992 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f4750c0-39e2-42d4-bf22-e5daab839876 None None] The sync data for ids ['290dc430-7830-4b38-89f7-0330682d7558'] in n-d-713301-27 is: [{'id': '290dc430-7830-4b38-89f7-0330682d7558', 'name': 'tempest-ServersTestMultiNic-285103454-router', 'tenant_id': '73812a0c336d4768b029fd6459a1ae9e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.220'}], 'enable_snat': True}, 'gw_port_id': '0c193336-bbb6-4822-b85a-c96594bf8ca5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:56Z', 'updated_at': '2021-12-09T21:25:01Z', 'revision_number': 4, 'project_id': '73812a0c336d4768b029fd6459a1ae9e', 'gw_port': {'id': '0c193336-bbb6-4822-b85a-c96594bf8ca5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:81:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '290dc430-7830-4b38-89f7-0330682d7558', 'device_owner': 'network:router_gateway', 'standard_attr_id': 869, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:57Z', 'updated_at': '2021-12-09T21:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1', 'name': '', 'network_id': '5b690ccc-3b51-4e15-887f-038429ce13f5', 'tenant_id': '73812a0c336d4768b029fd6459a1ae9e', 'mac_address': 'fa:16:3e:ed:75:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '290dc430-7830-4b38-89f7-0330682d7558', 'device_owner': 'network:router_interface', 'standard_attr_id': 872, 'fixed_ips': [{'subnet_id': '65af9a54-bf8f-4f71-97a2-68f4a31a18ad', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:59Z', 'updated_at': '2021-12-09T21:25:07Z', 'revision_number': 4, 'project_id': '73812a0c336d4768b029fd6459a1ae9e', 'subnets': [{'id': '65af9a54-bf8f-4f71-97a2-68f4a31a18ad', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:25:07.762252 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8edf7ac0-9936-4f49-b7b0-f27ac37c15b6 req-59c535d3-93f2-4339-85db-1ae3271ba5d4 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:07.768429 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de2b1268-01e4-4c1c-a6f6-0e23661ef0f4 None None] Pushing event updated for resources: {'Port': ['ID=91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:07.787856 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device a0305bf6-a5f5-4907-b32b-a04b1fb34872 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:25:07.826328 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8edf7ac0-9936-4f49-b7b0-f27ac37c15b6 req-59c535d3-93f2-4339-85db-1ae3271ba5d4 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:25:07.875754 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-11ac7451-259c-49d1-a08b-3158359dba98 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:07.892704 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71b3d8d8-4221-4544-b16e-0a2fe3ea9593 req-6da38275-f813-4f3c-965d-a54d598f07bb tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:07.895797 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71b3d8d8-4221-4544-b16e-0a2fe3ea9593 req-6da38275-f813-4f3c-965d-a54d598f07bb tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "GET /v2.0/ports?device_id=a0e7c231-5917-4aec-89da-a4a946e66c69 HTTP/1.1" status: 200 len: 932 time: 1.0323598 Dec 09 21:25:07.896956 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-8edf7ac0-9936-4f49-b7b0-f27ac37c15b6 req-59c535d3-93f2-4339-85db-1ae3271ba5d4 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:07.937822 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-8edf7ac0-9936-4f49-b7b0-f27ac37c15b6 req-59c535d3-93f2-4339-85db-1ae3271ba5d4 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:25:07.961086 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73bebd24-f554-47b2-b549-7c2bb2def51b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event updated for resources: {'Subnet': ['ID=c9ca5636-e2f1-4aee-84ec-4054f1a18361,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:07.966421 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-8a10f4d4-f190-4a2e-9762-2042ee51a438 service neutron] For port 90eef560-add6-4b61-8d08-f04574a6a893, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:25:08.015390 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-85a383fc-c79c-4656-9f30-a92273bae783 None None] Provisioning complete for port 91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:08.016041 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-85a383fc-c79c-4656-9f30-a92273bae783 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:08.019846 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:08.042891 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-8a10f4d4-f190-4a2e-9762-2042ee51a438 service neutron] For port 90eef560-add6-4b61-8d08-f04574a6a893, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=90eef560-add6-4b61-8d08-f04574a6a893,segment=NetworkSegment(7ba7eff4-a37f-4acb-b160-b374a7d3afdf),segment_id=7ba7eff4-a37f-4acb-b160-b374a7d3afdf)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:25:08.048517 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-73bebd24-f554-47b2-b549-7c2bb2def51b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Checking segment: {'id': '3e23a057-7b71-4625-891b-f66fd33737f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '6a0b092d-9731-4bc3-9661-8d5436bc9f71'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:25:08.048917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73bebd24-f554-47b2-b549-7c2bb2def51b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Network hostable DHCP agents. Network: 6a0b092d-9731-4bc3-9661-8d5436bc9f71, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:25:08.056895 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2563120b-15f0-4af7-880d-680576e7eea7 req-78a6181e-6a9a-412a-854d-611b24dd3897 service neutron] 10.222.0.10 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.1676161 Dec 09 21:25:08.057512 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59c535d3-93f2-4339-85db-1ae3271ba5d4 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Pushing event updated for resources: {'Port': ['ID=0d94b355-e3e2-4552-ada7-444ebd4040e4,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:08.059291 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-8a10f4d4-f190-4a2e-9762-2042ee51a438 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:08.092298 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71b3d8d8-4221-4544-b16e-0a2fe3ea9593 req-4e5726e0-98ec-42de-a7e9-cf5abfad09c8 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "GET /v2.0/security-groups?id=4aaea988-139c-4402-b4d7-14ee4ed56291&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1465502 Dec 09 21:25:08.140516 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port a0305bf6-a5f5-4907-b32b-a04b1fb34872, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=a0305bf6-a5f5-4907-b32b-a04b1fb34872,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:08.162734 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'a0305bf6-a5f5-4907-b32b-a04b1fb34872', 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb', 'port_id': 'a0305bf6-a5f5-4907-b32b-a04b1fb34872', 'mac_address': 'fa:16:3e:c9:d0:7b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 101, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '50496955-1646-4079-acd4-a47e8cd175cb', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:25:08.168894 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8edf7ac0-9936-4f49-b7b0-f27ac37c15b6 req-59c535d3-93f2-4339-85db-1ae3271ba5d4 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:08.203676 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a10f4d4-f190-4a2e-9762-2042ee51a438 service neutron] Pushing event updated for resources: {'Port': ['ID=90eef560-add6-4b61-8d08-f04574a6a893,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:08.227915 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8edf7ac0-9936-4f49-b7b0-f27ac37c15b6 req-59c535d3-93f2-4339-85db-1ae3271ba5d4 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:08.237644 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:08.271743 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-8a10f4d4-f190-4a2e-9762-2042ee51a438 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:08.272268 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-8a10f4d4-f190-4a2e-9762-2042ee51a438 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:08.273797 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-8a10f4d4-f190-4a2e-9762-2042ee51a438 service neutron] 10.222.0.31 "PUT /v2.0/ports/90eef560-add6-4b61-8d08-f04574a6a893 HTTP/1.1" status: 200 len: 1093 time: 3.5512805 Dec 09 21:25:08.283029 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '97debe2b-c2b5-48af-a541-3e55e73d399f', 'tag': '90eef560-add6-4b61-8d08-f04574a6a893'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:08.285096 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ddfd4325-6648-43ef-9715-5d96d1eeb0da" -d '{"events": [{"name": "network-changed", "server_uuid": "97debe2b-c2b5-48af-a541-3e55e73d399f", "tag": "90eef560-add6-4b61-8d08-f04574a6a893"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:08.288052 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73bebd24-f554-47b2-b549-7c2bb2def51b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Network 6a0b092d-9731-4bc3-9661-8d5436bc9f71 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:25:08.288295 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a0305bf6-a5f5-4907-b32b-a04b1fb34872 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:08.296927 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1a17ca6f-9b2c-44b0-bce3-4773406ba024 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:25:08.322036 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-73bebd24-f554-47b2-b549-7c2bb2def51b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 6a0b092d-9731-4bc3-9661-8d5436bc9f71) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:08.324325 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port a0305bf6-a5f5-4907-b32b-a04b1fb34872, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=a0305bf6-a5f5-4907-b32b-a04b1fb34872,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:08.329198 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73bebd24-f554-47b2-b549-7c2bb2def51b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:08.329662 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] Sync routers for ids ['7762495d-a37c-420e-b273-375d531a1e3b'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:25:08.329887 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-73bebd24-f554-47b2-b549-7c2bb2def51b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:08.337557 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:08.353234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a6b477e2-9c64-45aa-8c51-4f5ff5c6c1e6 None None] Network 6a0b092d-9731-4bc3-9661-8d5436bc9f71 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:25:08.370886 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a17ca6f-9b2c-44b0-bce3-4773406ba024 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:08.375479 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1a17ca6f-9b2c-44b0-bce3-4773406ba024 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 8.3641746 Dec 09 21:25:08.383946 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37142) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:08.401736 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-73bebd24-f554-47b2-b549-7c2bb2def51b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 798 time: 1.9842675 Dec 09 21:25:08.416240 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37144) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:08.446064 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-8ebb2d9a-264f-40b8-a0a6-d66ee394beb5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Request body: {'network': {'name': 'tempest-ServersTestMultiNic-1594606360'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:08.454690 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] Routers {'7762495d-a37c-420e-b273-375d531a1e3b'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:25:08.455349 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:25:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7762495d-a37c-420e-b273-375d531a1e3b'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:08.488562 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8ebb2d9a-264f-40b8-a0a6-d66ee394beb5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Made reservation on behalf of 73812a0c336d4768b029fd6459a1ae9e for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:25:08.492078 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ebb2d9a-264f-40b8-a0a6-d66ee394beb5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:08.544160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-72dbda5b-8a9a-4d3b-ba1d-6ce990e05856 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:08.545864 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-72dbda5b-8a9a-4d3b-ba1d-6ce990e05856 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=87694f06f4144186aac9c50bac43d5ec&device_id=97debe2b-c2b5-48af-a541-3e55e73d399f HTTP/1.1" status: 200 len: 1096 time: 0.1696472 Dec 09 21:25:08.580767 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8ebb2d9a-264f-40b8-a0a6-d66ee394beb5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] vlan segment allocate from pool success with {'vlan_id': 134, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:25:08.631160 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-89212a73-a6f3-47ae-96c9-f578d3a776b3 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=90eef560-add6-4b61-8d08-f04574a6a893 HTTP/1.1" status: 200 len: 217 time: 0.0565059 Dec 09 21:25:08.634646 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ebb2d9a-264f-40b8-a0a6-d66ee394beb5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:08.634996 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-8ebb2d9a-264f-40b8-a0a6-d66ee394beb5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Added segment e72604b7-1620-485e-8ea6-a66ce97f67f1 of type vlan for network c8e08369-5b79-4a41-a5f9-0059632e26cd Dec 09 21:25:08.661717 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8edf7ac0-9936-4f49-b7b0-f27ac37c15b6 req-59c535d3-93f2-4339-85db-1ae3271ba5d4 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:08.703777 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8edf7ac0-9936-4f49-b7b0-f27ac37c15b6 req-59c535d3-93f2-4339-85db-1ae3271ba5d4 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:08.767687 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0978dcc-2d71-4fab-bfe5-d0133d01136e req-4cbdcb5c-e572-439d-9395-c2110011b554 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:08.769295 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0978dcc-2d71-4fab-bfe5-d0133d01136e req-4cbdcb5c-e572-439d-9395-c2110011b554 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=73466791-f610-4f93-892b-3077db341121 HTTP/1.1" status: 200 len: 944 time: 0.3866308 Dec 09 21:25:08.785041 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-11ac7451-259c-49d1-a08b-3158359dba98 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 78afd497-51cf-40c2-9eaf-ee2f42951961 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:08.794759 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-11ac7451-259c-49d1-a08b-3158359dba98 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:08.812559 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-11ac7451-259c-49d1-a08b-3158359dba98 service neutron] Transition to ACTIVE for port object 78afd497-51cf-40c2-9eaf-ee2f42951961 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:25:08.840302 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-3a0dcda0-6f9e-44e3-a1e8-319b764049c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:08.842352 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-3a0dcda0-6f9e-44e3-a1e8-319b764049c0 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ffbc2156-2e0a-4a3b-8e1a-215cf8f39866 HTTP/1.1" status: 200 len: 854 time: 0.1962030 Dec 09 21:25:08.847022 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-11ac7451-259c-49d1-a08b-3158359dba98 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:08.888536 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['a0305bf6-a5f5-4907-b32b-a04b1fb34872'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:25:08.890970 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 378fa265-e1b8-415f-9f0c-2bff04df170a up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:08.912631 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ebb2d9a-264f-40b8-a0a6-d66ee394beb5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:08.919870 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11ac7451-259c-49d1-a08b-3158359dba98 service neutron] Pushing event updated for resources: {'Port': ['ID=78afd497-51cf-40c2-9eaf-ee2f42951961,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:08.954951 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8edf7ac0-9936-4f49-b7b0-f27ac37c15b6 req-59c535d3-93f2-4339-85db-1ae3271ba5d4 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:09.012700 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-c81364f8-9949-46b3-b0cf-b2b5b0b33ef6 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=419425e5-89f0-4884-91f7-260c4b9d176a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1151397 Dec 09 21:25:09.017845 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.db.resource_extend [None req-8ebb2d9a-264f-40b8-a0a6-d66ee394beb5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] It took 0.10 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 09 21:25:09.035472 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59c535d3-93f2-4339-85db-1ae3271ba5d4 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Pushing event updated for resources: {'Port': ['ID=0d94b355-e3e2-4552-ada7-444ebd4040e4,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:09.051123 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0978dcc-2d71-4fab-bfe5-d0133d01136e req-af87e175-f7fd-4367-affa-e894d481c729 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2368512 Dec 09 21:25:09.103887 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] Set router 7762495d-a37c-420e-b273-375d531a1e3b gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:25:09.117119 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=a0305bf6-a5f5-4907-b32b-a04b1fb34872,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:09.157998 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ebb2d9a-264f-40b8-a0a6-d66ee394beb5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:09.175813 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8ebb2d9a-264f-40b8-a0a6-d66ee394beb5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:09.176692 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ebb2d9a-264f-40b8-a0a6-d66ee394beb5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:09.230977 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8edf7ac0-9936-4f49-b7b0-f27ac37c15b6 req-59c535d3-93f2-4339-85db-1ae3271ba5d4 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:09.232365 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8edf7ac0-9936-4f49-b7b0-f27ac37c15b6 req-59c535d3-93f2-4339-85db-1ae3271ba5d4 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 698 time: 3.7728965 Dec 09 21:25:09.308081 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d14e875d-e483-45d1-84ae-e6a1998ab08d x-openstack-request-id: req-d14e875d-e483-45d1-84ae-e6a1998ab08d {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:09.308383 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f0e077f0-ebc8-425d-939f-f2a18284a3b6", "name": "network-vif-plugged", "status": "completed", "tag": "9ff7db85-9b93-4216-acdd-9338d10a0970", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:09.308642 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-d14e875d-e483-45d1-84ae-e6a1998ab08d {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:09.309054 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f0e077f0-ebc8-425d-939f-f2a18284a3b6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9ff7db85-9b93-4216-acdd-9338d10a0970', 'code': 200} Dec 09 21:25:09.440830 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3d4d182-8328-4384-ba2e-2f005530b25e req-fe9c1589-b80f-4e89-b3b2-fb7ec2fceb36 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=9012a4aa-4a6a-4b44-b9a8-35264565fa33&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.5331285 Dec 09 21:25:09.443462 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8edf7ac0-9936-4f49-b7b0-f27ac37c15b6 req-7a0ee566-2099-474a-94b6-1925b88b0e09 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.202 HTTP/1.1" status: 200 len: 696 time: 0.1679137 Dec 09 21:25:09.624603 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ebe2fa0d-2b78-4fe7-9e18-12a1fa64ee2d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-6a0b092d-9731-4bc3-9661-8d5436bc9f71', 'network_id': '6a0b092d-9731-4bc3-9661-8d5436bc9f71', 'project_id': '73812a0c336d4768b029fd6459a1ae9e', 'fixed_ips': [{'subnet_id': 'c9ca5636-e2f1-4aee-84ec-4054f1a18361'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:25:09.625511 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ebe2fa0d-2b78-4fe7-9e18-12a1fa64ee2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:09.639578 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f873891-8ae1-46fc-9722-7e90e63ab1cd req-4cdc8592-07bc-4e1c-b327-5315ae4f4c79 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:09.642376 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f873891-8ae1-46fc-9722-7e90e63ab1cd req-4cdc8592-07bc-4e1c-b327-5315ae4f4c79 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=f0e077f0-ebc8-425d-939f-f2a18284a3b6 HTTP/1.1" status: 200 len: 1101 time: 0.4068599 Dec 09 21:25:09.674299 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3df85306-c7a9-40f3-b6d5-a5518028d811 req-1ffef699-e60b-49b3-baeb-21f083c4bb85 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:09.685791 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3df85306-c7a9-40f3-b6d5-a5518028d811 req-1ffef699-e60b-49b3-baeb-21f083c4bb85 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.13 "GET /v2.0/ports?device_id=97debe2b-c2b5-48af-a541-3e55e73d399f HTTP/1.1" status: 200 len: 944 time: 0.3528340 Dec 09 21:25:09.724208 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 378fa265-e1b8-415f-9f0c-2bff04df170a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:09.724639 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:09.779854 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8ebb2d9a-264f-40b8-a0a6-d66ee394beb5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 774 time: 1.3624241 Dec 09 21:25:09.783676 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37150) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:09.830024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-1dd95757-85ea-403f-814b-7f84d6fae9b3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Request body: {'subnet': {'network_id': 'c8e08369-5b79-4a41-a5f9-0059632e26cd', 'cidr': '19.86.0.0/24', 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:09.837966 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:09.862543 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ebb2d9a-264f-40b8-a0a6-d66ee394beb5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event updated for resources: {'Network': ['ID=c8e08369-5b79-4a41-a5f9-0059632e26cd,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:09.872189 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-11ac7451-259c-49d1-a08b-3158359dba98 service neutron] Attempting to bind port 78afd497-51cf-40c2-9eaf-ee2f42951961 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:25:09.872189 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-11ac7451-259c-49d1-a08b-3158359dba98 service neutron] Attempting to bind port 78afd497-51cf-40c2-9eaf-ee2f42951961 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '51116481-b9d7-45e1-bfed-86b419caae01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:25:09.872189 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-11ac7451-259c-49d1-a08b-3158359dba98 service neutron] Attempting to bind port 78afd497-51cf-40c2-9eaf-ee2f42951961 on network ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:09.889724 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-11ac7451-259c-49d1-a08b-3158359dba98 service neutron] Port 78afd497-51cf-40c2-9eaf-ee2f42951961 on network ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:25:09.889960 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-11ac7451-259c-49d1-a08b-3158359dba98 service neutron] Attempting to bind port 78afd497-51cf-40c2-9eaf-ee2f42951961 on network ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:09.890782 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3d4d182-8328-4384-ba2e-2f005530b25e req-1ff5e9d6-334c-4331-9dfd-624efd6fa96b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:09.892705 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3d4d182-8328-4384-ba2e-2f005530b25e req-1ff5e9d6-334c-4331-9dfd-624efd6fa96b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3329fed690514d85b98adeb6691d89f2&device_id=9012a4aa-4a6a-4b44-b9a8-35264565fa33 HTTP/1.1" status: 200 len: 1102 time: 0.3332584 Dec 09 21:25:09.892956 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network c8e08369-5b79-4a41-a5f9-0059632e26cd details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:25:09.915124 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f873891-8ae1-46fc-9722-7e90e63ab1cd req-d0c78942-0635-45d0-b8b8-836ed4148add service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=50885dec-ee01-4c11-bc49-430c219f37b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2566628 Dec 09 21:25:09.932912 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8edf7ac0-9936-4f49-b7b0-f27ac37c15b6 req-84d64066-8ec7-4050-bed7-4812ade509ed tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:09.937721 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-11ac7451-259c-49d1-a08b-3158359dba98 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 24, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:25:09.938163 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-11ac7451-259c-49d1-a08b-3158359dba98 service neutron] Checking segment: {'id': '51116481-b9d7-45e1-bfed-86b419caae01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:25:09.938443 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7762495d-a37c-420e-b273-375d531a1e3b', 'name': 'tempest-FloatingIPsNegativeTestJSON-1102779277-router', 'tenant_id': '6133c356707e42408885bbdcb5f67413', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.73'}], 'enable_snat': True}, 'gw_port_id': '6ab9bd80-c278-4b58-a046-303d80c95939', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:25:00Z', 'updated_at': '2021-12-09T21:25:04Z', 'revision_number': 3, 'project_id': '6133c356707e42408885bbdcb5f67413', 'gw_port': {'id': '6ab9bd80-c278-4b58-a046-303d80c95939', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:34:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7762495d-a37c-420e-b273-375d531a1e3b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 877, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:25:02Z', 'updated_at': '2021-12-09T21:25:03Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:09.938612 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-11ac7451-259c-49d1-a08b-3158359dba98 service neutron] Bound using segment: {'id': '51116481-b9d7-45e1-bfed-86b419caae01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:25:09.945009 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-11ac7451-259c-49d1-a08b-3158359dba98 service neutron] Bound port: 78afd497-51cf-40c2-9eaf-ee2f42951961, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '51116481-b9d7-45e1-bfed-86b419caae01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:25:09.945009 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-11ac7451-259c-49d1-a08b-3158359dba98 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:09.953950 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8edf7ac0-9936-4f49-b7b0-f27ac37c15b6 req-84d64066-8ec7-4050-bed7-4812ade509ed tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.4981568 Dec 09 21:25:09.972048 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:09.973698 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3df85306-c7a9-40f3-b6d5-a5518028d811 req-13215097-314b-4a68-88dd-7ee7b7d41dca tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.13 "GET /v2.0/security-groups?id=b7152147-ed7a-4a1f-b140-69adad7d753f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2864354 Dec 09 21:25:09.974642 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-39026007-ea2e-4419-8642-f2eea0241f9c service neutron] 10.222.0.31 "GET /v2.0/networks/419425e5-89f0-4884-91f7-260c4b9d176a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9477100 Dec 09 21:25:10.102399 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-11ac7451-259c-49d1-a08b-3158359dba98 service neutron] For port 78afd497-51cf-40c2-9eaf-ee2f42951961, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:25:10.118581 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] Checking router: 7762495d-a37c-420e-b273-375d531a1e3b for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:25:10.119088 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] Updating router 7762495d-a37c-420e-b273-375d531a1e3b port 6ab9bd80-c278-4b58-a046-303d80c95939 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:25:10.132496 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1dd95757-85ea-403f-814b-7f84d6fae9b3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Made reservation on behalf of 73812a0c336d4768b029fd6459a1ae9e for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:25:10.135954 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1dd95757-85ea-403f-814b-7f84d6fae9b3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:10.152448 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-11ac7451-259c-49d1-a08b-3158359dba98 service neutron] For port 78afd497-51cf-40c2-9eaf-ee2f42951961, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=78afd497-51cf-40c2-9eaf-ee2f42951961,segment=NetworkSegment(51116481-b9d7-45e1-bfed-86b419caae01),segment_id=51116481-b9d7-45e1-bfed-86b419caae01)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:25:10.168323 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-11ac7451-259c-49d1-a08b-3158359dba98 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:10.181141 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:10.201632 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-ebe2fa0d-2b78-4fe7-9e18-12a1fa64ee2d None None] Allocated IP 19.80.0.2 (6a0b092d-9731-4bc3-9661-8d5436bc9f71/c9ca5636-e2f1-4aee-84ec-4054f1a18361/163ae9b8-a7f0-4e1e-9a66-9ce437978aae) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:25:10.225748 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca3f8c95-90c7-43c4-ba6e-703818771f39 req-b1835aa9-4e50-441b-8ad4-86345f04d6d4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:10.227323 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ca3f8c95-90c7-43c4-ba6e-703818771f39 req-b1835aa9-4e50-441b-8ad4-86345f04d6d4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=6fc3ad38-60ed-42b3-8c67-af66849bcbaf HTTP/1.1" status: 200 len: 945 time: 0.1892135 Dec 09 21:25:10.245704 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3d4d182-8328-4384-ba2e-2f005530b25e req-f934e543-22f6-43c1-b743-8c1a8bde0f38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:10.247139 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3d4d182-8328-4384-ba2e-2f005530b25e req-f934e543-22f6-43c1-b743-8c1a8bde0f38 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.2920058 Dec 09 21:25:10.250225 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-11ac7451-259c-49d1-a08b-3158359dba98 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:10.251176 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-11ac7451-259c-49d1-a08b-3158359dba98 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:10.252690 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-11ac7451-259c-49d1-a08b-3158359dba98 service neutron] 10.222.0.10 "PUT /v2.0/ports/78afd497-51cf-40c2-9eaf-ee2f42951961 HTTP/1.1" status: 200 len: 1093 time: 3.3020787 Dec 09 21:25:10.282909 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-576fc0bf-8fd6-4f7e-a1fd-e67af748dbaa req-49677d5a-4ae5-4ff7-bb05-fe4bd5092d09 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:10.284577 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-576fc0bf-8fd6-4f7e-a1fd-e67af748dbaa req-49677d5a-4ae5-4ff7-bb05-fe4bd5092d09 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/ports?device_id=f0e077f0-ebc8-425d-939f-f2a18284a3b6 HTTP/1.1" status: 200 len: 949 time: 0.1975243 Dec 09 21:25:10.346238 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:10.363246 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3d4d182-8328-4384-ba2e-2f005530b25e req-9dea7422-15d8-47fb-893f-9002c3882b53 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.161&port_id=f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 HTTP/1.1" status: 200 len: 217 time: 0.1030674 Dec 09 21:25:10.424306 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 378fa265-e1b8-415f-9f0c-2bff04df170a, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=378fa265-e1b8-415f-9f0c-2bff04df170a,segment=NetworkSegment(77d1b765-2404-4dd1-ab6e-956ebecc3e04),segment_id=77d1b765-2404-4dd1-ab6e-956ebecc3e04)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:10.435178 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:10.435404 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:10.456893 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2eb3616b-e731-4bdd-904e-42fcfbc100ed req-4ed9b144-e586-4845-9ce6-e4f976bd95f7 service neutron] 10.222.0.31 "GET /v2.0/networks/419425e5-89f0-4884-91f7-260c4b9d176a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4088421 Dec 09 21:25:10.464349 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0186ea7f-7c15-46cb-a3bb-b957ac8aa041 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:10.465273 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1dd95757-85ea-403f-814b-7f84d6fae9b3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:10.474657 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ca3f8c95-90c7-43c4-ba6e-703818771f39 req-f4bd6a31-d96e-4202-bf5e-441fb44766ed tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2392261 Dec 09 21:25:10.493031 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3d4d182-8328-4384-ba2e-2f005530b25e req-ba2d3b4f-e9d3-492d-a976-630fa50d545e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:10.494606 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3d4d182-8328-4384-ba2e-2f005530b25e req-ba2d3b4f-e9d3-492d-a976-630fa50d545e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1213346 Dec 09 21:25:10.498113 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-576fc0bf-8fd6-4f7e-a1fd-e67af748dbaa req-d8d9a9ed-e027-4a1f-aea3-eba4ef3b6b6c tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/security-groups?id=50885dec-ee01-4c11-bc49-430c219f37b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1667297 Dec 09 21:25:10.530292 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:10.624650 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-981aaf4a-d5ad-46c1-af8b-1ecef0022b74 x-openstack-request-id: req-981aaf4a-d5ad-46c1-af8b-1ecef0022b74 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:10.626736 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "97debe2b-c2b5-48af-a541-3e55e73d399f", "tag": "90eef560-add6-4b61-8d08-f04574a6a893", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:10.627166 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-981aaf4a-d5ad-46c1-af8b-1ecef0022b74 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:10.627788 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '97debe2b-c2b5-48af-a541-3e55e73d399f', 'tag': '90eef560-add6-4b61-8d08-f04574a6a893', 'status': 'completed', 'code': 200} Dec 09 21:25:10.628983 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3d4d182-8328-4384-ba2e-2f005530b25e req-b2cf2b3d-0394-46d1-a5e5-8006499c8a78 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:10.630581 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3d4d182-8328-4384-ba2e-2f005530b25e req-b2cf2b3d-0394-46d1-a5e5-8006499c8a78 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1182647 Dec 09 21:25:10.671404 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 378fa265-e1b8-415f-9f0c-2bff04df170a no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:25:10.684477 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11ac7451-259c-49d1-a08b-3158359dba98 service neutron] Pushing event updated for resources: {'Port': ['ID=78afd497-51cf-40c2-9eaf-ee2f42951961,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:10.740008 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-108599cd-760e-448f-9fdc-1d0ff1a9e9c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:10.741606 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-108599cd-760e-448f-9fdc-1d0ff1a9e9c4 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=dd631239105645b6b7088738a5229b7f&device_id=a0e7c231-5917-4aec-89da-a4a946e66c69 HTTP/1.1" status: 200 len: 1096 time: 0.3034430 Dec 09 21:25:10.746275 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddfd4325-6648-43ef-9715-5d96d1eeb0da req-44644e1b-9c6d-4959-8d62-50a2bf195bbf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:10.747748 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ddfd4325-6648-43ef-9715-5d96d1eeb0da req-44644e1b-9c6d-4959-8d62-50a2bf195bbf service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=87694f06f4144186aac9c50bac43d5ec&device_id=97debe2b-c2b5-48af-a541-3e55e73d399f HTTP/1.1" status: 200 len: 1096 time: 0.1417441 Dec 09 21:25:10.748463 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dd95757-85ea-403f-814b-7f84d6fae9b3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event updated for resources: {'Subnet': ['ID=f4a2d786-583b-4e8b-9946-37b7ed5fd3e8,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:10.793843 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-a7f47ac8-ac5c-4f5f-8d45-5d99abbdb4fa service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=78afd497-51cf-40c2-9eaf-ee2f42951961 HTTP/1.1" status: 200 len: 217 time: 0.0428338 Dec 09 21:25:10.806368 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ebe2fa0d-2b78-4fe7-9e18-12a1fa64ee2d None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:10.813804 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1dd95757-85ea-403f-814b-7f84d6fae9b3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Checking segment: {'id': 'e72604b7-1620-485e-8ea6-a66ce97f67f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'c8e08369-5b79-4a41-a5f9-0059632e26cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:25:10.814159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1dd95757-85ea-403f-814b-7f84d6fae9b3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Network hostable DHCP agents. Network: c8e08369-5b79-4a41-a5f9-0059632e26cd, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:25:10.819542 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=378fa265-e1b8-415f-9f0c-2bff04df170a,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:10.837001 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ebe2fa0d-2b78-4fe7-9e18-12a1fa64ee2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:10.883762 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ca2a8428-40b0-4b2e-a9a3-92c439f91994 req-eeaceb36-02c0-4b8c-a77d-4bbb510da0dc tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/floatingips/91653aa9-63ed-40e7-8bad-6101aa5b1bec HTTP/1.1" status: 200 len: 693 time: 0.1503789 Dec 09 21:25:10.930782 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1dd95757-85ea-403f-814b-7f84d6fae9b3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Network c8e08369-5b79-4a41-a5f9-0059632e26cd is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:25:10.947798 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-bc3c8a40-c4b3-4c1a-825c-bdc995dca22d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:10.949517 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-bc3c8a40-c4b3-4c1a-825c-bdc995dca22d service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9125b460-598b-4793-bfb4-08b07155042a HTTP/1.1" status: 200 len: 854 time: 0.1369743 Dec 09 21:25:10.953008 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-1dd95757-85ea-403f-814b-7f84d6fae9b3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, c8e08369-5b79-4a41-a5f9-0059632e26cd) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:10.961672 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1dd95757-85ea-403f-814b-7f84d6fae9b3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:10.962274 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1dd95757-85ea-403f-814b-7f84d6fae9b3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:10.976574 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ebe2fa0d-2b78-4fe7-9e18-12a1fa64ee2d None None] Network 6a0b092d-9731-4bc3-9661-8d5436bc9f71 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:25:10.989875 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ce91570-43b8-4bdf-89bb-42c6c736d3b1 None None] Network c8e08369-5b79-4a41-a5f9-0059632e26cd requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:25:11.008768 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-ebe2fa0d-2b78-4fe7-9e18-12a1fa64ee2d None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:11.028935 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1dd95757-85ea-403f-814b-7f84d6fae9b3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 798 time: 1.2029932 Dec 09 21:25:11.032231 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddfd4325-6648-43ef-9715-5d96d1eeb0da req-df018049-df49-4e6a-93b7-f8ffb8292e69 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:11.034472 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ddfd4325-6648-43ef-9715-5d96d1eeb0da req-df018049-df49-4e6a-93b7-f8ffb8292e69 service neutron] 10.222.0.31 "GET /v2.0/networks?id=419425e5-89f0-4884-91f7-260c4b9d176a HTTP/1.1" status: 200 len: 915 time: 0.2373140 Dec 09 21:25:11.041881 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-54ca93fa-ab7f-4519-a465-614176c9cff1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:11.044650 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-54ca93fa-ab7f-4519-a465-614176c9cff1 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0844851 Dec 09 21:25:11.071814 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebe2fa0d-2b78-4fe7-9e18-12a1fa64ee2d None None] Pushing event updated for resources: {'Port': ['ID=163ae9b8-a7f0-4e1e-9a66-9ce437978aae,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:11.092943 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b74eb17-2d34-421f-b24f-562ac6bfae68 req-3957d138-b6c5-43f9-ae95-8d8b97cbbcc0 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:11.093549 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ddfd4325-6648-43ef-9715-5d96d1eeb0da req-f0a95204-0f53-430a-a8c2-4ba48c61dab2 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=90eef560-add6-4b61-8d08-f04574a6a893 HTTP/1.1" status: 200 len: 217 time: 0.0472791 Dec 09 21:25:11.094160 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b74eb17-2d34-421f-b24f-562ac6bfae68 req-3957d138-b6c5-43f9-ae95-8d8b97cbbcc0 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "GET /v2.0/ports?device_id=a0e7c231-5917-4aec-89da-a4a946e66c69 HTTP/1.1" status: 200 len: 944 time: 0.3564179 Dec 09 21:25:11.099575 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ebe2fa0d-2b78-4fe7-9e18-12a1fa64ee2d None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:25:11.105137 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:11.126190 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-0186ea7f-7c15-46cb-a3bb-b957ac8aa041 admin admin] Allocated IP 172.20.0.1 (78764042-44c4-4593-a775-1545766ca91c/746a03de-007e-4d48-91db-784f6fe01ab8/ec7fdfab-915e-49ca-8a48-94776f0841bb) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:25:11.149114 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3d4d182-8328-4384-ba2e-2f005530b25e req-756d66d1-8485-4ca5-b50f-6306d1a414b5 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5100541 Dec 09 21:25:11.205097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddfd4325-6648-43ef-9715-5d96d1eeb0da req-08041d12-5426-460d-a764-443a8e1315df service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:11.206536 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ddfd4325-6648-43ef-9715-5d96d1eeb0da req-08041d12-5426-460d-a764-443a8e1315df service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ffbc2156-2e0a-4a3b-8e1a-215cf8f39866 HTTP/1.1" status: 200 len: 854 time: 0.0937970 Dec 09 21:25:11.222780 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca2a8428-40b0-4b2e-a9a3-92c439f91994 req-58e9b049-5283-41d9-88de-80c1b633c67a tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:11.224238 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ca2a8428-40b0-4b2e-a9a3-92c439f91994 req-58e9b049-5283-41d9-88de-80c1b633c67a tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.2803457 Dec 09 21:25:11.248404 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ddfd4325-6648-43ef-9715-5d96d1eeb0da req-31a38d64-5ece-40fa-a95b-b0a006d42466 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=419425e5-89f0-4884-91f7-260c4b9d176a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0265741 Dec 09 21:25:11.250446 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-f3baa7a7-5dc0-4979-a44d-fe247ee9bb1b service neutron] 10.222.0.10 "GET /v2.0/networks/ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1660023 Dec 09 21:25:11.288643 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b74eb17-2d34-421f-b24f-562ac6bfae68 req-6a011c51-f165-4ef2-b945-c5bd92bc0ad6 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "GET /v2.0/security-groups?id=4aaea988-139c-4402-b4d7-14ee4ed56291&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1805565 Dec 09 21:25:11.340698 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '73466791-f610-4f93-892b-3077db341121', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '378fa265-e1b8-415f-9f0c-2bff04df170a'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:11.343464 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-579d0b2e-9981-4472-bf49-032e8a04184f" -d '{"events": [{"server_uuid": "73466791-f610-4f93-892b-3077db341121", "name": "network-vif-plugged", "status": "completed", "tag": "378fa265-e1b8-415f-9f0c-2bff04df170a"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:11.436784 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0c568e51-b9bd-43d6-9234-62cb6d22145c req-44586ef1-f798-4e35-b6d5-13933ee0cdb3 service neutron] 10.222.0.10 "GET /v2.0/networks/ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1696219 Dec 09 21:25:11.438910 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ddfd4325-6648-43ef-9715-5d96d1eeb0da req-bc43f77a-f549-468f-8209-6598f2c81357 service neutron] 10.222.0.31 "GET /v2.0/networks/419425e5-89f0-4884-91f7-260c4b9d176a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1806378 Dec 09 21:25:11.503044 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 378fa265-e1b8-415f-9f0c-2bff04df170a, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=378fa265-e1b8-415f-9f0c-2bff04df170a,segment=NetworkSegment(77d1b765-2404-4dd1-ab6e-956ebecc3e04),segment_id=77d1b765-2404-4dd1-ab6e-956ebecc3e04)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:11.527018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00717dc9-5a6f-4038-aa96-61ddec8ce0a1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-c8e08369-5b79-4a41-a5f9-0059632e26cd', 'network_id': 'c8e08369-5b79-4a41-a5f9-0059632e26cd', 'project_id': '73812a0c336d4768b029fd6459a1ae9e', 'fixed_ips': [{'subnet_id': 'f4a2d786-583b-4e8b-9946-37b7ed5fd3e8'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:25:11.528589 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-00717dc9-5a6f-4038-aa96-61ddec8ce0a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:11.539717 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:11.547574 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ddfd4325-6648-43ef-9715-5d96d1eeb0da req-cabf6fcd-e899-4ac7-b77a-18abded1fbe8 service neutron] 10.222.0.31 "GET /v2.0/networks/419425e5-89f0-4884-91f7-260c4b9d176a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0988271 Dec 09 21:25:11.548668 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-ebe2fa0d-2b78-4fe7-9e18-12a1fa64ee2d None None] Attempting to bind port 163ae9b8-a7f0-4e1e-9a66-9ce437978aae on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:25:11.549100 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-ebe2fa0d-2b78-4fe7-9e18-12a1fa64ee2d None None] Attempting to bind port 163ae9b8-a7f0-4e1e-9a66-9ce437978aae by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '3e23a057-7b71-4625-891b-f66fd33737f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '6a0b092d-9731-4bc3-9661-8d5436bc9f71'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:25:11.549521 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ebe2fa0d-2b78-4fe7-9e18-12a1fa64ee2d None None] Attempting to bind port 163ae9b8-a7f0-4e1e-9a66-9ce437978aae on network 6a0b092d-9731-4bc3-9661-8d5436bc9f71 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:11.600069 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ebe2fa0d-2b78-4fe7-9e18-12a1fa64ee2d None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 25, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:25:11.600430 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ebe2fa0d-2b78-4fe7-9e18-12a1fa64ee2d None None] Checking segment: {'id': '3e23a057-7b71-4625-891b-f66fd33737f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '6a0b092d-9731-4bc3-9661-8d5436bc9f71'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:25:11.600821 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ebe2fa0d-2b78-4fe7-9e18-12a1fa64ee2d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:11.601214 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ebe2fa0d-2b78-4fe7-9e18-12a1fa64ee2d None None] Bound using segment: {'id': '3e23a057-7b71-4625-891b-f66fd33737f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '6a0b092d-9731-4bc3-9661-8d5436bc9f71'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:25:11.601691 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-ebe2fa0d-2b78-4fe7-9e18-12a1fa64ee2d None None] Bound port: 163ae9b8-a7f0-4e1e-9a66-9ce437978aae, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3e23a057-7b71-4625-891b-f66fd33737f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '6a0b092d-9731-4bc3-9661-8d5436bc9f71'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:25:11.602066 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ebe2fa0d-2b78-4fe7-9e18-12a1fa64ee2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:11.626564 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:11.691040 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:11.719185 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=378fa265-e1b8-415f-9f0c-2bff04df170a,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:11.774790 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device a0305bf6-a5f5-4907-b32b-a04b1fb34872 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:11.782077 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3d4d182-8328-4384-ba2e-2f005530b25e req-9c5e85c7-772d-445c-a371-cd7733996df8 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6179059 Dec 09 21:25:11.794108 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0186ea7f-7c15-46cb-a3bb-b957ac8aa041 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:11.803179 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-555db168-a23a-46cd-8b7c-247282775681 req-789a66b3-286b-4c28-a6bb-d1353c2cd6bd tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:11.804772 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-555db168-a23a-46cd-8b7c-247282775681 req-789a66b3-286b-4c28-a6bb-d1353c2cd6bd tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=73466791-f610-4f93-892b-3077db341121 HTTP/1.1" status: 200 len: 943 time: 0.1389275 Dec 09 21:25:11.820395 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c983942-0bbd-4a34-9ed8-6f9b104ee4e1 req-86e533b8-ed5f-4fe5-b6c2-a7a770113f8a tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:11.821978 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c983942-0bbd-4a34-9ed8-6f9b104ee4e1 req-86e533b8-ed5f-4fe5-b6c2-a7a770113f8a tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.13 "GET /v2.0/ports?device_id=97debe2b-c2b5-48af-a541-3e55e73d399f HTTP/1.1" status: 200 len: 944 time: 0.1572530 Dec 09 21:25:11.873829 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] Attempting to bind port 6ab9bd80-c278-4b58-a046-303d80c95939 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:25:11.874306 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] Attempting to bind port 6ab9bd80-c278-4b58-a046-303d80c95939 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:25:11.874728 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] Attempting to bind port 6ab9bd80-c278-4b58-a046-303d80c95939 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:11.880583 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ebe2fa0d-2b78-4fe7-9e18-12a1fa64ee2d None None] For port 163ae9b8-a7f0-4e1e-9a66-9ce437978aae, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:25:11.882580 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdde0907-797f-4d96-a523-02ea17656e9c None None] Pushing event updated for resources: {'Port': ['ID=6ab9bd80-c278-4b58-a046-303d80c95939,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:11.889479 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ebe2fa0d-2b78-4fe7-9e18-12a1fa64ee2d None None] For port 163ae9b8-a7f0-4e1e-9a66-9ce437978aae, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=163ae9b8-a7f0-4e1e-9a66-9ce437978aae,segment=NetworkSegment(3e23a057-7b71-4625-891b-f66fd33737f2),segment_id=3e23a057-7b71-4625-891b-f66fd33737f2)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:25:11.904979 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-00717dc9-5a6f-4038-aa96-61ddec8ce0a1 None None] Allocated IP 19.86.0.2 (c8e08369-5b79-4a41-a5f9-0059632e26cd/f4a2d786-583b-4e8b-9946-37b7ed5fd3e8/d22ec760-b478-40d7-8730-439cce19a9e0) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:25:11.907465 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ebe2fa0d-2b78-4fe7-9e18-12a1fa64ee2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:11.909655 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 25, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:25:11.910078 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:25:11.910435 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:11.910872 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:25:11.911311 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] Bound port: 6ab9bd80-c278-4b58-a046-303d80c95939, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:25:11.911763 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:11.921367 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-555db168-a23a-46cd-8b7c-247282775681 req-d90ad40c-491d-4d40-ab0d-c74284a89528 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0964205 Dec 09 21:25:11.927938 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c983942-0bbd-4a34-9ed8-6f9b104ee4e1 req-9424e7fb-4b56-4d77-91ea-13975c4877be tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.13 "GET /v2.0/security-groups?id=b7152147-ed7a-4a1f-b140-69adad7d753f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0862973 Dec 09 21:25:11.931470 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0186ea7f-7c15-46cb-a3bb-b957ac8aa041 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:11.984847 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0186ea7f-7c15-46cb-a3bb-b957ac8aa041 admin admin] Network 78764042-44c4-4593-a775-1545766ca91c is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:25:12.042112 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-0186ea7f-7c15-46cb-a3bb-b957ac8aa041 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:12.061926 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0186ea7f-7c15-46cb-a3bb-b957ac8aa041 admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:25:12.069217 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebe2fa0d-2b78-4fe7-9e18-12a1fa64ee2d None None] Pushing event updated for resources: {'Port': ['ID=163ae9b8-a7f0-4e1e-9a66-9ce437978aae,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:12.073918 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1cfc521e-5474-493d-8ea2-4f6933a667cf req-805e84f2-2d0f-4cd9-9797-a8fd68715b7d tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/floatingips/91653aa9-63ed-40e7-8bad-6101aa5b1bec HTTP/1.1" status: 200 len: 693 time: 0.0995727 Dec 09 21:25:12.112099 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0186ea7f-7c15-46cb-a3bb-b957ac8aa041 admin admin] Pushing event updated for resources: {'Port': ['ID=ec7fdfab-915e-49ca-8a48-94776f0841bb,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:12.154885 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port a0305bf6-a5f5-4907-b32b-a04b1fb34872 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:25:12.165985 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] For port 6ab9bd80-c278-4b58-a046-303d80c95939, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:25:12.168066 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port a0305bf6-a5f5-4907-b32b-a04b1fb34872 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:12.168435 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:12.204250 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] For port 6ab9bd80-c278-4b58-a046-303d80c95939, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6ab9bd80-c278-4b58-a046-303d80c95939,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:25:12.226687 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:12.243555 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0186ea7f-7c15-46cb-a3bb-b957ac8aa041 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:12.347128 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-00717dc9-5a6f-4038-aa96-61ddec8ce0a1 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:12.376259 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-00717dc9-5a6f-4038-aa96-61ddec8ce0a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:12.376554 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-c6ae0e25-c31c-47bb-a127-5bd6d639de57 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:12.383177 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-c6ae0e25-c31c-47bb-a127-5bd6d639de57 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:12.384891 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-c6ae0e25-c31c-47bb-a127-5bd6d639de57 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/networks?id=6a0b092d-9731-4bc3-9661-8d5436bc9f71&id=c8e08369-5b79-4a41-a5f9-0059632e26cd&id=6a0b092d-9731-4bc3-9661-8d5436bc9f71 HTTP/1.1" status: 200 len: 1391 time: 0.3485022 Dec 09 21:25:12.387784 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] Routers {'7762495d-a37c-420e-b273-375d531a1e3b'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:25:12.388270 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:25:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7762495d-a37c-420e-b273-375d531a1e3b'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:12.398835 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdde0907-797f-4d96-a523-02ea17656e9c None None] Pushing event updated for resources: {'Port': ['ID=6ab9bd80-c278-4b58-a046-303d80c95939,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:12.400580 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cfc521e-5474-493d-8ea2-4f6933a667cf req-237ad2cb-2df1-42e5-a065-04905092152c tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:12.408911 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1cfc521e-5474-493d-8ea2-4f6933a667cf req-237ad2cb-2df1-42e5-a065-04905092152c tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.3030813 Dec 09 21:25:12.479866 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2b25648b-2b36-4d9b-bfd7-6416ae2603d2 None None] Provisioning complete for port ec7fdfab-915e-49ca-8a48-94776f0841bb triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:12.480417 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2b25648b-2b36-4d9b-bfd7-6416ae2603d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:12.484982 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00717dc9-5a6f-4038-aa96-61ddec8ce0a1 None None] Network c8e08369-5b79-4a41-a5f9-0059632e26cd is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:25:12.491659 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-09c6e6a0-69cb-4875-8da2-875bf05d1044 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/quotas/73812a0c336d4768b029fd6459a1ae9e HTTP/1.1" status: 200 len: 375 time: 0.0725944 Dec 09 21:25:12.500534 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1cfc521e-5474-493d-8ea2-4f6933a667cf req-56b9c719-13e1-4559-81b4-4f3401bfb3a4 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.202 HTTP/1.1" status: 200 len: 696 time: 0.0901668 Dec 09 21:25:12.541647 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-00717dc9-5a6f-4038-aa96-61ddec8ce0a1 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:12.560763 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00717dc9-5a6f-4038-aa96-61ddec8ce0a1 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:25:12.576367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00717dc9-5a6f-4038-aa96-61ddec8ce0a1 None None] Pushing event updated for resources: {'Port': ['ID=d22ec760-b478-40d7-8730-439cce19a9e0,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:12.616720 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:12.625116 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-2b25648b-2b36-4d9b-bfd7-6416ae2603d2 None None] Port ec7fdfab-915e-49ca-8a48-94776f0841bb cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:25:12.625807 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1cfc521e-5474-493d-8ea2-4f6933a667cf req-15883eb7-11d8-4ed8-a566-034ff507df93 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.202 HTTP/1.1" status: 200 len: 696 time: 0.1213105 Dec 09 21:25:12.629744 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a0e7c231-5917-4aec-89da-a4a946e66c69', 'tag': '78afd497-51cf-40c2-9eaf-ee2f42951961'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:12.637855 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bd61bd8b-48da-40c1-acd5-d7601e92e8cc" -d '{"events": [{"name": "network-changed", "server_uuid": "a0e7c231-5917-4aec-89da-a4a946e66c69", "tag": "78afd497-51cf-40c2-9eaf-ee2f42951961"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:12.641517 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 90eef560-add6-4b61-8d08-f04574a6a893 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:25:12.645438 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0186ea7f-7c15-46cb-a3bb-b957ac8aa041 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:12.710012 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] Set router 7762495d-a37c-420e-b273-375d531a1e3b gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:25:12.712392 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-2e590bde-d272-4184-b7fd-4c348eed572b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=73812a0c336d4768b029fd6459a1ae9e&fields=id HTTP/1.1" status: 200 len: 394 time: 0.2113905 Dec 09 21:25:12.789960 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0172ea0e-ba27-491d-b1ed-35eefa0df83c req-5e014efc-4e2f-4871-b21b-4a1b08ca55b6 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:12.791500 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0172ea0e-ba27-491d-b1ed-35eefa0df83c req-5e014efc-4e2f-4871-b21b-4a1b08ca55b6 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.31 "GET /v2.0/ports?device_id=73466791-f610-4f93-892b-3077db341121 HTTP/1.1" status: 200 len: 943 time: 0.2178986 Dec 09 21:25:12.792975 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port a0305bf6-a5f5-4907-b32b-a04b1fb34872, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=a0305bf6-a5f5-4907-b32b-a04b1fb34872,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:12.800662 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-00717dc9-5a6f-4038-aa96-61ddec8ce0a1 None None] Attempting to bind port d22ec760-b478-40d7-8730-439cce19a9e0 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:25:12.801192 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-00717dc9-5a6f-4038-aa96-61ddec8ce0a1 None None] Attempting to bind port d22ec760-b478-40d7-8730-439cce19a9e0 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'e72604b7-1620-485e-8ea6-a66ce97f67f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'c8e08369-5b79-4a41-a5f9-0059632e26cd'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:25:12.801675 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00717dc9-5a6f-4038-aa96-61ddec8ce0a1 None None] Attempting to bind port d22ec760-b478-40d7-8730-439cce19a9e0 on network c8e08369-5b79-4a41-a5f9-0059632e26cd {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:12.828861 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:12.856680 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00717dc9-5a6f-4038-aa96-61ddec8ce0a1 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 25, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:25:12.857129 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00717dc9-5a6f-4038-aa96-61ddec8ce0a1 None None] Checking segment: {'id': 'e72604b7-1620-485e-8ea6-a66ce97f67f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'c8e08369-5b79-4a41-a5f9-0059632e26cd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:25:12.857501 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-00717dc9-5a6f-4038-aa96-61ddec8ce0a1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:12.857975 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00717dc9-5a6f-4038-aa96-61ddec8ce0a1 None None] Bound using segment: {'id': 'e72604b7-1620-485e-8ea6-a66ce97f67f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'c8e08369-5b79-4a41-a5f9-0059632e26cd'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:25:12.858746 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-00717dc9-5a6f-4038-aa96-61ddec8ce0a1 None None] Bound port: d22ec760-b478-40d7-8730-439cce19a9e0, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e72604b7-1620-485e-8ea6-a66ce97f67f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'c8e08369-5b79-4a41-a5f9-0059632e26cd'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:25:12.859137 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-00717dc9-5a6f-4038-aa96-61ddec8ce0a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:13.032125 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=a0305bf6-a5f5-4907-b32b-a04b1fb34872,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:13.044657 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-30bad4d8-43d0-4f19-9b00-a07d341c234f service neutron] 10.222.0.13 "GET /v2.0/networks/6a0b092d-9731-4bc3-9661-8d5436bc9f71?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3205326 Dec 09 21:25:13.050566 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 90eef560-add6-4b61-8d08-f04574a6a893, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=90eef560-add6-4b61-8d08-f04574a6a893,segment=NetworkSegment(7ba7eff4-a37f-4acb-b160-b374a7d3afdf),segment_id=7ba7eff4-a37f-4acb-b160-b374a7d3afdf)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:13.094259 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '90eef560-add6-4b61-8d08-f04574a6a893', 'network_id': '419425e5-89f0-4884-91f7-260c4b9d176a', 'port_id': '90eef560-add6-4b61-8d08-f04574a6a893', 'mac_address': 'fa:16:3e:23:d3:60', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ffbc2156-2e0a-4a3b-8e1a-215cf8f39866', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:25:13.100542 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-00717dc9-5a6f-4038-aa96-61ddec8ce0a1 None None] For port d22ec760-b478-40d7-8730-439cce19a9e0, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:25:13.102388 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-1cfc521e-5474-493d-8ea2-4f6933a667cf req-019b4ec6-e08a-48bb-9231-c593082e3e40 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Deleting port 0d94b355-e3e2-4552-ada7-444ebd4040e4 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:13.102388 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1cfc521e-5474-493d-8ea2-4f6933a667cf req-019b4ec6-e08a-48bb-9231-c593082e3e40 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:13.175860 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-0172ea0e-ba27-491d-b1ed-35eefa0df83c req-bb9d0f4c-02bc-4ce2-b2f3-e222ad8db34c tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Deleting port 378fa265-e1b8-415f-9f0c-2bff04df170a {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:13.176475 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0172ea0e-ba27-491d-b1ed-35eefa0df83c req-bb9d0f4c-02bc-4ce2-b2f3-e222ad8db34c tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:13.290576 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5ab6aeba-d6a9-44eb-b9b2-6f58a9f09038 None None] Network 6a0b092d-9731-4bc3-9661-8d5436bc9f71 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:25:13.299377 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-00717dc9-5a6f-4038-aa96-61ddec8ce0a1 None None] For port d22ec760-b478-40d7-8730-439cce19a9e0, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d22ec760-b478-40d7-8730-439cce19a9e0,segment=NetworkSegment(e72604b7-1620-485e-8ea6-a66ce97f67f1),segment_id=e72604b7-1620-485e-8ea6-a66ce97f67f1)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:25:13.317152 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0186ea7f-7c15-46cb-a3bb-b957ac8aa041 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:13.324302 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-bb99d674-c966-4855-8dae-fd72554e59f2 service neutron] 10.222.0.13 "GET /v2.0/networks/6a0b092d-9731-4bc3-9661-8d5436bc9f71?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2649064 Dec 09 21:25:13.325464 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-00717dc9-5a6f-4038-aa96-61ddec8ce0a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:13.338106 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0186ea7f-7c15-46cb-a3bb-b957ac8aa041 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:13.354842 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1cfc521e-5474-493d-8ea2-4f6933a667cf req-019b4ec6-e08a-48bb-9231-c593082e3e40 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:13.355198 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1cfc521e-5474-493d-8ea2-4f6933a667cf req-019b4ec6-e08a-48bb-9231-c593082e3e40 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:13.398224 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:13.428275 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7386e407-5218-4b0e-b988-30e2856c8595 None None] Provisioning complete for port 163ae9b8-a7f0-4e1e-9a66-9ce437978aae triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:13.428636 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7386e407-5218-4b0e-b988-30e2856c8595 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:13.437771 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-1cfc521e-5474-493d-8ea2-4f6933a667cf req-019b4ec6-e08a-48bb-9231-c593082e3e40 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Calling delete_port for 0d94b355-e3e2-4552-ada7-444ebd4040e4 owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:25:13.446294 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 90eef560-add6-4b61-8d08-f04574a6a893 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:13.497683 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-0172ea0e-ba27-491d-b1ed-35eefa0df83c req-bb9d0f4c-02bc-4ce2-b2f3-e222ad8db34c tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] For port 378fa265-e1b8-415f-9f0c-2bff04df170a, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=378fa265-e1b8-415f-9f0c-2bff04df170a,segment=NetworkSegment(77d1b765-2404-4dd1-ab6e-956ebecc3e04),segment_id=77d1b765-2404-4dd1-ab6e-956ebecc3e04)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:13.498132 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0172ea0e-ba27-491d-b1ed-35eefa0df83c req-bb9d0f4c-02bc-4ce2-b2f3-e222ad8db34c tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:13.509477 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00717dc9-5a6f-4038-aa96-61ddec8ce0a1 None None] Pushing event updated for resources: {'Port': ['ID=d22ec760-b478-40d7-8730-439cce19a9e0,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:13.516815 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7762495d-a37c-420e-b273-375d531a1e3b', 'name': 'tempest-FloatingIPsNegativeTestJSON-1102779277-router', 'tenant_id': '6133c356707e42408885bbdcb5f67413', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.73'}], 'enable_snat': True}, 'gw_port_id': '6ab9bd80-c278-4b58-a046-303d80c95939', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:25:00Z', 'updated_at': '2021-12-09T21:25:04Z', 'revision_number': 3, 'project_id': '6133c356707e42408885bbdcb5f67413', 'gw_port': {'id': '6ab9bd80-c278-4b58-a046-303d80c95939', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:34:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7762495d-a37c-420e-b273-375d531a1e3b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 877, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:25:02Z', 'updated_at': '2021-12-09T21:25:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:13.519909 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0186ea7f-7c15-46cb-a3bb-b957ac8aa041 admin admin] Pushing event updated for resources: {'Port': ['ID=ec7fdfab-915e-49ca-8a48-94776f0841bb,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:13.522475 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0186ea7f-7c15-46cb-a3bb-b957ac8aa041 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:13.561625 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 90eef560-add6-4b61-8d08-f04574a6a893, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=90eef560-add6-4b61-8d08-f04574a6a893,segment=NetworkSegment(7ba7eff4-a37f-4acb-b160-b374a7d3afdf),segment_id=7ba7eff4-a37f-4acb-b160-b374a7d3afdf)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:13.564306 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-0172ea0e-ba27-491d-b1ed-35eefa0df83c req-bb9d0f4c-02bc-4ce2-b2f3-e222ad8db34c tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Calling delete_port for 378fa265-e1b8-415f-9f0c-2bff04df170a owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:25:13.580716 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d812130-31bf-4ff6-93c4-9cafac5ec5a1 None None] The sync data for ids ['7762495d-a37c-420e-b273-375d531a1e3b'] in n-d-713301-27 is: [{'id': '7762495d-a37c-420e-b273-375d531a1e3b', 'name': 'tempest-FloatingIPsNegativeTestJSON-1102779277-router', 'tenant_id': '6133c356707e42408885bbdcb5f67413', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.73'}], 'enable_snat': True}, 'gw_port_id': '6ab9bd80-c278-4b58-a046-303d80c95939', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:25:00Z', 'updated_at': '2021-12-09T21:25:04Z', 'revision_number': 3, 'project_id': '6133c356707e42408885bbdcb5f67413', 'gw_port': {'id': '6ab9bd80-c278-4b58-a046-303d80c95939', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:34:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7762495d-a37c-420e-b273-375d531a1e3b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 877, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:25:02Z', 'updated_at': '2021-12-09T21:25:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:25:13.587642 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:13.729513 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=90eef560-add6-4b61-8d08-f04574a6a893,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:13.751868 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7386e407-5218-4b0e-b988-30e2856c8595 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:13.802038 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 78afd497-51cf-40c2-9eaf-ee2f42951961 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:25:13.833472 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['90eef560-add6-4b61-8d08-f04574a6a893'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:25:13.845942 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-7386e407-5218-4b0e-b988-30e2856c8595 None None] For port 163ae9b8-a7f0-4e1e-9a66-9ce437978aae, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=163ae9b8-a7f0-4e1e-9a66-9ce437978aae,segment=NetworkSegment(3e23a057-7b71-4625-891b-f66fd33737f2),segment_id=3e23a057-7b71-4625-891b-f66fd33737f2)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:13.889063 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-4aa100a3-c196-4894-9a9c-30e3fe740800 service neutron] 10.222.0.13 "GET /v2.0/networks/c8e08369-5b79-4a41-a5f9-0059632e26cd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5567517 Dec 09 21:25:13.917848 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7386e407-5218-4b0e-b988-30e2856c8595 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:13.941336 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d22ec760-b478-40d7-8730-439cce19a9e0 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:14.031145 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0172ea0e-ba27-491d-b1ed-35eefa0df83c req-bb9d0f4c-02bc-4ce2-b2f3-e222ad8db34c tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:14.126161 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb9d0f4c-02bc-4ce2-b2f3-e222ad8db34c tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Pushing event deleted for resources: {'Port': ['ID=378fa265-e1b8-415f-9f0c-2bff04df170a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:14.139948 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-d21d5187-b9c8-4117-a945-d220d8129022 service neutron] 10.222.0.13 "GET /v2.0/networks/c8e08369-5b79-4a41-a5f9-0059632e26cd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2498703 Dec 09 21:25:14.194390 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7386e407-5218-4b0e-b988-30e2856c8595 None None] Pushing event updated for resources: {'Port': ['ID=163ae9b8-a7f0-4e1e-9a66-9ce437978aae,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:14.219554 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 78afd497-51cf-40c2-9eaf-ee2f42951961, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=78afd497-51cf-40c2-9eaf-ee2f42951961,segment=NetworkSegment(51116481-b9d7-45e1-bfed-86b419caae01),segment_id=51116481-b9d7-45e1-bfed-86b419caae01)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:14.258860 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '78afd497-51cf-40c2-9eaf-ee2f42951961', 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c', 'port_id': '78afd497-51cf-40c2-9eaf-ee2f42951961', 'mac_address': 'fa:16:3e:45:e8:2a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 109, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9125b460-598b-4793-bfb4-08b07155042a', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:25:14.267243 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port d22ec760-b478-40d7-8730-439cce19a9e0 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:14.267644 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:14.328103 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7be08fc-15d8-4167-9621-6cdcff37d8bf None None] Provisioning complete for port 163ae9b8-a7f0-4e1e-9a66-9ce437978aae triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:14.328476 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7be08fc-15d8-4167-9621-6cdcff37d8bf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:14.406128 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:14.437958 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 78afd497-51cf-40c2-9eaf-ee2f42951961 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:14.469499 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 78afd497-51cf-40c2-9eaf-ee2f42951961, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=78afd497-51cf-40c2-9eaf-ee2f42951961,segment=NetworkSegment(51116481-b9d7-45e1-bfed-86b419caae01),segment_id=51116481-b9d7-45e1-bfed-86b419caae01)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:14.495386 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:14.558360 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:14.576878 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0186ea7f-7c15-46cb-a3bb-b957ac8aa041 admin admin] Network 78764042-44c4-4593-a775-1545766ca91c is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:25:14.578366 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-0172ea0e-ba27-491d-b1ed-35eefa0df83c req-bb9d0f4c-02bc-4ce2-b2f3-e222ad8db34c tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] No DVR routers for this DVR port 378fa265-e1b8-415f-9f0c-2bff04df170a on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:25:14.586514 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-0186ea7f-7c15-46cb-a3bb-b957ac8aa041 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:14.591872 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0172ea0e-ba27-491d-b1ed-35eefa0df83c req-bb9d0f4c-02bc-4ce2-b2f3-e222ad8db34c tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:14.595385 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0172ea0e-ba27-491d-b1ed-35eefa0df83c req-bb9d0f4c-02bc-4ce2-b2f3-e222ad8db34c tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.31 "DELETE /v2.0/ports/378fa265-e1b8-415f-9f0c-2bff04df170a HTTP/1.1" status: 204 len: 173 time: 1.7839792 Dec 09 21:25:14.595900 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '73466791-f610-4f93-892b-3077db341121', 'name': 'network-vif-deleted', 'tag': '378fa265-e1b8-415f-9f0c-2bff04df170a'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:14.598161 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cc5abdf6-5773-43ea-9931-704929d110e1" -d '{"events": [{"server_uuid": "73466791-f610-4f93-892b-3077db341121", "name": "network-vif-deleted", "tag": "378fa265-e1b8-415f-9f0c-2bff04df170a"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:14.618758 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=78afd497-51cf-40c2-9eaf-ee2f42951961,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:14.654626 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port d22ec760-b478-40d7-8730-439cce19a9e0, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d22ec760-b478-40d7-8730-439cce19a9e0,segment=NetworkSegment(e72604b7-1620-485e-8ea6-a66ce97f67f1),segment_id=e72604b7-1620-485e-8ea6-a66ce97f67f1)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:14.656375 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 378fa265-e1b8-415f-9f0c-2bff04df170a no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:25:14.704194 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 378fa265-e1b8-415f-9f0c-2bff04df170a {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:25:14.704679 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 378fa265-e1b8-415f-9f0c-2bff04df170a not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:25:14.712063 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:14.713796 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 163ae9b8-a7f0-4e1e-9a66-9ce437978aae up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:14.755570 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['78afd497-51cf-40c2-9eaf-ee2f42951961'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:25:14.848875 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-a786f438-2a86-405e-8d56-9675ba6fffe9 service neutron] 10.222.0.13 "GET /v2.0/networks/6a0b092d-9731-4bc3-9661-8d5436bc9f71?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7077353 Dec 09 21:25:14.864192 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=d22ec760-b478-40d7-8730-439cce19a9e0,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:14.908841 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1cfc521e-5474-493d-8ea2-4f6933a667cf req-019b4ec6-e08a-48bb-9231-c593082e3e40 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:14.924837 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 163ae9b8-a7f0-4e1e-9a66-9ce437978aae triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:14.925214 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:14.975313 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-019b4ec6-e08a-48bb-9231-c593082e3e40 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Pushing event deleted for resources: {'Port': ['ID=0d94b355-e3e2-4552-ada7-444ebd4040e4,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:15.038228 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:25:15.063095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0186ea7f-7c15-46cb-a3bb-b957ac8aa041 admin admin] Router 7762495d-a37c-420e-b273-375d531a1e3b has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:25:15.103609 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-ce09fdd9-80d3-46cb-bb37-ceb89873bd2a service neutron] 10.222.0.13 "GET /v2.0/networks/6a0b092d-9731-4bc3-9661-8d5436bc9f71?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2055361 Dec 09 21:25:15.120011 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9275b272-97eb-4ff3-81ee-258b3bccbca8 None None] Provisioning complete for port ec7fdfab-915e-49ca-8a48-94776f0841bb triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:15.120316 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9275b272-97eb-4ff3-81ee-258b3bccbca8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:15.148077 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1cfc521e-5474-493d-8ea2-4f6933a667cf req-019b4ec6-e08a-48bb-9231-c593082e3e40 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:15.152316 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1cfc521e-5474-493d-8ea2-4f6933a667cf req-019b4ec6-e08a-48bb-9231-c593082e3e40 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:15.153719 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1cfc521e-5474-493d-8ea2-4f6933a667cf req-019b4ec6-e08a-48bb-9231-c593082e3e40 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "DELETE /v2.0/floatingips/91653aa9-63ed-40e7-8bad-6101aa5b1bec HTTP/1.1" status: 204 len: 173 time: 2.5161715 Dec 09 21:25:15.162576 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9275b272-97eb-4ff3-81ee-258b3bccbca8 None None] Port ec7fdfab-915e-49ca-8a48-94776f0841bb cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:25:15.205161 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b5061cfc-acbf-487f-8ff0-73d136c53485 x-openstack-request-id: req-b5061cfc-acbf-487f-8ff0-73d136c53485 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:15.206123 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "73466791-f610-4f93-892b-3077db341121", "name": "network-vif-plugged", "status": "completed", "tag": "378fa265-e1b8-415f-9f0c-2bff04df170a", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:15.206525 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-b5061cfc-acbf-487f-8ff0-73d136c53485 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:15.207091 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '73466791-f610-4f93-892b-3077db341121', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '378fa265-e1b8-415f-9f0c-2bff04df170a', 'code': 200} Dec 09 21:25:15.283332 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f69fae42-54d5-4375-b6fe-1d72c23f5294 None None] Network c8e08369-5b79-4a41-a5f9-0059632e26cd requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:25:15.299017 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0186ea7f-7c15-46cb-a3bb-b957ac8aa041 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:25:15.306646 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0186ea7f-7c15-46cb-a3bb-b957ac8aa041 admin admin] 10.222.0.13 "PUT /v2.0/routers/7762495d-a37c-420e-b273-375d531a1e3b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.9216280 Dec 09 21:25:15.368561 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d7594ef-c6f6-49d2-8684-921271ab4f6c req-bb917810-40fb-4f4d-9613-843eb2671669 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:15.370307 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d7594ef-c6f6-49d2-8684-921271ab4f6c req-bb917810-40fb-4f4d-9613-843eb2671669 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=6fc3ad38-60ed-42b3-8c67-af66849bcbaf HTTP/1.1" status: 200 len: 946 time: 0.1066170 Dec 09 21:25:15.410903 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5ddf5578-9e68-49c5-85ff-0d67dbadc097 None None] Provisioning complete for port d22ec760-b478-40d7-8730-439cce19a9e0 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:15.411271 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5ddf5578-9e68-49c5-85ff-0d67dbadc097 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:15.451853 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d7594ef-c6f6-49d2-8684-921271ab4f6c req-518ef68d-aa71-4611-931d-c0d225b3bdac tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0741701 Dec 09 21:25:15.566598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96b4fd25-8345-4be2-af83-43a37eb3ca5c req-56c37c23-cb55-4032-a160-cfb499c575a9 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:15.572104 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96b4fd25-8345-4be2-af83-43a37eb3ca5c req-56c37c23-cb55-4032-a160-cfb499c575a9 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/ports?device_id=f0e077f0-ebc8-425d-939f-f2a18284a3b6 HTTP/1.1" status: 200 len: 949 time: 0.1252594 Dec 09 21:25:15.682327 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e5232e0-283a-49a2-b9ac-e2bc390fb43b req-0c816541-0600-40fa-a0bf-7773d7bc93e8 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:15.684166 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e5232e0-283a-49a2-b9ac-e2bc390fb43b req-0c816541-0600-40fa-a0bf-7773d7bc93e8 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "GET /v2.0/ports?device_id=a0e7c231-5917-4aec-89da-a4a946e66c69 HTTP/1.1" status: 200 len: 945 time: 0.0905545 Dec 09 21:25:15.689799 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96b4fd25-8345-4be2-af83-43a37eb3ca5c req-d20935f6-488d-4490-8162-9ddfa4db5afc tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/security-groups?id=50885dec-ee01-4c11-bc49-430c219f37b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1074131 Dec 09 21:25:15.755584 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-12a71994-38c9-48d1-b3c1-46ad6f1d006c x-openstack-request-id: req-12a71994-38c9-48d1-b3c1-46ad6f1d006c {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:15.756697 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a0e7c231-5917-4aec-89da-a4a946e66c69", "tag": "78afd497-51cf-40c2-9eaf-ee2f42951961", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:15.762060 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-12a71994-38c9-48d1-b3c1-46ad6f1d006c {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:15.762561 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a0e7c231-5917-4aec-89da-a4a946e66c69', 'tag': '78afd497-51cf-40c2-9eaf-ee2f42951961', 'status': 'completed', 'code': 200} Dec 09 21:25:15.801110 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 78afd497-51cf-40c2-9eaf-ee2f42951961 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:15.804982 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e5232e0-283a-49a2-b9ac-e2bc390fb43b req-1bc83f2f-dd69-4d85-9004-8fbcf67e2799 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "GET /v2.0/security-groups?id=4aaea988-139c-4402-b4d7-14ee4ed56291&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1055996 Dec 09 21:25:15.883143 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd61bd8b-48da-40c1-acd5-d7601e92e8cc req-610e4535-ece3-4200-9a5e-9aeaf04f3987 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:15.885404 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd61bd8b-48da-40c1-acd5-d7601e92e8cc req-610e4535-ece3-4200-9a5e-9aeaf04f3987 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=dd631239105645b6b7088738a5229b7f&device_id=a0e7c231-5917-4aec-89da-a4a946e66c69 HTTP/1.1" status: 200 len: 1097 time: 0.0943832 Dec 09 21:25:15.934129 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21152a4c-dfa4-47f3-9e9d-95d14b7cd040 req-3d42fcef-8086-493f-a700-0cc098dca490 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:15.939502 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-21152a4c-dfa4-47f3-9e9d-95d14b7cd040 req-3d42fcef-8086-493f-a700-0cc098dca490 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.13 "GET /v2.0/ports?device_id=97debe2b-c2b5-48af-a541-3e55e73d399f HTTP/1.1" status: 200 len: 945 time: 0.0967255 Dec 09 21:25:15.949635 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ec610119-df00-4ce9-bf50-078791ff4e6a None None] Provisioning complete for port d22ec760-b478-40d7-8730-439cce19a9e0 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:15.951686 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ec610119-df00-4ce9-bf50-078791ff4e6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:15.960579 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 78afd497-51cf-40c2-9eaf-ee2f42951961 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:25:15.988460 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] Sync routers for ids ['7762495d-a37c-420e-b273-375d531a1e3b'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:25:16.010088 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-abbd9f3e-fee6-4de0-ae89-3e4746679d68 x-openstack-request-id: req-abbd9f3e-fee6-4de0-ae89-3e4746679d68 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:16.010440 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "73466791-f610-4f93-892b-3077db341121", "name": "network-vif-deleted", "tag": "378fa265-e1b8-415f-9f0c-2bff04df170a", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:16.010696 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-abbd9f3e-fee6-4de0-ae89-3e4746679d68 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:16.011101 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '73466791-f610-4f93-892b-3077db341121', 'name': 'network-vif-deleted', 'tag': '378fa265-e1b8-415f-9f0c-2bff04df170a', 'status': 'completed', 'code': 200} Dec 09 21:25:16.012925 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] Routers {'7762495d-a37c-420e-b273-375d531a1e3b'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:25:16.013813 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:25:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7762495d-a37c-420e-b273-375d531a1e3b'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:16.027159 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6ab9bd80-c278-4b58-a046-303d80c95939 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:16.033220 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 78afd497-51cf-40c2-9eaf-ee2f42951961 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:16.033893 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:16.124167 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-21152a4c-dfa4-47f3-9e9d-95d14b7cd040 req-fd98e12d-60e5-47d9-8cd0-dca56b66dcf5 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.13 "GET /v2.0/security-groups?id=b7152147-ed7a-4a1f-b140-69adad7d753f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1754031 Dec 09 21:25:16.146913 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd61bd8b-48da-40c1-acd5-d7601e92e8cc req-ad99872f-b65d-4c0a-ae6b-301ac893c4ae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:16.148937 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd61bd8b-48da-40c1-acd5-d7601e92e8cc req-ad99872f-b65d-4c0a-ae6b-301ac893c4ae service neutron] 10.222.0.10 "GET /v2.0/networks?id=ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c HTTP/1.1" status: 200 len: 916 time: 0.2546573 Dec 09 21:25:16.169250 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] Set router 7762495d-a37c-420e-b273-375d531a1e3b gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:25:16.231071 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd61bd8b-48da-40c1-acd5-d7601e92e8cc req-d12377df-0af3-4d94-80d3-62e559c1a17f service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=78afd497-51cf-40c2-9eaf-ee2f42951961 HTTP/1.1" status: 200 len: 217 time: 0.0744622 Dec 09 21:25:16.301467 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd61bd8b-48da-40c1-acd5-d7601e92e8cc req-b79ce61d-263a-4e97-b956-6a76a4e9724a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:16.304342 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd61bd8b-48da-40c1-acd5-d7601e92e8cc req-b79ce61d-263a-4e97-b956-6a76a4e9724a service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9125b460-598b-4793-bfb4-08b07155042a HTTP/1.1" status: 200 len: 854 time: 0.0665882 Dec 09 21:25:16.304952 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 6ab9bd80-c278-4b58-a046-303d80c95939 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:16.305428 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:16.356848 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd61bd8b-48da-40c1-acd5-d7601e92e8cc req-05bef419-4187-4a20-874d-0ec9d939fd2e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:16.359002 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd61bd8b-48da-40c1-acd5-d7601e92e8cc req-05bef419-4187-4a20-874d-0ec9d939fd2e service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0468681 Dec 09 21:25:16.359137 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:16.388924 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fd180ab8-ba52-4e07-b38e-2c38102b8e2f req-b4f57635-4a7c-408f-992a-9cd3f90b28d2 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 210 time: 0.1380689 Dec 09 21:25:16.453050 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e824e2fd-2770-4ab8-88ec-8b141de3badc req-93a389e5-ba98-45f3-99a3-f19e719b6231 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:16.454645 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e824e2fd-2770-4ab8-88ec-8b141de3badc req-93a389e5-ba98-45f3-99a3-f19e719b6231 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 787 time: 0.4073453 Dec 09 21:25:16.471398 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7762495d-a37c-420e-b273-375d531a1e3b', 'name': 'tempest-FloatingIPsNegativeTestJSON-1102779277-router', 'tenant_id': '6133c356707e42408885bbdcb5f67413', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.73'}], 'enable_snat': True}, 'gw_port_id': '6ab9bd80-c278-4b58-a046-303d80c95939', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:25:00Z', 'updated_at': '2021-12-09T21:25:12Z', 'revision_number': 4, 'project_id': '6133c356707e42408885bbdcb5f67413', 'gw_port': {'id': '6ab9bd80-c278-4b58-a046-303d80c95939', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:34:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7762495d-a37c-420e-b273-375d531a1e3b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 877, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:25:02Z', 'updated_at': '2021-12-09T21:25:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'ec7fdfab-915e-49ca-8a48-94776f0841bb', 'name': '', 'network_id': '78764042-44c4-4593-a775-1545766ca91c', 'tenant_id': '6133c356707e42408885bbdcb5f67413', 'mac_address': 'fa:16:3e:3b:64:10', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7762495d-a37c-420e-b273-375d531a1e3b', 'device_owner': 'network:router_interface', 'standard_attr_id': 889, 'fixed_ips': [{'subnet_id': '746a03de-007e-4d48-91db-784f6fe01ab8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:25:10Z', 'updated_at': '2021-12-09T21:25:12Z', 'revision_number': 2, 'project_id': '6133c356707e42408885bbdcb5f67413', 'subnets': [{'id': '746a03de-007e-4d48-91db-784f6fe01ab8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:16.508224 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] Checking router: 7762495d-a37c-420e-b273-375d531a1e3b for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:25:16.508890 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] Updating router 7762495d-a37c-420e-b273-375d531a1e3b port ec7fdfab-915e-49ca-8a48-94776f0841bb binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:25:16.513243 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd61bd8b-48da-40c1-acd5-d7601e92e8cc req-9e237e4d-71d3-47e6-b296-fc3bbdfe2696 service neutron] 10.222.0.10 "GET /v2.0/networks/ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1461449 Dec 09 21:25:16.563983 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:16.595819 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-06c0e7f6-b8b5-4caa-ae27-53402d3bb783 req-5c31d329-841f-4928-a7e5-8b6ace88a4ec tempest-FloatingIPsNegativeTestJSON-1746575240 tempest-FloatingIPsNegativeTestJSON-1746575240-project] 10.222.0.13 "GET /v2.0/floatingips?tenant_id=6133c356707e42408885bbdcb5f67413 HTTP/1.1" status: 200 len: 217 time: 0.0524271 Dec 09 21:25:16.632329 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd61bd8b-48da-40c1-acd5-d7601e92e8cc req-20f35d94-4944-4a7a-b352-1e4a6daf0c03 service neutron] 10.222.0.10 "GET /v2.0/networks/ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1106336 Dec 09 21:25:16.657980 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 90eef560-add6-4b61-8d08-f04574a6a893 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:16.661001 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 78afd497-51cf-40c2-9eaf-ee2f42951961, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=78afd497-51cf-40c2-9eaf-ee2f42951961,segment=NetworkSegment(51116481-b9d7-45e1-bfed-86b419caae01),segment_id=51116481-b9d7-45e1-bfed-86b419caae01)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:16.704767 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:16.733387 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df552a58-d48f-4f96-848c-5a12421039e4 req-1abbc0a4-7beb-429b-a704-bb48abf693de tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/floatingips?tenant_id=df9831f9ad4847c8afaf37f22e8d18a9 HTTP/1.1" status: 200 len: 1656 time: 0.0593476 Dec 09 21:25:16.775968 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:16.815553 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=78afd497-51cf-40c2-9eaf-ee2f42951961,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:16.833943 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 6ab9bd80-c278-4b58-a046-303d80c95939, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6ab9bd80-c278-4b58-a046-303d80c95939,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:16.846534 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 90eef560-add6-4b61-8d08-f04574a6a893 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:25:16.850992 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:16.852868 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d22ec760-b478-40d7-8730-439cce19a9e0 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:16.861049 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 90eef560-add6-4b61-8d08-f04574a6a893 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:16.861049 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:16.979261 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=6ab9bd80-c278-4b58-a046-303d80c95939,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:17.007370 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df552a58-d48f-4f96-848c-5a12421039e4 req-31b2d59e-3098-4670-a623-fa04a5367427 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:17.008915 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df552a58-d48f-4f96-848c-5a12421039e4 req-31b2d59e-3098-4670-a623-fa04a5367427 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/networks?id=97925a19-460a-4476-8208-41db134b6c83&id=97925a19-460a-4476-8208-41db134b6c83&id=97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 787 time: 0.2626767 Dec 09 21:25:17.025937 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port d22ec760-b478-40d7-8730-439cce19a9e0 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:17.026325 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:17.030010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-b73ee9c7-7f92-4642-91a2-e0fcadb633cf tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:17.037054 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-b73ee9c7-7f92-4642-91a2-e0fcadb633cf tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/networks?id=c2615978-1c59-4fbb-826b-fc6aec14e987 HTTP/1.1" status: 200 len: 821 time: 0.3020570 Dec 09 21:25:17.063751 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-91186883-a10f-40d4-b145-f603cafc7322 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/quotas/6b406d0a75bb4ddd96157ff43fd37096 HTTP/1.1" status: 200 len: 375 time: 0.0257065 Dec 09 21:25:17.065799 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:17.100158 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-355c931f-4340-4767-9a03-78c3628e81d5 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=6b406d0a75bb4ddd96157ff43fd37096&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0354502 Dec 09 21:25:17.111392 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 90eef560-add6-4b61-8d08-f04574a6a893, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=90eef560-add6-4b61-8d08-f04574a6a893,segment=NetworkSegment(7ba7eff4-a37f-4acb-b160-b374a7d3afdf),segment_id=7ba7eff4-a37f-4acb-b160-b374a7d3afdf)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:17.115699 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-2ab37b82-807a-4853-a0d0-384c94ee351f tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:17.121487 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-2ab37b82-807a-4853-a0d0-384c94ee351f tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:17.123034 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-2ab37b82-807a-4853-a0d0-384c94ee351f tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.31 "GET /v2.0/networks?id=6a0b092d-9731-4bc3-9661-8d5436bc9f71&id=c8e08369-5b79-4a41-a5f9-0059632e26cd&id=6a0b092d-9731-4bc3-9661-8d5436bc9f71 HTTP/1.1" status: 200 len: 1391 time: 0.2766290 Dec 09 21:25:17.134554 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:17.146792 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-7068f457-6e0e-4f32-acd5-7ad66cbb3f2a tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Request body: {'port': {'device_id': 'e529b5d4-f89f-43c5-8e52-68ae6fa62846', 'network_id': '6a0b092d-9731-4bc3-9661-8d5436bc9f71', 'admin_state_up': True, 'tenant_id': '73812a0c336d4768b029fd6459a1ae9e'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:17.181554 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 163ae9b8-a7f0-4e1e-9a66-9ce437978aae up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:17.185298 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:17.199752 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:17.212776 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '73466791-f610-4f93-892b-3077db341121', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '378fa265-e1b8-415f-9f0c-2bff04df170a'}, {'server_uuid': '6fc3ad38-60ed-42b3-8c67-af66849bcbaf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a0305bf6-a5f5-4907-b32b-a04b1fb34872'}, {'server_uuid': 'a0e7c231-5917-4aec-89da-a4a946e66c69', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '78afd497-51cf-40c2-9eaf-ee2f42951961'}, {'server_uuid': '97debe2b-c2b5-48af-a541-3e55e73d399f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '90eef560-add6-4b61-8d08-f04574a6a893'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:17.215091 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6031b82d-a66e-4083-a39b-378d707540c9" -d '{"events": [{"server_uuid": "73466791-f610-4f93-892b-3077db341121", "name": "network-vif-unplugged", "status": "completed", "tag": "378fa265-e1b8-415f-9f0c-2bff04df170a"}, {"server_uuid": "6fc3ad38-60ed-42b3-8c67-af66849bcbaf", "name": "network-vif-plugged", "status": "completed", "tag": "a0305bf6-a5f5-4907-b32b-a04b1fb34872"}, {"server_uuid": "a0e7c231-5917-4aec-89da-a4a946e66c69", "name": "network-vif-plugged", "status": "completed", "tag": "78afd497-51cf-40c2-9eaf-ee2f42951961"}, {"server_uuid": "97debe2b-c2b5-48af-a541-3e55e73d399f", "name": "network-vif-plugged", "status": "completed", "tag": "90eef560-add6-4b61-8d08-f04574a6a893"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:17.230212 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=90eef560-add6-4b61-8d08-f04574a6a893,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:17.253305 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 163ae9b8-a7f0-4e1e-9a66-9ce437978aae triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:17.253677 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:17.273787 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4f98248-f484-4bf4-837e-5a92163cac52 None None] Pushing event updated for resources: {'Port': ['ID=ec7fdfab-915e-49ca-8a48-94776f0841bb,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:17.297027 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15e83bad-36b2-4652-827d-e0fa969b1735 req-ee8650ff-95d9-4b82-b37e-acc36b46534b tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:17.298621 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15e83bad-36b2-4652-827d-e0fa969b1735 req-ee8650ff-95d9-4b82-b37e-acc36b46534b tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=6fc3ad38-60ed-42b3-8c67-af66849bcbaf HTTP/1.1" status: 200 len: 946 time: 0.1898279 Dec 09 21:25:17.344451 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] Attempting to bind port ec7fdfab-915e-49ca-8a48-94776f0841bb on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:25:17.344873 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] Attempting to bind port ec7fdfab-915e-49ca-8a48-94776f0841bb by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '1acd79aa-cd7a-4fee-a7fc-139e8b6382c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '78764042-44c4-4593-a775-1545766ca91c'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:25:17.347182 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] Attempting to bind port ec7fdfab-915e-49ca-8a48-94776f0841bb on network 78764042-44c4-4593-a775-1545766ca91c {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:17.354264 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 25, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:25:17.354513 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-9d6c614c-5c00-4a85-bd6d-49b788235b58 service neutron] 10.222.0.13 "GET /v2.0/networks/c2615978-1c59-4fbb-826b-fc6aec14e987?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2532279 Dec 09 21:25:17.354777 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] Checking segment: {'id': '1acd79aa-cd7a-4fee-a7fc-139e8b6382c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '78764042-44c4-4593-a775-1545766ca91c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:25:17.355216 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:17.356031 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] Bound using segment: {'id': '1acd79aa-cd7a-4fee-a7fc-139e8b6382c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '78764042-44c4-4593-a775-1545766ca91c'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:25:17.357117 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] Bound port: ec7fdfab-915e-49ca-8a48-94776f0841bb, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1acd79aa-cd7a-4fee-a7fc-139e8b6382c5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '78764042-44c4-4593-a775-1545766ca91c'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:25:17.357535 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:17.444730 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] For port ec7fdfab-915e-49ca-8a48-94776f0841bb, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:25:17.448291 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] For port ec7fdfab-915e-49ca-8a48-94776f0841bb, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=ec7fdfab-915e-49ca-8a48-94776f0841bb,segment=NetworkSegment(1acd79aa-cd7a-4fee-a7fc-139e8b6382c5),segment_id=1acd79aa-cd7a-4fee-a7fc-139e8b6382c5)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:25:17.454175 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15e83bad-36b2-4652-827d-e0fa969b1735 req-b52846b7-5cd1-406e-b4e1-7f0ea13500a8 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1428161 Dec 09 21:25:17.454497 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:17.456762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-7068f457-6e0e-4f32-acd5-7ad66cbb3f2a tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Made reservation on behalf of 73812a0c336d4768b029fd6459a1ae9e for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:25:17.460413 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-7068f457-6e0e-4f32-acd5-7ad66cbb3f2a tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:17.521698 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] Routers {'7762495d-a37c-420e-b273-375d531a1e3b'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:25:17.522472 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:25:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7762495d-a37c-420e-b273-375d531a1e3b'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:17.556870 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60b5ce80-ec90-4f5f-a31c-33d3da552421 req-26a26fbe-6874-4bbe-a680-7bf10546815d tempest-FloatingIPsNegativeTestJSON-1746575240 tempest-FloatingIPsNegativeTestJSON-1746575240-project] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=non_exist_pool HTTP/1.1" status: 200 len: 213 time: 0.0592582 Dec 09 21:25:17.571853 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-32c67ed2-21d8-423c-b9db-0059368eed33 service neutron] 10.222.0.13 "GET /v2.0/networks/c2615978-1c59-4fbb-826b-fc6aec14e987?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2165585 Dec 09 21:25:17.572260 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4f98248-f484-4bf4-837e-5a92163cac52 None None] Pushing event updated for resources: {'Port': ['ID=ec7fdfab-915e-49ca-8a48-94776f0841bb,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:17.674955 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] Set router 7762495d-a37c-420e-b273-375d531a1e3b gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:25:17.700598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-7068f457-6e0e-4f32-acd5-7ad66cbb3f2a tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Allocated IP 19.80.0.16 (6a0b092d-9731-4bc3-9661-8d5436bc9f71/c9ca5636-e2f1-4aee-84ec-4054f1a18361/be89ffc7-e26a-4049-9372-9a434624cba7) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:25:17.707793 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d648f602-cdb1-4f21-a719-0bed085df1e3 None None] Provisioning complete for port ec7fdfab-915e-49ca-8a48-94776f0841bb triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:17.708736 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d648f602-cdb1-4f21-a719-0bed085df1e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:17.718291 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab0ace6c-f1e6-4edf-98c8-40a9c5e415c3 req-fff20483-1dc4-4520-a1ad-4dd7ce23a8a7 tempest-ServersAdminNegativeTestJSON-2022310890 tempest-ServersAdminNegativeTestJSON-2022310890-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:17.720472 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab0ace6c-f1e6-4edf-98c8-40a9c5e415c3 req-fff20483-1dc4-4520-a1ad-4dd7ce23a8a7 tempest-ServersAdminNegativeTestJSON-2022310890 tempest-ServersAdminNegativeTestJSON-2022310890-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=f0e077f0-ebc8-425d-939f-f2a18284a3b6 HTTP/1.1" status: 200 len: 1101 time: 0.0836658 Dec 09 21:25:17.759149 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ab0ace6c-f1e6-4edf-98c8-40a9c5e415c3 req-eb69fed1-df68-4eae-9820-8b04d15935a2 tempest-ServersAdminNegativeTestJSON-2022310890 tempest-ServersAdminNegativeTestJSON-2022310890-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:17.875887 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6ab9bd80-c278-4b58-a046-303d80c95939 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:18.011227 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 6ab9bd80-c278-4b58-a046-303d80c95939 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:18.011628 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:18.038528 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4f7c8bf-6930-45c0-be21-6530071ffc36 req-5e02ff20-e8d3-4407-8f2e-14a8dfdd68b5 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:18.039052 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d648f602-cdb1-4f21-a719-0bed085df1e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:18.040334 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d4f7c8bf-6930-45c0-be21-6530071ffc36 req-5e02ff20-e8d3-4407-8f2e-14a8dfdd68b5 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "GET /v2.0/ports?device_id=a0e7c231-5917-4aec-89da-a4a946e66c69 HTTP/1.1" status: 200 len: 946 time: 0.1588490 Dec 09 21:25:18.071597 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-7068f457-6e0e-4f32-acd5-7ad66cbb3f2a tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:18.076426 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ab0ace6c-f1e6-4edf-98c8-40a9c5e415c3 req-eb69fed1-df68-4eae-9820-8b04d15935a2 tempest-ServersAdminNegativeTestJSON-2022310890 tempest-ServersAdminNegativeTestJSON-2022310890-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:18.093244 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ab0ace6c-f1e6-4edf-98c8-40a9c5e415c3 req-eb69fed1-df68-4eae-9820-8b04d15935a2 tempest-ServersAdminNegativeTestJSON-2022310890 tempest-ServersAdminNegativeTestJSON-2022310890-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:18.103390 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-d648f602-cdb1-4f21-a719-0bed085df1e3 None None] For port ec7fdfab-915e-49ca-8a48-94776f0841bb, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=ec7fdfab-915e-49ca-8a48-94776f0841bb,segment=NetworkSegment(1acd79aa-cd7a-4fee-a7fc-139e8b6382c5),segment_id=1acd79aa-cd7a-4fee-a7fc-139e8b6382c5)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:18.111145 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d648f602-cdb1-4f21-a719-0bed085df1e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:18.130356 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7762495d-a37c-420e-b273-375d531a1e3b', 'name': 'tempest-FloatingIPsNegativeTestJSON-1102779277-router', 'tenant_id': '6133c356707e42408885bbdcb5f67413', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.73'}], 'enable_snat': True}, 'gw_port_id': '6ab9bd80-c278-4b58-a046-303d80c95939', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:25:00Z', 'updated_at': '2021-12-09T21:25:12Z', 'revision_number': 4, 'project_id': '6133c356707e42408885bbdcb5f67413', 'gw_port': {'id': '6ab9bd80-c278-4b58-a046-303d80c95939', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:34:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7762495d-a37c-420e-b273-375d531a1e3b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 877, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:25:02Z', 'updated_at': '2021-12-09T21:25:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'ec7fdfab-915e-49ca-8a48-94776f0841bb', 'name': '', 'network_id': '78764042-44c4-4593-a775-1545766ca91c', 'tenant_id': '6133c356707e42408885bbdcb5f67413', 'mac_address': 'fa:16:3e:3b:64:10', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7762495d-a37c-420e-b273-375d531a1e3b', 'device_owner': 'network:router_interface', 'standard_attr_id': 889, 'fixed_ips': [{'subnet_id': '746a03de-007e-4d48-91db-784f6fe01ab8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:25:10Z', 'updated_at': '2021-12-09T21:25:17Z', 'revision_number': 4, 'project_id': '6133c356707e42408885bbdcb5f67413', 'subnets': [{'id': '746a03de-007e-4d48-91db-784f6fe01ab8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:18.164665 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe22b853-4020-4c12-b12f-ee0fa5b6e63d None None] The sync data for ids ['7762495d-a37c-420e-b273-375d531a1e3b'] in n-d-713301-27 is: [{'id': '7762495d-a37c-420e-b273-375d531a1e3b', 'name': 'tempest-FloatingIPsNegativeTestJSON-1102779277-router', 'tenant_id': '6133c356707e42408885bbdcb5f67413', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.73'}], 'enable_snat': True}, 'gw_port_id': '6ab9bd80-c278-4b58-a046-303d80c95939', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:25:00Z', 'updated_at': '2021-12-09T21:25:12Z', 'revision_number': 4, 'project_id': '6133c356707e42408885bbdcb5f67413', 'gw_port': {'id': '6ab9bd80-c278-4b58-a046-303d80c95939', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:34:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7762495d-a37c-420e-b273-375d531a1e3b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 877, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:25:02Z', 'updated_at': '2021-12-09T21:25:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'ec7fdfab-915e-49ca-8a48-94776f0841bb', 'name': '', 'network_id': '78764042-44c4-4593-a775-1545766ca91c', 'tenant_id': '6133c356707e42408885bbdcb5f67413', 'mac_address': 'fa:16:3e:3b:64:10', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7762495d-a37c-420e-b273-375d531a1e3b', 'device_owner': 'network:router_interface', 'standard_attr_id': 889, 'fixed_ips': [{'subnet_id': '746a03de-007e-4d48-91db-784f6fe01ab8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:25:10Z', 'updated_at': '2021-12-09T21:25:17Z', 'revision_number': 4, 'project_id': '6133c356707e42408885bbdcb5f67413', 'subnets': [{'id': '746a03de-007e-4d48-91db-784f6fe01ab8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:25:18.196091 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab0ace6c-f1e6-4edf-98c8-40a9c5e415c3 req-eb69fed1-df68-4eae-9820-8b04d15935a2 tempest-ServersAdminNegativeTestJSON-2022310890 tempest-ServersAdminNegativeTestJSON-2022310890-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=50885dec-ee01-4c11-bc49-430c219f37b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4510767 Dec 09 21:25:18.198971 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb69fed1-df68-4eae-9820-8b04d15935a2 tempest-ServersAdminNegativeTestJSON-2022310890 tempest-ServersAdminNegativeTestJSON-2022310890-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7e788527-682e-4501-aa63-f5e45c1b3629,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:18.216056 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d4f7c8bf-6930-45c0-be21-6530071ffc36 req-78e17788-4b8c-46fa-ad5d-6778e6841b95 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "GET /v2.0/security-groups?id=4aaea988-139c-4402-b4d7-14ee4ed56291&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1672213 Dec 09 21:25:18.268523 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-7068f457-6e0e-4f32-acd5-7ad66cbb3f2a tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:18.290541 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d648f602-cdb1-4f21-a719-0bed085df1e3 None None] Pushing event updated for resources: {'Port': ['ID=ec7fdfab-915e-49ca-8a48-94776f0841bb,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:18.302485 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de958d1d-d3c3-424b-a568-0444903151d5 req-89e661c8-fe4e-4cea-aa1b-96929a7575be tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/floatingips/1ff6bd1d-4ee3-4254-abc0-d1499fcb3346 HTTP/1.1" status: 200 len: 693 time: 0.0813293 Dec 09 21:25:18.302959 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-16f9428f-8ccc-48e3-8bd9-3f86e6f95fd4 None None] Provisioning complete for port ec7fdfab-915e-49ca-8a48-94776f0841bb triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:18.302959 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-16f9428f-8ccc-48e3-8bd9-3f86e6f95fd4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:18.407642 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-7068f457-6e0e-4f32-acd5-7ad66cbb3f2a tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Network 6a0b092d-9731-4bc3-9661-8d5436bc9f71 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:25:18.462279 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-7068f457-6e0e-4f32-acd5-7ad66cbb3f2a tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:18.478922 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-7068f457-6e0e-4f32-acd5-7ad66cbb3f2a tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:25:18.490001 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7068f457-6e0e-4f32-acd5-7ad66cbb3f2a tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event updated for resources: {'Port': ['ID=be89ffc7-e26a-4049-9372-9a434624cba7,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:18.574786 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de958d1d-d3c3-424b-a568-0444903151d5 req-7f04b79d-ce9a-4d7a-ac8a-bd29cb96a50b tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:18.576819 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de958d1d-d3c3-424b-a568-0444903151d5 req-7f04b79d-ce9a-4d7a-ac8a-bd29cb96a50b tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.2771878 Dec 09 21:25:18.596027 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bab70ef-9f76-4943-9fae-5f7af9c6b33d req-2946f902-91e8-4221-876c-1f2d66bce033 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:18.597668 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5bab70ef-9f76-4943-9fae-5f7af9c6b33d req-2946f902-91e8-4221-876c-1f2d66bce033 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.13 "GET /v2.0/ports?device_id=97debe2b-c2b5-48af-a541-3e55e73d399f HTTP/1.1" status: 200 len: 946 time: 0.2377729 Dec 09 21:25:18.604286 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-7068f457-6e0e-4f32-acd5-7ad66cbb3f2a tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:18.604902 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-7068f457-6e0e-4f32-acd5-7ad66cbb3f2a tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:18.670793 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de958d1d-d3c3-424b-a568-0444903151d5 req-c98826e3-b43d-400d-a101-1e0cc3047205 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.143 HTTP/1.1" status: 200 len: 696 time: 0.0863931 Dec 09 21:25:18.698360 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-7068f457-6e0e-4f32-acd5-7ad66cbb3f2a tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5556514 Dec 09 21:25:18.735377 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7d02529-98ad-496a-b381-4ae7d84ac614 None None] Provisioning complete for port be89ffc7-e26a-4049-9372-9a434624cba7 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:18.736017 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7d02529-98ad-496a-b381-4ae7d84ac614 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:18.740089 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-8dcf1b02-268b-4c4e-81fe-75f86fef4501 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Request body: {'port': {'device_id': 'e529b5d4-f89f-43c5-8e52-68ae6fa62846', 'network_id': 'c8e08369-5b79-4a41-a5f9-0059632e26cd', 'admin_state_up': True, 'tenant_id': '73812a0c336d4768b029fd6459a1ae9e'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:18.777535 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7d02529-98ad-496a-b381-4ae7d84ac614 None None] Port be89ffc7-e26a-4049-9372-9a434624cba7 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:25:18.813797 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de958d1d-d3c3-424b-a568-0444903151d5 req-3e3fa4bd-939e-4ca6-a5b7-bb3800948665 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.143 HTTP/1.1" status: 200 len: 696 time: 0.1330817 Dec 09 21:25:18.845813 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5bab70ef-9f76-4943-9fae-5f7af9c6b33d req-bcdb87c3-8ab4-4526-8229-d9e3f2aaf888 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.13 "GET /v2.0/security-groups?id=b7152147-ed7a-4a1f-b140-69adad7d753f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1987324 Dec 09 21:25:18.919841 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 698 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-18a85c85-5bfd-40ac-9e8e-40eb16cf62ff x-openstack-request-id: req-18a85c85-5bfd-40ac-9e8e-40eb16cf62ff {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:18.920539 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "73466791-f610-4f93-892b-3077db341121", "name": "network-vif-unplugged", "status": "completed", "tag": "378fa265-e1b8-415f-9f0c-2bff04df170a", "code": 200}, {"server_uuid": "6fc3ad38-60ed-42b3-8c67-af66849bcbaf", "name": "network-vif-plugged", "status": "completed", "tag": "a0305bf6-a5f5-4907-b32b-a04b1fb34872", "code": 200}, {"server_uuid": "a0e7c231-5917-4aec-89da-a4a946e66c69", "name": "network-vif-plugged", "status": "completed", "tag": "78afd497-51cf-40c2-9eaf-ee2f42951961", "code": 200}, {"server_uuid": "97debe2b-c2b5-48af-a541-3e55e73d399f", "name": "network-vif-plugged", "status": "completed", "tag": "90eef560-add6-4b61-8d08-f04574a6a893", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:18.921099 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-18a85c85-5bfd-40ac-9e8e-40eb16cf62ff {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:18.921674 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '73466791-f610-4f93-892b-3077db341121', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '378fa265-e1b8-415f-9f0c-2bff04df170a', 'code': 200} Dec 09 21:25:18.922091 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6fc3ad38-60ed-42b3-8c67-af66849bcbaf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a0305bf6-a5f5-4907-b32b-a04b1fb34872', 'code': 200} Dec 09 21:25:18.922633 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a0e7c231-5917-4aec-89da-a4a946e66c69', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '78afd497-51cf-40c2-9eaf-ee2f42951961', 'code': 200} Dec 09 21:25:18.923103 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '97debe2b-c2b5-48af-a541-3e55e73d399f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '90eef560-add6-4b61-8d08-f04574a6a893', 'code': 200} Dec 09 21:25:19.194806 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74c80c72-0a7e-44bf-a9f1-25e2425b2998 req-fc0afd7c-49f0-4eb2-a9f0-6fddffe22095 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:19.197217 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-74c80c72-0a7e-44bf-a9f1-25e2425b2998 req-fc0afd7c-49f0-4eb2-a9f0-6fddffe22095 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=a0e7c231-5917-4aec-89da-a4a946e66c69 HTTP/1.1" status: 200 len: 1098 time: 0.1728437 Dec 09 21:25:19.235872 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf536884-ba62-4185-9f73-3207ce729b3d req-255817e4-7885-473f-8105-00576a483f22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:19.238081 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bf536884-ba62-4185-9f73-3207ce729b3d req-255817e4-7885-473f-8105-00576a483f22 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=97debe2b-c2b5-48af-a541-3e55e73d399f HTTP/1.1" status: 200 len: 1098 time: 0.1852052 Dec 09 21:25:19.270058 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-c8a58199-16e4-4d7a-b67a-f9653f29167b tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:19.275545 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-c8a58199-16e4-4d7a-b67a-f9653f29167b tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.31 "GET /v2.0/networks?id=c2615978-1c59-4fbb-826b-fc6aec14e987 HTTP/1.1" status: 200 len: 821 time: 0.1805744 Dec 09 21:25:19.294382 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-fac1c355-4927-4ace-999d-3d85836ea844 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Request body: {'port': {'device_id': 'a4db25b2-d98a-48fc-bb02-f60ce9fd57ea', 'network_id': 'c2615978-1c59-4fbb-826b-fc6aec14e987', 'admin_state_up': True, 'tenant_id': '6b406d0a75bb4ddd96157ff43fd37096'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:19.304114 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-74c80c72-0a7e-44bf-a9f1-25e2425b2998 req-49404cba-c97f-40a9-b929-86d2530c0644 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=4aaea988-139c-4402-b4d7-14ee4ed56291&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0951183 Dec 09 21:25:19.381816 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bf536884-ba62-4185-9f73-3207ce729b3d req-bf94a28a-1af9-4428-b418-1a9f9bbe5894 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=b7152147-ed7a-4a1f-b140-69adad7d753f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1284313 Dec 09 21:25:19.408469 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02d7308b-730a-4c05-b413-0a922d749b27 req-55369394-2f46-404b-9b8f-59281c2f0682 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:19.409977 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02d7308b-730a-4c05-b413-0a922d749b27 req-55369394-2f46-404b-9b8f-59281c2f0682 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=6fc3ad38-60ed-42b3-8c67-af66849bcbaf HTTP/1.1" status: 200 len: 1098 time: 0.1850326 Dec 09 21:25:19.423287 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d92c7be2-764e-40cd-ae24-a349554473fe req-6606e3f6-cd12-40ae-9100-3e46d66f1f27 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:19.424859 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d92c7be2-764e-40cd-ae24-a349554473fe req-6606e3f6-cd12-40ae-9100-3e46d66f1f27 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 931 time: 0.1967092 Dec 09 21:25:19.433345 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-8dcf1b02-268b-4c4e-81fe-75f86fef4501 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Made reservation on behalf of 73812a0c336d4768b029fd6459a1ae9e for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:25:19.437285 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-8dcf1b02-268b-4c4e-81fe-75f86fef4501 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:19.449898 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-fac1c355-4927-4ace-999d-3d85836ea844 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Made reservation on behalf of 6b406d0a75bb4ddd96157ff43fd37096 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:25:19.455484 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-fac1c355-4927-4ace-999d-3d85836ea844 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:19.489109 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-de958d1d-d3c3-424b-a568-0444903151d5 req-56a417f5-78b5-41a2-b1e4-91ec4991bfbd tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Deleting port 1a557782-cea6-4c8f-bfcf-437174910bee {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:19.489462 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-de958d1d-d3c3-424b-a568-0444903151d5 req-56a417f5-78b5-41a2-b1e4-91ec4991bfbd tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:19.588405 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d92c7be2-764e-40cd-ae24-a349554473fe req-c889ea07-b4cc-40aa-b6f4-952c15e5d49f tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1477075 Dec 09 21:25:19.596546 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-fac1c355-4927-4ace-999d-3d85836ea844 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Allocated IP 172.20.0.8 (c2615978-1c59-4fbb-826b-fc6aec14e987/1f5c65f5-5864-4e4e-bede-1bfc7f6e8e68/e8d231bb-9904-4e89-9b95-5135aca6fb1d) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:25:19.725183 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-698793c0-7622-4809-86ac-1f69f3279395 req-e5554d5f-1a78-486c-8557-3d5fd173b8fe tempest-FloatingIPsNegativeTestJSON-1746575240 tempest-FloatingIPsNegativeTestJSON-1746575240-project] show failed (client error): The resource could not be found. Dec 09 21:25:19.726210 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-698793c0-7622-4809-86ac-1f69f3279395 req-e5554d5f-1a78-486c-8557-3d5fd173b8fe tempest-FloatingIPsNegativeTestJSON-1746575240 tempest-FloatingIPsNegativeTestJSON-1746575240-project] 10.222.0.13 "GET /v2.0/floatingips/3641cfdb-c6f8-4c2c-85e3-9afa69a57cb3 HTTP/1.1" status: 404 len: 350 time: 0.0985932 Dec 09 21:25:19.736706 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02d7308b-730a-4c05-b413-0a922d749b27 req-b01946b8-7d14-46ba-af42-7e2c92d01bc4 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1939657 Dec 09 21:25:19.737215 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37256) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:19.753667 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-fac1c355-4927-4ace-999d-3d85836ea844 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:19.792101 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-fac1c355-4927-4ace-999d-3d85836ea844 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:19.797991 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-de958d1d-d3c3-424b-a568-0444903151d5 req-56a417f5-78b5-41a2-b1e4-91ec4991bfbd tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:19.798301 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-de958d1d-d3c3-424b-a568-0444903151d5 req-56a417f5-78b5-41a2-b1e4-91ec4991bfbd tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:19.819530 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-8dcf1b02-268b-4c4e-81fe-75f86fef4501 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Allocated IP 19.86.0.113 (c8e08369-5b79-4a41-a5f9-0059632e26cd/f4a2d786-583b-4e8b-9946-37b7ed5fd3e8/f985bc1a-2e10-4124-b2e9-f8c053c1cf19) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:25:19.837929 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device ec7fdfab-915e-49ca-8a48-94776f0841bb up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:19.850015 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-fac1c355-4927-4ace-999d-3d85836ea844 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Network c2615978-1c59-4fbb-826b-fc6aec14e987 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:25:19.854345 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-fac1c355-4927-4ace-999d-3d85836ea844 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:19.859706 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-fac1c355-4927-4ace-999d-3d85836ea844 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:25:19.864617 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-de958d1d-d3c3-424b-a568-0444903151d5 req-56a417f5-78b5-41a2-b1e4-91ec4991bfbd tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Calling delete_port for 1a557782-cea6-4c8f-bfcf-437174910bee owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:25:19.895011 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fac1c355-4927-4ace-999d-3d85836ea844 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Pushing event updated for resources: {'Port': ['ID=e8d231bb-9904-4e89-9b95-5135aca6fb1d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:19.918830 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-fac1c355-4927-4ace-999d-3d85836ea844 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:19.920859 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-fac1c355-4927-4ace-999d-3d85836ea844 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:19.943719 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-fac1c355-4927-4ace-999d-3d85836ea844 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6573734 Dec 09 21:25:19.946978 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port ec7fdfab-915e-49ca-8a48-94776f0841bb triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:19.947351 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:19.960073 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-4735ee19-625c-4c56-87a5-125a38e8d0d1 service neutron] Request body: {'port': {'device_id': 'a4db25b2-d98a-48fc-bb02-f60ce9fd57ea', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:20.018038 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae54b420-5bcb-4ba9-9c69-8e80c0d0c07e req-523f20dc-2aa5-4cde-bdd6-b4bc772b7458 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:20.020188 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae54b420-5bcb-4ba9-9c69-8e80c0d0c07e req-523f20dc-2aa5-4cde-bdd6-b4bc772b7458 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=a4db25b2-d98a-48fc-bb02-f60ce9fd57ea HTTP/1.1" status: 200 len: 931 time: 0.2172914 Dec 09 21:25:20.027935 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-4735ee19-625c-4c56-87a5-125a38e8d0d1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:20.248648 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae54b420-5bcb-4ba9-9c69-8e80c0d0c07e req-bb1b7cda-5833-48c1-ab86-9014c8b311da tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2204566 Dec 09 21:25:20.313193 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-8dcf1b02-268b-4c4e-81fe-75f86fef4501 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:20.327739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-4735ee19-625c-4c56-87a5-125a38e8d0d1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e8d231bb-9904-4e89-9b95-5135aca6fb1d {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:20.338305 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-4735ee19-625c-4c56-87a5-125a38e8d0d1 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:20.354602 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-4735ee19-625c-4c56-87a5-125a38e8d0d1 service neutron] Transition to ACTIVE for port object e8d231bb-9904-4e89-9b95-5135aca6fb1d will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:25:20.358110 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-de958d1d-d3c3-424b-a568-0444903151d5 req-56a417f5-78b5-41a2-b1e4-91ec4991bfbd tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:20.358921 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-4735ee19-625c-4c56-87a5-125a38e8d0d1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:20.403337 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56a417f5-78b5-41a2-b1e4-91ec4991bfbd tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Pushing event deleted for resources: {'Port': ['ID=1a557782-cea6-4c8f-bfcf-437174910bee,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:20.416894 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4735ee19-625c-4c56-87a5-125a38e8d0d1 service neutron] Pushing event updated for resources: {'Port': ['ID=e8d231bb-9904-4e89-9b95-5135aca6fb1d,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:20.486544 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-8dcf1b02-268b-4c4e-81fe-75f86fef4501 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:20.518091 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-4735ee19-625c-4c56-87a5-125a38e8d0d1 service neutron] Attempting to bind port e8d231bb-9904-4e89-9b95-5135aca6fb1d on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:25:20.518578 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-4735ee19-625c-4c56-87a5-125a38e8d0d1 service neutron] Attempting to bind port e8d231bb-9904-4e89-9b95-5135aca6fb1d by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '77d1b765-2404-4dd1-ab6e-956ebecc3e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'c2615978-1c59-4fbb-826b-fc6aec14e987'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:25:20.519465 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-4735ee19-625c-4c56-87a5-125a38e8d0d1 service neutron] Attempting to bind port e8d231bb-9904-4e89-9b95-5135aca6fb1d on network c2615978-1c59-4fbb-826b-fc6aec14e987 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:20.526061 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-4735ee19-625c-4c56-87a5-125a38e8d0d1 service neutron] Port e8d231bb-9904-4e89-9b95-5135aca6fb1d on network c2615978-1c59-4fbb-826b-fc6aec14e987 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:25:20.526616 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-4735ee19-625c-4c56-87a5-125a38e8d0d1 service neutron] Attempting to bind port e8d231bb-9904-4e89-9b95-5135aca6fb1d on network c2615978-1c59-4fbb-826b-fc6aec14e987 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:20.532944 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-4735ee19-625c-4c56-87a5-125a38e8d0d1 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 24, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:25:20.533283 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-4735ee19-625c-4c56-87a5-125a38e8d0d1 service neutron] Checking segment: {'id': '77d1b765-2404-4dd1-ab6e-956ebecc3e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'c2615978-1c59-4fbb-826b-fc6aec14e987'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:25:20.533700 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-4735ee19-625c-4c56-87a5-125a38e8d0d1 service neutron] Bound using segment: {'id': '77d1b765-2404-4dd1-ab6e-956ebecc3e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'c2615978-1c59-4fbb-826b-fc6aec14e987'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:25:20.534264 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-4735ee19-625c-4c56-87a5-125a38e8d0d1 service neutron] Bound port: e8d231bb-9904-4e89-9b95-5135aca6fb1d, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '77d1b765-2404-4dd1-ab6e-956ebecc3e04', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': 'c2615978-1c59-4fbb-826b-fc6aec14e987'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:25:20.534640 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-4735ee19-625c-4c56-87a5-125a38e8d0d1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:20.569114 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0d7ddb4-1d36-4887-aab0-84115da1c188 req-2f4b80ca-b4c9-4f64-bdc0-78644a75d871 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:20.571030 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0d7ddb4-1d36-4887-aab0-84115da1c188 req-2f4b80ca-b4c9-4f64-bdc0-78644a75d871 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=6fc3ad38-60ed-42b3-8c67-af66849bcbaf HTTP/1.1" status: 200 len: 946 time: 0.2003927 Dec 09 21:25:20.590796 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-8dcf1b02-268b-4c4e-81fe-75f86fef4501 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Network c8e08369-5b79-4a41-a5f9-0059632e26cd is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:25:20.609058 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-8dcf1b02-268b-4c4e-81fe-75f86fef4501 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:20.616763 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-de958d1d-d3c3-424b-a568-0444903151d5 req-56a417f5-78b5-41a2-b1e4-91ec4991bfbd tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:20.616907 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-4735ee19-625c-4c56-87a5-125a38e8d0d1 service neutron] For port e8d231bb-9904-4e89-9b95-5135aca6fb1d, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:25:20.619354 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-de958d1d-d3c3-424b-a568-0444903151d5 req-56a417f5-78b5-41a2-b1e4-91ec4991bfbd tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:20.620596 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de958d1d-d3c3-424b-a568-0444903151d5 req-56a417f5-78b5-41a2-b1e4-91ec4991bfbd tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "DELETE /v2.0/floatingips/1ff6bd1d-4ee3-4254-abc0-d1499fcb3346 HTTP/1.1" status: 204 len: 173 time: 1.7893853 Dec 09 21:25:20.620769 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-4735ee19-625c-4c56-87a5-125a38e8d0d1 service neutron] For port e8d231bb-9904-4e89-9b95-5135aca6fb1d, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e8d231bb-9904-4e89-9b95-5135aca6fb1d,segment=NetworkSegment(77d1b765-2404-4dd1-ab6e-956ebecc3e04),segment_id=77d1b765-2404-4dd1-ab6e-956ebecc3e04)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:25:20.623680 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-8dcf1b02-268b-4c4e-81fe-75f86fef4501 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:25:20.626244 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dcf1b02-268b-4c4e-81fe-75f86fef4501 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event updated for resources: {'Port': ['ID=f985bc1a-2e10-4124-b2e9-f8c053c1cf19,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:20.627466 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-4735ee19-625c-4c56-87a5-125a38e8d0d1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:20.695358 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-8dcf1b02-268b-4c4e-81fe-75f86fef4501 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:20.696230 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-8dcf1b02-268b-4c4e-81fe-75f86fef4501 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:20.699780 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4735ee19-625c-4c56-87a5-125a38e8d0d1 service neutron] Pushing event updated for resources: {'Port': ['ID=e8d231bb-9904-4e89-9b95-5135aca6fb1d,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:20.711601 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-4735ee19-625c-4c56-87a5-125a38e8d0d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:20.712537 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-4735ee19-625c-4c56-87a5-125a38e8d0d1 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:20.714302 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-4735ee19-625c-4c56-87a5-125a38e8d0d1 service neutron] 10.222.0.31 "PUT /v2.0/ports/e8d231bb-9904-4e89-9b95-5135aca6fb1d HTTP/1.1" status: 200 len: 1092 time: 0.7596197 Dec 09 21:25:20.714756 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a4db25b2-d98a-48fc-bb02-f60ce9fd57ea', 'tag': 'e8d231bb-9904-4e89-9b95-5135aca6fb1d'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:20.717732 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8dca3a02-9b3d-498e-9e7a-e72f07d12ee3" -d '{"events": [{"name": "network-changed", "server_uuid": "a4db25b2-d98a-48fc-bb02-f60ce9fd57ea", "tag": "e8d231bb-9904-4e89-9b95-5135aca6fb1d"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:20.808943 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0d7ddb4-1d36-4887-aab0-84115da1c188 req-a36d394c-1a4a-4332-add3-e5a89133a921 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2253773 Dec 09 21:25:20.825631 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-e1ddeee5-89df-444e-b599-34cb5222a255 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:20.827542 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-e1ddeee5-89df-444e-b599-34cb5222a255 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6b406d0a75bb4ddd96157ff43fd37096&device_id=a4db25b2-d98a-48fc-bb02-f60ce9fd57ea HTTP/1.1" status: 200 len: 1095 time: 0.0678523 Dec 09 21:25:20.829176 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-8dcf1b02-268b-4c4e-81fe-75f86fef4501 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.0957112 Dec 09 21:25:20.879555 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-49d43317-ed2b-4292-bbf6-04978ac7235b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Request body: {'port': {'device_id': 'e529b5d4-f89f-43c5-8e52-68ae6fa62846', 'network_id': '6a0b092d-9731-4bc3-9661-8d5436bc9f71', 'admin_state_up': True, 'tenant_id': '73812a0c336d4768b029fd6459a1ae9e'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:20.887016 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-19fedcd0-6981-4cf1-b6cc-21c57402fe0e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e8d231bb-9904-4e89-9b95-5135aca6fb1d HTTP/1.1" status: 200 len: 217 time: 0.0463507 Dec 09 21:25:20.914449 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-034a7272-a8ee-4d2a-9eeb-1c428a14e932 None None] Provisioning complete for port f985bc1a-2e10-4124-b2e9-f8c053c1cf19 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:20.915041 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-034a7272-a8ee-4d2a-9eeb-1c428a14e932 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:20.938706 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-882c778c-aae4-49a2-92d3-790ae7155157 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:20.940390 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-882c778c-aae4-49a2-92d3-790ae7155157 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=1f5c65f5-5864-4e4e-bede-1bfc7f6e8e68 HTTP/1.1" status: 200 len: 861 time: 0.0462070 Dec 09 21:25:20.945672 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e26f9a5c-b2d4-4b3f-937b-42d6ab83f88a req-020a3556-606b-4c10-bb20-598e4d421596 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:20.947239 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e26f9a5c-b2d4-4b3f-937b-42d6ab83f88a req-020a3556-606b-4c10-bb20-598e4d421596 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "GET /v2.0/ports?device_id=a0e7c231-5917-4aec-89da-a4a946e66c69 HTTP/1.1" status: 200 len: 946 time: 0.2285495 Dec 09 21:25:20.953592 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-034a7272-a8ee-4d2a-9eeb-1c428a14e932 None None] Port f985bc1a-2e10-4124-b2e9-f8c053c1cf19 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:25:20.973683 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-ead9a3a6-34f5-43e5-ad51-e944ff79a64b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=c2615978-1c59-4fbb-826b-fc6aec14e987&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0261006 Dec 09 21:25:21.048950 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-068374fb-c630-42db-822b-bcd305b67ecb req-18fa1bc8-69fe-4106-9a35-688d2825ae27 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:21.050467 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-068374fb-c630-42db-822b-bcd305b67ecb req-18fa1bc8-69fe-4106-9a35-688d2825ae27 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.10 "GET /v2.0/ports?device_id=6fc3ad38-60ed-42b3-8c67-af66849bcbaf HTTP/1.1" status: 200 len: 946 time: 0.2187431 Dec 09 21:25:21.070051 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-dd77a6d1-5393-47ad-bfa0-b19732233d36 service neutron] 10.222.0.31 "GET /v2.0/networks/c2615978-1c59-4fbb-826b-fc6aec14e987?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863023 Dec 09 21:25:21.133945 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-593ada35-bff2-42f1-9a04-737fac016ffa req-9e591085-c9a7-49cb-9f40-7a5b729ffa7d tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:21.135314 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-593ada35-bff2-42f1-9a04-737fac016ffa req-9e591085-c9a7-49cb-9f40-7a5b729ffa7d tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.13 "GET /v2.0/ports?device_id=97debe2b-c2b5-48af-a541-3e55e73d399f HTTP/1.1" status: 200 len: 946 time: 0.2280447 Dec 09 21:25:21.161318 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cca8bfab-5e5f-4c21-b157-32c8ff15077b req-54170631-c35d-4667-8ace-d1c7d385000e service neutron] 10.222.0.31 "GET /v2.0/networks/c2615978-1c59-4fbb-826b-fc6aec14e987?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0835788 Dec 09 21:25:21.163822 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e26f9a5c-b2d4-4b3f-937b-42d6ab83f88a req-e9fd5bec-4773-4e76-8bbb-fd62f8f1cb06 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "GET /v2.0/security-groups?id=4aaea988-139c-4402-b4d7-14ee4ed56291&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1905994 Dec 09 21:25:21.178811 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2aa1de8c-4e9d-41e1-a2f1-9900731cc797 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:21.294206 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-49d43317-ed2b-4292-bbf6-04978ac7235b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Made reservation on behalf of 73812a0c336d4768b029fd6459a1ae9e for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:25:21.297761 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-49d43317-ed2b-4292-bbf6-04978ac7235b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:21.371545 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-593ada35-bff2-42f1-9a04-737fac016ffa req-5e1873ed-ea60-40a3-abff-aef1e1b1180f tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.13 "GET /v2.0/security-groups?id=b7152147-ed7a-4a1f-b140-69adad7d753f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2275703 Dec 09 21:25:21.444259 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7b42947-eca0-41e2-b1da-1ceb5db624d8 req-e5df5358-5503-45bd-bb55-175e61e95241 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:21.450139 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7b42947-eca0-41e2-b1da-1ceb5db624d8 req-e5df5358-5503-45bd-bb55-175e61e95241 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:21.451812 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7b42947-eca0-41e2-b1da-1ceb5db624d8 req-e5df5358-5503-45bd-bb55-175e61e95241 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 1654 time: 0.2127187 Dec 09 21:25:21.536203 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-068374fb-c630-42db-822b-bcd305b67ecb req-228df7d1-684e-4e4d-b47c-d5526d423851 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Deleting port a0305bf6-a5f5-4907-b32b-a04b1fb34872 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:21.536543 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-068374fb-c630-42db-822b-bcd305b67ecb req-228df7d1-684e-4e4d-b47c-d5526d423851 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:21.572577 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1dc60516-f399-4a0a-8fe0-869b44e47b24 req-0dba9a4a-7c41-4465-ba88-14b069045b1b tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/floatingips/12a1ccdc-0d2b-48ac-991c-952605592479 HTTP/1.1" status: 200 len: 693 time: 0.1427591 Dec 09 21:25:21.804395 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7b42947-eca0-41e2-b1da-1ceb5db624d8 req-2230a80f-dcaf-4c3a-8cea-51f4b604359c tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3405888 Dec 09 21:25:21.808560 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-49d43317-ed2b-4292-bbf6-04978ac7235b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Allocated IP 19.80.0.232 (6a0b092d-9731-4bc3-9661-8d5436bc9f71/c9ca5636-e2f1-4aee-84ec-4054f1a18361/39a4e9cb-cd4f-4df2-9c02-6776529dc801) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:25:21.820464 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-068374fb-c630-42db-822b-bcd305b67ecb req-228df7d1-684e-4e4d-b47c-d5526d423851 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] For port a0305bf6-a5f5-4907-b32b-a04b1fb34872, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=a0305bf6-a5f5-4907-b32b-a04b1fb34872,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:21.820835 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-068374fb-c630-42db-822b-bcd305b67ecb req-228df7d1-684e-4e4d-b47c-d5526d423851 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:21.851666 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-068374fb-c630-42db-822b-bcd305b67ecb req-228df7d1-684e-4e4d-b47c-d5526d423851 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Calling delete_port for a0305bf6-a5f5-4907-b32b-a04b1fb34872 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:25:21.863411 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-19b35a90-6224-4739-a2c3-cae50d8818f9 x-openstack-request-id: req-19b35a90-6224-4739-a2c3-cae50d8818f9 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:21.863962 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a4db25b2-d98a-48fc-bb02-f60ce9fd57ea", "tag": "e8d231bb-9904-4e89-9b95-5135aca6fb1d", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:21.863962 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-19b35a90-6224-4739-a2c3-cae50d8818f9 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:21.864409 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a4db25b2-d98a-48fc-bb02-f60ce9fd57ea', 'tag': 'e8d231bb-9904-4e89-9b95-5135aca6fb1d', 'status': 'completed', 'code': 200} Dec 09 21:25:21.887755 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dc60516-f399-4a0a-8fe0-869b44e47b24 req-3f39f99b-27c9-4026-8dbc-79714ce712ef tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:21.889218 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1dc60516-f399-4a0a-8fe0-869b44e47b24 req-3f39f99b-27c9-4026-8dbc-79714ce712ef tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.2853758 Dec 09 21:25:21.953784 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dca3a02-9b3d-498e-9e7a-e72f07d12ee3 req-508b44c9-dff7-499b-8c1a-417dff872d3d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:21.956036 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8dca3a02-9b3d-498e-9e7a-e72f07d12ee3 req-508b44c9-dff7-499b-8c1a-417dff872d3d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6b406d0a75bb4ddd96157ff43fd37096&device_id=a4db25b2-d98a-48fc-bb02-f60ce9fd57ea HTTP/1.1" status: 200 len: 1095 time: 0.0520518 Dec 09 21:25:22.054323 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dca3a02-9b3d-498e-9e7a-e72f07d12ee3 req-fc195981-3439-4aa4-bdf3-5501f2fdc7f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:22.056031 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8dca3a02-9b3d-498e-9e7a-e72f07d12ee3 req-fc195981-3439-4aa4-bdf3-5501f2fdc7f4 service neutron] 10.222.0.31 "GET /v2.0/networks?id=c2615978-1c59-4fbb-826b-fc6aec14e987 HTTP/1.1" status: 200 len: 922 time: 0.0913987 Dec 09 21:25:22.109312 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8dca3a02-9b3d-498e-9e7a-e72f07d12ee3 req-3f4e8664-39b0-4b17-b498-d51d6f759a24 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=e8d231bb-9904-4e89-9b95-5135aca6fb1d HTTP/1.1" status: 200 len: 217 time: 0.0394299 Dec 09 21:25:22.162072 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dca3a02-9b3d-498e-9e7a-e72f07d12ee3 req-090009db-828b-4231-8a70-4bcbffdd5702 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:22.163858 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8dca3a02-9b3d-498e-9e7a-e72f07d12ee3 req-090009db-828b-4231-8a70-4bcbffdd5702 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=1f5c65f5-5864-4e4e-bede-1bfc7f6e8e68 HTTP/1.1" status: 200 len: 861 time: 0.0461366 Dec 09 21:25:22.197211 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8dca3a02-9b3d-498e-9e7a-e72f07d12ee3 req-5ffc48c8-2cca-444d-bd31-4e33494e344b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=c2615978-1c59-4fbb-826b-fc6aec14e987&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0257485 Dec 09 21:25:22.301033 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8dca3a02-9b3d-498e-9e7a-e72f07d12ee3 req-235275d9-9b2b-4772-9da3-91f08b48bceb service neutron] 10.222.0.31 "GET /v2.0/networks/c2615978-1c59-4fbb-826b-fc6aec14e987?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0957713 Dec 09 21:25:22.390595 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1dc60516-f399-4a0a-8fe0-869b44e47b24 req-f627073d-2b7d-4910-af3b-ca30c7a2ad58 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.101 HTTP/1.1" status: 200 len: 696 time: 0.4561336 Dec 09 21:25:22.402720 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8dca3a02-9b3d-498e-9e7a-e72f07d12ee3 req-2040ac67-9253-408a-8637-88bc4818da10 service neutron] 10.222.0.31 "GET /v2.0/networks/c2615978-1c59-4fbb-826b-fc6aec14e987?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0933146 Dec 09 21:25:22.543639 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a9bafa-6ab0-4fb8-a838-6c2244ae7411 req-c89d0032-8e84-4991-85d1-e4571676b8b7 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:22.545301 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42a9bafa-6ab0-4fb8-a838-6c2244ae7411 req-c89d0032-8e84-4991-85d1-e4571676b8b7 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "GET /v2.0/ports?device_id=a0e7c231-5917-4aec-89da-a4a946e66c69 HTTP/1.1" status: 200 len: 946 time: 0.6067226 Dec 09 21:25:22.557156 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37284) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:22.558277 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1dc60516-f399-4a0a-8fe0-869b44e47b24 req-fac965ef-41cf-4391-aa56-5c2ea88e1d19 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.101 HTTP/1.1" status: 200 len: 696 time: 0.1430118 Dec 09 21:25:22.566013 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-8d85a489-d68b-4446-b5bf-97798e92857d tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Request body: {'floatingip': {'port_id': '78afd497-51cf-40c2-9eaf-ee2f42951961'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:22.626691 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8d85a489-d68b-4446-b5bf-97798e92857d tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks [] for floatingip, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:22.732312 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-49d43317-ed2b-4292-bbf6-04978ac7235b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:22.770803 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-068374fb-c630-42db-822b-bcd305b67ecb req-228df7d1-684e-4e4d-b47c-d5526d423851 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:22.783258 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['a0305bf6-a5f5-4907-b32b-a04b1fb34872'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:25:22.802126 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-2aa1de8c-4e9d-41e1-a2f1-9900731cc797 admin admin] Deleting port ec7fdfab-915e-49ca-8a48-94776f0841bb {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:22.802620 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2aa1de8c-4e9d-41e1-a2f1-9900731cc797 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:22.843650 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-228df7d1-684e-4e4d-b47c-d5526d423851 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Pushing event deleted for resources: {'Port': ['ID=a0305bf6-a5f5-4907-b32b-a04b1fb34872,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:22.954239 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6100179-0d8b-453d-80ec-25144dc0b416 req-75895736-9b41-4a5f-a45e-24bbc3d87b66 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:22.955758 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d6100179-0d8b-453d-80ec-25144dc0b416 req-75895736-9b41-4a5f-a45e-24bbc3d87b66 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=a4db25b2-d98a-48fc-bb02-f60ce9fd57ea HTTP/1.1" status: 200 len: 943 time: 0.2928171 Dec 09 21:25:22.977009 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-068374fb-c630-42db-822b-bcd305b67ecb req-228df7d1-684e-4e4d-b47c-d5526d423851 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] No DVR routers for this DVR port a0305bf6-a5f5-4907-b32b-a04b1fb34872 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:25:22.985073 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-068374fb-c630-42db-822b-bcd305b67ecb req-228df7d1-684e-4e4d-b47c-d5526d423851 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:22.988355 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-068374fb-c630-42db-822b-bcd305b67ecb req-228df7d1-684e-4e4d-b47c-d5526d423851 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.10 "DELETE /v2.0/ports/a0305bf6-a5f5-4907-b32b-a04b1fb34872 HTTP/1.1" status: 204 len: 173 time: 1.9265256 Dec 09 21:25:22.994555 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6fc3ad38-60ed-42b3-8c67-af66849bcbaf', 'name': 'network-vif-deleted', 'tag': 'a0305bf6-a5f5-4907-b32b-a04b1fb34872'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:22.996857 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-10c2841c-05ba-4ca2-9ea2-c00e101ffe3b" -d '{"events": [{"server_uuid": "6fc3ad38-60ed-42b3-8c67-af66849bcbaf", "name": "network-vif-deleted", "tag": "a0305bf6-a5f5-4907-b32b-a04b1fb34872"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:23.024527 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-49d43317-ed2b-4292-bbf6-04978ac7235b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:23.089536 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-2aa1de8c-4e9d-41e1-a2f1-9900731cc797 admin admin] For port ec7fdfab-915e-49ca-8a48-94776f0841bb, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=ec7fdfab-915e-49ca-8a48-94776f0841bb,segment=NetworkSegment(1acd79aa-cd7a-4fee-a7fc-139e8b6382c5),segment_id=1acd79aa-cd7a-4fee-a7fc-139e8b6382c5)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:23.089813 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2aa1de8c-4e9d-41e1-a2f1-9900731cc797 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:23.111793 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-1dc60516-f399-4a0a-8fe0-869b44e47b24 req-3c4cbdc0-76e3-47ba-9ab3-840af767d57c tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Deleting port 27374f77-dc74-4170-9448-e028b879b7fc {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:23.112134 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1dc60516-f399-4a0a-8fe0-869b44e47b24 req-3c4cbdc0-76e3-47ba-9ab3-840af767d57c tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:23.138749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-49d43317-ed2b-4292-bbf6-04978ac7235b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Network 6a0b092d-9731-4bc3-9661-8d5436bc9f71 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:25:23.144571 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-2aa1de8c-4e9d-41e1-a2f1-9900731cc797 admin admin] Calling delete_port for ec7fdfab-915e-49ca-8a48-94776f0841bb owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:25:23.151305 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d6100179-0d8b-453d-80ec-25144dc0b416 req-9fca0901-e321-4ddc-af48-1ad23b7d5f47 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1765132 Dec 09 21:25:23.158523 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-49d43317-ed2b-4292-bbf6-04978ac7235b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:23.172126 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-49d43317-ed2b-4292-bbf6-04978ac7235b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:25:23.175015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49d43317-ed2b-4292-bbf6-04978ac7235b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event updated for resources: {'Port': ['ID=39a4e9cb-cd4f-4df2-9c02-6776529dc801,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:23.314576 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5988bd79-46ad-4b0a-ab1e-a9bead7098b9 req-3fc2efda-4a6e-48a2-af46-177d28d9a961 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=1b7916b634f74760a565cfeaef510cd9&device_id=6fc3ad38-60ed-42b3-8c67-af66849bcbaf HTTP/1.1" status: 200 len: 210 time: 0.0538001 Dec 09 21:25:23.358352 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-484e998f-79dd-49dc-9df9-6cfd6217a98d req-8a4a3130-00fa-4df5-8dea-8057e4b02c3f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=6fc3ad38-60ed-42b3-8c67-af66849bcbaf HTTP/1.1" status: 200 len: 210 time: 0.0818033 Dec 09 21:25:23.396421 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-49d43317-ed2b-4292-bbf6-04978ac7235b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:23.397093 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-49d43317-ed2b-4292-bbf6-04978ac7235b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:23.407660 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1dc60516-f399-4a0a-8fe0-869b44e47b24 req-3c4cbdc0-76e3-47ba-9ab3-840af767d57c tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:23.407923 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1dc60516-f399-4a0a-8fe0-869b44e47b24 req-3c4cbdc0-76e3-47ba-9ab3-840af767d57c tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:23.417924 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8d85a489-d68b-4446-b5bf-97798e92857d tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:23.423937 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8d85a489-d68b-4446-b5bf-97798e92857d tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:23.496944 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-1dc60516-f399-4a0a-8fe0-869b44e47b24 req-3c4cbdc0-76e3-47ba-9ab3-840af767d57c tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Calling delete_port for 27374f77-dc74-4170-9448-e028b879b7fc owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:25:23.509622 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-29793f8b-3301-46bf-a3cd-9a8d3eb68a46 None None] Provisioning complete for port 39a4e9cb-cd4f-4df2-9c02-6776529dc801 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:23.510721 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-29793f8b-3301-46bf-a3cd-9a8d3eb68a46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:23.543246 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-8d85a489-d68b-4446-b5bf-97798e92857d tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Floating IP 1b4b1e21-9999-439a-b529-4d84581ab707 associated. External IP: 172.25.3.79, port: 78afd497-51cf-40c2-9eaf-ee2f42951961. Dec 09 21:25:23.568120 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-29793f8b-3301-46bf-a3cd-9a8d3eb68a46 None None] Port 39a4e9cb-cd4f-4df2-9c02-6776529dc801 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:25:23.568635 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-49d43317-ed2b-4292-bbf6-04978ac7235b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.6952927 Dec 09 21:25:23.597053 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-bc81c13f-579c-44b7-9a66-035652396543 service neutron] Request body: {'port': {'device_id': 'e529b5d4-f89f-43c5-8e52-68ae6fa62846', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:23.723110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5988bd79-46ad-4b0a-ab1e-a9bead7098b9 req-e16ed3e6-3717-46d9-9362-9e3d05abc2d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:23.724687 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5988bd79-46ad-4b0a-ab1e-a9bead7098b9 req-e16ed3e6-3717-46d9-9362-9e3d05abc2d9 service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=1b7916b634f74760a565cfeaef510cd9&shared=False HTTP/1.1" status: 200 len: 913 time: 0.3826454 Dec 09 21:25:23.821234 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8d85a489-d68b-4446-b5bf-97798e92857d tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Router 48f26966-6ebd-4ded-9b83-e7fdb71c4bf7 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:25:23.882020 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-bc81c13f-579c-44b7-9a66-035652396543 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:23.940683 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8d85a489-d68b-4446-b5bf-97798e92857d tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:25:23.952094 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8d85a489-d68b-4446-b5bf-97798e92857d tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:23.953206 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de1516ee-fbbb-412e-85d5-76d916af554d None None] Sync routers for ids ['48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:25:23.977895 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de1516ee-fbbb-412e-85d5-76d916af554d None None] Routers {'48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:25:23.979150 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-de1516ee-fbbb-412e-85d5-76d916af554d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:25:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:24.024196 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8d85a489-d68b-4446-b5bf-97798e92857d tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "PUT /v2.0/floatingips/1b4b1e21-9999-439a-b529-4d84581ab707 HTTP/1.1" status: 200 len: 991 time: 1.4650214 Dec 09 21:25:24.024792 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a0e7c231-5917-4aec-89da-a4a946e66c69', 'tag': '78afd497-51cf-40c2-9eaf-ee2f42951961'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:24.027964 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-96a3bca8-beec-4fd6-b2ba-9144531a670c" -d '{"events": [{"name": "network-changed", "server_uuid": "a0e7c231-5917-4aec-89da-a4a946e66c69", "tag": "78afd497-51cf-40c2-9eaf-ee2f42951961"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:24.090106 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2aa1de8c-4e9d-41e1-a2f1-9900731cc797 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:24.101543 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5988bd79-46ad-4b0a-ab1e-a9bead7098b9 req-ffac7374-39ef-4225-8aa9-4c4f9bdd5545 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:24.102959 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5988bd79-46ad-4b0a-ab1e-a9bead7098b9 req-ffac7374-39ef-4225-8aa9-4c4f9bdd5545 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3679626 Dec 09 21:25:24.114644 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-de1516ee-fbbb-412e-85d5-76d916af554d None None] Set router 48f26966-6ebd-4ded-9b83-e7fdb71c4bf7 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:25:24.124712 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69c77187-2dd1-46c8-bd1a-6773c8930c8e req-9c34393b-7bc2-4c48-b838-e40ed55204ce tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:24.130675 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69c77187-2dd1-46c8-bd1a-6773c8930c8e req-9c34393b-7bc2-4c48-b838-e40ed55204ce tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:24.136711 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69c77187-2dd1-46c8-bd1a-6773c8930c8e req-9c34393b-7bc2-4c48-b838-e40ed55204ce tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:24.138787 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69c77187-2dd1-46c8-bd1a-6773c8930c8e req-9c34393b-7bc2-4c48-b838-e40ed55204ce tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 2376 time: 0.3325689 Dec 09 21:25:24.178622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2aa1de8c-4e9d-41e1-a2f1-9900731cc797 admin admin] Pushing event deleted for resources: {'Port': ['ID=ec7fdfab-915e-49ca-8a48-94776f0841bb,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:24.309446 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1dc60516-f399-4a0a-8fe0-869b44e47b24 req-3c4cbdc0-76e3-47ba-9ab3-840af767d57c tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:24.364792 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c4cbdc0-76e3-47ba-9ab3-840af767d57c tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Pushing event deleted for resources: {'Port': ['ID=27374f77-dc74-4170-9448-e028b879b7fc,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:24.391327 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69c77187-2dd1-46c8-bd1a-6773c8930c8e req-e421d86d-9766-4af2-bdd2-d47780b43aa5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2301240 Dec 09 21:25:24.442301 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-de1516ee-fbbb-412e-85d5-76d916af554d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'name': 'tempest-ServersTestFqdnHostnames-1853275289-router', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149'}], 'enable_snat': True}, 'gw_port_id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:32Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'gw_port': {'id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:92:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 809, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:33Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '1b4b1e21-9999-439a-b529-4d84581ab707', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'floating_ip_address': '172.25.3.79', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'port_id': '78afd497-51cf-40c2-9eaf-ee2f42951961', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 850, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c', 'mac_address': 'fa:16:3e:45:e8:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0e7c231-5917-4aec-89da-a4a946e66c69', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:24:55Z', 'updated_at': '2021-12-09T21:25:23Z', 'revision_number': 1, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0c3b6cc8-3628-4374-be2a-ae9bb603880e', 'name': '', 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'mac_address': 'fa:16:3e:01:4d:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 813, 'fixed_ips': [{'subnet_id': '9125b460-598b-4793-bfb4-08b07155042a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:39Z', 'updated_at': '2021-12-09T21:24:50Z', 'revision_number': 5, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'subnets': [{'id': '9125b460-598b-4793-bfb4-08b07155042a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:24.474685 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de1516ee-fbbb-412e-85d5-76d916af554d None None] Checking router: 48f26966-6ebd-4ded-9b83-e7fdb71c4bf7 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:25:24.483638 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de1516ee-fbbb-412e-85d5-76d916af554d None None] Routers {'48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:25:24.484258 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-de1516ee-fbbb-412e-85d5-76d916af554d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:25:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:24.489478 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7802fd6f-5781-4a00-83e4-2ef614d3cd54 x-openstack-request-id: req-7802fd6f-5781-4a00-83e4-2ef614d3cd54 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:24.489769 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6fc3ad38-60ed-42b3-8c67-af66849bcbaf", "name": "network-vif-deleted", "tag": "a0305bf6-a5f5-4907-b32b-a04b1fb34872", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:24.490017 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-7802fd6f-5781-4a00-83e4-2ef614d3cd54 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:24.490417 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6fc3ad38-60ed-42b3-8c67-af66849bcbaf', 'name': 'network-vif-deleted', 'tag': 'a0305bf6-a5f5-4907-b32b-a04b1fb34872', 'status': 'completed', 'code': 200} Dec 09 21:25:24.565953 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1dc60516-f399-4a0a-8fe0-869b44e47b24 req-3c4cbdc0-76e3-47ba-9ab3-840af767d57c tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:24.568662 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1dc60516-f399-4a0a-8fe0-869b44e47b24 req-3c4cbdc0-76e3-47ba-9ab3-840af767d57c tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:24.580280 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1dc60516-f399-4a0a-8fe0-869b44e47b24 req-3c4cbdc0-76e3-47ba-9ab3-840af767d57c tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "DELETE /v2.0/floatingips/12a1ccdc-0d2b-48ac-991c-952605592479 HTTP/1.1" status: 204 len: 173 time: 1.9808910 Dec 09 21:25:24.678475 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2aa1de8c-4e9d-41e1-a2f1-9900731cc797 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:24.723921 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f24dd461-13e3-4f4c-9f1e-3eda8088c88b x-openstack-request-id: req-f24dd461-13e3-4f4c-9f1e-3eda8088c88b {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:24.724479 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a0e7c231-5917-4aec-89da-a4a946e66c69", "tag": "78afd497-51cf-40c2-9eaf-ee2f42951961", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:24.724599 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f24dd461-13e3-4f4c-9f1e-3eda8088c88b {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:24.725218 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a0e7c231-5917-4aec-89da-a4a946e66c69', 'tag': '78afd497-51cf-40c2-9eaf-ee2f42951961', 'status': 'completed', 'code': 200} Dec 09 21:25:24.747595 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e8d231bb-9904-4e89-9b95-5135aca6fb1d details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:25:24.786432 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-de1516ee-fbbb-412e-85d5-76d916af554d None None] Set router 48f26966-6ebd-4ded-9b83-e7fdb71c4bf7 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:25:24.870068 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-bc81c13f-579c-44b7-9a66-035652396543 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id be89ffc7-e26a-4049-9372-9a434624cba7 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:24.958912 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port e8d231bb-9904-4e89-9b95-5135aca6fb1d, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e8d231bb-9904-4e89-9b95-5135aca6fb1d,segment=NetworkSegment(77d1b765-2404-4dd1-ab6e-956ebecc3e04),segment_id=77d1b765-2404-4dd1-ab6e-956ebecc3e04)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:24.992951 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'e8d231bb-9904-4e89-9b95-5135aca6fb1d', 'network_id': 'c2615978-1c59-4fbb-826b-fc6aec14e987', 'port_id': 'e8d231bb-9904-4e89-9b95-5135aca6fb1d', 'mac_address': 'fa:16:3e:d5:e8:7f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 147, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1f5c65f5-5864-4e4e-bede-1bfc7f6e8e68', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:25:25.072178 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:25.096718 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e8d231bb-9904-4e89-9b95-5135aca6fb1d {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:25.144230 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port e8d231bb-9904-4e89-9b95-5135aca6fb1d, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e8d231bb-9904-4e89-9b95-5135aca6fb1d,segment=NetworkSegment(77d1b765-2404-4dd1-ab6e-956ebecc3e04),segment_id=77d1b765-2404-4dd1-ab6e-956ebecc3e04)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:25.151659 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:25.205312 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-de1516ee-fbbb-412e-85d5-76d916af554d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'name': 'tempest-ServersTestFqdnHostnames-1853275289-router', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149'}], 'enable_snat': True}, 'gw_port_id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:32Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'gw_port': {'id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:92:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 809, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:33Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '1b4b1e21-9999-439a-b529-4d84581ab707', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'floating_ip_address': '172.25.3.79', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'port_id': '78afd497-51cf-40c2-9eaf-ee2f42951961', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 850, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c', 'mac_address': 'fa:16:3e:45:e8:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0e7c231-5917-4aec-89da-a4a946e66c69', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:24:55Z', 'updated_at': '2021-12-09T21:25:23Z', 'revision_number': 1, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0c3b6cc8-3628-4374-be2a-ae9bb603880e', 'name': '', 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'mac_address': 'fa:16:3e:01:4d:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 813, 'fixed_ips': [{'subnet_id': '9125b460-598b-4793-bfb4-08b07155042a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:39Z', 'updated_at': '2021-12-09T21:24:50Z', 'revision_number': 5, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'subnets': [{'id': '9125b460-598b-4793-bfb4-08b07155042a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:25.234780 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=e8d231bb-9904-4e89-9b95-5135aca6fb1d,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:25.244479 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de1516ee-fbbb-412e-85d5-76d916af554d None None] The sync data for ids ['48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'] in n-d-713301-27 is: [{'id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'name': 'tempest-ServersTestFqdnHostnames-1853275289-router', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149'}], 'enable_snat': True}, 'gw_port_id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:32Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'gw_port': {'id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:92:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 809, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:33Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '1b4b1e21-9999-439a-b529-4d84581ab707', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'floating_ip_address': '172.25.3.79', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'port_id': '78afd497-51cf-40c2-9eaf-ee2f42951961', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 850, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c', 'mac_address': 'fa:16:3e:45:e8:2a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0e7c231-5917-4aec-89da-a4a946e66c69', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:24:55Z', 'updated_at': '2021-12-09T21:25:23Z', 'revision_number': 1, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0c3b6cc8-3628-4374-be2a-ae9bb603880e', 'name': '', 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'mac_address': 'fa:16:3e:01:4d:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 813, 'fixed_ips': [{'subnet_id': '9125b460-598b-4793-bfb4-08b07155042a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:39Z', 'updated_at': '2021-12-09T21:24:50Z', 'revision_number': 5, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'subnets': [{'id': '9125b460-598b-4793-bfb4-08b07155042a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:25:25.272167 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-bc81c13f-579c-44b7-9a66-035652396543 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:25.281902 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-53ae9e16-488e-4e8f-a782-8815b9d31f61 req-0f7c0710-59b3-41dc-9187-5c4257f9b11c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=6fc3ad38-60ed-42b3-8c67-af66849bcbaf HTTP/1.1" status: 200 len: 210 time: 0.4418390 Dec 09 21:25:25.329954 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-bc81c13f-579c-44b7-9a66-035652396543 service neutron] Transition to ACTIVE for port object be89ffc7-e26a-4049-9372-9a434624cba7 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:25:25.367088 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-bc81c13f-579c-44b7-9a66-035652396543 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:25.375329 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['e8d231bb-9904-4e89-9b95-5135aca6fb1d'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:25:25.443037 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a426dbc7-1981-42d4-8a5c-8f45737505bf req-f9450d6f-5ef0-4014-8f00-bb82f115c265 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:25.447285 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a426dbc7-1981-42d4-8a5c-8f45737505bf req-f9450d6f-5ef0-4014-8f00-bb82f115c265 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=a4db25b2-d98a-48fc-bb02-f60ce9fd57ea HTTP/1.1" status: 200 len: 943 time: 0.6387401 Dec 09 21:25:25.470035 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96a3bca8-beec-4fd6-b2ba-9144531a670c req-b8fb34dc-d5c2-49d8-9e60-1a4fe51dcbf4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:25.473107 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96a3bca8-beec-4fd6-b2ba-9144531a670c req-b8fb34dc-d5c2-49d8-9e60-1a4fe51dcbf4 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=dd631239105645b6b7088738a5229b7f&device_id=a0e7c231-5917-4aec-89da-a4a946e66c69 HTTP/1.1" status: 200 len: 1098 time: 0.6730382 Dec 09 21:25:25.504752 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d90c1f98-a619-4b26-b684-b37ed81c6d10 req-6052bc30-9619-403f-8d0c-73ef5f65c719 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/floatingips/9c7b4dc1-27aa-4153-b307-e5bafea136ad HTTP/1.1" status: 200 len: 692 time: 0.1445434 Dec 09 21:25:25.506645 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5988bd79-46ad-4b0a-ab1e-a9bead7098b9 req-19bc080d-9327-4f3d-82c8-4ecf308bfbae tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.10 "GET /v2.0/ports?device_id=6fc3ad38-60ed-42b3-8c67-af66849bcbaf HTTP/1.1" status: 200 len: 210 time: 0.0430033 Dec 09 21:25:25.629336 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2151c707-bda4-4e8f-b5e1-44336025bac4 None None] New status for floating IP 1b4b1e21-9999-439a-b529-4d84581ab707: ACTIVE {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:25:25.831893 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96a3bca8-beec-4fd6-b2ba-9144531a670c req-eb539b3f-362c-42f2-861d-304bec34675c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:25.833374 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96a3bca8-beec-4fd6-b2ba-9144531a670c req-eb539b3f-362c-42f2-861d-304bec34675c service neutron] 10.222.0.10 "GET /v2.0/networks?id=ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c HTTP/1.1" status: 200 len: 916 time: 0.3139129 Dec 09 21:25:25.872527 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d90c1f98-a619-4b26-b684-b37ed81c6d10 req-b1110dc2-c42b-46be-8f41-d4fafb3d5e54 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:25.880185 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d90c1f98-a619-4b26-b684-b37ed81c6d10 req-b1110dc2-c42b-46be-8f41-d4fafb3d5e54 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.3728850 Dec 09 21:25:25.881159 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc81c13f-579c-44b7-9a66-035652396543 service neutron] Pushing event updated for resources: {'Port': ['ID=be89ffc7-e26a-4049-9372-9a434624cba7,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:26.117239 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d90c1f98-a619-4b26-b684-b37ed81c6d10 req-5d589203-929f-4e60-bb40-f2abc2136072 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.29 HTTP/1.1" status: 200 len: 695 time: 0.2295620 Dec 09 21:25:26.129450 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a426dbc7-1981-42d4-8a5c-8f45737505bf req-e5a9f5a0-a129-4b73-8d6b-36019e09e602 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6618946 Dec 09 21:25:26.206146 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b661d6d-b28f-44f6-a30d-1d12408e567a req-01ee63ed-d041-4b17-be32-3a4514f8a950 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:26.208411 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0b661d6d-b28f-44f6-a30d-1d12408e567a req-01ee63ed-d041-4b17-be32-3a4514f8a950 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.10 "GET /v2.0/ports?device_id=f0e077f0-ebc8-425d-939f-f2a18284a3b6 HTTP/1.1" status: 200 len: 949 time: 0.0584555 Dec 09 21:25:26.245739 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96a3bca8-beec-4fd6-b2ba-9144531a670c req-07b13418-9fcc-4913-9a24-2731bcd61db4 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=78afd497-51cf-40c2-9eaf-ee2f42951961 HTTP/1.1" status: 200 len: 1001 time: 0.3919902 Dec 09 21:25:26.285702 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d90c1f98-a619-4b26-b684-b37ed81c6d10 req-2ed918f9-1318-4ee3-bb82-0170489675f4 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.29 HTTP/1.1" status: 200 len: 695 time: 0.1535561 Dec 09 21:25:26.309854 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-0b661d6d-b28f-44f6-a30d-1d12408e567a req-eb30de6c-7007-4278-8ca9-64f99b6a16d8 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Deleting port 9ff7db85-9b93-4216-acdd-9338d10a0970 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:26.310544 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0b661d6d-b28f-44f6-a30d-1d12408e567a req-eb30de6c-7007-4278-8ca9-64f99b6a16d8 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:26.394325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-bc81c13f-579c-44b7-9a66-035652396543 service neutron] Attempting to bind port be89ffc7-e26a-4049-9372-9a434624cba7 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:25:26.394667 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-bc81c13f-579c-44b7-9a66-035652396543 service neutron] Attempting to bind port be89ffc7-e26a-4049-9372-9a434624cba7 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '3e23a057-7b71-4625-891b-f66fd33737f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '6a0b092d-9731-4bc3-9661-8d5436bc9f71'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:25:26.394997 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-bc81c13f-579c-44b7-9a66-035652396543 service neutron] Attempting to bind port be89ffc7-e26a-4049-9372-9a434624cba7 on network 6a0b092d-9731-4bc3-9661-8d5436bc9f71 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:26.404972 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-0b661d6d-b28f-44f6-a30d-1d12408e567a req-eb30de6c-7007-4278-8ca9-64f99b6a16d8 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] For port 9ff7db85-9b93-4216-acdd-9338d10a0970, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=9ff7db85-9b93-4216-acdd-9338d10a0970,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:26.405369 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0b661d6d-b28f-44f6-a30d-1d12408e567a req-eb30de6c-7007-4278-8ca9-64f99b6a16d8 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:26.405499 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2aa1de8c-4e9d-41e1-a2f1-9900731cc797 admin admin] Router 7762495d-a37c-420e-b273-375d531a1e3b has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:25:26.419359 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-0b661d6d-b28f-44f6-a30d-1d12408e567a req-eb30de6c-7007-4278-8ca9-64f99b6a16d8 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Calling delete_port for 9ff7db85-9b93-4216-acdd-9338d10a0970 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:25:26.427561 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-bc81c13f-579c-44b7-9a66-035652396543 service neutron] Port be89ffc7-e26a-4049-9372-9a434624cba7 on network 6a0b092d-9731-4bc3-9661-8d5436bc9f71 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:25:26.427893 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-bc81c13f-579c-44b7-9a66-035652396543 service neutron] Attempting to bind port be89ffc7-e26a-4049-9372-9a434624cba7 on network 6a0b092d-9731-4bc3-9661-8d5436bc9f71 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:26.459855 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96a3bca8-beec-4fd6-b2ba-9144531a670c req-ac43c288-76e5-4d3f-aee2-85f639acdebd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:26.461383 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96a3bca8-beec-4fd6-b2ba-9144531a670c req-ac43c288-76e5-4d3f-aee2-85f639acdebd service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9125b460-598b-4793-bfb4-08b07155042a HTTP/1.1" status: 200 len: 854 time: 0.1931264 Dec 09 21:25:26.478030 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-bc81c13f-579c-44b7-9a66-035652396543 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 24, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:25:26.478474 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-bc81c13f-579c-44b7-9a66-035652396543 service neutron] Checking segment: {'id': '3e23a057-7b71-4625-891b-f66fd33737f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '6a0b092d-9731-4bc3-9661-8d5436bc9f71'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:25:26.478747 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-bc81c13f-579c-44b7-9a66-035652396543 service neutron] Bound using segment: {'id': '3e23a057-7b71-4625-891b-f66fd33737f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '6a0b092d-9731-4bc3-9661-8d5436bc9f71'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:25:26.479193 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-bc81c13f-579c-44b7-9a66-035652396543 service neutron] Bound port: be89ffc7-e26a-4049-9372-9a434624cba7, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3e23a057-7b71-4625-891b-f66fd33737f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '6a0b092d-9731-4bc3-9661-8d5436bc9f71'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:25:26.479584 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-bc81c13f-579c-44b7-9a66-035652396543 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:26.498776 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a940bb0-9cb7-4356-8b98-3f475770edbe req-9b0a53ab-094b-43c3-bf14-eeb4665ec3a3 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:26.500371 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a940bb0-9cb7-4356-8b98-3f475770edbe req-9b0a53ab-094b-43c3-bf14-eeb4665ec3a3 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/ports?device_id=f0e077f0-ebc8-425d-939f-f2a18284a3b6 HTTP/1.1" status: 200 len: 949 time: 0.2884707 Dec 09 21:25:26.554851 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0b661d6d-b28f-44f6-a30d-1d12408e567a req-eb30de6c-7007-4278-8ca9-64f99b6a16d8 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:26.568308 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['f53b5ffa-c2e5-4ee2-84c4-f0439be955b2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:25:26.571084 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['9ff7db85-9b93-4216-acdd-9338d10a0970'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:25:26.590762 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb30de6c-7007-4278-8ca9-64f99b6a16d8 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Pushing event deleted for resources: {'Port': ['ID=9ff7db85-9b93-4216-acdd-9338d10a0970,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:26.653114 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-0b661d6d-b28f-44f6-a30d-1d12408e567a req-eb30de6c-7007-4278-8ca9-64f99b6a16d8 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] No DVR routers for this DVR port 9ff7db85-9b93-4216-acdd-9338d10a0970 on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:25:26.656913 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0b661d6d-b28f-44f6-a30d-1d12408e567a req-eb30de6c-7007-4278-8ca9-64f99b6a16d8 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:26.662294 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0b661d6d-b28f-44f6-a30d-1d12408e567a req-eb30de6c-7007-4278-8ca9-64f99b6a16d8 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.10 "DELETE /v2.0/ports/9ff7db85-9b93-4216-acdd-9338d10a0970 HTTP/1.1" status: 204 len: 173 time: 0.4466798 Dec 09 21:25:26.714934 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e8d231bb-9904-4e89-9b95-5135aca6fb1d up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:26.726217 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f0e077f0-ebc8-425d-939f-f2a18284a3b6', 'name': 'network-vif-deleted', 'tag': '9ff7db85-9b93-4216-acdd-9338d10a0970'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:26.730987 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2d301e6e-dc4d-4dfc-80b7-bdd1d170f54e" -d '{"events": [{"server_uuid": "f0e077f0-ebc8-425d-939f-f2a18284a3b6", "name": "network-vif-deleted", "tag": "9ff7db85-9b93-4216-acdd-9338d10a0970"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:26.740978 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96a3bca8-beec-4fd6-b2ba-9144531a670c req-4f1a0e09-dd9f-4484-9fe7-4e06725d0e6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:26.742520 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96a3bca8-beec-4fd6-b2ba-9144531a670c req-4f1a0e09-dd9f-4484-9fe7-4e06725d0e6f service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2657588 Dec 09 21:25:26.758227 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-bc81c13f-579c-44b7-9a66-035652396543 service neutron] For port be89ffc7-e26a-4049-9372-9a434624cba7, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:25:26.780621 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a940bb0-9cb7-4356-8b98-3f475770edbe req-1a23a2e4-591d-4704-9e77-6d3e0082c4db tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/security-groups?id=50885dec-ee01-4c11-bc49-430c219f37b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2309740 Dec 09 21:25:26.812953 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-bc81c13f-579c-44b7-9a66-035652396543 service neutron] For port be89ffc7-e26a-4049-9372-9a434624cba7, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=be89ffc7-e26a-4049-9372-9a434624cba7,segment=NetworkSegment(3e23a057-7b71-4625-891b-f66fd33737f2),segment_id=3e23a057-7b71-4625-891b-f66fd33737f2)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:25:26.821353 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-d90c1f98-a619-4b26-b684-b37ed81c6d10 req-d03aa11c-b1ad-4259-bb1b-53fa251775c6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Deleting port e3d18e33-189c-4e89-8b19-fbf11cce673b {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:26.821353 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d90c1f98-a619-4b26-b684-b37ed81c6d10 req-d03aa11c-b1ad-4259-bb1b-53fa251775c6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:26.830631 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2aa1de8c-4e9d-41e1-a2f1-9900731cc797 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:25:26.835633 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-bc81c13f-579c-44b7-9a66-035652396543 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:26.844468 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b36e0b7-de87-4225-9980-05fd43d780be None None] Sync routers for ids ['7762495d-a37c-420e-b273-375d531a1e3b'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:25:26.865499 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2aa1de8c-4e9d-41e1-a2f1-9900731cc797 admin admin] 10.222.0.13 "PUT /v2.0/routers/7762495d-a37c-420e-b273-375d531a1e3b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.1219120 Dec 09 21:25:26.868774 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37330) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:26.893438 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b36e0b7-de87-4225-9980-05fd43d780be None None] Routers {'7762495d-a37c-420e-b273-375d531a1e3b'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:25:26.895387 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-0b36e0b7-de87-4225-9980-05fd43d780be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:25:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7762495d-a37c-420e-b273-375d531a1e3b'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:26.913144 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port e8d231bb-9904-4e89-9b95-5135aca6fb1d completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:25:27.020315 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port e8d231bb-9904-4e89-9b95-5135aca6fb1d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:27.020829 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:27.100985 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b220347-0286-4491-a5d4-5aa8037db22c admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:27.161695 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:27.204712 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:27.226347 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b220347-0286-4491-a5d4-5aa8037db22c admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:27.272702 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:27.309411 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1b220347-0286-4491-a5d4-5aa8037db22c admin admin] Deleting port 6ab9bd80-c278-4b58-a046-303d80c95939 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:27.309969 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b220347-0286-4491-a5d4-5aa8037db22c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:27.312716 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-0b36e0b7-de87-4225-9980-05fd43d780be None None] Set router 7762495d-a37c-420e-b273-375d531a1e3b gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:25:27.373271 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a4db25b2-d98a-48fc-bb02-f60ce9fd57ea', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e8d231bb-9904-4e89-9b95-5135aca6fb1d'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:27.375645 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8c73c848-caed-42a3-94bc-7936454bf979" -d '{"events": [{"server_uuid": "a4db25b2-d98a-48fc-bb02-f60ce9fd57ea", "name": "network-vif-plugged", "status": "completed", "tag": "e8d231bb-9904-4e89-9b95-5135aca6fb1d"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:27.454286 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-1b220347-0286-4491-a5d4-5aa8037db22c admin admin] For port 6ab9bd80-c278-4b58-a046-303d80c95939, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6ab9bd80-c278-4b58-a046-303d80c95939,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:27.455065 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b220347-0286-4491-a5d4-5aa8037db22c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:27.470108 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1b220347-0286-4491-a5d4-5aa8037db22c admin admin] Calling delete_port for 6ab9bd80-c278-4b58-a046-303d80c95939 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:25:27.502814 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port e8d231bb-9904-4e89-9b95-5135aca6fb1d, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e8d231bb-9904-4e89-9b95-5135aca6fb1d,segment=NetworkSegment(77d1b765-2404-4dd1-ab6e-956ebecc3e04),segment_id=77d1b765-2404-4dd1-ab6e-956ebecc3e04)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:27.532975 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d90c1f98-a619-4b26-b684-b37ed81c6d10 req-d03aa11c-b1ad-4259-bb1b-53fa251775c6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:27.533598 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d90c1f98-a619-4b26-b684-b37ed81c6d10 req-d03aa11c-b1ad-4259-bb1b-53fa251775c6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:27.535410 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:27.547631 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-d90c1f98-a619-4b26-b684-b37ed81c6d10 req-d03aa11c-b1ad-4259-bb1b-53fa251775c6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Calling delete_port for e3d18e33-189c-4e89-8b19-fbf11cce673b owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:25:27.591384 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc81c13f-579c-44b7-9a66-035652396543 service neutron] Pushing event updated for resources: {'Port': ['ID=be89ffc7-e26a-4049-9372-9a434624cba7,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:27.593375 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=e8d231bb-9904-4e89-9b95-5135aca6fb1d,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:27.600190 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-bc81c13f-579c-44b7-9a66-035652396543 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:27.601440 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-bc81c13f-579c-44b7-9a66-035652396543 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:27.602289 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-bc81c13f-579c-44b7-9a66-035652396543 service neutron] 10.222.0.31 "PUT /v2.0/ports/be89ffc7-e26a-4049-9372-9a434624cba7 HTTP/1.1" status: 200 len: 1092 time: 4.0177464 Dec 09 21:25:27.605780 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e529b5d4-f89f-43c5-8e52-68ae6fa62846', 'tag': 'be89ffc7-e26a-4049-9372-9a434624cba7'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:27.608539 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9d24fee4-15ca-4447-b27e-c67492e7e9b4" -d '{"events": [{"name": "network-changed", "server_uuid": "e529b5d4-f89f-43c5-8e52-68ae6fa62846", "tag": "be89ffc7-e26a-4049-9372-9a434624cba7"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:27.621721 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-0b36e0b7-de87-4225-9980-05fd43d780be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7762495d-a37c-420e-b273-375d531a1e3b', 'name': 'tempest-FloatingIPsNegativeTestJSON-1102779277-router', 'tenant_id': '6133c356707e42408885bbdcb5f67413', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.73'}], 'enable_snat': True}, 'gw_port_id': '6ab9bd80-c278-4b58-a046-303d80c95939', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:25:00Z', 'updated_at': '2021-12-09T21:25:23Z', 'revision_number': 5, 'project_id': '6133c356707e42408885bbdcb5f67413', 'gw_port': {'id': '6ab9bd80-c278-4b58-a046-303d80c95939', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:34:7c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7762495d-a37c-420e-b273-375d531a1e3b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 877, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.73', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:25:02Z', 'updated_at': '2021-12-09T21:25:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:27.656465 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-fcceab40-9fe2-41a0-aa8b-ad1256969f7b service neutron] Request body: {'port': {'device_id': 'e529b5d4-f89f-43c5-8e52-68ae6fa62846', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:27.667020 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b36e0b7-de87-4225-9980-05fd43d780be None None] Checking router: 7762495d-a37c-420e-b273-375d531a1e3b for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:25:27.683904 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b36e0b7-de87-4225-9980-05fd43d780be None None] Routers {'7762495d-a37c-420e-b273-375d531a1e3b'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:25:27.685324 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-0b36e0b7-de87-4225-9980-05fd43d780be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:25:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7762495d-a37c-420e-b273-375d531a1e3b'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:27.700829 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b220347-0286-4491-a5d4-5aa8037db22c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:27.724464 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96a3bca8-beec-4fd6-b2ba-9144531a670c req-b7a13b99-c285-415d-8930-df9ecbc5dc3f service neutron] 10.222.0.10 "GET /v2.0/networks/ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9717102 Dec 09 21:25:27.811747 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b319198-f9fe-42ce-8f00-4c0ac24a8861 req-996236b4-0f60-4754-b7a8-a5eed96d5bf7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:27.815712 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b220347-0286-4491-a5d4-5aa8037db22c admin admin] Pushing event deleted for resources: {'Port': ['ID=6ab9bd80-c278-4b58-a046-303d80c95939,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:27.817726 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b319198-f9fe-42ce-8f00-4c0ac24a8861 req-996236b4-0f60-4754-b7a8-a5eed96d5bf7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:27.824303 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b319198-f9fe-42ce-8f00-4c0ac24a8861 req-996236b4-0f60-4754-b7a8-a5eed96d5bf7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:27.829940 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device a0305bf6-a5f5-4907-b32b-a04b1fb34872 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:25:27.833983 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b319198-f9fe-42ce-8f00-4c0ac24a8861 req-996236b4-0f60-4754-b7a8-a5eed96d5bf7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 2388 time: 0.2306604 Dec 09 21:25:27.842394 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b220347-0286-4491-a5d4-5aa8037db22c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:27.865719 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-0b36e0b7-de87-4225-9980-05fd43d780be None None] Set router 7762495d-a37c-420e-b273-375d531a1e3b gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:25:27.877483 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-fcceab40-9fe2-41a0-aa8b-ad1256969f7b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:27.936888 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: a0305bf6-a5f5-4907-b32b-a04b1fb34872 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:25:27.938216 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device a0305bf6-a5f5-4907-b32b-a04b1fb34872 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:25:27.938216 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 9ff7db85-9b93-4216-acdd-9338d10a0970 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:25:27.941450 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-0b36e0b7-de87-4225-9980-05fd43d780be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7762495d-a37c-420e-b273-375d531a1e3b', 'name': 'tempest-FloatingIPsNegativeTestJSON-1102779277-router', 'tenant_id': '6133c356707e42408885bbdcb5f67413', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:25:00Z', 'updated_at': '2021-12-09T21:25:27Z', 'revision_number': 6, 'project_id': '6133c356707e42408885bbdcb5f67413', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:27.972318 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b220347-0286-4491-a5d4-5aa8037db22c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:27.974678 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b220347-0286-4491-a5d4-5aa8037db22c admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:27.986712 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b36e0b7-de87-4225-9980-05fd43d780be None None] The sync data for ids ['7762495d-a37c-420e-b273-375d531a1e3b'] in n-d-713301-27 is: [{'id': '7762495d-a37c-420e-b273-375d531a1e3b', 'name': 'tempest-FloatingIPsNegativeTestJSON-1102779277-router', 'tenant_id': '6133c356707e42408885bbdcb5f67413', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:25:00Z', 'updated_at': '2021-12-09T21:25:27Z', 'revision_number': 6, 'project_id': '6133c356707e42408885bbdcb5f67413', 'gw_port_host': None}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:25:27.994501 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 9ff7db85-9b93-4216-acdd-9338d10a0970 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:25:27.994823 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 9ff7db85-9b93-4216-acdd-9338d10a0970 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:25:28.011667 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b319198-f9fe-42ce-8f00-4c0ac24a8861 req-dede4406-6ac2-4c36-9588-8d8f66714f0d tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1719828 Dec 09 21:25:28.014027 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96a3bca8-beec-4fd6-b2ba-9144531a670c req-8920a46d-1f12-4095-858d-b91611022c79 service neutron] 10.222.0.10 "GET /v2.0/networks/ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2793479 Dec 09 21:25:28.053353 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b220347-0286-4491-a5d4-5aa8037db22c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:28.054346 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1b220347-0286-4491-a5d4-5aa8037db22c admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7762495d-a37c-420e-b273-375d531a1e3b {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:25:28.061666 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b220347-0286-4491-a5d4-5aa8037db22c admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:28.067971 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1b220347-0286-4491-a5d4-5aa8037db22c admin admin] 10.222.0.13 "DELETE /v2.0/routers/7762495d-a37c-420e-b273-375d531a1e3b HTTP/1.1" status: 204 len: 168 time: 1.1981211 Dec 09 21:25:28.070129 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37344) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:28.130050 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-6b627dcd-cc0e-4de3-9789-22a77b3005f7 admin admin] Deleting subnet 746a03de-007e-4d48-91db-784f6fe01ab8 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:25:28.141822 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6b627dcd-cc0e-4de3-9789-22a77b3005f7 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:28.158924 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d90c1f98-a619-4b26-b684-b37ed81c6d10 req-d03aa11c-b1ad-4259-bb1b-53fa251775c6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:28.203332 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d03aa11c-b1ad-4259-bb1b-53fa251775c6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Pushing event deleted for resources: {'Port': ['ID=e3d18e33-189c-4e89-8b19-fbf11cce673b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:28.210533 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2011efb4-1dbd-4fa8-8fa4-c826b67f0daa x-openstack-request-id: req-2011efb4-1dbd-4fa8-8fa4-c826b67f0daa {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:28.210838 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f0e077f0-ebc8-425d-939f-f2a18284a3b6", "name": "network-vif-deleted", "tag": "9ff7db85-9b93-4216-acdd-9338d10a0970", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:28.211877 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-2011efb4-1dbd-4fa8-8fa4-c826b67f0daa {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:28.211877 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f0e077f0-ebc8-425d-939f-f2a18284a3b6', 'name': 'network-vif-deleted', 'tag': '9ff7db85-9b93-4216-acdd-9338d10a0970', 'status': 'completed', 'code': 200} Dec 09 21:25:28.226704 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6b627dcd-cc0e-4de3-9789-22a77b3005f7 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:28.343416 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6b627dcd-cc0e-4de3-9789-22a77b3005f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:28.374848 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d90c1f98-a619-4b26-b684-b37ed81c6d10 req-d03aa11c-b1ad-4259-bb1b-53fa251775c6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:28.377462 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d90c1f98-a619-4b26-b684-b37ed81c6d10 req-d03aa11c-b1ad-4259-bb1b-53fa251775c6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:28.378604 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d90c1f98-a619-4b26-b684-b37ed81c6d10 req-d03aa11c-b1ad-4259-bb1b-53fa251775c6 tempest-FloatingIPDetailsTestJSON-310836949 tempest-FloatingIPDetailsTestJSON-310836949-project] 10.222.0.13 "DELETE /v2.0/floatingips/9c7b4dc1-27aa-4153-b307-e5bafea136ad HTTP/1.1" status: 204 len: 173 time: 2.0491295 Dec 09 21:25:28.387792 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37350) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:28.425503 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4322850-a680-41d9-85aa-f6605b37a99e req-20365053-523e-44ec-ad83-5908c000042b tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:28.427300 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4322850-a680-41d9-85aa-f6605b37a99e req-20365053-523e-44ec-ad83-5908c000042b tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=a4db25b2-d98a-48fc-bb02-f60ce9fd57ea HTTP/1.1" status: 200 len: 945 time: 0.1541259 Dec 09 21:25:28.440082 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-539031ef-d08f-4fac-aa3e-76aceaf59e9f x-openstack-request-id: req-539031ef-d08f-4fac-aa3e-76aceaf59e9f {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:28.440375 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a4db25b2-d98a-48fc-bb02-f60ce9fd57ea", "name": "network-vif-plugged", "status": "completed", "tag": "e8d231bb-9904-4e89-9b95-5135aca6fb1d", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:28.440635 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-539031ef-d08f-4fac-aa3e-76aceaf59e9f {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:28.441033 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a4db25b2-d98a-48fc-bb02-f60ce9fd57ea', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e8d231bb-9904-4e89-9b95-5135aca6fb1d', 'code': 200} Dec 09 21:25:28.496070 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-879588f9-ea88-4079-bd6e-8f095d735e56 x-openstack-request-id: req-879588f9-ea88-4079-bd6e-8f095d735e56 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:28.496377 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e529b5d4-f89f-43c5-8e52-68ae6fa62846", "tag": "be89ffc7-e26a-4049-9372-9a434624cba7", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:28.496612 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-879588f9-ea88-4079-bd6e-8f095d735e56 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:28.497019 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e529b5d4-f89f-43c5-8e52-68ae6fa62846', 'tag': 'be89ffc7-e26a-4049-9372-9a434624cba7', 'status': 'completed', 'code': 200} Dec 09 21:25:28.511773 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6b627dcd-cc0e-4de3-9789-22a77b3005f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:28.535681 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-fcceab40-9fe2-41a0-aa8b-ad1256969f7b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f985bc1a-2e10-4124-b2e9-f8c053c1cf19 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:28.538538 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6b627dcd-cc0e-4de3-9789-22a77b3005f7 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:28.544234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aeeb1000-f11e-417a-9c0c-e000362fb6af None None] Network 78764042-44c4-4593-a775-1545766ca91c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:25:28.547424 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4322850-a680-41d9-85aa-f6605b37a99e req-0a58877b-8c1b-4e1a-8b05-8b1a0977fc69 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1131449 Dec 09 21:25:28.550345 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37354) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:28.553750 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-fcceab40-9fe2-41a0-aa8b-ad1256969f7b service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:28.571236 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6b627dcd-cc0e-4de3-9789-22a77b3005f7 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/746a03de-007e-4d48-91db-784f6fe01ab8 HTTP/1.1" status: 204 len: 168 time: 0.4699070 Dec 09 21:25:28.596729 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-fcceab40-9fe2-41a0-aa8b-ad1256969f7b service neutron] Transition to ACTIVE for port object f985bc1a-2e10-4124-b2e9-f8c053c1cf19 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:25:28.604244 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-fcceab40-9fe2-41a0-aa8b-ad1256969f7b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:28.731153 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-aa08ffa8-dc05-4276-a7ea-f4ee5621847a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:28.738812 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcceab40-9fe2-41a0-aa8b-ad1256969f7b service neutron] Pushing event updated for resources: {'Port': ['ID=f985bc1a-2e10-4124-b2e9-f8c053c1cf19,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:28.757932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b627dcd-cc0e-4de3-9789-22a77b3005f7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=746a03de-007e-4d48-91db-784f6fe01ab8,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:29.019172 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-3818c0f6-cdd4-4447-b968-387208992aa6 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:29.020852 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-3818c0f6-cdd4-4447-b968-387208992aa6 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/networks?id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb HTTP/1.1" status: 200 len: 812 time: 0.3843865 Dec 09 21:25:29.034457 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d24fee4-15ca-4447-b27e-c67492e7e9b4 req-2a50006c-3bda-47cf-9323-7f81b754cc2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:29.034940 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d24fee4-15ca-4447-b27e-c67492e7e9b4 req-2a50006c-3bda-47cf-9323-7f81b754cc2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:29.035412 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d24fee4-15ca-4447-b27e-c67492e7e9b4 req-2a50006c-3bda-47cf-9323-7f81b754cc2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:29.041845 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9d24fee4-15ca-4447-b27e-c67492e7e9b4 req-2a50006c-3bda-47cf-9323-7f81b754cc2a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=73812a0c336d4768b029fd6459a1ae9e&device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 2758 time: 0.4017553 Dec 09 21:25:29.072345 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-f04094b1-c136-48aa-a13a-c6127b26b859 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/quotas/1b7916b634f74760a565cfeaef510cd9 HTTP/1.1" status: 200 len: 375 time: 0.0414231 Dec 09 21:25:29.072610 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87c80bd0-dd69-447d-813f-0df22f4d4bf8 req-db24cd6a-ffb3-494d-917b-7e5fca149c37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:29.074952 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-87c80bd0-dd69-447d-813f-0df22f4d4bf8 req-db24cd6a-ffb3-494d-917b-7e5fca149c37 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=a4db25b2-d98a-48fc-bb02-f60ce9fd57ea HTTP/1.1" status: 200 len: 1097 time: 0.4360855 Dec 09 21:25:29.093455 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-fcceab40-9fe2-41a0-aa8b-ad1256969f7b service neutron] Attempting to bind port f985bc1a-2e10-4124-b2e9-f8c053c1cf19 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:25:29.093800 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-fcceab40-9fe2-41a0-aa8b-ad1256969f7b service neutron] Attempting to bind port f985bc1a-2e10-4124-b2e9-f8c053c1cf19 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'e72604b7-1620-485e-8ea6-a66ce97f67f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'c8e08369-5b79-4a41-a5f9-0059632e26cd'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:25:29.094130 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-fcceab40-9fe2-41a0-aa8b-ad1256969f7b service neutron] Attempting to bind port f985bc1a-2e10-4124-b2e9-f8c053c1cf19 on network c8e08369-5b79-4a41-a5f9-0059632e26cd {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:29.155877 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-a88d9d69-6b6a-462b-b3b1-fe828602c7d9 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=1b7916b634f74760a565cfeaef510cd9&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0647542 Dec 09 21:25:29.175379 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c2303d06-d50a-4aa6-9ef2-b1507c735617 None None] DHCP port deletion for 78764042-44c4-4593-a775-1545766ca91c request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:25:29.239613 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5992cf52-121d-4333-b006-d1a8bf202f29 req-14cdc2a7-1117-42b6-a3f8-2b1921521da3 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:29.248127 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5992cf52-121d-4333-b006-d1a8bf202f29 req-14cdc2a7-1117-42b6-a3f8-2b1921521da3 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/ports?device_id=9012a4aa-4a6a-4b44-b9a8-35264565fa33 HTTP/1.1" status: 200 len: 950 time: 0.3281839 Dec 09 21:25:29.257917 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-fcceab40-9fe2-41a0-aa8b-ad1256969f7b service neutron] Port f985bc1a-2e10-4124-b2e9-f8c053c1cf19 on network c8e08369-5b79-4a41-a5f9-0059632e26cd not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:25:29.258221 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-fcceab40-9fe2-41a0-aa8b-ad1256969f7b service neutron] Attempting to bind port f985bc1a-2e10-4124-b2e9-f8c053c1cf19 on network c8e08369-5b79-4a41-a5f9-0059632e26cd {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:29.280590 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-c2303d06-d50a-4aa6-9ef2-b1507c735617 None None] Deleting port 739045da-de08-4bd9-8441-0e750354346e {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:29.281440 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c2303d06-d50a-4aa6-9ef2-b1507c735617 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:29.316753 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-fcceab40-9fe2-41a0-aa8b-ad1256969f7b service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 25, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:25:29.317163 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-fcceab40-9fe2-41a0-aa8b-ad1256969f7b service neutron] Checking segment: {'id': 'e72604b7-1620-485e-8ea6-a66ce97f67f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'c8e08369-5b79-4a41-a5f9-0059632e26cd'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:25:29.317614 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-fcceab40-9fe2-41a0-aa8b-ad1256969f7b service neutron] Bound using segment: {'id': 'e72604b7-1620-485e-8ea6-a66ce97f67f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'c8e08369-5b79-4a41-a5f9-0059632e26cd'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:25:29.326117 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-fcceab40-9fe2-41a0-aa8b-ad1256969f7b service neutron] Bound port: f985bc1a-2e10-4124-b2e9-f8c053c1cf19, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e72604b7-1620-485e-8ea6-a66ce97f67f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'c8e08369-5b79-4a41-a5f9-0059632e26cd'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:25:29.326531 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-fcceab40-9fe2-41a0-aa8b-ad1256969f7b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:29.333051 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-aa08ffa8-dc05-4276-a7ea-f4ee5621847a admin admin] Deleting port 739045da-de08-4bd9-8441-0e750354346e {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:29.333432 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-aa08ffa8-dc05-4276-a7ea-f4ee5621847a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:29.416561 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c2303d06-d50a-4aa6-9ef2-b1507c735617 None None] For port 739045da-de08-4bd9-8441-0e750354346e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=739045da-de08-4bd9-8441-0e750354346e,segment=NetworkSegment(1acd79aa-cd7a-4fee-a7fc-139e8b6382c5),segment_id=1acd79aa-cd7a-4fee-a7fc-139e8b6382c5)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:29.417029 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c2303d06-d50a-4aa6-9ef2-b1507c735617 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:29.435031 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-c2303d06-d50a-4aa6-9ef2-b1507c735617 None None] Calling delete_port for 739045da-de08-4bd9-8441-0e750354346e owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:25:29.459247 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5992cf52-121d-4333-b006-d1a8bf202f29 req-974fe5fe-ffdf-4ca1-b52f-731b98c796ba tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/security-groups?id=50885dec-ee01-4c11-bc49-430c219f37b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2101247 Dec 09 21:25:29.557996 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c2303d06-d50a-4aa6-9ef2-b1507c735617 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:29.593688 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-20b3f735-355c-454a-91bb-f5a37fe2c3db service neutron] 10.222.0.13 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4365301 Dec 09 21:25:29.610002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2303d06-d50a-4aa6-9ef2-b1507c735617 None None] No DVR routers for this DVR port 739045da-de08-4bd9-8441-0e750354346e on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:25:29.623611 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2303d06-d50a-4aa6-9ef2-b1507c735617 None None] Pushing event deleted for resources: {'Port': ['ID=739045da-de08-4bd9-8441-0e750354346e,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:29.649110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-aa08ffa8-dc05-4276-a7ea-f4ee5621847a admin admin] For port 739045da-de08-4bd9-8441-0e750354346e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=739045da-de08-4bd9-8441-0e750354346e,segment=NetworkSegment(1acd79aa-cd7a-4fee-a7fc-139e8b6382c5),segment_id=1acd79aa-cd7a-4fee-a7fc-139e8b6382c5)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:29.649504 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-aa08ffa8-dc05-4276-a7ea-f4ee5621847a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:29.656275 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-87c80bd0-dd69-447d-813f-0df22f4d4bf8 req-05b862ab-cc8c-4da2-bcec-a2c5ac0772ce service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5485537 Dec 09 21:25:29.687031 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-aa08ffa8-dc05-4276-a7ea-f4ee5621847a admin admin] Calling delete_port for 739045da-de08-4bd9-8441-0e750354346e owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:25:29.706669 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-fcceab40-9fe2-41a0-aa8b-ad1256969f7b service neutron] For port f985bc1a-2e10-4124-b2e9-f8c053c1cf19, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:25:29.730528 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d24fee4-15ca-4447-b27e-c67492e7e9b4 req-01e03cde-437e-476b-a301-1dd540059497 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:29.731005 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d24fee4-15ca-4447-b27e-c67492e7e9b4 req-01e03cde-437e-476b-a301-1dd540059497 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:29.731529 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d24fee4-15ca-4447-b27e-c67492e7e9b4 req-01e03cde-437e-476b-a301-1dd540059497 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:29.733179 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9d24fee4-15ca-4447-b27e-c67492e7e9b4 req-01e03cde-437e-476b-a301-1dd540059497 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=73812a0c336d4768b029fd6459a1ae9e&shared=False HTTP/1.1" status: 200 len: 2290 time: 0.6792610 Dec 09 21:25:29.810151 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-fcceab40-9fe2-41a0-aa8b-ad1256969f7b service neutron] For port f985bc1a-2e10-4124-b2e9-f8c053c1cf19, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=f985bc1a-2e10-4124-b2e9-f8c053c1cf19,segment=NetworkSegment(e72604b7-1620-485e-8ea6-a66ce97f67f1),segment_id=e72604b7-1620-485e-8ea6-a66ce97f67f1)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:25:29.822628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dcfba5d-6c07-4725-936c-7762d9f7497f req-33f4c790-edd9-47ac-b0cb-5f0578bfe042 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:29.831670 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6ab9bd80-c278-4b58-a046-303d80c95939 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:25:29.838942 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dcfba5d-6c07-4725-936c-7762d9f7497f req-33f4c790-edd9-47ac-b0cb-5f0578bfe042 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:29.844998 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dcfba5d-6c07-4725-936c-7762d9f7497f req-33f4c790-edd9-47ac-b0cb-5f0578bfe042 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:29.847394 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0dcfba5d-6c07-4725-936c-7762d9f7497f req-33f4c790-edd9-47ac-b0cb-5f0578bfe042 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 2400 time: 0.2774301 Dec 09 21:25:29.847926 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 6ab9bd80-c278-4b58-a046-303d80c95939 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:25:29.848380 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6ab9bd80-c278-4b58-a046-303d80c95939 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:25:29.849003 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device ec7fdfab-915e-49ca-8a48-94776f0841bb no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:25:29.852452 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-fcceab40-9fe2-41a0-aa8b-ad1256969f7b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:29.873444 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: ec7fdfab-915e-49ca-8a48-94776f0841bb {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:25:29.876189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device ec7fdfab-915e-49ca-8a48-94776f0841bb not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:25:29.876748 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 739045da-de08-4bd9-8441-0e750354346e no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:25:29.903057 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 739045da-de08-4bd9-8441-0e750354346e {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:25:29.903597 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 739045da-de08-4bd9-8441-0e750354346e not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:25:29.967531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-fcceab40-9fe2-41a0-aa8b-ad1256969f7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:29.968302 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-fcceab40-9fe2-41a0-aa8b-ad1256969f7b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:29.970525 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-fcceab40-9fe2-41a0-aa8b-ad1256969f7b service neutron] 10.222.0.31 "PUT /v2.0/ports/f985bc1a-2e10-4124-b2e9-f8c053c1cf19 HTTP/1.1" status: 200 len: 1093 time: 2.3227091 Dec 09 21:25:29.988268 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-544b1b9a-3610-46b4-90e0-8ca543a8f7bb service neutron] 10.222.0.13 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3920622 Dec 09 21:25:30.020761 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-65ab16a8-f34f-4d87-8393-92a018a54837 service neutron] Request body: {'port': {'device_id': 'e529b5d4-f89f-43c5-8e52-68ae6fa62846', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:30.055333 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcceab40-9fe2-41a0-aa8b-ad1256969f7b service neutron] Pushing event updated for resources: {'Port': ['ID=f985bc1a-2e10-4124-b2e9-f8c053c1cf19,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:30.079524 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0dcfba5d-6c07-4725-936c-7762d9f7497f req-db5055b4-0e37-479e-bd43-98bde86a462b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2130113 Dec 09 21:25:30.134254 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03d07742-f7f3-4b78-9cdb-6db7951126f5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:30.151349 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-aa08ffa8-dc05-4276-a7ea-f4ee5621847a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:30.184842 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-65ab16a8-f34f-4d87-8393-92a018a54837 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:30.236587 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa08ffa8-dc05-4276-a7ea-f4ee5621847a admin admin] Pushing event deleted for resources: {'Port': ['ID=739045da-de08-4bd9-8441-0e750354346e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:30.268527 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa08ffa8-dc05-4276-a7ea-f4ee5621847a admin admin] No DVR routers for this DVR port 739045da-de08-4bd9-8441-0e750354346e on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:25:30.364169 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d24fee4-15ca-4447-b27e-c67492e7e9b4 req-1b2703c3-abaf-4abc-8ed7-982ac79c139c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:30.365631 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9d24fee4-15ca-4447-b27e-c67492e7e9b4 req-1b2703c3-abaf-4abc-8ed7-982ac79c139c service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4946015 Dec 09 21:25:30.400197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48b03e2f-79b5-4567-95d1-174ab80be3a0 req-3bbe39eb-d752-49d8-8af2-50c42a6617f4 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:30.401942 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-48b03e2f-79b5-4567-95d1-174ab80be3a0 req-3bbe39eb-d752-49d8-8af2-50c42a6617f4 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.31 "GET /v2.0/ports?device_id=9012a4aa-4a6a-4b44-b9a8-35264565fa33 HTTP/1.1" status: 200 len: 950 time: 0.1216629 Dec 09 21:25:30.441356 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-055e3733-e7a4-4bb2-bc0b-1405661eefe3 req-affef8b6-8b65-4a60-b667-cd04915629fd tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=c008c358-ebaf-4573-9145-fd2e014057cc HTTP/1.1" status: 200 len: 210 time: 0.1462417 Dec 09 21:25:30.538589 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e529b5d4-f89f-43c5-8e52-68ae6fa62846', 'tag': 'f985bc1a-2e10-4124-b2e9-f8c053c1cf19'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:30.541004 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-53390941-9511-4ee1-96d7-673a97d758d7" -d '{"events": [{"name": "network-changed", "server_uuid": "e529b5d4-f89f-43c5-8e52-68ae6fa62846", "tag": "f985bc1a-2e10-4124-b2e9-f8c053c1cf19"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:30.598949 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-48b03e2f-79b5-4567-95d1-174ab80be3a0 req-5a5d15b7-c234-47e1-9f32-5b5cac691e2f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Deleting port f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:30.599197 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-48b03e2f-79b5-4567-95d1-174ab80be3a0 req-5a5d15b7-c234-47e1-9f32-5b5cac691e2f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:30.636836 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-aa08ffa8-dc05-4276-a7ea-f4ee5621847a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:30.681988 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b89cfabb-ca6b-4749-a09f-fd1af24c5089 req-6fb22e83-d3a5-4395-aa35-ba2d4d1b036b tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:30.688137 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b89cfabb-ca6b-4749-a09f-fd1af24c5089 req-6fb22e83-d3a5-4395-aa35-ba2d4d1b036b tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=a4db25b2-d98a-48fc-bb02-f60ce9fd57ea HTTP/1.1" status: 200 len: 945 time: 0.4176352 Dec 09 21:25:30.724476 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-48b03e2f-79b5-4567-95d1-174ab80be3a0 req-5a5d15b7-c234-47e1-9f32-5b5cac691e2f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] For port f53b5ffa-c2e5-4ee2-84c4-f0439be955b2, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=f53b5ffa-c2e5-4ee2-84c4-f0439be955b2,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:30.725127 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-48b03e2f-79b5-4567-95d1-174ab80be3a0 req-5a5d15b7-c234-47e1-9f32-5b5cac691e2f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:30.744240 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-48b03e2f-79b5-4567-95d1-174ab80be3a0 req-5a5d15b7-c234-47e1-9f32-5b5cac691e2f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Calling delete_port for f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:25:30.747351 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-03d07742-f7f3-4b78-9cdb-6db7951126f5 admin admin] Deleting port 20d7dfe6-d481-4b2c-879f-23bab4173d92 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:30.747897 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03d07742-f7f3-4b78-9cdb-6db7951126f5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:30.759397 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-aa08ffa8-dc05-4276-a7ea-f4ee5621847a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['78764042-44c4-4593-a775-1545766ca91c']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:30.797540 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-aa08ffa8-dc05-4276-a7ea-f4ee5621847a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1acd79aa-cd7a-4fee-a7fc-139e8b6382c5') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:30.797540 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-aa08ffa8-dc05-4276-a7ea-f4ee5621847a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1acd79aa-cd7a-4fee-a7fc-139e8b6382c5') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:30.801483 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edcac7f1-64cc-4b64-9066-405b51d3170f req-ea686b67-c044-49a6-926d-8fb95c4c54d0 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:30.803142 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-edcac7f1-64cc-4b64-9066-405b51d3170f req-ea686b67-c044-49a6-926d-8fb95c4c54d0 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/ports?device_id=9012a4aa-4a6a-4b44-b9a8-35264565fa33 HTTP/1.1" status: 200 len: 950 time: 0.2444866 Dec 09 21:25:30.825323 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-aa08ffa8-dc05-4276-a7ea-f4ee5621847a admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:30.891499 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-aa08ffa8-dc05-4276-a7ea-f4ee5621847a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:30.896070 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-03d07742-f7f3-4b78-9cdb-6db7951126f5 admin admin] For port 20d7dfe6-d481-4b2c-879f-23bab4173d92, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=20d7dfe6-d481-4b2c-879f-23bab4173d92,segment=NetworkSegment(7cdf46cd-1cf9-47c2-bde8-571e75cabe6a),segment_id=7cdf46cd-1cf9-47c2-bde8-571e75cabe6a)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:30.896436 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03d07742-f7f3-4b78-9cdb-6db7951126f5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:30.912240 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b89cfabb-ca6b-4749-a09f-fd1af24c5089 req-673913fb-be0f-4222-8955-6449246201be tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2102873 Dec 09 21:25:30.919638 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-03d07742-f7f3-4b78-9cdb-6db7951126f5 admin admin] Calling delete_port for 20d7dfe6-d481-4b2c-879f-23bab4173d92 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:25:30.927804 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-aa08ffa8-dc05-4276-a7ea-f4ee5621847a admin admin] Releasing vlan 142 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:25:30.928377 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-aa08ffa8-dc05-4276-a7ea-f4ee5621847a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:25:30.930225 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:25:31.021999 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-edcac7f1-64cc-4b64-9066-405b51d3170f req-6064a2a8-6504-4f1f-909d-c2d2ae35d078 tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.13 "GET /v2.0/security-groups?id=50885dec-ee01-4c11-bc49-430c219f37b2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2017469 Dec 09 21:25:31.047957 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f0ebd204-f8fa-4685-b8cc-d0702e738aa7 x-openstack-request-id: req-f0ebd204-f8fa-4685-b8cc-d0702e738aa7 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:31.048228 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e529b5d4-f89f-43c5-8e52-68ae6fa62846", "tag": "f985bc1a-2e10-4124-b2e9-f8c053c1cf19", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:31.048483 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f0ebd204-f8fa-4685-b8cc-d0702e738aa7 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:31.048913 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e529b5d4-f89f-43c5-8e52-68ae6fa62846', 'tag': 'f985bc1a-2e10-4124-b2e9-f8c053c1cf19', 'status': 'completed', 'code': 200} Dec 09 21:25:31.051956 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-48b03e2f-79b5-4567-95d1-174ab80be3a0 req-5a5d15b7-c234-47e1-9f32-5b5cac691e2f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:31.063072 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-aa08ffa8-dc05-4276-a7ea-f4ee5621847a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:31.069353 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['f53b5ffa-c2e5-4ee2-84c4-f0439be955b2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:25:31.074752 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-65ab16a8-f34f-4d87-8393-92a018a54837 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 39a4e9cb-cd4f-4df2-9c02-6776529dc801 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:31.081460 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-aa08ffa8-dc05-4276-a7ea-f4ee5621847a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:31.085101 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-aa08ffa8-dc05-4276-a7ea-f4ee5621847a admin admin] 10.222.0.13 "DELETE /v2.0/networks/78764042-44c4-4593-a775-1545766ca91c HTTP/1.1" status: 204 len: 168 time: 2.5336964 Dec 09 21:25:31.125569 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-65ab16a8-f34f-4d87-8393-92a018a54837 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:31.134785 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa08ffa8-dc05-4276-a7ea-f4ee5621847a admin admin] Pushing event deleted for resources: {'Network': ['ID=78764042-44c4-4593-a775-1545766ca91c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:31.156320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a5d15b7-c234-47e1-9f32-5b5cac691e2f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Pushing event deleted for resources: {'Port': ['ID=f53b5ffa-c2e5-4ee2-84c4-f0439be955b2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:31.175727 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-65ab16a8-f34f-4d87-8393-92a018a54837 service neutron] Transition to ACTIVE for port object 39a4e9cb-cd4f-4df2-9c02-6776529dc801 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:25:31.215186 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-65ab16a8-f34f-4d87-8393-92a018a54837 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:31.223221 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-48b03e2f-79b5-4567-95d1-174ab80be3a0 req-5a5d15b7-c234-47e1-9f32-5b5cac691e2f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] No DVR routers for this DVR port f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:25:31.227932 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-48b03e2f-79b5-4567-95d1-174ab80be3a0 req-5a5d15b7-c234-47e1-9f32-5b5cac691e2f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:31.231943 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-48b03e2f-79b5-4567-95d1-174ab80be3a0 req-5a5d15b7-c234-47e1-9f32-5b5cac691e2f tempest-ServersAdminNegativeTestJSON-49113699 tempest-ServersAdminNegativeTestJSON-49113699-project] 10.222.0.31 "DELETE /v2.0/ports/f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 HTTP/1.1" status: 204 len: 173 time: 0.8219748 Dec 09 21:25:31.232584 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9012a4aa-4a6a-4b44-b9a8-35264565fa33', 'name': 'network-vif-deleted', 'tag': 'f53b5ffa-c2e5-4ee2-84c4-f0439be955b2'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:31.235050 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b9043609-c1c5-45ba-acdd-fbf6e23c4f09" -d '{"events": [{"server_uuid": "9012a4aa-4a6a-4b44-b9a8-35264565fa33", "name": "network-vif-deleted", "tag": "f53b5ffa-c2e5-4ee2-84c4-f0439be955b2"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:31.245771 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53390941-9511-4ee1-96d7-673a97d758d7 req-16daf9c0-b841-4f35-99b5-152baba2b0b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:31.246557 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53390941-9511-4ee1-96d7-673a97d758d7 req-16daf9c0-b841-4f35-99b5-152baba2b0b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:31.247274 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53390941-9511-4ee1-96d7-673a97d758d7 req-16daf9c0-b841-4f35-99b5-152baba2b0b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:31.249643 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-53390941-9511-4ee1-96d7-673a97d758d7 req-16daf9c0-b841-4f35-99b5-152baba2b0b2 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=73812a0c336d4768b029fd6459a1ae9e&device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 2800 time: 0.1588507 Dec 09 21:25:31.277223 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37400) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:31.345815 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b48da03e-00fe-4632-ab6f-bc6cfcd99631 req-5317f141-ebbb-4139-89b4-688d6efda0df tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:31.353613 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b48da03e-00fe-4632-ab6f-bc6cfcd99631 req-5317f141-ebbb-4139-89b4-688d6efda0df tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:31.362514 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b48da03e-00fe-4632-ab6f-bc6cfcd99631 req-5317f141-ebbb-4139-89b4-688d6efda0df tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:31.371603 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b48da03e-00fe-4632-ab6f-bc6cfcd99631 req-5317f141-ebbb-4139-89b4-688d6efda0df tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 2412 time: 0.1905980 Dec 09 21:25:31.373749 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-77a37228-637a-425d-93bb-5c2eeedfb79b x-openstack-request-id: req-77a37228-637a-425d-93bb-5c2eeedfb79b {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:31.374606 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65ab16a8-f34f-4d87-8393-92a018a54837 service neutron] Pushing event updated for resources: {'Port': ['ID=39a4e9cb-cd4f-4df2-9c02-6776529dc801,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:31.374859 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9012a4aa-4a6a-4b44-b9a8-35264565fa33", "name": "network-vif-deleted", "tag": "f53b5ffa-c2e5-4ee2-84c4-f0439be955b2", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:31.375281 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-77a37228-637a-425d-93bb-5c2eeedfb79b {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:31.375887 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9012a4aa-4a6a-4b44-b9a8-35264565fa33', 'name': 'network-vif-deleted', 'tag': 'f53b5ffa-c2e5-4ee2-84c4-f0439be955b2', 'status': 'completed', 'code': 200} Dec 09 21:25:31.490011 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-86198014-c24e-4c8e-b581-d5cb71814354 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=6133c356707e42408885bbdcb5f67413&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2115512 Dec 09 21:25:31.491062 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03d07742-f7f3-4b78-9cdb-6db7951126f5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:31.493903 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37406) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:31.503035 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b48da03e-00fe-4632-ab6f-bc6cfcd99631 req-dbad5e22-25e5-4ff6-b002-17359e0e7165 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1243989 Dec 09 21:25:31.520557 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-65ab16a8-f34f-4d87-8393-92a018a54837 service neutron] Attempting to bind port 39a4e9cb-cd4f-4df2-9c02-6776529dc801 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:25:31.520893 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-65ab16a8-f34f-4d87-8393-92a018a54837 service neutron] Attempting to bind port 39a4e9cb-cd4f-4df2-9c02-6776529dc801 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '3e23a057-7b71-4625-891b-f66fd33737f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '6a0b092d-9731-4bc3-9661-8d5436bc9f71'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:25:31.521277 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-65ab16a8-f34f-4d87-8393-92a018a54837 service neutron] Attempting to bind port 39a4e9cb-cd4f-4df2-9c02-6776529dc801 on network 6a0b092d-9731-4bc3-9661-8d5436bc9f71 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:31.527770 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-65ab16a8-f34f-4d87-8393-92a018a54837 service neutron] Port 39a4e9cb-cd4f-4df2-9c02-6776529dc801 on network 6a0b092d-9731-4bc3-9661-8d5436bc9f71 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:25:31.528025 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-65ab16a8-f34f-4d87-8393-92a018a54837 service neutron] Attempting to bind port 39a4e9cb-cd4f-4df2-9c02-6776529dc801 on network 6a0b092d-9731-4bc3-9661-8d5436bc9f71 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:31.534295 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-65ab16a8-f34f-4d87-8393-92a018a54837 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 25, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:25:31.534647 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-65ab16a8-f34f-4d87-8393-92a018a54837 service neutron] Checking segment: {'id': '3e23a057-7b71-4625-891b-f66fd33737f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '6a0b092d-9731-4bc3-9661-8d5436bc9f71'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:25:31.535036 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-65ab16a8-f34f-4d87-8393-92a018a54837 service neutron] Bound using segment: {'id': '3e23a057-7b71-4625-891b-f66fd33737f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '6a0b092d-9731-4bc3-9661-8d5436bc9f71'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:25:31.535482 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-65ab16a8-f34f-4d87-8393-92a018a54837 service neutron] Bound port: 39a4e9cb-cd4f-4df2-9c02-6776529dc801, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3e23a057-7b71-4625-891b-f66fd33737f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '6a0b092d-9731-4bc3-9661-8d5436bc9f71'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:25:31.535901 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-65ab16a8-f34f-4d87-8393-92a018a54837 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:31.566451 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03d07742-f7f3-4b78-9cdb-6db7951126f5 admin admin] Pushing event deleted for resources: {'Port': ['ID=20d7dfe6-d481-4b2c-879f-23bab4173d92,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:31.642871 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53390941-9511-4ee1-96d7-673a97d758d7 req-02dbd0a4-9422-469e-8587-d8cc89da05f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:31.643358 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53390941-9511-4ee1-96d7-673a97d758d7 req-02dbd0a4-9422-469e-8587-d8cc89da05f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:31.644232 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53390941-9511-4ee1-96d7-673a97d758d7 req-02dbd0a4-9422-469e-8587-d8cc89da05f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:31.646197 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-53390941-9511-4ee1-96d7-673a97d758d7 req-02dbd0a4-9422-469e-8587-d8cc89da05f4 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=73812a0c336d4768b029fd6459a1ae9e&shared=False HTTP/1.1" status: 200 len: 2290 time: 0.3855126 Dec 09 21:25:32.009582 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8e2ac3e7-e003-4f39-a783-a1843ece2b3e req-64f57fce-16d3-432d-a789-93f943aebb0b tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=c008c358-ebaf-4573-9145-fd2e014057cc HTTP/1.1" status: 200 len: 210 time: 0.4156368 Dec 09 21:25:32.026911 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-38ef3f07-de09-4478-b3fe-8b410d9cd6e6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:32.030329 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53390941-9511-4ee1-96d7-673a97d758d7 req-852e70dd-6407-4f97-aac8-6d1055a783f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:32.031945 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-53390941-9511-4ee1-96d7-673a97d758d7 req-852e70dd-6407-4f97-aac8-6d1055a783f8 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3506920 Dec 09 21:25:32.032367 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-65ab16a8-f34f-4d87-8393-92a018a54837 service neutron] For port 39a4e9cb-cd4f-4df2-9c02-6776529dc801, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:25:32.040667 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-65ab16a8-f34f-4d87-8393-92a018a54837 service neutron] For port 39a4e9cb-cd4f-4df2-9c02-6776529dc801, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=39a4e9cb-cd4f-4df2-9c02-6776529dc801,segment=NetworkSegment(3e23a057-7b71-4625-891b-f66fd33737f2),segment_id=3e23a057-7b71-4625-891b-f66fd33737f2)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:25:32.054204 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-65ab16a8-f34f-4d87-8393-92a018a54837 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:32.078175 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-38ef3f07-de09-4478-b3fe-8b410d9cd6e6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:32.089832 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-43309cc8-915f-4adb-bf42-be54ef363cd4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:32.091546 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-43309cc8-915f-4adb-bf42-be54ef363cd4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.31 "GET /v2.0/networks?id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb HTTP/1.1" status: 200 len: 812 time: 0.5026727 Dec 09 21:25:32.105770 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-65ab16a8-f34f-4d87-8393-92a018a54837 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:32.106812 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-65ab16a8-f34f-4d87-8393-92a018a54837 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:32.107863 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-65ab16a8-f34f-4d87-8393-92a018a54837 service neutron] 10.222.0.31 "PUT /v2.0/ports/39a4e9cb-cd4f-4df2-9c02-6776529dc801 HTTP/1.1" status: 200 len: 1093 time: 2.0931745 Dec 09 21:25:32.133515 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-72dac009-8933-4715-bb57-3d0ea975cc34 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Request body: {'port': {'device_id': 'c008c358-ebaf-4573-9145-fd2e014057cc', 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb', 'admin_state_up': True, 'tenant_id': '1b7916b634f74760a565cfeaef510cd9'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:32.151947 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967b33b5-8f47-4cc0-9214-eb60eb8c86f5 req-ae72ddbb-ab4a-45a9-b95c-118fadd6c7ae tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:32.158095 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-967b33b5-8f47-4cc0-9214-eb60eb8c86f5 req-ae72ddbb-ab4a-45a9-b95c-118fadd6c7ae tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=a4db25b2-d98a-48fc-bb02-f60ce9fd57ea HTTP/1.1" status: 200 len: 945 time: 0.1103435 Dec 09 21:25:32.167178 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65ab16a8-f34f-4d87-8393-92a018a54837 service neutron] Pushing event updated for resources: {'Port': ['ID=39a4e9cb-cd4f-4df2-9c02-6776529dc801,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:32.234488 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03d07742-f7f3-4b78-9cdb-6db7951126f5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:32.257468 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-967b33b5-8f47-4cc0-9214-eb60eb8c86f5 req-8c04bb41-3269-4109-a11a-7e2f6abedbd1 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0828640 Dec 09 21:25:32.265133 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-1956e50d-8b7a-4deb-b5b4-05387b5a174b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:32.266070 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-1956e50d-8b7a-4deb-b5b4-05387b5a174b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:32.266591 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-1956e50d-8b7a-4deb-b5b4-05387b5a174b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:32.268454 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-1956e50d-8b7a-4deb-b5b4-05387b5a174b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=73812a0c336d4768b029fd6459a1ae9e&device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 2868 time: 0.1087987 Dec 09 21:25:32.332003 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-38ef3f07-de09-4478-b3fe-8b410d9cd6e6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:32.338735 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-38ef3f07-de09-4478-b3fe-8b410d9cd6e6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:32.340264 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-38ef3f07-de09-4478-b3fe-8b410d9cd6e6 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/235b4b94-ef9b-4160-b058-7d1ee5628dff HTTP/1.1" status: 204 len: 168 time: 0.8412080 Dec 09 21:25:32.348132 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-d04d9628-b503-43e1-84f2-f1098aac693a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=19.80.0.16&port_id=be89ffc7-e26a-4049-9372-9a434624cba7 HTTP/1.1" status: 200 len: 217 time: 0.0601139 Dec 09 21:25:32.379138 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38ef3f07-de09-4478-b3fe-8b410d9cd6e6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=235b4b94-ef9b-4160-b058-7d1ee5628dff,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:32.435858 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-37bf2c4a-b163-432f-aff7-f6d487ca2b69 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:32.438041 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-37bf2c4a-b163-432f-aff7-f6d487ca2b69 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=c9ca5636-e2f1-4aee-84ec-4054f1a18361 HTTP/1.1" status: 200 len: 801 time: 0.0825901 Dec 09 21:25:32.463845 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-72dac009-8933-4715-bb57-3d0ea975cc34 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Made reservation on behalf of 1b7916b634f74760a565cfeaef510cd9 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:25:32.469182 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-72dac009-8933-4715-bb57-3d0ea975cc34 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:32.555770 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-658ce8e8-e5ac-4b84-b9c9-33a69c40c2d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:32.559584 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-658ce8e8-e5ac-4b84-b9c9-33a69c40c2d8 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=6a0b092d-9731-4bc3-9661-8d5436bc9f71&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1110425 Dec 09 21:25:32.718332 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37430) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:32.733118 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-03d07742-f7f3-4b78-9cdb-6db7951126f5 admin admin] Router d9739f4a-16b6-4e7e-8a7e-71716eacbe2d has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:25:32.739535 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-e777b38a-37c2-4916-ba81-04354cbd24cb service neutron] 10.222.0.31 "GET /v2.0/networks/6a0b092d-9731-4bc3-9661-8d5436bc9f71?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1738617 Dec 09 21:25:32.743564 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-72dac009-8933-4715-bb57-3d0ea975cc34 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Allocated IP 172.20.0.12 (43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb/50496955-1646-4079-acd4-a47e8cd175cb/151030b5-c66b-4f22-a8fc-9aceb1635009) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:25:32.754110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eed7e536-843a-4df0-a44f-eb21fa627ccf req-153e2664-5714-4643-8f94-d1e783a40e94 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:32.760258 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eed7e536-843a-4df0-a44f-eb21fa627ccf req-153e2664-5714-4643-8f94-d1e783a40e94 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:32.766815 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eed7e536-843a-4df0-a44f-eb21fa627ccf req-153e2664-5714-4643-8f94-d1e783a40e94 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:32.774264 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eed7e536-843a-4df0-a44f-eb21fa627ccf req-153e2664-5714-4643-8f94-d1e783a40e94 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 2412 time: 0.1269474 Dec 09 21:25:32.811103 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddb7af75-69c8-47f8-836f-024406896e17 req-80065ef9-2c90-4678-8bfd-6dddad321dbe tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:32.818923 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ddb7af75-69c8-47f8-836f-024406896e17 req-80065ef9-2c90-4678-8bfd-6dddad321dbe tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=a4db25b2-d98a-48fc-bb02-f60ce9fd57ea HTTP/1.1" status: 200 len: 945 time: 0.1704271 Dec 09 21:25:32.879517 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-03d07742-f7f3-4b78-9cdb-6db7951126f5 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:25:32.888927 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-03d07742-f7f3-4b78-9cdb-6db7951126f5 admin admin] 10.222.0.13 "PUT /v2.0/routers/d9739f4a-16b6-4e7e-8a7e-71716eacbe2d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.4971604 Dec 09 21:25:32.889683 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37440) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:32.892714 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e69709a4-2abb-42f2-ab49-5fef6d2658d0 None None] Sync routers for ids ['d9739f4a-16b6-4e7e-8a7e-71716eacbe2d'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:25:32.928931 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e69709a4-2abb-42f2-ab49-5fef6d2658d0 None None] Routers {'d9739f4a-16b6-4e7e-8a7e-71716eacbe2d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:25:32.933071 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e69709a4-2abb-42f2-ab49-5fef6d2658d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:25:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['d9739f4a-16b6-4e7e-8a7e-71716eacbe2d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:32.933440 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eed7e536-843a-4df0-a44f-eb21fa627ccf req-3fb67e12-b486-4cf3-b291-135d1f70b49b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1531947 Dec 09 21:25:32.949897 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8f326581-e3e4-4d27-9407-7918abcaa963 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:32.964065 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ddb7af75-69c8-47f8-836f-024406896e17 req-c89cbab1-1743-4fea-bb39-22c604007ed4 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1442647 Dec 09 21:25:32.981579 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-8f22b3ae-bd24-45bb-85c4-5b814fb72958 service neutron] 10.222.0.31 "GET /v2.0/networks/6a0b092d-9731-4bc3-9661-8d5436bc9f71?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2042406 Dec 09 21:25:33.049229 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-f7aea18f-3d5c-428a-ad50-2cebfc74bc93 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=19.86.0.113&port_id=f985bc1a-2e10-4124-b2e9-f8c053c1cf19 HTTP/1.1" status: 200 len: 217 time: 0.0540721 Dec 09 21:25:33.049936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e529b5d4-f89f-43c5-8e52-68ae6fa62846', 'tag': '39a4e9cb-cd4f-4df2-9c02-6776529dc801'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:33.053352 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a28da5aa-9d87-49fe-9397-c612e541c68e" -d '{"events": [{"name": "network-changed", "server_uuid": "e529b5d4-f89f-43c5-8e52-68ae6fa62846", "tag": "39a4e9cb-cd4f-4df2-9c02-6776529dc801"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:33.058708 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-e69709a4-2abb-42f2-ab49-5fef6d2658d0 None None] Set router d9739f4a-16b6-4e7e-8a7e-71716eacbe2d gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:25:33.086038 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-72dac009-8933-4715-bb57-3d0ea975cc34 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:33.128843 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-38369067-b0f3-484d-b356-0a924511ed00 x-openstack-request-id: req-38369067-b0f3-484d-b356-0a924511ed00 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:33.129721 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e529b5d4-f89f-43c5-8e52-68ae6fa62846", "tag": "39a4e9cb-cd4f-4df2-9c02-6776529dc801", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:33.130071 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-38369067-b0f3-484d-b356-0a924511ed00 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:33.131320 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e529b5d4-f89f-43c5-8e52-68ae6fa62846', 'tag': '39a4e9cb-cd4f-4df2-9c02-6776529dc801', 'status': 'completed', 'code': 200} Dec 09 21:25:33.133441 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-72dac009-8933-4715-bb57-3d0ea975cc34 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:33.167829 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-25e4db10-ac37-4907-b86a-77453c134a65 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:33.169985 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-25e4db10-ac37-4907-b86a-77453c134a65 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=f4a2d786-583b-4e8b-9946-37b7ed5fd3e8 HTTP/1.1" status: 200 len: 801 time: 0.0991859 Dec 09 21:25:33.178500 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fd6300ea-7c68-4888-9f9f-fd415b60341c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=3329fed690514d85b98adeb6691d89f2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4589376 Dec 09 21:25:33.189668 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37450) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:33.213920 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-72dac009-8933-4715-bb57-3d0ea975cc34 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:25:33.223249 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-72dac009-8933-4715-bb57-3d0ea975cc34 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:33.254212 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-72dac009-8933-4715-bb57-3d0ea975cc34 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:25:33.293945 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5f2b7f2-37d8-49ab-b9c8-675f496ac934 req-54dc4358-c15f-461a-8e69-03499138c545 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:33.299213 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e69709a4-2abb-42f2-ab49-5fef6d2658d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9739f4a-16b6-4e7e-8a7e-71716eacbe2d', 'name': 'tempest-FloatingIPDetailsTestJSON-407064217-router', 'tenant_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.86'}], 'enable_snat': True}, 'gw_port_id': 'b850be71-e07d-41b3-a3f1-34aa5c56525f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:32Z', 'updated_at': '2021-12-09T21:25:31Z', 'revision_number': 5, 'project_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'gw_port': {'id': 'b850be71-e07d-41b3-a3f1-34aa5c56525f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:2a:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9739f4a-16b6-4e7e-8a7e-71716eacbe2d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 807, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:33Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:33.309269 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c5f2b7f2-37d8-49ab-b9c8-675f496ac934 req-54dc4358-c15f-461a-8e69-03499138c545 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=c008c358-ebaf-4573-9145-fd2e014057cc HTTP/1.1" status: 200 len: 932 time: 0.1759899 Dec 09 21:25:33.331972 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-0651f789-e460-4edb-8e49-15b9e2bf7f30 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:33.334160 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-0651f789-e460-4edb-8e49-15b9e2bf7f30 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=c8e08369-5b79-4a41-a5f9-0059632e26cd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.1454473 Dec 09 21:25:33.340544 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e69709a4-2abb-42f2-ab49-5fef6d2658d0 None None] Checking router: d9739f4a-16b6-4e7e-8a7e-71716eacbe2d for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:25:33.351077 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e69709a4-2abb-42f2-ab49-5fef6d2658d0 None None] Routers {'d9739f4a-16b6-4e7e-8a7e-71716eacbe2d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:25:33.352056 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e69709a4-2abb-42f2-ab49-5fef6d2658d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:25:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['d9739f4a-16b6-4e7e-8a7e-71716eacbe2d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:33.415069 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6b553c0-2e73-4612-a10d-e95137e97591 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:33.449385 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c5f2b7f2-37d8-49ab-b9c8-675f496ac934 req-4d2c3aeb-4a8c-40eb-98f7-f0531e93ad25 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1456738 Dec 09 21:25:33.503671 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-e69709a4-2abb-42f2-ab49-5fef6d2658d0 None None] Set router d9739f4a-16b6-4e7e-8a7e-71716eacbe2d gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:25:33.514816 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6b553c0-2e73-4612-a10d-e95137e97591 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:33.565239 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-26899262-4c69-4ab8-8f8c-448e22ea5c6e service neutron] 10.222.0.31 "GET /v2.0/networks/c8e08369-5b79-4a41-a5f9-0059632e26cd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2195935 Dec 09 21:25:33.653326 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6b553c0-2e73-4612-a10d-e95137e97591 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:33.655675 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6b553c0-2e73-4612-a10d-e95137e97591 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:33.656831 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d6b553c0-2e73-4612-a10d-e95137e97591 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/50885dec-ee01-4c11-bc49-430c219f37b2 HTTP/1.1" status: 204 len: 168 time: 0.4648938 Dec 09 21:25:33.667894 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6b553c0-2e73-4612-a10d-e95137e97591 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=50885dec-ee01-4c11-bc49-430c219f37b2,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:33.683297 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6b553c0-2e73-4612-a10d-e95137e97591 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:33.683618 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6b553c0-2e73-4612-a10d-e95137e97591 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:33.683960 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6b553c0-2e73-4612-a10d-e95137e97591 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:33.684293 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6b553c0-2e73-4612-a10d-e95137e97591 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:33.684780 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6b553c0-2e73-4612-a10d-e95137e97591 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:33.685114 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6b553c0-2e73-4612-a10d-e95137e97591 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:33.685438 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6b553c0-2e73-4612-a10d-e95137e97591 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:33.686346 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6b553c0-2e73-4612-a10d-e95137e97591 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:33.686346 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6b553c0-2e73-4612-a10d-e95137e97591 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:33.686564 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6b553c0-2e73-4612-a10d-e95137e97591 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:33.686678 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6b553c0-2e73-4612-a10d-e95137e97591 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:33.687054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6b553c0-2e73-4612-a10d-e95137e97591 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:33.687541 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6b553c0-2e73-4612-a10d-e95137e97591 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:33.718708 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-5f86e663-a1c0-4331-8548-25f4cb5592d2 service neutron] 10.222.0.31 "GET /v2.0/networks/c8e08369-5b79-4a41-a5f9-0059632e26cd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1437035 Dec 09 21:25:33.732451 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-72dac009-8933-4715-bb57-3d0ea975cc34 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:33.733113 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-72dac009-8933-4715-bb57-3d0ea975cc34 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:33.748250 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72dac009-8933-4715-bb57-3d0ea975cc34 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Pushing event updated for resources: {'Port': ['ID=151030b5-c66b-4f22-a8fc-9aceb1635009,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:33.757936 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9c9477df-67d7-4525-a705-4e394486ae5b admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:33.768256 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e69709a4-2abb-42f2-ab49-5fef6d2658d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9739f4a-16b6-4e7e-8a7e-71716eacbe2d', 'name': 'tempest-FloatingIPDetailsTestJSON-407064217-router', 'tenant_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.86'}], 'enable_snat': True}, 'gw_port_id': 'b850be71-e07d-41b3-a3f1-34aa5c56525f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:32Z', 'updated_at': '2021-12-09T21:25:31Z', 'revision_number': 5, 'project_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'gw_port': {'id': 'b850be71-e07d-41b3-a3f1-34aa5c56525f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:2a:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9739f4a-16b6-4e7e-8a7e-71716eacbe2d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 807, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:33Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:33.812475 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-7052c3dc-3a1d-416f-9eab-f27d7f9c88d5 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=19.80.0.232&port_id=39a4e9cb-cd4f-4df2-9c02-6776529dc801 HTTP/1.1" status: 200 len: 217 time: 0.0805798 Dec 09 21:25:33.814786 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-72dac009-8933-4715-bb57-3d0ea975cc34 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.7113645 Dec 09 21:25:33.838294 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e69709a4-2abb-42f2-ab49-5fef6d2658d0 None None] The sync data for ids ['d9739f4a-16b6-4e7e-8a7e-71716eacbe2d'] in n-d-713301-27 is: [{'id': 'd9739f4a-16b6-4e7e-8a7e-71716eacbe2d', 'name': 'tempest-FloatingIPDetailsTestJSON-407064217-router', 'tenant_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.86'}], 'enable_snat': True}, 'gw_port_id': 'b850be71-e07d-41b3-a3f1-34aa5c56525f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:32Z', 'updated_at': '2021-12-09T21:25:31Z', 'revision_number': 5, 'project_id': 'df9831f9ad4847c8afaf37f22e8d18a9', 'gw_port': {'id': 'b850be71-e07d-41b3-a3f1-34aa5c56525f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:8d:2a:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9739f4a-16b6-4e7e-8a7e-71716eacbe2d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 807, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:33Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:25:33.860050 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-ce1e5d20-bae6-4e96-adb4-b8f525431438 service neutron] Request body: {'port': {'device_id': 'c008c358-ebaf-4573-9145-fd2e014057cc', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:33.909562 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-5e187c66-929b-44e6-9028-289e406d4bf1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:33.912826 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-5e187c66-929b-44e6-9028-289e406d4bf1 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=c9ca5636-e2f1-4aee-84ec-4054f1a18361 HTTP/1.1" status: 200 len: 801 time: 0.0766110 Dec 09 21:25:33.985450 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-c2aaa030-4973-4540-b5da-cd5e30f76f2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:33.987285 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9c9477df-67d7-4525-a705-4e394486ae5b admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:33.987533 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-c2aaa030-4973-4540-b5da-cd5e30f76f2a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=6a0b092d-9731-4bc3-9661-8d5436bc9f71&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0627475 Dec 09 21:25:33.994145 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-ce1e5d20-bae6-4e96-adb4-b8f525431438 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:34.065945 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6d245d9-cd29-4c9e-8b90-fadbc9b85b73 req-07b345c1-820b-4799-9c50-a0f0d52fc24a tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:34.067474 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b6d245d9-cd29-4c9e-8b90-fadbc9b85b73 req-07b345c1-820b-4799-9c50-a0f0d52fc24a tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.31 "GET /v2.0/ports?device_id=a4db25b2-d98a-48fc-bb02-f60ce9fd57ea HTTP/1.1" status: 200 len: 945 time: 0.1434295 Dec 09 21:25:34.197071 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6828443-9dc9-45d4-ab61-2df68cd955c7 req-4e8ebec6-1001-4669-8531-7ff76e10288f tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:34.203187 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6828443-9dc9-45d4-ab61-2df68cd955c7 req-4e8ebec6-1001-4669-8531-7ff76e10288f tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:34.209732 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6828443-9dc9-45d4-ab61-2df68cd955c7 req-4e8ebec6-1001-4669-8531-7ff76e10288f tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:34.216729 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d6828443-9dc9-45d4-ab61-2df68cd955c7 req-4e8ebec6-1001-4669-8531-7ff76e10288f tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 2412 time: 0.1765213 Dec 09 21:25:34.227603 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-593a32a3-182f-4296-9298-f73dad1cbc19 req-5ed47dc8-fe56-4684-a7b4-78e85e6e9541 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:34.229178 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-593a32a3-182f-4296-9298-f73dad1cbc19 req-5ed47dc8-fe56-4684-a7b4-78e85e6e9541 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=a4db25b2-d98a-48fc-bb02-f60ce9fd57ea HTTP/1.1" status: 200 len: 945 time: 0.1208587 Dec 09 21:25:34.229572 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-9c9477df-67d7-4525-a705-4e394486ae5b admin admin] Deleting port b850be71-e07d-41b3-a3f1-34aa5c56525f {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:34.230472 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9c9477df-67d7-4525-a705-4e394486ae5b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:34.233534 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-80719728-20b1-40af-b21c-e831e50ecbf5 service neutron] 10.222.0.31 "GET /v2.0/networks/6a0b092d-9731-4bc3-9661-8d5436bc9f71?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2346363 Dec 09 21:25:34.350147 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37510) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:34.382291 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37512) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:34.412044 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d6828443-9dc9-45d4-ab61-2df68cd955c7 req-cae6fe25-99e9-4408-a855-6ef86ef0fab2 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1662610 Dec 09 21:25:34.439859 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-593a32a3-182f-4296-9298-f73dad1cbc19 req-08d1cbde-b534-4b97-a806-38f89600bd5a tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups?id=47e50f10-7095-4f13-aafe-6bb7c79987c2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1963863 Dec 09 21:25:34.460570 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89fea243-6e50-44e4-b2f7-2e7be2d44a59 req-041a5347-ea2b-466d-85dc-62871a8eec45 service neutron] 10.222.0.31 "GET /v2.0/networks/6a0b092d-9731-4bc3-9661-8d5436bc9f71?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2160170 Dec 09 21:25:34.497464 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-9c9477df-67d7-4525-a705-4e394486ae5b admin admin] For port b850be71-e07d-41b3-a3f1-34aa5c56525f, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b850be71-e07d-41b3-a3f1-34aa5c56525f,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:34.497829 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9c9477df-67d7-4525-a705-4e394486ae5b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:34.502160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-b6d245d9-cd29-4c9e-8b90-fadbc9b85b73 req-f86bc09a-b1d1-42cd-8670-b4f38782469e tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Deleting port e8d231bb-9904-4e89-9b95-5135aca6fb1d {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:34.502481 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b6d245d9-cd29-4c9e-8b90-fadbc9b85b73 req-f86bc09a-b1d1-42cd-8670-b4f38782469e tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:34.550204 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-9c9477df-67d7-4525-a705-4e394486ae5b admin admin] Calling delete_port for b850be71-e07d-41b3-a3f1-34aa5c56525f owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:25:34.658370 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a28da5aa-9d87-49fe-9397-c612e541c68e req-7185e4b8-067d-4196-a5ed-7d9d7fe2bcea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:34.658859 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a28da5aa-9d87-49fe-9397-c612e541c68e req-7185e4b8-067d-4196-a5ed-7d9d7fe2bcea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:34.659331 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a28da5aa-9d87-49fe-9397-c612e541c68e req-7185e4b8-067d-4196-a5ed-7d9d7fe2bcea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:34.661038 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a28da5aa-9d87-49fe-9397-c612e541c68e req-7185e4b8-067d-4196-a5ed-7d9d7fe2bcea service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=73812a0c336d4768b029fd6459a1ae9e&device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 2868 time: 0.1377373 Dec 09 21:25:34.662968 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a99d7831-24db-4bab-9ef0-e62e549a79ce admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:34.678246 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-04e560de-f976-4b1c-9f08-c1aa5e672812 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=6b8ced3e956c4ac5b1af282546b7e7fb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3228602 Dec 09 21:25:34.685259 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37522) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:34.688247 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47747f19-5a32-443f-a8ea-9d68cf5fc092 req-d21a4386-f125-49c0-867b-e097fdfcf025 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:34.689746 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-47747f19-5a32-443f-a8ea-9d68cf5fc092 req-d21a4386-f125-49c0-867b-e097fdfcf025 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=c008c358-ebaf-4573-9145-fd2e014057cc HTTP/1.1" status: 200 len: 932 time: 0.1220849 Dec 09 21:25:34.737202 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:25:34.747595 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-ce1e5d20-bae6-4e96-adb4-b8f525431438 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 151030b5-c66b-4f22-a8fc-9aceb1635009 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:34.764491 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:25:34.765096 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device f53b5ffa-c2e5-4ee2-84c4-f0439be955b2 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:25:34.775019 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-ce1e5d20-bae6-4e96-adb4-b8f525431438 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:34.783356 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-b6d245d9-cd29-4c9e-8b90-fadbc9b85b73 req-f86bc09a-b1d1-42cd-8670-b4f38782469e tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] For port e8d231bb-9904-4e89-9b95-5135aca6fb1d, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e8d231bb-9904-4e89-9b95-5135aca6fb1d,segment=NetworkSegment(77d1b765-2404-4dd1-ab6e-956ebecc3e04),segment_id=77d1b765-2404-4dd1-ab6e-956ebecc3e04)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:34.783754 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b6d245d9-cd29-4c9e-8b90-fadbc9b85b73 req-f86bc09a-b1d1-42cd-8670-b4f38782469e tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:34.838577 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-b6d245d9-cd29-4c9e-8b90-fadbc9b85b73 req-f86bc09a-b1d1-42cd-8670-b4f38782469e tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Calling delete_port for e8d231bb-9904-4e89-9b95-5135aca6fb1d owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:25:34.839957 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-47747f19-5a32-443f-a8ea-9d68cf5fc092 req-0683717e-f78d-4409-9a19-db2bd0cf09fb tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1338148 Dec 09 21:25:34.850648 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-ce1e5d20-bae6-4e96-adb4-b8f525431438 service neutron] Transition to ACTIVE for port object 151030b5-c66b-4f22-a8fc-9aceb1635009 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:25:34.858428 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a28da5aa-9d87-49fe-9397-c612e541c68e req-e92c2cfd-42f8-444d-9a1a-78b34658aad4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:34.860149 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a28da5aa-9d87-49fe-9397-c612e541c68e req-e92c2cfd-42f8-444d-9a1a-78b34658aad4 service neutron] 10.222.0.31 "GET /v2.0/networks?id=6a0b092d-9731-4bc3-9661-8d5436bc9f71 HTTP/1.1" status: 200 len: 902 time: 0.1875029 Dec 09 21:25:34.866125 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-ce1e5d20-bae6-4e96-adb4-b8f525431438 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:34.917085 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a28da5aa-9d87-49fe-9397-c612e541c68e req-cb6d08ce-fb2c-42e8-acae-71452e213025 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=19.80.0.232&port_id=39a4e9cb-cd4f-4df2-9c02-6776529dc801 HTTP/1.1" status: 200 len: 217 time: 0.0438604 Dec 09 21:25:34.919215 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a99d7831-24db-4bab-9ef0-e62e549a79ce admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:34.924311 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a99d7831-24db-4bab-9ef0-e62e549a79ce admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:34.943178 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0391af30-780a-4843-9849-548314904788 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:35.008005 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a99d7831-24db-4bab-9ef0-e62e549a79ce admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9d3bf4f0-5b40-4ad6-bbaf-049106f412e2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:35.014700 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a99d7831-24db-4bab-9ef0-e62e549a79ce admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=0e23c0aefcb747ec8079cf0b86256351&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6251478 Dec 09 21:25:35.018880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37524) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:35.024032 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0391af30-780a-4843-9849-548314904788 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:35.028854 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a28da5aa-9d87-49fe-9397-c612e541c68e req-b209979b-5732-43c3-9e49-9ae2f48c9e30 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:35.029005 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce1e5d20-bae6-4e96-adb4-b8f525431438 service neutron] Pushing event updated for resources: {'Port': ['ID=151030b5-c66b-4f22-a8fc-9aceb1635009,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:35.030147 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a28da5aa-9d87-49fe-9397-c612e541c68e req-b209979b-5732-43c3-9e49-9ae2f48c9e30 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=c9ca5636-e2f1-4aee-84ec-4054f1a18361 HTTP/1.1" status: 200 len: 801 time: 0.1014683 Dec 09 21:25:35.104157 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a28da5aa-9d87-49fe-9397-c612e541c68e req-4f6f0475-e1c4-49fc-b1d0-7b6b30a14f17 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:35.105681 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a28da5aa-9d87-49fe-9397-c612e541c68e req-4f6f0475-e1c4-49fc-b1d0-7b6b30a14f17 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=6a0b092d-9731-4bc3-9661-8d5436bc9f71&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0656242 Dec 09 21:25:35.108816 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-49ff2091-18b7-4f1a-8f23-a9dc96e7f9be admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:35.121294 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9c9477df-67d7-4525-a705-4e394486ae5b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:35.155595 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-49ff2091-18b7-4f1a-8f23-a9dc96e7f9be admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:35.161840 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c9477df-67d7-4525-a705-4e394486ae5b admin admin] Pushing event deleted for resources: {'Port': ['ID=b850be71-e07d-41b3-a3f1-34aa5c56525f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:35.244300 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a28da5aa-9d87-49fe-9397-c612e541c68e req-836d2ac4-5a4d-4efd-8d33-3037e5647add service neutron] 10.222.0.31 "GET /v2.0/networks/6a0b092d-9731-4bc3-9661-8d5436bc9f71?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1308477 Dec 09 21:25:35.259246 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-ce1e5d20-bae6-4e96-adb4-b8f525431438 service neutron] Attempting to bind port 151030b5-c66b-4f22-a8fc-9aceb1635009 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:25:35.259846 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-ce1e5d20-bae6-4e96-adb4-b8f525431438 service neutron] Attempting to bind port 151030b5-c66b-4f22-a8fc-9aceb1635009 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:25:35.259846 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-ce1e5d20-bae6-4e96-adb4-b8f525431438 service neutron] Attempting to bind port 151030b5-c66b-4f22-a8fc-9aceb1635009 on network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:35.276699 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-49ff2091-18b7-4f1a-8f23-a9dc96e7f9be admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:35.277260 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-ce1e5d20-bae6-4e96-adb4-b8f525431438 service neutron] Port 151030b5-c66b-4f22-a8fc-9aceb1635009 on network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:25:35.277597 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-ce1e5d20-bae6-4e96-adb4-b8f525431438 service neutron] Attempting to bind port 151030b5-c66b-4f22-a8fc-9aceb1635009 on network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:35.279340 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-49ff2091-18b7-4f1a-8f23-a9dc96e7f9be admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:35.279624 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0391af30-780a-4843-9849-548314904788 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:35.280497 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-49ff2091-18b7-4f1a-8f23-a9dc96e7f9be admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/9d3bf4f0-5b40-4ad6-bbaf-049106f412e2 HTTP/1.1" status: 204 len: 168 time: 0.2606862 Dec 09 21:25:35.282152 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0391af30-780a-4843-9849-548314904788 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:35.283526 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0391af30-780a-4843-9849-548314904788 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/7e788527-682e-4501-aa63-f5e45c1b3629 HTTP/1.1" status: 204 len: 168 time: 0.5944958 Dec 09 21:25:35.299506 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-ce1e5d20-bae6-4e96-adb4-b8f525431438 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 25, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:25:35.299863 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-ce1e5d20-bae6-4e96-adb4-b8f525431438 service neutron] Checking segment: {'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:25:35.300252 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-ce1e5d20-bae6-4e96-adb4-b8f525431438 service neutron] Bound using segment: {'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:25:35.300694 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-ce1e5d20-bae6-4e96-adb4-b8f525431438 service neutron] Bound port: 151030b5-c66b-4f22-a8fc-9aceb1635009, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:25:35.301057 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-ce1e5d20-bae6-4e96-adb4-b8f525431438 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:35.305957 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9c9477df-67d7-4525-a705-4e394486ae5b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:35.308228 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0391af30-780a-4843-9849-548314904788 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7e788527-682e-4501-aa63-f5e45c1b3629,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:35.310275 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b6d245d9-cd29-4c9e-8b90-fadbc9b85b73 req-f86bc09a-b1d1-42cd-8670-b4f38782469e tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:35.332134 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['e8d231bb-9904-4e89-9b95-5135aca6fb1d'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:25:35.348373 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49ff2091-18b7-4f1a-8f23-a9dc96e7f9be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9d3bf4f0-5b40-4ad6-bbaf-049106f412e2,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:35.420914 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a28da5aa-9d87-49fe-9397-c612e541c68e req-7c8b0c9c-a79a-4d1b-8364-63214e307347 service neutron] 10.222.0.31 "GET /v2.0/networks/6a0b092d-9731-4bc3-9661-8d5436bc9f71?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1685851 Dec 09 21:25:35.464638 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f86bc09a-b1d1-42cd-8670-b4f38782469e tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Pushing event deleted for resources: {'Port': ['ID=e8d231bb-9904-4e89-9b95-5135aca6fb1d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:35.474611 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9c9477df-67d7-4525-a705-4e394486ae5b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:35.477923 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9c9477df-67d7-4525-a705-4e394486ae5b admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:35.519161 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f6f16286-83a2-4c4a-9723-bd0b319f0521 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:35.573820 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-b6d245d9-cd29-4c9e-8b90-fadbc9b85b73 req-f86bc09a-b1d1-42cd-8670-b4f38782469e tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] No DVR routers for this DVR port e8d231bb-9904-4e89-9b95-5135aca6fb1d on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:25:35.581102 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b6d245d9-cd29-4c9e-8b90-fadbc9b85b73 req-f86bc09a-b1d1-42cd-8670-b4f38782469e tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:35.584964 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b6d245d9-cd29-4c9e-8b90-fadbc9b85b73 req-f86bc09a-b1d1-42cd-8670-b4f38782469e tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.31 "DELETE /v2.0/ports/e8d231bb-9904-4e89-9b95-5135aca6fb1d HTTP/1.1" status: 204 len: 173 time: 1.5071139 Dec 09 21:25:35.589332 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a4db25b2-d98a-48fc-bb02-f60ce9fd57ea', 'name': 'network-vif-deleted', 'tag': 'e8d231bb-9904-4e89-9b95-5135aca6fb1d'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:35.592197 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8d4af731-5c0a-4657-8a71-6c034911f14e" -d '{"events": [{"server_uuid": "a4db25b2-d98a-48fc-bb02-f60ce9fd57ea", "name": "network-vif-deleted", "tag": "e8d231bb-9904-4e89-9b95-5135aca6fb1d"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:35.608066 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9c9477df-67d7-4525-a705-4e394486ae5b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:35.608961 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9c9477df-67d7-4525-a705-4e394486ae5b admin admin] Fanout notify agent at l3_agent the message router_deleted on router d9739f4a-16b6-4e7e-8a7e-71716eacbe2d {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:25:35.617616 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-ce1e5d20-bae6-4e96-adb4-b8f525431438 service neutron] For port 151030b5-c66b-4f22-a8fc-9aceb1635009, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:25:35.624902 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9c9477df-67d7-4525-a705-4e394486ae5b admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:35.626449 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9c9477df-67d7-4525-a705-4e394486ae5b admin admin] 10.222.0.13 "DELETE /v2.0/routers/d9739f4a-16b6-4e7e-8a7e-71716eacbe2d HTTP/1.1" status: 204 len: 168 time: 2.7358339 Dec 09 21:25:35.628859 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-ce1e5d20-bae6-4e96-adb4-b8f525431438 service neutron] For port 151030b5-c66b-4f22-a8fc-9aceb1635009, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=151030b5-c66b-4f22-a8fc-9aceb1635009,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:25:35.630122 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37546) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:35.643214 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-ce1e5d20-bae6-4e96-adb4-b8f525431438 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:35.646093 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-61e5004e-ebe3-4c1a-ba53-135a8ba404a0 req-7b231465-f079-4201-a234-eaae5bb3c945 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/ports?device_id=a4db25b2-d98a-48fc-bb02-f60ce9fd57ea HTTP/1.1" status: 200 len: 210 time: 0.0880964 Dec 09 21:25:35.683640 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bb313bf-5f5f-4c87-99e1-db8a7d8c2c76 req-4f4b1734-93a8-4137-b80b-442f0dd06988 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:35.690549 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bb313bf-5f5f-4c87-99e1-db8a7d8c2c76 req-4f4b1734-93a8-4137-b80b-442f0dd06988 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:35.698461 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bb313bf-5f5f-4c87-99e1-db8a7d8c2c76 req-4f4b1734-93a8-4137-b80b-442f0dd06988 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:35.708214 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-ce1e5d20-bae6-4e96-adb4-b8f525431438 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:35.709065 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-ce1e5d20-bae6-4e96-adb4-b8f525431438 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:35.710859 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-ce1e5d20-bae6-4e96-adb4-b8f525431438 service neutron] 10.222.0.31 "PUT /v2.0/ports/151030b5-c66b-4f22-a8fc-9aceb1635009 HTTP/1.1" status: 200 len: 1093 time: 1.8819754 Dec 09 21:25:35.731069 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-e88b14ac-7699-44a7-a5c1-1daabf3229f2 admin admin] Deleting subnet 9a606ad9-369f-4ab7-a435-14aa18212259 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:25:35.738319 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0bb313bf-5f5f-4c87-99e1-db8a7d8c2c76 req-4f4b1734-93a8-4137-b80b-442f0dd06988 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 2412 time: 0.1968939 Dec 09 21:25:35.744448 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e88b14ac-7699-44a7-a5c1-1daabf3229f2 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:35.821255 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce1e5d20-bae6-4e96-adb4-b8f525431438 service neutron] Pushing event updated for resources: {'Port': ['ID=151030b5-c66b-4f22-a8fc-9aceb1635009,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:35.865118 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ccff9c7c-c4e4-435b-9c86-5e3094204934 x-openstack-request-id: req-ccff9c7c-c4e4-435b-9c86-5e3094204934 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:35.865614 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a4db25b2-d98a-48fc-bb02-f60ce9fd57ea", "name": "network-vif-deleted", "tag": "e8d231bb-9904-4e89-9b95-5135aca6fb1d", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:35.865965 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-ccff9c7c-c4e4-435b-9c86-5e3094204934 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:35.866550 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a4db25b2-d98a-48fc-bb02-f60ce9fd57ea', 'name': 'network-vif-deleted', 'tag': 'e8d231bb-9904-4e89-9b95-5135aca6fb1d', 'status': 'completed', 'code': 200} Dec 09 21:25:35.896881 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e88b14ac-7699-44a7-a5c1-1daabf3229f2 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:35.898939 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 20d7dfe6-d481-4b2c-879f-23bab4173d92 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:25:35.915158 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0bb313bf-5f5f-4c87-99e1-db8a7d8c2c76 req-8e9373f5-c8e3-44fc-967b-3c89baf4d23e tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1740546 Dec 09 21:25:35.980509 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-532d3f32-dd4f-4d9b-b04b-9d6a04a441e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:35.982577 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-532d3f32-dd4f-4d9b-b04b-9d6a04a441e8 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=1b7916b634f74760a565cfeaef510cd9&device_id=c008c358-ebaf-4573-9145-fd2e014057cc HTTP/1.1" status: 200 len: 1096 time: 0.1437018 Dec 09 21:25:35.984021 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 20d7dfe6-d481-4b2c-879f-23bab4173d92 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:25:35.987729 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 20d7dfe6-d481-4b2c-879f-23bab4173d92 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:25:36.054203 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-749c26ea-79f3-45f2-bbfd-538a6e7c11a8 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=151030b5-c66b-4f22-a8fc-9aceb1635009 HTTP/1.1" status: 200 len: 217 time: 0.0456574 Dec 09 21:25:36.069682 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e88b14ac-7699-44a7-a5c1-1daabf3229f2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:36.120379 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d2edae7-4c6c-442e-babb-82b65e3910a6 req-c8d9943d-19fa-428a-b64a-08c5b07bba76 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:36.143807 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3d2edae7-4c6c-442e-babb-82b65e3910a6 req-c8d9943d-19fa-428a-b64a-08c5b07bba76 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=c008c358-ebaf-4573-9145-fd2e014057cc HTTP/1.1" status: 200 len: 944 time: 0.1014855 Dec 09 21:25:36.154960 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-2d936ee9-5188-4aa0-aa46-d48cd8448481 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:36.156066 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-2d936ee9-5188-4aa0-aa46-d48cd8448481 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=50496955-1646-4079-acd4-a47e8cd175cb HTTP/1.1" status: 200 len: 852 time: 0.0839880 Dec 09 21:25:36.178481 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e88b14ac-7699-44a7-a5c1-1daabf3229f2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:36.201259 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-05900b68-8357-4cdd-bb37-9e00e1444bf3 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0352986 Dec 09 21:25:36.214774 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3d2edae7-4c6c-442e-babb-82b65e3910a6 req-790c524f-abf9-4aa1-8a4d-393df1a365cb tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0700772 Dec 09 21:25:36.240488 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-82756063-6413-4196-91fa-50e56af594b2 None None] Network 31f694ab-9ca7-4e6a-a3ee-21a21efff365 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:25:36.240620 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e88b14ac-7699-44a7-a5c1-1daabf3229f2 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:36.241863 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e88b14ac-7699-44a7-a5c1-1daabf3229f2 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/9a606ad9-369f-4ab7-a435-14aa18212259 HTTP/1.1" status: 204 len: 168 time: 0.6102929 Dec 09 21:25:36.243087 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e88b14ac-7699-44a7-a5c1-1daabf3229f2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9a606ad9-369f-4ab7-a435-14aa18212259,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:36.245085 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37568) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:36.421238 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8010f2d-b674-4f85-a01e-881ab7865337 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:36.441904 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-a547b5f3-aa93-47cd-9d0b-095bd207bb26 service neutron] 10.222.0.31 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2130923 Dec 09 21:25:36.525641 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-89f6b011-2b65-4348-87bd-d137c9703e79 None None] DHCP port deletion for 31f694ab-9ca7-4e6a-a3ee-21a21efff365 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:25:36.570770 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:36.574655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37580) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:36.587097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-f8010f2d-b674-4f85-a01e-881ab7865337 admin admin] Deleting port fe58d238-e077-4ba7-a721-ae6bf5d3b9ae {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:36.587422 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8010f2d-b674-4f85-a01e-881ab7865337 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:36.594617 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-89f6b011-2b65-4348-87bd-d137c9703e79 None None] Deleting port fe58d238-e077-4ba7-a721-ae6bf5d3b9ae {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:36.595248 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-89f6b011-2b65-4348-87bd-d137c9703e79 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:36.610096 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-406ad17b-207f-47ae-84a0-4f6c8081ee83 req-704730a5-f944-49d9-a112-28d25a186cd5 service neutron] 10.222.0.31 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1356456 Dec 09 21:25:36.669214 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-89f6b011-2b65-4348-87bd-d137c9703e79 None None] For port fe58d238-e077-4ba7-a721-ae6bf5d3b9ae, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=fe58d238-e077-4ba7-a721-ae6bf5d3b9ae,segment=NetworkSegment(7cdf46cd-1cf9-47c2-bde8-571e75cabe6a),segment_id=7cdf46cd-1cf9-47c2-bde8-571e75cabe6a)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:36.669717 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-89f6b011-2b65-4348-87bd-d137c9703e79 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:36.690622 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-89f6b011-2b65-4348-87bd-d137c9703e79 None None] Calling delete_port for fe58d238-e077-4ba7-a721-ae6bf5d3b9ae owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:25:36.696749 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-f8010f2d-b674-4f85-a01e-881ab7865337 admin admin] For port fe58d238-e077-4ba7-a721-ae6bf5d3b9ae, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=fe58d238-e077-4ba7-a721-ae6bf5d3b9ae,segment=NetworkSegment(7cdf46cd-1cf9-47c2-bde8-571e75cabe6a),segment_id=7cdf46cd-1cf9-47c2-bde8-571e75cabe6a)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:36.697193 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8010f2d-b674-4f85-a01e-881ab7865337 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:36.713126 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-f8010f2d-b674-4f85-a01e-881ab7865337 admin admin] Calling delete_port for fe58d238-e077-4ba7-a721-ae6bf5d3b9ae owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:25:36.738234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device be89ffc7-e26a-4049-9372-9a434624cba7 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:25:36.829018 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8010f2d-b674-4f85-a01e-881ab7865337 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:36.871721 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-82075e5d-5f59-4611-b44e-05833bdfe2ba admin admin] Request body: {'network': {'name': 'tempest-MultipleCreateTestJSON-1703050208-network', 'tenant_id': '52eb00d38d4442158ed8579a84e900ca'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:36.876036 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8010f2d-b674-4f85-a01e-881ab7865337 admin admin] Pushing event deleted for resources: {'Port': ['ID=fe58d238-e077-4ba7-a721-ae6bf5d3b9ae,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:36.879578 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port be89ffc7-e26a-4049-9372-9a434624cba7, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=be89ffc7-e26a-4049-9372-9a434624cba7,segment=NetworkSegment(3e23a057-7b71-4625-891b-f66fd33737f2),segment_id=3e23a057-7b71-4625-891b-f66fd33737f2)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: from cryptography.utils import int_from_bytes Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: from cryptography.utils import int_from_bytes Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.881928 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.885515 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.885515 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.885515 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.885515 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.885515 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.885515 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.885515 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.885515 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.885515 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.885515 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.885515 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.885515 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.885515 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:25:36.885515 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:25:36.895571 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8010f2d-b674-4f85-a01e-881ab7865337 admin admin] No DVR routers for this DVR port fe58d238-e077-4ba7-a721-ae6bf5d3b9ae on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:25:36.898819 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'be89ffc7-e26a-4049-9372-9a434624cba7', 'network_id': '6a0b092d-9731-4bc3-9661-8d5436bc9f71', 'port_id': 'be89ffc7-e26a-4049-9372-9a434624cba7', 'mac_address': 'fa:16:3e:b3:22:e2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 137, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c9ca5636-e2f1-4aee-84ec-4054f1a18361', 'ip_address': '19.80.0.16'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:25:36.900909 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-89f6b011-2b65-4348-87bd-d137c9703e79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:36.972346 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:36.976048 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89f6b011-2b65-4348-87bd-d137c9703e79 None None] Pushing event deleted for resources: {'Port': ['ID=fe58d238-e077-4ba7-a721-ae6bf5d3b9ae,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:36.992028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89f6b011-2b65-4348-87bd-d137c9703e79 None None] No DVR routers for this DVR port fe58d238-e077-4ba7-a721-ae6bf5d3b9ae on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:25:36.998367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89f6b011-2b65-4348-87bd-d137c9703e79 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:36.998909 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89f6b011-2b65-4348-87bd-d137c9703e79 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:36.999610 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89f6b011-2b65-4348-87bd-d137c9703e79 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:37.000311 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89f6b011-2b65-4348-87bd-d137c9703e79 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:37.000809 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89f6b011-2b65-4348-87bd-d137c9703e79 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:37.001298 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89f6b011-2b65-4348-87bd-d137c9703e79 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:37.001933 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89f6b011-2b65-4348-87bd-d137c9703e79 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:37.002933 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89f6b011-2b65-4348-87bd-d137c9703e79 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:37.006852 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89f6b011-2b65-4348-87bd-d137c9703e79 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:37.007585 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89f6b011-2b65-4348-87bd-d137c9703e79 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:37.008222 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89f6b011-2b65-4348-87bd-d137c9703e79 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:37.008892 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89f6b011-2b65-4348-87bd-d137c9703e79 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:37.009496 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89f6b011-2b65-4348-87bd-d137c9703e79 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:37.014374 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id be89ffc7-e26a-4049-9372-9a434624cba7 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:37.016131 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8010f2d-b674-4f85-a01e-881ab7865337 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:37.038585 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port be89ffc7-e26a-4049-9372-9a434624cba7, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=be89ffc7-e26a-4049-9372-9a434624cba7,segment=NetworkSegment(3e23a057-7b71-4625-891b-f66fd33737f2),segment_id=3e23a057-7b71-4625-891b-f66fd33737f2)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:37.044483 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-82075e5d-5f59-4611-b44e-05833bdfe2ba admin admin] Made reservation on behalf of 52eb00d38d4442158ed8579a84e900ca for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:25:37.047226 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:37.047413 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82075e5d-5f59-4611-b44e-05833bdfe2ba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:37.048496 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 39a4e9cb-cd4f-4df2-9c02-6776529dc801 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:25:37.074037 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37614) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:37.131849 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=be89ffc7-e26a-4049-9372-9a434624cba7,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:37.138631 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 39a4e9cb-cd4f-4df2-9c02-6776529dc801, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=39a4e9cb-cd4f-4df2-9c02-6776529dc801,segment=NetworkSegment(3e23a057-7b71-4625-891b-f66fd33737f2),segment_id=3e23a057-7b71-4625-891b-f66fd33737f2)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:37.151488 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '39a4e9cb-cd4f-4df2-9c02-6776529dc801', 'network_id': '6a0b092d-9731-4bc3-9661-8d5436bc9f71', 'port_id': '39a4e9cb-cd4f-4df2-9c02-6776529dc801', 'mac_address': 'fa:16:3e:29:c5:b1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 137, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c9ca5636-e2f1-4aee-84ec-4054f1a18361', 'ip_address': '19.80.0.232'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:25:37.198229 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:37.215793 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 39a4e9cb-cd4f-4df2-9c02-6776529dc801 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:37.217242 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-212781e8-1433-42a1-8127-b4eb3931ab86 req-c45e987a-47d3-43a5-822e-19574291f678 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:37.225844 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-212781e8-1433-42a1-8127-b4eb3931ab86 req-c45e987a-47d3-43a5-822e-19574291f678 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:37.234195 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-212781e8-1433-42a1-8127-b4eb3931ab86 req-c45e987a-47d3-43a5-822e-19574291f678 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:37.236139 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-212781e8-1433-42a1-8127-b4eb3931ab86 req-c45e987a-47d3-43a5-822e-19574291f678 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 2413 time: 0.1724916 Dec 09 21:25:37.247271 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 39a4e9cb-cd4f-4df2-9c02-6776529dc801, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=39a4e9cb-cd4f-4df2-9c02-6776529dc801,segment=NetworkSegment(3e23a057-7b71-4625-891b-f66fd33737f2),segment_id=3e23a057-7b71-4625-891b-f66fd33737f2)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:37.258105 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:37.259634 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device f985bc1a-2e10-4124-b2e9-f8c053c1cf19 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:25:37.306760 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-538656d2-d7ba-47d9-a877-7f59d2393010 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:37.358004 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=39a4e9cb-cd4f-4df2-9c02-6776529dc801,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:37.426809 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-212781e8-1433-42a1-8127-b4eb3931ab86 req-91bf2188-9670-4247-8c11-5714597b51a4 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1825216 Dec 09 21:25:37.429116 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-538656d2-d7ba-47d9-a877-7f59d2393010 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:37.455765 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port f985bc1a-2e10-4124-b2e9-f8c053c1cf19, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=f985bc1a-2e10-4124-b2e9-f8c053c1cf19,segment=NetworkSegment(e72604b7-1620-485e-8ea6-a66ce97f67f1),segment_id=e72604b7-1620-485e-8ea6-a66ce97f67f1)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:37.458320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-f8010f2d-b674-4f85-a01e-881ab7865337 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['31f694ab-9ca7-4e6a-a3ee-21a21efff365']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:37.466237 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82075e5d-5f59-4611-b44e-05833bdfe2ba admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:37.472059 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'f985bc1a-2e10-4124-b2e9-f8c053c1cf19', 'network_id': 'c8e08369-5b79-4a41-a5f9-0059632e26cd', 'port_id': 'f985bc1a-2e10-4124-b2e9-f8c053c1cf19', 'mac_address': 'fa:16:3e:9e:a5:ff', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 134, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f4a2d786-583b-4e8b-9946-37b7ed5fd3e8', 'ip_address': '19.86.0.113'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:25:37.472446 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-f8010f2d-b674-4f85-a01e-881ab7865337 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7cdf46cd-1cf9-47c2-bde8-571e75cabe6a') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:37.472743 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-f8010f2d-b674-4f85-a01e-881ab7865337 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7cdf46cd-1cf9-47c2-bde8-571e75cabe6a') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:37.507192 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8010f2d-b674-4f85-a01e-881ab7865337 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:37.521972 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-538656d2-d7ba-47d9-a877-7f59d2393010 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:37.525835 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-538656d2-d7ba-47d9-a877-7f59d2393010 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:37.527133 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-538656d2-d7ba-47d9-a877-7f59d2393010 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "DELETE /v2.0/security-groups/a70cef89-7037-4b4e-877a-dc5c63664110 HTTP/1.1" status: 204 len: 168 time: 0.4516127 Dec 09 21:25:37.538015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37628) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:37.539749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-538656d2-d7ba-47d9-a877-7f59d2393010 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a70cef89-7037-4b4e-877a-dc5c63664110,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:37.545276 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:37.576508 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f985bc1a-2e10-4124-b2e9-f8c053c1cf19 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:37.582130 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8010f2d-b674-4f85-a01e-881ab7865337 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:37.588594 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-18856a08-8629-4037-9e19-36cf8f4d5c5c tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] show failed (client error): The resource could not be found. Dec 09 21:25:37.594510 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37632) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:37.596996 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f8010f2d-b674-4f85-a01e-881ab7865337 admin admin] Releasing vlan 122 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:25:37.597675 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8010f2d-b674-4f85-a01e-881ab7865337 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:37.606438 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-18856a08-8629-4037-9e19-36cf8f4d5c5c tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "GET /v2.0/security-groups/a70cef89-7037-4b4e-877a-dc5c63664110 HTTP/1.1" status: 404 len: 347 time: 0.0639319 Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:25:37.627723 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:25:37.630676 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port f985bc1a-2e10-4124-b2e9-f8c053c1cf19, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=f985bc1a-2e10-4124-b2e9-f8c053c1cf19,segment=NetworkSegment(e72604b7-1620-485e-8ea6-a66ce97f67f1),segment_id=e72604b7-1620-485e-8ea6-a66ce97f67f1)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:37.641394 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:37.722239 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-393be6d7-b25c-48f5-8802-0902a821fee5 req-cb55115f-4024-4ca7-90f6-bb0c80f78fb9 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:37.726531 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-393be6d7-b25c-48f5-8802-0902a821fee5 req-cb55115f-4024-4ca7-90f6-bb0c80f78fb9 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=c008c358-ebaf-4573-9145-fd2e014057cc HTTP/1.1" status: 200 len: 944 time: 0.1416011 Dec 09 21:25:37.746464 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=f985bc1a-2e10-4124-b2e9-f8c053c1cf19,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:37.813141 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82075e5d-5f59-4611-b44e-05833bdfe2ba admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:37.815313 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8010f2d-b674-4f85-a01e-881ab7865337 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:37.832261 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8010f2d-b674-4f85-a01e-881ab7865337 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:37.835522 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f8010f2d-b674-4f85-a01e-881ab7865337 admin admin] 10.222.0.13 "DELETE /v2.0/networks/31f694ab-9ca7-4e6a-a3ee-21a21efff365 HTTP/1.1" status: 204 len: 168 time: 1.5881395 Dec 09 21:25:37.837282 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b850be71-e07d-41b3-a3f1-34aa5c56525f no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:25:37.852079 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-393be6d7-b25c-48f5-8802-0902a821fee5 req-4927c84b-5640-4427-81d3-bf2bbbda9096 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1188681 Dec 09 21:25:37.859010 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82075e5d-5f59-4611-b44e-05833bdfe2ba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:37.875735 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8010f2d-b674-4f85-a01e-881ab7865337 admin admin] Pushing event deleted for resources: {'Network': ['ID=31f694ab-9ca7-4e6a-a3ee-21a21efff365,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:37.877485 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c008c358-ebaf-4573-9145-fd2e014057cc', 'tag': '151030b5-c66b-4f22-a8fc-9aceb1635009'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:37.879032 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: b850be71-e07d-41b3-a3f1-34aa5c56525f {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:25:37.879755 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b850be71-e07d-41b3-a3f1-34aa5c56525f not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:25:37.880129 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2749313f-d393-4a37-a34a-4dbd754009e4" -d '{"events": [{"name": "network-changed", "server_uuid": "c008c358-ebaf-4573-9145-fd2e014057cc", "tag": "151030b5-c66b-4f22-a8fc-9aceb1635009"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:37.880779 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device fe58d238-e077-4ba7-a721-ae6bf5d3b9ae no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:25:37.909348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-82075e5d-5f59-4611-b44e-05833bdfe2ba admin admin] vlan segment allocate from pool success with {'vlan_id': 139, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:25:37.924157 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82075e5d-5f59-4611-b44e-05833bdfe2ba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0be95913-f7f5-4b8c-a0a8-1ef338e16419,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:37.930379 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82075e5d-5f59-4611-b44e-05833bdfe2ba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:37.930730 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-82075e5d-5f59-4611-b44e-05833bdfe2ba admin admin] Added segment bada42e9-278b-46e3-bbc2-c2d37f00c32d of type vlan for network 56b576e6-50b1-4d1e-a1c2-80bcf1883e68 Dec 09 21:25:37.932694 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['39a4e9cb-cd4f-4df2-9c02-6776529dc801'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:25:37.939079 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: fe58d238-e077-4ba7-a721-ae6bf5d3b9ae {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:25:37.940025 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device fe58d238-e077-4ba7-a721-ae6bf5d3b9ae not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:25:37.970611 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3460426c-729f-49ee-b46c-a9a4996dbae0 x-openstack-request-id: req-3460426c-729f-49ee-b46c-a9a4996dbae0 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:37.971170 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c008c358-ebaf-4573-9145-fd2e014057cc", "tag": "151030b5-c66b-4f22-a8fc-9aceb1635009", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:37.971170 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-3460426c-729f-49ee-b46c-a9a4996dbae0 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:37.971594 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c008c358-ebaf-4573-9145-fd2e014057cc', 'tag': '151030b5-c66b-4f22-a8fc-9aceb1635009', 'status': 'completed', 'code': 200} Dec 09 21:25:37.973015 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-fac6b0a2-bd4f-4001-9f8b-d09f5058bee3 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Deleting port a921ba4f-8ccd-4406-8858-6c571f296262 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:37.973365 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fac6b0a2-bd4f-4001-9f8b-d09f5058bee3 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:37.986514 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['f985bc1a-2e10-4124-b2e9-f8c053c1cf19'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:25:38.009842 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82075e5d-5f59-4611-b44e-05833bdfe2ba admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:38.051822 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:38.118305 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82075e5d-5f59-4611-b44e-05833bdfe2ba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:38.119964 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82075e5d-5f59-4611-b44e-05833bdfe2ba admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:38.120420 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82075e5d-5f59-4611-b44e-05833bdfe2ba admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:38.142296 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2749313f-d393-4a37-a34a-4dbd754009e4 req-7d5ba8d0-da5f-4436-8cd2-0712761407a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:38.144201 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2749313f-d393-4a37-a34a-4dbd754009e4 req-7d5ba8d0-da5f-4436-8cd2-0712761407a5 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=1b7916b634f74760a565cfeaef510cd9&device_id=c008c358-ebaf-4573-9145-fd2e014057cc HTTP/1.1" status: 200 len: 1096 time: 0.1472187 Dec 09 21:25:38.146228 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fac6b0a2-bd4f-4001-9f8b-d09f5058bee3 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:38.146548 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fac6b0a2-bd4f-4001-9f8b-d09f5058bee3 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:38.190284 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-fac6b0a2-bd4f-4001-9f8b-d09f5058bee3 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Calling delete_port for a921ba4f-8ccd-4406-8858-6c571f296262 owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:25:38.215185 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-82075e5d-5f59-4611-b44e-05833bdfe2ba admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 1.6393914 Dec 09 21:25:38.218762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37656) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:38.224747 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-9e202c54-daa2-4b4e-ad22-914015724eb9 admin admin] Request body: {'subnet': {'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68', 'cidr': '172.20.0.0/28', 'name': 'tempest-MultipleCreateTestJSON-1703050208-subnet', 'tenant_id': '52eb00d38d4442158ed8579a84e900ca', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:38.278136 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9e202c54-daa2-4b4e-ad22-914015724eb9 admin admin] Made reservation on behalf of 52eb00d38d4442158ed8579a84e900ca for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:25:38.285415 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9e202c54-daa2-4b4e-ad22-914015724eb9 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:38.291306 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37662) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:38.349336 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82075e5d-5f59-4611-b44e-05833bdfe2ba admin admin] Pushing event updated for resources: {'Network': ['ID=56b576e6-50b1-4d1e-a1c2-80bcf1883e68,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:38.367492 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 56b576e6-50b1-4d1e-a1c2-80bcf1883e68 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:25:38.397250 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2516b5f0-5d2e-4124-8c6f-86b049961d78 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=df9831f9ad4847c8afaf37f22e8d18a9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1047599 Dec 09 21:25:38.399685 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37664) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:38.408569 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2749313f-d393-4a37-a34a-4dbd754009e4 req-36e5644e-9d1b-4a6b-bf81-c423164104de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:38.410324 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2749313f-d393-4a37-a34a-4dbd754009e4 req-36e5644e-9d1b-4a6b-bf81-c423164104de service neutron] 10.222.0.31 "GET /v2.0/networks?id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb HTTP/1.1" status: 200 len: 913 time: 0.2376342 Dec 09 21:25:38.467638 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-092530aa-a7ed-4aa7-b616-7bdb1a6dabe2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:38.480686 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2749313f-d393-4a37-a34a-4dbd754009e4 req-c3de2f3f-90be-4b07-9fd8-94ac93075fc0 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=151030b5-c66b-4f22-a8fc-9aceb1635009 HTTP/1.1" status: 200 len: 217 time: 0.0594335 Dec 09 21:25:38.550368 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-092530aa-a7ed-4aa7-b616-7bdb1a6dabe2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:38.575134 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2749313f-d393-4a37-a34a-4dbd754009e4 req-3f01f53d-ae46-4115-b83c-1a49b506727a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:38.576993 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2749313f-d393-4a37-a34a-4dbd754009e4 req-3f01f53d-ae46-4115-b83c-1a49b506727a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=50496955-1646-4079-acd4-a47e8cd175cb HTTP/1.1" status: 200 len: 852 time: 0.0823467 Dec 09 21:25:38.580003 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fac6b0a2-bd4f-4001-9f8b-d09f5058bee3 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:38.636856 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fac6b0a2-bd4f-4001-9f8b-d09f5058bee3 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Pushing event deleted for resources: {'Port': ['ID=a921ba4f-8ccd-4406-8858-6c571f296262,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:38.645049 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2749313f-d393-4a37-a34a-4dbd754009e4 req-b6399266-8a37-40d6-b210-132fb11255dc service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0602708 Dec 09 21:25:38.664543 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c5d7299-e37d-45c2-a537-d0aec2ed68dc req-b54b7e3c-5d9c-4f4d-9f58-eb79814de524 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:38.670765 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c5d7299-e37d-45c2-a537-d0aec2ed68dc req-b54b7e3c-5d9c-4f4d-9f58-eb79814de524 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:38.676763 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c5d7299-e37d-45c2-a537-d0aec2ed68dc req-b54b7e3c-5d9c-4f4d-9f58-eb79814de524 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:38.684702 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3c5d7299-e37d-45c2-a537-d0aec2ed68dc req-b54b7e3c-5d9c-4f4d-9f58-eb79814de524 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 2415 time: 0.1666374 Dec 09 21:25:38.728460 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fac6b0a2-bd4f-4001-9f8b-d09f5058bee3 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:38.731307 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fac6b0a2-bd4f-4001-9f8b-d09f5058bee3 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:38.735542 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fac6b0a2-bd4f-4001-9f8b-d09f5058bee3 tempest-ImagesOneServerNegativeTestJSON-1239106639 tempest-ImagesOneServerNegativeTestJSON-1239106639-project] 10.222.0.13 "DELETE /v2.0/floatingips/260908b5-493a-4ad7-8e52-bc996cf96843 HTTP/1.1" status: 204 len: 168 time: 1.1398194 Dec 09 21:25:38.751995 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 151030b5-c66b-4f22-a8fc-9aceb1635009 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:25:38.755930 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e8d231bb-9904-4e89-9b95-5135aca6fb1d no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:25:38.787058 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: e8d231bb-9904-4e89-9b95-5135aca6fb1d {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:25:38.787708 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e8d231bb-9904-4e89-9b95-5135aca6fb1d not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:25:38.813172 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2749313f-d393-4a37-a34a-4dbd754009e4 req-2ac4f4d6-c9e1-49ba-88b5-e77b3860c79f service neutron] 10.222.0.31 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1524317 Dec 09 21:25:38.901414 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 151030b5-c66b-4f22-a8fc-9aceb1635009, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=151030b5-c66b-4f22-a8fc-9aceb1635009,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:38.917464 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '151030b5-c66b-4f22-a8fc-9aceb1635009', 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb', 'port_id': '151030b5-c66b-4f22-a8fc-9aceb1635009', 'mac_address': 'fa:16:3e:b2:b7:8c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 101, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '50496955-1646-4079-acd4-a47e8cd175cb', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:25:38.930207 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2749313f-d393-4a37-a34a-4dbd754009e4 req-930848d7-2eef-43f0-b8e0-61c13ee11b16 service neutron] 10.222.0.31 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1088221 Dec 09 21:25:38.961306 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:38.976026 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9e202c54-daa2-4b4e-ad22-914015724eb9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:38.977705 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 151030b5-c66b-4f22-a8fc-9aceb1635009 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:39.003323 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 151030b5-c66b-4f22-a8fc-9aceb1635009, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=151030b5-c66b-4f22-a8fc-9aceb1635009,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:39.008472 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:39.033101 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-958812af-d553-4b08-a136-ec7338635e0f req-a295094f-76bc-46a2-bc83-ff9b7f75076a tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&shared=False HTTP/1.1" status: 200 len: 213 time: 0.3362696 Dec 09 21:25:39.048013 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-092530aa-a7ed-4aa7-b616-7bdb1a6dabe2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:39.048242 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['be89ffc7-e26a-4049-9372-9a434624cba7'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:25:39.050595 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-092530aa-a7ed-4aa7-b616-7bdb1a6dabe2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:39.054948 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-092530aa-a7ed-4aa7-b616-7bdb1a6dabe2 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/1e19db3b-b607-448e-bd9c-c7f8c4afe5f1 HTTP/1.1" status: 204 len: 168 time: 0.6526918 Dec 09 21:25:39.094092 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=151030b5-c66b-4f22-a8fc-9aceb1635009,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:39.105527 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-092530aa-a7ed-4aa7-b616-7bdb1a6dabe2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1e19db3b-b607-448e-bd9c-c7f8c4afe5f1,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:39.125919 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3c5d7299-e37d-45c2-a537-d0aec2ed68dc req-47a02528-0f1b-4827-b0a4-6ed78ad77b28 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4355936 Dec 09 21:25:39.126693 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e202c54-daa2-4b4e-ad22-914015724eb9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5b18bb60-11fe-4ddd-8fd3-bcb36985a134,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:39.207470 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e202c54-daa2-4b4e-ad22-914015724eb9 admin admin] Checking segment: {'id': 'bada42e9-278b-46e3-bbc2-c2d37f00c32d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:25:39.207846 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9e202c54-daa2-4b4e-ad22-914015724eb9 admin admin] Network hostable DHCP agents. Network: 56b576e6-50b1-4d1e-a1c2-80bcf1883e68, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:25:39.251123 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9e202c54-daa2-4b4e-ad22-914015724eb9 admin admin] Network 56b576e6-50b1-4d1e-a1c2-80bcf1883e68 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:25:39.257476 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['151030b5-c66b-4f22-a8fc-9aceb1635009'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:25:39.285840 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-958812af-d553-4b08-a136-ec7338635e0f req-dbc2b1f9-7de8-4b4c-a52a-eac11ba5c250 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:39.287870 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-958812af-d553-4b08-a136-ec7338635e0f req-dbc2b1f9-7de8-4b4c-a52a-eac11ba5c250 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2424569 Dec 09 21:25:39.304452 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-9e202c54-daa2-4b4e-ad22-914015724eb9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 56b576e6-50b1-4d1e-a1c2-80bcf1883e68) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:39.319339 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9e202c54-daa2-4b4e-ad22-914015724eb9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:39.320259 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9e202c54-daa2-4b4e-ad22-914015724eb9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:39.323257 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1aac7003-d316-4758-9974-9b44c12024ba None None] Network 56b576e6-50b1-4d1e-a1c2-80bcf1883e68 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:25:39.331559 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-958812af-d553-4b08-a136-ec7338635e0f req-daa8f2ad-a673-4de4-9fa8-dee6030d7ea3 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/quotas/23f7f8a3e7b14635b4f7dfa561684399 HTTP/1.1" status: 200 len: 375 time: 0.0280952 Dec 09 21:25:39.362895 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9e202c54-daa2-4b4e-ad22-914015724eb9 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 1.1428819 Dec 09 21:25:39.381014 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72d51cd0-0e22-4f1f-893b-47e24454f76b req-10b40a22-d935-4c7a-b413-00cd3b9b9f8c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:39.383928 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72d51cd0-0e22-4f1f-893b-47e24454f76b req-10b40a22-d935-4c7a-b413-00cd3b9b9f8c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=c008c358-ebaf-4573-9145-fd2e014057cc HTTP/1.1" status: 200 len: 945 time: 0.1337996 Dec 09 21:25:39.419747 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-958812af-d553-4b08-a136-ec7338635e0f req-e0021a9e-3c39-4d5f-bbd0-c52e56431460 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0782771 Dec 09 21:25:39.534987 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ecd0f130-ee64-4872-91aa-88b25f563d1d None None] Network 56b576e6-50b1-4d1e-a1c2-80bcf1883e68 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:25:39.549006 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72d51cd0-0e22-4f1f-893b-47e24454f76b req-15916a08-ab46-415e-9630-ba5edee11761 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1252577 Dec 09 21:25:39.689190 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:39.808912 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37714) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:39.830303 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2aa68092-8a49-48d8-92f1-8dc9bc906873 req-9fa86634-0ad4-4ff4-a1a5-fafd21ba218b tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=10aa9750-8504-424a-9c95-af3331c58955 HTTP/1.1" status: 200 len: 210 time: 0.0576265 Dec 09 21:25:39.904454 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-d1dc1e01-e5b9-4a8b-bbf4-51eba0d50e3c admin admin] Deleting subnet 1f5c65f5-5864-4e4e-bede-1bfc7f6e8e68 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:25:39.908157 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d1dc1e01-e5b9-4a8b-bbf4-51eba0d50e3c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:39.997183 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d1dc1e01-e5b9-4a8b-bbf4-51eba0d50e3c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:40.050022 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d1dc1e01-e5b9-4a8b-bbf4-51eba0d50e3c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:40.132798 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d1dc1e01-e5b9-4a8b-bbf4-51eba0d50e3c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:40.203800 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d1dc1e01-e5b9-4a8b-bbf4-51eba0d50e3c admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:40.207227 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d1dc1e01-e5b9-4a8b-bbf4-51eba0d50e3c admin admin] 10.222.0.13 "DELETE /v2.0/subnets/1f5c65f5-5864-4e4e-bede-1bfc7f6e8e68 HTTP/1.1" status: 204 len: 168 time: 0.3953574 Dec 09 21:25:40.208372 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1dc1e01-e5b9-4a8b-bbf4-51eba0d50e3c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1f5c65f5-5864-4e4e-bede-1bfc7f6e8e68,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:40.211191 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37736) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:40.364242 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c6c744b-4078-4374-bffd-8c9b978d462e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:40.411664 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2c381bb-b449-4d61-8668-5109fc2529ac req-0236be56-d60a-49f8-b4c7-b6aaee4f1ca0 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:40.419984 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2c381bb-b449-4d61-8668-5109fc2529ac req-0236be56-d60a-49f8-b4c7-b6aaee4f1ca0 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:40.431386 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2c381bb-b449-4d61-8668-5109fc2529ac req-0236be56-d60a-49f8-b4c7-b6aaee4f1ca0 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:40.433361 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f2c381bb-b449-4d61-8668-5109fc2529ac req-0236be56-d60a-49f8-b4c7-b6aaee4f1ca0 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 2415 time: 0.1866689 Dec 09 21:25:40.494305 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-225396bc-48ed-4da3-be9d-01811b989a02 req-cdbe9683-d56b-4567-9a5a-0393d181a0f9 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:40.497406 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-225396bc-48ed-4da3-be9d-01811b989a02 req-cdbe9683-d56b-4567-9a5a-0393d181a0f9 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/networks?id=56b576e6-50b1-4d1e-a1c2-80bcf1883e68 HTTP/1.1" status: 200 len: 813 time: 0.2161269 Dec 09 21:25:40.549398 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-225396bc-48ed-4da3-be9d-01811b989a02 req-4630a5bc-8a47-4f7b-8b38-fc2ebf601e03 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/quotas/52eb00d38d4442158ed8579a84e900ca HTTP/1.1" status: 200 len: 375 time: 0.0139215 Dec 09 21:25:40.602278 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-225396bc-48ed-4da3-be9d-01811b989a02 req-8d10c4c3-3898-4996-98ec-261d6f5e705b tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=52eb00d38d4442158ed8579a84e900ca&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0433838 Dec 09 21:25:40.619183 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f2c381bb-b449-4d61-8668-5109fc2529ac req-9bd7fc51-b945-4a8d-8821-7b6df4c1f329 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1522074 Dec 09 21:25:40.737318 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c6c744b-4078-4374-bffd-8c9b978d462e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:40.764871 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 151030b5-c66b-4f22-a8fc-9aceb1635009 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:40.825971 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 151030b5-c66b-4f22-a8fc-9aceb1635009 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:25:40.832005 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-7c6c744b-4078-4374-bffd-8c9b978d462e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c2615978-1c59-4fbb-826b-fc6aec14e987']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:40.834511 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 151030b5-c66b-4f22-a8fc-9aceb1635009 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:40.834965 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:40.851772 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-7c6c744b-4078-4374-bffd-8c9b978d462e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '77d1b765-2404-4dd1-ab6e-956ebecc3e04') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:40.852028 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-7c6c744b-4078-4374-bffd-8c9b978d462e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '77d1b765-2404-4dd1-ab6e-956ebecc3e04') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:40.875138 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c6c744b-4078-4374-bffd-8c9b978d462e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:40.900841 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e121e94-8fc2-42f3-a0fe-b597241750ed req-e5dec6d8-86bd-4adb-b6cb-f4ff0f33a34c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:40.902818 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e121e94-8fc2-42f3-a0fe-b597241750ed req-e5dec6d8-86bd-4adb-b6cb-f4ff0f33a34c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=c008c358-ebaf-4573-9145-fd2e014057cc HTTP/1.1" status: 200 len: 945 time: 0.1705692 Dec 09 21:25:40.921309 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-225396bc-48ed-4da3-be9d-01811b989a02 req-50793f15-55bd-4fcf-9630-6a2eac6b285f service neutron] 10.222.0.13 "GET /v2.0/networks/56b576e6-50b1-4d1e-a1c2-80bcf1883e68?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2983143 Dec 09 21:25:40.932851 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c6c744b-4078-4374-bffd-8c9b978d462e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:40.940299 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:40.968190 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7c6c744b-4078-4374-bffd-8c9b978d462e admin admin] Releasing vlan 147 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:25:40.969791 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c6c744b-4078-4374-bffd-8c9b978d462e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:25:40.996972 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:25:41.000622 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c008c358-ebaf-4573-9145-fd2e014057cc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '151030b5-c66b-4f22-a8fc-9aceb1635009'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:41.007945 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2b435956-6022-4e79-8cf9-f060f72e859b" -d '{"events": [{"server_uuid": "c008c358-ebaf-4573-9145-fd2e014057cc", "name": "network-vif-plugged", "status": "completed", "tag": "151030b5-c66b-4f22-a8fc-9aceb1635009"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:41.015891 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 151030b5-c66b-4f22-a8fc-9aceb1635009, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=151030b5-c66b-4f22-a8fc-9aceb1635009,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:41.021420 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:41.023380 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device be89ffc7-e26a-4049-9372-9a434624cba7 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:41.110609 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-958812af-d553-4b08-a136-ec7338635e0f req-33b31194-b952-4ca2-82b0-fed6d8a47c00 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0340922 Dec 09 21:25:41.124175 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c6c744b-4078-4374-bffd-8c9b978d462e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:41.132288 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e121e94-8fc2-42f3-a0fe-b597241750ed req-676aef6b-0012-4494-b99a-9f92331b35d5 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2198844 Dec 09 21:25:41.138979 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c6c744b-4078-4374-bffd-8c9b978d462e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:41.157324 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7c6c744b-4078-4374-bffd-8c9b978d462e admin admin] 10.222.0.13 "DELETE /v2.0/networks/c2615978-1c59-4fbb-826b-fc6aec14e987 HTTP/1.1" status: 204 len: 168 time: 0.9306388 Dec 09 21:25:41.202715 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6c744b-4078-4374-bffd-8c9b978d462e admin admin] Pushing event deleted for resources: {'Network': ['ID=c2615978-1c59-4fbb-826b-fc6aec14e987,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:41.261482 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-225396bc-48ed-4da3-be9d-01811b989a02 req-42767a44-24a1-412b-b591-a9e990479465 service neutron] 10.222.0.13 "GET /v2.0/networks/56b576e6-50b1-4d1e-a1c2-80bcf1883e68?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3125503 Dec 09 21:25:41.294428 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=151030b5-c66b-4f22-a8fc-9aceb1635009,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:41.312842 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-958812af-d553-4b08-a136-ec7338635e0f req-3b2d34da-3915-4415-9ebd-d7f0ee4c8fe7 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:41.314998 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-958812af-d553-4b08-a136-ec7338635e0f req-3b2d34da-3915-4415-9ebd-d7f0ee4c8fe7 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1965480 Dec 09 21:25:41.321637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port be89ffc7-e26a-4049-9372-9a434624cba7 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:25:41.327678 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port be89ffc7-e26a-4049-9372-9a434624cba7 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:41.328057 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:41.330422 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-958812af-d553-4b08-a136-ec7338635e0f req-88d8d5cc-b226-4710-9bea-8954e6254e91 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Request body: {'port': {'device_id': '10aa9750-8504-424a-9c95-af3331c58955', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '23f7f8a3e7b14635b4f7dfa561684399'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:41.437408 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37786) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:41.523130 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:41.539013 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-958812af-d553-4b08-a136-ec7338635e0f req-88d8d5cc-b226-4710-9bea-8954e6254e91 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Made reservation on behalf of 23f7f8a3e7b14635b4f7dfa561684399 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:25:41.544342 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-958812af-d553-4b08-a136-ec7338635e0f req-88d8d5cc-b226-4710-9bea-8954e6254e91 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:41.556883 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-958812af-d553-4b08-a136-ec7338635e0f req-88d8d5cc-b226-4710-9bea-8954e6254e91 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:41.574984 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c162f753-afdd-4a4c-b72f-c2b23228f5b1 req-95965564-ed63-4d48-aa1c-90186aa56cab tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=10aa9750-8504-424a-9c95-af3331c58955 HTTP/1.1" status: 200 len: 210 time: 0.0924752 Dec 09 21:25:41.654452 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7d140039-8cb5-4f96-831e-a336b2aeb132 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=6b406d0a75bb4ddd96157ff43fd37096&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2113717 Dec 09 21:25:41.656334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37798) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:41.775543 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78e6ce61-9f50-4051-99be-439a95ba9994 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:41.846719 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78e6ce61-9f50-4051-99be-439a95ba9994 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:41.848112 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c5703988-e79e-498a-b7d5-482e9c4d8bc2 x-openstack-request-id: req-c5703988-e79e-498a-b7d5-482e9c4d8bc2 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:41.848689 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c008c358-ebaf-4573-9145-fd2e014057cc", "name": "network-vif-plugged", "status": "completed", "tag": "151030b5-c66b-4f22-a8fc-9aceb1635009", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:41.848689 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c5703988-e79e-498a-b7d5-482e9c4d8bc2 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:41.849046 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c008c358-ebaf-4573-9145-fd2e014057cc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '151030b5-c66b-4f22-a8fc-9aceb1635009', 'code': 200} Dec 09 21:25:41.876816 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-958812af-d553-4b08-a136-ec7338635e0f req-88d8d5cc-b226-4710-9bea-8954e6254e91 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:41.893885 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-958812af-d553-4b08-a136-ec7338635e0f req-88d8d5cc-b226-4710-9bea-8954e6254e91 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:41.903418 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port be89ffc7-e26a-4049-9372-9a434624cba7, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=be89ffc7-e26a-4049-9372-9a434624cba7,segment=NetworkSegment(3e23a057-7b71-4625-891b-f66fd33737f2),segment_id=3e23a057-7b71-4625-891b-f66fd33737f2)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:41.913541 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:41.914857 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 39a4e9cb-cd4f-4df2-9c02-6776529dc801 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:41.969889 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=be89ffc7-e26a-4049-9372-9a434624cba7,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:42.007048 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be1570df-48fe-4bc8-99d0-1bf5a608723f req-9af5a42e-d628-45d0-8cb7-f2bcfab2291c tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:42.013914 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be1570df-48fe-4bc8-99d0-1bf5a608723f req-9af5a42e-d628-45d0-8cb7-f2bcfab2291c tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:42.020787 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be1570df-48fe-4bc8-99d0-1bf5a608723f req-9af5a42e-d628-45d0-8cb7-f2bcfab2291c tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:42.028932 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-be1570df-48fe-4bc8-99d0-1bf5a608723f req-9af5a42e-d628-45d0-8cb7-f2bcfab2291c tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 2415 time: 0.1705120 Dec 09 21:25:42.061359 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 39a4e9cb-cd4f-4df2-9c02-6776529dc801 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:25:42.066082 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 39a4e9cb-cd4f-4df2-9c02-6776529dc801 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:42.066633 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:42.075299 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78e6ce61-9f50-4051-99be-439a95ba9994 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:42.078671 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78e6ce61-9f50-4051-99be-439a95ba9994 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:42.080225 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-78e6ce61-9f50-4051-99be-439a95ba9994 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/47e50f10-7095-4f13-aafe-6bb7c79987c2 HTTP/1.1" status: 204 len: 168 time: 0.4209149 Dec 09 21:25:42.144574 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78e6ce61-9f50-4051-99be-439a95ba9994 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=47e50f10-7095-4f13-aafe-6bb7c79987c2,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:42.166206 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-be1570df-48fe-4bc8-99d0-1bf5a608723f req-e7c2bda8-8250-4fae-9df2-63fc5580c060 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1360114 Dec 09 21:25:42.248899 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-958812af-d553-4b08-a136-ec7338635e0f req-88d8d5cc-b226-4710-9bea-8954e6254e91 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Allocated IP 192.168.233.172 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/18bda486-9d6d-41a3-a260-dd244a3838b3) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:25:42.278077 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:42.328191 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-03407734-37f2-4a58-b3a9-5bfde8c39262 req-ef0de0b4-cf42-4167-8be0-ecd1fa891207 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=68d909ed-6a44-454a-9fce-e4dd59e2d088 HTTP/1.1" status: 200 len: 210 time: 0.0907609 Dec 09 21:25:42.339225 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 39a4e9cb-cd4f-4df2-9c02-6776529dc801, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=39a4e9cb-cd4f-4df2-9c02-6776529dc801,segment=NetworkSegment(3e23a057-7b71-4625-891b-f66fd33737f2),segment_id=3e23a057-7b71-4625-891b-f66fd33737f2)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:42.346498 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:42.347947 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device f985bc1a-2e10-4124-b2e9-f8c053c1cf19 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:42.357012 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88d8d5cc-b226-4710-9bea-8954e6254e91 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1470b5ed-2866-47fe-8713-041fb315f355,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:42.384183 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b3e1f1a-d618-4d98-a282-8d9a678f544d req-0ee9fd79-5131-4b91-951f-4a91d58f5781 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:42.393438 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3b3e1f1a-d618-4d98-a282-8d9a678f544d req-0ee9fd79-5131-4b91-951f-4a91d58f5781 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=c008c358-ebaf-4573-9145-fd2e014057cc HTTP/1.1" status: 200 len: 1098 time: 0.6372519 Dec 09 21:25:42.473804 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port f985bc1a-2e10-4124-b2e9-f8c053c1cf19 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:25:42.483598 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port f985bc1a-2e10-4124-b2e9-f8c053c1cf19 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:42.484330 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:42.513126 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=39a4e9cb-cd4f-4df2-9c02-6776529dc801,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:42.553176 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ab0e459-c081-4d8b-bb1c-f7c3ff8a7018 req-4d1d6c45-052b-4122-848e-37b948265388 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:42.554792 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ab0e459-c081-4d8b-bb1c-f7c3ff8a7018 req-4d1d6c45-052b-4122-848e-37b948265388 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=c008c358-ebaf-4573-9145-fd2e014057cc HTTP/1.1" status: 200 len: 946 time: 0.0970099 Dec 09 21:25:42.647482 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3b3e1f1a-d618-4d98-a282-8d9a678f544d req-17336cc3-6dc5-4983-8b8f-ead514f5aaa5 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2350886 Dec 09 21:25:42.652798 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:42.699200 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ab0e459-c081-4d8b-bb1c-f7c3ff8a7018 req-2f900eec-a8eb-40d6-808d-37818cd99c06 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1339719 Dec 09 21:25:42.734854 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port f985bc1a-2e10-4124-b2e9-f8c053c1cf19, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=f985bc1a-2e10-4124-b2e9-f8c053c1cf19,segment=NetworkSegment(e72604b7-1620-485e-8ea6-a66ce97f67f1),segment_id=e72604b7-1620-485e-8ea6-a66ce97f67f1)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:42.735999 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-958812af-d553-4b08-a136-ec7338635e0f req-88d8d5cc-b226-4710-9bea-8954e6254e91 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:42.745268 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:42.821390 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-958812af-d553-4b08-a136-ec7338635e0f req-88d8d5cc-b226-4710-9bea-8954e6254e91 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:42.845984 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=f985bc1a-2e10-4124-b2e9-f8c053c1cf19,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:42.950464 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88d8d5cc-b226-4710-9bea-8954e6254e91 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Pushing event updated for resources: {'Port': ['ID=18bda486-9d6d-41a3-a260-dd244a3838b3,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:42.968078 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-958812af-d553-4b08-a136-ec7338635e0f req-88d8d5cc-b226-4710-9bea-8954e6254e91 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:25:42.970793 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-958812af-d553-4b08-a136-ec7338635e0f req-88d8d5cc-b226-4710-9bea-8954e6254e91 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:42.986747 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-958812af-d553-4b08-a136-ec7338635e0f req-88d8d5cc-b226-4710-9bea-8954e6254e91 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:25:43.029810 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02bdab16-957a-4f1a-b2fb-beb93ffe57e3 req-cabb16b9-7974-411a-a65a-4a0fbf296379 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:43.036200 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02bdab16-957a-4f1a-b2fb-beb93ffe57e3 req-cabb16b9-7974-411a-a65a-4a0fbf296379 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=10aa9750-8504-424a-9c95-af3331c58955 HTTP/1.1" status: 200 len: 936 time: 0.2307577 Dec 09 21:25:43.072128 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-958812af-d553-4b08-a136-ec7338635e0f req-88d8d5cc-b226-4710-9bea-8954e6254e91 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:43.072128 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-958812af-d553-4b08-a136-ec7338635e0f req-88d8d5cc-b226-4710-9bea-8954e6254e91 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:43.099666 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-958812af-d553-4b08-a136-ec7338635e0f req-88d8d5cc-b226-4710-9bea-8954e6254e91 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.7736986 Dec 09 21:25:43.117152 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-958812af-d553-4b08-a136-ec7338635e0f req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Request body: {'port': {'device_id': '10aa9750-8504-424a-9c95-af3331c58955', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:43.165200 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02bdab16-957a-4f1a-b2fb-beb93ffe57e3 req-e1a9504f-98ea-470e-900c-445f593a5e93 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1202416 Dec 09 21:25:43.317931 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-958812af-d553-4b08-a136-ec7338635e0f req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:43.451296 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-008cd4b0-d4fd-4dbc-9a15-7d7cd0895daf None None] Provisioning complete for port 18bda486-9d6d-41a3-a260-dd244a3838b3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:43.452586 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-008cd4b0-d4fd-4dbc-9a15-7d7cd0895daf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:43.483653 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5529f81b-62dc-476f-a552-d27d91e2c63f req-46a7c7fe-6b36-4288-994e-03bb0a44ef02 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=68d909ed-6a44-454a-9fce-e4dd59e2d088 HTTP/1.1" status: 200 len: 210 time: 0.0675001 Dec 09 21:25:43.509741 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96531f8e-c8be-4892-9c53-596889d3562b req-f2765e71-b40d-484d-966b-b01ad5b9c2ca tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:43.525800 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96531f8e-c8be-4892-9c53-596889d3562b req-f2765e71-b40d-484d-966b-b01ad5b9c2ca tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:43.526535 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-008cd4b0-d4fd-4dbc-9a15-7d7cd0895daf None None] Port 18bda486-9d6d-41a3-a260-dd244a3838b3 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:25:43.533519 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96531f8e-c8be-4892-9c53-596889d3562b req-f2765e71-b40d-484d-966b-b01ad5b9c2ca tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:43.541952 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96531f8e-c8be-4892-9c53-596889d3562b req-f2765e71-b40d-484d-966b-b01ad5b9c2ca tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 2418 time: 0.1882606 Dec 09 21:25:43.623809 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96531f8e-c8be-4892-9c53-596889d3562b req-a84555bc-b417-4c61-801f-b12c43d3526d tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0697160 Dec 09 21:25:43.788100 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-958812af-d553-4b08-a136-ec7338635e0f req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 18bda486-9d6d-41a3-a260-dd244a3838b3 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:43.813428 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-958812af-d553-4b08-a136-ec7338635e0f req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:43.848935 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-958812af-d553-4b08-a136-ec7338635e0f req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Transition to ACTIVE for port object 18bda486-9d6d-41a3-a260-dd244a3838b3 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:25:43.851702 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e529b5d4-f89f-43c5-8e52-68ae6fa62846', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'be89ffc7-e26a-4049-9372-9a434624cba7'}, {'server_uuid': 'e529b5d4-f89f-43c5-8e52-68ae6fa62846', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '39a4e9cb-cd4f-4df2-9c02-6776529dc801'}, {'server_uuid': 'e529b5d4-f89f-43c5-8e52-68ae6fa62846', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f985bc1a-2e10-4124-b2e9-f8c053c1cf19'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:43.854666 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c65ec3dc-a0c4-49fb-a0b9-4ab6434a54a7" -d '{"events": [{"server_uuid": "e529b5d4-f89f-43c5-8e52-68ae6fa62846", "name": "network-vif-plugged", "status": "completed", "tag": "be89ffc7-e26a-4049-9372-9a434624cba7"}, {"server_uuid": "e529b5d4-f89f-43c5-8e52-68ae6fa62846", "name": "network-vif-plugged", "status": "completed", "tag": "39a4e9cb-cd4f-4df2-9c02-6776529dc801"}, {"server_uuid": "e529b5d4-f89f-43c5-8e52-68ae6fa62846", "name": "network-vif-plugged", "status": "completed", "tag": "f985bc1a-2e10-4124-b2e9-f8c053c1cf19"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:43.859298 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-958812af-d553-4b08-a136-ec7338635e0f req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:43.958991 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e89d8402-c8a7-430c-a68a-965317cbaa1b req-55f03d41-c23e-455b-8a79-179c3d722ed9 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:43.962675 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e89d8402-c8a7-430c-a68a-965317cbaa1b req-55f03d41-c23e-455b-8a79-179c3d722ed9 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=c008c358-ebaf-4573-9145-fd2e014057cc HTTP/1.1" status: 200 len: 946 time: 0.0862920 Dec 09 21:25:44.020182 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Pushing event updated for resources: {'Port': ['ID=18bda486-9d6d-41a3-a260-dd244a3838b3,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:44.059002 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e89d8402-c8a7-430c-a68a-965317cbaa1b req-1dfc2f7d-eae1-434c-bccf-bbf714d26a2b tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0883112 Dec 09 21:25:44.107321 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-958812af-d553-4b08-a136-ec7338635e0f req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Attempting to bind port 18bda486-9d6d-41a3-a260-dd244a3838b3 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:25:44.109150 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-958812af-d553-4b08-a136-ec7338635e0f req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Attempting to bind port 18bda486-9d6d-41a3-a260-dd244a3838b3 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:25:44.112198 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-958812af-d553-4b08-a136-ec7338635e0f req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Attempting to bind port 18bda486-9d6d-41a3-a260-dd244a3838b3 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:44.148801 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-958812af-d553-4b08-a136-ec7338635e0f req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Port 18bda486-9d6d-41a3-a260-dd244a3838b3 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:25:44.149236 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-958812af-d553-4b08-a136-ec7338635e0f req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Attempting to bind port 18bda486-9d6d-41a3-a260-dd244a3838b3 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:44.212454 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-958812af-d553-4b08-a136-ec7338635e0f req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 25, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:25:44.212858 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-958812af-d553-4b08-a136-ec7338635e0f req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:25:44.213300 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-958812af-d553-4b08-a136-ec7338635e0f req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:25:44.213807 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-958812af-d553-4b08-a136-ec7338635e0f req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Bound port: 18bda486-9d6d-41a3-a260-dd244a3838b3, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:25:44.218910 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-958812af-d553-4b08-a136-ec7338635e0f req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:44.265218 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 525 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fea9083d-c44e-4ceb-b427-04bc1b7b19c7 x-openstack-request-id: req-fea9083d-c44e-4ceb-b427-04bc1b7b19c7 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:44.265746 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e529b5d4-f89f-43c5-8e52-68ae6fa62846", "name": "network-vif-plugged", "status": "completed", "tag": "be89ffc7-e26a-4049-9372-9a434624cba7", "code": 200}, {"server_uuid": "e529b5d4-f89f-43c5-8e52-68ae6fa62846", "name": "network-vif-plugged", "status": "completed", "tag": "39a4e9cb-cd4f-4df2-9c02-6776529dc801", "code": 200}, {"server_uuid": "e529b5d4-f89f-43c5-8e52-68ae6fa62846", "name": "network-vif-plugged", "status": "completed", "tag": "f985bc1a-2e10-4124-b2e9-f8c053c1cf19", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:44.266174 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-fea9083d-c44e-4ceb-b427-04bc1b7b19c7 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:44.275175 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e529b5d4-f89f-43c5-8e52-68ae6fa62846', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'be89ffc7-e26a-4049-9372-9a434624cba7', 'code': 200} Dec 09 21:25:44.275665 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e529b5d4-f89f-43c5-8e52-68ae6fa62846', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '39a4e9cb-cd4f-4df2-9c02-6776529dc801', 'code': 200} Dec 09 21:25:44.276110 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e529b5d4-f89f-43c5-8e52-68ae6fa62846', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f985bc1a-2e10-4124-b2e9-f8c053c1cf19', 'code': 200} Dec 09 21:25:44.356782 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-958812af-d553-4b08-a136-ec7338635e0f req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] For port 18bda486-9d6d-41a3-a260-dd244a3838b3, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:25:44.361028 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-958812af-d553-4b08-a136-ec7338635e0f req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] For port 18bda486-9d6d-41a3-a260-dd244a3838b3, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=18bda486-9d6d-41a3-a260-dd244a3838b3,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:25:44.376044 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-958812af-d553-4b08-a136-ec7338635e0f req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:44.462435 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-225396bc-48ed-4da3-be9d-01811b989a02 req-0108012b-9f95-476c-bde0-4e37b7d65cfc tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:44.464712 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-225396bc-48ed-4da3-be9d-01811b989a02 req-0108012b-9f95-476c-bde0-4e37b7d65cfc tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.31 "GET /v2.0/networks?id=56b576e6-50b1-4d1e-a1c2-80bcf1883e68 HTTP/1.1" status: 200 len: 813 time: 0.5154767 Dec 09 21:25:44.516327 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-225396bc-48ed-4da3-be9d-01811b989a02 req-2f3f547b-40dc-44e6-9d22-a17572b7a2f4 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Request body: {'port': {'device_id': '70a40261-9248-40ae-8cc6-be041817b657', 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68', 'admin_state_up': True, 'tenant_id': '52eb00d38d4442158ed8579a84e900ca'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:44.659645 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-958812af-d553-4b08-a136-ec7338635e0f req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:44.660329 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-958812af-d553-4b08-a136-ec7338635e0f req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:44.662401 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-958812af-d553-4b08-a136-ec7338635e0f req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] 10.222.0.31 "PUT /v2.0/ports/18bda486-9d6d-41a3-a260-dd244a3838b3 HTTP/1.1" status: 200 len: 1097 time: 1.5534067 Dec 09 21:25:44.681252 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '10aa9750-8504-424a-9c95-af3331c58955', 'tag': '18bda486-9d6d-41a3-a260-dd244a3838b3'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:44.687966 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-10a3d3ad-e07a-4547-bc6e-7c48b08dac82" -d '{"events": [{"name": "network-changed", "server_uuid": "10aa9750-8504-424a-9c95-af3331c58955", "tag": "18bda486-9d6d-41a3-a260-dd244a3838b3"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:44.719771 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-225396bc-48ed-4da3-be9d-01811b989a02 req-ccff0ae4-d2ef-4b29-a854-1b478f6bf374 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:44.722217 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-225396bc-48ed-4da3-be9d-01811b989a02 req-ccff0ae4-d2ef-4b29-a854-1b478f6bf374 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.31 "GET /v2.0/networks?id=56b576e6-50b1-4d1e-a1c2-80bcf1883e68 HTTP/1.1" status: 200 len: 813 time: 0.3215804 Dec 09 21:25:44.743887 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-225396bc-48ed-4da3-be9d-01811b989a02 req-c0f6276f-84fd-42f8-8f9c-97b0c6bd7f25 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Request body: {'port': {'device_id': '68d909ed-6a44-454a-9fce-e4dd59e2d088', 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68', 'admin_state_up': True, 'tenant_id': '52eb00d38d4442158ed8579a84e900ca'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:44.780648 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Pushing event updated for resources: {'Port': ['ID=18bda486-9d6d-41a3-a260-dd244a3838b3,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:44.806470 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17555dea-2d53-45e8-b812-3260b59afebe req-c08d5562-91e0-4a40-84c9-71c62d8e40fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:44.807471 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17555dea-2d53-45e8-b812-3260b59afebe req-c08d5562-91e0-4a40-84c9-71c62d8e40fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:44.808887 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17555dea-2d53-45e8-b812-3260b59afebe req-c08d5562-91e0-4a40-84c9-71c62d8e40fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:44.811917 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-17555dea-2d53-45e8-b812-3260b59afebe req-c08d5562-91e0-4a40-84c9-71c62d8e40fc service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 2874 time: 0.3167651 Dec 09 21:25:44.813868 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:44.814378 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:44.814958 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:44.815587 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:44.816094 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:44.816772 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:44.817286 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:44.817470 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b05c1564-1fcd-48cb-b1eb-dad1fb69bca2 req-b3103911-69ef-4892-b15d-1f874df74ad5 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:44.818126 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:44.824231 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:44.824964 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:44.825646 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:44.825781 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b05c1564-1fcd-48cb-b1eb-dad1fb69bca2 req-b3103911-69ef-4892-b15d-1f874df74ad5 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=10aa9750-8504-424a-9c95-af3331c58955 HTTP/1.1" status: 200 len: 948 time: 0.3849788 Dec 09 21:25:44.826373 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:44.827044 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-57fd13e6-97f5-4bc1-b7af-12eca6efb2ba service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:25:44.832208 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-225396bc-48ed-4da3-be9d-01811b989a02 req-2f3f547b-40dc-44e6-9d22-a17572b7a2f4 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Made reservation on behalf of 52eb00d38d4442158ed8579a84e900ca for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:25:44.839221 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-225396bc-48ed-4da3-be9d-01811b989a02 req-2f3f547b-40dc-44e6-9d22-a17572b7a2f4 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:44.891814 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38020) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:44.912686 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8afae46d-7b43-41f9-82d7-034d7e464ce2 req-039ac4de-34e4-497f-95e2-794a1645de42 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:44.914337 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8afae46d-7b43-41f9-82d7-034d7e464ce2 req-039ac4de-34e4-497f-95e2-794a1645de42 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=c008c358-ebaf-4573-9145-fd2e014057cc HTTP/1.1" status: 200 len: 946 time: 0.2181938 Dec 09 21:25:45.012358 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8afae46d-7b43-41f9-82d7-034d7e464ce2 req-3384e7be-e1a8-47d1-92cb-0b31e5813af2 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0842497 Dec 09 21:25:45.037650 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b05c1564-1fcd-48cb-b1eb-dad1fb69bca2 req-71b39862-b5c3-4ccf-ae43-5c1f1284cdc8 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2028430 Dec 09 21:25:45.072542 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-958812af-d553-4b08-a136-ec7338635e0f req-1a2b5658-1247-476e-b59c-04587cbf55e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:45.075403 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-958812af-d553-4b08-a136-ec7338635e0f req-1a2b5658-1247-476e-b59c-04587cbf55e6 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&device_id=10aa9750-8504-424a-9c95-af3331c58955 HTTP/1.1" status: 200 len: 1100 time: 0.2724476 Dec 09 21:25:45.096231 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0668537b-b871-4a43-89d9-bc71732d7745 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:45.112792 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-225396bc-48ed-4da3-be9d-01811b989a02 req-2f3f547b-40dc-44e6-9d22-a17572b7a2f4 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Allocated IP 172.20.0.2 (56b576e6-50b1-4d1e-a1c2-80bcf1883e68/5b18bb60-11fe-4ddd-8fd3-bcb36985a134/3ebbcc5a-481f-4868-8b55-d0176959424c) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:25:45.190528 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-17555dea-2d53-45e8-b812-3260b59afebe req-e888c7b2-9701-437e-b3c5-74e96d85fa89 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3455234 Dec 09 21:25:45.193382 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-225396bc-48ed-4da3-be9d-01811b989a02 req-c0f6276f-84fd-42f8-8f9c-97b0c6bd7f25 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Made reservation on behalf of 52eb00d38d4442158ed8579a84e900ca for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:25:45.194469 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-958812af-d553-4b08-a136-ec7338635e0f req-cbe074c0-6abc-4c72-a813-7d4524aedb8a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.172&port_id=18bda486-9d6d-41a3-a260-dd244a3838b3 HTTP/1.1" status: 200 len: 217 time: 0.1027739 Dec 09 21:25:45.198515 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-225396bc-48ed-4da3-be9d-01811b989a02 req-c0f6276f-84fd-42f8-8f9c-97b0c6bd7f25 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:45.245746 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3af4879f-d338-42f4-8fda-069f656dc545 req-710b7d71-d8a5-4686-8d80-c51ff4d1055e tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=68d909ed-6a44-454a-9fce-e4dd59e2d088 HTTP/1.1" status: 200 len: 210 time: 0.1034038 Dec 09 21:25:45.339535 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0668537b-b871-4a43-89d9-bc71732d7745 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:45.353535 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0668537b-b871-4a43-89d9-bc71732d7745 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:45.369370 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-225396bc-48ed-4da3-be9d-01811b989a02 req-2f3f547b-40dc-44e6-9d22-a17572b7a2f4 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:45.425192 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0668537b-b871-4a43-89d9-bc71732d7745 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=226803c84feb40af8c0a3c27cf0f1858&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5298576 Dec 09 21:25:45.426102 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0668537b-b871-4a43-89d9-bc71732d7745 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8e91de60-39c5-42a7-b707-9a75c20a8088,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:45.430952 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38062) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:45.464545 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54c2172b-d546-4d58-8b64-c05c6cc13ba1 req-ffc61157-9f3b-494b-b9e9-fa5dc412d6a9 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:45.467897 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-958812af-d553-4b08-a136-ec7338635e0f req-004a6913-1a18-4f91-99b7-174f6072ac30 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:45.469677 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-958812af-d553-4b08-a136-ec7338635e0f req-004a6913-1a18-4f91-99b7-174f6072ac30 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0706913 Dec 09 21:25:45.472232 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54c2172b-d546-4d58-8b64-c05c6cc13ba1 req-ffc61157-9f3b-494b-b9e9-fa5dc412d6a9 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:45.473361 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-225396bc-48ed-4da3-be9d-01811b989a02 req-2f3f547b-40dc-44e6-9d22-a17572b7a2f4 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:45.479771 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54c2172b-d546-4d58-8b64-c05c6cc13ba1 req-ffc61157-9f3b-494b-b9e9-fa5dc412d6a9 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:45.481663 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-54c2172b-d546-4d58-8b64-c05c6cc13ba1 req-ffc61157-9f3b-494b-b9e9-fa5dc412d6a9 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 2418 time: 0.1408591 Dec 09 21:25:45.540655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-225396bc-48ed-4da3-be9d-01811b989a02 req-2f3f547b-40dc-44e6-9d22-a17572b7a2f4 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Network 56b576e6-50b1-4d1e-a1c2-80bcf1883e68 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:25:45.544548 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-225396bc-48ed-4da3-be9d-01811b989a02 req-2f3f547b-40dc-44e6-9d22-a17572b7a2f4 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:45.550443 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-acb4312c-3a3d-4803-85fc-3b2ea32943f8 x-openstack-request-id: req-acb4312c-3a3d-4803-85fc-3b2ea32943f8 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:45.551711 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "10aa9750-8504-424a-9c95-af3331c58955", "tag": "18bda486-9d6d-41a3-a260-dd244a3838b3", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:45.551711 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-acb4312c-3a3d-4803-85fc-3b2ea32943f8 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:45.551711 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '10aa9750-8504-424a-9c95-af3331c58955', 'tag': '18bda486-9d6d-41a3-a260-dd244a3838b3', 'status': 'completed', 'code': 200} Dec 09 21:25:45.559924 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-225396bc-48ed-4da3-be9d-01811b989a02 req-2f3f547b-40dc-44e6-9d22-a17572b7a2f4 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:25:45.577535 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-96193865-3498-4067-9e24-5991ea4411a4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:45.609404 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-225396bc-48ed-4da3-be9d-01811b989a02 req-c0f6276f-84fd-42f8-8f9c-97b0c6bd7f25 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Allocated IP 172.20.0.3 (56b576e6-50b1-4d1e-a1c2-80bcf1883e68/5b18bb60-11fe-4ddd-8fd3-bcb36985a134/775d6690-9f80-4aa2-9026-bb97c37d24af) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:25:45.636697 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f3f547b-40dc-44e6-9d22-a17572b7a2f4 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Pushing event updated for resources: {'Port': ['ID=3ebbcc5a-481f-4868-8b55-d0176959424c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:45.652096 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-54c2172b-d546-4d58-8b64-c05c6cc13ba1 req-cb0b8936-b0f7-432e-a043-2fe015d3cdbe tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1548271 Dec 09 21:25:45.655223 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-96193865-3498-4067-9e24-5991ea4411a4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:45.655823 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-225396bc-48ed-4da3-be9d-01811b989a02 req-2f3f547b-40dc-44e6-9d22-a17572b7a2f4 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:45.656473 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-225396bc-48ed-4da3-be9d-01811b989a02 req-2f3f547b-40dc-44e6-9d22-a17572b7a2f4 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:45.661343 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-958812af-d553-4b08-a136-ec7338635e0f req-df9cd9de-bd73-40e3-8901-fe4bcf0fc650 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:45.662990 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-958812af-d553-4b08-a136-ec7338635e0f req-df9cd9de-bd73-40e3-8901-fe4bcf0fc650 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1806443 Dec 09 21:25:45.700349 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-225396bc-48ed-4da3-be9d-01811b989a02 req-2f3f547b-40dc-44e6-9d22-a17572b7a2f4 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2019079 Dec 09 21:25:45.722151 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-225396bc-48ed-4da3-be9d-01811b989a02 req-7c187a42-43c6-4f60-8c20-3e5b38e64bfc service neutron] Request body: {'port': {'device_id': '70a40261-9248-40ae-8cc6-be041817b657', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:45.832588 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-96193865-3498-4067-9e24-5991ea4411a4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:45.836044 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-96193865-3498-4067-9e24-5991ea4411a4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:45.840134 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-96193865-3498-4067-9e24-5991ea4411a4 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/8e91de60-39c5-42a7-b707-9a75c20a8088 HTTP/1.1" status: 204 len: 168 time: 0.4055097 Dec 09 21:25:45.852577 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96193865-3498-4067-9e24-5991ea4411a4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8e91de60-39c5-42a7-b707-9a75c20a8088,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:45.855139 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-225396bc-48ed-4da3-be9d-01811b989a02 req-7c187a42-43c6-4f60-8c20-3e5b38e64bfc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:45.871834 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-958812af-d553-4b08-a136-ec7338635e0f req-c1831d6b-b1a8-4691-a693-642dbfae42ff service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1983492 Dec 09 21:25:45.905624 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-225396bc-48ed-4da3-be9d-01811b989a02 req-c0f6276f-84fd-42f8-8f9c-97b0c6bd7f25 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:45.955703 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-225396bc-48ed-4da3-be9d-01811b989a02 req-c0f6276f-84fd-42f8-8f9c-97b0c6bd7f25 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:46.057135 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0f6276f-84fd-42f8-8f9c-97b0c6bd7f25 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Pushing event updated for resources: {'Port': ['ID=775d6690-9f80-4aa2-9026-bb97c37d24af,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:46.070935 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-225396bc-48ed-4da3-be9d-01811b989a02 req-c0f6276f-84fd-42f8-8f9c-97b0c6bd7f25 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Network 56b576e6-50b1-4d1e-a1c2-80bcf1883e68 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:25:46.076214 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-225396bc-48ed-4da3-be9d-01811b989a02 req-c0f6276f-84fd-42f8-8f9c-97b0c6bd7f25 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:46.079290 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-225396bc-48ed-4da3-be9d-01811b989a02 req-c0f6276f-84fd-42f8-8f9c-97b0c6bd7f25 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:25:46.154958 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-958812af-d553-4b08-a136-ec7338635e0f req-00cb2d96-2442-4141-a5f4-d29be6d1d5d8 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2654581 Dec 09 21:25:46.219885 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-225396bc-48ed-4da3-be9d-01811b989a02 req-c0f6276f-84fd-42f8-8f9c-97b0c6bd7f25 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:46.220919 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-225396bc-48ed-4da3-be9d-01811b989a02 req-c0f6276f-84fd-42f8-8f9c-97b0c6bd7f25 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:46.274529 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4d1d07-89ba-4d1d-a777-547897d5396d req-67cb9af2-c22d-4af4-bbe8-3397b4a559cf tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:46.278182 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4d1d07-89ba-4d1d-a777-547897d5396d req-67cb9af2-c22d-4af4-bbe8-3397b4a559cf tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=c008c358-ebaf-4573-9145-fd2e014057cc HTTP/1.1" status: 200 len: 946 time: 0.1598942 Dec 09 21:25:46.282198 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-225396bc-48ed-4da3-be9d-01811b989a02 req-c0f6276f-84fd-42f8-8f9c-97b0c6bd7f25 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5427272 Dec 09 21:25:46.307083 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-225396bc-48ed-4da3-be9d-01811b989a02 req-13e7238b-ac60-495b-a896-47296d39c266 service neutron] Request body: {'port': {'device_id': '68d909ed-6a44-454a-9fce-e4dd59e2d088', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:46.483960 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c9eed43-1888-4c11-b670-c5d818037269 req-3a540d8a-2060-4edd-a24c-617a15346ecf tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:46.493568 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7c9eed43-1888-4c11-b670-c5d818037269 req-3a540d8a-2060-4edd-a24c-617a15346ecf tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=10aa9750-8504-424a-9c95-af3331c58955 HTTP/1.1" status: 200 len: 948 time: 0.1724000 Dec 09 21:25:46.498981 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4d1d07-89ba-4d1d-a777-547897d5396d req-678b180b-7570-4882-babd-f8e37e4c02f2 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2147524 Dec 09 21:25:46.507067 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-225396bc-48ed-4da3-be9d-01811b989a02 req-13e7238b-ac60-495b-a896-47296d39c266 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:46.753091 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7c9eed43-1888-4c11-b670-c5d818037269 req-a5e03c52-1cc4-4862-ae96-199485604ddb tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2584963 Dec 09 21:25:46.758980 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10a3d3ad-e07a-4547-bc6e-7c48b08dac82 req-723c5b39-ec21-4d37-9371-a86335a689b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:46.761246 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-10a3d3ad-e07a-4547-bc6e-7c48b08dac82 req-723c5b39-ec21-4d37-9371-a86335a689b2 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&device_id=10aa9750-8504-424a-9c95-af3331c58955 HTTP/1.1" status: 200 len: 1100 time: 0.5351889 Dec 09 21:25:46.817053 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-225396bc-48ed-4da3-be9d-01811b989a02 req-7c187a42-43c6-4f60-8c20-3e5b38e64bfc service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3ebbcc5a-481f-4868-8b55-d0176959424c {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:46.828896 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-225396bc-48ed-4da3-be9d-01811b989a02 req-7c187a42-43c6-4f60-8c20-3e5b38e64bfc service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:46.875614 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-225396bc-48ed-4da3-be9d-01811b989a02 req-7c187a42-43c6-4f60-8c20-3e5b38e64bfc service neutron] Transition to ACTIVE for port object 3ebbcc5a-481f-4868-8b55-d0176959424c will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:25:46.907882 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-225396bc-48ed-4da3-be9d-01811b989a02 req-7c187a42-43c6-4f60-8c20-3e5b38e64bfc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:47.066476 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c187a42-43c6-4f60-8c20-3e5b38e64bfc service neutron] Pushing event updated for resources: {'Port': ['ID=3ebbcc5a-481f-4868-8b55-d0176959424c,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:47.104899 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-249f497b-4377-4785-838d-f1422c08fb1d req-5d6ce756-3baa-41c7-8bd8-d7d2e5321a99 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:47.107302 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-249f497b-4377-4785-838d-f1422c08fb1d req-5d6ce756-3baa-41c7-8bd8-d7d2e5321a99 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=68d909ed-6a44-454a-9fce-e4dd59e2d088 HTTP/1.1" status: 200 len: 931 time: 0.2234392 Dec 09 21:25:47.114960 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10a3d3ad-e07a-4547-bc6e-7c48b08dac82 req-439a642d-e0f2-4a68-993a-5ee6fb259654 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:47.117044 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-10a3d3ad-e07a-4547-bc6e-7c48b08dac82 req-439a642d-e0f2-4a68-993a-5ee6fb259654 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.2713549 Dec 09 21:25:47.151481 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-225396bc-48ed-4da3-be9d-01811b989a02 req-7c187a42-43c6-4f60-8c20-3e5b38e64bfc service neutron] Attempting to bind port 3ebbcc5a-481f-4868-8b55-d0176959424c on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:25:47.151810 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-225396bc-48ed-4da3-be9d-01811b989a02 req-7c187a42-43c6-4f60-8c20-3e5b38e64bfc service neutron] Attempting to bind port 3ebbcc5a-481f-4868-8b55-d0176959424c by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'bada42e9-278b-46e3-bbc2-c2d37f00c32d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:25:47.152141 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-225396bc-48ed-4da3-be9d-01811b989a02 req-7c187a42-43c6-4f60-8c20-3e5b38e64bfc service neutron] Attempting to bind port 3ebbcc5a-481f-4868-8b55-d0176959424c on network 56b576e6-50b1-4d1e-a1c2-80bcf1883e68 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:47.193321 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-225396bc-48ed-4da3-be9d-01811b989a02 req-7c187a42-43c6-4f60-8c20-3e5b38e64bfc service neutron] Port 3ebbcc5a-481f-4868-8b55-d0176959424c on network 56b576e6-50b1-4d1e-a1c2-80bcf1883e68 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:25:47.193635 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-225396bc-48ed-4da3-be9d-01811b989a02 req-7c187a42-43c6-4f60-8c20-3e5b38e64bfc service neutron] Attempting to bind port 3ebbcc5a-481f-4868-8b55-d0176959424c on network 56b576e6-50b1-4d1e-a1c2-80bcf1883e68 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:47.205569 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-10a3d3ad-e07a-4547-bc6e-7c48b08dac82 req-e2082e11-efed-49d1-a201-c08b99adab91 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.172&port_id=18bda486-9d6d-41a3-a260-dd244a3838b3 HTTP/1.1" status: 200 len: 217 time: 0.0654297 Dec 09 21:25:47.206613 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-225396bc-48ed-4da3-be9d-01811b989a02 req-7c187a42-43c6-4f60-8c20-3e5b38e64bfc service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 25, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:25:47.206959 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-225396bc-48ed-4da3-be9d-01811b989a02 req-7c187a42-43c6-4f60-8c20-3e5b38e64bfc service neutron] Checking segment: {'id': 'bada42e9-278b-46e3-bbc2-c2d37f00c32d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:25:47.207343 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-225396bc-48ed-4da3-be9d-01811b989a02 req-7c187a42-43c6-4f60-8c20-3e5b38e64bfc service neutron] Bound using segment: {'id': 'bada42e9-278b-46e3-bbc2-c2d37f00c32d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:25:47.210027 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-225396bc-48ed-4da3-be9d-01811b989a02 req-7c187a42-43c6-4f60-8c20-3e5b38e64bfc service neutron] Bound port: 3ebbcc5a-481f-4868-8b55-d0176959424c, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bada42e9-278b-46e3-bbc2-c2d37f00c32d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:25:47.210401 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-225396bc-48ed-4da3-be9d-01811b989a02 req-7c187a42-43c6-4f60-8c20-3e5b38e64bfc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:47.266188 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10a3d3ad-e07a-4547-bc6e-7c48b08dac82 req-46e36f50-5b34-4cb8-b2ec-2982911fad06 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:47.267839 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-10a3d3ad-e07a-4547-bc6e-7c48b08dac82 req-46e36f50-5b34-4cb8-b2ec-2982911fad06 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0547440 Dec 09 21:25:47.297076 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-249f497b-4377-4785-838d-f1422c08fb1d req-0ee17d2d-7db6-439f-83b3-45f4447fc677 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1720977 Dec 09 21:25:47.387219 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10a3d3ad-e07a-4547-bc6e-7c48b08dac82 req-6380f185-8cfd-4ec1-bc9f-e549cb04d4fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:47.389424 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-10a3d3ad-e07a-4547-bc6e-7c48b08dac82 req-6380f185-8cfd-4ec1-bc9f-e549cb04d4fb service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1143620 Dec 09 21:25:47.396954 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-225396bc-48ed-4da3-be9d-01811b989a02 req-7c187a42-43c6-4f60-8c20-3e5b38e64bfc service neutron] For port 3ebbcc5a-481f-4868-8b55-d0176959424c, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:25:47.401282 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-225396bc-48ed-4da3-be9d-01811b989a02 req-7c187a42-43c6-4f60-8c20-3e5b38e64bfc service neutron] For port 3ebbcc5a-481f-4868-8b55-d0176959424c, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=3ebbcc5a-481f-4868-8b55-d0176959424c,segment=NetworkSegment(bada42e9-278b-46e3-bbc2-c2d37f00c32d),segment_id=bada42e9-278b-46e3-bbc2-c2d37f00c32d)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:25:47.402773 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-225396bc-48ed-4da3-be9d-01811b989a02 req-13e7238b-ac60-495b-a896-47296d39c266 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 775d6690-9f80-4aa2-9026-bb97c37d24af {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:47.415012 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-225396bc-48ed-4da3-be9d-01811b989a02 req-13e7238b-ac60-495b-a896-47296d39c266 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:47.433412 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-225396bc-48ed-4da3-be9d-01811b989a02 req-13e7238b-ac60-495b-a896-47296d39c266 service neutron] Transition to ACTIVE for port object 775d6690-9f80-4aa2-9026-bb97c37d24af will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:25:47.463429 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-225396bc-48ed-4da3-be9d-01811b989a02 req-13e7238b-ac60-495b-a896-47296d39c266 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:47.477948 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-225396bc-48ed-4da3-be9d-01811b989a02 req-7c187a42-43c6-4f60-8c20-3e5b38e64bfc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:47.532501 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-10a3d3ad-e07a-4547-bc6e-7c48b08dac82 req-216a6edd-dd98-4b66-a213-4e736d1609be service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1263278 Dec 09 21:25:47.534607 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-225396bc-48ed-4da3-be9d-01811b989a02 req-7c187a42-43c6-4f60-8c20-3e5b38e64bfc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:47.535566 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-225396bc-48ed-4da3-be9d-01811b989a02 req-7c187a42-43c6-4f60-8c20-3e5b38e64bfc service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:47.536864 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-225396bc-48ed-4da3-be9d-01811b989a02 req-7c187a42-43c6-4f60-8c20-3e5b38e64bfc service neutron] 10.222.0.31 "PUT /v2.0/ports/3ebbcc5a-481f-4868-8b55-d0176959424c HTTP/1.1" status: 200 len: 1092 time: 1.8197763 Dec 09 21:25:47.537927 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffbc78e5-76a4-45e9-a429-d09b642d7eca req-6514a1ee-dc23-4f44-ade3-90eeed5d0f71 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:47.544428 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffbc78e5-76a4-45e9-a429-d09b642d7eca req-6514a1ee-dc23-4f44-ade3-90eeed5d0f71 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:47.551279 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffbc78e5-76a4-45e9-a429-d09b642d7eca req-6514a1ee-dc23-4f44-ade3-90eeed5d0f71 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:47.551797 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '70a40261-9248-40ae-8cc6-be041817b657', 'tag': '3ebbcc5a-481f-4868-8b55-d0176959424c'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:47.554389 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-94c68691-0f8c-49d9-9795-4f101ed11937" -d '{"events": [{"name": "network-changed", "server_uuid": "70a40261-9248-40ae-8cc6-be041817b657", "tag": "3ebbcc5a-481f-4868-8b55-d0176959424c"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:47.559519 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ffbc78e5-76a4-45e9-a429-d09b642d7eca req-6514a1ee-dc23-4f44-ade3-90eeed5d0f71 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 2418 time: 0.1294651 Dec 09 21:25:47.579315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13e7238b-ac60-495b-a896-47296d39c266 service neutron] Pushing event updated for resources: {'Port': ['ID=775d6690-9f80-4aa2-9026-bb97c37d24af,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:47.592627 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c187a42-43c6-4f60-8c20-3e5b38e64bfc service neutron] Pushing event updated for resources: {'Port': ['ID=3ebbcc5a-481f-4868-8b55-d0176959424c,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:47.672176 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ffbc78e5-76a4-45e9-a429-d09b642d7eca req-1c7e56e9-a576-4a33-8d33-2bd6bc52cb01 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1114886 Dec 09 21:25:47.700299 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-225396bc-48ed-4da3-be9d-01811b989a02 req-ae141df7-f302-4044-9ca5-e6cfd99e9c56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:47.701832 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-225396bc-48ed-4da3-be9d-01811b989a02 req-ae141df7-f302-4044-9ca5-e6cfd99e9c56 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=52eb00d38d4442158ed8579a84e900ca&device_id=70a40261-9248-40ae-8cc6-be041817b657 HTTP/1.1" status: 200 len: 1095 time: 0.0974953 Dec 09 21:25:47.707423 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-10a3d3ad-e07a-4547-bc6e-7c48b08dac82 req-c1a83374-7855-48c4-9468-0bcbb9919ead service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1500578 Dec 09 21:25:47.707637 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-225396bc-48ed-4da3-be9d-01811b989a02 req-13e7238b-ac60-495b-a896-47296d39c266 service neutron] Attempting to bind port 775d6690-9f80-4aa2-9026-bb97c37d24af on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:25:47.707957 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-225396bc-48ed-4da3-be9d-01811b989a02 req-13e7238b-ac60-495b-a896-47296d39c266 service neutron] Attempting to bind port 775d6690-9f80-4aa2-9026-bb97c37d24af by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'bada42e9-278b-46e3-bbc2-c2d37f00c32d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:25:47.708290 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-225396bc-48ed-4da3-be9d-01811b989a02 req-13e7238b-ac60-495b-a896-47296d39c266 service neutron] Attempting to bind port 775d6690-9f80-4aa2-9026-bb97c37d24af on network 56b576e6-50b1-4d1e-a1c2-80bcf1883e68 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:47.712950 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-225396bc-48ed-4da3-be9d-01811b989a02 req-13e7238b-ac60-495b-a896-47296d39c266 service neutron] Port 775d6690-9f80-4aa2-9026-bb97c37d24af on network 56b576e6-50b1-4d1e-a1c2-80bcf1883e68 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:25:47.713339 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-225396bc-48ed-4da3-be9d-01811b989a02 req-13e7238b-ac60-495b-a896-47296d39c266 service neutron] Attempting to bind port 775d6690-9f80-4aa2-9026-bb97c37d24af on network 56b576e6-50b1-4d1e-a1c2-80bcf1883e68 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:47.718728 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-225396bc-48ed-4da3-be9d-01811b989a02 req-13e7238b-ac60-495b-a896-47296d39c266 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 25, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:25:47.719131 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-225396bc-48ed-4da3-be9d-01811b989a02 req-13e7238b-ac60-495b-a896-47296d39c266 service neutron] Checking segment: {'id': 'bada42e9-278b-46e3-bbc2-c2d37f00c32d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:25:47.719718 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-225396bc-48ed-4da3-be9d-01811b989a02 req-13e7238b-ac60-495b-a896-47296d39c266 service neutron] Bound using segment: {'id': 'bada42e9-278b-46e3-bbc2-c2d37f00c32d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:25:47.720223 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-225396bc-48ed-4da3-be9d-01811b989a02 req-13e7238b-ac60-495b-a896-47296d39c266 service neutron] Bound port: 775d6690-9f80-4aa2-9026-bb97c37d24af, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bada42e9-278b-46e3-bbc2-c2d37f00c32d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:25:47.720757 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-225396bc-48ed-4da3-be9d-01811b989a02 req-13e7238b-ac60-495b-a896-47296d39c266 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:47.769837 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-225396bc-48ed-4da3-be9d-01811b989a02 req-514e46fa-6d54-400e-be0a-ae1c307f1b82 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=3ebbcc5a-481f-4868-8b55-d0176959424c HTTP/1.1" status: 200 len: 217 time: 0.0466306 Dec 09 21:25:47.825621 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-225396bc-48ed-4da3-be9d-01811b989a02 req-f3ba43b9-cdcc-4a0b-9e78-8ca820dc0e24 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:47.827793 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-225396bc-48ed-4da3-be9d-01811b989a02 req-f3ba43b9-cdcc-4a0b-9e78-8ca820dc0e24 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5b18bb60-11fe-4ddd-8fd3-bcb36985a134 HTTP/1.1" status: 200 len: 853 time: 0.0499566 Dec 09 21:25:47.840849 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-225396bc-48ed-4da3-be9d-01811b989a02 req-13e7238b-ac60-495b-a896-47296d39c266 service neutron] For port 775d6690-9f80-4aa2-9026-bb97c37d24af, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:25:47.844996 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-225396bc-48ed-4da3-be9d-01811b989a02 req-13e7238b-ac60-495b-a896-47296d39c266 service neutron] For port 775d6690-9f80-4aa2-9026-bb97c37d24af, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=775d6690-9f80-4aa2-9026-bb97c37d24af,segment=NetworkSegment(bada42e9-278b-46e3-bbc2-c2d37f00c32d),segment_id=bada42e9-278b-46e3-bbc2-c2d37f00c32d)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:25:47.854459 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-225396bc-48ed-4da3-be9d-01811b989a02 req-13e7238b-ac60-495b-a896-47296d39c266 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:47.868837 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-225396bc-48ed-4da3-be9d-01811b989a02 req-856f3bf1-2aef-4542-9ad4-23c2088bad5f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=56b576e6-50b1-4d1e-a1c2-80bcf1883e68&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0337791 Dec 09 21:25:47.871312 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfa27939-d91c-4425-8d04-4fd94e3f60e1 req-6a02b60c-4c96-4709-b7d9-6a437b44c10e tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:47.873070 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfa27939-d91c-4425-8d04-4fd94e3f60e1 req-6a02b60c-4c96-4709-b7d9-6a437b44c10e tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=c008c358-ebaf-4573-9145-fd2e014057cc HTTP/1.1" status: 200 len: 946 time: 0.1003423 Dec 09 21:25:47.973821 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-225396bc-48ed-4da3-be9d-01811b989a02 req-8067a4da-970c-451f-a5be-0358b71e2269 service neutron] 10.222.0.31 "GET /v2.0/networks/56b576e6-50b1-4d1e-a1c2-80bcf1883e68?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0963614 Dec 09 21:25:48.073999 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-225396bc-48ed-4da3-be9d-01811b989a02 req-91724fd9-6279-4352-9861-26262a2daaca service neutron] 10.222.0.31 "GET /v2.0/networks/56b576e6-50b1-4d1e-a1c2-80bcf1883e68?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0918002 Dec 09 21:25:48.184492 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-225396bc-48ed-4da3-be9d-01811b989a02 req-13e7238b-ac60-495b-a896-47296d39c266 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:48.185183 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-225396bc-48ed-4da3-be9d-01811b989a02 req-13e7238b-ac60-495b-a896-47296d39c266 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:48.186649 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-225396bc-48ed-4da3-be9d-01811b989a02 req-13e7238b-ac60-495b-a896-47296d39c266 service neutron] 10.222.0.31 "PUT /v2.0/ports/775d6690-9f80-4aa2-9026-bb97c37d24af HTTP/1.1" status: 200 len: 1092 time: 1.8922994 Dec 09 21:25:48.187178 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '68d909ed-6a44-454a-9fce-e4dd59e2d088', 'tag': '775d6690-9f80-4aa2-9026-bb97c37d24af'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:48.188680 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-af733f78-0a90-4128-a6f5-a6ce18e4a04a x-openstack-request-id: req-af733f78-0a90-4128-a6f5-a6ce18e4a04a {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:48.189029 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "70a40261-9248-40ae-8cc6-be041817b657", "tag": "3ebbcc5a-481f-4868-8b55-d0176959424c", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:48.189337 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-af733f78-0a90-4128-a6f5-a6ce18e4a04a {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:48.189567 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-949f6bb7-5eed-467e-ad69-bb23aa3eb242" -d '{"events": [{"name": "network-changed", "server_uuid": "68d909ed-6a44-454a-9fce-e4dd59e2d088", "tag": "775d6690-9f80-4aa2-9026-bb97c37d24af"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:48.189843 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '70a40261-9248-40ae-8cc6-be041817b657', 'tag': '3ebbcc5a-481f-4868-8b55-d0176959424c', 'status': 'completed', 'code': 200} Dec 09 21:25:48.239073 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13e7238b-ac60-495b-a896-47296d39c266 service neutron] Pushing event updated for resources: {'Port': ['ID=775d6690-9f80-4aa2-9026-bb97c37d24af,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:48.279137 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfa27939-d91c-4425-8d04-4fd94e3f60e1 req-e9e4b99d-6976-4037-a67a-0ac48cd10c1b tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3813944 Dec 09 21:25:48.291391 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-225396bc-48ed-4da3-be9d-01811b989a02 req-0ed5bd3a-7d70-40d6-b3b5-56052a7d0d37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:48.294433 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-225396bc-48ed-4da3-be9d-01811b989a02 req-0ed5bd3a-7d70-40d6-b3b5-56052a7d0d37 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=52eb00d38d4442158ed8579a84e900ca&device_id=68d909ed-6a44-454a-9fce-e4dd59e2d088 HTTP/1.1" status: 200 len: 1095 time: 0.0584345 Dec 09 21:25:48.299839 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94c68691-0f8c-49d9-9795-4f101ed11937 req-7ea4b974-14b7-49cb-aaf0-6802f1217178 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:48.301741 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94c68691-0f8c-49d9-9795-4f101ed11937 req-7ea4b974-14b7-49cb-aaf0-6802f1217178 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=52eb00d38d4442158ed8579a84e900ca&device_id=70a40261-9248-40ae-8cc6-be041817b657 HTTP/1.1" status: 200 len: 1095 time: 0.0826666 Dec 09 21:25:48.353453 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-225396bc-48ed-4da3-be9d-01811b989a02 req-c4beb8da-fbcc-4a52-a9ee-82b6204e2f17 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=775d6690-9f80-4aa2-9026-bb97c37d24af HTTP/1.1" status: 200 len: 217 time: 0.0427253 Dec 09 21:25:48.416893 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-225396bc-48ed-4da3-be9d-01811b989a02 req-e16d143b-f656-46cf-9dd3-181c676f0eb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:48.419819 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-225396bc-48ed-4da3-be9d-01811b989a02 req-e16d143b-f656-46cf-9dd3-181c676f0eb3 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5b18bb60-11fe-4ddd-8fd3-bcb36985a134 HTTP/1.1" status: 200 len: 853 time: 0.0554435 Dec 09 21:25:48.439115 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c39662-891e-4824-b891-0d9af5bb8966 req-df895481-a826-4d73-ad66-44fbac773049 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:48.446788 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96c39662-891e-4824-b891-0d9af5bb8966 req-df895481-a826-4d73-ad66-44fbac773049 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=10aa9750-8504-424a-9c95-af3331c58955 HTTP/1.1" status: 200 len: 948 time: 0.1118550 Dec 09 21:25:48.462360 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-225396bc-48ed-4da3-be9d-01811b989a02 req-92b6ec38-9e6b-4761-8d4e-d6771fa92f8e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=56b576e6-50b1-4d1e-a1c2-80bcf1883e68&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0333440 Dec 09 21:25:48.503816 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94c68691-0f8c-49d9-9795-4f101ed11937 req-246d477d-ec2f-4b77-86cc-b0c617dca7ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:48.505626 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94c68691-0f8c-49d9-9795-4f101ed11937 req-246d477d-ec2f-4b77-86cc-b0c617dca7ba service neutron] 10.222.0.31 "GET /v2.0/networks?id=56b576e6-50b1-4d1e-a1c2-80bcf1883e68 HTTP/1.1" status: 200 len: 914 time: 0.1929727 Dec 09 21:25:48.515748 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96c39662-891e-4824-b891-0d9af5bb8966 req-e27262c5-28fb-4b35-8ccd-f0838f6d09a6 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0676186 Dec 09 21:25:48.591311 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-225396bc-48ed-4da3-be9d-01811b989a02 req-651e36ac-aa70-45f0-a4e2-54d14b282924 service neutron] 10.222.0.31 "GET /v2.0/networks/56b576e6-50b1-4d1e-a1c2-80bcf1883e68?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1192229 Dec 09 21:25:48.601942 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fe4662ac-f44f-49eb-811e-6dcaad6ef2ef x-openstack-request-id: req-fe4662ac-f44f-49eb-811e-6dcaad6ef2ef {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:48.602104 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "68d909ed-6a44-454a-9fce-e4dd59e2d088", "tag": "775d6690-9f80-4aa2-9026-bb97c37d24af", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:48.602334 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-fe4662ac-f44f-49eb-811e-6dcaad6ef2ef {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:48.602999 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '68d909ed-6a44-454a-9fce-e4dd59e2d088', 'tag': '775d6690-9f80-4aa2-9026-bb97c37d24af', 'status': 'completed', 'code': 200} Dec 09 21:25:48.604307 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94c68691-0f8c-49d9-9795-4f101ed11937 req-f80b0e30-a1ae-481a-a066-1fe559e06ec5 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=3ebbcc5a-481f-4868-8b55-d0176959424c HTTP/1.1" status: 200 len: 217 time: 0.0876167 Dec 09 21:25:48.694402 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94c68691-0f8c-49d9-9795-4f101ed11937 req-4bf4e962-64a2-44ce-af3e-c8ca5dc64a25 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:48.697408 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94c68691-0f8c-49d9-9795-4f101ed11937 req-4bf4e962-64a2-44ce-af3e-c8ca5dc64a25 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5b18bb60-11fe-4ddd-8fd3-bcb36985a134 HTTP/1.1" status: 200 len: 853 time: 0.0843771 Dec 09 21:25:48.701772 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-225396bc-48ed-4da3-be9d-01811b989a02 req-fb782aa3-9c4e-4508-8bdb-03815645ec84 service neutron] 10.222.0.31 "GET /v2.0/networks/56b576e6-50b1-4d1e-a1c2-80bcf1883e68?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0970881 Dec 09 21:25:48.768390 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94c68691-0f8c-49d9-9795-4f101ed11937 req-d81997c1-ac86-40f4-88b9-f41622f00ad6 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=56b576e6-50b1-4d1e-a1c2-80bcf1883e68&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0491245 Dec 09 21:25:48.804248 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 18bda486-9d6d-41a3-a260-dd244a3838b3 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:25:48.864104 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-949f6bb7-5eed-467e-ad69-bb23aa3eb242 req-24243cbf-7ac8-44f5-bda0-340121426ed0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:48.872730 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-949f6bb7-5eed-467e-ad69-bb23aa3eb242 req-24243cbf-7ac8-44f5-bda0-340121426ed0 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=52eb00d38d4442158ed8579a84e900ca&device_id=68d909ed-6a44-454a-9fce-e4dd59e2d088 HTTP/1.1" status: 200 len: 1095 time: 0.0923293 Dec 09 21:25:48.955225 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 18bda486-9d6d-41a3-a260-dd244a3838b3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=18bda486-9d6d-41a3-a260-dd244a3838b3,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:48.992609 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9929618e-e257-48cb-a2ea-d83bc8588eb4 req-22aa13dd-b0fc-4b14-b201-8f50f98b3c6d tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:48.994134 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9929618e-e257-48cb-a2ea-d83bc8588eb4 req-22aa13dd-b0fc-4b14-b201-8f50f98b3c6d tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=68d909ed-6a44-454a-9fce-e4dd59e2d088 HTTP/1.1" status: 200 len: 943 time: 0.2282803 Dec 09 21:25:48.994423 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '18bda486-9d6d-41a3-a260-dd244a3838b3', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '18bda486-9d6d-41a3-a260-dd244a3838b3', 'mac_address': 'fa:16:3e:e3:8f:9e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.172'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:25:49.056845 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:49.062076 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-949f6bb7-5eed-467e-ad69-bb23aa3eb242 req-085fdd5f-d4a3-4b38-808b-2ab8345a46f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:49.063858 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-949f6bb7-5eed-467e-ad69-bb23aa3eb242 req-085fdd5f-d4a3-4b38-808b-2ab8345a46f7 service neutron] 10.222.0.31 "GET /v2.0/networks?id=56b576e6-50b1-4d1e-a1c2-80bcf1883e68 HTTP/1.1" status: 200 len: 914 time: 0.1831629 Dec 09 21:25:49.080177 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 18bda486-9d6d-41a3-a260-dd244a3838b3 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:49.102737 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94c68691-0f8c-49d9-9795-4f101ed11937 req-220dc882-f23f-4a32-93c0-02825fde36cf service neutron] 10.222.0.31 "GET /v2.0/networks/56b576e6-50b1-4d1e-a1c2-80bcf1883e68?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3101242 Dec 09 21:25:49.106857 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 18bda486-9d6d-41a3-a260-dd244a3838b3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=18bda486-9d6d-41a3-a260-dd244a3838b3,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:49.115764 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:49.149938 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-949f6bb7-5eed-467e-ad69-bb23aa3eb242 req-84b82517-fa37-46bc-a297-14980eb062d5 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=775d6690-9f80-4aa2-9026-bb97c37d24af HTTP/1.1" status: 200 len: 217 time: 0.0775790 Dec 09 21:25:49.161517 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38344) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:49.165308 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9929618e-e257-48cb-a2ea-d83bc8588eb4 req-ffd2e8a8-0ed9-4795-b81f-e1c0e8db32f3 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1550143 Dec 09 21:25:49.225333 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=18bda486-9d6d-41a3-a260-dd244a3838b3,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:49.255337 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-450b8dea-a13c-4a38-a514-6b64d325a347 req-9c996467-cb91-44cd-a998-56a81988411e tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:49.256924 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-450b8dea-a13c-4a38-a514-6b64d325a347 req-9c996467-cb91-44cd-a998-56a81988411e tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.31 "GET /v2.0/ports?device_id=c008c358-ebaf-4573-9145-fd2e014057cc HTTP/1.1" status: 200 len: 946 time: 0.2043147 Dec 09 21:25:49.319913 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-949f6bb7-5eed-467e-ad69-bb23aa3eb242 req-12ddb014-93ec-4474-91ed-dd3cfdfd002f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:49.321632 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-949f6bb7-5eed-467e-ad69-bb23aa3eb242 req-12ddb014-93ec-4474-91ed-dd3cfdfd002f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5b18bb60-11fe-4ddd-8fd3-bcb36985a134 HTTP/1.1" status: 200 len: 853 time: 0.1565895 Dec 09 21:25:49.348581 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94c68691-0f8c-49d9-9795-4f101ed11937 req-686a5112-67d0-4c68-bde6-78e24f958956 service neutron] 10.222.0.31 "GET /v2.0/networks/56b576e6-50b1-4d1e-a1c2-80bcf1883e68?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1822109 Dec 09 21:25:49.390763 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-949f6bb7-5eed-467e-ad69-bb23aa3eb242 req-0dc571ee-d4a0-4444-a763-3bc4fa5fa519 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=56b576e6-50b1-4d1e-a1c2-80bcf1883e68&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0294933 Dec 09 21:25:49.441840 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['18bda486-9d6d-41a3-a260-dd244a3838b3'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:25:49.457876 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-319b7f5b-596e-4d1c-bd3e-fa334ec9fb97 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:49.462260 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a80a8b71-0b1c-4ac3-853b-fb6c36211afc req-acfa7915-628a-46b9-9324-f7c54a745e72 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:49.464185 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a80a8b71-0b1c-4ac3-853b-fb6c36211afc req-acfa7915-628a-46b9-9324-f7c54a745e72 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=c008c358-ebaf-4573-9145-fd2e014057cc HTTP/1.1" status: 200 len: 946 time: 0.0646026 Dec 09 21:25:49.474032 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a46112b-77cd-4941-b99d-fd20131b4e94 req-84e148db-8a2f-47a3-a6bb-041e936e73b0 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:49.480733 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a46112b-77cd-4941-b99d-fd20131b4e94 req-84e148db-8a2f-47a3-a6bb-041e936e73b0 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:49.487100 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a46112b-77cd-4941-b99d-fd20131b4e94 req-84e148db-8a2f-47a3-a6bb-041e936e73b0 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:49.488829 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a46112b-77cd-4941-b99d-fd20131b4e94 req-84e148db-8a2f-47a3-a6bb-041e936e73b0 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 2418 time: 0.1217933 Dec 09 21:25:49.528594 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-450b8dea-a13c-4a38-a514-6b64d325a347 req-84dc7cdd-1de4-4482-80b1-7b233741f54f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Deleting port 151030b5-c66b-4f22-a8fc-9aceb1635009 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:49.528990 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-450b8dea-a13c-4a38-a514-6b64d325a347 req-84dc7cdd-1de4-4482-80b1-7b233741f54f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:49.574620 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a80a8b71-0b1c-4ac3-853b-fb6c36211afc req-e90aca3b-ef46-40fa-b83a-30a2e5b6ecac tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0842240 Dec 09 21:25:49.603459 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a46112b-77cd-4941-b99d-fd20131b4e94 req-8160694a-ea7b-4cdc-aaa0-65265b60a0ee tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1058445 Dec 09 21:25:49.646478 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-949f6bb7-5eed-467e-ad69-bb23aa3eb242 req-48d88163-007c-45a4-b35d-d4cd16471627 service neutron] 10.222.0.31 "GET /v2.0/networks/56b576e6-50b1-4d1e-a1c2-80bcf1883e68?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2443841 Dec 09 21:25:49.741244 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e85bdc7-5efc-4c6c-8907-17cfe63476bd req-ab4ba8c3-f200-4e04-b03c-2958aa1b4a2a tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:49.743082 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e85bdc7-5efc-4c6c-8907-17cfe63476bd req-ab4ba8c3-f200-4e04-b03c-2958aa1b4a2a tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=10aa9750-8504-424a-9c95-af3331c58955 HTTP/1.1" status: 200 len: 949 time: 0.0673585 Dec 09 21:25:49.744604 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-450b8dea-a13c-4a38-a514-6b64d325a347 req-84dc7cdd-1de4-4482-80b1-7b233741f54f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] For port 151030b5-c66b-4f22-a8fc-9aceb1635009, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=151030b5-c66b-4f22-a8fc-9aceb1635009,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:49.745223 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-450b8dea-a13c-4a38-a514-6b64d325a347 req-84dc7cdd-1de4-4482-80b1-7b233741f54f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:49.812425 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e85bdc7-5efc-4c6c-8907-17cfe63476bd req-661300a7-c90d-4679-8a51-03971c1fe8f9 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595515 Dec 09 21:25:49.823851 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-450b8dea-a13c-4a38-a514-6b64d325a347 req-84dc7cdd-1de4-4482-80b1-7b233741f54f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Calling delete_port for 151030b5-c66b-4f22-a8fc-9aceb1635009 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:25:49.836922 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-319b7f5b-596e-4d1c-bd3e-fa334ec9fb97 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:49.847098 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-319b7f5b-596e-4d1c-bd3e-fa334ec9fb97 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:49.920255 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-949f6bb7-5eed-467e-ad69-bb23aa3eb242 req-be07bb09-60a9-43e1-8b82-95d6596ffd12 service neutron] 10.222.0.31 "GET /v2.0/networks/56b576e6-50b1-4d1e-a1c2-80bcf1883e68?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2581728 Dec 09 21:25:49.931859 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-319b7f5b-596e-4d1c-bd3e-fa334ec9fb97 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=db049da8bbd8460ea0a59b849310e1ae&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7679441 Dec 09 21:25:49.935089 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38394) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:49.943550 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-319b7f5b-596e-4d1c-bd3e-fa334ec9fb97 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=36bfbfa2-1402-4ea1-a3d9-def208962091,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:50.002672 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53666c0f-bae7-47d8-8f5e-de0c68bf43e7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:50.036715 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53666c0f-bae7-47d8-8f5e-de0c68bf43e7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:50.057999 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-450b8dea-a13c-4a38-a514-6b64d325a347 req-84dc7cdd-1de4-4482-80b1-7b233741f54f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:50.103880 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84dc7cdd-1de4-4482-80b1-7b233741f54f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Pushing event deleted for resources: {'Port': ['ID=151030b5-c66b-4f22-a8fc-9aceb1635009,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:50.106305 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53666c0f-bae7-47d8-8f5e-de0c68bf43e7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:50.119869 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53666c0f-bae7-47d8-8f5e-de0c68bf43e7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:50.124681 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-53666c0f-bae7-47d8-8f5e-de0c68bf43e7 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/36bfbfa2-1402-4ea1-a3d9-def208962091 HTTP/1.1" status: 204 len: 168 time: 0.1878731 Dec 09 21:25:50.130316 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['151030b5-c66b-4f22-a8fc-9aceb1635009'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:25:50.136113 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53666c0f-bae7-47d8-8f5e-de0c68bf43e7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=36bfbfa2-1402-4ea1-a3d9-def208962091,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:50.172608 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-450b8dea-a13c-4a38-a514-6b64d325a347 req-84dc7cdd-1de4-4482-80b1-7b233741f54f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] No DVR routers for this DVR port 151030b5-c66b-4f22-a8fc-9aceb1635009 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:25:50.175465 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-450b8dea-a13c-4a38-a514-6b64d325a347 req-84dc7cdd-1de4-4482-80b1-7b233741f54f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:50.179886 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-450b8dea-a13c-4a38-a514-6b64d325a347 req-84dc7cdd-1de4-4482-80b1-7b233741f54f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.31 "DELETE /v2.0/ports/151030b5-c66b-4f22-a8fc-9aceb1635009 HTTP/1.1" status: 204 len: 173 time: 0.9153197 Dec 09 21:25:50.192193 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c008c358-ebaf-4573-9145-fd2e014057cc', 'name': 'network-vif-deleted', 'tag': '151030b5-c66b-4f22-a8fc-9aceb1635009'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:50.195426 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6d8704f8-5ca0-41e0-9036-11196e99bc0f" -d '{"events": [{"server_uuid": "c008c358-ebaf-4573-9145-fd2e014057cc", "name": "network-vif-deleted", "tag": "151030b5-c66b-4f22-a8fc-9aceb1635009"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:50.393206 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c3d2df1-7270-47e5-bd05-2e61fcad39e3 req-ed0dc122-ac36-4dc9-b39b-ecb41207b20d tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:50.400382 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c3d2df1-7270-47e5-bd05-2e61fcad39e3 req-ed0dc122-ac36-4dc9-b39b-ecb41207b20d tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=68d909ed-6a44-454a-9fce-e4dd59e2d088 HTTP/1.1" status: 200 len: 943 time: 0.1037822 Dec 09 21:25:50.459234 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c3d2df1-7270-47e5-bd05-2e61fcad39e3 req-e658b260-b1b1-4012-9919-9e995ae9971d tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0564287 Dec 09 21:25:50.501755 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-783b37af-d3b4-4521-b4ae-3188cb2369b9 x-openstack-request-id: req-783b37af-d3b4-4521-b4ae-3188cb2369b9 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:50.502074 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c008c358-ebaf-4573-9145-fd2e014057cc", "name": "network-vif-deleted", "tag": "151030b5-c66b-4f22-a8fc-9aceb1635009", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:50.502310 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-783b37af-d3b4-4521-b4ae-3188cb2369b9 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:50.502724 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c008c358-ebaf-4573-9145-fd2e014057cc', 'name': 'network-vif-deleted', 'tag': '151030b5-c66b-4f22-a8fc-9aceb1635009', 'status': 'completed', 'code': 200} Dec 09 21:25:50.712442 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0be08b59-3584-45f8-a402-797d66d6b20d req-553c142d-a88a-46aa-ba5e-1da8d2a20c85 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=c008c358-ebaf-4573-9145-fd2e014057cc HTTP/1.1" status: 200 len: 210 time: 0.0401945 Dec 09 21:25:50.822784 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 775d6690-9f80-4aa2-9026-bb97c37d24af details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:25:50.828642 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 18bda486-9d6d-41a3-a260-dd244a3838b3 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:50.890897 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3208a4a2-3244-4519-9a74-539a5ff898a8 req-e745cc21-ca43-417e-bff7-3cd42272abdc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:50.905901 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3208a4a2-3244-4519-9a74-539a5ff898a8 req-e745cc21-ca43-417e-bff7-3cd42272abdc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:50.923469 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3208a4a2-3244-4519-9a74-539a5ff898a8 req-e745cc21-ca43-417e-bff7-3cd42272abdc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:50.935384 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3208a4a2-3244-4519-9a74-539a5ff898a8 req-e745cc21-ca43-417e-bff7-3cd42272abdc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 2418 time: 0.1918087 Dec 09 21:25:51.034494 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3208a4a2-3244-4519-9a74-539a5ff898a8 req-de3156b8-a640-444c-bf3a-da07fa5e8f7f tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0978544 Dec 09 21:25:51.071968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a965ff12-d8c6-4b98-8711-8af19999e520 req-ce397bbf-45e2-435d-9f33-f97efa14a598 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:51.080132 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a965ff12-d8c6-4b98-8711-8af19999e520 req-ce397bbf-45e2-435d-9f33-f97efa14a598 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=10aa9750-8504-424a-9c95-af3331c58955 HTTP/1.1" status: 200 len: 949 time: 0.1328564 Dec 09 21:25:51.109033 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 18bda486-9d6d-41a3-a260-dd244a3838b3 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:25:51.122492 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 18bda486-9d6d-41a3-a260-dd244a3838b3 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:51.131536 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:51.154181 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a965ff12-d8c6-4b98-8711-8af19999e520 req-8287101b-4ad2-4b4f-b2c2-a1fa97bce6e9 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0728817 Dec 09 21:25:51.166504 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38502) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:51.218160 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 775d6690-9f80-4aa2-9026-bb97c37d24af, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=775d6690-9f80-4aa2-9026-bb97c37d24af,segment=NetworkSegment(bada42e9-278b-46e3-bbc2-c2d37f00c32d),segment_id=bada42e9-278b-46e3-bbc2-c2d37f00c32d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:51.247983 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '775d6690-9f80-4aa2-9026-bb97c37d24af', 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68', 'port_id': '775d6690-9f80-4aa2-9026-bb97c37d24af', 'mac_address': 'fa:16:3e:07:a0:20', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5b18bb60-11fe-4ddd-8fd3-bcb36985a134', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:25:51.283891 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-e40587c8-56a3-4b94-a994-1d9b531b5fe5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:51.300502 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-e40587c8-56a3-4b94-a994-1d9b531b5fe5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:51.309989 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-e40587c8-56a3-4b94-a994-1d9b531b5fe5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:51.312264 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-e40587c8-56a3-4b94-a994-1d9b531b5fe5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.31 "GET /v2.0/ports?device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 2418 time: 0.1109312 Dec 09 21:25:51.325276 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:51.343602 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:51.357661 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 775d6690-9f80-4aa2-9026-bb97c37d24af {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:51.402768 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '10aa9750-8504-424a-9c95-af3331c58955', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '18bda486-9d6d-41a3-a260-dd244a3838b3'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:51.405194 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e74a50c7-f915-4a02-a1a4-ae062b11db0a" -d '{"events": [{"server_uuid": "10aa9750-8504-424a-9c95-af3331c58955", "name": "network-vif-plugged", "status": "completed", "tag": "18bda486-9d6d-41a3-a260-dd244a3838b3"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:51.409325 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 775d6690-9f80-4aa2-9026-bb97c37d24af, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=775d6690-9f80-4aa2-9026-bb97c37d24af,segment=NetworkSegment(bada42e9-278b-46e3-bbc2-c2d37f00c32d),segment_id=bada42e9-278b-46e3-bbc2-c2d37f00c32d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:51.419188 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:51.420230 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 3ebbcc5a-481f-4868-8b55-d0176959424c details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:25:51.424693 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ab2582db-0040-43fa-9336-a6c275cd47f6 admin admin] Request body: {'network': {'name': 'tempest-SecurityGroupRulesNegativeTestJSON-878094072-network', 'tenant_id': 'f1653df0a34f46d6911568893bd0799d'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:51.425455 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 18bda486-9d6d-41a3-a260-dd244a3838b3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=18bda486-9d6d-41a3-a260-dd244a3838b3,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:51.457248 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:51.473941 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ab2582db-0040-43fa-9336-a6c275cd47f6 admin admin] Made reservation on behalf of f1653df0a34f46d6911568893bd0799d for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:25:51.476635 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ab2582db-0040-43fa-9336-a6c275cd47f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:51.490846 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-df80a251-9fbd-4d15-8241-f559bed2bb4f tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Deleting port f985bc1a-2e10-4124-b2e9-f8c053c1cf19 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:51.491380 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-df80a251-9fbd-4d15-8241-f559bed2bb4f tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:51.496460 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ab2582db-0040-43fa-9336-a6c275cd47f6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:51.502143 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=775d6690-9f80-4aa2-9026-bb97c37d24af,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:51.506799 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 3ebbcc5a-481f-4868-8b55-d0176959424c, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=3ebbcc5a-481f-4868-8b55-d0176959424c,segment=NetworkSegment(bada42e9-278b-46e3-bbc2-c2d37f00c32d),segment_id=bada42e9-278b-46e3-bbc2-c2d37f00c32d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:51.548342 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-42d70351-2fce-49da-aa09-cb5f6d00c699 x-openstack-request-id: req-42d70351-2fce-49da-aa09-cb5f6d00c699 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:51.548973 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "10aa9750-8504-424a-9c95-af3331c58955", "name": "network-vif-plugged", "status": "completed", "tag": "18bda486-9d6d-41a3-a260-dd244a3838b3", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:51.549401 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-42d70351-2fce-49da-aa09-cb5f6d00c699 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:51.549958 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '10aa9750-8504-424a-9c95-af3331c58955', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '18bda486-9d6d-41a3-a260-dd244a3838b3', 'code': 200} Dec 09 21:25:51.554536 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '3ebbcc5a-481f-4868-8b55-d0176959424c', 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68', 'port_id': '3ebbcc5a-481f-4868-8b55-d0176959424c', 'mac_address': 'fa:16:3e:8e:de:a4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5b18bb60-11fe-4ddd-8fd3-bcb36985a134', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:25:51.589847 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38516) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:51.609461 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=18bda486-9d6d-41a3-a260-dd244a3838b3,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:51.619740 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:51.650420 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3ebbcc5a-481f-4868-8b55-d0176959424c {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:51.678386 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 3ebbcc5a-481f-4868-8b55-d0176959424c, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=3ebbcc5a-481f-4868-8b55-d0176959424c,segment=NetworkSegment(bada42e9-278b-46e3-bbc2-c2d37f00c32d),segment_id=bada42e9-278b-46e3-bbc2-c2d37f00c32d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:51.685081 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:51.708197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cfbceec-2bb8-4846-a53e-1f9d632fd289 req-4879c012-ed10-4b9b-9bfa-79c63d716174 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:51.709998 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5cfbceec-2bb8-4846-a53e-1f9d632fd289 req-4879c012-ed10-4b9b-9bfa-79c63d716174 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=10aa9750-8504-424a-9c95-af3331c58955 HTTP/1.1" status: 200 len: 1102 time: 0.1061270 Dec 09 21:25:51.753169 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-df80a251-9fbd-4d15-8241-f559bed2bb4f tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] For port f985bc1a-2e10-4124-b2e9-f8c053c1cf19, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=f985bc1a-2e10-4124-b2e9-f8c053c1cf19,segment=NetworkSegment(e72604b7-1620-485e-8ea6-a66ce97f67f1),segment_id=e72604b7-1620-485e-8ea6-a66ce97f67f1)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:51.753678 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-df80a251-9fbd-4d15-8241-f559bed2bb4f tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:51.760655 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c738e8a7-b575-4891-9695-21b25044202a req-5a65f4a4-efdc-4773-9e27-e30625adf914 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:51.773445 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c738e8a7-b575-4891-9695-21b25044202a req-5a65f4a4-efdc-4773-9e27-e30625adf914 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=68d909ed-6a44-454a-9fce-e4dd59e2d088 HTTP/1.1" status: 200 len: 944 time: 0.1428711 Dec 09 21:25:51.779880 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=3ebbcc5a-481f-4868-8b55-d0176959424c,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:51.803656 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-df80a251-9fbd-4d15-8241-f559bed2bb4f tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Calling delete_port for f985bc1a-2e10-4124-b2e9-f8c053c1cf19 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:25:51.872998 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c738e8a7-b575-4891-9695-21b25044202a req-4a1d9e50-469c-4762-9d3d-11baa6e1d3eb tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1007056 Dec 09 21:25:51.898536 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d7ef94f4-b5da-416c-87c9-4576ac294cea admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:51.925234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['775d6690-9f80-4aa2-9026-bb97c37d24af'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:25:51.993910 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['3ebbcc5a-481f-4868-8b55-d0176959424c'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:25:52.013615 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5cfbceec-2bb8-4846-a53e-1f9d632fd289 req-49a5bc94-2262-4b73-b1ca-206b49c57d81 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2928247 Dec 09 21:25:52.024487 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ab2582db-0040-43fa-9336-a6c275cd47f6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:52.037359 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ab2582db-0040-43fa-9336-a6c275cd47f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:52.038704 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:25:52.067804 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ab2582db-0040-43fa-9336-a6c275cd47f6 admin admin] vlan segment allocate from pool success with {'vlan_id': 102, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:25:52.100803 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ab2582db-0040-43fa-9336-a6c275cd47f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:52.101548 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-ab2582db-0040-43fa-9336-a6c275cd47f6 admin admin] Added segment f26fd670-bdee-4620-9d95-2bdac0a6a3fc of type vlan for network 8af3da98-702c-4f3e-94d5-1e7af3a60db1 Dec 09 21:25:52.104763 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab2582db-0040-43fa-9336-a6c275cd47f6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=be3c8f6d-6fef-40aa-b386-123fe16acbed,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:52.150373 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d7ef94f4-b5da-416c-87c9-4576ac294cea admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:52.173433 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d7ef94f4-b5da-416c-87c9-4576ac294cea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:52.182006 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ab2582db-0040-43fa-9336-a6c275cd47f6 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:52.245026 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-df80a251-9fbd-4d15-8241-f559bed2bb4f tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:52.325663 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df80a251-9fbd-4d15-8241-f559bed2bb4f tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event deleted for resources: {'Port': ['ID=f985bc1a-2e10-4124-b2e9-f8c053c1cf19,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:52.329626 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ab2582db-0040-43fa-9336-a6c275cd47f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:52.336688 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab2582db-0040-43fa-9336-a6c275cd47f6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:52.337641 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ab2582db-0040-43fa-9336-a6c275cd47f6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:52.377239 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ab2582db-0040-43fa-9336-a6c275cd47f6 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 1.2096004 Dec 09 21:25:52.393908 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38544) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:52.399369 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-03b8a915-eb28-4f5d-9fe6-0c03912614fc admin admin] Request body: {'subnet': {'network_id': '8af3da98-702c-4f3e-94d5-1e7af3a60db1', 'cidr': '172.20.0.0/28', 'name': 'tempest-SecurityGroupRulesNegativeTestJSON-878094072-subnet', 'tenant_id': 'f1653df0a34f46d6911568893bd0799d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:52.426195 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7ef94f4-b5da-416c-87c9-4576ac294cea admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=10ad42e6-09f3-4869-89dc-adeab421a53b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:52.462207 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d7ef94f4-b5da-416c-87c9-4576ac294cea admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=646a372b1c7848e2a7c51a837a9dbc8a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8709846 Dec 09 21:25:52.466283 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38546) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:52.486594 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11f13175-48ad-4dcb-acd0-5e43e9278b25 req-749f04f6-8eb3-4737-8523-10e91d9dbd6e tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:52.493598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11f13175-48ad-4dcb-acd0-5e43e9278b25 req-749f04f6-8eb3-4737-8523-10e91d9dbd6e tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:52.507624 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11f13175-48ad-4dcb-acd0-5e43e9278b25 req-749f04f6-8eb3-4737-8523-10e91d9dbd6e tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 1682 time: 0.3404603 Dec 09 21:25:52.512536 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-df80a251-9fbd-4d15-8241-f559bed2bb4f tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] No DVR routers for this DVR port f985bc1a-2e10-4124-b2e9-f8c053c1cf19 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:25:52.514184 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab2582db-0040-43fa-9336-a6c275cd47f6 admin admin] Pushing event updated for resources: {'Network': ['ID=8af3da98-702c-4f3e-94d5-1e7af3a60db1,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:52.520715 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-475cca33-229e-4cda-890f-724f6f706c2e req-7b4d4452-deba-4a2c-97b7-06898006b907 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:52.525119 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 8af3da98-702c-4f3e-94d5-1e7af3a60db1 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:25:52.526659 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-df80a251-9fbd-4d15-8241-f559bed2bb4f tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:52.530942 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-df80a251-9fbd-4d15-8241-f559bed2bb4f tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.31 "DELETE /v2.0/ports/f985bc1a-2e10-4124-b2e9-f8c053c1cf19 HTTP/1.1" status: 204 len: 173 time: 1.2109601 Dec 09 21:25:52.531430 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e529b5d4-f89f-43c5-8e52-68ae6fa62846', 'name': 'network-vif-deleted', 'tag': 'f985bc1a-2e10-4124-b2e9-f8c053c1cf19'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:52.533808 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a2036046-890e-4395-b530-ba774d149a50" -d '{"events": [{"server_uuid": "e529b5d4-f89f-43c5-8e52-68ae6fa62846", "name": "network-vif-deleted", "tag": "f985bc1a-2e10-4124-b2e9-f8c053c1cf19"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:52.548656 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-475cca33-229e-4cda-890f-724f6f706c2e req-7b4d4452-deba-4a2c-97b7-06898006b907 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/networks?id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb HTTP/1.1" status: 200 len: 812 time: 0.5077741 Dec 09 21:25:52.612472 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-475cca33-229e-4cda-890f-724f6f706c2e req-f765886d-b162-474e-a1f9-cc0581f667ff tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/quotas/1b7916b634f74760a565cfeaef510cd9 HTTP/1.1" status: 200 len: 375 time: 0.0627220 Dec 09 21:25:52.634308 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-03b8a915-eb28-4f5d-9fe6-0c03912614fc admin admin] Made reservation on behalf of f1653df0a34f46d6911568893bd0799d for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:25:52.637126 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03b8a915-eb28-4f5d-9fe6-0c03912614fc admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:52.666240 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-475cca33-229e-4cda-890f-724f6f706c2e req-b5933e34-662b-467e-838c-d5e596853bda tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=1b7916b634f74760a565cfeaef510cd9&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0528507 Dec 09 21:25:52.710239 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c354ccf6-ba5b-4e20-8a19-7444591caa06 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:52.753359 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11f13175-48ad-4dcb-acd0-5e43e9278b25 req-5898d668-14b4-4f2a-8654-f64ae2f09530 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2448103 Dec 09 21:25:52.805161 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-11f469e7-f081-4e7e-8651-e5b8ceb06255 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Deleting port 39a4e9cb-cd4f-4df2-9c02-6776529dc801 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:52.806618 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-11f469e7-f081-4e7e-8651-e5b8ceb06255 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:52.845483 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 151030b5-c66b-4f22-a8fc-9aceb1635009 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:25:52.861997 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c354ccf6-ba5b-4e20-8a19-7444591caa06 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:52.897332 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['f985bc1a-2e10-4124-b2e9-f8c053c1cf19', '39a4e9cb-cd4f-4df2-9c02-6776529dc801', 'be89ffc7-e26a-4049-9372-9a434624cba7'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:25:52.950043 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-475cca33-229e-4cda-890f-724f6f706c2e req-527ce0f6-974a-42b0-bdf6-5dc9d5ead60d service neutron] 10.222.0.13 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2826746 Dec 09 21:25:52.974267 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-11f469e7-f081-4e7e-8651-e5b8ceb06255 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] For port 39a4e9cb-cd4f-4df2-9c02-6776529dc801, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=39a4e9cb-cd4f-4df2-9c02-6776529dc801,segment=NetworkSegment(3e23a057-7b71-4625-891b-f66fd33737f2),segment_id=3e23a057-7b71-4625-891b-f66fd33737f2)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:52.975048 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-11f469e7-f081-4e7e-8651-e5b8ceb06255 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:53.004619 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 151030b5-c66b-4f22-a8fc-9aceb1635009 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:25:53.005171 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 151030b5-c66b-4f22-a8fc-9aceb1635009 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:25:53.008417 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 39a4e9cb-cd4f-4df2-9c02-6776529dc801 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:25:53.060166 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-11f469e7-f081-4e7e-8651-e5b8ceb06255 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Calling delete_port for 39a4e9cb-cd4f-4df2-9c02-6776529dc801 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:25:53.061701 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-475cca33-229e-4cda-890f-724f6f706c2e req-8810d70b-5e6b-4a63-b7f3-fdfc977f5412 service neutron] 10.222.0.13 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1091983 Dec 09 21:25:53.101109 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a01b5bb-4be9-4926-b847-ffe3b2bbdd78 req-e9029df8-8089-45a4-ba6e-14399496a58a tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:53.112049 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4a01b5bb-4be9-4926-b847-ffe3b2bbdd78 req-e9029df8-8089-45a4-ba6e-14399496a58a tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=10aa9750-8504-424a-9c95-af3331c58955 HTTP/1.1" status: 200 len: 950 time: 0.2473934 Dec 09 21:25:53.126237 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03b8a915-eb28-4f5d-9fe6-0c03912614fc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:53.188760 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c354ccf6-ba5b-4e20-8a19-7444591caa06 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:53.193930 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c354ccf6-ba5b-4e20-8a19-7444591caa06 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:53.212696 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c354ccf6-ba5b-4e20-8a19-7444591caa06 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/10ad42e6-09f3-4869-89dc-adeab421a53b HTTP/1.1" status: 204 len: 168 time: 0.7421582 Dec 09 21:25:53.270097 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c354ccf6-ba5b-4e20-8a19-7444591caa06 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=10ad42e6-09f3-4869-89dc-adeab421a53b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:53.295916 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4a01b5bb-4be9-4926-b847-ffe3b2bbdd78 req-5e9093d6-5114-415c-b590-2383843a58ef tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1828635 Dec 09 21:25:53.374590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b8a915-eb28-4f5d-9fe6-0c03912614fc admin admin] Pushing event updated for resources: {'Subnet': ['ID=4bb33c51-adeb-4529-9543-3172b6037520,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:53.411905 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-898d3e48-3253-45ec-ad73-18825b79f790 x-openstack-request-id: req-898d3e48-3253-45ec-ad73-18825b79f790 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:53.412359 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e529b5d4-f89f-43c5-8e52-68ae6fa62846", "name": "network-vif-deleted", "tag": "f985bc1a-2e10-4124-b2e9-f8c053c1cf19", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:53.412507 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-898d3e48-3253-45ec-ad73-18825b79f790 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:53.414494 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e529b5d4-f89f-43c5-8e52-68ae6fa62846', 'name': 'network-vif-deleted', 'tag': 'f985bc1a-2e10-4124-b2e9-f8c053c1cf19', 'status': 'completed', 'code': 200} Dec 09 21:25:53.469146 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03b8a915-eb28-4f5d-9fe6-0c03912614fc admin admin] Checking segment: {'id': 'f26fd670-bdee-4620-9d95-2bdac0a6a3fc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '8af3da98-702c-4f3e-94d5-1e7af3a60db1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:25:53.469509 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-03b8a915-eb28-4f5d-9fe6-0c03912614fc admin admin] Network hostable DHCP agents. Network: 8af3da98-702c-4f3e-94d5-1e7af3a60db1, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:25:53.495118 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:53.505620 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-03b8a915-eb28-4f5d-9fe6-0c03912614fc admin admin] Network 8af3da98-702c-4f3e-94d5-1e7af3a60db1 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:25:53.522302 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-03b8a915-eb28-4f5d-9fe6-0c03912614fc admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 8af3da98-702c-4f3e-94d5-1e7af3a60db1) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:53.522450 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af96642a-d031-482f-98c4-2df97a1ced24 req-6ea2f6b3-9ca7-418d-8d50-14ffc1251933 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 210 time: 0.0766466 Dec 09 21:25:53.547629 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03b8a915-eb28-4f5d-9fe6-0c03912614fc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:53.551028 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03b8a915-eb28-4f5d-9fe6-0c03912614fc admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:53.574815 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20ffdba4-db38-4f5e-bcb7-a1e3b98bbb0a None None] Network 8af3da98-702c-4f3e-94d5-1e7af3a60db1 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:25:53.633177 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-03b8a915-eb28-4f5d-9fe6-0c03912614fc admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 1.2378342 Dec 09 21:25:53.644122 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eafcce6-3277-4b1c-838b-e8f475b74a4e req-bbe44824-5291-457a-b0e7-c1e410912330 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:53.649296 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5eafcce6-3277-4b1c-838b-e8f475b74a4e req-bbe44824-5291-457a-b0e7-c1e410912330 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=68d909ed-6a44-454a-9fce-e4dd59e2d088 HTTP/1.1" status: 200 len: 944 time: 0.1130726 Dec 09 21:25:53.685915 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-11f469e7-f081-4e7e-8651-e5b8ceb06255 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:53.790384 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5eafcce6-3277-4b1c-838b-e8f475b74a4e req-a28168e4-ea8b-40c8-963f-c30c78ebb69e tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1158671 Dec 09 21:25:53.832201 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11f469e7-f081-4e7e-8651-e5b8ceb06255 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event deleted for resources: {'Port': ['ID=39a4e9cb-cd4f-4df2-9c02-6776529dc801,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:53.907496 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device f985bc1a-2e10-4124-b2e9-f8c053c1cf19 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:25:53.963002 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-11f469e7-f081-4e7e-8651-e5b8ceb06255 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] No DVR routers for this DVR port 39a4e9cb-cd4f-4df2-9c02-6776529dc801 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:25:53.969208 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-11f469e7-f081-4e7e-8651-e5b8ceb06255 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:53.978940 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-11f469e7-f081-4e7e-8651-e5b8ceb06255 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.31 "DELETE /v2.0/ports/39a4e9cb-cd4f-4df2-9c02-6776529dc801 HTTP/1.1" status: 204 len: 173 time: 1.4084547 Dec 09 21:25:53.996684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dfeaa46-a868-4644-bfde-650fbc36e199 req-f19b823b-f8e7-451e-962c-ee1ab19c8a03 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:54.001874 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9dfeaa46-a868-4644-bfde-650fbc36e199 req-f19b823b-f8e7-451e-962c-ee1ab19c8a03 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=e529b5d4-f89f-43c5-8e52-68ae6fa62846 HTTP/1.1" status: 200 len: 945 time: 0.1181684 Dec 09 21:25:54.028557 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: f985bc1a-2e10-4124-b2e9-f8c053c1cf19 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:25:54.029141 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device f985bc1a-2e10-4124-b2e9-f8c053c1cf19 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:25:54.116802 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b9210bf5-349e-4188-b2b5-f22488abca28 None None] Network 8af3da98-702c-4f3e-94d5-1e7af3a60db1 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:25:54.160586 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9dfeaa46-a868-4644-bfde-650fbc36e199 req-a1b97194-ca98-462d-8c66-aa75880530c9 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1541193 Dec 09 21:25:54.248286 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-5ad18932-9a30-4081-94b9-12ca80f529e9 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Deleting port be89ffc7-e26a-4049-9372-9a434624cba7 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:54.248798 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-5ad18932-9a30-4081-94b9-12ca80f529e9 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:54.478467 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-5ad18932-9a30-4081-94b9-12ca80f529e9 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] For port be89ffc7-e26a-4049-9372-9a434624cba7, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=be89ffc7-e26a-4049-9372-9a434624cba7,segment=NetworkSegment(3e23a057-7b71-4625-891b-f66fd33737f2),segment_id=3e23a057-7b71-4625-891b-f66fd33737f2)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:54.482418 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-5ad18932-9a30-4081-94b9-12ca80f529e9 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:54.498646 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f42c286-a6a3-49a0-95c6-8ab42818aed8 req-d1d17e39-4d9f-4d7f-b4db-8c4d9a5ab9fb tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:54.501014 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2f42c286-a6a3-49a0-95c6-8ab42818aed8 req-d1d17e39-4d9f-4d7f-b4db-8c4d9a5ab9fb tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=10aa9750-8504-424a-9c95-af3331c58955 HTTP/1.1" status: 200 len: 950 time: 0.0643811 Dec 09 21:25:54.525504 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-5ad18932-9a30-4081-94b9-12ca80f529e9 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Calling delete_port for be89ffc7-e26a-4049-9372-9a434624cba7 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:25:54.571318 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2f42c286-a6a3-49a0-95c6-8ab42818aed8 req-453f1d73-0254-479d-b199-ae9244d7ef5d tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0630460 Dec 09 21:25:54.697204 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-5214874e-d62e-4d7f-b1d2-efe2b79ea828 req-4486c0a9-a0e8-42d2-b8fe-f2a9aff3ec08 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1652095062', 'description': 'tempest-description-688715331'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:54.746396 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5214874e-d62e-4d7f-b1d2-efe2b79ea828 req-4486c0a9-a0e8-42d2-b8fe-f2a9aff3ec08 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:54.764518 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-5ad18932-9a30-4081-94b9-12ca80f529e9 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:54.800516 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94be2359-822c-4854-82e5-175e290bb1b3 req-b0091516-be5b-4151-b054-e512ed990c07 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 210 time: 0.0490189 Dec 09 21:25:54.827809 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ad18932-9a30-4081-94b9-12ca80f529e9 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event deleted for resources: {'Port': ['ID=be89ffc7-e26a-4049-9372-9a434624cba7,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:54.855752 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 775d6690-9f80-4aa2-9026-bb97c37d24af up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:54.880056 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-5ad18932-9a30-4081-94b9-12ca80f529e9 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] No DVR routers for this DVR port be89ffc7-e26a-4049-9372-9a434624cba7 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:25:54.883499 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-5ad18932-9a30-4081-94b9-12ca80f529e9 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:54.887849 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7f3d21a3-1e98-4f98-b421-528ca2b0c1d2 req-5ad18932-9a30-4081-94b9-12ca80f529e9 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.31 "DELETE /v2.0/ports/be89ffc7-e26a-4049-9372-9a434624cba7 HTTP/1.1" status: 204 len: 173 time: 0.9038303 Dec 09 21:25:54.976588 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5214874e-d62e-4d7f-b1d2-efe2b79ea828 req-4486c0a9-a0e8-42d2-b8fe-f2a9aff3ec08 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:54.985109 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5214874e-d62e-4d7f-b1d2-efe2b79ea828 req-4486c0a9-a0e8-42d2-b8fe-f2a9aff3ec08 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:55.011950 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 775d6690-9f80-4aa2-9026-bb97c37d24af completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:25:55.023273 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 775d6690-9f80-4aa2-9026-bb97c37d24af triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:55.025308 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:55.046639 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4486c0a9-a0e8-42d2-b8fe-f2a9aff3ec08 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Pushing event updated for resources: {'SecurityGroup': ['ID=bf43dc1d-fc98-4f45-8b2e-33b02cf1628a,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:55.096922 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5214874e-d62e-4d7f-b1d2-efe2b79ea828 req-4486c0a9-a0e8-42d2-b8fe-f2a9aff3ec08 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:55.099544 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5214874e-d62e-4d7f-b1d2-efe2b79ea828 req-4486c0a9-a0e8-42d2-b8fe-f2a9aff3ec08 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1834 time: 0.4099634 Dec 09 21:25:55.254106 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:55.298672 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '68d909ed-6a44-454a-9fce-e4dd59e2d088', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '775d6690-9f80-4aa2-9026-bb97c37d24af'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:55.303721 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8d78ed54-9d6b-435c-8c3f-f0f241ebfe8e" -d '{"events": [{"server_uuid": "68d909ed-6a44-454a-9fce-e4dd59e2d088", "name": "network-vif-plugged", "status": "completed", "tag": "775d6690-9f80-4aa2-9026-bb97c37d24af"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:55.352765 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 775d6690-9f80-4aa2-9026-bb97c37d24af, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=775d6690-9f80-4aa2-9026-bb97c37d24af,segment=NetworkSegment(bada42e9-278b-46e3-bbc2-c2d37f00c32d),segment_id=bada42e9-278b-46e3-bbc2-c2d37f00c32d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:55.358693 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:55.359777 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 3ebbcc5a-481f-4868-8b55-d0176959424c up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:25:55.416540 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e529b5d4-f89f-43c5-8e52-68ae6fa62846', 'name': 'network-vif-deleted', 'tag': '39a4e9cb-cd4f-4df2-9c02-6776529dc801'}, {'server_uuid': 'e529b5d4-f89f-43c5-8e52-68ae6fa62846', 'name': 'network-vif-deleted', 'tag': 'be89ffc7-e26a-4049-9372-9a434624cba7'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:55.422254 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7d97a0b1-249b-454e-bf55-146b72674e16" -d '{"events": [{"server_uuid": "e529b5d4-f89f-43c5-8e52-68ae6fa62846", "name": "network-vif-deleted", "tag": "39a4e9cb-cd4f-4df2-9c02-6776529dc801"}, {"server_uuid": "e529b5d4-f89f-43c5-8e52-68ae6fa62846", "name": "network-vif-deleted", "tag": "be89ffc7-e26a-4049-9372-9a434624cba7"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:55.424811 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82d0b945-980b-4103-a75e-6b745fc018fb req-f38815b3-c7f1-4f26-8af0-e9d07f83bc1f tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:55.436611 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-82d0b945-980b-4103-a75e-6b745fc018fb req-f38815b3-c7f1-4f26-8af0-e9d07f83bc1f tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=10aa9750-8504-424a-9c95-af3331c58955 HTTP/1.1" status: 200 len: 1102 time: 0.1653211 Dec 09 21:25:55.440164 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-6836b514-7e0f-441a-99a2-0ee166a6fe68 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=6ef183f29d2f4992bf91a120a9d85fac&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0927918 Dec 09 21:25:55.456293 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=775d6690-9f80-4aa2-9026-bb97c37d24af,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:55.458652 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-82d0b945-980b-4103-a75e-6b745fc018fb req-a2d1ac28-8a88-4364-9c27-54b09310acef tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:55.476600 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 3ebbcc5a-481f-4868-8b55-d0176959424c completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:25:55.482222 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 3ebbcc5a-481f-4868-8b55-d0176959424c triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:25:55.484621 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:55.487122 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-475cca33-229e-4cda-890f-724f6f706c2e req-2a15a045-b78f-4411-a4cd-4a7de41c170f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:55.490096 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-475cca33-229e-4cda-890f-724f6f706c2e req-2a15a045-b78f-4411-a4cd-4a7de41c170f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.31 "GET /v2.0/networks?id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb HTTP/1.1" status: 200 len: 812 time: 0.2735727 Dec 09 21:25:55.513763 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-475cca33-229e-4cda-890f-724f6f706c2e req-e90bb5bb-e9ef-416d-86dd-d69be844befe tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Request body: {'port': {'device_id': 'e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f', 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb', 'admin_state_up': True, 'tenant_id': '1b7916b634f74760a565cfeaef510cd9'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:55.631023 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:55.669571 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-c36b7630-5880-45de-b07f-0f11094f8e82 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:55.677513 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-c36b7630-5880-45de-b07f-0f11094f8e82 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2019506 Dec 09 21:25:55.688244 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 3ebbcc5a-481f-4868-8b55-d0176959424c, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=3ebbcc5a-481f-4868-8b55-d0176959424c,segment=NetworkSegment(bada42e9-278b-46e3-bbc2-c2d37f00c32d),segment_id=bada42e9-278b-46e3-bbc2-c2d37f00c32d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:55.693714 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:55.694759 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device be89ffc7-e26a-4049-9372-9a434624cba7 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:25:55.703993 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-b4cb011e-5e58-4d78-8f3a-79f3448aa585 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/quotas/6ef183f29d2f4992bf91a120a9d85fac HTTP/1.1" status: 200 len: 375 time: 0.0250154 Dec 09 21:25:55.742690 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-9a51723b-ed6b-4ac9-8433-0ea9b525874f tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=6ef183f29d2f4992bf91a120a9d85fac&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0369596 Dec 09 21:25:55.766201 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-82d0b945-980b-4103-a75e-6b745fc018fb req-a2d1ac28-8a88-4364-9c27-54b09310acef tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:55.767084 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-475cca33-229e-4cda-890f-724f6f706c2e req-e90bb5bb-e9ef-416d-86dd-d69be844befe tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Made reservation on behalf of 1b7916b634f74760a565cfeaef510cd9 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:25:55.770076 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-82d0b945-980b-4103-a75e-6b745fc018fb req-a2d1ac28-8a88-4364-9c27-54b09310acef tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:55.772724 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: be89ffc7-e26a-4049-9372-9a434624cba7 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:25:55.773134 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device be89ffc7-e26a-4049-9372-9a434624cba7 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:25:55.774423 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-475cca33-229e-4cda-890f-724f6f706c2e req-e90bb5bb-e9ef-416d-86dd-d69be844befe tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:55.797789 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-82d0b945-980b-4103-a75e-6b745fc018fb req-a2d1ac28-8a88-4364-9c27-54b09310acef tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3601148 Dec 09 21:25:55.828795 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=3ebbcc5a-481f-4868-8b55-d0176959424c,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:55.848877 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2d1ac28-8a88-4364-9c27-54b09310acef tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=03d925ec-d2f6-41ca-80e3-fe2cf6972aa4,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:55.926043 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-475cca33-229e-4cda-890f-724f6f706c2e req-e90bb5bb-e9ef-416d-86dd-d69be844befe tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Allocated IP 172.20.0.9 (43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb/50496955-1646-4079-acd4-a47e8cd175cb/058ec1cc-1cd2-44ec-93de-4557c5dd65de) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:25:56.013946 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ba5ee53-d210-4821-a379-b50ecb80dd2e req-86d38a3b-0207-4a3f-9e28-fbc61fd2593d tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:56.016030 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ba5ee53-d210-4821-a379-b50ecb80dd2e req-86d38a3b-0207-4a3f-9e28-fbc61fd2593d tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=68d909ed-6a44-454a-9fce-e4dd59e2d088 HTTP/1.1" status: 200 len: 945 time: 0.1070082 Dec 09 21:25:56.049328 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b4a827e9-963f-42a6-b1bf-d98723135cf2 req-902004cb-634b-491a-b829-8c9f6b674c4d tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "GET /v2.0/security-groups/bf43dc1d-fc98-4f45-8b2e-33b02cf1628a HTTP/1.1" status: 200 len: 1829 time: 0.0995018 Dec 09 21:25:56.057033 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-b4a827e9-963f-42a6-b1bf-d98723135cf2 req-7e34f549-f6d7-4ea0-8f37-926528109ed9 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Request body: {'security_group_rules': [{'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': 'bf43dc1d-fc98-4f45-8b2e-33b02cf1628a', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}]} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:56.057612 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-b4a827e9-963f-42a6-b1bf-d98723135cf2 req-7e34f549-f6d7-4ea0-8f37-926528109ed9 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Request body: {'security_group_rule': {'direction': 'ingress', 'protocol': 'tcp', 'ethertype': 'IPv4', 'remote_ip_prefix': '0.0.0.0/0', 'security_group_id': 'bf43dc1d-fc98-4f45-8b2e-33b02cf1628a', 'remote_group_id': None, 'port_range_min': 22, 'port_range_max': 22}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:56.108610 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ba5ee53-d210-4821-a379-b50ecb80dd2e req-89a75534-bff6-4f25-ae81-e25432d28b1b tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0854328 Dec 09 21:25:56.152576 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-475cca33-229e-4cda-890f-724f6f706c2e req-e90bb5bb-e9ef-416d-86dd-d69be844befe tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:56.175181 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b4a827e9-963f-42a6-b1bf-d98723135cf2 req-7e34f549-f6d7-4ea0-8f37-926528109ed9 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:56.187407 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38648) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:56.221289 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b4a827e9-963f-42a6-b1bf-d98723135cf2 req-7e34f549-f6d7-4ea0-8f37-926528109ed9 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:56.227843 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b4a827e9-963f-42a6-b1bf-d98723135cf2 req-7e34f549-f6d7-4ea0-8f37-926528109ed9 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:56.228927 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9f1b9238-610a-483e-9478-165d3fffff93 x-openstack-request-id: req-9f1b9238-610a-483e-9478-165d3fffff93 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:56.229946 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "68d909ed-6a44-454a-9fce-e4dd59e2d088", "name": "network-vif-plugged", "status": "completed", "tag": "775d6690-9f80-4aa2-9026-bb97c37d24af", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:56.230440 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-9f1b9238-610a-483e-9478-165d3fffff93 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:56.231326 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '68d909ed-6a44-454a-9fce-e4dd59e2d088', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '775d6690-9f80-4aa2-9026-bb97c37d24af', 'code': 200} Dec 09 21:25:56.258698 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e34f549-f6d7-4ea0-8f37-926528109ed9 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b7ed7555-9867-4b8c-932c-dcbe3daae972,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:56.268207 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b4a827e9-963f-42a6-b1bf-d98723135cf2 req-7e34f549-f6d7-4ea0-8f37-926528109ed9 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:56.281042 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b4a827e9-963f-42a6-b1bf-d98723135cf2 req-7e34f549-f6d7-4ea0-8f37-926528109ed9 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 0.2298138 Dec 09 21:25:56.311706 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-475cca33-229e-4cda-890f-724f6f706c2e req-e90bb5bb-e9ef-416d-86dd-d69be844befe tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:56.318160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-d2803214-5e63-43f6-8023-af6c8f084fd5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Deleting subnet f4a2d786-583b-4e8b-9946-37b7ed5fd3e8 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:25:56.334813 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d2803214-5e63-43f6-8023-af6c8f084fd5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:56.635201 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85ba7492-efa8-4e9b-b623-4266abfc63b0 req-52038dbe-f68f-4792-99c1-5649c174854f tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/ports?device_id=9503e24d-9ce5-4566-8e69-df8da4219cec HTTP/1.1" status: 200 len: 210 time: 0.0657656 Dec 09 21:25:56.664188 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-452e344c-432d-46de-9612-d405fa7521d8 req-06fecbd8-7c53-43b5-b94a-c4857a62c725 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:56.668085 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-452e344c-432d-46de-9612-d405fa7521d8 req-06fecbd8-7c53-43b5-b94a-c4857a62c725 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 931 time: 0.2052310 Dec 09 21:25:56.708154 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7b90e520-d7b0-47a7-bf45-58599a9845eb x-openstack-request-id: req-7b90e520-d7b0-47a7-bf45-58599a9845eb {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:56.709025 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e529b5d4-f89f-43c5-8e52-68ae6fa62846", "name": "network-vif-deleted", "tag": "39a4e9cb-cd4f-4df2-9c02-6776529dc801", "status": "completed", "code": 200}, {"server_uuid": "e529b5d4-f89f-43c5-8e52-68ae6fa62846", "name": "network-vif-deleted", "tag": "be89ffc7-e26a-4049-9372-9a434624cba7", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:56.709476 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-7b90e520-d7b0-47a7-bf45-58599a9845eb {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:56.710043 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e529b5d4-f89f-43c5-8e52-68ae6fa62846', 'name': 'network-vif-deleted', 'tag': '39a4e9cb-cd4f-4df2-9c02-6776529dc801', 'status': 'completed', 'code': 200} Dec 09 21:25:56.710472 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e529b5d4-f89f-43c5-8e52-68ae6fa62846', 'name': 'network-vif-deleted', 'tag': 'be89ffc7-e26a-4049-9372-9a434624cba7', 'status': 'completed', 'code': 200} Dec 09 21:25:56.748166 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-475cca33-229e-4cda-890f-724f6f706c2e req-e90bb5bb-e9ef-416d-86dd-d69be844befe tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:25:56.766046 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-475cca33-229e-4cda-890f-724f6f706c2e req-e90bb5bb-e9ef-416d-86dd-d69be844befe tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:25:56.770200 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d2803214-5e63-43f6-8023-af6c8f084fd5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:56.775359 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-475cca33-229e-4cda-890f-724f6f706c2e req-e90bb5bb-e9ef-416d-86dd-d69be844befe tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:25:56.803638 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-452e344c-432d-46de-9612-d405fa7521d8 req-f345a91b-4a2d-468a-998e-7a80a9692658 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1293399 Dec 09 21:25:56.804132 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e90bb5bb-e9ef-416d-86dd-d69be844befe tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Pushing event updated for resources: {'Port': ['ID=058ec1cc-1cd2-44ec-93de-4557c5dd65de,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:56.837390 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1dd138e9-3078-4fb7-abea-5071c6b78e49 req-7d6b46f4-d9cc-40e2-ae77-409e7ee5d7bc tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "GET /v2.0/security-groups/bf43dc1d-fc98-4f45-8b2e-33b02cf1628a HTTP/1.1" status: 200 len: 2422 time: 0.1106293 Dec 09 21:25:56.868035 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ee3b56b-5cc4-4282-8a3a-0db0eb2da610 req-440c5eba-a5fb-491e-aa5a-717899a3a171 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:56.870036 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3ee3b56b-5cc4-4282-8a3a-0db0eb2da610 req-440c5eba-a5fb-491e-aa5a-717899a3a171 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=68d909ed-6a44-454a-9fce-e4dd59e2d088 HTTP/1.1" status: 200 len: 1097 time: 0.5564487 Dec 09 21:25:56.899639 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94958ba1-e6e5-41cc-a408-3184b6e02cd2 req-0c8b770a-cb93-425e-a722-e8ffaad14e88 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "GET /v2.0/security-group-rules/b7ed7555-9867-4b8c-932c-dcbe3daae972 HTTP/1.1" status: 200 len: 778 time: 0.0406301 Dec 09 21:25:56.968321 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-475cca33-229e-4cda-890f-724f6f706c2e req-e90bb5bb-e9ef-416d-86dd-d69be844befe tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:56.969327 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-475cca33-229e-4cda-890f-724f6f706c2e req-e90bb5bb-e9ef-416d-86dd-d69be844befe tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:56.981907 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-496bcbe2-f5f7-4590-b9c8-a266301ba8bb tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0355480 Dec 09 21:25:56.987853 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94958ba1-e6e5-41cc-a408-3184b6e02cd2 req-caed3e77-deb0-41c3-a47d-a0669ee72fe7 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "GET /v2.0/security-groups/bf43dc1d-fc98-4f45-8b2e-33b02cf1628a HTTP/1.1" status: 200 len: 2422 time: 0.0871127 Dec 09 21:25:57.034656 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-475cca33-229e-4cda-890f-724f6f706c2e req-e90bb5bb-e9ef-416d-86dd-d69be844befe tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5292058 Dec 09 21:25:57.044837 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3ee3b56b-5cc4-4282-8a3a-0db0eb2da610 req-d315722e-6acd-4e71-9e7f-3850cb070fe8 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1614077 Dec 09 21:25:57.051368 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-475cca33-229e-4cda-890f-724f6f706c2e req-d12aeea2-897e-4cde-af8f-75af021c3783 service neutron] Request body: {'port': {'device_id': 'e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:57.053700 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:57.055414 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d2803214-5e63-43f6-8023-af6c8f084fd5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:57.080280 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:57.090028 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-94958ba1-e6e5-41cc-a408-3184b6e02cd2 req-675c54d1-fe10-47a5-a75e-b6e745030da8 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:57.105330 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-94958ba1-e6e5-41cc-a408-3184b6e02cd2 req-675c54d1-fe10-47a5-a75e-b6e745030da8 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:57.146820 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-475cca33-229e-4cda-890f-724f6f706c2e req-d12aeea2-897e-4cde-af8f-75af021c3783 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:57.157085 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-c3ed9614-581a-43a6-800f-ad93a65de327 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:57.158547 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-c3ed9614-581a-43a6-800f-ad93a65de327 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1625578 Dec 09 21:25:57.159753 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-94958ba1-e6e5-41cc-a408-3184b6e02cd2 req-675c54d1-fe10-47a5-a75e-b6e745030da8 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:57.164904 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-94958ba1-e6e5-41cc-a408-3184b6e02cd2 req-675c54d1-fe10-47a5-a75e-b6e745030da8 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:57.168623 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94958ba1-e6e5-41cc-a408-3184b6e02cd2 req-675c54d1-fe10-47a5-a75e-b6e745030da8 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "DELETE /v2.0/security-group-rules/b7ed7555-9867-4b8c-932c-dcbe3daae972 HTTP/1.1" status: 204 len: 173 time: 0.1699803 Dec 09 21:25:57.191905 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d2803214-5e63-43f6-8023-af6c8f084fd5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:57.194609 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-675c54d1-fe10-47a5-a75e-b6e745030da8 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=b7ed7555-9867-4b8c-932c-dcbe3daae972,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:57.200365 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-90df429c-4332-4cb3-a058-e3d14ad7e5e7 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/quotas/23f7f8a3e7b14635b4f7dfa561684399 HTTP/1.1" status: 200 len: 375 time: 0.0296772 Dec 09 21:25:57.232476 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2803214-5e63-43f6-8023-af6c8f084fd5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event deleted for resources: {'Subnet': ['ID=f4a2d786-583b-4e8b-9946-37b7ed5fd3e8,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:57.240190 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d2803214-5e63-43f6-8023-af6c8f084fd5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:57.245574 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-afa17705-3759-4842-b2af-925ef06da110 None None] Network c8e08369-5b79-4a41-a5f9-0059632e26cd requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:25:57.246102 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d2803214-5e63-43f6-8023-af6c8f084fd5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "DELETE /v2.0/subnets/f4a2d786-583b-4e8b-9946-37b7ed5fd3e8 HTTP/1.1" status: 204 len: 168 time: 1.0548725 Dec 09 21:25:57.250504 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38674) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:57.314516 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-e557e199-db4e-4686-84b8-332a7c07498d tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1024404 Dec 09 21:25:57.337668 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32afd1ee-96b0-4bad-8e78-5f4ba3f875cb req-9cd60131-d429-48eb-b13b-408687ca4997 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:57.346307 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32afd1ee-96b0-4bad-8e78-5f4ba3f875cb req-9cd60131-d429-48eb-b13b-408687ca4997 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=68d909ed-6a44-454a-9fce-e4dd59e2d088 HTTP/1.1" status: 200 len: 945 time: 0.0857229 Dec 09 21:25:57.405640 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32afd1ee-96b0-4bad-8e78-5f4ba3f875cb req-1d025f71-268a-4bc9-b989-b8834a700677 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0579817 Dec 09 21:25:57.411394 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1add6116-e6ac-47f5-9336-174f40f3b6dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:57.442807 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-4acbe5fe-451c-4eda-908e-c2d3baf8d9ce req-f76b2408-66c7-4043-8aa3-cb130bc68b55 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-87444175', 'description': 'tempest-description-291252194'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:57.488953 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4acbe5fe-451c-4eda-908e-c2d3baf8d9ce req-f76b2408-66c7-4043-8aa3-cb130bc68b55 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:57.581202 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1add6116-e6ac-47f5-9336-174f40f3b6dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Deleting port d22ec760-b478-40d7-8730-439cce19a9e0 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:57.581550 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1add6116-e6ac-47f5-9336-174f40f3b6dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:57.645107 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4acbe5fe-451c-4eda-908e-c2d3baf8d9ce req-f76b2408-66c7-4043-8aa3-cb130bc68b55 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:57.655612 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4acbe5fe-451c-4eda-908e-c2d3baf8d9ce req-f76b2408-66c7-4043-8aa3-cb130bc68b55 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:57.670659 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1a71dc4-74fb-45d3-9d09-2a3264083a80 None None] DHCP port deletion for c8e08369-5b79-4a41-a5f9-0059632e26cd request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:25:57.670982 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-9c3d552d-7226-4d9b-b93a-336635076644 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=6ef183f29d2f4992bf91a120a9d85fac&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0675373 Dec 09 21:25:57.738109 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-475cca33-229e-4cda-890f-724f6f706c2e req-d12aeea2-897e-4cde-af8f-75af021c3783 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 058ec1cc-1cd2-44ec-93de-4557c5dd65de {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:25:57.751683 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-1add6116-e6ac-47f5-9336-174f40f3b6dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] For port d22ec760-b478-40d7-8730-439cce19a9e0, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d22ec760-b478-40d7-8730-439cce19a9e0,segment=NetworkSegment(e72604b7-1620-485e-8ea6-a66ce97f67f1),segment_id=e72604b7-1620-485e-8ea6-a66ce97f67f1)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:57.752058 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1add6116-e6ac-47f5-9336-174f40f3b6dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:57.772664 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-475cca33-229e-4cda-890f-724f6f706c2e req-d12aeea2-897e-4cde-af8f-75af021c3783 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:57.774720 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4acbe5fe-451c-4eda-908e-c2d3baf8d9ce req-f76b2408-66c7-4043-8aa3-cb130bc68b55 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:57.780727 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1add6116-e6ac-47f5-9336-174f40f3b6dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Calling delete_port for d22ec760-b478-40d7-8730-439cce19a9e0 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:25:57.788738 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4acbe5fe-451c-4eda-908e-c2d3baf8d9ce req-f76b2408-66c7-4043-8aa3-cb130bc68b55 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1832 time: 0.3606501 Dec 09 21:25:57.816887 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f76b2408-66c7-4043-8aa3-cb130bc68b55 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8b8d7af4-acc3-4272-915e-3d467f1dd8c4,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:57.834386 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f1a71dc4-74fb-45d3-9d09-2a3264083a80 None None] Deleting port d22ec760-b478-40d7-8730-439cce19a9e0 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:57.835123 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f1a71dc4-74fb-45d3-9d09-2a3264083a80 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:57.888936 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d22ec760-b478-40d7-8730-439cce19a9e0 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:25:57.928457 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-475cca33-229e-4cda-890f-724f6f706c2e req-d12aeea2-897e-4cde-af8f-75af021c3783 service neutron] Transition to ACTIVE for port object 058ec1cc-1cd2-44ec-93de-4557c5dd65de will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:25:57.999252 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f1a71dc4-74fb-45d3-9d09-2a3264083a80 None None] For port d22ec760-b478-40d7-8730-439cce19a9e0, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d22ec760-b478-40d7-8730-439cce19a9e0,segment=NetworkSegment(e72604b7-1620-485e-8ea6-a66ce97f67f1),segment_id=e72604b7-1620-485e-8ea6-a66ce97f67f1)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:25:58.003884 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f1a71dc4-74fb-45d3-9d09-2a3264083a80 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:58.045678 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1add6116-e6ac-47f5-9336-174f40f3b6dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:58.047871 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f1a71dc4-74fb-45d3-9d09-2a3264083a80 None None] Calling delete_port for d22ec760-b478-40d7-8730-439cce19a9e0 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:25:58.052495 n-d-713301-27 neutron-server[103439]: INFO neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No ports have port_id starting with d22ec760-b478-40d7-8730-439cce19a9e0 Dec 09 21:25:58.089366 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-475cca33-229e-4cda-890f-724f6f706c2e req-d12aeea2-897e-4cde-af8f-75af021c3783 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:58.109779 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-68239b76-bfd9-4e1a-bc96-7eae6ff47372 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:58.111366 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-68239b76-bfd9-4e1a-bc96-7eae6ff47372 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4144933 Dec 09 21:25:58.113759 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1add6116-e6ac-47f5-9336-174f40f3b6dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event deleted for resources: {'Port': ['ID=d22ec760-b478-40d7-8730-439cce19a9e0,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:58.133512 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-58703560-6912-4266-9772-c08e59f405d6 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Request body: {'port': {'device_id': '9503e24d-9ce5-4566-8e69-df8da4219cec', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '6ef183f29d2f4992bf91a120a9d85fac'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:58.199042 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f1a71dc4-74fb-45d3-9d09-2a3264083a80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:58.205662 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-73ab288e-beac-4303-8912-84a140ddbcfe req-c3e849ed-110d-4b70-ab34-edb27ad55ef6 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/ports?device_id=9503e24d-9ce5-4566-8e69-df8da4219cec HTTP/1.1" status: 200 len: 210 time: 0.0701222 Dec 09 21:25:58.232555 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1a71dc4-74fb-45d3-9d09-2a3264083a80 None None] Pushing event deleted for resources: {'Port': ['ID=d22ec760-b478-40d7-8730-439cce19a9e0,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:58.234195 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '70a40261-9248-40ae-8cc6-be041817b657', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3ebbcc5a-481f-4868-8b55-d0176959424c'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:58.237896 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ec92b926-19a1-4c49-9ed1-efd971ce68d4" -d '{"events": [{"server_uuid": "70a40261-9248-40ae-8cc6-be041817b657", "name": "network-vif-plugged", "status": "completed", "tag": "3ebbcc5a-481f-4868-8b55-d0176959424c"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:58.243483 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1add6116-e6ac-47f5-9336-174f40f3b6dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] No DVR routers for this DVR port d22ec760-b478-40d7-8730-439cce19a9e0 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:25:58.243740 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1a71dc4-74fb-45d3-9d09-2a3264083a80 None None] No DVR routers for this DVR port d22ec760-b478-40d7-8730-439cce19a9e0 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:25:58.297387 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d12aeea2-897e-4cde-af8f-75af021c3783 service neutron] Pushing event updated for resources: {'Port': ['ID=058ec1cc-1cd2-44ec-93de-4557c5dd65de,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:58.376750 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b31b91f-6889-449e-96ff-b64ede71d294 req-75e885d9-3733-4952-b6c1-06ee13110392 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "GET /v2.0/security-groups/8b8d7af4-acc3-4272-915e-3d467f1dd8c4 HTTP/1.1" status: 200 len: 1827 time: 0.1819220 Dec 09 21:25:58.451619 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5a4d337-10b7-4a15-a750-a552d1eb2b4d req-07c37fe2-4159-4250-9fa9-8bbb7ba52501 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:58.457408 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5a4d337-10b7-4a15-a750-a552d1eb2b4d req-07c37fe2-4159-4250-9fa9-8bbb7ba52501 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 943 time: 0.1178415 Dec 09 21:25:58.529109 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-58703560-6912-4266-9772-c08e59f405d6 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Made reservation on behalf of 6ef183f29d2f4992bf91a120a9d85fac for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:25:58.533450 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-58703560-6912-4266-9772-c08e59f405d6 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:58.556464 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5a4d337-10b7-4a15-a750-a552d1eb2b4d req-77e0caeb-3bf5-4a6d-8017-4447bc86f7de tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0907524 Dec 09 21:25:58.585113 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1add6116-e6ac-47f5-9336-174f40f3b6dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:58.594969 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-58703560-6912-4266-9772-c08e59f405d6 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:58.624641 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-12ceb6de-1411-4509-b9d4-e98a1238cbe8 x-openstack-request-id: req-12ceb6de-1411-4509-b9d4-e98a1238cbe8 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:58.625163 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "70a40261-9248-40ae-8cc6-be041817b657", "name": "network-vif-plugged", "status": "completed", "tag": "3ebbcc5a-481f-4868-8b55-d0176959424c", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:58.625296 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-12ceb6de-1411-4509-b9d4-e98a1238cbe8 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:58.625588 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '70a40261-9248-40ae-8cc6-be041817b657', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3ebbcc5a-481f-4868-8b55-d0176959424c', 'code': 200} Dec 09 21:25:58.660167 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-1add6116-e6ac-47f5-9336-174f40f3b6dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c8e08369-5b79-4a41-a5f9-0059632e26cd']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:58.692804 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-475cca33-229e-4cda-890f-724f6f706c2e req-d12aeea2-897e-4cde-af8f-75af021c3783 service neutron] Attempting to bind port 058ec1cc-1cd2-44ec-93de-4557c5dd65de on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:25:58.693146 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-475cca33-229e-4cda-890f-724f6f706c2e req-d12aeea2-897e-4cde-af8f-75af021c3783 service neutron] Attempting to bind port 058ec1cc-1cd2-44ec-93de-4557c5dd65de by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:25:58.693483 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-475cca33-229e-4cda-890f-724f6f706c2e req-d12aeea2-897e-4cde-af8f-75af021c3783 service neutron] Attempting to bind port 058ec1cc-1cd2-44ec-93de-4557c5dd65de on network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:58.712575 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-1add6116-e6ac-47f5-9336-174f40f3b6dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e72604b7-1620-485e-8ea6-a66ce97f67f1') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:58.712868 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-1add6116-e6ac-47f5-9336-174f40f3b6dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e72604b7-1620-485e-8ea6-a66ce97f67f1') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:25:58.714902 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-475cca33-229e-4cda-890f-724f6f706c2e req-d12aeea2-897e-4cde-af8f-75af021c3783 service neutron] Port 058ec1cc-1cd2-44ec-93de-4557c5dd65de on network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:25:58.715288 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-475cca33-229e-4cda-890f-724f6f706c2e req-d12aeea2-897e-4cde-af8f-75af021c3783 service neutron] Attempting to bind port 058ec1cc-1cd2-44ec-93de-4557c5dd65de on network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:25:58.728644 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0e0185d-482a-41c1-976a-3b42339bd6b5 req-c5fdf785-5457-457e-8653-0a4b60f81bb1 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:58.730528 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d0e0185d-482a-41c1-976a-3b42339bd6b5 req-c5fdf785-5457-457e-8653-0a4b60f81bb1 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.13 "GET /v2.0/ports?device_id=97debe2b-c2b5-48af-a541-3e55e73d399f HTTP/1.1" status: 200 len: 946 time: 0.1023862 Dec 09 21:25:58.737985 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1add6116-e6ac-47f5-9336-174f40f3b6dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:58.749092 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-475cca33-229e-4cda-890f-724f6f706c2e req-d12aeea2-897e-4cde-af8f-75af021c3783 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 25, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:25:58.750147 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-475cca33-229e-4cda-890f-724f6f706c2e req-d12aeea2-897e-4cde-af8f-75af021c3783 service neutron] Checking segment: {'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:25:58.750896 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-475cca33-229e-4cda-890f-724f6f706c2e req-d12aeea2-897e-4cde-af8f-75af021c3783 service neutron] Bound using segment: {'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:25:58.751590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-475cca33-229e-4cda-890f-724f6f706c2e req-d12aeea2-897e-4cde-af8f-75af021c3783 service neutron] Bound port: 058ec1cc-1cd2-44ec-93de-4557c5dd65de, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:25:58.752173 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-475cca33-229e-4cda-890f-724f6f706c2e req-d12aeea2-897e-4cde-af8f-75af021c3783 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:58.776755 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1add6116-e6ac-47f5-9336-174f40f3b6dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:58.786687 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1add6116-e6ac-47f5-9336-174f40f3b6dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Releasing vlan 134 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:25:58.787464 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1add6116-e6ac-47f5-9336-174f40f3b6dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:25:58.792330 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:25:58.868218 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98ba935d-6400-47c4-a934-f9c4f74a7edd req-7e75198b-03e5-41a2-9df0-719b62e39eca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:58.869737 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98ba935d-6400-47c4-a934-f9c4f74a7edd req-7e75198b-03e5-41a2-9df0-719b62e39eca service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=70a40261-9248-40ae-8cc6-be041817b657 HTTP/1.1" status: 200 len: 1097 time: 0.1620824 Dec 09 21:25:58.906341 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d0e0185d-482a-41c1-976a-3b42339bd6b5 req-fe08b200-ce81-4eae-931e-f7846bb58058 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.13 "GET /v2.0/security-groups?id=b7152147-ed7a-4a1f-b140-69adad7d753f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1649761 Dec 09 21:25:58.937038 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1add6116-e6ac-47f5-9336-174f40f3b6dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:58.937776 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98ba935d-6400-47c4-a934-f9c4f74a7edd req-a529a614-2baa-465f-8868-bc6fb3453a2f service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0575202 Dec 09 21:25:58.957240 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c5d98b2-83b9-4472-bc00-f037ffd7089c req-730bbafc-d9da-4e40-8de6-a114d18e6e01 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:58.963991 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1add6116-e6ac-47f5-9336-174f40f3b6dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:58.966599 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c5d98b2-83b9-4472-bc00-f037ffd7089c req-730bbafc-d9da-4e40-8de6-a114d18e6e01 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=68d909ed-6a44-454a-9fce-e4dd59e2d088 HTTP/1.1" status: 200 len: 945 time: 0.2344019 Dec 09 21:25:58.968612 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1add6116-e6ac-47f5-9336-174f40f3b6dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "DELETE /v2.0/networks/c8e08369-5b79-4a41-a5f9-0059632e26cd HTTP/1.1" status: 204 len: 168 time: 1.7176199 Dec 09 21:25:58.985113 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38716) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:58.986723 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-475cca33-229e-4cda-890f-724f6f706c2e req-d12aeea2-897e-4cde-af8f-75af021c3783 service neutron] For port 058ec1cc-1cd2-44ec-93de-4557c5dd65de, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:25:59.022807 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ee772084-847c-4328-8be9-f47c946437de req-9b6efe84-ae8d-4259-8081-347dc0396329 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=d3f455b1-1a56-4ded-ab82-e9ce51afbfde HTTP/1.1" status: 200 len: 210 time: 0.0450294 Dec 09 21:25:59.057829 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1add6116-e6ac-47f5-9336-174f40f3b6dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event deleted for resources: {'Network': ['ID=c8e08369-5b79-4a41-a5f9-0059632e26cd,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:59.057829 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-58703560-6912-4266-9772-c08e59f405d6 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:59.069138 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-03a7889d-ba32-4dbc-b828-0533b47def7c tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Deleting subnet c9ca5636-e2f1-4aee-84ec-4054f1a18361 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:25:59.074864 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c5d98b2-83b9-4472-bc00-f037ffd7089c req-ea2c5b91-04e2-4eab-a92a-e1652a882211 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1027062 Dec 09 21:25:59.077176 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03a7889d-ba32-4dbc-b828-0533b47def7c tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:59.082899 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-0253a498-9ac7-4ce1-b0b6-eecc62349342 req-f5a57e32-b020-49e1-acc7-4a3dc83ac298 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-735280482', 'description': 'tempest-description-304349461'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:59.120452 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03a7889d-ba32-4dbc-b828-0533b47def7c tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:59.124208 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0253a498-9ac7-4ce1-b0b6-eecc62349342 req-f5a57e32-b020-49e1-acc7-4a3dc83ac298 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:59.169287 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-58703560-6912-4266-9772-c08e59f405d6 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:59.174614 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-475cca33-229e-4cda-890f-724f6f706c2e req-d12aeea2-897e-4cde-af8f-75af021c3783 service neutron] For port 058ec1cc-1cd2-44ec-93de-4557c5dd65de, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=058ec1cc-1cd2-44ec-93de-4557c5dd65de,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:25:59.191223 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-475cca33-229e-4cda-890f-724f6f706c2e req-d12aeea2-897e-4cde-af8f-75af021c3783 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:59.212909 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0253a498-9ac7-4ce1-b0b6-eecc62349342 req-f5a57e32-b020-49e1-acc7-4a3dc83ac298 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:59.225506 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0253a498-9ac7-4ce1-b0b6-eecc62349342 req-f5a57e32-b020-49e1-acc7-4a3dc83ac298 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:59.318890 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0253a498-9ac7-4ce1-b0b6-eecc62349342 req-f5a57e32-b020-49e1-acc7-4a3dc83ac298 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:59.321280 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-475cca33-229e-4cda-890f-724f6f706c2e req-d12aeea2-897e-4cde-af8f-75af021c3783 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:59.321889 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-475cca33-229e-4cda-890f-724f6f706c2e req-d12aeea2-897e-4cde-af8f-75af021c3783 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:59.323534 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-475cca33-229e-4cda-890f-724f6f706c2e req-d12aeea2-897e-4cde-af8f-75af021c3783 service neutron] 10.222.0.31 "PUT /v2.0/ports/058ec1cc-1cd2-44ec-93de-4557c5dd65de HTTP/1.1" status: 200 len: 1092 time: 2.2777383 Dec 09 21:25:59.324109 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f', 'tag': '058ec1cc-1cd2-44ec-93de-4557c5dd65de'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:25:59.326419 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c4a6ed4c-d527-4f26-9c99-c4e744288b2b" -d '{"events": [{"name": "network-changed", "server_uuid": "e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f", "tag": "058ec1cc-1cd2-44ec-93de-4557c5dd65de"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:25:59.332028 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0253a498-9ac7-4ce1-b0b6-eecc62349342 req-f5a57e32-b020-49e1-acc7-4a3dc83ac298 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1833 time: 0.2557542 Dec 09 21:25:59.336306 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58703560-6912-4266-9772-c08e59f405d6 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c81de824-def8-4781-88c7-f240bf84e2af,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:59.369017 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5a57e32-b020-49e1-acc7-4a3dc83ac298 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Pushing event updated for resources: {'SecurityGroup': ['ID=be517c53-9d70-4d2b-8e16-635c82cf0122,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:59.374650 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03a7889d-ba32-4dbc-b828-0533b47def7c tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:59.413623 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d12aeea2-897e-4cde-af8f-75af021c3783 service neutron] Pushing event updated for resources: {'Port': ['ID=058ec1cc-1cd2-44ec-93de-4557c5dd65de,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:59.418900 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-93a538a4-951a-4274-ba9c-eec773f24093 req-16f88bea-306f-44b3-996f-32103fda8b4e tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/ports?device_id=9503e24d-9ce5-4566-8e69-df8da4219cec HTTP/1.1" status: 200 len: 210 time: 0.0322857 Dec 09 21:25:59.427989 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2d6fdd5-ccb7-41e3-a23b-88b7d1529c33 req-d5d37f5a-4c7d-4465-98b5-e61217058a77 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:59.429612 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c2d6fdd5-ccb7-41e3-a23b-88b7d1529c33 req-d5d37f5a-4c7d-4465-98b5-e61217058a77 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=70a40261-9248-40ae-8cc6-be041817b657 HTTP/1.1" status: 200 len: 945 time: 0.1716239 Dec 09 21:25:59.502834 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-58703560-6912-4266-9772-c08e59f405d6 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Allocated IP 192.168.233.138 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/f4a163f1-05a1-4823-866b-b41a21ed72be) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:25:59.506855 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c2d6fdd5-ccb7-41e3-a23b-88b7d1529c33 req-647a998a-b8b8-47fb-8809-5df148973650 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0706263 Dec 09 21:25:59.524474 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d8bb7b9-f5b8-4ae8-994e-3495b14bd9f9 req-8ec1151f-1190-4daa-9fa4-b0a8bdbaadc2 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "GET /v2.0/security-groups/be517c53-9d70-4d2b-8e16-635c82cf0122 HTTP/1.1" status: 200 len: 1828 time: 0.0577357 Dec 09 21:25:59.537150 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-475cca33-229e-4cda-890f-724f6f706c2e req-6df902a1-b3e8-4135-8f5e-817c0e8e93ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:59.538934 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-475cca33-229e-4cda-890f-724f6f706c2e req-6df902a1-b3e8-4135-8f5e-817c0e8e93ce service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=1b7916b634f74760a565cfeaef510cd9&device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 1095 time: 0.1152804 Dec 09 21:25:59.544306 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03a7889d-ba32-4dbc-b828-0533b47def7c tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:59.553602 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-a31d90c3-a286-41b8-a1c0-5e2e95c7bb74 req-8bf62c7c-c4f3-44a6-bc0c-a99e4ff093f7 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2009305277', 'description': 'tempest-description-646220307'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:25:59.576531 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a31d90c3-a286-41b8-a1c0-5e2e95c7bb74 req-8bf62c7c-c4f3-44a6-bc0c-a99e4ff093f7 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:59.579068 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:25:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7ac3b5fb-4603-44c3-bd6f-2fb5fe1dca30 x-openstack-request-id: req-7ac3b5fb-4603-44c3-bd6f-2fb5fe1dca30 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:25:59.579367 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f", "tag": "058ec1cc-1cd2-44ec-93de-4557c5dd65de", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:25:59.579650 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-7ac3b5fb-4603-44c3-bd6f-2fb5fe1dca30 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:25:59.580058 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f', 'tag': '058ec1cc-1cd2-44ec-93de-4557c5dd65de', 'status': 'completed', 'code': 200} Dec 09 21:25:59.597426 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03a7889d-ba32-4dbc-b828-0533b47def7c tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event deleted for resources: {'Subnet': ['ID=c9ca5636-e2f1-4aee-84ec-4054f1a18361,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:25:59.633512 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03a7889d-ba32-4dbc-b828-0533b47def7c tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:59.639870 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-03a7889d-ba32-4dbc-b828-0533b47def7c tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "DELETE /v2.0/subnets/c9ca5636-e2f1-4aee-84ec-4054f1a18361 HTTP/1.1" status: 204 len: 168 time: 0.6504867 Dec 09 21:25:59.643619 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c0784cda-1a9c-4a12-8d04-2a112a114454 None None] Network 6a0b092d-9731-4bc3-9661-8d5436bc9f71 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:25:59.644665 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38730) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:25:59.646751 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-475cca33-229e-4cda-890f-724f6f706c2e req-50200a2e-c1b0-4ff0-833b-185609b4fccd service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=058ec1cc-1cd2-44ec-93de-4557c5dd65de HTTP/1.1" status: 200 len: 217 time: 0.0658464 Dec 09 21:25:59.725684 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a31d90c3-a286-41b8-a1c0-5e2e95c7bb74 req-8bf62c7c-c4f3-44a6-bc0c-a99e4ff093f7 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:59.768517 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-475cca33-229e-4cda-890f-724f6f706c2e req-0ba50d42-540f-4f83-9b06-db39d8d09453 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:25:59.770050 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-475cca33-229e-4cda-890f-724f6f706c2e req-0ba50d42-540f-4f83-9b06-db39d8d09453 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=50496955-1646-4079-acd4-a47e8cd175cb HTTP/1.1" status: 200 len: 852 time: 0.1123180 Dec 09 21:25:59.821603 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-475cca33-229e-4cda-890f-724f6f706c2e req-6718b602-6ea2-43dd-a9fc-4fdd8bf1bf45 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0405152 Dec 09 21:25:59.840989 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6a9ff04f-f957-423d-b0fc-e6d74ed0cdaf None None] DHCP port deletion for 6a0b092d-9731-4bc3-9661-8d5436bc9f71 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:25:59.896060 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-58703560-6912-4266-9772-c08e59f405d6 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:25:59.945662 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-6a9ff04f-f957-423d-b0fc-e6d74ed0cdaf None None] Deleting port 163ae9b8-a7f0-4e1e-9a66-9ce437978aae {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:25:59.947073 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6a9ff04f-f957-423d-b0fc-e6d74ed0cdaf None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:00.009790 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-475cca33-229e-4cda-890f-724f6f706c2e req-99267bdf-e402-45c1-b235-99d0858094f8 service neutron] 10.222.0.31 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1716733 Dec 09 21:26:00.025175 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-58703560-6912-4266-9772-c08e59f405d6 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:00.031101 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a31d90c3-a286-41b8-a1c0-5e2e95c7bb74 req-8bf62c7c-c4f3-44a6-bc0c-a99e4ff093f7 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:00.052904 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6a9ff04f-f957-423d-b0fc-e6d74ed0cdaf None None] For port 163ae9b8-a7f0-4e1e-9a66-9ce437978aae, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=163ae9b8-a7f0-4e1e-9a66-9ce437978aae,segment=NetworkSegment(3e23a057-7b71-4625-891b-f66fd33737f2),segment_id=3e23a057-7b71-4625-891b-f66fd33737f2)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:00.053600 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6a9ff04f-f957-423d-b0fc-e6d74ed0cdaf None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:00.068621 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-6a9ff04f-f957-423d-b0fc-e6d74ed0cdaf None None] Calling delete_port for 163ae9b8-a7f0-4e1e-9a66-9ce437978aae owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:26:00.070315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bf62c7c-c4f3-44a6-bc0c-a99e4ff093f7 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fbcc2d39-7a75-433e-ac35-d63b1c329a97,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:00.099075 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-7a48e60a-e8e3-4bf5-abd7-c68f94e377d5 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0368171 Dec 09 21:26:00.109472 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f3bec34-955f-4f4e-a8fb-6263dfeab0f5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:00.135250 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a31d90c3-a286-41b8-a1c0-5e2e95c7bb74 req-8bf62c7c-c4f3-44a6-bc0c-a99e4ff093f7 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:00.136480 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a31d90c3-a286-41b8-a1c0-5e2e95c7bb74 req-8bf62c7c-c4f3-44a6-bc0c-a99e4ff093f7 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1834 time: 0.5882394 Dec 09 21:26:00.144691 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-558b4f9f-eb40-4b1a-8a67-80721ae22dd5 req-b9885aa2-0e21-4774-ab32-0a3c44e4971c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:00.152711 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-558b4f9f-eb40-4b1a-8a67-80721ae22dd5 req-b9885aa2-0e21-4774-ab32-0a3c44e4971c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 943 time: 0.5061874 Dec 09 21:26:00.174335 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6a9ff04f-f957-423d-b0fc-e6d74ed0cdaf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:00.216469 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-58703560-6912-4266-9772-c08e59f405d6 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:26:00.223250 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a9ff04f-f957-423d-b0fc-e6d74ed0cdaf None None] Pushing event deleted for resources: {'Port': ['ID=163ae9b8-a7f0-4e1e-9a66-9ce437978aae,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:00.230492 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58703560-6912-4266-9772-c08e59f405d6 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Pushing event updated for resources: {'Port': ['ID=f4a163f1-05a1-4823-866b-b41a21ed72be,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:00.233304 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-58703560-6912-4266-9772-c08e59f405d6 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:00.238102 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-58703560-6912-4266-9772-c08e59f405d6 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:26:00.244627 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-475cca33-229e-4cda-890f-724f6f706c2e req-f41810cf-e5a5-4fca-b3be-c9f672685d42 service neutron] 10.222.0.31 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2094736 Dec 09 21:26:00.248043 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a9ff04f-f957-423d-b0fc-e6d74ed0cdaf None None] No DVR routers for this DVR port 163ae9b8-a7f0-4e1e-9a66-9ce437978aae on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:26:00.278575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-7f3bec34-955f-4f4e-a8fb-6263dfeab0f5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] The port '163ae9b8-a7f0-4e1e-9a66-9ce437978aae' was deleted {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1958}} Dec 09 21:26:00.295197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20650e19-87ba-4b18-a2c2-62b2ef9ceaa1 req-bd757fd2-d3e9-49e2-aaef-5f7cb4ce90c0 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:00.296772 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-20650e19-87ba-4b18-a2c2-62b2ef9ceaa1 req-bd757fd2-d3e9-49e2-aaef-5f7cb4ce90c0 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.31 "GET /v2.0/ports?device_id=97debe2b-c2b5-48af-a541-3e55e73d399f HTTP/1.1" status: 200 len: 946 time: 0.1441734 Dec 09 21:26:00.340026 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-58703560-6912-4266-9772-c08e59f405d6 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:00.340705 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-58703560-6912-4266-9772-c08e59f405d6 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:00.445685 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-58703560-6912-4266-9772-c08e59f405d6 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.3167217 Dec 09 21:26:00.448935 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f3bec34-955f-4f4e-a8fb-6263dfeab0f5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:00.457149 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-558b4f9f-eb40-4b1a-8a67-80721ae22dd5 req-87847c9a-673d-4607-b63c-273e8e896c94 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3044057 Dec 09 21:26:00.478742 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-9945ad60-3322-4d13-8a74-6476bb36e6cf service neutron] Request body: {'port': {'device_id': '9503e24d-9ce5-4566-8e69-df8da4219cec', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:00.497062 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a12ea5-3af3-4c21-adc8-862a4d17af8c req-e34e2f3c-3a82-4f1f-a5b6-ca6c76d47957 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:00.499689 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99a12ea5-3af3-4c21-adc8-862a4d17af8c req-e34e2f3c-3a82-4f1f-a5b6-ca6c76d47957 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.13 "GET /v2.0/ports?device_id=97debe2b-c2b5-48af-a541-3e55e73d399f HTTP/1.1" status: 200 len: 946 time: 0.2555060 Dec 09 21:26:00.507109 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-4402a9c7-cf98-49d3-9b33-8731a75255be tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:00.508937 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-4402a9c7-cf98-49d3-9b33-8731a75255be tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3874018 Dec 09 21:26:00.524187 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-7f3bec34-955f-4f4e-a8fb-6263dfeab0f5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6a0b092d-9731-4bc3-9661-8d5436bc9f71']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:00.542604 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-d3ecbe1f-6721-4d35-bf7f-3fcec6bf779e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Request body: {'port': {'device_id': 'd3f455b1-1a56-4ded-ab82-e9ce51afbfde', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '23f7f8a3e7b14635b4f7dfa561684399'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:00.545286 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-9945ad60-3322-4d13-8a74-6476bb36e6cf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:00.577354 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4a6ed4c-d527-4f26-9c99-c4e744288b2b req-6fad2629-2744-4a1c-9b14-2b4b144d8d9f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:00.578878 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c4a6ed4c-d527-4f26-9c99-c4e744288b2b req-6fad2629-2744-4a1c-9b14-2b4b144d8d9f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=1b7916b634f74760a565cfeaef510cd9&device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 1095 time: 0.2351911 Dec 09 21:26:00.627121 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-7f3bec34-955f-4f4e-a8fb-6263dfeab0f5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3e23a057-7b71-4625-891b-f66fd33737f2') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:00.627377 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-7f3bec34-955f-4f4e-a8fb-6263dfeab0f5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3e23a057-7b71-4625-891b-f66fd33737f2') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:00.629413 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.31', 57653) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:00.641835 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7469728a-bcdd-4858-b73f-c951d481ff1d None None] Provisioning complete for port f4a163f1-05a1-4823-866b-b41a21ed72be triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:00.642779 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7469728a-bcdd-4858-b73f-c951d481ff1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:00.665728 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f24d572c-7962-45ba-8664-3b86145e5321 req-6fa900fb-4c73-4326-9881-5601d2ef0460 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=d3f455b1-1a56-4ded-ab82-e9ce51afbfde HTTP/1.1" status: 200 len: 210 time: 0.0534961 Dec 09 21:26:00.667558 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f3bec34-955f-4f4e-a8fb-6263dfeab0f5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:00.690271 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-7469728a-bcdd-4858-b73f-c951d481ff1d None None] Port f4a163f1-05a1-4823-866b-b41a21ed72be cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:26:00.699040 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f3bec34-955f-4f4e-a8fb-6263dfeab0f5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:00.718267 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7f3bec34-955f-4f4e-a8fb-6263dfeab0f5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Releasing vlan 137 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:26:00.718674 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f3bec34-955f-4f4e-a8fb-6263dfeab0f5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:00.721434 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-2ded4594-88a2-453c-92b3-adb9491eaf1d tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0908384 Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:26:00.734537 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:26:00.796200 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99a12ea5-3af3-4c21-adc8-862a4d17af8c req-db250443-e67c-4971-b499-40ebc3278d13 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.13 "GET /v2.0/security-groups?id=b7152147-ed7a-4a1f-b140-69adad7d753f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2668633 Dec 09 21:26:00.886643 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b6d4c39-63a7-474a-b6a9-159c9b1d8bdb req-6e25a0cf-3b1c-4bc7-94b2-50f817458eb4 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "GET /v2.0/security-groups/fbcc2d39-7a75-433e-ac35-d63b1c329a97 HTTP/1.1" status: 200 len: 1829 time: 0.1696413 Dec 09 21:26:00.889235 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f3bec34-955f-4f4e-a8fb-6263dfeab0f5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:00.911645 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f3bec34-955f-4f4e-a8fb-6263dfeab0f5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:00.917656 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7f3bec34-955f-4f4e-a8fb-6263dfeab0f5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "DELETE /v2.0/networks/6a0b092d-9731-4bc3-9661-8d5436bc9f71 HTTP/1.1" status: 204 len: 168 time: 1.2679551 Dec 09 21:26:00.917656 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f3bec34-955f-4f4e-a8fb-6263dfeab0f5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event deleted for resources: {'Network': ['ID=6a0b092d-9731-4bc3-9661-8d5436bc9f71,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:00.923591 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-d3ecbe1f-6721-4d35-bf7f-3fcec6bf779e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Made reservation on behalf of 23f7f8a3e7b14635b4f7dfa561684399 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:00.926610 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-d3ecbe1f-6721-4d35-bf7f-3fcec6bf779e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:00.929930 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38746) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:00.943417 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-3af91aba-aa58-4876-9eca-e37ab34a0822 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Request body: {'network': {'name': 'tempest-ServersTestMultiNic-1768807715'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:01.068401 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3af91aba-aa58-4876-9eca-e37ab34a0822 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Made reservation on behalf of 73812a0c336d4768b029fd6459a1ae9e for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:01.071871 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3af91aba-aa58-4876-9eca-e37ab34a0822 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:01.115412 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-20650e19-87ba-4b18-a2c2-62b2ef9ceaa1 req-1c62565b-9086-4c4c-bd89-7e9f20bbf5f1 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Deleting port 90eef560-add6-4b61-8d08-f04574a6a893 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:26:01.116043 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-20650e19-87ba-4b18-a2c2-62b2ef9ceaa1 req-1c62565b-9086-4c4c-bd89-7e9f20bbf5f1 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:01.129722 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f70cece-9d6b-425d-8af1-3a8e865ae5a1 req-3a97226d-ed86-4b3d-8313-814363b2db47 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:01.131318 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f70cece-9d6b-425d-8af1-3a8e865ae5a1 req-3a97226d-ed86-4b3d-8313-814363b2db47 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/ports?device_id=9503e24d-9ce5-4566-8e69-df8da4219cec HTTP/1.1" status: 200 len: 936 time: 0.1830721 Dec 09 21:26:01.167036 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a0dacda-2167-426c-aff2-fb1ff01f8e62 req-60e0dbef-8d91-4e95-80f0-c9f64e2e66c4 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:01.168698 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a0dacda-2167-426c-aff2-fb1ff01f8e62 req-60e0dbef-8d91-4e95-80f0-c9f64e2e66c4 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=70a40261-9248-40ae-8cc6-be041817b657 HTTP/1.1" status: 200 len: 945 time: 0.2046871 Dec 09 21:26:01.179388 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3af91aba-aa58-4876-9eca-e37ab34a0822 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] vlan segment allocate from pool success with {'vlan_id': 116, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:26:01.230047 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3af91aba-aa58-4876-9eca-e37ab34a0822 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:01.230389 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-3af91aba-aa58-4876-9eca-e37ab34a0822 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Added segment d2f9d5c1-75e0-4806-a659-59422ae7083c of type vlan for network b10aba5b-a802-488f-b187-37195bb0b8ca Dec 09 21:26:01.271477 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-d3ecbe1f-6721-4d35-bf7f-3fcec6bf779e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Allocated IP 192.168.233.184 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/2958b0be-15e5-48e2-b87a-6ffefd9a7859) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:26:01.273043 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4a6ed4c-d527-4f26-9c99-c4e744288b2b req-56c87d7a-d4d2-4c57-b355-27df25120cc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:01.274652 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c4a6ed4c-d527-4f26-9c99-c4e744288b2b req-56c87d7a-d4d2-4c57-b355-27df25120cc4 service neutron] 10.222.0.31 "GET /v2.0/networks?id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb HTTP/1.1" status: 200 len: 913 time: 0.6743808 Dec 09 21:26:01.334460 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f70cece-9d6b-425d-8af1-3a8e865ae5a1 req-6c70e734-0120-45f4-b410-43bec23185ac tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/security-groups?id=c81de824-def8-4781-88c7-f240bf84e2af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1759386 Dec 09 21:26:01.337393 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3af91aba-aa58-4876-9eca-e37ab34a0822 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:01.339195 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c4a6ed4c-d527-4f26-9c99-c4e744288b2b req-c61e31f6-fc67-4db1-9d96-a147ec893ca4 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=058ec1cc-1cd2-44ec-93de-4557c5dd65de HTTP/1.1" status: 200 len: 217 time: 0.0563684 Dec 09 21:26:01.343137 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a0dacda-2167-426c-aff2-fb1ff01f8e62 req-e736d482-f8f6-47bf-bfbf-54d2dbb1edda tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1576881 Dec 09 21:26:01.358329 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-20650e19-87ba-4b18-a2c2-62b2ef9ceaa1 req-1c62565b-9086-4c4c-bd89-7e9f20bbf5f1 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] For port 90eef560-add6-4b61-8d08-f04574a6a893, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=90eef560-add6-4b61-8d08-f04574a6a893,segment=NetworkSegment(7ba7eff4-a37f-4acb-b160-b374a7d3afdf),segment_id=7ba7eff4-a37f-4acb-b160-b374a7d3afdf)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:01.358755 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-20650e19-87ba-4b18-a2c2-62b2ef9ceaa1 req-1c62565b-9086-4c4c-bd89-7e9f20bbf5f1 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:01.376203 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-70dcdf11-c567-424c-9d27-f09a8a6b10f2 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:01.376203 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-70dcdf11-c567-424c-9d27-f09a8a6b10f2 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2760260 Dec 09 21:26:01.376530 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-57120552-43ab-4890-9ba9-6411f9bf6865 req-33607e02-2f19-4278-8567-bbe5a523513d tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2087930535', 'description': 'tempest-description-1949985529'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:01.406839 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-2a6223b3-1d3a-4ba4-a362-fe71e44e4b8d tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Request body: {'port': {'device_id': '2cfba12a-761e-445b-bf14-a19d38aeeeb0', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '23f7f8a3e7b14635b4f7dfa561684399'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:01.407428 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3af91aba-aa58-4876-9eca-e37ab34a0822 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:01.412983 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3af91aba-aa58-4876-9eca-e37ab34a0822 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:01.413604 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3af91aba-aa58-4876-9eca-e37ab34a0822 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:01.417352 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-20650e19-87ba-4b18-a2c2-62b2ef9ceaa1 req-1c62565b-9086-4c4c-bd89-7e9f20bbf5f1 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Calling delete_port for 90eef560-add6-4b61-8d08-f04574a6a893 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:26:01.481779 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-57120552-43ab-4890-9ba9-6411f9bf6865 req-33607e02-2f19-4278-8567-bbe5a523513d tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:01.506908 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3af91aba-aa58-4876-9eca-e37ab34a0822 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 774 time: 0.5758843 Dec 09 21:26:01.520470 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38752) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:01.521088 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4a6ed4c-d527-4f26-9c99-c4e744288b2b req-c26d13d0-7417-430d-9bca-029986c3689a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:01.522576 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c4a6ed4c-d527-4f26-9c99-c4e744288b2b req-c26d13d0-7417-430d-9bca-029986c3689a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=50496955-1646-4079-acd4-a47e8cd175cb HTTP/1.1" status: 200 len: 852 time: 0.1731915 Dec 09 21:26:01.528768 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-9f98a4de-c45c-4ac9-ba90-f79a3c26d2dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Request body: {'subnet': {'network_id': 'b10aba5b-a802-488f-b187-37195bb0b8ca', 'cidr': '19.80.0.0/24', 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:01.570963 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c4a6ed4c-d527-4f26-9c99-c4e744288b2b req-cd2d483b-43b3-46b1-9e06-a4b1e3ca89c6 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0343874 Dec 09 21:26:01.632935 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3af91aba-aa58-4876-9eca-e37ab34a0822 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event updated for resources: {'Network': ['ID=b10aba5b-a802-488f-b187-37195bb0b8ca,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:01.645476 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network b10aba5b-a802-488f-b187-37195bb0b8ca details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:26:01.731469 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-2a6223b3-1d3a-4ba4-a362-fe71e44e4b8d tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Made reservation on behalf of 23f7f8a3e7b14635b4f7dfa561684399 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:01.734964 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-2a6223b3-1d3a-4ba4-a362-fe71e44e4b8d tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:01.751570 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c4a6ed4c-d527-4f26-9c99-c4e744288b2b req-9e5e825d-78f7-4cab-b05d-fec62266d4bf service neutron] 10.222.0.31 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1677432 Dec 09 21:26:01.791467 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-20650e19-87ba-4b18-a2c2-62b2ef9ceaa1 req-1c62565b-9086-4c4c-bd89-7e9f20bbf5f1 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:01.804015 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-d3ecbe1f-6721-4d35-bf7f-3fcec6bf779e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:01.808128 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['90eef560-add6-4b61-8d08-f04574a6a893'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:01.815546 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9f98a4de-c45c-4ac9-ba90-f79a3c26d2dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Made reservation on behalf of 73812a0c336d4768b029fd6459a1ae9e for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:01.821735 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9f98a4de-c45c-4ac9-ba90-f79a3c26d2dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:01.839590 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 163ae9b8-a7f0-4e1e-9a66-9ce437978aae no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:26:01.849957 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c09dcbb7-b95c-4da2-8f9a-391545f9c919 req-36705577-5d2f-40e7-ad15-792aec951ed6 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:01.851692 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c09dcbb7-b95c-4da2-8f9a-391545f9c919 req-36705577-5d2f-40e7-ad15-792aec951ed6 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 943 time: 0.2461467 Dec 09 21:26:01.857532 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-57120552-43ab-4890-9ba9-6411f9bf6865 req-33607e02-2f19-4278-8567-bbe5a523513d tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:01.860712 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 163ae9b8-a7f0-4e1e-9a66-9ce437978aae {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:26:01.861285 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 163ae9b8-a7f0-4e1e-9a66-9ce437978aae not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:26:01.883579 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-57120552-43ab-4890-9ba9-6411f9bf6865 req-33607e02-2f19-4278-8567-bbe5a523513d tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:01.896905 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c62565b-9086-4c4c-bd89-7e9f20bbf5f1 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Pushing event deleted for resources: {'Port': ['ID=90eef560-add6-4b61-8d08-f04574a6a893,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:01.960652 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-20650e19-87ba-4b18-a2c2-62b2ef9ceaa1 req-1c62565b-9086-4c4c-bd89-7e9f20bbf5f1 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] No DVR routers for this DVR port 90eef560-add6-4b61-8d08-f04574a6a893 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:26:01.966455 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-20650e19-87ba-4b18-a2c2-62b2ef9ceaa1 req-1c62565b-9086-4c4c-bd89-7e9f20bbf5f1 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:01.969748 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-20650e19-87ba-4b18-a2c2-62b2ef9ceaa1 req-1c62565b-9086-4c4c-bd89-7e9f20bbf5f1 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.31 "DELETE /v2.0/ports/90eef560-add6-4b61-8d08-f04574a6a893 HTTP/1.1" status: 204 len: 173 time: 1.6249001 Dec 09 21:26:01.970195 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '97debe2b-c2b5-48af-a541-3e55e73d399f', 'name': 'network-vif-deleted', 'tag': '90eef560-add6-4b61-8d08-f04574a6a893'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:01.972468 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0ce34949-ee07-4904-8985-e3f993166d17" -d '{"events": [{"server_uuid": "97debe2b-c2b5-48af-a541-3e55e73d399f", "name": "network-vif-deleted", "tag": "90eef560-add6-4b61-8d08-f04574a6a893"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:01.980063 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-57120552-43ab-4890-9ba9-6411f9bf6865 req-33607e02-2f19-4278-8567-bbe5a523513d tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:01.981430 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-57120552-43ab-4890-9ba9-6411f9bf6865 req-33607e02-2f19-4278-8567-bbe5a523513d tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1835 time: 0.6142967 Dec 09 21:26:01.990708 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c4a6ed4c-d527-4f26-9c99-c4e744288b2b req-7fb188ba-7589-45be-b714-725232b43197 service neutron] 10.222.0.31 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2265570 Dec 09 21:26:02.022874 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33607e02-2f19-4278-8567-bbe5a523513d tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d75975e5-3a27-41cd-8688-1a0eb9c6959c,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:02.039818 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c09dcbb7-b95c-4da2-8f9a-391545f9c919 req-655c54bd-c82a-47fc-8ff2-9d4046ebd7c3 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1669385 Dec 09 21:26:02.044923 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-d3ecbe1f-6721-4d35-bf7f-3fcec6bf779e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:02.064636 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['18bda486-9d6d-41a3-a260-dd244a3838b3'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:02.136558 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-d3ecbe1f-6721-4d35-bf7f-3fcec6bf779e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:26:02.144094 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-d3ecbe1f-6721-4d35-bf7f-3fcec6bf779e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:02.157770 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-d3ecbe1f-6721-4d35-bf7f-3fcec6bf779e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:26:02.203991 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3ecbe1f-6721-4d35-bf7f-3fcec6bf779e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Pushing event updated for resources: {'Port': ['ID=2958b0be-15e5-48e2-b87a-6ffefd9a7859,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:02.448007 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-9945ad60-3322-4d13-8a74-6476bb36e6cf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f4a163f1-05a1-4823-866b-b41a21ed72be {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:02.463408 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-9945ad60-3322-4d13-8a74-6476bb36e6cf service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:02.472720 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b4a5f98c-9dc4-4e98-9378-4ac17b7ceb25 req-40f0659a-07e6-46ff-a7b3-58bc1990b0b5 tempest-VolumesAdminNegativeTest-2087374609 tempest-VolumesAdminNegativeTest-2087374609-project] 10.222.0.13 "GET /v2.0/ports?device_id=97debe2b-c2b5-48af-a541-3e55e73d399f HTTP/1.1" status: 200 len: 210 time: 0.0764592 Dec 09 21:26:02.492607 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-9945ad60-3322-4d13-8a74-6476bb36e6cf service neutron] Transition to ACTIVE for port object f4a163f1-05a1-4823-866b-b41a21ed72be will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:26:02.494030 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9f98a4de-c45c-4ac9-ba90-f79a3c26d2dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:02.523165 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-d3ecbe1f-6721-4d35-bf7f-3fcec6bf779e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:02.533724 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-d3ecbe1f-6721-4d35-bf7f-3fcec6bf779e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:02.575794 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-2a6223b3-1d3a-4ba4-a362-fe71e44e4b8d tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Allocated IP 192.168.233.253 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/1ad36983-4549-4a03-a826-a31a08b98c98) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:26:02.611570 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-215953cf-b408-4164-a321-384c7afe627c req-03a8c238-7c20-4040-bd10-80a12c0be848 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:02.619676 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-215953cf-b408-4164-a321-384c7afe627c req-03a8c238-7c20-4040-bd10-80a12c0be848 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=d3f455b1-1a56-4ded-ab82-e9ce51afbfde HTTP/1.1" status: 200 len: 936 time: 0.3888466 Dec 09 21:26:02.635884 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8d797bbf-c56c-4e8c-b0e3-e66f0e4ff692 None None] Provisioning complete for port 2958b0be-15e5-48e2-b87a-6ffefd9a7859 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:02.636270 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8d797bbf-c56c-4e8c-b0e3-e66f0e4ff692 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:02.642430 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-d3ecbe1f-6721-4d35-bf7f-3fcec6bf779e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.1041195 Dec 09 21:26:02.672424 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-9945ad60-3322-4d13-8a74-6476bb36e6cf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:02.676218 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-44d2cb91-f04b-488d-9d76-47c050584167 x-openstack-request-id: req-44d2cb91-f04b-488d-9d76-47c050584167 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:02.676517 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "97debe2b-c2b5-48af-a541-3e55e73d399f", "name": "network-vif-deleted", "tag": "90eef560-add6-4b61-8d08-f04574a6a893", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:02.676777 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-44d2cb91-f04b-488d-9d76-47c050584167 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:02.677174 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '97debe2b-c2b5-48af-a541-3e55e73d399f', 'name': 'network-vif-deleted', 'tag': '90eef560-add6-4b61-8d08-f04574a6a893', 'status': 'completed', 'code': 200} Dec 09 21:26:02.691269 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-9b535cf2-0ad9-4afb-8686-9d7567c177d4 service neutron] Request body: {'port': {'device_id': 'd3f455b1-1a56-4ded-ab82-e9ce51afbfde', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:02.717591 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-8d797bbf-c56c-4e8c-b0e3-e66f0e4ff692 None None] Port 2958b0be-15e5-48e2-b87a-6ffefd9a7859 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:26:02.727244 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f98a4de-c45c-4ac9-ba90-f79a3c26d2dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event updated for resources: {'Subnet': ['ID=67c09b0c-f53c-4918-9d79-b5f265f8b0cb,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:02.784413 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-215953cf-b408-4164-a321-384c7afe627c req-9b35a958-15d1-4a9f-9ef1-fc8b83f36221 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1631634 Dec 09 21:26:02.789809 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9945ad60-3322-4d13-8a74-6476bb36e6cf service neutron] Pushing event updated for resources: {'Port': ['ID=f4a163f1-05a1-4823-866b-b41a21ed72be,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:02.796966 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9f98a4de-c45c-4ac9-ba90-f79a3c26d2dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Checking segment: {'id': 'd2f9d5c1-75e0-4806-a659-59422ae7083c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'b10aba5b-a802-488f-b187-37195bb0b8ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:02.797320 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f98a4de-c45c-4ac9-ba90-f79a3c26d2dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Network hostable DHCP agents. Network: b10aba5b-a802-488f-b187-37195bb0b8ca, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:26:02.833041 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d67cee1-89ca-42b6-b21c-db0e945dbe7c req-3ddb31a3-f324-4eda-9784-ccc766ae72c0 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "GET /v2.0/security-groups/d75975e5-3a27-41cd-8688-1a0eb9c6959c HTTP/1.1" status: 200 len: 1830 time: 0.1619382 Dec 09 21:26:02.876403 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-9b535cf2-0ad9-4afb-8686-9d7567c177d4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:02.892576 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-2a6223b3-1d3a-4ba4-a362-fe71e44e4b8d tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:02.901329 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f98a4de-c45c-4ac9-ba90-f79a3c26d2dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Network b10aba5b-a802-488f-b187-37195bb0b8ca is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:26:02.928120 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-9945ad60-3322-4d13-8a74-6476bb36e6cf service neutron] Attempting to bind port f4a163f1-05a1-4823-866b-b41a21ed72be on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:26:02.928472 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-9945ad60-3322-4d13-8a74-6476bb36e6cf service neutron] Attempting to bind port f4a163f1-05a1-4823-866b-b41a21ed72be by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:26:02.929342 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-9945ad60-3322-4d13-8a74-6476bb36e6cf service neutron] Attempting to bind port f4a163f1-05a1-4823-866b-b41a21ed72be on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:02.935130 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-9945ad60-3322-4d13-8a74-6476bb36e6cf service neutron] Port f4a163f1-05a1-4823-866b-b41a21ed72be on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:26:02.935501 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-9945ad60-3322-4d13-8a74-6476bb36e6cf service neutron] Attempting to bind port f4a163f1-05a1-4823-866b-b41a21ed72be on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:02.937961 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 058ec1cc-1cd2-44ec-93de-4557c5dd65de details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:26:02.943518 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-9945ad60-3322-4d13-8a74-6476bb36e6cf service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 25, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:26:02.943867 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-9945ad60-3322-4d13-8a74-6476bb36e6cf service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:02.944257 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-9945ad60-3322-4d13-8a74-6476bb36e6cf service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:26:02.944700 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-9945ad60-3322-4d13-8a74-6476bb36e6cf service neutron] Bound port: f4a163f1-05a1-4823-866b-b41a21ed72be, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:26:02.945063 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-9945ad60-3322-4d13-8a74-6476bb36e6cf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:02.992650 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-2a6223b3-1d3a-4ba4-a362-fe71e44e4b8d tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:03.025665 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-379af9ec-2979-4d10-b802-ca4aea002b06 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:03.032758 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['18bda486-9d6d-41a3-a260-dd244a3838b3'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:03.090251 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-9f98a4de-c45c-4ac9-ba90-f79a3c26d2dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, b10aba5b-a802-488f-b187-37195bb0b8ca) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:03.100006 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 058ec1cc-1cd2-44ec-93de-4557c5dd65de, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=058ec1cc-1cd2-44ec-93de-4557c5dd65de,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:03.102149 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-2a6223b3-1d3a-4ba4-a362-fe71e44e4b8d tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:26:03.107714 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-507dbd26-367d-423c-95f3-fffaebde1783 None None] Network b10aba5b-a802-488f-b187-37195bb0b8ca requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:26:03.121966 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a9416d8-eed4-4614-ba2b-a3d3e9b1c9a5 req-dc6db642-8e27-4339-8939-2fefa270f34c tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:03.123483 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2a9416d8-eed4-4614-ba2b-a3d3e9b1c9a5 req-dc6db642-8e27-4339-8939-2fefa270f34c tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.31 "GET /v2.0/ports?device_id=70a40261-9248-40ae-8cc6-be041817b657 HTTP/1.1" status: 200 len: 945 time: 0.0910883 Dec 09 21:26:03.130442 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-2a6223b3-1d3a-4ba4-a362-fe71e44e4b8d tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:03.144223 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-2a6223b3-1d3a-4ba4-a362-fe71e44e4b8d tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:26:03.161579 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '058ec1cc-1cd2-44ec-93de-4557c5dd65de', 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb', 'port_id': '058ec1cc-1cd2-44ec-93de-4557c5dd65de', 'mac_address': 'fa:16:3e:86:6f:e8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 101, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '50496955-1646-4079-acd4-a47e8cd175cb', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:26:03.166029 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a6223b3-1d3a-4ba4-a362-fe71e44e4b8d tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Pushing event updated for resources: {'Port': ['ID=1ad36983-4549-4a03-a826-a31a08b98c98,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:03.191241 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-9945ad60-3322-4d13-8a74-6476bb36e6cf service neutron] For port f4a163f1-05a1-4823-866b-b41a21ed72be, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:26:03.216295 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-9945ad60-3322-4d13-8a74-6476bb36e6cf service neutron] For port f4a163f1-05a1-4823-866b-b41a21ed72be, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=f4a163f1-05a1-4823-866b-b41a21ed72be,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:26:03.227605 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-9945ad60-3322-4d13-8a74-6476bb36e6cf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:03.284483 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f98a4de-c45c-4ac9-ba90-f79a3c26d2dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:03.287252 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9f98a4de-c45c-4ac9-ba90-f79a3c26d2dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:03.305208 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9945ad60-3322-4d13-8a74-6476bb36e6cf service neutron] Pushing event updated for resources: {'Port': ['ID=f4a163f1-05a1-4823-866b-b41a21ed72be,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:03.308513 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-9945ad60-3322-4d13-8a74-6476bb36e6cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:03.309379 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-9945ad60-3322-4d13-8a74-6476bb36e6cf service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:03.310932 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-9945ad60-3322-4d13-8a74-6476bb36e6cf service neutron] 10.222.0.31 "PUT /v2.0/ports/f4a163f1-05a1-4823-866b-b41a21ed72be HTTP/1.1" status: 200 len: 1097 time: 2.8418639 Dec 09 21:26:03.330577 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:03.337813 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-2a6223b3-1d3a-4ba4-a362-fe71e44e4b8d tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:03.338563 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-2a6223b3-1d3a-4ba4-a362-fe71e44e4b8d tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:03.348590 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 058ec1cc-1cd2-44ec-93de-4557c5dd65de {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:03.397935 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 058ec1cc-1cd2-44ec-93de-4557c5dd65de, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=058ec1cc-1cd2-44ec-93de-4557c5dd65de,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:03.401585 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-2a6223b3-1d3a-4ba4-a362-fe71e44e4b8d tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.0004582 Dec 09 21:26:03.404854 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf87fd1f-3661-4e55-940e-e5c4f43ac514 req-d004403b-ffb7-4a5d-a123-ec6e4b63a2a2 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:03.405470 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0547f6e6-a5d0-4ec2-8238-a293ee221712 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-b10aba5b-a802-488f-b187-37195bb0b8ca', 'network_id': 'b10aba5b-a802-488f-b187-37195bb0b8ca', 'project_id': '73812a0c336d4768b029fd6459a1ae9e', 'fixed_ips': [{'subnet_id': '67c09b0c-f53c-4918-9d79-b5f265f8b0cb'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:26:03.406223 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0547f6e6-a5d0-4ec2-8238-a293ee221712 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:03.412278 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:03.414940 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf87fd1f-3661-4e55-940e-e5c4f43ac514 req-d004403b-ffb7-4a5d-a123-ec6e4b63a2a2 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/ports?device_id=9503e24d-9ce5-4566-8e69-df8da4219cec HTTP/1.1" status: 200 len: 948 time: 0.5278487 Dec 09 21:26:03.417903 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-cc7371af-9688-4d81-871d-ee874ba00b5a service neutron] Request body: {'port': {'device_id': '2cfba12a-761e-445b-bf14-a19d38aeeeb0', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:03.422510 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-2a9416d8-eed4-4614-ba2b-a3d3e9b1c9a5 req-fd53afb1-cb00-403a-98df-f9b7f4427189 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Deleting port 3ebbcc5a-481f-4868-8b55-d0176959424c {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:26:03.422846 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2a9416d8-eed4-4614-ba2b-a3d3e9b1c9a5 req-fd53afb1-cb00-403a-98df-f9b7f4427189 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:03.476199 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9f98a4de-c45c-4ac9-ba90-f79a3c26d2dc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 798 time: 1.9512801 Dec 09 21:26:03.485827 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-7d638e22-8746-4a5c-9507-e4e582ea8c93 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:03.487032 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-7d638e22-8746-4a5c-9507-e4e582ea8c93 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6ef183f29d2f4992bf91a120a9d85fac&device_id=9503e24d-9ce5-4566-8e69-df8da4219cec HTTP/1.1" status: 200 len: 1100 time: 0.1255145 Dec 09 21:26:03.487770 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38784) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:03.494436 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-8e126831-983c-4274-8756-08db51716bc4 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Request body: {'network': {'name': 'tempest-ServersTestMultiNic-1276864297'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:03.531881 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-cc7371af-9688-4d81-871d-ee874ba00b5a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:03.545956 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf87fd1f-3661-4e55-940e-e5c4f43ac514 req-a9332d34-2ac3-4fdf-b61f-8c7abcd57c29 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/security-groups?id=c81de824-def8-4781-88c7-f240bf84e2af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1299360 Dec 09 21:26:03.578003 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=058ec1cc-1cd2-44ec-93de-4557c5dd65de,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:03.599393 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-9b535cf2-0ad9-4afb-8686-9d7567c177d4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2958b0be-15e5-48e2-b87a-6ffefd9a7859 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:03.625577 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3776e443-5f72-4105-b2d5-71fbbf4556fe None None] Provisioning complete for port 1ad36983-4549-4a03-a826-a31a08b98c98 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:03.625864 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3776e443-5f72-4105-b2d5-71fbbf4556fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:03.629796 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-ee987a22-d949-4057-9837-380e8c265f7b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.138&port_id=f4a163f1-05a1-4823-866b-b41a21ed72be HTTP/1.1" status: 200 len: 217 time: 0.0988870 Dec 09 21:26:03.639981 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-042ea4b5-78ad-4833-a77f-009bf8ce81aa req-0f2082c1-60be-423f-ba68-61b102027830 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] show failed (client error): The resource could not be found. Dec 09 21:26:03.641543 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-042ea4b5-78ad-4833-a77f-009bf8ce81aa req-0f2082c1-60be-423f-ba68-61b102027830 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "GET /v2.0/security-groups/61676579-b6e6-4c83-9837-a28c47238bc0 HTTP/1.1" status: 404 len: 352 time: 0.0311565 Dec 09 21:26:03.648675 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-9b535cf2-0ad9-4afb-8686-9d7567c177d4 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:03.658662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e361731-1601-48dc-b73e-067f3c56db22 req-86c84bf7-930f-4543-92cb-ffe1a2c6026d tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:03.660523 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e361731-1601-48dc-b73e-067f3c56db22 req-86c84bf7-930f-4543-92cb-ffe1a2c6026d tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/networks?id=56b576e6-50b1-4d1e-a1c2-80bcf1883e68 HTTP/1.1" status: 200 len: 813 time: 0.6441672 Dec 09 21:26:03.666136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-3776e443-5f72-4105-b2d5-71fbbf4556fe None None] Port 1ad36983-4549-4a03-a826-a31a08b98c98 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:26:03.674503 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-9b535cf2-0ad9-4afb-8686-9d7567c177d4 service neutron] Transition to ACTIVE for port object 2958b0be-15e5-48e2-b87a-6ffefd9a7859 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:26:03.683040 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-0547f6e6-a5d0-4ec2-8238-a293ee221712 None None] Allocated IP 19.80.0.2 (b10aba5b-a802-488f-b187-37195bb0b8ca/67c09b0c-f53c-4918-9d79-b5f265f8b0cb/00d35d1d-e182-4dbc-888e-3d60e58ca11a) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:26:03.684598 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-9b535cf2-0ad9-4afb-8686-9d7567c177d4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:03.714539 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['058ec1cc-1cd2-44ec-93de-4557c5dd65de'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:03.779396 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e361731-1601-48dc-b73e-067f3c56db22 req-b93fff09-f3a2-4788-a8c9-63dbae28e82e tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/quotas/52eb00d38d4442158ed8579a84e900ca HTTP/1.1" status: 200 len: 375 time: 0.0776451 Dec 09 21:26:03.929017 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8e126831-983c-4274-8756-08db51716bc4 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Made reservation on behalf of 73812a0c336d4768b029fd6459a1ae9e for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:03.931942 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0547f6e6-a5d0-4ec2-8238-a293ee221712 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:03.933029 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e126831-983c-4274-8756-08db51716bc4 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:03.945904 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b535cf2-0ad9-4afb-8686-9d7567c177d4 service neutron] Pushing event updated for resources: {'Port': ['ID=2958b0be-15e5-48e2-b87a-6ffefd9a7859,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:03.949014 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0547f6e6-a5d0-4ec2-8238-a293ee221712 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:03.961290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-2a9416d8-eed4-4614-ba2b-a3d3e9b1c9a5 req-fd53afb1-cb00-403a-98df-f9b7f4427189 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] For port 3ebbcc5a-481f-4868-8b55-d0176959424c, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=3ebbcc5a-481f-4868-8b55-d0176959424c,segment=NetworkSegment(bada42e9-278b-46e3-bbc2-c2d37f00c32d),segment_id=bada42e9-278b-46e3-bbc2-c2d37f00c32d)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:03.961941 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2a9416d8-eed4-4614-ba2b-a3d3e9b1c9a5 req-fd53afb1-cb00-403a-98df-f9b7f4427189 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:04.007532 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0547f6e6-a5d0-4ec2-8238-a293ee221712 None None] Network b10aba5b-a802-488f-b187-37195bb0b8ca is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:26:04.010002 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-2a9416d8-eed4-4614-ba2b-a3d3e9b1c9a5 req-fd53afb1-cb00-403a-98df-f9b7f4427189 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Calling delete_port for 3ebbcc5a-481f-4868-8b55-d0176959424c owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:26:04.011001 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5345f93f-17da-4864-b402-5854c66cae23 req-84930e4c-22ae-4a1d-9e53-baff297eca2f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:04.014909 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5345f93f-17da-4864-b402-5854c66cae23 req-84930e4c-22ae-4a1d-9e53-baff297eca2f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 944 time: 0.1713705 Dec 09 21:26:04.021459 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8e126831-983c-4274-8756-08db51716bc4 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] vlan segment allocate from pool success with {'vlan_id': 119, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:26:04.022352 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-0547f6e6-a5d0-4ec2-8238-a293ee221712 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:04.028078 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-e191d442-2313-4a46-a69d-01a5f3800314 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:04.029579 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-e191d442-2313-4a46-a69d-01a5f3800314 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1833608 Dec 09 21:26:04.039299 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0547f6e6-a5d0-4ec2-8238-a293ee221712 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:26:04.040254 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-9b535cf2-0ad9-4afb-8686-9d7567c177d4 service neutron] Attempting to bind port 2958b0be-15e5-48e2-b87a-6ffefd9a7859 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:26:04.040679 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-9b535cf2-0ad9-4afb-8686-9d7567c177d4 service neutron] Attempting to bind port 2958b0be-15e5-48e2-b87a-6ffefd9a7859 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:26:04.041010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-9b535cf2-0ad9-4afb-8686-9d7567c177d4 service neutron] Attempting to bind port 2958b0be-15e5-48e2-b87a-6ffefd9a7859 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:04.047951 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e803c476-d9be-4fd3-adcd-c4e1d53c5427 req-28f431de-dc37-42e9-bc9e-5555ff80c8e9 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:04.049760 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e803c476-d9be-4fd3-adcd-c4e1d53c5427 req-28f431de-dc37-42e9-bc9e-5555ff80c8e9 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.31 "GET /v2.0/ports?device_id=68d909ed-6a44-454a-9fce-e4dd59e2d088 HTTP/1.1" status: 200 len: 945 time: 0.1940925 Dec 09 21:26:04.056304 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0547f6e6-a5d0-4ec2-8238-a293ee221712 None None] Pushing event updated for resources: {'Port': ['ID=00d35d1d-e182-4dbc-888e-3d60e58ca11a,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:04.068949 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-9b535cf2-0ad9-4afb-8686-9d7567c177d4 service neutron] Port 2958b0be-15e5-48e2-b87a-6ffefd9a7859 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:26:04.069308 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-9b535cf2-0ad9-4afb-8686-9d7567c177d4 service neutron] Attempting to bind port 2958b0be-15e5-48e2-b87a-6ffefd9a7859 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:04.088442 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e126831-983c-4274-8756-08db51716bc4 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:04.088937 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-8e126831-983c-4274-8756-08db51716bc4 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Added segment 62cd2cbb-d71c-4d79-8112-51e9e682f3f3 of type vlan for network 30d0c468-ca40-4f41-a7a6-de8dc44194c4 Dec 09 21:26:04.096727 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a30ebf9f-5e0f-481f-a6bb-f4b7247d06b6 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=52eb00d38d4442158ed8579a84e900ca&fields=id HTTP/1.1" status: 200 len: 302 time: 0.2692254 Dec 09 21:26:04.105423 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-9b535cf2-0ad9-4afb-8686-9d7567c177d4 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 25, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:26:04.105756 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-9b535cf2-0ad9-4afb-8686-9d7567c177d4 service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:04.106275 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-9b535cf2-0ad9-4afb-8686-9d7567c177d4 service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:26:04.106998 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-9b535cf2-0ad9-4afb-8686-9d7567c177d4 service neutron] Bound port: 2958b0be-15e5-48e2-b87a-6ffefd9a7859, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:26:04.107249 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-9b535cf2-0ad9-4afb-8686-9d7567c177d4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:04.125126 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0547f6e6-a5d0-4ec2-8238-a293ee221712 None None] Attempting to bind port 00d35d1d-e182-4dbc-888e-3d60e58ca11a on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:26:04.125792 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0547f6e6-a5d0-4ec2-8238-a293ee221712 None None] Attempting to bind port 00d35d1d-e182-4dbc-888e-3d60e58ca11a by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'd2f9d5c1-75e0-4806-a659-59422ae7083c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'b10aba5b-a802-488f-b187-37195bb0b8ca'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:26:04.126282 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0547f6e6-a5d0-4ec2-8238-a293ee221712 None None] Attempting to bind port 00d35d1d-e182-4dbc-888e-3d60e58ca11a on network b10aba5b-a802-488f-b187-37195bb0b8ca {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:04.133126 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0547f6e6-a5d0-4ec2-8238-a293ee221712 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 25, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:26:04.133495 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0547f6e6-a5d0-4ec2-8238-a293ee221712 None None] Checking segment: {'id': 'd2f9d5c1-75e0-4806-a659-59422ae7083c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'b10aba5b-a802-488f-b187-37195bb0b8ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:04.133897 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0547f6e6-a5d0-4ec2-8238-a293ee221712 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:04.134463 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0547f6e6-a5d0-4ec2-8238-a293ee221712 None None] Bound using segment: {'id': 'd2f9d5c1-75e0-4806-a659-59422ae7083c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'b10aba5b-a802-488f-b187-37195bb0b8ca'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:26:04.135093 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0547f6e6-a5d0-4ec2-8238-a293ee221712 None None] Bound port: 00d35d1d-e182-4dbc-888e-3d60e58ca11a, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd2f9d5c1-75e0-4806-a659-59422ae7083c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'b10aba5b-a802-488f-b187-37195bb0b8ca'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:26:04.135717 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0547f6e6-a5d0-4ec2-8238-a293ee221712 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:04.184228 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5345f93f-17da-4864-b402-5854c66cae23 req-353b1dc6-a272-4d1e-b1f8-0ed16561fabd tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1500862 Dec 09 21:26:04.225216 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0547f6e6-a5d0-4ec2-8238-a293ee221712 None None] For port 00d35d1d-e182-4dbc-888e-3d60e58ca11a, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:26:04.229256 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0547f6e6-a5d0-4ec2-8238-a293ee221712 None None] For port 00d35d1d-e182-4dbc-888e-3d60e58ca11a, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=00d35d1d-e182-4dbc-888e-3d60e58ca11a,segment=NetworkSegment(d2f9d5c1-75e0-4806-a659-59422ae7083c),segment_id=d2f9d5c1-75e0-4806-a659-59422ae7083c)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:26:04.238625 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0547f6e6-a5d0-4ec2-8238-a293ee221712 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:04.321189 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38794) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:04.335902 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e126831-983c-4274-8756-08db51716bc4 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:04.347161 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-cc7371af-9688-4d81-871d-ee874ba00b5a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1ad36983-4549-4a03-a826-a31a08b98c98 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:04.347483 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0547f6e6-a5d0-4ec2-8238-a293ee221712 None None] Pushing event updated for resources: {'Port': ['ID=00d35d1d-e182-4dbc-888e-3d60e58ca11a,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:04.381287 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-cc7371af-9688-4d81-871d-ee874ba00b5a service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:04.406491 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-865444ed-14f4-4cb1-ac06-3a7caaa0d08e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:04.408079 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-865444ed-14f4-4cb1-ac06-3a7caaa0d08e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.3573124 Dec 09 21:26:04.473140 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-cc7371af-9688-4d81-871d-ee874ba00b5a service neutron] Transition to ACTIVE for port object 1ad36983-4549-4a03-a826-a31a08b98c98 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:26:04.495109 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-cc7371af-9688-4d81-871d-ee874ba00b5a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:04.501021 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-b8c26496-c78e-441b-b41f-483dbfc3d2dc admin admin] Deleting subnet ffbc2156-2e0a-4a3b-8e1a-215cf8f39866 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:26:04.517721 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e126831-983c-4274-8756-08db51716bc4 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:04.524796 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e126831-983c-4274-8756-08db51716bc4 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:04.525446 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e126831-983c-4274-8756-08db51716bc4 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:04.590829 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b8c26496-c78e-441b-b41f-483dbfc3d2dc admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:04.653206 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-9b535cf2-0ad9-4afb-8686-9d7567c177d4 service neutron] For port 2958b0be-15e5-48e2-b87a-6ffefd9a7859, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:26:04.661265 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-8e6d11ec-3a39-4930-9ea4-ba0f0e601759 req-00cff936-78e9-4f1b-be14-27c20f1d86a6 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] show failed (client error): The resource could not be found. Dec 09 21:26:04.662424 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8e6d11ec-3a39-4930-9ea4-ba0f0e601759 req-00cff936-78e9-4f1b-be14-27c20f1d86a6 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "GET /v2.0/security-group-rules/1e657232-f843-44bf-a750-597a0d76be4c HTTP/1.1" status: 404 len: 361 time: 0.0298078 Dec 09 21:26:04.676886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-9b535cf2-0ad9-4afb-8686-9d7567c177d4 service neutron] For port 2958b0be-15e5-48e2-b87a-6ffefd9a7859, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2958b0be-15e5-48e2-b87a-6ffefd9a7859,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:26:04.691278 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-9b535cf2-0ad9-4afb-8686-9d7567c177d4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:04.723217 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e361731-1601-48dc-b73e-067f3c56db22 req-59b8cb84-d775-43a1-b2bc-ff2dfc1f9702 service neutron] 10.222.0.13 "GET /v2.0/networks/56b576e6-50b1-4d1e-a1c2-80bcf1883e68?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6255913 Dec 09 21:26:04.739346 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-9b535cf2-0ad9-4afb-8686-9d7567c177d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:04.740168 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-9b535cf2-0ad9-4afb-8686-9d7567c177d4 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:04.741672 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-9b535cf2-0ad9-4afb-8686-9d7567c177d4 service neutron] 10.222.0.31 "PUT /v2.0/ports/2958b0be-15e5-48e2-b87a-6ffefd9a7859 HTTP/1.1" status: 200 len: 1097 time: 2.0564513 Dec 09 21:26:04.742244 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd3f455b1-1a56-4ded-ab82-e9ce51afbfde', 'tag': '2958b0be-15e5-48e2-b87a-6ffefd9a7859'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:04.744722 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b7c66946-d8c9-492b-ae38-c0cfd2a2096a" -d '{"events": [{"name": "network-changed", "server_uuid": "d3f455b1-1a56-4ded-ab82-e9ce51afbfde", "tag": "2958b0be-15e5-48e2-b87a-6ffefd9a7859"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:04.838032 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b535cf2-0ad9-4afb-8686-9d7567c177d4 service neutron] Pushing event updated for resources: {'Port': ['ID=2958b0be-15e5-48e2-b87a-6ffefd9a7859,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:04.929246 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 058ec1cc-1cd2-44ec-93de-4557c5dd65de up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:26:04.937012 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-406be46a-bc57-4066-9aeb-bcab3696d4d3 req-0a35d839-de25-4efe-b971-6d7458e6a764 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:04.938751 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-406be46a-bc57-4066-9aeb-bcab3696d4d3 req-0a35d839-de25-4efe-b971-6d7458e6a764 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=d3f455b1-1a56-4ded-ab82-e9ce51afbfde HTTP/1.1" status: 200 len: 948 time: 0.1550109 Dec 09 21:26:04.947728 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-fbde6861-9a1f-4b06-bfd3-fe1947e29ec9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:04.949816 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-fbde6861-9a1f-4b06-bfd3-fe1947e29ec9 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&device_id=d3f455b1-1a56-4ded-ab82-e9ce51afbfde HTTP/1.1" status: 200 len: 1100 time: 0.1288998 Dec 09 21:26:04.952641 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e361731-1601-48dc-b73e-067f3c56db22 req-4393d6f7-eedc-4a6b-b8d6-2dd895c21f21 service neutron] 10.222.0.13 "GET /v2.0/networks/56b576e6-50b1-4d1e-a1c2-80bcf1883e68?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1986556 Dec 09 21:26:05.015030 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-3fb23597-f98b-4228-95ad-df09c1d06ce3 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.184&port_id=2958b0be-15e5-48e2-b87a-6ffefd9a7859 HTTP/1.1" status: 200 len: 217 time: 0.0527973 Dec 09 21:26:05.029581 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 058ec1cc-1cd2-44ec-93de-4557c5dd65de completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:26:05.036815 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 058ec1cc-1cd2-44ec-93de-4557c5dd65de triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:05.038143 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:05.039028 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9503e24d-9ce5-4566-8e69-df8da4219cec', 'tag': 'f4a163f1-05a1-4823-866b-b41a21ed72be'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:05.044891 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f367832e-13e9-4717-9bf9-ac73d0b9f333" -d '{"events": [{"name": "network-changed", "server_uuid": "9503e24d-9ce5-4566-8e69-df8da4219cec", "tag": "f4a163f1-05a1-4823-866b-b41a21ed72be"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:05.081766 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-e803c476-d9be-4fd3-adcd-c4e1d53c5427 req-454cd4e0-e96e-4217-83c1-b3ed83ac24da tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Deleting port 775d6690-9f80-4aa2-9026-bb97c37d24af {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:26:05.082112 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e803c476-d9be-4fd3-adcd-c4e1d53c5427 req-454cd4e0-e96e-4217-83c1-b3ed83ac24da tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:05.085213 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2a9416d8-eed4-4614-ba2b-a3d3e9b1c9a5 req-fd53afb1-cb00-403a-98df-f9b7f4427189 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:05.092953 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-406be46a-bc57-4066-9aeb-bcab3696d4d3 req-a5d24639-b518-4155-93fd-76d4365a900f tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1362636 Dec 09 21:26:05.111024 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-2dec49fe-4c0c-49d4-b177-285d94a12261 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:05.113075 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-2dec49fe-4c0c-49d4-b177-285d94a12261 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0870228 Dec 09 21:26:05.170961 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8e126831-983c-4274-8756-08db51716bc4 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 774 time: 1.6803033 Dec 09 21:26:05.181385 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38806) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:05.214334 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:05.215501 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-a1eb3fcf-f579-4410-90ef-23c168e0ae4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:05.217634 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-a1eb3fcf-f579-4410-90ef-23c168e0ae4b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0959463 Dec 09 21:26:05.273815 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '058ec1cc-1cd2-44ec-93de-4557c5dd65de'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:05.280078 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a294bf33-65d3-4510-b7a8-d5ee2b83f9ab" -d '{"events": [{"server_uuid": "e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f", "name": "network-vif-plugged", "status": "completed", "tag": "058ec1cc-1cd2-44ec-93de-4557c5dd65de"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:05.291102 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b8c26496-c78e-441b-b41f-483dbfc3d2dc admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:05.313721 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 058ec1cc-1cd2-44ec-93de-4557c5dd65de, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=058ec1cc-1cd2-44ec-93de-4557c5dd65de,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:05.326759 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:05.328314 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 775d6690-9f80-4aa2-9026-bb97c37d24af no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:26:05.361718 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b8c26496-c78e-441b-b41f-483dbfc3d2dc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:05.407517 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-32f3050d-3453-4d62-af99-a90fe6808327 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Request body: {'subnet': {'network_id': '30d0c468-ca40-4f41-a7a6-de8dc44194c4', 'cidr': '19.86.0.0/24', 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:05.448762 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc7371af-9688-4d81-871d-ee874ba00b5a service neutron] Pushing event updated for resources: {'Port': ['ID=1ad36983-4549-4a03-a826-a31a08b98c98,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:05.452808 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=058ec1cc-1cd2-44ec-93de-4557c5dd65de,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:05.453974 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bc439f7-ecd2-4815-927d-f6f87a3e5089 req-fe4d9b0e-7b1c-4ec6-bc14-00a339904021 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:05.462898 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6bc439f7-ecd2-4815-927d-f6f87a3e5089 req-fe4d9b0e-7b1c-4ec6-bc14-00a339904021 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/ports?device_id=9503e24d-9ce5-4566-8e69-df8da4219cec HTTP/1.1" status: 200 len: 948 time: 0.2359102 Dec 09 21:26:05.509274 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e126831-983c-4274-8756-08db51716bc4 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event updated for resources: {'Network': ['ID=30d0c468-ca40-4f41-a7a6-de8dc44194c4,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:05.522695 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:05.535088 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a05d4ef5-e928-4dbf-9658-10bc0fd36c52 req-5a27f8d8-b41a-465b-ac1f-0eeb8d765c07 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "GET /v2.0/security-groups/d75975e5-3a27-41cd-8688-1a0eb9c6959c HTTP/1.1" status: 200 len: 1830 time: 0.1330225 Dec 09 21:26:05.542780 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 30d0c468-ca40-4f41-a7a6-de8dc44194c4 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:26:05.579528 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-1531ab70-40e9-4ab3-94d6-0121d9faad75 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3167925 Dec 09 21:26:05.600666 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6bc439f7-ecd2-4815-927d-f6f87a3e5089 req-6f490ca2-34e9-4f87-8dae-05fa802da8be tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/security-groups?id=c81de824-def8-4781-88c7-f240bf84e2af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1366167 Dec 09 21:26:05.678224 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c1f46af3-220f-44a8-aa7f-17b6dff5d65f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:05.700153 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 775d6690-9f80-4aa2-9026-bb97c37d24af, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=775d6690-9f80-4aa2-9026-bb97c37d24af,segment=NetworkSegment(bada42e9-278b-46e3-bbc2-c2d37f00c32d),segment_id=bada42e9-278b-46e3-bbc2-c2d37f00c32d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:05.709789 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd53afb1-cb00-403a-98df-f9b7f4427189 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Pushing event deleted for resources: {'Port': ['ID=3ebbcc5a-481f-4868-8b55-d0176959424c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:05.710971 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:05.717890 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 90eef560-add6-4b61-8d08-f04574a6a893 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:26:05.732268 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-7612d55c-acc9-421a-9b54-5a57774f0cc4 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.3080599 Dec 09 21:26:05.737433 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-564d5c0f-2589-4519-9ce3-a43c28efe073 x-openstack-request-id: req-564d5c0f-2589-4519-9ce3-a43c28efe073 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:05.737934 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d3f455b1-1a56-4ded-ab82-e9ce51afbfde", "tag": "2958b0be-15e5-48e2-b87a-6ffefd9a7859", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:05.738033 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-564d5c0f-2589-4519-9ce3-a43c28efe073 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:05.738660 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd3f455b1-1a56-4ded-ab82-e9ce51afbfde', 'tag': '2958b0be-15e5-48e2-b87a-6ffefd9a7859', 'status': 'completed', 'code': 200} Dec 09 21:26:05.756419 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-15d39a22-790c-4f0a-ab92-1c628b968ac8 x-openstack-request-id: req-15d39a22-790c-4f0a-ab92-1c628b968ac8 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:05.757056 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9503e24d-9ce5-4566-8e69-df8da4219cec", "tag": "f4a163f1-05a1-4823-866b-b41a21ed72be", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:05.757480 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-15d39a22-790c-4f0a-ab92-1c628b968ac8 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:05.758099 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9503e24d-9ce5-4566-8e69-df8da4219cec', 'tag': 'f4a163f1-05a1-4823-866b-b41a21ed72be', 'status': 'completed', 'code': 200} Dec 09 21:26:05.826378 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 90eef560-add6-4b61-8d08-f04574a6a893 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:26:05.830100 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 90eef560-add6-4b61-8d08-f04574a6a893 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:26:05.830573 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 3ebbcc5a-481f-4868-8b55-d0176959424c no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:26:05.879209 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 3ebbcc5a-481f-4868-8b55-d0176959424c {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:26:05.891708 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 3ebbcc5a-481f-4868-8b55-d0176959424c not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:26:05.905927 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=775d6690-9f80-4aa2-9026-bb97c37d24af,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:05.924751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18ce1572-ade6-454d-b3a8-8ad1ce22d73a None None] Network b10aba5b-a802-488f-b187-37195bb0b8ca requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:26:05.926958 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-8dd22551-5d14-4835-b59f-5b0c1e4d4f35 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3244162 Dec 09 21:26:05.927883 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a05d4ef5-e928-4dbf-9658-10bc0fd36c52 req-7d9afc84-e99b-4c2b-a9a7-0413097dd84a tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:05.958481 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-2a9416d8-eed4-4614-ba2b-a3d3e9b1c9a5 req-fd53afb1-cb00-403a-98df-f9b7f4427189 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] No DVR routers for this DVR port 3ebbcc5a-481f-4868-8b55-d0176959424c on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:26:05.968788 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 00d35d1d-e182-4dbc-888e-3d60e58ca11a up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:26:05.978784 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2a9416d8-eed4-4614-ba2b-a3d3e9b1c9a5 req-fd53afb1-cb00-403a-98df-f9b7f4427189 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:05.983699 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2a9416d8-eed4-4614-ba2b-a3d3e9b1c9a5 req-fd53afb1-cb00-403a-98df-f9b7f4427189 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.31 "DELETE /v2.0/ports/3ebbcc5a-481f-4868-8b55-d0176959424c HTTP/1.1" status: 204 len: 173 time: 2.8472791 Dec 09 21:26:05.987399 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b8c26496-c78e-441b-b41f-483dbfc3d2dc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:06.026836 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a05d4ef5-e928-4dbf-9658-10bc0fd36c52 req-7d9afc84-e99b-4c2b-a9a7-0413097dd84a tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:06.057593 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b8c26496-c78e-441b-b41f-483dbfc3d2dc admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:06.064689 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b8c26496-c78e-441b-b41f-483dbfc3d2dc admin admin] 10.222.0.13 "DELETE /v2.0/subnets/ffbc2156-2e0a-4a3b-8e1a-215cf8f39866 HTTP/1.1" status: 204 len: 168 time: 1.7407577 Dec 09 21:26:06.068306 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38826) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:06.071838 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7c66946-d8c9-492b-ae38-c0cfd2a2096a req-d637695f-11dc-4721-9199-c9451cf0e523 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:06.073657 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7c66946-d8c9-492b-ae38-c0cfd2a2096a req-d637695f-11dc-4721-9199-c9451cf0e523 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&device_id=d3f455b1-1a56-4ded-ab82-e9ce51afbfde HTTP/1.1" status: 200 len: 1100 time: 0.0823488 Dec 09 21:26:06.081959 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05aaf193-809a-4f2a-ba36-43f2e74f28f2 req-d6a15bac-eb69-4963-a78a-b898c6544336 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:06.083562 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-05aaf193-809a-4f2a-ba36-43f2e74f28f2 req-d6a15bac-eb69-4963-a78a-b898c6544336 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.2028883 Dec 09 21:26:06.101909 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8c26496-c78e-441b-b41f-483dbfc3d2dc admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ffbc2156-2e0a-4a3b-8e1a-215cf8f39866,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:06.112996 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-e803c476-d9be-4fd3-adcd-c4e1d53c5427 req-454cd4e0-e96e-4217-83c1-b3ed83ac24da tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] For port 775d6690-9f80-4aa2-9026-bb97c37d24af, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=775d6690-9f80-4aa2-9026-bb97c37d24af,segment=NetworkSegment(bada42e9-278b-46e3-bbc2-c2d37f00c32d),segment_id=bada42e9-278b-46e3-bbc2-c2d37f00c32d)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:06.113576 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e803c476-d9be-4fd3-adcd-c4e1d53c5427 req-454cd4e0-e96e-4217-83c1-b3ed83ac24da tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:06.192146 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-cc7371af-9688-4d81-871d-ee874ba00b5a service neutron] Attempting to bind port 1ad36983-4549-4a03-a826-a31a08b98c98 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:26:06.192747 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-cc7371af-9688-4d81-871d-ee874ba00b5a service neutron] Attempting to bind port 1ad36983-4549-4a03-a826-a31a08b98c98 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:26:06.193374 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-cc7371af-9688-4d81-871d-ee874ba00b5a service neutron] Attempting to bind port 1ad36983-4549-4a03-a826-a31a08b98c98 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:06.197478 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a05d4ef5-e928-4dbf-9658-10bc0fd36c52 req-7d9afc84-e99b-4c2b-a9a7-0413097dd84a tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:06.200844 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a05d4ef5-e928-4dbf-9658-10bc0fd36c52 req-7d9afc84-e99b-4c2b-a9a7-0413097dd84a tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:06.201939 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a05d4ef5-e928-4dbf-9658-10bc0fd36c52 req-7d9afc84-e99b-4c2b-a9a7-0413097dd84a tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "DELETE /v2.0/security-groups/d75975e5-3a27-41cd-8688-1a0eb9c6959c HTTP/1.1" status: 204 len: 173 time: 0.6564856 Dec 09 21:26:06.235630 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-e803c476-d9be-4fd3-adcd-c4e1d53c5427 req-454cd4e0-e96e-4217-83c1-b3ed83ac24da tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Calling delete_port for 775d6690-9f80-4aa2-9026-bb97c37d24af owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:26:06.243794 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-05aaf193-809a-4f2a-ba36-43f2e74f28f2 req-9e3d568b-2947-4a1e-a804-7d928c759929 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1406758 Dec 09 21:26:06.247841 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d9afc84-e99b-4c2b-a9a7-0413097dd84a tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d75975e5-3a27-41cd-8688-1a0eb9c6959c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:06.293144 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7c66946-d8c9-492b-ae38-c0cfd2a2096a req-5d337525-2682-4a39-b18b-f30fd43d83d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:06.294689 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7c66946-d8c9-492b-ae38-c0cfd2a2096a req-5d337525-2682-4a39-b18b-f30fd43d83d3 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.2058556 Dec 09 21:26:06.314330 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-cc7371af-9688-4d81-871d-ee874ba00b5a service neutron] Port 1ad36983-4549-4a03-a826-a31a08b98c98 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:26:06.316594 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-cc7371af-9688-4d81-871d-ee874ba00b5a service neutron] Attempting to bind port 1ad36983-4549-4a03-a826-a31a08b98c98 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:06.341484 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-32f3050d-3453-4d62-af99-a90fe6808327 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Made reservation on behalf of 73812a0c336d4768b029fd6459a1ae9e for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:06.345679 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-32f3050d-3453-4d62-af99-a90fe6808327 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:06.381760 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1198531b-8f2d-4e53-aed0-cb444829d8ac x-openstack-request-id: req-1198531b-8f2d-4e53-aed0-cb444829d8ac {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:06.382282 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f", "name": "network-vif-plugged", "status": "completed", "tag": "058ec1cc-1cd2-44ec-93de-4557c5dd65de", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:06.382477 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-1198531b-8f2d-4e53-aed0-cb444829d8ac {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:06.382974 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '058ec1cc-1cd2-44ec-93de-4557c5dd65de', 'code': 200} Dec 09 21:26:06.388585 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-cc7371af-9688-4d81-871d-ee874ba00b5a service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 25, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:26:06.389165 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-cc7371af-9688-4d81-871d-ee874ba00b5a service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:06.389955 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-cc7371af-9688-4d81-871d-ee874ba00b5a service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:26:06.391136 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-cc7371af-9688-4d81-871d-ee874ba00b5a service neutron] Bound port: 1ad36983-4549-4a03-a826-a31a08b98c98, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:26:06.391719 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-cc7371af-9688-4d81-871d-ee874ba00b5a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:06.396772 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7c66946-d8c9-492b-ae38-c0cfd2a2096a req-5250fea2-9354-4278-a344-411072a44d92 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.184&port_id=2958b0be-15e5-48e2-b87a-6ffefd9a7859 HTTP/1.1" status: 200 len: 217 time: 0.0935626 Dec 09 21:26:06.410083 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-39e0c1cc-8511-4b2e-b282-242f22a7a284 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:06.439261 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2ea7ddc2-a3b9-4e7b-bcef-3dbed8996135 None None] Provisioning complete for port 00d35d1d-e182-4dbc-888e-3d60e58ca11a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:06.439261 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2ea7ddc2-a3b9-4e7b-bcef-3dbed8996135 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:06.502480 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7c66946-d8c9-492b-ae38-c0cfd2a2096a req-5014808b-2a58-4e69-aa91-7f54ef608947 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:06.512413 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7c66946-d8c9-492b-ae38-c0cfd2a2096a req-5014808b-2a58-4e69-aa91-7f54ef608947 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1050653 Dec 09 21:26:06.521596 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0b17d08f-c2b0-48a2-a8fe-dcd2b492b0ab req-958db951-84c6-49ad-a6c1-eaf14942f769 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6670785 Dec 09 21:26:06.588905 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 00d35d1d-e182-4dbc-888e-3d60e58ca11a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:06.590064 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:06.669783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7c66946-d8c9-492b-ae38-c0cfd2a2096a req-b14f8be6-353e-400a-99c3-d07b271a49e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:06.671367 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7c66946-d8c9-492b-ae38-c0cfd2a2096a req-b14f8be6-353e-400a-99c3-d07b271a49e9 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1493652 Dec 09 21:26:06.682018 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-cc7371af-9688-4d81-871d-ee874ba00b5a service neutron] For port 1ad36983-4549-4a03-a826-a31a08b98c98, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:26:06.682300 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f84b530-6777-4b70-aa79-fd44af9fdaa2 req-d1161af4-7f2b-4677-b51a-10b085a31af9 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:06.688220 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-cc7371af-9688-4d81-871d-ee874ba00b5a service neutron] For port 1ad36983-4549-4a03-a826-a31a08b98c98, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1ad36983-4549-4a03-a826-a31a08b98c98,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:26:06.692437 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0f84b530-6777-4b70-aa79-fd44af9fdaa2 req-d1161af4-7f2b-4677-b51a-10b085a31af9 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=d3f455b1-1a56-4ded-ab82-e9ce51afbfde HTTP/1.1" status: 200 len: 948 time: 0.1251762 Dec 09 21:26:06.731284 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2ea7ddc2-a3b9-4e7b-bcef-3dbed8996135 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:06.755973 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:06.824844 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7c66946-d8c9-492b-ae38-c0cfd2a2096a req-cc1668db-3995-4b9d-b562-46f06832c55c service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1239407 Dec 09 21:26:06.829694 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-644033f8-3121-423c-9908-ce00aa08c7d9 req-a519ee53-6170-4a3a-bc58-2ec014d68f0f tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "GET /v2.0/security-groups/fbcc2d39-7a75-433e-ac35-d63b1c329a97 HTTP/1.1" status: 200 len: 1829 time: 0.2501256 Dec 09 21:26:06.833669 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2ea7ddc2-a3b9-4e7b-bcef-3dbed8996135 None None] For port 00d35d1d-e182-4dbc-888e-3d60e58ca11a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=00d35d1d-e182-4dbc-888e-3d60e58ca11a,segment=NetworkSegment(d2f9d5c1-75e0-4806-a659-59422ae7083c),segment_id=d2f9d5c1-75e0-4806-a659-59422ae7083c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:06.854423 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2ea7ddc2-a3b9-4e7b-bcef-3dbed8996135 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:06.891877 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-39e0c1cc-8511-4b2e-b282-242f22a7a284 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:06.931713 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-39e0c1cc-8511-4b2e-b282-242f22a7a284 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['419425e5-89f0-4884-91f7-260c4b9d176a']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:06.949728 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-39e0c1cc-8511-4b2e-b282-242f22a7a284 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7ba7eff4-a37f-4acb-b160-b374a7d3afdf') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:06.950560 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-39e0c1cc-8511-4b2e-b282-242f22a7a284 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7ba7eff4-a37f-4acb-b160-b374a7d3afdf') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:06.973480 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-39e0c1cc-8511-4b2e-b282-242f22a7a284 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:06.996392 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ea7ddc2-a3b9-4e7b-bcef-3dbed8996135 None None] Pushing event updated for resources: {'Port': ['ID=00d35d1d-e182-4dbc-888e-3d60e58ca11a,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:07.009650 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-cc7371af-9688-4d81-871d-ee874ba00b5a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:07.023215 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-39e0c1cc-8511-4b2e-b282-242f22a7a284 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:07.055931 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0f84b530-6777-4b70-aa79-fd44af9fdaa2 req-d3470c70-0817-4128-bdf0-bde460e6d876 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3624380 Dec 09 21:26:07.086018 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-39e0c1cc-8511-4b2e-b282-242f22a7a284 admin admin] Releasing vlan 144 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:26:07.086356 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-39e0c1cc-8511-4b2e-b282-242f22a7a284 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:26:07.093184 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:26:07.178217 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-cc7371af-9688-4d81-871d-ee874ba00b5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:07.178868 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-cc7371af-9688-4d81-871d-ee874ba00b5a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:07.180354 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-cc7371af-9688-4d81-871d-ee874ba00b5a service neutron] 10.222.0.31 "PUT /v2.0/ports/1ad36983-4549-4a03-a826-a31a08b98c98 HTTP/1.1" status: 200 len: 1097 time: 3.7667534 Dec 09 21:26:07.183653 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8149d27-9e95-40a1-9807-69931b382622 req-77a0e4d4-ffed-4ba7-9fcf-f0397196cf8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:07.184449 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-880877d6-b0cd-4d51-a52c-3a3f6e999204 None None] Provisioning complete for port 00d35d1d-e182-4dbc-888e-3d60e58ca11a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:07.185363 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-880877d6-b0cd-4d51-a52c-3a3f6e999204 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:07.185521 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8149d27-9e95-40a1-9807-69931b382622 req-77a0e4d4-ffed-4ba7-9fcf-f0397196cf8d service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 1097 time: 0.7112687 Dec 09 21:26:07.272147 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-95a4d6d5-fd0c-4809-b63d-afb5ae7cb69a req-9b90fa47-486b-4f2c-ae20-a14b529d58c2 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a86f14a-2802-4e38-b9dd-4568a02642fc HTTP/1.1" status: 200 len: 210 time: 0.0930166 Dec 09 21:26:07.337526 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7c66946-d8c9-492b-ae38-c0cfd2a2096a req-fc9ec97d-0569-461d-be79-fa950cdb648a service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4982574 Dec 09 21:26:07.341414 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-644033f8-3121-423c-9908-ce00aa08c7d9 req-7e8162fd-f47a-4293-b339-98fb37417ec3 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:07.371294 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-644033f8-3121-423c-9908-ce00aa08c7d9 req-7e8162fd-f47a-4293-b339-98fb37417ec3 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:07.400918 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-39e0c1cc-8511-4b2e-b282-242f22a7a284 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:07.406887 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-39e0c1cc-8511-4b2e-b282-242f22a7a284 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:07.410878 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-39e0c1cc-8511-4b2e-b282-242f22a7a284 admin admin] 10.222.0.13 "DELETE /v2.0/networks/419425e5-89f0-4884-91f7-260c4b9d176a HTTP/1.1" status: 204 len: 168 time: 1.3227680 Dec 09 21:26:07.438810 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f367832e-13e9-4717-9bf9-ac73d0b9f333 req-290cb67a-7996-4e58-adbe-93127e31cef9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:07.440593 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f367832e-13e9-4717-9bf9-ac73d0b9f333 req-290cb67a-7996-4e58-adbe-93127e31cef9 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6ef183f29d2f4992bf91a120a9d85fac&device_id=9503e24d-9ce5-4566-8e69-df8da4219cec HTTP/1.1" status: 200 len: 1100 time: 0.7114451 Dec 09 21:26:07.444892 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38840) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:07.447659 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39e0c1cc-8511-4b2e-b282-242f22a7a284 admin admin] Pushing event deleted for resources: {'Network': ['ID=419425e5-89f0-4884-91f7-260c4b9d176a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:07.487056 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0a2947e-e633-4994-a3e3-b7b03383a668 req-cfdb3d7d-87d9-464b-8089-51a9a7333cef tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:07.488962 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0a2947e-e633-4994-a3e3-b7b03383a668 req-cfdb3d7d-87d9-464b-8089-51a9a7333cef tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/ports?device_id=9503e24d-9ce5-4566-8e69-df8da4219cec HTTP/1.1" status: 200 len: 948 time: 0.0793610 Dec 09 21:26:07.490430 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-644033f8-3121-423c-9908-ce00aa08c7d9 req-7e8162fd-f47a-4293-b339-98fb37417ec3 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:07.493661 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-644033f8-3121-423c-9908-ce00aa08c7d9 req-7e8162fd-f47a-4293-b339-98fb37417ec3 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:07.495241 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-644033f8-3121-423c-9908-ce00aa08c7d9 req-7e8162fd-f47a-4293-b339-98fb37417ec3 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "DELETE /v2.0/security-groups/fbcc2d39-7a75-433e-ac35-d63b1c329a97 HTTP/1.1" status: 204 len: 173 time: 0.6335900 Dec 09 21:26:07.539544 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e8162fd-f47a-4293-b339-98fb37417ec3 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fbcc2d39-7a75-433e-ac35-d63b1c329a97,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:07.553036 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc7371af-9688-4d81-871d-ee874ba00b5a service neutron] Pushing event updated for resources: {'Port': ['ID=1ad36983-4549-4a03-a826-a31a08b98c98,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:07.560064 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0a2947e-e633-4994-a3e3-b7b03383a668 req-0469c8cd-8347-4b24-84be-ab2c44c26373 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/security-groups?id=c81de824-def8-4781-88c7-f240bf84e2af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0634685 Dec 09 21:26:07.697827 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1512d6e9-bdcb-43ca-8d64-fc6e6b391792 req-23f287c1-5aab-43b0-a1ec-90e97741d47d tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "GET /v2.0/security-groups/be517c53-9d70-4d2b-8e16-635c82cf0122 HTTP/1.1" status: 200 len: 1828 time: 0.0989132 Dec 09 21:26:07.760749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3c4642a-bdb2-41eb-82d2-51947b762066 req-4275321d-9d0a-470c-bd5f-d13e3fc3f056 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:07.762687 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3c4642a-bdb2-41eb-82d2-51947b762066 req-4275321d-9d0a-470c-bd5f-d13e3fc3f056 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.1404889 Dec 09 21:26:07.779689 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '70a40261-9248-40ae-8cc6-be041817b657', 'name': 'network-vif-deleted', 'tag': '3ebbcc5a-481f-4868-8b55-d0176959424c'}, {'name': 'network-changed', 'server_uuid': '2cfba12a-761e-445b-bf14-a19d38aeeeb0', 'tag': '1ad36983-4549-4a03-a826-a31a08b98c98'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:07.781992 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5930ee2a-d0d7-4354-96cc-b075b99a28f0" -d '{"events": [{"server_uuid": "70a40261-9248-40ae-8cc6-be041817b657", "name": "network-vif-deleted", "tag": "3ebbcc5a-481f-4868-8b55-d0176959424c"}, {"name": "network-changed", "server_uuid": "2cfba12a-761e-445b-bf14-a19d38aeeeb0", "tag": "1ad36983-4549-4a03-a826-a31a08b98c98"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:07.785128 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f367832e-13e9-4717-9bf9-ac73d0b9f333 req-a32eb7e7-1c1b-454d-8a58-b7c6e305df78 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:07.786732 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f367832e-13e9-4717-9bf9-ac73d0b9f333 req-a32eb7e7-1c1b-454d-8a58-b7c6e305df78 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.3021510 Dec 09 21:26:07.872253 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1512d6e9-bdcb-43ca-8d64-fc6e6b391792 req-13188035-ab75-4f08-8261-d4a9b553d333 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:07.887741 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:07.902456 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 00d35d1d-e182-4dbc-888e-3d60e58ca11a up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:26:07.966536 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-00a14530-b3c1-4084-bc38-bf8b7afccfe5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:07.968722 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-00a14530-b3c1-4084-bc38-bf8b7afccfe5 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&device_id=2cfba12a-761e-445b-bf14-a19d38aeeeb0 HTTP/1.1" status: 200 len: 1100 time: 0.6231337 Dec 09 21:26:07.972563 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1512d6e9-bdcb-43ca-8d64-fc6e6b391792 req-13188035-ab75-4f08-8261-d4a9b553d333 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:07.982592 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e361731-1601-48dc-b73e-067f3c56db22 req-46827644-4622-4411-83c9-dae439d3328c tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:07.985767 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e361731-1601-48dc-b73e-067f3c56db22 req-46827644-4622-4411-83c9-dae439d3328c tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.31 "GET /v2.0/networks?id=56b576e6-50b1-4d1e-a1c2-80bcf1883e68 HTTP/1.1" status: 200 len: 813 time: 0.3092053 Dec 09 21:26:07.994152 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 00d35d1d-e182-4dbc-888e-3d60e58ca11a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:07.995348 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:07.997423 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f367832e-13e9-4717-9bf9-ac73d0b9f333 req-5d9c06c8-099e-4792-985e-66da4b0ada48 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.138&port_id=f4a163f1-05a1-4823-866b-b41a21ed72be HTTP/1.1" status: 200 len: 217 time: 0.1672778 Dec 09 21:26:08.014977 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3c4642a-bdb2-41eb-82d2-51947b762066 req-fc44ad7f-7a53-449b-87ad-a4a4d63a336d tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2073786 Dec 09 21:26:08.020055 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-6e361731-1601-48dc-b73e-067f3c56db22 req-4ed60238-b7d5-4dbe-bd68-1310ff4a5f45 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Request body: {'port': {'device_id': '45c77ac9-72d0-4458-b992-e48fbc0c9adb', 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68', 'admin_state_up': True, 'tenant_id': '52eb00d38d4442158ed8579a84e900ca'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:08.032904 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-bda61c42-9c85-406f-be34-da7a4f3b37e4 admin admin] Deleting subnet 1703b2e6-892a-4fb8-a0e6-a752e0e8e836 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:26:08.037312 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8149d27-9e95-40a1-9807-69931b382622 req-13f1bc9f-b3cb-41f3-8345-95cc3c865c1b service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7152312 Dec 09 21:26:08.067927 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-92625c82-03a1-4983-99a5-16f2d8364f02 req-5883a91b-e0d4-4655-9397-80c24e2bd0c2 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=a0e7c231-5917-4aec-89da-a4a946e66c69&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1763687 Dec 09 21:26:08.164245 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f367832e-13e9-4717-9bf9-ac73d0b9f333 req-0fe080cd-e520-48ad-80a4-ea8318a65ac1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:08.165964 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f367832e-13e9-4717-9bf9-ac73d0b9f333 req-0fe080cd-e520-48ad-80a4-ea8318a65ac1 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1278174 Dec 09 21:26:08.166833 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bda61c42-9c85-406f-be34-da7a4f3b37e4 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:08.195789 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-cd15cebf-a96d-4b9a-98c8-c2f7b5dd39fb service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.253&port_id=1ad36983-4549-4a03-a826-a31a08b98c98 HTTP/1.1" status: 200 len: 217 time: 0.2092030 Dec 09 21:26:08.196486 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e803c476-d9be-4fd3-adcd-c4e1d53c5427 req-454cd4e0-e96e-4217-83c1-b3ed83ac24da tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:08.210843 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1512d6e9-bdcb-43ca-8d64-fc6e6b391792 req-13188035-ab75-4f08-8261-d4a9b553d333 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:08.213500 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1512d6e9-bdcb-43ca-8d64-fc6e6b391792 req-13188035-ab75-4f08-8261-d4a9b553d333 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:08.230023 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1512d6e9-bdcb-43ca-8d64-fc6e6b391792 req-13188035-ab75-4f08-8261-d4a9b553d333 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "DELETE /v2.0/security-groups/be517c53-9d70-4d2b-8e16-635c82cf0122 HTTP/1.1" status: 204 len: 173 time: 0.5310357 Dec 09 21:26:08.247771 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 350 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-75953b2d-b1ca-42c0-877b-df1c4cfd36a2 x-openstack-request-id: req-75953b2d-b1ca-42c0-877b-df1c4cfd36a2 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:08.248077 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "70a40261-9248-40ae-8cc6-be041817b657", "name": "network-vif-deleted", "tag": "3ebbcc5a-481f-4868-8b55-d0176959424c", "status": "completed", "code": 200}, {"name": "network-changed", "server_uuid": "2cfba12a-761e-445b-bf14-a19d38aeeeb0", "tag": "1ad36983-4549-4a03-a826-a31a08b98c98", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:08.248348 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-75953b2d-b1ca-42c0-877b-df1c4cfd36a2 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:08.248773 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '70a40261-9248-40ae-8cc6-be041817b657', 'name': 'network-vif-deleted', 'tag': '3ebbcc5a-481f-4868-8b55-d0176959424c', 'status': 'completed', 'code': 200} Dec 09 21:26:08.249028 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2cfba12a-761e-445b-bf14-a19d38aeeeb0', 'tag': '1ad36983-4549-4a03-a826-a31a08b98c98', 'status': 'completed', 'code': 200} Dec 09 21:26:08.256959 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-454cd4e0-e96e-4217-83c1-b3ed83ac24da tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Pushing event deleted for resources: {'Port': ['ID=775d6690-9f80-4aa2-9026-bb97c37d24af,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:08.333387 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13188035-ab75-4f08-8261-d4a9b553d333 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=be517c53-9d70-4d2b-8e16-635c82cf0122,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:08.352011 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92625c82-03a1-4983-99a5-16f2d8364f02 req-e9cdc980-0807-4568-8781-e0ac9df09529 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:08.353166 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-92625c82-03a1-4983-99a5-16f2d8364f02 req-e9cdc980-0807-4568-8781-e0ac9df09529 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=dd631239105645b6b7088738a5229b7f&device_id=a0e7c231-5917-4aec-89da-a4a946e66c69 HTTP/1.1" status: 200 len: 1098 time: 0.2101207 Dec 09 21:26:08.387791 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '68d909ed-6a44-454a-9fce-e4dd59e2d088', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '775d6690-9f80-4aa2-9026-bb97c37d24af'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:08.392475 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8a1c6686-42e3-4ef5-a8e1-17eea226c96d" -d '{"events": [{"server_uuid": "68d909ed-6a44-454a-9fce-e4dd59e2d088", "name": "network-vif-unplugged", "status": "completed", "tag": "775d6690-9f80-4aa2-9026-bb97c37d24af"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:08.416238 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-32f3050d-3453-4d62-af99-a90fe6808327 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:08.425525 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bda61c42-9c85-406f-be34-da7a4f3b37e4 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:08.466111 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3bc9948a-1148-4e2e-891b-ec75eac13f58 req-5104badf-9fe3-4b7e-a417-773b9938dbd4 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "GET /v2.0/security-groups/8b8d7af4-acc3-4272-915e-3d467f1dd8c4 HTTP/1.1" status: 200 len: 1827 time: 0.1934941 Dec 09 21:26:08.509163 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92625c82-03a1-4983-99a5-16f2d8364f02 req-d3f9b4c6-ee0e-410f-a4ca-dad6dab8baa3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:08.510671 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-92625c82-03a1-4983-99a5-16f2d8364f02 req-d3f9b4c6-ee0e-410f-a4ca-dad6dab8baa3 service neutron] 10.222.0.10 "GET /v2.0/networks?id=ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c HTTP/1.1" status: 200 len: 916 time: 0.1295438 Dec 09 21:26:08.515363 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-e803c476-d9be-4fd3-adcd-c4e1d53c5427 req-454cd4e0-e96e-4217-83c1-b3ed83ac24da tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] No DVR routers for this DVR port 775d6690-9f80-4aa2-9026-bb97c37d24af on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:26:08.518427 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e803c476-d9be-4fd3-adcd-c4e1d53c5427 req-454cd4e0-e96e-4217-83c1-b3ed83ac24da tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:08.520569 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6e361731-1601-48dc-b73e-067f3c56db22 req-4ed60238-b7d5-4dbe-bd68-1310ff4a5f45 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Made reservation on behalf of 52eb00d38d4442158ed8579a84e900ca for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:08.522342 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e803c476-d9be-4fd3-adcd-c4e1d53c5427 req-454cd4e0-e96e-4217-83c1-b3ed83ac24da tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.31 "DELETE /v2.0/ports/775d6690-9f80-4aa2-9026-bb97c37d24af HTTP/1.1" status: 204 len: 173 time: 4.4598238 Dec 09 21:26:08.524091 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6e361731-1601-48dc-b73e-067f3c56db22 req-4ed60238-b7d5-4dbe-bd68-1310ff4a5f45 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:08.554194 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-568fdee0-b9e5-485b-afcb-4aa6bd8223b6 req-d3b9f8d6-c5b2-4816-b78b-5a07c773b9e6 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:08.555744 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-568fdee0-b9e5-485b-afcb-4aa6bd8223b6 req-d3b9f8d6-c5b2-4816-b78b-5a07c773b9e6 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=d3f455b1-1a56-4ded-ab82-e9ce51afbfde HTTP/1.1" status: 200 len: 948 time: 0.2198291 Dec 09 21:26:08.622961 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-a2843cb1-5ea0-45f9-afad-74b18457a807 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:08.624550 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-a2843cb1-5ea0-45f9-afad-74b18457a807 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.3279922 Dec 09 21:26:08.634130 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f367832e-13e9-4717-9bf9-ac73d0b9f333 req-c2c63341-b4fc-4338-a92c-c43c42bbf181 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:08.637426 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f367832e-13e9-4717-9bf9-ac73d0b9f333 req-c2c63341-b4fc-4338-a92c-c43c42bbf181 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.3721626 Dec 09 21:26:08.644552 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bda61c42-9c85-406f-be34-da7a4f3b37e4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:08.654274 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32f3050d-3453-4d62-af99-a90fe6808327 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event updated for resources: {'Subnet': ['ID=1ae814b0-bedd-4a6b-96ff-e062ac849b56,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:08.743350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-92625c82-03a1-4983-99a5-16f2d8364f02 req-0812b630-39c2-454c-a6a2-761765abc6c3 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=78afd497-51cf-40c2-9eaf-ee2f42951961 HTTP/1.1" status: 200 len: 1001 time: 0.2170050 Dec 09 21:26:08.747307 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3bc9948a-1148-4e2e-891b-ec75eac13f58 req-eba99900-466a-45d6-89b8-97d1ce646a98 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:08.756437 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-568fdee0-b9e5-485b-afcb-4aa6bd8223b6 req-00c7bc21-f846-4560-a039-52746526e1e2 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1860645 Dec 09 21:26:08.856459 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3bc9948a-1148-4e2e-891b-ec75eac13f58 req-eba99900-466a-45d6-89b8-97d1ce646a98 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:08.893238 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dd43ca1e-3693-42e7-91f1-56ad7a3589a1 req-cf116ac2-e7c3-480c-88b5-2bd505b8e01d tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a86f14a-2802-4e38-b9dd-4568a02642fc HTTP/1.1" status: 200 len: 210 time: 0.0604260 Dec 09 21:26:08.929346 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92625c82-03a1-4983-99a5-16f2d8364f02 req-11aefa04-3edf-48b7-a28d-3f2c6057446d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:08.931576 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-92625c82-03a1-4983-99a5-16f2d8364f02 req-11aefa04-3edf-48b7-a28d-3f2c6057446d service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9125b460-598b-4793-bfb4-08b07155042a HTTP/1.1" status: 200 len: 854 time: 0.1793416 Dec 09 21:26:08.932366 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-6e361731-1601-48dc-b73e-067f3c56db22 req-4ed60238-b7d5-4dbe-bd68-1310ff4a5f45 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Allocated IP 172.20.0.13 (56b576e6-50b1-4d1e-a1c2-80bcf1883e68/5b18bb60-11fe-4ddd-8fd3-bcb36985a134/420d466e-c77f-433f-9763-037f0389654e) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:26:08.957931 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 2958b0be-15e5-48e2-b87a-6ffefd9a7859 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:26:08.971159 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-41f21639-8428-4db0-8ae2-49dfa8dd499e x-openstack-request-id: req-41f21639-8428-4db0-8ae2-49dfa8dd499e {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:08.975140 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "68d909ed-6a44-454a-9fce-e4dd59e2d088", "name": "network-vif-unplugged", "status": "completed", "tag": "775d6690-9f80-4aa2-9026-bb97c37d24af", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:08.975382 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-41f21639-8428-4db0-8ae2-49dfa8dd499e {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:08.978167 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '68d909ed-6a44-454a-9fce-e4dd59e2d088', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '775d6690-9f80-4aa2-9026-bb97c37d24af', 'code': 200} Dec 09 21:26:09.002962 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3bc9948a-1148-4e2e-891b-ec75eac13f58 req-eba99900-466a-45d6-89b8-97d1ce646a98 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:09.005942 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3bc9948a-1148-4e2e-891b-ec75eac13f58 req-eba99900-466a-45d6-89b8-97d1ce646a98 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:09.011528 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3bc9948a-1148-4e2e-891b-ec75eac13f58 req-eba99900-466a-45d6-89b8-97d1ce646a98 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "DELETE /v2.0/security-groups/8b8d7af4-acc3-4272-915e-3d467f1dd8c4 HTTP/1.1" status: 204 len: 173 time: 0.5278077 Dec 09 21:26:09.074121 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eba99900-466a-45d6-89b8-97d1ce646a98 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8b8d7af4-acc3-4272-915e-3d467f1dd8c4,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:09.091866 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92625c82-03a1-4983-99a5-16f2d8364f02 req-73722313-da94-405f-a497-dabdb9053984 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:09.093862 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-92625c82-03a1-4983-99a5-16f2d8364f02 req-73722313-da94-405f-a497-dabdb9053984 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1544299 Dec 09 21:26:09.167651 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 2958b0be-15e5-48e2-b87a-6ffefd9a7859, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2958b0be-15e5-48e2-b87a-6ffefd9a7859,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:09.183734 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f367832e-13e9-4717-9bf9-ac73d0b9f333 req-bbacf686-7073-4f05-aac0-d6fa39897363 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5222328 Dec 09 21:26:09.186107 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '2958b0be-15e5-48e2-b87a-6ffefd9a7859', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '2958b0be-15e5-48e2-b87a-6ffefd9a7859', 'mac_address': 'fa:16:3e:c3:73:0a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.184'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:26:09.190584 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e361731-1601-48dc-b73e-067f3c56db22 req-fe6369d4-4414-4e4f-87fc-be3406702239 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:09.192143 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6e361731-1601-48dc-b73e-067f3c56db22 req-fe6369d4-4414-4e4f-87fc-be3406702239 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.31 "GET /v2.0/networks?id=56b576e6-50b1-4d1e-a1c2-80bcf1883e68 HTTP/1.1" status: 200 len: 813 time: 0.8856606 Dec 09 21:26:09.193136 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32f3050d-3453-4d62-af99-a90fe6808327 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Checking segment: {'id': '62cd2cbb-d71c-4d79-8112-51e9e682f3f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '30d0c468-ca40-4f41-a7a6-de8dc44194c4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:09.193508 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-32f3050d-3453-4d62-af99-a90fe6808327 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Network hostable DHCP agents. Network: 30d0c468-ca40-4f41-a7a6-de8dc44194c4, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:26:09.300774 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:09.307308 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-3a992253-2daf-42ac-aeca-7ee1312923b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:09.309026 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-3a992253-2daf-42ac-aeca-7ee1312923b2 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.6703880 Dec 09 21:26:09.312598 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f367832e-13e9-4717-9bf9-ac73d0b9f333 req-b57d2b67-01b3-47b5-8d04-da5d3585f886 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0991626 Dec 09 21:26:09.320785 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a8434231-30fd-4dd4-ba9d-998fcfd9191c tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Request body: {'port': {'device_id': '1a86f14a-2802-4e38-b9dd-4568a02642fc', 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68', 'admin_state_up': True, 'tenant_id': '52eb00d38d4442158ed8579a84e900ca'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:09.333197 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2958b0be-15e5-48e2-b87a-6ffefd9a7859 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:09.375853 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 2958b0be-15e5-48e2-b87a-6ffefd9a7859, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2958b0be-15e5-48e2-b87a-6ffefd9a7859,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:09.389409 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:09.391240 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device f4a163f1-05a1-4823-866b-b41a21ed72be details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:26:09.467571 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port f4a163f1-05a1-4823-866b-b41a21ed72be, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=f4a163f1-05a1-4823-866b-b41a21ed72be,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:09.470473 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=2958b0be-15e5-48e2-b87a-6ffefd9a7859,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:09.485742 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'f4a163f1-05a1-4823-866b-b41a21ed72be', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': 'f4a163f1-05a1-4823-866b-b41a21ed72be', 'mac_address': 'fa:16:3e:9c:66:0b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.138'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:26:09.496680 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eb718549-b9e6-4482-8349-d6250b59566f req-4dea5984-554a-4fdb-bba3-58ea388e7308 tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "GET /v2.0/security-groups/bf43dc1d-fc98-4f45-8b2e-33b02cf1628a HTTP/1.1" status: 200 len: 1829 time: 0.4537799 Dec 09 21:26:09.526511 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:09.533936 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a8434231-30fd-4dd4-ba9d-998fcfd9191c tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Made reservation on behalf of 52eb00d38d4442158ed8579a84e900ca for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:09.538506 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a8434231-30fd-4dd4-ba9d-998fcfd9191c tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:09.553945 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f4a163f1-05a1-4823-866b-b41a21ed72be {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:09.558510 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bda61c42-9c85-406f-be34-da7a4f3b37e4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:09.561044 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-32f3050d-3453-4d62-af99-a90fe6808327 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Network 30d0c468-ca40-4f41-a7a6-de8dc44194c4 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:26:09.570245 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-5324b2a3-8295-4562-a4ac-d77d783e83a7 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1318421 Dec 09 21:26:09.576588 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port f4a163f1-05a1-4823-866b-b41a21ed72be, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=f4a163f1-05a1-4823-866b-b41a21ed72be,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:09.584583 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:09.590973 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:09.615112 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81d1168b-b062-4aa6-a73d-615358dd9fa8 req-fbaaf588-c839-4386-883e-64ca4275f393 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:09.616660 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-81d1168b-b062-4aa6-a73d-615358dd9fa8 req-fbaaf588-c839-4386-883e-64ca4275f393 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/ports?device_id=9503e24d-9ce5-4566-8e69-df8da4219cec HTTP/1.1" status: 200 len: 948 time: 0.5216508 Dec 09 21:26:09.618004 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-32f3050d-3453-4d62-af99-a90fe6808327 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 30d0c468-ca40-4f41-a7a6-de8dc44194c4) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:09.620353 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bda61c42-9c85-406f-be34-da7a4f3b37e4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1703b2e6-892a-4fb8-a0e6-a752e0e8e836,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:09.642222 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32f3050d-3453-4d62-af99-a90fe6808327 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:09.642981 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-32f3050d-3453-4d62-af99-a90fe6808327 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:09.646909 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ec258d81-30f7-4b91-aba3-f7bbe8ecbbac None None] Network 30d0c468-ca40-4f41-a7a6-de8dc44194c4 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:26:09.651173 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bda61c42-9c85-406f-be34-da7a4f3b37e4 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:09.651681 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=f4a163f1-05a1-4823-866b-b41a21ed72be,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:09.658053 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bda61c42-9c85-406f-be34-da7a4f3b37e4 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/1703b2e6-892a-4fb8-a0e6-a752e0e8e836 HTTP/1.1" status: 204 len: 168 time: 2.2040794 Dec 09 21:26:09.666336 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38864) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:09.684779 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-92625c82-03a1-4983-99a5-16f2d8364f02 req-4f5de13e-97d8-4ace-90f3-4e35ce9e067a service neutron] 10.222.0.10 "GET /v2.0/networks/ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5639963 Dec 09 21:26:09.768130 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-32f3050d-3453-4d62-af99-a90fe6808327 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 798 time: 4.4795394 Dec 09 21:26:09.797847 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-eb718549-b9e6-4482-8349-d6250b59566f req-a5bd9a7c-6de8-48b9-ab39-34eac9cb2c5e tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:09.806955 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6e361731-1601-48dc-b73e-067f3c56db22 req-4ed60238-b7d5-4dbe-bd68-1310ff4a5f45 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:09.820085 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a84c9c1b-cc0c-403b-a332-481aaac05724 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-30d0c468-ca40-4f41-a7a6-de8dc44194c4', 'network_id': '30d0c468-ca40-4f41-a7a6-de8dc44194c4', 'project_id': '73812a0c336d4768b029fd6459a1ae9e', 'fixed_ips': [{'subnet_id': '1ae814b0-bedd-4a6b-96ff-e062ac849b56'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:26:09.822245 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a84c9c1b-cc0c-403b-a332-481aaac05724 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:09.856313 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-78fb05cf-8f31-4c56-9d3d-e10879b009cf req-a54b713e-6387-419f-aa84-5b597bfeabfa service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2537603 Dec 09 21:26:09.881296 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-81d1168b-b062-4aa6-a73d-615358dd9fa8 req-4b511def-5f36-4a49-9fc0-11af3d938009 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/security-groups?id=c81de824-def8-4781-88c7-f240bf84e2af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2331848 Dec 09 21:26:09.922671 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-eb718549-b9e6-4482-8349-d6250b59566f req-a5bd9a7c-6de8-48b9-ab39-34eac9cb2c5e tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:09.959578 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-14a34fef-bf95-4103-81d2-4aabe4ce99d9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:09.962212 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['2958b0be-15e5-48e2-b87a-6ffefd9a7859'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:09.965811 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['f4a163f1-05a1-4823-866b-b41a21ed72be'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:09.995570 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5930ee2a-d0d7-4354-96cc-b075b99a28f0 req-5af4255e-4a41-4640-a4b7-a27f4329f5ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:10.002024 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5930ee2a-d0d7-4354-96cc-b075b99a28f0 req-5af4255e-4a41-4640-a4b7-a27f4329f5ff service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&device_id=2cfba12a-761e-445b-bf14-a19d38aeeeb0 HTTP/1.1" status: 200 len: 1100 time: 0.0874414 Dec 09 21:26:10.085935 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-92625c82-03a1-4983-99a5-16f2d8364f02 req-bd10b4f8-c5bf-41db-9737-817314844669 service neutron] 10.222.0.10 "GET /v2.0/networks/ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3805633 Dec 09 21:26:10.088341 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6e361731-1601-48dc-b73e-067f3c56db22 req-4ed60238-b7d5-4dbe-bd68-1310ff4a5f45 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:10.132117 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-a84c9c1b-cc0c-403b-a332-481aaac05724 None None] Allocated IP 19.86.0.2 (30d0c468-ca40-4f41-a7a6-de8dc44194c4/1ae814b0-bedd-4a6b-96ff-e062ac849b56/d421ed75-4068-4fe0-b0d2-b1800f25585a) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:26:10.149892 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a8434231-30fd-4dd4-ba9d-998fcfd9191c tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Allocated IP 172.20.0.7 (56b576e6-50b1-4d1e-a1c2-80bcf1883e68/5b18bb60-11fe-4ddd-8fd3-bcb36985a134/a0a1eab9-7a2d-4b73-9918-01919710bdbe) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:26:10.152105 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-eb718549-b9e6-4482-8349-d6250b59566f req-a5bd9a7c-6de8-48b9-ab39-34eac9cb2c5e tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:10.152771 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5930ee2a-d0d7-4354-96cc-b075b99a28f0 req-42b0b4b3-cd82-4d03-ad40-20791ab3b707 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:10.154997 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5930ee2a-d0d7-4354-96cc-b075b99a28f0 req-42b0b4b3-cd82-4d03-ad40-20791ab3b707 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.1454382 Dec 09 21:26:10.155317 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-eb718549-b9e6-4482-8349-d6250b59566f req-a5bd9a7c-6de8-48b9-ab39-34eac9cb2c5e tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:10.156545 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eb718549-b9e6-4482-8349-d6250b59566f req-a5bd9a7c-6de8-48b9-ab39-34eac9cb2c5e tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] 10.222.0.13 "DELETE /v2.0/security-groups/bf43dc1d-fc98-4f45-8b2e-33b02cf1628a HTTP/1.1" status: 204 len: 173 time: 0.6197591 Dec 09 21:26:10.178514 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38876) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:10.203981 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5930ee2a-d0d7-4354-96cc-b075b99a28f0 req-f55c350b-43f5-47f8-b2b9-fa908d9df3ba service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.253&port_id=1ad36983-4549-4a03-a826-a31a08b98c98 HTTP/1.1" status: 200 len: 217 time: 0.0401578 Dec 09 21:26:10.213742 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5062bf1e-57f5-4f71-bb52-d32525a4d3f6 req-000956ad-8d3a-426d-9e50-a54929c6402a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:10.222726 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5062bf1e-57f5-4f71-bb52-d32525a4d3f6 req-000956ad-8d3a-426d-9e50-a54929c6402a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.2329524 Dec 09 21:26:10.253981 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '68d909ed-6a44-454a-9fce-e4dd59e2d088', 'name': 'network-vif-deleted', 'tag': '775d6690-9f80-4aa2-9026-bb97c37d24af'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:10.256882 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cbbf2948-299f-4711-b906-fb05008f100b" -d '{"events": [{"server_uuid": "68d909ed-6a44-454a-9fce-e4dd59e2d088", "name": "network-vif-deleted", "tag": "775d6690-9f80-4aa2-9026-bb97c37d24af"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:10.279628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6e361731-1601-48dc-b73e-067f3c56db22 req-4ed60238-b7d5-4dbe-bd68-1310ff4a5f45 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Network 56b576e6-50b1-4d1e-a1c2-80bcf1883e68 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:26:10.303797 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5bd9a7c-6de8-48b9-ab39-34eac9cb2c5e tempest-SecurityGroupRulesNegativeTestJSON-426945813 tempest-SecurityGroupRulesNegativeTestJSON-426945813-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=bf43dc1d-fc98-4f45-8b2e-33b02cf1628a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:10.310705 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-14a34fef-bf95-4103-81d2-4aabe4ce99d9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:10.314636 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5930ee2a-d0d7-4354-96cc-b075b99a28f0 req-03a06668-a521-4d92-9a3e-abbeb67a6059 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:10.316202 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5930ee2a-d0d7-4354-96cc-b075b99a28f0 req-03a06668-a521-4d92-9a3e-abbeb67a6059 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1049755 Dec 09 21:26:10.370430 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-14a34fef-bf95-4103-81d2-4aabe4ce99d9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6ec183b6-af32-41ca-8fac-dabe007f5a94']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:10.374730 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ed60238-b7d5-4dbe-bd68-1310ff4a5f45 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Pushing event updated for resources: {'Port': ['ID=420d466e-c77f-433f-9763-037f0389654e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:10.398952 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-6e361731-1601-48dc-b73e-067f3c56db22 req-4ed60238-b7d5-4dbe-bd68-1310ff4a5f45 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:10.424815 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-14a34fef-bf95-4103-81d2-4aabe4ce99d9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f36b93d7-1714-4a6f-87e4-8efd31b62bf6') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:10.425116 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-14a34fef-bf95-4103-81d2-4aabe4ce99d9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f36b93d7-1714-4a6f-87e4-8efd31b62bf6') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:10.427578 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5930ee2a-d0d7-4354-96cc-b075b99a28f0 req-ba3bf487-621b-46e4-bf1b-343f4add1651 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:10.430443 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5930ee2a-d0d7-4354-96cc-b075b99a28f0 req-ba3bf487-621b-46e4-bf1b-343f4add1651 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1025777 Dec 09 21:26:10.430648 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-6e361731-1601-48dc-b73e-067f3c56db22 req-4ed60238-b7d5-4dbe-bd68-1310ff4a5f45 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:26:10.444602 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a84c9c1b-cc0c-403b-a332-481aaac05724 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:10.451055 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a84c9c1b-cc0c-403b-a332-481aaac05724 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:10.474783 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a8434231-30fd-4dd4-ba9d-998fcfd9191c tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:10.493052 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-14a34fef-bf95-4103-81d2-4aabe4ce99d9 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:10.502539 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-d2319657-c359-4d1b-9423-434aa98b881d admin admin] Deleting subnet 4bb33c51-adeb-4529-9543-3172b6037520 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:26:10.506457 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a84c9c1b-cc0c-403b-a332-481aaac05724 None None] Network 30d0c468-ca40-4f41-a7a6-de8dc44194c4 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:26:10.508874 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-a84c9c1b-cc0c-403b-a332-481aaac05724 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:10.510168 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a84c9c1b-cc0c-403b-a332-481aaac05724 None None] Pushing event updated for resources: {'Port': ['ID=d421ed75-4068-4fe0-b0d2-b1800f25585a,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:10.513712 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a84c9c1b-cc0c-403b-a332-481aaac05724 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:26:10.528559 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2319657-c359-4d1b-9423-434aa98b881d admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:10.554054 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5930ee2a-d0d7-4354-96cc-b075b99a28f0 req-e592c68c-d838-4638-8b8a-a40b79a98970 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1156681 Dec 09 21:26:10.563983 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a8434231-30fd-4dd4-ba9d-998fcfd9191c tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:10.574645 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a84c9c1b-cc0c-403b-a332-481aaac05724 None None] Attempting to bind port d421ed75-4068-4fe0-b0d2-b1800f25585a on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:26:10.574946 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5062bf1e-57f5-4f71-bb52-d32525a4d3f6 req-f9bb6a5a-662e-42b0-8e5c-59f75a9c1493 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3511927 Dec 09 21:26:10.575289 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a84c9c1b-cc0c-403b-a332-481aaac05724 None None] Attempting to bind port d421ed75-4068-4fe0-b0d2-b1800f25585a by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '62cd2cbb-d71c-4d79-8112-51e9e682f3f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '30d0c468-ca40-4f41-a7a6-de8dc44194c4'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:26:10.575930 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a84c9c1b-cc0c-403b-a332-481aaac05724 None None] Attempting to bind port d421ed75-4068-4fe0-b0d2-b1800f25585a on network 30d0c468-ca40-4f41-a7a6-de8dc44194c4 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:10.579133 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-14a34fef-bf95-4103-81d2-4aabe4ce99d9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:10.584954 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a84c9c1b-cc0c-403b-a332-481aaac05724 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 26, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:26:10.585487 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a84c9c1b-cc0c-403b-a332-481aaac05724 None None] Checking segment: {'id': '62cd2cbb-d71c-4d79-8112-51e9e682f3f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '30d0c468-ca40-4f41-a7a6-de8dc44194c4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:10.585989 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a84c9c1b-cc0c-403b-a332-481aaac05724 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:10.587833 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a84c9c1b-cc0c-403b-a332-481aaac05724 None None] Bound using segment: {'id': '62cd2cbb-d71c-4d79-8112-51e9e682f3f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '30d0c468-ca40-4f41-a7a6-de8dc44194c4'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:26:10.589136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a84c9c1b-cc0c-403b-a332-481aaac05724 None None] Bound port: d421ed75-4068-4fe0-b0d2-b1800f25585a, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '62cd2cbb-d71c-4d79-8112-51e9e682f3f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '30d0c468-ca40-4f41-a7a6-de8dc44194c4'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:26:10.589555 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a84c9c1b-cc0c-403b-a332-481aaac05724 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:10.604383 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-408b2863-0454-4e04-9e05-71b0905d0cc2 req-7d158d98-b0ce-4bd0-86b1-85518f8e96c2 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:10.605912 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-408b2863-0454-4e04-9e05-71b0905d0cc2 req-7d158d98-b0ce-4bd0-86b1-85518f8e96c2 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=d3f455b1-1a56-4ded-ab82-e9ce51afbfde HTTP/1.1" status: 200 len: 949 time: 0.2103109 Dec 09 21:26:10.611813 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e361731-1601-48dc-b73e-067f3c56db22 req-4ed60238-b7d5-4dbe-bd68-1310ff4a5f45 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:10.612374 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6e361731-1601-48dc-b73e-067f3c56db22 req-4ed60238-b7d5-4dbe-bd68-1310ff4a5f45 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:10.618479 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-14a34fef-bf95-4103-81d2-4aabe4ce99d9 admin admin] Releasing vlan 104 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:26:10.618893 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-14a34fef-bf95-4103-81d2-4aabe4ce99d9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:26:10.621467 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:26:10.658328 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2319657-c359-4d1b-9423-434aa98b881d admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:10.661856 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8434231-30fd-4dd4-ba9d-998fcfd9191c tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Pushing event updated for resources: {'Port': ['ID=a0a1eab9-7a2d-4b73-9918-01919710bdbe,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:10.685812 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a84c9c1b-cc0c-403b-a332-481aaac05724 None None] For port d421ed75-4068-4fe0-b0d2-b1800f25585a, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:26:10.689459 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a84c9c1b-cc0c-403b-a332-481aaac05724 None None] For port d421ed75-4068-4fe0-b0d2-b1800f25585a, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d421ed75-4068-4fe0-b0d2-b1800f25585a,segment=NetworkSegment(62cd2cbb-d71c-4d79-8112-51e9e682f3f3),segment_id=62cd2cbb-d71c-4d79-8112-51e9e682f3f3)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:26:10.694035 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a84c9c1b-cc0c-403b-a332-481aaac05724 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:10.696725 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a8434231-30fd-4dd4-ba9d-998fcfd9191c tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Network 56b576e6-50b1-4d1e-a1c2-80bcf1883e68 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:26:10.759847 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a84c9c1b-cc0c-403b-a332-481aaac05724 None None] Pushing event updated for resources: {'Port': ['ID=d421ed75-4068-4fe0-b0d2-b1800f25585a,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:10.765549 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a8434231-30fd-4dd4-ba9d-998fcfd9191c tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:10.768891 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5930ee2a-d0d7-4354-96cc-b075b99a28f0 req-f3197afc-4a46-4d26-a9be-c3e638ca07b0 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1872818 Dec 09 21:26:10.770323 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a8434231-30fd-4dd4-ba9d-998fcfd9191c tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:26:10.790502 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e361731-1601-48dc-b73e-067f3c56db22 req-4ed60238-b7d5-4dbe-bd68-1310ff4a5f45 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.7746949 Dec 09 21:26:10.802531 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-408b2863-0454-4e04-9e05-71b0905d0cc2 req-306661be-57e1-4687-8921-f6298d51fd7b tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1866226 Dec 09 21:26:10.813805 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-14a34fef-bf95-4103-81d2-4aabe4ce99d9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:10.823525 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-6e361731-1601-48dc-b73e-067f3c56db22 req-77236651-608d-4929-b4f4-accf3c77a789 service neutron] Request body: {'port': {'device_id': '45c77ac9-72d0-4458-b992-e48fbc0c9adb', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:10.846954 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a8434231-30fd-4dd4-ba9d-998fcfd9191c tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:10.847893 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a8434231-30fd-4dd4-ba9d-998fcfd9191c tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:10.861128 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2319657-c359-4d1b-9423-434aa98b881d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:10.880011 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a8434231-30fd-4dd4-ba9d-998fcfd9191c tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5608282 Dec 09 21:26:10.905744 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-14a34fef-bf95-4103-81d2-4aabe4ce99d9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:10.908925 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-14a34fef-bf95-4103-81d2-4aabe4ce99d9 admin admin] 10.222.0.13 "DELETE /v2.0/networks/6ec183b6-af32-41ca-8fac-dabe007f5a94 HTTP/1.1" status: 204 len: 168 time: 1.2277725 Dec 09 21:26:10.909173 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a4a6bd31-7020-46a0-a76a-4032318d1fe8 service neutron] Request body: {'port': {'device_id': '1a86f14a-2802-4e38-b9dd-4568a02642fc', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:10.909914 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14a34fef-bf95-4103-81d2-4aabe4ce99d9 admin admin] Pushing event deleted for resources: {'Network': ['ID=6ec183b6-af32-41ca-8fac-dabe007f5a94,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:10.950127 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-873e96e8-74ba-4114-abd8-c6e7ab00547b req-293657bc-a8c6-4f3b-994e-69cab014656c tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:10.952059 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-873e96e8-74ba-4114-abd8-c6e7ab00547b req-293657bc-a8c6-4f3b-994e-69cab014656c tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a86f14a-2802-4e38-b9dd-4568a02642fc HTTP/1.1" status: 200 len: 931 time: 0.2992043 Dec 09 21:26:10.987236 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 2958b0be-15e5-48e2-b87a-6ffefd9a7859 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:26:10.988243 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a4a6bd31-7020-46a0-a76a-4032318d1fe8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:11.125037 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6e361731-1601-48dc-b73e-067f3c56db22 req-77236651-608d-4929-b4f4-accf3c77a789 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:11.138266 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 2958b0be-15e5-48e2-b87a-6ffefd9a7859 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:26:11.144139 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 2958b0be-15e5-48e2-b87a-6ffefd9a7859 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:11.144758 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:11.149699 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2319657-c359-4d1b-9423-434aa98b881d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:11.171508 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38894) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:11.229749 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-873e96e8-74ba-4114-abd8-c6e7ab00547b req-0484797f-0749-4f90-a18f-390136b73678 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2645798 Dec 09 21:26:11.239664 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2319657-c359-4d1b-9423-434aa98b881d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4bb33c51-adeb-4529-9543-3172b6037520,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:11.266319 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:11.290701 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd3f455b1-1a56-4ded-ab82-e9ce51afbfde', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2958b0be-15e5-48e2-b87a-6ffefd9a7859'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:11.293067 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-68954659-6fdb-44a6-909c-52e77d6282ca" -d '{"events": [{"server_uuid": "d3f455b1-1a56-4ded-ab82-e9ce51afbfde", "name": "network-vif-plugged", "status": "completed", "tag": "2958b0be-15e5-48e2-b87a-6ffefd9a7859"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:11.306559 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 2958b0be-15e5-48e2-b87a-6ffefd9a7859, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2958b0be-15e5-48e2-b87a-6ffefd9a7859,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:11.312141 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:11.313267 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device f4a163f1-05a1-4823-866b-b41a21ed72be up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:26:11.314944 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a3cd54ab-f5b8-401c-a07b-88689f33c858 x-openstack-request-id: req-a3cd54ab-f5b8-401c-a07b-88689f33c858 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:11.315318 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "68d909ed-6a44-454a-9fce-e4dd59e2d088", "name": "network-vif-deleted", "tag": "775d6690-9f80-4aa2-9026-bb97c37d24af", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:11.315661 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a3cd54ab-f5b8-401c-a07b-88689f33c858 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:11.316313 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '68d909ed-6a44-454a-9fce-e4dd59e2d088', 'name': 'network-vif-deleted', 'tag': '775d6690-9f80-4aa2-9026-bb97c37d24af', 'status': 'completed', 'code': 200} Dec 09 21:26:11.380101 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2319657-c359-4d1b-9423-434aa98b881d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:11.384945 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d2319657-c359-4d1b-9423-434aa98b881d admin admin] 10.222.0.13 "DELETE /v2.0/subnets/4bb33c51-adeb-4529-9543-3172b6037520 HTTP/1.1" status: 204 len: 168 time: 1.2025626 Dec 09 21:26:11.390851 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38900) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:11.394146 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-4bfa3195-7bd4-4433-98f4-a4bf1793d397 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:11.401305 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-4bfa3195-7bd4-4433-98f4-a4bf1793d397 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:11.401500 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a4a6bd31-7020-46a0-a76a-4032318d1fe8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a0a1eab9-7a2d-4b73-9918-01919710bdbe {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:11.405771 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=2958b0be-15e5-48e2-b87a-6ffefd9a7859,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:11.416830 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-4bfa3195-7bd4-4433-98f4-a4bf1793d397 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/networks?id=b10aba5b-a802-488f-b187-37195bb0b8ca&id=30d0c468-ca40-4f41-a7a6-de8dc44194c4 HTTP/1.1" status: 200 len: 1392 time: 0.5036569 Dec 09 21:26:11.417115 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port f4a163f1-05a1-4823-866b-b41a21ed72be completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:26:11.422539 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port f4a163f1-05a1-4823-866b-b41a21ed72be triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:11.422956 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:11.427286 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a4a6bd31-7020-46a0-a76a-4032318d1fe8 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:11.492933 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-43abc82f-d26e-4317-8137-09298ecaba6f admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=87694f06f4144186aac9c50bac43d5ec&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3148057 Dec 09 21:26:11.497608 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38902) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:11.502340 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a4a6bd31-7020-46a0-a76a-4032318d1fe8 service neutron] Transition to ACTIVE for port object a0a1eab9-7a2d-4b73-9918-01919710bdbe will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:26:11.503687 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-f24988fb-cce1-46ec-9727-b083acf84bea tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/quotas/73812a0c336d4768b029fd6459a1ae9e HTTP/1.1" status: 200 len: 375 time: 0.0854778 Dec 09 21:26:11.513104 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:11.522211 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a4a6bd31-7020-46a0-a76a-4032318d1fe8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:11.559134 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port f4a163f1-05a1-4823-866b-b41a21ed72be, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=f4a163f1-05a1-4823-866b-b41a21ed72be,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:11.566769 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac22aedd-05c6-4da3-9d18-6c7bc069ba37 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:11.567091 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:11.625805 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=f4a163f1-05a1-4823-866b-b41a21ed72be,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:11.632775 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-a1944fa7-c54d-4665-a088-6455d14666c1 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=73812a0c336d4768b029fd6459a1ae9e&fields=id HTTP/1.1" status: 200 len: 394 time: 0.1214378 Dec 09 21:26:11.701885 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac22aedd-05c6-4da3-9d18-6c7bc069ba37 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:11.724131 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-ac22aedd-05c6-4da3-9d18-6c7bc069ba37 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8af3da98-702c-4f3e-94d5-1e7af3a60db1']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:11.734930 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-ac22aedd-05c6-4da3-9d18-6c7bc069ba37 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f26fd670-bdee-4620-9d95-2bdac0a6a3fc') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:11.735322 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-ac22aedd-05c6-4da3-9d18-6c7bc069ba37 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f26fd670-bdee-4620-9d95-2bdac0a6a3fc') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:11.744202 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4a6bd31-7020-46a0-a76a-4032318d1fe8 service neutron] Pushing event updated for resources: {'Port': ['ID=a0a1eab9-7a2d-4b73-9918-01919710bdbe,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:11.749578 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac22aedd-05c6-4da3-9d18-6c7bc069ba37 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:11.786699 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-1a226cab-8fb5-479f-963d-0830650c24fe service neutron] 10.222.0.13 "GET /v2.0/networks/b10aba5b-a802-488f-b187-37195bb0b8ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1424341 Dec 09 21:26:11.846057 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac22aedd-05c6-4da3-9d18-6c7bc069ba37 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:11.876372 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8f55c1e2-4046-403a-ac8b-df4ce1d94b41 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:11.881750 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ac22aedd-05c6-4da3-9d18-6c7bc069ba37 admin admin] Releasing vlan 102 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:26:11.882155 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac22aedd-05c6-4da3-9d18-6c7bc069ba37 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:26:11.885089 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:26:11.887962 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-6e361731-1601-48dc-b73e-067f3c56db22 req-77236651-608d-4929-b4f4-accf3c77a789 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 420d466e-c77f-433f-9763-037f0389654e {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:11.898191 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6e361731-1601-48dc-b73e-067f3c56db22 req-77236651-608d-4929-b4f4-accf3c77a789 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:11.928327 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-6e361731-1601-48dc-b73e-067f3c56db22 req-77236651-608d-4929-b4f4-accf3c77a789 service neutron] Transition to ACTIVE for port object 420d466e-c77f-433f-9763-037f0389654e will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:26:11.930173 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d421ed75-4068-4fe0-b0d2-b1800f25585a up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:26:11.970337 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8f55c1e2-4046-403a-ac8b-df4ce1d94b41 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:11.978190 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a4a6bd31-7020-46a0-a76a-4032318d1fe8 service neutron] Attempting to bind port a0a1eab9-7a2d-4b73-9918-01919710bdbe on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:26:11.978571 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a4a6bd31-7020-46a0-a76a-4032318d1fe8 service neutron] Attempting to bind port a0a1eab9-7a2d-4b73-9918-01919710bdbe by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'bada42e9-278b-46e3-bbc2-c2d37f00c32d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:26:11.979128 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a4a6bd31-7020-46a0-a76a-4032318d1fe8 service neutron] Attempting to bind port a0a1eab9-7a2d-4b73-9918-01919710bdbe on network 56b576e6-50b1-4d1e-a1c2-80bcf1883e68 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:11.989439 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a4a6bd31-7020-46a0-a76a-4032318d1fe8 service neutron] Port a0a1eab9-7a2d-4b73-9918-01919710bdbe on network 56b576e6-50b1-4d1e-a1c2-80bcf1883e68 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:26:11.989939 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a4a6bd31-7020-46a0-a76a-4032318d1fe8 service neutron] Attempting to bind port a0a1eab9-7a2d-4b73-9918-01919710bdbe on network 56b576e6-50b1-4d1e-a1c2-80bcf1883e68 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:12.000351 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port d421ed75-4068-4fe0-b0d2-b1800f25585a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:12.000871 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:12.025752 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac22aedd-05c6-4da3-9d18-6c7bc069ba37 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:12.028843 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a4a6bd31-7020-46a0-a76a-4032318d1fe8 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 25, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:26:12.029367 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a4a6bd31-7020-46a0-a76a-4032318d1fe8 service neutron] Checking segment: {'id': 'bada42e9-278b-46e3-bbc2-c2d37f00c32d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:12.029793 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a4a6bd31-7020-46a0-a76a-4032318d1fe8 service neutron] Bound using segment: {'id': 'bada42e9-278b-46e3-bbc2-c2d37f00c32d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:26:12.030336 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a4a6bd31-7020-46a0-a76a-4032318d1fe8 service neutron] Bound port: a0a1eab9-7a2d-4b73-9918-01919710bdbe, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bada42e9-278b-46e3-bbc2-c2d37f00c32d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:26:12.030818 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a4a6bd31-7020-46a0-a76a-4032318d1fe8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:12.048611 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-fa2baafb-95c3-41d4-837f-0bbf6339d192 service neutron] 10.222.0.13 "GET /v2.0/networks/b10aba5b-a802-488f-b187-37195bb0b8ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1390240 Dec 09 21:26:12.049201 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac22aedd-05c6-4da3-9d18-6c7bc069ba37 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:12.049348 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6e361731-1601-48dc-b73e-067f3c56db22 req-77236651-608d-4929-b4f4-accf3c77a789 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:12.052846 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ac22aedd-05c6-4da3-9d18-6c7bc069ba37 admin admin] 10.222.0.13 "DELETE /v2.0/networks/8af3da98-702c-4f3e-94d5-1e7af3a60db1 HTTP/1.1" status: 204 len: 168 time: 0.6605661 Dec 09 21:26:12.061395 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac22aedd-05c6-4da3-9d18-6c7bc069ba37 admin admin] Pushing event deleted for resources: {'Network': ['ID=8af3da98-702c-4f3e-94d5-1e7af3a60db1,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:12.124304 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a4a6bd31-7020-46a0-a76a-4032318d1fe8 service neutron] For port a0a1eab9-7a2d-4b73-9918-01919710bdbe, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:26:12.128189 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a4a6bd31-7020-46a0-a76a-4032318d1fe8 service neutron] For port a0a1eab9-7a2d-4b73-9918-01919710bdbe, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a0a1eab9-7a2d-4b73-9918-01919710bdbe,segment=NetworkSegment(bada42e9-278b-46e3-bbc2-c2d37f00c32d),segment_id=bada42e9-278b-46e3-bbc2-c2d37f00c32d)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:26:12.136907 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a4a6bd31-7020-46a0-a76a-4032318d1fe8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:12.161942 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:12.179155 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8f55c1e2-4046-403a-ac8b-df4ce1d94b41 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:12.181866 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8f55c1e2-4046-403a-ac8b-df4ce1d94b41 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:12.183334 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8f55c1e2-4046-403a-ac8b-df4ce1d94b41 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/b7152147-ed7a-4a1f-b140-69adad7d753f HTTP/1.1" status: 204 len: 168 time: 0.6794679 Dec 09 21:26:12.208469 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f55c1e2-4046-403a-ac8b-df4ce1d94b41 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b7152147-ed7a-4a1f-b140-69adad7d753f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:12.219922 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a4a6bd31-7020-46a0-a76a-4032318d1fe8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:12.220679 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a4a6bd31-7020-46a0-a76a-4032318d1fe8 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:12.222024 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1cc9f2f2-4ae3-4eec-99c4-9889fce0c406 None None] Network 30d0c468-ca40-4f41-a7a6-de8dc44194c4 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:26:12.226326 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a4a6bd31-7020-46a0-a76a-4032318d1fe8 service neutron] 10.222.0.31 "PUT /v2.0/ports/a0a1eab9-7a2d-4b73-9918-01919710bdbe HTTP/1.1" status: 200 len: 1092 time: 1.3216698 Dec 09 21:26:12.269410 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-b7f186b5-61b1-4fa4-a32a-4a60b76a4900 service neutron] 10.222.0.13 "GET /v2.0/networks/30d0c468-ca40-4f41-a7a6-de8dc44194c4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1894984 Dec 09 21:26:12.276285 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4a6bd31-7020-46a0-a76a-4032318d1fe8 service neutron] Pushing event updated for resources: {'Port': ['ID=a0a1eab9-7a2d-4b73-9918-01919710bdbe,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:12.306448 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port d421ed75-4068-4fe0-b0d2-b1800f25585a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d421ed75-4068-4fe0-b0d2-b1800f25585a,segment=NetworkSegment(62cd2cbb-d71c-4d79-8112-51e9e682f3f3),segment_id=62cd2cbb-d71c-4d79-8112-51e9e682f3f3)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:12.338312 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd3751f1-7dab-49ac-9e7f-dcd53dc9e5bb req-98fd7ddb-9b6a-4188-ac2e-e0fa73ec983e tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:12.344173 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38922) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:12.346047 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fd3751f1-7dab-49ac-9e7f-dcd53dc9e5bb req-98fd7ddb-9b6a-4188-ac2e-e0fa73ec983e tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/ports?device_id=9503e24d-9ce5-4566-8e69-df8da4219cec HTTP/1.1" status: 200 len: 950 time: 0.4265919 Dec 09 21:26:12.347970 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:12.399985 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77236651-608d-4929-b4f4-accf3c77a789 service neutron] Pushing event updated for resources: {'Port': ['ID=420d466e-c77f-433f-9763-037f0389654e,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:12.407215 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e361731-1601-48dc-b73e-067f3c56db22 req-efb25942-e092-4800-84d0-24c1ec5037f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:12.407522 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9622de54-755e-4dfc-a539-4a4e5b9889ec None None] Provisioning complete for port d421ed75-4068-4fe0-b0d2-b1800f25585a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:12.407726 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9622de54-755e-4dfc-a539-4a4e5b9889ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:12.412250 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6e361731-1601-48dc-b73e-067f3c56db22 req-efb25942-e092-4800-84d0-24c1ec5037f2 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=52eb00d38d4442158ed8579a84e900ca&device_id=1a86f14a-2802-4e38-b9dd-4568a02642fc HTTP/1.1" status: 200 len: 1095 time: 0.1275556 Dec 09 21:26:12.502966 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=d421ed75-4068-4fe0-b0d2-b1800f25585a,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:12.504358 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-36eb30bc-ad4f-4b06-8006-2c3fbe10d83c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=f1653df0a34f46d6911568893bd0799d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1571326 Dec 09 21:26:12.506309 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6e361731-1601-48dc-b73e-067f3c56db22 req-4f4b4871-0b8e-4339-8e70-6305264f7c63 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=a0a1eab9-7a2d-4b73-9918-01919710bdbe HTTP/1.1" status: 200 len: 217 time: 0.0795686 Dec 09 21:26:12.507160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38926) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:12.616611 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a4407784-c4b0-4b24-9b40-e3f57773d8c2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:12.632983 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38928) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:12.648788 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e361731-1601-48dc-b73e-067f3c56db22 req-43ed0bab-973d-48f5-b9f5-68d275d8442a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:12.650496 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6e361731-1601-48dc-b73e-067f3c56db22 req-43ed0bab-973d-48f5-b9f5-68d275d8442a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5b18bb60-11fe-4ddd-8fd3-bcb36985a134 HTTP/1.1" status: 200 len: 853 time: 0.1332829 Dec 09 21:26:12.678517 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a4407784-c4b0-4b24-9b40-e3f57773d8c2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:12.707950 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6e361731-1601-48dc-b73e-067f3c56db22 req-9439e2a3-7464-4728-8a6c-9f75be38a25e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=56b576e6-50b1-4d1e-a1c2-80bcf1883e68&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0458186 Dec 09 21:26:12.762028 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fd3751f1-7dab-49ac-9e7f-dcd53dc9e5bb req-7d05408a-00d5-4823-84df-5735256650c2 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/security-groups?id=c81de824-def8-4781-88c7-f240bf84e2af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4151142 Dec 09 21:26:12.787165 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b94c7549-00ab-42f3-b381-f9d5be18e60b admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=851eb4460eb14a8ab38ec00fdc320526&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1509399 Dec 09 21:26:12.793198 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-b155dcd5-fa34-41ed-bd09-e53b85034b5e service neutron] 10.222.0.13 "GET /v2.0/networks/30d0c468-ca40-4f41-a7a6-de8dc44194c4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5228090 Dec 09 21:26:12.793784 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38930) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:12.864757 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-6e361731-1601-48dc-b73e-067f3c56db22 req-77236651-608d-4929-b4f4-accf3c77a789 service neutron] Attempting to bind port 420d466e-c77f-433f-9763-037f0389654e on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:26:12.865438 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-6e361731-1601-48dc-b73e-067f3c56db22 req-77236651-608d-4929-b4f4-accf3c77a789 service neutron] Attempting to bind port 420d466e-c77f-433f-9763-037f0389654e by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'bada42e9-278b-46e3-bbc2-c2d37f00c32d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:26:12.865767 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e361731-1601-48dc-b73e-067f3c56db22 req-77236651-608d-4929-b4f4-accf3c77a789 service neutron] Attempting to bind port 420d466e-c77f-433f-9763-037f0389654e on network 56b576e6-50b1-4d1e-a1c2-80bcf1883e68 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:12.879356 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6e361731-1601-48dc-b73e-067f3c56db22 req-0f5beabe-0bee-43d0-b8c1-2fb5a85ccd95 service neutron] 10.222.0.31 "GET /v2.0/networks/56b576e6-50b1-4d1e-a1c2-80bcf1883e68?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1614354 Dec 09 21:26:12.883097 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a4407784-c4b0-4b24-9b40-e3f57773d8c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:12.885937 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a4407784-c4b0-4b24-9b40-e3f57773d8c2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:12.887239 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a4407784-c4b0-4b24-9b40-e3f57773d8c2 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/be3c8f6d-6fef-40aa-b386-123fe16acbed HTTP/1.1" status: 204 len: 168 time: 0.3770635 Dec 09 21:26:12.894412 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e361731-1601-48dc-b73e-067f3c56db22 req-77236651-608d-4929-b4f4-accf3c77a789 service neutron] Port 420d466e-c77f-433f-9763-037f0389654e on network 56b576e6-50b1-4d1e-a1c2-80bcf1883e68 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:26:12.895385 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e361731-1601-48dc-b73e-067f3c56db22 req-77236651-608d-4929-b4f4-accf3c77a789 service neutron] Attempting to bind port 420d466e-c77f-433f-9763-037f0389654e on network 56b576e6-50b1-4d1e-a1c2-80bcf1883e68 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:12.900281 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2a982287-a6c5-47df-923a-cbd3b1a3aaba admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:12.911719 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-566e6ca6-ac83-4350-a041-ba16a3bfafd9 None None] Provisioning complete for port d421ed75-4068-4fe0-b0d2-b1800f25585a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:12.912044 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-566e6ca6-ac83-4350-a041-ba16a3bfafd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:12.914911 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e361731-1601-48dc-b73e-067f3c56db22 req-77236651-608d-4929-b4f4-accf3c77a789 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 25, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:26:12.915378 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e361731-1601-48dc-b73e-067f3c56db22 req-77236651-608d-4929-b4f4-accf3c77a789 service neutron] Checking segment: {'id': 'bada42e9-278b-46e3-bbc2-c2d37f00c32d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:12.915916 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e361731-1601-48dc-b73e-067f3c56db22 req-77236651-608d-4929-b4f4-accf3c77a789 service neutron] Bound using segment: {'id': 'bada42e9-278b-46e3-bbc2-c2d37f00c32d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:26:12.916454 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-6e361731-1601-48dc-b73e-067f3c56db22 req-77236651-608d-4929-b4f4-accf3c77a789 service neutron] Bound port: 420d466e-c77f-433f-9763-037f0389654e, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bada42e9-278b-46e3-bbc2-c2d37f00c32d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:26:12.916968 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6e361731-1601-48dc-b73e-067f3c56db22 req-77236651-608d-4929-b4f4-accf3c77a789 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:12.919707 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4407784-c4b0-4b24-9b40-e3f57773d8c2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=be3c8f6d-6fef-40aa-b386-123fe16acbed,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:12.988236 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bf271730-e50d-45cc-bcad-ee2bb5c467f9 x-openstack-request-id: req-bf271730-e50d-45cc-bcad-ee2bb5c467f9 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:12.988590 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d3f455b1-1a56-4ded-ab82-e9ce51afbfde", "name": "network-vif-plugged", "status": "completed", "tag": "2958b0be-15e5-48e2-b87a-6ffefd9a7859", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:12.988847 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-bf271730-e50d-45cc-bcad-ee2bb5c467f9 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:12.989250 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd3f455b1-1a56-4ded-ab82-e9ce51afbfde', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2958b0be-15e5-48e2-b87a-6ffefd9a7859', 'code': 200} Dec 09 21:26:12.994972 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2a982287-a6c5-47df-923a-cbd3b1a3aaba admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:13.009675 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1ad36983-4549-4a03-a826-a31a08b98c98 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:26:13.094628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-6e361731-1601-48dc-b73e-067f3c56db22 req-77236651-608d-4929-b4f4-accf3c77a789 service neutron] For port 420d466e-c77f-433f-9763-037f0389654e, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:26:13.101120 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-6e361731-1601-48dc-b73e-067f3c56db22 req-77236651-608d-4929-b4f4-accf3c77a789 service neutron] For port 420d466e-c77f-433f-9763-037f0389654e, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=420d466e-c77f-433f-9763-037f0389654e,segment=NetworkSegment(bada42e9-278b-46e3-bbc2-c2d37f00c32d),segment_id=bada42e9-278b-46e3-bbc2-c2d37f00c32d)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:26:13.109830 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6e361731-1601-48dc-b73e-067f3c56db22 req-77236651-608d-4929-b4f4-accf3c77a789 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:13.193319 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75977cbb-af9a-42a1-a453-d16ce9f79da5 req-6b38310f-6a61-4c2e-8d45-9903318065d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:13.194965 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-75977cbb-af9a-42a1-a453-d16ce9f79da5 req-6b38310f-6a61-4c2e-8d45-9903318065d4 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=d3f455b1-1a56-4ded-ab82-e9ce51afbfde HTTP/1.1" status: 200 len: 1102 time: 0.1691170 Dec 09 21:26:13.197594 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6e361731-1601-48dc-b73e-067f3c56db22 req-91847d31-fa16-4d3c-9334-03fcfad44433 service neutron] 10.222.0.31 "GET /v2.0/networks/56b576e6-50b1-4d1e-a1c2-80bcf1883e68?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3090563 Dec 09 21:26:13.273749 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2a982287-a6c5-47df-923a-cbd3b1a3aaba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:13.280071 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2a982287-a6c5-47df-923a-cbd3b1a3aaba admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:13.282683 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2a982287-a6c5-47df-923a-cbd3b1a3aaba admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/a235b45a-06c4-4ee6-bb6e-606b9200bc9d HTTP/1.1" status: 204 len: 168 time: 0.4848552 Dec 09 21:26:13.287224 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e361731-1601-48dc-b73e-067f3c56db22 req-77236651-608d-4929-b4f4-accf3c77a789 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:13.288199 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6e361731-1601-48dc-b73e-067f3c56db22 req-77236651-608d-4929-b4f4-accf3c77a789 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:13.290007 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e361731-1601-48dc-b73e-067f3c56db22 req-77236651-608d-4929-b4f4-accf3c77a789 service neutron] 10.222.0.31 "PUT /v2.0/ports/420d466e-c77f-433f-9763-037f0389654e HTTP/1.1" status: 200 len: 1093 time: 2.4772339 Dec 09 21:26:13.299678 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '45c77ac9-72d0-4458-b992-e48fbc0c9adb', 'tag': '420d466e-c77f-433f-9763-037f0389654e'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:13.303075 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-45b22656-ed7c-4185-b2af-29a243a10582" -d '{"events": [{"name": "network-changed", "server_uuid": "45c77ac9-72d0-4458-b992-e48fbc0c9adb", "tag": "420d466e-c77f-433f-9763-037f0389654e"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:13.318160 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-75977cbb-af9a-42a1-a453-d16ce9f79da5 req-2d495601-41a8-4f0e-8eca-2104339ab1ab service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1114433 Dec 09 21:26:13.319197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1a86f14a-2802-4e38-b9dd-4568a02642fc', 'tag': 'a0a1eab9-7a2d-4b73-9918-01919710bdbe'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:13.325735 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-185d0a6d-87db-489a-ab7f-921b1812093a" -d '{"events": [{"name": "network-changed", "server_uuid": "1a86f14a-2802-4e38-b9dd-4568a02642fc", "tag": "a0a1eab9-7a2d-4b73-9918-01919710bdbe"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:13.355368 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-890efd03-471c-4aad-8afc-9f6360a77051 req-172f4c4e-4426-48fd-a1e2-51a76807f7b5 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:13.364006 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-890efd03-471c-4aad-8afc-9f6360a77051 req-172f4c4e-4426-48fd-a1e2-51a76807f7b5 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.2120280 Dec 09 21:26:13.405532 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 1ad36983-4549-4a03-a826-a31a08b98c98, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1ad36983-4549-4a03-a826-a31a08b98c98,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:13.418872 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '1ad36983-4549-4a03-a826-a31a08b98c98', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '1ad36983-4549-4a03-a826-a31a08b98c98', 'mac_address': 'fa:16:3e:ae:0e:32', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.253'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:26:13.423051 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a982287-a6c5-47df-923a-cbd3b1a3aaba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a235b45a-06c4-4ee6-bb6e-606b9200bc9d,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:13.442068 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e27069c-5dec-4ff7-8dd8-9714e0ab18e1 req-b0101abd-e67d-4135-8b72-f3b890c75a1b tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:13.450349 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e27069c-5dec-4ff7-8dd8-9714e0ab18e1 req-b0101abd-e67d-4135-8b72-f3b890c75a1b tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=d3f455b1-1a56-4ded-ab82-e9ce51afbfde HTTP/1.1" status: 200 len: 950 time: 0.2774901 Dec 09 21:26:13.471547 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77236651-608d-4929-b4f4-accf3c77a789 service neutron] Pushing event updated for resources: {'Port': ['ID=420d466e-c77f-433f-9763-037f0389654e,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:13.481428 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:13.505734 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1ad36983-4549-4a03-a826-a31a08b98c98 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:13.552484 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 1ad36983-4549-4a03-a826-a31a08b98c98, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1ad36983-4549-4a03-a826-a31a08b98c98,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:13.571482 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:13.597504 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e27069c-5dec-4ff7-8dd8-9714e0ab18e1 req-f1c17c45-4070-45f8-a444-5008ab106012 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1460452 Dec 09 21:26:13.616414 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e361731-1601-48dc-b73e-067f3c56db22 req-44e19d36-7d7a-45be-b00e-29d237e0371d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:13.618040 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6e361731-1601-48dc-b73e-067f3c56db22 req-44e19d36-7d7a-45be-b00e-29d237e0371d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=52eb00d38d4442158ed8579a84e900ca&device_id=45c77ac9-72d0-4458-b992-e48fbc0c9adb HTTP/1.1" status: 200 len: 1096 time: 0.1067739 Dec 09 21:26:13.622155 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-890efd03-471c-4aad-8afc-9f6360a77051 req-a69378f7-09ab-4066-ad6e-4f2e82ff5a9e tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2438073 Dec 09 21:26:13.729228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=1ad36983-4549-4a03-a826-a31a08b98c98,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:13.745265 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6e361731-1601-48dc-b73e-067f3c56db22 req-fd9bd3b1-7f55-40f4-9aa1-8dc2a62a4cf6 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=420d466e-c77f-433f-9763-037f0389654e HTTP/1.1" status: 200 len: 217 time: 0.1092522 Dec 09 21:26:13.755676 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-134f0769-a5cf-4714-8fee-bbfed42621ec req-04270138-d090-4bba-b1dd-cec02710ac3e tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=a17d0675-93b1-4ffe-a686-311f32edd826 HTTP/1.1" status: 200 len: 210 time: 0.0462775 Dec 09 21:26:13.860117 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d421ed75-4068-4fe0-b0d2-b1800f25585a up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:26:13.866392 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['1ad36983-4549-4a03-a826-a31a08b98c98'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:13.874341 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa1da171-5309-4900-8d4d-c9a321182c8b req-e64337c7-fce0-4a9d-98b8-e254f16918ee tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:13.884535 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fa1da171-5309-4900-8d4d-c9a321182c8b req-e64337c7-fce0-4a9d-98b8-e254f16918ee tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a86f14a-2802-4e38-b9dd-4568a02642fc HTTP/1.1" status: 200 len: 943 time: 0.1318440 Dec 09 21:26:13.895534 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a97e2fe5-a96f-4f45-a5d6-ebcc00c66de1 x-openstack-request-id: req-a97e2fe5-a96f-4f45-a5d6-ebcc00c66de1 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:13.897747 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "45c77ac9-72d0-4458-b992-e48fbc0c9adb", "tag": "420d466e-c77f-433f-9763-037f0389654e", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:13.898734 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a97e2fe5-a96f-4f45-a5d6-ebcc00c66de1 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:13.899224 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '45c77ac9-72d0-4458-b992-e48fbc0c9adb', 'tag': '420d466e-c77f-433f-9763-037f0389654e', 'status': 'completed', 'code': 200} Dec 09 21:26:13.925651 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e361731-1601-48dc-b73e-067f3c56db22 req-7d27e6d8-afad-4c4b-b407-1bcee9cf3fc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:13.927072 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6e361731-1601-48dc-b73e-067f3c56db22 req-7d27e6d8-afad-4c4b-b407-1bcee9cf3fc4 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5b18bb60-11fe-4ddd-8fd3-bcb36985a134 HTTP/1.1" status: 200 len: 853 time: 0.1739640 Dec 09 21:26:13.964920 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-86eae8bf-baa1-4987-8d43-c70deac842c2 x-openstack-request-id: req-86eae8bf-baa1-4987-8d43-c70deac842c2 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:13.965212 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1a86f14a-2802-4e38-b9dd-4568a02642fc", "tag": "a0a1eab9-7a2d-4b73-9918-01919710bdbe", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:13.965552 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-86eae8bf-baa1-4987-8d43-c70deac842c2 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:13.966094 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1a86f14a-2802-4e38-b9dd-4568a02642fc', 'tag': 'a0a1eab9-7a2d-4b73-9918-01919710bdbe', 'status': 'completed', 'code': 200} Dec 09 21:26:13.988076 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fa1da171-5309-4900-8d4d-c9a321182c8b req-6242ac1b-1be4-41c6-a05e-f0de0ff3b1ef tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1025138 Dec 09 21:26:14.010409 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6e361731-1601-48dc-b73e-067f3c56db22 req-95fbccc9-8a3e-4e8b-a150-99afee83c466 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=56b576e6-50b1-4d1e-a1c2-80bcf1883e68&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0725431 Dec 09 21:26:14.126377 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a1254ae9-f8eb-4905-8b87-1e69a4f738ab service neutron] 10.222.0.31 "GET /v2.0/networks/56b576e6-50b1-4d1e-a1c2-80bcf1883e68?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1051984 Dec 09 21:26:14.154739 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port d421ed75-4068-4fe0-b0d2-b1800f25585a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:14.155347 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-185d0a6d-87db-489a-ab7f-921b1812093a req-02eb0e37-2893-4c5d-aec6-73135ea64187 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:14.156066 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:14.156525 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-185d0a6d-87db-489a-ab7f-921b1812093a req-02eb0e37-2893-4c5d-aec6-73135ea64187 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=52eb00d38d4442158ed8579a84e900ca&device_id=1a86f14a-2802-4e38-b9dd-4568a02642fc HTTP/1.1" status: 200 len: 1095 time: 0.1674688 Dec 09 21:26:14.171486 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a01be90-7afe-4ed7-92ad-52dd4fc6b9a6 req-a37aaa1a-5a7e-4bcf-967a-88e3d6adfa46 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:14.173041 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a01be90-7afe-4ed7-92ad-52dd4fc6b9a6 req-a37aaa1a-5a7e-4bcf-967a-88e3d6adfa46 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/ports?device_id=9503e24d-9ce5-4566-8e69-df8da4219cec HTTP/1.1" status: 200 len: 950 time: 0.1106591 Dec 09 21:26:14.304874 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a01be90-7afe-4ed7-92ad-52dd4fc6b9a6 req-81bc5786-cc41-4abd-9d9c-1cc2fab62c36 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/security-groups?id=c81de824-def8-4781-88c7-f240bf84e2af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1220772 Dec 09 21:26:14.327926 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6e361731-1601-48dc-b73e-067f3c56db22 req-a72f2b52-5cd6-443d-8270-79adc6b1c988 service neutron] 10.222.0.31 "GET /v2.0/networks/56b576e6-50b1-4d1e-a1c2-80bcf1883e68?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1935408 Dec 09 21:26:14.341141 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-185d0a6d-87db-489a-ab7f-921b1812093a req-95354433-4de5-4ec8-8646-a21191a93704 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:14.344237 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-185d0a6d-87db-489a-ab7f-921b1812093a req-95354433-4de5-4ec8-8646-a21191a93704 service neutron] 10.222.0.31 "GET /v2.0/networks?id=56b576e6-50b1-4d1e-a1c2-80bcf1883e68 HTTP/1.1" status: 200 len: 914 time: 0.1701026 Dec 09 21:26:14.397226 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-185d0a6d-87db-489a-ab7f-921b1812093a req-23b35fe5-e786-402a-b3de-112287823ef9 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=a0a1eab9-7a2d-4b73-9918-01919710bdbe HTTP/1.1" status: 200 len: 217 time: 0.0422733 Dec 09 21:26:14.452481 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45b22656-ed7c-4185-b2af-29a243a10582 req-e326cb74-a945-47cb-bc25-590bf23de49e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:14.454420 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-45b22656-ed7c-4185-b2af-29a243a10582 req-e326cb74-a945-47cb-bc25-590bf23de49e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=52eb00d38d4442158ed8579a84e900ca&device_id=45c77ac9-72d0-4458-b992-e48fbc0c9adb HTTP/1.1" status: 200 len: 1096 time: 0.0610731 Dec 09 21:26:14.483875 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-185d0a6d-87db-489a-ab7f-921b1812093a req-5e403fbf-ffdf-4a45-966a-ac5872a4bef3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:14.485148 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-185d0a6d-87db-489a-ab7f-921b1812093a req-5e403fbf-ffdf-4a45-966a-ac5872a4bef3 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5b18bb60-11fe-4ddd-8fd3-bcb36985a134 HTTP/1.1" status: 200 len: 853 time: 0.0645874 Dec 09 21:26:14.485637 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38990) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:14.565712 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-185d0a6d-87db-489a-ab7f-921b1812093a req-e960ac13-ad78-4c04-ac46-616d737141a8 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=56b576e6-50b1-4d1e-a1c2-80bcf1883e68&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0544846 Dec 09 21:26:14.732450 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45b22656-ed7c-4185-b2af-29a243a10582 req-66f3e056-1bf5-4d79-9c4c-6a6ed13bc829 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:14.733947 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-45b22656-ed7c-4185-b2af-29a243a10582 req-66f3e056-1bf5-4d79-9c4c-6a6ed13bc829 service neutron] 10.222.0.31 "GET /v2.0/networks?id=56b576e6-50b1-4d1e-a1c2-80bcf1883e68 HTTP/1.1" status: 200 len: 914 time: 0.2638774 Dec 09 21:26:14.791487 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-45b22656-ed7c-4185-b2af-29a243a10582 req-276454d6-1dcc-4781-ba3a-5e7ff296a5e2 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=420d466e-c77f-433f-9763-037f0389654e HTTP/1.1" status: 200 len: 217 time: 0.0468316 Dec 09 21:26:14.798573 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-c550864d-a720-456c-a2a6-b48d403b80f8 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:14.804497 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-c550864d-a720-456c-a2a6-b48d403b80f8 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:14.806096 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-c550864d-a720-456c-a2a6-b48d403b80f8 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.31 "GET /v2.0/networks?id=b10aba5b-a802-488f-b187-37195bb0b8ca&id=30d0c468-ca40-4f41-a7a6-de8dc44194c4 HTTP/1.1" status: 200 len: 1392 time: 0.2802789 Dec 09 21:26:14.843663 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d4952ea-3708-4aa0-b20a-ff4609c8cae8 req-c77bdad3-bfdf-4e46-82ce-a6c3fbbb32e4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:14.843862 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-5bb5b9c3-b546-401e-8a83-9799512556d3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Request body: {'port': {'device_id': 'a17d0675-93b1-4ffe-a686-311f32edd826', 'network_id': 'b10aba5b-a802-488f-b187-37195bb0b8ca', 'admin_state_up': True, 'tenant_id': '73812a0c336d4768b029fd6459a1ae9e'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:14.845172 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d4952ea-3708-4aa0-b20a-ff4609c8cae8 req-c77bdad3-bfdf-4e46-82ce-a6c3fbbb32e4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.1062737 Dec 09 21:26:14.856462 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed4b7383-e5a6-4c24-b9d2-ed88e445d566 req-c35aea94-77bc-4936-be70-169e8ef6997d tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:14.857683 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ed4b7383-e5a6-4c24-b9d2-ed88e445d566 req-c35aea94-77bc-4936-be70-169e8ef6997d tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=d3f455b1-1a56-4ded-ab82-e9ce51afbfde HTTP/1.1" status: 200 len: 950 time: 0.1164150 Dec 09 21:26:14.860882 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-d2734dd6-afcd-49d1-92e7-f9cff4933af2 admin admin] Request body: {'network': {'name': 'tempest-InstanceActionsTestJSON-1991215833-network', 'tenant_id': 'a9b3d91742274db295ecdc3138fae25f'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:14.872964 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-185d0a6d-87db-489a-ab7f-921b1812093a req-1c865cc0-f061-48cc-9db2-a99409fbc265 service neutron] 10.222.0.31 "GET /v2.0/networks/56b576e6-50b1-4d1e-a1c2-80bcf1883e68?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2909262 Dec 09 21:26:14.908965 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45b22656-ed7c-4185-b2af-29a243a10582 req-8f696a86-32b9-4a51-b342-d6124a4083c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:14.910429 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-45b22656-ed7c-4185-b2af-29a243a10582 req-8f696a86-32b9-4a51-b342-d6124a4083c1 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=5b18bb60-11fe-4ddd-8fd3-bcb36985a134 HTTP/1.1" status: 200 len: 853 time: 0.1034558 Dec 09 21:26:14.948257 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-45b22656-ed7c-4185-b2af-29a243a10582 req-06f1b28f-9ae0-4733-8958-e1b81aaa8218 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=56b576e6-50b1-4d1e-a1c2-80bcf1883e68&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0304449 Dec 09 21:26:14.990659 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9503e24d-9ce5-4566-8e69-df8da4219cec', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f4a163f1-05a1-4823-866b-b41a21ed72be'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:14.993027 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ad26aab0-c4eb-4b97-84cd-d557d8de9cb6" -d '{"events": [{"server_uuid": "9503e24d-9ce5-4566-8e69-df8da4219cec", "name": "network-vif-plugged", "status": "completed", "tag": "f4a163f1-05a1-4823-866b-b41a21ed72be"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:14.996191 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d2734dd6-afcd-49d1-92e7-f9cff4933af2 admin admin] Made reservation on behalf of a9b3d91742274db295ecdc3138fae25f for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:14.998935 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2734dd6-afcd-49d1-92e7-f9cff4933af2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:15.023940 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d4952ea-3708-4aa0-b20a-ff4609c8cae8 req-838d8e43-df6b-4b77-b9fd-22d3f6ab3568 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1583655 Dec 09 21:26:15.026290 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2734dd6-afcd-49d1-92e7-f9cff4933af2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:15.032684 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ed4b7383-e5a6-4c24-b9d2-ed88e445d566 req-a7a2ad42-c198-4ec4-be1a-3ffeed25d9d8 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1652532 Dec 09 21:26:15.049903 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-5bb5b9c3-b546-401e-8a83-9799512556d3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Made reservation on behalf of 73812a0c336d4768b029fd6459a1ae9e for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:15.053713 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-5bb5b9c3-b546-401e-8a83-9799512556d3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:15.068221 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-185d0a6d-87db-489a-ab7f-921b1812093a req-157e5994-1a84-424a-9d7a-ce5095bfd3f0 service neutron] 10.222.0.31 "GET /v2.0/networks/56b576e6-50b1-4d1e-a1c2-80bcf1883e68?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1853025 Dec 09 21:26:15.078388 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-45b22656-ed7c-4185-b2af-29a243a10582 req-e8cf9f3f-68da-4c88-87ba-26a08e26af93 service neutron] 10.222.0.31 "GET /v2.0/networks/56b576e6-50b1-4d1e-a1c2-80bcf1883e68?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1161859 Dec 09 21:26:15.152112 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67725e27-039e-4c0c-b93a-f1c4247ac221 req-6c355ffd-43b4-4e6a-99ea-10bd00832907 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=a17d0675-93b1-4ffe-a686-311f32edd826 HTTP/1.1" status: 200 len: 210 time: 0.0378318 Dec 09 21:26:15.193319 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2734dd6-afcd-49d1-92e7-f9cff4933af2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:15.199211 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2734dd6-afcd-49d1-92e7-f9cff4933af2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:15.228243 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c720bf8e-03b7-4465-a793-13f3ae582a14 x-openstack-request-id: req-c720bf8e-03b7-4465-a793-13f3ae582a14 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:15.228795 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9503e24d-9ce5-4566-8e69-df8da4219cec", "name": "network-vif-plugged", "status": "completed", "tag": "f4a163f1-05a1-4823-866b-b41a21ed72be", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:15.228795 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c720bf8e-03b7-4465-a793-13f3ae582a14 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:15.230154 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9503e24d-9ce5-4566-8e69-df8da4219cec', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f4a163f1-05a1-4823-866b-b41a21ed72be', 'code': 200} Dec 09 21:26:15.241017 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d2734dd6-afcd-49d1-92e7-f9cff4933af2 admin admin] vlan segment allocate from pool success with {'vlan_id': 107, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:26:15.258177 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2734dd6-afcd-49d1-92e7-f9cff4933af2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c460cbfc-5960-42ff-abb9-4a137fb9cba6,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:15.263358 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-45b22656-ed7c-4185-b2af-29a243a10582 req-5e8891e8-e8b8-411a-adca-f3dba9143681 service neutron] 10.222.0.31 "GET /v2.0/networks/56b576e6-50b1-4d1e-a1c2-80bcf1883e68?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1733203 Dec 09 21:26:15.264238 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2734dd6-afcd-49d1-92e7-f9cff4933af2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:15.264735 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-d2734dd6-afcd-49d1-92e7-f9cff4933af2 admin admin] Added segment b091c3fa-97be-41c0-9252-b65227a09bde of type vlan for network 5246b845-7de3-4759-8deb-13c3871588f0 Dec 09 21:26:15.278285 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-5bb5b9c3-b546-401e-8a83-9799512556d3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Allocated IP 19.80.0.245 (b10aba5b-a802-488f-b187-37195bb0b8ca/67c09b0c-f53c-4918-9d79-b5f265f8b0cb/5dd56541-48db-4dce-a0d7-6624015c8553) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:26:15.388133 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2734dd6-afcd-49d1-92e7-f9cff4933af2 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:15.450783 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-655aa62a-d560-406a-bbee-6aa539e21028 req-c76ce52e-c5db-495e-b5a6-a58f40617a18 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:15.452284 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-655aa62a-d560-406a-bbee-6aa539e21028 req-c76ce52e-c5db-495e-b5a6-a58f40617a18 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=9503e24d-9ce5-4566-8e69-df8da4219cec HTTP/1.1" status: 200 len: 1102 time: 0.0882490 Dec 09 21:26:15.452638 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d79f8208-7735-4aa6-b255-50b5ffc716a7 req-d4d6d19e-db1d-422d-878c-ed5c53fc0763 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:15.454163 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d79f8208-7735-4aa6-b255-50b5ffc716a7 req-d4d6d19e-db1d-422d-878c-ed5c53fc0763 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a86f14a-2802-4e38-b9dd-4568a02642fc HTTP/1.1" status: 200 len: 943 time: 0.1227515 Dec 09 21:26:15.454837 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2734dd6-afcd-49d1-92e7-f9cff4933af2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:15.455735 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d2734dd6-afcd-49d1-92e7-f9cff4933af2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:15.456322 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2734dd6-afcd-49d1-92e7-f9cff4933af2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:15.495012 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-5bb5b9c3-b546-401e-8a83-9799512556d3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:15.515193 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea76777d-762a-4bf1-9847-87ddad02973c req-83da21d8-3349-4ace-b11d-8022300cc187 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:15.517109 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea76777d-762a-4bf1-9847-87ddad02973c req-83da21d8-3349-4ace-b11d-8022300cc187 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=2cfba12a-761e-445b-bf14-a19d38aeeeb0 HTTP/1.1" status: 200 len: 949 time: 0.1356561 Dec 09 21:26:15.523144 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-655aa62a-d560-406a-bbee-6aa539e21028 req-fec88c1b-b788-4e26-ac24-1a3cae4b5bce service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=c81de824-def8-4781-88c7-f240bf84e2af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0619955 Dec 09 21:26:15.532139 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d2734dd6-afcd-49d1-92e7-f9cff4933af2 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 1.0455036 Dec 09 21:26:15.535569 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39022) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:15.540246 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-42decd60-0921-4b9c-9a9d-337e1153d2c1 admin admin] Request body: {'subnet': {'network_id': '5246b845-7de3-4759-8deb-13c3871588f0', 'cidr': '172.20.0.0/28', 'name': 'tempest-InstanceActionsTestJSON-1991215833-subnet', 'tenant_id': 'a9b3d91742274db295ecdc3138fae25f', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:15.561289 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-5bb5b9c3-b546-401e-8a83-9799512556d3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:15.572895 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-42decd60-0921-4b9c-9a9d-337e1153d2c1 admin admin] Made reservation on behalf of a9b3d91742274db295ecdc3138fae25f for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:15.575617 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42decd60-0921-4b9c-9a9d-337e1153d2c1 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:15.605608 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2734dd6-afcd-49d1-92e7-f9cff4933af2 admin admin] Pushing event updated for resources: {'Network': ['ID=5246b845-7de3-4759-8deb-13c3871588f0,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:15.616733 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 5246b845-7de3-4759-8deb-13c3871588f0 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:26:15.627114 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-5bb5b9c3-b546-401e-8a83-9799512556d3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Network b10aba5b-a802-488f-b187-37195bb0b8ca is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:26:15.634946 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d79f8208-7735-4aa6-b255-50b5ffc716a7 req-fa539ce2-9939-4e85-8b68-b8708a2afdc5 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1698751 Dec 09 21:26:15.648985 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea76777d-762a-4bf1-9847-87ddad02973c req-814df030-ef2b-4ced-9831-2766762c2177 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1118064 Dec 09 21:26:15.665531 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-5bb5b9c3-b546-401e-8a83-9799512556d3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:15.671140 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-5bb5b9c3-b546-401e-8a83-9799512556d3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:26:15.673776 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bb5b9c3-b546-401e-8a83-9799512556d3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event updated for resources: {'Port': ['ID=5dd56541-48db-4dce-a0d7-6624015c8553,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:15.748578 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-5bb5b9c3-b546-401e-8a83-9799512556d3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:15.749246 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-5bb5b9c3-b546-401e-8a83-9799512556d3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:15.791532 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-5bb5b9c3-b546-401e-8a83-9799512556d3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9516420 Dec 09 21:26:15.816910 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-13c6b68e-6f9b-41b3-8bb4-de06ff9071c8 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Request body: {'port': {'device_id': 'a17d0675-93b1-4ffe-a686-311f32edd826', 'network_id': '30d0c468-ca40-4f41-a7a6-de8dc44194c4', 'admin_state_up': True, 'tenant_id': '73812a0c336d4768b029fd6459a1ae9e'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:15.885725 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1cfeea1-493e-43fd-814d-6aca940db143 req-b03673c8-80c9-4bd7-9b83-7c62fd8f7446 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:15.894386 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f1cfeea1-493e-43fd-814d-6aca940db143 req-b03673c8-80c9-4bd7-9b83-7c62fd8f7446 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/ports?device_id=9503e24d-9ce5-4566-8e69-df8da4219cec HTTP/1.1" status: 200 len: 950 time: 0.0784042 Dec 09 21:26:15.951988 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f1cfeea1-493e-43fd-814d-6aca940db143 req-125c2f61-2323-4295-bd25-79866f17296c tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/security-groups?id=c81de824-def8-4781-88c7-f240bf84e2af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0566242 Dec 09 21:26:16.004407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-83504c0d-7409-4e29-b6c0-65efc711244c None None] Provisioning complete for port 5dd56541-48db-4dce-a0d7-6624015c8553 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:16.005331 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-83504c0d-7409-4e29-b6c0-65efc711244c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:16.044189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-83504c0d-7409-4e29-b6c0-65efc711244c None None] Port 5dd56541-48db-4dce-a0d7-6624015c8553 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:26:16.162792 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd1e54f4-ac5d-430d-bce0-5b6216104125 req-127837c3-0590-42d2-86b2-8069148c098c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:16.164374 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fd1e54f4-ac5d-430d-bce0-5b6216104125 req-127837c3-0590-42d2-86b2-8069148c098c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.0551243 Dec 09 21:26:16.175785 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39058) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:16.234432 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fd1e54f4-ac5d-430d-bce0-5b6216104125 req-c4a3340e-bee1-4517-8757-67cac009efd2 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0599427 Dec 09 21:26:16.288857 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42decd60-0921-4b9c-9a9d-337e1153d2c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:16.297824 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76113004-aeff-4510-bbb7-c2c65a47ef69 req-50814ab5-ff49-4ffd-80cc-7397ec4fe523 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:16.299469 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-76113004-aeff-4510-bbb7-c2c65a47ef69 req-50814ab5-ff49-4ffd-80cc-7397ec4fe523 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=a17d0675-93b1-4ffe-a686-311f32edd826 HTTP/1.1" status: 200 len: 932 time: 0.0569134 Dec 09 21:26:16.338778 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-307ab516-d482-4485-8944-3c832db5269e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:16.367702 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42decd60-0921-4b9c-9a9d-337e1153d2c1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ff1bf4b1-2f03-42e0-ab07-8a818f9a1ba2,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:16.371531 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-13c6b68e-6f9b-41b3-8bb4-de06ff9071c8 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Made reservation on behalf of 73812a0c336d4768b029fd6459a1ae9e for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:16.374877 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-76113004-aeff-4510-bbb7-c2c65a47ef69 req-6a692042-c9a3-4b2f-9245-df526a600058 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0678184 Dec 09 21:26:16.375371 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-13c6b68e-6f9b-41b3-8bb4-de06ff9071c8 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:16.389775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42decd60-0921-4b9c-9a9d-337e1153d2c1 admin admin] Checking segment: {'id': 'b091c3fa-97be-41c0-9252-b65227a09bde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '5246b845-7de3-4759-8deb-13c3871588f0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:16.390146 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-42decd60-0921-4b9c-9a9d-337e1153d2c1 admin admin] Network hostable DHCP agents. Network: 5246b845-7de3-4759-8deb-13c3871588f0, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:26:16.446304 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-307ab516-d482-4485-8944-3c832db5269e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:16.448957 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-42decd60-0921-4b9c-9a9d-337e1153d2c1 admin admin] Network 5246b845-7de3-4759-8deb-13c3871588f0 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:26:16.450136 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-307ab516-d482-4485-8944-3c832db5269e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:16.466256 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-42decd60-0921-4b9c-9a9d-337e1153d2c1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 5246b845-7de3-4759-8deb-13c3871588f0) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:16.473814 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42decd60-0921-4b9c-9a9d-337e1153d2c1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:16.474415 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42decd60-0921-4b9c-9a9d-337e1153d2c1 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:16.476607 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9834aba1-d11a-4585-a7d6-89fe582b2fac None None] Network 5246b845-7de3-4759-8deb-13c3871588f0 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:26:16.494746 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-307ab516-d482-4485-8944-3c832db5269e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=04bb46d8-5bb1-4547-8611-b47e61047e0f,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:16.500433 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-307ab516-d482-4485-8944-3c832db5269e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ac5bbe1c78fa4ad7b9bc417c2b8bb6e1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3237081 Dec 09 21:26:16.503068 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39064) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:16.524307 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-42decd60-0921-4b9c-9a9d-337e1153d2c1 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.9876852 Dec 09 21:26:16.539824 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-13c6b68e-6f9b-41b3-8bb4-de06ff9071c8 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Allocated IP 19.86.0.42 (30d0c468-ca40-4f41-a7a6-de8dc44194c4/1ae814b0-bedd-4a6b-96ff-e062ac849b56/3eea4303-cbf9-4dd6-8eaa-de772b7d85f8) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:26:16.568719 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f778951b-a8a9-4c07-87b4-af04c83063cf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:16.591664 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f778951b-a8a9-4c07-87b4-af04c83063cf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:16.607616 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-40f56fd3-5f0e-4fdd-a457-130ec99c6924 None None] Network 5246b845-7de3-4759-8deb-13c3871588f0 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:26:16.667027 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f778951b-a8a9-4c07-87b4-af04c83063cf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:16.673539 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f778951b-a8a9-4c07-87b4-af04c83063cf admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:16.674754 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f778951b-a8a9-4c07-87b4-af04c83063cf admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/04bb46d8-5bb1-4547-8611-b47e61047e0f HTTP/1.1" status: 204 len: 168 time: 0.1707027 Dec 09 21:26:16.723377 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f778951b-a8a9-4c07-87b4-af04c83063cf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=04bb46d8-5bb1-4547-8611-b47e61047e0f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:16.801886 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-13c6b68e-6f9b-41b3-8bb4-de06ff9071c8 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:16.849460 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-13c6b68e-6f9b-41b3-8bb4-de06ff9071c8 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:16.873315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd1aedbe-8cf1-4615-9ca2-65e3eca20d1d req-2fc9720d-1d40-4a20-89da-acae8b0350d0 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:16.875120 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd1aedbe-8cf1-4615-9ca2-65e3eca20d1d req-2fc9720d-1d40-4a20-89da-acae8b0350d0 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a86f14a-2802-4e38-b9dd-4568a02642fc HTTP/1.1" status: 200 len: 943 time: 0.0692546 Dec 09 21:26:16.916621 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-13c6b68e-6f9b-41b3-8bb4-de06ff9071c8 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Network 30d0c468-ca40-4f41-a7a6-de8dc44194c4 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:26:16.920909 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-13c6b68e-6f9b-41b3-8bb4-de06ff9071c8 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:16.923642 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13c6b68e-6f9b-41b3-8bb4-de06ff9071c8 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event updated for resources: {'Port': ['ID=3eea4303-cbf9-4dd6-8eaa-de772b7d85f8,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:16.933555 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-13c6b68e-6f9b-41b3-8bb4-de06ff9071c8 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:26:16.966136 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44516b09-f68d-4dfd-bc19-fe3261441b10 req-ab03b5c0-9f1c-448c-b22a-bbb3590fa6de tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:16.968122 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44516b09-f68d-4dfd-bc19-fe3261441b10 req-ab03b5c0-9f1c-448c-b22a-bbb3590fa6de tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=2cfba12a-761e-445b-bf14-a19d38aeeeb0 HTTP/1.1" status: 200 len: 949 time: 0.0919797 Dec 09 21:26:16.997874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-13c6b68e-6f9b-41b3-8bb4-de06ff9071c8 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:16.998282 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-13c6b68e-6f9b-41b3-8bb4-de06ff9071c8 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:17.006674 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 420d466e-c77f-433f-9763-037f0389654e details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:26:17.008911 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1ad36983-4549-4a03-a826-a31a08b98c98 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:26:17.019088 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd1aedbe-8cf1-4615-9ca2-65e3eca20d1d req-f84997a9-2ad0-4bbe-840b-581d7b3df12f tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1093338 Dec 09 21:26:17.052782 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-13c6b68e-6f9b-41b3-8bb4-de06ff9071c8 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2498634 Dec 09 21:26:17.074531 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-823bc624-7ab6-4e71-a469-a45949b7f71e service neutron] Request body: {'port': {'device_id': 'a17d0675-93b1-4ffe-a686-311f32edd826', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:17.080072 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44516b09-f68d-4dfd-bc19-fe3261441b10 req-e2746d02-f112-4320-b058-43bea27eefb8 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1044943 Dec 09 21:26:17.159974 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-823bc624-7ab6-4e71-a469-a45949b7f71e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:17.283081 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 420d466e-c77f-433f-9763-037f0389654e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=420d466e-c77f-433f-9763-037f0389654e,segment=NetworkSegment(bada42e9-278b-46e3-bbc2-c2d37f00c32d),segment_id=bada42e9-278b-46e3-bbc2-c2d37f00c32d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:17.304553 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '420d466e-c77f-433f-9763-037f0389654e', 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68', 'port_id': '420d466e-c77f-433f-9763-037f0389654e', 'mac_address': 'fa:16:3e:0a:a2:f4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5b18bb60-11fe-4ddd-8fd3-bcb36985a134', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:26:17.345146 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 1ad36983-4549-4a03-a826-a31a08b98c98 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:26:17.349651 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-582bcad9-ad87-445e-98ed-de50ab4a9870 None None] Provisioning complete for port 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:17.350010 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-582bcad9-ad87-445e-98ed-de50ab4a9870 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:17.354289 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 1ad36983-4549-4a03-a826-a31a08b98c98 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:17.354649 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:17.361017 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c77a5a2-6234-4304-bd2f-2e9c292e11f3 req-eee914c8-db7f-4b1e-a1bd-625d8f1b9d24 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:17.373991 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7c77a5a2-6234-4304-bd2f-2e9c292e11f3 req-eee914c8-db7f-4b1e-a1bd-625d8f1b9d24 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/ports?device_id=9503e24d-9ce5-4566-8e69-df8da4219cec HTTP/1.1" status: 200 len: 950 time: 0.0969281 Dec 09 21:26:17.410774 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:17.433240 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7c77a5a2-6234-4304-bd2f-2e9c292e11f3 req-d66dcf2e-9a13-473c-a18f-34564797e97a tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/security-groups?id=c81de824-def8-4781-88c7-f240bf84e2af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0583317 Dec 09 21:26:17.439112 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-582bcad9-ad87-445e-98ed-de50ab4a9870 None None] Port 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:26:17.442209 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 420d466e-c77f-433f-9763-037f0389654e {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:17.471461 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 420d466e-c77f-433f-9763-037f0389654e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=420d466e-c77f-433f-9763-037f0389654e,segment=NetworkSegment(bada42e9-278b-46e3-bbc2-c2d37f00c32d),segment_id=bada42e9-278b-46e3-bbc2-c2d37f00c32d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:17.497634 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:17.500052 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device a0a1eab9-7a2d-4b73-9918-01919710bdbe details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:26:17.559788 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:17.585052 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port a0a1eab9-7a2d-4b73-9918-01919710bdbe, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a0a1eab9-7a2d-4b73-9918-01919710bdbe,segment=NetworkSegment(bada42e9-278b-46e3-bbc2-c2d37f00c32d),segment_id=bada42e9-278b-46e3-bbc2-c2d37f00c32d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:17.607131 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-823bc624-7ab6-4e71-a469-a45949b7f71e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5dd56541-48db-4dce-a0d7-6624015c8553 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:17.614218 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'a0a1eab9-7a2d-4b73-9918-01919710bdbe', 'network_id': '56b576e6-50b1-4d1e-a1c2-80bcf1883e68', 'port_id': 'a0a1eab9-7a2d-4b73-9918-01919710bdbe', 'mac_address': 'fa:16:3e:36:7a:21', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5b18bb60-11fe-4ddd-8fd3-bcb36985a134', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:26:17.615954 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-823bc624-7ab6-4e71-a469-a45949b7f71e service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:17.619585 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2cfba12a-761e-445b-bf14-a19d38aeeeb0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1ad36983-4549-4a03-a826-a31a08b98c98'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:17.622109 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-adb3d2ea-6f2d-438e-8a7e-610e67ab36f0" -d '{"events": [{"server_uuid": "2cfba12a-761e-445b-bf14-a19d38aeeeb0", "name": "network-vif-plugged", "status": "completed", "tag": "1ad36983-4549-4a03-a826-a31a08b98c98"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:17.625179 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=420d466e-c77f-433f-9763-037f0389654e,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:17.630993 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-823bc624-7ab6-4e71-a469-a45949b7f71e service neutron] Transition to ACTIVE for port object 5dd56541-48db-4dce-a0d7-6624015c8553 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:26:17.642535 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-823bc624-7ab6-4e71-a469-a45949b7f71e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:17.643743 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 1ad36983-4549-4a03-a826-a31a08b98c98, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1ad36983-4549-4a03-a826-a31a08b98c98,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:17.644360 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-a23e7453-6c70-433a-89ae-6a4030aeab3f tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:17.652434 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-a23e7453-6c70-433a-89ae-6a4030aeab3f tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/networks?id=5246b845-7de3-4759-8deb-13c3871588f0 HTTP/1.1" status: 200 len: 814 time: 0.1760087 Dec 09 21:26:17.673326 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-e296e28c-8127-42f3-bb72-379f548226de tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/quotas/a9b3d91742274db295ecdc3138fae25f HTTP/1.1" status: 200 len: 375 time: 0.0205090 Dec 09 21:26:17.678733 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:17.726392 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-bcc6e4bc-7912-4881-89c3-eb160a54c3bb tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=a9b3d91742274db295ecdc3138fae25f&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0518477 Dec 09 21:26:17.735177 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:17.757267 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-823bc624-7ab6-4e71-a469-a45949b7f71e service neutron] Pushing event updated for resources: {'Port': ['ID=5dd56541-48db-4dce-a0d7-6624015c8553,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:17.799094 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=1ad36983-4549-4a03-a826-a31a08b98c98,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:17.802150 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-823bc624-7ab6-4e71-a469-a45949b7f71e service neutron] Attempting to bind port 5dd56541-48db-4dce-a0d7-6624015c8553 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:26:17.802150 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-823bc624-7ab6-4e71-a469-a45949b7f71e service neutron] Attempting to bind port 5dd56541-48db-4dce-a0d7-6624015c8553 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'd2f9d5c1-75e0-4806-a659-59422ae7083c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'b10aba5b-a802-488f-b187-37195bb0b8ca'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:26:17.802801 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-823bc624-7ab6-4e71-a469-a45949b7f71e service neutron] Attempting to bind port 5dd56541-48db-4dce-a0d7-6624015c8553 on network b10aba5b-a802-488f-b187-37195bb0b8ca {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:17.807580 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-823bc624-7ab6-4e71-a469-a45949b7f71e service neutron] Port 5dd56541-48db-4dce-a0d7-6624015c8553 on network b10aba5b-a802-488f-b187-37195bb0b8ca not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:26:17.807580 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-823bc624-7ab6-4e71-a469-a45949b7f71e service neutron] Attempting to bind port 5dd56541-48db-4dce-a0d7-6624015c8553 on network b10aba5b-a802-488f-b187-37195bb0b8ca {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:17.812313 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50778b82-ffb1-4a90-9817-31ab627ffd20 req-228004da-bfd6-4c8e-915d-4405dfd9e906 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:17.814569 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-823bc624-7ab6-4e71-a469-a45949b7f71e service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 25, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:26:17.815235 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-823bc624-7ab6-4e71-a469-a45949b7f71e service neutron] Checking segment: {'id': 'd2f9d5c1-75e0-4806-a659-59422ae7083c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'b10aba5b-a802-488f-b187-37195bb0b8ca'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:17.815600 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-823bc624-7ab6-4e71-a469-a45949b7f71e service neutron] Bound using segment: {'id': 'd2f9d5c1-75e0-4806-a659-59422ae7083c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'b10aba5b-a802-488f-b187-37195bb0b8ca'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:26:17.816384 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-823bc624-7ab6-4e71-a469-a45949b7f71e service neutron] Bound port: 5dd56541-48db-4dce-a0d7-6624015c8553, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd2f9d5c1-75e0-4806-a659-59422ae7083c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': 'b10aba5b-a802-488f-b187-37195bb0b8ca'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:26:17.816847 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-823bc624-7ab6-4e71-a469-a45949b7f71e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:17.820725 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a0a1eab9-7a2d-4b73-9918-01919710bdbe {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:17.822693 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50778b82-ffb1-4a90-9817-31ab627ffd20 req-228004da-bfd6-4c8e-915d-4405dfd9e906 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.3015068 Dec 09 21:26:17.856538 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port a0a1eab9-7a2d-4b73-9918-01919710bdbe, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a0a1eab9-7a2d-4b73-9918-01919710bdbe,segment=NetworkSegment(bada42e9-278b-46e3-bbc2-c2d37f00c32d),segment_id=bada42e9-278b-46e3-bbc2-c2d37f00c32d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:17.864628 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:17.917987 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-7a2b0ebe-0d60-4dcf-9370-30ec17d8849c service neutron] 10.222.0.13 "GET /v2.0/networks/5246b845-7de3-4759-8deb-13c3871588f0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1906176 Dec 09 21:26:17.932468 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=a0a1eab9-7a2d-4b73-9918-01919710bdbe,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:17.948845 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-823bc624-7ab6-4e71-a469-a45949b7f71e service neutron] For port 5dd56541-48db-4dce-a0d7-6624015c8553, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:26:17.951668 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50778b82-ffb1-4a90-9817-31ab627ffd20 req-7addcc2f-1432-4f4b-8793-1a6e49b77728 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1278081 Dec 09 21:26:17.952847 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-823bc624-7ab6-4e71-a469-a45949b7f71e service neutron] For port 5dd56541-48db-4dce-a0d7-6624015c8553, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=5dd56541-48db-4dce-a0d7-6624015c8553,segment=NetworkSegment(d2f9d5c1-75e0-4806-a659-59422ae7083c),segment_id=d2f9d5c1-75e0-4806-a659-59422ae7083c)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:26:17.958104 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-823bc624-7ab6-4e71-a469-a45949b7f71e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:17.995478 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-823bc624-7ab6-4e71-a469-a45949b7f71e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:17.996293 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-823bc624-7ab6-4e71-a469-a45949b7f71e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:17.997890 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-823bc624-7ab6-4e71-a469-a45949b7f71e service neutron] 10.222.0.31 "PUT /v2.0/ports/5dd56541-48db-4dce-a0d7-6624015c8553 HTTP/1.1" status: 200 len: 1093 time: 0.9282758 Dec 09 21:26:17.998447 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a17d0675-93b1-4ffe-a686-311f32edd826', 'tag': '5dd56541-48db-4dce-a0d7-6624015c8553'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:18.000921 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9152f30c-b755-4a2b-a02d-6a90285bf09b" -d '{"events": [{"name": "network-changed", "server_uuid": "a17d0675-93b1-4ffe-a686-311f32edd826", "tag": "5dd56541-48db-4dce-a0d7-6624015c8553"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:18.037112 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-00309288-101c-45a7-a258-d82371abfcd0 service neutron] Request body: {'port': {'device_id': 'a17d0675-93b1-4ffe-a686-311f32edd826', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:18.059765 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-823bc624-7ab6-4e71-a469-a45949b7f71e service neutron] Pushing event updated for resources: {'Port': ['ID=5dd56541-48db-4dce-a0d7-6624015c8553,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:18.100037 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-58f4044c-f434-41e4-a4ec-ee66cc90e162 service neutron] 10.222.0.13 "GET /v2.0/networks/5246b845-7de3-4759-8deb-13c3871588f0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1810491 Dec 09 21:26:18.123994 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c8f1eaf-35d9-4ca0-8d3d-737fc41fa742 req-27b9f341-116f-4dd5-8ceb-9c6af3b89bcb tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:18.124373 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-00309288-101c-45a7-a258-d82371abfcd0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:18.130379 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c8f1eaf-35d9-4ca0-8d3d-737fc41fa742 req-27b9f341-116f-4dd5-8ceb-9c6af3b89bcb tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:18.138582 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c8f1eaf-35d9-4ca0-8d3d-737fc41fa742 req-27b9f341-116f-4dd5-8ceb-9c6af3b89bcb tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=a17d0675-93b1-4ffe-a686-311f32edd826 HTTP/1.1" status: 200 len: 1666 time: 0.1003714 Dec 09 21:26:18.185155 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['a0a1eab9-7a2d-4b73-9918-01919710bdbe'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:18.205895 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c8f1eaf-35d9-4ca0-8d3d-737fc41fa742 req-6b17611f-1742-47c3-851d-a7a03cd76c87 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0580616 Dec 09 21:26:18.269279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['420d466e-c77f-433f-9763-037f0389654e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:18.322103 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4d19d139-a4fd-422c-a2fd-e1ce527090cb x-openstack-request-id: req-4d19d139-a4fd-422c-a2fd-e1ce527090cb {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:18.322332 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2cfba12a-761e-445b-bf14-a19d38aeeeb0", "name": "network-vif-plugged", "status": "completed", "tag": "1ad36983-4549-4a03-a826-a31a08b98c98", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:18.322538 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-4d19d139-a4fd-422c-a2fd-e1ce527090cb {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:18.322938 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2cfba12a-761e-445b-bf14-a19d38aeeeb0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1ad36983-4549-4a03-a826-a31a08b98c98', 'code': 200} Dec 09 21:26:18.446180 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2046968-6588-40af-b10c-6b7c7616ad9f req-58edf28f-e8bc-4295-a023-58a7d3bef07a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:18.447814 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c2046968-6588-40af-b10c-6b7c7616ad9f req-58edf28f-e8bc-4295-a023-58a7d3bef07a service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=2cfba12a-761e-445b-bf14-a19d38aeeeb0 HTTP/1.1" status: 200 len: 1102 time: 0.0761735 Dec 09 21:26:18.519078 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c2046968-6588-40af-b10c-6b7c7616ad9f req-5e780ba1-6cf8-4730-8414-b78e1b98ed71 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0615218 Dec 09 21:26:18.572866 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-39cd1659-140c-40b0-a442-63b4bc172e38 x-openstack-request-id: req-39cd1659-140c-40b0-a442-63b4bc172e38 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:18.573205 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a17d0675-93b1-4ffe-a686-311f32edd826", "tag": "5dd56541-48db-4dce-a0d7-6624015c8553", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:18.573558 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-39cd1659-140c-40b0-a442-63b4bc172e38 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:18.574153 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a17d0675-93b1-4ffe-a686-311f32edd826', 'tag': '5dd56541-48db-4dce-a0d7-6624015c8553', 'status': 'completed', 'code': 200} Dec 09 21:26:18.576894 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-00309288-101c-45a7-a258-d82371abfcd0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:18.585936 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-00309288-101c-45a7-a258-d82371abfcd0 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:18.608212 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-00309288-101c-45a7-a258-d82371abfcd0 service neutron] Transition to ACTIVE for port object 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:26:18.610990 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-00309288-101c-45a7-a258-d82371abfcd0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:18.658532 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00309288-101c-45a7-a258-d82371abfcd0 service neutron] Pushing event updated for resources: {'Port': ['ID=3eea4303-cbf9-4dd6-8eaa-de772b7d85f8,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:18.686849 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaacbd6c-4a12-4cd6-bb35-babd8196042d req-a593d1c3-a44f-4485-8f42-c083fb87725a tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:18.695909 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aaacbd6c-4a12-4cd6-bb35-babd8196042d req-a593d1c3-a44f-4485-8f42-c083fb87725a tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a86f14a-2802-4e38-b9dd-4568a02642fc HTTP/1.1" status: 200 len: 944 time: 0.0644641 Dec 09 21:26:18.765368 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-00309288-101c-45a7-a258-d82371abfcd0 service neutron] Attempting to bind port 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:26:18.765780 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-00309288-101c-45a7-a258-d82371abfcd0 service neutron] Attempting to bind port 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '62cd2cbb-d71c-4d79-8112-51e9e682f3f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '30d0c468-ca40-4f41-a7a6-de8dc44194c4'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:26:18.766629 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-00309288-101c-45a7-a258-d82371abfcd0 service neutron] Attempting to bind port 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8 on network 30d0c468-ca40-4f41-a7a6-de8dc44194c4 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:18.782372 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-00309288-101c-45a7-a258-d82371abfcd0 service neutron] Port 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8 on network 30d0c468-ca40-4f41-a7a6-de8dc44194c4 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:26:18.783013 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-00309288-101c-45a7-a258-d82371abfcd0 service neutron] Attempting to bind port 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8 on network 30d0c468-ca40-4f41-a7a6-de8dc44194c4 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:18.787900 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3f0ee21-8440-48c2-b8cd-e76dcfdc9715 req-a14e42b9-9114-4cba-ad83-2ad9833309bf tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:18.790247 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3f0ee21-8440-48c2-b8cd-e76dcfdc9715 req-a14e42b9-9114-4cba-ad83-2ad9833309bf tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=2cfba12a-761e-445b-bf14-a19d38aeeeb0 HTTP/1.1" status: 200 len: 950 time: 0.1167884 Dec 09 21:26:18.814961 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aaacbd6c-4a12-4cd6-bb35-babd8196042d req-e77b2e71-4b55-42fd-9a93-2f596b9cd140 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1178737 Dec 09 21:26:18.827298 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-00309288-101c-45a7-a258-d82371abfcd0 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 25, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:26:18.827862 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-00309288-101c-45a7-a258-d82371abfcd0 service neutron] Checking segment: {'id': '62cd2cbb-d71c-4d79-8112-51e9e682f3f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '30d0c468-ca40-4f41-a7a6-de8dc44194c4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:18.828239 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-00309288-101c-45a7-a258-d82371abfcd0 service neutron] Bound using segment: {'id': '62cd2cbb-d71c-4d79-8112-51e9e682f3f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '30d0c468-ca40-4f41-a7a6-de8dc44194c4'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:26:18.828771 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-00309288-101c-45a7-a258-d82371abfcd0 service neutron] Bound port: 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '62cd2cbb-d71c-4d79-8112-51e9e682f3f3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '30d0c468-ca40-4f41-a7a6-de8dc44194c4'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:26:18.829289 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-00309288-101c-45a7-a258-d82371abfcd0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:18.894876 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9152f30c-b755-4a2b-a02d-6a90285bf09b req-a2c6dd62-96c8-40ee-b1f9-c8f46718ff8c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:18.895552 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9152f30c-b755-4a2b-a02d-6a90285bf09b req-a2c6dd62-96c8-40ee-b1f9-c8f46718ff8c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:18.897375 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9152f30c-b755-4a2b-a02d-6a90285bf09b req-a2c6dd62-96c8-40ee-b1f9-c8f46718ff8c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=73812a0c336d4768b029fd6459a1ae9e&device_id=a17d0675-93b1-4ffe-a686-311f32edd826 HTTP/1.1" status: 200 len: 1940 time: 0.1282618 Dec 09 21:26:18.927883 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3f0ee21-8440-48c2-b8cd-e76dcfdc9715 req-2f0da4d3-10e8-479c-83e4-c9f178dcc3ba tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1229098 Dec 09 21:26:18.995004 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-00309288-101c-45a7-a258-d82371abfcd0 service neutron] For port 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:26:19.031255 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9e751743-13c6-4f5e-9953-0232de61b85e req-b4274f80-6ab2-4ece-b194-0cefb0812add tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/ports?device_id=04d5c285-e8c5-448e-a7e8-5b0bbd69602f HTTP/1.1" status: 200 len: 210 time: 0.0457034 Dec 09 21:26:19.046160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-00309288-101c-45a7-a258-d82371abfcd0 service neutron] For port 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=3eea4303-cbf9-4dd6-8eaa-de772b7d85f8,segment=NetworkSegment(62cd2cbb-d71c-4d79-8112-51e9e682f3f3),segment_id=62cd2cbb-d71c-4d79-8112-51e9e682f3f3)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:26:19.078524 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-00309288-101c-45a7-a258-d82371abfcd0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:19.095813 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e724bb27-06a4-4e51-9417-c7d27e973742 req-57527e30-a742-4b68-9e5c-e03a5f3c59e7 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:19.097986 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e724bb27-06a4-4e51-9417-c7d27e973742 req-57527e30-a742-4b68-9e5c-e03a5f3c59e7 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/ports?device_id=9503e24d-9ce5-4566-8e69-df8da4219cec HTTP/1.1" status: 200 len: 950 time: 0.0658200 Dec 09 21:26:19.158538 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00309288-101c-45a7-a258-d82371abfcd0 service neutron] Pushing event updated for resources: {'Port': ['ID=3eea4303-cbf9-4dd6-8eaa-de772b7d85f8,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:19.163947 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9152f30c-b755-4a2b-a02d-6a90285bf09b req-d281eb9a-02f9-49b5-90fa-d69ad9777b3d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:19.164540 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9152f30c-b755-4a2b-a02d-6a90285bf09b req-d281eb9a-02f9-49b5-90fa-d69ad9777b3d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:19.164955 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9152f30c-b755-4a2b-a02d-6a90285bf09b req-d281eb9a-02f9-49b5-90fa-d69ad9777b3d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:19.166677 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e724bb27-06a4-4e51-9417-c7d27e973742 req-5b0eda7a-4146-4814-a719-c7ffdfd727a9 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/security-groups?id=c81de824-def8-4781-88c7-f240bf84e2af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595684 Dec 09 21:26:19.166827 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9152f30c-b755-4a2b-a02d-6a90285bf09b req-d281eb9a-02f9-49b5-90fa-d69ad9777b3d service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=73812a0c336d4768b029fd6459a1ae9e&shared=False HTTP/1.1" status: 200 len: 2291 time: 0.2442412 Dec 09 21:26:19.168413 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-00309288-101c-45a7-a258-d82371abfcd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:19.169075 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-00309288-101c-45a7-a258-d82371abfcd0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:19.170319 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-00309288-101c-45a7-a258-d82371abfcd0 service neutron] 10.222.0.31 "PUT /v2.0/ports/3eea4303-cbf9-4dd6-8eaa-de772b7d85f8 HTTP/1.1" status: 200 len: 1092 time: 1.1400373 Dec 09 21:26:19.272799 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cab44e8-3e5e-4672-9611-c0cedf47cb4e req-a55a56f2-6fb6-4cfa-8aae-03aeed211dd0 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:19.275898 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7cab44e8-3e5e-4672-9611-c0cedf47cb4e req-a55a56f2-6fb6-4cfa-8aae-03aeed211dd0 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.0942810 Dec 09 21:26:19.344457 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9152f30c-b755-4a2b-a02d-6a90285bf09b req-f408ae81-6733-4b6f-bf74-635dab3cfe24 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:19.346187 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7cab44e8-3e5e-4672-9611-c0cedf47cb4e req-9e897ee4-20e0-400b-bdb9-b2b8f5e04035 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0625589 Dec 09 21:26:19.348333 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9152f30c-b755-4a2b-a02d-6a90285bf09b req-f408ae81-6733-4b6f-bf74-635dab3cfe24 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1461172 Dec 09 21:26:19.458090 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-2157e897-3770-4373-8fa1-4a76ac0f9558 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:19.458575 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-2157e897-3770-4373-8fa1-4a76ac0f9558 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:19.460253 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-2157e897-3770-4373-8fa1-4a76ac0f9558 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=73812a0c336d4768b029fd6459a1ae9e&device_id=a17d0675-93b1-4ffe-a686-311f32edd826 HTTP/1.1" status: 200 len: 1982 time: 0.0493150 Dec 09 21:26:19.488292 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dca90ba1-e0e8-44df-8fc3-219c2c763175 req-3c313c5d-4d49-4728-b5b6-f3146ce11e00 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:19.494220 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dca90ba1-e0e8-44df-8fc3-219c2c763175 req-3c313c5d-4d49-4728-b5b6-f3146ce11e00 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:19.495866 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dca90ba1-e0e8-44df-8fc3-219c2c763175 req-3c313c5d-4d49-4728-b5b6-f3146ce11e00 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=a17d0675-93b1-4ffe-a686-311f32edd826 HTTP/1.1" status: 200 len: 1678 time: 0.0553343 Dec 09 21:26:19.524367 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-82a50295-0313-4d19-a42c-803b7ffa36fa service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=19.80.0.245&port_id=5dd56541-48db-4dce-a0d7-6624015c8553 HTTP/1.1" status: 200 len: 217 time: 0.0447402 Dec 09 21:26:19.549522 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dca90ba1-e0e8-44df-8fc3-219c2c763175 req-ab7cee2f-5700-437d-a033-e9169d7bc62f tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460167 Dec 09 21:26:19.588091 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-57af1be9-3c21-4734-ab00-6bc39c31383e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:19.589625 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-57af1be9-3c21-4734-ab00-6bc39c31383e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=67c09b0c-f53c-4918-9d79-b5f265f8b0cb HTTP/1.1" status: 200 len: 801 time: 0.0533864 Dec 09 21:26:19.649735 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-fcb69fd0-877e-4284-aa42-1ba44e81ba68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:19.651260 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-fcb69fd0-877e-4284-aa42-1ba44e81ba68 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=b10aba5b-a802-488f-b187-37195bb0b8ca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0456114 Dec 09 21:26:19.746062 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-f00a276d-a498-4f6a-868f-7bfcada562bc service neutron] 10.222.0.31 "GET /v2.0/networks/b10aba5b-a802-488f-b187-37195bb0b8ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0825205 Dec 09 21:26:19.864248 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-83e401d5-7139-49a8-9663-47e143ffb4b7 service neutron] 10.222.0.31 "GET /v2.0/networks/b10aba5b-a802-488f-b187-37195bb0b8ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1103022 Dec 09 21:26:19.959921 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-1f9af6ca-1ed9-4481-aa2a-ab89de92fcba service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=19.86.0.42&port_id=3eea4303-cbf9-4dd6-8eaa-de772b7d85f8 HTTP/1.1" status: 200 len: 217 time: 0.0739911 Dec 09 21:26:19.964970 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d50fd927-a8ab-42be-a97e-974b0761c125 req-aa585590-f9b8-4ec6-915b-61614d0c6e98 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:19.973570 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d50fd927-a8ab-42be-a97e-974b0761c125 req-aa585590-f9b8-4ec6-915b-61614d0c6e98 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a86f14a-2802-4e38-b9dd-4568a02642fc HTTP/1.1" status: 200 len: 944 time: 0.0680470 Dec 09 21:26:20.044723 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d50fd927-a8ab-42be-a97e-974b0761c125 req-ab4df5fb-2290-4e8e-af70-633c04f2b1c6 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0699294 Dec 09 21:26:20.073337 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-547ab9ce-a26a-430a-a986-5f0a3dd2ab18 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:20.073657 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c05ca495-e278-49bb-a2d2-2df8ff96d040 req-e38ffd1b-39f1-4926-a3d8-7e87d5b63697 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:20.075743 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-547ab9ce-a26a-430a-a986-5f0a3dd2ab18 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=1ae814b0-bedd-4a6b-96ff-e062ac849b56 HTTP/1.1" status: 200 len: 801 time: 0.1048017 Dec 09 21:26:20.076696 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c05ca495-e278-49bb-a2d2-2df8ff96d040 req-e38ffd1b-39f1-4926-a3d8-7e87d5b63697 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=2cfba12a-761e-445b-bf14-a19d38aeeeb0 HTTP/1.1" status: 200 len: 950 time: 0.0793879 Dec 09 21:26:20.102794 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-58477c41-e0fd-4694-9ea6-3d5db72777a8 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:20.104468 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-58477c41-e0fd-4694-9ea6-3d5db72777a8 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.31 "GET /v2.0/networks?id=5246b845-7de3-4759-8deb-13c3871588f0 HTTP/1.1" status: 200 len: 814 time: 0.2199240 Dec 09 21:26:20.141855 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c05ca495-e278-49bb-a2d2-2df8ff96d040 req-eeed0fc8-f5f7-46d1-a1ee-1abc7a9a256b tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0480623 Dec 09 21:26:20.150138 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-af00b2c6-27fe-4694-a672-39b6f7ccdd1a tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Request body: {'port': {'device_id': '04d5c285-e8c5-448e-a7e8-5b0bbd69602f', 'network_id': '5246b845-7de3-4759-8deb-13c3871588f0', 'admin_state_up': True, 'tenant_id': 'a9b3d91742274db295ecdc3138fae25f'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:20.169910 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-be6f73f5-79ae-4f39-8e80-13e58624ccf4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:20.171376 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-be6f73f5-79ae-4f39-8e80-13e58624ccf4 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=30d0c468-ca40-4f41-a7a6-de8dc44194c4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0863678 Dec 09 21:26:20.224186 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a27af684-fbf5-4bfe-a7a5-413d9dfcb37d req-ee3ec931-bf0e-4494-8d6e-c00b7682f1d1 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/ports?device_id=04d5c285-e8c5-448e-a7e8-5b0bbd69602f HTTP/1.1" status: 200 len: 210 time: 0.0346813 Dec 09 21:26:20.340790 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71c7699c-0781-41da-af4f-e9d8650ee76a req-db29dbcc-0318-40bf-a764-28f010a67c98 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:20.342520 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71c7699c-0781-41da-af4f-e9d8650ee76a req-db29dbcc-0318-40bf-a764-28f010a67c98 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/ports?device_id=9503e24d-9ce5-4566-8e69-df8da4219cec HTTP/1.1" status: 200 len: 950 time: 0.0584559 Dec 09 21:26:20.352527 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-87f8bf0b-92cf-4d70-8c67-d6d1d4dbab8c service neutron] 10.222.0.31 "GET /v2.0/networks/30d0c468-ca40-4f41-a7a6-de8dc44194c4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1659150 Dec 09 21:26:20.403404 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71c7699c-0781-41da-af4f-e9d8650ee76a req-aab10aba-a537-4688-b36d-31e5e5aa4b16 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/security-groups?id=c81de824-def8-4781-88c7-f240bf84e2af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0529530 Dec 09 21:26:20.424100 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-af00b2c6-27fe-4694-a672-39b6f7ccdd1a tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Made reservation on behalf of a9b3d91742274db295ecdc3138fae25f for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:20.427750 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-af00b2c6-27fe-4694-a672-39b6f7ccdd1a tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:20.511406 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72c5a20e-ff9f-4553-b14f-df0978b447bb req-f154ced2-530d-469d-872f-a974e75d7a74 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:20.513297 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72c5a20e-ff9f-4553-b14f-df0978b447bb req-f154ced2-530d-469d-872f-a974e75d7a74 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.0563984 Dec 09 21:26:20.550601 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5e69852a-02a8-4667-84f1-b1f8f7728a1e req-ee718e02-1455-4141-b150-f4d002b71327 service neutron] 10.222.0.31 "GET /v2.0/networks/30d0c468-ca40-4f41-a7a6-de8dc44194c4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1820126 Dec 09 21:26:20.583808 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72c5a20e-ff9f-4553-b14f-df0978b447bb req-9dbbb083-8349-4637-a6a9-44edec060503 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0583916 Dec 09 21:26:20.584725 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39182) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:20.602368 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a17d0675-93b1-4ffe-a686-311f32edd826', 'tag': '3eea4303-cbf9-4dd6-8eaa-de772b7d85f8'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:20.605084 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-83b65ff2-4d2b-4a2f-809b-42e7b9c495b5" -d '{"events": [{"name": "network-changed", "server_uuid": "a17d0675-93b1-4ffe-a686-311f32edd826", "tag": "3eea4303-cbf9-4dd6-8eaa-de772b7d85f8"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:20.640169 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-af00b2c6-27fe-4694-a672-39b6f7ccdd1a tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Allocated IP 172.20.0.11 (5246b845-7de3-4759-8deb-13c3871588f0/ff1bf4b1-2f03-42e0-ab07-8a818f9a1ba2/e6c753d6-8187-435b-afd5-f77fe7d762ce) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:26:20.660351 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-07f16995-0bc4-4498-8536-6159f2396c71 x-openstack-request-id: req-07f16995-0bc4-4498-8536-6159f2396c71 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:20.660934 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a17d0675-93b1-4ffe-a686-311f32edd826", "tag": "3eea4303-cbf9-4dd6-8eaa-de772b7d85f8", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:20.661205 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-07f16995-0bc4-4498-8536-6159f2396c71 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:20.661587 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a17d0675-93b1-4ffe-a686-311f32edd826', 'tag': '3eea4303-cbf9-4dd6-8eaa-de772b7d85f8', 'status': 'completed', 'code': 200} Dec 09 21:26:20.694081 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b373c74c-e123-4bdc-919a-dbec88223b47 req-417a288a-d381-48a3-b983-7f30b323fa92 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:20.700037 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b373c74c-e123-4bdc-919a-dbec88223b47 req-417a288a-d381-48a3-b983-7f30b323fa92 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:20.702239 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b373c74c-e123-4bdc-919a-dbec88223b47 req-417a288a-d381-48a3-b983-7f30b323fa92 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=a17d0675-93b1-4ffe-a686-311f32edd826 HTTP/1.1" status: 200 len: 1678 time: 0.0602391 Dec 09 21:26:20.741211 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cb98dd11-930b-4a87-b1c7-fc5ae582430a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:20.776027 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b65ff2-4d2b-4a2f-809b-42e7b9c495b5 req-7eea82f9-e388-4348-914d-962e295c5c67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:20.776509 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b65ff2-4d2b-4a2f-809b-42e7b9c495b5 req-7eea82f9-e388-4348-914d-962e295c5c67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:20.778132 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-83b65ff2-4d2b-4a2f-809b-42e7b9c495b5 req-7eea82f9-e388-4348-914d-962e295c5c67 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=73812a0c336d4768b029fd6459a1ae9e&device_id=a17d0675-93b1-4ffe-a686-311f32edd826 HTTP/1.1" status: 200 len: 1982 time: 0.0856650 Dec 09 21:26:20.790707 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b373c74c-e123-4bdc-919a-dbec88223b47 req-cdc2e3a5-2b51-49e9-88e9-02490aae16d3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0761316 Dec 09 21:26:20.883625 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33c4f4e1-ef1e-48bf-9281-bafd0b8587f4 req-8ee1c2d3-772f-47d8-b65b-40eea861093c tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:20.885104 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-33c4f4e1-ef1e-48bf-9281-bafd0b8587f4 req-8ee1c2d3-772f-47d8-b65b-40eea861093c tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.31 "GET /v2.0/ports?device_id=9503e24d-9ce5-4566-8e69-df8da4219cec HTTP/1.1" status: 200 len: 950 time: 0.0900395 Dec 09 21:26:20.889897 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cb98dd11-930b-4a87-b1c7-fc5ae582430a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:20.895160 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cb98dd11-930b-4a87-b1c7-fc5ae582430a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:20.918952 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-af00b2c6-27fe-4694-a672-39b6f7ccdd1a tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:20.936900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b65ff2-4d2b-4a2f-809b-42e7b9c495b5 req-c95222bc-9335-4254-b7ec-861c6365c49b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:20.938316 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-83b65ff2-4d2b-4a2f-809b-42e7b9c495b5 req-c95222bc-9335-4254-b7ec-861c6365c49b service neutron] 10.222.0.31 "GET /v2.0/networks?id=30d0c468-ca40-4f41-a7a6-de8dc44194c4 HTTP/1.1" status: 200 len: 903 time: 0.1298838 Dec 09 21:26:20.963568 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb98dd11-930b-4a87-b1c7-fc5ae582430a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dbbf7ee0-cc95-41f8-ab85-779214c1d320,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:20.974808 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cb98dd11-930b-4a87-b1c7-fc5ae582430a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=25dded0ae9e9428fbac856ad513d28a8&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3853085 Dec 09 21:26:20.976590 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39188) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:20.993240 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-83b65ff2-4d2b-4a2f-809b-42e7b9c495b5 req-f6fd52bf-8c98-44a6-a47f-9d8c64956516 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=19.86.0.42&port_id=3eea4303-cbf9-4dd6-8eaa-de772b7d85f8 HTTP/1.1" status: 200 len: 217 time: 0.0426300 Dec 09 21:26:21.001629 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-af00b2c6-27fe-4694-a672-39b6f7ccdd1a tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:21.020715 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 420d466e-c77f-433f-9763-037f0389654e up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:26:21.064377 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-33c4f4e1-ef1e-48bf-9281-bafd0b8587f4 req-60147d2e-c67e-465a-8931-d6709e504852 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Deleting port f4a163f1-05a1-4823-866b-b41a21ed72be {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:26:21.064806 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-33c4f4e1-ef1e-48bf-9281-bafd0b8587f4 req-60147d2e-c67e-465a-8931-d6709e504852 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:21.079696 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0beee8dd-7ea7-40a4-a7df-124cbd9a7069 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:21.085258 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 420d466e-c77f-433f-9763-037f0389654e completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:26:21.088614 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-af00b2c6-27fe-4694-a672-39b6f7ccdd1a tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Network 5246b845-7de3-4759-8deb-13c3871588f0 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:26:21.090929 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 420d466e-c77f-433f-9763-037f0389654e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:21.091534 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:21.094859 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-af00b2c6-27fe-4694-a672-39b6f7ccdd1a tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:21.100172 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af00b2c6-27fe-4694-a672-39b6f7ccdd1a tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Pushing event updated for resources: {'Port': ['ID=e6c753d6-8187-435b-afd5-f77fe7d762ce,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:21.102630 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-af00b2c6-27fe-4694-a672-39b6f7ccdd1a tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:26:21.164701 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-af00b2c6-27fe-4694-a672-39b6f7ccdd1a tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:21.165089 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-af00b2c6-27fe-4694-a672-39b6f7ccdd1a tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:21.170533 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b65ff2-4d2b-4a2f-809b-42e7b9c495b5 req-6f811c48-5ae3-4083-b0c5-bed9656787ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:21.171846 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-83b65ff2-4d2b-4a2f-809b-42e7b9c495b5 req-6f811c48-5ae3-4083-b0c5-bed9656787ff service neutron] 10.222.0.31 "GET /v2.0/subnets?id=1ae814b0-bedd-4a6b-96ff-e062ac849b56 HTTP/1.1" status: 200 len: 801 time: 0.1657000 Dec 09 21:26:21.214176 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:21.222357 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-af00b2c6-27fe-4694-a672-39b6f7ccdd1a tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0911770 Dec 09 21:26:21.237626 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-050a5205-0ec9-4f79-ae74-a2f96d0f4a96 service neutron] Request body: {'port': {'device_id': '04d5c285-e8c5-448e-a7e8-5b0bbd69602f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:21.244766 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '45c77ac9-72d0-4458-b992-e48fbc0c9adb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '420d466e-c77f-433f-9763-037f0389654e'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:21.247725 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-babb7285-7033-4574-9bd1-980efbb4081f" -d '{"events": [{"server_uuid": "45c77ac9-72d0-4458-b992-e48fbc0c9adb", "name": "network-vif-plugged", "status": "completed", "tag": "420d466e-c77f-433f-9763-037f0389654e"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:21.261344 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83b65ff2-4d2b-4a2f-809b-42e7b9c495b5 req-2b0501cb-402e-416b-b932-7313bc4c329c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:21.263007 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-83b65ff2-4d2b-4a2f-809b-42e7b9c495b5 req-2b0501cb-402e-416b-b932-7313bc4c329c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=30d0c468-ca40-4f41-a7a6-de8dc44194c4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1163 time: 0.0834188 Dec 09 21:26:21.263785 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 420d466e-c77f-433f-9763-037f0389654e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=420d466e-c77f-433f-9763-037f0389654e,segment=NetworkSegment(bada42e9-278b-46e3-bbc2-c2d37f00c32d),segment_id=bada42e9-278b-46e3-bbc2-c2d37f00c32d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:21.271897 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:21.273055 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device a0a1eab9-7a2d-4b73-9918-01919710bdbe up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:26:21.331929 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-050a5205-0ec9-4f79-ae74-a2f96d0f4a96 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:21.348839 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=420d466e-c77f-433f-9763-037f0389654e,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:21.381866 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port a0a1eab9-7a2d-4b73-9918-01919710bdbe completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:26:21.386258 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port a0a1eab9-7a2d-4b73-9918-01919710bdbe triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:21.386769 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:21.414546 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0beee8dd-7ea7-40a4-a7df-124cbd9a7069 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:21.435158 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-83b65ff2-4d2b-4a2f-809b-42e7b9c495b5 req-89b0be71-bb27-40c3-b7db-4ceb30d48789 service neutron] 10.222.0.31 "GET /v2.0/networks/30d0c468-ca40-4f41-a7a6-de8dc44194c4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1614652 Dec 09 21:26:21.472534 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:21.507609 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port a0a1eab9-7a2d-4b73-9918-01919710bdbe, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a0a1eab9-7a2d-4b73-9918-01919710bdbe,segment=NetworkSegment(bada42e9-278b-46e3-bbc2-c2d37f00c32d),segment_id=bada42e9-278b-46e3-bbc2-c2d37f00c32d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:21.512547 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:21.531792 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-33c4f4e1-ef1e-48bf-9281-bafd0b8587f4 req-60147d2e-c67e-465a-8931-d6709e504852 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] For port f4a163f1-05a1-4823-866b-b41a21ed72be, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=f4a163f1-05a1-4823-866b-b41a21ed72be,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:21.532219 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-33c4f4e1-ef1e-48bf-9281-bafd0b8587f4 req-60147d2e-c67e-465a-8931-d6709e504852 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:21.553809 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-33c4f4e1-ef1e-48bf-9281-bafd0b8587f4 req-60147d2e-c67e-465a-8931-d6709e504852 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Calling delete_port for f4a163f1-05a1-4823-866b-b41a21ed72be owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:26:21.567636 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-686982d8-2330-4064-9d23-85c2bba5f07d req-5b8697fb-bfd7-4574-8214-77b31998f961 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:21.571910 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-686982d8-2330-4064-9d23-85c2bba5f07d req-5b8697fb-bfd7-4574-8214-77b31998f961 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=2cfba12a-761e-445b-bf14-a19d38aeeeb0 HTTP/1.1" status: 200 len: 950 time: 0.1633816 Dec 09 21:26:21.572179 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=a0a1eab9-7a2d-4b73-9918-01919710bdbe,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:21.593925 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9e30174-b400-44d2-ba4d-7aeb090b236d req-c64ea052-48a0-40f9-ab2b-72d6131b35b5 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:21.595426 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d9e30174-b400-44d2-ba4d-7aeb090b236d req-c64ea052-48a0-40f9-ab2b-72d6131b35b5 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a86f14a-2802-4e38-b9dd-4568a02642fc HTTP/1.1" status: 200 len: 944 time: 0.1830940 Dec 09 21:26:21.624287 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-83b65ff2-4d2b-4a2f-809b-42e7b9c495b5 req-600a26f8-4950-403f-a637-1d1d95c36272 service neutron] 10.222.0.31 "GET /v2.0/networks/30d0c468-ca40-4f41-a7a6-de8dc44194c4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1793623 Dec 09 21:26:21.641937 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0beee8dd-7ea7-40a4-a7df-124cbd9a7069 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:21.644572 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0beee8dd-7ea7-40a4-a7df-124cbd9a7069 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:21.648122 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0beee8dd-7ea7-40a4-a7df-124cbd9a7069 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/dbbf7ee0-cc95-41f8-ab85-779214c1d320 HTTP/1.1" status: 204 len: 168 time: 0.6681883 Dec 09 21:26:21.683112 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0beee8dd-7ea7-40a4-a7df-124cbd9a7069 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dbbf7ee0-cc95-41f8-ab85-779214c1d320,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:21.744670 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d9e30174-b400-44d2-ba4d-7aeb090b236d req-f7097d28-ddec-4533-85c5-630041574073 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1122937 Dec 09 21:26:21.762460 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-050a5205-0ec9-4f79-ae74-a2f96d0f4a96 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e6c753d6-8187-435b-afd5-f77fe7d762ce {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:21.768362 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-686982d8-2330-4064-9d23-85c2bba5f07d req-7211b1e0-7e6b-4ea3-99ce-61e0171d8b0a tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1827042 Dec 09 21:26:21.789133 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-050a5205-0ec9-4f79-ae74-a2f96d0f4a96 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:21.831210 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8825062b-8c51-4880-b4aa-759cee312bc9 x-openstack-request-id: req-8825062b-8c51-4880-b4aa-759cee312bc9 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:21.831883 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "45c77ac9-72d0-4458-b992-e48fbc0c9adb", "name": "network-vif-plugged", "status": "completed", "tag": "420d466e-c77f-433f-9763-037f0389654e", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:21.832142 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8825062b-8c51-4880-b4aa-759cee312bc9 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:21.832566 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '45c77ac9-72d0-4458-b992-e48fbc0c9adb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '420d466e-c77f-433f-9763-037f0389654e', 'code': 200} Dec 09 21:26:21.932989 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-33c4f4e1-ef1e-48bf-9281-bafd0b8587f4 req-60147d2e-c67e-465a-8931-d6709e504852 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:21.947257 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['f4a163f1-05a1-4823-866b-b41a21ed72be'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:21.954982 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82789127-e493-4c30-86d2-8368e09ee414 req-8dd89be2-1db2-4fef-9f43-1d0b583e5a3f tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:21.956565 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-82789127-e493-4c30-86d2-8368e09ee414 req-8dd89be2-1db2-4fef-9f43-1d0b583e5a3f tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/ports?device_id=04d5c285-e8c5-448e-a7e8-5b0bbd69602f HTTP/1.1" status: 200 len: 932 time: 0.1139002 Dec 09 21:26:21.960438 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-050a5205-0ec9-4f79-ae74-a2f96d0f4a96 service neutron] Transition to ACTIVE for port object e6c753d6-8187-435b-afd5-f77fe7d762ce will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:26:21.969680 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b30393fb-cf0b-49d1-a27d-8ac34fc2f078 req-9a44bbf8-75db-42ac-b5a3-1c2beced6412 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:21.972453 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b30393fb-cf0b-49d1-a27d-8ac34fc2f078 req-9a44bbf8-75db-42ac-b5a3-1c2beced6412 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=45c77ac9-72d0-4458-b992-e48fbc0c9adb HTTP/1.1" status: 200 len: 1098 time: 0.0562167 Dec 09 21:26:21.973280 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-050a5205-0ec9-4f79-ae74-a2f96d0f4a96 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:21.981792 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60147d2e-c67e-465a-8931-d6709e504852 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Pushing event deleted for resources: {'Port': ['ID=f4a163f1-05a1-4823-866b-b41a21ed72be,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:22.041840 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11e63578-58dd-48e3-aa6b-7d176554d25a req-d4187ce2-8797-4a41-84fd-eda6309f5766 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:22.043390 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11e63578-58dd-48e3-aa6b-7d176554d25a req-d4187ce2-8797-4a41-84fd-eda6309f5766 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/ports?device_id=9503e24d-9ce5-4566-8e69-df8da4219cec HTTP/1.1" status: 200 len: 867 time: 0.1552250 Dec 09 21:26:22.066061 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-33c4f4e1-ef1e-48bf-9281-bafd0b8587f4 req-60147d2e-c67e-465a-8931-d6709e504852 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] No DVR routers for this DVR port f4a163f1-05a1-4823-866b-b41a21ed72be on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:26:22.074798 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-33c4f4e1-ef1e-48bf-9281-bafd0b8587f4 req-60147d2e-c67e-465a-8931-d6709e504852 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:22.078481 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-33c4f4e1-ef1e-48bf-9281-bafd0b8587f4 req-60147d2e-c67e-465a-8931-d6709e504852 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.31 "DELETE /v2.0/ports/f4a163f1-05a1-4823-866b-b41a21ed72be HTTP/1.1" status: 204 len: 173 time: 1.1781945 Dec 09 21:26:22.079181 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9503e24d-9ce5-4566-8e69-df8da4219cec', 'name': 'network-vif-deleted', 'tag': 'f4a163f1-05a1-4823-866b-b41a21ed72be'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:22.081716 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d9c05547-82b0-4207-a111-54c2f74e7187" -d '{"events": [{"server_uuid": "9503e24d-9ce5-4566-8e69-df8da4219cec", "name": "network-vif-deleted", "tag": "f4a163f1-05a1-4823-866b-b41a21ed72be"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:22.086923 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b30393fb-cf0b-49d1-a27d-8ac34fc2f078 req-8607cff5-1083-4230-8e33-af3f85127664 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0865698 Dec 09 21:26:22.089288 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-050a5205-0ec9-4f79-ae74-a2f96d0f4a96 service neutron] Pushing event updated for resources: {'Port': ['ID=e6c753d6-8187-435b-afd5-f77fe7d762ce,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:22.143078 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-82789127-e493-4c30-86d2-8368e09ee414 req-f982f1b5-bebf-4fb0-b60d-2a4a52ff3109 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/security-groups?id=c460cbfc-5960-42ff-abb9-4a137fb9cba6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1657169 Dec 09 21:26:22.169230 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-050a5205-0ec9-4f79-ae74-a2f96d0f4a96 service neutron] Attempting to bind port e6c753d6-8187-435b-afd5-f77fe7d762ce on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:26:22.169924 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-050a5205-0ec9-4f79-ae74-a2f96d0f4a96 service neutron] Attempting to bind port e6c753d6-8187-435b-afd5-f77fe7d762ce by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'b091c3fa-97be-41c0-9252-b65227a09bde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '5246b845-7de3-4759-8deb-13c3871588f0'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:26:22.170486 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-050a5205-0ec9-4f79-ae74-a2f96d0f4a96 service neutron] Attempting to bind port e6c753d6-8187-435b-afd5-f77fe7d762ce on network 5246b845-7de3-4759-8deb-13c3871588f0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:22.176813 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-050a5205-0ec9-4f79-ae74-a2f96d0f4a96 service neutron] Port e6c753d6-8187-435b-afd5-f77fe7d762ce on network 5246b845-7de3-4759-8deb-13c3871588f0 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:26:22.177649 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-050a5205-0ec9-4f79-ae74-a2f96d0f4a96 service neutron] Attempting to bind port e6c753d6-8187-435b-afd5-f77fe7d762ce on network 5246b845-7de3-4759-8deb-13c3871588f0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:22.188858 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11e63578-58dd-48e3-aa6b-7d176554d25a req-f6d88804-4b1c-484d-8baf-76ff53516d66 tempest-ImagesNegativeTestJSON-455571862 tempest-ImagesNegativeTestJSON-455571862-project] 10.222.0.13 "GET /v2.0/security-groups?id=c81de824-def8-4781-88c7-f240bf84e2af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1214879 Dec 09 21:26:22.190097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-050a5205-0ec9-4f79-ae74-a2f96d0f4a96 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 25, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:26:22.190557 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-050a5205-0ec9-4f79-ae74-a2f96d0f4a96 service neutron] Checking segment: {'id': 'b091c3fa-97be-41c0-9252-b65227a09bde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '5246b845-7de3-4759-8deb-13c3871588f0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:22.191005 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-050a5205-0ec9-4f79-ae74-a2f96d0f4a96 service neutron] Bound using segment: {'id': 'b091c3fa-97be-41c0-9252-b65227a09bde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '5246b845-7de3-4759-8deb-13c3871588f0'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:26:22.191569 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-050a5205-0ec9-4f79-ae74-a2f96d0f4a96 service neutron] Bound port: e6c753d6-8187-435b-afd5-f77fe7d762ce, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b091c3fa-97be-41c0-9252-b65227a09bde', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '5246b845-7de3-4759-8deb-13c3871588f0'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:26:22.191999 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-050a5205-0ec9-4f79-ae74-a2f96d0f4a96 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:22.310393 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-050a5205-0ec9-4f79-ae74-a2f96d0f4a96 service neutron] For port e6c753d6-8187-435b-afd5-f77fe7d762ce, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:26:22.315907 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-050a5205-0ec9-4f79-ae74-a2f96d0f4a96 service neutron] For port e6c753d6-8187-435b-afd5-f77fe7d762ce, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e6c753d6-8187-435b-afd5-f77fe7d762ce,segment=NetworkSegment(b091c3fa-97be-41c0-9252-b65227a09bde),segment_id=b091c3fa-97be-41c0-9252-b65227a09bde)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:26:22.328293 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6883f23a-e2e1-45bb-8444-bd8b10988ff5 req-8da85c5b-bd12-416f-a7b3-cc041de6ac1e tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:22.328596 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-050a5205-0ec9-4f79-ae74-a2f96d0f4a96 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:22.330011 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6883f23a-e2e1-45bb-8444-bd8b10988ff5 req-8da85c5b-bd12-416f-a7b3-cc041de6ac1e tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.0867193 Dec 09 21:26:22.394183 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6883f23a-e2e1-45bb-8444-bd8b10988ff5 req-e3ce86de-675f-4dad-886b-66659462f93b tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0545611 Dec 09 21:26:22.407723 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-050a5205-0ec9-4f79-ae74-a2f96d0f4a96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:22.408713 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-050a5205-0ec9-4f79-ae74-a2f96d0f4a96 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:22.410866 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-050a5205-0ec9-4f79-ae74-a2f96d0f4a96 service neutron] 10.222.0.31 "PUT /v2.0/ports/e6c753d6-8187-435b-afd5-f77fe7d762ce HTTP/1.1" status: 200 len: 1093 time: 1.1781857 Dec 09 21:26:22.415555 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-050a5205-0ec9-4f79-ae74-a2f96d0f4a96 service neutron] Pushing event updated for resources: {'Port': ['ID=e6c753d6-8187-435b-afd5-f77fe7d762ce,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:22.539236 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-6296e85b-8d7e-4305-9325-6e04eda7cbc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:22.541527 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-6296e85b-8d7e-4305-9325-6e04eda7cbc4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a9b3d91742274db295ecdc3138fae25f&device_id=04d5c285-e8c5-448e-a7e8-5b0bbd69602f HTTP/1.1" status: 200 len: 1096 time: 0.0744464 Dec 09 21:26:22.558136 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e379d8a5-a4e6-4051-8ad7-133cbda04d5b req-04c61e43-fe45-404d-8bce-a35b06485f0a tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:22.565296 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e379d8a5-a4e6-4051-8ad7-133cbda04d5b req-04c61e43-fe45-404d-8bce-a35b06485f0a tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:22.573998 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e379d8a5-a4e6-4051-8ad7-133cbda04d5b req-04c61e43-fe45-404d-8bce-a35b06485f0a tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=a17d0675-93b1-4ffe-a686-311f32edd826 HTTP/1.1" status: 200 len: 1678 time: 0.0801041 Dec 09 21:26:22.602032 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-e4439583-c002-488b-83ac-ef5dd4f58be1 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=e6c753d6-8187-435b-afd5-f77fe7d762ce HTTP/1.1" status: 200 len: 217 time: 0.0447977 Dec 09 21:26:22.621045 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e379d8a5-a4e6-4051-8ad7-133cbda04d5b req-7660e3c1-345f-491c-bafc-3278588b5a4c tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458877 Dec 09 21:26:22.664345 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '04d5c285-e8c5-448e-a7e8-5b0bbd69602f', 'tag': 'e6c753d6-8187-435b-afd5-f77fe7d762ce'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:22.666612 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5b8c916d-f8bc-4389-a328-e91ef754cd15" -d '{"events": [{"name": "network-changed", "server_uuid": "04d5c285-e8c5-448e-a7e8-5b0bbd69602f", "tag": "e6c753d6-8187-435b-afd5-f77fe7d762ce"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:22.668290 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f66349c0-d537-435e-8121-5442a4c65bb3 x-openstack-request-id: req-f66349c0-d537-435e-8121-5442a4c65bb3 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:22.669005 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9503e24d-9ce5-4566-8e69-df8da4219cec", "name": "network-vif-deleted", "tag": "f4a163f1-05a1-4823-866b-b41a21ed72be", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:22.669570 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f66349c0-d537-435e-8121-5442a4c65bb3 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:22.669842 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9503e24d-9ce5-4566-8e69-df8da4219cec', 'name': 'network-vif-deleted', 'tag': 'f4a163f1-05a1-4823-866b-b41a21ed72be', 'status': 'completed', 'code': 200} Dec 09 21:26:22.671128 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-810c2cb2-70b4-42a5-b6b6-7ca82bb7de6a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:22.672832 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-810c2cb2-70b4-42a5-b6b6-7ca82bb7de6a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ff1bf4b1-2f03-42e0-ab07-8a818f9a1ba2 HTTP/1.1" status: 200 len: 854 time: 0.0619249 Dec 09 21:26:22.708504 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-643b0963-3d1f-4830-970d-38db94cf1ab4 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5246b845-7de3-4759-8deb-13c3871588f0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0253358 Dec 09 21:26:22.814657 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-6d77049d-7692-44ce-812d-ddaaf3fc3b44 service neutron] 10.222.0.31 "GET /v2.0/networks/5246b845-7de3-4759-8deb-13c3871588f0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0972157 Dec 09 21:26:22.814889 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-557cce2f-8eeb-439d-a2cf-a746d3d46105 req-9abae85d-9649-477e-afee-034cb894bb3c tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:22.821226 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-557cce2f-8eeb-439d-a2cf-a746d3d46105 req-9abae85d-9649-477e-afee-034cb894bb3c tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:22.822890 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-557cce2f-8eeb-439d-a2cf-a746d3d46105 req-9abae85d-9649-477e-afee-034cb894bb3c tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=2cfba12a-761e-445b-bf14-a19d38aeeeb0&device_id=d3f455b1-1a56-4ded-ab82-e9ce51afbfde HTTP/1.1" status: 200 len: 1691 time: 0.0579629 Dec 09 21:26:22.886634 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-557cce2f-8eeb-439d-a2cf-a746d3d46105 req-51a06a81-8ea5-4209-acc3-baeb7594cae9 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0557280 Dec 09 21:26:22.927601 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a30dca7b-9a8d-4a29-9173-0f2af8523ca1 req-be6af078-83c4-4f95-bc00-29b5fb50dd5d service neutron] 10.222.0.31 "GET /v2.0/networks/5246b845-7de3-4759-8deb-13c3871588f0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1059530 Dec 09 21:26:22.941380 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ae223020-5d49-4c0d-bb12-9a40952fd887 x-openstack-request-id: req-ae223020-5d49-4c0d-bb12-9a40952fd887 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:22.942159 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "04d5c285-e8c5-448e-a7e8-5b0bbd69602f", "tag": "e6c753d6-8187-435b-afd5-f77fe7d762ce", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:22.942623 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-ae223020-5d49-4c0d-bb12-9a40952fd887 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:22.943236 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '04d5c285-e8c5-448e-a7e8-5b0bbd69602f', 'tag': 'e6c753d6-8187-435b-afd5-f77fe7d762ce', 'status': 'completed', 'code': 200} Dec 09 21:26:23.036208 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 5dd56541-48db-4dce-a0d7-6624015c8553 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:26:23.045430 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3615eb9e-3b2b-47c5-a7d5-de3e889915d7 req-10f15b00-e6f7-4593-b343-2ac80b758de7 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:23.048538 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3615eb9e-3b2b-47c5-a7d5-de3e889915d7 req-10f15b00-e6f7-4593-b343-2ac80b758de7 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a86f14a-2802-4e38-b9dd-4568a02642fc HTTP/1.1" status: 200 len: 945 time: 0.0621185 Dec 09 21:26:23.117501 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3615eb9e-3b2b-47c5-a7d5-de3e889915d7 req-16d976bd-86b9-4388-93e6-a5dc77652994 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0624363 Dec 09 21:26:23.146898 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b8c916d-f8bc-4389-a328-e91ef754cd15 req-12d54591-c72b-4923-b530-a35992a2dd63 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:23.151730 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5b8c916d-f8bc-4389-a328-e91ef754cd15 req-12d54591-c72b-4923-b530-a35992a2dd63 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a9b3d91742274db295ecdc3138fae25f&device_id=04d5c285-e8c5-448e-a7e8-5b0bbd69602f HTTP/1.1" status: 200 len: 1096 time: 0.0824969 Dec 09 21:26:23.202933 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 5dd56541-48db-4dce-a0d7-6624015c8553, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=5dd56541-48db-4dce-a0d7-6624015c8553,segment=NetworkSegment(d2f9d5c1-75e0-4806-a659-59422ae7083c),segment_id=d2f9d5c1-75e0-4806-a659-59422ae7083c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:23.227939 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '5dd56541-48db-4dce-a0d7-6624015c8553', 'network_id': 'b10aba5b-a802-488f-b187-37195bb0b8ca', 'port_id': '5dd56541-48db-4dce-a0d7-6624015c8553', 'mac_address': 'fa:16:3e:41:62:b7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 116, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '67c09b0c-f53c-4918-9d79-b5f265f8b0cb', 'ip_address': '19.80.0.245'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:26:23.284845 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:23.304425 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5dd56541-48db-4dce-a0d7-6624015c8553 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:23.311451 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c449964-c2ab-4942-8555-500c7dc10b4c req-5777bf32-4ff2-4951-ae3d-6c385b6b7760 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:23.314300 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c449964-c2ab-4942-8555-500c7dc10b4c req-5777bf32-4ff2-4951-ae3d-6c385b6b7760 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/ports?device_id=04d5c285-e8c5-448e-a7e8-5b0bbd69602f HTTP/1.1" status: 200 len: 944 time: 0.0706840 Dec 09 21:26:23.321330 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b8c916d-f8bc-4389-a328-e91ef754cd15 req-d5202f68-26fe-4388-a4fe-94b33ea51b1a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:23.322922 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5b8c916d-f8bc-4389-a328-e91ef754cd15 req-d5202f68-26fe-4388-a4fe-94b33ea51b1a service neutron] 10.222.0.31 "GET /v2.0/networks?id=5246b845-7de3-4759-8deb-13c3871588f0 HTTP/1.1" status: 200 len: 915 time: 0.1603835 Dec 09 21:26:23.330277 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 5dd56541-48db-4dce-a0d7-6624015c8553, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=5dd56541-48db-4dce-a0d7-6624015c8553,segment=NetworkSegment(d2f9d5c1-75e0-4806-a659-59422ae7083c),segment_id=d2f9d5c1-75e0-4806-a659-59422ae7083c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:23.335523 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:23.336612 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:26:23.371530 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5b8c916d-f8bc-4389-a328-e91ef754cd15 req-09392555-970d-4bbd-94fe-54a54a888f82 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=e6c753d6-8187-435b-afd5-f77fe7d762ce HTTP/1.1" status: 200 len: 217 time: 0.0376537 Dec 09 21:26:23.407836 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c449964-c2ab-4942-8555-500c7dc10b4c req-1060f706-f1ce-4d6f-a015-90249b8dd636 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/security-groups?id=c460cbfc-5960-42ff-abb9-4a137fb9cba6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0869260 Dec 09 21:26:23.418081 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6a862cb-846d-4a52-aaf9-8e4aa38f7c68 req-8ce6ffca-4291-4841-889f-331b15f247a5 tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:23.421195 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=5dd56541-48db-4dce-a0d7-6624015c8553,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:23.427966 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6a862cb-846d-4a52-aaf9-8e4aa38f7c68 req-8ce6ffca-4291-4841-889f-331b15f247a5 tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=2cfba12a-761e-445b-bf14-a19d38aeeeb0 HTTP/1.1" status: 200 len: 1102 time: 0.0779076 Dec 09 21:26:23.436098 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b8c916d-f8bc-4389-a328-e91ef754cd15 req-58d5819b-b2ec-4e8c-9cf3-884c90cf5165 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:23.438588 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5b8c916d-f8bc-4389-a328-e91ef754cd15 req-58d5819b-b2ec-4e8c-9cf3-884c90cf5165 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ff1bf4b1-2f03-42e0-ab07-8a818f9a1ba2 HTTP/1.1" status: 200 len: 854 time: 0.0567493 Dec 09 21:26:23.484616 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6a862cb-846d-4a52-aaf9-8e4aa38f7c68 req-46250c26-8b84-48c2-9215-153525c58aac tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0557177 Dec 09 21:26:23.494474 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5b8c916d-f8bc-4389-a328-e91ef754cd15 req-30488093-646d-40e5-8256-b724087fe60b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5246b845-7de3-4759-8deb-13c3871588f0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0467918 Dec 09 21:26:23.613395 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5b8c916d-f8bc-4389-a328-e91ef754cd15 req-e8c330e9-23cd-4d5a-82bd-c1a28f53d6f3 service neutron] 10.222.0.31 "GET /v2.0/networks/5246b845-7de3-4759-8deb-13c3871588f0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1093290 Dec 09 21:26:23.668200 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af37c430-1dc4-4cf9-b538-33c507598c9a req-2a672176-69cb-4dd0-b196-d0cc9faa9238 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:23.670715 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af37c430-1dc4-4cf9-b538-33c507598c9a req-2a672176-69cb-4dd0-b196-d0cc9faa9238 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.0638642 Dec 09 21:26:23.713084 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=3eea4303-cbf9-4dd6-8eaa-de772b7d85f8,segment=NetworkSegment(62cd2cbb-d71c-4d79-8112-51e9e682f3f3),segment_id=62cd2cbb-d71c-4d79-8112-51e9e682f3f3)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:23.729306 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af37c430-1dc4-4cf9-b538-33c507598c9a req-c9cf2a8e-104d-4958-b9c1-0040b26e3a41 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0506670 Dec 09 21:26:23.729674 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '3eea4303-cbf9-4dd6-8eaa-de772b7d85f8', 'network_id': '30d0c468-ca40-4f41-a7a6-de8dc44194c4', 'port_id': '3eea4303-cbf9-4dd6-8eaa-de772b7d85f8', 'mac_address': 'fa:16:3e:c9:28:75', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 119, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1ae814b0-bedd-4a6b-96ff-e062ac849b56', 'ip_address': '19.86.0.42'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:26:23.776427 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5b8c916d-f8bc-4389-a328-e91ef754cd15 req-3b11e00b-1cea-428c-b949-d8c2806eeccc service neutron] 10.222.0.31 "GET /v2.0/networks/5246b845-7de3-4759-8deb-13c3871588f0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1460612 Dec 09 21:26:23.793689 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:23.811154 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:23.839175 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1a86f14a-2802-4e38-b9dd-4568a02642fc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a0a1eab9-7a2d-4b73-9918-01919710bdbe'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:23.842028 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b605fabc-6a11-4fb8-a4de-379693a9be6f" -d '{"events": [{"server_uuid": "1a86f14a-2802-4e38-b9dd-4568a02642fc", "name": "network-vif-plugged", "status": "completed", "tag": "a0a1eab9-7a2d-4b73-9918-01919710bdbe"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:23.847998 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=3eea4303-cbf9-4dd6-8eaa-de772b7d85f8,segment=NetworkSegment(62cd2cbb-d71c-4d79-8112-51e9e682f3f3),segment_id=62cd2cbb-d71c-4d79-8112-51e9e682f3f3)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:23.853147 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:23.864954 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0705dbc1-0622-4aac-a599-fc4981767ab3 req-d7ff02be-97c6-4d31-bf5b-d9e82edd757c tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:23.866708 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0705dbc1-0622-4aac-a599-fc4981767ab3 req-d7ff02be-97c6-4d31-bf5b-d9e82edd757c tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=d3f455b1-1a56-4ded-ab82-e9ce51afbfde HTTP/1.1" status: 200 len: 1102 time: 0.0429862 Dec 09 21:26:23.902226 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=3eea4303-cbf9-4dd6-8eaa-de772b7d85f8,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:23.914914 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0705dbc1-0622-4aac-a599-fc4981767ab3 req-513615cd-2700-4082-af8b-ff187a48f11a tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420449 Dec 09 21:26:24.035823 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25666d50-3243-4def-a3cf-e4d0b59f257c req-b9d64107-8710-4052-a869-64426cccf6c6 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:24.041898 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25666d50-3243-4def-a3cf-e4d0b59f257c req-b9d64107-8710-4052-a869-64426cccf6c6 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:24.043465 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25666d50-3243-4def-a3cf-e4d0b59f257c req-b9d64107-8710-4052-a869-64426cccf6c6 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=a17d0675-93b1-4ffe-a686-311f32edd826 HTTP/1.1" status: 200 len: 1680 time: 0.0633743 Dec 09 21:26:24.096169 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25666d50-3243-4def-a3cf-e4d0b59f257c req-34249e8f-d556-435f-8a0c-477b720033a6 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461738 Dec 09 21:26:24.167080 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-63ac0687-3481-4e41-8ae5-e31d38ec6db5 x-openstack-request-id: req-63ac0687-3481-4e41-8ae5-e31d38ec6db5 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:24.167982 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1a86f14a-2802-4e38-b9dd-4568a02642fc", "name": "network-vif-plugged", "status": "completed", "tag": "a0a1eab9-7a2d-4b73-9918-01919710bdbe", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:24.168525 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-63ac0687-3481-4e41-8ae5-e31d38ec6db5 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:24.169559 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1a86f14a-2802-4e38-b9dd-4568a02642fc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a0a1eab9-7a2d-4b73-9918-01919710bdbe', 'code': 200} Dec 09 21:26:24.272389 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['3eea4303-cbf9-4dd6-8eaa-de772b7d85f8'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:24.315431 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a14c9ee9-8b02-4705-ad29-dc1ab34dbe50 req-f65898f9-6df0-46a2-86b7-0ad1a6c0d914 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:24.317374 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a14c9ee9-8b02-4705-ad29-dc1ab34dbe50 req-f65898f9-6df0-46a2-86b7-0ad1a6c0d914 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=1a86f14a-2802-4e38-b9dd-4568a02642fc HTTP/1.1" status: 200 len: 1097 time: 0.0649512 Dec 09 21:26:24.359551 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d551692d-0182-498e-972c-09071ef016b3 req-549703cb-3516-4962-b88c-1a03ea8dbea2 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:24.371801 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d551692d-0182-498e-972c-09071ef016b3 req-549703cb-3516-4962-b88c-1a03ea8dbea2 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a86f14a-2802-4e38-b9dd-4568a02642fc HTTP/1.1" status: 200 len: 945 time: 0.1132536 Dec 09 21:26:24.380414 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['5dd56541-48db-4dce-a0d7-6624015c8553'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:24.381307 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a14c9ee9-8b02-4705-ad29-dc1ab34dbe50 req-f7a56887-8c8b-48c9-8b2b-1ed374d0ab61 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0527079 Dec 09 21:26:24.438587 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d551692d-0182-498e-972c-09071ef016b3 req-d0994a48-f91d-43dd-8862-00d471f422ae tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0651908 Dec 09 21:26:24.552610 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-e08db048-ec9a-4439-b5d5-e08aec808d4d tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0280910 Dec 09 21:26:24.667130 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c9912cd-b9d9-4dd7-a68a-6a1bbc2e111c req-448fa32b-f6c5-4f97-9e1a-6dcd25584144 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:24.668637 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c9912cd-b9d9-4dd7-a68a-6a1bbc2e111c req-448fa32b-f6c5-4f97-9e1a-6dcd25584144 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/ports?device_id=04d5c285-e8c5-448e-a7e8-5b0bbd69602f HTTP/1.1" status: 200 len: 944 time: 0.1193769 Dec 09 21:26:24.707735 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-8ad0abcd-a966-446c-b439-186cff2ff356 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:24.709207 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-8ad0abcd-a966-446c-b439-186cff2ff356 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1489744 Dec 09 21:26:24.737145 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-534159cb-ab5c-4126-9ee7-f998608a3c9e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/quotas/23f7f8a3e7b14635b4f7dfa561684399 HTTP/1.1" status: 200 len: 375 time: 0.0218294 Dec 09 21:26:24.744437 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c9912cd-b9d9-4dd7-a68a-6a1bbc2e111c req-072c0c1d-c8c6-440b-9223-99cd289e6187 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/security-groups?id=c460cbfc-5960-42ff-abb9-4a137fb9cba6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0676761 Dec 09 21:26:24.788498 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39308) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:24.801610 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-88c334d2-f439-44e6-b40c-8816f437ee6e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0562029 Dec 09 21:26:24.944168 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7cad9776-e413-4b0b-9147-c913f842fea7 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=6ef183f29d2f4992bf91a120a9d85fac&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1543407 Dec 09 21:26:24.946562 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39312) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:24.995330 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-154e9daf-1ac4-424e-ab7f-86ca2ebb56d5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:25.023750 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-154e9daf-1ac4-424e-ab7f-86ca2ebb56d5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:25.036665 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e6c753d6-8187-435b-afd5-f77fe7d762ce details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:26:25.039026 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device f4a163f1-05a1-4823-866b-b41a21ed72be no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:26:25.067406 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: f4a163f1-05a1-4823-866b-b41a21ed72be {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:26:25.068060 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device f4a163f1-05a1-4823-866b-b41a21ed72be not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:26:25.082896 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-154e9daf-1ac4-424e-ab7f-86ca2ebb56d5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:25.085748 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-154e9daf-1ac4-424e-ab7f-86ca2ebb56d5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:25.087074 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-154e9daf-1ac4-424e-ab7f-86ca2ebb56d5 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/c81de824-def8-4781-88c7-f240bf84e2af HTTP/1.1" status: 204 len: 168 time: 0.1393940 Dec 09 21:26:25.095275 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-154e9daf-1ac4-424e-ab7f-86ca2ebb56d5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c81de824-def8-4781-88c7-f240bf84e2af,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:25.132119 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b7883ef-f8b4-4f03-9ff8-09cc78727576 req-00558a41-9afc-46b7-9e2e-ec39258733e5 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:25.141170 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b7883ef-f8b4-4f03-9ff8-09cc78727576 req-00558a41-9afc-46b7-9e2e-ec39258733e5 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.0716825 Dec 09 21:26:25.198774 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b7883ef-f8b4-4f03-9ff8-09cc78727576 req-a2b6b2d9-a397-4469-b1aa-fa3f346155e2 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0560703 Dec 09 21:26:25.211392 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port e6c753d6-8187-435b-afd5-f77fe7d762ce, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e6c753d6-8187-435b-afd5-f77fe7d762ce,segment=NetworkSegment(b091c3fa-97be-41c0-9252-b65227a09bde),segment_id=b091c3fa-97be-41c0-9252-b65227a09bde)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:25.246759 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'e6c753d6-8187-435b-afd5-f77fe7d762ce', 'network_id': '5246b845-7de3-4759-8deb-13c3871588f0', 'port_id': 'e6c753d6-8187-435b-afd5-f77fe7d762ce', 'mac_address': 'fa:16:3e:83:20:7c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 107, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ff1bf4b1-2f03-42e0-ab07-8a818f9a1ba2', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:26:25.314234 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:25.329478 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e6c753d6-8187-435b-afd5-f77fe7d762ce {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:25.351266 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port e6c753d6-8187-435b-afd5-f77fe7d762ce, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e6c753d6-8187-435b-afd5-f77fe7d762ce,segment=NetworkSegment(b091c3fa-97be-41c0-9252-b65227a09bde),segment_id=b091c3fa-97be-41c0-9252-b65227a09bde)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:25.357524 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:25.386740 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e951b95-3b70-48eb-a9bb-fa0e8c0d3060 req-53e3a238-46ca-410c-b18e-cc601ba853cc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:25.411671 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e951b95-3b70-48eb-a9bb-fa0e8c0d3060 req-53e3a238-46ca-410c-b18e-cc601ba853cc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:25.415204 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e951b95-3b70-48eb-a9bb-fa0e8c0d3060 req-53e3a238-46ca-410c-b18e-cc601ba853cc tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=a17d0675-93b1-4ffe-a686-311f32edd826 HTTP/1.1" status: 200 len: 1680 time: 0.1234896 Dec 09 21:26:25.424696 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=e6c753d6-8187-435b-afd5-f77fe7d762ce,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:25.516095 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e951b95-3b70-48eb-a9bb-fa0e8c0d3060 req-48d6af40-501d-4dea-9b2e-7ae2ec853c9e tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0909612 Dec 09 21:26:25.687093 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea726bed-eea8-45ad-ab56-d05c183cced7 req-980ec1e5-8bba-4ce3-a0d9-22ff68dd2b3d tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:25.695359 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea726bed-eea8-45ad-ab56-d05c183cced7 req-980ec1e5-8bba-4ce3-a0d9-22ff68dd2b3d tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a86f14a-2802-4e38-b9dd-4568a02642fc HTTP/1.1" status: 200 len: 945 time: 0.0664399 Dec 09 21:26:25.745477 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea726bed-eea8-45ad-ab56-d05c183cced7 req-db3e74ec-ed0e-4a92-b3dc-91cf8cf5fe5a tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0490994 Dec 09 21:26:25.828950 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['e6c753d6-8187-435b-afd5-f77fe7d762ce'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:25.837396 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b2750d72-6d17-4124-99f1-1e3e66dcdbc7 req-fdf94d3b-a58e-4942-b0ed-4c0c80e0d858 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=c7f45d89-875f-4294-9fcb-17f7fc994b3f HTTP/1.1" status: 200 len: 210 time: 0.0410509 Dec 09 21:26:25.986617 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba0b505f-ecd4-44c6-ae57-dbca28c54a7c req-9751d7e8-0e97-4a9a-b365-a6fc7d5badbf tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:25.988304 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba0b505f-ecd4-44c6-ae57-dbca28c54a7c req-9751d7e8-0e97-4a9a-b365-a6fc7d5badbf tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/ports?device_id=04d5c285-e8c5-448e-a7e8-5b0bbd69602f HTTP/1.1" status: 200 len: 945 time: 0.0653100 Dec 09 21:26:26.008930 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39362) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:26.084629 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba0b505f-ecd4-44c6-ae57-dbca28c54a7c req-098b5e63-696d-4d26-bbe6-f45fc145fa87 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/security-groups?id=c460cbfc-5960-42ff-abb9-4a137fb9cba6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0839524 Dec 09 21:26:26.139083 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-6c6a3fd1-da85-4fc6-85bf-541ff2e7e9af admin admin] Request body: {'network': {'name': 'tempest-SecurityGroupsTestJSON-4885114-network', 'tenant_id': '5635fb0018b24f538b250cdac6dca9d9'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:26.165637 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6c6a3fd1-da85-4fc6-85bf-541ff2e7e9af admin admin] Made reservation on behalf of 5635fb0018b24f538b250cdac6dca9d9 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:26.168320 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c6a3fd1-da85-4fc6-85bf-541ff2e7e9af admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:26.180011 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c6a3fd1-da85-4fc6-85bf-541ff2e7e9af admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:26.272719 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c6a3fd1-da85-4fc6-85bf-541ff2e7e9af admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:26.280842 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c6a3fd1-da85-4fc6-85bf-541ff2e7e9af admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:26.315191 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6c6a3fd1-da85-4fc6-85bf-541ff2e7e9af admin admin] vlan segment allocate from pool success with {'vlan_id': 121, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:26:26.323381 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c6a3fd1-da85-4fc6-85bf-541ff2e7e9af admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:26.330202 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c6a3fd1-da85-4fc6-85bf-541ff2e7e9af admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:26.330801 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-6c6a3fd1-da85-4fc6-85bf-541ff2e7e9af admin admin] Added segment c472f4a8-1a94-4bb1-8978-a56e5ee37bb8 of type vlan for network de91a458-cde4-4265-8605-31d9b6f8f05f Dec 09 21:26:26.382045 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c6a3fd1-da85-4fc6-85bf-541ff2e7e9af admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:26.411686 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c6a3fd1-da85-4fc6-85bf-541ff2e7e9af admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:26.412879 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c6a3fd1-da85-4fc6-85bf-541ff2e7e9af admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:26.413635 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c6a3fd1-da85-4fc6-85bf-541ff2e7e9af admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:26.415239 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e67544d-cec0-4e24-9ee3-613aaa3e2fe6 req-04f41c7e-aa7c-4d31-a872-0cc44c874ced tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:26.417565 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e67544d-cec0-4e24-9ee3-613aaa3e2fe6 req-04f41c7e-aa7c-4d31-a872-0cc44c874ced tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.1019459 Dec 09 21:26:26.480130 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e67544d-cec0-4e24-9ee3-613aaa3e2fe6 req-d010b697-1e9b-4aac-9509-29fadfe22cae tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0551825 Dec 09 21:26:26.490516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c6a3fd1-da85-4fc6-85bf-541ff2e7e9af admin admin] Pushing event updated for resources: {'Network': ['ID=de91a458-cde4-4265-8605-31d9b6f8f05f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:26.495726 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6c6a3fd1-da85-4fc6-85bf-541ff2e7e9af admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.4851027 Dec 09 21:26:26.499120 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39380) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:26.503983 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-245959f1-d51b-42ba-9d0d-3fdf84460d56 admin admin] Request body: {'subnet': {'network_id': 'de91a458-cde4-4265-8605-31d9b6f8f05f', 'cidr': '172.20.0.0/28', 'name': 'tempest-SecurityGroupsTestJSON-4885114-subnet', 'tenant_id': '5635fb0018b24f538b250cdac6dca9d9', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:26.510567 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network de91a458-cde4-4265-8605-31d9b6f8f05f details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:26:26.531367 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-245959f1-d51b-42ba-9d0d-3fdf84460d56 admin admin] Made reservation on behalf of 5635fb0018b24f538b250cdac6dca9d9 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:26.535096 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-245959f1-d51b-42ba-9d0d-3fdf84460d56 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:26.694521 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e8f2133-46b3-4fa9-8827-4331ee036d86 req-5e1a2386-bde1-4098-9e57-7cd043495091 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:26.701540 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e8f2133-46b3-4fa9-8827-4331ee036d86 req-5e1a2386-bde1-4098-9e57-7cd043495091 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:26.703371 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e8f2133-46b3-4fa9-8827-4331ee036d86 req-5e1a2386-bde1-4098-9e57-7cd043495091 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=a17d0675-93b1-4ffe-a686-311f32edd826 HTTP/1.1" status: 200 len: 1680 time: 0.0708261 Dec 09 21:26:26.729926 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-245959f1-d51b-42ba-9d0d-3fdf84460d56 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:26.777335 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e8f2133-46b3-4fa9-8827-4331ee036d86 req-35fea87c-4c1e-4934-93c0-cc42eb8caf01 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0656290 Dec 09 21:26:26.795688 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-245959f1-d51b-42ba-9d0d-3fdf84460d56 admin admin] Pushing event updated for resources: {'Subnet': ['ID=cb187a9c-ec94-4995-93f8-92c16c7a80a3,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:26.832730 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-245959f1-d51b-42ba-9d0d-3fdf84460d56 admin admin] Checking segment: {'id': 'c472f4a8-1a94-4bb1-8978-a56e5ee37bb8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': 'de91a458-cde4-4265-8605-31d9b6f8f05f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:26.832976 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-245959f1-d51b-42ba-9d0d-3fdf84460d56 admin admin] Network hostable DHCP agents. Network: de91a458-cde4-4265-8605-31d9b6f8f05f, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:26:26.865696 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-245959f1-d51b-42ba-9d0d-3fdf84460d56 admin admin] Network de91a458-cde4-4265-8605-31d9b6f8f05f is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:26:26.883727 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-245959f1-d51b-42ba-9d0d-3fdf84460d56 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, de91a458-cde4-4265-8605-31d9b6f8f05f) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:26.895802 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-245959f1-d51b-42ba-9d0d-3fdf84460d56 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:26.896494 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-245959f1-d51b-42ba-9d0d-3fdf84460d56 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:26.898441 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3fc8acf-3a99-4d7c-b8a4-c376289b99c0 None None] Network de91a458-cde4-4265-8605-31d9b6f8f05f requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:26:26.942235 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-245959f1-d51b-42ba-9d0d-3fdf84460d56 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.4414065 Dec 09 21:26:26.970472 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-88808ba3-00dc-452b-b3c1-081ceda45683 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.10 "GET /v2.0/networks?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0884714 Dec 09 21:26:27.073153 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 5dd56541-48db-4dce-a0d7-6624015c8553 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:26:27.077886 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-61819ab8-4c08-4937-a4d7-897105f17651 None None] Network de91a458-cde4-4265-8605-31d9b6f8f05f requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:26:27.120365 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-20b46326-b8a3-42be-b33e-259f99b25eae tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0486383 Dec 09 21:26:27.155735 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bc07ea9-c4f9-4ff3-ac96-b149e48baff0 req-ec4acc53-59ba-4e02-8cfd-307377793d00 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:27.166944 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9bc07ea9-c4f9-4ff3-ac96-b149e48baff0 req-ec4acc53-59ba-4e02-8cfd-307377793d00 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a86f14a-2802-4e38-b9dd-4568a02642fc HTTP/1.1" status: 200 len: 945 time: 0.2725561 Dec 09 21:26:27.181610 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:27.209803 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:27.302055 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-993e37ef-74ba-4264-8f85-a4e1d34756f2 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:27.303703 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-993e37ef-74ba-4264-8f85-a4e1d34756f2 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3114789 Dec 09 21:26:27.344454 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9bc07ea9-c4f9-4ff3-ac96-b149e48baff0 req-33575d66-c38c-4e97-a2cb-c8cadd9c3570 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1641958 Dec 09 21:26:27.349042 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-3ded3dcf-279a-47f5-b503-77bba3027cf0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Request body: {'port': {'device_id': 'c7f45d89-875f-4294-9fcb-17f7fc994b3f', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '23f7f8a3e7b14635b4f7dfa561684399'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:27.353996 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 5dd56541-48db-4dce-a0d7-6624015c8553 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:26:27.361467 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 5dd56541-48db-4dce-a0d7-6624015c8553 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:27.362278 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:27.479354 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:27.504005 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a17d0675-93b1-4ffe-a686-311f32edd826', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5dd56541-48db-4dce-a0d7-6624015c8553'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:27.506711 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-eba77692-4bd6-4b30-bb6d-db908e2b27e1" -d '{"events": [{"server_uuid": "a17d0675-93b1-4ffe-a686-311f32edd826", "name": "network-vif-plugged", "status": "completed", "tag": "5dd56541-48db-4dce-a0d7-6624015c8553"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:27.521288 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 5dd56541-48db-4dce-a0d7-6624015c8553, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=5dd56541-48db-4dce-a0d7-6624015c8553,segment=NetworkSegment(d2f9d5c1-75e0-4806-a659-59422ae7083c),segment_id=d2f9d5c1-75e0-4806-a659-59422ae7083c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:27.526599 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:27.527637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e6c753d6-8187-435b-afd5-f77fe7d762ce up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:26:27.537412 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a7f50803-1cb0-447d-9020-1abb7f99440b req-e9d8dae9-4056-4787-9708-b508d8374f67 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=c7f45d89-875f-4294-9fcb-17f7fc994b3f HTTP/1.1" status: 200 len: 210 time: 0.0626011 Dec 09 21:26:27.594896 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42bd97cc-e762-48f0-bd59-e862b36f83cf req-b4e8a486-4ba4-4a9a-a5ea-1923f3c6cc75 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:27.603875 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42bd97cc-e762-48f0-bd59-e862b36f83cf req-b4e8a486-4ba4-4a9a-a5ea-1923f3c6cc75 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/ports?device_id=04d5c285-e8c5-448e-a7e8-5b0bbd69602f HTTP/1.1" status: 200 len: 945 time: 0.1277349 Dec 09 21:26:27.615069 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=5dd56541-48db-4dce-a0d7-6624015c8553,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:27.624770 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-3d780458-5dc7-42fa-a387-ccb70c2669dd tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:27.627247 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-3d780458-5dc7-42fa-a387-ccb70c2669dd tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.5000257 Dec 09 21:26:27.631708 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port e6c753d6-8187-435b-afd5-f77fe7d762ce completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:26:27.636182 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port e6c753d6-8187-435b-afd5-f77fe7d762ce triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:27.636688 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:27.643973 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-aa1212f0-3abb-40bc-bc08-7e52a7bb79db tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Request body: {'port': {'device_id': '94826b5c-46f2-422a-a48d-eb415b5b9e44', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '23f7f8a3e7b14635b4f7dfa561684399'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:27.644253 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-3ded3dcf-279a-47f5-b503-77bba3027cf0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Made reservation on behalf of 23f7f8a3e7b14635b4f7dfa561684399 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:27.647645 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-3ded3dcf-279a-47f5-b503-77bba3027cf0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:27.683269 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42bd97cc-e762-48f0-bd59-e862b36f83cf req-20d7f1c5-d7d7-47e0-8eb7-4a2e3efdee77 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/security-groups?id=c460cbfc-5960-42ff-abb9-4a137fb9cba6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0782180 Dec 09 21:26:27.732048 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:27.768787 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port e6c753d6-8187-435b-afd5-f77fe7d762ce, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e6c753d6-8187-435b-afd5-f77fe7d762ce,segment=NetworkSegment(b091c3fa-97be-41c0-9252-b65227a09bde),segment_id=b091c3fa-97be-41c0-9252-b65227a09bde)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:27.787720 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:27.791338 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:26:27.810891 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-aa1212f0-3abb-40bc-bc08-7e52a7bb79db tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Made reservation on behalf of 23f7f8a3e7b14635b4f7dfa561684399 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:27.816433 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-aa1212f0-3abb-40bc-bc08-7e52a7bb79db tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:27.822124 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-ab9762b4-3bd5-461f-8411-af84b93f9dbb req-7aee1798-9277-42f3-b414-37f783bc4bac tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupsTestJSON-securitygroup-380500455', 'description': 'tempest-description-541353479'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:27.881292 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-3ded3dcf-279a-47f5-b503-77bba3027cf0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Allocated IP 192.168.233.198 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/fd466da6-f506-43e6-9800-156622bd2781) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:26:27.888500 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:26:27.896502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:27.897165 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:27.900031 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ab9762b4-3bd5-461f-8411-af84b93f9dbb req-7aee1798-9277-42f3-b414-37f783bc4bac tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:27.900511 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=e6c753d6-8187-435b-afd5-f77fe7d762ce,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:27.926424 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1e50da4-29c9-48af-8b7c-b48e212e6d71 req-544cd79a-a033-4fef-847f-871e16eb1228 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:27.927993 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a1e50da4-29c9-48af-8b7c-b48e212e6d71 req-544cd79a-a033-4fef-847f-871e16eb1228 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=45c77ac9-72d0-4458-b992-e48fbc0c9adb HTTP/1.1" status: 200 len: 946 time: 0.1206007 Dec 09 21:26:27.980961 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:28.012852 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=3eea4303-cbf9-4dd6-8eaa-de772b7d85f8,segment=NetworkSegment(62cd2cbb-d71c-4d79-8112-51e9e682f3f3),segment_id=62cd2cbb-d71c-4d79-8112-51e9e682f3f3)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:28.017708 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:28.059288 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a1e50da4-29c9-48af-8b7c-b48e212e6d71 req-87a86ed5-507d-4abd-8251-a937a42f5de6 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1178987 Dec 09 21:26:28.069413 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=3eea4303-cbf9-4dd6-8eaa-de772b7d85f8,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:28.119787 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ab9762b4-3bd5-461f-8411-af84b93f9dbb req-7aee1798-9277-42f3-b414-37f783bc4bac tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:28.120386 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-835a0c1d-3582-47b9-949b-c0bee0e188ae x-openstack-request-id: req-835a0c1d-3582-47b9-949b-c0bee0e188ae {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:28.120560 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a17d0675-93b1-4ffe-a686-311f32edd826", "name": "network-vif-plugged", "status": "completed", "tag": "5dd56541-48db-4dce-a0d7-6624015c8553", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:28.120729 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-835a0c1d-3582-47b9-949b-c0bee0e188ae {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:28.121221 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a17d0675-93b1-4ffe-a686-311f32edd826', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5dd56541-48db-4dce-a0d7-6624015c8553', 'code': 200} Dec 09 21:26:28.127542 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ab9762b4-3bd5-461f-8411-af84b93f9dbb req-7aee1798-9277-42f3-b414-37f783bc4bac tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:28.185408 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-3ded3dcf-279a-47f5-b503-77bba3027cf0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:28.192430 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ab9762b4-3bd5-461f-8411-af84b93f9dbb req-7aee1798-9277-42f3-b414-37f783bc4bac tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:28.193628 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab9762b4-3bd5-461f-8411-af84b93f9dbb req-7aee1798-9277-42f3-b414-37f783bc4bac tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1823 time: 0.3873415 Dec 09 21:26:28.208448 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7aee1798-9277-42f3-b414-37f783bc4bac tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d0cefb8e-5181-40ca-9bcf-8d762cff4764,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:28.249519 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-628e2cb8-f203-4319-bff3-44fa171f55b5 req-dacdf9ad-cec1-46a8-bc81-6b4afd7211ca tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:28.251018 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-628e2cb8-f203-4319-bff3-44fa171f55b5 req-dacdf9ad-cec1-46a8-bc81-6b4afd7211ca tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.0839522 Dec 09 21:26:28.280754 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-3ded3dcf-279a-47f5-b503-77bba3027cf0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:28.304051 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['18bda486-9d6d-41a3-a260-dd244a3838b3', '2958b0be-15e5-48e2-b87a-6ffefd9a7859', '1ad36983-4549-4a03-a826-a31a08b98c98'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:28.327320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-aa1212f0-3abb-40bc-bc08-7e52a7bb79db tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Allocated IP 192.168.233.99 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/07457883-17db-4553-8f10-716e04bc16b1) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:26:28.370494 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-3ded3dcf-279a-47f5-b503-77bba3027cf0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:26:28.381457 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ded3dcf-279a-47f5-b503-77bba3027cf0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Pushing event updated for resources: {'Port': ['ID=fd466da6-f506-43e6-9800-156622bd2781,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:28.384009 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-3ded3dcf-279a-47f5-b503-77bba3027cf0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:28.395604 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-628e2cb8-f203-4319-bff3-44fa171f55b5 req-56836c54-10ba-4e0a-a0f1-99d874c3229a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1368952 Dec 09 21:26:28.396761 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-3ded3dcf-279a-47f5-b503-77bba3027cf0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:26:28.467512 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-3ded3dcf-279a-47f5-b503-77bba3027cf0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:28.468740 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-3ded3dcf-279a-47f5-b503-77bba3027cf0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:28.497343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-312bd654-a802-4863-bd05-a2640e06eea9 req-c8eb1894-3ab7-4744-a882-417bda3a5f40 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:28.504365 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-312bd654-a802-4863-bd05-a2640e06eea9 req-c8eb1894-3ab7-4744-a882-417bda3a5f40 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:28.506320 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-312bd654-a802-4863-bd05-a2640e06eea9 req-c8eb1894-3ab7-4744-a882-417bda3a5f40 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=a17d0675-93b1-4ffe-a686-311f32edd826 HTTP/1.1" status: 200 len: 1682 time: 0.1945138 Dec 09 21:26:28.510499 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-3ded3dcf-279a-47f5-b503-77bba3027cf0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.1760783 Dec 09 21:26:28.524171 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-0edadbcf-9c70-41d9-987e-54a0cfae40ba service neutron] Request body: {'port': {'device_id': 'c7f45d89-875f-4294-9fcb-17f7fc994b3f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:28.562957 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-aa1212f0-3abb-40bc-bc08-7e52a7bb79db tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:28.637605 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-aa1212f0-3abb-40bc-bc08-7e52a7bb79db tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:28.675879 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-312bd654-a802-4863-bd05-a2640e06eea9 req-1c9d011f-81e5-42a6-a220-ce09c7e21a5a tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1433642 Dec 09 21:26:28.694088 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-039c2d0e-2bc6-41c6-9efc-2f0042c4c799 req-dfbc09e2-e5ed-427f-a8ce-7ebe6a26e534 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupsTestJSON-securitygroup-204319425', 'description': 'tempest-description-2079097636'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:28.697659 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-aa1212f0-3abb-40bc-bc08-7e52a7bb79db tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:26:28.701457 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-aa1212f0-3abb-40bc-bc08-7e52a7bb79db tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:28.705940 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-aa1212f0-3abb-40bc-bc08-7e52a7bb79db tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:26:28.717743 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-0edadbcf-9c70-41d9-987e-54a0cfae40ba service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:28.739764 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa1212f0-3abb-40bc-bc08-7e52a7bb79db tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Pushing event updated for resources: {'Port': ['ID=07457883-17db-4553-8f10-716e04bc16b1,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:28.788622 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-aa1212f0-3abb-40bc-bc08-7e52a7bb79db tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:28.789625 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-aa1212f0-3abb-40bc-bc08-7e52a7bb79db tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:28.796331 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-039c2d0e-2bc6-41c6-9efc-2f0042c4c799 req-dfbc09e2-e5ed-427f-a8ce-7ebe6a26e534 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:28.807469 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-889b6b78-578b-45fb-a352-e1dd75af5120 None None] Provisioning complete for port fd466da6-f506-43e6-9800-156622bd2781 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:28.808068 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-889b6b78-578b-45fb-a352-e1dd75af5120 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:28.828639 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-aa1212f0-3abb-40bc-bc08-7e52a7bb79db tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.1899149 Dec 09 21:26:28.853023 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-889b6b78-578b-45fb-a352-e1dd75af5120 None None] Port fd466da6-f506-43e6-9800-156622bd2781 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:26:28.854391 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-bef9225b-959c-40f6-b13c-e0ff766a2fc0 service neutron] Request body: {'port': {'device_id': '94826b5c-46f2-422a-a48d-eb415b5b9e44', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:28.918626 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-bef9225b-959c-40f6-b13c-e0ff766a2fc0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:28.941175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3de2598c-655f-4ded-a6f9-55d3d98e8192 req-14208aa2-0a6e-4c15-80e4-d4010fcc9705 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:28.942761 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3de2598c-655f-4ded-a6f9-55d3d98e8192 req-14208aa2-0a6e-4c15-80e4-d4010fcc9705 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=c7f45d89-875f-4294-9fcb-17f7fc994b3f HTTP/1.1" status: 200 len: 936 time: 0.1573112 Dec 09 21:26:29.037995 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:26:29.071471 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-039c2d0e-2bc6-41c6-9efc-2f0042c4c799 req-dfbc09e2-e5ed-427f-a8ce-7ebe6a26e534 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:29.072675 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2028f9ed-a132-416b-961d-ea3236839cb1 None None] Provisioning complete for port 07457883-17db-4553-8f10-716e04bc16b1 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:29.073063 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2028f9ed-a132-416b-961d-ea3236839cb1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:29.081110 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-039c2d0e-2bc6-41c6-9efc-2f0042c4c799 req-dfbc09e2-e5ed-427f-a8ce-7ebe6a26e534 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:29.098313 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3de2598c-655f-4ded-a6f9-55d3d98e8192 req-25a9cef2-7046-4f7d-aea5-9b18be7cbb64 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1478734 Dec 09 21:26:29.110923 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-2028f9ed-a132-416b-961d-ea3236839cb1 None None] Port 07457883-17db-4553-8f10-716e04bc16b1 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:26:29.121408 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-039c2d0e-2bc6-41c6-9efc-2f0042c4c799 req-dfbc09e2-e5ed-427f-a8ce-7ebe6a26e534 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:29.122612 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-039c2d0e-2bc6-41c6-9efc-2f0042c4c799 req-dfbc09e2-e5ed-427f-a8ce-7ebe6a26e534 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1824 time: 0.4456241 Dec 09 21:26:29.134058 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfbc09e2-e5ed-427f-a8ce-7ebe6a26e534 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event updated for resources: {'SecurityGroup': ['ID=dc3fa276-da75-42c1-a8e4-8471106148d2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:29.227389 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-0edadbcf-9c70-41d9-987e-54a0cfae40ba service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fd466da6-f506-43e6-9800-156622bd2781 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:29.237272 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-0edadbcf-9c70-41d9-987e-54a0cfae40ba service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:29.251940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-0edadbcf-9c70-41d9-987e-54a0cfae40ba service neutron] Transition to ACTIVE for port object fd466da6-f506-43e6-9800-156622bd2781 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:26:29.280021 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-0edadbcf-9c70-41d9-987e-54a0cfae40ba service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:29.412337 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0edadbcf-9c70-41d9-987e-54a0cfae40ba service neutron] Pushing event updated for resources: {'Port': ['ID=fd466da6-f506-43e6-9800-156622bd2781,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:29.437869 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-bef9225b-959c-40f6-b13c-e0ff766a2fc0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 07457883-17db-4553-8f10-716e04bc16b1 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:29.448555 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-bef9225b-959c-40f6-b13c-e0ff766a2fc0 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:29.457598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6919b2eb-5cea-4d3d-9c02-316dda55f579 req-bc344803-6bed-4df8-85a3-b892c7fe1068 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:29.459203 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6919b2eb-5cea-4d3d-9c02-316dda55f579 req-bc344803-6bed-4df8-85a3-b892c7fe1068 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/ports?device_id=04d5c285-e8c5-448e-a7e8-5b0bbd69602f HTTP/1.1" status: 200 len: 946 time: 0.1218107 Dec 09 21:26:29.472061 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-bef9225b-959c-40f6-b13c-e0ff766a2fc0 service neutron] Transition to ACTIVE for port object 07457883-17db-4553-8f10-716e04bc16b1 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:26:29.480926 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-bef9225b-959c-40f6-b13c-e0ff766a2fc0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:29.512038 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-0edadbcf-9c70-41d9-987e-54a0cfae40ba service neutron] Attempting to bind port fd466da6-f506-43e6-9800-156622bd2781 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:26:29.512375 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-0edadbcf-9c70-41d9-987e-54a0cfae40ba service neutron] Attempting to bind port fd466da6-f506-43e6-9800-156622bd2781 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:26:29.512822 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-0edadbcf-9c70-41d9-987e-54a0cfae40ba service neutron] Attempting to bind port fd466da6-f506-43e6-9800-156622bd2781 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:29.526754 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-0edadbcf-9c70-41d9-987e-54a0cfae40ba service neutron] Port fd466da6-f506-43e6-9800-156622bd2781 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:26:29.527143 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-0edadbcf-9c70-41d9-987e-54a0cfae40ba service neutron] Attempting to bind port fd466da6-f506-43e6-9800-156622bd2781 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:29.549666 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6919b2eb-5cea-4d3d-9c02-316dda55f579 req-52efaf02-8f7f-4767-856b-fe53dc5f3999 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/security-groups?id=c460cbfc-5960-42ff-abb9-4a137fb9cba6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0798066 Dec 09 21:26:29.551078 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-0edadbcf-9c70-41d9-987e-54a0cfae40ba service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 26, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:26:29.551427 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-0edadbcf-9c70-41d9-987e-54a0cfae40ba service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:29.551911 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-0edadbcf-9c70-41d9-987e-54a0cfae40ba service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:26:29.552307 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-0edadbcf-9c70-41d9-987e-54a0cfae40ba service neutron] Bound port: fd466da6-f506-43e6-9800-156622bd2781, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:26:29.552679 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-0edadbcf-9c70-41d9-987e-54a0cfae40ba service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:29.578954 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bef9225b-959c-40f6-b13c-e0ff766a2fc0 service neutron] Pushing event updated for resources: {'Port': ['ID=07457883-17db-4553-8f10-716e04bc16b1,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:29.640315 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-bef9225b-959c-40f6-b13c-e0ff766a2fc0 service neutron] Attempting to bind port 07457883-17db-4553-8f10-716e04bc16b1 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:26:29.640938 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-bef9225b-959c-40f6-b13c-e0ff766a2fc0 service neutron] Attempting to bind port 07457883-17db-4553-8f10-716e04bc16b1 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:26:29.641933 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-bef9225b-959c-40f6-b13c-e0ff766a2fc0 service neutron] Attempting to bind port 07457883-17db-4553-8f10-716e04bc16b1 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:29.649705 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-bef9225b-959c-40f6-b13c-e0ff766a2fc0 service neutron] Port 07457883-17db-4553-8f10-716e04bc16b1 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:26:29.650387 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-bef9225b-959c-40f6-b13c-e0ff766a2fc0 service neutron] Attempting to bind port 07457883-17db-4553-8f10-716e04bc16b1 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:29.657186 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-bef9225b-959c-40f6-b13c-e0ff766a2fc0 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 26, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:26:29.657611 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-bef9225b-959c-40f6-b13c-e0ff766a2fc0 service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:29.657911 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-bef9225b-959c-40f6-b13c-e0ff766a2fc0 service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:26:29.658718 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-bef9225b-959c-40f6-b13c-e0ff766a2fc0 service neutron] Bound port: 07457883-17db-4553-8f10-716e04bc16b1, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:26:29.658718 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-bef9225b-959c-40f6-b13c-e0ff766a2fc0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:29.733527 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-bef9225b-959c-40f6-b13c-e0ff766a2fc0 service neutron] For port 07457883-17db-4553-8f10-716e04bc16b1, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:26:29.741567 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-bef9225b-959c-40f6-b13c-e0ff766a2fc0 service neutron] For port 07457883-17db-4553-8f10-716e04bc16b1, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=07457883-17db-4553-8f10-716e04bc16b1,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:26:29.748325 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-bef9225b-959c-40f6-b13c-e0ff766a2fc0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:29.778354 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-0edadbcf-9c70-41d9-987e-54a0cfae40ba service neutron] For port fd466da6-f506-43e6-9800-156622bd2781, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:26:29.793374 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-bef9225b-959c-40f6-b13c-e0ff766a2fc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:29.793810 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-bef9225b-959c-40f6-b13c-e0ff766a2fc0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:29.795407 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-bef9225b-959c-40f6-b13c-e0ff766a2fc0 service neutron] 10.222.0.31 "PUT /v2.0/ports/07457883-17db-4553-8f10-716e04bc16b1 HTTP/1.1" status: 200 len: 1096 time: 0.9484348 Dec 09 21:26:29.795887 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '94826b5c-46f2-422a-a48d-eb415b5b9e44', 'tag': '07457883-17db-4553-8f10-716e04bc16b1'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:29.798909 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-614e4dfc-9066-4e24-b910-d0173ff5bfc8" -d '{"events": [{"name": "network-changed", "server_uuid": "94826b5c-46f2-422a-a48d-eb415b5b9e44", "tag": "07457883-17db-4553-8f10-716e04bc16b1"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:29.809002 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-0edadbcf-9c70-41d9-987e-54a0cfae40ba service neutron] For port fd466da6-f506-43e6-9800-156622bd2781, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=fd466da6-f506-43e6-9800-156622bd2781,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:26:29.832693 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bef9225b-959c-40f6-b13c-e0ff766a2fc0 service neutron] Pushing event updated for resources: {'Port': ['ID=07457883-17db-4553-8f10-716e04bc16b1,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:29.839145 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-feb21427-c77f-4fcc-a1d9-0f360e8fa5ce tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:29.848016 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-feb21427-c77f-4fcc-a1d9-0f360e8fa5ce tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/networks?id=de91a458-cde4-4265-8605-31d9b6f8f05f HTTP/1.1" status: 200 len: 810 time: 0.1860335 Dec 09 21:26:29.851732 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-0edadbcf-9c70-41d9-987e-54a0cfae40ba service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:29.866665 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['18bda486-9d6d-41a3-a260-dd244a3838b3', '2958b0be-15e5-48e2-b87a-6ffefd9a7859', '1ad36983-4549-4a03-a826-a31a08b98c98'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:29.911381 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-a49f1af9-8441-4739-8220-1f64ca420231 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:29.913018 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-a49f1af9-8441-4739-8220-1f64ca420231 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&device_id=94826b5c-46f2-422a-a48d-eb415b5b9e44 HTTP/1.1" status: 200 len: 1099 time: 0.0520175 Dec 09 21:26:29.929244 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-202b59ab-bfdc-42d1-80f1-502180ab9942 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/quotas/5635fb0018b24f538b250cdac6dca9d9 HTTP/1.1" status: 200 len: 375 time: 0.0744054 Dec 09 21:26:29.930539 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-0edadbcf-9c70-41d9-987e-54a0cfae40ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:29.931461 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-0edadbcf-9c70-41d9-987e-54a0cfae40ba service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:29.933582 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-0edadbcf-9c70-41d9-987e-54a0cfae40ba service neutron] 10.222.0.10 "PUT /v2.0/ports/fd466da6-f506-43e6-9800-156622bd2781 HTTP/1.1" status: 200 len: 1097 time: 1.4142709 Dec 09 21:26:29.936314 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c7f45d89-875f-4294-9fcb-17f7fc994b3f', 'tag': 'fd466da6-f506-43e6-9800-156622bd2781'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:29.939322 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ba176234-cc7a-4d65-bae4-3323b64bcd52" -d '{"events": [{"name": "network-changed", "server_uuid": "c7f45d89-875f-4294-9fcb-17f7fc994b3f", "tag": "fd466da6-f506-43e6-9800-156622bd2781"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:29.999708 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-5cb6bd29-026c-4b6f-a92d-6174c761051e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.99&port_id=07457883-17db-4553-8f10-716e04bc16b1 HTTP/1.1" status: 200 len: 217 time: 0.0650010 Dec 09 21:26:30.004920 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-0b3ec5a9-ebbb-4411-8bc4-7e1a78c66224 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=5635fb0018b24f538b250cdac6dca9d9&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0572183 Dec 09 21:26:30.021073 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0edadbcf-9c70-41d9-987e-54a0cfae40ba service neutron] Pushing event updated for resources: {'Port': ['ID=fd466da6-f506-43e6-9800-156622bd2781,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:30.045862 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc319c13-ead5-43b6-8a77-19b0d7ad2acc req-aea9bd16-7fad-4de7-bde0-2b43b094d38a tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:30.053653 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc319c13-ead5-43b6-8a77-19b0d7ad2acc req-aea9bd16-7fad-4de7-bde0-2b43b094d38a tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=45c77ac9-72d0-4458-b992-e48fbc0c9adb HTTP/1.1" status: 200 len: 946 time: 0.2045002 Dec 09 21:26:30.079380 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-1ef3f0db-68f8-487d-ae74-fcd55abad8fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:30.081135 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-1ef3f0db-68f8-487d-ae74-fcd55abad8fe service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0720024 Dec 09 21:26:30.122446 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '04d5c285-e8c5-448e-a7e8-5b0bbd69602f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e6c753d6-8187-435b-afd5-f77fe7d762ce'}, {'server_uuid': 'a17d0675-93b1-4ffe-a686-311f32edd826', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3eea4303-cbf9-4dd6-8eaa-de772b7d85f8'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:30.129961 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6e01e89e-1233-4a8e-830c-6cd52e8e2f98" -d '{"events": [{"server_uuid": "04d5c285-e8c5-448e-a7e8-5b0bbd69602f", "name": "network-vif-plugged", "status": "completed", "tag": "e6c753d6-8187-435b-afd5-f77fe7d762ce"}, {"server_uuid": "a17d0675-93b1-4ffe-a686-311f32edd826", "name": "network-vif-plugged", "status": "completed", "tag": "3eea4303-cbf9-4dd6-8eaa-de772b7d85f8"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:30.148684 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-44f31681-9720-4d14-a9f9-0e7095438a7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:30.150662 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-44f31681-9720-4d14-a9f9-0e7095438a7f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0554776 Dec 09 21:26:30.182420 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-cdece618-9368-4c32-a09a-cb7a67e4c564 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:30.184105 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-cdece618-9368-4c32-a09a-cb7a67e4c564 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&device_id=c7f45d89-875f-4294-9fcb-17f7fc994b3f HTTP/1.1" status: 200 len: 1100 time: 0.1781650 Dec 09 21:26:30.193210 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc319c13-ead5-43b6-8a77-19b0d7ad2acc req-c30523ae-fbcf-49ff-9aed-74efde519aa5 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/security-groups?id=0be95913-f7f5-4b8c-a0a8-1ef338e16419&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1387002 Dec 09 21:26:30.267228 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-6417df22-066f-4f1c-92d2-f8f658a4bac7 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.198&port_id=fd466da6-f506-43e6-9800-156622bd2781 HTTP/1.1" status: 200 len: 217 time: 0.0712733 Dec 09 21:26:30.273877 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-b70a8e6f-9762-4379-807a-bc6fcb8f7bf2 service neutron] 10.222.0.13 "GET /v2.0/networks/de91a458-cde4-4265-8605-31d9b6f8f05f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2538233 Dec 09 21:26:30.287145 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-38c9df59-bf85-4b6d-9077-048270408405 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1158624 Dec 09 21:26:30.398104 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-ff0f626a-23fc-4a24-be42-4de8f7b3fbb7 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0979919 Dec 09 21:26:30.666388 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-32258058-fe81-4afe-bda0-ee29f0b54599 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:30.667845 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-32258058-fe81-4afe-bda0-ee29f0b54599 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.3918643 Dec 09 21:26:30.677904 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44858ef7-cdb8-4a0a-b15e-09e5503da6e7 req-895df131-bf06-43db-bbfd-8602a15039af tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:30.679354 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44858ef7-cdb8-4a0a-b15e-09e5503da6e7 req-895df131-bf06-43db-bbfd-8602a15039af tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.4045844 Dec 09 21:26:30.708414 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0313f1b-759c-4082-b05e-5f5fa987ad30 req-001f3827-ffbb-472c-9d7d-844161dcf7b7 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:30.709890 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a0313f1b-759c-4082-b05e-5f5fa987ad30 req-001f3827-ffbb-472c-9d7d-844161dcf7b7 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.31 "GET /v2.0/ports?device_id=45c77ac9-72d0-4458-b992-e48fbc0c9adb HTTP/1.1" status: 200 len: 946 time: 0.0500383 Dec 09 21:26:30.745737 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-95be6e6f-082e-4852-881f-3f0798793ffa service neutron] 10.222.0.13 "GET /v2.0/networks/de91a458-cde4-4265-8605-31d9b6f8f05f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4613013 Dec 09 21:26:30.770149 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-8bea79b5-a55d-4cfb-aafa-c134a283e50e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:30.771693 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-8bea79b5-a55d-4cfb-aafa-c134a283e50e service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0913899 Dec 09 21:26:30.776826 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44858ef7-cdb8-4a0a-b15e-09e5503da6e7 req-81b6fcbb-3470-41fe-9748-002b1b7f18f3 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0873983 Dec 09 21:26:30.831365 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-a0313f1b-759c-4082-b05e-5f5fa987ad30 req-4d37718a-0642-4ace-b8ee-6a47c30e1038 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Deleting port 420d466e-c77f-433f-9763-037f0389654e {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:26:30.831654 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a0313f1b-759c-4082-b05e-5f5fa987ad30 req-4d37718a-0642-4ace-b8ee-6a47c30e1038 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:30.932672 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-a0313f1b-759c-4082-b05e-5f5fa987ad30 req-4d37718a-0642-4ace-b8ee-6a47c30e1038 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] For port 420d466e-c77f-433f-9763-037f0389654e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=420d466e-c77f-433f-9763-037f0389654e,segment=NetworkSegment(bada42e9-278b-46e3-bbc2-c2d37f00c32d),segment_id=bada42e9-278b-46e3-bbc2-c2d37f00c32d)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:30.933087 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a0313f1b-759c-4082-b05e-5f5fa987ad30 req-4d37718a-0642-4ace-b8ee-6a47c30e1038 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:30.943902 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-dc43a9f9-1cc3-4bf7-9e49-e76bd0e445e7 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1642833 Dec 09 21:26:30.948692 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-a0313f1b-759c-4082-b05e-5f5fa987ad30 req-4d37718a-0642-4ace-b8ee-6a47c30e1038 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Calling delete_port for 420d466e-c77f-433f-9763-037f0389654e owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:26:30.956120 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08ab457a-93ca-46ad-bec6-adb1068bd8b8 req-ee7ba3c9-ff25-42a0-b78b-4d3d77cab406 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:30.962900 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08ab457a-93ca-46ad-bec6-adb1068bd8b8 req-ee7ba3c9-ff25-42a0-b78b-4d3d77cab406 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:30.964975 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-08ab457a-93ca-46ad-bec6-adb1068bd8b8 req-ee7ba3c9-ff25-42a0-b78b-4d3d77cab406 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=a17d0675-93b1-4ffe-a686-311f32edd826 HTTP/1.1" status: 200 len: 1682 time: 0.0974410 Dec 09 21:26:30.995084 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9dade5d6-e74e-4781-b65c-e7e00ac05432 x-openstack-request-id: req-9dade5d6-e74e-4781-b65c-e7e00ac05432 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:30.995552 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "94826b5c-46f2-422a-a48d-eb415b5b9e44", "tag": "07457883-17db-4553-8f10-716e04bc16b1", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:30.995685 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-9dade5d6-e74e-4781-b65c-e7e00ac05432 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:30.996023 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '94826b5c-46f2-422a-a48d-eb415b5b9e44', 'tag': '07457883-17db-4553-8f10-716e04bc16b1', 'status': 'completed', 'code': 200} Dec 09 21:26:31.056549 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-17dea400-5e84-4c35-99c5-d32d5488ece7 x-openstack-request-id: req-17dea400-5e84-4c35-99c5-d32d5488ece7 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:31.056849 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c7f45d89-875f-4294-9fcb-17f7fc994b3f", "tag": "fd466da6-f506-43e6-9800-156622bd2781", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:31.057104 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-17dea400-5e84-4c35-99c5-d32d5488ece7 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:31.057504 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c7f45d89-875f-4294-9fcb-17f7fc994b3f', 'tag': 'fd466da6-f506-43e6-9800-156622bd2781', 'status': 'completed', 'code': 200} Dec 09 21:26:31.063295 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-614e4dfc-9066-4e24-b910-d0173ff5bfc8 req-10aabdc1-3cec-4ab9-bd44-e43998f6eee3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:31.064877 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-614e4dfc-9066-4e24-b910-d0173ff5bfc8 req-10aabdc1-3cec-4ab9-bd44-e43998f6eee3 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&device_id=94826b5c-46f2-422a-a48d-eb415b5b9e44 HTTP/1.1" status: 200 len: 1099 time: 0.0666511 Dec 09 21:26:31.103903 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-08ab457a-93ca-46ad-bec6-adb1068bd8b8 req-faf87c9a-d61d-4330-9f51-b18122bf1115 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1296482 Dec 09 21:26:31.124926 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4679a4-bf8a-4ee8-8225-05a36ef34558 req-b5e4c24e-765a-42ee-a259-978fe4936c4e service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1587307 Dec 09 21:26:31.168690 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e385459d-2a23-4678-810e-f08b67756828 x-openstack-request-id: req-e385459d-2a23-4678-810e-f08b67756828 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:31.169270 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "04d5c285-e8c5-448e-a7e8-5b0bbd69602f", "name": "network-vif-plugged", "status": "completed", "tag": "e6c753d6-8187-435b-afd5-f77fe7d762ce", "code": 200}, {"server_uuid": "a17d0675-93b1-4ffe-a686-311f32edd826", "name": "network-vif-plugged", "status": "completed", "tag": "3eea4303-cbf9-4dd6-8eaa-de772b7d85f8", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:31.169386 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e385459d-2a23-4678-810e-f08b67756828 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:31.169896 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '04d5c285-e8c5-448e-a7e8-5b0bbd69602f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e6c753d6-8187-435b-afd5-f77fe7d762ce', 'code': 200} Dec 09 21:26:31.170167 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a17d0675-93b1-4ffe-a686-311f32edd826', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3eea4303-cbf9-4dd6-8eaa-de772b7d85f8', 'code': 200} Dec 09 21:26:31.228145 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a0313f1b-759c-4082-b05e-5f5fa987ad30 req-4d37718a-0642-4ace-b8ee-6a47c30e1038 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:31.240541 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['a0a1eab9-7a2d-4b73-9918-01919710bdbe', '420d466e-c77f-433f-9763-037f0389654e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:31.241858 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-614e4dfc-9066-4e24-b910-d0173ff5bfc8 req-4fa01536-6d3b-4df1-a3ce-016a713690ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:31.245615 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-614e4dfc-9066-4e24-b910-d0173ff5bfc8 req-4fa01536-6d3b-4df1-a3ce-016a713690ad service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.1660850 Dec 09 21:26:31.274196 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d37718a-0642-4ace-b8ee-6a47c30e1038 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Pushing event deleted for resources: {'Port': ['ID=420d466e-c77f-433f-9763-037f0389654e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:31.334579 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-484449f2-2629-4e61-aaa9-f89022767a70 req-5531ac0c-0ba3-4bf8-bbbf-e350d7621b2f tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:31.340912 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-614e4dfc-9066-4e24-b910-d0173ff5bfc8 req-5c9b56e7-e797-48d8-a473-08f91e185d4d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.99&port_id=07457883-17db-4553-8f10-716e04bc16b1 HTTP/1.1" status: 200 len: 217 time: 0.0680873 Dec 09 21:26:31.342763 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-484449f2-2629-4e61-aaa9-f89022767a70 req-5531ac0c-0ba3-4bf8-bbbf-e350d7621b2f tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=c7f45d89-875f-4294-9fcb-17f7fc994b3f HTTP/1.1" status: 200 len: 948 time: 0.2167306 Dec 09 21:26:31.430026 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-a0313f1b-759c-4082-b05e-5f5fa987ad30 req-4d37718a-0642-4ace-b8ee-6a47c30e1038 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] No DVR routers for this DVR port 420d466e-c77f-433f-9763-037f0389654e on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:26:31.432443 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba176234-cc7a-4d65-bae4-3323b64bcd52 req-e281f294-a680-4fb3-943f-ac1548ad1f4a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:31.434124 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a0313f1b-759c-4082-b05e-5f5fa987ad30 req-4d37718a-0642-4ace-b8ee-6a47c30e1038 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:31.434280 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba176234-cc7a-4d65-bae4-3323b64bcd52 req-e281f294-a680-4fb3-943f-ac1548ad1f4a service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&device_id=c7f45d89-875f-4294-9fcb-17f7fc994b3f HTTP/1.1" status: 200 len: 1100 time: 0.2240088 Dec 09 21:26:31.437570 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a0313f1b-759c-4082-b05e-5f5fa987ad30 req-4d37718a-0642-4ace-b8ee-6a47c30e1038 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.31 "DELETE /v2.0/ports/420d466e-c77f-433f-9763-037f0389654e HTTP/1.1" status: 204 len: 173 time: 0.7210793 Dec 09 21:26:31.468752 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7757e507-3625-45e4-8e50-09b98130fa95 req-c764ad59-d7ee-4d8b-ae28-122ccd924a1e tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:31.470486 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7757e507-3625-45e4-8e50-09b98130fa95 req-c764ad59-d7ee-4d8b-ae28-122ccd924a1e tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/ports?device_id=04d5c285-e8c5-448e-a7e8-5b0bbd69602f HTTP/1.1" status: 200 len: 946 time: 0.2380562 Dec 09 21:26:31.477314 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d058479d-36c9-40f9-aca4-6f98a0f693b4 req-f53b06d1-e155-4a38-a538-e8e0d6f18bd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:31.477804 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d058479d-36c9-40f9-aca4-6f98a0f693b4 req-f53b06d1-e155-4a38-a538-e8e0d6f18bd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:31.479365 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d058479d-36c9-40f9-aca4-6f98a0f693b4 req-f53b06d1-e155-4a38-a538-e8e0d6f18bd3 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=a17d0675-93b1-4ffe-a686-311f32edd826 HTTP/1.1" status: 200 len: 1986 time: 0.1674457 Dec 09 21:26:31.507417 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16e81a0c-c954-4eec-9ff4-63d36be73be8 req-70d88aac-2e6a-4456-9e76-75dc428d2b41 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:31.509415 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-16e81a0c-c954-4eec-9ff4-63d36be73be8 req-70d88aac-2e6a-4456-9e76-75dc428d2b41 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.31 "GET /v2.0/ports?device_id=1a86f14a-2802-4e38-b9dd-4568a02642fc HTTP/1.1" status: 200 len: 945 time: 0.1781561 Dec 09 21:26:31.519048 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-614e4dfc-9066-4e24-b910-d0173ff5bfc8 req-f63d486f-8ab8-4534-9327-9150133305eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:31.520127 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-484449f2-2629-4e61-aaa9-f89022767a70 req-f3732c8c-9329-47cf-963f-85cd0687e0d8 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1717169 Dec 09 21:26:31.520699 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-614e4dfc-9066-4e24-b910-d0173ff5bfc8 req-f63d486f-8ab8-4534-9327-9150133305eb service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1338830 Dec 09 21:26:31.522549 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c972c87-1713-43b5-8d57-58fe5b7d99cf req-0affcf96-ec38-424a-afda-1b4a867a4931 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:31.524064 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2c972c87-1713-43b5-8d57-58fe5b7d99cf req-0affcf96-ec38-424a-afda-1b4a867a4931 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=04d5c285-e8c5-448e-a7e8-5b0bbd69602f HTTP/1.1" status: 200 len: 1098 time: 0.1914494 Dec 09 21:26:31.660886 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7757e507-3625-45e4-8e50-09b98130fa95 req-0b044262-7a7f-4a46-877b-6c68d701f262 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/security-groups?id=c460cbfc-5960-42ff-abb9-4a137fb9cba6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1704261 Dec 09 21:26:31.662055 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2c972c87-1713-43b5-8d57-58fe5b7d99cf req-6f03bcd6-c863-4913-9f2d-3054254895bb service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=c460cbfc-5960-42ff-abb9-4a137fb9cba6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1156404 Dec 09 21:26:31.665679 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-614e4dfc-9066-4e24-b910-d0173ff5bfc8 req-0c067c93-7c50-467d-9a3f-c4492abdb0a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:31.667050 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-614e4dfc-9066-4e24-b910-d0173ff5bfc8 req-0c067c93-7c50-467d-9a3f-c4492abdb0a2 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1306138 Dec 09 21:26:31.695471 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-16e81a0c-c954-4eec-9ff4-63d36be73be8 req-6f11798e-6835-4a75-bed5-46430727d0e6 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Deleting port a0a1eab9-7a2d-4b73-9918-01919710bdbe {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:26:31.695893 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-16e81a0c-c954-4eec-9ff4-63d36be73be8 req-6f11798e-6835-4a75-bed5-46430727d0e6 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:31.722427 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a6eb7cb-fdf6-460c-a7d3-da00b30d76cb req-78f2d1d4-c305-4d73-bf85-1d7a925600b2 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=dffe3c86-0677-4490-a36a-8bed7d798809 HTTP/1.1" status: 200 len: 210 time: 0.0555534 Dec 09 21:26:31.728006 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d058479d-36c9-40f9-aca4-6f98a0f693b4 req-341bf025-baff-46ad-a206-17ea759d735d service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2358963 Dec 09 21:26:31.737681 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba176234-cc7a-4d65-bae4-3323b64bcd52 req-ededf4ac-c9ae-4f0c-94ed-34fafa527493 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:31.739183 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba176234-cc7a-4d65-bae4-3323b64bcd52 req-ededf4ac-c9ae-4f0c-94ed-34fafa527493 service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.2924075 Dec 09 21:26:31.803561 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba176234-cc7a-4d65-bae4-3323b64bcd52 req-2c881138-b64f-445a-8cc5-24f984a28bc7 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.198&port_id=fd466da6-f506-43e6-9800-156622bd2781 HTTP/1.1" status: 200 len: 217 time: 0.0487115 Dec 09 21:26:31.807633 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-16e81a0c-c954-4eec-9ff4-63d36be73be8 req-6f11798e-6835-4a75-bed5-46430727d0e6 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] For port a0a1eab9-7a2d-4b73-9918-01919710bdbe, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a0a1eab9-7a2d-4b73-9918-01919710bdbe,segment=NetworkSegment(bada42e9-278b-46e3-bbc2-c2d37f00c32d),segment_id=bada42e9-278b-46e3-bbc2-c2d37f00c32d)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:31.808193 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-16e81a0c-c954-4eec-9ff4-63d36be73be8 req-6f11798e-6835-4a75-bed5-46430727d0e6 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:31.830093 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-16e81a0c-c954-4eec-9ff4-63d36be73be8 req-6f11798e-6835-4a75-bed5-46430727d0e6 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Calling delete_port for a0a1eab9-7a2d-4b73-9918-01919710bdbe owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:26:31.863619 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ad35b4e-0f01-4b9b-86ea-eed7daba7929 req-e03c8651-f3d1-44e8-8682-05c2ef964ffc tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=45c77ac9-72d0-4458-b992-e48fbc0c9adb HTTP/1.1" status: 200 len: 210 time: 0.0631201 Dec 09 21:26:31.910592 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba176234-cc7a-4d65-bae4-3323b64bcd52 req-2fdae9f5-1b18-460e-995d-c6645ba579cc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:31.912098 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba176234-cc7a-4d65-bae4-3323b64bcd52 req-2fdae9f5-1b18-460e-995d-c6645ba579cc service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1002984 Dec 09 21:26:31.956899 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf995f0a-926a-4d52-97e3-010ee339f2df req-1146035f-07de-4b0d-bd8a-59ea7374f70b tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:31.958645 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf995f0a-926a-4d52-97e3-010ee339f2df req-1146035f-07de-4b0d-bd8a-59ea7374f70b tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.0800705 Dec 09 21:26:31.991691 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba176234-cc7a-4d65-bae4-3323b64bcd52 req-e2989a75-4877-40f3-a0af-d7337c8ba3d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:31.993577 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba176234-cc7a-4d65-bae4-3323b64bcd52 req-e2989a75-4877-40f3-a0af-d7337c8ba3d3 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0732429 Dec 09 21:26:31.997329 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-16e81a0c-c954-4eec-9ff4-63d36be73be8 req-6f11798e-6835-4a75-bed5-46430727d0e6 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:32.013837 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['420d466e-c77f-433f-9763-037f0389654e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:32.030700 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f11798e-6835-4a75-bed5-46430727d0e6 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Pushing event deleted for resources: {'Port': ['ID=a0a1eab9-7a2d-4b73-9918-01919710bdbe,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:32.046181 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf995f0a-926a-4d52-97e3-010ee339f2df req-bef89a97-8153-4517-a1cf-26b60f1661ff tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0776696 Dec 09 21:26:32.061683 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39480) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:32.086125 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-16e81a0c-c954-4eec-9ff4-63d36be73be8 req-6f11798e-6835-4a75-bed5-46430727d0e6 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] No DVR routers for this DVR port a0a1eab9-7a2d-4b73-9918-01919710bdbe on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:26:32.088721 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-16e81a0c-c954-4eec-9ff4-63d36be73be8 req-6f11798e-6835-4a75-bed5-46430727d0e6 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:32.092188 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-16e81a0c-c954-4eec-9ff4-63d36be73be8 req-6f11798e-6835-4a75-bed5-46430727d0e6 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.31 "DELETE /v2.0/ports/a0a1eab9-7a2d-4b73-9918-01919710bdbe HTTP/1.1" status: 204 len: 173 time: 0.5671544 Dec 09 21:26:32.136945 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba176234-cc7a-4d65-bae4-3323b64bcd52 req-615ab9bf-0783-49b4-b591-ecc606b5968f service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1314650 Dec 09 21:26:32.236328 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6e139cb4-5e12-48b8-97b9-919df17ef78d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:32.283219 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e891467-c810-4443-ba92-849e77ad05c5 req-ab75c809-1207-4ab2-afb4-1d4e5f0bf4ba tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:32.289940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e891467-c810-4443-ba92-849e77ad05c5 req-ab75c809-1207-4ab2-afb4-1d4e5f0bf4ba tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:32.291840 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e891467-c810-4443-ba92-849e77ad05c5 req-ab75c809-1207-4ab2-afb4-1d4e5f0bf4ba tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=a17d0675-93b1-4ffe-a686-311f32edd826 HTTP/1.1" status: 200 len: 1682 time: 0.1138620 Dec 09 21:26:32.300094 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-614e4dfc-9066-4e24-b910-d0173ff5bfc8 req-a0633289-1e0a-485c-bffa-de1db541fe0d service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1632149 Dec 09 21:26:32.323715 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba176234-cc7a-4d65-bae4-3323b64bcd52 req-1d90a9f2-3e71-4577-8427-dbfeaccf4d25 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1673057 Dec 09 21:26:32.355583 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e891467-c810-4443-ba92-849e77ad05c5 req-4e459651-3bca-4646-bee8-46c0d9b8d8ad tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0560513 Dec 09 21:26:32.386665 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6e139cb4-5e12-48b8-97b9-919df17ef78d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:32.393145 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6e139cb4-5e12-48b8-97b9-919df17ef78d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:32.447676 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6e139cb4-5e12-48b8-97b9-919df17ef78d admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=9401eb7d94d941b4acb4cea9eb433758&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3848774 Dec 09 21:26:32.448760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e139cb4-5e12-48b8-97b9-919df17ef78d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fdbc0117-f4b4-4141-9dd2-c7f44a42763e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:32.450757 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39486) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:32.453114 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-614e4dfc-9066-4e24-b910-d0173ff5bfc8 req-32bcb71e-1488-4624-8077-379f9b743080 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1443946 Dec 09 21:26:32.504930 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-736656d3-3022-424d-b7da-273c7de1c4a8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:32.529092 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-736656d3-3022-424d-b7da-273c7de1c4a8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:32.588772 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-736656d3-3022-424d-b7da-273c7de1c4a8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:32.593097 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-736656d3-3022-424d-b7da-273c7de1c4a8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:32.595972 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-736656d3-3022-424d-b7da-273c7de1c4a8 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/fdbc0117-f4b4-4141-9dd2-c7f44a42763e HTTP/1.1" status: 204 len: 168 time: 0.1423781 Dec 09 21:26:32.603464 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-736656d3-3022-424d-b7da-273c7de1c4a8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fdbc0117-f4b4-4141-9dd2-c7f44a42763e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:32.682897 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1dc3623-94c5-40e4-8002-092e805bd143 req-e2aa2ad6-4381-4b9c-ba86-11418e285259 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:32.688121 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c1dc3623-94c5-40e4-8002-092e805bd143 req-e2aa2ad6-4381-4b9c-ba86-11418e285259 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=c7f45d89-875f-4294-9fcb-17f7fc994b3f HTTP/1.1" status: 200 len: 948 time: 0.0781109 Dec 09 21:26:32.751115 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c1dc3623-94c5-40e4-8002-092e805bd143 req-a10dc948-8fe9-432e-9e27-e2187daf0163 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0594888 Dec 09 21:26:32.862173 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c4f67c53-ee5f-4b72-be6f-b4bb9e68d893 req-a91df2ae-9d78-41b3-a59c-21b1e29060f9 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=dffe3c86-0677-4490-a36a-8bed7d798809 HTTP/1.1" status: 200 len: 210 time: 0.0375149 Dec 09 21:26:32.870560 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfc5eb9f-c59c-4919-8f3f-f925f9a15356 req-0d8f43ad-a7c9-4a72-a8e7-dfe2033aa92d tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:32.872233 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cfc5eb9f-c59c-4919-8f3f-f925f9a15356 req-0d8f43ad-a7c9-4a72-a8e7-dfe2033aa92d tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/ports?device_id=04d5c285-e8c5-448e-a7e8-5b0bbd69602f HTTP/1.1" status: 200 len: 946 time: 0.0923536 Dec 09 21:26:32.936005 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-afdb1001-4475-4700-8e45-444b3f781757 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:32.939719 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cfc5eb9f-c59c-4919-8f3f-f925f9a15356 req-8c2a2337-3813-4bdf-bb86-136f78c30834 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/security-groups?id=c460cbfc-5960-42ff-abb9-4a137fb9cba6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0607004 Dec 09 21:26:32.997187 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '45c77ac9-72d0-4458-b992-e48fbc0c9adb', 'name': 'network-vif-deleted', 'tag': '420d466e-c77f-433f-9763-037f0389654e'}, {'server_uuid': '1a86f14a-2802-4e38-b9dd-4568a02642fc', 'name': 'network-vif-deleted', 'tag': 'a0a1eab9-7a2d-4b73-9918-01919710bdbe'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:33.001767 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b4846e0d-d0fb-4796-acd3-bbf1b75ca05c" -d '{"events": [{"server_uuid": "45c77ac9-72d0-4458-b992-e48fbc0c9adb", "name": "network-vif-deleted", "tag": "420d466e-c77f-433f-9763-037f0389654e"}, {"server_uuid": "1a86f14a-2802-4e38-b9dd-4568a02642fc", "name": "network-vif-deleted", "tag": "a0a1eab9-7a2d-4b73-9918-01919710bdbe"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:33.031104 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04028dc2-f6b8-4665-90d0-580a51856ff5 req-3aed885b-10b0-43c9-986b-dc450f47e011 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a86f14a-2802-4e38-b9dd-4568a02642fc HTTP/1.1" status: 200 len: 210 time: 0.0306339 Dec 09 21:26:33.047670 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fccc4dc3-daad-47b2-930b-60fe4f036ee3 x-openstack-request-id: req-fccc4dc3-daad-47b2-930b-60fe4f036ee3 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:33.047670 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "45c77ac9-72d0-4458-b992-e48fbc0c9adb", "name": "network-vif-deleted", "tag": "420d466e-c77f-433f-9763-037f0389654e", "status": "completed", "code": 200}, {"server_uuid": "1a86f14a-2802-4e38-b9dd-4568a02642fc", "name": "network-vif-deleted", "tag": "a0a1eab9-7a2d-4b73-9918-01919710bdbe", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:33.047670 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-fccc4dc3-daad-47b2-930b-60fe4f036ee3 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:33.047670 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '45c77ac9-72d0-4458-b992-e48fbc0c9adb', 'name': 'network-vif-deleted', 'tag': '420d466e-c77f-433f-9763-037f0389654e', 'status': 'completed', 'code': 200} Dec 09 21:26:33.047670 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1a86f14a-2802-4e38-b9dd-4568a02642fc', 'name': 'network-vif-deleted', 'tag': 'a0a1eab9-7a2d-4b73-9918-01919710bdbe', 'status': 'completed', 'code': 200} Dec 09 21:26:33.086298 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 07457883-17db-4553-8f10-716e04bc16b1 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:26:33.184286 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9352c01c-dbb7-4b5d-a797-97e26ee70825 req-90c3b5a5-a978-4510-bae7-5f1f858594d0 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:33.186558 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9352c01c-dbb7-4b5d-a797-97e26ee70825 req-90c3b5a5-a978-4510-bae7-5f1f858594d0 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.0653391 Dec 09 21:26:33.196804 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 07457883-17db-4553-8f10-716e04bc16b1, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=07457883-17db-4553-8f10-716e04bc16b1,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:33.210409 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '07457883-17db-4553-8f10-716e04bc16b1', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '07457883-17db-4553-8f10-716e04bc16b1', 'mac_address': 'fa:16:3e:b6:5e:cc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.99'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:26:33.257975 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:33.263810 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9352c01c-dbb7-4b5d-a797-97e26ee70825 req-2b8ab982-4486-4661-b0b7-5608c1819ada tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0707238 Dec 09 21:26:33.281074 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 07457883-17db-4553-8f10-716e04bc16b1 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:33.313351 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 07457883-17db-4553-8f10-716e04bc16b1, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=07457883-17db-4553-8f10-716e04bc16b1,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:33.318652 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:33.369685 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=07457883-17db-4553-8f10-716e04bc16b1,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:33.411981 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39526) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:33.482639 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdf64235-3f9f-4266-b77d-fdc868842595 req-39cb70b7-4aa0-4597-8917-4c1746128322 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:33.493144 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdf64235-3f9f-4266-b77d-fdc868842595 req-39cb70b7-4aa0-4597-8917-4c1746128322 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:33.496067 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fdf64235-3f9f-4266-b77d-fdc868842595 req-39cb70b7-4aa0-4597-8917-4c1746128322 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=a17d0675-93b1-4ffe-a686-311f32edd826 HTTP/1.1" status: 200 len: 1682 time: 0.0673549 Dec 09 21:26:33.527207 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-a0e31e3b-2b68-4558-bb52-968fef16a3c2 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:33.529377 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-a0e31e3b-2b68-4558-bb52-968fef16a3c2 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.31 "GET /v2.0/networks?id=de91a458-cde4-4265-8605-31d9b6f8f05f HTTP/1.1" status: 200 len: 810 time: 0.1522706 Dec 09 21:26:33.556019 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Request body: {'network': {'name': 'tempest-ServerDiskConfigTestJSON-1761243015-network', 'tenant_id': '18e7af94d60344a18dedc56eda040c4b'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:33.559058 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-342cca87-0582-4087-afc8-b75e33298607 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Request body: {'port': {'device_id': 'dffe3c86-0677-4490-a36a-8bed7d798809', 'network_id': 'de91a458-cde4-4265-8605-31d9b6f8f05f', 'admin_state_up': True, 'tenant_id': '5635fb0018b24f538b250cdac6dca9d9'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:33.588613 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fdf64235-3f9f-4266-b77d-fdc868842595 req-fc5db450-ed3b-4507-9db5-ad8e7ac1c818 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0858343 Dec 09 21:26:33.610985 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Made reservation on behalf of 18e7af94d60344a18dedc56eda040c4b for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:33.615121 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:33.622605 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:33.688688 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-342cca87-0582-4087-afc8-b75e33298607 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Made reservation on behalf of 5635fb0018b24f538b250cdac6dca9d9 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:33.692293 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-342cca87-0582-4087-afc8-b75e33298607 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:33.703619 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:33.715552 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:33.719367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['07457883-17db-4553-8f10-716e04bc16b1'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:33.735565 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] vlan segment allocate from pool success with {'vlan_id': 138, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:26:33.753619 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:33.753971 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Added segment e3c687b5-afac-4ac8-9b38-06599c2a8b7e of type vlan for network 4d446a14-1218-469d-93aa-b4f9babdbb6e Dec 09 21:26:33.755157 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=09461f3e-b584-4926-824b-56cad478d61b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:33.784445 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:33.784797 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:33.785138 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:33.785468 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:33.787448 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:33.787448 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:33.787448 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:33.787828 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:33.788073 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:33.788255 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:33.788946 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:33.788946 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:33.789179 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:33.847737 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:33.877087 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:33.879684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:33.880341 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:33.903584 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-342cca87-0582-4087-afc8-b75e33298607 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Allocated IP 172.20.0.14 (de91a458-cde4-4265-8605-31d9b6f8f05f/cb187a9c-ec94-4995-93f8-92c16c7a80a3/b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:26:33.958267 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.5450945 Dec 09 21:26:33.963174 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39538) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:33.969780 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-de209f75-f0d6-468e-80c7-97cfc085a22a admin admin] Request body: {'subnet': {'network_id': '4d446a14-1218-469d-93aa-b4f9babdbb6e', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerDiskConfigTestJSON-1761243015-subnet', 'tenant_id': '18e7af94d60344a18dedc56eda040c4b', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:33.997622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfa6d7d6-8daf-455c-914c-9a624bab1546 admin admin] Pushing event updated for resources: {'Network': ['ID=4d446a14-1218-469d-93aa-b4f9babdbb6e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:34.011223 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 4d446a14-1218-469d-93aa-b4f9babdbb6e details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:26:34.038669 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7367dbde-bb3c-45c3-a177-171cf2c42ef3 req-a52786bb-692e-4daa-ae3b-df092d4e23f6 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=dffe3c86-0677-4490-a36a-8bed7d798809 HTTP/1.1" status: 200 len: 210 time: 0.0358527 Dec 09 21:26:34.054950 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b6b7c50-f4c8-42b0-af66-f9ed62789390 req-89c3513b-0221-4a5e-aabf-29f2f6c5a840 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:34.056700 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b6b7c50-f4c8-42b0-af66-f9ed62789390 req-89c3513b-0221-4a5e-aabf-29f2f6c5a840 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=c7f45d89-875f-4294-9fcb-17f7fc994b3f HTTP/1.1" status: 200 len: 948 time: 0.1641212 Dec 09 21:26:34.077067 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-de209f75-f0d6-468e-80c7-97cfc085a22a admin admin] Made reservation on behalf of 18e7af94d60344a18dedc56eda040c4b for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:34.079901 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de209f75-f0d6-468e-80c7-97cfc085a22a admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:34.113142 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device fd466da6-f506-43e6-9800-156622bd2781 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:26:34.130176 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b6b7c50-f4c8-42b0-af66-f9ed62789390 req-cf320c71-f855-4702-9f41-d246288eaad3 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0659509 Dec 09 21:26:34.170616 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-342cca87-0582-4087-afc8-b75e33298607 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:34.207504 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39542) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:34.230811 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4941536-6544-4050-b06b-63cd74c99f4b req-ff048e34-3bb4-4a58-94c0-c713cd47d1ae tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:34.232715 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d4941536-6544-4050-b06b-63cd74c99f4b req-ff048e34-3bb4-4a58-94c0-c713cd47d1ae tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/ports?device_id=04d5c285-e8c5-448e-a7e8-5b0bbd69602f HTTP/1.1" status: 200 len: 946 time: 0.0823488 Dec 09 21:26:34.236375 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port fd466da6-f506-43e6-9800-156622bd2781, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=fd466da6-f506-43e6-9800-156622bd2781,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:34.248932 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'fd466da6-f506-43e6-9800-156622bd2781', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': 'fd466da6-f506-43e6-9800-156622bd2781', 'mac_address': 'fa:16:3e:32:75:bd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.198'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:26:34.287302 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d4941536-6544-4050-b06b-63cd74c99f4b req-afb1d42c-2fcb-4e99-8b77-a98e9b9e9bb0 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/security-groups?id=c460cbfc-5960-42ff-abb9-4a137fb9cba6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473573 Dec 09 21:26:34.295719 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-342cca87-0582-4087-afc8-b75e33298607 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:34.307358 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-52d8e1e4-0e2a-4fbd-90dd-c4671e4dd7fe admin admin] Deleting subnet 5b18bb60-11fe-4ddd-8fd3-bcb36985a134 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:26:34.338278 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-52d8e1e4-0e2a-4fbd-90dd-c4671e4dd7fe admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:34.344648 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:34.359875 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fd466da6-f506-43e6-9800-156622bd2781 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:34.394810 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port fd466da6-f506-43e6-9800-156622bd2781, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=fd466da6-f506-43e6-9800-156622bd2781,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:34.396775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-342cca87-0582-4087-afc8-b75e33298607 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Network de91a458-cde4-4265-8605-31d9b6f8f05f is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:26:34.402183 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:34.423745 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50f6854d-d408-4969-a61a-6daeb769cc79 req-8c2de35f-fa28-4d78-a36d-1bb0eb71da8d tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:34.425978 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50f6854d-d408-4969-a61a-6daeb769cc79 req-8c2de35f-fa28-4d78-a36d-1bb0eb71da8d tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.0709858 Dec 09 21:26:34.435705 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-342cca87-0582-4087-afc8-b75e33298607 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:34.441261 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-342cca87-0582-4087-afc8-b75e33298607 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event updated for resources: {'Port': ['ID=b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:34.446117 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-52d8e1e4-0e2a-4fbd-90dd-c4671e4dd7fe admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:34.448258 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-342cca87-0582-4087-afc8-b75e33298607 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:26:34.480890 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=fd466da6-f506-43e6-9800-156622bd2781,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:34.497848 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50f6854d-d408-4969-a61a-6daeb769cc79 req-701a624c-bd9d-449b-95b6-bf264070acdc tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0641046 Dec 09 21:26:34.519294 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de209f75-f0d6-468e-80c7-97cfc085a22a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:34.574141 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-52d8e1e4-0e2a-4fbd-90dd-c4671e4dd7fe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:34.584967 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-342cca87-0582-4087-afc8-b75e33298607 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:34.585588 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-342cca87-0582-4087-afc8-b75e33298607 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:34.615495 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['fd466da6-f506-43e6-9800-156622bd2781'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:34.636906 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89e08b0b-d2ed-4624-a8c3-08a5307bcd79 req-06ddc06e-c418-4ce1-a6a6-b156df112f4f tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:34.638629 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89e08b0b-d2ed-4624-a8c3-08a5307bcd79 req-06ddc06e-c418-4ce1-a6a6-b156df112f4f tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/ports?device_id=04d5c285-e8c5-448e-a7e8-5b0bbd69602f HTTP/1.1" status: 200 len: 946 time: 0.0737848 Dec 09 21:26:34.684817 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de209f75-f0d6-468e-80c7-97cfc085a22a admin admin] Pushing event updated for resources: {'Subnet': ['ID=75afc53b-d3f3-461c-aba4-c2ce93780246,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:34.692706 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-342cca87-0582-4087-afc8-b75e33298607 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.1385355 Dec 09 21:26:34.701086 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de209f75-f0d6-468e-80c7-97cfc085a22a admin admin] Checking segment: {'id': 'e3c687b5-afac-4ac8-9b38-06599c2a8b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '4d446a14-1218-469d-93aa-b4f9babdbb6e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:34.701535 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de209f75-f0d6-468e-80c7-97cfc085a22a admin admin] Network hostable DHCP agents. Network: 4d446a14-1218-469d-93aa-b4f9babdbb6e, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:26:34.714685 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-92934f26-ff85-4ebd-8b27-7da490b296b1 service neutron] Request body: {'port': {'device_id': 'dffe3c86-0677-4490-a36a-8bed7d798809', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:34.743575 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-52d8e1e4-0e2a-4fbd-90dd-c4671e4dd7fe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:34.746831 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c92b2b77-4d2d-4a62-a176-c7b41e4a660d req-f339b237-ab64-4ca4-afbc-c9796ee7767d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:34.747970 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89e08b0b-d2ed-4624-a8c3-08a5307bcd79 req-cb9f1023-3c46-4b21-a265-7cdacc95dc0c tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/security-groups?id=c460cbfc-5960-42ff-abb9-4a137fb9cba6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1025004 Dec 09 21:26:34.748792 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c92b2b77-4d2d-4a62-a176-c7b41e4a660d req-f339b237-ab64-4ca4-afbc-c9796ee7767d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a9b3d91742274db295ecdc3138fae25f&device_id=04d5c285-e8c5-448e-a7e8-5b0bbd69602f HTTP/1.1" status: 200 len: 1098 time: 0.1605024 Dec 09 21:26:34.771554 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90267727-c21e-4411-a8ba-b36c63663ba2 req-6438d687-df81-40ea-a0d0-ce1b91b63005 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:34.778091 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90267727-c21e-4411-a8ba-b36c63663ba2 req-6438d687-df81-40ea-a0d0-ce1b91b63005 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:34.779843 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-90267727-c21e-4411-a8ba-b36c63663ba2 req-6438d687-df81-40ea-a0d0-ce1b91b63005 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=a17d0675-93b1-4ffe-a686-311f32edd826 HTTP/1.1" status: 200 len: 1682 time: 0.1044300 Dec 09 21:26:34.808104 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-52d8e1e4-0e2a-4fbd-90dd-c4671e4dd7fe admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:34.811417 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-52d8e1e4-0e2a-4fbd-90dd-c4671e4dd7fe admin admin] 10.222.0.13 "DELETE /v2.0/subnets/5b18bb60-11fe-4ddd-8fd3-bcb36985a134 HTTP/1.1" status: 204 len: 168 time: 0.5987895 Dec 09 21:26:34.816009 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52d8e1e4-0e2a-4fbd-90dd-c4671e4dd7fe admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5b18bb60-11fe-4ddd-8fd3-bcb36985a134,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:34.818950 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39554) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:34.833550 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de209f75-f0d6-468e-80c7-97cfc085a22a admin admin] Network 4d446a14-1218-469d-93aa-b4f9babdbb6e is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:26:34.865261 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-90267727-c21e-4411-a8ba-b36c63663ba2 req-a192a5a4-43d2-4c00-ae4b-b87b0098ef1a tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0784752 Dec 09 21:26:34.882736 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-92934f26-ff85-4ebd-8b27-7da490b296b1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:34.886465 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-de209f75-f0d6-468e-80c7-97cfc085a22a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 4d446a14-1218-469d-93aa-b4f9babdbb6e) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:34.901459 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-de209f75-f0d6-468e-80c7-97cfc085a22a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:34.902048 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de209f75-f0d6-468e-80c7-97cfc085a22a admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:34.904028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33f8b9cc-a11a-4f18-a3dc-0741298cbb72 None None] Network 4d446a14-1218-469d-93aa-b4f9babdbb6e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:26:34.918710 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-064ac351-b06f-40ce-8cc7-ffaf157aaae5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:34.972097 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-de209f75-f0d6-468e-80c7-97cfc085a22a admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.9933846 Dec 09 21:26:34.972097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c92b2b77-4d2d-4a62-a176-c7b41e4a660d req-80aa14f8-eb76-4d7e-94cf-dca869fe0159 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:34.972097 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c92b2b77-4d2d-4a62-a176-c7b41e4a660d req-80aa14f8-eb76-4d7e-94cf-dca869fe0159 service neutron] 10.222.0.31 "GET /v2.0/networks?id=5246b845-7de3-4759-8deb-13c3871588f0 HTTP/1.1" status: 200 len: 915 time: 0.2000391 Dec 09 21:26:35.026738 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-064ac351-b06f-40ce-8cc7-ffaf157aaae5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:35.047752 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c92b2b77-4d2d-4a62-a176-c7b41e4a660d req-4dd40ebf-590a-429e-a635-e4654c5ada47 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=e6c753d6-8187-435b-afd5-f77fe7d762ce HTTP/1.1" status: 200 len: 217 time: 0.0760286 Dec 09 21:26:35.062774 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f0ffbb31-204b-4311-b127-1288ce8e5ebc None None] Network 4d446a14-1218-469d-93aa-b4f9babdbb6e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:26:35.086264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-064ac351-b06f-40ce-8cc7-ffaf157aaae5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['56b576e6-50b1-4d1e-a1c2-80bcf1883e68']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:35.101233 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 07457883-17db-4553-8f10-716e04bc16b1 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:26:35.112568 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-064ac351-b06f-40ce-8cc7-ffaf157aaae5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bada42e9-278b-46e3-bbc2-c2d37f00c32d') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:35.112998 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-064ac351-b06f-40ce-8cc7-ffaf157aaae5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bada42e9-278b-46e3-bbc2-c2d37f00c32d') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:35.146349 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-064ac351-b06f-40ce-8cc7-ffaf157aaae5 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:35.181237 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c92b2b77-4d2d-4a62-a176-c7b41e4a660d req-36eb821d-7a9b-4042-927f-6c663f63fe61 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:35.185808 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-064ac351-b06f-40ce-8cc7-ffaf157aaae5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:35.186811 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c92b2b77-4d2d-4a62-a176-c7b41e4a660d req-36eb821d-7a9b-4042-927f-6c663f63fe61 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ff1bf4b1-2f03-42e0-ab07-8a818f9a1ba2 HTTP/1.1" status: 200 len: 854 time: 0.0968797 Dec 09 21:26:35.195974 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-064ac351-b06f-40ce-8cc7-ffaf157aaae5 admin admin] Releasing vlan 139 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:26:35.196387 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-064ac351-b06f-40ce-8cc7-ffaf157aaae5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:26:35.198427 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:26:35.249773 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c92b2b77-4d2d-4a62-a176-c7b41e4a660d req-ad39876b-dc5f-4e0a-bd8a-fad26588dc69 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5246b845-7de3-4759-8deb-13c3871588f0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0442929 Dec 09 21:26:35.262393 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d04983ce-625a-46a9-afb2-755c155b0015 req-6b7e92c0-5669-4ec9-89a8-b198e63c3f79 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:35.271096 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d04983ce-625a-46a9-afb2-755c155b0015 req-6b7e92c0-5669-4ec9-89a8-b198e63c3f79 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=dffe3c86-0677-4490-a36a-8bed7d798809 HTTP/1.1" status: 200 len: 932 time: 0.1223493 Dec 09 21:26:35.304398 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-064ac351-b06f-40ce-8cc7-ffaf157aaae5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:35.320939 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-064ac351-b06f-40ce-8cc7-ffaf157aaae5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:35.324125 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-064ac351-b06f-40ce-8cc7-ffaf157aaae5 admin admin] 10.222.0.13 "DELETE /v2.0/networks/56b576e6-50b1-4d1e-a1c2-80bcf1883e68 HTTP/1.1" status: 204 len: 168 time: 0.5041218 Dec 09 21:26:35.354294 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-064ac351-b06f-40ce-8cc7-ffaf157aaae5 admin admin] Pushing event deleted for resources: {'Network': ['ID=56b576e6-50b1-4d1e-a1c2-80bcf1883e68,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:35.390832 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d04983ce-625a-46a9-afb2-755c155b0015 req-46797f7d-2d1b-45c1-b086-0b4995a95dfd tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1187673 Dec 09 21:26:35.434688 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ff95d33-6c85-4927-ace0-15eb9ce7145a req-21a10911-78bb-4005-9694-51fe69fa95b2 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:35.436667 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3ff95d33-6c85-4927-ace0-15eb9ce7145a req-21a10911-78bb-4005-9694-51fe69fa95b2 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=c7f45d89-875f-4294-9fcb-17f7fc994b3f HTTP/1.1" status: 200 len: 949 time: 0.1180763 Dec 09 21:26:35.467553 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 07457883-17db-4553-8f10-716e04bc16b1 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:26:35.477333 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 07457883-17db-4553-8f10-716e04bc16b1 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:35.477780 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:35.528486 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39576) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:35.534371 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-660c2f95-2107-4719-ba99-945f4fc0a744 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:35.560755 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3ff95d33-6c85-4927-ace0-15eb9ce7145a req-b7d6bca6-f33e-4df3-a1ba-acdd08a45cae tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1171768 Dec 09 21:26:35.587009 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1367b4c1-3672-456c-967d-03b2e5b8652a req-eec2fd6c-de2d-41f0-86eb-027e596fbfe1 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:35.588117 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1367b4c1-3672-456c-967d-03b2e5b8652a req-eec2fd6c-de2d-41f0-86eb-027e596fbfe1 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:35.595772 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1367b4c1-3672-456c-967d-03b2e5b8652a req-eec2fd6c-de2d-41f0-86eb-027e596fbfe1 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=a17d0675-93b1-4ffe-a686-311f32edd826 HTTP/1.1" status: 200 len: 1682 time: 0.1150148 Dec 09 21:26:35.607036 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:35.642665 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-66aae7f9-9c35-490a-bebd-48a8cf5d05ff admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=52eb00d38d4442158ed8579a84e900ca&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1108189 Dec 09 21:26:35.645651 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39582) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:35.649279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 07457883-17db-4553-8f10-716e04bc16b1, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=07457883-17db-4553-8f10-716e04bc16b1,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:35.650716 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '94826b5c-46f2-422a-a48d-eb415b5b9e44', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '07457883-17db-4553-8f10-716e04bc16b1'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:35.653800 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ef371091-9769-4431-a795-7bea91d87249" -d '{"events": [{"server_uuid": "94826b5c-46f2-422a-a48d-eb415b5b9e44", "name": "network-vif-plugged", "status": "completed", "tag": "07457883-17db-4553-8f10-716e04bc16b1"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:35.659916 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:35.661610 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 420d466e-c77f-433f-9763-037f0389654e no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:26:35.702537 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 420d466e-c77f-433f-9763-037f0389654e {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:26:35.703529 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 420d466e-c77f-433f-9763-037f0389654e not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:26:35.703529 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device a0a1eab9-7a2d-4b73-9918-01919710bdbe no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:26:35.730648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: a0a1eab9-7a2d-4b73-9918-01919710bdbe {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:26:35.731235 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device a0a1eab9-7a2d-4b73-9918-01919710bdbe not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:26:35.738089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1367b4c1-3672-456c-967d-03b2e5b8652a req-d46efe36-5ca3-438a-ab4d-70be886c3f85 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1354671 Dec 09 21:26:35.750170 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-522b8f2c-829a-48d2-a6c5-6bc48d537b0c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:35.789508 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=07457883-17db-4553-8f10-716e04bc16b1,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:35.799275 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-522b8f2c-829a-48d2-a6c5-6bc48d537b0c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:35.811633 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c92b2b77-4d2d-4a62-a176-c7b41e4a660d req-c9c5f380-8ee4-4411-b20b-b5865f40b8ce service neutron] 10.222.0.31 "GET /v2.0/networks/5246b845-7de3-4759-8deb-13c3871588f0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5415802 Dec 09 21:26:35.898015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af5eff32-d7d2-4884-86c9-ff6daa50cbb2 req-c1b7e043-5962-4242-9d69-c68cb1a95dc3 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:35.899861 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af5eff32-d7d2-4884-86c9-ff6daa50cbb2 req-c1b7e043-5962-4242-9d69-c68cb1a95dc3 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.0668344 Dec 09 21:26:35.901164 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-522b8f2c-829a-48d2-a6c5-6bc48d537b0c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:35.904491 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-522b8f2c-829a-48d2-a6c5-6bc48d537b0c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:35.908073 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-522b8f2c-829a-48d2-a6c5-6bc48d537b0c admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/0be95913-f7f5-4b8c-a0a8-1ef338e16419 HTTP/1.1" status: 204 len: 168 time: 0.2609606 Dec 09 21:26:35.925692 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-92934f26-ff85-4ebd-8b27-7da490b296b1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:35.939030 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-92934f26-ff85-4ebd-8b27-7da490b296b1 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:35.939310 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-522b8f2c-829a-48d2-a6c5-6bc48d537b0c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0be95913-f7f5-4b8c-a0a8-1ef338e16419,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:35.970134 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-92934f26-ff85-4ebd-8b27-7da490b296b1 service neutron] Transition to ACTIVE for port object b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:26:35.980474 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-92934f26-ff85-4ebd-8b27-7da490b296b1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:35.987149 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c92b2b77-4d2d-4a62-a176-c7b41e4a660d req-ef8a953c-06fc-41a7-a8cd-f9e2b6451574 service neutron] 10.222.0.31 "GET /v2.0/networks/5246b845-7de3-4759-8deb-13c3871588f0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1561618 Dec 09 21:26:36.012531 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af5eff32-d7d2-4884-86c9-ff6daa50cbb2 req-8dbfa8b6-3cf0-4fc3-88d4-5e682bda54a7 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1035123 Dec 09 21:26:36.059150 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92934f26-ff85-4ebd-8b27-7da490b296b1 service neutron] Pushing event updated for resources: {'Port': ['ID=b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:36.071582 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1686fc21-eb51-4e92-9573-b98cbea6b946 x-openstack-request-id: req-1686fc21-eb51-4e92-9573-b98cbea6b946 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:36.072124 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "94826b5c-46f2-422a-a48d-eb415b5b9e44", "name": "network-vif-plugged", "status": "completed", "tag": "07457883-17db-4553-8f10-716e04bc16b1", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:36.072238 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-1686fc21-eb51-4e92-9573-b98cbea6b946 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:36.072778 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '94826b5c-46f2-422a-a48d-eb415b5b9e44', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '07457883-17db-4553-8f10-716e04bc16b1', 'code': 200} Dec 09 21:26:36.123735 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device fd466da6-f506-43e6-9800-156622bd2781 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:26:36.179407 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-92934f26-ff85-4ebd-8b27-7da490b296b1 service neutron] Attempting to bind port b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:26:36.180642 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-92934f26-ff85-4ebd-8b27-7da490b296b1 service neutron] Attempting to bind port b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'c472f4a8-1a94-4bb1-8978-a56e5ee37bb8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': 'de91a458-cde4-4265-8605-31d9b6f8f05f'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:26:36.181853 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-92934f26-ff85-4ebd-8b27-7da490b296b1 service neutron] Attempting to bind port b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e on network de91a458-cde4-4265-8605-31d9b6f8f05f {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:36.190856 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port fd466da6-f506-43e6-9800-156622bd2781 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:26:36.195257 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port fd466da6-f506-43e6-9800-156622bd2781 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:36.195695 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:36.196323 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-92934f26-ff85-4ebd-8b27-7da490b296b1 service neutron] Port b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e on network de91a458-cde4-4265-8605-31d9b6f8f05f not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:26:36.196747 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-92934f26-ff85-4ebd-8b27-7da490b296b1 service neutron] Attempting to bind port b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e on network de91a458-cde4-4265-8605-31d9b6f8f05f {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:36.207746 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-92934f26-ff85-4ebd-8b27-7da490b296b1 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 26, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:26:36.208221 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-92934f26-ff85-4ebd-8b27-7da490b296b1 service neutron] Checking segment: {'id': 'c472f4a8-1a94-4bb1-8978-a56e5ee37bb8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': 'de91a458-cde4-4265-8605-31d9b6f8f05f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:36.208697 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-92934f26-ff85-4ebd-8b27-7da490b296b1 service neutron] Bound using segment: {'id': 'c472f4a8-1a94-4bb1-8978-a56e5ee37bb8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': 'de91a458-cde4-4265-8605-31d9b6f8f05f'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:26:36.209242 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-92934f26-ff85-4ebd-8b27-7da490b296b1 service neutron] Bound port: b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c472f4a8-1a94-4bb1-8978-a56e5ee37bb8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': 'de91a458-cde4-4265-8605-31d9b6f8f05f'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:26:36.210923 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-92934f26-ff85-4ebd-8b27-7da490b296b1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:36.275465 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-e7681607-f281-45eb-bd28-0b17069ccbd1 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:36.284712 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-e7681607-f281-45eb-bd28-0b17069ccbd1 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/networks?id=4d446a14-1218-469d-93aa-b4f9babdbb6e HTTP/1.1" status: 200 len: 815 time: 0.1945982 Dec 09 21:26:36.330704 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:36.333489 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-4e38749e-539f-4fb9-bafe-490c2ff5afba tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/quotas/18e7af94d60344a18dedc56eda040c4b HTTP/1.1" status: 200 len: 375 time: 0.0478656 Dec 09 21:26:36.343268 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-594600d0-d6c6-4e70-bc9c-c179858a25a4 req-6ad55d90-843b-4d9e-9f02-bd79a99875e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:36.345011 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-594600d0-d6c6-4e70-bc9c-c179858a25a4 req-6ad55d90-843b-4d9e-9f02-bd79a99875e7 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=94826b5c-46f2-422a-a48d-eb415b5b9e44 HTTP/1.1" status: 200 len: 1101 time: 0.1174543 Dec 09 21:26:36.347548 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-92934f26-ff85-4ebd-8b27-7da490b296b1 service neutron] For port b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:26:36.350776 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-92934f26-ff85-4ebd-8b27-7da490b296b1 service neutron] For port b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e,segment=NetworkSegment(c472f4a8-1a94-4bb1-8978-a56e5ee37bb8),segment_id=c472f4a8-1a94-4bb1-8978-a56e5ee37bb8)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:26:36.355579 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-92934f26-ff85-4ebd-8b27-7da490b296b1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:36.386433 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-b20ba659-dba7-4e30-a077-5334c7385e98 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=18e7af94d60344a18dedc56eda040c4b&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0429251 Dec 09 21:26:36.389274 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port fd466da6-f506-43e6-9800-156622bd2781, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=fd466da6-f506-43e6-9800-156622bd2781,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:36.396535 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:36.418122 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-92934f26-ff85-4ebd-8b27-7da490b296b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:36.419628 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-92934f26-ff85-4ebd-8b27-7da490b296b1 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:36.422352 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-92934f26-ff85-4ebd-8b27-7da490b296b1 service neutron] 10.222.0.31 "PUT /v2.0/ports/b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e HTTP/1.1" status: 200 len: 1093 time: 1.7143266 Dec 09 21:26:36.425876 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3f90adc-ad2e-49bd-8e4b-8ffc3fa4ba48 req-4a715e40-8a49-49f3-89d7-d6057eb1e51c tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:36.427123 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dffe3c86-0677-4490-a36a-8bed7d798809', 'tag': 'b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:36.427511 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3f90adc-ad2e-49bd-8e4b-8ffc3fa4ba48 req-4a715e40-8a49-49f3-89d7-d6057eb1e51c tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/ports?device_id=04d5c285-e8c5-448e-a7e8-5b0bbd69602f HTTP/1.1" status: 200 len: 946 time: 0.1389618 Dec 09 21:26:36.432483 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f7c68f96-89e8-43e4-b916-42470dae3122" -d '{"events": [{"name": "network-changed", "server_uuid": "dffe3c86-0677-4490-a36a-8bed7d798809", "tag": "b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:36.469079 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=fd466da6-f506-43e6-9800-156622bd2781,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:36.484179 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-594600d0-d6c6-4e70-bc9c-c179858a25a4 req-024e31e2-5b7c-4ba9-bedc-ef2be702f9fd service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1227965 Dec 09 21:26:36.484931 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92934f26-ff85-4ebd-8b27-7da490b296b1 service neutron] Pushing event updated for resources: {'Port': ['ID=b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:36.543162 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3f90adc-ad2e-49bd-8e4b-8ffc3fa4ba48 req-b81ec205-056f-43b5-8fab-2c49e36e21bb tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/security-groups?id=c460cbfc-5960-42ff-abb9-4a137fb9cba6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1049545 Dec 09 21:26:36.549965 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-87f8a363-0306-4018-947e-9976391367fd service neutron] 10.222.0.13 "GET /v2.0/networks/4d446a14-1218-469d-93aa-b4f9babdbb6e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1625218 Dec 09 21:26:36.557567 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:36.654233 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-3e1887bb-52b6-47b2-9337-9326add44b00 service neutron] 10.222.0.13 "GET /v2.0/networks/4d446a14-1218-469d-93aa-b4f9babdbb6e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0977299 Dec 09 21:26:36.743253 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b21b165-8d89-4988-b662-3dda8c41caad req-12aa3081-3667-49ca-a0ed-bff911300dbd tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:36.744856 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b21b165-8d89-4988-b662-3dda8c41caad req-12aa3081-3667-49ca-a0ed-bff911300dbd tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=dffe3c86-0677-4490-a36a-8bed7d798809 HTTP/1.1" status: 200 len: 944 time: 0.0669663 Dec 09 21:26:36.779207 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-ecc1ac92-d2f2-4b07-a07f-daec39185c45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:36.780582 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-ecc1ac92-d2f2-4b07-a07f-daec39185c45 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=5635fb0018b24f538b250cdac6dca9d9&device_id=dffe3c86-0677-4490-a36a-8bed7d798809 HTTP/1.1" status: 200 len: 1096 time: 0.0504620 Dec 09 21:26:36.825066 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b21b165-8d89-4988-b662-3dda8c41caad req-fafadc2d-ae50-41cb-9cc7-8c8c181dcc6c tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0693238 Dec 09 21:26:36.885076 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0dab4d20-6a41-466d-93ab-b7250b0b36ea x-openstack-request-id: req-0dab4d20-6a41-466d-93ab-b7250b0b36ea {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:36.885368 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dffe3c86-0677-4490-a36a-8bed7d798809", "tag": "b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:36.886101 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0dab4d20-6a41-466d-93ab-b7250b0b36ea {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:36.886480 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dffe3c86-0677-4490-a36a-8bed7d798809', 'tag': 'b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e', 'status': 'completed', 'code': 200} Dec 09 21:26:36.888669 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-777df49b-54f6-456a-9077-3f7183976d2f service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e HTTP/1.1" status: 200 len: 217 time: 0.0953107 Dec 09 21:26:36.978775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-dd028c25-b0d1-41dc-a504-a2150eb48bd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:36.981782 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-dd028c25-b0d1-41dc-a504-a2150eb48bd7 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=cb187a9c-ec94-4995-93f8-92c16c7a80a3 HTTP/1.1" status: 200 len: 850 time: 0.0698581 Dec 09 21:26:37.007212 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39634) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:37.021314 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f44dc6ae-0b34-4117-807a-dc2859f593d7 req-c23b3f7e-13ad-44b0-8fc0-95a3939487d1 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:37.028188 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f44dc6ae-0b34-4117-807a-dc2859f593d7 req-c23b3f7e-13ad-44b0-8fc0-95a3939487d1 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=c7f45d89-875f-4294-9fcb-17f7fc994b3f HTTP/1.1" status: 200 len: 950 time: 0.1032152 Dec 09 21:26:37.052548 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-8ce3b879-ce38-4cd3-b22a-ec51c7b9cb7e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=de91a458-cde4-4265-8605-31d9b6f8f05f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0365515 Dec 09 21:26:37.087597 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f44dc6ae-0b34-4117-807a-dc2859f593d7 req-baa6cc32-2fba-4773-9ce1-a65fbc2c10da tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0553463 Dec 09 21:26:37.115597 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b91a7a9-deda-4a91-8d22-258f2441913c req-5a78f2c2-991a-45f6-8827-cf73237864e9 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:37.121533 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b91a7a9-deda-4a91-8d22-258f2441913c req-5a78f2c2-991a-45f6-8827-cf73237864e9 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:37.123366 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4b91a7a9-deda-4a91-8d22-258f2441913c req-5a78f2c2-991a-45f6-8827-cf73237864e9 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=a17d0675-93b1-4ffe-a686-311f32edd826 HTTP/1.1" status: 200 len: 1682 time: 0.1487134 Dec 09 21:26:37.167605 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-16d51243-b1ef-4feb-b1b7-81261ddc62c6 service neutron] 10.222.0.31 "GET /v2.0/networks/de91a458-cde4-4265-8605-31d9b6f8f05f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1054232 Dec 09 21:26:37.176608 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a0a33b8a-0968-4133-ad0e-c908e0dd1022 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueTestJSON-1978792040-network', 'tenant_id': '9ca15fab17f34cc58f1ad1fcedc1bf31'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:37.213457 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-06b755b3-84e5-47d7-84af-5ed2737010bd req-477fffee-bef2-466e-a1ac-fd00b481dced tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 210 time: 0.0386209 Dec 09 21:26:37.227268 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4b91a7a9-deda-4a91-8d22-258f2441913c req-ccb1847c-9f8e-49ee-beb9-c59c62fc7148 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/security-groups?id=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0905175 Dec 09 21:26:37.259112 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a0a33b8a-0968-4133-ad0e-c908e0dd1022 admin admin] Made reservation on behalf of 9ca15fab17f34cc58f1ad1fcedc1bf31 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:37.262204 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a0a33b8a-0968-4133-ad0e-c908e0dd1022 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:37.276873 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a0a33b8a-0968-4133-ad0e-c908e0dd1022 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:37.319172 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-24cb8258-0b5a-4521-a60a-bea867a8fd5e req-a72fc380-416e-4bcb-a616-ee8ccc72b97e service neutron] 10.222.0.31 "GET /v2.0/networks/de91a458-cde4-4265-8605-31d9b6f8f05f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1380436 Dec 09 21:26:37.352203 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec64a62a-67d3-4f48-9888-4d842e42f4d4 req-4f82f0d4-1f71-4e79-9146-63bdbf235de2 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:37.353831 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec64a62a-67d3-4f48-9888-4d842e42f4d4 req-4f82f0d4-1f71-4e79-9146-63bdbf235de2 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.0599742 Dec 09 21:26:37.378776 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a0a33b8a-0968-4133-ad0e-c908e0dd1022 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:37.387310 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a0a33b8a-0968-4133-ad0e-c908e0dd1022 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:37.413642 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec64a62a-67d3-4f48-9888-4d842e42f4d4 req-9fdf23ab-5fc8-4d1c-aba8-ca0a05ac1764 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0530517 Dec 09 21:26:37.438525 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a0a33b8a-0968-4133-ad0e-c908e0dd1022 admin admin] vlan segment allocate from pool success with {'vlan_id': 102, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:26:37.453056 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0a33b8a-0968-4133-ad0e-c908e0dd1022 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:37.459855 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a0a33b8a-0968-4133-ad0e-c908e0dd1022 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:37.460200 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-a0a33b8a-0968-4133-ad0e-c908e0dd1022 admin admin] Added segment 6bb6d7a7-737b-46b2-b463-0bc25081f6ef of type vlan for network e7d3d836-ebe9-4e03-af4b-235dd5e5cbea Dec 09 21:26:37.478852 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7c68f96-89e8-43e4-b916-42470dae3122 req-68ae2e76-feb0-4d8b-abdd-bf4217f1f6b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:37.480409 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f7c68f96-89e8-43e4-b916-42470dae3122 req-68ae2e76-feb0-4d8b-abdd-bf4217f1f6b7 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=5635fb0018b24f538b250cdac6dca9d9&device_id=dffe3c86-0677-4490-a36a-8bed7d798809 HTTP/1.1" status: 200 len: 1096 time: 0.0875013 Dec 09 21:26:37.562953 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a0a33b8a-0968-4133-ad0e-c908e0dd1022 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:37.643460 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7740c4e-b9cb-4b0f-91ff-6bb2f73be62f req-6b702a92-7fcc-4149-b6c8-79c794e0b92b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:37.649442 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7740c4e-b9cb-4b0f-91ff-6bb2f73be62f req-6b702a92-7fcc-4149-b6c8-79c794e0b92b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:37.651042 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c7740c4e-b9cb-4b0f-91ff-6bb2f73be62f req-6b702a92-7fcc-4149-b6c8-79c794e0b92b tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.31 "GET /v2.0/ports?device_id=a17d0675-93b1-4ffe-a686-311f32edd826 HTTP/1.1" status: 200 len: 1682 time: 0.1540143 Dec 09 21:26:37.655697 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a0a33b8a-0968-4133-ad0e-c908e0dd1022 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:37.656609 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0a33b8a-0968-4133-ad0e-c908e0dd1022 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:37.657173 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a0a33b8a-0968-4133-ad0e-c908e0dd1022 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:37.695305 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5935e3e-e19f-4aab-bc4d-c05cacb1b3be req-37d00f01-aef3-48be-ab2c-776ee043a777 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:37.697537 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b5935e3e-e19f-4aab-bc4d-c05cacb1b3be req-37d00f01-aef3-48be-ab2c-776ee043a777 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/ports?device_id=04d5c285-e8c5-448e-a7e8-5b0bbd69602f HTTP/1.1" status: 200 len: 946 time: 0.0678649 Dec 09 21:26:37.714066 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7c68f96-89e8-43e4-b916-42470dae3122 req-3db4a5b5-fb68-446f-80af-70283e2731dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:37.715597 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f7c68f96-89e8-43e4-b916-42470dae3122 req-3db4a5b5-fb68-446f-80af-70283e2731dc service neutron] 10.222.0.31 "GET /v2.0/networks?id=de91a458-cde4-4265-8605-31d9b6f8f05f HTTP/1.1" status: 200 len: 911 time: 0.2171025 Dec 09 21:26:37.725944 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a0a33b8a-0968-4133-ad0e-c908e0dd1022 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.7171991 Dec 09 21:26:37.729018 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39646) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:37.734564 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-3f7e7130-805c-4e49-be78-33cd76158450 admin admin] Request body: {'subnet': {'network_id': 'e7d3d836-ebe9-4e03-af4b-235dd5e5cbea', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueTestJSON-1978792040-subnet', 'tenant_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:37.781821 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b5935e3e-e19f-4aab-bc4d-c05cacb1b3be req-afea68ba-8b06-4dd6-90ff-0f542419e0a8 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/security-groups?id=c460cbfc-5960-42ff-abb9-4a137fb9cba6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0773315 Dec 09 21:26:37.787680 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3f7e7130-805c-4e49-be78-33cd76158450 admin admin] Made reservation on behalf of 9ca15fab17f34cc58f1ad1fcedc1bf31 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:37.791036 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f7e7130-805c-4e49-be78-33cd76158450 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:37.808070 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f7c68f96-89e8-43e4-b916-42470dae3122 req-b9389b8b-2d1f-47b6-b79e-9554b53835ef service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e HTTP/1.1" status: 200 len: 217 time: 0.0809219 Dec 09 21:26:37.808819 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0a33b8a-0968-4133-ad0e-c908e0dd1022 admin admin] Pushing event updated for resources: {'Network': ['ID=e7d3d836-ebe9-4e03-af4b-235dd5e5cbea,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:37.822620 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network e7d3d836-ebe9-4e03-af4b-235dd5e5cbea details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:26:37.893097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7c68f96-89e8-43e4-b916-42470dae3122 req-d6e7d606-5bda-420b-afd4-c16df5fa7105 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:37.894705 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f7c68f96-89e8-43e4-b916-42470dae3122 req-d6e7d606-5bda-420b-afd4-c16df5fa7105 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=cb187a9c-ec94-4995-93f8-92c16c7a80a3 HTTP/1.1" status: 200 len: 850 time: 0.0587809 Dec 09 21:26:37.935752 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:37.954248 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-c7740c4e-b9cb-4b0f-91ff-6bb2f73be62f req-88f52ceb-d2df-4c27-baf2-366f844d8549 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Deleting port 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:26:37.954586 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c7740c4e-b9cb-4b0f-91ff-6bb2f73be62f req-88f52ceb-d2df-4c27-baf2-366f844d8549 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:37.958887 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f7c68f96-89e8-43e4-b916-42470dae3122 req-264d86cb-bea9-460b-abe9-9a3df2e4cd3c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=de91a458-cde4-4265-8605-31d9b6f8f05f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0517933 Dec 09 21:26:38.048596 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc8afa98-ae96-4aaa-98b2-b5b0cdff7b09 req-531b9ed5-05bb-4084-baf0-b7ef3f2b9e2b tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:38.050462 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc8afa98-ae96-4aaa-98b2-b5b0cdff7b09 req-531b9ed5-05bb-4084-baf0-b7ef3f2b9e2b tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=dffe3c86-0677-4490-a36a-8bed7d798809 HTTP/1.1" status: 200 len: 944 time: 0.1057601 Dec 09 21:26:38.073489 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c7f45d89-875f-4294-9fcb-17f7fc994b3f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fd466da6-f506-43e6-9800-156622bd2781'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:38.076429 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8e8835e8-86a5-429f-a9b0-fe35f179db17" -d '{"events": [{"server_uuid": "c7f45d89-875f-4294-9fcb-17f7fc994b3f", "name": "network-vif-plugged", "status": "completed", "tag": "fd466da6-f506-43e6-9800-156622bd2781"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:38.130241 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f7e7130-805c-4e49-be78-33cd76158450 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:38.132783 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-c7740c4e-b9cb-4b0f-91ff-6bb2f73be62f req-88f52ceb-d2df-4c27-baf2-366f844d8549 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] For port 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=3eea4303-cbf9-4dd6-8eaa-de772b7d85f8,segment=NetworkSegment(62cd2cbb-d71c-4d79-8112-51e9e682f3f3),segment_id=62cd2cbb-d71c-4d79-8112-51e9e682f3f3)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:38.133762 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c7740c4e-b9cb-4b0f-91ff-6bb2f73be62f req-88f52ceb-d2df-4c27-baf2-366f844d8549 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:38.142397 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-250dc15d-35c8-4a38-b4ee-240d18ca47f9 x-openstack-request-id: req-250dc15d-35c8-4a38-b4ee-240d18ca47f9 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:38.142989 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c7f45d89-875f-4294-9fcb-17f7fc994b3f", "name": "network-vif-plugged", "status": "completed", "tag": "fd466da6-f506-43e6-9800-156622bd2781", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:38.143670 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-250dc15d-35c8-4a38-b4ee-240d18ca47f9 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:38.144278 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c7f45d89-875f-4294-9fcb-17f7fc994b3f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fd466da6-f506-43e6-9800-156622bd2781', 'code': 200} Dec 09 21:26:38.159989 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-c7740c4e-b9cb-4b0f-91ff-6bb2f73be62f req-88f52ceb-d2df-4c27-baf2-366f844d8549 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Calling delete_port for 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:26:38.172410 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f7c68f96-89e8-43e4-b916-42470dae3122 req-2b466faf-b53a-4c9c-ab74-1c976dc6a58e service neutron] 10.222.0.31 "GET /v2.0/networks/de91a458-cde4-4265-8605-31d9b6f8f05f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1798663 Dec 09 21:26:38.251022 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc8afa98-ae96-4aaa-98b2-b5b0cdff7b09 req-c4b3fdfc-0805-43c9-b9d2-2b1281549ec7 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1747751 Dec 09 21:26:38.345193 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f7c68f96-89e8-43e4-b916-42470dae3122 req-a4d1748b-9c52-45ad-9c97-c999151af0aa service neutron] 10.222.0.31 "GET /v2.0/networks/de91a458-cde4-4265-8605-31d9b6f8f05f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1201198 Dec 09 21:26:38.362685 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f7e7130-805c-4e49-be78-33cd76158450 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a84d1123-6651-4f35-9cba-4f9c8f45aab6,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:38.415957 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c7740c4e-b9cb-4b0f-91ff-6bb2f73be62f req-88f52ceb-d2df-4c27-baf2-366f844d8549 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:38.431645 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['3eea4303-cbf9-4dd6-8eaa-de772b7d85f8', '5dd56541-48db-4dce-a0d7-6624015c8553'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:38.446060 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88f52ceb-d2df-4c27-baf2-366f844d8549 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event deleted for resources: {'Port': ['ID=3eea4303-cbf9-4dd6-8eaa-de772b7d85f8,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:38.497441 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-c7740c4e-b9cb-4b0f-91ff-6bb2f73be62f req-88f52ceb-d2df-4c27-baf2-366f844d8549 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] No DVR routers for this DVR port 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:26:38.500260 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c7740c4e-b9cb-4b0f-91ff-6bb2f73be62f req-88f52ceb-d2df-4c27-baf2-366f844d8549 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:38.511024 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c7740c4e-b9cb-4b0f-91ff-6bb2f73be62f req-88f52ceb-d2df-4c27-baf2-366f844d8549 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.31 "DELETE /v2.0/ports/3eea4303-cbf9-4dd6-8eaa-de772b7d85f8 HTTP/1.1" status: 204 len: 173 time: 0.8401699 Dec 09 21:26:38.643013 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-c7740c4e-b9cb-4b0f-91ff-6bb2f73be62f req-c683711d-d089-4bc8-b196-ed225b256ed3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Deleting port 5dd56541-48db-4dce-a0d7-6624015c8553 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:26:38.643479 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c7740c4e-b9cb-4b0f-91ff-6bb2f73be62f req-c683711d-d089-4bc8-b196-ed225b256ed3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:38.705125 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-5c43b69e-41bb-4941-874c-81574b564526 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:38.706556 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-5c43b69e-41bb-4941-874c-81574b564526 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.31 "GET /v2.0/networks?id=4d446a14-1218-469d-93aa-b4f9babdbb6e HTTP/1.1" status: 200 len: 815 time: 0.5367212 Dec 09 21:26:38.716720 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ac6f79b-7207-4262-8d8c-be16adc89a80 req-5353382e-6c1f-43c7-96b0-5fd12a605a08 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:38.718119 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ac6f79b-7207-4262-8d8c-be16adc89a80 req-5353382e-6c1f-43c7-96b0-5fd12a605a08 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=c7f45d89-875f-4294-9fcb-17f7fc994b3f HTTP/1.1" status: 200 len: 1102 time: 0.4584262 Dec 09 21:26:38.721937 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f7e7130-805c-4e49-be78-33cd76158450 admin admin] Checking segment: {'id': '6bb6d7a7-737b-46b2-b463-0bc25081f6ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'e7d3d836-ebe9-4e03-af4b-235dd5e5cbea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:38.722285 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3f7e7130-805c-4e49-be78-33cd76158450 admin admin] Network hostable DHCP agents. Network: e7d3d836-ebe9-4e03-af4b-235dd5e5cbea, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:26:38.731832 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c68eb106-319f-44c7-be36-81dd27020f36 req-98599575-6bf7-488b-80e6-026897b61a28 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:38.733502 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c68eb106-319f-44c7-be36-81dd27020f36 req-98599575-6bf7-488b-80e6-026897b61a28 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/ports?device_id=04d5c285-e8c5-448e-a7e8-5b0bbd69602f HTTP/1.1" status: 200 len: 946 time: 0.4803021 Dec 09 21:26:38.739675 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-c7740c4e-b9cb-4b0f-91ff-6bb2f73be62f req-c683711d-d089-4bc8-b196-ed225b256ed3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] For port 5dd56541-48db-4dce-a0d7-6624015c8553, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=5dd56541-48db-4dce-a0d7-6624015c8553,segment=NetworkSegment(d2f9d5c1-75e0-4806-a659-59422ae7083c),segment_id=d2f9d5c1-75e0-4806-a659-59422ae7083c)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:38.739975 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c7740c4e-b9cb-4b0f-91ff-6bb2f73be62f req-c683711d-d089-4bc8-b196-ed225b256ed3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:38.753939 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-c7740c4e-b9cb-4b0f-91ff-6bb2f73be62f req-c683711d-d089-4bc8-b196-ed225b256ed3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Calling delete_port for 5dd56541-48db-4dce-a0d7-6624015c8553 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:26:38.758448 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-7bff3a47-d97f-4488-9787-23726bc76fc7 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Request body: {'port': {'device_id': 'f3361776-fc91-4b92-9d13-73ed7e781a51', 'network_id': '4d446a14-1218-469d-93aa-b4f9babdbb6e', 'admin_state_up': True, 'tenant_id': '18e7af94d60344a18dedc56eda040c4b'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:38.810517 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6169f5db-12e1-4810-8ee3-604cf9006227 req-454811e4-fe12-444c-9210-a729896598d1 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:38.812018 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6169f5db-12e1-4810-8ee3-604cf9006227 req-454811e4-fe12-444c-9210-a729896598d1 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=c7f45d89-875f-4294-9fcb-17f7fc994b3f HTTP/1.1" status: 200 len: 950 time: 0.4669416 Dec 09 21:26:38.874827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3f7e7130-805c-4e49-be78-33cd76158450 admin admin] Network e7d3d836-ebe9-4e03-af4b-235dd5e5cbea is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:26:38.889248 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a17d0675-93b1-4ffe-a686-311f32edd826', 'name': 'network-vif-deleted', 'tag': '3eea4303-cbf9-4dd6-8eaa-de772b7d85f8'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:38.891750 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8a3e73a8-8c73-4153-a404-0efcda59e047" -d '{"events": [{"server_uuid": "a17d0675-93b1-4ffe-a686-311f32edd826", "name": "network-vif-deleted", "tag": "3eea4303-cbf9-4dd6-8eaa-de772b7d85f8"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:38.906908 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c7740c4e-b9cb-4b0f-91ff-6bb2f73be62f req-c683711d-d089-4bc8-b196-ed225b256ed3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:38.923289 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['3eea4303-cbf9-4dd6-8eaa-de772b7d85f8'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:38.924009 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-3f7e7130-805c-4e49-be78-33cd76158450 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, e7d3d836-ebe9-4e03-af4b-235dd5e5cbea) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:38.930415 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ac6f79b-7207-4262-8d8c-be16adc89a80 req-703a2128-b24f-4ccf-a38a-e2a8af756b36 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1959538 Dec 09 21:26:38.934074 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad5d2f53-2293-4d88-a54e-ee920c3a69da None None] Network e7d3d836-ebe9-4e03-af4b-235dd5e5cbea requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:26:38.938291 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c683711d-d089-4bc8-b196-ed225b256ed3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event deleted for resources: {'Port': ['ID=5dd56541-48db-4dce-a0d7-6624015c8553,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:38.942133 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c68eb106-319f-44c7-be36-81dd27020f36 req-ab70a9e2-35f7-4018-9969-03849877ee53 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/security-groups?id=c460cbfc-5960-42ff-abb9-4a137fb9cba6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2000446 Dec 09 21:26:38.943463 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f7e7130-805c-4e49-be78-33cd76158450 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:38.944051 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f7e7130-805c-4e49-be78-33cd76158450 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:38.982531 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6169f5db-12e1-4810-8ee3-604cf9006227 req-9280de87-ab2d-4474-b2b2-83997254ebd8 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1609478 Dec 09 21:26:38.994383 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3f7e7130-805c-4e49-be78-33cd76158450 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.2610688 Dec 09 21:26:38.994383 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39670) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:38.999898 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-25b77b9e-b15d-4671-bf2b-10c95064bb0b admin admin] Request body: {'router': {'name': 'tempest-ServerRescueTestJSON-1978792040-router', 'tenant_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:39.011516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-c7740c4e-b9cb-4b0f-91ff-6bb2f73be62f req-c683711d-d089-4bc8-b196-ed225b256ed3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] No DVR routers for this DVR port 5dd56541-48db-4dce-a0d7-6624015c8553 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:26:39.015841 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c7740c4e-b9cb-4b0f-91ff-6bb2f73be62f req-c683711d-d089-4bc8-b196-ed225b256ed3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:39.021689 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c7740c4e-b9cb-4b0f-91ff-6bb2f73be62f req-c683711d-d089-4bc8-b196-ed225b256ed3 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.31 "DELETE /v2.0/ports/5dd56541-48db-4dce-a0d7-6624015c8553 HTTP/1.1" status: 204 len: 173 time: 0.5028234 Dec 09 21:26:39.044584 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-7bff3a47-d97f-4488-9787-23726bc76fc7 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Made reservation on behalf of 18e7af94d60344a18dedc56eda040c4b for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:39.048540 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-7bff3a47-d97f-4488-9787-23726bc76fc7 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:39.079832 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-25b77b9e-b15d-4671-bf2b-10c95064bb0b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:39.080856 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-25b77b9e-b15d-4671-bf2b-10c95064bb0b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:39.120112 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 058ec1cc-1cd2-44ec-93de-4557c5dd65de details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:26:39.188112 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8469a8f1-8146-438e-8fd4-f162e602e222 None None] Network e7d3d836-ebe9-4e03-af4b-235dd5e5cbea requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:26:39.201716 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-17dd651d-9b8b-48f4-bfb2-84e26488695a req-092f4038-5b78-4f07-b577-34f18bb758d5 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "GET /v2.0/ports?device_id=a17d0675-93b1-4ffe-a686-311f32edd826 HTTP/1.1" status: 200 len: 210 time: 0.0979996 Dec 09 21:26:39.259308 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b5382f1b-e4e4-4375-809a-83fa6dddac53 req-5aaa3699-83f5-4e31-8621-9b0fe7ddb7d6 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 210 time: 0.1339090 Dec 09 21:26:39.337039 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-25b77b9e-b15d-4671-bf2b-10c95064bb0b admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:39.338086 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 058ec1cc-1cd2-44ec-93de-4557c5dd65de, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=058ec1cc-1cd2-44ec-93de-4557c5dd65de,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:39.369483 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '058ec1cc-1cd2-44ec-93de-4557c5dd65de', 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb', 'port_id': '058ec1cc-1cd2-44ec-93de-4557c5dd65de', 'mac_address': 'fa:16:3e:86:6f:e8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 101, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '50496955-1646-4079-acd4-a47e8cd175cb', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:26:39.400287 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-93ba5793-0281-4378-bf56-dc2a41eb92cc x-openstack-request-id: req-93ba5793-0281-4378-bf56-dc2a41eb92cc {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:39.400818 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a17d0675-93b1-4ffe-a686-311f32edd826", "name": "network-vif-deleted", "tag": "3eea4303-cbf9-4dd6-8eaa-de772b7d85f8", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:39.401011 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-93ba5793-0281-4378-bf56-dc2a41eb92cc {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:39.401648 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a17d0675-93b1-4ffe-a686-311f32edd826', 'name': 'network-vif-deleted', 'tag': '3eea4303-cbf9-4dd6-8eaa-de772b7d85f8', 'status': 'completed', 'code': 200} Dec 09 21:26:39.416100 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:39.429362 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 058ec1cc-1cd2-44ec-93de-4557c5dd65de {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:39.451118 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 058ec1cc-1cd2-44ec-93de-4557c5dd65de, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=058ec1cc-1cd2-44ec-93de-4557c5dd65de,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:39.456907 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:39.503333 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cde44b4a-c871-4382-ae74-95c08e86199d req-9546c56e-0ee5-4ef6-baf0-592f2ee36b09 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:39.504886 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cde44b4a-c871-4382-ae74-95c08e86199d req-9546c56e-0ee5-4ef6-baf0-592f2ee36b09 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.1798208 Dec 09 21:26:39.505435 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=058ec1cc-1cd2-44ec-93de-4557c5dd65de,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:39.513284 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:39.513630 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:39.513955 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:39.514286 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:39.514612 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:39.514936 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:39.515263 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:39.515610 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:39.515920 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:39.516240 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:39.516553 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:39.517229 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:39.517550 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:39.520148 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-7bff3a47-d97f-4488-9787-23726bc76fc7 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Allocated IP 172.20.0.7 (4d446a14-1218-469d-93aa-b4f9babdbb6e/75afc53b-d3f3-461c-aba4-c2ce93780246/a2162a7f-55fc-4ed6-a111-15a5b9802370) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:26:39.549168 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:39.625088 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-25b77b9e-b15d-4671-bf2b-10c95064bb0b admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:39.638685 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['058ec1cc-1cd2-44ec-93de-4557c5dd65de'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:39.713412 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65ae078b-bef4-4305-952b-366a0538f839 req-53e4c8a6-38d3-460f-a8da-97e2505f4f84 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:39.714829 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-65ae078b-bef4-4305-952b-366a0538f839 req-53e4c8a6-38d3-460f-a8da-97e2505f4f84 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=dffe3c86-0677-4490-a36a-8bed7d798809 HTTP/1.1" status: 200 len: 944 time: 0.2441733 Dec 09 21:26:39.736714 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cde44b4a-c871-4382-ae74-95c08e86199d req-f12a23cc-6274-4aee-bf09-6c1bc99d5d90 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1810298 Dec 09 21:26:39.894569 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-65ae078b-bef4-4305-952b-366a0538f839 req-da9f2380-5387-4576-83ff-94c4a82be2a5 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1719213 Dec 09 21:26:39.918612 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-7bff3a47-d97f-4488-9787-23726bc76fc7 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:40.025981 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-7bff3a47-d97f-4488-9787-23726bc76fc7 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:40.162027 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-7bff3a47-d97f-4488-9787-23726bc76fc7 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Network 4d446a14-1218-469d-93aa-b4f9babdbb6e is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:26:40.172495 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-7bff3a47-d97f-4488-9787-23726bc76fc7 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:40.174309 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bff3a47-d97f-4488-9787-23726bc76fc7 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Pushing event updated for resources: {'Port': ['ID=a2162a7f-55fc-4ed6-a111-15a5b9802370,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:40.180634 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-7bff3a47-d97f-4488-9787-23726bc76fc7 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:26:40.204170 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-25b77b9e-b15d-4671-bf2b-10c95064bb0b admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:40.241528 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-25b77b9e-b15d-4671-bf2b-10c95064bb0b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:40.277196 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55cbe144-0490-4355-8e61-f39429da9ca1 req-d616ad28-20e1-491c-a204-d3d5908ea8ab tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:40.278771 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-55cbe144-0490-4355-8e61-f39429da9ca1 req-d616ad28-20e1-491c-a204-d3d5908ea8ab tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/ports?device_id=04d5c285-e8c5-448e-a7e8-5b0bbd69602f HTTP/1.1" status: 200 len: 946 time: 0.2426727 Dec 09 21:26:40.286202 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4627c62-5bdb-4441-b27b-be55e6760806 req-aae04e49-84c4-4979-a6f1-48bd1f5f18c5 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:40.287643 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c4627c62-5bdb-4441-b27b-be55e6760806 req-aae04e49-84c4-4979-a6f1-48bd1f5f18c5 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=c7f45d89-875f-4294-9fcb-17f7fc994b3f HTTP/1.1" status: 200 len: 950 time: 0.1920025 Dec 09 21:26:40.325367 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-7bff3a47-d97f-4488-9787-23726bc76fc7 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:40.325984 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-7bff3a47-d97f-4488-9787-23726bc76fc7 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:40.383748 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-7bff3a47-d97f-4488-9787-23726bc76fc7 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.6302257 Dec 09 21:26:40.414702 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-81bfdca0-e6cf-4926-8ccb-912915763334 service neutron] Request body: {'port': {'device_id': 'f3361776-fc91-4b92-9d13-73ed7e781a51', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:40.467998 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-55cbe144-0490-4355-8e61-f39429da9ca1 req-76e65cde-3dac-4ba5-aacc-ff56b355e712 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.13 "GET /v2.0/security-groups?id=c460cbfc-5960-42ff-abb9-4a137fb9cba6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1777868 Dec 09 21:26:40.480814 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c4627c62-5bdb-4441-b27b-be55e6760806 req-747bcdc2-833d-4436-a496-a4afddd552bf tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1522107 Dec 09 21:26:40.529805 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-25b77b9e-b15d-4671-bf2b-10c95064bb0b admin admin] Allocated IP 172.25.3.44 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/7e38e03d-c1aa-4113-b1bd-d91131f610c5) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:26:40.541684 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-81bfdca0-e6cf-4926-8ccb-912915763334 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:40.542185 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39710) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:40.661102 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-9f2cfaed-09ba-48d1-9111-6aa1d12912fe tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Deleting subnet 1ae814b0-bedd-4a6b-96ff-e062ac849b56 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:26:40.665890 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9f2cfaed-09ba-48d1-9111-6aa1d12912fe tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:40.757664 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9f2cfaed-09ba-48d1-9111-6aa1d12912fe tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:40.797240 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1943aee-0213-41db-858f-01222bde6809 req-34cb5c78-bd93-4066-92c3-3c9c1dc0ef52 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:40.799101 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e1943aee-0213-41db-858f-01222bde6809 req-34cb5c78-bd93-4066-92c3-3c9c1dc0ef52 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 931 time: 0.2260921 Dec 09 21:26:40.814371 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81123405-145e-4c51-8730-42b23afd71f2 req-0565e40b-c0e2-46cd-b254-30bb3da6b2ae tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:40.816443 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-81123405-145e-4c51-8730-42b23afd71f2 req-0565e40b-c0e2-46cd-b254-30bb3da6b2ae tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.31 "GET /v2.0/ports?device_id=04d5c285-e8c5-448e-a7e8-5b0bbd69602f HTTP/1.1" status: 200 len: 946 time: 0.1194103 Dec 09 21:26:40.830982 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-25b77b9e-b15d-4671-bf2b-10c95064bb0b admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:40.926071 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3719be9c-e21d-4c01-8875-1c5a1eeb6c5b req-d1108b25-0cd2-431f-8973-ddcd83dba58a tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:40.929763 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3719be9c-e21d-4c01-8875-1c5a1eeb6c5b req-d1108b25-0cd2-431f-8973-ddcd83dba58a tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=94826b5c-46f2-422a-a48d-eb415b5b9e44 HTTP/1.1" status: 200 len: 949 time: 0.2397885 Dec 09 21:26:40.991132 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9f2cfaed-09ba-48d1-9111-6aa1d12912fe tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:41.019415 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e1943aee-0213-41db-858f-01222bde6809 req-80c6c5a4-1c40-4b74-af68-032ff183ffff tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2105980 Dec 09 21:26:41.064210 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-81123405-145e-4c51-8730-42b23afd71f2 req-34024f09-b3f4-47a1-8ba5-b8f129297de8 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Deleting port e6c753d6-8187-435b-afd5-f77fe7d762ce {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:26:41.064652 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-81123405-145e-4c51-8730-42b23afd71f2 req-34024f09-b3f4-47a1-8ba5-b8f129297de8 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:41.090530 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-25b77b9e-b15d-4671-bf2b-10c95064bb0b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:41.111145 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3719be9c-e21d-4c01-8875-1c5a1eeb6c5b req-e62fdb1b-0616-40f2-8e21-0bd9e71bcb28 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1461205 Dec 09 21:26:41.134021 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:26:41.136868 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 058ec1cc-1cd2-44ec-93de-4557c5dd65de up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:26:41.152313 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9f2cfaed-09ba-48d1-9111-6aa1d12912fe tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:41.190160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f2cfaed-09ba-48d1-9111-6aa1d12912fe tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event deleted for resources: {'Subnet': ['ID=1ae814b0-bedd-4a6b-96ff-e062ac849b56,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:41.197730 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9f2cfaed-09ba-48d1-9111-6aa1d12912fe tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:41.204478 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9f2cfaed-09ba-48d1-9111-6aa1d12912fe tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "DELETE /v2.0/subnets/1ae814b0-bedd-4a6b-96ff-e062ac849b56 HTTP/1.1" status: 204 len: 168 time: 0.6605818 Dec 09 21:26:41.208056 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39722) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:41.213018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71706ab5-03b4-4011-965a-1024f8eb5f7f None None] Network 30d0c468-ca40-4f41-a7a6-de8dc44194c4 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:26:41.245433 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-81123405-145e-4c51-8730-42b23afd71f2 req-34024f09-b3f4-47a1-8ba5-b8f129297de8 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] For port e6c753d6-8187-435b-afd5-f77fe7d762ce, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e6c753d6-8187-435b-afd5-f77fe7d762ce,segment=NetworkSegment(b091c3fa-97be-41c0-9252-b65227a09bde),segment_id=b091c3fa-97be-41c0-9252-b65227a09bde)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:41.245862 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-81123405-145e-4c51-8730-42b23afd71f2 req-34024f09-b3f4-47a1-8ba5-b8f129297de8 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:41.276528 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-81123405-145e-4c51-8730-42b23afd71f2 req-34024f09-b3f4-47a1-8ba5-b8f129297de8 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Calling delete_port for e6c753d6-8187-435b-afd5-f77fe7d762ce owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:26:41.282638 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 058ec1cc-1cd2-44ec-93de-4557c5dd65de triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:41.283577 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:41.339300 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8dc0dbd7-5700-4bdb-a7b5-be98a23f9dc7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:41.432378 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e,segment=NetworkSegment(c472f4a8-1a94-4bb1-8978-a56e5ee37bb8),segment_id=c472f4a8-1a94-4bb1-8978-a56e5ee37bb8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:41.438516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a17d0675-93b1-4ffe-a686-311f32edd826', 'name': 'network-vif-deleted', 'tag': '5dd56541-48db-4dce-a0d7-6624015c8553'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:41.442752 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6cc5f3aa-1d60-4a85-8313-61638e1b2533" -d '{"events": [{"server_uuid": "a17d0675-93b1-4ffe-a686-311f32edd826", "name": "network-vif-deleted", "tag": "5dd56541-48db-4dce-a0d7-6624015c8553"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:41.471098 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e', 'network_id': 'de91a458-cde4-4265-8605-31d9b6f8f05f', 'port_id': 'b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e', 'mac_address': 'fa:16:3e:37:9f:e5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 121, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cb187a9c-ec94-4995-93f8-92c16c7a80a3', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:26:41.560654 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7ec43f8-89eb-45f8-a57e-3c4800ebf3b7 None None] DHCP port deletion for 30d0c468-ca40-4f41-a7a6-de8dc44194c4 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:26:41.571520 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-81123405-145e-4c51-8730-42b23afd71f2 req-34024f09-b3f4-47a1-8ba5-b8f129297de8 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:41.580033 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:41.586166 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:41.588661 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['e6c753d6-8187-435b-afd5-f77fe7d762ce'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:41.589252 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25b77b9e-b15d-4671-bf2b-10c95064bb0b admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:26:41.621458 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34024f09-b3f4-47a1-8ba5-b8f129297de8 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Pushing event deleted for resources: {'Port': ['ID=e6c753d6-8187-435b-afd5-f77fe7d762ce,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:41.626214 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-25b77b9e-b15d-4671-bf2b-10c95064bb0b admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:41.646555 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25b77b9e-b15d-4671-bf2b-10c95064bb0b admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:26:41.678180 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-8dc0dbd7-5700-4bdb-a7b5-be98a23f9dc7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Deleting port d421ed75-4068-4fe0-b0d2-b1800f25585a {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:26:41.678577 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8dc0dbd7-5700-4bdb-a7b5-be98a23f9dc7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:41.680074 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:41.711555 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-81123405-145e-4c51-8730-42b23afd71f2 req-34024f09-b3f4-47a1-8ba5-b8f129297de8 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] No DVR routers for this DVR port e6c753d6-8187-435b-afd5-f77fe7d762ce on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:26:41.722794 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-81123405-145e-4c51-8730-42b23afd71f2 req-34024f09-b3f4-47a1-8ba5-b8f129297de8 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:41.723226 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '058ec1cc-1cd2-44ec-93de-4557c5dd65de'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:41.726178 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-81123405-145e-4c51-8730-42b23afd71f2 req-34024f09-b3f4-47a1-8ba5-b8f129297de8 tempest-InstanceActionsTestJSON-190106541 tempest-InstanceActionsTestJSON-190106541-project] 10.222.0.31 "DELETE /v2.0/ports/e6c753d6-8187-435b-afd5-f77fe7d762ce HTTP/1.1" status: 204 len: 173 time: 0.8925474 Dec 09 21:26:41.726462 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e44777c3-4980-4063-982b-d89ef58a5608" -d '{"events": [{"server_uuid": "e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f", "name": "network-vif-plugged", "status": "completed", "tag": "058ec1cc-1cd2-44ec-93de-4557c5dd65de"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:41.733468 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25b77b9e-b15d-4671-bf2b-10c95064bb0b admin admin] Pushing event updated for resources: {'Port': ['ID=7e38e03d-c1aa-4113-b1bd-d91131f610c5,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:41.737117 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e,segment=NetworkSegment(c472f4a8-1a94-4bb1-8978-a56e5ee37bb8),segment_id=c472f4a8-1a94-4bb1-8978-a56e5ee37bb8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:41.754373 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 058ec1cc-1cd2-44ec-93de-4557c5dd65de, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=058ec1cc-1cd2-44ec-93de-4557c5dd65de,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:41.756052 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:41.792684 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:41.793463 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 5dd56541-48db-4dce-a0d7-6624015c8553 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:26:41.837935 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-8dc0dbd7-5700-4bdb-a7b5-be98a23f9dc7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] For port d421ed75-4068-4fe0-b0d2-b1800f25585a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d421ed75-4068-4fe0-b0d2-b1800f25585a,segment=NetworkSegment(62cd2cbb-d71c-4d79-8112-51e9e682f3f3),segment_id=62cd2cbb-d71c-4d79-8112-51e9e682f3f3)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:41.838324 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8dc0dbd7-5700-4bdb-a7b5-be98a23f9dc7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:41.862477 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-81bfdca0-e6cf-4926-8ccb-912915763334 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a2162a7f-55fc-4ed6-a111-15a5b9802370 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:41.877382 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-8dc0dbd7-5700-4bdb-a7b5-be98a23f9dc7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Calling delete_port for d421ed75-4068-4fe0-b0d2-b1800f25585a owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:26:41.879558 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-81bfdca0-e6cf-4926-8ccb-912915763334 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:41.911085 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-81bfdca0-e6cf-4926-8ccb-912915763334 service neutron] Transition to ACTIVE for port object a2162a7f-55fc-4ed6-a111-15a5b9802370 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:26:42.021560 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 5dd56541-48db-4dce-a0d7-6624015c8553 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:26:42.022020 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 5dd56541-48db-4dce-a0d7-6624015c8553 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:26:42.022462 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:26:42.024406 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8dc0dbd7-5700-4bdb-a7b5-be98a23f9dc7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:42.048795 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d421ed75-4068-4fe0-b0d2-b1800f25585a no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:26:42.083070 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc0dbd7-5700-4bdb-a7b5-be98a23f9dc7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event deleted for resources: {'Port': ['ID=d421ed75-4068-4fe0-b0d2-b1800f25585a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:42.086886 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-81bfdca0-e6cf-4926-8ccb-912915763334 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:42.108402 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:26:42.108824 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 3eea4303-cbf9-4dd6-8eaa-de772b7d85f8 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:26:42.112264 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: d421ed75-4068-4fe0-b0d2-b1800f25585a {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:26:42.112587 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8dc0dbd7-5700-4bdb-a7b5-be98a23f9dc7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] No DVR routers for this DVR port d421ed75-4068-4fe0-b0d2-b1800f25585a on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:26:42.112724 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d421ed75-4068-4fe0-b0d2-b1800f25585a not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:26:42.116209 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-c7ec43f8-89eb-45f8-a57e-3c4800ebf3b7 None None] Deleting port d421ed75-4068-4fe0-b0d2-b1800f25585a {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:26:42.116539 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c7ec43f8-89eb-45f8-a57e-3c4800ebf3b7 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:42.118235 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:42.148365 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a31ce41-3627-4c17-9387-5bfe8b082e39 req-042d2810-f327-4187-80da-c98fd83e6eab tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:42.157316 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a31ce41-3627-4c17-9387-5bfe8b082e39 req-042d2810-f327-4187-80da-c98fd83e6eab tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 944 time: 0.5926828 Dec 09 21:26:42.229542 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c7ec43f8-89eb-45f8-a57e-3c4800ebf3b7 None None] For port d421ed75-4068-4fe0-b0d2-b1800f25585a, host n-d-713301-27, got binding levels [] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:42.230218 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c7ec43f8-89eb-45f8-a57e-3c4800ebf3b7 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:42.234174 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:42.246393 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=058ec1cc-1cd2-44ec-93de-4557c5dd65de,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:42.259378 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-595e9433-1ae4-4f41-b8d1-90db0f4efb71 req-dc79bc8c-5ae5-4476-8702-155f842f9f78 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:42.267623 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-595e9433-1ae4-4f41-b8d1-90db0f4efb71 req-dc79bc8c-5ae5-4476-8702-155f842f9f78 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=dffe3c86-0677-4490-a36a-8bed7d798809 HTTP/1.1" status: 200 len: 944 time: 0.7131417 Dec 09 21:26:42.270335 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-c7ec43f8-89eb-45f8-a57e-3c4800ebf3b7 None None] Calling delete_port for d421ed75-4068-4fe0-b0d2-b1800f25585a owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:26:42.280880 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.ipam_backend_mixin [None req-c7ec43f8-89eb-45f8-a57e-3c4800ebf3b7 None None] Port d421ed75-4068-4fe0-b0d2-b1800f25585a was not found and therefore no delete operation was performed {{(pid=103439) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 09 21:26:42.284311 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c7ec43f8-89eb-45f8-a57e-3c4800ebf3b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:42.340625 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8dc0dbd7-5700-4bdb-a7b5-be98a23f9dc7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:42.372684 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7ec43f8-89eb-45f8-a57e-3c4800ebf3b7 None None] Pushing event deleted for resources: {'Port': ['ID=d421ed75-4068-4fe0-b0d2-b1800f25585a,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:42.388558 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7ec43f8-89eb-45f8-a57e-3c4800ebf3b7 None None] No DVR routers for this DVR port d421ed75-4068-4fe0-b0d2-b1800f25585a on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:26:42.430390 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-8dc0dbd7-5700-4bdb-a7b5-be98a23f9dc7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['30d0c468-ca40-4f41-a7a6-de8dc44194c4']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:42.447018 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-8dc0dbd7-5700-4bdb-a7b5-be98a23f9dc7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '62cd2cbb-d71c-4d79-8112-51e9e682f3f3') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:42.447974 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-8dc0dbd7-5700-4bdb-a7b5-be98a23f9dc7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '62cd2cbb-d71c-4d79-8112-51e9e682f3f3') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:42.461456 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8dc0dbd7-5700-4bdb-a7b5-be98a23f9dc7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:42.471957 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81bfdca0-e6cf-4926-8ccb-912915763334 service neutron] Pushing event updated for resources: {'Port': ['ID=a2162a7f-55fc-4ed6-a111-15a5b9802370,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:42.496843 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8dc0dbd7-5700-4bdb-a7b5-be98a23f9dc7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:42.502494 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a31ce41-3627-4c17-9387-5bfe8b082e39 req-ae3900a1-7682-47cf-bfb9-b1550b00482e tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3442400 Dec 09 21:26:42.509823 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8dc0dbd7-5700-4bdb-a7b5-be98a23f9dc7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Releasing vlan 119 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:26:42.510657 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8dc0dbd7-5700-4bdb-a7b5-be98a23f9dc7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:26:42.514753 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:26:42.534519 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-81bfdca0-e6cf-4926-8ccb-912915763334 service neutron] Attempting to bind port a2162a7f-55fc-4ed6-a111-15a5b9802370 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:26:42.536009 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-81bfdca0-e6cf-4926-8ccb-912915763334 service neutron] Attempting to bind port a2162a7f-55fc-4ed6-a111-15a5b9802370 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'e3c687b5-afac-4ac8-9b38-06599c2a8b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '4d446a14-1218-469d-93aa-b4f9babdbb6e'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:26:42.538006 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-81bfdca0-e6cf-4926-8ccb-912915763334 service neutron] Attempting to bind port a2162a7f-55fc-4ed6-a111-15a5b9802370 on network 4d446a14-1218-469d-93aa-b4f9babdbb6e {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:42.576334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-81bfdca0-e6cf-4926-8ccb-912915763334 service neutron] Port a2162a7f-55fc-4ed6-a111-15a5b9802370 on network 4d446a14-1218-469d-93aa-b4f9babdbb6e not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:26:42.576669 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-81bfdca0-e6cf-4926-8ccb-912915763334 service neutron] Attempting to bind port a2162a7f-55fc-4ed6-a111-15a5b9802370 on network 4d446a14-1218-469d-93aa-b4f9babdbb6e {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:42.582094 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-595e9433-1ae4-4f41-b8d1-90db0f4efb71 req-453ea195-ad20-4d72-ba34-0ebcb76bfbda tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3135002 Dec 09 21:26:42.608247 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-81bfdca0-e6cf-4926-8ccb-912915763334 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 26, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:26:42.608936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-81bfdca0-e6cf-4926-8ccb-912915763334 service neutron] Checking segment: {'id': 'e3c687b5-afac-4ac8-9b38-06599c2a8b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '4d446a14-1218-469d-93aa-b4f9babdbb6e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:42.609508 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-81bfdca0-e6cf-4926-8ccb-912915763334 service neutron] Bound using segment: {'id': 'e3c687b5-afac-4ac8-9b38-06599c2a8b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '4d446a14-1218-469d-93aa-b4f9babdbb6e'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:26:42.609935 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-81bfdca0-e6cf-4926-8ccb-912915763334 service neutron] Bound port: a2162a7f-55fc-4ed6-a111-15a5b9802370, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e3c687b5-afac-4ac8-9b38-06599c2a8b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '4d446a14-1218-469d-93aa-b4f9babdbb6e'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:26:42.610367 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-81bfdca0-e6cf-4926-8ccb-912915763334 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:42.630426 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8dc0dbd7-5700-4bdb-a7b5-be98a23f9dc7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:42.636472 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8dc0dbd7-5700-4bdb-a7b5-be98a23f9dc7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:42.652615 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8dc0dbd7-5700-4bdb-a7b5-be98a23f9dc7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "DELETE /v2.0/networks/30d0c468-ca40-4f41-a7a6-de8dc44194c4 HTTP/1.1" status: 204 len: 168 time: 1.4405785 Dec 09 21:26:42.654443 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39734) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:42.670156 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-10a30a0f-2337-4c49-917b-9869a5254781 x-openstack-request-id: req-10a30a0f-2337-4c49-917b-9869a5254781 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:42.670434 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a17d0675-93b1-4ffe-a686-311f32edd826", "name": "network-vif-deleted", "tag": "5dd56541-48db-4dce-a0d7-6624015c8553", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:42.677356 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-10a30a0f-2337-4c49-917b-9869a5254781 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:42.677813 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a17d0675-93b1-4ffe-a686-311f32edd826', 'name': 'network-vif-deleted', 'tag': '5dd56541-48db-4dce-a0d7-6624015c8553', 'status': 'completed', 'code': 200} Dec 09 21:26:42.696337 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dc0dbd7-5700-4bdb-a7b5-be98a23f9dc7 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event deleted for resources: {'Network': ['ID=30d0c468-ca40-4f41-a7a6-de8dc44194c4,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:42.735826 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39736) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:42.764580 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-90c36da5-0324-40d8-a17b-a31489389ed6 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Deleting subnet 67c09b0c-f53c-4918-9d79-b5f265f8b0cb {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:26:42.766893 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-25b77b9e-b15d-4671-bf2b-10c95064bb0b admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:42.828107 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-fd4123a5-328c-4a65-aa30-26f15f8a7500 admin admin] Deleting subnet ff1bf4b1-2f03-42e0-ab07-8a818f9a1ba2 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:26:42.833217 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd4123a5-328c-4a65-aa30-26f15f8a7500 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:42.876992 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-68010794-efa4-40c3-b1dc-eaedd7aa4456 x-openstack-request-id: req-68010794-efa4-40c3-b1dc-eaedd7aa4456 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:42.877429 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f", "name": "network-vif-plugged", "status": "completed", "tag": "058ec1cc-1cd2-44ec-93de-4557c5dd65de", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:42.877691 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-68010794-efa4-40c3-b1dc-eaedd7aa4456 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:42.878268 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '058ec1cc-1cd2-44ec-93de-4557c5dd65de', 'code': 200} Dec 09 21:26:42.883491 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd4123a5-328c-4a65-aa30-26f15f8a7500 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:42.925328 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-90c36da5-0324-40d8-a17b-a31489389ed6 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:42.941258 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd4123a5-328c-4a65-aa30-26f15f8a7500 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:43.019135 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd4123a5-328c-4a65-aa30-26f15f8a7500 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:43.087199 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-90c36da5-0324-40d8-a17b-a31489389ed6 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:43.090740 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd4123a5-328c-4a65-aa30-26f15f8a7500 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ff1bf4b1-2f03-42e0-ab07-8a818f9a1ba2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:43.094454 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd4123a5-328c-4a65-aa30-26f15f8a7500 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:43.099602 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fd4123a5-328c-4a65-aa30-26f15f8a7500 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/ff1bf4b1-2f03-42e0-ab07-8a818f9a1ba2 HTTP/1.1" status: 204 len: 168 time: 0.3626904 Dec 09 21:26:43.102100 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39738) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:43.211768 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-042cc448-f70f-4179-af05-28dca53bc26b req-3299cb7a-0abc-4639-868f-cb7405ce6a41 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:43.217506 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-042cc448-f70f-4179-af05-28dca53bc26b req-3299cb7a-0abc-4639-868f-cb7405ce6a41 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:43.221940 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f3709364-d774-4023-b1ae-76624104e5d2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:43.224937 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-042cc448-f70f-4179-af05-28dca53bc26b req-3299cb7a-0abc-4639-868f-cb7405ce6a41 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=c7f45d89-875f-4294-9fcb-17f7fc994b3f&device_id=94826b5c-46f2-422a-a48d-eb415b5b9e44 HTTP/1.1" status: 200 len: 1690 time: 0.3039968 Dec 09 21:26:43.241418 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-81bfdca0-e6cf-4926-8ccb-912915763334 service neutron] For port a2162a7f-55fc-4ed6-a111-15a5b9802370, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:26:43.273948 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed4eaea2-d27d-4e11-918d-2d257235c037 req-8eb19b53-f949-49aa-8038-a0d63ba35ca0 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:43.275471 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ed4eaea2-d27d-4e11-918d-2d257235c037 req-8eb19b53-f949-49aa-8038-a0d63ba35ca0 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 943 time: 0.3183203 Dec 09 21:26:43.329287 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f3709364-d774-4023-b1ae-76624104e5d2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:43.352530 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-f3709364-d774-4023-b1ae-76624104e5d2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5246b845-7de3-4759-8deb-13c3871588f0']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:43.366067 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-f3709364-d774-4023-b1ae-76624104e5d2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b091c3fa-97be-41c0-9252-b65227a09bde') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:43.366481 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-f3709364-d774-4023-b1ae-76624104e5d2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b091c3fa-97be-41c0-9252-b65227a09bde') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:43.371982 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-81bfdca0-e6cf-4926-8ccb-912915763334 service neutron] For port a2162a7f-55fc-4ed6-a111-15a5b9802370, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a2162a7f-55fc-4ed6-a111-15a5b9802370,segment=NetworkSegment(e3c687b5-afac-4ac8-9b38-06599c2a8b7e),segment_id=e3c687b5-afac-4ac8-9b38-06599c2a8b7e)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:26:43.382880 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f3709364-d774-4023-b1ae-76624104e5d2 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:43.394268 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-90c36da5-0324-40d8-a17b-a31489389ed6 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:43.402149 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f3709364-d774-4023-b1ae-76624104e5d2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:43.412717 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f3709364-d774-4023-b1ae-76624104e5d2 admin admin] Releasing vlan 107 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:26:43.412717 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f3709364-d774-4023-b1ae-76624104e5d2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:26:43.414854 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:26:43.437547 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-81bfdca0-e6cf-4926-8ccb-912915763334 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:43.526995 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-81bfdca0-e6cf-4926-8ccb-912915763334 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:43.527659 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-81bfdca0-e6cf-4926-8ccb-912915763334 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:43.529990 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-81bfdca0-e6cf-4926-8ccb-912915763334 service neutron] 10.222.0.31 "PUT /v2.0/ports/a2162a7f-55fc-4ed6-a111-15a5b9802370 HTTP/1.1" status: 200 len: 1092 time: 3.1287575 Dec 09 21:26:43.535431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f3361776-fc91-4b92-9d13-73ed7e781a51', 'tag': 'a2162a7f-55fc-4ed6-a111-15a5b9802370'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:43.537898 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e619c897-abed-4f5b-ae2f-0fde2a247957" -d '{"events": [{"name": "network-changed", "server_uuid": "f3361776-fc91-4b92-9d13-73ed7e781a51", "tag": "a2162a7f-55fc-4ed6-a111-15a5b9802370"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:43.541197 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-25b77b9e-b15d-4671-bf2b-10c95064bb0b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:43.563904 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f3709364-d774-4023-b1ae-76624104e5d2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:43.579420 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-042cc448-f70f-4179-af05-28dca53bc26b req-7f659ff5-18fe-4904-a9b9-ce8ecb5f9df9 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3536162 Dec 09 21:26:43.580247 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f3709364-d774-4023-b1ae-76624104e5d2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:43.593023 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f3709364-d774-4023-b1ae-76624104e5d2 admin admin] 10.222.0.13 "DELETE /v2.0/networks/5246b845-7de3-4759-8deb-13c3871588f0 HTTP/1.1" status: 204 len: 168 time: 0.4897034 Dec 09 21:26:43.633754 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3709364-d774-4023-b1ae-76624104e5d2 admin admin] Pushing event deleted for resources: {'Network': ['ID=5246b845-7de3-4759-8deb-13c3871588f0,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:43.670368 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81bfdca0-e6cf-4926-8ccb-912915763334 service neutron] Pushing event updated for resources: {'Port': ['ID=a2162a7f-55fc-4ed6-a111-15a5b9802370,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:43.707044 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ed4eaea2-d27d-4e11-918d-2d257235c037 req-b704a2b5-4c48-4d58-97b2-94aa0d6aa371 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3370442 Dec 09 21:26:43.801552 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39750) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:43.814244 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-39bf6f6b-1f2f-421d-9952-27d8aa2c07fd x-openstack-request-id: req-39bf6f6b-1f2f-421d-9952-27d8aa2c07fd {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:43.814551 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f3361776-fc91-4b92-9d13-73ed7e781a51", "tag": "a2162a7f-55fc-4ed6-a111-15a5b9802370", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:43.814782 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-39bf6f6b-1f2f-421d-9952-27d8aa2c07fd {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:43.815211 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f3361776-fc91-4b92-9d13-73ed7e781a51', 'tag': 'a2162a7f-55fc-4ed6-a111-15a5b9802370', 'status': 'completed', 'code': 200} Dec 09 21:26:43.865930 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-90c36da5-0324-40d8-a17b-a31489389ed6 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:43.885391 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e0375f84-da41-484a-97ed-749f05831b90 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=a9b3d91742274db295ecdc3138fae25f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0826120 Dec 09 21:26:43.886236 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39756) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:43.920386 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90c36da5-0324-40d8-a17b-a31489389ed6 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event deleted for resources: {'Subnet': ['ID=67c09b0c-f53c-4918-9d79-b5f265f8b0cb,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:43.923907 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-d06de893-65e1-4d97-9742-70d7a1343765 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:43.925511 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-d06de893-65e1-4d97-9742-70d7a1343765 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=18e7af94d60344a18dedc56eda040c4b&device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 1095 time: 0.3106251 Dec 09 21:26:43.928635 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-90c36da5-0324-40d8-a17b-a31489389ed6 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:43.932129 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-90c36da5-0324-40d8-a17b-a31489389ed6 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "DELETE /v2.0/subnets/67c09b0c-f53c-4918-9d79-b5f265f8b0cb HTTP/1.1" status: 204 len: 168 time: 1.2766662 Dec 09 21:26:43.934309 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5e4de5ec-cb25-4685-976e-a2ef67092db9 None None] Network b10aba5b-a802-488f-b187-37195bb0b8ca requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:26:43.944038 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39758) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:43.972477 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bb10ab84-f79b-42e2-9da4-e35d3187fe75 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:43.974801 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8668fde-8de6-4fa8-a445-7565042ec5ef req-3672ca5c-6493-422b-9b64-f62beacd80e4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:43.988710 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8668fde-8de6-4fa8-a445-7565042ec5ef req-3672ca5c-6493-422b-9b64-f62beacd80e4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.2769914 Dec 09 21:26:43.995748 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bb10ab84-f79b-42e2-9da4-e35d3187fe75 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:44.048561 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-ff0b67a3-2815-4267-b881-6762c6cd7009 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=a2162a7f-55fc-4ed6-a111-15a5b9802370 HTTP/1.1" status: 200 len: 217 time: 0.1068914 Dec 09 21:26:44.051467 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bb10ab84-f79b-42e2-9da4-e35d3187fe75 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:44.054601 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bb10ab84-f79b-42e2-9da4-e35d3187fe75 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:44.058832 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bb10ab84-f79b-42e2-9da4-e35d3187fe75 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/c460cbfc-5960-42ff-abb9-4a137fb9cba6 HTTP/1.1" status: 204 len: 168 time: 0.1694131 Dec 09 21:26:44.069989 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb10ab84-f79b-42e2-9da4-e35d3187fe75 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c460cbfc-5960-42ff-abb9-4a137fb9cba6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:44.186531 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f382d065-7201-4ef8-bfdc-010a9a729697 None None] DHCP port deletion for b10aba5b-a802-488f-b187-37195bb0b8ca request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:26:44.293401 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f382d065-7201-4ef8-bfdc-010a9a729697 None None] Deleting port 00d35d1d-e182-4dbc-888e-3d60e58ca11a {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:26:44.293924 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f382d065-7201-4ef8-bfdc-010a9a729697 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:44.391211 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f382d065-7201-4ef8-bfdc-010a9a729697 None None] For port 00d35d1d-e182-4dbc-888e-3d60e58ca11a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=00d35d1d-e182-4dbc-888e-3d60e58ca11a,segment=NetworkSegment(d2f9d5c1-75e0-4806-a659-59422ae7083c),segment_id=d2f9d5c1-75e0-4806-a659-59422ae7083c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:44.391802 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f382d065-7201-4ef8-bfdc-010a9a729697 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:44.408029 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f382d065-7201-4ef8-bfdc-010a9a729697 None None] Calling delete_port for 00d35d1d-e182-4dbc-888e-3d60e58ca11a owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:26:44.529077 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f382d065-7201-4ef8-bfdc-010a9a729697 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:44.556034 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-792f2fa9-fd49-4fa2-b918-d40b6f36da08 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:44.571145 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f382d065-7201-4ef8-bfdc-010a9a729697 None None] No DVR routers for this DVR port 00d35d1d-e182-4dbc-888e-3d60e58ca11a on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:26:44.574516 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f382d065-7201-4ef8-bfdc-010a9a729697 None None] Pushing event deleted for resources: {'Port': ['ID=00d35d1d-e182-4dbc-888e-3d60e58ca11a,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:44.598213 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-f3a76b68-3be0-4477-a725-9183d9289dce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:44.599731 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-f3a76b68-3be0-4477-a725-9183d9289dce service neutron] 10.222.0.31 "GET /v2.0/subnets?id=75afc53b-d3f3-461c-aba4-c2ce93780246 HTTP/1.1" status: 200 len: 855 time: 0.4897053 Dec 09 21:26:44.615222 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2da02fb-ac6f-407f-81f6-04a62a57f47c req-d129b79a-ac99-4c4a-9765-9c58e0ea35b7 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:44.625548 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2da02fb-ac6f-407f-81f6-04a62a57f47c req-d129b79a-ac99-4c4a-9765-9c58e0ea35b7 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=dffe3c86-0677-4490-a36a-8bed7d798809 HTTP/1.1" status: 200 len: 945 time: 0.6357076 Dec 09 21:26:44.658714 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8668fde-8de6-4fa8-a445-7565042ec5ef req-0b86463e-773c-46bd-93c7-86b907eebb89 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6245027 Dec 09 21:26:44.679090 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '04d5c285-e8c5-448e-a7e8-5b0bbd69602f', 'name': 'network-vif-deleted', 'tag': 'e6c753d6-8187-435b-afd5-f77fe7d762ce'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:44.682259 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0e70f0ac-8730-4240-a448-3dfd7bcb5ac5" -d '{"events": [{"server_uuid": "04d5c285-e8c5-448e-a7e8-5b0bbd69602f", "name": "network-vif-deleted", "tag": "e6c753d6-8187-435b-afd5-f77fe7d762ce"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:44.707841 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-25b77b9e-b15d-4671-bf2b-10c95064bb0b admin admin] Router 59853428-6655-4e5e-b7d8-ac85e7e3f2b4 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:26:44.711747 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-1e1cb914-d4e2-4fe3-9cf4-9c275a706554 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=4d446a14-1218-469d-93aa-b4f9babdbb6e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0767956 Dec 09 21:26:44.835222 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2da02fb-ac6f-407f-81f6-04a62a57f47c req-5fab9f9c-5688-4e23-9679-14adee68359e tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2026498 Dec 09 21:26:44.932100 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-da7375e9-c613-4fc9-9665-a6139f94ce1c x-openstack-request-id: req-da7375e9-c613-4fc9-9665-a6139f94ce1c {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:44.932435 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "04d5c285-e8c5-448e-a7e8-5b0bbd69602f", "name": "network-vif-deleted", "tag": "e6c753d6-8187-435b-afd5-f77fe7d762ce", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:44.932639 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-da7375e9-c613-4fc9-9665-a6139f94ce1c {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:44.933041 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '04d5c285-e8c5-448e-a7e8-5b0bbd69602f', 'name': 'network-vif-deleted', 'tag': 'e6c753d6-8187-435b-afd5-f77fe7d762ce', 'status': 'completed', 'code': 200} Dec 09 21:26:45.103891 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-792f2fa9-fd49-4fa2-b918-d40b6f36da08 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:45.132131 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:26:45.196985 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:26:45.197306 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-9766de9e-221d-4f5c-b6ef-9fb12899e614 service neutron] 10.222.0.31 "GET /v2.0/networks/4d446a14-1218-469d-93aa-b4f9babdbb6e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4666436 Dec 09 21:26:45.198981 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-792f2fa9-fd49-4fa2-b918-d40b6f36da08 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b10aba5b-a802-488f-b187-37195bb0b8ca']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:45.203932 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:45.205271 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:45.219488 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39784) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:45.228217 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-25b77b9e-b15d-4671-bf2b-10c95064bb0b admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:26:45.231973 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-792f2fa9-fd49-4fa2-b918-d40b6f36da08 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd2f9d5c1-75e0-4806-a659-59422ae7083c') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:45.232270 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-792f2fa9-fd49-4fa2-b918-d40b6f36da08 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd2f9d5c1-75e0-4806-a659-59422ae7083c') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:45.247079 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] Sync routers for ids ['59853428-6655-4e5e-b7d8-ac85e7e3f2b4'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:26:45.264821 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-792f2fa9-fd49-4fa2-b918-d40b6f36da08 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:45.267945 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] Routers {'59853428-6655-4e5e-b7d8-ac85e7e3f2b4'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:26:45.269558 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:26:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['59853428-6655-4e5e-b7d8-ac85e7e3f2b4'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:45.297247 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf859f4d-483d-45b8-b5d5-4c25713d7dfc req-7b4ca921-0a9d-4330-9b10-29559e155a00 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:45.304500 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf859f4d-483d-45b8-b5d5-4c25713d7dfc req-7b4ca921-0a9d-4330-9b10-29559e155a00 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 943 time: 0.2416413 Dec 09 21:26:45.357864 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-792f2fa9-fd49-4fa2-b918-d40b6f36da08 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:45.362046 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-25b77b9e-b15d-4671-bf2b-10c95064bb0b admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:45.363379 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-25b77b9e-b15d-4671-bf2b-10c95064bb0b admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 6.3684866 Dec 09 21:26:45.365867 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af090917-942e-4590-a483-6102661962cc req-6a02c26c-f505-4f67-ae14-1f3c90aff87d tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:45.366408 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39788) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:45.374162 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af090917-942e-4590-a483-6102661962cc req-6a02c26c-f505-4f67-ae14-1f3c90aff87d tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=c7f45d89-875f-4294-9fcb-17f7fc994b3f HTTP/1.1" status: 200 len: 1102 time: 0.3096881 Dec 09 21:26:45.395842 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-792f2fa9-fd49-4fa2-b918-d40b6f36da08 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Releasing vlan 116 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:26:45.396077 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] Set router 59853428-6655-4e5e-b7d8-ac85e7e3f2b4 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:26:45.396645 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-792f2fa9-fd49-4fa2-b918-d40b6f36da08 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:26:45.402261 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:26:45.443904 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Request body: {'network': {'name': 'tempest-InstanceActionsNegativeTestJSON-865546321-network', 'tenant_id': 'f8b3b783f4c54a789e9012e49667eaa1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:45.524395 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43b2de2b-257f-4c85-9a40-c8b9938c6770 req-d16f64ab-8a0d-48c8-8d8a-6c7af3c6759c service neutron] 10.222.0.31 "GET /v2.0/networks/4d446a14-1218-469d-93aa-b4f9babdbb6e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3092527 Dec 09 21:26:45.529967 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Made reservation on behalf of f8b3b783f4c54a789e9012e49667eaa1 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:45.534297 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:45.542024 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf859f4d-483d-45b8-b5d5-4c25713d7dfc req-596897b1-324b-47af-968c-20f58cef5a41 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2365732 Dec 09 21:26:45.558692 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:45.564220 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af090917-942e-4590-a483-6102661962cc req-2e416ecd-397a-4e30-b162-61d73d66776c tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1887858 Dec 09 21:26:45.565402 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-792f2fa9-fd49-4fa2-b918-d40b6f36da08 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:45.588655 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-792f2fa9-fd49-4fa2-b918-d40b6f36da08 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:45.600755 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-792f2fa9-fd49-4fa2-b918-d40b6f36da08 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] 10.222.0.13 "DELETE /v2.0/networks/b10aba5b-a802-488f-b187-37195bb0b8ca HTTP/1.1" status: 204 len: 168 time: 1.6546857 Dec 09 21:26:45.666599 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-792f2fa9-fd49-4fa2-b918-d40b6f36da08 tempest-ServersTestMultiNic-2080649802 tempest-ServersTestMultiNic-2080649802-project] Pushing event deleted for resources: {'Network': ['ID=b10aba5b-a802-488f-b187-37195bb0b8ca,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:45.728450 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:45.754369 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e619c897-abed-4f5b-ae2f-0fde2a247957 req-0ecd4828-84c2-4b82-8a92-e8ef8fc944be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:45.756391 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e619c897-abed-4f5b-ae2f-0fde2a247957 req-0ecd4828-84c2-4b82-8a92-e8ef8fc944be service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=18e7af94d60344a18dedc56eda040c4b&device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 1095 time: 0.1459520 Dec 09 21:26:45.764789 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faa210c9-ea42-482b-b6dd-b12828f59efb req-0015ba99-5479-43c6-ac39-9421a6b89945 tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:45.766441 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-faa210c9-ea42-482b-b6dd-b12828f59efb req-0015ba99-5479-43c6-ac39-9421a6b89945 tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=94826b5c-46f2-422a-a48d-eb415b5b9e44 HTTP/1.1" status: 200 len: 1101 time: 0.0904839 Dec 09 21:26:45.804393 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dffe3c86-0677-4490-a36a-8bed7d798809', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:45.810492 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b37791ed-efe4-40e4-854c-6817d08d3f87" -d '{"events": [{"server_uuid": "dffe3c86-0677-4490-a36a-8bed7d798809", "name": "network-vif-plugged", "status": "completed", "tag": "b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:45.830051 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e,segment=NetworkSegment(c472f4a8-1a94-4bb1-8978-a56e5ee37bb8),segment_id=c472f4a8-1a94-4bb1-8978-a56e5ee37bb8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:45.841149 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '59853428-6655-4e5e-b7d8-ac85e7e3f2b4', 'name': 'tempest-ServerRescueTestJSON-1978792040-router', 'tenant_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44'}], 'enable_snat': True}, 'gw_port_id': '7e38e03d-c1aa-4113-b1bd-d91131f610c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:26:39Z', 'updated_at': '2021-12-09T21:26:42Z', 'revision_number': 3, 'project_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'gw_port': {'id': '7e38e03d-c1aa-4113-b1bd-d91131f610c5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:e8:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '59853428-6655-4e5e-b7d8-ac85e7e3f2b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1046, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:26:40Z', 'updated_at': '2021-12-09T21:26:40Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:45.870253 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] Checking router: 59853428-6655-4e5e-b7d8-ac85e7e3f2b4 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:26:45.870642 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] Updating router 59853428-6655-4e5e-b7d8-ac85e7e3f2b4 port 7e38e03d-c1aa-4113-b1bd-d91131f610c5 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:26:45.898316 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:45.898926 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e6c753d6-8187-435b-afd5-f77fe7d762ce no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:26:45.919479 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:45.921987 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: e6c753d6-8187-435b-afd5-f77fe7d762ce {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:26:45.922326 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e6c753d6-8187-435b-afd5-f77fe7d762ce not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:26:45.927334 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 00d35d1d-e182-4dbc-888e-3d60e58ca11a no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:26:45.961687 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-488b3fff-c1ed-4639-8af2-04438d29bec5 req-6cabb2b4-80aa-41b5-8108-a0df7c370dd0 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:45.972317 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-488b3fff-c1ed-4639-8af2-04438d29bec5 req-6cabb2b4-80aa-41b5-8108-a0df7c370dd0 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.1545916 Dec 09 21:26:45.993426 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 00d35d1d-e182-4dbc-888e-3d60e58ca11a {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:26:45.993766 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 00d35d1d-e182-4dbc-888e-3d60e58ca11a not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:26:46.057911 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-488b3fff-c1ed-4639-8af2-04438d29bec5 req-79949c90-3f06-4f1b-943d-6efd5a14602f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0811040 Dec 09 21:26:46.078122 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:46.093413 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-faa210c9-ea42-482b-b6dd-b12828f59efb req-845ded34-8b28-4c7e-ae56-7c12311f51fe tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3019309 Dec 09 21:26:46.102326 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:46.109088 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e619c897-abed-4f5b-ae2f-0fde2a247957 req-e04dbe3c-ce65-4e53-8422-12d2bfc14410 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:46.111826 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e619c897-abed-4f5b-ae2f-0fde2a247957 req-e04dbe3c-ce65-4e53-8422-12d2bfc14410 service neutron] 10.222.0.31 "GET /v2.0/networks?id=4d446a14-1218-469d-93aa-b4f9babdbb6e HTTP/1.1" status: 200 len: 916 time: 0.3440480 Dec 09 21:26:46.114457 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:46.212081 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4d5d912f-1d0b-42bc-a2bc-0cbf4c11113d x-openstack-request-id: req-4d5d912f-1d0b-42bc-a2bc-0cbf4c11113d {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:46.212706 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dffe3c86-0677-4490-a36a-8bed7d798809", "name": "network-vif-plugged", "status": "completed", "tag": "b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:46.212706 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-4d5d912f-1d0b-42bc-a2bc-0cbf4c11113d {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:46.212903 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dffe3c86-0677-4490-a36a-8bed7d798809', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e', 'code': 200} Dec 09 21:26:46.245606 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e619c897-abed-4f5b-ae2f-0fde2a247957 req-333975f0-8ca4-4e39-96ad-71e6010db4d4 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=a2162a7f-55fc-4ed6-a111-15a5b9802370 HTTP/1.1" status: 200 len: 217 time: 0.1227715 Dec 09 21:26:46.261791 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] vlan segment allocate from pool success with {'vlan_id': 136, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:26:46.359416 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:46.374908 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:46.385545 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39814) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:46.387428 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e619c897-abed-4f5b-ae2f-0fde2a247957 req-2af19808-7526-4067-a530-e8880de85747 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:46.389397 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e619c897-abed-4f5b-ae2f-0fde2a247957 req-2af19808-7526-4067-a530-e8880de85747 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=75afc53b-d3f3-461c-aba4-c2ce93780246 HTTP/1.1" status: 200 len: 855 time: 0.1226177 Dec 09 21:26:46.399073 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=311d4b92-14f8-4511-8f88-1dc905946c73,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:46.402511 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:46.402736 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Added segment 46e6c67a-dcee-4633-8adc-6de1ea927c73 of type vlan for network 43277078-8ac8-4619-8b7d-a7366d3b265f Dec 09 21:26:46.449179 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e619c897-abed-4f5b-ae2f-0fde2a247957 req-647470ed-ef60-4163-8042-bb902d3dc4d8 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=4d446a14-1218-469d-93aa-b4f9babdbb6e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0445509 Dec 09 21:26:46.471792 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40eb96c3-227e-4b47-a447-7c0518d8a45b None None] Pushing event updated for resources: {'Port': ['ID=7e38e03d-c1aa-4113-b1bd-d91131f610c5,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:46.472744 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8d2fb7c-3ec0-4c12-9937-f54d856b5923 req-578b838e-0a3a-4804-bd30-726da83f69d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:46.474287 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b8d2fb7c-3ec0-4c12-9937-f54d856b5923 req-578b838e-0a3a-4804-bd30-726da83f69d7 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=dffe3c86-0677-4490-a36a-8bed7d798809 HTTP/1.1" status: 200 len: 1098 time: 0.1585391 Dec 09 21:26:46.496864 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] Attempting to bind port 7e38e03d-c1aa-4113-b1bd-d91131f610c5 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:26:46.497672 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] Attempting to bind port 7e38e03d-c1aa-4113-b1bd-d91131f610c5 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:26:46.498470 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] Attempting to bind port 7e38e03d-c1aa-4113-b1bd-d91131f610c5 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:46.503226 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:46.503628 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:46.503976 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:46.504320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:46.504660 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:46.504995 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:46.505324 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:46.505661 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:46.506029 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:46.506317 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:46.506645 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:46.506969 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:46.507291 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:46.524353 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-077c776d-34a5-46af-81e4-c08566912da0 req-f3fe16c0-9996-46b5-b69d-9355376a0825 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:46.527675 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 26, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:26:46.528220 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:46.528828 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:46.529313 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:26:46.530143 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] Bound port: 7e38e03d-c1aa-4113-b1bd-d91131f610c5, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:26:46.530622 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:46.533376 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-077c776d-34a5-46af-81e4-c08566912da0 req-f3fe16c0-9996-46b5-b69d-9355376a0825 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=dffe3c86-0677-4490-a36a-8bed7d798809 HTTP/1.1" status: 200 len: 946 time: 0.1428404 Dec 09 21:26:46.587736 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] For port 7e38e03d-c1aa-4113-b1bd-d91131f610c5, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:26:46.590927 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:46.592299 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] For port 7e38e03d-c1aa-4113-b1bd-d91131f610c5, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7e38e03d-c1aa-4113-b1bd-d91131f610c5,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:26:46.611133 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:46.628420 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-b6089d4a-6d86-4b85-ad4b-068bc9cbea99 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0926962 Dec 09 21:26:46.679525 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b8d2fb7c-3ec0-4c12-9937-f54d856b5923 req-ddfc7f68-2e36-4111-b32d-3f5c3663836a service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1540108 Dec 09 21:26:46.688860 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40eb96c3-227e-4b47-a447-7c0518d8a45b None None] Pushing event updated for resources: {'Port': ['ID=7e38e03d-c1aa-4113-b1bd-d91131f610c5,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:46.710914 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] Routers {'59853428-6655-4e5e-b7d8-ac85e7e3f2b4'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:26:46.711344 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-077c776d-34a5-46af-81e4-c08566912da0 req-b06d3a09-e158-4c29-8f3f-31a82572358d tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1718514 Dec 09 21:26:46.711628 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:26:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['59853428-6655-4e5e-b7d8-ac85e7e3f2b4'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:46.718096 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-317b3952-1706-4ee9-8f7f-0c5fc6e23f03 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:46.899741 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e619c897-abed-4f5b-ae2f-0fde2a247957 req-24d1a780-6894-4250-9b62-5bc37b009ef7 service neutron] 10.222.0.31 "GET /v2.0/networks/4d446a14-1218-469d-93aa-b4f9babdbb6e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4399269 Dec 09 21:26:46.912065 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] Set router 59853428-6655-4e5e-b7d8-ac85e7e3f2b4 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:26:46.970998 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-50ce9d4d-9c02-455c-8d1d-b80cab652351 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:46.978936 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-50ce9d4d-9c02-455c-8d1d-b80cab652351 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3494129 Dec 09 21:26:47.043473 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-c5e93dc8-cc94-4b5e-89c9-f51a9c0b5594 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/quotas/23f7f8a3e7b14635b4f7dfa561684399 HTTP/1.1" status: 200 len: 375 time: 0.0632198 Dec 09 21:26:47.072596 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-667fdf72-d53f-4c24-a3f3-570bd3455d53 req-60cf1ef7-096c-4dcf-8597-b60e06657968 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:47.081175 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-667fdf72-d53f-4c24-a3f3-570bd3455d53 req-60cf1ef7-096c-4dcf-8597-b60e06657968 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 943 time: 0.2081325 Dec 09 21:26:47.169062 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-667fdf72-d53f-4c24-a3f3-570bd3455d53 req-97ea13b8-b0a7-49ce-8484-8b397bc2c2d0 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0868509 Dec 09 21:26:47.190010 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '59853428-6655-4e5e-b7d8-ac85e7e3f2b4', 'name': 'tempest-ServerRescueTestJSON-1978792040-router', 'tenant_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44'}], 'enable_snat': True}, 'gw_port_id': '7e38e03d-c1aa-4113-b1bd-d91131f610c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:26:39Z', 'updated_at': '2021-12-09T21:26:42Z', 'revision_number': 3, 'project_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'gw_port': {'id': '7e38e03d-c1aa-4113-b1bd-d91131f610c5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:e8:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '59853428-6655-4e5e-b7d8-ac85e7e3f2b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1046, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:26:40Z', 'updated_at': '2021-12-09T21:26:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:47.191487 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e619c897-abed-4f5b-ae2f-0fde2a247957 req-e4f108e2-6241-4d27-a11b-507786813e27 service neutron] 10.222.0.31 "GET /v2.0/networks/4d446a14-1218-469d-93aa-b4f9babdbb6e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2684655 Dec 09 21:26:47.231814 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-3ba0ced0-273b-42a3-9b40-a3830e2b1e8c tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&fields=id HTTP/1.1" status: 200 len: 440 time: 0.1871874 Dec 09 21:26:47.281010 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-317b3952-1706-4ee9-8f7f-0c5fc6e23f03 admin admin] Allocated IP 172.20.0.1 (e7d3d836-ebe9-4e03-af4b-235dd5e5cbea/a84d1123-6651-4f35-9cba-4f9c8f45aab6/d68b58cd-3f98-4aa6-8259-efea961feb0a) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:26:47.390420 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cc0359c-bd78-4d5b-b66a-b9ce88805703 req-b948b116-e0e5-44db-ade7-eef783432b3e tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:47.400213 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5cc0359c-bd78-4d5b-b66a-b9ce88805703 req-b948b116-e0e5-44db-ade7-eef783432b3e tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.0980051 Dec 09 21:26:47.426887 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-317b3952-1706-4ee9-8f7f-0c5fc6e23f03 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:47.484847 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5cc0359c-bd78-4d5b-b66a-b9ce88805703 req-4083b5d8-33cc-4a61-a88e-1d9fc59615a5 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0786228 Dec 09 21:26:47.521383 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:47.522714 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:47.529462 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:47.563676 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb74cb26-2bca-4a53-a99c-3bd2d0e11d3f req-ea7ceed4-2093-4acb-b1d7-70a9538c01f3 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=a45aee8c-1ead-4182-81dd-72688d980ba4 HTTP/1.1" status: 200 len: 210 time: 0.0429316 Dec 09 21:26:47.577029 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c5100be-900f-4c31-baef-69ac76653ec7 None None] The sync data for ids ['59853428-6655-4e5e-b7d8-ac85e7e3f2b4'] in n-d-713301-27 is: [{'id': '59853428-6655-4e5e-b7d8-ac85e7e3f2b4', 'name': 'tempest-ServerRescueTestJSON-1978792040-router', 'tenant_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44'}], 'enable_snat': True}, 'gw_port_id': '7e38e03d-c1aa-4113-b1bd-d91131f610c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:26:39Z', 'updated_at': '2021-12-09T21:26:42Z', 'revision_number': 3, 'project_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'gw_port': {'id': '7e38e03d-c1aa-4113-b1bd-d91131f610c5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:e8:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '59853428-6655-4e5e-b7d8-ac85e7e3f2b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1046, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:26:40Z', 'updated_at': '2021-12-09T21:26:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:26:47.640132 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-317b3952-1706-4ee9-8f7f-0c5fc6e23f03 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:47.744519 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] Pushing event updated for resources: {'Network': ['ID=43277078-8ac8-4619-8b7d-a7366d3b265f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:47.756203 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 43277078-8ac8-4619-8b7d-a7366d3b265f details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:26:47.761174 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39842) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:47.761849 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0e040eec-c4c5-4c35-b94a-390bbc3d0274 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 894 time: 2.5409389 Dec 09 21:26:47.769371 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-f6a27f73-234e-4720-9954-7eddb61db598 admin admin] Request body: {'subnet': {'network_id': '43277078-8ac8-4619-8b7d-a7366d3b265f', 'cidr': '172.20.0.0/28', 'name': 'tempest-InstanceActionsNegativeTestJSON-865546321-subnet', 'tenant_id': 'f8b3b783f4c54a789e9012e49667eaa1', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:47.794711 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-317b3952-1706-4ee9-8f7f-0c5fc6e23f03 admin admin] Network e7d3d836-ebe9-4e03-af4b-235dd5e5cbea is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:26:47.804930 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-317b3952-1706-4ee9-8f7f-0c5fc6e23f03 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:47.842402 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-317b3952-1706-4ee9-8f7f-0c5fc6e23f03 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:26:47.842672 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f6a27f73-234e-4720-9954-7eddb61db598 admin admin] Made reservation on behalf of f8b3b783f4c54a789e9012e49667eaa1 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:47.845140 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-317b3952-1706-4ee9-8f7f-0c5fc6e23f03 admin admin] Pushing event updated for resources: {'Port': ['ID=d68b58cd-3f98-4aa6-8259-efea961feb0a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:47.846028 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f6a27f73-234e-4720-9954-7eddb61db598 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:47.908879 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-317b3952-1706-4ee9-8f7f-0c5fc6e23f03 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:48.131364 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-317b3952-1706-4ee9-8f7f-0c5fc6e23f03 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:48.134139 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35e91bde-b518-403b-83aa-fa3d3eaf413c req-53350001-3d8c-48ba-9691-d8e4ebd1fcc6 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:48.144498 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35e91bde-b518-403b-83aa-fa3d3eaf413c req-53350001-3d8c-48ba-9691-d8e4ebd1fcc6 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=dffe3c86-0677-4490-a36a-8bed7d798809 HTTP/1.1" status: 200 len: 946 time: 0.2430067 Dec 09 21:26:48.259832 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35e91bde-b518-403b-83aa-fa3d3eaf413c req-5728420e-90df-4dc0-8410-8c34b16864c8 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1110282 Dec 09 21:26:48.424372 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-317b3952-1706-4ee9-8f7f-0c5fc6e23f03 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:48.449266 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-317b3952-1706-4ee9-8f7f-0c5fc6e23f03 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:48.467716 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5bee991-601f-4c81-864c-d7caf1b2a1a8 req-ed48e8fb-0b04-4e5c-ab1b-dba594fb77f2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:48.469379 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d5bee991-601f-4c81-864c-d7caf1b2a1a8 req-ed48e8fb-0b04-4e5c-ab1b-dba594fb77f2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 943 time: 0.1534817 Dec 09 21:26:48.502976 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f6a27f73-234e-4720-9954-7eddb61db598 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:48.579898 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-317b3952-1706-4ee9-8f7f-0c5fc6e23f03 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:48.606209 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6a27f73-234e-4720-9954-7eddb61db598 admin admin] Pushing event updated for resources: {'Subnet': ['ID=88904fa3-5b93-4c51-bfd3-07adb53a77ab,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:48.674691 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-317b3952-1706-4ee9-8f7f-0c5fc6e23f03 admin admin] Pushing event updated for resources: {'Port': ['ID=d68b58cd-3f98-4aa6-8259-efea961feb0a,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:48.737152 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d5bee991-601f-4c81-864c-d7caf1b2a1a8 req-037f00a6-e1f0-4674-9c0a-53ac2e834238 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2608442 Dec 09 21:26:48.794880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6a27f73-234e-4720-9954-7eddb61db598 admin admin] Checking segment: {'id': '46e6c67a-dcee-4633-8adc-6de1ea927c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '43277078-8ac8-4619-8b7d-a7366d3b265f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:48.795756 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f6a27f73-234e-4720-9954-7eddb61db598 admin admin] Network hostable DHCP agents. Network: 43277078-8ac8-4619-8b7d-a7366d3b265f, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:26:48.816668 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25df2ee0-f65c-4bd4-8f42-a38a3e0ce6b8 req-2cb33fb1-348a-43f6-9a1e-fe420c9311f1 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:48.832835 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25df2ee0-f65c-4bd4-8f42-a38a3e0ce6b8 req-2cb33fb1-348a-43f6-9a1e-fe420c9311f1 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.2341034 Dec 09 21:26:48.860702 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-317b3952-1706-4ee9-8f7f-0c5fc6e23f03 admin admin] Network e7d3d836-ebe9-4e03-af4b-235dd5e5cbea is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:26:48.863823 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-317b3952-1706-4ee9-8f7f-0c5fc6e23f03 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:48.865674 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f6a27f73-234e-4720-9954-7eddb61db598 admin admin] Network 43277078-8ac8-4619-8b7d-a7366d3b265f is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:26:48.887322 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-f6a27f73-234e-4720-9954-7eddb61db598 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 43277078-8ac8-4619-8b7d-a7366d3b265f) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:48.896331 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22d92faa-fa59-451c-bf70-20240827c5a3 None None] Network 43277078-8ac8-4619-8b7d-a7366d3b265f requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:26:48.933097 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6a27f73-234e-4720-9954-7eddb61db598 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:48.935894 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f6a27f73-234e-4720-9954-7eddb61db598 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:49.009909 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25df2ee0-f65c-4bd4-8f42-a38a3e0ce6b8 req-cdf1ff22-ffdf-44af-9ad8-f0ced3dc9efb tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1752586 Dec 09 21:26:49.018827 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d7d2d0fc-04b2-4663-abef-f796af731260 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:49.066772 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2b8fe2f4-d3d7-4829-a916-c5a149ca42b6 req-a3c31d0c-523a-4fa4-a96a-d88354db10ff tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=a45aee8c-1ead-4182-81dd-72688d980ba4 HTTP/1.1" status: 200 len: 210 time: 0.0514445 Dec 09 21:26:49.099704 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f6a27f73-234e-4720-9954-7eddb61db598 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 858 time: 1.3311911 Dec 09 21:26:49.122189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5fced1b-88e3-40a1-b555-ffe0f834c144 None None] Network 43277078-8ac8-4619-8b7d-a7366d3b265f requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:26:49.157015 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-b0956c22-5285-4c0b-9aa5-be27341799b0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.10 "GET /v2.0/networks?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0570183 Dec 09 21:26:49.218331 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device a2162a7f-55fc-4ed6-a111-15a5b9802370 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:26:49.378225 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port a2162a7f-55fc-4ed6-a111-15a5b9802370, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a2162a7f-55fc-4ed6-a111-15a5b9802370,segment=NetworkSegment(e3c687b5-afac-4ac8-9b38-06599c2a8b7e),segment_id=e3c687b5-afac-4ac8-9b38-06599c2a8b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:49.435781 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-317b3952-1706-4ee9-8f7f-0c5fc6e23f03 admin admin] Router 59853428-6655-4e5e-b7d8-ac85e7e3f2b4 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:26:49.445422 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'a2162a7f-55fc-4ed6-a111-15a5b9802370', 'network_id': '4d446a14-1218-469d-93aa-b4f9babdbb6e', 'port_id': 'a2162a7f-55fc-4ed6-a111-15a5b9802370', 'mac_address': 'fa:16:3e:83:5a:d1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 138, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '75afc53b-d3f3-461c-aba4-c2ce93780246', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:26:49.476302 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-b7504570-d624-422b-a237-b21e6b975725 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:49.486138 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-b7504570-d624-422b-a237-b21e6b975725 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3269069 Dec 09 21:26:49.533674 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-b400fa25-00ac-4822-b19a-45887e4240de tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Request body: {'port': {'device_id': 'a45aee8c-1ead-4182-81dd-72688d980ba4', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '23f7f8a3e7b14635b4f7dfa561684399'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:49.551576 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:49.577018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a2162a7f-55fc-4ed6-a111-15a5b9802370 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:49.618199 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-317b3952-1706-4ee9-8f7f-0c5fc6e23f03 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:26:49.622708 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port a2162a7f-55fc-4ed6-a111-15a5b9802370, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a2162a7f-55fc-4ed6-a111-15a5b9802370,segment=NetworkSegment(e3c687b5-afac-4ac8-9b38-06599c2a8b7e),segment_id=e3c687b5-afac-4ac8-9b38-06599c2a8b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:49.626974 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-317b3952-1706-4ee9-8f7f-0c5fc6e23f03 admin admin] 10.222.0.13 "PUT /v2.0/routers/59853428-6655-4e5e-b7d8-ac85e7e3f2b4/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.2592087 Dec 09 21:26:49.640140 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:49.698408 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c77358e5-f52e-45ef-a6e0-409c694c5f4c req-5517031e-905b-4258-81d3-fdbbe7426a6b tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:49.700171 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c77358e5-f52e-45ef-a6e0-409c694c5f4c req-5517031e-905b-4258-81d3-fdbbe7426a6b tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=dffe3c86-0677-4490-a36a-8bed7d798809 HTTP/1.1" status: 200 len: 946 time: 0.2439892 Dec 09 21:26:49.741738 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-d7d2d0fc-04b2-4663-abef-f796af731260 admin admin] Deleting port 91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:26:49.742148 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d7d2d0fc-04b2-4663-abef-f796af731260 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:49.756677 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=a2162a7f-55fc-4ed6-a111-15a5b9802370,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:49.909015 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c77358e5-f52e-45ef-a6e0-409c694c5f4c req-924e6639-3e52-4a7c-a653-1344f1d19cad tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1953282 Dec 09 21:26:49.977754 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['a2162a7f-55fc-4ed6-a111-15a5b9802370'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:49.993321 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-d7d2d0fc-04b2-4663-abef-f796af731260 admin admin] For port 91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1,segment=NetworkSegment(ad3b787d-bad8-49ed-bf29-13e361e4a583),segment_id=ad3b787d-bad8-49ed-bf29-13e361e4a583)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:49.993908 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d7d2d0fc-04b2-4663-abef-f796af731260 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:50.024003 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-b400fa25-00ac-4822-b19a-45887e4240de tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Made reservation on behalf of 23f7f8a3e7b14635b4f7dfa561684399 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:50.025139 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-d7d2d0fc-04b2-4663-abef-f796af731260 admin admin] Calling delete_port for 91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:26:50.033628 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-b400fa25-00ac-4822-b19a-45887e4240de tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:50.047055 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7e38e03d-c1aa-4113-b1bd-d91131f610c5 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:26:50.203027 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 7e38e03d-c1aa-4113-b1bd-d91131f610c5 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:50.203638 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:50.316880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-995c3482-d482-4635-8912-87eb3c5d4ed2 req-f183089a-a7d6-4e12-ad6e-92e201f31741 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:50.329063 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-995c3482-d482-4635-8912-87eb3c5d4ed2 req-f183089a-a7d6-4e12-ad6e-92e201f31741 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 944 time: 0.2671463 Dec 09 21:26:50.359422 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:50.379315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-f4cba2a5-afb3-41a4-91fe-a5648abbf50f tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:50.387866 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-f4cba2a5-afb3-41a4-91fe-a5648abbf50f tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] 10.222.0.13 "GET /v2.0/networks?id=43277078-8ac8-4619-8b7d-a7366d3b265f HTTP/1.1" status: 200 len: 821 time: 0.4349492 Dec 09 21:26:50.391158 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d7d2d0fc-04b2-4663-abef-f796af731260 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:50.391357 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 7e38e03d-c1aa-4113-b1bd-d91131f610c5, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7e38e03d-c1aa-4113-b1bd-d91131f610c5,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:50.401277 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:50.415798 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-1f9a1894-aa7c-44b2-a1d7-77d4f13cdb59 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] 10.222.0.13 "GET /v2.0/quotas/f8b3b783f4c54a789e9012e49667eaa1 HTTP/1.1" status: 200 len: 375 time: 0.0267446 Dec 09 21:26:50.453036 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7d2d0fc-04b2-4663-abef-f796af731260 admin admin] Pushing event deleted for resources: {'Port': ['ID=91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:50.484195 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=7e38e03d-c1aa-4113-b1bd-d91131f610c5,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:50.498157 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] Sync routers for ids ['59853428-6655-4e5e-b7d8-ac85e7e3f2b4'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:26:50.508047 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-0bd87d28-7072-48b3-b9b6-22cd4b9b9025 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=f8b3b783f4c54a789e9012e49667eaa1&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0911348 Dec 09 21:26:50.520182 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] Routers {'59853428-6655-4e5e-b7d8-ac85e7e3f2b4'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:26:50.538251 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:26:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['59853428-6655-4e5e-b7d8-ac85e7e3f2b4'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:50.540093 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-995c3482-d482-4635-8912-87eb3c5d4ed2 req-79dfb9b5-6021-4f23-96f4-8b2f8f9004ce tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2094834 Dec 09 21:26:50.772268 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] Set router 59853428-6655-4e5e-b7d8-ac85e7e3f2b4 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:26:50.802431 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d7d2d0fc-04b2-4663-abef-f796af731260 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:51.041392 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3588c8df-db16-4b1a-bedd-9801c37cd570 req-7cf72c79-053a-4aa9-a3b4-a55ca5e740f0 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-SecurityGroupsTestJSON-securitygroup-380500455&fields=id&tenant_id=5635fb0018b24f538b250cdac6dca9d9 HTTP/1.1" status: 200 len: 267 time: 0.1080284 Dec 09 21:26:51.097747 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-b400fa25-00ac-4822-b19a-45887e4240de tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Allocated IP 192.168.233.123 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/c3c31744-0580-4d09-863d-697769f7c0ee) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:26:51.102766 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '59853428-6655-4e5e-b7d8-ac85e7e3f2b4', 'name': 'tempest-ServerRescueTestJSON-1978792040-router', 'tenant_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44'}], 'enable_snat': True}, 'gw_port_id': '7e38e03d-c1aa-4113-b1bd-d91131f610c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:26:39Z', 'updated_at': '2021-12-09T21:26:48Z', 'revision_number': 4, 'project_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'gw_port': {'id': '7e38e03d-c1aa-4113-b1bd-d91131f610c5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:e8:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '59853428-6655-4e5e-b7d8-ac85e7e3f2b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1046, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:26:40Z', 'updated_at': '2021-12-09T21:26:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'd68b58cd-3f98-4aa6-8259-efea961feb0a', 'name': '', 'network_id': 'e7d3d836-ebe9-4e03-af4b-235dd5e5cbea', 'tenant_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'mac_address': 'fa:16:3e:0c:20:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '59853428-6655-4e5e-b7d8-ac85e7e3f2b4', 'device_owner': 'network:router_interface', 'standard_attr_id': 1054, 'fixed_ips': [{'subnet_id': 'a84d1123-6651-4f35-9cba-4f9c8f45aab6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:26:46Z', 'updated_at': '2021-12-09T21:26:48Z', 'revision_number': 2, 'project_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'subnets': [{'id': 'a84d1123-6651-4f35-9cba-4f9c8f45aab6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:51.136858 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] Checking router: 59853428-6655-4e5e-b7d8-ac85e7e3f2b4 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:26:51.137267 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] Updating router 59853428-6655-4e5e-b7d8-ac85e7e3f2b4 port d68b58cd-3f98-4aa6-8259-efea961feb0a binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:26:51.152212 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3588c8df-db16-4b1a-bedd-9801c37cd570 req-d5bcdd2b-fa0b-43f2-a0fb-10f8af94e1f1 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:51.153776 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3588c8df-db16-4b1a-bedd-9801c37cd570 req-d5bcdd2b-fa0b-43f2-a0fb-10f8af94e1f1 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=dffe3c86-0677-4490-a36a-8bed7d798809 HTTP/1.1" status: 200 len: 946 time: 0.1029644 Dec 09 21:26:51.159161 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device a2162a7f-55fc-4ed6-a111-15a5b9802370 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:26:51.162471 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-3ad49bff-2a05-47f1-b59a-c22fea4aa2d1 service neutron] 10.222.0.13 "GET /v2.0/networks/43277078-8ac8-4619-8b7d-a7366d3b265f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6517344 Dec 09 21:26:51.168424 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d7d2d0fc-04b2-4663-abef-f796af731260 admin admin] Router 290dc430-7830-4b38-89f7-0330682d7558 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:26:51.175251 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-3588c8df-db16-4b1a-bedd-9801c37cd570 req-baba6277-52eb-4ed7-896a-8d43b11da91e tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Request body: {'port': {'security_groups': ['18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9', 'd0cefb8e-5181-40ca-9bcf-8d762cff4764']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:51.194517 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:51.279706 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port a2162a7f-55fc-4ed6-a111-15a5b9802370 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:26:51.284332 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port a2162a7f-55fc-4ed6-a111-15a5b9802370 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:51.285356 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:51.329120 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d7d2d0fc-04b2-4663-abef-f796af731260 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:26:51.338386 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d7d2d0fc-04b2-4663-abef-f796af731260 admin admin] 10.222.0.13 "PUT /v2.0/routers/290dc430-7830-4b38-89f7-0330682d7558/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.9497647 Dec 09 21:26:51.344321 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39888) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:51.346001 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b932feeb-8801-4ea6-ba3d-573002650f37 None None] Sync routers for ids ['290dc430-7830-4b38-89f7-0330682d7558'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:26:51.369753 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b932feeb-8801-4ea6-ba3d-573002650f37 None None] Routers {'290dc430-7830-4b38-89f7-0330682d7558'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:26:51.370648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b932feeb-8801-4ea6-ba3d-573002650f37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:26:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['290dc430-7830-4b38-89f7-0330682d7558'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:51.496803 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:51.541455 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ddc913c-e029-4012-8ec2-23d705ad3b6c admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:51.558500 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-b400fa25-00ac-4822-b19a-45887e4240de tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:51.568057 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f3361776-fc91-4b92-9d13-73ed7e781a51', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a2162a7f-55fc-4ed6-a111-15a5b9802370'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:51.570136 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:51.573782 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-00a790a7-1842-4665-a2a7-3750534c80b4" -d '{"events": [{"server_uuid": "f3361776-fc91-4b92-9d13-73ed7e781a51", "name": "network-vif-plugged", "status": "completed", "tag": "a2162a7f-55fc-4ed6-a111-15a5b9802370"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:51.581521 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:51.611392 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3588c8df-db16-4b1a-bedd-9801c37cd570 req-baba6277-52eb-4ed7-896a-8d43b11da91e tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:51.618035 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-b400fa25-00ac-4822-b19a-45887e4240de tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:51.627240 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port a2162a7f-55fc-4ed6-a111-15a5b9802370, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a2162a7f-55fc-4ed6-a111-15a5b9802370,segment=NetworkSegment(e3c687b5-afac-4ac8-9b38-06599c2a8b7e),segment_id=e3c687b5-afac-4ac8-9b38-06599c2a8b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:51.630134 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7430342-cf8d-4aab-9751-482b844f7cbd None None] Pushing event updated for resources: {'Port': ['ID=d68b58cd-3f98-4aa6-8259-efea961feb0a,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:51.643571 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['fd466da6-f506-43e6-9800-156622bd2781'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:51.645876 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7430342-cf8d-4aab-9751-482b844f7cbd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:51.646454 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7430342-cf8d-4aab-9751-482b844f7cbd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:51.646973 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7430342-cf8d-4aab-9751-482b844f7cbd None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:51.647513 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7430342-cf8d-4aab-9751-482b844f7cbd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:51.648032 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7430342-cf8d-4aab-9751-482b844f7cbd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:51.648553 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7430342-cf8d-4aab-9751-482b844f7cbd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:51.649036 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7430342-cf8d-4aab-9751-482b844f7cbd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:51.649539 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7430342-cf8d-4aab-9751-482b844f7cbd None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:51.650044 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7430342-cf8d-4aab-9751-482b844f7cbd None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:51.650578 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7430342-cf8d-4aab-9751-482b844f7cbd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:51.651066 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7430342-cf8d-4aab-9751-482b844f7cbd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:51.651591 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7430342-cf8d-4aab-9751-482b844f7cbd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:51.652074 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7430342-cf8d-4aab-9751-482b844f7cbd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:26:51.708289 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['18bda486-9d6d-41a3-a260-dd244a3838b3', '2958b0be-15e5-48e2-b87a-6ffefd9a7859', '1ad36983-4549-4a03-a826-a31a08b98c98', '07457883-17db-4553-8f10-716e04bc16b1'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:51.757585 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-b400fa25-00ac-4822-b19a-45887e4240de tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:26:51.766496 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ddc913c-e029-4012-8ec2-23d705ad3b6c admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:51.775402 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-176add6d-437e-4e32-acb3-51c56560afaf service neutron] 10.222.0.13 "GET /v2.0/networks/43277078-8ac8-4619-8b7d-a7366d3b265f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6119902 Dec 09 21:26:51.785096 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] Attempting to bind port d68b58cd-3f98-4aa6-8259-efea961feb0a on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:26:51.785489 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] Attempting to bind port d68b58cd-3f98-4aa6-8259-efea961feb0a by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '6bb6d7a7-737b-46b2-b463-0bc25081f6ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'e7d3d836-ebe9-4e03-af4b-235dd5e5cbea'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:26:51.786632 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] Attempting to bind port d68b58cd-3f98-4aa6-8259-efea961feb0a on network e7d3d836-ebe9-4e03-af4b-235dd5e5cbea {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:51.802964 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 26, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:26:51.803353 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] Checking segment: {'id': '6bb6d7a7-737b-46b2-b463-0bc25081f6ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'e7d3d836-ebe9-4e03-af4b-235dd5e5cbea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:51.803790 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:51.804277 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] Bound using segment: {'id': '6bb6d7a7-737b-46b2-b463-0bc25081f6ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'e7d3d836-ebe9-4e03-af4b-235dd5e5cbea'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:26:51.804664 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] Bound port: d68b58cd-3f98-4aa6-8259-efea961feb0a, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6bb6d7a7-737b-46b2-b463-0bc25081f6ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'e7d3d836-ebe9-4e03-af4b-235dd5e5cbea'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:26:51.805046 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:51.815204 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-b400fa25-00ac-4822-b19a-45887e4240de tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:51.835180 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-b400fa25-00ac-4822-b19a-45887e4240de tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:26:51.841558 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b400fa25-00ac-4822-b19a-45887e4240de tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Pushing event updated for resources: {'Port': ['ID=c3c31744-0580-4d09-863d-697769f7c0ee,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:51.870376 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:51.953175 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1ddc913c-e029-4012-8ec2-23d705ad3b6c admin admin] Deleting port 0c193336-bbb6-4822-b85a-c96594bf8ca5 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:26:51.953647 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ddc913c-e029-4012-8ec2-23d705ad3b6c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:52.029522 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] For port d68b58cd-3f98-4aa6-8259-efea961feb0a, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:26:52.039244 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] For port d68b58cd-3f98-4aa6-8259-efea961feb0a, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d68b58cd-3f98-4aa6-8259-efea961feb0a,segment=NetworkSegment(6bb6d7a7-737b-46b2-b463-0bc25081f6ef),segment_id=6bb6d7a7-737b-46b2-b463-0bc25081f6ef)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:26:52.049972 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:52.065699 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=a2162a7f-55fc-4ed6-a111-15a5b9802370,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:52.095295 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7e38e03d-c1aa-4113-b1bd-d91131f610c5 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:26:52.162953 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] Routers {'59853428-6655-4e5e-b7d8-ac85e7e3f2b4'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:26:52.163637 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:26:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['59853428-6655-4e5e-b7d8-ac85e7e3f2b4'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:52.167739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-1ddc913c-e029-4012-8ec2-23d705ad3b6c admin admin] For port 0c193336-bbb6-4822-b85a-c96594bf8ca5, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=0c193336-bbb6-4822-b85a-c96594bf8ca5,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:52.168238 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-b400fa25-00ac-4822-b19a-45887e4240de tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:52.169159 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-b400fa25-00ac-4822-b19a-45887e4240de tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:52.176658 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ddc913c-e029-4012-8ec2-23d705ad3b6c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:52.209247 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-b400fa25-00ac-4822-b19a-45887e4240de tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.6826439 Dec 09 21:26:52.232069 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-16f2fd2b-02b8-47f9-a518-dd5f35bf7ed4 service neutron] Request body: {'port': {'device_id': 'a45aee8c-1ead-4182-81dd-72688d980ba4', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:52.247532 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1ddc913c-e029-4012-8ec2-23d705ad3b6c admin admin] Calling delete_port for 0c193336-bbb6-4822-b85a-c96594bf8ca5 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:26:52.396211 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] Set router 59853428-6655-4e5e-b7d8-ac85e7e3f2b4 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:26:52.399970 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-b932feeb-8801-4ea6-ba3d-573002650f37 None None] Set router 290dc430-7830-4b38-89f7-0330682d7558 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:26:52.489833 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-16f2fd2b-02b8-47f9-a518-dd5f35bf7ed4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:52.604698 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7430342-cf8d-4aab-9751-482b844f7cbd None None] Pushing event updated for resources: {'Port': ['ID=d68b58cd-3f98-4aa6-8259-efea961feb0a,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:52.658837 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ddc913c-e029-4012-8ec2-23d705ad3b6c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:52.692468 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-3588c8df-db16-4b1a-bedd-9801c37cd570 req-baba6277-52eb-4ed7-896a-8d43b11da91e tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] For port b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e,segment=NetworkSegment(c472f4a8-1a94-4bb1-8978-a56e5ee37bb8),segment_id=c472f4a8-1a94-4bb1-8978-a56e5ee37bb8)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:52.716964 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f427bd25-6f2d-4fb0-9047-10ece023779b None None] Provisioning complete for port c3c31744-0580-4d09-863d-697769f7c0ee triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:52.717669 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f427bd25-6f2d-4fb0-9047-10ece023779b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:52.721906 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ddc913c-e029-4012-8ec2-23d705ad3b6c admin admin] Pushing event deleted for resources: {'Port': ['ID=0c193336-bbb6-4822-b85a-c96594bf8ca5,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:52.731963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 7e38e03d-c1aa-4113-b1bd-d91131f610c5 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:52.732343 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:52.805719 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '59853428-6655-4e5e-b7d8-ac85e7e3f2b4', 'name': 'tempest-ServerRescueTestJSON-1978792040-router', 'tenant_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44'}], 'enable_snat': True}, 'gw_port_id': '7e38e03d-c1aa-4113-b1bd-d91131f610c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:26:39Z', 'updated_at': '2021-12-09T21:26:48Z', 'revision_number': 4, 'project_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'gw_port': {'id': '7e38e03d-c1aa-4113-b1bd-d91131f610c5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:e8:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '59853428-6655-4e5e-b7d8-ac85e7e3f2b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1046, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:26:40Z', 'updated_at': '2021-12-09T21:26:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'd68b58cd-3f98-4aa6-8259-efea961feb0a', 'name': '', 'network_id': 'e7d3d836-ebe9-4e03-af4b-235dd5e5cbea', 'tenant_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'mac_address': 'fa:16:3e:0c:20:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '59853428-6655-4e5e-b7d8-ac85e7e3f2b4', 'device_owner': 'network:router_interface', 'standard_attr_id': 1054, 'fixed_ips': [{'subnet_id': 'a84d1123-6651-4f35-9cba-4f9c8f45aab6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:26:46Z', 'updated_at': '2021-12-09T21:26:52Z', 'revision_number': 4, 'project_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'subnets': [{'id': 'a84d1123-6651-4f35-9cba-4f9c8f45aab6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:52.857997 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ddc913c-e029-4012-8ec2-23d705ad3b6c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:52.877448 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2bee9f4b-f2eb-416a-8f47-06dd6c078dd7 None None] The sync data for ids ['59853428-6655-4e5e-b7d8-ac85e7e3f2b4'] in n-d-713301-27 is: [{'id': '59853428-6655-4e5e-b7d8-ac85e7e3f2b4', 'name': 'tempest-ServerRescueTestJSON-1978792040-router', 'tenant_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44'}], 'enable_snat': True}, 'gw_port_id': '7e38e03d-c1aa-4113-b1bd-d91131f610c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:26:39Z', 'updated_at': '2021-12-09T21:26:48Z', 'revision_number': 4, 'project_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'gw_port': {'id': '7e38e03d-c1aa-4113-b1bd-d91131f610c5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:e8:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '59853428-6655-4e5e-b7d8-ac85e7e3f2b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1046, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:26:40Z', 'updated_at': '2021-12-09T21:26:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'd68b58cd-3f98-4aa6-8259-efea961feb0a', 'name': '', 'network_id': 'e7d3d836-ebe9-4e03-af4b-235dd5e5cbea', 'tenant_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'mac_address': 'fa:16:3e:0c:20:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '59853428-6655-4e5e-b7d8-ac85e7e3f2b4', 'device_owner': 'network:router_interface', 'standard_attr_id': 1054, 'fixed_ips': [{'subnet_id': 'a84d1123-6651-4f35-9cba-4f9c8f45aab6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:26:46Z', 'updated_at': '2021-12-09T21:26:52Z', 'revision_number': 4, 'project_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'subnets': [{'id': 'a84d1123-6651-4f35-9cba-4f9c8f45aab6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:26:52.902126 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3588c8df-db16-4b1a-bedd-9801c37cd570 req-baba6277-52eb-4ed7-896a-8d43b11da91e tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:53.038749 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3588c8df-db16-4b1a-bedd-9801c37cd570 req-baba6277-52eb-4ed7-896a-8d43b11da91e tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:53.042294 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ddc913c-e029-4012-8ec2-23d705ad3b6c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:53.046311 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ddc913c-e029-4012-8ec2-23d705ad3b6c admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:53.050426 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-63ffdba6-a023-4336-ac8b-a3c806aae13a tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:53.061138 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-63ffdba6-a023-4336-ac8b-a3c806aae13a tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/networks?id=e7d3d836-ebe9-4e03-af4b-235dd5e5cbea HTTP/1.1" status: 200 len: 811 time: 0.6525524 Dec 09 21:26:53.103895 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-94724127-fe68-4364-82b5-f522185c25a0 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/quotas/9ca15fab17f34cc58f1ad1fcedc1bf31 HTTP/1.1" status: 200 len: 375 time: 0.0414052 Dec 09 21:26:53.151355 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3588c8df-db16-4b1a-bedd-9801c37cd570 req-baba6277-52eb-4ed7-896a-8d43b11da91e tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:53.152044 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3588c8df-db16-4b1a-bedd-9801c37cd570 req-baba6277-52eb-4ed7-896a-8d43b11da91e tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:53.153686 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3588c8df-db16-4b1a-bedd-9801c37cd570 req-baba6277-52eb-4ed7-896a-8d43b11da91e tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "PUT /v2.0/ports/b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e HTTP/1.1" status: 200 len: 982 time: 1.9826567 Dec 09 21:26:53.155209 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f427bd25-6f2d-4fb0-9047-10ece023779b None None] Port c3c31744-0580-4d09-863d-697769f7c0ee cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:26:53.168930 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ddc913c-e029-4012-8ec2-23d705ad3b6c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:53.173201 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dffe3c86-0677-4490-a36a-8bed7d798809', 'tag': 'b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:53.175682 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1ddc913c-e029-4012-8ec2-23d705ad3b6c admin admin] Fanout notify agent at l3_agent the message router_deleted on router 290dc430-7830-4b38-89f7-0330682d7558 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:26:53.194201 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ac42d565-0f3b-4283-a96e-b5feaeeb6aa1" -d '{"events": [{"name": "network-changed", "server_uuid": "dffe3c86-0677-4490-a36a-8bed7d798809", "tag": "b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:53.201963 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ddc913c-e029-4012-8ec2-23d705ad3b6c admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:53.201963 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1ddc913c-e029-4012-8ec2-23d705ad3b6c admin admin] 10.222.0.13 "DELETE /v2.0/routers/290dc430-7830-4b38-89f7-0330682d7558 HTTP/1.1" status: 204 len: 168 time: 1.8524404 Dec 09 21:26:53.203869 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39920) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:53.282972 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baba6277-52eb-4ed7-896a-8d43b11da91e tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event updated for resources: {'Port': ['ID=b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e,revision_number=6']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:53.332060 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-a1d14fce-9225-4f6e-8bd6-10b23daa2a62 admin admin] Deleting subnet 65af9a54-bf8f-4f71-97a2-68f4a31a18ad {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:26:53.339216 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a1d14fce-9225-4f6e-8bd6-10b23daa2a62 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:53.388955 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-1261ad62-27bc-4cf4-8c9c-9c96f6400b63 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=9ca15fab17f34cc58f1ad1fcedc1bf31&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2727675 Dec 09 21:26:53.389359 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:53.513235 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a1d14fce-9225-4f6e-8bd6-10b23daa2a62 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:53.681693 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a1d14fce-9225-4f6e-8bd6-10b23daa2a62 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:53.695824 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b37d97dd-2d62-4339-b9f0-d56b442bd096 req-d6ae1e72-ddc8-42ed-bdcb-27a0c9a641bc tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:53.697393 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b37d97dd-2d62-4339-b9f0-d56b442bd096 req-d6ae1e72-ddc8-42ed-bdcb-27a0c9a641bc tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.3594759 Dec 09 21:26:53.755036 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a1d14fce-9225-4f6e-8bd6-10b23daa2a62 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:53.776264 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a1d14fce-9225-4f6e-8bd6-10b23daa2a62 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:53.785303 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a1d14fce-9225-4f6e-8bd6-10b23daa2a62 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/65af9a54-bf8f-4f71-97a2-68f4a31a18ad HTTP/1.1" status: 204 len: 168 time: 0.5800943 Dec 09 21:26:53.805948 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39926) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:53.810888 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1d14fce-9225-4f6e-8bd6-10b23daa2a62 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=65af9a54-bf8f-4f71-97a2-68f4a31a18ad,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:53.843105 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a14a6592-4365-4bcd-aac2-d719756fc4d4 None None] Network 5b690ccc-3b51-4e15-887f-038429ce13f5 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:26:53.936108 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b932feeb-8801-4ea6-ba3d-573002650f37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '290dc430-7830-4b38-89f7-0330682d7558', 'name': 'tempest-ServersTestMultiNic-285103454-router', 'tenant_id': '73812a0c336d4768b029fd6459a1ae9e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.220'}], 'enable_snat': True}, 'gw_port_id': '0c193336-bbb6-4822-b85a-c96594bf8ca5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:56Z', 'updated_at': '2021-12-09T21:26:50Z', 'revision_number': 5, 'project_id': '73812a0c336d4768b029fd6459a1ae9e', 'gw_port': {'id': '0c193336-bbb6-4822-b85a-c96594bf8ca5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:b1:81:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '290dc430-7830-4b38-89f7-0330682d7558', 'device_owner': 'network:router_gateway', 'standard_attr_id': 869, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:57Z', 'updated_at': '2021-12-09T21:25:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:53.948117 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-93f709af-dcc7-41b6-afde-d54cb199e7e8 service neutron] 10.222.0.13 "GET /v2.0/networks/e7d3d836-ebe9-4e03-af4b-235dd5e5cbea?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5694525 Dec 09 21:26:54.027260 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b932feeb-8801-4ea6-ba3d-573002650f37 None None] Checking router: 290dc430-7830-4b38-89f7-0330682d7558 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:26:54.163255 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b932feeb-8801-4ea6-ba3d-573002650f37 None None] Routers set() bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:26:54.163845 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b932feeb-8801-4ea6-ba3d-573002650f37 None None] Router IDs set() for agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Dec 09 21:26:54.166107 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_agentschedulers_db [None req-b932feeb-8801-4ea6-ba3d-573002650f37 None None] Agent requested router IDs not scheduled to it. Scheduled: []. Unscheduled: {'290dc430-7830-4b38-89f7-0330682d7558'}. Agent: Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:26:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent'). {{(pid=103439) list_active_sync_routers_on_active_l3_agent /opt/stack/neutron/neutron/db/l3_agentschedulers_db.py:353}} Dec 09 21:26:54.166717 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b932feeb-8801-4ea6-ba3d-573002650f37 None None] The sync data for ids ['290dc430-7830-4b38-89f7-0330682d7558'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:26:54.193749 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d68b58cd-3f98-4aa6-8259-efea961feb0a up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:26:54.237153 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-1d1f9af8-5618-47c0-81bd-3efd8c7c5c56 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:54.249897 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-1d1f9af8-5618-47c0-81bd-3efd8c7c5c56 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] 10.222.0.10 "GET /v2.0/networks?id=43277078-8ac8-4619-8b7d-a7366d3b265f HTTP/1.1" status: 200 len: 821 time: 0.2915292 Dec 09 21:26:54.262267 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9fb958a6-c674-4af3-869c-4a022a5f236f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:54.268531 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-8c364aeb-86e4-4ddd-8230-7c978702f986 service neutron] 10.222.0.13 "GET /v2.0/networks/e7d3d836-ebe9-4e03-af4b-235dd5e5cbea?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3189206 Dec 09 21:26:54.282461 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-16f2fd2b-02b8-47f9-a518-dd5f35bf7ed4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c3c31744-0580-4d09-863d-697769f7c0ee {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:54.298435 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b37d97dd-2d62-4339-b9f0-d56b442bd096 req-51e694f4-89cf-41ce-a848-05ead90a3e71 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5852163 Dec 09 21:26:54.301773 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-16f2fd2b-02b8-47f9-a518-dd5f35bf7ed4 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:54.313807 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-d04180c2-b150-483e-9865-259d793f1ab4 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Request body: {'port': {'device_id': 'b47d322e-d75b-4899-be48-dd276a4cdf7e', 'network_id': '43277078-8ac8-4619-8b7d-a7366d3b265f', 'admin_state_up': True, 'tenant_id': 'f8b3b783f4c54a789e9012e49667eaa1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:54.377628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-16f2fd2b-02b8-47f9-a518-dd5f35bf7ed4 service neutron] Transition to ACTIVE for port object c3c31744-0580-4d09-863d-697769f7c0ee will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:26:54.384085 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-497c781c-69fe-4037-9d0a-2831d265d783 None None] DHCP port deletion for 5b690ccc-3b51-4e15-887f-038429ce13f5 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:26:54.401173 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-16f2fd2b-02b8-47f9-a518-dd5f35bf7ed4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:54.414175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-9fb958a6-c674-4af3-869c-4a022a5f236f admin admin] Deleting port 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:26:54.415015 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9fb958a6-c674-4af3-869c-4a022a5f236f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:54.524026 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-9fb958a6-c674-4af3-869c-4a022a5f236f admin admin] For port 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9db6e7df-0c6c-4376-ab3e-76509fe7fcd0,segment=NetworkSegment(ad3b787d-bad8-49ed-bf29-13e361e4a583),segment_id=ad3b787d-bad8-49ed-bf29-13e361e4a583)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:54.524503 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9fb958a6-c674-4af3-869c-4a022a5f236f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:54.542763 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-9fb958a6-c674-4af3-869c-4a022a5f236f admin admin] Calling delete_port for 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:26:54.550140 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port d68b58cd-3f98-4aa6-8259-efea961feb0a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:54.550516 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:54.689620 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-d04180c2-b150-483e-9865-259d793f1ab4 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Made reservation on behalf of f8b3b783f4c54a789e9012e49667eaa1 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:54.695508 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-d04180c2-b150-483e-9865-259d793f1ab4 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:54.717946 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-497c781c-69fe-4037-9d0a-2831d265d783 None None] Deleting port 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:26:54.718332 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-497c781c-69fe-4037-9d0a-2831d265d783 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:54.867182 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16f2fd2b-02b8-47f9-a518-dd5f35bf7ed4 service neutron] Pushing event updated for resources: {'Port': ['ID=c3c31744-0580-4d09-863d-697769f7c0ee,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:54.886979 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9fb958a6-c674-4af3-869c-4a022a5f236f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:54.982405 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:55.028858 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9fb958a6-c674-4af3-869c-4a022a5f236f admin admin] No DVR routers for this DVR port 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:26:55.031589 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fb958a6-c674-4af3-869c-4a022a5f236f admin admin] Pushing event deleted for resources: {'Port': ['ID=9db6e7df-0c6c-4376-ab3e-76509fe7fcd0,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:55.080509 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-d04180c2-b150-483e-9865-259d793f1ab4 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Allocated IP 172.20.0.9 (43277078-8ac8-4619-8b7d-a7366d3b265f/88904fa3-5b93-4c51-bfd3-07adb53a77ab/0cb48dd1-cbdb-43d4-9909-33474781399b) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:26:55.160874 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-497c781c-69fe-4037-9d0a-2831d265d783 None None] For port 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0, host n-d-713301-27, got binding levels [] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:55.161310 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-497c781c-69fe-4037-9d0a-2831d265d783 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:55.200627 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port d68b58cd-3f98-4aa6-8259-efea961feb0a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d68b58cd-3f98-4aa6-8259-efea961feb0a,segment=NetworkSegment(6bb6d7a7-737b-46b2-b463-0bc25081f6ef),segment_id=6bb6d7a7-737b-46b2-b463-0bc25081f6ef)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:55.204788 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-497c781c-69fe-4037-9d0a-2831d265d783 None None] Calling delete_port for 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:26:55.222594 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.ipam_backend_mixin [None req-497c781c-69fe-4037-9d0a-2831d265d783 None None] Port 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0 was not found and therefore no delete operation was performed {{(pid=103439) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 09 21:26:55.234347 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:55.321625 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-497c781c-69fe-4037-9d0a-2831d265d783 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:55.453097 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-497c781c-69fe-4037-9d0a-2831d265d783 None None] No DVR routers for this DVR port 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:26:55.461448 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9fb958a6-c674-4af3-869c-4a022a5f236f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:55.469656 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=d68b58cd-3f98-4aa6-8259-efea961feb0a,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:55.516720 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-d04180c2-b150-483e-9865-259d793f1ab4 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:55.543281 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-497c781c-69fe-4037-9d0a-2831d265d783 None None] Pushing event deleted for resources: {'Port': ['ID=9db6e7df-0c6c-4376-ab3e-76509fe7fcd0,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:55.593272 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-d04180c2-b150-483e-9865-259d793f1ab4 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:55.635327 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-d04180c2-b150-483e-9865-259d793f1ab4 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Network 43277078-8ac8-4619-8b7d-a7366d3b265f is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:26:55.638635 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-d04180c2-b150-483e-9865-259d793f1ab4 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:26:55.641144 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-d04180c2-b150-483e-9865-259d793f1ab4 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:26:55.696282 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d04180c2-b150-483e-9865-259d793f1ab4 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Pushing event updated for resources: {'Port': ['ID=0cb48dd1-cbdb-43d4-9909-33474781399b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:55.723565 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-d04180c2-b150-483e-9865-259d793f1ab4 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:55.724295 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-d04180c2-b150-483e-9865-259d793f1ab4 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:55.746105 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-d04180c2-b150-483e-9865-259d793f1ab4 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.4576993 Dec 09 21:26:55.760872 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-f2fd0776-0e80-4197-aa3f-b32e71e60a82 service neutron] Request body: {'port': {'device_id': 'b47d322e-d75b-4899-be48-dd276a4cdf7e', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:55.848678 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-f2fd0776-0e80-4197-aa3f-b32e71e60a82 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:55.859494 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3852b45a-c060-4319-bb83-1a376b2c72f9 req-d10e0986-b1af-4e8a-a3a6-976b04455649 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:55.867282 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3852b45a-c060-4319-bb83-1a376b2c72f9 req-d10e0986-b1af-4e8a-a3a6-976b04455649 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=a45aee8c-1ead-4182-81dd-72688d980ba4 HTTP/1.1" status: 200 len: 948 time: 1.0011098 Dec 09 21:26:55.880836 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-9fb958a6-c674-4af3-869c-4a022a5f236f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5b690ccc-3b51-4e15-887f-038429ce13f5']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:55.942196 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd1f5eaf-b501-4828-a0e5-1853af108498 req-8e5db3b1-942c-4c96-9952-4c39cea58f16 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:55.952417 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd1f5eaf-b501-4828-a0e5-1853af108498 req-8e5db3b1-942c-4c96-9952-4c39cea58f16 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 1.0885117 Dec 09 21:26:55.960191 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d68b58cd-3f98-4aa6-8259-efea961feb0a up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:26:55.971624 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3852b45a-c060-4319-bb83-1a376b2c72f9 req-7dcac279-ab4d-42bb-add6-84508f3d6b4a tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1025753 Dec 09 21:26:55.976393 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-9fb958a6-c674-4af3-869c-4a022a5f236f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ad3b787d-bad8-49ed-bf29-13e361e4a583') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:55.983188 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-9fb958a6-c674-4af3-869c-4a022a5f236f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ad3b787d-bad8-49ed-bf29-13e361e4a583') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:26:56.050765 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c83cb7ca-5227-45b4-a83b-433efafaa735 x-openstack-request-id: req-c83cb7ca-5227-45b4-a83b-433efafaa735 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:56.051305 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f3361776-fc91-4b92-9d13-73ed7e781a51", "name": "network-vif-plugged", "status": "completed", "tag": "a2162a7f-55fc-4ed6-a111-15a5b9802370", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:56.051305 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c83cb7ca-5227-45b4-a83b-433efafaa735 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:56.051721 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f3361776-fc91-4b92-9d13-73ed7e781a51', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a2162a7f-55fc-4ed6-a111-15a5b9802370', 'code': 200} Dec 09 21:26:56.060721 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port d68b58cd-3f98-4aa6-8259-efea961feb0a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:26:56.061135 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:56.082235 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9fb958a6-c674-4af3-869c-4a022a5f236f admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:56.111735 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9fb958a6-c674-4af3-869c-4a022a5f236f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:56.132948 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9fb958a6-c674-4af3-869c-4a022a5f236f admin admin] Releasing vlan 100 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:26:56.133370 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9fb958a6-c674-4af3-869c-4a022a5f236f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:56.146375 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd1f5eaf-b501-4828-a0e5-1853af108498 req-30bd6bb4-7016-4526-b16d-ef85ea2040af tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1926529 Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:26:56.152005 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:26:56.223918 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-16f2fd2b-02b8-47f9-a518-dd5f35bf7ed4 service neutron] Attempting to bind port c3c31744-0580-4d09-863d-697769f7c0ee on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:26:56.224257 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-16f2fd2b-02b8-47f9-a518-dd5f35bf7ed4 service neutron] Attempting to bind port c3c31744-0580-4d09-863d-697769f7c0ee by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:26:56.224588 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-16f2fd2b-02b8-47f9-a518-dd5f35bf7ed4 service neutron] Attempting to bind port c3c31744-0580-4d09-863d-697769f7c0ee on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:56.316551 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0c193336-bbb6-4822-b85a-c96594bf8ca5 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:26:56.323879 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-16f2fd2b-02b8-47f9-a518-dd5f35bf7ed4 service neutron] Port c3c31744-0580-4d09-863d-697769f7c0ee on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:26:56.324264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-16f2fd2b-02b8-47f9-a518-dd5f35bf7ed4 service neutron] Attempting to bind port c3c31744-0580-4d09-863d-697769f7c0ee on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:56.358822 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 0c193336-bbb6-4822-b85a-c96594bf8ca5 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:26:56.359651 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0c193336-bbb6-4822-b85a-c96594bf8ca5 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:26:56.360338 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:26:56.377526 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-f2fd0776-0e80-4197-aa3f-b32e71e60a82 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0cb48dd1-cbdb-43d4-9909-33474781399b {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:26:56.392786 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:26:56.393137 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 91dfc0bf-a7f5-42af-a3c9-ea20ca6ffba1 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:26:56.393608 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:26:56.398825 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-f2fd0776-0e80-4197-aa3f-b32e71e60a82 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:56.419254 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:26:56.419659 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9db6e7df-0c6c-4376-ab3e-76509fe7fcd0 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:26:56.432099 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-f2fd0776-0e80-4197-aa3f-b32e71e60a82 service neutron] Transition to ACTIVE for port object 0cb48dd1-cbdb-43d4-9909-33474781399b will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:26:56.435278 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-16f2fd2b-02b8-47f9-a518-dd5f35bf7ed4 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 26, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:26:56.436004 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-16f2fd2b-02b8-47f9-a518-dd5f35bf7ed4 service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:56.436804 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-16f2fd2b-02b8-47f9-a518-dd5f35bf7ed4 service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:26:56.437647 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-16f2fd2b-02b8-47f9-a518-dd5f35bf7ed4 service neutron] Bound port: c3c31744-0580-4d09-863d-697769f7c0ee, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:26:56.438395 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-16f2fd2b-02b8-47f9-a518-dd5f35bf7ed4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:56.447204 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-f2fd0776-0e80-4197-aa3f-b32e71e60a82 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:56.490666 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9fb958a6-c674-4af3-869c-4a022a5f236f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:56.501087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94ced466-a3d6-454c-85e4-4dcf3acb82f1 req-ed3f884a-07af-4dc4-a952-a50face41a08 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:56.502809 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94ced466-a3d6-454c-85e4-4dcf3acb82f1 req-ed3f884a-07af-4dc4-a952-a50face41a08 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 1097 time: 0.3460929 Dec 09 21:26:56.548240 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9fb958a6-c674-4af3-869c-4a022a5f236f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:56.551656 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9fb958a6-c674-4af3-869c-4a022a5f236f admin admin] 10.222.0.13 "DELETE /v2.0/networks/5b690ccc-3b51-4e15-887f-038429ce13f5 HTTP/1.1" status: 204 len: 168 time: 2.6952407 Dec 09 21:26:56.552662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fb958a6-c674-4af3-869c-4a022a5f236f admin admin] Pushing event deleted for resources: {'Network': ['ID=5b690ccc-3b51-4e15-887f-038429ce13f5,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:56.566583 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2fd0776-0e80-4197-aa3f-b32e71e60a82 service neutron] Pushing event updated for resources: {'Port': ['ID=0cb48dd1-cbdb-43d4-9909-33474781399b,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:56.624592 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:56.630565 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-f2fd0776-0e80-4197-aa3f-b32e71e60a82 service neutron] Attempting to bind port 0cb48dd1-cbdb-43d4-9909-33474781399b on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:26:56.630954 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-f2fd0776-0e80-4197-aa3f-b32e71e60a82 service neutron] Attempting to bind port 0cb48dd1-cbdb-43d4-9909-33474781399b by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '46e6c67a-dcee-4633-8adc-6de1ea927c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '43277078-8ac8-4619-8b7d-a7366d3b265f'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:26:56.631300 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-f2fd0776-0e80-4197-aa3f-b32e71e60a82 service neutron] Attempting to bind port 0cb48dd1-cbdb-43d4-9909-33474781399b on network 43277078-8ac8-4619-8b7d-a7366d3b265f {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:56.635195 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e60613cf-c7dd-4027-8ae0-eb255cbea293 req-a0d45abf-343c-4559-8a50-8bbcfc8a5b55 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:56.635854 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-f2fd0776-0e80-4197-aa3f-b32e71e60a82 service neutron] Port 0cb48dd1-cbdb-43d4-9909-33474781399b on network 43277078-8ac8-4619-8b7d-a7366d3b265f not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:26:56.636172 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-f2fd0776-0e80-4197-aa3f-b32e71e60a82 service neutron] Attempting to bind port 0cb48dd1-cbdb-43d4-9909-33474781399b on network 43277078-8ac8-4619-8b7d-a7366d3b265f {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:26:56.637038 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e60613cf-c7dd-4027-8ae0-eb255cbea293 req-a0d45abf-343c-4559-8a50-8bbcfc8a5b55 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] 10.222.0.13 "GET /v2.0/ports?device_id=b47d322e-d75b-4899-be48-dd276a4cdf7e HTTP/1.1" status: 200 len: 931 time: 0.4173141 Dec 09 21:26:56.641853 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-f2fd0776-0e80-4197-aa3f-b32e71e60a82 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 26, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:26:56.642266 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-f2fd0776-0e80-4197-aa3f-b32e71e60a82 service neutron] Checking segment: {'id': '46e6c67a-dcee-4633-8adc-6de1ea927c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '43277078-8ac8-4619-8b7d-a7366d3b265f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:26:56.642939 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-f2fd0776-0e80-4197-aa3f-b32e71e60a82 service neutron] Bound using segment: {'id': '46e6c67a-dcee-4633-8adc-6de1ea927c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '43277078-8ac8-4619-8b7d-a7366d3b265f'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:26:56.643368 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-f2fd0776-0e80-4197-aa3f-b32e71e60a82 service neutron] Bound port: 0cb48dd1-cbdb-43d4-9909-33474781399b, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '46e6c67a-dcee-4633-8adc-6de1ea927c73', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '43277078-8ac8-4619-8b7d-a7366d3b265f'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:26:56.643754 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-f2fd0776-0e80-4197-aa3f-b32e71e60a82 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:56.671720 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-97172314-b057-4dff-bc7c-25fe0f83ac71 req-edf013c3-05e1-4985-bbed-ef34dafc3edd tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-SecurityGroupsTestJSON-securitygroup-204319425&fields=id&tenant_id=5635fb0018b24f538b250cdac6dca9d9 HTTP/1.1" status: 200 len: 267 time: 0.3600171 Dec 09 21:26:56.825564 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-16f2fd2b-02b8-47f9-a518-dd5f35bf7ed4 service neutron] For port c3c31744-0580-4d09-863d-697769f7c0ee, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:26:56.831874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-f2fd0776-0e80-4197-aa3f-b32e71e60a82 service neutron] For port 0cb48dd1-cbdb-43d4-9909-33474781399b, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:26:56.834143 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-16f2fd2b-02b8-47f9-a518-dd5f35bf7ed4 service neutron] For port c3c31744-0580-4d09-863d-697769f7c0ee, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=c3c31744-0580-4d09-863d-697769f7c0ee,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:26:56.845066 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-f2fd0776-0e80-4197-aa3f-b32e71e60a82 service neutron] For port 0cb48dd1-cbdb-43d4-9909-33474781399b, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=0cb48dd1-cbdb-43d4-9909-33474781399b,segment=NetworkSegment(46e6c67a-dcee-4633-8adc-6de1ea927c73),segment_id=46e6c67a-dcee-4633-8adc-6de1ea927c73)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:26:56.854644 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-f2fd0776-0e80-4197-aa3f-b32e71e60a82 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:56.863270 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-ff8d3922-c315-416a-8f3a-d31deb2e60b8 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:56.865516 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-ff8d3922-c315-416a-8f3a-d31deb2e60b8 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.10 "GET /v2.0/networks?id=e7d3d836-ebe9-4e03-af4b-235dd5e5cbea HTTP/1.1" status: 200 len: 811 time: 0.5385649 Dec 09 21:26:56.877404 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-16f2fd2b-02b8-47f9-a518-dd5f35bf7ed4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:56.892136 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-cd70e010-10bc-4089-b7fb-36bcdeaba7d1 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Request body: {'port': {'device_id': '5c7a3543-1d7f-4fd2-a53f-511ae0a4074d', 'network_id': 'e7d3d836-ebe9-4e03-af4b-235dd5e5cbea', 'admin_state_up': True, 'tenant_id': '9ca15fab17f34cc58f1ad1fcedc1bf31'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:56.903318 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39942) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:56.922582 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-f2fd0776-0e80-4197-aa3f-b32e71e60a82 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:56.923290 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-f2fd0776-0e80-4197-aa3f-b32e71e60a82 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:56.925368 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-f2fd0776-0e80-4197-aa3f-b32e71e60a82 service neutron] 10.222.0.10 "PUT /v2.0/ports/0cb48dd1-cbdb-43d4-9909-33474781399b HTTP/1.1" status: 200 len: 1092 time: 1.1705272 Dec 09 21:26:56.933210 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b47d322e-d75b-4899-be48-dd276a4cdf7e', 'tag': '0cb48dd1-cbdb-43d4-9909-33474781399b'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:56.935580 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-01190211-fb78-4464-9c51-a4b53ddeb3b2" -d '{"events": [{"name": "network-changed", "server_uuid": "b47d322e-d75b-4899-be48-dd276a4cdf7e", "tag": "0cb48dd1-cbdb-43d4-9909-33474781399b"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:57.037349 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16f2fd2b-02b8-47f9-a518-dd5f35bf7ed4 service neutron] Pushing event updated for resources: {'Port': ['ID=c3c31744-0580-4d09-863d-697769f7c0ee,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:57.120540 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-16f2fd2b-02b8-47f9-a518-dd5f35bf7ed4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:57.121823 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-16f2fd2b-02b8-47f9-a518-dd5f35bf7ed4 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:57.123985 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-16f2fd2b-02b8-47f9-a518-dd5f35bf7ed4 service neutron] 10.222.0.10 "PUT /v2.0/ports/c3c31744-0580-4d09-863d-697769f7c0ee HTTP/1.1" status: 200 len: 1097 time: 4.8968892 Dec 09 21:26:57.139585 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97172314-b057-4dff-bc7c-25fe0f83ac71 req-aa9efedb-3b22-4968-8feb-7a20dee623cf tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:57.141728 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-97172314-b057-4dff-bc7c-25fe0f83ac71 req-aa9efedb-3b22-4968-8feb-7a20dee623cf tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=dffe3c86-0677-4490-a36a-8bed7d798809 HTTP/1.1" status: 200 len: 985 time: 0.4676712 Dec 09 21:26:57.145695 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94ced466-a3d6-454c-85e4-4dcf3acb82f1 req-1e08a3c7-929c-49d5-a237-c5c508564f59 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6026299 Dec 09 21:26:57.182698 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-97172314-b057-4dff-bc7c-25fe0f83ac71 req-74b2bb30-818c-4a1c-aa79-97b3b4090aae tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Request body: {'port': {'security_groups': ['18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9', 'd0cefb8e-5181-40ca-9bcf-8d762cff4764', 'dc3fa276-da75-42c1-a8e4-8471106148d2']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:57.203961 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:57.219982 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:57.372382 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e60613cf-c7dd-4027-8ae0-eb255cbea293 req-985fa4ef-7e67-4d84-ba6d-8fb2f0d6a2a2 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] 10.222.0.13 "GET /v2.0/security-groups?id=311d4b92-14f8-4511-8f88-1dc905946c73&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6858275 Dec 09 21:26:57.390520 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-97172314-b057-4dff-bc7c-25fe0f83ac71 req-74b2bb30-818c-4a1c-aa79-97b3b4090aae tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:57.431693 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-167f5d51-a123-4d16-b6f7-40343f132e28 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=73812a0c336d4768b029fd6459a1ae9e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5248575 Dec 09 21:26:57.439625 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39952) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:57.480168 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2fd0776-0e80-4197-aa3f-b32e71e60a82 service neutron] Pushing event updated for resources: {'Port': ['ID=0cb48dd1-cbdb-43d4-9909-33474781399b,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:57.494200 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-3f8ee92a-2bc3-4588-96cb-ddb605a52073 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:57.495662 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-3f8ee92a-2bc3-4588-96cb-ddb605a52073 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=f8b3b783f4c54a789e9012e49667eaa1&device_id=b47d322e-d75b-4899-be48-dd276a4cdf7e HTTP/1.1" status: 200 len: 1095 time: 0.1087515 Dec 09 21:26:57.514658 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ac00d8a1-554f-4bd4-86e1-b01b1ae007f7 x-openstack-request-id: req-ac00d8a1-554f-4bd4-86e1-b01b1ae007f7 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:57.514960 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dffe3c86-0677-4490-a36a-8bed7d798809", "tag": "b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:57.515195 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-ac00d8a1-554f-4bd4-86e1-b01b1ae007f7 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:57.515632 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dffe3c86-0677-4490-a36a-8bed7d798809', 'tag': 'b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e', 'status': 'completed', 'code': 200} Dec 09 21:26:57.529349 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-d7ab52de-6b7e-4ba3-9401-db494ef417c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:57.531768 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-d7ab52de-6b7e-4ba3-9401-db494ef417c6 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&device_id=a45aee8c-1ead-4182-81dd-72688d980ba4 HTTP/1.1" status: 200 len: 1100 time: 0.2497354 Dec 09 21:26:57.587248 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-29fc8369-2088-4eef-b006-95676ca0f8bd service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=0cb48dd1-cbdb-43d4-9909-33474781399b HTTP/1.1" status: 200 len: 217 time: 0.0785282 Dec 09 21:26:57.605722 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-daaa5181-1016-448f-818b-976a86675a35 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:57.672503 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7da3ed61-6f33-49bc-b552-4431a3efefd3 req-10e2b0de-5e6b-4b41-aaf2-bf15b2862775 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 210 time: 0.0816336 Dec 09 21:26:57.679800 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-aeff4cb4-9ed2-40f2-925d-05e730113be6 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.123&port_id=c3c31744-0580-4d09-863d-697769f7c0ee HTTP/1.1" status: 200 len: 217 time: 0.1235809 Dec 09 21:26:57.680897 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-daaa5181-1016-448f-818b-976a86675a35 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:57.702166 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-e6fb62a4-00eb-44ab-87d9-e33afbcdd7cf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:57.703962 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-e6fb62a4-00eb-44ab-87d9-e33afbcdd7cf service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88904fa3-5b93-4c51-bfd3-07adb53a77ab HTTP/1.1" status: 200 len: 861 time: 0.0934942 Dec 09 21:26:57.715926 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac42d565-0f3b-4283-a96e-b5feaeeb6aa1 req-376de0f2-5f33-4849-8eab-61b6a577c2b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:57.717597 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac42d565-0f3b-4283-a96e-b5feaeeb6aa1 req-376de0f2-5f33-4849-8eab-61b6a577c2b3 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=5635fb0018b24f538b250cdac6dca9d9&device_id=dffe3c86-0677-4490-a36a-8bed7d798809 HTTP/1.1" status: 200 len: 1137 time: 0.1908574 Dec 09 21:26:57.738382 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-cd70e010-10bc-4089-b7fb-36bcdeaba7d1 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Made reservation on behalf of 9ca15fab17f34cc58f1ad1fcedc1bf31 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:57.742158 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-cd70e010-10bc-4089-b7fb-36bcdeaba7d1 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:57.752358 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-7734ef73-d4b2-43a2-87b2-6850159cc67c service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=43277078-8ac8-4619-8b7d-a7366d3b265f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0288627 Dec 09 21:26:57.929199 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-e66e4a76-0b39-4249-8a06-ecea43cb7668 service neutron] 10.222.0.10 "GET /v2.0/networks/43277078-8ac8-4619-8b7d-a7366d3b265f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1608076 Dec 09 21:26:57.931063 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-daaa5181-1016-448f-818b-976a86675a35 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:57.934417 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-daaa5181-1016-448f-818b-976a86675a35 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:57.938263 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-daaa5181-1016-448f-818b-976a86675a35 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/8cd22e8e-68b3-4ae8-86f1-7bddf671d50f HTTP/1.1" status: 204 len: 168 time: 0.4916041 Dec 09 21:26:58.029763 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-7d17e369-79f6-46c6-899f-9c46a4cb724c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:58.032167 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-7d17e369-79f6-46c6-899f-9c46a4cb724c service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.3408694 Dec 09 21:26:58.050000 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f9f3cda-9f7e-4452-b39d-d409c5506dce req-389ed7b2-dffe-4d46-b7d6-56af14399b34 service neutron] 10.222.0.10 "GET /v2.0/networks/43277078-8ac8-4619-8b7d-a7366d3b265f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1130223 Dec 09 21:26:58.081367 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daaa5181-1016-448f-818b-976a86675a35 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8cd22e8e-68b3-4ae8-86f1-7bddf671d50f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:58.131242 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8d74ccb-067e-4200-84aa-0468a3a4fd15 req-ff10408f-8926-4152-bfcc-490a76bce8b1 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:58.133171 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8d74ccb-067e-4200-84aa-0468a3a4fd15 req-ff10408f-8926-4152-bfcc-490a76bce8b1 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.3267982 Dec 09 21:26:58.187937 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-97172314-b057-4dff-bc7c-25fe0f83ac71 req-74b2bb30-818c-4a1c-aa79-97b3b4090aae tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] For port b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e,segment=NetworkSegment(c472f4a8-1a94-4bb1-8978-a56e5ee37bb8),segment_id=c472f4a8-1a94-4bb1-8978-a56e5ee37bb8)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:26:58.214684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac42d565-0f3b-4283-a96e-b5feaeeb6aa1 req-f70f2516-ad02-4431-ae9c-fab1bd10f5eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:58.216376 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac42d565-0f3b-4283-a96e-b5feaeeb6aa1 req-f70f2516-ad02-4431-ae9c-fab1bd10f5eb service neutron] 10.222.0.31 "GET /v2.0/networks?id=de91a458-cde4-4265-8605-31d9b6f8f05f HTTP/1.1" status: 200 len: 911 time: 0.4714692 Dec 09 21:26:58.221214 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-cd70e010-10bc-4089-b7fb-36bcdeaba7d1 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Allocated IP 172.20.0.10 (e7d3d836-ebe9-4e03-af4b-235dd5e5cbea/a84d1123-6651-4f35-9cba-4f9c8f45aab6/4479e7ab-f0ee-45ff-a040-76f4dd53237f) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:26:58.230436 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-5edb7acf-d059-4ef3-898b-58cc7c630046 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:58.232691 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-5edb7acf-d059-4ef3-898b-58cc7c630046 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1858034 Dec 09 21:26:58.333384 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac42d565-0f3b-4283-a96e-b5feaeeb6aa1 req-8f7104c2-4f8f-46a3-8fb8-fa6f8297c8f0 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e HTTP/1.1" status: 200 len: 217 time: 0.0947304 Dec 09 21:26:58.342148 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-97172314-b057-4dff-bc7c-25fe0f83ac71 req-74b2bb30-818c-4a1c-aa79-97b3b4090aae tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:58.374999 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-97172314-b057-4dff-bc7c-25fe0f83ac71 req-74b2bb30-818c-4a1c-aa79-97b3b4090aae tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:58.400304 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:58.483934 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8d74ccb-067e-4200-84aa-0468a3a4fd15 req-9eedd15d-0481-45a2-88f8-9582a08078d1 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3312879 Dec 09 21:26:58.589878 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f2df502d-2e57-4336-bd95-d675d9569e5b x-openstack-request-id: req-f2df502d-2e57-4336-bd95-d675d9569e5b {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:26:58.589878 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b47d322e-d75b-4899-be48-dd276a4cdf7e", "tag": "0cb48dd1-cbdb-43d4-9909-33474781399b", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:26:58.590170 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f2df502d-2e57-4336-bd95-d675d9569e5b {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:26:58.590438 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b47d322e-d75b-4899-be48-dd276a4cdf7e', 'tag': '0cb48dd1-cbdb-43d4-9909-33474781399b', 'status': 'completed', 'code': 200} Dec 09 21:26:58.749140 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01190211-fb78-4464-9c51-a4b53ddeb3b2 req-c5033d0e-85f2-46df-8fc1-16026eb54866 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:58.750703 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-01190211-fb78-4464-9c51-a4b53ddeb3b2 req-c5033d0e-85f2-46df-8fc1-16026eb54866 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=f8b3b783f4c54a789e9012e49667eaa1&device_id=b47d322e-d75b-4899-be48-dd276a4cdf7e HTTP/1.1" status: 200 len: 1095 time: 0.1371059 Dec 09 21:26:58.825728 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74b2bb30-818c-4a1c-aa79-97b3b4090aae tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event updated for resources: {'Port': ['ID=b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e,revision_number=7']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:58.849941 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97172314-b057-4dff-bc7c-25fe0f83ac71 req-74b2bb30-818c-4a1c-aa79-97b3b4090aae tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:58.851203 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-97172314-b057-4dff-bc7c-25fe0f83ac71 req-74b2bb30-818c-4a1c-aa79-97b3b4090aae tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:58.853701 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-97172314-b057-4dff-bc7c-25fe0f83ac71 req-74b2bb30-818c-4a1c-aa79-97b3b4090aae tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "PUT /v2.0/ports/b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e HTTP/1.1" status: 200 len: 1021 time: 1.6965587 Dec 09 21:26:58.889446 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac42d565-0f3b-4283-a96e-b5feaeeb6aa1 req-8c5af16e-ff28-4701-85ce-4afa92681e8c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:58.892159 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac42d565-0f3b-4283-a96e-b5feaeeb6aa1 req-8c5af16e-ff28-4701-85ce-4afa92681e8c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=cb187a9c-ec94-4995-93f8-92c16c7a80a3 HTTP/1.1" status: 200 len: 850 time: 0.5377979 Dec 09 21:26:58.962433 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac42d565-0f3b-4283-a96e-b5feaeeb6aa1 req-3116ae49-ea78-4200-8b9c-70f52c030230 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=de91a458-cde4-4265-8605-31d9b6f8f05f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0415871 Dec 09 21:26:58.978736 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:26:59.065483 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01190211-fb78-4464-9c51-a4b53ddeb3b2 req-4c8baf78-121e-4533-a397-51a5a678becc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:59.071476 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-01190211-fb78-4464-9c51-a4b53ddeb3b2 req-4c8baf78-121e-4533-a397-51a5a678becc service neutron] 10.222.0.10 "GET /v2.0/networks?id=43277078-8ac8-4619-8b7d-a7366d3b265f HTTP/1.1" status: 200 len: 922 time: 0.3080249 Dec 09 21:26:59.168920 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39982) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:59.183174 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-01190211-fb78-4464-9c51-a4b53ddeb3b2 req-5e3bdb29-9d71-4166-8aef-7e90bd23f07a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=0cb48dd1-cbdb-43d4-9909-33474781399b HTTP/1.1" status: 200 len: 217 time: 0.1031344 Dec 09 21:26:59.290793 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01190211-fb78-4464-9c51-a4b53ddeb3b2 req-1a63fbaa-5a08-4604-8f20-6626fe686e15 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:59.297161 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-01190211-fb78-4464-9c51-a4b53ddeb3b2 req-1a63fbaa-5a08-4604-8f20-6626fe686e15 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88904fa3-5b93-4c51-bfd3-07adb53a77ab HTTP/1.1" status: 200 len: 861 time: 0.1009746 Dec 09 21:26:59.358300 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-01190211-fb78-4464-9c51-a4b53ddeb3b2 req-5b29349b-f55d-456c-9b71-567fb730a0bd service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=43277078-8ac8-4619-8b7d-a7366d3b265f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0493147 Dec 09 21:26:59.368902 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-4f6ed40c-4285-4788-a3b1-bdf9f1cdbfb3 admin admin] Request body: {'network': {'name': 'tempest-TaggedBootDevicesTest-1896005035-network', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:59.452097 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1d80822-d47d-44fd-ba51-bf63ddd1f96c req-46684ecf-f1de-4d3b-ad47-c5c279e84cff tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:59.454485 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f1d80822-d47d-44fd-ba51-bf63ddd1f96c req-46684ecf-f1de-4d3b-ad47-c5c279e84cff tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=a45aee8c-1ead-4182-81dd-72688d980ba4 HTTP/1.1" status: 200 len: 948 time: 0.5790854 Dec 09 21:26:59.485704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4f6ed40c-4285-4788-a3b1-bdf9f1cdbfb3 admin admin] Made reservation on behalf of 03e962eb7f5e4325a7c08c8b1e2a4cea for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:26:59.488430 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4f6ed40c-4285-4788-a3b1-bdf9f1cdbfb3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:59.500904 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4f6ed40c-4285-4788-a3b1-bdf9f1cdbfb3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:59.534833 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a45aee8c-1ead-4182-81dd-72688d980ba4', 'tag': 'c3c31744-0580-4d09-863d-697769f7c0ee'}, {'name': 'network-changed', 'server_uuid': 'dffe3c86-0677-4490-a36a-8bed7d798809', 'tag': 'b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:26:59.537233 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e7dce404-e826-4375-9d6d-8f9034296ecd" -d '{"events": [{"name": "network-changed", "server_uuid": "a45aee8c-1ead-4182-81dd-72688d980ba4", "tag": "c3c31744-0580-4d09-863d-697769f7c0ee"}, {"name": "network-changed", "server_uuid": "dffe3c86-0677-4490-a36a-8bed7d798809", "tag": "b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:26:59.548604 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-01190211-fb78-4464-9c51-a4b53ddeb3b2 req-6a15edf3-779d-4ef1-929e-6f9f860eafe2 service neutron] 10.222.0.10 "GET /v2.0/networks/43277078-8ac8-4619-8b7d-a7366d3b265f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1831861 Dec 09 21:26:59.581783 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-c349edc4-56c0-4f35-be3e-23662309826c service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.3308957 Dec 09 21:26:59.586079 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f1d80822-d47d-44fd-ba51-bf63ddd1f96c req-b3d22a46-58ff-4d89-9741-c7fdf311d4b5 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1117301 Dec 09 21:26:59.596434 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-cd70e010-10bc-4089-b7fb-36bcdeaba7d1 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:59.623121 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e5e1107-c1ce-4ad1-8d99-f951ce39c823 req-6b191c34-aef0-47f6-bd41-c6afa79af1a5 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:59.630420 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e5e1107-c1ce-4ad1-8d99-f951ce39c823 req-6b191c34-aef0-47f6-bd41-c6afa79af1a5 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 0.1723037 Dec 09 21:26:59.696466 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4f6ed40c-4285-4788-a3b1-bdf9f1cdbfb3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:59.705830 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-01190211-fb78-4464-9c51-a4b53ddeb3b2 req-38c1f073-fb1a-4faa-bcb0-5000ae371aac service neutron] 10.222.0.10 "GET /v2.0/networks/43277078-8ac8-4619-8b7d-a7366d3b265f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1465092 Dec 09 21:26:59.726350 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4f6ed40c-4285-4788-a3b1-bdf9f1cdbfb3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:59.746826 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac42d565-0f3b-4283-a96e-b5feaeeb6aa1 req-acc89be9-fa6a-49c6-bcf5-8f06ca9cb159 service neutron] 10.222.0.31 "GET /v2.0/networks/de91a458-cde4-4265-8605-31d9b6f8f05f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7554688 Dec 09 21:26:59.748916 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63ce6e53-259a-43c1-bed8-00741ea84ec1 req-e0e6b6ea-9063-447d-841a-9f2a8cb1b10a service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1492856 Dec 09 21:26:59.751951 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4f6ed40c-4285-4788-a3b1-bdf9f1cdbfb3 admin admin] vlan segment allocate from pool success with {'vlan_id': 141, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:26:59.780790 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f6ed40c-4285-4788-a3b1-bdf9f1cdbfb3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c9dd44b4-64da-4ec9-9419-32736736a6d2,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:26:59.805266 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4f6ed40c-4285-4788-a3b1-bdf9f1cdbfb3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:59.805615 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-4f6ed40c-4285-4788-a3b1-bdf9f1cdbfb3 admin admin] Added segment f5a54e61-4fb1-4afa-9a27-98e2163b0365 of type vlan for network f0373886-3db8-47eb-af65-78244497171e Dec 09 21:26:59.854583 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e5e1107-c1ce-4ad1-8d99-f951ce39c823 req-07d12fb8-e1ef-4673-a468-f4a4f1fc82e7 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2232616 Dec 09 21:26:59.861862 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4f6ed40c-4285-4788-a3b1-bdf9f1cdbfb3 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:59.904994 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4f6ed40c-4285-4788-a3b1-bdf9f1cdbfb3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:59.906312 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4f6ed40c-4285-4788-a3b1-bdf9f1cdbfb3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:59.907119 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4f6ed40c-4285-4788-a3b1-bdf9f1cdbfb3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:59.923265 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a785ec62-2509-469c-9777-54871b2ce272 req-a900f561-9159-4a37-874a-6d2f483c5d6f tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:26:59.925087 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a785ec62-2509-469c-9777-54871b2ce272 req-a900f561-9159-4a37-874a-6d2f483c5d6f tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] 10.222.0.13 "GET /v2.0/ports?device_id=b47d322e-d75b-4899-be48-dd276a4cdf7e HTTP/1.1" status: 200 len: 943 time: 0.1661758 Dec 09 21:26:59.929444 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-cd70e010-10bc-4089-b7fb-36bcdeaba7d1 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:26:59.944455 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4f6ed40c-4285-4788-a3b1-bdf9f1cdbfb3 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.7740445 Dec 09 21:26:59.948142 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39994) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:26:59.953500 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-6cce7d41-a198-4b8a-b0c7-81b5cca97225 admin admin] Request body: {'subnet': {'network_id': 'f0373886-3db8-47eb-af65-78244497171e', 'cidr': '172.20.0.0/28', 'name': 'tempest-TaggedBootDevicesTest-1896005035-subnet', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:26:59.991729 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f6ed40c-4285-4788-a3b1-bdf9f1cdbfb3 admin admin] Pushing event updated for resources: {'Network': ['ID=f0373886-3db8-47eb-af65-78244497171e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:00.004914 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network f0373886-3db8-47eb-af65-78244497171e details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:27:00.013313 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6cce7d41-a198-4b8a-b0c7-81b5cca97225 admin admin] Made reservation on behalf of 03e962eb7f5e4325a7c08c8b1e2a4cea for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:27:00.015709 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6cce7d41-a198-4b8a-b0c7-81b5cca97225 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:00.058445 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac42d565-0f3b-4283-a96e-b5feaeeb6aa1 req-cf3d5c22-4cf3-443a-a806-d8ee68aa1cb2 service neutron] 10.222.0.31 "GET /v2.0/networks/de91a458-cde4-4265-8605-31d9b6f8f05f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2970808 Dec 09 21:27:00.089622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-cd70e010-10bc-4089-b7fb-36bcdeaba7d1 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Network e7d3d836-ebe9-4e03-af4b-235dd5e5cbea is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:27:00.125539 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-cd70e010-10bc-4089-b7fb-36bcdeaba7d1 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:00.133144 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-cd70e010-10bc-4089-b7fb-36bcdeaba7d1 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:27:00.135942 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd70e010-10bc-4089-b7fb-36bcdeaba7d1 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Pushing event updated for resources: {'Port': ['ID=4479e7ab-f0ee-45ff-a040-76f4dd53237f,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:00.191515 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46956a52-1061-4bb3-858d-d544ee218177 req-9d00ea79-a150-415d-b547-5903da5cbf97 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:00.193795 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46956a52-1061-4bb3-858d-d544ee218177 req-9d00ea79-a150-415d-b547-5903da5cbf97 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 932 time: 0.2114089 Dec 09 21:27:00.212337 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a785ec62-2509-469c-9777-54871b2ce272 req-2b1cedf0-2055-4dfb-a22e-96f0fd89627c tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] 10.222.0.13 "GET /v2.0/security-groups?id=311d4b92-14f8-4511-8f88-1dc905946c73&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2647836 Dec 09 21:27:00.237313 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 0cb48dd1-cbdb-43d4-9909-33474781399b details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:27:00.287919 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6cce7d41-a198-4b8a-b0c7-81b5cca97225 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:00.288727 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-cd70e010-10bc-4089-b7fb-36bcdeaba7d1 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:00.289650 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-cd70e010-10bc-4089-b7fb-36bcdeaba7d1 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:00.352048 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46956a52-1061-4bb3-858d-d544ee218177 req-e2b90ba7-44a4-45ef-8005-dd799d4bacf0 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1324356 Dec 09 21:27:00.390286 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 0cb48dd1-cbdb-43d4-9909-33474781399b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=0cb48dd1-cbdb-43d4-9909-33474781399b,segment=NetworkSegment(46e6c67a-dcee-4633-8adc-6de1ea927c73),segment_id=46e6c67a-dcee-4633-8adc-6de1ea927c73)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:00.397505 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cce7d41-a198-4b8a-b0c7-81b5cca97225 admin admin] Pushing event updated for resources: {'Subnet': ['ID=65df7637-0210-4526-a5dd-a692c26062b4,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:00.415564 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '0cb48dd1-cbdb-43d4-9909-33474781399b', 'network_id': '43277078-8ac8-4619-8b7d-a7366d3b265f', 'port_id': '0cb48dd1-cbdb-43d4-9909-33474781399b', 'mac_address': 'fa:16:3e:fd:ad:76', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 136, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '88904fa3-5b93-4c51-bfd3-07adb53a77ab', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:27:00.431202 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6cce7d41-a198-4b8a-b0c7-81b5cca97225 admin admin] Checking segment: {'id': 'f5a54e61-4fb1-4afa-9a27-98e2163b0365', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'f0373886-3db8-47eb-af65-78244497171e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:27:00.431708 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6cce7d41-a198-4b8a-b0c7-81b5cca97225 admin admin] Network hostable DHCP agents. Network: f0373886-3db8-47eb-af65-78244497171e, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:27:00.438615 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-cd70e010-10bc-4089-b7fb-36bcdeaba7d1 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.5507805 Dec 09 21:27:00.456012 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6cce7d41-a198-4b8a-b0c7-81b5cca97225 admin admin] Network f0373886-3db8-47eb-af65-78244497171e is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:27:00.467880 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:00.469856 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-a141079f-bad4-48e3-813c-dca71ea84a5f service neutron] Request body: {'port': {'device_id': '5c7a3543-1d7f-4fd2-a53f-511ae0a4074d', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:00.473564 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-6cce7d41-a198-4b8a-b0c7-81b5cca97225 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, f0373886-3db8-47eb-af65-78244497171e) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:00.478290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cce7d41-a198-4b8a-b0c7-81b5cca97225 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:00.479547 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6cce7d41-a198-4b8a-b0c7-81b5cca97225 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:00.502324 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6cce7d41-a198-4b8a-b0c7-81b5cca97225 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.5527704 Dec 09 21:27:00.505696 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49ae1839-e062-4a6c-a965-105d66536746 None None] Network f0373886-3db8-47eb-af65-78244497171e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:27:00.506389 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40000) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:00.511235 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-fa62882f-9bd7-463e-b242-43b819fd910e admin admin] Request body: {'router': {'name': 'tempest-TaggedBootDevicesTest-1896005035-router', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:00.531994 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0cb48dd1-cbdb-43d4-9909-33474781399b {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:27:00.555499 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4332dfd-bc51-44c0-b4a2-788edbc01929 req-11b5cecc-aa0f-4dd6-947d-218ee0939b40 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:00.563500 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e4332dfd-bc51-44c0-b4a2-788edbc01929 req-11b5cecc-aa0f-4dd6-947d-218ee0939b40 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=dffe3c86-0677-4490-a36a-8bed7d798809 HTTP/1.1" status: 200 len: 1024 time: 0.2101483 Dec 09 21:27:00.573880 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fa62882f-9bd7-463e-b242-43b819fd910e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:00.575559 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fa62882f-9bd7-463e-b242-43b819fd910e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:00.614420 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 0cb48dd1-cbdb-43d4-9909-33474781399b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=0cb48dd1-cbdb-43d4-9909-33474781399b,segment=NetworkSegment(46e6c67a-dcee-4633-8adc-6de1ea927c73),segment_id=46e6c67a-dcee-4633-8adc-6de1ea927c73)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:00.614665 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-a141079f-bad4-48e3-813c-dca71ea84a5f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:00.629849 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:00.632976 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-876a3c92-a9d8-485c-85f8-3ec6c638e8d8 req-87d71810-75f0-4bb7-a422-dfcca8d0e4e9 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:00.641203 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-876a3c92-a9d8-485c-85f8-3ec6c638e8d8 req-87d71810-75f0-4bb7-a422-dfcca8d0e4e9 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.1783857 Dec 09 21:27:00.690165 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fa62882f-9bd7-463e-b242-43b819fd910e admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:00.709030 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7abe7f22-6ab5-4e7d-a40c-034f38080aad None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-f0373886-3db8-47eb-af65-78244497171e', 'network_id': 'f0373886-3db8-47eb-af65-78244497171e', 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'fixed_ips': [{'subnet_id': '65df7637-0210-4526-a5dd-a692c26062b4'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:27:00.709483 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7abe7f22-6ab5-4e7d-a40c-034f38080aad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:00.723627 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=0cb48dd1-cbdb-43d4-9909-33474781399b,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:00.816222 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e4332dfd-bc51-44c0-b4a2-788edbc01929 req-a8263603-a077-4fdd-a34a-7022de0c8990 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=dc3fa276-da75-42c1-a8e4-8471106148d2&id=d0cefb8e-5181-40ca-9bcf-8d762cff4764&id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9 HTTP/1.1" status: 200 len: 6206 time: 0.2516694 Dec 09 21:27:00.838849 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-876a3c92-a9d8-485c-85f8-3ec6c638e8d8 req-36145515-f4e4-4aed-b30d-a01b4dd3a9fb tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1966469 Dec 09 21:27:00.935850 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 346 Content-Type: application/json Date: Thu, 09 Dec 2021 21:26:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8835d5b4-3877-4a70-b475-438529a15b83 x-openstack-request-id: req-8835d5b4-3877-4a70-b475-438529a15b83 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:27:00.936252 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a45aee8c-1ead-4182-81dd-72688d980ba4", "tag": "c3c31744-0580-4d09-863d-697769f7c0ee", "status": "completed", "code": 200}, {"name": "network-changed", "server_uuid": "dffe3c86-0677-4490-a36a-8bed7d798809", "tag": "b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:27:00.936598 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8835d5b4-3877-4a70-b475-438529a15b83 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:27:00.937082 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a45aee8c-1ead-4182-81dd-72688d980ba4', 'tag': 'c3c31744-0580-4d09-863d-697769f7c0ee', 'status': 'completed', 'code': 200} Dec 09 21:27:00.937447 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dffe3c86-0677-4490-a36a-8bed7d798809', 'tag': 'b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e', 'status': 'completed', 'code': 200} Dec 09 21:27:00.969304 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fa62882f-9bd7-463e-b242-43b819fd910e admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:01.160346 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7dce404-e826-4375-9d6d-8f9034296ecd req-f5f5a272-371b-4973-a7a1-d34ee9027395 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:01.162097 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7dce404-e826-4375-9d6d-8f9034296ecd req-f5f5a272-371b-4973-a7a1-d34ee9027395 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=5635fb0018b24f538b250cdac6dca9d9&device_id=dffe3c86-0677-4490-a36a-8bed7d798809 HTTP/1.1" status: 200 len: 1176 time: 0.2236559 Dec 09 21:27:01.229473 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['0cb48dd1-cbdb-43d4-9909-33474781399b'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:27:01.276539 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7dce404-e826-4375-9d6d-8f9034296ecd req-f723c58c-6ff2-4ea4-a4e9-bd91ece4be2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:01.278194 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7dce404-e826-4375-9d6d-8f9034296ecd req-f723c58c-6ff2-4ea4-a4e9-bd91ece4be2a service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&device_id=a45aee8c-1ead-4182-81dd-72688d980ba4 HTTP/1.1" status: 200 len: 1100 time: 0.3202698 Dec 09 21:27:01.289404 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea66730e-617a-4942-a3f2-81326e7d256d req-c376bc52-5754-4bd9-84e8-63567e9dcb1e tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:01.298346 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea66730e-617a-4942-a3f2-81326e7d256d req-c376bc52-5754-4bd9-84e8-63567e9dcb1e tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 0.2257349 Dec 09 21:27:01.306781 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-7abe7f22-6ab5-4e7d-a40c-034f38080aad None None] Allocated IP 172.20.0.2 (f0373886-3db8-47eb-af65-78244497171e/65df7637-0210-4526-a5dd-a692c26062b4/33623e1c-80ee-46d8-a56b-36b3b16079f6) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:27:01.348375 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fa62882f-9bd7-463e-b242-43b819fd910e admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:01.378916 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fa62882f-9bd7-463e-b242-43b819fd910e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:01.513361 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-918d87c4-05e6-4857-ac9d-2b045a5a9a6c req-b2085516-d2bd-4113-91cb-04bec325e83e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:01.515089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-918d87c4-05e6-4857-ac9d-2b045a5a9a6c req-b2085516-d2bd-4113-91cb-04bec325e83e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=a45aee8c-1ead-4182-81dd-72688d980ba4 HTTP/1.1" status: 200 len: 948 time: 0.3352001 Dec 09 21:27:01.531257 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea66730e-617a-4942-a3f2-81326e7d256d req-22251e4e-77c9-4ec4-a0a0-7daa7da68234 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2319493 Dec 09 21:27:01.555815 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-fa62882f-9bd7-463e-b242-43b819fd910e admin admin] Allocated IP 172.25.3.127 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/419b54cc-ec88-493d-a1d4-a2bb128da19c) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:27:01.581193 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7abe7f22-6ab5-4e7d-a40c-034f38080aad None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:01.582453 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-dec48393-cd58-4d15-989b-0342976ad7e1 req-17093593-9b89-4842-8e80-83ef553bf7bf tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Request body: {'security_group': {'name': ' tempest-securitygroup -125737716 ', 'description': 'tempest-description-1374515772'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:01.590444 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7abe7f22-6ab5-4e7d-a40c-034f38080aad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:01.618226 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7dce404-e826-4375-9d6d-8f9034296ecd req-e4ebca8e-f197-459a-a553-597c2b28cd46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:01.619717 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7dce404-e826-4375-9d6d-8f9034296ecd req-e4ebca8e-f197-459a-a553-597c2b28cd46 service neutron] 10.222.0.31 "GET /v2.0/networks?id=de91a458-cde4-4265-8605-31d9b6f8f05f HTTP/1.1" status: 200 len: 911 time: 0.4410324 Dec 09 21:27:01.648739 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7abe7f22-6ab5-4e7d-a40c-034f38080aad None None] Network f0373886-3db8-47eb-af65-78244497171e is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:27:01.654460 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-7abe7f22-6ab5-4e7d-a40c-034f38080aad None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:01.659323 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7abe7f22-6ab5-4e7d-a40c-034f38080aad None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:27:01.662690 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7abe7f22-6ab5-4e7d-a40c-034f38080aad None None] Pushing event updated for resources: {'Port': ['ID=33623e1c-80ee-46d8-a56b-36b3b16079f6,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:01.696784 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7dce404-e826-4375-9d6d-8f9034296ecd req-56580de1-f53d-4360-b1de-5d510e8c7aa2 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e HTTP/1.1" status: 200 len: 217 time: 0.0619161 Dec 09 21:27:01.719297 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-7abe7f22-6ab5-4e7d-a40c-034f38080aad None None] Attempting to bind port 33623e1c-80ee-46d8-a56b-36b3b16079f6 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:27:01.720150 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-7abe7f22-6ab5-4e7d-a40c-034f38080aad None None] Attempting to bind port 33623e1c-80ee-46d8-a56b-36b3b16079f6 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f5a54e61-4fb1-4afa-9a27-98e2163b0365', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'f0373886-3db8-47eb-af65-78244497171e'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:27:01.720426 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fa62882f-9bd7-463e-b242-43b819fd910e admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:01.721307 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7abe7f22-6ab5-4e7d-a40c-034f38080aad None None] Attempting to bind port 33623e1c-80ee-46d8-a56b-36b3b16079f6 on network f0373886-3db8-47eb-af65-78244497171e {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:01.729708 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7abe7f22-6ab5-4e7d-a40c-034f38080aad None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 26, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:27:01.730097 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7abe7f22-6ab5-4e7d-a40c-034f38080aad None None] Checking segment: {'id': 'f5a54e61-4fb1-4afa-9a27-98e2163b0365', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'f0373886-3db8-47eb-af65-78244497171e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:27:01.730778 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7abe7f22-6ab5-4e7d-a40c-034f38080aad None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:01.730911 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7abe7f22-6ab5-4e7d-a40c-034f38080aad None None] Bound using segment: {'id': 'f5a54e61-4fb1-4afa-9a27-98e2163b0365', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'f0373886-3db8-47eb-af65-78244497171e'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:27:01.731358 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-7abe7f22-6ab5-4e7d-a40c-034f38080aad None None] Bound port: 33623e1c-80ee-46d8-a56b-36b3b16079f6, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f5a54e61-4fb1-4afa-9a27-98e2163b0365', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'f0373886-3db8-47eb-af65-78244497171e'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:27:01.731840 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7abe7f22-6ab5-4e7d-a40c-034f38080aad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:01.764023 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fa62882f-9bd7-463e-b242-43b819fd910e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:01.766626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7dce404-e826-4375-9d6d-8f9034296ecd req-022a0dfa-b189-42d1-aaa6-082fbd837764 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:01.768606 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7dce404-e826-4375-9d6d-8f9034296ecd req-022a0dfa-b189-42d1-aaa6-082fbd837764 service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.4658070 Dec 09 21:27:01.784700 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-dec48393-cd58-4d15-989b-0342976ad7e1 req-17093593-9b89-4842-8e80-83ef553bf7bf tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:01.807261 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fa62882f-9bd7-463e-b242-43b819fd910e admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:27:01.813144 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-fa62882f-9bd7-463e-b242-43b819fd910e admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:01.815731 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-7abe7f22-6ab5-4e7d-a40c-034f38080aad None None] For port 33623e1c-80ee-46d8-a56b-36b3b16079f6, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:27:01.817008 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-a141079f-bad4-48e3-813c-dca71ea84a5f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4479e7ab-f0ee-45ff-a040-76f4dd53237f {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:27:01.824234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-7abe7f22-6ab5-4e7d-a40c-034f38080aad None None] For port 33623e1c-80ee-46d8-a56b-36b3b16079f6, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=33623e1c-80ee-46d8-a56b-36b3b16079f6,segment=NetworkSegment(f5a54e61-4fb1-4afa-9a27-98e2163b0365),segment_id=f5a54e61-4fb1-4afa-9a27-98e2163b0365)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:27:01.824479 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa62882f-9bd7-463e-b242-43b819fd910e admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:27:01.835337 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7abe7f22-6ab5-4e7d-a40c-034f38080aad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:01.837172 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-918d87c4-05e6-4857-ac9d-2b045a5a9a6c req-1c40952f-ad9c-442e-9272-fbaf58bb09c7 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2943349 Dec 09 21:27:01.891829 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-a141079f-bad4-48e3-813c-dca71ea84a5f service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:01.898095 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7dce404-e826-4375-9d6d-8f9034296ecd req-a5e9ab3f-4502-4b74-ae0d-b2140db41514 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.123&port_id=c3c31744-0580-4d09-863d-697769f7c0ee HTTP/1.1" status: 200 len: 217 time: 0.1202378 Dec 09 21:27:01.917430 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7abe7f22-6ab5-4e7d-a40c-034f38080aad None None] Pushing event updated for resources: {'Port': ['ID=33623e1c-80ee-46d8-a56b-36b3b16079f6,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:01.937097 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7dce404-e826-4375-9d6d-8f9034296ecd req-179aa27f-2e00-457a-99a0-7633d075a483 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:01.938534 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7dce404-e826-4375-9d6d-8f9034296ecd req-179aa27f-2e00-457a-99a0-7633d075a483 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=cb187a9c-ec94-4995-93f8-92c16c7a80a3 HTTP/1.1" status: 200 len: 850 time: 0.2133985 Dec 09 21:27:01.947865 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa62882f-9bd7-463e-b242-43b819fd910e admin admin] Pushing event updated for resources: {'Port': ['ID=419b54cc-ec88-493d-a1d4-a2bb128da19c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:01.997021 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-a141079f-bad4-48e3-813c-dca71ea84a5f service neutron] Transition to ACTIVE for port object 4479e7ab-f0ee-45ff-a040-76f4dd53237f will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:27:02.044414 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7dce404-e826-4375-9d6d-8f9034296ecd req-5df02169-37c5-4fa2-acdb-ccf19f8707ae service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=de91a458-cde4-4265-8605-31d9b6f8f05f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0832450 Dec 09 21:27:02.045033 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-a141079f-bad4-48e3-813c-dca71ea84a5f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:02.108427 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-dec48393-cd58-4d15-989b-0342976ad7e1 req-17093593-9b89-4842-8e80-83ef553bf7bf tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:02.133863 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7dce404-e826-4375-9d6d-8f9034296ecd req-70c69d0b-7312-4663-b518-0b4d83050030 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:02.135341 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7dce404-e826-4375-9d6d-8f9034296ecd req-70c69d0b-7312-4663-b518-0b4d83050030 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.2040231 Dec 09 21:27:02.135951 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-dec48393-cd58-4d15-989b-0342976ad7e1 req-17093593-9b89-4842-8e80-83ef553bf7bf tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:02.156262 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fa62882f-9bd7-463e-b242-43b819fd910e admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:02.230842 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65335276-fddd-4321-8f09-88b24730b581 req-3957185f-5357-4777-8e47-f33121f4c192 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:02.233311 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-65335276-fddd-4321-8f09-88b24730b581 req-3957185f-5357-4777-8e47-f33121f4c192 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "GET /v2.0/ports?device_id=a0e7c231-5917-4aec-89da-a4a946e66c69 HTTP/1.1" status: 200 len: 946 time: 0.2977357 Dec 09 21:27:02.235996 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device c3c31744-0580-4d09-863d-697769f7c0ee details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:27:02.241089 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 0cb48dd1-cbdb-43d4-9909-33474781399b up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:02.246804 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a141079f-bad4-48e3-813c-dca71ea84a5f service neutron] Pushing event updated for resources: {'Port': ['ID=4479e7ab-f0ee-45ff-a040-76f4dd53237f,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:02.307646 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17093593-9b89-4842-8e80-83ef553bf7bf tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2532bd8f-3548-430a-8273-6cdaee201c51,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:02.314445 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-dec48393-cd58-4d15-989b-0342976ad7e1 req-17093593-9b89-4842-8e80-83ef553bf7bf tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:02.326017 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dec48393-cd58-4d15-989b-0342976ad7e1 req-17093593-9b89-4842-8e80-83ef553bf7bf tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1804 time: 0.7701797 Dec 09 21:27:02.420879 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 0cb48dd1-cbdb-43d4-9909-33474781399b completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:27:02.437051 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port c3c31744-0580-4d09-863d-697769f7c0ee, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=c3c31744-0580-4d09-863d-697769f7c0ee,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:02.439555 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 0cb48dd1-cbdb-43d4-9909-33474781399b triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:02.439713 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7dce404-e826-4375-9d6d-8f9034296ecd req-77d9a9be-ef5c-4090-9883-7211fbcb37e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:02.439936 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:02.441074 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7dce404-e826-4375-9d6d-8f9034296ecd req-77d9a9be-ef5c-4090-9883-7211fbcb37e7 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.2828019 Dec 09 21:27:02.450256 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fa62882f-9bd7-463e-b242-43b819fd910e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:02.488081 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'c3c31744-0580-4d09-863d-697769f7c0ee', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': 'c3c31744-0580-4d09-863d-697769f7c0ee', 'mac_address': 'fa:16:3e:d4:3d:96', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.123'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:27:02.512284 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68ced780-66cc-4be8-9884-78314db6362d req-b4278593-8833-4f8b-872a-29bf4de4d5c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:02.514251 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-68ced780-66cc-4be8-9884-78314db6362d req-b4278593-8833-4f8b-872a-29bf4de4d5c3 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=1b7916b634f74760a565cfeaef510cd9&device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 1097 time: 0.1005557 Dec 09 21:27:02.566491 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:02.585357 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:02.598301 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c3c31744-0580-4d09-863d-697769f7c0ee {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:27:02.644584 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b47d322e-d75b-4899-be48-dd276a4cdf7e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0cb48dd1-cbdb-43d4-9909-33474781399b'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:27:02.648224 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f26a088d-956e-411d-8f17-b5de249a828d" -d '{"events": [{"server_uuid": "b47d322e-d75b-4899-be48-dd276a4cdf7e", "name": "network-vif-plugged", "status": "completed", "tag": "0cb48dd1-cbdb-43d4-9909-33474781399b"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:27:02.677442 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port c3c31744-0580-4d09-863d-697769f7c0ee, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=c3c31744-0580-4d09-863d-697769f7c0ee,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:02.683947 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 0cb48dd1-cbdb-43d4-9909-33474781399b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=0cb48dd1-cbdb-43d4-9909-33474781399b,segment=NetworkSegment(46e6c67a-dcee-4633-8adc-6de1ea927c73),segment_id=46e6c67a-dcee-4633-8adc-6de1ea927c73)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:02.688455 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:02.721363 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ab64d06-931b-4541-88dc-e2dda6ac1832 req-d41db264-2a62-411d-9a63-4d5276a7135f tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:02.723063 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9ab64d06-931b-4541-88dc-e2dda6ac1832 req-d41db264-2a62-411d-9a63-4d5276a7135f tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.10 "GET /v2.0/ports?device_id=a0e7c231-5917-4aec-89da-a4a946e66c69 HTTP/1.1" status: 200 len: 946 time: 0.1522341 Dec 09 21:27:02.758493 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=c3c31744-0580-4d09-863d-697769f7c0ee,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:02.761414 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:02.802463 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68ced780-66cc-4be8-9884-78314db6362d req-9e50b3ef-7ff2-43a0-b857-e0ef51785b73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:02.804318 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-68ced780-66cc-4be8-9884-78314db6362d req-9e50b3ef-7ff2-43a0-b857-e0ef51785b73 service neutron] 10.222.0.31 "GET /v2.0/networks?id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb HTTP/1.1" status: 200 len: 913 time: 0.2802341 Dec 09 21:27:02.827271 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=0cb48dd1-cbdb-43d4-9909-33474781399b,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:02.861784 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7dce404-e826-4375-9d6d-8f9034296ecd req-24bc5b29-0b54-4176-b177-ab05420c49da service neutron] 10.222.0.31 "GET /v2.0/networks/de91a458-cde4-4265-8605-31d9b6f8f05f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7460778 Dec 09 21:27:02.938733 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['c3c31744-0580-4d09-863d-697769f7c0ee'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:27:02.952862 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-65335276-fddd-4321-8f09-88b24730b581 req-9a58fb59-9063-4209-bc46-069e9208434a tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "GET /v2.0/security-groups?id=4aaea988-139c-4402-b4d7-14ee4ed56291&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.6486819 Dec 09 21:27:02.953595 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-a141079f-bad4-48e3-813c-dca71ea84a5f service neutron] Attempting to bind port 4479e7ab-f0ee-45ff-a040-76f4dd53237f on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:27:02.953934 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-a141079f-bad4-48e3-813c-dca71ea84a5f service neutron] Attempting to bind port 4479e7ab-f0ee-45ff-a040-76f4dd53237f by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '6bb6d7a7-737b-46b2-b463-0bc25081f6ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'e7d3d836-ebe9-4e03-af4b-235dd5e5cbea'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:27:02.954275 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-a141079f-bad4-48e3-813c-dca71ea84a5f service neutron] Attempting to bind port 4479e7ab-f0ee-45ff-a040-76f4dd53237f on network e7d3d836-ebe9-4e03-af4b-235dd5e5cbea {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:02.967489 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-68ced780-66cc-4be8-9884-78314db6362d req-52509ec1-78b0-4262-9905-8460d2ef96dc service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=058ec1cc-1cd2-44ec-93de-4557c5dd65de HTTP/1.1" status: 200 len: 217 time: 0.1215215 Dec 09 21:27:02.968128 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fa62882f-9bd7-463e-b242-43b819fd910e admin admin] Router f2b3fc08-9e60-4600-9a8b-7400a9e940a0 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:27:03.057723 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-a141079f-bad4-48e3-813c-dca71ea84a5f service neutron] Port 4479e7ab-f0ee-45ff-a040-76f4dd53237f on network e7d3d836-ebe9-4e03-af4b-235dd5e5cbea not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:27:03.059253 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-a141079f-bad4-48e3-813c-dca71ea84a5f service neutron] Attempting to bind port 4479e7ab-f0ee-45ff-a040-76f4dd53237f on network e7d3d836-ebe9-4e03-af4b-235dd5e5cbea {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:03.059414 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-12b4141c-5cf0-4e88-a5b9-b5784dab6a16 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:03.110337 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69adc75c-371e-4262-a410-605e9f30484a req-283ab9e5-7424-4bdd-a2a5-64ce3981cda4 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:03.112833 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69adc75c-371e-4262-a410-605e9f30484a req-283ab9e5-7424-4bdd-a2a5-64ce3981cda4 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] 10.222.0.13 "GET /v2.0/ports?device_id=b47d322e-d75b-4899-be48-dd276a4cdf7e HTTP/1.1" status: 200 len: 944 time: 0.6916907 Dec 09 21:27:03.155938 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-a141079f-bad4-48e3-813c-dca71ea84a5f service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 26, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:27:03.156285 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-a141079f-bad4-48e3-813c-dca71ea84a5f service neutron] Checking segment: {'id': '6bb6d7a7-737b-46b2-b463-0bc25081f6ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'e7d3d836-ebe9-4e03-af4b-235dd5e5cbea'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:27:03.156680 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-a141079f-bad4-48e3-813c-dca71ea84a5f service neutron] Bound using segment: {'id': '6bb6d7a7-737b-46b2-b463-0bc25081f6ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'e7d3d836-ebe9-4e03-af4b-235dd5e5cbea'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:27:03.157134 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-a141079f-bad4-48e3-813c-dca71ea84a5f service neutron] Bound port: 4479e7ab-f0ee-45ff-a040-76f4dd53237f, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6bb6d7a7-737b-46b2-b463-0bc25081f6ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'e7d3d836-ebe9-4e03-af4b-235dd5e5cbea'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:27:03.157500 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-a141079f-bad4-48e3-813c-dca71ea84a5f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:03.182590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68ced780-66cc-4be8-9884-78314db6362d req-8ad58381-4e57-4abd-b294-c456b4b902ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:03.184044 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-68ced780-66cc-4be8-9884-78314db6362d req-8ad58381-4e57-4abd-b294-c456b4b902ad service neutron] 10.222.0.31 "GET /v2.0/subnets?id=50496955-1646-4079-acd4-a47e8cd175cb HTTP/1.1" status: 200 len: 852 time: 0.2057970 Dec 09 21:27:03.189123 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-9ab64d06-931b-4541-88dc-e2dda6ac1832 req-95e7fe03-4ad5-41dc-a7d6-58803f012b27 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Deleting port 78afd497-51cf-40c2-9eaf-ee2f42951961 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:27:03.189445 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9ab64d06-931b-4541-88dc-e2dda6ac1832 req-95e7fe03-4ad5-41dc-a7d6-58803f012b27 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:03.261328 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7dce404-e826-4375-9d6d-8f9034296ecd req-4e4d3bdb-bb6b-4a21-a3af-41e49b8d53c8 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8028955 Dec 09 21:27:03.284851 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-81f9d4f4-495e-4597-a58f-28d4abced16f None None] Network f0373886-3db8-47eb-af65-78244497171e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:27:03.288387 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7dce404-e826-4375-9d6d-8f9034296ecd req-917f29b8-7afa-4a82-be42-14746d89b875 service neutron] 10.222.0.31 "GET /v2.0/networks/de91a458-cde4-4265-8605-31d9b6f8f05f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4068694 Dec 09 21:27:03.339694 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ca3a251-3b67-426d-a561-22f5a4d17e1e req-45b05c2a-3d97-4cd6-8e6f-f0b6ca910aa5 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:03.341471 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ca3a251-3b67-426d-a561-22f5a4d17e1e req-45b05c2a-3d97-4cd6-8e6f-f0b6ca910aa5 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 944 time: 0.2248626 Dec 09 21:27:03.355002 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69adc75c-371e-4262-a410-605e9f30484a req-a470971c-280b-4a30-b4be-1b6944ca2a75 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] 10.222.0.13 "GET /v2.0/security-groups?id=311d4b92-14f8-4511-8f88-1dc905946c73&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2288125 Dec 09 21:27:03.388479 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-de43001d-fccb-430c-9269-97565bf8b732 None None] Provisioning complete for port 33623e1c-80ee-46d8-a56b-36b3b16079f6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:03.388888 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-de43001d-fccb-430c-9269-97565bf8b732 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:03.431471 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-a141079f-bad4-48e3-813c-dca71ea84a5f service neutron] For port 4479e7ab-f0ee-45ff-a040-76f4dd53237f, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:27:03.449483 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-a141079f-bad4-48e3-813c-dca71ea84a5f service neutron] For port 4479e7ab-f0ee-45ff-a040-76f4dd53237f, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=4479e7ab-f0ee-45ff-a040-76f4dd53237f,segment=NetworkSegment(6bb6d7a7-737b-46b2-b463-0bc25081f6ef),segment_id=6bb6d7a7-737b-46b2-b463-0bc25081f6ef)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:27:03.484980 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-a141079f-bad4-48e3-813c-dca71ea84a5f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:03.495298 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7dce404-e826-4375-9d6d-8f9034296ecd req-b85c3bfb-2aff-494e-a20a-1bf1b051b7e4 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2148070 Dec 09 21:27:03.542912 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ca3a251-3b67-426d-a561-22f5a4d17e1e req-eac4a806-5f67-4ffc-baf0-a4e0e04caa01 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1868734 Dec 09 21:27:03.546638 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-de43001d-fccb-430c-9269-97565bf8b732 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:03.548647 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-a141079f-bad4-48e3-813c-dca71ea84a5f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:03.549733 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-a141079f-bad4-48e3-813c-dca71ea84a5f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:03.551379 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-a141079f-bad4-48e3-813c-dca71ea84a5f service neutron] 10.222.0.10 "PUT /v2.0/ports/4479e7ab-f0ee-45ff-a040-76f4dd53237f HTTP/1.1" status: 200 len: 1093 time: 3.0898538 Dec 09 21:27:03.552218 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5c7a3543-1d7f-4fd2-a53f-511ae0a4074d', 'tag': '4479e7ab-f0ee-45ff-a040-76f4dd53237f'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:27:03.555376 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ee451170-1fd9-4ad7-961f-b9ac428bf383" -d '{"events": [{"name": "network-changed", "server_uuid": "5c7a3543-1d7f-4fd2-a53f-511ae0a4074d", "tag": "4479e7ab-f0ee-45ff-a040-76f4dd53237f"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:27:03.587755 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a141079f-bad4-48e3-813c-dca71ea84a5f service neutron] Pushing event updated for resources: {'Port': ['ID=4479e7ab-f0ee-45ff-a040-76f4dd53237f,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:03.633775 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-de43001d-fccb-430c-9269-97565bf8b732 None None] For port 33623e1c-80ee-46d8-a56b-36b3b16079f6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=33623e1c-80ee-46d8-a56b-36b3b16079f6,segment=NetworkSegment(f5a54e61-4fb1-4afa-9a27-98e2163b0365),segment_id=f5a54e61-4fb1-4afa-9a27-98e2163b0365)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:03.639989 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-68ced780-66cc-4be8-9884-78314db6362d req-06688781-5a5a-4411-81de-978fb6930a66 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.4345186 Dec 09 21:27:03.646230 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fa62882f-9bd7-463e-b242-43b819fd910e admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:27:03.649152 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-9ab64d06-931b-4541-88dc-e2dda6ac1832 req-95e7fe03-4ad5-41dc-a7d6-58803f012b27 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] For port 78afd497-51cf-40c2-9eaf-ee2f42951961, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=78afd497-51cf-40c2-9eaf-ee2f42951961,segment=NetworkSegment(51116481-b9d7-45e1-bfed-86b419caae01),segment_id=51116481-b9d7-45e1-bfed-86b419caae01)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:03.649527 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9ab64d06-931b-4541-88dc-e2dda6ac1832 req-95e7fe03-4ad5-41dc-a7d6-58803f012b27 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:03.656920 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] Sync routers for ids ['f2b3fc08-9e60-4600-9a8b-7400a9e940a0'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:27:03.674659 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-de43001d-fccb-430c-9269-97565bf8b732 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:03.681580 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] Routers {'f2b3fc08-9e60-4600-9a8b-7400a9e940a0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:27:03.682565 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:26:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f2b3fc08-9e60-4600-9a8b-7400a9e940a0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:03.780511 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de43001d-fccb-430c-9269-97565bf8b732 None None] Pushing event updated for resources: {'Port': ['ID=33623e1c-80ee-46d8-a56b-36b3b16079f6,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:03.823389 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-05e04186-473a-4156-8f26-a0d89172e25f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:03.827993 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-05e04186-473a-4156-8f26-a0d89172e25f service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=9ca15fab17f34cc58f1ad1fcedc1bf31&device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 1096 time: 0.2023447 Dec 09 21:27:03.861356 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fa62882f-9bd7-463e-b242-43b819fd910e admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:03.863009 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fa62882f-9bd7-463e-b242-43b819fd910e admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 3.3552394 Dec 09 21:27:03.895330 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40046) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:03.947772 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-3658bf29-9d8b-4c7f-a25f-3fb8a63d8604 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=4479e7ab-f0ee-45ff-a040-76f4dd53237f HTTP/1.1" status: 200 len: 217 time: 0.0947628 Dec 09 21:27:03.970824 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 33623e1c-80ee-46d8-a56b-36b3b16079f6 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:03.995085 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35c0e8e7-c2c7-49b1-bac9-cc8fe1a57213 req-aeeedb31-7b2f-4555-adb2-c6e5517caba6 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:03.996653 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35c0e8e7-c2c7-49b1-bac9-cc8fe1a57213 req-aeeedb31-7b2f-4555-adb2-c6e5517caba6 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.2732482 Dec 09 21:27:04.037792 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-038e68ae-1e3f-4b9d-b657-7414a785df61 req-b2982743-ba26-4957-9a75-afee7ee83db2 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/2532bd8f-3548-430a-8273-6cdaee201c51 HTTP/1.1" status: 200 len: 1799 time: 0.2519426 Dec 09 21:27:04.044592 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 33623e1c-80ee-46d8-a56b-36b3b16079f6 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:04.045218 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:04.083681 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9ab64d06-931b-4541-88dc-e2dda6ac1832 req-95e7fe03-4ad5-41dc-a7d6-58803f012b27 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:04.084196 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9ab64d06-931b-4541-88dc-e2dda6ac1832 req-95e7fe03-4ad5-41dc-a7d6-58803f012b27 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:04.084522 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [req-9ab64d06-931b-4541-88dc-e2dda6ac1832 req-95e7fe03-4ad5-41dc-a7d6-58803f012b27 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Floating IP 1b4b1e21-9999-439a-b529-4d84581ab707 disassociated. External IP: 172.25.3.79, port: 78afd497-51cf-40c2-9eaf-ee2f42951961. Dec 09 21:27:04.084872 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-9ab64d06-931b-4541-88dc-e2dda6ac1832 req-95e7fe03-4ad5-41dc-a7d6-58803f012b27 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Calling delete_port for 78afd497-51cf-40c2-9eaf-ee2f42951961 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:27:04.114171 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:27:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-356f371e-8769-4854-bdbf-e4b156a47520 x-openstack-request-id: req-356f371e-8769-4854-bdbf-e4b156a47520 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:27:04.114881 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b47d322e-d75b-4899-be48-dd276a4cdf7e", "name": "network-vif-plugged", "status": "completed", "tag": "0cb48dd1-cbdb-43d4-9909-33474781399b", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:27:04.115242 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-356f371e-8769-4854-bdbf-e4b156a47520 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:27:04.115765 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b47d322e-d75b-4899-be48-dd276a4cdf7e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0cb48dd1-cbdb-43d4-9909-33474781399b', 'code': 200} Dec 09 21:27:04.123663 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-1b8f1295-d7bd-4a1c-b9c1-e3696dd768d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:04.126739 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-1b8f1295-d7bd-4a1c-b9c1-e3696dd768d8 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=a84d1123-6651-4f35-9cba-4f9c8f45aab6 HTTP/1.1" status: 200 len: 851 time: 0.1777310 Dec 09 21:27:04.148628 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] Set router f2b3fc08-9e60-4600-9a8b-7400a9e940a0 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:27:04.212755 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-023ebb74-2c33-43f3-9bc4-9fb600de6853 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=e7d3d836-ebe9-4e03-af4b-235dd5e5cbea&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0749671 Dec 09 21:27:04.224884 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1e11cf5c-4c64-4935-8077-5ae855ed3803 None None] Provisioning complete for port 33623e1c-80ee-46d8-a56b-36b3b16079f6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:04.225284 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1e11cf5c-4c64-4935-8077-5ae855ed3803 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:04.267176 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device c3c31744-0580-4d09-863d-697769f7c0ee up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:04.310372 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35c0e8e7-c2c7-49b1-bac9-cc8fe1a57213 req-35407b68-3ab5-43be-9b9c-cb682376de57 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2926574 Dec 09 21:27:04.342186 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-68ced780-66cc-4be8-9884-78314db6362d req-ee52c417-89fd-456b-8902-08c8e27d0b6b service neutron] 10.222.0.31 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6879673 Dec 09 21:27:04.399125 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port c3c31744-0580-4d09-863d-697769f7c0ee completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:27:04.409011 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port c3c31744-0580-4d09-863d-697769f7c0ee triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:04.409572 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:04.412658 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0052cfb9-ac9c-4ae3-96fb-b9be66d6eeb4 req-964d009f-0b03-4bb2-9c43-99c579ae496c tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:04.421426 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0052cfb9-ac9c-4ae3-96fb-b9be66d6eeb4 req-964d009f-0b03-4bb2-9c43-99c579ae496c tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=a45aee8c-1ead-4182-81dd-72688d980ba4 HTTP/1.1" status: 200 len: 949 time: 0.2448261 Dec 09 21:27:04.426698 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:27:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ca4e5bba-c93d-4ec1-b4c6-6788b62caa0a x-openstack-request-id: req-ca4e5bba-c93d-4ec1-b4c6-6788b62caa0a {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:27:04.427003 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5c7a3543-1d7f-4fd2-a53f-511ae0a4074d", "tag": "4479e7ab-f0ee-45ff-a040-76f4dd53237f", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:27:04.427224 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-ca4e5bba-c93d-4ec1-b4c6-6788b62caa0a {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:27:04.427654 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5c7a3543-1d7f-4fd2-a53f-511ae0a4074d', 'tag': '4479e7ab-f0ee-45ff-a040-76f4dd53237f', 'status': 'completed', 'code': 200} Dec 09 21:27:04.469712 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfc121b2-a937-4f76-9cf1-a5ce74c8cb44 req-6b2e7825-41ea-4475-9391-c97a82f6f29d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:04.471905 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfc121b2-a937-4f76-9cf1-a5ce74c8cb44 req-6b2e7825-41ea-4475-9391-c97a82f6f29d service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=b47d322e-d75b-4899-be48-dd276a4cdf7e HTTP/1.1" status: 200 len: 1097 time: 0.2633832 Dec 09 21:27:04.502599 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'name': 'tempest-TaggedBootDevicesTest-1896005035-router', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127'}], 'enable_snat': True}, 'gw_port_id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:00Z', 'updated_at': '2021-12-09T21:27:02Z', 'revision_number': 3, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'gw_port': {'id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a1:90:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1069, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:01Z', 'updated_at': '2021-12-09T21:27:01Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:04.512115 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9ab64d06-931b-4541-88dc-e2dda6ac1832 req-95e7fe03-4ad5-41dc-a7d6-58803f012b27 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:04.539332 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:04.541107 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] Checking router: f2b3fc08-9e60-4600-9a8b-7400a9e940a0 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:27:04.541459 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] Updating router f2b3fc08-9e60-4600-9a8b-7400a9e940a0 port 419b54cc-ec88-493d-a1d4-a2bb128da19c binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:27:04.570145 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:04.582526 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95e7fe03-4ad5-41dc-a7d6-58803f012b27 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Pushing event deleted for resources: {'Port': ['ID=78afd497-51cf-40c2-9eaf-ee2f42951961,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:04.585472 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0052cfb9-ac9c-4ae3-96fb-b9be66d6eeb4 req-21ca9c80-64ca-409f-b7ea-904e84705914 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1631339 Dec 09 21:27:04.586510 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port c3c31744-0580-4d09-863d-697769f7c0ee, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=c3c31744-0580-4d09-863d-697769f7c0ee,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:04.588116 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-f868bd68-56a3-4685-b6b9-44cb9f9a0a3d service neutron] 10.222.0.10 "GET /v2.0/networks/e7d3d836-ebe9-4e03-af4b-235dd5e5cbea?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3220379 Dec 09 21:27:04.595798 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:04.623220 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-68ced780-66cc-4be8-9884-78314db6362d req-54a68136-abdb-4879-acf6-e1eea687eee3 service neutron] 10.222.0.31 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2411506 Dec 09 21:27:04.686660 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae51657-2a08-4bfb-847d-f40cc4769f7f req-c833a4b9-0366-4943-be6d-15e2a98c3ae0 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:04.692813 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fae51657-2a08-4bfb-847d-f40cc4769f7f req-c833a4b9-0366-4943-be6d-15e2a98c3ae0 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 0.1413801 Dec 09 21:27:04.703137 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=c3c31744-0580-4d09-863d-697769f7c0ee,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:04.786613 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20985da5-002e-460f-a484-4945a70ca5a1 req-874849b2-3975-47e9-984d-d95dc2c06012 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "GET /v2.0/ports?device_id=a0e7c231-5917-4aec-89da-a4a946e66c69 HTTP/1.1" status: 200 len: 210 time: 0.0869360 Dec 09 21:27:04.795722 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfc121b2-a937-4f76-9cf1-a5ce74c8cb44 req-721fa249-c70c-4dc4-9ad7-cb8836765973 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=311d4b92-14f8-4511-8f88-1dc905946c73&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2701609 Dec 09 21:27:04.852580 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4d31f926-1894-4e2f-a1ca-07862d923b66 req-0b0f31c9-1bf2-430f-a93c-69d02efa2a6c service neutron] 10.222.0.10 "GET /v2.0/networks/e7d3d836-ebe9-4e03-af4b-235dd5e5cbea?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2508245 Dec 09 21:27:04.865651 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fae51657-2a08-4bfb-847d-f40cc4769f7f req-888bbdcb-4195-4c9c-a8ac-02a04f5458e5 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1591294 Dec 09 21:27:04.908643 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bb7c0cab-5ba1-4a34-82e1-1ac8de8d5617 req-e94682d7-6f45-4111-9095-bd06a331de48 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/2532bd8f-3548-430a-8273-6cdaee201c51 HTTP/1.1" status: 200 len: 1799 time: 0.0695417 Dec 09 21:27:04.918360 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [req-9ab64d06-931b-4541-88dc-e2dda6ac1832 req-95e7fe03-4ad5-41dc-a7d6-58803f012b27 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Router 48f26966-6ebd-4ded-9b83-e7fdb71c4bf7 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:27:04.976346 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:04.999970 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:05.009008 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bb7c0cab-5ba1-4a34-82e1-1ac8de8d5617 req-5a6c6969-00fe-4072-bc56-0cf4fddc514f tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:05.023256 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5ae977d-5b74-45db-af93-d48de83eda5a req-2ebef421-54bb-45ee-8e18-b960f098a5f6 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:05.025117 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d5ae977d-5b74-45db-af93-d48de83eda5a req-2ebef421-54bb-45ee-8e18-b960f098a5f6 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] 10.222.0.13 "GET /v2.0/ports?device_id=b47d322e-d75b-4899-be48-dd276a4cdf7e HTTP/1.1" status: 200 len: 945 time: 0.1008980 Dec 09 21:27:05.057795 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-9ab64d06-931b-4541-88dc-e2dda6ac1832 req-95e7fe03-4ad5-41dc-a7d6-58803f012b27 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:27:05.073082 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1839cff-c3d4-4f63-97a7-28c4e6cf1b8d None None] Sync routers for ids ['48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:27:05.092506 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1839cff-c3d4-4f63-97a7-28c4e6cf1b8d None None] Routers {'48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:27:05.093180 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-c1839cff-c3d4-4f63-97a7-28c4e6cf1b8d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:26:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:05.102737 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] Attempting to bind port 419b54cc-ec88-493d-a1d4-a2bb128da19c on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:27:05.103191 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] Attempting to bind port 419b54cc-ec88-493d-a1d4-a2bb128da19c by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:27:05.103693 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] Attempting to bind port 419b54cc-ec88-493d-a1d4-a2bb128da19c on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:05.106100 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eecb9649-974e-436c-8c17-750b6eb05a82 None None] Pushing event updated for resources: {'Port': ['ID=419b54cc-ec88-493d-a1d4-a2bb128da19c,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:05.114411 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bb7c0cab-5ba1-4a34-82e1-1ac8de8d5617 req-5a6c6969-00fe-4072-bc56-0cf4fddc514f tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:05.124484 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 26, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:27:05.124969 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:27:05.125668 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:05.126222 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:27:05.126864 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] Bound port: 419b54cc-ec88-493d-a1d4-a2bb128da19c, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:27:05.127760 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:05.141622 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-9ab64d06-931b-4541-88dc-e2dda6ac1832 req-95e7fe03-4ad5-41dc-a7d6-58803f012b27 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] No DVR routers for this DVR port 78afd497-51cf-40c2-9eaf-ee2f42951961 on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:27:05.162022 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9ab64d06-931b-4541-88dc-e2dda6ac1832 req-95e7fe03-4ad5-41dc-a7d6-58803f012b27 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:05.166807 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9ab64d06-931b-4541-88dc-e2dda6ac1832 req-95e7fe03-4ad5-41dc-a7d6-58803f012b27 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.10 "DELETE /v2.0/ports/78afd497-51cf-40c2-9eaf-ee2f42951961 HTTP/1.1" status: 204 len: 173 time: 2.4341643 Dec 09 21:27:05.167318 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a0e7c231-5917-4aec-89da-a4a946e66c69', 'name': 'network-vif-deleted', 'tag': '78afd497-51cf-40c2-9eaf-ee2f42951961'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:27:05.168513 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d5ae977d-5b74-45db-af93-d48de83eda5a req-b0ff1279-2504-4ed9-86de-5b46d3de1447 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] 10.222.0.13 "GET /v2.0/security-groups?id=311d4b92-14f8-4511-8f88-1dc905946c73&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1330717 Dec 09 21:27:05.170138 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fdecc413-d378-4803-8a7b-a641fa1b4cb3" -d '{"events": [{"server_uuid": "a0e7c231-5917-4aec-89da-a4a946e66c69", "name": "network-vif-deleted", "tag": "78afd497-51cf-40c2-9eaf-ee2f42951961"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:27:05.199100 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee451170-1fd9-4ad7-961f-b9ac428bf383 req-5755c576-9493-4932-b3d9-69bc3e380228 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:05.200693 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ee451170-1fd9-4ad7-961f-b9ac428bf383 req-5755c576-9493-4932-b3d9-69bc3e380228 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=9ca15fab17f34cc58f1ad1fcedc1bf31&device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 1096 time: 0.1385713 Dec 09 21:27:05.205404 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 058ec1cc-1cd2-44ec-93de-4557c5dd65de no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:27:05.211608 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-771990fa-dfa5-494e-a062-17c97bfbde17 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:05.298529 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] For port 419b54cc-ec88-493d-a1d4-a2bb128da19c, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:27:05.305163 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] For port 419b54cc-ec88-493d-a1d4-a2bb128da19c, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=419b54cc-ec88-493d-a1d4-a2bb128da19c,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:27:05.312563 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:05.384162 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-c1839cff-c3d4-4f63-97a7-28c4e6cf1b8d None None] Set router 48f26966-6ebd-4ded-9b83-e7fdb71c4bf7 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:27:05.386067 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee451170-1fd9-4ad7-961f-b9ac428bf383 req-d2f17618-ffc3-4fc1-814b-6a45f124c847 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:05.386670 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ee451170-1fd9-4ad7-961f-b9ac428bf383 req-d2f17618-ffc3-4fc1-814b-6a45f124c847 service neutron] 10.222.0.10 "GET /v2.0/networks?id=e7d3d836-ebe9-4e03-af4b-235dd5e5cbea HTTP/1.1" status: 200 len: 912 time: 0.1763511 Dec 09 21:27:05.390756 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bb7c0cab-5ba1-4a34-82e1-1ac8de8d5617 req-5a6c6969-00fe-4072-bc56-0cf4fddc514f tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:05.396069 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bb7c0cab-5ba1-4a34-82e1-1ac8de8d5617 req-5a6c6969-00fe-4072-bc56-0cf4fddc514f tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:05.396343 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] Routers {'f2b3fc08-9e60-4600-9a8b-7400a9e940a0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:27:05.396789 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:26:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f2b3fc08-9e60-4600-9a8b-7400a9e940a0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:05.398038 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bb7c0cab-5ba1-4a34-82e1-1ac8de8d5617 req-5a6c6969-00fe-4072-bc56-0cf4fddc514f tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "DELETE /v2.0/security-groups/2532bd8f-3548-430a-8273-6cdaee201c51 HTTP/1.1" status: 204 len: 173 time: 0.4823868 Dec 09 21:27:05.462448 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-771990fa-dfa5-494e-a062-17c97bfbde17 admin admin] Allocated IP 172.20.0.1 (f0373886-3db8-47eb-af65-78244497171e/65df7637-0210-4526-a5dd-a692c26062b4/07784993-5ed4-492f-8151-3e60e91832c1) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:27:05.478198 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a6c6969-00fe-4072-bc56-0cf4fddc514f tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=2532bd8f-3548-430a-8273-6cdaee201c51,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:05.481904 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ee451170-1fd9-4ad7-961f-b9ac428bf383 req-9e7d95c6-ceff-4e22-bfae-0d4d6a6f833c service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=4479e7ab-f0ee-45ff-a040-76f4dd53237f HTTP/1.1" status: 200 len: 217 time: 0.0747416 Dec 09 21:27:05.496144 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:27:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-513d8ae0-8826-4a8d-9047-a7fb6e8ec038 x-openstack-request-id: req-513d8ae0-8826-4a8d-9047-a7fb6e8ec038 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:27:05.496498 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a0e7c231-5917-4aec-89da-a4a946e66c69", "name": "network-vif-deleted", "tag": "78afd497-51cf-40c2-9eaf-ee2f42951961", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:27:05.496920 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-513d8ae0-8826-4a8d-9047-a7fb6e8ec038 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:27:05.497808 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a0e7c231-5917-4aec-89da-a4a946e66c69', 'name': 'network-vif-deleted', 'tag': '78afd497-51cf-40c2-9eaf-ee2f42951961', 'status': 'completed', 'code': 200} Dec 09 21:27:05.506504 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45a58608-e5ba-44a4-b3df-5ed57798eaa7 req-6691110c-7dbd-4cd6-afe1-0a771ba473cf tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:05.507545 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-45a58608-e5ba-44a4-b3df-5ed57798eaa7 req-6691110c-7dbd-4cd6-afe1-0a771ba473cf tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 944 time: 0.1192796 Dec 09 21:27:05.629082 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee451170-1fd9-4ad7-961f-b9ac428bf383 req-be33cc0f-80c3-40c1-a770-8208b8ee45e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:05.630601 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ee451170-1fd9-4ad7-961f-b9ac428bf383 req-be33cc0f-80c3-40c1-a770-8208b8ee45e5 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=a84d1123-6651-4f35-9cba-4f9c8f45aab6 HTTP/1.1" status: 200 len: 851 time: 0.1336427 Dec 09 21:27:05.648603 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] Set router f2b3fc08-9e60-4600-9a8b-7400a9e940a0 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:27:05.655621 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-45a58608-e5ba-44a4-b3df-5ed57798eaa7 req-430c74f5-8e89-4238-a273-22b7924adec3 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1357417 Dec 09 21:27:05.674963 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:05.676807 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-34e26018-e968-4552-9a9c-0ef87649e487 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:05.702222 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-771990fa-dfa5-494e-a062-17c97bfbde17 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:05.723943 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ee451170-1fd9-4ad7-961f-b9ac428bf383 req-12835af0-0200-430f-8f7e-50275c7e6e93 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=e7d3d836-ebe9-4e03-af4b-235dd5e5cbea&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0627542 Dec 09 21:27:05.742595 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eecb9649-974e-436c-8c17-750b6eb05a82 None None] Pushing event updated for resources: {'Port': ['ID=419b54cc-ec88-493d-a1d4-a2bb128da19c,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:05.767154 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-566568dd-2c09-488f-a4ab-7637a99f0f19 req-a4ac0424-63e6-4a00-a806-d5cf6f970854 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:05.769070 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-566568dd-2c09-488f-a4ab-7637a99f0f19 req-a4ac0424-63e6-4a00-a806-d5cf6f970854 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 945 time: 0.2053552 Dec 09 21:27:05.772411 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-c297cb6a-b1a0-425d-bf01-7cc4d90335f7 req-23ad0fd4-614c-462e-a9c6-2285fbefcdeb tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] show failed (client error): The resource could not be found. Dec 09 21:27:05.773249 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c297cb6a-b1a0-425d-bf01-7cc4d90335f7 req-23ad0fd4-614c-462e-a9c6-2285fbefcdeb tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/2532bd8f-3548-430a-8273-6cdaee201c51 HTTP/1.1" status: 404 len: 352 time: 0.0484216 Dec 09 21:27:05.815967 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-771990fa-dfa5-494e-a062-17c97bfbde17 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:05.842139 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 058ec1cc-1cd2-44ec-93de-4557c5dd65de, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=058ec1cc-1cd2-44ec-93de-4557c5dd65de,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:05.860957 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:05.881533 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-771990fa-dfa5-494e-a062-17c97bfbde17 admin admin] Network f0373886-3db8-47eb-af65-78244497171e is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:27:05.886981 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-771990fa-dfa5-494e-a062-17c97bfbde17 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:05.892520 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-771990fa-dfa5-494e-a062-17c97bfbde17 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:27:05.896247 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-771990fa-dfa5-494e-a062-17c97bfbde17 admin admin] Pushing event updated for resources: {'Port': ['ID=07784993-5ed4-492f-8151-3e60e91832c1,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:05.951086 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-771990fa-dfa5-494e-a062-17c97bfbde17 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:05.969304 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'name': 'tempest-TaggedBootDevicesTest-1896005035-router', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127'}], 'enable_snat': True}, 'gw_port_id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:00Z', 'updated_at': '2021-12-09T21:27:02Z', 'revision_number': 3, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'gw_port': {'id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a1:90:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1069, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:01Z', 'updated_at': '2021-12-09T21:27:05Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:05.992981 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-566568dd-2c09-488f-a4ab-7637a99f0f19 req-de06bbf2-d3cb-4374-b682-2e1dd8b496fd tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2172427 Dec 09 21:27:06.008290 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=058ec1cc-1cd2-44ec-93de-4557c5dd65de,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:06.028942 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b096ba7-05ac-4958-a863-a489ea75c19d None None] The sync data for ids ['f2b3fc08-9e60-4600-9a8b-7400a9e940a0'] in n-d-713301-27 is: [{'id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'name': 'tempest-TaggedBootDevicesTest-1896005035-router', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127'}], 'enable_snat': True}, 'gw_port_id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:00Z', 'updated_at': '2021-12-09T21:27:02Z', 'revision_number': 3, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'gw_port': {'id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a1:90:41', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1069, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:01Z', 'updated_at': '2021-12-09T21:27:05Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:27:06.048926 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:27:06.117083 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a45aee8c-1ead-4182-81dd-72688d980ba4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c3c31744-0580-4d09-863d-697769f7c0ee'}, {'server_uuid': 'e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '058ec1cc-1cd2-44ec-93de-4557c5dd65de'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:27:06.119584 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a6787752-7b46-49f2-8b41-c0adb3313650" -d '{"events": [{"server_uuid": "a45aee8c-1ead-4182-81dd-72688d980ba4", "name": "network-vif-plugged", "status": "completed", "tag": "c3c31744-0580-4d09-863d-697769f7c0ee"}, {"server_uuid": "e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f", "name": "network-vif-unplugged", "status": "completed", "tag": "058ec1cc-1cd2-44ec-93de-4557c5dd65de"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:27:06.130472 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ee451170-1fd9-4ad7-961f-b9ac428bf383 req-50dd476d-8932-494b-8222-8934df6a85cc service neutron] 10.222.0.10 "GET /v2.0/networks/e7d3d836-ebe9-4e03-af4b-235dd5e5cbea?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3937407 Dec 09 21:27:06.139995 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-5855582d-eb00-4c22-b1b2-eeb9267d9308 req-6c686b48-39d5-4e5e-b520-b724c27cbbda tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupsTestJSON-securitygroup-1877179986', 'description': 'tempest-description-1598791272'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:06.145441 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-c1839cff-c3d4-4f63-97a7-28c4e6cf1b8d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'name': 'tempest-ServersTestFqdnHostnames-1853275289-router', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149'}], 'enable_snat': True}, 'gw_port_id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:32Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'gw_port': {'id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:92:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 809, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:33Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '0c3b6cc8-3628-4374-be2a-ae9bb603880e', 'name': '', 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'mac_address': 'fa:16:3e:01:4d:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 813, 'fixed_ips': [{'subnet_id': '9125b460-598b-4793-bfb4-08b07155042a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:39Z', 'updated_at': '2021-12-09T21:24:50Z', 'revision_number': 5, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'subnets': [{'id': '9125b460-598b-4793-bfb4-08b07155042a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:06.175586 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1839cff-c3d4-4f63-97a7-28c4e6cf1b8d None None] Checking router: 48f26966-6ebd-4ded-9b83-e7fdb71c4bf7 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:27:06.184852 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1839cff-c3d4-4f63-97a7-28c4e6cf1b8d None None] Routers {'48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:27:06.185567 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-c1839cff-c3d4-4f63-97a7-28c4e6cf1b8d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:27:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:06.205360 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-771990fa-dfa5-494e-a062-17c97bfbde17 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:06.218069 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79774832-db5e-4b77-9b06-0860d5f49455 req-8c1218a9-e8bd-46b3-914a-75b7dadbf5b1 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:06.228926 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-79774832-db5e-4b77-9b06-0860d5f49455 req-8c1218a9-e8bd-46b3-914a-75b7dadbf5b1 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=a45aee8c-1ead-4182-81dd-72688d980ba4 HTTP/1.1" status: 200 len: 950 time: 0.2077997 Dec 09 21:27:06.283996 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 4479e7ab-f0ee-45ff-a040-76f4dd53237f details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:27:06.339025 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-c1839cff-c3d4-4f63-97a7-28c4e6cf1b8d None None] Set router 48f26966-6ebd-4ded-9b83-e7fdb71c4bf7 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:27:06.347635 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ee451170-1fd9-4ad7-961f-b9ac428bf383 req-addc110b-f768-4fea-a310-a5b6bbe9e879 service neutron] 10.222.0.10 "GET /v2.0/networks/e7d3d836-ebe9-4e03-af4b-235dd5e5cbea?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1817949 Dec 09 21:27:06.354045 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5855582d-eb00-4c22-b1b2-eeb9267d9308 req-6c686b48-39d5-4e5e-b520-b724c27cbbda tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:06.376130 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3a5be433-d1f6-4722-8036-2420b7d15828 None None] Provisioning complete for port 07784993-5ed4-492f-8151-3e60e91832c1 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:06.391295 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3a5be433-d1f6-4722-8036-2420b7d15828 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:06.409673 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-79774832-db5e-4b77-9b06-0860d5f49455 req-83ab4ce7-e79e-4a1d-93b8-35fb2ccf2bce tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1797574 Dec 09 21:27:06.475877 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-771990fa-dfa5-494e-a062-17c97bfbde17 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:06.483985 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-771990fa-dfa5-494e-a062-17c97bfbde17 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:06.504433 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5855582d-eb00-4c22-b1b2-eeb9267d9308 req-6c686b48-39d5-4e5e-b520-b724c27cbbda tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:06.510794 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5855582d-eb00-4c22-b1b2-eeb9267d9308 req-6c686b48-39d5-4e5e-b520-b724c27cbbda tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:06.533759 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5855582d-eb00-4c22-b1b2-eeb9267d9308 req-6c686b48-39d5-4e5e-b520-b724c27cbbda tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:06.548367 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5855582d-eb00-4c22-b1b2-eeb9267d9308 req-6c686b48-39d5-4e5e-b520-b724c27cbbda tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1825 time: 0.4377263 Dec 09 21:27:06.597314 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c686b48-39d5-4e5e-b520-b724c27cbbda tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event updated for resources: {'SecurityGroup': ['ID=77bbf48d-463a-47f1-ac08-a895b61ca313,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:06.605380 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-771990fa-dfa5-494e-a062-17c97bfbde17 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:06.616521 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-771990fa-dfa5-494e-a062-17c97bfbde17 admin admin] Pushing event updated for resources: {'Port': ['ID=07784993-5ed4-492f-8151-3e60e91832c1,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:06.632265 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 4479e7ab-f0ee-45ff-a040-76f4dd53237f, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=4479e7ab-f0ee-45ff-a040-76f4dd53237f,segment=NetworkSegment(6bb6d7a7-737b-46b2-b463-0bc25081f6ef),segment_id=6bb6d7a7-737b-46b2-b463-0bc25081f6ef)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:06.694741 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:06.772563 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-771990fa-dfa5-494e-a062-17c97bfbde17 admin admin] Network f0373886-3db8-47eb-af65-78244497171e is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:27:06.784508 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 356 Content-Type: application/json Date: Thu, 09 Dec 2021 21:27:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d0960eeb-5e78-4686-a9bc-da90de62b4ce x-openstack-request-id: req-d0960eeb-5e78-4686-a9bc-da90de62b4ce {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:27:06.784808 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a45aee8c-1ead-4182-81dd-72688d980ba4", "name": "network-vif-plugged", "status": "completed", "tag": "c3c31744-0580-4d09-863d-697769f7c0ee", "code": 200}, {"server_uuid": "e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f", "name": "network-vif-unplugged", "status": "completed", "tag": "058ec1cc-1cd2-44ec-93de-4557c5dd65de", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:27:06.785060 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-d0960eeb-5e78-4686-a9bc-da90de62b4ce {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:27:06.785451 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a45aee8c-1ead-4182-81dd-72688d980ba4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c3c31744-0580-4d09-863d-697769f7c0ee', 'code': 200} Dec 09 21:27:06.785703 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '058ec1cc-1cd2-44ec-93de-4557c5dd65de', 'code': 200} Dec 09 21:27:06.788403 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-771990fa-dfa5-494e-a062-17c97bfbde17 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:06.797789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-3a5be433-d1f6-4722-8036-2420b7d15828 None None] Port 07784993-5ed4-492f-8151-3e60e91832c1 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:27:06.808785 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '4479e7ab-f0ee-45ff-a040-76f4dd53237f', 'network_id': 'e7d3d836-ebe9-4e03-af4b-235dd5e5cbea', 'port_id': '4479e7ab-f0ee-45ff-a040-76f4dd53237f', 'mac_address': 'fa:16:3e:75:18:85', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 102, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a84d1123-6651-4f35-9cba-4f9c8f45aab6', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:27:06.903076 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-556ab58d-53ce-4e24-931e-618203d49bf8 req-c9fec443-d3ab-4b73-a194-2cca9d161d5b tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:06.904748 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-556ab58d-53ce-4e24-931e-618203d49bf8 req-c9fec443-d3ab-4b73-a194-2cca9d161d5b tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 0.2989788 Dec 09 21:27:06.930225 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-391d998d-9161-4ee6-bfa8-f60da4bcc33d req-09cb86e2-4a96-429c-93d5-0bf3122d0791 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:06.932242 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-391d998d-9161-4ee6-bfa8-f60da4bcc33d req-09cb86e2-4a96-429c-93d5-0bf3122d0791 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=a45aee8c-1ead-4182-81dd-72688d980ba4 HTTP/1.1" status: 200 len: 1102 time: 0.2366216 Dec 09 21:27:06.951935 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:06.959195 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88c3f64f-07fc-4b15-9149-32e60b1b2607 req-2d11ed45-2e23-4743-928f-468ac6305042 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:06.961130 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-88c3f64f-07fc-4b15-9149-32e60b1b2607 req-2d11ed45-2e23-4743-928f-468ac6305042 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] 10.222.0.13 "GET /v2.0/ports?device_id=b47d322e-d75b-4899-be48-dd276a4cdf7e HTTP/1.1" status: 200 len: 945 time: 0.1901159 Dec 09 21:27:06.992592 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4479e7ab-f0ee-45ff-a040-76f4dd53237f {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:27:07.027086 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-771990fa-dfa5-494e-a062-17c97bfbde17 admin admin] Router f2b3fc08-9e60-4600-9a8b-7400a9e940a0 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:27:07.075323 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-c1839cff-c3d4-4f63-97a7-28c4e6cf1b8d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'name': 'tempest-ServersTestFqdnHostnames-1853275289-router', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149'}], 'enable_snat': True}, 'gw_port_id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:32Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'gw_port': {'id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:92:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 809, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:33Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '0c3b6cc8-3628-4374-be2a-ae9bb603880e', 'name': '', 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'mac_address': 'fa:16:3e:01:4d:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 813, 'fixed_ips': [{'subnet_id': '9125b460-598b-4793-bfb4-08b07155042a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:39Z', 'updated_at': '2021-12-09T21:24:50Z', 'revision_number': 5, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'subnets': [{'id': '9125b460-598b-4793-bfb4-08b07155042a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:07.083389 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 4479e7ab-f0ee-45ff-a040-76f4dd53237f, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=4479e7ab-f0ee-45ff-a040-76f4dd53237f,segment=NetworkSegment(6bb6d7a7-737b-46b2-b463-0bc25081f6ef),segment_id=6bb6d7a7-737b-46b2-b463-0bc25081f6ef)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:07.089687 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-556ab58d-53ce-4e24-931e-618203d49bf8 req-cf01aad7-cdd3-4267-b3d8-4970c6790c8f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1591451 Dec 09 21:27:07.159724 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:07.162232 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1839cff-c3d4-4f63-97a7-28c4e6cf1b8d None None] The sync data for ids ['48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'] in n-d-713301-27 is: [{'id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'name': 'tempest-ServersTestFqdnHostnames-1853275289-router', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149'}], 'enable_snat': True}, 'gw_port_id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:32Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'gw_port': {'id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:92:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 809, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:33Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '0c3b6cc8-3628-4374-be2a-ae9bb603880e', 'name': '', 'network_id': 'ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'mac_address': 'fa:16:3e:01:4d:1c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 813, 'fixed_ips': [{'subnet_id': '9125b460-598b-4793-bfb4-08b07155042a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:39Z', 'updated_at': '2021-12-09T21:24:50Z', 'revision_number': 5, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'subnets': [{'id': '9125b460-598b-4793-bfb4-08b07155042a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:27:07.228156 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-c2d33793-9929-48c6-a24d-63060f4e1de1 req-1ebd8618-5673-4c98-a85a-b328c3363688 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupsTestJSON-securitygroup-519806691', 'description': 'tempest-description-176038690'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:07.273822 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40084) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:07.332058 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-88c3f64f-07fc-4b15-9149-32e60b1b2607 req-464d8562-223c-4251-bd95-867d9c78d55e tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] 10.222.0.13 "GET /v2.0/security-groups?id=311d4b92-14f8-4511-8f88-1dc905946c73&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3626440 Dec 09 21:27:07.352761 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c2d33793-9929-48c6-a24d-63060f4e1de1 req-1ebd8618-5673-4c98-a85a-b328c3363688 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:07.374521 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-eb73887b-686a-446f-8b3c-080a78a551fd None None] Provisioning complete for port 07784993-5ed4-492f-8151-3e60e91832c1 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:07.374888 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb73887b-686a-446f-8b3c-080a78a551fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:07.376918 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-391d998d-9161-4ee6-bfa8-f60da4bcc33d req-b91b29cf-7472-49c8-9aa2-2892815a5ed2 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4329181 Dec 09 21:27:07.380524 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=4479e7ab-f0ee-45ff-a040-76f4dd53237f,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:07.442638 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['4479e7ab-f0ee-45ff-a040-76f4dd53237f'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:27:07.472777 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2920d53-7d53-4784-84f0-6a5019195ff9 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:07.516678 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-eb73887b-686a-446f-8b3c-080a78a551fd None None] Port 07784993-5ed4-492f-8151-3e60e91832c1 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:27:07.628689 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2920d53-7d53-4784-84f0-6a5019195ff9 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:07.706404 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86c7bf1e-cf25-4d2b-939a-6c0b0b1c9f6f req-e5c131c9-21e0-40eb-832a-66b285d0f9d5 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:07.710254 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86c7bf1e-cf25-4d2b-939a-6c0b0b1c9f6f req-e5c131c9-21e0-40eb-832a-66b285d0f9d5 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 945 time: 0.2478817 Dec 09 21:27:07.741795 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b79f9449-cfdf-4fee-a0f5-09dbc8a6ae32 None None] New status for floating IP 1b4b1e21-9999-439a-b529-4d84581ab707: DOWN {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:27:07.837951 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c2d33793-9929-48c6-a24d-63060f4e1de1 req-1ebd8618-5673-4c98-a85a-b328c3363688 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:07.841684 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2920d53-7d53-4784-84f0-6a5019195ff9 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:07.846238 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2920d53-7d53-4784-84f0-6a5019195ff9 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:07.848001 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d2920d53-7d53-4784-84f0-6a5019195ff9 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "DELETE /v2.0/security-groups/4aaea988-139c-4402-b4d7-14ee4ed56291 HTTP/1.1" status: 204 len: 168 time: 0.5723391 Dec 09 21:27:07.850613 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-771990fa-dfa5-494e-a062-17c97bfbde17 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:27:07.852805 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40090) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:07.861197 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86c7bf1e-cf25-4d2b-939a-6c0b0b1c9f6f req-144a3d71-cc9d-4dc4-9147-8fb7070c40f4 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1402774 Dec 09 21:27:07.861823 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c2d33793-9929-48c6-a24d-63060f4e1de1 req-1ebd8618-5673-4c98-a85a-b328c3363688 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:07.873867 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2920d53-7d53-4784-84f0-6a5019195ff9 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4aaea988-139c-4402-b4d7-14ee4ed56291,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:07.891252 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-771990fa-dfa5-494e-a062-17c97bfbde17 admin admin] 10.222.0.13 "PUT /v2.0/routers/f2b3fc08-9e60-4600-9a8b-7400a9e940a0/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.9837668 Dec 09 21:27:07.910908 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:07.911966 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-7238b02b-b821-455e-838b-29dea86c424e tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] show failed (client error): The resource could not be found. Dec 09 21:27:07.913569 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7238b02b-b821-455e-838b-29dea86c424e tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "GET /v2.0/security-groups/4aaea988-139c-4402-b4d7-14ee4ed56291 HTTP/1.1" status: 404 len: 347 time: 0.0591342 Dec 09 21:27:07.916359 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40094) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:07.940725 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c2d33793-9929-48c6-a24d-63060f4e1de1 req-1ebd8618-5673-4c98-a85a-b328c3363688 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:07.954313 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c2d33793-9929-48c6-a24d-63060f4e1de1 req-1ebd8618-5673-4c98-a85a-b328c3363688 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1823 time: 0.7393932 Dec 09 21:27:07.965011 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ebd8618-5673-4c98-a85a-b328c3363688 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f13bda71-a22a-40d5-8623-6019230ec2f2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:08.068309 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 419b54cc-ec88-493d-a1d4-a2bb128da19c up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:08.140105 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 419b54cc-ec88-493d-a1d4-a2bb128da19c triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:08.140363 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:08.161292 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69da365d-560e-45e5-9802-4a0894db32c2 req-2b3c58aa-9e74-4d4c-8f6f-69d2bda31415 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:08.164379 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69da365d-560e-45e5-9802-4a0894db32c2 req-2b3c58aa-9e74-4d4c-8f6f-69d2bda31415 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 943 time: 0.1245143 Dec 09 21:27:08.196941 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c78c4700-81b5-4ccc-9fda-8a48f2f6ed21 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Deleting port e1a65c12-f2dd-4a5f-b3f3-e42bd0c43d20 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:27:08.197538 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c78c4700-81b5-4ccc-9fda-8a48f2f6ed21 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:08.275011 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69da365d-560e-45e5-9802-4a0894db32c2 req-7ca9058f-13b9-46c1-b073-2201eed68eb3 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1032028 Dec 09 21:27:08.290455 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26fece9d-5247-4864-a207-42cecd4a4936 req-7a9a6061-85e6-44e4-951e-6f679337a614 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:08.292633 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-26fece9d-5247-4864-a207-42cecd4a4936 req-7a9a6061-85e6-44e4-951e-6f679337a614 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=a45aee8c-1ead-4182-81dd-72688d980ba4 HTTP/1.1" status: 200 len: 950 time: 0.1242719 Dec 09 21:27:08.331676 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:08.339075 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 4479e7ab-f0ee-45ff-a040-76f4dd53237f up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:08.348929 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-3847406c-14cd-4a83-a568-b5ffb1b558fa req-b9e99bb6-dadc-43ee-b360-40322043bb56 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupsTestJSON-securitygroup-1298182236', 'description': 'tempest-description-1742670455'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:08.373489 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c78c4700-81b5-4ccc-9fda-8a48f2f6ed21 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:08.373791 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c78c4700-81b5-4ccc-9fda-8a48f2f6ed21 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:08.391868 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c78c4700-81b5-4ccc-9fda-8a48f2f6ed21 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Calling delete_port for e1a65c12-f2dd-4a5f-b3f3-e42bd0c43d20 owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:27:08.419878 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-26fece9d-5247-4864-a207-42cecd4a4936 req-8d9b18b3-37c4-4e7d-8c96-0ff4b9f1dd41 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1046593 Dec 09 21:27:08.420972 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3847406c-14cd-4a83-a568-b5ffb1b558fa req-b9e99bb6-dadc-43ee-b360-40322043bb56 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:08.430037 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 419b54cc-ec88-493d-a1d4-a2bb128da19c, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=419b54cc-ec88-493d-a1d4-a2bb128da19c,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:08.445193 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:08.574777 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 4479e7ab-f0ee-45ff-a040-76f4dd53237f completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:27:08.594822 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 4479e7ab-f0ee-45ff-a040-76f4dd53237f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:08.595207 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:08.650425 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3847406c-14cd-4a83-a568-b5ffb1b558fa req-b9e99bb6-dadc-43ee-b360-40322043bb56 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:08.686187 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=419b54cc-ec88-493d-a1d4-a2bb128da19c,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:08.696437 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c78c4700-81b5-4ccc-9fda-8a48f2f6ed21 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:08.749024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c78c4700-81b5-4ccc-9fda-8a48f2f6ed21 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Pushing event deleted for resources: {'Port': ['ID=e1a65c12-f2dd-4a5f-b3f3-e42bd0c43d20,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:08.810740 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:08.824336 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] Sync routers for ids ['f2b3fc08-9e60-4600-9a8b-7400a9e940a0'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:27:08.855034 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40118) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:08.856519 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5c7a3543-1d7f-4fd2-a53f-511ae0a4074d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4479e7ab-f0ee-45ff-a040-76f4dd53237f'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:27:08.859216 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e24b2445-1efa-41a1-bc35-e2adcfbee27a" -d '{"events": [{"server_uuid": "5c7a3543-1d7f-4fd2-a53f-511ae0a4074d", "name": "network-vif-plugged", "status": "completed", "tag": "4479e7ab-f0ee-45ff-a040-76f4dd53237f"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:27:08.870452 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] Routers {'f2b3fc08-9e60-4600-9a8b-7400a9e940a0'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:27:08.871106 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:27:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f2b3fc08-9e60-4600-9a8b-7400a9e940a0'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:08.871629 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-613063f8-7c59-421f-9018-4628c8557369 admin admin] Request body: {'network': {'name': 'tempest-TaggedBootDevicesTest-1740845933-network', 'tenant_id': 'f8441d8d390b442691a162db541a51b0'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:08.877100 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 4479e7ab-f0ee-45ff-a040-76f4dd53237f, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=4479e7ab-f0ee-45ff-a040-76f4dd53237f,segment=NetworkSegment(6bb6d7a7-737b-46b2-b463-0bc25081f6ef),segment_id=6bb6d7a7-737b-46b2-b463-0bc25081f6ef)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:08.908221 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c78c4700-81b5-4ccc-9fda-8a48f2f6ed21 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:08.911409 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c78c4700-81b5-4ccc-9fda-8a48f2f6ed21 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:08.913050 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c78c4700-81b5-4ccc-9fda-8a48f2f6ed21 tempest-ServersTestFqdnHostnames-815870181 tempest-ServersTestFqdnHostnames-815870181-project] 10.222.0.13 "DELETE /v2.0/floatingips/1b4b1e21-9999-439a-b529-4d84581ab707 HTTP/1.1" status: 204 len: 168 time: 0.9953778 Dec 09 21:27:08.916140 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40124) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:08.923758 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-613063f8-7c59-421f-9018-4628c8557369 admin admin] Made reservation on behalf of f8441d8d390b442691a162db541a51b0 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:27:08.926482 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-613063f8-7c59-421f-9018-4628c8557369 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:08.970263 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-613063f8-7c59-421f-9018-4628c8557369 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:09.063026 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3847406c-14cd-4a83-a568-b5ffb1b558fa req-b9e99bb6-dadc-43ee-b360-40322043bb56 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:09.093668 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:09.094469 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 78afd497-51cf-40c2-9eaf-ee2f42951961 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:27:09.108741 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3847406c-14cd-4a83-a568-b5ffb1b558fa req-b9e99bb6-dadc-43ee-b360-40322043bb56 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:09.109983 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3847406c-14cd-4a83-a568-b5ffb1b558fa req-b9e99bb6-dadc-43ee-b360-40322043bb56 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1825 time: 0.7684550 Dec 09 21:27:09.111405 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9e99bb6-dadc-43ee-b360-40322043bb56 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1cc4844b-f1c9-4751-b1a6-ddc43fd1f320,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:09.129261 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61c41a3b-9b8f-4d0e-9e7e-744a79a95ec3 req-3cce4b36-6d48-48a8-8ae2-972d67be38e7 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:09.131840 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-61c41a3b-9b8f-4d0e-9e7e-744a79a95ec3 req-3cce4b36-6d48-48a8-8ae2-972d67be38e7 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 0.5113859 Dec 09 21:27:09.143897 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 78afd497-51cf-40c2-9eaf-ee2f42951961 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:27:09.143897 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 78afd497-51cf-40c2-9eaf-ee2f42951961 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:27:09.190553 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-61c41a3b-9b8f-4d0e-9e7e-744a79a95ec3 req-4e34b10c-603e-422d-a2db-772693c18b22 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501134 Dec 09 21:27:09.198385 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-613063f8-7c59-421f-9018-4628c8557369 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:09.209249 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-613063f8-7c59-421f-9018-4628c8557369 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:09.211591 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 058ec1cc-1cd2-44ec-93de-4557c5dd65de no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:27:09.221023 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-613063f8-7c59-421f-9018-4628c8557369 admin admin] vlan segment allocate from pool success with {'vlan_id': 113, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:27:09.230849 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-613063f8-7c59-421f-9018-4628c8557369 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:09.231302 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-613063f8-7c59-421f-9018-4628c8557369 admin admin] Added segment cba73bdd-55aa-420b-957f-16ad6c3beaed of type vlan for network fc8cdf15-d749-4170-8af1-e4f121fd1c72 Dec 09 21:27:09.258842 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=4479e7ab-f0ee-45ff-a040-76f4dd53237f,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:09.324299 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-613063f8-7c59-421f-9018-4628c8557369 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:09.328505 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-613063f8-7c59-421f-9018-4628c8557369 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d53dc779-90c9-4258-80f1-e7f29604f817,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:09.381412 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-613063f8-7c59-421f-9018-4628c8557369 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:09.382423 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-613063f8-7c59-421f-9018-4628c8557369 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:09.383062 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-613063f8-7c59-421f-9018-4628c8557369 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:09.454889 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] Set router f2b3fc08-9e60-4600-9a8b-7400a9e940a0 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:27:09.459140 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:27:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7bb79223-a3b8-49b3-81e3-9dfad7048967 x-openstack-request-id: req-7bb79223-a3b8-49b3-81e3-9dfad7048967 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:27:09.459425 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5c7a3543-1d7f-4fd2-a53f-511ae0a4074d", "name": "network-vif-plugged", "status": "completed", "tag": "4479e7ab-f0ee-45ff-a040-76f4dd53237f", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:27:09.459700 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-7bb79223-a3b8-49b3-81e3-9dfad7048967 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:27:09.460100 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5c7a3543-1d7f-4fd2-a53f-511ae0a4074d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4479e7ab-f0ee-45ff-a040-76f4dd53237f', 'code': 200} Dec 09 21:27:09.476163 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-613063f8-7c59-421f-9018-4628c8557369 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.6199706 Dec 09 21:27:09.478922 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40142) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:09.484033 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-85122548-bc63-4afb-bfda-2427f0b11bca admin admin] Request body: {'subnet': {'network_id': 'fc8cdf15-d749-4170-8af1-e4f121fd1c72', 'cidr': '172.20.0.0/28', 'name': 'tempest-TaggedBootDevicesTest-1740845933-subnet', 'tenant_id': 'f8441d8d390b442691a162db541a51b0', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:09.491493 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-613063f8-7c59-421f-9018-4628c8557369 admin admin] Pushing event updated for resources: {'Network': ['ID=fc8cdf15-d749-4170-8af1-e4f121fd1c72,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:09.510655 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network fc8cdf15-d749-4170-8af1-e4f121fd1c72 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:27:09.528119 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-85122548-bc63-4afb-bfda-2427f0b11bca admin admin] Made reservation on behalf of f8441d8d390b442691a162db541a51b0 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:27:09.530914 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-85122548-bc63-4afb-bfda-2427f0b11bca admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:09.649748 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3446e805-6c9d-42b4-9ffd-308ffbf84970 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:09.663164 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:09.717665 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b412eb1-c1ab-47f9-ab00-8648c5a6aecc req-3b99a714-f8b0-4917-b120-b05fdd3e901a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:09.718783 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b412eb1-c1ab-47f9-ab00-8648c5a6aecc req-3b99a714-f8b0-4917-b120-b05fdd3e901a service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 1098 time: 0.1840200 Dec 09 21:27:09.730628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d27ff8b4-95a9-4517-8452-9b09db784216 req-eb8c4598-e444-4033-bc28-71c016d0b902 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:09.732710 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d27ff8b4-95a9-4517-8452-9b09db784216 req-eb8c4598-e444-4033-bc28-71c016d0b902 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.1663337 Dec 09 21:27:09.804846 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'name': 'tempest-TaggedBootDevicesTest-1896005035-router', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127'}], 'enable_snat': True}, 'gw_port_id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:00Z', 'updated_at': '2021-12-09T21:27:06Z', 'revision_number': 4, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'gw_port': {'id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a1:90:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1069, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:01Z', 'updated_at': '2021-12-09T21:27:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '07784993-5ed4-492f-8151-3e60e91832c1', 'name': '', 'network_id': 'f0373886-3db8-47eb-af65-78244497171e', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'mac_address': 'fa:16:3e:31:30:c3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'device_owner': 'network:router_interface', 'standard_attr_id': 1073, 'fixed_ips': [{'subnet_id': '65df7637-0210-4526-a5dd-a692c26062b4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:05Z', 'updated_at': '2021-12-09T21:27:06Z', 'revision_number': 2, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'subnets': [{'id': '65df7637-0210-4526-a5dd-a692c26062b4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:09.841244 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] Checking router: f2b3fc08-9e60-4600-9a8b-7400a9e940a0 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:27:09.841850 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] Updating router f2b3fc08-9e60-4600-9a8b-7400a9e940a0 port 07784993-5ed4-492f-8151-3e60e91832c1 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:27:09.874468 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:09.904045 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d27ff8b4-95a9-4517-8452-9b09db784216 req-5ba52424-7c68-49f3-8cb5-163b0fd212e7 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1396549 Dec 09 21:27:09.993948 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b412eb1-c1ab-47f9-ab00-8648c5a6aecc req-cab70c46-d8c5-4c0b-81df-6df96c043da5 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2585421 Dec 09 21:27:10.001960 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-85122548-bc63-4afb-bfda-2427f0b11bca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:10.024917 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-015cf181-6609-48b3-86d6-c98138b02aef req-e4161c53-aa10-43c6-a9fe-47d4546134de service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=c7f45d89-875f-4294-9fcb-17f7fc994b3f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1060188 Dec 09 21:27:10.040134 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 419b54cc-ec88-493d-a1d4-a2bb128da19c up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:10.081120 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-3446e805-6c9d-42b4-9ffd-308ffbf84970 admin admin] Deleting port 0c3b6cc8-3628-4374-be2a-ae9bb603880e {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:27:10.081523 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3446e805-6c9d-42b4-9ffd-308ffbf84970 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:10.115787 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85122548-bc63-4afb-bfda-2427f0b11bca admin admin] Checking segment: {'id': 'cba73bdd-55aa-420b-957f-16ad6c3beaed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': 'fc8cdf15-d749-4170-8af1-e4f121fd1c72'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:27:10.116144 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85122548-bc63-4afb-bfda-2427f0b11bca admin admin] Network hostable DHCP agents. Network: fc8cdf15-d749-4170-8af1-e4f121fd1c72, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:27:10.135646 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85122548-bc63-4afb-bfda-2427f0b11bca admin admin] Pushing event updated for resources: {'Subnet': ['ID=feaf79a7-d79d-4e19-b68a-52abdef41e8b,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:10.152080 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 419b54cc-ec88-493d-a1d4-a2bb128da19c triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:10.152653 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:10.181059 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-3446e805-6c9d-42b4-9ffd-308ffbf84970 admin admin] For port 0c3b6cc8-3628-4374-be2a-ae9bb603880e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=0c3b6cc8-3628-4374-be2a-ae9bb603880e,segment=NetworkSegment(51116481-b9d7-45e1-bfed-86b419caae01),segment_id=51116481-b9d7-45e1-bfed-86b419caae01)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:10.181440 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3446e805-6c9d-42b4-9ffd-308ffbf84970 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:10.189806 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85122548-bc63-4afb-bfda-2427f0b11bca admin admin] Network fc8cdf15-d749-4170-8af1-e4f121fd1c72 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:27:10.196516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-3446e805-6c9d-42b4-9ffd-308ffbf84970 admin admin] Calling delete_port for 0c3b6cc8-3628-4374-be2a-ae9bb603880e owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:27:10.210197 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-13e24960-a982-4c66-82f5-fd60ae67eddb req-af261d69-79d3-4269-b3eb-788c7241b7b7 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=5635fb0018b24f538b250cdac6dca9d9 HTTP/1.1" status: 200 len: 11011 time: 0.2382922 Dec 09 21:27:10.244556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0275ef2f-bd9b-470c-b9c8-8efb24fb1a02 req-89fb86a3-1273-440e-a11e-95b61cbb4ca4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:10.246434 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0275ef2f-bd9b-470c-b9c8-8efb24fb1a02 req-89fb86a3-1273-440e-a11e-95b61cbb4ca4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f HTTP/1.1" status: 200 len: 943 time: 0.1279032 Dec 09 21:27:10.252110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-85122548-bc63-4afb-bfda-2427f0b11bca admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, fc8cdf15-d749-4170-8af1-e4f121fd1c72) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:10.283282 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-81b2cd3a-afb8-4c75-a6ac-37f6e602adb0 None None] Network fc8cdf15-d749-4170-8af1-e4f121fd1c72 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:27:10.293484 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-85122548-bc63-4afb-bfda-2427f0b11bca admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:10.294075 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-85122548-bc63-4afb-bfda-2427f0b11bca admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:10.301403 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-13e24960-a982-4c66-82f5-fd60ae67eddb req-50838a22-bf7c-46c8-b817-b6f1af424a58 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9 HTTP/1.1" status: 200 len: 3002 time: 0.0907214 Dec 09 21:27:10.308666 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-015cf181-6609-48b3-86d6-c98138b02aef req-5a111caa-b8e7-42db-99ce-18337370e22d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:10.311001 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-015cf181-6609-48b3-86d6-c98138b02aef req-5a111caa-b8e7-42db-99ce-18337370e22d service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&device_id=c7f45d89-875f-4294-9fcb-17f7fc994b3f HTTP/1.1" status: 200 len: 1102 time: 0.0615492 Dec 09 21:27:10.358803 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-85122548-bc63-4afb-bfda-2427f0b11bca admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.8786478 Dec 09 21:27:10.363770 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40172) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:10.371373 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-9ce10d25-409f-4c9d-9bdd-1fc31642bfe2 admin admin] Request body: {'router': {'name': 'tempest-TaggedBootDevicesTest-1740845933-router', 'tenant_id': 'f8441d8d390b442691a162db541a51b0', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:10.422070 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-13e24960-a982-4c66-82f5-fd60ae67eddb req-e21b6082-6bfc-47f1-92b3-73ab97892864 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9 HTTP/1.1" status: 200 len: 3002 time: 0.1010957 Dec 09 21:27:10.432781 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9ce10d25-409f-4c9d-9bdd-1fc31642bfe2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:10.433826 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9ce10d25-409f-4c9d-9bdd-1fc31642bfe2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:10.439676 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-0275ef2f-bd9b-470c-b9c8-8efb24fb1a02 req-c26fe972-3522-4672-8919-64cfd32454da tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Deleting port 058ec1cc-1cd2-44ec-93de-4557c5dd65de {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:27:10.440011 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0275ef2f-bd9b-470c-b9c8-8efb24fb1a02 req-c26fe972-3522-4672-8919-64cfd32454da tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:10.460979 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:10.488062 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:10.501401 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6c36d31d-cc43-469a-946e-4be66d636161 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-fc8cdf15-d749-4170-8af1-e4f121fd1c72', 'network_id': 'fc8cdf15-d749-4170-8af1-e4f121fd1c72', 'project_id': 'f8441d8d390b442691a162db541a51b0', 'fixed_ips': [{'subnet_id': 'feaf79a7-d79d-4e19-b68a-52abdef41e8b'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:27:10.502338 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6c36d31d-cc43-469a-946e-4be66d636161 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:10.515117 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-015cf181-6609-48b3-86d6-c98138b02aef req-23715808-9471-4c2a-962d-96ec52b5000b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:10.516654 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-015cf181-6609-48b3-86d6-c98138b02aef req-23715808-9471-4c2a-962d-96ec52b5000b service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.1649811 Dec 09 21:27:10.571122 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-727c15c8-4354-49ac-8898-898885ed463d None None] Pushing event updated for resources: {'Port': ['ID=07784993-5ed4-492f-8151-3e60e91832c1,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:10.586859 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-0275ef2f-bd9b-470c-b9c8-8efb24fb1a02 req-c26fe972-3522-4672-8919-64cfd32454da tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] For port 058ec1cc-1cd2-44ec-93de-4557c5dd65de, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=058ec1cc-1cd2-44ec-93de-4557c5dd65de,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:10.587361 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0275ef2f-bd9b-470c-b9c8-8efb24fb1a02 req-c26fe972-3522-4672-8919-64cfd32454da tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:10.602181 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-0275ef2f-bd9b-470c-b9c8-8efb24fb1a02 req-c26fe972-3522-4672-8919-64cfd32454da tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Calling delete_port for 058ec1cc-1cd2-44ec-93de-4557c5dd65de owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:27:10.611928 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-015cf181-6609-48b3-86d6-c98138b02aef req-3f0dfbea-f030-4acd-b00a-cad33fed3c44 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.198&port_id=fd466da6-f506-43e6-9800-156622bd2781 HTTP/1.1" status: 200 len: 217 time: 0.0737159 Dec 09 21:27:10.612653 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3446e805-6c9d-42b4-9ffd-308ffbf84970 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:10.655034 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3446e805-6c9d-42b4-9ffd-308ffbf84970 admin admin] Pushing event deleted for resources: {'Port': ['ID=0c3b6cc8-3628-4374-be2a-ae9bb603880e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:10.729764 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9ce10d25-409f-4c9d-9bdd-1fc31642bfe2 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:10.731977 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-6c36d31d-cc43-469a-946e-4be66d636161 None None] Allocated IP 172.20.0.2 (fc8cdf15-d749-4170-8af1-e4f121fd1c72/feaf79a7-d79d-4e19-b68a-52abdef41e8b/e50fe61d-462c-4e08-9b0a-318666886803) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:27:10.741251 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-015cf181-6609-48b3-86d6-c98138b02aef req-63b9a430-8deb-4bcb-a197-544a07c182ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:10.742735 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-015cf181-6609-48b3-86d6-c98138b02aef req-63b9a430-8deb-4bcb-a197-544a07c182ca service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1214657 Dec 09 21:27:10.744192 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9562025-0635-49b4-9940-21c21a1d8c98 req-f2e7830d-bebe-407a-8438-a701a7c9cf4c tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:10.754198 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a9562025-0635-49b4-9940-21c21a1d8c98 req-f2e7830d-bebe-407a-8438-a701a7c9cf4c tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] 10.222.0.13 "GET /v2.0/ports?device_id=b47d322e-d75b-4899-be48-dd276a4cdf7e HTTP/1.1" status: 200 len: 945 time: 0.1467311 Dec 09 21:27:10.906774 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-416988d2-8fc8-46be-9ca3-c5b4a5bf34ae req-a9420636-b48c-42f1-a25c-06af676a4cdc service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=10aa9750-8504-424a-9c95-af3331c58955&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1531541 Dec 09 21:27:10.920772 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-015cf181-6609-48b3-86d6-c98138b02aef req-cb6a142c-d666-4221-beca-390c3ebc8794 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:10.922976 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-015cf181-6609-48b3-86d6-c98138b02aef req-cb6a142c-d666-4221-beca-390c3ebc8794 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1683686 Dec 09 21:27:10.938705 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a15ab0f8-e48a-4fc1-8d7b-fb06ce39c688 None None] Provisioning complete for port 07784993-5ed4-492f-8151-3e60e91832c1 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:10.939363 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a15ab0f8-e48a-4fc1-8d7b-fb06ce39c688 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:10.975115 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] Attempting to bind port 07784993-5ed4-492f-8151-3e60e91832c1 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:27:10.975843 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] Attempting to bind port 07784993-5ed4-492f-8151-3e60e91832c1 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f5a54e61-4fb1-4afa-9a27-98e2163b0365', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'f0373886-3db8-47eb-af65-78244497171e'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:27:10.976411 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] Attempting to bind port 07784993-5ed4-492f-8151-3e60e91832c1 on network f0373886-3db8-47eb-af65-78244497171e {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:11.012189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 27, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:27:11.012720 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] Checking segment: {'id': 'f5a54e61-4fb1-4afa-9a27-98e2163b0365', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'f0373886-3db8-47eb-af65-78244497171e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:27:11.013657 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:11.014207 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] Bound using segment: {'id': 'f5a54e61-4fb1-4afa-9a27-98e2163b0365', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'f0373886-3db8-47eb-af65-78244497171e'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:27:11.014803 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] Bound port: 07784993-5ed4-492f-8151-3e60e91832c1, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f5a54e61-4fb1-4afa-9a27-98e2163b0365', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'f0373886-3db8-47eb-af65-78244497171e'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:27:11.015399 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:11.039448 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a15ab0f8-e48a-4fc1-8d7b-fb06ce39c688 None None] Port 07784993-5ed4-492f-8151-3e60e91832c1 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:27:11.056533 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6c36d31d-cc43-469a-946e-4be66d636161 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:11.060647 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9ce10d25-409f-4c9d-9bdd-1fc31642bfe2 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:11.069121 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-015cf181-6609-48b3-86d6-c98138b02aef req-cd5f8335-41d4-4805-afb0-7e61f443e588 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0978792 Dec 09 21:27:11.080956 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6c36d31d-cc43-469a-946e-4be66d636161 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:11.093783 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a9562025-0635-49b4-9940-21c21a1d8c98 req-d3278559-983b-43e2-a74b-e99112131c9b tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] 10.222.0.13 "GET /v2.0/security-groups?id=311d4b92-14f8-4511-8f88-1dc905946c73&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3383684 Dec 09 21:27:11.140271 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6c36d31d-cc43-469a-946e-4be66d636161 None None] Network fc8cdf15-d749-4170-8af1-e4f121fd1c72 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:27:11.147630 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-6c36d31d-cc43-469a-946e-4be66d636161 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:11.155099 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] For port 07784993-5ed4-492f-8151-3e60e91832c1, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:27:11.158302 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c36d31d-cc43-469a-946e-4be66d636161 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:27:11.164158 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] For port 07784993-5ed4-492f-8151-3e60e91832c1, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=07784993-5ed4-492f-8151-3e60e91832c1,segment=NetworkSegment(f5a54e61-4fb1-4afa-9a27-98e2163b0365),segment_id=f5a54e61-4fb1-4afa-9a27-98e2163b0365)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:27:11.166582 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c36d31d-cc43-469a-946e-4be66d636161 None None] Pushing event updated for resources: {'Port': ['ID=e50fe61d-462c-4e08-9b0a-318666886803,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:11.181428 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:11.245176 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-015cf181-6609-48b3-86d6-c98138b02aef req-6b48da68-7875-4443-82bb-52db9c9d5fc9 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1473050 Dec 09 21:27:11.262481 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0275ef2f-bd9b-470c-b9c8-8efb24fb1a02 req-c26fe972-3522-4672-8919-64cfd32454da tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:11.272789 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-416988d2-8fc8-46be-9ca3-c5b4a5bf34ae req-c479f864-d4c7-49db-bee1-b5622ea54113 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:11.274824 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-416988d2-8fc8-46be-9ca3-c5b4a5bf34ae req-c479f864-d4c7-49db-bee1-b5622ea54113 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&device_id=10aa9750-8504-424a-9c95-af3331c58955 HTTP/1.1" status: 200 len: 1102 time: 0.2045143 Dec 09 21:27:11.275709 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3446e805-6c9d-42b4-9ffd-308ffbf84970 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:11.301337 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6c36d31d-cc43-469a-946e-4be66d636161 None None] Attempting to bind port e50fe61d-462c-4e08-9b0a-318666886803 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:27:11.302151 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6c36d31d-cc43-469a-946e-4be66d636161 None None] Attempting to bind port e50fe61d-462c-4e08-9b0a-318666886803 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'cba73bdd-55aa-420b-957f-16ad6c3beaed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': 'fc8cdf15-d749-4170-8af1-e4f121fd1c72'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:27:11.302758 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c36d31d-cc43-469a-946e-4be66d636161 None None] Attempting to bind port e50fe61d-462c-4e08-9b0a-318666886803 on network fc8cdf15-d749-4170-8af1-e4f121fd1c72 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:11.312793 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-727c15c8-4354-49ac-8898-898885ed463d None None] Pushing event updated for resources: {'Port': ['ID=07784993-5ed4-492f-8151-3e60e91832c1,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:11.322323 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] Routers {'f2b3fc08-9e60-4600-9a8b-7400a9e940a0'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:27:11.330801 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:27:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f2b3fc08-9e60-4600-9a8b-7400a9e940a0'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:11.334407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c36d31d-cc43-469a-946e-4be66d636161 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 27, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:27:11.335830 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c36d31d-cc43-469a-946e-4be66d636161 None None] Checking segment: {'id': 'cba73bdd-55aa-420b-957f-16ad6c3beaed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': 'fc8cdf15-d749-4170-8af1-e4f121fd1c72'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:27:11.336329 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6c36d31d-cc43-469a-946e-4be66d636161 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:11.336819 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c36d31d-cc43-469a-946e-4be66d636161 None None] Bound using segment: {'id': 'cba73bdd-55aa-420b-957f-16ad6c3beaed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': 'fc8cdf15-d749-4170-8af1-e4f121fd1c72'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:27:11.337606 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6c36d31d-cc43-469a-946e-4be66d636161 None None] Bound port: e50fe61d-462c-4e08-9b0a-318666886803, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cba73bdd-55aa-420b-957f-16ad6c3beaed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': 'fc8cdf15-d749-4170-8af1-e4f121fd1c72'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:27:11.338102 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6c36d31d-cc43-469a-946e-4be66d636161 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:11.356108 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c26fe972-3522-4672-8919-64cfd32454da tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Pushing event deleted for resources: {'Port': ['ID=058ec1cc-1cd2-44ec-93de-4557c5dd65de,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:11.409833 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ba28a67-ad29-4c29-9279-14967bbc8510 req-621c0569-0bd3-40ed-9de3-66b71c8d98bd tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:11.421768 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3ba28a67-ad29-4c29-9279-14967bbc8510 req-621c0569-0bd3-40ed-9de3-66b71c8d98bd tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=a45aee8c-1ead-4182-81dd-72688d980ba4 HTTP/1.1" status: 200 len: 950 time: 0.2266345 Dec 09 21:27:11.463388 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-416988d2-8fc8-46be-9ca3-c5b4a5bf34ae req-e30db080-ebd1-43e6-8f0c-5fb4643b0df6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:11.465020 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-416988d2-8fc8-46be-9ca3-c5b4a5bf34ae req-e30db080-ebd1-43e6-8f0c-5fb4643b0df6 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.1215544 Dec 09 21:27:11.485953 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-0275ef2f-bd9b-470c-b9c8-8efb24fb1a02 req-c26fe972-3522-4672-8919-64cfd32454da tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] No DVR routers for this DVR port 058ec1cc-1cd2-44ec-93de-4557c5dd65de on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:27:11.489227 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0275ef2f-bd9b-470c-b9c8-8efb24fb1a02 req-c26fe972-3522-4672-8919-64cfd32454da tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:11.504416 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0275ef2f-bd9b-470c-b9c8-8efb24fb1a02 req-c26fe972-3522-4672-8919-64cfd32454da tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "DELETE /v2.0/ports/058ec1cc-1cd2-44ec-93de-4557c5dd65de HTTP/1.1" status: 204 len: 173 time: 1.2474868 Dec 09 21:27:11.508260 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f', 'name': 'network-vif-deleted', 'tag': '058ec1cc-1cd2-44ec-93de-4557c5dd65de'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:27:11.510471 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-859d7e49-159d-443f-a78c-12431c41e184" -d '{"events": [{"server_uuid": "e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f", "name": "network-vif-deleted", "tag": "058ec1cc-1cd2-44ec-93de-4557c5dd65de"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:27:11.546540 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43dfa4da-9ada-4675-b8e6-ce3671ea801b req-bf9fc4b1-c8ce-4613-b5bb-dfdf746599ed tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:11.548253 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43dfa4da-9ada-4675-b8e6-ce3671ea801b req-bf9fc4b1-c8ce-4613-b5bb-dfdf746599ed tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] 10.222.0.10 "GET /v2.0/ports?device_id=b47d322e-d75b-4899-be48-dd276a4cdf7e HTTP/1.1" status: 200 len: 945 time: 0.3157191 Dec 09 21:27:11.549270 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] Set router f2b3fc08-9e60-4600-9a8b-7400a9e940a0 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:27:11.551863 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6c36d31d-cc43-469a-946e-4be66d636161 None None] For port e50fe61d-462c-4e08-9b0a-318666886803, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:27:11.565070 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-416988d2-8fc8-46be-9ca3-c5b4a5bf34ae req-f3e85df8-fe16-4442-83fa-5eb7451c104d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.172&port_id=18bda486-9d6d-41a3-a260-dd244a3838b3 HTTP/1.1" status: 200 len: 217 time: 0.0842097 Dec 09 21:27:11.634374 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-416988d2-8fc8-46be-9ca3-c5b4a5bf34ae req-5b96b0c9-cbc4-40b8-9a34-da34abd3052c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:11.636007 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-416988d2-8fc8-46be-9ca3-c5b4a5bf34ae req-5b96b0c9-cbc4-40b8-9a34-da34abd3052c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0613225 Dec 09 21:27:11.668309 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3ba28a67-ad29-4c29-9279-14967bbc8510 req-716579fb-b590-49c4-a545-3e15ee5c84fb tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2380872 Dec 09 21:27:11.777158 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6c36d31d-cc43-469a-946e-4be66d636161 None None] For port e50fe61d-462c-4e08-9b0a-318666886803, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e50fe61d-462c-4e08-9b0a-318666886803,segment=NetworkSegment(cba73bdd-55aa-420b-957f-16ad6c3beaed),segment_id=cba73bdd-55aa-420b-957f-16ad6c3beaed)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:27:11.801663 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6c36d31d-cc43-469a-946e-4be66d636161 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:11.835309 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9ce10d25-409f-4c9d-9bdd-1fc31642bfe2 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:11.838414 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-cbc51326-dd9c-4270-af0c-e946f0dce2f4 None None] Provisioning complete for port 07784993-5ed4-492f-8151-3e60e91832c1 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:11.839084 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cbc51326-dd9c-4270-af0c-e946f0dce2f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:11.910776 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9ce10d25-409f-4c9d-9bdd-1fc31642bfe2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:11.988299 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-43dfa4da-9ada-4675-b8e6-ce3671ea801b req-7531f9e7-8809-49ce-8c97-22a624104340 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Deleting port 0cb48dd1-cbdb-43d4-9909-33474781399b {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:27:11.988704 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-43dfa4da-9ada-4675-b8e6-ce3671ea801b req-7531f9e7-8809-49ce-8c97-22a624104340 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:12.011813 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c36d31d-cc43-469a-946e-4be66d636161 None None] Pushing event updated for resources: {'Port': ['ID=e50fe61d-462c-4e08-9b0a-318666886803,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:12.021271 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e6d1f80-c7f2-4939-a2d8-9d5776b20a2e req-94501670-8c09-409e-9e7e-976fe2bb6ee0 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:12.029767 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e6d1f80-c7f2-4939-a2d8-9d5776b20a2e req-94501670-8c09-409e-9e7e-976fe2bb6ee0 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 0.2045426 Dec 09 21:27:12.152658 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cbc51326-dd9c-4270-af0c-e946f0dce2f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:12.210795 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e6d1f80-c7f2-4939-a2d8-9d5776b20a2e req-5d8d3b45-c8e9-4174-8805-4882d6a54323 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1807680 Dec 09 21:27:12.238494 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-cbc51326-dd9c-4270-af0c-e946f0dce2f4 None None] For port 07784993-5ed4-492f-8151-3e60e91832c1, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=07784993-5ed4-492f-8151-3e60e91832c1,segment=NetworkSegment(f5a54e61-4fb1-4afa-9a27-98e2163b0365),segment_id=f5a54e61-4fb1-4afa-9a27-98e2163b0365)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:12.266269 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cbc51326-dd9c-4270-af0c-e946f0dce2f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:12.305412 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-416988d2-8fc8-46be-9ca3-c5b4a5bf34ae req-e4952717-e466-4e8f-b6a1-6d9b7b5ecfa8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:12.306970 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-416988d2-8fc8-46be-9ca3-c5b4a5bf34ae req-e4952717-e466-4e8f-b6a1-6d9b7b5ecfa8 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.6508751 Dec 09 21:27:12.339555 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3446e805-6c9d-42b4-9ffd-308ffbf84970 admin admin] Router 48f26966-6ebd-4ded-9b83-e7fdb71c4bf7 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:27:12.349363 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'name': 'tempest-TaggedBootDevicesTest-1896005035-router', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127'}], 'enable_snat': True}, 'gw_port_id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:00Z', 'updated_at': '2021-12-09T21:27:06Z', 'revision_number': 4, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'gw_port': {'id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a1:90:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1069, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:01Z', 'updated_at': '2021-12-09T21:27:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '07784993-5ed4-492f-8151-3e60e91832c1', 'name': '', 'network_id': 'f0373886-3db8-47eb-af65-78244497171e', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'mac_address': 'fa:16:3e:31:30:c3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'device_owner': 'network:router_interface', 'standard_attr_id': 1073, 'fixed_ips': [{'subnet_id': '65df7637-0210-4526-a5dd-a692c26062b4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:05Z', 'updated_at': '2021-12-09T21:27:11Z', 'revision_number': 4, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'subnets': [{'id': '65df7637-0210-4526-a5dd-a692c26062b4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:12.367003 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-43dfa4da-9ada-4675-b8e6-ce3671ea801b req-7531f9e7-8809-49ce-8c97-22a624104340 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] For port 0cb48dd1-cbdb-43d4-9909-33474781399b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=0cb48dd1-cbdb-43d4-9909-33474781399b,segment=NetworkSegment(46e6c67a-dcee-4633-8adc-6de1ea927c73),segment_id=46e6c67a-dcee-4633-8adc-6de1ea927c73)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:12.367376 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-43dfa4da-9ada-4675-b8e6-ce3671ea801b req-7531f9e7-8809-49ce-8c97-22a624104340 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:12.372335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-9ce10d25-409f-4c9d-9bdd-1fc31642bfe2 admin admin] Allocated IP 172.25.3.158 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/2400575d-0b51-48ba-bd46-ed904f5cdbcd) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:27:12.389524 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a567e3a5-2596-4731-8132-17388f520fc2 None None] The sync data for ids ['f2b3fc08-9e60-4600-9a8b-7400a9e940a0'] in n-d-713301-27 is: [{'id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'name': 'tempest-TaggedBootDevicesTest-1896005035-router', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127'}], 'enable_snat': True}, 'gw_port_id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:00Z', 'updated_at': '2021-12-09T21:27:06Z', 'revision_number': 4, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'gw_port': {'id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a1:90:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1069, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:01Z', 'updated_at': '2021-12-09T21:27:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '07784993-5ed4-492f-8151-3e60e91832c1', 'name': '', 'network_id': 'f0373886-3db8-47eb-af65-78244497171e', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'mac_address': 'fa:16:3e:31:30:c3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'device_owner': 'network:router_interface', 'standard_attr_id': 1073, 'fixed_ips': [{'subnet_id': '65df7637-0210-4526-a5dd-a692c26062b4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:05Z', 'updated_at': '2021-12-09T21:27:11Z', 'revision_number': 4, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'subnets': [{'id': '65df7637-0210-4526-a5dd-a692c26062b4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:27:12.397319 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbc51326-dd9c-4270-af0c-e946f0dce2f4 None None] Pushing event updated for resources: {'Port': ['ID=07784993-5ed4-492f-8151-3e60e91832c1,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:12.422268 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-43dfa4da-9ada-4675-b8e6-ce3671ea801b req-7531f9e7-8809-49ce-8c97-22a624104340 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Calling delete_port for 0cb48dd1-cbdb-43d4-9909-33474781399b owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:27:12.527242 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-416988d2-8fc8-46be-9ca3-c5b4a5bf34ae req-e19ca7e4-0bc4-41b5-97f6-ba977bd61fec service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2098835 Dec 09 21:27:12.596569 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0707c30a-f7c1-47f8-972e-a4d7ded23d1f req-2859b209-59e5-4e62-a85f-1af8671391d7 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/77bbf48d-463a-47f1-ac08-a895b61ca313 HTTP/1.1" status: 200 len: 1820 time: 0.3188210 Dec 09 21:27:12.718904 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1082c079-42e3-439e-bd6c-a973c7152441 req-a2d98b0b-c828-4c1c-a971-d136038aa26b tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:12.720535 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1082c079-42e3-439e-bd6c-a973c7152441 req-a2d98b0b-c828-4c1c-a971-d136038aa26b tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.1716096 Dec 09 21:27:12.733213 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-416988d2-8fc8-46be-9ca3-c5b4a5bf34ae req-76d01cfb-e443-4563-b89d-96d84fa1f7f0 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1959209 Dec 09 21:27:12.735556 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3446e805-6c9d-42b4-9ffd-308ffbf84970 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:27:12.741964 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3446e805-6c9d-42b4-9ffd-308ffbf84970 admin admin] 10.222.0.13 "PUT /v2.0/routers/48f26966-6ebd-4ded-9b83-e7fdb71c4bf7/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.8243914 Dec 09 21:27:12.744222 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9ce10d25-409f-4c9d-9bdd-1fc31642bfe2 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:12.747947 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b892e837-d3d0-4244-b53e-35cb6602f9a1 None None] Sync routers for ids ['48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:27:12.748803 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40196) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:12.761246 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b892e837-d3d0-4244-b53e-35cb6602f9a1 None None] Routers {'48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:27:12.765692 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-b892e837-d3d0-4244-b53e-35cb6602f9a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:27:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:12.888853 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0707c30a-f7c1-47f8-972e-a4d7ded23d1f req-f7bc097c-6eea-4551-b0f2-9605bf4a87a8 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:12.891688 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-b892e837-d3d0-4244-b53e-35cb6602f9a1 None None] Set router 48f26966-6ebd-4ded-9b83-e7fdb71c4bf7 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:27:12.976932 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1082c079-42e3-439e-bd6c-a973c7152441 req-f72f5d25-dc3d-4302-a095-b1455ce2da7b tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2307389 Dec 09 21:27:12.991776 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-43dfa4da-9ada-4675-b8e6-ce3671ea801b req-7531f9e7-8809-49ce-8c97-22a624104340 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:13.004106 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['0cb48dd1-cbdb-43d4-9909-33474781399b'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:27:13.018352 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0707c30a-f7c1-47f8-972e-a4d7ded23d1f req-f7bc097c-6eea-4551-b0f2-9605bf4a87a8 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:13.085465 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9ce10d25-409f-4c9d-9bdd-1fc31642bfe2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:13.096426 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 180 Content-Type: application/json Date: Thu, 09 Dec 2021 21:27:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5d82519e-1ab9-457a-bf49-ad07aad253e3 x-openstack-request-id: req-5d82519e-1ab9-457a-bf49-ad07aad253e3 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:27:13.096856 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f", "name": "network-vif-deleted", "tag": "058ec1cc-1cd2-44ec-93de-4557c5dd65de", "status": "failed", "code": 422}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:27:13.096989 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-5d82519e-1ab9-457a-bf49-ad07aad253e3 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:27:13.097512 n-d-713301-27 neutron-server[103438]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'e9b7c6a1-c7b5-46ed-bc7b-c769dc6b7a2f', 'name': 'network-vif-deleted', 'tag': '058ec1cc-1cd2-44ec-93de-4557c5dd65de', 'status': 'failed', 'code': 422} returned with failed status Dec 09 21:27:13.104762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7531f9e7-8809-49ce-8c97-22a624104340 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Pushing event deleted for resources: {'Port': ['ID=0cb48dd1-cbdb-43d4-9909-33474781399b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:13.138610 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-086eb409-7306-4220-881a-a3f325b91b31 admin admin] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:13.219060 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-b892e837-d3d0-4244-b53e-35cb6602f9a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'name': 'tempest-ServersTestFqdnHostnames-1853275289-router', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149'}], 'enable_snat': True}, 'gw_port_id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:32Z', 'updated_at': '2021-12-09T21:27:10Z', 'revision_number': 5, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'gw_port': {'id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:92:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 809, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:33Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:13.248960 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-43dfa4da-9ada-4675-b8e6-ce3671ea801b req-7531f9e7-8809-49ce-8c97-22a624104340 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] No DVR routers for this DVR port 0cb48dd1-cbdb-43d4-9909-33474781399b on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:27:13.265062 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b892e837-d3d0-4244-b53e-35cb6602f9a1 None None] Checking router: 48f26966-6ebd-4ded-9b83-e7fdb71c4bf7 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:27:13.281862 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b892e837-d3d0-4244-b53e-35cb6602f9a1 None None] Routers {'48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:27:13.282514 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-b892e837-d3d0-4244-b53e-35cb6602f9a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:27:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:13.387738 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-70b313ff-2f4f-49e2-b0ec-cd6048c06aa1 None None] Network fc8cdf15-d749-4170-8af1-e4f121fd1c72 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:27:13.434661 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2a366d6f-326d-42af-9dc3-f350127e9172 None None] Provisioning complete for port e50fe61d-462c-4e08-9b0a-318666886803 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:13.434973 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2a366d6f-326d-42af-9dc3-f350127e9172 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:13.512513 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-b892e837-d3d0-4244-b53e-35cb6602f9a1 None None] Set router 48f26966-6ebd-4ded-9b83-e7fdb71c4bf7 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:27:13.605606 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2a366d6f-326d-42af-9dc3-f350127e9172 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:13.614024 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-43dfa4da-9ada-4675-b8e6-ce3671ea801b req-7531f9e7-8809-49ce-8c97-22a624104340 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:13.617683 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43dfa4da-9ada-4675-b8e6-ce3671ea801b req-7531f9e7-8809-49ce-8c97-22a624104340 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] 10.222.0.10 "DELETE /v2.0/ports/0cb48dd1-cbdb-43d4-9909-33474781399b HTTP/1.1" status: 204 len: 173 time: 2.0567436 Dec 09 21:27:13.626037 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ce10d25-409f-4c9d-9bdd-1fc31642bfe2 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:27:13.633616 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0707c30a-f7c1-47f8-972e-a4d7ded23d1f req-f7bc097c-6eea-4551-b0f2-9605bf4a87a8 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:13.636322 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-0707c30a-f7c1-47f8-972e-a4d7ded23d1f req-f7bc097c-6eea-4551-b0f2-9605bf4a87a8 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:13.637525 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0707c30a-f7c1-47f8-972e-a4d7ded23d1f req-f7bc097c-6eea-4551-b0f2-9605bf4a87a8 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "DELETE /v2.0/security-groups/77bbf48d-463a-47f1-ac08-a895b61ca313 HTTP/1.1" status: 204 len: 173 time: 1.0112541 Dec 09 21:27:13.681789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2a366d6f-326d-42af-9dc3-f350127e9172 None None] For port e50fe61d-462c-4e08-9b0a-318666886803, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e50fe61d-462c-4e08-9b0a-318666886803,segment=NetworkSegment(cba73bdd-55aa-420b-957f-16ad6c3beaed),segment_id=cba73bdd-55aa-420b-957f-16ad6c3beaed)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:13.689765 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2a366d6f-326d-42af-9dc3-f350127e9172 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:13.697318 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-9ce10d25-409f-4c9d-9bdd-1fc31642bfe2 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:13.717088 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7bc097c-6eea-4551-b0f2-9605bf4a87a8 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=77bbf48d-463a-47f1-ac08-a895b61ca313,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:13.732190 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ce10d25-409f-4c9d-9bdd-1fc31642bfe2 admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:27:13.809712 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a366d6f-326d-42af-9dc3-f350127e9172 None None] Pushing event updated for resources: {'Port': ['ID=e50fe61d-462c-4e08-9b0a-318666886803,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:13.810074 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-b892e837-d3d0-4244-b53e-35cb6602f9a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'name': 'tempest-ServersTestFqdnHostnames-1853275289-router', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149'}], 'enable_snat': True}, 'gw_port_id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:32Z', 'updated_at': '2021-12-09T21:27:10Z', 'revision_number': 5, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'gw_port': {'id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:92:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 809, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:33Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:13.822730 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f903926-2f0c-4ede-8c04-5989e36219ee req-c8075cbb-baec-405d-82b1-e73d723c3505 tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:13.827087 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f903926-2f0c-4ede-8c04-5989e36219ee req-c8075cbb-baec-405d-82b1-e73d723c3505 tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=a45aee8c-1ead-4182-81dd-72688d980ba4 HTTP/1.1" status: 200 len: 1102 time: 0.5812333 Dec 09 21:27:13.875246 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b892e837-d3d0-4244-b53e-35cb6602f9a1 None None] The sync data for ids ['48f26966-6ebd-4ded-9b83-e7fdb71c4bf7'] in n-d-713301-27 is: [{'id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'name': 'tempest-ServersTestFqdnHostnames-1853275289-router', 'tenant_id': 'dd631239105645b6b7088738a5229b7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149'}], 'enable_snat': True}, 'gw_port_id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:24:32Z', 'updated_at': '2021-12-09T21:27:10Z', 'revision_number': 5, 'project_id': 'dd631239105645b6b7088738a5229b7f', 'gw_port': {'id': '709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:92:53', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '48f26966-6ebd-4ded-9b83-e7fdb71c4bf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 809, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:24:33Z', 'updated_at': '2021-12-09T21:24:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:27:13.878139 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ce10d25-409f-4c9d-9bdd-1fc31642bfe2 admin admin] Pushing event updated for resources: {'Port': ['ID=2400575d-0b51-48ba-bd46-ed904f5cdbcd,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:13.922097 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4b0dd931-f48d-4c88-82c8-87a8995e3f9c req-93eb5ce3-6231-483e-8fc3-c0a9a2c481d5 tempest-InstanceActionsNegativeTestJSON-993283685 tempest-InstanceActionsNegativeTestJSON-993283685-project] 10.222.0.13 "GET /v2.0/ports?device_id=b47d322e-d75b-4899-be48-dd276a4cdf7e HTTP/1.1" status: 200 len: 210 time: 0.1201746 Dec 09 21:27:13.932877 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-086eb409-7306-4220-881a-a3f325b91b31 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:13.965007 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f903926-2f0c-4ede-8c04-5989e36219ee req-36b152b0-e7b3-40d3-aaa0-141120e531c2 tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1334426 Dec 09 21:27:14.038539 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2ba109d7-921d-46ef-a5df-41546fa363f5 None None] Provisioning complete for port e50fe61d-462c-4e08-9b0a-318666886803 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:14.038920 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2ba109d7-921d-46ef-a5df-41546fa363f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:14.272359 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-039a0de0-780d-4974-b47a-a929dbfa84a0 req-15dba5d1-e7c0-410a-a0da-8fb981f0ecb9 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:14.274191 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-039a0de0-780d-4974-b47a-a929dbfa84a0 req-15dba5d1-e7c0-410a-a0da-8fb981f0ecb9 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 0.1864674 Dec 09 21:27:14.301237 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-596b0bf8-2ed3-402f-9966-2ba498adc209 req-43184538-8099-47a8-9640-43949fa81d05 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] show failed (client error): The resource could not be found. Dec 09 21:27:14.302442 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-596b0bf8-2ed3-402f-9966-2ba498adc209 req-43184538-8099-47a8-9640-43949fa81d05 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/77bbf48d-463a-47f1-ac08-a895b61ca313 HTTP/1.1" status: 404 len: 352 time: 0.0431058 Dec 09 21:27:14.381656 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 07784993-5ed4-492f-8151-3e60e91832c1 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:14.438507 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-086eb409-7306-4220-881a-a3f325b91b31 admin admin] Deleting port 709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:27:14.438507 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-086eb409-7306-4220-881a-a3f325b91b31 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:14.451792 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 07784993-5ed4-492f-8151-3e60e91832c1 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:14.452432 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:14.525747 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-039a0de0-780d-4974-b47a-a929dbfa84a0 req-34227afc-1667-4ad1-a1df-7ff4f9e5d0aa tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2315967 Dec 09 21:27:14.533977 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e50fe61d-462c-4e08-9b0a-318666886803 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:14.584852 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port e50fe61d-462c-4e08-9b0a-318666886803 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:14.585218 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:14.667655 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71cb62dc-07c1-4d91-a3de-2fd16a509a1d req-42b9aa13-c8c3-4bf9-849c-afcf82f61c14 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:14.669177 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71cb62dc-07c1-4d91-a3de-2fd16a509a1d req-42b9aa13-c8c3-4bf9-849c-afcf82f61c14 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=9ca15fab17f34cc58f1ad1fcedc1bf31&device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 1098 time: 0.2721739 Dec 09 21:27:14.707424 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c338965-dd38-4791-90df-411c37f9993e req-52707d46-29af-4524-88c8-a077ca6f2d8c tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0782003 Dec 09 21:27:14.756615 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9ce10d25-409f-4c9d-9bdd-1fc31642bfe2 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:14.830190 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-6fc30c8d-8e8a-425d-9449-4154ed7c20ba tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:14.834366 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-6fc30c8d-8e8a-425d-9449-4154ed7c20ba tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/networks?id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb HTTP/1.1" status: 200 len: 812 time: 0.3994553 Dec 09 21:27:14.937525 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-086eb409-7306-4220-881a-a3f325b91b31 admin admin] For port 709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:14.937842 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-086eb409-7306-4220-881a-a3f325b91b31 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:14.955686 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-304bbc5f-2880-4e08-a5e0-b05b7c5a736a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/quotas/1b7916b634f74760a565cfeaef510cd9 HTTP/1.1" status: 200 len: 375 time: 0.0827079 Dec 09 21:27:14.978626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-086eb409-7306-4220-881a-a3f325b91b31 admin admin] Calling delete_port for 709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:27:15.053950 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-fdea8ccd-8b45-48c0-bb90-9f676da03383 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=1b7916b634f74760a565cfeaef510cd9&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0911305 Dec 09 21:27:15.054923 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71cb62dc-07c1-4d91-a3de-2fd16a509a1d req-da4605ce-8f40-430c-9973-ce2246917399 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:15.056261 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71cb62dc-07c1-4d91-a3de-2fd16a509a1d req-da4605ce-8f40-430c-9973-ce2246917399 service neutron] 10.222.0.10 "GET /v2.0/networks?id=e7d3d836-ebe9-4e03-af4b-235dd5e5cbea HTTP/1.1" status: 200 len: 912 time: 0.3727624 Dec 09 21:27:15.115758 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b47d322e-d75b-4899-be48-dd276a4cdf7e', 'name': 'network-vif-deleted', 'tag': '0cb48dd1-cbdb-43d4-9909-33474781399b'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:27:15.117999 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a6cce41e-a594-46ac-9610-dcd55a590402" -d '{"events": [{"server_uuid": "b47d322e-d75b-4899-be48-dd276a4cdf7e", "name": "network-vif-deleted", "tag": "0cb48dd1-cbdb-43d4-9909-33474781399b"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:27:15.178576 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c338965-dd38-4791-90df-411c37f9993e req-27c8a8a1-65de-4080-92a1-a586cc2afaf1 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:15.180069 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c338965-dd38-4791-90df-411c37f9993e req-27c8a8a1-65de-4080-92a1-a586cc2afaf1 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4583352 Dec 09 21:27:15.181278 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71cb62dc-07c1-4d91-a3de-2fd16a509a1d req-58a220ee-7f6b-413c-8bae-59e00c53e981 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=4479e7ab-f0ee-45ff-a040-76f4dd53237f HTTP/1.1" status: 200 len: 217 time: 0.1116171 Dec 09 21:27:15.302396 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c338965-dd38-4791-90df-411c37f9993e req-eb5b2bc6-bba8-4897-99fc-d68c2710d21a tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/quotas/23f7f8a3e7b14635b4f7dfa561684399 HTTP/1.1" status: 200 len: 375 time: 0.1101418 Dec 09 21:27:15.439228 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71cb62dc-07c1-4d91-a3de-2fd16a509a1d req-9a6a48f9-8150-499e-9d7d-efd456e895d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:15.440720 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71cb62dc-07c1-4d91-a3de-2fd16a509a1d req-9a6a48f9-8150-499e-9d7d-efd456e895d1 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=a84d1123-6651-4f35-9cba-4f9c8f45aab6 HTTP/1.1" status: 200 len: 851 time: 0.2454953 Dec 09 21:27:15.458955 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-0286fda8-f238-4222-8bc5-538b037b3898 service neutron] 10.222.0.13 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3956840 Dec 09 21:27:15.516379 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71cb62dc-07c1-4d91-a3de-2fd16a509a1d req-70406ed2-43eb-40cb-b69f-c1e33895cca1 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=e7d3d836-ebe9-4e03-af4b-235dd5e5cbea&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0595510 Dec 09 21:27:15.529808 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9ce10d25-409f-4c9d-9bdd-1fc31642bfe2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:15.623232 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c338965-dd38-4791-90df-411c37f9993e req-7593cdc8-b625-4575-ada7-c963eb12765c tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&fields=id HTTP/1.1" status: 200 len: 486 time: 0.3073151 Dec 09 21:27:15.846434 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0c3b6cc8-3628-4374-be2a-ae9bb603880e no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:27:15.869524 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 0c3b6cc8-3628-4374-be2a-ae9bb603880e {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:27:15.869888 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0c3b6cc8-3628-4374-be2a-ae9bb603880e not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:27:16.048767 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-086eb409-7306-4220-881a-a3f325b91b31 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:16.129363 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-086eb409-7306-4220-881a-a3f325b91b31 admin admin] Pushing event deleted for resources: {'Port': ['ID=709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:16.142373 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-4bfd0e25-86d4-41e7-b780-2d5b812eda73 service neutron] 10.222.0.13 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6709161 Dec 09 21:27:16.177962 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71cb62dc-07c1-4d91-a3de-2fd16a509a1d req-75b7a1b0-f15b-4033-852a-8302e8f5d6ba service neutron] 10.222.0.10 "GET /v2.0/networks/e7d3d836-ebe9-4e03-af4b-235dd5e5cbea?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6521301 Dec 09 21:27:16.234379 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9329b2d-75d7-4bf0-9ed6-c9277b97b65f req-5ea878bd-70e3-4ecd-86f1-eca94ba7cc0e tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:16.235944 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e9329b2d-75d7-4bf0-9ed6-c9277b97b65f req-5ea878bd-70e3-4ecd-86f1-eca94ba7cc0e tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.2700098 Dec 09 21:27:16.328910 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 0cb48dd1-cbdb-43d4-9909-33474781399b no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:27:16.351534 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 0cb48dd1-cbdb-43d4-9909-33474781399b {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:27:16.352117 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 0cb48dd1-cbdb-43d4-9909-33474781399b not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:27:16.362338 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-086eb409-7306-4220-881a-a3f325b91b31 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:16.521478 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-086eb409-7306-4220-881a-a3f325b91b31 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:16.533855 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-086eb409-7306-4220-881a-a3f325b91b31 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:16.570680 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b9b17a1-51e7-4445-ac90-6db6ac82e176 req-861ce58e-a317-4c53-b215-11480ded81e6 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/f13bda71-a22a-40d5-8623-6019230ec2f2 HTTP/1.1" status: 200 len: 1818 time: 0.2917469 Dec 09 21:27:16.572637 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71cb62dc-07c1-4d91-a3de-2fd16a509a1d req-87881c0f-6110-42c3-af3a-075e459e4bb2 service neutron] 10.222.0.10 "GET /v2.0/networks/e7d3d836-ebe9-4e03-af4b-235dd5e5cbea?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3809929 Dec 09 21:27:16.611929 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e9329b2d-75d7-4bf0-9ed6-c9277b97b65f req-128899c6-652f-4232-8087-cd64557e5eb5 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3566656 Dec 09 21:27:16.618114 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9ce10d25-409f-4c9d-9bdd-1fc31642bfe2 admin admin] Router 31a00d4e-6581-4747-824c-a35acf7b5352 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:27:16.649664 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-086eb409-7306-4220-881a-a3f325b91b31 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:16.650186 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-086eb409-7306-4220-881a-a3f325b91b31 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 48f26966-6ebd-4ded-9b83-e7fdb71c4bf7 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:27:16.660452 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-086eb409-7306-4220-881a-a3f325b91b31 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:16.661632 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-086eb409-7306-4220-881a-a3f325b91b31 admin admin] 10.222.0.13 "DELETE /v2.0/routers/48f26966-6ebd-4ded-9b83-e7fdb71c4bf7 HTTP/1.1" status: 204 len: 168 time: 3.9057453 Dec 09 21:27:16.664877 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40262) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:16.713883 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40264) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:16.776216 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-fa305998-8958-42fd-920d-baaa4f936ce2 admin admin] Deleting subnet 9125b460-598b-4793-bfb4-08b07155042a {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:27:16.783170 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fa305998-8958-42fd-920d-baaa4f936ce2 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:16.804027 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:27:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c174e026-d3ea-42ee-98bb-91dc90791057 x-openstack-request-id: req-c174e026-d3ea-42ee-98bb-91dc90791057 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:27:16.804627 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b47d322e-d75b-4899-be48-dd276a4cdf7e", "name": "network-vif-deleted", "tag": "0cb48dd1-cbdb-43d4-9909-33474781399b", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:27:16.805042 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c174e026-d3ea-42ee-98bb-91dc90791057 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:27:16.805599 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b47d322e-d75b-4899-be48-dd276a4cdf7e', 'name': 'network-vif-deleted', 'tag': '0cb48dd1-cbdb-43d4-9909-33474781399b', 'status': 'completed', 'code': 200} Dec 09 21:27:16.873595 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fa305998-8958-42fd-920d-baaa4f936ce2 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:16.914098 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9b9b17a1-51e7-4445-ac90-6db6ac82e176 req-b11cf5a4-224b-4441-b76f-0f68c7f4cb60 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:16.977534 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9ce10d25-409f-4c9d-9bdd-1fc31642bfe2 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:27:16.991983 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fa305998-8958-42fd-920d-baaa4f936ce2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:16.992272 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] Sync routers for ids ['31a00d4e-6581-4747-824c-a35acf7b5352'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:27:16.992775 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c338965-dd38-4791-90df-411c37f9993e req-2b6ac517-7603-430a-af10-c130423a618f tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.10 "GET /v2.0/networks?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1090343 Dec 09 21:27:17.014469 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] Routers {'31a00d4e-6581-4747-824c-a35acf7b5352'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:27:17.016061 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:27:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['31a00d4e-6581-4747-824c-a35acf7b5352'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:17.017162 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9b9b17a1-51e7-4445-ac90-6db6ac82e176 req-b11cf5a4-224b-4441-b76f-0f68c7f4cb60 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:17.041813 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-0e71c39d-91ef-4382-a593-b7b4fb0344b0 admin admin] Deleting subnet 88904fa3-5b93-4c51-bfd3-07adb53a77ab {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:27:17.070215 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e71c39d-91ef-4382-a593-b7b4fb0344b0 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:17.073091 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fa305998-8958-42fd-920d-baaa4f936ce2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:17.074238 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9ce10d25-409f-4c9d-9bdd-1fc31642bfe2 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:17.075678 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9ce10d25-409f-4c9d-9bdd-1fc31642bfe2 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 6.7108498 Dec 09 21:27:17.087741 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40266) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:17.112789 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa305998-8958-42fd-920d-baaa4f936ce2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9125b460-598b-4793-bfb4-08b07155042a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:17.132835 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b9f95bb7-d072-4a7a-8f9e-094bd7e343a1 None None] Network ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:27:17.137076 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0311e10b-b19b-42db-9cc7-f6be94568627 req-2c1f2f7a-bc1a-46cd-85f8-f7cb5908f04c tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:17.138783 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0311e10b-b19b-42db-9cc7-f6be94568627 req-2c1f2f7a-bc1a-46cd-85f8-f7cb5908f04c tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 0.2542896 Dec 09 21:27:17.163886 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fa305998-8958-42fd-920d-baaa4f936ce2 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:17.167583 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fa305998-8958-42fd-920d-baaa4f936ce2 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/9125b460-598b-4793-bfb4-08b07155042a HTTP/1.1" status: 204 len: 168 time: 0.5015421 Dec 09 21:27:17.170355 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40268) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:17.181289 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] Set router 31a00d4e-6581-4747-824c-a35acf7b5352 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:27:17.193487 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e71c39d-91ef-4382-a593-b7b4fb0344b0 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:17.254817 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9b9b17a1-51e7-4445-ac90-6db6ac82e176 req-b11cf5a4-224b-4441-b76f-0f68c7f4cb60 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:17.257503 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9b9b17a1-51e7-4445-ac90-6db6ac82e176 req-b11cf5a4-224b-4441-b76f-0f68c7f4cb60 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:17.258663 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b9b17a1-51e7-4445-ac90-6db6ac82e176 req-b11cf5a4-224b-4441-b76f-0f68c7f4cb60 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "DELETE /v2.0/security-groups/f13bda71-a22a-40d5-8623-6019230ec2f2 HTTP/1.1" status: 204 len: 173 time: 0.6452086 Dec 09 21:27:17.302599 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b11cf5a4-224b-4441-b76f-0f68c7f4cb60 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f13bda71-a22a-40d5-8623-6019230ec2f2,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:17.317101 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c338965-dd38-4791-90df-411c37f9993e req-4dba5f67-d24f-41dc-8089-78309ace124f tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:17.318636 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c338965-dd38-4791-90df-411c37f9993e req-4dba5f67-d24f-41dc-8089-78309ace124f tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3056192 Dec 09 21:27:17.322755 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e71c39d-91ef-4382-a593-b7b4fb0344b0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:17.328056 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0311e10b-b19b-42db-9cc7-f6be94568627 req-cf801bbb-cae6-406d-9963-d7d75ae7fedc tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1493754 Dec 09 21:27:17.340243 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31beb08e-cd8c-49f4-b9e4-be7f02c3b792 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:17.361940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-2c338965-dd38-4791-90df-411c37f9993e req-f9103175-2e98-4f8a-8a76-ae1a21ad2d40 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Request body: {'port': {'device_id': 'b521a440-0384-48fc-aaa9-13419003343e', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '23f7f8a3e7b14635b4f7dfa561684399'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:17.472053 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bf0f353-8763-46eb-8289-82c23c52a9fe req-a969e7f2-fc88-44f5-9080-4445ab4c3e4d tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=b521a440-0384-48fc-aaa9-13419003343e HTTP/1.1" status: 200 len: 210 time: 0.0818985 Dec 09 21:27:17.532916 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '31a00d4e-6581-4747-824c-a35acf7b5352', 'name': 'tempest-TaggedBootDevicesTest-1740845933-router', 'tenant_id': 'f8441d8d390b442691a162db541a51b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.158'}], 'enable_snat': True}, 'gw_port_id': '2400575d-0b51-48ba-bd46-ed904f5cdbcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:10Z', 'updated_at': '2021-12-09T21:27:14Z', 'revision_number': 3, 'project_id': 'f8441d8d390b442691a162db541a51b0', 'gw_port': {'id': '2400575d-0b51-48ba-bd46-ed904f5cdbcd', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:0d:d4:57', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '31a00d4e-6581-4747-824c-a35acf7b5352', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1093, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:11Z', 'updated_at': '2021-12-09T21:27:12Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:17.570244 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-6e9c8f17-4736-4e5f-8574-493a8429f554 req-6f3a7848-fd78-43b4-b927-7dcbacb399b5 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] show failed (client error): The resource could not be found. Dec 09 21:27:17.575012 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] Checking router: 31a00d4e-6581-4747-824c-a35acf7b5352 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:27:17.575850 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] Updating router 31a00d4e-6581-4747-824c-a35acf7b5352 port 2400575d-0b51-48ba-bd46-ed904f5cdbcd binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:27:17.576784 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e9c8f17-4736-4e5f-8574-493a8429f554 req-6f3a7848-fd78-43b4-b927-7dcbacb399b5 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/f13bda71-a22a-40d5-8623-6019230ec2f2 HTTP/1.1" status: 404 len: 352 time: 0.0740645 Dec 09 21:27:17.583290 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-16bc8ac2-0403-403f-8a80-876188556d33 None None] DHCP port deletion for ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:27:17.595242 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ff06bf1d-e751-4159-ab86-1a79adafe4e0 req-0feb7686-9ffc-41e4-99b0-826207bd904c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 210 time: 0.0747044 Dec 09 21:27:17.630603 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e71c39d-91ef-4382-a593-b7b4fb0344b0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:17.646158 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:17.676676 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e71c39d-91ef-4382-a593-b7b4fb0344b0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=88904fa3-5b93-4c51-bfd3-07adb53a77ab,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:17.691639 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e71c39d-91ef-4382-a593-b7b4fb0344b0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:17.697265 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0e71c39d-91ef-4382-a593-b7b4fb0344b0 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/88904fa3-5b93-4c51-bfd3-07adb53a77ab HTTP/1.1" status: 204 len: 168 time: 0.9785254 Dec 09 21:27:17.698895 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40276) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:17.717399 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38585ebb-36ef-433c-8244-b77d714a33e2 req-542b5510-9ebb-4151-81b1-aff598dd286f tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/1cc4844b-f1c9-4751-b1a6-ddc43fd1f320 HTTP/1.1" status: 200 len: 1820 time: 0.1205401 Dec 09 21:27:17.756526 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2c338965-dd38-4791-90df-411c37f9993e req-f9103175-2e98-4f8a-8a76-ae1a21ad2d40 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Made reservation on behalf of 23f7f8a3e7b14635b4f7dfa561684399 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:27:17.760346 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2c338965-dd38-4791-90df-411c37f9993e req-f9103175-2e98-4f8a-8a76-ae1a21ad2d40 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:17.884942 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-ae0cea90-080f-4930-b302-ef325a697ffa tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:17.886345 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-ae0cea90-080f-4930-b302-ef325a697ffa tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.31 "GET /v2.0/networks?id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb HTTP/1.1" status: 200 len: 812 time: 0.3061957 Dec 09 21:27:17.898829 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-31beb08e-cd8c-49f4-b9e4-be7f02c3b792 admin admin] Deleting port 4223f93e-2b4f-4613-877b-54f472a974d6 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:27:17.898829 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31beb08e-cd8c-49f4-b9e4-be7f02c3b792 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:17.903308 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a87a5088-a14e-4a0d-83cf-cb1226af7af9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:17.919056 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-c9937b88-5794-447c-99f0-3f10aeb4fe81 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Request body: {'port': {'device_id': 'f9370050-6da6-47ee-8b58-2b96e64a02fc', 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb', 'admin_state_up': True, 'tenant_id': '1b7916b634f74760a565cfeaef510cd9'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:17.982313 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:27:17.986456 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-38585ebb-36ef-433c-8244-b77d714a33e2 req-bf0092ab-9cff-498d-8831-8c7a15444856 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.010085 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8c366c3-b01e-4b8d-8ed1-f552bea62ad7 req-bd3166a7-2daa-48fc-ba09-d0bed1f7e572 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:18.011041 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-16bc8ac2-0403-403f-8a80-876188556d33 None None] Deleting port 4223f93e-2b4f-4613-877b-54f472a974d6 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:27:18.011572 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-16bc8ac2-0403-403f-8a80-876188556d33 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.013570 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:27:18.013987 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 709b0602-d2aa-4e8d-baf0-bd9d7e7dcdfe not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:27:18.014385 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 4223f93e-2b4f-4613-877b-54f472a974d6 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:27:18.018824 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8c366c3-b01e-4b8d-8ed1-f552bea62ad7 req-bd3166a7-2daa-48fc-ba09-d0bed1f7e572 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.2448485 Dec 09 21:27:18.095260 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-31beb08e-cd8c-49f4-b9e4-be7f02c3b792 admin admin] For port 4223f93e-2b4f-4613-877b-54f472a974d6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=4223f93e-2b4f-4613-877b-54f472a974d6,segment=NetworkSegment(51116481-b9d7-45e1-bfed-86b419caae01),segment_id=51116481-b9d7-45e1-bfed-86b419caae01)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:18.095684 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31beb08e-cd8c-49f4-b9e4-be7f02c3b792 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.101180 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-38585ebb-36ef-433c-8244-b77d714a33e2 req-bf0092ab-9cff-498d-8831-8c7a15444856 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.114558 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-31beb08e-cd8c-49f4-b9e4-be7f02c3b792 admin admin] Calling delete_port for 4223f93e-2b4f-4613-877b-54f472a974d6 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:27:18.177128 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-16bc8ac2-0403-403f-8a80-876188556d33 None None] For port 4223f93e-2b4f-4613-877b-54f472a974d6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=4223f93e-2b4f-4613-877b-54f472a974d6,segment=NetworkSegment(51116481-b9d7-45e1-bfed-86b419caae01),segment_id=51116481-b9d7-45e1-bfed-86b419caae01)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:18.177128 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-16bc8ac2-0403-403f-8a80-876188556d33 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.204807 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-16bc8ac2-0403-403f-8a80-876188556d33 None None] Calling delete_port for 4223f93e-2b4f-4613-877b-54f472a974d6 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:27:18.208129 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a87a5088-a14e-4a0d-83cf-cb1226af7af9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.225542 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.244216 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-2c338965-dd38-4791-90df-411c37f9993e req-f9103175-2e98-4f8a-8a76-ae1a21ad2d40 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Allocated IP 192.168.233.11 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/0ef815c5-fc54-4d19-b139-1eaa75cffde2) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:27:18.254301 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8c366c3-b01e-4b8d-8ed1-f552bea62ad7 req-1c94f857-2e28-4484-a478-dbba11fcfbac tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2345204 Dec 09 21:27:18.261118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-a87a5088-a14e-4a0d-83cf-cb1226af7af9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['43277078-8ac8-4619-8b7d-a7366d3b265f']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:18.279628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-a87a5088-a14e-4a0d-83cf-cb1226af7af9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '46e6c67a-dcee-4633-8adc-6de1ea927c73') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:18.280036 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-a87a5088-a14e-4a0d-83cf-cb1226af7af9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '46e6c67a-dcee-4633-8adc-6de1ea927c73') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:18.290765 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-c9937b88-5794-447c-99f0-3f10aeb4fe81 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Made reservation on behalf of 1b7916b634f74760a565cfeaef510cd9 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:27:18.296108 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-c9937b88-5794-447c-99f0-3f10aeb4fe81 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.300932 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-38585ebb-36ef-433c-8244-b77d714a33e2 req-bf0092ab-9cff-498d-8831-8c7a15444856 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.303729 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-38585ebb-36ef-433c-8244-b77d714a33e2 req-bf0092ab-9cff-498d-8831-8c7a15444856 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.304880 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38585ebb-36ef-433c-8244-b77d714a33e2 req-bf0092ab-9cff-498d-8831-8c7a15444856 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "DELETE /v2.0/security-groups/1cc4844b-f1c9-4751-b1a6-ddc43fd1f320 HTTP/1.1" status: 204 len: 173 time: 0.5871418 Dec 09 21:27:18.309574 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a87a5088-a14e-4a0d-83cf-cb1226af7af9 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.331021 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bde576ae-706c-4491-b930-02b5b9408e20 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.346936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf0092ab-9cff-498d-8831-8c7a15444856 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1cc4844b-f1c9-4751-b1a6-ddc43fd1f320,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:18.347771 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.353244 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a87a5088-a14e-4a0d-83cf-cb1226af7af9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.356375 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31beb08e-cd8c-49f4-b9e4-be7f02c3b792 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.381974 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a87a5088-a14e-4a0d-83cf-cb1226af7af9 admin admin] Releasing vlan 136 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:27:18.382387 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a87a5088-a14e-4a0d-83cf-cb1226af7af9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.392924 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:27:18.394722 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:27:18.424871 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-26ba1c93-f93e-4937-a758-4b2afdd025f1 req-d28e59ce-bc06-46cd-9b84-f934205e3608 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] show failed (client error): The resource could not be found. Dec 09 21:27:18.426546 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-26ba1c93-f93e-4937-a758-4b2afdd025f1 req-d28e59ce-bc06-46cd-9b84-f934205e3608 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/1cc4844b-f1c9-4751-b1a6-ddc43fd1f320 HTTP/1.1" status: 404 len: 352 time: 0.0606551 Dec 09 21:27:18.430993 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31beb08e-cd8c-49f4-b9e4-be7f02c3b792 admin admin] Pushing event deleted for resources: {'Port': ['ID=4223f93e-2b4f-4613-877b-54f472a974d6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:18.445733 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31beb08e-cd8c-49f4-b9e4-be7f02c3b792 admin admin] No DVR routers for this DVR port 4223f93e-2b4f-4613-877b-54f472a974d6 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:27:18.462895 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5c482d9-cddb-4eb9-bf2e-f11e12e9a559 None None] Pushing event updated for resources: {'Port': ['ID=2400575d-0b51-48ba-bd46-ed904f5cdbcd,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:18.492541 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] Attempting to bind port 2400575d-0b51-48ba-bd46-ed904f5cdbcd on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:27:18.493146 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] Attempting to bind port 2400575d-0b51-48ba-bd46-ed904f5cdbcd by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:27:18.493694 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] Attempting to bind port 2400575d-0b51-48ba-bd46-ed904f5cdbcd on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:18.498920 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-16bc8ac2-0403-403f-8a80-876188556d33 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.511099 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 27, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:27:18.511842 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:27:18.512441 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.513002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:27:18.513816 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] Bound port: 2400575d-0b51-48ba-bd46-ed904f5cdbcd, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:27:18.514206 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.516109 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16bc8ac2-0403-403f-8a80-876188556d33 None None] No DVR routers for this DVR port 4223f93e-2b4f-4613-877b-54f472a974d6 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:27:18.541086 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16bc8ac2-0403-403f-8a80-876188556d33 None None] Pushing event deleted for resources: {'Port': ['ID=4223f93e-2b4f-4613-877b-54f472a974d6,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:18.605962 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] For port 2400575d-0b51-48ba-bd46-ed904f5cdbcd, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:27:18.610233 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] For port 2400575d-0b51-48ba-bd46-ed904f5cdbcd, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2400575d-0b51-48ba-bd46-ed904f5cdbcd,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:27:18.617761 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.675259 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31beb08e-cd8c-49f4-b9e4-be7f02c3b792 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.686093 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] Routers {'31a00d4e-6581-4747-824c-a35acf7b5352'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:27:18.686520 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:27:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['31a00d4e-6581-4747-824c-a35acf7b5352'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:18.690815 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5c482d9-cddb-4eb9-bf2e-f11e12e9a559 None None] Pushing event updated for resources: {'Port': ['ID=2400575d-0b51-48ba-bd46-ed904f5cdbcd,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:18.756642 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-31beb08e-cd8c-49f4-b9e4-be7f02c3b792 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:18.773487 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-c9937b88-5794-447c-99f0-3f10aeb4fe81 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Allocated IP 172.20.0.11 (43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb/50496955-1646-4079-acd4-a47e8cd175cb/a6dac932-4c7b-404f-a089-32576a768d83) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:27:18.779481 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-31beb08e-cd8c-49f4-b9e4-be7f02c3b792 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '51116481-b9d7-45e1-bfed-86b419caae01') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:18.779764 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-31beb08e-cd8c-49f4-b9e4-be7f02c3b792 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '51116481-b9d7-45e1-bfed-86b419caae01') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:18.802853 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] Set router 31a00d4e-6581-4747-824c-a35acf7b5352 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:27:18.810529 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31beb08e-cd8c-49f4-b9e4-be7f02c3b792 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.813560 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-bde576ae-706c-4491-b930-02b5b9408e20 admin admin] Allocated IP 172.20.0.1 (fc8cdf15-d749-4170-8af1-e4f121fd1c72/feaf79a7-d79d-4e19-b68a-52abdef41e8b/7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:27:18.847735 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31beb08e-cd8c-49f4-b9e4-be7f02c3b792 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.871342 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-31beb08e-cd8c-49f4-b9e4-be7f02c3b792 admin admin] Releasing vlan 109 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:27:18.871798 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31beb08e-cd8c-49f4-b9e4-be7f02c3b792 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:27:18.873871 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:27:18.881516 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a87a5088-a14e-4a0d-83cf-cb1226af7af9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.897400 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a87a5088-a14e-4a0d-83cf-cb1226af7af9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.900566 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a87a5088-a14e-4a0d-83cf-cb1226af7af9 admin admin] 10.222.0.13 "DELETE /v2.0/networks/43277078-8ac8-4619-8b7d-a7366d3b265f HTTP/1.1" status: 204 len: 168 time: 1.1999433 Dec 09 21:27:18.951954 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a87a5088-a14e-4a0d-83cf-cb1226af7af9 admin admin] Pushing event deleted for resources: {'Network': ['ID=43277078-8ac8-4619-8b7d-a7366d3b265f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:18.980576 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b937b303-9513-4190-9f70-196e8e3912f9 req-2952f9f9-a82c-480d-9325-d3742e2b6490 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:18.982111 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b937b303-9513-4190-9f70-196e8e3912f9 req-2952f9f9-a82c-480d-9325-d3742e2b6490 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 0.4559760 Dec 09 21:27:18.993512 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2c338965-dd38-4791-90df-411c37f9993e req-f9103175-2e98-4f8a-8a76-ae1a21ad2d40 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:18.999424 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31beb08e-cd8c-49f4-b9e4-be7f02c3b792 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:19.031073 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '31a00d4e-6581-4747-824c-a35acf7b5352', 'name': 'tempest-TaggedBootDevicesTest-1740845933-router', 'tenant_id': 'f8441d8d390b442691a162db541a51b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.158'}], 'enable_snat': True}, 'gw_port_id': '2400575d-0b51-48ba-bd46-ed904f5cdbcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:10Z', 'updated_at': '2021-12-09T21:27:14Z', 'revision_number': 3, 'project_id': 'f8441d8d390b442691a162db541a51b0', 'gw_port': {'id': '2400575d-0b51-48ba-bd46-ed904f5cdbcd', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:0d:d4:57', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '31a00d4e-6581-4747-824c-a35acf7b5352', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1093, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:11Z', 'updated_at': '2021-12-09T21:27:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:19.042418 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31beb08e-cd8c-49f4-b9e4-be7f02c3b792 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:19.045812 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-31beb08e-cd8c-49f4-b9e4-be7f02c3b792 admin admin] 10.222.0.13 "DELETE /v2.0/networks/ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c HTTP/1.1" status: 204 len: 168 time: 1.8740602 Dec 09 21:27:19.056471 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60798b1e-ac23-4768-8c50-1431a2d030cd req-b7fce02f-6df5-45f4-bc48-1c0277f3bb63 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=5635fb0018b24f538b250cdac6dca9d9 HTTP/1.1" status: 200 len: 6206 time: 0.5882046 Dec 09 21:27:19.071241 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acd07f42-f645-4e93-bcb8-b2dc82f47268 None None] The sync data for ids ['31a00d4e-6581-4747-824c-a35acf7b5352'] in n-d-713301-27 is: [{'id': '31a00d4e-6581-4747-824c-a35acf7b5352', 'name': 'tempest-TaggedBootDevicesTest-1740845933-router', 'tenant_id': 'f8441d8d390b442691a162db541a51b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.158'}], 'enable_snat': True}, 'gw_port_id': '2400575d-0b51-48ba-bd46-ed904f5cdbcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:10Z', 'updated_at': '2021-12-09T21:27:14Z', 'revision_number': 3, 'project_id': 'f8441d8d390b442691a162db541a51b0', 'gw_port': {'id': '2400575d-0b51-48ba-bd46-ed904f5cdbcd', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:0d:d4:57', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '31a00d4e-6581-4747-824c-a35acf7b5352', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1093, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:11Z', 'updated_at': '2021-12-09T21:27:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:27:19.091096 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31beb08e-cd8c-49f4-b9e4-be7f02c3b792 admin admin] Pushing event deleted for resources: {'Network': ['ID=ad84acbd-b8c5-4e8e-8cea-2647f14e1c3c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:19.106988 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b937b303-9513-4190-9f70-196e8e3912f9 req-3d45330e-a33d-449e-8419-fcbc89c718f1 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1110466 Dec 09 21:27:19.135766 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60798b1e-ac23-4768-8c50-1431a2d030cd req-17feed68-fc35-4cd2-98b2-ecbb7ac02d4c tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9 HTTP/1.1" status: 200 len: 3002 time: 0.0656483 Dec 09 21:27:19.153193 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2c338965-dd38-4791-90df-411c37f9993e req-f9103175-2e98-4f8a-8a76-ae1a21ad2d40 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:19.158594 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bde576ae-706c-4491-b930-02b5b9408e20 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:19.166250 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['fd466da6-f506-43e6-9800-156622bd2781', 'c3c31744-0580-4d09-863d-697769f7c0ee'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:27:19.172422 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['18bda486-9d6d-41a3-a260-dd244a3838b3', '2958b0be-15e5-48e2-b87a-6ffefd9a7859', '1ad36983-4549-4a03-a826-a31a08b98c98', '07457883-17db-4553-8f10-716e04bc16b1'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:27:19.204422 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-c9937b88-5794-447c-99f0-3f10aeb4fe81 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:19.302507 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2c338965-dd38-4791-90df-411c37f9993e req-f9103175-2e98-4f8a-8a76-ae1a21ad2d40 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:27:19.327171 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60798b1e-ac23-4768-8c50-1431a2d030cd req-93b03442-6f51-4958-abfa-e15a2ee23e77 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9 HTTP/1.1" status: 200 len: 3002 time: 0.1620169 Dec 09 21:27:19.329171 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40294) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:19.342752 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-2c338965-dd38-4791-90df-411c37f9993e req-f9103175-2e98-4f8a-8a76-ae1a21ad2d40 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:19.360203 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-c9937b88-5794-447c-99f0-3f10aeb4fe81 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:19.367741 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-2c338965-dd38-4791-90df-411c37f9993e req-f9103175-2e98-4f8a-8a76-ae1a21ad2d40 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:27:19.373749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9103175-2e98-4f8a-8a76-ae1a21ad2d40 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Pushing event updated for resources: {'Port': ['ID=0ef815c5-fc54-4d19-b139-1eaa75cffde2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:19.406549 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40298) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:19.426444 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9937b88-5794-447c-99f0-3f10aeb4fe81 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Pushing event updated for resources: {'Port': ['ID=a6dac932-4c7b-404f-a089-32576a768d83,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:19.446743 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bde576ae-706c-4491-b930-02b5b9408e20 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:19.511509 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bde576ae-706c-4491-b930-02b5b9408e20 admin admin] Pushing event updated for resources: {'Port': ['ID=7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:19.536919 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a40f4103-1b89-4dad-8f38-73d01da77e1d req-0ec81f41-fcbe-4f98-be00-5b1bada6df42 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:19.547374 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a40f4103-1b89-4dad-8f38-73d01da77e1d req-0ec81f41-fcbe-4f98-be00-5b1bada6df42 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=b521a440-0384-48fc-aaa9-13419003343e HTTP/1.1" status: 200 len: 935 time: 0.2847092 Dec 09 21:27:19.547763 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-c9937b88-5794-447c-99f0-3f10aeb4fe81 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:27:19.558712 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-c9937b88-5794-447c-99f0-3f10aeb4fe81 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:19.573326 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-c9937b88-5794-447c-99f0-3f10aeb4fe81 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:27:19.604430 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c338965-dd38-4791-90df-411c37f9993e req-f9103175-2e98-4f8a-8a76-ae1a21ad2d40 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:19.605206 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2c338965-dd38-4791-90df-411c37f9993e req-f9103175-2e98-4f8a-8a76-ae1a21ad2d40 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:19.647340 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-c9937b88-5794-447c-99f0-3f10aeb4fe81 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:19.648407 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-c9937b88-5794-447c-99f0-3f10aeb4fe81 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:19.659768 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bde576ae-706c-4491-b930-02b5b9408e20 admin admin] Network fc8cdf15-d749-4170-8af1-e4f121fd1c72 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:27:19.661907 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c338965-dd38-4791-90df-411c37f9993e req-f9103175-2e98-4f8a-8a76-ae1a21ad2d40 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 2.3328018 Dec 09 21:27:19.665605 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-bde576ae-706c-4491-b930-02b5b9408e20 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:19.672970 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e40b07e3-d448-4488-a2c7-d522f3a80a42 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=dd631239105645b6b7088738a5229b7f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3387287 Dec 09 21:27:19.672970 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bde576ae-706c-4491-b930-02b5b9408e20 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:27:19.680192 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40300) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:19.706579 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-2c338965-dd38-4791-90df-411c37f9993e req-16d16c2e-f224-4946-a3e5-b599161f1afe service neutron] Request body: {'port': {'device_id': 'b521a440-0384-48fc-aaa9-13419003343e', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:19.722163 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-04b32001-22cf-4fd0-8aff-1390842ee6cf admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=f8b3b783f4c54a789e9012e49667eaa1&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3108244 Dec 09 21:27:19.725154 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40302) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:19.739783 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-c9937b88-5794-447c-99f0-3f10aeb4fe81 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.8370028 Dec 09 21:27:19.741942 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bde576ae-706c-4491-b930-02b5b9408e20 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:19.814121 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-bf157e76-643f-44f5-8a35-00e9533c218b service neutron] Request body: {'port': {'device_id': 'f9370050-6da6-47ee-8b58-2b96e64a02fc', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:19.822972 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4749ac54-62a8-427b-955f-5d9b56cb2791 req-fcbefe46-78c0-489c-ac24-e03d0b1e9fe4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:19.832564 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4749ac54-62a8-427b-955f-5d9b56cb2791 req-fcbefe46-78c0-489c-ac24-e03d0b1e9fe4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 932 time: 0.3692071 Dec 09 21:27:19.948969 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a40f4103-1b89-4dad-8f38-73d01da77e1d req-80ad5fd7-d3aa-46a8-abbd-bf855cf7cc26 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3920634 Dec 09 21:27:19.949087 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d0e6de41-bc9f-4e6f-b7f7-2a377cd2152c None None] Provisioning complete for port 0ef815c5-fc54-4d19-b139-1eaa75cffde2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:19.949087 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d0e6de41-bc9f-4e6f-b7f7-2a377cd2152c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:20.047661 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2400575d-0b51-48ba-bd46-ed904f5cdbcd up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:20.048947 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-80b5698c-e80e-410b-8cad-633d48e267a5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:20.052797 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-bf157e76-643f-44f5-8a35-00e9533c218b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:20.063199 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2c338965-dd38-4791-90df-411c37f9993e req-16d16c2e-f224-4946-a3e5-b599161f1afe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:20.078971 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83302c3d-fc94-4bdc-a3c0-3ac89393d75b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:20.110619 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4749ac54-62a8-427b-955f-5d9b56cb2791 req-63563386-e1eb-48a9-8eec-bc1ab24de8ea tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2769647 Dec 09 21:27:20.111303 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-80b5698c-e80e-410b-8cad-633d48e267a5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:20.164112 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d0e6de41-bc9f-4e6f-b7f7-2a377cd2152c None None] Port 0ef815c5-fc54-4d19-b139-1eaa75cffde2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:27:20.164995 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-772368a2-456e-4a31-a910-8f9841355190 req-7a4d2f8c-e847-4f44-b51e-301ef0c56a54 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupsTestJSON-securitygroup-1066064235', 'description': 'tempest-description-1330925252'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:20.218010 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 2400575d-0b51-48ba-bd46-ed904f5cdbcd triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:20.218690 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:20.223704 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83302c3d-fc94-4bdc-a3c0-3ac89393d75b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:20.260963 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0183624-214b-496e-bf88-39db9e0c4522 req-25e9f21f-7dc3-4427-b3d7-98a4e112598e tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:20.263017 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c0183624-214b-496e-bf88-39db9e0c4522 req-25e9f21f-7dc3-4427-b3d7-98a4e112598e tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.1967924 Dec 09 21:27:20.294171 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-772368a2-456e-4a31-a910-8f9841355190 req-7a4d2f8c-e847-4f44-b51e-301ef0c56a54 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:20.350591 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f8f47645-5af5-4f4c-8d62-c524f28e60d8 None None] Provisioning complete for port 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:20.351102 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f8f47645-5af5-4f4c-8d62-c524f28e60d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:20.419366 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c0183624-214b-496e-bf88-39db9e0c4522 req-4665d0a8-a174-412b-b8cf-34c620e16673 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1325397 Dec 09 21:27:20.433534 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:20.469853 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83302c3d-fc94-4bdc-a3c0-3ac89393d75b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:20.473108 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83302c3d-fc94-4bdc-a3c0-3ac89393d75b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:20.477833 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-83302c3d-fc94-4bdc-a3c0-3ac89393d75b admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/eb498b70-4d2c-4ede-b27d-8f7d694bece9 HTTP/1.1" status: 204 len: 168 time: 0.7952893 Dec 09 21:27:20.496025 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 2400575d-0b51-48ba-bd46-ed904f5cdbcd, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2400575d-0b51-48ba-bd46-ed904f5cdbcd,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:20.529195 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83302c3d-fc94-4bdc-a3c0-3ac89393d75b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eb498b70-4d2c-4ede-b27d-8f7d694bece9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:20.533456 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:20.538263 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f8f47645-5af5-4f4c-8d62-c524f28e60d8 None None] Port 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:27:20.606655 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=2400575d-0b51-48ba-bd46-ed904f5cdbcd,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:20.679754 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-772368a2-456e-4a31-a910-8f9841355190 req-7a4d2f8c-e847-4f44-b51e-301ef0c56a54 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:20.690620 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-772368a2-456e-4a31-a910-8f9841355190 req-7a4d2f8c-e847-4f44-b51e-301ef0c56a54 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:20.743979 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-660f5c7b-fd67-4084-ac81-2d8ce77820ee req-ba6dd32c-7726-4ba2-b4ff-e01f13fb2725 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:20.748258 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-660f5c7b-fd67-4084-ac81-2d8ce77820ee req-ba6dd32c-7726-4ba2-b4ff-e01f13fb2725 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 0.1274045 Dec 09 21:27:20.752513 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-772368a2-456e-4a31-a910-8f9841355190 req-7a4d2f8c-e847-4f44-b51e-301ef0c56a54 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:20.753665 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-772368a2-456e-4a31-a910-8f9841355190 req-7a4d2f8c-e847-4f44-b51e-301ef0c56a54 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1825 time: 0.5932639 Dec 09 21:27:20.775106 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a4d2f8c-e847-4f44-b51e-301ef0c56a54 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fcc03377-adb3-4132-941b-ffa4bc0df861,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:20.804129 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bde576ae-706c-4491-b930-02b5b9408e20 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:20.821578 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-047b835a-c328-4580-83ce-8e9029e3eed6 req-60f1ee9b-c932-4b6d-8574-d78a202d8aae tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupsTestJSON-securitygroup-1329481412', 'description': 'tempest-description-1375744998'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:20.860798 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-2c338965-dd38-4791-90df-411c37f9993e req-16d16c2e-f224-4946-a3e5-b599161f1afe service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0ef815c5-fc54-4d19-b139-1eaa75cffde2 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:27:20.873378 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2c338965-dd38-4791-90df-411c37f9993e req-16d16c2e-f224-4946-a3e5-b599161f1afe service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:20.901187 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-660f5c7b-fd67-4084-ac81-2d8ce77820ee req-139eb3f5-1dc2-44d3-86c2-0042b3803110 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1443946 Dec 09 21:27:20.913867 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-2c338965-dd38-4791-90df-411c37f9993e req-16d16c2e-f224-4946-a3e5-b599161f1afe service neutron] Transition to ACTIVE for port object 0ef815c5-fc54-4d19-b139-1eaa75cffde2 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:27:20.916130 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-047b835a-c328-4580-83ce-8e9029e3eed6 req-60f1ee9b-c932-4b6d-8574-d78a202d8aae tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:20.922642 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-80b5698c-e80e-410b-8cad-633d48e267a5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:20.925331 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-80b5698c-e80e-410b-8cad-633d48e267a5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:20.926477 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-80b5698c-e80e-410b-8cad-633d48e267a5 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/311d4b92-14f8-4511-8f88-1dc905946c73 HTTP/1.1" status: 204 len: 168 time: 1.2004657 Dec 09 21:27:20.932703 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2c338965-dd38-4791-90df-411c37f9993e req-16d16c2e-f224-4946-a3e5-b599161f1afe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:20.940738 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80b5698c-e80e-410b-8cad-633d48e267a5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=311d4b92-14f8-4511-8f88-1dc905946c73,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:21.142748 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-bf157e76-643f-44f5-8a35-00e9533c218b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a6dac932-4c7b-404f-a089-32576a768d83 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:27:21.162550 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-bf157e76-643f-44f5-8a35-00e9533c218b service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:21.188151 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-bf157e76-643f-44f5-8a35-00e9533c218b service neutron] Transition to ACTIVE for port object a6dac932-4c7b-404f-a089-32576a768d83 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:27:21.199288 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bde576ae-706c-4491-b930-02b5b9408e20 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:21.201816 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-bf157e76-643f-44f5-8a35-00e9533c218b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:21.243854 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bde576ae-706c-4491-b930-02b5b9408e20 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:21.266281 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16d16c2e-f224-4946-a3e5-b599161f1afe service neutron] Pushing event updated for resources: {'Port': ['ID=0ef815c5-fc54-4d19-b139-1eaa75cffde2,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:21.319563 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a190741d-8c4e-42b7-bd24-338b6a3126b4 req-8c74dd39-5430-46d7-add8-e8700280e1ad tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:21.329913 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a190741d-8c4e-42b7-bd24-338b6a3126b4 req-8c74dd39-5430-46d7-add8-e8700280e1ad tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=b521a440-0384-48fc-aaa9-13419003343e HTTP/1.1" status: 200 len: 947 time: 0.2336125 Dec 09 21:27:21.378389 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-2c338965-dd38-4791-90df-411c37f9993e req-16d16c2e-f224-4946-a3e5-b599161f1afe service neutron] Attempting to bind port 0ef815c5-fc54-4d19-b139-1eaa75cffde2 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:27:21.378929 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-2c338965-dd38-4791-90df-411c37f9993e req-16d16c2e-f224-4946-a3e5-b599161f1afe service neutron] Attempting to bind port 0ef815c5-fc54-4d19-b139-1eaa75cffde2 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:27:21.379493 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c338965-dd38-4791-90df-411c37f9993e req-16d16c2e-f224-4946-a3e5-b599161f1afe service neutron] Attempting to bind port 0ef815c5-fc54-4d19-b139-1eaa75cffde2 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:21.402391 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c338965-dd38-4791-90df-411c37f9993e req-16d16c2e-f224-4946-a3e5-b599161f1afe service neutron] Port 0ef815c5-fc54-4d19-b139-1eaa75cffde2 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:27:21.402972 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c338965-dd38-4791-90df-411c37f9993e req-16d16c2e-f224-4946-a3e5-b599161f1afe service neutron] Attempting to bind port 0ef815c5-fc54-4d19-b139-1eaa75cffde2 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:21.424180 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf157e76-643f-44f5-8a35-00e9533c218b service neutron] Pushing event updated for resources: {'Port': ['ID=a6dac932-4c7b-404f-a089-32576a768d83,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:21.427306 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-047b835a-c328-4580-83ce-8e9029e3eed6 req-60f1ee9b-c932-4b6d-8574-d78a202d8aae tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:21.435334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c338965-dd38-4791-90df-411c37f9993e req-16d16c2e-f224-4946-a3e5-b599161f1afe service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 26, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:27:21.435933 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c338965-dd38-4791-90df-411c37f9993e req-16d16c2e-f224-4946-a3e5-b599161f1afe service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:27:21.436515 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c338965-dd38-4791-90df-411c37f9993e req-16d16c2e-f224-4946-a3e5-b599161f1afe service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:27:21.437156 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-2c338965-dd38-4791-90df-411c37f9993e req-16d16c2e-f224-4946-a3e5-b599161f1afe service neutron] Bound port: 0ef815c5-fc54-4d19-b139-1eaa75cffde2, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:27:21.437698 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2c338965-dd38-4791-90df-411c37f9993e req-16d16c2e-f224-4946-a3e5-b599161f1afe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:21.457020 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-047b835a-c328-4580-83ce-8e9029e3eed6 req-60f1ee9b-c932-4b6d-8574-d78a202d8aae tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:21.480184 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a190741d-8c4e-42b7-bd24-338b6a3126b4 req-604e3f29-8124-42f0-a017-e8dd1f3ef504 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1493614 Dec 09 21:27:21.500119 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bde576ae-706c-4491-b930-02b5b9408e20 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:21.512689 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bde576ae-706c-4491-b930-02b5b9408e20 admin admin] Pushing event updated for resources: {'Port': ['ID=7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:21.549263 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-047b835a-c328-4580-83ce-8e9029e3eed6 req-60f1ee9b-c932-4b6d-8574-d78a202d8aae tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:21.551055 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-bf157e76-643f-44f5-8a35-00e9533c218b service neutron] Attempting to bind port a6dac932-4c7b-404f-a089-32576a768d83 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:27:21.551474 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-bf157e76-643f-44f5-8a35-00e9533c218b service neutron] Attempting to bind port a6dac932-4c7b-404f-a089-32576a768d83 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:27:21.551902 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-bf157e76-643f-44f5-8a35-00e9533c218b service neutron] Attempting to bind port a6dac932-4c7b-404f-a089-32576a768d83 on network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:21.558449 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-bf157e76-643f-44f5-8a35-00e9533c218b service neutron] Port a6dac932-4c7b-404f-a089-32576a768d83 on network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:27:21.559175 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-bf157e76-643f-44f5-8a35-00e9533c218b service neutron] Attempting to bind port a6dac932-4c7b-404f-a089-32576a768d83 on network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:21.578748 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-047b835a-c328-4580-83ce-8e9029e3eed6 req-60f1ee9b-c932-4b6d-8574-d78a202d8aae tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1825 time: 0.7650971 Dec 09 21:27:21.579905 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-bf157e76-643f-44f5-8a35-00e9533c218b service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 26, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:27:21.581893 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60f1ee9b-c932-4b6d-8574-d78a202d8aae tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event updated for resources: {'SecurityGroup': ['ID=cdc6e27b-dfad-461a-82c4-cf68a29a9802,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:21.582046 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-bf157e76-643f-44f5-8a35-00e9533c218b service neutron] Checking segment: {'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:27:21.582914 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-bf157e76-643f-44f5-8a35-00e9533c218b service neutron] Bound using segment: {'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:27:21.582914 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-bf157e76-643f-44f5-8a35-00e9533c218b service neutron] Bound port: a6dac932-4c7b-404f-a089-32576a768d83, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:27:21.585493 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-bf157e76-643f-44f5-8a35-00e9533c218b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:21.691953 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-2c338965-dd38-4791-90df-411c37f9993e req-16d16c2e-f224-4946-a3e5-b599161f1afe service neutron] For port 0ef815c5-fc54-4d19-b139-1eaa75cffde2, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:27:21.697992 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-2c338965-dd38-4791-90df-411c37f9993e req-16d16c2e-f224-4946-a3e5-b599161f1afe service neutron] For port 0ef815c5-fc54-4d19-b139-1eaa75cffde2, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=0ef815c5-fc54-4d19-b139-1eaa75cffde2,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:27:21.711751 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bde576ae-706c-4491-b930-02b5b9408e20 admin admin] Network fc8cdf15-d749-4170-8af1-e4f121fd1c72 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:27:21.715385 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-bde576ae-706c-4491-b930-02b5b9408e20 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:21.717757 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-bf157e76-643f-44f5-8a35-00e9533c218b service neutron] For port a6dac932-4c7b-404f-a089-32576a768d83, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:27:21.738081 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-bf157e76-643f-44f5-8a35-00e9533c218b service neutron] For port a6dac932-4c7b-404f-a089-32576a768d83, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a6dac932-4c7b-404f-a089-32576a768d83,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:27:21.747608 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2c338965-dd38-4791-90df-411c37f9993e req-16d16c2e-f224-4946-a3e5-b599161f1afe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:21.781843 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-bf157e76-643f-44f5-8a35-00e9533c218b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:21.834529 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-bf157e76-643f-44f5-8a35-00e9533c218b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:21.835747 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-bf157e76-643f-44f5-8a35-00e9533c218b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:21.837782 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-bf157e76-643f-44f5-8a35-00e9533c218b service neutron] 10.222.0.31 "PUT /v2.0/ports/a6dac932-4c7b-404f-a089-32576a768d83 HTTP/1.1" status: 200 len: 1093 time: 2.0297577 Dec 09 21:27:21.841940 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f9370050-6da6-47ee-8b58-2b96e64a02fc', 'tag': 'a6dac932-4c7b-404f-a089-32576a768d83'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:27:21.845344 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f903a9ae-4df0-4ef8-aef3-9103ad0c1c44" -d '{"events": [{"name": "network-changed", "server_uuid": "f9370050-6da6-47ee-8b58-2b96e64a02fc", "tag": "a6dac932-4c7b-404f-a089-32576a768d83"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:27:21.905663 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40356) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:21.936026 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16d16c2e-f224-4946-a3e5-b599161f1afe service neutron] Pushing event updated for resources: {'Port': ['ID=0ef815c5-fc54-4d19-b139-1eaa75cffde2,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:21.961103 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c338965-dd38-4791-90df-411c37f9993e req-16d16c2e-f224-4946-a3e5-b599161f1afe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:21.961724 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2c338965-dd38-4791-90df-411c37f9993e req-16d16c2e-f224-4946-a3e5-b599161f1afe service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:21.963749 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c338965-dd38-4791-90df-411c37f9993e req-16d16c2e-f224-4946-a3e5-b599161f1afe service neutron] 10.222.0.10 "PUT /v2.0/ports/0ef815c5-fc54-4d19-b139-1eaa75cffde2 HTTP/1.1" status: 200 len: 1096 time: 2.2860913 Dec 09 21:27:21.969958 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2400575d-0b51-48ba-bd46-ed904f5cdbcd up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:21.987078 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf157e76-643f-44f5-8a35-00e9533c218b service neutron] Pushing event updated for resources: {'Port': ['ID=a6dac932-4c7b-404f-a089-32576a768d83,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:21.992495 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-050c40a1-c11f-4f43-9610-4cfd58875559 req-691304ed-c7e2-4af4-9596-e88d461d8ef7 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:22.006350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-050c40a1-c11f-4f43-9610-4cfd58875559 req-691304ed-c7e2-4af4-9596-e88d461d8ef7 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 944 time: 0.4015903 Dec 09 21:27:22.007147 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b521a440-0384-48fc-aaa9-13419003343e', 'tag': '0ef815c5-fc54-4d19-b139-1eaa75cffde2'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:27:22.010522 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4fd78958-52ab-40c2-9c50-c54feccb94bb" -d '{"events": [{"name": "network-changed", "server_uuid": "b521a440-0384-48fc-aaa9-13419003343e", "tag": "0ef815c5-fc54-4d19-b139-1eaa75cffde2"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:27:22.031871 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdde9da7-f051-4e7c-b486-2c66a1a1504d req-0a186c45-b37a-4636-970d-f86ffbae9c8a tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:22.033483 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fdde9da7-f051-4e7c-b486-2c66a1a1504d req-0a186c45-b37a-4636-970d-f86ffbae9c8a tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.3339605 Dec 09 21:27:22.044826 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-65c8717b-5f08-4ac9-acfd-be0acd40f7d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:22.049032 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-65c8717b-5f08-4ac9-acfd-be0acd40f7d7 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=1b7916b634f74760a565cfeaef510cd9&device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 1096 time: 0.1412292 Dec 09 21:27:22.071746 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bde576ae-706c-4491-b930-02b5b9408e20 admin admin] Router 31a00d4e-6581-4747-824c-a35acf7b5352 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:27:22.132466 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 2400575d-0b51-48ba-bd46-ed904f5cdbcd triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:22.132848 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:22.146156 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-50967cff-d0a6-4902-8ae6-bf44de6d6f6f service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=a6dac932-4c7b-404f-a089-32576a768d83 HTTP/1.1" status: 200 len: 217 time: 0.0868404 Dec 09 21:27:22.184846 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-050c40a1-c11f-4f43-9610-4cfd58875559 req-911faaec-92dc-428d-ac43-77cd17b25342 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1475456 Dec 09 21:27:22.242482 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c338965-dd38-4791-90df-411c37f9993e req-61553b0b-aa15-4598-8524-25910764cd32 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:22.252341 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c338965-dd38-4791-90df-411c37f9993e req-61553b0b-aa15-4598-8524-25910764cd32 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&device_id=b521a440-0384-48fc-aaa9-13419003343e HTTP/1.1" status: 200 len: 1099 time: 0.2166312 Dec 09 21:27:22.258019 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fdde9da7-f051-4e7c-b486-2c66a1a1504d req-fbf3d9f4-ac08-4fa7-9671-195a7a4de30b tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1679180 Dec 09 21:27:22.281857 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-d536d390-1dcd-4ea9-9a62-7a3d9f5c1ef6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:22.283383 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-d536d390-1dcd-4ea9-9a62-7a3d9f5c1ef6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=50496955-1646-4079-acd4-a47e8cd175cb HTTP/1.1" status: 200 len: 852 time: 0.1239700 Dec 09 21:27:22.350952 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1b14541f-0cf2-49f4-9960-3d523eda300d None None] Provisioning complete for port 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:22.351327 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1b14541f-0cf2-49f4-9960-3d523eda300d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:22.367254 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c338965-dd38-4791-90df-411c37f9993e req-462d379c-6792-4a47-9bbb-c013ffdd7912 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.11&port_id=0ef815c5-fc54-4d19-b139-1eaa75cffde2 HTTP/1.1" status: 200 len: 217 time: 0.0984504 Dec 09 21:27:22.386427 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-46f87f25-67df-4d55-b5a8-22e2c5bbc61f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0850360 Dec 09 21:27:22.387874 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:27:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1e582356-c7e1-40e7-ade8-98b21b21dd18 x-openstack-request-id: req-1e582356-c7e1-40e7-ade8-98b21b21dd18 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:27:22.388275 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f9370050-6da6-47ee-8b58-2b96e64a02fc", "tag": "a6dac932-4c7b-404f-a089-32576a768d83", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:27:22.388564 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-1e582356-c7e1-40e7-ade8-98b21b21dd18 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:27:22.388990 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f9370050-6da6-47ee-8b58-2b96e64a02fc', 'tag': 'a6dac932-4c7b-404f-a089-32576a768d83', 'status': 'completed', 'code': 200} Dec 09 21:27:22.416540 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-1b14541f-0cf2-49f4-9960-3d523eda300d None None] Port 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:27:22.495747 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-465ddab9-a1b5-4e93-9bac-42d35a85ee2f admin admin] Request body: {'network': {'name': 'tempest-TaggedBootDevicesTest_v242-1825188234-network', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:22.524747 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c338965-dd38-4791-90df-411c37f9993e req-f460682f-d505-4380-a835-4d9db5cd479b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:22.526320 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c338965-dd38-4791-90df-411c37f9993e req-f460682f-d505-4380-a835-4d9db5cd479b service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1409883 Dec 09 21:27:22.574479 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bde576ae-706c-4491-b930-02b5b9408e20 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:27:22.577972 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-a2782d32-4b42-4c18-a7fc-58e9cf4101c9 service neutron] 10.222.0.31 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1394765 Dec 09 21:27:22.581907 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bde576ae-706c-4491-b930-02b5b9408e20 admin admin] 10.222.0.13 "PUT /v2.0/routers/31a00d4e-6581-4747-824c-a35acf7b5352/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.4699523 Dec 09 21:27:22.589845 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e91784fc-44d1-462f-97ad-8b2bbeeb4ac2 req-202bcf26-3bec-482b-bd76-a23c3b03f2bd tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:22.591474 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e91784fc-44d1-462f-97ad-8b2bbeeb4ac2 req-202bcf26-3bec-482b-bd76-a23c3b03f2bd tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 0.1638198 Dec 09 21:27:22.593904 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] Sync routers for ids ['31a00d4e-6581-4747-824c-a35acf7b5352'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:27:22.596243 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-465ddab9-a1b5-4e93-9bac-42d35a85ee2f admin admin] Made reservation on behalf of 0a5d0e4652be4d8b87936a559840cc87 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:27:22.598506 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-465ddab9-a1b5-4e93-9bac-42d35a85ee2f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:22.610017 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] Routers {'31a00d4e-6581-4747-824c-a35acf7b5352'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:27:22.611030 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:27:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['31a00d4e-6581-4747-824c-a35acf7b5352'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:22.619297 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-2ff2a054-23a0-44cd-a6a6-850ba8269147 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:22.628396 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-2ff2a054-23a0-44cd-a6a6-850ba8269147 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/networks?id=de91a458-cde4-4265-8605-31d9b6f8f05f HTTP/1.1" status: 200 len: 810 time: 0.2800415 Dec 09 21:27:22.642119 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-465ddab9-a1b5-4e93-9bac-42d35a85ee2f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:22.682450 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-366e8be7-6194-4048-b62c-a80bc564465f tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/quotas/5635fb0018b24f538b250cdac6dca9d9 HTTP/1.1" status: 200 len: 375 time: 0.0532784 Dec 09 21:27:22.702357 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c338965-dd38-4791-90df-411c37f9993e req-edf862ef-4c6c-473d-a6c1-162aa3566a5f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:22.704199 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c338965-dd38-4791-90df-411c37f9993e req-edf862ef-4c6c-473d-a6c1-162aa3566a5f service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1627159 Dec 09 21:27:22.705408 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bb882608-eace-4e2b-b463-cc55e9ebc094 req-a12966f0-efb2-4ac5-a485-5da6e00a2c5f service neutron] 10.222.0.31 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1195467 Dec 09 21:27:22.751032 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] Set router 31a00d4e-6581-4747-824c-a35acf7b5352 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:27:22.778018 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e91784fc-44d1-462f-97ad-8b2bbeeb4ac2 req-e236716b-f3fb-49af-9770-4d9c66e29677 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1760709 Dec 09 21:27:22.860767 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f903a9ae-4df0-4ef8-aef3-9103ad0c1c44 req-a8dd7585-2c96-496f-81b7-aa7b44e7cc55 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:22.868265 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f903a9ae-4df0-4ef8-aef3-9103ad0c1c44 req-a8dd7585-2c96-496f-81b7-aa7b44e7cc55 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=1b7916b634f74760a565cfeaef510cd9&device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 1096 time: 0.1023030 Dec 09 21:27:22.879299 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-e5aeb72d-7a8f-493e-a42a-89db63aca629 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=5635fb0018b24f538b250cdac6dca9d9&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1799750 Dec 09 21:27:22.925904 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:27:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f052fe40-0728-4e26-aba9-f7a73413eeef x-openstack-request-id: req-f052fe40-0728-4e26-aba9-f7a73413eeef {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:27:22.928165 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b521a440-0384-48fc-aaa9-13419003343e", "tag": "0ef815c5-fc54-4d19-b139-1eaa75cffde2", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:27:22.929207 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f052fe40-0728-4e26-aba9-f7a73413eeef {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:27:22.933602 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b521a440-0384-48fc-aaa9-13419003343e', 'tag': '0ef815c5-fc54-4d19-b139-1eaa75cffde2', 'status': 'completed', 'code': 200} Dec 09 21:27:22.971098 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f903a9ae-4df0-4ef8-aef3-9103ad0c1c44 req-b090782d-5393-4184-aa9e-9d5f4cd4af4d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:22.973200 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f903a9ae-4df0-4ef8-aef3-9103ad0c1c44 req-b090782d-5393-4184-aa9e-9d5f4cd4af4d service neutron] 10.222.0.31 "GET /v2.0/networks?id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb HTTP/1.1" status: 200 len: 913 time: 0.0975308 Dec 09 21:27:23.003355 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c338965-dd38-4791-90df-411c37f9993e req-25565628-985f-4f73-b969-7f0db175ea90 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2848866 Dec 09 21:27:23.005176 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '31a00d4e-6581-4747-824c-a35acf7b5352', 'name': 'tempest-TaggedBootDevicesTest-1740845933-router', 'tenant_id': 'f8441d8d390b442691a162db541a51b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.158'}], 'enable_snat': True}, 'gw_port_id': '2400575d-0b51-48ba-bd46-ed904f5cdbcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:10Z', 'updated_at': '2021-12-09T21:27:20Z', 'revision_number': 4, 'project_id': 'f8441d8d390b442691a162db541a51b0', 'gw_port': {'id': '2400575d-0b51-48ba-bd46-ed904f5cdbcd', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:0d:d4:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '31a00d4e-6581-4747-824c-a35acf7b5352', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1093, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:11Z', 'updated_at': '2021-12-09T21:27:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f', 'name': '', 'network_id': 'fc8cdf15-d749-4170-8af1-e4f121fd1c72', 'tenant_id': 'f8441d8d390b442691a162db541a51b0', 'mac_address': 'fa:16:3e:bd:91:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '31a00d4e-6581-4747-824c-a35acf7b5352', 'device_owner': 'network:router_interface', 'standard_attr_id': 1096, 'fixed_ips': [{'subnet_id': 'feaf79a7-d79d-4e19-b68a-52abdef41e8b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:18Z', 'updated_at': '2021-12-09T21:27:20Z', 'revision_number': 2, 'project_id': 'f8441d8d390b442691a162db541a51b0', 'subnets': [{'id': 'feaf79a7-d79d-4e19-b68a-52abdef41e8b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:23.012016 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-465ddab9-a1b5-4e93-9bac-42d35a85ee2f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:23.043632 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] Checking router: 31a00d4e-6581-4747-824c-a35acf7b5352 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:27:23.044249 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] Updating router 31a00d4e-6581-4747-824c-a35acf7b5352 port 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:27:23.056850 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-465ddab9-a1b5-4e93-9bac-42d35a85ee2f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:23.070688 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f903a9ae-4df0-4ef8-aef3-9103ad0c1c44 req-6f893f1d-7b9e-4c7a-9b3e-b7fa6dcb920d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=a6dac932-4c7b-404f-a089-32576a768d83 HTTP/1.1" status: 200 len: 217 time: 0.0859718 Dec 09 21:27:23.071247 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-465ddab9-a1b5-4e93-9bac-42d35a85ee2f admin admin] vlan segment allocate from pool success with {'vlan_id': 148, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:27:23.074968 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:23.082456 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-465ddab9-a1b5-4e93-9bac-42d35a85ee2f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:23.082940 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-465ddab9-a1b5-4e93-9bac-42d35a85ee2f admin admin] Added segment 7cf32f95-b9ab-465b-889c-7d7de3246a6f of type vlan for network 361619eb-51a4-4728-b2cc-72e27ec4eca5 Dec 09 21:27:23.167771 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f903a9ae-4df0-4ef8-aef3-9103ad0c1c44 req-adc60106-fc40-4840-8578-4b23be341bd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:23.170910 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f903a9ae-4df0-4ef8-aef3-9103ad0c1c44 req-adc60106-fc40-4840-8578-4b23be341bd0 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=50496955-1646-4079-acd4-a47e8cd175cb HTTP/1.1" status: 200 len: 852 time: 0.0911956 Dec 09 21:27:23.220633 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f903a9ae-4df0-4ef8-aef3-9103ad0c1c44 req-960de70f-4208-4b7f-b509-d59897dec8dc service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0409088 Dec 09 21:27:23.240332 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-465ddab9-a1b5-4e93-9bac-42d35a85ee2f admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:23.251743 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-c01e376e-bdd9-4cd8-8c69-ea74bae18575 service neutron] 10.222.0.13 "GET /v2.0/networks/de91a458-cde4-4265-8605-31d9b6f8f05f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3713472 Dec 09 21:27:23.290577 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-465ddab9-a1b5-4e93-9bac-42d35a85ee2f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ae1d5335-d417-46c6-9564-e81ad355759f,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:23.414924 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f903a9ae-4df0-4ef8-aef3-9103ad0c1c44 req-fda68ade-5073-48dc-afc2-c18229069c0d service neutron] 10.222.0.31 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1831121 Dec 09 21:27:23.434801 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-465ddab9-a1b5-4e93-9bac-42d35a85ee2f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:23.436179 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-465ddab9-a1b5-4e93-9bac-42d35a85ee2f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:23.436719 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-465ddab9-a1b5-4e93-9bac-42d35a85ee2f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:23.475186 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:23.484817 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:23.520578 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c338965-dd38-4791-90df-411c37f9993e req-d626835b-a497-489a-9f4b-e6df5984614b service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4756494 Dec 09 21:27:23.568815 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-205ca55e-9f39-4650-aa7d-986189f522ba None None] Pushing event updated for resources: {'Port': ['ID=7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:23.600703 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-465ddab9-a1b5-4e93-9bac-42d35a85ee2f admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 1.6791120 Dec 09 21:27:23.608709 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-465ddab9-a1b5-4e93-9bac-42d35a85ee2f admin admin] Pushing event updated for resources: {'Network': ['ID=361619eb-51a4-4728-b2cc-72e27ec4eca5,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:23.610424 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40442) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:23.619761 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 361619eb-51a4-4728-b2cc-72e27ec4eca5 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:27:23.651269 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-5a4342d3-9e45-4ac3-9e36-59cdc49b2906 service neutron] 10.222.0.13 "GET /v2.0/networks/de91a458-cde4-4265-8605-31d9b6f8f05f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3979282 Dec 09 21:27:23.672532 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31e0a760-963b-4a11-a147-d4e6a7cc9b91 req-4629997a-7f6f-4ada-9e9b-34060423532c tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:23.680616 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31e0a760-963b-4a11-a147-d4e6a7cc9b91 req-4629997a-7f6f-4ada-9e9b-34060423532c tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=b521a440-0384-48fc-aaa9-13419003343e HTTP/1.1" status: 200 len: 947 time: 0.2846005 Dec 09 21:27:23.684490 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-884d5f62-817c-4228-955a-84eab0ac2cd3 admin admin] Request body: {'subnet': {'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5', 'cidr': '172.20.0.0/28', 'name': 'tempest-TaggedBootDevicesTest_v242-1825188234-subnet', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:23.729422 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f903a9ae-4df0-4ef8-aef3-9103ad0c1c44 req-546a894f-9a77-4f75-824e-e03e7fecc305 service neutron] 10.222.0.31 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3084173 Dec 09 21:27:23.729594 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fd78958-52ab-40c2-9c50-c54feccb94bb req-4c6b8e07-edc1-42ab-b6e0-71c9517303f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:23.732478 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fd78958-52ab-40c2-9c50-c54feccb94bb req-4c6b8e07-edc1-42ab-b6e0-71c9517303f2 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&device_id=b521a440-0384-48fc-aaa9-13419003343e HTTP/1.1" status: 200 len: 1099 time: 0.1285443 Dec 09 21:27:23.755252 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] Attempting to bind port 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:27:23.756563 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] Attempting to bind port 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'cba73bdd-55aa-420b-957f-16ad6c3beaed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': 'fc8cdf15-d749-4170-8af1-e4f121fd1c72'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:27:23.759009 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] Attempting to bind port 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f on network fc8cdf15-d749-4170-8af1-e4f121fd1c72 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:23.759531 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-884d5f62-817c-4228-955a-84eab0ac2cd3 admin admin] Made reservation on behalf of 0a5d0e4652be4d8b87936a559840cc87 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:27:23.762195 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-884d5f62-817c-4228-955a-84eab0ac2cd3 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:23.775022 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 27, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:27:23.775547 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] Checking segment: {'id': 'cba73bdd-55aa-420b-957f-16ad6c3beaed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': 'fc8cdf15-d749-4170-8af1-e4f121fd1c72'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:27:23.776029 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:23.777336 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] Bound using segment: {'id': 'cba73bdd-55aa-420b-957f-16ad6c3beaed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': 'fc8cdf15-d749-4170-8af1-e4f121fd1c72'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:27:23.778358 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] Bound port: 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cba73bdd-55aa-420b-957f-16ad6c3beaed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': 'fc8cdf15-d749-4170-8af1-e4f121fd1c72'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:27:23.779209 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:23.823638 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31e0a760-963b-4a11-a147-d4e6a7cc9b91 req-ad9f589b-bddc-4713-87ed-8f37ff386ee6 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1419005 Dec 09 21:27:24.009018 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fd78958-52ab-40c2-9c50-c54feccb94bb req-ee90f6c2-eec6-4b4a-886d-6201ef918d77 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:24.011917 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fd78958-52ab-40c2-9c50-c54feccb94bb req-ee90f6c2-eec6-4b4a-886d-6201ef918d77 service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.2706182 Dec 09 21:27:24.094539 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] For port 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:27:24.110137 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] For port 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f,segment=NetworkSegment(cba73bdd-55aa-420b-957f-16ad6c3beaed),segment_id=cba73bdd-55aa-420b-957f-16ad6c3beaed)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:27:24.112294 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-09f4c16e-cc04-4937-90fd-f950a0be9c39 None None] Provisioning complete for port 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:24.113120 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-09f4c16e-cc04-4937-90fd-f950a0be9c39 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:24.116595 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-884d5f62-817c-4228-955a-84eab0ac2cd3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:24.119175 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fd78958-52ab-40c2-9c50-c54feccb94bb req-a12eec28-937a-4d98-b582-5acf3d5689ea service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.11&port_id=0ef815c5-fc54-4d19-b139-1eaa75cffde2 HTTP/1.1" status: 200 len: 217 time: 0.0860555 Dec 09 21:27:24.123295 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:24.218945 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1836904-13c8-44fb-b29a-070eb4fdf9c0 req-cd743349-9788-4c2a-807a-715266d90b1a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:24.230094 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d1836904-13c8-44fb-b29a-070eb4fdf9c0 req-cd743349-9788-4c2a-807a-715266d90b1a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 944 time: 0.2391620 Dec 09 21:27:24.269336 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-09f4c16e-cc04-4937-90fd-f950a0be9c39 None None] Port 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:27:24.307190 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fd78958-52ab-40c2-9c50-c54feccb94bb req-19a45c3a-c257-4652-a61b-086e067fe0e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:24.308495 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-205ca55e-9f39-4650-aa7d-986189f522ba None None] Pushing event updated for resources: {'Port': ['ID=7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:24.308849 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fd78958-52ab-40c2-9c50-c54feccb94bb req-19a45c3a-c257-4652-a61b-086e067fe0e4 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1820769 Dec 09 21:27:24.323392 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-884d5f62-817c-4228-955a-84eab0ac2cd3 admin admin] Checking segment: {'id': '7cf32f95-b9ab-465b-889c-7d7de3246a6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:27:24.326243 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-884d5f62-817c-4228-955a-84eab0ac2cd3 admin admin] Network hostable DHCP agents. Network: 361619eb-51a4-4728-b2cc-72e27ec4eca5, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:27:24.336991 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-884d5f62-817c-4228-955a-84eab0ac2cd3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d989acab-7cdc-482f-a350-344dd6e11873,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:24.383735 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] Routers {'31a00d4e-6581-4747-824c-a35acf7b5352'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:27:24.385595 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:27:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['31a00d4e-6581-4747-824c-a35acf7b5352'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:24.398636 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-884d5f62-817c-4228-955a-84eab0ac2cd3 admin admin] Network 361619eb-51a4-4728-b2cc-72e27ec4eca5 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:27:24.399421 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2822185-3964-47ce-b8bc-0906edddab53 req-3cf3c68c-c6f6-469f-bb1e-078093cd81b6 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:24.401033 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d2822185-3964-47ce-b8bc-0906edddab53 req-3cf3c68c-c6f6-469f-bb1e-078093cd81b6 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.1655712 Dec 09 21:27:24.432738 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d1836904-13c8-44fb-b29a-070eb4fdf9c0 req-0f52e62a-d4db-4e57-8e07-a58f2ba80337 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2009852 Dec 09 21:27:24.436823 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-884d5f62-817c-4228-955a-84eab0ac2cd3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 361619eb-51a4-4728-b2cc-72e27ec4eca5) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:24.444450 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-884d5f62-817c-4228-955a-84eab0ac2cd3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:24.446202 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-884d5f62-817c-4228-955a-84eab0ac2cd3 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:24.455976 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce8e5703-31f1-4f79-87bc-e2f94d49c09c None None] Network 361619eb-51a4-4728-b2cc-72e27ec4eca5 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:27:24.492580 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-884d5f62-817c-4228-955a-84eab0ac2cd3 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 0.8553815 Dec 09 21:27:24.494650 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40494) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:24.501106 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fd78958-52ab-40c2-9c50-c54feccb94bb req-68b5e0fe-29f9-4436-aa3d-9066165d1ae4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:24.502630 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fd78958-52ab-40c2-9c50-c54feccb94bb req-68b5e0fe-29f9-4436-aa3d-9066165d1ae4 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1781778 Dec 09 21:27:24.521035 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-61ab8267-aaf9-4f1b-8eda-fc88b4c6c9b4 admin admin] Request body: {'router': {'name': 'tempest-TaggedBootDevicesTest_v242-1825188234-router', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:24.590929 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-61ab8267-aaf9-4f1b-8eda-fc88b4c6c9b4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:24.595053 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-61ab8267-aaf9-4f1b-8eda-fc88b4c6c9b4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:24.708373 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-61ab8267-aaf9-4f1b-8eda-fc88b4c6c9b4 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:24.765508 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] Set router 31a00d4e-6581-4747-824c-a35acf7b5352 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:27:24.801419 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53ebe0e9-7ff8-4862-8cd8-7a96a3e10881 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-361619eb-51a4-4728-b2cc-72e27ec4eca5', 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5', 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'fixed_ips': [{'subnet_id': 'd989acab-7cdc-482f-a350-344dd6e11873'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:27:24.803128 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-53ebe0e9-7ff8-4862-8cd8-7a96a3e10881 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:24.836332 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-db50f937-7041-4eb1-a978-3f33ef596b67 None None] Provisioning complete for port 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:24.836814 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-db50f937-7041-4eb1-a978-3f33ef596b67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:24.882342 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d2822185-3964-47ce-b8bc-0906edddab53 req-81d46b5c-e633-4e73-a1e1-ed1f974e4d57 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4149039 Dec 09 21:27:25.002363 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fd78958-52ab-40c2-9c50-c54feccb94bb req-10ccef3b-fc4b-4795-82d7-41db93d924c0 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4850006 Dec 09 21:27:25.050142 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-61ab8267-aaf9-4f1b-8eda-fc88b4c6c9b4 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:25.083897 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-db50f937-7041-4eb1-a978-3f33ef596b67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:25.099115 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-53ebe0e9-7ff8-4862-8cd8-7a96a3e10881 None None] Allocated IP 172.20.0.2 (361619eb-51a4-4728-b2cc-72e27ec4eca5/d989acab-7cdc-482f-a350-344dd6e11873/86083fc5-2b62-435e-b3a7-5150d6e88905) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:27:25.196596 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-db50f937-7041-4eb1-a978-3f33ef596b67 None None] For port 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f,segment=NetworkSegment(cba73bdd-55aa-420b-957f-16ad6c3beaed),segment_id=cba73bdd-55aa-420b-957f-16ad6c3beaed)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:25.215630 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-95e31ee8-2305-4133-b5ed-e3a24addc9a0 req-dda86538-2785-4b79-a1c6-9016accdb1be tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.3709674 Dec 09 21:27:25.369191 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fee2885b-8a06-4a73-89d7-0e7406c54378 req-7128999e-95f8-4fb6-a348-e5e16ca68b17 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:25.378824 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fee2885b-8a06-4a73-89d7-0e7406c54378 req-7128999e-95f8-4fb6-a348-e5e16ca68b17 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 0.1575720 Dec 09 21:27:25.425344 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-61ab8267-aaf9-4f1b-8eda-fc88b4c6c9b4 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:25.437608 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device a6dac932-4c7b-404f-a089-32576a768d83 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:27:25.450108 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-61ab8267-aaf9-4f1b-8eda-fc88b4c6c9b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:25.458486 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fd78958-52ab-40c2-9c50-c54feccb94bb req-f12ac148-c9a6-4153-8a05-d989edb9a752 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4465039 Dec 09 21:27:25.466268 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '31a00d4e-6581-4747-824c-a35acf7b5352', 'name': 'tempest-TaggedBootDevicesTest-1740845933-router', 'tenant_id': 'f8441d8d390b442691a162db541a51b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.158'}], 'enable_snat': True}, 'gw_port_id': '2400575d-0b51-48ba-bd46-ed904f5cdbcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:10Z', 'updated_at': '2021-12-09T21:27:20Z', 'revision_number': 4, 'project_id': 'f8441d8d390b442691a162db541a51b0', 'gw_port': {'id': '2400575d-0b51-48ba-bd46-ed904f5cdbcd', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:0d:d4:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '31a00d4e-6581-4747-824c-a35acf7b5352', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1093, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:11Z', 'updated_at': '2021-12-09T21:27:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f', 'name': '', 'network_id': 'fc8cdf15-d749-4170-8af1-e4f121fd1c72', 'tenant_id': 'f8441d8d390b442691a162db541a51b0', 'mac_address': 'fa:16:3e:bd:91:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '31a00d4e-6581-4747-824c-a35acf7b5352', 'device_owner': 'network:router_interface', 'standard_attr_id': 1096, 'fixed_ips': [{'subnet_id': 'feaf79a7-d79d-4e19-b68a-52abdef41e8b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:18Z', 'updated_at': '2021-12-09T21:27:24Z', 'revision_number': 4, 'project_id': 'f8441d8d390b442691a162db541a51b0', 'subnets': [{'id': 'feaf79a7-d79d-4e19-b68a-52abdef41e8b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:25.475025 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cfedc749-61bb-4fb1-b7d6-63e2e37e4460 req-c78b22df-33b8-46f3-a91f-e7082b204b20 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 210 time: 0.0932732 Dec 09 21:27:25.529789 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fee2885b-8a06-4a73-89d7-0e7406c54378 req-7c47f0c0-43fe-4b6e-ad36-f9c24205219a tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1489336 Dec 09 21:27:25.537280 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50cfef52-b55e-498c-b487-aa9bc8c865cf None None] The sync data for ids ['31a00d4e-6581-4747-824c-a35acf7b5352'] in n-d-713301-27 is: [{'id': '31a00d4e-6581-4747-824c-a35acf7b5352', 'name': 'tempest-TaggedBootDevicesTest-1740845933-router', 'tenant_id': 'f8441d8d390b442691a162db541a51b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.158'}], 'enable_snat': True}, 'gw_port_id': '2400575d-0b51-48ba-bd46-ed904f5cdbcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:10Z', 'updated_at': '2021-12-09T21:27:20Z', 'revision_number': 4, 'project_id': 'f8441d8d390b442691a162db541a51b0', 'gw_port': {'id': '2400575d-0b51-48ba-bd46-ed904f5cdbcd', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:0d:d4:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '31a00d4e-6581-4747-824c-a35acf7b5352', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1093, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:11Z', 'updated_at': '2021-12-09T21:27:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f', 'name': '', 'network_id': 'fc8cdf15-d749-4170-8af1-e4f121fd1c72', 'tenant_id': 'f8441d8d390b442691a162db541a51b0', 'mac_address': 'fa:16:3e:bd:91:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '31a00d4e-6581-4747-824c-a35acf7b5352', 'device_owner': 'network:router_interface', 'standard_attr_id': 1096, 'fixed_ips': [{'subnet_id': 'feaf79a7-d79d-4e19-b68a-52abdef41e8b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:18Z', 'updated_at': '2021-12-09T21:27:24Z', 'revision_number': 4, 'project_id': 'f8441d8d390b442691a162db541a51b0', 'subnets': [{'id': 'feaf79a7-d79d-4e19-b68a-52abdef41e8b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:27:25.612035 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-db50f937-7041-4eb1-a978-3f33ef596b67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:25.701386 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-61ab8267-aaf9-4f1b-8eda-fc88b4c6c9b4 admin admin] Allocated IP 172.25.3.97 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/f29fe8cc-72a3-485b-a257-8a8081d710b1) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:27:25.724331 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-53ebe0e9-7ff8-4862-8cd8-7a96a3e10881 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:25.751494 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-53ebe0e9-7ff8-4862-8cd8-7a96a3e10881 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:25.824625 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1caf7610-58a8-4511-a611-fff0587cb3ac req-74f6f1a0-e59b-4d06-9458-567c965fdda4 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:25.828783 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1caf7610-58a8-4511-a611-fff0587cb3ac req-74f6f1a0-e59b-4d06-9458-567c965fdda4 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=b521a440-0384-48fc-aaa9-13419003343e HTTP/1.1" status: 200 len: 947 time: 0.1816809 Dec 09 21:27:25.918078 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-61ab8267-aaf9-4f1b-8eda-fc88b4c6c9b4 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:25.937910 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1caf7610-58a8-4511-a611-fff0587cb3ac req-cda7abbb-95d5-45fd-a80b-fbec50cdc45e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1016827 Dec 09 21:27:26.012641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f914803-6ba4-4b96-91de-05f259e46471 req-5cd32cda-2377-4b30-99ba-89f8948dbe42 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:26.019602 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1f914803-6ba4-4b96-91de-05f259e46471 req-5cd32cda-2377-4b30-99ba-89f8948dbe42 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 944 time: 0.2956336 Dec 09 21:27:26.029871 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-61ab8267-aaf9-4f1b-8eda-fc88b4c6c9b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:26.046607 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:26.064018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port a6dac932-4c7b-404f-a089-32576a768d83, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a6dac932-4c7b-404f-a089-32576a768d83,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:26.071193 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db50f937-7041-4eb1-a978-3f33ef596b67 None None] Pushing event updated for resources: {'Port': ['ID=7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:26.140356 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61ab8267-aaf9-4f1b-8eda-fc88b4c6c9b4 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:27:26.154492 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-61ab8267-aaf9-4f1b-8eda-fc88b4c6c9b4 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:26.156637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53ebe0e9-7ff8-4862-8cd8-7a96a3e10881 None None] Network 361619eb-51a4-4728-b2cc-72e27ec4eca5 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:27:26.158130 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'a6dac932-4c7b-404f-a089-32576a768d83', 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb', 'port_id': 'a6dac932-4c7b-404f-a089-32576a768d83', 'mac_address': 'fa:16:3e:fb:11:53', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 101, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '50496955-1646-4079-acd4-a47e8cd175cb', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:27:26.159306 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61ab8267-aaf9-4f1b-8eda-fc88b4c6c9b4 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:27:26.179788 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-53ebe0e9-7ff8-4862-8cd8-7a96a3e10881 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:26.192978 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53ebe0e9-7ff8-4862-8cd8-7a96a3e10881 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:27:26.236718 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53ebe0e9-7ff8-4862-8cd8-7a96a3e10881 None None] Pushing event updated for resources: {'Port': ['ID=86083fc5-2b62-435e-b3a7-5150d6e88905,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:26.238064 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61ab8267-aaf9-4f1b-8eda-fc88b4c6c9b4 admin admin] Pushing event updated for resources: {'Port': ['ID=f29fe8cc-72a3-485b-a257-8a8081d710b1,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:26.405876 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 0ef815c5-fc54-4d19-b139-1eaa75cffde2 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:27:26.428478 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:26.429186 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:26.470437 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:26.482929 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-53ebe0e9-7ff8-4862-8cd8-7a96a3e10881 None None] Attempting to bind port 86083fc5-2b62-435e-b3a7-5150d6e88905 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:27:26.483279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-53ebe0e9-7ff8-4862-8cd8-7a96a3e10881 None None] Attempting to bind port 86083fc5-2b62-435e-b3a7-5150d6e88905 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '7cf32f95-b9ab-465b-889c-7d7de3246a6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:27:26.483668 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53ebe0e9-7ff8-4862-8cd8-7a96a3e10881 None None] Attempting to bind port 86083fc5-2b62-435e-b3a7-5150d6e88905 on network 361619eb-51a4-4728-b2cc-72e27ec4eca5 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:26.543392 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53ebe0e9-7ff8-4862-8cd8-7a96a3e10881 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 27, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:27:26.544133 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53ebe0e9-7ff8-4862-8cd8-7a96a3e10881 None None] Checking segment: {'id': '7cf32f95-b9ab-465b-889c-7d7de3246a6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:27:26.545219 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-53ebe0e9-7ff8-4862-8cd8-7a96a3e10881 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:26.545809 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53ebe0e9-7ff8-4862-8cd8-7a96a3e10881 None None] Bound using segment: {'id': '7cf32f95-b9ab-465b-889c-7d7de3246a6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:27:26.546470 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-53ebe0e9-7ff8-4862-8cd8-7a96a3e10881 None None] Bound port: 86083fc5-2b62-435e-b3a7-5150d6e88905, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7cf32f95-b9ab-465b-889c-7d7de3246a6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:27:26.547039 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-53ebe0e9-7ff8-4862-8cd8-7a96a3e10881 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:26.563902 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a6dac932-4c7b-404f-a089-32576a768d83 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:27:26.604697 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ad98d-7b38-48c5-8d08-c71a174ee5c8 req-dffbc4ff-a486-46be-a642-86acb2ca9e42 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.0481319 Dec 09 21:27:26.619847 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-61ab8267-aaf9-4f1b-8eda-fc88b4c6c9b4 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:26.635358 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port a6dac932-4c7b-404f-a089-32576a768d83, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a6dac932-4c7b-404f-a089-32576a768d83,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:26.679941 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f61da48f-ba31-4a35-b200-c2a839d8dd53 req-ecfdba05-ff89-48dc-abc2-02d4f5a161eb tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:26.681466 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f61da48f-ba31-4a35-b200-c2a839d8dd53 req-ecfdba05-ff89-48dc-abc2-02d4f5a161eb tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.1800828 Dec 09 21:27:26.695570 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:26.822382 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-60b696e7-e16a-470e-82d8-78308a999f41 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:26.824803 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-60b696e7-e16a-470e-82d8-78308a999f41 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.10 "GET /v2.0/networks?id=de91a458-cde4-4265-8605-31d9b6f8f05f HTTP/1.1" status: 200 len: 810 time: 0.8608148 Dec 09 21:27:26.855261 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-084f5fae-30fe-4c60-a0f1-cce54b245c66 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Request body: {'port': {'device_id': '21566c6e-f8d2-4122-ac9c-f052ec7a451c', 'network_id': 'de91a458-cde4-4265-8605-31d9b6f8f05f', 'admin_state_up': True, 'tenant_id': '5635fb0018b24f538b250cdac6dca9d9'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:26.856452 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 0ef815c5-fc54-4d19-b139-1eaa75cffde2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=0ef815c5-fc54-4d19-b139-1eaa75cffde2,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:26.869996 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '0ef815c5-fc54-4d19-b139-1eaa75cffde2', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '0ef815c5-fc54-4d19-b139-1eaa75cffde2', 'mac_address': 'fa:16:3e:49:85:aa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:27:26.917172 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1f914803-6ba4-4b96-91de-05f259e46471 req-41efcb3f-ade6-4ec0-8b03-37b7688366df tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4129050 Dec 09 21:27:26.937585 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=a6dac932-4c7b-404f-a089-32576a768d83,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:26.967071 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-53ebe0e9-7ff8-4862-8cd8-7a96a3e10881 None None] For port 86083fc5-2b62-435e-b3a7-5150d6e88905, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:27:26.968269 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f61da48f-ba31-4a35-b200-c2a839d8dd53 req-bf9fcab1-d27e-4b22-bc78-94dec41de205 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2732844 Dec 09 21:27:26.988357 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-53ebe0e9-7ff8-4862-8cd8-7a96a3e10881 None None] For port 86083fc5-2b62-435e-b3a7-5150d6e88905, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=86083fc5-2b62-435e-b3a7-5150d6e88905,segment=NetworkSegment(7cf32f95-b9ab-465b-889c-7d7de3246a6f),segment_id=7cf32f95-b9ab-465b-889c-7d7de3246a6f)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:27:26.989760 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:27.003029 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-53ebe0e9-7ff8-4862-8cd8-7a96a3e10881 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:27.034702 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-61ab8267-aaf9-4f1b-8eda-fc88b4c6c9b4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:27.047946 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['a6dac932-4c7b-404f-a089-32576a768d83'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:27:27.127782 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0ef815c5-fc54-4d19-b139-1eaa75cffde2 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:27:27.138699 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b401fd0-aef5-40d9-8663-dfcac73b0153 req-ce9dd3dc-2d24-45b7-a51d-ed097ac592fb tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 210 time: 0.0570850 Dec 09 21:27:27.283404 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-084f5fae-30fe-4c60-a0f1-cce54b245c66 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Made reservation on behalf of 5635fb0018b24f538b250cdac6dca9d9 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:27:27.283404 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-084f5fae-30fe-4c60-a0f1-cce54b245c66 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:27.299322 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 0ef815c5-fc54-4d19-b139-1eaa75cffde2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=0ef815c5-fc54-4d19-b139-1eaa75cffde2,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:27.316791 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53ebe0e9-7ff8-4862-8cd8-7a96a3e10881 None None] Pushing event updated for resources: {'Port': ['ID=86083fc5-2b62-435e-b3a7-5150d6e88905,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:27.327533 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:27.328635 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:27.364090 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7a82aa2d-7283-478a-89d4-befa83c8aa52 req-84c2fc26-c1ff-49a1-8289-1e286134c1d4 tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.1225486 Dec 09 21:27:27.369320 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:27.453288 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=0ef815c5-fc54-4d19-b139-1eaa75cffde2,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:27.454657 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5ba4eca-29a7-46aa-8fa2-2e375ec91844 req-b24f33e3-da11-4bc0-98ea-efa652135bbc tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:27.471023 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e5ba4eca-29a7-46aa-8fa2-2e375ec91844 req-b24f33e3-da11-4bc0-98ea-efa652135bbc tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 0.2312686 Dec 09 21:27:27.631182 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['0ef815c5-fc54-4d19-b139-1eaa75cffde2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:27:27.823821 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09a5a1e3-ffee-4076-8bda-eca201ec2c15 req-fcd72de4-b07e-4828-8fd0-ce4bb9155f6e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:27.825415 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09a5a1e3-ffee-4076-8bda-eca201ec2c15 req-fcd72de4-b07e-4828-8fd0-ce4bb9155f6e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=b521a440-0384-48fc-aaa9-13419003343e HTTP/1.1" status: 200 len: 948 time: 0.2848272 Dec 09 21:27:27.913085 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e5ba4eca-29a7-46aa-8fa2-2e375ec91844 req-68ed4516-fe5a-4ebc-86e8-f087546543aa tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4315758 Dec 09 21:27:27.924244 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-084f5fae-30fe-4c60-a0f1-cce54b245c66 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Allocated IP 172.20.0.6 (de91a458-cde4-4265-8605-31d9b6f8f05f/cb187a9c-ec94-4995-93f8-92c16c7a80a3/117119cd-9d6a-4e2a-94cc-9578db376ba6) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:27:27.973735 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-61ab8267-aaf9-4f1b-8eda-fc88b4c6c9b4 admin admin] Router 4757617b-081d-4a51-a741-443e352d3856 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:27:27.982335 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09a5a1e3-ffee-4076-8bda-eca201ec2c15 req-bee2f032-e5f7-4eb8-b849-5e5524441254 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1382153 Dec 09 21:27:28.125158 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 86083fc5-2b62-435e-b3a7-5150d6e88905 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:28.135273 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-61ab8267-aaf9-4f1b-8eda-fc88b4c6c9b4 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:27:28.159416 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-61ab8267-aaf9-4f1b-8eda-fc88b4c6c9b4 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:28.164943 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-61ab8267-aaf9-4f1b-8eda-fc88b4c6c9b4 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 3.6677423 Dec 09 21:27:28.166077 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40528) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:28.166755 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] Sync routers for ids ['4757617b-081d-4a51-a741-443e352d3856'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:27:28.192194 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] Routers {'4757617b-081d-4a51-a741-443e352d3856'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:27:28.192194 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:27:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4757617b-081d-4a51-a741-443e352d3856'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:28.231592 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-950e61cd-1a7d-49c4-9f73-9bfb66f6d5b8 req-05aa3b57-5677-487a-831f-99c2142e1bbd tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:28.236985 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-950e61cd-1a7d-49c4-9f73-9bfb66f6d5b8 req-05aa3b57-5677-487a-831f-99c2142e1bbd tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.1396143 Dec 09 21:27:28.257087 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 86083fc5-2b62-435e-b3a7-5150d6e88905 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:28.257459 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:28.263773 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-192cfc53-fd65-423b-a536-ae9073d99fbb req-9d6fa4b9-12d8-439f-b180-1d99b91bb9b0 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:28.265509 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-192cfc53-fd65-423b-a536-ae9073d99fbb req-9d6fa4b9-12d8-439f-b180-1d99b91bb9b0 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 945 time: 0.2424705 Dec 09 21:27:28.394870 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] Set router 4757617b-081d-4a51-a741-443e352d3856 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:27:28.449343 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-950e61cd-1a7d-49c4-9f73-9bfb66f6d5b8 req-d4376d5c-6309-407c-b2ae-f1a2cf8737dd tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1747258 Dec 09 21:27:28.453334 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-084f5fae-30fe-4c60-a0f1-cce54b245c66 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:28.464537 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-192cfc53-fd65-423b-a536-ae9073d99fbb req-b3555618-cb46-4512-8904-97bfeb8252e1 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1865551 Dec 09 21:27:28.633321 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fd3214ef-a69f-4a15-ac6b-0117f07aa809 req-257867bb-0a9c-4dd0-973d-36f7cf513487 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 210 time: 0.0907381 Dec 09 21:27:28.690106 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:28.700090 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d0780f4f-4bbb-4067-ae3d-4eca53adb012 req-255895ac-b2a8-4ec6-bb60-c8a58772782e tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.0803142 Dec 09 21:27:28.732909 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-084f5fae-30fe-4c60-a0f1-cce54b245c66 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:28.754154 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:27:28.838796 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 86083fc5-2b62-435e-b3a7-5150d6e88905, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=86083fc5-2b62-435e-b3a7-5150d6e88905,segment=NetworkSegment(7cf32f95-b9ab-465b-889c-7d7de3246a6f),segment_id=7cf32f95-b9ab-465b-889c-7d7de3246a6f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:28.851511 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-084f5fae-30fe-4c60-a0f1-cce54b245c66 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Network de91a458-cde4-4265-8605-31d9b6f8f05f is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:27:28.861138 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4757617b-081d-4a51-a741-443e352d3856', 'name': 'tempest-TaggedBootDevicesTest_v242-1825188234-router', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97'}], 'enable_snat': True}, 'gw_port_id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:24Z', 'updated_at': '2021-12-09T21:27:26Z', 'revision_number': 3, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'gw_port': {'id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1113, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:25Z', 'updated_at': '2021-12-09T21:27:25Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:28.867314 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-374b09de-6724-4f87-b0cc-dc063d8be874 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:28.870473 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:28.871938 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:28.875107 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-084f5fae-30fe-4c60-a0f1-cce54b245c66 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:28.889402 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-084f5fae-30fe-4c60-a0f1-cce54b245c66 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:27:28.898316 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-084f5fae-30fe-4c60-a0f1-cce54b245c66 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event updated for resources: {'Port': ['ID=117119cd-9d6a-4e2a-94cc-9578db376ba6,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:29.020621 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-084f5fae-30fe-4c60-a0f1-cce54b245c66 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:29.031685 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-084f5fae-30fe-4c60-a0f1-cce54b245c66 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:29.062364 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=86083fc5-2b62-435e-b3a7-5150d6e88905,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:29.067427 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c841ec0-817a-48d8-bc19-fa5f999c11e8 None None] Network 361619eb-51a4-4728-b2cc-72e27ec4eca5 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:27:29.094871 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] Checking router: 4757617b-081d-4a51-a741-443e352d3856 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:27:29.095279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] Updating router 4757617b-081d-4a51-a741-443e352d3856 port f29fe8cc-72a3-485b-a257-8a8081d710b1 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:27:29.123072 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-374b09de-6724-4f87-b0cc-dc063d8be874 admin admin] Allocated IP 172.20.0.1 (361619eb-51a4-4728-b2cc-72e27ec4eca5/d989acab-7cdc-482f-a350-344dd6e11873/19d4a80e-ba79-4490-8a95-e9c7e2370cf8) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:27:29.157630 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-084f5fae-30fe-4c60-a0f1-cce54b245c66 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.3170354 Dec 09 21:27:29.158378 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:29.174113 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-199d2940-0016-4990-9f07-1360c7dae856 service neutron] Request body: {'port': {'device_id': '21566c6e-f8d2-4122-ac9c-f052ec7a451c', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:29.184861 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08af2a37-3dff-481a-bf3b-48a57f175a3f req-fbab9a25-d49e-42a3-988a-d5ebd96d08a0 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:29.186633 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-08af2a37-3dff-481a-bf3b-48a57f175a3f req-fbab9a25-d49e-42a3-988a-d5ebd96d08a0 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 0.1861889 Dec 09 21:27:29.192379 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9b83484e-17e3-4004-b442-87d882a02614 None None] Provisioning complete for port 86083fc5-2b62-435e-b3a7-5150d6e88905 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:29.192755 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9b83484e-17e3-4004-b442-87d882a02614 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:29.249886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f16b88b9-2216-4e9d-9453-4724a4075837 req-357c6884-9922-4b38-94d2-9a4e1adcdf5c tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:29.251598 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f16b88b9-2216-4e9d-9453-4724a4075837 req-357c6884-9922-4b38-94d2-9a4e1adcdf5c tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=b521a440-0384-48fc-aaa9-13419003343e HTTP/1.1" status: 200 len: 948 time: 0.1595790 Dec 09 21:27:29.277351 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-374b09de-6724-4f87-b0cc-dc063d8be874 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:29.338732 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-374b09de-6724-4f87-b0cc-dc063d8be874 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:29.356621 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-08af2a37-3dff-481a-bf3b-48a57f175a3f req-53e7ccad-6973-4a3b-9830-ef883c138c9c tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1433885 Dec 09 21:27:29.362299 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device a6dac932-4c7b-404f-a089-32576a768d83 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:29.371587 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-199d2940-0016-4990-9f07-1360c7dae856 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:29.384910 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-374b09de-6724-4f87-b0cc-dc063d8be874 admin admin] Network 361619eb-51a4-4728-b2cc-72e27ec4eca5 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:27:29.389626 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-374b09de-6724-4f87-b0cc-dc063d8be874 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:29.396023 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-374b09de-6724-4f87-b0cc-dc063d8be874 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:27:29.436676 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f16b88b9-2216-4e9d-9453-4724a4075837 req-f7527df5-e129-4157-a48f-c59199ebbfa0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1459129 Dec 09 21:27:29.438005 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-374b09de-6724-4f87-b0cc-dc063d8be874 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:29.494734 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-374b09de-6724-4f87-b0cc-dc063d8be874 admin admin] Pushing event updated for resources: {'Port': ['ID=19d4a80e-ba79-4490-8a95-e9c7e2370cf8,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:29.529053 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:29.530968 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:29.667741 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-374b09de-6724-4f87-b0cc-dc063d8be874 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:29.670341 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbc2a6bb-92b1-4828-9e72-0635bb763089 req-ed6d6432-805f-483b-b15b-0e7c818c282c tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:29.680094 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dbc2a6bb-92b1-4828-9e72-0635bb763089 req-ed6d6432-805f-483b-b15b-0e7c818c282c tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.1023176 Dec 09 21:27:29.800958 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dbc2a6bb-92b1-4828-9e72-0635bb763089 req-3e005208-9ea1-42e3-ad4a-bd84a7172020 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1195381 Dec 09 21:27:30.042654 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-374b09de-6724-4f87-b0cc-dc063d8be874 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:30.051048 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-199d2940-0016-4990-9f07-1360c7dae856 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 117119cd-9d6a-4e2a-94cc-9578db376ba6 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:27:30.056718 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-374b09de-6724-4f87-b0cc-dc063d8be874 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:30.067820 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-199d2940-0016-4990-9f07-1360c7dae856 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:30.087589 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-469ad168-7418-4808-b30a-165d06565bab req-7cb5ad6d-b644-419e-a085-5580a7de5875 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:30.099999 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-469ad168-7418-4808-b30a-165d06565bab req-7cb5ad6d-b644-419e-a085-5580a7de5875 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 945 time: 0.1591008 Dec 09 21:27:30.109837 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port a6dac932-4c7b-404f-a089-32576a768d83 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:27:30.142633 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5152a5c3-13d1-4be8-bedb-997798d56b88 req-4b34f57f-58f6-4e21-9756-0507c6e8a388 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:30.144890 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5152a5c3-13d1-4be8-bedb-997798d56b88 req-4b34f57f-58f6-4e21-9756-0507c6e8a388 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 931 time: 0.1422610 Dec 09 21:27:30.162241 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-199d2940-0016-4990-9f07-1360c7dae856 service neutron] Transition to ACTIVE for port object 117119cd-9d6a-4e2a-94cc-9578db376ba6 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:27:30.184636 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-199d2940-0016-4990-9f07-1360c7dae856 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:30.185861 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port a6dac932-4c7b-404f-a089-32576a768d83 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:30.186462 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:30.280022 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-374b09de-6724-4f87-b0cc-dc063d8be874 admin admin] Pushing event updated for resources: {'Port': ['ID=19d4a80e-ba79-4490-8a95-e9c7e2370cf8,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:30.293668 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-374b09de-6724-4f87-b0cc-dc063d8be874 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:30.311996 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-469ad168-7418-4808-b30a-165d06565bab req-e19930ec-15e2-4498-adb2-d2074034b51f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2101531 Dec 09 21:27:30.396280 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 0ef815c5-fc54-4d19-b139-1eaa75cffde2 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:30.408925 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-199d2940-0016-4990-9f07-1360c7dae856 service neutron] Pushing event updated for resources: {'Port': ['ID=117119cd-9d6a-4e2a-94cc-9578db376ba6,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:30.432023 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5152a5c3-13d1-4be8-bedb-997798d56b88 req-d5ca0918-28b5-4f84-b586-8328d4814aba tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2785022 Dec 09 21:27:30.514091 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 86083fc5-2b62-435e-b3a7-5150d6e88905 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:30.540477 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-374b09de-6724-4f87-b0cc-dc063d8be874 admin admin] Network 361619eb-51a4-4728-b2cc-72e27ec4eca5 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:27:30.552504 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-374b09de-6724-4f87-b0cc-dc063d8be874 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:30.643135 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de17331e-13c7-4d37-8375-ef6073e53dae req-6701b2dd-7976-4426-bfb8-62450b448dff tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.1508338 Dec 09 21:27:30.708025 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d8e6f3dc-e9b3-4ccf-97eb-9f891c953d97 None None] Provisioning complete for port 19d4a80e-ba79-4490-8a95-e9c7e2370cf8 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:30.708399 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d8e6f3dc-e9b3-4ccf-97eb-9f891c953d97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:30.779707 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a49568f-dbdd-4209-b774-cf4d8d81ac12 req-f7ff612b-5e89-4f15-a01f-439f58632776 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:30.788017 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5a49568f-dbdd-4209-b774-cf4d8d81ac12 req-f7ff612b-5e89-4f15-a01f-439f58632776 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 0.2118075 Dec 09 21:27:30.790082 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-199d2940-0016-4990-9f07-1360c7dae856 service neutron] Attempting to bind port 117119cd-9d6a-4e2a-94cc-9578db376ba6 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:27:30.790231 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-199d2940-0016-4990-9f07-1360c7dae856 service neutron] Attempting to bind port 117119cd-9d6a-4e2a-94cc-9578db376ba6 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'c472f4a8-1a94-4bb1-8978-a56e5ee37bb8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': 'de91a458-cde4-4265-8605-31d9b6f8f05f'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:27:30.790646 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-199d2940-0016-4990-9f07-1360c7dae856 service neutron] Attempting to bind port 117119cd-9d6a-4e2a-94cc-9578db376ba6 on network de91a458-cde4-4265-8605-31d9b6f8f05f {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:30.812115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-374b09de-6724-4f87-b0cc-dc063d8be874 admin admin] Router 4757617b-081d-4a51-a741-443e352d3856 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:27:30.813027 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:30.824086 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:30.851664 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 0ef815c5-fc54-4d19-b139-1eaa75cffde2 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:27:30.851947 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-199d2940-0016-4990-9f07-1360c7dae856 service neutron] Port 117119cd-9d6a-4e2a-94cc-9578db376ba6 on network de91a458-cde4-4265-8605-31d9b6f8f05f not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:27:30.852286 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-199d2940-0016-4990-9f07-1360c7dae856 service neutron] Attempting to bind port 117119cd-9d6a-4e2a-94cc-9578db376ba6 on network de91a458-cde4-4265-8605-31d9b6f8f05f {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:30.861788 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-199d2940-0016-4990-9f07-1360c7dae856 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 27, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:27:30.862154 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-199d2940-0016-4990-9f07-1360c7dae856 service neutron] Checking segment: {'id': 'c472f4a8-1a94-4bb1-8978-a56e5ee37bb8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': 'de91a458-cde4-4265-8605-31d9b6f8f05f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:27:30.862541 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-199d2940-0016-4990-9f07-1360c7dae856 service neutron] Bound using segment: {'id': 'c472f4a8-1a94-4bb1-8978-a56e5ee37bb8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': 'de91a458-cde4-4265-8605-31d9b6f8f05f'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:27:30.863119 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-199d2940-0016-4990-9f07-1360c7dae856 service neutron] Bound port: 117119cd-9d6a-4e2a-94cc-9578db376ba6, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c472f4a8-1a94-4bb1-8978-a56e5ee37bb8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': 'de91a458-cde4-4265-8605-31d9b6f8f05f'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:27:30.863349 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-199d2940-0016-4990-9f07-1360c7dae856 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:30.873026 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 0ef815c5-fc54-4d19-b139-1eaa75cffde2 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:30.873504 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:30.907532 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:30.969372 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd45a796-4d69-43f2-b0ee-6fdaa8f38523 req-3f2104d2-f7ae-4e33-ae8f-7d38e3476c1c tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:30.971049 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fd45a796-4d69-43f2-b0ee-6fdaa8f38523 req-3f2104d2-f7ae-4e33-ae8f-7d38e3476c1c tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=b521a440-0384-48fc-aaa9-13419003343e HTTP/1.1" status: 200 len: 948 time: 0.2030094 Dec 09 21:27:30.977747 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-374b09de-6724-4f87-b0cc-dc063d8be874 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:27:30.983978 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-374b09de-6724-4f87-b0cc-dc063d8be874 admin admin] 10.222.0.13 "PUT /v2.0/routers/4757617b-081d-4a51-a741-443e352d3856/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8168194 Dec 09 21:27:30.988878 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d8e6f3dc-e9b3-4ccf-97eb-9f891c953d97 None None] Port 19d4a80e-ba79-4490-8a95-e9c7e2370cf8 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:27:30.999276 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5a49568f-dbdd-4209-b774-cf4d8d81ac12 req-e0187705-adda-45a8-b5bc-1eb342db3a35 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2102654 Dec 09 21:27:31.035197 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] Attempting to bind port f29fe8cc-72a3-485b-a257-8a8081d710b1 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:27:31.035421 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] Attempting to bind port f29fe8cc-72a3-485b-a257-8a8081d710b1 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:27:31.035717 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] Attempting to bind port f29fe8cc-72a3-485b-a257-8a8081d710b1 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:31.052713 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 27, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:27:31.053178 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:27:31.053507 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:31.053902 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:27:31.054402 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] Bound port: f29fe8cc-72a3-485b-a257-8a8081d710b1, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:27:31.054782 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:31.113715 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] For port f29fe8cc-72a3-485b-a257-8a8081d710b1, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:27:31.117341 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] For port f29fe8cc-72a3-485b-a257-8a8081d710b1, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f29fe8cc-72a3-485b-a257-8a8081d710b1,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:27:31.118427 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f9370050-6da6-47ee-8b58-2b96e64a02fc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a6dac932-4c7b-404f-a089-32576a768d83'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:27:31.120161 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-199d2940-0016-4990-9f07-1360c7dae856 service neutron] For port 117119cd-9d6a-4e2a-94cc-9578db376ba6, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:27:31.121402 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1024ccac-8748-4a31-b565-84aa1c0f3a38" -d '{"events": [{"server_uuid": "f9370050-6da6-47ee-8b58-2b96e64a02fc", "name": "network-vif-plugged", "status": "completed", "tag": "a6dac932-4c7b-404f-a089-32576a768d83"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:27:31.164052 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-199d2940-0016-4990-9f07-1360c7dae856 service neutron] For port 117119cd-9d6a-4e2a-94cc-9578db376ba6, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=117119cd-9d6a-4e2a-94cc-9578db376ba6,segment=NetworkSegment(c472f4a8-1a94-4bb1-8978-a56e5ee37bb8),segment_id=c472f4a8-1a94-4bb1-8978-a56e5ee37bb8)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:27:31.171172 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fd45a796-4d69-43f2-b0ee-6fdaa8f38523 req-d9fa95d8-3ef0-4074-acd5-3a8040cf3b22 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1690583 Dec 09 21:27:31.179074 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:31.183097 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port a6dac932-4c7b-404f-a089-32576a768d83, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a6dac932-4c7b-404f-a089-32576a768d83,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:31.187688 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c22b6b88-172d-4ba3-9220-cf9192c3ed56 None None] Pushing event updated for resources: {'Port': ['ID=f29fe8cc-72a3-485b-a257-8a8081d710b1,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:31.194099 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d8e6f3dc-e9b3-4ccf-97eb-9f891c953d97 None None] Provisioning complete for port 86083fc5-2b62-435e-b3a7-5150d6e88905 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:31.194490 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d8e6f3dc-e9b3-4ccf-97eb-9f891c953d97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:31.201687 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 86083fc5-2b62-435e-b3a7-5150d6e88905 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:31.202153 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:31.203524 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-199d2940-0016-4990-9f07-1360c7dae856 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:31.227045 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:31.266267 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a096199-3326-4e84-b3f3-0022bfcc01fc req-c44dab3b-435c-4697-8ad7-a7885be5ca4d tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:31.274343 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2a096199-3326-4e84-b3f3-0022bfcc01fc req-c44dab3b-435c-4697-8ad7-a7885be5ca4d tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.1719558 Dec 09 21:27:31.275254 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:27:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ad96a97d-1700-4450-9fb5-f7e296cd1e71 x-openstack-request-id: req-ad96a97d-1700-4450-9fb5-f7e296cd1e71 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:27:31.275585 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f9370050-6da6-47ee-8b58-2b96e64a02fc", "name": "network-vif-plugged", "status": "completed", "tag": "a6dac932-4c7b-404f-a089-32576a768d83", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:27:31.275844 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-ad96a97d-1700-4450-9fb5-f7e296cd1e71 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:27:31.276240 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f9370050-6da6-47ee-8b58-2b96e64a02fc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a6dac932-4c7b-404f-a089-32576a768d83', 'code': 200} Dec 09 21:27:31.284449 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-199d2940-0016-4990-9f07-1360c7dae856 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:31.285332 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-199d2940-0016-4990-9f07-1360c7dae856 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:31.286801 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-199d2940-0016-4990-9f07-1360c7dae856 service neutron] 10.222.0.10 "PUT /v2.0/ports/117119cd-9d6a-4e2a-94cc-9578db376ba6 HTTP/1.1" status: 200 len: 1092 time: 2.1167693 Dec 09 21:27:31.288549 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '21566c6e-f8d2-4122-ac9c-f052ec7a451c', 'tag': '117119cd-9d6a-4e2a-94cc-9578db376ba6'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:27:31.290971 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1e105bc8-43b2-4304-8a7d-5902e872239d" -d '{"events": [{"name": "network-changed", "server_uuid": "21566c6e-f8d2-4122-ac9c-f052ec7a451c", "tag": "117119cd-9d6a-4e2a-94cc-9578db376ba6"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:27:31.300703 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:31.343039 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] Routers {'4757617b-081d-4a51-a741-443e352d3856'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:27:31.343727 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:27:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4757617b-081d-4a51-a741-443e352d3856'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:31.363518 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-199d2940-0016-4990-9f07-1360c7dae856 service neutron] Pushing event updated for resources: {'Port': ['ID=117119cd-9d6a-4e2a-94cc-9578db376ba6,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:31.404107 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:27:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9baa8f75-9a63-4ffa-915d-43c7e4c5d214 x-openstack-request-id: req-9baa8f75-9a63-4ffa-915d-43c7e4c5d214 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:27:31.404407 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "21566c6e-f8d2-4122-ac9c-f052ec7a451c", "tag": "117119cd-9d6a-4e2a-94cc-9578db376ba6", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:27:31.404662 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-9baa8f75-9a63-4ffa-915d-43c7e4c5d214 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:27:31.405074 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '21566c6e-f8d2-4122-ac9c-f052ec7a451c', 'tag': '117119cd-9d6a-4e2a-94cc-9578db376ba6', 'status': 'completed', 'code': 200} Dec 09 21:27:31.431020 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2a096199-3326-4e84-b3f3-0022bfcc01fc req-7853098b-ae6b-42ef-901b-6cfbeb71926a tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1556003 Dec 09 21:27:31.458633 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-08023a19-415a-40bd-9f02-6970af1e0663 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:31.461522 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-08023a19-415a-40bd-9f02-6970af1e0663 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=5635fb0018b24f538b250cdac6dca9d9&device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 1095 time: 0.0918336 Dec 09 21:27:31.462320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4f50e2f-3aa4-42ac-9294-82fa93b9fc46 req-67f33b22-039a-4f07-89c1-3506e6769e45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:31.463876 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d4f50e2f-3aa4-42ac-9294-82fa93b9fc46 req-67f33b22-039a-4f07-89c1-3506e6769e45 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 1098 time: 0.0849612 Dec 09 21:27:31.489414 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c22b6b88-172d-4ba3-9220-cf9192c3ed56 None None] Pushing event updated for resources: {'Port': ['ID=f29fe8cc-72a3-485b-a257-8a8081d710b1,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:31.495949 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 0ef815c5-fc54-4d19-b139-1eaa75cffde2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=0ef815c5-fc54-4d19-b139-1eaa75cffde2,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:31.546406 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:31.682822 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-f3cb8240-4b81-416e-bb30-a5f8f5c66c55 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=117119cd-9d6a-4e2a-94cc-9578db376ba6 HTTP/1.1" status: 200 len: 217 time: 0.2115366 Dec 09 21:27:31.705646 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=a6dac932-4c7b-404f-a089-32576a768d83,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:31.717614 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] Set router 4757617b-081d-4a51-a741-443e352d3856 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:27:31.802000 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d4f50e2f-3aa4-42ac-9294-82fa93b9fc46 req-0b18209d-3e0c-4026-855a-2bcc5bae37d5 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3282375 Dec 09 21:27:31.809928 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-49a18c00-751d-42df-9056-4f1d1c0e1e33 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:31.811522 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-49a18c00-751d-42df-9056-4f1d1c0e1e33 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=cb187a9c-ec94-4995-93f8-92c16c7a80a3 HTTP/1.1" status: 200 len: 850 time: 0.0978186 Dec 09 21:27:31.832423 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28dec60b-8bc5-4249-96a0-fa47d33035c9 req-a3b4aecc-f5b8-4a87-9483-8e382550f5f7 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:31.840092 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-28dec60b-8bc5-4249-96a0-fa47d33035c9 req-a3b4aecc-f5b8-4a87-9483-8e382550f5f7 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 946 time: 0.3180997 Dec 09 21:27:31.849350 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=0ef815c5-fc54-4d19-b139-1eaa75cffde2,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:31.850741 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dab6dc8-acbc-4dea-b541-ca1990bf4acb req-f355c16f-c917-4369-80e0-d271a7d3fec6 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:31.858143 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2dab6dc8-acbc-4dea-b541-ca1990bf4acb req-f355c16f-c917-4369-80e0-d271a7d3fec6 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 943 time: 0.1723437 Dec 09 21:27:31.879487 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c9aa8ab1-3d14-4eef-bd04-5365e0639fba None None] Provisioning complete for port 19d4a80e-ba79-4490-8a95-e9c7e2370cf8 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:31.879883 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c9aa8ab1-3d14-4eef-bd04-5365e0639fba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:31.903645 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-26f7d2dc-02d0-4bf2-b32a-99c6281d7af5 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=de91a458-cde4-4265-8605-31d9b6f8f05f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0615840 Dec 09 21:27:31.952334 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-c9aa8ab1-3d14-4eef-bd04-5365e0639fba None None] Port 19d4a80e-ba79-4490-8a95-e9c7e2370cf8 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:27:31.999804 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40600) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:32.005098 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-59a01dc9-9edc-459a-a995-b151fc3383d1 admin admin] Request body: {'network': {'name': 'tempest-TaggedBootDevicesTest_v242-485407257-network', 'tenant_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:32.032848 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-59a01dc9-9edc-459a-a995-b151fc3383d1 admin admin] Made reservation on behalf of c7a32d3f9ddc4d84b214b72938d8d6bd for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:27:32.035761 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59a01dc9-9edc-459a-a995-b151fc3383d1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:32.039351 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4757617b-081d-4a51-a741-443e352d3856', 'name': 'tempest-TaggedBootDevicesTest_v242-1825188234-router', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97'}], 'enable_snat': True}, 'gw_port_id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:24Z', 'updated_at': '2021-12-09T21:27:29Z', 'revision_number': 4, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'gw_port': {'id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1113, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:25Z', 'updated_at': '2021-12-09T21:27:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '19d4a80e-ba79-4490-8a95-e9c7e2370cf8', 'name': '', 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'mac_address': 'fa:16:3e:47:22:78', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_interface', 'standard_attr_id': 1115, 'fixed_ips': [{'subnet_id': 'd989acab-7cdc-482f-a350-344dd6e11873', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:28Z', 'updated_at': '2021-12-09T21:27:29Z', 'revision_number': 2, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'subnets': [{'id': 'd989acab-7cdc-482f-a350-344dd6e11873', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:32.045952 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59a01dc9-9edc-459a-a995-b151fc3383d1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:32.063627 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-28dec60b-8bc5-4249-96a0-fa47d33035c9 req-a8258041-678b-4888-a5d2-c9222aa73877 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2208579 Dec 09 21:27:32.080067 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2dab6dc8-acbc-4dea-b541-ca1990bf4acb req-e7213172-bccc-4d96-a40f-36baf33a825e tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1734197 Dec 09 21:27:32.089169 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a74be26-823a-4242-b00f-6382e8a3f794 None None] The sync data for ids ['4757617b-081d-4a51-a741-443e352d3856'] in n-d-713301-27 is: [{'id': '4757617b-081d-4a51-a741-443e352d3856', 'name': 'tempest-TaggedBootDevicesTest_v242-1825188234-router', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97'}], 'enable_snat': True}, 'gw_port_id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:24Z', 'updated_at': '2021-12-09T21:27:29Z', 'revision_number': 4, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'gw_port': {'id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1113, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:25Z', 'updated_at': '2021-12-09T21:27:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '19d4a80e-ba79-4490-8a95-e9c7e2370cf8', 'name': '', 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'mac_address': 'fa:16:3e:47:22:78', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_interface', 'standard_attr_id': 1115, 'fixed_ips': [{'subnet_id': 'd989acab-7cdc-482f-a350-344dd6e11873', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:28Z', 'updated_at': '2021-12-09T21:27:29Z', 'revision_number': 2, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'subnets': [{'id': 'd989acab-7cdc-482f-a350-344dd6e11873', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:27:32.124817 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-6fbb62a3-3b93-40a4-8d64-897a6d625e0f service neutron] 10.222.0.10 "GET /v2.0/networks/de91a458-cde4-4265-8605-31d9b6f8f05f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2027867 Dec 09 21:27:32.170741 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59a01dc9-9edc-459a-a995-b151fc3383d1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:32.191568 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59a01dc9-9edc-459a-a995-b151fc3383d1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:32.231140 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-59a01dc9-9edc-459a-a995-b151fc3383d1 admin admin] vlan segment allocate from pool success with {'vlan_id': 116, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:27:32.244590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59a01dc9-9edc-459a-a995-b151fc3383d1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6b84f656-3301-4a13-a1de-21553f1e9e68,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:32.251280 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7dda0db-cc25-422c-9326-6b380d9df8da req-e70ab1c6-632e-4f37-90ed-182dad543a8d tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.0610759 Dec 09 21:27:32.269090 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59a01dc9-9edc-459a-a995-b151fc3383d1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:32.269447 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-59a01dc9-9edc-459a-a995-b151fc3383d1 admin admin] Added segment b277bb60-9cde-4512-80aa-21951c30630a of type vlan for network 59e2b0d9-72ce-453d-a928-6c19b34a60c9 Dec 09 21:27:32.327779 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59a01dc9-9edc-459a-a995-b151fc3383d1 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:32.362305 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59a01dc9-9edc-459a-a995-b151fc3383d1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:32.363738 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-59a01dc9-9edc-459a-a995-b151fc3383d1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:32.364572 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59a01dc9-9edc-459a-a995-b151fc3383d1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:32.364763 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bd5ca0f-13a6-4529-97f4-250933e4698d req-36110448-4ced-4445-9551-eb1a0503d9f3 service neutron] 10.222.0.10 "GET /v2.0/networks/de91a458-cde4-4265-8605-31d9b6f8f05f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2269747 Dec 09 21:27:32.381559 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dade21c-9505-428a-b3c4-70cc68ba603e req-fd177af8-0079-419e-a537-5031f4bc045c tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:32.385170 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5dade21c-9505-428a-b3c4-70cc68ba603e req-fd177af8-0079-419e-a537-5031f4bc045c tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 0.1791759 Dec 09 21:27:32.418560 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-59a01dc9-9edc-459a-a995-b151fc3383d1 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.4148726 Dec 09 21:27:32.418905 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40606) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:32.459685 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-30a138bc-9d73-4d30-ae04-3fd4b7ec21cd admin admin] Request body: {'subnet': {'network_id': '59e2b0d9-72ce-453d-a928-6c19b34a60c9', 'cidr': '172.20.0.0/28', 'name': 'tempest-TaggedBootDevicesTest_v242-485407257-subnet', 'tenant_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:32.469384 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59a01dc9-9edc-459a-a995-b151fc3383d1 admin admin] Pushing event updated for resources: {'Network': ['ID=59e2b0d9-72ce-453d-a928-6c19b34a60c9,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:32.485287 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 59e2b0d9-72ce-453d-a928-6c19b34a60c9 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:27:32.523310 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-30a138bc-9d73-4d30-ae04-3fd4b7ec21cd admin admin] Made reservation on behalf of c7a32d3f9ddc4d84b214b72938d8d6bd for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:27:32.525891 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30a138bc-9d73-4d30-ae04-3fd4b7ec21cd admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:32.582121 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-614aad2d-914b-4d30-884a-62432aed7fb0 req-8e2fcb8c-eda7-44ac-977b-36bfd4e3b775 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:32.583893 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-614aad2d-914b-4d30-884a-62432aed7fb0 req-8e2fcb8c-eda7-44ac-977b-36bfd4e3b775 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=b521a440-0384-48fc-aaa9-13419003343e HTTP/1.1" status: 200 len: 949 time: 0.1976030 Dec 09 21:27:32.621460 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e105bc8-43b2-4304-8a7d-5902e872239d req-a5e735cb-98f2-4ad5-8ac2-46f6469a36b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:32.626172 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e105bc8-43b2-4304-8a7d-5902e872239d req-a5e735cb-98f2-4ad5-8ac2-46f6469a36b8 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=5635fb0018b24f538b250cdac6dca9d9&device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 1095 time: 0.1594002 Dec 09 21:27:32.663927 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5dade21c-9505-428a-b3c4-70cc68ba603e req-df75278a-3f6c-495d-b156-55a21df61edf tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2076068 Dec 09 21:27:32.804125 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-614aad2d-914b-4d30-884a-62432aed7fb0 req-8f4c46fe-07b2-4e1d-a179-223599406e7a tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2094736 Dec 09 21:27:32.857288 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e105bc8-43b2-4304-8a7d-5902e872239d req-384ac814-8691-410e-a3b4-581e2d6882d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:32.861769 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e105bc8-43b2-4304-8a7d-5902e872239d req-384ac814-8691-410e-a3b4-581e2d6882d6 service neutron] 10.222.0.10 "GET /v2.0/networks?id=de91a458-cde4-4265-8605-31d9b6f8f05f HTTP/1.1" status: 200 len: 911 time: 0.1936724 Dec 09 21:27:32.869266 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30a138bc-9d73-4d30-ae04-3fd4b7ec21cd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:32.946764 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9ca6f88b-1f18-47ae-ae18-ba1ac8783f38 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:32.956622 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e105bc8-43b2-4304-8a7d-5902e872239d req-4747dcba-543f-4e11-8a4c-56e585b761ad service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=117119cd-9d6a-4e2a-94cc-9578db376ba6 HTTP/1.1" status: 200 len: 217 time: 0.0841279 Dec 09 21:27:32.973742 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-371519d7-f607-44e3-bb37-5628a052745c req-8a861f3c-272b-48c8-8fb4-7f4b79e0bd48 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:32.982505 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30a138bc-9d73-4d30-ae04-3fd4b7ec21cd admin admin] Checking segment: {'id': 'b277bb60-9cde-4512-80aa-21951c30630a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '59e2b0d9-72ce-453d-a928-6c19b34a60c9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:27:32.983409 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30a138bc-9d73-4d30-ae04-3fd4b7ec21cd admin admin] Network hostable DHCP agents. Network: 59e2b0d9-72ce-453d-a928-6c19b34a60c9, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:27:32.984599 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-371519d7-f607-44e3-bb37-5628a052745c req-8a861f3c-272b-48c8-8fb4-7f4b79e0bd48 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.1951160 Dec 09 21:27:32.990419 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30a138bc-9d73-4d30-ae04-3fd4b7ec21cd admin admin] Pushing event updated for resources: {'Subnet': ['ID=549d348b-5c92-4b49-aa63-dbd8d0a93c5c,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:33.013534 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30a138bc-9d73-4d30-ae04-3fd4b7ec21cd admin admin] Network 59e2b0d9-72ce-453d-a928-6c19b34a60c9 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:27:33.031201 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-30a138bc-9d73-4d30-ae04-3fd4b7ec21cd admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 59e2b0d9-72ce-453d-a928-6c19b34a60c9) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:33.037285 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-30a138bc-9d73-4d30-ae04-3fd4b7ec21cd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:33.037782 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30a138bc-9d73-4d30-ae04-3fd4b7ec21cd admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:33.045610 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d172fdd-6aba-40a6-b655-72092869f508 None None] Network 59e2b0d9-72ce-453d-a928-6c19b34a60c9 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:27:33.094081 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-30a138bc-9d73-4d30-ae04-3fd4b7ec21cd admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.6739345 Dec 09 21:27:33.094737 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40614) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:33.100350 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e105bc8-43b2-4304-8a7d-5902e872239d req-04b8a458-3e45-4930-bf14-b1343579e3cf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:33.100937 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-66b0487c-b6a1-400b-a796-9659e64afca1 admin admin] Request body: {'router': {'name': 'tempest-TaggedBootDevicesTest_v242-485407257-router', 'tenant_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:33.102586 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e105bc8-43b2-4304-8a7d-5902e872239d req-04b8a458-3e45-4930-bf14-b1343579e3cf service neutron] 10.222.0.10 "GET /v2.0/subnets?id=cb187a9c-ec94-4995-93f8-92c16c7a80a3 HTTP/1.1" status: 200 len: 850 time: 0.1092465 Dec 09 21:27:33.149093 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e105bc8-43b2-4304-8a7d-5902e872239d req-13a8fbac-69a5-4c21-a691-0a2485172664 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=de91a458-cde4-4265-8605-31d9b6f8f05f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0384772 Dec 09 21:27:33.158478 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-66b0487c-b6a1-400b-a796-9659e64afca1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:33.159601 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-66b0487c-b6a1-400b-a796-9659e64afca1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:33.161828 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-371519d7-f607-44e3-bb37-5628a052745c req-e042285c-dd2f-436f-894e-f7d9a1c8809a tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1758444 Dec 09 21:27:33.274272 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-66b0487c-b6a1-400b-a796-9659e64afca1 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:33.322389 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f34c7639-bb59-4bfd-b8f9-4cdcff670428 req-ea2a3456-2bf2-41dc-85d0-c39bbd19a119 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:33.322692 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f34c7639-bb59-4bfd-b8f9-4cdcff670428 req-ea2a3456-2bf2-41dc-85d0-c39bbd19a119 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 946 time: 0.1208205 Dec 09 21:27:33.526620 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-66b0487c-b6a1-400b-a796-9659e64afca1 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:33.545762 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b521a440-0384-48fc-aaa9-13419003343e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0ef815c5-fc54-4d19-b139-1eaa75cffde2'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:27:33.548622 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8fc7ba04-4c00-43b2-a58d-e726eff240b3" -d '{"events": [{"server_uuid": "b521a440-0384-48fc-aaa9-13419003343e", "name": "network-vif-plugged", "status": "completed", "tag": "0ef815c5-fc54-4d19-b139-1eaa75cffde2"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:27:33.569496 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-903ec54a-bd1d-4338-9925-239cf422e68c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-59e2b0d9-72ce-453d-a928-6c19b34a60c9', 'network_id': '59e2b0d9-72ce-453d-a928-6c19b34a60c9', 'project_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'fixed_ips': [{'subnet_id': '549d348b-5c92-4b49-aa63-dbd8d0a93c5c'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:27:33.570790 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-903ec54a-bd1d-4338-9925-239cf422e68c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:33.773987 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e105bc8-43b2-4304-8a7d-5902e872239d req-ce7c3fa9-c086-42fa-ad4d-3f6a42ef7b97 service neutron] 10.222.0.10 "GET /v2.0/networks/de91a458-cde4-4265-8605-31d9b6f8f05f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6107948 Dec 09 21:27:33.778030 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-903ec54a-bd1d-4338-9925-239cf422e68c None None] Allocated IP 172.20.0.2 (59e2b0d9-72ce-453d-a928-6c19b34a60c9/549d348b-5c92-4b49-aa63-dbd8d0a93c5c/f465eaff-f85c-43ee-8cce-e6a6b7924ac1) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:27:33.841955 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-66b0487c-b6a1-400b-a796-9659e64afca1 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:33.872711 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-66b0487c-b6a1-400b-a796-9659e64afca1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:33.885640 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ab5852f-9a80-46d2-9ab2-22494fd99255 req-c216eab3-f256-4ff4-a66c-ab19e3e0e7f1 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:33.894913 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ab5852f-9a80-46d2-9ab2-22494fd99255 req-c216eab3-f256-4ff4-a66c-ab19e3e0e7f1 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 943 time: 0.5710242 Dec 09 21:27:33.981734 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f34c7639-bb59-4bfd-b8f9-4cdcff670428 req-0cb6fc48-b307-49d7-994e-cdee83d6a10c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6163726 Dec 09 21:27:34.023083 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-903ec54a-bd1d-4338-9925-239cf422e68c None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:34.032494 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-903ec54a-bd1d-4338-9925-239cf422e68c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:34.096760 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ab5852f-9a80-46d2-9ab2-22494fd99255 req-7e633fe2-32de-4c1b-9259-f31af252486b tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2007935 Dec 09 21:27:34.124055 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e105bc8-43b2-4304-8a7d-5902e872239d req-6bb566a9-2337-4183-85db-d8aff06446e5 service neutron] 10.222.0.10 "GET /v2.0/networks/de91a458-cde4-4265-8605-31d9b6f8f05f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3335078 Dec 09 21:27:34.125250 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-903ec54a-bd1d-4338-9925-239cf422e68c None None] Network 59e2b0d9-72ce-453d-a928-6c19b34a60c9 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:27:34.131597 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-903ec54a-bd1d-4338-9925-239cf422e68c None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:34.133990 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-903ec54a-bd1d-4338-9925-239cf422e68c None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:27:34.154240 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-903ec54a-bd1d-4338-9925-239cf422e68c None None] Pushing event updated for resources: {'Port': ['ID=f465eaff-f85c-43ee-8cce-e6a6b7924ac1,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:34.154544 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-66b0487c-b6a1-400b-a796-9659e64afca1 admin admin] Allocated IP 172.25.3.4 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/0ca4bf99-2fc0-4203-9d93-7f254c7af4df) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:27:34.177579 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da2466c4-f278-4013-8085-9b85077507a8 req-0688768b-1702-4316-bb3b-ec1ea9fec229 tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.0561831 Dec 09 21:27:34.240352 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:27:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4d1651dc-8ec6-4a48-b1b0-9d65974854ae x-openstack-request-id: req-4d1651dc-8ec6-4a48-b1b0-9d65974854ae {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:27:34.240653 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b521a440-0384-48fc-aaa9-13419003343e", "name": "network-vif-plugged", "status": "completed", "tag": "0ef815c5-fc54-4d19-b139-1eaa75cffde2", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:27:34.240957 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-4d1651dc-8ec6-4a48-b1b0-9d65974854ae {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:27:34.241635 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b521a440-0384-48fc-aaa9-13419003343e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0ef815c5-fc54-4d19-b139-1eaa75cffde2', 'code': 200} Dec 09 21:27:34.276130 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-903ec54a-bd1d-4338-9925-239cf422e68c None None] Attempting to bind port f465eaff-f85c-43ee-8cce-e6a6b7924ac1 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:27:34.276512 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-903ec54a-bd1d-4338-9925-239cf422e68c None None] Attempting to bind port f465eaff-f85c-43ee-8cce-e6a6b7924ac1 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'b277bb60-9cde-4512-80aa-21951c30630a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '59e2b0d9-72ce-453d-a928-6c19b34a60c9'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:27:34.276909 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-903ec54a-bd1d-4338-9925-239cf422e68c None None] Attempting to bind port f465eaff-f85c-43ee-8cce-e6a6b7924ac1 on network 59e2b0d9-72ce-453d-a928-6c19b34a60c9 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:34.290900 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-903ec54a-bd1d-4338-9925-239cf422e68c None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 27, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:27:34.291295 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-903ec54a-bd1d-4338-9925-239cf422e68c None None] Checking segment: {'id': 'b277bb60-9cde-4512-80aa-21951c30630a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '59e2b0d9-72ce-453d-a928-6c19b34a60c9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:27:34.291745 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-903ec54a-bd1d-4338-9925-239cf422e68c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:34.292154 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-903ec54a-bd1d-4338-9925-239cf422e68c None None] Bound using segment: {'id': 'b277bb60-9cde-4512-80aa-21951c30630a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '59e2b0d9-72ce-453d-a928-6c19b34a60c9'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:27:34.292643 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-903ec54a-bd1d-4338-9925-239cf422e68c None None] Bound port: f465eaff-f85c-43ee-8cce-e6a6b7924ac1, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b277bb60-9cde-4512-80aa-21951c30630a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '59e2b0d9-72ce-453d-a928-6c19b34a60c9'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:27:34.293034 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-903ec54a-bd1d-4338-9925-239cf422e68c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:34.407572 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-66b0487c-b6a1-400b-a796-9659e64afca1 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:34.431523 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 117119cd-9d6a-4e2a-94cc-9578db376ba6 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:27:34.445618 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9ab2a0e-5bdc-4a54-92bd-abc4b0665c73 req-ab433ae7-eefe-4c9e-a659-528e6ae090a4 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:34.453771 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f9ab2a0e-5bdc-4a54-92bd-abc4b0665c73 req-ab433ae7-eefe-4c9e-a659-528e6ae090a4 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 0.1903734 Dec 09 21:27:34.480790 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-66b0487c-b6a1-400b-a796-9659e64afca1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:34.486269 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01e5d7b7-8fd8-4719-8fa5-71ae814dbab3 req-70c6d642-de2f-45fb-b0f8-3b4260ccc7eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:34.487817 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-01e5d7b7-8fd8-4719-8fa5-71ae814dbab3 req-70c6d642-de2f-45fb-b0f8-3b4260ccc7eb service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=b521a440-0384-48fc-aaa9-13419003343e HTTP/1.1" status: 200 len: 1101 time: 0.1642909 Dec 09 21:27:34.501315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da5d3c07-327f-4aaf-95fc-56684b65b304 req-16cae3ef-38bf-408f-9ee4-206342f9daec tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:34.503548 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da5d3c07-327f-4aaf-95fc-56684b65b304 req-16cae3ef-38bf-408f-9ee4-206342f9daec tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=b521a440-0384-48fc-aaa9-13419003343e HTTP/1.1" status: 200 len: 949 time: 0.1212261 Dec 09 21:27:34.527127 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-66b0487c-b6a1-400b-a796-9659e64afca1 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:27:34.536548 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-66b0487c-b6a1-400b-a796-9659e64afca1 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:34.541323 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66b0487c-b6a1-400b-a796-9659e64afca1 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:27:34.583356 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f9ab2a0e-5bdc-4a54-92bd-abc4b0665c73 req-4d15380a-53b6-4ebe-8cd5-559a1a284a61 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1285343 Dec 09 21:27:34.593623 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 117119cd-9d6a-4e2a-94cc-9578db376ba6, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=117119cd-9d6a-4e2a-94cc-9578db376ba6,segment=NetworkSegment(c472f4a8-1a94-4bb1-8978-a56e5ee37bb8),segment_id=c472f4a8-1a94-4bb1-8978-a56e5ee37bb8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:34.624479 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-903ec54a-bd1d-4338-9925-239cf422e68c None None] For port f465eaff-f85c-43ee-8cce-e6a6b7924ac1, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:27:34.640876 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da5d3c07-327f-4aaf-95fc-56684b65b304 req-f565dd5b-3a11-493c-b946-7b9c591ed1dc tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1297963 Dec 09 21:27:34.643508 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-01e5d7b7-8fd8-4719-8fa5-71ae814dbab3 req-8610d201-ead8-4503-9607-f842ccf8cbd7 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1394427 Dec 09 21:27:34.667896 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-903ec54a-bd1d-4338-9925-239cf422e68c None None] For port f465eaff-f85c-43ee-8cce-e6a6b7924ac1, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f465eaff-f85c-43ee-8cce-e6a6b7924ac1,segment=NetworkSegment(b277bb60-9cde-4512-80aa-21951c30630a),segment_id=b277bb60-9cde-4512-80aa-21951c30630a)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:27:34.667896 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f29fe8cc-72a3-485b-a257-8a8081d710b1 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:34.670051 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-903ec54a-bd1d-4338-9925-239cf422e68c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:34.680185 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66b0487c-b6a1-400b-a796-9659e64afca1 admin admin] Pushing event updated for resources: {'Port': ['ID=0ca4bf99-2fc0-4203-9d93-7f254c7af4df,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:34.731662 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '117119cd-9d6a-4e2a-94cc-9578db376ba6', 'network_id': 'de91a458-cde4-4265-8605-31d9b6f8f05f', 'port_id': '117119cd-9d6a-4e2a-94cc-9578db376ba6', 'mac_address': 'fa:16:3e:e2:83:98', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 121, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cb187a9c-ec94-4995-93f8-92c16c7a80a3', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:27:34.912623 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8c308d7-175d-427e-9214-0ba9ea107895 req-2f597f2c-85c6-4a5b-b483-107cf34f8b4f tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:34.926484 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c8c308d7-175d-427e-9214-0ba9ea107895 req-2f597f2c-85c6-4a5b-b483-107cf34f8b4f tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.1725290 Dec 09 21:27:34.929516 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-903ec54a-bd1d-4338-9925-239cf422e68c None None] Pushing event updated for resources: {'Port': ['ID=f465eaff-f85c-43ee-8cce-e6a6b7924ac1,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:34.967423 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:34.984363 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f29fe8cc-72a3-485b-a257-8a8081d710b1 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:34.984736 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:35.012033 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 117119cd-9d6a-4e2a-94cc-9578db376ba6 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:27:35.021145 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-66b0487c-b6a1-400b-a796-9659e64afca1 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:35.087810 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 117119cd-9d6a-4e2a-94cc-9578db376ba6, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=117119cd-9d6a-4e2a-94cc-9578db376ba6,segment=NetworkSegment(c472f4a8-1a94-4bb1-8978-a56e5ee37bb8),segment_id=c472f4a8-1a94-4bb1-8978-a56e5ee37bb8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:35.100844 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:35.116237 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c8c308d7-175d-427e-9214-0ba9ea107895 req-8641ed3e-4644-4d89-a578-45530d050681 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1884873 Dec 09 21:27:35.171004 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9742a087-838e-403a-a25c-c1ba00356f2f req-b213f328-0d83-4504-8958-c41e840fddc8 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:35.178735 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9742a087-838e-403a-a25c-c1ba00356f2f req-b213f328-0d83-4504-8958-c41e840fddc8 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 946 time: 0.2491438 Dec 09 21:27:35.263960 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9742a087-838e-403a-a25c-c1ba00356f2f req-cd9a834f-799f-4045-8e92-0e0edab794bb tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0842366 Dec 09 21:27:35.265289 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=117119cd-9d6a-4e2a-94cc-9578db376ba6,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:35.277416 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:35.348149 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port f29fe8cc-72a3-485b-a257-8a8081d710b1, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f29fe8cc-72a3-485b-a257-8a8081d710b1,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:35.364187 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:35.394444 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8553807d-bf8e-4e65-8d9b-c773b440a7a6 req-83430dce-7492-4168-bd29-97e934138d38 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:35.396565 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8553807d-bf8e-4e65-8d9b-c773b440a7a6 req-83430dce-7492-4168-bd29-97e934138d38 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 944 time: 0.1130750 Dec 09 21:27:35.442521 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=f29fe8cc-72a3-485b-a257-8a8081d710b1,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:35.454001 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['117119cd-9d6a-4e2a-94cc-9578db376ba6'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:27:35.482446 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3d749a15-6419-4afb-b429-b9eabf59642b req-fd5560f9-3eb7-4874-90ba-22dece72f8db tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.0406222 Dec 09 21:27:35.489005 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8553807d-bf8e-4e65-8d9b-c773b440a7a6 req-f7fcb293-83c1-423f-82a6-879a8daddff5 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0862234 Dec 09 21:27:35.527004 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-36cee23a-e18d-420f-b600-0b0c90f11acf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:35.775101 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcf6669d-f56e-494b-bb0a-abc5dd2a9749 req-15197e89-abf6-4ebb-932a-33dff336625d tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:35.776701 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dcf6669d-f56e-494b-bb0a-abc5dd2a9749 req-15197e89-abf6-4ebb-932a-33dff336625d tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 0.0943527 Dec 09 21:27:35.874371 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dcf6669d-f56e-494b-bb0a-abc5dd2a9749 req-fcf2a5bd-354a-4ae8-b006-fc48cb298f45 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0869191 Dec 09 21:27:35.886590 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad18297d-f542-46a7-bfba-a377cf51c36e req-5d5ec3ed-e907-4bf5-9cf7-98a522453768 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:35.896769 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ad18297d-f542-46a7-bfba-a377cf51c36e req-5d5ec3ed-e907-4bf5-9cf7-98a522453768 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=b521a440-0384-48fc-aaa9-13419003343e HTTP/1.1" status: 200 len: 949 time: 0.1175520 Dec 09 21:27:35.969787 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-66b0487c-b6a1-400b-a796-9659e64afca1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:35.987577 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ad18297d-f542-46a7-bfba-a377cf51c36e req-b343c9a1-5a4d-41aa-9c66-8857fda183a2 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0879364 Dec 09 21:27:36.078736 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] Sync routers for ids ['4757617b-081d-4a51-a741-443e352d3856'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:27:36.091145 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] Routers {'4757617b-081d-4a51-a741-443e352d3856'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:27:36.091991 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:27:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4757617b-081d-4a51-a741-443e352d3856'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:36.158213 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-66b0487c-b6a1-400b-a796-9659e64afca1 admin admin] Router bf1205e6-b4d1-485d-b2f3-3ea9a434d27e is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:27:36.224539 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] Set router 4757617b-081d-4a51-a741-443e352d3856 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:27:36.302651 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-edea8a3e-6dca-4058-be15-f5b946aa1e58 None None] Network 59e2b0d9-72ce-453d-a928-6c19b34a60c9 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:27:36.308378 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-66b0487c-b6a1-400b-a796-9659e64afca1 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:27:36.317252 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85558bdb-c2fb-477c-be3a-32900a8d357a req-c62cf072-43c4-4ad6-8f75-dff57f93a1b7 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:36.318988 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85558bdb-c2fb-477c-be3a-32900a8d357a req-c62cf072-43c4-4ad6-8f75-dff57f93a1b7 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.0960488 Dec 09 21:27:36.342379 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] Sync routers for ids ['bf1205e6-b4d1-485d-b2f3-3ea9a434d27e'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:27:36.349001 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-66b0487c-b6a1-400b-a796-9659e64afca1 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:36.351760 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-66b0487c-b6a1-400b-a796-9659e64afca1 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 3.2552428 Dec 09 21:27:36.353911 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40650) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:36.392873 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] Routers {'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:27:36.397317 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:27:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['bf1205e6-b4d1-485d-b2f3-3ea9a434d27e'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:36.426980 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85558bdb-c2fb-477c-be3a-32900a8d357a req-2e4ef9d5-995d-4199-8b41-4545999ec231 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1017814 Dec 09 21:27:36.560378 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 117119cd-9d6a-4e2a-94cc-9578db376ba6 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:36.572883 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b04cdac9-08e0-44f4-aff9-9489005ba488 req-033f56fb-de36-4145-911f-5de8a5e1d9fe tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:36.586867 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b04cdac9-08e0-44f4-aff9-9489005ba488 req-033f56fb-de36-4145-911f-5de8a5e1d9fe tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 946 time: 0.1584775 Dec 09 21:27:36.685813 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b04cdac9-08e0-44f4-aff9-9489005ba488 req-e48f9ff8-1272-4e08-94fb-d9951eddb446 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0930350 Dec 09 21:27:36.718067 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] Set router bf1205e6-b4d1-485d-b2f3-3ea9a434d27e gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:27:36.750562 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4757617b-081d-4a51-a741-443e352d3856', 'name': 'tempest-TaggedBootDevicesTest_v242-1825188234-router', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97'}], 'enable_snat': True}, 'gw_port_id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:24Z', 'updated_at': '2021-12-09T21:27:29Z', 'revision_number': 4, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'gw_port': {'id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1113, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:25Z', 'updated_at': '2021-12-09T21:27:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '19d4a80e-ba79-4490-8a95-e9c7e2370cf8', 'name': '', 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'mac_address': 'fa:16:3e:47:22:78', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_interface', 'standard_attr_id': 1115, 'fixed_ips': [{'subnet_id': 'd989acab-7cdc-482f-a350-344dd6e11873', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:28Z', 'updated_at': '2021-12-09T21:27:29Z', 'revision_number': 2, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'subnets': [{'id': 'd989acab-7cdc-482f-a350-344dd6e11873', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:36.811052 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8052a10-de25-4492-a906-9ab6f8fcfef3 req-27011992-d8c2-47b4-9e43-01bac2054f9f tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:36.814129 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] Checking router: 4757617b-081d-4a51-a741-443e352d3856 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:27:36.814741 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] Updating router 4757617b-081d-4a51-a741-443e352d3856 port 19d4a80e-ba79-4490-8a95-e9c7e2370cf8 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:27:36.824926 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8052a10-de25-4492-a906-9ab6f8fcfef3 req-27011992-d8c2-47b4-9e43-01bac2054f9f tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 944 time: 0.1557636 Dec 09 21:27:36.836502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f29fe8cc-72a3-485b-a257-8a8081d710b1 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:36.868258 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:36.889740 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8ab3c31-03bb-40a7-a83f-9bf2cdd65ecf req-d4e76137-6da2-4d99-870a-a2f51ee8d21d tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.0497591 Dec 09 21:27:36.914829 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:36.933457 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8052a10-de25-4492-a906-9ab6f8fcfef3 req-315662a5-836d-4b9f-90bc-8f855542c429 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1075275 Dec 09 21:27:36.960820 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f8845bd4-51b9-4276-b564-0481a8fb9575 None None] Provisioning complete for port f465eaff-f85c-43ee-8cce-e6a6b7924ac1 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:36.961304 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f8845bd4-51b9-4276-b564-0481a8fb9575 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:37.088047 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80dbdea1-7006-44a5-87f1-f4fe34848f9e req-64bcdc3f-2c92-4f6e-97a6-221f4828b495 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:37.103643 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-80dbdea1-7006-44a5-87f1-f4fe34848f9e req-64bcdc3f-2c92-4f6e-97a6-221f4828b495 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 0.0956821 Dec 09 21:27:37.182965 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cb8b52ef-a5bf-46ac-8330-001dcc65b8a8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:37.237137 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-80dbdea1-7006-44a5-87f1-f4fe34848f9e req-44a976ea-83ee-4b2d-81c8-2e26eb6fd87b tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1274679 Dec 09 21:27:37.251573 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64cadeb0-7808-4008-92d6-bf63800248d0 req-82bc4c26-2bd4-4193-904d-e9fa61bbeba3 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:37.256248 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-64cadeb0-7808-4008-92d6-bf63800248d0 req-82bc4c26-2bd4-4193-904d-e9fa61bbeba3 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=b521a440-0384-48fc-aaa9-13419003343e HTTP/1.1" status: 200 len: 949 time: 0.1188180 Dec 09 21:27:37.258544 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f29fe8cc-72a3-485b-a257-8a8081d710b1 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:37.258918 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:37.261695 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 117119cd-9d6a-4e2a-94cc-9578db376ba6 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:27:37.263047 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:37.273232 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:37.319672 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0509fe3b-2e19-4463-b396-c0e7cecfb3dc None None] Pushing event updated for resources: {'Port': ['ID=19d4a80e-ba79-4490-8a95-e9c7e2370cf8,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:37.330784 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 117119cd-9d6a-4e2a-94cc-9578db376ba6 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:37.331338 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:37.366639 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-64cadeb0-7808-4008-92d6-bf63800248d0 req-e42932db-9a57-4a5c-99c4-290a14863c89 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0934031 Dec 09 21:27:37.444322 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] Attempting to bind port 19d4a80e-ba79-4490-8a95-e9c7e2370cf8 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:27:37.445000 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] Attempting to bind port 19d4a80e-ba79-4490-8a95-e9c7e2370cf8 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '7cf32f95-b9ab-465b-889c-7d7de3246a6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:27:37.445550 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] Attempting to bind port 19d4a80e-ba79-4490-8a95-e9c7e2370cf8 on network 361619eb-51a4-4728-b2cc-72e27ec4eca5 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:37.453246 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 27, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:27:37.453976 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] Checking segment: {'id': '7cf32f95-b9ab-465b-889c-7d7de3246a6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:27:37.454559 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:37.455130 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] Bound using segment: {'id': '7cf32f95-b9ab-465b-889c-7d7de3246a6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:27:37.455630 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device a2162a7f-55fc-4ed6-a111-15a5b9802370 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:27:37.456017 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] Bound port: 19d4a80e-ba79-4490-8a95-e9c7e2370cf8, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7cf32f95-b9ab-465b-889c-7d7de3246a6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:27:37.456564 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:37.550678 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-cb8b52ef-a5bf-46ac-8330-001dcc65b8a8 admin admin] Allocated IP 172.20.0.1 (59e2b0d9-72ce-453d-a928-6c19b34a60c9/549d348b-5c92-4b49-aa63-dbd8d0a93c5c/21963cc5-b64c-44cd-847e-fb5f82ccd3f9) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:27:37.604915 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] For port 19d4a80e-ba79-4490-8a95-e9c7e2370cf8, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:27:37.609486 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] For port 19d4a80e-ba79-4490-8a95-e9c7e2370cf8, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=19d4a80e-ba79-4490-8a95-e9c7e2370cf8,segment=NetworkSegment(7cf32f95-b9ab-465b-889c-7d7de3246a6f),segment_id=7cf32f95-b9ab-465b-889c-7d7de3246a6f)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:27:37.620667 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:37.665792 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9829703f-665c-40e9-94a2-85339de5ffea req-b65998ff-81ce-4e25-8ff8-3867975c3731 tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:37.667594 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9829703f-665c-40e9-94a2-85339de5ffea req-b65998ff-81ce-4e25-8ff8-3867975c3731 tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=b521a440-0384-48fc-aaa9-13419003343e HTTP/1.1" status: 200 len: 1101 time: 0.1722181 Dec 09 21:27:37.706966 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-558930b1-3748-4c5a-ad41-57ff94b5b64c req-031de39b-6334-4c28-9204-fb817fd0d1de tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:37.723525 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-558930b1-3748-4c5a-ad41-57ff94b5b64c req-031de39b-6334-4c28-9204-fb817fd0d1de tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.1651695 Dec 09 21:27:37.743191 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0509fe3b-2e19-4463-b396-c0e7cecfb3dc None None] Pushing event updated for resources: {'Port': ['ID=19d4a80e-ba79-4490-8a95-e9c7e2370cf8,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:37.765187 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] Routers {'4757617b-081d-4a51-a741-443e352d3856'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:27:37.766542 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:27:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4757617b-081d-4a51-a741-443e352d3856'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:37.789131 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cb8b52ef-a5bf-46ac-8330-001dcc65b8a8 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:37.809199 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9829703f-665c-40e9-94a2-85339de5ffea req-1c5b47e5-edc8-4029-8980-3372fca778a4 tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1308873 Dec 09 21:27:37.937549 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cb8b52ef-a5bf-46ac-8330-001dcc65b8a8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:37.987602 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-558930b1-3748-4c5a-ad41-57ff94b5b64c req-d9305fac-3614-4485-9d6e-5f6467438b5f tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2623839 Dec 09 21:27:38.017902 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] Set router 4757617b-081d-4a51-a741-443e352d3856 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:27:38.114672 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb8b52ef-a5bf-46ac-8330-001dcc65b8a8 admin admin] Pushing event updated for resources: {'Port': ['ID=21963cc5-b64c-44cd-847e-fb5f82ccd3f9,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:38.148898 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec9432d8-4cc0-45c3-8238-70712dfc0745 req-7c44b7a0-9b3b-4487-9b91-a5ab376569aa tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:38.154444 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec9432d8-4cc0-45c3-8238-70712dfc0745 req-7c44b7a0-9b3b-4487-9b91-a5ab376569aa tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 946 time: 0.2286003 Dec 09 21:27:38.157205 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb8b52ef-a5bf-46ac-8330-001dcc65b8a8 admin admin] Network 59e2b0d9-72ce-453d-a928-6c19b34a60c9 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:27:38.158838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-cb8b52ef-a5bf-46ac-8330-001dcc65b8a8 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:38.165459 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb8b52ef-a5bf-46ac-8330-001dcc65b8a8 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:27:38.202035 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f8845bd4-51b9-4276-b564-0481a8fb9575 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:38.223298 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port a2162a7f-55fc-4ed6-a111-15a5b9802370, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a2162a7f-55fc-4ed6-a111-15a5b9802370,segment=NetworkSegment(e3c687b5-afac-4ac8-9b38-06599c2a8b7e),segment_id=e3c687b5-afac-4ac8-9b38-06599c2a8b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:38.251851 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:38.285906 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cb8b52ef-a5bf-46ac-8330-001dcc65b8a8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:38.298812 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1bb4fdaa-6797-4f4d-bf35-21c51c84f71f req-72f83e82-1058-41a5-99a3-1044eeb75413 tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.1015477 Dec 09 21:27:38.304861 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'a2162a7f-55fc-4ed6-a111-15a5b9802370', 'network_id': '4d446a14-1218-469d-93aa-b4f9babdbb6e', 'port_id': 'a2162a7f-55fc-4ed6-a111-15a5b9802370', 'mac_address': 'fa:16:3e:83:5a:d1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 138, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '75afc53b-d3f3-461c-aba4-c2ce93780246', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:27:38.386531 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec9432d8-4cc0-45c3-8238-70712dfc0745 req-1f769d9a-94a0-41df-920f-22991f03c6a9 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2227328 Dec 09 21:27:38.426422 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e', 'name': 'tempest-TaggedBootDevicesTest_v242-485407257-router', 'tenant_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.4'}], 'enable_snat': True}, 'gw_port_id': '0ca4bf99-2fc0-4203-9d93-7f254c7af4df', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:33Z', 'updated_at': '2021-12-09T21:27:34Z', 'revision_number': 3, 'project_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'gw_port': {'id': '0ca4bf99-2fc0-4203-9d93-7f254c7af4df', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:10:14:ff', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1126, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.4', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:33Z', 'updated_at': '2021-12-09T21:27:34Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:38.489596 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f8845bd4-51b9-4276-b564-0481a8fb9575 None None] For port f465eaff-f85c-43ee-8cce-e6a6b7924ac1, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f465eaff-f85c-43ee-8cce-e6a6b7924ac1,segment=NetworkSegment(b277bb60-9cde-4512-80aa-21951c30630a),segment_id=b277bb60-9cde-4512-80aa-21951c30630a)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:38.536380 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] Checking router: bf1205e6-b4d1-485d-b2f3-3ea9a434d27e for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:27:38.542267 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4757617b-081d-4a51-a741-443e352d3856', 'name': 'tempest-TaggedBootDevicesTest_v242-1825188234-router', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97'}], 'enable_snat': True}, 'gw_port_id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:24Z', 'updated_at': '2021-12-09T21:27:29Z', 'revision_number': 4, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'gw_port': {'id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1113, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:25Z', 'updated_at': '2021-12-09T21:27:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '19d4a80e-ba79-4490-8a95-e9c7e2370cf8', 'name': '', 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'mac_address': 'fa:16:3e:47:22:78', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_interface', 'standard_attr_id': 1115, 'fixed_ips': [{'subnet_id': 'd989acab-7cdc-482f-a350-344dd6e11873', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:28Z', 'updated_at': '2021-12-09T21:27:37Z', 'revision_number': 4, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'subnets': [{'id': 'd989acab-7cdc-482f-a350-344dd6e11873', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:38.547174 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] Updating router bf1205e6-b4d1-485d-b2f3-3ea9a434d27e port 0ca4bf99-2fc0-4203-9d93-7f254c7af4df binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:27:38.550610 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f8845bd4-51b9-4276-b564-0481a8fb9575 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:38.590859 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f62ef921-4673-45e2-8fb0-396a422722a4 None None] The sync data for ids ['4757617b-081d-4a51-a741-443e352d3856'] in n-d-713301-27 is: [{'id': '4757617b-081d-4a51-a741-443e352d3856', 'name': 'tempest-TaggedBootDevicesTest_v242-1825188234-router', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97'}], 'enable_snat': True}, 'gw_port_id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:24Z', 'updated_at': '2021-12-09T21:27:29Z', 'revision_number': 4, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'gw_port': {'id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1113, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:25Z', 'updated_at': '2021-12-09T21:27:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '19d4a80e-ba79-4490-8a95-e9c7e2370cf8', 'name': '', 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'mac_address': 'fa:16:3e:47:22:78', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_interface', 'standard_attr_id': 1115, 'fixed_ips': [{'subnet_id': 'd989acab-7cdc-482f-a350-344dd6e11873', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:28Z', 'updated_at': '2021-12-09T21:27:37Z', 'revision_number': 4, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'subnets': [{'id': 'd989acab-7cdc-482f-a350-344dd6e11873', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:27:38.601303 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cb8b52ef-a5bf-46ac-8330-001dcc65b8a8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:38.611919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f465eaff-f85c-43ee-8cce-e6a6b7924ac1 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:38.615818 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f40eaacb-b406-4d6b-a1ae-b20ff09bb9ce req-010f68ee-2228-4957-9149-a63115ad26b6 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:38.618084 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f40eaacb-b406-4d6b-a1ae-b20ff09bb9ce req-010f68ee-2228-4957-9149-a63115ad26b6 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 944 time: 0.1765900 Dec 09 21:27:38.635218 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:38.663025 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ea5ad4b-692e-42b0-a1c2-f82390bf88e4 req-828f48a0-84be-4fc6-b27c-537844caa0fb tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:38.664823 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ea5ad4b-692e-42b0-a1c2-f82390bf88e4 req-828f48a0-84be-4fc6-b27c-537844caa0fb tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 0.1338992 Dec 09 21:27:38.704880 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:38.706404 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:38.727422 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f40eaacb-b406-4d6b-a1ae-b20ff09bb9ce req-2a832add-51d7-41ad-b675-803c28e68338 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1014342 Dec 09 21:27:38.822232 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '21566c6e-f8d2-4122-ac9c-f052ec7a451c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '117119cd-9d6a-4e2a-94cc-9578db376ba6'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:27:38.826344 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-91afc7e3-ed93-433c-bc1d-0640f803488d" -d '{"events": [{"server_uuid": "21566c6e-f8d2-4122-ac9c-f052ec7a451c", "name": "network-vif-plugged", "status": "completed", "tag": "117119cd-9d6a-4e2a-94cc-9578db376ba6"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:27:38.871668 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ea5ad4b-692e-42b0-a1c2-f82390bf88e4 req-5a5b50b8-b170-4d04-afad-9234f3210aba tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1369739 Dec 09 21:27:38.887825 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8845bd4-51b9-4276-b564-0481a8fb9575 None None] Pushing event updated for resources: {'Port': ['ID=f465eaff-f85c-43ee-8cce-e6a6b7924ac1,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:38.904264 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 117119cd-9d6a-4e2a-94cc-9578db376ba6, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=117119cd-9d6a-4e2a-94cc-9578db376ba6,segment=NetworkSegment(c472f4a8-1a94-4bb1-8978-a56e5ee37bb8),segment_id=c472f4a8-1a94-4bb1-8978-a56e5ee37bb8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:38.905260 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cb8b52ef-a5bf-46ac-8330-001dcc65b8a8 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:38.908248 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e6f9e02-163c-402f-becb-478d52c57467 req-af8f4ba0-b14a-4c64-945f-9c3c54a6b836 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0323994 Dec 09 21:27:38.915236 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id a2162a7f-55fc-4ed6-a111-15a5b9802370 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:27:38.920612 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cb8b52ef-a5bf-46ac-8330-001dcc65b8a8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:38.946065 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:38.953064 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e22d4bbf-106e-474a-a1b0-382d49fb3046 None None] Provisioning complete for port 19d4a80e-ba79-4490-8a95-e9c7e2370cf8 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:38.953421 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e22d4bbf-106e-474a-a1b0-382d49fb3046 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:39.036284 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb8b52ef-a5bf-46ac-8330-001dcc65b8a8 admin admin] Pushing event updated for resources: {'Port': ['ID=21963cc5-b64c-44cd-847e-fb5f82ccd3f9,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:39.041934 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:27:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-54af3dce-b207-409c-8e83-ebbb8847ae40 x-openstack-request-id: req-54af3dce-b207-409c-8e83-ebbb8847ae40 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:27:39.042231 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "21566c6e-f8d2-4122-ac9c-f052ec7a451c", "name": "network-vif-plugged", "status": "completed", "tag": "117119cd-9d6a-4e2a-94cc-9578db376ba6", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:27:39.042487 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-54af3dce-b207-409c-8e83-ebbb8847ae40 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:27:39.042882 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '21566c6e-f8d2-4122-ac9c-f052ec7a451c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '117119cd-9d6a-4e2a-94cc-9578db376ba6', 'code': 200} Dec 09 21:27:39.072979 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cb8b52ef-a5bf-46ac-8330-001dcc65b8a8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:39.126227 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port a2162a7f-55fc-4ed6-a111-15a5b9802370, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a2162a7f-55fc-4ed6-a111-15a5b9802370,segment=NetworkSegment(e3c687b5-afac-4ac8-9b38-06599c2a8b7e),segment_id=e3c687b5-afac-4ac8-9b38-06599c2a8b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:39.143491 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:39.192594 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967ce35f-db88-4a45-afad-a63ea6d0acce req-caa745eb-f4d5-437a-a1f1-14925365007a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:39.194257 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-967ce35f-db88-4a45-afad-a63ea6d0acce req-caa745eb-f4d5-437a-a1f1-14925365007a service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 1097 time: 0.1216087 Dec 09 21:27:39.203203 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f465eaff-f85c-43ee-8cce-e6a6b7924ac1 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:39.203609 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:39.212345 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e6f9e02-163c-402f-becb-478d52c57467 req-290c6cb4-fbaa-4f70-9d23-4c517f324769 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:39.214261 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e6f9e02-163c-402f-becb-478d52c57467 req-290c6cb4-fbaa-4f70-9d23-4c517f324769 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2987180 Dec 09 21:27:39.249832 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=117119cd-9d6a-4e2a-94cc-9578db376ba6,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:39.280992 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebaff775-8f31-461a-9752-3d20059a55e8 req-19168cda-554f-48f4-8979-fc40e63362f5 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:39.283008 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ebaff775-8f31-461a-9752-3d20059a55e8 req-19168cda-554f-48f4-8979-fc40e63362f5 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.1624525 Dec 09 21:27:39.293249 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e6f9e02-163c-402f-becb-478d52c57467 req-0f9dad5e-5899-4a5a-95cb-265b7ea781a5 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/quotas/23f7f8a3e7b14635b4f7dfa561684399 HTTP/1.1" status: 200 len: 375 time: 0.0684001 Dec 09 21:27:39.314931 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb8b52ef-a5bf-46ac-8330-001dcc65b8a8 admin admin] Network 59e2b0d9-72ce-453d-a928-6c19b34a60c9 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:27:39.316579 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-cb8b52ef-a5bf-46ac-8330-001dcc65b8a8 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:39.390880 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device a2162a7f-55fc-4ed6-a111-15a5b9802370 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:27:39.442293 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ebaff775-8f31-461a-9752-3d20059a55e8 req-e36d143f-3d43-46e1-b063-8a2f44ef3af2 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1449733 Dec 09 21:27:39.507705 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['a2162a7f-55fc-4ed6-a111-15a5b9802370'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:27:39.531431 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-967ce35f-db88-4a45-afad-a63ea6d0acce req-fd1d2116-bb0a-4758-9633-f15272b08e7d service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3142536 Dec 09 21:27:39.555749 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cb8b52ef-a5bf-46ac-8330-001dcc65b8a8 admin admin] Router bf1205e6-b4d1-485d-b2f3-3ea9a434d27e has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:27:39.589089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e6f9e02-163c-402f-becb-478d52c57467 req-aeae06b0-7669-4d1c-b503-a147923c3f9a tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&fields=id HTTP/1.1" status: 200 len: 532 time: 0.2949104 Dec 09 21:27:39.638746 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a6439ff-e1ed-4c3e-8111-0af11419e0c4 req-7b7da3c6-d78a-4e6d-9298-ba4a1ce1dedf tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.0482686 Dec 09 21:27:39.745220 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e22d4bbf-106e-474a-a1b0-382d49fb3046 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:39.746922 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=a2162a7f-55fc-4ed6-a111-15a5b9802370,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:39.786855 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:39.841252 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:39.841721 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:39.842312 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:39.842618 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:39.842988 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:39.843357 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:39.844177 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cb8b52ef-a5bf-46ac-8330-001dcc65b8a8 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:27:39.845916 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:39.846165 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:39.846592 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:39.846991 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:39.847354 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:39.847710 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:39.848110 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:39.855185 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cb8b52ef-a5bf-46ac-8330-001dcc65b8a8 admin admin] 10.222.0.13 "PUT /v2.0/routers/bf1205e6-b4d1-485d-b2f3-3ea9a434d27e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4999557 Dec 09 21:27:39.898889 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07649dbf-287d-4dcd-9cdf-cf11d3265262 req-017d1b11-4711-4770-b2a5-e3f99b2a4ce4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:39.916783 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07649dbf-287d-4dcd-9cdf-cf11d3265262 req-017d1b11-4711-4770-b2a5-e3f99b2a4ce4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 946 time: 0.1590047 Dec 09 21:27:39.978178 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e22d4bbf-106e-474a-a1b0-382d49fb3046 None None] For port 19d4a80e-ba79-4490-8a95-e9c7e2370cf8, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=19d4a80e-ba79-4490-8a95-e9c7e2370cf8,segment=NetworkSegment(7cf32f95-b9ab-465b-889c-7d7de3246a6f),segment_id=7cf32f95-b9ab-465b-889c-7d7de3246a6f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:40.012750 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07649dbf-287d-4dcd-9cdf-cf11d3265262 req-f540e66b-e748-4bec-984c-ef551337ec38 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0876517 Dec 09 21:27:40.020618 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e22d4bbf-106e-474a-a1b0-382d49fb3046 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:40.043107 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:40.079622 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:40.084326 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:40.152554 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e22d4bbf-106e-474a-a1b0-382d49fb3046 None None] Provisioning complete for port f465eaff-f85c-43ee-8cce-e6a6b7924ac1 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:40.152926 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e22d4bbf-106e-474a-a1b0-382d49fb3046 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:40.160356 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: BUILD current_port_status: DOWN port_id a2162a7f-55fc-4ed6-a111-15a5b9802370 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:27:40.207070 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d02f8531-c4de-48e9-b0f0-e0671837b7cc req-44d7eb8c-bc04-498f-a596-92d712496f21 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=53da382a-16f4-44e1-bfd3-8ba00a807708 HTTP/1.1" status: 200 len: 210 time: 0.0844860 Dec 09 21:27:40.221685 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e22d4bbf-106e-474a-a1b0-382d49fb3046 None None] Pushing event updated for resources: {'Port': ['ID=19d4a80e-ba79-4490-8a95-e9c7e2370cf8,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:40.233022 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] Attempting to bind port 0ca4bf99-2fc0-4203-9d93-7f254c7af4df on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:27:40.233396 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] Attempting to bind port 0ca4bf99-2fc0-4203-9d93-7f254c7af4df by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:27:40.233759 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] Attempting to bind port 0ca4bf99-2fc0-4203-9d93-7f254c7af4df on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:40.252383 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bca7209-6a53-4f9d-81c1-d59780e5baa8 req-ece1fb6c-7357-4a40-9675-2fde15f04366 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:40.264171 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8bca7209-6a53-4f9d-81c1-d59780e5baa8 req-ece1fb6c-7357-4a40-9675-2fde15f04366 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 945 time: 0.2492380 Dec 09 21:27:40.277305 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port a2162a7f-55fc-4ed6-a111-15a5b9802370, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a2162a7f-55fc-4ed6-a111-15a5b9802370,segment=NetworkSegment(e3c687b5-afac-4ac8-9b38-06599c2a8b7e),segment_id=e3c687b5-afac-4ac8-9b38-06599c2a8b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:40.295622 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 27, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:27:40.295986 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:27:40.296463 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:40.296873 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:27:40.297346 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] Bound port: 0ca4bf99-2fc0-4203-9d93-7f254c7af4df, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:27:40.297733 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:40.304128 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:40.305967 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 19d4a80e-ba79-4490-8a95-e9c7e2370cf8 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:40.377826 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8bca7209-6a53-4f9d-81c1-d59780e5baa8 req-106aa052-adf3-42f1-8f11-20ec87792061 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1126456 Dec 09 21:27:40.402499 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69836e56-0f90-4c4f-b1f6-87064383a492 None None] Pushing event updated for resources: {'Port': ['ID=0ca4bf99-2fc0-4203-9d93-7f254c7af4df,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:40.486243 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40308a63-b6c4-424b-b39a-6bcc90e01a76 req-b01bae1e-fdc5-4cf8-b539-97ab2ab5c80e tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:40.520173 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-40308a63-b6c4-424b-b39a-6bcc90e01a76 req-b01bae1e-fdc5-4cf8-b539-97ab2ab5c80e tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 943 time: 0.1543648 Dec 09 21:27:40.528177 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] For port 0ca4bf99-2fc0-4203-9d93-7f254c7af4df, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:27:40.536291 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] For port 0ca4bf99-2fc0-4203-9d93-7f254c7af4df, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=0ca4bf99-2fc0-4203-9d93-7f254c7af4df,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:27:40.573849 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:40.625506 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=a2162a7f-55fc-4ed6-a111-15a5b9802370,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:40.662949 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-40308a63-b6c4-424b-b39a-6bcc90e01a76 req-9ecee755-1ea6-43b2-b982-1c5adf919657 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1415799 Dec 09 21:27:40.685704 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bb0d66d-519d-4b3a-8376-3b0421fa0c66 req-f6b37ad5-e3c8-4c11-b831-51cdf2cbfb31 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:40.697563 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3bb0d66d-519d-4b3a-8376-3b0421fa0c66 req-f6b37ad5-e3c8-4c11-b831-51cdf2cbfb31 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.1372540 Dec 09 21:27:40.718959 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 19d4a80e-ba79-4490-8a95-e9c7e2370cf8 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:40.719329 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:40.783549 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] Routers {'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:27:40.784220 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:27:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['bf1205e6-b4d1-485d-b2f3-3ea9a434d27e'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:40.851275 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e22d4bbf-106e-474a-a1b0-382d49fb3046 None None] Provisioning complete for port 21963cc5-b64c-44cd-847e-fb5f82ccd3f9 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:40.851671 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e22d4bbf-106e-474a-a1b0-382d49fb3046 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:40.857767 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69836e56-0f90-4c4f-b1f6-87064383a492 None None] Pushing event updated for resources: {'Port': ['ID=0ca4bf99-2fc0-4203-9d93-7f254c7af4df,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:40.864419 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3bb0d66d-519d-4b3a-8376-3b0421fa0c66 req-e7b4da1e-06e1-4d07-a6b6-fb0ae02b6d34 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1602645 Dec 09 21:27:40.904573 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-48d948d7-1aa8-4893-9e5d-d3b873e5a8b9 req-4e3be708-75b4-4568-99d8-f146478ae3f5 tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.0907927 Dec 09 21:27:41.074037 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e22d4bbf-106e-474a-a1b0-382d49fb3046 None None] Port 21963cc5-b64c-44cd-847e-fb5f82ccd3f9 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:27:41.151535 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43a7e7ec-e73b-4bfb-82bf-5c289ba6f7d7 req-83712ccd-c884-4362-bc17-7d77c1e0a63a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:41.161750 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43a7e7ec-e73b-4bfb-82bf-5c289ba6f7d7 req-83712ccd-c884-4362-bc17-7d77c1e0a63a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 946 time: 0.0665209 Dec 09 21:27:41.227939 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f465eaff-f85c-43ee-8cce-e6a6b7924ac1 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:41.264872 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43a7e7ec-e73b-4bfb-82bf-5c289ba6f7d7 req-adaadf0c-9acc-42e5-8a52-40db5d534777 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1000130 Dec 09 21:27:41.289946 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] Set router bf1205e6-b4d1-485d-b2f3-3ea9a434d27e gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:27:41.337095 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e979a54a-fd20-4b93-831a-89605c19590f None None] Provisioning complete for port 21963cc5-b64c-44cd-847e-fb5f82ccd3f9 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:41.337469 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e979a54a-fd20-4b93-831a-89605c19590f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:41.343962 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e307ad01-4327-442d-8ade-9eb6bd86b8a6 req-5c93982f-a95c-44c3-aaf1-f0ca5c21c6c0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=53da382a-16f4-44e1-bfd3-8ba00a807708 HTTP/1.1" status: 200 len: 210 time: 0.0492146 Dec 09 21:27:41.386885 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device a2162a7f-55fc-4ed6-a111-15a5b9802370 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:41.455349 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e979a54a-fd20-4b93-831a-89605c19590f None None] Port 21963cc5-b64c-44cd-847e-fb5f82ccd3f9 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:27:41.483706 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f465eaff-f85c-43ee-8cce-e6a6b7924ac1 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:41.484079 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:41.579072 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ac45990-ba22-4b3f-b309-10370b1d9d69 req-7ff90250-1fa2-41d5-8b15-f51fad8a6a0c tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:41.580704 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3ac45990-ba22-4b3f-b309-10370b1d9d69 req-7ff90250-1fa2-41d5-8b15-f51fad8a6a0c tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 945 time: 0.1214108 Dec 09 21:27:41.632457 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port a2162a7f-55fc-4ed6-a111-15a5b9802370 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:41.633033 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:41.658047 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2e6f9e02-163c-402f-becb-478d52c57467 req-919f0b0d-0efd-484f-b15a-a39256ddadb2 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0449195 Dec 09 21:27:41.664697 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3ac45990-ba22-4b3f-b309-10370b1d9d69 req-d49add2f-09d6-4482-b825-ed1ab41050d7 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0738223 Dec 09 21:27:41.909352 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ebfc0a7-7572-4982-8fa3-4888f760a200 req-32e1905f-ed08-437a-827e-168053b580bf tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:41.911123 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ebfc0a7-7572-4982-8fa3-4888f760a200 req-32e1905f-ed08-437a-827e-168053b580bf tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 943 time: 0.1157317 Dec 09 21:27:41.928124 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e6f9e02-163c-402f-becb-478d52c57467 req-b0bb9d9a-80fa-472a-8417-69b2195ff0fd tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:41.932655 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2e6f9e02-163c-402f-becb-478d52c57467 req-b0bb9d9a-80fa-472a-8417-69b2195ff0fd tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2668505 Dec 09 21:27:41.938027 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e', 'name': 'tempest-TaggedBootDevicesTest_v242-485407257-router', 'tenant_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.4'}], 'enable_snat': True}, 'gw_port_id': '0ca4bf99-2fc0-4203-9d93-7f254c7af4df', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:33Z', 'updated_at': '2021-12-09T21:27:38Z', 'revision_number': 4, 'project_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'gw_port': {'id': '0ca4bf99-2fc0-4203-9d93-7f254c7af4df', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:10:14:ff', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1126, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.4', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:33Z', 'updated_at': '2021-12-09T21:27:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '21963cc5-b64c-44cd-847e-fb5f82ccd3f9', 'name': '', 'network_id': '59e2b0d9-72ce-453d-a928-6c19b34a60c9', 'tenant_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'mac_address': 'fa:16:3e:cc:bd:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1127, 'fixed_ips': [{'subnet_id': '549d348b-5c92-4b49-aa63-dbd8d0a93c5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:37Z', 'updated_at': '2021-12-09T21:27:38Z', 'revision_number': 2, 'project_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'subnets': [{'id': '549d348b-5c92-4b49-aa63-dbd8d0a93c5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:41.949537 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-2e6f9e02-163c-402f-becb-478d52c57467 req-00e3cf62-59a8-497d-8f73-5ecaecaaa34e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Request body: {'port': {'device_id': '53da382a-16f4-44e1-bfd3-8ba00a807708', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '23f7f8a3e7b14635b4f7dfa561684399'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:41.973644 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b30807a-b59f-40bc-b0af-066d7e2c4191 None None] The sync data for ids ['bf1205e6-b4d1-485d-b2f3-3ea9a434d27e'] in n-d-713301-27 is: [{'id': 'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e', 'name': 'tempest-TaggedBootDevicesTest_v242-485407257-router', 'tenant_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.4'}], 'enable_snat': True}, 'gw_port_id': '0ca4bf99-2fc0-4203-9d93-7f254c7af4df', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:33Z', 'updated_at': '2021-12-09T21:27:38Z', 'revision_number': 4, 'project_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'gw_port': {'id': '0ca4bf99-2fc0-4203-9d93-7f254c7af4df', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:10:14:ff', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1126, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.4', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:33Z', 'updated_at': '2021-12-09T21:27:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '21963cc5-b64c-44cd-847e-fb5f82ccd3f9', 'name': '', 'network_id': '59e2b0d9-72ce-453d-a928-6c19b34a60c9', 'tenant_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'mac_address': 'fa:16:3e:cc:bd:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1127, 'fixed_ips': [{'subnet_id': '549d348b-5c92-4b49-aa63-dbd8d0a93c5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:37Z', 'updated_at': '2021-12-09T21:27:38Z', 'revision_number': 2, 'project_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'subnets': [{'id': '549d348b-5c92-4b49-aa63-dbd8d0a93c5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:27:41.975058 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:41.995480 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ebfc0a7-7572-4982-8fa3-4888f760a200 req-357e6d94-426e-4abf-985c-a84efd0d3d3d tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0695562 Dec 09 21:27:42.020069 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6887e7de-da00-425a-adeb-9e493806b121 req-9236e0b5-ae5c-4481-a40c-cd614f15e6de tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-SecurityGroupsTestJSON-securitygroup-1066064235&fields=id&tenant_id=5635fb0018b24f538b250cdac6dca9d9 HTTP/1.1" status: 200 len: 267 time: 0.1886692 Dec 09 21:27:42.033069 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f3361776-fc91-4b92-9d13-73ed7e781a51', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a2162a7f-55fc-4ed6-a111-15a5b9802370'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:27:42.035607 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c90717eb-dbb5-45c5-99eb-2dc2ac9b6fc7" -d '{"events": [{"server_uuid": "f3361776-fc91-4b92-9d13-73ed7e781a51", "name": "network-vif-plugged", "status": "completed", "tag": "a2162a7f-55fc-4ed6-a111-15a5b9802370"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:27:42.067572 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port a2162a7f-55fc-4ed6-a111-15a5b9802370, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a2162a7f-55fc-4ed6-a111-15a5b9802370,segment=NetworkSegment(e3c687b5-afac-4ac8-9b38-06599c2a8b7e),segment_id=e3c687b5-afac-4ac8-9b38-06599c2a8b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:42.078378 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:42.100059 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6887e7de-da00-425a-adeb-9e493806b121 req-1b0df727-e35e-49c3-92f5-87f5406613c0 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:42.112828 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6887e7de-da00-425a-adeb-9e493806b121 req-1b0df727-e35e-49c3-92f5-87f5406613c0 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 945 time: 0.0916040 Dec 09 21:27:42.119764 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-6887e7de-da00-425a-adeb-9e493806b121 req-b3b3b19f-ed35-4d22-9a11-a24cb1127315 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Request body: {'port': {'security_groups': ['18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9', 'fcc03377-adb3-4132-941b-ffa4bc0df861']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:42.149515 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2e6f9e02-163c-402f-becb-478d52c57467 req-00e3cf62-59a8-497d-8f73-5ecaecaaa34e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Made reservation on behalf of 23f7f8a3e7b14635b4f7dfa561684399 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:27:42.153478 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2e6f9e02-163c-402f-becb-478d52c57467 req-00e3cf62-59a8-497d-8f73-5ecaecaaa34e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:42.174289 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=a2162a7f-55fc-4ed6-a111-15a5b9802370,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:42.203399 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 19d4a80e-ba79-4490-8a95-e9c7e2370cf8 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:42.275860 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abbc3942-dced-4fd3-899e-f83025de8886 req-31b79e84-7901-4cf8-a58d-d8d4f1256f16 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:42.277417 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-abbc3942-dced-4fd3-899e-f83025de8886 req-31b79e84-7901-4cf8-a58d-d8d4f1256f16 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.1516290 Dec 09 21:27:42.295149 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6887e7de-da00-425a-adeb-9e493806b121 req-b3b3b19f-ed35-4d22-9a11-a24cb1127315 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:42.304623 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 19d4a80e-ba79-4490-8a95-e9c7e2370cf8 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:42.304822 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:42.356409 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-abbc3942-dced-4fd3-899e-f83025de8886 req-a64bdb9f-ef12-4ac7-a2ea-4d656d72ba91 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0649300 Dec 09 21:27:42.450121 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-2e6f9e02-163c-402f-becb-478d52c57467 req-00e3cf62-59a8-497d-8f73-5ecaecaaa34e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Allocated IP 192.168.233.217 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/937c022a-ae46-441a-8b52-fa1da6f3b496) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:27:42.604138 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-094d9076-51da-4e90-bf26-8dc88d064a9a req-2b7b7b6b-c70b-478b-b457-7777a1efba1f tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.0714972 Dec 09 21:27:42.682121 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:27:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5170c76d-42c0-4a53-9250-187ce2d90a98 x-openstack-request-id: req-5170c76d-42c0-4a53-9250-187ce2d90a98 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:27:42.682721 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f3361776-fc91-4b92-9d13-73ed7e781a51", "name": "network-vif-plugged", "status": "completed", "tag": "a2162a7f-55fc-4ed6-a111-15a5b9802370", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:27:42.682721 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-5170c76d-42c0-4a53-9250-187ce2d90a98 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:27:42.683129 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f3361776-fc91-4b92-9d13-73ed7e781a51', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a2162a7f-55fc-4ed6-a111-15a5b9802370', 'code': 200} Dec 09 21:27:42.844211 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2e6f9e02-163c-402f-becb-478d52c57467 req-00e3cf62-59a8-497d-8f73-5ecaecaaa34e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:42.874938 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2e6f9e02-163c-402f-becb-478d52c57467 req-00e3cf62-59a8-497d-8f73-5ecaecaaa34e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:42.889923 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['18bda486-9d6d-41a3-a260-dd244a3838b3', '2958b0be-15e5-48e2-b87a-6ffefd9a7859', '1ad36983-4549-4a03-a826-a31a08b98c98', '07457883-17db-4553-8f10-716e04bc16b1'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:27:42.897675 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['fd466da6-f506-43e6-9800-156622bd2781', 'c3c31744-0580-4d09-863d-697769f7c0ee', '0ef815c5-fc54-4d19-b139-1eaa75cffde2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:27:42.918393 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-6887e7de-da00-425a-adeb-9e493806b121 req-b3b3b19f-ed35-4d22-9a11-a24cb1127315 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] For port 117119cd-9d6a-4e2a-94cc-9578db376ba6, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=117119cd-9d6a-4e2a-94cc-9578db376ba6,segment=NetworkSegment(c472f4a8-1a94-4bb1-8978-a56e5ee37bb8),segment_id=c472f4a8-1a94-4bb1-8978-a56e5ee37bb8)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:42.937874 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed7b6af7-30a1-41ee-bba7-71a1a6b6ce42 req-4157ddb6-8217-48c1-bebf-394e52cbc029 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:42.945913 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ed7b6af7-30a1-41ee-bba7-71a1a6b6ce42 req-4157ddb6-8217-48c1-bebf-394e52cbc029 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 946 time: 0.1613371 Dec 09 21:27:42.949855 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2e6f9e02-163c-402f-becb-478d52c57467 req-00e3cf62-59a8-497d-8f73-5ecaecaaa34e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:27:42.954305 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-2e6f9e02-163c-402f-becb-478d52c57467 req-00e3cf62-59a8-497d-8f73-5ecaecaaa34e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:42.962776 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-2e6f9e02-163c-402f-becb-478d52c57467 req-00e3cf62-59a8-497d-8f73-5ecaecaaa34e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:27:43.011672 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7ad23cc-a051-4431-9525-92c686c51c35 req-335171a1-447c-4824-afd0-2e7526b0f486 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:43.018246 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d7ad23cc-a051-4431-9525-92c686c51c35 req-335171a1-447c-4824-afd0-2e7526b0f486 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 1097 time: 0.1869419 Dec 09 21:27:43.033428 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e6f9e02-163c-402f-becb-478d52c57467 req-00e3cf62-59a8-497d-8f73-5ecaecaaa34e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:43.034107 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2e6f9e02-163c-402f-becb-478d52c57467 req-00e3cf62-59a8-497d-8f73-5ecaecaaa34e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:43.056221 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:27:43.065607 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00e3cf62-59a8-497d-8f73-5ecaecaaa34e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Pushing event updated for resources: {'Port': ['ID=937c022a-ae46-441a-8b52-fa1da6f3b496,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:43.086405 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2e6f9e02-163c-402f-becb-478d52c57467 req-00e3cf62-59a8-497d-8f73-5ecaecaaa34e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.1423352 Dec 09 21:27:43.098583 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-2e6f9e02-163c-402f-becb-478d52c57467 req-82f65ab4-b46a-4417-9a5b-4a0375975490 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:27:43.099655 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2e6f9e02-163c-402f-becb-478d52c57467 req-82f65ab4-b46a-4417-9a5b-4a0375975490 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0073526 Dec 09 21:27:43.121093 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6887e7de-da00-425a-adeb-9e493806b121 req-b3b3b19f-ed35-4d22-9a11-a24cb1127315 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:43.128278 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-2e6f9e02-163c-402f-becb-478d52c57467 req-77247a66-3e83-4a82-ae38-93d524015c2f service neutron] Request body: {'port': {'device_id': '53da382a-16f4-44e1-bfd3-8ba00a807708', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:43.143492 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6887e7de-da00-425a-adeb-9e493806b121 req-b3b3b19f-ed35-4d22-9a11-a24cb1127315 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:43.167538 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ed7b6af7-30a1-41ee-bba7-71a1a6b6ce42 req-ed635420-e744-4eb5-956f-a579d522e9b2 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2206280 Dec 09 21:27:43.217359 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d7ad23cc-a051-4431-9525-92c686c51c35 req-3bef066a-7e4e-40b3-963c-a4a529db4323 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1776214 Dec 09 21:27:43.233607 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6887e7de-da00-425a-adeb-9e493806b121 req-b3b3b19f-ed35-4d22-9a11-a24cb1127315 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:43.234890 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6887e7de-da00-425a-adeb-9e493806b121 req-b3b3b19f-ed35-4d22-9a11-a24cb1127315 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:43.246462 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6887e7de-da00-425a-adeb-9e493806b121 req-b3b3b19f-ed35-4d22-9a11-a24cb1127315 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "PUT /v2.0/ports/117119cd-9d6a-4e2a-94cc-9578db376ba6 HTTP/1.1" status: 200 len: 981 time: 1.1325274 Dec 09 21:27:43.246994 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '21566c6e-f8d2-4122-ac9c-f052ec7a451c', 'tag': '117119cd-9d6a-4e2a-94cc-9578db376ba6'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:27:43.254748 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fb8a8bde-f004-43f2-918c-7d67662d144d" -d '{"events": [{"name": "network-changed", "server_uuid": "21566c6e-f8d2-4122-ac9c-f052ec7a451c", "tag": "117119cd-9d6a-4e2a-94cc-9578db376ba6"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:27:43.310176 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3b3b19f-ed35-4d22-9a11-a24cb1127315 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event updated for resources: {'Port': ['ID=117119cd-9d6a-4e2a-94cc-9578db376ba6,revision_number=6']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:43.310410 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2e6f9e02-163c-402f-becb-478d52c57467 req-77247a66-3e83-4a82-ae38-93d524015c2f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:43.361676 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['117119cd-9d6a-4e2a-94cc-9578db376ba6'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:27:43.371012 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b3b19f-ed35-4d22-9a11-a24cb1127315 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:43.371012 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b3b19f-ed35-4d22-9a11-a24cb1127315 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:43.371012 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b3b19f-ed35-4d22-9a11-a24cb1127315 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:43.371336 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b3b19f-ed35-4d22-9a11-a24cb1127315 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:43.378749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b3b19f-ed35-4d22-9a11-a24cb1127315 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:43.379190 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b3b19f-ed35-4d22-9a11-a24cb1127315 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:43.379589 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b3b19f-ed35-4d22-9a11-a24cb1127315 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:43.379926 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b3b19f-ed35-4d22-9a11-a24cb1127315 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:43.380259 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b3b19f-ed35-4d22-9a11-a24cb1127315 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:43.380592 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b3b19f-ed35-4d22-9a11-a24cb1127315 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:43.380923 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b3b19f-ed35-4d22-9a11-a24cb1127315 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:43.381251 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b3b19f-ed35-4d22-9a11-a24cb1127315 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:43.381576 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3b3b19f-ed35-4d22-9a11-a24cb1127315 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:43.484260 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-badcdb0f-eacc-4067-84af-de83da91c9cb None None] Provisioning complete for port 937c022a-ae46-441a-8b52-fa1da6f3b496 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:43.484868 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-badcdb0f-eacc-4067-84af-de83da91c9cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:43.565976 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afae7bbd-b228-4966-8b4d-9b8d178d8d3a req-596ba5ec-9f1e-479a-bac4-d2d85479f5a4 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:43.567660 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-afae7bbd-b228-4966-8b4d-9b8d178d8d3a req-596ba5ec-9f1e-479a-bac4-d2d85479f5a4 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 0.2353282 Dec 09 21:27:43.576176 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-122e62b7-d3d9-4f92-be57-900e5a0911d9 req-c671d588-406e-4fb0-a5d9-2e64c0ffb965 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:43.577822 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-122e62b7-d3d9-4f92-be57-900e5a0911d9 req-c671d588-406e-4fb0-a5d9-2e64c0ffb965 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=53da382a-16f4-44e1-bfd3-8ba00a807708 HTTP/1.1" status: 200 len: 936 time: 0.2113955 Dec 09 21:27:43.666282 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-badcdb0f-eacc-4067-84af-de83da91c9cb None None] Port 937c022a-ae46-441a-8b52-fa1da6f3b496 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:27:43.712267 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-afae7bbd-b228-4966-8b4d-9b8d178d8d3a req-28e9e2dc-9bb3-4188-b7da-7493434cae13 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1333957 Dec 09 21:27:43.758259 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-122e62b7-d3d9-4f92-be57-900e5a0911d9 req-5b9f4056-18c9-4fee-918b-8d8f0393d54e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1605532 Dec 09 21:27:43.837031 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-61494bca-8f7c-4e40-8922-a22f0e036701 req-00aa0ecf-68c1-42b2-a4d6-28721526d7dd tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/fcc03377-adb3-4132-941b-ffa4bc0df861 HTTP/1.1" status: 200 len: 1820 time: 0.0777342 Dec 09 21:27:43.853469 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:27:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cd394f80-ce78-4681-b307-8be571900ca8 x-openstack-request-id: req-cd394f80-ce78-4681-b307-8be571900ca8 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:27:43.853910 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "21566c6e-f8d2-4122-ac9c-f052ec7a451c", "tag": "117119cd-9d6a-4e2a-94cc-9578db376ba6", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:27:43.854285 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-cd394f80-ce78-4681-b307-8be571900ca8 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:27:43.854835 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '21566c6e-f8d2-4122-ac9c-f052ec7a451c', 'tag': '117119cd-9d6a-4e2a-94cc-9578db376ba6', 'status': 'completed', 'code': 200} Dec 09 21:27:43.884356 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-2e6f9e02-163c-402f-becb-478d52c57467 req-77247a66-3e83-4a82-ae38-93d524015c2f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 937c022a-ae46-441a-8b52-fa1da6f3b496 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:27:43.906252 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2e6f9e02-163c-402f-becb-478d52c57467 req-77247a66-3e83-4a82-ae38-93d524015c2f service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:43.928505 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-2e6f9e02-163c-402f-becb-478d52c57467 req-77247a66-3e83-4a82-ae38-93d524015c2f service neutron] Transition to ACTIVE for port object 937c022a-ae46-441a-8b52-fa1da6f3b496 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:27:43.937673 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2e6f9e02-163c-402f-becb-478d52c57467 req-77247a66-3e83-4a82-ae38-93d524015c2f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:43.951130 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-61494bca-8f7c-4e40-8922-a22f0e036701 req-92e0378d-0c11-462e-9052-8182aace1a84 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] delete failed (client error): There was a conflict when trying to complete your request. Dec 09 21:27:43.963845 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-61494bca-8f7c-4e40-8922-a22f0e036701 req-92e0378d-0c11-462e-9052-8182aace1a84 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "DELETE /v2.0/security-groups/fcc03377-adb3-4132-941b-ffa4bc0df861 HTTP/1.1" status: 409 len: 341 time: 0.1195049 Dec 09 21:27:43.980817 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb8a8bde-f004-43f2-918c-7d67662d144d req-62e805fe-0f65-42ad-8acf-b5b1dcbdc2ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:43.982466 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fb8a8bde-f004-43f2-918c-7d67662d144d req-62e805fe-0f65-42ad-8acf-b5b1dcbdc2ea service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=5635fb0018b24f538b250cdac6dca9d9&device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 1136 time: 0.1022727 Dec 09 21:27:44.079671 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77247a66-3e83-4a82-ae38-93d524015c2f service neutron] Pushing event updated for resources: {'Port': ['ID=937c022a-ae46-441a-8b52-fa1da6f3b496,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:44.134147 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef0ec7e8-b560-4ed3-8c26-4b374a1da8d3 req-21857194-4541-4aea-815f-11531074add0 tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.0631516 Dec 09 21:27:44.140232 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-2e6f9e02-163c-402f-becb-478d52c57467 req-77247a66-3e83-4a82-ae38-93d524015c2f service neutron] Attempting to bind port 937c022a-ae46-441a-8b52-fa1da6f3b496 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:27:44.141349 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-2e6f9e02-163c-402f-becb-478d52c57467 req-77247a66-3e83-4a82-ae38-93d524015c2f service neutron] Attempting to bind port 937c022a-ae46-441a-8b52-fa1da6f3b496 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:27:44.142484 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2e6f9e02-163c-402f-becb-478d52c57467 req-77247a66-3e83-4a82-ae38-93d524015c2f service neutron] Attempting to bind port 937c022a-ae46-441a-8b52-fa1da6f3b496 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:44.163367 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2e6f9e02-163c-402f-becb-478d52c57467 req-77247a66-3e83-4a82-ae38-93d524015c2f service neutron] Port 937c022a-ae46-441a-8b52-fa1da6f3b496 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:27:44.166869 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2e6f9e02-163c-402f-becb-478d52c57467 req-77247a66-3e83-4a82-ae38-93d524015c2f service neutron] Attempting to bind port 937c022a-ae46-441a-8b52-fa1da6f3b496 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:44.176290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2e6f9e02-163c-402f-becb-478d52c57467 req-77247a66-3e83-4a82-ae38-93d524015c2f service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 27, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:27:44.178146 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2e6f9e02-163c-402f-becb-478d52c57467 req-77247a66-3e83-4a82-ae38-93d524015c2f service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:27:44.178633 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2e6f9e02-163c-402f-becb-478d52c57467 req-77247a66-3e83-4a82-ae38-93d524015c2f service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:27:44.182243 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-2e6f9e02-163c-402f-becb-478d52c57467 req-77247a66-3e83-4a82-ae38-93d524015c2f service neutron] Bound port: 937c022a-ae46-441a-8b52-fa1da6f3b496, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:27:44.183945 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2e6f9e02-163c-402f-becb-478d52c57467 req-77247a66-3e83-4a82-ae38-93d524015c2f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:44.278995 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5685dff0-721d-442b-9d18-aa5a22aab6df req-0c99f398-dd8c-4f00-8115-ae110f127e39 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:44.280639 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5685dff0-721d-442b-9d18-aa5a22aab6df req-0c99f398-dd8c-4f00-8115-ae110f127e39 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.2962401 Dec 09 21:27:44.351827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb8a8bde-f004-43f2-918c-7d67662d144d req-eee0d55a-0ccb-46bf-b05d-8b907061f516 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:44.353350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fb8a8bde-f004-43f2-918c-7d67662d144d req-eee0d55a-0ccb-46bf-b05d-8b907061f516 service neutron] 10.222.0.10 "GET /v2.0/networks?id=de91a458-cde4-4265-8605-31d9b6f8f05f HTTP/1.1" status: 200 len: 911 time: 0.3601875 Dec 09 21:27:44.435813 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-2e6f9e02-163c-402f-becb-478d52c57467 req-77247a66-3e83-4a82-ae38-93d524015c2f service neutron] For port 937c022a-ae46-441a-8b52-fa1da6f3b496, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:27:44.452039 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-2e6f9e02-163c-402f-becb-478d52c57467 req-77247a66-3e83-4a82-ae38-93d524015c2f service neutron] For port 937c022a-ae46-441a-8b52-fa1da6f3b496, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=937c022a-ae46-441a-8b52-fa1da6f3b496,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:27:44.464563 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2e6f9e02-163c-402f-becb-478d52c57467 req-77247a66-3e83-4a82-ae38-93d524015c2f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:44.466069 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fb8a8bde-f004-43f2-918c-7d67662d144d req-50775d54-57da-4787-a973-915deb90ea79 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=117119cd-9d6a-4e2a-94cc-9578db376ba6 HTTP/1.1" status: 200 len: 217 time: 0.1006434 Dec 09 21:27:44.474815 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0ca4bf99-2fc0-4203-9d93-7f254c7af4df up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:44.509495 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5685dff0-721d-442b-9d18-aa5a22aab6df req-19f73d7b-890f-49d5-ba8b-7196e4e9a1eb tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2091184 Dec 09 21:27:44.512159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e6f9e02-163c-402f-becb-478d52c57467 req-77247a66-3e83-4a82-ae38-93d524015c2f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:44.514553 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2e6f9e02-163c-402f-becb-478d52c57467 req-77247a66-3e83-4a82-ae38-93d524015c2f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:44.530720 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2e6f9e02-163c-402f-becb-478d52c57467 req-77247a66-3e83-4a82-ae38-93d524015c2f service neutron] 10.222.0.31 "PUT /v2.0/ports/937c022a-ae46-441a-8b52-fa1da6f3b496 HTTP/1.1" status: 200 len: 1097 time: 1.4040601 Dec 09 21:27:44.536594 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '53da382a-16f4-44e1-bfd3-8ba00a807708', 'tag': '937c022a-ae46-441a-8b52-fa1da6f3b496'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:27:44.544653 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f0d365b6-18c8-4d24-8e72-9f39551617f3" -d '{"events": [{"name": "network-changed", "server_uuid": "53da382a-16f4-44e1-bfd3-8ba00a807708", "tag": "937c022a-ae46-441a-8b52-fa1da6f3b496"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:27:44.650194 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77247a66-3e83-4a82-ae38-93d524015c2f service neutron] Pushing event updated for resources: {'Port': ['ID=937c022a-ae46-441a-8b52-fa1da6f3b496,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:44.705839 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb8a8bde-f004-43f2-918c-7d67662d144d req-71e9b3b9-d219-44ad-94b3-d5ea2d49d11d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:44.711840 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fb8a8bde-f004-43f2-918c-7d67662d144d req-71e9b3b9-d219-44ad-94b3-d5ea2d49d11d service neutron] 10.222.0.10 "GET /v2.0/subnets?id=cb187a9c-ec94-4995-93f8-92c16c7a80a3 HTTP/1.1" status: 200 len: 850 time: 0.2323172 Dec 09 21:27:44.776747 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e6f9e02-163c-402f-becb-478d52c57467 req-63ac3425-bac9-4dca-9329-4b2f9d40cfeb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:44.781453 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2e6f9e02-163c-402f-becb-478d52c57467 req-63ac3425-bac9-4dca-9329-4b2f9d40cfeb service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&device_id=53da382a-16f4-44e1-bfd3-8ba00a807708 HTTP/1.1" status: 200 len: 1100 time: 0.0941005 Dec 09 21:27:44.842656 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 0ca4bf99-2fc0-4203-9d93-7f254c7af4df triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:44.843236 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:44.890307 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fb8a8bde-f004-43f2-918c-7d67662d144d req-3966006d-7e8e-4982-915b-ee638c4c1cae service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=de91a458-cde4-4265-8605-31d9b6f8f05f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1256027 Dec 09 21:27:44.907093 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2e6f9e02-163c-402f-becb-478d52c57467 req-f0f2b7d4-88db-4899-8f2e-e2a0b251d80a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.217&port_id=937c022a-ae46-441a-8b52-fa1da6f3b496 HTTP/1.1" status: 200 len: 217 time: 0.1099789 Dec 09 21:27:44.963796 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6677f42c-a9f3-42e6-af6c-9ce4f4953352 req-6f67c443-b2e7-4684-9ea9-0bd99f38029a tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:44.974233 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6677f42c-a9f3-42e6-af6c-9ce4f4953352 req-6f67c443-b2e7-4684-9ea9-0bd99f38029a tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 984 time: 0.2613502 Dec 09 21:27:45.004305 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72708601-7227-43eb-89cc-6a34eecb5658 req-57cdfcb9-02aa-46dd-ac71-a896297b73c1 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:45.006133 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72708601-7227-43eb-89cc-6a34eecb5658 req-57cdfcb9-02aa-46dd-ac71-a896297b73c1 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 946 time: 0.2649081 Dec 09 21:27:45.009834 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e6f9e02-163c-402f-becb-478d52c57467 req-994a4ab6-7fab-41ab-ac36-444e05c04d97 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:45.024074 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2e6f9e02-163c-402f-becb-478d52c57467 req-994a4ab6-7fab-41ab-ac36-444e05c04d97 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1067233 Dec 09 21:27:45.111758 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e6f9e02-163c-402f-becb-478d52c57467 req-12323c67-900b-46f3-9afd-1a629b3ef516 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:45.114322 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2e6f9e02-163c-402f-becb-478d52c57467 req-12323c67-900b-46f3-9afd-1a629b3ef516 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0712748 Dec 09 21:27:45.138406 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fb8a8bde-f004-43f2-918c-7d67662d144d req-ac131e27-26ea-44ec-ae7c-c538810efb85 service neutron] 10.222.0.10 "GET /v2.0/networks/de91a458-cde4-4265-8605-31d9b6f8f05f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2309327 Dec 09 21:27:45.162195 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:45.202176 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 0ca4bf99-2fc0-4203-9d93-7f254c7af4df, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=0ca4bf99-2fc0-4203-9d93-7f254c7af4df,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:45.210558 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:45.264302 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6677f42c-a9f3-42e6-af6c-9ce4f4953352 req-fb150718-fa56-453a-85a5-2ab2bed94312 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=fcc03377-adb3-4132-941b-ffa4bc0df861&id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 402 time: 0.2889276 Dec 09 21:27:45.288656 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=0ca4bf99-2fc0-4203-9d93-7f254c7af4df,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:45.306043 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2e6f9e02-163c-402f-becb-478d52c57467 req-9e2e3212-cfd7-4c06-94db-9d1b04cdabf0 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1825919 Dec 09 21:27:45.360614 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72708601-7227-43eb-89cc-6a34eecb5658 req-be3a1968-7e32-4f12-bde6-e1e652933bcd tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3084641 Dec 09 21:27:45.362650 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:27:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e4dbbaca-e6a3-4055-a482-1150f5dc5533 x-openstack-request-id: req-e4dbbaca-e6a3-4055-a482-1150f5dc5533 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:27:45.362951 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "53da382a-16f4-44e1-bfd3-8ba00a807708", "tag": "937c022a-ae46-441a-8b52-fa1da6f3b496", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:27:45.363601 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e4dbbaca-e6a3-4055-a482-1150f5dc5533 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:27:45.364015 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '53da382a-16f4-44e1-bfd3-8ba00a807708', 'tag': '937c022a-ae46-441a-8b52-fa1da6f3b496', 'status': 'completed', 'code': 200} Dec 09 21:27:45.431428 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fb8a8bde-f004-43f2-918c-7d67662d144d req-5a0c1d27-b537-46ef-a3f7-0e194f744513 service neutron] 10.222.0.10 "GET /v2.0/networks/de91a458-cde4-4265-8605-31d9b6f8f05f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2831144 Dec 09 21:27:45.441647 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['117119cd-9d6a-4e2a-94cc-9578db376ba6'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:27:45.450506 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2e6f9e02-163c-402f-becb-478d52c57467 req-67108b8d-9d7d-43a5-9e4b-6c0c15d85b1f service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1370933 Dec 09 21:27:45.618320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0d365b6-18c8-4d24-8e72-9f39551617f3 req-cd6be7f4-e6c8-4bed-855f-95f036b187f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:45.621839 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f0d365b6-18c8-4d24-8e72-9f39551617f3 req-cd6be7f4-e6c8-4bed-855f-95f036b187f0 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&device_id=53da382a-16f4-44e1-bfd3-8ba00a807708 HTTP/1.1" status: 200 len: 1100 time: 0.0967698 Dec 09 21:27:45.789563 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0d365b6-18c8-4d24-8e72-9f39551617f3 req-ab4b3d3d-5636-4f25-8dcf-cd45de322381 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:45.798947 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f0d365b6-18c8-4d24-8e72-9f39551617f3 req-ab4b3d3d-5636-4f25-8dcf-cd45de322381 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.1692555 Dec 09 21:27:45.859194 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f0d365b6-18c8-4d24-8e72-9f39551617f3 req-6581a0e2-01bb-4c34-86ef-75dd752fd92b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.217&port_id=937c022a-ae46-441a-8b52-fa1da6f3b496 HTTP/1.1" status: 200 len: 217 time: 0.0495579 Dec 09 21:27:45.925538 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0d365b6-18c8-4d24-8e72-9f39551617f3 req-5c1c40b0-9b3b-4c20-b176-a19287ad3369 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:45.928070 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f0d365b6-18c8-4d24-8e72-9f39551617f3 req-5c1c40b0-9b3b-4c20-b176-a19287ad3369 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0560334 Dec 09 21:27:46.009540 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0d365b6-18c8-4d24-8e72-9f39551617f3 req-2cbba119-b744-45ab-bf17-219e70c792d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:46.012281 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f0d365b6-18c8-4d24-8e72-9f39551617f3 req-2cbba119-b744-45ab-bf17-219e70c792d9 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0735073 Dec 09 21:27:46.025817 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6f0943b-eec6-464f-bf3d-b68d1f2a8bdb req-d9fbeaff-0bfa-423d-a81f-d3c619138745 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:46.027502 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c6f0943b-eec6-464f-bf3d-b68d1f2a8bdb req-d9fbeaff-0bfa-423d-a81f-d3c619138745 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=53da382a-16f4-44e1-bfd3-8ba00a807708 HTTP/1.1" status: 200 len: 948 time: 0.5544937 Dec 09 21:27:46.036825 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a6e790-e9bd-4ea3-be51-b03866776741 req-6331da55-bd80-4a67-911a-4bf9b85ca721 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:46.038936 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32a6e790-e9bd-4ea3-be51-b03866776741 req-6331da55-bd80-4a67-911a-4bf9b85ca721 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 0.5451763 Dec 09 21:27:46.077166 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deb8bb61-ffc1-4252-8a66-de9c90cb3de2 req-ce993b91-82ab-41fd-88a5-fa7b59e136ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:46.079841 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-deb8bb61-ffc1-4252-8a66-de9c90cb3de2 req-ce993b91-82ab-41fd-88a5-fa7b59e136ab service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=5635fb0018b24f538b250cdac6dca9d9&device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 1136 time: 0.5536997 Dec 09 21:27:46.134352 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] Sync routers for ids ['bf1205e6-b4d1-485d-b2f3-3ea9a434d27e'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:27:46.151703 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] Routers {'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:27:46.151896 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32a6e790-e9bd-4ea3-be51-b03866776741 req-5fe92739-e260-4f90-ba16-80ef7dce3b5a tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1032495 Dec 09 21:27:46.152335 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:27:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['bf1205e6-b4d1-485d-b2f3-3ea9a434d27e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:46.168062 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:27:46.251667 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0ca4bf99-2fc0-4203-9d93-7f254c7af4df up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:46.318100 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c6f0943b-eec6-464f-bf3d-b68d1f2a8bdb req-a9b0fb5d-60b9-4446-8ef9-20e3dffff71a tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2751603 Dec 09 21:27:46.370760 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bec2989-d82c-4fb0-a837-e3530e57bf02 req-b8e68e67-0057-4fa1-9958-5e5cbe9ee5c5 tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.0290761 Dec 09 21:27:46.391489 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deb8bb61-ffc1-4252-8a66-de9c90cb3de2 req-c27e6423-04f9-4bdf-b5a3-93f8f3313312 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:46.393620 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-deb8bb61-ffc1-4252-8a66-de9c90cb3de2 req-c27e6423-04f9-4bdf-b5a3-93f8f3313312 service neutron] 10.222.0.10 "GET /v2.0/networks?id=de91a458-cde4-4265-8605-31d9b6f8f05f HTTP/1.1" status: 200 len: 911 time: 0.2956018 Dec 09 21:27:46.408848 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] Set router bf1205e6-b4d1-485d-b2f3-3ea9a434d27e gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:27:46.458692 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-deb8bb61-ffc1-4252-8a66-de9c90cb3de2 req-a0da7e6e-bb29-4a8f-923c-49cb61a83d42 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=117119cd-9d6a-4e2a-94cc-9578db376ba6 HTTP/1.1" status: 200 len: 217 time: 0.0566275 Dec 09 21:27:46.503407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 0ca4bf99-2fc0-4203-9d93-7f254c7af4df triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:46.509169 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:46.667031 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93a14f0a-42eb-4013-a35d-01617766ec98 req-d6b743f7-d17b-45e2-89b9-74cf1e169681 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:46.667852 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-93a14f0a-42eb-4013-a35d-01617766ec98 req-d6b743f7-d17b-45e2-89b9-74cf1e169681 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.2001910 Dec 09 21:27:46.674396 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deb8bb61-ffc1-4252-8a66-de9c90cb3de2 req-c1cf079f-6f70-492c-af74-13b1511b8111 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:46.676671 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-deb8bb61-ffc1-4252-8a66-de9c90cb3de2 req-c1cf079f-6f70-492c-af74-13b1511b8111 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=cb187a9c-ec94-4995-93f8-92c16c7a80a3 HTTP/1.1" status: 200 len: 850 time: 0.1561468 Dec 09 21:27:46.731879 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19114cf4-49e3-493d-bfdf-5233a164bd67 req-bdf7d9e6-b015-4182-a74d-417effac2662 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:46.733890 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19114cf4-49e3-493d-bfdf-5233a164bd67 req-bdf7d9e6-b015-4182-a74d-417effac2662 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 0.1894095 Dec 09 21:27:46.736693 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-deb8bb61-ffc1-4252-8a66-de9c90cb3de2 req-4ddbc1c6-5f4c-4d03-b09a-9e6fcd5780fc service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=de91a458-cde4-4265-8605-31d9b6f8f05f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0503216 Dec 09 21:27:46.900598 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f0d365b6-18c8-4d24-8e72-9f39551617f3 req-5290751f-ceb7-4264-bc98-45f43f835609 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8649259 Dec 09 21:27:46.908895 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e', 'name': 'tempest-TaggedBootDevicesTest_v242-485407257-router', 'tenant_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.4'}], 'enable_snat': True}, 'gw_port_id': '0ca4bf99-2fc0-4203-9d93-7f254c7af4df', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:33Z', 'updated_at': '2021-12-09T21:27:38Z', 'revision_number': 4, 'project_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'gw_port': {'id': '0ca4bf99-2fc0-4203-9d93-7f254c7af4df', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:10:14:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1126, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.4', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:33Z', 'updated_at': '2021-12-09T21:27:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '21963cc5-b64c-44cd-847e-fb5f82ccd3f9', 'name': '', 'network_id': '59e2b0d9-72ce-453d-a928-6c19b34a60c9', 'tenant_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'mac_address': 'fa:16:3e:cc:bd:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1127, 'fixed_ips': [{'subnet_id': '549d348b-5c92-4b49-aa63-dbd8d0a93c5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:37Z', 'updated_at': '2021-12-09T21:27:38Z', 'revision_number': 2, 'project_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'subnets': [{'id': '549d348b-5c92-4b49-aa63-dbd8d0a93c5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:46.956398 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] Checking router: bf1205e6-b4d1-485d-b2f3-3ea9a434d27e for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:27:46.956755 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] Updating router bf1205e6-b4d1-485d-b2f3-3ea9a434d27e port 21963cc5-b64c-44cd-847e-fb5f82ccd3f9 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:27:46.966110 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19114cf4-49e3-493d-bfdf-5233a164bd67 req-98fdaab5-1421-4786-9cf4-8ad84412e1fd tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2256179 Dec 09 21:27:46.995673 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:47.022570 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-93a14f0a-42eb-4013-a35d-01617766ec98 req-32ee874f-64b2-4c7a-844f-d1b694fbaf0c tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3437274 Dec 09 21:27:47.049422 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f0d365b6-18c8-4d24-8e72-9f39551617f3 req-bf0fb55c-6f94-4582-b0e5-32fbcfd4c9d8 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1402836 Dec 09 21:27:47.113572 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-deb8bb61-ffc1-4252-8a66-de9c90cb3de2 req-c681d9bc-3ef5-48df-815d-b3b1eb279a77 service neutron] 10.222.0.10 "GET /v2.0/networks/de91a458-cde4-4265-8605-31d9b6f8f05f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3225231 Dec 09 21:27:47.126578 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e10de82-3513-4ea6-a4a8-6370f3506598 req-5ab87842-b060-408b-a627-6b55ca59f6ee tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:47.135084 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9e10de82-3513-4ea6-a4a8-6370f3506598 req-5ab87842-b060-408b-a627-6b55ca59f6ee tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 984 time: 0.0828800 Dec 09 21:27:47.320552 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2686a619-229d-494c-9bd6-026109ae86a0 req-a6560c34-4a7f-42ea-a63c-af7d9dd33b02 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:47.322079 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2686a619-229d-494c-9bd6-026109ae86a0 req-a6560c34-4a7f-42ea-a63c-af7d9dd33b02 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 946 time: 0.1643968 Dec 09 21:27:47.323982 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-deb8bb61-ffc1-4252-8a66-de9c90cb3de2 req-b12b73e2-1fbc-4047-8ae2-33043b7bd939 service neutron] 10.222.0.10 "GET /v2.0/networks/de91a458-cde4-4265-8605-31d9b6f8f05f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1819911 Dec 09 21:27:47.327706 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:47.329779 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9e10de82-3513-4ea6-a4a8-6370f3506598 req-7af79c61-7eb5-4277-a0df-98a5b88a1140 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=fcc03377-adb3-4132-941b-ffa4bc0df861&id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 402 time: 0.1939297 Dec 09 21:27:47.337057 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:47.391206 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2686a619-229d-494c-9bd6-026109ae86a0 req-5e08e3a2-3285-4f94-be12-f282fd5ec8aa tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0604582 Dec 09 21:27:47.421465 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95169861-8ec5-406e-8832-45cd0a9f4648 None None] Pushing event updated for resources: {'Port': ['ID=21963cc5-b64c-44cd-847e-fb5f82ccd3f9,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:47.428983 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 937c022a-ae46-441a-8b52-fa1da6f3b496 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:27:47.655670 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-237dcb18-9bb1-49a1-ac89-8a498ed34ac5 req-540aee62-bebe-46a0-ac7d-886a90db49ce tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:47.657444 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-237dcb18-9bb1-49a1-ac89-8a498ed34ac5 req-540aee62-bebe-46a0-ac7d-886a90db49ce tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=53da382a-16f4-44e1-bfd3-8ba00a807708 HTTP/1.1" status: 200 len: 948 time: 0.1409116 Dec 09 21:27:47.698059 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] Attempting to bind port 21963cc5-b64c-44cd-847e-fb5f82ccd3f9 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:27:47.698567 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] Attempting to bind port 21963cc5-b64c-44cd-847e-fb5f82ccd3f9 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'b277bb60-9cde-4512-80aa-21951c30630a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '59e2b0d9-72ce-453d-a928-6c19b34a60c9'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:27:47.699035 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] Attempting to bind port 21963cc5-b64c-44cd-847e-fb5f82ccd3f9 on network 59e2b0d9-72ce-453d-a928-6c19b34a60c9 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:47.704917 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 27, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:27:47.705559 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] Checking segment: {'id': 'b277bb60-9cde-4512-80aa-21951c30630a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '59e2b0d9-72ce-453d-a928-6c19b34a60c9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:27:47.706110 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:47.706601 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] Bound using segment: {'id': 'b277bb60-9cde-4512-80aa-21951c30630a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '59e2b0d9-72ce-453d-a928-6c19b34a60c9'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:27:47.707259 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] Bound port: 21963cc5-b64c-44cd-847e-fb5f82ccd3f9, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b277bb60-9cde-4512-80aa-21951c30630a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 116, 'network_id': '59e2b0d9-72ce-453d-a928-6c19b34a60c9'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:27:47.707756 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:47.753226 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 937c022a-ae46-441a-8b52-fa1da6f3b496, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=937c022a-ae46-441a-8b52-fa1da6f3b496,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:47.783906 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '937c022a-ae46-441a-8b52-fa1da6f3b496', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '937c022a-ae46-441a-8b52-fa1da6f3b496', 'mac_address': 'fa:16:3e:d0:08:12', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.217'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:27:47.813208 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] For port 21963cc5-b64c-44cd-847e-fb5f82ccd3f9, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:27:47.817397 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] For port 21963cc5-b64c-44cd-847e-fb5f82ccd3f9, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=21963cc5-b64c-44cd-847e-fb5f82ccd3f9,segment=NetworkSegment(b277bb60-9cde-4512-80aa-21951c30630a),segment_id=b277bb60-9cde-4512-80aa-21951c30630a)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:27:47.828088 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:47.876715 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-237dcb18-9bb1-49a1-ac89-8a498ed34ac5 req-690e29f7-f849-4da8-8642-7a67cb0fd6c2 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2108848 Dec 09 21:27:47.980309 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] Routers {'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:27:47.985274 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:27:35Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['bf1205e6-b4d1-485d-b2f3-3ea9a434d27e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:48.004888 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8061409d-4c42-41ee-8267-ad06a0cc123d req-5c60e3b3-69bc-4a4d-aa38-6c1db8086259 tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.1217427 Dec 09 21:27:48.123902 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:48.186494 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95169861-8ec5-406e-8832-45cd0a9f4648 None None] Pushing event updated for resources: {'Port': ['ID=21963cc5-b64c-44cd-847e-fb5f82ccd3f9,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:48.190801 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-697e227d-ad9d-4e8d-92b3-bad7e8d1ac7b None None] Provisioning complete for port 21963cc5-b64c-44cd-847e-fb5f82ccd3f9 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:48.191231 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-697e227d-ad9d-4e8d-92b3-bad7e8d1ac7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:48.232432 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 937c022a-ae46-441a-8b52-fa1da6f3b496 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:27:48.340266 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] Set router bf1205e6-b4d1-485d-b2f3-3ea9a434d27e gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:27:48.361429 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 937c022a-ae46-441a-8b52-fa1da6f3b496, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=937c022a-ae46-441a-8b52-fa1da6f3b496,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:48.374219 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:48.467981 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7bfe906-454f-4e2f-b8f5-ffcf48f77ff8 req-2c7f7fbb-1daf-4a45-a62b-4c526c4523a6 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:48.476681 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7bfe906-454f-4e2f-b8f5-ffcf48f77ff8 req-2c7f7fbb-1daf-4a45-a62b-4c526c4523a6 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.2926588 Dec 09 21:27:48.481627 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=937c022a-ae46-441a-8b52-fa1da6f3b496,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:48.485935 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-697e227d-ad9d-4e8d-92b3-bad7e8d1ac7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:48.500334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09fca3d1-cfa4-45fe-8f4f-75e6bf89f2a9 req-2b78aadb-2f8f-4751-8473-e17a7003db48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:48.501931 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09fca3d1-cfa4-45fe-8f4f-75e6bf89f2a9 req-2b78aadb-2f8f-4751-8473-e17a7003db48 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 1098 time: 0.2320669 Dec 09 21:27:48.525918 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-697e227d-ad9d-4e8d-92b3-bad7e8d1ac7b None None] For port 21963cc5-b64c-44cd-847e-fb5f82ccd3f9, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=21963cc5-b64c-44cd-847e-fb5f82ccd3f9,segment=NetworkSegment(b277bb60-9cde-4512-80aa-21951c30630a),segment_id=b277bb60-9cde-4512-80aa-21951c30630a)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:48.533938 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-697e227d-ad9d-4e8d-92b3-bad7e8d1ac7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:48.570256 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-740f3d4e-cfc1-444a-80f2-2d948b7549bb tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:48.580320 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-740f3d4e-cfc1-444a-80f2-2d948b7549bb tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/networks?id=4d446a14-1218-469d-93aa-b4f9babdbb6e HTTP/1.1" status: 200 len: 815 time: 0.5135090 Dec 09 21:27:48.607832 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-697e227d-ad9d-4e8d-92b3-bad7e8d1ac7b None None] Pushing event updated for resources: {'Port': ['ID=21963cc5-b64c-44cd-847e-fb5f82ccd3f9,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:48.617057 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7bfe906-454f-4e2f-b8f5-ffcf48f77ff8 req-32bc0988-3493-42ab-a696-c1fee8384a2a tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1394472 Dec 09 21:27:48.627393 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-abaab202-aa0a-4a16-be18-b75c662146cc tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/quotas/18e7af94d60344a18dedc56eda040c4b HTTP/1.1" status: 200 len: 375 time: 0.0461667 Dec 09 21:27:48.661156 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09fca3d1-cfa4-45fe-8f4f-75e6bf89f2a9 req-64dbedda-3ede-4161-9c01-2d42104f9429 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1497049 Dec 09 21:27:48.669456 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e74b6e2a-3923-41b7-80d6-c757e11c3d4c None None] Provisioning complete for port 21963cc5-b64c-44cd-847e-fb5f82ccd3f9 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:48.669990 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e74b6e2a-3923-41b7-80d6-c757e11c3d4c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:48.688910 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e', 'name': 'tempest-TaggedBootDevicesTest_v242-485407257-router', 'tenant_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.4'}], 'enable_snat': True}, 'gw_port_id': '0ca4bf99-2fc0-4203-9d93-7f254c7af4df', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:33Z', 'updated_at': '2021-12-09T21:27:38Z', 'revision_number': 4, 'project_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'gw_port': {'id': '0ca4bf99-2fc0-4203-9d93-7f254c7af4df', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:10:14:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1126, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.4', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:33Z', 'updated_at': '2021-12-09T21:27:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '21963cc5-b64c-44cd-847e-fb5f82ccd3f9', 'name': '', 'network_id': '59e2b0d9-72ce-453d-a928-6c19b34a60c9', 'tenant_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'mac_address': 'fa:16:3e:cc:bd:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1127, 'fixed_ips': [{'subnet_id': '549d348b-5c92-4b49-aa63-dbd8d0a93c5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:37Z', 'updated_at': '2021-12-09T21:27:47Z', 'revision_number': 4, 'project_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'subnets': [{'id': '549d348b-5c92-4b49-aa63-dbd8d0a93c5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:27:48.704311 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-64b2b576-9940-499f-a341-557b385f7019 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=18e7af94d60344a18dedc56eda040c4b&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0688353 Dec 09 21:27:48.752769 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99e95fb0-6381-49d6-ab17-9f3757486704 None None] The sync data for ids ['bf1205e6-b4d1-485d-b2f3-3ea9a434d27e'] in n-d-713301-27 is: [{'id': 'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e', 'name': 'tempest-TaggedBootDevicesTest_v242-485407257-router', 'tenant_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.4'}], 'enable_snat': True}, 'gw_port_id': '0ca4bf99-2fc0-4203-9d93-7f254c7af4df', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:33Z', 'updated_at': '2021-12-09T21:27:38Z', 'revision_number': 4, 'project_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'gw_port': {'id': '0ca4bf99-2fc0-4203-9d93-7f254c7af4df', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:10:14:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1126, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.4', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:33Z', 'updated_at': '2021-12-09T21:27:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '21963cc5-b64c-44cd-847e-fb5f82ccd3f9', 'name': '', 'network_id': '59e2b0d9-72ce-453d-a928-6c19b34a60c9', 'tenant_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'mac_address': 'fa:16:3e:cc:bd:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1127, 'fixed_ips': [{'subnet_id': '549d348b-5c92-4b49-aa63-dbd8d0a93c5c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:37Z', 'updated_at': '2021-12-09T21:27:47Z', 'revision_number': 4, 'project_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'subnets': [{'id': '549d348b-5c92-4b49-aa63-dbd8d0a93c5c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:27:48.886687 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b330b32e-927c-45dc-a04e-c76ca6abe73c req-7eb51131-bbfe-487e-bf20-f64f992ab2d7 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:48.888561 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b330b32e-927c-45dc-a04e-c76ca6abe73c req-7eb51131-bbfe-487e-bf20-f64f992ab2d7 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 984 time: 0.1666296 Dec 09 21:27:48.911106 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['937c022a-ae46-441a-8b52-fa1da6f3b496'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:27:48.935737 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-bb337f79-7e35-47a6-a213-36769096a20f service neutron] 10.222.0.13 "GET /v2.0/networks/4d446a14-1218-469d-93aa-b4f9babdbb6e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2239075 Dec 09 21:27:49.079391 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b330b32e-927c-45dc-a04e-c76ca6abe73c req-6452d77e-fcfd-4d26-b99f-eec4add13449 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=fcc03377-adb3-4132-941b-ffa4bc0df861&id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 402 time: 0.1778021 Dec 09 21:27:49.109616 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-245e45e8-3e59-424a-b90b-0cad1f081bec service neutron] 10.222.0.13 "GET /v2.0/networks/4d446a14-1218-469d-93aa-b4f9babdbb6e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1660492 Dec 09 21:27:49.176333 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3551517-e988-46f0-8398-55f47ddac1e4 req-26a1aee6-34fa-4802-860c-f4c785e5c551 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:49.185844 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e3551517-e988-46f0-8398-55f47ddac1e4 req-26a1aee6-34fa-4802-860c-f4c785e5c551 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.31 "GET /v2.0/ports?device_id=f3361776-fc91-4b92-9d13-73ed7e781a51 HTTP/1.1" status: 200 len: 945 time: 0.1081095 Dec 09 21:27:49.381050 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b04ce3c0-3d79-4dac-b7d5-ca6725d07e66 req-25470ec1-7ea7-451c-811f-20866082c5bd tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:49.381634 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-e3551517-e988-46f0-8398-55f47ddac1e4 req-e0bceec3-dbf0-4878-843e-fe18d92c16c2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Deleting port a2162a7f-55fc-4ed6-a111-15a5b9802370 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:27:49.382126 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e3551517-e988-46f0-8398-55f47ddac1e4 req-e0bceec3-dbf0-4878-843e-fe18d92c16c2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:49.382663 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b04ce3c0-3d79-4dac-b7d5-ca6725d07e66 req-25470ec1-7ea7-451c-811f-20866082c5bd tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 946 time: 0.1322756 Dec 09 21:27:49.490822 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b04ce3c0-3d79-4dac-b7d5-ca6725d07e66 req-31624123-bcaf-465d-90a3-f1b8da33e2e1 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0884817 Dec 09 21:27:49.523958 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbbdf73d-f45f-4b7b-b425-d0a547913e54 req-29d09dd7-96dc-4e8d-bb11-7e87239a3a25 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:49.531517 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dbbdf73d-f45f-4b7b-b425-d0a547913e54 req-29d09dd7-96dc-4e8d-bb11-7e87239a3a25 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=53da382a-16f4-44e1-bfd3-8ba00a807708 HTTP/1.1" status: 200 len: 949 time: 0.1477387 Dec 09 21:27:49.550245 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-e3551517-e988-46f0-8398-55f47ddac1e4 req-e0bceec3-dbf0-4878-843e-fe18d92c16c2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] For port a2162a7f-55fc-4ed6-a111-15a5b9802370, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a2162a7f-55fc-4ed6-a111-15a5b9802370,segment=NetworkSegment(e3c687b5-afac-4ac8-9b38-06599c2a8b7e),segment_id=e3c687b5-afac-4ac8-9b38-06599c2a8b7e)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:49.556496 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e3551517-e988-46f0-8398-55f47ddac1e4 req-e0bceec3-dbf0-4878-843e-fe18d92c16c2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:49.582651 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-e3551517-e988-46f0-8398-55f47ddac1e4 req-e0bceec3-dbf0-4878-843e-fe18d92c16c2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Calling delete_port for a2162a7f-55fc-4ed6-a111-15a5b9802370 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:27:49.608918 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dbbdf73d-f45f-4b7b-b425-d0a547913e54 req-be1c3fbd-0853-4654-90e3-6f5b0153eb84 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0759358 Dec 09 21:27:49.729436 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-acdc2edc-155a-4a66-9aea-16694b982bfc req-bf301c4a-ab27-4f88-aafa-85238e1d93e3 tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.0583799 Dec 09 21:27:49.844627 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-62803a89-834a-4da2-9079-ce491c7b9abb req-876248a6-3cc9-46c0-9037-03f289759ec0 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-SecurityGroupsTestJSON-securitygroup-1329481412&fields=id&tenant_id=5635fb0018b24f538b250cdac6dca9d9 HTTP/1.1" status: 200 len: 267 time: 0.1022122 Dec 09 21:27:49.872984 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e3551517-e988-46f0-8398-55f47ddac1e4 req-e0bceec3-dbf0-4878-843e-fe18d92c16c2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:49.936953 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1694b8bf-143d-43d7-b83e-7d8ac0b13892 req-115414cb-288a-46bb-a9e4-4f826a3c0f5e tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 210 time: 0.1254773 Dec 09 21:27:49.937452 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0bceec3-dbf0-4878-843e-fe18d92c16c2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Pushing event deleted for resources: {'Port': ['ID=a2162a7f-55fc-4ed6-a111-15a5b9802370,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:49.976910 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0bceec3-dbf0-4878-843e-fe18d92c16c2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:49.977259 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0bceec3-dbf0-4878-843e-fe18d92c16c2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:49.990281 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0bceec3-dbf0-4878-843e-fe18d92c16c2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:49.990896 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0bceec3-dbf0-4878-843e-fe18d92c16c2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:49.991256 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0bceec3-dbf0-4878-843e-fe18d92c16c2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:49.991692 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0bceec3-dbf0-4878-843e-fe18d92c16c2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:49.992063 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0bceec3-dbf0-4878-843e-fe18d92c16c2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:49.992420 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0bceec3-dbf0-4878-843e-fe18d92c16c2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:49.992847 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0bceec3-dbf0-4878-843e-fe18d92c16c2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:49.993183 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0bceec3-dbf0-4878-843e-fe18d92c16c2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:49.993608 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0bceec3-dbf0-4878-843e-fe18d92c16c2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:49.993989 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0bceec3-dbf0-4878-843e-fe18d92c16c2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:49.994290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e0bceec3-dbf0-4878-843e-fe18d92c16c2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:27:50.070676 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-e3551517-e988-46f0-8398-55f47ddac1e4 req-e0bceec3-dbf0-4878-843e-fe18d92c16c2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] No DVR routers for this DVR port a2162a7f-55fc-4ed6-a111-15a5b9802370 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:27:50.075417 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e3551517-e988-46f0-8398-55f47ddac1e4 req-e0bceec3-dbf0-4878-843e-fe18d92c16c2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:50.079964 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62803a89-834a-4da2-9079-ce491c7b9abb req-678d4af3-e08b-4ba2-9f96-c610839db46a tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:50.090069 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e3551517-e988-46f0-8398-55f47ddac1e4 req-e0bceec3-dbf0-4878-843e-fe18d92c16c2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.31 "DELETE /v2.0/ports/a2162a7f-55fc-4ed6-a111-15a5b9802370 HTTP/1.1" status: 204 len: 173 time: 0.8959029 Dec 09 21:27:50.090660 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f3361776-fc91-4b92-9d13-73ed7e781a51', 'name': 'network-vif-deleted', 'tag': 'a2162a7f-55fc-4ed6-a111-15a5b9802370'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:27:50.097610 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8a63c5bf-1bdc-451b-adfa-3e78ead501a9" -d '{"events": [{"server_uuid": "f3361776-fc91-4b92-9d13-73ed7e781a51", "name": "network-vif-deleted", "tag": "a2162a7f-55fc-4ed6-a111-15a5b9802370"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:27:50.105202 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-62803a89-834a-4da2-9079-ce491c7b9abb req-678d4af3-e08b-4ba2-9f96-c610839db46a tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 984 time: 0.1670403 Dec 09 21:27:50.116075 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-62803a89-834a-4da2-9079-ce491c7b9abb req-ef19aad9-b61f-4307-8889-c1ee67c700eb tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Request body: {'port': {'security_groups': ['18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9', 'fcc03377-adb3-4132-941b-ffa4bc0df861', 'cdc6e27b-dfad-461a-82c4-cf68a29a9802']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:50.244419 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-62803a89-834a-4da2-9079-ce491c7b9abb req-ef19aad9-b61f-4307-8889-c1ee67c700eb tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:50.265363 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c65393e-2120-4677-9ecb-a674a48d500b req-da3ea235-8218-463d-8fa8-c0a29d9d891b tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:50.278672 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3c65393e-2120-4677-9ecb-a674a48d500b req-da3ea235-8218-463d-8fa8-c0a29d9d891b tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.1708212 Dec 09 21:27:50.305476 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 21963cc5-b64c-44cd-847e-fb5f82ccd3f9 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:50.414646 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 21963cc5-b64c-44cd-847e-fb5f82ccd3f9 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:50.415024 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:50.441638 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3c65393e-2120-4677-9ecb-a674a48d500b req-ab807fd5-59fb-43ce-93a9-4bc857f369ec tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1618679 Dec 09 21:27:50.518980 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:27:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a53d13f6-b8a5-4cc3-a0e8-6712be73115b x-openstack-request-id: req-a53d13f6-b8a5-4cc3-a0e8-6712be73115b {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:27:50.520081 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f3361776-fc91-4b92-9d13-73ed7e781a51", "name": "network-vif-deleted", "tag": "a2162a7f-55fc-4ed6-a111-15a5b9802370", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:27:50.520081 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a53d13f6-b8a5-4cc3-a0e8-6712be73115b {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:27:50.520576 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f3361776-fc91-4b92-9d13-73ed7e781a51', 'name': 'network-vif-deleted', 'tag': 'a2162a7f-55fc-4ed6-a111-15a5b9802370', 'status': 'completed', 'code': 200} Dec 09 21:27:50.690154 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-62803a89-834a-4da2-9079-ce491c7b9abb req-ef19aad9-b61f-4307-8889-c1ee67c700eb tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] For port 117119cd-9d6a-4e2a-94cc-9578db376ba6, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=117119cd-9d6a-4e2a-94cc-9578db376ba6,segment=NetworkSegment(c472f4a8-1a94-4bb1-8978-a56e5ee37bb8),segment_id=c472f4a8-1a94-4bb1-8978-a56e5ee37bb8)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:50.718582 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb766a04-4cbc-4001-afcd-dccf936c54f9 req-2ac588b6-ad1a-4c20-bdee-925ef633c588 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:50.726893 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eb766a04-4cbc-4001-afcd-dccf936c54f9 req-2ac588b6-ad1a-4c20-bdee-925ef633c588 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 946 time: 0.1134965 Dec 09 21:27:50.842845 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-62803a89-834a-4da2-9079-ce491c7b9abb req-ef19aad9-b61f-4307-8889-c1ee67c700eb tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:50.861762 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eb766a04-4cbc-4001-afcd-dccf936c54f9 req-bb55a34b-2a82-4652-a7d0-889589ca463a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1311169 Dec 09 21:27:50.866951 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-62803a89-834a-4da2-9079-ce491c7b9abb req-ef19aad9-b61f-4307-8889-c1ee67c700eb tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:50.882471 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['117119cd-9d6a-4e2a-94cc-9578db376ba6'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:27:50.886098 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:27:50.963580 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62803a89-834a-4da2-9079-ce491c7b9abb req-ef19aad9-b61f-4307-8889-c1ee67c700eb tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:50.964226 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-62803a89-834a-4da2-9079-ce491c7b9abb req-ef19aad9-b61f-4307-8889-c1ee67c700eb tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:50.977083 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-62803a89-834a-4da2-9079-ce491c7b9abb req-ef19aad9-b61f-4307-8889-c1ee67c700eb tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "PUT /v2.0/ports/117119cd-9d6a-4e2a-94cc-9578db376ba6 HTTP/1.1" status: 200 len: 1020 time: 0.8704369 Dec 09 21:27:50.977399 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '21566c6e-f8d2-4122-ac9c-f052ec7a451c', 'tag': '117119cd-9d6a-4e2a-94cc-9578db376ba6'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:27:50.980270 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e585dd42-bd7e-40a9-a53a-06d33d03dc84" -d '{"events": [{"name": "network-changed", "server_uuid": "21566c6e-f8d2-4122-ac9c-f052ec7a451c", "tag": "117119cd-9d6a-4e2a-94cc-9578db376ba6"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:27:51.012923 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef19aad9-b61f-4307-8889-c1ee67c700eb tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event updated for resources: {'Port': ['ID=117119cd-9d6a-4e2a-94cc-9578db376ba6,revision_number=7']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:51.063518 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['117119cd-9d6a-4e2a-94cc-9578db376ba6'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:27:51.169165 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d53abbf-894f-47f9-ade2-6663edc24d07 req-5cbb93c4-656a-41af-89b0-bbb0eeab8a57 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:51.170878 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1d53abbf-894f-47f9-ade2-6663edc24d07 req-5cbb93c4-656a-41af-89b0-bbb0eeab8a57 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=53da382a-16f4-44e1-bfd3-8ba00a807708 HTTP/1.1" status: 200 len: 949 time: 0.0995679 Dec 09 21:27:51.192888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37d40f60-56ff-405c-af00-64b40ae65254 req-c44817cc-6fc4-4f03-a59d-fae106b276e8 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:51.200200 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-37d40f60-56ff-405c-af00-64b40ae65254 req-c44817cc-6fc4-4f03-a59d-fae106b276e8 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/networks?id=e7d3d836-ebe9-4e03-af4b-235dd5e5cbea HTTP/1.1" status: 200 len: 811 time: 0.1833937 Dec 09 21:27:51.226386 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-37d40f60-56ff-405c-af00-64b40ae65254 req-639ab1b8-78b4-49e8-88e0-beaa40fe82be tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/quotas/9ca15fab17f34cc58f1ad1fcedc1bf31 HTTP/1.1" status: 200 len: 375 time: 0.0253141 Dec 09 21:27:51.301677 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1d53abbf-894f-47f9-ade2-6663edc24d07 req-956cc7ef-624b-4b9a-adf6-aae8154d1255 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1231396 Dec 09 21:27:51.332711 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-37d40f60-56ff-405c-af00-64b40ae65254 req-0df85a1a-12ad-469e-8f65-9c403e650089 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=9ca15fab17f34cc58f1ad1fcedc1bf31&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1053836 Dec 09 21:27:51.339573 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-37d40f60-56ff-405c-af00-64b40ae65254 req-4834f4e0-1aed-4c4b-9cef-d4e38a2526d4 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:27:51.353360 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-37d40f60-56ff-405c-af00-64b40ae65254 req-4834f4e0-1aed-4c4b-9cef-d4e38a2526d4 service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0196805 Dec 09 21:27:51.470150 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 937c022a-ae46-441a-8b52-fa1da6f3b496 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:51.509293 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-52549ba3-ed94-45e5-953d-daae9e26e452 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:51.514559 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-52549ba3-ed94-45e5-953d-daae9e26e452 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.31 "GET /v2.0/networks?id=4d446a14-1218-469d-93aa-b4f9babdbb6e HTTP/1.1" status: 200 len: 815 time: 0.2868459 Dec 09 21:27:51.530074 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-c9835ce9-0486-4fe0-8852-8b8bfbc986c0 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Request body: {'port': {'device_id': 'bac40331-6475-4539-8840-531fdb9e5c14', 'network_id': '4d446a14-1218-469d-93aa-b4f9babdbb6e', 'admin_state_up': True, 'tenant_id': '18e7af94d60344a18dedc56eda040c4b'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:51.592908 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84fcf126-80e6-4a35-8aba-feddb1ce0b86 req-3743ce45-34a7-487d-a989-e3399f58b6ff tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.1071985 Dec 09 21:27:51.626440 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-37d40f60-56ff-405c-af00-64b40ae65254 req-26c28772-96f4-48a8-8a57-c3101c7cee52 service neutron] 10.222.0.13 "GET /v2.0/networks/e7d3d836-ebe9-4e03-af4b-235dd5e5cbea?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2462292 Dec 09 21:27:51.735532 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-c9835ce9-0486-4fe0-8852-8b8bfbc986c0 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Made reservation on behalf of 18e7af94d60344a18dedc56eda040c4b for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:27:51.736682 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 937c022a-ae46-441a-8b52-fa1da6f3b496 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:27:51.740789 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-c9835ce9-0486-4fe0-8852-8b8bfbc986c0 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:51.755606 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b99749b4-40f0-4ee8-b2f8-e417fe649606 req-9a32c5f0-9592-4abb-9ef4-01fd114a3cfc tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/cdc6e27b-dfad-461a-82c4-cf68a29a9802 HTTP/1.1" status: 200 len: 1820 time: 0.0954006 Dec 09 21:27:51.765278 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 937c022a-ae46-441a-8b52-fa1da6f3b496 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:51.765658 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:51.818097 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-b99749b4-40f0-4ee8-b2f8-e417fe649606 req-13645148-3546-4d80-9b57-487e2ffa6d6d tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] delete failed (client error): There was a conflict when trying to complete your request. Dec 09 21:27:51.829792 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b99749b4-40f0-4ee8-b2f8-e417fe649606 req-13645148-3546-4d80-9b57-487e2ffa6d6d tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "DELETE /v2.0/security-groups/cdc6e27b-dfad-461a-82c4-cf68a29a9802 HTTP/1.1" status: 409 len: 341 time: 0.0732052 Dec 09 21:27:51.837957 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-37d40f60-56ff-405c-af00-64b40ae65254 req-bf415d7a-9f64-448e-b0c0-74d5aa16d7c9 service neutron] 10.222.0.13 "GET /v2.0/networks/e7d3d836-ebe9-4e03-af4b-235dd5e5cbea?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2105989 Dec 09 21:27:51.925150 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-109e22da-20ab-4b1f-b143-02ba5340dcfc req-c834558b-b09c-4dad-8a3d-d56cbd10922d tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 210 time: 0.0420182 Dec 09 21:27:51.935574 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-c9835ce9-0486-4fe0-8852-8b8bfbc986c0 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Allocated IP 172.20.0.3 (4d446a14-1218-469d-93aa-b4f9babdbb6e/75afc53b-d3f3-461c-aba4-c2ce93780246/8d3e0eef-050e-4fd6-87a2-f7e332149769) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:27:51.973405 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:27:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8f55b4a4-4dff-47c0-a3b4-6172bac60aaa x-openstack-request-id: req-8f55b4a4-4dff-47c0-a3b4-6172bac60aaa {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:27:51.973906 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "21566c6e-f8d2-4122-ac9c-f052ec7a451c", "tag": "117119cd-9d6a-4e2a-94cc-9578db376ba6", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:27:51.974328 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8f55b4a4-4dff-47c0-a3b4-6172bac60aaa {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:27:51.974907 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '21566c6e-f8d2-4122-ac9c-f052ec7a451c', 'tag': '117119cd-9d6a-4e2a-94cc-9578db376ba6', 'status': 'completed', 'code': 200} Dec 09 21:27:52.102891 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e585dd42-bd7e-40a9-a53a-06d33d03dc84 req-d59f59c5-8951-4811-b298-617afe97fe33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:52.108190 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e585dd42-bd7e-40a9-a53a-06d33d03dc84 req-d59f59c5-8951-4811-b298-617afe97fe33 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=5635fb0018b24f538b250cdac6dca9d9&device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 1175 time: 0.1032860 Dec 09 21:27:52.250993 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:52.279411 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-c9835ce9-0486-4fe0-8852-8b8bfbc986c0 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:52.370201 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-c9835ce9-0486-4fe0-8852-8b8bfbc986c0 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:52.379475 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '53da382a-16f4-44e1-bfd3-8ba00a807708', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '937c022a-ae46-441a-8b52-fa1da6f3b496'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:27:52.384784 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8128d676-a765-463b-892e-d64f822f90b8" -d '{"events": [{"server_uuid": "53da382a-16f4-44e1-bfd3-8ba00a807708", "name": "network-vif-plugged", "status": "completed", "tag": "937c022a-ae46-441a-8b52-fa1da6f3b496"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:27:52.415073 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-c9835ce9-0486-4fe0-8852-8b8bfbc986c0 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Network 4d446a14-1218-469d-93aa-b4f9babdbb6e is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:27:52.427605 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e585dd42-bd7e-40a9-a53a-06d33d03dc84 req-bb0bafe8-715c-4305-8a07-303a09e2b569 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:52.430838 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e585dd42-bd7e-40a9-a53a-06d33d03dc84 req-bb0bafe8-715c-4305-8a07-303a09e2b569 service neutron] 10.222.0.10 "GET /v2.0/networks?id=de91a458-cde4-4265-8605-31d9b6f8f05f HTTP/1.1" status: 200 len: 911 time: 0.3124158 Dec 09 21:27:52.433935 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 937c022a-ae46-441a-8b52-fa1da6f3b496, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=937c022a-ae46-441a-8b52-fa1da6f3b496,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:52.443875 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-c9835ce9-0486-4fe0-8852-8b8bfbc986c0 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:52.451781 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-c9835ce9-0486-4fe0-8852-8b8bfbc986c0 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:27:52.456065 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:52.456723 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device a2162a7f-55fc-4ed6-a111-15a5b9802370 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:27:52.522553 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-c9835ce9-0486-4fe0-8852-8b8bfbc986c0 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:52.523528 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-c9835ce9-0486-4fe0-8852-8b8bfbc986c0 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:52.536668 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9835ce9-0486-4fe0-8852-8b8bfbc986c0 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Pushing event updated for resources: {'Port': ['ID=8d3e0eef-050e-4fd6-87a2-f7e332149769,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:52.551767 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=937c022a-ae46-441a-8b52-fa1da6f3b496,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:52.557156 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-c9835ce9-0486-4fe0-8852-8b8bfbc986c0 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0323412 Dec 09 21:27:52.572943 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e585dd42-bd7e-40a9-a53a-06d33d03dc84 req-405ddf7e-ee65-4880-9bcd-5f66aa14c89f service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=117119cd-9d6a-4e2a-94cc-9578db376ba6 HTTP/1.1" status: 200 len: 217 time: 0.0802357 Dec 09 21:27:52.573168 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-9f850244-3b32-4e8b-b471-4db5e8373519 service neutron] Request body: {'port': {'device_id': 'bac40331-6475-4539-8840-531fdb9e5c14', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:52.579373 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: a2162a7f-55fc-4ed6-a111-15a5b9802370 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:27:52.579722 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device a2162a7f-55fc-4ed6-a111-15a5b9802370 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:27:52.608111 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e35094f7-1858-400b-9796-4da957f650cd req-413d0f56-6850-4b9e-902d-9f66d6645438 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 210 time: 0.2441897 Dec 09 21:27:52.705670 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-9f850244-3b32-4e8b-b471-4db5e8373519 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:52.718716 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-846910be-27de-434b-b689-13a61133769f req-d0fe00a8-da73-481f-b6f3-6c615eaab8e2 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:52.729658 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-846910be-27de-434b-b689-13a61133769f req-d0fe00a8-da73-481f-b6f3-6c615eaab8e2 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 946 time: 0.5235951 Dec 09 21:27:52.850350 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e585dd42-bd7e-40a9-a53a-06d33d03dc84 req-2fbebf70-9568-444a-bffe-07b732e13a75 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:52.852437 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e585dd42-bd7e-40a9-a53a-06d33d03dc84 req-2fbebf70-9568-444a-bffe-07b732e13a75 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=cb187a9c-ec94-4995-93f8-92c16c7a80a3 HTTP/1.1" status: 200 len: 850 time: 0.2594833 Dec 09 21:27:52.875651 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-846910be-27de-434b-b689-13a61133769f req-bf2df140-35a6-47d1-ad1f-39ed25f121fd tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1439719 Dec 09 21:27:52.909506 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e585dd42-bd7e-40a9-a53a-06d33d03dc84 req-a8621bb0-397a-467d-a54a-30c59e4ddfa5 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=de91a458-cde4-4265-8605-31d9b6f8f05f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0475185 Dec 09 21:27:52.920087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990f8321-0a16-4f5b-ac5a-5d3f648e5a49 req-7b874b84-3092-43e5-8b4f-1a597d606d9e tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:52.929633 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-990f8321-0a16-4f5b-ac5a-5d3f648e5a49 req-7b874b84-3092-43e5-8b4f-1a597d606d9e tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 1023 time: 0.1890082 Dec 09 21:27:52.971856 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-e585dd42-bd7e-40a9-a53a-06d33d03dc84 req-5977e942-c6ed-4e5c-8b12-b7bdf536734a service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:27:52.976112 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e585dd42-bd7e-40a9-a53a-06d33d03dc84 req-5977e942-c6ed-4e5c-8b12-b7bdf536734a service neutron] 10.222.0.10 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0415890 Dec 09 21:27:53.119888 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e585dd42-bd7e-40a9-a53a-06d33d03dc84 req-1f7d1ec6-5ea0-44d2-af06-6a871646d6a9 service neutron] 10.222.0.10 "GET /v2.0/networks/de91a458-cde4-4265-8605-31d9b6f8f05f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1349096 Dec 09 21:27:53.156440 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-9f850244-3b32-4e8b-b471-4db5e8373519 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8d3e0eef-050e-4fd6-87a2-f7e332149769 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:27:53.167321 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-9f850244-3b32-4e8b-b471-4db5e8373519 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:53.207889 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-9f850244-3b32-4e8b-b471-4db5e8373519 service neutron] Transition to ACTIVE for port object 8d3e0eef-050e-4fd6-87a2-f7e332149769 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:27:53.215524 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-9f850244-3b32-4e8b-b471-4db5e8373519 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:53.220207 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-990f8321-0a16-4f5b-ac5a-5d3f648e5a49 req-fc2aa40c-1c95-4c68-823c-2a6f29d1e063 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=fcc03377-adb3-4132-941b-ffa4bc0df861&id=cdc6e27b-dfad-461a-82c4-cf68a29a9802&id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 517 time: 0.2896600 Dec 09 21:27:53.302291 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:27:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8ed56f27-b9d0-40a3-83c8-4aaedb1ac1b2 x-openstack-request-id: req-8ed56f27-b9d0-40a3-83c8-4aaedb1ac1b2 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:27:53.303748 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "53da382a-16f4-44e1-bfd3-8ba00a807708", "name": "network-vif-plugged", "status": "completed", "tag": "937c022a-ae46-441a-8b52-fa1da6f3b496", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:27:53.304103 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8ed56f27-b9d0-40a3-83c8-4aaedb1ac1b2 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:27:53.304599 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '53da382a-16f4-44e1-bfd3-8ba00a807708', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '937c022a-ae46-441a-8b52-fa1da6f3b496', 'code': 200} Dec 09 21:27:53.315461 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e585dd42-bd7e-40a9-a53a-06d33d03dc84 req-2bc345f5-6772-41d1-bc57-1bacc24b5ec0 service neutron] 10.222.0.10 "GET /v2.0/networks/de91a458-cde4-4265-8605-31d9b6f8f05f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1791573 Dec 09 21:27:53.335868 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f850244-3b32-4e8b-b471-4db5e8373519 service neutron] Pushing event updated for resources: {'Port': ['ID=8d3e0eef-050e-4fd6-87a2-f7e332149769,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:53.349545 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03881810-1263-4592-964d-9d2f1e513063 req-f3c54490-0d40-4180-8d9e-47a5eb231378 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:53.358880 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-03881810-1263-4592-964d-9d2f1e513063 req-f3c54490-0d40-4180-8d9e-47a5eb231378 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=53da382a-16f4-44e1-bfd3-8ba00a807708 HTTP/1.1" status: 200 len: 950 time: 0.2274637 Dec 09 21:27:53.484754 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-9f850244-3b32-4e8b-b471-4db5e8373519 service neutron] Attempting to bind port 8d3e0eef-050e-4fd6-87a2-f7e332149769 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:27:53.485149 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-9f850244-3b32-4e8b-b471-4db5e8373519 service neutron] Attempting to bind port 8d3e0eef-050e-4fd6-87a2-f7e332149769 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'e3c687b5-afac-4ac8-9b38-06599c2a8b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '4d446a14-1218-469d-93aa-b4f9babdbb6e'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:27:53.485858 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-9f850244-3b32-4e8b-b471-4db5e8373519 service neutron] Attempting to bind port 8d3e0eef-050e-4fd6-87a2-f7e332149769 on network 4d446a14-1218-469d-93aa-b4f9babdbb6e {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:53.492932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-9f850244-3b32-4e8b-b471-4db5e8373519 service neutron] Port 8d3e0eef-050e-4fd6-87a2-f7e332149769 on network 4d446a14-1218-469d-93aa-b4f9babdbb6e not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:27:53.493316 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-9f850244-3b32-4e8b-b471-4db5e8373519 service neutron] Attempting to bind port 8d3e0eef-050e-4fd6-87a2-f7e332149769 on network 4d446a14-1218-469d-93aa-b4f9babdbb6e {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:53.500580 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-9f850244-3b32-4e8b-b471-4db5e8373519 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 27, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:27:53.501225 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-9f850244-3b32-4e8b-b471-4db5e8373519 service neutron] Checking segment: {'id': 'e3c687b5-afac-4ac8-9b38-06599c2a8b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '4d446a14-1218-469d-93aa-b4f9babdbb6e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:27:53.501641 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-9f850244-3b32-4e8b-b471-4db5e8373519 service neutron] Bound using segment: {'id': 'e3c687b5-afac-4ac8-9b38-06599c2a8b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '4d446a14-1218-469d-93aa-b4f9babdbb6e'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:27:53.502129 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-9f850244-3b32-4e8b-b471-4db5e8373519 service neutron] Bound port: 8d3e0eef-050e-4fd6-87a2-f7e332149769, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e3c687b5-afac-4ac8-9b38-06599c2a8b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '4d446a14-1218-469d-93aa-b4f9babdbb6e'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:27:53.502500 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-9f850244-3b32-4e8b-b471-4db5e8373519 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:53.608428 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-9f850244-3b32-4e8b-b471-4db5e8373519 service neutron] For port 8d3e0eef-050e-4fd6-87a2-f7e332149769, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:27:53.612923 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-9f850244-3b32-4e8b-b471-4db5e8373519 service neutron] For port 8d3e0eef-050e-4fd6-87a2-f7e332149769, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=8d3e0eef-050e-4fd6-87a2-f7e332149769,segment=NetworkSegment(e3c687b5-afac-4ac8-9b38-06599c2a8b7e),segment_id=e3c687b5-afac-4ac8-9b38-06599c2a8b7e)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:27:53.621762 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-9f850244-3b32-4e8b-b471-4db5e8373519 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:53.674115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-9f850244-3b32-4e8b-b471-4db5e8373519 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:53.675003 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-9f850244-3b32-4e8b-b471-4db5e8373519 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:53.676617 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-9f850244-3b32-4e8b-b471-4db5e8373519 service neutron] 10.222.0.31 "PUT /v2.0/ports/8d3e0eef-050e-4fd6-87a2-f7e332149769 HTTP/1.1" status: 200 len: 1092 time: 1.1108172 Dec 09 21:27:53.677256 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bac40331-6475-4539-8840-531fdb9e5c14', 'tag': '8d3e0eef-050e-4fd6-87a2-f7e332149769'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:27:53.680296 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-321822a0-882c-48f2-9088-9be7aade9fba" -d '{"events": [{"name": "network-changed", "server_uuid": "bac40331-6475-4539-8840-531fdb9e5c14", "tag": "8d3e0eef-050e-4fd6-87a2-f7e332149769"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:27:53.853059 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f850244-3b32-4e8b-b471-4db5e8373519 service neutron] Pushing event updated for resources: {'Port': ['ID=8d3e0eef-050e-4fd6-87a2-f7e332149769,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:53.899205 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-df47a6d5-c594-4377-bf47-00944e9e163b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:53.901031 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-df47a6d5-c594-4377-bf47-00944e9e163b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=18e7af94d60344a18dedc56eda040c4b&device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 1095 time: 0.1536069 Dec 09 21:27:53.913787 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37d40f60-56ff-405c-af00-64b40ae65254 req-4135bb7a-c097-4684-8ed5-df538b1a56f1 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:53.915365 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-37d40f60-56ff-405c-af00-64b40ae65254 req-4135bb7a-c097-4684-8ed5-df538b1a56f1 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.31 "GET /v2.0/networks?id=e7d3d836-ebe9-4e03-af4b-235dd5e5cbea HTTP/1.1" status: 200 len: 811 time: 0.2283430 Dec 09 21:27:53.963073 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-37d40f60-56ff-405c-af00-64b40ae65254 req-186df1b7-09be-4fe8-a708-e1fa51c13085 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Request body: {'port': {'device_id': '29288a2c-1307-4936-8a5e-57387556eb95', 'network_id': 'e7d3d836-ebe9-4e03-af4b-235dd5e5cbea', 'admin_state_up': True, 'tenant_id': '9ca15fab17f34cc58f1ad1fcedc1bf31'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:53.969106 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-cab03b25-1bc7-4826-842f-4ea84e4b10fa service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=8d3e0eef-050e-4fd6-87a2-f7e332149769 HTTP/1.1" status: 200 len: 217 time: 0.0526209 Dec 09 21:27:54.040794 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e3cf442-b8c1-40e3-aed7-be18b5f75f81 req-0abe6dcf-7550-4746-9465-537be1751dfd tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.0730667 Dec 09 21:27:54.092245 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-9f25ee66-6bc1-4cf8-910a-bef8c0ba1195 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:54.094811 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-9f25ee66-6bc1-4cf8-910a-bef8c0ba1195 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=75afc53b-d3f3-461c-aba4-c2ce93780246 HTTP/1.1" status: 200 len: 855 time: 0.1141076 Dec 09 21:27:54.117208 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-03881810-1263-4592-964d-9d2f1e513063 req-96328dfd-5948-41ce-81f7-6f79c74e7419 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7416074 Dec 09 21:27:54.158444 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-171058d8-815e-4dec-b96f-4ba34c6e31f1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=4d446a14-1218-469d-93aa-b4f9babdbb6e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0457456 Dec 09 21:27:54.171646 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2807e09c-8c78-4c56-bb70-230a7c9c28d9 req-48e0611e-75f1-4b89-972d-548b6b984bea tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:54.173567 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2807e09c-8c78-4c56-bb70-230a7c9c28d9 req-48e0611e-75f1-4b89-972d-548b6b984bea tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.10 "GET /v2.0/ports?device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 1023 time: 0.1665492 Dec 09 21:27:54.178870 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddcf81fb-143f-4232-80c5-98428ab02832 req-7272cf1a-13cb-4d33-b849-0491b30fc58c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:54.182017 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ddcf81fb-143f-4232-80c5-98428ab02832 req-7272cf1a-13cb-4d33-b849-0491b30fc58c service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=53da382a-16f4-44e1-bfd3-8ba00a807708 HTTP/1.1" status: 200 len: 1102 time: 0.2124970 Dec 09 21:27:54.216961 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-37d40f60-56ff-405c-af00-64b40ae65254 req-186df1b7-09be-4fe8-a708-e1fa51c13085 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Made reservation on behalf of 9ca15fab17f34cc58f1ad1fcedc1bf31 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:27:54.221029 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-37d40f60-56ff-405c-af00-64b40ae65254 req-186df1b7-09be-4fe8-a708-e1fa51c13085 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:54.336208 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-0ccc3d15-2c1e-44cb-8ac5-85f6a881bd57 service neutron] 10.222.0.31 "GET /v2.0/networks/4d446a14-1218-469d-93aa-b4f9babdbb6e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1697383 Dec 09 21:27:54.393255 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-30e90bc4-5537-4045-9267-e0bb90d088e8 req-0195da01-8dc7-43ec-9a3c-3dffaa712831 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 210 time: 0.0609581 Dec 09 21:27:54.480544 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:27:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d437a6a9-dac5-4938-ade0-e5589f79f196 x-openstack-request-id: req-d437a6a9-dac5-4938-ade0-e5589f79f196 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:27:54.480842 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bac40331-6475-4539-8840-531fdb9e5c14", "tag": "8d3e0eef-050e-4fd6-87a2-f7e332149769", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:27:54.481107 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-d437a6a9-dac5-4938-ade0-e5589f79f196 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:27:54.481530 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bac40331-6475-4539-8840-531fdb9e5c14', 'tag': '8d3e0eef-050e-4fd6-87a2-f7e332149769', 'status': 'completed', 'code': 200} Dec 09 21:27:54.494965 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ddcf81fb-143f-4232-80c5-98428ab02832 req-7e2ef321-4acc-47df-9705-8fe46bef6c90 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2896440 Dec 09 21:27:54.516062 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eee803a7-e5a5-4147-915b-f17bd8ccdb95 req-5759f77a-a537-4532-8ce1-7f0a156d1a14 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:54.516486 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-37d40f60-56ff-405c-af00-64b40ae65254 req-186df1b7-09be-4fe8-a708-e1fa51c13085 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Allocated IP 172.20.0.7 (e7d3d836-ebe9-4e03-af4b-235dd5e5cbea/a84d1123-6651-4f35-9cba-4f9c8f45aab6/5fd1ab85-a36a-49d7-924f-21a52601dc1e) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:27:54.525698 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eee803a7-e5a5-4147-915b-f17bd8ccdb95 req-5759f77a-a537-4532-8ce1-7f0a156d1a14 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 943 time: 0.3903890 Dec 09 21:27:54.591400 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a22b0ace-6eca-48df-ab69-025a29ba62cf req-cec8c4e4-ba05-42dd-b559-49ec5f35e14a service neutron] 10.222.0.31 "GET /v2.0/networks/4d446a14-1218-469d-93aa-b4f9babdbb6e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2459655 Dec 09 21:27:54.613535 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-2807e09c-8c78-4c56-bb70-230a7c9c28d9 req-d3d12226-bb6d-4519-8d39-b0591bcfa0df tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Deleting port 117119cd-9d6a-4e2a-94cc-9578db376ba6 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:27:54.613941 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2807e09c-8c78-4c56-bb70-230a7c9c28d9 req-d3d12226-bb6d-4519-8d39-b0591bcfa0df tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:54.764784 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe465436-ee0a-49fb-b347-9880cd9444c5 req-16762419-f61f-470e-96d2-efe647be47ed tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:54.773862 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe465436-ee0a-49fb-b347-9880cd9444c5 req-16762419-f61f-470e-96d2-efe647be47ed tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 946 time: 0.2225404 Dec 09 21:27:54.792382 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eee803a7-e5a5-4147-915b-f17bd8ccdb95 req-b26eee32-7aa6-478f-ac1a-1cb0a648394b tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2651896 Dec 09 21:27:54.804033 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-37d40f60-56ff-405c-af00-64b40ae65254 req-186df1b7-09be-4fe8-a708-e1fa51c13085 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:54.823396 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-321822a0-882c-48f2-9088-9be7aade9fba req-d882c6eb-5c23-4c88-94cc-88fb4067b0db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:54.829154 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-321822a0-882c-48f2-9088-9be7aade9fba req-d882c6eb-5c23-4c88-94cc-88fb4067b0db service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=18e7af94d60344a18dedc56eda040c4b&device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 1095 time: 0.0939608 Dec 09 21:27:54.914133 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-2807e09c-8c78-4c56-bb70-230a7c9c28d9 req-d3d12226-bb6d-4519-8d39-b0591bcfa0df tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] For port 117119cd-9d6a-4e2a-94cc-9578db376ba6, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=117119cd-9d6a-4e2a-94cc-9578db376ba6,segment=NetworkSegment(c472f4a8-1a94-4bb1-8978-a56e5ee37bb8),segment_id=c472f4a8-1a94-4bb1-8978-a56e5ee37bb8)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:54.914735 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2807e09c-8c78-4c56-bb70-230a7c9c28d9 req-d3d12226-bb6d-4519-8d39-b0591bcfa0df tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:54.939399 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-37d40f60-56ff-405c-af00-64b40ae65254 req-186df1b7-09be-4fe8-a708-e1fa51c13085 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:54.958527 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['4479e7ab-f0ee-45ff-a040-76f4dd53237f'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:27:54.959353 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-2807e09c-8c78-4c56-bb70-230a7c9c28d9 req-d3d12226-bb6d-4519-8d39-b0591bcfa0df tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Calling delete_port for 117119cd-9d6a-4e2a-94cc-9578db376ba6 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:27:54.965492 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe465436-ee0a-49fb-b347-9880cd9444c5 req-90cb9f8a-d28d-47a8-9c99-31cce53e2d54 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1907485 Dec 09 21:27:55.009262 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-37d40f60-56ff-405c-af00-64b40ae65254 req-186df1b7-09be-4fe8-a708-e1fa51c13085 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Network e7d3d836-ebe9-4e03-af4b-235dd5e5cbea is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:27:55.018921 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-37d40f60-56ff-405c-af00-64b40ae65254 req-186df1b7-09be-4fe8-a708-e1fa51c13085 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:27:55.021872 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-321822a0-882c-48f2-9088-9be7aade9fba req-77890071-be84-4d41-b1e2-b6b2c25651ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:55.023653 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-321822a0-882c-48f2-9088-9be7aade9fba req-77890071-be84-4d41-b1e2-b6b2c25651ca service neutron] 10.222.0.31 "GET /v2.0/networks?id=4d446a14-1218-469d-93aa-b4f9babdbb6e HTTP/1.1" status: 200 len: 916 time: 0.1784732 Dec 09 21:27:55.024809 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-37d40f60-56ff-405c-af00-64b40ae65254 req-186df1b7-09be-4fe8-a708-e1fa51c13085 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:27:55.027991 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-186df1b7-09be-4fe8-a708-e1fa51c13085 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Pushing event updated for resources: {'Port': ['ID=5fd1ab85-a36a-49d7-924f-21a52601dc1e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:55.056912 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff4ad84d-fd70-46a6-9759-527cb2370dde req-17c28c4e-7b89-4d8d-8eae-a28cbeb52578 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:55.058380 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ff4ad84d-fd70-46a6-9759-527cb2370dde req-17c28c4e-7b89-4d8d-8eae-a28cbeb52578 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=21566c6e-f8d2-4122-ac9c-f052ec7a451c HTTP/1.1" status: 200 len: 1023 time: 0.1599102 Dec 09 21:27:55.102583 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-321822a0-882c-48f2-9088-9be7aade9fba req-2a0bc218-339b-4da1-b009-32a86ab43c19 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=8d3e0eef-050e-4fd6-87a2-f7e332149769 HTTP/1.1" status: 200 len: 217 time: 0.0509870 Dec 09 21:27:55.154005 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37d40f60-56ff-405c-af00-64b40ae65254 req-186df1b7-09be-4fe8-a708-e1fa51c13085 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:55.154815 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-37d40f60-56ff-405c-af00-64b40ae65254 req-186df1b7-09be-4fe8-a708-e1fa51c13085 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:55.186757 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-37d40f60-56ff-405c-af00-64b40ae65254 req-186df1b7-09be-4fe8-a708-e1fa51c13085 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2584841 Dec 09 21:27:55.188183 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-321822a0-882c-48f2-9088-9be7aade9fba req-e8bd26bd-50e4-4f3f-b04b-cdcdc7d86853 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:55.189530 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-321822a0-882c-48f2-9088-9be7aade9fba req-e8bd26bd-50e4-4f3f-b04b-cdcdc7d86853 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=75afc53b-d3f3-461c-aba4-c2ce93780246 HTTP/1.1" status: 200 len: 855 time: 0.0781112 Dec 09 21:27:55.190591 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ff4ad84d-fd70-46a6-9759-527cb2370dde req-520ddb9e-8f63-4409-8dfb-de13c52bf7cf tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=fcc03377-adb3-4132-941b-ffa4bc0df861&id=cdc6e27b-dfad-461a-82c4-cf68a29a9802&id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 517 time: 0.1158915 Dec 09 21:27:55.235004 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-37d40f60-56ff-405c-af00-64b40ae65254 req-e7c19d73-9b15-4fe2-889a-11270a04fa12 service neutron] Request body: {'port': {'device_id': '29288a2c-1307-4936-8a5e-57387556eb95', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:55.253283 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-321822a0-882c-48f2-9088-9be7aade9fba req-4b0f67cc-8d7f-4cb3-a259-108fb2718499 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=4d446a14-1218-469d-93aa-b4f9babdbb6e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0478063 Dec 09 21:27:55.270309 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cdd09bf5-e2c4-4512-9905-51a5a27142a1 req-541517e8-45f8-401f-b36b-8541849900e0 tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.0784149 Dec 09 21:27:55.340742 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33b07b5f-9ef0-4fc6-b307-d89e1b77a1ac req-cf58cf33-8b30-4925-a8ae-8d06e2adb914 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:55.342700 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-33b07b5f-9ef0-4fc6-b307-d89e1b77a1ac req-cf58cf33-8b30-4925-a8ae-8d06e2adb914 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=53da382a-16f4-44e1-bfd3-8ba00a807708 HTTP/1.1" status: 200 len: 950 time: 0.0639901 Dec 09 21:27:55.343365 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2807e09c-8c78-4c56-bb70-230a7c9c28d9 req-d3d12226-bb6d-4519-8d39-b0591bcfa0df tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:55.355376 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:27:55.379209 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-37d40f60-56ff-405c-af00-64b40ae65254 req-e7c19d73-9b15-4fe2-889a-11270a04fa12 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:55.379634 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3d12226-bb6d-4519-8d39-b0591bcfa0df tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event deleted for resources: {'Port': ['ID=117119cd-9d6a-4e2a-94cc-9578db376ba6,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:55.432781 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['117119cd-9d6a-4e2a-94cc-9578db376ba6'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:27:55.459880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-2807e09c-8c78-4c56-bb70-230a7c9c28d9 req-d3d12226-bb6d-4519-8d39-b0591bcfa0df tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] No DVR routers for this DVR port 117119cd-9d6a-4e2a-94cc-9578db376ba6 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:27:55.462833 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-321822a0-882c-48f2-9088-9be7aade9fba req-849f560c-ccfb-414f-9ca2-2522fd50ca90 service neutron] 10.222.0.31 "GET /v2.0/networks/4d446a14-1218-469d-93aa-b4f9babdbb6e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1917927 Dec 09 21:27:55.464985 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2807e09c-8c78-4c56-bb70-230a7c9c28d9 req-d3d12226-bb6d-4519-8d39-b0591bcfa0df tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:55.481712 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2807e09c-8c78-4c56-bb70-230a7c9c28d9 req-d3d12226-bb6d-4519-8d39-b0591bcfa0df tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.10 "DELETE /v2.0/ports/117119cd-9d6a-4e2a-94cc-9578db376ba6 HTTP/1.1" status: 204 len: 173 time: 1.2914832 Dec 09 21:27:55.482347 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '21566c6e-f8d2-4122-ac9c-f052ec7a451c', 'name': 'network-vif-deleted', 'tag': '117119cd-9d6a-4e2a-94cc-9578db376ba6'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:27:55.485211 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f7b20dcf-1b6b-4263-89c1-655557486b34" -d '{"events": [{"server_uuid": "21566c6e-f8d2-4122-ac9c-f052ec7a451c", "name": "network-vif-deleted", "tag": "117119cd-9d6a-4e2a-94cc-9578db376ba6"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:27:55.506700 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-33b07b5f-9ef0-4fc6-b307-d89e1b77a1ac req-9c2b9ad3-b93c-4885-b147-c8651c4fb278 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1352530 Dec 09 21:27:55.594874 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d222a61e-5b79-498e-babc-fc22992710d0 req-2120071b-faf6-416c-b990-cd7099e4d8b3 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:55.608220 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d222a61e-5b79-498e-babc-fc22992710d0 req-2120071b-faf6-416c-b990-cd7099e4d8b3 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 931 time: 0.0938275 Dec 09 21:27:55.648097 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:27:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2ba00d7f-98fb-4f4b-a985-a05cdfc6af15 x-openstack-request-id: req-2ba00d7f-98fb-4f4b-a985-a05cdfc6af15 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:27:55.648535 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "21566c6e-f8d2-4122-ac9c-f052ec7a451c", "name": "network-vif-deleted", "tag": "117119cd-9d6a-4e2a-94cc-9578db376ba6", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:27:55.648798 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-2ba00d7f-98fb-4f4b-a985-a05cdfc6af15 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:27:55.649205 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '21566c6e-f8d2-4122-ac9c-f052ec7a451c', 'name': 'network-vif-deleted', 'tag': '117119cd-9d6a-4e2a-94cc-9578db376ba6', 'status': 'completed', 'code': 200} Dec 09 21:27:55.704602 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d222a61e-5b79-498e-babc-fc22992710d0 req-87ccd606-7652-443f-a33a-0d50ee3bb3b9 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0955167 Dec 09 21:27:55.874328 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-321822a0-882c-48f2-9088-9be7aade9fba req-2983188d-647f-481f-9504-8c24669b6298 service neutron] 10.222.0.31 "GET /v2.0/networks/4d446a14-1218-469d-93aa-b4f9babdbb6e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3985620 Dec 09 21:27:56.000897 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-37d40f60-56ff-405c-af00-64b40ae65254 req-e7c19d73-9b15-4fe2-889a-11270a04fa12 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5fd1ab85-a36a-49d7-924f-21a52601dc1e {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:27:56.003679 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ab7409c-0608-4682-be00-f14d9e450355 req-e0b80540-b5f8-4bf2-9e19-70c70912ac01 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:56.014909 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ab7409c-0608-4682-be00-f14d9e450355 req-e0b80540-b5f8-4bf2-9e19-70c70912ac01 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 943 time: 0.0938349 Dec 09 21:27:56.015060 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-37d40f60-56ff-405c-af00-64b40ae65254 req-e7c19d73-9b15-4fe2-889a-11270a04fa12 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:56.046086 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-37d40f60-56ff-405c-af00-64b40ae65254 req-e7c19d73-9b15-4fe2-889a-11270a04fa12 service neutron] Transition to ACTIVE for port object 5fd1ab85-a36a-49d7-924f-21a52601dc1e will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:27:56.055405 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-37d40f60-56ff-405c-af00-64b40ae65254 req-e7c19d73-9b15-4fe2-889a-11270a04fa12 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:56.171040 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7c19d73-9b15-4fe2-889a-11270a04fa12 service neutron] Pushing event updated for resources: {'Port': ['ID=5fd1ab85-a36a-49d7-924f-21a52601dc1e,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:56.193832 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ab7409c-0608-4682-be00-f14d9e450355 req-5227af33-cf0b-43ad-9153-843eedc2e283 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1780078 Dec 09 21:27:56.242030 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa8900df-8ab7-4af0-a738-5c0b36ffe34b req-b4ed2deb-190a-48d7-b792-47b8c8ae5e43 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:56.251018 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aa8900df-8ab7-4af0-a738-5c0b36ffe34b req-b4ed2deb-190a-48d7-b792-47b8c8ae5e43 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 946 time: 0.1724873 Dec 09 21:27:56.286535 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-37d40f60-56ff-405c-af00-64b40ae65254 req-e7c19d73-9b15-4fe2-889a-11270a04fa12 service neutron] Attempting to bind port 5fd1ab85-a36a-49d7-924f-21a52601dc1e on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:27:56.287108 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-37d40f60-56ff-405c-af00-64b40ae65254 req-e7c19d73-9b15-4fe2-889a-11270a04fa12 service neutron] Attempting to bind port 5fd1ab85-a36a-49d7-924f-21a52601dc1e by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '6bb6d7a7-737b-46b2-b463-0bc25081f6ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'e7d3d836-ebe9-4e03-af4b-235dd5e5cbea'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:27:56.287659 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37d40f60-56ff-405c-af00-64b40ae65254 req-e7c19d73-9b15-4fe2-889a-11270a04fa12 service neutron] Attempting to bind port 5fd1ab85-a36a-49d7-924f-21a52601dc1e on network e7d3d836-ebe9-4e03-af4b-235dd5e5cbea {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:56.294804 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37d40f60-56ff-405c-af00-64b40ae65254 req-e7c19d73-9b15-4fe2-889a-11270a04fa12 service neutron] Port 5fd1ab85-a36a-49d7-924f-21a52601dc1e on network e7d3d836-ebe9-4e03-af4b-235dd5e5cbea not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:27:56.295772 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37d40f60-56ff-405c-af00-64b40ae65254 req-e7c19d73-9b15-4fe2-889a-11270a04fa12 service neutron] Attempting to bind port 5fd1ab85-a36a-49d7-924f-21a52601dc1e on network e7d3d836-ebe9-4e03-af4b-235dd5e5cbea {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:27:56.301683 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37d40f60-56ff-405c-af00-64b40ae65254 req-e7c19d73-9b15-4fe2-889a-11270a04fa12 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 27, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:27:56.302027 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37d40f60-56ff-405c-af00-64b40ae65254 req-e7c19d73-9b15-4fe2-889a-11270a04fa12 service neutron] Checking segment: {'id': '6bb6d7a7-737b-46b2-b463-0bc25081f6ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'e7d3d836-ebe9-4e03-af4b-235dd5e5cbea'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:27:56.302417 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-37d40f60-56ff-405c-af00-64b40ae65254 req-e7c19d73-9b15-4fe2-889a-11270a04fa12 service neutron] Bound using segment: {'id': '6bb6d7a7-737b-46b2-b463-0bc25081f6ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'e7d3d836-ebe9-4e03-af4b-235dd5e5cbea'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:27:56.302901 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-37d40f60-56ff-405c-af00-64b40ae65254 req-e7c19d73-9b15-4fe2-889a-11270a04fa12 service neutron] Bound port: 5fd1ab85-a36a-49d7-924f-21a52601dc1e, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6bb6d7a7-737b-46b2-b463-0bc25081f6ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': 'e7d3d836-ebe9-4e03-af4b-235dd5e5cbea'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:27:56.303267 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-37d40f60-56ff-405c-af00-64b40ae65254 req-e7c19d73-9b15-4fe2-889a-11270a04fa12 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:56.332297 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aa8900df-8ab7-4af0-a738-5c0b36ffe34b req-3462e10e-4ca9-4b49-999e-cd576e765d78 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0798459 Dec 09 21:27:56.343029 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27af695a-192d-48b1-81b0-aacece87367c req-735db073-04d9-4454-84e7-33f9af890585 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/fcc03377-adb3-4132-941b-ffa4bc0df861 HTTP/1.1" status: 200 len: 1820 time: 0.0705495 Dec 09 21:27:56.386374 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-37d40f60-56ff-405c-af00-64b40ae65254 req-e7c19d73-9b15-4fe2-889a-11270a04fa12 service neutron] For port 5fd1ab85-a36a-49d7-924f-21a52601dc1e, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:27:56.396851 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-37d40f60-56ff-405c-af00-64b40ae65254 req-e7c19d73-9b15-4fe2-889a-11270a04fa12 service neutron] For port 5fd1ab85-a36a-49d7-924f-21a52601dc1e, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=5fd1ab85-a36a-49d7-924f-21a52601dc1e,segment=NetworkSegment(6bb6d7a7-737b-46b2-b463-0bc25081f6ef),segment_id=6bb6d7a7-737b-46b2-b463-0bc25081f6ef)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:27:56.406894 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-37d40f60-56ff-405c-af00-64b40ae65254 req-e7c19d73-9b15-4fe2-889a-11270a04fa12 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:56.413645 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-27af695a-192d-48b1-81b0-aacece87367c req-3ad737e6-3b3a-4048-af64-3cc4d853bd1d tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:56.455390 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37d40f60-56ff-405c-af00-64b40ae65254 req-e7c19d73-9b15-4fe2-889a-11270a04fa12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:56.456043 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-37d40f60-56ff-405c-af00-64b40ae65254 req-e7c19d73-9b15-4fe2-889a-11270a04fa12 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:56.457449 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-37d40f60-56ff-405c-af00-64b40ae65254 req-e7c19d73-9b15-4fe2-889a-11270a04fa12 service neutron] 10.222.0.31 "PUT /v2.0/ports/5fd1ab85-a36a-49d7-924f-21a52601dc1e HTTP/1.1" status: 200 len: 1092 time: 1.2539098 Dec 09 21:27:56.459325 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-27af695a-192d-48b1-81b0-aacece87367c req-3ad737e6-3b3a-4048-af64-3cc4d853bd1d tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:56.483326 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '29288a2c-1307-4936-8a5e-57387556eb95', 'tag': '5fd1ab85-a36a-49d7-924f-21a52601dc1e'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:27:56.485809 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c87de1c1-2a6e-4d75-bc79-e10c9a55582e" -d '{"events": [{"name": "network-changed", "server_uuid": "29288a2c-1307-4936-8a5e-57387556eb95", "tag": "5fd1ab85-a36a-49d7-924f-21a52601dc1e"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:27:56.491739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7c19d73-9b15-4fe2-889a-11270a04fa12 service neutron] Pushing event updated for resources: {'Port': ['ID=5fd1ab85-a36a-49d7-924f-21a52601dc1e,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:56.550323 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b48dc18-c2d6-45c3-ae04-6788021e7521 req-a7ce417c-c01f-4d11-a7dc-0a2c9d951827 tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.0933785 Dec 09 21:27:56.578304 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37d40f60-56ff-405c-af00-64b40ae65254 req-0439c2f9-fb91-403b-8637-6724d5f893e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:56.584194 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-37d40f60-56ff-405c-af00-64b40ae65254 req-0439c2f9-fb91-403b-8637-6724d5f893e7 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=9ca15fab17f34cc58f1ad1fcedc1bf31&device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 1095 time: 0.0746741 Dec 09 21:27:56.597301 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-27af695a-192d-48b1-81b0-aacece87367c req-3ad737e6-3b3a-4048-af64-3cc4d853bd1d tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:56.608222 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-27af695a-192d-48b1-81b0-aacece87367c req-3ad737e6-3b3a-4048-af64-3cc4d853bd1d tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:56.649519 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27af695a-192d-48b1-81b0-aacece87367c req-3ad737e6-3b3a-4048-af64-3cc4d853bd1d tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "DELETE /v2.0/security-groups/fcc03377-adb3-4132-941b-ffa4bc0df861 HTTP/1.1" status: 204 len: 173 time: 0.3054466 Dec 09 21:27:56.680118 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-37d40f60-56ff-405c-af00-64b40ae65254 req-dff16c4b-f48a-4551-9bdd-ecfe1b05f692 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=5fd1ab85-a36a-49d7-924f-21a52601dc1e HTTP/1.1" status: 200 len: 217 time: 0.0864708 Dec 09 21:27:56.681785 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ad737e6-3b3a-4048-af64-3cc4d853bd1d tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fcc03377-adb3-4132-941b-ffa4bc0df861,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:56.771308 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37d40f60-56ff-405c-af00-64b40ae65254 req-6ad25249-f1fa-4078-b43e-3cc076508a13 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:56.771308 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-37d40f60-56ff-405c-af00-64b40ae65254 req-6ad25249-f1fa-4078-b43e-3cc076508a13 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a84d1123-6651-4f35-9cba-4f9c8f45aab6 HTTP/1.1" status: 200 len: 851 time: 0.0827286 Dec 09 21:27:56.817602 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-37d40f60-56ff-405c-af00-64b40ae65254 req-e43d459a-f267-4ad2-9c69-18edf01bcef2 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e7d3d836-ebe9-4e03-af4b-235dd5e5cbea&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0396829 Dec 09 21:27:56.872570 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:27:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9a6497f2-373e-4d01-a099-889bf6f5c2c3 x-openstack-request-id: req-9a6497f2-373e-4d01-a099-889bf6f5c2c3 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:27:56.873072 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "29288a2c-1307-4936-8a5e-57387556eb95", "tag": "5fd1ab85-a36a-49d7-924f-21a52601dc1e", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:27:56.873503 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-9a6497f2-373e-4d01-a099-889bf6f5c2c3 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:27:56.874011 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '29288a2c-1307-4936-8a5e-57387556eb95', 'tag': '5fd1ab85-a36a-49d7-924f-21a52601dc1e', 'status': 'completed', 'code': 200} Dec 09 21:27:56.914528 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8615960-2b6e-44fa-af90-2eec5d2de0c6 req-ddd96df7-ac0d-40eb-b8cc-8cfa576b463e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:56.925801 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8615960-2b6e-44fa-af90-2eec5d2de0c6 req-ddd96df7-ac0d-40eb-b8cc-8cfa576b463e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=53da382a-16f4-44e1-bfd3-8ba00a807708 HTTP/1.1" status: 200 len: 950 time: 0.1462958 Dec 09 21:27:56.956746 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-37d40f60-56ff-405c-af00-64b40ae65254 req-d8515ae1-f0db-48a1-bb63-c4cebc7a1c1f service neutron] 10.222.0.31 "GET /v2.0/networks/e7d3d836-ebe9-4e03-af4b-235dd5e5cbea?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1314795 Dec 09 21:27:57.007176 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8615960-2b6e-44fa-af90-2eec5d2de0c6 req-0e0d9339-3418-4f5c-bf4d-203f5c8f0004 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0803907 Dec 09 21:27:57.051080 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-493ab59f-dcc6-4cdf-9c4e-575fbb1db557 req-aaca1dc3-6b4c-422f-8e3c-d743d774d5c4 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/cdc6e27b-dfad-461a-82c4-cf68a29a9802 HTTP/1.1" status: 200 len: 1820 time: 0.1171353 Dec 09 21:27:57.087058 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-37d40f60-56ff-405c-af00-64b40ae65254 req-2939214a-9bf4-46c5-86bd-21bd59ffdd58 service neutron] 10.222.0.31 "GET /v2.0/networks/e7d3d836-ebe9-4e03-af4b-235dd5e5cbea?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1229055 Dec 09 21:27:57.152141 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:57.158843 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:57.166778 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-493ab59f-dcc6-4cdf-9c4e-575fbb1db557 req-e1e7e509-f5a0-4108-a82c-5fde23a4811c tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:57.221408 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-493ab59f-dcc6-4cdf-9c4e-575fbb1db557 req-e1e7e509-f5a0-4108-a82c-5fde23a4811c tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:57.228948 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c87de1c1-2a6e-4d75-bc79-e10c9a55582e req-f84220f3-c552-40cd-9234-f63c66e00a00 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:57.230740 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c87de1c1-2a6e-4d75-bc79-e10c9a55582e req-f84220f3-c552-40cd-9234-f63c66e00a00 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=9ca15fab17f34cc58f1ad1fcedc1bf31&device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 1095 time: 0.0796092 Dec 09 21:27:57.301543 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-860c7214-18b8-4d1b-9d7a-f7c7a1633fb1 req-fc422149-90f9-4029-8091-1de9581bdaaa tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:57.304279 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-860c7214-18b8-4d1b-9d7a-f7c7a1633fb1 req-fc422149-90f9-4029-8091-1de9581bdaaa tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 943 time: 0.1991601 Dec 09 21:27:57.306259 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-493ab59f-dcc6-4cdf-9c4e-575fbb1db557 req-e1e7e509-f5a0-4108-a82c-5fde23a4811c tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:57.309528 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-493ab59f-dcc6-4cdf-9c4e-575fbb1db557 req-e1e7e509-f5a0-4108-a82c-5fde23a4811c tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:57.310841 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-493ab59f-dcc6-4cdf-9c4e-575fbb1db557 req-e1e7e509-f5a0-4108-a82c-5fde23a4811c tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "DELETE /v2.0/security-groups/cdc6e27b-dfad-461a-82c4-cf68a29a9802 HTTP/1.1" status: 204 len: 173 time: 0.2588770 Dec 09 21:27:57.345329 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1e7e509-f5a0-4108-a82c-5fde23a4811c tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=cdc6e27b-dfad-461a-82c4-cf68a29a9802,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:57.413440 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c87de1c1-2a6e-4d75-bc79-e10c9a55582e req-34f8ed1a-a6dc-4733-9824-7a7e05922810 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:57.415215 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c87de1c1-2a6e-4d75-bc79-e10c9a55582e req-34f8ed1a-a6dc-4733-9824-7a7e05922810 service neutron] 10.222.0.31 "GET /v2.0/networks?id=e7d3d836-ebe9-4e03-af4b-235dd5e5cbea HTTP/1.1" status: 200 len: 912 time: 0.1768255 Dec 09 21:27:57.417237 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-860c7214-18b8-4d1b-9d7a-f7c7a1633fb1 req-7103f6a4-f76c-4a4d-93b5-f72a479ab0de tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1006067 Dec 09 21:27:57.473140 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c87de1c1-2a6e-4d75-bc79-e10c9a55582e req-b22420a8-5b34-4431-b0d5-c4b98cc2fd07 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=5fd1ab85-a36a-49d7-924f-21a52601dc1e HTTP/1.1" status: 200 len: 217 time: 0.0484006 Dec 09 21:27:57.479944 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 8d3e0eef-050e-4fd6-87a2-f7e332149769 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:27:57.484468 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1237e959-6c97-410f-b556-410a7fe0947c req-95d01011-14b7-4350-a99e-f65e1073ad84 tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:57.493060 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1237e959-6c97-410f-b556-410a7fe0947c req-95d01011-14b7-4350-a99e-f65e1073ad84 tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=53da382a-16f4-44e1-bfd3-8ba00a807708 HTTP/1.1" status: 200 len: 1102 time: 0.0820689 Dec 09 21:27:57.555282 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c87de1c1-2a6e-4d75-bc79-e10c9a55582e req-53b70dd8-2c7b-40de-9ffd-bbef05d63dc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:57.557351 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c87de1c1-2a6e-4d75-bc79-e10c9a55582e req-53b70dd8-2c7b-40de-9ffd-bbef05d63dc6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a84d1123-6651-4f35-9cba-4f9c8f45aab6 HTTP/1.1" status: 200 len: 851 time: 0.0770023 Dec 09 21:27:57.571776 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1237e959-6c97-410f-b556-410a7fe0947c req-80bd704e-8931-4e0e-a3de-1727037ed5aa tempest-ServersOnMultiNodesTest-1549816806 tempest-ServersOnMultiNodesTest-1549816806-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0769119 Dec 09 21:27:57.596724 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c87de1c1-2a6e-4d75-bc79-e10c9a55582e req-3ea18f61-737d-4842-9301-fbaf59d36522 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e7d3d836-ebe9-4e03-af4b-235dd5e5cbea&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0312712 Dec 09 21:27:57.614397 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 8d3e0eef-050e-4fd6-87a2-f7e332149769, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=8d3e0eef-050e-4fd6-87a2-f7e332149769,segment=NetworkSegment(e3c687b5-afac-4ac8-9b38-06599c2a8b7e),segment_id=e3c687b5-afac-4ac8-9b38-06599c2a8b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:57.619087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b029558-c909-448a-b5fc-eae017c9a87b req-d7e52211-ed0e-4a3b-8757-aa06bba965ee tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:57.626769 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b029558-c909-448a-b5fc-eae017c9a87b req-d7e52211-ed0e-4a3b-8757-aa06bba965ee tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 943 time: 0.1222663 Dec 09 21:27:57.628530 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '8d3e0eef-050e-4fd6-87a2-f7e332149769', 'network_id': '4d446a14-1218-469d-93aa-b4f9babdbb6e', 'port_id': '8d3e0eef-050e-4fd6-87a2-f7e332149769', 'mac_address': 'fa:16:3e:9d:b8:06', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 138, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '75afc53b-d3f3-461c-aba4-c2ce93780246', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:27:57.642075 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-cd21813e-c210-46d9-9d55-f36cebdab0f8 req-b955defa-920d-4721-80f7-3b7d62c13f59 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Request body: {'security_group': {'name': 'tempest-SecurityGroupsTestJSON-securitygroup-1337178145', 'description': 'tempest-description-1511396742'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:57.680295 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cd21813e-c210-46d9-9d55-f36cebdab0f8 req-b955defa-920d-4721-80f7-3b7d62c13f59 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:57.681157 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:57.704262 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8d3e0eef-050e-4fd6-87a2-f7e332149769 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:27:57.729013 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 8d3e0eef-050e-4fd6-87a2-f7e332149769, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=8d3e0eef-050e-4fd6-87a2-f7e332149769,segment=NetworkSegment(e3c687b5-afac-4ac8-9b38-06599c2a8b7e),segment_id=e3c687b5-afac-4ac8-9b38-06599c2a8b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:57.732216 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b029558-c909-448a-b5fc-eae017c9a87b req-a1d8b998-2f85-4a61-b2e7-38abcf9b8af5 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1042237 Dec 09 21:27:57.736004 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:57.845247 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=8d3e0eef-050e-4fd6-87a2-f7e332149769,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:57.888981 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cd21813e-c210-46d9-9d55-f36cebdab0f8 req-b955defa-920d-4721-80f7-3b7d62c13f59 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:57.899704 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cd21813e-c210-46d9-9d55-f36cebdab0f8 req-b955defa-920d-4721-80f7-3b7d62c13f59 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:57.938539 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-098848e1-32c6-4003-9a0f-1e541708f407 req-fcbb5c8a-91fc-457d-9f61-a02c98461b90 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:57.941467 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-098848e1-32c6-4003-9a0f-1e541708f407 req-fcbb5c8a-91fc-457d-9f61-a02c98461b90 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 946 time: 0.0991676 Dec 09 21:27:57.954238 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cd21813e-c210-46d9-9d55-f36cebdab0f8 req-b955defa-920d-4721-80f7-3b7d62c13f59 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:57.955894 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd21813e-c210-46d9-9d55-f36cebdab0f8 req-b955defa-920d-4721-80f7-3b7d62c13f59 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1825 time: 0.3192947 Dec 09 21:27:57.974248 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b955defa-920d-4721-80f7-3b7d62c13f59 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a9a851d4-da12-414d-a0aa-9adede6d6696,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:58.018980 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-098848e1-32c6-4003-9a0f-1e541708f407 req-e0d6e03e-923b-4083-a9b7-26cc6dcf27bb tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0597003 Dec 09 21:27:58.055757 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d72881a2-dc12-4191-8bfc-4adf44893344 req-639133e1-bbd4-446f-9c1d-ff552e04367c tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.0353043 Dec 09 21:27:58.069791 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['8d3e0eef-050e-4fd6-87a2-f7e332149769'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:27:58.137433 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c87de1c1-2a6e-4d75-bc79-e10c9a55582e req-8e5a69da-dfb4-44a8-afcc-e26c8752374b service neutron] 10.222.0.31 "GET /v2.0/networks/e7d3d836-ebe9-4e03-af4b-235dd5e5cbea?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5252635 Dec 09 21:27:58.176246 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-044078bb-7bd6-427a-8158-3ce264c2668b req-496b9a42-5a07-4bdf-aa41-fa2ce11bcec7 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/a9a851d4-da12-414d-a0aa-9adede6d6696 HTTP/1.1" status: 200 len: 1820 time: 0.0745194 Dec 09 21:27:58.190500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-044078bb-7bd6-427a-8158-3ce264c2668b req-ecd019c8-eac5-4933-ad59-f6763b8281b4 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Request body: {'security_group': {'name': 'tempest-sg-hth-2110506150', 'description': 'tempest-description-hth-2054269251'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:58.243730 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-044078bb-7bd6-427a-8158-3ce264c2668b req-ecd019c8-eac5-4933-ad59-f6763b8281b4 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:58.279371 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c87de1c1-2a6e-4d75-bc79-e10c9a55582e req-59ef5b40-9053-4396-bf11-cf3207a2704c service neutron] 10.222.0.31 "GET /v2.0/networks/e7d3d836-ebe9-4e03-af4b-235dd5e5cbea?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1334419 Dec 09 21:27:58.317440 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-044078bb-7bd6-427a-8158-3ce264c2668b req-ecd019c8-eac5-4933-ad59-f6763b8281b4 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:58.327365 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-044078bb-7bd6-427a-8158-3ce264c2668b req-ecd019c8-eac5-4933-ad59-f6763b8281b4 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:58.330086 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-044078bb-7bd6-427a-8158-3ce264c2668b req-ecd019c8-eac5-4933-ad59-f6763b8281b4 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:58.331301 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-044078bb-7bd6-427a-8158-3ce264c2668b req-ecd019c8-eac5-4933-ad59-f6763b8281b4 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "PUT /v2.0/security-groups/a9a851d4-da12-414d-a0aa-9adede6d6696 HTTP/1.1" status: 200 len: 1794 time: 0.1478219 Dec 09 21:27:58.413913 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5ec9f1f-c6ec-4ed5-bd84-6fa8baaef5f2 req-a64cf2c5-926a-41e3-8c0d-907ff0d46cdf tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:58.415430 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5ec9f1f-c6ec-4ed5-bd84-6fa8baaef5f2 req-a64cf2c5-926a-41e3-8c0d-907ff0d46cdf tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=53da382a-16f4-44e1-bfd3-8ba00a807708 HTTP/1.1" status: 200 len: 950 time: 0.1019876 Dec 09 21:27:58.419354 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecd019c8-eac5-4933-ad59-f6763b8281b4 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a9a851d4-da12-414d-a0aa-9adede6d6696,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:58.445234 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dd709af3-05c7-448b-899b-6e801f7e5d65 req-63642566-7405-4ed3-9e54-d469955f67c7 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/a9a851d4-da12-414d-a0aa-9adede6d6696 HTTP/1.1" status: 200 len: 1794 time: 0.0904233 Dec 09 21:27:58.485715 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5ec9f1f-c6ec-4ed5-bd84-6fa8baaef5f2 req-2c63000a-1658-4810-b4f9-1a9d5e95cd5d tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0584447 Dec 09 21:27:58.515719 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 117119cd-9d6a-4e2a-94cc-9578db376ba6 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:27:58.544104 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 117119cd-9d6a-4e2a-94cc-9578db376ba6 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:27:58.544399 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 117119cd-9d6a-4e2a-94cc-9578db376ba6 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:27:58.600870 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9719688-c4d8-4f7f-aad6-1d382144d26a req-a67bc115-6671-4ffd-b249-d4d0a2961ffc tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:58.602595 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f9719688-c4d8-4f7f-aad6-1d382144d26a req-a67bc115-6671-4ffd-b249-d4d0a2961ffc tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 943 time: 0.0869727 Dec 09 21:27:58.605755 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-231e732c-17ed-41c8-b91a-6c93b3fe07ab req-ce5619ef-5f2a-460b-9bb9-d4f9b7837d39 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/a9a851d4-da12-414d-a0aa-9adede6d6696 HTTP/1.1" status: 200 len: 1794 time: 0.0778840 Dec 09 21:27:58.698776 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f9719688-c4d8-4f7f-aad6-1d382144d26a req-138a54f8-c3b8-4308-a4a9-cf4bde89f208 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0839446 Dec 09 21:27:58.721233 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-231e732c-17ed-41c8-b91a-6c93b3fe07ab req-c789184e-988f-43a7-8ba7-80d8dc08a05e tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:58.746139 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-231e732c-17ed-41c8-b91a-6c93b3fe07ab req-c789184e-988f-43a7-8ba7-80d8dc08a05e tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:58.800723 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-231e732c-17ed-41c8-b91a-6c93b3fe07ab req-c789184e-988f-43a7-8ba7-80d8dc08a05e tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:58.803648 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-231e732c-17ed-41c8-b91a-6c93b3fe07ab req-c789184e-988f-43a7-8ba7-80d8dc08a05e tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:58.805029 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-231e732c-17ed-41c8-b91a-6c93b3fe07ab req-c789184e-988f-43a7-8ba7-80d8dc08a05e tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "DELETE /v2.0/security-groups/a9a851d4-da12-414d-a0aa-9adede6d6696 HTTP/1.1" status: 204 len: 173 time: 0.1877956 Dec 09 21:27:58.851568 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c789184e-988f-43a7-8ba7-80d8dc08a05e tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a9a851d4-da12-414d-a0aa-9adede6d6696,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:27:58.880810 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1745770-2ef0-437d-a9c4-c7e3e48ceba2 req-286cef18-bb5e-4bbc-b697-08d87e94e1a2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:58.882390 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d1745770-2ef0-437d-a9c4-c7e3e48ceba2 req-286cef18-bb5e-4bbc-b697-08d87e94e1a2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 944 time: 0.0696526 Dec 09 21:27:58.964069 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-0b05166f-73d5-4c73-95a5-cca052c90132 req-ad0666c3-fa32-4687-a343-bc1eb1020f94 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] show failed (client error): The resource could not be found. Dec 09 21:27:58.968235 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b05166f-73d5-4c73-95a5-cca052c90132 req-ad0666c3-fa32-4687-a343-bc1eb1020f94 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/cdc6e27b-dfad-461a-82c4-cf68a29a9802 HTTP/1.1" status: 404 len: 352 time: 0.0365365 Dec 09 21:27:58.974931 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d1745770-2ef0-437d-a9c4-c7e3e48ceba2 req-a1878cd4-fc2b-4fda-aa27-be4ac280b2ca tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0821915 Dec 09 21:27:59.003929 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-ea65cab9-5fcd-4760-bb34-79d9757ded1f req-c9a2a0d2-ec73-42fd-a948-ad1420c6035d tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] show failed (client error): The resource could not be found. Dec 09 21:27:59.004981 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea65cab9-5fcd-4760-bb34-79d9757ded1f req-c9a2a0d2-ec73-42fd-a948-ad1420c6035d tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/fcc03377-adb3-4132-941b-ffa4bc0df861 HTTP/1.1" status: 404 len: 352 time: 0.0181499 Dec 09 21:27:59.041797 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-623777a2-3eba-471e-932b-0e1b6c6ab668 req-a6683fc2-1e11-4bae-8a42-84343d9040cd tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] show failed (client error): The resource could not be found. Dec 09 21:27:59.044866 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-623777a2-3eba-471e-932b-0e1b6c6ab668 req-a6683fc2-1e11-4bae-8a42-84343d9040cd tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/1cc4844b-f1c9-4751-b1a6-ddc43fd1f320 HTTP/1.1" status: 404 len: 352 time: 0.0183241 Dec 09 21:27:59.095320 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-e3df88b1-5582-412e-91d0-5cf0fdf3a48e req-0b1b17ca-bbbe-4ce8-a3c3-a3e7068f652c tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] show failed (client error): The resource could not be found. Dec 09 21:27:59.104290 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3df88b1-5582-412e-91d0-5cf0fdf3a48e req-0b1b17ca-bbbe-4ce8-a3c3-a3e7068f652c tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/f13bda71-a22a-40d5-8623-6019230ec2f2 HTTP/1.1" status: 404 len: 352 time: 0.0290728 Dec 09 21:27:59.198416 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b482c67f-401c-48fd-ac09-3c3b750e28fe req-4c836210-b9eb-46fb-9fc0-4d6cb23fd75e tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.0356822 Dec 09 21:27:59.207240 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14a86a07-c5e8-4912-83a9-344bdf62d442 req-018e67b6-a854-4c09-8444-2137debb1645 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:59.208947 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-14a86a07-c5e8-4912-83a9-344bdf62d442 req-018e67b6-a854-4c09-8444-2137debb1645 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 946 time: 0.0981464 Dec 09 21:27:59.279648 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-56d074aa-d5be-4d81-a17f-dce3463f019d req-f49285ec-edc2-434b-b72b-4fe3fa6c096a tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] show failed (client error): The resource could not be found. Dec 09 21:27:59.284074 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56d074aa-d5be-4d81-a17f-dce3463f019d req-f49285ec-edc2-434b-b72b-4fe3fa6c096a tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/77bbf48d-463a-47f1-ac08-a895b61ca313 HTTP/1.1" status: 404 len: 352 time: 0.0481076 Dec 09 21:27:59.293193 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-14a86a07-c5e8-4912-83a9-344bdf62d442 req-028a0066-1e6f-4259-bc06-dd8428cd305f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0775466 Dec 09 21:27:59.324803 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-10dcb933-f73e-4c75-809c-a16d80ef1662 req-16033517-2bbc-44d0-bda1-ab1060d5b220 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] show failed (client error): The resource could not be found. Dec 09 21:27:59.325841 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-10dcb933-f73e-4c75-809c-a16d80ef1662 req-16033517-2bbc-44d0-bda1-ab1060d5b220 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/2532bd8f-3548-430a-8273-6cdaee201c51 HTTP/1.1" status: 404 len: 352 time: 0.0213356 Dec 09 21:27:59.492591 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 5fd1ab85-a36a-49d7-924f-21a52601dc1e details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:27:59.496903 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 8d3e0eef-050e-4fd6-87a2-f7e332149769 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:27:59.624367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 8d3e0eef-050e-4fd6-87a2-f7e332149769 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:27:59.644887 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 8d3e0eef-050e-4fd6-87a2-f7e332149769 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:27:59.645530 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:59.676713 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eebce446-5c0b-4c44-9181-95eb0aa5b294 req-22ab6126-6dd7-473b-b1ef-f511e8eb253e tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:59.685813 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eebce446-5c0b-4c44-9181-95eb0aa5b294 req-22ab6126-6dd7-473b-b1ef-f511e8eb253e tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=dffe3c86-0677-4490-a36a-8bed7d798809 HTTP/1.1" status: 200 len: 1024 time: 0.1286469 Dec 09 21:27:59.719615 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c742a8f7-cf2b-4a05-89b7-a4c8776f58d0 req-537f3b43-ecc2-4b51-9584-0b45b5ffc2a9 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:59.731620 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c742a8f7-cf2b-4a05-89b7-a4c8776f58d0 req-537f3b43-ecc2-4b51-9584-0b45b5ffc2a9 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=53da382a-16f4-44e1-bfd3-8ba00a807708 HTTP/1.1" status: 200 len: 950 time: 0.1112075 Dec 09 21:27:59.760942 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 5fd1ab85-a36a-49d7-924f-21a52601dc1e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=5fd1ab85-a36a-49d7-924f-21a52601dc1e,segment=NetworkSegment(6bb6d7a7-737b-46b2-b463-0bc25081f6ef),segment_id=6bb6d7a7-737b-46b2-b463-0bc25081f6ef)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:59.776181 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '5fd1ab85-a36a-49d7-924f-21a52601dc1e', 'network_id': 'e7d3d836-ebe9-4e03-af4b-235dd5e5cbea', 'port_id': '5fd1ab85-a36a-49d7-924f-21a52601dc1e', 'mac_address': 'fa:16:3e:d9:5e:33', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 102, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a84d1123-6651-4f35-9cba-4f9c8f45aab6', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:27:59.779716 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41130) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:27:59.789786 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81a0d779-d9b7-40ba-9758-e24eaf2b06c6 req-f0beb5e2-c5be-4f12-9ed0-bb83a6b71012 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:27:59.792096 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-81a0d779-d9b7-40ba-9758-e24eaf2b06c6 req-f0beb5e2-c5be-4f12-9ed0-bb83a6b71012 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "GET /v2.0/ports?device_id=53da382a-16f4-44e1-bfd3-8ba00a807708 HTTP/1.1" status: 200 len: 950 time: 0.0698147 Dec 09 21:27:59.793415 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-4f8cd36d-c36b-4564-a977-53cb4cc0ad61 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Request body: {'network': {'name': 'tempest-device-tagging-net1-528602105'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:27:59.851775 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:59.853848 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:59.874960 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5fd1ab85-a36a-49d7-924f-21a52601dc1e {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:27:59.876557 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c742a8f7-cf2b-4a05-89b7-a4c8776f58d0 req-282b16dd-3d09-4ef8-8a3a-2deecdff5223 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1432152 Dec 09 21:27:59.898553 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bac40331-6475-4539-8840-531fdb9e5c14', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8d3e0eef-050e-4fd6-87a2-f7e332149769'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:27:59.900932 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c8f8a915-4515-4e18-84f4-43311f80f7ba" -d '{"events": [{"server_uuid": "bac40331-6475-4539-8840-531fdb9e5c14", "name": "network-vif-plugged", "status": "completed", "tag": "8d3e0eef-050e-4fd6-87a2-f7e332149769"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:27:59.906851 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eebce446-5c0b-4c44-9181-95eb0aa5b294 req-9ce5c743-628b-4796-a336-0fae1894fc1f tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=dc3fa276-da75-42c1-a8e4-8471106148d2&id=d0cefb8e-5181-40ca-9bcf-8d762cff4764&id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 515 time: 0.2205622 Dec 09 21:27:59.907889 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4f8cd36d-c36b-4564-a977-53cb4cc0ad61 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Made reservation on behalf of 03e962eb7f5e4325a7c08c8b1e2a4cea for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:27:59.914244 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4f8cd36d-c36b-4564-a977-53cb4cc0ad61 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:59.922824 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 8d3e0eef-050e-4fd6-87a2-f7e332149769, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=8d3e0eef-050e-4fd6-87a2-f7e332149769,segment=NetworkSegment(e3c687b5-afac-4ac8-9b38-06599c2a8b7e),segment_id=e3c687b5-afac-4ac8-9b38-06599c2a8b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:59.924951 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 5fd1ab85-a36a-49d7-924f-21a52601dc1e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=5fd1ab85-a36a-49d7-924f-21a52601dc1e,segment=NetworkSegment(6bb6d7a7-737b-46b2-b463-0bc25081f6ef),segment_id=6bb6d7a7-737b-46b2-b463-0bc25081f6ef)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:27:59.941790 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:59.950498 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:59.960860 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4f8cd36d-c36b-4564-a977-53cb4cc0ad61 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] vlan segment allocate from pool success with {'vlan_id': 112, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:27:59.978803 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-81a0d779-d9b7-40ba-9758-e24eaf2b06c6 req-3a03d30a-4abd-4aee-8ebc-2b91772d533e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Deleting port 937c022a-ae46-441a-8b52-fa1da6f3b496 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:27:59.979311 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-81a0d779-d9b7-40ba-9758-e24eaf2b06c6 req-3a03d30a-4abd-4aee-8ebc-2b91772d533e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:59.984955 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4f8cd36d-c36b-4564-a977-53cb4cc0ad61 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:27:59.985571 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-4f8cd36d-c36b-4564-a977-53cb4cc0ad61 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Added segment 669c24e6-ecea-4894-adc4-51a9b461417f of type vlan for network a859e4ba-764a-41c0-982d-5bf79a2797a1 Dec 09 21:28:00.078054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=8d3e0eef-050e-4fd6-87a2-f7e332149769,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:00.097245 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4f8cd36d-c36b-4564-a977-53cb4cc0ad61 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:00.121870 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:27:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cc50b81b-e8bb-4db5-b6d1-e49cffc6183b x-openstack-request-id: req-cc50b81b-e8bb-4db5-b6d1-e49cffc6183b {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:00.122086 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bac40331-6475-4539-8840-531fdb9e5c14", "name": "network-vif-plugged", "status": "completed", "tag": "8d3e0eef-050e-4fd6-87a2-f7e332149769", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:00.122252 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-cc50b81b-e8bb-4db5-b6d1-e49cffc6183b {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:00.125307 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bac40331-6475-4539-8840-531fdb9e5c14', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8d3e0eef-050e-4fd6-87a2-f7e332149769', 'code': 200} Dec 09 21:28:00.141332 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4704ee5a-6181-4e09-acc1-ba65c7428e80 req-9faa7abf-b34f-4e7e-b50a-0dd27b5f430d tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:00.149422 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4704ee5a-6181-4e09-acc1-ba65c7428e80 req-9faa7abf-b34f-4e7e-b50a-0dd27b5f430d tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 944 time: 0.0923681 Dec 09 21:28:00.170187 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4f8cd36d-c36b-4564-a977-53cb4cc0ad61 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:00.182488 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4f8cd36d-c36b-4564-a977-53cb4cc0ad61 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:00.183143 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4f8cd36d-c36b-4564-a977-53cb4cc0ad61 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:00.186245 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-81a0d779-d9b7-40ba-9758-e24eaf2b06c6 req-3a03d30a-4abd-4aee-8ebc-2b91772d533e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] For port 937c022a-ae46-441a-8b52-fa1da6f3b496, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=937c022a-ae46-441a-8b52-fa1da6f3b496,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:00.186605 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-81a0d779-d9b7-40ba-9758-e24eaf2b06c6 req-3a03d30a-4abd-4aee-8ebc-2b91772d533e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:00.197880 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=5fd1ab85-a36a-49d7-924f-21a52601dc1e,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:00.238280 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-81a0d779-d9b7-40ba-9758-e24eaf2b06c6 req-3a03d30a-4abd-4aee-8ebc-2b91772d533e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Calling delete_port for 937c022a-ae46-441a-8b52-fa1da6f3b496 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:28:00.258266 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['5fd1ab85-a36a-49d7-924f-21a52601dc1e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:28:00.259689 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4f8cd36d-c36b-4564-a977-53cb4cc0ad61 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 773 time: 0.4761200 Dec 09 21:28:00.292117 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-624ec120-378c-4816-b385-b77040937962 req-091a419c-7616-496e-833e-cacaabf46ba6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:00.293626 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-624ec120-378c-4816-b385-b77040937962 req-091a419c-7616-496e-833e-cacaabf46ba6 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 1097 time: 0.1043937 Dec 09 21:28:00.295673 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41142) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:00.302644 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-1b808389-ece6-4ae5-adf5-eef80091ad76 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Request body: {'network': {'name': 'tempest-device-tagging-net2-1361037807'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:00.321834 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f8cd36d-c36b-4564-a977-53cb4cc0ad61 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event updated for resources: {'Network': ['ID=a859e4ba-764a-41c0-982d-5bf79a2797a1,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:00.341212 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4704ee5a-6181-4e09-acc1-ba65c7428e80 req-49efd2aa-5c14-4fca-bc19-3d4095ea7baa tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1883740 Dec 09 21:28:00.346594 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network a859e4ba-764a-41c0-982d-5bf79a2797a1 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:28:00.368534 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd977c61-d60f-4d5a-abef-e81763c9aea1 req-ab0e6905-9380-4633-a475-67016b984509 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:00.370084 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fd977c61-d60f-4d5a-abef-e81763c9aea1 req-ab0e6905-9380-4633-a475-67016b984509 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 945 time: 0.1431656 Dec 09 21:28:00.403776 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-624ec120-378c-4816-b385-b77040937962 req-9616b54a-8753-4e11-995a-d7b00f000a82 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0964911 Dec 09 21:28:00.406720 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1b808389-ece6-4ae5-adf5-eef80091ad76 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Made reservation on behalf of 03e962eb7f5e4325a7c08c8b1e2a4cea for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:00.410430 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b808389-ece6-4ae5-adf5-eef80091ad76 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:00.451257 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1b808389-ece6-4ae5-adf5-eef80091ad76 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] vlan segment allocate from pool success with {'vlan_id': 104, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:28:00.481571 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d9032fa0-c9e7-494a-b624-ab92e1b5fde3 req-a814b326-1708-430e-9126-7aa00ed00561 tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.0405538 Dec 09 21:28:00.484223 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b808389-ece6-4ae5-adf5-eef80091ad76 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:00.484851 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-1b808389-ece6-4ae5-adf5-eef80091ad76 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Added segment 8ca86951-e612-4db0-90f4-834b52fd24e0 of type vlan for network a133a939-2827-4fe6-81f5-14715631c0ec Dec 09 21:28:00.489623 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fd977c61-d60f-4d5a-abef-e81763c9aea1 req-f9188ddb-3ac0-4242-b5f1-44ae2884f62a tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1110666 Dec 09 21:28:00.548461 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b808389-ece6-4ae5-adf5-eef80091ad76 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:00.568607 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-81a0d779-d9b7-40ba-9758-e24eaf2b06c6 req-3a03d30a-4abd-4aee-8ebc-2b91772d533e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:00.586769 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['fd466da6-f506-43e6-9800-156622bd2781', 'c3c31744-0580-4d09-863d-697769f7c0ee', '0ef815c5-fc54-4d19-b139-1eaa75cffde2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:28:00.608547 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a03d30a-4abd-4aee-8ebc-2b91772d533e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Pushing event deleted for resources: {'Port': ['ID=937c022a-ae46-441a-8b52-fa1da6f3b496,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:00.620695 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b808389-ece6-4ae5-adf5-eef80091ad76 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:00.627679 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1b808389-ece6-4ae5-adf5-eef80091ad76 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:00.628852 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b808389-ece6-4ae5-adf5-eef80091ad76 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:00.632336 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cdd2ab0-1672-4794-a1e0-a419c5903481 req-b72cde07-3677-4a8c-9f0e-28cc618fac9a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:00.645933 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8cdd2ab0-1672-4794-a1e0-a419c5903481 req-b72cde07-3677-4a8c-9f0e-28cc618fac9a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 946 time: 0.0790253 Dec 09 21:28:00.700306 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-81a0d779-d9b7-40ba-9758-e24eaf2b06c6 req-3a03d30a-4abd-4aee-8ebc-2b91772d533e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] No DVR routers for this DVR port 937c022a-ae46-441a-8b52-fa1da6f3b496 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:28:00.707771 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-81a0d779-d9b7-40ba-9758-e24eaf2b06c6 req-3a03d30a-4abd-4aee-8ebc-2b91772d533e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:00.714082 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-81a0d779-d9b7-40ba-9758-e24eaf2b06c6 req-3a03d30a-4abd-4aee-8ebc-2b91772d533e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "DELETE /v2.0/ports/937c022a-ae46-441a-8b52-fa1da6f3b496 HTTP/1.1" status: 204 len: 173 time: 0.9108069 Dec 09 21:28:00.739565 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '53da382a-16f4-44e1-bfd3-8ba00a807708', 'name': 'network-vif-deleted', 'tag': '937c022a-ae46-441a-8b52-fa1da6f3b496'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:00.743094 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-04265cb7-d90e-4a88-9d49-606aa04110d1" -d '{"events": [{"server_uuid": "53da382a-16f4-44e1-bfd3-8ba00a807708", "name": "network-vif-deleted", "tag": "937c022a-ae46-441a-8b52-fa1da6f3b496"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:00.751996 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8cdd2ab0-1672-4794-a1e0-a419c5903481 req-7cec86d5-8e7b-4705-80db-fe8ab806b447 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1050286 Dec 09 21:28:00.752247 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1b808389-ece6-4ae5-adf5-eef80091ad76 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 774 time: 0.4555109 Dec 09 21:28:00.756390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41148) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:00.770024 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-39762535-ed15-4f6d-b52d-fde7f1f9d03b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Request body: {'subnet': {'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1', 'cidr': '10.1.1.0/24', 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:00.837562 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-76d969ce-ac55-44bd-936a-8d40ea8bd3fc x-openstack-request-id: req-76d969ce-ac55-44bd-936a-8d40ea8bd3fc {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:00.838051 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "53da382a-16f4-44e1-bfd3-8ba00a807708", "name": "network-vif-deleted", "tag": "937c022a-ae46-441a-8b52-fa1da6f3b496", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:00.838143 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-76d969ce-ac55-44bd-936a-8d40ea8bd3fc {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:00.838503 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '53da382a-16f4-44e1-bfd3-8ba00a807708', 'name': 'network-vif-deleted', 'tag': '937c022a-ae46-441a-8b52-fa1da6f3b496', 'status': 'completed', 'code': 200} Dec 09 21:28:00.845021 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b808389-ece6-4ae5-adf5-eef80091ad76 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event updated for resources: {'Network': ['ID=a133a939-2827-4fe6-81f5-14715631c0ec,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:00.859915 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network a133a939-2827-4fe6-81f5-14715631c0ec details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:28:01.021901 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-39762535-ed15-4f6d-b52d-fde7f1f9d03b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Made reservation on behalf of 03e962eb7f5e4325a7c08c8b1e2a4cea for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:01.027146 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-39762535-ed15-4f6d-b52d-fde7f1f9d03b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:01.151921 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-474cd8f1-b751-41d6-9ff2-e07f78d35c98 req-61a55594-0366-46bf-8854-e4a4c240adaf tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=53da382a-16f4-44e1-bfd3-8ba00a807708 HTTP/1.1" status: 200 len: 210 time: 0.0868275 Dec 09 21:28:01.207300 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eea8225f-e387-496b-a057-27abceb0d3fb req-d8e15028-60bb-401e-99db-0682ebd0ae01 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:01.208967 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eea8225f-e387-496b-a057-27abceb0d3fb req-d8e15028-60bb-401e-99db-0682ebd0ae01 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/ports?device_id=dffe3c86-0677-4490-a36a-8bed7d798809 HTTP/1.1" status: 200 len: 1024 time: 0.1569173 Dec 09 21:28:01.259128 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec706cde-f8e9-41b4-8a7f-726408c0c38e req-6830c693-ca3e-4ae7-acf8-0ae7e69522e9 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:01.260762 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ec706cde-f8e9-41b4-8a7f-726408c0c38e req-6830c693-ca3e-4ae7-acf8-0ae7e69522e9 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.31 "GET /v2.0/ports?device_id=dffe3c86-0677-4490-a36a-8bed7d798809 HTTP/1.1" status: 200 len: 1024 time: 0.1135635 Dec 09 21:28:01.278743 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['18bda486-9d6d-41a3-a260-dd244a3838b3', '2958b0be-15e5-48e2-b87a-6ffefd9a7859', '1ad36983-4549-4a03-a826-a31a08b98c98', '07457883-17db-4553-8f10-716e04bc16b1', '937c022a-ae46-441a-8b52-fa1da6f3b496'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:28:01.421049 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eea8225f-e387-496b-a057-27abceb0d3fb req-b083dece-a1f8-4dce-9ad0-ded4a2666e76 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups?id=dc3fa276-da75-42c1-a8e4-8471106148d2&id=d0cefb8e-5181-40ca-9bcf-8d762cff4764&id=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9&fields=id&fields=name HTTP/1.1" status: 200 len: 515 time: 0.2008145 Dec 09 21:28:01.424081 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-39762535-ed15-4f6d-b52d-fde7f1f9d03b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:01.476773 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-ec706cde-f8e9-41b4-8a7f-726408c0c38e req-f6dcfde8-bbaf-4e4c-bd82-8f16df116d1b tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Deleting port b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:28:01.477127 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ec706cde-f8e9-41b4-8a7f-726408c0c38e req-f6dcfde8-bbaf-4e4c-bd82-8f16df116d1b tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:01.521705 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 5fd1ab85-a36a-49d7-924f-21a52601dc1e up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:28:01.619600 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39762535-ed15-4f6d-b52d-fde7f1f9d03b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event updated for resources: {'Subnet': ['ID=a894075b-fa9f-4a27-9782-e476e86f74e0,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:01.642835 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 5fd1ab85-a36a-49d7-924f-21a52601dc1e completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:28:01.643177 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-ec706cde-f8e9-41b4-8a7f-726408c0c38e req-f6dcfde8-bbaf-4e4c-bd82-8f16df116d1b tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] For port b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e,segment=NetworkSegment(c472f4a8-1a94-4bb1-8978-a56e5ee37bb8),segment_id=c472f4a8-1a94-4bb1-8978-a56e5ee37bb8)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:01.645186 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ec706cde-f8e9-41b4-8a7f-726408c0c38e req-f6dcfde8-bbaf-4e4c-bd82-8f16df116d1b tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:01.654608 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 5fd1ab85-a36a-49d7-924f-21a52601dc1e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:01.655029 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:01.673361 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-ec706cde-f8e9-41b4-8a7f-726408c0c38e req-f6dcfde8-bbaf-4e4c-bd82-8f16df116d1b tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Calling delete_port for b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:28:01.760263 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98fe5a62-c53f-4dad-b1f5-173a2f1b3f23 req-e8ecd4e6-6c5e-47e0-9e84-8d123edb889c tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.0887620 Dec 09 21:28:01.788737 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39762535-ed15-4f6d-b52d-fde7f1f9d03b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Checking segment: {'id': '669c24e6-ecea-4894-adc4-51a9b461417f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:01.789098 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-39762535-ed15-4f6d-b52d-fde7f1f9d03b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Network hostable DHCP agents. Network: a859e4ba-764a-41c0-982d-5bf79a2797a1, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:28:01.833974 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8d73b9f-d9ad-4157-8b0f-6a2feccd0184 req-93bdc369-c6e2-46dc-a34e-8aeebf60bcfd tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:01.839859 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8d73b9f-d9ad-4157-8b0f-6a2feccd0184 req-93bdc369-c6e2-46dc-a34e-8aeebf60bcfd tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 944 time: 0.3757350 Dec 09 21:28:01.864164 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:01.900448 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ec706cde-f8e9-41b4-8a7f-726408c0c38e req-f6dcfde8-bbaf-4e4c-bd82-8f16df116d1b tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:01.914544 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 5fd1ab85-a36a-49d7-924f-21a52601dc1e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=5fd1ab85-a36a-49d7-924f-21a52601dc1e,segment=NetworkSegment(6bb6d7a7-737b-46b2-b463-0bc25081f6ef),segment_id=6bb6d7a7-737b-46b2-b463-0bc25081f6ef)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:01.970699 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-39762535-ed15-4f6d-b52d-fde7f1f9d03b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Network a859e4ba-764a-41c0-982d-5bf79a2797a1 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:28:01.972886 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:01.977387 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6dcfde8-bbaf-4e4c-bd82-8f16df116d1b tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event deleted for resources: {'Port': ['ID=b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:02.008057 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8d73b9f-d9ad-4157-8b0f-6a2feccd0184 req-5c55add4-84f8-45e6-b91e-5fb84ffacdf7 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1475379 Dec 09 21:28:02.017339 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-39762535-ed15-4f6d-b52d-fde7f1f9d03b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, a859e4ba-764a-41c0-982d-5bf79a2797a1) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:02.058136 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39762535-ed15-4f6d-b52d-fde7f1f9d03b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:02.058751 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-39762535-ed15-4f6d-b52d-fde7f1f9d03b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:02.059282 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-ec706cde-f8e9-41b4-8a7f-726408c0c38e req-f6dcfde8-bbaf-4e4c-bd82-8f16df116d1b tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] No DVR routers for this DVR port b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:28:02.065296 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ec706cde-f8e9-41b4-8a7f-726408c0c38e req-f6dcfde8-bbaf-4e4c-bd82-8f16df116d1b tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:02.075658 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ec706cde-f8e9-41b4-8a7f-726408c0c38e req-f6dcfde8-bbaf-4e4c-bd82-8f16df116d1b tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.31 "DELETE /v2.0/ports/b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e HTTP/1.1" status: 204 len: 173 time: 0.8057065 Dec 09 21:28:02.089822 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-39762535-ed15-4f6d-b52d-fde7f1f9d03b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 794 time: 1.3299263 Dec 09 21:28:02.090372 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41174) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:02.096032 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-47f7ab69-d408-4a1f-bc02-1c67bdcc021c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Request body: {'subnet': {'network_id': 'a133a939-2827-4fe6-81f5-14715631c0ec', 'cidr': '10.2.2.0/24', 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:02.133476 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d45f1b2-8a44-4fbc-a0db-eaba61051339 req-c2c96d25-1c9b-4b99-be54-7b74348110eb tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:02.135635 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d45f1b2-8a44-4fbc-a0db-eaba61051339 req-c2c96d25-1c9b-4b99-be54-7b74348110eb tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 945 time: 0.1498580 Dec 09 21:28:02.226276 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '29288a2c-1307-4936-8a5e-57387556eb95', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5fd1ab85-a36a-49d7-924f-21a52601dc1e'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:02.228574 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fe20539d-63d8-466d-bd6d-15a1bbdfe0cf" -d '{"events": [{"server_uuid": "29288a2c-1307-4936-8a5e-57387556eb95", "name": "network-vif-plugged", "status": "completed", "tag": "5fd1ab85-a36a-49d7-924f-21a52601dc1e"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:02.235144 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-57ec7495-9598-4906-9a05-4d5ec1bdd700 None None] Network a859e4ba-764a-41c0-982d-5bf79a2797a1 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:28:02.333387 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=5fd1ab85-a36a-49d7-924f-21a52601dc1e,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:02.383079 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a096d858-e293-4dfb-8556-b0287e17b9de None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-a859e4ba-764a-41c0-982d-5bf79a2797a1', 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1', 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'fixed_ips': [{'subnet_id': 'a894075b-fa9f-4a27-9782-e476e86f74e0'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:28:02.384278 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a096d858-e293-4dfb-8556-b0287e17b9de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:02.543679 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-a096d858-e293-4dfb-8556-b0287e17b9de None None] Allocated IP 10.1.1.2 (a859e4ba-764a-41c0-982d-5bf79a2797a1/a894075b-fa9f-4a27-9782-e476e86f74e0/733d9248-a81b-4611-8784-329c6a7090a3) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:02.575196 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c609273-1476-4479-87c0-9163a65b4673 req-20bfde05-0a37-45f2-9dbb-df6e5d50a6b4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:02.579938 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c609273-1476-4479-87c0-9163a65b4673 req-20bfde05-0a37-45f2-9dbb-df6e5d50a6b4 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 946 time: 0.4240873 Dec 09 21:28:02.600484 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d45f1b2-8a44-4fbc-a0db-eaba61051339 req-fc8865d7-21a6-441b-8bad-301a83242756 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4544799 Dec 09 21:28:02.636814 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-47f7ab69-d408-4a1f-bc02-1c67bdcc021c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Made reservation on behalf of 03e962eb7f5e4325a7c08c8b1e2a4cea for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:02.645044 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-47f7ab69-d408-4a1f-bc02-1c67bdcc021c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:02.726549 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c609273-1476-4479-87c0-9163a65b4673 req-4568163d-a219-4b0e-bc58-db39eb879b98 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1211054 Dec 09 21:28:02.782211 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a096d858-e293-4dfb-8556-b0287e17b9de None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:02.789818 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-025d7150-862c-4289-930c-ff8356fae30d x-openstack-request-id: req-025d7150-862c-4289-930c-ff8356fae30d {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:02.791482 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "29288a2c-1307-4936-8a5e-57387556eb95", "name": "network-vif-plugged", "status": "completed", "tag": "5fd1ab85-a36a-49d7-924f-21a52601dc1e", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:02.791482 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-025d7150-862c-4289-930c-ff8356fae30d {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:02.791482 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '29288a2c-1307-4936-8a5e-57387556eb95', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5fd1ab85-a36a-49d7-924f-21a52601dc1e', 'code': 200} Dec 09 21:28:02.794667 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a096d858-e293-4dfb-8556-b0287e17b9de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:02.856815 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a096d858-e293-4dfb-8556-b0287e17b9de None None] Pushing event updated for resources: {'Port': ['ID=733d9248-a81b-4611-8784-329c6a7090a3,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:02.857253 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dffe3c86-0677-4490-a36a-8bed7d798809', 'name': 'network-vif-deleted', 'tag': 'b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:02.869880 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5ed38136-dd88-49d0-85e0-51a217d1159b" -d '{"events": [{"server_uuid": "dffe3c86-0677-4490-a36a-8bed7d798809", "name": "network-vif-deleted", "tag": "b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:02.870331 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a096d858-e293-4dfb-8556-b0287e17b9de None None] Network a859e4ba-764a-41c0-982d-5bf79a2797a1 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:02.878050 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-a096d858-e293-4dfb-8556-b0287e17b9de None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:02.881355 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a096d858-e293-4dfb-8556-b0287e17b9de None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:02.905251 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-861a846c-e373-4693-a13b-045c569183b0 req-53c2e291-b92c-4173-8684-3e2fa719fd78 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:02.907803 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-861a846c-e373-4693-a13b-045c569183b0 req-53c2e291-b92c-4173-8684-3e2fa719fd78 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 1097 time: 0.0976541 Dec 09 21:28:02.980546 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-861a846c-e373-4693-a13b-045c569183b0 req-62622287-1cb2-4677-9ab7-f2f79e1f5d7f service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0651138 Dec 09 21:28:02.986347 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-71e499d6-c1b6-4764-bdc7-ca8c584367e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:02.999270 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a096d858-e293-4dfb-8556-b0287e17b9de None None] Attempting to bind port 733d9248-a81b-4611-8784-329c6a7090a3 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:28:02.999805 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a096d858-e293-4dfb-8556-b0287e17b9de None None] Attempting to bind port 733d9248-a81b-4611-8784-329c6a7090a3 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '669c24e6-ecea-4894-adc4-51a9b461417f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:28:03.000624 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a096d858-e293-4dfb-8556-b0287e17b9de None None] Attempting to bind port 733d9248-a81b-4611-8784-329c6a7090a3 on network a859e4ba-764a-41c0-982d-5bf79a2797a1 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:03.005649 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a096d858-e293-4dfb-8556-b0287e17b9de None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 27, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:28:03.006013 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a096d858-e293-4dfb-8556-b0287e17b9de None None] Checking segment: {'id': '669c24e6-ecea-4894-adc4-51a9b461417f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:03.006703 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a096d858-e293-4dfb-8556-b0287e17b9de None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:03.006845 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a096d858-e293-4dfb-8556-b0287e17b9de None None] Bound using segment: {'id': '669c24e6-ecea-4894-adc4-51a9b461417f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:28:03.007399 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a096d858-e293-4dfb-8556-b0287e17b9de None None] Bound port: 733d9248-a81b-4611-8784-329c6a7090a3, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '669c24e6-ecea-4894-adc4-51a9b461417f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:28:03.007927 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a096d858-e293-4dfb-8556-b0287e17b9de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:03.014118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11bc27f7-d772-49c5-bef7-be00dc96be4c req-f0c2cfc6-7d35-46c0-a531-5c2ab1903644 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:03.015698 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11bc27f7-d772-49c5-bef7-be00dc96be4c req-f0c2cfc6-7d35-46c0-a531-5c2ab1903644 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 945 time: 0.1789651 Dec 09 21:28:03.068902 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99ec13cd-ba69-415b-b671-33e8f7e038e3 req-66d30c81-993d-4262-a803-5bc15fd5cf53 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/dc3fa276-da75-42c1-a8e4-8471106148d2 HTTP/1.1" status: 200 len: 1819 time: 0.0882275 Dec 09 21:28:03.092947 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a096d858-e293-4dfb-8556-b0287e17b9de None None] For port 733d9248-a81b-4611-8784-329c6a7090a3, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:28:03.097834 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a096d858-e293-4dfb-8556-b0287e17b9de None None] For port 733d9248-a81b-4611-8784-329c6a7090a3, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=733d9248-a81b-4611-8784-329c6a7090a3,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:28:03.104628 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a096d858-e293-4dfb-8556-b0287e17b9de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:03.187235 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a096d858-e293-4dfb-8556-b0287e17b9de None None] Pushing event updated for resources: {'Port': ['ID=733d9248-a81b-4611-8784-329c6a7090a3,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:03.238900 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11bc27f7-d772-49c5-bef7-be00dc96be4c req-4826951d-8d51-4881-b878-aa366c8c9886 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2135549 Dec 09 21:28:03.327359 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-99ec13cd-ba69-415b-b671-33e8f7e038e3 req-f7b69e96-66b3-42ef-bc41-c71976b30260 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:03.416669 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-99ec13cd-ba69-415b-b671-33e8f7e038e3 req-f7b69e96-66b3-42ef-bc41-c71976b30260 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:03.440534 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-817faa63-9eb5-4a53-9b6c-34a38493d3a9 req-145b998b-7606-46fa-863b-9b1356517196 tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.1143038 Dec 09 21:28:03.473215 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d5db67de-fb19-461f-965d-7dcf99cc6c71 req-880ef5b0-2802-4438-8d84-6448dfb4e8be service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.3439751 Dec 09 21:28:03.474330 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-47f7ab69-d408-4a1f-bc02-1c67bdcc021c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:03.529235 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 937c022a-ae46-441a-8b52-fa1da6f3b496 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:28:03.544958 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cafd5e2e-1a80-4cfb-8c12-982e8aa1c3d7 x-openstack-request-id: req-cafd5e2e-1a80-4cfb-8c12-982e8aa1c3d7 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:03.544958 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dffe3c86-0677-4490-a36a-8bed7d798809", "name": "network-vif-deleted", "tag": "b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:03.545247 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-cafd5e2e-1a80-4cfb-8c12-982e8aa1c3d7 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:03.545621 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dffe3c86-0677-4490-a36a-8bed7d798809', 'name': 'network-vif-deleted', 'tag': 'b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e', 'status': 'completed', 'code': 200} Dec 09 21:28:03.622515 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47f7ab69-d408-4a1f-bc02-1c67bdcc021c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event updated for resources: {'Subnet': ['ID=753ba647-b0b0-482e-ac28-89c7e6adf654,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:03.626731 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 937c022a-ae46-441a-8b52-fa1da6f3b496 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:28:03.627765 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 937c022a-ae46-441a-8b52-fa1da6f3b496 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:28:03.628196 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-99ec13cd-ba69-415b-b671-33e8f7e038e3 req-f7b69e96-66b3-42ef-bc41-c71976b30260 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:03.629755 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:28:03.630916 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-99ec13cd-ba69-415b-b671-33e8f7e038e3 req-f7b69e96-66b3-42ef-bc41-c71976b30260 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:03.653410 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99ec13cd-ba69-415b-b671-33e8f7e038e3 req-f7b69e96-66b3-42ef-bc41-c71976b30260 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "DELETE /v2.0/security-groups/dc3fa276-da75-42c1-a8e4-8471106148d2 HTTP/1.1" status: 204 len: 173 time: 0.5835469 Dec 09 21:28:03.670329 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:28:03.670764 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device b7bb5127-cb57-45bc-9bb7-3c1e6e5e353e not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:28:03.683766 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47f7ab69-d408-4a1f-bc02-1c67bdcc021c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Checking segment: {'id': '8ca86951-e612-4db0-90f4-834b52fd24e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'a133a939-2827-4fe6-81f5-14715631c0ec'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:03.684042 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-47f7ab69-d408-4a1f-bc02-1c67bdcc021c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Network hostable DHCP agents. Network: a133a939-2827-4fe6-81f5-14715631c0ec, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:28:03.698300 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7b69e96-66b3-42ef-bc41-c71976b30260 tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=dc3fa276-da75-42c1-a8e4-8471106148d2,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:03.752910 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22925acf-20ca-468a-ab93-0e7566725ed7 req-656a58c0-e778-4a97-8fac-bf65a304a3f4 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:03.754424 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22925acf-20ca-468a-ab93-0e7566725ed7 req-656a58c0-e778-4a97-8fac-bf65a304a3f4 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=b521a440-0384-48fc-aaa9-13419003343e HTTP/1.1" status: 200 len: 949 time: 0.0885882 Dec 09 21:28:03.764767 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-47f7ab69-d408-4a1f-bc02-1c67bdcc021c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Network a133a939-2827-4fe6-81f5-14715631c0ec is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:28:03.807527 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-47f7ab69-d408-4a1f-bc02-1c67bdcc021c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, a133a939-2827-4fe6-81f5-14715631c0ec) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:03.815587 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47f7ab69-d408-4a1f-bc02-1c67bdcc021c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:03.816200 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-47f7ab69-d408-4a1f-bc02-1c67bdcc021c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:03.818587 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90ab36c0-8bad-4c1e-b33b-2ce0e280a4cb None None] Network a133a939-2827-4fe6-81f5-14715631c0ec requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:28:03.865319 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73e087ef-8b2a-4f0c-8035-cbd9a4412c7b req-7efd7de5-a042-4d4a-9d91-70f94827da37 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:03.867022 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-73e087ef-8b2a-4f0c-8035-cbd9a4412c7b req-7efd7de5-a042-4d4a-9d91-70f94827da37 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 945 time: 0.1255190 Dec 09 21:28:03.873930 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22925acf-20ca-468a-ab93-0e7566725ed7 req-bfb3a7b3-b56e-4fcb-a1f9-4d1474ad22ba tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1113505 Dec 09 21:28:03.882481 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-47f7ab69-d408-4a1f-bc02-1c67bdcc021c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 794 time: 1.7884910 Dec 09 21:28:03.882771 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41214) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:03.898548 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-db017446-833f-4470-b400-61eefee096eb tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Request body: {'port': {'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1', 'name': 'tempest-TaggedBootDevicesTest-450341210', 'fixed_ips': [{'subnet_id': 'a894075b-fa9f-4a27-9782-e476e86f74e0'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:03.955918 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-73e087ef-8b2a-4f0c-8035-cbd9a4412c7b req-13b199ad-5d72-45fa-9242-a79b9cf37c63 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0749507 Dec 09 21:28:03.978489 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8de1e2a5-ad62-4a4a-a853-ca53f1ee40a8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-a133a939-2827-4fe6-81f5-14715631c0ec', 'network_id': 'a133a939-2827-4fe6-81f5-14715631c0ec', 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'fixed_ips': [{'subnet_id': '753ba647-b0b0-482e-ac28-89c7e6adf654'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:28:03.978489 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8de1e2a5-ad62-4a4a-a853-ca53f1ee40a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:04.064236 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-db017446-833f-4470-b400-61eefee096eb tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Made reservation on behalf of 03e962eb7f5e4325a7c08c8b1e2a4cea for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:04.151980 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cfab5cac-ca8a-4727-adb0-2403f69ecf02 req-40578bc8-d875-4e94-8950-9d692e66fddc tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "GET /v2.0/security-groups/d0cefb8e-5181-40ca-9bcf-8d762cff4764 HTTP/1.1" status: 200 len: 1818 time: 0.1509674 Dec 09 21:28:04.215300 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-8de1e2a5-ad62-4a4a-a853-ca53f1ee40a8 None None] Allocated IP 10.2.2.2 (a133a939-2827-4fe6-81f5-14715631c0ec/753ba647-b0b0-482e-ac28-89c7e6adf654/597635f0-9f73-4c25-9ef3-19098dd68e58) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:04.215666 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-db017446-833f-4470-b400-61eefee096eb tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:04.257193 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-db017446-833f-4470-b400-61eefee096eb tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] device_id is not set on port 1e946a47-f496-445b-964b-618881eab263 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:28:04.299986 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 733d9248-a81b-4611-8784-329c6a7090a3 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:28:04.386357 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cfab5cac-ca8a-4727-adb0-2403f69ecf02 req-ce8c613f-e954-459d-91a5-b0f66273e0cd tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:04.459941 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c717ff60-b68c-4f00-8b27-35ab5724784f req-d1e90174-0780-433d-aa79-f4ceb01e8a1d tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:04.468877 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c717ff60-b68c-4f00-8b27-35ab5724784f req-d1e90174-0780-433d-aa79-f4ceb01e8a1d tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 946 time: 0.1893854 Dec 09 21:28:04.489900 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cfab5cac-ca8a-4727-adb0-2403f69ecf02 req-ce8c613f-e954-459d-91a5-b0f66273e0cd tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:04.539780 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8de1e2a5-ad62-4a4a-a853-ca53f1ee40a8 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:04.564794 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-db017446-833f-4470-b400-61eefee096eb tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Allocated IP 10.1.1.81 (a859e4ba-764a-41c0-982d-5bf79a2797a1/a894075b-fa9f-4a27-9782-e476e86f74e0/1e946a47-f496-445b-964b-618881eab263) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:04.568350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c717ff60-b68c-4f00-8b27-35ab5724784f req-1e35ae24-050b-4d3d-b322-a05d95819d0f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0905104 Dec 09 21:28:04.569278 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8de1e2a5-ad62-4a4a-a853-ca53f1ee40a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:04.628232 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cfab5cac-ca8a-4727-adb0-2403f69ecf02 req-ce8c613f-e954-459d-91a5-b0f66273e0cd tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:04.631893 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-cfab5cac-ca8a-4727-adb0-2403f69ecf02 req-ce8c613f-e954-459d-91a5-b0f66273e0cd tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:04.640741 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cfab5cac-ca8a-4727-adb0-2403f69ecf02 req-ce8c613f-e954-459d-91a5-b0f66273e0cd tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] 10.222.0.13 "DELETE /v2.0/security-groups/d0cefb8e-5181-40ca-9bcf-8d762cff4764 HTTP/1.1" status: 204 len: 173 time: 0.4838140 Dec 09 21:28:04.641518 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41222) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:04.684294 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8de1e2a5-ad62-4a4a-a853-ca53f1ee40a8 None None] Network a133a939-2827-4fe6-81f5-14715631c0ec is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:04.687034 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8de1e2a5-ad62-4a4a-a853-ca53f1ee40a8 None None] Pushing event updated for resources: {'Port': ['ID=597635f0-9f73-4c25-9ef3-19098dd68e58,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:04.697358 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce8c613f-e954-459d-91a5-b0f66273e0cd tempest-SecurityGroupsTestJSON-1961551729 tempest-SecurityGroupsTestJSON-1961551729-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d0cefb8e-5181-40ca-9bcf-8d762cff4764,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:04.708283 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-8de1e2a5-ad62-4a4a-a853-ca53f1ee40a8 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:04.721606 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8de1e2a5-ad62-4a4a-a853-ca53f1ee40a8 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:04.760701 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 733d9248-a81b-4611-8784-329c6a7090a3 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:04.761847 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:04.824557 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87e8b1c0-deb3-40e0-a92d-e905e1d6ec19 None None] Network a859e4ba-764a-41c0-982d-5bf79a2797a1 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:28:04.900844 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43ed51c4-1052-4099-bdcf-68f1a5cd7ef9 req-f91d4bfb-98f3-4b15-8152-590c20a111d9 tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.0803545 Dec 09 21:28:04.939422 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-d2d6fce3-28eb-427a-a879-08e1ff4a54e2 admin admin] Deleting subnet cb187a9c-ec94-4995-93f8-92c16c7a80a3 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:28:04.944260 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-db017446-833f-4470-b400-61eefee096eb tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:04.967094 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2d6fce3-28eb-427a-a879-08e1ff4a54e2 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:04.989537 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-db017446-833f-4470-b400-61eefee096eb tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:05.002708 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-8de1e2a5-ad62-4a4a-a853-ca53f1ee40a8 None None] Attempting to bind port 597635f0-9f73-4c25-9ef3-19098dd68e58 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:28:05.003328 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-8de1e2a5-ad62-4a4a-a853-ca53f1ee40a8 None None] Attempting to bind port 597635f0-9f73-4c25-9ef3-19098dd68e58 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '8ca86951-e612-4db0-90f4-834b52fd24e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'a133a939-2827-4fe6-81f5-14715631c0ec'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:28:05.005003 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8de1e2a5-ad62-4a4a-a853-ca53f1ee40a8 None None] Attempting to bind port 597635f0-9f73-4c25-9ef3-19098dd68e58 on network a133a939-2827-4fe6-81f5-14715631c0ec {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:05.007352 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-20dfe1cc-8736-4c2b-a4f2-3b7684f6f699 None None] Provisioning complete for port 733d9248-a81b-4611-8784-329c6a7090a3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:05.007749 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-20dfe1cc-8736-4c2b-a4f2-3b7684f6f699 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:05.028535 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60a08f05-b9e9-4dfe-9233-1e6e3d7379bb req-38fe0b19-f585-49b3-a391-eb04346e9c07 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:05.030889 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60a08f05-b9e9-4dfe-9233-1e6e3d7379bb req-38fe0b19-f585-49b3-a391-eb04346e9c07 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.10 "GET /v2.0/ports?device_id=b521a440-0384-48fc-aaa9-13419003343e HTTP/1.1" status: 200 len: 949 time: 0.3449769 Dec 09 21:28:05.046079 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db017446-833f-4470-b400-61eefee096eb tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Network a859e4ba-764a-41c0-982d-5bf79a2797a1 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:05.048231 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8de1e2a5-ad62-4a4a-a853-ca53f1ee40a8 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 27, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:28:05.048615 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8de1e2a5-ad62-4a4a-a853-ca53f1ee40a8 None None] Checking segment: {'id': '8ca86951-e612-4db0-90f4-834b52fd24e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'a133a939-2827-4fe6-81f5-14715631c0ec'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:05.050099 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8de1e2a5-ad62-4a4a-a853-ca53f1ee40a8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:05.050505 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8de1e2a5-ad62-4a4a-a853-ca53f1ee40a8 None None] Bound using segment: {'id': '8ca86951-e612-4db0-90f4-834b52fd24e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'a133a939-2827-4fe6-81f5-14715631c0ec'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:28:05.051018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-8de1e2a5-ad62-4a4a-a853-ca53f1ee40a8 None None] Bound port: 597635f0-9f73-4c25-9ef3-19098dd68e58, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8ca86951-e612-4db0-90f4-834b52fd24e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'a133a939-2827-4fe6-81f5-14715631c0ec'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:28:05.051869 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-db017446-833f-4470-b400-61eefee096eb tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:05.051963 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8de1e2a5-ad62-4a4a-a853-ca53f1ee40a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:05.053945 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db017446-833f-4470-b400-61eefee096eb tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:05.057928 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c2427a0-a3c1-4317-8036-500fa2a35981 req-755c2ef7-45e5-400a-bb05-0c5ac3b9f9fd tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:05.060566 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c2427a0-a3c1-4317-8036-500fa2a35981 req-755c2ef7-45e5-400a-bb05-0c5ac3b9f9fd tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 945 time: 0.3648806 Dec 09 21:28:05.095879 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db017446-833f-4470-b400-61eefee096eb tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event updated for resources: {'Port': ['ID=1e946a47-f496-445b-964b-618881eab263,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:05.121531 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db017446-833f-4470-b400-61eefee096eb tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:05.122546 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-db017446-833f-4470-b400-61eefee096eb tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:05.146385 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-db017446-833f-4470-b400-61eefee096eb tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 1.2613709 Dec 09 21:28:05.148501 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41238) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:05.154878 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-3bf7f9e6-a0eb-43de-8292-d2aa438be796 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Request body: {'port': {'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1', 'name': 'tempest-TaggedBootDevicesTest-1349263043', 'fixed_ips': [{'subnet_id': 'a894075b-fa9f-4a27-9782-e476e86f74e0'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:05.172921 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2d6fce3-28eb-427a-a879-08e1ff4a54e2 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:05.191411 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:05.258294 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-8de1e2a5-ad62-4a4a-a853-ca53f1ee40a8 None None] For port 597635f0-9f73-4c25-9ef3-19098dd68e58, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:28:05.263944 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-8de1e2a5-ad62-4a4a-a853-ca53f1ee40a8 None None] For port 597635f0-9f73-4c25-9ef3-19098dd68e58, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=597635f0-9f73-4c25-9ef3-19098dd68e58,segment=NetworkSegment(8ca86951-e612-4db0-90f4-834b52fd24e0),segment_id=8ca86951-e612-4db0-90f4-834b52fd24e0)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:28:05.264292 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6fe9c6c-2829-4490-9fd0-149387bc256c req-6038a1d5-ba8f-48d5-a47d-dc9deedc0e53 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:05.272141 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c6fe9c6c-2829-4490-9fd0-149387bc256c req-6038a1d5-ba8f-48d5-a47d-dc9deedc0e53 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=b521a440-0384-48fc-aaa9-13419003343e HTTP/1.1" status: 200 len: 949 time: 0.2367127 Dec 09 21:28:05.317332 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c2427a0-a3c1-4317-8036-500fa2a35981 req-c01aaf1a-1aff-4593-8bf1-c8944efba4d6 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2330980 Dec 09 21:28:05.338449 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8de1e2a5-ad62-4a4a-a853-ca53f1ee40a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:05.344332 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 733d9248-a81b-4611-8784-329c6a7090a3, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=733d9248-a81b-4611-8784-329c6a7090a3,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:05.382027 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:05.396756 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3bf7f9e6-a0eb-43de-8292-d2aa438be796 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Made reservation on behalf of 03e962eb7f5e4325a7c08c8b1e2a4cea for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:05.402944 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3bf7f9e6-a0eb-43de-8292-d2aa438be796 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:05.416409 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2d6fce3-28eb-427a-a879-08e1ff4a54e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:05.429914 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-3bf7f9e6-a0eb-43de-8292-d2aa438be796 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] device_id is not set on port 145a0cde-0fe5-4163-a063-0fdfe42f243b yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:28:05.508508 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-20dfe1cc-8736-4c2b-a4f2-3b7684f6f699 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:05.588151 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8de1e2a5-ad62-4a4a-a853-ca53f1ee40a8 None None] Pushing event updated for resources: {'Port': ['ID=597635f0-9f73-4c25-9ef3-19098dd68e58,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:05.614652 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c6fe9c6c-2829-4490-9fd0-149387bc256c req-45619fe4-7b4b-4e2e-a938-9afa4abe4c13 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3414917 Dec 09 21:28:05.636766 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-3bf7f9e6-a0eb-43de-8292-d2aa438be796 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Allocated IP 10.1.1.31 (a859e4ba-764a-41c0-982d-5bf79a2797a1/a894075b-fa9f-4a27-9782-e476e86f74e0/145a0cde-0fe5-4163-a063-0fdfe42f243b) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:05.671801 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-60a08f05-b9e9-4dfe-9233-1e6e3d7379bb req-da77526b-4b77-4343-9781-2bf0817700cc tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Deleting port 0ef815c5-fc54-4d19-b139-1eaa75cffde2 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:28:05.672285 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-60a08f05-b9e9-4dfe-9233-1e6e3d7379bb req-da77526b-4b77-4343-9781-2bf0817700cc tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:05.713721 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=733d9248-a81b-4611-8784-329c6a7090a3,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:05.718156 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-20dfe1cc-8736-4c2b-a4f2-3b7684f6f699 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:28:05.719394 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-20dfe1cc-8736-4c2b-a4f2-3b7684f6f699 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:28:05.719937 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2081cb8b-da4b-480d-a731-26c9bff24853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:05.907078 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1246b1-e3b7-4a9b-ac55-6a4d5bd1f3f1 req-f5e4fa87-8a09-48a5-ab70-06a8de845514 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:05.922369 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e1246b1-e3b7-4a9b-ac55-6a4d5bd1f3f1 req-f5e4fa87-8a09-48a5-ab70-06a8de845514 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 945 time: 0.4396839 Dec 09 21:28:05.948490 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2d6fce3-28eb-427a-a879-08e1ff4a54e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:05.989397 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3bf7f9e6-a0eb-43de-8292-d2aa438be796 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:05.995223 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2d6fce3-28eb-427a-a879-08e1ff4a54e2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=cb187a9c-ec94-4995-93f8-92c16c7a80a3,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:06.042368 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d33fa47-2ab6-416b-ab01-1deec29e5f24 req-8ea11919-0d0a-4b94-b42c-7bc45f912796 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:06.049678 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5d33fa47-2ab6-416b-ab01-1deec29e5f24 req-8ea11919-0d0a-4b94-b42c-7bc45f912796 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 945 time: 0.2834971 Dec 09 21:28:06.056609 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3bf7f9e6-a0eb-43de-8292-d2aa438be796 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:06.066625 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2d6fce3-28eb-427a-a879-08e1ff4a54e2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:06.072586 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d2d6fce3-28eb-427a-a879-08e1ff4a54e2 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/cb187a9c-ec94-4995-93f8-92c16c7a80a3 HTTP/1.1" status: 204 len: 168 time: 1.3972051 Dec 09 21:28:06.096959 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41248) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:06.125486 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-60a08f05-b9e9-4dfe-9233-1e6e3d7379bb req-da77526b-4b77-4343-9781-2bf0817700cc tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] For port 0ef815c5-fc54-4d19-b139-1eaa75cffde2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=0ef815c5-fc54-4d19-b139-1eaa75cffde2,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:06.125850 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-60a08f05-b9e9-4dfe-9233-1e6e3d7379bb req-da77526b-4b77-4343-9781-2bf0817700cc tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:06.154573 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3bf7f9e6-a0eb-43de-8292-d2aa438be796 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Network a859e4ba-764a-41c0-982d-5bf79a2797a1 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:06.163558 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-3bf7f9e6-a0eb-43de-8292-d2aa438be796 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:06.175873 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-60a08f05-b9e9-4dfe-9233-1e6e3d7379bb req-da77526b-4b77-4343-9781-2bf0817700cc tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Calling delete_port for 0ef815c5-fc54-4d19-b139-1eaa75cffde2 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:28:06.186117 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e1246b1-e3b7-4a9b-ac55-6a4d5bd1f3f1 req-937466e4-a783-4605-a39c-ddc20047024f tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2629461 Dec 09 21:28:06.208865 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3bf7f9e6-a0eb-43de-8292-d2aa438be796 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:06.214546 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5d33fa47-2ab6-416b-ab01-1deec29e5f24 req-c926fd4e-51b5-43eb-99a8-5c6174f18f91 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1291199 Dec 09 21:28:06.261509 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bf7f9e6-a0eb-43de-8292-d2aa438be796 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event updated for resources: {'Port': ['ID=145a0cde-0fe5-4163-a063-0fdfe42f243b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:06.298515 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e325e30c-e651-4c3d-aaf9-c43f30f6270e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:06.368173 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3bf7f9e6-a0eb-43de-8292-d2aa438be796 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:06.369019 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3bf7f9e6-a0eb-43de-8292-d2aa438be796 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:06.452971 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3bf7f9e6-a0eb-43de-8292-d2aa438be796 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 1.3032317 Dec 09 21:28:06.460390 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 597635f0-9f73-4c25-9ef3-19098dd68e58 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:28:06.552290 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d98e6818-32aa-4eaa-a91a-62376aeb1cc4 req-4e56725a-df98-4186-b5b9-4108823b3cb8 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:06.570449 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d98e6818-32aa-4eaa-a91a-62376aeb1cc4 req-4e56725a-df98-4186-b5b9-4108823b3cb8 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 946 time: 0.1934071 Dec 09 21:28:06.593121 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f2c3d2bf-a573-42fa-a7b9-95dee2f759e5 None None] Provisioning complete for port 733d9248-a81b-4611-8784-329c6a7090a3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:06.593581 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f2c3d2bf-a573-42fa-a7b9-95dee2f759e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:06.607074 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e325e30c-e651-4c3d-aaf9-c43f30f6270e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:06.671135 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0a344613-4080-4a48-84fb-f5ea2fa2c87b req-b310dd49-634b-487a-94be-ba86d927706a service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=54a2288281d94f2e97ddb6d56d76df9f&device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.0633199 Dec 09 21:28:06.682149 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d98e6818-32aa-4eaa-a91a-62376aeb1cc4 req-93e927b9-9209-4c6c-b04b-f87ef118808b tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1106935 Dec 09 21:28:06.701262 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-e325e30c-e651-4c3d-aaf9-c43f30f6270e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['de91a458-cde4-4265-8605-31d9b6f8f05f']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:28:06.703724 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-60a08f05-b9e9-4dfe-9233-1e6e3d7379bb req-da77526b-4b77-4343-9781-2bf0817700cc tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:06.713219 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:06.726865 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['fd466da6-f506-43e6-9800-156622bd2781', 'c3c31744-0580-4d09-863d-697769f7c0ee'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:28:06.730090 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['18bda486-9d6d-41a3-a260-dd244a3838b3', '2958b0be-15e5-48e2-b87a-6ffefd9a7859', '1ad36983-4549-4a03-a826-a31a08b98c98', '07457883-17db-4553-8f10-716e04bc16b1'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:28:06.745052 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0a344613-4080-4a48-84fb-f5ea2fa2c87b req-b53a109a-5d98-4c7b-b697-cb73c7d7c351 service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=54a2288281d94f2e97ddb6d56d76df9f&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0727515 Dec 09 21:28:06.747024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-e325e30c-e651-4c3d-aaf9-c43f30f6270e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c472f4a8-1a94-4bb1-8978-a56e5ee37bb8') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:28:06.747320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-e325e30c-e651-4c3d-aaf9-c43f30f6270e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c472f4a8-1a94-4bb1-8978-a56e5ee37bb8') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:28:06.789283 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da77526b-4b77-4343-9781-2bf0817700cc tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Pushing event deleted for resources: {'Port': ['ID=0ef815c5-fc54-4d19-b139-1eaa75cffde2,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:06.818866 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 597635f0-9f73-4c25-9ef3-19098dd68e58 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:06.819755 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:06.881998 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e325e30c-e651-4c3d-aaf9-c43f30f6270e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:06.948128 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-60a08f05-b9e9-4dfe-9233-1e6e3d7379bb req-da77526b-4b77-4343-9781-2bf0817700cc tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] No DVR routers for this DVR port 0ef815c5-fc54-4d19-b139-1eaa75cffde2 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:28:06.953193 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-60a08f05-b9e9-4dfe-9233-1e6e3d7379bb req-da77526b-4b77-4343-9781-2bf0817700cc tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:06.959756 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60a08f05-b9e9-4dfe-9233-1e6e3d7379bb req-da77526b-4b77-4343-9781-2bf0817700cc tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.10 "DELETE /v2.0/ports/0ef815c5-fc54-4d19-b139-1eaa75cffde2 HTTP/1.1" status: 204 len: 173 time: 1.8952849 Dec 09 21:28:06.960508 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b521a440-0384-48fc-aaa9-13419003343e', 'name': 'network-vif-deleted', 'tag': '0ef815c5-fc54-4d19-b139-1eaa75cffde2'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:06.974724 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a5be89cf-fef4-4f8c-866b-9d06e3731e61" -d '{"events": [{"server_uuid": "b521a440-0384-48fc-aaa9-13419003343e", "name": "network-vif-deleted", "tag": "0ef815c5-fc54-4d19-b139-1eaa75cffde2"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:07.074235 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e325e30c-e651-4c3d-aaf9-c43f30f6270e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:07.122131 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e325e30c-e651-4c3d-aaf9-c43f30f6270e admin admin] Releasing vlan 121 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:28:07.122814 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e325e30c-e651-4c3d-aaf9-c43f30f6270e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:28:07.139899 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:28:07.204232 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a344613-4080-4a48-84fb-f5ea2fa2c87b req-539b3ffd-5c23-418f-b16e-a70fd357f410 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:07.205834 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0a344613-4080-4a48-84fb-f5ea2fa2c87b req-539b3ffd-5c23-418f-b16e-a70fd357f410 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4496005 Dec 09 21:28:07.207877 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3c8115e-e2bb-4769-845e-16fd771c3c49 req-c74acc19-18ec-4f6e-9fd7-650b7f4fef36 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:07.209462 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d3c8115e-e2bb-4769-845e-16fd771c3c49 req-c74acc19-18ec-4f6e-9fd7-650b7f4fef36 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=9ca15fab17f34cc58f1ad1fcedc1bf31&device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 1097 time: 0.3301351 Dec 09 21:28:07.390004 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15ccc274-734f-453a-9688-4bdb6b3f16a0 req-a590ae5d-9fa2-4331-81c5-c183a5ab790f tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.0732942 Dec 09 21:28:07.469106 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3e4745f6-862e-4fe3-8eb5-757c08cc13dd None None] Network a133a939-2827-4fe6-81f5-14715631c0ec requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:28:07.510588 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3c8115e-e2bb-4769-845e-16fd771c3c49 req-cfe33438-ecf0-4d75-aa9f-0ecb128498f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:07.512332 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d3c8115e-e2bb-4769-845e-16fd771c3c49 req-cfe33438-ecf0-4d75-aa9f-0ecb128498f8 service neutron] 10.222.0.31 "GET /v2.0/networks?id=e7d3d836-ebe9-4e03-af4b-235dd5e5cbea HTTP/1.1" status: 200 len: 912 time: 0.2039816 Dec 09 21:28:07.544174 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e325e30c-e651-4c3d-aaf9-c43f30f6270e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:07.621996 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e325e30c-e651-4c3d-aaf9-c43f30f6270e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:07.638298 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e325e30c-e651-4c3d-aaf9-c43f30f6270e admin admin] 10.222.0.13 "DELETE /v2.0/networks/de91a458-cde4-4265-8605-31d9b6f8f05f HTTP/1.1" status: 204 len: 168 time: 1.5379577 Dec 09 21:28:07.638298 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d3c8115e-e2bb-4769-845e-16fd771c3c49 req-74c2b399-40eb-44dd-9569-689cd481acfb service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=5fd1ab85-a36a-49d7-924f-21a52601dc1e HTTP/1.1" status: 200 len: 217 time: 0.1170642 Dec 09 21:28:07.655320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41284) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:07.666786 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-40655006-8cbf-4486-a558-017a3e2d7150 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1521113110', 'description': 'tempest-description--755457283'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:07.684916 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e56f3deb-f06f-4712-8ada-f08de80bc3a6 req-4f7621f6-e3ee-42ca-aaf9-343a59c6b1fc tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=b521a440-0384-48fc-aaa9-13419003343e HTTP/1.1" status: 200 len: 210 time: 0.1053526 Dec 09 21:28:07.763294 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e325e30c-e651-4c3d-aaf9-c43f30f6270e admin admin] Pushing event deleted for resources: {'Network': ['ID=de91a458-cde4-4265-8605-31d9b6f8f05f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:07.892340 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-40655006-8cbf-4486-a558-017a3e2d7150 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:07.895914 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3c8115e-e2bb-4769-845e-16fd771c3c49 req-58c175a9-7d55-4b73-97f4-953b43edd25f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:07.897761 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d3c8115e-e2bb-4769-845e-16fd771c3c49 req-58c175a9-7d55-4b73-97f4-953b43edd25f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a84d1123-6651-4f35-9cba-4f9c8f45aab6 HTTP/1.1" status: 200 len: 851 time: 0.1551316 Dec 09 21:28:07.912109 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:07.950858 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad4934dc-25ab-483d-888a-bc51b2e4d23b req-270b74b1-26b1-49c9-a7a7-b63bf6b3416e tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:07.959282 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ad4934dc-25ab-483d-888a-bc51b2e4d23b req-270b74b1-26b1-49c9-a7a7-b63bf6b3416e tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 945 time: 0.1205201 Dec 09 21:28:07.981540 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d3c8115e-e2bb-4769-845e-16fd771c3c49 req-e75ea9da-3c59-42f7-9e85-bde4c6b1d1df service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e7d3d836-ebe9-4e03-af4b-235dd5e5cbea&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0563960 Dec 09 21:28:08.101089 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-415d4964-f856-4dfd-a993-9c010573142c x-openstack-request-id: req-415d4964-f856-4dfd-a993-9c010573142c {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:08.101535 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b521a440-0384-48fc-aaa9-13419003343e", "name": "network-vif-deleted", "tag": "0ef815c5-fc54-4d19-b139-1eaa75cffde2", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:08.101643 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-415d4964-f856-4dfd-a993-9c010573142c {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:08.102040 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b521a440-0384-48fc-aaa9-13419003343e', 'name': 'network-vif-deleted', 'tag': '0ef815c5-fc54-4d19-b139-1eaa75cffde2', 'status': 'completed', 'code': 200} Dec 09 21:28:08.126988 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f2c3d2bf-a573-42fa-a7b9-95dee2f759e5 None None] Provisioning complete for port 1e946a47-f496-445b-964b-618881eab263 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:08.129229 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ad4934dc-25ab-483d-888a-bc51b2e4d23b req-c40361b8-133a-4567-8b36-ed6d0cdc28f3 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1616209 Dec 09 21:28:08.130703 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41290) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:08.144299 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f2c3d2bf-a573-42fa-a7b9-95dee2f759e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:08.227070 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 597635f0-9f73-4c25-9ef3-19098dd68e58, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=597635f0-9f73-4c25-9ef3-19098dd68e58,segment=NetworkSegment(8ca86951-e612-4db0-90f4-834b52fd24e0),segment_id=8ca86951-e612-4db0-90f4-834b52fd24e0)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:08.237200 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f2c3d2bf-a573-42fa-a7b9-95dee2f759e5 None None] Port 1e946a47-f496-445b-964b-618881eab263 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:28:08.277383 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fabe125b-a385-4121-9633-2f0cd0c5342e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=5635fb0018b24f538b250cdac6dca9d9&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1413012 Dec 09 21:28:08.283840 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41292) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:08.285288 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:08.294499 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-40655006-8cbf-4486-a558-017a3e2d7150 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:08.297238 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d3c8115e-e2bb-4769-845e-16fd771c3c49 req-87460790-8cc6-41d3-90bf-f5e07f43cd88 service neutron] 10.222.0.31 "GET /v2.0/networks/e7d3d836-ebe9-4e03-af4b-235dd5e5cbea?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3050444 Dec 09 21:28:08.302724 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-40655006-8cbf-4486-a558-017a3e2d7150 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:08.313132 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:08.313939 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 733d9248-a81b-4611-8784-329c6a7090a3 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:28:08.360244 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d29e3e4f-7278-4e21-8358-b5efab8098db req-33010c82-435b-428d-ab30-ccdf673fd4b3 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:08.382470 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d29e3e4f-7278-4e21-8358-b5efab8098db req-33010c82-435b-428d-ab30-ccdf673fd4b3 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 945 time: 0.2867718 Dec 09 21:28:08.388614 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-40655006-8cbf-4486-a558-017a3e2d7150 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:08.392561 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-40655006-8cbf-4486-a558-017a3e2d7150 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1798 time: 0.7325013 Dec 09 21:28:08.404302 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41294) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:08.442768 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-3eb015a4-dead-4432-a2dc-5695c2898112 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Request body: {'security_group_rule': {'security_group_id': '7eb72df0-7940-41d2-b7f8-e0c3cff1ced2', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:08.469445 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d1ee76b-15a1-447d-835b-5a32d0d180c4 req-94819b2a-54b5-4c86-8b79-8acc06968244 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:08.475101 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40655006-8cbf-4486-a558-017a3e2d7150 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:08.492621 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5d1ee76b-15a1-447d-835b-5a32d0d180c4 req-94819b2a-54b5-4c86-8b79-8acc06968244 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 946 time: 0.2610564 Dec 09 21:28:08.568937 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5d1ee76b-15a1-447d-835b-5a32d0d180c4 req-1d4b2158-55cd-49c9-8a39-4e421918132b tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0738223 Dec 09 21:28:08.596079 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d29e3e4f-7278-4e21-8358-b5efab8098db req-35c717ae-0fad-49a7-9e0e-5fcce75775d2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2112224 Dec 09 21:28:08.618712 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 0ef815c5-fc54-4d19-b139-1eaa75cffde2 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:28:08.624438 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4b06a952-5b66-4bfe-bbb8-23405c98bdad admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:08.662487 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=597635f0-9f73-4c25-9ef3-19098dd68e58,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:08.667362 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d3c8115e-e2bb-4769-845e-16fd771c3c49 req-7da36d9f-ae1a-414d-bb61-278beebf2170 service neutron] 10.222.0.31 "GET /v2.0/networks/e7d3d836-ebe9-4e03-af4b-235dd5e5cbea?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3556638 Dec 09 21:28:08.667879 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4b06a952-5b66-4bfe-bbb8-23405c98bdad admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:08.725356 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 0ef815c5-fc54-4d19-b139-1eaa75cffde2 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:28:08.725863 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 0ef815c5-fc54-4d19-b139-1eaa75cffde2 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:28:08.727475 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5e1624ff-36e7-42ee-b93c-3c551bb6667f None None] Provisioning complete for port 597635f0-9f73-4c25-9ef3-19098dd68e58 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:08.727989 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5e1624ff-36e7-42ee-b93c-3c551bb6667f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:08.741403 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3eb015a4-dead-4432-a2dc-5695c2898112 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:08.856499 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4b06a952-5b66-4bfe-bbb8-23405c98bdad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:08.859586 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4b06a952-5b66-4bfe-bbb8-23405c98bdad admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:08.860794 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4b06a952-5b66-4bfe-bbb8-23405c98bdad admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9 HTTP/1.1" status: 204 len: 168 time: 0.5540576 Dec 09 21:28:08.876367 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-372ccae1-d202-4d23-91c6-ca460ece4464 req-350b7e40-787a-4a71-816e-b0db1ecd1108 tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.13 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.0966048 Dec 09 21:28:08.910338 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b06a952-5b66-4bfe-bbb8-23405c98bdad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=18371a39-0edc-4a3f-a6ae-b3dbcc7f8ab9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:08.922874 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3eb015a4-dead-4432-a2dc-5695c2898112 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:08.928053 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0a344613-4080-4a48-84fb-f5ea2fa2c87b req-5c557c26-57de-4933-bf5a-73ea5ae982f4 tempest-ServerShowV254Test-346878007 tempest-ServerShowV254Test-346878007-project] 10.222.0.10 "GET /v2.0/ports?device_id=21636816-5615-45ba-b78a-d61e1c728418 HTTP/1.1" status: 200 len: 210 time: 0.3173172 Dec 09 21:28:08.930470 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3eb015a4-dead-4432-a2dc-5695c2898112 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:08.967175 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eb015a4-dead-4432-a2dc-5695c2898112 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7ff51ed6-397b-4037-ac81-96fa5cac5a6c,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:09.007611 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3eb015a4-dead-4432-a2dc-5695c2898112 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:09.010883 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3eb015a4-dead-4432-a2dc-5695c2898112 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5750875 Dec 09 21:28:09.013747 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41310) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:09.018546 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-0eb7432c-9608-4577-9039-afcb606ae776 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Request body: {'security_group_rule': {'security_group_id': '7eb72df0-7940-41d2-b7f8-e0c3cff1ced2', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:09.023236 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 733d9248-a81b-4611-8784-329c6a7090a3 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:09.023635 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:09.087145 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0eb7432c-9608-4577-9039-afcb606ae776 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:09.200193 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0eb7432c-9608-4577-9039-afcb606ae776 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:09.214800 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0eb7432c-9608-4577-9039-afcb606ae776 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:09.384399 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e8685c4-82d9-4b60-88aa-f7d109161080 req-aff10fa2-0844-4c0a-8bce-62cbdedf501f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:09.386409 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2e8685c4-82d9-4b60-88aa-f7d109161080 req-aff10fa2-0844-4c0a-8bce-62cbdedf501f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.31 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 946 time: 0.1075389 Dec 09 21:28:09.413521 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0eb7432c-9608-4577-9039-afcb606ae776 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1c4a96d7-6962-4d73-98ad-592efa910561,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:09.445503 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5e1624ff-36e7-42ee-b93c-3c551bb6667f None None] Provisioning complete for port 145a0cde-0fe5-4163-a063-0fdfe42f243b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:09.445821 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5e1624ff-36e7-42ee-b93c-3c551bb6667f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:09.459519 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0eb7432c-9608-4577-9039-afcb606ae776 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:09.463847 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0eb7432c-9608-4577-9039-afcb606ae776 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4458814 Dec 09 21:28:09.466360 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41318) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:09.504757 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-4ccf673a-8057-462e-9b66-bcd4dcfaa20b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:09.507835 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-5e1624ff-36e7-42ee-b93c-3c551bb6667f None None] Port 145a0cde-0fe5-4163-a063-0fdfe42f243b cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:28:09.551260 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac9590e4-1a9d-49f2-8960-31f6d156181c req-2b50e578-7853-4872-9844-5ebbb1111bdb tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:09.562955 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac9590e4-1a9d-49f2-8960-31f6d156181c req-2b50e578-7853-4872-9844-5ebbb1111bdb tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=a45aee8c-1ead-4182-81dd-72688d980ba4 HTTP/1.1" status: 200 len: 950 time: 0.3035920 Dec 09 21:28:09.587995 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-2e8685c4-82d9-4b60-88aa-f7d109161080 req-6df2af9a-7434-4c4f-82d0-1f1b6634988a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Deleting port a6dac932-4c7b-404f-a089-32576a768d83 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:28:09.588603 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2e8685c4-82d9-4b60-88aa-f7d109161080 req-6df2af9a-7434-4c4f-82d0-1f1b6634988a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:09.651172 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 597635f0-9f73-4c25-9ef3-19098dd68e58 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:28:09.666348 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f04a6e8a-b703-4349-875c-a98bc8553fcb req-78b14c05-8df9-40b1-8be6-7c0db0b44dca tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:09.680873 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f04a6e8a-b703-4349-875c-a98bc8553fcb req-78b14c05-8df9-40b1-8be6-7c0db0b44dca tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 945 time: 0.4523754 Dec 09 21:28:09.694531 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-2e8685c4-82d9-4b60-88aa-f7d109161080 req-6df2af9a-7434-4c4f-82d0-1f1b6634988a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] For port a6dac932-4c7b-404f-a089-32576a768d83, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a6dac932-4c7b-404f-a089-32576a768d83,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:09.694900 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2e8685c4-82d9-4b60-88aa-f7d109161080 req-6df2af9a-7434-4c4f-82d0-1f1b6634988a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:09.712228 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-2e8685c4-82d9-4b60-88aa-f7d109161080 req-6df2af9a-7434-4c4f-82d0-1f1b6634988a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Calling delete_port for a6dac932-4c7b-404f-a089-32576a768d83 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:28:09.727152 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac9590e4-1a9d-49f2-8960-31f6d156181c req-66bfd6a3-f709-40aa-8f12-a2ae80767928 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1631994 Dec 09 21:28:09.728217 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4ccf673a-8057-462e-9b66-bcd4dcfaa20b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:09.781425 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:09.815180 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f04a6e8a-b703-4349-875c-a98bc8553fcb req-5da61644-24b2-42ed-9196-1af9ff3a6cd9 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1333094 Dec 09 21:28:09.838460 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-cfc478d4-c7e5-49a1-82b2-de777b49346f None None] Provisioning complete for port 597635f0-9f73-4c25-9ef3-19098dd68e58 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:09.840719 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cfc478d4-c7e5-49a1-82b2-de777b49346f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:09.925808 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 597635f0-9f73-4c25-9ef3-19098dd68e58 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:09.926205 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:09.965267 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2e8685c4-82d9-4b60-88aa-f7d109161080 req-6df2af9a-7434-4c4f-82d0-1f1b6634988a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:10.004801 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6df2af9a-7434-4c4f-82d0-1f1b6634988a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Pushing event deleted for resources: {'Port': ['ID=a6dac932-4c7b-404f-a089-32576a768d83,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:10.047114 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d53849e6-0fd9-4ef5-8c54-11f97ffe38a3 req-10ee50c5-c1c4-4a85-b65c-101ac406f913 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:10.055579 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d53849e6-0fd9-4ef5-8c54-11f97ffe38a3 req-10ee50c5-c1c4-4a85-b65c-101ac406f913 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9370050-6da6-47ee-8b58-2b96e64a02fc HTTP/1.1" status: 200 len: 867 time: 0.1647127 Dec 09 21:28:10.071361 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-2e8685c4-82d9-4b60-88aa-f7d109161080 req-6df2af9a-7434-4c4f-82d0-1f1b6634988a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] No DVR routers for this DVR port a6dac932-4c7b-404f-a089-32576a768d83 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:28:10.074347 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2e8685c4-82d9-4b60-88aa-f7d109161080 req-6df2af9a-7434-4c4f-82d0-1f1b6634988a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:10.078792 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2e8685c4-82d9-4b60-88aa-f7d109161080 req-6df2af9a-7434-4c4f-82d0-1f1b6634988a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.31 "DELETE /v2.0/ports/a6dac932-4c7b-404f-a089-32576a768d83 HTTP/1.1" status: 204 len: 173 time: 0.6848700 Dec 09 21:28:10.079424 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f9370050-6da6-47ee-8b58-2b96e64a02fc', 'name': 'network-vif-deleted', 'tag': 'a6dac932-4c7b-404f-a089-32576a768d83'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:10.082514 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-67934990-baee-4ed3-b629-d164aae1bf13" -d '{"events": [{"server_uuid": "f9370050-6da6-47ee-8b58-2b96e64a02fc", "name": "network-vif-deleted", "tag": "a6dac932-4c7b-404f-a089-32576a768d83"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:10.107615 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35c7de95-7eb8-4565-9d2e-eed5c5a4c4bc req-ea58b050-a06d-44c0-819a-38b28fea670b tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:10.115528 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35c7de95-7eb8-4565-9d2e-eed5c5a4c4bc req-ea58b050-a06d-44c0-819a-38b28fea670b tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 945 time: 0.1524248 Dec 09 21:28:10.165365 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4ccf673a-8057-462e-9b66-bcd4dcfaa20b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:10.276402 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35c7de95-7eb8-4565-9d2e-eed5c5a4c4bc req-a38db413-cc66-4792-bf66-91225084a32d tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1598127 Dec 09 21:28:10.281751 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d53849e6-0fd9-4ef5-8c54-11f97ffe38a3 req-58d5afe6-6eb3-4414-9437-c38c07eaa54f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2241263 Dec 09 21:28:10.328365 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41346) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:10.368705 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e57829b9-2580-4957-ba0a-bda494b4c406 x-openstack-request-id: req-e57829b9-2580-4957-ba0a-bda494b4c406 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:10.369004 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f9370050-6da6-47ee-8b58-2b96e64a02fc", "name": "network-vif-deleted", "tag": "a6dac932-4c7b-404f-a089-32576a768d83", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:10.369256 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e57829b9-2580-4957-ba0a-bda494b4c406 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:10.369649 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f9370050-6da6-47ee-8b58-2b96e64a02fc', 'name': 'network-vif-deleted', 'tag': 'a6dac932-4c7b-404f-a089-32576a768d83', 'status': 'completed', 'code': 200} Dec 09 21:28:10.409881 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-4ccf673a-8057-462e-9b66-bcd4dcfaa20b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Allocated IP 172.25.3.134 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/1ac7a7b1-7d92-471a-a03b-8b88ff10b0aa) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:10.555421 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4ccf673a-8057-462e-9b66-bcd4dcfaa20b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:10.568100 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-9405779d-3e17-4d64-ab15-0c0d77533991 admin admin] Request body: {'network': {'name': 'tempest-SecurityGroupsNegativeTestJSON-987926988-network', 'tenant_id': '6461e253db534e9981d6b9bd1c31363f'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:10.606324 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4ccf673a-8057-462e-9b66-bcd4dcfaa20b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:10.638681 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9405779d-3e17-4d64-ab15-0c0d77533991 admin admin] Made reservation on behalf of 6461e253db534e9981d6b9bd1c31363f for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:10.650409 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9405779d-3e17-4d64-ab15-0c0d77533991 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:10.660624 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4ccf673a-8057-462e-9b66-bcd4dcfaa20b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:10.665008 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-4ccf673a-8057-462e-9b66-bcd4dcfaa20b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:10.669593 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ccf673a-8057-462e-9b66-bcd4dcfaa20b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:10.694956 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9405779d-3e17-4d64-ab15-0c0d77533991 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:10.702931 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ccf673a-8057-462e-9b66-bcd4dcfaa20b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event updated for resources: {'Port': ['ID=1ac7a7b1-7d92-471a-a03b-8b88ff10b0aa,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:10.729767 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d140a738-1ee2-44a3-b5e5-dd64c38ac1c8 req-19dd75e3-c932-4f19-b1ab-b3c973013b6b tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:10.731747 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d140a738-1ee2-44a3-b5e5-dd64c38ac1c8 req-19dd75e3-c932-4f19-b1ab-b3c973013b6b tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.10 "GET /v2.0/ports?device_id=a45aee8c-1ead-4182-81dd-72688d980ba4 HTTP/1.1" status: 200 len: 950 time: 0.1430714 Dec 09 21:28:10.822099 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41356) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:10.881491 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4ccf673a-8057-462e-9b66-bcd4dcfaa20b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:10.975098 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8ae6ccc-519c-4c40-bf07-2c902d5c3a36 req-e8999adb-6928-4b49-8c27-ece8e7884a9c tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:10.976609 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9405779d-3e17-4d64-ab15-0c0d77533991 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:10.977082 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a8ae6ccc-519c-4c40-bf07-2c902d5c3a36 req-e8999adb-6928-4b49-8c27-ece8e7884a9c tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=a45aee8c-1ead-4182-81dd-72688d980ba4 HTTP/1.1" status: 200 len: 950 time: 0.1303630 Dec 09 21:28:10.978881 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4ccf673a-8057-462e-9b66-bcd4dcfaa20b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:11.002113 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9405779d-3e17-4d64-ab15-0c0d77533991 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:11.050296 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9405779d-3e17-4d64-ab15-0c0d77533991 admin admin] vlan segment allocate from pool success with {'vlan_id': 128, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:28:11.062169 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9405779d-3e17-4d64-ab15-0c0d77533991 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a75544ea-bc78-4b70-9d01-c8e6f7dc224d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:11.074757 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9405779d-3e17-4d64-ab15-0c0d77533991 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:11.075102 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-9405779d-3e17-4d64-ab15-0c0d77533991 admin admin] Added segment b8767565-da80-43d4-b04b-2d0055e64978 of type vlan for network aeb2bab7-ff50-46a7-b05d-e305ec6eab66 Dec 09 21:28:11.086823 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-d140a738-1ee2-44a3-b5e5-dd64c38ac1c8 req-87d4f8c6-d297-4fca-af62-edcddbb345b0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Deleting port c3c31744-0580-4d09-863d-697769f7c0ee {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:28:11.087034 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d140a738-1ee2-44a3-b5e5-dd64c38ac1c8 req-87d4f8c6-d297-4fca-af62-edcddbb345b0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:11.108027 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea975b9d-8466-490f-a2c0-e2abacf85134 req-28611414-e1b9-4fca-9006-adee06ac9908 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:11.111208 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea975b9d-8466-490f-a2c0-e2abacf85134 req-28611414-e1b9-4fca-9006-adee06ac9908 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 945 time: 0.1826587 Dec 09 21:28:11.136179 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a8ae6ccc-519c-4c40-bf07-2c902d5c3a36 req-87ffc007-6990-4469-97d0-75cc170c7620 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1496844 Dec 09 21:28:11.162477 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e027534e-c1ef-45c3-915e-59b068b0046a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:11.184411 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9405779d-3e17-4d64-ab15-0c0d77533991 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:11.279499 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9405779d-3e17-4d64-ab15-0c0d77533991 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:11.280638 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9405779d-3e17-4d64-ab15-0c0d77533991 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:11.281296 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9405779d-3e17-4d64-ab15-0c0d77533991 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:11.299651 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea975b9d-8466-490f-a2c0-e2abacf85134 req-ca0e2fe6-32fb-4f12-a85c-78b0d3cbcee2 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1772914 Dec 09 21:28:11.317566 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-d140a738-1ee2-44a3-b5e5-dd64c38ac1c8 req-87d4f8c6-d297-4fca-af62-edcddbb345b0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] For port c3c31744-0580-4d09-863d-697769f7c0ee, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=c3c31744-0580-4d09-863d-697769f7c0ee,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:11.317938 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d140a738-1ee2-44a3-b5e5-dd64c38ac1c8 req-87d4f8c6-d297-4fca-af62-edcddbb345b0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:11.339952 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-d140a738-1ee2-44a3-b5e5-dd64c38ac1c8 req-87d4f8c6-d297-4fca-af62-edcddbb345b0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Calling delete_port for c3c31744-0580-4d09-863d-697769f7c0ee owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:28:11.360855 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9405779d-3e17-4d64-ab15-0c0d77533991 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 893 time: 1.0286822 Dec 09 21:28:11.362568 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41368) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:11.367692 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-ee5ccde8-332b-48a4-9cca-02fff7b92fb0 admin admin] Request body: {'subnet': {'network_id': 'aeb2bab7-ff50-46a7-b05d-e305ec6eab66', 'cidr': '172.20.0.0/28', 'name': 'tempest-SecurityGroupsNegativeTestJSON-987926988-subnet', 'tenant_id': '6461e253db534e9981d6b9bd1c31363f', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:11.411041 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9405779d-3e17-4d64-ab15-0c0d77533991 admin admin] Pushing event updated for resources: {'Network': ['ID=aeb2bab7-ff50-46a7-b05d-e305ec6eab66,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:11.423004 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network aeb2bab7-ff50-46a7-b05d-e305ec6eab66 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:28:11.440439 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4ccf673a-8057-462e-9b66-bcd4dcfaa20b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:11.457499 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e027534e-c1ef-45c3-915e-59b068b0046a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:11.461703 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4ccf673a-8057-462e-9b66-bcd4dcfaa20b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:11.464022 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ee5ccde8-332b-48a4-9cca-02fff7b92fb0 admin admin] Made reservation on behalf of 6461e253db534e9981d6b9bd1c31363f for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:11.466621 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee5ccde8-332b-48a4-9cca-02fff7b92fb0 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:11.478689 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e027534e-c1ef-45c3-915e-59b068b0046a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:11.582851 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device a6dac932-4c7b-404f-a089-32576a768d83 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:28:11.614303 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: a6dac932-4c7b-404f-a089-32576a768d83 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:28:11.614641 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device a6dac932-4c7b-404f-a089-32576a768d83 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:28:11.633737 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d140a738-1ee2-44a3-b5e5-dd64c38ac1c8 req-87d4f8c6-d297-4fca-af62-edcddbb345b0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:11.648323 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['fd466da6-f506-43e6-9800-156622bd2781', 'c3c31744-0580-4d09-863d-697769f7c0ee'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:28:11.653574 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['18bda486-9d6d-41a3-a260-dd244a3838b3', '2958b0be-15e5-48e2-b87a-6ffefd9a7859', '1ad36983-4549-4a03-a826-a31a08b98c98', '07457883-17db-4553-8f10-716e04bc16b1'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:28:11.732161 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-d140a738-1ee2-44a3-b5e5-dd64c38ac1c8 req-87d4f8c6-d297-4fca-af62-edcddbb345b0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] No DVR routers for this DVR port c3c31744-0580-4d09-863d-697769f7c0ee on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:28:11.734550 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87d4f8c6-d297-4fca-af62-edcddbb345b0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Pushing event deleted for resources: {'Port': ['ID=c3c31744-0580-4d09-863d-697769f7c0ee,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:11.737295 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d140a738-1ee2-44a3-b5e5-dd64c38ac1c8 req-87d4f8c6-d297-4fca-af62-edcddbb345b0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:11.741771 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d140a738-1ee2-44a3-b5e5-dd64c38ac1c8 req-87d4f8c6-d297-4fca-af62-edcddbb345b0 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.10 "DELETE /v2.0/ports/c3c31744-0580-4d09-863d-697769f7c0ee HTTP/1.1" status: 204 len: 173 time: 0.9575238 Dec 09 21:28:11.922504 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e027534e-c1ef-45c3-915e-59b068b0046a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=54a2288281d94f2e97ddb6d56d76df9f&name=default HTTP/1.1" status: 200 len: 3000 time: 1.0978673 Dec 09 21:28:11.925781 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41382) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:11.942836 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a339948d-e9de-417e-bb71-4d62434cc516 req-5a840671-b1de-4b05-bfc5-e8922cbf08f8 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:11.944283 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a339948d-e9de-417e-bb71-4d62434cc516 req-5a840671-b1de-4b05-bfc5-e8922cbf08f8 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 945 time: 0.5468693 Dec 09 21:28:11.950733 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ccf673a-8057-462e-9b66-bcd4dcfaa20b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event updated for resources: {'Port': ['ID=1ac7a7b1-7d92-471a-a03b-8b88ff10b0aa,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:11.953266 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e027534e-c1ef-45c3-915e-59b068b0046a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eed0942a-4bd6-4613-8e05-91a50dda006b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:12.040899 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4ccf673a-8057-462e-9b66-bcd4dcfaa20b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:12.059600 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fef43522-55f0-4955-b03c-e7a54bb8e555 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:12.102822 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fef43522-55f0-4955-b03c-e7a54bb8e555 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:12.123697 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4ccf673a-8057-462e-9b66-bcd4dcfaa20b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:12.134980 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4ccf673a-8057-462e-9b66-bcd4dcfaa20b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 2.6615868 Dec 09 21:28:12.202726 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a339948d-e9de-417e-bb71-4d62434cc516 req-6fa39cd5-4762-489e-9fe0-0a12cc768df6 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2327528 Dec 09 21:28:12.234158 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fef43522-55f0-4955-b03c-e7a54bb8e555 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:12.245342 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fef43522-55f0-4955-b03c-e7a54bb8e555 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:12.246535 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fef43522-55f0-4955-b03c-e7a54bb8e555 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/eed0942a-4bd6-4613-8e05-91a50dda006b HTTP/1.1" status: 204 len: 168 time: 0.3194175 Dec 09 21:28:12.268746 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fef43522-55f0-4955-b03c-e7a54bb8e555 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eed0942a-4bd6-4613-8e05-91a50dda006b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:12.362106 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-44e0e127-5a57-4ec4-a84a-198284ac831a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:12.370583 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a45aee8c-1ead-4182-81dd-72688d980ba4', 'name': 'network-vif-deleted', 'tag': 'c3c31744-0580-4d09-863d-697769f7c0ee'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:12.373171 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e45777d8-e915-4207-8fb8-e5cdcaa6e138" -d '{"events": [{"server_uuid": "a45aee8c-1ead-4182-81dd-72688d980ba4", "name": "network-vif-deleted", "tag": "c3c31744-0580-4d09-863d-697769f7c0ee"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:12.376689 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-44e0e127-5a57-4ec4-a84a-198284ac831a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/networks?id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb HTTP/1.1" status: 200 len: 812 time: 0.4579029 Dec 09 21:28:12.521280 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6ebfa8e-a2e4-4a08-b197-f91f4cab1edd req-7d6fa599-0dae-416c-b187-d97fef4658b5 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=a45aee8c-1ead-4182-81dd-72688d980ba4 HTTP/1.1" status: 200 len: 210 time: 0.0905416 Dec 09 21:28:12.525776 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-51d17ff4-0b98-469f-a14d-39eb97feba98 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/quotas/1b7916b634f74760a565cfeaef510cd9 HTTP/1.1" status: 200 len: 375 time: 0.1482198 Dec 09 21:28:12.608866 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-838c4ad2-ec0b-474c-b549-25aaf809723e tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=1b7916b634f74760a565cfeaef510cd9&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0726783 Dec 09 21:28:12.706957 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee5ccde8-332b-48a4-9cca-02fff7b92fb0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:12.788103 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c2dbea5-383f-4b53-b8d4-0791e0f7a33c req-3acf4e95-adce-47d0-84de-383027c2e329 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:12.789651 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4c2dbea5-383f-4b53-b8d4-0791e0f7a33c req-3acf4e95-adce-47d0-84de-383027c2e329 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 945 time: 0.1841536 Dec 09 21:28:12.817849 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4f4a5ce-2991-4ad7-8c96-9e73b03f9d97 req-20b03781-4ecf-4ccb-9e5c-8c95f9ba4c32 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=2cfba12a-761e-445b-bf14-a19d38aeeeb0&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0593264 Dec 09 21:28:12.855750 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee5ccde8-332b-48a4-9cca-02fff7b92fb0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3d20ff35-e2da-461d-8fb6-7371c8a75965,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:12.873775 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-400ed5e5-bea9-4958-8092-ea4ca6c2acf3 service neutron] 10.222.0.13 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2426026 Dec 09 21:28:12.895244 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4f4a5ce-2991-4ad7-8c96-9e73b03f9d97 req-28d11c9e-34b5-408d-86e0-d44e3d791604 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:12.896844 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4f4a5ce-2991-4ad7-8c96-9e73b03f9d97 req-28d11c9e-34b5-408d-86e0-d44e3d791604 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&device_id=2cfba12a-761e-445b-bf14-a19d38aeeeb0 HTTP/1.1" status: 200 len: 1102 time: 0.0522451 Dec 09 21:28:12.912326 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee5ccde8-332b-48a4-9cca-02fff7b92fb0 admin admin] Checking segment: {'id': 'b8767565-da80-43d4-b04b-2d0055e64978', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'aeb2bab7-ff50-46a7-b05d-e305ec6eab66'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:12.912696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee5ccde8-332b-48a4-9cca-02fff7b92fb0 admin admin] Network hostable DHCP agents. Network: aeb2bab7-ff50-46a7-b05d-e305ec6eab66, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:28:12.972135 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4c2dbea5-383f-4b53-b8d4-0791e0f7a33c req-ca0e84c3-e32d-4f61-a088-63ee2cc53b52 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1711807 Dec 09 21:28:13.017454 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee5ccde8-332b-48a4-9cca-02fff7b92fb0 admin admin] Network aeb2bab7-ff50-46a7-b05d-e305ec6eab66 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:28:13.020734 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4f4a5ce-2991-4ad7-8c96-9e73b03f9d97 req-8269a866-d657-4e5c-a097-9a98bcf56bcb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:13.022319 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4f4a5ce-2991-4ad7-8c96-9e73b03f9d97 req-8269a866-d657-4e5c-a097-9a98bcf56bcb service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.1034315 Dec 09 21:28:13.028613 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-083bb130-b98d-409d-800a-22b49b87ca28 service neutron] 10.222.0.13 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1545236 Dec 09 21:28:13.033487 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-699b5cf9-dc38-479d-9da6-651b801a053e x-openstack-request-id: req-699b5cf9-dc38-479d-9da6-651b801a053e {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:13.033776 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a45aee8c-1ead-4182-81dd-72688d980ba4", "name": "network-vif-deleted", "tag": "c3c31744-0580-4d09-863d-697769f7c0ee", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:13.034029 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-699b5cf9-dc38-479d-9da6-651b801a053e {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:13.034470 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a45aee8c-1ead-4182-81dd-72688d980ba4', 'name': 'network-vif-deleted', 'tag': 'c3c31744-0580-4d09-863d-697769f7c0ee', 'status': 'completed', 'code': 200} Dec 09 21:28:13.038013 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-ee5ccde8-332b-48a4-9cca-02fff7b92fb0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, aeb2bab7-ff50-46a7-b05d-e305ec6eab66) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:13.043815 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee5ccde8-332b-48a4-9cca-02fff7b92fb0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:13.046000 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee5ccde8-332b-48a4-9cca-02fff7b92fb0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:13.052699 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ec7ec91-f522-4994-86b1-ea885d761ba7 None None] Network aeb2bab7-ff50-46a7-b05d-e305ec6eab66 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:28:13.081358 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ee5ccde8-332b-48a4-9cca-02fff7b92fb0 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 857 time: 1.7173069 Dec 09 21:28:13.100870 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4f4a5ce-2991-4ad7-8c96-9e73b03f9d97 req-bc1c6683-a2de-4796-8303-32dc2b045bac service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.253&port_id=1ad36983-4549-4a03-a826-a31a08b98c98 HTTP/1.1" status: 200 len: 217 time: 0.0655000 Dec 09 21:28:13.230075 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4f4a5ce-2991-4ad7-8c96-9e73b03f9d97 req-b6b719ad-68e7-43aa-bedb-ed07527eb41d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:13.234092 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4f4a5ce-2991-4ad7-8c96-9e73b03f9d97 req-b6b719ad-68e7-43aa-bedb-ed07527eb41d service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1245201 Dec 09 21:28:13.260781 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7b707854-6cc3-4373-91d7-9bb46f354379 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-securitygroup--1521113110&fields=id&tenant_id=03e962eb7f5e4325a7c08c8b1e2a4cea HTTP/1.1" status: 200 len: 267 time: 0.0943401 Dec 09 21:28:13.270238 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32f67bcd-0ede-41c0-95be-963c74a4e328 None None] Network aeb2bab7-ff50-46a7-b05d-e305ec6eab66 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:28:13.321595 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41440) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:13.340043 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4f4a5ce-2991-4ad7-8c96-9e73b03f9d97 req-18f43c55-6c68-40f7-a462-bc139180778f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:13.341623 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4f4a5ce-2991-4ad7-8c96-9e73b03f9d97 req-18f43c55-6c68-40f7-a462-bc139180778f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1004109 Dec 09 21:28:13.372012 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e32d842b-9b56-48c8-97bc-03c3a6ee91cc tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:13.381674 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e32d842b-9b56-48c8-97bc-03c3a6ee91cc tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports/1e946a47-f496-445b-964b-618881eab263 HTTP/1.1" status: 200 len: 930 time: 0.1191440 Dec 09 21:28:13.386834 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c3dd3561-6479-4e11-b3c2-d78b1cecf077 req-ad66094e-3c11-402c-bd71-9dd8bc72cfff tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=3e0505b6-bf4a-4e37-aacd-7600f6833c41 HTTP/1.1" status: 200 len: 210 time: 0.0845194 Dec 09 21:28:13.431533 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-44205db3-88e4-4e07-b80e-01c783798efd tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:13.439038 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-44205db3-88e4-4e07-b80e-01c783798efd tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports/145a0cde-0fe5-4163-a063-0fdfe42f243b HTTP/1.1" status: 200 len: 931 time: 0.0559795 Dec 09 21:28:13.510212 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4f4a5ce-2991-4ad7-8c96-9e73b03f9d97 req-26fb6e71-a746-44e7-b8c0-d98db629068a service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1602988 Dec 09 21:28:13.520701 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-29bbb526-4847-41d1-9914-8105bca17d12 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-236206179-network', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:13.562621 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-2f99a3de-c595-46b7-aaae-514377e2b47b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?network_id=a133a939-2827-4fe6-81f5-14715631c0ec&fixed_ips=ip_address%3D10.2.2.100&fields=device_id HTTP/1.1" status: 200 len: 210 time: 0.1226332 Dec 09 21:28:13.602314 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-fe59fc8e-a714-4c92-a856-172a1d79be75 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?network_id=a133a939-2827-4fe6-81f5-14715631c0ec&fixed_ips=ip_address%3D10.2.2.200&fields=device_id HTTP/1.1" status: 200 len: 210 time: 0.0306375 Dec 09 21:28:13.617334 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-29bbb526-4847-41d1-9914-8105bca17d12 admin admin] Made reservation on behalf of 29f2c1d9be9348b0888bc61ed37ed957 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:13.620868 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-29bbb526-4847-41d1-9914-8105bca17d12 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:13.636833 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-29bbb526-4847-41d1-9914-8105bca17d12 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:13.678872 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4f4a5ce-2991-4ad7-8c96-9e73b03f9d97 req-26709f76-045a-4d85-a564-d290e3d159a2 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1399920 Dec 09 21:28:13.760965 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-29bbb526-4847-41d1-9914-8105bca17d12 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:13.766827 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-29bbb526-4847-41d1-9914-8105bca17d12 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:13.772685 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12157793-932f-47c3-a7f8-3b62d3d79cc6 req-6a3c820b-f57d-473f-b1fe-f8859521e52b tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:13.782998 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-12157793-932f-47c3-a7f8-3b62d3d79cc6 req-6a3c820b-f57d-473f-b1fe-f8859521e52b tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 945 time: 0.2244761 Dec 09 21:28:13.793750 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-29bbb526-4847-41d1-9914-8105bca17d12 admin admin] vlan segment allocate from pool success with {'vlan_id': 144, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:28:13.816578 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29bbb526-4847-41d1-9914-8105bca17d12 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b3df31c8-3004-4dae-848a-df0a458122c0,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:13.820279 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-29bbb526-4847-41d1-9914-8105bca17d12 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:13.820832 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-29bbb526-4847-41d1-9914-8105bca17d12 admin admin] Added segment ad90d3b7-fe41-4a28-acd8-4c934cf4d57c of type vlan for network e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 Dec 09 21:28:13.883158 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-29bbb526-4847-41d1-9914-8105bca17d12 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:13.888005 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-12157793-932f-47c3-a7f8-3b62d3d79cc6 req-0f101cbc-6520-4ed2-a315-2fd4172fcb34 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1040030 Dec 09 21:28:13.906227 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-f16805ce-6058-4c98-bc85-08de5456de2c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:13.906227 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-f16805ce-6058-4c98-bc85-08de5456de2c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:13.910257 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-f16805ce-6058-4c98-bc85-08de5456de2c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:13.917548 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-f16805ce-6058-4c98-bc85-08de5456de2c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/networks?id=f0373886-3db8-47eb-af65-78244497171e&id=a859e4ba-764a-41c0-982d-5bf79a2797a1&id=a859e4ba-764a-41c0-982d-5bf79a2797a1&id=a133a939-2827-4fe6-81f5-14715631c0ec&id=a133a939-2827-4fe6-81f5-14715631c0ec HTTP/1.1" status: 200 len: 1990 time: 0.3007288 Dec 09 21:28:13.930817 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-4ceece71-cff3-4484-8ff6-ed9610e18f53 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/quotas/03e962eb7f5e4325a7c08c8b1e2a4cea HTTP/1.1" status: 200 len: 375 time: 0.0123179 Dec 09 21:28:13.932631 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-29bbb526-4847-41d1-9914-8105bca17d12 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:13.933629 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-29bbb526-4847-41d1-9914-8105bca17d12 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:13.934259 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-29bbb526-4847-41d1-9914-8105bca17d12 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:14.007473 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29bbb526-4847-41d1-9914-8105bca17d12 admin admin] Pushing event updated for resources: {'Network': ['ID=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:14.015605 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-305efa89-a31b-45b0-8f92-d10790eccab8 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=03e962eb7f5e4325a7c08c8b1e2a4cea&fields=id HTTP/1.1" status: 200 len: 486 time: 0.0764475 Dec 09 21:28:14.022163 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:28:14.040700 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-29bbb526-4847-41d1-9914-8105bca17d12 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.7165174 Dec 09 21:28:14.043183 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41464) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:14.049217 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-f019fb6c-875c-4edc-b028-04144aa8af07 admin admin] Request body: {'subnet': {'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-236206179-subnet', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:14.083048 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f019fb6c-875c-4edc-b028-04144aa8af07 admin admin] Made reservation on behalf of 29f2c1d9be9348b0888bc61ed37ed957 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:14.088262 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f019fb6c-875c-4edc-b028-04144aa8af07 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:14.291333 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-d5c742fc-254e-413b-b2fc-8da3550142ff req-217e1bf5-de28-42ac-a933-b0e6bdc61ab7 tempest-SecurityGroupsNegativeTestJSON-1808228169 tempest-SecurityGroupsNegativeTestJSON-1808228169-project] show failed (client error): The resource could not be found. Dec 09 21:28:14.298274 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f019fb6c-875c-4edc-b028-04144aa8af07 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:14.303943 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d5c742fc-254e-413b-b2fc-8da3550142ff req-217e1bf5-de28-42ac-a933-b0e6bdc61ab7 tempest-SecurityGroupsNegativeTestJSON-1808228169 tempest-SecurityGroupsNegativeTestJSON-1808228169-project] 10.222.0.13 "GET /v2.0/security-groups/9792eb0a-2261-48e6-bed9-7586107fcdba HTTP/1.1" status: 404 len: 352 time: 0.1059575 Dec 09 21:28:14.306320 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-dc9e5e58-10c9-4c8d-bd8e-6e2f51e52730 service neutron] 10.222.0.13 "GET /v2.0/networks/f0373886-3db8-47eb-af65-78244497171e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2751534 Dec 09 21:28:14.381621 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f019fb6c-875c-4edc-b028-04144aa8af07 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ace82e8b-012a-4184-a81e-5303eecf12ff,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:14.392067 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f019fb6c-875c-4edc-b028-04144aa8af07 admin admin] Checking segment: {'id': 'ad90d3b7-fe41-4a28-acd8-4c934cf4d57c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:14.392434 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f019fb6c-875c-4edc-b028-04144aa8af07 admin admin] Network hostable DHCP agents. Network: e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:28:14.411662 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f019fb6c-875c-4edc-b028-04144aa8af07 admin admin] Network e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:28:14.421699 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-f019fb6c-875c-4edc-b028-04144aa8af07 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:14.425979 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f019fb6c-875c-4edc-b028-04144aa8af07 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:14.426581 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f019fb6c-875c-4edc-b028-04144aa8af07 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:14.430405 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d2f4611-3cea-43cd-9f70-87a5c542eae0 None None] Network e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:28:14.445398 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f019fb6c-875c-4edc-b028-04144aa8af07 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.4007607 Dec 09 21:28:14.448000 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41472) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:14.454608 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-3ac921f1-3c74-41c0-a506-0b04c1d4ce86 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-236206179-router', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:14.495498 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab06b32b-e4cf-4f7c-b98a-fdfb509b3c74 req-cc8eb5c5-e2b7-4d5e-926e-0783855354dd tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:14.495498 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab06b32b-e4cf-4f7c-b98a-fdfb509b3c74 req-cc8eb5c5-e2b7-4d5e-926e-0783855354dd tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 945 time: 0.0905824 Dec 09 21:28:14.501779 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6c3593b4-b905-42d6-8cfb-a37bdc4b607e service neutron] 10.222.0.13 "GET /v2.0/networks/f0373886-3db8-47eb-af65-78244497171e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1880226 Dec 09 21:28:14.505665 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ac921f1-3c74-41c0-a506-0b04c1d4ce86 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:14.508867 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ac921f1-3c74-41c0-a506-0b04c1d4ce86 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:14.590118 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a21442c9-822a-4f6b-96b8-5bb6022e599f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'fixed_ips': [{'subnet_id': 'ace82e8b-012a-4184-a81e-5303eecf12ff'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:28:14.591996 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a21442c9-822a-4f6b-96b8-5bb6022e599f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:14.629007 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device c3c31744-0580-4d09-863d-697769f7c0ee no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:28:14.650760 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-5dd4ff3c-7bd1-489f-a985-a439fab4c5f6 service neutron] 10.222.0.13 "GET /v2.0/ports/1e946a47-f496-445b-964b-618881eab263?fields=binding%3Avnic_type&fields=binding%3Aprofile&fields=network_id&fields=resource_request&fields=numa_affinity_policy&fields=device_profile HTTP/1.1" status: 200 len: 311 time: 0.1382105 Dec 09 21:28:14.762669 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-c0ec16ff-d79e-4f1f-a856-a3a02d3ecfa0 service neutron] 10.222.0.13 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1104734 Dec 09 21:28:14.764884 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-a21442c9-822a-4f6b-96b8-5bb6022e599f None None] Allocated IP 172.20.0.2 (e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8/ace82e8b-012a-4184-a81e-5303eecf12ff/f0107249-478c-46d2-8518-d2a9b5ed6220) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:14.920524 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab06b32b-e4cf-4f7c-b98a-fdfb509b3c74 req-427afe16-cd44-4917-99fa-1d9351043ee8 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4173310 Dec 09 21:28:14.926156 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a21442c9-822a-4f6b-96b8-5bb6022e599f None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:14.929477 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-9a7962a4-a21c-451d-8b51-c6a736f53b74 service neutron] 10.222.0.13 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1657076 Dec 09 21:28:14.954202 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a21442c9-822a-4f6b-96b8-5bb6022e599f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:14.978096 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-93c536ff-6f52-435d-9420-acb58ee3cd42 service neutron] 10.222.0.13 "GET /v2.0/ports/145a0cde-0fe5-4163-a063-0fdfe42f243b?fields=binding%3Avnic_type&fields=binding%3Aprofile&fields=network_id&fields=resource_request&fields=numa_affinity_policy&fields=device_profile HTTP/1.1" status: 200 len: 311 time: 0.0475187 Dec 09 21:28:14.984740 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ac921f1-3c74-41c0-a506-0b04c1d4ce86 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:14.988415 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: c3c31744-0580-4d09-863d-697769f7c0ee {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:28:14.988810 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device c3c31744-0580-4d09-863d-697769f7c0ee not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:28:15.005448 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a21442c9-822a-4f6b-96b8-5bb6022e599f None None] Pushing event updated for resources: {'Port': ['ID=f0107249-478c-46d2-8518-d2a9b5ed6220,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:15.016821 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a21442c9-822a-4f6b-96b8-5bb6022e599f None None] Network e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:15.018459 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-a21442c9-822a-4f6b-96b8-5bb6022e599f None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:15.022624 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a21442c9-822a-4f6b-96b8-5bb6022e599f None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:15.082373 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a21442c9-822a-4f6b-96b8-5bb6022e599f None None] Attempting to bind port f0107249-478c-46d2-8518-d2a9b5ed6220 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:28:15.082800 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a21442c9-822a-4f6b-96b8-5bb6022e599f None None] Attempting to bind port f0107249-478c-46d2-8518-d2a9b5ed6220 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'ad90d3b7-fe41-4a28-acd8-4c934cf4d57c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:28:15.083337 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a21442c9-822a-4f6b-96b8-5bb6022e599f None None] Attempting to bind port f0107249-478c-46d2-8518-d2a9b5ed6220 on network e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:15.089633 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a21442c9-822a-4f6b-96b8-5bb6022e599f None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:28:15.090277 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a21442c9-822a-4f6b-96b8-5bb6022e599f None None] Checking segment: {'id': 'ad90d3b7-fe41-4a28-acd8-4c934cf4d57c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:15.090498 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-849ca449-5822-4cc3-8fa7-662e608947ca service neutron] 10.222.0.13 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1020455 Dec 09 21:28:15.091020 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a21442c9-822a-4f6b-96b8-5bb6022e599f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:15.091490 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a21442c9-822a-4f6b-96b8-5bb6022e599f None None] Bound using segment: {'id': 'ad90d3b7-fe41-4a28-acd8-4c934cf4d57c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:28:15.092162 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a21442c9-822a-4f6b-96b8-5bb6022e599f None None] Bound port: f0107249-478c-46d2-8518-d2a9b5ed6220, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ad90d3b7-fe41-4a28-acd8-4c934cf4d57c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:28:15.092619 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a21442c9-822a-4f6b-96b8-5bb6022e599f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:15.177690 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a21442c9-822a-4f6b-96b8-5bb6022e599f None None] For port f0107249-478c-46d2-8518-d2a9b5ed6220, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:28:15.181197 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a21442c9-822a-4f6b-96b8-5bb6022e599f None None] For port f0107249-478c-46d2-8518-d2a9b5ed6220, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f0107249-478c-46d2-8518-d2a9b5ed6220,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:28:15.186203 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a21442c9-822a-4f6b-96b8-5bb6022e599f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:15.213905 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-526af4ca-8bde-4209-b736-4b8e686e4fe9 req-782410fc-1c8f-4fce-91ee-6ad0af289272 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=3e0505b6-bf4a-4e37-aacd-7600f6833c41 HTTP/1.1" status: 200 len: 210 time: 0.0391140 Dec 09 21:28:15.243148 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-831fb879-e320-4e12-b400-36dfe17f3833 service neutron] 10.222.0.13 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1386800 Dec 09 21:28:15.263173 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a21442c9-822a-4f6b-96b8-5bb6022e599f None None] Pushing event updated for resources: {'Port': ['ID=f0107249-478c-46d2-8518-d2a9b5ed6220,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:15.281717 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ac921f1-3c74-41c0-a506-0b04c1d4ce86 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:15.322866 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-08708565-709f-4843-af78-5a51ef9fbab1 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:15.324358 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-08708565-709f-4843-af78-5a51ef9fbab1 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.10 "GET /v2.0/networks?id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb HTTP/1.1" status: 200 len: 812 time: 0.3503637 Dec 09 21:28:15.342937 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-4478ceb8-13d0-4271-a20f-28ed95cd50bf tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Request body: {'port': {'device_id': '3e0505b6-bf4a-4e37-aacd-7600f6833c41', 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb', 'admin_state_up': True, 'tenant_id': '1b7916b634f74760a565cfeaef510cd9'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:15.393250 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-689112b2-b46d-4cef-9193-0792f55ecb3d req-818b641a-fa3d-41dd-9f16-4a0f830d8ae9 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:15.395220 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-689112b2-b46d-4cef-9193-0792f55ecb3d req-818b641a-fa3d-41dd-9f16-4a0f830d8ae9 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 945 time: 0.1012919 Dec 09 21:28:15.397693 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d29f609d-0fa4-4dc4-8ece-dbc906cd8228 service neutron] 10.222.0.13 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1456544 Dec 09 21:28:15.545853 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-689112b2-b46d-4cef-9193-0792f55ecb3d req-05149902-06d2-486e-a92e-75942b358797 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1328280 Dec 09 21:28:15.561618 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-4478ceb8-13d0-4271-a20f-28ed95cd50bf tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Made reservation on behalf of 1b7916b634f74760a565cfeaef510cd9 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:15.567563 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7ea65bb4-cb3b-4787-9458-c9ee13b4c81b service neutron] 10.222.0.13 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1623476 Dec 09 21:28:15.569990 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-4478ceb8-13d0-4271-a20f-28ed95cd50bf tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:15.635046 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f0107249-478c-46d2-8518-d2a9b5ed6220 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:28:15.692682 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-be321cd3-5837-4e2c-8b23-785497113964 req-d0cea3a2-f22a-4a16-a9ea-d549bc23a2ef tempest-SecurityGroupsNegativeTestJSON-1808228169 tempest-SecurityGroupsNegativeTestJSON-1808228169-project] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=6461e253db534e9981d6b9bd1c31363f HTTP/1.1" status: 200 len: 3005 time: 0.1025445 Dec 09 21:28:15.709101 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f0107249-478c-46d2-8518-d2a9b5ed6220 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:15.709476 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:15.713651 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ac921f1-3c74-41c0-a506-0b04c1d4ce86 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:15.737468 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ac921f1-3c74-41c0-a506-0b04c1d4ce86 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:15.738528 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-b4a1c968-a002-464a-a997-49fb5f526667 service neutron] 10.222.0.13 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1570389 Dec 09 21:28:15.786730 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-be321cd3-5837-4e2c-8b23-785497113964 req-a6a98692-678a-4bcd-9e58-93cd1e537d50 tempest-SecurityGroupsNegativeTestJSON-1808228169 tempest-SecurityGroupsNegativeTestJSON-1808228169-project] 10.222.0.13 "GET /v2.0/security-groups/a75544ea-bc78-4b70-9d01-c8e6f7dc224d HTTP/1.1" status: 200 len: 3002 time: 0.0898643 Dec 09 21:28:15.792583 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:15.836321 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port f0107249-478c-46d2-8518-d2a9b5ed6220, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f0107249-478c-46d2-8518-d2a9b5ed6220,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:15.845067 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:15.869068 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-4478ceb8-13d0-4271-a20f-28ed95cd50bf tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Allocated IP 172.20.0.5 (43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb/50496955-1646-4079-acd4-a47e8cd175cb/fd5eccfa-9fff-46bc-a3bd-73a647cd826e) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:15.903168 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=f0107249-478c-46d2-8518-d2a9b5ed6220,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:15.908000 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7af79900-29fa-42d2-b164-a4bbedfb1ad5 service neutron] 10.222.0.13 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1591659 Dec 09 21:28:15.968387 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-be321cd3-5837-4e2c-8b23-785497113964 req-5878a356-80a8-4883-8af3-efb1f4788634 tempest-SecurityGroupsNegativeTestJSON-1808228169 tempest-SecurityGroupsNegativeTestJSON-1808228169-project] 10.222.0.13 "GET /v2.0/security-groups/a75544ea-bc78-4b70-9d01-c8e6f7dc224d HTTP/1.1" status: 200 len: 3002 time: 0.1195562 Dec 09 21:28:15.980561 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-3ac921f1-3c74-41c0-a506-0b04c1d4ce86 admin admin] Allocated IP 172.25.3.203 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/24ef0d1e-7cfa-4ade-8f5e-466567bc5628) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:16.053354 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-60917094-fe1e-48f7-811f-6e28be541361 service neutron] 10.222.0.13 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1353691 Dec 09 21:28:16.225888 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-4478ceb8-13d0-4271-a20f-28ed95cd50bf tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:16.267491 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-50be75b5-c0f1-42cb-832c-654cb2b1b5b0 service neutron] 10.222.0.13 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2122695 Dec 09 21:28:16.318832 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ec722c9-041a-4ce2-84f9-7ca1cc8dac83 req-2638fabf-60ad-4b5c-8bb3-0a017bdefe63 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:16.320437 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ec722c9-041a-4ce2-84f9-7ca1cc8dac83 req-2638fabf-60ad-4b5c-8bb3-0a017bdefe63 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 945 time: 0.1134617 Dec 09 21:28:16.328670 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ac921f1-3c74-41c0-a506-0b04c1d4ce86 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:16.363551 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-4478ceb8-13d0-4271-a20f-28ed95cd50bf tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:16.420389 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-4478ceb8-13d0-4271-a20f-28ed95cd50bf tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:16.446190 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-67e72617-1294-4326-b401-d971a64dd5d2 service neutron] 10.222.0.13 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1783352 Dec 09 21:28:16.456489 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-4478ceb8-13d0-4271-a20f-28ed95cd50bf tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:16.458591 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4478ceb8-13d0-4271-a20f-28ed95cd50bf tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Pushing event updated for resources: {'Port': ['ID=fd5eccfa-9fff-46bc-a3bd-73a647cd826e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:16.468812 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-4478ceb8-13d0-4271-a20f-28ed95cd50bf tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:16.514074 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ac921f1-3c74-41c0-a506-0b04c1d4ce86 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:16.551584 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-19b9a194-6a75-4cf3-99eb-28d79e232a10 service neutron] 10.222.0.13 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1044071 Dec 09 21:28:16.563184 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ac921f1-3c74-41c0-a506-0b04c1d4ce86 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:16.563648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e1df255a-5891-44b1-a79e-ede2b9fad803 None None] Network e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:28:16.570438 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-3ac921f1-3c74-41c0-a506-0b04c1d4ce86 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:16.573119 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ec722c9-041a-4ce2-84f9-7ca1cc8dac83 req-9b9b8f36-d327-488d-9749-f4fe60f5cabe tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2070193 Dec 09 21:28:16.574321 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ac921f1-3c74-41c0-a506-0b04c1d4ce86 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:16.672356 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f331c518-11eb-4f3b-b9d3-c2f84cb44929 req-f852fc80-7598-4491-878e-12243f2ef4f4 tempest-SecurityGroupsNegativeTestJSON-1808228169 tempest-SecurityGroupsNegativeTestJSON-1808228169-project] 10.222.0.13 "GET /v2.0/security-groups/a75544ea-bc78-4b70-9d01-c8e6f7dc224d HTTP/1.1" status: 200 len: 3002 time: 0.0803268 Dec 09 21:28:16.731878 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5408aef2-fb8c-4ed1-81f2-65dd8e19495e None None] Provisioning complete for port f0107249-478c-46d2-8518-d2a9b5ed6220 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:16.732679 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5408aef2-fb8c-4ed1-81f2-65dd8e19495e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:16.771887 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-4478ceb8-13d0-4271-a20f-28ed95cd50bf tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:16.772432 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-4478ceb8-13d0-4271-a20f-28ed95cd50bf tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:16.789292 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-f331c518-11eb-4f3b-b9d3-c2f84cb44929 req-36991740-0d7a-4ec4-a893-346c30f1366d tempest-SecurityGroupsNegativeTestJSON-1808228169 tempest-SecurityGroupsNegativeTestJSON-1808228169-project] delete failed (client error): There was a conflict when trying to complete your request. Dec 09 21:28:16.800851 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f331c518-11eb-4f3b-b9d3-c2f84cb44929 req-36991740-0d7a-4ec4-a893-346c30f1366d tempest-SecurityGroupsNegativeTestJSON-1808228169 tempest-SecurityGroupsNegativeTestJSON-1808228169-project] 10.222.0.13 "DELETE /v2.0/security-groups/a75544ea-bc78-4b70-9d01-c8e6f7dc224d HTTP/1.1" status: 409 len: 352 time: 0.1264412 Dec 09 21:28:16.819961 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-4478ceb8-13d0-4271-a20f-28ed95cd50bf tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.4816258 Dec 09 21:28:16.860544 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ac921f1-3c74-41c0-a506-0b04c1d4ce86 admin admin] Pushing event updated for resources: {'Port': ['ID=24ef0d1e-7cfa-4ade-8f5e-466567bc5628,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:16.884938 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-426bd49f-4a37-409d-8e3e-fdad1210c396 service neutron] Request body: {'port': {'device_id': '3e0505b6-bf4a-4e37-aacd-7600f6833c41', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:16.924280 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf088405-75d7-424a-a13f-1ea62c73f140 req-6d62ed3b-45d0-4251-8d3a-8ed39cd6582a tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:16.926028 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cf088405-75d7-424a-a13f-1ea62c73f140 req-6d62ed3b-45d0-4251-8d3a-8ed39cd6582a tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "GET /v2.0/ports?device_id=94826b5c-46f2-422a-a48d-eb415b5b9e44 HTTP/1.1" status: 200 len: 949 time: 0.1664333 Dec 09 21:28:17.032397 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c14f5e7c-69b4-4a7c-acbe-a0e0a047cd50 req-b5dd378a-1a91-4455-897b-c3637fc5649d tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:17.034064 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c14f5e7c-69b4-4a7c-acbe-a0e0a047cd50 req-b5dd378a-1a91-4455-897b-c3637fc5649d tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=94826b5c-46f2-422a-a48d-eb415b5b9e44 HTTP/1.1" status: 200 len: 949 time: 0.1149600 Dec 09 21:28:17.099186 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-426bd49f-4a37-409d-8e3e-fdad1210c396 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:17.130798 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c14f5e7c-69b4-4a7c-acbe-a0e0a047cd50 req-aeab80de-b3e5-4cf0-8d98-f137fefa3108 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0794358 Dec 09 21:28:17.136617 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ac921f1-3c74-41c0-a506-0b04c1d4ce86 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:17.148336 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-cf088405-75d7-424a-a13f-1ea62c73f140 req-e20e03ad-905f-4fa8-8dec-1f3c29656ac3 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Deleting port 07457883-17db-4553-8f10-716e04bc16b1 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:28:17.150218 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cf088405-75d7-424a-a13f-1ea62c73f140 req-e20e03ad-905f-4fa8-8dec-1f3c29656ac3 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:17.234638 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-136568b4-e8a3-430e-9e50-c98e90530212 None None] Provisioning complete for port f0107249-478c-46d2-8518-d2a9b5ed6220 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:17.234638 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-136568b4-e8a3-430e-9e50-c98e90530212 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:17.278256 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae375673-558f-495a-af82-ea93ecf7f69c req-d6a41fa5-b980-4b6f-b04f-1e9ea5485e7e tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:17.281419 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae375673-558f-495a-af82-ea93ecf7f69c req-d6a41fa5-b980-4b6f-b04f-1e9ea5485e7e tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=3e0505b6-bf4a-4e37-aacd-7600f6833c41 HTTP/1.1" status: 200 len: 931 time: 0.0667512 Dec 09 21:28:17.414301 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae375673-558f-495a-af82-ea93ecf7f69c req-2b5407e0-89f1-4636-95cc-f189600ee03d tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1246898 Dec 09 21:28:17.490481 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-cf088405-75d7-424a-a13f-1ea62c73f140 req-e20e03ad-905f-4fa8-8dec-1f3c29656ac3 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] For port 07457883-17db-4553-8f10-716e04bc16b1, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=07457883-17db-4553-8f10-716e04bc16b1,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:17.490967 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cf088405-75d7-424a-a13f-1ea62c73f140 req-e20e03ad-905f-4fa8-8dec-1f3c29656ac3 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:17.520954 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-cf088405-75d7-424a-a13f-1ea62c73f140 req-e20e03ad-905f-4fa8-8dec-1f3c29656ac3 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Calling delete_port for 07457883-17db-4553-8f10-716e04bc16b1 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:28:17.539349 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-c201d081-8ae0-4848-ad2b-320e6b0c2881 req-e9fb226e-0901-47bf-a0f1-57612b27d29a tempest-SecurityGroupsNegativeTestJSON-1808228169 tempest-SecurityGroupsNegativeTestJSON-1808228169-project] show failed (client error): The resource could not be found. Dec 09 21:28:17.540509 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c201d081-8ae0-4848-ad2b-320e6b0c2881 req-e9fb226e-0901-47bf-a0f1-57612b27d29a tempest-SecurityGroupsNegativeTestJSON-1808228169 tempest-SecurityGroupsNegativeTestJSON-1808228169-project] 10.222.0.13 "GET /v2.0/security-groups/34556502-b13a-4a6f-b818-332dde82394e HTTP/1.1" status: 404 len: 352 time: 0.0635006 Dec 09 21:28:17.609817 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f7d6430-2d53-4419-92b4-9975d4c7c3ab req-aedfa07b-1f9b-467e-aa06-3a41beec849e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:17.611402 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f7d6430-2d53-4419-92b4-9975d4c7c3ab req-aedfa07b-1f9b-467e-aa06-3a41beec849e tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.10 "GET /v2.0/ports?device_id=c7f45d89-875f-4294-9fcb-17f7fc994b3f HTTP/1.1" status: 200 len: 950 time: 0.0989704 Dec 09 21:28:17.640950 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f0107249-478c-46d2-8518-d2a9b5ed6220 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:28:17.657820 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ea602eb-05b8-4f8c-a69a-2d7d56377d52 req-19e272b6-a627-4b62-a8f0-ad0a29646c9a tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:17.659354 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ea602eb-05b8-4f8c-a69a-2d7d56377d52 req-19e272b6-a627-4b62-a8f0-ad0a29646c9a tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 945 time: 0.1458178 Dec 09 21:28:17.692170 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e78362eb-d058-4f62-b225-02bf3ea92198 req-5a35db93-7917-483d-8b44-d140e0cbb46c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 210 time: 0.0728250 Dec 09 21:28:17.717202 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f0107249-478c-46d2-8518-d2a9b5ed6220 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:17.717581 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:17.766802 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cf088405-75d7-424a-a13f-1ea62c73f140 req-e20e03ad-905f-4fa8-8dec-1f3c29656ac3 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:17.786074 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['fd466da6-f506-43e6-9800-156622bd2781'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:28:17.789544 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['18bda486-9d6d-41a3-a260-dd244a3838b3', '2958b0be-15e5-48e2-b87a-6ffefd9a7859', '1ad36983-4549-4a03-a826-a31a08b98c98'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:28:17.790088 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-3bafdd94-0240-40ca-ad10-2b44eebdc01e req-f36177ce-86f7-4d47-a79b-f2bb33297cd4 tempest-SecurityGroupsNegativeTestJSON-1808228169 tempest-SecurityGroupsNegativeTestJSON-1808228169-project] show failed (client error): The resource could not be found. Dec 09 21:28:17.791156 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3bafdd94-0240-40ca-ad10-2b44eebdc01e req-f36177ce-86f7-4d47-a79b-f2bb33297cd4 tempest-SecurityGroupsNegativeTestJSON-1808228169 tempest-SecurityGroupsNegativeTestJSON-1808228169-project] 10.222.0.13 "GET /v2.0/security-groups/bf783053-7f88-48ee-aa72-58a7c510c1d0 HTTP/1.1" status: 404 len: 352 time: 0.0443447 Dec 09 21:28:17.809474 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ea602eb-05b8-4f8c-a69a-2d7d56377d52 req-17e652db-d3b5-4e3f-ad38-d153624c725d tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1200571 Dec 09 21:28:17.810479 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41536) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:17.866355 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e20e03ad-905f-4fa8-8dec-1f3c29656ac3 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Pushing event deleted for resources: {'Port': ['ID=07457883-17db-4553-8f10-716e04bc16b1,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:17.966018 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-b27ba584-819e-45a8-acd3-64e29d0ee6b2 admin admin] Deleting subnet 3d20ff35-e2da-461d-8fb6-7371c8a75965 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:28:17.972762 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b27ba584-819e-45a8-acd3-64e29d0ee6b2 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:18.002424 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-9f7d6430-2d53-4419-92b4-9975d4c7c3ab req-dc1c0d8c-55a5-43e5-ac92-330673b660dc tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Deleting port fd466da6-f506-43e6-9800-156622bd2781 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:28:18.002668 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9f7d6430-2d53-4419-92b4-9975d4c7c3ab req-dc1c0d8c-55a5-43e5-ac92-330673b660dc tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:18.003752 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-cf088405-75d7-424a-a13f-1ea62c73f140 req-e20e03ad-905f-4fa8-8dec-1f3c29656ac3 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] No DVR routers for this DVR port 07457883-17db-4553-8f10-716e04bc16b1 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:28:18.006504 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cf088405-75d7-424a-a13f-1ea62c73f140 req-e20e03ad-905f-4fa8-8dec-1f3c29656ac3 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:18.011296 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cf088405-75d7-424a-a13f-1ea62c73f140 req-e20e03ad-905f-4fa8-8dec-1f3c29656ac3 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "DELETE /v2.0/ports/07457883-17db-4553-8f10-716e04bc16b1 HTTP/1.1" status: 204 len: 173 time: 1.0767763 Dec 09 21:28:18.016448 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '94826b5c-46f2-422a-a48d-eb415b5b9e44', 'name': 'network-vif-deleted', 'tag': '07457883-17db-4553-8f10-716e04bc16b1'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:18.018869 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dceaedd0-1fff-4847-bd21-146b5f876ec5" -d '{"events": [{"server_uuid": "94826b5c-46f2-422a-a48d-eb415b5b9e44", "name": "network-vif-deleted", "tag": "07457883-17db-4553-8f10-716e04bc16b1"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:18.045645 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d9b7fe4-5e11-4c8f-a7a2-3bd83b7e140d req-f52518f1-229a-4568-8baf-35f0b2bdbdd3 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:18.047045 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0d9b7fe4-5e11-4c8f-a7a2-3bd83b7e140d req-f52518f1-229a-4568-8baf-35f0b2bdbdd3 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 945 time: 0.1398783 Dec 09 21:28:18.095528 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ac921f1-3c74-41c0-a506-0b04c1d4ce86 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:18.159261 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b953fbf1-def7-4969-aefe-ac4004f5f1a3 x-openstack-request-id: req-b953fbf1-def7-4969-aefe-ac4004f5f1a3 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:18.159595 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "94826b5c-46f2-422a-a48d-eb415b5b9e44", "name": "network-vif-deleted", "tag": "07457883-17db-4553-8f10-716e04bc16b1", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:18.160011 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-b953fbf1-def7-4969-aefe-ac4004f5f1a3 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:18.160485 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '94826b5c-46f2-422a-a48d-eb415b5b9e44', 'name': 'network-vif-deleted', 'tag': '07457883-17db-4553-8f10-716e04bc16b1', 'status': 'completed', 'code': 200} Dec 09 21:28:18.188930 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b27ba584-819e-45a8-acd3-64e29d0ee6b2 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:18.303005 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b27ba584-819e-45a8-acd3-64e29d0ee6b2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:18.327739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-426bd49f-4a37-409d-8e3e-fdad1210c396 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fd5eccfa-9fff-46bc-a3bd-73a647cd826e {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:28:18.341865 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-426bd49f-4a37-409d-8e3e-fdad1210c396 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:18.389865 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3ac921f1-3c74-41c0-a506-0b04c1d4ce86 admin admin] Router 8f39d25d-26dd-4bce-b961-53cba1551e5d is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:28:18.403883 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-9f7d6430-2d53-4419-92b4-9975d4c7c3ab req-dc1c0d8c-55a5-43e5-ac92-330673b660dc tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] For port fd466da6-f506-43e6-9800-156622bd2781, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=fd466da6-f506-43e6-9800-156622bd2781,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:18.404489 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9f7d6430-2d53-4419-92b4-9975d4c7c3ab req-dc1c0d8c-55a5-43e5-ac92-330673b660dc tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:18.477319 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-272e15f4-f59b-42b9-9540-2f1245631595 req-33533f77-d756-4d22-963d-5acb08da967b tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=94826b5c-46f2-422a-a48d-eb415b5b9e44 HTTP/1.1" status: 200 len: 210 time: 0.1096704 Dec 09 21:28:18.527526 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3ac921f1-3c74-41c0-a506-0b04c1d4ce86 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:28:18.549754 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] Sync routers for ids ['8f39d25d-26dd-4bce-b961-53cba1551e5d'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:28:18.561945 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b27ba584-819e-45a8-acd3-64e29d0ee6b2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:18.567311 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ac921f1-3c74-41c0-a506-0b04c1d4ce86 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:18.568864 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3ac921f1-3c74-41c0-a506-0b04c1d4ce86 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 4.1196675 Dec 09 21:28:18.572965 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-426bd49f-4a37-409d-8e3e-fdad1210c396 service neutron] Transition to ACTIVE for port object fd5eccfa-9fff-46bc-a3bd-73a647cd826e will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:28:18.573636 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41548) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:18.573973 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41550) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:18.578125 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] Routers {'8f39d25d-26dd-4bce-b961-53cba1551e5d'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:28:18.578797 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:28:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['8f39d25d-26dd-4bce-b961-53cba1551e5d'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:28:18.585469 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-dc2b22d1-a6e2-48fb-a8a6-7534224097bc tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Request body: {'network': {'name': 'tempest-device-tagging-net1-71588011'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:18.613366 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-9f7d6430-2d53-4419-92b4-9975d4c7c3ab req-dc1c0d8c-55a5-43e5-ac92-330673b660dc tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Calling delete_port for fd466da6-f506-43e6-9800-156622bd2781 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:28:18.615888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b27ba584-819e-45a8-acd3-64e29d0ee6b2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3d20ff35-e2da-461d-8fb6-7371c8a75965,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:18.630730 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b27ba584-819e-45a8-acd3-64e29d0ee6b2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:18.641274 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b27ba584-819e-45a8-acd3-64e29d0ee6b2 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/3d20ff35-e2da-461d-8fb6-7371c8a75965 HTTP/1.1" status: 204 len: 168 time: 0.8222747 Dec 09 21:28:18.644367 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41552) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:18.658758 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-426bd49f-4a37-409d-8e3e-fdad1210c396 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:18.695626 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dc2b22d1-a6e2-48fb-a8a6-7534224097bc tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Made reservation on behalf of 0a5d0e4652be4d8b87936a559840cc87 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:18.699149 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dc2b22d1-a6e2-48fb-a8a6-7534224097bc tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:18.715843 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0d9b7fe4-5e11-4c8f-a7a2-3bd83b7e140d req-36a23108-52af-478c-90c8-c31d189b0a7e tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6316929 Dec 09 21:28:18.757951 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] Set router 8f39d25d-26dd-4bce-b961-53cba1551e5d gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:28:18.798558 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dc2b22d1-a6e2-48fb-a8a6-7534224097bc tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] vlan segment allocate from pool success with {'vlan_id': 132, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:28:19.099377 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'name': 'tempest-AttachVolumeShelveTestJSON-236206179-router', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203'}], 'enable_snat': True}, 'gw_port_id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:14Z', 'updated_at': '2021-12-09T21:28:16Z', 'revision_number': 3, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'gw_port': {'id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:4c:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1175, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:15Z', 'updated_at': '2021-12-09T21:28:16Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:28:19.141267 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] Checking router: 8f39d25d-26dd-4bce-b961-53cba1551e5d for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:28:19.142022 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] Updating router 8f39d25d-26dd-4bce-b961-53cba1551e5d port 24ef0d1e-7cfa-4ade-8f5e-466567bc5628 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:28:19.173910 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:19.180290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-426bd49f-4a37-409d-8e3e-fdad1210c396 service neutron] Pushing event updated for resources: {'Port': ['ID=fd5eccfa-9fff-46bc-a3bd-73a647cd826e,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:19.203325 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dc2b22d1-a6e2-48fb-a8a6-7534224097bc tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:19.203695 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-dc2b22d1-a6e2-48fb-a8a6-7534224097bc tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Added segment 06cdf949-c592-4827-b617-66043758d462 of type vlan for network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c Dec 09 21:28:19.265227 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dc2b22d1-a6e2-48fb-a8a6-7534224097bc tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:19.274677 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-57e69381-e651-47f8-b94f-bdaed3bfeefe req-ff1615f2-e9c5-4c70-8d9d-024a5c4fc56f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 210 time: 0.1114581 Dec 09 21:28:19.299468 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-426bd49f-4a37-409d-8e3e-fdad1210c396 service neutron] Attempting to bind port fd5eccfa-9fff-46bc-a3bd-73a647cd826e on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:28:19.299805 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-426bd49f-4a37-409d-8e3e-fdad1210c396 service neutron] Attempting to bind port fd5eccfa-9fff-46bc-a3bd-73a647cd826e by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:28:19.300136 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-426bd49f-4a37-409d-8e3e-fdad1210c396 service neutron] Attempting to bind port fd5eccfa-9fff-46bc-a3bd-73a647cd826e on network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:19.327133 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a7c8607-cded-4d96-8532-ab0d70f72985 req-cc47193b-ceee-4b1b-a58b-0eb3ecbe8468 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:19.334514 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a7c8607-cded-4d96-8532-ab0d70f72985 req-cc47193b-ceee-4b1b-a58b-0eb3ecbe8468 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=3e0505b6-bf4a-4e37-aacd-7600f6833c41 HTTP/1.1" status: 200 len: 943 time: 0.6938376 Dec 09 21:28:19.338757 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-a1313be1-0a2e-4977-86d4-6bb12327c01a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:19.340212 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-a1313be1-0a2e-4977-86d4-6bb12327c01a service neutron] 10.222.0.10 "GET /v2.0/ports/1e946a47-f496-445b-964b-618881eab263 HTTP/1.1" status: 200 len: 1026 time: 0.1740875 Dec 09 21:28:19.344746 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7927adbd-fa58-4f0c-a1fb-dfd77bf72be4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:19.356586 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-426bd49f-4a37-409d-8e3e-fdad1210c396 service neutron] Port fd5eccfa-9fff-46bc-a3bd-73a647cd826e on network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:28:19.356772 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-426bd49f-4a37-409d-8e3e-fdad1210c396 service neutron] Attempting to bind port fd5eccfa-9fff-46bc-a3bd-73a647cd826e on network 43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:19.364606 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-426bd49f-4a37-409d-8e3e-fdad1210c396 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 27, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:28:19.365029 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-426bd49f-4a37-409d-8e3e-fdad1210c396 service neutron] Checking segment: {'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:19.365295 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-426bd49f-4a37-409d-8e3e-fdad1210c396 service neutron] Bound using segment: {'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:28:19.365746 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-426bd49f-4a37-409d-8e3e-fdad1210c396 service neutron] Bound port: fd5eccfa-9fff-46bc-a3bd-73a647cd826e, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd383c8e8-889c-4799-8949-cba737586b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:28:19.366242 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-426bd49f-4a37-409d-8e3e-fdad1210c396 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:19.382186 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dc2b22d1-a6e2-48fb-a8a6-7534224097bc tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:19.387695 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc2b22d1-a6e2-48fb-a8a6-7534224097bc tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:19.388336 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dc2b22d1-a6e2-48fb-a8a6-7534224097bc tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:19.456874 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-3ebe7ba5-7850-4ddc-ba82-81d5f36f2bef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:19.458538 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-3ebe7ba5-7850-4ddc-ba82-81d5f36f2bef service neutron] 10.222.0.10 "GET /v2.0/ports/145a0cde-0fe5-4163-a063-0fdfe42f243b HTTP/1.1" status: 200 len: 1027 time: 0.1052940 Dec 09 21:28:19.533724 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-dc2b22d1-a6e2-48fb-a8a6-7534224097bc tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.9564049 Dec 09 21:28:19.544752 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41560) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:19.563321 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a559082e-54a6-4c2e-b5c1-5d754f08f074 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Request body: {'network': {'name': 'tempest-device-tagging-net2-516379967'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:19.576797 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:19.586665 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:19.611024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc2b22d1-a6e2-48fb-a8a6-7534224097bc tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event updated for resources: {'Network': ['ID=69c5e9e4-78c6-4a6b-9b16-9f1da643282c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:19.614314 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a7c8607-cded-4d96-8532-ab0d70f72985 req-f510e0a6-da04-445f-b02f-17d5bd80a36b tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2743120 Dec 09 21:28:19.626520 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 07457883-17db-4553-8f10-716e04bc16b1 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:28:19.628684 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:28:19.729412 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 07457883-17db-4553-8f10-716e04bc16b1 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:28:19.729991 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 07457883-17db-4553-8f10-716e04bc16b1 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:28:19.756767 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-426bd49f-4a37-409d-8e3e-fdad1210c396 service neutron] For port fd5eccfa-9fff-46bc-a3bd-73a647cd826e, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:28:19.778817 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-426bd49f-4a37-409d-8e3e-fdad1210c396 service neutron] For port fd5eccfa-9fff-46bc-a3bd-73a647cd826e, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=fd5eccfa-9fff-46bc-a3bd-73a647cd826e,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:28:19.789970 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-426bd49f-4a37-409d-8e3e-fdad1210c396 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:19.835549 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] Attempting to bind port 24ef0d1e-7cfa-4ade-8f5e-466567bc5628 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:28:19.836652 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] Attempting to bind port 24ef0d1e-7cfa-4ade-8f5e-466567bc5628 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:28:19.836818 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] Attempting to bind port 24ef0d1e-7cfa-4ade-8f5e-466567bc5628 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:19.839766 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ada1c8ba-8b1c-4052-a7ba-109bc7972828 None None] Pushing event updated for resources: {'Port': ['ID=24ef0d1e-7cfa-4ade-8f5e-466567bc5628,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:19.847039 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-426bd49f-4a37-409d-8e3e-fdad1210c396 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:19.848374 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-426bd49f-4a37-409d-8e3e-fdad1210c396 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:19.849577 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-426bd49f-4a37-409d-8e3e-fdad1210c396 service neutron] 10.222.0.10 "PUT /v2.0/ports/fd5eccfa-9fff-46bc-a3bd-73a647cd826e HTTP/1.1" status: 200 len: 1092 time: 2.9800310 Dec 09 21:28:19.869607 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:28:19.869913 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:19.871029 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:19.871718 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:28:19.872197 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] Bound port: 24ef0d1e-7cfa-4ade-8f5e-466567bc5628, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:28:19.872734 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:19.885721 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7927adbd-fa58-4f0c-a1fb-dfd77bf72be4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:19.900727 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f9a24412-dee3-45eb-8ea3-f5bc19cfcb0f req-e46abc7a-758b-4368-8d7b-b17de72250f8 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=c7f45d89-875f-4294-9fcb-17f7fc994b3f HTTP/1.1" status: 200 len: 210 time: 0.1421213 Dec 09 21:28:19.932417 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-2db0f11b-3491-4c5e-9b84-bfa6a42e0476 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:19.945784 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-2db0f11b-3491-4c5e-9b84-bfa6a42e0476 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:19.947198 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-426bd49f-4a37-409d-8e3e-fdad1210c396 service neutron] Pushing event updated for resources: {'Port': ['ID=fd5eccfa-9fff-46bc-a3bd-73a647cd826e,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:19.962370 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-2db0f11b-3491-4c5e-9b84-bfa6a42e0476 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:19.964297 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-2db0f11b-3491-4c5e-9b84-bfa6a42e0476 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.10 "GET /v2.0/networks?id=f0373886-3db8-47eb-af65-78244497171e&id=a859e4ba-764a-41c0-982d-5bf79a2797a1&id=a859e4ba-764a-41c0-982d-5bf79a2797a1&id=a859e4ba-764a-41c0-982d-5bf79a2797a1&id=a859e4ba-764a-41c0-982d-5bf79a2797a1&id=a133a939-2827-4fe6-81f5-14715631c0ec&id=a133a939-2827-4fe6-81f5-14715631c0ec HTTP/1.1" status: 200 len: 1990 time: 0.4962246 Dec 09 21:28:19.967400 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92d2d799-833b-46a3-9a67-c9731e44e826 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:19.969577 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] For port 24ef0d1e-7cfa-4ade-8f5e-466567bc5628, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:28:19.976187 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] For port 24ef0d1e-7cfa-4ade-8f5e-466567bc5628, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=24ef0d1e-7cfa-4ade-8f5e-466567bc5628,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:28:19.985322 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9f7d6430-2d53-4419-92b4-9975d4c7c3ab req-dc1c0d8c-55a5-43e5-ac92-330673b660dc tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:19.989439 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:19.994447 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-9a612330-8903-4a3c-8325-6a139877928e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:19.996533 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-9a612330-8903-4a3c-8325-6a139877928e service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=1b7916b634f74760a565cfeaef510cd9&device_id=3e0505b6-bf4a-4e37-aacd-7600f6833c41 HTTP/1.1" status: 200 len: 1095 time: 0.0889919 Dec 09 21:28:19.998196 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4693c872-a4d4-4722-9222-3f4ede7a4469 req-391a510d-04d2-4b73-837b-34b3e0b9456b tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:19.999793 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4693c872-a4d4-4722-9222-3f4ede7a4469 req-391a510d-04d2-4b73-837b-34b3e0b9456b tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 945 time: 0.5841453 Dec 09 21:28:20.023162 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['18bda486-9d6d-41a3-a260-dd244a3838b3', '2958b0be-15e5-48e2-b87a-6ffefd9a7859', '1ad36983-4549-4a03-a826-a31a08b98c98'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:28:20.055110 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:28:20.079683 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-148fe620-fb35-4f98-a71c-ffe7179c127e service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=fd5eccfa-9fff-46bc-a3bd-73a647cd826e HTTP/1.1" status: 200 len: 217 time: 0.0724781 Dec 09 21:28:20.106141 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc1c0d8c-55a5-43e5-ac92-330673b660dc tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Pushing event deleted for resources: {'Port': ['ID=fd466da6-f506-43e6-9800-156622bd2781,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:20.121744 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] Routers {'8f39d25d-26dd-4bce-b961-53cba1551e5d'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:28:20.122947 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:28:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['8f39d25d-26dd-4bce-b961-53cba1551e5d'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:28:20.143965 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-7927adbd-fa58-4f0c-a1fb-dfd77bf72be4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['aeb2bab7-ff50-46a7-b05d-e305ec6eab66']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:28:20.169839 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3e0505b6-bf4a-4e37-aacd-7600f6833c41', 'tag': 'fd5eccfa-9fff-46bc-a3bd-73a647cd826e'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:20.172306 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a87667cc-1a0d-427a-a15e-4aa6aac6ec42" -d '{"events": [{"name": "network-changed", "server_uuid": "3e0505b6-bf4a-4e37-aacd-7600f6833c41", "tag": "fd5eccfa-9fff-46bc-a3bd-73a647cd826e"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:20.193070 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-38cd541a-bc57-4641-8639-8ee0672af1f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:20.194962 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-38cd541a-bc57-4641-8639-8ee0672af1f0 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=50496955-1646-4079-acd4-a47e8cd175cb HTTP/1.1" status: 200 len: 852 time: 0.1072874 Dec 09 21:28:20.198940 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ada1c8ba-8b1c-4052-a7ba-109bc7972828 None None] Pushing event updated for resources: {'Port': ['ID=24ef0d1e-7cfa-4ade-8f5e-466567bc5628,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:20.226784 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4693c872-a4d4-4722-9222-3f4ede7a4469 req-8ccf6c45-d641-43b3-bbff-ca4d02997b75 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1498528 Dec 09 21:28:20.233660 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a559082e-54a6-4c2e-b5c1-5d754f08f074 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Made reservation on behalf of 0a5d0e4652be4d8b87936a559840cc87 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:20.235081 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-468320e9-0e8b-4a3f-8174-342845dee90f service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0317776 Dec 09 21:28:20.238072 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a559082e-54a6-4c2e-b5c1-5d754f08f074 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:20.267676 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-7927adbd-fa58-4f0c-a1fb-dfd77bf72be4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b8767565-da80-43d4-b04b-2d0055e64978') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:28:20.268066 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-7927adbd-fa58-4f0c-a1fb-dfd77bf72be4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b8767565-da80-43d4-b04b-2d0055e64978') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:28:20.270392 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-9f7d6430-2d53-4419-92b4-9975d4c7c3ab req-dc1c0d8c-55a5-43e5-ac92-330673b660dc tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] No DVR routers for this DVR port fd466da6-f506-43e6-9800-156622bd2781 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:28:20.274133 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9f7d6430-2d53-4419-92b4-9975d4c7c3ab req-dc1c0d8c-55a5-43e5-ac92-330673b660dc tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:20.278444 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f7d6430-2d53-4419-92b4-9975d4c7c3ab req-dc1c0d8c-55a5-43e5-ac92-330673b660dc tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.10 "DELETE /v2.0/ports/fd466da6-f506-43e6-9800-156622bd2781 HTTP/1.1" status: 204 len: 173 time: 2.6577256 Dec 09 21:28:20.300100 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c7f45d89-875f-4294-9fcb-17f7fc994b3f', 'name': 'network-vif-deleted', 'tag': 'fd466da6-f506-43e6-9800-156622bd2781'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:20.304490 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e11d6e3a-10c7-446d-9a21-4daac5bd8d7c" -d '{"events": [{"server_uuid": "c7f45d89-875f-4294-9fcb-17f7fc994b3f", "name": "network-vif-deleted", "tag": "fd466da6-f506-43e6-9800-156622bd2781"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:20.321027 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7927adbd-fa58-4f0c-a1fb-dfd77bf72be4 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:20.374777 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7927adbd-fa58-4f0c-a1fb-dfd77bf72be4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:20.386412 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c375cdd-0ec6-4f18-acbc-8392d2782420 req-5c21a080-6ec8-4957-a0ff-6a546c66195d tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:20.396015 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3c375cdd-0ec6-4f18-acbc-8392d2782420 req-5c21a080-6ec8-4957-a0ff-6a546c66195d tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 945 time: 0.3514550 Dec 09 21:28:20.417677 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-8eae3739-826d-46ea-a4e2-7cae09e6f786 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.10 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=03e962eb7f5e4325a7c08c8b1e2a4cea HTTP/1.1" status: 200 len: 380 time: 0.4168553 Dec 09 21:28:20.425139 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a559082e-54a6-4c2e-b5c1-5d754f08f074 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] vlan segment allocate from pool success with {'vlan_id': 145, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:28:20.434609 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7927adbd-fa58-4f0c-a1fb-dfd77bf72be4 admin admin] Releasing vlan 128 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:28:20.435407 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7927adbd-fa58-4f0c-a1fb-dfd77bf72be4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:20.435823 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] Set router 8f39d25d-26dd-4bce-b961-53cba1551e5d gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:28:20.444265 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:28:20.475337 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-dd45e6a1-ac18-4506-9e2d-e9fa9f064397 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Request body: {'port': {'device_id': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'network_id': 'f0373886-3db8-47eb-af65-78244497171e', 'admin_state_up': True, 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'security_groups': ['7eb72df0-7940-41d2-b7f8-e0c3cff1ced2']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:20.483686 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-53ca8bad-1aee-4620-ae0d-a584d7df0f5e service neutron] 10.222.0.10 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2244158 Dec 09 21:28:20.486085 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0e4c12e5-aa3a-486f-82c2-626c8235d4d9 x-openstack-request-id: req-0e4c12e5-aa3a-486f-82c2-626c8235d4d9 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:20.486371 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3e0505b6-bf4a-4e37-aacd-7600f6833c41", "tag": "fd5eccfa-9fff-46bc-a3bd-73a647cd826e", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:20.486620 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0e4c12e5-aa3a-486f-82c2-626c8235d4d9 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:20.490593 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3e0505b6-bf4a-4e37-aacd-7600f6833c41', 'tag': 'fd5eccfa-9fff-46bc-a3bd-73a647cd826e', 'status': 'completed', 'code': 200} Dec 09 21:28:20.507393 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6efe99cb-cac5-4c74-a6d2-264c01c643b2 req-17d239e5-5a86-4170-87dd-1df5a1f7df53 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 210 time: 0.1045520 Dec 09 21:28:20.527924 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a559082e-54a6-4c2e-b5c1-5d754f08f074 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:20.528486 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-a559082e-54a6-4c2e-b5c1-5d754f08f074 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Added segment a40eb34b-04cf-427f-a562-8a47c01a297b of type vlan for network ae9d25d5-c9a2-4627-a465-8324b17541d9 Dec 09 21:28:20.551724 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-92d2d799-833b-46a3-9a67-c9731e44e826 admin admin] Allocated IP 172.20.0.1 (e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8/ace82e8b-012a-4184-a81e-5303eecf12ff/a9a5d2ec-b408-4729-99d3-0e4f8f041e60) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:20.666361 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3c375cdd-0ec6-4f18-acbc-8392d2782420 req-d56e7e2c-23ff-4ed5-b985-b4fa2ae67074 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2690291 Dec 09 21:28:20.735361 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f68d5a58-abd2-4043-9428-120b7b2578a7 req-032ea8d3-d71c-47d1-9a95-ca50578cadcb service neutron] 10.222.0.10 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2381940 Dec 09 21:28:20.785448 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7927adbd-fa58-4f0c-a1fb-dfd77bf72be4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:20.788330 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8c2e1d49-799d-46fd-8fce-4752de6e2b02 x-openstack-request-id: req-8c2e1d49-799d-46fd-8fce-4752de6e2b02 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:20.788737 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c7f45d89-875f-4294-9fcb-17f7fc994b3f", "name": "network-vif-deleted", "tag": "fd466da6-f506-43e6-9800-156622bd2781", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:20.792588 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8c2e1d49-799d-46fd-8fce-4752de6e2b02 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:20.793207 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c7f45d89-875f-4294-9fcb-17f7fc994b3f', 'name': 'network-vif-deleted', 'tag': 'fd466da6-f506-43e6-9800-156622bd2781', 'status': 'completed', 'code': 200} Dec 09 21:28:20.845914 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'name': 'tempest-AttachVolumeShelveTestJSON-236206179-router', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203'}], 'enable_snat': True}, 'gw_port_id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:14Z', 'updated_at': '2021-12-09T21:28:16Z', 'revision_number': 3, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'gw_port': {'id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:4c:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1175, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:15Z', 'updated_at': '2021-12-09T21:28:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:28:20.871397 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7927adbd-fa58-4f0c-a1fb-dfd77bf72be4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:20.875279 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7927adbd-fa58-4f0c-a1fb-dfd77bf72be4 admin admin] 10.222.0.13 "DELETE /v2.0/networks/aeb2bab7-ff50-46a7-b05d-e305ec6eab66 HTTP/1.1" status: 204 len: 168 time: 2.2285430 Dec 09 21:28:20.891834 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a87667cc-1a0d-427a-a15e-4aa6aac6ec42 req-ccbf16f9-09cc-47a0-87e9-2ac97eec26b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:20.896900 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a559082e-54a6-4c2e-b5c1-5d754f08f074 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:20.904885 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a87667cc-1a0d-427a-a15e-4aa6aac6ec42 req-ccbf16f9-09cc-47a0-87e9-2ac97eec26b1 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=1b7916b634f74760a565cfeaef510cd9&device_id=3e0505b6-bf4a-4e37-aacd-7600f6833c41 HTTP/1.1" status: 200 len: 1095 time: 0.0755961 Dec 09 21:28:20.926830 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-064fcad9-f36d-452b-92bd-9ba6c1075d59 None None] The sync data for ids ['8f39d25d-26dd-4bce-b961-53cba1551e5d'] in n-d-713301-27 is: [{'id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'name': 'tempest-AttachVolumeShelveTestJSON-236206179-router', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203'}], 'enable_snat': True}, 'gw_port_id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:14Z', 'updated_at': '2021-12-09T21:28:16Z', 'revision_number': 3, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'gw_port': {'id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:4c:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1175, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:15Z', 'updated_at': '2021-12-09T21:28:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:28:21.025744 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7927adbd-fa58-4f0c-a1fb-dfd77bf72be4 admin admin] Pushing event deleted for resources: {'Network': ['ID=aeb2bab7-ff50-46a7-b05d-e305ec6eab66,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:21.098274 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92d2d799-833b-46a3-9a67-c9731e44e826 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:21.148872 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41580) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:21.183845 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a47919-6526-4fd9-a3a0-0871f3d1390d req-0f6544b5-46e4-4021-a83b-02b3174e52f1 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:21.192079 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85a47919-6526-4fd9-a3a0-0871f3d1390d req-0f6544b5-46e4-4021-a83b-02b3174e52f1 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=3e0505b6-bf4a-4e37-aacd-7600f6833c41 HTTP/1.1" status: 200 len: 943 time: 0.3504627 Dec 09 21:28:21.200579 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a559082e-54a6-4c2e-b5c1-5d754f08f074 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:21.206670 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a559082e-54a6-4c2e-b5c1-5d754f08f074 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:21.207314 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a559082e-54a6-4c2e-b5c1-5d754f08f074 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:21.212288 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bdd6b726-8cc8-4786-85b4-f3316a4c43d8 req-3cb816a0-d755-49a1-84eb-06a9f7ab2c7b tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=c7f45d89-875f-4294-9fcb-17f7fc994b3f HTTP/1.1" status: 200 len: 210 time: 0.1266098 Dec 09 21:28:21.219994 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-dd45e6a1-ac18-4506-9e2d-e9fa9f064397 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Made reservation on behalf of 03e962eb7f5e4325a7c08c8b1e2a4cea for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:21.227332 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a87667cc-1a0d-427a-a15e-4aa6aac6ec42 req-32350649-9027-4fb0-8bf1-4d7123057c9b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:21.229112 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a87667cc-1a0d-427a-a15e-4aa6aac6ec42 req-32350649-9027-4fb0-8bf1-4d7123057c9b service neutron] 10.222.0.10 "GET /v2.0/networks?id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb HTTP/1.1" status: 200 len: 913 time: 0.3103404 Dec 09 21:28:21.231812 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-dd45e6a1-ac18-4506-9e2d-e9fa9f064397 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:21.248949 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-555238bc-e76b-4082-a21f-da7f976264f9 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=6461e253db534e9981d6b9bd1c31363f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0972290 Dec 09 21:28:21.252208 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41584) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:21.338974 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92d2d799-833b-46a3-9a67-c9731e44e826 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:21.361399 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a87667cc-1a0d-427a-a15e-4aa6aac6ec42 req-00e65bf0-2fbe-42a9-a12f-17501d5312cd service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=fd5eccfa-9fff-46bc-a3bd-73a647cd826e HTTP/1.1" status: 200 len: 217 time: 0.1101549 Dec 09 21:28:21.390178 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d3a77fc8-421c-4110-8f86-90fd322591e6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:21.397370 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a559082e-54a6-4c2e-b5c1-5d754f08f074 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 773 time: 1.8402708 Dec 09 21:28:21.418978 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d3a77fc8-421c-4110-8f86-90fd322591e6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:21.449520 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41586) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:21.465238 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c678b147-19a4-4173-85b3-fd4d1db423ca tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Request body: {'subnet': {'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c', 'cidr': '10.1.1.0/24', 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:21.511905 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92d2d799-833b-46a3-9a67-c9731e44e826 admin admin] Network e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:21.517478 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-92d2d799-833b-46a3-9a67-c9731e44e826 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:21.526182 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92d2d799-833b-46a3-9a67-c9731e44e826 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:21.547900 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a559082e-54a6-4c2e-b5c1-5d754f08f074 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event updated for resources: {'Network': ['ID=ae9d25d5-c9a2-4627-a465-8324b17541d9,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:21.574577 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network ae9d25d5-c9a2-4627-a465-8324b17541d9 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:28:21.602404 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92d2d799-833b-46a3-9a67-c9731e44e826 admin admin] Pushing event updated for resources: {'Port': ['ID=a9a5d2ec-b408-4729-99d3-0e4f8f041e60,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:21.649348 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92d2d799-833b-46a3-9a67-c9731e44e826 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:21.661968 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d3a77fc8-421c-4110-8f86-90fd322591e6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:21.665558 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 24ef0d1e-7cfa-4ade-8f5e-466567bc5628 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:28:21.665906 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d3a77fc8-421c-4110-8f86-90fd322591e6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:21.669792 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d3a77fc8-421c-4110-8f86-90fd322591e6 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/a75544ea-bc78-4b70-9d01-c8e6f7dc224d HTTP/1.1" status: 204 len: 168 time: 0.4139338 Dec 09 21:28:21.754576 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85a47919-6526-4fd9-a3a0-0871f3d1390d req-efba7475-73e7-427d-a5c1-3237f80ab412 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5608096 Dec 09 21:28:21.780574 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a87667cc-1a0d-427a-a15e-4aa6aac6ec42 req-762f0d4e-58fb-4593-ab65-0d0157bdd5c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:21.785504 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a87667cc-1a0d-427a-a15e-4aa6aac6ec42 req-762f0d4e-58fb-4593-ab65-0d0157bdd5c4 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=50496955-1646-4079-acd4-a47e8cd175cb HTTP/1.1" status: 200 len: 852 time: 0.4029777 Dec 09 21:28:21.844702 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3a77fc8-421c-4110-8f86-90fd322591e6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a75544ea-bc78-4b70-9d01-c8e6f7dc224d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:21.913523 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb7e8a13-db9e-497d-97da-d6e009119a26 req-7c26572c-ee1d-4a65-b4aa-3a4fab072858 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:21.913742 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 24ef0d1e-7cfa-4ade-8f5e-466567bc5628 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:21.913895 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:21.927975 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fb7e8a13-db9e-497d-97da-d6e009119a26 req-7c26572c-ee1d-4a65-b4aa-3a4fab072858 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 945 time: 0.5914259 Dec 09 21:28:21.936324 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a87667cc-1a0d-427a-a15e-4aa6aac6ec42 req-4aa5a829-cfd2-4da4-8261-358a1c307403 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1321733 Dec 09 21:28:21.965219 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d3b5bc4c-62bf-42db-9079-f4641eaac347 None None] Provisioning complete for port a9a5d2ec-b408-4729-99d3-0e4f8f041e60 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:21.965597 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d3b5bc4c-62bf-42db-9079-f4641eaac347 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:22.030275 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d3b5bc4c-62bf-42db-9079-f4641eaac347 None None] Port a9a5d2ec-b408-4729-99d3-0e4f8f041e60 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:28:22.070064 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:22.079676 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-dd45e6a1-ac18-4506-9e2d-e9fa9f064397 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Allocated IP 172.20.0.10 (f0373886-3db8-47eb-af65-78244497171e/65df7637-0210-4526-a5dd-a692c26062b4/90180a85-620b-470e-b808-b635138111be) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:22.095586 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 24ef0d1e-7cfa-4ade-8f5e-466567bc5628, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=24ef0d1e-7cfa-4ade-8f5e-466567bc5628,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:22.103174 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:22.146295 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c678b147-19a4-4173-85b3-fd4d1db423ca tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Made reservation on behalf of 0a5d0e4652be4d8b87936a559840cc87 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:22.154407 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c678b147-19a4-4173-85b3-fd4d1db423ca tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:22.192364 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=24ef0d1e-7cfa-4ade-8f5e-466567bc5628,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:22.262748 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92d2d799-833b-46a3-9a67-c9731e44e826 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:22.279833 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a87667cc-1a0d-427a-a15e-4aa6aac6ec42 req-8b1be132-89cf-4660-8591-2724e00a4700 service neutron] 10.222.0.10 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3305364 Dec 09 21:28:22.520876 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b7550a9-6f32-4a0f-8e78-3aa650fe89ba req-705348f0-ec38-4d17-9db7-b1c750a8ceac tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 210 time: 0.5320234 Dec 09 21:28:22.531033 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c678b147-19a4-4173-85b3-fd4d1db423ca tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:22.570731 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a87667cc-1a0d-427a-a15e-4aa6aac6ec42 req-212c0a23-20ad-41ac-96a9-a8b8423650ad service neutron] 10.222.0.10 "GET /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2363536 Dec 09 21:28:22.658855 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device fd5eccfa-9fff-46bc-a3bd-73a647cd826e details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:28:22.664964 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device fd466da6-f506-43e6-9800-156622bd2781 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:28:22.677798 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92d2d799-833b-46a3-9a67-c9731e44e826 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:22.690518 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92d2d799-833b-46a3-9a67-c9731e44e826 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:22.731072 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fb7e8a13-db9e-497d-97da-d6e009119a26 req-146929a0-db1d-4297-b716-977b2162d2f3 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7977090 Dec 09 21:28:22.759668 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: fd466da6-f506-43e6-9800-156622bd2781 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:28:22.760013 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device fd466da6-f506-43e6-9800-156622bd2781 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:28:22.768073 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92d2d799-833b-46a3-9a67-c9731e44e826 admin admin] Pushing event updated for resources: {'Port': ['ID=a9a5d2ec-b408-4729-99d3-0e4f8f041e60,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:22.781563 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92d2d799-833b-46a3-9a67-c9731e44e826 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:22.792681 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c678b147-19a4-4173-85b3-fd4d1db423ca tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event updated for resources: {'Subnet': ['ID=871c2dc1-486e-4fcf-a882-5a1394082fc5,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:22.938134 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-dd45e6a1-ac18-4506-9e2d-e9fa9f064397 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:22.952309 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eea7043e-456b-4795-b69c-27543a82733a req-6d98e2df-deef-4899-bc14-dc3feaf09591 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:22.954111 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eea7043e-456b-4795-b69c-27543a82733a req-6d98e2df-deef-4899-bc14-dc3feaf09591 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 945 time: 0.3042440 Dec 09 21:28:22.960756 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c678b147-19a4-4173-85b3-fd4d1db423ca tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Checking segment: {'id': '06cdf949-c592-4827-b617-66043758d462', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:22.961210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c678b147-19a4-4173-85b3-fd4d1db423ca tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Network hostable DHCP agents. Network: 69c5e9e4-78c6-4a6b-9b16-9f1da643282c, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:28:22.989738 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92d2d799-833b-46a3-9a67-c9731e44e826 admin admin] Network e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:23.002248 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-92d2d799-833b-46a3-9a67-c9731e44e826 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:23.066019 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port fd5eccfa-9fff-46bc-a3bd-73a647cd826e, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=fd5eccfa-9fff-46bc-a3bd-73a647cd826e,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:23.083061 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eea7043e-456b-4795-b69c-27543a82733a req-a82e2816-6168-467b-98b4-5813dc912524 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1160476 Dec 09 21:28:23.083888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c678b147-19a4-4173-85b3-fd4d1db423ca tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:28:23.099270 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'fd5eccfa-9fff-46bc-a3bd-73a647cd826e', 'network_id': '43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb', 'port_id': 'fd5eccfa-9fff-46bc-a3bd-73a647cd826e', 'mac_address': 'fa:16:3e:d0:12:d8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 101, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '50496955-1646-4079-acd4-a47e8cd175cb', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:28:23.117676 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a550aa8-5a6a-4b3a-aef8-13d15bc87b70 req-64832523-a351-4ba0-927f-08af9732a38f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:23.126248 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a550aa8-5a6a-4b3a-aef8-13d15bc87b70 req-64832523-a351-4ba0-927f-08af9732a38f tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=3e0505b6-bf4a-4e37-aacd-7600f6833c41 HTTP/1.1" status: 200 len: 943 time: 0.1688886 Dec 09 21:28:23.136780 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-c678b147-19a4-4173-85b3-fd4d1db423ca tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 69c5e9e4-78c6-4a6b-9b16-9f1da643282c) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:23.143652 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c678b147-19a4-4173-85b3-fd4d1db423ca tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:23.146113 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c678b147-19a4-4173-85b3-fd4d1db423ca tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:23.174480 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-dd45e6a1-ac18-4506-9e2d-e9fa9f064397 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:23.176997 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-750b6627-997d-4ed5-9e4d-a26b228e9372 None None] Network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:28:23.221156 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c678b147-19a4-4173-85b3-fd4d1db423ca tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 794 time: 1.7643566 Dec 09 21:28:23.224545 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41620) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:23.243123 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-4875bd86-af00-4036-b86d-b30a8a934404 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Request body: {'subnet': {'network_id': 'ae9d25d5-c9a2-4627-a465-8324b17541d9', 'cidr': '10.2.2.0/24', 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:23.268724 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-dd45e6a1-ac18-4506-9e2d-e9fa9f064397 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Network f0373886-3db8-47eb-af65-78244497171e is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:23.309110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-dd45e6a1-ac18-4506-9e2d-e9fa9f064397 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:23.313134 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-dd45e6a1-ac18-4506-9e2d-e9fa9f064397 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:23.351115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-92d2d799-833b-46a3-9a67-c9731e44e826 admin admin] Router 8f39d25d-26dd-4bce-b961-53cba1551e5d has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:28:23.389205 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-dd45e6a1-ac18-4506-9e2d-e9fa9f064397 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:23.391730 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:23.392140 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-dd45e6a1-ac18-4506-9e2d-e9fa9f064397 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:23.455521 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-dd45e6a1-ac18-4506-9e2d-e9fa9f064397 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.0081561 Dec 09 21:28:23.477027 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fd5eccfa-9fff-46bc-a3bd-73a647cd826e {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:28:23.496630 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-c64eb737-13da-4577-b623-8404d50c380e tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Request body: {'port': {'device_id': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1', 'admin_state_up': True, 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'security_groups': ['7eb72df0-7940-41d2-b7f8-e0c3cff1ced2']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:23.504881 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port fd5eccfa-9fff-46bc-a3bd-73a647cd826e, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=fd5eccfa-9fff-46bc-a3bd-73a647cd826e,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:23.519262 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:23.642657 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-92d2d799-833b-46a3-9a67-c9731e44e826 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:28:23.649390 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-92d2d799-833b-46a3-9a67-c9731e44e826 admin admin] 10.222.0.13 "PUT /v2.0/routers/8f39d25d-26dd-4bce-b961-53cba1551e5d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.0731897 Dec 09 21:28:23.692146 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd45e6a1-ac18-4506-9e2d-e9fa9f064397 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event updated for resources: {'Port': ['ID=90180a85-620b-470e-b808-b635138111be,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:23.750549 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 24ef0d1e-7cfa-4ade-8f5e-466567bc5628 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:28:23.823580 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a550aa8-5a6a-4b3a-aef8-13d15bc87b70 req-04ba548b-8f56-4b18-a92a-5062e41d788a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6962254 Dec 09 21:28:23.864460 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] Sync routers for ids ['8f39d25d-26dd-4bce-b961-53cba1551e5d'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:28:23.875688 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-c64eb737-13da-4577-b623-8404d50c380e tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Made reservation on behalf of 03e962eb7f5e4325a7c08c8b1e2a4cea for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:23.877306 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] Routers {'8f39d25d-26dd-4bce-b961-53cba1551e5d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:28:23.878225 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:28:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['8f39d25d-26dd-4bce-b961-53cba1551e5d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:28:23.879676 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-c64eb737-13da-4577-b623-8404d50c380e tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:23.939968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4875bd86-af00-4036-b86d-b30a8a934404 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Made reservation on behalf of 0a5d0e4652be4d8b87936a559840cc87 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:23.955458 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4875bd86-af00-4036-b86d-b30a8a934404 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:24.008051 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] Set router 8f39d25d-26dd-4bce-b961-53cba1551e5d gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:28:24.087604 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41642) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:24.160634 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-507f44f9-ec2a-4843-9add-fc8f7902adad None None] Provisioning complete for port a9a5d2ec-b408-4729-99d3-0e4f8f041e60 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:24.161001 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-507f44f9-ec2a-4843-9add-fc8f7902adad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:24.163730 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc0e5ca9-2938-4393-b075-1f76720a4412 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-69c5e9e4-78c6-4a6b-9b16-9f1da643282c', 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c', 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'fixed_ips': [{'subnet_id': '871c2dc1-486e-4fcf-a882-5a1394082fc5'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:28:24.164827 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fc0e5ca9-2938-4393-b075-1f76720a4412 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:24.208040 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=fd5eccfa-9fff-46bc-a3bd-73a647cd826e,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:24.224003 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['fd5eccfa-9fff-46bc-a3bd-73a647cd826e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:28:24.269484 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c4f0cfd3-86bb-4011-8305-834421df6334 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:24.270840 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'name': 'tempest-AttachVolumeShelveTestJSON-236206179-router', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203'}], 'enable_snat': True}, 'gw_port_id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:14Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'gw_port': {'id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:4c:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1175, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:15Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'a9a5d2ec-b408-4729-99d3-0e4f8f041e60', 'name': '', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'mac_address': 'fa:16:3e:40:0d:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1178, 'fixed_ips': [{'subnet_id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:19Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 2, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'subnets': [{'id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:28:24.295723 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8a73d29-ccf6-4642-9329-f938118b7f9b req-6efe7360-6ef7-4aeb-bb69-7f7441fac371 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:24.298972 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8a73d29-ccf6-4642-9329-f938118b7f9b req-6efe7360-6ef7-4aeb-bb69-7f7441fac371 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 932 time: 0.2118881 Dec 09 21:28:24.299771 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] Checking router: 8f39d25d-26dd-4bce-b961-53cba1551e5d for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:28:24.300398 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] Updating router 8f39d25d-26dd-4bce-b961-53cba1551e5d port a9a5d2ec-b408-4729-99d3-0e4f8f041e60 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:28:24.317613 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f468042-60d4-4a5e-992a-b18a29ca07f2 req-adfcbd8a-1eae-4b66-b0dd-3e1826a4585e tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:24.321516 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0f468042-60d4-4a5e-992a-b18a29ca07f2 req-adfcbd8a-1eae-4b66-b0dd-3e1826a4585e tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 945 time: 0.2356200 Dec 09 21:28:24.329844 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:24.383761 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-507f44f9-ec2a-4843-9add-fc8f7902adad None None] Port a9a5d2ec-b408-4729-99d3-0e4f8f041e60 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:28:24.447564 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c4f0cfd3-86bb-4011-8305-834421df6334 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:24.457064 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c4f0cfd3-86bb-4011-8305-834421df6334 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:24.494504 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 24ef0d1e-7cfa-4ade-8f5e-466567bc5628 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:24.494504 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:24.513738 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c4f0cfd3-86bb-4011-8305-834421df6334 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=444db39d5326423b960de3eb296dda69&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4225914 Dec 09 21:28:24.517886 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41648) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:24.567133 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-fc0e5ca9-2938-4393-b075-1f76720a4412 None None] Allocated IP 10.1.1.2 (69c5e9e4-78c6-4a6b-9b16-9f1da643282c/871c2dc1-486e-4fcf-a882-5a1394082fc5/c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:24.594287 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-fd031525-fd6c-48e4-9d4f-dd8495a236c0 None None] Provisioning complete for port 90180a85-620b-470e-b808-b635138111be triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:24.594617 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fd031525-fd6c-48e4-9d4f-dd8495a236c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:24.634930 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4f0cfd3-86bb-4011-8305-834421df6334 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=10c0d611-73ed-4471-b580-73c87a7aaace,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:24.666417 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:24.679112 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:24.688879 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-322ff18a-be41-4526-b86b-238dd89044db admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:24.721070 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-322ff18a-be41-4526-b86b-238dd89044db admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:24.742911 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eed5d0ca-832c-4442-96ce-c19c5544e4b6 None None] Pushing event updated for resources: {'Port': ['ID=a9a5d2ec-b408-4729-99d3-0e4f8f041e60,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:24.757774 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eed5d0ca-832c-4442-96ce-c19c5544e4b6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:24.758112 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eed5d0ca-832c-4442-96ce-c19c5544e4b6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:24.758449 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eed5d0ca-832c-4442-96ce-c19c5544e4b6 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:24.759233 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eed5d0ca-832c-4442-96ce-c19c5544e4b6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:24.759233 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eed5d0ca-832c-4442-96ce-c19c5544e4b6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:24.759564 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eed5d0ca-832c-4442-96ce-c19c5544e4b6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:24.759803 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eed5d0ca-832c-4442-96ce-c19c5544e4b6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:24.760119 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eed5d0ca-832c-4442-96ce-c19c5544e4b6 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:24.760435 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eed5d0ca-832c-4442-96ce-c19c5544e4b6 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:24.760749 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eed5d0ca-832c-4442-96ce-c19c5544e4b6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:24.761064 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eed5d0ca-832c-4442-96ce-c19c5544e4b6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:24.761378 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eed5d0ca-832c-4442-96ce-c19c5544e4b6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:24.761687 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eed5d0ca-832c-4442-96ce-c19c5544e4b6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:24.828370 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-322ff18a-be41-4526-b86b-238dd89044db admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:24.831591 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-322ff18a-be41-4526-b86b-238dd89044db admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:24.832894 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-322ff18a-be41-4526-b86b-238dd89044db admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/10c0d611-73ed-4471-b580-73c87a7aaace HTTP/1.1" status: 204 len: 168 time: 0.3087058 Dec 09 21:28:24.865081 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-322ff18a-be41-4526-b86b-238dd89044db admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=10c0d611-73ed-4471-b580-73c87a7aaace,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:24.886337 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] Attempting to bind port a9a5d2ec-b408-4729-99d3-0e4f8f041e60 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:28:24.887367 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] Attempting to bind port a9a5d2ec-b408-4729-99d3-0e4f8f041e60 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'ad90d3b7-fe41-4a28-acd8-4c934cf4d57c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:28:24.887917 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] Attempting to bind port a9a5d2ec-b408-4729-99d3-0e4f8f041e60 on network e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:24.895613 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fc0e5ca9-2938-4393-b075-1f76720a4412 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:24.896943 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:28:24.898630 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] Checking segment: {'id': 'ad90d3b7-fe41-4a28-acd8-4c934cf4d57c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:24.900249 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:24.901707 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] Bound using segment: {'id': 'ad90d3b7-fe41-4a28-acd8-4c934cf4d57c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:28:24.902842 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] Bound port: a9a5d2ec-b408-4729-99d3-0e4f8f041e60, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ad90d3b7-fe41-4a28-acd8-4c934cf4d57c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:28:24.906057 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:24.926009 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fc0e5ca9-2938-4393-b075-1f76720a4412 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:24.928828 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-fd031525-fd6c-48e4-9d4f-dd8495a236c0 None None] Port 90180a85-620b-470e-b808-b635138111be cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:28:25.007028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc0e5ca9-2938-4393-b075-1f76720a4412 None None] Pushing event updated for resources: {'Port': ['ID=c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:25.035699 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-c64eb737-13da-4577-b623-8404d50c380e tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Allocated IP 10.1.1.110 (a859e4ba-764a-41c0-982d-5bf79a2797a1/a894075b-fa9f-4a27-9782-e476e86f74e0/7b66d328-f18c-4d26-af51-99c1b1f1f05e) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:25.037120 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc0e5ca9-2938-4393-b075-1f76720a4412 None None] Network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:25.041719 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-fc0e5ca9-2938-4393-b075-1f76720a4412 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:25.047689 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc0e5ca9-2938-4393-b075-1f76720a4412 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:25.098648 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0f468042-60d4-4a5e-992a-b18a29ca07f2 req-0a2e6fbc-68a3-41d4-a01a-03e992859d23 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7534838 Dec 09 21:28:25.194889 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] For port a9a5d2ec-b408-4729-99d3-0e4f8f041e60, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:28:25.198371 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] For port a9a5d2ec-b408-4729-99d3-0e4f8f041e60, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a9a5d2ec-b408-4729-99d3-0e4f8f041e60,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:28:25.200966 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-fc0e5ca9-2938-4393-b075-1f76720a4412 None None] Attempting to bind port c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:28:25.201433 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-fc0e5ca9-2938-4393-b075-1f76720a4412 None None] Attempting to bind port c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '06cdf949-c592-4827-b617-66043758d462', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:28:25.201895 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc0e5ca9-2938-4393-b075-1f76720a4412 None None] Attempting to bind port c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9 on network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:25.207684 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:25.211905 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4c0abc54-0421-4c88-a7db-f4f404696633 None None] Provisioning complete for port a9a5d2ec-b408-4729-99d3-0e4f8f041e60 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:25.213644 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4c0abc54-0421-4c88-a7db-f4f404696633 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:25.215412 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc0e5ca9-2938-4393-b075-1f76720a4412 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:28:25.215857 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc0e5ca9-2938-4393-b075-1f76720a4412 None None] Checking segment: {'id': '06cdf949-c592-4827-b617-66043758d462', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:25.216407 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fc0e5ca9-2938-4393-b075-1f76720a4412 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:25.216879 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc0e5ca9-2938-4393-b075-1f76720a4412 None None] Bound using segment: {'id': '06cdf949-c592-4827-b617-66043758d462', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:28:25.218130 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-fc0e5ca9-2938-4393-b075-1f76720a4412 None None] Bound port: c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '06cdf949-c592-4827-b617-66043758d462', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:28:25.218526 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fc0e5ca9-2938-4393-b075-1f76720a4412 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:25.240252 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8a73d29-ccf6-4642-9329-f938118b7f9b req-449befb6-0753-42ae-af31-1a271dee9a8f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.9134593 Dec 09 21:28:25.335293 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] Routers {'8f39d25d-26dd-4bce-b961-53cba1551e5d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:28:25.335969 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:28:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['8f39d25d-26dd-4bce-b961-53cba1551e5d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:28:25.486340 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4875bd86-af00-4036-b86d-b30a8a934404 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:25.494210 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eed5d0ca-832c-4442-96ce-c19c5544e4b6 None None] Pushing event updated for resources: {'Port': ['ID=a9a5d2ec-b408-4729-99d3-0e4f8f041e60,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:25.575929 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4c0abc54-0421-4c88-a7db-f4f404696633 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:25.641616 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-fc0e5ca9-2938-4393-b075-1f76720a4412 None None] For port c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:28:25.647992 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-294856dc-bda3-464c-99c3-f124201c3113 req-45b8d02d-9797-4696-95c0-7f8cb7401811 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:25.651478 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-294856dc-bda3-464c-99c3-f124201c3113 req-45b8d02d-9797-4696-95c0-7f8cb7401811 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "GET /v2.0/ports?device_id=2cfba12a-761e-445b-bf14-a19d38aeeeb0 HTTP/1.1" status: 200 len: 950 time: 0.1988528 Dec 09 21:28:25.694156 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-4c0abc54-0421-4c88-a7db-f4f404696633 None None] For port a9a5d2ec-b408-4729-99d3-0e4f8f041e60, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a9a5d2ec-b408-4729-99d3-0e4f8f041e60,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:25.703369 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-fc0e5ca9-2938-4393-b075-1f76720a4412 None None] For port c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:28:25.711575 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4c0abc54-0421-4c88-a7db-f4f404696633 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:25.769761 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fc0e5ca9-2938-4393-b075-1f76720a4412 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:25.772380 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4875bd86-af00-4036-b86d-b30a8a934404 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event updated for resources: {'Subnet': ['ID=2b4dff83-a3e7-4d10-a901-43c21154e5da,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:25.782663 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] Set router 8f39d25d-26dd-4bce-b961-53cba1551e5d gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:28:25.844845 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-294856dc-bda3-464c-99c3-f124201c3113 req-580c535d-97f3-4585-957e-253679f4348b tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Deleting port 1ad36983-4549-4a03-a826-a31a08b98c98 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:28:25.845523 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-294856dc-bda3-464c-99c3-f124201c3113 req-580c535d-97f3-4585-957e-253679f4348b tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:25.881504 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-c64eb737-13da-4577-b623-8404d50c380e tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:25.884720 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-10e2ccf5-243e-4873-9077-f585a3820059 None None] Provisioning complete for port a9a5d2ec-b408-4729-99d3-0e4f8f041e60 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:25.887423 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-10e2ccf5-243e-4873-9077-f585a3820059 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:25.966219 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4875bd86-af00-4036-b86d-b30a8a934404 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Checking segment: {'id': 'a40eb34b-04cf-427f-a562-8a47c01a297b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'ae9d25d5-c9a2-4627-a465-8324b17541d9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:25.968378 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4875bd86-af00-4036-b86d-b30a8a934404 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Network hostable DHCP agents. Network: ae9d25d5-c9a2-4627-a465-8324b17541d9, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:28:25.995717 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c0abc54-0421-4c88-a7db-f4f404696633 None None] Pushing event updated for resources: {'Port': ['ID=a9a5d2ec-b408-4729-99d3-0e4f8f041e60,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:26.068690 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4875bd86-af00-4036-b86d-b30a8a934404 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Network ae9d25d5-c9a2-4627-a465-8324b17541d9 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:28:26.086695 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-294856dc-bda3-464c-99c3-f124201c3113 req-580c535d-97f3-4585-957e-253679f4348b tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] For port 1ad36983-4549-4a03-a826-a31a08b98c98, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1ad36983-4549-4a03-a826-a31a08b98c98,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:26.090817 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-294856dc-bda3-464c-99c3-f124201c3113 req-580c535d-97f3-4585-957e-253679f4348b tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:26.093830 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df52046e-528c-465c-9df6-4333d8c2a780 req-8146f67c-f9b0-47d2-93fc-6018c29f2c0a tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:26.102478 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df52046e-528c-465c-9df6-4333d8c2a780 req-8146f67c-f9b0-47d2-93fc-6018c29f2c0a tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 945 time: 0.2685897 Dec 09 21:28:26.128862 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-294856dc-bda3-464c-99c3-f124201c3113 req-580c535d-97f3-4585-957e-253679f4348b tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Calling delete_port for 1ad36983-4549-4a03-a826-a31a08b98c98 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:28:26.215309 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-4875bd86-af00-4036-b86d-b30a8a934404 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, ae9d25d5-c9a2-4627-a465-8324b17541d9) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:26.218588 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc0e5ca9-2938-4393-b075-1f76720a4412 None None] Pushing event updated for resources: {'Port': ['ID=c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:26.231665 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-adbb79b1-825f-4159-8075-5c47c55678e5 None None] Network ae9d25d5-c9a2-4627-a465-8324b17541d9 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:28:26.256589 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4875bd86-af00-4036-b86d-b30a8a934404 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:26.259267 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4875bd86-af00-4036-b86d-b30a8a934404 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:26.270479 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-c64eb737-13da-4577-b623-8404d50c380e tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:26.391831 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41678) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:26.392586 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df52046e-528c-465c-9df6-4333d8c2a780 req-94526bed-b070-4e13-9854-c695b97b7801 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2885971 Dec 09 21:28:26.405517 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-e38ba239-9503-470a-9936-afc50d7811c9 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1988309227', 'description': 'tempest-description--1826254416'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:26.418026 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22c83fc3-a0dd-4183-a87f-11ba103223e3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-ae9d25d5-c9a2-4627-a465-8324b17541d9', 'network_id': 'ae9d25d5-c9a2-4627-a465-8324b17541d9', 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'fixed_ips': [{'subnet_id': '2b4dff83-a3e7-4d10-a901-43c21154e5da'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:28:26.418939 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-22c83fc3-a0dd-4183-a87f-11ba103223e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:26.427574 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'name': 'tempest-AttachVolumeShelveTestJSON-236206179-router', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203'}], 'enable_snat': True}, 'gw_port_id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:14Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'gw_port': {'id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:4c:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1175, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:15Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'a9a5d2ec-b408-4729-99d3-0e4f8f041e60', 'name': '', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'mac_address': 'fa:16:3e:40:0d:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1178, 'fixed_ips': [{'subnet_id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:19Z', 'updated_at': '2021-12-09T21:28:25Z', 'revision_number': 4, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'subnets': [{'id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:28:26.470377 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e38ba239-9503-470a-9936-afc50d7811c9 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:26.505587 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd1044ee-0ecf-4c02-a977-08dac8ceec9f None None] The sync data for ids ['8f39d25d-26dd-4bce-b961-53cba1551e5d'] in n-d-713301-27 is: [{'id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'name': 'tempest-AttachVolumeShelveTestJSON-236206179-router', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203'}], 'enable_snat': True}, 'gw_port_id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:14Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'gw_port': {'id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:4c:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1175, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:15Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'a9a5d2ec-b408-4729-99d3-0e4f8f041e60', 'name': '', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'mac_address': 'fa:16:3e:40:0d:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1178, 'fixed_ips': [{'subnet_id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:19Z', 'updated_at': '2021-12-09T21:28:25Z', 'revision_number': 4, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'subnets': [{'id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:28:26.539925 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4875bd86-af00-4036-b86d-b30a8a934404 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 794 time: 3.3110168 Dec 09 21:28:26.573022 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e38ba239-9503-470a-9936-afc50d7811c9 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:26.601722 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41682) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:26.611344 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2f2bc6a9-92c4-46e2-86e0-c833f42eb25a tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Request body: {'port': {'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c', 'name': 'tempest-TaggedBootDevicesTest_v242-743158802', 'fixed_ips': [{'subnet_id': '871c2dc1-486e-4fcf-a882-5a1394082fc5'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:26.615117 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e38ba239-9503-470a-9936-afc50d7811c9 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:26.666931 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e38ba239-9503-470a-9936-afc50d7811c9 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:26.671288 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e38ba239-9503-470a-9936-afc50d7811c9 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1799 time: 0.2749796 Dec 09 21:28:26.673072 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device fd5eccfa-9fff-46bc-a3bd-73a647cd826e up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:28:26.680147 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41684) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:26.680488 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41686) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:26.698535 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2d4eb5ee-d6ac-47b5-be6c-a10a458e48e5 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Request body: {'security_group_rule': {'security_group_id': 'df0eeb44-314a-4a29-a8ce-fccee69f8fe4', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:26.758126 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e38ba239-9503-470a-9936-afc50d7811c9 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Pushing event updated for resources: {'SecurityGroup': ['ID=df0eeb44-314a-4a29-a8ce-fccee69f8fe4,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:26.758660 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-c64eb737-13da-4577-b623-8404d50c380e tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Network a859e4ba-764a-41c0-982d-5bf79a2797a1 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:26.783475 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-294856dc-bda3-464c-99c3-f124201c3113 req-580c535d-97f3-4585-957e-253679f4348b tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:26.783767 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-c64eb737-13da-4577-b623-8404d50c380e tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:26.790067 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-c64eb737-13da-4577-b623-8404d50c380e tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:26.801198 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c64eb737-13da-4577-b623-8404d50c380e tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event updated for resources: {'Port': ['ID=7b66d328-f18c-4d26-af51-99c1b1f1f05e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:26.886894 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['18bda486-9d6d-41a3-a260-dd244a3838b3', '2958b0be-15e5-48e2-b87a-6ffefd9a7859'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:28:26.949482 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-c64eb737-13da-4577-b623-8404d50c380e tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:26.953256 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-c64eb737-13da-4577-b623-8404d50c380e tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:26.977182 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f156478-08d0-4b64-81b4-f50af170bfad req-186adf5b-8122-4dfc-9d8d-6a0802989865 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:27.003773 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f156478-08d0-4b64-81b4-f50af170bfad req-186adf5b-8122-4dfc-9d8d-6a0802989865 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=2cfba12a-761e-445b-bf14-a19d38aeeeb0 HTTP/1.1" status: 200 len: 867 time: 0.4881341 Dec 09 21:28:27.019177 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4efe4265-699d-4acb-bed8-c3e6a66c3439 req-d9d2a259-5375-4539-aaf6-6304742acb31 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:27.032486 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4efe4265-699d-4acb-bed8-c3e6a66c3439 req-d9d2a259-5375-4539-aaf6-6304742acb31 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=3e0505b6-bf4a-4e37-aacd-7600f6833c41 HTTP/1.1" status: 200 len: 944 time: 0.4717200 Dec 09 21:28:27.178350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4efe4265-699d-4acb-bed8-c3e6a66c3439 req-e1973e87-8f03-440d-9429-2afe3d02ce3a tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1451254 Dec 09 21:28:27.267299 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f156478-08d0-4b64-81b4-f50af170bfad req-268f6904-c7d8-4113-ba71-ed7988f48496 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2624776 Dec 09 21:28:27.342656 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-22c83fc3-a0dd-4183-a87f-11ba103223e3 None None] Allocated IP 10.2.2.2 (ae9d25d5-c9a2-4627-a465-8324b17541d9/2b4dff83-a3e7-4d10-a901-43c21154e5da/e89c3350-d1c3-4579-9a89-153f406f40ea) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:27.496011 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-0fea4cb0-8f5f-4c3e-a9c1-7265b25b0389 admin admin] Request body: {'network': {'name': 'tempest-ServersTestBootFromVolume-1721587557-network', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:27.502684 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-294856dc-bda3-464c-99c3-f124201c3113 req-580c535d-97f3-4585-957e-253679f4348b tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] No DVR routers for this DVR port 1ad36983-4549-4a03-a826-a31a08b98c98 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:28:27.507666 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-294856dc-bda3-464c-99c3-f124201c3113 req-580c535d-97f3-4585-957e-253679f4348b tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:27.512392 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-294856dc-bda3-464c-99c3-f124201c3113 req-580c535d-97f3-4585-957e-253679f4348b tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "DELETE /v2.0/ports/1ad36983-4549-4a03-a826-a31a08b98c98 HTTP/1.1" status: 204 len: 173 time: 1.8543022 Dec 09 21:28:27.520360 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2cfba12a-761e-445b-bf14-a19d38aeeeb0', 'name': 'network-vif-deleted', 'tag': '1ad36983-4549-4a03-a826-a31a08b98c98'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:27.522938 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0ec64263-0fbd-4ac2-afba-507e78b7006d" -d '{"events": [{"server_uuid": "2cfba12a-761e-445b-bf14-a19d38aeeeb0", "name": "network-vif-deleted", "tag": "1ad36983-4549-4a03-a826-a31a08b98c98"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:27.524182 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-c64eb737-13da-4577-b623-8404d50c380e tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 4.0574136 Dec 09 21:28:27.557954 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-aeddca29-9db7-478b-8555-3da65abb7b57 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Request body: {'port': {'device_id': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1', 'admin_state_up': True, 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'security_groups': ['7eb72df0-7940-41d2-b7f8-e0c3cff1ced2']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:27.579762 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-580c535d-97f3-4585-957e-253679f4348b tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Pushing event deleted for resources: {'Port': ['ID=1ad36983-4549-4a03-a826-a31a08b98c98,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:27.587731 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d4eb5ee-d6ac-47b5-be6c-a10a458e48e5 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:27.674600 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d4eb5ee-d6ac-47b5-be6c-a10a458e48e5 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:27.697912 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e5fd55e-df2e-48cf-8418-9319ebe8e9ff req-0072f2e2-e77c-4559-9c22-5239388d164b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:27.699064 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d4eb5ee-d6ac-47b5-be6c-a10a458e48e5 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:27.720103 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e5fd55e-df2e-48cf-8418-9319ebe8e9ff req-0072f2e2-e77c-4559-9c22-5239388d164b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:27.732663 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e5fd55e-df2e-48cf-8418-9319ebe8e9ff req-0072f2e2-e77c-4559-9c22-5239388d164b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 1654 time: 0.3260112 Dec 09 21:28:27.743517 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d4eb5ee-d6ac-47b5-be6c-a10a458e48e5 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2dc813ba-7a39-4c11-89bf-915eaa6586ef,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:27.798284 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-995d0ad8-858e-47df-a253-bbc1ea401a9a req-399949e3-0ac2-4ecb-bc8a-4ead834dd053 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:27.800767 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-995d0ad8-858e-47df-a253-bbc1ea401a9a req-399949e3-0ac2-4ecb-bc8a-4ead834dd053 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "GET /v2.0/ports?device_id=d3f455b1-1a56-4ded-ab82-e9ce51afbfde HTTP/1.1" status: 200 len: 950 time: 0.3652754 Dec 09 21:28:27.801468 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0fea4cb0-8f5f-4c3e-a9c1-7265b25b0389 admin admin] Made reservation on behalf of 77fc0831d6584a36b61a4823157f9c1d for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:27.803953 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0fea4cb0-8f5f-4c3e-a9c1-7265b25b0389 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:27.848056 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0fea4cb0-8f5f-4c3e-a9c1-7265b25b0389 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:27.866721 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08d87afb-be02-4606-8c15-901ee6dd47f6 req-8c759822-a8bb-452d-924c-c758a165060f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:27.867054 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d4eb5ee-d6ac-47b5-be6c-a10a458e48e5 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:27.869473 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-08d87afb-be02-4606-8c15-901ee6dd47f6 req-8c759822-a8bb-452d-924c-c758a165060f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 945 time: 0.5451720 Dec 09 21:28:27.871880 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2d4eb5ee-d6ac-47b5-be6c-a10a458e48e5 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.1870830 Dec 09 21:28:27.893922 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41694) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:27.917349 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1ad36983-4549-4a03-a826-a31a08b98c98 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:28:27.919948 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ac887c3b-b0de-4163-a4c7-1ffa5f9362b0 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Request body: {'security_group_rule': {'security_group_id': 'df0eeb44-314a-4a29-a8ce-fccee69f8fe4', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:27.921688 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-62e7d165-c6fd-493c-8d97-2413f40649af None None] Network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:28:27.923937 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a9a5d2ec-b408-4729-99d3-0e4f8f041e60 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:28:27.954097 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port fd5eccfa-9fff-46bc-a3bd-73a647cd826e completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:28:27.988886 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:28.009028 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:28.011945 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 1ad36983-4549-4a03-a826-a31a08b98c98 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:28:28.012516 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1ad36983-4549-4a03-a826-a31a08b98c98 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:28:28.017668 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2f2bc6a9-92c4-46e2-86e0-c833f42eb25a tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Made reservation on behalf of 0a5d0e4652be4d8b87936a559840cc87 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:28.050919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port fd5eccfa-9fff-46bc-a3bd-73a647cd826e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:28.051299 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:28.060538 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e5fd55e-df2e-48cf-8418-9319ebe8e9ff req-3771c393-c57e-4790-b778-118e76e39243 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3264380 Dec 09 21:28:28.065898 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-22c83fc3-a0dd-4183-a87f-11ba103223e3 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:28.096058 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-08d87afb-be02-4606-8c15-901ee6dd47f6 req-cfd9e851-54c1-42e2-b74a-edfe81d632d6 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2091749 Dec 09 21:28:28.117136 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac887c3b-b0de-4163-a4c7-1ffa5f9362b0 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:28.202737 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-aeddca29-9db7-478b-8555-3da65abb7b57 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Made reservation on behalf of 03e962eb7f5e4325a7c08c8b1e2a4cea for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:28.212640 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-22c83fc3-a0dd-4183-a87f-11ba103223e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:28.221714 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-aeddca29-9db7-478b-8555-3da65abb7b57 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:28.250285 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-71871653-f52e-45d6-8f91-3c164bd7fc0a x-openstack-request-id: req-71871653-f52e-45d6-8f91-3c164bd7fc0a {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:28.252503 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2cfba12a-761e-445b-bf14-a19d38aeeeb0", "name": "network-vif-deleted", "tag": "1ad36983-4549-4a03-a826-a31a08b98c98", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:28.252903 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-71871653-f52e-45d6-8f91-3c164bd7fc0a {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:28.253485 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2cfba12a-761e-445b-bf14-a19d38aeeeb0', 'name': 'network-vif-deleted', 'tag': '1ad36983-4549-4a03-a826-a31a08b98c98', 'status': 'completed', 'code': 200} Dec 09 21:28:28.368707 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-995d0ad8-858e-47df-a253-bbc1ea401a9a req-6c55a08c-0729-46a9-8928-39494e9faa15 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Deleting port 2958b0be-15e5-48e2-b87a-6ffefd9a7859 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:28:28.369290 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-995d0ad8-858e-47df-a253-bbc1ea401a9a req-6c55a08c-0729-46a9-8928-39494e9faa15 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:28.418284 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e42456f-3273-415a-97b1-8f77bd424879 req-8d25d7ce-2c0c-4c32-92cc-2ad1c3aca237 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:28.426809 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e42456f-3273-415a-97b1-8f77bd424879 req-8d25d7ce-2c0c-4c32-92cc-2ad1c3aca237 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 945 time: 0.2265937 Dec 09 21:28:28.477055 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-995d0ad8-858e-47df-a253-bbc1ea401a9a req-6c55a08c-0729-46a9-8928-39494e9faa15 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] For port 2958b0be-15e5-48e2-b87a-6ffefd9a7859, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2958b0be-15e5-48e2-b87a-6ffefd9a7859,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:28.477264 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-995d0ad8-858e-47df-a253-bbc1ea401a9a req-6c55a08c-0729-46a9-8928-39494e9faa15 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:28.491903 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-995d0ad8-858e-47df-a253-bbc1ea401a9a req-6c55a08c-0729-46a9-8928-39494e9faa15 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Calling delete_port for 2958b0be-15e5-48e2-b87a-6ffefd9a7859 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:28:28.550996 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e42456f-3273-415a-97b1-8f77bd424879 req-969015ff-854b-43f8-923a-65bcd640a50e tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1182346 Dec 09 21:28:28.567623 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22c83fc3-a0dd-4183-a87f-11ba103223e3 None None] Pushing event updated for resources: {'Port': ['ID=e89c3350-d1c3-4579-9a89-153f406f40ea,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:28.589572 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ea7c5d56-cd32-4022-ae53-08968e69abbc None None] Provisioning complete for port 7b66d328-f18c-4d26-af51-99c1b1f1f05e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:28.589944 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ea7c5d56-cd32-4022-ae53-08968e69abbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:28.590495 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-936adc22-1ab7-414a-ab1b-e73ccaa61f4b req-ba7dc593-448c-4ce6-a523-ea855607e40c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:28.603814 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-936adc22-1ab7-414a-ab1b-e73ccaa61f4b req-ba7dc593-448c-4ce6-a523-ea855607e40c tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=3e0505b6-bf4a-4e37-aacd-7600f6833c41 HTTP/1.1" status: 200 len: 944 time: 0.2837439 Dec 09 21:28:28.660352 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-aeddca29-9db7-478b-8555-3da65abb7b57 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Allocated IP 10.1.1.206 (a859e4ba-764a-41c0-982d-5bf79a2797a1/a894075b-fa9f-4a27-9782-e476e86f74e0/3bbd0bd0-666a-4f39-abae-59f44d88319c) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:28.682414 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-22c83fc3-a0dd-4183-a87f-11ba103223e3 None None] Network ae9d25d5-c9a2-4627-a465-8324b17541d9 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:28.699096 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0fea4cb0-8f5f-4c3e-a9c1-7265b25b0389 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:28.709480 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f2bc6a9-92c4-46e2-86e0-c833f42eb25a tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:28.710878 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-936adc22-1ab7-414a-ab1b-e73ccaa61f4b req-625a00fa-2c90-411d-9f4f-eabd2961a9f1 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1061728 Dec 09 21:28:28.736303 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-22c83fc3-a0dd-4183-a87f-11ba103223e3 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:28.744502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22c83fc3-a0dd-4183-a87f-11ba103223e3 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:28.752412 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0fea4cb0-8f5f-4c3e-a9c1-7265b25b0389 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:28.762034 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac887c3b-b0de-4163-a4c7-1ffa5f9362b0 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:28.786411 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac887c3b-b0de-4163-a4c7-1ffa5f9362b0 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:28.792876 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-840472f1-22f4-4419-b17e-9f69ed0f8cb8 req-8aa371ad-efcb-4cc8-b640-ef6212b50493 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:28.801592 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-840472f1-22f4-4419-b17e-9f69ed0f8cb8 req-8aa371ad-efcb-4cc8-b640-ef6212b50493 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=d3f455b1-1a56-4ded-ab82-e9ce51afbfde HTTP/1.1" status: 200 len: 950 time: 0.0895958 Dec 09 21:28:28.818982 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-2f2bc6a9-92c4-46e2-86e0-c833f42eb25a tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] device_id is not set on port 18d9d7fa-fedf-4844-90ef-6757eb984ae2 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:28:28.830431 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac887c3b-b0de-4163-a4c7-1ffa5f9362b0 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0ca38273-3d43-4722-98d6-90877a397979,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:28.839045 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0fea4cb0-8f5f-4c3e-a9c1-7265b25b0389 admin admin] vlan segment allocate from pool success with {'vlan_id': 117, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:28:28.893490 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ea7c5d56-cd32-4022-ae53-08968e69abbc None None] Port 7b66d328-f18c-4d26-af51-99c1b1f1f05e cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:28:28.910883 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fea4cb0-8f5f-4c3e-a9c1-7265b25b0389 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9dc55695-672d-4f75-a8bd-550395aa5ddb,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:28.915658 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac887c3b-b0de-4163-a4c7-1ffa5f9362b0 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:28.919899 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ac887c3b-b0de-4163-a4c7-1ffa5f9362b0 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.0079966 Dec 09 21:28:28.919899 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-995d0ad8-858e-47df-a253-bbc1ea401a9a req-6c55a08c-0729-46a9-8928-39494e9faa15 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:28.919899 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0fea4cb0-8f5f-4c3e-a9c1-7265b25b0389 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:28.920904 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-0fea4cb0-8f5f-4c3e-a9c1-7265b25b0389 admin admin] Added segment dc772362-7c7f-473d-bb4b-7b6705959a15 of type vlan for network b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6 Dec 09 21:28:28.929338 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-840472f1-22f4-4419-b17e-9f69ed0f8cb8 req-076df9ee-ac5a-402f-8a94-94f59e660b3f tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1237550 Dec 09 21:28:28.929889 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41704) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:28.968714 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-945d078c-c57c-4145-98c5-09363c313c26 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:28.989686 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port a9a5d2ec-b408-4729-99d3-0e4f8f041e60 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:28.990025 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:28.992132 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-22c83fc3-a0dd-4183-a87f-11ba103223e3 None None] Attempting to bind port e89c3350-d1c3-4579-9a89-153f406f40ea on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:28:28.992500 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-22c83fc3-a0dd-4183-a87f-11ba103223e3 None None] Attempting to bind port e89c3350-d1c3-4579-9a89-153f406f40ea by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'a40eb34b-04cf-427f-a562-8a47c01a297b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'ae9d25d5-c9a2-4627-a465-8324b17541d9'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:28:28.992897 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22c83fc3-a0dd-4183-a87f-11ba103223e3 None None] Attempting to bind port e89c3350-d1c3-4579-9a89-153f406f40ea on network ae9d25d5-c9a2-4627-a465-8324b17541d9 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:29.012293 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c55a08c-0729-46a9-8928-39494e9faa15 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Pushing event deleted for resources: {'Port': ['ID=2958b0be-15e5-48e2-b87a-6ffefd9a7859,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:29.051822 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22c83fc3-a0dd-4183-a87f-11ba103223e3 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:28:29.052178 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22c83fc3-a0dd-4183-a87f-11ba103223e3 None None] Checking segment: {'id': 'a40eb34b-04cf-427f-a562-8a47c01a297b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'ae9d25d5-c9a2-4627-a465-8324b17541d9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:29.052624 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-22c83fc3-a0dd-4183-a87f-11ba103223e3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:29.053068 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22c83fc3-a0dd-4183-a87f-11ba103223e3 None None] Bound using segment: {'id': 'a40eb34b-04cf-427f-a562-8a47c01a297b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'ae9d25d5-c9a2-4627-a465-8324b17541d9'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:28:29.053551 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-22c83fc3-a0dd-4183-a87f-11ba103223e3 None None] Bound port: e89c3350-d1c3-4579-9a89-153f406f40ea, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a40eb34b-04cf-427f-a562-8a47c01a297b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'ae9d25d5-c9a2-4627-a465-8324b17541d9'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:28:29.053974 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-22c83fc3-a0dd-4183-a87f-11ba103223e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:29.063510 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:29.070496 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-945d078c-c57c-4145-98c5-09363c313c26 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:29.097596 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0fea4cb0-8f5f-4c3e-a9c1-7265b25b0389 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:29.153166 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d7ada4df-d06d-4040-9578-54b463f1f972 None None] Provisioning complete for port c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:29.153540 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d7ada4df-d06d-4040-9578-54b463f1f972 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:29.164942 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-aeddca29-9db7-478b-8555-3da65abb7b57 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:29.236683 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3e0505b6-bf4a-4e37-aacd-7600f6833c41', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fd5eccfa-9fff-46bc-a3bd-73a647cd826e'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:29.238197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-995d0ad8-858e-47df-a253-bbc1ea401a9a req-6c55a08c-0729-46a9-8928-39494e9faa15 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] No DVR routers for this DVR port 2958b0be-15e5-48e2-b87a-6ffefd9a7859 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:28:29.239478 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-db94041d-954c-49cb-a986-7811ea051c05" -d '{"events": [{"server_uuid": "3e0505b6-bf4a-4e37-aacd-7600f6833c41", "name": "network-vif-plugged", "status": "completed", "tag": "fd5eccfa-9fff-46bc-a3bd-73a647cd826e"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:29.240103 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0fea4cb0-8f5f-4c3e-a9c1-7265b25b0389 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:29.241284 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0fea4cb0-8f5f-4c3e-a9c1-7265b25b0389 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:29.241989 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0fea4cb0-8f5f-4c3e-a9c1-7265b25b0389 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:29.250014 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-995d0ad8-858e-47df-a253-bbc1ea401a9a req-6c55a08c-0729-46a9-8928-39494e9faa15 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:29.254287 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-995d0ad8-858e-47df-a253-bbc1ea401a9a req-6c55a08c-0729-46a9-8928-39494e9faa15 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "DELETE /v2.0/ports/2958b0be-15e5-48e2-b87a-6ffefd9a7859 HTTP/1.1" status: 204 len: 173 time: 1.4301119 Dec 09 21:28:29.327642 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port fd5eccfa-9fff-46bc-a3bd-73a647cd826e, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=fd5eccfa-9fff-46bc-a3bd-73a647cd826e,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:29.331250 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0fea4cb0-8f5f-4c3e-a9c1-7265b25b0389 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 2.6494353 Dec 09 21:28:29.344782 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:29.347763 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41712) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:29.360405 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b931e4e1-c240-4498-a63c-eac1ad20fb2c admin admin] Request body: {'subnet': {'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestBootFromVolume-1721587557-subnet', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:29.390343 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-aeddca29-9db7-478b-8555-3da65abb7b57 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:29.453951 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fea4cb0-8f5f-4c3e-a9c1-7265b25b0389 admin admin] Pushing event updated for resources: {'Network': ['ID=b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:29.509010 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b931e4e1-c240-4498-a63c-eac1ad20fb2c admin admin] Made reservation on behalf of 77fc0831d6584a36b61a4823157f9c1d for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:29.511765 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b931e4e1-c240-4498-a63c-eac1ad20fb2c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:29.514650 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-22c83fc3-a0dd-4183-a87f-11ba103223e3 None None] For port e89c3350-d1c3-4579-9a89-153f406f40ea, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:28:29.519283 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:28:29.522669 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['18bda486-9d6d-41a3-a260-dd244a3838b3'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:28:29.533408 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11dedfd2-3396-4b62-bc7f-af459c949be8 req-0fe08a75-477f-42f9-beaf-6ee33ead3a4d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:29.541146 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-2f2bc6a9-92c4-46e2-86e0-c833f42eb25a tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Allocated IP 10.1.1.107 (69c5e9e4-78c6-4a6b-9b16-9f1da643282c/871c2dc1-486e-4fcf-a882-5a1394082fc5/18d9d7fa-fedf-4844-90ef-6757eb984ae2) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:29.541797 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11dedfd2-3396-4b62-bc7f-af459c949be8 req-0fe08a75-477f-42f9-beaf-6ee33ead3a4d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:29.549968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11dedfd2-3396-4b62-bc7f-af459c949be8 req-0fe08a75-477f-42f9-beaf-6ee33ead3a4d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:29.552335 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11dedfd2-3396-4b62-bc7f-af459c949be8 req-0fe08a75-477f-42f9-beaf-6ee33ead3a4d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 2375 time: 0.3323460 Dec 09 21:28:29.571575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-aeddca29-9db7-478b-8555-3da65abb7b57 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Network a859e4ba-764a-41c0-982d-5bf79a2797a1 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:29.578861 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-aeddca29-9db7-478b-8555-3da65abb7b57 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:29.618969 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-aeddca29-9db7-478b-8555-3da65abb7b57 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:29.635505 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-22c83fc3-a0dd-4183-a87f-11ba103223e3 None None] For port e89c3350-d1c3-4579-9a89-153f406f40ea, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e89c3350-d1c3-4579-9a89-153f406f40ea,segment=NetworkSegment(a40eb34b-04cf-427f-a562-8a47c01a297b),segment_id=a40eb34b-04cf-427f-a562-8a47c01a297b)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:28:29.638129 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 2958b0be-15e5-48e2-b87a-6ffefd9a7859 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:28:29.647859 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0de2b54-7962-4c78-8133-7ddad3ecd37d req-2e2ccff7-836f-49a7-ad26-55d9deb5d09b tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:29.655812 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0de2b54-7962-4c78-8133-7ddad3ecd37d req-2e2ccff7-836f-49a7-ad26-55d9deb5d09b tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 945 time: 0.3841317 Dec 09 21:28:29.737672 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d7ada4df-d06d-4040-9578-54b463f1f972 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:29.812382 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-22c83fc3-a0dd-4183-a87f-11ba103223e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:29.824115 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeddca29-9db7-478b-8555-3da65abb7b57 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event updated for resources: {'Port': ['ID=3bbd0bd0-666a-4f39-abae-59f44d88319c,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:29.843547 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=fd5eccfa-9fff-46bc-a3bd-73a647cd826e,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:29.916908 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11dedfd2-3396-4b62-bc7f-af459c949be8 req-318da60a-3d8b-464e-bfbf-26fb6c3fe7b1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3393860 Dec 09 21:28:29.947489 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-aeddca29-9db7-478b-8555-3da65abb7b57 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:29.949836 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-aeddca29-9db7-478b-8555-3da65abb7b57 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:29.966869 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 2958b0be-15e5-48e2-b87a-6ffefd9a7859 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:28:29.967210 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 2958b0be-15e5-48e2-b87a-6ffefd9a7859 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:28:29.979431 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:28:29.999484 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f2bc6a9-92c4-46e2-86e0-c833f42eb25a tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:30.023027 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0de2b54-7962-4c78-8133-7ddad3ecd37d req-218b0f51-3cfb-488e-9063-e05a71eff3d8 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3662214 Dec 09 21:28:30.041729 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-aeddca29-9db7-478b-8555-3da65abb7b57 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.5049968 Dec 09 21:28:30.066944 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-9dc77cd1-b575-4e7b-b67d-50b3c5140a6b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Request body: {'port': {'device_id': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'fixed_ips': [{'ip_address': '10.2.2.100'}], 'network_id': 'a133a939-2827-4fe6-81f5-14715631c0ec', 'admin_state_up': True, 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'security_groups': ['7eb72df0-7940-41d2-b7f8-e0c3cff1ced2']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:30.112922 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0501b045-8009-464d-8765-28da8c4adcf1 x-openstack-request-id: req-0501b045-8009-464d-8765-28da8c4adcf1 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:30.113175 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3e0505b6-bf4a-4e37-aacd-7600f6833c41", "name": "network-vif-plugged", "status": "completed", "tag": "fd5eccfa-9fff-46bc-a3bd-73a647cd826e", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:30.114189 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0501b045-8009-464d-8765-28da8c4adcf1 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:30.114598 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3e0505b6-bf4a-4e37-aacd-7600f6833c41', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fd5eccfa-9fff-46bc-a3bd-73a647cd826e', 'code': 200} Dec 09 21:28:30.211537 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b931e4e1-c240-4498-a63c-eac1ad20fb2c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:30.217947 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-d7ada4df-d06d-4040-9578-54b463f1f972 None None] For port c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:30.259268 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd3f455b1-1a56-4ded-ab82-e9ce51afbfde', 'name': 'network-vif-deleted', 'tag': '2958b0be-15e5-48e2-b87a-6ffefd9a7859'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:30.262769 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-327fe929-12a8-46f0-a68d-b62a83036905" -d '{"events": [{"server_uuid": "d3f455b1-1a56-4ded-ab82-e9ce51afbfde", "name": "network-vif-deleted", "tag": "2958b0be-15e5-48e2-b87a-6ffefd9a7859"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:30.265499 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d7ada4df-d06d-4040-9578-54b463f1f972 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:30.314125 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22c83fc3-a0dd-4183-a87f-11ba103223e3 None None] Pushing event updated for resources: {'Port': ['ID=e89c3350-d1c3-4579-9a89-153f406f40ea,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:30.346752 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f2bc6a9-92c4-46e2-86e0-c833f42eb25a tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:30.350115 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:30.350647 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:30.364325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a79bde8-9f4f-4849-84c1-99039d5657c3 req-47e20833-6587-442a-8604-32a0b0639a03 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:30.376336 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7a79bde8-9f4f-4849-84c1-99039d5657c3 req-47e20833-6587-442a-8604-32a0b0639a03 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 945 time: 0.2061706 Dec 09 21:28:30.383715 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-945d078c-c57c-4145-98c5-09363c313c26 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:30.396705 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b931e4e1-c240-4498-a63c-eac1ad20fb2c admin admin] Checking segment: {'id': 'dc772362-7c7f-473d-bb4b-7b6705959a15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:30.397606 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b931e4e1-c240-4498-a63c-eac1ad20fb2c admin admin] Network hostable DHCP agents. Network: b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:28:30.468583 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3f19d3b0-68ab-4c66-adf4-a41842f21b10 None None] Provisioning complete for port 3bbd0bd0-666a-4f39-abae-59f44d88319c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:30.468960 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3f19d3b0-68ab-4c66-adf4-a41842f21b10 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:30.502174 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f2bc6a9-92c4-46e2-86e0-c833f42eb25a tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:30.505298 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7ada4df-d06d-4040-9578-54b463f1f972 None None] Pushing event updated for resources: {'Port': ['ID=c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:30.508961 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7a79bde8-9f4f-4849-84c1-99039d5657c3 req-f8137e73-ef3e-4826-9b43-217f2740fef8 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1267979 Dec 09 21:28:30.519583 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00ffe6fe-7906-44ef-a33b-15e34fbc0e3d req-ae848a0e-47c0-4f68-b06c-6d84f0eb714e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:30.526878 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-00ffe6fe-7906-44ef-a33b-15e34fbc0e3d req-ae848a0e-47c0-4f68-b06c-6d84f0eb714e service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=3e0505b6-bf4a-4e37-aacd-7600f6833c41 HTTP/1.1" status: 200 len: 1097 time: 0.3841217 Dec 09 21:28:30.543797 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f2bc6a9-92c4-46e2-86e0-c833f42eb25a tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event updated for resources: {'Port': ['ID=18d9d7fa-fedf-4844-90ef-6757eb984ae2,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:30.547474 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-505483f8-e9c3-4fb7-abd8-5af3c550c49d req-a320582f-e04c-4844-91cb-8ed1785d7538 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:30.551286 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-505483f8-e9c3-4fb7-abd8-5af3c550c49d req-a320582f-e04c-4844-91cb-8ed1785d7538 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=3e0505b6-bf4a-4e37-aacd-7600f6833c41 HTTP/1.1" status: 200 len: 945 time: 0.3847299 Dec 09 21:28:30.556943 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-3f19d3b0-68ab-4c66-adf4-a41842f21b10 None None] Port 3bbd0bd0-666a-4f39-abae-59f44d88319c cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:28:30.576781 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-2f2bc6a9-92c4-46e2-86e0-c833f42eb25a tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:30.583484 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f2bc6a9-92c4-46e2-86e0-c833f42eb25a tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:30.596415 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3f19d3b0-68ab-4c66-adf4-a41842f21b10 None None] Provisioning complete for port c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:30.596835 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3f19d3b0-68ab-4c66-adf4-a41842f21b10 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:30.633580 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-9dc77cd1-b575-4e7b-b67d-50b3c5140a6b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Made reservation on behalf of 03e962eb7f5e4325a7c08c8b1e2a4cea for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:30.654170 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b931e4e1-c240-4498-a63c-eac1ad20fb2c admin admin] Pushing event updated for resources: {'Subnet': ['ID=93335bf9-6f1e-4484-ae25-dca4b03b29b4,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:30.661181 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bd4f2a68-b753-4d51-9905-15457945dd8c x-openstack-request-id: req-bd4f2a68-b753-4d51-9905-15457945dd8c {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:30.661479 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d3f455b1-1a56-4ded-ab82-e9ce51afbfde", "name": "network-vif-deleted", "tag": "2958b0be-15e5-48e2-b87a-6ffefd9a7859", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:30.661737 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-bd4f2a68-b753-4d51-9905-15457945dd8c {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:30.662139 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd3f455b1-1a56-4ded-ab82-e9ce51afbfde', 'name': 'network-vif-deleted', 'tag': '2958b0be-15e5-48e2-b87a-6ffefd9a7859', 'status': 'completed', 'code': 200} Dec 09 21:28:30.740629 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b931e4e1-c240-4498-a63c-eac1ad20fb2c admin admin] Network b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:28:30.787998 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f2bc6a9-92c4-46e2-86e0-c833f42eb25a tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:30.788927 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f2bc6a9-92c4-46e2-86e0-c833f42eb25a tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:30.800109 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-9dc77cd1-b575-4e7b-b67d-50b3c5140a6b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:30.826942 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-00ffe6fe-7906-44ef-a33b-15e34fbc0e3d req-625c5f48-41ca-4c43-bf00-5c4efb9b48e9 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1638436 Dec 09 21:28:30.834808 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2f2bc6a9-92c4-46e2-86e0-c833f42eb25a tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 936 time: 4.2319157 Dec 09 21:28:30.835710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-b931e4e1-c240-4498-a63c-eac1ad20fb2c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:30.842771 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b931e4e1-c240-4498-a63c-eac1ad20fb2c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:30.843972 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b931e4e1-c240-4498-a63c-eac1ad20fb2c admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:30.847654 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41726) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:30.850400 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cab50e42-606f-4b77-80b6-6d435849ce63 None None] Network b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:28:30.855725 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-735016ab-635b-4712-8e06-8861a8d809c0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Request body: {'port': {'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c', 'name': 'tempest-TaggedBootDevicesTest_v242-1957395973', 'fixed_ips': [{'subnet_id': '871c2dc1-486e-4fcf-a882-5a1394082fc5'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:30.870568 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-945d078c-c57c-4145-98c5-09363c313c26 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Allocated IP 172.25.3.72 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/3b4701e3-b6e8-4be9-a35a-74fb297acc7d) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:31.044728 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e89c3350-d1c3-4579-9a89-153f406f40ea up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:28:31.100378 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-945d078c-c57c-4145-98c5-09363c313c26 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:31.116982 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-735016ab-635b-4712-8e06-8861a8d809c0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Made reservation on behalf of 0a5d0e4652be4d8b87936a559840cc87 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:31.123724 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-735016ab-635b-4712-8e06-8861a8d809c0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:31.145407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8f2caf5f-c1e7-458d-ae91-82b8c617fd87 None None] Provisioning complete for port 18d9d7fa-fedf-4844-90ef-6757eb984ae2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:31.145797 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8f2caf5f-c1e7-458d-ae91-82b8c617fd87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:31.147622 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d5a4775c-7a40-4037-b0b2-40730aaab163 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6', 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6', 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'fixed_ips': [{'subnet_id': '93335bf9-6f1e-4484-ae25-dca4b03b29b4'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:28:31.148465 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d5a4775c-7a40-4037-b0b2-40730aaab163 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:31.169226 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-735016ab-635b-4712-8e06-8861a8d809c0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] device_id is not set on port 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:28:31.180899 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b931e4e1-c240-4498-a63c-eac1ad20fb2c admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 1.8278115 Dec 09 21:28:31.183635 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41734) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:31.190736 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-15947a49-c461-45f9-9da6-221a4c857bc3 admin admin] Request body: {'router': {'name': 'tempest-ServersTestBootFromVolume-1721587557-router', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:31.198798 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-945d078c-c57c-4145-98c5-09363c313c26 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:31.218256 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-505483f8-e9c3-4fb7-abd8-5af3c550c49d req-a3207069-754a-493e-926a-71205d1d0eb8 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6555879 Dec 09 21:28:31.283858 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15947a49-c461-45f9-9da6-221a4c857bc3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:31.286139 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15947a49-c461-45f9-9da6-221a4c857bc3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:31.365779 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-945d078c-c57c-4145-98c5-09363c313c26 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Pushing event updated for resources: {'Port': ['ID=3b4701e3-b6e8-4be9-a35a-74fb297acc7d,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:31.408530 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-945d078c-c57c-4145-98c5-09363c313c26 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:31.437929 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-8f2caf5f-c1e7-458d-ae91-82b8c617fd87 None None] Port 18d9d7fa-fedf-4844-90ef-6757eb984ae2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:28:31.444672 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port e89c3350-d1c3-4579-9a89-153f406f40ea triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:31.445048 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:31.458698 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-945d078c-c57c-4145-98c5-09363c313c26 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:31.471345 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15947a49-c461-45f9-9da6-221a4c857bc3 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:31.477415 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-945d078c-c57c-4145-98c5-09363c313c26 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:31.568782 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:31.585315 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-d5a4775c-7a40-4037-b0b2-40730aaab163 None None] Allocated IP 172.20.0.2 (b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6/93335bf9-6f1e-4484-ae25-dca4b03b29b4/3c106718-124c-4283-bf92-9c0013914134) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:31.604031 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-735016ab-635b-4712-8e06-8861a8d809c0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Allocated IP 10.1.1.197 (69c5e9e4-78c6-4a6b-9b16-9f1da643282c/871c2dc1-486e-4fcf-a882-5a1394082fc5/1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:31.618080 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-945d078c-c57c-4145-98c5-09363c313c26 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:31.625340 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port e89c3350-d1c3-4579-9a89-153f406f40ea, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e89c3350-d1c3-4579-9a89-153f406f40ea,segment=NetworkSegment(a40eb34b-04cf-427f-a562-8a47c01a297b),segment_id=a40eb34b-04cf-427f-a562-8a47c01a297b)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:31.643902 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-08142002-906f-466d-a0fc-f7e3b080451e None None] Network ae9d25d5-c9a2-4627-a465-8324b17541d9 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:28:31.686941 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-692c9874-ee6a-48df-8310-0cf2a112d822 req-407c9796-e756-46d2-ba59-40dcc8a25986 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:31.695870 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-692c9874-ee6a-48df-8310-0cf2a112d822 req-407c9796-e756-46d2-ba59-40dcc8a25986 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:31.704914 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-692c9874-ee6a-48df-8310-0cf2a112d822 req-407c9796-e756-46d2-ba59-40dcc8a25986 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:31.706115 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15947a49-c461-45f9-9da6-221a4c857bc3 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:31.706955 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-692c9874-ee6a-48df-8310-0cf2a112d822 req-407c9796-e756-46d2-ba59-40dcc8a25986 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 2375 time: 0.5347135 Dec 09 21:28:31.774668 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30f4b061-9503-448b-a429-7e61f0ce02f6 req-d4efd4c5-77b5-42c8-bec2-014ba3b00490 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:31.776155 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-30f4b061-9503-448b-a429-7e61f0ce02f6 req-d4efd4c5-77b5-42c8-bec2-014ba3b00490 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 945 time: 0.4566905 Dec 09 21:28:31.859285 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-945d078c-c57c-4145-98c5-09363c313c26 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:31.983183 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-735016ab-635b-4712-8e06-8861a8d809c0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:31.999303 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:32.000126 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:28:32.131558 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15947a49-c461-45f9-9da6-221a4c857bc3 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:32.135186 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-735016ab-635b-4712-8e06-8861a8d809c0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:32.135357 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=e89c3350-d1c3-4579-9a89-153f406f40ea,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:32.162178 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15947a49-c461-45f9-9da6-221a4c857bc3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:32.199296 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1bc9c394-fa69-47c9-b30b-9b23ae289747 None None] Provisioning complete for port e89c3350-d1c3-4579-9a89-153f406f40ea triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:32.199909 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1bc9c394-fa69-47c9-b30b-9b23ae289747 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:32.263469 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-735016ab-635b-4712-8e06-8861a8d809c0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:32.270531 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-735016ab-635b-4712-8e06-8861a8d809c0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:32.282740 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-735016ab-635b-4712-8e06-8861a8d809c0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:32.292435 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:32.293449 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:32.340711 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-30f4b061-9503-448b-a429-7e61f0ce02f6 req-5abd1352-dc6e-467a-a3d9-c46092f253e5 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5224929 Dec 09 21:28:32.340953 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-735016ab-635b-4712-8e06-8861a8d809c0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:32.341382 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-735016ab-635b-4712-8e06-8861a8d809c0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:32.357958 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-735016ab-635b-4712-8e06-8861a8d809c0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event updated for resources: {'Port': ['ID=1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:32.422239 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-735016ab-635b-4712-8e06-8861a8d809c0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.5731037 Dec 09 21:28:32.434461 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-692c9874-ee6a-48df-8310-0cf2a112d822 req-8357ed96-1921-4712-8a35-ddb9907e6bc6 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.6843293 Dec 09 21:28:32.454620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-9dc77cd1-b575-4e7b-b67d-50b3c5140a6b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Allocated IP 10.2.2.100 (a133a939-2827-4fe6-81f5-14715631c0ec/753ba647-b0b0-482e-ac28-89c7e6adf654/d0dcf098-4522-4347-b733-bbc98e48d7e0) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:32.575769 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-15947a49-c461-45f9-9da6-221a4c857bc3 admin admin] Allocated IP 172.25.3.163 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/a86b6971-a767-4594-8a0c-17a90908b6c3) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:32.602870 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d5a4775c-7a40-4037-b0b2-40730aaab163 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:32.626073 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d5a4775c-7a40-4037-b0b2-40730aaab163 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:32.661424 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6a6dc54-49d9-443e-8186-aea76ac4291a req-6ff065b2-e8e0-45c4-b2cb-5c00bae228b3 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:32.663014 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a6a6dc54-49d9-443e-8186-aea76ac4291a req-6ff065b2-e8e0-45c4-b2cb-5c00bae228b3 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "GET /v2.0/ports?device_id=10aa9750-8504-424a-9c95-af3331c58955 HTTP/1.1" status: 200 len: 950 time: 0.2282076 Dec 09 21:28:32.747110 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d5a4775c-7a40-4037-b0b2-40730aaab163 None None] Network b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:32.761470 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-d5a4775c-7a40-4037-b0b2-40730aaab163 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:32.768649 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5a4775c-7a40-4037-b0b2-40730aaab163 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:32.785896 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1615732-2094-4eec-bb0a-ba23958228c5 req-84f09a7b-9ffb-46f4-a580-13d977064761 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:32.787520 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a1615732-2094-4eec-bb0a-ba23958228c5 req-84f09a7b-9ffb-46f4-a580-13d977064761 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/ports?device_id=10aa9750-8504-424a-9c95-af3331c58955 HTTP/1.1" status: 200 len: 950 time: 0.2174678 Dec 09 21:28:32.805445 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5a4775c-7a40-4037-b0b2-40730aaab163 None None] Pushing event updated for resources: {'Port': ['ID=3c106718-124c-4283-bf92-9c0013914134,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:32.807113 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2160a511-fc63-4662-9698-6fefaf7690c2 req-ee01b372-8d46-42ff-94a8-d85b4ce0fcac tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:32.816720 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2160a511-fc63-4662-9698-6fefaf7690c2 req-ee01b372-8d46-42ff-94a8-d85b4ce0fcac tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 945 time: 0.2220345 Dec 09 21:28:32.910355 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-d5a4775c-7a40-4037-b0b2-40730aaab163 None None] Attempting to bind port 3c106718-124c-4283-bf92-9c0013914134 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:28:32.911374 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-d5a4775c-7a40-4037-b0b2-40730aaab163 None None] Attempting to bind port 3c106718-124c-4283-bf92-9c0013914134 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'dc772362-7c7f-473d-bb4b-7b6705959a15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:28:32.912200 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5a4775c-7a40-4037-b0b2-40730aaab163 None None] Attempting to bind port 3c106718-124c-4283-bf92-9c0013914134 on network b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:32.928608 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15947a49-c461-45f9-9da6-221a4c857bc3 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:32.946037 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-a6a6dc54-49d9-443e-8186-aea76ac4291a req-baaea49d-d523-4273-9cab-15c9d0223cdf tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Deleting port 18bda486-9d6d-41a3-a260-dd244a3838b3 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:28:32.946588 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a6a6dc54-49d9-443e-8186-aea76ac4291a req-baaea49d-d523-4273-9cab-15c9d0223cdf tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:32.966397 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-945d078c-c57c-4145-98c5-09363c313c26 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:32.969031 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5a4775c-7a40-4037-b0b2-40730aaab163 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:28:32.970323 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5a4775c-7a40-4037-b0b2-40730aaab163 None None] Checking segment: {'id': 'dc772362-7c7f-473d-bb4b-7b6705959a15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:32.972576 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d5a4775c-7a40-4037-b0b2-40730aaab163 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:32.973956 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5a4775c-7a40-4037-b0b2-40730aaab163 None None] Bound using segment: {'id': 'dc772362-7c7f-473d-bb4b-7b6705959a15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:28:32.975229 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-d5a4775c-7a40-4037-b0b2-40730aaab163 None None] Bound port: 3c106718-124c-4283-bf92-9c0013914134, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'dc772362-7c7f-473d-bb4b-7b6705959a15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:28:32.976932 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d5a4775c-7a40-4037-b0b2-40730aaab163 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:33.001698 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-945d078c-c57c-4145-98c5-09363c313c26 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:33.014124 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a31ae35f-6eb6-470c-95f4-1f7d4ad7d253 None None] Provisioning complete for port e89c3350-d1c3-4579-9a89-153f406f40ea triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:33.014981 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a31ae35f-6eb6-470c-95f4-1f7d4ad7d253 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:33.056319 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2160a511-fc63-4662-9698-6fefaf7690c2 req-bb8a5310-938a-45bb-a06e-55054a95a441 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2357681 Dec 09 21:28:33.071590 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-46666ee9-0cb1-4e81-95f2-3e5b971f84a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:33.073229 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e89c3350-d1c3-4579-9a89-153f406f40ea up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:28:33.082098 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15947a49-c461-45f9-9da6-221a4c857bc3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:33.149686 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15947a49-c461-45f9-9da6-221a4c857bc3 admin admin] Pushing event updated for resources: {'Port': ['ID=a86b6971-a767-4594-8a0c-17a90908b6c3,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:33.167760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15947a49-c461-45f9-9da6-221a4c857bc3 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:33.172311 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-15947a49-c461-45f9-9da6-221a4c857bc3 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:33.172525 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a1615732-2094-4eec-bb0a-ba23958228c5 req-cd882404-8d33-4322-a827-0b6e6a3d0925 tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.13 "GET /v2.0/security-groups?id=1470b5ed-2866-47fe-8713-041fb315f355&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3498740 Dec 09 21:28:33.184250 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15947a49-c461-45f9-9da6-221a4c857bc3 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:33.225584 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-9dc77cd1-b575-4e7b-b67d-50b3c5140a6b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:33.232218 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-a6a6dc54-49d9-443e-8186-aea76ac4291a req-baaea49d-d523-4273-9cab-15c9d0223cdf tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] For port 18bda486-9d6d-41a3-a260-dd244a3838b3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=18bda486-9d6d-41a3-a260-dd244a3838b3,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:33.233014 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a6a6dc54-49d9-443e-8186-aea76ac4291a req-baaea49d-d523-4273-9cab-15c9d0223cdf tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:33.241569 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-d5a4775c-7a40-4037-b0b2-40730aaab163 None None] For port 3c106718-124c-4283-bf92-9c0013914134, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:28:33.254138 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-d5a4775c-7a40-4037-b0b2-40730aaab163 None None] For port 3c106718-124c-4283-bf92-9c0013914134, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=3c106718-124c-4283-bf92-9c0013914134,segment=NetworkSegment(dc772362-7c7f-473d-bb4b-7b6705959a15),segment_id=dc772362-7c7f-473d-bb4b-7b6705959a15)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:28:33.254931 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-a6a6dc54-49d9-443e-8186-aea76ac4291a req-baaea49d-d523-4273-9cab-15c9d0223cdf tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Calling delete_port for 18bda486-9d6d-41a3-a260-dd244a3838b3 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:28:33.260449 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port e89c3350-d1c3-4579-9a89-153f406f40ea triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:33.260833 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:33.308203 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d5a4775c-7a40-4037-b0b2-40730aaab163 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:33.316667 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-945d078c-c57c-4145-98c5-09363c313c26 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Pushing event updated for resources: {'Port': ['ID=3b4701e3-b6e8-4be9-a35a-74fb297acc7d,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:33.368991 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-945d078c-c57c-4145-98c5-09363c313c26 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:33.408331 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-add43b0c-3c6e-4e09-985a-9576cc6e6216 req-f6ec0447-7122-4d17-981a-cd8da292606d tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:33.410511 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-add43b0c-3c6e-4e09-985a-9576cc6e6216 req-f6ec0447-7122-4d17-981a-cd8da292606d tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=3e0505b6-bf4a-4e37-aacd-7600f6833c41 HTTP/1.1" status: 200 len: 945 time: 0.2157764 Dec 09 21:28:33.419950 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-945d078c-c57c-4145-98c5-09363c313c26 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:33.424616 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-945d078c-c57c-4145-98c5-09363c313c26 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 4.4743333 Dec 09 21:28:33.428201 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5a4775c-7a40-4037-b0b2-40730aaab163 None None] Pushing event updated for resources: {'Port': ['ID=3c106718-124c-4283-bf92-9c0013914134,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:33.461704 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a31ae35f-6eb6-470c-95f4-1f7d4ad7d253 None None] Provisioning complete for port 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:33.462079 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a31ae35f-6eb6-470c-95f4-1f7d4ad7d253 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:33.554237 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-9dc77cd1-b575-4e7b-b67d-50b3c5140a6b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:33.586752 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-add43b0c-3c6e-4e09-985a-9576cc6e6216 req-87989f48-2f48-44b3-92b2-fcb4a40b2113 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1595299 Dec 09 21:28:33.603886 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a31ae35f-6eb6-470c-95f4-1f7d4ad7d253 None None] Port 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:28:33.669027 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41750) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:33.675750 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a0adb0cd-f647-4b57-9c1b-264e4c98d49e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Request body: {'security_group': {'name': 'tempest-securitygroup--240105791', 'description': 'tempest-description--121339679'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:33.750769 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-9dc77cd1-b575-4e7b-b67d-50b3c5140a6b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Network a133a939-2827-4fe6-81f5-14715631c0ec is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:33.770710 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dc77cd1-b575-4e7b-b67d-50b3c5140a6b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event updated for resources: {'Port': ['ID=d0dcf098-4522-4347-b733-bbc98e48d7e0,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:33.797490 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-9dc77cd1-b575-4e7b-b67d-50b3c5140a6b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:33.823371 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-9dc77cd1-b575-4e7b-b67d-50b3c5140a6b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:33.884439 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a0adb0cd-f647-4b57-9c1b-264e4c98d49e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:33.949651 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-9dc77cd1-b575-4e7b-b67d-50b3c5140a6b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:33.950355 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-9dc77cd1-b575-4e7b-b67d-50b3c5140a6b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:33.981891 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-9dc77cd1-b575-4e7b-b67d-50b3c5140a6b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.9255853 Dec 09 21:28:33.995272 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65e0f579-f5d0-4bbb-99f4-554de081d37c req-090c7a8f-545b-48d7-8452-e1b5bb07da13 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:34.002517 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65e0f579-f5d0-4bbb-99f4-554de081d37c req-090c7a8f-545b-48d7-8452-e1b5bb07da13 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:34.009064 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65e0f579-f5d0-4bbb-99f4-554de081d37c req-090c7a8f-545b-48d7-8452-e1b5bb07da13 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:34.015409 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65e0f579-f5d0-4bbb-99f4-554de081d37c req-090c7a8f-545b-48d7-8452-e1b5bb07da13 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:34.024036 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-65e0f579-f5d0-4bbb-99f4-554de081d37c req-090c7a8f-545b-48d7-8452-e1b5bb07da13 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 3096 time: 0.2628160 Dec 09 21:28:34.036921 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-5fc20d0f-d53c-4222-aaad-ef78bb8539ab tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Request body: {'port': {'device_id': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'fixed_ips': [{'ip_address': '10.2.2.200'}], 'network_id': 'a133a939-2827-4fe6-81f5-14715631c0ec', 'admin_state_up': True, 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'security_groups': ['7eb72df0-7940-41d2-b7f8-e0c3cff1ced2']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:34.087209 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c581f81-905b-47f6-b4f8-bb8da5852b72 req-9d23bfad-8b61-4ab4-beb5-2ad049fb463b tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:34.109326 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4c581f81-905b-47f6-b4f8-bb8da5852b72 req-9d23bfad-8b61-4ab4-beb5-2ad049fb463b tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 945 time: 0.3352854 Dec 09 21:28:34.357308 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7dbc9de6-5bb4-481a-89c3-cb697f7cda3c None None] Provisioning complete for port d0dcf098-4522-4347-b733-bbc98e48d7e0 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:34.357857 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7dbc9de6-5bb4-481a-89c3-cb697f7cda3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:34.377029 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a6a6dc54-49d9-443e-8186-aea76ac4291a req-baaea49d-d523-4273-9cab-15c9d0223cdf tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:34.380035 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15947a49-c461-45f9-9da6-221a4c857bc3 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:34.404650 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-7dbc9de6-5bb4-481a-89c3-cb697f7cda3c None None] Port d0dcf098-4522-4347-b733-bbc98e48d7e0 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:28:34.434766 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4c581f81-905b-47f6-b4f8-bb8da5852b72 req-a429c8b5-51cb-46cd-ac00-f2542e5d6dd2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3242297 Dec 09 21:28:34.449387 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baaea49d-d523-4273-9cab-15c9d0223cdf tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Pushing event deleted for resources: {'Port': ['ID=18bda486-9d6d-41a3-a260-dd244a3838b3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:34.463818 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-65e0f579-f5d0-4bbb-99f4-554de081d37c req-75d346f1-9313-4478-912b-af54726ffc1a tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4385526 Dec 09 21:28:34.559185 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-a6a6dc54-49d9-443e-8186-aea76ac4291a req-baaea49d-d523-4273-9cab-15c9d0223cdf tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] No DVR routers for this DVR port 18bda486-9d6d-41a3-a260-dd244a3838b3 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:28:34.571539 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-5fc20d0f-d53c-4222-aaad-ef78bb8539ab tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Made reservation on behalf of 03e962eb7f5e4325a7c08c8b1e2a4cea for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:34.579616 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-5fc20d0f-d53c-4222-aaad-ef78bb8539ab tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:34.601817 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a0adb0cd-f647-4b57-9c1b-264e4c98d49e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:34.604993 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a6a6dc54-49d9-443e-8186-aea76ac4291a req-baaea49d-d523-4273-9cab-15c9d0223cdf tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:34.608899 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a6a6dc54-49d9-443e-8186-aea76ac4291a req-baaea49d-d523-4273-9cab-15c9d0223cdf tempest-ServersOnMultiNodesTest-1875538630 tempest-ServersOnMultiNodesTest-1875538630-project] 10.222.0.31 "DELETE /v2.0/ports/18bda486-9d6d-41a3-a260-dd244a3838b3 HTTP/1.1" status: 204 len: 173 time: 1.9226959 Dec 09 21:28:34.609318 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '10aa9750-8504-424a-9c95-af3331c58955', 'name': 'network-vif-deleted', 'tag': '18bda486-9d6d-41a3-a260-dd244a3838b3'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:34.618979 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a030525e-16f5-4612-8239-dccda7b76304" -d '{"events": [{"server_uuid": "10aa9750-8504-424a-9c95-af3331c58955", "name": "network-vif-deleted", "tag": "18bda486-9d6d-41a3-a260-dd244a3838b3"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:34.637173 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a0adb0cd-f647-4b57-9c1b-264e4c98d49e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:34.740427 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a0adb0cd-f647-4b57-9c1b-264e4c98d49e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:34.741937 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a0adb0cd-f647-4b57-9c1b-264e4c98d49e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 1.0699310 Dec 09 21:28:34.745715 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41770) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:34.760696 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b3e82703-18ee-427a-94f0-8643f39e648e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Request body: {'security_group_rule': {'security_group_id': '66e1817f-e10c-4faf-abd8-bc5e8fda7f97', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:34.764485 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-23911530-93da-4937-bd50-87e684174760 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-securitygroup--1988309227&fields=id&tenant_id=29f2c1d9be9348b0888bc61ed37ed957 HTTP/1.1" status: 200 len: 267 time: 0.1612544 Dec 09 21:28:34.781617 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0adb0cd-f647-4b57-9c1b-264e4c98d49e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event updated for resources: {'SecurityGroup': ['ID=66e1817f-e10c-4faf-abd8-bc5e8fda7f97,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:34.925555 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b3e82703-18ee-427a-94f0-8643f39e648e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:34.967238 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15947a49-c461-45f9-9da6-221a4c857bc3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:35.083344 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-64c9c771-5bf1-4055-8dc6-6083e3c30ac9 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:35.090586 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-64c9c771-5bf1-4055-8dc6-6083e3c30ac9 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/networks?id=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 HTTP/1.1" status: 200 len: 816 time: 0.3249283 Dec 09 21:28:35.120548 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-5fc20d0f-d53c-4222-aaad-ef78bb8539ab tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Allocated IP 10.2.2.200 (a133a939-2827-4fe6-81f5-14715631c0ec/753ba647-b0b0-482e-ac28-89c7e6adf654/b7cad057-c6e6-483b-9791-e1b1a0dd73ac) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:35.125675 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b3e82703-18ee-427a-94f0-8643f39e648e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:35.140840 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-d74fe2cf-b99d-4561-8cc9-3fbeb6769ea1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/quotas/29f2c1d9be9348b0888bc61ed37ed957 HTTP/1.1" status: 200 len: 375 time: 0.0492463 Dec 09 21:28:35.144225 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b3e82703-18ee-427a-94f0-8643f39e648e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:35.191887 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 3c106718-124c-4283-bf92-9c0013914134 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:28:35.259012 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3e82703-18ee-427a-94f0-8643f39e648e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=44a5b5c6-9e27-4e4a-b93f-9281d801841b,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:35.314637 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b3e82703-18ee-427a-94f0-8643f39e648e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:35.315335 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-329f42f7-3d4a-4929-a898-1cebbe85f350 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=29f2c1d9be9348b0888bc61ed37ed957&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1643846 Dec 09 21:28:35.316142 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b3e82703-18ee-427a-94f0-8643f39e648e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5692918 Dec 09 21:28:35.319283 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41774) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:35.325087 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-987c6c60-ecd2-4a24-a0c6-483895415905 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Request body: {'security_group_rule': {'security_group_id': '66e1817f-e10c-4faf-abd8-bc5e8fda7f97', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:35.380551 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-987c6c60-ecd2-4a24-a0c6-483895415905 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:35.405416 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 3c106718-124c-4283-bf92-9c0013914134 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:35.406547 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:35.451097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-15947a49-c461-45f9-9da6-221a4c857bc3 admin admin] Router eeac8998-5e81-4874-bc7a-2829c8a216f7 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:28:35.470714 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cc24f723-01bc-43fb-8527-53663faea7d0 None None] Network b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:28:35.574471 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a8bc35ae-f3a9-4c1a-97b9-d2a042b75072 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:35.586119 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d1defc11-f4e4-4e55-8a7c-8968b641ba91 None None] Provisioning complete for port 3c106718-124c-4283-bf92-9c0013914134 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:35.586588 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d1defc11-f4e4-4e55-8a7c-8968b641ba91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:35.612351 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-987c6c60-ecd2-4a24-a0c6-483895415905 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:35.623967 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-987c6c60-ecd2-4a24-a0c6-483895415905 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:35.639734 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-15947a49-c461-45f9-9da6-221a4c857bc3 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:28:35.649796 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-987c6c60-ecd2-4a24-a0c6-483895415905 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ed52ce12-d73f-4684-ac1c-d6f586a16681,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:35.650408 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 8d3e0eef-050e-4fd6-87a2-f7e332149769 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:28:35.652425 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 18bda486-9d6d-41a3-a260-dd244a3838b3 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:28:35.662381 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] Sync routers for ids ['eeac8998-5e81-4874-bc7a-2829c8a216f7'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:28:35.667623 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-987c6c60-ecd2-4a24-a0c6-483895415905 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:35.669169 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-987c6c60-ecd2-4a24-a0c6-483895415905 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3487744 Dec 09 21:28:35.673765 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15947a49-c461-45f9-9da6-221a4c857bc3 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:35.678293 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-15947a49-c461-45f9-9da6-221a4c857bc3 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 4.4933207 Dec 09 21:28:35.679077 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41782) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:35.679405 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41784) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:35.693997 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-97898b3f-d6f3-43c2-a0e2-65328d122373 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:35.711765 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 18bda486-9d6d-41a3-a260-dd244a3838b3 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:28:35.712140 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 18bda486-9d6d-41a3-a260-dd244a3838b3 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:28:35.719830 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-0ca0d9fd-4e21-442f-aa9e-cdd40f5648a6 service neutron] 10.222.0.13 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3836582 Dec 09 21:28:35.728135 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:35.753903 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] Routers {'eeac8998-5e81-4874-bc7a-2829c8a216f7'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:28:35.754647 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:28:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['eeac8998-5e81-4874-bc7a-2829c8a216f7'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:28:35.764201 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990e72d7-9e77-41be-9a00-3f9709a75878 req-06974c54-bbe3-4575-87b6-f4499feace7b tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:35.785924 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-990e72d7-9e77-41be-9a00-3f9709a75878 req-06974c54-bbe3-4575-87b6-f4499feace7b tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 945 time: 0.4932106 Dec 09 21:28:35.815034 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-97898b3f-d6f3-43c2-a0e2-65328d122373 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for floatingip, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:35.835109 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-5fc20d0f-d53c-4222-aaad-ef78bb8539ab tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:35.896714 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-5fc20d0f-d53c-4222-aaad-ef78bb8539ab tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:35.945147 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 3c106718-124c-4283-bf92-9c0013914134, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=3c106718-124c-4283-bf92-9c0013914134,segment=NetworkSegment(dc772362-7c7f-473d-bb4b-7b6705959a15),segment_id=dc772362-7c7f-473d-bb4b-7b6705959a15)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:35.969678 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:36.084130 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d1defc11-f4e4-4e55-8a7c-8968b641ba91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:36.093135 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-5fc20d0f-d53c-4222-aaad-ef78bb8539ab tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Network a133a939-2827-4fe6-81f5-14715631c0ec is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:36.131113 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 8d3e0eef-050e-4fd6-87a2-f7e332149769, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=8d3e0eef-050e-4fd6-87a2-f7e332149769,segment=NetworkSegment(e3c687b5-afac-4ac8-9b38-06599c2a8b7e),segment_id=e3c687b5-afac-4ac8-9b38-06599c2a8b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:36.142993 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fc20d0f-d53c-4222-aaad-ef78bb8539ab tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event updated for resources: {'Port': ['ID=b7cad057-c6e6-483b-9791-e1b1a0dd73ac,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:36.147154 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] Set router eeac8998-5e81-4874-bc7a-2829c8a216f7 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:28:36.160759 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-990e72d7-9e77-41be-9a00-3f9709a75878 req-f7f13a56-4533-4a23-b478-1b62120cb2cf tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3733203 Dec 09 21:28:36.166825 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-5fc20d0f-d53c-4222-aaad-ef78bb8539ab tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:36.173164 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-5fc20d0f-d53c-4222-aaad-ef78bb8539ab tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:36.232392 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-97898b3f-d6f3-43c2-a0e2-65328d122373 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:36.270900 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-18877d5f-5d71-4c98-8699-1de72a387863 service neutron] 10.222.0.13 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5494940 Dec 09 21:28:36.318926 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-5fc20d0f-d53c-4222-aaad-ef78bb8539ab tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:36.320604 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-5fc20d0f-d53c-4222-aaad-ef78bb8539ab tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:36.362974 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-5fc20d0f-d53c-4222-aaad-ef78bb8539ab tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.3307261 Dec 09 21:28:36.376594 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6ce65aa1-b06e-48ca-afcf-287a00a9b05e service neutron] Request body: {'port': {'device_id': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:36.520459 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8af4918c-27c0-4e84-b7dc-020da915a3f4 x-openstack-request-id: req-8af4918c-27c0-4e84-b7dc-020da915a3f4 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:36.522986 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "10aa9750-8504-424a-9c95-af3331c58955", "name": "network-vif-deleted", "tag": "18bda486-9d6d-41a3-a260-dd244a3838b3", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:36.523271 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8af4918c-27c0-4e84-b7dc-020da915a3f4 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:36.523724 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '10aa9750-8504-424a-9c95-af3331c58955', 'name': 'network-vif-deleted', 'tag': '18bda486-9d6d-41a3-a260-dd244a3838b3', 'status': 'completed', 'code': 200} Dec 09 21:28:36.533199 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '8d3e0eef-050e-4fd6-87a2-f7e332149769', 'network_id': '4d446a14-1218-469d-93aa-b4f9babdbb6e', 'port_id': '8d3e0eef-050e-4fd6-87a2-f7e332149769', 'mac_address': 'fa:16:3e:9d:b8:06', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 138, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '75afc53b-d3f3-461c-aba4-c2ce93780246', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:28:36.545341 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=3c106718-124c-4283-bf92-9c0013914134,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:36.612027 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6ce65aa1-b06e-48ca-afcf-287a00a9b05e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:36.739426 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:36.743007 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41794) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:36.743758 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1edf9ec2-d5d4-4c65-b719-f6622a633752 req-b4ad96ef-7c50-48d6-b535-fac838db8d30 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:36.751404 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:36.753767 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1edf9ec2-d5d4-4c65-b719-f6622a633752 req-b4ad96ef-7c50-48d6-b535-fac838db8d30 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=3e0505b6-bf4a-4e37-aacd-7600f6833c41 HTTP/1.1" status: 200 len: 945 time: 0.2538245 Dec 09 21:28:36.862100 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-d1defc11-f4e4-4e55-8a7c-8968b641ba91 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:28:36.862460 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-d1defc11-f4e4-4e55-8a7c-8968b641ba91 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:28:36.879236 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fd05f25-2223-4f75-be37-1fe8d93ac903 req-89966228-7016-4183-89fe-423486ba05b9 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:36.883528 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 8d3e0eef-050e-4fd6-87a2-f7e332149769 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:28:36.885934 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9fd05f25-2223-4f75-be37-1fe8d93ac903 req-89966228-7016-4183-89fe-423486ba05b9 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 945 time: 0.2560585 Dec 09 21:28:36.910158 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-97898b3f-d6f3-43c2-a0e2-65328d122373 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Allocated IP 172.25.3.201 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/9a59b751-0f89-4df2-b0c8-8fd95c5a1ea3) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:36.976065 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1edf9ec2-d5d4-4c65-b719-f6622a633752 req-43b6f9da-6cf6-42a7-a4f0-9b55d01333c1 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2161732 Dec 09 21:28:37.007808 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-157c44ae-2a02-431b-8c97-8dd4ac37d5f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:37.027263 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 8d3e0eef-050e-4fd6-87a2-f7e332149769, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=8d3e0eef-050e-4fd6-87a2-f7e332149769,segment=NetworkSegment(e3c687b5-afac-4ac8-9b38-06599c2a8b7e),segment_id=e3c687b5-afac-4ac8-9b38-06599c2a8b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:37.038703 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:37.117289 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 3c106718-124c-4283-bf92-9c0013914134 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:28:37.248893 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f3dda303-6daf-4f26-a8b9-69dd68b99ee9 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=23f7f8a3e7b14635b4f7dfa561684399&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4937930 Dec 09 21:28:37.255052 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41808) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:37.284604 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9fd05f25-2223-4f75-be37-1fe8d93ac903 req-1509becf-4461-4d00-847f-1b7382cf4c95 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3817594 Dec 09 21:28:37.315898 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['8d3e0eef-050e-4fd6-87a2-f7e332149769'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:28:37.385605 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8356b74-8321-408d-a131-c940ad0d47b9 req-a4f70a39-ac1d-4b91-b434-e6a503765e41 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:37.402132 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8356b74-8321-408d-a131-c940ad0d47b9 req-a4f70a39-ac1d-4b91-b434-e6a503765e41 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:37.417833 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8356b74-8321-408d-a131-c940ad0d47b9 req-a4f70a39-ac1d-4b91-b434-e6a503765e41 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:37.426796 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=8d3e0eef-050e-4fd6-87a2-f7e332149769,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:37.435533 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8356b74-8321-408d-a131-c940ad0d47b9 req-a4f70a39-ac1d-4b91-b434-e6a503765e41 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:37.439171 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-97898b3f-d6f3-43c2-a0e2-65328d122373 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:37.449888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8356b74-8321-408d-a131-c940ad0d47b9 req-a4f70a39-ac1d-4b91-b434-e6a503765e41 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:37.454345 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8356b74-8321-408d-a131-c940ad0d47b9 req-a4f70a39-ac1d-4b91-b434-e6a503765e41 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 3817 time: 0.3398426 Dec 09 21:28:37.552043 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 3c106718-124c-4283-bf92-9c0013914134 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:37.552591 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:37.554619 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'name': 'tempest-ServersTestBootFromVolume-1721587557-router', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163'}], 'enable_snat': True}, 'gw_port_id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:31Z', 'updated_at': '2021-12-09T21:28:34Z', 'revision_number': 3, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'gw_port': {'id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:5c:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1213, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:32Z', 'updated_at': '2021-12-09T21:28:32Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:28:37.558810 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f27ec8c1-6928-4028-8f29-7f413cbd2bd6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:37.587358 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f27ec8c1-6928-4028-8f29-7f413cbd2bd6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:37.652250 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] Checking router: eeac8998-5e81-4874-bc7a-2829c8a216f7 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:28:37.652658 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] Updating router eeac8998-5e81-4874-bc7a-2829c8a216f7 port a86b6971-a767-4594-8a0c-17a90908b6c3 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:28:37.660258 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f27ec8c1-6928-4028-8f29-7f413cbd2bd6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:37.663086 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f27ec8c1-6928-4028-8f29-7f413cbd2bd6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:37.664464 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f27ec8c1-6928-4028-8f29-7f413cbd2bd6 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/1470b5ed-2866-47fe-8713-041fb315f355 HTTP/1.1" status: 204 len: 168 time: 0.4081919 Dec 09 21:28:37.681402 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-157c44ae-2a02-431b-8c97-8dd4ac37d5f1 admin admin] Allocated IP 172.20.0.1 (b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6/93335bf9-6f1e-4484-ae25-dca4b03b29b4/4417739f-7bef-4bd0-b1eb-dab883253f64) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:37.684111 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f27ec8c1-6928-4028-8f29-7f413cbd2bd6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1470b5ed-2866-47fe-8713-041fb315f355,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:37.689906 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-97898b3f-d6f3-43c2-a0e2-65328d122373 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:37.705299 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 8d3e0eef-050e-4fd6-87a2-f7e332149769 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:28:37.709714 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:37.734165 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6ce65aa1-b06e-48ca-afcf-287a00a9b05e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 90180a85-620b-470e-b808-b635138111be {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:28:37.740389 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-97898b3f-d6f3-43c2-a0e2-65328d122373 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:37.745723 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-97898b3f-d6f3-43c2-a0e2-65328d122373 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:37.745974 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6ce65aa1-b06e-48ca-afcf-287a00a9b05e service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:37.759103 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97898b3f-d6f3-43c2-a0e2-65328d122373 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:37.768959 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6ce65aa1-b06e-48ca-afcf-287a00a9b05e service neutron] Transition to ACTIVE for port object 90180a85-620b-470e-b808-b635138111be will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:28:37.795135 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6ce65aa1-b06e-48ca-afcf-287a00a9b05e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:37.827421 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97898b3f-d6f3-43c2-a0e2-65328d122373 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event updated for resources: {'Port': ['ID=9a59b751-0f89-4df2-b0c8-8fd95c5a1ea3,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:37.844517 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5de670e1-f698-4ea3-9df1-1d8ea7bb3c07 None None] Provisioning complete for port 3c106718-124c-4283-bf92-9c0013914134 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:37.844944 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5de670e1-f698-4ea3-9df1-1d8ea7bb3c07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:37.946022 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-97cd8d70-12ed-413c-8b8f-7ecb1e61b73e req-95c22722-406f-485a-8e10-66e6448502b5 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 210 time: 0.4872627 Dec 09 21:28:38.012172 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-97898b3f-d6f3-43c2-a0e2-65328d122373 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:38.159239 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:38.276847 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ce65aa1-b06e-48ca-afcf-287a00a9b05e service neutron] Pushing event updated for resources: {'Port': ['ID=90180a85-620b-470e-b808-b635138111be,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:38.328903 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8356b74-8321-408d-a131-c940ad0d47b9 req-d97a728b-9b82-4a58-b340-8e5eece4f65a tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5573785 Dec 09 21:28:38.331114 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6ce65aa1-b06e-48ca-afcf-287a00a9b05e service neutron] Attempting to bind port 90180a85-620b-470e-b808-b635138111be on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:28:38.331473 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6ce65aa1-b06e-48ca-afcf-287a00a9b05e service neutron] Attempting to bind port 90180a85-620b-470e-b808-b635138111be by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'f5a54e61-4fb1-4afa-9a27-98e2163b0365', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'f0373886-3db8-47eb-af65-78244497171e'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:28:38.331818 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6ce65aa1-b06e-48ca-afcf-287a00a9b05e service neutron] Attempting to bind port 90180a85-620b-470e-b808-b635138111be on network f0373886-3db8-47eb-af65-78244497171e {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:38.332240 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-97898b3f-d6f3-43c2-a0e2-65328d122373 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:38.348579 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6ce65aa1-b06e-48ca-afcf-287a00a9b05e service neutron] Port 90180a85-620b-470e-b808-b635138111be on network f0373886-3db8-47eb-af65-78244497171e not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:28:38.349482 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6ce65aa1-b06e-48ca-afcf-287a00a9b05e service neutron] Attempting to bind port 90180a85-620b-470e-b808-b635138111be on network f0373886-3db8-47eb-af65-78244497171e {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:38.372001 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6ce65aa1-b06e-48ca-afcf-287a00a9b05e service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:28:38.372669 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6ce65aa1-b06e-48ca-afcf-287a00a9b05e service neutron] Checking segment: {'id': 'f5a54e61-4fb1-4afa-9a27-98e2163b0365', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'f0373886-3db8-47eb-af65-78244497171e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:38.374974 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6ce65aa1-b06e-48ca-afcf-287a00a9b05e service neutron] Bound using segment: {'id': 'f5a54e61-4fb1-4afa-9a27-98e2163b0365', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'f0373886-3db8-47eb-af65-78244497171e'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:28:38.375758 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6ce65aa1-b06e-48ca-afcf-287a00a9b05e service neutron] Bound port: 90180a85-620b-470e-b808-b635138111be, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f5a54e61-4fb1-4afa-9a27-98e2163b0365', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': 'f0373886-3db8-47eb-af65-78244497171e'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:28:38.376598 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6ce65aa1-b06e-48ca-afcf-287a00a9b05e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:38.404355 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-157c44ae-2a02-431b-8c97-8dd4ac37d5f1 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:38.410344 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41818) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:38.541504 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-ef87e84c-81d0-4362-8da0-69f43475ec99 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:38.543017 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-ef87e84c-81d0-4362-8da0-69f43475ec99 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.31 "GET /v2.0/networks?id=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 HTTP/1.1" status: 200 len: 816 time: 0.5013788 Dec 09 21:28:38.547938 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32d1dae5-1a28-499d-b8f4-c6300e22e17c req-06563bda-08f5-4467-bcb5-178b13be0a6b tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:38.550013 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32d1dae5-1a28-499d-b8f4-c6300e22e17c req-06563bda-08f5-4467-bcb5-178b13be0a6b tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 945 time: 0.1449745 Dec 09 21:28:38.584079 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4c93008a-5e68-42c7-87be-9be310527d3d admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=702dd5358af3486aaefcfdfbf0070143&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1558294 Dec 09 21:28:38.598001 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41820) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:38.606905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d33475c3-a6d1-4325-977d-783dcbf0fe39 req-5bb9e185-977e-460c-ae11-98b1731736bc tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:38.608826 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d33475c3-a6d1-4325-977d-783dcbf0fe39 req-5bb9e185-977e-460c-ae11-98b1731736bc tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=3e0505b6-bf4a-4e37-aacd-7600f6833c41 HTTP/1.1" status: 200 len: 945 time: 0.1639857 Dec 09 21:28:38.650120 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6ce65aa1-b06e-48ca-afcf-287a00a9b05e service neutron] For port 90180a85-620b-470e-b808-b635138111be, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:28:38.656637 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:38.671758 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:38.672362 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-157c44ae-2a02-431b-8c97-8dd4ac37d5f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:38.697143 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6ce65aa1-b06e-48ca-afcf-287a00a9b05e service neutron] For port 90180a85-620b-470e-b808-b635138111be, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=90180a85-620b-470e-b808-b635138111be,segment=NetworkSegment(f5a54e61-4fb1-4afa-9a27-98e2163b0365),segment_id=f5a54e61-4fb1-4afa-9a27-98e2163b0365)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:28:38.706709 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d33475c3-a6d1-4325-977d-783dcbf0fe39 req-d6b2ab5e-6f99-42fb-bd71-e44192430197 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0855708 Dec 09 21:28:38.710561 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32d1dae5-1a28-499d-b8f4-c6300e22e17c req-78754d5c-6a0a-4bf9-bd2e-ce4a145e4f83 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1529040 Dec 09 21:28:38.711783 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6ce65aa1-b06e-48ca-afcf-287a00a9b05e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:38.750490 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6ce65aa1-b06e-48ca-afcf-287a00a9b05e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:38.750490 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6ce65aa1-b06e-48ca-afcf-287a00a9b05e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:38.751750 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6ce65aa1-b06e-48ca-afcf-287a00a9b05e service neutron] 10.222.0.10 "PUT /v2.0/ports/90180a85-620b-470e-b808-b635138111be HTTP/1.1" status: 200 len: 1093 time: 2.3803246 Dec 09 21:28:38.754641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'tag': '90180a85-620b-470e-b808-b635138111be'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:38.768089 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ab0c8b8e-3d29-4ba4-8d19-8b6c68c8d853" -d '{"events": [{"name": "network-changed", "server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "tag": "90180a85-620b-470e-b808-b635138111be"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:38.769000 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:38.798048 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: BUILD current_port_status: DOWN port_id 8d3e0eef-050e-4fd6-87a2-f7e332149769 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:28:38.802660 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-157c44ae-2a02-431b-8c97-8dd4ac37d5f1 admin admin] Network b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:38.833201 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-0ef49fe1-f0c1-46bc-98f9-4892dc4355a3 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=29f2c1d9be9348b0888bc61ed37ed957 HTTP/1.1" status: 200 len: 380 time: 0.2706470 Dec 09 21:28:38.833937 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-bc68dfaf-1111-4234-b35d-634c3e9d6755 service neutron] Request body: {'port': {'device_id': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:38.841128 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-157c44ae-2a02-431b-8c97-8dd4ac37d5f1 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:38.844944 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-157c44ae-2a02-431b-8c97-8dd4ac37d5f1 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:38.857456 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-157c44ae-2a02-431b-8c97-8dd4ac37d5f1 admin admin] Pushing event updated for resources: {'Port': ['ID=4417739f-7bef-4bd0-b1eb-dab883253f64,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:38.909798 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-9cad28b1-e8b6-4f91-8856-1db429c12b9d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Request body: {'port': {'device_id': '753dc06f-e08a-4cab-82a9-7e1089901f9b', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'admin_state_up': True, 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'security_groups': ['df0eeb44-314a-4a29-a8ce-fccee69f8fe4']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:38.951806 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] Attempting to bind port a86b6971-a767-4594-8a0c-17a90908b6c3 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:28:38.952175 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] Attempting to bind port a86b6971-a767-4594-8a0c-17a90908b6c3 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:28:38.952539 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] Attempting to bind port a86b6971-a767-4594-8a0c-17a90908b6c3 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:38.954773 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a94f6c6-688a-4493-838a-2170c617a521 None None] Pushing event updated for resources: {'Port': ['ID=a86b6971-a767-4594-8a0c-17a90908b6c3,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:38.970469 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 8d3e0eef-050e-4fd6-87a2-f7e332149769, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=8d3e0eef-050e-4fd6-87a2-f7e332149769,segment=NetworkSegment(e3c687b5-afac-4ac8-9b38-06599c2a8b7e),segment_id=e3c687b5-afac-4ac8-9b38-06599c2a8b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:38.972866 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5de670e1-f698-4ea3-9df1-1d8ea7bb3c07 None None] Provisioning complete for port b7cad057-c6e6-483b-9791-e1b1a0dd73ac triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:38.973301 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5de670e1-f698-4ea3-9df1-1d8ea7bb3c07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:38.980252 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:38.983503 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:28:38.984110 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:38.984539 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:38.984913 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:28:38.985400 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] Bound port: a86b6971-a767-4594-8a0c-17a90908b6c3, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:28:38.985783 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:39.066140 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-97898b3f-d6f3-43c2-a0e2-65328d122373 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:39.074886 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-50cacb54-c063-4467-9761-26bec0d5497d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:39.095241 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-5de670e1-f698-4ea3-9df1-1d8ea7bb3c07 None None] Port b7cad057-c6e6-483b-9791-e1b1a0dd73ac cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:28:39.136438 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=8d3e0eef-050e-4fd6-87a2-f7e332149769,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:39.158888 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] For port a86b6971-a767-4594-8a0c-17a90908b6c3, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:28:39.164211 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] For port a86b6971-a767-4594-8a0c-17a90908b6c3, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a86b6971-a767-4594-8a0c-17a90908b6c3,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:28:39.172732 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:39.278532 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a94f6c6-688a-4493-838a-2170c617a521 None None] Pushing event updated for resources: {'Port': ['ID=a86b6971-a767-4594-8a0c-17a90908b6c3,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:39.285986 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] Routers {'eeac8998-5e81-4874-bc7a-2829c8a216f7'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:28:39.286618 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:28:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['eeac8998-5e81-4874-bc7a-2829c8a216f7'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:28:39.378291 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-85b9fa1d-cf14-4a2d-85ac-03ac7ffa990c x-openstack-request-id: req-85b9fa1d-cf14-4a2d-85ac-03ac7ffa990c {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:39.378827 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "tag": "90180a85-620b-470e-b808-b635138111be", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:39.378964 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-85b9fa1d-cf14-4a2d-85ac-03ac7ffa990c {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:39.379366 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'tag': '90180a85-620b-470e-b808-b635138111be', 'status': 'completed', 'code': 200} Dec 09 21:28:39.409853 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] Set router eeac8998-5e81-4874-bc7a-2829c8a216f7 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:28:39.464532 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ce65aa1-b06e-48ca-afcf-287a00a9b05e service neutron] Pushing event updated for resources: {'Port': ['ID=90180a85-620b-470e-b808-b635138111be,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:39.481089 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6b6585b8-fead-4384-b466-5d6aaa72c2dc None None] Provisioning complete for port 4417739f-7bef-4bd0-b1eb-dab883253f64 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:39.481715 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6b6585b8-fead-4384-b466-5d6aaa72c2dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:39.514104 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36f5d116-b61b-4f6b-b61d-e883d7f761ef req-8fc581ed-e1d3-4ddb-9529-f7420c0773a0 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 210 time: 0.1374161 Dec 09 21:28:39.574389 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-157c44ae-2a02-431b-8c97-8dd4ac37d5f1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:39.581718 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-97898b3f-d6f3-43c2-a0e2-65328d122373 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:39.592725 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-bc68dfaf-1111-4234-b35d-634c3e9d6755 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:39.616008 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bf1df7f-ea64-4076-8ff8-cafcf81e3768 req-6f6cab44-3e06-40d1-baaa-781cd8daccac tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:39.618366 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3bf1df7f-ea64-4076-8ff8-cafcf81e3768 req-6f6cab44-3e06-40d1-baaa-781cd8daccac tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 943 time: 0.2434931 Dec 09 21:28:39.719532 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-50cacb54-c063-4467-9761-26bec0d5497d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:39.772263 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab0c8b8e-3d29-4ba4-8d19-8b6c68c8d853 req-f7db8097-2687-416a-bf76-aaaaab949726 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:39.772961 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab0c8b8e-3d29-4ba4-8d19-8b6c68c8d853 req-f7db8097-2687-416a-bf76-aaaaab949726 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:39.773445 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab0c8b8e-3d29-4ba4-8d19-8b6c68c8d853 req-f7db8097-2687-416a-bf76-aaaaab949726 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:39.774064 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab0c8b8e-3d29-4ba4-8d19-8b6c68c8d853 req-f7db8097-2687-416a-bf76-aaaaab949726 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:39.774536 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab0c8b8e-3d29-4ba4-8d19-8b6c68c8d853 req-f7db8097-2687-416a-bf76-aaaaab949726 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:39.778478 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ab0c8b8e-3d29-4ba4-8d19-8b6c68c8d853 req-f7db8097-2687-416a-bf76-aaaaab949726 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=03e962eb7f5e4325a7c08c8b1e2a4cea&device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 4365 time: 0.8223710 Dec 09 21:28:39.837775 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 8d3e0eef-050e-4fd6-87a2-f7e332149769 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:28:39.849757 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97898b3f-d6f3-43c2-a0e2-65328d122373 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event updated for resources: {'Port': ['ID=9a59b751-0f89-4df2-b0c8-8fd95c5a1ea3,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:39.914955 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-97898b3f-d6f3-43c2-a0e2-65328d122373 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:39.933379 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-6b6585b8-fead-4384-b466-5d6aaa72c2dc None None] Port 4417739f-7bef-4bd0-b1eb-dab883253f64 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:28:39.941416 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-9cad28b1-e8b6-4f91-8856-1db429c12b9d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Made reservation on behalf of 29f2c1d9be9348b0888bc61ed37ed957 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:39.947169 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-9cad28b1-e8b6-4f91-8856-1db429c12b9d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:39.959418 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:39.980980 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 8d3e0eef-050e-4fd6-87a2-f7e332149769 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:39.981524 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:40.022807 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3bf1df7f-ea64-4076-8ff8-cafcf81e3768 req-6618ef1b-8d80-4746-9fc0-5cea551c6113 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3943558 Dec 09 21:28:40.052517 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4889d80-7809-4414-8984-e07229d9a890 req-3b136e90-e6d1-441a-adc9-016428dd1e04 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:40.058407 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4889d80-7809-4414-8984-e07229d9a890 req-3b136e90-e6d1-441a-adc9-016428dd1e04 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:40.064571 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4889d80-7809-4414-8984-e07229d9a890 req-3b136e90-e6d1-441a-adc9-016428dd1e04 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:40.070451 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4889d80-7809-4414-8984-e07229d9a890 req-3b136e90-e6d1-441a-adc9-016428dd1e04 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:40.076483 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4889d80-7809-4414-8984-e07229d9a890 req-3b136e90-e6d1-441a-adc9-016428dd1e04 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:40.078344 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e4889d80-7809-4414-8984-e07229d9a890 req-3b136e90-e6d1-441a-adc9-016428dd1e04 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 3829 time: 0.3444908 Dec 09 21:28:40.102434 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56a7b7ed-b56b-42dd-ac6b-0e0369007656 req-9287dbee-74db-448a-92fd-b0952d117ac7 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:40.103981 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56a7b7ed-b56b-42dd-ac6b-0e0369007656 req-9287dbee-74db-448a-92fd-b0952d117ac7 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.10 "GET /v2.0/ports?device_id=3e0505b6-bf4a-4e37-aacd-7600f6833c41 HTTP/1.1" status: 200 len: 945 time: 0.3690023 Dec 09 21:28:40.135875 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'name': 'tempest-ServersTestBootFromVolume-1721587557-router', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163'}], 'enable_snat': True}, 'gw_port_id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:31Z', 'updated_at': '2021-12-09T21:28:34Z', 'revision_number': 3, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'gw_port': {'id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:5c:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1213, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:32Z', 'updated_at': '2021-12-09T21:28:39Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:28:40.199022 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45ed1654-d84e-43db-9515-22974caaf7ca None None] The sync data for ids ['eeac8998-5e81-4874-bc7a-2829c8a216f7'] in n-d-713301-27 is: [{'id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'name': 'tempest-ServersTestBootFromVolume-1721587557-router', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163'}], 'enable_snat': True}, 'gw_port_id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:31Z', 'updated_at': '2021-12-09T21:28:34Z', 'revision_number': 3, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'gw_port': {'id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:5c:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1213, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:32Z', 'updated_at': '2021-12-09T21:28:39Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:28:40.233424 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:40.244810 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-9cad28b1-e8b6-4f91-8856-1db429c12b9d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Allocated IP 172.20.0.12 (e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8/ace82e8b-012a-4184-a81e-5303eecf12ff/778d35d4-c635-4fcb-b344-64cbb94958b9) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:40.274428 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bac40331-6475-4539-8840-531fdb9e5c14', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8d3e0eef-050e-4fd6-87a2-f7e332149769'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:40.284612 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-af447dc1-f585-43f9-a738-fab04e9101e6" -d '{"events": [{"server_uuid": "bac40331-6475-4539-8840-531fdb9e5c14", "name": "network-vif-plugged", "status": "completed", "tag": "8d3e0eef-050e-4fd6-87a2-f7e332149769"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:40.308799 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 8d3e0eef-050e-4fd6-87a2-f7e332149769, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=8d3e0eef-050e-4fd6-87a2-f7e332149769,segment=NetworkSegment(e3c687b5-afac-4ac8-9b38-06599c2a8b7e),segment_id=e3c687b5-afac-4ac8-9b38-06599c2a8b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:40.316291 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:40.362982 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e4889d80-7809-4414-8984-e07229d9a890 req-6b7af7e6-9777-41a6-99c0-21f2d125ebc8 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2655661 Dec 09 21:28:40.385387 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-bc68dfaf-1111-4234-b35d-634c3e9d6755 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1e946a47-f496-445b-964b-618881eab263 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:28:40.389575 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=8d3e0eef-050e-4fd6-87a2-f7e332149769,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:40.393562 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-9cad28b1-e8b6-4f91-8856-1db429c12b9d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:40.401179 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:40.401584 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:40.402320 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:40.405516 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:40.405996 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:40.406528 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:40.407353 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:40.407725 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:40.408065 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:40.408441 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:40.408908 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:40.409246 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:40.409740 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:40.425339 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fb819c2-a409-4abc-8735-cea6d48e2149 req-3b80eee7-9ffc-4555-8cc5-3222539b2ec8 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:40.426945 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fb819c2-a409-4abc-8735-cea6d48e2149 req-3b80eee7-9ffc-4555-8cc5-3222539b2ec8 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 945 time: 0.2575140 Dec 09 21:28:40.436030 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-bc68dfaf-1111-4234-b35d-634c3e9d6755 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:40.441150 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-97898b3f-d6f3-43c2-a0e2-65328d122373 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:40.448728 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-97898b3f-d6f3-43c2-a0e2-65328d122373 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 4.7582142 Dec 09 21:28:40.481952 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-9cad28b1-e8b6-4f91-8856-1db429c12b9d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:40.497423 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-56a7b7ed-b56b-42dd-ac6b-0e0369007656 req-5eaeaed6-f3a0-4dca-a1e4-4c18a62ff526 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Deleting port fd5eccfa-9fff-46bc-a3bd-73a647cd826e {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:28:40.498007 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-56a7b7ed-b56b-42dd-ac6b-0e0369007656 req-5eaeaed6-f3a0-4dca-a1e4-4c18a62ff526 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:40.540995 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cce3f23-a03d-4f03-b62b-739a01dcf095 req-3d9c9e25-ce4d-4e82-a28d-6593cffa0e72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:40.542897 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2cce3f23-a03d-4f03-b62b-739a01dcf095 req-3d9c9e25-ce4d-4e82-a28d-6593cffa0e72 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 1097 time: 0.7042758 Dec 09 21:28:40.544036 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-50cacb54-c063-4467-9761-26bec0d5497d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:40.548135 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-50cacb54-c063-4467-9761-26bec0d5497d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:40.551628 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-50cacb54-c063-4467-9761-26bec0d5497d admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/03d925ec-d2f6-41ca-80e3-fe2cf6972aa4 HTTP/1.1" status: 204 len: 168 time: 1.9502792 Dec 09 21:28:40.630764 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-9cad28b1-e8b6-4f91-8856-1db429c12b9d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Network e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:40.661206 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-157c44ae-2a02-431b-8c97-8dd4ac37d5f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:40.673467 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab0c8b8e-3d29-4ba4-8d19-8b6c68c8d853 req-21a3e39f-ce26-4114-8e0d-7313695954c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:40.673955 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab0c8b8e-3d29-4ba4-8d19-8b6c68c8d853 req-21a3e39f-ce26-4114-8e0d-7313695954c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:40.674422 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab0c8b8e-3d29-4ba4-8d19-8b6c68c8d853 req-21a3e39f-ce26-4114-8e0d-7313695954c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:40.676787 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ab0c8b8e-3d29-4ba4-8d19-8b6c68c8d853 req-21a3e39f-ce26-4114-8e0d-7313695954c3 service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=03e962eb7f5e4325a7c08c8b1e2a4cea&shared=False HTTP/1.1" status: 200 len: 2293 time: 0.8755839 Dec 09 21:28:40.679111 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-56a7b7ed-b56b-42dd-ac6b-0e0369007656 req-5eaeaed6-f3a0-4dca-a1e4-4c18a62ff526 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] For port fd5eccfa-9fff-46bc-a3bd-73a647cd826e, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=fd5eccfa-9fff-46bc-a3bd-73a647cd826e,segment=NetworkSegment(d383c8e8-889c-4799-8949-cba737586b7e),segment_id=d383c8e8-889c-4799-8949-cba737586b7e)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:40.679650 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-56a7b7ed-b56b-42dd-ac6b-0e0369007656 req-5eaeaed6-f3a0-4dca-a1e4-4c18a62ff526 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:40.693269 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-9cad28b1-e8b6-4f91-8856-1db429c12b9d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:40.695286 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-56a7b7ed-b56b-42dd-ac6b-0e0369007656 req-5eaeaed6-f3a0-4dca-a1e4-4c18a62ff526 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Calling delete_port for fd5eccfa-9fff-46bc-a3bd-73a647cd826e owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:28:40.696137 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-9cad28b1-e8b6-4f91-8856-1db429c12b9d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:40.742971 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50cacb54-c063-4467-9761-26bec0d5497d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=03d925ec-d2f6-41ca-80e3-fe2cf6972aa4,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:40.800513 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cad28b1-e8b6-4f91-8856-1db429c12b9d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Pushing event updated for resources: {'Port': ['ID=778d35d4-c635-4fcb-b344-64cbb94958b9,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:40.869540 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2cce3f23-a03d-4f03-b62b-739a01dcf095 req-a033aa2a-bf6d-44e9-bad9-67670eafeada service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2470820 Dec 09 21:28:40.885620 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-9cad28b1-e8b6-4f91-8856-1db429c12b9d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:40.886181 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-9cad28b1-e8b6-4f91-8856-1db429c12b9d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:40.925708 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fb819c2-a409-4abc-8735-cea6d48e2149 req-92ade2af-849f-4635-9452-14e6045ad671 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4821966 Dec 09 21:28:41.042143 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-9cad28b1-e8b6-4f91-8856-1db429c12b9d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.1892140 Dec 09 21:28:41.050252 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-45b5735d-167f-4aa7-9c7e-3b547ea984da x-openstack-request-id: req-45b5735d-167f-4aa7-9c7e-3b547ea984da {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:41.052284 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bac40331-6475-4539-8840-531fdb9e5c14", "name": "network-vif-plugged", "status": "completed", "tag": "8d3e0eef-050e-4fd6-87a2-f7e332149769", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:41.054039 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-45b5735d-167f-4aa7-9c7e-3b547ea984da {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:41.057297 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bac40331-6475-4539-8840-531fdb9e5c14', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8d3e0eef-050e-4fd6-87a2-f7e332149769', 'code': 200} Dec 09 21:28:41.103971 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-be71b53a-245b-422c-9b68-88679d565ce2 service neutron] Request body: {'port': {'device_id': '753dc06f-e08a-4cab-82a9-7e1089901f9b', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:41.146660 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7293f2af-75b6-431d-ab82-38ad2f0aac9b req-b95d3fae-9ab8-46d3-aa19-30dcfd546611 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:41.151688 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7293f2af-75b6-431d-ab82-38ad2f0aac9b req-b95d3fae-9ab8-46d3-aa19-30dcfd546611 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/ports?device_id=3e0505b6-bf4a-4e37-aacd-7600f6833c41 HTTP/1.1" status: 200 len: 945 time: 0.3050194 Dec 09 21:28:41.154632 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-bc68dfaf-1111-4234-b35d-634c3e9d6755 service neutron] Transition to ACTIVE for port object 1e946a47-f496-445b-964b-618881eab263 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:28:41.159133 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-56a7b7ed-b56b-42dd-ac6b-0e0369007656 req-5eaeaed6-f3a0-4dca-a1e4-4c18a62ff526 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:41.176830 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['fd5eccfa-9fff-46bc-a3bd-73a647cd826e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:28:41.239431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5eaeaed6-f3a0-4dca-a1e4-4c18a62ff526 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Pushing event deleted for resources: {'Port': ['ID=fd5eccfa-9fff-46bc-a3bd-73a647cd826e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:41.241032 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-bc68dfaf-1111-4234-b35d-634c3e9d6755 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:41.247143 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a86b6971-a767-4594-8a0c-17a90908b6c3 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:28:41.340788 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab0c8b8e-3d29-4ba4-8d19-8b6c68c8d853 req-4a459681-2cd8-4463-bd41-974cd8042fa4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:41.342748 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ab0c8b8e-3d29-4ba4-8d19-8b6c68c8d853 req-4a459681-2cd8-4463-bd41-974cd8042fa4 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.6017570 Dec 09 21:28:41.344991 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-68878b59-9347-4962-a254-413535df86a1 None None] Provisioning complete for port 778d35d4-c635-4fcb-b344-64cbb94958b9 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:41.345345 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-68878b59-9347-4962-a254-413535df86a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:41.465660 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port a86b6971-a767-4594-8a0c-17a90908b6c3 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:41.466047 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:41.476354 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-be71b53a-245b-422c-9b68-88679d565ce2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:41.513352 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-56a7b7ed-b56b-42dd-ac6b-0e0369007656 req-5eaeaed6-f3a0-4dca-a1e4-4c18a62ff526 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] No DVR routers for this DVR port fd5eccfa-9fff-46bc-a3bd-73a647cd826e on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:28:41.523422 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-56a7b7ed-b56b-42dd-ac6b-0e0369007656 req-5eaeaed6-f3a0-4dca-a1e4-4c18a62ff526 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:41.534339 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56a7b7ed-b56b-42dd-ac6b-0e0369007656 req-5eaeaed6-f3a0-4dca-a1e4-4c18a62ff526 tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.10 "DELETE /v2.0/ports/fd5eccfa-9fff-46bc-a3bd-73a647cd826e HTTP/1.1" status: 204 len: 173 time: 1.4198649 Dec 09 21:28:41.547528 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7293f2af-75b6-431d-ab82-38ad2f0aac9b req-57291b5e-ce09-435c-b9ce-d156e5126aea tempest-DeleteServersTestJSON-1647208849 tempest-DeleteServersTestJSON-1647208849-project] 10.222.0.13 "GET /v2.0/security-groups?id=d2724709-ec49-467a-ab5e-5283cd267185&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3747146 Dec 09 21:28:41.548366 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3e0505b6-bf4a-4e37-aacd-7600f6833c41', 'name': 'network-vif-deleted', 'tag': 'fd5eccfa-9fff-46bc-a3bd-73a647cd826e'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:41.553305 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fa7fdfb1-2447-459f-b455-2ba52a6551a3" -d '{"events": [{"server_uuid": "3e0505b6-bf4a-4e37-aacd-7600f6833c41", "name": "network-vif-deleted", "tag": "fd5eccfa-9fff-46bc-a3bd-73a647cd826e"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:41.562289 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5272365-f5c9-4b1a-9804-cc04c39855e8 req-56f66f07-d346-43b7-bfe4-dde4a2f2adb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:41.563977 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d5272365-f5c9-4b1a-9804-cc04c39855e8 req-56f66f07-d346-43b7-bfe4-dde4a2f2adb1 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 1097 time: 0.2417581 Dec 09 21:28:41.576481 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6379404-e52b-4906-8d0a-b6c02e25b5da req-f06fef88-5dd4-4265-9dc2-eaa20ea8d9fb tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:41.579113 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6379404-e52b-4906-8d0a-b6c02e25b5da req-f06fef88-5dd4-4265-9dc2-eaa20ea8d9fb tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 932 time: 0.4258749 Dec 09 21:28:41.586694 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc68dfaf-1111-4234-b35d-634c3e9d6755 service neutron] Pushing event updated for resources: {'Port': ['ID=1e946a47-f496-445b-964b-618881eab263,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:41.624884 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-68878b59-9347-4962-a254-413535df86a1 None None] Port 778d35d4-c635-4fcb-b344-64cbb94958b9 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:28:41.682947 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-157c44ae-2a02-431b-8c97-8dd4ac37d5f1 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:41.748699 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-157c44ae-2a02-431b-8c97-8dd4ac37d5f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:41.826816 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6379404-e52b-4906-8d0a-b6c02e25b5da req-28dff059-ff08-47dd-8369-81bb19e871fb tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2370112 Dec 09 21:28:41.841119 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:41.929571 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port a86b6971-a767-4594-8a0c-17a90908b6c3, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a86b6971-a767-4594-8a0c-17a90908b6c3,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:41.933387 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-bc68dfaf-1111-4234-b35d-634c3e9d6755 service neutron] Attempting to bind port 1e946a47-f496-445b-964b-618881eab263 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:28:41.933843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-bc68dfaf-1111-4234-b35d-634c3e9d6755 service neutron] Attempting to bind port 1e946a47-f496-445b-964b-618881eab263 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '669c24e6-ecea-4894-adc4-51a9b461417f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:28:41.934434 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-bc68dfaf-1111-4234-b35d-634c3e9d6755 service neutron] Attempting to bind port 1e946a47-f496-445b-964b-618881eab263 on network a859e4ba-764a-41c0-982d-5bf79a2797a1 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:41.940886 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:41.955212 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-bc68dfaf-1111-4234-b35d-634c3e9d6755 service neutron] Port 1e946a47-f496-445b-964b-618881eab263 on network a859e4ba-764a-41c0-982d-5bf79a2797a1 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:28:41.955831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-bc68dfaf-1111-4234-b35d-634c3e9d6755 service neutron] Attempting to bind port 1e946a47-f496-445b-964b-618881eab263 on network a859e4ba-764a-41c0-982d-5bf79a2797a1 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:41.975968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-bc68dfaf-1111-4234-b35d-634c3e9d6755 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:28:41.976383 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-bc68dfaf-1111-4234-b35d-634c3e9d6755 service neutron] Checking segment: {'id': '669c24e6-ecea-4894-adc4-51a9b461417f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:41.977013 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-bc68dfaf-1111-4234-b35d-634c3e9d6755 service neutron] Bound using segment: {'id': '669c24e6-ecea-4894-adc4-51a9b461417f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:28:41.977230 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-bc68dfaf-1111-4234-b35d-634c3e9d6755 service neutron] Bound port: 1e946a47-f496-445b-964b-618881eab263, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '669c24e6-ecea-4894-adc4-51a9b461417f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:28:41.977587 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-bc68dfaf-1111-4234-b35d-634c3e9d6755 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:42.030756 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-94160675-f575-4c5e-97f5-3a7e9694fe5a tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-securitygroup--240105791&fields=id&tenant_id=0a5d0e4652be4d8b87936a559840cc87 HTTP/1.1" status: 200 len: 267 time: 0.2220554 Dec 09 21:28:42.050390 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d5272365-f5c9-4b1a-9804-cc04c39855e8 req-3887f80a-bbbf-48f4-a5d4-66416e8a0347 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4782200 Dec 09 21:28:42.071048 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-157c44ae-2a02-431b-8c97-8dd4ac37d5f1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:42.086307 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=a86b6971-a767-4594-8a0c-17a90908b6c3,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:42.096750 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-157c44ae-2a02-431b-8c97-8dd4ac37d5f1 admin admin] Pushing event updated for resources: {'Port': ['ID=4417739f-7bef-4bd0-b1eb-dab883253f64,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:42.157435 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-3c2af9c3-099c-48ae-8451-a3eb4bac764b tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:42.159879 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-3c2af9c3-099c-48ae-8451-a3eb4bac764b tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports/18d9d7fa-fedf-4844-90ef-6757eb984ae2 HTTP/1.1" status: 200 len: 936 time: 0.1279120 Dec 09 21:28:42.246801 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5330ebea-3886-41cf-892c-4379d75c41d9 req-26a3b251-9ef3-4a56-a041-7b91dfb4c0e7 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:42.258721 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5330ebea-3886-41cf-892c-4379d75c41d9 req-26a3b251-9ef3-4a56-a041-7b91dfb4c0e7 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 945 time: 0.2525804 Dec 09 21:28:42.271343 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-157c44ae-2a02-431b-8c97-8dd4ac37d5f1 admin admin] Network b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:42.275470 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-157c44ae-2a02-431b-8c97-8dd4ac37d5f1 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:42.382721 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-373c126d-3e7e-4f9b-ab60-1d8402156596 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:42.384453 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-373c126d-3e7e-4f9b-ab60-1d8402156596 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports/1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f HTTP/1.1" status: 200 len: 937 time: 0.2059243 Dec 09 21:28:42.406719 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-bc68dfaf-1111-4234-b35d-634c3e9d6755 service neutron] For port 1e946a47-f496-445b-964b-618881eab263, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:28:42.460202 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5330ebea-3886-41cf-892c-4379d75c41d9 req-9fb09ae6-8b60-4756-83c6-d26883f097ac tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2004409 Dec 09 21:28:42.466774 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-be71b53a-245b-422c-9b68-88679d565ce2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 778d35d4-c635-4fcb-b344-64cbb94958b9 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:28:42.493002 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-be71b53a-245b-422c-9b68-88679d565ce2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:42.493423 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-77e28261-eb48-434a-9b38-a3655fbf59fa tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?network_id=ae9d25d5-c9a2-4627-a465-8324b17541d9&fixed_ips=ip_address%3D10.2.2.100&fields=device_id HTTP/1.1" status: 200 len: 210 time: 0.0927551 Dec 09 21:28:42.522927 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-be71b53a-245b-422c-9b68-88679d565ce2 service neutron] Transition to ACTIVE for port object 778d35d4-c635-4fcb-b344-64cbb94958b9 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:28:42.531038 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-157c44ae-2a02-431b-8c97-8dd4ac37d5f1 admin admin] Router eeac8998-5e81-4874-bc7a-2829c8a216f7 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:28:42.535991 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-be71b53a-245b-422c-9b68-88679d565ce2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:42.556495 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-bc68dfaf-1111-4234-b35d-634c3e9d6755 service neutron] For port 1e946a47-f496-445b-964b-618881eab263, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1e946a47-f496-445b-964b-618881eab263,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:28:42.565999 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-0405b407-cef8-4aaf-896d-aaa33f19a885 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?network_id=ae9d25d5-c9a2-4627-a465-8324b17541d9&fixed_ips=ip_address%3D10.2.2.200&fields=device_id HTTP/1.1" status: 200 len: 210 time: 0.0715513 Dec 09 21:28:42.571635 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-bc68dfaf-1111-4234-b35d-634c3e9d6755 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:42.641519 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be71b53a-245b-422c-9b68-88679d565ce2 service neutron] Pushing event updated for resources: {'Port': ['ID=778d35d4-c635-4fcb-b344-64cbb94958b9,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:42.765948 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-bc68dfaf-1111-4234-b35d-634c3e9d6755 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:42.767208 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-bc68dfaf-1111-4234-b35d-634c3e9d6755 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:42.769755 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-bc68dfaf-1111-4234-b35d-634c3e9d6755 service neutron] 10.222.0.10 "PUT /v2.0/ports/1e946a47-f496-445b-964b-618881eab263 HTTP/1.1" status: 200 len: 1130 time: 3.9616740 Dec 09 21:28:42.803268 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-157c44ae-2a02-431b-8c97-8dd4ac37d5f1 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:28:42.814322 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-157c44ae-2a02-431b-8c97-8dd4ac37d5f1 admin admin] 10.222.0.13 "PUT /v2.0/routers/eeac8998-5e81-4874-bc7a-2829c8a216f7/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.1286044 Dec 09 21:28:42.838633 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e45057b9-140c-409f-8038-334a813a187f None None] Provisioning complete for port 4417739f-7bef-4bd0-b1eb-dab883253f64 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:42.839766 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e45057b9-140c-409f-8038-334a813a187f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:42.850094 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-be71b53a-245b-422c-9b68-88679d565ce2 service neutron] Attempting to bind port 778d35d4-c635-4fcb-b344-64cbb94958b9 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:28:42.850481 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-be71b53a-245b-422c-9b68-88679d565ce2 service neutron] Attempting to bind port 778d35d4-c635-4fcb-b344-64cbb94958b9 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'ad90d3b7-fe41-4a28-acd8-4c934cf4d57c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:28:42.851259 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-be71b53a-245b-422c-9b68-88679d565ce2 service neutron] Attempting to bind port 778d35d4-c635-4fcb-b344-64cbb94958b9 on network e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:42.862192 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-be71b53a-245b-422c-9b68-88679d565ce2 service neutron] Port 778d35d4-c635-4fcb-b344-64cbb94958b9 on network e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:28:42.862549 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-be71b53a-245b-422c-9b68-88679d565ce2 service neutron] Attempting to bind port 778d35d4-c635-4fcb-b344-64cbb94958b9 on network e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:42.873615 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-be71b53a-245b-422c-9b68-88679d565ce2 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:28:42.873864 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-be71b53a-245b-422c-9b68-88679d565ce2 service neutron] Checking segment: {'id': 'ad90d3b7-fe41-4a28-acd8-4c934cf4d57c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:42.874261 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-be71b53a-245b-422c-9b68-88679d565ce2 service neutron] Bound using segment: {'id': 'ad90d3b7-fe41-4a28-acd8-4c934cf4d57c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:28:42.874710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-be71b53a-245b-422c-9b68-88679d565ce2 service neutron] Bound port: 778d35d4-c635-4fcb-b344-64cbb94958b9, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ad90d3b7-fe41-4a28-acd8-4c934cf4d57c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:28:42.875083 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-be71b53a-245b-422c-9b68-88679d565ce2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:42.945075 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc68dfaf-1111-4234-b35d-634c3e9d6755 service neutron] Pushing event updated for resources: {'Port': ['ID=1e946a47-f496-445b-964b-618881eab263,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:42.984412 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e45057b9-140c-409f-8038-334a813a187f None None] Port 4417739f-7bef-4bd0-b1eb-dab883253f64 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:28:43.061451 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f4b6177f-b4db-428d-96a2-983626e7c421 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:43.070698 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f4b6177f-b4db-428d-96a2-983626e7c421 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:43.072573 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-be71b53a-245b-422c-9b68-88679d565ce2 service neutron] For port 778d35d4-c635-4fcb-b344-64cbb94958b9, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:28:43.076576 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a86b6971-a767-4594-8a0c-17a90908b6c3 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:28:43.077050 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f4b6177f-b4db-428d-96a2-983626e7c421 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:43.078747 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f4b6177f-b4db-428d-96a2-983626e7c421 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/networks?id=361619eb-51a4-4728-b2cc-72e27ec4eca5&id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&id=ae9d25d5-c9a2-4627-a465-8324b17541d9&id=ae9d25d5-c9a2-4627-a465-8324b17541d9 HTTP/1.1" status: 200 len: 1993 time: 0.5119734 Dec 09 21:28:43.082763 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Request body: {'port': {'device_id': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:43.110294 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-be71b53a-245b-422c-9b68-88679d565ce2 service neutron] For port 778d35d4-c635-4fcb-b344-64cbb94958b9, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=778d35d4-c635-4fcb-b344-64cbb94958b9,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:28:43.128547 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-be71b53a-245b-422c-9b68-88679d565ce2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:43.159574 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e84d458-f22a-4a25-ad27-a2bde1b7077b req-9450cec9-780f-4e2c-8880-6889233bd17c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:43.177725 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e84d458-f22a-4a25-ad27-a2bde1b7077b req-9450cec9-780f-4e2c-8880-6889233bd17c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:43.184245 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e84d458-f22a-4a25-ad27-a2bde1b7077b req-9450cec9-780f-4e2c-8880-6889233bd17c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:43.202050 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e84d458-f22a-4a25-ad27-a2bde1b7077b req-9450cec9-780f-4e2c-8880-6889233bd17c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:43.202926 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port a86b6971-a767-4594-8a0c-17a90908b6c3 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:43.203367 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:43.212516 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e84d458-f22a-4a25-ad27-a2bde1b7077b req-9450cec9-780f-4e2c-8880-6889233bd17c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:43.221216 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e84d458-f22a-4a25-ad27-a2bde1b7077b req-9450cec9-780f-4e2c-8880-6889233bd17c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:43.231182 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e84d458-f22a-4a25-ad27-a2bde1b7077b req-9450cec9-780f-4e2c-8880-6889233bd17c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 4600 time: 0.5314825 Dec 09 21:28:43.239404 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-be71b53a-245b-422c-9b68-88679d565ce2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:43.240063 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-be71b53a-245b-422c-9b68-88679d565ce2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:43.241182 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-a20ea3d4-efba-4dd4-b0c2-b3db41b3993f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/quotas/0a5d0e4652be4d8b87936a559840cc87 HTTP/1.1" status: 200 len: 375 time: 0.1237650 Dec 09 21:28:43.241508 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-be71b53a-245b-422c-9b68-88679d565ce2 service neutron] 10.222.0.31 "PUT /v2.0/ports/778d35d4-c635-4fcb-b344-64cbb94958b9 HTTP/1.1" status: 200 len: 1093 time: 2.1546910 Dec 09 21:28:43.241963 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '753dc06f-e08a-4cab-82a9-7e1089901f9b', 'tag': '778d35d4-c635-4fcb-b344-64cbb94958b9'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:43.256141 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dfc8eb45-989c-4b4e-bada-ecf378ca6fe1" -d '{"events": [{"name": "network-changed", "server_uuid": "753dc06f-e08a-4cab-82a9-7e1089901f9b", "tag": "778d35d4-c635-4fcb-b344-64cbb94958b9"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:43.302611 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be71b53a-245b-422c-9b68-88679d565ce2 service neutron] Pushing event updated for resources: {'Port': ['ID=778d35d4-c635-4fcb-b344-64cbb94958b9,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:43.336652 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] Sync routers for ids ['eeac8998-5e81-4874-bc7a-2829c8a216f7'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:28:43.361221 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] Routers {'eeac8998-5e81-4874-bc7a-2829c8a216f7'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:28:43.362175 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:28:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['eeac8998-5e81-4874-bc7a-2829c8a216f7'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:28:43.382199 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:43.429978 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-48278067-3bbf-4235-b03b-d06943f485c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:43.431821 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-48278067-3bbf-4235-b03b-d06943f485c7 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=29f2c1d9be9348b0888bc61ed37ed957&device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 1096 time: 0.0808091 Dec 09 21:28:43.491449 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-1978d413-97be-4d54-9ce7-7b605e343a02 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=778d35d4-c635-4fcb-b344-64cbb94958b9 HTTP/1.1" status: 200 len: 217 time: 0.0512261 Dec 09 21:28:43.510796 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] Set router eeac8998-5e81-4874-bc7a-2829c8a216f7 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:28:43.571502 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-0b93cc1d-b546-4d51-bb97-f1628673d5ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:43.575866 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-0b93cc1d-b546-4d51-bb97-f1628673d5ab service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ace82e8b-012a-4184-a81e-5303eecf12ff HTTP/1.1" status: 200 len: 855 time: 0.0762095 Dec 09 21:28:43.628488 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-8e8525af-f72c-4982-832d-1464aefea74a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:43.630233 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-8e8525af-f72c-4982-832d-1464aefea74a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0469398 Dec 09 21:28:43.750370 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-f9645507-6f73-405e-9a50-b10b3286bdd8 service neutron] 10.222.0.31 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1099682 Dec 09 21:28:43.758624 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'name': 'tempest-ServersTestBootFromVolume-1721587557-router', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163'}], 'enable_snat': True}, 'gw_port_id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:31Z', 'updated_at': '2021-12-09T21:28:40Z', 'revision_number': 4, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'gw_port': {'id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:5c:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1213, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:32Z', 'updated_at': '2021-12-09T21:28:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '4417739f-7bef-4bd0-b1eb-dab883253f64', 'name': '', 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'mac_address': 'fa:16:3e:a3:e6:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1221, 'fixed_ips': [{'subnet_id': '93335bf9-6f1e-4484-ae25-dca4b03b29b4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:37Z', 'updated_at': '2021-12-09T21:28:41Z', 'revision_number': 2, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'subnets': [{'id': '93335bf9-6f1e-4484-ae25-dca4b03b29b4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:28:43.768074 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-adf0e61c-6486-4ff3-9ed0-1409f72926d0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=0a5d0e4652be4d8b87936a559840cc87&fields=id HTTP/1.1" status: 200 len: 486 time: 0.5257192 Dec 09 21:28:43.780894 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e84d458-f22a-4a25-ad27-a2bde1b7077b req-7ff1e29c-f1e5-46a1-b987-3045efc3d15b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.5481188 Dec 09 21:28:43.827048 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] Checking router: eeac8998-5e81-4874-bc7a-2829c8a216f7 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:28:43.827413 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] Updating router eeac8998-5e81-4874-bc7a-2829c8a216f7 port 4417739f-7bef-4bd0-b1eb-dab883253f64 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:28:43.853292 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 145a0cde-0fe5-4163-a063-0fdfe42f243b {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:28:43.892493 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:43.897935 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-36507deb-31ed-456b-8a17-e782ff649ea9 x-openstack-request-id: req-36507deb-31ed-456b-8a17-e782ff649ea9 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:43.899027 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3e0505b6-bf4a-4e37-aacd-7600f6833c41", "name": "network-vif-deleted", "tag": "fd5eccfa-9fff-46bc-a3bd-73a647cd826e", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:43.899378 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-36507deb-31ed-456b-8a17-e782ff649ea9 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:43.899895 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3e0505b6-bf4a-4e37-aacd-7600f6833c41', 'name': 'network-vif-deleted', 'tag': 'fd5eccfa-9fff-46bc-a3bd-73a647cd826e', 'status': 'completed', 'code': 200} Dec 09 21:28:43.901903 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:43.921333 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd70bbf3-8100-421f-bb85-80efd78786f8 req-e3577cc9-c998-4037-8d97-b9e7a6e4853c service neutron] 10.222.0.31 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1632829 Dec 09 21:28:43.928687 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Transition to ACTIVE for port object 145a0cde-0fe5-4163-a063-0fdfe42f243b will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:28:43.954481 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:43.998276 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-45760925-33a9-4df1-ae04-4954acd398e7 service neutron] 10.222.0.13 "GET /v2.0/networks/361619eb-51a4-4728-b2cc-72e27ec4eca5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1937602 Dec 09 21:28:44.041065 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Pushing event updated for resources: {'Port': ['ID=145a0cde-0fe5-4163-a063-0fdfe42f243b,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:44.084844 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeb12f40-0656-4115-ac6a-c34719bfa24f req-eb1e8536-8cfa-43bd-bbc7-0904e613a22b tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:44.086358 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aeb12f40-0656-4115-ac6a-c34719bfa24f req-eb1e8536-8cfa-43bd-bbc7-0904e613a22b tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 945 time: 0.1524673 Dec 09 21:28:44.108940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:44.109282 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:44.109620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:44.109949 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:44.110274 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:44.110595 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:44.110914 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:44.111231 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:44.111567 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:44.111889 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:44.112209 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:44.112524 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:44.112844 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:44.249965 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aeb12f40-0656-4115-ac6a-c34719bfa24f req-e017d3f5-0da9-4027-be7d-042a7cd27f26 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1482680 Dec 09 21:28:44.251464 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Attempting to bind port 145a0cde-0fe5-4163-a063-0fdfe42f243b on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:28:44.251802 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Attempting to bind port 145a0cde-0fe5-4163-a063-0fdfe42f243b by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '669c24e6-ecea-4894-adc4-51a9b461417f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:28:44.252127 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Attempting to bind port 145a0cde-0fe5-4163-a063-0fdfe42f243b on network a859e4ba-764a-41c0-982d-5bf79a2797a1 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:44.255679 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-020339ab-ac5b-4c8f-a95b-b652c5eb60fa service neutron] 10.222.0.13 "GET /v2.0/networks/361619eb-51a4-4728-b2cc-72e27ec4eca5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2305427 Dec 09 21:28:44.258977 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Port 145a0cde-0fe5-4163-a063-0fdfe42f243b on network a859e4ba-764a-41c0-982d-5bf79a2797a1 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:28:44.259300 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Attempting to bind port 145a0cde-0fe5-4163-a063-0fdfe42f243b on network a859e4ba-764a-41c0-982d-5bf79a2797a1 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:44.265170 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:28:44.265572 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Checking segment: {'id': '669c24e6-ecea-4894-adc4-51a9b461417f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:44.266011 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Bound using segment: {'id': '669c24e6-ecea-4894-adc4-51a9b461417f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:28:44.266531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Bound port: 145a0cde-0fe5-4163-a063-0fdfe42f243b, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '669c24e6-ecea-4894-adc4-51a9b461417f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:28:44.266940 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:44.271006 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:44.279720 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:44.348028 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16d6e99d-1604-460b-ab1b-b20477cdfb3f None None] Pushing event updated for resources: {'Port': ['ID=4417739f-7bef-4bd0-b1eb-dab883253f64,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:44.353451 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-74d020c9-35ae-4e61-8f53-b036219655c6 service neutron] 10.222.0.13 "GET /v2.0/ports/18d9d7fa-fedf-4844-90ef-6757eb984ae2?fields=binding%3Avnic_type&fields=binding%3Aprofile&fields=network_id&fields=resource_request&fields=numa_affinity_policy&fields=device_profile HTTP/1.1" status: 200 len: 311 time: 0.0768657 Dec 09 21:28:44.441238 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] For port 145a0cde-0fe5-4163-a063-0fdfe42f243b, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:28:44.465727 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] For port 145a0cde-0fe5-4163-a063-0fdfe42f243b, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=145a0cde-0fe5-4163-a063-0fdfe42f243b,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:28:44.474007 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:44.491730 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] Attempting to bind port 4417739f-7bef-4bd0-b1eb-dab883253f64 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:28:44.491730 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] Attempting to bind port 4417739f-7bef-4bd0-b1eb-dab883253f64 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'dc772362-7c7f-473d-bb4b-7b6705959a15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:28:44.491730 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] Attempting to bind port 4417739f-7bef-4bd0-b1eb-dab883253f64 on network b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:44.491730 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:28:44.491730 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] Checking segment: {'id': 'dc772362-7c7f-473d-bb4b-7b6705959a15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:44.491730 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:44.491730 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] Bound using segment: {'id': 'dc772362-7c7f-473d-bb4b-7b6705959a15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:28:44.491730 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] Bound port: 4417739f-7bef-4bd0-b1eb-dab883253f64, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'dc772362-7c7f-473d-bb4b-7b6705959a15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:28:44.491730 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:44.535959 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:44.536613 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:44.543082 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] 10.222.0.10 "PUT /v2.0/ports/145a0cde-0fe5-4163-a063-0fdfe42f243b HTTP/1.1" status: 200 len: 1131 time: 1.5088708 Dec 09 21:28:44.557987 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-9082e98c-9b6a-4ae6-b9d9-905f2b778cdb service neutron] 10.222.0.13 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1960082 Dec 09 21:28:44.619947 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-08559384-eca7-4a53-9280-f04e6b9e806b service neutron] Request body: {'port': {'device_id': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:44.715514 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] For port 4417739f-7bef-4bd0-b1eb-dab883253f64, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:28:44.717742 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device fd5eccfa-9fff-46bc-a3bd-73a647cd826e no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:28:44.724481 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] For port 4417739f-7bef-4bd0-b1eb-dab883253f64, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=4417739f-7bef-4bd0-b1eb-dab883253f64,segment=NetworkSegment(dc772362-7c7f-473d-bb4b-7b6705959a15),segment_id=dc772362-7c7f-473d-bb4b-7b6705959a15)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:28:44.734216 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:44.777536 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: fd5eccfa-9fff-46bc-a3bd-73a647cd826e {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:28:44.778026 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device fd5eccfa-9fff-46bc-a3bd-73a647cd826e not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:28:44.789598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3636c68-5fdd-41e9-b2b0-99cd0e8c9e05 service neutron] Pushing event updated for resources: {'Port': ['ID=145a0cde-0fe5-4163-a063-0fdfe42f243b,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:44.836508 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6bce670e-e1c9-428f-8eac-f34bc721da79 None None] Provisioning complete for port 4417739f-7bef-4bd0-b1eb-dab883253f64 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:44.837225 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6bce670e-e1c9-428f-8eac-f34bc721da79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:44.877081 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] Routers {'eeac8998-5e81-4874-bc7a-2829c8a216f7'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:28:44.877734 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:28:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['eeac8998-5e81-4874-bc7a-2829c8a216f7'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:28:44.979087 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-08559384-eca7-4a53-9280-f04e6b9e806b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:45.017168 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] Set router eeac8998-5e81-4874-bc7a-2829c8a216f7 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:28:45.022838 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6bce670e-e1c9-428f-8eac-f34bc721da79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:45.099218 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6bce670e-e1c9-428f-8eac-f34bc721da79 None None] For port 4417739f-7bef-4bd0-b1eb-dab883253f64, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=4417739f-7bef-4bd0-b1eb-dab883253f64,segment=NetworkSegment(dc772362-7c7f-473d-bb4b-7b6705959a15),segment_id=dc772362-7c7f-473d-bb4b-7b6705959a15)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:45.110051 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6bce670e-e1c9-428f-8eac-f34bc721da79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:45.166907 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16d6e99d-1604-460b-ab1b-b20477cdfb3f None None] Pushing event updated for resources: {'Port': ['ID=4417739f-7bef-4bd0-b1eb-dab883253f64,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:45.209945 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9322f796-92cc-40a6-b5c4-c86e5e69a737 req-0df7fe09-e569-46b7-86c7-3485ba90aa8d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:45.218198 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9322f796-92cc-40a6-b5c4-c86e5e69a737 req-0df7fe09-e569-46b7-86c7-3485ba90aa8d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 944 time: 0.5594761 Dec 09 21:28:45.267372 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-a1f881a9-11f7-4130-a043-b2dc8e24c829 service neutron] 10.222.0.13 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6930211 Dec 09 21:28:45.273716 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bce670e-e1c9-428f-8eac-f34bc721da79 None None] Pushing event updated for resources: {'Port': ['ID=4417739f-7bef-4bd0-b1eb-dab883253f64,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:45.278540 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-65ac77a4-9e0f-42d7-8a4c-15e34d9cf5a3 None None] Provisioning complete for port 4417739f-7bef-4bd0-b1eb-dab883253f64 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:45.287351 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-65ac77a4-9e0f-42d7-8a4c-15e34d9cf5a3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:45.492810 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'name': 'tempest-ServersTestBootFromVolume-1721587557-router', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163'}], 'enable_snat': True}, 'gw_port_id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:31Z', 'updated_at': '2021-12-09T21:28:40Z', 'revision_number': 4, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'gw_port': {'id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:5c:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1213, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:32Z', 'updated_at': '2021-12-09T21:28:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '4417739f-7bef-4bd0-b1eb-dab883253f64', 'name': '', 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'mac_address': 'fa:16:3e:a3:e6:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1221, 'fixed_ips': [{'subnet_id': '93335bf9-6f1e-4484-ae25-dca4b03b29b4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:37Z', 'updated_at': '2021-12-09T21:28:44Z', 'revision_number': 4, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'subnets': [{'id': '93335bf9-6f1e-4484-ae25-dca4b03b29b4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:28:45.527095 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7803d8bc-50d7-4e3e-84af-272cb4b6e2fd None None] The sync data for ids ['eeac8998-5e81-4874-bc7a-2829c8a216f7'] in n-d-713301-27 is: [{'id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'name': 'tempest-ServersTestBootFromVolume-1721587557-router', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163'}], 'enable_snat': True}, 'gw_port_id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:31Z', 'updated_at': '2021-12-09T21:28:40Z', 'revision_number': 4, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'gw_port': {'id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:5c:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1213, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:32Z', 'updated_at': '2021-12-09T21:28:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '4417739f-7bef-4bd0-b1eb-dab883253f64', 'name': '', 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'mac_address': 'fa:16:3e:a3:e6:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1221, 'fixed_ips': [{'subnet_id': '93335bf9-6f1e-4484-ae25-dca4b03b29b4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:37Z', 'updated_at': '2021-12-09T21:28:44Z', 'revision_number': 4, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'subnets': [{'id': '93335bf9-6f1e-4484-ae25-dca4b03b29b4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:28:45.659916 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 778d35d4-c635-4fcb-b344-64cbb94958b9 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:28:45.669087 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-9af2f9f7-e744-4685-93bf-135827db282c service neutron] 10.222.0.13 "GET /v2.0/ports/1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f?fields=binding%3Avnic_type&fields=binding%3Aprofile&fields=network_id&fields=resource_request&fields=numa_affinity_policy&fields=device_profile HTTP/1.1" status: 200 len: 311 time: 0.3888733 Dec 09 21:28:45.703133 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9322f796-92cc-40a6-b5c4-c86e5e69a737 req-0363f2a0-1a3c-418b-98c7-b7cf3bc09583 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4824138 Dec 09 21:28:45.803385 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 778d35d4-c635-4fcb-b344-64cbb94958b9, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=778d35d4-c635-4fcb-b344-64cbb94958b9,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:45.825330 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '778d35d4-c635-4fcb-b344-64cbb94958b9', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'port_id': '778d35d4-c635-4fcb-b344-64cbb94958b9', 'mac_address': 'fa:16:3e:aa:9b:e5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:28:45.886596 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-08559384-eca7-4a53-9280-f04e6b9e806b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7b66d328-f18c-4d26-af51-99c1b1f1f05e {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:28:45.887856 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:45.901599 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-08559384-eca7-4a53-9280-f04e6b9e806b service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:45.903539 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'tag': '1e946a47-f496-445b-964b-618881eab263'}, {'name': 'network-changed', 'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'tag': '145a0cde-0fe5-4163-a063-0fdfe42f243b'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:45.906148 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c8dee638-e85f-4e76-afb0-d906c4607c14" -d '{"events": [{"name": "network-changed", "server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "tag": "1e946a47-f496-445b-964b-618881eab263"}, {"name": "network-changed", "server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "tag": "145a0cde-0fe5-4163-a063-0fdfe42f243b"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:45.918229 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-79cb667b-ed17-4f95-a29b-bdf6b8daed1c service neutron] 10.222.0.13 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2400978 Dec 09 21:28:45.923048 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-08559384-eca7-4a53-9280-f04e6b9e806b service neutron] Transition to ACTIVE for port object 7b66d328-f18c-4d26-af51-99c1b1f1f05e will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:28:45.932346 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 778d35d4-c635-4fcb-b344-64cbb94958b9 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:28:45.946691 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-08559384-eca7-4a53-9280-f04e6b9e806b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:45.983905 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 778d35d4-c635-4fcb-b344-64cbb94958b9, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=778d35d4-c635-4fcb-b344-64cbb94958b9,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:45.990751 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:46.055235 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=778d35d4-c635-4fcb-b344-64cbb94958b9,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:46.090625 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08559384-eca7-4a53-9280-f04e6b9e806b service neutron] Pushing event updated for resources: {'Port': ['ID=7b66d328-f18c-4d26-af51-99c1b1f1f05e,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:46.205757 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-bfc0fd39-2834-4623-b30c-e1c2b2b7ab77 service neutron] 10.222.0.13 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2792349 Dec 09 21:28:46.212668 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['778d35d4-c635-4fcb-b344-64cbb94958b9'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:28:46.325780 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41934) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:46.332213 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-d8c24316-4689-4b91-96a9-6fb2a472da08 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1087225393', 'description': 'tempest-description--1602241405'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:46.385272 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d8c24316-4689-4b91-96a9-6fb2a472da08 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:46.406285 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e2c2d850-1a6a-4c66-b606-4f6623f2d3f4 x-openstack-request-id: req-e2c2d850-1a6a-4c66-b606-4f6623f2d3f4 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:46.406567 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "753dc06f-e08a-4cab-82a9-7e1089901f9b", "tag": "778d35d4-c635-4fcb-b344-64cbb94958b9", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:46.407135 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e2c2d850-1a6a-4c66-b606-4f6623f2d3f4 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:46.408294 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '753dc06f-e08a-4cab-82a9-7e1089901f9b', 'tag': '778d35d4-c635-4fcb-b344-64cbb94958b9', 'status': 'completed', 'code': 200} Dec 09 21:28:46.444002 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-08559384-eca7-4a53-9280-f04e6b9e806b service neutron] Attempting to bind port 7b66d328-f18c-4d26-af51-99c1b1f1f05e on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:28:46.444002 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-08559384-eca7-4a53-9280-f04e6b9e806b service neutron] Attempting to bind port 7b66d328-f18c-4d26-af51-99c1b1f1f05e by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '669c24e6-ecea-4894-adc4-51a9b461417f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:28:46.445094 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-08559384-eca7-4a53-9280-f04e6b9e806b service neutron] Attempting to bind port 7b66d328-f18c-4d26-af51-99c1b1f1f05e on network a859e4ba-764a-41c0-982d-5bf79a2797a1 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:46.465753 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-08559384-eca7-4a53-9280-f04e6b9e806b service neutron] Port 7b66d328-f18c-4d26-af51-99c1b1f1f05e on network a859e4ba-764a-41c0-982d-5bf79a2797a1 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:28:46.466088 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-08559384-eca7-4a53-9280-f04e6b9e806b service neutron] Attempting to bind port 7b66d328-f18c-4d26-af51-99c1b1f1f05e on network a859e4ba-764a-41c0-982d-5bf79a2797a1 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:46.489994 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-08559384-eca7-4a53-9280-f04e6b9e806b service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:28:46.490239 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-08559384-eca7-4a53-9280-f04e6b9e806b service neutron] Checking segment: {'id': '669c24e6-ecea-4894-adc4-51a9b461417f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:46.490628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-08559384-eca7-4a53-9280-f04e6b9e806b service neutron] Bound using segment: {'id': '669c24e6-ecea-4894-adc4-51a9b461417f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:28:46.491074 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-08559384-eca7-4a53-9280-f04e6b9e806b service neutron] Bound port: 7b66d328-f18c-4d26-af51-99c1b1f1f05e, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '669c24e6-ecea-4894-adc4-51a9b461417f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:28:46.491464 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-08559384-eca7-4a53-9280-f04e6b9e806b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:46.558122 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfc8eb45-989c-4b4e-bada-ecf378ca6fe1 req-62b1bf86-354d-4f9e-bbb9-14d06d8a072f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:46.559870 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dfc8eb45-989c-4b4e-bada-ecf378ca6fe1 req-62b1bf86-354d-4f9e-bbb9-14d06d8a072f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=29f2c1d9be9348b0888bc61ed37ed957&device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 1097 time: 0.1309288 Dec 09 21:28:46.573061 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-4b038a2f-15dc-4f03-a6c1-9e1f4b95e41e service neutron] 10.222.0.13 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3465731 Dec 09 21:28:46.608001 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d8c24316-4689-4b91-96a9-6fb2a472da08 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:46.619405 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d8c24316-4689-4b91-96a9-6fb2a472da08 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:46.635923 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-08559384-eca7-4a53-9280-f04e6b9e806b service neutron] For port 7b66d328-f18c-4d26-af51-99c1b1f1f05e, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:28:46.639525 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-08559384-eca7-4a53-9280-f04e6b9e806b service neutron] For port 7b66d328-f18c-4d26-af51-99c1b1f1f05e, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=7b66d328-f18c-4d26-af51-99c1b1f1f05e,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:28:46.669222 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-08559384-eca7-4a53-9280-f04e6b9e806b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:46.688525 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d8c24316-4689-4b91-96a9-6fb2a472da08 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:46.690738 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d8c24316-4689-4b91-96a9-6fb2a472da08 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1799 time: 0.3625326 Dec 09 21:28:46.699772 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41936) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:46.708389 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-f94dd2d2-6c44-406b-a98f-a9d519add57d tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Request body: {'security_group_rule': {'security_group_id': '02690a1b-c814-4a6b-a7d8-1252ee74106e', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:46.744453 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-08559384-eca7-4a53-9280-f04e6b9e806b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:46.745119 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-08559384-eca7-4a53-9280-f04e6b9e806b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:46.747045 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-08559384-eca7-4a53-9280-f04e6b9e806b service neutron] 10.222.0.10 "PUT /v2.0/ports/7b66d328-f18c-4d26-af51-99c1b1f1f05e HTTP/1.1" status: 200 len: 1092 time: 2.1470370 Dec 09 21:28:46.759213 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8c24316-4689-4b91-96a9-6fb2a472da08 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Pushing event updated for resources: {'SecurityGroup': ['ID=02690a1b-c814-4a6b-a7d8-1252ee74106e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:46.773991 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfc8eb45-989c-4b4e-bada-ecf378ca6fe1 req-fb6f1dd9-edc4-4f47-ae98-3fa777532f53 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:46.775744 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dfc8eb45-989c-4b4e-bada-ecf378ca6fe1 req-fb6f1dd9-edc4-4f47-ae98-3fa777532f53 service neutron] 10.222.0.31 "GET /v2.0/networks?id=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 HTTP/1.1" status: 200 len: 917 time: 0.1997631 Dec 09 21:28:46.793775 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f94dd2d2-6c44-406b-a98f-a9d519add57d tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:46.806966 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7d7d708a-87a8-43e6-90a0-5a60dd9154ef service neutron] Request body: {'port': {'device_id': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:46.845884 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db633ae3-75d3-48cd-abd6-41e0bc79182f req-2e32a174-5292-49ff-9315-640b23476885 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:46.855795 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db633ae3-75d3-48cd-abd6-41e0bc79182f req-2e32a174-5292-49ff-9315-640b23476885 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 945 time: 0.3358979 Dec 09 21:28:46.907468 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dfc8eb45-989c-4b4e-bada-ecf378ca6fe1 req-6ab09b2c-ed73-4b93-b5a5-7409031a550a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=778d35d4-c635-4fcb-b344-64cbb94958b9 HTTP/1.1" status: 200 len: 217 time: 0.1219411 Dec 09 21:28:46.925764 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08559384-eca7-4a53-9280-f04e6b9e806b service neutron] Pushing event updated for resources: {'Port': ['ID=7b66d328-f18c-4d26-af51-99c1b1f1f05e,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:47.001851 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f94dd2d2-6c44-406b-a98f-a9d519add57d tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:47.013097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfc8eb45-989c-4b4e-bada-ecf378ca6fe1 req-a86de480-5707-48f4-8437-88f19fdd183f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:47.015254 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dfc8eb45-989c-4b4e-bada-ecf378ca6fe1 req-a86de480-5707-48f4-8437-88f19fdd183f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ace82e8b-012a-4184-a81e-5303eecf12ff HTTP/1.1" status: 200 len: 855 time: 0.0953288 Dec 09 21:28:47.016542 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f94dd2d2-6c44-406b-a98f-a9d519add57d tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:47.049874 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-aa90baba-2a5e-4464-9280-b7f57eb27f2e service neutron] 10.222.0.13 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4060256 Dec 09 21:28:47.063906 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db633ae3-75d3-48cd-abd6-41e0bc79182f req-9c0fd526-d316-485c-b1eb-1d8355faafd2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2070153 Dec 09 21:28:47.077871 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7d7d708a-87a8-43e6-90a0-5a60dd9154ef service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:47.111537 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f94dd2d2-6c44-406b-a98f-a9d519add57d tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=55e00483-e80c-42e5-8089-fd4061cffedc,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:47.122045 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f94dd2d2-6c44-406b-a98f-a9d519add57d tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:47.127336 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f94dd2d2-6c44-406b-a98f-a9d519add57d tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4228911 Dec 09 21:28:47.130343 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41942) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:47.136693 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-8a228245-c5d9-414f-821b-a0299aab7a5b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Request body: {'security_group_rule': {'security_group_id': '02690a1b-c814-4a6b-a7d8-1252ee74106e', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:47.146077 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 4417739f-7bef-4bd0-b1eb-dab883253f64 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:28:47.196661 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfc8eb45-989c-4b4e-bada-ecf378ca6fe1 req-403ad4b4-e34a-4168-ba49-69e3fd8e0f37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:47.198693 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dfc8eb45-989c-4b4e-bada-ecf378ca6fe1 req-403ad4b4-e34a-4168-ba49-69e3fd8e0f37 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1721232 Dec 09 21:28:47.231875 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a228245-c5d9-414f-821b-a0299aab7a5b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:47.260793 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 4417739f-7bef-4bd0-b1eb-dab883253f64 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:47.263259 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:47.392045 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-fa5b7462-2f73-49ef-9392-be28268b8593 service neutron] 10.222.0.13 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3266456 Dec 09 21:28:47.476414 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dfc8eb45-989c-4b4e-bada-ecf378ca6fe1 req-4ec0a4e1-4404-4a93-85e7-486b818f30e2 service neutron] 10.222.0.31 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2639380 Dec 09 21:28:47.478098 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a228245-c5d9-414f-821b-a0299aab7a5b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:47.482870 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7616051b-5912-4589-b5c6-d8f7241a224e req-425fb0ef-f8ea-4699-b352-6b13b710b9d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:47.484539 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7616051b-5912-4589-b5c6-d8f7241a224e req-425fb0ef-f8ea-4699-b352-6b13b710b9d4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=9ca15fab17f34cc58f1ad1fcedc1bf31&device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 1097 time: 0.1072087 Dec 09 21:28:47.494926 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a228245-c5d9-414f-821b-a0299aab7a5b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:47.582828 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a228245-c5d9-414f-821b-a0299aab7a5b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f220d287-3d01-4e3e-a110-7f2ed69a1d5f,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:47.595137 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a228245-c5d9-414f-821b-a0299aab7a5b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:47.596441 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8a228245-c5d9-414f-821b-a0299aab7a5b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4633610 Dec 09 21:28:47.608144 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41948) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:47.615146 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-276e7c59-7a45-4704-ae8d-cdbdace7f63b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:47.621622 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-bd8478eb-91e4-4a82-933a-9b2d8fe0fdfc service neutron] 10.222.0.13 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2187071 Dec 09 21:28:47.640971 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eda8216e-5321-49d6-8570-1e8919879b09 req-5f38ece1-07d3-4765-b573-8c2b0d3c973a tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:47.647291 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eda8216e-5321-49d6-8570-1e8919879b09 req-5f38ece1-07d3-4765-b573-8c2b0d3c973a tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:47.653354 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eda8216e-5321-49d6-8570-1e8919879b09 req-5f38ece1-07d3-4765-b573-8c2b0d3c973a tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:47.659426 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eda8216e-5321-49d6-8570-1e8919879b09 req-5f38ece1-07d3-4765-b573-8c2b0d3c973a tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:47.659967 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 778d35d4-c635-4fcb-b344-64cbb94958b9 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:28:47.665598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eda8216e-5321-49d6-8570-1e8919879b09 req-5f38ece1-07d3-4765-b573-8c2b0d3c973a tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:47.671804 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eda8216e-5321-49d6-8570-1e8919879b09 req-5f38ece1-07d3-4765-b573-8c2b0d3c973a tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:47.677808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eda8216e-5321-49d6-8570-1e8919879b09 req-5f38ece1-07d3-4765-b573-8c2b0d3c973a tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:47.679826 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eda8216e-5321-49d6-8570-1e8919879b09 req-5f38ece1-07d3-4765-b573-8c2b0d3c973a tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5384 time: 0.2318759 Dec 09 21:28:47.711696 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 778d35d4-c635-4fcb-b344-64cbb94958b9 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:28:47.716714 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 778d35d4-c635-4fcb-b344-64cbb94958b9 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:47.716956 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:47.765412 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-276e7c59-7a45-4704-ae8d-cdbdace7f63b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:47.809429 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:47.835545 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '753dc06f-e08a-4cab-82a9-7e1089901f9b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '778d35d4-c635-4fcb-b344-64cbb94958b9'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:47.838225 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-744529c3-b1d1-43d2-9eae-4f7b6e25832a" -d '{"events": [{"server_uuid": "753dc06f-e08a-4cab-82a9-7e1089901f9b", "name": "network-vif-plugged", "status": "completed", "tag": "778d35d4-c635-4fcb-b344-64cbb94958b9"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:47.852710 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 778d35d4-c635-4fcb-b344-64cbb94958b9, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=778d35d4-c635-4fcb-b344-64cbb94958b9,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:47.857660 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:47.886766 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7d7d708a-87a8-43e6-90a0-5a60dd9154ef service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3bbd0bd0-666a-4f39-abae-59f44d88319c {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:28:47.909027 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7d7d708a-87a8-43e6-90a0-5a60dd9154ef service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:47.914953 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=778d35d4-c635-4fcb-b344-64cbb94958b9,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:47.945290 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eda8216e-5321-49d6-8570-1e8919879b09 req-a470e535-3cbf-41ff-b5d8-a138b75a1b61 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2452040 Dec 09 21:28:47.954171 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-3c747df5-1970-47d1-8f3b-7a8c904f636a service neutron] 10.222.0.13 "GET /v2.0/networks/ae9d25d5-c9a2-4627-a465-8324b17541d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2698100 Dec 09 21:28:47.955127 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7d7d708a-87a8-43e6-90a0-5a60dd9154ef service neutron] Transition to ACTIVE for port object 3bbd0bd0-666a-4f39-abae-59f44d88319c will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:28:47.980270 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dfc8eb45-989c-4b4e-bada-ecf378ca6fe1 req-b4ec0417-e424-4e13-81d3-5813a6bbc097 service neutron] 10.222.0.31 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4944670 Dec 09 21:28:47.985154 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7616051b-5912-4589-b5c6-d8f7241a224e req-f82e92a9-a061-4e47-abe3-eb053d67d56b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:47.986671 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7616051b-5912-4589-b5c6-d8f7241a224e req-f82e92a9-a061-4e47-abe3-eb053d67d56b service neutron] 10.222.0.31 "GET /v2.0/networks?id=e7d3d836-ebe9-4e03-af4b-235dd5e5cbea HTTP/1.1" status: 200 len: 912 time: 0.4891009 Dec 09 21:28:48.011065 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7d7d708a-87a8-43e6-90a0-5a60dd9154ef service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:48.042318 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7616051b-5912-4589-b5c6-d8f7241a224e req-d99b137c-208b-436f-a006-1eaa3420521d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=5fd1ab85-a36a-49d7-924f-21a52601dc1e HTTP/1.1" status: 200 len: 217 time: 0.0447507 Dec 09 21:28:48.091578 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7616051b-5912-4589-b5c6-d8f7241a224e req-f86f342c-e9d4-40bc-a691-844d27123f73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:48.094994 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7616051b-5912-4589-b5c6-d8f7241a224e req-f86f342c-e9d4-40bc-a691-844d27123f73 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a84d1123-6651-4f35-9cba-4f9c8f45aab6 HTTP/1.1" status: 200 len: 851 time: 0.0451686 Dec 09 21:28:48.134480 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7616051b-5912-4589-b5c6-d8f7241a224e req-8d51c438-d112-4857-aa53-1ad3a0e3006c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e7d3d836-ebe9-4e03-af4b-235dd5e5cbea&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0319297 Dec 09 21:28:48.136129 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f30c8938-a497-4d15-b4bf-0092278e2c52 req-d61848d0-deaa-4f95-b2a0-c6970be27f63 tempest-FlavorsV2NegativeTest-1062244901 tempest-FlavorsV2NegativeTest-1062244901-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=ccf359e6bed94d3393733460d23ecddd&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0959513 Dec 09 21:28:48.205189 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d7d708a-87a8-43e6-90a0-5a60dd9154ef service neutron] Pushing event updated for resources: {'Port': ['ID=3bbd0bd0-666a-4f39-abae-59f44d88319c,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:48.241745 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7616051b-5912-4589-b5c6-d8f7241a224e req-22f547b0-bbfc-41b3-95a6-c85692280a84 service neutron] 10.222.0.31 "GET /v2.0/networks/e7d3d836-ebe9-4e03-af4b-235dd5e5cbea?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0989089 Dec 09 21:28:48.281043 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-81bd25c9-e8ab-4bb4-a0c1-5282617e1573 service neutron] 10.222.0.13 "GET /v2.0/networks/ae9d25d5-c9a2-4627-a465-8324b17541d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2797742 Dec 09 21:28:48.326837 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-276e7c59-7a45-4704-ae8d-cdbdace7f63b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:48.338904 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7616051b-5912-4589-b5c6-d8f7241a224e req-44be9426-49ce-46b4-90d3-d714072e212d service neutron] 10.222.0.31 "GET /v2.0/networks/e7d3d836-ebe9-4e03-af4b-235dd5e5cbea?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0891881 Dec 09 21:28:48.461209 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7d7d708a-87a8-43e6-90a0-5a60dd9154ef service neutron] Attempting to bind port 3bbd0bd0-666a-4f39-abae-59f44d88319c on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:28:48.461544 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7d7d708a-87a8-43e6-90a0-5a60dd9154ef service neutron] Attempting to bind port 3bbd0bd0-666a-4f39-abae-59f44d88319c by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '669c24e6-ecea-4894-adc4-51a9b461417f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:28:48.461864 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7d7d708a-87a8-43e6-90a0-5a60dd9154ef service neutron] Attempting to bind port 3bbd0bd0-666a-4f39-abae-59f44d88319c on network a859e4ba-764a-41c0-982d-5bf79a2797a1 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:48.480581 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7d7d708a-87a8-43e6-90a0-5a60dd9154ef service neutron] Port 3bbd0bd0-666a-4f39-abae-59f44d88319c on network a859e4ba-764a-41c0-982d-5bf79a2797a1 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:28:48.480762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7d7d708a-87a8-43e6-90a0-5a60dd9154ef service neutron] Attempting to bind port 3bbd0bd0-666a-4f39-abae-59f44d88319c on network a859e4ba-764a-41c0-982d-5bf79a2797a1 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:48.492297 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f30c8938-a497-4d15-b4bf-0092278e2c52 req-0177b756-cca0-47cb-81a4-7d0135e64ed7 tempest-FlavorsV2NegativeTest-1062244901 tempest-FlavorsV2NegativeTest-1062244901-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:48.493752 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f30c8938-a497-4d15-b4bf-0092278e2c52 req-0177b756-cca0-47cb-81a4-7d0135e64ed7 tempest-FlavorsV2NegativeTest-1062244901 tempest-FlavorsV2NegativeTest-1062244901-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3427842 Dec 09 21:28:48.527907 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7d7d708a-87a8-43e6-90a0-5a60dd9154ef service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:28:48.528250 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7d7d708a-87a8-43e6-90a0-5a60dd9154ef service neutron] Checking segment: {'id': '669c24e6-ecea-4894-adc4-51a9b461417f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:48.528627 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7d7d708a-87a8-43e6-90a0-5a60dd9154ef service neutron] Bound using segment: {'id': '669c24e6-ecea-4894-adc4-51a9b461417f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:28:48.529112 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7d7d708a-87a8-43e6-90a0-5a60dd9154ef service neutron] Bound port: 3bbd0bd0-666a-4f39-abae-59f44d88319c, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '669c24e6-ecea-4894-adc4-51a9b461417f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:28:48.529470 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7d7d708a-87a8-43e6-90a0-5a60dd9154ef service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:48.561426 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f30c8938-a497-4d15-b4bf-0092278e2c52 req-7a591026-1866-428b-b07d-fa286a5606a0 tempest-FlavorsV2NegativeTest-1062244901 tempest-FlavorsV2NegativeTest-1062244901-project] 10.222.0.13 "GET /v2.0/quotas/ccf359e6bed94d3393733460d23ecddd HTTP/1.1" status: 200 len: 375 time: 0.0590765 Dec 09 21:28:48.566561 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-e6325aa7-9d93-474b-ab6f-79e3c22d091f service neutron] 10.222.0.13 "GET /v2.0/networks/ae9d25d5-c9a2-4627-a465-8324b17541d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2524173 Dec 09 21:28:48.924196 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-276e7c59-7a45-4704-ae8d-cdbdace7f63b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Allocated IP 172.25.3.35 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/4b5f65e7-70fc-4047-a3ff-bc617dae38a0) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:48.927755 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f30c8938-a497-4d15-b4bf-0092278e2c52 req-aac4ba03-c6d2-4884-a0fd-2800fb416f74 tempest-FlavorsV2NegativeTest-1062244901 tempest-FlavorsV2NegativeTest-1062244901-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=ccf359e6bed94d3393733460d23ecddd&fields=id HTTP/1.1" status: 200 len: 210 time: 0.3602970 Dec 09 21:28:49.003030 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 346 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-022809a4-5ed2-4a11-babc-f4dadc236326 x-openstack-request-id: req-022809a4-5ed2-4a11-babc-f4dadc236326 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:49.003634 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "tag": "1e946a47-f496-445b-964b-618881eab263", "status": "completed", "code": 200}, {"name": "network-changed", "server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "tag": "145a0cde-0fe5-4163-a063-0fdfe42f243b", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:49.003634 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-022809a4-5ed2-4a11-babc-f4dadc236326 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:49.004010 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'tag': '1e946a47-f496-445b-964b-618881eab263', 'status': 'completed', 'code': 200} Dec 09 21:28:49.004259 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'tag': '145a0cde-0fe5-4163-a063-0fdfe42f243b', 'status': 'completed', 'code': 200} Dec 09 21:28:49.039850 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7d7d708a-87a8-43e6-90a0-5a60dd9154ef service neutron] For port 3bbd0bd0-666a-4f39-abae-59f44d88319c, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:28:49.129415 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7d7d708a-87a8-43e6-90a0-5a60dd9154ef service neutron] For port 3bbd0bd0-666a-4f39-abae-59f44d88319c, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3bbd0bd0-666a-4f39-abae-59f44d88319c,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:28:49.147803 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7d7d708a-87a8-43e6-90a0-5a60dd9154ef service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:49.217132 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-c9e5755f-66ae-4e89-83a4-e1163ed35230 service neutron] 10.222.0.13 "GET /v2.0/networks/ae9d25d5-c9a2-4627-a465-8324b17541d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6363788 Dec 09 21:28:49.234433 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7d7d708a-87a8-43e6-90a0-5a60dd9154ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:49.235177 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7d7d708a-87a8-43e6-90a0-5a60dd9154ef service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:49.236765 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7d7d708a-87a8-43e6-90a0-5a60dd9154ef service neutron] 10.222.0.10 "PUT /v2.0/ports/3bbd0bd0-666a-4f39-abae-59f44d88319c HTTP/1.1" status: 200 len: 1092 time: 2.4341838 Dec 09 21:28:49.249945 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-08298e75-39fc-4afc-8063-7fb1cd2c935c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:49.250766 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-08298e75-39fc-4afc-8063-7fb1cd2c935c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:49.251240 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-08298e75-39fc-4afc-8063-7fb1cd2c935c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:49.251749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-08298e75-39fc-4afc-8063-7fb1cd2c935c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:49.252213 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-08298e75-39fc-4afc-8063-7fb1cd2c935c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:49.252671 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-08298e75-39fc-4afc-8063-7fb1cd2c935c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:49.253126 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-08298e75-39fc-4afc-8063-7fb1cd2c935c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:49.255148 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-08298e75-39fc-4afc-8063-7fb1cd2c935c service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=03e962eb7f5e4325a7c08c8b1e2a4cea&device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 6306 time: 0.2466042 Dec 09 21:28:49.269941 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c4e6fe7-9b88-448e-91fe-dc50d3c534a3 req-b2688455-088e-4672-b30e-f39497208711 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:49.272046 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c4e6fe7-9b88-448e-91fe-dc50d3c534a3 req-b2688455-088e-4672-b30e-f39497208711 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.2380028 Dec 09 21:28:49.302771 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-276e7c59-7a45-4704-ae8d-cdbdace7f63b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:49.313823 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e42f5600-f5e2-44d1-be49-be5be4116612 service neutron] Request body: {'port': {'device_id': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:49.339619 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d7d708a-87a8-43e6-90a0-5a60dd9154ef service neutron] Pushing event updated for resources: {'Port': ['ID=3bbd0bd0-666a-4f39-abae-59f44d88319c,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:49.521779 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e42f5600-f5e2-44d1-be49-be5be4116612 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:49.524546 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41994) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:49.533744 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c4e6fe7-9b88-448e-91fe-dc50d3c534a3 req-d2c76ac6-83d2-4b96-be00-52c7b715b558 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2463377 Dec 09 21:28:49.551265 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-276e7c59-7a45-4704-ae8d-cdbdace7f63b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:49.562167 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-c0b6294e-5c46-40e8-a98b-985d6adbeceb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:49.562167 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-c0b6294e-5c46-40e8-a98b-985d6adbeceb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:49.562167 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-c0b6294e-5c46-40e8-a98b-985d6adbeceb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:49.562167 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-c0b6294e-5c46-40e8-a98b-985d6adbeceb service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=03e962eb7f5e4325a7c08c8b1e2a4cea&shared=False HTTP/1.1" status: 200 len: 2293 time: 0.2774622 Dec 09 21:28:49.653229 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-276e7c59-7a45-4704-ae8d-cdbdace7f63b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:49.672123 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-276e7c59-7a45-4704-ae8d-cdbdace7f63b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:49.686289 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15376462-8535-49cc-a904-5584686293eb admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:49.695776 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-276e7c59-7a45-4704-ae8d-cdbdace7f63b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Pushing event updated for resources: {'Port': ['ID=4b5f65e7-70fc-4047-a3ff-bc617dae38a0,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:49.702219 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-276e7c59-7a45-4704-ae8d-cdbdace7f63b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:49.783721 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15376462-8535-49cc-a904-5584686293eb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:49.788980 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15376462-8535-49cc-a904-5584686293eb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:49.839793 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-15376462-8535-49cc-a904-5584686293eb admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ccf359e6bed94d3393733460d23ecddd&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3138597 Dec 09 21:28:49.840364 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42006) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:49.862710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15376462-8535-49cc-a904-5584686293eb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7abc4524-6028-4a7e-8a24-1fb570275410,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:49.908259 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19d0c13c-bae5-4e35-9f78-3acca4bbfce7 req-edbe9d08-3970-4ef2-b4fd-85d21f771cd0 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:49.915424 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19d0c13c-bae5-4e35-9f78-3acca4bbfce7 req-edbe9d08-3970-4ef2-b4fd-85d21f771cd0 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 945 time: 0.2746556 Dec 09 21:28:49.929533 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-c59ad67a-30d9-40e1-ba8a-1d9e470fe902 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:49.931007 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-c59ad67a-30d9-40e1-ba8a-1d9e470fe902 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3447115 Dec 09 21:28:49.940056 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e7e54b3f-8327-4c06-b77e-b25152733a6e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:49.970382 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e7e54b3f-8327-4c06-b77e-b25152733a6e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:50.038700 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e7e54b3f-8327-4c06-b77e-b25152733a6e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:50.041723 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e7e54b3f-8327-4c06-b77e-b25152733a6e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:50.046066 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e7e54b3f-8327-4c06-b77e-b25152733a6e admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/7abc4524-6028-4a7e-8a24-1fb570275410 HTTP/1.1" status: 204 len: 168 time: 0.2006993 Dec 09 21:28:50.057096 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7e54b3f-8327-4c06-b77e-b25152733a6e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7abc4524-6028-4a7e-8a24-1fb570275410,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:50.067700 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e54b3f-8327-4c06-b77e-b25152733a6e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:50.068054 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e54b3f-8327-4c06-b77e-b25152733a6e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:50.068399 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e54b3f-8327-4c06-b77e-b25152733a6e admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:50.068738 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e54b3f-8327-4c06-b77e-b25152733a6e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:50.069071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e54b3f-8327-4c06-b77e-b25152733a6e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:50.069700 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e54b3f-8327-4c06-b77e-b25152733a6e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:50.069700 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e54b3f-8327-4c06-b77e-b25152733a6e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:50.070181 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e54b3f-8327-4c06-b77e-b25152733a6e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:50.070694 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e54b3f-8327-4c06-b77e-b25152733a6e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:50.071537 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e54b3f-8327-4c06-b77e-b25152733a6e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:50.071879 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e54b3f-8327-4c06-b77e-b25152733a6e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:50.072516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e54b3f-8327-4c06-b77e-b25152733a6e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:50.072516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e7e54b3f-8327-4c06-b77e-b25152733a6e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:28:50.126309 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-276e7c59-7a45-4704-ae8d-cdbdace7f63b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:50.146570 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19d0c13c-bae5-4e35-9f78-3acca4bbfce7 req-66c5fb34-1c82-4e15-8eed-b202f8544290 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2302060 Dec 09 21:28:50.199728 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-42c1319e-d58b-4cda-bb17-90413349f7aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:50.200209 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-42c1319e-d58b-4cda-bb17-90413349f7aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:50.200677 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-42c1319e-d58b-4cda-bb17-90413349f7aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:50.201455 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-42c1319e-d58b-4cda-bb17-90413349f7aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:50.202004 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-42c1319e-d58b-4cda-bb17-90413349f7aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:50.202462 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-42c1319e-d58b-4cda-bb17-90413349f7aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:50.202909 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-42c1319e-d58b-4cda-bb17-90413349f7aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:50.204961 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-42c1319e-d58b-4cda-bb17-90413349f7aa service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=03e962eb7f5e4325a7c08c8b1e2a4cea&device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 6348 time: 0.2136936 Dec 09 21:28:50.225104 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1ba4389-c372-4630-bc3f-b1fc7a5a38f0 req-a4f0976e-e775-4ecf-8617-a860ea0cd800 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:50.233162 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e1ba4389-c372-4630-bc3f-b1fc7a5a38f0 req-a4f0976e-e775-4ecf-8617-a860ea0cd800 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 945 time: 0.1814208 Dec 09 21:28:50.267394 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7692419e-5e64-449a-9f14-4ca31bfe67aa x-openstack-request-id: req-7692419e-5e64-449a-9f14-4ca31bfe67aa {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:50.267870 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "753dc06f-e08a-4cab-82a9-7e1089901f9b", "name": "network-vif-plugged", "status": "completed", "tag": "778d35d4-c635-4fcb-b344-64cbb94958b9", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:50.268255 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-7692419e-5e64-449a-9f14-4ca31bfe67aa {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:50.268790 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '753dc06f-e08a-4cab-82a9-7e1089901f9b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '778d35d4-c635-4fcb-b344-64cbb94958b9', 'code': 200} Dec 09 21:28:50.270965 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-276e7c59-7a45-4704-ae8d-cdbdace7f63b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:50.397317 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bc41b04-83b0-4490-ba49-15f8f7b5d422 req-b4316348-c1a4-43bd-8293-a653ca128722 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:50.400640 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6bc41b04-83b0-4490-ba49-15f8f7b5d422 req-b4316348-c1a4-43bd-8293-a653ca128722 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 1098 time: 0.0675893 Dec 09 21:28:50.460110 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6bc41b04-83b0-4490-ba49-15f8f7b5d422 req-ffbeccad-f8a2-4955-8a2e-92d6fd64180a service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0512459 Dec 09 21:28:50.478503 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e1ba4389-c372-4630-bc3f-b1fc7a5a38f0 req-fee92bfd-c9a5-419f-bf7e-0546668fc550 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2442608 Dec 09 21:28:50.518437 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e42f5600-f5e2-44d1-be49-be5be4116612 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d0dcf098-4522-4347-b733-bbc98e48d7e0 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:28:50.550061 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e42f5600-f5e2-44d1-be49-be5be4116612 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:50.600948 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-70e44c53-7140-43e0-b89e-21edde08340b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:50.601424 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-70e44c53-7140-43e0-b89e-21edde08340b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:50.601886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-70e44c53-7140-43e0-b89e-21edde08340b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:50.603505 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-70e44c53-7140-43e0-b89e-21edde08340b service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=03e962eb7f5e4325a7c08c8b1e2a4cea&shared=False HTTP/1.1" status: 200 len: 2293 time: 0.3872359 Dec 09 21:28:50.637330 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fb30a9ec-666e-450a-9b47-f5f0abde0d96 req-0992a961-6766-4a5b-95b4-9ad12fb9da4d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 210 time: 0.0937440 Dec 09 21:28:50.638278 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e42f5600-f5e2-44d1-be49-be5be4116612 service neutron] Transition to ACTIVE for port object d0dcf098-4522-4347-b733-bbc98e48d7e0 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:28:50.664040 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a4499d-24aa-4cbd-bac1-2511e7438e9f req-9e3bf66d-1792-474d-b249-559d89fc2a79 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:50.671824 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a4499d-24aa-4cbd-bac1-2511e7438e9f req-9e3bf66d-1792-474d-b249-559d89fc2a79 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:50.678001 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a4499d-24aa-4cbd-bac1-2511e7438e9f req-9e3bf66d-1792-474d-b249-559d89fc2a79 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:50.684922 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a4499d-24aa-4cbd-bac1-2511e7438e9f req-9e3bf66d-1792-474d-b249-559d89fc2a79 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:50.691309 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a4499d-24aa-4cbd-bac1-2511e7438e9f req-9e3bf66d-1792-474d-b249-559d89fc2a79 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:50.697783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a4499d-24aa-4cbd-bac1-2511e7438e9f req-9e3bf66d-1792-474d-b249-559d89fc2a79 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:50.704096 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a4499d-24aa-4cbd-bac1-2511e7438e9f req-9e3bf66d-1792-474d-b249-559d89fc2a79 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:50.706298 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99a4499d-24aa-4cbd-bac1-2511e7438e9f req-9e3bf66d-1792-474d-b249-559d89fc2a79 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5396 time: 0.3074286 Dec 09 21:28:50.718099 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e42f5600-f5e2-44d1-be49-be5be4116612 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:50.887230 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e42f5600-f5e2-44d1-be49-be5be4116612 service neutron] Pushing event updated for resources: {'Port': ['ID=d0dcf098-4522-4347-b733-bbc98e48d7e0,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:50.965290 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-276e7c59-7a45-4704-ae8d-cdbdace7f63b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:51.009144 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'tag': '7b66d328-f18c-4d26-af51-99c1b1f1f05e'}, {'name': 'network-changed', 'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'tag': '3bbd0bd0-666a-4f39-abae-59f44d88319c'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:51.011447 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0e293aca-d945-4814-8479-42c5d8615acd" -d '{"events": [{"name": "network-changed", "server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "tag": "7b66d328-f18c-4d26-af51-99c1b1f1f05e"}, {"name": "network-changed", "server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "tag": "3bbd0bd0-666a-4f39-abae-59f44d88319c"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:51.014377 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-276e7c59-7a45-4704-ae8d-cdbdace7f63b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:51.089746 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-c1b5a684-1288-4786-a4bf-61a75ea76666 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.091287 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c8dee638-e85f-4e76-afb0-d906c4607c14 req-c1b5a684-1288-4786-a4bf-61a75ea76666 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4611595 Dec 09 21:28:51.126390 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99a4499d-24aa-4cbd-bac1-2511e7438e9f req-66b13560-1f4d-450c-93f7-e12f366b3e8c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.4008415 Dec 09 21:28:51.135657 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-276e7c59-7a45-4704-ae8d-cdbdace7f63b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Pushing event updated for resources: {'Port': ['ID=4b5f65e7-70fc-4047-a3ff-bc617dae38a0,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:51.200413 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e42f5600-f5e2-44d1-be49-be5be4116612 service neutron] Attempting to bind port d0dcf098-4522-4347-b733-bbc98e48d7e0 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:28:51.200854 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e42f5600-f5e2-44d1-be49-be5be4116612 service neutron] Attempting to bind port d0dcf098-4522-4347-b733-bbc98e48d7e0 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '8ca86951-e612-4db0-90f4-834b52fd24e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'a133a939-2827-4fe6-81f5-14715631c0ec'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:28:51.201277 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e42f5600-f5e2-44d1-be49-be5be4116612 service neutron] Attempting to bind port d0dcf098-4522-4347-b733-bbc98e48d7e0 on network a133a939-2827-4fe6-81f5-14715631c0ec {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:51.224945 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e42f5600-f5e2-44d1-be49-be5be4116612 service neutron] Port d0dcf098-4522-4347-b733-bbc98e48d7e0 on network a133a939-2827-4fe6-81f5-14715631c0ec not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:28:51.225137 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e42f5600-f5e2-44d1-be49-be5be4116612 service neutron] Attempting to bind port d0dcf098-4522-4347-b733-bbc98e48d7e0 on network a133a939-2827-4fe6-81f5-14715631c0ec {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:51.279336 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e42f5600-f5e2-44d1-be49-be5be4116612 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:28:51.279788 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e42f5600-f5e2-44d1-be49-be5be4116612 service neutron] Checking segment: {'id': '8ca86951-e612-4db0-90f4-834b52fd24e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'a133a939-2827-4fe6-81f5-14715631c0ec'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:51.280357 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e42f5600-f5e2-44d1-be49-be5be4116612 service neutron] Bound using segment: {'id': '8ca86951-e612-4db0-90f4-834b52fd24e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'a133a939-2827-4fe6-81f5-14715631c0ec'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:28:51.280966 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e42f5600-f5e2-44d1-be49-be5be4116612 service neutron] Bound port: d0dcf098-4522-4347-b733-bbc98e48d7e0, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8ca86951-e612-4db0-90f4-834b52fd24e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'a133a939-2827-4fe6-81f5-14715631c0ec'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:28:51.281482 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e42f5600-f5e2-44d1-be49-be5be4116612 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:51.284913 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 346 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-caa277f3-b4ce-4789-a571-81f8ee46e7bf x-openstack-request-id: req-caa277f3-b4ce-4789-a571-81f8ee46e7bf {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:51.285333 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "tag": "7b66d328-f18c-4d26-af51-99c1b1f1f05e", "status": "completed", "code": 200}, {"name": "network-changed", "server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "tag": "3bbd0bd0-666a-4f39-abae-59f44d88319c", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:51.285836 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-caa277f3-b4ce-4789-a571-81f8ee46e7bf {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:51.286455 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'tag': '7b66d328-f18c-4d26-af51-99c1b1f1f05e', 'status': 'completed', 'code': 200} Dec 09 21:28:51.286717 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'tag': '3bbd0bd0-666a-4f39-abae-59f44d88319c', 'status': 'completed', 'code': 200} Dec 09 21:28:51.347832 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e293aca-d945-4814-8479-42c5d8615acd req-ddc904cc-db0b-4f73-98f4-b16be353967f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.349279 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e293aca-d945-4814-8479-42c5d8615acd req-ddc904cc-db0b-4f73-98f4-b16be353967f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.349959 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e293aca-d945-4814-8479-42c5d8615acd req-ddc904cc-db0b-4f73-98f4-b16be353967f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.350439 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e293aca-d945-4814-8479-42c5d8615acd req-ddc904cc-db0b-4f73-98f4-b16be353967f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.350903 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e293aca-d945-4814-8479-42c5d8615acd req-ddc904cc-db0b-4f73-98f4-b16be353967f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.351691 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e293aca-d945-4814-8479-42c5d8615acd req-ddc904cc-db0b-4f73-98f4-b16be353967f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.352683 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e293aca-d945-4814-8479-42c5d8615acd req-ddc904cc-db0b-4f73-98f4-b16be353967f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.354951 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0e293aca-d945-4814-8479-42c5d8615acd req-ddc904cc-db0b-4f73-98f4-b16be353967f service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=03e962eb7f5e4325a7c08c8b1e2a4cea&device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 6374 time: 0.0629141 Dec 09 21:28:51.476014 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e293aca-d945-4814-8479-42c5d8615acd req-2ed9fbf5-1b51-4790-9cc4-1cf342bec8c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.476504 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e293aca-d945-4814-8479-42c5d8615acd req-2ed9fbf5-1b51-4790-9cc4-1cf342bec8c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.476979 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e293aca-d945-4814-8479-42c5d8615acd req-2ed9fbf5-1b51-4790-9cc4-1cf342bec8c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.478875 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0e293aca-d945-4814-8479-42c5d8615acd req-2ed9fbf5-1b51-4790-9cc4-1cf342bec8c5 service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=03e962eb7f5e4325a7c08c8b1e2a4cea&shared=False HTTP/1.1" status: 200 len: 2293 time: 0.1158047 Dec 09 21:28:51.591674 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e293aca-d945-4814-8479-42c5d8615acd req-66a90ab8-17fa-41ca-9a5a-41c2025d6867 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.594527 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0e293aca-d945-4814-8479-42c5d8615acd req-66a90ab8-17fa-41ca-9a5a-41c2025d6867 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1087477 Dec 09 21:28:51.596483 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-276e7c59-7a45-4704-ae8d-cdbdace7f63b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:51.626055 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-bc496a64-8456-4a77-afb2-40a0d60ff410 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.627526 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-bc496a64-8456-4a77-afb2-40a0d60ff410 service neutron] 10.222.0.10 "GET /v2.0/ports/18d9d7fa-fedf-4844-90ef-6757eb984ae2 HTTP/1.1" status: 200 len: 1032 time: 0.4038785 Dec 09 21:28:51.676755 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-276e7c59-7a45-4704-ae8d-cdbdace7f63b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:51.678198 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-276e7c59-7a45-4704-ae8d-cdbdace7f63b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 4.0690851 Dec 09 21:28:51.691872 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1acb213f-4899-4b0e-adbf-d044b8116db1 req-18c571d3-7334-44f7-84f5-3b95c31e42c8 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.693456 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1acb213f-4899-4b0e-adbf-d044b8116db1 req-18c571d3-7334-44f7-84f5-3b95c31e42c8 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.4856133 Dec 09 21:28:51.722285 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e293aca-d945-4814-8479-42c5d8615acd req-8d487303-1f24-43f7-b6d2-395342cfe1ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.722285 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e293aca-d945-4814-8479-42c5d8615acd req-8d487303-1f24-43f7-b6d2-395342cfe1ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.722866 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e293aca-d945-4814-8479-42c5d8615acd req-8d487303-1f24-43f7-b6d2-395342cfe1ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.723471 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e293aca-d945-4814-8479-42c5d8615acd req-8d487303-1f24-43f7-b6d2-395342cfe1ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.723981 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e293aca-d945-4814-8479-42c5d8615acd req-8d487303-1f24-43f7-b6d2-395342cfe1ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.724377 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e293aca-d945-4814-8479-42c5d8615acd req-8d487303-1f24-43f7-b6d2-395342cfe1ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.725011 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e293aca-d945-4814-8479-42c5d8615acd req-8d487303-1f24-43f7-b6d2-395342cfe1ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.727128 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0e293aca-d945-4814-8479-42c5d8615acd req-8d487303-1f24-43f7-b6d2-395342cfe1ab service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=03e962eb7f5e4325a7c08c8b1e2a4cea&device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 6374 time: 0.0858209 Dec 09 21:28:51.791238 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-9962ed5f-e10c-46ac-b14c-525041282460 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.793075 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-9962ed5f-e10c-46ac-b14c-525041282460 service neutron] 10.222.0.10 "GET /v2.0/ports/1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f HTTP/1.1" status: 200 len: 1033 time: 0.1510203 Dec 09 21:28:51.856666 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e42f5600-f5e2-44d1-be49-be5be4116612 service neutron] For port d0dcf098-4522-4347-b733-bbc98e48d7e0, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:28:51.862853 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e293aca-d945-4814-8479-42c5d8615acd req-9e1282b1-bf29-4106-89a4-2cb4c1c021f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.863383 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e293aca-d945-4814-8479-42c5d8615acd req-9e1282b1-bf29-4106-89a4-2cb4c1c021f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.863907 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e293aca-d945-4814-8479-42c5d8615acd req-9e1282b1-bf29-4106-89a4-2cb4c1c021f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.865527 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0e293aca-d945-4814-8479-42c5d8615acd req-9e1282b1-bf29-4106-89a4-2cb4c1c021f6 service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=03e962eb7f5e4325a7c08c8b1e2a4cea&shared=False HTTP/1.1" status: 200 len: 2293 time: 0.1291368 Dec 09 21:28:51.901962 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-069bd6b0-0e88-43b1-afa6-fe3fc6925fd3 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.908041 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-069bd6b0-0e88-43b1-afa6-fe3fc6925fd3 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/networks?id=4d446a14-1218-469d-93aa-b4f9babdbb6e HTTP/1.1" status: 200 len: 815 time: 0.3041255 Dec 09 21:28:51.911844 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e42f5600-f5e2-44d1-be49-be5be4116612 service neutron] For port d0dcf098-4522-4347-b733-bbc98e48d7e0, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=d0dcf098-4522-4347-b733-bbc98e48d7e0,segment=NetworkSegment(8ca86951-e612-4db0-90f4-834b52fd24e0),segment_id=8ca86951-e612-4db0-90f4-834b52fd24e0)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:28:51.937489 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1acb213f-4899-4b0e-adbf-d044b8116db1 req-ab6116e8-337a-42d8-853b-ffd74c73ee70 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2181814 Dec 09 21:28:51.987368 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e42f5600-f5e2-44d1-be49-be5be4116612 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:51.992433 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e293aca-d945-4814-8479-42c5d8615acd req-8450069a-e976-4e5e-84f4-4e8906daf755 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:51.994019 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0e293aca-d945-4814-8479-42c5d8615acd req-8450069a-e976-4e5e-84f4-4e8906daf755 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1200640 Dec 09 21:28:52.006347 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-62e03552-fb4b-4a96-98ac-987c2a8aa03e tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/quotas/18e7af94d60344a18dedc56eda040c4b HTTP/1.1" status: 200 len: 375 time: 0.0972881 Dec 09 21:28:52.091285 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e42f5600-f5e2-44d1-be49-be5be4116612 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:52.097661 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e42f5600-f5e2-44d1-be49-be5be4116612 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:52.099146 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e42f5600-f5e2-44d1-be49-be5be4116612 service neutron] 10.222.0.10 "PUT /v2.0/ports/d0dcf098-4522-4347-b733-bbc98e48d7e0 HTTP/1.1" status: 200 len: 1092 time: 2.8093216 Dec 09 21:28:52.121001 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e42f5600-f5e2-44d1-be49-be5be4116612 service neutron] Pushing event updated for resources: {'Port': ['ID=d0dcf098-4522-4347-b733-bbc98e48d7e0,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:52.157960 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-d8dba8fe-1427-44fc-904f-67d1b991c0ed tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:52.166501 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-d8dba8fe-1427-44fc-904f-67d1b991c0ed tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:52.175045 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-d8dba8fe-1427-44fc-904f-67d1b991c0ed tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:52.177315 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-d8dba8fe-1427-44fc-904f-67d1b991c0ed tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.10 "GET /v2.0/networks?id=361619eb-51a4-4728-b2cc-72e27ec4eca5&id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&id=ae9d25d5-c9a2-4627-a465-8324b17541d9&id=ae9d25d5-c9a2-4627-a465-8324b17541d9 HTTP/1.1" status: 200 len: 1993 time: 0.3714993 Dec 09 21:28:52.184203 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-40744b73-e32a-47b1-9c7e-d1f70f91d264 service neutron] Request body: {'port': {'device_id': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:52.244977 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-047ee976-21ea-4735-b199-ceaf8af01d20 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=18e7af94d60344a18dedc56eda040c4b&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2375898 Dec 09 21:28:52.397525 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-40744b73-e32a-47b1-9c7e-d1f70f91d264 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:52.420715 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f4ba6967-70a3-4c82-8d91-bc68ccd915df tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.10 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=0a5d0e4652be4d8b87936a559840cc87 HTTP/1.1" status: 200 len: 379 time: 0.2311940 Dec 09 21:28:52.435570 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-15934779-e7dd-4cbd-923b-ec0aed10e723 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Request body: {'port': {'device_id': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5', 'admin_state_up': True, 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'security_groups': ['66e1817f-e10c-4faf-abd8-bc5e8fda7f97']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:52.497168 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-f27492a7-4c53-45c3-8509-8f48aecd20ee service neutron] 10.222.0.13 "GET /v2.0/networks/4d446a14-1218-469d-93aa-b4f9babdbb6e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2511957 Dec 09 21:28:52.565828 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-add134ae-7161-4130-8118-02b01d02f352 req-bac2dc4c-9674-450a-986e-aeb5892b28de tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:52.568067 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-add134ae-7161-4130-8118-02b01d02f352 req-bac2dc4c-9674-450a-986e-aeb5892b28de tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.31 "GET /v2.0/ports?device_id=bac40331-6475-4539-8840-531fdb9e5c14 HTTP/1.1" status: 200 len: 945 time: 0.1211438 Dec 09 21:28:52.742565 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-add134ae-7161-4130-8118-02b01d02f352 req-8dcc25ca-315b-42d2-bdf7-ba301cb4a12d tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Deleting port 8d3e0eef-050e-4fd6-87a2-f7e332149769 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:28:52.744539 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-add134ae-7161-4130-8118-02b01d02f352 req-8dcc25ca-315b-42d2-bdf7-ba301cb4a12d tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:52.857526 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a1ef722-3675-4b4e-9fb3-3368f631ea8f req-bf5734df-e21d-48bf-8984-403e89c284be tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:52.866430 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a1ef722-3675-4b4e-9fb3-3368f631ea8f req-bf5734df-e21d-48bf-8984-403e89c284be tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 945 time: 0.1873779 Dec 09 21:28:52.879295 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-8eaca86c-8b85-49b5-a8b5-05f634a33477 service neutron] 10.222.0.13 "GET /v2.0/networks/4d446a14-1218-469d-93aa-b4f9babdbb6e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3811829 Dec 09 21:28:52.896590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-add134ae-7161-4130-8118-02b01d02f352 req-8dcc25ca-315b-42d2-bdf7-ba301cb4a12d tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] For port 8d3e0eef-050e-4fd6-87a2-f7e332149769, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=8d3e0eef-050e-4fd6-87a2-f7e332149769,segment=NetworkSegment(e3c687b5-afac-4ac8-9b38-06599c2a8b7e),segment_id=e3c687b5-afac-4ac8-9b38-06599c2a8b7e)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:52.896971 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-add134ae-7161-4130-8118-02b01d02f352 req-8dcc25ca-315b-42d2-bdf7-ba301cb4a12d tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:52.914618 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-add134ae-7161-4130-8118-02b01d02f352 req-8dcc25ca-315b-42d2-bdf7-ba301cb4a12d tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Calling delete_port for 8d3e0eef-050e-4fd6-87a2-f7e332149769 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:28:52.922018 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-15934779-e7dd-4cbd-923b-ec0aed10e723 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Made reservation on behalf of 0a5d0e4652be4d8b87936a559840cc87 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:52.940719 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-15934779-e7dd-4cbd-923b-ec0aed10e723 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:53.148112 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a1ef722-3675-4b4e-9fb3-3368f631ea8f req-551e07ed-1a25-46dc-b46b-5a4bf39acf0f tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2804525 Dec 09 21:28:53.154055 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-add134ae-7161-4130-8118-02b01d02f352 req-8dcc25ca-315b-42d2-bdf7-ba301cb4a12d tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:53.167753 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['8d3e0eef-050e-4fd6-87a2-f7e332149769'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:28:53.267006 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dcc25ca-315b-42d2-bdf7-ba301cb4a12d tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Pushing event deleted for resources: {'Port': ['ID=8d3e0eef-050e-4fd6-87a2-f7e332149769,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:53.306079 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-add134ae-7161-4130-8118-02b01d02f352 req-8dcc25ca-315b-42d2-bdf7-ba301cb4a12d tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] No DVR routers for this DVR port 8d3e0eef-050e-4fd6-87a2-f7e332149769 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:28:53.308843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-15934779-e7dd-4cbd-923b-ec0aed10e723 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Allocated IP 172.20.0.14 (361619eb-51a4-4728-b2cc-72e27ec4eca5/d989acab-7cdc-482f-a350-344dd6e11873/7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:53.312885 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-add134ae-7161-4130-8118-02b01d02f352 req-8dcc25ca-315b-42d2-bdf7-ba301cb4a12d tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:53.317534 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-add134ae-7161-4130-8118-02b01d02f352 req-8dcc25ca-315b-42d2-bdf7-ba301cb4a12d tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.31 "DELETE /v2.0/ports/8d3e0eef-050e-4fd6-87a2-f7e332149769 HTTP/1.1" status: 204 len: 173 time: 0.7421422 Dec 09 21:28:53.318315 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bac40331-6475-4539-8840-531fdb9e5c14', 'name': 'network-vif-deleted', 'tag': '8d3e0eef-050e-4fd6-87a2-f7e332149769'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:53.332906 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-362ff26a-009e-4833-bbca-b0fa499a7432" -d '{"events": [{"server_uuid": "bac40331-6475-4539-8840-531fdb9e5c14", "name": "network-vif-deleted", "tag": "8d3e0eef-050e-4fd6-87a2-f7e332149769"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:53.346968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'tag': 'd0dcf098-4522-4347-b733-bbc98e48d7e0'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:53.349336 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ea2de2f7-6879-4ea5-9ddf-e5018fa6d209" -d '{"events": [{"name": "network-changed", "server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "tag": "d0dcf098-4522-4347-b733-bbc98e48d7e0"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:53.424984 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5770ee28-512c-4339-b5b6-65039c7bf4ae req-7666999f-fcdd-4500-9a3d-3aeb12137af7 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 210 time: 0.0589921 Dec 09 21:28:53.624622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-40744b73-e32a-47b1-9c7e-d1f70f91d264 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b7cad057-c6e6-483b-9791-e1b1a0dd73ac {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:28:53.636541 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-40744b73-e32a-47b1-9c7e-d1f70f91d264 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:53.727265 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-587b6516-96b2-4895-9def-d8bd07c1c08c req-c21ebd12-ef9b-4d56-b90b-540ba8e7a487 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:53.733820 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-587b6516-96b2-4895-9def-d8bd07c1c08c req-c21ebd12-ef9b-4d56-b90b-540ba8e7a487 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:53.741720 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-587b6516-96b2-4895-9def-d8bd07c1c08c req-c21ebd12-ef9b-4d56-b90b-540ba8e7a487 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:53.748435 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-587b6516-96b2-4895-9def-d8bd07c1c08c req-c21ebd12-ef9b-4d56-b90b-540ba8e7a487 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:53.754564 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-587b6516-96b2-4895-9def-d8bd07c1c08c req-c21ebd12-ef9b-4d56-b90b-540ba8e7a487 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:53.761109 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-587b6516-96b2-4895-9def-d8bd07c1c08c req-c21ebd12-ef9b-4d56-b90b-540ba8e7a487 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:53.769427 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-587b6516-96b2-4895-9def-d8bd07c1c08c req-c21ebd12-ef9b-4d56-b90b-540ba8e7a487 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:53.772088 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-587b6516-96b2-4895-9def-d8bd07c1c08c req-c21ebd12-ef9b-4d56-b90b-540ba8e7a487 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5408 time: 0.4146736 Dec 09 21:28:53.786856 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-40744b73-e32a-47b1-9c7e-d1f70f91d264 service neutron] Transition to ACTIVE for port object b7cad057-c6e6-483b-9791-e1b1a0dd73ac will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:28:53.811680 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-40744b73-e32a-47b1-9c7e-d1f70f91d264 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:53.932212 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6e0283d-c760-4423-8a8b-8214d852c358 req-78294a8c-c007-48d7-a370-cfb168ee6faa tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:53.940576 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d6e0283d-c760-4423-8a8b-8214d852c358 req-78294a8c-c007-48d7-a370-cfb168ee6faa tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.3852022 Dec 09 21:28:53.960528 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-587b6516-96b2-4895-9def-d8bd07c1c08c req-6a9148e5-40d1-4b91-8be0-b031322e1967 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1698797 Dec 09 21:28:54.040552 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-15934779-e7dd-4cbd-923b-ec0aed10e723 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:54.118350 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40744b73-e32a-47b1-9c7e-d1f70f91d264 service neutron] Pushing event updated for resources: {'Port': ['ID=b7cad057-c6e6-483b-9791-e1b1a0dd73ac,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:54.201800 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d6e0283d-c760-4423-8a8b-8214d852c358 req-52d105e3-a7e6-411b-92f0-331237cd3be7 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2602859 Dec 09 21:28:54.210670 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-64045936-e17f-4c73-a500-29ebe4e7b9c5 req-5bd7f06f-847a-41f3-9edb-9e83b71976b2 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=4641e74b-365e-4a0f-9c88-45d8762ec4bf HTTP/1.1" status: 200 len: 210 time: 0.0779476 Dec 09 21:28:54.271718 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-40744b73-e32a-47b1-9c7e-d1f70f91d264 service neutron] Attempting to bind port b7cad057-c6e6-483b-9791-e1b1a0dd73ac on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:28:54.272053 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-40744b73-e32a-47b1-9c7e-d1f70f91d264 service neutron] Attempting to bind port b7cad057-c6e6-483b-9791-e1b1a0dd73ac by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '8ca86951-e612-4db0-90f4-834b52fd24e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'a133a939-2827-4fe6-81f5-14715631c0ec'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:28:54.272431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-40744b73-e32a-47b1-9c7e-d1f70f91d264 service neutron] Attempting to bind port b7cad057-c6e6-483b-9791-e1b1a0dd73ac on network a133a939-2827-4fe6-81f5-14715631c0ec {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:54.277622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-40744b73-e32a-47b1-9c7e-d1f70f91d264 service neutron] Port b7cad057-c6e6-483b-9791-e1b1a0dd73ac on network a133a939-2827-4fe6-81f5-14715631c0ec not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:28:54.277942 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-40744b73-e32a-47b1-9c7e-d1f70f91d264 service neutron] Attempting to bind port b7cad057-c6e6-483b-9791-e1b1a0dd73ac on network a133a939-2827-4fe6-81f5-14715631c0ec {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:54.284407 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-15934779-e7dd-4cbd-923b-ec0aed10e723 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:54.286512 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-40744b73-e32a-47b1-9c7e-d1f70f91d264 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:28:54.286917 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-40744b73-e32a-47b1-9c7e-d1f70f91d264 service neutron] Checking segment: {'id': '8ca86951-e612-4db0-90f4-834b52fd24e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'a133a939-2827-4fe6-81f5-14715631c0ec'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:54.287250 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-40744b73-e32a-47b1-9c7e-d1f70f91d264 service neutron] Bound using segment: {'id': '8ca86951-e612-4db0-90f4-834b52fd24e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'a133a939-2827-4fe6-81f5-14715631c0ec'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:28:54.287708 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-40744b73-e32a-47b1-9c7e-d1f70f91d264 service neutron] Bound port: b7cad057-c6e6-483b-9791-e1b1a0dd73ac, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8ca86951-e612-4db0-90f4-834b52fd24e0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'a133a939-2827-4fe6-81f5-14715631c0ec'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:28:54.288175 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-40744b73-e32a-47b1-9c7e-d1f70f91d264 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:54.343871 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-32a570a8-2cee-4c50-89be-074999c4f71e x-openstack-request-id: req-32a570a8-2cee-4c50-89be-074999c4f71e {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:54.344361 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bac40331-6475-4539-8840-531fdb9e5c14", "name": "network-vif-deleted", "tag": "8d3e0eef-050e-4fd6-87a2-f7e332149769", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:54.344361 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-32a570a8-2cee-4c50-89be-074999c4f71e {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:54.344758 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bac40331-6475-4539-8840-531fdb9e5c14', 'name': 'network-vif-deleted', 'tag': '8d3e0eef-050e-4fd6-87a2-f7e332149769', 'status': 'completed', 'code': 200} Dec 09 21:28:54.365744 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-15934779-e7dd-4cbd-923b-ec0aed10e723 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Network 361619eb-51a4-4728-b2cc-72e27ec4eca5 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:54.399899 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-15934779-e7dd-4cbd-923b-ec0aed10e723 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:54.430024 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-76b96f28-4309-41f8-b429-2f05018f524b x-openstack-request-id: req-76b96f28-4309-41f8-b429-2f05018f524b {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:54.430321 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "tag": "d0dcf098-4522-4347-b733-bbc98e48d7e0", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:54.431151 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-76b96f28-4309-41f8-b429-2f05018f524b {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:54.431488 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'tag': 'd0dcf098-4522-4347-b733-bbc98e48d7e0', 'status': 'completed', 'code': 200} Dec 09 21:28:54.432241 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-15934779-e7dd-4cbd-923b-ec0aed10e723 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:54.510966 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-15934779-e7dd-4cbd-923b-ec0aed10e723 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:54.510966 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-15934779-e7dd-4cbd-923b-ec0aed10e723 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:54.543925 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15934779-e7dd-4cbd-923b-ec0aed10e723 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event updated for resources: {'Port': ['ID=7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:54.590197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43d6e8ab-3c90-4bf9-94c2-c863b5612379 req-7441cf21-26ab-4bb2-bb4b-d1f6f3071869 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:54.592101 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-43d6e8ab-3c90-4bf9-94c2-c863b5612379 req-7441cf21-26ab-4bb2-bb4b-d1f6f3071869 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.31 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 945 time: 0.2445202 Dec 09 21:28:54.622070 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea2de2f7-6879-4ea5-9ddf-e5018fa6d209 req-8a048fd0-1bf9-4fd7-b6a1-c5998282ce8f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:54.623085 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea2de2f7-6879-4ea5-9ddf-e5018fa6d209 req-8a048fd0-1bf9-4fd7-b6a1-c5998282ce8f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:54.623795 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea2de2f7-6879-4ea5-9ddf-e5018fa6d209 req-8a048fd0-1bf9-4fd7-b6a1-c5998282ce8f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:54.624579 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea2de2f7-6879-4ea5-9ddf-e5018fa6d209 req-8a048fd0-1bf9-4fd7-b6a1-c5998282ce8f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:54.625748 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea2de2f7-6879-4ea5-9ddf-e5018fa6d209 req-8a048fd0-1bf9-4fd7-b6a1-c5998282ce8f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:54.626263 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea2de2f7-6879-4ea5-9ddf-e5018fa6d209 req-8a048fd0-1bf9-4fd7-b6a1-c5998282ce8f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:54.627681 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea2de2f7-6879-4ea5-9ddf-e5018fa6d209 req-8a048fd0-1bf9-4fd7-b6a1-c5998282ce8f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:54.634814 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ea2de2f7-6879-4ea5-9ddf-e5018fa6d209 req-8a048fd0-1bf9-4fd7-b6a1-c5998282ce8f service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=03e962eb7f5e4325a7c08c8b1e2a4cea&device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 6442 time: 0.1799073 Dec 09 21:28:54.636991 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.10', 63863) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:54.686010 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-15934779-e7dd-4cbd-923b-ec0aed10e723 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.2571635 Dec 09 21:28:54.701205 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-1643c2e2-2217-478b-a636-62067869e97c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Request body: {'port': {'device_id': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c', 'admin_state_up': True, 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'security_groups': ['66e1817f-e10c-4faf-abd8-bc5e8fda7f97']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:54.705636 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-40744b73-e32a-47b1-9c7e-d1f70f91d264 service neutron] For port b7cad057-c6e6-483b-9791-e1b1a0dd73ac, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:28:54.739165 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-40744b73-e32a-47b1-9c7e-d1f70f91d264 service neutron] For port b7cad057-c6e6-483b-9791-e1b1a0dd73ac, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=b7cad057-c6e6-483b-9791-e1b1a0dd73ac,segment=NetworkSegment(8ca86951-e612-4db0-90f4-834b52fd24e0),segment_id=8ca86951-e612-4db0-90f4-834b52fd24e0)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:28:54.751524 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-560402d4-65f0-44fc-9bd5-09608c257c08 req-661ab7e8-c75c-477e-9e0f-ebdd176f9cf8 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:54.753329 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-560402d4-65f0-44fc-9bd5-09608c257c08 req-661ab7e8-c75c-477e-9e0f-ebdd176f9cf8 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.2316718 Dec 09 21:28:54.786811 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42180) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:28:54.795051 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-40744b73-e32a-47b1-9c7e-d1f70f91d264 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:54.801381 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-02977727-9d52-4814-a656-fceed2149ec1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Request body: {'floatingip': {'port_id': '778d35d4-c635-4fcb-b344-64cbb94958b9'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:54.821900 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0c0ba87-beec-410a-ad46-d8749d69f702 req-d1f547bb-fe3b-4837-b84b-f1df063d7eda tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:54.823558 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c0c0ba87-beec-410a-ad46-d8749d69f702 req-d1f547bb-fe3b-4837-b84b-f1df063d7eda tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=29288a2c-1307-4936-8a5e-57387556eb95 HTTP/1.1" status: 200 len: 945 time: 0.2821844 Dec 09 21:28:54.938996 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-cadd7dcc-689b-4be2-a91f-fc2493fc50a9 None None] Provisioning complete for port 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:54.939914 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea2de2f7-6879-4ea5-9ddf-e5018fa6d209 req-81ce75f9-bd7b-47cc-97e4-bc0c19394a3f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:54.940384 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea2de2f7-6879-4ea5-9ddf-e5018fa6d209 req-81ce75f9-bd7b-47cc-97e4-bc0c19394a3f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:54.940653 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cadd7dcc-689b-4be2-a91f-fc2493fc50a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:54.940841 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea2de2f7-6879-4ea5-9ddf-e5018fa6d209 req-81ce75f9-bd7b-47cc-97e4-bc0c19394a3f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:54.942481 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ea2de2f7-6879-4ea5-9ddf-e5018fa6d209 req-81ce75f9-bd7b-47cc-97e4-bc0c19394a3f service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=03e962eb7f5e4325a7c08c8b1e2a4cea&shared=False HTTP/1.1" status: 200 len: 2293 time: 0.2903309 Dec 09 21:28:54.948556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40744b73-e32a-47b1-9c7e-d1f70f91d264 service neutron] Pushing event updated for resources: {'Port': ['ID=b7cad057-c6e6-483b-9791-e1b1a0dd73ac,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:54.955943 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-40744b73-e32a-47b1-9c7e-d1f70f91d264 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:54.957281 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-40744b73-e32a-47b1-9c7e-d1f70f91d264 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:54.965499 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-40744b73-e32a-47b1-9c7e-d1f70f91d264 service neutron] 10.222.0.10 "PUT /v2.0/ports/b7cad057-c6e6-483b-9791-e1b1a0dd73ac HTTP/1.1" status: 200 len: 1092 time: 2.8263857 Dec 09 21:28:54.967727 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-5ddc7b85-dc5d-4ff1-8d47-61cb884ed800 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:54.975233 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-5ddc7b85-dc5d-4ff1-8d47-61cb884ed800 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.10 "GET /v2.0/networks?id=4d446a14-1218-469d-93aa-b4f9babdbb6e HTTP/1.1" status: 200 len: 815 time: 0.3371036 Dec 09 21:28:55.011087 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-e1c6b723-212e-4a1e-8c9e-35cbfabdf15f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Request body: {'port': {'device_id': '4641e74b-365e-4a0f-9c88-45d8762ec4bf', 'network_id': '4d446a14-1218-469d-93aa-b4f9babdbb6e', 'admin_state_up': True, 'tenant_id': '18e7af94d60344a18dedc56eda040c4b'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:55.037823 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-cadd7dcc-689b-4be2-a91f-fc2493fc50a9 None None] Port 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:28:55.068693 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-02977727-9d52-4814-a656-fceed2149ec1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for floatingip, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:55.077417 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-43d6e8ab-3c90-4bf9-94c2-c863b5612379 req-96bb1906-174f-4550-8687-bf18c55a4690 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Deleting port 5fd1ab85-a36a-49d7-924f-21a52601dc1e {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:28:55.091123 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-43d6e8ab-3c90-4bf9-94c2-c863b5612379 req-96bb1906-174f-4550-8687-bf18c55a4690 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:55.435189 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea2de2f7-6879-4ea5-9ddf-e5018fa6d209 req-7321d81c-659f-4dbf-9b62-97710f8bf759 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:55.436898 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ea2de2f7-6879-4ea5-9ddf-e5018fa6d209 req-7321d81c-659f-4dbf-9b62-97710f8bf759 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4586229 Dec 09 21:28:55.439539 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-43d6e8ab-3c90-4bf9-94c2-c863b5612379 req-96bb1906-174f-4550-8687-bf18c55a4690 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] For port 5fd1ab85-a36a-49d7-924f-21a52601dc1e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=5fd1ab85-a36a-49d7-924f-21a52601dc1e,segment=NetworkSegment(6bb6d7a7-737b-46b2-b463-0bc25081f6ef),segment_id=6bb6d7a7-737b-46b2-b463-0bc25081f6ef)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:28:55.439947 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-43d6e8ab-3c90-4bf9-94c2-c863b5612379 req-96bb1906-174f-4550-8687-bf18c55a4690 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:55.474162 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-43d6e8ab-3c90-4bf9-94c2-c863b5612379 req-96bb1906-174f-4550-8687-bf18c55a4690 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Calling delete_port for 5fd1ab85-a36a-49d7-924f-21a52601dc1e owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:28:55.669878 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-e1c6b723-212e-4a1e-8c9e-35cbfabdf15f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Made reservation on behalf of 18e7af94d60344a18dedc56eda040c4b for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:55.674339 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-e1c6b723-212e-4a1e-8c9e-35cbfabdf15f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:55.676777 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 5fd1ab85-a36a-49d7-924f-21a52601dc1e no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:28:55.879483 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-e1c6b723-212e-4a1e-8c9e-35cbfabdf15f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Allocated IP 172.20.0.13 (4d446a14-1218-469d-93aa-b4f9babdbb6e/75afc53b-d3f3-461c-aba4-c2ce93780246/12141f96-3d14-4c4d-a043-91223dcefddd) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:55.879933 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:55.901593 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-668727bc-4472-4838-b2e1-dcc5faf4d09d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:55.902085 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-668727bc-4472-4838-b2e1-dcc5faf4d09d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:55.903022 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-668727bc-4472-4838-b2e1-dcc5faf4d09d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:55.904376 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-668727bc-4472-4838-b2e1-dcc5faf4d09d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:55.904845 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-668727bc-4472-4838-b2e1-dcc5faf4d09d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:55.905459 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-668727bc-4472-4838-b2e1-dcc5faf4d09d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:55.905930 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-668727bc-4472-4838-b2e1-dcc5faf4d09d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:55.908143 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-668727bc-4472-4838-b2e1-dcc5faf4d09d service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=03e962eb7f5e4325a7c08c8b1e2a4cea&device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 6484 time: 0.4251323 Dec 09 21:28:55.912783 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-43d6e8ab-3c90-4bf9-94c2-c863b5612379 req-96bb1906-174f-4550-8687-bf18c55a4690 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:55.960167 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['4479e7ab-f0ee-45ff-a040-76f4dd53237f'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:28:55.964651 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 8d3e0eef-050e-4fd6-87a2-f7e332149769 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:28:55.996011 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96bb1906-174f-4550-8687-bf18c55a4690 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Pushing event deleted for resources: {'Port': ['ID=5fd1ab85-a36a-49d7-924f-21a52601dc1e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:55.998944 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-446ab101-1219-4366-833c-9573d2e3745f service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=90180a85-620b-470e-b808-b635138111be HTTP/1.1" status: 200 len: 217 time: 0.0798736 Dec 09 21:28:56.016289 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 8d3e0eef-050e-4fd6-87a2-f7e332149769 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:28:56.017029 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 8d3e0eef-050e-4fd6-87a2-f7e332149769 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:28:56.068635 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c0c0ba87-beec-410a-ad46-d8749d69f702 req-7de3e1dc-1c05-4b10-83cf-fa6309b3edb4 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.2225826 Dec 09 21:28:56.113559 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-1643c2e2-2217-478b-a636-62067869e97c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Made reservation on behalf of 0a5d0e4652be4d8b87936a559840cc87 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:56.117849 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-1643c2e2-2217-478b-a636-62067869e97c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:56.138622 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-43d6e8ab-3c90-4bf9-94c2-c863b5612379 req-96bb1906-174f-4550-8687-bf18c55a4690 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] No DVR routers for this DVR port 5fd1ab85-a36a-49d7-924f-21a52601dc1e on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:28:56.148112 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-43d6e8ab-3c90-4bf9-94c2-c863b5612379 req-96bb1906-174f-4550-8687-bf18c55a4690 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:56.151709 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-43d6e8ab-3c90-4bf9-94c2-c863b5612379 req-96bb1906-174f-4550-8687-bf18c55a4690 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.31 "DELETE /v2.0/ports/5fd1ab85-a36a-49d7-924f-21a52601dc1e HTTP/1.1" status: 204 len: 173 time: 1.5483963 Dec 09 21:28:56.156410 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-0457a091-0da5-4977-b0ff-45bf7d3810d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:56.158134 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-0457a091-0da5-4977-b0ff-45bf7d3810d4 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=65df7637-0210-4526-a5dd-a692c26062b4 HTTP/1.1" status: 200 len: 851 time: 0.1437271 Dec 09 21:28:56.222686 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c15e6ee3-34c1-4048-af1b-0a2d3fc9d707 req-647b398b-b223-43ce-885d-38d186434a30 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:56.238206 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c15e6ee3-34c1-4048-af1b-0a2d3fc9d707 req-647b398b-b223-43ce-885d-38d186434a30 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 932 time: 0.2439775 Dec 09 21:28:56.249857 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-aef8f280-f27f-4044-a224-a77f5c723f12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:56.251492 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-aef8f280-f27f-4044-a224-a77f5c723f12 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=f0373886-3db8-47eb-af65-78244497171e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0861263 Dec 09 21:28:56.347871 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '29288a2c-1307-4936-8a5e-57387556eb95', 'name': 'network-vif-deleted', 'tag': '5fd1ab85-a36a-49d7-924f-21a52601dc1e'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:56.350871 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-58d56c53-b93a-412d-8789-09edd089a36a" -d '{"events": [{"server_uuid": "29288a2c-1307-4936-8a5e-57387556eb95", "name": "network-vif-deleted", "tag": "5fd1ab85-a36a-49d7-924f-21a52601dc1e"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:56.358125 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-e1c6b723-212e-4a1e-8c9e-35cbfabdf15f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:56.425408 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c15e6ee3-34c1-4048-af1b-0a2d3fc9d707 req-28e6e51c-c94f-499d-b278-dc0f9a816277 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1861145 Dec 09 21:28:56.437490 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-27d19796-c3f3-4721-ae6c-6613b70009c2 service neutron] 10.222.0.10 "GET /v2.0/networks/f0373886-3db8-47eb-af65-78244497171e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1680088 Dec 09 21:28:56.459349 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-e1c6b723-212e-4a1e-8c9e-35cbfabdf15f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:56.460636 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'tag': 'b7cad057-c6e6-483b-9791-e1b1a0dd73ac'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:56.462848 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e8e0805a-a8e9-4c97-8713-24f260f81a45" -d '{"events": [{"name": "network-changed", "server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "tag": "b7cad057-c6e6-483b-9791-e1b1a0dd73ac"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:56.636610 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-e1c6b723-212e-4a1e-8c9e-35cbfabdf15f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Network 4d446a14-1218-469d-93aa-b4f9babdbb6e is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:56.638229 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-e1c6b723-212e-4a1e-8c9e-35cbfabdf15f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:56.651260 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-e1c6b723-212e-4a1e-8c9e-35cbfabdf15f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:56.660556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-291b0225-5411-4292-9b31-de189df373d8 req-62591b4a-e4c1-4a80-9d5e-ba0503730e90 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:56.667558 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-291b0225-5411-4292-9b31-de189df373d8 req-62591b4a-e4c1-4a80-9d5e-ba0503730e90 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:56.690617 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-ef5b7f0d-f47c-43fd-97ba-cde43d75fb69 service neutron] 10.222.0.10 "GET /v2.0/networks/f0373886-3db8-47eb-af65-78244497171e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2449527 Dec 09 21:28:56.691034 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-291b0225-5411-4292-9b31-de189df373d8 req-62591b4a-e4c1-4a80-9d5e-ba0503730e90 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:56.699799 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-291b0225-5411-4292-9b31-de189df373d8 req-62591b4a-e4c1-4a80-9d5e-ba0503730e90 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:56.706047 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-291b0225-5411-4292-9b31-de189df373d8 req-62591b4a-e4c1-4a80-9d5e-ba0503730e90 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:56.712189 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-291b0225-5411-4292-9b31-de189df373d8 req-62591b4a-e4c1-4a80-9d5e-ba0503730e90 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:56.714817 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1c6b723-212e-4a1e-8c9e-35cbfabdf15f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Pushing event updated for resources: {'Port': ['ID=12141f96-3d14-4c4d-a043-91223dcefddd,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:56.718582 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-291b0225-5411-4292-9b31-de189df373d8 req-62591b4a-e4c1-4a80-9d5e-ba0503730e90 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:56.726585 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-291b0225-5411-4292-9b31-de189df373d8 req-62591b4a-e4c1-4a80-9d5e-ba0503730e90 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5420 time: 0.3956730 Dec 09 21:28:56.799726 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-e1c6b723-212e-4a1e-8c9e-35cbfabdf15f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:56.800530 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-e1c6b723-212e-4a1e-8c9e-35cbfabdf15f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:56.815170 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-60d452c9-39eb-4916-bdf9-19a7dc080196 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.81&port_id=1e946a47-f496-445b-964b-618881eab263 HTTP/1.1" status: 200 len: 217 time: 0.1149514 Dec 09 21:28:56.836828 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-e1c6b723-212e-4a1e-8c9e-35cbfabdf15f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.8307741 Dec 09 21:28:56.876124 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-310c73c1-d66f-4aea-8a87-b36ab298d801 service neutron] Request body: {'port': {'device_id': '4641e74b-365e-4a0f-9c88-45d8762ec4bf', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:56.952312 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-291b0225-5411-4292-9b31-de189df373d8 req-30f3eca0-ff5c-492d-a9c9-37f1787751a3 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2219970 Dec 09 21:28:56.990506 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-5700899d-6dfe-4304-b530-3cd7b5c8ed18 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:56.994922 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-5700899d-6dfe-4304-b530-3cd7b5c8ed18 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=a894075b-fa9f-4a27-9782-e476e86f74e0 HTTP/1.1" status: 200 len: 797 time: 0.1557279 Dec 09 21:28:56.996556 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-310c73c1-d66f-4aea-8a87-b36ab298d801 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:57.010998 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a6e076b-adf9-49bb-8a9e-7a9c19f8be56 req-3ce23050-92fd-41ab-87af-c6947566bf92 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:57.030557 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a6e076b-adf9-49bb-8a9e-7a9c19f8be56 req-3ce23050-92fd-41ab-87af-c6947566bf92 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=4641e74b-365e-4a0f-9c88-45d8762ec4bf HTTP/1.1" status: 200 len: 932 time: 0.4347754 Dec 09 21:28:57.049627 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-1643c2e2-2217-478b-a636-62067869e97c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Allocated IP 10.1.1.40 (69c5e9e4-78c6-4a6b-9b16-9f1da643282c/871c2dc1-486e-4fcf-a882-5a1394082fc5/38f97951-e872-4c24-947f-934429895ad3) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:57.058044 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:28:57.117343 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-af5321c4-cb83-4a89-9614-527020d0559a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:57.119562 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-af5321c4-cb83-4a89-9614-527020d0559a service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a859e4ba-764a-41c0-982d-5bf79a2797a1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1114831 Dec 09 21:28:57.163193 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:57.181699 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:57.209114 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-039772b5-5408-4be6-8020-d960cb4e1c7b x-openstack-request-id: req-039772b5-5408-4be6-8020-d960cb4e1c7b {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:57.209413 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "29288a2c-1307-4936-8a5e-57387556eb95", "name": "network-vif-deleted", "tag": "5fd1ab85-a36a-49d7-924f-21a52601dc1e", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:57.209799 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-039772b5-5408-4be6-8020-d960cb4e1c7b {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:57.210149 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '29288a2c-1307-4936-8a5e-57387556eb95', 'name': 'network-vif-deleted', 'tag': '5fd1ab85-a36a-49d7-924f-21a52601dc1e', 'status': 'completed', 'code': 200} Dec 09 21:28:57.292340 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a40082ee-3d4c-41d9-b9b7-ffb8611c7bd3 x-openstack-request-id: req-a40082ee-3d4c-41d9-b9b7-ffb8611c7bd3 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:28:57.297260 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "tag": "b7cad057-c6e6-483b-9791-e1b1a0dd73ac", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:28:57.298917 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a40082ee-3d4c-41d9-b9b7-ffb8611c7bd3 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:28:57.299538 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'tag': 'b7cad057-c6e6-483b-9791-e1b1a0dd73ac', 'status': 'completed', 'code': 200} Dec 09 21:28:57.359979 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a6e076b-adf9-49bb-8a9e-7a9c19f8be56 req-de0bd0ef-b12f-480c-829b-2dab8234c158 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3266304 Dec 09 21:28:57.378300 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.db.resource_extend [None req-02977727-9d52-4814-a656-fceed2149ec1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] It took 0.20 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 09 21:28:57.378443 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-252d6b35-f562-48b7-afef-06ab9d8856e7 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2037346 Dec 09 21:28:57.535291 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-02977727-9d52-4814-a656-fceed2149ec1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:57.546978 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-02977727-9d52-4814-a656-fceed2149ec1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:57.603735 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-be3d93ed-4f37-4628-942f-981bff0f8b19 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2168279 Dec 09 21:28:57.611088 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-310c73c1-d66f-4aea-8a87-b36ab298d801 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 12141f96-3d14-4c4d-a043-91223dcefddd {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:28:57.687255 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-310c73c1-d66f-4aea-8a87-b36ab298d801 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:57.693401 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-ef4b96aa-dc26-42ec-afdd-f1078ba89bf3 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.31&port_id=145a0cde-0fe5-4163-a063-0fdfe42f243b HTTP/1.1" status: 200 len: 217 time: 0.0746489 Dec 09 21:28:57.768221 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d05a290d-935c-46fb-be2c-fe54252d84a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:57.771682 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d05a290d-935c-46fb-be2c-fe54252d84a5 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=a894075b-fa9f-4a27-9782-e476e86f74e0 HTTP/1.1" status: 200 len: 797 time: 0.0684960 Dec 09 21:28:57.793087 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-1643c2e2-2217-478b-a636-62067869e97c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:57.810703 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd0dcdc5-c3c4-40a6-a4b6-8343ffa3d5b8 req-b7970eaf-9a13-4f51-8d78-7b72f04dc4a2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:57.812350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd0dcdc5-c3c4-40a6-a4b6-8343ffa3d5b8 req-b7970eaf-9a13-4f51-8d78-7b72f04dc4a2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 932 time: 0.1600721 Dec 09 21:28:57.831900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-310c73c1-d66f-4aea-8a87-b36ab298d801 service neutron] Transition to ACTIVE for port object 12141f96-3d14-4c4d-a043-91223dcefddd will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:28:57.840391 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-02977727-9d52-4814-a656-fceed2149ec1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Floating IP 287dcdd1-9e61-49f6-b207-f9e349bbb1a7 associated. External IP: 172.25.3.72, port: 778d35d4-c635-4fcb-b344-64cbb94958b9. Dec 09 21:28:57.844644 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-310c73c1-d66f-4aea-8a87-b36ab298d801 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:57.912702 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6302f571-939d-4ae4-b437-70d59941924f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:57.915345 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6302f571-939d-4ae4-b437-70d59941924f service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a859e4ba-764a-41c0-982d-5bf79a2797a1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1366560 Dec 09 21:28:58.009386 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-1643c2e2-2217-478b-a636-62067869e97c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:58.050602 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-310c73c1-d66f-4aea-8a87-b36ab298d801 service neutron] Pushing event updated for resources: {'Port': ['ID=12141f96-3d14-4c4d-a043-91223dcefddd,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:58.088900 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd0dcdc5-c3c4-40a6-a4b6-8343ffa3d5b8 req-c7783ea5-6d6e-4190-ac4f-c1500b12990f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2432199 Dec 09 21:28:58.140593 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-1643c2e2-2217-478b-a636-62067869e97c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:28:58.147002 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-1643c2e2-2217-478b-a636-62067869e97c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:28:58.161206 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-1643c2e2-2217-478b-a636-62067869e97c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:28:58.299351 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1643c2e2-2217-478b-a636-62067869e97c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event updated for resources: {'Port': ['ID=38f97951-e872-4c24-947f-934429895ad3,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:58.319038 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-310c73c1-d66f-4aea-8a87-b36ab298d801 service neutron] Attempting to bind port 12141f96-3d14-4c4d-a043-91223dcefddd on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:28:58.320063 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-310c73c1-d66f-4aea-8a87-b36ab298d801 service neutron] Attempting to bind port 12141f96-3d14-4c4d-a043-91223dcefddd by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'e3c687b5-afac-4ac8-9b38-06599c2a8b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '4d446a14-1218-469d-93aa-b4f9babdbb6e'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:28:58.320849 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-310c73c1-d66f-4aea-8a87-b36ab298d801 service neutron] Attempting to bind port 12141f96-3d14-4c4d-a043-91223dcefddd on network 4d446a14-1218-469d-93aa-b4f9babdbb6e {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:58.332291 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-310c73c1-d66f-4aea-8a87-b36ab298d801 service neutron] Port 12141f96-3d14-4c4d-a043-91223dcefddd on network 4d446a14-1218-469d-93aa-b4f9babdbb6e not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:28:58.332935 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-310c73c1-d66f-4aea-8a87-b36ab298d801 service neutron] Attempting to bind port 12141f96-3d14-4c4d-a043-91223dcefddd on network 4d446a14-1218-469d-93aa-b4f9babdbb6e {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:28:58.346128 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-310c73c1-d66f-4aea-8a87-b36ab298d801 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:28:58.346840 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-310c73c1-d66f-4aea-8a87-b36ab298d801 service neutron] Checking segment: {'id': 'e3c687b5-afac-4ac8-9b38-06599c2a8b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '4d446a14-1218-469d-93aa-b4f9babdbb6e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:28:58.347560 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-310c73c1-d66f-4aea-8a87-b36ab298d801 service neutron] Bound using segment: {'id': 'e3c687b5-afac-4ac8-9b38-06599c2a8b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '4d446a14-1218-469d-93aa-b4f9babdbb6e'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:28:58.348220 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-310c73c1-d66f-4aea-8a87-b36ab298d801 service neutron] Bound port: 12141f96-3d14-4c4d-a043-91223dcefddd, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e3c687b5-afac-4ac8-9b38-06599c2a8b7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '4d446a14-1218-469d-93aa-b4f9babdbb6e'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:28:58.348795 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-310c73c1-d66f-4aea-8a87-b36ab298d801 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:58.354064 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-614c7ba6-8802-4fb4-bb3b-3e0fb9cce32e service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4138105 Dec 09 21:28:58.643097 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-19f1d3b8-41aa-4ff9-9f08-e26c678a2b9a None None] Provisioning complete for port 38f97951-e872-4c24-947f-934429895ad3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:28:58.647142 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-19f1d3b8-41aa-4ff9-9f08-e26c678a2b9a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:58.733063 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-1643c2e2-2217-478b-a636-62067869e97c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:58.733854 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-1643c2e2-2217-478b-a636-62067869e97c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:58.753850 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-19f1d3b8-41aa-4ff9-9f08-e26c678a2b9a None None] Port 38f97951-e872-4c24-947f-934429895ad3 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:28:58.780814 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f106ea6d-7249-48ba-81f5-cf4130263c80 req-a62561ac-6680-44a5-890c-b31d6972f366 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:58.789237 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f106ea6d-7249-48ba-81f5-cf4130263c80 req-a62561ac-6680-44a5-890c-b31d6972f366 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.5829291 Dec 09 21:28:58.825468 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-1643c2e2-2217-478b-a636-62067869e97c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 932 time: 4.1290905 Dec 09 21:28:58.876230 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-267d4675-af4f-44c4-b070-56b7a6e72477 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Request body: {'port': {'device_id': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c', 'admin_state_up': True, 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'security_groups': ['66e1817f-e10c-4faf-abd8-bc5e8fda7f97']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:28:58.943540 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97627160-b182-4fbb-91d3-7df2aaad7e08 req-bded1b15-5e61-4863-bd56-7507ace78b81 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:58.951879 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97627160-b182-4fbb-91d3-7df2aaad7e08 req-bded1b15-5e61-4863-bd56-7507ace78b81 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:58.961052 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97627160-b182-4fbb-91d3-7df2aaad7e08 req-bded1b15-5e61-4863-bd56-7507ace78b81 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:58.972532 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-310c73c1-d66f-4aea-8a87-b36ab298d801 service neutron] For port 12141f96-3d14-4c4d-a043-91223dcefddd, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:28:58.973230 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97627160-b182-4fbb-91d3-7df2aaad7e08 req-bded1b15-5e61-4863-bd56-7507ace78b81 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:58.980406 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-310c73c1-d66f-4aea-8a87-b36ab298d801 service neutron] For port 12141f96-3d14-4c4d-a043-91223dcefddd, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=12141f96-3d14-4c4d-a043-91223dcefddd,segment=NetworkSegment(e3c687b5-afac-4ac8-9b38-06599c2a8b7e),segment_id=e3c687b5-afac-4ac8-9b38-06599c2a8b7e)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:28:58.983225 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97627160-b182-4fbb-91d3-7df2aaad7e08 req-bded1b15-5e61-4863-bd56-7507ace78b81 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:58.987830 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-310c73c1-d66f-4aea-8a87-b36ab298d801 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:58.990626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97627160-b182-4fbb-91d3-7df2aaad7e08 req-bded1b15-5e61-4863-bd56-7507ace78b81 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:58.998532 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97627160-b182-4fbb-91d3-7df2aaad7e08 req-bded1b15-5e61-4863-bd56-7507ace78b81 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:59.004143 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-97627160-b182-4fbb-91d3-7df2aaad7e08 req-bded1b15-5e61-4863-bd56-7507ace78b81 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5420 time: 0.6687918 Dec 09 21:28:59.018837 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-65bead7c-34a6-4a25-a822-035ad91816e6 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6503837 Dec 09 21:28:59.032037 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-310c73c1-d66f-4aea-8a87-b36ab298d801 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:59.032674 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-310c73c1-d66f-4aea-8a87-b36ab298d801 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:59.034471 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-310c73c1-d66f-4aea-8a87-b36ab298d801 service neutron] 10.222.0.10 "PUT /v2.0/ports/12141f96-3d14-4c4d-a043-91223dcefddd HTTP/1.1" status: 200 len: 1093 time: 2.1651301 Dec 09 21:28:59.077150 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-396406c5-3ec3-4bf5-b3b2-2aeaab48ada3 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.110&port_id=7b66d328-f18c-4d26-af51-99c1b1f1f05e HTTP/1.1" status: 200 len: 217 time: 0.0466676 Dec 09 21:28:59.154459 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f106ea6d-7249-48ba-81f5-cf4130263c80 req-92abab9a-463c-4b8a-b1ee-5a8f32d5abb5 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3641024 Dec 09 21:28:59.168483 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-310c73c1-d66f-4aea-8a87-b36ab298d801 service neutron] Pushing event updated for resources: {'Port': ['ID=12141f96-3d14-4c4d-a043-91223dcefddd,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:28:59.176788 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-02977727-9d52-4814-a656-fceed2149ec1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Router 8f39d25d-26dd-4bce-b961-53cba1551e5d has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:28:59.187935 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e7d57a54-066f-4a7d-a801-69ded9d80621 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:59.189418 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e7d57a54-066f-4a7d-a801-69ded9d80621 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=a894075b-fa9f-4a27-9782-e476e86f74e0 HTTP/1.1" status: 200 len: 797 time: 0.0994406 Dec 09 21:28:59.195125 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-885765c1-306f-43ff-a61c-75c56e244524 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:59.196548 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-885765c1-306f-43ff-a61c-75c56e244524 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=18e7af94d60344a18dedc56eda040c4b&device_id=4641e74b-365e-4a0f-9c88-45d8762ec4bf HTTP/1.1" status: 200 len: 1096 time: 0.1076477 Dec 09 21:28:59.224978 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4641e74b-365e-4a0f-9c88-45d8762ec4bf', 'tag': '12141f96-3d14-4c4d-a043-91223dcefddd'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:59.227336 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-291169f1-2889-46e2-8fd9-ee0b1c52fd6f" -d '{"events": [{"name": "network-changed", "server_uuid": "4641e74b-365e-4a0f-9c88-45d8762ec4bf", "tag": "12141f96-3d14-4c4d-a043-91223dcefddd"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:59.274736 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-4aecb9cd-38c0-42b7-8b89-2a4dff528992 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=12141f96-3d14-4c4d-a043-91223dcefddd HTTP/1.1" status: 200 len: 217 time: 0.0425234 Dec 09 21:28:59.292980 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-b029a418-a94b-4150-9de9-f13e21938b66 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:59.294703 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-b029a418-a94b-4150-9de9-f13e21938b66 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a859e4ba-764a-41c0-982d-5bf79a2797a1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0963321 Dec 09 21:28:59.315186 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-97627160-b182-4fbb-91d3-7df2aaad7e08 req-057660f3-ea96-43af-ba35-9bbef140de85 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2897789 Dec 09 21:28:59.360006 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-0304fea5-bd0a-4ee5-ba88-c4a62b6fe9b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:59.368266 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-0304fea5-bd0a-4ee5-ba88-c4a62b6fe9b6 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=75afc53b-d3f3-461c-aba4-c2ce93780246 HTTP/1.1" status: 200 len: 855 time: 0.0854344 Dec 09 21:28:59.423119 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-565b59b0-2c61-4742-be24-1fc6fa814b3e service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=4d446a14-1218-469d-93aa-b4f9babdbb6e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0297654 Dec 09 21:28:59.452436 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-267d4675-af4f-44c4-b070-56b7a6e72477 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Made reservation on behalf of 0a5d0e4652be4d8b87936a559840cc87 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:28:59.456083 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-267d4675-af4f-44c4-b070-56b7a6e72477 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:59.510386 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-5733e430-07e0-4e1a-9cb1-4932a119e097 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1958885 Dec 09 21:28:59.519376 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-02977727-9d52-4814-a656-fceed2149ec1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:28:59.528129 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-02977727-9d52-4814-a656-fceed2149ec1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:28:59.531876 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f529c364-7fad-4af2-9088-eb95379bd0fa None None] Sync routers for ids ['8f39d25d-26dd-4bce-b961-53cba1551e5d'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:28:59.557558 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f529c364-7fad-4af2-9088-eb95379bd0fa None None] Routers {'8f39d25d-26dd-4bce-b961-53cba1551e5d'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:28:59.558548 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-f529c364-7fad-4af2-9088-eb95379bd0fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:28:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['8f39d25d-26dd-4bce-b961-53cba1551e5d'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:28:59.589752 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7400e912-55ab-4136-8e38-bb5b71598e67 req-10e3974e-43bd-4bce-837d-cf14538cee65 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:28:59.591660 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7400e912-55ab-4136-8e38-bb5b71598e67 req-10e3974e-43bd-4bce-837d-cf14538cee65 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=4641e74b-365e-4a0f-9c88-45d8762ec4bf HTTP/1.1" status: 200 len: 944 time: 0.1579900 Dec 09 21:28:59.606308 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-23154d1c-de8c-4d7a-a706-d5a351c042f3 service neutron] 10.222.0.10 "GET /v2.0/networks/4d446a14-1218-469d-93aa-b4f9babdbb6e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1743221 Dec 09 21:28:59.638049 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-02977727-9d52-4814-a656-fceed2149ec1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "PUT /v2.0/floatingips/287dcdd1-9e61-49f6-b207-f9e349bbb1a7 HTTP/1.1" status: 200 len: 991 time: 4.8427691 Dec 09 21:28:59.641586 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '753dc06f-e08a-4cab-82a9-7e1089901f9b', 'tag': '778d35d4-c635-4fcb-b344-64cbb94958b9'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:28:59.643874 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c9242ce1-b0b7-4197-aa0f-2b199ba4af88" -d '{"events": [{"name": "network-changed", "server_uuid": "753dc06f-e08a-4cab-82a9-7e1089901f9b", "tag": "778d35d4-c635-4fcb-b344-64cbb94958b9"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:28:59.718473 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7400e912-55ab-4136-8e38-bb5b71598e67 req-15d211b6-a0bc-453b-beb8-5c1353544e95 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1122999 Dec 09 21:28:59.735339 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-267d4675-af4f-44c4-b070-56b7a6e72477 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Allocated IP 10.1.1.103 (69c5e9e4-78c6-4a6b-9b16-9f1da643282c/871c2dc1-486e-4fcf-a882-5a1394082fc5/57519c10-1d02-4ce7-b4be-b37a7bd58b09) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:28:59.794524 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-27cdc5ad-707f-4a16-80f0-7f02a9836fc6 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2727480 Dec 09 21:28:59.907544 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-6c52e4c7-2b43-4e3e-b2bb-d15f8dbe3033 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.206&port_id=3bbd0bd0-666a-4f39-abae-59f44d88319c HTTP/1.1" status: 200 len: 217 time: 0.0972281 Dec 09 21:29:00.000531 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e751c32c-faab-43e6-9bc6-4dc4276f4a7e req-ee58f9c4-fb5c-48d0-8617-973ce5afe013 service neutron] 10.222.0.10 "GET /v2.0/networks/4d446a14-1218-469d-93aa-b4f9babdbb6e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3846793 Dec 09 21:29:00.039301 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-eb9a730b-6048-4a29-9c1d-a53046dacd23 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:00.040852 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-eb9a730b-6048-4a29-9c1d-a53046dacd23 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=a894075b-fa9f-4a27-9782-e476e86f74e0 HTTP/1.1" status: 200 len: 797 time: 0.1155381 Dec 09 21:29:00.068141 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-534f42a9-9c8f-40bc-93c2-b36950676890 x-openstack-request-id: req-534f42a9-9c8f-40bc-93c2-b36950676890 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:00.068443 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4641e74b-365e-4a0f-9c88-45d8762ec4bf", "tag": "12141f96-3d14-4c4d-a043-91223dcefddd", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:00.068748 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-534f42a9-9c8f-40bc-93c2-b36950676890 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:00.069164 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4641e74b-365e-4a0f-9c88-45d8762ec4bf', 'tag': '12141f96-3d14-4c4d-a043-91223dcefddd', 'status': 'completed', 'code': 200} Dec 09 21:29:00.100885 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11df4c64-1f3b-4c80-99f8-b9632cf2f0fa req-3747289e-16e9-4026-baf5-98258a27afb3 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:00.124106 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11df4c64-1f3b-4c80-99f8-b9632cf2f0fa req-3747289e-16e9-4026-baf5-98258a27afb3 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:00.126165 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11df4c64-1f3b-4c80-99f8-b9632cf2f0fa req-3747289e-16e9-4026-baf5-98258a27afb3 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 1653 time: 0.1665702 Dec 09 21:29:00.145090 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-732d7328-ff0e-4433-b3f4-a7c911541f38 req-4357d5d9-b4a0-401a-892f-be32a6322ca1 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:00.155417 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-732d7328-ff0e-4433-b3f4-a7c911541f38 req-4357d5d9-b4a0-401a-892f-be32a6322ca1 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.10 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.1849806 Dec 09 21:29:00.161665 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-267d4675-af4f-44c4-b070-56b7a6e72477 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:00.238441 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-15d2dcab-3fc7-411c-9e0f-72da9b660f89 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:00.245099 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-15d2dcab-3fc7-411c-9e0f-72da9b660f89 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a859e4ba-764a-41c0-982d-5bf79a2797a1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1924815 Dec 09 21:29:00.299873 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:28:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6a553394-d8c7-4e33-bff8-8398806524cd x-openstack-request-id: req-6a553394-d8c7-4e33-bff8-8398806524cd {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:00.301896 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "753dc06f-e08a-4cab-82a9-7e1089901f9b", "tag": "778d35d4-c635-4fcb-b344-64cbb94958b9", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:00.302321 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-6a553394-d8c7-4e33-bff8-8398806524cd {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:00.306312 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '753dc06f-e08a-4cab-82a9-7e1089901f9b', 'tag': '778d35d4-c635-4fcb-b344-64cbb94958b9', 'status': 'completed', 'code': 200} Dec 09 21:29:00.317265 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-f529c364-7fad-4af2-9088-eb95379bd0fa None None] Set router 8f39d25d-26dd-4bce-b961-53cba1551e5d gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:29:00.394355 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11df4c64-1f3b-4c80-99f8-b9632cf2f0fa req-6d9d4dfa-54f6-4765-a104-3b49d954fb5c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2294314 Dec 09 21:29:00.441724 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-267d4675-af4f-44c4-b070-56b7a6e72477 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:00.503197 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-c496bec0-cf85-4278-bab9-6877798171af service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2483785 Dec 09 21:29:00.533588 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-291169f1-2889-46e2-8fd9-ee0b1c52fd6f req-b01cb683-b883-48f4-af29-9fa180bed70a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:00.535771 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-291169f1-2889-46e2-8fd9-ee0b1c52fd6f req-b01cb683-b883-48f4-af29-9fa180bed70a service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=18e7af94d60344a18dedc56eda040c4b&device_id=4641e74b-365e-4a0f-9c88-45d8762ec4bf HTTP/1.1" status: 200 len: 1096 time: 0.4316881 Dec 09 21:29:00.553289 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-732d7328-ff0e-4433-b3f4-a7c911541f38 req-1b131ae1-b032-404a-a5f3-b1ea6aff6b2e tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Deleting port 4479e7ab-f0ee-45ff-a040-76f4dd53237f {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:29:00.553972 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-732d7328-ff0e-4433-b3f4-a7c911541f38 req-1b131ae1-b032-404a-a5f3-b1ea6aff6b2e tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:00.611983 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-267d4675-af4f-44c4-b070-56b7a6e72477 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:29:00.635415 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-267d4675-af4f-44c4-b070-56b7a6e72477 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:29:00.683356 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-267d4675-af4f-44c4-b070-56b7a6e72477 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:29:00.687129 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-267d4675-af4f-44c4-b070-56b7a6e72477 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event updated for resources: {'Port': ['ID=57519c10-1d02-4ce7-b4be-b37a7bd58b09,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:00.763006 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6f39ede-c1a3-4f2a-90a6-1830fe41e419 req-ae08b86e-d83a-4bf6-b810-f292b2fe168b tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:00.773509 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6f39ede-c1a3-4f2a-90a6-1830fe41e419 req-ae08b86e-d83a-4bf6-b810-f292b2fe168b tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 946 time: 0.2413085 Dec 09 21:29:00.829087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-267d4675-af4f-44c4-b070-56b7a6e72477 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:00.830022 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-267d4675-af4f-44c4-b070-56b7a6e72477 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:00.861134 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-732d7328-ff0e-4433-b3f4-a7c911541f38 req-1b131ae1-b032-404a-a5f3-b1ea6aff6b2e tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] For port 4479e7ab-f0ee-45ff-a040-76f4dd53237f, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=4479e7ab-f0ee-45ff-a040-76f4dd53237f,segment=NetworkSegment(6bb6d7a7-737b-46b2-b463-0bc25081f6ef),segment_id=6bb6d7a7-737b-46b2-b463-0bc25081f6ef)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:00.861890 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-732d7328-ff0e-4433-b3f4-a7c911541f38 req-1b131ae1-b032-404a-a5f3-b1ea6aff6b2e tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:00.903786 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6f39ede-c1a3-4f2a-90a6-1830fe41e419 req-6aa5e953-9ef2-43cd-99e0-77d893d225f5 tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/security-groups?id=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1285620 Dec 09 21:29:00.928350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-267d4675-af4f-44c4-b070-56b7a6e72477 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.0593097 Dec 09 21:29:00.929591 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-732d7328-ff0e-4433-b3f4-a7c911541f38 req-1b131ae1-b032-404a-a5f3-b1ea6aff6b2e tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Calling delete_port for 4479e7ab-f0ee-45ff-a040-76f4dd53237f owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:29:00.955753 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-121895e4-f1dc-4255-8f02-aa8b2b8287eb tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Request body: {'port': {'device_id': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'fixed_ips': [{'ip_address': '10.2.2.100'}], 'network_id': 'ae9d25d5-c9a2-4627-a465-8324b17541d9', 'admin_state_up': True, 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'security_groups': ['66e1817f-e10c-4faf-abd8-bc5e8fda7f97']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:01.001975 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-3772718e-ac7b-47bd-b3dd-e2d3a7d5524f service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4791336 Dec 09 21:29:01.084159 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-f529c364-7fad-4af2-9088-eb95379bd0fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'name': 'tempest-AttachVolumeShelveTestJSON-236206179-router', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203'}], 'enable_snat': True}, 'gw_port_id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:14Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'gw_port': {'id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:4c:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1175, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:15Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '287dcdd1-9e61-49f6-b207-f9e349bbb1a7', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'floating_ip_address': '172.25.3.72', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'port_id': '778d35d4-c635-4fcb-b344-64cbb94958b9', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1212, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'mac_address': 'fa:16:3e:aa:9b:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '753dc06f-e08a-4cab-82a9-7e1089901f9b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:28:31Z', 'updated_at': '2021-12-09T21:28:57Z', 'revision_number': 1, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a9a5d2ec-b408-4729-99d3-0e4f8f041e60', 'name': '', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'mac_address': 'fa:16:3e:40:0d:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1178, 'fixed_ips': [{'subnet_id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:19Z', 'updated_at': '2021-12-09T21:28:25Z', 'revision_number': 5, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'subnets': [{'id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:01.115160 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f529c364-7fad-4af2-9088-eb95379bd0fa None None] Checking router: 8f39d25d-26dd-4bce-b961-53cba1551e5d for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:29:01.125554 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f529c364-7fad-4af2-9088-eb95379bd0fa None None] Routers {'8f39d25d-26dd-4bce-b961-53cba1551e5d'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:29:01.126187 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-f529c364-7fad-4af2-9088-eb95379bd0fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:28:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['8f39d25d-26dd-4bce-b961-53cba1551e5d'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:01.204655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9242ce1-b0b7-4197-aa0f-2b199ba4af88 req-9d406087-cc32-4455-a41b-94fc824941b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:01.207042 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c9242ce1-b0b7-4197-aa0f-2b199ba4af88 req-9d406087-cc32-4455-a41b-94fc824941b3 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=29f2c1d9be9348b0888bc61ed37ed957&device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 1098 time: 0.7015297 Dec 09 21:29:01.289793 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-f529c364-7fad-4af2-9088-eb95379bd0fa None None] Set router 8f39d25d-26dd-4bce-b961-53cba1551e5d gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:29:01.333458 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-854a6967-0914-47ac-be97-79dc1f178e3d None None] Provisioning complete for port 57519c10-1d02-4ce7-b4be-b37a7bd58b09 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:01.334129 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-854a6967-0914-47ac-be97-79dc1f178e3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:01.342349 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-0acf6a43-8bb2-4c8b-9749-802874805606 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.100&port_id=d0dcf098-4522-4347-b733-bbc98e48d7e0 HTTP/1.1" status: 200 len: 217 time: 0.1707554 Dec 09 21:29:01.385110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2610087-9085-4dfa-bedb-bc73b89dd45e req-bcb6cf3b-22b4-4369-b2ac-088331a7eaf4 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:01.391389 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2610087-9085-4dfa-bedb-bc73b89dd45e req-bcb6cf3b-22b4-4369-b2ac-088331a7eaf4 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:01.398132 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2610087-9085-4dfa-bedb-bc73b89dd45e req-bcb6cf3b-22b4-4369-b2ac-088331a7eaf4 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:01.404932 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2610087-9085-4dfa-bedb-bc73b89dd45e req-bcb6cf3b-22b4-4369-b2ac-088331a7eaf4 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:01.412034 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2610087-9085-4dfa-bedb-bc73b89dd45e req-bcb6cf3b-22b4-4369-b2ac-088331a7eaf4 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:01.418227 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2610087-9085-4dfa-bedb-bc73b89dd45e req-bcb6cf3b-22b4-4369-b2ac-088331a7eaf4 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:01.424870 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2610087-9085-4dfa-bedb-bc73b89dd45e req-bcb6cf3b-22b4-4369-b2ac-088331a7eaf4 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:01.426338 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-291169f1-2889-46e2-8fd9-ee0b1c52fd6f req-f791acbb-8695-4f21-95bc-474c5429d15d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:01.432671 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-291169f1-2889-46e2-8fd9-ee0b1c52fd6f req-f791acbb-8695-4f21-95bc-474c5429d15d service neutron] 10.222.0.10 "GET /v2.0/networks?id=4d446a14-1218-469d-93aa-b4f9babdbb6e HTTP/1.1" status: 200 len: 916 time: 0.8432636 Dec 09 21:29:01.434515 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2610087-9085-4dfa-bedb-bc73b89dd45e req-bcb6cf3b-22b4-4369-b2ac-088331a7eaf4 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5420 time: 0.4429724 Dec 09 21:29:01.443166 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-854a6967-0914-47ac-be97-79dc1f178e3d None None] Port 57519c10-1d02-4ce7-b4be-b37a7bd58b09 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:29:01.475388 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb9de487-648b-4422-99b4-81fe04656a6a req-ce2a51b8-dcbd-4a2e-8c01-47de4c60bd16 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:01.483203 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eb9de487-648b-4422-99b4-81fe04656a6a req-ce2a51b8-dcbd-4a2e-8c01-47de4c60bd16 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=4641e74b-365e-4a0f-9c88-45d8762ec4bf HTTP/1.1" status: 200 len: 944 time: 0.3676198 Dec 09 21:29:01.609224 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2610087-9085-4dfa-bedb-bc73b89dd45e req-634c0b15-85b9-468c-8a13-ef1cdb717a5f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1733842 Dec 09 21:29:01.664932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e0baf081-404c-458c-b56f-b29ef0d93385 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:01.666607 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-e0baf081-404c-458c-b56f-b29ef0d93385 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=753ba647-b0b0-482e-ac28-89c7e6adf654 HTTP/1.1" status: 200 len: 797 time: 0.3043497 Dec 09 21:29:01.687025 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eb9de487-648b-4422-99b4-81fe04656a6a req-22dc5126-e620-4692-b0c3-3a28e940213c tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2027147 Dec 09 21:29:01.742711 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-121895e4-f1dc-4255-8f02-aa8b2b8287eb tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Made reservation on behalf of 0a5d0e4652be4d8b87936a559840cc87 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:29:01.780502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-f529c364-7fad-4af2-9088-eb95379bd0fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'name': 'tempest-AttachVolumeShelveTestJSON-236206179-router', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203'}], 'enable_snat': True}, 'gw_port_id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:14Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'gw_port': {'id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:4c:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1175, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:15Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '287dcdd1-9e61-49f6-b207-f9e349bbb1a7', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'floating_ip_address': '172.25.3.72', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'port_id': '778d35d4-c635-4fcb-b344-64cbb94958b9', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1212, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'mac_address': 'fa:16:3e:aa:9b:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '753dc06f-e08a-4cab-82a9-7e1089901f9b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:28:31Z', 'updated_at': '2021-12-09T21:28:57Z', 'revision_number': 1, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a9a5d2ec-b408-4729-99d3-0e4f8f041e60', 'name': '', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'mac_address': 'fa:16:3e:40:0d:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1178, 'fixed_ips': [{'subnet_id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:19Z', 'updated_at': '2021-12-09T21:28:25Z', 'revision_number': 5, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'subnets': [{'id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:01.848934 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-291169f1-2889-46e2-8fd9-ee0b1c52fd6f req-737e76eb-afcd-4a2e-af11-beaf811f790d service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=12141f96-3d14-4c4d-a043-91223dcefddd HTTP/1.1" status: 200 len: 217 time: 0.1742074 Dec 09 21:29:01.863260 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9242ce1-b0b7-4197-aa0f-2b199ba4af88 req-e888d152-2e9a-4f79-b2d1-22df1c1f945e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:01.863514 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f529c364-7fad-4af2-9088-eb95379bd0fa None None] The sync data for ids ['8f39d25d-26dd-4bce-b961-53cba1551e5d'] in n-d-713301-27 is: [{'id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'name': 'tempest-AttachVolumeShelveTestJSON-236206179-router', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203'}], 'enable_snat': True}, 'gw_port_id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:14Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'gw_port': {'id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:4c:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1175, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:15Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '287dcdd1-9e61-49f6-b207-f9e349bbb1a7', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'floating_ip_address': '172.25.3.72', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'port_id': '778d35d4-c635-4fcb-b344-64cbb94958b9', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 1212, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'mac_address': 'fa:16:3e:aa:9b:e5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '753dc06f-e08a-4cab-82a9-7e1089901f9b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:28:31Z', 'updated_at': '2021-12-09T21:28:57Z', 'revision_number': 1, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a9a5d2ec-b408-4729-99d3-0e4f8f041e60', 'name': '', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'mac_address': 'fa:16:3e:40:0d:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1178, 'fixed_ips': [{'subnet_id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:19Z', 'updated_at': '2021-12-09T21:28:25Z', 'revision_number': 5, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'subnets': [{'id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:29:01.864761 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c9242ce1-b0b7-4197-aa0f-2b199ba4af88 req-e888d152-2e9a-4f79-b2d1-22df1c1f945e service neutron] 10.222.0.31 "GET /v2.0/networks?id=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 HTTP/1.1" status: 200 len: 917 time: 0.5309739 Dec 09 21:29:01.957900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-291169f1-2889-46e2-8fd9-ee0b1c52fd6f req-b0d2a924-573d-4f74-b61b-092c1d090703 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:01.959408 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-291169f1-2889-46e2-8fd9-ee0b1c52fd6f req-b0d2a924-573d-4f74-b61b-092c1d090703 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=75afc53b-d3f3-461c-aba4-c2ce93780246 HTTP/1.1" status: 200 len: 855 time: 0.1011519 Dec 09 21:29:02.002314 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-682cac1c-522f-4164-9e52-11fecb00407c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:02.003870 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-682cac1c-522f-4164-9e52-11fecb00407c service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a133a939-2827-4fe6-81f5-14715631c0ec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.3266449 Dec 09 21:29:02.005788 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-291169f1-2889-46e2-8fd9-ee0b1c52fd6f req-99b7d9b1-faa2-44dc-a3a4-2d8cf8554e92 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=4d446a14-1218-469d-93aa-b4f9babdbb6e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0350964 Dec 09 21:29:02.092932 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-732d7328-ff0e-4433-b3f4-a7c911541f38 req-1b131ae1-b032-404a-a5f3-b1ea6aff6b2e tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:02.104826 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['4479e7ab-f0ee-45ff-a040-76f4dd53237f'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:29:02.166714 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d304a0cc-8c5d-4df1-94ce-9aa36fdf864c req-1eb92a40-c4ff-459e-af13-f63b3b71160a tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c7a3543-1d7f-4fd2-a53f-511ae0a4074d HTTP/1.1" status: 200 len: 210 time: 0.0957506 Dec 09 21:29:02.229417 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c9242ce1-b0b7-4197-aa0f-2b199ba4af88 req-787fe708-176e-453d-8d41-bc84e8197ccc service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=778d35d4-c635-4fcb-b344-64cbb94958b9 HTTP/1.1" status: 200 len: 999 time: 0.2689664 Dec 09 21:29:02.297991 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b131ae1-b032-404a-a5f3-b1ea6aff6b2e tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Pushing event deleted for resources: {'Port': ['ID=4479e7ab-f0ee-45ff-a040-76f4dd53237f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:02.360010 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d839267-5cdb-4d6b-8ce6-0a0794a49ba3 None None] New status for floating IP 287dcdd1-9e61-49f6-b207-f9e349bbb1a7: ACTIVE {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:29:02.377768 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-732d7328-ff0e-4433-b3f4-a7c911541f38 req-1b131ae1-b032-404a-a5f3-b1ea6aff6b2e tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] No DVR routers for this DVR port 4479e7ab-f0ee-45ff-a040-76f4dd53237f on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:29:02.401892 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d75b9d33-0124-492d-b786-8d3cfd0c429a req-ef9abb8e-9269-4742-9800-2dd3a5b580e3 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:02.415086 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d75b9d33-0124-492d-b786-8d3cfd0c429a req-ef9abb8e-9269-4742-9800-2dd3a5b580e3 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:02.432703 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d75b9d33-0124-492d-b786-8d3cfd0c429a req-ef9abb8e-9269-4742-9800-2dd3a5b580e3 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:02.439680 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d75b9d33-0124-492d-b786-8d3cfd0c429a req-ef9abb8e-9269-4742-9800-2dd3a5b580e3 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 2374 time: 0.6222692 Dec 09 21:29:02.446242 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-121895e4-f1dc-4255-8f02-aa8b2b8287eb tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:02.454857 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-732d7328-ff0e-4433-b3f4-a7c911541f38 req-1b131ae1-b032-404a-a5f3-b1ea6aff6b2e tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:02.466254 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-732d7328-ff0e-4433-b3f4-a7c911541f38 req-1b131ae1-b032-404a-a5f3-b1ea6aff6b2e tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] 10.222.0.10 "DELETE /v2.0/ports/4479e7ab-f0ee-45ff-a040-76f4dd53237f HTTP/1.1" status: 204 len: 173 time: 2.2896032 Dec 09 21:29:02.473667 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5c7a3543-1d7f-4fd2-a53f-511ae0a4074d', 'name': 'network-vif-deleted', 'tag': '4479e7ab-f0ee-45ff-a040-76f4dd53237f'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:02.482075 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9242ce1-b0b7-4197-aa0f-2b199ba4af88 req-a6c3adbe-1b82-4066-9fd2-5ad46141920c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:02.483624 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c9242ce1-b0b7-4197-aa0f-2b199ba4af88 req-a6c3adbe-1b82-4066-9fd2-5ad46141920c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ace82e8b-012a-4184-a81e-5303eecf12ff HTTP/1.1" status: 200 len: 855 time: 0.2437108 Dec 09 21:29:02.485375 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-0653c6e5-c4b1-4631-8a2b-6ac3b830c449 service neutron] 10.222.0.10 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4439089 Dec 09 21:29:02.485722 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ec2d4b9a-89a1-4d86-a236-6a20365e419f" -d '{"events": [{"server_uuid": "5c7a3543-1d7f-4fd2-a53f-511ae0a4074d", "name": "network-vif-deleted", "tag": "4479e7ab-f0ee-45ff-a040-76f4dd53237f"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:02.577925 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8c88f6ae-bf70-4948-9159-a4f299471011 x-openstack-request-id: req-8c88f6ae-bf70-4948-9159-a4f299471011 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:02.578573 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5c7a3543-1d7f-4fd2-a53f-511ae0a4074d", "name": "network-vif-deleted", "tag": "4479e7ab-f0ee-45ff-a040-76f4dd53237f", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:02.579043 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8c88f6ae-bf70-4948-9159-a4f299471011 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:02.579679 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5c7a3543-1d7f-4fd2-a53f-511ae0a4074d', 'name': 'network-vif-deleted', 'tag': '4479e7ab-f0ee-45ff-a040-76f4dd53237f', 'status': 'completed', 'code': 200} Dec 09 21:29:02.625558 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-291169f1-2889-46e2-8fd9-ee0b1c52fd6f req-f02bee84-9a9d-44e7-89e8-ba7cc06408cc service neutron] 10.222.0.10 "GET /v2.0/networks/4d446a14-1218-469d-93aa-b4f9babdbb6e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5920336 Dec 09 21:29:02.671097 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d75b9d33-0124-492d-b786-8d3cfd0c429a req-d85fd5b4-38f4-4415-b8a7-396fa7f9c2a9 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2034986 Dec 09 21:29:02.778368 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 12141f96-3d14-4c4d-a043-91223dcefddd details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:29:02.942464 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42286) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:03.038313 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0e9b2c-db7b-4cb8-96e1-5ca9d02fb078 req-410fa760-ab62-4689-8b15-7a3a1ce3d52b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:03.064238 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0e9b2c-db7b-4cb8-96e1-5ca9d02fb078 req-410fa760-ab62-4689-8b15-7a3a1ce3d52b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:03.073399 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 12141f96-3d14-4c4d-a043-91223dcefddd, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=12141f96-3d14-4c4d-a043-91223dcefddd,segment=NetworkSegment(e3c687b5-afac-4ac8-9b38-06599c2a8b7e),segment_id=e3c687b5-afac-4ac8-9b38-06599c2a8b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:03.082325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0e9b2c-db7b-4cb8-96e1-5ca9d02fb078 req-410fa760-ab62-4689-8b15-7a3a1ce3d52b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:03.093894 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '12141f96-3d14-4c4d-a043-91223dcefddd', 'network_id': '4d446a14-1218-469d-93aa-b4f9babdbb6e', 'port_id': '12141f96-3d14-4c4d-a043-91223dcefddd', 'mac_address': 'fa:16:3e:4e:5e:77', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 138, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '75afc53b-d3f3-461c-aba4-c2ce93780246', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:29:03.098344 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-92c54901-dd90-4564-9bdc-c146f489c7e3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:03.104111 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0e9b2c-db7b-4cb8-96e1-5ca9d02fb078 req-410fa760-ab62-4689-8b15-7a3a1ce3d52b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:03.121764 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0e9b2c-db7b-4cb8-96e1-5ca9d02fb078 req-410fa760-ab62-4689-8b15-7a3a1ce3d52b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:03.127825 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-291169f1-2889-46e2-8fd9-ee0b1c52fd6f req-2974c616-d9ef-428d-bffa-ae1f33003963 service neutron] 10.222.0.10 "GET /v2.0/networks/4d446a14-1218-469d-93aa-b4f9babdbb6e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4263613 Dec 09 21:29:03.129612 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-c92db69f-0969-47aa-93a5-fd22e5a84372 service neutron] 10.222.0.10 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6170390 Dec 09 21:29:03.156269 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0e9b2c-db7b-4cb8-96e1-5ca9d02fb078 req-410fa760-ab62-4689-8b15-7a3a1ce3d52b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:03.178710 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0e9b2c-db7b-4cb8-96e1-5ca9d02fb078 req-410fa760-ab62-4689-8b15-7a3a1ce3d52b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:03.185692 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9e0e9b2c-db7b-4cb8-96e1-5ca9d02fb078 req-410fa760-ab62-4689-8b15-7a3a1ce3d52b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5420 time: 0.4297917 Dec 09 21:29:03.192193 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:03.211786 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 12141f96-3d14-4c4d-a043-91223dcefddd {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:03.241627 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 12141f96-3d14-4c4d-a043-91223dcefddd, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=12141f96-3d14-4c4d-a043-91223dcefddd,segment=NetworkSegment(e3c687b5-afac-4ac8-9b38-06599c2a8b7e),segment_id=e3c687b5-afac-4ac8-9b38-06599c2a8b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:03.249901 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-c059a4ee-8b68-4215-b44a-859601dd2387 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=b7cad057-c6e6-483b-9791-e1b1a0dd73ac HTTP/1.1" status: 200 len: 217 time: 0.1078684 Dec 09 21:29:03.252363 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:03.280076 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-121895e4-f1dc-4255-8f02-aa8b2b8287eb tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Allocated IP 10.2.2.100 (ae9d25d5-c9a2-4627-a465-8324b17541d9/2b4dff83-a3e7-4d10-a901-43c21154e5da/f6c2c656-c5c9-4a38-baf6-3924df82937d) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:29:03.320387 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=12141f96-3d14-4c4d-a043-91223dcefddd,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:03.338086 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9242ce1-b0b7-4197-aa0f-2b199ba4af88 req-a8389a6e-c381-4d6b-80d1-45c149823a02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:03.339793 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c9242ce1-b0b7-4197-aa0f-2b199ba4af88 req-a8389a6e-c381-4d6b-80d1-45c149823a02 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.8283613 Dec 09 21:29:03.360784 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-02dcd8f5-b67f-4e3a-9cad-b3ffbd84957a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:03.415908 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-005b890c-99d4-40e0-938d-42f03e1ac263 req-a7787af7-d654-4392-ab75-79bf6fd420f8 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:03.424019 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-005b890c-99d4-40e0-938d-42f03e1ac263 req-a7787af7-d654-4392-ab75-79bf6fd420f8 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=4641e74b-365e-4a0f-9c88-45d8762ec4bf HTTP/1.1" status: 200 len: 944 time: 0.4801652 Dec 09 21:29:03.459914 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['12141f96-3d14-4c4d-a043-91223dcefddd'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:29:03.521748 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-f2218447-dd80-46f5-90d1-dd3ae1ec673e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:03.523293 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-f2218447-dd80-46f5-90d1-dd3ae1ec673e service neutron] 10.222.0.10 "GET /v2.0/subnets?id=753ba647-b0b0-482e-ac28-89c7e6adf654 HTTP/1.1" status: 200 len: 797 time: 0.2605624 Dec 09 21:29:03.642548 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9e0e9b2c-db7b-4cb8-96e1-5ca9d02fb078 req-6b00bca1-da3b-4f5c-ad84-a3f5f528c3d1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.3085611 Dec 09 21:29:03.644119 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c9242ce1-b0b7-4197-aa0f-2b199ba4af88 req-03e26035-56b7-4aca-b7dc-9f5e7cdc03e7 service neutron] 10.222.0.31 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2935910 Dec 09 21:29:03.648476 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7b254b13-044c-4d14-92fc-2167b6c8fe1a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:03.652333 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-7b254b13-044c-4d14-92fc-2167b6c8fe1a service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a133a939-2827-4fe6-81f5-14715631c0ec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1176116 Dec 09 21:29:03.684214 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-005b890c-99d4-40e0-938d-42f03e1ac263 req-8cda66b2-dd71-4811-9f53-36cdcd065f16 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2590158 Dec 09 21:29:03.738946 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-121895e4-f1dc-4255-8f02-aa8b2b8287eb tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:03.822019 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-02dcd8f5-b67f-4e3a-9cad-b3ffbd84957a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:03.834741 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-02dcd8f5-b67f-4e3a-9cad-b3ffbd84957a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:03.862081 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42298) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:03.929481 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c9242ce1-b0b7-4197-aa0f-2b199ba4af88 req-ea4235e1-a75f-4985-a5d1-076f211fc00b service neutron] 10.222.0.31 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2733698 Dec 09 21:29:03.932076 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-34192960-0a7e-46c2-897a-9684302335b4 service neutron] 10.222.0.10 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2721033 Dec 09 21:29:03.964465 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-02dcd8f5-b67f-4e3a-9cad-b3ffbd84957a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=4b4d149fec384c99a600aef6526d4ce2&name=default HTTP/1.1" status: 200 len: 3000 time: 0.9975057 Dec 09 21:29:03.966293 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42300) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:03.971342 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-121895e4-f1dc-4255-8f02-aa8b2b8287eb tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:04.002243 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02dcd8f5-b67f-4e3a-9cad-b3ffbd84957a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=496bb4e8-4eba-4e68-a448-0de267aa46a7,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:04.225584 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ae6ca6c6-7e6c-41fc-bfad-26df3af4de6c req-d899f31e-986b-4af6-9598-5959126c69da service neutron] 10.222.0.10 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2843709 Dec 09 21:29:04.409456 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8e0805a-a8e9-4c97-8713-24f260f81a45 req-38214cea-c171-4637-9381-ca75d941c7ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:04.410294 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8e0805a-a8e9-4c97-8713-24f260f81a45 req-38214cea-c171-4637-9381-ca75d941c7ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:04.410936 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8e0805a-a8e9-4c97-8713-24f260f81a45 req-38214cea-c171-4637-9381-ca75d941c7ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:04.411888 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8e0805a-a8e9-4c97-8713-24f260f81a45 req-38214cea-c171-4637-9381-ca75d941c7ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:04.412160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8e0805a-a8e9-4c97-8713-24f260f81a45 req-38214cea-c171-4637-9381-ca75d941c7ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:04.413331 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8e0805a-a8e9-4c97-8713-24f260f81a45 req-38214cea-c171-4637-9381-ca75d941c7ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:04.414077 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8e0805a-a8e9-4c97-8713-24f260f81a45 req-38214cea-c171-4637-9381-ca75d941c7ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:04.416182 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e8e0805a-a8e9-4c97-8713-24f260f81a45 req-38214cea-c171-4637-9381-ca75d941c7ba service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=03e962eb7f5e4325a7c08c8b1e2a4cea&device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 6484 time: 0.0876131 Dec 09 21:29:04.546540 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8e0805a-a8e9-4c97-8713-24f260f81a45 req-05c6b844-9350-41d8-b90a-339fa1a6f43d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:04.548266 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e8e0805a-a8e9-4c97-8713-24f260f81a45 req-05c6b844-9350-41d8-b90a-339fa1a6f43d service neutron] 10.222.0.10 "GET /v2.0/networks?id=a133a939-2827-4fe6-81f5-14715631c0ec HTTP/1.1" status: 200 len: 903 time: 0.1241660 Dec 09 21:29:04.635101 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-121895e4-f1dc-4255-8f02-aa8b2b8287eb tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Network ae9d25d5-c9a2-4627-a465-8324b17541d9 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:29:04.678799 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-121895e4-f1dc-4255-8f02-aa8b2b8287eb tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:29:04.724079 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-121895e4-f1dc-4255-8f02-aa8b2b8287eb tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event updated for resources: {'Port': ['ID=f6c2c656-c5c9-4a38-baf6-3924df82937d,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:04.741739 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-121895e4-f1dc-4255-8f02-aa8b2b8287eb tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:29:04.802302 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-121895e4-f1dc-4255-8f02-aa8b2b8287eb tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:04.802995 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-121895e4-f1dc-4255-8f02-aa8b2b8287eb tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:04.809187 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 12141f96-3d14-4c4d-a043-91223dcefddd up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:29:04.923227 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 12141f96-3d14-4c4d-a043-91223dcefddd completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:29:04.930899 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 12141f96-3d14-4c4d-a043-91223dcefddd triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:04.931400 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:05.118237 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e8e0805a-a8e9-4c97-8713-24f260f81a45 req-5f8911c7-7fca-475b-82dc-7592d48f7b4b service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=b7cad057-c6e6-483b-9791-e1b1a0dd73ac HTTP/1.1" status: 200 len: 217 time: 0.5619886 Dec 09 21:29:05.125501 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:05.156226 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-121895e4-f1dc-4255-8f02-aa8b2b8287eb tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 4.2176981 Dec 09 21:29:05.173727 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8e0805a-a8e9-4c97-8713-24f260f81a45 req-22d64a86-eb87-4570-a9d9-43b00805b7ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:05.175583 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e8e0805a-a8e9-4c97-8713-24f260f81a45 req-22d64a86-eb87-4570-a9d9-43b00805b7ce service neutron] 10.222.0.10 "GET /v2.0/subnets?id=753ba647-b0b0-482e-ac28-89c7e6adf654 HTTP/1.1" status: 200 len: 797 time: 0.0493014 Dec 09 21:29:05.183755 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-9d302678-e9f7-486f-bbc1-f77969feabc6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Request body: {'port': {'device_id': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'fixed_ips': [{'ip_address': '10.2.2.200'}], 'network_id': 'ae9d25d5-c9a2-4627-a465-8324b17541d9', 'admin_state_up': True, 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'security_groups': ['66e1817f-e10c-4faf-abd8-bc5e8fda7f97']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:05.208307 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4641e74b-365e-4a0f-9c88-45d8762ec4bf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '12141f96-3d14-4c4d-a043-91223dcefddd'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:05.219806 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f69f0de7-a2e8-44d1-8369-f9cee0d264c4" -d '{"events": [{"server_uuid": "4641e74b-365e-4a0f-9c88-45d8762ec4bf", "name": "network-vif-plugged", "status": "completed", "tag": "12141f96-3d14-4c4d-a043-91223dcefddd"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:05.242707 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3973b7f-f342-4965-815a-e8cbe9fb9d8d req-85177334-ffdb-4a84-ac61-93f91ee3d3e8 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:05.250289 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3973b7f-f342-4965-815a-e8cbe9fb9d8d req-85177334-ffdb-4a84-ac61-93f91ee3d3e8 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:05.254332 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8e0805a-a8e9-4c97-8713-24f260f81a45 req-2a7807d5-b9dc-49c8-b417-b8412ebcd95c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:05.256410 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e8e0805a-a8e9-4c97-8713-24f260f81a45 req-2a7807d5-b9dc-49c8-b417-b8412ebcd95c service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a133a939-2827-4fe6-81f5-14715631c0ec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0715754 Dec 09 21:29:05.257119 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3973b7f-f342-4965-815a-e8cbe9fb9d8d req-85177334-ffdb-4a84-ac61-93f91ee3d3e8 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:05.263862 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 12141f96-3d14-4c4d-a043-91223dcefddd, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=12141f96-3d14-4c4d-a043-91223dcefddd,segment=NetworkSegment(e3c687b5-afac-4ac8-9b38-06599c2a8b7e),segment_id=e3c687b5-afac-4ac8-9b38-06599c2a8b7e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:05.265659 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3973b7f-f342-4965-815a-e8cbe9fb9d8d req-85177334-ffdb-4a84-ac61-93f91ee3d3e8 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:05.268474 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a1736ae8-d430-4a9b-b15d-abe7d983ed40 None None] Provisioning complete for port f6c2c656-c5c9-4a38-baf6-3924df82937d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:05.270517 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a1736ae8-d430-4a9b-b15d-abe7d983ed40 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:05.274333 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c3973b7f-f342-4965-815a-e8cbe9fb9d8d req-85177334-ffdb-4a84-ac61-93f91ee3d3e8 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 3095 time: 1.2123771 Dec 09 21:29:05.278768 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:05.281576 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 4479e7ab-f0ee-45ff-a040-76f4dd53237f no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:29:05.301572 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fd48d7a4-5ea3-4bb1-9865-43ebd78926cf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:05.382884 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 4479e7ab-f0ee-45ff-a040-76f4dd53237f {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:29:05.383346 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 4479e7ab-f0ee-45ff-a040-76f4dd53237f not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:29:05.419737 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e8e0805a-a8e9-4c97-8713-24f260f81a45 req-65d1bb9c-70eb-4f67-9384-73178c6d35bb service neutron] 10.222.0.10 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1540511 Dec 09 21:29:05.438511 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a1736ae8-d430-4a9b-b15d-abe7d983ed40 None None] Port f6c2c656-c5c9-4a38-baf6-3924df82937d cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:29:05.452805 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=12141f96-3d14-4c4d-a043-91223dcefddd,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:05.485820 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f369070-12ae-43a2-9b03-81f765ec1de0 req-8eb78128-befb-4404-bd57-32bc7e47a4ed tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:05.491967 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f369070-12ae-43a2-9b03-81f765ec1de0 req-8eb78128-befb-4404-bd57-32bc7e47a4ed tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:05.498226 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f369070-12ae-43a2-9b03-81f765ec1de0 req-8eb78128-befb-4404-bd57-32bc7e47a4ed tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:05.504743 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f369070-12ae-43a2-9b03-81f765ec1de0 req-8eb78128-befb-4404-bd57-32bc7e47a4ed tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:05.510700 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f369070-12ae-43a2-9b03-81f765ec1de0 req-8eb78128-befb-4404-bd57-32bc7e47a4ed tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:05.512073 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e83c6206-7482-493a-8377-1ad7273c9843 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:05.517461 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f369070-12ae-43a2-9b03-81f765ec1de0 req-8eb78128-befb-4404-bd57-32bc7e47a4ed tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:05.523788 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f369070-12ae-43a2-9b03-81f765ec1de0 req-8eb78128-befb-4404-bd57-32bc7e47a4ed tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:05.532670 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f369070-12ae-43a2-9b03-81f765ec1de0 req-8eb78128-befb-4404-bd57-32bc7e47a4ed tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5420 time: 0.4107692 Dec 09 21:29:05.564801 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fd48d7a4-5ea3-4bb1-9865-43ebd78926cf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:05.592549 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e8e0805a-a8e9-4c97-8713-24f260f81a45 req-51137e65-1ed1-4848-94db-bfa8742a5dda service neutron] 10.222.0.10 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1656287 Dec 09 21:29:05.679510 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c3973b7f-f342-4965-815a-e8cbe9fb9d8d req-c542115f-66e9-420d-93c8-2ae2b0ffba4d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4042561 Dec 09 21:29:05.750401 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f369070-12ae-43a2-9b03-81f765ec1de0 req-0a00b68d-67f6-4d38-995c-2952611669a6 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2121568 Dec 09 21:29:05.788347 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-9d302678-e9f7-486f-bbc1-f77969feabc6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Made reservation on behalf of 0a5d0e4652be4d8b87936a559840cc87 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:29:05.797944 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-9d302678-e9f7-486f-bbc1-f77969feabc6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:05.820603 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fd48d7a4-5ea3-4bb1-9865-43ebd78926cf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:05.823477 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fd48d7a4-5ea3-4bb1-9865-43ebd78926cf admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:05.824792 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fd48d7a4-5ea3-4bb1-9865-43ebd78926cf admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/496bb4e8-4eba-4e68-a448-0de267aa46a7 HTTP/1.1" status: 204 len: 168 time: 1.8549573 Dec 09 21:29:05.867396 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd48d7a4-5ea3-4bb1-9865-43ebd78926cf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=496bb4e8-4eba-4e68-a448-0de267aa46a7,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:06.004192 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ce8ee13a-7844-4013-9057-001e330ed8ac x-openstack-request-id: req-ce8ee13a-7844-4013-9057-001e330ed8ac {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:06.004693 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4641e74b-365e-4a0f-9c88-45d8762ec4bf", "name": "network-vif-plugged", "status": "completed", "tag": "12141f96-3d14-4c4d-a043-91223dcefddd", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:06.004939 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-ce8ee13a-7844-4013-9057-001e330ed8ac {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:06.005444 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4641e74b-365e-4a0f-9c88-45d8762ec4bf', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '12141f96-3d14-4c4d-a043-91223dcefddd', 'code': 200} Dec 09 21:29:06.011727 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39a327eb-b878-4972-a33c-6740b4a6e740 req-7006e23b-3ecd-4831-a99e-9e06a8fdebe6 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:06.013320 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-39a327eb-b878-4972-a33c-6740b4a6e740 req-7006e23b-3ecd-4831-a99e-9e06a8fdebe6 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=4641e74b-365e-4a0f-9c88-45d8762ec4bf HTTP/1.1" status: 200 len: 946 time: 0.2100081 Dec 09 21:29:06.182498 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-9d302678-e9f7-486f-bbc1-f77969feabc6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Allocated IP 10.2.2.200 (ae9d25d5-c9a2-4627-a465-8324b17541d9/2b4dff83-a3e7-4d10-a901-43c21154e5da/2c568c8f-47ca-4f47-ab71-187026ca02db) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:29:06.183974 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eae3f491-3df1-40ec-88b8-f0d71a508b3e req-60681aff-4b25-426d-aafb-7c79b1336fb9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:06.189533 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-eae3f491-3df1-40ec-88b8-f0d71a508b3e req-60681aff-4b25-426d-aafb-7c79b1336fb9 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=4641e74b-365e-4a0f-9c88-45d8762ec4bf HTTP/1.1" status: 200 len: 1098 time: 0.1030622 Dec 09 21:29:06.276637 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-eae3f491-3df1-40ec-88b8-f0d71a508b3e req-abd6acbb-6d40-4b8b-af9b-90b488dd2f5c service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0782695 Dec 09 21:29:06.362860 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-39a327eb-b878-4972-a33c-6740b4a6e740 req-4d537e6d-acf1-4539-bfd3-9151c72c0ff5 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3294735 Dec 09 21:29:06.411377 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-26343340-ff39-4676-a1e3-f7a6a6fdffc4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:06.563677 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:06.651257 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-9d302678-e9f7-486f-bbc1-f77969feabc6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:06.720053 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42346) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:06.850190 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-9d302678-e9f7-486f-bbc1-f77969feabc6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:06.998606 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-9d302678-e9f7-486f-bbc1-f77969feabc6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Network ae9d25d5-c9a2-4627-a465-8324b17541d9 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:29:07.047708 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-9d302678-e9f7-486f-bbc1-f77969feabc6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:29:07.072821 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-9d302678-e9f7-486f-bbc1-f77969feabc6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:29:07.188822 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-3d203e21-34bb-4d55-ac91-caf8b28a38a4 admin admin] Deleting subnet 50496955-1646-4079-acd4-a47e8cd175cb {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:29:07.195025 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-9d302678-e9f7-486f-bbc1-f77969feabc6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:07.195846 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-9d302678-e9f7-486f-bbc1-f77969feabc6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:07.203251 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3d203e21-34bb-4d55-ac91-caf8b28a38a4 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:07.313144 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42d2deb3-945d-4d75-ba38-261d86edd65e req-93c724ef-124a-497f-aae2-38e24e285651 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:07.339505 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42d2deb3-945d-4d75-ba38-261d86edd65e req-93c724ef-124a-497f-aae2-38e24e285651 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:07.363800 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3d203e21-34bb-4d55-ac91-caf8b28a38a4 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:07.376807 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42d2deb3-945d-4d75-ba38-261d86edd65e req-93c724ef-124a-497f-aae2-38e24e285651 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:07.397948 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42d2deb3-945d-4d75-ba38-261d86edd65e req-93c724ef-124a-497f-aae2-38e24e285651 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:07.411783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42d2deb3-945d-4d75-ba38-261d86edd65e req-93c724ef-124a-497f-aae2-38e24e285651 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:07.427453 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42d2deb3-945d-4d75-ba38-261d86edd65e req-93c724ef-124a-497f-aae2-38e24e285651 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:07.439805 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42d2deb3-945d-4d75-ba38-261d86edd65e req-93c724ef-124a-497f-aae2-38e24e285651 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:07.449348 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42d2deb3-945d-4d75-ba38-261d86edd65e req-93c724ef-124a-497f-aae2-38e24e285651 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5420 time: 0.5243170 Dec 09 21:29:07.460453 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d302678-e9f7-486f-bbc1-f77969feabc6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event updated for resources: {'Port': ['ID=2c568c8f-47ca-4f47-ab71-187026ca02db,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:07.464566 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3d203e21-34bb-4d55-ac91-caf8b28a38a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:07.483039 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-420bfd2b-4b5f-447a-bc5d-2c0957457da3 None None] Provisioning complete for port 2c568c8f-47ca-4f47-ab71-187026ca02db triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:07.483844 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-420bfd2b-4b5f-447a-bc5d-2c0957457da3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:07.488313 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a647c8c-7122-49c3-8ca7-488456e4c126 req-52b444eb-b52b-4133-8b81-c3b1fced8c74 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:07.494902 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a647c8c-7122-49c3-8ca7-488456e4c126 req-52b444eb-b52b-4133-8b81-c3b1fced8c74 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:07.504432 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a647c8c-7122-49c3-8ca7-488456e4c126 req-52b444eb-b52b-4133-8b81-c3b1fced8c74 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:07.511885 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a647c8c-7122-49c3-8ca7-488456e4c126 req-52b444eb-b52b-4133-8b81-c3b1fced8c74 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:07.527543 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a647c8c-7122-49c3-8ca7-488456e4c126 req-52b444eb-b52b-4133-8b81-c3b1fced8c74 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:07.539948 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a647c8c-7122-49c3-8ca7-488456e4c126 req-52b444eb-b52b-4133-8b81-c3b1fced8c74 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 3816 time: 0.6428666 Dec 09 21:29:07.561035 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-420bfd2b-4b5f-447a-bc5d-2c0957457da3 None None] Port 2c568c8f-47ca-4f47-ab71-187026ca02db cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:29:07.582263 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-9d302678-e9f7-486f-bbc1-f77969feabc6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.4031632 Dec 09 21:29:07.595095 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3d203e21-34bb-4d55-ac91-caf8b28a38a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:07.635477 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-4c7c0387-13b3-45c3-b683-16b3a724d35b service neutron] Request body: {'port': {'device_id': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:07.649561 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d203e21-34bb-4d55-ac91-caf8b28a38a4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=50496955-1646-4079-acd4-a47e8cd175cb,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:07.658037 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3d203e21-34bb-4d55-ac91-caf8b28a38a4 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:07.663850 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3d203e21-34bb-4d55-ac91-caf8b28a38a4 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/50496955-1646-4079-acd4-a47e8cd175cb HTTP/1.1" status: 204 len: 168 time: 0.9402320 Dec 09 21:29:07.668518 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42364) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:07.729570 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42d2deb3-945d-4d75-ba38-261d86edd65e req-d0f082bf-9ae8-4389-8aba-b0c4e27549b1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2793012 Dec 09 21:29:07.864439 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a647c8c-7122-49c3-8ca7-488456e4c126 req-a86f35c3-8003-4190-a3ef-6cb2cc1d4516 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3191047 Dec 09 21:29:07.900945 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:07.910903 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-4c7c0387-13b3-45c3-b683-16b3a724d35b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:07.981048 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60755b82-312b-4ff0-86d5-155634d68d8b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:08.019173 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-26343340-ff39-4676-a1e3-f7a6a6fdffc4 admin admin] Deleting port d68b58cd-3f98-4aa6-8259-efea961feb0a {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:29:08.019811 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-26343340-ff39-4676-a1e3-f7a6a6fdffc4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:08.278808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03ee66c2-0d8e-4ff6-91b6-3307ac62ff21 req-044333cf-0083-43e6-ba9e-b7dfb7aa1ec9 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:08.286581 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-03ee66c2-0d8e-4ff6-91b6-3307ac62ff21 req-044333cf-0083-43e6-ba9e-b7dfb7aa1ec9 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=4641e74b-365e-4a0f-9c88-45d8762ec4bf HTTP/1.1" status: 200 len: 946 time: 0.2807093 Dec 09 21:29:08.345267 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60755b82-312b-4ff0-86d5-155634d68d8b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:08.426489 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-60755b82-312b-4ff0-86d5-155634d68d8b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:08.448653 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-60755b82-312b-4ff0-86d5-155634d68d8b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd383c8e8-889c-4799-8949-cba737586b7e') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:08.450502 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-60755b82-312b-4ff0-86d5-155634d68d8b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd383c8e8-889c-4799-8949-cba737586b7e') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:08.475376 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60755b82-312b-4ff0-86d5-155634d68d8b admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:08.527652 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-03ee66c2-0d8e-4ff6-91b6-3307ac62ff21 req-83a49a91-920a-420c-ba18-ababf2168a2c tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2401483 Dec 09 21:29:08.530657 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-26343340-ff39-4676-a1e3-f7a6a6fdffc4 admin admin] For port d68b58cd-3f98-4aa6-8259-efea961feb0a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d68b58cd-3f98-4aa6-8259-efea961feb0a,segment=NetworkSegment(6bb6d7a7-737b-46b2-b463-0bc25081f6ef),segment_id=6bb6d7a7-737b-46b2-b463-0bc25081f6ef)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:08.531037 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-26343340-ff39-4676-a1e3-f7a6a6fdffc4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:08.582541 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60755b82-312b-4ff0-86d5-155634d68d8b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:08.615525 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-26343340-ff39-4676-a1e3-f7a6a6fdffc4 admin admin] Calling delete_port for d68b58cd-3f98-4aa6-8259-efea961feb0a owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:29:08.623833 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50e2fc6c-2ece-41c3-ab31-efa94dd5fd0e req-a80bc0c5-1805-4952-a478-c2b5b37810d1 tempest-AbsoluteLimitsNegativeTestJSON-534879752 tempest-AbsoluteLimitsNegativeTestJSON-534879752-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=50c91e1902da4738bd3bd1f8e87773a6&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1055632 Dec 09 21:29:08.627234 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-60755b82-312b-4ff0-86d5-155634d68d8b admin admin] Releasing vlan 101 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:29:08.627694 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60755b82-312b-4ff0-86d5-155634d68d8b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:29:08.631711 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:29:08.843886 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60755b82-312b-4ff0-86d5-155634d68d8b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:09.235087 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60755b82-312b-4ff0-86d5-155634d68d8b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:09.238451 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-60755b82-312b-4ff0-86d5-155634d68d8b admin admin] 10.222.0.13 "DELETE /v2.0/networks/43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb HTTP/1.1" status: 204 len: 168 time: 1.5248480 Dec 09 21:29:09.242832 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60755b82-312b-4ff0-86d5-155634d68d8b admin admin] Pushing event deleted for resources: {'Network': ['ID=43fdda59-0e6a-48c1-b34f-1e39ec5d4dfb,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:09.290175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27019a30-17fa-4193-a4f5-85bfb9a2aad4 req-07827fbd-9472-4d64-8df7-2baf5c05e328 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:09.291772 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27019a30-17fa-4193-a4f5-85bfb9a2aad4 req-07827fbd-9472-4d64-8df7-2baf5c05e328 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=4641e74b-365e-4a0f-9c88-45d8762ec4bf HTTP/1.1" status: 200 len: 946 time: 0.6313970 Dec 09 21:29:09.414142 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50e2fc6c-2ece-41c3-ab31-efa94dd5fd0e req-d1a507aa-ce59-45f2-986e-449e7e1f0e1e tempest-AbsoluteLimitsNegativeTestJSON-534879752 tempest-AbsoluteLimitsNegativeTestJSON-534879752-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:09.421071 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50e2fc6c-2ece-41c3-ab31-efa94dd5fd0e req-d1a507aa-ce59-45f2-986e-449e7e1f0e1e tempest-AbsoluteLimitsNegativeTestJSON-534879752 tempest-AbsoluteLimitsNegativeTestJSON-534879752-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.7715552 Dec 09 21:29:09.463865 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50e2fc6c-2ece-41c3-ab31-efa94dd5fd0e req-bd4efc7e-6fd8-48f8-93f7-5fc1d5c088f1 tempest-AbsoluteLimitsNegativeTestJSON-534879752 tempest-AbsoluteLimitsNegativeTestJSON-534879752-project] 10.222.0.13 "GET /v2.0/quotas/50c91e1902da4738bd3bd1f8e87773a6 HTTP/1.1" status: 200 len: 375 time: 0.0416322 Dec 09 21:29:09.467772 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-4c7c0387-13b3-45c3-b683-16b3a724d35b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:09.479907 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42394) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:09.498332 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-4c7c0387-13b3-45c3-b683-16b3a724d35b service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:09.506118 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27019a30-17fa-4193-a4f5-85bfb9a2aad4 req-1b3d4d7c-3df0-4c26-a3d6-1c6e77a63722 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1755900 Dec 09 21:29:09.545132 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50e2fc6c-2ece-41c3-ab31-efa94dd5fd0e req-8fc50150-40ca-4daa-b76d-0b639daad6a6 tempest-AbsoluteLimitsNegativeTestJSON-534879752 tempest-AbsoluteLimitsNegativeTestJSON-534879752-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=50c91e1902da4738bd3bd1f8e87773a6&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0789206 Dec 09 21:29:09.548002 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3b318abc-07fe-46ca-828b-85a50cc879d5 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=1b7916b634f74760a565cfeaef510cd9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0659459 Dec 09 21:29:09.550046 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42398) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:09.577701 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-4c7c0387-13b3-45c3-b683-16b3a724d35b service neutron] Transition to ACTIVE for port object 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:29:09.587163 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:09.622350 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d246ead-b2f9-42da-b3b1-685e104f7e75 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:09.634182 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-4c7c0387-13b3-45c3-b683-16b3a724d35b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:09.681331 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d246ead-b2f9-42da-b3b1-685e104f7e75 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:09.742498 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c7c0387-13b3-45c3-b683-16b3a724d35b service neutron] Pushing event updated for resources: {'Port': ['ID=7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:09.759377 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d246ead-b2f9-42da-b3b1-685e104f7e75 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:09.771257 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d246ead-b2f9-42da-b3b1-685e104f7e75 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:09.775027 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4d246ead-b2f9-42da-b3b1-685e104f7e75 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/d2724709-ec49-467a-ab5e-5283cd267185 HTTP/1.1" status: 204 len: 168 time: 0.2213922 Dec 09 21:29:09.801447 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d246ead-b2f9-42da-b3b1-685e104f7e75 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d2724709-ec49-467a-ab5e-5283cd267185,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:09.822462 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7a68e45-9dce-4535-a454-53be5f8fcea1 req-e0ed6759-d5af-4f06-a063-a0d0d514475c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:09.830750 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7a68e45-9dce-4535-a454-53be5f8fcea1 req-e0ed6759-d5af-4f06-a063-a0d0d514475c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:09.842787 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7a68e45-9dce-4535-a454-53be5f8fcea1 req-e0ed6759-d5af-4f06-a063-a0d0d514475c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:09.856662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7a68e45-9dce-4535-a454-53be5f8fcea1 req-e0ed6759-d5af-4f06-a063-a0d0d514475c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:09.876082 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7a68e45-9dce-4535-a454-53be5f8fcea1 req-e0ed6759-d5af-4f06-a063-a0d0d514475c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:09.886571 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7a68e45-9dce-4535-a454-53be5f8fcea1 req-e0ed6759-d5af-4f06-a063-a0d0d514475c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:09.897330 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7a68e45-9dce-4535-a454-53be5f8fcea1 req-e0ed6759-d5af-4f06-a063-a0d0d514475c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:09.905558 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7a68e45-9dce-4535-a454-53be5f8fcea1 req-e0ed6759-d5af-4f06-a063-a0d0d514475c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5420 time: 0.2749767 Dec 09 21:29:09.964282 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-26343340-ff39-4676-a1e3-f7a6a6fdffc4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:10.053828 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3bf60023-9dbe-4e2a-8496-170895f71026 req-664b03db-bcea-4c9b-8122-8e53a1834e87 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=4641e74b-365e-4a0f-9c88-45d8762ec4bf&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1450253 Dec 09 21:29:10.061294 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26343340-ff39-4676-a1e3-f7a6a6fdffc4 admin admin] Pushing event deleted for resources: {'Port': ['ID=d68b58cd-3f98-4aa6-8259-efea961feb0a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:10.154911 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7a68e45-9dce-4535-a454-53be5f8fcea1 req-2adcd1b8-cf35-41e8-9128-28fe18cafaab tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2483475 Dec 09 21:29:10.216034 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81802942-9f75-46f3-a853-b9ceeeaf851a req-0386a105-a4ec-4ae1-9d97-74b6f657273c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:10.231191 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bf60023-9dbe-4e2a-8496-170895f71026 req-a51f9c2c-3018-48c9-be98-cf92d1a6e064 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:10.235122 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3bf60023-9dbe-4e2a-8496-170895f71026 req-a51f9c2c-3018-48c9-be98-cf92d1a6e064 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=18e7af94d60344a18dedc56eda040c4b&device_id=4641e74b-365e-4a0f-9c88-45d8762ec4bf HTTP/1.1" status: 200 len: 1098 time: 0.1143305 Dec 09 21:29:10.240995 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81802942-9f75-46f3-a853-b9ceeeaf851a req-0386a105-a4ec-4ae1-9d97-74b6f657273c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:10.253838 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81802942-9f75-46f3-a853-b9ceeeaf851a req-0386a105-a4ec-4ae1-9d97-74b6f657273c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:10.259864 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42408) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:10.276316 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81802942-9f75-46f3-a853-b9ceeeaf851a req-0386a105-a4ec-4ae1-9d97-74b6f657273c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:10.310060 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81802942-9f75-46f3-a853-b9ceeeaf851a req-0386a105-a4ec-4ae1-9d97-74b6f657273c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:10.316729 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-81802942-9f75-46f3-a853-b9ceeeaf851a req-0386a105-a4ec-4ae1-9d97-74b6f657273c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 3828 time: 0.3869300 Dec 09 21:29:10.373502 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-4c7c0387-13b3-45c3-b683-16b3a724d35b service neutron] Attempting to bind port 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:29:10.374185 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-4c7c0387-13b3-45c3-b683-16b3a724d35b service neutron] Attempting to bind port 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '7cf32f95-b9ab-465b-889c-7d7de3246a6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:29:10.374509 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-4c7c0387-13b3-45c3-b683-16b3a724d35b service neutron] Attempting to bind port 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a on network 361619eb-51a4-4728-b2cc-72e27ec4eca5 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:10.409223 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-4c7c0387-13b3-45c3-b683-16b3a724d35b service neutron] Port 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a on network 361619eb-51a4-4728-b2cc-72e27ec4eca5 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:29:10.409803 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-4c7c0387-13b3-45c3-b683-16b3a724d35b service neutron] Attempting to bind port 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a on network 361619eb-51a4-4728-b2cc-72e27ec4eca5 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:10.416806 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bf60023-9dbe-4e2a-8496-170895f71026 req-066aab66-222f-4793-b738-c5f57434c8c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:10.430609 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3bf60023-9dbe-4e2a-8496-170895f71026 req-066aab66-222f-4793-b738-c5f57434c8c8 service neutron] 10.222.0.10 "GET /v2.0/networks?id=4d446a14-1218-469d-93aa-b4f9babdbb6e HTTP/1.1" status: 200 len: 916 time: 0.1516643 Dec 09 21:29:10.500572 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-81802942-9f75-46f3-a853-b9ceeeaf851a req-221caa6b-5c17-4f5a-bc5a-589a4c8afe6b tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1514471 Dec 09 21:29:10.506030 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3bf60023-9dbe-4e2a-8496-170895f71026 req-8d269abb-7e46-428b-bd3b-d7d9b22b1059 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=12141f96-3d14-4c4d-a043-91223dcefddd HTTP/1.1" status: 200 len: 217 time: 0.0681195 Dec 09 21:29:10.507582 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a8b3541-0c09-467d-8ef3-633fa834cd83 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:10.528467 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-4c7c0387-13b3-45c3-b683-16b3a724d35b service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:29:10.529840 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-4c7c0387-13b3-45c3-b683-16b3a724d35b service neutron] Checking segment: {'id': '7cf32f95-b9ab-465b-889c-7d7de3246a6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:29:10.530444 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-4c7c0387-13b3-45c3-b683-16b3a724d35b service neutron] Bound using segment: {'id': '7cf32f95-b9ab-465b-889c-7d7de3246a6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:29:10.531098 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-4c7c0387-13b3-45c3-b683-16b3a724d35b service neutron] Bound port: 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7cf32f95-b9ab-465b-889c-7d7de3246a6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:29:10.531817 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-4c7c0387-13b3-45c3-b683-16b3a724d35b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:10.607715 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bf60023-9dbe-4e2a-8496-170895f71026 req-26cb10f0-842b-4866-a89a-1ee9712007a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:10.609280 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3bf60023-9dbe-4e2a-8496-170895f71026 req-26cb10f0-842b-4866-a89a-1ee9712007a5 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=75afc53b-d3f3-461c-aba4-c2ce93780246 HTTP/1.1" status: 200 len: 855 time: 0.0798728 Dec 09 21:29:10.652951 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3bf60023-9dbe-4e2a-8496-170895f71026 req-0bc1bd0c-ed7b-46a0-9beb-f81e961d5eb8 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=4d446a14-1218-469d-93aa-b4f9babdbb6e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0345960 Dec 09 21:29:10.714354 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dd917db-f586-41fd-83de-3b4a0b7b8fbe req-d9dd8a27-e1bc-4f82-9f21-47b1e56de68d tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:10.715981 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8dd917db-f586-41fd-83de-3b4a0b7b8fbe req-d9dd8a27-e1bc-4f82-9f21-47b1e56de68d tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=4641e74b-365e-4a0f-9c88-45d8762ec4bf HTTP/1.1" status: 200 len: 946 time: 0.2002249 Dec 09 21:29:10.806781 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-4c7c0387-13b3-45c3-b683-16b3a724d35b service neutron] For port 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:29:10.810639 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-4c7c0387-13b3-45c3-b683-16b3a724d35b service neutron] For port 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a,segment=NetworkSegment(7cf32f95-b9ab-465b-889c-7d7de3246a6f),segment_id=7cf32f95-b9ab-465b-889c-7d7de3246a6f)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:29:10.812487 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-26343340-ff39-4676-a1e3-f7a6a6fdffc4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:10.832838 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a8b3541-0c09-467d-8ef3-633fa834cd83 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:10.861777 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8dd917db-f586-41fd-83de-3b4a0b7b8fbe req-e2c733b8-1351-495a-a46d-97cb6c7549b5 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1289978 Dec 09 21:29:10.871133 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-4c7c0387-13b3-45c3-b683-16b3a724d35b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:10.878447 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a8b3541-0c09-467d-8ef3-633fa834cd83 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:10.920318 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7a8b3541-0c09-467d-8ef3-633fa834cd83 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=50c91e1902da4738bd3bd1f8e87773a6&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6590197 Dec 09 21:29:10.926583 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42430) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:10.989969 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-4c7c0387-13b3-45c3-b683-16b3a724d35b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:10.990593 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-4c7c0387-13b3-45c3-b683-16b3a724d35b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:10.992027 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-4c7c0387-13b3-45c3-b683-16b3a724d35b service neutron] 10.222.0.10 "PUT /v2.0/ports/7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a HTTP/1.1" status: 200 len: 1093 time: 3.3830652 Dec 09 21:29:10.992487 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'tag': '7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:10.994779 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4b5d4964-9731-4a25-9795-2d03d1d9f5e5" -d '{"events": [{"name": "network-changed", "server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "tag": "7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:11.007868 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3bf60023-9dbe-4e2a-8496-170895f71026 req-86a53d61-8793-4c60-bbd3-10400fde7253 service neutron] 10.222.0.10 "GET /v2.0/networks/4d446a14-1218-469d-93aa-b4f9babdbb6e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3469827 Dec 09 21:29:11.012950 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a8b3541-0c09-467d-8ef3-633fa834cd83 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=df3ba2df-b49e-4a81-9f12-d927406f0e76,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:11.119086 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-28836cdf-ba3f-4542-8bce-0f8a00c65fbd x-openstack-request-id: req-28836cdf-ba3f-4542-8bce-0f8a00c65fbd {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:11.119380 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "tag": "7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:11.119662 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-28836cdf-ba3f-4542-8bce-0f8a00c65fbd {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:11.120068 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'tag': '7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a', 'status': 'completed', 'code': 200} Dec 09 21:29:11.137326 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-ae8bd4ba-d1b8-4d11-9d1d-bad99c15ee91 service neutron] Request body: {'port': {'device_id': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:11.185463 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a6771cb-0a21-449f-a0fb-9cc24618a39e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:11.254338 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c7c0387-13b3-45c3-b683-16b3a724d35b service neutron] Pushing event updated for resources: {'Port': ['ID=7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:11.257492 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a6771cb-0a21-449f-a0fb-9cc24618a39e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:11.314949 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-ae8bd4ba-d1b8-4d11-9d1d-bad99c15ee91 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:11.398291 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a6771cb-0a21-449f-a0fb-9cc24618a39e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:11.400700 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a6771cb-0a21-449f-a0fb-9cc24618a39e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:11.402305 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7a6771cb-0a21-449f-a0fb-9cc24618a39e admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/df3ba2df-b49e-4a81-9f12-d927406f0e76 HTTP/1.1" status: 204 len: 168 time: 0.4682367 Dec 09 21:29:11.411419 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68259aea-5732-4669-97d5-6fdc12f28daf req-e60505ef-9c6c-482e-bdf4-46d601dc4aa9 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:11.419794 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-68259aea-5732-4669-97d5-6fdc12f28daf req-e60505ef-9c6c-482e-bdf4-46d601dc4aa9 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=4641e74b-365e-4a0f-9c88-45d8762ec4bf HTTP/1.1" status: 200 len: 946 time: 0.3023386 Dec 09 21:29:11.469829 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42446) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:11.476624 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a6771cb-0a21-449f-a0fb-9cc24618a39e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=df3ba2df-b49e-4a81-9f12-d927406f0e76,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:11.504214 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b5d4964-9731-4a25-9795-2d03d1d9f5e5 req-ddd7293b-80e0-4b20-a010-372d04e48538 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:11.504706 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b5d4964-9731-4a25-9795-2d03d1d9f5e5 req-ddd7293b-80e0-4b20-a010-372d04e48538 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:11.505180 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b5d4964-9731-4a25-9795-2d03d1d9f5e5 req-ddd7293b-80e0-4b20-a010-372d04e48538 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:11.505646 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b5d4964-9731-4a25-9795-2d03d1d9f5e5 req-ddd7293b-80e0-4b20-a010-372d04e48538 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:11.506111 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b5d4964-9731-4a25-9795-2d03d1d9f5e5 req-ddd7293b-80e0-4b20-a010-372d04e48538 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:11.507963 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4b5d4964-9731-4a25-9795-2d03d1d9f5e5 req-ddd7293b-80e0-4b20-a010-372d04e48538 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0a5d0e4652be4d8b87936a559840cc87&device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 4364 time: 0.3862371 Dec 09 21:29:11.632820 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b5d4964-9731-4a25-9795-2d03d1d9f5e5 req-3d42db9d-0dde-4b2a-9ab3-2d137e5828f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:11.633295 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b5d4964-9731-4a25-9795-2d03d1d9f5e5 req-3d42db9d-0dde-4b2a-9ab3-2d137e5828f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:11.633760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b5d4964-9731-4a25-9795-2d03d1d9f5e5 req-3d42db9d-0dde-4b2a-9ab3-2d137e5828f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:11.635950 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4b5d4964-9731-4a25-9795-2d03d1d9f5e5 req-3d42db9d-0dde-4b2a-9ab3-2d137e5828f0 service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=0a5d0e4652be4d8b87936a559840cc87&shared=False HTTP/1.1" status: 200 len: 2296 time: 0.1160543 Dec 09 21:29:11.663570 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-68259aea-5732-4669-97d5-6fdc12f28daf req-efa1b8a7-c23a-4362-a383-f85625d04238 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2404103 Dec 09 21:29:11.668351 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3bf60023-9dbe-4e2a-8496-170895f71026 req-d69211e1-13ca-44eb-a59f-cd1e6a43d3e9 service neutron] 10.222.0.10 "GET /v2.0/networks/4d446a14-1218-469d-93aa-b4f9babdbb6e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6434801 Dec 09 21:29:11.802178 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-93626a21-85cb-4ac9-96e7-8ded3de1a8fc admin admin] Request body: {'network': {'name': 'tempest-InstanceActionsV221TestJSON-342356969-network', 'tenant_id': 'e9159c237df04f09a82d1c2eee1f573e'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:11.831271 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b5d4964-9731-4a25-9795-2d03d1d9f5e5 req-b9bb28b4-5de1-4aee-999e-1468624766a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:11.832954 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4b5d4964-9731-4a25-9795-2d03d1d9f5e5 req-b9bb28b4-5de1-4aee-999e-1468624766a5 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1879323 Dec 09 21:29:11.897783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd83eb9b-5ce0-4d75-bc6a-7daaee98fc2d req-b9f88fc4-9a8b-406c-9448-bbcfefef4b2d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:11.904250 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd83eb9b-5ce0-4d75-bc6a-7daaee98fc2d req-b9f88fc4-9a8b-406c-9448-bbcfefef4b2d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:11.910916 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd83eb9b-5ce0-4d75-bc6a-7daaee98fc2d req-b9f88fc4-9a8b-406c-9448-bbcfefef4b2d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:11.916973 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd83eb9b-5ce0-4d75-bc6a-7daaee98fc2d req-b9f88fc4-9a8b-406c-9448-bbcfefef4b2d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:11.923822 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd83eb9b-5ce0-4d75-bc6a-7daaee98fc2d req-b9f88fc4-9a8b-406c-9448-bbcfefef4b2d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:11.929966 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd83eb9b-5ce0-4d75-bc6a-7daaee98fc2d req-b9f88fc4-9a8b-406c-9448-bbcfefef4b2d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:11.936634 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd83eb9b-5ce0-4d75-bc6a-7daaee98fc2d req-b9f88fc4-9a8b-406c-9448-bbcfefef4b2d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:11.938078 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dd83eb9b-5ce0-4d75-bc6a-7daaee98fc2d req-b9f88fc4-9a8b-406c-9448-bbcfefef4b2d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5420 time: 0.6079376 Dec 09 21:29:12.066342 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-26343340-ff39-4676-a1e3-f7a6a6fdffc4 admin admin] Router 59853428-6655-4e5e-b7d8-ac85e7e3f2b4 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:29:12.072082 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-93626a21-85cb-4ac9-96e7-8ded3de1a8fc admin admin] Made reservation on behalf of e9159c237df04f09a82d1c2eee1f573e for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:29:12.074585 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-93626a21-85cb-4ac9-96e7-8ded3de1a8fc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:12.119329 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfef22c4-3c18-4a77-b20a-40698395c6e2 req-ba4a3add-fb58-4110-ae39-6eef193ef50f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:12.125969 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfef22c4-3c18-4a77-b20a-40698395c6e2 req-ba4a3add-fb58-4110-ae39-6eef193ef50f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:12.132986 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfef22c4-3c18-4a77-b20a-40698395c6e2 req-ba4a3add-fb58-4110-ae39-6eef193ef50f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:12.139706 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfef22c4-3c18-4a77-b20a-40698395c6e2 req-ba4a3add-fb58-4110-ae39-6eef193ef50f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:12.145758 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfef22c4-3c18-4a77-b20a-40698395c6e2 req-ba4a3add-fb58-4110-ae39-6eef193ef50f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:12.148025 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cfef22c4-3c18-4a77-b20a-40698395c6e2 req-ba4a3add-fb58-4110-ae39-6eef193ef50f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 3828 time: 0.3357894 Dec 09 21:29:12.154673 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-93626a21-85cb-4ac9-96e7-8ded3de1a8fc admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:12.358287 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dd83eb9b-5ce0-4d75-bc6a-7daaee98fc2d req-adeb26a7-be3d-4fbc-a3e7-06f755d8c53d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.4097893 Dec 09 21:29:12.416837 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-26343340-ff39-4676-a1e3-f7a6a6fdffc4 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:29:12.431240 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83df7066-b122-45c5-a177-cb6b35fead94 None None] Sync routers for ids ['59853428-6655-4e5e-b7d8-ac85e7e3f2b4'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:29:12.431820 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-26343340-ff39-4676-a1e3-f7a6a6fdffc4 admin admin] 10.222.0.13 "PUT /v2.0/routers/59853428-6655-4e5e-b7d8-ac85e7e3f2b4/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 8.5562871 Dec 09 21:29:12.431939 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42472) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:12.453723 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cfef22c4-3c18-4a77-b20a-40698395c6e2 req-421c526c-0f46-4e36-9ca2-9a2accc34bf6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2936907 Dec 09 21:29:12.468940 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83df7066-b122-45c5-a177-cb6b35fead94 None None] Routers {'59853428-6655-4e5e-b7d8-ac85e7e3f2b4'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:29:12.469668 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-83df7066-b122-45c5-a177-cb6b35fead94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:29:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['59853428-6655-4e5e-b7d8-ac85e7e3f2b4'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:12.569218 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-ae8bd4ba-d1b8-4d11-9d1d-bad99c15ee91 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 18d9d7fa-fedf-4844-90ef-6757eb984ae2 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:12.594822 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-ae8bd4ba-d1b8-4d11-9d1d-bad99c15ee91 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:12.640182 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-93626a21-85cb-4ac9-96e7-8ded3de1a8fc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:12.658483 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-ae8bd4ba-d1b8-4d11-9d1d-bad99c15ee91 service neutron] Transition to ACTIVE for port object 18d9d7fa-fedf-4844-90ef-6757eb984ae2 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:29:12.659429 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-93626a21-85cb-4ac9-96e7-8ded3de1a8fc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:12.677847 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-83df7066-b122-45c5-a177-cb6b35fead94 None None] Set router 59853428-6655-4e5e-b7d8-ac85e7e3f2b4 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:29:12.682854 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-ae8bd4ba-d1b8-4d11-9d1d-bad99c15ee91 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:12.683419 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-06eb7df4-71c7-4b6b-861a-8b1a96cbecef admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:12.712962 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-93626a21-85cb-4ac9-96e7-8ded3de1a8fc admin admin] vlan segment allocate from pool success with {'vlan_id': 111, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:29:12.823750 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-93626a21-85cb-4ac9-96e7-8ded3de1a8fc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:12.825610 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-93626a21-85cb-4ac9-96e7-8ded3de1a8fc admin admin] Added segment 156677c4-8e58-420b-a3a1-7c1c07b52a7d of type vlan for network 2700a60c-f75d-4026-8ff3-5e6bb9394ac1 Dec 09 21:29:12.831739 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93626a21-85cb-4ac9-96e7-8ded3de1a8fc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=872108a7-5ae2-4b16-8e57-f5d879884a6d,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:12.863996 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42480) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:12.893931 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-06eb7df4-71c7-4b6b-861a-8b1a96cbecef admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:12.916390 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-93626a21-85cb-4ac9-96e7-8ded3de1a8fc admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:12.959656 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae8bd4ba-d1b8-4d11-9d1d-bad99c15ee91 service neutron] Pushing event updated for resources: {'Port': ['ID=18d9d7fa-fedf-4844-90ef-6757eb984ae2,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:12.989822 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-93626a21-85cb-4ac9-96e7-8ded3de1a8fc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:12.993327 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-93626a21-85cb-4ac9-96e7-8ded3de1a8fc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:12.994008 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-93626a21-85cb-4ac9-96e7-8ded3de1a8fc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:13.010233 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-06eb7df4-71c7-4b6b-861a-8b1a96cbecef admin admin] Deleting port 7e38e03d-c1aa-4113-b1bd-d91131f610c5 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:29:13.011210 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-06eb7df4-71c7-4b6b-861a-8b1a96cbecef admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:13.132764 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-83df7066-b122-45c5-a177-cb6b35fead94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '59853428-6655-4e5e-b7d8-ac85e7e3f2b4', 'name': 'tempest-ServerRescueTestJSON-1978792040-router', 'tenant_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44'}], 'enable_snat': True}, 'gw_port_id': '7e38e03d-c1aa-4113-b1bd-d91131f610c5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:26:39Z', 'updated_at': '2021-12-09T21:29:09Z', 'revision_number': 5, 'project_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'gw_port': {'id': '7e38e03d-c1aa-4113-b1bd-d91131f610c5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:e8:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '59853428-6655-4e5e-b7d8-ac85e7e3f2b4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1046, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:26:40Z', 'updated_at': '2021-12-09T21:26:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:13.162001 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-bfcea64a-4bed-4590-8e25-e46d08ea5aa1 admin admin] Request body: {'network': {'name': 'tempest-ListServersNegativeTestJSON-1282374147-network', 'tenant_id': '6757323541bb47f99775de3a0132216b'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:13.194175 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83df7066-b122-45c5-a177-cb6b35fead94 None None] Checking router: 59853428-6655-4e5e-b7d8-ac85e7e3f2b4 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:29:13.209759 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83df7066-b122-45c5-a177-cb6b35fead94 None None] Routers {'59853428-6655-4e5e-b7d8-ac85e7e3f2b4'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:29:13.210742 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-83df7066-b122-45c5-a177-cb6b35fead94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:29:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['59853428-6655-4e5e-b7d8-ac85e7e3f2b4'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:13.212047 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bfcea64a-4bed-4590-8e25-e46d08ea5aa1 admin admin] Made reservation on behalf of 6757323541bb47f99775de3a0132216b for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:29:13.214490 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bfcea64a-4bed-4590-8e25-e46d08ea5aa1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:13.226633 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bfcea64a-4bed-4590-8e25-e46d08ea5aa1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:13.241928 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-06eb7df4-71c7-4b6b-861a-8b1a96cbecef admin admin] For port 7e38e03d-c1aa-4113-b1bd-d91131f610c5, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7e38e03d-c1aa-4113-b1bd-d91131f610c5,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:13.242276 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-06eb7df4-71c7-4b6b-861a-8b1a96cbecef admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:13.278589 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54938ff2-a700-4515-afa5-d9e9bcb770c7 req-ee4bee2e-0392-48a3-88e1-75d4bbb4d155 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:13.292662 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-54938ff2-a700-4515-afa5-d9e9bcb770c7 req-ee4bee2e-0392-48a3-88e1-75d4bbb4d155 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=4641e74b-365e-4a0f-9c88-45d8762ec4bf HTTP/1.1" status: 200 len: 946 time: 0.6024773 Dec 09 21:29:13.341402 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bfcea64a-4bed-4590-8e25-e46d08ea5aa1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:13.347677 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93626a21-85cb-4ac9-96e7-8ded3de1a8fc admin admin] Pushing event updated for resources: {'Network': ['ID=2700a60c-f75d-4026-8ff3-5e6bb9394ac1,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:13.359143 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bfcea64a-4bed-4590-8e25-e46d08ea5aa1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:13.372164 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-06eb7df4-71c7-4b6b-861a-8b1a96cbecef admin admin] Calling delete_port for 7e38e03d-c1aa-4113-b1bd-d91131f610c5 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:29:13.417976 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-ae8bd4ba-d1b8-4d11-9d1d-bad99c15ee91 service neutron] Attempting to bind port 18d9d7fa-fedf-4844-90ef-6757eb984ae2 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:29:13.418605 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-ae8bd4ba-d1b8-4d11-9d1d-bad99c15ee91 service neutron] Attempting to bind port 18d9d7fa-fedf-4844-90ef-6757eb984ae2 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '06cdf949-c592-4827-b617-66043758d462', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:29:13.418605 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-ae8bd4ba-d1b8-4d11-9d1d-bad99c15ee91 service neutron] Attempting to bind port 18d9d7fa-fedf-4844-90ef-6757eb984ae2 on network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:13.419960 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bfcea64a-4bed-4590-8e25-e46d08ea5aa1 admin admin] vlan segment allocate from pool success with {'vlan_id': 105, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:29:13.458179 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-93626a21-85cb-4ac9-96e7-8ded3de1a8fc admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 1.9631562 Dec 09 21:29:13.458462 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42496) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:13.475058 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-681929cd-0f27-458e-9dde-40d1e4656222 admin admin] Request body: {'subnet': {'network_id': '2700a60c-f75d-4026-8ff3-5e6bb9394ac1', 'cidr': '172.20.0.0/28', 'name': 'tempest-InstanceActionsV221TestJSON-342356969-subnet', 'tenant_id': 'e9159c237df04f09a82d1c2eee1f573e', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:13.505546 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-54938ff2-a700-4515-afa5-d9e9bcb770c7 req-eeda448e-f537-4e40-a620-1e1611712c86 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2091048 Dec 09 21:29:13.558631 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 2700a60c-f75d-4026-8ff3-5e6bb9394ac1 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:29:13.587164 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfcea64a-4bed-4590-8e25-e46d08ea5aa1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=09be3411-a85c-42e3-aaf7-829301eec3de,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:13.587768 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-ae8bd4ba-d1b8-4d11-9d1d-bad99c15ee91 service neutron] Port 18d9d7fa-fedf-4844-90ef-6757eb984ae2 on network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:29:13.588971 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-ae8bd4ba-d1b8-4d11-9d1d-bad99c15ee91 service neutron] Attempting to bind port 18d9d7fa-fedf-4844-90ef-6757eb984ae2 on network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:13.590508 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bfcea64a-4bed-4590-8e25-e46d08ea5aa1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:13.590707 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-bfcea64a-4bed-4590-8e25-e46d08ea5aa1 admin admin] Added segment 4944fe1d-3354-4e33-b6be-75c5cb26e73d of type vlan for network 0bcede63-0fdd-4d40-8c5c-4890fec5dc38 Dec 09 21:29:13.593997 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-681929cd-0f27-458e-9dde-40d1e4656222 admin admin] Made reservation on behalf of e9159c237df04f09a82d1c2eee1f573e for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:29:13.596302 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-681929cd-0f27-458e-9dde-40d1e4656222 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:13.616349 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-ae8bd4ba-d1b8-4d11-9d1d-bad99c15ee91 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:29:13.616711 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-ae8bd4ba-d1b8-4d11-9d1d-bad99c15ee91 service neutron] Checking segment: {'id': '06cdf949-c592-4827-b617-66043758d462', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:29:13.617148 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-ae8bd4ba-d1b8-4d11-9d1d-bad99c15ee91 service neutron] Bound using segment: {'id': '06cdf949-c592-4827-b617-66043758d462', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:29:13.619717 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-ae8bd4ba-d1b8-4d11-9d1d-bad99c15ee91 service neutron] Bound port: 18d9d7fa-fedf-4844-90ef-6757eb984ae2, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '06cdf949-c592-4827-b617-66043758d462', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:29:13.620078 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-ae8bd4ba-d1b8-4d11-9d1d-bad99c15ee91 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:13.682764 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-83df7066-b122-45c5-a177-cb6b35fead94 None None] Set router 59853428-6655-4e5e-b7d8-ac85e7e3f2b4 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:29:13.750882 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bfcea64a-4bed-4590-8e25-e46d08ea5aa1 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:13.768665 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-83df7066-b122-45c5-a177-cb6b35fead94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '59853428-6655-4e5e-b7d8-ac85e7e3f2b4', 'name': 'tempest-ServerRescueTestJSON-1978792040-router', 'tenant_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:26:39Z', 'updated_at': '2021-12-09T21:29:12Z', 'revision_number': 6, 'project_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:13.829966 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83df7066-b122-45c5-a177-cb6b35fead94 None None] The sync data for ids ['59853428-6655-4e5e-b7d8-ac85e7e3f2b4'] in n-d-713301-27 is: [{'id': '59853428-6655-4e5e-b7d8-ac85e7e3f2b4', 'name': 'tempest-ServerRescueTestJSON-1978792040-router', 'tenant_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:26:39Z', 'updated_at': '2021-12-09T21:29:12Z', 'revision_number': 6, 'project_id': '9ca15fab17f34cc58f1ad1fcedc1bf31', 'gw_port_host': None}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:29:13.948995 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bfcea64a-4bed-4590-8e25-e46d08ea5aa1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:13.950055 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bfcea64a-4bed-4590-8e25-e46d08ea5aa1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:13.950649 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bfcea64a-4bed-4590-8e25-e46d08ea5aa1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:13.976325 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bfcea64a-4bed-4590-8e25-e46d08ea5aa1 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 1.1109347 Dec 09 21:29:13.990948 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42504) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:14.017084 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-7e97f43f-75fc-4c69-b07d-8f7aef141d0a admin admin] Request body: {'subnet': {'network_id': '0bcede63-0fdd-4d40-8c5c-4890fec5dc38', 'cidr': '172.20.0.0/28', 'name': 'tempest-ListServersNegativeTestJSON-1282374147-subnet', 'tenant_id': '6757323541bb47f99775de3a0132216b', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:14.107212 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afeddc14-4950-4273-a9db-fd12ad15e6eb req-9aebfa7d-8d8a-4a31-8a1e-037394f3d1fe tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:14.107519 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfcea64a-4bed-4590-8e25-e46d08ea5aa1 admin admin] Pushing event updated for resources: {'Network': ['ID=0bcede63-0fdd-4d40-8c5c-4890fec5dc38,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:14.114848 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afeddc14-4950-4273-a9db-fd12ad15e6eb req-9aebfa7d-8d8a-4a31-8a1e-037394f3d1fe tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:14.118544 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 0bcede63-0fdd-4d40-8c5c-4890fec5dc38 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:29:14.122948 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afeddc14-4950-4273-a9db-fd12ad15e6eb req-9aebfa7d-8d8a-4a31-8a1e-037394f3d1fe tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:14.129321 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afeddc14-4950-4273-a9db-fd12ad15e6eb req-9aebfa7d-8d8a-4a31-8a1e-037394f3d1fe tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:14.135390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afeddc14-4950-4273-a9db-fd12ad15e6eb req-9aebfa7d-8d8a-4a31-8a1e-037394f3d1fe tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:14.141598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afeddc14-4950-4273-a9db-fd12ad15e6eb req-9aebfa7d-8d8a-4a31-8a1e-037394f3d1fe tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:14.149782 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afeddc14-4950-4273-a9db-fd12ad15e6eb req-9aebfa7d-8d8a-4a31-8a1e-037394f3d1fe tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:14.159739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7e97f43f-75fc-4c69-b07d-8f7aef141d0a admin admin] Made reservation on behalf of 6757323541bb47f99775de3a0132216b for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:29:14.162016 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7e97f43f-75fc-4c69-b07d-8f7aef141d0a admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:14.162438 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-afeddc14-4950-4273-a9db-fd12ad15e6eb req-9aebfa7d-8d8a-4a31-8a1e-037394f3d1fe tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5420 time: 0.6824207 Dec 09 21:29:14.188173 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-06eb7df4-71c7-4b6b-861a-8b1a96cbecef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:14.200490 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-681929cd-0f27-458e-9dde-40d1e4656222 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:14.245228 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-afeddc14-4950-4273-a9db-fd12ad15e6eb req-27220555-0850-4840-9412-a04a072fe60f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0804880 Dec 09 21:29:14.249849 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06eb7df4-71c7-4b6b-861a-8b1a96cbecef admin admin] Pushing event deleted for resources: {'Port': ['ID=7e38e03d-c1aa-4113-b1bd-d91131f610c5,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:14.299382 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec1e0194-f3c2-4a08-ae58-4d07975deac3 req-a70a0897-1c5c-446a-8134-adbbe8076ded tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:14.317656 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec1e0194-f3c2-4a08-ae58-4d07975deac3 req-a70a0897-1c5c-446a-8134-adbbe8076ded tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:14.331646 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec1e0194-f3c2-4a08-ae58-4d07975deac3 req-a70a0897-1c5c-446a-8134-adbbe8076ded tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:14.342446 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec1e0194-f3c2-4a08-ae58-4d07975deac3 req-a70a0897-1c5c-446a-8134-adbbe8076ded tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:14.360204 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec1e0194-f3c2-4a08-ae58-4d07975deac3 req-a70a0897-1c5c-446a-8134-adbbe8076ded tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:14.370843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec1e0194-f3c2-4a08-ae58-4d07975deac3 req-a70a0897-1c5c-446a-8134-adbbe8076ded tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:14.379229 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec1e0194-f3c2-4a08-ae58-4d07975deac3 req-a70a0897-1c5c-446a-8134-adbbe8076ded tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 4605 time: 0.7192273 Dec 09 21:29:14.431431 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-681929cd-0f27-458e-9dde-40d1e4656222 admin admin] Checking segment: {'id': '156677c4-8e58-420b-a3a1-7c1c07b52a7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '2700a60c-f75d-4026-8ff3-5e6bb9394ac1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:29:14.431807 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-681929cd-0f27-458e-9dde-40d1e4656222 admin admin] Network hostable DHCP agents. Network: 2700a60c-f75d-4026-8ff3-5e6bb9394ac1, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:29:14.433865 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-681929cd-0f27-458e-9dde-40d1e4656222 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b3687d43-b504-4450-b43d-3e7de97d09da,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:14.444808 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-06eb7df4-71c7-4b6b-861a-8b1a96cbecef admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:14.468236 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-ae8bd4ba-d1b8-4d11-9d1d-bad99c15ee91 service neutron] For port 18d9d7fa-fedf-4844-90ef-6757eb984ae2, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:29:14.495660 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-ae8bd4ba-d1b8-4d11-9d1d-bad99c15ee91 service neutron] For port 18d9d7fa-fedf-4844-90ef-6757eb984ae2, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=18d9d7fa-fedf-4844-90ef-6757eb984ae2,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:29:14.505553 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a004c738-abc4-491f-aafd-0173aed19956 req-5df5a6f5-53cc-40d3-bec9-eb5ef58cfb18 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:14.507294 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a004c738-abc4-491f-aafd-0173aed19956 req-5df5a6f5-53cc-40d3-bec9-eb5ef58cfb18 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=4641e74b-365e-4a0f-9c88-45d8762ec4bf HTTP/1.1" status: 200 len: 946 time: 0.1206713 Dec 09 21:29:14.514185 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-ae8bd4ba-d1b8-4d11-9d1d-bad99c15ee91 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:14.532838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-681929cd-0f27-458e-9dde-40d1e4656222 admin admin] Network 2700a60c-f75d-4026-8ff3-5e6bb9394ac1 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:29:14.601672 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a004c738-abc4-491f-aafd-0173aed19956 req-924342e3-8d2f-460c-a9ae-fb9f57f29438 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0842619 Dec 09 21:29:14.609429 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-681929cd-0f27-458e-9dde-40d1e4656222 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 2700a60c-f75d-4026-8ff3-5e6bb9394ac1) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:29:14.623932 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-06eb7df4-71c7-4b6b-861a-8b1a96cbecef admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:14.626746 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-ae8bd4ba-d1b8-4d11-9d1d-bad99c15ee91 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:14.627385 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-ae8bd4ba-d1b8-4d11-9d1d-bad99c15ee91 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:14.628823 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-ae8bd4ba-d1b8-4d11-9d1d-bad99c15ee91 service neutron] 10.222.0.10 "PUT /v2.0/ports/18d9d7fa-fedf-4844-90ef-6757eb984ae2 HTTP/1.1" status: 200 len: 1136 time: 3.5159380 Dec 09 21:29:14.632560 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-06eb7df4-71c7-4b6b-861a-8b1a96cbecef admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:14.638161 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e399b134-3f52-4499-bf68-3707aa12401e None None] Network 2700a60c-f75d-4026-8ff3-5e6bb9394ac1 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:29:14.652454 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-681929cd-0f27-458e-9dde-40d1e4656222 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:14.652724 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'tag': '18d9d7fa-fedf-4844-90ef-6757eb984ae2'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:14.656835 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-681929cd-0f27-458e-9dde-40d1e4656222 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:14.659758 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-01d16dcf-a0b1-45f5-aea6-0d86551320cc" -d '{"events": [{"name": "network-changed", "server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "tag": "18d9d7fa-fedf-4844-90ef-6757eb984ae2"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:14.701431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-8ee089fa-f382-4eef-acc0-daaca85fa889 service neutron] Request body: {'port': {'device_id': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:14.724467 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-681929cd-0f27-458e-9dde-40d1e4656222 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 1.2329342 Dec 09 21:29:14.772104 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec1e0194-f3c2-4a08-ae58-4d07975deac3 req-993ad370-ae5f-4814-9a1b-42cf816d40fc tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.3915539 Dec 09 21:29:14.878493 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae8bd4ba-d1b8-4d11-9d1d-bad99c15ee91 service neutron] Pushing event updated for resources: {'Port': ['ID=18d9d7fa-fedf-4844-90ef-6757eb984ae2,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:14.950147 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-06eb7df4-71c7-4b6b-861a-8b1a96cbecef admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:14.951309 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-06eb7df4-71c7-4b6b-861a-8b1a96cbecef admin admin] Fanout notify agent at l3_agent the message router_deleted on router 59853428-6655-4e5e-b7d8-ac85e7e3f2b4 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:29:14.978329 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-06eb7df4-71c7-4b6b-861a-8b1a96cbecef admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:14.980655 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-06eb7df4-71c7-4b6b-861a-8b1a96cbecef admin admin] 10.222.0.13 "DELETE /v2.0/routers/59853428-6655-4e5e-b7d8-ac85e7e3f2b4 HTTP/1.1" status: 204 len: 168 time: 2.5479968 Dec 09 21:29:14.996713 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42526) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:15.007901 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-673a50a5-dd2c-4017-8c11-4f457a0b9a23 x-openstack-request-id: req-673a50a5-dd2c-4017-8c11-4f457a0b9a23 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:15.008380 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "tag": "18d9d7fa-fedf-4844-90ef-6757eb984ae2", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:15.008896 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-673a50a5-dd2c-4017-8c11-4f457a0b9a23 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:15.009447 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'tag': '18d9d7fa-fedf-4844-90ef-6757eb984ae2', 'status': 'completed', 'code': 200} Dec 09 21:29:15.017622 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ab4acda-ff89-4d38-bf2f-b1e5f2b9a21a None None] Network 2700a60c-f75d-4026-8ff3-5e6bb9394ac1 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:29:15.130241 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-8ee089fa-f382-4eef-acc0-daaca85fa889 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:15.217655 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-398d3f20-1a43-4ff0-8553-2b566cabdebb admin admin] Deleting subnet a84d1123-6651-4f35-9cba-4f9c8f45aab6 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:29:15.223260 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-398d3f20-1a43-4ff0-8553-2b566cabdebb admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:15.256500 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d68b58cd-3f98-4aa6-8259-efea961feb0a no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:29:15.269467 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7e97f43f-75fc-4c69-b07d-8f7aef141d0a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:15.308180 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d16dcf-a0b1-45f5-aea6-0d86551320cc req-841edef5-c711-4f83-a5b6-0d153d2837a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:15.308678 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d16dcf-a0b1-45f5-aea6-0d86551320cc req-841edef5-c711-4f83-a5b6-0d153d2837a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:15.309154 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d16dcf-a0b1-45f5-aea6-0d86551320cc req-841edef5-c711-4f83-a5b6-0d153d2837a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:15.309615 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d16dcf-a0b1-45f5-aea6-0d86551320cc req-841edef5-c711-4f83-a5b6-0d153d2837a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:15.310068 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d16dcf-a0b1-45f5-aea6-0d86551320cc req-841edef5-c711-4f83-a5b6-0d153d2837a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:15.310621 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d16dcf-a0b1-45f5-aea6-0d86551320cc req-841edef5-c711-4f83-a5b6-0d153d2837a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:15.312610 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-01d16dcf-a0b1-45f5-aea6-0d86551320cc req-841edef5-c711-4f83-a5b6-0d153d2837a2 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0a5d0e4652be4d8b87936a559840cc87&device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5293 time: 0.2771785 Dec 09 21:29:15.388273 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: d68b58cd-3f98-4aa6-8259-efea961feb0a {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:29:15.388699 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d68b58cd-3f98-4aa6-8259-efea961feb0a not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:29:15.389117 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7e38e03d-c1aa-4113-b1bd-d91131f610c5 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:29:15.482550 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 7e38e03d-c1aa-4113-b1bd-d91131f610c5 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:29:15.482892 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7e38e03d-c1aa-4113-b1bd-d91131f610c5 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:29:15.522543 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-398d3f20-1a43-4ff0-8553-2b566cabdebb admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:15.545516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e97f43f-75fc-4c69-b07d-8f7aef141d0a admin admin] Pushing event updated for resources: {'Subnet': ['ID=16184032-e4c1-40c2-a34f-a13c4226a14a,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:15.562822 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e97f43f-75fc-4c69-b07d-8f7aef141d0a admin admin] Checking segment: {'id': '4944fe1d-3354-4e33-b6be-75c5cb26e73d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '0bcede63-0fdd-4d40-8c5c-4890fec5dc38'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:29:15.563498 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e97f43f-75fc-4c69-b07d-8f7aef141d0a admin admin] Network hostable DHCP agents. Network: 0bcede63-0fdd-4d40-8c5c-4890fec5dc38, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:29:15.622608 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e97f43f-75fc-4c69-b07d-8f7aef141d0a admin admin] Network 0bcede63-0fdd-4d40-8c5c-4890fec5dc38 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:29:15.625876 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d16dcf-a0b1-45f5-aea6-0d86551320cc req-7906c6fb-f769-4c8a-9aee-644eeeb8c18d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:15.626453 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d16dcf-a0b1-45f5-aea6-0d86551320cc req-7906c6fb-f769-4c8a-9aee-644eeeb8c18d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:15.626925 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d16dcf-a0b1-45f5-aea6-0d86551320cc req-7906c6fb-f769-4c8a-9aee-644eeeb8c18d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:15.629055 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-01d16dcf-a0b1-45f5-aea6-0d86551320cc req-7906c6fb-f769-4c8a-9aee-644eeeb8c18d service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=0a5d0e4652be4d8b87936a559840cc87&shared=False HTTP/1.1" status: 200 len: 2296 time: 0.2699833 Dec 09 21:29:15.649748 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-7e97f43f-75fc-4c69-b07d-8f7aef141d0a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 0bcede63-0fdd-4d40-8c5c-4890fec5dc38) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:29:15.661523 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f888bcfe-1872-46f7-bbf7-a53e87e9b3fa None None] Network 0bcede63-0fdd-4d40-8c5c-4890fec5dc38 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:29:15.677173 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e97f43f-75fc-4c69-b07d-8f7aef141d0a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:15.678915 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7e97f43f-75fc-4c69-b07d-8f7aef141d0a admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:15.716436 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-398d3f20-1a43-4ff0-8553-2b566cabdebb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:15.750021 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7e97f43f-75fc-4c69-b07d-8f7aef141d0a admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 855 time: 1.7391105 Dec 09 21:29:15.775616 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-08d70c85-89f2-48e5-945e-1cec5d0a1b10 None None] Network 0bcede63-0fdd-4d40-8c5c-4890fec5dc38 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:29:15.808803 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d16dcf-a0b1-45f5-aea6-0d86551320cc req-dc80962d-8800-40da-90e3-37985bd9cc86 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:15.811907 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-01d16dcf-a0b1-45f5-aea6-0d86551320cc req-dc80962d-8800-40da-90e3-37985bd9cc86 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1747622 Dec 09 21:29:15.835942 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-8ee089fa-f382-4eef-acc0-daaca85fa889 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:15.845779 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-8ee089fa-f382-4eef-acc0-daaca85fa889 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:15.863771 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-8ee089fa-f382-4eef-acc0-daaca85fa889 service neutron] Transition to ACTIVE for port object 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:29:15.990971 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-902f88d7-545c-4155-b486-4539df4b239b tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:15.999685 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-902f88d7-545c-4155-b486-4539df4b239b tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/networks?id=2700a60c-f75d-4026-8ff3-5e6bb9394ac1 HTTP/1.1" status: 200 len: 817 time: 0.5113196 Dec 09 21:29:16.049598 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-8ee089fa-f382-4eef-acc0-daaca85fa889 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:16.081172 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-2377eb63-1fcb-447c-be56-e9b3bb5c279f tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/quotas/e9159c237df04f09a82d1c2eee1f573e HTTP/1.1" status: 200 len: 375 time: 0.0805624 Dec 09 21:29:16.086399 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-398d3f20-1a43-4ff0-8553-2b566cabdebb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:16.111966 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ee089fa-f382-4eef-acc0-daaca85fa889 service neutron] Pushing event updated for resources: {'Port': ['ID=1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:16.160854 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-398d3f20-1a43-4ff0-8553-2b566cabdebb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a84d1123-6651-4f35-9cba-4f9c8f45aab6,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:16.170346 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-398d3f20-1a43-4ff0-8553-2b566cabdebb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:16.173927 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-398d3f20-1a43-4ff0-8553-2b566cabdebb admin admin] 10.222.0.13 "DELETE /v2.0/subnets/a84d1123-6651-4f35-9cba-4f9c8f45aab6 HTTP/1.1" status: 204 len: 168 time: 1.1632740 Dec 09 21:29:16.176644 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42556) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:16.193885 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-1980e7d7-41dd-49b8-a341-28098da95503 tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=e9159c237df04f09a82d1c2eee1f573e&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0511053 Dec 09 21:29:16.214139 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee9be08d-37ff-4e23-b6a4-164cd15947af req-461a2ff7-b740-4eba-8acc-20b4df6383b8 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:16.220748 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee9be08d-37ff-4e23-b6a4-164cd15947af req-461a2ff7-b740-4eba-8acc-20b4df6383b8 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:16.228598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee9be08d-37ff-4e23-b6a4-164cd15947af req-461a2ff7-b740-4eba-8acc-20b4df6383b8 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:16.235631 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee9be08d-37ff-4e23-b6a4-164cd15947af req-461a2ff7-b740-4eba-8acc-20b4df6383b8 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:16.245369 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee9be08d-37ff-4e23-b6a4-164cd15947af req-461a2ff7-b740-4eba-8acc-20b4df6383b8 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:16.251422 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee9be08d-37ff-4e23-b6a4-164cd15947af req-461a2ff7-b740-4eba-8acc-20b4df6383b8 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:16.257485 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee9be08d-37ff-4e23-b6a4-164cd15947af req-461a2ff7-b740-4eba-8acc-20b4df6383b8 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:16.265582 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ee9be08d-37ff-4e23-b6a4-164cd15947af req-461a2ff7-b740-4eba-8acc-20b4df6383b8 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5420 time: 0.5077367 Dec 09 21:29:16.323924 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-88b07941-0d97-4f59-9a3a-d8727042df93 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:16.421128 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-88b07941-0d97-4f59-9a3a-d8727042df93 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:16.429857 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-8ee089fa-f382-4eef-acc0-daaca85fa889 service neutron] Attempting to bind port 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:29:16.430292 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-8ee089fa-f382-4eef-acc0-daaca85fa889 service neutron] Attempting to bind port 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '06cdf949-c592-4827-b617-66043758d462', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:29:16.430755 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-8ee089fa-f382-4eef-acc0-daaca85fa889 service neutron] Attempting to bind port 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f on network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:16.452291 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-88b07941-0d97-4f59-9a3a-d8727042df93 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e7d3d836-ebe9-4e03-af4b-235dd5e5cbea']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:16.463262 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-88b07941-0d97-4f59-9a3a-d8727042df93 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6bb6d7a7-737b-46b2-b463-0bc25081f6ef') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:16.463490 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-88b07941-0d97-4f59-9a3a-d8727042df93 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6bb6d7a7-737b-46b2-b463-0bc25081f6ef') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:16.474972 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-88b07941-0d97-4f59-9a3a-d8727042df93 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:16.479188 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-8ee089fa-f382-4eef-acc0-daaca85fa889 service neutron] Port 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f on network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:29:16.479680 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-8ee089fa-f382-4eef-acc0-daaca85fa889 service neutron] Attempting to bind port 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f on network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:16.491088 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-88b07941-0d97-4f59-9a3a-d8727042df93 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:16.492566 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-8ee089fa-f382-4eef-acc0-daaca85fa889 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:29:16.493048 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-8ee089fa-f382-4eef-acc0-daaca85fa889 service neutron] Checking segment: {'id': '06cdf949-c592-4827-b617-66043758d462', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:29:16.494330 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-8ee089fa-f382-4eef-acc0-daaca85fa889 service neutron] Bound using segment: {'id': '06cdf949-c592-4827-b617-66043758d462', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:29:16.494463 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-8ee089fa-f382-4eef-acc0-daaca85fa889 service neutron] Bound port: 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '06cdf949-c592-4827-b617-66043758d462', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:29:16.494764 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-8ee089fa-f382-4eef-acc0-daaca85fa889 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:16.499270 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-88b07941-0d97-4f59-9a3a-d8727042df93 admin admin] Releasing vlan 102 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:29:16.499696 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-88b07941-0d97-4f59-9a3a-d8727042df93 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:29:16.570105 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:29:16.580191 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ee9be08d-37ff-4e23-b6a4-164cd15947af req-1d322732-cda6-49ca-8475-28bfa89ab475 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.3136857 Dec 09 21:29:16.603797 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-88b07941-0d97-4f59-9a3a-d8727042df93 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:16.612780 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-88b07941-0d97-4f59-9a3a-d8727042df93 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:16.628026 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-f6ea336d-1efa-4490-944a-ce03c02ad477 service neutron] 10.222.0.13 "GET /v2.0/networks/2700a60c-f75d-4026-8ff3-5e6bb9394ac1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3540981 Dec 09 21:29:16.629157 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-88b07941-0d97-4f59-9a3a-d8727042df93 admin admin] 10.222.0.13 "DELETE /v2.0/networks/e7d3d836-ebe9-4e03-af4b-235dd5e5cbea HTTP/1.1" status: 204 len: 168 time: 0.4513156 Dec 09 21:29:16.644521 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88b07941-0d97-4f59-9a3a-d8727042df93 admin admin] Pushing event deleted for resources: {'Network': ['ID=e7d3d836-ebe9-4e03-af4b-235dd5e5cbea,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:16.671852 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad4d5eb3-7202-4914-b00c-b854cce118af req-137ae87d-70ab-4fe2-8cef-cea55fedae2a tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:16.673550 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ad4d5eb3-7202-4914-b00c-b854cce118af req-137ae87d-70ab-4fe2-8cef-cea55fedae2a tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.10 "GET /v2.0/ports?device_id=4641e74b-365e-4a0f-9c88-45d8762ec4bf HTTP/1.1" status: 200 len: 946 time: 0.1024287 Dec 09 21:29:16.776475 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-8ee089fa-f382-4eef-acc0-daaca85fa889 service neutron] For port 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:29:16.780362 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-8ee089fa-f382-4eef-acc0-daaca85fa889 service neutron] For port 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:29:16.801322 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-8ee089fa-f382-4eef-acc0-daaca85fa889 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:16.836740 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-8ee089fa-f382-4eef-acc0-daaca85fa889 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:16.837664 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-8ee089fa-f382-4eef-acc0-daaca85fa889 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:16.839127 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-8ee089fa-f382-4eef-acc0-daaca85fa889 service neutron] 10.222.0.10 "PUT /v2.0/ports/1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f HTTP/1.1" status: 200 len: 1137 time: 2.1676204 Dec 09 21:29:16.869278 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-ad4d5eb3-7202-4914-b00c-b854cce118af req-0a986150-4b42-4aa8-baa1-b5a9cea15b8f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Deleting port 12141f96-3d14-4c4d-a043-91223dcefddd {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:29:16.869711 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ad4d5eb3-7202-4914-b00c-b854cce118af req-0a986150-4b42-4aa8-baa1-b5a9cea15b8f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:16.884833 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-e6f1905f-961a-4fb7-ab72-26f7d906f827 service neutron] Request body: {'port': {'device_id': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:16.893901 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42566) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:16.916271 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-ec10fe9b-9169-46fe-8461-b13b7eb4b77b service neutron] 10.222.0.13 "GET /v2.0/networks/2700a60c-f75d-4026-8ff3-5e6bb9394ac1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2874410 Dec 09 21:29:16.998909 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a9237a6-a6fd-401d-936d-98bface1569e req-3e385bdd-b2fa-41d1-86e8-5556256aef15 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:17.008069 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-ad4d5eb3-7202-4914-b00c-b854cce118af req-0a986150-4b42-4aa8-baa1-b5a9cea15b8f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] For port 12141f96-3d14-4c4d-a043-91223dcefddd, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=12141f96-3d14-4c4d-a043-91223dcefddd,segment=NetworkSegment(e3c687b5-afac-4ac8-9b38-06599c2a8b7e),segment_id=e3c687b5-afac-4ac8-9b38-06599c2a8b7e)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:17.008444 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ad4d5eb3-7202-4914-b00c-b854cce118af req-0a986150-4b42-4aa8-baa1-b5a9cea15b8f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:17.012683 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7a9237a6-a6fd-401d-936d-98bface1569e req-3e385bdd-b2fa-41d1-86e8-5556256aef15 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/ports?device_id=4641e74b-365e-4a0f-9c88-45d8762ec4bf HTTP/1.1" status: 200 len: 946 time: 0.2305756 Dec 09 21:29:17.020447 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'tag': '1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:17.028567 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-ad4d5eb3-7202-4914-b00c-b854cce118af req-0a986150-4b42-4aa8-baa1-b5a9cea15b8f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Calling delete_port for 12141f96-3d14-4c4d-a043-91223dcefddd owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:29:17.031559 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fa9aa6a2-f240-4fa8-9f31-3901614d1029" -d '{"events": [{"name": "network-changed", "server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "tag": "1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:17.043410 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ee089fa-f382-4eef-acc0-daaca85fa889 service neutron] Pushing event updated for resources: {'Port': ['ID=1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:17.128869 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-61b07137-2610-482f-b458-77b4056277f1 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=9ca15fab17f34cc58f1ad1fcedc1bf31&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2157722 Dec 09 21:29:17.129834 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-e6f1905f-961a-4fb7-ab72-26f7d906f827 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:17.132267 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42576) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:17.221468 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7a9237a6-a6fd-401d-936d-98bface1569e req-a59e886e-b0a5-49a1-bde1-975e04055b34 tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.13 "GET /v2.0/security-groups?id=09461f3e-b584-4926-824b-56cad478d61b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2077007 Dec 09 21:29:17.362564 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ad4d5eb3-7202-4914-b00c-b854cce118af req-0a986150-4b42-4aa8-baa1-b5a9cea15b8f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:17.377374 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['12141f96-3d14-4c4d-a043-91223dcefddd'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:29:17.407082 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7334047-6685-46f2-8f8d-f4d0fbb98f6f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:17.446283 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a986150-4b42-4aa8-baa1-b5a9cea15b8f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Pushing event deleted for resources: {'Port': ['ID=12141f96-3d14-4c4d-a043-91223dcefddd,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:17.527081 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f56aa6c-05ef-4710-90b6-bbbb592b7158 req-afb916d3-4dd7-4a2b-a5a9-5bda8f3180bc tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:17.534957 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-ad4d5eb3-7202-4914-b00c-b854cce118af req-0a986150-4b42-4aa8-baa1-b5a9cea15b8f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] No DVR routers for this DVR port 12141f96-3d14-4c4d-a043-91223dcefddd on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:29:17.535149 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f56aa6c-05ef-4710-90b6-bbbb592b7158 req-afb916d3-4dd7-4a2b-a5a9-5bda8f3180bc tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:17.539702 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ad4d5eb3-7202-4914-b00c-b854cce118af req-0a986150-4b42-4aa8-baa1-b5a9cea15b8f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:17.543068 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ad4d5eb3-7202-4914-b00c-b854cce118af req-0a986150-4b42-4aa8-baa1-b5a9cea15b8f tempest-ServerDiskConfigTestJSON-19326042 tempest-ServerDiskConfigTestJSON-19326042-project] 10.222.0.10 "DELETE /v2.0/ports/12141f96-3d14-4c4d-a043-91223dcefddd HTTP/1.1" status: 204 len: 173 time: 0.8624656 Dec 09 21:29:17.543628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f56aa6c-05ef-4710-90b6-bbbb592b7158 req-afb916d3-4dd7-4a2b-a5a9-5bda8f3180bc tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:17.548839 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4641e74b-365e-4a0f-9c88-45d8762ec4bf', 'name': 'network-vif-deleted', 'tag': '12141f96-3d14-4c4d-a043-91223dcefddd'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:17.551258 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9e84ddcb-d088-43ea-a577-73d77130f0ed" -d '{"events": [{"server_uuid": "4641e74b-365e-4a0f-9c88-45d8762ec4bf", "name": "network-vif-deleted", "tag": "12141f96-3d14-4c4d-a043-91223dcefddd"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:17.561251 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f56aa6c-05ef-4710-90b6-bbbb592b7158 req-afb916d3-4dd7-4a2b-a5a9-5bda8f3180bc tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:17.578403 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f56aa6c-05ef-4710-90b6-bbbb592b7158 req-afb916d3-4dd7-4a2b-a5a9-5bda8f3180bc tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:17.588168 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f56aa6c-05ef-4710-90b6-bbbb592b7158 req-afb916d3-4dd7-4a2b-a5a9-5bda8f3180bc tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:17.596702 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f56aa6c-05ef-4710-90b6-bbbb592b7158 req-afb916d3-4dd7-4a2b-a5a9-5bda8f3180bc tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:17.618238 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f56aa6c-05ef-4710-90b6-bbbb592b7158 req-afb916d3-4dd7-4a2b-a5a9-5bda8f3180bc tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5383 time: 0.3906474 Dec 09 21:29:17.669297 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7334047-6685-46f2-8f8d-f4d0fbb98f6f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:17.802852 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7334047-6685-46f2-8f8d-f4d0fbb98f6f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:17.805769 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7334047-6685-46f2-8f8d-f4d0fbb98f6f admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:17.809714 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c7334047-6685-46f2-8f8d-f4d0fbb98f6f admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/e3e1adf5-b10b-43bf-ae09-0ef01e9685e6 HTTP/1.1" status: 204 len: 168 time: 0.6755173 Dec 09 21:29:17.925241 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7334047-6685-46f2-8f8d-f4d0fbb98f6f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e3e1adf5-b10b-43bf-ae09-0ef01e9685e6,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:17.981723 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f56aa6c-05ef-4710-90b6-bbbb592b7158 req-a852ba3c-3469-4587-bf8b-84529fdad50e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.3598654 Dec 09 21:29:18.104679 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d98e2628-a15a-4eb8-bdf3-a39e7dcc29ab x-openstack-request-id: req-d98e2628-a15a-4eb8-bdf3-a39e7dcc29ab {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:18.104969 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "tag": "1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:18.105220 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-d98e2628-a15a-4eb8-bdf3-a39e7dcc29ab {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:18.105610 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'tag': '1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f', 'status': 'completed', 'code': 200} Dec 09 21:29:18.130795 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ea3e58-6571-4081-a041-f25342614c13 req-30c7cdcb-58b3-4d48-bb20-fd608f388f45 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:18.138333 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-30c7cdcb-58b3-4d48-bb20-fd608f388f45 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/networks?id=0bcede63-0fdd-4d40-8c5c-4890fec5dc38 HTTP/1.1" status: 200 len: 818 time: 0.3802838 Dec 09 21:29:18.189312 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-2cd73cb7-a577-4763-9aa7-a661690c7041 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/quotas/6757323541bb47f99775de3a0132216b HTTP/1.1" status: 200 len: 375 time: 0.0399270 Dec 09 21:29:18.253146 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-21efd0df-4a23-477b-ae38-b9e984b001ef req-92cf664c-13fe-486b-b683-7b30780014c0 tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/ports?device_id=312d3f8f-a9e2-4604-b559-13de6a525547 HTTP/1.1" status: 200 len: 210 time: 0.0703349 Dec 09 21:29:18.254179 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9aa6a2-f240-4fa8-9f31-3901614d1029 req-36287c08-e797-4c41-970a-df12b4d2254c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:18.254981 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9aa6a2-f240-4fa8-9f31-3901614d1029 req-36287c08-e797-4c41-970a-df12b4d2254c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:18.256365 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9aa6a2-f240-4fa8-9f31-3901614d1029 req-36287c08-e797-4c41-970a-df12b4d2254c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:18.257659 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9aa6a2-f240-4fa8-9f31-3901614d1029 req-36287c08-e797-4c41-970a-df12b4d2254c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:18.259678 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9aa6a2-f240-4fa8-9f31-3901614d1029 req-36287c08-e797-4c41-970a-df12b4d2254c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:18.262737 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9aa6a2-f240-4fa8-9f31-3901614d1029 req-36287c08-e797-4c41-970a-df12b4d2254c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:18.263570 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9aa6a2-f240-4fa8-9f31-3901614d1029 req-36287c08-e797-4c41-970a-df12b4d2254c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:18.268573 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fa9aa6a2-f240-4fa8-9f31-3901614d1029 req-36287c08-e797-4c41-970a-df12b4d2254c service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0a5d0e4652be4d8b87936a559840cc87&device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 6223 time: 0.1535094 Dec 09 21:29:18.339015 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-7ba4a7dd-381d-46b0-84e7-8982b71d6300 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=6757323541bb47f99775de3a0132216b&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1288855 Dec 09 21:29:18.350828 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a6e93c92-ac00-4d61-ba38-e8bb26b7260c x-openstack-request-id: req-a6e93c92-ac00-4d61-ba38-e8bb26b7260c {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:18.351293 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4641e74b-365e-4a0f-9c88-45d8762ec4bf", "name": "network-vif-deleted", "tag": "12141f96-3d14-4c4d-a043-91223dcefddd", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:18.351663 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a6e93c92-ac00-4d61-ba38-e8bb26b7260c {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:18.352475 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4641e74b-365e-4a0f-9c88-45d8762ec4bf', 'name': 'network-vif-deleted', 'tag': '12141f96-3d14-4c4d-a043-91223dcefddd', 'status': 'completed', 'code': 200} Dec 09 21:29:18.483225 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-e6f1905f-961a-4fb7-ab72-26f7d906f827 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 38f97951-e872-4c24-947f-934429895ad3 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:18.522119 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-e6f1905f-961a-4fb7-ab72-26f7d906f827 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:18.553540 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-196cf0fc-cb8f-428c-9dab-83685167d7b3 service neutron] 10.222.0.13 "GET /v2.0/networks/0bcede63-0fdd-4d40-8c5c-4890fec5dc38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2054396 Dec 09 21:29:18.567478 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-e6f1905f-961a-4fb7-ab72-26f7d906f827 service neutron] Transition to ACTIVE for port object 38f97951-e872-4c24-947f-934429895ad3 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:29:18.586307 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-e6f1905f-961a-4fb7-ab72-26f7d906f827 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:18.826353 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-a4364ffb-9edd-4ba6-895b-4deb64d2b5af service neutron] 10.222.0.13 "GET /v2.0/networks/0bcede63-0fdd-4d40-8c5c-4890fec5dc38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2716317 Dec 09 21:29:18.842276 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e448b3a2-2ca8-446e-b084-0a0ca1ead9cb req-da51ea02-43ee-4094-ba92-a5ee20a55e02 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:18.863156 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e448b3a2-2ca8-446e-b084-0a0ca1ead9cb req-da51ea02-43ee-4094-ba92-a5ee20a55e02 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:18.875159 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e448b3a2-2ca8-446e-b084-0a0ca1ead9cb req-da51ea02-43ee-4094-ba92-a5ee20a55e02 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:18.886539 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e448b3a2-2ca8-446e-b084-0a0ca1ead9cb req-da51ea02-43ee-4094-ba92-a5ee20a55e02 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:18.897742 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e448b3a2-2ca8-446e-b084-0a0ca1ead9cb req-da51ea02-43ee-4094-ba92-a5ee20a55e02 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:18.907735 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e448b3a2-2ca8-446e-b084-0a0ca1ead9cb req-da51ea02-43ee-4094-ba92-a5ee20a55e02 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:18.930292 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e448b3a2-2ca8-446e-b084-0a0ca1ead9cb req-da51ea02-43ee-4094-ba92-a5ee20a55e02 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:18.949232 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e448b3a2-2ca8-446e-b084-0a0ca1ead9cb req-da51ea02-43ee-4094-ba92-a5ee20a55e02 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5420 time: 0.4897864 Dec 09 21:29:19.161883 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9aa6a2-f240-4fa8-9f31-3901614d1029 req-cb5bde4c-b527-4aac-a169-a662017c7dea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:19.163166 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9aa6a2-f240-4fa8-9f31-3901614d1029 req-cb5bde4c-b527-4aac-a169-a662017c7dea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:19.163811 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9aa6a2-f240-4fa8-9f31-3901614d1029 req-cb5bde4c-b527-4aac-a169-a662017c7dea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:19.165583 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fa9aa6a2-f240-4fa8-9f31-3901614d1029 req-cb5bde4c-b527-4aac-a169-a662017c7dea service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=0a5d0e4652be4d8b87936a559840cc87&shared=False HTTP/1.1" status: 200 len: 2296 time: 0.8880589 Dec 09 21:29:19.171121 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6f1905f-961a-4fb7-ab72-26f7d906f827 service neutron] Pushing event updated for resources: {'Port': ['ID=38f97951-e872-4c24-947f-934429895ad3,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:19.290005 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e448b3a2-2ca8-446e-b084-0a0ca1ead9cb req-02f1d30d-5c9c-4b95-892d-2188a4bb1505 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.3397665 Dec 09 21:29:19.300433 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42632) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:19.353979 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-0582b646-c62a-47ac-b2dd-55d41010c11c tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:19.355571 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-0582b646-c62a-47ac-b2dd-55d41010c11c tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.31 "GET /v2.0/networks?id=2700a60c-f75d-4026-8ff3-5e6bb9394ac1 HTTP/1.1" status: 200 len: 817 time: 0.3521175 Dec 09 21:29:19.406224 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-e6f1905f-961a-4fb7-ab72-26f7d906f827 service neutron] Attempting to bind port 38f97951-e872-4c24-947f-934429895ad3 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:29:19.408624 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-e6f1905f-961a-4fb7-ab72-26f7d906f827 service neutron] Attempting to bind port 38f97951-e872-4c24-947f-934429895ad3 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '06cdf949-c592-4827-b617-66043758d462', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:29:19.409201 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-e6f1905f-961a-4fb7-ab72-26f7d906f827 service neutron] Attempting to bind port 38f97951-e872-4c24-947f-934429895ad3 on network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:19.421296 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-e6f1905f-961a-4fb7-ab72-26f7d906f827 service neutron] Port 38f97951-e872-4c24-947f-934429895ad3 on network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:29:19.421737 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-e6f1905f-961a-4fb7-ab72-26f7d906f827 service neutron] Attempting to bind port 38f97951-e872-4c24-947f-934429895ad3 on network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:19.429574 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-560153d1-41a3-4039-9585-a0e843e477cd tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Request body: {'port': {'device_id': '312d3f8f-a9e2-4604-b559-13de6a525547', 'network_id': '2700a60c-f75d-4026-8ff3-5e6bb9394ac1', 'admin_state_up': True, 'tenant_id': 'e9159c237df04f09a82d1c2eee1f573e'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:19.435354 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-e6f1905f-961a-4fb7-ab72-26f7d906f827 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:29:19.438450 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-e6f1905f-961a-4fb7-ab72-26f7d906f827 service neutron] Checking segment: {'id': '06cdf949-c592-4827-b617-66043758d462', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:29:19.439175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-e6f1905f-961a-4fb7-ab72-26f7d906f827 service neutron] Bound using segment: {'id': '06cdf949-c592-4827-b617-66043758d462', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:29:19.441222 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-e6f1905f-961a-4fb7-ab72-26f7d906f827 service neutron] Bound port: 38f97951-e872-4c24-947f-934429895ad3, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '06cdf949-c592-4827-b617-66043758d462', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:29:19.441840 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-e6f1905f-961a-4fb7-ab72-26f7d906f827 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:19.623338 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-d75667f6-20be-4b06-8fd1-c09855be284d admin admin] Request body: {'network': {'name': 'tempest-VirtualInterfacesTestJSON-327061642-network', 'tenant_id': '92c07059a0e148b5a1b8c9e41d1d0178'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:19.628221 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-e6f1905f-961a-4fb7-ab72-26f7d906f827 service neutron] For port 38f97951-e872-4c24-947f-934429895ad3, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:29:19.656914 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9aa6a2-f240-4fa8-9f31-3901614d1029 req-0f9b142f-ca40-40c5-9961-7f6e5ce352c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:19.658403 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fa9aa6a2-f240-4fa8-9f31-3901614d1029 req-0f9b142f-ca40-40c5-9961-7f6e5ce352c4 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4837494 Dec 09 21:29:19.681785 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f956cec6-ff37-4db4-a6bf-44db68c74774 req-9bc93f28-6d21-4d71-8b15-6dd7b4f049b9 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:19.688997 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f956cec6-ff37-4db4-a6bf-44db68c74774 req-9bc93f28-6d21-4d71-8b15-6dd7b4f049b9 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:19.695032 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f956cec6-ff37-4db4-a6bf-44db68c74774 req-9bc93f28-6d21-4d71-8b15-6dd7b4f049b9 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:19.701240 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f956cec6-ff37-4db4-a6bf-44db68c74774 req-9bc93f28-6d21-4d71-8b15-6dd7b4f049b9 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:19.707614 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f956cec6-ff37-4db4-a6bf-44db68c74774 req-9bc93f28-6d21-4d71-8b15-6dd7b4f049b9 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:19.715262 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f956cec6-ff37-4db4-a6bf-44db68c74774 req-9bc93f28-6d21-4d71-8b15-6dd7b4f049b9 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:19.722242 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f956cec6-ff37-4db4-a6bf-44db68c74774 req-9bc93f28-6d21-4d71-8b15-6dd7b4f049b9 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:19.724639 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f956cec6-ff37-4db4-a6bf-44db68c74774 req-9bc93f28-6d21-4d71-8b15-6dd7b4f049b9 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5395 time: 0.1857893 Dec 09 21:29:19.731808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-e6f1905f-961a-4fb7-ab72-26f7d906f827 service neutron] For port 38f97951-e872-4c24-947f-934429895ad3, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=38f97951-e872-4c24-947f-934429895ad3,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:29:19.749549 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-560153d1-41a3-4039-9585-a0e843e477cd tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Made reservation on behalf of e9159c237df04f09a82d1c2eee1f573e for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:29:19.752964 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-560153d1-41a3-4039-9585-a0e843e477cd tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:19.756758 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-e6f1905f-961a-4fb7-ab72-26f7d906f827 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:19.758863 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.db.api [None req-d75667f6-20be-4b06-8fd1-c09855be284d admin admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Dec 09 21:29:19.758863 n-d-713301-27 neutron-server[103438]: [SQL: INSERT INTO reservations (project_id, id, expiration) VALUES (%(project_id)s, %(id)s, %(expiration)s)] Dec 09 21:29:19.758863 n-d-713301-27 neutron-server[103438]: [parameters: {'project_id': '92c07059a0e148b5a1b8c9e41d1d0178', 'id': '9a41dd69-b66d-42c9-b46b-2c9e2d2f44af', 'expiration': datetime.datetime(2021, 12, 9, 21, 31, 19, 733090)}] Dec 09 21:29:19.758863 n-d-713301-27 neutron-server[103438]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=103438) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:29:19.759199 n-d-713301-27 neutron-server[103438]: DEBUG oslo_db.api [None req-d75667f6-20be-4b06-8fd1-c09855be284d admin admin] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:29:19.841769 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6f1905f-961a-4fb7-ab72-26f7d906f827 service neutron] Pushing event updated for resources: {'Port': ['ID=38f97951-e872-4c24-947f-934429895ad3,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:19.867933 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b0fd1268-4dcd-4da0-b0b8-facfde4ec003 req-64e69387-ed84-4d95-9c18-884396c990ea tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/ports?device_id=312d3f8f-a9e2-4604-b559-13de6a525547 HTTP/1.1" status: 200 len: 210 time: 0.1362367 Dec 09 21:29:19.939647 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f956cec6-ff37-4db4-a6bf-44db68c74774 req-fdbc8e2a-63a9-43d9-a2df-d20fd294656b tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.2032089 Dec 09 21:29:19.953353 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-e6f1905f-961a-4fb7-ab72-26f7d906f827 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:19.956110 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-e6f1905f-961a-4fb7-ab72-26f7d906f827 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:19.957589 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-e6f1905f-961a-4fb7-ab72-26f7d906f827 service neutron] 10.222.0.10 "PUT /v2.0/ports/38f97951-e872-4c24-947f-934429895ad3 HTTP/1.1" status: 200 len: 1091 time: 3.0827589 Dec 09 21:29:19.995659 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f41c6942-2bae-4f6d-bcf9-2a20ae3f5ba5 service neutron] Request body: {'port': {'device_id': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:20.110917 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'tag': '38f97951-e872-4c24-947f-934429895ad3'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:20.115523 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aaab3a3e-1c52-4bcb-9cdb-17cc3f545943" -d '{"events": [{"name": "network-changed", "server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "tag": "38f97951-e872-4c24-947f-934429895ad3"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:20.149570 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f41c6942-2bae-4f6d-bcf9-2a20ae3f5ba5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:20.242400 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-560153d1-41a3-4039-9585-a0e843e477cd tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Allocated IP 172.20.0.3 (2700a60c-f75d-4026-8ff3-5e6bb9394ac1/b3687d43-b504-4450-b43d-3e7de97d09da/61aa5263-8686-42ca-a69d-76fd6420ede8) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:29:20.285242 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-82f1a493-284f-4a79-9f92-44be447cf134 x-openstack-request-id: req-82f1a493-284f-4a79-9f92-44be447cf134 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:20.285595 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "tag": "38f97951-e872-4c24-947f-934429895ad3", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:20.285889 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-82f1a493-284f-4a79-9f92-44be447cf134 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:20.286352 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'tag': '38f97951-e872-4c24-947f-934429895ad3', 'status': 'completed', 'code': 200} Dec 09 21:29:20.354507 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d90f665d-4bf4-4c66-905a-51e944074c91 req-945285d3-8568-4439-a677-e07409bf8fdf tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/ports?device_id=31a27c6f-f2ac-4eff-9039-700b918036ef HTTP/1.1" status: 200 len: 210 time: 0.0757234 Dec 09 21:29:20.365275 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42670) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:20.384932 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d75667f6-20be-4b06-8fd1-c09855be284d admin admin] Made reservation on behalf of 92c07059a0e148b5a1b8c9e41d1d0178 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:29:20.387507 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d75667f6-20be-4b06-8fd1-c09855be284d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:20.564256 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaab3a3e-1c52-4bcb-9cdb-17cc3f545943 req-5b96587e-b300-4bec-b3d5-bc64425a2ede service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:20.566123 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaab3a3e-1c52-4bcb-9cdb-17cc3f545943 req-5b96587e-b300-4bec-b3d5-bc64425a2ede service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:20.566800 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaab3a3e-1c52-4bcb-9cdb-17cc3f545943 req-5b96587e-b300-4bec-b3d5-bc64425a2ede service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:20.567402 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaab3a3e-1c52-4bcb-9cdb-17cc3f545943 req-5b96587e-b300-4bec-b3d5-bc64425a2ede service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:20.568017 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaab3a3e-1c52-4bcb-9cdb-17cc3f545943 req-5b96587e-b300-4bec-b3d5-bc64425a2ede service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:20.568646 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaab3a3e-1c52-4bcb-9cdb-17cc3f545943 req-5b96587e-b300-4bec-b3d5-bc64425a2ede service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:20.569265 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaab3a3e-1c52-4bcb-9cdb-17cc3f545943 req-5b96587e-b300-4bec-b3d5-bc64425a2ede service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:20.571706 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aaab3a3e-1c52-4bcb-9cdb-17cc3f545943 req-5b96587e-b300-4bec-b3d5-bc64425a2ede service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0a5d0e4652be4d8b87936a559840cc87&device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 6291 time: 0.2784979 Dec 09 21:29:20.585945 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d75667f6-20be-4b06-8fd1-c09855be284d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:20.641064 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-9b73cb38-42ac-4634-8666-b09cb0e5a0e0 admin admin] Deleting subnet 75afc53b-d3f3-461c-aba4-c2ce93780246 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:29:20.653340 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9b73cb38-42ac-4634-8666-b09cb0e5a0e0 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:20.658111 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-560153d1-41a3-4039-9585-a0e843e477cd tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:20.726766 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-560153d1-41a3-4039-9585-a0e843e477cd tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:20.734191 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9b73cb38-42ac-4634-8666-b09cb0e5a0e0 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:20.829104 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 12141f96-3d14-4c4d-a043-91223dcefddd no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:29:20.869740 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-560153d1-41a3-4039-9585-a0e843e477cd tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Network 2700a60c-f75d-4026-8ff3-5e6bb9394ac1 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:29:20.877649 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-560153d1-41a3-4039-9585-a0e843e477cd tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Pushing event updated for resources: {'Port': ['ID=61aa5263-8686-42ca-a69d-76fd6420ede8,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:20.884312 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-560153d1-41a3-4039-9585-a0e843e477cd tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:29:20.886048 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70374bb7-cb93-4a33-a399-188871e79c6d req-da61a553-0761-41c8-beb8-13b6dd1aa9f9 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:20.889575 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-560153d1-41a3-4039-9585-a0e843e477cd tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:29:20.890541 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 12141f96-3d14-4c4d-a043-91223dcefddd {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:29:20.891115 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 12141f96-3d14-4c4d-a043-91223dcefddd not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:29:20.899340 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70374bb7-cb93-4a33-a399-188871e79c6d req-da61a553-0761-41c8-beb8-13b6dd1aa9f9 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:20.906607 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70374bb7-cb93-4a33-a399-188871e79c6d req-da61a553-0761-41c8-beb8-13b6dd1aa9f9 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:20.916845 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70374bb7-cb93-4a33-a399-188871e79c6d req-da61a553-0761-41c8-beb8-13b6dd1aa9f9 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:20.940578 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70374bb7-cb93-4a33-a399-188871e79c6d req-da61a553-0761-41c8-beb8-13b6dd1aa9f9 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:20.959221 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70374bb7-cb93-4a33-a399-188871e79c6d req-da61a553-0761-41c8-beb8-13b6dd1aa9f9 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:20.959402 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaab3a3e-1c52-4bcb-9cdb-17cc3f545943 req-5e11bcdf-f8d3-4467-8b3c-62297ba96b33 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:20.959736 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaab3a3e-1c52-4bcb-9cdb-17cc3f545943 req-5e11bcdf-f8d3-4467-8b3c-62297ba96b33 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:20.960267 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaab3a3e-1c52-4bcb-9cdb-17cc3f545943 req-5e11bcdf-f8d3-4467-8b3c-62297ba96b33 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:20.961932 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aaab3a3e-1c52-4bcb-9cdb-17cc3f545943 req-5e11bcdf-f8d3-4467-8b3c-62297ba96b33 service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=0a5d0e4652be4d8b87936a559840cc87&shared=False HTTP/1.1" status: 200 len: 2296 time: 0.3691618 Dec 09 21:29:20.969344 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70374bb7-cb93-4a33-a399-188871e79c6d req-da61a553-0761-41c8-beb8-13b6dd1aa9f9 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:20.996440 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-70374bb7-cb93-4a33-a399-188871e79c6d req-da61a553-0761-41c8-beb8-13b6dd1aa9f9 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5420 time: 0.4640453 Dec 09 21:29:21.058036 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-560153d1-41a3-4039-9585-a0e843e477cd tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:21.058763 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-560153d1-41a3-4039-9585-a0e843e477cd tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:21.158954 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-560153d1-41a3-4039-9585-a0e843e477cd tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.7671688 Dec 09 21:29:21.187064 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-ed0f147a-84a4-4b19-a435-65abf9afa420 service neutron] Request body: {'port': {'device_id': '312d3f8f-a9e2-4604-b559-13de6a525547', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:21.300826 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaab3a3e-1c52-4bcb-9cdb-17cc3f545943 req-c25d023c-3321-4e47-8e8a-d4ca176f2c1b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:21.302378 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aaab3a3e-1c52-4bcb-9cdb-17cc3f545943 req-c25d023c-3321-4e47-8e8a-d4ca176f2c1b service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3309774 Dec 09 21:29:21.323135 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-ed0f147a-84a4-4b19-a435-65abf9afa420 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:21.558104 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d75667f6-20be-4b06-8fd1-c09855be284d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:21.639551 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9b73cb38-42ac-4634-8666-b09cb0e5a0e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:21.679994 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d75667f6-20be-4b06-8fd1-c09855be284d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:21.729698 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-ed0f147a-84a4-4b19-a435-65abf9afa420 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 61aa5263-8686-42ca-a69d-76fd6420ede8 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:21.743194 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-ed0f147a-84a4-4b19-a435-65abf9afa420 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:21.762006 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-ed0f147a-84a4-4b19-a435-65abf9afa420 service neutron] Transition to ACTIVE for port object 61aa5263-8686-42ca-a69d-76fd6420ede8 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:29:21.782425 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-ed0f147a-84a4-4b19-a435-65abf9afa420 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:21.865234 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d75667f6-20be-4b06-8fd1-c09855be284d admin admin] vlan segment allocate from pool success with {'vlan_id': 135, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:29:21.894233 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d75667f6-20be-4b06-8fd1-c09855be284d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:21.894967 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-d75667f6-20be-4b06-8fd1-c09855be284d admin admin] Added segment 5c616a6b-a5ac-4e30-84cd-253367ee4087 of type vlan for network c2fae4b3-aa79-4c93-b923-fc1ee0bed658 Dec 09 21:29:21.969422 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d75667f6-20be-4b06-8fd1-c09855be284d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1214fd64-d7c7-460b-ac97-ddbd3b64a318,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:22.025109 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d75667f6-20be-4b06-8fd1-c09855be284d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:22.034112 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f41c6942-2bae-4f6d-bcf9-2a20ae3f5ba5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 57519c10-1d02-4ce7-b4be-b37a7bd58b09 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:22.038193 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed0f147a-84a4-4b19-a435-65abf9afa420 service neutron] Pushing event updated for resources: {'Port': ['ID=61aa5263-8686-42ca-a69d-76fd6420ede8,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:22.065857 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1b941f2-e9e5-4e3d-801c-9d8aba5f993b req-abaaab3e-6c35-4e09-ae11-f9e18ea07267 tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:22.067562 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f1b941f2-e9e5-4e3d-801c-9d8aba5f993b req-abaaab3e-6c35-4e09-ae11-f9e18ea07267 tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/ports?device_id=312d3f8f-a9e2-4604-b559-13de6a525547 HTTP/1.1" status: 200 len: 931 time: 0.9242144 Dec 09 21:29:22.072143 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f41c6942-2bae-4f6d-bcf9-2a20ae3f5ba5 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:22.086665 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-70374bb7-cb93-4a33-a399-188871e79c6d req-d09cf753-056f-4fce-baff-0e38e050395c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.9821641 Dec 09 21:29:22.147904 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f1b941f2-e9e5-4e3d-801c-9d8aba5f993b req-c1bb7330-e869-427e-a9a3-7be872363ae7 tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/security-groups?id=872108a7-5ae2-4b16-8e57-f5d879884a6d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0585783 Dec 09 21:29:22.149615 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f41c6942-2bae-4f6d-bcf9-2a20ae3f5ba5 service neutron] Transition to ACTIVE for port object 57519c10-1d02-4ce7-b4be-b37a7bd58b09 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:29:22.151005 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9b73cb38-42ac-4634-8666-b09cb0e5a0e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:22.168913 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ea3e58-6571-4081-a041-f25342614c13 req-aa5058bc-5a77-43c8-8f64-662e43ec4583 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:22.170783 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-aa5058bc-5a77-43c8-8f64-662e43ec4583 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.10 "GET /v2.0/networks?id=0bcede63-0fdd-4d40-8c5c-4890fec5dc38 HTTP/1.1" status: 200 len: 818 time: 0.3847492 Dec 09 21:29:22.175168 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d75667f6-20be-4b06-8fd1-c09855be284d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:22.176124 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d75667f6-20be-4b06-8fd1-c09855be284d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:22.176704 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d75667f6-20be-4b06-8fd1-c09855be284d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:22.188134 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ea3e58-6571-4081-a041-f25342614c13 req-e974b887-0ad8-4f97-9ac1-36ae4dd61b12 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:22.192291 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-e974b887-0ad8-4f97-9ac1-36ae4dd61b12 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.31 "GET /v2.0/networks?id=0bcede63-0fdd-4d40-8c5c-4890fec5dc38 HTTP/1.1" status: 200 len: 818 time: 0.4236655 Dec 09 21:29:22.214760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-52ea3e58-6571-4081-a041-f25342614c13 req-e68f24ad-e808-4fcc-8a5d-cf9a60accf16 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Request body: {'port': {'device_id': 'ba78dacb-cf50-4182-b474-958412e2b568', 'network_id': '0bcede63-0fdd-4d40-8c5c-4890fec5dc38', 'admin_state_up': True, 'tenant_id': '6757323541bb47f99775de3a0132216b'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:22.228362 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-52ea3e58-6571-4081-a041-f25342614c13 req-b82b973a-39e1-4145-9e51-7d28eec6ff94 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Request body: {'port': {'device_id': 'd0b23879-8919-4f30-9aa0-db8d2f85e707', 'network_id': '0bcede63-0fdd-4d40-8c5c-4890fec5dc38', 'admin_state_up': True, 'tenant_id': '6757323541bb47f99775de3a0132216b'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:22.273598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b73cb38-42ac-4634-8666-b09cb0e5a0e0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=75afc53b-d3f3-461c-aba4-c2ce93780246,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:22.285435 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f41c6942-2bae-4f6d-bcf9-2a20ae3f5ba5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:22.313866 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-ed0f147a-84a4-4b19-a435-65abf9afa420 service neutron] Attempting to bind port 61aa5263-8686-42ca-a69d-76fd6420ede8 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:29:22.314487 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-ed0f147a-84a4-4b19-a435-65abf9afa420 service neutron] Attempting to bind port 61aa5263-8686-42ca-a69d-76fd6420ede8 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '156677c4-8e58-420b-a3a1-7c1c07b52a7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '2700a60c-f75d-4026-8ff3-5e6bb9394ac1'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:29:22.314625 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-ed0f147a-84a4-4b19-a435-65abf9afa420 service neutron] Attempting to bind port 61aa5263-8686-42ca-a69d-76fd6420ede8 on network 2700a60c-f75d-4026-8ff3-5e6bb9394ac1 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:22.325400 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d75667f6-20be-4b06-8fd1-c09855be284d admin admin] Pushing event updated for resources: {'Network': ['ID=c2fae4b3-aa79-4c93-b923-fc1ee0bed658,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:22.341993 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network c2fae4b3-aa79-4c93-b923-fc1ee0bed658 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:29:22.375536 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-ed0f147a-84a4-4b19-a435-65abf9afa420 service neutron] Port 61aa5263-8686-42ca-a69d-76fd6420ede8 on network 2700a60c-f75d-4026-8ff3-5e6bb9394ac1 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:29:22.375867 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-ed0f147a-84a4-4b19-a435-65abf9afa420 service neutron] Attempting to bind port 61aa5263-8686-42ca-a69d-76fd6420ede8 on network 2700a60c-f75d-4026-8ff3-5e6bb9394ac1 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:22.401226 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9b73cb38-42ac-4634-8666-b09cb0e5a0e0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:22.407009 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9b73cb38-42ac-4634-8666-b09cb0e5a0e0 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/75afc53b-d3f3-461c-aba4-c2ce93780246 HTTP/1.1" status: 204 len: 168 time: 2.0385473 Dec 09 21:29:22.419258 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42688) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:22.429187 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-371eb34e-686f-4a93-9ce2-13e08aa7520b req-6ce4dfed-e339-4d2b-b31e-c073250f7a90 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/ports?device_id=31a27c6f-f2ac-4eff-9039-700b918036ef HTTP/1.1" status: 200 len: 210 time: 0.1183610 Dec 09 21:29:22.435502 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-ed0f147a-84a4-4b19-a435-65abf9afa420 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:29:22.444507 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-ed0f147a-84a4-4b19-a435-65abf9afa420 service neutron] Checking segment: {'id': '156677c4-8e58-420b-a3a1-7c1c07b52a7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '2700a60c-f75d-4026-8ff3-5e6bb9394ac1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:29:22.445371 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-ed0f147a-84a4-4b19-a435-65abf9afa420 service neutron] Bound using segment: {'id': '156677c4-8e58-420b-a3a1-7c1c07b52a7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '2700a60c-f75d-4026-8ff3-5e6bb9394ac1'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:29:22.446056 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-ed0f147a-84a4-4b19-a435-65abf9afa420 service neutron] Bound port: 61aa5263-8686-42ca-a69d-76fd6420ede8, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '156677c4-8e58-420b-a3a1-7c1c07b52a7d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '2700a60c-f75d-4026-8ff3-5e6bb9394ac1'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:29:22.446663 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-ed0f147a-84a4-4b19-a435-65abf9afa420 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:22.479760 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d75667f6-20be-4b06-8fd1-c09855be284d admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 3.1752911 Dec 09 21:29:22.483615 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42690) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:22.503571 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-565ae9f8-5382-4cd6-bf72-1c506e5c4305 admin admin] Request body: {'subnet': {'network_id': 'c2fae4b3-aa79-4c93-b923-fc1ee0bed658', 'cidr': '172.20.0.0/28', 'name': 'tempest-VirtualInterfacesTestJSON-327061642-subnet', 'tenant_id': '92c07059a0e148b5a1b8c9e41d1d0178', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:22.608409 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-565ae9f8-5382-4cd6-bf72-1c506e5c4305 admin admin] Made reservation on behalf of 92c07059a0e148b5a1b8c9e41d1d0178 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:29:22.610486 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-565ae9f8-5382-4cd6-bf72-1c506e5c4305 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:22.647913 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f41c6942-2bae-4f6d-bcf9-2a20ae3f5ba5 service neutron] Pushing event updated for resources: {'Port': ['ID=57519c10-1d02-4ce7-b4be-b37a7bd58b09,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:22.661245 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-ed0f147a-84a4-4b19-a435-65abf9afa420 service neutron] For port 61aa5263-8686-42ca-a69d-76fd6420ede8, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:29:22.673125 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-52ea3e58-6571-4081-a041-f25342614c13 req-b82b973a-39e1-4145-9e51-7d28eec6ff94 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Made reservation on behalf of 6757323541bb47f99775de3a0132216b for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:29:22.676681 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-b82b973a-39e1-4145-9e51-7d28eec6ff94 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:22.726368 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-ed0f147a-84a4-4b19-a435-65abf9afa420 service neutron] For port 61aa5263-8686-42ca-a69d-76fd6420ede8, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=61aa5263-8686-42ca-a69d-76fd6420ede8,segment=NetworkSegment(156677c4-8e58-420b-a3a1-7c1c07b52a7d),segment_id=156677c4-8e58-420b-a3a1-7c1c07b52a7d)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:29:22.740266 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b18b1053-769e-4cf6-9781-bbceed97d384 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:22.747296 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-ed0f147a-84a4-4b19-a435-65abf9afa420 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:22.781258 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ea3e58-6571-4081-a041-f25342614c13 req-035b5dbc-e63c-440a-823e-245801e98f92 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:22.783534 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-035b5dbc-e63c-440a-823e-245801e98f92 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.31 "GET /v2.0/networks?id=0bcede63-0fdd-4d40-8c5c-4890fec5dc38 HTTP/1.1" status: 200 len: 818 time: 0.4881141 Dec 09 21:29:22.820311 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-52ea3e58-6571-4081-a041-f25342614c13 req-e68f24ad-e808-4fcc-8a5d-cf9a60accf16 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Made reservation on behalf of 6757323541bb47f99775de3a0132216b for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:29:22.823974 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-e68f24ad-e808-4fcc-8a5d-cf9a60accf16 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:22.824264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-776c8f2e-5705-4358-9930-753b46281b71 req-aa3f5550-d312-498d-b53e-a5d8f6e8459d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:22.830582 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 90180a85-620b-470e-b808-b635138111be details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:29:22.830858 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-ed0f147a-84a4-4b19-a435-65abf9afa420 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:22.831493 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-ed0f147a-84a4-4b19-a435-65abf9afa420 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:22.832902 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-776c8f2e-5705-4358-9930-753b46281b71 req-aa3f5550-d312-498d-b53e-a5d8f6e8459d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:22.833643 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-ed0f147a-84a4-4b19-a435-65abf9afa420 service neutron] 10.222.0.31 "PUT /v2.0/ports/61aa5263-8686-42ca-a69d-76fd6420ede8 HTTP/1.1" status: 200 len: 1092 time: 1.6643093 Dec 09 21:29:22.834142 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '312d3f8f-a9e2-4604-b559-13de6a525547', 'tag': '61aa5263-8686-42ca-a69d-76fd6420ede8'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:22.836546 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a245dfe2-e490-4716-b8ea-60bec5481d17" -d '{"events": [{"name": "network-changed", "server_uuid": "312d3f8f-a9e2-4604-b559-13de6a525547", "tag": "61aa5263-8686-42ca-a69d-76fd6420ede8"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:22.843467 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-776c8f2e-5705-4358-9930-753b46281b71 req-aa3f5550-d312-498d-b53e-a5d8f6e8459d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:22.853161 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-776c8f2e-5705-4358-9930-753b46281b71 req-aa3f5550-d312-498d-b53e-a5d8f6e8459d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:22.861356 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-776c8f2e-5705-4358-9930-753b46281b71 req-aa3f5550-d312-498d-b53e-a5d8f6e8459d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:22.868874 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-776c8f2e-5705-4358-9930-753b46281b71 req-aa3f5550-d312-498d-b53e-a5d8f6e8459d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:22.876891 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-776c8f2e-5705-4358-9930-753b46281b71 req-aa3f5550-d312-498d-b53e-a5d8f6e8459d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:22.878916 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-776c8f2e-5705-4358-9930-753b46281b71 req-aa3f5550-d312-498d-b53e-a5d8f6e8459d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5407 time: 0.6120329 Dec 09 21:29:22.901560 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-52ea3e58-6571-4081-a041-f25342614c13 req-c823e369-758f-44e0-bb13-d8beac827319 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Request body: {'port': {'device_id': '31a27c6f-f2ac-4eff-9039-700b918036ef', 'network_id': '0bcede63-0fdd-4d40-8c5c-4890fec5dc38', 'admin_state_up': True, 'tenant_id': '6757323541bb47f99775de3a0132216b'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:22.988083 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bd17edf7-8808-4bfd-b7c3-28553c054d81 x-openstack-request-id: req-bd17edf7-8808-4bfd-b7c3-28553c054d81 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:22.988433 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "312d3f8f-a9e2-4604-b559-13de6a525547", "tag": "61aa5263-8686-42ca-a69d-76fd6420ede8", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:22.988692 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-bd17edf7-8808-4bfd-b7c3-28553c054d81 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:22.989096 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '312d3f8f-a9e2-4604-b559-13de6a525547', 'tag': '61aa5263-8686-42ca-a69d-76fd6420ede8', 'status': 'completed', 'code': 200} Dec 09 21:29:23.007836 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed0f147a-84a4-4b19-a435-65abf9afa420 service neutron] Pushing event updated for resources: {'Port': ['ID=61aa5263-8686-42ca-a69d-76fd6420ede8,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:23.046418 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b18b1053-769e-4cf6-9781-bbceed97d384 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:23.047560 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 90180a85-620b-470e-b808-b635138111be, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=90180a85-620b-470e-b808-b635138111be,segment=NetworkSegment(f5a54e61-4fb1-4afa-9a27-98e2163b0365),segment_id=f5a54e61-4fb1-4afa-9a27-98e2163b0365)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:23.062786 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '90180a85-620b-470e-b808-b635138111be', 'network_id': 'f0373886-3db8-47eb-af65-78244497171e', 'port_id': '90180a85-620b-470e-b808-b635138111be', 'mac_address': 'fa:16:3e:65:8d:95', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 141, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '65df7637-0210-4526-a5dd-a692c26062b4', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:29:23.116844 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:23.148831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-b18b1053-769e-4cf6-9781-bbceed97d384 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4d446a14-1218-469d-93aa-b4f9babdbb6e']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:23.149434 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 90180a85-620b-470e-b808-b635138111be {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:23.149884 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-52ea3e58-6571-4081-a041-f25342614c13 req-b82b973a-39e1-4145-9e51-7d28eec6ff94 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Allocated IP 172.20.0.5 (0bcede63-0fdd-4d40-8c5c-4890fec5dc38/16184032-e4c1-40c2-a34f-a13c4226a14a/38b263bd-10f0-49ea-bef8-a6caba0ce784) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:29:23.166249 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f41c6942-2bae-4f6d-bcf9-2a20ae3f5ba5 service neutron] Attempting to bind port 57519c10-1d02-4ce7-b4be-b37a7bd58b09 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:29:23.166650 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f41c6942-2bae-4f6d-bcf9-2a20ae3f5ba5 service neutron] Attempting to bind port 57519c10-1d02-4ce7-b4be-b37a7bd58b09 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '06cdf949-c592-4827-b617-66043758d462', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:29:23.166913 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f41c6942-2bae-4f6d-bcf9-2a20ae3f5ba5 service neutron] Attempting to bind port 57519c10-1d02-4ce7-b4be-b37a7bd58b09 on network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:23.177417 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f41c6942-2bae-4f6d-bcf9-2a20ae3f5ba5 service neutron] Port 57519c10-1d02-4ce7-b4be-b37a7bd58b09 on network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:29:23.177899 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f41c6942-2bae-4f6d-bcf9-2a20ae3f5ba5 service neutron] Attempting to bind port 57519c10-1d02-4ce7-b4be-b37a7bd58b09 on network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:23.185440 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-b18b1053-769e-4cf6-9781-bbceed97d384 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e3c687b5-afac-4ac8-9b38-06599c2a8b7e') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:23.185965 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-b18b1053-769e-4cf6-9781-bbceed97d384 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e3c687b5-afac-4ac8-9b38-06599c2a8b7e') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:23.191723 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 90180a85-620b-470e-b808-b635138111be, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=90180a85-620b-470e-b808-b635138111be,segment=NetworkSegment(f5a54e61-4fb1-4afa-9a27-98e2163b0365),segment_id=f5a54e61-4fb1-4afa-9a27-98e2163b0365)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:23.197353 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:23.204703 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-79f5efc2-5b0c-4775-8c4f-dd6d8c136e1a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:23.204907 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-776c8f2e-5705-4358-9930-753b46281b71 req-9bdc0d79-de73-4676-a3e1-2a3f19c7108c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.2976382 Dec 09 21:29:23.205200 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-79f5efc2-5b0c-4775-8c4f-dd6d8c136e1a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e9159c237df04f09a82d1c2eee1f573e&device_id=312d3f8f-a9e2-4604-b559-13de6a525547 HTTP/1.1" status: 200 len: 1095 time: 0.2336566 Dec 09 21:29:23.224536 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f41c6942-2bae-4f6d-bcf9-2a20ae3f5ba5 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:29:23.224680 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f41c6942-2bae-4f6d-bcf9-2a20ae3f5ba5 service neutron] Checking segment: {'id': '06cdf949-c592-4827-b617-66043758d462', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:29:23.226456 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f41c6942-2bae-4f6d-bcf9-2a20ae3f5ba5 service neutron] Bound using segment: {'id': '06cdf949-c592-4827-b617-66043758d462', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:29:23.226456 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f41c6942-2bae-4f6d-bcf9-2a20ae3f5ba5 service neutron] Bound port: 57519c10-1d02-4ce7-b4be-b37a7bd58b09, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '06cdf949-c592-4827-b617-66043758d462', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:29:23.226456 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f41c6942-2bae-4f6d-bcf9-2a20ae3f5ba5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:23.233226 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b18b1053-769e-4cf6-9781-bbceed97d384 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:23.285943 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b18b1053-769e-4cf6-9781-bbceed97d384 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:23.298338 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-d4d970af-c090-479c-8acf-80caa5fbee63 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=61aa5263-8686-42ca-a69d-76fd6420ede8 HTTP/1.1" status: 200 len: 217 time: 0.0842106 Dec 09 21:29:23.321814 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b18b1053-769e-4cf6-9781-bbceed97d384 admin admin] Releasing vlan 138 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:29:23.322226 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b18b1053-769e-4cf6-9781-bbceed97d384 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:23.325597 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=90180a85-620b-470e-b808-b635138111be,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:29:23.326540 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:29:23.367950 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da7d92f8-1bce-411b-a394-12a8b5dcef6e req-1c4286ef-f4de-4806-9402-b75b52e413e0 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:23.373987 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da7d92f8-1bce-411b-a394-12a8b5dcef6e req-1c4286ef-f4de-4806-9402-b75b52e413e0 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:23.375398 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-565ae9f8-5382-4cd6-bf72-1c506e5c4305 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:23.379947 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da7d92f8-1bce-411b-a394-12a8b5dcef6e req-1c4286ef-f4de-4806-9402-b75b52e413e0 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:23.386158 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da7d92f8-1bce-411b-a394-12a8b5dcef6e req-1c4286ef-f4de-4806-9402-b75b52e413e0 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:23.392245 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da7d92f8-1bce-411b-a394-12a8b5dcef6e req-1c4286ef-f4de-4806-9402-b75b52e413e0 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:23.398488 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da7d92f8-1bce-411b-a394-12a8b5dcef6e req-1c4286ef-f4de-4806-9402-b75b52e413e0 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:23.404552 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da7d92f8-1bce-411b-a394-12a8b5dcef6e req-1c4286ef-f4de-4806-9402-b75b52e413e0 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:23.406566 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da7d92f8-1bce-411b-a394-12a8b5dcef6e req-1c4286ef-f4de-4806-9402-b75b52e413e0 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5421 time: 0.2014763 Dec 09 21:29:23.410303 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['90180a85-620b-470e-b808-b635138111be'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:29:23.425991 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-8b6a195b-fb4e-46e9-969a-4a655fffe189 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:23.427499 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-8b6a195b-fb4e-46e9-969a-4a655fffe189 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=b3687d43-b504-4450-b43d-3e7de97d09da HTTP/1.1" status: 200 len: 857 time: 0.1204824 Dec 09 21:29:23.436666 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-52ea3e58-6571-4081-a041-f25342614c13 req-c823e369-758f-44e0-bb13-d8beac827319 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Made reservation on behalf of 6757323541bb47f99775de3a0132216b for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:29:23.440238 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-c823e369-758f-44e0-bb13-d8beac827319 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:23.505938 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-10235fad-db8b-429d-9a39-43860a2c9858 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2700a60c-f75d-4026-8ff3-5e6bb9394ac1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0598977 Dec 09 21:29:23.521570 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b18b1053-769e-4cf6-9781-bbceed97d384 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:23.538602 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-565ae9f8-5382-4cd6-bf72-1c506e5c4305 admin admin] Pushing event updated for resources: {'Subnet': ['ID=87cbeff8-0c94-4fb3-a422-4e1dfa300f62,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:23.545428 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f41c6942-2bae-4f6d-bcf9-2a20ae3f5ba5 service neutron] For port 57519c10-1d02-4ce7-b4be-b37a7bd58b09, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:29:23.549118 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b18b1053-769e-4cf6-9781-bbceed97d384 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:23.552775 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b18b1053-769e-4cf6-9781-bbceed97d384 admin admin] 10.222.0.13 "DELETE /v2.0/networks/4d446a14-1218-469d-93aa-b4f9babdbb6e HTTP/1.1" status: 204 len: 168 time: 1.1163485 Dec 09 21:29:23.614869 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f41c6942-2bae-4f6d-bcf9-2a20ae3f5ba5 service neutron] For port 57519c10-1d02-4ce7-b4be-b37a7bd58b09, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=57519c10-1d02-4ce7-b4be-b37a7bd58b09,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:29:23.616788 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b18b1053-769e-4cf6-9781-bbceed97d384 admin admin] Pushing event deleted for resources: {'Network': ['ID=4d446a14-1218-469d-93aa-b4f9babdbb6e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:23.625410 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-565ae9f8-5382-4cd6-bf72-1c506e5c4305 admin admin] Checking segment: {'id': '5c616a6b-a5ac-4e30-84cd-253367ee4087', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'c2fae4b3-aa79-4c93-b923-fc1ee0bed658'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:29:23.625676 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-565ae9f8-5382-4cd6-bf72-1c506e5c4305 admin admin] Network hostable DHCP agents. Network: c2fae4b3-aa79-4c93-b923-fc1ee0bed658, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:29:23.641139 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f41c6942-2bae-4f6d-bcf9-2a20ae3f5ba5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:23.660670 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e86350c-ab40-4c1c-bf21-8a5fa992fe36 req-bb38251f-0fa6-49d8-9a56-8ddf5bf7e79b tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:23.662574 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e86350c-ab40-4c1c-bf21-8a5fa992fe36 req-bb38251f-0fa6-49d8-9a56-8ddf5bf7e79b tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/ports?device_id=312d3f8f-a9e2-4604-b559-13de6a525547 HTTP/1.1" status: 200 len: 943 time: 0.2546916 Dec 09 21:29:23.670939 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-b82b973a-39e1-4145-9e51-7d28eec6ff94 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:23.688714 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-565ae9f8-5382-4cd6-bf72-1c506e5c4305 admin admin] Network c2fae4b3-aa79-4c93-b923-fc1ee0bed658 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:29:23.705331 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-80a002ec-bbc0-4504-918e-a8970d815681 service neutron] 10.222.0.31 "GET /v2.0/networks/2700a60c-f75d-4026-8ff3-5e6bb9394ac1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1887825 Dec 09 21:29:23.712121 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da7d92f8-1bce-411b-a394-12a8b5dcef6e req-9768600d-3539-42d3-a781-3c729dceb73f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2695971 Dec 09 21:29:23.718590 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42708) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:23.720715 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-565ae9f8-5382-4cd6-bf72-1c506e5c4305 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, c2fae4b3-aa79-4c93-b923-fc1ee0bed658) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:29:23.754308 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-565ae9f8-5382-4cd6-bf72-1c506e5c4305 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:23.754308 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-565ae9f8-5382-4cd6-bf72-1c506e5c4305 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:23.754490 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e8354f5-aac2-44c1-beeb-0e84adab589b None None] Network c2fae4b3-aa79-4c93-b923-fc1ee0bed658 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:29:23.772579 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f41c6942-2bae-4f6d-bcf9-2a20ae3f5ba5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:23.773473 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f41c6942-2bae-4f6d-bcf9-2a20ae3f5ba5 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:23.775200 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-f41c6942-2bae-4f6d-bcf9-2a20ae3f5ba5 service neutron] 10.222.0.10 "PUT /v2.0/ports/57519c10-1d02-4ce7-b4be-b37a7bd58b09 HTTP/1.1" status: 200 len: 1092 time: 3.7842045 Dec 09 21:29:23.812237 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-b82b973a-39e1-4145-9e51-7d28eec6ff94 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:23.815753 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'tag': '57519c10-1d02-4ce7-b4be-b37a7bd58b09'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:23.819776 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0a2c0ddf-8ccf-475d-96c1-6d0133a8112f" -d '{"events": [{"name": "network-changed", "server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "tag": "57519c10-1d02-4ce7-b4be-b37a7bd58b09"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:23.850821 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-aa6504d0-e28f-4df4-a8e9-d7858936675e service neutron] Request body: {'port': {'device_id': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:23.875347 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-565ae9f8-5382-4cd6-bf72-1c506e5c4305 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 1.3700321 Dec 09 21:29:23.933011 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f41c6942-2bae-4f6d-bcf9-2a20ae3f5ba5 service neutron] Pushing event updated for resources: {'Port': ['ID=57519c10-1d02-4ce7-b4be-b37a7bd58b09,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:23.953122 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-52ea3e58-6571-4081-a041-f25342614c13 req-b82b973a-39e1-4145-9e51-7d28eec6ff94 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Network 0bcede63-0fdd-4d40-8c5c-4890fec5dc38 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:29:23.964294 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-38803a4a-fee6-41cc-b147-8218b87dbae7 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=18e7af94d60344a18dedc56eda040c4b&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2403097 Dec 09 21:29:23.965112 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42716) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:23.968620 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-52ea3e58-6571-4081-a041-f25342614c13 req-b82b973a-39e1-4145-9e51-7d28eec6ff94 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:29:23.970768 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b78fb66-408c-4f51-8347-f26d5b1b8995 None None] Network c2fae4b3-aa79-4c93-b923-fc1ee0bed658 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:29:23.977639 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e86350c-ab40-4c1c-bf21-8a5fa992fe36 req-2fcc0921-21c0-4787-b83b-f6ea70cdd516 tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/security-groups?id=872108a7-5ae2-4b16-8e57-f5d879884a6d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2841263 Dec 09 21:29:23.992873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-52ea3e58-6571-4081-a041-f25342614c13 req-b82b973a-39e1-4145-9e51-7d28eec6ff94 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:29:24.041734 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-31639423-396f-41b9-b834-3cf9ad3e6306 req-b5ca66e7-19fc-44f2-a46c-f9834594fbd1 service neutron] 10.222.0.31 "GET /v2.0/networks/2700a60c-f75d-4026-8ff3-5e6bb9394ac1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3191016 Dec 09 21:29:24.042326 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b82b973a-39e1-4145-9e51-7d28eec6ff94 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Pushing event updated for resources: {'Port': ['ID=38b263bd-10f0-49ea-bef8-a6caba0ce784,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:24.045595 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-52ea3e58-6571-4081-a041-f25342614c13 req-e68f24ad-e808-4fcc-8a5d-cf9a60accf16 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Allocated IP 172.20.0.11 (0bcede63-0fdd-4d40-8c5c-4890fec5dc38/16184032-e4c1-40c2-a34f-a13c4226a14a/723351f2-7c62-4bb5-aaad-288a6e26545f) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:29:24.089574 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ea3e58-6571-4081-a041-f25342614c13 req-b82b973a-39e1-4145-9e51-7d28eec6ff94 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:24.090275 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-b82b973a-39e1-4145-9e51-7d28eec6ff94 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:24.090795 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-aa6504d0-e28f-4df4-a8e9-d7858936675e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:24.104476 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6871688-1e2d-47d9-8112-d5a83e00bd78 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:24.131811 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-b82b973a-39e1-4145-9e51-7d28eec6ff94 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.9086599 Dec 09 21:29:24.150179 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3058adc5-8452-4451-a346-e338c605d9f5 req-72c33df9-4190-411c-840f-d757693e27d0 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/ports?device_id=31a27c6f-f2ac-4eff-9039-700b918036ef HTTP/1.1" status: 200 len: 210 time: 0.0388801 Dec 09 21:29:24.167058 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-63e873bf-fc8a-4c39-8012-6ed850ac41a3 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-securitygroup--1087225393&fields=id&tenant_id=77fc0831d6584a36b61a4823157f9c1d HTTP/1.1" status: 200 len: 267 time: 0.2437704 Dec 09 21:29:24.167193 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-52ea3e58-6571-4081-a041-f25342614c13 req-d0a67e47-b90e-432b-a72c-093be68c9e71 service neutron] Request body: {'port': {'device_id': 'd0b23879-8919-4f30-9aa0-db8d2f85e707', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:24.224073 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6871688-1e2d-47d9-8112-d5a83e00bd78 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:24.290445 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a245dfe2-e490-4716-b8ea-60bec5481d17 req-23b5e3ea-e3d0-48bd-9755-05e69c1d6fa1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:24.292009 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a245dfe2-e490-4716-b8ea-60bec5481d17 req-23b5e3ea-e3d0-48bd-9755-05e69c1d6fa1 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e9159c237df04f09a82d1c2eee1f573e&device_id=312d3f8f-a9e2-4604-b559-13de6a525547 HTTP/1.1" status: 200 len: 1095 time: 0.1594148 Dec 09 21:29:24.313819 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bbb88193-29a3-4183-86fd-3601374ed121 x-openstack-request-id: req-bbb88193-29a3-4183-86fd-3601374ed121 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:24.314247 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "tag": "57519c10-1d02-4ce7-b4be-b37a7bd58b09", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:24.314355 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-bbb88193-29a3-4183-86fd-3601374ed121 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:24.315394 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'tag': '57519c10-1d02-4ce7-b4be-b37a7bd58b09', 'status': 'completed', 'code': 200} Dec 09 21:29:24.323015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42722) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:24.328438 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-d0a67e47-b90e-432b-a72c-093be68c9e71 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:24.460594 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-3938cab6-d00f-47fd-b025-2d944f168961 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:24.462092 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-3938cab6-d00f-47fd-b025-2d944f168961 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/networks?id=b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6 HTTP/1.1" status: 200 len: 816 time: 0.2942433 Dec 09 21:29:24.483696 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-e68f24ad-e808-4fcc-8a5d-cf9a60accf16 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:24.500330 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-70b7d190-493d-4d01-a562-353a9590c06f admin admin] Deleting subnet 87cbeff8-0c94-4fb3-a422-4e1dfa300f62 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:29:24.508972 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-30326a71-262a-457a-a876-01e43864d229 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/quotas/77fc0831d6584a36b61a4823157f9c1d HTTP/1.1" status: 200 len: 375 time: 0.0387864 Dec 09 21:29:24.512596 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70b7d190-493d-4d01-a562-353a9590c06f admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:24.516959 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a2c0ddf-8ccf-475d-96c1-6d0133a8112f req-180b9702-11be-47e4-bef4-12aafdd877eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:24.517436 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a2c0ddf-8ccf-475d-96c1-6d0133a8112f req-180b9702-11be-47e4-bef4-12aafdd877eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:24.517902 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a2c0ddf-8ccf-475d-96c1-6d0133a8112f req-180b9702-11be-47e4-bef4-12aafdd877eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:24.518364 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a2c0ddf-8ccf-475d-96c1-6d0133a8112f req-180b9702-11be-47e4-bef4-12aafdd877eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:24.518835 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a2c0ddf-8ccf-475d-96c1-6d0133a8112f req-180b9702-11be-47e4-bef4-12aafdd877eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:24.519282 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a2c0ddf-8ccf-475d-96c1-6d0133a8112f req-180b9702-11be-47e4-bef4-12aafdd877eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:24.519911 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a2c0ddf-8ccf-475d-96c1-6d0133a8112f req-180b9702-11be-47e4-bef4-12aafdd877eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:24.522747 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0a2c0ddf-8ccf-475d-96c1-6d0133a8112f req-180b9702-11be-47e4-bef4-12aafdd877eb service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0a5d0e4652be4d8b87936a559840cc87&device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 6359 time: 0.1745284 Dec 09 21:29:24.526460 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a245dfe2-e490-4716-b8ea-60bec5481d17 req-4757017d-1379-493c-b46a-236739dfd601 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:24.527960 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6871688-1e2d-47d9-8112-d5a83e00bd78 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:24.528858 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a245dfe2-e490-4716-b8ea-60bec5481d17 req-4757017d-1379-493c-b46a-236739dfd601 service neutron] 10.222.0.31 "GET /v2.0/networks?id=2700a60c-f75d-4026-8ff3-5e6bb9394ac1 HTTP/1.1" status: 200 len: 918 time: 0.2265518 Dec 09 21:29:24.530746 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6871688-1e2d-47d9-8112-d5a83e00bd78 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:24.531927 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a6871688-1e2d-47d9-8112-d5a83e00bd78 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/09461f3e-b584-4926-824b-56cad478d61b HTTP/1.1" status: 204 len: 168 time: 0.5628324 Dec 09 21:29:24.597095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c576b80b-3976-4ef8-8ada-2b558e15c5d0 req-b34b3655-dc6e-486c-9cbb-029044e662db tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:24.602996 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c576b80b-3976-4ef8-8ada-2b558e15c5d0 req-b34b3655-dc6e-486c-9cbb-029044e662db tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:24.609121 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c576b80b-3976-4ef8-8ada-2b558e15c5d0 req-b34b3655-dc6e-486c-9cbb-029044e662db tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:24.615038 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c576b80b-3976-4ef8-8ada-2b558e15c5d0 req-b34b3655-dc6e-486c-9cbb-029044e662db tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:24.620986 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c576b80b-3976-4ef8-8ada-2b558e15c5d0 req-b34b3655-dc6e-486c-9cbb-029044e662db tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:24.626942 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c576b80b-3976-4ef8-8ada-2b558e15c5d0 req-b34b3655-dc6e-486c-9cbb-029044e662db tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:24.632893 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c576b80b-3976-4ef8-8ada-2b558e15c5d0 req-b34b3655-dc6e-486c-9cbb-029044e662db tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:24.634800 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c576b80b-3976-4ef8-8ada-2b558e15c5d0 req-b34b3655-dc6e-486c-9cbb-029044e662db tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5407 time: 0.2277248 Dec 09 21:29:24.652592 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6871688-1e2d-47d9-8112-d5a83e00bd78 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=09461f3e-b584-4926-824b-56cad478d61b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:24.665646 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a245dfe2-e490-4716-b8ea-60bec5481d17 req-adc86cec-6c72-4ed1-b1f1-91435ea5dc89 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=61aa5263-8686-42ca-a69d-76fd6420ede8 HTTP/1.1" status: 200 len: 217 time: 0.1158409 Dec 09 21:29:24.691784 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70b7d190-493d-4d01-a562-353a9590c06f admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:24.802728 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-ff55632c-057e-4a6c-bda1-9d0902cad760 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=77fc0831d6584a36b61a4823157f9c1d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.2684400 Dec 09 21:29:24.845027 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device b7cad057-c6e6-483b-9791-e1b1a0dd73ac details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:29:24.850797 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 90180a85-620b-470e-b808-b635138111be up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:29:24.867016 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70b7d190-493d-4d01-a562-353a9590c06f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:24.926254 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c576b80b-3976-4ef8-8ada-2b558e15c5d0 req-a6bf1e2a-842a-4e7f-ac8e-c4f120407da4 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.2423217 Dec 09 21:29:25.029126 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 90180a85-620b-470e-b808-b635138111be completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:29:25.038705 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 90180a85-620b-470e-b808-b635138111be triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:25.039127 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:25.072648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port b7cad057-c6e6-483b-9791-e1b1a0dd73ac, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=b7cad057-c6e6-483b-9791-e1b1a0dd73ac,segment=NetworkSegment(8ca86951-e612-4db0-90f4-834b52fd24e0),segment_id=8ca86951-e612-4db0-90f4-834b52fd24e0)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:25.090977 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'b7cad057-c6e6-483b-9791-e1b1a0dd73ac', 'network_id': 'a133a939-2827-4fe6-81f5-14715631c0ec', 'port_id': 'b7cad057-c6e6-483b-9791-e1b1a0dd73ac', 'mac_address': 'fa:16:3e:68:99:8b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 104, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '753ba647-b0b0-482e-ac28-89c7e6adf654', 'ip_address': '10.2.2.200'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:29:25.131020 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-aa6504d0-e28f-4df4-a8e9-d7858936675e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f6c2c656-c5c9-4a38-baf6-3924df82937d {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:25.154987 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-aa6504d0-e28f-4df4-a8e9-d7858936675e service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:25.173134 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-3fe348f8-96bd-431e-a261-b6a125527d75 service neutron] 10.222.0.13 "GET /v2.0/networks/b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3521106 Dec 09 21:29:25.175586 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70b7d190-493d-4d01-a562-353a9590c06f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:25.181465 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a2c0ddf-8ccf-475d-96c1-6d0133a8112f req-5865d5bf-98cf-4c71-bcaa-297d4884b198 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:25.181945 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a2c0ddf-8ccf-475d-96c1-6d0133a8112f req-5865d5bf-98cf-4c71-bcaa-297d4884b198 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:25.182581 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a2c0ddf-8ccf-475d-96c1-6d0133a8112f req-5865d5bf-98cf-4c71-bcaa-297d4884b198 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:25.185036 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0a2c0ddf-8ccf-475d-96c1-6d0133a8112f req-5865d5bf-98cf-4c71-bcaa-297d4884b198 service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=0a5d0e4652be4d8b87936a559840cc87&shared=False HTTP/1.1" status: 200 len: 2296 time: 0.6503868 Dec 09 21:29:25.187395 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a245dfe2-e490-4716-b8ea-60bec5481d17 req-f41b5178-666a-432a-9093-b7c46c685f45 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:25.189836 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a245dfe2-e490-4716-b8ea-60bec5481d17 req-f41b5178-666a-432a-9093-b7c46c685f45 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=b3687d43-b504-4450-b43d-3e7de97d09da HTTP/1.1" status: 200 len: 857 time: 0.0627778 Dec 09 21:29:25.197368 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:25.205819 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990c878e-ef46-497b-bba1-893816035a6f req-07eca74c-a067-4f66-90a1-d3c47dfb5200 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:25.212332 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:25.212699 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990c878e-ef46-497b-bba1-893816035a6f req-07eca74c-a067-4f66-90a1-d3c47dfb5200 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:25.219792 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990c878e-ef46-497b-bba1-893816035a6f req-07eca74c-a067-4f66-90a1-d3c47dfb5200 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:25.226217 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990c878e-ef46-497b-bba1-893816035a6f req-07eca74c-a067-4f66-90a1-d3c47dfb5200 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:25.234438 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990c878e-ef46-497b-bba1-893816035a6f req-07eca74c-a067-4f66-90a1-d3c47dfb5200 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:25.235401 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a245dfe2-e490-4716-b8ea-60bec5481d17 req-c435d602-b274-4854-b7cd-b00c29adf9d4 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2700a60c-f75d-4026-8ff3-5e6bb9394ac1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0294216 Dec 09 21:29:25.240283 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b7cad057-c6e6-483b-9791-e1b1a0dd73ac {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:25.242410 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990c878e-ef46-497b-bba1-893816035a6f req-07eca74c-a067-4f66-90a1-d3c47dfb5200 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:25.250288 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '90180a85-620b-470e-b808-b635138111be'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:25.250447 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990c878e-ef46-497b-bba1-893816035a6f req-07eca74c-a067-4f66-90a1-d3c47dfb5200 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:25.253639 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3a8f007d-3900-42dc-ad83-aa34f447e15a" -d '{"events": [{"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-plugged", "status": "completed", "tag": "90180a85-620b-470e-b808-b635138111be"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:25.259250 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-990c878e-ef46-497b-bba1-893816035a6f req-07eca74c-a067-4f66-90a1-d3c47dfb5200 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5421 time: 0.2439897 Dec 09 21:29:25.273540 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-aa6504d0-e28f-4df4-a8e9-d7858936675e service neutron] Transition to ACTIVE for port object f6c2c656-c5c9-4a38-baf6-3924df82937d will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:29:25.281693 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 90180a85-620b-470e-b808-b635138111be, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=90180a85-620b-470e-b808-b635138111be,segment=NetworkSegment(f5a54e61-4fb1-4afa-9a27-98e2163b0365),segment_id=f5a54e61-4fb1-4afa-9a27-98e2163b0365)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:25.291609 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port b7cad057-c6e6-483b-9791-e1b1a0dd73ac, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=b7cad057-c6e6-483b-9791-e1b1a0dd73ac,segment=NetworkSegment(8ca86951-e612-4db0-90f4-834b52fd24e0),segment_id=8ca86951-e612-4db0-90f4-834b52fd24e0)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:25.293706 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:25.301310 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-e68f24ad-e808-4fcc-8a5d-cf9a60accf16 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:25.323714 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:25.324681 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1e946a47-f496-445b-964b-618881eab263 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:29:25.366347 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-52ea3e58-6571-4081-a041-f25342614c13 req-e68f24ad-e808-4fcc-8a5d-cf9a60accf16 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Network 0bcede63-0fdd-4d40-8c5c-4890fec5dc38 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:29:25.370833 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-aa6504d0-e28f-4df4-a8e9-d7858936675e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:25.372986 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70b7d190-493d-4d01-a562-353a9590c06f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=87cbeff8-0c94-4fb3-a422-4e1dfa300f62,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:25.384854 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70b7d190-493d-4d01-a562-353a9590c06f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:25.391397 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-70b7d190-493d-4d01-a562-353a9590c06f admin admin] 10.222.0.13 "DELETE /v2.0/subnets/87cbeff8-0c94-4fb3-a422-4e1dfa300f62 HTTP/1.1" status: 204 len: 168 time: 1.0672808 Dec 09 21:29:25.397857 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e68f24ad-e808-4fcc-8a5d-cf9a60accf16 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Pushing event updated for resources: {'Port': ['ID=723351f2-7c62-4bb5-aaad-288a6e26545f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:25.402775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-52ea3e58-6571-4081-a041-f25342614c13 req-e68f24ad-e808-4fcc-8a5d-cf9a60accf16 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:29:25.403091 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42754) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:25.411782 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-52ea3e58-6571-4081-a041-f25342614c13 req-e68f24ad-e808-4fcc-8a5d-cf9a60accf16 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:29:25.465026 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=90180a85-620b-470e-b808-b635138111be,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:25.494724 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42756) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:25.527696 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.db.api [req-52ea3e58-6571-4081-a041-f25342614c13 req-c823e369-758f-44e0-bb13-d8beac827319 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Retry wrapper got retriable exception: Failed to create a duplicate IpamAllocation: for attribute(s) ['ipamallocations.PRIMARY'] with value(s) 172.20.0.5-43d23c62-b946-4e68-b6b5-b2a1f3a6ee48 {{(pid=103438) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:29:25.528080 n-d-713301-27 neutron-server[103438]: DEBUG oslo_db.api [req-52ea3e58-6571-4081-a041-f25342614c13 req-c823e369-758f-44e0-bb13-d8beac827319 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.create_port {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:29:25.528576 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=b7cad057-c6e6-483b-9791-e1b1a0dd73ac,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:25.562874 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1e946a47-f496-445b-964b-618881eab263, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1e946a47-f496-445b-964b-618881eab263,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:25.579424 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '1e946a47-f496-445b-964b-618881eab263', 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1', 'port_id': '1e946a47-f496-445b-964b-618881eab263', 'mac_address': 'fa:16:3e:68:c8:75', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 112, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a894075b-fa9f-4a27-9782-e476e86f74e0', 'ip_address': '10.1.1.81'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:29:25.627420 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ea3e58-6571-4081-a041-f25342614c13 req-e68f24ad-e808-4fcc-8a5d-cf9a60accf16 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:25.628139 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-e68f24ad-e808-4fcc-8a5d-cf9a60accf16 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:25.650409 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:25.654964 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a245dfe2-e490-4716-b8ea-60bec5481d17 req-14bb8f62-7cd2-4e3d-bdbe-80ac3141e5ad service neutron] 10.222.0.31 "GET /v2.0/networks/2700a60c-f75d-4026-8ff3-5e6bb9394ac1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4041736 Dec 09 21:29:25.772974 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a2c0ddf-8ccf-475d-96c1-6d0133a8112f req-a02e90dd-11f6-4a29-81df-ca2fe73e41e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:25.774580 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0a2c0ddf-8ccf-475d-96c1-6d0133a8112f req-a02e90dd-11f6-4a29-81df-ca2fe73e41e4 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.5798018 Dec 09 21:29:25.784692 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-fc82037d-12a9-4c77-8358-5444f6c910f5 admin admin] Request body: {'network': {'name': 'tempest-ServerActionsTestJSON-1559985225-network', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:25.810525 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a245dfe2-e490-4716-b8ea-60bec5481d17 req-10775f84-d10d-49e3-be45-fb582f73b97f service neutron] 10.222.0.31 "GET /v2.0/networks/2700a60c-f75d-4026-8ff3-5e6bb9394ac1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1412137 Dec 09 21:29:25.829660 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-e68f24ad-e808-4fcc-8a5d-cf9a60accf16 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.6270466 Dec 09 21:29:25.840637 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fc82037d-12a9-4c77-8358-5444f6c910f5 admin admin] Made reservation on behalf of a36a93590a9f45e1b9b3f78753bb8e12 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:29:25.844350 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fc82037d-12a9-4c77-8358-5444f6c910f5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:25.855373 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1e946a47-f496-445b-964b-618881eab263 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:25.860981 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-52ea3e58-6571-4081-a041-f25342614c13 req-0a072582-cde4-4644-92db-1090693a429e service neutron] Request body: {'port': {'device_id': 'ba78dacb-cf50-4182-b474-958412e2b568', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:25.874085 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fc82037d-12a9-4c77-8358-5444f6c910f5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:25.887062 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1e946a47-f496-445b-964b-618881eab263, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1e946a47-f496-445b-964b-618881eab263,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:25.893809 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:25.895137 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 145a0cde-0fe5-4163-a063-0fdfe42f243b details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:29:25.962841 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa6504d0-e28f-4df4-a8e9-d7858936675e service neutron] Pushing event updated for resources: {'Port': ['ID=f6c2c656-c5c9-4a38-baf6-3924df82937d,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:25.966518 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 145a0cde-0fe5-4163-a063-0fdfe42f243b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=145a0cde-0fe5-4163-a063-0fdfe42f243b,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:25.975468 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=1e946a47-f496-445b-964b-618881eab263,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:25.982192 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '145a0cde-0fe5-4163-a063-0fdfe42f243b', 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1', 'port_id': '145a0cde-0fe5-4163-a063-0fdfe42f243b', 'mac_address': 'fa:16:3e:df:5b:77', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 112, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a894075b-fa9f-4a27-9782-e476e86f74e0', 'ip_address': '10.1.1.31'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:29:26.016232 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-0a072582-cde4-4644-92db-1090693a429e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.026322 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.033337 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-c823e369-758f-44e0-bb13-d8beac827319 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.039873 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-990c878e-ef46-497b-bba1-893816035a6f req-5e3331a7-9260-4ad8-b39c-274108844e88 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.7792192 Dec 09 21:29:26.046921 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 145a0cde-0fe5-4163-a063-0fdfe42f243b {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:26.078131 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-958ed3e5-2295-4c95-9783-48ec2013c83c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.078307 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 145a0cde-0fe5-4163-a063-0fdfe42f243b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=145a0cde-0fe5-4163-a063-0fdfe42f243b,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:26.078412 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-8cf7054e-9f81-473e-ad22-bc1c4a3e8a0a service neutron] 10.222.0.13 "GET /v2.0/networks/b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8855901 Dec 09 21:29:26.088282 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.090883 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device d0dcf098-4522-4347-b733-bbc98e48d7e0 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:29:26.177062 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-52ea3e58-6571-4081-a041-f25342614c13 req-d0a67e47-b90e-432b-a72c-093be68c9e71 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 38b263bd-10f0-49ea-bef8-a6caba0ce784 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:26.193902 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-d0a67e47-b90e-432b-a72c-093be68c9e71 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.211267 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=145a0cde-0fe5-4163-a063-0fdfe42f243b,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:26.215797 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port d0dcf098-4522-4347-b733-bbc98e48d7e0, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=d0dcf098-4522-4347-b733-bbc98e48d7e0,segment=NetworkSegment(8ca86951-e612-4db0-90f4-834b52fd24e0),segment_id=8ca86951-e612-4db0-90f4-834b52fd24e0)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:26.225638 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-52ea3e58-6571-4081-a041-f25342614c13 req-d0a67e47-b90e-432b-a72c-093be68c9e71 service neutron] Transition to ACTIVE for port object 38b263bd-10f0-49ea-bef8-a6caba0ce784 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:29:26.229930 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'd0dcf098-4522-4347-b733-bbc98e48d7e0', 'network_id': 'a133a939-2827-4fe6-81f5-14715631c0ec', 'port_id': 'd0dcf098-4522-4347-b733-bbc98e48d7e0', 'mac_address': 'fa:16:3e:cc:7b:98', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 104, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '753ba647-b0b0-482e-ac28-89c7e6adf654', 'ip_address': '10.2.2.100'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:29:26.231095 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fc82037d-12a9-4c77-8358-5444f6c910f5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.265847 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-d0a67e47-b90e-432b-a72c-093be68c9e71 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.272044 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fc82037d-12a9-4c77-8358-5444f6c910f5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.280204 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.280413 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-958ed3e5-2295-4c95-9783-48ec2013c83c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.304914 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d0dcf098-4522-4347-b733-bbc98e48d7e0 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:26.329235 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-aa6504d0-e28f-4df4-a8e9-d7858936675e service neutron] Attempting to bind port f6c2c656-c5c9-4a38-baf6-3924df82937d on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:29:26.329573 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-aa6504d0-e28f-4df4-a8e9-d7858936675e service neutron] Attempting to bind port f6c2c656-c5c9-4a38-baf6-3924df82937d by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'a40eb34b-04cf-427f-a562-8a47c01a297b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'ae9d25d5-c9a2-4627-a465-8324b17541d9'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:29:26.329899 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-aa6504d0-e28f-4df4-a8e9-d7858936675e service neutron] Attempting to bind port f6c2c656-c5c9-4a38-baf6-3924df82937d on network ae9d25d5-c9a2-4627-a465-8324b17541d9 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:26.331700 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port d0dcf098-4522-4347-b733-bbc98e48d7e0, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=d0dcf098-4522-4347-b733-bbc98e48d7e0,segment=NetworkSegment(8ca86951-e612-4db0-90f4-834b52fd24e0),segment_id=8ca86951-e612-4db0-90f4-834b52fd24e0)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:26.333774 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-958ed3e5-2295-4c95-9783-48ec2013c83c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c2fae4b3-aa79-4c93-b923-fc1ee0bed658']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:26.339519 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.340468 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 7b66d328-f18c-4d26-af51-99c1b1f1f05e details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:29:26.350054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-958ed3e5-2295-4c95-9783-48ec2013c83c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5c616a6b-a5ac-4e30-84cd-253367ee4087') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:26.350341 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-958ed3e5-2295-4c95-9783-48ec2013c83c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5c616a6b-a5ac-4e30-84cd-253367ee4087') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:26.351984 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-aa6504d0-e28f-4df4-a8e9-d7858936675e service neutron] Port f6c2c656-c5c9-4a38-baf6-3924df82937d on network ae9d25d5-c9a2-4627-a465-8324b17541d9 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:29:26.352303 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-aa6504d0-e28f-4df4-a8e9-d7858936675e service neutron] Attempting to bind port f6c2c656-c5c9-4a38-baf6-3924df82937d on network ae9d25d5-c9a2-4627-a465-8324b17541d9 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:26.368198 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9d1607a-37fb-41e3-8f85-2438fcac5c7f req-a467a45f-6de2-4614-91b0-c88552ec8dd3 tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:26.376264 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f9d1607a-37fb-41e3-8f85-2438fcac5c7f req-a467a45f-6de2-4614-91b0-c88552ec8dd3 tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/ports?device_id=312d3f8f-a9e2-4604-b559-13de6a525547 HTTP/1.1" status: 200 len: 943 time: 0.2132702 Dec 09 21:29:26.384012 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fc82037d-12a9-4c77-8358-5444f6c910f5 admin admin] vlan segment allocate from pool success with {'vlan_id': 139, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:29:26.389635 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-958ed3e5-2295-4c95-9783-48ec2013c83c admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.392440 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-aa6504d0-e28f-4df4-a8e9-d7858936675e service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:29:26.392755 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-aa6504d0-e28f-4df4-a8e9-d7858936675e service neutron] Checking segment: {'id': 'a40eb34b-04cf-427f-a562-8a47c01a297b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'ae9d25d5-c9a2-4627-a465-8324b17541d9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:29:26.393198 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-aa6504d0-e28f-4df4-a8e9-d7858936675e service neutron] Bound using segment: {'id': 'a40eb34b-04cf-427f-a562-8a47c01a297b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'ae9d25d5-c9a2-4627-a465-8324b17541d9'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:29:26.393636 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-aa6504d0-e28f-4df4-a8e9-d7858936675e service neutron] Bound port: f6c2c656-c5c9-4a38-baf6-3924df82937d, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a40eb34b-04cf-427f-a562-8a47c01a297b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'ae9d25d5-c9a2-4627-a465-8324b17541d9'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:29:26.394010 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-aa6504d0-e28f-4df4-a8e9-d7858936675e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.424177 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=d0dcf098-4522-4347-b733-bbc98e48d7e0,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:26.427615 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fc82037d-12a9-4c77-8358-5444f6c910f5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.427615 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-fc82037d-12a9-4c77-8358-5444f6c910f5 admin admin] Added segment 83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d of type vlan for network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a Dec 09 21:29:26.436339 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-958ed3e5-2295-4c95-9783-48ec2013c83c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.439041 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc82037d-12a9-4c77-8358-5444f6c910f5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6ed93d17-f72b-4798-a8c8-e7aa9862a531,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:26.463524 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 7b66d328-f18c-4d26-af51-99c1b1f1f05e, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=7b66d328-f18c-4d26-af51-99c1b1f1f05e,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:26.469579 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-958ed3e5-2295-4c95-9783-48ec2013c83c admin admin] Releasing vlan 135 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:29:26.469992 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-958ed3e5-2295-4c95-9783-48ec2013c83c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:29:26.471837 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:29:26.480784 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '7b66d328-f18c-4d26-af51-99c1b1f1f05e', 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1', 'port_id': '7b66d328-f18c-4d26-af51-99c1b1f1f05e', 'mac_address': 'fa:16:3e:d5:dc:5e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 112, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a894075b-fa9f-4a27-9782-e476e86f74e0', 'ip_address': '10.1.1.110'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:29:26.484852 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0a67e47-b90e-432b-a72c-093be68c9e71 service neutron] Pushing event updated for resources: {'Port': ['ID=38b263bd-10f0-49ea-bef8-a6caba0ce784,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:26.513635 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f9d1607a-37fb-41e3-8f85-2438fcac5c7f req-a259c6ab-6498-40b2-bdf3-1ccd3650225b tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/security-groups?id=872108a7-5ae2-4b16-8e57-f5d879884a6d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1344297 Dec 09 21:29:26.533359 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.549625 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7b66d328-f18c-4d26-af51-99c1b1f1f05e {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:26.577906 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 7b66d328-f18c-4d26-af51-99c1b1f1f05e, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=7b66d328-f18c-4d26-af51-99c1b1f1f05e,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:26.581507 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-aa6504d0-e28f-4df4-a8e9-d7858936675e service neutron] For port f6c2c656-c5c9-4a38-baf6-3924df82937d, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:29:26.585199 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.586013 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 3bbd0bd0-666a-4f39-abae-59f44d88319c details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:29:26.597588 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-aa6504d0-e28f-4df4-a8e9-d7858936675e service neutron] For port f6c2c656-c5c9-4a38-baf6-3924df82937d, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=f6c2c656-c5c9-4a38-baf6-3924df82937d,segment=NetworkSegment(a40eb34b-04cf-427f-a562-8a47c01a297b),segment_id=a40eb34b-04cf-427f-a562-8a47c01a297b)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:29:26.603793 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-958ed3e5-2295-4c95-9783-48ec2013c83c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.612656 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-958ed3e5-2295-4c95-9783-48ec2013c83c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.616297 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-958ed3e5-2295-4c95-9783-48ec2013c83c admin admin] 10.222.0.13 "DELETE /v2.0/networks/c2fae4b3-aa79-4c93-b923-fc1ee0bed658 HTTP/1.1" status: 204 len: 168 time: 1.2075613 Dec 09 21:29:26.620863 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-aa6504d0-e28f-4df4-a8e9-d7858936675e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.632252 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fc82037d-12a9-4c77-8358-5444f6c910f5 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.637324 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-958ed3e5-2295-4c95-9783-48ec2013c83c admin admin] Pushing event deleted for resources: {'Network': ['ID=c2fae4b3-aa79-4c93-b923-fc1ee0bed658,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:26.674936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-aa6504d0-e28f-4df4-a8e9-d7858936675e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:26.675752 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-aa6504d0-e28f-4df4-a8e9-d7858936675e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.677549 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-aa6504d0-e28f-4df4-a8e9-d7858936675e service neutron] 10.222.0.10 "PUT /v2.0/ports/f6c2c656-c5c9-4a38-baf6-3924df82937d HTTP/1.1" status: 200 len: 1092 time: 2.8441174 Dec 09 21:29:26.678631 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'tag': 'f6c2c656-c5c9-4a38-baf6-3924df82937d'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:26.682463 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d253a256-780b-4856-9d96-ebf8322d16e8" -d '{"events": [{"name": "network-changed", "server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "tag": "f6c2c656-c5c9-4a38-baf6-3924df82937d"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:26.722418 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-fc8357b4-4a64-4611-8795-bb07b454f964 service neutron] Request body: {'port': {'device_id': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:26.723975 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4e493cc6-16bd-46c1-bfaa-7bfe2a23bf1d x-openstack-request-id: req-4e493cc6-16bd-46c1-bfaa-7bfe2a23bf1d {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:26.726332 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-plugged", "status": "completed", "tag": "90180a85-620b-470e-b808-b635138111be", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:26.727073 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-4e493cc6-16bd-46c1-bfaa-7bfe2a23bf1d {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:26.729257 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '90180a85-620b-470e-b808-b635138111be', 'code': 200} Dec 09 21:29:26.735792 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa6504d0-e28f-4df4-a8e9-d7858936675e service neutron] Pushing event updated for resources: {'Port': ['ID=f6c2c656-c5c9-4a38-baf6-3924df82937d,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:26.741333 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-52ea3e58-6571-4081-a041-f25342614c13 req-d0a67e47-b90e-432b-a72c-093be68c9e71 service neutron] Attempting to bind port 38b263bd-10f0-49ea-bef8-a6caba0ce784 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:29:26.741714 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-52ea3e58-6571-4081-a041-f25342614c13 req-d0a67e47-b90e-432b-a72c-093be68c9e71 service neutron] Attempting to bind port 38b263bd-10f0-49ea-bef8-a6caba0ce784 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '4944fe1d-3354-4e33-b6be-75c5cb26e73d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '0bcede63-0fdd-4d40-8c5c-4890fec5dc38'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:29:26.741995 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52ea3e58-6571-4081-a041-f25342614c13 req-d0a67e47-b90e-432b-a72c-093be68c9e71 service neutron] Attempting to bind port 38b263bd-10f0-49ea-bef8-a6caba0ce784 on network 0bcede63-0fdd-4d40-8c5c-4890fec5dc38 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:26.785502 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52ea3e58-6571-4081-a041-f25342614c13 req-d0a67e47-b90e-432b-a72c-093be68c9e71 service neutron] Port 38b263bd-10f0-49ea-bef8-a6caba0ce784 on network 0bcede63-0fdd-4d40-8c5c-4890fec5dc38 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:29:26.785743 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52ea3e58-6571-4081-a041-f25342614c13 req-d0a67e47-b90e-432b-a72c-093be68c9e71 service neutron] Attempting to bind port 38b263bd-10f0-49ea-bef8-a6caba0ce784 on network 0bcede63-0fdd-4d40-8c5c-4890fec5dc38 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:26.794082 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-52ea3e58-6571-4081-a041-f25342614c13 req-0a072582-cde4-4644-92db-1090693a429e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 723351f2-7c62-4bb5-aaad-288a6e26545f {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:26.812285 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fc82037d-12a9-4c77-8358-5444f6c910f5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.814771 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fc82037d-12a9-4c77-8358-5444f6c910f5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:26.815831 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fc82037d-12a9-4c77-8358-5444f6c910f5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.819411 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 3bbd0bd0-666a-4f39-abae-59f44d88319c, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3bbd0bd0-666a-4f39-abae-59f44d88319c,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:26.828918 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=7b66d328-f18c-4d26-af51-99c1b1f1f05e,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:26.839846 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '3bbd0bd0-666a-4f39-abae-59f44d88319c', 'network_id': 'a859e4ba-764a-41c0-982d-5bf79a2797a1', 'port_id': '3bbd0bd0-666a-4f39-abae-59f44d88319c', 'mac_address': 'fa:16:3e:f1:ab:39', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 112, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a894075b-fa9f-4a27-9782-e476e86f74e0', 'ip_address': '10.1.1.206'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:29:26.866631 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ddf0fcdd-3f0f-4be0-8338-0290244d72d3 req-52ec27d0-0375-41c7-8bbb-886a7e693051 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/ports?device_id=31a27c6f-f2ac-4eff-9039-700b918036ef HTTP/1.1" status: 200 len: 210 time: 0.1348572 Dec 09 21:29:26.946365 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42778) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:26.960870 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.970878 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-fc8357b4-4a64-4611-8795-bb07b454f964 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:26.987731 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3bbd0bd0-666a-4f39-abae-59f44d88319c {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:27.003067 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-0a072582-cde4-4644-92db-1090693a429e service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:27.018922 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-52ea3e58-6571-4081-a041-f25342614c13 req-0a072582-cde4-4644-92db-1090693a429e service neutron] Transition to ACTIVE for port object 723351f2-7c62-4bb5-aaad-288a6e26545f will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:29:27.020378 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52ea3e58-6571-4081-a041-f25342614c13 req-d0a67e47-b90e-432b-a72c-093be68c9e71 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 28, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:29:27.020746 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52ea3e58-6571-4081-a041-f25342614c13 req-d0a67e47-b90e-432b-a72c-093be68c9e71 service neutron] Checking segment: {'id': '4944fe1d-3354-4e33-b6be-75c5cb26e73d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '0bcede63-0fdd-4d40-8c5c-4890fec5dc38'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:29:27.021546 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52ea3e58-6571-4081-a041-f25342614c13 req-d0a67e47-b90e-432b-a72c-093be68c9e71 service neutron] Bound using segment: {'id': '4944fe1d-3354-4e33-b6be-75c5cb26e73d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '0bcede63-0fdd-4d40-8c5c-4890fec5dc38'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:29:27.022024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-52ea3e58-6571-4081-a041-f25342614c13 req-d0a67e47-b90e-432b-a72c-093be68c9e71 service neutron] Bound port: 38b263bd-10f0-49ea-bef8-a6caba0ce784, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4944fe1d-3354-4e33-b6be-75c5cb26e73d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '0bcede63-0fdd-4d40-8c5c-4890fec5dc38'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:29:27.022392 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-d0a67e47-b90e-432b-a72c-093be68c9e71 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:27.032360 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fc82037d-12a9-4c77-8358-5444f6c910f5 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.5271173 Dec 09 21:29:27.037827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42782) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:27.041275 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-0a072582-cde4-4644-92db-1090693a429e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:27.049417 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc82037d-12a9-4c77-8358-5444f6c910f5 admin admin] Pushing event updated for resources: {'Network': ['ID=2c03082f-742a-4ae3-9d23-6178c7ff2a0a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:27.067772 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 3bbd0bd0-666a-4f39-abae-59f44d88319c, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3bbd0bd0-666a-4f39-abae-59f44d88319c,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:27.069738 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-0f70ca02-6330-4b4b-85f1-e5ef1aac6b86 admin admin] Request body: {'subnet': {'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerActionsTestJSON-1559985225-subnet', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:27.076753 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:29:27.084645 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:27.138542 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-52ea3e58-6571-4081-a041-f25342614c13 req-d0a67e47-b90e-432b-a72c-093be68c9e71 service neutron] For port 38b263bd-10f0-49ea-bef8-a6caba0ce784, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:29:27.142229 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-52ea3e58-6571-4081-a041-f25342614c13 req-d0a67e47-b90e-432b-a72c-093be68c9e71 service neutron] For port 38b263bd-10f0-49ea-bef8-a6caba0ce784, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=38b263bd-10f0-49ea-bef8-a6caba0ce784,segment=NetworkSegment(4944fe1d-3354-4e33-b6be-75c5cb26e73d),segment_id=4944fe1d-3354-4e33-b6be-75c5cb26e73d)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:29:27.170049 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-827f9591-558c-49f9-b4c0-d6634c45f9d0 req-141e95a7-178f-4ac8-92c5-7b30ebda1653 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 210 time: 0.1620834 Dec 09 21:29:27.225132 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:27.231578 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-d0a67e47-b90e-432b-a72c-093be68c9e71 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:27.254628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92dc2be3-973c-4c34-843d-8f5bcd4bb32b req-4ea8682f-aae5-4af3-bd28-b1a7e7444ad6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.254826 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:27.262285 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92dc2be3-973c-4c34-843d-8f5bcd4bb32b req-4ea8682f-aae5-4af3-bd28-b1a7e7444ad6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.272437 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92dc2be3-973c-4c34-843d-8f5bcd4bb32b req-4ea8682f-aae5-4af3-bd28-b1a7e7444ad6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.275734 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=3bbd0bd0-666a-4f39-abae-59f44d88319c,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:27.275867 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a072582-cde4-4644-92db-1090693a429e service neutron] Pushing event updated for resources: {'Port': ['ID=723351f2-7c62-4bb5-aaad-288a6e26545f,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:27.286345 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ea3e58-6571-4081-a041-f25342614c13 req-d0a67e47-b90e-432b-a72c-093be68c9e71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.286899 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-d0a67e47-b90e-432b-a72c-093be68c9e71 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:27.288377 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-d0a67e47-b90e-432b-a72c-093be68c9e71 service neutron] 10.222.0.31 "PUT /v2.0/ports/38b263bd-10f0-49ea-bef8-a6caba0ce784 HTTP/1.1" status: 200 len: 1092 time: 3.1432886 Dec 09 21:29:27.290900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd0b23879-8919-4f30-9aa0-db8d2f85e707', 'tag': '38b263bd-10f0-49ea-bef8-a6caba0ce784'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:27.292020 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92dc2be3-973c-4c34-843d-8f5bcd4bb32b req-4ea8682f-aae5-4af3-bd28-b1a7e7444ad6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.299903 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ab192a21-c36f-4f63-9ea2-e8f4b5e5db79" -d '{"events": [{"name": "network-changed", "server_uuid": "d0b23879-8919-4f30-9aa0-db8d2f85e707", "tag": "38b263bd-10f0-49ea-bef8-a6caba0ce784"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:27.300134 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92dc2be3-973c-4c34-843d-8f5bcd4bb32b req-4ea8682f-aae5-4af3-bd28-b1a7e7444ad6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.307513 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92dc2be3-973c-4c34-843d-8f5bcd4bb32b req-4ea8682f-aae5-4af3-bd28-b1a7e7444ad6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.317258 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92dc2be3-973c-4c34-843d-8f5bcd4bb32b req-4ea8682f-aae5-4af3-bd28-b1a7e7444ad6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.338288 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-92dc2be3-973c-4c34-843d-8f5bcd4bb32b req-4ea8682f-aae5-4af3-bd28-b1a7e7444ad6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5419 time: 0.3328145 Dec 09 21:29:27.353586 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7cd02bd3-5c55-404d-a660-48dec53ebe65 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=92c07059a0e148b5a1b8c9e41d1d0178&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4009845 Dec 09 21:29:27.356719 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42790) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:27.361988 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4d1e146b-b3ac-48c5-8ddf-3010a5e5d083 x-openstack-request-id: req-4d1e146b-b3ac-48c5-8ddf-3010a5e5d083 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:27.362283 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "tag": "f6c2c656-c5c9-4a38-baf6-3924df82937d", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:27.362696 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-4d1e146b-b3ac-48c5-8ddf-3010a5e5d083 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:27.363113 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'tag': 'f6c2c656-c5c9-4a38-baf6-3924df82937d', 'status': 'completed', 'code': 200} Dec 09 21:29:27.409414 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-52ea3e58-6571-4081-a041-f25342614c13 req-0a072582-cde4-4644-92db-1090693a429e service neutron] Attempting to bind port 723351f2-7c62-4bb5-aaad-288a6e26545f on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:29:27.409783 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-52ea3e58-6571-4081-a041-f25342614c13 req-0a072582-cde4-4644-92db-1090693a429e service neutron] Attempting to bind port 723351f2-7c62-4bb5-aaad-288a6e26545f by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '4944fe1d-3354-4e33-b6be-75c5cb26e73d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '0bcede63-0fdd-4d40-8c5c-4890fec5dc38'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:29:27.410071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52ea3e58-6571-4081-a041-f25342614c13 req-0a072582-cde4-4644-92db-1090693a429e service neutron] Attempting to bind port 723351f2-7c62-4bb5-aaad-288a6e26545f on network 0bcede63-0fdd-4d40-8c5c-4890fec5dc38 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:27.416717 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0f70ca02-6330-4b4b-85f1-e5ef1aac6b86 admin admin] Made reservation on behalf of a36a93590a9f45e1b9b3f78753bb8e12 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:29:27.419053 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0f70ca02-6330-4b4b-85f1-e5ef1aac6b86 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:27.449127 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52ea3e58-6571-4081-a041-f25342614c13 req-0a072582-cde4-4644-92db-1090693a429e service neutron] Port 723351f2-7c62-4bb5-aaad-288a6e26545f on network 0bcede63-0fdd-4d40-8c5c-4890fec5dc38 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:29:27.449514 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52ea3e58-6571-4081-a041-f25342614c13 req-0a072582-cde4-4644-92db-1090693a429e service neutron] Attempting to bind port 723351f2-7c62-4bb5-aaad-288a6e26545f on network 0bcede63-0fdd-4d40-8c5c-4890fec5dc38 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:27.464021 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0a67e47-b90e-432b-a72c-093be68c9e71 service neutron] Pushing event updated for resources: {'Port': ['ID=38b263bd-10f0-49ea-bef8-a6caba0ce784,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:27.480302 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52ea3e58-6571-4081-a041-f25342614c13 req-0a072582-cde4-4644-92db-1090693a429e service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 29, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:29:27.480825 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52ea3e58-6571-4081-a041-f25342614c13 req-0a072582-cde4-4644-92db-1090693a429e service neutron] Checking segment: {'id': '4944fe1d-3354-4e33-b6be-75c5cb26e73d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '0bcede63-0fdd-4d40-8c5c-4890fec5dc38'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:29:27.481401 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52ea3e58-6571-4081-a041-f25342614c13 req-0a072582-cde4-4644-92db-1090693a429e service neutron] Bound using segment: {'id': '4944fe1d-3354-4e33-b6be-75c5cb26e73d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '0bcede63-0fdd-4d40-8c5c-4890fec5dc38'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:29:27.482152 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-52ea3e58-6571-4081-a041-f25342614c13 req-0a072582-cde4-4644-92db-1090693a429e service neutron] Bound port: 723351f2-7c62-4bb5-aaad-288a6e26545f, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4944fe1d-3354-4e33-b6be-75c5cb26e73d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '0bcede63-0fdd-4d40-8c5c-4890fec5dc38'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:29:27.482817 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-0a072582-cde4-4644-92db-1090693a429e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:27.504481 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ea3e58-6571-4081-a041-f25342614c13 req-02711a94-d1f5-4ed4-9843-6018fcac9bd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.506062 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-02711a94-d1f5-4ed4-9843-6018fcac9bd9 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6757323541bb47f99775de3a0132216b&device_id=d0b23879-8919-4f30-9aa0-db8d2f85e707 HTTP/1.1" status: 200 len: 1095 time: 0.1464863 Dec 09 21:29:27.515424 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d253a256-780b-4856-9d96-ebf8322d16e8 req-b38ba904-fd92-4105-b13a-f649fa73f37a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.515901 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d253a256-780b-4856-9d96-ebf8322d16e8 req-b38ba904-fd92-4105-b13a-f649fa73f37a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.516370 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d253a256-780b-4856-9d96-ebf8322d16e8 req-b38ba904-fd92-4105-b13a-f649fa73f37a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.516839 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d253a256-780b-4856-9d96-ebf8322d16e8 req-b38ba904-fd92-4105-b13a-f649fa73f37a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.517308 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d253a256-780b-4856-9d96-ebf8322d16e8 req-b38ba904-fd92-4105-b13a-f649fa73f37a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.517773 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d253a256-780b-4856-9d96-ebf8322d16e8 req-b38ba904-fd92-4105-b13a-f649fa73f37a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.518204 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d253a256-780b-4856-9d96-ebf8322d16e8 req-b38ba904-fd92-4105-b13a-f649fa73f37a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.520374 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d253a256-780b-4856-9d96-ebf8322d16e8 req-b38ba904-fd92-4105-b13a-f649fa73f37a service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0a5d0e4652be4d8b87936a559840cc87&device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 6427 time: 0.1657825 Dec 09 21:29:27.533384 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['1e946a47-f496-445b-964b-618881eab263'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:29:27.550273 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-52ea3e58-6571-4081-a041-f25342614c13 req-c823e369-758f-44e0-bb13-d8beac827319 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Allocated IP 172.20.0.6 (0bcede63-0fdd-4d40-8c5c-4890fec5dc38/16184032-e4c1-40c2-a34f-a13c4226a14a/675f510c-c35a-468e-b70b-4abb34188642) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:29:27.572988 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['d0dcf098-4522-4347-b733-bbc98e48d7e0'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:29:27.646922 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['b7cad057-c6e6-483b-9791-e1b1a0dd73ac'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:29:27.668216 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-b7a34135-b6fd-4960-9597-602048a94183 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=38b263bd-10f0-49ea-bef8-a6caba0ce784 HTTP/1.1" status: 200 len: 217 time: 0.1461537 Dec 09 21:29:27.722994 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-92dc2be3-973c-4c34-843d-8f5bcd4bb32b req-b414567f-721c-48cb-91f3-b5ea2712ed53 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.3837798 Dec 09 21:29:27.743985 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d253a256-780b-4856-9d96-ebf8322d16e8 req-3097d464-dfdb-4376-9177-32e572027466 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.744459 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d253a256-780b-4856-9d96-ebf8322d16e8 req-3097d464-dfdb-4376-9177-32e572027466 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.744921 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d253a256-780b-4856-9d96-ebf8322d16e8 req-3097d464-dfdb-4376-9177-32e572027466 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.746517 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d253a256-780b-4856-9d96-ebf8322d16e8 req-3097d464-dfdb-4376-9177-32e572027466 service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=0a5d0e4652be4d8b87936a559840cc87&shared=False HTTP/1.1" status: 200 len: 2296 time: 0.1811945 Dec 09 21:29:27.777886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19501eef-ce81-4caf-b8dd-19c0ebeaa738 req-6d9d5212-8bd0-40b3-8ca0-f7061e7fa9af tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.785460 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19501eef-ce81-4caf-b8dd-19c0ebeaa738 req-6d9d5212-8bd0-40b3-8ca0-f7061e7fa9af tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.791883 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 61aa5263-8686-42ca-a69d-76fd6420ede8 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:29:27.801935 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19501eef-ce81-4caf-b8dd-19c0ebeaa738 req-6d9d5212-8bd0-40b3-8ca0-f7061e7fa9af tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.808087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19501eef-ce81-4caf-b8dd-19c0ebeaa738 req-6d9d5212-8bd0-40b3-8ca0-f7061e7fa9af tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.814922 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19501eef-ce81-4caf-b8dd-19c0ebeaa738 req-6d9d5212-8bd0-40b3-8ca0-f7061e7fa9af tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.830188 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19501eef-ce81-4caf-b8dd-19c0ebeaa738 req-6d9d5212-8bd0-40b3-8ca0-f7061e7fa9af tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.836389 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19501eef-ce81-4caf-b8dd-19c0ebeaa738 req-6d9d5212-8bd0-40b3-8ca0-f7061e7fa9af tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.844508 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19501eef-ce81-4caf-b8dd-19c0ebeaa738 req-6d9d5212-8bd0-40b3-8ca0-f7061e7fa9af tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5428 time: 0.4890869 Dec 09 21:29:27.863893 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d253a256-780b-4856-9d96-ebf8322d16e8 req-ec79e73b-f7c9-4afc-b1bc-82c6e5febdc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.866042 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d253a256-780b-4856-9d96-ebf8322d16e8 req-ec79e73b-f7c9-4afc-b1bc-82c6e5febdc0 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1025598 Dec 09 21:29:27.871584 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-70bcd13b-e253-49d1-be81-dd6e59b8b450 x-openstack-request-id: req-70bcd13b-e253-49d1-be81-dd6e59b8b450 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:27.871923 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d0b23879-8919-4f30-9aa0-db8d2f85e707", "tag": "38b263bd-10f0-49ea-bef8-a6caba0ce784", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:27.872093 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-70bcd13b-e253-49d1-be81-dd6e59b8b450 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:27.872894 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd0b23879-8919-4f30-9aa0-db8d2f85e707', 'tag': '38b263bd-10f0-49ea-bef8-a6caba0ce784', 'status': 'completed', 'code': 200} Dec 09 21:29:27.877206 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-52ea3e58-6571-4081-a041-f25342614c13 req-0a072582-cde4-4644-92db-1090693a429e service neutron] For port 723351f2-7c62-4bb5-aaad-288a6e26545f, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:29:27.889322 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ea3e58-6571-4081-a041-f25342614c13 req-eda8c943-2a6d-486c-a465-c47608b023fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.891227 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-eda8c943-2a6d-486c-a465-c47608b023fd service neutron] 10.222.0.31 "GET /v2.0/subnets?id=16184032-e4c1-40c2-a34f-a13c4226a14a HTTP/1.1" status: 200 len: 858 time: 0.2128551 Dec 09 21:29:27.896825 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-52ea3e58-6571-4081-a041-f25342614c13 req-0a072582-cde4-4644-92db-1090693a429e service neutron] For port 723351f2-7c62-4bb5-aaad-288a6e26545f, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=723351f2-7c62-4bb5-aaad-288a6e26545f,segment=NetworkSegment(4944fe1d-3354-4e33-b6be-75c5cb26e73d),segment_id=4944fe1d-3354-4e33-b6be-75c5cb26e73d)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:29:27.913852 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-06a4f0ab-5c1f-45fd-af4b-c2eb8dfaee8c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:27.920864 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-0a072582-cde4-4644-92db-1090693a429e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:27.940507 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-06a4f0ab-5c1f-45fd-af4b-c2eb8dfaee8c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:27.965961 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-f790ef1c-b3cd-4a37-9bce-1c7fd37e7758 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=0bcede63-0fdd-4d40-8c5c-4890fec5dc38&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0564442 Dec 09 21:29:27.992476 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ea3e58-6571-4081-a041-f25342614c13 req-0a072582-cde4-4644-92db-1090693a429e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:27.993154 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-0a072582-cde4-4644-92db-1090693a429e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:27.994763 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-0a072582-cde4-4644-92db-1090693a429e service neutron] 10.222.0.10 "PUT /v2.0/ports/723351f2-7c62-4bb5-aaad-288a6e26545f HTTP/1.1" status: 200 len: 1093 time: 2.1435497 Dec 09 21:29:27.996367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 61aa5263-8686-42ca-a69d-76fd6420ede8, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=61aa5263-8686-42ca-a69d-76fd6420ede8,segment=NetworkSegment(156677c4-8e58-420b-a3a1-7c1c07b52a7d),segment_id=156677c4-8e58-420b-a3a1-7c1c07b52a7d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:28.039951 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-06a4f0ab-5c1f-45fd-af4b-c2eb8dfaee8c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:28.043747 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-06a4f0ab-5c1f-45fd-af4b-c2eb8dfaee8c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:28.047476 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-06a4f0ab-5c1f-45fd-af4b-c2eb8dfaee8c admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/1214fd64-d7c7-460b-ac97-ddbd3b64a318 HTTP/1.1" status: 204 len: 168 time: 0.6714253 Dec 09 21:29:28.047644 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '61aa5263-8686-42ca-a69d-76fd6420ede8', 'network_id': '2700a60c-f75d-4026-8ff3-5e6bb9394ac1', 'port_id': '61aa5263-8686-42ca-a69d-76fd6420ede8', 'mac_address': 'fa:16:3e:65:ce:76', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 111, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b3687d43-b504-4450-b43d-3e7de97d09da', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:29:28.055097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a072582-cde4-4644-92db-1090693a429e service neutron] Pushing event updated for resources: {'Port': ['ID=723351f2-7c62-4bb5-aaad-288a6e26545f,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:28.144650 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06a4f0ab-5c1f-45fd-af4b-c2eb8dfaee8c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1214fd64-d7c7-460b-ac97-ddbd3b64a318,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:28.161247 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19501eef-ce81-4caf-b8dd-19c0ebeaa738 req-90586886-eba0-4506-ac9d-170829fbba1c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.3156278 Dec 09 21:29:28.173614 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:28.236877 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 61aa5263-8686-42ca-a69d-76fd6420ede8 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:28.306122 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55a38fec-2b63-4f41-be0e-8a94211263f4 req-69036e7d-1509-43dc-b1eb-43f1d64dcbc8 tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:28.315544 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-55a38fec-2b63-4f41-be0e-8a94211263f4 req-69036e7d-1509-43dc-b1eb-43f1d64dcbc8 tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/ports?device_id=312d3f8f-a9e2-4604-b559-13de6a525547 HTTP/1.1" status: 200 len: 943 time: 0.3227334 Dec 09 21:29:28.322511 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 61aa5263-8686-42ca-a69d-76fd6420ede8, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=61aa5263-8686-42ca-a69d-76fd6420ede8,segment=NetworkSegment(156677c4-8e58-420b-a3a1-7c1c07b52a7d),segment_id=156677c4-8e58-420b-a3a1-7c1c07b52a7d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:28.340621 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:28.347346 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ea3e58-6571-4081-a041-f25342614c13 req-9859c3e1-f352-4066-b9bc-40412bbade6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:28.348955 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-9859c3e1-f352-4066-b9bc-40412bbade6f service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=6757323541bb47f99775de3a0132216b&device_id=ba78dacb-cf50-4182-b474-958412e2b568 HTTP/1.1" status: 200 len: 1096 time: 0.2461889 Dec 09 21:29:28.422667 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-7756a459-dca8-44e9-ba60-8d52f20cfd13 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=723351f2-7c62-4bb5-aaad-288a6e26545f HTTP/1.1" status: 200 len: 217 time: 0.0639272 Dec 09 21:29:28.436691 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=61aa5263-8686-42ca-a69d-76fd6420ede8,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:28.439270 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-c8dfc5ec-27f2-4ec8-a950-60d6b2216d81 service neutron] 10.222.0.31 "GET /v2.0/networks/0bcede63-0fdd-4d40-8c5c-4890fec5dc38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4615881 Dec 09 21:29:28.475271 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e1da6557-39ea-49d7-a928-417ea82cfbd4 req-af14a18a-9d95-41b8-973c-0b016b7e21b7 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/ports?device_id=31a27c6f-f2ac-4eff-9039-700b918036ef HTTP/1.1" status: 200 len: 210 time: 0.0838451 Dec 09 21:29:28.554621 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-fc8357b4-4a64-4611-8795-bb07b454f964 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2c568c8f-47ca-4f47-ab71-187026ca02db {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:28.563879 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-7e926408-3640-4c34-83dd-7a1c883efe37 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:28.567103 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-7e926408-3640-4c34-83dd-7a1c883efe37 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.10 "GET /v2.0/networks?id=b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6 HTTP/1.1" status: 200 len: 816 time: 0.4555709 Dec 09 21:29:28.582063 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-55a38fec-2b63-4f41-be0e-8a94211263f4 req-a4b5eaf5-4603-4489-87a2-1ec6a458f7b5 tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/security-groups?id=872108a7-5ae2-4b16-8e57-f5d879884a6d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2635276 Dec 09 21:29:28.591073 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['61aa5263-8686-42ca-a69d-76fd6420ede8'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:29:28.600693 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-fc8357b4-4a64-4611-8795-bb07b454f964 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:28.606421 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-c823e369-758f-44e0-bb13-d8beac827319 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:28.645835 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1814d79f-67bb-4820-bb78-9baad735c578 req-74d8169f-7df6-4a75-a20a-8026b85a07fc tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 210 time: 0.0562942 Dec 09 21:29:28.656702 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['3bbd0bd0-666a-4f39-abae-59f44d88319c'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:29:28.663555 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0f70ca02-6330-4b4b-85f1-e5ef1aac6b86 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:28.671722 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ea3e58-6571-4081-a041-f25342614c13 req-6f16de6d-8821-436e-96fa-75695a892196 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:28.672807 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-fc8357b4-4a64-4611-8795-bb07b454f964 service neutron] Transition to ACTIVE for port object 2c568c8f-47ca-4f47-ab71-187026ca02db will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:29:28.673452 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-6f16de6d-8821-436e-96fa-75695a892196 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=16184032-e4c1-40c2-a34f-a13c4226a14a HTTP/1.1" status: 200 len: 858 time: 0.2292230 Dec 09 21:29:28.710531 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-fc8357b4-4a64-4611-8795-bb07b454f964 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:28.721517 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['7b66d328-f18c-4d26-af51-99c1b1f1f05e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:29:28.723617 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['145a0cde-0fe5-4163-a063-0fdfe42f243b'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:29:28.774665 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-210b5919-4e41-4bcc-95c8-db510e203ea7 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=0bcede63-0fdd-4d40-8c5c-4890fec5dc38&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0897748 Dec 09 21:29:28.836243 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc8357b4-4a64-4611-8795-bb07b454f964 service neutron] Pushing event updated for resources: {'Port': ['ID=2c568c8f-47ca-4f47-ab71-187026ca02db,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:28.894741 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f70ca02-6330-4b4b-85f1-e5ef1aac6b86 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d776263b-6b97-44cc-bef5-299b9262dfec,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:28.925190 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-1456ea13-45d4-4e54-8022-3eec7c2b6e88 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.10 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=77fc0831d6584a36b61a4823157f9c1d HTTP/1.1" status: 200 len: 380 time: 0.3394809 Dec 09 21:29:28.929190 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-cbfe2176-8f8b-430c-acdd-91e1485b5248 service neutron] 10.222.0.31 "GET /v2.0/networks/0bcede63-0fdd-4d40-8c5c-4890fec5dc38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4100716 Dec 09 21:29:28.943148 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f70ca02-6330-4b4b-85f1-e5ef1aac6b86 admin admin] Checking segment: {'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:29:28.943823 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f70ca02-6330-4b4b-85f1-e5ef1aac6b86 admin admin] Network hostable DHCP agents. Network: 2c03082f-742a-4ae3-9d23-6178c7ff2a0a, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:29:28.964334 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-c823e369-758f-44e0-bb13-d8beac827319 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:28.983529 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-89e8a45c-7903-453d-bb4e-7c8ffec19a50 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Request body: {'port': {'device_id': '752d9ac2-7383-4bdb-b56f-3c52855d7fc9', 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6', 'admin_state_up': True, 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'security_groups': ['02690a1b-c814-4a6b-a7d8-1252ee74106e']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:29.064978 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-52ea3e58-6571-4081-a041-f25342614c13 req-c823e369-758f-44e0-bb13-d8beac827319 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Network 0bcede63-0fdd-4d40-8c5c-4890fec5dc38 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:29:29.127833 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f70ca02-6330-4b4b-85f1-e5ef1aac6b86 admin admin] Network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:29:29.143909 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f76b6f7-6f56-4991-b32b-447440c275b5 req-877e2d8d-7758-43d3-8e19-19fbafe84ff6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:29.150570 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f76b6f7-6f56-4991-b32b-447440c275b5 req-877e2d8d-7758-43d3-8e19-19fbafe84ff6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:29.160331 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f76b6f7-6f56-4991-b32b-447440c275b5 req-877e2d8d-7758-43d3-8e19-19fbafe84ff6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:29.160472 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-68cee1e1-8c06-434d-97e3-0c0c27197e07 service neutron] 10.222.0.10 "GET /v2.0/networks/0bcede63-0fdd-4d40-8c5c-4890fec5dc38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3644292 Dec 09 21:29:29.169725 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f76b6f7-6f56-4991-b32b-447440c275b5 req-877e2d8d-7758-43d3-8e19-19fbafe84ff6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:29.174083 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab192a21-c36f-4f63-9ea2-e8f4b5e5db79 req-5ca77980-a51e-4d0e-8780-f6552f5c80e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:29.175673 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ab192a21-c36f-4f63-9ea2-e8f4b5e5db79 req-5ca77980-a51e-4d0e-8780-f6552f5c80e8 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6757323541bb47f99775de3a0132216b&device_id=d0b23879-8919-4f30-9aa0-db8d2f85e707 HTTP/1.1" status: 200 len: 1095 time: 0.1755092 Dec 09 21:29:29.177206 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f76b6f7-6f56-4991-b32b-447440c275b5 req-877e2d8d-7758-43d3-8e19-19fbafe84ff6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:29.184941 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f76b6f7-6f56-4991-b32b-447440c275b5 req-877e2d8d-7758-43d3-8e19-19fbafe84ff6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:29.196989 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f76b6f7-6f56-4991-b32b-447440c275b5 req-877e2d8d-7758-43d3-8e19-19fbafe84ff6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:29.199035 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f76b6f7-6f56-4991-b32b-447440c275b5 req-877e2d8d-7758-43d3-8e19-19fbafe84ff6 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5431 time: 0.3163679 Dec 09 21:29:29.205565 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-52ea3e58-6571-4081-a041-f25342614c13 req-c823e369-758f-44e0-bb13-d8beac827319 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:29:29.225777 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-52ea3e58-6571-4081-a041-f25342614c13 req-c823e369-758f-44e0-bb13-d8beac827319 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:29:29.302764 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1e946a47-f496-445b-964b-618881eab263 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:29:29.333361 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f76b6f7-6f56-4991-b32b-447440c275b5 req-cc7fcdd9-1a81-441d-8bf9-fc7ef38875c0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1141825 Dec 09 21:29:29.334030 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c823e369-758f-44e0-bb13-d8beac827319 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Pushing event updated for resources: {'Port': ['ID=675f510c-c35a-468e-b70b-4abb34188642,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:29.336712 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-0f70ca02-6330-4b4b-85f1-e5ef1aac6b86 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 2c03082f-742a-4ae3-9d23-6178c7ff2a0a) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:29:29.341730 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-fc8357b4-4a64-4611-8795-bb07b454f964 service neutron] Attempting to bind port 2c568c8f-47ca-4f47-ab71-187026ca02db on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:29:29.342142 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-fc8357b4-4a64-4611-8795-bb07b454f964 service neutron] Attempting to bind port 2c568c8f-47ca-4f47-ab71-187026ca02db by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'a40eb34b-04cf-427f-a562-8a47c01a297b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'ae9d25d5-c9a2-4627-a465-8324b17541d9'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:29:29.342547 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-fc8357b4-4a64-4611-8795-bb07b454f964 service neutron] Attempting to bind port 2c568c8f-47ca-4f47-ab71-187026ca02db on network ae9d25d5-c9a2-4627-a465-8324b17541d9 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:29.349464 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab192a21-c36f-4f63-9ea2-e8f4b5e5db79 req-e1ea2347-b51e-4ce0-a14c-d7ea441ee488 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:29.351592 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ab192a21-c36f-4f63-9ea2-e8f4b5e5db79 req-e1ea2347-b51e-4ce0-a14c-d7ea441ee488 service neutron] 10.222.0.31 "GET /v2.0/networks?id=0bcede63-0fdd-4d40-8c5c-4890fec5dc38 HTTP/1.1" status: 200 len: 919 time: 0.1488035 Dec 09 21:29:29.362962 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f70ca02-6330-4b4b-85f1-e5ef1aac6b86 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:29.363607 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0f70ca02-6330-4b4b-85f1-e5ef1aac6b86 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:29.402518 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0f70ca02-6330-4b4b-85f1-e5ef1aac6b86 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 2.3586240 Dec 09 21:29:29.403360 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-fc8357b4-4a64-4611-8795-bb07b454f964 service neutron] Port 2c568c8f-47ca-4f47-ab71-187026ca02db on network ae9d25d5-c9a2-4627-a465-8324b17541d9 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:29:29.403804 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-fc8357b4-4a64-4611-8795-bb07b454f964 service neutron] Attempting to bind port 2c568c8f-47ca-4f47-ab71-187026ca02db on network ae9d25d5-c9a2-4627-a465-8324b17541d9 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:29.406871 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87f29619-c9be-439a-bd74-6157f8480efc None None] Network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:29:29.407920 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42824) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:29.414649 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-fc8357b4-4a64-4611-8795-bb07b454f964 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 29, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:29:29.415092 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-fc8357b4-4a64-4611-8795-bb07b454f964 service neutron] Checking segment: {'id': 'a40eb34b-04cf-427f-a562-8a47c01a297b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'ae9d25d5-c9a2-4627-a465-8324b17541d9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:29:29.415578 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-fc8357b4-4a64-4611-8795-bb07b454f964 service neutron] Bound using segment: {'id': 'a40eb34b-04cf-427f-a562-8a47c01a297b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'ae9d25d5-c9a2-4627-a465-8324b17541d9'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:29:29.416178 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-fc8357b4-4a64-4611-8795-bb07b454f964 service neutron] Bound port: 2c568c8f-47ca-4f47-ab71-187026ca02db, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a40eb34b-04cf-427f-a562-8a47c01a297b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'ae9d25d5-c9a2-4627-a465-8324b17541d9'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:29:29.416521 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-fc8357b4-4a64-4611-8795-bb07b454f964 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:29.419173 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-58f9cc7a-323c-4b5a-a3b4-32a9aa8e8d1e admin admin] Request body: {'router': {'name': 'tempest-ServerActionsTestJSON-1559985225-router', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:29.454727 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ea3e58-6571-4081-a041-f25342614c13 req-c823e369-758f-44e0-bb13-d8beac827319 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:29.454727 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-c823e369-758f-44e0-bb13-d8beac827319 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:29.496826 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ab192a21-c36f-4f63-9ea2-e8f4b5e5db79 req-ade8510b-246a-4332-8522-97ee72497347 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=38b263bd-10f0-49ea-bef8-a6caba0ce784 HTTP/1.1" status: 200 len: 217 time: 0.1033785 Dec 09 21:29:29.514196 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-fc8357b4-4a64-4611-8795-bb07b454f964 service neutron] For port 2c568c8f-47ca-4f47-ab71-187026ca02db, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:29:29.518213 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-fc8357b4-4a64-4611-8795-bb07b454f964 service neutron] For port 2c568c8f-47ca-4f47-ab71-187026ca02db, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=2c568c8f-47ca-4f47-ab71-187026ca02db,segment=NetworkSegment(a40eb34b-04cf-427f-a562-8a47c01a297b),segment_id=a40eb34b-04cf-427f-a562-8a47c01a297b)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:29:29.530204 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-fc8357b4-4a64-4611-8795-bb07b454f964 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:29.550386 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c34968-e537-4b3d-8b7c-fa7155ca0d78 req-1a360d2d-03ec-49cc-b381-f4b6e20f9aac tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:29.558123 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c34968-e537-4b3d-8b7c-fa7155ca0d78 req-1a360d2d-03ec-49cc-b381-f4b6e20f9aac tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:29.565405 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c34968-e537-4b3d-8b7c-fa7155ca0d78 req-1a360d2d-03ec-49cc-b381-f4b6e20f9aac tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:29.572142 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c34968-e537-4b3d-8b7c-fa7155ca0d78 req-1a360d2d-03ec-49cc-b381-f4b6e20f9aac tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:29.587281 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c34968-e537-4b3d-8b7c-fa7155ca0d78 req-1a360d2d-03ec-49cc-b381-f4b6e20f9aac tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:29.594804 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c34968-e537-4b3d-8b7c-fa7155ca0d78 req-1a360d2d-03ec-49cc-b381-f4b6e20f9aac tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:29.602110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c34968-e537-4b3d-8b7c-fa7155ca0d78 req-1a360d2d-03ec-49cc-b381-f4b6e20f9aac tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:29.610809 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31c34968-e537-4b3d-8b7c-fa7155ca0d78 req-1a360d2d-03ec-49cc-b381-f4b6e20f9aac tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5428 time: 0.2833378 Dec 09 21:29:29.613723 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42830) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:29.719706 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-fc8357b4-4a64-4611-8795-bb07b454f964 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:29.720342 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-fc8357b4-4a64-4611-8795-bb07b454f964 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:29.721778 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-fc8357b4-4a64-4611-8795-bb07b454f964 service neutron] 10.222.0.10 "PUT /v2.0/ports/2c568c8f-47ca-4f47-ab71-187026ca02db HTTP/1.1" status: 200 len: 1092 time: 3.0065506 Dec 09 21:29:29.725052 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'tag': '2c568c8f-47ca-4f47-ab71-187026ca02db'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:29.727545 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-251c5726-69d9-4e3c-99d9-414bc5c142ec" -d '{"events": [{"name": "network-changed", "server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "tag": "2c568c8f-47ca-4f47-ab71-187026ca02db"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:29.807084 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4344faa6-d17d-4d11-9554-c24ad888488c req-2b3d6f20-9f57-47ae-b561-3d06fff78fbc tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:29.808755 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4344faa6-d17d-4d11-9554-c24ad888488c req-2b3d6f20-9f57-47ae-b561-3d06fff78fbc tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/ports?device_id=31a27c6f-f2ac-4eff-9039-700b918036ef HTTP/1.1" status: 200 len: 931 time: 0.1534340 Dec 09 21:29:29.837725 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc8357b4-4a64-4611-8795-bb07b454f964 service neutron] Pushing event updated for resources: {'Port': ['ID=2c568c8f-47ca-4f47-ab71-187026ca02db,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:29.892381 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31c34968-e537-4b3d-8b7c-fa7155ca0d78 req-53b99ee3-488d-4316-8edf-36946b6f47cd tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2801514 Dec 09 21:29:29.925903 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ba78dacb-cf50-4182-b474-958412e2b568', 'tag': '723351f2-7c62-4bb5-aaad-288a6e26545f'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:29.928243 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-653635e9-d395-48f7-8d0f-ef460c60c2ac" -d '{"events": [{"name": "network-changed", "server_uuid": "ba78dacb-cf50-4182-b474-958412e2b568", "tag": "723351f2-7c62-4bb5-aaad-288a6e26545f"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:29.931836 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.db.api [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-89e8a45c-7903-453d-bb4e-7c8ffec19a50 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Dec 09 21:29:29.931836 n-d-713301-27 neutron-server[103437]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Dec 09 21:29:29.931836 n-d-713301-27 neutron-server[103437]: [parameters: {'project_id_1': '77fc0831d6584a36b61a4823157f9c1d', 'expiration_1': datetime.datetime(2021, 12, 9, 21, 29, 9, 462388)}] Dec 09 21:29:29.931836 n-d-713301-27 neutron-server[103437]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=103437) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:29:29.932195 n-d-713301-27 neutron-server[103437]: DEBUG oslo_db.api [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-89e8a45c-7903-453d-bb4e-7c8ffec19a50 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:29:29.970953 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-032cd9e7-24c8-4916-818d-4680c7a98931 admin admin] Request body: {'network': {'name': 'tempest-ComputeTenantNetworksTest-1408388706-network', 'tenant_id': '85a6e1dda1094fc4ac53e74ece6bb8b8'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:29.971635 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58f9cc7a-323c-4b5a-a3b4-32a9aa8e8d1e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:29.972766 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58f9cc7a-323c-4b5a-a3b4-32a9aa8e8d1e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:30.015651 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-1514e235-58af-443c-a938-751fad90caa2 service neutron] 10.222.0.10 "GET /v2.0/networks/0bcede63-0fdd-4d40-8c5c-4890fec5dc38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8363357 Dec 09 21:29:30.035819 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-c823e369-758f-44e0-bb13-d8beac827319 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 7.1402719 Dec 09 21:29:30.037166 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab192a21-c36f-4f63-9ea2-e8f4b5e5db79 req-9859302f-bb1d-4cef-8db7-7b7636326bff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:30.038685 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ab192a21-c36f-4f63-9ea2-e8f4b5e5db79 req-9859302f-bb1d-4cef-8db7-7b7636326bff service neutron] 10.222.0.31 "GET /v2.0/subnets?id=16184032-e4c1-40c2-a34f-a13c4226a14a HTTP/1.1" status: 200 len: 858 time: 0.5282655 Dec 09 21:29:30.044084 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-997b36c7-149f-45f7-ae52-a258df41f4f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:30.044947 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-997b36c7-149f-45f7-ae52-a258df41f4f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:30.045667 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-997b36c7-149f-45f7-ae52-a258df41f4f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:30.046306 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-997b36c7-149f-45f7-ae52-a258df41f4f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:30.046945 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-997b36c7-149f-45f7-ae52-a258df41f4f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:30.047651 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-997b36c7-149f-45f7-ae52-a258df41f4f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:30.048280 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-997b36c7-149f-45f7-ae52-a258df41f4f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:30.052447 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-997b36c7-149f-45f7-ae52-a258df41f4f3 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0a5d0e4652be4d8b87936a559840cc87&device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 6495 time: 0.2715027 Dec 09 21:29:30.071809 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-52ea3e58-6571-4081-a041-f25342614c13 req-2a913687-86d7-4f76-b5ad-0a3080f9fffe service neutron] Request body: {'port': {'device_id': '31a27c6f-f2ac-4eff-9039-700b918036ef', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:30.074936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-032cd9e7-24c8-4916-818d-4680c7a98931 admin admin] Made reservation on behalf of 85a6e1dda1094fc4ac53e74ece6bb8b8 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:29:30.078029 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-032cd9e7-24c8-4916-818d-4680c7a98931 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:30.103090 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ab192a21-c36f-4f63-9ea2-e8f4b5e5db79 req-30765514-ac00-4c4a-8dee-e182bcd39806 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=0bcede63-0fdd-4d40-8c5c-4890fec5dc38&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0455782 Dec 09 21:29:30.125745 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-032cd9e7-24c8-4916-818d-4680c7a98931 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:30.144396 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58f9cc7a-323c-4b5a-a3b4-32a9aa8e8d1e admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:30.204525 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-a30d0aa8-a209-43c2-abe6-c122d6002752 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a HTTP/1.1" status: 200 len: 217 time: 0.1369245 Dec 09 21:29:30.204775 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 1e946a47-f496-445b-964b-618881eab263 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:29:30.214928 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4344faa6-d17d-4d11-9554-c24ad888488c req-e9010a3f-494c-417b-a6a5-6b4f107e9d77 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/security-groups?id=09be3411-a85c-42e3-aaf7-829301eec3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3818824 Dec 09 21:29:30.274579 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 1e946a47-f496-445b-964b-618881eab263 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:30.274813 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:30.324084 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8873b56d-3d37-4774-85b6-3f2563690e45 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'fixed_ips': [{'subnet_id': 'd776263b-6b97-44cc-bef5-299b9262dfec'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:29:30.324958 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8873b56d-3d37-4774-85b6-3f2563690e45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:30.355347 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58f9cc7a-323c-4b5a-a3b4-32a9aa8e8d1e admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:30.362069 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ab192a21-c36f-4f63-9ea2-e8f4b5e5db79 req-f6ba478f-cad4-4c71-9ac9-6573213f4158 service neutron] 10.222.0.31 "GET /v2.0/networks/0bcede63-0fdd-4d40-8c5c-4890fec5dc38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2292454 Dec 09 21:29:30.366007 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-16444cfd-3899-48d9-a8a7-2974583560e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:30.368243 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-16444cfd-3899-48d9-a8a7-2974583560e9 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=d989acab-7cdc-482f-a350-344dd6e11873 HTTP/1.1" status: 200 len: 856 time: 0.1504383 Dec 09 21:29:30.378121 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc2bd8ae-3b2b-4e30-85aa-aefbb83f90a5 req-0be923ce-28fb-41aa-94c9-51542fdf95fa tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:30.384389 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc2bd8ae-3b2b-4e30-85aa-aefbb83f90a5 req-0be923ce-28fb-41aa-94c9-51542fdf95fa tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/ports?device_id=312d3f8f-a9e2-4604-b559-13de6a525547 HTTP/1.1" status: 200 len: 944 time: 0.3571820 Dec 09 21:29:30.474275 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b685cbb-56de-49da-84ef-f21d6c399a58 req-dd8319ce-a038-4eed-b233-bf4d5d71c83a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 210 time: 0.1284320 Dec 09 21:29:30.481920 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-2a913687-86d7-4f76-b5ad-0a3080f9fffe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:30.560606 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc2bd8ae-3b2b-4e30-85aa-aefbb83f90a5 req-238ee25a-5799-4b6f-b254-a9dcf8d11a94 tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/security-groups?id=872108a7-5ae2-4b16-8e57-f5d879884a6d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1610591 Dec 09 21:29:30.561912 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ab192a21-c36f-4f63-9ea2-e8f4b5e5db79 req-72be0fb0-73cc-4d94-9524-e1dd77fea2e1 service neutron] 10.222.0.31 "GET /v2.0/networks/0bcede63-0fdd-4d40-8c5c-4890fec5dc38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1921422 Dec 09 21:29:30.562694 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-89e8a45c-7903-453d-bb4e-7c8ffec19a50 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Made reservation on behalf of 77fc0831d6584a36b61a4823157f9c1d for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:29:30.567855 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-89e8a45c-7903-453d-bb4e-7c8ffec19a50 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:30.591762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-8e295847-7b4f-43d6-a673-5f580f392d64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:30.596158 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-8873b56d-3d37-4774-85b6-3f2563690e45 None None] Allocated IP 172.20.0.2 (2c03082f-742a-4ae3-9d23-6178c7ff2a0a/d776263b-6b97-44cc-bef5-299b9262dfec/d2525219-68b7-4035-9de7-ec388a6121a8) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:29:30.602692 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-8e295847-7b4f-43d6-a673-5f580f392d64 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=361619eb-51a4-4728-b2cc-72e27ec4eca5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2144887 Dec 09 21:29:30.606582 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-75ce46cd-1790-422b-a379-8d639cebff13 x-openstack-request-id: req-75ce46cd-1790-422b-a379-8d639cebff13 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:30.607207 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "tag": "2c568c8f-47ca-4f47-ab71-187026ca02db", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:30.607642 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-75ce46cd-1790-422b-a379-8d639cebff13 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:30.609267 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'tag': '2c568c8f-47ca-4f47-ab71-187026ca02db', 'status': 'completed', 'code': 200} Dec 09 21:29:30.670230 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:30.711975 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1e946a47-f496-445b-964b-618881eab263, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1e946a47-f496-445b-964b-618881eab263,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:30.717530 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1e946a47-f496-445b-964b-618881eab263'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:30.720967 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1d53e123-ad14-4128-9cbf-9e7b3d22d6c6" -d '{"events": [{"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-plugged", "status": "completed", "tag": "1e946a47-f496-445b-964b-618881eab263"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:30.729726 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:30.731116 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device d0dcf098-4522-4347-b733-bbc98e48d7e0 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:29:30.745092 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-89e8a45c-7903-453d-bb4e-7c8ffec19a50 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Allocated IP 172.20.0.5 (b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6/93335bf9-6f1e-4484-ae25-dca4b03b29b4/5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:29:30.828175 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-032cd9e7-24c8-4916-818d-4680c7a98931 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:30.901173 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-032cd9e7-24c8-4916-818d-4680c7a98931 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:30.907266 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-89e8a45c-7903-453d-bb4e-7c8ffec19a50 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:30.939798 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8873b56d-3d37-4774-85b6-3f2563690e45 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:30.942408 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fd683d1d-8bc0-452c-a017-b66162cd1aa4 x-openstack-request-id: req-fd683d1d-8bc0-452c-a017-b66162cd1aa4 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:30.942961 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ba78dacb-cf50-4182-b474-958412e2b568", "tag": "723351f2-7c62-4bb5-aaad-288a6e26545f", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:30.942961 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-fd683d1d-8bc0-452c-a017-b66162cd1aa4 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:30.943356 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ba78dacb-cf50-4182-b474-958412e2b568', 'tag': '723351f2-7c62-4bb5-aaad-288a6e26545f', 'status': 'completed', 'code': 200} Dec 09 21:29:30.943484 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-032cd9e7-24c8-4916-818d-4680c7a98931 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0af9104d-ead6-4d7f-9022-ddec6d6967d9,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:30.959423 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-89e8a45c-7903-453d-bb4e-7c8ffec19a50 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:30.969166 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d0f286fc-fd1f-4e8a-bbca-babf00521a9c x-openstack-request-id: req-d0f286fc-fd1f-4e8a-bbca-babf00521a9c {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:30.970561 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-plugged", "status": "completed", "tag": "1e946a47-f496-445b-964b-618881eab263", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:30.972792 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-d0f286fc-fd1f-4e8a-bbca-babf00521a9c {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:30.974573 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1e946a47-f496-445b-964b-618881eab263', 'code': 200} Dec 09 21:29:30.974701 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-032cd9e7-24c8-4916-818d-4680c7a98931 admin admin] vlan segment allocate from pool success with {'vlan_id': 108, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:29:31.009763 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb03b9c9-4d06-4d81-bfb1-d816b009a434 req-52a2f950-d5cf-4430-bdb4-0c7094d2e960 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:31.015548 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8873b56d-3d37-4774-85b6-3f2563690e45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:31.017167 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb03b9c9-4d06-4d81-bfb1-d816b009a434 req-52a2f950-d5cf-4430-bdb4-0c7094d2e960 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:31.024054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb03b9c9-4d06-4d81-bfb1-d816b009a434 req-52a2f950-d5cf-4430-bdb4-0c7094d2e960 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:31.030888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb03b9c9-4d06-4d81-bfb1-d816b009a434 req-52a2f950-d5cf-4430-bdb4-0c7094d2e960 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:31.034694 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89e8a45c-7903-453d-bb4e-7c8ffec19a50 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Pushing event updated for resources: {'Port': ['ID=5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:31.040124 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb03b9c9-4d06-4d81-bfb1-d816b009a434 req-52a2f950-d5cf-4430-bdb4-0c7094d2e960 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:31.050251 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb03b9c9-4d06-4d81-bfb1-d816b009a434 req-52a2f950-d5cf-4430-bdb4-0c7094d2e960 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:31.065601 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb03b9c9-4d06-4d81-bfb1-d816b009a434 req-52a2f950-d5cf-4430-bdb4-0c7094d2e960 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:31.067208 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-89e8a45c-7903-453d-bb4e-7c8ffec19a50 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Network b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:29:31.070173 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-89e8a45c-7903-453d-bb4e-7c8ffec19a50 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:29:31.077570 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eb03b9c9-4d06-4d81-bfb1-d816b009a434 req-52a2f950-d5cf-4430-bdb4-0c7094d2e960 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5431 time: 0.3436317 Dec 09 21:29:31.082605 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-89e8a45c-7903-453d-bb4e-7c8ffec19a50 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:29:31.121360 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8873b56d-3d37-4774-85b6-3f2563690e45 None None] Network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:29:31.135108 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 723351f2-7c62-4bb5-aaad-288a6e26545f details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:29:31.242588 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-032cd9e7-24c8-4916-818d-4680c7a98931 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:31.242934 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-032cd9e7-24c8-4916-818d-4680c7a98931 admin admin] Added segment ae149259-a99b-4c2c-9236-3ea82985f5f6 of type vlan for network c0e00dcb-74fd-4e07-bd40-df626f86d494 Dec 09 21:29:31.249393 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-653635e9-d395-48f7-8d0f-ef460c60c2ac req-096f3126-0d93-41db-8f8b-d52e47be667c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:31.249393 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-653635e9-d395-48f7-8d0f-ef460c60c2ac req-096f3126-0d93-41db-8f8b-d52e47be667c service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=6757323541bb47f99775de3a0132216b&device_id=ba78dacb-cf50-4182-b474-958412e2b568 HTTP/1.1" status: 200 len: 1096 time: 0.3042552 Dec 09 21:29:31.258065 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-c492e394-21e3-4cb5-98c7-ef5c7f91fac4 service neutron] 10.222.0.10 "GET /v2.0/networks/361619eb-51a4-4728-b2cc-72e27ec4eca5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6336298 Dec 09 21:29:31.263381 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 723351f2-7c62-4bb5-aaad-288a6e26545f, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=723351f2-7c62-4bb5-aaad-288a6e26545f,segment=NetworkSegment(4944fe1d-3354-4e33-b6be-75c5cb26e73d),segment_id=4944fe1d-3354-4e33-b6be-75c5cb26e73d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:31.276843 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-8873b56d-3d37-4774-85b6-3f2563690e45 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:29:31.282757 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8873b56d-3d37-4774-85b6-3f2563690e45 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:29:31.318696 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-89e8a45c-7903-453d-bb4e-7c8ffec19a50 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:31.319497 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-89e8a45c-7903-453d-bb4e-7c8ffec19a50 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:31.360405 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '723351f2-7c62-4bb5-aaad-288a6e26545f', 'network_id': '0bcede63-0fdd-4d40-8c5c-4890fec5dc38', 'port_id': '723351f2-7c62-4bb5-aaad-288a6e26545f', 'mac_address': 'fa:16:3e:86:e5:67', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 105, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '16184032-e4c1-40c2-a34f-a13c4226a14a', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:29:31.377037 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-89e8a45c-7903-453d-bb4e-7c8ffec19a50 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.4451902 Dec 09 21:29:31.388697 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58f9cc7a-323c-4b5a-a3b4-32a9aa8e8d1e admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:31.390935 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-8873b56d-3d37-4774-85b6-3f2563690e45 None None] Attempting to bind port d2525219-68b7-4035-9de7-ec388a6121a8 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:29:31.391551 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-8873b56d-3d37-4774-85b6-3f2563690e45 None None] Attempting to bind port d2525219-68b7-4035-9de7-ec388a6121a8 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:29:31.392469 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8873b56d-3d37-4774-85b6-3f2563690e45 None None] Attempting to bind port d2525219-68b7-4035-9de7-ec388a6121a8 on network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:31.401845 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8873b56d-3d37-4774-85b6-3f2563690e45 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 29, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:29:31.402236 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8873b56d-3d37-4774-85b6-3f2563690e45 None None] Checking segment: {'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:29:31.402648 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8873b56d-3d37-4774-85b6-3f2563690e45 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:31.403101 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8873b56d-3d37-4774-85b6-3f2563690e45 None None] Bound using segment: {'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:29:31.404246 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-8873b56d-3d37-4774-85b6-3f2563690e45 None None] Bound port: d2525219-68b7-4035-9de7-ec388a6121a8, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:29:31.404663 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8873b56d-3d37-4774-85b6-3f2563690e45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:31.419833 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=1e946a47-f496-445b-964b-618881eab263,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:31.440333 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-e6430a84-33ba-4d95-9cd5-642e812d32cc service neutron] Request body: {'port': {'device_id': '752d9ac2-7383-4bdb-b56f-3c52855d7fc9', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:31.446482 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58f9cc7a-323c-4b5a-a3b4-32a9aa8e8d1e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:31.486197 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-8873b56d-3d37-4774-85b6-3f2563690e45 None None] For port d2525219-68b7-4035-9de7-ec388a6121a8, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:29:31.491059 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-8873b56d-3d37-4774-85b6-3f2563690e45 None None] For port d2525219-68b7-4035-9de7-ec388a6121a8, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d2525219-68b7-4035-9de7-ec388a6121a8,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:29:31.563703 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8873b56d-3d37-4774-85b6-3f2563690e45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:31.565380 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-653635e9-d395-48f7-8d0f-ef460c60c2ac req-80d515dc-1a0d-4097-9715-7c44cd82a53c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:31.567110 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-653635e9-d395-48f7-8d0f-ef460c60c2ac req-80d515dc-1a0d-4097-9715-7c44cd82a53c service neutron] 10.222.0.10 "GET /v2.0/networks?id=0bcede63-0fdd-4d40-8c5c-4890fec5dc38 HTTP/1.1" status: 200 len: 919 time: 0.2936554 Dec 09 21:29:31.570763 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-e6430a84-33ba-4d95-9cd5-642e812d32cc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:31.582266 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port d0dcf098-4522-4347-b733-bbc98e48d7e0 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:29:31.605664 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6980c997-1194-4025-8543-556c9b4dde0f None None] Provisioning complete for port 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:31.606085 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6980c997-1194-4025-8543-556c9b4dde0f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:31.629403 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-653635e9-d395-48f7-8d0f-ef460c60c2ac req-6ebf97a6-8b1f-4456-87c4-2361192cc426 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=723351f2-7c62-4bb5-aaad-288a6e26545f HTTP/1.1" status: 200 len: 217 time: 0.0532732 Dec 09 21:29:31.651863 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port d0dcf098-4522-4347-b733-bbc98e48d7e0 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:31.652579 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:31.710409 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-6980c997-1194-4025-8543-556c9b4dde0f None None] Port 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:29:31.723873 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:31.738809 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 723351f2-7c62-4bb5-aaad-288a6e26545f {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:31.743312 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8873b56d-3d37-4774-85b6-3f2563690e45 None None] Pushing event updated for resources: {'Port': ['ID=d2525219-68b7-4035-9de7-ec388a6121a8,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:31.797635 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-653635e9-d395-48f7-8d0f-ef460c60c2ac req-63c3070a-302c-436c-a85a-38b7dfdcb228 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:31.799226 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-653635e9-d395-48f7-8d0f-ef460c60c2ac req-63c3070a-302c-436c-a85a-38b7dfdcb228 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=16184032-e4c1-40c2-a34f-a13c4226a14a HTTP/1.1" status: 200 len: 858 time: 0.1478848 Dec 09 21:29:31.803775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-58f9cc7a-323c-4b5a-a3b4-32a9aa8e8d1e admin admin] Allocated IP 172.25.3.242 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/0bf80ece-82d7-4c64-8066-ef5107ea9e0d) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:29:31.829688 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:31.850736 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-032cd9e7-24c8-4916-818d-4680c7a98931 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:31.851282 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 38b263bd-10f0-49ea-bef8-a6caba0ce784 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:29:31.854392 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 61aa5263-8686-42ca-a69d-76fd6420ede8 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:29:31.903923 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-653635e9-d395-48f7-8d0f-ef460c60c2ac req-3b17f189-439a-4abb-aef5-b36284c845b5 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=0bcede63-0fdd-4d40-8c5c-4890fec5dc38&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0976753 Dec 09 21:29:31.923147 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eb03b9c9-4d06-4d81-bfb1-d816b009a434 req-2ad20c68-4727-439b-ac58-f115101e6926 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.8449275 Dec 09 21:29:31.937227 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 723351f2-7c62-4bb5-aaad-288a6e26545f, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=723351f2-7c62-4bb5-aaad-288a6e26545f,segment=NetworkSegment(4944fe1d-3354-4e33-b6be-75c5cb26e73d),segment_id=4944fe1d-3354-4e33-b6be-75c5cb26e73d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:31.963035 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:31.964952 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3a501a5-2e64-4f7f-a476-cf4ad31a5370 req-cc10612e-a926-4138-beb7-855547d980b5 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:31.983032 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3a501a5-2e64-4f7f-a476-cf4ad31a5370 req-cc10612e-a926-4138-beb7-855547d980b5 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:32.000169 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3a501a5-2e64-4f7f-a476-cf4ad31a5370 req-cc10612e-a926-4138-beb7-855547d980b5 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:32.021916 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port d0dcf098-4522-4347-b733-bbc98e48d7e0, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=d0dcf098-4522-4347-b733-bbc98e48d7e0,segment=NetworkSegment(8ca86951-e612-4db0-90f4-834b52fd24e0),segment_id=8ca86951-e612-4db0-90f4-834b52fd24e0)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:32.023595 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3a501a5-2e64-4f7f-a476-cf4ad31a5370 req-cc10612e-a926-4138-beb7-855547d980b5 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:32.025972 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 61aa5263-8686-42ca-a69d-76fd6420ede8 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:29:32.030603 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3a501a5-2e64-4f7f-a476-cf4ad31a5370 req-cc10612e-a926-4138-beb7-855547d980b5 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:32.040766 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3a501a5-2e64-4f7f-a476-cf4ad31a5370 req-cc10612e-a926-4138-beb7-855547d980b5 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:32.046638 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 61aa5263-8686-42ca-a69d-76fd6420ede8 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:32.047017 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:32.048050 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3a501a5-2e64-4f7f-a476-cf4ad31a5370 req-cc10612e-a926-4138-beb7-855547d980b5 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:32.050417 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3a501a5-2e64-4f7f-a476-cf4ad31a5370 req-cc10612e-a926-4138-beb7-855547d980b5 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5429 time: 0.9664273 Dec 09 21:29:32.054306 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-52ea3e58-6571-4081-a041-f25342614c13 req-2a913687-86d7-4f76-b5ad-0a3080f9fffe service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 675f510c-c35a-468e-b70b-4abb34188642 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:32.075545 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.db.resource_extend [None req-032cd9e7-24c8-4916-818d-4680c7a98931 admin admin] It took 0.18 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 09 21:29:32.086539 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-2a913687-86d7-4f76-b5ad-0a3080f9fffe service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:32.096811 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:32.114340 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.resource_extend [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] It took 0.15 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 09 21:29:32.118992 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device b7cad057-c6e6-483b-9791-e1b1a0dd73ac up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:29:32.143387 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8873b56d-3d37-4774-85b6-3f2563690e45 None None] Pushing event updated for resources: {'Port': ['ID=d2525219-68b7-4035-9de7-ec388a6121a8,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:32.167486 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-52ea3e58-6571-4081-a041-f25342614c13 req-2a913687-86d7-4f76-b5ad-0a3080f9fffe service neutron] Transition to ACTIVE for port object 675f510c-c35a-468e-b70b-4abb34188642 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:29:32.176468 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-032cd9e7-24c8-4916-818d-4680c7a98931 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:32.177445 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-032cd9e7-24c8-4916-818d-4680c7a98931 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:32.178040 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-032cd9e7-24c8-4916-818d-4680c7a98931 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:32.212932 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-2a913687-86d7-4f76-b5ad-0a3080f9fffe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:32.225950 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-032cd9e7-24c8-4916-818d-4680c7a98931 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 2.5978050 Dec 09 21:29:32.241950 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=723351f2-7c62-4bb5-aaad-288a6e26545f,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:32.301996 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-0af2a381-596f-4f9c-a6c0-f64c686761af service neutron] 10.222.0.10 "GET /v2.0/networks/361619eb-51a4-4728-b2cc-72e27ec4eca5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.9981492 Dec 09 21:29:32.342862 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-653635e9-d395-48f7-8d0f-ef460c60c2ac req-b7dfd850-ee11-4c2f-a0ac-de36d938bf40 service neutron] 10.222.0.10 "GET /v2.0/networks/0bcede63-0fdd-4d40-8c5c-4890fec5dc38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4176853 Dec 09 21:29:32.349426 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c140bd5d-b7b7-4dd1-9aab-c8320baa6fd0 req-c8156782-b9e3-4455-b3ef-17a5cf54ba40 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:32.352272 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c140bd5d-b7b7-4dd1-9aab-c8320baa6fd0 req-c8156782-b9e3-4455-b3ef-17a5cf54ba40 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/ports?device_id=31a27c6f-f2ac-4eff-9039-700b918036ef HTTP/1.1" status: 200 len: 931 time: 0.2819707 Dec 09 21:29:32.370336 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['723351f2-7c62-4bb5-aaad-288a6e26545f'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:29:32.443674 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-178cb3c7-85ee-4054-9561-ac14dfd50280 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.107&port_id=18d9d7fa-fedf-4844-90ef-6757eb984ae2 HTTP/1.1" status: 200 len: 217 time: 0.1098192 Dec 09 21:29:32.460675 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3a501a5-2e64-4f7f-a476-cf4ad31a5370 req-6c3cca8e-0dde-45ba-b27d-f993fd1a72d3 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.3980253 Dec 09 21:29:32.479734 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-032cd9e7-24c8-4916-818d-4680c7a98931 admin admin] Pushing event updated for resources: {'Network': ['ID=c0e00dcb-74fd-4e07-bd40-df626f86d494,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:32.479927 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-653635e9-d395-48f7-8d0f-ef460c60c2ac req-e52458ca-868f-45d3-a6db-759a930dc466 service neutron] 10.222.0.10 "GET /v2.0/networks/0bcede63-0fdd-4d40-8c5c-4890fec5dc38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1245003 Dec 09 21:29:32.548957 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a913687-86d7-4f76-b5ad-0a3080f9fffe service neutron] Pushing event updated for resources: {'Port': ['ID=675f510c-c35a-468e-b70b-4abb34188642,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:32.585792 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58f9cc7a-323c-4b5a-a3b4-32a9aa8e8d1e admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:32.615238 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 38b263bd-10f0-49ea-bef8-a6caba0ce784, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=38b263bd-10f0-49ea-bef8-a6caba0ce784,segment=NetworkSegment(4944fe1d-3354-4e33-b6be-75c5cb26e73d),segment_id=4944fe1d-3354-4e33-b6be-75c5cb26e73d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:32.631785 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network c0e00dcb-74fd-4e07-bd40-df626f86d494 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:29:32.634758 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '38b263bd-10f0-49ea-bef8-a6caba0ce784', 'network_id': '0bcede63-0fdd-4d40-8c5c-4890fec5dc38', 'port_id': '38b263bd-10f0-49ea-bef8-a6caba0ce784', 'mac_address': 'fa:16:3e:8c:7f:d2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 105, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '16184032-e4c1-40c2-a34f-a13c4226a14a', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:29:32.641605 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c140bd5d-b7b7-4dd1-9aab-c8320baa6fd0 req-166e6139-aaf8-4c54-891e-319ddac1c8c6 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/security-groups?id=09be3411-a85c-42e3-aaf7-829301eec3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2478218 Dec 09 21:29:32.655457 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-132abfe5-ba26-4960-8f3f-81cc0e752299 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:32.657430 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-132abfe5-ba26-4960-8f3f-81cc0e752299 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=871c2dc1-486e-4fcf-a882-5a1394082fc5 HTTP/1.1" status: 200 len: 797 time: 0.1956193 Dec 09 21:29:32.698960 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-e6430a84-33ba-4d95-9cd5-642e812d32cc service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:32.711488 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-e6430a84-33ba-4d95-9cd5-642e812d32cc service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:32.741084 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58f9cc7a-323c-4b5a-a3b4-32a9aa8e8d1e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:32.747882 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-e6430a84-33ba-4d95-9cd5-642e812d32cc service neutron] Transition to ACTIVE for port object 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:29:32.753314 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-52ea3e58-6571-4081-a041-f25342614c13 req-2a913687-86d7-4f76-b5ad-0a3080f9fffe service neutron] Attempting to bind port 675f510c-c35a-468e-b70b-4abb34188642 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:29:32.755203 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-52ea3e58-6571-4081-a041-f25342614c13 req-2a913687-86d7-4f76-b5ad-0a3080f9fffe service neutron] Attempting to bind port 675f510c-c35a-468e-b70b-4abb34188642 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '4944fe1d-3354-4e33-b6be-75c5cb26e73d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '0bcede63-0fdd-4d40-8c5c-4890fec5dc38'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:29:32.756060 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52ea3e58-6571-4081-a041-f25342614c13 req-2a913687-86d7-4f76-b5ad-0a3080f9fffe service neutron] Attempting to bind port 675f510c-c35a-468e-b70b-4abb34188642 on network 0bcede63-0fdd-4d40-8c5c-4890fec5dc38 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:32.781754 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=d0dcf098-4522-4347-b733-bbc98e48d7e0,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:32.793744 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52ea3e58-6571-4081-a041-f25342614c13 req-2a913687-86d7-4f76-b5ad-0a3080f9fffe service neutron] Port 675f510c-c35a-468e-b70b-4abb34188642 on network 0bcede63-0fdd-4d40-8c5c-4890fec5dc38 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:29:32.794306 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52ea3e58-6571-4081-a041-f25342614c13 req-2a913687-86d7-4f76-b5ad-0a3080f9fffe service neutron] Attempting to bind port 675f510c-c35a-468e-b70b-4abb34188642 on network 0bcede63-0fdd-4d40-8c5c-4890fec5dc38 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:32.807752 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-e6430a84-33ba-4d95-9cd5-642e812d32cc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:32.819703 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52ea3e58-6571-4081-a041-f25342614c13 req-2a913687-86d7-4f76-b5ad-0a3080f9fffe service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 29, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:29:32.820101 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52ea3e58-6571-4081-a041-f25342614c13 req-2a913687-86d7-4f76-b5ad-0a3080f9fffe service neutron] Checking segment: {'id': '4944fe1d-3354-4e33-b6be-75c5cb26e73d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '0bcede63-0fdd-4d40-8c5c-4890fec5dc38'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:29:32.820425 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-52ea3e58-6571-4081-a041-f25342614c13 req-2a913687-86d7-4f76-b5ad-0a3080f9fffe service neutron] Bound using segment: {'id': '4944fe1d-3354-4e33-b6be-75c5cb26e73d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '0bcede63-0fdd-4d40-8c5c-4890fec5dc38'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:29:32.820872 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-52ea3e58-6571-4081-a041-f25342614c13 req-2a913687-86d7-4f76-b5ad-0a3080f9fffe service neutron] Bound port: 675f510c-c35a-468e-b70b-4abb34188642, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4944fe1d-3354-4e33-b6be-75c5cb26e73d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '0bcede63-0fdd-4d40-8c5c-4890fec5dc38'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:29:32.821228 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-2a913687-86d7-4f76-b5ad-0a3080f9fffe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:32.846259 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port b7cad057-c6e6-483b-9791-e1b1a0dd73ac completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:29:32.876817 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port b7cad057-c6e6-483b-9791-e1b1a0dd73ac triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:32.877196 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:32.880077 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-58f9cc7a-323c-4b5a-a3b4-32a9aa8e8d1e admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:29:32.881784 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-dd857c27-3b3e-4705-bd94-604d57cb45c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:32.884083 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-dd857c27-3b3e-4705-bd94-604d57cb45c2 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.2176473 Dec 09 21:29:32.885982 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-58f9cc7a-323c-4b5a-a3b4-32a9aa8e8d1e admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:29:32.895250 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58f9cc7a-323c-4b5a-a3b4-32a9aa8e8d1e admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:29:32.921593 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:32.956640 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:32.959396 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58f9cc7a-323c-4b5a-a3b4-32a9aa8e8d1e admin admin] Pushing event updated for resources: {'Port': ['ID=0bf80ece-82d7-4c64-8066-ef5107ea9e0d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:32.977868 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd0dcf098-4522-4347-b733-bbc98e48d7e0'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:32.981271 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ba1cdcd3-9bab-4167-aeaa-7695c43d3335" -d '{"events": [{"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-plugged", "status": "completed", "tag": "d0dcf098-4522-4347-b733-bbc98e48d7e0"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:33.057591 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97ddc652-fc16-4f9b-85b4-453bdd1ff59f req-01aafb34-5ea1-414c-bdbf-a6a5b1d10255 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:33.059251 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 38b263bd-10f0-49ea-bef8-a6caba0ce784 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:33.059617 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-97ddc652-fc16-4f9b-85b4-453bdd1ff59f req-01aafb34-5ea1-414c-bdbf-a6a5b1d10255 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 931 time: 0.3704476 Dec 09 21:29:33.087268 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d56b7804-a559-4016-b8b9-a2ff988eb073 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:33.088544 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71c9d667-c429-429b-8383-df8bb9d5e61d req-f6a1b48b-dc40-4566-bfe5-dea0f9e982aa tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:33.100457 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71c9d667-c429-429b-8383-df8bb9d5e61d req-f6a1b48b-dc40-4566-bfe5-dea0f9e982aa tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/ports?device_id=312d3f8f-a9e2-4604-b559-13de6a525547 HTTP/1.1" status: 200 len: 944 time: 0.3491659 Dec 09 21:29:33.179152 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 61aa5263-8686-42ca-a69d-76fd6420ede8, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=61aa5263-8686-42ca-a69d-76fd6420ede8,segment=NetworkSegment(156677c4-8e58-420b-a3a1-7c1c07b52a7d),segment_id=156677c4-8e58-420b-a3a1-7c1c07b52a7d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:33.194971 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-52ea3e58-6571-4081-a041-f25342614c13 req-2a913687-86d7-4f76-b5ad-0a3080f9fffe service neutron] For port 675f510c-c35a-468e-b70b-4abb34188642, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:29:33.210723 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-52ea3e58-6571-4081-a041-f25342614c13 req-2a913687-86d7-4f76-b5ad-0a3080f9fffe service neutron] For port 675f510c-c35a-468e-b70b-4abb34188642, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=675f510c-c35a-468e-b70b-4abb34188642,segment=NetworkSegment(4944fe1d-3354-4e33-b6be-75c5cb26e73d),segment_id=4944fe1d-3354-4e33-b6be-75c5cb26e73d)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:29:33.233797 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:33.252259 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 38b263bd-10f0-49ea-bef8-a6caba0ce784, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=38b263bd-10f0-49ea-bef8-a6caba0ce784,segment=NetworkSegment(4944fe1d-3354-4e33-b6be-75c5cb26e73d),segment_id=4944fe1d-3354-4e33-b6be-75c5cb26e73d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:33.255937 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d2525219-68b7-4035-9de7-ec388a6121a8 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:29:33.320356 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-2a913687-86d7-4f76-b5ad-0a3080f9fffe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:33.338419 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:33.347577 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ea3e58-6571-4081-a041-f25342614c13 req-2a913687-86d7-4f76-b5ad-0a3080f9fffe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:33.348630 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-52ea3e58-6571-4081-a041-f25342614c13 req-2a913687-86d7-4f76-b5ad-0a3080f9fffe service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:33.350788 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-2a913687-86d7-4f76-b5ad-0a3080f9fffe service neutron] 10.222.0.31 "PUT /v2.0/ports/675f510c-c35a-468e-b70b-4abb34188642 HTTP/1.1" status: 200 len: 1092 time: 3.2966180 Dec 09 21:29:33.370970 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f162364-87ff-4886-b74a-4575abe46350 None None] Network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:29:33.415820 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '31a27c6f-f2ac-4eff-9039-700b918036ef', 'tag': '675f510c-c35a-468e-b70b-4abb34188642'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:33.418419 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-af322812-97d0-49d5-8e44-ab2980ffcabe" -d '{"events": [{"name": "network-changed", "server_uuid": "31a27c6f-f2ac-4eff-9039-700b918036ef", "tag": "675f510c-c35a-468e-b70b-4abb34188642"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:33.424716 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71c9d667-c429-429b-8383-df8bb9d5e61d req-75b39f09-7d2f-4b0f-b255-7639726d5e8c tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/security-groups?id=872108a7-5ae2-4b16-8e57-f5d879884a6d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3233609 Dec 09 21:29:33.481919 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58f9cc7a-323c-4b5a-a3b4-32a9aa8e8d1e admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:33.544025 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port d2525219-68b7-4035-9de7-ec388a6121a8 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:33.544713 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:33.557052 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-3bd94481-0bcc-45f9-a92c-7e6168137a5b service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6548755 Dec 09 21:29:33.571592 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-97ddc652-fc16-4f9b-85b4-453bdd1ff59f req-6bf666d4-99a9-489f-8d96-b0a68c2eb3a5 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/security-groups?id=02690a1b-c814-4a6b-a7d8-1252ee74106e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4643962 Dec 09 21:29:33.584357 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=61aa5263-8686-42ca-a69d-76fd6420ede8,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:33.620949 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ea3e58-6571-4081-a041-f25342614c13 req-63aa4562-004e-4e40-b8cb-d66e93610694 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:33.629057 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-63aa4562-004e-4e40-b8cb-d66e93610694 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6757323541bb47f99775de3a0132216b&device_id=31a27c6f-f2ac-4eff-9039-700b918036ef HTTP/1.1" status: 200 len: 1095 time: 0.2023597 Dec 09 21:29:33.688730 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['38b263bd-10f0-49ea-bef8-a6caba0ce784'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:29:33.711892 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a913687-86d7-4f76-b5ad-0a3080f9fffe service neutron] Pushing event updated for resources: {'Port': ['ID=675f510c-c35a-468e-b70b-4abb34188642,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:33.726419 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-60bf03cd-553f-49b0-89e0-f94fda05e313 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=675f510c-c35a-468e-b70b-4abb34188642 HTTP/1.1" status: 200 len: 217 time: 0.0645971 Dec 09 21:29:33.799986 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52ea3e58-6571-4081-a041-f25342614c13 req-14a03774-d836-4087-a3d7-bd6b19174ac3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:33.799986 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-14a03774-d836-4087-a3d7-bd6b19174ac3 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=16184032-e4c1-40c2-a34f-a13c4226a14a HTTP/1.1" status: 200 len: 858 time: 0.0594568 Dec 09 21:29:33.898131 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-104a343e-5620-439d-ade4-858b2c4d015f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=0bcede63-0fdd-4d40-8c5c-4890fec5dc38&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0713537 Dec 09 21:29:33.941063 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:33.970512 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-cca7f0ec-2311-4d97-8e6a-16c66c9d3a31 None None] Provisioning complete for port d2525219-68b7-4035-9de7-ec388a6121a8 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:33.970887 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cca7f0ec-2311-4d97-8e6a-16c66c9d3a31 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:33.977723 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6430a84-33ba-4d95-9cd5-642e812d32cc service neutron] Pushing event updated for resources: {'Port': ['ID=5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:34.005602 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-e6430a84-33ba-4d95-9cd5-642e812d32cc service neutron] Attempting to bind port 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:29:34.006335 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-e6430a84-33ba-4d95-9cd5-642e812d32cc service neutron] Attempting to bind port 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'dc772362-7c7f-473d-bb4b-7b6705959a15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:29:34.006870 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-e6430a84-33ba-4d95-9cd5-642e812d32cc service neutron] Attempting to bind port 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc on network b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:34.016478 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-e6430a84-33ba-4d95-9cd5-642e812d32cc service neutron] Port 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc on network b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:29:34.017175 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-e6430a84-33ba-4d95-9cd5-642e812d32cc service neutron] Attempting to bind port 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc on network b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:34.032195 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-e6430a84-33ba-4d95-9cd5-642e812d32cc service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 29, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:29:34.032894 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-e6430a84-33ba-4d95-9cd5-642e812d32cc service neutron] Checking segment: {'id': 'dc772362-7c7f-473d-bb4b-7b6705959a15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:29:34.033501 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-e6430a84-33ba-4d95-9cd5-642e812d32cc service neutron] Bound using segment: {'id': 'dc772362-7c7f-473d-bb4b-7b6705959a15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:29:34.034136 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-e6430a84-33ba-4d95-9cd5-642e812d32cc service neutron] Bound port: 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dc772362-7c7f-473d-bb4b-7b6705959a15', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 117, 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:29:34.035212 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-e6430a84-33ba-4d95-9cd5-642e812d32cc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:34.058867 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:29:34.072580 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9261df40-ca84-49fd-897a-f59a483f356b req-43420499-477b-4630-ab29-f789a04d493f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:34.078940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9261df40-ca84-49fd-897a-f59a483f356b req-43420499-477b-4630-ab29-f789a04d493f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:34.085648 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9261df40-ca84-49fd-897a-f59a483f356b req-43420499-477b-4630-ab29-f789a04d493f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:34.085799 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=38b263bd-10f0-49ea-bef8-a6caba0ce784,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:34.100765 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port b7cad057-c6e6-483b-9791-e1b1a0dd73ac, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=b7cad057-c6e6-483b-9791-e1b1a0dd73ac,segment=NetworkSegment(8ca86951-e612-4db0-90f4-834b52fd24e0),segment_id=8ca86951-e612-4db0-90f4-834b52fd24e0)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:34.106127 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9261df40-ca84-49fd-897a-f59a483f356b req-43420499-477b-4630-ab29-f789a04d493f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:34.114808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9261df40-ca84-49fd-897a-f59a483f356b req-43420499-477b-4630-ab29-f789a04d493f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:34.123620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9261df40-ca84-49fd-897a-f59a483f356b req-43420499-477b-4630-ab29-f789a04d493f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:34.130820 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9261df40-ca84-49fd-897a-f59a483f356b req-43420499-477b-4630-ab29-f789a04d493f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:34.134721 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9261df40-ca84-49fd-897a-f59a483f356b req-43420499-477b-4630-ab29-f789a04d493f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5431 time: 0.4078703 Dec 09 21:29:34.166261 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:34.167224 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 7b66d328-f18c-4d26-af51-99c1b1f1f05e up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:29:34.177532 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58f9cc7a-323c-4b5a-a3b4-32a9aa8e8d1e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:34.269105 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:34.294933 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-9ea5840c-943d-40cc-a254-bd080f2b557c service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7214158 Dec 09 21:29:34.350415 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-60a75aa3-eb88-41ca-bd19-018a837588c6 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.197&port_id=1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f HTTP/1.1" status: 200 len: 217 time: 0.0469933 Dec 09 21:29:34.405079 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port d2525219-68b7-4035-9de7-ec388a6121a8, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d2525219-68b7-4035-9de7-ec388a6121a8,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:34.411154 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=b7cad057-c6e6-483b-9791-e1b1a0dd73ac,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:34.412209 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-e6430a84-33ba-4d95-9cd5-642e812d32cc service neutron] For port 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:29:34.416628 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-e6430a84-33ba-4d95-9cd5-642e812d32cc service neutron] For port 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc,segment=NetworkSegment(dc772362-7c7f-473d-bb4b-7b6705959a15),segment_id=dc772362-7c7f-473d-bb4b-7b6705959a15)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:29:34.420432 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 7b66d328-f18c-4d26-af51-99c1b1f1f05e completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:29:34.433442 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:34.441562 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-e6430a84-33ba-4d95-9cd5-642e812d32cc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:34.443885 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 7b66d328-f18c-4d26-af51-99c1b1f1f05e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:34.444257 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:34.462371 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-1daf8f6c-807a-4833-8f87-3e2bd95b6ae7 service neutron] 10.222.0.31 "GET /v2.0/networks/0bcede63-0fdd-4d40-8c5c-4890fec5dc38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5247998 Dec 09 21:29:34.477662 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-e6430a84-33ba-4d95-9cd5-642e812d32cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:34.478305 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-e6430a84-33ba-4d95-9cd5-642e812d32cc service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:34.480201 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-e6430a84-33ba-4d95-9cd5-642e812d32cc service neutron] 10.222.0.10 "PUT /v2.0/ports/5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc HTTP/1.1" status: 200 len: 1092 time: 3.0865483 Dec 09 21:29:34.486267 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cca7f0ec-2311-4d97-8e6a-16c66c9d3a31 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:34.525407 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '752d9ac2-7383-4bdb-b56f-3c52855d7fc9', 'tag': '5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:34.531690 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-963c9f40-8034-454b-b43d-65fe44dadd62" -d '{"events": [{"name": "network-changed", "server_uuid": "752d9ac2-7383-4bdb-b56f-3c52855d7fc9", "tag": "5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:34.539152 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-58f9cc7a-323c-4b5a-a3b4-32a9aa8e8d1e admin admin] Router 1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:29:34.585340 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52ea3e58-6571-4081-a041-f25342614c13 req-135fa970-6f73-47c4-b646-471c0dc09b4f service neutron] 10.222.0.31 "GET /v2.0/networks/0bcede63-0fdd-4d40-8c5c-4890fec5dc38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1144612 Dec 09 21:29:34.598975 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb15766d-4da5-4f62-ab26-2fa9719ba20a req-b0abbd5e-16da-4d51-9f1f-888d219f6f8a tempest-ComputeTenantNetworksTest-237520624 tempest-ComputeTenantNetworksTest-237520624-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:34.606395 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb15766d-4da5-4f62-ab26-2fa9719ba20a req-b0abbd5e-16da-4d51-9f1f-888d219f6f8a tempest-ComputeTenantNetworksTest-237520624 tempest-ComputeTenantNetworksTest-237520624-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:34.613997 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb15766d-4da5-4f62-ab26-2fa9719ba20a req-b0abbd5e-16da-4d51-9f1f-888d219f6f8a tempest-ComputeTenantNetworksTest-237520624 tempest-ComputeTenantNetworksTest-237520624-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:34.633513 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb15766d-4da5-4f62-ab26-2fa9719ba20a req-b0abbd5e-16da-4d51-9f1f-888d219f6f8a tempest-ComputeTenantNetworksTest-237520624 tempest-ComputeTenantNetworksTest-237520624-project] 10.222.0.13 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1903 time: 0.8328240 Dec 09 21:29:34.650948 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=d2525219-68b7-4035-9de7-ec388a6121a8,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:34.654342 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9261df40-ca84-49fd-897a-f59a483f356b req-1881b4fa-e417-41fc-82f5-9c2a91afeb52 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.5053313 Dec 09 21:29:34.690976 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-55dfa40f-acf5-40bf-a0ff-ec920bbf2e18 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:34.692515 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-55dfa40f-acf5-40bf-a0ff-ec920bbf2e18 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=871c2dc1-486e-4fcf-a882-5a1394082fc5 HTTP/1.1" status: 200 len: 797 time: 0.3179910 Dec 09 21:29:34.728117 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1440de81-a06a-4754-ac33-14e0883a2487 x-openstack-request-id: req-1440de81-a06a-4754-ac33-14e0883a2487 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:34.728427 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-plugged", "status": "completed", "tag": "d0dcf098-4522-4347-b733-bbc98e48d7e0", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:34.728688 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-1440de81-a06a-4754-ac33-14e0883a2487 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:34.729099 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd0dcf098-4522-4347-b733-bbc98e48d7e0', 'code': 200} Dec 09 21:29:34.745955 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6430a84-33ba-4d95-9cd5-642e812d32cc service neutron] Pushing event updated for resources: {'Port': ['ID=5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:34.767996 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-33b1cf79-fe40-4105-94cf-f5d7b7587083 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:34.769633 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-760e9879-745d-40ca-97a2-41b8ec3e0277 x-openstack-request-id: req-760e9879-745d-40ca-97a2-41b8ec3e0277 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:34.769929 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "31a27c6f-f2ac-4eff-9039-700b918036ef", "tag": "675f510c-c35a-468e-b70b-4abb34188642", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:34.770185 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-760e9879-745d-40ca-97a2-41b8ec3e0277 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:34.770596 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '31a27c6f-f2ac-4eff-9039-700b918036ef', 'tag': '675f510c-c35a-468e-b70b-4abb34188642', 'status': 'completed', 'code': 200} Dec 09 21:29:34.778436 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-cca7f0ec-2311-4d97-8e6a-16c66c9d3a31 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:29:34.779185 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-cca7f0ec-2311-4d97-8e6a-16c66c9d3a31 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:29:34.780788 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-33b1cf79-fe40-4105-94cf-f5d7b7587083 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=77fc0831d6584a36b61a4823157f9c1d&device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 1095 time: 0.2430589 Dec 09 21:29:34.833155 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:34.853044 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-6a05f81d-23c1-4870-a75e-889a4a67693b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:34.854783 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-6a05f81d-23c1-4870-a75e-889a4a67693b service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1543117 Dec 09 21:29:34.874189 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-e3162f87-5751-4091-8521-2588d2367191 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc HTTP/1.1" status: 200 len: 217 time: 0.0408661 Dec 09 21:29:34.897689 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 7b66d328-f18c-4d26-af51-99c1b1f1f05e, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=7b66d328-f18c-4d26-af51-99c1b1f1f05e,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:34.903607 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:34.905378 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 145a0cde-0fe5-4163-a063-0fdfe42f243b up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:29:34.921668 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-58f9cc7a-323c-4b5a-a3b4-32a9aa8e8d1e admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:29:34.931621 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] Sync routers for ids ['1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:29:34.948115 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] Routers {'1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:29:34.949767 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:29:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:34.959981 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58f9cc7a-323c-4b5a-a3b4-32a9aa8e8d1e admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:34.961208 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-58f9cc7a-323c-4b5a-a3b4-32a9aa8e8d1e admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 5.5522540 Dec 09 21:29:34.969156 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42886) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:34.987156 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-fe50ed4f-e131-4d74-9a81-5bf9ce7f5092 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:34.989484 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-fe50ed4f-e131-4d74-9a81-5bf9ce7f5092 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=93335bf9-6f1e-4484-ae25-dca4b03b29b4 HTTP/1.1" status: 200 len: 855 time: 0.1051445 Dec 09 21:29:35.004062 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50537f52-8d98-45c6-b80d-e7aee05df668 req-f9fcc91a-13c9-48b7-a20b-069ff290d2c5 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:35.010150 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50537f52-8d98-45c6-b80d-e7aee05df668 req-f9fcc91a-13c9-48b7-a20b-069ff290d2c5 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:35.016988 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50537f52-8d98-45c6-b80d-e7aee05df668 req-f9fcc91a-13c9-48b7-a20b-069ff290d2c5 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:35.017270 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=7b66d328-f18c-4d26-af51-99c1b1f1f05e,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:35.024464 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50537f52-8d98-45c6-b80d-e7aee05df668 req-f9fcc91a-13c9-48b7-a20b-069ff290d2c5 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:35.035798 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50537f52-8d98-45c6-b80d-e7aee05df668 req-f9fcc91a-13c9-48b7-a20b-069ff290d2c5 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:35.042039 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50537f52-8d98-45c6-b80d-e7aee05df668 req-f9fcc91a-13c9-48b7-a20b-069ff290d2c5 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:35.048375 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50537f52-8d98-45c6-b80d-e7aee05df668 req-f9fcc91a-13c9-48b7-a20b-069ff290d2c5 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:35.050422 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50537f52-8d98-45c6-b80d-e7aee05df668 req-f9fcc91a-13c9-48b7-a20b-069ff290d2c5 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5431 time: 0.2361152 Dec 09 21:29:35.052408 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af322812-97d0-49d5-8e44-ab2980ffcabe req-d447a8ca-0741-48c5-9729-a274a29feb6b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:35.053791 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af322812-97d0-49d5-8e44-ab2980ffcabe req-d447a8ca-0741-48c5-9729-a274a29feb6b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6757323541bb47f99775de3a0132216b&device_id=31a27c6f-f2ac-4eff-9039-700b918036ef HTTP/1.1" status: 200 len: 1095 time: 0.2793665 Dec 09 21:29:35.058677 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 145a0cde-0fe5-4163-a063-0fdfe42f243b completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:29:35.070879 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 145a0cde-0fe5-4163-a063-0fdfe42f243b triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:35.071798 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:35.097257 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] Set router 1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:29:35.210558 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:35.213174 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d2525219-68b7-4035-9de7-ec388a6121a8 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:29:35.216591 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-1257d062-fa22-4932-aff2-9ded91dae0f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:35.218887 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-1257d062-fa22-4932-aff2-9ded91dae0f6 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1316495 Dec 09 21:29:35.234657 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ecb708d-e041-450a-99d2-8b6b0266de0d req-e11c4c2b-d55c-438d-a996-70644a911950 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:35.238480 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3ecb708d-e041-450a-99d2-8b6b0266de0d req-e11c4c2b-d55c-438d-a996-70644a911950 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/ports?device_id=31a27c6f-f2ac-4eff-9039-700b918036ef HTTP/1.1" status: 200 len: 943 time: 0.3575954 Dec 09 21:29:35.239908 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af322812-97d0-49d5-8e44-ab2980ffcabe req-ad0f27e8-45fa-4722-994b-bde874065ded service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:35.241288 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af322812-97d0-49d5-8e44-ab2980ffcabe req-ad0f27e8-45fa-4722-994b-bde874065ded service neutron] 10.222.0.31 "GET /v2.0/networks?id=0bcede63-0fdd-4d40-8c5c-4890fec5dc38 HTTP/1.1" status: 200 len: 919 time: 0.1747246 Dec 09 21:29:35.295231 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 145a0cde-0fe5-4163-a063-0fdfe42f243b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=145a0cde-0fe5-4163-a063-0fdfe42f243b,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:35.309323 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af322812-97d0-49d5-8e44-ab2980ffcabe req-a2247cb9-0ab5-4f03-b6dd-26b1e3ce798b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=675f510c-c35a-468e-b70b-4abb34188642 HTTP/1.1" status: 200 len: 217 time: 0.0449326 Dec 09 21:29:35.333989 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:35.335270 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 3bbd0bd0-666a-4f39-abae-59f44d88319c up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:29:35.367487 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-2dc44ba0-dd59-4e1f-9fcb-21c5d66da34a service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5013790 Dec 09 21:29:35.438394 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3ecb708d-e041-450a-99d2-8b6b0266de0d req-c1365261-c30e-4619-bd49-4dc441341c0a tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/security-groups?id=09be3411-a85c-42e3-aaf7-829301eec3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1861391 Dec 09 21:29:35.451764 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port d2525219-68b7-4035-9de7-ec388a6121a8 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:35.452409 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:35.474065 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'name': 'tempest-ServerActionsTestJSON-1559985225-router', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242'}], 'enable_snat': True}, 'gw_port_id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:29:30Z', 'updated_at': '2021-12-09T21:29:33Z', 'revision_number': 3, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'gw_port': {'id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:d4:09', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1299, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:29:31Z', 'updated_at': '2021-12-09T21:29:31Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:35.500045 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50537f52-8d98-45c6-b80d-e7aee05df668 req-b9a197f7-d1b1-4795-bd5d-e08dca226a10 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.4368465 Dec 09 21:29:35.503977 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 3bbd0bd0-666a-4f39-abae-59f44d88319c completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:29:35.509249 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af322812-97d0-49d5-8e44-ab2980ffcabe req-c72347a2-0895-4cdc-a5f7-351e60abf198 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:35.511193 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-c3cfbdc7-ea07-45e8-9da6-b5e24c13af7c service neutron] 10.222.0.10 "GET /v2.0/networks/b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2843895 Dec 09 21:29:35.514214 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af322812-97d0-49d5-8e44-ab2980ffcabe req-c72347a2-0895-4cdc-a5f7-351e60abf198 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=16184032-e4c1-40c2-a34f-a13c4226a14a HTTP/1.1" status: 200 len: 858 time: 0.1747210 Dec 09 21:29:35.534945 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 3bbd0bd0-666a-4f39-abae-59f44d88319c triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:35.538717 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:35.561556 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] Checking router: 1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:29:35.563756 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] Updating router 1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586 port 0bf80ece-82d7-4c64-8066-ef5107ea9e0d binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:29:35.594562 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0b70c5e9-3022-4f49-b1cd-81bc5a317a19 x-openstack-request-id: req-0b70c5e9-3022-4f49-b1cd-81bc5a317a19 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:35.595106 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "752d9ac2-7383-4bdb-b56f-3c52855d7fc9", "tag": "5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:35.595106 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0b70c5e9-3022-4f49-b1cd-81bc5a317a19 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:35.595497 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '752d9ac2-7383-4bdb-b56f-3c52855d7fc9', 'tag': '5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc', 'status': 'completed', 'code': 200} Dec 09 21:29:35.609487 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:35.661752 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0d5b631e-b673-4f80-ae69-24608c354064 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:35.670494 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e49bc33f-7d2a-494a-a78e-af9716f992e0 req-e4b74919-ed25-4efe-9435-908b5ad761fa service neutron] 10.222.0.10 "GET /v2.0/networks/b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1378312 Dec 09 21:29:35.708267 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=145a0cde-0fe5-4163-a063-0fdfe42f243b,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:35.836223 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 38b263bd-10f0-49ea-bef8-a6caba0ce784 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:29:35.904828 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:35.913380 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5a79a2c5-6ca6-4212-a82d-3fd277f42368 None None] Provisioning complete for port d2525219-68b7-4035-9de7-ec388a6121a8 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:35.914131 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5a79a2c5-6ca6-4212-a82d-3fd277f42368 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:35.936928 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-963c9f40-8034-454b-b43d-65fe44dadd62 req-c7af7a6f-1226-4167-a596-c94147455fe0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:35.938493 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-963c9f40-8034-454b-b43d-65fe44dadd62 req-c7af7a6f-1226-4167-a596-c94147455fe0 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=77fc0831d6584a36b61a4823157f9c1d&device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 1095 time: 0.1897707 Dec 09 21:29:36.038185 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 3bbd0bd0-666a-4f39-abae-59f44d88319c, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3bbd0bd0-666a-4f39-abae-59f44d88319c,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:36.042038 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:36.061999 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:36.067038 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-963c9f40-8034-454b-b43d-65fe44dadd62 req-afc55737-e2ea-4a01-8307-fd610eaf901e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:36.069071 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-963c9f40-8034-454b-b43d-65fe44dadd62 req-afc55737-e2ea-4a01-8307-fd610eaf901e service neutron] 10.222.0.10 "GET /v2.0/networks?id=b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6 HTTP/1.1" status: 200 len: 917 time: 0.1119924 Dec 09 21:29:36.071705 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:36.095573 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 723351f2-7c62-4bb5-aaad-288a6e26545f up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:29:36.099605 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 38b263bd-10f0-49ea-bef8-a6caba0ce784 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:29:36.126535 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-963c9f40-8034-454b-b43d-65fe44dadd62 req-8d0bca31-984e-4b06-9eb1-1e10d190dccf service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc HTTP/1.1" status: 200 len: 217 time: 0.0490892 Dec 09 21:29:36.128049 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b13c5c3-56ac-4df8-8c45-d14a15c62859 None None] Pushing event updated for resources: {'Port': ['ID=0bf80ece-82d7-4c64-8066-ef5107ea9e0d,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:36.138248 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b13c5c3-56ac-4df8-8c45-d14a15c62859 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:36.139079 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b13c5c3-56ac-4df8-8c45-d14a15c62859 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:36.139604 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b13c5c3-56ac-4df8-8c45-d14a15c62859 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:36.139939 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b13c5c3-56ac-4df8-8c45-d14a15c62859 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:36.143602 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b13c5c3-56ac-4df8-8c45-d14a15c62859 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:36.143948 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b13c5c3-56ac-4df8-8c45-d14a15c62859 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:36.144287 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b13c5c3-56ac-4df8-8c45-d14a15c62859 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:36.144904 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b13c5c3-56ac-4df8-8c45-d14a15c62859 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:36.145036 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b13c5c3-56ac-4df8-8c45-d14a15c62859 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:36.145253 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b13c5c3-56ac-4df8-8c45-d14a15c62859 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:36.146070 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b13c5c3-56ac-4df8-8c45-d14a15c62859 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:36.146777 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b13c5c3-56ac-4df8-8c45-d14a15c62859 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:36.146897 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af322812-97d0-49d5-8e44-ab2980ffcabe req-af17cd52-5185-4e62-a616-6282fd6996ff service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=0bcede63-0fdd-4d40-8c5c-4890fec5dc38&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.5701103 Dec 09 21:29:36.147359 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3b13c5c3-56ac-4df8-8c45-d14a15c62859 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:36.165677 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 38b263bd-10f0-49ea-bef8-a6caba0ce784 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:36.166163 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:36.187375 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] Attempting to bind port 0bf80ece-82d7-4c64-8066-ef5107ea9e0d on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:29:36.187953 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] Attempting to bind port 0bf80ece-82d7-4c64-8066-ef5107ea9e0d by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:29:36.188320 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] Attempting to bind port 0bf80ece-82d7-4c64-8066-ef5107ea9e0d on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:36.194706 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 29, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:29:36.195200 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:29:36.195626 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:36.196013 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:29:36.196476 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] Bound port: 0bf80ece-82d7-4c64-8066-ef5107ea9e0d, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:29:36.198377 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:36.247425 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=3bbd0bd0-666a-4f39-abae-59f44d88319c,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:36.267400 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 723351f2-7c62-4bb5-aaad-288a6e26545f completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:29:36.274081 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 723351f2-7c62-4bb5-aaad-288a6e26545f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:36.274081 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:36.291230 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] For port 0bf80ece-82d7-4c64-8066-ef5107ea9e0d, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:29:36.298478 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] For port 0bf80ece-82d7-4c64-8066-ef5107ea9e0d, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=0bf80ece-82d7-4c64-8066-ef5107ea9e0d,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:29:36.305094 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:36.350279 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af322812-97d0-49d5-8e44-ab2980ffcabe req-0dd0d049-dade-470a-9767-4acb04fed067 service neutron] 10.222.0.31 "GET /v2.0/networks/0bcede63-0fdd-4d40-8c5c-4890fec5dc38?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1818600 Dec 09 21:29:36.361064 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:36.366791 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19bb327e-55cd-4bbc-8236-65496e6a8dbf req-6740d05e-505d-46b5-bcc2-9f0988787d5d tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:36.368589 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19bb327e-55cd-4bbc-8236-65496e6a8dbf req-6740d05e-505d-46b5-bcc2-9f0988787d5d tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/ports?device_id=312d3f8f-a9e2-4604-b559-13de6a525547 HTTP/1.1" status: 200 len: 945 time: 0.7778430 Dec 09 21:29:36.374796 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b13c5c3-56ac-4df8-8c45-d14a15c62859 None None] Pushing event updated for resources: {'Port': ['ID=0bf80ece-82d7-4c64-8066-ef5107ea9e0d,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:36.378941 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b1b0f709-397a-4ae8-89ad-4de8b1d5ae87 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:36.406188 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-963c9f40-8034-454b-b43d-65fe44dadd62 req-9384015d-2455-48de-a6b3-52e60461a8f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:36.407724 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-963c9f40-8034-454b-b43d-65fe44dadd62 req-9384015d-2455-48de-a6b3-52e60461a8f2 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=93335bf9-6f1e-4484-ae25-dca4b03b29b4 HTTP/1.1" status: 200 len: 855 time: 0.2683451 Dec 09 21:29:36.419660 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 38b263bd-10f0-49ea-bef8-a6caba0ce784, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=38b263bd-10f0-49ea-bef8-a6caba0ce784,segment=NetworkSegment(4944fe1d-3354-4e33-b6be-75c5cb26e73d),segment_id=4944fe1d-3354-4e33-b6be-75c5cb26e73d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:36.425373 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] Routers {'1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:29:36.433289 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:29:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:36.443765 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-d61264f6-5f68-44f5-9871-fe36bf104409 service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.0459552 Dec 09 21:29:36.471725 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:36.480737 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19bb327e-55cd-4bbc-8236-65496e6a8dbf req-dc64c553-c21a-46ef-beb6-a0bac04663c7 tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/security-groups?id=872108a7-5ae2-4b16-8e57-f5d879884a6d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0957208 Dec 09 21:29:36.485926 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:36.488452 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f2dbdd9-fa84-4284-9879-5234cf0e9dad req-4384b7db-0750-47ab-8a2d-3af80d9bfaf1 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:36.496184 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f2dbdd9-fa84-4284-9879-5234cf0e9dad req-4384b7db-0750-47ab-8a2d-3af80d9bfaf1 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 943 time: 0.3896282 Dec 09 21:29:36.562467 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 723351f2-7c62-4bb5-aaad-288a6e26545f, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=723351f2-7c62-4bb5-aaad-288a6e26545f,segment=NetworkSegment(4944fe1d-3354-4e33-b6be-75c5cb26e73d),segment_id=4944fe1d-3354-4e33-b6be-75c5cb26e73d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:36.576545 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:36.594684 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:36.619835 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-963c9f40-8034-454b-b43d-65fe44dadd62 req-1388ab0d-6ac1-4686-90b6-1c7f1a68eb32 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:36.620435 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=38b263bd-10f0-49ea-bef8-a6caba0ce784,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:36.621584 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-963c9f40-8034-454b-b43d-65fe44dadd62 req-1388ab0d-6ac1-4686-90b6-1c7f1a68eb32 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2000449 Dec 09 21:29:36.625995 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] Set router 1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:29:36.637854 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-90c6cb96-e070-4e63-9e11-206ecf10954e service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.40&port_id=38f97951-e872-4c24-947f-934429895ad3 HTTP/1.1" status: 200 len: 217 time: 0.1654117 Dec 09 21:29:36.725524 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=723351f2-7c62-4bb5-aaad-288a6e26545f,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:36.732795 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '312d3f8f-a9e2-4604-b559-13de6a525547', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '61aa5263-8686-42ca-a69d-76fd6420ede8'}, {'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b7cad057-c6e6-483b-9791-e1b1a0dd73ac'}, {'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7b66d328-f18c-4d26-af51-99c1b1f1f05e'}, {'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '145a0cde-0fe5-4163-a063-0fdfe42f243b'}, {'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3bbd0bd0-666a-4f39-abae-59f44d88319c'}, {'server_uuid': 'd0b23879-8919-4f30-9aa0-db8d2f85e707', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '38b263bd-10f0-49ea-bef8-a6caba0ce784'}, {'server_uuid': 'ba78dacb-cf50-4182-b474-958412e2b568', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '723351f2-7c62-4bb5-aaad-288a6e26545f'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:36.735106 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-57f5f284-44e1-447e-890a-e6b77a6d1a73" -d '{"events": [{"server_uuid": "312d3f8f-a9e2-4604-b559-13de6a525547", "name": "network-vif-plugged", "status": "completed", "tag": "61aa5263-8686-42ca-a69d-76fd6420ede8"}, {"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-plugged", "status": "completed", "tag": "b7cad057-c6e6-483b-9791-e1b1a0dd73ac"}, {"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-plugged", "status": "completed", "tag": "7b66d328-f18c-4d26-af51-99c1b1f1f05e"}, {"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-plugged", "status": "completed", "tag": "145a0cde-0fe5-4163-a063-0fdfe42f243b"}, {"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-plugged", "status": "completed", "tag": "3bbd0bd0-666a-4f39-abae-59f44d88319c"}, {"server_uuid": "d0b23879-8919-4f30-9aa0-db8d2f85e707", "name": "network-vif-plugged", "status": "completed", "tag": "38b263bd-10f0-49ea-bef8-a6caba0ce784"}, {"server_uuid": "ba78dacb-cf50-4182-b474-958412e2b568", "name": "network-vif-plugged", "status": "completed", "tag": "723351f2-7c62-4bb5-aaad-288a6e26545f"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:36.794332 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f2dbdd9-fa84-4284-9879-5234cf0e9dad req-b9e37a2b-8818-43f7-bb3b-d7caff7b0c2a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/security-groups?id=02690a1b-c814-4a6b-a7d8-1252ee74106e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2932141 Dec 09 21:29:36.819381 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4436771-f55e-4118-b138-8e2049bf8d6e req-67c72c3b-83d8-4097-9303-0f1fcc635fc7 tempest-ComputeTenantNetworksTest-237520624 tempest-ComputeTenantNetworksTest-237520624-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:36.820828 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d4436771-f55e-4118-b138-8e2049bf8d6e req-67c72c3b-83d8-4097-9303-0f1fcc635fc7 tempest-ComputeTenantNetworksTest-237520624 tempest-ComputeTenantNetworksTest-237520624-project] 10.222.0.13 "GET /v2.0/networks/c0e00dcb-74fd-4e07-bd40-df626f86d494 HTTP/1.1" status: 200 len: 769 time: 0.1950557 Dec 09 21:29:36.833394 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af322812-97d0-49d5-8e44-ab2980ffcabe req-36a1835d-b696-4952-9d7a-a41781d59b77 service neutron] 10.222.0.31 "GET /v2.0/networks/0bcede63-0fdd-4d40-8c5c-4890fec5dc38?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4579015 Dec 09 21:29:36.833598 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-b1b0f709-397a-4ae8-89ad-4de8b1d5ae87 admin admin] Allocated IP 172.20.0.1 (2c03082f-742a-4ae3-9d23-6178c7ff2a0a/d776263b-6b97-44cc-bef5-299b9262dfec/1ab9d8fe-6942-4722-90aa-1232fb6aab84) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:29:36.833697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42898) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:36.860436 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-963c9f40-8034-454b-b43d-65fe44dadd62 req-ee1d1ef6-b297-4121-b965-06b932b9b1f5 service neutron] 10.222.0.10 "GET /v2.0/networks/b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2222795 Dec 09 21:29:36.875399 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-6c1428b0-6ab8-4f54-8da7-ca379a26fb6f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:36.878080 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-6c1428b0-6ab8-4f54-8da7-ca379a26fb6f service neutron] 10.222.0.10 "GET /v2.0/subnets?id=871c2dc1-486e-4fcf-a882-5a1394082fc5 HTTP/1.1" status: 200 len: 797 time: 0.2319772 Dec 09 21:29:36.952709 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'name': 'tempest-ServerActionsTestJSON-1559985225-router', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242'}], 'enable_snat': True}, 'gw_port_id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:29:30Z', 'updated_at': '2021-12-09T21:29:33Z', 'revision_number': 3, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'gw_port': {'id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:d4:09', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1299, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:29:31Z', 'updated_at': '2021-12-09T21:29:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:36.981101 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dcbbbe98-0887-44c0-926b-248ebe43a0df None None] The sync data for ids ['1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'] in n-d-713301-27 is: [{'id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'name': 'tempest-ServerActionsTestJSON-1559985225-router', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242'}], 'enable_snat': True}, 'gw_port_id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:29:30Z', 'updated_at': '2021-12-09T21:29:33Z', 'revision_number': 3, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'gw_port': {'id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:d4:09', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1299, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:29:31Z', 'updated_at': '2021-12-09T21:29:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:29:36.989335 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9101787e-31d2-41f4-9b1d-19d47d323496 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:37.083854 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-963c9f40-8034-454b-b43d-65fe44dadd62 req-19f646a7-d1f5-4834-8c99-052818969766 service neutron] 10.222.0.10 "GET /v2.0/networks/b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2104867 Dec 09 21:29:37.086726 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b1b0f709-397a-4ae8-89ad-4de8b1d5ae87 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:37.126041 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-c7904acf-bf68-4100-86ac-c6ebfa810f11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:37.127620 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-c7904acf-bf68-4100-86ac-c6ebfa810f11 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.2211049 Dec 09 21:29:37.130648 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b1b0f709-397a-4ae8-89ad-4de8b1d5ae87 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:37.143641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16f20805-ec47-44ae-9b47-24cff8523394 req-c881b271-16e7-4bbf-a3f7-995da0ac0736 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:37.149907 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16f20805-ec47-44ae-9b47-24cff8523394 req-c881b271-16e7-4bbf-a3f7-995da0ac0736 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:37.155911 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16f20805-ec47-44ae-9b47-24cff8523394 req-c881b271-16e7-4bbf-a3f7-995da0ac0736 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:37.163543 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16f20805-ec47-44ae-9b47-24cff8523394 req-c881b271-16e7-4bbf-a3f7-995da0ac0736 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:37.170350 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1b0f709-397a-4ae8-89ad-4de8b1d5ae87 admin admin] Network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:29:37.171330 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16f20805-ec47-44ae-9b47-24cff8523394 req-c881b271-16e7-4bbf-a3f7-995da0ac0736 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:37.174220 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-b1b0f709-397a-4ae8-89ad-4de8b1d5ae87 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:29:37.177830 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1b0f709-397a-4ae8-89ad-4de8b1d5ae87 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:29:37.178397 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16f20805-ec47-44ae-9b47-24cff8523394 req-c881b271-16e7-4bbf-a3f7-995da0ac0736 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:37.185661 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16f20805-ec47-44ae-9b47-24cff8523394 req-c881b271-16e7-4bbf-a3f7-995da0ac0736 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:37.187648 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-16f20805-ec47-44ae-9b47-24cff8523394 req-c881b271-16e7-4bbf-a3f7-995da0ac0736 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5431 time: 0.2870951 Dec 09 21:29:37.209942 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1b0f709-397a-4ae8-89ad-4de8b1d5ae87 admin admin] Pushing event updated for resources: {'Port': ['ID=1ab9d8fe-6942-4722-90aa-1232fb6aab84,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:37.224808 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b1b0f709-397a-4ae8-89ad-4de8b1d5ae87 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:37.254842 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf3b0546-8879-4bda-953b-3082f047eb73 req-f81e6bb1-6e7d-4e1b-8c19-fd9e961dad57 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:37.262809 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf3b0546-8879-4bda-953b-3082f047eb73 req-f81e6bb1-6e7d-4e1b-8c19-fd9e961dad57 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/ports?device_id=31a27c6f-f2ac-4eff-9039-700b918036ef HTTP/1.1" status: 200 len: 943 time: 0.2669716 Dec 09 21:29:37.353538 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9101787e-31d2-41f4-9b1d-19d47d323496 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:37.432308 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b1b0f709-397a-4ae8-89ad-4de8b1d5ae87 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:37.461009 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-9101787e-31d2-41f4-9b1d-19d47d323496 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c0e00dcb-74fd-4e07-bd40-df626f86d494']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:37.495025 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-9101787e-31d2-41f4-9b1d-19d47d323496 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ae149259-a99b-4c2c-9236-3ea82985f5f6') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:37.495258 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-9101787e-31d2-41f4-9b1d-19d47d323496 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ae149259-a99b-4c2c-9236-3ea82985f5f6') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:37.525713 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9101787e-31d2-41f4-9b1d-19d47d323496 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:37.544524 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9101787e-31d2-41f4-9b1d-19d47d323496 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:37.554242 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9101787e-31d2-41f4-9b1d-19d47d323496 admin admin] Releasing vlan 108 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:29:37.554630 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9101787e-31d2-41f4-9b1d-19d47d323496 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:37.649654 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-dbabb149-55c7-4a4b-9498-5962be757ead None None] Provisioning complete for port 1ab9d8fe-6942-4722-90aa-1232fb6aab84 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:37.650510 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-16f20805-ec47-44ae-9b47-24cff8523394 req-136e7266-6ae3-410d-8965-09e89d5aa45f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.4409847 Dec 09 21:29:37.650827 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dbabb149-55c7-4a4b-9498-5962be757ead None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:29:37.651729 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:29:37.673349 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9101787e-31d2-41f4-9b1d-19d47d323496 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:37.707242 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9101787e-31d2-41f4-9b1d-19d47d323496 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:37.709706 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b1b0f709-397a-4ae8-89ad-4de8b1d5ae87 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:37.710758 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9101787e-31d2-41f4-9b1d-19d47d323496 admin admin] 10.222.0.13 "DELETE /v2.0/networks/c0e00dcb-74fd-4e07-bd40-df626f86d494 HTTP/1.1" status: 204 len: 168 time: 0.8703561 Dec 09 21:29:37.728385 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b1b0f709-397a-4ae8-89ad-4de8b1d5ae87 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:37.750558 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf3b0546-8879-4bda-953b-3082f047eb73 req-3ea26f1e-71d3-4bf1-9eb6-6083d9d99493 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/security-groups?id=09be3411-a85c-42e3-aaf7-829301eec3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4861684 Dec 09 21:29:37.755141 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-dbabb149-55c7-4a4b-9498-5962be757ead None None] Port 1ab9d8fe-6942-4722-90aa-1232fb6aab84 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:29:37.807340 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9101787e-31d2-41f4-9b1d-19d47d323496 admin admin] Pushing event deleted for resources: {'Network': ['ID=c0e00dcb-74fd-4e07-bd40-df626f86d494,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:37.823070 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-c986458b-395c-44de-a13b-0a09bd222e18 service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6248577 Dec 09 21:29:37.831599 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 675f510c-c35a-468e-b70b-4abb34188642 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:29:37.846091 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1b0f709-397a-4ae8-89ad-4de8b1d5ae87 admin admin] Pushing event updated for resources: {'Port': ['ID=1ab9d8fe-6942-4722-90aa-1232fb6aab84,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:37.865792 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b1b0f709-397a-4ae8-89ad-4de8b1d5ae87 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:37.915310 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42906) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:37.988341 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:37.999687 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 1209 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a6bfede1-e7c1-47f7-97d8-0fd2805f4ea7 x-openstack-request-id: req-a6bfede1-e7c1-47f7-97d8-0fd2805f4ea7 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:38.000070 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "312d3f8f-a9e2-4604-b559-13de6a525547", "name": "network-vif-plugged", "status": "completed", "tag": "61aa5263-8686-42ca-a69d-76fd6420ede8", "code": 200}, {"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-plugged", "status": "completed", "tag": "b7cad057-c6e6-483b-9791-e1b1a0dd73ac", "code": 200}, {"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-plugged", "status": "completed", "tag": "7b66d328-f18c-4d26-af51-99c1b1f1f05e", "code": 200}, {"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-plugged", "status": "completed", "tag": "145a0cde-0fe5-4163-a063-0fdfe42f243b", "code": 200}, {"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-plugged", "status": "completed", "tag": "3bbd0bd0-666a-4f39-abae-59f44d88319c", "code": 200}, {"server_uuid": "d0b23879-8919-4f30-9aa0-db8d2f85e707", "name": "network-vif-plugged", "status": "completed", "tag": "38b263bd-10f0-49ea-bef8-a6caba0ce784", "code": 200}, {"server_uuid": "ba78dacb-cf50-4182-b474-958412e2b568", "name": "network-vif-plugged", "status": "completed", "tag": "723351f2-7c62-4bb5-aaad-288a6e26545f", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:38.000754 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a6bfede1-e7c1-47f7-97d8-0fd2805f4ea7 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:38.001081 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '312d3f8f-a9e2-4604-b559-13de6a525547', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '61aa5263-8686-42ca-a69d-76fd6420ede8', 'code': 200} Dec 09 21:29:38.001978 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b7cad057-c6e6-483b-9791-e1b1a0dd73ac', 'code': 200} Dec 09 21:29:38.001978 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7b66d328-f18c-4d26-af51-99c1b1f1f05e', 'code': 200} Dec 09 21:29:38.001978 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '145a0cde-0fe5-4163-a063-0fdfe42f243b', 'code': 200} Dec 09 21:29:38.002373 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3bbd0bd0-666a-4f39-abae-59f44d88319c', 'code': 200} Dec 09 21:29:38.002615 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd0b23879-8919-4f30-9aa0-db8d2f85e707', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '38b263bd-10f0-49ea-bef8-a6caba0ce784', 'code': 200} Dec 09 21:29:38.002806 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ba78dacb-cf50-4182-b474-958412e2b568', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '723351f2-7c62-4bb5-aaad-288a6e26545f', 'code': 200} Dec 09 21:29:38.016916 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8763e648-5150-4281-a364-d9aed30842d1 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=85a6e1dda1094fc4ac53e74ece6bb8b8&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0981753 Dec 09 21:29:38.021008 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42908) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:38.040721 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 675f510c-c35a-468e-b70b-4abb34188642, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=675f510c-c35a-468e-b70b-4abb34188642,segment=NetworkSegment(4944fe1d-3354-4e33-b6be-75c5cb26e73d),segment_id=4944fe1d-3354-4e33-b6be-75c5cb26e73d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:38.061146 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '675f510c-c35a-468e-b70b-4abb34188642', 'network_id': '0bcede63-0fdd-4d40-8c5c-4890fec5dc38', 'port_id': '675f510c-c35a-468e-b70b-4abb34188642', 'mac_address': 'fa:16:3e:b8:be:47', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 105, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '16184032-e4c1-40c2-a34f-a13c4226a14a', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:29:38.095400 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1b0f709-397a-4ae8-89ad-4de8b1d5ae87 admin admin] Network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:29:38.105726 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-b1b0f709-397a-4ae8-89ad-4de8b1d5ae87 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:29:38.144234 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-98086329-8e98-4f2e-bca8-3739b0638ef8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:38.163560 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:38.170666 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61620202-f74f-476e-bb29-f33776acce8e req-1cdf26f1-ed94-4370-a949-8300652f4922 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:38.176034 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-98086329-8e98-4f2e-bca8-3739b0638ef8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:38.177623 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61620202-f74f-476e-bb29-f33776acce8e req-1cdf26f1-ed94-4370-a949-8300652f4922 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:38.183193 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 675f510c-c35a-468e-b70b-4abb34188642 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:38.184669 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61620202-f74f-476e-bb29-f33776acce8e req-1cdf26f1-ed94-4370-a949-8300652f4922 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:38.191572 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61620202-f74f-476e-bb29-f33776acce8e req-1cdf26f1-ed94-4370-a949-8300652f4922 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:38.198440 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61620202-f74f-476e-bb29-f33776acce8e req-1cdf26f1-ed94-4370-a949-8300652f4922 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:38.205566 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61620202-f74f-476e-bb29-f33776acce8e req-1cdf26f1-ed94-4370-a949-8300652f4922 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:38.212024 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61620202-f74f-476e-bb29-f33776acce8e req-1cdf26f1-ed94-4370-a949-8300652f4922 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:38.214493 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 675f510c-c35a-468e-b70b-4abb34188642, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=675f510c-c35a-468e-b70b-4abb34188642,segment=NetworkSegment(4944fe1d-3354-4e33-b6be-75c5cb26e73d),segment_id=4944fe1d-3354-4e33-b6be-75c5cb26e73d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:38.222086 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-61620202-f74f-476e-bb29-f33776acce8e req-1cdf26f1-ed94-4370-a949-8300652f4922 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5434 time: 0.4189129 Dec 09 21:29:38.222513 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:38.333432 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=675f510c-c35a-468e-b70b-4abb34188642,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:38.353123 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-90ab9c63-64ba-4b03-b3b8-5553030d4b65 service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4246974 Dec 09 21:29:38.381986 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-98086329-8e98-4f2e-bca8-3739b0638ef8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:38.385150 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-98086329-8e98-4f2e-bca8-3739b0638ef8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:38.386310 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-98086329-8e98-4f2e-bca8-3739b0638ef8 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/0af9104d-ead6-4d7f-9022-ddec6d6967d9 HTTP/1.1" status: 204 len: 168 time: 0.3638613 Dec 09 21:29:38.432647 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f97fe19-8ed9-427f-a15a-edf4e7186db6 req-09151f11-c403-4c8a-b8d9-37061ef0902e tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:38.434243 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2f97fe19-8ed9-427f-a15a-edf4e7186db6 req-09151f11-c403-4c8a-b8d9-37061ef0902e tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/ports?device_id=312d3f8f-a9e2-4604-b559-13de6a525547 HTTP/1.1" status: 200 len: 945 time: 0.2011642 Dec 09 21:29:38.435637 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98086329-8e98-4f2e-bca8-3739b0638ef8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0af9104d-ead6-4d7f-9022-ddec6d6967d9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:38.440954 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-61620202-f74f-476e-bb29-f33776acce8e req-0ec7c1f3-f874-44a1-8db0-5b44707270e3 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2176793 Dec 09 21:29:38.442600 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-df515a5d-ccbe-4a05-aec0-6b01bad4f659 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.103&port_id=57519c10-1d02-4ce7-b4be-b37a7bd58b09 HTTP/1.1" status: 200 len: 217 time: 0.0652530 Dec 09 21:29:38.444521 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90caa65a-d973-4169-b029-b35b407576b4 req-379513b1-8023-4b27-aa85-5979e81d5abd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:38.445943 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-90caa65a-d973-4169-b029-b35b407576b4 req-379513b1-8023-4b27-aa85-5979e81d5abd service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=312d3f8f-a9e2-4604-b559-13de6a525547 HTTP/1.1" status: 200 len: 1097 time: 0.3215327 Dec 09 21:29:38.456339 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['675f510c-c35a-468e-b70b-4abb34188642'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:29:38.492527 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be7512ed-6283-442d-ab0b-2a90bf77b48c req-8e1dd32d-9197-45e5-afe7-125167f889b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:38.494088 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-be7512ed-6283-442d-ab0b-2a90bf77b48c req-8e1dd32d-9197-45e5-afe7-125167f889b8 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=ba78dacb-cf50-4182-b474-958412e2b568 HTTP/1.1" status: 200 len: 1098 time: 0.2197976 Dec 09 21:29:38.513464 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-0c049d64-1d40-4664-99e5-3712b31b87e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:38.515511 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-0c049d64-1d40-4664-99e5-3712b31b87e4 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=871c2dc1-486e-4fcf-a882-5a1394082fc5 HTTP/1.1" status: 200 len: 797 time: 0.0649967 Dec 09 21:29:38.604397 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bacf293-7dfd-4cb5-a2c1-dd324719f853 req-fa0581d1-98a7-45c8-9325-90f2cd6849b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:38.605190 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bacf293-7dfd-4cb5-a2c1-dd324719f853 req-fa0581d1-98a7-45c8-9325-90f2cd6849b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:38.605964 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bacf293-7dfd-4cb5-a2c1-dd324719f853 req-fa0581d1-98a7-45c8-9325-90f2cd6849b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:38.606596 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bacf293-7dfd-4cb5-a2c1-dd324719f853 req-fa0581d1-98a7-45c8-9325-90f2cd6849b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:38.607310 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bacf293-7dfd-4cb5-a2c1-dd324719f853 req-fa0581d1-98a7-45c8-9325-90f2cd6849b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:38.608092 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bacf293-7dfd-4cb5-a2c1-dd324719f853 req-fa0581d1-98a7-45c8-9325-90f2cd6849b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:38.608739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bacf293-7dfd-4cb5-a2c1-dd324719f853 req-fa0581d1-98a7-45c8-9325-90f2cd6849b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:38.610899 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9bacf293-7dfd-4cb5-a2c1-dd324719f853 req-fa0581d1-98a7-45c8-9325-90f2cd6849b3 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 6498 time: 0.3721271 Dec 09 21:29:38.621651 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0a66bb2-aed1-40cd-a17a-fa0657c350b1 req-1a3eaca9-b11a-4b66-8c3c-92141a1a8ceb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:38.623937 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b0a66bb2-aed1-40cd-a17a-fa0657c350b1 req-1a3eaca9-b11a-4b66-8c3c-92141a1a8ceb service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=d0b23879-8919-4f30-9aa0-db8d2f85e707 HTTP/1.1" status: 200 len: 1097 time: 0.3485296 Dec 09 21:29:38.676204 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-90caa65a-d973-4169-b029-b35b407576b4 req-b3f1c81c-d45f-4181-bb7c-5c41da8a4419 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=872108a7-5ae2-4b16-8e57-f5d879884a6d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1594076 Dec 09 21:29:38.704382 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24bf3d49-6738-481c-990a-0480e897e547 req-3293662b-08f0-44f0-8f3f-15ead57ee63c tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:38.706243 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-24bf3d49-6738-481c-990a-0480e897e547 req-3293662b-08f0-44f0-8f3f-15ead57ee63c tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 943 time: 0.1102622 Dec 09 21:29:38.708448 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-679ba6a0-471f-4385-9345-3b6aa96859c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:38.710249 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-679ba6a0-471f-4385-9345-3b6aa96859c2 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1608298 Dec 09 21:29:38.736403 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2f97fe19-8ed9-427f-a15a-edf4e7186db6 req-cbfcc102-374a-4e6c-87cd-fbd73fd1c38a tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/security-groups?id=872108a7-5ae2-4b16-8e57-f5d879884a6d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2177331 Dec 09 21:29:38.738204 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ff8f212a-e53f-4a89-81c1-4a3b6f74497e None None] Provisioning complete for port 1ab9d8fe-6942-4722-90aa-1232fb6aab84 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:38.739147 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ff8f212a-e53f-4a89-81c1-4a3b6f74497e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:38.864004 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ff8f212a-e53f-4a89-81c1-4a3b6f74497e None None] Port 1ab9d8fe-6942-4722-90aa-1232fb6aab84 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:29:38.985840 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-27fa4b43-f385-4731-9a5d-de4128e71e6a service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2470136 Dec 09 21:29:38.990772 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-24bf3d49-6738-481c-990a-0480e897e547 req-2efb6704-95cc-4989-8417-a0b4987d121a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/security-groups?id=02690a1b-c814-4a6b-a7d8-1252ee74106e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2508078 Dec 09 21:29:39.027635 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce96037-15dd-4a14-9436-347f1c5e13c1 req-d7978c35-492c-4bff-9382-03756bfe1b51 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:39.034003 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce96037-15dd-4a14-9436-347f1c5e13c1 req-d7978c35-492c-4bff-9382-03756bfe1b51 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:39.040380 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce96037-15dd-4a14-9436-347f1c5e13c1 req-d7978c35-492c-4bff-9382-03756bfe1b51 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:39.061587 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce96037-15dd-4a14-9436-347f1c5e13c1 req-d7978c35-492c-4bff-9382-03756bfe1b51 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:39.074176 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce96037-15dd-4a14-9436-347f1c5e13c1 req-d7978c35-492c-4bff-9382-03756bfe1b51 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:39.081817 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce96037-15dd-4a14-9436-347f1c5e13c1 req-d7978c35-492c-4bff-9382-03756bfe1b51 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:39.089948 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce96037-15dd-4a14-9436-347f1c5e13c1 req-d7978c35-492c-4bff-9382-03756bfe1b51 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:39.102727 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ce96037-15dd-4a14-9436-347f1c5e13c1 req-d7978c35-492c-4bff-9382-03756bfe1b51 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5431 time: 0.2165794 Dec 09 21:29:39.136367 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b1b0f709-397a-4ae8-89ad-4de8b1d5ae87 admin admin] Router 1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:29:39.138920 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-be7512ed-6283-442d-ab0b-2a90bf77b48c req-0acdd49a-951c-4cc2-bec5-e680331500b6 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=09be3411-a85c-42e3-aaf7-829301eec3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5676103 Dec 09 21:29:39.235853 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0bf80ece-82d7-4c64-8066-ef5107ea9e0d up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:29:39.256791 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9bacf293-7dfd-4cb5-a2c1-dd324719f853 req-b2b86049-21d4-4710-9823-345a698b1704 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.6282582 Dec 09 21:29:39.277197 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab5a3d3f-f159-460b-9d13-34cf871d3973 req-968166ad-6f47-4cc5-85a4-9a9cac8d802d tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:39.278879 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab5a3d3f-f159-460b-9d13-34cf871d3973 req-968166ad-6f47-4cc5-85a4-9a9cac8d802d tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/ports?device_id=31a27c6f-f2ac-4eff-9039-700b918036ef HTTP/1.1" status: 200 len: 944 time: 0.1507678 Dec 09 21:29:39.301957 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ce96037-15dd-4a14-9436-347f1c5e13c1 req-32d9a23a-4113-47a5-9639-342927f4d6a7 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1984766 Dec 09 21:29:39.309575 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b0a66bb2-aed1-40cd-a17a-fa0657c350b1 req-a24ec8de-19a3-43c5-b62f-400368e3891d service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=09be3411-a85c-42e3-aaf7-829301eec3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1960282 Dec 09 21:29:39.314078 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 0bf80ece-82d7-4c64-8066-ef5107ea9e0d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:39.314531 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:39.337369 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-380ae8d4-20b5-4985-b437-859a14f399f6 service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3390715 Dec 09 21:29:39.340843 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b1b0f709-397a-4ae8-89ad-4de8b1d5ae87 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:29:39.364166 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b1b0f709-397a-4ae8-89ad-4de8b1d5ae87 admin admin] 10.222.0.13 "PUT /v2.0/routers/1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.3913112 Dec 09 21:29:39.399258 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab5a3d3f-f159-460b-9d13-34cf871d3973 req-7c8bee26-c9cd-49ae-aa29-b826835c0642 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/security-groups?id=09be3411-a85c-42e3-aaf7-829301eec3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0871944 Dec 09 21:29:39.436911 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:39.460293 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 0bf80ece-82d7-4c64-8066-ef5107ea9e0d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=0bf80ece-82d7-4c64-8066-ef5107ea9e0d,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:39.465003 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:39.541586 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=0bf80ece-82d7-4c64-8066-ef5107ea9e0d,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:39.545524 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] Sync routers for ids ['1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:29:39.567410 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] Routers {'1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:29:39.568121 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:29:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:39.593422 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-33383d70-cb33-40aa-97a8-be2c75aa7297 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.100&port_id=f6c2c656-c5c9-4a38-baf6-3924df82937d HTTP/1.1" status: 200 len: 217 time: 0.0602210 Dec 09 21:29:39.622630 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:39.678064 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-874214f1-1956-4280-9f5e-8f4d56bef96b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:39.679569 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-874214f1-1956-4280-9f5e-8f4d56bef96b service neutron] 10.222.0.10 "GET /v2.0/subnets?id=2b4dff83-a3e7-4d10-a901-43c21154e5da HTTP/1.1" status: 200 len: 797 time: 0.0737059 Dec 09 21:29:39.692070 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ce303f0-1e84-4cf3-8992-ca13d6bed22e req-2a6febe3-b773-4497-8158-a1ca6c2cd517 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:39.699014 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] Set router 1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:29:39.705883 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ce303f0-1e84-4cf3-8992-ca13d6bed22e req-2a6febe3-b773-4497-8158-a1ca6c2cd517 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:39.712904 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ce303f0-1e84-4cf3-8992-ca13d6bed22e req-2a6febe3-b773-4497-8158-a1ca6c2cd517 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:39.722244 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ce303f0-1e84-4cf3-8992-ca13d6bed22e req-2a6febe3-b773-4497-8158-a1ca6c2cd517 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:39.730673 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ce303f0-1e84-4cf3-8992-ca13d6bed22e req-2a6febe3-b773-4497-8158-a1ca6c2cd517 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:39.737062 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ce303f0-1e84-4cf3-8992-ca13d6bed22e req-2a6febe3-b773-4497-8158-a1ca6c2cd517 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:39.743167 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ce303f0-1e84-4cf3-8992-ca13d6bed22e req-2a6febe3-b773-4497-8158-a1ca6c2cd517 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:39.745632 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ce303f0-1e84-4cf3-8992-ca13d6bed22e req-2a6febe3-b773-4497-8158-a1ca6c2cd517 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5434 time: 0.1559665 Dec 09 21:29:39.823400 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-2ce68432-36d7-4629-a636-4a49c7cc3620 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:39.828360 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-2ce68432-36d7-4629-a636-4a49c7cc3620 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=ae9d25d5-c9a2-4627-a465-8324b17541d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0786457 Dec 09 21:29:39.843367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 675f510c-c35a-468e-b70b-4abb34188642 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:29:39.885681 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ce303f0-1e84-4cf3-8992-ca13d6bed22e req-25979169-917d-4833-8af6-6f331432d90a tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1275749 Dec 09 21:29:39.958012 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 675f510c-c35a-468e-b70b-4abb34188642 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:29:39.962487 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 675f510c-c35a-468e-b70b-4abb34188642 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:39.962917 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:39.966315 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-3f847cab-2bcf-4da5-b452-222c7efe7c0d service neutron] 10.222.0.10 "GET /v2.0/networks/ae9d25d5-c9a2-4627-a465-8324b17541d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1299968 Dec 09 21:29:40.010597 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'name': 'tempest-ServerActionsTestJSON-1559985225-router', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242'}], 'enable_snat': True}, 'gw_port_id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:29:30Z', 'updated_at': '2021-12-09T21:29:37Z', 'revision_number': 4, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'gw_port': {'id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:d4:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1299, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:29:31Z', 'updated_at': '2021-12-09T21:29:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '1ab9d8fe-6942-4722-90aa-1232fb6aab84', 'name': '', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'mac_address': 'fa:16:3e:3c:b2:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'device_owner': 'network:router_interface', 'standard_attr_id': 1300, 'fixed_ips': [{'subnet_id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:29:36Z', 'updated_at': '2021-12-09T21:29:37Z', 'revision_number': 2, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'subnets': [{'id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:40.043998 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] Checking router: 1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:29:40.044494 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] Updating router 1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586 port 1ab9d8fe-6942-4722-90aa-1232fb6aab84 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:29:40.102892 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:40.103129 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-202a267b-a5dc-4c90-88f3-c764b2cbf66d service neutron] 10.222.0.10 "GET /v2.0/networks/ae9d25d5-c9a2-4627-a465-8324b17541d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1237321 Dec 09 21:29:40.126432 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42960) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:40.132524 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-bfee4ade-26eb-4e13-ad71-6f852a055515 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1723684260', 'description': 'tempest-description--1472027391'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:40.153181 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:40.182568 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-a9dd04ac-2484-4b58-979a-da95eac94fcc service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=2c568c8f-47ca-4f47-ab71-187026ca02db HTTP/1.1" status: 200 len: 217 time: 0.0713530 Dec 09 21:29:40.190421 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bfee4ade-26eb-4e13-ad71-6f852a055515 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:40.285730 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-7f8021c5-ec97-449d-8468-109b6e9ba187 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:40.293267 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-7f8021c5-ec97-449d-8468-109b6e9ba187 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=2b4dff83-a3e7-4d10-a901-43c21154e5da HTTP/1.1" status: 200 len: 797 time: 0.0986435 Dec 09 21:29:40.336108 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bfee4ade-26eb-4e13-ad71-6f852a055515 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:40.346084 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bfee4ade-26eb-4e13-ad71-6f852a055515 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:40.351286 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '31a27c6f-f2ac-4eff-9039-700b918036ef', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '675f510c-c35a-468e-b70b-4abb34188642'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:40.353624 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-50d2602f-607b-4072-9336-b2d0e08f0f86" -d '{"events": [{"server_uuid": "31a27c6f-f2ac-4eff-9039-700b918036ef", "name": "network-vif-plugged", "status": "completed", "tag": "675f510c-c35a-468e-b70b-4abb34188642"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:40.384869 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 675f510c-c35a-468e-b70b-4abb34188642, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=675f510c-c35a-468e-b70b-4abb34188642,segment=NetworkSegment(4944fe1d-3354-4e33-b6be-75c5cb26e73d),segment_id=4944fe1d-3354-4e33-b6be-75c5cb26e73d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:40.394348 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7baff24-a719-4552-823d-e40b3a238dc0 req-e714fdce-4d5e-4364-b262-69d5a1303b80 tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:40.396692 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a7baff24-a719-4552-823d-e40b3a238dc0 req-e714fdce-4d5e-4364-b262-69d5a1303b80 tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/ports?device_id=312d3f8f-a9e2-4604-b559-13de6a525547 HTTP/1.1" status: 200 len: 945 time: 0.1673663 Dec 09 21:29:40.407858 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bfee4ade-26eb-4e13-ad71-6f852a055515 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:40.409521 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bfee4ade-26eb-4e13-ad71-6f852a055515 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1799 time: 0.2807999 Dec 09 21:29:40.410145 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:40.416252 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42970) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:40.422869 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-e3e11881-2bd2-4759-b854-fdc172bf0492 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Request body: {'security_group_rule': {'security_group_id': '8af3855c-aec1-4d4b-9b6b-aa6f0a87db66', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:40.429664 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfee4ade-26eb-4e13-ad71-6f852a055515 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:40.461142 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3e11881-2bd2-4759-b854-fdc172bf0492 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:40.477685 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-564f3972-8eb9-4892-9e53-b2ea25908c59 req-d1aa7ba6-f5af-4f90-8222-2307557369a1 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:40.487869 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-564f3972-8eb9-4892-9e53-b2ea25908c59 req-d1aa7ba6-f5af-4f90-8222-2307557369a1 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 943 time: 0.1916504 Dec 09 21:29:40.514500 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=675f510c-c35a-468e-b70b-4abb34188642,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:40.526366 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:40.526366 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:40.526713 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:40.526966 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:40.527407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:40.527853 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:40.528179 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:40.528503 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:40.528994 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:40.529328 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:40.529650 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:40.529970 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:40.530284 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:40.536023 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a7baff24-a719-4552-823d-e40b3a238dc0 req-c217fb19-b49d-4ced-bda8-1cbc0c6c25ba tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/security-groups?id=872108a7-5ae2-4b16-8e57-f5d879884a6d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1289351 Dec 09 21:29:40.538037 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3e11881-2bd2-4759-b854-fdc172bf0492 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:40.545991 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3e11881-2bd2-4759-b854-fdc172bf0492 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:40.553170 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-cc46a45f-6848-42cb-a888-6311a1657a98 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:40.554660 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-cc46a45f-6848-42cb-a888-6311a1657a98 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=ae9d25d5-c9a2-4627-a465-8324b17541d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.2464345 Dec 09 21:29:40.572367 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3e11881-2bd2-4759-b854-fdc172bf0492 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=05d5d177-df6f-4ef0-a346-4ad1f2e02c48,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:40.587979 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3e11881-2bd2-4759-b854-fdc172bf0492 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:40.589467 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e3e11881-2bd2-4759-b854-fdc172bf0492 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1717973 Dec 09 21:29:40.592880 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42978) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:40.597988 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-c2d527c9-6b03-40e6-a761-37034c2850e3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Request body: {'security_group_rule': {'security_group_id': '8af3855c-aec1-4d4b-9b6b-aa6f0a87db66', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:40.632309 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-564f3972-8eb9-4892-9e53-b2ea25908c59 req-fe47cb11-deb8-4699-aa3a-77e72e6ed1a6 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/security-groups?id=02690a1b-c814-4a6b-a7d8-1252ee74106e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1427212 Dec 09 21:29:40.644450 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c2d527c9-6b03-40e6-a761-37034c2850e3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:40.740505 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c2d527c9-6b03-40e6-a761-37034c2850e3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:40.750828 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c2d527c9-6b03-40e6-a761-37034c2850e3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:40.782445 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2d527c9-6b03-40e6-a761-37034c2850e3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a2af2ac8-b125-4aef-a853-3a14376d0914,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:40.783896 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d2d01da3-1f63-4f87-84d9-946fcc84be5a x-openstack-request-id: req-d2d01da3-1f63-4f87-84d9-946fcc84be5a {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:40.786248 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "31a27c6f-f2ac-4eff-9039-700b918036ef", "name": "network-vif-plugged", "status": "completed", "tag": "675f510c-c35a-468e-b70b-4abb34188642", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:40.786729 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-d2d01da3-1f63-4f87-84d9-946fcc84be5a {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:40.787527 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '31a27c6f-f2ac-4eff-9039-700b918036ef', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '675f510c-c35a-468e-b70b-4abb34188642', 'code': 200} Dec 09 21:29:40.813367 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c2d527c9-6b03-40e6-a761-37034c2850e3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:40.817341 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c2d527c9-6b03-40e6-a761-37034c2850e3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2204742 Dec 09 21:29:40.817752 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42982) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:40.818623 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:40.830396 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-f45a15d2-12af-4170-9bd7-751eea1be12c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:40.837422 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:40.860501 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19ba8028-053d-46e2-8dbe-92ee6bc9672c req-b269e43f-cdd5-4795-a23b-fc12995dbe5d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:40.868468 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19ba8028-053d-46e2-8dbe-92ee6bc9672c req-b269e43f-cdd5-4795-a23b-fc12995dbe5d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:40.875691 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19ba8028-053d-46e2-8dbe-92ee6bc9672c req-b269e43f-cdd5-4795-a23b-fc12995dbe5d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:40.884150 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19ba8028-053d-46e2-8dbe-92ee6bc9672c req-b269e43f-cdd5-4795-a23b-fc12995dbe5d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:40.884710 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f45a15d2-12af-4170-9bd7-751eea1be12c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for floatingip, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:40.890378 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19ba8028-053d-46e2-8dbe-92ee6bc9672c req-b269e43f-cdd5-4795-a23b-fc12995dbe5d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:40.896654 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19ba8028-053d-46e2-8dbe-92ee6bc9672c req-b269e43f-cdd5-4795-a23b-fc12995dbe5d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:40.902619 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19ba8028-053d-46e2-8dbe-92ee6bc9672c req-b269e43f-cdd5-4795-a23b-fc12995dbe5d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:40.911682 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19ba8028-053d-46e2-8dbe-92ee6bc9672c req-b269e43f-cdd5-4795-a23b-fc12995dbe5d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5431 time: 0.1797743 Dec 09 21:29:40.942591 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-9fac2f95-e72f-4999-a004-f4529742b218 service neutron] 10.222.0.10 "GET /v2.0/networks/ae9d25d5-c9a2-4627-a465-8324b17541d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3596187 Dec 09 21:29:40.972966 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ec436ca-48ba-4bf1-92d7-ddb90f5325d5 req-b3b138db-bcf3-4e16-8f3a-3eb948dfd0ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:40.974711 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8ec436ca-48ba-4bf1-92d7-ddb90f5325d5 req-b3b138db-bcf3-4e16-8f3a-3eb948dfd0ef service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=31a27c6f-f2ac-4eff-9039-700b918036ef HTTP/1.1" status: 200 len: 1097 time: 0.0704026 Dec 09 21:29:40.984029 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13cf4dd0-7e56-4201-b566-d7ae2d645e53 None None] Pushing event updated for resources: {'Port': ['ID=1ab9d8fe-6942-4722-90aa-1232fb6aab84,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:41.023587 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] Attempting to bind port 1ab9d8fe-6942-4722-90aa-1232fb6aab84 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:29:41.024755 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] Attempting to bind port 1ab9d8fe-6942-4722-90aa-1232fb6aab84 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:29:41.025138 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] Attempting to bind port 1ab9d8fe-6942-4722-90aa-1232fb6aab84 on network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:41.035588 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 29, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:29:41.035892 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] Checking segment: {'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:29:41.036309 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:41.036707 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] Bound using segment: {'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:29:41.037185 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] Bound port: 1ab9d8fe-6942-4722-90aa-1232fb6aab84, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:29:41.037574 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:41.123325 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8ec436ca-48ba-4bf1-92d7-ddb90f5325d5 req-bfa3f510-9aef-4e1d-b354-44b59ae072bc service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=09be3411-a85c-42e3-aaf7-829301eec3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1414573 Dec 09 21:29:41.148398 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] For port 1ab9d8fe-6942-4722-90aa-1232fb6aab84, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:29:41.155030 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] For port 1ab9d8fe-6942-4722-90aa-1232fb6aab84, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=1ab9d8fe-6942-4722-90aa-1232fb6aab84,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:29:41.165539 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:41.173960 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f45a15d2-12af-4170-9bd7-751eea1be12c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:41.239125 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0bf80ece-82d7-4c64-8066-ef5107ea9e0d up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:29:41.273440 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13cf4dd0-7e56-4201-b566-d7ae2d645e53 None None] Pushing event updated for resources: {'Port': ['ID=1ab9d8fe-6942-4722-90aa-1232fb6aab84,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:41.325041 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] Routers {'1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:29:41.325968 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:29:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:41.370432 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-f45a15d2-12af-4170-9bd7-751eea1be12c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Allocated IP 172.25.3.249 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/3db534ad-6c5d-4da2-b2a6-16ff51de3d1e) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:29:41.512748 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] Set router 1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:29:41.515783 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f45a15d2-12af-4170-9bd7-751eea1be12c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:41.574867 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4ec3e4e7-1b03-4cd9-9902-174f73ef772e None None] Provisioning complete for port 1ab9d8fe-6942-4722-90aa-1232fb6aab84 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:41.575286 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4ec3e4e7-1b03-4cd9-9902-174f73ef772e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:41.580008 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f45a15d2-12af-4170-9bd7-751eea1be12c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:41.627878 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f45a15d2-12af-4170-9bd7-751eea1be12c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:29:41.631171 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-f45a15d2-12af-4170-9bd7-751eea1be12c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:29:41.633252 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4147d6e1-7d43-4bdb-b9cf-1f1dbe8f3c35 req-751c09da-b498-4b0d-aff6-91d217e6e21a service neutron] 10.222.0.10 "GET /v2.0/networks/ae9d25d5-c9a2-4627-a465-8324b17541d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6623478 Dec 09 21:29:41.634568 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f45a15d2-12af-4170-9bd7-751eea1be12c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:29:41.646956 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19ba8028-053d-46e2-8dbe-92ee6bc9672c req-53892b97-b1bb-4a2b-8a0c-4b8327c79757 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.7340326 Dec 09 21:29:41.648818 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 0bf80ece-82d7-4c64-8066-ef5107ea9e0d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:41.649405 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:41.663687 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a1e786e-574e-4fc4-8090-ed3b2ad213a1 req-9522417a-7e5c-4d26-a531-d29894133942 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:41.675277 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a1e786e-574e-4fc4-8090-ed3b2ad213a1 req-9522417a-7e5c-4d26-a531-d29894133942 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/ports?device_id=31a27c6f-f2ac-4eff-9039-700b918036ef HTTP/1.1" status: 200 len: 945 time: 0.7440016 Dec 09 21:29:41.703938 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f45a15d2-12af-4170-9bd7-751eea1be12c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Pushing event updated for resources: {'Port': ['ID=3db534ad-6c5d-4da2-b2a6-16ff51de3d1e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:41.760843 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a1e786e-574e-4fc4-8090-ed3b2ad213a1 req-9ecfb382-ff38-4ab1-81fe-08478c4b6157 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/security-groups?id=09be3411-a85c-42e3-aaf7-829301eec3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0851057 Dec 09 21:29:41.811510 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f45a15d2-12af-4170-9bd7-751eea1be12c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:41.817266 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-251c5726-69d9-4e3c-99d9-414bc5c142ec req-6d644522-0c56-4e45-a097-ec7e55a38c7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:41.817928 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-251c5726-69d9-4e3c-99d9-414bc5c142ec req-6d644522-0c56-4e45-a097-ec7e55a38c7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:41.818576 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-251c5726-69d9-4e3c-99d9-414bc5c142ec req-6d644522-0c56-4e45-a097-ec7e55a38c7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:41.819315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-251c5726-69d9-4e3c-99d9-414bc5c142ec req-6d644522-0c56-4e45-a097-ec7e55a38c7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:41.819894 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-251c5726-69d9-4e3c-99d9-414bc5c142ec req-6d644522-0c56-4e45-a097-ec7e55a38c7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:41.820446 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-251c5726-69d9-4e3c-99d9-414bc5c142ec req-6d644522-0c56-4e45-a097-ec7e55a38c7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:41.820956 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-251c5726-69d9-4e3c-99d9-414bc5c142ec req-6d644522-0c56-4e45-a097-ec7e55a38c7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:41.823238 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-251c5726-69d9-4e3c-99d9-414bc5c142ec req-6d644522-0c56-4e45-a097-ec7e55a38c7a service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0a5d0e4652be4d8b87936a559840cc87&device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 6495 time: 0.0754883 Dec 09 21:29:41.825411 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4ec3e4e7-1b03-4cd9-9902-174f73ef772e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:41.875396 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f45a15d2-12af-4170-9bd7-751eea1be12c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:42.029523 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22b58f3b-ca01-48f3-b7c1-79d14911943c req-fc9968e9-0376-4ee8-a9e7-5c0f91083c53 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:42.037248 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22b58f3b-ca01-48f3-b7c1-79d14911943c req-fc9968e9-0376-4ee8-a9e7-5c0f91083c53 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:42.046544 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22b58f3b-ca01-48f3-b7c1-79d14911943c req-fc9968e9-0376-4ee8-a9e7-5c0f91083c53 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:42.053083 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22b58f3b-ca01-48f3-b7c1-79d14911943c req-fc9968e9-0376-4ee8-a9e7-5c0f91083c53 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:42.059352 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22b58f3b-ca01-48f3-b7c1-79d14911943c req-fc9968e9-0376-4ee8-a9e7-5c0f91083c53 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:42.066868 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22b58f3b-ca01-48f3-b7c1-79d14911943c req-fc9968e9-0376-4ee8-a9e7-5c0f91083c53 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:42.072882 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f45a15d2-12af-4170-9bd7-751eea1be12c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:42.074863 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22b58f3b-ca01-48f3-b7c1-79d14911943c req-fc9968e9-0376-4ee8-a9e7-5c0f91083c53 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:42.077212 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22b58f3b-ca01-48f3-b7c1-79d14911943c req-fc9968e9-0376-4ee8-a9e7-5c0f91083c53 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5434 time: 0.2034428 Dec 09 21:29:42.084111 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f45a15d2-12af-4170-9bd7-751eea1be12c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:42.090086 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-4ec3e4e7-1b03-4cd9-9902-174f73ef772e None None] For port 1ab9d8fe-6942-4722-90aa-1232fb6aab84, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=1ab9d8fe-6942-4722-90aa-1232fb6aab84,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:42.099477 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4ec3e4e7-1b03-4cd9-9902-174f73ef772e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:42.155926 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-251c5726-69d9-4e3c-99d9-414bc5c142ec req-1b48e626-0f94-4fa2-963c-75fdf4683a5d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:42.157603 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ec3e4e7-1b03-4cd9-9902-174f73ef772e None None] Pushing event updated for resources: {'Port': ['ID=1ab9d8fe-6942-4722-90aa-1232fb6aab84,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:42.158162 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-251c5726-69d9-4e3c-99d9-414bc5c142ec req-1b48e626-0f94-4fa2-963c-75fdf4683a5d service neutron] 10.222.0.10 "GET /v2.0/networks?id=ae9d25d5-c9a2-4627-a465-8324b17541d9 HTTP/1.1" status: 200 len: 902 time: 0.3215759 Dec 09 21:29:42.163203 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'name': 'tempest-ServerActionsTestJSON-1559985225-router', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242'}], 'enable_snat': True}, 'gw_port_id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:29:30Z', 'updated_at': '2021-12-09T21:29:37Z', 'revision_number': 4, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'gw_port': {'id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:d4:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1299, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:29:31Z', 'updated_at': '2021-12-09T21:29:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '1ab9d8fe-6942-4722-90aa-1232fb6aab84', 'name': '', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'mac_address': 'fa:16:3e:3c:b2:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'device_owner': 'network:router_interface', 'standard_attr_id': 1300, 'fixed_ips': [{'subnet_id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:29:36Z', 'updated_at': '2021-12-09T21:29:41Z', 'revision_number': 4, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'subnets': [{'id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:42.171745 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f45a15d2-12af-4170-9bd7-751eea1be12c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Pushing event updated for resources: {'Port': ['ID=3db534ad-6c5d-4da2-b2a6-16ff51de3d1e,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:42.179946 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f45a15d2-12af-4170-9bd7-751eea1be12c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:42.196977 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1bcf94d-04d2-47d5-a2e4-7a629ea98078 None None] The sync data for ids ['1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'] in n-d-713301-27 is: [{'id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'name': 'tempest-ServerActionsTestJSON-1559985225-router', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242'}], 'enable_snat': True}, 'gw_port_id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:29:30Z', 'updated_at': '2021-12-09T21:29:37Z', 'revision_number': 4, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'gw_port': {'id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:d4:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1299, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:29:31Z', 'updated_at': '2021-12-09T21:29:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '1ab9d8fe-6942-4722-90aa-1232fb6aab84', 'name': '', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'mac_address': 'fa:16:3e:3c:b2:ae', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'device_owner': 'network:router_interface', 'standard_attr_id': 1300, 'fixed_ips': [{'subnet_id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:29:36Z', 'updated_at': '2021-12-09T21:29:41Z', 'revision_number': 4, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'subnets': [{'id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:29:42.197268 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f45a15d2-12af-4170-9bd7-751eea1be12c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:42.198537 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f45a15d2-12af-4170-9bd7-751eea1be12c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.3796275 Dec 09 21:29:42.222536 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9382bdc9-2ad7-417d-84f0-96d1fd63976f None None] Provisioning complete for port 1ab9d8fe-6942-4722-90aa-1232fb6aab84 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:42.222915 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9382bdc9-2ad7-417d-84f0-96d1fd63976f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:42.249620 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-251c5726-69d9-4e3c-99d9-414bc5c142ec req-cf3c47e3-d2c6-4bc3-9cf6-0ae33494c81f service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=2c568c8f-47ca-4f47-ab71-187026ca02db HTTP/1.1" status: 200 len: 217 time: 0.0807903 Dec 09 21:29:42.294324 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7909b1f8-ea13-4816-ac83-1c52e4416b3f req-42e92d63-e6d7-4f40-9222-aa745583bd45 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:42.303380 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7909b1f8-ea13-4816-ac83-1c52e4416b3f req-42e92d63-e6d7-4f40-9222-aa745583bd45 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 943 time: 0.2237477 Dec 09 21:29:42.357461 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22b58f3b-ca01-48f3-b7c1-79d14911943c req-5df49ad7-d116-4273-94f7-f06e3ca726b7 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.2696042 Dec 09 21:29:42.411154 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7909b1f8-ea13-4816-ac83-1c52e4416b3f req-69166754-ada5-4a6d-aafa-343f0be1f571 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/security-groups?id=02690a1b-c814-4a6b-a7d8-1252ee74106e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1076839 Dec 09 21:29:42.412689 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-251c5726-69d9-4e3c-99d9-414bc5c142ec req-ecc282b8-b42b-49e9-90c4-6e0cdd540621 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:42.415623 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-251c5726-69d9-4e3c-99d9-414bc5c142ec req-ecc282b8-b42b-49e9-90c4-6e0cdd540621 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=2b4dff83-a3e7-4d10-a901-43c21154e5da HTTP/1.1" status: 200 len: 797 time: 0.1531503 Dec 09 21:29:42.476816 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-251c5726-69d9-4e3c-99d9-414bc5c142ec req-a9aab68d-dddd-4e62-8c29-530fe9a7abb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:42.479106 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-251c5726-69d9-4e3c-99d9-414bc5c142ec req-a9aab68d-dddd-4e62-8c29-530fe9a7abb2 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=ae9d25d5-c9a2-4627-a465-8324b17541d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0541768 Dec 09 21:29:42.631946 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8b10869-4891-4bb4-9e30-79060b24e252 req-bfb243b9-656c-48e0-93b3-aeaf1fe7d404 tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:42.633483 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8b10869-4891-4bb4-9e30-79060b24e252 req-bfb243b9-656c-48e0-93b3-aeaf1fe7d404 tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/ports?device_id=312d3f8f-a9e2-4604-b559-13de6a525547 HTTP/1.1" status: 200 len: 945 time: 0.1350455 Dec 09 21:29:42.680935 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-75ba0004-69a7-409b-a61a-045e49799644 req-c60262aa-1905-4ae4-9bcf-6edf40864ee5 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-securitygroup--1723684260&fields=id&tenant_id=a36a93590a9f45e1b9b3f78753bb8e12 HTTP/1.1" status: 200 len: 267 time: 0.1344786 Dec 09 21:29:42.682993 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-251c5726-69d9-4e3c-99d9-414bc5c142ec req-bfa3a31b-38a5-4d85-9e3c-a9b6b90823ed service neutron] 10.222.0.10 "GET /v2.0/networks/ae9d25d5-c9a2-4627-a465-8324b17541d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1940949 Dec 09 21:29:42.777350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8b10869-4891-4bb4-9e30-79060b24e252 req-a8a69a40-b3e4-4288-9ad3-d952772f446a tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/security-groups?id=872108a7-5ae2-4b16-8e57-f5d879884a6d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1349843 Dec 09 21:29:42.940768 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75ba0004-69a7-409b-a61a-045e49799644 req-7f82f067-84e6-4f0e-b1e6-1e406d1e3ac5 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:42.942307 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-75ba0004-69a7-409b-a61a-045e49799644 req-7f82f067-84e6-4f0e-b1e6-1e406d1e3ac5 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 812 time: 0.2557287 Dec 09 21:29:42.949993 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-251c5726-69d9-4e3c-99d9-414bc5c142ec req-d286f198-f458-4020-9eaf-f76adad1d9a0 service neutron] 10.222.0.10 "GET /v2.0/networks/ae9d25d5-c9a2-4627-a465-8324b17541d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2463434 Dec 09 21:29:42.977230 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8f49779-f7b8-4b00-afa8-3f55202111b5 req-33c8b58a-fb3b-4ed8-bfc4-abd7e87f4ae9 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:42.983865 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8f49779-f7b8-4b00-afa8-3f55202111b5 req-33c8b58a-fb3b-4ed8-bfc4-abd7e87f4ae9 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:42.989903 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8f49779-f7b8-4b00-afa8-3f55202111b5 req-33c8b58a-fb3b-4ed8-bfc4-abd7e87f4ae9 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:42.995996 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8f49779-f7b8-4b00-afa8-3f55202111b5 req-33c8b58a-fb3b-4ed8-bfc4-abd7e87f4ae9 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:43.002545 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8f49779-f7b8-4b00-afa8-3f55202111b5 req-33c8b58a-fb3b-4ed8-bfc4-abd7e87f4ae9 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:43.008556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8f49779-f7b8-4b00-afa8-3f55202111b5 req-33c8b58a-fb3b-4ed8-bfc4-abd7e87f4ae9 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:43.015015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8f49779-f7b8-4b00-afa8-3f55202111b5 req-33c8b58a-fb3b-4ed8-bfc4-abd7e87f4ae9 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:43.017071 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8f49779-f7b8-4b00-afa8-3f55202111b5 req-33c8b58a-fb3b-4ed8-bfc4-abd7e87f4ae9 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5434 time: 0.1580727 Dec 09 21:29:43.018573 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-75ba0004-69a7-409b-a61a-045e49799644 req-1f1ca8ae-09db-49af-b454-6262bad69f63 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/quotas/a36a93590a9f45e1b9b3f78753bb8e12 HTTP/1.1" status: 200 len: 375 time: 0.0663664 Dec 09 21:29:43.029414 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43016) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:43.034013 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-785a5722-9982-4c3b-b5e7-8ed65c6f480d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Request body: {'floatingip': {'port_id': '90180a85-620b-470e-b808-b635138111be'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:43.077644 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-785a5722-9982-4c3b-b5e7-8ed65c6f480d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for floatingip, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:43.081758 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-75ba0004-69a7-409b-a61a-045e49799644 req-9d8c8cfb-ee38-4eea-8977-a47a3e1381a8 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0537703 Dec 09 21:29:43.218439 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 1ab9d8fe-6942-4722-90aa-1232fb6aab84 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:29:43.259203 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-75ba0004-69a7-409b-a61a-045e49799644 req-c9f7ae17-3d72-4988-a05e-c05e3de53aee service neutron] 10.222.0.13 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1621823 Dec 09 21:29:43.281201 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 1ab9d8fe-6942-4722-90aa-1232fb6aab84 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:43.281957 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:43.375172 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-75ba0004-69a7-409b-a61a-045e49799644 req-63e84d1c-2afc-40e3-997d-fd05e3e81350 service neutron] 10.222.0.13 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1086609 Dec 09 21:29:43.563577 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5423283-ca8a-4596-9820-340adb37bc93 req-eb86de83-305d-45ad-9cd9-e9080bd4b368 tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:43.565334 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c5423283-ca8a-4596-9820-340adb37bc93 req-eb86de83-305d-45ad-9cd9-e9080bd4b368 tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.31 "GET /v2.0/ports?device_id=312d3f8f-a9e2-4604-b559-13de6a525547 HTTP/1.1" status: 200 len: 945 time: 0.2043927 Dec 09 21:29:43.599804 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1debfaf-ea18-42f9-a8b4-7506d0b71fea req-20e58541-2c39-4365-af0d-8ec17274182d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:43.606277 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1debfaf-ea18-42f9-a8b4-7506d0b71fea req-20e58541-2c39-4365-af0d-8ec17274182d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:43.630783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1debfaf-ea18-42f9-a8b4-7506d0b71fea req-20e58541-2c39-4365-af0d-8ec17274182d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:43.637179 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1debfaf-ea18-42f9-a8b4-7506d0b71fea req-20e58541-2c39-4365-af0d-8ec17274182d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:43.656205 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1debfaf-ea18-42f9-a8b4-7506d0b71fea req-20e58541-2c39-4365-af0d-8ec17274182d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:43.669389 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1debfaf-ea18-42f9-a8b4-7506d0b71fea req-20e58541-2c39-4365-af0d-8ec17274182d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:43.677167 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1debfaf-ea18-42f9-a8b4-7506d0b71fea req-20e58541-2c39-4365-af0d-8ec17274182d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:43.679169 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a1debfaf-ea18-42f9-a8b4-7506d0b71fea req-20e58541-2c39-4365-af0d-8ec17274182d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5431 time: 0.1706364 Dec 09 21:29:43.812344 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e7f7ffb-2c7d-4a0f-98e8-13a87603e0f1 req-2b3c9bde-fc88-46a2-ba5c-90949b01b9dd tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:43.814200 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e7f7ffb-2c7d-4a0f-98e8-13a87603e0f1 req-2b3c9bde-fc88-46a2-ba5c-90949b01b9dd tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/ports?device_id=31a27c6f-f2ac-4eff-9039-700b918036ef HTTP/1.1" status: 200 len: 945 time: 0.1340692 Dec 09 21:29:43.837504 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a1debfaf-ea18-42f9-a8b4-7506d0b71fea req-b8799f0d-d667-4f1d-bf0e-2f4b9fe9c2aa tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1317742 Dec 09 21:29:43.878566 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-785a5722-9982-4c3b-b5e7-8ed65c6f480d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:43.886754 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-c5423283-ca8a-4596-9820-340adb37bc93 req-0596ec21-cf0e-4cf4-b196-c36eeba3b40e tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Deleting port 61aa5263-8686-42ca-a69d-76fd6420ede8 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:29:43.887577 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c5423283-ca8a-4596-9820-340adb37bc93 req-0596ec21-cf0e-4cf4-b196-c36eeba3b40e tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:43.931971 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e7f7ffb-2c7d-4a0f-98e8-13a87603e0f1 req-f7149d51-bf6a-48db-b459-d15f8013b058 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/security-groups?id=09be3411-a85c-42e3-aaf7-829301eec3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0875561 Dec 09 21:29:43.991406 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-785a5722-9982-4c3b-b5e7-8ed65c6f480d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:44.123344 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1785c255-7e07-4b07-8b5b-4f1c4a939a6f req-08b23372-217f-499e-9ace-c6e7d4ee4b4c tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:44.125738 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1785c255-7e07-4b07-8b5b-4f1c4a939a6f req-08b23372-217f-499e-9ace-c6e7d4ee4b4c tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 943 time: 0.0655696 Dec 09 21:29:44.154276 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-785a5722-9982-4c3b-b5e7-8ed65c6f480d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Floating IP 12695033-260e-4718-a36f-6ec3b27ba7c8 associated. External IP: 172.25.3.134, port: 90180a85-620b-470e-b808-b635138111be. Dec 09 21:29:44.184496 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ce53493d-5e33-4b76-adee-2f6096dc6eee req-10ae6179-7566-4d7d-96e4-9e00bab3da57 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 210 time: 0.0422754 Dec 09 21:29:44.205946 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-c5423283-ca8a-4596-9820-340adb37bc93 req-0596ec21-cf0e-4cf4-b196-c36eeba3b40e tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] For port 61aa5263-8686-42ca-a69d-76fd6420ede8, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=61aa5263-8686-42ca-a69d-76fd6420ede8,segment=NetworkSegment(156677c4-8e58-420b-a3a1-7c1c07b52a7d),segment_id=156677c4-8e58-420b-a3a1-7c1c07b52a7d)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:44.206324 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c5423283-ca8a-4596-9820-340adb37bc93 req-0596ec21-cf0e-4cf4-b196-c36eeba3b40e tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:44.222047 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1785c255-7e07-4b07-8b5b-4f1c4a939a6f req-a4ed4b52-102d-4b92-97f5-f9466a025732 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/security-groups?id=02690a1b-c814-4a6b-a7d8-1252ee74106e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0894005 Dec 09 21:29:44.225284 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-c5423283-ca8a-4596-9820-340adb37bc93 req-0596ec21-cf0e-4cf4-b196-c36eeba3b40e tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Calling delete_port for 61aa5263-8686-42ca-a69d-76fd6420ede8 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:29:44.378415 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15bdc7cd-c298-4490-ba14-88929a843c81 req-db5b7f6a-616a-4518-a503-b3feb13aa842 tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:44.380038 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15bdc7cd-c298-4490-ba14-88929a843c81 req-db5b7f6a-616a-4518-a503-b3feb13aa842 tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/ports?device_id=312d3f8f-a9e2-4604-b559-13de6a525547 HTTP/1.1" status: 200 len: 945 time: 0.1009960 Dec 09 21:29:44.433586 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a44d3612-2e8e-4018-af5e-1fcd9b1ee2f4 req-31452a9e-3c95-42c2-8730-94001bca1953 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:44.435154 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a44d3612-2e8e-4018-af5e-1fcd9b1ee2f4 req-31452a9e-3c95-42c2-8730-94001bca1953 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/ports?device_id=ba78dacb-cf50-4182-b474-958412e2b568 HTTP/1.1" status: 200 len: 946 time: 0.1156888 Dec 09 21:29:44.500964 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15bdc7cd-c298-4490-ba14-88929a843c81 req-d13e2843-ccf4-4b9d-936b-8ccb2505f8a9 tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.13 "GET /v2.0/security-groups?id=872108a7-5ae2-4b16-8e57-f5d879884a6d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1131294 Dec 09 21:29:44.517016 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-785a5722-9982-4c3b-b5e7-8ed65c6f480d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Router f2b3fc08-9e60-4600-9a8b-7400a9e940a0 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:29:44.553448 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a44d3612-2e8e-4018-af5e-1fcd9b1ee2f4 req-5416476c-8449-44d2-bf10-7d47376abfa3 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/security-groups?id=09be3411-a85c-42e3-aaf7-829301eec3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1080599 Dec 09 21:29:44.635201 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c5423283-ca8a-4596-9820-340adb37bc93 req-0596ec21-cf0e-4cf4-b196-c36eeba3b40e tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:44.650973 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['61aa5263-8686-42ca-a69d-76fd6420ede8'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:29:44.692784 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfdbb95a-eeb0-4ce9-91fe-75e2a89e21f3 req-94ab3d7b-d6f4-4417-b21c-ee182bed1898 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:44.694345 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfdbb95a-eeb0-4ce9-91fe-75e2a89e21f3 req-94ab3d7b-d6f4-4417-b21c-ee182bed1898 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/ports?device_id=d0b23879-8919-4f30-9aa0-db8d2f85e707 HTTP/1.1" status: 200 len: 945 time: 0.0618541 Dec 09 21:29:44.697576 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0596ec21-cf0e-4cf4-b196-c36eeba3b40e tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Pushing event deleted for resources: {'Port': ['ID=61aa5263-8686-42ca-a69d-76fd6420ede8,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:44.752418 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-c5423283-ca8a-4596-9820-340adb37bc93 req-0596ec21-cf0e-4cf4-b196-c36eeba3b40e tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] No DVR routers for this DVR port 61aa5263-8686-42ca-a69d-76fd6420ede8 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:29:44.755907 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c5423283-ca8a-4596-9820-340adb37bc93 req-0596ec21-cf0e-4cf4-b196-c36eeba3b40e tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:44.760591 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c5423283-ca8a-4596-9820-340adb37bc93 req-0596ec21-cf0e-4cf4-b196-c36eeba3b40e tempest-InstanceActionsV221TestJSON-2125752409 tempest-InstanceActionsV221TestJSON-2125752409-project] 10.222.0.31 "DELETE /v2.0/ports/61aa5263-8686-42ca-a69d-76fd6420ede8 HTTP/1.1" status: 204 len: 173 time: 1.1883407 Dec 09 21:29:44.761117 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '312d3f8f-a9e2-4604-b559-13de6a525547', 'name': 'network-vif-deleted', 'tag': '61aa5263-8686-42ca-a69d-76fd6420ede8'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:44.763697 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f3bc77d8-572c-4436-a5af-3939468ef3fb" -d '{"events": [{"server_uuid": "312d3f8f-a9e2-4604-b559-13de6a525547", "name": "network-vif-deleted", "tag": "61aa5263-8686-42ca-a69d-76fd6420ede8"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:44.768187 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-785a5722-9982-4c3b-b5e7-8ed65c6f480d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:29:44.773408 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-785a5722-9982-4c3b-b5e7-8ed65c6f480d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:44.776748 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfdbb95a-eeb0-4ce9-91fe-75e2a89e21f3 req-092bfa1e-db90-4e8e-8350-7008ccd36e5b tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/security-groups?id=09be3411-a85c-42e3-aaf7-829301eec3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0759068 Dec 09 21:29:44.782853 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3aa9255-f193-412f-a8d9-e152cf4eb442 None None] Sync routers for ids ['f2b3fc08-9e60-4600-9a8b-7400a9e940a0'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:29:44.858865 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0e98e70a-aa0a-4f51-9129-580bcf03911c x-openstack-request-id: req-0e98e70a-aa0a-4f51-9129-580bcf03911c {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:44.859160 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "312d3f8f-a9e2-4604-b559-13de6a525547", "name": "network-vif-deleted", "tag": "61aa5263-8686-42ca-a69d-76fd6420ede8", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:44.859469 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0e98e70a-aa0a-4f51-9129-580bcf03911c {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:44.861926 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '312d3f8f-a9e2-4604-b559-13de6a525547', 'name': 'network-vif-deleted', 'tag': '61aa5263-8686-42ca-a69d-76fd6420ede8', 'status': 'completed', 'code': 200} Dec 09 21:29:44.936221 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-785a5722-9982-4c3b-b5e7-8ed65c6f480d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "PUT /v2.0/floatingips/12695033-260e-4718-a36f-6ec3b27ba7c8 HTTP/1.1" status: 200 len: 992 time: 1.9026499 Dec 09 21:29:45.010161 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3aa9255-f193-412f-a8d9-e152cf4eb442 None None] Routers {'f2b3fc08-9e60-4600-9a8b-7400a9e940a0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:29:45.011042 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a3aa9255-f193-412f-a8d9-e152cf4eb442 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:29:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f2b3fc08-9e60-4600-9a8b-7400a9e940a0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:45.086441 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75ba0004-69a7-409b-a61a-045e49799644 req-e319c557-ec86-4d90-9dc7-2040227869d2 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:45.088199 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-75ba0004-69a7-409b-a61a-045e49799644 req-e319c557-ec86-4d90-9dc7-2040227869d2 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.31 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 812 time: 0.2646742 Dec 09 21:29:45.179985 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10cab16c-c86f-42ef-9142-f469294b983c req-0c2810ee-5559-4369-817a-94fca8424a10 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:45.182714 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-75ba0004-69a7-409b-a61a-045e49799644 req-50f0b3ba-b086-43e8-9b36-1a632eb2e628 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a36a93590a9f45e1b9b3f78753bb8e12 HTTP/1.1" status: 200 len: 380 time: 0.0828278 Dec 09 21:29:45.195542 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-75ba0004-69a7-409b-a61a-045e49799644 req-95afd872-b3da-4d1a-b115-0d06bdc34add tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Request body: {'port': {'device_id': '7ef6883d-9c98-4e81-b102-bc1197ac4a47', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'admin_state_up': True, 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'security_groups': ['8af3855c-aec1-4d4b-9b6b-aa6f0a87db66']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:45.197731 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10cab16c-c86f-42ef-9142-f469294b983c req-0c2810ee-5559-4369-817a-94fca8424a10 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:45.201493 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-a3aa9255-f193-412f-a8d9-e152cf4eb442 None None] Set router f2b3fc08-9e60-4600-9a8b-7400a9e940a0 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:29:45.213870 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:29:45.217326 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10cab16c-c86f-42ef-9142-f469294b983c req-0c2810ee-5559-4369-817a-94fca8424a10 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:45.233626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10cab16c-c86f-42ef-9142-f469294b983c req-0c2810ee-5559-4369-817a-94fca8424a10 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:45.254434 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10cab16c-c86f-42ef-9142-f469294b983c req-0c2810ee-5559-4369-817a-94fca8424a10 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:45.270556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10cab16c-c86f-42ef-9142-f469294b983c req-0c2810ee-5559-4369-817a-94fca8424a10 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:45.287817 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10cab16c-c86f-42ef-9142-f469294b983c req-0c2810ee-5559-4369-817a-94fca8424a10 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:45.302417 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-10cab16c-c86f-42ef-9142-f469294b983c req-0c2810ee-5559-4369-817a-94fca8424a10 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5431 time: 0.2865760 Dec 09 21:29:45.426983 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc,segment=NetworkSegment(dc772362-7c7f-473d-bb4b-7b6705959a15),segment_id=dc772362-7c7f-473d-bb4b-7b6705959a15)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:45.454693 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc', 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6', 'port_id': '5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc', 'mac_address': 'fa:16:3e:f0:c6:c6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 117, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '93335bf9-6f1e-4484-ae25-dca4b03b29b4', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:29:45.522849 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-75ba0004-69a7-409b-a61a-045e49799644 req-95afd872-b3da-4d1a-b115-0d06bdc34add tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Made reservation on behalf of a36a93590a9f45e1b9b3f78753bb8e12 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:29:45.524490 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-10cab16c-c86f-42ef-9142-f469294b983c req-1fb27d7f-b09e-4d7e-a0f3-128253cdcdcb tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.2180884 Dec 09 21:29:45.528438 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:45.530405 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-75ba0004-69a7-409b-a61a-045e49799644 req-95afd872-b3da-4d1a-b115-0d06bdc34add tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:45.557620 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:45.586890 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc,segment=NetworkSegment(dc772362-7c7f-473d-bb4b-7b6705959a15),segment_id=dc772362-7c7f-473d-bb4b-7b6705959a15)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:45.596839 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:45.638743 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e6b7834-9e5d-415f-8780-427a213f0723 req-2a77075d-459b-460b-b005-608c6235a666 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:45.647084 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e6b7834-9e5d-415f-8780-427a213f0723 req-2a77075d-459b-460b-b005-608c6235a666 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/ports?device_id=d0b23879-8919-4f30-9aa0-db8d2f85e707 HTTP/1.1" status: 200 len: 945 time: 0.1206644 Dec 09 21:29:45.728681 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a3aa9255-f193-412f-a8d9-e152cf4eb442 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'name': 'tempest-TaggedBootDevicesTest-1896005035-router', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127'}], 'enable_snat': True}, 'gw_port_id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:00Z', 'updated_at': '2021-12-09T21:27:06Z', 'revision_number': 4, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'gw_port': {'id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a1:90:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1069, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:01Z', 'updated_at': '2021-12-09T21:27:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '12695033-260e-4718-a36f-6ec3b27ba7c8', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'floating_ip_address': '172.25.3.134', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'port_id': '90180a85-620b-470e-b808-b635138111be', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 1150, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'f0373886-3db8-47eb-af65-78244497171e', 'mac_address': 'fa:16:3e:65:8d:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:28:10Z', 'updated_at': '2021-12-09T21:29:43Z', 'revision_number': 1, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '07784993-5ed4-492f-8151-3e60e91832c1', 'name': '', 'network_id': 'f0373886-3db8-47eb-af65-78244497171e', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'mac_address': 'fa:16:3e:31:30:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'device_owner': 'network:router_interface', 'standard_attr_id': 1073, 'fixed_ips': [{'subnet_id': '65df7637-0210-4526-a5dd-a692c26062b4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:05Z', 'updated_at': '2021-12-09T21:27:12Z', 'revision_number': 5, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'subnets': [{'id': '65df7637-0210-4526-a5dd-a692c26062b4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:45.741492 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e6b7834-9e5d-415f-8780-427a213f0723 req-1a501ee1-c7f1-428e-a034-39d0f32b298f tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/security-groups?id=09be3411-a85c-42e3-aaf7-829301eec3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0926473 Dec 09 21:29:45.761891 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:45.768212 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3aa9255-f193-412f-a8d9-e152cf4eb442 None None] Checking router: f2b3fc08-9e60-4600-9a8b-7400a9e940a0 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:29:45.778993 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3aa9255-f193-412f-a8d9-e152cf4eb442 None None] Routers {'f2b3fc08-9e60-4600-9a8b-7400a9e940a0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:29:45.780901 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a3aa9255-f193-412f-a8d9-e152cf4eb442 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:29:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f2b3fc08-9e60-4600-9a8b-7400a9e940a0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:45.801282 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e285ce08-84e6-4fc4-91fc-05f1377dafc2 req-e1072f0e-0bbb-4a39-bb83-7543d8f7de54 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 210 time: 0.0779505 Dec 09 21:29:45.829372 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-75ba0004-69a7-409b-a61a-045e49799644 req-95afd872-b3da-4d1a-b115-0d06bdc34add tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Allocated IP 172.20.0.10 (2c03082f-742a-4ae3-9d23-6178c7ff2a0a/d776263b-6b97-44cc-bef5-299b9262dfec/90f16e74-f2e6-416e-a079-f205615a0d8e) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:29:45.896083 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:29:45.934943 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1634f3aa-b86a-45d1-9f08-83aa59acdae6 req-aec950c6-32db-439d-aae9-1cee788d3589 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:45.942620 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1634f3aa-b86a-45d1-9f08-83aa59acdae6 req-aec950c6-32db-439d-aae9-1cee788d3589 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 944 time: 0.0766535 Dec 09 21:29:45.971966 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-a3aa9255-f193-412f-a8d9-e152cf4eb442 None None] Set router f2b3fc08-9e60-4600-9a8b-7400a9e940a0 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:29:45.995180 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1634f3aa-b86a-45d1-9f08-83aa59acdae6 req-6c7e6de2-9e93-4b35-9785-d0e54d5aae84 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/security-groups?id=02690a1b-c814-4a6b-a7d8-1252ee74106e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0516636 Dec 09 21:29:46.045728 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-75ba0004-69a7-409b-a61a-045e49799644 req-95afd872-b3da-4d1a-b115-0d06bdc34add tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:46.096799 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-75ba0004-69a7-409b-a61a-045e49799644 req-95afd872-b3da-4d1a-b115-0d06bdc34add tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:46.155780 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43086) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:46.167644 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-75ba0004-69a7-409b-a61a-045e49799644 req-95afd872-b3da-4d1a-b115-0d06bdc34add tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:29:46.174520 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-75ba0004-69a7-409b-a61a-045e49799644 req-95afd872-b3da-4d1a-b115-0d06bdc34add tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:29:46.178792 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-75ba0004-69a7-409b-a61a-045e49799644 req-95afd872-b3da-4d1a-b115-0d06bdc34add tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:29:46.231593 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-d8f13c83-592a-47b7-b4ef-4de75abed172 admin admin] Deleting subnet b3687d43-b504-4450-b43d-3e7de97d09da {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:29:46.235205 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8f13c83-592a-47b7-b4ef-4de75abed172 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:46.248044 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95afd872-b3da-4d1a-b115-0d06bdc34add tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Pushing event updated for resources: {'Port': ['ID=90f16e74-f2e6-416e-a079-f205615a0d8e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:46.292365 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75ba0004-69a7-409b-a61a-045e49799644 req-95afd872-b3da-4d1a-b115-0d06bdc34add tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:46.292963 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-75ba0004-69a7-409b-a61a-045e49799644 req-95afd872-b3da-4d1a-b115-0d06bdc34add tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:46.301128 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8f13c83-592a-47b7-b4ef-4de75abed172 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:46.319345 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-75ba0004-69a7-409b-a61a-045e49799644 req-95afd872-b3da-4d1a-b115-0d06bdc34add tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.1275463 Dec 09 21:29:46.337119 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-75ba0004-69a7-409b-a61a-045e49799644 req-b28c80d3-3a77-4e83-991e-f852d647239b service neutron] Request body: {'port': {'device_id': '7ef6883d-9c98-4e81-b102-bc1197ac4a47', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:46.358022 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a3aa9255-f193-412f-a8d9-e152cf4eb442 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'name': 'tempest-TaggedBootDevicesTest-1896005035-router', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127'}], 'enable_snat': True}, 'gw_port_id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:00Z', 'updated_at': '2021-12-09T21:27:06Z', 'revision_number': 4, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'gw_port': {'id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a1:90:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1069, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:01Z', 'updated_at': '2021-12-09T21:27:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '12695033-260e-4718-a36f-6ec3b27ba7c8', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'floating_ip_address': '172.25.3.134', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'port_id': '90180a85-620b-470e-b808-b635138111be', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 1150, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'f0373886-3db8-47eb-af65-78244497171e', 'mac_address': 'fa:16:3e:65:8d:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:28:10Z', 'updated_at': '2021-12-09T21:29:43Z', 'revision_number': 1, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '07784993-5ed4-492f-8151-3e60e91832c1', 'name': '', 'network_id': 'f0373886-3db8-47eb-af65-78244497171e', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'mac_address': 'fa:16:3e:31:30:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'device_owner': 'network:router_interface', 'standard_attr_id': 1073, 'fixed_ips': [{'subnet_id': '65df7637-0210-4526-a5dd-a692c26062b4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:05Z', 'updated_at': '2021-12-09T21:27:12Z', 'revision_number': 5, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'subnets': [{'id': '65df7637-0210-4526-a5dd-a692c26062b4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:46.384371 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8f13c83-592a-47b7-b4ef-4de75abed172 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:46.392544 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3aa9255-f193-412f-a8d9-e152cf4eb442 None None] The sync data for ids ['f2b3fc08-9e60-4600-9a8b-7400a9e940a0'] in n-d-713301-27 is: [{'id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'name': 'tempest-TaggedBootDevicesTest-1896005035-router', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127'}], 'enable_snat': True}, 'gw_port_id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:00Z', 'updated_at': '2021-12-09T21:27:06Z', 'revision_number': 4, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'gw_port': {'id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a1:90:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1069, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:01Z', 'updated_at': '2021-12-09T21:27:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '12695033-260e-4718-a36f-6ec3b27ba7c8', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'floating_ip_address': '172.25.3.134', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'port_id': '90180a85-620b-470e-b808-b635138111be', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 1150, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'f0373886-3db8-47eb-af65-78244497171e', 'mac_address': 'fa:16:3e:65:8d:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:28:10Z', 'updated_at': '2021-12-09T21:29:43Z', 'revision_number': 1, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '07784993-5ed4-492f-8151-3e60e91832c1', 'name': '', 'network_id': 'f0373886-3db8-47eb-af65-78244497171e', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'mac_address': 'fa:16:3e:31:30:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'device_owner': 'network:router_interface', 'standard_attr_id': 1073, 'fixed_ips': [{'subnet_id': '65df7637-0210-4526-a5dd-a692c26062b4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:05Z', 'updated_at': '2021-12-09T21:27:12Z', 'revision_number': 5, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'subnets': [{'id': '65df7637-0210-4526-a5dd-a692c26062b4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:29:46.409538 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-75ba0004-69a7-409b-a61a-045e49799644 req-b28c80d3-3a77-4e83-991e-f852d647239b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:46.484775 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8f13c83-592a-47b7-b4ef-4de75abed172 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:46.513980 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8f13c83-592a-47b7-b4ef-4de75abed172 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b3687d43-b504-4450-b43d-3e7de97d09da,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:46.525171 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8f13c83-592a-47b7-b4ef-4de75abed172 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:46.528114 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e8eefffb-ffd0-4338-a372-d57204aebe32 None None] Provisioning complete for port 90f16e74-f2e6-416e-a079-f205615a0d8e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:46.529665 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e8eefffb-ffd0-4338-a372-d57204aebe32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:46.531265 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d8f13c83-592a-47b7-b4ef-4de75abed172 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/b3687d43-b504-4450-b43d-3e7de97d09da HTTP/1.1" status: 204 len: 168 time: 0.3743949 Dec 09 21:29:46.532094 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43092) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:46.535121 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8f13c83-592a-47b7-b4ef-4de75abed172 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:46.535483 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8f13c83-592a-47b7-b4ef-4de75abed172 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:46.535827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8f13c83-592a-47b7-b4ef-4de75abed172 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:46.536165 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8f13c83-592a-47b7-b4ef-4de75abed172 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:46.536497 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8f13c83-592a-47b7-b4ef-4de75abed172 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:46.536824 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8f13c83-592a-47b7-b4ef-4de75abed172 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:46.537150 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8f13c83-592a-47b7-b4ef-4de75abed172 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:46.537718 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8f13c83-592a-47b7-b4ef-4de75abed172 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:46.538046 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8f13c83-592a-47b7-b4ef-4de75abed172 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:46.538371 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8f13c83-592a-47b7-b4ef-4de75abed172 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:46.538694 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8f13c83-592a-47b7-b4ef-4de75abed172 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:46.539017 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8f13c83-592a-47b7-b4ef-4de75abed172 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:46.539336 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8f13c83-592a-47b7-b4ef-4de75abed172 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:46.587859 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e8eefffb-ffd0-4338-a372-d57204aebe32 None None] Port 90f16e74-f2e6-416e-a079-f205615a0d8e cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:29:46.701535 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-470c350d-ac9d-4466-b7a8-91e5d1b151cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:46.756388 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4bc1344-b3a1-4de9-a180-0f2e1921f87d None None] New status for floating IP 12695033-260e-4718-a36f-6ec3b27ba7c8: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:29:46.788951 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-188543ab-729f-482e-bbde-e2a1c63750a6 req-6583fea0-7469-43a5-9c28-7349248fae5c tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:46.791577 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-188543ab-729f-482e-bbde-e2a1c63750a6 req-6583fea0-7469-43a5-9c28-7349248fae5c tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.31 "GET /v2.0/ports?device_id=d0b23879-8919-4f30-9aa0-db8d2f85e707 HTTP/1.1" status: 200 len: 945 time: 0.1615267 Dec 09 21:29:46.827273 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-75ba0004-69a7-409b-a61a-045e49799644 req-b28c80d3-3a77-4e83-991e-f852d647239b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 90f16e74-f2e6-416e-a079-f205615a0d8e {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:46.837681 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3c97548-5e4c-4ed1-b6c7-5ba35e02f2c6 req-fa9ed0c6-98e9-4f53-8240-ad0fdc575257 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:46.844241 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3c97548-5e4c-4ed1-b6c7-5ba35e02f2c6 req-fa9ed0c6-98e9-4f53-8240-ad0fdc575257 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:46.847593 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-75ba0004-69a7-409b-a61a-045e49799644 req-b28c80d3-3a77-4e83-991e-f852d647239b service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:46.852395 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3c97548-5e4c-4ed1-b6c7-5ba35e02f2c6 req-fa9ed0c6-98e9-4f53-8240-ad0fdc575257 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:46.863613 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'tag': '90180a85-620b-470e-b808-b635138111be'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:46.864495 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3c97548-5e4c-4ed1-b6c7-5ba35e02f2c6 req-fa9ed0c6-98e9-4f53-8240-ad0fdc575257 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:46.867155 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3a17a347-51d9-4ef5-a12b-2e7a9c2411ff" -d '{"events": [{"name": "network-changed", "server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "tag": "90180a85-620b-470e-b808-b635138111be"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:46.871777 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3c97548-5e4c-4ed1-b6c7-5ba35e02f2c6 req-fa9ed0c6-98e9-4f53-8240-ad0fdc575257 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:46.875484 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-75ba0004-69a7-409b-a61a-045e49799644 req-b28c80d3-3a77-4e83-991e-f852d647239b service neutron] Transition to ACTIVE for port object 90f16e74-f2e6-416e-a079-f205615a0d8e will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:29:46.879819 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3c97548-5e4c-4ed1-b6c7-5ba35e02f2c6 req-fa9ed0c6-98e9-4f53-8240-ad0fdc575257 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:46.883491 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-75ba0004-69a7-409b-a61a-045e49799644 req-b28c80d3-3a77-4e83-991e-f852d647239b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:46.886476 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3c97548-5e4c-4ed1-b6c7-5ba35e02f2c6 req-fa9ed0c6-98e9-4f53-8240-ad0fdc575257 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:46.891986 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a3c97548-5e4c-4ed1-b6c7-5ba35e02f2c6 req-fa9ed0c6-98e9-4f53-8240-ad0fdc575257 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5431 time: 0.2310836 Dec 09 21:29:46.944343 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b28c80d3-3a77-4e83-991e-f852d647239b service neutron] Pushing event updated for resources: {'Port': ['ID=90f16e74-f2e6-416e-a079-f205615a0d8e,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:47.039895 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-75ba0004-69a7-409b-a61a-045e49799644 req-b28c80d3-3a77-4e83-991e-f852d647239b service neutron] Attempting to bind port 90f16e74-f2e6-416e-a079-f205615a0d8e on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:29:47.040214 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-75ba0004-69a7-409b-a61a-045e49799644 req-b28c80d3-3a77-4e83-991e-f852d647239b service neutron] Attempting to bind port 90f16e74-f2e6-416e-a079-f205615a0d8e by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:29:47.040444 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-75ba0004-69a7-409b-a61a-045e49799644 req-b28c80d3-3a77-4e83-991e-f852d647239b service neutron] Attempting to bind port 90f16e74-f2e6-416e-a079-f205615a0d8e on network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:47.046158 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-75ba0004-69a7-409b-a61a-045e49799644 req-b28c80d3-3a77-4e83-991e-f852d647239b service neutron] Port 90f16e74-f2e6-416e-a079-f205615a0d8e on network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:29:47.046516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-75ba0004-69a7-409b-a61a-045e49799644 req-b28c80d3-3a77-4e83-991e-f852d647239b service neutron] Attempting to bind port 90f16e74-f2e6-416e-a079-f205615a0d8e on network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:47.066746 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-75ba0004-69a7-409b-a61a-045e49799644 req-b28c80d3-3a77-4e83-991e-f852d647239b service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 29, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:29:47.066891 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-75ba0004-69a7-409b-a61a-045e49799644 req-b28c80d3-3a77-4e83-991e-f852d647239b service neutron] Checking segment: {'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:29:47.067280 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-75ba0004-69a7-409b-a61a-045e49799644 req-b28c80d3-3a77-4e83-991e-f852d647239b service neutron] Bound using segment: {'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:29:47.067747 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-75ba0004-69a7-409b-a61a-045e49799644 req-b28c80d3-3a77-4e83-991e-f852d647239b service neutron] Bound port: 90f16e74-f2e6-416e-a079-f205615a0d8e, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:29:47.068110 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-75ba0004-69a7-409b-a61a-045e49799644 req-b28c80d3-3a77-4e83-991e-f852d647239b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:47.072180 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-470c350d-ac9d-4466-b7a8-91e5d1b151cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:47.147713 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a3c97548-5e4c-4ed1-b6c7-5ba35e02f2c6 req-5e1f10e5-e025-4680-9dbb-46e18c988d32 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.2210512 Dec 09 21:29:47.160175 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-75ba0004-69a7-409b-a61a-045e49799644 req-b28c80d3-3a77-4e83-991e-f852d647239b service neutron] For port 90f16e74-f2e6-416e-a079-f205615a0d8e, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:29:47.160175 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-75ba0004-69a7-409b-a61a-045e49799644 req-b28c80d3-3a77-4e83-991e-f852d647239b service neutron] For port 90f16e74-f2e6-416e-a079-f205615a0d8e, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=90f16e74-f2e6-416e-a079-f205615a0d8e,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:29:47.167112 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-75ba0004-69a7-409b-a61a-045e49799644 req-b28c80d3-3a77-4e83-991e-f852d647239b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:47.196041 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-470c350d-ac9d-4466-b7a8-91e5d1b151cf admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2700a60c-f75d-4026-8ff3-5e6bb9394ac1']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:47.202287 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:29:47.206675 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c0bca43-7e3e-4efd-bc1f-8b02bf115f31 req-1ec27279-ee53-4561-bc97-084063901d6c tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:47.213140 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75ba0004-69a7-409b-a61a-045e49799644 req-b28c80d3-3a77-4e83-991e-f852d647239b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:47.213830 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-75ba0004-69a7-409b-a61a-045e49799644 req-b28c80d3-3a77-4e83-991e-f852d647239b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:47.214572 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1c0bca43-7e3e-4efd-bc1f-8b02bf115f31 req-1ec27279-ee53-4561-bc97-084063901d6c tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/ports?device_id=d0b23879-8919-4f30-9aa0-db8d2f85e707 HTTP/1.1" status: 200 len: 945 time: 0.3215251 Dec 09 21:29:47.215842 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-75ba0004-69a7-409b-a61a-045e49799644 req-b28c80d3-3a77-4e83-991e-f852d647239b service neutron] 10.222.0.31 "PUT /v2.0/ports/90f16e74-f2e6-416e-a079-f205615a0d8e HTTP/1.1" status: 200 len: 1093 time: 0.8844121 Dec 09 21:29:47.242611 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b28c80d3-3a77-4e83-991e-f852d647239b service neutron] Pushing event updated for resources: {'Port': ['ID=90f16e74-f2e6-416e-a079-f205615a0d8e,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:47.254320 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-470c350d-ac9d-4466-b7a8-91e5d1b151cf admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '156677c4-8e58-420b-a3a1-7c1c07b52a7d') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:47.254908 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-470c350d-ac9d-4466-b7a8-91e5d1b151cf admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '156677c4-8e58-420b-a3a1-7c1c07b52a7d') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:47.286887 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-470c350d-ac9d-4466-b7a8-91e5d1b151cf admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:47.323558 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:29:47.328114 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:47.328605 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:47.351068 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-470c350d-ac9d-4466-b7a8-91e5d1b151cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:47.361877 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75ba0004-69a7-409b-a61a-045e49799644 req-c3aee96b-74f7-4bcd-8a5b-087b2933f7af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:47.369780 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-75ba0004-69a7-409b-a61a-045e49799644 req-c3aee96b-74f7-4bcd-8a5b-087b2933f7af service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 1096 time: 0.1000254 Dec 09 21:29:47.382197 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-470c350d-ac9d-4466-b7a8-91e5d1b151cf admin admin] Releasing vlan 111 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:29:47.382606 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-470c350d-ac9d-4466-b7a8-91e5d1b151cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:29:47.387505 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:29:47.425898 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1c0bca43-7e3e-4efd-bc1f-8b02bf115f31 req-8458965b-0ed7-4c4a-9dc1-48cec024f40e tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/security-groups?id=09be3411-a85c-42e3-aaf7-829301eec3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2103477 Dec 09 21:29:47.458747 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-75ba0004-69a7-409b-a61a-045e49799644 req-26e82d40-bb29-4273-b07c-89c53c25c725 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=90f16e74-f2e6-416e-a079-f205615a0d8e HTTP/1.1" status: 200 len: 217 time: 0.0796423 Dec 09 21:29:47.471278 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-188543ab-729f-482e-bbde-e2a1c63750a6 req-90cab4af-4da6-4c72-882d-a6e1cef52f8c tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Deleting port 38b263bd-10f0-49ea-bef8-a6caba0ce784 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:29:47.471862 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:47.476408 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-188543ab-729f-482e-bbde-e2a1c63750a6 req-90cab4af-4da6-4c72-882d-a6e1cef52f8c tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:47.503496 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '752d9ac2-7383-4bdb-b56f-3c52855d7fc9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:47.506222 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fd16fe20-4044-4090-bb86-b8db8e0304b4" -d '{"events": [{"server_uuid": "752d9ac2-7383-4bdb-b56f-3c52855d7fc9", "name": "network-vif-plugged", "status": "completed", "tag": "5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:47.523148 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc,segment=NetworkSegment(dc772362-7c7f-473d-bb4b-7b6705959a15),segment_id=dc772362-7c7f-473d-bb4b-7b6705959a15)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:47.530300 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f3b9297d-7973-4df6-8966-7c3acc42a912 x-openstack-request-id: req-f3b9297d-7973-4df6-8966-7c3acc42a912 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:47.530834 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "tag": "90180a85-620b-470e-b808-b635138111be", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:47.531367 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f3b9297d-7973-4df6-8966-7c3acc42a912 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:47.532253 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:47.532404 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'tag': '90180a85-620b-470e-b808-b635138111be', 'status': 'completed', 'code': 200} Dec 09 21:29:47.553151 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75ba0004-69a7-409b-a61a-045e49799644 req-f71ec7e1-8832-4878-ac52-06f264308805 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:47.555293 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-75ba0004-69a7-409b-a61a-045e49799644 req-f71ec7e1-8832-4878-ac52-06f264308805 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 200 len: 851 time: 0.0884254 Dec 09 21:29:47.624946 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75ba0004-69a7-409b-a61a-045e49799644 req-215a51b4-e6d7-4e94-bedb-98e9615a570b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:47.626933 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-75ba0004-69a7-409b-a61a-045e49799644 req-215a51b4-e6d7-4e94-bedb-98e9615a570b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0652480 Dec 09 21:29:47.631401 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:47.666951 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2182cf92-f01d-451c-871f-2edec0a26f43 req-d00e255e-bea8-4f2d-8a1a-c24f47b1d1e4 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:47.668519 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2182cf92-f01d-451c-871f-2edec0a26f43 req-d00e255e-bea8-4f2d-8a1a-c24f47b1d1e4 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 944 time: 0.3781619 Dec 09 21:29:47.730167 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-470c350d-ac9d-4466-b7a8-91e5d1b151cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:47.742700 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-75ba0004-69a7-409b-a61a-045e49799644 req-0cae5a6e-9ff4-489e-bcf5-71e7227569bb service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1078610 Dec 09 21:29:47.760184 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-470c350d-ac9d-4466-b7a8-91e5d1b151cf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:47.764935 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-470c350d-ac9d-4466-b7a8-91e5d1b151cf admin admin] 10.222.0.13 "DELETE /v2.0/networks/2700a60c-f75d-4026-8ff3-5e6bb9394ac1 HTTP/1.1" status: 204 len: 168 time: 1.2315640 Dec 09 21:29:47.828780 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-470c350d-ac9d-4466-b7a8-91e5d1b151cf admin admin] Pushing event deleted for resources: {'Network': ['ID=2700a60c-f75d-4026-8ff3-5e6bb9394ac1,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:47.863155 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-188543ab-729f-482e-bbde-e2a1c63750a6 req-90cab4af-4da6-4c72-882d-a6e1cef52f8c tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] For port 38b263bd-10f0-49ea-bef8-a6caba0ce784, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=38b263bd-10f0-49ea-bef8-a6caba0ce784,segment=NetworkSegment(4944fe1d-3354-4e33-b6be-75c5cb26e73d),segment_id=4944fe1d-3354-4e33-b6be-75c5cb26e73d)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:47.863746 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-188543ab-729f-482e-bbde-e2a1c63750a6 req-90cab4af-4da6-4c72-882d-a6e1cef52f8c tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:47.864026 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 61aa5263-8686-42ca-a69d-76fd6420ede8 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:29:47.870459 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-75ba0004-69a7-409b-a61a-045e49799644 req-f868850a-3129-49e6-9e4b-c6ced285d560 service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1212261 Dec 09 21:29:47.878892 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a17a347-51d9-4ef5-a12b-2e7a9c2411ff req-a3164c4a-3dfe-44ab-a4ea-4c618de8e673 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:47.879429 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a17a347-51d9-4ef5-a12b-2e7a9c2411ff req-a3164c4a-3dfe-44ab-a4ea-4c618de8e673 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:47.879978 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a17a347-51d9-4ef5-a12b-2e7a9c2411ff req-a3164c4a-3dfe-44ab-a4ea-4c618de8e673 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:47.880676 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a17a347-51d9-4ef5-a12b-2e7a9c2411ff req-a3164c4a-3dfe-44ab-a4ea-4c618de8e673 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:47.881554 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a17a347-51d9-4ef5-a12b-2e7a9c2411ff req-a3164c4a-3dfe-44ab-a4ea-4c618de8e673 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:47.882083 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a17a347-51d9-4ef5-a12b-2e7a9c2411ff req-a3164c4a-3dfe-44ab-a4ea-4c618de8e673 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:47.882603 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a17a347-51d9-4ef5-a12b-2e7a9c2411ff req-a3164c4a-3dfe-44ab-a4ea-4c618de8e673 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:47.884861 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a17a347-51d9-4ef5-a12b-2e7a9c2411ff req-a3164c4a-3dfe-44ab-a4ea-4c618de8e673 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=03e962eb7f5e4325a7c08c8b1e2a4cea&device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 6498 time: 0.3049469 Dec 09 21:29:47.907329 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 61aa5263-8686-42ca-a69d-76fd6420ede8 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:29:47.907705 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 61aa5263-8686-42ca-a69d-76fd6420ede8 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:29:47.917272 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e46275c-0e8e-4091-8849-5946a51559c0 req-2fc1d03d-542e-47b7-9e35-82e568938538 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:47.919119 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e46275c-0e8e-4091-8849-5946a51559c0 req-2fc1d03d-542e-47b7-9e35-82e568938538 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 945 time: 0.2779109 Dec 09 21:29:47.941902 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-188543ab-729f-482e-bbde-e2a1c63750a6 req-90cab4af-4da6-4c72-882d-a6e1cef52f8c tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Calling delete_port for 38b263bd-10f0-49ea-bef8-a6caba0ce784 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:29:47.962984 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2182cf92-f01d-451c-871f-2edec0a26f43 req-88501886-3cbb-4af4-b408-0f064f73c49a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2521992 Dec 09 21:29:48.067423 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43116) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:48.118790 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-512e26a1-db87-43e0-9870-09b46dd02b5b admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e9159c237df04f09a82d1c2eee1f573e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0495107 Dec 09 21:29:48.121076 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43118) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:48.176950 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e46275c-0e8e-4091-8849-5946a51559c0 req-9abef9e0-84db-4a6b-9b5c-427e4d8f22b2 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/security-groups?id=02690a1b-c814-4a6b-a7d8-1252ee74106e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2367928 Dec 09 21:29:48.178492 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a17a347-51d9-4ef5-a12b-2e7a9c2411ff req-c7dabdd4-561d-4ede-b5aa-3244dcf2cf38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:48.181178 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a17a347-51d9-4ef5-a12b-2e7a9c2411ff req-c7dabdd4-561d-4ede-b5aa-3244dcf2cf38 service neutron] 10.222.0.10 "GET /v2.0/networks?id=f0373886-3db8-47eb-af65-78244497171e HTTP/1.1" status: 200 len: 913 time: 0.2849865 Dec 09 21:29:48.183976 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b9aa5ca9-696c-427c-9ec1-94289112f052 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:48.221019 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b9aa5ca9-696c-427c-9ec1-94289112f052 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:48.239598 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b5fe9a53-c349-47b8-8d43-21510d6d1b2c x-openstack-request-id: req-b5fe9a53-c349-47b8-8d43-21510d6d1b2c {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:48.240102 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "752d9ac2-7383-4bdb-b56f-3c52855d7fc9", "name": "network-vif-plugged", "status": "completed", "tag": "5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:48.240207 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-b5fe9a53-c349-47b8-8d43-21510d6d1b2c {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:48.240527 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '752d9ac2-7383-4bdb-b56f-3c52855d7fc9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc', 'code': 200} Dec 09 21:29:48.309464 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b9aa5ca9-696c-427c-9ec1-94289112f052 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:48.316332 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b9aa5ca9-696c-427c-9ec1-94289112f052 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:48.320106 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b9aa5ca9-696c-427c-9ec1-94289112f052 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/872108a7-5ae2-4b16-8e57-f5d879884a6d HTTP/1.1" status: 204 len: 168 time: 0.1956778 Dec 09 21:29:48.327786 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9aa5ca9-696c-427c-9ec1-94289112f052 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=872108a7-5ae2-4b16-8e57-f5d879884a6d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:48.340888 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a17a347-51d9-4ef5-a12b-2e7a9c2411ff req-8d6de180-0e7f-40bd-b89b-75975dbb645b service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=90180a85-620b-470e-b808-b635138111be HTTP/1.1" status: 200 len: 1002 time: 0.1474042 Dec 09 21:29:48.385743 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe4185d0-90f9-41fb-a597-714a6d93088e req-f2b3dcce-4aa6-43d5-b271-f39d8b8d61c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:48.387824 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fe4185d0-90f9-41fb-a597-714a6d93088e req-f2b3dcce-4aa6-43d5-b271-f39d8b8d61c3 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 1097 time: 0.0614779 Dec 09 21:29:48.415630 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09a14afc-6993-417b-9394-e0c618309783 req-e37de350-a264-41da-89b9-9602a86f8459 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:48.421870 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09a14afc-6993-417b-9394-e0c618309783 req-e37de350-a264-41da-89b9-9602a86f8459 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:48.427802 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09a14afc-6993-417b-9394-e0c618309783 req-e37de350-a264-41da-89b9-9602a86f8459 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:48.433704 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09a14afc-6993-417b-9394-e0c618309783 req-e37de350-a264-41da-89b9-9602a86f8459 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:48.439973 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09a14afc-6993-417b-9394-e0c618309783 req-e37de350-a264-41da-89b9-9602a86f8459 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:48.440989 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fe4185d0-90f9-41fb-a597-714a6d93088e req-f54e726c-afa0-455f-b563-5f810c5e5e86 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=02690a1b-c814-4a6b-a7d8-1252ee74106e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459633 Dec 09 21:29:48.445882 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09a14afc-6993-417b-9394-e0c618309783 req-e37de350-a264-41da-89b9-9602a86f8459 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:48.452305 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09a14afc-6993-417b-9394-e0c618309783 req-e37de350-a264-41da-89b9-9602a86f8459 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:48.454313 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09a14afc-6993-417b-9394-e0c618309783 req-e37de350-a264-41da-89b9-9602a86f8459 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5431 time: 0.1653948 Dec 09 21:29:48.459099 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-188543ab-729f-482e-bbde-e2a1c63750a6 req-90cab4af-4da6-4c72-882d-a6e1cef52f8c tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:48.474936 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['723351f2-7c62-4bb5-aaad-288a6e26545f'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:29:48.477233 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['38b263bd-10f0-49ea-bef8-a6caba0ce784', '675f510c-c35a-468e-b70b-4abb34188642'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:29:48.517821 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90cab4af-4da6-4c72-882d-a6e1cef52f8c tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Pushing event deleted for resources: {'Port': ['ID=38b263bd-10f0-49ea-bef8-a6caba0ce784,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:48.523150 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a17a347-51d9-4ef5-a12b-2e7a9c2411ff req-6fc8682f-9ec2-40cb-91b1-2cc436ffa5e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:48.524674 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a17a347-51d9-4ef5-a12b-2e7a9c2411ff req-6fc8682f-9ec2-40cb-91b1-2cc436ffa5e1 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=65df7637-0210-4526-a5dd-a692c26062b4 HTTP/1.1" status: 200 len: 851 time: 0.1740208 Dec 09 21:29:48.552815 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-646e7d22-5258-4b56-92d1-a04030c2df74 req-f843410c-20e8-488a-adf9-a343c06e15e9 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/ports?device_id=d0b23879-8919-4f30-9aa0-db8d2f85e707 HTTP/1.1" status: 200 len: 210 time: 0.0399089 Dec 09 21:29:48.615222 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-188543ab-729f-482e-bbde-e2a1c63750a6 req-90cab4af-4da6-4c72-882d-a6e1cef52f8c tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] No DVR routers for this DVR port 38b263bd-10f0-49ea-bef8-a6caba0ce784 on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:29:48.625655 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-188543ab-729f-482e-bbde-e2a1c63750a6 req-90cab4af-4da6-4c72-882d-a6e1cef52f8c tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:48.634286 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-188543ab-729f-482e-bbde-e2a1c63750a6 req-90cab4af-4da6-4c72-882d-a6e1cef52f8c tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.31 "DELETE /v2.0/ports/38b263bd-10f0-49ea-bef8-a6caba0ce784 HTTP/1.1" status: 204 len: 173 time: 1.7141407 Dec 09 21:29:48.634286 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd0b23879-8919-4f30-9aa0-db8d2f85e707', 'name': 'network-vif-deleted', 'tag': '38b263bd-10f0-49ea-bef8-a6caba0ce784'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:48.634286 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-675e44c0-7420-4ccb-ab7a-7672f831637b" -d '{"events": [{"server_uuid": "d0b23879-8919-4f30-9aa0-db8d2f85e707", "name": "network-vif-deleted", "tag": "38b263bd-10f0-49ea-bef8-a6caba0ce784"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:48.642694 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09a14afc-6993-417b-9394-e0c618309783 req-2c84118f-4a8e-4e00-9e7a-6563a1c06d83 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1734004 Dec 09 21:29:48.710712 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-765bcf99-770c-4c54-9a0e-75f237fb2628 x-openstack-request-id: req-765bcf99-770c-4c54-9a0e-75f237fb2628 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:48.710876 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d0b23879-8919-4f30-9aa0-db8d2f85e707", "name": "network-vif-deleted", "tag": "38b263bd-10f0-49ea-bef8-a6caba0ce784", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:48.711487 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-765bcf99-770c-4c54-9a0e-75f237fb2628 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:48.711905 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd0b23879-8919-4f30-9aa0-db8d2f85e707', 'name': 'network-vif-deleted', 'tag': '38b263bd-10f0-49ea-bef8-a6caba0ce784', 'status': 'completed', 'code': 200} Dec 09 21:29:48.731565 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a17a347-51d9-4ef5-a12b-2e7a9c2411ff req-a64f2bcb-48e6-403b-b0c6-270203d0a3ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:48.733645 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a17a347-51d9-4ef5-a12b-2e7a9c2411ff req-a64f2bcb-48e6-403b-b0c6-270203d0a3ca service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=f0373886-3db8-47eb-af65-78244497171e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0730338 Dec 09 21:29:48.862917 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a17a347-51d9-4ef5-a12b-2e7a9c2411ff req-53f6a49a-a7c2-4f48-9c6e-ae960e4abf3e service neutron] 10.222.0.10 "GET /v2.0/networks/f0373886-3db8-47eb-af65-78244497171e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1187842 Dec 09 21:29:48.987170 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a17a347-51d9-4ef5-a12b-2e7a9c2411ff req-6cb82e32-5acb-4ce7-935a-1db3feba15ff service neutron] 10.222.0.10 "GET /v2.0/networks/f0373886-3db8-47eb-af65-78244497171e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0908055 Dec 09 21:29:49.096652 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e88255d5-60eb-4b8e-a557-19f92541789c req-4cd1fdf8-ad57-490b-96bd-8c033e4433d6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:49.103981 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e88255d5-60eb-4b8e-a557-19f92541789c req-4cd1fdf8-ad57-490b-96bd-8c033e4433d6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 944 time: 0.0686507 Dec 09 21:29:49.159764 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e88255d5-60eb-4b8e-a557-19f92541789c req-11666545-8c40-49ed-8551-ce4b76dcdb3d tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0508230 Dec 09 21:29:49.165942 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43158) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:49.308605 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-8e6ba7b1-a163-44c6-a3a9-dc38722983a8 admin admin] Request body: {'network': {'name': 'tempest-ServerAddressesNegativeTestJSON-1571898811-network', 'tenant_id': '396a9c42822e4e8d8a7907c4ec96ed68'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:49.340654 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8e6ba7b1-a163-44c6-a3a9-dc38722983a8 admin admin] Made reservation on behalf of 396a9c42822e4e8d8a7907c4ec96ed68 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:29:49.343612 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e6ba7b1-a163-44c6-a3a9-dc38722983a8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:49.356481 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e6ba7b1-a163-44c6-a3a9-dc38722983a8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:49.444470 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e6ba7b1-a163-44c6-a3a9-dc38722983a8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:49.453751 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e6ba7b1-a163-44c6-a3a9-dc38722983a8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:49.481830 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8e6ba7b1-a163-44c6-a3a9-dc38722983a8 admin admin] vlan segment allocate from pool success with {'vlan_id': 142, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:29:49.499364 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e6ba7b1-a163-44c6-a3a9-dc38722983a8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d1f3d7b6-7fd9-4f73-b3cf-8eb30963c2a7,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:49.502597 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e6ba7b1-a163-44c6-a3a9-dc38722983a8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:49.502954 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-8e6ba7b1-a163-44c6-a3a9-dc38722983a8 admin admin] Added segment a2c20e6d-42c4-4a87-8c3e-1d0138b5958f of type vlan for network cbb87bc0-e3d4-44f3-aba2-8f506f7616a0 Dec 09 21:29:49.532960 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7ef6883d-9c98-4e81-b102-bc1197ac4a47', 'tag': '90f16e74-f2e6-416e-a079-f205615a0d8e'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:49.535552 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-72646988-463e-4647-80da-bc508f3f2b60" -d '{"events": [{"name": "network-changed", "server_uuid": "7ef6883d-9c98-4e81-b102-bc1197ac4a47", "tag": "90f16e74-f2e6-416e-a079-f205615a0d8e"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:49.577072 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e6ba7b1-a163-44c6-a3a9-dc38722983a8 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:49.600907 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4d0d84ea-a2c5-4b93-82ff-28e433277b7c x-openstack-request-id: req-4d0d84ea-a2c5-4b93-82ff-28e433277b7c {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:49.601245 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7ef6883d-9c98-4e81-b102-bc1197ac4a47", "tag": "90f16e74-f2e6-416e-a079-f205615a0d8e", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:49.601555 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-4d0d84ea-a2c5-4b93-82ff-28e433277b7c {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:49.601963 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7ef6883d-9c98-4e81-b102-bc1197ac4a47', 'tag': '90f16e74-f2e6-416e-a079-f205615a0d8e', 'status': 'completed', 'code': 200} Dec 09 21:29:49.618188 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e6ba7b1-a163-44c6-a3a9-dc38722983a8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:49.619205 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e6ba7b1-a163-44c6-a3a9-dc38722983a8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:49.619855 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e6ba7b1-a163-44c6-a3a9-dc38722983a8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:49.667457 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8e6ba7b1-a163-44c6-a3a9-dc38722983a8 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 895 time: 0.4989889 Dec 09 21:29:49.692690 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43174) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:49.698150 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] Request body: {'subnet': {'network_id': 'cbb87bc0-e3d4-44f3-aba2-8f506f7616a0', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerAddressesNegativeTestJSON-1571898811-subnet', 'tenant_id': '396a9c42822e4e8d8a7907c4ec96ed68', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:49.708932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e6ba7b1-a163-44c6-a3a9-dc38722983a8 admin admin] Pushing event updated for resources: {'Network': ['ID=cbb87bc0-e3d4-44f3-aba2-8f506f7616a0,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:49.721814 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network cbb87bc0-e3d4-44f3-aba2-8f506f7616a0 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:29:49.754664 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] Made reservation on behalf of 396a9c42822e4e8d8a7907c4ec96ed68 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:29:49.758511 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:49.869139 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cd5d26d-5982-4b63-99e7-ebd4116344da req-1eca1245-c894-4ed3-a1e5-43efd33f2623 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:49.871921 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6cd5d26d-5982-4b63-99e7-ebd4116344da req-1eca1245-c894-4ed3-a1e5-43efd33f2623 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 945 time: 0.5166199 Dec 09 21:29:49.883360 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72646988-463e-4647-80da-bc508f3f2b60 req-d8b0aca5-bb01-4b06-bc45-1664ba3f88c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:49.884990 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72646988-463e-4647-80da-bc508f3f2b60 req-d8b0aca5-bb01-4b06-bc45-1664ba3f88c5 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 1096 time: 0.1095140 Dec 09 21:29:49.942296 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ba31dcd-9034-4c3e-8f96-ed897b10e511 req-b8d25e05-6a3e-4899-8530-fd7c83b2fcb2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:49.948930 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ba31dcd-9034-4c3e-8f96-ed897b10e511 req-b8d25e05-6a3e-4899-8530-fd7c83b2fcb2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:49.955027 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ba31dcd-9034-4c3e-8f96-ed897b10e511 req-b8d25e05-6a3e-4899-8530-fd7c83b2fcb2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:49.961035 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ba31dcd-9034-4c3e-8f96-ed897b10e511 req-b8d25e05-6a3e-4899-8530-fd7c83b2fcb2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:49.967334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ba31dcd-9034-4c3e-8f96-ed897b10e511 req-b8d25e05-6a3e-4899-8530-fd7c83b2fcb2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:49.974569 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ba31dcd-9034-4c3e-8f96-ed897b10e511 req-b8d25e05-6a3e-4899-8530-fd7c83b2fcb2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:49.980545 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ba31dcd-9034-4c3e-8f96-ed897b10e511 req-b8d25e05-6a3e-4899-8530-fd7c83b2fcb2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:49.982703 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ba31dcd-9034-4c3e-8f96-ed897b10e511 req-b8d25e05-6a3e-4899-8530-fd7c83b2fcb2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5431 time: 0.1713929 Dec 09 21:29:49.990478 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:50.067178 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6cd5d26d-5982-4b63-99e7-ebd4116344da req-6250c94a-b546-4c45-bac3-46c92a135e42 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/security-groups?id=02690a1b-c814-4a6b-a7d8-1252ee74106e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1863160 Dec 09 21:29:50.114942 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72646988-463e-4647-80da-bc508f3f2b60 req-0a771f8a-c850-4064-a9f1-8b516eb0e2bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:50.116503 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72646988-463e-4647-80da-bc508f3f2b60 req-0a771f8a-c850-4064-a9f1-8b516eb0e2bb service neutron] 10.222.0.31 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 913 time: 0.2209830 Dec 09 21:29:50.126561 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ba31dcd-9034-4c3e-8f96-ed897b10e511 req-dceed407-a259-47f5-8a77-22f553de4283 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1336894 Dec 09 21:29:50.165006 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72646988-463e-4647-80da-bc508f3f2b60 req-e00a8939-0c93-44b4-931c-ed9b7f888334 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=90f16e74-f2e6-416e-a079-f205615a0d8e HTTP/1.1" status: 200 len: 217 time: 0.0374050 Dec 09 21:29:50.225998 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72646988-463e-4647-80da-bc508f3f2b60 req-c783ea4d-d475-479c-b5b6-750e50439a40 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:50.227684 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72646988-463e-4647-80da-bc508f3f2b60 req-c783ea4d-d475-479c-b5b6-750e50439a40 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 200 len: 851 time: 0.0552361 Dec 09 21:29:50.318480 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72646988-463e-4647-80da-bc508f3f2b60 req-0c4a37a5-1db9-4638-8cfc-939324f965d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:50.320722 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72646988-463e-4647-80da-bc508f3f2b60 req-0c4a37a5-1db9-4638-8cfc-939324f965d8 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0846381 Dec 09 21:29:50.388280 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1553d9d-0360-4b3f-a3c4-c23d4eb0871c req-64dfe100-87cf-4aae-9e25-586529d06de3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:50.396785 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a1553d9d-0360-4b3f-a3c4-c23d4eb0871c req-64dfe100-87cf-4aae-9e25-586529d06de3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 944 time: 0.1184137 Dec 09 21:29:50.430143 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] Pushing event updated for resources: {'Subnet': ['ID=d23b9496-b001-4ab9-9cdc-44b02b1be59a,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:50.442887 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:50.443243 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:50.443616 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:50.443961 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:50.444796 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:50.445348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:50.445583 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:50.445803 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:50.446138 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:50.446468 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:50.446812 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:50.447141 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:50.448002 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:29:50.474160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] Checking segment: {'id': 'a2c20e6d-42c4-4a87-8c3e-1d0138b5958f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'cbb87bc0-e3d4-44f3-aba2-8f506f7616a0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:29:50.475472 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] Network hostable DHCP agents. Network: cbb87bc0-e3d4-44f3-aba2-8f506f7616a0, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:29:50.490867 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a1553d9d-0360-4b3f-a3c4-c23d4eb0871c req-b0bf601f-8932-4fa9-932f-2ca0449065c8 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0929334 Dec 09 21:29:50.500857 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] Network cbb87bc0-e3d4-44f3-aba2-8f506f7616a0 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:29:50.515430 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, cbb87bc0-e3d4-44f3-aba2-8f506f7616a0) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:29:50.529020 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-392dc02c-3ff5-405c-b485-6bc7326ee47b None None] Network cbb87bc0-e3d4-44f3-aba2-8f506f7616a0 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:29:50.533889 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:50.535560 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:50.549382 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72646988-463e-4647-80da-bc508f3f2b60 req-b0e1e047-1c5b-4086-a9a6-26b138b83f14 service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2192519 Dec 09 21:29:50.560297 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c4ec6045-4e86-479d-a511-565f7ab86f5a admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 859 time: 0.8663101 Dec 09 21:29:50.701837 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72646988-463e-4647-80da-bc508f3f2b60 req-77a281b4-79f8-4f69-a244-d07f6a98981e service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1452026 Dec 09 21:29:50.721574 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b01512cf-a875-44bd-9ba0-b0be87e0a669 None None] Network cbb87bc0-e3d4-44f3-aba2-8f506f7616a0 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:29:51.074086 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-de0f9f55-65cd-43d1-a824-a1deba291ef6 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:51.075643 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-de0f9f55-65cd-43d1-a824-a1deba291ef6 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/networks?id=cbb87bc0-e3d4-44f3-aba2-8f506f7616a0 HTTP/1.1" status: 200 len: 822 time: 0.1399972 Dec 09 21:29:51.097199 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-331a1e05-73f1-4f5e-bc99-6a645d2cd008 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/quotas/396a9c42822e4e8d8a7907c4ec96ed68 HTTP/1.1" status: 200 len: 375 time: 0.0147455 Dec 09 21:29:51.105490 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fd09296-fbff-403a-bb3c-f19efbcd6773 req-07154f1f-89b8-4894-aa05-28f6cf4cad11 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:51.111471 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fd09296-fbff-403a-bb3c-f19efbcd6773 req-07154f1f-89b8-4894-aa05-28f6cf4cad11 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:51.113044 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3fd09296-fbff-403a-bb3c-f19efbcd6773 req-07154f1f-89b8-4894-aa05-28f6cf4cad11 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/ports?device_id=31a27c6f-f2ac-4eff-9039-700b918036ef&device_id=ba78dacb-cf50-4182-b474-958412e2b568 HTTP/1.1" status: 200 len: 1682 time: 0.0801284 Dec 09 21:29:51.145302 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-a53240c9-6de4-47d0-a82c-90b681521cb6 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=396a9c42822e4e8d8a7907c4ec96ed68&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0311787 Dec 09 21:29:51.233189 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3fd09296-fbff-403a-bb3c-f19efbcd6773 req-3f3715da-f931-473e-bc12-01ba3893d6d4 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/security-groups?id=09be3411-a85c-42e3-aaf7-829301eec3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1107411 Dec 09 21:29:51.271071 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-0e492c96-e5fe-43d3-9f64-1f0a5162b1ad service neutron] 10.222.0.13 "GET /v2.0/networks/cbb87bc0-e3d4-44f3-aba2-8f506f7616a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1153672 Dec 09 21:29:51.393500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64cb5ea8-4c6e-4caf-a1df-5f75071959c7 req-1d7a3b70-458e-4c47-a98e-5bb164ce70ed tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:51.395120 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-64cb5ea8-4c6e-4caf-a1df-5f75071959c7 req-1d7a3b70-458e-4c47-a98e-5bb164ce70ed tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 945 time: 0.1084430 Dec 09 21:29:51.414900 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-ad805300-b504-4349-97d6-2a0d41d6bc4f service neutron] 10.222.0.13 "GET /v2.0/networks/cbb87bc0-e3d4-44f3-aba2-8f506f7616a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1358902 Dec 09 21:29:51.455538 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-64cb5ea8-4c6e-4caf-a1df-5f75071959c7 req-b97a5650-7715-41f1-9ea8-45aabc9d6d7b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/security-groups?id=02690a1b-c814-4a6b-a7d8-1252ee74106e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0535765 Dec 09 21:29:51.604095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0c6fcce-472d-4545-9e77-3a5c8d459f91 req-549c1225-27ab-4f63-bb2d-12c897e71c45 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:51.612054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0c6fcce-472d-4545-9e77-3a5c8d459f91 req-549c1225-27ab-4f63-bb2d-12c897e71c45 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:51.619577 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0c6fcce-472d-4545-9e77-3a5c8d459f91 req-549c1225-27ab-4f63-bb2d-12c897e71c45 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:51.629834 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0c6fcce-472d-4545-9e77-3a5c8d459f91 req-549c1225-27ab-4f63-bb2d-12c897e71c45 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:51.637150 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0c6fcce-472d-4545-9e77-3a5c8d459f91 req-549c1225-27ab-4f63-bb2d-12c897e71c45 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:51.643997 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0c6fcce-472d-4545-9e77-3a5c8d459f91 req-549c1225-27ab-4f63-bb2d-12c897e71c45 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:51.650895 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0c6fcce-472d-4545-9e77-3a5c8d459f91 req-549c1225-27ab-4f63-bb2d-12c897e71c45 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:51.653136 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f0c6fcce-472d-4545-9e77-3a5c8d459f91 req-549c1225-27ab-4f63-bb2d-12c897e71c45 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5431 time: 0.1201427 Dec 09 21:29:51.756192 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f0c6fcce-472d-4545-9e77-3a5c8d459f91 req-0917986e-ca89-48c2-ac32-7fefb922d363 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0959256 Dec 09 21:29:51.794474 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3579684-863d-4ac3-b3d2-9c69bc519f18 req-286096d0-991c-43c4-a713-14952e7e2c61 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:51.794474 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3579684-863d-4ac3-b3d2-9c69bc519f18 req-286096d0-991c-43c4-a713-14952e7e2c61 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 945 time: 0.0902407 Dec 09 21:29:51.799527 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43250) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:51.810369 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-edba5f6c-b435-4569-aced-88baceb96e06 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Request body: {'floatingip': {'port_id': '5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:51.860705 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-edba5f6c-b435-4569-aced-88baceb96e06 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks [] for floatingip, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:51.878151 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 90f16e74-f2e6-416e-a079-f205615a0d8e details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:29:51.882878 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 38b263bd-10f0-49ea-bef8-a6caba0ce784 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:29:51.955233 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d216274-bd4a-4ed3-893c-dcd8f31b5586 req-0e2fcf99-4f6f-4906-9c4b-3fafbaf3a32c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:51.963985 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 38b263bd-10f0-49ea-bef8-a6caba0ce784 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:29:51.965098 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 38b263bd-10f0-49ea-bef8-a6caba0ce784 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:29:51.970646 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d216274-bd4a-4ed3-893c-dcd8f31b5586 req-0e2fcf99-4f6f-4906-9c4b-3fafbaf3a32c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 944 time: 0.0802360 Dec 09 21:29:52.056224 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c1babbb-150d-4f5c-a731-e06b6e1b5d5c req-d62a0681-5394-4764-a5a3-9e64b113f75d tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/ports?device_id=fec8d114-7ce3-465f-a037-5b16fce83357 HTTP/1.1" status: 200 len: 210 time: 0.0821323 Dec 09 21:29:52.139867 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d216274-bd4a-4ed3-893c-dcd8f31b5586 req-99096c62-c4bd-4241-bdce-4624f261ec06 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1598768 Dec 09 21:29:52.168810 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 90f16e74-f2e6-416e-a079-f205615a0d8e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=90f16e74-f2e6-416e-a079-f205615a0d8e,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:52.184443 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '90f16e74-f2e6-416e-a079-f205615a0d8e', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'port_id': '90f16e74-f2e6-416e-a079-f205615a0d8e', 'mac_address': 'fa:16:3e:69:c9:b5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:29:52.261924 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:52.280255 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 90f16e74-f2e6-416e-a079-f205615a0d8e {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:52.308692 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 90f16e74-f2e6-416e-a079-f205615a0d8e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=90f16e74-f2e6-416e-a079-f205615a0d8e,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:52.317351 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:52.381576 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=90f16e74-f2e6-416e-a079-f205615a0d8e,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:52.541155 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['90f16e74-f2e6-416e-a079-f205615a0d8e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:29:52.564635 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-edba5f6c-b435-4569-aced-88baceb96e06 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:52.571307 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-edba5f6c-b435-4569-aced-88baceb96e06 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:52.716596 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43276) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:52.785608 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-edba5f6c-b435-4569-aced-88baceb96e06 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Floating IP c8a74273-d4f2-4daa-b03c-d5fe21026216 associated. External IP: 172.25.3.35, port: 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc. Dec 09 21:29:53.115429 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2c8fc140-1e44-44ba-9317-4b8438e69e1b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:53.130670 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-edba5f6c-b435-4569-aced-88baceb96e06 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Router eeac8998-5e81-4874-bc7a-2829c8a216f7 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:29:53.137229 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-ca3e99ac-fa43-40ef-babf-c451e35111ff tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:53.138792 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-ca3e99ac-fa43-40ef-babf-c451e35111ff tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.31 "GET /v2.0/networks?id=cbb87bc0-e3d4-44f3-aba2-8f506f7616a0 HTTP/1.1" status: 200 len: 822 time: 0.1870897 Dec 09 21:29:53.161457 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-714665aa-bc24-440b-8ffb-44eb8690d44a req-b34fbf8f-7813-4ff7-9915-f44a32ecb12d tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:53.163321 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-714665aa-bc24-440b-8ffb-44eb8690d44a req-b34fbf8f-7813-4ff7-9915-f44a32ecb12d tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/ports?device_id=ba78dacb-cf50-4182-b474-958412e2b568 HTTP/1.1" status: 200 len: 946 time: 0.2631433 Dec 09 21:29:53.167001 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-9035108e-e617-4915-bcf2-cbef7038af08 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Request body: {'port': {'device_id': 'fec8d114-7ce3-465f-a037-5b16fce83357', 'network_id': 'cbb87bc0-e3d4-44f3-aba2-8f506f7616a0', 'admin_state_up': True, 'tenant_id': '396a9c42822e4e8d8a7907c4ec96ed68'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:53.208369 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60c18757-a6b6-41c1-b641-c538a93ad892 req-2965e9e9-7c7c-4e4c-9b30-b6df42b0c0f7 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:53.214397 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60c18757-a6b6-41c1-b641-c538a93ad892 req-2965e9e9-7c7c-4e4c-9b30-b6df42b0c0f7 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:53.221411 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60c18757-a6b6-41c1-b641-c538a93ad892 req-2965e9e9-7c7c-4e4c-9b30-b6df42b0c0f7 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:53.228701 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60c18757-a6b6-41c1-b641-c538a93ad892 req-2965e9e9-7c7c-4e4c-9b30-b6df42b0c0f7 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:53.235556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60c18757-a6b6-41c1-b641-c538a93ad892 req-2965e9e9-7c7c-4e4c-9b30-b6df42b0c0f7 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:53.242759 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60c18757-a6b6-41c1-b641-c538a93ad892 req-2965e9e9-7c7c-4e4c-9b30-b6df42b0c0f7 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:53.249639 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-edba5f6c-b435-4569-aced-88baceb96e06 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:29:53.252575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60c18757-a6b6-41c1-b641-c538a93ad892 req-2965e9e9-7c7c-4e4c-9b30-b6df42b0c0f7 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:53.254001 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-edba5f6c-b435-4569-aced-88baceb96e06 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:53.254537 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60c18757-a6b6-41c1-b641-c538a93ad892 req-2965e9e9-7c7c-4e4c-9b30-b6df42b0c0f7 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5431 time: 0.2130940 Dec 09 21:29:53.261763 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7725b31-607a-47d2-b418-6c408afbef95 None None] Sync routers for ids ['eeac8998-5e81-4874-bc7a-2829c8a216f7'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:29:53.280934 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7725b31-607a-47d2-b418-6c408afbef95 None None] Routers {'eeac8998-5e81-4874-bc7a-2829c8a216f7'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:29:53.281641 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a7725b31-607a-47d2-b418-6c408afbef95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:29:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['eeac8998-5e81-4874-bc7a-2829c8a216f7'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:53.299934 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-edba5f6c-b435-4569-aced-88baceb96e06 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "PUT /v2.0/floatingips/c8a74273-d4f2-4daa-b03c-d5fe21026216 HTTP/1.1" status: 200 len: 990 time: 1.4980824 Dec 09 21:29:53.300607 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '752d9ac2-7383-4bdb-b56f-3c52855d7fc9', 'tag': '5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:53.303157 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c301440b-32c0-4aad-90fe-9ff96659ac65" -d '{"events": [{"name": "network-changed", "server_uuid": "752d9ac2-7383-4bdb-b56f-3c52855d7fc9", "tag": "5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:53.396808 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-a7725b31-607a-47d2-b418-6c408afbef95 None None] Set router eeac8998-5e81-4874-bc7a-2829c8a216f7 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:29:53.411207 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-714665aa-bc24-440b-8ffb-44eb8690d44a req-8cd676d5-4e41-43da-977c-9008350d431d tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/security-groups?id=09be3411-a85c-42e3-aaf7-829301eec3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2355404 Dec 09 21:29:53.475976 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60c18757-a6b6-41c1-b641-c538a93ad892 req-da73d0b8-8463-4513-a351-da78bc0d4272 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1906338 Dec 09 21:29:53.511320 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2c8fc140-1e44-44ba-9317-4b8438e69e1b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:53.513345 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-9035108e-e617-4915-bcf2-cbef7038af08 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Made reservation on behalf of 396a9c42822e4e8d8a7907c4ec96ed68 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:29:53.517892 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-9035108e-e617-4915-bcf2-cbef7038af08 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:53.536029 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2c8fc140-1e44-44ba-9317-4b8438e69e1b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:53.569051 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2c8fc140-1e44-44ba-9317-4b8438e69e1b admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=f84e61bfb9084c6b99c84eb81fadee66&name=default HTTP/1.1" status: 200 len: 3000 time: 0.8508115 Dec 09 21:29:53.572633 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43296) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:53.631058 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c85fe2be-404f-41ef-9686-32604225b2f3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:53.656980 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c85fe2be-404f-41ef-9686-32604225b2f3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:53.657461 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a7725b31-607a-47d2-b418-6c408afbef95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'name': 'tempest-ServersTestBootFromVolume-1721587557-router', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163'}], 'enable_snat': True}, 'gw_port_id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:31Z', 'updated_at': '2021-12-09T21:28:40Z', 'revision_number': 4, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'gw_port': {'id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:5c:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1213, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:32Z', 'updated_at': '2021-12-09T21:28:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'c8a74273-d4f2-4daa-b03c-d5fe21026216', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'floating_ip_address': '172.25.3.35', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'port_id': '5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 1235, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6', 'mac_address': 'fa:16:3e:f0:c6:c6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '752d9ac2-7383-4bdb-b56f-3c52855d7fc9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:28:49Z', 'updated_at': '2021-12-09T21:29:52Z', 'revision_number': 1, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4417739f-7bef-4bd0-b1eb-dab883253f64', 'name': '', 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'mac_address': 'fa:16:3e:a3:e6:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1221, 'fixed_ips': [{'subnet_id': '93335bf9-6f1e-4484-ae25-dca4b03b29b4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:37Z', 'updated_at': '2021-12-09T21:28:45Z', 'revision_number': 5, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'subnets': [{'id': '93335bf9-6f1e-4484-ae25-dca4b03b29b4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:53.660035 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfe169c7-88b7-4820-848c-399c23a7c770 req-42acc32a-1a8d-4ba2-a19b-5a07b8942fa4 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/ports?device_id=fec8d114-7ce3-465f-a037-5b16fce83357 HTTP/1.1" status: 200 len: 210 time: 0.0885673 Dec 09 21:29:53.679817 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c8fc140-1e44-44ba-9317-4b8438e69e1b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0ba29e37-7819-4a17-acc1-01b2bb203b91,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:53.691106 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7725b31-607a-47d2-b418-6c408afbef95 None None] Checking router: eeac8998-5e81-4874-bc7a-2829c8a216f7 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:29:53.700232 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7725b31-607a-47d2-b418-6c408afbef95 None None] Routers {'eeac8998-5e81-4874-bc7a-2829c8a216f7'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:29:53.701065 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a7725b31-607a-47d2-b418-6c408afbef95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:29:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['eeac8998-5e81-4874-bc7a-2829c8a216f7'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:53.744638 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-401ab707-42d5-4495-a3b6-84c51f7ede9b req-718058a0-292f-4450-a0b0-930d9d99b77f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:53.745965 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c85fe2be-404f-41ef-9686-32604225b2f3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:53.750467 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c85fe2be-404f-41ef-9686-32604225b2f3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:53.752114 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c85fe2be-404f-41ef-9686-32604225b2f3 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/0ba29e37-7819-4a17-acc1-01b2bb203b91 HTTP/1.1" status: 204 len: 168 time: 0.1783810 Dec 09 21:29:53.760884 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c85fe2be-404f-41ef-9686-32604225b2f3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0ba29e37-7819-4a17-acc1-01b2bb203b91,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:53.766082 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-401ab707-42d5-4495-a3b6-84c51f7ede9b req-718058a0-292f-4450-a0b0-930d9d99b77f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1905158 Dec 09 21:29:53.802901 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3ed698e4-6724-46e1-9b8b-a4bc3a4dc98b x-openstack-request-id: req-3ed698e4-6724-46e1-9b8b-a4bc3a4dc98b {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:53.803297 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "752d9ac2-7383-4bdb-b56f-3c52855d7fc9", "tag": "5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:53.803786 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-3ed698e4-6724-46e1-9b8b-a4bc3a4dc98b {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:53.804307 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '752d9ac2-7383-4bdb-b56f-3c52855d7fc9', 'tag': '5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc', 'status': 'completed', 'code': 200} Dec 09 21:29:53.865187 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-a7725b31-607a-47d2-b418-6c408afbef95 None None] Set router eeac8998-5e81-4874-bc7a-2829c8a216f7 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:29:53.897329 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 90f16e74-f2e6-416e-a079-f205615a0d8e up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:29:53.940080 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-401ab707-42d5-4495-a3b6-84c51f7ede9b req-726cda73-a9d9-483d-9cf8-05ae908b5e29 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1729882 Dec 09 21:29:53.944586 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-9035108e-e617-4915-bcf2-cbef7038af08 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Allocated IP 172.20.0.9 (cbb87bc0-e3d4-44f3-aba2-8f506f7616a0/d23b9496-b001-4ab9-9cdc-44b02b1be59a/b066fd2a-040f-466e-9a26-d112946f9ecf) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:29:53.973840 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 90f16e74-f2e6-416e-a079-f205615a0d8e completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:29:53.976977 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c301440b-32c0-4aad-90fe-9ff96659ac65 req-2bbbb213-a8f3-4254-894f-be0aaeeccd88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:53.979517 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c301440b-32c0-4aad-90fe-9ff96659ac65 req-2bbbb213-a8f3-4254-894f-be0aaeeccd88 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=77fc0831d6584a36b61a4823157f9c1d&device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 1097 time: 0.1335921 Dec 09 21:29:53.983622 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 90f16e74-f2e6-416e-a079-f205615a0d8e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:29:53.984007 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:54.097645 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:54.125562 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7ef6883d-9c98-4e81-b102-bc1197ac4a47', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '90f16e74-f2e6-416e-a079-f205615a0d8e'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:54.128369 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-50eec63c-cd85-43d2-9b19-a403acfc47dd" -d '{"events": [{"server_uuid": "7ef6883d-9c98-4e81-b102-bc1197ac4a47", "name": "network-vif-plugged", "status": "completed", "tag": "90f16e74-f2e6-416e-a079-f205615a0d8e"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:54.166466 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 90f16e74-f2e6-416e-a079-f205615a0d8e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=90f16e74-f2e6-416e-a079-f205615a0d8e,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:54.170064 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c301440b-32c0-4aad-90fe-9ff96659ac65 req-f27f63ce-e7d6-48e6-857b-fc908ff05bf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:54.171652 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c301440b-32c0-4aad-90fe-9ff96659ac65 req-f27f63ce-e7d6-48e6-857b-fc908ff05bf3 service neutron] 10.222.0.10 "GET /v2.0/networks?id=b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6 HTTP/1.1" status: 200 len: 917 time: 0.1756957 Dec 09 21:29:54.174248 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:54.279044 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5af441d8-bdad-4223-876d-f1a754e37cf9 x-openstack-request-id: req-5af441d8-bdad-4223-876d-f1a754e37cf9 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:54.279468 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7ef6883d-9c98-4e81-b102-bc1197ac4a47", "name": "network-vif-plugged", "status": "completed", "tag": "90f16e74-f2e6-416e-a079-f205615a0d8e", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:54.279654 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-5af441d8-bdad-4223-876d-f1a754e37cf9 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:54.280058 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7ef6883d-9c98-4e81-b102-bc1197ac4a47', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '90f16e74-f2e6-416e-a079-f205615a0d8e', 'code': 200} Dec 09 21:29:54.282234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=90f16e74-f2e6-416e-a079-f205615a0d8e,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:54.326894 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a7725b31-607a-47d2-b418-6c408afbef95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'name': 'tempest-ServersTestBootFromVolume-1721587557-router', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163'}], 'enable_snat': True}, 'gw_port_id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:31Z', 'updated_at': '2021-12-09T21:28:40Z', 'revision_number': 4, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'gw_port': {'id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:5c:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1213, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:32Z', 'updated_at': '2021-12-09T21:28:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'c8a74273-d4f2-4daa-b03c-d5fe21026216', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'floating_ip_address': '172.25.3.35', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'port_id': '5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 1235, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6', 'mac_address': 'fa:16:3e:f0:c6:c6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '752d9ac2-7383-4bdb-b56f-3c52855d7fc9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:28:49Z', 'updated_at': '2021-12-09T21:29:52Z', 'revision_number': 1, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4417739f-7bef-4bd0-b1eb-dab883253f64', 'name': '', 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'mac_address': 'fa:16:3e:a3:e6:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1221, 'fixed_ips': [{'subnet_id': '93335bf9-6f1e-4484-ae25-dca4b03b29b4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:37Z', 'updated_at': '2021-12-09T21:28:45Z', 'revision_number': 5, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'subnets': [{'id': '93335bf9-6f1e-4484-ae25-dca4b03b29b4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:54.331465 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c301440b-32c0-4aad-90fe-9ff96659ac65 req-ae4c028c-604c-4bba-b9a7-fad9449c15cd service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc HTTP/1.1" status: 200 len: 998 time: 0.1163254 Dec 09 21:29:54.357610 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-9035108e-e617-4915-bcf2-cbef7038af08 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:54.359688 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7725b31-607a-47d2-b418-6c408afbef95 None None] The sync data for ids ['eeac8998-5e81-4874-bc7a-2829c8a216f7'] in n-d-713301-27 is: [{'id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'name': 'tempest-ServersTestBootFromVolume-1721587557-router', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163'}], 'enable_snat': True}, 'gw_port_id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:31Z', 'updated_at': '2021-12-09T21:28:40Z', 'revision_number': 4, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'gw_port': {'id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:5c:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1213, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:32Z', 'updated_at': '2021-12-09T21:28:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'c8a74273-d4f2-4daa-b03c-d5fe21026216', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'floating_ip_address': '172.25.3.35', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'port_id': '5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 1235, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6', 'mac_address': 'fa:16:3e:f0:c6:c6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '752d9ac2-7383-4bdb-b56f-3c52855d7fc9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:28:49Z', 'updated_at': '2021-12-09T21:29:52Z', 'revision_number': 1, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4417739f-7bef-4bd0-b1eb-dab883253f64', 'name': '', 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'mac_address': 'fa:16:3e:a3:e6:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1221, 'fixed_ips': [{'subnet_id': '93335bf9-6f1e-4484-ae25-dca4b03b29b4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:37Z', 'updated_at': '2021-12-09T21:28:45Z', 'revision_number': 5, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'subnets': [{'id': '93335bf9-6f1e-4484-ae25-dca4b03b29b4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:29:54.414555 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-893b97ba-bc22-4fac-8850-4c626561f212 req-8c160f1d-4e8d-4a9e-b12a-4c95514dfcd6 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:54.416200 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-893b97ba-bc22-4fac-8850-4c626561f212 req-8c160f1d-4e8d-4a9e-b12a-4c95514dfcd6 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.10 "GET /v2.0/ports?device_id=ba78dacb-cf50-4182-b474-958412e2b568 HTTP/1.1" status: 200 len: 946 time: 0.1882339 Dec 09 21:29:54.432076 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c301440b-32c0-4aad-90fe-9ff96659ac65 req-61103f5b-d149-44f4-a127-e826b7231474 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:54.433649 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c301440b-32c0-4aad-90fe-9ff96659ac65 req-61103f5b-d149-44f4-a127-e826b7231474 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=93335bf9-6f1e-4484-ae25-dca4b03b29b4 HTTP/1.1" status: 200 len: 855 time: 0.0919783 Dec 09 21:29:54.474247 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d505447-7558-43ea-af9f-efe535583bf5 req-9b31a631-5155-4e01-8c9f-aae17ab121a3 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:54.477791 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1d505447-7558-43ea-af9f-efe535583bf5 req-9b31a631-5155-4e01-8c9f-aae17ab121a3 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.31 "GET /v2.0/ports?device_id=31a27c6f-f2ac-4eff-9039-700b918036ef HTTP/1.1" status: 200 len: 945 time: 0.1757710 Dec 09 21:29:54.483862 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-9035108e-e617-4915-bcf2-cbef7038af08 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:54.531661 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-9035108e-e617-4915-bcf2-cbef7038af08 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Network cbb87bc0-e3d4-44f3-aba2-8f506f7616a0 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:29:54.556215 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-9035108e-e617-4915-bcf2-cbef7038af08 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:29:54.565113 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c301440b-32c0-4aad-90fe-9ff96659ac65 req-4e205347-dead-4cd7-8a37-9ecd9acdee9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:54.566204 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c301440b-32c0-4aad-90fe-9ff96659ac65 req-4e205347-dead-4cd7-8a37-9ecd9acdee9a service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1247594 Dec 09 21:29:54.581390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-9035108e-e617-4915-bcf2-cbef7038af08 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:29:54.612485 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b1b857e-d575-4fde-bb63-02faf9d7ceb8 req-4aed2920-7a92-4609-8647-54167abb6715 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:54.614018 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4b1b857e-d575-4fde-bb63-02faf9d7ceb8 req-4aed2920-7a92-4609-8647-54167abb6715 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 1098 time: 0.3084145 Dec 09 21:29:54.680757 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9035108e-e617-4915-bcf2-cbef7038af08 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Pushing event updated for resources: {'Port': ['ID=b066fd2a-040f-466e-9a26-d112946f9ecf,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:54.743288 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68816851-939b-4126-b626-0d0472a4acd2 None None] New status for floating IP c8a74273-d4f2-4daa-b03c-d5fe21026216: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:29:54.761774 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8d6d17f-d0c7-4235-be72-b4664f7404bb req-015c820a-6448-4292-83a3-8f9230f68635 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:54.763726 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8d6d17f-d0c7-4235-be72-b4664f7404bb req-015c820a-6448-4292-83a3-8f9230f68635 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/ports?device_id=ba78dacb-cf50-4182-b474-958412e2b568 HTTP/1.1" status: 200 len: 946 time: 0.2303722 Dec 09 21:29:54.772149 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4b1b857e-d575-4fde-bb63-02faf9d7ceb8 req-2e692b47-3760-4370-9a1a-d4a62ee7473a service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1504562 Dec 09 21:29:54.783738 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-9035108e-e617-4915-bcf2-cbef7038af08 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:54.784491 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-9035108e-e617-4915-bcf2-cbef7038af08 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:54.819768 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-893b97ba-bc22-4fac-8850-4c626561f212 req-cabd419f-7ad7-42ed-8f30-45ab5f6d03c8 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Deleting port 723351f2-7c62-4bb5-aaad-288a6e26545f {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:29:54.820510 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-893b97ba-bc22-4fac-8850-4c626561f212 req-cabd419f-7ad7-42ed-8f30-45ab5f6d03c8 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:54.844876 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0872bcc5-5171-49c9-ae87-4d56de6f3ba8 req-ef9cb0cf-a16f-45fb-bfc0-48371da3eb0c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:54.845421 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-1d505447-7558-43ea-af9f-efe535583bf5 req-0a005211-9b44-47f2-839f-a2c3bafa54e4 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Deleting port 675f510c-c35a-468e-b70b-4abb34188642 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:29:54.846085 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1d505447-7558-43ea-af9f-efe535583bf5 req-0a005211-9b44-47f2-839f-a2c3bafa54e4 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:54.850770 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0872bcc5-5171-49c9-ae87-4d56de6f3ba8 req-ef9cb0cf-a16f-45fb-bfc0-48371da3eb0c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:54.857711 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0872bcc5-5171-49c9-ae87-4d56de6f3ba8 req-ef9cb0cf-a16f-45fb-bfc0-48371da3eb0c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:54.863739 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0872bcc5-5171-49c9-ae87-4d56de6f3ba8 req-ef9cb0cf-a16f-45fb-bfc0-48371da3eb0c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:54.869859 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0872bcc5-5171-49c9-ae87-4d56de6f3ba8 req-ef9cb0cf-a16f-45fb-bfc0-48371da3eb0c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:54.876307 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0872bcc5-5171-49c9-ae87-4d56de6f3ba8 req-ef9cb0cf-a16f-45fb-bfc0-48371da3eb0c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:54.882205 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0872bcc5-5171-49c9-ae87-4d56de6f3ba8 req-ef9cb0cf-a16f-45fb-bfc0-48371da3eb0c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:54.884151 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0872bcc5-5171-49c9-ae87-4d56de6f3ba8 req-ef9cb0cf-a16f-45fb-bfc0-48371da3eb0c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5431 time: 0.2636819 Dec 09 21:29:54.902803 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-9035108e-e617-4915-bcf2-cbef7038af08 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.7520721 Dec 09 21:29:54.924678 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c301440b-32c0-4aad-90fe-9ff96659ac65 req-0c5bd3be-b987-4e75-b824-7a7444216c0d service neutron] 10.222.0.10 "GET /v2.0/networks/b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3379810 Dec 09 21:29:54.991494 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8d6d17f-d0c7-4235-be72-b4664f7404bb req-798de18d-f2a5-4d78-b1a1-a8a066ac0f25 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/security-groups?id=09be3411-a85c-42e3-aaf7-829301eec3de&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1955996 Dec 09 21:29:55.001336 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-35a01734-4dcb-410f-a398-d2594d0a0ba4 service neutron] Request body: {'port': {'device_id': 'fec8d114-7ce3-465f-a037-5b16fce83357', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:55.029539 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0872bcc5-5171-49c9-ae87-4d56de6f3ba8 req-3acc6172-682b-440e-85a7-6f6f022181d2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1303139 Dec 09 21:29:55.080287 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-893b97ba-bc22-4fac-8850-4c626561f212 req-cabd419f-7ad7-42ed-8f30-45ab5f6d03c8 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] For port 723351f2-7c62-4bb5-aaad-288a6e26545f, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=723351f2-7c62-4bb5-aaad-288a6e26545f,segment=NetworkSegment(4944fe1d-3354-4e33-b6be-75c5cb26e73d),segment_id=4944fe1d-3354-4e33-b6be-75c5cb26e73d)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:55.080914 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-893b97ba-bc22-4fac-8850-4c626561f212 req-cabd419f-7ad7-42ed-8f30-45ab5f6d03c8 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:55.098353 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-1d505447-7558-43ea-af9f-efe535583bf5 req-0a005211-9b44-47f2-839f-a2c3bafa54e4 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] For port 675f510c-c35a-468e-b70b-4abb34188642, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=675f510c-c35a-468e-b70b-4abb34188642,segment=NetworkSegment(4944fe1d-3354-4e33-b6be-75c5cb26e73d),segment_id=4944fe1d-3354-4e33-b6be-75c5cb26e73d)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:29:55.098722 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1d505447-7558-43ea-af9f-efe535583bf5 req-0a005211-9b44-47f2-839f-a2c3bafa54e4 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:55.124572 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-1d505447-7558-43ea-af9f-efe535583bf5 req-0a005211-9b44-47f2-839f-a2c3bafa54e4 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Calling delete_port for 675f510c-c35a-468e-b70b-4abb34188642 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:29:55.196011 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-893b97ba-bc22-4fac-8850-4c626561f212 req-cabd419f-7ad7-42ed-8f30-45ab5f6d03c8 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Calling delete_port for 723351f2-7c62-4bb5-aaad-288a6e26545f owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:29:55.351625 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1d505447-7558-43ea-af9f-efe535583bf5 req-0a005211-9b44-47f2-839f-a2c3bafa54e4 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:55.366946 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['675f510c-c35a-468e-b70b-4abb34188642'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:29:55.370427 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['723351f2-7c62-4bb5-aaad-288a6e26545f'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:29:55.454475 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a005211-9b44-47f2-839f-a2c3bafa54e4 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Pushing event deleted for resources: {'Port': ['ID=675f510c-c35a-468e-b70b-4abb34188642,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:55.514518 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-1d505447-7558-43ea-af9f-efe535583bf5 req-0a005211-9b44-47f2-839f-a2c3bafa54e4 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] No DVR routers for this DVR port 675f510c-c35a-468e-b70b-4abb34188642 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:29:55.519913 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1d505447-7558-43ea-af9f-efe535583bf5 req-0a005211-9b44-47f2-839f-a2c3bafa54e4 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:55.523660 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1d505447-7558-43ea-af9f-efe535583bf5 req-0a005211-9b44-47f2-839f-a2c3bafa54e4 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.31 "DELETE /v2.0/ports/675f510c-c35a-468e-b70b-4abb34188642 HTTP/1.1" status: 204 len: 173 time: 1.0331531 Dec 09 21:29:55.534589 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-893b97ba-bc22-4fac-8850-4c626561f212 req-cabd419f-7ad7-42ed-8f30-45ab5f6d03c8 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:55.553757 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['675f510c-c35a-468e-b70b-4abb34188642'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:29:55.591951 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cabd419f-7ad7-42ed-8f30-45ab5f6d03c8 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Pushing event deleted for resources: {'Port': ['ID=723351f2-7c62-4bb5-aaad-288a6e26545f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:55.647406 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-893b97ba-bc22-4fac-8850-4c626561f212 req-cabd419f-7ad7-42ed-8f30-45ab5f6d03c8 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] No DVR routers for this DVR port 723351f2-7c62-4bb5-aaad-288a6e26545f on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:29:55.647683 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-35a01734-4dcb-410f-a398-d2594d0a0ba4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:55.650282 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-893b97ba-bc22-4fac-8850-4c626561f212 req-cabd419f-7ad7-42ed-8f30-45ab5f6d03c8 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:55.653988 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-893b97ba-bc22-4fac-8850-4c626561f212 req-cabd419f-7ad7-42ed-8f30-45ab5f6d03c8 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.10 "DELETE /v2.0/ports/723351f2-7c62-4bb5-aaad-288a6e26545f HTTP/1.1" status: 204 len: 173 time: 1.2308824 Dec 09 21:29:55.708045 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c301440b-32c0-4aad-90fe-9ff96659ac65 req-8ea587a7-bfea-45bc-8100-7b7d12cc5959 service neutron] 10.222.0.10 "GET /v2.0/networks/b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7712603 Dec 09 21:29:55.748936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d57aba52-63ec-4b7c-9e11-3787543a46f6 req-1cbbda7e-8b91-4b27-82b3-647a3a6726e2 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:55.751263 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d57aba52-63ec-4b7c-9e11-3787543a46f6 req-1cbbda7e-8b91-4b27-82b3-647a3a6726e2 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/ports?device_id=fec8d114-7ce3-465f-a037-5b16fce83357 HTTP/1.1" status: 200 len: 931 time: 0.6090970 Dec 09 21:29:55.788708 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84a646a4-f53d-491c-ae53-4d7741359cc3 req-67ac8548-a752-4654-b71f-d9c38f0a07c6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:55.796111 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84a646a4-f53d-491c-ae53-4d7741359cc3 req-67ac8548-a752-4654-b71f-d9c38f0a07c6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 946 time: 0.1873579 Dec 09 21:29:55.805145 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '31a27c6f-f2ac-4eff-9039-700b918036ef', 'name': 'network-vif-deleted', 'tag': '675f510c-c35a-468e-b70b-4abb34188642'}, {'server_uuid': 'ba78dacb-cf50-4182-b474-958412e2b568', 'name': 'network-vif-deleted', 'tag': '723351f2-7c62-4bb5-aaad-288a6e26545f'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:55.807698 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-66600c1f-70fa-4e3e-9701-9571ef401303" -d '{"events": [{"server_uuid": "31a27c6f-f2ac-4eff-9039-700b918036ef", "name": "network-vif-deleted", "tag": "675f510c-c35a-468e-b70b-4abb34188642"}, {"server_uuid": "ba78dacb-cf50-4182-b474-958412e2b568", "name": "network-vif-deleted", "tag": "723351f2-7c62-4bb5-aaad-288a6e26545f"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:55.968089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d57aba52-63ec-4b7c-9e11-3787543a46f6 req-5bd6b061-2b60-44e2-a50e-3dc5c0ac0557 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/security-groups?id=d1f3d7b6-7fd9-4f73-b3cf-8eb30963c2a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2026095 Dec 09 21:29:55.987999 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84a646a4-f53d-491c-ae53-4d7741359cc3 req-6a51dd29-ac1b-4f58-9357-3e04d753df33 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1622674 Dec 09 21:29:56.084437 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5b90ea8c-4443-460c-883e-8ac32ad62138 x-openstack-request-id: req-5b90ea8c-4443-460c-883e-8ac32ad62138 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:56.084824 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "31a27c6f-f2ac-4eff-9039-700b918036ef", "name": "network-vif-deleted", "tag": "675f510c-c35a-468e-b70b-4abb34188642", "status": "completed", "code": 200}, {"server_uuid": "ba78dacb-cf50-4182-b474-958412e2b568", "name": "network-vif-deleted", "tag": "723351f2-7c62-4bb5-aaad-288a6e26545f", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:56.085248 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-5b90ea8c-4443-460c-883e-8ac32ad62138 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:56.085702 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '31a27c6f-f2ac-4eff-9039-700b918036ef', 'name': 'network-vif-deleted', 'tag': '675f510c-c35a-468e-b70b-4abb34188642', 'status': 'completed', 'code': 200} Dec 09 21:29:56.085959 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ba78dacb-cf50-4182-b474-958412e2b568', 'name': 'network-vif-deleted', 'tag': '723351f2-7c62-4bb5-aaad-288a6e26545f', 'status': 'completed', 'code': 200} Dec 09 21:29:56.199259 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6062c399-a1c2-47a1-b2de-382db4714ae3 req-c18e4cda-c8bc-41a1-bcd6-82f95b9b2502 tempest-ListServersNegativeTestJSON-1322283896 tempest-ListServersNegativeTestJSON-1322283896-project] 10.222.0.13 "GET /v2.0/ports?device_id=ba78dacb-cf50-4182-b474-958412e2b568 HTTP/1.1" status: 200 len: 210 time: 0.0918455 Dec 09 21:29:56.308066 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa6e2456-e572-480c-b0b0-c98d02eddfde req-0ca1995e-7fb8-4e69-9a34-4bd81422f2c1 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:56.315373 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa6e2456-e572-480c-b0b0-c98d02eddfde req-0ca1995e-7fb8-4e69-9a34-4bd81422f2c1 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:56.322054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa6e2456-e572-480c-b0b0-c98d02eddfde req-0ca1995e-7fb8-4e69-9a34-4bd81422f2c1 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:56.328463 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa6e2456-e572-480c-b0b0-c98d02eddfde req-0ca1995e-7fb8-4e69-9a34-4bd81422f2c1 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:56.334839 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa6e2456-e572-480c-b0b0-c98d02eddfde req-0ca1995e-7fb8-4e69-9a34-4bd81422f2c1 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:56.341040 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa6e2456-e572-480c-b0b0-c98d02eddfde req-0ca1995e-7fb8-4e69-9a34-4bd81422f2c1 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:56.347515 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa6e2456-e572-480c-b0b0-c98d02eddfde req-0ca1995e-7fb8-4e69-9a34-4bd81422f2c1 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:56.349490 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fa6e2456-e572-480c-b0b0-c98d02eddfde req-0ca1995e-7fb8-4e69-9a34-4bd81422f2c1 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5431 time: 0.1823075 Dec 09 21:29:56.351840 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-35a01734-4dcb-410f-a398-d2594d0a0ba4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b066fd2a-040f-466e-9a26-d112946f9ecf {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:29:56.362320 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-35a01734-4dcb-410f-a398-d2594d0a0ba4 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:56.392826 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-35a01734-4dcb-410f-a398-d2594d0a0ba4 service neutron] Transition to ACTIVE for port object b066fd2a-040f-466e-9a26-d112946f9ecf will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:29:56.403166 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-35a01734-4dcb-410f-a398-d2594d0a0ba4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:56.475899 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fa6e2456-e572-480c-b0b0-c98d02eddfde req-c1ca8e9f-a5ac-4a5d-af98-f940e8963987 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1165621 Dec 09 21:29:56.484828 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35a01734-4dcb-410f-a398-d2594d0a0ba4 service neutron] Pushing event updated for resources: {'Port': ['ID=b066fd2a-040f-466e-9a26-d112946f9ecf,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:56.566997 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-35a01734-4dcb-410f-a398-d2594d0a0ba4 service neutron] Attempting to bind port b066fd2a-040f-466e-9a26-d112946f9ecf on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:29:56.567335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-35a01734-4dcb-410f-a398-d2594d0a0ba4 service neutron] Attempting to bind port b066fd2a-040f-466e-9a26-d112946f9ecf by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'a2c20e6d-42c4-4a87-8c3e-1d0138b5958f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'cbb87bc0-e3d4-44f3-aba2-8f506f7616a0'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:29:56.567696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-35a01734-4dcb-410f-a398-d2594d0a0ba4 service neutron] Attempting to bind port b066fd2a-040f-466e-9a26-d112946f9ecf on network cbb87bc0-e3d4-44f3-aba2-8f506f7616a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:56.571959 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-35a01734-4dcb-410f-a398-d2594d0a0ba4 service neutron] Port b066fd2a-040f-466e-9a26-d112946f9ecf on network cbb87bc0-e3d4-44f3-aba2-8f506f7616a0 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:29:56.572281 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-35a01734-4dcb-410f-a398-d2594d0a0ba4 service neutron] Attempting to bind port b066fd2a-040f-466e-9a26-d112946f9ecf on network cbb87bc0-e3d4-44f3-aba2-8f506f7616a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:29:56.577520 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-35a01734-4dcb-410f-a398-d2594d0a0ba4 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 29, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:29:56.577858 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-35a01734-4dcb-410f-a398-d2594d0a0ba4 service neutron] Checking segment: {'id': 'a2c20e6d-42c4-4a87-8c3e-1d0138b5958f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'cbb87bc0-e3d4-44f3-aba2-8f506f7616a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:29:56.578237 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-35a01734-4dcb-410f-a398-d2594d0a0ba4 service neutron] Bound using segment: {'id': 'a2c20e6d-42c4-4a87-8c3e-1d0138b5958f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'cbb87bc0-e3d4-44f3-aba2-8f506f7616a0'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:29:56.578663 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-35a01734-4dcb-410f-a398-d2594d0a0ba4 service neutron] Bound port: b066fd2a-040f-466e-9a26-d112946f9ecf, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a2c20e6d-42c4-4a87-8c3e-1d0138b5958f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'cbb87bc0-e3d4-44f3-aba2-8f506f7616a0'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:29:56.579016 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-35a01734-4dcb-410f-a398-d2594d0a0ba4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:56.640954 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-35a01734-4dcb-410f-a398-d2594d0a0ba4 service neutron] For port b066fd2a-040f-466e-9a26-d112946f9ecf, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:29:56.644137 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-35a01734-4dcb-410f-a398-d2594d0a0ba4 service neutron] For port b066fd2a-040f-466e-9a26-d112946f9ecf, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b066fd2a-040f-466e-9a26-d112946f9ecf,segment=NetworkSegment(a2c20e6d-42c4-4a87-8c3e-1d0138b5958f),segment_id=a2c20e6d-42c4-4a87-8c3e-1d0138b5958f)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:29:56.650080 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-35a01734-4dcb-410f-a398-d2594d0a0ba4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:56.688901 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-35a01734-4dcb-410f-a398-d2594d0a0ba4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:56.689529 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-35a01734-4dcb-410f-a398-d2594d0a0ba4 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:56.690970 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-35a01734-4dcb-410f-a398-d2594d0a0ba4 service neutron] 10.222.0.31 "PUT /v2.0/ports/b066fd2a-040f-466e-9a26-d112946f9ecf HTTP/1.1" status: 200 len: 1092 time: 1.7003665 Dec 09 21:29:56.691410 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fec8d114-7ce3-465f-a037-5b16fce83357', 'tag': 'b066fd2a-040f-466e-9a26-d112946f9ecf'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:56.693653 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-20a74a3d-4cbd-4f56-a448-520987ff300c" -d '{"events": [{"name": "network-changed", "server_uuid": "fec8d114-7ce3-465f-a037-5b16fce83357", "tag": "b066fd2a-040f-466e-9a26-d112946f9ecf"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:56.721118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35a01734-4dcb-410f-a398-d2594d0a0ba4 service neutron] Pushing event updated for resources: {'Port': ['ID=b066fd2a-040f-466e-9a26-d112946f9ecf,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:56.735366 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-87c5d659-927e-4fc8-a1c9-214c813ec82e x-openstack-request-id: req-87c5d659-927e-4fc8-a1c9-214c813ec82e {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:56.735966 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fec8d114-7ce3-465f-a037-5b16fce83357", "tag": "b066fd2a-040f-466e-9a26-d112946f9ecf", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:56.736224 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-87c5d659-927e-4fc8-a1c9-214c813ec82e {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:56.736626 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fec8d114-7ce3-465f-a037-5b16fce83357', 'tag': 'b066fd2a-040f-466e-9a26-d112946f9ecf', 'status': 'completed', 'code': 200} Dec 09 21:29:56.779113 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-7a410f30-b747-489c-a110-40f282be2668 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:56.780666 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-7a410f30-b747-489c-a110-40f282be2668 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=396a9c42822e4e8d8a7907c4ec96ed68&device_id=fec8d114-7ce3-465f-a037-5b16fce83357 HTTP/1.1" status: 200 len: 1095 time: 0.0431883 Dec 09 21:29:56.832005 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-369b714f-2038-4e74-83e8-7bf27b69467b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=b066fd2a-040f-466e-9a26-d112946f9ecf HTTP/1.1" status: 200 len: 217 time: 0.0431283 Dec 09 21:29:56.889195 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-45759629-47c7-4df8-ba07-1ab0b031f7fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:56.890690 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-45759629-47c7-4df8-ba07-1ab0b031f7fa service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d23b9496-b001-4ab9-9cdc-44b02b1be59a HTTP/1.1" status: 200 len: 862 time: 0.0513694 Dec 09 21:29:56.923348 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-8d9f493a-37f6-475c-a271-7ee58c637fdc service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=cbb87bc0-e3d4-44f3-aba2-8f506f7616a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0247836 Dec 09 21:29:57.023275 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-bde6b496-882c-4575-a1c6-7a496be6022b service neutron] 10.222.0.31 "GET /v2.0/networks/cbb87bc0-e3d4-44f3-aba2-8f506f7616a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0925405 Dec 09 21:29:57.132847 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:57.157193 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:57.188717 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bce6f32-c589-4fbd-b2b2-38ed0acb8b48 req-18745749-f79a-4c6a-a31e-ac6beaf377d0 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:57.190235 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3bce6f32-c589-4fbd-b2b2-38ed0acb8b48 req-18745749-f79a-4c6a-a31e-ac6beaf377d0 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/ports?device_id=fec8d114-7ce3-465f-a037-5b16fce83357 HTTP/1.1" status: 200 len: 943 time: 0.1401439 Dec 09 21:29:57.203182 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18a78499-61fb-4d10-bf0a-6072b51746cb req-f0b1f3e7-6d0e-4df0-9031-6cb854f65939 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:57.205535 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-18a78499-61fb-4d10-bf0a-6072b51746cb req-f0b1f3e7-6d0e-4df0-9031-6cb854f65939 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 946 time: 0.1561961 Dec 09 21:29:57.208938 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0108ce3-ea23-4d60-b072-a565cc31a142 req-7a4e3851-cbf6-4fff-ba82-25891c31bc31 service neutron] 10.222.0.31 "GET /v2.0/networks/cbb87bc0-e3d4-44f3-aba2-8f506f7616a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1781597 Dec 09 21:29:57.306967 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3bce6f32-c589-4fbd-b2b2-38ed0acb8b48 req-b3cd91be-9e5e-4a25-a3bf-039050d99b08 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/security-groups?id=d1f3d7b6-7fd9-4f73-b3cf-8eb30963c2a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1000803 Dec 09 21:29:57.314321 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-18a78499-61fb-4d10-bf0a-6072b51746cb req-dd524cda-2300-4e11-91ab-bddce5d168e6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0997565 Dec 09 21:29:57.328933 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20a74a3d-4cbd-4f56-a448-520987ff300c req-9e337869-5d7a-419a-9b07-6a98595df237 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:57.330500 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20a74a3d-4cbd-4f56-a448-520987ff300c req-9e337869-5d7a-419a-9b07-6a98595df237 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=396a9c42822e4e8d8a7907c4ec96ed68&device_id=fec8d114-7ce3-465f-a037-5b16fce83357 HTTP/1.1" status: 200 len: 1095 time: 0.0640261 Dec 09 21:29:57.430455 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43376) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:57.476401 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-6f2d0039-ef75-412f-b8ad-8e895824274a admin admin] Deleting subnet 16184032-e4c1-40c2-a34f-a13c4226a14a {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:29:57.479819 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f2d0039-ef75-412f-b8ad-8e895824274a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:57.480513 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa3e36df-491e-4235-8fd9-f3bce923b70b req-75f03ed2-b790-40c4-916b-294c9fab5cde tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:57.482272 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aa3e36df-491e-4235-8fd9-f3bce923b70b req-75f03ed2-b790-40c4-916b-294c9fab5cde tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 946 time: 0.0693262 Dec 09 21:29:57.485770 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20a74a3d-4cbd-4f56-a448-520987ff300c req-1cac103e-fb8e-45c2-a952-806282d1eaa8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:57.487851 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20a74a3d-4cbd-4f56-a448-520987ff300c req-1cac103e-fb8e-45c2-a952-806282d1eaa8 service neutron] 10.222.0.31 "GET /v2.0/networks?id=cbb87bc0-e3d4-44f3-aba2-8f506f7616a0 HTTP/1.1" status: 200 len: 923 time: 0.1494825 Dec 09 21:29:57.490694 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43380) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:57.496690 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-0f79661b-f4e6-4d85-907c-c7df0521fc4b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Request body: {'floatingip': {'port_id': '90f16e74-f2e6-416e-a079-f205615a0d8e'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:29:57.521425 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f2d0039-ef75-412f-b8ad-8e895824274a admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:57.585952 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f2d0039-ef75-412f-b8ad-8e895824274a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:57.588297 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0f79661b-f4e6-4d85-907c-c7df0521fc4b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for floatingip, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:57.592558 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20a74a3d-4cbd-4f56-a448-520987ff300c req-d7979f32-0b4c-431f-aa58-2e6aca9eabe9 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=b066fd2a-040f-466e-9a26-d112946f9ecf HTTP/1.1" status: 200 len: 217 time: 0.0923529 Dec 09 21:29:57.639577 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f2d0039-ef75-412f-b8ad-8e895824274a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:57.670266 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2d0039-ef75-412f-b8ad-8e895824274a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=16184032-e4c1-40c2-a34f-a13c4226a14a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:57.672668 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f2d0039-ef75-412f-b8ad-8e895824274a admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:57.677057 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6f2d0039-ef75-412f-b8ad-8e895824274a admin admin] 10.222.0.13 "DELETE /v2.0/subnets/16184032-e4c1-40c2-a34f-a13c4226a14a HTTP/1.1" status: 204 len: 168 time: 0.2455518 Dec 09 21:29:57.679543 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43392) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:57.753199 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-426c8d46-83dd-4ccf-b5c3-94ba20a1a2aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:57.763562 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20a74a3d-4cbd-4f56-a448-520987ff300c req-89910256-fdd6-4118-8c69-2b042a5b7052 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:57.765099 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20a74a3d-4cbd-4f56-a448-520987ff300c req-89910256-fdd6-4118-8c69-2b042a5b7052 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d23b9496-b001-4ab9-9cdc-44b02b1be59a HTTP/1.1" status: 200 len: 862 time: 0.1410224 Dec 09 21:29:57.781282 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0af4ce57-9ac0-48a2-8096-255f4358dd4d req-512b6bae-b1cb-43e4-a974-01dcaad12967 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:57.788083 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0af4ce57-9ac0-48a2-8096-255f4358dd4d req-512b6bae-b1cb-43e4-a974-01dcaad12967 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:57.794272 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0af4ce57-9ac0-48a2-8096-255f4358dd4d req-512b6bae-b1cb-43e4-a974-01dcaad12967 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:57.800783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0af4ce57-9ac0-48a2-8096-255f4358dd4d req-512b6bae-b1cb-43e4-a974-01dcaad12967 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:57.808749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0af4ce57-9ac0-48a2-8096-255f4358dd4d req-512b6bae-b1cb-43e4-a974-01dcaad12967 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:57.814978 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0af4ce57-9ac0-48a2-8096-255f4358dd4d req-512b6bae-b1cb-43e4-a974-01dcaad12967 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:57.821574 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0af4ce57-9ac0-48a2-8096-255f4358dd4d req-512b6bae-b1cb-43e4-a974-01dcaad12967 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:57.828042 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0af4ce57-9ac0-48a2-8096-255f4358dd4d req-512b6bae-b1cb-43e4-a974-01dcaad12967 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5431 time: 0.2345057 Dec 09 21:29:57.842899 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-426c8d46-83dd-4ccf-b5c3-94ba20a1a2aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:57.866000 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-426c8d46-83dd-4ccf-b5c3-94ba20a1a2aa admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0bcede63-0fdd-4d40-8c5c-4890fec5dc38']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:57.876856 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-426c8d46-83dd-4ccf-b5c3-94ba20a1a2aa admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4944fe1d-3354-4e33-b6be-75c5cb26e73d') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:57.877341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-426c8d46-83dd-4ccf-b5c3-94ba20a1a2aa admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4944fe1d-3354-4e33-b6be-75c5cb26e73d') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:57.882614 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20a74a3d-4cbd-4f56-a448-520987ff300c req-c4e29c98-27a5-428c-9f15-ab830e86bdd3 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=cbb87bc0-e3d4-44f3-aba2-8f506f7616a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0533447 Dec 09 21:29:57.893129 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-426c8d46-83dd-4ccf-b5c3-94ba20a1a2aa admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:57.930189 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-426c8d46-83dd-4ccf-b5c3-94ba20a1a2aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:57.938236 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-426c8d46-83dd-4ccf-b5c3-94ba20a1a2aa admin admin] Releasing vlan 105 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:29:57.940156 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-426c8d46-83dd-4ccf-b5c3-94ba20a1a2aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:29:57.942881 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:29:58.004153 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0af4ce57-9ac0-48a2-8096-255f4358dd4d req-a4602933-733a-4176-b8a4-d1c2001a093e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1634285 Dec 09 21:29:58.017979 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-426c8d46-83dd-4ccf-b5c3-94ba20a1a2aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:58.038537 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-426c8d46-83dd-4ccf-b5c3-94ba20a1a2aa admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:58.044273 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-426c8d46-83dd-4ccf-b5c3-94ba20a1a2aa admin admin] 10.222.0.13 "DELETE /v2.0/networks/0bcede63-0fdd-4d40-8c5c-4890fec5dc38 HTTP/1.1" status: 204 len: 168 time: 0.3612876 Dec 09 21:29:58.044273 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-426c8d46-83dd-4ccf-b5c3-94ba20a1a2aa admin admin] Pushing event deleted for resources: {'Network': ['ID=0bcede63-0fdd-4d40-8c5c-4890fec5dc38,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:58.121680 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20a74a3d-4cbd-4f56-a448-520987ff300c req-4fe0932f-fc7a-4ab5-8e11-fdb79d49de75 service neutron] 10.222.0.31 "GET /v2.0/networks/cbb87bc0-e3d4-44f3-aba2-8f506f7616a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2288258 Dec 09 21:29:58.232198 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43402) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:58.279190 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-58a53060-f77b-4a49-9d5a-dbf7888ef64b admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=6757323541bb47f99775de3a0132216b&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0441012 Dec 09 21:29:58.281644 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43404) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:29:58.332453 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac747d68-8f9f-4398-bbd7-0f7e641b4f1c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:58.332683 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20a74a3d-4cbd-4f56-a448-520987ff300c req-297454dc-7ddb-498d-9652-7a8f24ca8d00 service neutron] 10.222.0.31 "GET /v2.0/networks/cbb87bc0-e3d4-44f3-aba2-8f506f7616a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1793554 Dec 09 21:29:58.357022 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac747d68-8f9f-4398-bbd7-0f7e641b4f1c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:58.424932 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac747d68-8f9f-4398-bbd7-0f7e641b4f1c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:58.427983 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac747d68-8f9f-4398-bbd7-0f7e641b4f1c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:58.431685 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ac747d68-8f9f-4398-bbd7-0f7e641b4f1c admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/09be3411-a85c-42e3-aaf7-829301eec3de HTTP/1.1" status: 204 len: 168 time: 0.1467628 Dec 09 21:29:58.448631 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac747d68-8f9f-4398-bbd7-0f7e641b4f1c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=09be3411-a85c-42e3-aaf7-829301eec3de,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:29:58.510069 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0f79661b-f4e6-4d85-907c-c7df0521fc4b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:58.522460 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0f79661b-f4e6-4d85-907c-c7df0521fc4b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:58.536655 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38adc57f-9381-4dd9-a538-71cb4bd2f0e1 req-8043d76b-80dd-4654-8802-f4e7883e56ec tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:58.547517 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38adc57f-9381-4dd9-a538-71cb4bd2f0e1 req-8043d76b-80dd-4654-8802-f4e7883e56ec tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/ports?device_id=fec8d114-7ce3-465f-a037-5b16fce83357 HTTP/1.1" status: 200 len: 943 time: 0.1032488 Dec 09 21:29:58.698817 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38adc57f-9381-4dd9-a538-71cb4bd2f0e1 req-dbf2a4e6-f456-45f2-a0d1-ecab703e9572 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/security-groups?id=d1f3d7b6-7fd9-4f73-b3cf-8eb30963c2a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1502748 Dec 09 21:29:58.719258 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-0f79661b-f4e6-4d85-907c-c7df0521fc4b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Floating IP 221af2a9-94eb-44be-8e07-2d0f9a4d191b associated. External IP: 172.25.3.249, port: 90f16e74-f2e6-416e-a079-f205615a0d8e. Dec 09 21:29:58.967908 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0f79661b-f4e6-4d85-907c-c7df0521fc4b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Router 1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:29:59.090681 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0f79661b-f4e6-4d85-907c-c7df0521fc4b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:29:59.099562 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0f79661b-f4e6-4d85-907c-c7df0521fc4b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:29:59.118681 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e092cfa1-7c9c-4a3b-9291-a4a0dbb86510 None None] Sync routers for ids ['1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:29:59.130306 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e092cfa1-7c9c-4a3b-9291-a4a0dbb86510 None None] Routers {'1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:29:59.131067 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e092cfa1-7c9c-4a3b-9291-a4a0dbb86510 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:29:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:59.162370 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0f79661b-f4e6-4d85-907c-c7df0521fc4b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "PUT /v2.0/floatingips/221af2a9-94eb-44be-8e07-2d0f9a4d191b HTTP/1.1" status: 200 len: 992 time: 1.6704209 Dec 09 21:29:59.163347 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7ef6883d-9c98-4e81-b102-bc1197ac4a47', 'tag': '90f16e74-f2e6-416e-a079-f205615a0d8e'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:29:59.166026 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e047843d-721c-4d72-b0b4-1765a1c78d8a" -d '{"events": [{"name": "network-changed", "server_uuid": "7ef6883d-9c98-4e81-b102-bc1197ac4a47", "tag": "90f16e74-f2e6-416e-a079-f205615a0d8e"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:29:59.204544 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87de366d-94e3-4dbc-a0e2-d6cdaccc2da9 req-9ec438e9-a41c-4438-b989-c6005581a4c2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:59.224337 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87de366d-94e3-4dbc-a0e2-d6cdaccc2da9 req-9ec438e9-a41c-4438-b989-c6005581a4c2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:59.230426 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87de366d-94e3-4dbc-a0e2-d6cdaccc2da9 req-9ec438e9-a41c-4438-b989-c6005581a4c2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:59.236822 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87de366d-94e3-4dbc-a0e2-d6cdaccc2da9 req-9ec438e9-a41c-4438-b989-c6005581a4c2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:59.243113 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87de366d-94e3-4dbc-a0e2-d6cdaccc2da9 req-9ec438e9-a41c-4438-b989-c6005581a4c2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:59.249477 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87de366d-94e3-4dbc-a0e2-d6cdaccc2da9 req-9ec438e9-a41c-4438-b989-c6005581a4c2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:59.255475 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87de366d-94e3-4dbc-a0e2-d6cdaccc2da9 req-9ec438e9-a41c-4438-b989-c6005581a4c2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:59.263653 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-e092cfa1-7c9c-4a3b-9291-a4a0dbb86510 None None] Set router 1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:29:59.263865 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-87de366d-94e3-4dbc-a0e2-d6cdaccc2da9 req-9ec438e9-a41c-4438-b989-c6005581a4c2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5431 time: 0.1419072 Dec 09 21:29:59.287260 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 723351f2-7c62-4bb5-aaad-288a6e26545f no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:29:59.317470 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 723351f2-7c62-4bb5-aaad-288a6e26545f {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:29:59.318073 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 723351f2-7c62-4bb5-aaad-288a6e26545f not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:29:59.364088 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-87de366d-94e3-4dbc-a0e2-d6cdaccc2da9 req-e1115406-7f27-4b48-a288-ce37f92c29cb tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0891254 Dec 09 21:29:59.366165 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:29:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-62f6b905-d8da-4cef-a5c5-47a416d81483 x-openstack-request-id: req-62f6b905-d8da-4cef-a5c5-47a416d81483 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:29:59.366459 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7ef6883d-9c98-4e81-b102-bc1197ac4a47", "tag": "90f16e74-f2e6-416e-a079-f205615a0d8e", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:29:59.366722 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-62f6b905-d8da-4cef-a5c5-47a416d81483 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:29:59.367159 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7ef6883d-9c98-4e81-b102-bc1197ac4a47', 'tag': '90f16e74-f2e6-416e-a079-f205615a0d8e', 'status': 'completed', 'code': 200} Dec 09 21:29:59.426294 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e047843d-721c-4d72-b0b4-1765a1c78d8a req-278920e6-9d41-4bf5-aacc-2118bedae19f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:59.428380 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e047843d-721c-4d72-b0b4-1765a1c78d8a req-278920e6-9d41-4bf5-aacc-2118bedae19f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 1098 time: 0.0544829 Dec 09 21:29:59.548440 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e047843d-721c-4d72-b0b4-1765a1c78d8a req-d7a4e021-39b4-4453-83f2-f81d2c209746 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:59.549929 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e047843d-721c-4d72-b0b4-1765a1c78d8a req-d7a4e021-39b4-4453-83f2-f81d2c209746 service neutron] 10.222.0.31 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 913 time: 0.1149790 Dec 09 21:29:59.603756 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e092cfa1-7c9c-4a3b-9291-a4a0dbb86510 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'name': 'tempest-ServerActionsTestJSON-1559985225-router', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242'}], 'enable_snat': True}, 'gw_port_id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:29:30Z', 'updated_at': '2021-12-09T21:29:37Z', 'revision_number': 4, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'gw_port': {'id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:d4:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1299, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:29:31Z', 'updated_at': '2021-12-09T21:29:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '221af2a9-94eb-44be-8e07-2d0f9a4d191b', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'floating_ip_address': '172.25.3.249', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'port_id': '90f16e74-f2e6-416e-a079-f205615a0d8e', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 1307, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'mac_address': 'fa:16:3e:69:c9:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ef6883d-9c98-4e81-b102-bc1197ac4a47', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:29:41Z', 'updated_at': '2021-12-09T21:29:58Z', 'revision_number': 1, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1ab9d8fe-6942-4722-90aa-1232fb6aab84', 'name': '', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'mac_address': 'fa:16:3e:3c:b2:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'device_owner': 'network:router_interface', 'standard_attr_id': 1300, 'fixed_ips': [{'subnet_id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:29:36Z', 'updated_at': '2021-12-09T21:29:41Z', 'revision_number': 5, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'subnets': [{'id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:59.664075 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e092cfa1-7c9c-4a3b-9291-a4a0dbb86510 None None] Checking router: 1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:29:59.674977 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e092cfa1-7c9c-4a3b-9291-a4a0dbb86510 None None] Routers {'1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:29:59.676567 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e092cfa1-7c9c-4a3b-9291-a4a0dbb86510 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:29:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:29:59.719089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e047843d-721c-4d72-b0b4-1765a1c78d8a req-a23e97b4-16aa-43c2-b368-f058ca8b884b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=90f16e74-f2e6-416e-a079-f205615a0d8e HTTP/1.1" status: 200 len: 1000 time: 0.1612816 Dec 09 21:29:59.864967 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-e092cfa1-7c9c-4a3b-9291-a4a0dbb86510 None None] Set router 1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:29:59.879916 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e047843d-721c-4d72-b0b4-1765a1c78d8a req-1ca30bb4-240e-4a92-a2bd-c3da646c0f31 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:59.882587 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e047843d-721c-4d72-b0b4-1765a1c78d8a req-1ca30bb4-240e-4a92-a2bd-c3da646c0f31 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 200 len: 851 time: 0.1551728 Dec 09 21:29:59.900051 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08c14cdb-ea65-40d2-a156-12a8008e84ac req-6ed665fc-141d-46e2-887e-eb3a0125a03d tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:29:59.908379 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-08c14cdb-ea65-40d2-a156-12a8008e84ac req-6ed665fc-141d-46e2-887e-eb3a0125a03d tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/ports?device_id=fec8d114-7ce3-465f-a037-5b16fce83357 HTTP/1.1" status: 200 len: 943 time: 0.0944772 Dec 09 21:29:59.955885 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device b066fd2a-040f-466e-9a26-d112946f9ecf details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:30:00.010413 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-08c14cdb-ea65-40d2-a156-12a8008e84ac req-e6ee3cd3-7b22-4ab6-8ca0-4658e68e3f1d tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/security-groups?id=d1f3d7b6-7fd9-4f73-b3cf-8eb30963c2a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0969112 Dec 09 21:30:00.036438 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e047843d-721c-4d72-b0b4-1765a1c78d8a req-928bb10e-daf8-4e5a-9d3c-9171eff1ed30 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:00.040193 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e047843d-721c-4d72-b0b4-1765a1c78d8a req-928bb10e-daf8-4e5a-9d3c-9171eff1ed30 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1494596 Dec 09 21:30:00.110962 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 675f510c-c35a-468e-b70b-4abb34188642 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:30:00.148752 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e047843d-721c-4d72-b0b4-1765a1c78d8a req-e17cfc19-dcae-46cf-b4b3-7de8f852f87e service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0960536 Dec 09 21:30:00.181968 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 675f510c-c35a-468e-b70b-4abb34188642 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:30:00.182566 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 675f510c-c35a-468e-b70b-4abb34188642 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:30:00.196501 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port b066fd2a-040f-466e-9a26-d112946f9ecf, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b066fd2a-040f-466e-9a26-d112946f9ecf,segment=NetworkSegment(a2c20e6d-42c4-4a87-8c3e-1d0138b5958f),segment_id=a2c20e6d-42c4-4a87-8c3e-1d0138b5958f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:00.220304 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'b066fd2a-040f-466e-9a26-d112946f9ecf', 'network_id': 'cbb87bc0-e3d4-44f3-aba2-8f506f7616a0', 'port_id': 'b066fd2a-040f-466e-9a26-d112946f9ecf', 'mac_address': 'fa:16:3e:1a:f0:e7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 142, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd23b9496-b001-4ab9-9cdc-44b02b1be59a', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:30:00.277862 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e092cfa1-7c9c-4a3b-9291-a4a0dbb86510 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'name': 'tempest-ServerActionsTestJSON-1559985225-router', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242'}], 'enable_snat': True}, 'gw_port_id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:29:30Z', 'updated_at': '2021-12-09T21:29:37Z', 'revision_number': 4, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'gw_port': {'id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:d4:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1299, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:29:31Z', 'updated_at': '2021-12-09T21:29:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '221af2a9-94eb-44be-8e07-2d0f9a4d191b', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'floating_ip_address': '172.25.3.249', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'port_id': '90f16e74-f2e6-416e-a079-f205615a0d8e', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 1307, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'mac_address': 'fa:16:3e:69:c9:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ef6883d-9c98-4e81-b102-bc1197ac4a47', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:29:41Z', 'updated_at': '2021-12-09T21:29:58Z', 'revision_number': 1, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1ab9d8fe-6942-4722-90aa-1232fb6aab84', 'name': '', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'mac_address': 'fa:16:3e:3c:b2:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'device_owner': 'network:router_interface', 'standard_attr_id': 1300, 'fixed_ips': [{'subnet_id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:29:36Z', 'updated_at': '2021-12-09T21:29:41Z', 'revision_number': 5, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'subnets': [{'id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:00.312300 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:00.316735 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e092cfa1-7c9c-4a3b-9291-a4a0dbb86510 None None] The sync data for ids ['1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'] in n-d-713301-27 is: [{'id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'name': 'tempest-ServerActionsTestJSON-1559985225-router', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242'}], 'enable_snat': True}, 'gw_port_id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:29:30Z', 'updated_at': '2021-12-09T21:29:37Z', 'revision_number': 4, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'gw_port': {'id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:d4:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1299, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:29:31Z', 'updated_at': '2021-12-09T21:29:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '221af2a9-94eb-44be-8e07-2d0f9a4d191b', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'floating_ip_address': '172.25.3.249', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'port_id': '90f16e74-f2e6-416e-a079-f205615a0d8e', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 1307, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'mac_address': 'fa:16:3e:69:c9:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ef6883d-9c98-4e81-b102-bc1197ac4a47', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:29:41Z', 'updated_at': '2021-12-09T21:29:58Z', 'revision_number': 1, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1ab9d8fe-6942-4722-90aa-1232fb6aab84', 'name': '', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'mac_address': 'fa:16:3e:3c:b2:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'device_owner': 'network:router_interface', 'standard_attr_id': 1300, 'fixed_ips': [{'subnet_id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:29:36Z', 'updated_at': '2021-12-09T21:29:41Z', 'revision_number': 5, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'subnets': [{'id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:30:00.337280 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b066fd2a-040f-466e-9a26-d112946f9ecf {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:30:00.372068 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port b066fd2a-040f-466e-9a26-d112946f9ecf, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b066fd2a-040f-466e-9a26-d112946f9ecf,segment=NetworkSegment(a2c20e6d-42c4-4a87-8c3e-1d0138b5958f),segment_id=a2c20e6d-42c4-4a87-8c3e-1d0138b5958f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:00.388336 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:00.408191 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e047843d-721c-4d72-b0b4-1765a1c78d8a req-e6fffbd9-77d7-4b1c-924a-abac4f58f653 service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2522326 Dec 09 21:30:00.487328 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=b066fd2a-040f-466e-9a26-d112946f9ecf,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:00.510785 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43492) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:00.600760 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a15400e-5995-4ec8-ab2e-72d1f0eef5ba req-ed584d5f-9055-4257-88b0-828f4f5f64f7 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:00.608680 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['b066fd2a-040f-466e-9a26-d112946f9ecf'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:30:00.618079 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a15400e-5995-4ec8-ab2e-72d1f0eef5ba req-ed584d5f-9055-4257-88b0-828f4f5f64f7 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:00.631679 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a15400e-5995-4ec8-ab2e-72d1f0eef5ba req-ed584d5f-9055-4257-88b0-828f4f5f64f7 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:00.638182 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a15400e-5995-4ec8-ab2e-72d1f0eef5ba req-ed584d5f-9055-4257-88b0-828f4f5f64f7 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:00.652680 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a15400e-5995-4ec8-ab2e-72d1f0eef5ba req-ed584d5f-9055-4257-88b0-828f4f5f64f7 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:00.665353 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a15400e-5995-4ec8-ab2e-72d1f0eef5ba req-ed584d5f-9055-4257-88b0-828f4f5f64f7 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:00.679676 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a15400e-5995-4ec8-ab2e-72d1f0eef5ba req-ed584d5f-9055-4257-88b0-828f4f5f64f7 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:00.691652 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7a15400e-5995-4ec8-ab2e-72d1f0eef5ba req-ed584d5f-9055-4257-88b0-828f4f5f64f7 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5431 time: 0.1990669 Dec 09 21:30:00.757268 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e90f67fa-21c9-4e6d-b2ff-8e1dd6cc6094 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:00.791728 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-692965d5-86c5-495a-986f-713e412e1a71 None None] New status for floating IP 221af2a9-94eb-44be-8e07-2d0f9a4d191b: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:30:00.864732 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7a15400e-5995-4ec8-ab2e-72d1f0eef5ba req-957661dc-bb28-425e-a683-8c09a33de5cd tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1706936 Dec 09 21:30:00.886033 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e90f67fa-21c9-4e6d-b2ff-8e1dd6cc6094 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:00.892926 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e90f67fa-21c9-4e6d-b2ff-8e1dd6cc6094 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:00.923173 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e90f67fa-21c9-4e6d-b2ff-8e1dd6cc6094 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e1151b63-70bc-4baa-b861-9b2d3fbaa91a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:00.955489 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e90f67fa-21c9-4e6d-b2ff-8e1dd6cc6094 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=adb97d297d454e088b9dc801f86da97b&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4408720 Dec 09 21:30:00.956652 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43504) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:01.015982 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7644d7b3-cd52-4b01-b367-7ccd33e57b57 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:01.042855 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7644d7b3-cd52-4b01-b367-7ccd33e57b57 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:01.118161 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7644d7b3-cd52-4b01-b367-7ccd33e57b57 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:01.121392 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7644d7b3-cd52-4b01-b367-7ccd33e57b57 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:01.122782 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7644d7b3-cd52-4b01-b367-7ccd33e57b57 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/e1151b63-70bc-4baa-b861-9b2d3fbaa91a HTTP/1.1" status: 204 len: 168 time: 0.1647439 Dec 09 21:30:01.131712 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7644d7b3-cd52-4b01-b367-7ccd33e57b57 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e1151b63-70bc-4baa-b861-9b2d3fbaa91a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:01.166303 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e9924b2-f113-493a-8a35-2531aecac885 req-a92b4995-a039-46e0-935d-cee1ad574be0 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:01.169191 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e9924b2-f113-493a-8a35-2531aecac885 req-a92b4995-a039-46e0-935d-cee1ad574be0 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/ports?device_id=fec8d114-7ce3-465f-a037-5b16fce83357 HTTP/1.1" status: 200 len: 944 time: 0.0809653 Dec 09 21:30:01.240906 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e9924b2-f113-493a-8a35-2531aecac885 req-8a983301-5203-4c8c-9d56-0f6232574cc0 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/security-groups?id=d1f3d7b6-7fd9-4f73-b3cf-8eb30963c2a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474341 Dec 09 21:30:01.280868 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:30:01.529454 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:01.543118 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f', 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c', 'port_id': '1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f', 'mac_address': 'fa:16:3e:07:b3:cb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 132, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '871c2dc1-486e-4fcf-a882-5a1394082fc5', 'ip_address': '10.1.1.197'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:30:01.583403 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:01.604031 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:30:01.625915 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:01.631055 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:01.632101 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 57519c10-1d02-4ce7-b4be-b37a7bd58b09 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:30:01.690498 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:01.720187 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 57519c10-1d02-4ce7-b4be-b37a7bd58b09, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=57519c10-1d02-4ce7-b4be-b37a7bd58b09,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:01.731585 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '57519c10-1d02-4ce7-b4be-b37a7bd58b09', 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c', 'port_id': '57519c10-1d02-4ce7-b4be-b37a7bd58b09', 'mac_address': 'fa:16:3e:fa:a8:4b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 132, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '871c2dc1-486e-4fcf-a882-5a1394082fc5', 'ip_address': '10.1.1.103'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:30:01.782257 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:01.802561 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 57519c10-1d02-4ce7-b4be-b37a7bd58b09 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:30:01.829168 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 57519c10-1d02-4ce7-b4be-b37a7bd58b09, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=57519c10-1d02-4ce7-b4be-b37a7bd58b09,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:01.836035 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:01.837107 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:30:01.859063 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43546) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:01.924694 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=57519c10-1d02-4ce7-b4be-b37a7bd58b09,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:01.957509 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device b066fd2a-040f-466e-9a26-d112946f9ecf up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:30:02.011630 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b6708dd4-0354-43fb-9f94-3194bf127ffc admin admin] Request body: {'network': {'name': 'tempest-ServerMetadataNegativeTestJSON-251008914-network', 'tenant_id': 'c2ee958ddfcb4d6c9715806fe7564854'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:02.038390 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a,segment=NetworkSegment(7cf32f95-b9ab-465b-889c-7d7de3246a6f),segment_id=7cf32f95-b9ab-465b-889c-7d7de3246a6f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:02.042674 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b6708dd4-0354-43fb-9f94-3194bf127ffc admin admin] Made reservation on behalf of c2ee958ddfcb4d6c9715806fe7564854 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:30:02.045668 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b6708dd4-0354-43fb-9f94-3194bf127ffc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:02.056474 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b6708dd4-0354-43fb-9f94-3194bf127ffc admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:02.058737 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a', 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5', 'port_id': '7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a', 'mac_address': 'fa:16:3e:52:a0:7e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 148, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd989acab-7cdc-482f-a350-344dd6e11873', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:30:02.082503 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f48afd7-2d29-4203-87cc-c1271206f130 req-b9993146-ed60-4158-b510-3bf51fe12038 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:02.089134 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f48afd7-2d29-4203-87cc-c1271206f130 req-b9993146-ed60-4158-b510-3bf51fe12038 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:02.096311 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f48afd7-2d29-4203-87cc-c1271206f130 req-b9993146-ed60-4158-b510-3bf51fe12038 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:02.104702 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f48afd7-2d29-4203-87cc-c1271206f130 req-b9993146-ed60-4158-b510-3bf51fe12038 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:02.114565 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f48afd7-2d29-4203-87cc-c1271206f130 req-b9993146-ed60-4158-b510-3bf51fe12038 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:02.123489 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f48afd7-2d29-4203-87cc-c1271206f130 req-b9993146-ed60-4158-b510-3bf51fe12038 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:02.130174 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:02.131946 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f48afd7-2d29-4203-87cc-c1271206f130 req-b9993146-ed60-4158-b510-3bf51fe12038 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:02.134193 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f48afd7-2d29-4203-87cc-c1271206f130 req-b9993146-ed60-4158-b510-3bf51fe12038 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5433 time: 0.1180270 Dec 09 21:30:02.140471 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port b066fd2a-040f-466e-9a26-d112946f9ecf completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:30:02.150118 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port b066fd2a-040f-466e-9a26-d112946f9ecf triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:02.150498 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:02.153079 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:30:02.175948 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a,segment=NetworkSegment(7cf32f95-b9ab-465b-889c-7d7de3246a6f),segment_id=7cf32f95-b9ab-465b-889c-7d7de3246a6f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:02.195723 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b6708dd4-0354-43fb-9f94-3194bf127ffc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:02.201626 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:02.201861 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b6708dd4-0354-43fb-9f94-3194bf127ffc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:02.215897 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 2c568c8f-47ca-4f47-ab71-187026ca02db details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:30:02.218683 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f48afd7-2d29-4203-87cc-c1271206f130 req-29f4e6df-2221-4238-9fcd-fb4493c4bcc1 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0738845 Dec 09 21:30:02.230290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b6708dd4-0354-43fb-9f94-3194bf127ffc admin admin] vlan segment allocate from pool success with {'vlan_id': 135, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:30:02.257565 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b6708dd4-0354-43fb-9f94-3194bf127ffc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:02.258371 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-b6708dd4-0354-43fb-9f94-3194bf127ffc admin admin] Added segment f3b15b89-832d-4313-a864-1edfab1a4b59 of type vlan for network 5b21d7bb-3cb6-4d1a-933f-9771c9a4e497 Dec 09 21:30:02.283664 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6708dd4-0354-43fb-9f94-3194bf127ffc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e654b672-7d47-4ee0-9e34-ab2f5987626f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:02.341933 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b6708dd4-0354-43fb-9f94-3194bf127ffc admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:02.374794 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b6708dd4-0354-43fb-9f94-3194bf127ffc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:02.376491 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b6708dd4-0354-43fb-9f94-3194bf127ffc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:02.377593 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b6708dd4-0354-43fb-9f94-3194bf127ffc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:02.399240 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:02.415358 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cedff798-47a2-403b-8b49-5ca32ec5d87f req-fe25e05b-9a65-436c-b21b-d8cd45e5c308 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:02.417380 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cedff798-47a2-403b-8b49-5ca32ec5d87f req-fe25e05b-9a65-436c-b21b-d8cd45e5c308 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/ports?device_id=fec8d114-7ce3-465f-a037-5b16fce83357 HTTP/1.1" status: 200 len: 944 time: 0.0723772 Dec 09 21:30:02.447336 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b6708dd4-0354-43fb-9f94-3194bf127ffc admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 893 time: 0.5864763 Dec 09 21:30:02.451824 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:02.452779 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43570) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:02.459015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c1cafcd7-bd89-46ac-b243-51b855841607 admin admin] Request body: {'subnet': {'network_id': '5b21d7bb-3cb6-4d1a-933f-9771c9a4e497', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerMetadataNegativeTestJSON-251008914-subnet', 'tenant_id': 'c2ee958ddfcb4d6c9715806fe7564854', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:02.497144 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fec8d114-7ce3-465f-a037-5b16fce83357', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b066fd2a-040f-466e-9a26-d112946f9ecf'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:30:02.499941 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ba7772a8-f9c6-4dc0-873c-f74e1c2a3d20" -d '{"events": [{"server_uuid": "fec8d114-7ce3-465f-a037-5b16fce83357", "name": "network-vif-plugged", "status": "completed", "tag": "b066fd2a-040f-466e-9a26-d112946f9ecf"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:30:02.504259 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c1cafcd7-bd89-46ac-b243-51b855841607 admin admin] Made reservation on behalf of c2ee958ddfcb4d6c9715806fe7564854 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:30:02.506680 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c1cafcd7-bd89-46ac-b243-51b855841607 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:02.512133 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 2c568c8f-47ca-4f47-ab71-187026ca02db, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=2c568c8f-47ca-4f47-ab71-187026ca02db,segment=NetworkSegment(a40eb34b-04cf-427f-a562-8a47c01a297b),segment_id=a40eb34b-04cf-427f-a562-8a47c01a297b)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:02.515531 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6708dd4-0354-43fb-9f94-3194bf127ffc admin admin] Pushing event updated for resources: {'Network': ['ID=5b21d7bb-3cb6-4d1a-933f-9771c9a4e497,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:02.538483 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 5b21d7bb-3cb6-4d1a-933f-9771c9a4e497 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:30:02.542690 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port b066fd2a-040f-466e-9a26-d112946f9ecf, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b066fd2a-040f-466e-9a26-d112946f9ecf,segment=NetworkSegment(a2c20e6d-42c4-4a87-8c3e-1d0138b5958f),segment_id=a2c20e6d-42c4-4a87-8c3e-1d0138b5958f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:02.554552 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cedff798-47a2-403b-8b49-5ca32ec5d87f req-e053f375-1aa2-4736-acc2-9610fdc5b383 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/security-groups?id=d1f3d7b6-7fd9-4f73-b3cf-8eb30963c2a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1303289 Dec 09 21:30:02.565056 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:02.580458 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '2c568c8f-47ca-4f47-ab71-187026ca02db', 'network_id': 'ae9d25d5-c9a2-4627-a465-8324b17541d9', 'port_id': '2c568c8f-47ca-4f47-ab71-187026ca02db', 'mac_address': 'fa:16:3e:f8:f8:5e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 145, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2b4dff83-a3e7-4d10-a901-43c21154e5da', 'ip_address': '10.2.2.200'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:30:02.667126 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:30:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e786ff87-df3a-487b-a40d-14c0795ee220 x-openstack-request-id: req-e786ff87-df3a-487b-a40d-14c0795ee220 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:30:02.667449 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fec8d114-7ce3-465f-a037-5b16fce83357", "name": "network-vif-plugged", "status": "completed", "tag": "b066fd2a-040f-466e-9a26-d112946f9ecf", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:30:02.667753 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e786ff87-df3a-487b-a40d-14c0795ee220 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:30:02.668187 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fec8d114-7ce3-465f-a037-5b16fce83357', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b066fd2a-040f-466e-9a26-d112946f9ecf', 'code': 200} Dec 09 21:30:02.747023 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:02.760931 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=b066fd2a-040f-466e-9a26-d112946f9ecf,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:02.766777 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2c568c8f-47ca-4f47-ab71-187026ca02db {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:30:02.799540 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 2c568c8f-47ca-4f47-ab71-187026ca02db, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=2c568c8f-47ca-4f47-ab71-187026ca02db,segment=NetworkSegment(a40eb34b-04cf-427f-a562-8a47c01a297b),segment_id=a40eb34b-04cf-427f-a562-8a47c01a297b)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:02.809018 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:02.809717 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 38f97951-e872-4c24-947f-934429895ad3 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:30:02.914941 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 38f97951-e872-4c24-947f-934429895ad3, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=38f97951-e872-4c24-947f-934429895ad3,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:02.928955 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=2c568c8f-47ca-4f47-ab71-187026ca02db,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:02.956606 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '38f97951-e872-4c24-947f-934429895ad3', 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c', 'port_id': '38f97951-e872-4c24-947f-934429895ad3', 'mac_address': 'fa:16:3e:2a:c2:77', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 132, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '871c2dc1-486e-4fcf-a882-5a1394082fc5', 'ip_address': '10.1.1.40'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:30:02.964920 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0efd3106-cd79-49e2-a6b3-839c9d3ff476 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:03.002955 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:03.023372 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 38f97951-e872-4c24-947f-934429895ad3 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:30:03.058368 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 38f97951-e872-4c24-947f-934429895ad3, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=38f97951-e872-4c24-947f-934429895ad3,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:03.066758 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:03.068579 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 18d9d7fa-fedf-4844-90ef-6757eb984ae2 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:30:03.124793 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c1cafcd7-bd89-46ac-b243-51b855841607 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:03.151031 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 18d9d7fa-fedf-4844-90ef-6757eb984ae2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=18d9d7fa-fedf-4844-90ef-6757eb984ae2,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:03.158992 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=38f97951-e872-4c24-947f-934429895ad3,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:03.166223 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '18d9d7fa-fedf-4844-90ef-6757eb984ae2', 'network_id': '69c5e9e4-78c6-4a6b-9b16-9f1da643282c', 'port_id': '18d9d7fa-fedf-4844-90ef-6757eb984ae2', 'mac_address': 'fa:16:3e:fe:49:c7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 132, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '871c2dc1-486e-4fcf-a882-5a1394082fc5', 'ip_address': '10.1.1.107'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:30:03.203804 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1cafcd7-bd89-46ac-b243-51b855841607 admin admin] Pushing event updated for resources: {'Subnet': ['ID=bb9cf677-90a0-4039-87cf-7b2af98aa6ae,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:03.207269 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aef185d0-eab5-4d59-942d-96adfeba5b39 req-17151128-15bf-4a82-b27b-6d9e28bbcb9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:03.209070 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aef185d0-eab5-4d59-942d-96adfeba5b39 req-17151128-15bf-4a82-b27b-6d9e28bbcb9c service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=fec8d114-7ce3-465f-a037-5b16fce83357 HTTP/1.1" status: 200 len: 1097 time: 0.0961428 Dec 09 21:30:03.212370 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:03.229384 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 18d9d7fa-fedf-4844-90ef-6757eb984ae2 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:30:03.247085 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1cafcd7-bd89-46ac-b243-51b855841607 admin admin] Checking segment: {'id': 'f3b15b89-832d-4313-a864-1edfab1a4b59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '5b21d7bb-3cb6-4d1a-933f-9771c9a4e497'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:30:03.248234 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1cafcd7-bd89-46ac-b243-51b855841607 admin admin] Network hostable DHCP agents. Network: 5b21d7bb-3cb6-4d1a-933f-9771c9a4e497, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:30:03.254968 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 18d9d7fa-fedf-4844-90ef-6757eb984ae2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=18d9d7fa-fedf-4844-90ef-6757eb984ae2,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:03.260953 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:03.261877 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device f6c2c656-c5c9-4a38-baf6-3924df82937d details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:30:03.281807 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aef185d0-eab5-4d59-942d-96adfeba5b39 req-d1c20d57-b0f0-41d5-90c2-99b89b0756d2 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=d1f3d7b6-7fd9-4f73-b3cf-8eb30963c2a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0653367 Dec 09 21:30:03.289576 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1cafcd7-bd89-46ac-b243-51b855841607 admin admin] Network 5b21d7bb-3cb6-4d1a-933f-9771c9a4e497 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:30:03.303361 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-c1cafcd7-bd89-46ac-b243-51b855841607 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 5b21d7bb-3cb6-4d1a-933f-9771c9a4e497) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:30:03.309709 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1cafcd7-bd89-46ac-b243-51b855841607 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:03.310379 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c1cafcd7-bd89-46ac-b243-51b855841607 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:03.331801 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-767a0b71-ca2d-4c47-8fb9-0708f6ed50b2 None None] Network 5b21d7bb-3cb6-4d1a-933f-9771c9a4e497 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:30:03.341994 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c1cafcd7-bd89-46ac-b243-51b855841607 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 857 time: 0.8872674 Dec 09 21:30:03.365782 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port f6c2c656-c5c9-4a38-baf6-3924df82937d, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=f6c2c656-c5c9-4a38-baf6-3924df82937d,segment=NetworkSegment(a40eb34b-04cf-427f-a562-8a47c01a297b),segment_id=a40eb34b-04cf-427f-a562-8a47c01a297b)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:03.377184 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=18d9d7fa-fedf-4844-90ef-6757eb984ae2,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:03.428409 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c472eac0-8b95-494c-b869-e9ed711e8eda req-a0bcd271-c474-4704-8fab-a7084cabf92e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:03.435066 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c472eac0-8b95-494c-b869-e9ed711e8eda req-a0bcd271-c474-4704-8fab-a7084cabf92e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:03.441781 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c472eac0-8b95-494c-b869-e9ed711e8eda req-a0bcd271-c474-4704-8fab-a7084cabf92e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:03.448636 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c472eac0-8b95-494c-b869-e9ed711e8eda req-a0bcd271-c474-4704-8fab-a7084cabf92e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:03.455211 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c472eac0-8b95-494c-b869-e9ed711e8eda req-a0bcd271-c474-4704-8fab-a7084cabf92e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:03.461757 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'f6c2c656-c5c9-4a38-baf6-3924df82937d', 'network_id': 'ae9d25d5-c9a2-4627-a465-8324b17541d9', 'port_id': 'f6c2c656-c5c9-4a38-baf6-3924df82937d', 'mac_address': 'fa:16:3e:76:01:77', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 145, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2b4dff83-a3e7-4d10-a901-43c21154e5da', 'ip_address': '10.2.2.100'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:30:03.464302 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c472eac0-8b95-494c-b869-e9ed711e8eda req-a0bcd271-c474-4704-8fab-a7084cabf92e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:03.470543 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c472eac0-8b95-494c-b869-e9ed711e8eda req-a0bcd271-c474-4704-8fab-a7084cabf92e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:03.478974 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c472eac0-8b95-494c-b869-e9ed711e8eda req-a0bcd271-c474-4704-8fab-a7084cabf92e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5437 time: 0.1188242 Dec 09 21:30:03.513014 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a251b946-b81d-4007-a2ba-2b847e447500 None None] Network 5b21d7bb-3cb6-4d1a-933f-9771c9a4e497 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:30:03.569190 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c472eac0-8b95-494c-b869-e9ed711e8eda req-ef1f94c7-e623-4b91-aa4a-59297d0805ee tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0890589 Dec 09 21:30:03.632777 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:03.675816 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f6c2c656-c5c9-4a38-baf6-3924df82937d {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:30:03.697924 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port f6c2c656-c5c9-4a38-baf6-3924df82937d, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=f6c2c656-c5c9-4a38-baf6-3924df82937d,segment=NetworkSegment(a40eb34b-04cf-427f-a562-8a47c01a297b),segment_id=a40eb34b-04cf-427f-a562-8a47c01a297b)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:03.703722 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:03.757856 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=f6c2c656-c5c9-4a38-baf6-3924df82937d,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:03.832525 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-822773b9-c5ba-43e1-bfed-0369538389d1 req-b30fc119-0255-4437-bd12-e25f66aa1b71 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:03.834116 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-822773b9-c5ba-43e1-bfed-0369538389d1 req-b30fc119-0255-4437-bd12-e25f66aa1b71 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/ports?device_id=fec8d114-7ce3-465f-a037-5b16fce83357 HTTP/1.1" status: 200 len: 945 time: 0.0882907 Dec 09 21:30:03.929723 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-3717b559-6f7c-41bf-834d-35aecddc86cc tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:03.931217 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-3717b559-6f7c-41bf-834d-35aecddc86cc tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/networks?id=5b21d7bb-3cb6-4d1a-933f-9771c9a4e497 HTTP/1.1" status: 200 len: 820 time: 0.1540196 Dec 09 21:30:03.934727 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-822773b9-c5ba-43e1-bfed-0369538389d1 req-cd52f9f5-de1b-43e4-8cf7-bf6eea628274 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/security-groups?id=d1f3d7b6-7fd9-4f73-b3cf-8eb30963c2a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0743527 Dec 09 21:30:03.946965 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-0d340bad-9c03-4b14-82e3-fe501a52ba8e tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/quotas/c2ee958ddfcb4d6c9715806fe7564854 HTTP/1.1" status: 200 len: 375 time: 0.0096369 Dec 09 21:30:03.981942 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-fa3ccfa0-e0d6-4f9c-aa5d-aefed20a33fc tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=c2ee958ddfcb4d6c9715806fe7564854&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0279067 Dec 09 21:30:03.994530 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-f4941007-fb72-465d-9017-f58f5ba638eb service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:30:03.995532 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-f4941007-fb72-465d-9017-f58f5ba638eb service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0056021 Dec 09 21:30:04.095316 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-b9ecee51-f993-4804-ac3b-b1cac05707e8 service neutron] 10.222.0.13 "GET /v2.0/networks/5b21d7bb-3cb6-4d1a-933f-9771c9a4e497?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0929744 Dec 09 21:30:04.204101 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-4cb10eb1-48cf-44ec-9bed-6da7182313b0 service neutron] 10.222.0.13 "GET /v2.0/networks/5b21d7bb-3cb6-4d1a-933f-9771c9a4e497?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0999968 Dec 09 21:30:04.427711 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-49f73594-9fbe-47bc-9295-20578811f047 req-c6e778dc-2d4f-4ee6-850d-eba274f23db2 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/ports?device_id=cd9b8f35-7873-4aef-8507-811168c7aafe HTTP/1.1" status: 200 len: 210 time: 0.0320568 Dec 09 21:30:04.442054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:30:04.470828 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:30:04.504014 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['f6c2c656-c5c9-4a38-baf6-3924df82937d'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:30:04.540937 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['18d9d7fa-fedf-4844-90ef-6757eb984ae2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:30:04.837433 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-543ad10e-7b2b-4b9f-9fbd-347d9703dc50 req-9ad0aac1-73a2-492d-ba3a-56d24463989e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:04.844288 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-543ad10e-7b2b-4b9f-9fbd-347d9703dc50 req-9ad0aac1-73a2-492d-ba3a-56d24463989e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:04.850940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-543ad10e-7b2b-4b9f-9fbd-347d9703dc50 req-9ad0aac1-73a2-492d-ba3a-56d24463989e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:04.858793 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-543ad10e-7b2b-4b9f-9fbd-347d9703dc50 req-9ad0aac1-73a2-492d-ba3a-56d24463989e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:04.865906 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-543ad10e-7b2b-4b9f-9fbd-347d9703dc50 req-9ad0aac1-73a2-492d-ba3a-56d24463989e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:04.873245 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-543ad10e-7b2b-4b9f-9fbd-347d9703dc50 req-9ad0aac1-73a2-492d-ba3a-56d24463989e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:04.889024 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-543ad10e-7b2b-4b9f-9fbd-347d9703dc50 req-9ad0aac1-73a2-492d-ba3a-56d24463989e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:04.892639 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-543ad10e-7b2b-4b9f-9fbd-347d9703dc50 req-9ad0aac1-73a2-492d-ba3a-56d24463989e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5438 time: 0.1479318 Dec 09 21:30:05.029085 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-543ad10e-7b2b-4b9f-9fbd-347d9703dc50 req-85976947-3b93-4718-8921-3dbdfa36a2b7 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1242554 Dec 09 21:30:05.148163 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b6b72d7-1210-457c-9c8f-6ed1e2fbb5ca req-f1e62d11-15df-4e51-bef3-f5e7c8a66eec tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:05.159619 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8b6b72d7-1210-457c-9c8f-6ed1e2fbb5ca req-f1e62d11-15df-4e51-bef3-f5e7c8a66eec tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/ports?device_id=fec8d114-7ce3-465f-a037-5b16fce83357 HTTP/1.1" status: 200 len: 945 time: 0.1381953 Dec 09 21:30:05.237221 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8b6b72d7-1210-457c-9c8f-6ed1e2fbb5ca req-73062f21-512f-4779-b89b-9f0acad4e503 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/security-groups?id=d1f3d7b6-7fd9-4f73-b3cf-8eb30963c2a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0764577 Dec 09 21:30:05.504967 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0e9ea3e9-6b5a-4dfa-8969-a22c4b4ddd5c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:05.629646 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ebccf15f-144d-4c32-be94-aba5317e4fd1 req-ad4018d4-b793-46b4-9c14-da0c408a2715 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/ports?device_id=cd9b8f35-7873-4aef-8507-811168c7aafe HTTP/1.1" status: 200 len: 210 time: 0.0348303 Dec 09 21:30:05.655393 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed3a2521-33e7-46a0-aa62-c41da6fcfdc8 req-02af6b83-cb39-4626-bf4a-0d071033af58 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:05.656989 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ed3a2521-33e7-46a0-aa62-c41da6fcfdc8 req-02af6b83-cb39-4626-bf4a-0d071033af58 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/ports?device_id=fec8d114-7ce3-465f-a037-5b16fce83357 HTTP/1.1" status: 200 len: 945 time: 0.0883589 Dec 09 21:30:05.668944 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['2c568c8f-47ca-4f47-ab71-187026ca02db'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:30:05.750702 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['57519c10-1d02-4ce7-b4be-b37a7bd58b09'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:30:05.785495 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['38f97951-e872-4c24-947f-934429895ad3'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:30:05.818983 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ed3a2521-33e7-46a0-aa62-c41da6fcfdc8 req-0153fcaa-e10d-4dd3-82ee-aa390b5e0b35 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/security-groups?id=d1f3d7b6-7fd9-4f73-b3cf-8eb30963c2a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1546435 Dec 09 21:30:05.960825 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-a8299c08-ef12-4b6d-9afe-9af902709985 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:05.962926 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-a8299c08-ef12-4b6d-9afe-9af902709985 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.31 "GET /v2.0/networks?id=5b21d7bb-3cb6-4d1a-933f-9771c9a4e497 HTTP/1.1" status: 200 len: 820 time: 0.2656796 Dec 09 21:30:05.978837 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-733ff9e6-d500-4f28-8316-f8b04991f4d0 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Request body: {'port': {'device_id': 'cd9b8f35-7873-4aef-8507-811168c7aafe', 'network_id': '5b21d7bb-3cb6-4d1a-933f-9771c9a4e497', 'admin_state_up': True, 'tenant_id': 'c2ee958ddfcb4d6c9715806fe7564854'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:06.115149 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-733ff9e6-d500-4f28-8316-f8b04991f4d0 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Made reservation on behalf of c2ee958ddfcb4d6c9715806fe7564854 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:30:06.121223 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-733ff9e6-d500-4f28-8316-f8b04991f4d0 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:06.261805 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73d51802-7749-4963-b763-4f243854ef26 req-bd08aed2-153b-40cf-9c0d-62c573a55470 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:06.269593 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73d51802-7749-4963-b763-4f243854ef26 req-bd08aed2-153b-40cf-9c0d-62c573a55470 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:06.287837 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73d51802-7749-4963-b763-4f243854ef26 req-bd08aed2-153b-40cf-9c0d-62c573a55470 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:06.294310 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73d51802-7749-4963-b763-4f243854ef26 req-bd08aed2-153b-40cf-9c0d-62c573a55470 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:06.300339 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73d51802-7749-4963-b763-4f243854ef26 req-bd08aed2-153b-40cf-9c0d-62c573a55470 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:06.306503 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73d51802-7749-4963-b763-4f243854ef26 req-bd08aed2-153b-40cf-9c0d-62c573a55470 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:06.313754 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73d51802-7749-4963-b763-4f243854ef26 req-bd08aed2-153b-40cf-9c0d-62c573a55470 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:06.321966 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-73d51802-7749-4963-b763-4f243854ef26 req-bd08aed2-153b-40cf-9c0d-62c573a55470 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5438 time: 0.1683271 Dec 09 21:30:06.450170 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-73d51802-7749-4963-b763-4f243854ef26 req-e0a994f6-3b2d-4038-bc10-e6f97b7e475c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1272798 Dec 09 21:30:06.452177 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-733ff9e6-d500-4f28-8316-f8b04991f4d0 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Allocated IP 172.20.0.6 (5b21d7bb-3cb6-4d1a-933f-9771c9a4e497/bb9cf677-90a0-4039-87cf-7b2af98aa6ae/ecdf312e-8304-4283-bcef-f24f46f66eee) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:30:06.596192 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:06.688773 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-733ff9e6-d500-4f28-8316-f8b04991f4d0 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:06.762099 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b76bf9b-ffe0-4124-af79-925404c055d3 req-e082ca4c-729f-458e-9731-bcfaec4cabad tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/ports?device_id=cd9b8f35-7873-4aef-8507-811168c7aafe HTTP/1.1" status: 200 len: 210 time: 0.0366404 Dec 09 21:30:06.771392 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-733ff9e6-d500-4f28-8316-f8b04991f4d0 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:06.834637 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-733ff9e6-d500-4f28-8316-f8b04991f4d0 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Network 5b21d7bb-3cb6-4d1a-933f-9771c9a4e497 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:30:06.839147 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-733ff9e6-d500-4f28-8316-f8b04991f4d0 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:30:06.844210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-733ff9e6-d500-4f28-8316-f8b04991f4d0 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:30:06.887570 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-733ff9e6-d500-4f28-8316-f8b04991f4d0 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Pushing event updated for resources: {'Port': ['ID=ecdf312e-8304-4283-bcef-f24f46f66eee,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:06.943627 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-733ff9e6-d500-4f28-8316-f8b04991f4d0 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:06.944303 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-733ff9e6-d500-4f28-8316-f8b04991f4d0 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:07.047743 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-733ff9e6-d500-4f28-8316-f8b04991f4d0 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0735385 Dec 09 21:30:07.081477 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-87ddcc2e-31a0-4044-8158-5e0fbcd2bbfb service neutron] Request body: {'port': {'device_id': 'cd9b8f35-7873-4aef-8507-811168c7aafe', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:07.088733 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea37a293-61ba-4e94-9a6b-52581ca6d811 req-517845a9-badb-49ae-9efd-45d036145d93 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:07.093798 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ea37a293-61ba-4e94-9a6b-52581ca6d811 req-517845a9-badb-49ae-9efd-45d036145d93 tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.31 "GET /v2.0/ports?device_id=fec8d114-7ce3-465f-a037-5b16fce83357 HTTP/1.1" status: 200 len: 945 time: 0.1577430 Dec 09 21:30:07.181592 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6d74b8b-9389-4009-9761-0eec453471c9 req-107278f9-c253-413a-ba7e-fd19de13b8ae tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:07.183242 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6d74b8b-9389-4009-9761-0eec453471c9 req-107278f9-c253-413a-ba7e-fd19de13b8ae tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/ports?device_id=fec8d114-7ce3-465f-a037-5b16fce83357 HTTP/1.1" status: 200 len: 945 time: 0.2273436 Dec 09 21:30:07.184077 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-87ddcc2e-31a0-4044-8158-5e0fbcd2bbfb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:07.242260 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-ea37a293-61ba-4e94-9a6b-52581ca6d811 req-b296ac73-c323-46f5-928c-301481f8e65c tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Deleting port b066fd2a-040f-466e-9a26-d112946f9ecf {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:30:07.243335 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ea37a293-61ba-4e94-9a6b-52581ca6d811 req-b296ac73-c323-46f5-928c-301481f8e65c tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:07.319582 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6d74b8b-9389-4009-9761-0eec453471c9 req-3ab0106b-def3-48d9-8344-2b0703bcdd2c tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/security-groups?id=d1f3d7b6-7fd9-4f73-b3cf-8eb30963c2a7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1240709 Dec 09 21:30:07.458271 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-ea37a293-61ba-4e94-9a6b-52581ca6d811 req-b296ac73-c323-46f5-928c-301481f8e65c tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] For port b066fd2a-040f-466e-9a26-d112946f9ecf, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b066fd2a-040f-466e-9a26-d112946f9ecf,segment=NetworkSegment(a2c20e6d-42c4-4a87-8c3e-1d0138b5958f),segment_id=a2c20e6d-42c4-4a87-8c3e-1d0138b5958f)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:07.460547 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ea37a293-61ba-4e94-9a6b-52581ca6d811 req-b296ac73-c323-46f5-928c-301481f8e65c tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:07.487567 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-ea37a293-61ba-4e94-9a6b-52581ca6d811 req-b296ac73-c323-46f5-928c-301481f8e65c tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Calling delete_port for b066fd2a-040f-466e-9a26-d112946f9ecf owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:30:07.658060 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52be6fc3-0209-460b-a75d-2a222b6766eb req-6f69ad88-8a71-427b-8568-825b24b0a357 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:07.665421 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52be6fc3-0209-460b-a75d-2a222b6766eb req-6f69ad88-8a71-427b-8568-825b24b0a357 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:07.672039 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52be6fc3-0209-460b-a75d-2a222b6766eb req-6f69ad88-8a71-427b-8568-825b24b0a357 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:07.680072 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52be6fc3-0209-460b-a75d-2a222b6766eb req-6f69ad88-8a71-427b-8568-825b24b0a357 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:07.683169 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ea37a293-61ba-4e94-9a6b-52581ca6d811 req-b296ac73-c323-46f5-928c-301481f8e65c tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:07.687211 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52be6fc3-0209-460b-a75d-2a222b6766eb req-6f69ad88-8a71-427b-8568-825b24b0a357 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:07.693480 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52be6fc3-0209-460b-a75d-2a222b6766eb req-6f69ad88-8a71-427b-8568-825b24b0a357 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:07.696200 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['b066fd2a-040f-466e-9a26-d112946f9ecf'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:30:07.699772 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52be6fc3-0209-460b-a75d-2a222b6766eb req-6f69ad88-8a71-427b-8568-825b24b0a357 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:07.708425 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52be6fc3-0209-460b-a75d-2a222b6766eb req-6f69ad88-8a71-427b-8568-825b24b0a357 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5438 time: 0.1630902 Dec 09 21:30:07.721336 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b296ac73-c323-46f5-928c-301481f8e65c tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Pushing event deleted for resources: {'Port': ['ID=b066fd2a-040f-466e-9a26-d112946f9ecf,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:07.743687 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:30:07.812131 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-ea37a293-61ba-4e94-9a6b-52581ca6d811 req-b296ac73-c323-46f5-928c-301481f8e65c tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] No DVR routers for this DVR port b066fd2a-040f-466e-9a26-d112946f9ecf on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:30:07.818629 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ea37a293-61ba-4e94-9a6b-52581ca6d811 req-b296ac73-c323-46f5-928c-301481f8e65c tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:07.820482 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:30:07.830829 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ea37a293-61ba-4e94-9a6b-52581ca6d811 req-b296ac73-c323-46f5-928c-301481f8e65c tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.31 "DELETE /v2.0/ports/b066fd2a-040f-466e-9a26-d112946f9ecf HTTP/1.1" status: 204 len: 173 time: 0.7249818 Dec 09 21:30:07.831988 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fec8d114-7ce3-465f-a037-5b16fce83357', 'name': 'network-vif-deleted', 'tag': 'b066fd2a-040f-466e-9a26-d112946f9ecf'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:30:07.836780 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:07.837220 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:07.839915 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6259549f-fa00-4084-8aad-46e7c051ebcd" -d '{"events": [{"server_uuid": "fec8d114-7ce3-465f-a037-5b16fce83357", "name": "network-vif-deleted", "tag": "b066fd2a-040f-466e-9a26-d112946f9ecf"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:30:07.863024 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52be6fc3-0209-460b-a75d-2a222b6766eb req-d8bdf011-3753-452d-9914-4fc982dde840 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1500838 Dec 09 21:30:07.897462 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-87ddcc2e-31a0-4044-8158-5e0fbcd2bbfb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ecdf312e-8304-4283-bcef-f24f46f66eee {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:30:07.948674 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:30:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b18374d3-52f0-4448-a0d6-c75142a35ea6 x-openstack-request-id: req-b18374d3-52f0-4448-a0d6-c75142a35ea6 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:30:07.949086 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fec8d114-7ce3-465f-a037-5b16fce83357", "name": "network-vif-deleted", "tag": "b066fd2a-040f-466e-9a26-d112946f9ecf", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:30:07.949591 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-b18374d3-52f0-4448-a0d6-c75142a35ea6 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:30:07.950207 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fec8d114-7ce3-465f-a037-5b16fce83357', 'name': 'network-vif-deleted', 'tag': 'b066fd2a-040f-466e-9a26-d112946f9ecf', 'status': 'completed', 'code': 200} Dec 09 21:30:07.952934 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-87ddcc2e-31a0-4044-8158-5e0fbcd2bbfb service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:07.974852 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:08.004133 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e58ae2d-bab2-4853-9aaf-135d69243877 req-0739ebd0-8759-4624-96e7-d303a60ee2c9 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:08.006421 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e58ae2d-bab2-4853-9aaf-135d69243877 req-0739ebd0-8759-4624-96e7-d303a60ee2c9 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/ports?device_id=cd9b8f35-7873-4aef-8507-811168c7aafe HTTP/1.1" status: 200 len: 931 time: 0.1158426 Dec 09 21:30:08.007695 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-87ddcc2e-31a0-4044-8158-5e0fbcd2bbfb service neutron] Transition to ACTIVE for port object ecdf312e-8304-4283-bcef-f24f46f66eee will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:30:08.015007 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-87ddcc2e-31a0-4044-8158-5e0fbcd2bbfb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:08.063974 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:08.095243 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:30:08.098612 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b2ffcef1-5e4b-4c8c-ac8a-6fbfa3158599" -d '{"events": [{"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-plugged", "status": "completed", "tag": "7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:30:08.119249 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a,segment=NetworkSegment(7cf32f95-b9ab-465b-889c-7d7de3246a6f),segment_id=7cf32f95-b9ab-465b-889c-7d7de3246a6f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:08.128381 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:08.129863 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device f6c2c656-c5c9-4a38-baf6-3924df82937d up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:30:08.161426 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87ddcc2e-31a0-4044-8158-5e0fbcd2bbfb service neutron] Pushing event updated for resources: {'Port': ['ID=ecdf312e-8304-4283-bcef-f24f46f66eee,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:08.208623 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e58ae2d-bab2-4853-9aaf-135d69243877 req-23f1f084-4e82-413d-b8b5-9e5e92b3fbc8 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/security-groups?id=e654b672-7d47-4ee0-9e34-ab2f5987626f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1889622 Dec 09 21:30:08.243331 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:30:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a69c64af-84fb-4e4f-b0ff-804c1ab30a83 x-openstack-request-id: req-a69c64af-84fb-4e4f-b0ff-804c1ab30a83 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:30:08.243850 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-plugged", "status": "completed", "tag": "7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:30:08.244199 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a69c64af-84fb-4e4f-b0ff-804c1ab30a83 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:30:08.244691 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a', 'code': 200} Dec 09 21:30:08.269497 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port f6c2c656-c5c9-4a38-baf6-3924df82937d completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:30:08.277134 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port f6c2c656-c5c9-4a38-baf6-3924df82937d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:08.277908 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:08.356020 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-87ddcc2e-31a0-4044-8158-5e0fbcd2bbfb service neutron] Attempting to bind port ecdf312e-8304-4283-bcef-f24f46f66eee on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:08.356370 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-87ddcc2e-31a0-4044-8158-5e0fbcd2bbfb service neutron] Attempting to bind port ecdf312e-8304-4283-bcef-f24f46f66eee by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'f3b15b89-832d-4313-a864-1edfab1a4b59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '5b21d7bb-3cb6-4d1a-933f-9771c9a4e497'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:08.356768 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-87ddcc2e-31a0-4044-8158-5e0fbcd2bbfb service neutron] Attempting to bind port ecdf312e-8304-4283-bcef-f24f46f66eee on network 5b21d7bb-3cb6-4d1a-933f-9771c9a4e497 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:08.358303 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:08.373910 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-87ddcc2e-31a0-4044-8158-5e0fbcd2bbfb service neutron] Port ecdf312e-8304-4283-bcef-f24f46f66eee on network 5b21d7bb-3cb6-4d1a-933f-9771c9a4e497 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:30:08.374247 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-87ddcc2e-31a0-4044-8158-5e0fbcd2bbfb service neutron] Attempting to bind port ecdf312e-8304-4283-bcef-f24f46f66eee on network 5b21d7bb-3cb6-4d1a-933f-9771c9a4e497 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:08.387549 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-87ddcc2e-31a0-4044-8158-5e0fbcd2bbfb service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 29, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:30:08.387950 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-87ddcc2e-31a0-4044-8158-5e0fbcd2bbfb service neutron] Checking segment: {'id': 'f3b15b89-832d-4313-a864-1edfab1a4b59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '5b21d7bb-3cb6-4d1a-933f-9771c9a4e497'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:30:08.388334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-87ddcc2e-31a0-4044-8158-5e0fbcd2bbfb service neutron] Bound using segment: {'id': 'f3b15b89-832d-4313-a864-1edfab1a4b59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '5b21d7bb-3cb6-4d1a-933f-9771c9a4e497'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:30:08.388768 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-87ddcc2e-31a0-4044-8158-5e0fbcd2bbfb service neutron] Bound port: ecdf312e-8304-4283-bcef-f24f46f66eee, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f3b15b89-832d-4313-a864-1edfab1a4b59', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '5b21d7bb-3cb6-4d1a-933f-9771c9a4e497'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:30:08.389126 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-87ddcc2e-31a0-4044-8158-5e0fbcd2bbfb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:08.412021 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:08.471544 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port f6c2c656-c5c9-4a38-baf6-3924df82937d, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=f6c2c656-c5c9-4a38-baf6-3924df82937d,segment=NetworkSegment(a40eb34b-04cf-427f-a562-8a47c01a297b),segment_id=a40eb34b-04cf-427f-a562-8a47c01a297b)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:08.479835 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:08.480908 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:30:08.484258 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-87ddcc2e-31a0-4044-8158-5e0fbcd2bbfb service neutron] For port ecdf312e-8304-4283-bcef-f24f46f66eee, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:30:08.488113 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-87ddcc2e-31a0-4044-8158-5e0fbcd2bbfb service neutron] For port ecdf312e-8304-4283-bcef-f24f46f66eee, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ecdf312e-8304-4283-bcef-f24f46f66eee,segment=NetworkSegment(f3b15b89-832d-4313-a864-1edfab1a4b59),segment_id=f3b15b89-832d-4313-a864-1edfab1a4b59)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:30:08.499954 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-87ddcc2e-31a0-4044-8158-5e0fbcd2bbfb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:08.612794 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87ddcc2e-31a0-4044-8158-5e0fbcd2bbfb service neutron] Pushing event updated for resources: {'Port': ['ID=ecdf312e-8304-4283-bcef-f24f46f66eee,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:08.634346 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=f6c2c656-c5c9-4a38-baf6-3924df82937d,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:08.642698 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:30:08.647279 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e4a0f626-2120-41fe-a62c-51125679d3a6 req-fe7f7138-325f-4583-babe-ba5b3dba9e9e tempest-ServerAddressesNegativeTestJSON-255293403 tempest-ServerAddressesNegativeTestJSON-255293403-project] 10.222.0.13 "GET /v2.0/ports?device_id=fec8d114-7ce3-465f-a037-5b16fce83357 HTTP/1.1" status: 200 len: 210 time: 0.0973308 Dec 09 21:30:08.648958 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-87ddcc2e-31a0-4044-8158-5e0fbcd2bbfb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:08.649751 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-87ddcc2e-31a0-4044-8158-5e0fbcd2bbfb service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:08.651954 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-87ddcc2e-31a0-4044-8158-5e0fbcd2bbfb service neutron] 10.222.0.31 "PUT /v2.0/ports/ecdf312e-8304-4283-bcef-f24f46f66eee HTTP/1.1" status: 200 len: 1092 time: 1.5935428 Dec 09 21:30:08.652718 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cd9b8f35-7873-4aef-8507-811168c7aafe', 'tag': 'ecdf312e-8304-4283-bcef-f24f46f66eee'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:30:08.655538 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-94043de8-2af1-4970-92bd-542fe2ac74cb" -d '{"events": [{"name": "network-changed", "server_uuid": "cd9b8f35-7873-4aef-8507-811168c7aafe", "tag": "ecdf312e-8304-4283-bcef-f24f46f66eee"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:30:08.666242 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:08.666641 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:08.701877 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:30:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-78167c0a-bf5c-4b1c-b659-69b74160bfef x-openstack-request-id: req-78167c0a-bf5c-4b1c-b659-69b74160bfef {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:30:08.702814 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cd9b8f35-7873-4aef-8507-811168c7aafe", "tag": "ecdf312e-8304-4283-bcef-f24f46f66eee", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:30:08.703260 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-78167c0a-bf5c-4b1c-b659-69b74160bfef {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:30:08.704088 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cd9b8f35-7873-4aef-8507-811168c7aafe', 'tag': 'ecdf312e-8304-4283-bcef-f24f46f66eee', 'status': 'completed', 'code': 200} Dec 09 21:30:08.800863 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-a3bb9c5a-2f0b-4cd5-a27f-6ced35d2d9cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:08.804481 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-a3bb9c5a-2f0b-4cd5-a27f-6ced35d2d9cd service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=c2ee958ddfcb4d6c9715806fe7564854&device_id=cd9b8f35-7873-4aef-8507-811168c7aafe HTTP/1.1" status: 200 len: 1095 time: 0.0921228 Dec 09 21:30:08.824597 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:08.866748 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:08.873811 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:08.904074 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-bcbe174f-1626-44f6-a185-e164453f685b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=ecdf312e-8304-4283-bcef-f24f46f66eee HTTP/1.1" status: 200 len: 217 time: 0.0897243 Dec 09 21:30:08.946950 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:08.988448 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-43cbfef3-e7dd-4018-93b3-9d21b4c90a3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:08.990202 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-43cbfef3-e7dd-4018-93b3-9d21b4c90a3b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=bb9cf677-90a0-4039-87cf-7b2af98aa6ae HTTP/1.1" status: 200 len: 860 time: 0.0766041 Dec 09 21:30:09.034414 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-cec2b57e-a5c7-4c14-b517-583e7519b433 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5b21d7bb-3cb6-4d1a-933f-9771c9a4e497&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0374999 Dec 09 21:30:09.141282 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a191f013-8b1e-4889-8aa7-b69324b396c9 req-7f1f6a4a-bffc-4c54-893d-8774ec9d75e4 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:09.148215 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a191f013-8b1e-4889-8aa7-b69324b396c9 req-7f1f6a4a-bffc-4c54-893d-8774ec9d75e4 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:09.155041 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a191f013-8b1e-4889-8aa7-b69324b396c9 req-7f1f6a4a-bffc-4c54-893d-8774ec9d75e4 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:09.161643 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a191f013-8b1e-4889-8aa7-b69324b396c9 req-7f1f6a4a-bffc-4c54-893d-8774ec9d75e4 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:09.168783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a191f013-8b1e-4889-8aa7-b69324b396c9 req-7f1f6a4a-bffc-4c54-893d-8774ec9d75e4 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:09.177501 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a191f013-8b1e-4889-8aa7-b69324b396c9 req-7f1f6a4a-bffc-4c54-893d-8774ec9d75e4 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:09.184224 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a191f013-8b1e-4889-8aa7-b69324b396c9 req-7f1f6a4a-bffc-4c54-893d-8774ec9d75e4 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:09.186774 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a191f013-8b1e-4889-8aa7-b69324b396c9 req-7f1f6a4a-bffc-4c54-893d-8774ec9d75e4 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5441 time: 0.1782148 Dec 09 21:30:09.244949 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-936b0d77-5408-4b40-8413-ac265f4968c8 service neutron] 10.222.0.31 "GET /v2.0/networks/5b21d7bb-3cb6-4d1a-933f-9771c9a4e497?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1943197 Dec 09 21:30:09.303997 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a191f013-8b1e-4889-8aa7-b69324b396c9 req-664925a2-5fa7-451e-8d1d-b14d732a12ec tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1105142 Dec 09 21:30:09.420575 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c50f618-56fd-490a-923c-b002e0f33bb6 req-38f6e54b-f670-4660-af16-a5ba200fa4af service neutron] 10.222.0.31 "GET /v2.0/networks/5b21d7bb-3cb6-4d1a-933f-9771c9a4e497?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1635246 Dec 09 21:30:09.430391 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33e776b2-fe90-48de-a7f3-b0003d062299 req-ce8f7c33-fc86-4106-9ac4-99d50ec013da tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:09.432107 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-33e776b2-fe90-48de-a7f3-b0003d062299 req-ce8f7c33-fc86-4106-9ac4-99d50ec013da tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/ports?device_id=cd9b8f35-7873-4aef-8507-811168c7aafe HTTP/1.1" status: 200 len: 943 time: 0.1254923 Dec 09 21:30:09.539517 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-33e776b2-fe90-48de-a7f3-b0003d062299 req-65147524-4b0b-49d3-8973-9328e9c38237 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/security-groups?id=e654b672-7d47-4ee0-9e34-ab2f5987626f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1009581 Dec 09 21:30:09.544352 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94043de8-2af1-4970-92bd-542fe2ac74cb req-1440cf68-f7ad-43b1-83e1-ff28e77c7785 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:09.545843 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94043de8-2af1-4970-92bd-542fe2ac74cb req-1440cf68-f7ad-43b1-83e1-ff28e77c7785 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=c2ee958ddfcb4d6c9715806fe7564854&device_id=cd9b8f35-7873-4aef-8507-811168c7aafe HTTP/1.1" status: 200 len: 1095 time: 0.0658092 Dec 09 21:30:09.598893 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:09.666493 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94043de8-2af1-4970-92bd-542fe2ac74cb req-953143e5-0a09-4255-8694-5b3c54af3d6e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:09.668111 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94043de8-2af1-4970-92bd-542fe2ac74cb req-953143e5-0a09-4255-8694-5b3c54af3d6e service neutron] 10.222.0.31 "GET /v2.0/networks?id=5b21d7bb-3cb6-4d1a-933f-9771c9a4e497 HTTP/1.1" status: 200 len: 921 time: 0.1141140 Dec 09 21:30:09.715976 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 18d9d7fa-fedf-4844-90ef-6757eb984ae2 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:30:09.754020 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43734) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:09.778061 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94043de8-2af1-4970-92bd-542fe2ac74cb req-fe443c2b-03ff-4d83-9f8c-6d3e6bc9dc2c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=ecdf312e-8304-4283-bcef-f24f46f66eee HTTP/1.1" status: 200 len: 217 time: 0.1011052 Dec 09 21:30:09.814732 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 18d9d7fa-fedf-4844-90ef-6757eb984ae2 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:30:09.829279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 18d9d7fa-fedf-4844-90ef-6757eb984ae2 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:09.832963 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:09.846873 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94043de8-2af1-4970-92bd-542fe2ac74cb req-25cd3184-674f-4808-afe1-d313b04db06b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:09.848777 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94043de8-2af1-4970-92bd-542fe2ac74cb req-25cd3184-674f-4808-afe1-d313b04db06b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=bb9cf677-90a0-4039-87cf-7b2af98aa6ae HTTP/1.1" status: 200 len: 860 time: 0.0599258 Dec 09 21:30:09.849232 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-16fbdd2b-e88f-4295-a6ff-b2d2be03a4d6 admin admin] Deleting subnet d23b9496-b001-4ab9-9cdc-44b02b1be59a {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:30:09.860260 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16fbdd2b-e88f-4295-a6ff-b2d2be03a4d6 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:09.924711 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94043de8-2af1-4970-92bd-542fe2ac74cb req-1a69e65f-f15f-49a6-9b7d-b16a8f6f2ae1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5b21d7bb-3cb6-4d1a-933f-9771c9a4e497&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0674257 Dec 09 21:30:09.926566 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16fbdd2b-e88f-4295-a6ff-b2d2be03a4d6 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:09.975721 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16fbdd2b-e88f-4295-a6ff-b2d2be03a4d6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:10.045466 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:10.063383 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16fbdd2b-e88f-4295-a6ff-b2d2be03a4d6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:10.092936 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 18d9d7fa-fedf-4844-90ef-6757eb984ae2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=18d9d7fa-fedf-4844-90ef-6757eb984ae2,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:10.098447 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:10.099474 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 2c568c8f-47ca-4f47-ab71-187026ca02db up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:30:10.127491 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16fbdd2b-e88f-4295-a6ff-b2d2be03a4d6 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:10.139240 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-16fbdd2b-e88f-4295-a6ff-b2d2be03a4d6 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/d23b9496-b001-4ab9-9cdc-44b02b1be59a HTTP/1.1" status: 204 len: 168 time: 0.3839436 Dec 09 21:30:10.140485 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16fbdd2b-e88f-4295-a6ff-b2d2be03a4d6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d23b9496-b001-4ab9-9cdc-44b02b1be59a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:10.143163 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43738) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:10.190013 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=18d9d7fa-fedf-4844-90ef-6757eb984ae2,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:10.207279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 2c568c8f-47ca-4f47-ab71-187026ca02db completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:30:10.213757 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 2c568c8f-47ca-4f47-ab71-187026ca02db triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:10.214169 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:10.225181 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-a25fc027-d2ad-489a-ae6e-e3af819b1f2f service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 665 time: 0.1344607 Dec 09 21:30:10.248370 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a43f960-6fdc-4ad5-a4fa-abb57b9458d6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:10.258695 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94043de8-2af1-4970-92bd-542fe2ac74cb req-5554b207-586d-4446-944a-ddbb82d6b164 service neutron] 10.222.0.31 "GET /v2.0/networks/5b21d7bb-3cb6-4d1a-933f-9771c9a4e497?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3229792 Dec 09 21:30:10.269165 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f6c2c656-c5c9-4a38-baf6-3924df82937d'}, {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f'}, {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '18d9d7fa-fedf-4844-90ef-6757eb984ae2'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:30:10.274646 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-300259bd-0c46-4cbf-b617-a015a6211ab9" -d '{"events": [{"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-plugged", "status": "completed", "tag": "f6c2c656-c5c9-4a38-baf6-3924df82937d"}, {"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-plugged", "status": "completed", "tag": "1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f"}, {"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-plugged", "status": "completed", "tag": "18d9d7fa-fedf-4844-90ef-6757eb984ae2"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:30:10.342935 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:10.381416 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 525 Content-Type: application/json Date: Thu, 09 Dec 2021 21:30:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dd29364e-f07a-4519-856a-744993501c11 x-openstack-request-id: req-dd29364e-f07a-4519-856a-744993501c11 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:30:10.383197 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-plugged", "status": "completed", "tag": "f6c2c656-c5c9-4a38-baf6-3924df82937d", "code": 200}, {"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-plugged", "status": "completed", "tag": "1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f", "code": 200}, {"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-plugged", "status": "completed", "tag": "18d9d7fa-fedf-4844-90ef-6757eb984ae2", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:30:10.383582 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-dd29364e-f07a-4519-856a-744993501c11 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:30:10.384074 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f6c2c656-c5c9-4a38-baf6-3924df82937d', 'code': 200} Dec 09 21:30:10.389036 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f', 'code': 200} Dec 09 21:30:10.389427 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '18d9d7fa-fedf-4844-90ef-6757eb984ae2', 'code': 200} Dec 09 21:30:10.440027 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 2c568c8f-47ca-4f47-ab71-187026ca02db, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=2c568c8f-47ca-4f47-ab71-187026ca02db,segment=NetworkSegment(a40eb34b-04cf-427f-a562-8a47c01a297b),segment_id=a40eb34b-04cf-427f-a562-8a47c01a297b)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:10.448891 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:10.450927 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 57519c10-1d02-4ce7-b4be-b37a7bd58b09 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:30:10.629715 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-da126ac8-8607-4a25-9516-1a7dc6d0ebc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:10.630640 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-da126ac8-8607-4a25-9516-1a7dc6d0ebc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:10.631277 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-da126ac8-8607-4a25-9516-1a7dc6d0ebc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:10.631940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-da126ac8-8607-4a25-9516-1a7dc6d0ebc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:10.632566 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-da126ac8-8607-4a25-9516-1a7dc6d0ebc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:10.633329 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-da126ac8-8607-4a25-9516-1a7dc6d0ebc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:10.634823 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-da126ac8-8607-4a25-9516-1a7dc6d0ebc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:10.637367 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-da126ac8-8607-4a25-9516-1a7dc6d0ebc4 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=03e962eb7f5e4325a7c08c8b1e2a4cea&device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 6498 time: 0.3004951 Dec 09 21:30:10.643822 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94043de8-2af1-4970-92bd-542fe2ac74cb req-2338d6bc-14cc-4924-a449-558d152ed85f service neutron] 10.222.0.31 "GET /v2.0/networks/5b21d7bb-3cb6-4d1a-933f-9771c9a4e497?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3786283 Dec 09 21:30:10.659913 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=2c568c8f-47ca-4f47-ab71-187026ca02db,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:10.671375 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 57519c10-1d02-4ce7-b4be-b37a7bd58b09 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:30:10.685887 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 57519c10-1d02-4ce7-b4be-b37a7bd58b09 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:10.686337 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:10.690961 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4518cc3-aadc-4f75-8bf2-4eb520cb4c44 req-11b7323a-1880-4d54-86d3-a7789983e243 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:10.709610 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4518cc3-aadc-4f75-8bf2-4eb520cb4c44 req-11b7323a-1880-4d54-86d3-a7789983e243 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:10.728876 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4518cc3-aadc-4f75-8bf2-4eb520cb4c44 req-11b7323a-1880-4d54-86d3-a7789983e243 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:10.744287 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4518cc3-aadc-4f75-8bf2-4eb520cb4c44 req-11b7323a-1880-4d54-86d3-a7789983e243 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:10.764517 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4518cc3-aadc-4f75-8bf2-4eb520cb4c44 req-11b7323a-1880-4d54-86d3-a7789983e243 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:10.777720 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4518cc3-aadc-4f75-8bf2-4eb520cb4c44 req-11b7323a-1880-4d54-86d3-a7789983e243 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:10.798787 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4518cc3-aadc-4f75-8bf2-4eb520cb4c44 req-11b7323a-1880-4d54-86d3-a7789983e243 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:10.811876 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d4518cc3-aadc-4f75-8bf2-4eb520cb4c44 req-11b7323a-1880-4d54-86d3-a7789983e243 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5443 time: 0.2944901 Dec 09 21:30:10.962093 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:10.992490 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a43f960-6fdc-4ad5-a4fa-abb57b9458d6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:11.044817 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 57519c10-1d02-4ce7-b4be-b37a7bd58b09, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=57519c10-1d02-4ce7-b4be-b37a7bd58b09,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:11.047501 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-8a43f960-6fdc-4ad5-a4fa-abb57b9458d6 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cbb87bc0-e3d4-44f3-aba2-8f506f7616a0']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:11.057913 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:11.058937 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:30:11.059894 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 38f97951-e872-4c24-947f-934429895ad3 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:30:11.098563 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-8a43f960-6fdc-4ad5-a4fa-abb57b9458d6 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a2c20e6d-42c4-4a87-8c3e-1d0138b5958f') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:11.105506 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-8a43f960-6fdc-4ad5-a4fa-abb57b9458d6 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a2c20e6d-42c4-4a87-8c3e-1d0138b5958f') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:11.138454 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a43f960-6fdc-4ad5-a4fa-abb57b9458d6 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:11.142855 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d4518cc3-aadc-4f75-8bf2-4eb520cb4c44 req-cf0474f5-b213-4e40-97ba-8bb3d270b426 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.3231518 Dec 09 21:30:11.163789 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a43f960-6fdc-4ad5-a4fa-abb57b9458d6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:11.170485 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8a43f960-6fdc-4ad5-a4fa-abb57b9458d6 admin admin] Releasing vlan 142 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:30:11.170911 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a43f960-6fdc-4ad5-a4fa-abb57b9458d6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:11.197022 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=57519c10-1d02-4ce7-b4be-b37a7bd58b09,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:11.215119 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 38f97951-e872-4c24-947f-934429895ad3 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:30:11.221112 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 38f97951-e872-4c24-947f-934429895ad3 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:11.221979 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:11.238148 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-3fe8f34a-d56a-44fc-899e-77a85adbdd30 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:11.239427 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-3fe8f34a-d56a-44fc-899e-77a85adbdd30 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:11.240890 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-3fe8f34a-d56a-44fc-899e-77a85adbdd30 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:11.246576 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-3fe8f34a-d56a-44fc-899e-77a85adbdd30 service neutron] 10.222.0.10 "GET /v2.0/networks?id=f0373886-3db8-47eb-af65-78244497171e&id=a859e4ba-764a-41c0-982d-5bf79a2797a1&id=a859e4ba-764a-41c0-982d-5bf79a2797a1&id=a859e4ba-764a-41c0-982d-5bf79a2797a1&id=a859e4ba-764a-41c0-982d-5bf79a2797a1&id=a133a939-2827-4fe6-81f5-14715631c0ec&id=a133a939-2827-4fe6-81f5-14715631c0ec HTTP/1.1" status: 200 len: 2293 time: 0.4292684 Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:30:11.289533 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:30:11.294005 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a43f960-6fdc-4ad5-a4fa-abb57b9458d6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:11.312939 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a43f960-6fdc-4ad5-a4fa-abb57b9458d6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:11.316682 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8a43f960-6fdc-4ad5-a4fa-abb57b9458d6 admin admin] 10.222.0.13 "DELETE /v2.0/networks/cbb87bc0-e3d4-44f3-aba2-8f506f7616a0 HTTP/1.1" status: 204 len: 168 time: 1.1722751 Dec 09 21:30:11.317688 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a43f960-6fdc-4ad5-a4fa-abb57b9458d6 admin admin] Pushing event deleted for resources: {'Network': ['ID=cbb87bc0-e3d4-44f3-aba2-8f506f7616a0,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:11.346052 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:11.401223 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 38f97951-e872-4c24-947f-934429895ad3, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=38f97951-e872-4c24-947f-934429895ad3,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:11.406138 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:11.485070 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43760) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:11.490898 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac16a54f-d5bd-4eac-a242-97e02516fa0f req-03640c1e-84d6-4911-86ac-92d665d1ce03 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:11.494558 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac16a54f-d5bd-4eac-a242-97e02516fa0f req-03640c1e-84d6-4911-86ac-92d665d1ce03 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/ports?device_id=cd9b8f35-7873-4aef-8507-811168c7aafe HTTP/1.1" status: 200 len: 943 time: 0.2979157 Dec 09 21:30:11.507755 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-0497d520-e0cb-4074-8bdb-f3e9c67b5b16 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=90180a85-620b-470e-b808-b635138111be HTTP/1.1" status: 200 len: 1002 time: 0.2234468 Dec 09 21:30:11.529028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=38f97951-e872-4c24-947f-934429895ad3,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:11.580796 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b8826c7f-79eb-4aa8-9537-08c780602deb admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=396a9c42822e4e8d8a7907c4ec96ed68&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0912540 Dec 09 21:30:11.582211 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43762) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:11.612106 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-00769193-d6aa-4c8e-9b25-96ae04350c1e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:11.613752 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-00769193-d6aa-4c8e-9b25-96ae04350c1e service neutron] 10.222.0.10 "GET /v2.0/subnets?id=65df7637-0210-4526-a5dd-a692c26062b4 HTTP/1.1" status: 200 len: 851 time: 0.0970716 Dec 09 21:30:11.692000 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac16a54f-d5bd-4eac-a242-97e02516fa0f req-2d607365-cff6-4a7f-885f-0b95bd563a24 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/security-groups?id=e654b672-7d47-4ee0-9e34-ab2f5987626f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1871693 Dec 09 21:30:11.706136 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-571e24c2-3656-49e7-b272-f56ab5f49e7e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:11.708790 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-571e24c2-3656-49e7-b272-f56ab5f49e7e service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=f0373886-3db8-47eb-af65-78244497171e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0867262 Dec 09 21:30:11.711011 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e878abc2-091e-4339-976a-cade5bb55db7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:11.738977 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e878abc2-091e-4339-976a-cade5bb55db7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:11.810006 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e878abc2-091e-4339-976a-cade5bb55db7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:11.817501 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e878abc2-091e-4339-976a-cade5bb55db7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:11.821823 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e878abc2-091e-4339-976a-cade5bb55db7 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/d1f3d7b6-7fd9-4f73-b3cf-8eb30963c2a7 HTTP/1.1" status: 204 len: 168 time: 0.2394979 Dec 09 21:30:11.832698 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e878abc2-091e-4339-976a-cade5bb55db7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d1f3d7b6-7fd9-4f73-b3cf-8eb30963c2a7,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:11.870212 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-990f93e2-d137-4818-8c66-4cf9c221b9b7 service neutron] 10.222.0.10 "GET /v2.0/networks/f0373886-3db8-47eb-af65-78244497171e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1505404 Dec 09 21:30:12.009021 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device b066fd2a-040f-466e-9a26-d112946f9ecf no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:30:12.020619 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-606c84ac-5de4-479d-a81a-83b116fe69f1 service neutron] 10.222.0.10 "GET /v2.0/networks/f0373886-3db8-47eb-af65-78244497171e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1433094 Dec 09 21:30:12.053842 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: b066fd2a-040f-466e-9a26-d112946f9ecf {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:30:12.055652 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device b066fd2a-040f-466e-9a26-d112946f9ecf not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:30:12.094235 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-a3320f8b-e490-457c-be5f-2eb510d034a9 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.81&port_id=1e946a47-f496-445b-964b-618881eab263 HTTP/1.1" status: 200 len: 217 time: 0.0653946 Dec 09 21:30:12.171538 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-17d70d84-db51-4a31-9bce-c52326c478d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:12.173513 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-17d70d84-db51-4a31-9bce-c52326c478d2 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=a894075b-fa9f-4a27-9782-e476e86f74e0 HTTP/1.1" status: 200 len: 797 time: 0.0713625 Dec 09 21:30:12.247225 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-44c5b172-766b-4192-b1e6-99541277f55b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:12.249266 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-44c5b172-766b-4192-b1e6-99541277f55b service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a859e4ba-764a-41c0-982d-5bf79a2797a1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0675595 Dec 09 21:30:12.390458 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2c568c8f-47ca-4f47-ab71-187026ca02db'}, {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '57519c10-1d02-4ce7-b4be-b37a7bd58b09'}, {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '38f97951-e872-4c24-947f-934429895ad3'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:30:12.392955 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-232caec1-d218-4779-a4e2-2a9e3b4b1b55" -d '{"events": [{"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-plugged", "status": "completed", "tag": "2c568c8f-47ca-4f47-ab71-187026ca02db"}, {"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-plugged", "status": "completed", "tag": "57519c10-1d02-4ce7-b4be-b37a7bd58b09"}, {"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-plugged", "status": "completed", "tag": "38f97951-e872-4c24-947f-934429895ad3"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:30:12.474121 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-e94b958d-5a78-424f-ab60-714467d52126 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2162564 Dec 09 21:30:12.567484 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 525 Content-Type: application/json Date: Thu, 09 Dec 2021 21:30:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3f8ef54d-6a9d-453e-a83e-2254dcbc596e x-openstack-request-id: req-3f8ef54d-6a9d-453e-a83e-2254dcbc596e {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:30:12.567895 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-plugged", "status": "completed", "tag": "2c568c8f-47ca-4f47-ab71-187026ca02db", "code": 200}, {"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-plugged", "status": "completed", "tag": "57519c10-1d02-4ce7-b4be-b37a7bd58b09", "code": 200}, {"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-plugged", "status": "completed", "tag": "38f97951-e872-4c24-947f-934429895ad3", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:30:12.568218 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-3f8ef54d-6a9d-453e-a83e-2254dcbc596e {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:30:12.568852 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2c568c8f-47ca-4f47-ab71-187026ca02db', 'code': 200} Dec 09 21:30:12.568974 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '57519c10-1d02-4ce7-b4be-b37a7bd58b09', 'code': 200} Dec 09 21:30:12.569398 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '38f97951-e872-4c24-947f-934429895ad3', 'code': 200} Dec 09 21:30:12.733547 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ae87e1e-6149-447d-ac18-ee5c50eee9c8 req-738b970a-03a6-438b-8a43-96ba39f0b946 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:12.739786 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ae87e1e-6149-447d-ac18-ee5c50eee9c8 req-738b970a-03a6-438b-8a43-96ba39f0b946 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:12.745967 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ae87e1e-6149-447d-ac18-ee5c50eee9c8 req-738b970a-03a6-438b-8a43-96ba39f0b946 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:12.753159 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ae87e1e-6149-447d-ac18-ee5c50eee9c8 req-738b970a-03a6-438b-8a43-96ba39f0b946 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:12.779500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ae87e1e-6149-447d-ac18-ee5c50eee9c8 req-738b970a-03a6-438b-8a43-96ba39f0b946 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:12.796984 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ae87e1e-6149-447d-ac18-ee5c50eee9c8 req-738b970a-03a6-438b-8a43-96ba39f0b946 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:12.799911 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3aa49e7-84e1-483d-96de-f1ba094c8bb2 req-fe42b805-8efb-4375-aecd-04a9e5e54010 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:12.800398 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3aa49e7-84e1-483d-96de-f1ba094c8bb2 req-fe42b805-8efb-4375-aecd-04a9e5e54010 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:12.800844 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3aa49e7-84e1-483d-96de-f1ba094c8bb2 req-fe42b805-8efb-4375-aecd-04a9e5e54010 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:12.801296 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3aa49e7-84e1-483d-96de-f1ba094c8bb2 req-fe42b805-8efb-4375-aecd-04a9e5e54010 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:12.809328 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3aa49e7-84e1-483d-96de-f1ba094c8bb2 req-fe42b805-8efb-4375-aecd-04a9e5e54010 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:12.810288 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3aa49e7-84e1-483d-96de-f1ba094c8bb2 req-fe42b805-8efb-4375-aecd-04a9e5e54010 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:12.811028 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3aa49e7-84e1-483d-96de-f1ba094c8bb2 req-fe42b805-8efb-4375-aecd-04a9e5e54010 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:12.818281 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ae87e1e-6149-447d-ac18-ee5c50eee9c8 req-738b970a-03a6-438b-8a43-96ba39f0b946 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:12.819658 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f3aa49e7-84e1-483d-96de-f1ba094c8bb2 req-fe42b805-8efb-4375-aecd-04a9e5e54010 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 6509 time: 0.1525211 Dec 09 21:30:12.820343 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ae87e1e-6149-447d-ac18-ee5c50eee9c8 req-738b970a-03a6-438b-8a43-96ba39f0b946 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5445 time: 0.3445184 Dec 09 21:30:12.909610 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f3aa49e7-84e1-483d-96de-f1ba094c8bb2 req-0fe8d1f4-9a66-4675-b615-c9c3e9a420b3 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=ae1d5335-d417-46c6-9564-e81ad355759f&id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0803187 Dec 09 21:30:12.945187 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-4c827e4d-e620-4534-93f8-b2652d322952 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4548793 Dec 09 21:30:13.033109 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ae87e1e-6149-447d-ac18-ee5c50eee9c8 req-4f805ffb-e156-48e7-81fa-0b99808809ab tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1858590 Dec 09 21:30:13.073946 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cc9c78e-b427-4b65-b997-145f006f6830 req-26a682f7-026e-4bef-9b45-b8cc49cb0337 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:13.090502 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4cc9c78e-b427-4b65-b997-145f006f6830 req-26a682f7-026e-4bef-9b45-b8cc49cb0337 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/ports?device_id=cd9b8f35-7873-4aef-8507-811168c7aafe HTTP/1.1" status: 200 len: 943 time: 0.1167176 Dec 09 21:30:13.128719 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43804) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:13.350701 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b064c03e-7c43-44d1-b177-adb465aebacd admin admin] Request body: {'network': {'name': 'tempest-ServerRescueTestJSONUnderV235-1609818858-network', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:13.419887 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b064c03e-7c43-44d1-b177-adb465aebacd admin admin] Made reservation on behalf of 0f8295f4c3534e24a63938170ba2425e for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:30:13.422884 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b064c03e-7c43-44d1-b177-adb465aebacd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:13.437979 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b064c03e-7c43-44d1-b177-adb465aebacd admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:13.581760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43814) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:13.614591 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b064c03e-7c43-44d1-b177-adb465aebacd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:13.628105 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b064c03e-7c43-44d1-b177-adb465aebacd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:13.640919 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b064c03e-7c43-44d1-b177-adb465aebacd admin admin] vlan segment allocate from pool success with {'vlan_id': 129, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:30:13.651411 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b064c03e-7c43-44d1-b177-adb465aebacd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:13.651739 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-b064c03e-7c43-44d1-b177-adb465aebacd admin admin] Added segment 758500a8-fda8-49cf-a84c-a7e78098b9e8 of type vlan for network deef6d86-d3bd-4711-b0fe-ebca0c9737aa Dec 09 21:30:13.700671 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b064c03e-7c43-44d1-b177-adb465aebacd admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:13.756068 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b064c03e-7c43-44d1-b177-adb465aebacd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=25073bae-9c1b-4f21-941c-9dcae7db554c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:13.760125 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b064c03e-7c43-44d1-b177-adb465aebacd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:13.761095 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b064c03e-7c43-44d1-b177-adb465aebacd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:13.761964 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b064c03e-7c43-44d1-b177-adb465aebacd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:13.796110 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b064c03e-7c43-44d1-b177-adb465aebacd admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 893 time: 0.6623886 Dec 09 21:30:13.812704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43820) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:13.815515 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-d8fe54e3-4439-436b-af4e-67334f61de4f service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.31&port_id=145a0cde-0fe5-4163-a063-0fdfe42f243b HTTP/1.1" status: 200 len: 217 time: 0.6868055 Dec 09 21:30:13.820412 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-9cb4066c-9bc4-4be2-b96e-28798f03a9e7 admin admin] Request body: {'subnet': {'network_id': 'deef6d86-d3bd-4711-b0fe-ebca0c9737aa', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueTestJSONUnderV235-1609818858-subnet', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:13.828026 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ce95395-b14a-4bcb-a3c7-82a56400fac0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:13.908037 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4cc9c78e-b427-4b65-b997-145f006f6830 req-03b18010-eb26-4f50-863d-959053cdc4d1 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/security-groups?id=e654b672-7d47-4ee0-9e34-ab2f5987626f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.8163095 Dec 09 21:30:13.918229 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-dfa6eab9-6ae3-47be-9344-5c42ab8b3ba2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:13.921302 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-dfa6eab9-6ae3-47be-9344-5c42ab8b3ba2 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=a894075b-fa9f-4a27-9782-e476e86f74e0 HTTP/1.1" status: 200 len: 797 time: 0.0904779 Dec 09 21:30:13.924982 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b064c03e-7c43-44d1-b177-adb465aebacd admin admin] Pushing event updated for resources: {'Network': ['ID=deef6d86-d3bd-4711-b0fe-ebca0c9737aa,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:13.936110 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network deef6d86-d3bd-4711-b0fe-ebca0c9737aa details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:30:13.961526 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9cb4066c-9bc4-4be2-b96e-28798f03a9e7 admin admin] Made reservation on behalf of 0f8295f4c3534e24a63938170ba2425e for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:30:13.964678 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cb4066c-9bc4-4be2-b96e-28798f03a9e7 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:13.976105 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-ba5c84ed-7dcd-4923-aea5-8ad71da2975b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:13.977874 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-ba5c84ed-7dcd-4923-aea5-8ad71da2975b service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a859e4ba-764a-41c0-982d-5bf79a2797a1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0493472 Dec 09 21:30:14.020336 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device ecdf312e-8304-4283-bcef-f24f46f66eee details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:30:14.098228 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-aff9df94-84b7-4a4e-b508-efb28d4aa174 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1123488 Dec 09 21:30:14.126408 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ce95395-b14a-4bcb-a3c7-82a56400fac0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:14.134345 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ce95395-b14a-4bcb-a3c7-82a56400fac0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:14.175951 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port ecdf312e-8304-4283-bcef-f24f46f66eee, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ecdf312e-8304-4283-bcef-f24f46f66eee,segment=NetworkSegment(f3b15b89-832d-4313-a864-1edfab1a4b59),segment_id=f3b15b89-832d-4313-a864-1edfab1a4b59)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:14.192586 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'ecdf312e-8304-4283-bcef-f24f46f66eee', 'network_id': '5b21d7bb-3cb6-4d1a-933f-9771c9a4e497', 'port_id': 'ecdf312e-8304-4283-bcef-f24f46f66eee', 'mac_address': 'fa:16:3e:4a:09:d1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 135, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bb9cf677-90a0-4039-87cf-7b2af98aa6ae', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:30:14.224309 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1ce95395-b14a-4bcb-a3c7-82a56400fac0 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=50a16c75fb144e42bb63a5d97e688ed3&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6414156 Dec 09 21:30:14.228796 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43826) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:14.238394 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ce95395-b14a-4bcb-a3c7-82a56400fac0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=894009d5-1024-4bb2-9835-0039650ae414,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:14.242418 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cb4066c-9bc4-4be2-b96e-28798f03a9e7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:14.296157 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cb4066c-9bc4-4be2-b96e-28798f03a9e7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=86b80e39-7de5-4454-807b-0a1be07d2de3,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:14.313446 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-abf55799-1094-4712-a94c-245552fa28ae service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2057388 Dec 09 21:30:14.316455 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:14.350725 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ecdf312e-8304-4283-bcef-f24f46f66eee {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:30:14.362985 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9cb4066c-9bc4-4be2-b96e-28798f03a9e7 admin admin] Checking segment: {'id': '758500a8-fda8-49cf-a84c-a7e78098b9e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'deef6d86-d3bd-4711-b0fe-ebca0c9737aa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:30:14.363771 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9cb4066c-9bc4-4be2-b96e-28798f03a9e7 admin admin] Network hostable DHCP agents. Network: deef6d86-d3bd-4711-b0fe-ebca0c9737aa, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:30:14.378162 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-8b07f354-f6d9-45f0-8cbf-6ca3be58be5d service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.110&port_id=7b66d328-f18c-4d26-af51-99c1b1f1f05e HTTP/1.1" status: 200 len: 217 time: 0.0483570 Dec 09 21:30:14.402383 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port ecdf312e-8304-4283-bcef-f24f46f66eee, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ecdf312e-8304-4283-bcef-f24f46f66eee,segment=NetworkSegment(f3b15b89-832d-4313-a864-1edfab1a4b59),segment_id=f3b15b89-832d-4313-a864-1edfab1a4b59)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:14.410254 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9cb4066c-9bc4-4be2-b96e-28798f03a9e7 admin admin] Network deef6d86-d3bd-4711-b0fe-ebca0c9737aa is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:30:14.414022 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:14.457284 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-9cb4066c-9bc4-4be2-b96e-28798f03a9e7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, deef6d86-d3bd-4711-b0fe-ebca0c9737aa) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:30:14.463153 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9cb4066c-9bc4-4be2-b96e-28798f03a9e7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:14.465145 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cb4066c-9bc4-4be2-b96e-28798f03a9e7 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:14.478916 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73988ab5-9c9e-4a9c-b64a-da0dd61400d4 req-30eae3f8-7945-4173-b925-545dcd25e1e1 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:14.486340 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73988ab5-9c9e-4a9c-b64a-da0dd61400d4 req-30eae3f8-7945-4173-b925-545dcd25e1e1 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:14.494162 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73988ab5-9c9e-4a9c-b64a-da0dd61400d4 req-30eae3f8-7945-4173-b925-545dcd25e1e1 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:14.502514 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73988ab5-9c9e-4a9c-b64a-da0dd61400d4 req-30eae3f8-7945-4173-b925-545dcd25e1e1 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:14.504632 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9cb4066c-9bc4-4be2-b96e-28798f03a9e7 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 857 time: 0.6907682 Dec 09 21:30:14.507546 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43830) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:14.513467 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e06a5508-cef1-4357-8e64-ad4385514a56 None None] Network deef6d86-d3bd-4711-b0fe-ebca0c9737aa requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:30:14.513912 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-436707a3-e2a8-4f85-8f6c-b1aa9952fdc6 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueTestJSONUnderV235-1609818858-router', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:14.520454 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73988ab5-9c9e-4a9c-b64a-da0dd61400d4 req-30eae3f8-7945-4173-b925-545dcd25e1e1 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:14.526702 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73988ab5-9c9e-4a9c-b64a-da0dd61400d4 req-30eae3f8-7945-4173-b925-545dcd25e1e1 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:14.533441 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73988ab5-9c9e-4a9c-b64a-da0dd61400d4 req-30eae3f8-7945-4173-b925-545dcd25e1e1 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:14.535849 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-73988ab5-9c9e-4a9c-b64a-da0dd61400d4 req-30eae3f8-7945-4173-b925-545dcd25e1e1 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5445 time: 0.2776601 Dec 09 21:30:14.539163 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4e151867-e9d2-462f-a729-ea1fde1522f2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:14.546622 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-436707a3-e2a8-4f85-8f6c-b1aa9952fdc6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:14.547977 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-436707a3-e2a8-4f85-8f6c-b1aa9952fdc6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:14.595215 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4e151867-e9d2-462f-a729-ea1fde1522f2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:14.597642 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-d7db49df-1fef-48a2-8661-65c29b89bbfb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:14.599676 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-d7db49df-1fef-48a2-8661-65c29b89bbfb service neutron] 10.222.0.10 "GET /v2.0/subnets?id=a894075b-fa9f-4a27-9782-e476e86f74e0 HTTP/1.1" status: 200 len: 797 time: 0.2114158 Dec 09 21:30:14.607097 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=ecdf312e-8304-4283-bcef-f24f46f66eee,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:14.632911 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-436707a3-e2a8-4f85-8f6c-b1aa9952fdc6 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:14.665692 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b7fede74-9752-412d-abdd-05f4816e70f3 None None] Network deef6d86-d3bd-4711-b0fe-ebca0c9737aa requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:30:14.707188 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-73988ab5-9c9e-4a9c-b64a-da0dd61400d4 req-a4df2a16-62c2-4d7f-9f5e-2e8862c4a55f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1592209 Dec 09 21:30:14.722787 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-4bb09ae1-8799-4a8d-a896-3ff5f392a2c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:14.725293 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-4bb09ae1-8799-4a8d-a896-3ff5f392a2c2 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a859e4ba-764a-41c0-982d-5bf79a2797a1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1067951 Dec 09 21:30:14.788088 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['ecdf312e-8304-4283-bcef-f24f46f66eee'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:30:14.813082 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4e151867-e9d2-462f-a729-ea1fde1522f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:14.823031 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4e151867-e9d2-462f-a729-ea1fde1522f2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:14.824359 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4e151867-e9d2-462f-a729-ea1fde1522f2 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/894009d5-1024-4bb2-9835-0039650ae414 HTTP/1.1" status: 204 len: 168 time: 0.5945761 Dec 09 21:30:14.878719 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-436707a3-e2a8-4f85-8f6c-b1aa9952fdc6 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:14.965205 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-964094d3-4077-4e88-9e50-86b70aeb6b44 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2317121 Dec 09 21:30:14.974949 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e151867-e9d2-462f-a729-ea1fde1522f2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=894009d5-1024-4bb2-9835-0039650ae414,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:15.232937 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-d70e544c-6a57-4e20-a724-7929bbb1d4c7 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2521563 Dec 09 21:30:15.256443 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-436707a3-e2a8-4f85-8f6c-b1aa9952fdc6 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:15.279392 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-436707a3-e2a8-4f85-8f6c-b1aa9952fdc6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:15.317280 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-673ac74b-755e-41a1-ac45-e625115937d6 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.206&port_id=3bbd0bd0-666a-4f39-abae-59f44d88319c HTTP/1.1" status: 200 len: 217 time: 0.0660942 Dec 09 21:30:15.420491 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-948d4346-e22d-428f-8b3f-66aa17ec3877 req-7726afbd-e44f-4b39-8cf9-e34c79be93b0 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:15.429186 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-948d4346-e22d-428f-8b3f-66aa17ec3877 req-7726afbd-e44f-4b39-8cf9-e34c79be93b0 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/ports?device_id=cd9b8f35-7873-4aef-8507-811168c7aafe HTTP/1.1" status: 200 len: 944 time: 0.1943347 Dec 09 21:30:15.448872 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-436707a3-e2a8-4f85-8f6c-b1aa9952fdc6 admin admin] Allocated IP 172.25.3.208 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/e830112e-9e99-483b-b004-4f2061144a6c) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:30:15.451366 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-f3dace4d-a83f-4fe8-bbfe-badca8b9583f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:15.453247 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-f3dace4d-a83f-4fe8-bbfe-badca8b9583f service neutron] 10.222.0.10 "GET /v2.0/subnets?id=a894075b-fa9f-4a27-9782-e476e86f74e0 HTTP/1.1" status: 200 len: 797 time: 0.1182530 Dec 09 21:30:15.533284 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-948d4346-e22d-428f-8b3f-66aa17ec3877 req-1ea1f6b0-4abb-4750-811a-d889685790d6 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/security-groups?id=e654b672-7d47-4ee0-9e34-ab2f5987626f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1013749 Dec 09 21:30:15.573203 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-61a9f1e6-7746-4012-b835-f6e208f9184c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:15.574792 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-61a9f1e6-7746-4012-b835-f6e208f9184c service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a859e4ba-764a-41c0-982d-5bf79a2797a1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1138861 Dec 09 21:30:15.626993 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-436707a3-e2a8-4f85-8f6c-b1aa9952fdc6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:15.681277 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-436707a3-e2a8-4f85-8f6c-b1aa9952fdc6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:15.719104 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-e583f594-19a2-47b5-86dd-ac7e0c921a3b service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1361771 Dec 09 21:30:15.805000 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-436707a3-e2a8-4f85-8f6c-b1aa9952fdc6 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:30:15.811117 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-436707a3-e2a8-4f85-8f6c-b1aa9952fdc6 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:30:15.813400 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-436707a3-e2a8-4f85-8f6c-b1aa9952fdc6 admin admin] Pushing event updated for resources: {'Port': ['ID=e830112e-9e99-483b-b004-4f2061144a6c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:15.816025 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-436707a3-e2a8-4f85-8f6c-b1aa9952fdc6 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:30:15.848923 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-595d6370-2e21-4517-8a21-24e756be149f service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1203911 Dec 09 21:30:15.916290 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-2009a596-f554-4bd1-abe4-fa1771d200f8 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.100&port_id=d0dcf098-4522-4347-b733-bbc98e48d7e0 HTTP/1.1" status: 200 len: 217 time: 0.0577552 Dec 09 21:30:16.045571 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device ecdf312e-8304-4283-bcef-f24f46f66eee up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:30:16.103709 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-10724bd1-1ea9-4351-b6c7-ffb4ba7c0f51 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:16.107311 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-10724bd1-1ea9-4351-b6c7-ffb4ba7c0f51 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=753ba647-b0b0-482e-ac28-89c7e6adf654 HTTP/1.1" status: 200 len: 797 time: 0.1784792 Dec 09 21:30:16.136176 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6be0340d-7bca-4719-9b85-b9197ef2d71e req-1f606b84-6c32-4f5d-ad4b-52533d5043e5 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:16.151155 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6be0340d-7bca-4719-9b85-b9197ef2d71e req-1f606b84-6c32-4f5d-ad4b-52533d5043e5 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:16.151827 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port ecdf312e-8304-4283-bcef-f24f46f66eee completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:30:16.156705 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port ecdf312e-8304-4283-bcef-f24f46f66eee triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:16.156992 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:16.159843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6be0340d-7bca-4719-9b85-b9197ef2d71e req-1f606b84-6c32-4f5d-ad4b-52533d5043e5 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:16.165997 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6be0340d-7bca-4719-9b85-b9197ef2d71e req-1f606b84-6c32-4f5d-ad4b-52533d5043e5 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:16.174151 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6be0340d-7bca-4719-9b85-b9197ef2d71e req-1f606b84-6c32-4f5d-ad4b-52533d5043e5 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:16.178598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6be0340d-7bca-4719-9b85-b9197ef2d71e req-1f606b84-6c32-4f5d-ad4b-52533d5043e5 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:16.185056 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6be0340d-7bca-4719-9b85-b9197ef2d71e req-1f606b84-6c32-4f5d-ad4b-52533d5043e5 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:16.193227 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6be0340d-7bca-4719-9b85-b9197ef2d71e req-1f606b84-6c32-4f5d-ad4b-52533d5043e5 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5445 time: 0.2754240 Dec 09 21:30:16.253272 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:16.294778 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-f5e81458-0fe8-4871-816e-cf077ec71e10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:16.297869 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-f5e81458-0fe8-4871-816e-cf077ec71e10 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a133a939-2827-4fe6-81f5-14715631c0ec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1014955 Dec 09 21:30:16.305671 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cd9b8f35-7873-4aef-8507-811168c7aafe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ecdf312e-8304-4283-bcef-f24f46f66eee'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:30:16.310714 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b8af25d5-aee7-4925-a727-eec43f497ef9" -d '{"events": [{"server_uuid": "cd9b8f35-7873-4aef-8507-811168c7aafe", "name": "network-vif-plugged", "status": "completed", "tag": "ecdf312e-8304-4283-bcef-f24f46f66eee"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:30:16.319015 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6be0340d-7bca-4719-9b85-b9197ef2d71e req-0dbff7c7-45b8-4a91-b00b-51d84e975a61 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1250572 Dec 09 21:30:16.344637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port ecdf312e-8304-4283-bcef-f24f46f66eee, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ecdf312e-8304-4283-bcef-f24f46f66eee,segment=NetworkSegment(f3b15b89-832d-4313-a864-1edfab1a4b59),segment_id=f3b15b89-832d-4313-a864-1edfab1a4b59)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:16.353168 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:16.385634 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-436707a3-e2a8-4f85-8f6c-b1aa9952fdc6 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:16.462727 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:30:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d5576b70-d07f-4d3d-83d2-a2cf99132f3d x-openstack-request-id: req-d5576b70-d07f-4d3d-83d2-a2cf99132f3d {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:30:16.463623 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cd9b8f35-7873-4aef-8507-811168c7aafe", "name": "network-vif-plugged", "status": "completed", "tag": "ecdf312e-8304-4283-bcef-f24f46f66eee", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:30:16.464089 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-d5576b70-d07f-4d3d-83d2-a2cf99132f3d {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:30:16.465450 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cd9b8f35-7873-4aef-8507-811168c7aafe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ecdf312e-8304-4283-bcef-f24f46f66eee', 'code': 200} Dec 09 21:30:16.471456 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=ecdf312e-8304-4283-bcef-f24f46f66eee,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:16.473389 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-0bc4c847-e267-4a07-8185-ee5566c6f83c service neutron] 10.222.0.10 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1514940 Dec 09 21:30:16.664832 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d960b9e-ca44-4702-b904-40a51bd09ba6 req-1ea5be18-f556-4f0e-adc9-12c684f09c39 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:16.671926 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d960b9e-ca44-4702-b904-40a51bd09ba6 req-1ea5be18-f556-4f0e-adc9-12c684f09c39 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:16.678217 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d960b9e-ca44-4702-b904-40a51bd09ba6 req-1ea5be18-f556-4f0e-adc9-12c684f09c39 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:16.685214 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d960b9e-ca44-4702-b904-40a51bd09ba6 req-1ea5be18-f556-4f0e-adc9-12c684f09c39 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:16.691205 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d960b9e-ca44-4702-b904-40a51bd09ba6 req-1ea5be18-f556-4f0e-adc9-12c684f09c39 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:16.697441 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d960b9e-ca44-4702-b904-40a51bd09ba6 req-1ea5be18-f556-4f0e-adc9-12c684f09c39 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:16.703911 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d960b9e-ca44-4702-b904-40a51bd09ba6 req-1ea5be18-f556-4f0e-adc9-12c684f09c39 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:16.721213 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43892) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:16.727107 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d960b9e-ca44-4702-b904-40a51bd09ba6 req-1ea5be18-f556-4f0e-adc9-12c684f09c39 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5445 time: 0.2317140 Dec 09 21:30:16.731948 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c05f459-9b01-43b9-99a9-49a523214e1c req-dddd8da0-9a59-4929-a333-fbf5df1c5251 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:16.732201 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-c63fd9fb-9514-4a4d-bc23-c41474638a43 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Request body: {'floatingip': {'port_id': '7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:16.733360 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c05f459-9b01-43b9-99a9-49a523214e1c req-dddd8da0-9a59-4929-a333-fbf5df1c5251 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=cd9b8f35-7873-4aef-8507-811168c7aafe HTTP/1.1" status: 200 len: 1097 time: 0.2152593 Dec 09 21:30:16.788496 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-46a0ee7c-980c-4e8b-8a4c-436a8e9255af service neutron] 10.222.0.10 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3073771 Dec 09 21:30:16.795741 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-436707a3-e2a8-4f85-8f6c-b1aa9952fdc6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:16.803303 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c63fd9fb-9514-4a4d-bc23-c41474638a43 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for floatingip, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:16.860408 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-d6713af1-974b-4c93-98f1-f3baaafd2f68 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=b7cad057-c6e6-483b-9791-e1b1a0dd73ac HTTP/1.1" status: 200 len: 217 time: 0.0625515 Dec 09 21:30:16.876960 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eae573c-b24f-46df-805b-5251e734270d req-0af51a77-8c9b-4fed-9021-0adaeba72ea0 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:16.878468 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2eae573c-b24f-46df-805b-5251e734270d req-0af51a77-8c9b-4fed-9021-0adaeba72ea0 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/ports?device_id=cd9b8f35-7873-4aef-8507-811168c7aafe HTTP/1.1" status: 200 len: 945 time: 0.1423016 Dec 09 21:30:16.892845 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c05f459-9b01-43b9-99a9-49a523214e1c req-e075c853-f30c-4cfc-8423-0022aea65752 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=e654b672-7d47-4ee0-9e34-ab2f5987626f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1391342 Dec 09 21:30:16.980561 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-c9d167f0-b2ce-4c9d-8677-3aca8f0971a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:16.982594 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-c9d167f0-b2ce-4c9d-8677-3aca8f0971a1 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=753ba647-b0b0-482e-ac28-89c7e6adf654 HTTP/1.1" status: 200 len: 797 time: 0.1142845 Dec 09 21:30:16.995646 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2eae573c-b24f-46df-805b-5251e734270d req-ca2aaadc-a47d-4e36-b461-0e9fee8a84bd tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/security-groups?id=e654b672-7d47-4ee0-9e34-ab2f5987626f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1056113 Dec 09 21:30:17.046856 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-48811097-4fa9-4ae8-ba0b-3dcadbc3ee28 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:17.048797 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-48811097-4fa9-4ae8-ba0b-3dcadbc3ee28 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a133a939-2827-4fe6-81f5-14715631c0ec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0520675 Dec 09 21:30:17.183718 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-436707a3-e2a8-4f85-8f6c-b1aa9952fdc6 admin admin] Router 16dbc747-be19-40bc-8996-b5aa5410163c is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:30:17.184136 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-7005f719-2051-4f74-899c-c7d3c594f507 service neutron] 10.222.0.10 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1267240 Dec 09 21:30:17.300157 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3dd36865-0685-49b8-856e-96538d8ad6bf req-b5947d0b-8f60-4646-8354-6b686fdc2c72 service neutron] 10.222.0.10 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0966761 Dec 09 21:30:17.358441 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43914) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:17.396751 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-436707a3-e2a8-4f85-8f6c-b1aa9952fdc6 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:30:17.408479 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] Sync routers for ids ['16dbc747-be19-40bc-8996-b5aa5410163c'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:30:17.420725 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] Routers {'16dbc747-be19-40bc-8996-b5aa5410163c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:30:17.421601 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:30:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['16dbc747-be19-40bc-8996-b5aa5410163c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:17.449697 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-436707a3-e2a8-4f85-8f6c-b1aa9952fdc6 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:17.454234 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-436707a3-e2a8-4f85-8f6c-b1aa9952fdc6 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 932 time: 2.9423461 Dec 09 21:30:17.454407 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43918) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:17.521565 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7a97f60f-3dee-47ca-b9cb-cb5418b7bff9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:17.578114 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] Set router 16dbc747-be19-40bc-8996-b5aa5410163c gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:30:17.589702 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c63fd9fb-9514-4a4d-bc23-c41474638a43 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:17.594417 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c63fd9fb-9514-4a4d-bc23-c41474638a43 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:17.737912 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7a97f60f-3dee-47ca-b9cb-cb5418b7bff9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:17.747980 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7a97f60f-3dee-47ca-b9cb-cb5418b7bff9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:17.768383 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-c63fd9fb-9514-4a4d-bc23-c41474638a43 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Floating IP 3435483a-a00a-4fba-97af-9cb9ff87f279 associated. External IP: 172.25.3.201, port: 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a. Dec 09 21:30:17.826676 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'name': 'tempest-ServerRescueTestJSONUnderV235-1609818858-router', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208'}], 'enable_snat': True}, 'gw_port_id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:14Z', 'updated_at': '2021-12-09T21:30:16Z', 'revision_number': 3, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'gw_port': {'id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:fa:55:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1351, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:15Z', 'updated_at': '2021-12-09T21:30:15Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:17.828325 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7a97f60f-3dee-47ca-b9cb-cb5418b7bff9 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=52f0d62a0c824802b4f8739b6b20b895&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4680090 Dec 09 21:30:17.832494 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43922) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:17.868836 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] Checking router: 16dbc747-be19-40bc-8996-b5aa5410163c for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:30:17.869565 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] Updating router 16dbc747-be19-40bc-8996-b5aa5410163c port e830112e-9e99-483b-b004-4f2061144a6c binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:30:17.908140 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:17.992176 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a97f60f-3dee-47ca-b9cb-cb5418b7bff9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f3d44818-9190-4dfd-a9ff-d73060f19788,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:18.164104 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f2c3b468-b803-4ddf-ae84-0f14421fcdc6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:18.198434 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f2c3b468-b803-4ddf-ae84-0f14421fcdc6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:18.280921 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f2c3b468-b803-4ddf-ae84-0f14421fcdc6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:18.284733 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f2c3b468-b803-4ddf-ae84-0f14421fcdc6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:18.289804 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f2c3b468-b803-4ddf-ae84-0f14421fcdc6 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/f3d44818-9190-4dfd-a9ff-d73060f19788 HTTP/1.1" status: 204 len: 168 time: 0.4553537 Dec 09 21:30:18.298361 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c8ef83c-60ba-4189-b501-14c466a5cd4d req-a9a03d2b-10b5-447e-a5e4-f4d79a7784cb tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:18.300236 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c8ef83c-60ba-4189-b501-14c466a5cd4d req-a9a03d2b-10b5-447e-a5e4-f4d79a7784cb tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/ports?device_id=cd9b8f35-7873-4aef-8507-811168c7aafe HTTP/1.1" status: 200 len: 945 time: 0.1412449 Dec 09 21:30:18.330902 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2c3b468-b803-4ddf-ae84-0f14421fcdc6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f3d44818-9190-4dfd-a9ff-d73060f19788,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:18.390770 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c63fd9fb-9514-4a4d-bc23-c41474638a43 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Router 4757617b-081d-4a51-a741-443e352d3856 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:30:18.406364 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:18.415352 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:18.433719 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c8ef83c-60ba-4189-b501-14c466a5cd4d req-e0583e26-ac0e-415a-8dee-9db4493e4e64 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/security-groups?id=e654b672-7d47-4ee0-9e34-ab2f5987626f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1214712 Dec 09 21:30:18.458718 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2808226a-4d69-425e-a9a8-725ffaf2e320 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:18.475350 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e4dad5f-2915-4e4a-9e6e-bd64dbdd04bc None None] Pushing event updated for resources: {'Port': ['ID=e830112e-9e99-483b-b004-4f2061144a6c,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:18.506877 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] Attempting to bind port e830112e-9e99-483b-b004-4f2061144a6c on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:18.507375 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] Attempting to bind port e830112e-9e99-483b-b004-4f2061144a6c by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:18.508140 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] Attempting to bind port e830112e-9e99-483b-b004-4f2061144a6c on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:18.516777 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 30, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:30:18.517146 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:30:18.517549 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:18.517933 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:30:18.518395 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] Bound port: e830112e-9e99-483b-b004-4f2061144a6c, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:30:18.521642 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:18.574363 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c63fd9fb-9514-4a4d-bc23-c41474638a43 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:30:18.578280 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] For port e830112e-9e99-483b-b004-4f2061144a6c, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:30:18.580130 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c63fd9fb-9514-4a4d-bc23-c41474638a43 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:18.583211 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] For port e830112e-9e99-483b-b004-4f2061144a6c, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e830112e-9e99-483b-b004-4f2061144a6c,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:30:18.586057 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5bdd2313-8889-4362-a8da-536b7282c833 None None] Sync routers for ids ['4757617b-081d-4a51-a741-443e352d3856'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:30:18.591586 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:18.597659 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5bdd2313-8889-4362-a8da-536b7282c833 None None] Routers {'4757617b-081d-4a51-a741-443e352d3856'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:30:18.598605 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5bdd2313-8889-4362-a8da-536b7282c833 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:30:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4757617b-081d-4a51-a741-443e352d3856'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:18.614108 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c63fd9fb-9514-4a4d-bc23-c41474638a43 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "PUT /v2.0/floatingips/3435483a-a00a-4fba-97af-9cb9ff87f279 HTTP/1.1" status: 200 len: 992 time: 1.8883724 Dec 09 21:30:18.614108 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'tag': '7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:30:18.625568 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2bfb8e55-2e4e-4f1b-b242-12107b179d24" -d '{"events": [{"name": "network-changed", "server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "tag": "7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:30:18.692742 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e4dad5f-2915-4e4a-9e6e-bd64dbdd04bc None None] Pushing event updated for resources: {'Port': ['ID=e830112e-9e99-483b-b004-4f2061144a6c,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:18.715916 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:30:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-040650ef-c3bf-49d5-a797-93a8badb0340 x-openstack-request-id: req-040650ef-c3bf-49d5-a797-93a8badb0340 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:30:18.716327 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "tag": "7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:30:18.716666 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-040650ef-c3bf-49d5-a797-93a8badb0340 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:30:18.717168 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'tag': '7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a', 'status': 'completed', 'code': 200} Dec 09 21:30:18.724981 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-2808226a-4d69-425e-a9a8-725ffaf2e320 admin admin] Allocated IP 172.20.0.1 (deef6d86-d3bd-4711-b0fe-ebca0c9737aa/86b80e39-7de5-4454-807b-0a1be07d2de3/a593c11a-9955-487b-871c-d87440b7d7f6) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:30:18.729030 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] Routers {'16dbc747-be19-40bc-8996-b5aa5410163c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:30:18.729891 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:30:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['16dbc747-be19-40bc-8996-b5aa5410163c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:18.769747 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-5bdd2313-8889-4362-a8da-536b7282c833 None None] Set router 4757617b-081d-4a51-a741-443e352d3856 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:30:18.876477 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2808226a-4d69-425e-a9a8-725ffaf2e320 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:18.880506 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] Set router 16dbc747-be19-40bc-8996-b5aa5410163c gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:30:18.994949 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bfb8e55-2e4e-4f1b-b242-12107b179d24 req-376f1139-5684-47e0-939e-f7481c895ee2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:18.995450 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bfb8e55-2e4e-4f1b-b242-12107b179d24 req-376f1139-5684-47e0-939e-f7481c895ee2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:18.996335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bfb8e55-2e4e-4f1b-b242-12107b179d24 req-376f1139-5684-47e0-939e-f7481c895ee2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:18.996335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bfb8e55-2e4e-4f1b-b242-12107b179d24 req-376f1139-5684-47e0-939e-f7481c895ee2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:18.996794 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bfb8e55-2e4e-4f1b-b242-12107b179d24 req-376f1139-5684-47e0-939e-f7481c895ee2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:18.997300 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bfb8e55-2e4e-4f1b-b242-12107b179d24 req-376f1139-5684-47e0-939e-f7481c895ee2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:18.997761 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bfb8e55-2e4e-4f1b-b242-12107b179d24 req-376f1139-5684-47e0-939e-f7481c895ee2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:19.000347 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bfb8e55-2e4e-4f1b-b242-12107b179d24 req-376f1139-5684-47e0-939e-f7481c895ee2 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0a5d0e4652be4d8b87936a559840cc87&device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 6509 time: 0.1129184 Dec 09 21:30:19.004076 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2808226a-4d69-425e-a9a8-725ffaf2e320 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:19.013975 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d80d0032-e96b-4c52-98ea-2f2b696d2201 req-c0b5bf4e-928f-474c-aac4-8c143d4a783a service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1134746 Dec 09 21:30:19.099207 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5bdd2313-8889-4362-a8da-536b7282c833 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4757617b-081d-4a51-a741-443e352d3856', 'name': 'tempest-TaggedBootDevicesTest_v242-1825188234-router', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97'}], 'enable_snat': True}, 'gw_port_id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:24Z', 'updated_at': '2021-12-09T21:27:29Z', 'revision_number': 4, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'gw_port': {'id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1113, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:25Z', 'updated_at': '2021-12-09T21:27:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3435483a-a00a-4fba-97af-9cb9ff87f279', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'floating_ip_address': '172.25.3.201', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '4757617b-081d-4a51-a741-443e352d3856', 'port_id': '7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 1222, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5', 'mac_address': 'fa:16:3e:52:a0:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:28:37Z', 'updated_at': '2021-12-09T21:30:17Z', 'revision_number': 1, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '19d4a80e-ba79-4490-8a95-e9c7e2370cf8', 'name': '', 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'mac_address': 'fa:16:3e:47:22:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_interface', 'standard_attr_id': 1115, 'fixed_ips': [{'subnet_id': 'd989acab-7cdc-482f-a350-344dd6e11873', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:28Z', 'updated_at': '2021-12-09T21:27:39Z', 'revision_number': 5, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'subnets': [{'id': 'd989acab-7cdc-482f-a350-344dd6e11873', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:19.106150 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2808226a-4d69-425e-a9a8-725ffaf2e320 admin admin] Network deef6d86-d3bd-4711-b0fe-ebca0c9737aa is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:30:19.107742 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-2808226a-4d69-425e-a9a8-725ffaf2e320 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:30:19.111531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2808226a-4d69-425e-a9a8-725ffaf2e320 admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:30:19.120236 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'name': 'tempest-ServerRescueTestJSONUnderV235-1609818858-router', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208'}], 'enable_snat': True}, 'gw_port_id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:14Z', 'updated_at': '2021-12-09T21:30:16Z', 'revision_number': 3, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'gw_port': {'id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:fa:55:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1351, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:15Z', 'updated_at': '2021-12-09T21:30:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:19.132242 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5bdd2313-8889-4362-a8da-536b7282c833 None None] Checking router: 4757617b-081d-4a51-a741-443e352d3856 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:30:19.142489 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5bdd2313-8889-4362-a8da-536b7282c833 None None] Routers {'4757617b-081d-4a51-a741-443e352d3856'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:30:19.143249 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5bdd2313-8889-4362-a8da-536b7282c833 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:30:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4757617b-081d-4a51-a741-443e352d3856'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:19.148257 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2808226a-4d69-425e-a9a8-725ffaf2e320 admin admin] Pushing event updated for resources: {'Port': ['ID=a593c11a-9955-487b-871c-d87440b7d7f6,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:19.154652 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ca74330-9536-4239-aebc-737f83421ca9 None None] The sync data for ids ['16dbc747-be19-40bc-8996-b5aa5410163c'] in n-d-713301-27 is: [{'id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'name': 'tempest-ServerRescueTestJSONUnderV235-1609818858-router', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208'}], 'enable_snat': True}, 'gw_port_id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:14Z', 'updated_at': '2021-12-09T21:30:16Z', 'revision_number': 3, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'gw_port': {'id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:fa:55:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1351, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:15Z', 'updated_at': '2021-12-09T21:30:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:30:19.254977 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2808226a-4d69-425e-a9a8-725ffaf2e320 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:19.326664 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d80d0032-e96b-4c52-98ea-2f2b696d2201 req-341d5882-0449-4e58-b5a4-0deb1cf62efe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:19.328417 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d80d0032-e96b-4c52-98ea-2f2b696d2201 req-341d5882-0449-4e58-b5a4-0deb1cf62efe service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=29f2c1d9be9348b0888bc61ed37ed957&device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 1098 time: 0.2517309 Dec 09 21:30:19.356086 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bfb8e55-2e4e-4f1b-b242-12107b179d24 req-d73c45ba-0789-400d-8281-5704450e6787 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:19.358041 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bfb8e55-2e4e-4f1b-b242-12107b179d24 req-d73c45ba-0789-400d-8281-5704450e6787 service neutron] 10.222.0.10 "GET /v2.0/networks?id=361619eb-51a4-4728-b2cc-72e27ec4eca5 HTTP/1.1" status: 200 len: 918 time: 0.3335819 Dec 09 21:30:19.556131 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-5bdd2313-8889-4362-a8da-536b7282c833 None None] Set router 4757617b-081d-4a51-a741-443e352d3856 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:30:19.902910 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5bdd2313-8889-4362-a8da-536b7282c833 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4757617b-081d-4a51-a741-443e352d3856', 'name': 'tempest-TaggedBootDevicesTest_v242-1825188234-router', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97'}], 'enable_snat': True}, 'gw_port_id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:24Z', 'updated_at': '2021-12-09T21:27:29Z', 'revision_number': 4, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'gw_port': {'id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1113, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:25Z', 'updated_at': '2021-12-09T21:27:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3435483a-a00a-4fba-97af-9cb9ff87f279', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'floating_ip_address': '172.25.3.201', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '4757617b-081d-4a51-a741-443e352d3856', 'port_id': '7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 1222, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5', 'mac_address': 'fa:16:3e:52:a0:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:28:37Z', 'updated_at': '2021-12-09T21:30:17Z', 'revision_number': 1, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '19d4a80e-ba79-4490-8a95-e9c7e2370cf8', 'name': '', 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'mac_address': 'fa:16:3e:47:22:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_interface', 'standard_attr_id': 1115, 'fixed_ips': [{'subnet_id': 'd989acab-7cdc-482f-a350-344dd6e11873', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:28Z', 'updated_at': '2021-12-09T21:27:39Z', 'revision_number': 5, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'subnets': [{'id': 'd989acab-7cdc-482f-a350-344dd6e11873', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:19.938440 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5bdd2313-8889-4362-a8da-536b7282c833 None None] The sync data for ids ['4757617b-081d-4a51-a741-443e352d3856'] in n-d-713301-27 is: [{'id': '4757617b-081d-4a51-a741-443e352d3856', 'name': 'tempest-TaggedBootDevicesTest_v242-1825188234-router', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97'}], 'enable_snat': True}, 'gw_port_id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:24Z', 'updated_at': '2021-12-09T21:27:29Z', 'revision_number': 4, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'gw_port': {'id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1113, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:25Z', 'updated_at': '2021-12-09T21:27:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3435483a-a00a-4fba-97af-9cb9ff87f279', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'floating_ip_address': '172.25.3.201', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '4757617b-081d-4a51-a741-443e352d3856', 'port_id': '7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 1222, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5', 'mac_address': 'fa:16:3e:52:a0:7e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:28:37Z', 'updated_at': '2021-12-09T21:30:17Z', 'revision_number': 1, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '19d4a80e-ba79-4490-8a95-e9c7e2370cf8', 'name': '', 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'mac_address': 'fa:16:3e:47:22:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_interface', 'standard_attr_id': 1115, 'fixed_ips': [{'subnet_id': 'd989acab-7cdc-482f-a350-344dd6e11873', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:28Z', 'updated_at': '2021-12-09T21:27:39Z', 'revision_number': 5, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'subnets': [{'id': 'd989acab-7cdc-482f-a350-344dd6e11873', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:30:20.030521 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bfb8e55-2e4e-4f1b-b242-12107b179d24 req-caa240b1-45dd-436f-9c78-ee63c59a21f8 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a HTTP/1.1" status: 200 len: 1000 time: 0.6268053 Dec 09 21:30:20.097847 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2808226a-4d69-425e-a9a8-725ffaf2e320 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:20.119263 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d80d0032-e96b-4c52-98ea-2f2b696d2201 req-6984d447-8c7c-4f10-9f0c-f296476e776f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:20.121585 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d80d0032-e96b-4c52-98ea-2f2b696d2201 req-6984d447-8c7c-4f10-9f0c-f296476e776f service neutron] 10.222.0.31 "GET /v2.0/networks?id=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 HTTP/1.1" status: 200 len: 917 time: 0.7183349 Dec 09 21:30:20.147758 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0da3f30c-a433-44f2-bac9-f49817c0aa79 req-05b5a040-af4e-4451-a9a6-33bc052197ca tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:20.151820 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0da3f30c-a433-44f2-bac9-f49817c0aa79 req-05b5a040-af4e-4451-a9a6-33bc052197ca tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/ports?device_id=cd9b8f35-7873-4aef-8507-811168c7aafe HTTP/1.1" status: 200 len: 945 time: 0.5532196 Dec 09 21:30:20.223962 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bfb8e55-2e4e-4f1b-b242-12107b179d24 req-8a2f767b-c7ca-449a-89a9-4c717624e6d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:20.225778 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bfb8e55-2e4e-4f1b-b242-12107b179d24 req-8a2f767b-c7ca-449a-89a9-4c717624e6d4 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=d989acab-7cdc-482f-a350-344dd6e11873 HTTP/1.1" status: 200 len: 856 time: 0.1769657 Dec 09 21:30:20.317557 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7affd1c4-fcb7-4336-a689-c716b2aebf29 None None] New status for floating IP 3435483a-a00a-4fba-97af-9cb9ff87f279: ACTIVE {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:30:20.358867 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d80d0032-e96b-4c52-98ea-2f2b696d2201 req-06fafda8-4d46-43bc-b290-bdcfd3903061 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=778d35d4-c635-4fcb-b344-64cbb94958b9 HTTP/1.1" status: 200 len: 1001 time: 0.2277136 Dec 09 21:30:20.504838 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0da3f30c-a433-44f2-bac9-f49817c0aa79 req-b9690091-95d0-4c06-81e1-4088bd4f985f tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/security-groups?id=e654b672-7d47-4ee0-9e34-ab2f5987626f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3441494 Dec 09 21:30:20.566155 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bfb8e55-2e4e-4f1b-b242-12107b179d24 req-e73d1aad-32b2-47f7-8872-c643c9d8a34f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:20.567936 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bfb8e55-2e4e-4f1b-b242-12107b179d24 req-e73d1aad-32b2-47f7-8872-c643c9d8a34f service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=361619eb-51a4-4728-b2cc-72e27ec4eca5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.3148384 Dec 09 21:30:20.611373 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d80d0032-e96b-4c52-98ea-2f2b696d2201 req-b4e6587d-7540-4cd3-ba69-9a4220be72b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:20.613588 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d80d0032-e96b-4c52-98ea-2f2b696d2201 req-b4e6587d-7540-4cd3-ba69-9a4220be72b8 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ace82e8b-012a-4184-a81e-5303eecf12ff HTTP/1.1" status: 200 len: 855 time: 0.2376018 Dec 09 21:30:20.772422 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2808226a-4d69-425e-a9a8-725ffaf2e320 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:20.787378 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2808226a-4d69-425e-a9a8-725ffaf2e320 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:20.825521 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d80d0032-e96b-4c52-98ea-2f2b696d2201 req-11543914-8074-4990-8546-3cfc7b0a8179 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:20.825521 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d80d0032-e96b-4c52-98ea-2f2b696d2201 req-11543914-8074-4990-8546-3cfc7b0a8179 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1973259 Dec 09 21:30:20.855795 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bfb8e55-2e4e-4f1b-b242-12107b179d24 req-ded97fd9-1e2f-44f0-9458-903c618d2b89 service neutron] 10.222.0.10 "GET /v2.0/networks/361619eb-51a4-4728-b2cc-72e27ec4eca5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2767320 Dec 09 21:30:20.980641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2808226a-4d69-425e-a9a8-725ffaf2e320 admin admin] Pushing event updated for resources: {'Port': ['ID=a593c11a-9955-487b-871c-d87440b7d7f6,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:20.984863 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2808226a-4d69-425e-a9a8-725ffaf2e320 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:21.144883 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bfb8e55-2e4e-4f1b-b242-12107b179d24 req-ceb4bcde-cab7-4ebb-bb93-385068b6a30c service neutron] 10.222.0.10 "GET /v2.0/networks/361619eb-51a4-4728-b2cc-72e27ec4eca5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2773669 Dec 09 21:30:21.146659 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d80d0032-e96b-4c52-98ea-2f2b696d2201 req-81a78477-c458-421e-9c95-426542f8cde0 service neutron] 10.222.0.31 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3174405 Dec 09 21:30:21.259805 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2808226a-4d69-425e-a9a8-725ffaf2e320 admin admin] Network deef6d86-d3bd-4711-b0fe-ebca0c9737aa is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:30:21.263858 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-2808226a-4d69-425e-a9a8-725ffaf2e320 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:30:21.292200 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e830112e-9e99-483b-b004-4f2061144a6c up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:30:21.346035 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d80d0032-e96b-4c52-98ea-2f2b696d2201 req-adc5a67e-f22c-4c0c-87e9-be3a0b836f30 service neutron] 10.222.0.31 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1896849 Dec 09 21:30:21.456061 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2808226a-4d69-425e-a9a8-725ffaf2e320 admin admin] Router 16dbc747-be19-40bc-8996-b5aa5410163c has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:30:21.461433 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port e830112e-9e99-483b-b004-4f2061144a6c triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:21.461841 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:21.585398 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:21.609273 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b3e4c03-370e-4879-876d-7f30d1da5e60 req-541e67c3-9164-46e4-8b6c-8565a5e69e98 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:21.611635 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b3e4c03-370e-4879-876d-7f30d1da5e60 req-541e67c3-9164-46e4-8b6c-8565a5e69e98 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/ports?device_id=cd9b8f35-7873-4aef-8507-811168c7aafe HTTP/1.1" status: 200 len: 945 time: 0.1310260 Dec 09 21:30:21.614554 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port e830112e-9e99-483b-b004-4f2061144a6c, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e830112e-9e99-483b-b004-4f2061144a6c,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:21.623498 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44054) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:21.628179 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:21.697229 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=e830112e-9e99-483b-b004-4f2061144a6c,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:21.698384 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2808226a-4d69-425e-a9a8-725ffaf2e320 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:30:21.709701 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2808226a-4d69-425e-a9a8-725ffaf2e320 admin admin] 10.222.0.13 "PUT /v2.0/routers/16dbc747-be19-40bc-8996-b5aa5410163c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.2537382 Dec 09 21:30:21.731318 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b3e4c03-370e-4879-876d-7f30d1da5e60 req-d5862f5b-099d-47e8-a149-596ac7690cff tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/security-groups?id=e654b672-7d47-4ee0-9e34-ab2f5987626f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0903955 Dec 09 21:30:21.808738 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e1b1878-893a-4697-9723-b24c537ca590 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:21.918196 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] Sync routers for ids ['16dbc747-be19-40bc-8996-b5aa5410163c'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:30:21.919748 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e1b1878-893a-4697-9723-b24c537ca590 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:21.924171 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e1b1878-893a-4697-9723-b24c537ca590 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:21.933926 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] Routers {'16dbc747-be19-40bc-8996-b5aa5410163c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:30:21.934802 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:30:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['16dbc747-be19-40bc-8996-b5aa5410163c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:21.966377 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8e1b1878-893a-4697-9723-b24c537ca590 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=c864902c54e64f6abbc7443da83fd011&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3407938 Dec 09 21:30:21.969493 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44070) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:21.969875 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e1b1878-893a-4697-9723-b24c537ca590 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=880c8836-39ea-4b9b-bc50-381463c9706f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:22.045610 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-86c5d96e-b7f1-41bf-b6ea-72f0f54e273a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:22.084021 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-86c5d96e-b7f1-41bf-b6ea-72f0f54e273a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:22.088771 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] Set router 16dbc747-be19-40bc-8996-b5aa5410163c gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:30:22.146811 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-86c5d96e-b7f1-41bf-b6ea-72f0f54e273a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:22.152414 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-86c5d96e-b7f1-41bf-b6ea-72f0f54e273a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:22.153776 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-86c5d96e-b7f1-41bf-b6ea-72f0f54e273a admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/880c8836-39ea-4b9b-bc50-381463c9706f HTTP/1.1" status: 204 len: 168 time: 0.1828902 Dec 09 21:30:22.170892 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86c5d96e-b7f1-41bf-b6ea-72f0f54e273a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=880c8836-39ea-4b9b-bc50-381463c9706f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:22.380934 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'name': 'tempest-ServerRescueTestJSONUnderV235-1609818858-router', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208'}], 'enable_snat': True}, 'gw_port_id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:14Z', 'updated_at': '2021-12-09T21:30:19Z', 'revision_number': 4, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'gw_port': {'id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:fa:55:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1351, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:15Z', 'updated_at': '2021-12-09T21:30:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'a593c11a-9955-487b-871c-d87440b7d7f6', 'name': '', 'network_id': 'deef6d86-d3bd-4711-b0fe-ebca0c9737aa', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'mac_address': 'fa:16:3e:fc:b6:56', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1357, 'fixed_ips': [{'subnet_id': '86b80e39-7de5-4454-807b-0a1be07d2de3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:18Z', 'updated_at': '2021-12-09T21:30:20Z', 'revision_number': 2, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'subnets': [{'id': '86b80e39-7de5-4454-807b-0a1be07d2de3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:22.416212 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] Checking router: 16dbc747-be19-40bc-8996-b5aa5410163c for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:30:22.416676 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] Updating router 16dbc747-be19-40bc-8996-b5aa5410163c port a593c11a-9955-487b-871c-d87440b7d7f6 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:30:22.448393 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:22.602055 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-9b2a429a-60ec-4fc1-afd7-d2d8c365d499 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:22.606900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44090) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:22.610769 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-9b2a429a-60ec-4fc1-afd7-d2d8c365d499 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/networks?id=deef6d86-d3bd-4711-b0fe-ebca0c9737aa HTTP/1.1" status: 200 len: 820 time: 0.1545715 Dec 09 21:30:22.624200 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-8086c789-55c4-488f-aa60-4ea3e88f0b43 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/quotas/0f8295f4c3534e24a63938170ba2425e HTTP/1.1" status: 200 len: 375 time: 0.0124278 Dec 09 21:30:22.632448 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d69d9e80-68eb-4da7-84d8-c0b2045a083a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:22.732607 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-66b957c9-eb79-47d7-98f4-e853c4b54809 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=0f8295f4c3534e24a63938170ba2425e&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1008911 Dec 09 21:30:22.751286 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d69d9e80-68eb-4da7-84d8-c0b2045a083a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:22.755976 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d69d9e80-68eb-4da7-84d8-c0b2045a083a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:22.757987 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df79c8d4-e3ee-4f54-8f2d-5ada02797416 req-1b226f1e-ac2d-48ba-9ca7-f9fe848a92e1 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:22.759896 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df79c8d4-e3ee-4f54-8f2d-5ada02797416 req-1b226f1e-ac2d-48ba-9ca7-f9fe848a92e1 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.31 "GET /v2.0/ports?device_id=cd9b8f35-7873-4aef-8507-811168c7aafe HTTP/1.1" status: 200 len: 945 time: 0.1135216 Dec 09 21:30:22.806400 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d69d9e80-68eb-4da7-84d8-c0b2045a083a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=bee1919d52734e9890ac030ec443405e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1979516 Dec 09 21:30:22.808206 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44094) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:22.817270 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d69d9e80-68eb-4da7-84d8-c0b2045a083a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b142ca8a-b911-4e7f-a059-f2b65bc2f9cb,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:22.881383 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d3d0509-f2e1-4a74-9040-e52468d34ecd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:22.884290 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:22.893762 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:22.909806 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d3d0509-f2e1-4a74-9040-e52468d34ecd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:22.978749 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ad13e3a-dcf5-4cbd-8a16-4246f0d6a4fc None None] Pushing event updated for resources: {'Port': ['ID=a593c11a-9955-487b-871c-d87440b7d7f6,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:22.989546 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d3d0509-f2e1-4a74-9040-e52468d34ecd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:22.993570 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d3d0509-f2e1-4a74-9040-e52468d34ecd admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:22.995866 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-bd8e75cc-08e0-4799-9671-f81a55116e2a service neutron] 10.222.0.13 "GET /v2.0/networks/deef6d86-d3bd-4711-b0fe-ebca0c9737aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2573595 Dec 09 21:30:22.998718 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2d3d0509-f2e1-4a74-9040-e52468d34ecd admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/b142ca8a-b911-4e7f-a059-f2b65bc2f9cb HTTP/1.1" status: 204 len: 168 time: 0.1891596 Dec 09 21:30:23.011038 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d3d0509-f2e1-4a74-9040-e52468d34ecd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b142ca8a-b911-4e7f-a059-f2b65bc2f9cb,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:23.014586 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8c23e64-ed9d-4144-9e3e-d72286e8cdbe req-25abfa87-8494-460c-a179-a116eb69fdf3 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:23.016311 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8c23e64-ed9d-4144-9e3e-d72286e8cdbe req-25abfa87-8494-460c-a179-a116eb69fdf3 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/ports?device_id=cd9b8f35-7873-4aef-8507-811168c7aafe HTTP/1.1" status: 200 len: 945 time: 0.1765423 Dec 09 21:30:23.050045 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] Attempting to bind port a593c11a-9955-487b-871c-d87440b7d7f6 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:23.050482 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] Attempting to bind port a593c11a-9955-487b-871c-d87440b7d7f6 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '758500a8-fda8-49cf-a84c-a7e78098b9e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'deef6d86-d3bd-4711-b0fe-ebca0c9737aa'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:23.050857 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] Attempting to bind port a593c11a-9955-487b-871c-d87440b7d7f6 on network deef6d86-d3bd-4711-b0fe-ebca0c9737aa {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:23.070255 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 30, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:30:23.070699 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] Checking segment: {'id': '758500a8-fda8-49cf-a84c-a7e78098b9e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'deef6d86-d3bd-4711-b0fe-ebca0c9737aa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:30:23.071086 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:23.071574 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] Bound using segment: {'id': '758500a8-fda8-49cf-a84c-a7e78098b9e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'deef6d86-d3bd-4711-b0fe-ebca0c9737aa'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:30:23.072065 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] Bound port: a593c11a-9955-487b-871c-d87440b7d7f6, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '758500a8-fda8-49cf-a84c-a7e78098b9e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'deef6d86-d3bd-4711-b0fe-ebca0c9737aa'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:30:23.072471 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:23.103735 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-df79c8d4-e3ee-4f54-8f2d-5ada02797416 req-454db5b6-916f-408f-a088-28fbb16c4975 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Deleting port ecdf312e-8304-4283-bcef-f24f46f66eee {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:30:23.104530 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-df79c8d4-e3ee-4f54-8f2d-5ada02797416 req-454db5b6-916f-408f-a088-28fbb16c4975 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:23.145934 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] For port a593c11a-9955-487b-871c-d87440b7d7f6, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:30:23.149722 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] For port a593c11a-9955-487b-871c-d87440b7d7f6, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a593c11a-9955-487b-871c-d87440b7d7f6,segment=NetworkSegment(758500a8-fda8-49cf-a84c-a7e78098b9e8),segment_id=758500a8-fda8-49cf-a84c-a7e78098b9e8)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:30:23.156186 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:23.228700 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8c23e64-ed9d-4144-9e3e-d72286e8cdbe req-c3f2b43f-e781-4060-a4e7-0b7e3513bb89 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/security-groups?id=e654b672-7d47-4ee0-9e34-ab2f5987626f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1981745 Dec 09 21:30:23.238370 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] Routers {'16dbc747-be19-40bc-8996-b5aa5410163c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:30:23.239051 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:30:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['16dbc747-be19-40bc-8996-b5aa5410163c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:23.242850 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e830112e-9e99-483b-b004-4f2061144a6c up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:30:23.260298 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-85cb348a-21ec-410a-8001-b7dd7022e5fe service neutron] 10.222.0.13 "GET /v2.0/networks/deef6d86-d3bd-4711-b0fe-ebca0c9737aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2633924 Dec 09 21:30:23.292656 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-df79c8d4-e3ee-4f54-8f2d-5ada02797416 req-454db5b6-916f-408f-a088-28fbb16c4975 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] For port ecdf312e-8304-4283-bcef-f24f46f66eee, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ecdf312e-8304-4283-bcef-f24f46f66eee,segment=NetworkSegment(f3b15b89-832d-4313-a864-1edfab1a4b59),segment_id=f3b15b89-832d-4313-a864-1edfab1a4b59)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:23.293427 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-df79c8d4-e3ee-4f54-8f2d-5ada02797416 req-454db5b6-916f-408f-a088-28fbb16c4975 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:23.317803 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-df79c8d4-e3ee-4f54-8f2d-5ada02797416 req-454db5b6-916f-408f-a088-28fbb16c4975 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Calling delete_port for ecdf312e-8304-4283-bcef-f24f46f66eee owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:30:23.352092 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ad13e3a-dcf5-4cbd-8a16-4246f0d6a4fc None None] Pushing event updated for resources: {'Port': ['ID=a593c11a-9955-487b-871c-d87440b7d7f6,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:23.457363 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port e830112e-9e99-483b-b004-4f2061144a6c triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:23.458385 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:23.472215 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] Set router 16dbc747-be19-40bc-8996-b5aa5410163c gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:30:23.514160 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-26112593-0970-43c2-a94e-03f8b6c385ff req-ce70ff2c-3149-4e49-b84f-a09c9c25242b tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 210 time: 0.0487285 Dec 09 21:30:23.640886 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-df79c8d4-e3ee-4f54-8f2d-5ada02797416 req-454db5b6-916f-408f-a088-28fbb16c4975 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:23.677232 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['ecdf312e-8304-4283-bcef-f24f46f66eee'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:30:23.687317 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-454db5b6-916f-408f-a088-28fbb16c4975 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Pushing event deleted for resources: {'Port': ['ID=ecdf312e-8304-4283-bcef-f24f46f66eee,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:23.746319 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-df79c8d4-e3ee-4f54-8f2d-5ada02797416 req-454db5b6-916f-408f-a088-28fbb16c4975 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] No DVR routers for this DVR port ecdf312e-8304-4283-bcef-f24f46f66eee on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:30:23.755573 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-df79c8d4-e3ee-4f54-8f2d-5ada02797416 req-454db5b6-916f-408f-a088-28fbb16c4975 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:23.765279 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df79c8d4-e3ee-4f54-8f2d-5ada02797416 req-454db5b6-916f-408f-a088-28fbb16c4975 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.31 "DELETE /v2.0/ports/ecdf312e-8304-4283-bcef-f24f46f66eee HTTP/1.1" status: 204 len: 173 time: 0.9888811 Dec 09 21:30:23.768412 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cd9b8f35-7873-4aef-8507-811168c7aafe', 'name': 'network-vif-deleted', 'tag': 'ecdf312e-8304-4283-bcef-f24f46f66eee'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:30:23.775256 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4df9e380-d1cb-4c2c-a0ff-238cd5c924f0" -d '{"events": [{"server_uuid": "cd9b8f35-7873-4aef-8507-811168c7aafe", "name": "network-vif-deleted", "tag": "ecdf312e-8304-4283-bcef-f24f46f66eee"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:30:23.883879 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:30:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cdfe8f8b-6540-4b05-9cf8-751bf5ee8974 x-openstack-request-id: req-cdfe8f8b-6540-4b05-9cf8-751bf5ee8974 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:30:23.884748 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cd9b8f35-7873-4aef-8507-811168c7aafe", "name": "network-vif-deleted", "tag": "ecdf312e-8304-4283-bcef-f24f46f66eee", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:30:23.885605 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-cdfe8f8b-6540-4b05-9cf8-751bf5ee8974 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:30:23.886456 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cd9b8f35-7873-4aef-8507-811168c7aafe', 'name': 'network-vif-deleted', 'tag': 'ecdf312e-8304-4283-bcef-f24f46f66eee', 'status': 'completed', 'code': 200} Dec 09 21:30:24.014470 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'name': 'tempest-ServerRescueTestJSONUnderV235-1609818858-router', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208'}], 'enable_snat': True}, 'gw_port_id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:14Z', 'updated_at': '2021-12-09T21:30:19Z', 'revision_number': 4, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'gw_port': {'id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:fa:55:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1351, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:15Z', 'updated_at': '2021-12-09T21:30:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'a593c11a-9955-487b-871c-d87440b7d7f6', 'name': '', 'network_id': 'deef6d86-d3bd-4711-b0fe-ebca0c9737aa', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'mac_address': 'fa:16:3e:fc:b6:56', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1357, 'fixed_ips': [{'subnet_id': '86b80e39-7de5-4454-807b-0a1be07d2de3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:18Z', 'updated_at': '2021-12-09T21:30:23Z', 'revision_number': 4, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'subnets': [{'id': '86b80e39-7de5-4454-807b-0a1be07d2de3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:24.049805 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-20e40c67-204a-47dd-a268-f58911929f20 None None] The sync data for ids ['16dbc747-be19-40bc-8996-b5aa5410163c'] in n-d-713301-27 is: [{'id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'name': 'tempest-ServerRescueTestJSONUnderV235-1609818858-router', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208'}], 'enable_snat': True}, 'gw_port_id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:14Z', 'updated_at': '2021-12-09T21:30:19Z', 'revision_number': 4, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'gw_port': {'id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:fa:55:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1351, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:15Z', 'updated_at': '2021-12-09T21:30:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'a593c11a-9955-487b-871c-d87440b7d7f6', 'name': '', 'network_id': 'deef6d86-d3bd-4711-b0fe-ebca0c9737aa', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'mac_address': 'fa:16:3e:fc:b6:56', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1357, 'fixed_ips': [{'subnet_id': '86b80e39-7de5-4454-807b-0a1be07d2de3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:18Z', 'updated_at': '2021-12-09T21:30:23Z', 'revision_number': 4, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'subnets': [{'id': '86b80e39-7de5-4454-807b-0a1be07d2de3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:30:24.444338 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6fe4cc9a-4a3d-497a-84c7-d0a4b63b00c1 req-a76222e4-2853-41a8-b9d0-1a38948433c9 tempest-ServerMetadataNegativeTestJSON-888278713 tempest-ServerMetadataNegativeTestJSON-888278713-project] 10.222.0.13 "GET /v2.0/ports?device_id=cd9b8f35-7873-4aef-8507-811168c7aafe HTTP/1.1" status: 200 len: 210 time: 0.0577228 Dec 09 21:30:24.623694 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8b38aeab-0e2f-4aa9-9f08-e3064361bdf9 req-ca234521-f09d-467e-a29e-0a0cd27bf6f3 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 210 time: 0.0282245 Dec 09 21:30:25.033875 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-6dc6664d-a82b-41ff-ba50-d6a88acfcc3a tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:25.036017 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-6dc6664d-a82b-41ff-ba50-d6a88acfcc3a tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.10 "GET /v2.0/networks?id=deef6d86-d3bd-4711-b0fe-ebca0c9737aa HTTP/1.1" status: 200 len: 820 time: 0.1546230 Dec 09 21:30:25.053283 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-4ace2e7b-0565-46f3-ab1e-a3ed3100bd9e tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Request body: {'port': {'device_id': '16ff2943-c2d6-4af7-9bbd-52443fde3d6e', 'network_id': 'deef6d86-d3bd-4711-b0fe-ebca0c9737aa', 'admin_state_up': True, 'tenant_id': '0f8295f4c3534e24a63938170ba2425e'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:25.227188 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-4ace2e7b-0565-46f3-ab1e-a3ed3100bd9e tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Made reservation on behalf of 0f8295f4c3534e24a63938170ba2425e for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:30:25.231925 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-4ace2e7b-0565-46f3-ab1e-a3ed3100bd9e tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:25.249872 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a593c11a-9955-487b-871c-d87440b7d7f6 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:30:25.313618 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port a593c11a-9955-487b-871c-d87440b7d7f6 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:25.314011 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:25.419075 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-4ace2e7b-0565-46f3-ab1e-a3ed3100bd9e tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Allocated IP 172.20.0.4 (deef6d86-d3bd-4711-b0fe-ebca0c9737aa/86b80e39-7de5-4454-807b-0a1be07d2de3/3d9c176b-4d74-466f-b7bd-8d44eae4a3f2) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:30:25.426919 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:25.466286 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port a593c11a-9955-487b-871c-d87440b7d7f6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a593c11a-9955-487b-871c-d87440b7d7f6,segment=NetworkSegment(758500a8-fda8-49cf-a84c-a7e78098b9e8),segment_id=758500a8-fda8-49cf-a84c-a7e78098b9e8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:25.471546 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:25.542573 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44180) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:25.552886 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=a593c11a-9955-487b-871c-d87440b7d7f6,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:25.621323 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-6f815a03-589b-4950-a1dd-ea63b7ad6a3a admin admin] Deleting subnet bb9cf677-90a0-4039-87cf-7b2af98aa6ae {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:30:25.625802 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f815a03-589b-4950-a1dd-ea63b7ad6a3a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:25.673793 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f815a03-589b-4950-a1dd-ea63b7ad6a3a admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:25.688753 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-4ace2e7b-0565-46f3-ab1e-a3ed3100bd9e tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:25.737249 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-4ace2e7b-0565-46f3-ab1e-a3ed3100bd9e tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:25.750394 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f815a03-589b-4950-a1dd-ea63b7ad6a3a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:25.822543 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ace2e7b-0565-46f3-ab1e-a3ed3100bd9e tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Pushing event updated for resources: {'Port': ['ID=3d9c176b-4d74-466f-b7bd-8d44eae4a3f2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:25.868115 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f815a03-589b-4950-a1dd-ea63b7ad6a3a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:25.875118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-4ace2e7b-0565-46f3-ab1e-a3ed3100bd9e tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Network deef6d86-d3bd-4711-b0fe-ebca0c9737aa is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:30:25.877959 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-4ace2e7b-0565-46f3-ab1e-a3ed3100bd9e tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:30:25.886481 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-4ace2e7b-0565-46f3-ab1e-a3ed3100bd9e tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:30:25.929803 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f815a03-589b-4950-a1dd-ea63b7ad6a3a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=bb9cf677-90a0-4039-87cf-7b2af98aa6ae,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:25.936580 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f815a03-589b-4950-a1dd-ea63b7ad6a3a admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:25.944001 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6f815a03-589b-4950-a1dd-ea63b7ad6a3a admin admin] 10.222.0.13 "DELETE /v2.0/subnets/bb9cf677-90a0-4039-87cf-7b2af98aa6ae HTTP/1.1" status: 204 len: 168 time: 0.3993983 Dec 09 21:30:25.944876 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44200) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:25.953580 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a26d622-634f-4f87-97b1-88cc4ff97cc5 req-f57edd14-c3c4-4967-90b1-e9e3344fc390 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:25.955724 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a26d622-634f-4f87-97b1-88cc4ff97cc5 req-f57edd14-c3c4-4967-90b1-e9e3344fc390 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 931 time: 0.2318268 Dec 09 21:30:25.966121 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-4ace2e7b-0565-46f3-ab1e-a3ed3100bd9e tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:25.966975 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-4ace2e7b-0565-46f3-ab1e-a3ed3100bd9e tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:26.026267 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-4ace2e7b-0565-46f3-ab1e-a3ed3100bd9e tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9786997 Dec 09 21:30:26.050807 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-e796fee0-d6e0-4a0f-860e-26ab9f19ec14 service neutron] Request body: {'port': {'device_id': '16ff2943-c2d6-4af7-9bbd-52443fde3d6e', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:26.064650 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-303172ec-31a7-4ea2-8109-aa87743864a7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:26.084110 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a26d622-634f-4f87-97b1-88cc4ff97cc5 req-c233fc49-4bed-4491-bc88-7835ea129f6b tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1135619 Dec 09 21:30:26.132557 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-e796fee0-d6e0-4a0f-860e-26ab9f19ec14 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:26.453583 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-e796fee0-d6e0-4a0f-860e-26ab9f19ec14 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:30:26.462250 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-e796fee0-d6e0-4a0f-860e-26ab9f19ec14 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:26.476648 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-e796fee0-d6e0-4a0f-860e-26ab9f19ec14 service neutron] Transition to ACTIVE for port object 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:30:26.483139 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-e796fee0-d6e0-4a0f-860e-26ab9f19ec14 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:26.512186 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-303172ec-31a7-4ea2-8109-aa87743864a7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:26.536307 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-303172ec-31a7-4ea2-8109-aa87743864a7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5b21d7bb-3cb6-4d1a-933f-9771c9a4e497']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:26.546858 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-303172ec-31a7-4ea2-8109-aa87743864a7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f3b15b89-832d-4313-a864-1edfab1a4b59') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:26.547543 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-303172ec-31a7-4ea2-8109-aa87743864a7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f3b15b89-832d-4313-a864-1edfab1a4b59') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:26.556301 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e796fee0-d6e0-4a0f-860e-26ab9f19ec14 service neutron] Pushing event updated for resources: {'Port': ['ID=3d9c176b-4d74-466f-b7bd-8d44eae4a3f2,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:26.559273 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-303172ec-31a7-4ea2-8109-aa87743864a7 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:26.576796 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-303172ec-31a7-4ea2-8109-aa87743864a7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:26.583497 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-303172ec-31a7-4ea2-8109-aa87743864a7 admin admin] Releasing vlan 135 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:30:26.583938 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-303172ec-31a7-4ea2-8109-aa87743864a7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:26.609992 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-e796fee0-d6e0-4a0f-860e-26ab9f19ec14 service neutron] Attempting to bind port 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:26.610337 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-e796fee0-d6e0-4a0f-860e-26ab9f19ec14 service neutron] Attempting to bind port 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '758500a8-fda8-49cf-a84c-a7e78098b9e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'deef6d86-d3bd-4711-b0fe-ebca0c9737aa'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:26.610691 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-e796fee0-d6e0-4a0f-860e-26ab9f19ec14 service neutron] Attempting to bind port 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 on network deef6d86-d3bd-4711-b0fe-ebca0c9737aa {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:26.615704 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-e796fee0-d6e0-4a0f-860e-26ab9f19ec14 service neutron] Port 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 on network deef6d86-d3bd-4711-b0fe-ebca0c9737aa not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:30:26.615894 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-e796fee0-d6e0-4a0f-860e-26ab9f19ec14 service neutron] Attempting to bind port 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 on network deef6d86-d3bd-4711-b0fe-ebca0c9737aa {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:26.622219 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-e796fee0-d6e0-4a0f-860e-26ab9f19ec14 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 29, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:30:26.623323 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-e796fee0-d6e0-4a0f-860e-26ab9f19ec14 service neutron] Checking segment: {'id': '758500a8-fda8-49cf-a84c-a7e78098b9e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'deef6d86-d3bd-4711-b0fe-ebca0c9737aa'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:30:26.623522 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-e796fee0-d6e0-4a0f-860e-26ab9f19ec14 service neutron] Bound using segment: {'id': '758500a8-fda8-49cf-a84c-a7e78098b9e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'deef6d86-d3bd-4711-b0fe-ebca0c9737aa'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:30:26.623961 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-e796fee0-d6e0-4a0f-860e-26ab9f19ec14 service neutron] Bound port: 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '758500a8-fda8-49cf-a84c-a7e78098b9e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': 'deef6d86-d3bd-4711-b0fe-ebca0c9737aa'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:30:26.624344 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-e796fee0-d6e0-4a0f-860e-26ab9f19ec14 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:30:26.648324 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:30:26.652998 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-303172ec-31a7-4ea2-8109-aa87743864a7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:26.658380 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-303172ec-31a7-4ea2-8109-aa87743864a7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:26.662881 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-303172ec-31a7-4ea2-8109-aa87743864a7 admin admin] 10.222.0.13 "DELETE /v2.0/networks/5b21d7bb-3cb6-4d1a-933f-9771c9a4e497 HTTP/1.1" status: 204 len: 168 time: 0.7167633 Dec 09 21:30:26.678584 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-303172ec-31a7-4ea2-8109-aa87743864a7 admin admin] Pushing event deleted for resources: {'Network': ['ID=5b21d7bb-3cb6-4d1a-933f-9771c9a4e497,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:26.727497 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-e796fee0-d6e0-4a0f-860e-26ab9f19ec14 service neutron] For port 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:30:26.736820 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-e796fee0-d6e0-4a0f-860e-26ab9f19ec14 service neutron] For port 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3d9c176b-4d74-466f-b7bd-8d44eae4a3f2,segment=NetworkSegment(758500a8-fda8-49cf-a84c-a7e78098b9e8),segment_id=758500a8-fda8-49cf-a84c-a7e78098b9e8)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:30:26.744342 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-e796fee0-d6e0-4a0f-860e-26ab9f19ec14 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:26.781956 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-e796fee0-d6e0-4a0f-860e-26ab9f19ec14 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:26.782612 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-e796fee0-d6e0-4a0f-860e-26ab9f19ec14 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:26.784171 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-e796fee0-d6e0-4a0f-860e-26ab9f19ec14 service neutron] 10.222.0.10 "PUT /v2.0/ports/3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 HTTP/1.1" status: 200 len: 1092 time: 0.7453918 Dec 09 21:30:26.784717 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '16ff2943-c2d6-4af7-9bbd-52443fde3d6e', 'tag': '3d9c176b-4d74-466f-b7bd-8d44eae4a3f2'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:30:26.786969 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-501dd7b4-8152-4827-b37d-51bdef08f59a" -d '{"events": [{"name": "network-changed", "server_uuid": "16ff2943-c2d6-4af7-9bbd-52443fde3d6e", "tag": "3d9c176b-4d74-466f-b7bd-8d44eae4a3f2"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:30:26.848623 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:30:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-91839d35-41f4-4eb8-a176-e1928c42465b x-openstack-request-id: req-91839d35-41f4-4eb8-a176-e1928c42465b {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:30:26.848929 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "16ff2943-c2d6-4af7-9bbd-52443fde3d6e", "tag": "3d9c176b-4d74-466f-b7bd-8d44eae4a3f2", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:30:26.849168 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-91839d35-41f4-4eb8-a176-e1928c42465b {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:30:26.849568 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '16ff2943-c2d6-4af7-9bbd-52443fde3d6e', 'tag': '3d9c176b-4d74-466f-b7bd-8d44eae4a3f2', 'status': 'completed', 'code': 200} Dec 09 21:30:26.873290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44230) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:26.894226 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e796fee0-d6e0-4a0f-860e-26ab9f19ec14 service neutron] Pushing event updated for resources: {'Port': ['ID=3d9c176b-4d74-466f-b7bd-8d44eae4a3f2,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:26.912566 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-02eddf41-11af-4c54-a490-d9c34f3ad052 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:26.914699 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-02eddf41-11af-4c54-a490-d9c34f3ad052 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0f8295f4c3534e24a63938170ba2425e&device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 1095 time: 0.0681050 Dec 09 21:30:26.962918 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-359eb99f-c870-4c86-ad9b-eaff109daa93 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 HTTP/1.1" status: 200 len: 217 time: 0.0387177 Dec 09 21:30:26.982143 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44236) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:27.046783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-df334103-11a4-4baa-83fd-dfcd12e7fff7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:27.049800 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-df334103-11a4-4baa-83fd-dfcd12e7fff7 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=86b80e39-7de5-4454-807b-0a1be07d2de3 HTTP/1.1" status: 200 len: 860 time: 0.0776618 Dec 09 21:30:27.076404 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-83d27726-2fb2-4a15-83ea-bdbc5ebc6fb3 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=c2ee958ddfcb4d6c9715806fe7564854&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0719635 Dec 09 21:30:27.079855 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44240) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:27.093242 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-6ecdbea4-a9c4-4e81-b147-0736a7779a41 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=deef6d86-d3bd-4711-b0fe-ebca0c9737aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0304880 Dec 09 21:30:27.175951 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04dc4622-121b-432b-bf63-b9bd5bfcd2cc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:27.188025 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:27.190586 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:27.198508 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e90e057d-0b3c-4a9a-b7aa-1fa05f466506 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:27.203152 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a593c11a-9955-487b-871c-d87440b7d7f6 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:30:27.292475 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e90e057d-0b3c-4a9a-b7aa-1fa05f466506 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:27.302790 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e90e057d-0b3c-4a9a-b7aa-1fa05f466506 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:27.336905 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e90e057d-0b3c-4a9a-b7aa-1fa05f466506 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=8c5fc24677bd457f9da1e93d95157bcd&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4594214 Dec 09 21:30:27.336905 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04dc4622-121b-432b-bf63-b9bd5bfcd2cc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:27.343838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44244) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:27.427636 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port a593c11a-9955-487b-871c-d87440b7d7f6 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:27.428015 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:27.428603 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e90e057d-0b3c-4a9a-b7aa-1fa05f466506 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1e68d38d-ad7e-43d5-93b6-abd7f4cbe8b1,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:27.469336 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c8a4cdd-66be-4e15-9fae-0b225621a566 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:27.498167 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04dc4622-121b-432b-bf63-b9bd5bfcd2cc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:27.500858 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04dc4622-121b-432b-bf63-b9bd5bfcd2cc admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:27.502063 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-04dc4622-121b-432b-bf63-b9bd5bfcd2cc admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/e654b672-7d47-4ee0-9e34-ab2f5987626f HTTP/1.1" status: 204 len: 168 time: 0.4212983 Dec 09 21:30:27.509377 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c8a4cdd-66be-4e15-9fae-0b225621a566 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:27.526247 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04dc4622-121b-432b-bf63-b9bd5bfcd2cc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e654b672-7d47-4ee0-9e34-ab2f5987626f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:27.597792 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c8a4cdd-66be-4e15-9fae-0b225621a566 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:27.600926 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c8a4cdd-66be-4e15-9fae-0b225621a566 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:27.602428 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5c8a4cdd-66be-4e15-9fae-0b225621a566 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/1e68d38d-ad7e-43d5-93b6-abd7f4cbe8b1 HTTP/1.1" status: 204 len: 168 time: 0.2572644 Dec 09 21:30:27.605727 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-a2105e5b-c602-4cf5-a88a-b733627247a7 service neutron] 10.222.0.10 "GET /v2.0/networks/deef6d86-d3bd-4711-b0fe-ebca0c9737aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5042789 Dec 09 21:30:27.613352 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c8a4cdd-66be-4e15-9fae-0b225621a566 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1e68d38d-ad7e-43d5-93b6-abd7f4cbe8b1,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:27.618359 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0018c334-20af-4556-a43f-e7f20154e1e2 req-a61a1f3f-abad-4674-89c0-36db97c7d3da tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:27.619899 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0018c334-20af-4556-a43f-e7f20154e1e2 req-a61a1f3f-abad-4674-89c0-36db97c7d3da tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 943 time: 0.0738039 Dec 09 21:30:27.748710 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0018c334-20af-4556-a43f-e7f20154e1e2 req-6f888e49-7f86-462c-891b-4b288e28fae7 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1189210 Dec 09 21:30:27.778031 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-849578bd-cbbf-48f6-a228-fff5114e98c4 req-b62bc017-d05a-442a-b8da-564df914ce1d service neutron] 10.222.0.10 "GET /v2.0/networks/deef6d86-d3bd-4711-b0fe-ebca0c9737aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1570981 Dec 09 21:30:27.972737 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-501dd7b4-8152-4827-b37d-51bdef08f59a req-51d37b5c-e7dd-46e7-bb18-6db9fdf6d252 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:27.974730 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-501dd7b4-8152-4827-b37d-51bdef08f59a req-51d37b5c-e7dd-46e7-bb18-6db9fdf6d252 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0f8295f4c3534e24a63938170ba2425e&device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 1095 time: 0.0796127 Dec 09 21:30:28.126865 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44272) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:28.142421 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-501dd7b4-8152-4827-b37d-51bdef08f59a req-0fb369cb-41da-4e08-b139-aaf26eed1fde service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:28.143972 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-501dd7b4-8152-4827-b37d-51bdef08f59a req-0fb369cb-41da-4e08-b139-aaf26eed1fde service neutron] 10.222.0.10 "GET /v2.0/networks?id=deef6d86-d3bd-4711-b0fe-ebca0c9737aa HTTP/1.1" status: 200 len: 921 time: 0.1598806 Dec 09 21:30:28.149401 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device ecdf312e-8304-4283-bcef-f24f46f66eee no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:30:28.180347 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-23eab04b-4496-4524-9751-db1153868c4d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:28.186213 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: ecdf312e-8304-4283-bcef-f24f46f66eee {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:30:28.186848 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device ecdf312e-8304-4283-bcef-f24f46f66eee not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:30:28.206400 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-501dd7b4-8152-4827-b37d-51bdef08f59a req-35a13aad-53b0-4b77-ac8d-348af941a8bb service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 HTTP/1.1" status: 200 len: 217 time: 0.0514119 Dec 09 21:30:28.285323 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-501dd7b4-8152-4827-b37d-51bdef08f59a req-f0dab5c8-f97f-448c-898f-04e2b9fc461a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:28.286873 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-501dd7b4-8152-4827-b37d-51bdef08f59a req-f0dab5c8-f97f-448c-898f-04e2b9fc461a service neutron] 10.222.0.10 "GET /v2.0/subnets?id=86b80e39-7de5-4454-807b-0a1be07d2de3 HTTP/1.1" status: 200 len: 860 time: 0.0604846 Dec 09 21:30:28.294915 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-23eab04b-4496-4524-9751-db1153868c4d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:28.300242 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-23eab04b-4496-4524-9751-db1153868c4d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:28.326196 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-501dd7b4-8152-4827-b37d-51bdef08f59a req-9955d5a7-ad50-48a8-ac4b-90b5d927ee77 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=deef6d86-d3bd-4711-b0fe-ebca0c9737aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0298405 Dec 09 21:30:28.337167 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-23eab04b-4496-4524-9751-db1153868c4d admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=be86bfe073044f8cb81e82a301c8ea65&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1973076 Dec 09 21:30:28.344129 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44274) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:28.371246 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23eab04b-4496-4524-9751-db1153868c4d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b04fa8c9-6fa4-4c65-aa31-713662c6c9e9,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:28.434443 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-41555f1d-bb0d-4d92-950a-35ace617ec12 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:28.462153 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-41555f1d-bb0d-4d92-950a-35ace617ec12 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:28.474836 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-501dd7b4-8152-4827-b37d-51bdef08f59a req-de2bd861-be80-4ad7-8079-ab9256da6ec9 service neutron] 10.222.0.10 "GET /v2.0/networks/deef6d86-d3bd-4711-b0fe-ebca0c9737aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1392453 Dec 09 21:30:28.518354 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-41555f1d-bb0d-4d92-950a-35ace617ec12 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:28.521337 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-41555f1d-bb0d-4d92-950a-35ace617ec12 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:28.523695 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-41555f1d-bb0d-4d92-950a-35ace617ec12 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/b04fa8c9-6fa4-4c65-aa31-713662c6c9e9 HTTP/1.1" status: 204 len: 168 time: 0.1783965 Dec 09 21:30:28.534615 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41555f1d-bb0d-4d92-950a-35ace617ec12 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b04fa8c9-6fa4-4c65-aa31-713662c6c9e9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:28.608864 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-501dd7b4-8152-4827-b37d-51bdef08f59a req-4f08eb47-82f7-4b96-8220-f2e9866e551e service neutron] 10.222.0.10 "GET /v2.0/networks/deef6d86-d3bd-4711-b0fe-ebca0c9737aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1238563 Dec 09 21:30:28.921189 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7340897-ef19-4eef-9502-a4eb1290362d req-a5e60ad2-9760-4acc-b4e2-6a30dd9d6512 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:28.931425 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7340897-ef19-4eef-9502-a4eb1290362d req-a5e60ad2-9760-4acc-b4e2-6a30dd9d6512 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 943 time: 0.0768654 Dec 09 21:30:29.027809 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7340897-ef19-4eef-9502-a4eb1290362d req-1694a438-f53a-4945-a9aa-393bf1ee2f82 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0882177 Dec 09 21:30:29.343613 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44326) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:29.607552 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f4b927d-edfd-4585-b472-5dcfa770ec3d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:29.693049 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f4b927d-edfd-4585-b472-5dcfa770ec3d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:29.697963 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f4b927d-edfd-4585-b472-5dcfa770ec3d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:29.738314 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3f4b927d-edfd-4585-b472-5dcfa770ec3d admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=b287200464274662937c4b4f5878a8de&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3949919 Dec 09 21:30:29.741510 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44336) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:29.743064 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f4b927d-edfd-4585-b472-5dcfa770ec3d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=efcf1119-1acb-426f-8884-d8456a1b49a9,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:29.815099 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01a74e89-f838-431d-b348-b2f0465f6884 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:29.842643 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01a74e89-f838-431d-b348-b2f0465f6884 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:29.876377 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:30:29.911776 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01a74e89-f838-431d-b348-b2f0465f6884 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:29.917268 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01a74e89-f838-431d-b348-b2f0465f6884 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:29.919608 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-01a74e89-f838-431d-b348-b2f0465f6884 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/efcf1119-1acb-426f-8884-d8456a1b49a9 HTTP/1.1" status: 204 len: 168 time: 0.1761010 Dec 09 21:30:29.931559 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01a74e89-f838-431d-b348-b2f0465f6884 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=efcf1119-1acb-426f-8884-d8456a1b49a9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:30.036500 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3d9c176b-4d74-466f-b7bd-8d44eae4a3f2,segment=NetworkSegment(758500a8-fda8-49cf-a84c-a7e78098b9e8),segment_id=758500a8-fda8-49cf-a84c-a7e78098b9e8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:30.056391 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '3d9c176b-4d74-466f-b7bd-8d44eae4a3f2', 'network_id': 'deef6d86-d3bd-4711-b0fe-ebca0c9737aa', 'port_id': '3d9c176b-4d74-466f-b7bd-8d44eae4a3f2', 'mac_address': 'fa:16:3e:14:5d:29', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 129, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '86b80e39-7de5-4454-807b-0a1be07d2de3', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:30:30.133303 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:30.152672 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:30:30.194931 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3d9c176b-4d74-466f-b7bd-8d44eae4a3f2,segment=NetworkSegment(758500a8-fda8-49cf-a84c-a7e78098b9e8),segment_id=758500a8-fda8-49cf-a84c-a7e78098b9e8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:30.201659 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:30.283859 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e01ae17c-4af2-400d-9b2b-53810a9aefc2 req-701ee82e-41cf-4ec7-84a7-441d9096a8fb tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:30.288082 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e01ae17c-4af2-400d-9b2b-53810a9aefc2 req-701ee82e-41cf-4ec7-84a7-441d9096a8fb tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 943 time: 0.1218598 Dec 09 21:30:30.312425 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=3d9c176b-4d74-466f-b7bd-8d44eae4a3f2,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:30.400766 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e01ae17c-4af2-400d-9b2b-53810a9aefc2 req-76694ee7-bcdf-4cd2-b20d-a6a236b1fedc tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1019750 Dec 09 21:30:30.592075 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['3d9c176b-4d74-466f-b7bd-8d44eae4a3f2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:30:31.013282 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44392) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:31.134691 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c8df8b29-597f-42d8-b465-d100b2d78635 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-1079676770-network', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:31.170329 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c8df8b29-597f-42d8-b465-d100b2d78635 admin admin] Made reservation on behalf of aacb3291db4d4252a9225e8fe617f667 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:30:31.173047 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c8df8b29-597f-42d8-b465-d100b2d78635 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:31.191028 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c8df8b29-597f-42d8-b465-d100b2d78635 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:31.306106 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c8df8b29-597f-42d8-b465-d100b2d78635 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:31.311170 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c8df8b29-597f-42d8-b465-d100b2d78635 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:31.341810 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8df8b29-597f-42d8-b465-d100b2d78635 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9842a51d-6296-4920-8474-10ad60f68659,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:31.367169 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c8df8b29-597f-42d8-b465-d100b2d78635 admin admin] vlan segment allocate from pool success with {'vlan_id': 125, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:30:31.379796 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c8df8b29-597f-42d8-b465-d100b2d78635 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:31.380140 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-c8df8b29-597f-42d8-b465-d100b2d78635 admin admin] Added segment d3bafd14-6a72-4dc5-8e4d-11da22a389ed of type vlan for network 935b09ce-7410-4b66-82be-99978deb6717 Dec 09 21:30:31.444179 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c8df8b29-597f-42d8-b465-d100b2d78635 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:31.484281 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c8df8b29-597f-42d8-b465-d100b2d78635 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:31.486240 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8df8b29-597f-42d8-b465-d100b2d78635 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:31.487572 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c8df8b29-597f-42d8-b465-d100b2d78635 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:31.567572 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c8df8b29-597f-42d8-b465-d100b2d78635 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.5485351 Dec 09 21:30:31.568702 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44414) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:31.574426 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-58af19b6-f99b-42f7-9036-e4ebbff1d095 admin admin] Request body: {'subnet': {'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-1079676770-subnet', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:31.618081 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8df8b29-597f-42d8-b465-d100b2d78635 admin admin] Pushing event updated for resources: {'Network': ['ID=935b09ce-7410-4b66-82be-99978deb6717,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:31.629721 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 935b09ce-7410-4b66-82be-99978deb6717 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:30:31.646667 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-196aff47-a0c3-4190-9799-c5dffba28298 req-3e82d1f0-b460-46b3-a40d-58eb962cbdca tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:31.658951 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-58af19b6-f99b-42f7-9036-e4ebbff1d095 admin admin] Made reservation on behalf of aacb3291db4d4252a9225e8fe617f667 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:30:31.664965 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58af19b6-f99b-42f7-9036-e4ebbff1d095 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:31.665706 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-196aff47-a0c3-4190-9799-c5dffba28298 req-3e82d1f0-b460-46b3-a40d-58eb962cbdca tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 944 time: 0.1680281 Dec 09 21:30:31.804850 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-196aff47-a0c3-4190-9799-c5dffba28298 req-002345a7-fa92-49bf-bdfe-8788642a4613 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1376164 Dec 09 21:30:31.948369 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58af19b6-f99b-42f7-9036-e4ebbff1d095 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:32.016983 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58af19b6-f99b-42f7-9036-e4ebbff1d095 admin admin] Pushing event updated for resources: {'Subnet': ['ID=10ff3f47-d1f4-47a0-808e-f885899dfb29,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:32.043376 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44424) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:32.057931 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58af19b6-f99b-42f7-9036-e4ebbff1d095 admin admin] Checking segment: {'id': 'd3bafd14-6a72-4dc5-8e4d-11da22a389ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '935b09ce-7410-4b66-82be-99978deb6717'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:30:32.059326 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-58af19b6-f99b-42f7-9036-e4ebbff1d095 admin admin] Network hostable DHCP agents. Network: 935b09ce-7410-4b66-82be-99978deb6717, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:30:32.089763 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-58af19b6-f99b-42f7-9036-e4ebbff1d095 admin admin] Network 935b09ce-7410-4b66-82be-99978deb6717 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:30:32.106622 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-58af19b6-f99b-42f7-9036-e4ebbff1d095 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 935b09ce-7410-4b66-82be-99978deb6717) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:30:32.120488 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-58af19b6-f99b-42f7-9036-e4ebbff1d095 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:32.120488 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58af19b6-f99b-42f7-9036-e4ebbff1d095 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:32.121283 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46ebd820-c3c7-4e10-9a09-ab5da713c3d4 None None] Network 935b09ce-7410-4b66-82be-99978deb6717 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:30:32.143119 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44430) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:32.143817 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-58af19b6-f99b-42f7-9036-e4ebbff1d095 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.5731454 Dec 09 21:30:32.149109 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-b99c8ea2-1231-4753-9c81-e326be17a269 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-1079676770-router', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:32.179875 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b99c8ea2-1231-4753-9c81-e326be17a269 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:32.181241 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b99c8ea2-1231-4753-9c81-e326be17a269 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:32.269393 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b99c8ea2-1231-4753-9c81-e326be17a269 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:32.272757 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c662844d-8ee5-4b35-b2e6-e0422f2b92e9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:32.321275 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68011be7-10d6-45d6-a50d-9de2d5e03866 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-935b09ce-7410-4b66-82be-99978deb6717', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'fixed_ips': [{'subnet_id': '10ff3f47-d1f4-47a0-808e-f885899dfb29'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:30:32.322430 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-68011be7-10d6-45d6-a50d-9de2d5e03866 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:32.489966 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b99c8ea2-1231-4753-9c81-e326be17a269 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:32.571836 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-68011be7-10d6-45d6-a50d-9de2d5e03866 None None] Allocated IP 172.20.0.2 (935b09ce-7410-4b66-82be-99978deb6717/10ff3f47-d1f4-47a0-808e-f885899dfb29/b8354390-a3b8-468e-b70c-d491e3ea4213) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:30:32.579769 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c662844d-8ee5-4b35-b2e6-e0422f2b92e9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:32.627557 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c662844d-8ee5-4b35-b2e6-e0422f2b92e9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:32.698911 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c662844d-8ee5-4b35-b2e6-e0422f2b92e9 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=8e62f8ccf25e4198a8b5962c30f3a1a9&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6538601 Dec 09 21:30:32.702860 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44442) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:32.722018 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c662844d-8ee5-4b35-b2e6-e0422f2b92e9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7991a5ea-c022-4db9-924e-fd922ae1c411,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:32.818148 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-68011be7-10d6-45d6-a50d-9de2d5e03866 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:32.827789 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-68011be7-10d6-45d6-a50d-9de2d5e03866 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:32.851528 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d9fbdba-2741-4f2d-a9c8-fdcfc0be9b53 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:32.884888 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68011be7-10d6-45d6-a50d-9de2d5e03866 None None] Network 935b09ce-7410-4b66-82be-99978deb6717 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:30:32.896246 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-68011be7-10d6-45d6-a50d-9de2d5e03866 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:30:32.898876 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d9fbdba-2741-4f2d-a9c8-fdcfc0be9b53 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:32.908139 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68011be7-10d6-45d6-a50d-9de2d5e03866 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:30:32.995813 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68011be7-10d6-45d6-a50d-9de2d5e03866 None None] Pushing event updated for resources: {'Port': ['ID=b8354390-a3b8-468e-b70c-d491e3ea4213,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:33.013555 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b99c8ea2-1231-4753-9c81-e326be17a269 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:33.032618 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d9fbdba-2741-4f2d-a9c8-fdcfc0be9b53 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:33.043029 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d9fbdba-2741-4f2d-a9c8-fdcfc0be9b53 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:33.044215 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9d9fbdba-2741-4f2d-a9c8-fdcfc0be9b53 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/7991a5ea-c022-4db9-924e-fd922ae1c411 HTTP/1.1" status: 204 len: 168 time: 0.3394065 Dec 09 21:30:33.045499 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1ce7c48d-5b22-4da6-8409-f14cb46b5340 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:33.055617 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-68011be7-10d6-45d6-a50d-9de2d5e03866 None None] Attempting to bind port b8354390-a3b8-468e-b70c-d491e3ea4213 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:33.056001 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-68011be7-10d6-45d6-a50d-9de2d5e03866 None None] Attempting to bind port b8354390-a3b8-468e-b70c-d491e3ea4213 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'd3bafd14-6a72-4dc5-8e4d-11da22a389ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '935b09ce-7410-4b66-82be-99978deb6717'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:33.056473 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68011be7-10d6-45d6-a50d-9de2d5e03866 None None] Attempting to bind port b8354390-a3b8-468e-b70c-d491e3ea4213 on network 935b09ce-7410-4b66-82be-99978deb6717 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:33.072183 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68011be7-10d6-45d6-a50d-9de2d5e03866 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 30, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:30:33.072453 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b99c8ea2-1231-4753-9c81-e326be17a269 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:33.072563 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68011be7-10d6-45d6-a50d-9de2d5e03866 None None] Checking segment: {'id': 'd3bafd14-6a72-4dc5-8e4d-11da22a389ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '935b09ce-7410-4b66-82be-99978deb6717'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:30:33.073312 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d9fbdba-2741-4f2d-a9c8-fdcfc0be9b53 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7991a5ea-c022-4db9-924e-fd922ae1c411,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:33.074768 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-68011be7-10d6-45d6-a50d-9de2d5e03866 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:33.075158 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68011be7-10d6-45d6-a50d-9de2d5e03866 None None] Bound using segment: {'id': 'd3bafd14-6a72-4dc5-8e4d-11da22a389ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '935b09ce-7410-4b66-82be-99978deb6717'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:30:33.080337 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-68011be7-10d6-45d6-a50d-9de2d5e03866 None None] Bound port: b8354390-a3b8-468e-b70c-d491e3ea4213, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd3bafd14-6a72-4dc5-8e4d-11da22a389ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '935b09ce-7410-4b66-82be-99978deb6717'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:30:33.080750 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-68011be7-10d6-45d6-a50d-9de2d5e03866 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:33.108454 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6f8eac0-9eef-438c-bed0-62a9706ebc5e req-db955bcd-71b4-495b-a6fb-2982c5a75368 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:33.123526 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6f8eac0-9eef-438c-bed0-62a9706ebc5e req-db955bcd-71b4-495b-a6fb-2982c5a75368 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 944 time: 0.1965373 Dec 09 21:30:33.228134 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-68011be7-10d6-45d6-a50d-9de2d5e03866 None None] For port b8354390-a3b8-468e-b70c-d491e3ea4213, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:30:33.232102 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-68011be7-10d6-45d6-a50d-9de2d5e03866 None None] For port b8354390-a3b8-468e-b70c-d491e3ea4213, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b8354390-a3b8-468e-b70c-d491e3ea4213,segment=NetworkSegment(d3bafd14-6a72-4dc5-8e4d-11da22a389ed),segment_id=d3bafd14-6a72-4dc5-8e4d-11da22a389ed)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:30:33.240342 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-68011be7-10d6-45d6-a50d-9de2d5e03866 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:33.373494 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68011be7-10d6-45d6-a50d-9de2d5e03866 None None] Pushing event updated for resources: {'Port': ['ID=b8354390-a3b8-468e-b70c-d491e3ea4213,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:33.382469 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6f8eac0-9eef-438c-bed0-62a9706ebc5e req-c3d0e9aa-3518-4133-bbf7-379bd38c8127 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2417436 Dec 09 21:30:33.458489 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-b99c8ea2-1231-4753-9c81-e326be17a269 admin admin] Allocated IP 172.25.3.210 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/6cf4ffbd-1ca6-4dd1-a033-c481be40b106) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:30:33.734861 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b99c8ea2-1231-4753-9c81-e326be17a269 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:33.780279 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44458) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:33.801919 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2cc42d39-1c35-49cd-97ed-be045742beaa admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:33.816086 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b99c8ea2-1231-4753-9c81-e326be17a269 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:33.878933 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b99c8ea2-1231-4753-9c81-e326be17a269 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:30:33.883376 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-b99c8ea2-1231-4753-9c81-e326be17a269 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:30:33.886482 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b99c8ea2-1231-4753-9c81-e326be17a269 admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:30:33.915196 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:30:33.958560 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b99c8ea2-1231-4753-9c81-e326be17a269 admin admin] Pushing event updated for resources: {'Port': ['ID=6cf4ffbd-1ca6-4dd1-a033-c481be40b106,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:33.983697 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2cc42d39-1c35-49cd-97ed-be045742beaa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:33.991116 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2cc42d39-1c35-49cd-97ed-be045742beaa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:34.042053 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:30:34.049176 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:34.049497 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:34.054597 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cc42d39-1c35-49cd-97ed-be045742beaa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a5303a33-8297-44c8-8b21-57d747d7c8da,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:34.064238 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2cc42d39-1c35-49cd-97ed-be045742beaa admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=647bda00f5b145829566c91d4f0d43d5&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2819643 Dec 09 21:30:34.065156 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44462) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:34.141277 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d71774c-6a14-459a-bb21-8b06de022ddf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:34.173337 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d71774c-6a14-459a-bb21-8b06de022ddf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:34.214923 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:34.255590 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '16ff2943-c2d6-4af7-9bbd-52443fde3d6e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3d9c176b-4d74-466f-b7bd-8d44eae4a3f2'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:30:34.258031 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f771a218-f574-4f0f-8f3a-b3c3718b78fa" -d '{"events": [{"server_uuid": "16ff2943-c2d6-4af7-9bbd-52443fde3d6e", "name": "network-vif-plugged", "status": "completed", "tag": "3d9c176b-4d74-466f-b7bd-8d44eae4a3f2"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:30:34.262372 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d71774c-6a14-459a-bb21-8b06de022ddf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:34.266694 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d71774c-6a14-459a-bb21-8b06de022ddf admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:34.269710 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5d71774c-6a14-459a-bb21-8b06de022ddf admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/a5303a33-8297-44c8-8b21-57d747d7c8da HTTP/1.1" status: 204 len: 168 time: 0.2016475 Dec 09 21:30:34.281971 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d71774c-6a14-459a-bb21-8b06de022ddf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a5303a33-8297-44c8-8b21-57d747d7c8da,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:34.307788 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3d9c176b-4d74-466f-b7bd-8d44eae4a3f2,segment=NetworkSegment(758500a8-fda8-49cf-a84c-a7e78098b9e8),segment_id=758500a8-fda8-49cf-a84c-a7e78098b9e8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:34.316850 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:34.317134 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b99c8ea2-1231-4753-9c81-e326be17a269 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:34.389093 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:30:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6dbf33ee-802b-423a-afe9-c4d52fc60141 x-openstack-request-id: req-6dbf33ee-802b-423a-afe9-c4d52fc60141 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:30:34.389588 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "16ff2943-c2d6-4af7-9bbd-52443fde3d6e", "name": "network-vif-plugged", "status": "completed", "tag": "3d9c176b-4d74-466f-b7bd-8d44eae4a3f2", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:30:34.389706 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-6dbf33ee-802b-423a-afe9-c4d52fc60141 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:30:34.391132 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '16ff2943-c2d6-4af7-9bbd-52443fde3d6e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3d9c176b-4d74-466f-b7bd-8d44eae4a3f2', 'code': 200} Dec 09 21:30:34.490883 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=3d9c176b-4d74-466f-b7bd-8d44eae4a3f2,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:34.724736 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b99c8ea2-1231-4753-9c81-e326be17a269 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:34.728560 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf394f55-df4f-4feb-ae59-b3b307077a7a req-5fac1b35-6ea8-4fb0-9358-07216bcae53e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:34.730320 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf394f55-df4f-4feb-ae59-b3b307077a7a req-5fac1b35-6ea8-4fb0-9358-07216bcae53e service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 1097 time: 0.2487285 Dec 09 21:30:34.745622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91e06d50-be56-4b99-b38b-8fe706a5a595 req-4beb00db-09b1-4d9c-8fc8-df85afccfe77 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:34.749094 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-91e06d50-be56-4b99-b38b-8fe706a5a595 req-4beb00db-09b1-4d9c-8fc8-df85afccfe77 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.1751862 Dec 09 21:30:35.006782 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-91e06d50-be56-4b99-b38b-8fe706a5a595 req-7b8ceabb-ecde-41b7-b5d8-18a8ddf68ade tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2395296 Dec 09 21:30:35.018307 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf394f55-df4f-4feb-ae59-b3b307077a7a req-8f403a5d-d2b6-46e8-ba27-0582f50cc5ae service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2680249 Dec 09 21:30:35.097621 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b99c8ea2-1231-4753-9c81-e326be17a269 admin admin] Router a0406620-d595-409c-958d-7a486a49577c is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:30:35.136603 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33acd381-45cb-4a17-b967-3f1df2e43466 None None] Network 935b09ce-7410-4b66-82be-99978deb6717 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:30:35.311594 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b8354390-a3b8-468e-b70c-d491e3ea4213 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:30:35.329044 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b99c8ea2-1231-4753-9c81-e326be17a269 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:30:35.343425 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] Sync routers for ids ['a0406620-d595-409c-958d-7a486a49577c'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:30:35.366325 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f9634588-8e0c-46a5-9895-6085c17eb400 None None] Provisioning complete for port b8354390-a3b8-468e-b70c-d491e3ea4213 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:35.366492 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] Routers {'a0406620-d595-409c-958d-7a486a49577c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:30:35.366578 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f9634588-8e0c-46a5-9895-6085c17eb400 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:35.366832 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:30:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a0406620-d595-409c-958d-7a486a49577c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:35.387417 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b99c8ea2-1231-4753-9c81-e326be17a269 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:35.389476 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b99c8ea2-1231-4753-9c81-e326be17a269 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 3.2443876 Dec 09 21:30:35.392476 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44502) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:35.552079 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port b8354390-a3b8-468e-b70c-d491e3ea4213 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:35.552839 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:35.562345 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-06af2369-1228-4dd5-be02-72895a2e389f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:35.656822 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] Set router a0406620-d595-409c-958d-7a486a49577c gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:30:35.886799 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f9634588-8e0c-46a5-9895-6085c17eb400 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:36.035810 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f9634588-8e0c-46a5-9895-6085c17eb400 None None] For port b8354390-a3b8-468e-b70c-d491e3ea4213, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b8354390-a3b8-468e-b70c-d491e3ea4213,segment=NetworkSegment(d3bafd14-6a72-4dc5-8e4d-11da22a389ed),segment_id=d3bafd14-6a72-4dc5-8e4d-11da22a389ed)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:36.070394 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0406620-d595-409c-958d-7a486a49577c', 'name': 'tempest-AttachVolumeTestJSON-1079676770-router', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210'}], 'enable_snat': True}, 'gw_port_id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:32Z', 'updated_at': '2021-12-09T21:30:34Z', 'revision_number': 3, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'gw_port': {'id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:0e:fb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1399, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:33Z', 'updated_at': '2021-12-09T21:30:33Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:36.118085 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] Checking router: a0406620-d595-409c-958d-7a486a49577c for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:30:36.118666 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] Updating router a0406620-d595-409c-958d-7a486a49577c port 6cf4ffbd-1ca6-4dd1-a033-c481be40b106 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:30:36.134636 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f9634588-8e0c-46a5-9895-6085c17eb400 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:36.190575 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:36.407189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9634588-8e0c-46a5-9895-6085c17eb400 None None] Pushing event updated for resources: {'Port': ['ID=b8354390-a3b8-468e-b70c-d491e3ea4213,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:36.432261 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6fc2e351-347c-49d3-985d-f9dc92f00857 None None] Provisioning complete for port b8354390-a3b8-468e-b70c-d491e3ea4213 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:36.436053 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6fc2e351-347c-49d3-985d-f9dc92f00857 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:36.674252 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:36.879651 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-434e7591-89e5-487a-bb34-2adae321014f req-97334a20-a6a0-4156-b68d-190d84421fbf tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:36.888662 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-434e7591-89e5-487a-bb34-2adae321014f req-97334a20-a6a0-4156-b68d-190d84421fbf tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.2165027 Dec 09 21:30:36.928616 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eccbb4cd-b99c-4ddc-911a-52e2c8ee3ff1 req-1d1466b1-0fdb-48ad-bf02-d7854fc7fc7d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:36.928616 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eccbb4cd-b99c-4ddc-911a-52e2c8ee3ff1 req-1d1466b1-0fdb-48ad-bf02-d7854fc7fc7d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 1.0234871 Dec 09 21:30:36.968470 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:36.977650 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:37.041999 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] Attempting to bind port 6cf4ffbd-1ca6-4dd1-a033-c481be40b106 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:37.042372 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] Attempting to bind port 6cf4ffbd-1ca6-4dd1-a033-c481be40b106 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:37.042936 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] Attempting to bind port 6cf4ffbd-1ca6-4dd1-a033-c481be40b106 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:37.056478 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 30, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:30:37.056863 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:30:37.057417 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:37.057812 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:30:37.058283 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] Bound port: 6cf4ffbd-1ca6-4dd1-a033-c481be40b106, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:30:37.058674 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:37.060604 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91f838e4-5f4c-44f2-b8dd-f9f1bce75f38 None None] Pushing event updated for resources: {'Port': ['ID=6cf4ffbd-1ca6-4dd1-a033-c481be40b106,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:37.092096 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-434e7591-89e5-487a-bb34-2adae321014f req-4250456e-ea55-4e46-800d-7399bcf0b13b tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2014923 Dec 09 21:30:37.092645 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f838e4-5f4c-44f2-b8dd-f9f1bce75f38 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:37.092995 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f838e4-5f4c-44f2-b8dd-f9f1bce75f38 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:37.093383 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f838e4-5f4c-44f2-b8dd-f9f1bce75f38 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:37.093721 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f838e4-5f4c-44f2-b8dd-f9f1bce75f38 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:37.094051 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f838e4-5f4c-44f2-b8dd-f9f1bce75f38 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:37.094380 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f838e4-5f4c-44f2-b8dd-f9f1bce75f38 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:37.094793 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f838e4-5f4c-44f2-b8dd-f9f1bce75f38 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:37.095116 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f838e4-5f4c-44f2-b8dd-f9f1bce75f38 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:37.095639 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f838e4-5f4c-44f2-b8dd-f9f1bce75f38 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:37.096007 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f838e4-5f4c-44f2-b8dd-f9f1bce75f38 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:37.096379 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f838e4-5f4c-44f2-b8dd-f9f1bce75f38 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:37.096798 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f838e4-5f4c-44f2-b8dd-f9f1bce75f38 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:37.099462 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f838e4-5f4c-44f2-b8dd-f9f1bce75f38 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:37.136985 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] For port 6cf4ffbd-1ca6-4dd1-a033-c481be40b106, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:30:37.150998 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] For port 6cf4ffbd-1ca6-4dd1-a033-c481be40b106, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6cf4ffbd-1ca6-4dd1-a033-c481be40b106,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:30:37.158778 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:37.182313 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eccbb4cd-b99c-4ddc-911a-52e2c8ee3ff1 req-2caf9514-8e45-480e-ba79-dd51b8e3b5a0 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2387743 Dec 09 21:30:37.189887 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9558aedf-00be-47d9-9242-7a9b8c6ac42e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:37.321007 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b8354390-a3b8-468e-b70c-d491e3ea4213 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:30:37.321325 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] Routers {'a0406620-d595-409c-958d-7a486a49577c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:30:37.321936 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:30:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a0406620-d595-409c-958d-7a486a49577c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:37.327302 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91f838e4-5f4c-44f2-b8dd-f9f1bce75f38 None None] Pushing event updated for resources: {'Port': ['ID=6cf4ffbd-1ca6-4dd1-a033-c481be40b106,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:37.461879 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] Set router a0406620-d595-409c-958d-7a486a49577c gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:30:37.480648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port b8354390-a3b8-468e-b70c-d491e3ea4213 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:37.481395 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:37.614797 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-9558aedf-00be-47d9-9242-7a9b8c6ac42e admin admin] Allocated IP 172.20.0.1 (935b09ce-7410-4b66-82be-99978deb6717/10ff3f47-d1f4-47a0-808e-f885899dfb29/dbff506a-7b73-4238-9fda-dd193910d0ce) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:30:37.761642 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9558aedf-00be-47d9-9242-7a9b8c6ac42e admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:37.860842 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0406620-d595-409c-958d-7a486a49577c', 'name': 'tempest-AttachVolumeTestJSON-1079676770-router', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210'}], 'enable_snat': True}, 'gw_port_id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:32Z', 'updated_at': '2021-12-09T21:30:34Z', 'revision_number': 3, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'gw_port': {'id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:0e:fb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1399, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:33Z', 'updated_at': '2021-12-09T21:30:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:37.874314 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9558aedf-00be-47d9-9242-7a9b8c6ac42e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:37.902971 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:37.919324 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86a7298b-f714-44a6-8907-deeadccd4c4d None None] The sync data for ids ['a0406620-d595-409c-958d-7a486a49577c'] in n-d-713301-27 is: [{'id': 'a0406620-d595-409c-958d-7a486a49577c', 'name': 'tempest-AttachVolumeTestJSON-1079676770-router', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210'}], 'enable_snat': True}, 'gw_port_id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:32Z', 'updated_at': '2021-12-09T21:30:34Z', 'revision_number': 3, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'gw_port': {'id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:0e:fb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1399, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:33Z', 'updated_at': '2021-12-09T21:30:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:30:37.983516 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ad83da9-2ad8-4271-aced-2f2ca4079ca9 req-0f8c7bdf-b9f6-4607-bc1f-6fbc4e8640b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:37.985079 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ad83da9-2ad8-4271-aced-2f2ca4079ca9 req-0f8c7bdf-b9f6-4607-bc1f-6fbc4e8640b5 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0f8295f4c3534e24a63938170ba2425e&device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 1097 time: 0.1959147 Dec 09 21:30:37.987629 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9558aedf-00be-47d9-9242-7a9b8c6ac42e admin admin] Network 935b09ce-7410-4b66-82be-99978deb6717 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:30:37.998098 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-9558aedf-00be-47d9-9242-7a9b8c6ac42e admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:30:38.014766 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9558aedf-00be-47d9-9242-7a9b8c6ac42e admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:30:38.180374 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9558aedf-00be-47d9-9242-7a9b8c6ac42e admin admin] Pushing event updated for resources: {'Port': ['ID=dbff506a-7b73-4238-9fda-dd193910d0ce,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:38.199294 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ee9e55a-1fc6-4119-b3e7-5e6b1429b630 req-b325f37f-8918-42e4-848f-30aaf54424c3 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:38.210574 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3ee9e55a-1fc6-4119-b3e7-5e6b1429b630 req-b325f37f-8918-42e4-848f-30aaf54424c3 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.3595176 Dec 09 21:30:38.245507 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ad83da9-2ad8-4271-aced-2f2ca4079ca9 req-511965f6-2518-44cc-bdff-f8bd1b375e64 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:38.253001 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ad83da9-2ad8-4271-aced-2f2ca4079ca9 req-511965f6-2518-44cc-bdff-f8bd1b375e64 service neutron] 10.222.0.10 "GET /v2.0/networks?id=deef6d86-d3bd-4711-b0fe-ebca0c9737aa HTTP/1.1" status: 200 len: 921 time: 0.2518451 Dec 09 21:30:38.477736 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ad83da9-2ad8-4271-aced-2f2ca4079ca9 req-f34e873d-a2b6-44a4-892d-573edba764e0 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 HTTP/1.1" status: 200 len: 217 time: 0.1496608 Dec 09 21:30:38.478478 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9558aedf-00be-47d9-9242-7a9b8c6ac42e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:38.488799 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-689ee514-615a-4923-a456-6c8fc952d48d None None] Provisioning complete for port dbff506a-7b73-4238-9fda-dd193910d0ce triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:38.489345 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-689ee514-615a-4923-a456-6c8fc952d48d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:38.557545 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-689ee514-615a-4923-a456-6c8fc952d48d None None] Port dbff506a-7b73-4238-9fda-dd193910d0ce cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:30:38.601214 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3ee9e55a-1fc6-4119-b3e7-5e6b1429b630 req-95d14a06-9cd0-41ae-828d-284e1648421a tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3868244 Dec 09 21:30:38.684867 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ad83da9-2ad8-4271-aced-2f2ca4079ca9 req-9c0d3221-7878-40ae-8d37-c8f016141c90 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:38.686823 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ad83da9-2ad8-4271-aced-2f2ca4079ca9 req-9c0d3221-7878-40ae-8d37-c8f016141c90 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=86b80e39-7de5-4454-807b-0a1be07d2de3 HTTP/1.1" status: 200 len: 860 time: 0.1526911 Dec 09 21:30:38.706555 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c897788-99f2-48d0-8ba3-4d02e925f98f req-32037b35-55ea-438c-adba-a134ad06a1b7 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:38.708385 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4c897788-99f2-48d0-8ba3-4d02e925f98f req-32037b35-55ea-438c-adba-a134ad06a1b7 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.3554506 Dec 09 21:30:38.777211 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ad83da9-2ad8-4271-aced-2f2ca4079ca9 req-e19f2c63-f207-4712-b56c-2074e57c1c53 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=deef6d86-d3bd-4711-b0fe-ebca0c9737aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0655181 Dec 09 21:30:38.949957 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9558aedf-00be-47d9-9242-7a9b8c6ac42e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:38.964981 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4c897788-99f2-48d0-8ba3-4d02e925f98f req-902d58c4-65e9-43d8-9e50-edcd5ec8805c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2355387 Dec 09 21:30:39.014785 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44602) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:39.161236 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ad83da9-2ad8-4271-aced-2f2ca4079ca9 req-998b5b31-0f81-46c3-9b20-f2404d2608fe service neutron] 10.222.0.10 "GET /v2.0/networks/deef6d86-d3bd-4711-b0fe-ebca0c9737aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3605261 Dec 09 21:30:39.244548 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-826bc62d-8d0a-4e4b-9535-2d801f1e04b7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:39.310932 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6cf4ffbd-1ca6-4dd1-a033-c481be40b106 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:30:39.366633 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-826bc62d-8d0a-4e4b-9535-2d801f1e04b7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:39.372446 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-826bc62d-8d0a-4e4b-9535-2d801f1e04b7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:39.423086 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ad83da9-2ad8-4271-aced-2f2ca4079ca9 req-f4c53cd9-9c82-4a48-b9cd-36ec349bc350 service neutron] 10.222.0.10 "GET /v2.0/networks/deef6d86-d3bd-4711-b0fe-ebca0c9737aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2520559 Dec 09 21:30:39.424200 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 6cf4ffbd-1ca6-4dd1-a033-c481be40b106 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:39.425145 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:39.443532 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-826bc62d-8d0a-4e4b-9535-2d801f1e04b7 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=947c5c8bb3fe42509cb1abad91d23728&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4229374 Dec 09 21:30:39.444067 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44606) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:39.445913 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-826bc62d-8d0a-4e4b-9535-2d801f1e04b7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f350ee90-d5ae-4fee-8b1b-e2b1ea8fb9da,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:39.602046 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-79be49f9-c1e8-483c-ba15-60f283aef148 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:39.605336 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9558aedf-00be-47d9-9242-7a9b8c6ac42e admin admin] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:39.615196 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9558aedf-00be-47d9-9242-7a9b8c6ac42e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:39.658725 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9558aedf-00be-47d9-9242-7a9b8c6ac42e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:39.677589 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:39.682403 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:39.713692 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 6cf4ffbd-1ca6-4dd1-a033-c481be40b106, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6cf4ffbd-1ca6-4dd1-a033-c481be40b106,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:39.721264 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:39.789940 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-79be49f9-c1e8-483c-ba15-60f283aef148 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:39.822749 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=6cf4ffbd-1ca6-4dd1-a033-c481be40b106,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:39.890724 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9558aedf-00be-47d9-9242-7a9b8c6ac42e admin admin] Pushing event updated for resources: {'Port': ['ID=dbff506a-7b73-4238-9fda-dd193910d0ce,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:39.920888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9558aedf-00be-47d9-9242-7a9b8c6ac42e admin admin] Network 935b09ce-7410-4b66-82be-99978deb6717 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:30:39.923868 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-9558aedf-00be-47d9-9242-7a9b8c6ac42e admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:30:39.944951 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2ca97a8-d690-4351-975a-fbcbd163df87 req-63b55c6d-e68e-4601-8739-f1acc67f036b tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:39.946673 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b2ca97a8-d690-4351-975a-fbcbd163df87 req-63b55c6d-e68e-4601-8739-f1acc67f036b tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.1674912 Dec 09 21:30:40.044626 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-79be49f9-c1e8-483c-ba15-60f283aef148 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:40.048580 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-79be49f9-c1e8-483c-ba15-60f283aef148 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:40.068359 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-79be49f9-c1e8-483c-ba15-60f283aef148 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/f350ee90-d5ae-4fee-8b1b-e2b1ea8fb9da HTTP/1.1" status: 204 len: 168 time: 0.6044786 Dec 09 21:30:40.093764 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79be49f9-c1e8-483c-ba15-60f283aef148 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f350ee90-d5ae-4fee-8b1b-e2b1ea8fb9da,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:40.247203 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b2ca97a8-d690-4351-975a-fbcbd163df87 req-f043162b-3db5-4a9d-b6e0-b2ea2912ab03 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2868056 Dec 09 21:30:40.296101 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9558aedf-00be-47d9-9242-7a9b8c6ac42e admin admin] Router a0406620-d595-409c-958d-7a486a49577c has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:30:40.311691 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-654b3b26-2a5c-40b7-891a-b75b9aceed10 req-541cf659-eff3-4b0a-9dc4-23e973a60aa4 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:40.313818 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-654b3b26-2a5c-40b7-891a-b75b9aceed10 req-541cf659-eff3-4b0a-9dc4-23e973a60aa4 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.1126540 Dec 09 21:30:40.316047 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-0be9d0fc-3937-4ea6-af64-e8f2bc684fa4 None None] Provisioning complete for port dbff506a-7b73-4238-9fda-dd193910d0ce triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:40.317126 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0be9d0fc-3937-4ea6-af64-e8f2bc684fa4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:40.371329 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-0be9d0fc-3937-4ea6-af64-e8f2bc684fa4 None None] Port dbff506a-7b73-4238-9fda-dd193910d0ce cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:30:40.457067 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-654b3b26-2a5c-40b7-891a-b75b9aceed10 req-75bd18e5-8f5d-4d51-ba15-b62430e769c4 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1347375 Dec 09 21:30:40.468879 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44628) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:40.488595 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a592f4bd-8915-4d59-9b64-8796ff43fe17 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:40.528422 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9558aedf-00be-47d9-9242-7a9b8c6ac42e admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:30:40.533991 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9558aedf-00be-47d9-9242-7a9b8c6ac42e admin admin] 10.222.0.13 "PUT /v2.0/routers/a0406620-d595-409c-958d-7a486a49577c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.1403785 Dec 09 21:30:40.581014 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a592f4bd-8915-4d59-9b64-8796ff43fe17 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:40.587527 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a592f4bd-8915-4d59-9b64-8796ff43fe17 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:40.601153 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] Sync routers for ids ['a0406620-d595-409c-958d-7a486a49577c'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:30:40.613388 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] Routers {'a0406620-d595-409c-958d-7a486a49577c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:30:40.614277 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:30:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a0406620-d595-409c-958d-7a486a49577c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:40.630038 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a592f4bd-8915-4d59-9b64-8796ff43fe17 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=81edb9ef-0990-4474-bf40-ebbff89554d3,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:40.640768 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a592f4bd-8915-4d59-9b64-8796ff43fe17 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=4f7fef9e97564869837e225f089e4646&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1707392 Dec 09 21:30:40.643400 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44632) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:40.698956 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-da13b1d5-4226-4031-82a8-4dcd4eacad54 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:40.723763 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-da13b1d5-4226-4031-82a8-4dcd4eacad54 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:40.796628 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-da13b1d5-4226-4031-82a8-4dcd4eacad54 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:40.801215 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-da13b1d5-4226-4031-82a8-4dcd4eacad54 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:40.803818 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-da13b1d5-4226-4031-82a8-4dcd4eacad54 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/81edb9ef-0990-4474-bf40-ebbff89554d3 HTTP/1.1" status: 204 len: 168 time: 0.1592371 Dec 09 21:30:40.827120 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da13b1d5-4226-4031-82a8-4dcd4eacad54 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=81edb9ef-0990-4474-bf40-ebbff89554d3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:40.915961 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] Set router a0406620-d595-409c-958d-7a486a49577c gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:30:41.161533 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0406620-d595-409c-958d-7a486a49577c', 'name': 'tempest-AttachVolumeTestJSON-1079676770-router', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210'}], 'enable_snat': True}, 'gw_port_id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:32Z', 'updated_at': '2021-12-09T21:30:38Z', 'revision_number': 4, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'gw_port': {'id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:0e:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1399, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:33Z', 'updated_at': '2021-12-09T21:30:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'dbff506a-7b73-4238-9fda-dd193910d0ce', 'name': '', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'mac_address': 'fa:16:3e:94:28:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:37Z', 'updated_at': '2021-12-09T21:30:39Z', 'revision_number': 2, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'subnets': [{'id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:41.211710 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] Checking router: a0406620-d595-409c-958d-7a486a49577c for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:30:41.212197 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] Updating router a0406620-d595-409c-958d-7a486a49577c port dbff506a-7b73-4238-9fda-dd193910d0ce binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:30:41.274143 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:41.377670 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44660) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:41.383290 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-497c4dce-0c88-418c-b878-17f67129bb24 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Request body: {'security_group': {'name': 'tempest-securitygroup--360769301', 'description': 'tempest-description--1830114866'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:41.401374 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6cf4ffbd-1ca6-4dd1-a033-c481be40b106 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:30:41.475088 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-497c4dce-0c88-418c-b878-17f67129bb24 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:41.525312 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a88fd006-d24d-4334-8aed-4b986082b6d9 req-640b9c3f-a6eb-4b32-8fc7-a6dd9426922e tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:41.544268 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a88fd006-d24d-4334-8aed-4b986082b6d9 req-640b9c3f-a6eb-4b32-8fc7-a6dd9426922e tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.1506367 Dec 09 21:30:41.596356 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 6cf4ffbd-1ca6-4dd1-a033-c481be40b106 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:41.596853 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:41.696433 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a88fd006-d24d-4334-8aed-4b986082b6d9 req-9d32c58d-8e94-4825-8f44-fc975a23c5eb tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1474941 Dec 09 21:30:41.734852 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:41.739989 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9621f1f-0f46-46a1-ae2a-51f457b55a84 req-060e5196-789f-4e71-8371-436d5d29e7e8 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:41.741866 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f9621f1f-0f46-46a1-ae2a-51f457b55a84 req-060e5196-789f-4e71-8371-436d5d29e7e8 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.1668155 Dec 09 21:30:41.745156 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-497c4dce-0c88-418c-b878-17f67129bb24 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:41.755259 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:41.758133 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-497c4dce-0c88-418c-b878-17f67129bb24 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:41.798930 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-497c4dce-0c88-418c-b878-17f67129bb24 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:41.800371 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-497c4dce-0c88-418c-b878-17f67129bb24 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1798 time: 0.4210818 Dec 09 21:30:41.803854 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44672) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:41.809300 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2e58b3eb-4427-49d7-aa4c-b24040c653fa tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Request body: {'security_group_rule': {'security_group_id': '15f9ec10-291b-4d5f-8acd-a537b0bfe76b', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:41.815780 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-497c4dce-0c88-418c-b878-17f67129bb24 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Pushing event updated for resources: {'SecurityGroup': ['ID=15f9ec10-291b-4d5f-8acd-a537b0bfe76b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:41.844214 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f9621f1f-0f46-46a1-ae2a-51f457b55a84 req-29052bc2-768a-4b6c-b836-20ad2cf37699 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0927730 Dec 09 21:30:41.848850 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2e58b3eb-4427-49d7-aa4c-b24040c653fa tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:41.853368 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67a09980-6dda-4caf-9428-c2f05a6474a2 None None] Pushing event updated for resources: {'Port': ['ID=dbff506a-7b73-4238-9fda-dd193910d0ce,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:41.866097 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67a09980-6dda-4caf-9428-c2f05a6474a2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:41.866481 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67a09980-6dda-4caf-9428-c2f05a6474a2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:41.876491 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67a09980-6dda-4caf-9428-c2f05a6474a2 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:41.877080 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67a09980-6dda-4caf-9428-c2f05a6474a2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:41.877731 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67a09980-6dda-4caf-9428-c2f05a6474a2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:41.879216 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67a09980-6dda-4caf-9428-c2f05a6474a2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:41.879582 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67a09980-6dda-4caf-9428-c2f05a6474a2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:41.879924 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67a09980-6dda-4caf-9428-c2f05a6474a2 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:41.880904 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67a09980-6dda-4caf-9428-c2f05a6474a2 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:41.883327 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67a09980-6dda-4caf-9428-c2f05a6474a2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:41.883856 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67a09980-6dda-4caf-9428-c2f05a6474a2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:41.884201 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67a09980-6dda-4caf-9428-c2f05a6474a2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:41.884533 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67a09980-6dda-4caf-9428-c2f05a6474a2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:41.944916 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2e58b3eb-4427-49d7-aa4c-b24040c653fa tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:41.951293 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2e58b3eb-4427-49d7-aa4c-b24040c653fa tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:41.962685 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] Attempting to bind port dbff506a-7b73-4238-9fda-dd193910d0ce on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:41.963344 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] Attempting to bind port dbff506a-7b73-4238-9fda-dd193910d0ce by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'd3bafd14-6a72-4dc5-8e4d-11da22a389ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '935b09ce-7410-4b66-82be-99978deb6717'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:41.963597 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] Attempting to bind port dbff506a-7b73-4238-9fda-dd193910d0ce on network 935b09ce-7410-4b66-82be-99978deb6717 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:41.970399 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 30, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:30:41.971033 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] Checking segment: {'id': 'd3bafd14-6a72-4dc5-8e4d-11da22a389ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '935b09ce-7410-4b66-82be-99978deb6717'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:30:41.971764 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:41.972264 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] Bound using segment: {'id': 'd3bafd14-6a72-4dc5-8e4d-11da22a389ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '935b09ce-7410-4b66-82be-99978deb6717'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:30:41.972821 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] Bound port: dbff506a-7b73-4238-9fda-dd193910d0ce, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd3bafd14-6a72-4dc5-8e4d-11da22a389ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '935b09ce-7410-4b66-82be-99978deb6717'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:30:41.973217 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:41.982208 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e58b3eb-4427-49d7-aa4c-b24040c653fa tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e25d88be-e028-494d-85b1-c45f5614c799,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:41.988391 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2e58b3eb-4427-49d7-aa4c-b24040c653fa tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:41.992371 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44682) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:41.993783 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2e58b3eb-4427-49d7-aa4c-b24040c653fa tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1882279 Dec 09 21:30:41.997475 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-0f7dded9-5690-4dd5-9359-2f7e0985c290 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Request body: {'security_group_rule': {'security_group_id': '15f9ec10-291b-4d5f-8acd-a537b0bfe76b', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:42.079768 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] For port dbff506a-7b73-4238-9fda-dd193910d0ce, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:30:42.083911 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] For port dbff506a-7b73-4238-9fda-dd193910d0ce, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=dbff506a-7b73-4238-9fda-dd193910d0ce,segment=NetworkSegment(d3bafd14-6a72-4dc5-8e4d-11da22a389ed),segment_id=d3bafd14-6a72-4dc5-8e4d-11da22a389ed)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:30:42.092207 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:42.107488 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0f7dded9-5690-4dd5-9359-2f7e0985c290 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:42.181046 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0f7dded9-5690-4dd5-9359-2f7e0985c290 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:42.186117 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0f7dded9-5690-4dd5-9359-2f7e0985c290 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:42.193224 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] Routers {'a0406620-d595-409c-958d-7a486a49577c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:30:42.194021 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:30:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a0406620-d595-409c-958d-7a486a49577c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:42.201651 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67a09980-6dda-4caf-9428-c2f05a6474a2 None None] Pushing event updated for resources: {'Port': ['ID=dbff506a-7b73-4238-9fda-dd193910d0ce,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:42.218422 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f7dded9-5690-4dd5-9359-2f7e0985c290 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e4ccb3db-44f0-44b0-b532-6df8b8766569,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:42.227162 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0f7dded9-5690-4dd5-9359-2f7e0985c290 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:42.228494 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0f7dded9-5690-4dd5-9359-2f7e0985c290 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2351623 Dec 09 21:30:42.232026 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44702) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:42.237950 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-6c066326-1220-4a1b-8ac3-91a9c7c62996 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:42.288821 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c066326-1220-4a1b-8ac3-91a9c7c62996 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for floatingip, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:42.341173 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-94573745-d8df-425d-b6de-7943fa5bd84c None None] Provisioning complete for port dbff506a-7b73-4238-9fda-dd193910d0ce triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:42.341571 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-94573745-d8df-425d-b6de-7943fa5bd84c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:42.370856 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] Set router a0406620-d595-409c-958d-7a486a49577c gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:30:42.456106 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c066326-1220-4a1b-8ac3-91a9c7c62996 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:42.576275 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-94573745-d8df-425d-b6de-7943fa5bd84c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:42.600513 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-6c066326-1220-4a1b-8ac3-91a9c7c62996 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Allocated IP 172.25.3.170 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/41cdb40e-bd30-4566-a2eb-a8ec05877093) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:30:42.639051 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44716) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:42.647578 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-94573745-d8df-425d-b6de-7943fa5bd84c None None] For port dbff506a-7b73-4238-9fda-dd193910d0ce, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=dbff506a-7b73-4238-9fda-dd193910d0ce,segment=NetworkSegment(d3bafd14-6a72-4dc5-8e4d-11da22a389ed),segment_id=d3bafd14-6a72-4dc5-8e4d-11da22a389ed)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:42.652467 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-94573745-d8df-425d-b6de-7943fa5bd84c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:42.720451 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94573745-d8df-425d-b6de-7943fa5bd84c None None] Pushing event updated for resources: {'Port': ['ID=dbff506a-7b73-4238-9fda-dd193910d0ce,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:42.738522 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0406620-d595-409c-958d-7a486a49577c', 'name': 'tempest-AttachVolumeTestJSON-1079676770-router', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210'}], 'enable_snat': True}, 'gw_port_id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:32Z', 'updated_at': '2021-12-09T21:30:38Z', 'revision_number': 4, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'gw_port': {'id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:0e:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1399, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:33Z', 'updated_at': '2021-12-09T21:30:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'dbff506a-7b73-4238-9fda-dd193910d0ce', 'name': '', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'mac_address': 'fa:16:3e:94:28:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:37Z', 'updated_at': '2021-12-09T21:30:42Z', 'revision_number': 4, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'subnets': [{'id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:42.741716 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c066326-1220-4a1b-8ac3-91a9c7c62996 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:42.763859 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d0f157a5-f28a-47c2-a8d4-c25cec95f306 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:42.779889 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6f5bfc5-3aa8-42d8-89d5-6d674f819dfa None None] The sync data for ids ['a0406620-d595-409c-958d-7a486a49577c'] in n-d-713301-27 is: [{'id': 'a0406620-d595-409c-958d-7a486a49577c', 'name': 'tempest-AttachVolumeTestJSON-1079676770-router', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210'}], 'enable_snat': True}, 'gw_port_id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:32Z', 'updated_at': '2021-12-09T21:30:38Z', 'revision_number': 4, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'gw_port': {'id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:0e:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1399, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:33Z', 'updated_at': '2021-12-09T21:30:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'dbff506a-7b73-4238-9fda-dd193910d0ce', 'name': '', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'mac_address': 'fa:16:3e:94:28:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:37Z', 'updated_at': '2021-12-09T21:30:42Z', 'revision_number': 4, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'subnets': [{'id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:30:42.790545 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f6d0da67-16b7-4ea5-819c-103f23e28bfd None None] Provisioning complete for port dbff506a-7b73-4238-9fda-dd193910d0ce triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:42.790952 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f6d0da67-16b7-4ea5-819c-103f23e28bfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:42.801919 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c066326-1220-4a1b-8ac3-91a9c7c62996 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:42.845328 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6c066326-1220-4a1b-8ac3-91a9c7c62996 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:30:42.848386 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-6c066326-1220-4a1b-8ac3-91a9c7c62996 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:30:42.854508 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c066326-1220-4a1b-8ac3-91a9c7c62996 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:30:42.878712 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a70f3ae-2fd6-4ec4-9e66-e15d0e174633 req-5ae6e7c7-5f5b-4ad4-b366-db7886ac4feb tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:42.899677 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a70f3ae-2fd6-4ec4-9e66-e15d0e174633 req-5ae6e7c7-5f5b-4ad4-b366-db7886ac4feb tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.1191609 Dec 09 21:30:42.954641 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c066326-1220-4a1b-8ac3-91a9c7c62996 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Pushing event updated for resources: {'Port': ['ID=41cdb40e-bd30-4566-a2eb-a8ec05877093,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:42.981576 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a70f3ae-2fd6-4ec4-9e66-e15d0e174633 req-5e20dfe8-7366-42e0-bb98-c7be9e902a3f tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0794804 Dec 09 21:30:43.007233 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c066326-1220-4a1b-8ac3-91a9c7c62996 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:43.014004 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d0f157a5-f28a-47c2-a8d4-c25cec95f306 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:43.031639 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d0f157a5-f28a-47c2-a8d4-c25cec95f306 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:43.051782 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c066326-1220-4a1b-8ac3-91a9c7c62996 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:43.112377 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d0f157a5-f28a-47c2-a8d4-c25cec95f306 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=bff2ec4f0e0c41c88134f31b29db55c3&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4674950 Dec 09 21:30:43.113278 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44726) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:43.188015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0f157a5-f28a-47c2-a8d4-c25cec95f306 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=70d914c2-7b82-4301-a63f-78146f79babd,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:43.201987 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c756a95a-5511-44a2-8558-124c44dcf250 req-7fe6b0db-40e0-42d7-92bd-2705c896037f tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:43.210552 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c756a95a-5511-44a2-8558-124c44dcf250 req-7fe6b0db-40e0-42d7-92bd-2705c896037f tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.1941943 Dec 09 21:30:43.280374 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7cb30a8-d7ac-4fe0-b5ac-164696246a66 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:43.288434 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c066326-1220-4a1b-8ac3-91a9c7c62996 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:43.300418 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c066326-1220-4a1b-8ac3-91a9c7c62996 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:43.300630 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device dbff506a-7b73-4238-9fda-dd193910d0ce up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:30:43.344567 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c756a95a-5511-44a2-8558-124c44dcf250 req-e203d697-ff99-42ff-827f-e76aebb728da tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1316707 Dec 09 21:30:43.353068 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7cb30a8-d7ac-4fe0-b5ac-164696246a66 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:43.389442 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port dbff506a-7b73-4238-9fda-dd193910d0ce triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:43.389825 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:43.429127 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7cb30a8-d7ac-4fe0-b5ac-164696246a66 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:43.431885 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7cb30a8-d7ac-4fe0-b5ac-164696246a66 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:43.433113 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c7cb30a8-d7ac-4fe0-b5ac-164696246a66 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/70d914c2-7b82-4301-a63f-78146f79babd HTTP/1.1" status: 204 len: 168 time: 0.3135202 Dec 09 21:30:43.447410 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c066326-1220-4a1b-8ac3-91a9c7c62996 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:43.453801 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7cb30a8-d7ac-4fe0-b5ac-164696246a66 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=70d914c2-7b82-4301-a63f-78146f79babd,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:43.466788 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c066326-1220-4a1b-8ac3-91a9c7c62996 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Pushing event updated for resources: {'Port': ['ID=41cdb40e-bd30-4566-a2eb-a8ec05877093,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:43.484449 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c066326-1220-4a1b-8ac3-91a9c7c62996 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:43.493885 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6c066326-1220-4a1b-8ac3-91a9c7c62996 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.2528982 Dec 09 21:30:43.737895 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d299616-4130-45aa-910f-0be4cabd042b req-75117f78-f0ea-4a6c-a367-58dd958848b7 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-securitygroup--360769301&fields=id&tenant_id=aacb3291db4d4252a9225e8fe617f667 HTTP/1.1" status: 200 len: 267 time: 0.0535665 Dec 09 21:30:43.877871 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d299616-4130-45aa-910f-0be4cabd042b req-6271bcbd-6b7d-4662-ab78-76c9b14bb9cc tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:43.879642 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d299616-4130-45aa-910f-0be4cabd042b req-6271bcbd-6b7d-4662-ab78-76c9b14bb9cc tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/networks?id=935b09ce-7410-4b66-82be-99978deb6717 HTTP/1.1" status: 200 len: 811 time: 0.1332500 Dec 09 21:30:43.897022 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d299616-4130-45aa-910f-0be4cabd042b req-3a3a7b58-68a0-4db2-8edc-3804c2849f09 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/quotas/aacb3291db4d4252a9225e8fe617f667 HTTP/1.1" status: 200 len: 375 time: 0.0102451 Dec 09 21:30:43.964822 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d299616-4130-45aa-910f-0be4cabd042b req-30f0b0a8-6cfd-4d70-b654-18e4774f84ac tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=aacb3291db4d4252a9225e8fe617f667&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0579832 Dec 09 21:30:44.126712 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d299616-4130-45aa-910f-0be4cabd042b req-0696c3e2-9757-4056-8a65-33249d3bd955 service neutron] 10.222.0.13 "GET /v2.0/networks/935b09ce-7410-4b66-82be-99978deb6717?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1402345 Dec 09 21:30:44.148906 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd9f36f-7717-4648-a473-cbb1eb89f1ce req-64a8b4a6-4516-41c1-97df-eff49e3bbf9f tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:44.154390 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fdd9f36f-7717-4648-a473-cbb1eb89f1ce req-64a8b4a6-4516-41c1-97df-eff49e3bbf9f tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.0894957 Dec 09 21:30:44.263425 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fdd9f36f-7717-4648-a473-cbb1eb89f1ce req-0ade0054-767f-4580-a5c7-9a2a08d2b6ec tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1003513 Dec 09 21:30:44.290651 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d299616-4130-45aa-910f-0be4cabd042b req-7ab008e3-b77b-46bd-829d-3d65e2a22336 service neutron] 10.222.0.13 "GET /v2.0/networks/935b09ce-7410-4b66-82be-99978deb6717?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1591876 Dec 09 21:30:44.576198 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0346ac8b-cf92-4277-bdc3-5e1d1dfaeacb req-aca14270-56f5-4f03-b157-bb926a1cf29c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:44.577913 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0346ac8b-cf92-4277-bdc3-5e1d1dfaeacb req-aca14270-56f5-4f03-b157-bb926a1cf29c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.0675881 Dec 09 21:30:44.609118 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83859656-7f2f-47b2-b16e-916b344ef1c7 req-395322af-7086-4b93-93dd-6d54f97c5dde tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 210 time: 0.0474603 Dec 09 21:30:44.662653 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0346ac8b-cf92-4277-bdc3-5e1d1dfaeacb req-6941249e-55df-47ec-a4f9-d0d9c769cde8 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0525775 Dec 09 21:30:45.061107 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44802) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:45.216444 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-7de303f1-027a-459f-ad72-514b63782dab tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Request body: {'network': {'name': 'tempest-DHCPAgentSchedulersTestJSON-test-network-851940730'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:45.236902 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7de303f1-027a-459f-ad72-514b63782dab tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Made reservation on behalf of ae3d7e00c066487ba5a8c39d19d243c9 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:30:45.240400 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7de303f1-027a-459f-ad72-514b63782dab tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:45.249060 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7de303f1-027a-459f-ad72-514b63782dab tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:45.328120 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7de303f1-027a-459f-ad72-514b63782dab tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:45.333208 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7de303f1-027a-459f-ad72-514b63782dab tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:45.389416 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7de303f1-027a-459f-ad72-514b63782dab tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] vlan segment allocate from pool success with {'vlan_id': 115, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:30:45.395844 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7de303f1-027a-459f-ad72-514b63782dab tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Pushing event updated for resources: {'SecurityGroup': ['ID=508d4933-7267-4e59-91f7-2f7481565d1c,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:45.405895 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7de303f1-027a-459f-ad72-514b63782dab tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:45.406253 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-7de303f1-027a-459f-ad72-514b63782dab tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Added segment 9cffea5e-8d42-4214-9794-27c1bb806228 of type vlan for network 2daf651d-b48a-48c4-bd2d-2a1996637137 Dec 09 21:30:45.449453 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1c044a-6b38-48d4-b816-8dd1ba65787d req-d5b07c88-3a40-46b6-aecd-2b91bf3e643a tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:45.451487 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e1c044a-6b38-48d4-b816-8dd1ba65787d req-d5b07c88-3a40-46b6-aecd-2b91bf3e643a tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.1096976 Dec 09 21:30:45.494540 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7de303f1-027a-459f-ad72-514b63782dab tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:45.593938 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7de303f1-027a-459f-ad72-514b63782dab tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:45.599989 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7de303f1-027a-459f-ad72-514b63782dab tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:45.600585 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7de303f1-027a-459f-ad72-514b63782dab tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:45.622247 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e1c044a-6b38-48d4-b816-8dd1ba65787d req-5ece3e53-cc0f-4721-94c1-defa5c4e8b4e tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1563411 Dec 09 21:30:45.987636 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7de303f1-027a-459f-ad72-514b63782dab tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 794 time: 0.9242582 Dec 09 21:30:45.990006 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44820) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:45.995886 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-fc36eb09-8e03-43f7-852f-95a079f55709 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Request body: {'subnet': {'network_id': '2daf651d-b48a-48c4-bd2d-2a1996637137', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:46.019790 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8af4354e-1267-41ba-b808-09eb1ad6f5f3 req-2264258e-4a58-42a0-9f9c-54587851a079 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 210 time: 0.0749850 Dec 09 21:30:46.055492 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d299616-4130-45aa-910f-0be4cabd042b req-9ecd7784-6a7c-4ac8-bb0b-7c8b1d03a102 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:46.056987 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d299616-4130-45aa-910f-0be4cabd042b req-9ecd7784-6a7c-4ac8-bb0b-7c8b1d03a102 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.31 "GET /v2.0/networks?id=935b09ce-7410-4b66-82be-99978deb6717 HTTP/1.1" status: 200 len: 811 time: 0.6023962 Dec 09 21:30:46.062003 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7de303f1-027a-459f-ad72-514b63782dab tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Pushing event updated for resources: {'Network': ['ID=2daf651d-b48a-48c4-bd2d-2a1996637137,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:46.076492 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 2daf651d-b48a-48c4-bd2d-2a1996637137 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:30:46.100234 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fc36eb09-8e03-43f7-852f-95a079f55709 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Made reservation on behalf of ae3d7e00c066487ba5a8c39d19d243c9 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:30:46.103245 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f25453-5375-45be-8470-5f51ebf5ff7b req-663effce-79c8-4507-a890-c8d33955b2cb tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:46.104853 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52f25453-5375-45be-8470-5f51ebf5ff7b req-663effce-79c8-4507-a890-c8d33955b2cb tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.1564114 Dec 09 21:30:46.107291 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fc36eb09-8e03-43f7-852f-95a079f55709 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:46.159937 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d299616-4130-45aa-910f-0be4cabd042b req-f4ff7eb4-d145-43c3-9d09-49e1345b359a tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=aacb3291db4d4252a9225e8fe617f667 HTTP/1.1" status: 200 len: 379 time: 0.0923436 Dec 09 21:30:46.170380 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-6d299616-4130-45aa-910f-0be4cabd042b req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Request body: {'port': {'device_id': 'de68791c-82e4-4147-88d4-7a0ce0f25710', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'admin_state_up': True, 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'security_groups': ['15f9ec10-291b-4d5f-8acd-a537b0bfe76b']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:46.210206 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52f25453-5375-45be-8470-5f51ebf5ff7b req-c70610a3-33c2-4e0b-a2da-fb22a95824ec tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0963850 Dec 09 21:30:46.293008 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6d299616-4130-45aa-910f-0be4cabd042b req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Made reservation on behalf of aacb3291db4d4252a9225e8fe617f667 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:30:46.296840 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6d299616-4130-45aa-910f-0be4cabd042b req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:46.303652 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fc36eb09-8e03-43f7-852f-95a079f55709 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:46.370713 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc36eb09-8e03-43f7-852f-95a079f55709 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Pushing event updated for resources: {'Subnet': ['ID=e39522c5-3ef5-44e5-83cf-8051df233455,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:46.380799 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc36eb09-8e03-43f7-852f-95a079f55709 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Checking segment: {'id': '9cffea5e-8d42-4214-9794-27c1bb806228', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '2daf651d-b48a-48c4-bd2d-2a1996637137'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:30:46.381187 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc36eb09-8e03-43f7-852f-95a079f55709 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Network hostable DHCP agents. Network: 2daf651d-b48a-48c4-bd2d-2a1996637137, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:30:46.399067 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc36eb09-8e03-43f7-852f-95a079f55709 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Network 2daf651d-b48a-48c4-bd2d-2a1996637137 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:30:46.408978 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-fc36eb09-8e03-43f7-852f-95a079f55709 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 2daf651d-b48a-48c4-bd2d-2a1996637137) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:30:46.415303 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fc36eb09-8e03-43f7-852f-95a079f55709 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:46.416088 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fc36eb09-8e03-43f7-852f-95a079f55709 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:46.419897 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f4f43a7-9150-4618-b8c0-e03b91858407 None None] Network 2daf651d-b48a-48c4-bd2d-2a1996637137 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:30:46.435321 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fc36eb09-8e03-43f7-852f-95a079f55709 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.4439361 Dec 09 21:30:46.438037 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44824) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:46.444791 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-6d299616-4130-45aa-910f-0be4cabd042b req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Allocated IP 172.20.0.14 (935b09ce-7410-4b66-82be-99978deb6717/10ff3f47-d1f4-47a0-808e-f885899dfb29/042e101d-fba7-4c12-8471-48255f57bee1) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:30:46.447342 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-787896f5-fe0f-4849-a2e7-c699b9888832 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Request body: {'port': {'network_id': '2daf651d-b48a-48c4-bd2d-2a1996637137', 'name': 'tempest-DHCPAgentSchedulersTestJSON-161355296'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:46.539756 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-411c3024-7f68-4ffa-83f8-e785af13c917 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-2daf651d-b48a-48c4-bd2d-2a1996637137', 'network_id': '2daf651d-b48a-48c4-bd2d-2a1996637137', 'project_id': 'ae3d7e00c066487ba5a8c39d19d243c9', 'fixed_ips': [{'subnet_id': 'e39522c5-3ef5-44e5-83cf-8051df233455'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:30:46.540805 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-411c3024-7f68-4ffa-83f8-e785af13c917 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:46.584542 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-787896f5-fe0f-4849-a2e7-c699b9888832 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Made reservation on behalf of ae3d7e00c066487ba5a8c39d19d243c9 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:30:46.589309 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-787896f5-fe0f-4849-a2e7-c699b9888832 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:46.615142 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-787896f5-fe0f-4849-a2e7-c699b9888832 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] device_id is not set on port 8ff7aac4-59fc-4198-928f-fe9f58dd717a yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:30:46.641182 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6d299616-4130-45aa-910f-0be4cabd042b req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:46.719150 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-411c3024-7f68-4ffa-83f8-e785af13c917 None None] Allocated IP 172.20.0.2 (2daf651d-b48a-48c4-bd2d-2a1996637137/e39522c5-3ef5-44e5-83cf-8051df233455/8b1ca609-e47e-4036-8ddc-c4da7b6611b9) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:30:46.720738 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6d299616-4130-45aa-910f-0be4cabd042b req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:46.784956 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6d299616-4130-45aa-910f-0be4cabd042b req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Network 935b09ce-7410-4b66-82be-99978deb6717 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:30:46.794887 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-6d299616-4130-45aa-910f-0be4cabd042b req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:30:46.797979 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Pushing event updated for resources: {'Port': ['ID=042e101d-fba7-4c12-8471-48255f57bee1,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:46.801730 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-6d299616-4130-45aa-910f-0be4cabd042b req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:30:46.814306 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13029362-465d-4167-a67b-33ea050a3b9c req-b234926e-978a-435a-83fd-689edf664c98 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:46.816685 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-13029362-465d-4167-a67b-33ea050a3b9c req-b234926e-978a-435a-83fd-689edf664c98 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.1074328 Dec 09 21:30:46.857686 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:46.858225 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:46.858910 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:46.858910 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:46.859229 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:46.859599 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:46.860171 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:46.860521 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:46.860857 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:46.861191 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:46.861518 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:46.861848 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:46.862196 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:46.881566 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-411c3024-7f68-4ffa-83f8-e785af13c917 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:46.890859 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-411c3024-7f68-4ffa-83f8-e785af13c917 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:46.910670 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d299616-4130-45aa-910f-0be4cabd042b req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:46.911328 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6d299616-4130-45aa-910f-0be4cabd042b req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:46.940681 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-411c3024-7f68-4ffa-83f8-e785af13c917 None None] Network 2daf651d-b48a-48c4-bd2d-2a1996637137 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:30:46.944952 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-411c3024-7f68-4ffa-83f8-e785af13c917 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:30:46.949963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-411c3024-7f68-4ffa-83f8-e785af13c917 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:30:46.951504 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-13029362-465d-4167-a67b-33ea050a3b9c req-5f849090-f37a-420d-8b9c-e5e70d675db9 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1117086 Dec 09 21:30:46.954581 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-787896f5-fe0f-4849-a2e7-c699b9888832 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Allocated IP 172.20.0.9 (2daf651d-b48a-48c4-bd2d-2a1996637137/e39522c5-3ef5-44e5-83cf-8051df233455/8ff7aac4-59fc-4198-928f-fe9f58dd717a) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:30:46.955675 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d299616-4130-45aa-910f-0be4cabd042b req-4407d0dd-6156-4294-9e9b-6aa321e46697 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7893746 Dec 09 21:30:46.964835 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-411c3024-7f68-4ffa-83f8-e785af13c917 None None] Pushing event updated for resources: {'Port': ['ID=8b1ca609-e47e-4036-8ddc-c4da7b6611b9,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:46.981691 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-6d299616-4130-45aa-910f-0be4cabd042b req-151c455c-2fe0-43d0-861a-24fb9737d2c2 service neutron] Request body: {'port': {'device_id': 'de68791c-82e4-4147-88d4-7a0ce0f25710', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:47.033319 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-411c3024-7f68-4ffa-83f8-e785af13c917 None None] Attempting to bind port 8b1ca609-e47e-4036-8ddc-c4da7b6611b9 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:47.033822 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-411c3024-7f68-4ffa-83f8-e785af13c917 None None] Attempting to bind port 8b1ca609-e47e-4036-8ddc-c4da7b6611b9 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '9cffea5e-8d42-4214-9794-27c1bb806228', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '2daf651d-b48a-48c4-bd2d-2a1996637137'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:47.034194 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-411c3024-7f68-4ffa-83f8-e785af13c917 None None] Attempting to bind port 8b1ca609-e47e-4036-8ddc-c4da7b6611b9 on network 2daf651d-b48a-48c4-bd2d-2a1996637137 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:47.039621 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-411c3024-7f68-4ffa-83f8-e785af13c917 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 30, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:30:47.039899 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-411c3024-7f68-4ffa-83f8-e785af13c917 None None] Checking segment: {'id': '9cffea5e-8d42-4214-9794-27c1bb806228', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '2daf651d-b48a-48c4-bd2d-2a1996637137'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:30:47.040312 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-411c3024-7f68-4ffa-83f8-e785af13c917 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:47.040701 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-411c3024-7f68-4ffa-83f8-e785af13c917 None None] Bound using segment: {'id': '9cffea5e-8d42-4214-9794-27c1bb806228', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '2daf651d-b48a-48c4-bd2d-2a1996637137'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:30:47.041175 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-411c3024-7f68-4ffa-83f8-e785af13c917 None None] Bound port: 8b1ca609-e47e-4036-8ddc-c4da7b6611b9, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9cffea5e-8d42-4214-9794-27c1bb806228', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': '2daf651d-b48a-48c4-bd2d-2a1996637137'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:30:47.041560 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-411c3024-7f68-4ffa-83f8-e785af13c917 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:47.043113 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6d299616-4130-45aa-910f-0be4cabd042b req-151c455c-2fe0-43d0-861a-24fb9737d2c2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:47.134050 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-411c3024-7f68-4ffa-83f8-e785af13c917 None None] For port 8b1ca609-e47e-4036-8ddc-c4da7b6611b9, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:30:47.137792 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-411c3024-7f68-4ffa-83f8-e785af13c917 None None] For port 8b1ca609-e47e-4036-8ddc-c4da7b6611b9, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=8b1ca609-e47e-4036-8ddc-c4da7b6611b9,segment=NetworkSegment(9cffea5e-8d42-4214-9794-27c1bb806228),segment_id=9cffea5e-8d42-4214-9794-27c1bb806228)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:30:47.140978 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-fdafe870-368d-450a-acbf-b3265e08f6c1 None None] Provisioning complete for port 042e101d-fba7-4c12-8471-48255f57bee1 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:47.141487 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fdafe870-368d-450a-acbf-b3265e08f6c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:47.146491 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-411c3024-7f68-4ffa-83f8-e785af13c917 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:47.153266 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-787896f5-fe0f-4849-a2e7-c699b9888832 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:47.190792 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-787896f5-fe0f-4849-a2e7-c699b9888832 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:47.226403 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2398e92e-f69b-4a55-9f8d-1083dd9f0ed6 req-b957e207-30b3-40d7-982c-b054d88350b2 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:47.231642 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-fdafe870-368d-450a-acbf-b3265e08f6c1 None None] Port 042e101d-fba7-4c12-8471-48255f57bee1 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:30:47.234955 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2398e92e-f69b-4a55-9f8d-1083dd9f0ed6 req-b957e207-30b3-40d7-982c-b054d88350b2 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 932 time: 0.1375666 Dec 09 21:30:47.239496 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-787896f5-fe0f-4849-a2e7-c699b9888832 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Network 2daf651d-b48a-48c4-bd2d-2a1996637137 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:30:47.246389 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-787896f5-fe0f-4849-a2e7-c699b9888832 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:30:47.252885 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-787896f5-fe0f-4849-a2e7-c699b9888832 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:30:47.274976 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-411c3024-7f68-4ffa-83f8-e785af13c917 None None] Pushing event updated for resources: {'Port': ['ID=8b1ca609-e47e-4036-8ddc-c4da7b6611b9,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:47.292496 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-787896f5-fe0f-4849-a2e7-c699b9888832 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Pushing event updated for resources: {'Port': ['ID=8ff7aac4-59fc-4198-928f-fe9f58dd717a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:47.322901 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-787896f5-fe0f-4849-a2e7-c699b9888832 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:47.323563 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-787896f5-fe0f-4849-a2e7-c699b9888832 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:47.341288 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-787896f5-fe0f-4849-a2e7-c699b9888832 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 0.9019761 Dec 09 21:30:47.344941 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44838) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:47.409691 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2398e92e-f69b-4a55-9f8d-1083dd9f0ed6 req-8fb03bdc-0895-497a-a515-f2dad2a24021 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1739669 Dec 09 21:30:47.446865 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-2a1783cf-a338-4d4d-aef3-f201040452bc tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Deleting port 8ff7aac4-59fc-4198-928f-fe9f58dd717a {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:30:47.447477 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a1783cf-a338-4d4d-aef3-f201040452bc tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:47.458256 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e73ce0d-5ef3-4736-a77f-6f14de8076d7 req-be75cfc9-67e8-4bf5-b942-e4103ef16f1c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:47.459873 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e73ce0d-5ef3-4736-a77f-6f14de8076d7 req-be75cfc9-67e8-4bf5-b942-e4103ef16f1c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.1059341 Dec 09 21:30:47.546130 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-6d299616-4130-45aa-910f-0be4cabd042b req-151c455c-2fe0-43d0-861a-24fb9737d2c2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 042e101d-fba7-4c12-8471-48255f57bee1 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:30:47.557945 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a1783cf-a338-4d4d-aef3-f201040452bc tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:47.560999 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6d299616-4130-45aa-910f-0be4cabd042b req-151c455c-2fe0-43d0-861a-24fb9737d2c2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:47.575354 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-2a1783cf-a338-4d4d-aef3-f201040452bc tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Calling delete_port for 8ff7aac4-59fc-4198-928f-fe9f58dd717a owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:30:47.576608 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e73ce0d-5ef3-4736-a77f-6f14de8076d7 req-20854d4b-60a7-461b-aa08-70e50f5277fd tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1051261 Dec 09 21:30:47.591880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-6d299616-4130-45aa-910f-0be4cabd042b req-151c455c-2fe0-43d0-861a-24fb9737d2c2 service neutron] Transition to ACTIVE for port object 042e101d-fba7-4c12-8471-48255f57bee1 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:30:47.596935 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6d299616-4130-45aa-910f-0be4cabd042b req-151c455c-2fe0-43d0-861a-24fb9737d2c2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:47.664222 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-151c455c-2fe0-43d0-861a-24fb9737d2c2 service neutron] Pushing event updated for resources: {'Port': ['ID=042e101d-fba7-4c12-8471-48255f57bee1,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:47.774750 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-6d299616-4130-45aa-910f-0be4cabd042b req-151c455c-2fe0-43d0-861a-24fb9737d2c2 service neutron] Attempting to bind port 042e101d-fba7-4c12-8471-48255f57bee1 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:47.775087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-6d299616-4130-45aa-910f-0be4cabd042b req-151c455c-2fe0-43d0-861a-24fb9737d2c2 service neutron] Attempting to bind port 042e101d-fba7-4c12-8471-48255f57bee1 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'd3bafd14-6a72-4dc5-8e4d-11da22a389ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '935b09ce-7410-4b66-82be-99978deb6717'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:47.775613 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6d299616-4130-45aa-910f-0be4cabd042b req-151c455c-2fe0-43d0-861a-24fb9737d2c2 service neutron] Attempting to bind port 042e101d-fba7-4c12-8471-48255f57bee1 on network 935b09ce-7410-4b66-82be-99978deb6717 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:47.780433 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6d299616-4130-45aa-910f-0be4cabd042b req-151c455c-2fe0-43d0-861a-24fb9737d2c2 service neutron] Port 042e101d-fba7-4c12-8471-48255f57bee1 on network 935b09ce-7410-4b66-82be-99978deb6717 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:30:47.780751 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6d299616-4130-45aa-910f-0be4cabd042b req-151c455c-2fe0-43d0-861a-24fb9737d2c2 service neutron] Attempting to bind port 042e101d-fba7-4c12-8471-48255f57bee1 on network 935b09ce-7410-4b66-82be-99978deb6717 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:47.789751 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6d299616-4130-45aa-910f-0be4cabd042b req-151c455c-2fe0-43d0-861a-24fb9737d2c2 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 30, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:30:47.790656 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6d299616-4130-45aa-910f-0be4cabd042b req-151c455c-2fe0-43d0-861a-24fb9737d2c2 service neutron] Checking segment: {'id': 'd3bafd14-6a72-4dc5-8e4d-11da22a389ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '935b09ce-7410-4b66-82be-99978deb6717'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:30:47.791055 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6d299616-4130-45aa-910f-0be4cabd042b req-151c455c-2fe0-43d0-861a-24fb9737d2c2 service neutron] Bound using segment: {'id': 'd3bafd14-6a72-4dc5-8e4d-11da22a389ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '935b09ce-7410-4b66-82be-99978deb6717'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:30:47.791541 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-6d299616-4130-45aa-910f-0be4cabd042b req-151c455c-2fe0-43d0-861a-24fb9737d2c2 service neutron] Bound port: 042e101d-fba7-4c12-8471-48255f57bee1, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd3bafd14-6a72-4dc5-8e4d-11da22a389ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '935b09ce-7410-4b66-82be-99978deb6717'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:30:47.791975 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6d299616-4130-45aa-910f-0be4cabd042b req-151c455c-2fe0-43d0-861a-24fb9737d2c2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:47.798256 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a1783cf-a338-4d4d-aef3-f201040452bc tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:47.843637 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a1783cf-a338-4d4d-aef3-f201040452bc tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Pushing event deleted for resources: {'Port': ['ID=8ff7aac4-59fc-4198-928f-fe9f58dd717a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:47.884284 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-6d299616-4130-45aa-910f-0be4cabd042b req-151c455c-2fe0-43d0-861a-24fb9737d2c2 service neutron] For port 042e101d-fba7-4c12-8471-48255f57bee1, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:30:47.888277 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-6d299616-4130-45aa-910f-0be4cabd042b req-151c455c-2fe0-43d0-861a-24fb9737d2c2 service neutron] For port 042e101d-fba7-4c12-8471-48255f57bee1, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=042e101d-fba7-4c12-8471-48255f57bee1,segment=NetworkSegment(d3bafd14-6a72-4dc5-8e4d-11da22a389ed),segment_id=d3bafd14-6a72-4dc5-8e4d-11da22a389ed)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:30:47.893877 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6d299616-4130-45aa-910f-0be4cabd042b req-151c455c-2fe0-43d0-861a-24fb9737d2c2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:47.932015 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a1783cf-a338-4d4d-aef3-f201040452bc tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:47.936089 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d299616-4130-45aa-910f-0be4cabd042b req-151c455c-2fe0-43d0-861a-24fb9737d2c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:47.936794 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6d299616-4130-45aa-910f-0be4cabd042b req-151c455c-2fe0-43d0-861a-24fb9737d2c2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:47.937057 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2a1783cf-a338-4d4d-aef3-f201040452bc tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] 10.222.0.13 "DELETE /v2.0/ports/8ff7aac4-59fc-4198-928f-fe9f58dd717a HTTP/1.1" status: 204 len: 168 time: 0.5910990 Dec 09 21:30:47.938226 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d299616-4130-45aa-910f-0be4cabd042b req-151c455c-2fe0-43d0-861a-24fb9737d2c2 service neutron] 10.222.0.31 "PUT /v2.0/ports/042e101d-fba7-4c12-8471-48255f57bee1 HTTP/1.1" status: 200 len: 1093 time: 0.9734871 Dec 09 21:30:47.938609 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'de68791c-82e4-4147-88d4-7a0ce0f25710', 'tag': '042e101d-fba7-4c12-8471-48255f57bee1'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:30:47.939714 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44846) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:47.940935 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-27731223-4ef4-424c-bc9c-c9d64754dedd" -d '{"events": [{"name": "network-changed", "server_uuid": "de68791c-82e4-4147-88d4-7a0ce0f25710", "tag": "042e101d-fba7-4c12-8471-48255f57bee1"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:30:47.964600 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-151c455c-2fe0-43d0-861a-24fb9737d2c2 service neutron] Pushing event updated for resources: {'Port': ['ID=042e101d-fba7-4c12-8471-48255f57bee1,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:48.050177 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:30:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-18581606-35e2-409a-81e5-195989df725f x-openstack-request-id: req-18581606-35e2-409a-81e5-195989df725f {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:30:48.050413 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "de68791c-82e4-4147-88d4-7a0ce0f25710", "tag": "042e101d-fba7-4c12-8471-48255f57bee1", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:30:48.050672 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-18581606-35e2-409a-81e5-195989df725f {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:30:48.051137 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'de68791c-82e4-4147-88d4-7a0ce0f25710', 'tag': '042e101d-fba7-4c12-8471-48255f57bee1', 'status': 'completed', 'code': 200} Dec 09 21:30:48.063404 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:30:48.070898 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1cd09f87-30a5-4aab-abf9-35d43eeb72ba tempest-DHCPAgentSchedulersTestJSON-1203919490 tempest-DHCPAgentSchedulersTestJSON-1203919490-project-admin] 10.222.0.13 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4937 time: 0.1274488 Dec 09 21:30:48.071678 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44854) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:48.077172 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-3ad98244-0a29-42eb-98dc-ecdad1e35fef tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Request body: {'network': {'name': 'tempest-DHCPAgentSchedulersTestJSON-test-network-1676757597'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:48.086440 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d299616-4130-45aa-910f-0be4cabd042b req-972bcd17-9653-4471-8a5e-7784ecd981d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:48.087892 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d299616-4130-45aa-910f-0be4cabd042b req-972bcd17-9653-4471-8a5e-7784ecd981d4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=aacb3291db4d4252a9225e8fe617f667&device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 1096 time: 0.0899007 Dec 09 21:30:48.102700 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3ad98244-0a29-42eb-98dc-ecdad1e35fef tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Made reservation on behalf of ae3d7e00c066487ba5a8c39d19d243c9 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:30:48.106578 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ad98244-0a29-42eb-98dc-ecdad1e35fef tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:48.132339 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3ad98244-0a29-42eb-98dc-ecdad1e35fef tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] vlan segment allocate from pool success with {'vlan_id': 109, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:30:48.143473 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ad98244-0a29-42eb-98dc-ecdad1e35fef tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:48.143980 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-3ad98244-0a29-42eb-98dc-ecdad1e35fef tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Added segment 377c91ac-486e-4c40-b6b2-3e9043f37cb8 of type vlan for network 962f4d1e-e437-438a-8567-912561f3a483 Dec 09 21:30:48.165890 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d299616-4130-45aa-910f-0be4cabd042b req-a10c4327-2d5d-481a-b0f4-9a78a8ad22f3 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=042e101d-fba7-4c12-8471-48255f57bee1 HTTP/1.1" status: 200 len: 217 time: 0.0566139 Dec 09 21:30:48.187953 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-669b7922-2471-4dae-bec1-5f7f3814d8bf req-580c4520-46c4-4e69-9539-9ccb844ebd44 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:48.198764 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-669b7922-2471-4dae-bec1-5f7f3814d8bf req-580c4520-46c4-4e69-9539-9ccb844ebd44 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.1329792 Dec 09 21:30:48.227521 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ad98244-0a29-42eb-98dc-ecdad1e35fef tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:48.253310 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 778d35d4-c635-4fcb-b344-64cbb94958b9 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:30:48.268212 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ad98244-0a29-42eb-98dc-ecdad1e35fef tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:48.275239 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ad98244-0a29-42eb-98dc-ecdad1e35fef tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:48.278304 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ad98244-0a29-42eb-98dc-ecdad1e35fef tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:48.339887 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d299616-4130-45aa-910f-0be4cabd042b req-eb8eb887-a15b-436d-b350-3a31d55ab72e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:48.346602 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d299616-4130-45aa-910f-0be4cabd042b req-eb8eb887-a15b-436d-b350-3a31d55ab72e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=10ff3f47-d1f4-47a0-808e-f885899dfb29 HTTP/1.1" status: 200 len: 850 time: 0.1244450 Dec 09 21:30:48.361363 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-669b7922-2471-4dae-bec1-5f7f3814d8bf req-37a4efbe-cb98-4c23-919a-cb1c20f1ed94 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1615534 Dec 09 21:30:48.407095 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ad98244-0a29-42eb-98dc-ecdad1e35fef tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Pushing event updated for resources: {'Network': ['ID=962f4d1e-e437-438a-8567-912561f3a483,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:48.415071 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44868) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:48.415693 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3ad98244-0a29-42eb-98dc-ecdad1e35fef tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 795 time: 0.3428073 Dec 09 21:30:48.461771 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d299616-4130-45aa-910f-0be4cabd042b req-7b5aca02-7949-4816-a1c8-571182fb9463 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:48.463658 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d299616-4130-45aa-910f-0be4cabd042b req-7b5aca02-7949-4816-a1c8-571182fb9463 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=935b09ce-7410-4b66-82be-99978deb6717&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1141534 Dec 09 21:30:48.554935 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 962f4d1e-e437-438a-8567-912561f3a483 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:30:48.673509 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa27abf8-bf36-4719-987c-7199b671d40d req-1c6541d7-e213-4da5-9520-9f899b6f3a8b tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:48.681902 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aa27abf8-bf36-4719-987c-7199b671d40d req-1c6541d7-e213-4da5-9520-9f899b6f3a8b tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 944 time: 0.1596627 Dec 09 21:30:48.704244 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 778d35d4-c635-4fcb-b344-64cbb94958b9, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=778d35d4-c635-4fcb-b344-64cbb94958b9,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:48.716741 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '778d35d4-c635-4fcb-b344-64cbb94958b9', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'port_id': '778d35d4-c635-4fcb-b344-64cbb94958b9', 'mac_address': 'fa:16:3e:aa:9b:e5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:30:48.752924 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7fee01d5-fd68-4f06-82df-3de42201412a None None] Network 2daf651d-b48a-48c4-bd2d-2a1996637137 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:30:48.827924 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d299616-4130-45aa-910f-0be4cabd042b req-5e4d0769-3a37-444b-b992-366fb774bc60 service neutron] 10.222.0.31 "GET /v2.0/networks/935b09ce-7410-4b66-82be-99978deb6717?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3492982 Dec 09 21:30:48.852285 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:48.872026 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1c0fd186-afd3-4ffc-bce9-36d1453161d0 None None] Provisioning complete for port 8b1ca609-e47e-4036-8ddc-c4da7b6611b9 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:48.872264 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1c0fd186-afd3-4ffc-bce9-36d1453161d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:48.876158 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aa27abf8-bf36-4719-987c-7199b671d40d req-f9a1a4bd-8b4c-4f0c-a056-b967e0804d55 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1931548 Dec 09 21:30:48.877565 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 778d35d4-c635-4fcb-b344-64cbb94958b9 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:30:48.894683 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e23a0c84-c7b8-4b6d-a9a3-3d76f833567c tempest-DHCPAgentSchedulersTestJSON-1203919490 tempest-DHCPAgentSchedulersTestJSON-1203919490-project-admin] 10.222.0.13 "GET /v2.0/agents/05180752-3a78-469e-8204-bc6af7fe05ab/dhcp-networks HTTP/1.1" status: 200 len: 13653 time: 0.4770594 Dec 09 21:30:48.897590 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44894) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:48.949765 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 778d35d4-c635-4fcb-b344-64cbb94958b9, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=778d35d4-c635-4fcb-b344-64cbb94958b9,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:48.963782 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:48.996593 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8644afb2-e5f4-4130-a1d0-174b306855ef req-7ec86a09-db0d-4d6c-9639-ecf3f6dc7835 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:49.007569 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8644afb2-e5f4-4130-a1d0-174b306855ef req-7ec86a09-db0d-4d6c-9639-ecf3f6dc7835 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.1839211 Dec 09 21:30:49.037761 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=778d35d4-c635-4fcb-b344-64cbb94958b9,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:49.065422 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['778d35d4-c635-4fcb-b344-64cbb94958b9'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:30:49.110638 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1c0fd186-afd3-4ffc-bce9-36d1453161d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:49.129806 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d299616-4130-45aa-910f-0be4cabd042b req-16980db9-66aa-4e5a-87d9-bbffd99a9034 service neutron] 10.222.0.31 "GET /v2.0/networks/935b09ce-7410-4b66-82be-99978deb6717?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2881885 Dec 09 21:30:49.145665 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8644afb2-e5f4-4130-a1d0-174b306855ef req-b00d5091-de26-4e4c-b0d1-1fcf9b6ed0b0 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1332736 Dec 09 21:30:49.210980 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-1c0fd186-afd3-4ffc-bce9-36d1453161d0 None None] For port 8b1ca609-e47e-4036-8ddc-c4da7b6611b9, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=8b1ca609-e47e-4036-8ddc-c4da7b6611b9,segment=NetworkSegment(9cffea5e-8d42-4214-9794-27c1bb806228),segment_id=9cffea5e-8d42-4214-9794-27c1bb806228)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:49.235605 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1c0fd186-afd3-4ffc-bce9-36d1453161d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:49.277584 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a54d4c2-aa0b-4bee-96c0-4d3c58c50272 tempest-DHCPAgentSchedulersTestJSON-1203919490 tempest-DHCPAgentSchedulersTestJSON-1203919490-project-admin] Network 962f4d1e-e437-438a-8567-912561f3a483 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:30:49.288164 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27731223-4ef4-424c-bc9c-c9d64754dedd req-bc9eb8e6-e6de-4687-87f5-1446dd20f05c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:49.290182 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27731223-4ef4-424c-bc9c-c9d64754dedd req-bc9eb8e6-e6de-4687-87f5-1446dd20f05c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=aacb3291db4d4252a9225e8fe617f667&device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 1096 time: 0.0856144 Dec 09 21:30:49.334584 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5a54d4c2-aa0b-4bee-96c0-4d3c58c50272 tempest-DHCPAgentSchedulersTestJSON-1203919490 tempest-DHCPAgentSchedulersTestJSON-1203919490-project-admin] 10.222.0.13 "POST /v2.0/agents/05180752-3a78-469e-8204-bc6af7fe05ab/dhcp-networks HTTP/1.1" status: 201 len: 201 time: 0.4358637 Dec 09 21:30:49.336964 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44902) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:49.340239 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 8b1ca609-e47e-4036-8ddc-c4da7b6611b9 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:30:49.351025 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3b7e4acb-9a2e-4d43-b944-a4b245ca8d26 None None] Network 962f4d1e-e437-438a-8567-912561f3a483 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:30:49.606844 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c0fd186-afd3-4ffc-bce9-36d1453161d0 None None] Pushing event updated for resources: {'Port': ['ID=8b1ca609-e47e-4036-8ddc-c4da7b6611b9,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:49.625528 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3da09aef-7bba-4e50-b28f-5db2b9ecf343 None None] Provisioning complete for port 8b1ca609-e47e-4036-8ddc-c4da7b6611b9 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:49.625906 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3da09aef-7bba-4e50-b28f-5db2b9ecf343 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:49.674423 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 8b1ca609-e47e-4036-8ddc-c4da7b6611b9 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:49.674795 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:49.703185 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-23d91a03-795b-4c43-bc59-a9e53e62a5b4 tempest-DHCPAgentSchedulersTestJSON-1203919490 tempest-DHCPAgentSchedulersTestJSON-1203919490-project-admin] 10.222.0.13 "GET /v2.0/agents/05180752-3a78-469e-8204-bc6af7fe05ab/dhcp-networks HTTP/1.1" status: 200 len: 14424 time: 0.3650839 Dec 09 21:30:49.706229 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44906) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:49.744978 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1edc42b-fc32-4a29-804d-118f4482320d req-662179a1-993a-42bf-89e1-fa644e703bd1 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:49.755133 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d1edc42b-fc32-4a29-804d-118f4482320d req-662179a1-993a-42bf-89e1-fa644e703bd1 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.2456384 Dec 09 21:30:49.801548 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27731223-4ef4-424c-bc9c-c9d64754dedd req-6a3af223-1bb6-4550-bc40-05ed7b488f37 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:49.803075 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27731223-4ef4-424c-bc9c-c9d64754dedd req-6a3af223-1bb6-4550-bc40-05ed7b488f37 service neutron] 10.222.0.31 "GET /v2.0/networks?id=935b09ce-7410-4b66-82be-99978deb6717 HTTP/1.1" status: 200 len: 912 time: 0.4906378 Dec 09 21:30:49.872992 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c18cacba-33e6-4ed1-b289-8b9111fe8e7e tempest-DHCPAgentSchedulersTestJSON-1203919490 tempest-DHCPAgentSchedulersTestJSON-1203919490-project-admin] 10.222.0.13 "DELETE /v2.0/agents/05180752-3a78-469e-8204-bc6af7fe05ab/dhcp-networks/962f4d1e-e437-438a-8567-912561f3a483 HTTP/1.1" status: 204 len: 168 time: 0.1637027 Dec 09 21:30:49.876341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44910) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:49.908554 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27731223-4ef4-424c-bc9c-c9d64754dedd req-0d063e73-039c-4fbb-9f9c-5142cce5b61f service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=042e101d-fba7-4c12-8471-48255f57bee1 HTTP/1.1" status: 200 len: 217 time: 0.0855105 Dec 09 21:30:49.927565 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d1edc42b-fc32-4a29-804d-118f4482320d req-4df1f136-12a9-4867-806d-75c68ba0a547 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1682696 Dec 09 21:30:50.005874 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27731223-4ef4-424c-bc9c-c9d64754dedd req-18a3709f-d3a5-4bba-a694-cccbc37ee625 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:50.014422 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27731223-4ef4-424c-bc9c-c9d64754dedd req-18a3709f-d3a5-4bba-a694-cccbc37ee625 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=10ff3f47-d1f4-47a0-808e-f885899dfb29 HTTP/1.1" status: 200 len: 850 time: 0.0839481 Dec 09 21:30:50.024708 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d502c531-f08f-4a12-97ea-f1ebc5fa8efd None None] Could not find standard attr ID for object 8ff7aac4-59fc-4198-928f-fe9f58dd717a. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:30:50.140812 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27731223-4ef4-424c-bc9c-c9d64754dedd req-43f02189-085e-4ad6-9b30-34ec0b778f9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:50.142427 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27731223-4ef4-424c-bc9c-c9d64754dedd req-43f02189-085e-4ad6-9b30-34ec0b778f9c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=935b09ce-7410-4b66-82be-99978deb6717&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1012697 Dec 09 21:30:50.146714 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-eb87ff9e-f39a-431d-ae76-2aa8abe707dd tempest-DHCPAgentSchedulersTestJSON-1203919490 tempest-DHCPAgentSchedulersTestJSON-1203919490-project-admin] 10.222.0.13 "GET /v2.0/agents/05180752-3a78-469e-8204-bc6af7fe05ab/dhcp-networks HTTP/1.1" status: 200 len: 13653 time: 0.2681510 Dec 09 21:30:50.151543 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44918) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:50.155809 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42936e6f-c3a4-4dcf-b1e5-706b14904e39 req-7fcfc86c-a75a-4d4c-a3d5-028e405fa2ff tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:50.157377 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42936e6f-c3a4-4dcf-b1e5-706b14904e39 req-7fcfc86c-a75a-4d4c-a3d5-028e405fa2ff tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 944 time: 0.1416993 Dec 09 21:30:50.176937 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b9c14435-dc15-4ae7-bf4c-6de8856f9c61 tempest-DHCPAgentSchedulersTestJSON-1203919490 tempest-DHCPAgentSchedulersTestJSON-1203919490-project-admin] 10.222.0.13 "GET /v2.0/networks/2daf651d-b48a-48c4-bd2d-2a1996637137/dhcp-agents HTTP/1.1" status: 200 len: 798 time: 0.0230844 Dec 09 21:30:50.181264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44920) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:50.254746 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 778d35d4-c635-4fcb-b344-64cbb94958b9 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:30:50.267994 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5a90da3d-aa3a-44a6-8fc0-e65b0536f274 tempest-DHCPAgentSchedulersTestJSON-1203919490 tempest-DHCPAgentSchedulersTestJSON-1203919490-project-admin] 10.222.0.13 "GET /v2.0/networks/2daf651d-b48a-48c4-bd2d-2a1996637137/dhcp-agents HTTP/1.1" status: 200 len: 798 time: 0.0732467 Dec 09 21:30:50.270533 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44924) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:50.304952 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42936e6f-c3a4-4dcf-b1e5-706b14904e39 req-1848b9a6-d92d-443c-9497-e7508f137942 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1368885 Dec 09 21:30:50.324751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 778d35d4-c635-4fcb-b344-64cbb94958b9 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:50.325240 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:50.366941 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27731223-4ef4-424c-bc9c-c9d64754dedd req-f3557573-45e1-4acc-b5f4-55cf82174acc service neutron] 10.222.0.31 "GET /v2.0/networks/935b09ce-7410-4b66-82be-99978deb6717?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2084267 Dec 09 21:30:50.434430 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:50.484638 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 778d35d4-c635-4fcb-b344-64cbb94958b9, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=778d35d4-c635-4fcb-b344-64cbb94958b9,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:50.485933 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '753dc06f-e08a-4cab-82a9-7e1089901f9b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '778d35d4-c635-4fcb-b344-64cbb94958b9'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:30:50.490306 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-09f6fb93-92c7-4464-8e74-a2519b57444f" -d '{"events": [{"server_uuid": "753dc06f-e08a-4cab-82a9-7e1089901f9b", "name": "network-vif-plugged", "status": "completed", "tag": "778d35d4-c635-4fcb-b344-64cbb94958b9"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:30:50.501513 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:50.522752 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27731223-4ef4-424c-bc9c-c9d64754dedd req-7188d98c-ff62-4ecb-8252-cd10a0db9bfc service neutron] 10.222.0.31 "GET /v2.0/networks/935b09ce-7410-4b66-82be-99978deb6717?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1451178 Dec 09 21:30:50.531501 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ac405379-2844-4180-a35e-95a869923f6b tempest-DHCPAgentSchedulersTestJSON-1203919490 tempest-DHCPAgentSchedulersTestJSON-1203919490-project-admin] 10.222.0.13 "GET /v2.0/agents/05180752-3a78-469e-8204-bc6af7fe05ab/dhcp-networks HTTP/1.1" status: 200 len: 13653 time: 0.2571862 Dec 09 21:30:50.534534 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44930) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:50.567366 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6de5e61f-ca6d-4514-9634-dfa2996ed0a7 req-d8828d9f-8234-48c9-8c85-9de590740ca9 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:50.576252 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6de5e61f-ca6d-4514-9634-dfa2996ed0a7 req-d8828d9f-8234-48c9-8c85-9de590740ca9 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 945 time: 0.2695529 Dec 09 21:30:50.611250 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:30:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-48c6248a-c159-4dd4-94c2-50c0557215f2 x-openstack-request-id: req-48c6248a-c159-4dd4-94c2-50c0557215f2 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:30:50.611823 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "753dc06f-e08a-4cab-82a9-7e1089901f9b", "name": "network-vif-plugged", "status": "completed", "tag": "778d35d4-c635-4fcb-b344-64cbb94958b9", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:30:50.612241 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-48c6248a-c159-4dd4-94c2-50c0557215f2 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:30:50.612798 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '753dc06f-e08a-4cab-82a9-7e1089901f9b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '778d35d4-c635-4fcb-b344-64cbb94958b9', 'code': 200} Dec 09 21:30:50.614046 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=778d35d4-c635-4fcb-b344-64cbb94958b9,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:50.652551 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:50.656284 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6de5e61f-ca6d-4514-9634-dfa2996ed0a7 req-c255487b-d790-48df-8678-7e30899b5651 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0791397 Dec 09 21:30:50.759833 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:50.781567 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['962f4d1e-e437-438a-8567-912561f3a483']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:50.791021 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '377c91ac-486e-4c40-b6b2-3e9043f37cb8') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:50.791317 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '377c91ac-486e-4c40-b6b2-3e9043f37cb8') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:50.802391 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:50.817157 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:50.828612 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Releasing vlan 109 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:30:50.829098 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:30:50.832328 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:30:50.902439 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:50.910470 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:50.916068 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] 10.222.0.13 "DELETE /v2.0/networks/962f4d1e-e437-438a-8567-912561f3a483 HTTP/1.1" status: 204 len: 168 time: 0.3764615 Dec 09 21:30:50.916317 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44934) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:50.931727 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Pushing event deleted for resources: {'Network': ['ID=962f4d1e-e437-438a-8567-912561f3a483,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:50.940986 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:50.941344 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:50.941697 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:50.942037 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:50.942376 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:50.942704 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-d20f5b6e-a900-45d7-bf17-093732c06415 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] DELETE failed (client error): The resource could not be found. Dec 09 21:30:50.942827 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:50.943038 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:50.943683 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d20f5b6e-a900-45d7-bf17-093732c06415 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:30:50.943816 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:50.944105 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:50.944442 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:50.944774 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:50.947205 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d20f5b6e-a900-45d7-bf17-093732c06415 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] 10.222.0.13 "DELETE /v2.0/ports/8ff7aac4-59fc-4198-928f-fe9f58dd717a HTTP/1.1" status: 404 len: 333 time: 0.0295179 Dec 09 21:30:50.947360 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:50.949368 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44938) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:50.955228 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d37729d5-92ad-40bf-9766-d54db1cb7c89 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:30:51.045568 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-875defb4-2e9c-4066-9358-ace882502a21 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Deleting subnet e39522c5-3ef5-44e5-83cf-8051df233455 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:30:51.048668 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-875defb4-2e9c-4066-9358-ace882502a21 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:51.102727 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d52ccb04-31b3-4b26-ab07-c1b56999834c req-05b24753-18d9-4945-978c-eb6e5a5a5e1b tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:51.109988 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d52ccb04-31b3-4b26-ab07-c1b56999834c req-05b24753-18d9-4945-978c-eb6e5a5a5e1b tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.1001256 Dec 09 21:30:51.116331 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-875defb4-2e9c-4066-9358-ace882502a21 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:51.212987 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 8b1ca609-e47e-4036-8ddc-c4da7b6611b9 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:30:51.213800 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d52ccb04-31b3-4b26-ab07-c1b56999834c req-713200e6-c04d-49cf-aff0-e83d94c9e35a tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1028564 Dec 09 21:30:51.283128 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-875defb4-2e9c-4066-9358-ace882502a21 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:51.315228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 8b1ca609-e47e-4036-8ddc-c4da7b6611b9 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:51.316188 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:51.392680 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-875defb4-2e9c-4066-9358-ace882502a21 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:51.441874 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-875defb4-2e9c-4066-9358-ace882502a21 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Pushing event deleted for resources: {'Subnet': ['ID=e39522c5-3ef5-44e5-83cf-8051df233455,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:51.448292 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-875defb4-2e9c-4066-9358-ace882502a21 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:51.452673 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-875defb4-2e9c-4066-9358-ace882502a21 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] 10.222.0.13 "DELETE /v2.0/subnets/e39522c5-3ef5-44e5-83cf-8051df233455 HTTP/1.1" status: 204 len: 168 time: 0.5020921 Dec 09 21:30:51.455334 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44946) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:51.461830 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae1c7d48-a618-4c2a-8406-ddd513054529 None None] Network 2daf651d-b48a-48c4-bd2d-2a1996637137 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:30:51.475909 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55828189-1dbf-4a9b-8ea5-9b7ddbc5e069 req-d1a3997b-7fc5-4c0e-aa88-79ca217580c1 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:51.483040 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-55828189-1dbf-4a9b-8ea5-9b7ddbc5e069 req-d1a3997b-7fc5-4c0e-aa88-79ca217580c1 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 944 time: 0.1028337 Dec 09 21:30:51.566439 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-221ec395-6973-4714-9f91-7efa768ead55 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:51.568464 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-55828189-1dbf-4a9b-8ea5-9b7ddbc5e069 req-ec0a09f2-b269-4f8b-ac94-9590b133ca5b tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0843382 Dec 09 21:30:51.646686 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-221ec395-6973-4714-9f91-7efa768ead55 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Deleting port 8b1ca609-e47e-4036-8ddc-c4da7b6611b9 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:30:51.647078 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-221ec395-6973-4714-9f91-7efa768ead55 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:51.680772 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dfc66a5e-432a-4437-bfa9-c4e6fc892059 None None] DHCP port deletion for 2daf651d-b48a-48c4-bd2d-2a1996637137 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:30:51.737776 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-221ec395-6973-4714-9f91-7efa768ead55 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] For port 8b1ca609-e47e-4036-8ddc-c4da7b6611b9, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=8b1ca609-e47e-4036-8ddc-c4da7b6611b9,segment=NetworkSegment(9cffea5e-8d42-4214-9794-27c1bb806228),segment_id=9cffea5e-8d42-4214-9794-27c1bb806228)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:51.738276 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-221ec395-6973-4714-9f91-7efa768ead55 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:51.764657 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-221ec395-6973-4714-9f91-7efa768ead55 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Calling delete_port for 8b1ca609-e47e-4036-8ddc-c4da7b6611b9 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:30:51.770206 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-dfc66a5e-432a-4437-bfa9-c4e6fc892059 None None] Deleting port 8b1ca609-e47e-4036-8ddc-c4da7b6611b9 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:30:51.770591 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dfc66a5e-432a-4437-bfa9-c4e6fc892059 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:51.807986 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3686ae5c-4ecd-47be-910a-e01421f6e858 req-64df1f75-ed0c-42ef-8a3f-ab25099aa374 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:51.810314 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3686ae5c-4ecd-47be-910a-e01421f6e858 req-64df1f75-ed0c-42ef-8a3f-ab25099aa374 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.0693412 Dec 09 21:30:51.865751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-dfc66a5e-432a-4437-bfa9-c4e6fc892059 None None] For port 8b1ca609-e47e-4036-8ddc-c4da7b6611b9, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=8b1ca609-e47e-4036-8ddc-c4da7b6611b9,segment=NetworkSegment(9cffea5e-8d42-4214-9794-27c1bb806228),segment_id=9cffea5e-8d42-4214-9794-27c1bb806228)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:51.866212 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dfc66a5e-432a-4437-bfa9-c4e6fc892059 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:51.874816 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3686ae5c-4ecd-47be-910a-e01421f6e858 req-7f0b0cb3-8133-4385-a71c-d7bc372471d1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0578477 Dec 09 21:30:51.884320 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-221ec395-6973-4714-9f91-7efa768ead55 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:51.886782 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-dfc66a5e-432a-4437-bfa9-c4e6fc892059 None None] Calling delete_port for 8b1ca609-e47e-4036-8ddc-c4da7b6611b9 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:30:51.917614 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-221ec395-6973-4714-9f91-7efa768ead55 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Pushing event deleted for resources: {'Port': ['ID=8b1ca609-e47e-4036-8ddc-c4da7b6611b9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:51.923364 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-221ec395-6973-4714-9f91-7efa768ead55 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] No DVR routers for this DVR port 8b1ca609-e47e-4036-8ddc-c4da7b6611b9 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:30:51.984331 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dfc66a5e-432a-4437-bfa9-c4e6fc892059 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:52.014820 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfc66a5e-432a-4437-bfa9-c4e6fc892059 None None] Pushing event deleted for resources: {'Port': ['ID=8b1ca609-e47e-4036-8ddc-c4da7b6611b9,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:52.023419 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-221ec395-6973-4714-9f91-7efa768ead55 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:52.030224 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfc66a5e-432a-4437-bfa9-c4e6fc892059 None None] No DVR routers for this DVR port 8b1ca609-e47e-4036-8ddc-c4da7b6611b9 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:30:52.073226 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-221ec395-6973-4714-9f91-7efa768ead55 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2daf651d-b48a-48c4-bd2d-2a1996637137']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:52.090587 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-221ec395-6973-4714-9f91-7efa768ead55 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9cffea5e-8d42-4214-9794-27c1bb806228') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:52.090587 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-221ec395-6973-4714-9f91-7efa768ead55 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9cffea5e-8d42-4214-9794-27c1bb806228') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:52.099875 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-221ec395-6973-4714-9f91-7efa768ead55 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:52.116551 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-221ec395-6973-4714-9f91-7efa768ead55 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:52.126466 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-221ec395-6973-4714-9f91-7efa768ead55 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Releasing vlan 115 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:30:52.127036 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-221ec395-6973-4714-9f91-7efa768ead55 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:30:52.130562 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:30:52.200457 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-221ec395-6973-4714-9f91-7efa768ead55 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:52.221564 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-221ec395-6973-4714-9f91-7efa768ead55 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:52.227360 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-221ec395-6973-4714-9f91-7efa768ead55 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] 10.222.0.13 "DELETE /v2.0/networks/2daf651d-b48a-48c4-bd2d-2a1996637137 HTTP/1.1" status: 204 len: 168 time: 0.7682681 Dec 09 21:30:52.228797 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-221ec395-6973-4714-9f91-7efa768ead55 tempest-DHCPAgentSchedulersTestJSON-346639921 tempest-DHCPAgentSchedulersTestJSON-346639921-project] Pushing event deleted for resources: {'Network': ['ID=2daf651d-b48a-48c4-bd2d-2a1996637137,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:52.268828 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 042e101d-fba7-4c12-8471-48255f57bee1 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:30:52.434754 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 042e101d-fba7-4c12-8471-48255f57bee1, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=042e101d-fba7-4c12-8471-48255f57bee1,segment=NetworkSegment(d3bafd14-6a72-4dc5-8e4d-11da22a389ed),segment_id=d3bafd14-6a72-4dc5-8e4d-11da22a389ed)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:52.453103 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85192c2c-6ca9-4c5f-a947-4b5d58c6a8c9 req-bf548bad-d736-409e-a7d9-cb4be02d59e6 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:52.454844 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85192c2c-6ca9-4c5f-a947-4b5d58c6a8c9 req-bf548bad-d736-409e-a7d9-cb4be02d59e6 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.1195474 Dec 09 21:30:52.462760 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '042e101d-fba7-4c12-8471-48255f57bee1', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'port_id': '042e101d-fba7-4c12-8471-48255f57bee1', 'mac_address': 'fa:16:3e:ac:41:da', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:30:52.524319 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:52.540958 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 042e101d-fba7-4c12-8471-48255f57bee1 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:30:52.546865 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85192c2c-6ca9-4c5f-a947-4b5d58c6a8c9 req-35ae2882-49e1-4b37-9d82-255b4e28a37c tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0779719 Dec 09 21:30:52.572336 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 042e101d-fba7-4c12-8471-48255f57bee1, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=042e101d-fba7-4c12-8471-48255f57bee1,segment=NetworkSegment(d3bafd14-6a72-4dc5-8e4d-11da22a389ed),segment_id=d3bafd14-6a72-4dc5-8e4d-11da22a389ed)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:52.578260 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:52.665608 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=042e101d-fba7-4c12-8471-48255f57bee1,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:52.709694 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44968) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:52.733792 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1ef2959-8ff0-4bfc-ad60-acc0c38a95a7 req-abc0ea82-3d1c-4f5a-a4b8-a8d66ee42ce9 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:52.743089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f1ef2959-8ff0-4bfc-ad60-acc0c38a95a7 req-abc0ea82-3d1c-4f5a-a4b8-a8d66ee42ce9 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 945 time: 0.0901775 Dec 09 21:30:52.803222 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f1ef2959-8ff0-4bfc-ad60-acc0c38a95a7 req-efa4586f-efad-46d4-ab74-273f75f2dd29 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0588157 Dec 09 21:30:52.824552 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['042e101d-fba7-4c12-8471-48255f57bee1'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:30:52.916243 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-91cfff7d-2d86-41d5-b413-ece233db2c1f admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ae3d7e00c066487ba5a8c39d19d243c9&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2054427 Dec 09 21:30:52.919231 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44974) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:53.014956 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0057f942-ed8d-4001-9400-3efba54010f3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:53.074341 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0057f942-ed8d-4001-9400-3efba54010f3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:53.105623 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-052d8e94-d783-493e-b409-ab2144069030 req-3f92a985-c01e-4352-8b00-59990d6b7afd tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:53.107767 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-052d8e94-d783-493e-b409-ab2144069030 req-3f92a985-c01e-4352-8b00-59990d6b7afd tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.0948634 Dec 09 21:30:53.177899 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0057f942-ed8d-4001-9400-3efba54010f3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:53.180853 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0057f942-ed8d-4001-9400-3efba54010f3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:53.184729 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0057f942-ed8d-4001-9400-3efba54010f3 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/508d4933-7267-4e59-91f7-2f7481565d1c HTTP/1.1" status: 204 len: 168 time: 0.2618966 Dec 09 21:30:53.199372 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-052d8e94-d783-493e-b409-ab2144069030 req-76d11e98-4c5c-43f3-8af6-d45471587f87 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0782847 Dec 09 21:30:53.200904 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0057f942-ed8d-4001-9400-3efba54010f3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=508d4933-7267-4e59-91f7-2f7481565d1c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:53.269273 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 8b1ca609-e47e-4036-8ddc-c4da7b6611b9 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:30:53.321602 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 8b1ca609-e47e-4036-8ddc-c4da7b6611b9 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:30:53.321957 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 8b1ca609-e47e-4036-8ddc-c4da7b6611b9 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:30:53.589849 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44988) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:53.613598 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-db3d1f35-c8da-474f-a43f-8eb098d28937 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:53.706451 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45109453-2ef5-4561-b8f0-fe36bf1debe6 req-bc15f075-60e6-4ab1-afeb-66f3322708f3 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:53.707986 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-45109453-2ef5-4561-b8f0-fe36bf1debe6 req-bc15f075-60e6-4ab1-afeb-66f3322708f3 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.0782142 Dec 09 21:30:53.753960 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-db3d1f35-c8da-474f-a43f-8eb098d28937 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:53.769910 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-db3d1f35-c8da-474f-a43f-8eb098d28937 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:53.838940 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-45109453-2ef5-4561-b8f0-fe36bf1debe6 req-94a8efcb-6db4-408e-b90a-bd8efeed5b51 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1134117 Dec 09 21:30:53.846345 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-db3d1f35-c8da-474f-a43f-8eb098d28937 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=a36df129c0df462cab85cfbcb28ad1f1&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2526317 Dec 09 21:30:53.846769 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44996) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:53.866489 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db3d1f35-c8da-474f-a43f-8eb098d28937 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=09628e29-ba71-4609-b6ed-53ab3dbd2465,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:53.920137 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-adda3555-6267-44e7-8d5c-fcf8f9c61f55 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:53.960996 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-adda3555-6267-44e7-8d5c-fcf8f9c61f55 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:54.008354 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8f0962f-1a8c-41a4-84d1-f01b3d75a332 req-923a7910-b0ce-4e4f-8d9a-f0b3b8c59267 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:54.010471 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8f0962f-1a8c-41a4-84d1-f01b3d75a332 req-923a7910-b0ce-4e4f-8d9a-f0b3b8c59267 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 945 time: 0.0803127 Dec 09 21:30:54.020025 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-adda3555-6267-44e7-8d5c-fcf8f9c61f55 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:54.023249 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-adda3555-6267-44e7-8d5c-fcf8f9c61f55 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:54.024677 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-adda3555-6267-44e7-8d5c-fcf8f9c61f55 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/09628e29-ba71-4609-b6ed-53ab3dbd2465 HTTP/1.1" status: 204 len: 168 time: 0.1771767 Dec 09 21:30:54.039809 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adda3555-6267-44e7-8d5c-fcf8f9c61f55 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=09628e29-ba71-4609-b6ed-53ab3dbd2465,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:54.098342 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8f0962f-1a8c-41a4-84d1-f01b3d75a332 req-a86a608c-6a54-4032-98ca-44816b243e97 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0790300 Dec 09 21:30:54.274797 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 042e101d-fba7-4c12-8471-48255f57bee1 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:30:54.426997 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 042e101d-fba7-4c12-8471-48255f57bee1 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:30:54.430958 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e7bc8bf-4cbd-49a8-9464-4bffe6ed7502 req-feb8b7cf-4a60-4abb-bf52-bf4adecfabf7 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:54.432589 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 042e101d-fba7-4c12-8471-48255f57bee1 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:30:54.433316 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:54.444114 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e7bc8bf-4cbd-49a8-9464-4bffe6ed7502 req-feb8b7cf-4a60-4abb-bf52-bf4adecfabf7 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.1083703 Dec 09 21:30:54.552005 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e7bc8bf-4cbd-49a8-9464-4bffe6ed7502 req-6f3f2324-be92-40c6-bf23-1f0a08a464d9 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1064243 Dec 09 21:30:54.581297 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:54.613622 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'de68791c-82e4-4147-88d4-7a0ce0f25710', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '042e101d-fba7-4c12-8471-48255f57bee1'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:30:54.616153 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0723bfbd-5a48-4ba7-9bbe-334add5530d1" -d '{"events": [{"server_uuid": "de68791c-82e4-4147-88d4-7a0ce0f25710", "name": "network-vif-plugged", "status": "completed", "tag": "042e101d-fba7-4c12-8471-48255f57bee1"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:30:54.640630 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 042e101d-fba7-4c12-8471-48255f57bee1, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=042e101d-fba7-4c12-8471-48255f57bee1,segment=NetworkSegment(d3bafd14-6a72-4dc5-8e4d-11da22a389ed),segment_id=d3bafd14-6a72-4dc5-8e4d-11da22a389ed)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:54.646352 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:54.686044 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:30:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1aeaa2e0-b2ab-4644-beeb-97a77995b5d0 x-openstack-request-id: req-1aeaa2e0-b2ab-4644-beeb-97a77995b5d0 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:30:54.686397 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "de68791c-82e4-4147-88d4-7a0ce0f25710", "name": "network-vif-plugged", "status": "completed", "tag": "042e101d-fba7-4c12-8471-48255f57bee1", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:30:54.686649 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-1aeaa2e0-b2ab-4644-beeb-97a77995b5d0 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:30:54.687046 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'de68791c-82e4-4147-88d4-7a0ce0f25710', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '042e101d-fba7-4c12-8471-48255f57bee1', 'code': 200} Dec 09 21:30:54.717839 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=042e101d-fba7-4c12-8471-48255f57bee1,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:54.804216 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c66e549c-3dd2-401f-be46-46cbe6bd0f58 req-506b69f0-aeda-4d74-8bf3-4c4f985c20e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:54.805980 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c66e549c-3dd2-401f-be46-46cbe6bd0f58 req-506b69f0-aeda-4d74-8bf3-4c4f985c20e6 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 1098 time: 0.0500345 Dec 09 21:30:55.260722 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c66e549c-3dd2-401f-be46-46cbe6bd0f58 req-19994048-fb56-4e58-9cc2-2df3be724ad9 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4470870 Dec 09 21:30:55.335405 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-705d83d6-a2d8-4647-97bf-4413807a77c5 req-7fa876a5-50e9-4eef-b928-2139131c1ffc tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:55.341679 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-705d83d6-a2d8-4647-97bf-4413807a77c5 req-7fa876a5-50e9-4eef-b928-2139131c1ffc tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.0936992 Dec 09 21:30:55.361577 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2b5ecf4-b567-4bd0-b19e-0b3cf892e691 req-a75a0c79-ce9f-4891-8298-3f64baa46d0a tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:55.363282 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b2b5ecf4-b567-4bd0-b19e-0b3cf892e691 req-a75a0c79-ce9f-4891-8298-3f64baa46d0a tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.1260746 Dec 09 21:30:55.415848 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-705d83d6-a2d8-4647-97bf-4413807a77c5 req-7fab5705-f742-4d38-afcb-a99d1cc01947 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0679629 Dec 09 21:30:55.516355 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b2b5ecf4-b567-4bd0-b19e-0b3cf892e691 req-89ae74f4-a15d-4044-ad1a-207c883a9be3 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1408947 Dec 09 21:30:55.720039 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35818116-0877-4065-b566-ad81a10cd041 req-9b05a9e7-7e19-4dcb-ad85-bbb00cab21b4 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:55.721701 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35818116-0877-4065-b566-ad81a10cd041 req-9b05a9e7-7e19-4dcb-ad85-bbb00cab21b4 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.0764158 Dec 09 21:30:55.799641 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35818116-0877-4065-b566-ad81a10cd041 req-c7a222d5-5d6a-4d93-96ec-d47971ea8d3a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0672255 Dec 09 21:30:55.972137 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45058) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:56.161693 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-42c4ac17-259a-4fe5-91eb-aab1bb529c26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] Request body: {'network': {'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-test-network-1088117448'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:56.195616 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-42c4ac17-259a-4fe5-91eb-aab1bb529c26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] Made reservation on behalf of e186344d2a4f42f0b958721bf4c001e8 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:30:56.199936 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42c4ac17-259a-4fe5-91eb-aab1bb529c26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:56.210481 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42c4ac17-259a-4fe5-91eb-aab1bb529c26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:56.310003 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42c4ac17-259a-4fe5-91eb-aab1bb529c26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:56.315145 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42c4ac17-259a-4fe5-91eb-aab1bb529c26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:56.348960 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-42c4ac17-259a-4fe5-91eb-aab1bb529c26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] vlan segment allocate from pool success with {'vlan_id': 149, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:30:56.365095 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42c4ac17-259a-4fe5-91eb-aab1bb529c26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b6d6d88b-00aa-4801-9d62-f90db5033ed8,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:56.369469 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42c4ac17-259a-4fe5-91eb-aab1bb529c26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:56.370567 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-42c4ac17-259a-4fe5-91eb-aab1bb529c26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] Added segment 84b93960-a6df-4fd8-a5cd-b8f037e14fbc of type vlan for network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 Dec 09 21:30:56.420909 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42c4ac17-259a-4fe5-91eb-aab1bb529c26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:56.465652 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42c4ac17-259a-4fe5-91eb-aab1bb529c26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:56.472305 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42c4ac17-259a-4fe5-91eb-aab1bb529c26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:56.472958 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42c4ac17-259a-4fe5-91eb-aab1bb529c26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:56.577639 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42c4ac17-259a-4fe5-91eb-aab1bb529c26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] Pushing event updated for resources: {'Network': ['ID=a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:56.589236 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:30:56.602490 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-42c4ac17-259a-4fe5-91eb-aab1bb529c26 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 803 time: 0.6285923 Dec 09 21:30:56.614534 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19fa75e7-61ad-48e8-903e-8caab261d2d4 req-49adda8d-5ef7-4a89-8457-40252accc95b tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:56.623916 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19fa75e7-61ad-48e8-903e-8caab261d2d4 req-49adda8d-5ef7-4a89-8457-40252accc95b tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.1289418 Dec 09 21:30:56.729053 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-666004aa-9ba9-456e-8664-31c5a6725465 req-2b826d63-b264-4618-b2b7-851443d2ffb4 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:56.730996 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-666004aa-9ba9-456e-8664-31c5a6725465 req-2b826d63-b264-4618-b2b7-851443d2ffb4 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.0840673 Dec 09 21:30:56.744914 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19fa75e7-61ad-48e8-903e-8caab261d2d4 req-e02f5928-ef25-4345-808d-ec14ee947843 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1196227 Dec 09 21:30:56.834497 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-666004aa-9ba9-456e-8664-31c5a6725465 req-83b413ba-c41a-4f15-b13b-49a32602f5a9 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0884018 Dec 09 21:30:57.071807 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45080) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:57.078370 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Request body: {'port': {'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14', 'binding:host_id': 'n-h1-713301-27', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-1359561876'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:57.136843 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Made reservation on behalf of 340b257a32a54b86b816968ee33f4779 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:30:57.140525 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:57.150440 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:57.166675 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70836ef0-b525-47ef-a0ed-8cacf03e6aa5 req-6827a16f-60a8-4cf9-aafa-3ab1b4662280 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:57.180771 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-70836ef0-b525-47ef-a0ed-8cacf03e6aa5 req-6827a16f-60a8-4cf9-aafa-3ab1b4662280 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.0887508 Dec 09 21:30:57.196343 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:57.201284 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:57.235912 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:57.238915 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-70836ef0-b525-47ef-a0ed-8cacf03e6aa5 req-6214a089-fad4-494c-81e5-23bf67f48c68 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0569491 Dec 09 21:30:57.242030 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:57.245921 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] device_id is not set on port 89e0dd06-8547-45d8-9603-847dd53e90c8 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:30:57.340593 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=391d9d10-56af-44a1-8b72-8235a2062e73,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:57.493744 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] device_id is not set on port 89e0dd06-8547-45d8-9603-847dd53e90c8 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:30:57.504163 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:57.512597 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:57.573289 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Pushing event updated for resources: {'Port': ['ID=89e0dd06-8547-45d8-9603-847dd53e90c8,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:57.594980 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Checking segment: {'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:30:57.595338 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Network hostable DHCP agents. Network: a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:30:57.623470 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:30:57.632736 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:30:57.636969 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:30:57.647116 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c151c7a1-4084-4a57-9061-29895044698a None None] Network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:30:57.658367 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:57.658698 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:57.659075 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:57.663477 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port 89e0dd06-8547-45d8-9603-847dd53e90c8 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:30:57.663821 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:30:57.664206 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 2 to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 Dec 09 21:30:57.680408 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:57.680408 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:57.680408 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:57.686084 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port 89e0dd06-8547-45d8-9603-847dd53e90c8 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:30:57.686084 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:30:57.686340 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 3 to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 Dec 09 21:30:57.699917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:57.700332 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:57.700872 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:57.705972 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port 89e0dd06-8547-45d8-9603-847dd53e90c8 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:30:57.706330 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:30:57.706724 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 4 to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 Dec 09 21:30:57.721908 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:57.722182 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:57.722511 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:57.731230 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port 89e0dd06-8547-45d8-9603-847dd53e90c8 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:30:57.731638 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:30:57.732041 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 5 to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 Dec 09 21:30:57.747142 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:57.747411 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:57.747803 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:57.752833 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port 89e0dd06-8547-45d8-9603-847dd53e90c8 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:30:57.753227 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:30:57.753672 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 6 to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 Dec 09 21:30:57.770932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:57.770932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:57.770932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:57.776055 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port 89e0dd06-8547-45d8-9603-847dd53e90c8 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:30:57.776561 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:30:57.777189 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 7 to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 Dec 09 21:30:57.795175 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:57.795175 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:57.795175 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:57.799727 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port 89e0dd06-8547-45d8-9603-847dd53e90c8 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:30:57.800117 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:30:57.800569 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 8 to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 Dec 09 21:30:57.814494 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:57.814938 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:57.815430 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:57.820361 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port 89e0dd06-8547-45d8-9603-847dd53e90c8 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:30:57.820762 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:30:57.821209 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 9 to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 Dec 09 21:30:57.841322 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:57.841971 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:57.849725 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:57.859177 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port 89e0dd06-8547-45d8-9603-847dd53e90c8 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:30:57.859568 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:30:57.859960 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 10 to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 Dec 09 21:30:57.885432 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:57.885861 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:57.886473 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:57.892956 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port 89e0dd06-8547-45d8-9603-847dd53e90c8 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:30:57.893278 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port 89e0dd06-8547-45d8-9603-847dd53e90c8 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:30:57.893944 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:57.915673 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-211f1c4e-24cd-47f4-8a04-a670ec2538d3 req-63beb148-09ba-4a5b-903e-af0162ca2d7c tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:57.925032 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-211f1c4e-24cd-47f4-8a04-a670ec2538d3 req-63beb148-09ba-4a5b-903e-af0162ca2d7c tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.0877542 Dec 09 21:30:57.983761 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-211f1c4e-24cd-47f4-8a04-a670ec2538d3 req-1e5875cf-58a8-42da-a201-4b1437ce5896 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0574071 Dec 09 21:30:58.053806 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] For port 89e0dd06-8547-45d8-9603-847dd53e90c8, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:30:58.054238 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempted to set empty binding levels {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Dec 09 21:30:58.061489 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:58.095002 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:58.095738 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:58.105325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-131a1daf-d115-4472-bdee-760ffb0215d4 req-96b783fe-58c0-4769-a91d-ec8093628d87 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:58.117926 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-131a1daf-d115-4472-bdee-760ffb0215d4 req-96b783fe-58c0-4769-a91d-ec8093628d87 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.0867248 Dec 09 21:30:58.121812 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Pushing event updated for resources: {'Port': ['ID=89e0dd06-8547-45d8-9603-847dd53e90c8,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:58.132808 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-02562160-0918-447b-bc2a-67012ed62c7b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 985 time: 1.0574808 Dec 09 21:30:58.133215 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45100) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:58.196642 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-131a1daf-d115-4472-bdee-760ffb0215d4 req-e630cbba-103b-4917-9c33-03df3f1e41a8 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0767534 Dec 09 21:30:58.250083 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-379672d8-c517-48e5-965a-b3b21ab770f3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Deleting port 89e0dd06-8547-45d8-9603-847dd53e90c8 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:30:58.250444 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-379672d8-c517-48e5-965a-b3b21ab770f3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:58.255199 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-844ee93e-1322-4c19-83a9-0db547c570f0 req-dfed11ce-0059-4934-865b-0437decddeb7 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:58.269665 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-844ee93e-1322-4c19-83a9-0db547c570f0 req-dfed11ce-0059-4934-865b-0437decddeb7 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.0962989 Dec 09 21:30:58.270190 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45104) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:58.281678 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-9dd97a7a-8758-40f3-9009-05457fe23d58 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Request body: {'floatingip': {'port_id': '042e101d-fba7-4c12-8471-48255f57bee1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:58.328108 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-379672d8-c517-48e5-965a-b3b21ab770f3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] For port 89e0dd06-8547-45d8-9603-847dd53e90c8, host n-h1-713301-27, got binding levels [] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:30:58.328615 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-379672d8-c517-48e5-965a-b3b21ab770f3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:58.342486 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-379672d8-c517-48e5-965a-b3b21ab770f3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Calling delete_port for 89e0dd06-8547-45d8-9603-847dd53e90c8 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:30:58.407346 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9dd97a7a-8758-40f3-9009-05457fe23d58 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for floatingip, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:58.438435 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-379672d8-c517-48e5-965a-b3b21ab770f3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:58.468714 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-379672d8-c517-48e5-965a-b3b21ab770f3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Pushing event deleted for resources: {'Port': ['ID=89e0dd06-8547-45d8-9603-847dd53e90c8,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:58.480084 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-379672d8-c517-48e5-965a-b3b21ab770f3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:58.487196 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-379672d8-c517-48e5-965a-b3b21ab770f3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] 10.222.0.13 "DELETE /v2.0/ports/89e0dd06-8547-45d8-9603-847dd53e90c8 HTTP/1.1" status: 204 len: 168 time: 0.3529580 Dec 09 21:30:58.487918 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45108) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:58.517549 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-da3fc096-b03b-4e56-b97c-219cffc35ff7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] GET failed (client error): The resource could not be found. Dec 09 21:30:58.523034 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-da3fc096-b03b-4e56-b97c-219cffc35ff7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] 10.222.0.13 "GET /v2.0/ports/89e0dd06-8547-45d8-9603-847dd53e90c8 HTTP/1.1" status: 404 len: 333 time: 0.0340879 Dec 09 21:30:58.523717 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45110) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:58.528651 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-01fa0971-111e-493c-bd44-b17f17609a4d tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Request body: {'port': {'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-1777522306'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:58.556028 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-01fa0971-111e-493c-bd44-b17f17609a4d tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Made reservation on behalf of 340b257a32a54b86b816968ee33f4779 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:30:58.559103 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01fa0971-111e-493c-bd44-b17f17609a4d tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:58.577323 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-01fa0971-111e-493c-bd44-b17f17609a4d tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] device_id is not set on port f54efef3-974f-4f70-a244-b8c409003944 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:30:58.592762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fc31bb1-0039-467a-bcc5-8502d9f7c01f req-6c5e0086-bfab-4a95-acce-f330ee8e9c4a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:58.594295 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8fc31bb1-0039-467a-bcc5-8502d9f7c01f req-6c5e0086-bfab-4a95-acce-f330ee8e9c4a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.2363861 Dec 09 21:30:58.705790 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8fc31bb1-0039-467a-bcc5-8502d9f7c01f req-aa1d3df1-2f99-4d01-9887-f6a50544c656 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0741172 Dec 09 21:30:58.762007 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01fa0971-111e-493c-bd44-b17f17609a4d tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:58.801652 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01fa0971-111e-493c-bd44-b17f17609a4d tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:58.851538 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-01fa0971-111e-493c-bd44-b17f17609a4d tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:30:58.855689 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01fa0971-111e-493c-bd44-b17f17609a4d tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Pushing event updated for resources: {'Port': ['ID=f54efef3-974f-4f70-a244-b8c409003944,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:58.860130 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-01fa0971-111e-493c-bd44-b17f17609a4d tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:30:58.862430 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01fa0971-111e-493c-bd44-b17f17609a4d tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:30:58.863842 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01fa0971-111e-493c-bd44-b17f17609a4d tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:58.864755 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01fa0971-111e-493c-bd44-b17f17609a4d tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:58.898695 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-01fa0971-111e-493c-bd44-b17f17609a4d tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 964 time: 0.3710244 Dec 09 21:30:58.898933 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45112) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:58.905150 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Request body: {'port': {'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:30:58.969251 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:59.141842 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9dd97a7a-8758-40f3-9009-05457fe23d58 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:59.150379 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9dd97a7a-8758-40f3-9009-05457fe23d58 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:59.261632 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] device_id is not set on port f54efef3-974f-4f70-a244-b8c409003944 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:30:59.276500 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-9dd97a7a-8758-40f3-9009-05457fe23d58 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Floating IP 314ffaf2-8bb1-44c3-9e47-3fb70d04ddee associated. External IP: 172.25.3.170, port: 042e101d-fba7-4c12-8471-48255f57bee1. Dec 09 21:30:59.281108 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:59.295561 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:59.388313 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Pushing event updated for resources: {'Port': ['ID=f54efef3-974f-4f70-a244-b8c409003944,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:30:59.416670 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4905b6d-8847-405c-bff1-10a3c393332a req-750aba20-70fe-4cb5-a604-afbce0e7dce7 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:59.418801 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:59.419322 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:59.420516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:59.425883 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port f54efef3-974f-4f70-a244-b8c409003944 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:30:59.426284 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d4905b6d-8847-405c-bff1-10a3c393332a req-750aba20-70fe-4cb5-a604-afbce0e7dce7 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.0945001 Dec 09 21:30:59.426583 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port f54efef3-974f-4f70-a244-b8c409003944 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:30:59.427188 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 2 to bind port f54efef3-974f-4f70-a244-b8c409003944 Dec 09 21:30:59.463352 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:59.465762 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:59.468747 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:59.504235 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port f54efef3-974f-4f70-a244-b8c409003944 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:30:59.505696 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port f54efef3-974f-4f70-a244-b8c409003944 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:30:59.506628 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 3 to bind port f54efef3-974f-4f70-a244-b8c409003944 Dec 09 21:30:59.524080 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:59.524672 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:59.525166 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:59.534770 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port f54efef3-974f-4f70-a244-b8c409003944 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:30:59.536122 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port f54efef3-974f-4f70-a244-b8c409003944 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:30:59.536661 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 4 to bind port f54efef3-974f-4f70-a244-b8c409003944 Dec 09 21:30:59.550756 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:59.551326 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:59.551874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:59.559327 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port f54efef3-974f-4f70-a244-b8c409003944 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:30:59.560367 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port f54efef3-974f-4f70-a244-b8c409003944 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:30:59.560936 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 5 to bind port f54efef3-974f-4f70-a244-b8c409003944 Dec 09 21:30:59.576178 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:59.577014 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:59.577536 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:59.579862 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d4905b6d-8847-405c-bff1-10a3c393332a req-0477b441-2730-42e9-af34-371173fa0d83 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1523914 Dec 09 21:30:59.582385 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port f54efef3-974f-4f70-a244-b8c409003944 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:30:59.582858 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port f54efef3-974f-4f70-a244-b8c409003944 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:30:59.583385 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 6 to bind port f54efef3-974f-4f70-a244-b8c409003944 Dec 09 21:30:59.597768 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:59.598309 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:59.598795 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:59.608221 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port f54efef3-974f-4f70-a244-b8c409003944 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:30:59.608773 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port f54efef3-974f-4f70-a244-b8c409003944 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:30:59.609307 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 7 to bind port f54efef3-974f-4f70-a244-b8c409003944 Dec 09 21:30:59.621936 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:59.622565 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:59.623166 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:59.628078 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port f54efef3-974f-4f70-a244-b8c409003944 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:30:59.628563 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port f54efef3-974f-4f70-a244-b8c409003944 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:30:59.629090 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 8 to bind port f54efef3-974f-4f70-a244-b8c409003944 Dec 09 21:30:59.645678 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:59.646259 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:59.646751 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:59.651718 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port f54efef3-974f-4f70-a244-b8c409003944 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:30:59.652224 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port f54efef3-974f-4f70-a244-b8c409003944 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:30:59.652608 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 9 to bind port f54efef3-974f-4f70-a244-b8c409003944 Dec 09 21:30:59.665267 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9dd97a7a-8758-40f3-9009-05457fe23d58 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Router a0406620-d595-409c-958d-7a486a49577c has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:30:59.667641 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:59.667974 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:59.668310 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:59.676989 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port f54efef3-974f-4f70-a244-b8c409003944 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:30:59.678089 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port f54efef3-974f-4f70-a244-b8c409003944 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:30:59.678492 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 10 to bind port f54efef3-974f-4f70-a244-b8c409003944 Dec 09 21:30:59.696769 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:30:59.697103 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:30:59.697437 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port f54efef3-974f-4f70-a244-b8c409003944 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:30:59.701911 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port f54efef3-974f-4f70-a244-b8c409003944 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:30:59.702233 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port f54efef3-974f-4f70-a244-b8c409003944 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:30:59.702601 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:59.809257 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] For port f54efef3-974f-4f70-a244-b8c409003944, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:30:59.810006 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempted to set empty binding levels {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Dec 09 21:30:59.817215 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:59.846816 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9dd97a7a-8758-40f3-9009-05457fe23d58 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:30:59.854107 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9dd97a7a-8758-40f3-9009-05457fe23d58 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:59.862329 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65504b80-e9b1-4d47-aa8f-dcef947934ee None None] Sync routers for ids ['a0406620-d595-409c-958d-7a486a49577c'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:30:59.870353 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] In _notify_port_updated(), no bound segment for port f54efef3-974f-4f70-a244-b8c409003944 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:30:59.871397 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:59.872668 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:30:59.876595 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] 10.222.0.13 "PUT /v2.0/ports/f54efef3-974f-4f70-a244-b8c409003944 HTTP/1.1" status: 200 len: 980 time: 0.9742968 Dec 09 21:30:59.877718 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65504b80-e9b1-4d47-aa8f-dcef947934ee None None] Routers {'a0406620-d595-409c-958d-7a486a49577c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:30:59.878632 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45126) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:30:59.883100 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-65504b80-e9b1-4d47-aa8f-dcef947934ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:30:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a0406620-d595-409c-958d-7a486a49577c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:30:59.891478 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9dd97a7a-8758-40f3-9009-05457fe23d58 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "PUT /v2.0/floatingips/314ffaf2-8bb1-44c3-9e47-3fb70d04ddee HTTP/1.1" status: 200 len: 992 time: 1.6201160 Dec 09 21:30:59.894040 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'de68791c-82e4-4147-88d4-7a0ce0f25710', 'tag': '042e101d-fba7-4c12-8471-48255f57bee1'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:30:59.899037 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ec230596-a05e-4562-88dc-7f41d6fba6d5" -d '{"events": [{"name": "network-changed", "server_uuid": "de68791c-82e4-4147-88d4-7a0ce0f25710", "tag": "042e101d-fba7-4c12-8471-48255f57bee1"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:30:59.916808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22901ae7-1cff-4727-9ff8-d3eefb4398a2 req-dd22856c-6c62-4e1c-a978-b96316689b74 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:30:59.928009 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22901ae7-1cff-4727-9ff8-d3eefb4398a2 req-dd22856c-6c62-4e1c-a978-b96316689b74 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.1189356 Dec 09 21:30:59.965101 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7219b4a8-0eb7-4756-9477-984579fef1ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Pushing event updated for resources: {'Port': ['ID=f54efef3-974f-4f70-a244-b8c409003944,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:00.057762 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:30:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8e00fc44-0d2c-4ca7-b600-05fae5f052c2 x-openstack-request-id: req-8e00fc44-0d2c-4ca7-b600-05fae5f052c2 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:31:00.058094 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "de68791c-82e4-4147-88d4-7a0ce0f25710", "tag": "042e101d-fba7-4c12-8471-48255f57bee1", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:31:00.060598 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8e00fc44-0d2c-4ca7-b600-05fae5f052c2 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:31:00.061104 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'de68791c-82e4-4147-88d4-7a0ce0f25710', 'tag': '042e101d-fba7-4c12-8471-48255f57bee1', 'status': 'completed', 'code': 200} Dec 09 21:31:00.066444 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22901ae7-1cff-4727-9ff8-d3eefb4398a2 req-615b90cd-c716-44bc-a256-4b6c269b9025 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1321354 Dec 09 21:31:00.142617 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-65504b80-e9b1-4d47-aa8f-dcef947934ee None None] Set router a0406620-d595-409c-958d-7a486a49577c gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:31:00.174960 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec230596-a05e-4562-88dc-7f41d6fba6d5 req-3e7f5820-49cb-44a7-8f96-7b6331adca16 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.177154 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec230596-a05e-4562-88dc-7f41d6fba6d5 req-3e7f5820-49cb-44a7-8f96-7b6331adca16 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=aacb3291db4d4252a9225e8fe617f667&device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 1098 time: 0.1150095 Dec 09 21:31:00.406489 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec230596-a05e-4562-88dc-7f41d6fba6d5 req-c246121c-1450-4cd9-8ce5-f199b7f58000 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.412124 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec230596-a05e-4562-88dc-7f41d6fba6d5 req-c246121c-1450-4cd9-8ce5-f199b7f58000 service neutron] 10.222.0.31 "GET /v2.0/networks?id=935b09ce-7410-4b66-82be-99978deb6717 HTTP/1.1" status: 200 len: 912 time: 0.2258132 Dec 09 21:31:00.443587 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.444197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.444510 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.444972 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.445427 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.445973 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.446531 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.446987 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.447467 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.447959 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.448494 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.449181 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.449760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.450307 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.450757 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.451199 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.451679 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.452128 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.452574 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.453032 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.453469 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.453915 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.454359 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.454808 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.455343 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.455938 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.456412 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.456889 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.457381 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.457854 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.458449 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.459524 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.459524 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.459917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.460367 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.460844 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.461331 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.461807 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.462320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.462765 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.463236 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.463814 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.464355 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.464816 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.465280 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.465878 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.466327 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.466772 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.467221 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.467714 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.468161 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.468608 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.469174 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.469618 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.470058 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.470593 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.471181 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.471550 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.471998 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.472756 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.478083 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4aec4e70-efbc-4395-9b6a-d2f566bf14e6 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 53624 time: 0.5984423 Dec 09 21:31:00.478290 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-65504b80-e9b1-4d47-aa8f-dcef947934ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0406620-d595-409c-958d-7a486a49577c', 'name': 'tempest-AttachVolumeTestJSON-1079676770-router', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210'}], 'enable_snat': True}, 'gw_port_id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:32Z', 'updated_at': '2021-12-09T21:30:38Z', 'revision_number': 4, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'gw_port': {'id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:0e:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1399, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:33Z', 'updated_at': '2021-12-09T21:30:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '314ffaf2-8bb1-44c3-9e47-3fb70d04ddee', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'floating_ip_address': '172.25.3.170', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'a0406620-d595-409c-958d-7a486a49577c', 'port_id': '042e101d-fba7-4c12-8471-48255f57bee1', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 1425, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'mac_address': 'fa:16:3e:ac:41:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'de68791c-82e4-4147-88d4-7a0ce0f25710', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:30:42Z', 'updated_at': '2021-12-09T21:30:58Z', 'revision_number': 1, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbff506a-7b73-4238-9fda-dd193910d0ce', 'name': '', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'mac_address': 'fa:16:3e:94:28:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:37Z', 'updated_at': '2021-12-09T21:30:42Z', 'revision_number': 5, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'subnets': [{'id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:00.483939 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45140) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:00.510990 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65504b80-e9b1-4d47-aa8f-dcef947934ee None None] Checking router: a0406620-d595-409c-958d-7a486a49577c for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:31:00.522057 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65504b80-e9b1-4d47-aa8f-dcef947934ee None None] Routers {'a0406620-d595-409c-958d-7a486a49577c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:31:00.525159 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-65504b80-e9b1-4d47-aa8f-dcef947934ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:30:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a0406620-d595-409c-958d-7a486a49577c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:00.619843 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec230596-a05e-4562-88dc-7f41d6fba6d5 req-7b5b8c1b-3661-41d7-901e-b6ceeb832aa4 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=042e101d-fba7-4c12-8471-48255f57bee1 HTTP/1.1" status: 200 len: 1000 time: 0.1996548 Dec 09 21:31:00.633322 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1612b88d-5166-4801-9c89-e0e9cb23cab0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Deleting port f54efef3-974f-4f70-a244-b8c409003944 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:31:00.633838 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1612b88d-5166-4801-9c89-e0e9cb23cab0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:00.706343 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-65504b80-e9b1-4d47-aa8f-dcef947934ee None None] Set router a0406620-d595-409c-958d-7a486a49577c gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:31:00.739186 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-1612b88d-5166-4801-9c89-e0e9cb23cab0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] For port f54efef3-974f-4f70-a244-b8c409003944, host n-h1-713301-27, got binding levels [] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:31:00.740104 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1612b88d-5166-4801-9c89-e0e9cb23cab0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:00.749618 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec230596-a05e-4562-88dc-7f41d6fba6d5 req-c6e54bd6-202a-4120-8416-dbc8fdc209c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.752113 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec230596-a05e-4562-88dc-7f41d6fba6d5 req-c6e54bd6-202a-4120-8416-dbc8fdc209c1 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=10ff3f47-d1f4-47a0-808e-f885899dfb29 HTTP/1.1" status: 200 len: 850 time: 0.1244783 Dec 09 21:31:00.764668 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1612b88d-5166-4801-9c89-e0e9cb23cab0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Calling delete_port for f54efef3-974f-4f70-a244-b8c409003944 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:31:00.823932 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e46e891e-b995-4863-8d04-573268f70804 req-155986bd-d1ce-49f6-9708-7943a4e3ce6a tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.832089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e46e891e-b995-4863-8d04-573268f70804 req-155986bd-d1ce-49f6-9708-7943a4e3ce6a tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.1177392 Dec 09 21:31:00.895347 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e46e891e-b995-4863-8d04-573268f70804 req-ac17501d-0970-44f3-a31f-d35f79ec5fee tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0622747 Dec 09 21:31:00.898633 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec230596-a05e-4562-88dc-7f41d6fba6d5 req-0317c9ea-d58f-415e-add0-67827015b8ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:00.900222 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec230596-a05e-4562-88dc-7f41d6fba6d5 req-0317c9ea-d58f-415e-add0-67827015b8ff service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=935b09ce-7410-4b66-82be-99978deb6717&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1401417 Dec 09 21:31:00.918212 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1612b88d-5166-4801-9c89-e0e9cb23cab0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:00.958704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1612b88d-5166-4801-9c89-e0e9cb23cab0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Pushing event deleted for resources: {'Port': ['ID=f54efef3-974f-4f70-a244-b8c409003944,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:00.965750 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1612b88d-5166-4801-9c89-e0e9cb23cab0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:00.970526 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1612b88d-5166-4801-9c89-e0e9cb23cab0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] 10.222.0.13 "DELETE /v2.0/ports/f54efef3-974f-4f70-a244-b8c409003944 HTTP/1.1" status: 204 len: 168 time: 0.4850740 Dec 09 21:31:00.974620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45144) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:01.012386 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-1fcda55b-3b84-4fb9-87dc-b572257998f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] GET failed (client error): The resource could not be found. Dec 09 21:31:01.014244 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1fcda55b-3b84-4fb9-87dc-b572257998f5 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] 10.222.0.13 "GET /v2.0/ports/f54efef3-974f-4f70-a244-b8c409003944 HTTP/1.1" status: 404 len: 333 time: 0.0381322 Dec 09 21:31:01.018107 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45148) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:01.023656 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-71c95784-1586-4204-9e47-ff8869a7aca0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Request body: {'port': {'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-2079547777', 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:01.056676 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-71c95784-1586-4204-9e47-ff8869a7aca0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Made reservation on behalf of 340b257a32a54b86b816968ee33f4779 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:31:01.064883 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71c95784-1586-4204-9e47-ff8869a7aca0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:01.089859 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-71c95784-1586-4204-9e47-ff8869a7aca0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] device_id is not set on port 723875cb-b8c9-4c0a-9113-ec2e7b4c70e0 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:31:01.115315 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-65504b80-e9b1-4d47-aa8f-dcef947934ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0406620-d595-409c-958d-7a486a49577c', 'name': 'tempest-AttachVolumeTestJSON-1079676770-router', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210'}], 'enable_snat': True}, 'gw_port_id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:32Z', 'updated_at': '2021-12-09T21:30:38Z', 'revision_number': 4, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'gw_port': {'id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:0e:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1399, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:33Z', 'updated_at': '2021-12-09T21:30:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '314ffaf2-8bb1-44c3-9e47-3fb70d04ddee', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'floating_ip_address': '172.25.3.170', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'a0406620-d595-409c-958d-7a486a49577c', 'port_id': '042e101d-fba7-4c12-8471-48255f57bee1', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 1425, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'mac_address': 'fa:16:3e:ac:41:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'de68791c-82e4-4147-88d4-7a0ce0f25710', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:30:42Z', 'updated_at': '2021-12-09T21:30:58Z', 'revision_number': 1, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbff506a-7b73-4238-9fda-dd193910d0ce', 'name': '', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'mac_address': 'fa:16:3e:94:28:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:37Z', 'updated_at': '2021-12-09T21:30:42Z', 'revision_number': 5, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'subnets': [{'id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:01.154480 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65504b80-e9b1-4d47-aa8f-dcef947934ee None None] The sync data for ids ['a0406620-d595-409c-958d-7a486a49577c'] in n-d-713301-27 is: [{'id': 'a0406620-d595-409c-958d-7a486a49577c', 'name': 'tempest-AttachVolumeTestJSON-1079676770-router', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210'}], 'enable_snat': True}, 'gw_port_id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:32Z', 'updated_at': '2021-12-09T21:30:38Z', 'revision_number': 4, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'gw_port': {'id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:0e:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1399, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:33Z', 'updated_at': '2021-12-09T21:30:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '314ffaf2-8bb1-44c3-9e47-3fb70d04ddee', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'floating_ip_address': '172.25.3.170', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'a0406620-d595-409c-958d-7a486a49577c', 'port_id': '042e101d-fba7-4c12-8471-48255f57bee1', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 1425, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'mac_address': 'fa:16:3e:ac:41:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'de68791c-82e4-4147-88d4-7a0ce0f25710', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:30:42Z', 'updated_at': '2021-12-09T21:30:58Z', 'revision_number': 1, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbff506a-7b73-4238-9fda-dd193910d0ce', 'name': '', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'mac_address': 'fa:16:3e:94:28:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:37Z', 'updated_at': '2021-12-09T21:30:42Z', 'revision_number': 5, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'subnets': [{'id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:31:01.161464 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec230596-a05e-4562-88dc-7f41d6fba6d5 req-273d6ac2-93a5-4988-92a9-b9e33c86f103 service neutron] 10.222.0.31 "GET /v2.0/networks/935b09ce-7410-4b66-82be-99978deb6717?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2530446 Dec 09 21:31:01.327894 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7f11457-20c5-4d2f-83a1-4bc447eea181 req-4e31834b-8949-4b34-b622-0af231383ad6 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:01.336516 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7f11457-20c5-4d2f-83a1-4bc447eea181 req-4e31834b-8949-4b34-b622-0af231383ad6 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.1330907 Dec 09 21:31:01.368917 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71c95784-1586-4204-9e47-ff8869a7aca0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:01.425776 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7f11457-20c5-4d2f-83a1-4bc447eea181 req-28f95c95-d77c-4671-973f-de6220832850 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0836110 Dec 09 21:31:01.449915 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec230596-a05e-4562-88dc-7f41d6fba6d5 req-64b34aef-fa10-4172-bc98-5c7f747834f6 service neutron] 10.222.0.31 "GET /v2.0/networks/935b09ce-7410-4b66-82be-99978deb6717?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2806041 Dec 09 21:31:01.454524 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71c95784-1586-4204-9e47-ff8869a7aca0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:01.526052 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71c95784-1586-4204-9e47-ff8869a7aca0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:31:01.526541 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5597f66d-5b35-4578-a902-d6f90f3d043a None None] New status for floating IP 314ffaf2-8bb1-44c3-9e47-3fb70d04ddee: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:31:01.529865 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-71c95784-1586-4204-9e47-ff8869a7aca0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:01.547098 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71c95784-1586-4204-9e47-ff8869a7aca0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:31:01.548113 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71c95784-1586-4204-9e47-ff8869a7aca0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:01.548730 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71c95784-1586-4204-9e47-ff8869a7aca0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:01.559590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71c95784-1586-4204-9e47-ff8869a7aca0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Pushing event updated for resources: {'Port': ['ID=723875cb-b8c9-4c0a-9113-ec2e7b4c70e0,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:01.586019 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45158) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:01.594841 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-71c95784-1586-4204-9e47-ff8869a7aca0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 964 time: 0.5752890 Dec 09 21:31:01.635219 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cbf44c07-0ea3-40e9-8a98-480619dbd610 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:01.645354 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cbf44c07-0ea3-40e9-8a98-480619dbd610 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] 10.222.0.13 "GET /v2.0/ports/723875cb-b8c9-4c0a-9113-ec2e7b4c70e0 HTTP/1.1" status: 200 len: 959 time: 0.0557754 Dec 09 21:31:01.645880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45162) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:01.776989 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-dcd8fcce-d085-4065-9b56-8930c4d3872e tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Deleting port 723875cb-b8c9-4c0a-9113-ec2e7b4c70e0 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:31:01.777337 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dcd8fcce-d085-4065-9b56-8930c4d3872e tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:01.860895 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dcd8fcce-d085-4065-9b56-8930c4d3872e tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:01.874405 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-dcd8fcce-d085-4065-9b56-8930c4d3872e tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Calling delete_port for 723875cb-b8c9-4c0a-9113-ec2e7b4c70e0 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:31:01.983006 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dcd8fcce-d085-4065-9b56-8930c4d3872e tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:02.047535 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcd8fcce-d085-4065-9b56-8930c4d3872e tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Pushing event deleted for resources: {'Port': ['ID=723875cb-b8c9-4c0a-9113-ec2e7b4c70e0,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:02.060113 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dcd8fcce-d085-4065-9b56-8930c4d3872e tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:02.064198 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-dcd8fcce-d085-4065-9b56-8930c4d3872e tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] 10.222.0.13 "DELETE /v2.0/ports/723875cb-b8c9-4c0a-9113-ec2e7b4c70e0 HTTP/1.1" status: 204 len: 168 time: 0.4171529 Dec 09 21:31:02.068510 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45168) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:02.087864 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8fda49a-c48e-48ac-8ea9-3cb964642629 req-60140bb1-ac93-4abc-ab77-54bdcccd150a tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:02.089802 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8fda49a-c48e-48ac-8ea9-3cb964642629 req-60140bb1-ac93-4abc-ab77-54bdcccd150a tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.0991921 Dec 09 21:31:02.107935 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-7b0a49f4-5e90-4680-9c61-07ee0e834c4c tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] GET failed (client error): The resource could not be found. Dec 09 21:31:02.110068 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7b0a49f4-5e90-4680-9c61-07ee0e834c4c tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] 10.222.0.13 "GET /v2.0/ports/723875cb-b8c9-4c0a-9113-ec2e7b4c70e0 HTTP/1.1" status: 404 len: 333 time: 0.0404849 Dec 09 21:31:02.120161 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45170) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:02.125737 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a339acb8-4d3a-46a4-a909-59fbb0cb5254 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Request body: {'port': {'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14', 'name': 'tempest-PortsAdminExtendedAttrsIpV6TestJSON-1352553565'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:02.161105 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a339acb8-4d3a-46a4-a909-59fbb0cb5254 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Made reservation on behalf of 340b257a32a54b86b816968ee33f4779 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:31:02.163933 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a339acb8-4d3a-46a4-a909-59fbb0cb5254 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:02.172856 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8fda49a-c48e-48ac-8ea9-3cb964642629 req-c86b43b6-ec6d-4ff9-8467-a71594760185 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0763063 Dec 09 21:31:02.200941 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-a339acb8-4d3a-46a4-a909-59fbb0cb5254 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] device_id is not set on port 1a2f242a-de75-4b24-973f-7cc9b46a1425 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:31:02.373829 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a339acb8-4d3a-46a4-a909-59fbb0cb5254 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:02.413394 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a339acb8-4d3a-46a4-a909-59fbb0cb5254 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:02.459271 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a339acb8-4d3a-46a4-a909-59fbb0cb5254 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:31:02.462154 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-a339acb8-4d3a-46a4-a909-59fbb0cb5254 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:02.468220 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a339acb8-4d3a-46a4-a909-59fbb0cb5254 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:31:02.469177 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a339acb8-4d3a-46a4-a909-59fbb0cb5254 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:02.469810 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a339acb8-4d3a-46a4-a909-59fbb0cb5254 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:02.494610 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a339acb8-4d3a-46a4-a909-59fbb0cb5254 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Pushing event updated for resources: {'Port': ['ID=1a2f242a-de75-4b24-973f-7cc9b46a1425,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:02.518888 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a339acb8-4d3a-46a4-a909-59fbb0cb5254 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 964 time: 0.3974791 Dec 09 21:31:02.521501 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45182) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:02.526846 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Request body: {'port': {'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:02.615090 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:02.631544 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b13160a-6c9d-41ff-8e86-99ead3f1e772 req-614ccd64-cf18-40d2-bb55-06888f98d3c3 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:02.641046 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b13160a-6c9d-41ff-8e86-99ead3f1e772 req-614ccd64-cf18-40d2-bb55-06888f98d3c3 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.0743098 Dec 09 21:31:02.710622 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b13160a-6c9d-41ff-8e86-99ead3f1e772 req-2254f54a-6174-4739-862e-f4f8ff492415 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0700700 Dec 09 21:31:02.833699 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] device_id is not set on port 1a2f242a-de75-4b24-973f-7cc9b46a1425 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:31:02.844934 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:02.853431 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:02.914950 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Pushing event updated for resources: {'Port': ['ID=1a2f242a-de75-4b24-973f-7cc9b46a1425,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:02.935921 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:31:02.936259 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:31:02.937120 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:31:02.940319 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b6fb2ce5-b53b-408b-a9ee-e9610f4731db None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:02.941953 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:31:02.942463 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:31:02.942879 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 2 to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 Dec 09 21:31:02.958575 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:31:02.958951 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:31:02.959246 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:31:02.963925 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:31:02.964249 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:31:02.964634 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 3 to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 Dec 09 21:31:02.977781 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:31:02.978209 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:31:02.978613 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:31:02.983377 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:31:02.983737 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:31:02.984127 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 4 to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 Dec 09 21:31:02.997031 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:31:02.997455 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:31:02.997858 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:31:03.002682 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:31:03.003063 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:31:03.003544 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 5 to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 Dec 09 21:31:03.016159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:31:03.016600 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:31:03.016988 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:31:03.021523 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:31:03.021843 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:31:03.022221 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 6 to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 Dec 09 21:31:03.035934 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:31:03.036282 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:31:03.036618 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:31:03.040891 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:31:03.041402 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:31:03.041786 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 7 to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 Dec 09 21:31:03.053771 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:31:03.054225 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:31:03.054579 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:31:03.058927 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:31:03.059371 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:31:03.060010 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 8 to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 Dec 09 21:31:03.078951 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:31:03.079276 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:31:03.079681 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:31:03.084943 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:31:03.085432 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:31:03.085833 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 9 to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 Dec 09 21:31:03.100247 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:31:03.100594 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:31:03.100947 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:31:03.106355 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:31:03.106693 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:31:03.107299 n-d-713301-27 neutron-server[103437]: INFO neutron.plugins.ml2.plugin [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempt 10 to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 Dec 09 21:31:03.128182 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:31:03.129625 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:31:03.129625 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempting to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:31:03.133291 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:31:03.133604 n-d-713301-27 neutron-server[103437]: ERROR neutron.plugins.ml2.managers [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Failed to bind port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '84b93960-a6df-4fd8-a5cd-b8f037e14fbc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14'}] Dec 09 21:31:03.133967 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:03.210358 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] For port 1a2f242a-de75-4b24-973f-7cc9b46a1425, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:31:03.211594 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attempted to set empty binding levels {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Dec 09 21:31:03.218904 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:03.255995 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] In _notify_port_updated(), no bound segment for port 1a2f242a-de75-4b24-973f-7cc9b46a1425 on network a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 {{(pid=103437) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:31:03.256859 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:03.257473 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:03.261538 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] 10.222.0.13 "PUT /v2.0/ports/1a2f242a-de75-4b24-973f-7cc9b46a1425 HTTP/1.1" status: 200 len: 980 time: 0.7363522 Dec 09 21:31:03.263717 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45198) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:03.293023 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bc11cc4-734f-4c0d-b953-cc812763213f tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Pushing event updated for resources: {'Port': ['ID=1a2f242a-de75-4b24-973f-7cc9b46a1425,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:03.314790 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dff4042-8058-40b8-9f7f-d2b7758d7cf8 req-5bdf0e90-5c29-4d8a-bc7f-e5b885762669 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:03.317362 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9dff4042-8058-40b8-9f7f-d2b7758d7cf8 req-5bdf0e90-5c29-4d8a-bc7f-e5b885762669 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.0602896 Dec 09 21:31:03.352189 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-b3d6b627-5cb0-46ec-a26d-e07c833cbe1b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Deleting port 1a2f242a-de75-4b24-973f-7cc9b46a1425 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:31:03.352535 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b3d6b627-5cb0-46ec-a26d-e07c833cbe1b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:03.368213 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9dff4042-8058-40b8-9f7f-d2b7758d7cf8 req-35379099-70d7-4bd9-9934-ec2c153ad646 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453513 Dec 09 21:31:03.428407 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-b3d6b627-5cb0-46ec-a26d-e07c833cbe1b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] For port 1a2f242a-de75-4b24-973f-7cc9b46a1425, host n-h1-713301-27, got binding levels [] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:31:03.428750 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b3d6b627-5cb0-46ec-a26d-e07c833cbe1b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:03.442707 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-b3d6b627-5cb0-46ec-a26d-e07c833cbe1b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Calling delete_port for 1a2f242a-de75-4b24-973f-7cc9b46a1425 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:31:03.535303 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b3d6b627-5cb0-46ec-a26d-e07c833cbe1b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:03.563488 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3d6b627-5cb0-46ec-a26d-e07c833cbe1b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Pushing event deleted for resources: {'Port': ['ID=1a2f242a-de75-4b24-973f-7cc9b46a1425,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:03.568425 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b3d6b627-5cb0-46ec-a26d-e07c833cbe1b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:03.571793 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b3d6b627-5cb0-46ec-a26d-e07c833cbe1b tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] 10.222.0.13 "DELETE /v2.0/ports/1a2f242a-de75-4b24-973f-7cc9b46a1425 HTTP/1.1" status: 204 len: 168 time: 0.3070784 Dec 09 21:31:03.575534 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45206) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:03.602899 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-c64fe214-af9b-438b-977a-3cfaa83433cb tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] GET failed (client error): The resource could not be found. Dec 09 21:31:03.604386 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c64fe214-af9b-438b-977a-3cfaa83433cb tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829 tempest-PortsAdminExtendedAttrsIpV6TestJSON-37695829-project-admin] 10.222.0.13 "GET /v2.0/ports/1a2f242a-de75-4b24-973f-7cc9b46a1425 HTTP/1.1" status: 404 len: 333 time: 0.0278029 Dec 09 21:31:03.608279 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45210) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:03.684822 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-53d68d3b-127c-4ddc-8cc2-5cfc413229a8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:03.787181 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-53d68d3b-127c-4ddc-8cc2-5cfc413229a8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:03.814355 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-53d68d3b-127c-4ddc-8cc2-5cfc413229a8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:03.830156 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-53d68d3b-127c-4ddc-8cc2-5cfc413229a8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '84b93960-a6df-4fd8-a5cd-b8f037e14fbc') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:03.830455 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-53d68d3b-127c-4ddc-8cc2-5cfc413229a8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '84b93960-a6df-4fd8-a5cd-b8f037e14fbc') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:03.840690 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-53d68d3b-127c-4ddc-8cc2-5cfc413229a8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:03.855036 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-53d68d3b-127c-4ddc-8cc2-5cfc413229a8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:03.861564 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-53d68d3b-127c-4ddc-8cc2-5cfc413229a8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] Releasing vlan 149 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:31:03.863837 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-53d68d3b-127c-4ddc-8cc2-5cfc413229a8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:31:03.868320 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:31:03.898570 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e2194b4-8033-42e5-b31c-4d53c1a90f23 req-8d5468fd-a46c-44f4-9f76-992990343960 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:03.900129 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0e2194b4-8033-42e5-b31c-4d53c1a90f23 req-8d5468fd-a46c-44f4-9f76-992990343960 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.1019299 Dec 09 21:31:03.906945 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99ed5ce9-ff54-44a8-976a-b87b49f10387 req-ed89c503-6f41-4ec6-a5a9-24e7db3bb49e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:03.908420 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99ed5ce9-ff54-44a8-976a-b87b49f10387 req-ed89c503-6f41-4ec6-a5a9-24e7db3bb49e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=29f2c1d9be9348b0888bc61ed37ed957&device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 1098 time: 0.0673292 Dec 09 21:31:03.929844 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-53d68d3b-127c-4ddc-8cc2-5cfc413229a8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:03.948402 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-53d68d3b-127c-4ddc-8cc2-5cfc413229a8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:03.951640 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-53d68d3b-127c-4ddc-8cc2-5cfc413229a8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] 10.222.0.13 "DELETE /v2.0/networks/a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14 HTTP/1.1" status: 204 len: 168 time: 0.3424149 Dec 09 21:31:03.955305 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53d68d3b-127c-4ddc-8cc2-5cfc413229a8 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1996379633-project] Pushing event deleted for resources: {'Network': ['ID=a0ce437f-fddd-4a8d-a341-e4ae3a6b7a14,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:04.010828 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0e2194b4-8033-42e5-b31c-4d53c1a90f23 req-c2c594c7-8770-4068-b4b0-f24d76a19b3c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1014075 Dec 09 21:31:04.044383 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99ed5ce9-ff54-44a8-976a-b87b49f10387 req-4cc454c1-13d7-4b7a-b4f1-0ff1978d8f2a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:04.046137 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99ed5ce9-ff54-44a8-976a-b87b49f10387 req-4cc454c1-13d7-4b7a-b4f1-0ff1978d8f2a service neutron] 10.222.0.31 "GET /v2.0/networks?id=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 HTTP/1.1" status: 200 len: 917 time: 0.1301718 Dec 09 21:31:04.122964 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99ed5ce9-ff54-44a8-976a-b87b49f10387 req-b30c95e6-8f49-4010-bdba-af9cb4405c0d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=778d35d4-c635-4fcb-b344-64cbb94958b9 HTTP/1.1" status: 200 len: 1001 time: 0.0689049 Dec 09 21:31:04.175592 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99ed5ce9-ff54-44a8-976a-b87b49f10387 req-cd05c89a-f8db-4f0b-8590-24e9fad936a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:04.177099 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99ed5ce9-ff54-44a8-976a-b87b49f10387 req-cd05c89a-f8db-4f0b-8590-24e9fad936a2 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ace82e8b-012a-4184-a81e-5303eecf12ff HTTP/1.1" status: 200 len: 855 time: 0.0473673 Dec 09 21:31:04.216491 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45224) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:04.230843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99ed5ce9-ff54-44a8-976a-b87b49f10387 req-b28f8084-b94d-4a36-9d7b-2864f088c3b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:04.232648 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99ed5ce9-ff54-44a8-976a-b87b49f10387 req-b28f8084-b94d-4a36-9d7b-2864f088c3b2 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0483873 Dec 09 21:31:04.331474 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99ed5ce9-ff54-44a8-976a-b87b49f10387 req-afc3293b-c500-4138-b2e1-369b207a0cbc service neutron] 10.222.0.31 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0914466 Dec 09 21:31:04.365303 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-41ec914d-44e4-49a3-b32e-5cc9af71d290 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e186344d2a4f42f0b958721bf4c001e8&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1472604 Dec 09 21:31:04.367644 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45228) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:04.417041 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-957a12dc-e55a-4547-8cc5-1bcab76f4547 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:04.429315 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99ed5ce9-ff54-44a8-976a-b87b49f10387 req-05f6c0f0-d48d-49e3-9963-682aa9065152 service neutron] 10.222.0.31 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0912132 Dec 09 21:31:04.439410 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-957a12dc-e55a-4547-8cc5-1bcab76f4547 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:04.508469 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-957a12dc-e55a-4547-8cc5-1bcab76f4547 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:04.513446 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-957a12dc-e55a-4547-8cc5-1bcab76f4547 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:04.513446 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-957a12dc-e55a-4547-8cc5-1bcab76f4547 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/b6d6d88b-00aa-4801-9d62-f90db5033ed8 HTTP/1.1" status: 204 len: 168 time: 0.1441476 Dec 09 21:31:04.521659 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-957a12dc-e55a-4547-8cc5-1bcab76f4547 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b6d6d88b-00aa-4801-9d62-f90db5033ed8,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:04.527785 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7bb718e-8adb-49e4-a29a-08273cd6c17a req-18f9f606-74e2-4400-9be7-36b0f602fe9b tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:04.529853 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a7bb718e-8adb-49e4-a29a-08273cd6c17a req-18f9f606-74e2-4400-9be7-36b0f602fe9b tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.0663257 Dec 09 21:31:04.589429 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a7bb718e-8adb-49e4-a29a-08273cd6c17a req-6e4a1ded-74e2-4d52-bcc5-85fe8f422911 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508080 Dec 09 21:31:04.821579 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45242) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:04.864108 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5471b36a-64ad-4179-943c-3078dd2ec5c9 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=340b257a32a54b86b816968ee33f4779&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0405097 Dec 09 21:31:04.866435 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45244) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:04.922103 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-814912e9-8787-4665-b488-67b49b2cd393 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:04.946116 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-814912e9-8787-4665-b488-67b49b2cd393 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:04.998773 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-814912e9-8787-4665-b488-67b49b2cd393 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:05.002428 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-814912e9-8787-4665-b488-67b49b2cd393 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:05.006006 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-814912e9-8787-4665-b488-67b49b2cd393 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/391d9d10-56af-44a1-8b72-8235a2062e73 HTTP/1.1" status: 204 len: 168 time: 0.1359453 Dec 09 21:31:05.012233 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-814912e9-8787-4665-b488-67b49b2cd393 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=391d9d10-56af-44a1-8b72-8235a2062e73,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:05.142934 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbce334c-e138-42d5-85c5-68de8eba32df req-5e975c61-b20c-4026-81af-17e11dd18e2c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:05.144492 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dbce334c-e138-42d5-85c5-68de8eba32df req-5e975c61-b20c-4026-81af-17e11dd18e2c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.0508387 Dec 09 21:31:05.197580 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dbce334c-e138-42d5-85c5-68de8eba32df req-fcd78ec9-6884-43b4-9613-67750df9e7b3 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454800 Dec 09 21:31:05.507663 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-79962599-1a4e-42e4-a5ba-0e7475538cf5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:05.713748 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff01a194-c289-459b-948e-a2effe0efd75 req-a207fa6c-3099-475b-b828-52298ba4dcb9 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:05.715407 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ff01a194-c289-459b-948e-a2effe0efd75 req-a207fa6c-3099-475b-b828-52298ba4dcb9 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.0509272 Dec 09 21:31:05.799251 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ff01a194-c289-459b-948e-a2effe0efd75 req-b2a6eb89-0452-4b8b-9381-d7ef169fee19 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0757551 Dec 09 21:31:05.816510 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4c6b6b3-81c7-44cf-b45e-ff71a0275531 req-46950dfa-596c-49e6-a425-3bf824663186 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:05.818090 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4c6b6b3-81c7-44cf-b45e-ff71a0275531 req-46950dfa-596c-49e6-a425-3bf824663186 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 1097 time: 0.0645156 Dec 09 21:31:05.864656 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4c6b6b3-81c7-44cf-b45e-ff71a0275531 req-6db4c016-f50f-4e13-b126-4b7fa36e2ea2 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394170 Dec 09 21:31:06.329533 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aa12a95-205e-42ca-936e-34134419b686 req-020339f4-4c53-4b15-8dfe-02d51f88a9a9 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:06.331071 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0aa12a95-205e-42ca-936e-34134419b686 req-020339f4-4c53-4b15-8dfe-02d51f88a9a9 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.0548151 Dec 09 21:31:06.341299 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45298) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:06.386930 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0aa12a95-205e-42ca-936e-34134419b686 req-aac8e997-a39d-4a98-a57a-6f651c056197 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493693 Dec 09 21:31:06.447253 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-94a3022c-8334-40ca-b18d-a17cf90b6c57 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminNegativeIpV6Test-860446493', 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:06.469304 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-94a3022c-8334-40ca-b18d-a17cf90b6c57 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Made reservation on behalf of b86f789161e74a28b6b8c4e6c2175879 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:31:06.471712 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94a3022c-8334-40ca-b18d-a17cf90b6c57 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:06.480381 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94a3022c-8334-40ca-b18d-a17cf90b6c57 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:06.557663 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94a3022c-8334-40ca-b18d-a17cf90b6c57 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:06.562891 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94a3022c-8334-40ca-b18d-a17cf90b6c57 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:06.567728 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-94a3022c-8334-40ca-b18d-a17cf90b6c57 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] device_id is not set on port b80a9c92-cbfa-4b0e-93c2-ffb51d9b19fe yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:31:06.571324 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:06.630129 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94a3022c-8334-40ca-b18d-a17cf90b6c57 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6fd10080-b6f8-4c21-988e-4a19f781829f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:06.710365 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-94a3022c-8334-40ca-b18d-a17cf90b6c57 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Allocated IP 172.25.3.77 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/b80a9c92-cbfa-4b0e-93c2-ffb51d9b19fe) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:31:06.879125 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94a3022c-8334-40ca-b18d-a17cf90b6c57 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:06.975912 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94a3022c-8334-40ca-b18d-a17cf90b6c57 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:07.033959 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-42415902-ba8d-4c49-8a99-39a788b47353 req-f6fea4fb-9c52-4215-b963-ea45b7e86445 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:31:07.035885 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42415902-ba8d-4c49-8a99-39a788b47353 req-f6fea4fb-9c52-4215-b963-ea45b7e86445 service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0098512 Dec 09 21:31:07.050294 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94a3022c-8334-40ca-b18d-a17cf90b6c57 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:31:07.054009 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edb6843a-4d31-40a5-b9e0-681c6db72203 req-8aaaabdf-2dd2-486b-bede-eac61006df7c tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:07.056293 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-94a3022c-8334-40ca-b18d-a17cf90b6c57 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:07.061768 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94a3022c-8334-40ca-b18d-a17cf90b6c57 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:31:07.069918 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-edb6843a-4d31-40a5-b9e0-681c6db72203 req-8aaaabdf-2dd2-486b-bede-eac61006df7c tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.1266158 Dec 09 21:31:07.104350 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-94a3022c-8334-40ca-b18d-a17cf90b6c57 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:07.105098 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94a3022c-8334-40ca-b18d-a17cf90b6c57 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:07.108653 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94a3022c-8334-40ca-b18d-a17cf90b6c57 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Pushing event updated for resources: {'Port': ['ID=b80a9c92-cbfa-4b0e-93c2-ffb51d9b19fe,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:07.127595 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-94a3022c-8334-40ca-b18d-a17cf90b6c57 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1035 time: 0.7844937 Dec 09 21:31:07.129631 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-edb6843a-4d31-40a5-b9e0-681c6db72203 req-d4521dc6-a2ea-472e-a9be-ea404df5f032 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0584948 Dec 09 21:31:07.130129 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45330) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:07.135621 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-5ccadad6-ba51-4939-a13e-c9d1b3e50ed2 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.77'}]}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:07.192857 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ccadad6-ba51-4939-a13e-c9d1b3e50ed2 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:07.194258 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ccadad6-ba51-4939-a13e-c9d1b3e50ed2 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:07.273532 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ccadad6-ba51-4939-a13e-c9d1b3e50ed2 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:07.473704 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ccadad6-ba51-4939-a13e-c9d1b3e50ed2 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:07.508150 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4db4d6d0-ca9f-4497-a058-b5a08ee370fd req-d55d247e-66cd-4390-884c-c4a3b5ca10b1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:07.509656 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4db4d6d0-ca9f-4497-a058-b5a08ee370fd req-d55d247e-66cd-4390-884c-c4a3b5ca10b1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 946 time: 0.1872630 Dec 09 21:31:07.599898 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e8a50be7-e8eb-4a2a-8117-49c82b2c9bec req-c4fda0ad-2354-40bd-97d3-87dfc5c4ad06 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1177647 Dec 09 21:31:07.601215 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4db4d6d0-ca9f-4497-a058-b5a08ee370fd req-d2649967-9b86-4ce3-86f6-0084bd6de70d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0840580 Dec 09 21:31:07.620550 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-e8a50be7-e8eb-4a2a-8117-49c82b2c9bec req-ef54e8b2-3071-4b61-ae90-63407114552e service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:31:07.635285 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e8a50be7-e8eb-4a2a-8117-49c82b2c9bec req-ef54e8b2-3071-4b61-ae90-63407114552e service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0159140 Dec 09 21:31:07.928834 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:08.103791 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ccadad6-ba51-4939-a13e-c9d1b3e50ed2 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:08.126211 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ccadad6-ba51-4939-a13e-c9d1b3e50ed2 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:08.299544 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-293a82ea-3b2f-455c-b11a-219fb354c004 req-66c62ea2-7377-48c6-8e17-55b85db565ae tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:08.303932 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-293a82ea-3b2f-455c-b11a-219fb354c004 req-66c62ea2-7377-48c6-8e17-55b85db565ae tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.0863292 Dec 09 21:31:08.316819 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 778d35d4-c635-4fcb-b344-64cbb94958b9 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:31:08.345848 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ccadad6-ba51-4939-a13e-c9d1b3e50ed2 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:08.411842 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:08.436777 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '753dc06f-e08a-4cab-82a9-7e1089901f9b', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '778d35d4-c635-4fcb-b344-64cbb94958b9'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:31:08.438534 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-293a82ea-3b2f-455c-b11a-219fb354c004 req-55d00989-d354-4204-8670-2751245bb8e4 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1315837 Dec 09 21:31:08.439016 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-17168bc0-6855-4700-a33f-a154d34ef889" -d '{"events": [{"server_uuid": "753dc06f-e08a-4cab-82a9-7e1089901f9b", "name": "network-vif-unplugged", "status": "completed", "tag": "778d35d4-c635-4fcb-b344-64cbb94958b9"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:31:08.453289 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 778d35d4-c635-4fcb-b344-64cbb94958b9, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=778d35d4-c635-4fcb-b344-64cbb94958b9,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:31:08.458739 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:08.502000 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Thu, 09 Dec 2021 21:31:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-418b472b-d7c1-4085-a74a-2684a76c5260 x-openstack-request-id: req-418b472b-d7c1-4085-a74a-2684a76c5260 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:31:08.502379 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "753dc06f-e08a-4cab-82a9-7e1089901f9b", "name": "network-vif-unplugged", "status": "failed", "tag": "778d35d4-c635-4fcb-b344-64cbb94958b9", "code": 422}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:31:08.502699 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-418b472b-d7c1-4085-a74a-2684a76c5260 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:31:08.503488 n-d-713301-27 neutron-server[103439]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '753dc06f-e08a-4cab-82a9-7e1089901f9b', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '778d35d4-c635-4fcb-b344-64cbb94958b9', 'code': 422} returned with failed status Dec 09 21:31:08.509924 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-c393cd1b-0107-48db-adb5-ccee2da4357f req-3d0d41a8-825b-4e7a-888b-d85f6124c479 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Request body: {'security_group': {'name': 'tempest-ServerRescueTestJSONUnderV235-securitygroup-865459036', 'description': 'tempest-description-1139779552'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:08.532964 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=778d35d4-c635-4fcb-b344-64cbb94958b9,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:08.552516 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ccadad6-ba51-4939-a13e-c9d1b3e50ed2 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:08.555691 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ccadad6-ba51-4939-a13e-c9d1b3e50ed2 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:08.599756 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c393cd1b-0107-48db-adb5-ccee2da4357f req-3d0d41a8-825b-4e7a-888b-d85f6124c479 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:08.617564 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ccadad6-ba51-4939-a13e-c9d1b3e50ed2 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:08.618063 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5ccadad6-ba51-4939-a13e-c9d1b3e50ed2 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Fanout notify agent at l3_agent the message router_deleted on router dea30f93-1101-4639-9308-9d4157d57624 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:31:08.645751 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-5ccadad6-ba51-4939-a13e-c9d1b3e50ed2 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] create failed (client error): There was a conflict when trying to complete your request. Dec 09 21:31:08.646803 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5ccadad6-ba51-4939-a13e-c9d1b3e50ed2 tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 409 len: 371 time: 1.5153866 Dec 09 21:31:08.650203 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45372) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:08.734357 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c393cd1b-0107-48db-adb5-ccee2da4357f req-3d0d41a8-825b-4e7a-888b-d85f6124c479 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:08.754044 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c393cd1b-0107-48db-adb5-ccee2da4357f req-3d0d41a8-825b-4e7a-888b-d85f6124c479 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:08.800816 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d0d41a8-825b-4e7a-888b-d85f6124c479 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6d0b589a-fba4-450d-b727-ca2a914231de,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:08.807258 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c393cd1b-0107-48db-adb5-ccee2da4357f req-3d0d41a8-825b-4e7a-888b-d85f6124c479 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:08.808493 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c393cd1b-0107-48db-adb5-ccee2da4357f req-3d0d41a8-825b-4e7a-888b-d85f6124c479 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1831 time: 0.3044608 Dec 09 21:31:08.823491 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9bfd6c3-976a-4c1a-9b0a-4498dea35488 req-debba736-9257-43b3-a5c8-6348388af50a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:08.823491 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9bfd6c3-976a-4c1a-9b0a-4498dea35488 req-debba736-9257-43b3-a5c8-6348388af50a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 944 time: 0.1196613 Dec 09 21:31:08.835579 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-bf42a93f-1b7b-4c00-a6fd-6674a7cfb3ae tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Deleting port b80a9c92-cbfa-4b0e-93c2-ffb51d9b19fe {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:31:08.836104 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf42a93f-1b7b-4c00-a6fd-6674a7cfb3ae tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:08.929988 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9bfd6c3-976a-4c1a-9b0a-4498dea35488 req-5647c078-860a-4428-a922-d8fca397fb45 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0917051 Dec 09 21:31:08.960628 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf42a93f-1b7b-4c00-a6fd-6674a7cfb3ae tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:08.979480 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-bf42a93f-1b7b-4c00-a6fd-6674a7cfb3ae tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Calling delete_port for b80a9c92-cbfa-4b0e-93c2-ffb51d9b19fe owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:31:09.011384 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aebe8969-dd98-4a61-9932-88a683b36e1b req-ecbde822-9c97-413c-b4f1-6384b667cc4c tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-ServerRescueTestJSONUnderV235-securitygroup-865459036&fields=id&tenant_id=0f8295f4c3534e24a63938170ba2425e HTTP/1.1" status: 200 len: 267 time: 0.0789993 Dec 09 21:31:09.114500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aebe8969-dd98-4a61-9932-88a683b36e1b req-810862bb-7598-4640-b5fa-a1ad500b3434 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:09.115891 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aebe8969-dd98-4a61-9932-88a683b36e1b req-810862bb-7598-4640-b5fa-a1ad500b3434 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.0723202 Dec 09 21:31:09.150855 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-aebe8969-dd98-4a61-9932-88a683b36e1b req-2f1cab0e-6f12-4fdb-bdb3-2f6d969db261 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Request body: {'port': {'security_groups': ['25073bae-9c1b-4f21-941c-9dcae7db554c', '6d0b589a-fba4-450d-b727-ca2a914231de']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:09.206938 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf42a93f-1b7b-4c00-a6fd-6674a7cfb3ae tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:09.260779 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf42a93f-1b7b-4c00-a6fd-6674a7cfb3ae tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Pushing event deleted for resources: {'Port': ['ID=b80a9c92-cbfa-4b0e-93c2-ffb51d9b19fe,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:09.264724 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-aebe8969-dd98-4a61-9932-88a683b36e1b req-2f1cab0e-6f12-4fdb-bdb3-2f6d969db261 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:09.361376 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf42a93f-1b7b-4c00-a6fd-6674a7cfb3ae tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:09.364642 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bf42a93f-1b7b-4c00-a6fd-6674a7cfb3ae tempest-RoutersAdminNegativeIpV6Test-1379998439 tempest-RoutersAdminNegativeIpV6Test-1379998439-project-admin] 10.222.0.13 "DELETE /v2.0/ports/b80a9c92-cbfa-4b0e-93c2-ffb51d9b19fe HTTP/1.1" status: 204 len: 168 time: 0.7132258 Dec 09 21:31:09.542681 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-aebe8969-dd98-4a61-9932-88a683b36e1b req-2f1cab0e-6f12-4fdb-bdb3-2f6d969db261 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] For port 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3d9c176b-4d74-466f-b7bd-8d44eae4a3f2,segment=NetworkSegment(758500a8-fda8-49cf-a84c-a7e78098b9e8),segment_id=758500a8-fda8-49cf-a84c-a7e78098b9e8)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:31:09.576646 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-aebe8969-dd98-4a61-9932-88a683b36e1b req-2f1cab0e-6f12-4fdb-bdb3-2f6d969db261 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:09.582962 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-aebe8969-dd98-4a61-9932-88a683b36e1b req-2f1cab0e-6f12-4fdb-bdb3-2f6d969db261 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:09.589842 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:09.609783 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['3d9c176b-4d74-466f-b7bd-8d44eae4a3f2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:31:09.630915 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aebe8969-dd98-4a61-9932-88a683b36e1b req-2f1cab0e-6f12-4fdb-bdb3-2f6d969db261 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:09.631601 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-aebe8969-dd98-4a61-9932-88a683b36e1b req-2f1cab0e-6f12-4fdb-bdb3-2f6d969db261 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:09.633026 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aebe8969-dd98-4a61-9932-88a683b36e1b req-2f1cab0e-6f12-4fdb-bdb3-2f6d969db261 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "PUT /v2.0/ports/3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 HTTP/1.1" status: 200 len: 981 time: 0.4889383 Dec 09 21:31:09.633585 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '16ff2943-c2d6-4af7-9bbd-52443fde3d6e', 'tag': '3d9c176b-4d74-466f-b7bd-8d44eae4a3f2'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:31:09.639229 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8496807d-18a8-4578-8cbb-4f00941abfeb" -d '{"events": [{"name": "network-changed", "server_uuid": "16ff2943-c2d6-4af7-9bbd-52443fde3d6e", "tag": "3d9c176b-4d74-466f-b7bd-8d44eae4a3f2"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:31:09.668305 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f1cab0e-6f12-4fdb-bdb3-2f6d969db261 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Pushing event updated for resources: {'Port': ['ID=3d9c176b-4d74-466f-b7bd-8d44eae4a3f2,revision_number=6']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:09.706733 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45394) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:09.754957 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:31:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f20ddeaf-994f-4fdc-bc0f-e5d2b4879041 x-openstack-request-id: req-f20ddeaf-994f-4fdc-bc0f-e5d2b4879041 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:31:09.755228 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "16ff2943-c2d6-4af7-9bbd-52443fde3d6e", "tag": "3d9c176b-4d74-466f-b7bd-8d44eae4a3f2", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:31:09.755521 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f20ddeaf-994f-4fdc-bc0f-e5d2b4879041 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:31:09.755943 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '16ff2943-c2d6-4af7-9bbd-52443fde3d6e', 'tag': '3d9c176b-4d74-466f-b7bd-8d44eae4a3f2', 'status': 'completed', 'code': 200} Dec 09 21:31:09.791761 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['3d9c176b-4d74-466f-b7bd-8d44eae4a3f2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:31:09.808287 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fa7a4a21-1b15-44ec-862c-be833b52e0ab req-b0bb131f-9a94-40a4-83c2-acacd776434a tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-ServerRescueTestJSONUnderV235-securitygroup-865459036&fields=id&tenant_id=0f8295f4c3534e24a63938170ba2425e HTTP/1.1" status: 200 len: 267 time: 0.0791967 Dec 09 21:31:09.899036 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8496807d-18a8-4578-8cbb-4f00941abfeb req-1f9ccc7e-eeab-4e76-93fd-9fd1097fb88a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:09.901843 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8496807d-18a8-4578-8cbb-4f00941abfeb req-1f9ccc7e-eeab-4e76-93fd-9fd1097fb88a service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0f8295f4c3534e24a63938170ba2425e&device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 1136 time: 0.0829630 Dec 09 21:31:09.903015 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bf3a8975-478a-4139-987f-0d7293efc38b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:09.930028 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa7a4a21-1b15-44ec-862c-be833b52e0ab req-8c1834e8-cb53-44e0-85ff-a840c462306c tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:09.932145 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fa7a4a21-1b15-44ec-862c-be833b52e0ab req-8c1834e8-cb53-44e0-85ff-a840c462306c tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 984 time: 0.1230350 Dec 09 21:31:09.954046 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-fa7a4a21-1b15-44ec-862c-be833b52e0ab req-f7346a63-281a-410e-af4b-2339dd1f2440 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Request body: {'port': {'security_groups': ['25073bae-9c1b-4f21-941c-9dcae7db554c']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:09.994972 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bf3a8975-478a-4139-987f-0d7293efc38b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:10.001025 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bf3a8975-478a-4139-987f-0d7293efc38b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:10.052116 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bf3a8975-478a-4139-987f-0d7293efc38b admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=fc2421a53b944f03964f19c15ca7a27f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3433723 Dec 09 21:31:10.053396 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf3a8975-478a-4139-987f-0d7293efc38b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=567b9ca7-266a-48d9-a516-08eca57942ee,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:10.056325 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45402) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:10.072508 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fa7a4a21-1b15-44ec-862c-be833b52e0ab req-f7346a63-281a-410e-af4b-2339dd1f2440 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:10.136593 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a7d10098-2680-49bb-a980-7bc00cb84222 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:10.160719 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a7d10098-2680-49bb-a980-7bc00cb84222 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:10.217876 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a7d10098-2680-49bb-a980-7bc00cb84222 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:10.220671 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a7d10098-2680-49bb-a980-7bc00cb84222 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:10.224255 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a7d10098-2680-49bb-a980-7bc00cb84222 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/567b9ca7-266a-48d9-a516-08eca57942ee HTTP/1.1" status: 204 len: 168 time: 0.1643641 Dec 09 21:31:10.231834 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7d10098-2680-49bb-a980-7bc00cb84222 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=567b9ca7-266a-48d9-a516-08eca57942ee,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:10.246035 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ed9cfa8-a28b-4a41-ab5b-7f6ea8694a1e req-152bf51a-4437-4c0d-90a2-15bc1659ab8c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:10.249602 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ed9cfa8-a28b-4a41-ab5b-7f6ea8694a1e req-152bf51a-4437-4c0d-90a2-15bc1659ab8c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 944 time: 0.1295602 Dec 09 21:31:10.253787 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8496807d-18a8-4578-8cbb-4f00941abfeb req-6427ddaa-e0c8-4b9a-a0e3-f62151b22b19 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:10.255940 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8496807d-18a8-4578-8cbb-4f00941abfeb req-6427ddaa-e0c8-4b9a-a0e3-f62151b22b19 service neutron] 10.222.0.10 "GET /v2.0/networks?id=deef6d86-d3bd-4711-b0fe-ebca0c9737aa HTTP/1.1" status: 200 len: 921 time: 0.3463900 Dec 09 21:31:10.329362 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8496807d-18a8-4578-8cbb-4f00941abfeb req-24b90618-cd37-46ab-930c-84eaa4ba7f33 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 HTTP/1.1" status: 200 len: 217 time: 0.0598950 Dec 09 21:31:10.456106 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8496807d-18a8-4578-8cbb-4f00941abfeb req-5b1e569c-3612-4dda-9d0a-0d25407dbc06 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:10.457698 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8496807d-18a8-4578-8cbb-4f00941abfeb req-5b1e569c-3612-4dda-9d0a-0d25407dbc06 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=86b80e39-7de5-4454-807b-0a1be07d2de3 HTTP/1.1" status: 200 len: 860 time: 0.1195109 Dec 09 21:31:10.461127 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ed9cfa8-a28b-4a41-ab5b-7f6ea8694a1e req-c828c200-ea60-425b-b58e-eb5e4bad578c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1930211 Dec 09 21:31:10.499789 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8496807d-18a8-4578-8cbb-4f00941abfeb req-a62f7ec1-a202-494f-ad1e-746854979777 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=deef6d86-d3bd-4711-b0fe-ebca0c9737aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0303390 Dec 09 21:31:10.543951 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-fa7a4a21-1b15-44ec-862c-be833b52e0ab req-f7346a63-281a-410e-af4b-2339dd1f2440 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] For port 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3d9c176b-4d74-466f-b7bd-8d44eae4a3f2,segment=NetworkSegment(758500a8-fda8-49cf-a84c-a7e78098b9e8),segment_id=758500a8-fda8-49cf-a84c-a7e78098b9e8)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:31:10.594870 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45414) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:10.620960 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fa7a4a21-1b15-44ec-862c-be833b52e0ab req-f7346a63-281a-410e-af4b-2339dd1f2440 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:10.635648 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fa7a4a21-1b15-44ec-862c-be833b52e0ab req-f7346a63-281a-410e-af4b-2339dd1f2440 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:10.649563 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['3d9c176b-4d74-466f-b7bd-8d44eae4a3f2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:31:10.651598 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-65c3778a-687d-4179-9bc2-5edec7e2f5d2 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=b86f789161e74a28b6b8c4e6c2175879&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0554569 Dec 09 21:31:10.653995 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45416) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:10.671125 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8496807d-18a8-4578-8cbb-4f00941abfeb req-9ea85327-cb1a-4b86-80c5-4e3ec8d1c6e1 service neutron] 10.222.0.10 "GET /v2.0/networks/deef6d86-d3bd-4711-b0fe-ebca0c9737aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1633437 Dec 09 21:31:10.687809 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa7a4a21-1b15-44ec-862c-be833b52e0ab req-f7346a63-281a-410e-af4b-2339dd1f2440 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:10.688915 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fa7a4a21-1b15-44ec-862c-be833b52e0ab req-f7346a63-281a-410e-af4b-2339dd1f2440 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:10.701826 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fa7a4a21-1b15-44ec-862c-be833b52e0ab req-f7346a63-281a-410e-af4b-2339dd1f2440 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "PUT /v2.0/ports/3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 HTTP/1.1" status: 200 len: 942 time: 0.7567353 Dec 09 21:31:10.742889 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-339acf2f-9e4f-4811-a7b7-6f8fc5dffac7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:10.770984 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-339acf2f-9e4f-4811-a7b7-6f8fc5dffac7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:10.844258 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-339acf2f-9e4f-4811-a7b7-6f8fc5dffac7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:10.848523 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-339acf2f-9e4f-4811-a7b7-6f8fc5dffac7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:10.850235 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-339acf2f-9e4f-4811-a7b7-6f8fc5dffac7 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/6fd10080-b6f8-4c21-988e-4a19f781829f HTTP/1.1" status: 204 len: 168 time: 0.1948402 Dec 09 21:31:10.863922 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-339acf2f-9e4f-4811-a7b7-6f8fc5dffac7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6fd10080-b6f8-4c21-988e-4a19f781829f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:10.880097 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7346a63-281a-410e-af4b-2339dd1f2440 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Pushing event updated for resources: {'Port': ['ID=3d9c176b-4d74-466f-b7bd-8d44eae4a3f2,revision_number=7']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:10.881898 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['3d9c176b-4d74-466f-b7bd-8d44eae4a3f2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:31:11.046840 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c318bf65-746a-4bf7-a499-68e684596b55 req-f0c578e0-be23-427a-afd7-389b19ac52ed service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1115375 Dec 09 21:31:11.064084 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-30790bd2-ba86-4189-af60-4c043a0ee2a8 req-67f4bdfa-5ef2-4423-90ec-36f96a9eedb9 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True&fields=id&name=public HTTP/1.1" status: 200 len: 258 time: 0.3138337 Dec 09 21:31:11.078992 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-30790bd2-ba86-4189-af60-4c043a0ee2a8 req-ce9398c0-19fe-4c3e-b53b-b6093e74f6b8 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:11.089466 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8496807d-18a8-4578-8cbb-4f00941abfeb req-221382e1-f091-4ecd-bb46-b8ea252a7468 service neutron] 10.222.0.10 "GET /v2.0/networks/deef6d86-d3bd-4711-b0fe-ebca0c9737aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4104712 Dec 09 21:31:11.127963 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c318bf65-746a-4bf7-a499-68e684596b55 req-71693111-1346-44cb-81dd-434d22127d4d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:11.130187 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c318bf65-746a-4bf7-a499-68e684596b55 req-71693111-1346-44cb-81dd-434d22127d4d service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=77fc0831d6584a36b61a4823157f9c1d&device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 1097 time: 0.0532382 Dec 09 21:31:11.135695 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-30790bd2-ba86-4189-af60-4c043a0ee2a8 req-ce9398c0-19fe-4c3e-b53b-b6093e74f6b8 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:11.263246 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c318bf65-746a-4bf7-a499-68e684596b55 req-77cd41c8-4e25-45c5-afde-686f72b80370 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:11.265975 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c318bf65-746a-4bf7-a499-68e684596b55 req-77cd41c8-4e25-45c5-afde-686f72b80370 service neutron] 10.222.0.10 "GET /v2.0/networks?id=b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6 HTTP/1.1" status: 200 len: 917 time: 0.1126020 Dec 09 21:31:11.282397 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-30790bd2-ba86-4189-af60-4c043a0ee2a8 req-ce9398c0-19fe-4c3e-b53b-b6093e74f6b8 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:11.357264 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c318bf65-746a-4bf7-a499-68e684596b55 req-6ca5efa5-609f-4e46-bc4c-8859794f90e5 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc HTTP/1.1" status: 200 len: 1000 time: 0.0815682 Dec 09 21:31:11.399592 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-30790bd2-ba86-4189-af60-4c043a0ee2a8 req-ce9398c0-19fe-4c3e-b53b-b6093e74f6b8 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Allocated IP 172.25.3.5 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/c39b988b-8f95-422f-a595-579cf20a34ac) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:31:11.425788 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c318bf65-746a-4bf7-a499-68e684596b55 req-38e7dd90-747e-4c36-9ace-b968bccc9157 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:11.427586 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c318bf65-746a-4bf7-a499-68e684596b55 req-38e7dd90-747e-4c36-9ace-b968bccc9157 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=93335bf9-6f1e-4484-ae25-dca4b03b29b4 HTTP/1.1" status: 200 len: 855 time: 0.0632486 Dec 09 21:31:11.478077 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c318bf65-746a-4bf7-a499-68e684596b55 req-e6ca3464-8830-46ae-b0e5-05c5e6113375 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:11.480171 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c318bf65-746a-4bf7-a499-68e684596b55 req-e6ca3464-8830-46ae-b0e5-05c5e6113375 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0453148 Dec 09 21:31:11.533605 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-30790bd2-ba86-4189-af60-4c043a0ee2a8 req-ce9398c0-19fe-4c3e-b53b-b6093e74f6b8 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:11.571892 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-30790bd2-ba86-4189-af60-4c043a0ee2a8 req-ce9398c0-19fe-4c3e-b53b-b6093e74f6b8 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:11.597091 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c318bf65-746a-4bf7-a499-68e684596b55 req-11671305-602a-4eff-a062-414abd787120 service neutron] 10.222.0.10 "GET /v2.0/networks/b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1095295 Dec 09 21:31:11.646927 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-30790bd2-ba86-4189-af60-4c043a0ee2a8 req-ce9398c0-19fe-4c3e-b53b-b6093e74f6b8 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:31:11.660844 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-30790bd2-ba86-4189-af60-4c043a0ee2a8 req-ce9398c0-19fe-4c3e-b53b-b6093e74f6b8 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:11.663555 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-30790bd2-ba86-4189-af60-4c043a0ee2a8 req-ce9398c0-19fe-4c3e-b53b-b6093e74f6b8 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:31:11.687458 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce9398c0-19fe-4c3e-b53b-b6093e74f6b8 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Pushing event updated for resources: {'Port': ['ID=c39b988b-8f95-422f-a595-579cf20a34ac,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:11.704080 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c318bf65-746a-4bf7-a499-68e684596b55 req-dbd0ef93-75be-46fe-b57e-0d9ca07477ab service neutron] 10.222.0.10 "GET /v2.0/networks/b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0988958 Dec 09 21:31:11.737295 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5d0411f-8e3c-4ab0-9202-73ea84211f10 req-325ff122-498a-4723-b41b-763d95e8a45b tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:11.738868 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5d0411f-8e3c-4ab0-9202-73ea84211f10 req-325ff122-498a-4723-b41b-763d95e8a45b tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 944 time: 0.1342580 Dec 09 21:31:11.778007 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '16ff2943-c2d6-4af7-9bbd-52443fde3d6e', 'tag': '3d9c176b-4d74-466f-b7bd-8d44eae4a3f2'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:31:11.780347 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f177f394-64eb-4a8d-94c4-fae78e26258e" -d '{"events": [{"name": "network-changed", "server_uuid": "16ff2943-c2d6-4af7-9bbd-52443fde3d6e", "tag": "3d9c176b-4d74-466f-b7bd-8d44eae4a3f2"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:31:11.830946 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-30790bd2-ba86-4189-af60-4c043a0ee2a8 req-ce9398c0-19fe-4c3e-b53b-b6093e74f6b8 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:11.854523 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5d0411f-8e3c-4ab0-9202-73ea84211f10 req-7e604507-41b1-4f46-abab-482418cce679 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1047530 Dec 09 21:31:11.883336 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-30790bd2-ba86-4189-af60-4c043a0ee2a8 req-ce9398c0-19fe-4c3e-b53b-b6093e74f6b8 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:11.965678 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45454) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:12.078317 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-30790bd2-ba86-4189-af60-4c043a0ee2a8 req-ce9398c0-19fe-4c3e-b53b-b6093e74f6b8 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:12.081728 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:31:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-65bac273-a278-4e26-a4db-906ad2e75127 x-openstack-request-id: req-65bac273-a278-4e26-a4db-906ad2e75127 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:31:12.082994 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "16ff2943-c2d6-4af7-9bbd-52443fde3d6e", "tag": "3d9c176b-4d74-466f-b7bd-8d44eae4a3f2", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:31:12.083253 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-65bac273-a278-4e26-a4db-906ad2e75127 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:31:12.083679 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '16ff2943-c2d6-4af7-9bbd-52443fde3d6e', 'tag': '3d9c176b-4d74-466f-b7bd-8d44eae4a3f2', 'status': 'completed', 'code': 200} Dec 09 21:31:12.086879 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-30790bd2-ba86-4189-af60-4c043a0ee2a8 req-ce9398c0-19fe-4c3e-b53b-b6093e74f6b8 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:12.106145 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-eeb4fe36-f2a4-4c6b-90dc-d5ffc8620793 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Request body: {'network': {'name': 'tempest-AllowedAddressPairTestJSON-test-network-609083399'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:12.170257 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f177f394-64eb-4a8d-94c4-fae78e26258e req-032427c0-81e7-4005-bdd1-dc7b18effbca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:12.172511 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f177f394-64eb-4a8d-94c4-fae78e26258e req-032427c0-81e7-4005-bdd1-dc7b18effbca service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0f8295f4c3534e24a63938170ba2425e&device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 1097 time: 0.0626237 Dec 09 21:31:12.173784 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eeb4fe36-f2a4-4c6b-90dc-d5ffc8620793 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Made reservation on behalf of bfcae90dbc4d484b92d6477166297d8c for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:31:12.177670 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eeb4fe36-f2a4-4c6b-90dc-d5ffc8620793 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:12.184652 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce9398c0-19fe-4c3e-b53b-b6093e74f6b8 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Pushing event updated for resources: {'Port': ['ID=c39b988b-8f95-422f-a595-579cf20a34ac,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:12.194162 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-30790bd2-ba86-4189-af60-4c043a0ee2a8 req-ce9398c0-19fe-4c3e-b53b-b6093e74f6b8 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:12.205818 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eeb4fe36-f2a4-4c6b-90dc-d5ffc8620793 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:12.215156 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-30790bd2-ba86-4189-af60-4c043a0ee2a8 req-ce9398c0-19fe-4c3e-b53b-b6093e74f6b8 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:12.217702 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-30790bd2-ba86-4189-af60-4c043a0ee2a8 req-ce9398c0-19fe-4c3e-b53b-b6093e74f6b8 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 696 time: 1.1512165 Dec 09 21:31:12.282082 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-30790bd2-ba86-4189-af60-4c043a0ee2a8 req-45c11c79-384f-4aef-b6b8-c048524e789e tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.5 HTTP/1.1" status: 200 len: 694 time: 0.0584435 Dec 09 21:31:12.335263 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f177f394-64eb-4a8d-94c4-fae78e26258e req-1f059355-d1e0-449c-abc4-860f5cc528c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:12.336927 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f177f394-64eb-4a8d-94c4-fae78e26258e req-1f059355-d1e0-449c-abc4-860f5cc528c0 service neutron] 10.222.0.10 "GET /v2.0/networks?id=deef6d86-d3bd-4711-b0fe-ebca0c9737aa HTTP/1.1" status: 200 len: 921 time: 0.1564684 Dec 09 21:31:12.384112 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f177f394-64eb-4a8d-94c4-fae78e26258e req-6407d48e-374b-4bb0-a689-fe69f5b550f6 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 HTTP/1.1" status: 200 len: 217 time: 0.0400057 Dec 09 21:31:12.403227 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30790bd2-ba86-4189-af60-4c043a0ee2a8 req-927ce6bb-b641-4de3-ac41-16b3becf6a9e tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:12.404832 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-30790bd2-ba86-4189-af60-4c043a0ee2a8 req-927ce6bb-b641-4de3-ac41-16b3becf6a9e tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.1170917 Dec 09 21:31:12.432255 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eeb4fe36-f2a4-4c6b-90dc-d5ffc8620793 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:12.440829 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eeb4fe36-f2a4-4c6b-90dc-d5ffc8620793 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:12.467500 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f177f394-64eb-4a8d-94c4-fae78e26258e req-1a557f60-a50e-4e7a-a184-857905ac4031 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:12.469512 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f177f394-64eb-4a8d-94c4-fae78e26258e req-1a557f60-a50e-4e7a-a184-857905ac4031 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=86b80e39-7de5-4454-807b-0a1be07d2de3 HTTP/1.1" status: 200 len: 860 time: 0.0756953 Dec 09 21:31:12.480089 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-eeb4fe36-f2a4-4c6b-90dc-d5ffc8620793 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] vlan segment allocate from pool success with {'vlan_id': 103, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:31:12.505986 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eeb4fe36-f2a4-4c6b-90dc-d5ffc8620793 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7e9378de-a2af-419e-a6af-ab42443685a3,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:12.524818 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f177f394-64eb-4a8d-94c4-fae78e26258e req-0a566064-6332-4309-a00d-add8aa8e4b76 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=deef6d86-d3bd-4711-b0fe-ebca0c9737aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0458901 Dec 09 21:31:12.528200 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eeb4fe36-f2a4-4c6b-90dc-d5ffc8620793 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:12.528566 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-eeb4fe36-f2a4-4c6b-90dc-d5ffc8620793 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Added segment 90681332-ace8-4a6b-9cd9-05d95713261a of type vlan for network 138bbad6-c535-44aa-9e30-5f63cf09578a Dec 09 21:31:12.555288 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-146c41f9-ff3e-415a-a16e-12e2f64f1004 req-03722882-57d8-424d-8f1b-6da3f0c83f81 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:12.557034 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-146c41f9-ff3e-415a-a16e-12e2f64f1004 req-03722882-57d8-424d-8f1b-6da3f0c83f81 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e&device_owner=compute%3Anova HTTP/1.1" status: 200 len: 945 time: 0.0924430 Dec 09 21:31:12.601208 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eeb4fe36-f2a4-4c6b-90dc-d5ffc8620793 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:12.625453 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-146c41f9-ff3e-415a-a16e-12e2f64f1004 req-5fd0a965-1abd-4a1a-9e10-edec07d5dc4d tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.5 HTTP/1.1" status: 200 len: 694 time: 0.0575860 Dec 09 21:31:12.640827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-146c41f9-ff3e-415a-a16e-12e2f64f1004 req-02951aea-381f-45c1-a634-a1e69e0f0817 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Request body: {'floatingip': {'port_id': '3d9c176b-4d74-466f-b7bd-8d44eae4a3f2', 'fixed_ip_address': '172.20.0.4'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:12.669674 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eeb4fe36-f2a4-4c6b-90dc-d5ffc8620793 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:12.675149 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eeb4fe36-f2a4-4c6b-90dc-d5ffc8620793 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:12.675822 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eeb4fe36-f2a4-4c6b-90dc-d5ffc8620793 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:12.684452 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-146c41f9-ff3e-415a-a16e-12e2f64f1004 req-02951aea-381f-45c1-a634-a1e69e0f0817 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks [] for floatingip, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:12.694889 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f177f394-64eb-4a8d-94c4-fae78e26258e req-ded207d1-9dc0-4810-af9a-ecd834b158cf service neutron] 10.222.0.10 "GET /v2.0/networks/deef6d86-d3bd-4711-b0fe-ebca0c9737aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1576569 Dec 09 21:31:12.740780 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-eeb4fe36-f2a4-4c6b-90dc-d5ffc8620793 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 793 time: 0.7703707 Dec 09 21:31:12.742219 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45464) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:12.748824 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a8568a53-b291-428d-8e0f-9870b4d29638 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Request body: {'subnet': {'network_id': '138bbad6-c535-44aa-9e30-5f63cf09578a', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:12.774474 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eeb4fe36-f2a4-4c6b-90dc-d5ffc8620793 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Pushing event updated for resources: {'Network': ['ID=138bbad6-c535-44aa-9e30-5f63cf09578a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:12.789668 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 138bbad6-c535-44aa-9e30-5f63cf09578a details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:31:12.846290 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f177f394-64eb-4a8d-94c4-fae78e26258e req-5bb774cf-d374-4d2b-b976-ebfdf4cebb56 service neutron] 10.222.0.10 "GET /v2.0/networks/deef6d86-d3bd-4711-b0fe-ebca0c9737aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1439390 Dec 09 21:31:12.932881 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a8568a53-b291-428d-8e0f-9870b4d29638 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Made reservation on behalf of bfcae90dbc4d484b92d6477166297d8c for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:31:12.936469 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a8568a53-b291-428d-8e0f-9870b4d29638 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:13.496198 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01f71c53-9a1b-4aaf-9651-5daa1978a968 req-90ca5749-fda5-4572-b13f-b05c1c21e817 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:13.497607 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-01f71c53-9a1b-4aaf-9651-5daa1978a968 req-90ca5749-fda5-4572-b13f-b05c1c21e817 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 944 time: 0.5518632 Dec 09 21:31:13.651479 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-01f71c53-9a1b-4aaf-9651-5daa1978a968 req-644c2c51-5281-48a8-80b0-48bd6b913ec0 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1471529 Dec 09 21:31:13.754657 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a8568a53-b291-428d-8e0f-9870b4d29638 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:13.776806 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-146c41f9-ff3e-415a-a16e-12e2f64f1004 req-02951aea-381f-45c1-a634-a1e69e0f0817 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:13.817712 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-146c41f9-ff3e-415a-a16e-12e2f64f1004 req-02951aea-381f-45c1-a634-a1e69e0f0817 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:13.940423 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8568a53-b291-428d-8e0f-9870b4d29638 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Pushing event updated for resources: {'Subnet': ['ID=831b7776-76ab-47d9-b714-1b07ce5db105,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:13.962442 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8568a53-b291-428d-8e0f-9870b4d29638 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Checking segment: {'id': '90681332-ace8-4a6b-9cd9-05d95713261a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '138bbad6-c535-44aa-9e30-5f63cf09578a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:31:13.962806 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8568a53-b291-428d-8e0f-9870b4d29638 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Network hostable DHCP agents. Network: 138bbad6-c535-44aa-9e30-5f63cf09578a, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:31:13.966399 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [req-146c41f9-ff3e-415a-a16e-12e2f64f1004 req-02951aea-381f-45c1-a634-a1e69e0f0817 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Floating IP d9b6e614-022a-49b1-a61a-ebcfa7e5c9dd associated. External IP: 172.25.3.5, port: 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2. Dec 09 21:31:14.024769 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8568a53-b291-428d-8e0f-9870b4d29638 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Network 138bbad6-c535-44aa-9e30-5f63cf09578a is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:31:14.066547 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-a8568a53-b291-428d-8e0f-9870b4d29638 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 138bbad6-c535-44aa-9e30-5f63cf09578a) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:14.074377 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8568a53-b291-428d-8e0f-9870b4d29638 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:14.074995 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a8568a53-b291-428d-8e0f-9870b4d29638 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:14.077566 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a132e303-3c05-4271-8793-86894daaec72 None None] Network 138bbad6-c535-44aa-9e30-5f63cf09578a requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:31:14.106420 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a8568a53-b291-428d-8e0f-9870b4d29638 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.3619344 Dec 09 21:31:14.107751 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45478) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:14.114475 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2a7e50ab-4c59-476c-8033-c37234be6591 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Request body: {'port': {'network_id': '138bbad6-c535-44aa-9e30-5f63cf09578a', 'name': 'tempest-AllowedAddressPairTestJSON-1086606425'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:14.211866 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-290fa893-ce4e-4b13-8f4a-49f1237f58f7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-138bbad6-c535-44aa-9e30-5f63cf09578a', 'network_id': '138bbad6-c535-44aa-9e30-5f63cf09578a', 'project_id': 'bfcae90dbc4d484b92d6477166297d8c', 'fixed_ips': [{'subnet_id': '831b7776-76ab-47d9-b714-1b07ce5db105'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:31:14.213096 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-290fa893-ce4e-4b13-8f4a-49f1237f58f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:14.257997 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [req-146c41f9-ff3e-415a-a16e-12e2f64f1004 req-02951aea-381f-45c1-a634-a1e69e0f0817 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Router 16dbc747-be19-40bc-8996-b5aa5410163c has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:31:14.268503 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2a7e50ab-4c59-476c-8033-c37234be6591 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Made reservation on behalf of bfcae90dbc4d484b92d6477166297d8c for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:31:14.273862 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a7e50ab-4c59-476c-8033-c37234be6591 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:14.302430 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-2a7e50ab-4c59-476c-8033-c37234be6591 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] device_id is not set on port 7089b6c3-4e14-4dd4-9051-7a556f7f9d6b yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:31:14.404965 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-290fa893-ce4e-4b13-8f4a-49f1237f58f7 None None] Allocated IP 172.20.0.2 (138bbad6-c535-44aa-9e30-5f63cf09578a/831b7776-76ab-47d9-b714-1b07ce5db105/207b7d23-72e8-45c3-8207-c3088997a588) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:31:14.423049 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-146c41f9-ff3e-415a-a16e-12e2f64f1004 req-02951aea-381f-45c1-a634-a1e69e0f0817 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:31:14.427909 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-146c41f9-ff3e-415a-a16e-12e2f64f1004 req-02951aea-381f-45c1-a634-a1e69e0f0817 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:14.434533 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7dd24238-ae79-4b56-adab-08001e3691c3 None None] Sync routers for ids ['16dbc747-be19-40bc-8996-b5aa5410163c'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:31:14.445601 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7dd24238-ae79-4b56-adab-08001e3691c3 None None] Routers {'16dbc747-be19-40bc-8996-b5aa5410163c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:31:14.446510 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-7dd24238-ae79-4b56-adab-08001e3691c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 10, "extensions": [], "floating_ips": 6, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:31:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['16dbc747-be19-40bc-8996-b5aa5410163c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:14.464524 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-146c41f9-ff3e-415a-a16e-12e2f64f1004 req-02951aea-381f-45c1-a634-a1e69e0f0817 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "PUT /v2.0/floatingips/d9b6e614-022a-49b1-a61a-ebcfa7e5c9dd HTTP/1.1" status: 200 len: 994 time: 1.8280883 Dec 09 21:31:14.465139 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '16ff2943-c2d6-4af7-9bbd-52443fde3d6e', 'tag': '3d9c176b-4d74-466f-b7bd-8d44eae4a3f2'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:31:14.469473 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-23ca4963-19d1-41c0-9b33-631e2161c59a" -d '{"events": [{"name": "network-changed", "server_uuid": "16ff2943-c2d6-4af7-9bbd-52443fde3d6e", "tag": "3d9c176b-4d74-466f-b7bd-8d44eae4a3f2"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:31:14.540098 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:31:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-470078a9-8cb6-41d0-ac9f-c9d526cbb3a0 x-openstack-request-id: req-470078a9-8cb6-41d0-ac9f-c9d526cbb3a0 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:31:14.541025 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "16ff2943-c2d6-4af7-9bbd-52443fde3d6e", "tag": "3d9c176b-4d74-466f-b7bd-8d44eae4a3f2", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:31:14.541025 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-470078a9-8cb6-41d0-ac9f-c9d526cbb3a0 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:31:14.541242 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '16ff2943-c2d6-4af7-9bbd-52443fde3d6e', 'tag': '3d9c176b-4d74-466f-b7bd-8d44eae4a3f2', 'status': 'completed', 'code': 200} Dec 09 21:31:14.568458 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-146c41f9-ff3e-415a-a16e-12e2f64f1004 req-d30b3fac-5156-4a0a-b6b7-d0e98f1dbe0c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:14.576220 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-146c41f9-ff3e-415a-a16e-12e2f64f1004 req-d30b3fac-5156-4a0a-b6b7-d0e98f1dbe0c service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0f8295f4c3534e24a63938170ba2425e&device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 1097 time: 0.0730162 Dec 09 21:31:14.631380 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ca4963-19d1-41c0-9b33-631e2161c59a req-ef319456-ce25-41d7-9b27-9bd997d9f60b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:14.633166 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-23ca4963-19d1-41c0-9b33-631e2161c59a req-ef319456-ce25-41d7-9b27-9bd997d9f60b service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0f8295f4c3534e24a63938170ba2425e&device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 1097 time: 0.0683675 Dec 09 21:31:14.645353 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-290fa893-ce4e-4b13-8f4a-49f1237f58f7 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:14.656677 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-290fa893-ce4e-4b13-8f4a-49f1237f58f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:14.685418 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-7dd24238-ae79-4b56-adab-08001e3691c3 None None] Set router 16dbc747-be19-40bc-8996-b5aa5410163c gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:31:14.727487 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-290fa893-ce4e-4b13-8f4a-49f1237f58f7 None None] Pushing event updated for resources: {'Port': ['ID=207b7d23-72e8-45c3-8207-c3088997a588,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:14.738001 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-146c41f9-ff3e-415a-a16e-12e2f64f1004 req-ad811ab6-57b3-47bc-9319-e0694626a2cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:14.748933 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-146c41f9-ff3e-415a-a16e-12e2f64f1004 req-ad811ab6-57b3-47bc-9319-e0694626a2cb service neutron] 10.222.0.13 "GET /v2.0/networks?id=deef6d86-d3bd-4711-b0fe-ebca0c9737aa HTTP/1.1" status: 200 len: 921 time: 0.1701391 Dec 09 21:31:14.749137 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-290fa893-ce4e-4b13-8f4a-49f1237f58f7 None None] Network 138bbad6-c535-44aa-9e30-5f63cf09578a is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:31:14.750496 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-290fa893-ce4e-4b13-8f4a-49f1237f58f7 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:14.753154 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-290fa893-ce4e-4b13-8f4a-49f1237f58f7 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:31:14.801117 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.db.api [None req-2a7e50ab-4c59-476c-8033-c37234be6591 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Retry wrapper got retriable exception: Failed to create a duplicate IpamAllocation: for attribute(s) ['ipamallocations.PRIMARY'] with value(s) 172.20.0.2-1154cc88-f2b4-4f20-a7e9-297466bbb167 {{(pid=103437) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:31:14.801359 n-d-713301-27 neutron-server[103437]: DEBUG oslo_db.api [None req-2a7e50ab-4c59-476c-8033-c37234be6591 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.create_port {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:31:14.817374 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ca4963-19d1-41c0-9b33-631e2161c59a req-79cd10a3-5a81-4181-aaff-4b07259e87e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:14.825449 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-290fa893-ce4e-4b13-8f4a-49f1237f58f7 None None] Attempting to bind port 207b7d23-72e8-45c3-8207-c3088997a588 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:31:14.825840 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-290fa893-ce4e-4b13-8f4a-49f1237f58f7 None None] Attempting to bind port 207b7d23-72e8-45c3-8207-c3088997a588 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '90681332-ace8-4a6b-9cd9-05d95713261a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '138bbad6-c535-44aa-9e30-5f63cf09578a'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:31:14.826430 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-290fa893-ce4e-4b13-8f4a-49f1237f58f7 None None] Attempting to bind port 207b7d23-72e8-45c3-8207-c3088997a588 on network 138bbad6-c535-44aa-9e30-5f63cf09578a {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:31:14.827197 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-23ca4963-19d1-41c0-9b33-631e2161c59a req-79cd10a3-5a81-4181-aaff-4b07259e87e4 service neutron] 10.222.0.10 "GET /v2.0/networks?id=deef6d86-d3bd-4711-b0fe-ebca0c9737aa HTTP/1.1" status: 200 len: 921 time: 0.1859422 Dec 09 21:31:14.833916 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-290fa893-ce4e-4b13-8f4a-49f1237f58f7 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 31, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:31:14.834311 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-290fa893-ce4e-4b13-8f4a-49f1237f58f7 None None] Checking segment: {'id': '90681332-ace8-4a6b-9cd9-05d95713261a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '138bbad6-c535-44aa-9e30-5f63cf09578a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:31:14.834731 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-290fa893-ce4e-4b13-8f4a-49f1237f58f7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:14.835389 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-290fa893-ce4e-4b13-8f4a-49f1237f58f7 None None] Bound using segment: {'id': '90681332-ace8-4a6b-9cd9-05d95713261a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '138bbad6-c535-44aa-9e30-5f63cf09578a'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:31:14.835891 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-290fa893-ce4e-4b13-8f4a-49f1237f58f7 None None] Bound port: 207b7d23-72e8-45c3-8207-c3088997a588, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '90681332-ace8-4a6b-9cd9-05d95713261a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '138bbad6-c535-44aa-9e30-5f63cf09578a'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:31:14.836280 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-290fa893-ce4e-4b13-8f4a-49f1237f58f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:14.879202 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-146c41f9-ff3e-415a-a16e-12e2f64f1004 req-8b43d2f7-0f7f-4df6-abdb-6854d591d790 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 HTTP/1.1" status: 200 len: 997 time: 0.1287847 Dec 09 21:31:14.907514 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-290fa893-ce4e-4b13-8f4a-49f1237f58f7 None None] For port 207b7d23-72e8-45c3-8207-c3088997a588, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:31:14.910706 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-290fa893-ce4e-4b13-8f4a-49f1237f58f7 None None] For port 207b7d23-72e8-45c3-8207-c3088997a588, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=207b7d23-72e8-45c3-8207-c3088997a588,segment=NetworkSegment(90681332-ace8-4a6b-9cd9-05d95713261a),segment_id=90681332-ace8-4a6b-9cd9-05d95713261a)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:31:14.918660 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-290fa893-ce4e-4b13-8f4a-49f1237f58f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:14.919508 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-23ca4963-19d1-41c0-9b33-631e2161c59a req-bd96c517-2216-4d3d-a95a-f1c7657d441c service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 HTTP/1.1" status: 200 len: 997 time: 0.0854642 Dec 09 21:31:14.989406 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ca4963-19d1-41c0-9b33-631e2161c59a req-5c0a2608-c795-4083-b7b2-afc554cbe1f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:14.989736 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7588bc2f-d9bc-4550-ae42-3369a9660cc1 req-e04e9267-64d8-4333-b358-7438bc2b79d0 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:14.990748 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-23ca4963-19d1-41c0-9b33-631e2161c59a req-5c0a2608-c795-4083-b7b2-afc554cbe1f8 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=86b80e39-7de5-4454-807b-0a1be07d2de3 HTTP/1.1" status: 200 len: 860 time: 0.0644090 Dec 09 21:31:14.991381 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7588bc2f-d9bc-4550-ae42-3369a9660cc1 req-e04e9267-64d8-4333-b358-7438bc2b79d0 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 944 time: 0.1843390 Dec 09 21:31:14.992789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-290fa893-ce4e-4b13-8f4a-49f1237f58f7 None None] Pushing event updated for resources: {'Port': ['ID=207b7d23-72e8-45c3-8207-c3088997a588,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:15.034012 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-23ca4963-19d1-41c0-9b33-631e2161c59a req-675337cb-a115-44c1-913d-4b4a249ce80a service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=deef6d86-d3bd-4711-b0fe-ebca0c9737aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0361514 Dec 09 21:31:15.037567 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a50be7-e8eb-4a2a-8117-49c82b2c9bec req-a07d50f8-7958-4335-be7a-d5b85bd5cb73 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:15.039136 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8a50be7-e8eb-4a2a-8117-49c82b2c9bec req-a07d50f8-7958-4335-be7a-d5b85bd5cb73 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b&tenant_id=29f2c1d9be9348b0888bc61ed37ed957 HTTP/1.1" status: 200 len: 1096 time: 0.1568785 Dec 09 21:31:15.051464 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-146c41f9-ff3e-415a-a16e-12e2f64f1004 req-f6d3389e-5971-4db1-8ba6-85d7696d21bf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:15.052969 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-146c41f9-ff3e-415a-a16e-12e2f64f1004 req-f6d3389e-5971-4db1-8ba6-85d7696d21bf service neutron] 10.222.0.13 "GET /v2.0/subnets?id=86b80e39-7de5-4454-807b-0a1be07d2de3 HTTP/1.1" status: 200 len: 860 time: 0.1728783 Dec 09 21:31:15.063379 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-7dd24238-ae79-4b56-adab-08001e3691c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'name': 'tempest-ServerRescueTestJSONUnderV235-1609818858-router', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208'}], 'enable_snat': True}, 'gw_port_id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:14Z', 'updated_at': '2021-12-09T21:30:19Z', 'revision_number': 4, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'gw_port': {'id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:fa:55:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1351, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:15Z', 'updated_at': '2021-12-09T21:30:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'd9b6e614-022a-49b1-a61a-ebcfa7e5c9dd', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'floating_ip_address': '172.25.3.5', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'port_id': '3d9c176b-4d74-466f-b7bd-8d44eae4a3f2', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 1479, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'deef6d86-d3bd-4711-b0fe-ebca0c9737aa', 'mac_address': 'fa:16:3e:14:5d:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16ff2943-c2d6-4af7-9bbd-52443fde3d6e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:31:11Z', 'updated_at': '2021-12-09T21:31:13Z', 'revision_number': 1, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a593c11a-9955-487b-871c-d87440b7d7f6', 'name': '', 'network_id': 'deef6d86-d3bd-4711-b0fe-ebca0c9737aa', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'mac_address': 'fa:16:3e:fc:b6:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1357, 'fixed_ips': [{'subnet_id': '86b80e39-7de5-4454-807b-0a1be07d2de3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:18Z', 'updated_at': '2021-12-09T21:30:25Z', 'revision_number': 5, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'subnets': [{'id': '86b80e39-7de5-4454-807b-0a1be07d2de3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:15.101241 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7dd24238-ae79-4b56-adab-08001e3691c3 None None] Checking router: 16dbc747-be19-40bc-8996-b5aa5410163c for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:31:15.110746 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7dd24238-ae79-4b56-adab-08001e3691c3 None None] Routers {'16dbc747-be19-40bc-8996-b5aa5410163c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:31:15.111363 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-7dd24238-ae79-4b56-adab-08001e3691c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 10, "extensions": [], "floating_ips": 6, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:31:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['16dbc747-be19-40bc-8996-b5aa5410163c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:15.117182 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-146c41f9-ff3e-415a-a16e-12e2f64f1004 req-9c312ee0-ac4f-4cfa-92c1-5d369ea5f603 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=deef6d86-d3bd-4711-b0fe-ebca0c9737aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0545881 Dec 09 21:31:15.146806 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7588bc2f-d9bc-4550-ae42-3369a9660cc1 req-577b5774-7fb9-4dd9-af3b-35a43b25e0b3 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1392214 Dec 09 21:31:15.153683 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-146c41f9-ff3e-415a-a16e-12e2f64f1004 req-b3496238-3110-4f39-9b21-a1f32e469583 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:31:15.155129 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-146c41f9-ff3e-415a-a16e-12e2f64f1004 req-b3496238-3110-4f39-9b21-a1f32e469583 service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0073054 Dec 09 21:31:15.196520 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-23ca4963-19d1-41c0-9b33-631e2161c59a req-deb23802-3837-41f0-877c-998883a8f9c3 service neutron] 10.222.0.10 "GET /v2.0/networks/deef6d86-d3bd-4711-b0fe-ebca0c9737aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1540048 Dec 09 21:31:15.253848 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a50be7-e8eb-4a2a-8117-49c82b2c9bec req-0b4bac00-12ee-4362-a3bc-03e025b44d9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:15.255411 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8a50be7-e8eb-4a2a-8117-49c82b2c9bec req-0b4bac00-12ee-4362-a3bc-03e025b44d9a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=29f2c1d9be9348b0888bc61ed37ed957&device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 1096 time: 0.1790397 Dec 09 21:31:15.314909 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-7dd24238-ae79-4b56-adab-08001e3691c3 None None] Set router 16dbc747-be19-40bc-8996-b5aa5410163c gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:31:15.317619 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a7e50ab-4c59-476c-8033-c37234be6591 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:15.367376 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-2a7e50ab-4c59-476c-8033-c37234be6591 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] device_id is not set on port d329eb51-62f0-4e9e-8739-46b02b957b55 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:31:15.420948 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-23ca4963-19d1-41c0-9b33-631e2161c59a req-2c7830da-28ef-403c-aded-140fe967ee7a service neutron] 10.222.0.10 "GET /v2.0/networks/deef6d86-d3bd-4711-b0fe-ebca0c9737aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2173426 Dec 09 21:31:15.478705 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-146c41f9-ff3e-415a-a16e-12e2f64f1004 req-39b5e751-ea21-4efa-8fb1-482f5eea67a9 service neutron] 10.222.0.13 "GET /v2.0/networks/deef6d86-d3bd-4711-b0fe-ebca0c9737aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3053424 Dec 09 21:31:15.512098 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a50be7-e8eb-4a2a-8117-49c82b2c9bec req-bed1a1cb-d343-449a-b5fb-094b73bea269 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:15.513730 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8a50be7-e8eb-4a2a-8117-49c82b2c9bec req-bed1a1cb-d343-449a-b5fb-094b73bea269 service neutron] 10.222.0.31 "GET /v2.0/networks?id=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 HTTP/1.1" status: 200 len: 917 time: 0.2398539 Dec 09 21:31:15.541465 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-2a7e50ab-4c59-476c-8033-c37234be6591 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Allocated IP 172.20.0.11 (138bbad6-c535-44aa-9e30-5f63cf09578a/831b7776-76ab-47d9-b714-1b07ce5db105/d329eb51-62f0-4e9e-8739-46b02b957b55) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:31:15.655150 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8a50be7-e8eb-4a2a-8117-49c82b2c9bec req-1d36c180-a96f-415d-bf08-5117e69ef4ef service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=778d35d4-c635-4fcb-b344-64cbb94958b9 HTTP/1.1" status: 200 len: 999 time: 0.1289744 Dec 09 21:31:15.696251 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-7dd24238-ae79-4b56-adab-08001e3691c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'name': 'tempest-ServerRescueTestJSONUnderV235-1609818858-router', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208'}], 'enable_snat': True}, 'gw_port_id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:14Z', 'updated_at': '2021-12-09T21:30:19Z', 'revision_number': 4, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'gw_port': {'id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:fa:55:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1351, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:15Z', 'updated_at': '2021-12-09T21:30:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'd9b6e614-022a-49b1-a61a-ebcfa7e5c9dd', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'floating_ip_address': '172.25.3.5', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'port_id': '3d9c176b-4d74-466f-b7bd-8d44eae4a3f2', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 1479, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'deef6d86-d3bd-4711-b0fe-ebca0c9737aa', 'mac_address': 'fa:16:3e:14:5d:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16ff2943-c2d6-4af7-9bbd-52443fde3d6e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:31:11Z', 'updated_at': '2021-12-09T21:31:13Z', 'revision_number': 1, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a593c11a-9955-487b-871c-d87440b7d7f6', 'name': '', 'network_id': 'deef6d86-d3bd-4711-b0fe-ebca0c9737aa', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'mac_address': 'fa:16:3e:fc:b6:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1357, 'fixed_ips': [{'subnet_id': '86b80e39-7de5-4454-807b-0a1be07d2de3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:18Z', 'updated_at': '2021-12-09T21:30:25Z', 'revision_number': 5, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'subnets': [{'id': '86b80e39-7de5-4454-807b-0a1be07d2de3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:15.713042 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-146c41f9-ff3e-415a-a16e-12e2f64f1004 req-0a442c7d-c393-4e97-b32b-151d75f78dfe service neutron] 10.222.0.13 "GET /v2.0/networks/deef6d86-d3bd-4711-b0fe-ebca0c9737aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2334626 Dec 09 21:31:15.729850 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a50be7-e8eb-4a2a-8117-49c82b2c9bec req-b6abc484-6667-474c-b809-420a60837238 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:15.730029 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7dd24238-ae79-4b56-adab-08001e3691c3 None None] The sync data for ids ['16dbc747-be19-40bc-8996-b5aa5410163c'] in n-d-713301-27 is: [{'id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'name': 'tempest-ServerRescueTestJSONUnderV235-1609818858-router', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208'}], 'enable_snat': True}, 'gw_port_id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:14Z', 'updated_at': '2021-12-09T21:30:19Z', 'revision_number': 4, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'gw_port': {'id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:fa:55:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1351, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:15Z', 'updated_at': '2021-12-09T21:30:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'd9b6e614-022a-49b1-a61a-ebcfa7e5c9dd', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'floating_ip_address': '172.25.3.5', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'port_id': '3d9c176b-4d74-466f-b7bd-8d44eae4a3f2', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 1479, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'deef6d86-d3bd-4711-b0fe-ebca0c9737aa', 'mac_address': 'fa:16:3e:14:5d:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16ff2943-c2d6-4af7-9bbd-52443fde3d6e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:31:11Z', 'updated_at': '2021-12-09T21:31:13Z', 'revision_number': 1, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a593c11a-9955-487b-871c-d87440b7d7f6', 'name': '', 'network_id': 'deef6d86-d3bd-4711-b0fe-ebca0c9737aa', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'mac_address': 'fa:16:3e:fc:b6:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1357, 'fixed_ips': [{'subnet_id': '86b80e39-7de5-4454-807b-0a1be07d2de3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:18Z', 'updated_at': '2021-12-09T21:30:25Z', 'revision_number': 5, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'subnets': [{'id': '86b80e39-7de5-4454-807b-0a1be07d2de3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:31:15.731811 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8a50be7-e8eb-4a2a-8117-49c82b2c9bec req-b6abc484-6667-474c-b809-420a60837238 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ace82e8b-012a-4184-a81e-5303eecf12ff HTTP/1.1" status: 200 len: 855 time: 0.0686874 Dec 09 21:31:15.746507 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a7e50ab-4c59-476c-8033-c37234be6591 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:15.788014 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a7e50ab-4c59-476c-8033-c37234be6591 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:15.838351 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a7e50ab-4c59-476c-8033-c37234be6591 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Network 138bbad6-c535-44aa-9e30-5f63cf09578a is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:31:15.842103 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-2a7e50ab-4c59-476c-8033-c37234be6591 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:15.849066 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a7e50ab-4c59-476c-8033-c37234be6591 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:31:15.880767 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a7e50ab-4c59-476c-8033-c37234be6591 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Pushing event updated for resources: {'Port': ['ID=d329eb51-62f0-4e9e-8739-46b02b957b55,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:15.883339 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a50be7-e8eb-4a2a-8117-49c82b2c9bec req-d66327c9-fdfa-400c-aa4e-06eb8b527697 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:15.885741 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8a50be7-e8eb-4a2a-8117-49c82b2c9bec req-d66327c9-fdfa-400c-aa4e-06eb8b527697 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1438203 Dec 09 21:31:15.894761 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-53e0973c-4b9a-43e2-808c-24918512bc71 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.5 HTTP/1.1" status: 200 len: 997 time: 0.1443105 Dec 09 21:31:15.914637 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a7e50ab-4c59-476c-8033-c37234be6591 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:15.915420 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a7e50ab-4c59-476c-8033-c37234be6591 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:15.937660 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2a7e50ab-4c59-476c-8033-c37234be6591 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.8279326 Dec 09 21:31:15.938283 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45496) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:15.943625 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b9d0260c-81b0-4ed7-afbe-2d05086faadb tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Request body: {'port': {'network_id': '138bbad6-c535-44aa-9e30-5f63cf09578a', 'name': 'tempest-AllowedAddressPairTestJSON-1747497059', 'allowed_address_pairs': [{'ip_address': '172.20.0.11', 'mac_address': 'fa:16:3e:fe:dc:c3'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:15.973659 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-14549954-68fa-4844-b082-25d0d17db171 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:15.975785 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-14549954-68fa-4844-b082-25d0d17db171 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports/3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 HTTP/1.1" status: 200 len: 942 time: 0.0801353 Dec 09 21:31:16.049789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1dfc3a37-11c3-4d46-8f1b-c6dbb96ff6a6 None None] New status for floating IP d9b6e614-022a-49b1-a61a-ebcfa7e5c9dd: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:31:16.089617 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b9d0260c-81b0-4ed7-afbe-2d05086faadb tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Made reservation on behalf of bfcae90dbc4d484b92d6477166297d8c for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:31:16.090163 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8a50be7-e8eb-4a2a-8117-49c82b2c9bec req-873b3414-c4bd-4cb1-ba50-616947558f4e service neutron] 10.222.0.31 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1932721 Dec 09 21:31:16.206171 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b9d0260c-81b0-4ed7-afbe-2d05086faadb tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:16.212789 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-268a91d1-07b9-44ba-8210-b3ce7d5e9402 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.5 HTTP/1.1" status: 200 len: 997 time: 0.1664498 Dec 09 21:31:16.228423 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-b9d0260c-81b0-4ed7-afbe-2d05086faadb tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] device_id is not set on port b792828b-d4fd-40e2-8ab3-4c5c073804a3 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:31:16.334626 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-483d7085-1ca6-4586-8e07-3fdd5786d742 None None] Network 138bbad6-c535-44aa-9e30-5f63cf09578a requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:31:16.365170 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-b9d0260c-81b0-4ed7-afbe-2d05086faadb tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Allocated IP 172.20.0.10 (138bbad6-c535-44aa-9e30-5f63cf09578a/831b7776-76ab-47d9-b714-1b07ce5db105/b792828b-d4fd-40e2-8ab3-4c5c073804a3) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:31:16.418817 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-abc3cc9d-af77-44c8-8452-59b26ae5dd33 None None] Provisioning complete for port 207b7d23-72e8-45c3-8207-c3088997a588 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:16.419266 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-abc3cc9d-af77-44c8-8452-59b26ae5dd33 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:16.529387 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-abc3cc9d-af77-44c8-8452-59b26ae5dd33 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:16.539690 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b9d0260c-81b0-4ed7-afbe-2d05086faadb tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:16.574909 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-abc3cc9d-af77-44c8-8452-59b26ae5dd33 None None] For port 207b7d23-72e8-45c3-8207-c3088997a588, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=207b7d23-72e8-45c3-8207-c3088997a588,segment=NetworkSegment(90681332-ace8-4a6b-9cd9-05d95713261a),segment_id=90681332-ace8-4a6b-9cd9-05d95713261a)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:31:16.580959 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b9d0260c-81b0-4ed7-afbe-2d05086faadb tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:16.584651 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-abc3cc9d-af77-44c8-8452-59b26ae5dd33 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:16.628698 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b9d0260c-81b0-4ed7-afbe-2d05086faadb tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Network 138bbad6-c535-44aa-9e30-5f63cf09578a is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:31:16.632264 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-b9d0260c-81b0-4ed7-afbe-2d05086faadb tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:16.638619 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9d0260c-81b0-4ed7-afbe-2d05086faadb tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:31:16.655293 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abc3cc9d-af77-44c8-8452-59b26ae5dd33 None None] Pushing event updated for resources: {'Port': ['ID=207b7d23-72e8-45c3-8207-c3088997a588,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:16.673389 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9d0260c-81b0-4ed7-afbe-2d05086faadb tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Pushing event updated for resources: {'Port': ['ID=b792828b-d4fd-40e2-8ab3-4c5c073804a3,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:16.678527 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8a50be7-e8eb-4a2a-8117-49c82b2c9bec req-b9156fa3-6d29-4245-80b0-bd16e5ab2268 service neutron] 10.222.0.31 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5587065 Dec 09 21:31:16.705894 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b9d0260c-81b0-4ed7-afbe-2d05086faadb tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:16.707257 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b9d0260c-81b0-4ed7-afbe-2d05086faadb tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:16.731946 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b9d0260c-81b0-4ed7-afbe-2d05086faadb tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1000 time: 0.7902799 Dec 09 21:31:16.732695 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45510) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:16.734771 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b74591e8-e876-46e5-b268-826af9234106 req-61d5ca52-46a5-42d1-b503-cd98e7fbcfac tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:16.736354 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b74591e8-e876-46e5-b268-826af9234106 req-61d5ca52-46a5-42d1-b503-cd98e7fbcfac tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 944 time: 0.1431894 Dec 09 21:31:16.785877 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-f3460400-0a4f-4d4c-aac2-e4a60b2d0868 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:16.787214 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-f3460400-0a4f-4d4c-aac2-e4a60b2d0868 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.5736318 Dec 09 21:31:16.814725 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8b123e4d-7fb1-4a25-948d-c3cc1db6799f None None] Provisioning complete for port 207b7d23-72e8-45c3-8207-c3088997a588 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:16.815217 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8b123e4d-7fb1-4a25-948d-c3cc1db6799f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:16.821551 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-a15a963c-5f13-4285-aa73-60b3420ed5e2 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:31:16.838210 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-a15a963c-5f13-4285-aa73-60b3420ed5e2 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0305135 Dec 09 21:31:16.850312 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b74591e8-e876-46e5-b268-826af9234106 req-e1f097bc-0044-4a1b-a2e4-93fd19608b09 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1069102 Dec 09 21:31:16.873666 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-baf5a3ca-9e18-4652-8015-da0b51a6fec5 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:16.898217 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-baf5a3ca-9e18-4652-8015-da0b51a6fec5 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:16.917521 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-baf5a3ca-9e18-4652-8015-da0b51a6fec5 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:16.920529 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-baf5a3ca-9e18-4652-8015-da0b51a6fec5 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2469 time: 0.1866462 Dec 09 21:31:16.923644 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-eaaf0fe1-2f2d-4ba4-857e-076b0bcc4c39 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.5 HTTP/1.1" status: 200 len: 999 time: 0.0844851 Dec 09 21:31:16.924362 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45518) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:16.973344 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8b123e4d-7fb1-4a25-948d-c3cc1db6799f None None] Provisioning complete for port d329eb51-62f0-4e9e-8739-46b02b957b55 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:16.973617 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-25327ec9-9efd-4a7c-8ad4-2aacbb7457d9 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Request body: {'floatingip': {'port_id': None}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:16.975147 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8b123e4d-7fb1-4a25-948d-c3cc1db6799f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:17.025850 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-8b123e4d-7fb1-4a25-948d-c3cc1db6799f None None] Port d329eb51-62f0-4e9e-8739-46b02b957b55 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:31:17.092250 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-25327ec9-9efd-4a7c-8ad4-2aacbb7457d9 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks [] for floatingip, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:17.159073 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e3c0083d-2dba-4f2d-961e-985fbe9cef0d None None] Provisioning complete for port d329eb51-62f0-4e9e-8739-46b02b957b55 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:17.162323 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e3c0083d-2dba-4f2d-961e-985fbe9cef0d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:17.262137 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e3c0083d-2dba-4f2d-961e-985fbe9cef0d None None] Port d329eb51-62f0-4e9e-8739-46b02b957b55 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:31:17.307596 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 207b7d23-72e8-45c3-8207-c3088997a588 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:31:17.318390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-299ca678-fb1f-40c1-987b-a40241f9b467 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Deleting port b792828b-d4fd-40e2-8ab3-4c5c073804a3 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:31:17.318733 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-299ca678-fb1f-40c1-987b-a40241f9b467 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:17.402783 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-517a036f-da41-4c1c-81f8-12c47ae446d3 None None] Provisioning complete for port b792828b-d4fd-40e2-8ab3-4c5c073804a3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:17.403612 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-517a036f-da41-4c1c-81f8-12c47ae446d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:17.455933 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 207b7d23-72e8-45c3-8207-c3088997a588 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:17.456713 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:17.456992 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-25327ec9-9efd-4a7c-8ad4-2aacbb7457d9 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:17.467103 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-25327ec9-9efd-4a7c-8ad4-2aacbb7457d9 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:17.467882 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-25327ec9-9efd-4a7c-8ad4-2aacbb7457d9 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Floating IP d9b6e614-022a-49b1-a61a-ebcfa7e5c9dd disassociated. External IP: 172.25.3.5, port: 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2. Dec 09 21:31:17.493894 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-517a036f-da41-4c1c-81f8-12c47ae446d3 None None] Port b792828b-d4fd-40e2-8ab3-4c5c073804a3 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:31:17.646693 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-299ca678-fb1f-40c1-987b-a40241f9b467 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:17.662119 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-299ca678-fb1f-40c1-987b-a40241f9b467 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Calling delete_port for b792828b-d4fd-40e2-8ab3-4c5c073804a3 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:31:17.890100 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-25327ec9-9efd-4a7c-8ad4-2aacbb7457d9 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Router 16dbc747-be19-40bc-8996-b5aa5410163c has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:31:18.035672 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-299ca678-fb1f-40c1-987b-a40241f9b467 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:18.118412 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89025d6c-d899-4026-adcf-7d4f47dc078c req-3bdae3e8-736e-448d-a966-fbaf684f8d43 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:18.120058 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89025d6c-d899-4026-adcf-7d4f47dc078c req-3bdae3e8-736e-448d-a966-fbaf684f8d43 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 944 time: 0.1821520 Dec 09 21:31:18.125987 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-299ca678-fb1f-40c1-987b-a40241f9b467 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Pushing event deleted for resources: {'Port': ['ID=b792828b-d4fd-40e2-8ab3-4c5c073804a3,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:18.204386 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-25327ec9-9efd-4a7c-8ad4-2aacbb7457d9 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:31:18.217841 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-25327ec9-9efd-4a7c-8ad4-2aacbb7457d9 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:18.223372 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f40afac7-88ca-41f9-a4a3-0cf43591dd74 None None] Sync routers for ids ['16dbc747-be19-40bc-8996-b5aa5410163c'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:31:18.240247 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f40afac7-88ca-41f9-a4a3-0cf43591dd74 None None] Routers {'16dbc747-be19-40bc-8996-b5aa5410163c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:31:18.241041 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f40afac7-88ca-41f9-a4a3-0cf43591dd74 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 10, "extensions": [], "floating_ips": 6, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:31:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['16dbc747-be19-40bc-8996-b5aa5410163c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:18.356780 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-25327ec9-9efd-4a7c-8ad4-2aacbb7457d9 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "PUT /v2.0/floatingips/d9b6e614-022a-49b1-a61a-ebcfa7e5c9dd HTTP/1.1" status: 200 len: 693 time: 1.3880320 Dec 09 21:31:18.359193 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '16ff2943-c2d6-4af7-9bbd-52443fde3d6e', 'tag': '3d9c176b-4d74-466f-b7bd-8d44eae4a3f2'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:31:18.361523 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6c9b4d05-3237-4b2d-92fb-723c01d84751" -d '{"events": [{"name": "network-changed", "server_uuid": "16ff2943-c2d6-4af7-9bbd-52443fde3d6e", "tag": "3d9c176b-4d74-466f-b7bd-8d44eae4a3f2"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:31:18.407414 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89025d6c-d899-4026-adcf-7d4f47dc078c req-62c8574f-af81-4907-b939-fa620fd52ad5 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2694781 Dec 09 21:31:18.432045 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-f40afac7-88ca-41f9-a4a3-0cf43591dd74 None None] Set router 16dbc747-be19-40bc-8996-b5aa5410163c gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:31:18.486271 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-299ca678-fb1f-40c1-987b-a40241f9b467 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:18.490165 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-299ca678-fb1f-40c1-987b-a40241f9b467 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "DELETE /v2.0/ports/b792828b-d4fd-40e2-8ab3-4c5c073804a3 HTTP/1.1" status: 204 len: 168 time: 1.5647116 Dec 09 21:31:18.493509 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45544) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:18.497112 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-afd79a38-99e4-4cb1-bf43-d14e90547e02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:18.498693 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-afd79a38-99e4-4cb1-bf43-d14e90547e02 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0f8295f4c3534e24a63938170ba2425e&device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 1097 time: 0.0879164 Dec 09 21:31:18.526393 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-a841ddbe-3cfc-4a16-9ad9-dc3646d2e74c tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] GET failed (client error): The resource could not be found. Dec 09 21:31:18.529348 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a841ddbe-3cfc-4a16-9ad9-dc3646d2e74c tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "GET /v2.0/ports/b792828b-d4fd-40e2-8ab3-4c5c073804a3 HTTP/1.1" status: 404 len: 333 time: 0.0339882 Dec 09 21:31:18.534608 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45546) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:18.541766 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-5be0555c-f039-4b26-b7c7-232cffe32578 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Request body: {'port': {'network_id': '138bbad6-c535-44aa-9e30-5f63cf09578a', 'name': 'tempest-AllowedAddressPairTestJSON-1789245765'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:18.648126 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-fdc8aceb-372f-4de8-9a66-8a1961ba210f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:18.649836 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-fdc8aceb-372f-4de8-9a66-8a1961ba210f service neutron] 10.222.0.13 "GET /v2.0/networks?id=deef6d86-d3bd-4711-b0fe-ebca0c9737aa HTTP/1.1" status: 200 len: 921 time: 0.1429200 Dec 09 21:31:18.706771 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f40afac7-88ca-41f9-a4a3-0cf43591dd74 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'name': 'tempest-ServerRescueTestJSONUnderV235-1609818858-router', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208'}], 'enable_snat': True}, 'gw_port_id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:14Z', 'updated_at': '2021-12-09T21:30:19Z', 'revision_number': 4, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'gw_port': {'id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:fa:55:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1351, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:15Z', 'updated_at': '2021-12-09T21:30:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'a593c11a-9955-487b-871c-d87440b7d7f6', 'name': '', 'network_id': 'deef6d86-d3bd-4711-b0fe-ebca0c9737aa', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'mac_address': 'fa:16:3e:fc:b6:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1357, 'fixed_ips': [{'subnet_id': '86b80e39-7de5-4454-807b-0a1be07d2de3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:18Z', 'updated_at': '2021-12-09T21:30:25Z', 'revision_number': 5, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'subnets': [{'id': '86b80e39-7de5-4454-807b-0a1be07d2de3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:18.708963 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5be0555c-f039-4b26-b7c7-232cffe32578 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Made reservation on behalf of bfcae90dbc4d484b92d6477166297d8c for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:31:18.714038 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5be0555c-f039-4b26-b7c7-232cffe32578 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:18.732887 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-5be0555c-f039-4b26-b7c7-232cffe32578 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] device_id is not set on port 0aa2c4f2-c252-474f-99aa-899f03b60908 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:31:18.742278 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-c78e456c-8ce4-4022-a636-3e36bd1a0c1b service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 HTTP/1.1" status: 200 len: 217 time: 0.0810113 Dec 09 21:31:18.747195 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f40afac7-88ca-41f9-a4a3-0cf43591dd74 None None] Checking router: 16dbc747-be19-40bc-8996-b5aa5410163c for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:31:18.764669 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f40afac7-88ca-41f9-a4a3-0cf43591dd74 None None] Routers {'16dbc747-be19-40bc-8996-b5aa5410163c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:31:18.765310 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f40afac7-88ca-41f9-a4a3-0cf43591dd74 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 10, "extensions": [], "floating_ips": 6, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:31:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['16dbc747-be19-40bc-8996-b5aa5410163c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:18.825175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-b003a318-9eb3-4080-9bd4-454b083ad64d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:18.825175 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-b003a318-9eb3-4080-9bd4-454b083ad64d service neutron] 10.222.0.13 "GET /v2.0/subnets?id=86b80e39-7de5-4454-807b-0a1be07d2de3 HTTP/1.1" status: 200 len: 860 time: 0.0786197 Dec 09 21:31:18.880713 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-5be0555c-f039-4b26-b7c7-232cffe32578 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Allocated IP 172.20.0.5 (138bbad6-c535-44aa-9e30-5f63cf09578a/831b7776-76ab-47d9-b714-1b07ce5db105/0aa2c4f2-c252-474f-99aa-899f03b60908) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:31:18.885289 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-24d4b54b-1e88-4ae7-bacf-b6801008c632 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=deef6d86-d3bd-4711-b0fe-ebca0c9737aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0437360 Dec 09 21:31:18.946617 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-f40afac7-88ca-41f9-a4a3-0cf43591dd74 None None] Set router 16dbc747-be19-40bc-8996-b5aa5410163c gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:31:19.012766 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-16c6e6ee-30ef-40ef-ba5c-4cfe0b4328ad service neutron] 10.222.0.13 "GET /v2.0/networks/deef6d86-d3bd-4711-b0fe-ebca0c9737aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1201673 Dec 09 21:31:19.057059 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5be0555c-f039-4b26-b7c7-232cffe32578 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:19.101726 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5be0555c-f039-4b26-b7c7-232cffe32578 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:19.161155 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aec5626c-234b-45e5-b45d-7b3701ee8260 req-34f5af45-1f46-4873-8680-6c3ef5a8193f service neutron] 10.222.0.13 "GET /v2.0/networks/deef6d86-d3bd-4711-b0fe-ebca0c9737aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1304195 Dec 09 21:31:19.208548 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5be0555c-f039-4b26-b7c7-232cffe32578 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Pushing event updated for resources: {'Port': ['ID=0aa2c4f2-c252-474f-99aa-899f03b60908,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:19.220094 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5be0555c-f039-4b26-b7c7-232cffe32578 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Network 138bbad6-c535-44aa-9e30-5f63cf09578a is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:31:19.220697 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f40afac7-88ca-41f9-a4a3-0cf43591dd74 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'name': 'tempest-ServerRescueTestJSONUnderV235-1609818858-router', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208'}], 'enable_snat': True}, 'gw_port_id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:14Z', 'updated_at': '2021-12-09T21:30:19Z', 'revision_number': 4, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'gw_port': {'id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:fa:55:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1351, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:15Z', 'updated_at': '2021-12-09T21:30:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'a593c11a-9955-487b-871c-d87440b7d7f6', 'name': '', 'network_id': 'deef6d86-d3bd-4711-b0fe-ebca0c9737aa', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'mac_address': 'fa:16:3e:fc:b6:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1357, 'fixed_ips': [{'subnet_id': '86b80e39-7de5-4454-807b-0a1be07d2de3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:18Z', 'updated_at': '2021-12-09T21:30:25Z', 'revision_number': 5, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'subnets': [{'id': '86b80e39-7de5-4454-807b-0a1be07d2de3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:19.222174 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-5be0555c-f039-4b26-b7c7-232cffe32578 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:19.235486 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5be0555c-f039-4b26-b7c7-232cffe32578 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:31:19.252693 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f40afac7-88ca-41f9-a4a3-0cf43591dd74 None None] The sync data for ids ['16dbc747-be19-40bc-8996-b5aa5410163c'] in n-d-713301-27 is: [{'id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'name': 'tempest-ServerRescueTestJSONUnderV235-1609818858-router', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208'}], 'enable_snat': True}, 'gw_port_id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:14Z', 'updated_at': '2021-12-09T21:30:19Z', 'revision_number': 4, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'gw_port': {'id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:fa:55:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1351, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:15Z', 'updated_at': '2021-12-09T21:30:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'a593c11a-9955-487b-871c-d87440b7d7f6', 'name': '', 'network_id': 'deef6d86-d3bd-4711-b0fe-ebca0c9737aa', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'mac_address': 'fa:16:3e:fc:b6:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1357, 'fixed_ips': [{'subnet_id': '86b80e39-7de5-4454-807b-0a1be07d2de3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:18Z', 'updated_at': '2021-12-09T21:30:25Z', 'revision_number': 5, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'subnets': [{'id': '86b80e39-7de5-4454-807b-0a1be07d2de3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:31:19.328836 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5be0555c-f039-4b26-b7c7-232cffe32578 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:19.331608 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5be0555c-f039-4b26-b7c7-232cffe32578 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:19.361257 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45550) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:19.367027 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-5e456a72-4ec9-4271-b33c-f5610893a37b tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.11', 'mac_address': 'fa:16:3e:fe:dc:c3'}]}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:19.374070 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5be0555c-f039-4b26-b7c7-232cffe32578 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 0.8357611 Dec 09 21:31:19.646249 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e456a72-4ec9-4271-b33c-f5610893a37b tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:19.695003 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1ebfc1c-1efb-4d4a-8c2b-86e8c3e7d9a3 None None] New status for floating IP d9b6e614-022a-49b1-a61a-ebcfa7e5c9dd: DOWN {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:31:19.835521 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6f79c4c6-8624-4aeb-b326-80731d3b5baa None None] Provisioning complete for port 0aa2c4f2-c252-474f-99aa-899f03b60908 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:19.836026 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6f79c4c6-8624-4aeb-b326-80731d3b5baa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:19.882218 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e456a72-4ec9-4271-b33c-f5610893a37b tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:19.887142 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e456a72-4ec9-4271-b33c-f5610893a37b tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:19.980136 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e456a72-4ec9-4271-b33c-f5610893a37b tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Pushing event updated for resources: {'Port': ['ID=0aa2c4f2-c252-474f-99aa-899f03b60908,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:19.994881 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-5e456a72-4ec9-4271-b33c-f5610893a37b tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] In _notify_port_updated(), no bound segment for port 0aa2c4f2-c252-474f-99aa-899f03b60908 on network 138bbad6-c535-44aa-9e30-5f63cf09578a {{(pid=103438) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:31:20.002725 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e456a72-4ec9-4271-b33c-f5610893a37b tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:20.003431 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e456a72-4ec9-4271-b33c-f5610893a37b tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:20.005340 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5e456a72-4ec9-4271-b33c-f5610893a37b tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "PUT /v2.0/ports/0aa2c4f2-c252-474f-99aa-899f03b60908 HTTP/1.1" status: 200 len: 994 time: 0.6427059 Dec 09 21:31:20.008301 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45554) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:20.126147 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-8035933b-3d72-4ca3-8556-b163b5cab0c0 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Deleting port 0aa2c4f2-c252-474f-99aa-899f03b60908 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:31:20.126637 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8035933b-3d72-4ca3-8556-b163b5cab0c0 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:20.153428 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-6f79c4c6-8624-4aeb-b326-80731d3b5baa None None] Port 0aa2c4f2-c252-474f-99aa-899f03b60908 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:31:20.279431 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8035933b-3d72-4ca3-8556-b163b5cab0c0 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:20.281498 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7efdcea2-2738-4052-9a7f-4a4cee85e9e2 None None] Provisioning complete for port 0aa2c4f2-c252-474f-99aa-899f03b60908 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:20.282022 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7efdcea2-2738-4052-9a7f-4a4cee85e9e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:20.296011 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-8035933b-3d72-4ca3-8556-b163b5cab0c0 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Calling delete_port for 0aa2c4f2-c252-474f-99aa-899f03b60908 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:31:20.325654 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-7efdcea2-2738-4052-9a7f-4a4cee85e9e2 None None] Port 0aa2c4f2-c252-474f-99aa-899f03b60908 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:31:20.446129 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8035933b-3d72-4ca3-8556-b163b5cab0c0 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:20.474894 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8035933b-3d72-4ca3-8556-b163b5cab0c0 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Pushing event deleted for resources: {'Port': ['ID=0aa2c4f2-c252-474f-99aa-899f03b60908,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:20.624828 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8035933b-3d72-4ca3-8556-b163b5cab0c0 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:20.631689 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8035933b-3d72-4ca3-8556-b163b5cab0c0 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "DELETE /v2.0/ports/0aa2c4f2-c252-474f-99aa-899f03b60908 HTTP/1.1" status: 204 len: 168 time: 0.6222129 Dec 09 21:31:20.634653 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45562) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:20.662838 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-56aee1d4-0964-4c22-a67d-d4fa28eb7787 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] GET failed (client error): The resource could not be found. Dec 09 21:31:20.668545 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-56aee1d4-0964-4c22-a67d-d4fa28eb7787 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "GET /v2.0/ports/0aa2c4f2-c252-474f-99aa-899f03b60908 HTTP/1.1" status: 404 len: 333 time: 0.0284274 Dec 09 21:31:20.668915 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45564) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:20.674164 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-7cb41e54-419c-4019-a26d-372c554110b2 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Request body: {'port': {'network_id': '138bbad6-c535-44aa-9e30-5f63cf09578a', 'name': 'tempest-AllowedAddressPairTestJSON-868564433'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:20.792558 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7cb41e54-419c-4019-a26d-372c554110b2 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Made reservation on behalf of bfcae90dbc4d484b92d6477166297d8c for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:31:20.796134 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7cb41e54-419c-4019-a26d-372c554110b2 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:20.815004 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-7cb41e54-419c-4019-a26d-372c554110b2 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] device_id is not set on port be91d5df-9de7-4be3-91cb-70304ade3863 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:31:20.924778 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-7cb41e54-419c-4019-a26d-372c554110b2 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Allocated IP 172.20.0.8 (138bbad6-c535-44aa-9e30-5f63cf09578a/831b7776-76ab-47d9-b714-1b07ce5db105/be91d5df-9de7-4be3-91cb-70304ade3863) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:31:21.079293 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7cb41e54-419c-4019-a26d-372c554110b2 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:21.115358 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7cb41e54-419c-4019-a26d-372c554110b2 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:21.159732 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7cb41e54-419c-4019-a26d-372c554110b2 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Network 138bbad6-c535-44aa-9e30-5f63cf09578a is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:31:21.163047 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-7cb41e54-419c-4019-a26d-372c554110b2 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:21.165484 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7cb41e54-419c-4019-a26d-372c554110b2 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:31:21.206551 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cb41e54-419c-4019-a26d-372c554110b2 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Pushing event updated for resources: {'Port': ['ID=be91d5df-9de7-4be3-91cb-70304ade3863,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:21.245545 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7cb41e54-419c-4019-a26d-372c554110b2 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:21.246217 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7cb41e54-419c-4019-a26d-372c554110b2 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:21.266774 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7cb41e54-419c-4019-a26d-372c554110b2 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 936 time: 0.5965722 Dec 09 21:31:21.269685 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45566) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:21.275374 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-dd5b597c-8611-41d0-ab78-5e472bb7a706 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.0/16', 'mac_address': 'fa:16:3e:fe:dc:c3'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:21.455803 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2c518396-183c-4db6-b90b-32d9fd0cc9c1 None None] Provisioning complete for port be91d5df-9de7-4be3-91cb-70304ade3863 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:21.456646 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dd5b597c-8611-41d0-ab78-5e472bb7a706 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:21.457051 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2c518396-183c-4db6-b90b-32d9fd0cc9c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:21.492500 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-2c518396-183c-4db6-b90b-32d9fd0cc9c1 None None] Port be91d5df-9de7-4be3-91cb-70304ade3863 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:31:21.940281 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dd5b597c-8611-41d0-ab78-5e472bb7a706 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:21.946435 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dd5b597c-8611-41d0-ab78-5e472bb7a706 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:22.025589 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd5b597c-8611-41d0-ab78-5e472bb7a706 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Pushing event updated for resources: {'Port': ['ID=be91d5df-9de7-4be3-91cb-70304ade3863,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:22.038888 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-dd5b597c-8611-41d0-ab78-5e472bb7a706 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] In _notify_port_updated(), no bound segment for port be91d5df-9de7-4be3-91cb-70304ade3863 on network 138bbad6-c535-44aa-9e30-5f63cf09578a {{(pid=103437) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:31:22.044659 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd5b597c-8611-41d0-ab78-5e472bb7a706 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:22.045328 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dd5b597c-8611-41d0-ab78-5e472bb7a706 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:22.047898 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-dd5b597c-8611-41d0-ab78-5e472bb7a706 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "PUT /v2.0/ports/be91d5df-9de7-4be3-91cb-70304ade3863 HTTP/1.1" status: 200 len: 995 time: 0.7771432 Dec 09 21:31:22.049416 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45568) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:22.159619 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-35e5fb53-c7fe-43e6-bf37-6526bccbee00 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Deleting port be91d5df-9de7-4be3-91cb-70304ade3863 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:31:22.160027 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-35e5fb53-c7fe-43e6-bf37-6526bccbee00 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:22.257090 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-35e5fb53-c7fe-43e6-bf37-6526bccbee00 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:22.269307 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-35e5fb53-c7fe-43e6-bf37-6526bccbee00 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Calling delete_port for be91d5df-9de7-4be3-91cb-70304ade3863 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:31:22.321509 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7616174c-8513-43bc-a3f8-91498868fa72 None None] Provisioning complete for port be91d5df-9de7-4be3-91cb-70304ade3863 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:22.322146 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7616174c-8513-43bc-a3f8-91498868fa72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:22.365310 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-7616174c-8513-43bc-a3f8-91498868fa72 None None] Port be91d5df-9de7-4be3-91cb-70304ade3863 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:31:22.415140 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-35e5fb53-c7fe-43e6-bf37-6526bccbee00 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:22.448751 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35e5fb53-c7fe-43e6-bf37-6526bccbee00 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Pushing event deleted for resources: {'Port': ['ID=be91d5df-9de7-4be3-91cb-70304ade3863,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:22.531811 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-35e5fb53-c7fe-43e6-bf37-6526bccbee00 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:22.538522 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-35e5fb53-c7fe-43e6-bf37-6526bccbee00 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "DELETE /v2.0/ports/be91d5df-9de7-4be3-91cb-70304ade3863 HTTP/1.1" status: 204 len: 168 time: 0.4850965 Dec 09 21:31:22.539711 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45570) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:22.567703 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-55e45112-c655-4155-8389-f41bbe145ea9 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] GET failed (client error): The resource could not be found. Dec 09 21:31:22.573781 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45572) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:22.579271 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-0e30b249-208d-4b85-bc04-15bd34a7e1db tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Request body: {'port': {'network_id': '138bbad6-c535-44aa-9e30-5f63cf09578a', 'name': 'tempest-AllowedAddressPairTestJSON-460728819'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:22.582542 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-55e45112-c655-4155-8389-f41bbe145ea9 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "GET /v2.0/ports/be91d5df-9de7-4be3-91cb-70304ade3863 HTTP/1.1" status: 404 len: 333 time: 0.0387471 Dec 09 21:31:22.701074 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0e30b249-208d-4b85-bc04-15bd34a7e1db tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Made reservation on behalf of bfcae90dbc4d484b92d6477166297d8c for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:31:22.704821 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e30b249-208d-4b85-bc04-15bd34a7e1db tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:22.722860 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-0e30b249-208d-4b85-bc04-15bd34a7e1db tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] device_id is not set on port 75492b41-1246-4e54-a242-0036b99ee5c3 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:31:22.836251 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-0e30b249-208d-4b85-bc04-15bd34a7e1db tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Allocated IP 172.20.0.8 (138bbad6-c535-44aa-9e30-5f63cf09578a/831b7776-76ab-47d9-b714-1b07ce5db105/75492b41-1246-4e54-a242-0036b99ee5c3) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:31:23.035330 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e30b249-208d-4b85-bc04-15bd34a7e1db tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:23.070245 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e30b249-208d-4b85-bc04-15bd34a7e1db tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:23.113966 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e30b249-208d-4b85-bc04-15bd34a7e1db tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Network 138bbad6-c535-44aa-9e30-5f63cf09578a is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:31:23.117585 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-0e30b249-208d-4b85-bc04-15bd34a7e1db tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:23.121457 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e30b249-208d-4b85-bc04-15bd34a7e1db tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:31:23.153812 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e30b249-208d-4b85-bc04-15bd34a7e1db tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Pushing event updated for resources: {'Port': ['ID=75492b41-1246-4e54-a242-0036b99ee5c3,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:23.188239 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0e30b249-208d-4b85-bc04-15bd34a7e1db tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:23.189184 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e30b249-208d-4b85-bc04-15bd34a7e1db tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:23.213573 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0e30b249-208d-4b85-bc04-15bd34a7e1db tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 936 time: 0.6379769 Dec 09 21:31:23.215622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45576) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:23.230270 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-0d106454-958d-412c-9cc4-c20861463563 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Request body: {'port': {'network_id': '138bbad6-c535-44aa-9e30-5f63cf09578a', 'name': 'tempest-AllowedAddressPairTestJSON-1457491117'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:23.369704 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d106454-958d-412c-9cc4-c20861463563 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Made reservation on behalf of bfcae90dbc4d484b92d6477166297d8c for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:31:23.374158 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d106454-958d-412c-9cc4-c20861463563 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:23.394541 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-0d106454-958d-412c-9cc4-c20861463563 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] device_id is not set on port 1464ccea-1dc9-44fd-9532-e39709ca2d50 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:31:23.401259 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b0f7e7b2-467c-4ba6-8f9b-268909940d72 None None] Provisioning complete for port 75492b41-1246-4e54-a242-0036b99ee5c3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:23.401933 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b0f7e7b2-467c-4ba6-8f9b-268909940d72 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:23.444938 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-b0f7e7b2-467c-4ba6-8f9b-268909940d72 None None] Port 75492b41-1246-4e54-a242-0036b99ee5c3 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:31:23.509263 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-0d106454-958d-412c-9cc4-c20861463563 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Allocated IP 172.20.0.7 (138bbad6-c535-44aa-9e30-5f63cf09578a/831b7776-76ab-47d9-b714-1b07ce5db105/1464ccea-1dc9-44fd-9532-e39709ca2d50) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:31:23.667097 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d106454-958d-412c-9cc4-c20861463563 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:23.702724 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d106454-958d-412c-9cc4-c20861463563 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:23.750753 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d106454-958d-412c-9cc4-c20861463563 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Network 138bbad6-c535-44aa-9e30-5f63cf09578a is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:31:23.753950 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-0d106454-958d-412c-9cc4-c20861463563 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:23.759987 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d106454-958d-412c-9cc4-c20861463563 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:31:24.073244 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b2c5a245-a422-460a-be53-b5d9df527cb2 None None] Provisioning complete for port 1464ccea-1dc9-44fd-9532-e39709ca2d50 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:24.073593 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b2c5a245-a422-460a-be53-b5d9df527cb2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:24.120403 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-b2c5a245-a422-460a-be53-b5d9df527cb2 None None] Port 1464ccea-1dc9-44fd-9532-e39709ca2d50 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:31:24.136593 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d106454-958d-412c-9cc4-c20861463563 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Pushing event updated for resources: {'Port': ['ID=1464ccea-1dc9-44fd-9532-e39709ca2d50,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:24.168554 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d106454-958d-412c-9cc4-c20861463563 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:24.169204 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d106454-958d-412c-9cc4-c20861463563 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:24.186613 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0d106454-958d-412c-9cc4-c20861463563 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 0.9694695 Dec 09 21:31:24.189473 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45578) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:24.194788 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-7bab2ac3-ac4f-423e-88bb-2470b6fa58ff tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '172.20.0.11', 'mac_address': 'fa:16:3e:fe:dc:c3'}, {'ip_address': '172.20.0.8', 'mac_address': 'fa:16:3e:17:f4:91'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:24.272215 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7bab2ac3-ac4f-423e-88bb-2470b6fa58ff tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:24.467104 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7bab2ac3-ac4f-423e-88bb-2470b6fa58ff tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:24.473079 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7bab2ac3-ac4f-423e-88bb-2470b6fa58ff tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:24.556975 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bab2ac3-ac4f-423e-88bb-2470b6fa58ff tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Pushing event updated for resources: {'Port': ['ID=1464ccea-1dc9-44fd-9532-e39709ca2d50,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:24.570698 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-7bab2ac3-ac4f-423e-88bb-2470b6fa58ff tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] In _notify_port_updated(), no bound segment for port 1464ccea-1dc9-44fd-9532-e39709ca2d50 on network 138bbad6-c535-44aa-9e30-5f63cf09578a {{(pid=103437) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:31:24.577445 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7bab2ac3-ac4f-423e-88bb-2470b6fa58ff tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:24.578256 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7bab2ac3-ac4f-423e-88bb-2470b6fa58ff tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:24.582384 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7bab2ac3-ac4f-423e-88bb-2470b6fa58ff tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "PUT /v2.0/ports/1464ccea-1dc9-44fd-9532-e39709ca2d50 HTTP/1.1" status: 200 len: 1056 time: 0.3891733 Dec 09 21:31:24.582778 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45580) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:24.697559 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-ceae6115-2e70-44f3-af59-4d0d75f1ad91 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Deleting port 1464ccea-1dc9-44fd-9532-e39709ca2d50 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:31:24.698175 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ceae6115-2e70-44f3-af59-4d0d75f1ad91 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:24.789794 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ceae6115-2e70-44f3-af59-4d0d75f1ad91 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:24.802367 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-ceae6115-2e70-44f3-af59-4d0d75f1ad91 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Calling delete_port for 1464ccea-1dc9-44fd-9532-e39709ca2d50 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:31:24.847358 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-24f8fb53-2bf5-47b7-bd20-d08f2a19e5b1 None None] Provisioning complete for port 1464ccea-1dc9-44fd-9532-e39709ca2d50 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:24.848076 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-24f8fb53-2bf5-47b7-bd20-d08f2a19e5b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:24.884318 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-24f8fb53-2bf5-47b7-bd20-d08f2a19e5b1 None None] Port 1464ccea-1dc9-44fd-9532-e39709ca2d50 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:31:24.945106 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ceae6115-2e70-44f3-af59-4d0d75f1ad91 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:24.972718 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceae6115-2e70-44f3-af59-4d0d75f1ad91 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Pushing event deleted for resources: {'Port': ['ID=1464ccea-1dc9-44fd-9532-e39709ca2d50,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:25.065756 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:31:25.229653 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ceae6115-2e70-44f3-af59-4d0d75f1ad91 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:25.233019 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ceae6115-2e70-44f3-af59-4d0d75f1ad91 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "DELETE /v2.0/ports/1464ccea-1dc9-44fd-9532-e39709ca2d50 HTTP/1.1" status: 204 len: 168 time: 0.6490374 Dec 09 21:31:25.235646 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45582) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:25.266587 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-0d546f39-4717-477b-a75c-7e52b8ebfca3 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] GET failed (client error): The resource could not be found. Dec 09 21:31:25.268137 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0d546f39-4717-477b-a75c-7e52b8ebfca3 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "GET /v2.0/ports/1464ccea-1dc9-44fd-9532-e39709ca2d50 HTTP/1.1" status: 404 len: 333 time: 0.0315237 Dec 09 21:31:25.271012 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45584) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:25.365061 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-ac359266-5295-4260-b87a-b9cf1163e32a tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Deleting port 75492b41-1246-4e54-a242-0036b99ee5c3 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:31:25.365309 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac359266-5295-4260-b87a-b9cf1163e32a tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:25.459237 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac359266-5295-4260-b87a-b9cf1163e32a tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:25.472409 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-ac359266-5295-4260-b87a-b9cf1163e32a tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Calling delete_port for 75492b41-1246-4e54-a242-0036b99ee5c3 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:31:25.603422 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac359266-5295-4260-b87a-b9cf1163e32a tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:25.640440 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac359266-5295-4260-b87a-b9cf1163e32a tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Pushing event deleted for resources: {'Port': ['ID=75492b41-1246-4e54-a242-0036b99ee5c3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:25.723627 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac359266-5295-4260-b87a-b9cf1163e32a tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:25.739352 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45586) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:25.744660 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ac359266-5295-4260-b87a-b9cf1163e32a tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "DELETE /v2.0/ports/75492b41-1246-4e54-a242-0036b99ee5c3 HTTP/1.1" status: 204 len: 168 time: 0.4724684 Dec 09 21:31:25.781497 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-05bec96b-12c7-40dc-a447-c9ea6fb1a018 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] GET failed (client error): The resource could not be found. Dec 09 21:31:25.783105 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-05bec96b-12c7-40dc-a447-c9ea6fb1a018 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "GET /v2.0/ports/75492b41-1246-4e54-a242-0036b99ee5c3 HTTP/1.1" status: 404 len: 333 time: 0.0411747 Dec 09 21:31:25.789047 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45588) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:25.911530 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c2395de6-1917-4e87-895f-2746355edbc3 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Deleting port d329eb51-62f0-4e9e-8739-46b02b957b55 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:31:25.911888 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c2395de6-1917-4e87-895f-2746355edbc3 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:26.009646 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c2395de6-1917-4e87-895f-2746355edbc3 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:26.022895 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c2395de6-1917-4e87-895f-2746355edbc3 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Calling delete_port for d329eb51-62f0-4e9e-8739-46b02b957b55 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:31:26.157223 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c2395de6-1917-4e87-895f-2746355edbc3 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:26.192918 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2395de6-1917-4e87-895f-2746355edbc3 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Pushing event deleted for resources: {'Port': ['ID=d329eb51-62f0-4e9e-8739-46b02b957b55,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:26.271864 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c2395de6-1917-4e87-895f-2746355edbc3 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:26.277839 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c2395de6-1917-4e87-895f-2746355edbc3 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "DELETE /v2.0/ports/d329eb51-62f0-4e9e-8739-46b02b957b55 HTTP/1.1" status: 204 len: 168 time: 0.4861016 Dec 09 21:31:26.278775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45590) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:26.334656 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-bc607130-55ac-4227-9397-3a02faedd31d tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Deleting subnet 831b7776-76ab-47d9-b714-1b07ce5db105 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:31:26.343095 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bc607130-55ac-4227-9397-3a02faedd31d tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:26.391214 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bc607130-55ac-4227-9397-3a02faedd31d tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:26.490134 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bc607130-55ac-4227-9397-3a02faedd31d tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:26.556775 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bc607130-55ac-4227-9397-3a02faedd31d tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:26.586242 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc607130-55ac-4227-9397-3a02faedd31d tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Pushing event deleted for resources: {'Subnet': ['ID=831b7776-76ab-47d9-b714-1b07ce5db105,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:26.591765 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bc607130-55ac-4227-9397-3a02faedd31d tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:26.598466 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b883b46b-dbd8-4804-95e1-fed09fe1c724 None None] Network 138bbad6-c535-44aa-9e30-5f63cf09578a requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:31:26.603091 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45594) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:26.607837 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bc607130-55ac-4227-9397-3a02faedd31d tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "DELETE /v2.0/subnets/831b7776-76ab-47d9-b714-1b07ce5db105 HTTP/1.1" status: 204 len: 168 time: 0.3231494 Dec 09 21:31:26.689769 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-23953067-2585-41ad-9b1b-76a2e13903c7 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:26.765459 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-23953067-2585-41ad-9b1b-76a2e13903c7 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Deleting port 207b7d23-72e8-45c3-8207-c3088997a588 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:31:26.766543 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-23953067-2585-41ad-9b1b-76a2e13903c7 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:26.773536 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa423723-6aef-4eec-bfa8-5e300e168695 None None] DHCP port deletion for 138bbad6-c535-44aa-9e30-5f63cf09578a request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:31:26.835156 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-aa423723-6aef-4eec-bfa8-5e300e168695 None None] Deleting port 207b7d23-72e8-45c3-8207-c3088997a588 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:31:26.835653 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aa423723-6aef-4eec-bfa8-5e300e168695 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:26.848530 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-23953067-2585-41ad-9b1b-76a2e13903c7 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] For port 207b7d23-72e8-45c3-8207-c3088997a588, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=207b7d23-72e8-45c3-8207-c3088997a588,segment=NetworkSegment(90681332-ace8-4a6b-9cd9-05d95713261a),segment_id=90681332-ace8-4a6b-9cd9-05d95713261a)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:31:26.849316 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-23953067-2585-41ad-9b1b-76a2e13903c7 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:26.864390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-23953067-2585-41ad-9b1b-76a2e13903c7 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Calling delete_port for 207b7d23-72e8-45c3-8207-c3088997a588 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:31:26.915593 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-aa423723-6aef-4eec-bfa8-5e300e168695 None None] For port 207b7d23-72e8-45c3-8207-c3088997a588, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=207b7d23-72e8-45c3-8207-c3088997a588,segment=NetworkSegment(90681332-ace8-4a6b-9cd9-05d95713261a),segment_id=90681332-ace8-4a6b-9cd9-05d95713261a)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:31:26.916358 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aa423723-6aef-4eec-bfa8-5e300e168695 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:26.929931 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-aa423723-6aef-4eec-bfa8-5e300e168695 None None] Calling delete_port for 207b7d23-72e8-45c3-8207-c3088997a588 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:31:26.957958 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-23953067-2585-41ad-9b1b-76a2e13903c7 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:26.987843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-23953067-2585-41ad-9b1b-76a2e13903c7 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] No DVR routers for this DVR port 207b7d23-72e8-45c3-8207-c3088997a588 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:31:26.994155 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23953067-2585-41ad-9b1b-76a2e13903c7 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Pushing event deleted for resources: {'Port': ['ID=207b7d23-72e8-45c3-8207-c3088997a588,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:27.013363 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aa423723-6aef-4eec-bfa8-5e300e168695 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:27.046216 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa423723-6aef-4eec-bfa8-5e300e168695 None None] Pushing event deleted for resources: {'Port': ['ID=207b7d23-72e8-45c3-8207-c3088997a588,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:27.048401 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa423723-6aef-4eec-bfa8-5e300e168695 None None] No DVR routers for this DVR port 207b7d23-72e8-45c3-8207-c3088997a588 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:31:27.077639 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-23953067-2585-41ad-9b1b-76a2e13903c7 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:27.099351 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-23953067-2585-41ad-9b1b-76a2e13903c7 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['138bbad6-c535-44aa-9e30-5f63cf09578a']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:27.109758 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-23953067-2585-41ad-9b1b-76a2e13903c7 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '90681332-ace8-4a6b-9cd9-05d95713261a') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:27.110051 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-23953067-2585-41ad-9b1b-76a2e13903c7 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '90681332-ace8-4a6b-9cd9-05d95713261a') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:27.119788 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-23953067-2585-41ad-9b1b-76a2e13903c7 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:27.135512 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-23953067-2585-41ad-9b1b-76a2e13903c7 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:27.143117 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-23953067-2585-41ad-9b1b-76a2e13903c7 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Releasing vlan 103 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:31:27.143538 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-23953067-2585-41ad-9b1b-76a2e13903c7 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:31:27.147307 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:31:27.201920 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:27.204735 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:27.221699 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-23953067-2585-41ad-9b1b-76a2e13903c7 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:27.226979 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 207b7d23-72e8-45c3-8207-c3088997a588 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:31:27.227740 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-23953067-2585-41ad-9b1b-76a2e13903c7 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:27.233829 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-23953067-2585-41ad-9b1b-76a2e13903c7 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] 10.222.0.13 "DELETE /v2.0/networks/138bbad6-c535-44aa-9e30-5f63cf09578a HTTP/1.1" status: 204 len: 168 time: 0.6268151 Dec 09 21:31:27.245947 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23953067-2585-41ad-9b1b-76a2e13903c7 tempest-AllowedAddressPairTestJSON-312579597 tempest-AllowedAddressPairTestJSON-312579597-project] Pushing event deleted for resources: {'Network': ['ID=138bbad6-c535-44aa-9e30-5f63cf09578a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:27.264920 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 207b7d23-72e8-45c3-8207-c3088997a588 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:31:27.265304 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 207b7d23-72e8-45c3-8207-c3088997a588 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:31:27.489377 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45600) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:27.625232 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-72269254-6499-4709-8073-869867bed820 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=bfcae90dbc4d484b92d6477166297d8c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1346307 Dec 09 21:31:27.627946 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45604) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:27.688278 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf37fdef-77c1-4180-a114-3959f9690187 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:27.712344 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf37fdef-77c1-4180-a114-3959f9690187 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:27.777335 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf37fdef-77c1-4180-a114-3959f9690187 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:27.781632 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf37fdef-77c1-4180-a114-3959f9690187 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:27.785731 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cf37fdef-77c1-4180-a114-3959f9690187 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/7e9378de-a2af-419e-a6af-ab42443685a3 HTTP/1.1" status: 204 len: 168 time: 0.1539323 Dec 09 21:31:27.785877 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:31:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f34b9fd9-a925-4582-8552-5cfea21f2145 x-openstack-request-id: req-f34b9fd9-a925-4582-8552-5cfea21f2145 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:31:27.785877 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "16ff2943-c2d6-4af7-9bbd-52443fde3d6e", "tag": "3d9c176b-4d74-466f-b7bd-8d44eae4a3f2", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:31:27.785877 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f34b9fd9-a925-4582-8552-5cfea21f2145 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:31:27.786495 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '16ff2943-c2d6-4af7-9bbd-52443fde3d6e', 'tag': '3d9c176b-4d74-466f-b7bd-8d44eae4a3f2', 'status': 'completed', 'code': 200} Dec 09 21:31:27.792902 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf37fdef-77c1-4180-a114-3959f9690187 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7e9378de-a2af-419e-a6af-ab42443685a3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:27.907644 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3203bd0-cec2-4669-aab7-171252c5cd61 req-470a1633-4655-4980-a348-c9454c699cfa tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/floatingips/d9b6e614-022a-49b1-a61a-ebcfa7e5c9dd HTTP/1.1" status: 200 len: 691 time: 0.0678999 Dec 09 21:31:27.911466 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-daf444d3-393a-475c-b939-e250663f9f0d req-3fccdb37-029f-4b64-a65a-f371da7d1ede service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1370184 Dec 09 21:31:27.914195 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c9b4d05-3237-4b2d-92fb-723c01d84751 req-0048d5cd-0f3e-47ca-9601-6917adba9cc7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:27.916252 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6c9b4d05-3237-4b2d-92fb-723c01d84751 req-0048d5cd-0f3e-47ca-9601-6917adba9cc7 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0f8295f4c3534e24a63938170ba2425e&device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 1097 time: 0.0752666 Dec 09 21:31:28.027719 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c9b4d05-3237-4b2d-92fb-723c01d84751 req-fc29286c-8c7f-4321-b804-77b31be0011c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:28.029329 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6c9b4d05-3237-4b2d-92fb-723c01d84751 req-fc29286c-8c7f-4321-b804-77b31be0011c service neutron] 10.222.0.10 "GET /v2.0/networks?id=deef6d86-d3bd-4711-b0fe-ebca0c9737aa HTTP/1.1" status: 200 len: 921 time: 0.0995004 Dec 09 21:31:28.076063 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6c9b4d05-3237-4b2d-92fb-723c01d84751 req-06c7820a-11f1-4fb9-a687-8d566577d26d service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 HTTP/1.1" status: 200 len: 217 time: 0.0393221 Dec 09 21:31:28.084059 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daf444d3-393a-475c-b939-e250663f9f0d req-404a7a18-5603-4b9b-afe4-3774a7a33f5f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:28.085555 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-daf444d3-393a-475c-b939-e250663f9f0d req-404a7a18-5603-4b9b-afe4-3774a7a33f5f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 1098 time: 0.1471827 Dec 09 21:31:28.096713 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2d959d9-5239-466d-8721-2f6b17acb62f req-b01b3edd-2daa-476e-8a13-9439d2c767e4 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:28.098411 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f2d959d9-5239-466d-8721-2f6b17acb62f req-b01b3edd-2daa-476e-8a13-9439d2c767e4 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 944 time: 0.1377704 Dec 09 21:31:28.117297 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3203bd0-cec2-4669-aab7-171252c5cd61 req-59663a48-ab4e-4137-82b3-915216bbb9b8 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:28.118680 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3203bd0-cec2-4669-aab7-171252c5cd61 req-59663a48-ab4e-4137-82b3-915216bbb9b8 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 784 time: 0.1972730 Dec 09 21:31:28.130834 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c9b4d05-3237-4b2d-92fb-723c01d84751 req-9765d7df-7eac-41d9-af48-1851008fdb61 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:28.132817 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6c9b4d05-3237-4b2d-92fb-723c01d84751 req-9765d7df-7eac-41d9-af48-1851008fdb61 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=86b80e39-7de5-4454-807b-0a1be07d2de3 HTTP/1.1" status: 200 len: 860 time: 0.0489841 Dec 09 21:31:28.152250 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-f3203bd0-cec2-4669-aab7-171252c5cd61 req-20a86f06-680f-4260-8f1a-db9db5c59a01 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:31:28.153295 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3203bd0-cec2-4669-aab7-171252c5cd61 req-20a86f06-680f-4260-8f1a-db9db5c59a01 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0262017 Dec 09 21:31:28.172752 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6c9b4d05-3237-4b2d-92fb-723c01d84751 req-2eac7440-2575-4efa-abee-09f76f4ff875 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=deef6d86-d3bd-4711-b0fe-ebca0c9737aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0318785 Dec 09 21:31:28.257227 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3203bd0-cec2-4669-aab7-171252c5cd61 req-36d5c3fb-0a2e-4322-89d2-a6c5c13a1988 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.5 HTTP/1.1" status: 200 len: 694 time: 0.0937667 Dec 09 21:31:28.279530 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6c9b4d05-3237-4b2d-92fb-723c01d84751 req-34e3a84b-190c-4023-bbf6-36a02d7d1e4c service neutron] 10.222.0.10 "GET /v2.0/networks/deef6d86-d3bd-4711-b0fe-ebca0c9737aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0980787 Dec 09 21:31:28.314787 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f2d959d9-5239-466d-8721-2f6b17acb62f req-ca18a7bf-23e7-4221-9910-ce1263b2e662 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1951036 Dec 09 21:31:28.326783 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3203bd0-cec2-4669-aab7-171252c5cd61 req-3b888692-753e-41f4-8aa6-f01f4e137fef tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/floatingips?floating_ip_address=172.25.3.5 HTTP/1.1" status: 200 len: 694 time: 0.0589519 Dec 09 21:31:28.382275 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daf444d3-393a-475c-b939-e250663f9f0d req-e0b99729-411d-42de-9e6b-7f03b97869a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:28.384536 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-daf444d3-393a-475c-b939-e250663f9f0d req-e0b99729-411d-42de-9e6b-7f03b97869a6 service neutron] 10.222.0.31 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 913 time: 0.2766068 Dec 09 21:31:28.391454 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6c9b4d05-3237-4b2d-92fb-723c01d84751 req-7e2a49b4-66af-4268-be13-68955a777268 service neutron] 10.222.0.10 "GET /v2.0/networks/deef6d86-d3bd-4711-b0fe-ebca0c9737aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1051054 Dec 09 21:31:28.511722 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-daf444d3-393a-475c-b939-e250663f9f0d req-8303b92e-c451-4827-ac43-0671cc66a97e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=90f16e74-f2e6-416e-a079-f205615a0d8e HTTP/1.1" status: 200 len: 1002 time: 0.1170540 Dec 09 21:31:28.566050 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-f3203bd0-cec2-4669-aab7-171252c5cd61 req-4cb9a1d5-6693-4fc6-a052-98436240c7e1 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Deleting port c39b988b-8f95-422f-a595-579cf20a34ac {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:31:28.566340 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f3203bd0-cec2-4669-aab7-171252c5cd61 req-4cb9a1d5-6693-4fc6-a052-98436240c7e1 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:28.591683 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45626) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:28.597363 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daf444d3-393a-475c-b939-e250663f9f0d req-6c16d989-8c6b-4a0a-ae57-ad39ae318cff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:28.598857 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-daf444d3-393a-475c-b939-e250663f9f0d req-6c16d989-8c6b-4a0a-ae57-ad39ae318cff service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 200 len: 851 time: 0.0784173 Dec 09 21:31:28.682720 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f3203bd0-cec2-4669-aab7-171252c5cd61 req-4cb9a1d5-6693-4fc6-a052-98436240c7e1 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:28.683041 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f3203bd0-cec2-4669-aab7-171252c5cd61 req-4cb9a1d5-6693-4fc6-a052-98436240c7e1 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:28.690088 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Request body: {'networks': [{'name': 'tempest-network--1084355985'}, {'name': 'tempest-network--1805766784'}]} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:28.690387 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Request body: {'network': {'name': 'tempest-network--1084355985'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:28.690865 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Request body: {'network': {'name': 'tempest-network--1805766784'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:28.699469 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daf444d3-393a-475c-b939-e250663f9f0d req-303a1027-1c48-471c-9604-09073d8a4dc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:28.701012 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-daf444d3-393a-475c-b939-e250663f9f0d req-303a1027-1c48-471c-9604-09073d8a4dc1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0718999 Dec 09 21:31:28.701910 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-f3203bd0-cec2-4669-aab7-171252c5cd61 req-4cb9a1d5-6693-4fc6-a052-98436240c7e1 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Calling delete_port for c39b988b-8f95-422f-a595-579cf20a34ac owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:31:28.712654 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Made reservation on behalf of 771151d2362842e3a098655197de55d7 for: {'network': 2} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:31:28.717519 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:28.726504 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:28.817161 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:28.832896 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:28.833477 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:28.870491 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-daf444d3-393a-475c-b939-e250663f9f0d req-de4441b6-6be2-4f4d-9a34-13770a803dac service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1598713 Dec 09 21:31:28.884497 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c59ebcbc-706e-4a7c-8497-83f2c69046ed,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:28.887210 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] vlan segment allocate from pool success with {'vlan_id': 128, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:31:28.982234 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f3203bd0-cec2-4669-aab7-171252c5cd61 req-4cb9a1d5-6693-4fc6-a052-98436240c7e1 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:28.984910 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:28.985268 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Added segment a3e68eac-d877-48d3-95d8-d35f39262553 of type vlan for network cfa17e4c-fb21-44b1-9de4-db2ae13d9ec2 Dec 09 21:31:29.013862 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cb9a1d5-6693-4fc6-a052-98436240c7e1 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Pushing event deleted for resources: {'Port': ['ID=c39b988b-8f95-422f-a595-579cf20a34ac,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:29.028249 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:29.058312 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] vlan segment allocate from pool success with {'vlan_id': 146, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:31:29.068497 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:29.068844 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Added segment 3f83fe24-4387-43f9-a770-4ce79cf8cff3 of type vlan for network 94de0d5f-4b0b-46ed-b413-113def4ab7df Dec 09 21:31:29.077143 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-daf444d3-393a-475c-b939-e250663f9f0d req-c5c1c2c0-9ad6-4630-a2c3-d11f7e172291 service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1714184 Dec 09 21:31:29.091030 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f3203bd0-cec2-4669-aab7-171252c5cd61 req-4cb9a1d5-6693-4fc6-a052-98436240c7e1 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:29.094311 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f3203bd0-cec2-4669-aab7-171252c5cd61 req-4cb9a1d5-6693-4fc6-a052-98436240c7e1 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:29.095546 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3203bd0-cec2-4669-aab7-171252c5cd61 req-4cb9a1d5-6693-4fc6-a052-98436240c7e1 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "DELETE /v2.0/floatingips/d9b6e614-022a-49b1-a61a-ebcfa7e5c9dd HTTP/1.1" status: 204 len: 173 time: 0.7624216 Dec 09 21:31:29.109705 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:29.140511 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:29.141127 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:29.148366 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:29.153889 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:29.154534 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:29.158449 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-93245665-e2df-482e-baf2-71c3953dd0c2 req-d947dba3-872c-4cf8-ae3d-8abc072c0ad5 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups/6d0b589a-fba4-450d-b727-ca2a914231de HTTP/1.1" status: 200 len: 1826 time: 0.0412710 Dec 09 21:31:29.189915 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 1320 time: 0.5964735 Dec 09 21:31:29.192479 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45638) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:29.221104 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-93245665-e2df-482e-baf2-71c3953dd0c2 req-66997bd0-f5f1-4242-a3c3-f37865657c8b tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:29.243875 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-93245665-e2df-482e-baf2-71c3953dd0c2 req-66997bd0-f5f1-4242-a3c3-f37865657c8b tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:29.258327 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Pushing event updated for resources: {'Network': ['ID=cfa17e4c-fb21-44b1-9de4-db2ae13d9ec2,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:29.270011 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network cfa17e4c-fb21-44b1-9de4-db2ae13d9ec2 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:31:29.291924 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-93245665-e2df-482e-baf2-71c3953dd0c2 req-66997bd0-f5f1-4242-a3c3-f37865657c8b tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:29.295077 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-93245665-e2df-482e-baf2-71c3953dd0c2 req-66997bd0-f5f1-4242-a3c3-f37865657c8b tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:29.296350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-93245665-e2df-482e-baf2-71c3953dd0c2 req-66997bd0-f5f1-4242-a3c3-f37865657c8b tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "DELETE /v2.0/security-groups/6d0b589a-fba4-450d-b727-ca2a914231de HTTP/1.1" status: 204 len: 173 time: 0.1314151 Dec 09 21:31:29.305894 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66997bd0-f5f1-4242-a3c3-f37865657c8b tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=6d0b589a-fba4-450d-b727-ca2a914231de,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:29.419748 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d65acff-2fbe-48d8-9b29-d31b942a38a3 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Pushing event updated for resources: {'Network': ['ID=94de0d5f-4b0b-46ed-b413-113def4ab7df,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:29.433741 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 94de0d5f-4b0b-46ed-b413-113def4ab7df details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:31:29.463372 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5f4fab0-f8c4-42db-9281-bfe90bd4194f req-6d9de9c6-00d7-43f1-a71c-1f6057237243 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:29.465139 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5f4fab0-f8c4-42db-9281-bfe90bd4194f req-6d9de9c6-00d7-43f1-a71c-1f6057237243 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 944 time: 0.0617352 Dec 09 21:31:29.466123 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b07aeaa7-ed07-41ed-94df-75a96037e5ba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:29.478587 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b07aeaa7-ed07-41ed-94df-75a96037e5ba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:29.486360 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b07aeaa7-ed07-41ed-94df-75a96037e5ba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:29.493393 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b07aeaa7-ed07-41ed-94df-75a96037e5ba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:29.501270 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b07aeaa7-ed07-41ed-94df-75a96037e5ba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] 10.222.0.13 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2407 time: 0.3030350 Dec 09 21:31:29.501270 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45648) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:29.532092 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5f4fab0-f8c4-42db-9281-bfe90bd4194f req-9603c7c5-50d4-46f0-8b3f-d7ce1629d5ea tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0599225 Dec 09 21:31:29.607072 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70bac93b-4ca3-45b2-9c3a-7c57239bc2ae tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:29.636855 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5b3cb16-e3a0-42ec-be63-d05ad0df7c41 req-307c593c-3b90-4f92-bb80-35aaf680854c tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:29.638274 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5b3cb16-e3a0-42ec-be63-d05ad0df7c41 req-307c593c-3b90-4f92-bb80-35aaf680854c tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.0515356 Dec 09 21:31:29.690059 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5b3cb16-e3a0-42ec-be63-d05ad0df7c41 req-99e7c2d0-905c-4040-9f70-2b30249b46a4 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428836 Dec 09 21:31:29.695930 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70bac93b-4ca3-45b2-9c3a-7c57239bc2ae tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:29.715700 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-70bac93b-4ca3-45b2-9c3a-7c57239bc2ae tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cfa17e4c-fb21-44b1-9de4-db2ae13d9ec2']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:29.725250 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-70bac93b-4ca3-45b2-9c3a-7c57239bc2ae tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a3e68eac-d877-48d3-95d8-d35f39262553') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:29.725543 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-70bac93b-4ca3-45b2-9c3a-7c57239bc2ae tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a3e68eac-d877-48d3-95d8-d35f39262553') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:29.734905 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70bac93b-4ca3-45b2-9c3a-7c57239bc2ae tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:29.747916 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70bac93b-4ca3-45b2-9c3a-7c57239bc2ae tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:29.753686 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-70bac93b-4ca3-45b2-9c3a-7c57239bc2ae tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Releasing vlan 128 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:31:29.754063 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70bac93b-4ca3-45b2-9c3a-7c57239bc2ae tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:31:29.757079 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:31:29.818506 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70bac93b-4ca3-45b2-9c3a-7c57239bc2ae tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:29.829905 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70bac93b-4ca3-45b2-9c3a-7c57239bc2ae tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:29.833110 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-70bac93b-4ca3-45b2-9c3a-7c57239bc2ae tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] 10.222.0.13 "DELETE /v2.0/networks/cfa17e4c-fb21-44b1-9de4-db2ae13d9ec2 HTTP/1.1" status: 204 len: 168 time: 0.3327465 Dec 09 21:31:29.836093 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45654) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:29.845516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70bac93b-4ca3-45b2-9c3a-7c57239bc2ae tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Pushing event deleted for resources: {'Network': ['ID=cfa17e4c-fb21-44b1-9de4-db2ae13d9ec2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:29.917340 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e95e69b1-133b-4f9a-8bf4-e6f03cee63af tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:30.009522 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e95e69b1-133b-4f9a-8bf4-e6f03cee63af tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:30.031036 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e95e69b1-133b-4f9a-8bf4-e6f03cee63af tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['94de0d5f-4b0b-46ed-b413-113def4ab7df']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:30.040956 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e95e69b1-133b-4f9a-8bf4-e6f03cee63af tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3f83fe24-4387-43f9-a770-4ce79cf8cff3') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:30.041256 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e95e69b1-133b-4f9a-8bf4-e6f03cee63af tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3f83fe24-4387-43f9-a770-4ce79cf8cff3') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:30.051108 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e95e69b1-133b-4f9a-8bf4-e6f03cee63af tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:30.064438 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e95e69b1-133b-4f9a-8bf4-e6f03cee63af tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:30.070399 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e95e69b1-133b-4f9a-8bf4-e6f03cee63af tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Releasing vlan 146 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:31:30.070804 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e95e69b1-133b-4f9a-8bf4-e6f03cee63af tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:31:30.073860 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:31:30.138139 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e95e69b1-133b-4f9a-8bf4-e6f03cee63af tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:30.146454 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e95e69b1-133b-4f9a-8bf4-e6f03cee63af tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:30.149403 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e95e69b1-133b-4f9a-8bf4-e6f03cee63af tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] 10.222.0.13 "DELETE /v2.0/networks/94de0d5f-4b0b-46ed-b413-113def4ab7df HTTP/1.1" status: 204 len: 168 time: 0.3122861 Dec 09 21:31:30.152169 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45660) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:30.160501 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e95e69b1-133b-4f9a-8bf4-e6f03cee63af tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Pushing event deleted for resources: {'Network': ['ID=94de0d5f-4b0b-46ed-b413-113def4ab7df,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:30.265714 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f9b5b6e-b29d-409a-93db-827f1457d99e tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:30.271648 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f9b5b6e-b29d-409a-93db-827f1457d99e tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:30.273559 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1f9b5b6e-b29d-409a-93db-827f1457d99e tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] 10.222.0.13 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1339 time: 0.1202707 Dec 09 21:31:30.277521 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45662) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:30.283039 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-7d28108c-af53-489b-9470-ffa09083f191 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-1268362663'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:30.307367 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7d28108c-af53-489b-9470-ffa09083f191 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Made reservation on behalf of 771151d2362842e3a098655197de55d7 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:31:30.310977 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7d28108c-af53-489b-9470-ffa09083f191 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:30.336419 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7d28108c-af53-489b-9470-ffa09083f191 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] vlan segment allocate from pool success with {'vlan_id': 135, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:31:30.345857 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7d28108c-af53-489b-9470-ffa09083f191 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:30.346158 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-7d28108c-af53-489b-9470-ffa09083f191 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Added segment 8d1896da-f627-440a-93c9-8aabbd46cd62 of type vlan for network 77afc054-caf7-47af-b1fc-536f508776b3 Dec 09 21:31:30.385105 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7d28108c-af53-489b-9470-ffa09083f191 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:30.415731 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7d28108c-af53-489b-9470-ffa09083f191 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:30.421671 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7d28108c-af53-489b-9470-ffa09083f191 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:30.422383 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7d28108c-af53-489b-9470-ffa09083f191 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:30.456705 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7d28108c-af53-489b-9470-ffa09083f191 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.1780016 Dec 09 21:31:30.459383 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45664) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:30.466239 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-4283a408-768e-4e86-96d8-f27b906aa7e7 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-1402693840'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:30.503135 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d28108c-af53-489b-9470-ffa09083f191 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Pushing event updated for resources: {'Network': ['ID=77afc054-caf7-47af-b1fc-536f508776b3,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:30.514057 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 77afc054-caf7-47af-b1fc-536f508776b3 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:31:30.518223 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4283a408-768e-4e86-96d8-f27b906aa7e7 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Made reservation on behalf of 771151d2362842e3a098655197de55d7 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:31:30.521787 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4283a408-768e-4e86-96d8-f27b906aa7e7 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:30.547039 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4283a408-768e-4e86-96d8-f27b906aa7e7 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] vlan segment allocate from pool success with {'vlan_id': 138, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:31:30.556668 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4283a408-768e-4e86-96d8-f27b906aa7e7 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:30.557063 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-4283a408-768e-4e86-96d8-f27b906aa7e7 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Added segment a8f64cee-8bbd-4667-8a0c-7c8629b57b3f of type vlan for network 9e0e97b5-52d2-411f-9d84-3b59769de56d Dec 09 21:31:30.602514 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4283a408-768e-4e86-96d8-f27b906aa7e7 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:30.654781 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4283a408-768e-4e86-96d8-f27b906aa7e7 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:30.660575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4283a408-768e-4e86-96d8-f27b906aa7e7 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:30.661179 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4283a408-768e-4e86-96d8-f27b906aa7e7 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:30.700647 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b480ff15-258d-43bd-96ce-f9e17f9f4fae req-4d0df771-9e27-4bda-8c98-d7c6686cfb65 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:30.702225 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b480ff15-258d-43bd-96ce-f9e17f9f4fae req-4d0df771-9e27-4bda-8c98-d7c6686cfb65 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 944 time: 0.0959301 Dec 09 21:31:30.722447 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4283a408-768e-4e86-96d8-f27b906aa7e7 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.2591736 Dec 09 21:31:30.723234 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45674) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:30.731915 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Request body: {'ports': [{'network_id': '77afc054-caf7-47af-b1fc-536f508776b3', 'name': 'tempest-port--1847505123', 'admin_state_up': True}, {'network_id': '9e0e97b5-52d2-411f-9d84-3b59769de56d', 'admin_state_up': False}]} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:30.732223 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Request body: {'port': {'network_id': '77afc054-caf7-47af-b1fc-536f508776b3', 'name': 'tempest-port--1847505123', 'admin_state_up': True}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:30.732725 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Request body: {'port': {'network_id': '9e0e97b5-52d2-411f-9d84-3b59769de56d', 'admin_state_up': False}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:30.785390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4283a408-768e-4e86-96d8-f27b906aa7e7 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Pushing event updated for resources: {'Network': ['ID=9e0e97b5-52d2-411f-9d84-3b59769de56d,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:30.799709 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 9e0e97b5-52d2-411f-9d84-3b59769de56d details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:31:30.896726 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b480ff15-258d-43bd-96ce-f9e17f9f4fae req-620eaaab-1525-43d1-b223-cff029265bf7 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1845088 Dec 09 21:31:30.934203 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-320267cf-0879-466c-a09b-7c996da9fb7c req-cbb07f13-694d-4765-9c7d-abb7ab4c4dc1 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:30.935737 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-320267cf-0879-466c-a09b-7c996da9fb7c req-cbb07f13-694d-4765-9c7d-abb7ab4c4dc1 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.1690047 Dec 09 21:31:31.034214 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-320267cf-0879-466c-a09b-7c996da9fb7c req-59c58241-270d-4646-84c5-917e59be17a9 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/security-groups?id=25073bae-9c1b-4f21-941c-9dcae7db554c&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0730624 Dec 09 21:31:31.035563 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Made reservation on behalf of 771151d2362842e3a098655197de55d7 for: {'port': 2} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:31:31.040066 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:31.054940 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:31.135189 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] device_id is not set on port 94ec30a6-c9e6-4d38-892b-b8ff974b89e9 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:31:31.269367 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:31.335785 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] device_id is not set on port 19092998-1dcb-421e-ae77-cd4c55c8e3c2 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:31:31.450370 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:31.488717 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:31.543374 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Pushing event updated for resources: {'Port': ['ID=94ec30a6-c9e6-4d38-892b-b8ff974b89e9,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:31.559735 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Checking segment: {'id': '8d1896da-f627-440a-93c9-8aabbd46cd62', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '77afc054-caf7-47af-b1fc-536f508776b3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:31:31.560095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Network hostable DHCP agents. Network: 77afc054-caf7-47af-b1fc-536f508776b3, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:31:31.579380 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Network 77afc054-caf7-47af-b1fc-536f508776b3 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:31:31.589428 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 77afc054-caf7-47af-b1fc-536f508776b3) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:31.594046 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:31:31.594933 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:31.605106 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22b529c0-603e-4c39-aab2-d3c48b3e1061 None None] Network 77afc054-caf7-47af-b1fc-536f508776b3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:31:31.656405 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Pushing event updated for resources: {'Port': ['ID=19092998-1dcb-421e-ae77-cd4c55c8e3c2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:31.669761 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Checking segment: {'id': 'a8f64cee-8bbd-4667-8a0c-7c8629b57b3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '9e0e97b5-52d2-411f-9d84-3b59769de56d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:31:31.670140 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Network hostable DHCP agents. Network: 9e0e97b5-52d2-411f-9d84-3b59769de56d, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:31:31.692161 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Network 9e0e97b5-52d2-411f-9d84-3b59769de56d is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:31:31.703123 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 9e0e97b5-52d2-411f-9d84-3b59769de56d) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:31.707243 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:31:31.712307 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb610c3c-714e-4c7b-9d23-93fa01506e0b None None] Network 9e0e97b5-52d2-411f-9d84-3b59769de56d requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:31:31.713679 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:31.719069 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:31.728632 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:31.752946 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-76bf44c0-6127-430b-9c72-f3914a3cb3d9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1450 time: 1.0245512 Dec 09 21:31:31.755691 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45686) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:31.776750 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83d45cec-fc77-444c-90df-e55ae769fe69 req-7008a1ed-81e6-419f-9c05-eb915ed29891 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:31.778475 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-83d45cec-fc77-444c-90df-e55ae769fe69 req-7008a1ed-81e6-419f-9c05-eb915ed29891 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.10 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 945 time: 0.0953171 Dec 09 21:31:31.882554 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4dc7f89-764d-49a6-b7dc-ba31db2d2f92 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:31.888394 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4dc7f89-764d-49a6-b7dc-ba31db2d2f92 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:31.891784 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e4dc7f89-764d-49a6-b7dc-ba31db2d2f92 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1445 time: 0.1329935 Dec 09 21:31:31.893274 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45688) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:31.921947 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-83d45cec-fc77-444c-90df-e55ae769fe69 req-73967452-5b82-48c7-ad84-c075319f5e2f tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Deleting port 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:31:31.922278 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-83d45cec-fc77-444c-90df-e55ae769fe69 req-73967452-5b82-48c7-ad84-c075319f5e2f tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:32.018186 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-ee9bf1c1-3fb0-430a-bc0a-72d4bc4dac6f tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Deleting port 94ec30a6-c9e6-4d38-892b-b8ff974b89e9 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:31:32.018791 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee9bf1c1-3fb0-430a-bc0a-72d4bc4dac6f tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:32.025810 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-83d45cec-fc77-444c-90df-e55ae769fe69 req-73967452-5b82-48c7-ad84-c075319f5e2f tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] For port 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3d9c176b-4d74-466f-b7bd-8d44eae4a3f2,segment=NetworkSegment(758500a8-fda8-49cf-a84c-a7e78098b9e8),segment_id=758500a8-fda8-49cf-a84c-a7e78098b9e8)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:31:32.026168 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-83d45cec-fc77-444c-90df-e55ae769fe69 req-73967452-5b82-48c7-ad84-c075319f5e2f tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:32.041490 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-83d45cec-fc77-444c-90df-e55ae769fe69 req-73967452-5b82-48c7-ad84-c075319f5e2f tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Calling delete_port for 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:31:32.093150 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3814002-c670-4e25-9d07-5d13a96e5adf req-81fc778e-6516-4806-9622-a88b740dd275 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:32.094688 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b3814002-c670-4e25-9d07-5d13a96e5adf req-81fc778e-6516-4806-9622-a88b740dd275 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 944 time: 0.1192033 Dec 09 21:31:32.104760 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee9bf1c1-3fb0-430a-bc0a-72d4bc4dac6f tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:32.129491 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-ee9bf1c1-3fb0-430a-bc0a-72d4bc4dac6f tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Calling delete_port for 94ec30a6-c9e6-4d38-892b-b8ff974b89e9 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:31:32.181211 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-83d45cec-fc77-444c-90df-e55ae769fe69 req-73967452-5b82-48c7-ad84-c075319f5e2f tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:32.192963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['3d9c176b-4d74-466f-b7bd-8d44eae4a3f2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:31:32.204257 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b3814002-c670-4e25-9d07-5d13a96e5adf req-6528b317-e4d3-47b8-890c-0245faf69bb0 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1020534 Dec 09 21:31:32.220812 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73967452-5b82-48c7-ad84-c075319f5e2f tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Pushing event deleted for resources: {'Port': ['ID=3d9c176b-4d74-466f-b7bd-8d44eae4a3f2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:32.226183 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a57ae5bc-a0fd-48b4-b20c-60bed1e15b7e req-b30b6a74-c184-4666-8819-7f5fca6318b3 tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.13 "GET /v2.0/ports?device_id=16ff2943-c2d6-4af7-9bbd-52443fde3d6e HTTP/1.1" status: 200 len: 210 time: 0.0677147 Dec 09 21:31:32.264543 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee9bf1c1-3fb0-430a-bc0a-72d4bc4dac6f tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:32.279254 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-83d45cec-fc77-444c-90df-e55ae769fe69 req-73967452-5b82-48c7-ad84-c075319f5e2f tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] No DVR routers for this DVR port 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:31:32.282750 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-83d45cec-fc77-444c-90df-e55ae769fe69 req-73967452-5b82-48c7-ad84-c075319f5e2f tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:32.286856 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-83d45cec-fc77-444c-90df-e55ae769fe69 req-73967452-5b82-48c7-ad84-c075319f5e2f tempest-ServerRescueTestJSONUnderV235-333812296 tempest-ServerRescueTestJSONUnderV235-333812296-project] 10.222.0.10 "DELETE /v2.0/ports/3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 HTTP/1.1" status: 204 len: 173 time: 0.4865792 Dec 09 21:31:32.287320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '16ff2943-c2d6-4af7-9bbd-52443fde3d6e', 'name': 'network-vif-deleted', 'tag': '3d9c176b-4d74-466f-b7bd-8d44eae4a3f2'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:31:32.290233 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4f2ca9c0-4abc-42c9-8bbb-973d41b62cef" -d '{"events": [{"server_uuid": "16ff2943-c2d6-4af7-9bbd-52443fde3d6e", "name": "network-vif-deleted", "tag": "3d9c176b-4d74-466f-b7bd-8d44eae4a3f2"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:31:32.303501 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee9bf1c1-3fb0-430a-bc0a-72d4bc4dac6f tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:32.312846 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45702) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:32.316004 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ee9bf1c1-3fb0-430a-bc0a-72d4bc4dac6f tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] 10.222.0.13 "DELETE /v2.0/ports/94ec30a6-c9e6-4d38-892b-b8ff974b89e9 HTTP/1.1" status: 204 len: 168 time: 0.4214885 Dec 09 21:31:32.317308 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee9bf1c1-3fb0-430a-bc0a-72d4bc4dac6f tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Pushing event deleted for resources: {'Port': ['ID=94ec30a6-c9e6-4d38-892b-b8ff974b89e9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:32.344771 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:31:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cdbd7024-bb51-476d-93d0-901b2d22dfd0 x-openstack-request-id: req-cdbd7024-bb51-476d-93d0-901b2d22dfd0 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:31:32.345042 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "16ff2943-c2d6-4af7-9bbd-52443fde3d6e", "name": "network-vif-deleted", "tag": "3d9c176b-4d74-466f-b7bd-8d44eae4a3f2", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:31:32.345293 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-cdbd7024-bb51-476d-93d0-901b2d22dfd0 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:31:32.345691 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '16ff2943-c2d6-4af7-9bbd-52443fde3d6e', 'name': 'network-vif-deleted', 'tag': '3d9c176b-4d74-466f-b7bd-8d44eae4a3f2', 'status': 'completed', 'code': 200} Dec 09 21:31:32.412296 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-365959d2-c4b4-4f98-964f-ab66a18aecd8 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Deleting port 19092998-1dcb-421e-ae77-cd4c55c8e3c2 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:31:32.412644 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-365959d2-c4b4-4f98-964f-ab66a18aecd8 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:32.484516 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-365959d2-c4b4-4f98-964f-ab66a18aecd8 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:32.496897 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-365959d2-c4b4-4f98-964f-ab66a18aecd8 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Calling delete_port for 19092998-1dcb-421e-ae77-cd4c55c8e3c2 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:31:32.576805 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-365959d2-c4b4-4f98-964f-ab66a18aecd8 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:32.910120 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-365959d2-c4b4-4f98-964f-ab66a18aecd8 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Pushing event deleted for resources: {'Port': ['ID=19092998-1dcb-421e-ae77-cd4c55c8e3c2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:32.915645 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-365959d2-c4b4-4f98-964f-ab66a18aecd8 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:32.918717 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-365959d2-c4b4-4f98-964f-ab66a18aecd8 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] 10.222.0.13 "DELETE /v2.0/ports/19092998-1dcb-421e-ae77-cd4c55c8e3c2 HTTP/1.1" status: 204 len: 168 time: 0.6057944 Dec 09 21:31:32.921628 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45708) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:32.946441 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e4ba00e8-973c-40b6-9d0c-03cf9a517526 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:32.949356 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ee8de47f-24a9-4cd2-bbac-c0fd0ebacf72 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0266194 Dec 09 21:31:32.953042 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45710) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:32.957941 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-39cde204-d093-4d53-8c21-6a958dd70c51 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-1627754125'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:32.978109 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-39cde204-d093-4d53-8c21-6a958dd70c51 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Made reservation on behalf of 771151d2362842e3a098655197de55d7 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:31:32.981467 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-39cde204-d093-4d53-8c21-6a958dd70c51 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:33.004015 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-39cde204-d093-4d53-8c21-6a958dd70c51 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] vlan segment allocate from pool success with {'vlan_id': 109, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:31:33.013904 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-39cde204-d093-4d53-8c21-6a958dd70c51 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:33.014381 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-39cde204-d093-4d53-8c21-6a958dd70c51 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Added segment 132940ba-ef1e-481b-86fe-e6023fa3f311 of type vlan for network 3a5e2e27-340e-4866-88a0-186f52ebef29 Dec 09 21:31:33.059417 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-39cde204-d093-4d53-8c21-6a958dd70c51 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:33.087308 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-39cde204-d093-4d53-8c21-6a958dd70c51 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:33.093370 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39cde204-d093-4d53-8c21-6a958dd70c51 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:33.094115 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-39cde204-d093-4d53-8c21-6a958dd70c51 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:33.123997 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-39cde204-d093-4d53-8c21-6a958dd70c51 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.1698790 Dec 09 21:31:33.127023 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45716) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:33.132943 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-dd9d0ab7-3a36-4651-8c9c-31ff161450a9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsTest-test-network-1646100003'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:33.158424 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dd9d0ab7-3a36-4651-8c9c-31ff161450a9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Made reservation on behalf of 771151d2362842e3a098655197de55d7 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:31:33.162702 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dd9d0ab7-3a36-4651-8c9c-31ff161450a9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:33.174758 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39cde204-d093-4d53-8c21-6a958dd70c51 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Pushing event updated for resources: {'Network': ['ID=3a5e2e27-340e-4866-88a0-186f52ebef29,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:33.190732 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 3a5e2e27-340e-4866-88a0-186f52ebef29 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:31:33.191131 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dd9d0ab7-3a36-4651-8c9c-31ff161450a9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] vlan segment allocate from pool success with {'vlan_id': 119, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:31:33.200040 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dd9d0ab7-3a36-4651-8c9c-31ff161450a9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:33.200387 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-dd9d0ab7-3a36-4651-8c9c-31ff161450a9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Added segment 856a0d6c-84e0-488d-a35a-cfb4151a030f of type vlan for network ca6ec313-6147-44eb-8b12-e4411bb9b48c Dec 09 21:31:33.243736 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dd9d0ab7-3a36-4651-8c9c-31ff161450a9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:33.278875 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dd9d0ab7-3a36-4651-8c9c-31ff161450a9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:33.286227 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dd9d0ab7-3a36-4651-8c9c-31ff161450a9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:33.286977 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dd9d0ab7-3a36-4651-8c9c-31ff161450a9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:33.293975 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45722) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:33.362100 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-dd9d0ab7-3a36-4651-8c9c-31ff161450a9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.2335308 Dec 09 21:31:33.404717 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd9d0ab7-3a36-4651-8c9c-31ff161450a9 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Pushing event updated for resources: {'Network': ['ID=ca6ec313-6147-44eb-8b12-e4411bb9b48c,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:33.418461 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network ca6ec313-6147-44eb-8b12-e4411bb9b48c details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:31:33.419001 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a28d5f95-a29d-4d42-95e3-5af398d7ffaf req-85649351-0cce-4afd-8d27-6e6aa2493b60 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:33.426710 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a28d5f95-a29d-4d42-95e3-5af398d7ffaf req-85649351-0cce-4afd-8d27-6e6aa2493b60 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 944 time: 0.1135597 Dec 09 21:31:33.481691 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a28d5f95-a29d-4d42-95e3-5af398d7ffaf req-1922e801-a467-4d54-9361-6e7b91c3eb0e tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0490615 Dec 09 21:31:33.496209 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45726) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:33.501795 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-406034db-4991-48c2-bde5-4257b31d277d tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Request body: {'subnets': [{'network_id': '3a5e2e27-340e-4866-88a0-186f52ebef29', 'cidr': '172.20.0.0/28', 'name': 'tempest-subnet--1512591955', 'ip_version': 4}, {'network_id': 'ca6ec313-6147-44eb-8b12-e4411bb9b48c', 'cidr': '172.20.0.16/28', 'ip_version': 4}]} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:33.502113 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-406034db-4991-48c2-bde5-4257b31d277d tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Request body: {'subnet': {'network_id': '3a5e2e27-340e-4866-88a0-186f52ebef29', 'cidr': '172.20.0.0/28', 'name': 'tempest-subnet--1512591955', 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:33.502700 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-406034db-4991-48c2-bde5-4257b31d277d tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Request body: {'subnet': {'network_id': 'ca6ec313-6147-44eb-8b12-e4411bb9b48c', 'cidr': '172.20.0.16/28', 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:33.662406 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-406034db-4991-48c2-bde5-4257b31d277d tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Made reservation on behalf of 771151d2362842e3a098655197de55d7 for: {'subnet': 2} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:31:33.667093 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-406034db-4991-48c2-bde5-4257b31d277d tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:33.667459 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-406034db-4991-48c2-bde5-4257b31d277d tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:33.672197 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee277219-9875-4e9a-8eee-27d2e652b9c8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:33.921273 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-ee277219-9875-4e9a-8eee-27d2e652b9c8 admin admin] Deleting port a593c11a-9955-487b-871c-d87440b7d7f6 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:31:33.921982 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee277219-9875-4e9a-8eee-27d2e652b9c8 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:34.010188 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-ee277219-9875-4e9a-8eee-27d2e652b9c8 admin admin] For port a593c11a-9955-487b-871c-d87440b7d7f6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a593c11a-9955-487b-871c-d87440b7d7f6,segment=NetworkSegment(758500a8-fda8-49cf-a84c-a7e78098b9e8),segment_id=758500a8-fda8-49cf-a84c-a7e78098b9e8)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:31:34.010559 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee277219-9875-4e9a-8eee-27d2e652b9c8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:34.026320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-ee277219-9875-4e9a-8eee-27d2e652b9c8 admin admin] Calling delete_port for a593c11a-9955-487b-871c-d87440b7d7f6 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:31:34.220091 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee277219-9875-4e9a-8eee-27d2e652b9c8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:34.247661 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee277219-9875-4e9a-8eee-27d2e652b9c8 admin admin] Pushing event deleted for resources: {'Port': ['ID=a593c11a-9955-487b-871c-d87440b7d7f6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:34.369008 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-406034db-4991-48c2-bde5-4257b31d277d tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:34.417966 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee277219-9875-4e9a-8eee-27d2e652b9c8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:34.424730 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-406034db-4991-48c2-bde5-4257b31d277d tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Pushing event updated for resources: {'Subnet': ['ID=3ea723bc-da24-4557-b33c-1252949d92ec,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:34.443101 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-406034db-4991-48c2-bde5-4257b31d277d tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Checking segment: {'id': '132940ba-ef1e-481b-86fe-e6023fa3f311', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '3a5e2e27-340e-4866-88a0-186f52ebef29'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:31:34.443476 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-406034db-4991-48c2-bde5-4257b31d277d tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Network hostable DHCP agents. Network: 3a5e2e27-340e-4866-88a0-186f52ebef29, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:31:34.464783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-406034db-4991-48c2-bde5-4257b31d277d tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Network 3a5e2e27-340e-4866-88a0-186f52ebef29 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:31:34.476738 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-406034db-4991-48c2-bde5-4257b31d277d tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 3a5e2e27-340e-4866-88a0-186f52ebef29) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:34.480797 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-406034db-4991-48c2-bde5-4257b31d277d tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:34.492058 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c3487f2-9be6-4620-adba-a73532b681c2 None None] Network 3a5e2e27-340e-4866-88a0-186f52ebef29 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:31:34.548478 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-406034db-4991-48c2-bde5-4257b31d277d tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Pushing event updated for resources: {'Subnet': ['ID=9d1e5e0c-e6af-47ff-8db2-2ff4f6e483e4,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:34.557760 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-406034db-4991-48c2-bde5-4257b31d277d tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Checking segment: {'id': '856a0d6c-84e0-488d-a35a-cfb4151a030f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'ca6ec313-6147-44eb-8b12-e4411bb9b48c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:31:34.558123 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-406034db-4991-48c2-bde5-4257b31d277d tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Network hostable DHCP agents. Network: ca6ec313-6147-44eb-8b12-e4411bb9b48c, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:31:34.579161 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-406034db-4991-48c2-bde5-4257b31d277d tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Network ca6ec313-6147-44eb-8b12-e4411bb9b48c is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:31:34.596235 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-406034db-4991-48c2-bde5-4257b31d277d tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, ca6ec313-6147-44eb-8b12-e4411bb9b48c) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:34.601516 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-406034db-4991-48c2-bde5-4257b31d277d tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:34.602136 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-406034db-4991-48c2-bde5-4257b31d277d tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:34.602842 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-406034db-4991-48c2-bde5-4257b31d277d tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:34.609516 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6232f33-e52d-468d-b4a5-1989c692a4ec None None] Network ca6ec313-6147-44eb-8b12-e4411bb9b48c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:31:34.650422 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-406034db-4991-48c2-bde5-4257b31d277d tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 1426 time: 1.1530647 Dec 09 21:31:34.653234 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45740) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:34.693364 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ee277219-9875-4e9a-8eee-27d2e652b9c8 admin admin] Router 16dbc747-be19-40bc-8996-b5aa5410163c has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:31:34.706655 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0be2434-9aad-402a-b5a7-28f8b95f92ca req-70f8fca2-5c67-4f9e-b2c9-bcd3093c45df tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:34.708286 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b0be2434-9aad-402a-b5a7-28f8b95f92ca req-70f8fca2-5c67-4f9e-b2c9-bcd3093c45df tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 944 time: 0.1023605 Dec 09 21:31:34.711905 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0cf2705d-9e7d-40e3-bae7-489a817026e2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-3a5e2e27-340e-4866-88a0-186f52ebef29', 'network_id': '3a5e2e27-340e-4866-88a0-186f52ebef29', 'project_id': '771151d2362842e3a098655197de55d7', 'fixed_ips': [{'subnet_id': '3ea723bc-da24-4557-b33c-1252949d92ec'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:31:34.712892 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0cf2705d-9e7d-40e3-bae7-489a817026e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:34.779115 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c37bc83-f377-410c-8109-949fbaba0cce tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:34.780800 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c37bc83-f377-410c-8109-949fbaba0cce tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:34.782394 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c37bc83-f377-410c-8109-949fbaba0cce tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:34.787324 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7c37bc83-f377-410c-8109-949fbaba0cce tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2052 time: 0.1329660 Dec 09 21:31:34.793125 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45742) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:34.826389 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c0b8fc89-dc82-4102-bd27-29e96a243450 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-ca6ec313-6147-44eb-8b12-e4411bb9b48c', 'network_id': 'ca6ec313-6147-44eb-8b12-e4411bb9b48c', 'project_id': '771151d2362842e3a098655197de55d7', 'fixed_ips': [{'subnet_id': '9d1e5e0c-e6af-47ff-8db2-2ff4f6e483e4'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:31:34.827246 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c0b8fc89-dc82-4102-bd27-29e96a243450 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:34.843690 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b0be2434-9aad-402a-b5a7-28f8b95f92ca req-71358619-04e6-4c03-948b-5f44cb8eb443 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1282709 Dec 09 21:31:34.845023 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ee277219-9875-4e9a-8eee-27d2e652b9c8 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:31:34.854573 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ee277219-9875-4e9a-8eee-27d2e652b9c8 admin admin] 10.222.0.13 "PUT /v2.0/routers/16dbc747-be19-40bc-8996-b5aa5410163c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5569048 Dec 09 21:31:34.854987 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45744) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:34.861050 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-98285eb3-a643-43ae-ac10-23e53e128af1 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Deleting subnet 3ea723bc-da24-4557-b33c-1252949d92ec {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:31:34.865705 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-98285eb3-a643-43ae-ac10-23e53e128af1 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:34.876246 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-546c7cc2-298d-487f-99fb-ce5fb713ba21 None None] Sync routers for ids ['16dbc747-be19-40bc-8996-b5aa5410163c'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:31:34.903803 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-546c7cc2-298d-487f-99fb-ce5fb713ba21 None None] Routers {'16dbc747-be19-40bc-8996-b5aa5410163c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:31:34.904481 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-546c7cc2-298d-487f-99fb-ce5fb713ba21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 10, "extensions": [], "floating_ips": 6, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:31:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['16dbc747-be19-40bc-8996-b5aa5410163c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:34.919323 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-98285eb3-a643-43ae-ac10-23e53e128af1 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:34.988174 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-98285eb3-a643-43ae-ac10-23e53e128af1 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:35.010066 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8ec5299-ac0d-46d8-81f0-24b189442fd0 admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:35.065577 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-98285eb3-a643-43ae-ac10-23e53e128af1 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:35.088776 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-98285eb3-a643-43ae-ac10-23e53e128af1 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:35.092555 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-98285eb3-a643-43ae-ac10-23e53e128af1 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] 10.222.0.13 "DELETE /v2.0/subnets/3ea723bc-da24-4557-b33c-1252949d92ec HTTP/1.1" status: 204 len: 168 time: 0.2984173 Dec 09 21:31:35.115031 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45750) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:35.124734 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98285eb3-a643-43ae-ac10-23e53e128af1 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Pushing event deleted for resources: {'Subnet': ['ID=3ea723bc-da24-4557-b33c-1252949d92ec,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server [None req-0cf2705d-9e7d-40e3-bae7-489a817026e2 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 3ea723bc-da24-4557-b33c-1252949d92ec: This subnet is being modified by another concurrent operation. Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 306, in create_dhcp_port Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:31:35.127612 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1485, in create_port Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1450, in _create_port_db Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1460, in create_port_db Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnet.lock_register( Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise exception Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 3ea723bc-da24-4557-b33c-1252949d92ec: This subnet is being modified by another concurrent operation. Dec 09 21:31:35.132874 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Dec 09 21:31:35.146994 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-546c7cc2-298d-487f-99fb-ce5fb713ba21 None None] Set router 16dbc747-be19-40bc-8996-b5aa5410163c gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:31:35.190247 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18814215-07c5-4115-ae4a-f6c2b739caf2 None None] Network 3a5e2e27-340e-4866-88a0-186f52ebef29 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:31:35.190384 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8ec5299-ac0d-46d8-81f0-24b189442fd0 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:35.261147 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-c561be78-75b3-477b-bdd1-f874223f7e5c tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Deleting subnet 9d1e5e0c-e6af-47ff-8db2-2ff4f6e483e4 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:31:35.284637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-c0b8fc89-dc82-4102-bd27-29e96a243450 None None] Allocated IP 172.20.0.18 (ca6ec313-6147-44eb-8b12-e4411bb9b48c/9d1e5e0c-e6af-47ff-8db2-2ff4f6e483e4/7d2984a9-8dc4-4275-9c11-378cce6a89f3) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:31:35.341338 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c8ec5299-ac0d-46d8-81f0-24b189442fd0 admin admin] Deleting port e830112e-9e99-483b-b004-4f2061144a6c {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:31:35.347199 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8ec5299-ac0d-46d8-81f0-24b189442fd0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:35.373965 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-546c7cc2-298d-487f-99fb-ce5fb713ba21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'name': 'tempest-ServerRescueTestJSONUnderV235-1609818858-router', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208'}], 'enable_snat': True}, 'gw_port_id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:14Z', 'updated_at': '2021-12-09T21:31:34Z', 'revision_number': 5, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'gw_port': {'id': 'e830112e-9e99-483b-b004-4f2061144a6c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:fa:55:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1351, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.208', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:15Z', 'updated_at': '2021-12-09T21:30:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:35.401943 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-546c7cc2-298d-487f-99fb-ce5fb713ba21 None None] Checking router: 16dbc747-be19-40bc-8996-b5aa5410163c for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:31:35.410610 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-546c7cc2-298d-487f-99fb-ce5fb713ba21 None None] Routers {'16dbc747-be19-40bc-8996-b5aa5410163c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:31:35.411226 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-546c7cc2-298d-487f-99fb-ce5fb713ba21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 10, "extensions": [], "floating_ips": 6, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:31:05Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['16dbc747-be19-40bc-8996-b5aa5410163c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:35.438759 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-c8ec5299-ac0d-46d8-81f0-24b189442fd0 admin admin] For port e830112e-9e99-483b-b004-4f2061144a6c, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e830112e-9e99-483b-b004-4f2061144a6c,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:31:35.439122 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8ec5299-ac0d-46d8-81f0-24b189442fd0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:35.453665 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c8ec5299-ac0d-46d8-81f0-24b189442fd0 admin admin] Calling delete_port for e830112e-9e99-483b-b004-4f2061144a6c owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:31:35.470308 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c0b8fc89-dc82-4102-bd27-29e96a243450 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:35.478077 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c561be78-75b3-477b-bdd1-f874223f7e5c tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:35.479233 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c0b8fc89-dc82-4102-bd27-29e96a243450 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:35.504676 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-546c7cc2-298d-487f-99fb-ce5fb713ba21 None None] Set router 16dbc747-be19-40bc-8996-b5aa5410163c gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:31:35.536145 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c561be78-75b3-477b-bdd1-f874223f7e5c tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:35.539705 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0b8fc89-dc82-4102-bd27-29e96a243450 None None] Network ca6ec313-6147-44eb-8b12-e4411bb9b48c is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:31:35.551761 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-c0b8fc89-dc82-4102-bd27-29e96a243450 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:35.554215 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5123ca34-44e9-48e2-96db-f899de1759a5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:35.562549 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c0b8fc89-dc82-4102-bd27-29e96a243450 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:31:35.565866 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-546c7cc2-298d-487f-99fb-ce5fb713ba21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'name': 'tempest-ServerRescueTestJSONUnderV235-1609818858-router', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:14Z', 'updated_at': '2021-12-09T21:31:35Z', 'revision_number': 6, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:35.595705 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-546c7cc2-298d-487f-99fb-ce5fb713ba21 None None] The sync data for ids ['16dbc747-be19-40bc-8996-b5aa5410163c'] in n-d-713301-27 is: [{'id': '16dbc747-be19-40bc-8996-b5aa5410163c', 'name': 'tempest-ServerRescueTestJSONUnderV235-1609818858-router', 'tenant_id': '0f8295f4c3534e24a63938170ba2425e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:14Z', 'updated_at': '2021-12-09T21:31:35Z', 'revision_number': 6, 'project_id': '0f8295f4c3534e24a63938170ba2425e', 'gw_port_host': None}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:31:35.604284 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0b8fc89-dc82-4102-bd27-29e96a243450 None None] Pushing event updated for resources: {'Port': ['ID=7d2984a9-8dc4-4275-9c11-378cce6a89f3,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:35.638124 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-c0b8fc89-dc82-4102-bd27-29e96a243450 None None] Attempting to bind port 7d2984a9-8dc4-4275-9c11-378cce6a89f3 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:31:35.638506 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-c0b8fc89-dc82-4102-bd27-29e96a243450 None None] Attempting to bind port 7d2984a9-8dc4-4275-9c11-378cce6a89f3 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '856a0d6c-84e0-488d-a35a-cfb4151a030f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'ca6ec313-6147-44eb-8b12-e4411bb9b48c'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:31:35.638878 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0b8fc89-dc82-4102-bd27-29e96a243450 None None] Attempting to bind port 7d2984a9-8dc4-4275-9c11-378cce6a89f3 on network ca6ec313-6147-44eb-8b12-e4411bb9b48c {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:31:35.647313 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0b8fc89-dc82-4102-bd27-29e96a243450 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 31, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:31:35.648054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0b8fc89-dc82-4102-bd27-29e96a243450 None None] Checking segment: {'id': '856a0d6c-84e0-488d-a35a-cfb4151a030f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'ca6ec313-6147-44eb-8b12-e4411bb9b48c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:31:35.648467 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c0b8fc89-dc82-4102-bd27-29e96a243450 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:35.648878 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0b8fc89-dc82-4102-bd27-29e96a243450 None None] Bound using segment: {'id': '856a0d6c-84e0-488d-a35a-cfb4151a030f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'ca6ec313-6147-44eb-8b12-e4411bb9b48c'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:31:35.649366 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-c0b8fc89-dc82-4102-bd27-29e96a243450 None None] Bound port: 7d2984a9-8dc4-4275-9c11-378cce6a89f3, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '856a0d6c-84e0-488d-a35a-cfb4151a030f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'ca6ec313-6147-44eb-8b12-e4411bb9b48c'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:31:35.649780 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c0b8fc89-dc82-4102-bd27-29e96a243450 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:35.670100 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c561be78-75b3-477b-bdd1-f874223f7e5c tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:35.718174 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8ec5299-ac0d-46d8-81f0-24b189442fd0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:35.735311 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c561be78-75b3-477b-bdd1-f874223f7e5c tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:35.737480 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c0b8fc89-dc82-4102-bd27-29e96a243450 None None] For port 7d2984a9-8dc4-4275-9c11-378cce6a89f3, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:31:35.740848 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c0b8fc89-dc82-4102-bd27-29e96a243450 None None] For port 7d2984a9-8dc4-4275-9c11-378cce6a89f3, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7d2984a9-8dc4-4275-9c11-378cce6a89f3,segment=NetworkSegment(856a0d6c-84e0-488d-a35a-cfb4151a030f),segment_id=856a0d6c-84e0-488d-a35a-cfb4151a030f)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:31:35.745555 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c0b8fc89-dc82-4102-bd27-29e96a243450 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:35.750391 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8ec5299-ac0d-46d8-81f0-24b189442fd0 admin admin] Pushing event deleted for resources: {'Port': ['ID=e830112e-9e99-483b-b004-4f2061144a6c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:35.765174 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c561be78-75b3-477b-bdd1-f874223f7e5c tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Pushing event deleted for resources: {'Subnet': ['ID=9d1e5e0c-e6af-47ff-8db2-2ff4f6e483e4,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:35.769213 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c561be78-75b3-477b-bdd1-f874223f7e5c tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:35.775570 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c561be78-75b3-477b-bdd1-f874223f7e5c tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] 10.222.0.13 "DELETE /v2.0/subnets/9d1e5e0c-e6af-47ff-8db2-2ff4f6e483e4 HTTP/1.1" status: 204 len: 168 time: 0.6565332 Dec 09 21:31:35.775758 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45758) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:35.811950 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0b8fc89-dc82-4102-bd27-29e96a243450 None None] Pushing event updated for resources: {'Port': ['ID=7d2984a9-8dc4-4275-9c11-378cce6a89f3,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:35.843167 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8ec5299-ac0d-46d8-81f0-24b189442fd0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:35.847849 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-75fef01c-5f71-4b5f-8e56-fc3c90295916 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:35.849494 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-75fef01c-5f71-4b5f-8e56-fc3c90295916 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0727758 Dec 09 21:31:35.853395 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45760) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:35.945374 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f6046dd3-d330-4741-b743-398502972cba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:35.949009 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8ec5299-ac0d-46d8-81f0-24b189442fd0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:35.952283 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8ec5299-ac0d-46d8-81f0-24b189442fd0 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.017204 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8ec5299-ac0d-46d8-81f0-24b189442fd0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.018027 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c8ec5299-ac0d-46d8-81f0-24b189442fd0 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 16dbc747-be19-40bc-8996-b5aa5410163c {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:31:36.023984 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8ec5299-ac0d-46d8-81f0-24b189442fd0 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.026289 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c8ec5299-ac0d-46d8-81f0-24b189442fd0 admin admin] 10.222.0.13 "DELETE /v2.0/routers/16dbc747-be19-40bc-8996-b5aa5410163c HTTP/1.1" status: 204 len: 168 time: 1.1699369 Dec 09 21:31:36.029099 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45764) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:36.105957 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2d087a8-5dbb-4114-88ea-1bb34835cbcf req-4b915f51-1dbb-4e6c-a703-840159fd681a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:36.106636 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:31:36.107920 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2d087a8-5dbb-4114-88ea-1bb34835cbcf req-4b915f51-1dbb-4e6c-a703-840159fd681a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 944 time: 0.1170642 Dec 09 21:31:36.110345 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-f6046dd3-d330-4741-b743-398502972cba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Deleting port 7d2984a9-8dc4-4275-9c11-378cce6a89f3 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:31:36.110345 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f6046dd3-d330-4741-b743-398502972cba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.130527 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-af720210-e2c1-4c77-b9ec-5fc6d58c5672 admin admin] Deleting subnet 86b80e39-7de5-4454-807b-0a1be07d2de3 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:31:36.133035 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af720210-e2c1-4c77-b9ec-5fc6d58c5672 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.143673 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:31:36.143896 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 3d9c176b-4d74-466f-b7bd-8d44eae4a3f2 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:31:36.196400 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af720210-e2c1-4c77-b9ec-5fc6d58c5672 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.254319 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af720210-e2c1-4c77-b9ec-5fc6d58c5672 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.273273 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2d087a8-5dbb-4114-88ea-1bb34835cbcf req-d7d76480-729f-4bc7-8f94-732441f7eb98 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1465650 Dec 09 21:31:36.279536 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-f6046dd3-d330-4741-b743-398502972cba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] For port 7d2984a9-8dc4-4275-9c11-378cce6a89f3, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7d2984a9-8dc4-4275-9c11-378cce6a89f3,segment=NetworkSegment(856a0d6c-84e0-488d-a35a-cfb4151a030f),segment_id=856a0d6c-84e0-488d-a35a-cfb4151a030f)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:31:36.279896 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f6046dd3-d330-4741-b743-398502972cba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.296637 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-f6046dd3-d330-4741-b743-398502972cba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Calling delete_port for 7d2984a9-8dc4-4275-9c11-378cce6a89f3 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:31:36.330320 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af720210-e2c1-4c77-b9ec-5fc6d58c5672 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.359827 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af720210-e2c1-4c77-b9ec-5fc6d58c5672 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=86b80e39-7de5-4454-807b-0a1be07d2de3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:36.366076 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af720210-e2c1-4c77-b9ec-5fc6d58c5672 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.369710 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-af720210-e2c1-4c77-b9ec-5fc6d58c5672 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/86b80e39-7de5-4454-807b-0a1be07d2de3 HTTP/1.1" status: 204 len: 168 time: 0.3375061 Dec 09 21:31:36.373123 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45774) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:36.404714 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f6046dd3-d330-4741-b743-398502972cba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.442166 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6046dd3-d330-4741-b743-398502972cba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Pushing event deleted for resources: {'Port': ['ID=7d2984a9-8dc4-4275-9c11-378cce6a89f3,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:36.446400 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6046dd3-d330-4741-b743-398502972cba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] No DVR routers for this DVR port 7d2984a9-8dc4-4275-9c11-378cce6a89f3 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:31:36.458230 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 778d35d4-c635-4fcb-b344-64cbb94958b9 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:31:36.473268 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0971c1ec-1050-44fb-83e2-a567c60761e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.596024 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f6046dd3-d330-4741-b743-398502972cba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.631578 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0971c1ec-1050-44fb-83e2-a567c60761e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.631956 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.661007 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-0971c1ec-1050-44fb-83e2-a567c60761e6 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['deef6d86-d3bd-4711-b0fe-ebca0c9737aa']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:36.661582 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-f6046dd3-d330-4741-b743-398502972cba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ca6ec313-6147-44eb-8b12-e4411bb9b48c']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:36.670186 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 778d35d4-c635-4fcb-b344-64cbb94958b9, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=778d35d4-c635-4fcb-b344-64cbb94958b9,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:31:36.680664 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-0971c1ec-1050-44fb-83e2-a567c60761e6 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '758500a8-fda8-49cf-a84c-a7e78098b9e8') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:36.681010 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-0971c1ec-1050-44fb-83e2-a567c60761e6 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '758500a8-fda8-49cf-a84c-a7e78098b9e8') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:36.685448 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '778d35d4-c635-4fcb-b344-64cbb94958b9', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'port_id': '778d35d4-c635-4fcb-b344-64cbb94958b9', 'mac_address': 'fa:16:3e:aa:9b:e5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:31:36.689965 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-116b765d-bdde-46e4-8bc2-7a0aa7435ebb req-8d5657cc-cdd1-42fd-b9f3-dbd582a8217c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:36.700537 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-116b765d-bdde-46e4-8bc2-7a0aa7435ebb req-8d5657cc-cdd1-42fd-b9f3-dbd582a8217c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 946 time: 0.1231534 Dec 09 21:31:36.703677 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0971c1ec-1050-44fb-83e2-a567c60761e6 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.710461 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-f6046dd3-d330-4741-b743-398502972cba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '856a0d6c-84e0-488d-a35a-cfb4151a030f') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:36.710843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-f6046dd3-d330-4741-b743-398502972cba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '856a0d6c-84e0-488d-a35a-cfb4151a030f') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:36.720508 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0971c1ec-1050-44fb-83e2-a567c60761e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.730137 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0971c1ec-1050-44fb-83e2-a567c60761e6 admin admin] Releasing vlan 129 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:31:36.731197 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0971c1ec-1050-44fb-83e2-a567c60761e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.733062 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f6046dd3-d330-4741-b743-398502972cba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:31:36.733486 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:31:36.736441 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.753230 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 778d35d4-c635-4fcb-b344-64cbb94958b9 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:31:36.765817 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f6046dd3-d330-4741-b743-398502972cba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.782118 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 778d35d4-c635-4fcb-b344-64cbb94958b9, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=778d35d4-c635-4fcb-b344-64cbb94958b9,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:31:36.787937 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-116b765d-bdde-46e4-8bc2-7a0aa7435ebb req-4ecca851-fafc-4b56-9490-1f115aa4d400 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0863397 Dec 09 21:31:36.795487 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.795757 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f6046dd3-d330-4741-b743-398502972cba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Releasing vlan 119 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:31:36.795757 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f6046dd3-d330-4741-b743-398502972cba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:31:36.801116 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:31:36.821117 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0971c1ec-1050-44fb-83e2-a567c60761e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.833448 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0971c1ec-1050-44fb-83e2-a567c60761e6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.837359 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0971c1ec-1050-44fb-83e2-a567c60761e6 admin admin] 10.222.0.13 "DELETE /v2.0/networks/deef6d86-d3bd-4711-b0fe-ebca0c9737aa HTTP/1.1" status: 204 len: 168 time: 0.4627459 Dec 09 21:31:36.854021 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0971c1ec-1050-44fb-83e2-a567c60761e6 admin admin] Pushing event deleted for resources: {'Network': ['ID=deef6d86-d3bd-4711-b0fe-ebca0c9737aa,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:36.886619 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=778d35d4-c635-4fcb-b344-64cbb94958b9,revision_number=9']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:36.932349 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f6046dd3-d330-4741-b743-398502972cba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.943719 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f6046dd3-d330-4741-b743-398502972cba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:36.948244 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f6046dd3-d330-4741-b743-398502972cba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] 10.222.0.13 "DELETE /v2.0/networks/ca6ec313-6147-44eb-8b12-e4411bb9b48c HTTP/1.1" status: 204 len: 168 time: 1.0937011 Dec 09 21:31:36.951523 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45788) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:36.959697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6046dd3-d330-4741-b743-398502972cba tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Pushing event deleted for resources: {'Network': ['ID=ca6ec313-6147-44eb-8b12-e4411bb9b48c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:37.006313 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['778d35d4-c635-4fcb-b344-64cbb94958b9'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:31:37.086557 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8f6da277-2319-4fd3-a4f5-80dae44ddba1 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:37.138758 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45790) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:37.256561 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-df63fe0a-b3d5-4f8a-bc92-58c6a29ef637 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=0f8295f4c3534e24a63938170ba2425e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1163876 Dec 09 21:31:37.257569 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45798) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:37.318980 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8f6da277-2319-4fd3-a4f5-80dae44ddba1 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:37.325299 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-31e9a78b-67e4-424d-b0d4-6e5657e2cf35 None None] DHCP port deletion for ca6ec313-6147-44eb-8b12-e4411bb9b48c request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:31:37.345018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3d0545cc-3211-45a9-92f4-eb35814aea4e None None] Could not find standard attr ID for object 7d2984a9-8dc4-4275-9c11-378cce6a89f3. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:31:37.356894 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c98dd77a-8130-490c-ad1b-4c36d8e35d1f None None] Network ca6ec313-6147-44eb-8b12-e4411bb9b48c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:31:37.383542 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-8f6da277-2319-4fd3-a4f5-80dae44ddba1 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3a5e2e27-340e-4866-88a0-186f52ebef29']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:37.385257 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-73efbe02-b6f0-4a3e-944c-fa67e7554070 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:37.408044 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-8f6da277-2319-4fd3-a4f5-80dae44ddba1 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '132940ba-ef1e-481b-86fe-e6023fa3f311') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:37.408335 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-8f6da277-2319-4fd3-a4f5-80dae44ddba1 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '132940ba-ef1e-481b-86fe-e6023fa3f311') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:37.428950 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-73efbe02-b6f0-4a3e-944c-fa67e7554070 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:37.432356 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8f6da277-2319-4fd3-a4f5-80dae44ddba1 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:37.454197 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8f6da277-2319-4fd3-a4f5-80dae44ddba1 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:37.472271 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8f6da277-2319-4fd3-a4f5-80dae44ddba1 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Releasing vlan 109 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:31:37.472703 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8f6da277-2319-4fd3-a4f5-80dae44ddba1 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:31:37.478255 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:31:37.521492 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-73efbe02-b6f0-4a3e-944c-fa67e7554070 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:37.525120 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-73efbe02-b6f0-4a3e-944c-fa67e7554070 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:37.527554 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-73efbe02-b6f0-4a3e-944c-fa67e7554070 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/25073bae-9c1b-4f21-941c-9dcae7db554c HTTP/1.1" status: 204 len: 168 time: 0.2677777 Dec 09 21:31:37.571412 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73efbe02-b6f0-4a3e-944c-fa67e7554070 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=25073bae-9c1b-4f21-941c-9dcae7db554c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:37.582873 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8f6da277-2319-4fd3-a4f5-80dae44ddba1 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:37.593813 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8f6da277-2319-4fd3-a4f5-80dae44ddba1 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:37.607042 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8f6da277-2319-4fd3-a4f5-80dae44ddba1 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] 10.222.0.13 "DELETE /v2.0/networks/3a5e2e27-340e-4866-88a0-186f52ebef29 HTTP/1.1" status: 204 len: 168 time: 0.6452241 Dec 09 21:31:37.613577 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45808) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:37.614176 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f6da277-2319-4fd3-a4f5-80dae44ddba1 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Pushing event deleted for resources: {'Network': ['ID=3a5e2e27-340e-4866-88a0-186f52ebef29,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:37.679151 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02ed8778-ce73-44de-8260-8d11b699bef2 req-bbfafb59-90ca-442b-abb3-facf775ebe2b tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:37.689112 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02ed8778-ce73-44de-8260-8d11b699bef2 req-bbfafb59-90ca-442b-abb3-facf775ebe2b tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 945 time: 0.1223633 Dec 09 21:31:37.740606 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e830112e-9e99-483b-b004-4f2061144a6c no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:31:37.758613 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02ed8778-ce73-44de-8260-8d11b699bef2 req-28b84228-6f8b-41be-b93f-fe31364b1ee4 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0656633 Dec 09 21:31:37.763999 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c98dd77a-8130-490c-ad1b-4c36d8e35d1f None None] Network ca6ec313-6147-44eb-8b12-e4411bb9b48c could not be found, it might have been deleted concurrently. {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:224}} Dec 09 21:31:37.769159 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd9fc264-93bc-4556-aef9-c665b952d6c8 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:37.827718 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42fa09c6-1458-4ac0-b0bf-5ab14aeab33b None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 21:31:37.862317 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: e830112e-9e99-483b-b004-4f2061144a6c {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:31:37.862749 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e830112e-9e99-483b-b004-4f2061144a6c not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:31:37.863311 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a593c11a-9955-487b-871c-d87440b7d7f6 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:31:37.888186 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd9fc264-93bc-4556-aef9-c665b952d6c8 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:37.911540 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-cd9fc264-93bc-4556-aef9-c665b952d6c8 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9e0e97b5-52d2-411f-9d84-3b59769de56d']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:37.922720 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-cd9fc264-93bc-4556-aef9-c665b952d6c8 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a8f64cee-8bbd-4667-8a0c-7c8629b57b3f') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:37.923142 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-cd9fc264-93bc-4556-aef9-c665b952d6c8 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a8f64cee-8bbd-4667-8a0c-7c8629b57b3f') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:37.933786 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd9fc264-93bc-4556-aef9-c665b952d6c8 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:37.939745 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: a593c11a-9955-487b-871c-d87440b7d7f6 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:31:37.940095 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a593c11a-9955-487b-871c-d87440b7d7f6 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:31:37.950453 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd9fc264-93bc-4556-aef9-c665b952d6c8 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:37.959513 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cd9fc264-93bc-4556-aef9-c665b952d6c8 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Releasing vlan 138 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:31:37.960421 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd9fc264-93bc-4556-aef9-c665b952d6c8 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:31:37.963992 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:31:37.992224 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:38.029582 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd9fc264-93bc-4556-aef9-c665b952d6c8 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:38.039591 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd9fc264-93bc-4556-aef9-c665b952d6c8 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:38.046027 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45822) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:38.046821 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cd9fc264-93bc-4556-aef9-c665b952d6c8 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] 10.222.0.13 "DELETE /v2.0/networks/9e0e97b5-52d2-411f-9d84-3b59769de56d HTTP/1.1" status: 204 len: 168 time: 0.4302125 Dec 09 21:31:38.057712 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd9fc264-93bc-4556-aef9-c665b952d6c8 tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Pushing event deleted for resources: {'Network': ['ID=9e0e97b5-52d2-411f-9d84-3b59769de56d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:38.093074 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-42fa09c6-1458-4ac0-b0bf-5ab14aeab33b None None] Resources bound (agent type, host, resource id): {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 09 21:31:38.136328 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0045fe67-657d-4c34-8457-38794fac45ff tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:38.232781 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0045fe67-657d-4c34-8457-38794fac45ff tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:38.255785 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-0045fe67-657d-4c34-8457-38794fac45ff tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['77afc054-caf7-47af-b1fc-536f508776b3']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:38.268723 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-0045fe67-657d-4c34-8457-38794fac45ff tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8d1896da-f627-440a-93c9-8aabbd46cd62') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:38.269183 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-0045fe67-657d-4c34-8457-38794fac45ff tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8d1896da-f627-440a-93c9-8aabbd46cd62') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:38.280973 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0045fe67-657d-4c34-8457-38794fac45ff tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:38.297028 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0045fe67-657d-4c34-8457-38794fac45ff tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:38.303975 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0045fe67-657d-4c34-8457-38794fac45ff tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Releasing vlan 135 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:31:38.304967 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0045fe67-657d-4c34-8457-38794fac45ff tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:31:38.308487 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:31:38.394771 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0045fe67-657d-4c34-8457-38794fac45ff tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:38.403846 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0045fe67-657d-4c34-8457-38794fac45ff tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:38.407976 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0045fe67-657d-4c34-8457-38794fac45ff tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] 10.222.0.13 "DELETE /v2.0/networks/77afc054-caf7-47af-b1fc-536f508776b3 HTTP/1.1" status: 204 len: 168 time: 0.3604345 Dec 09 21:31:38.430935 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0045fe67-657d-4c34-8457-38794fac45ff tempest-BulkNetworkOpsTest-1930115279 tempest-BulkNetworkOpsTest-1930115279-project] Pushing event deleted for resources: {'Network': ['ID=77afc054-caf7-47af-b1fc-536f508776b3,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:38.495321 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 778d35d4-c635-4fcb-b344-64cbb94958b9 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:31:38.600936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cb48503-a872-416e-ae62-711f938d0e9c req-78647587-7e6e-44c3-8ac0-823a211b22b1 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:38.604672 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2cb48503-a872-416e-ae62-711f938d0e9c req-78647587-7e6e-44c3-8ac0-823a211b22b1 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 945 time: 0.0715318 Dec 09 21:31:38.664338 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 778d35d4-c635-4fcb-b344-64cbb94958b9 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:38.667730 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2cb48503-a872-416e-ae62-711f938d0e9c req-64bada6f-bf37-48b0-af6d-28cc6201bd34 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/security-groups?id=02690a1b-c814-4a6b-a7d8-1252ee74106e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0557058 Dec 09 21:31:38.668122 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:38.738098 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Provisioning complete for port 0ca4bf99-2fc0-4203-9d93-7f254c7af4df triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:38.738474 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:38.834829 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:38.872402 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45862) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:38.885911 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '753dc06f-e08a-4cab-82a9-7e1089901f9b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '778d35d4-c635-4fcb-b344-64cbb94958b9'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:31:38.888926 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-933d51ed-8d45-4b2f-81c3-264ce0d824d4" -d '{"events": [{"server_uuid": "753dc06f-e08a-4cab-82a9-7e1089901f9b", "name": "network-vif-plugged", "status": "completed", "tag": "778d35d4-c635-4fcb-b344-64cbb94958b9"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:31:38.914313 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 778d35d4-c635-4fcb-b344-64cbb94958b9, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=778d35d4-c635-4fcb-b344-64cbb94958b9,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:31:38.923586 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:38.930407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Provisioning complete for port a86b6971-a767-4594-8a0c-17a90908b6c3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:38.931046 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:38.956199 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45870) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:38.956702 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:31:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-49218768-37fc-4f11-ade6-e06ca543daf8 x-openstack-request-id: req-49218768-37fc-4f11-ade6-e06ca543daf8 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:31:38.968301 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "753dc06f-e08a-4cab-82a9-7e1089901f9b", "name": "network-vif-plugged", "status": "completed", "tag": "778d35d4-c635-4fcb-b344-64cbb94958b9", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:31:38.968946 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-49218768-37fc-4f11-ade6-e06ca543daf8 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:31:38.971212 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '753dc06f-e08a-4cab-82a9-7e1089901f9b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '778d35d4-c635-4fcb-b344-64cbb94958b9', 'code': 200} Dec 09 21:31:39.019599 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=778d35d4-c635-4fcb-b344-64cbb94958b9,revision_number=10']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:39.049619 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-455a5cf9-a493-4647-9b97-82b62282af88 req-355e80e2-0525-4da7-9df1-99e20399a363 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:39.051497 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-455a5cf9-a493-4647-9b97-82b62282af88 req-355e80e2-0525-4da7-9df1-99e20399a363 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 945 time: 0.1611328 Dec 09 21:31:39.147495 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-62026381-15d2-4ef8-8863-fbfae11cbdd6 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=771151d2362842e3a098655197de55d7&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2736540 Dec 09 21:31:39.151679 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45874) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:39.156616 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b40e16b-392f-4898-8b05-0a45a96fac4a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:39.169294 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Provisioning complete for port 419b54cc-ec88-493d-a1d4-a2bb128da19c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:39.169529 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:39.170227 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-455a5cf9-a493-4647-9b97-82b62282af88 req-a77fd442-d3d3-42a3-9b25-782678eab074 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1099379 Dec 09 21:31:39.193191 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7d2984a9-8dc4-4275-9c11-378cce6a89f3 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:31:39.251149 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f1ec19a-cbeb-4ca7-89f2-4daad1b8449b req-422d5714-558e-4cac-bad5-acbc52600dbc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:39.252737 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7f1ec19a-cbeb-4ca7-89f2-4daad1b8449b req-422d5714-558e-4cac-bad5-acbc52600dbc service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 1099 time: 0.0797613 Dec 09 21:31:39.257632 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d44fe1fe-a267-437b-a608-a9a1c92b4ac6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:39.258121 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b40e16b-392f-4898-8b05-0a45a96fac4a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:39.263874 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b40e16b-392f-4898-8b05-0a45a96fac4a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:39.264310 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 7d2984a9-8dc4-4275-9c11-378cce6a89f3 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:31:39.264712 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7d2984a9-8dc4-4275-9c11-378cce6a89f3 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:31:39.297352 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d44fe1fe-a267-437b-a608-a9a1c92b4ac6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:39.318972 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1b40e16b-392f-4898-8b05-0a45a96fac4a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=107c35dbe3b648119b83337ed94b301e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3608420 Dec 09 21:31:39.319738 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45876) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:39.330071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b40e16b-392f-4898-8b05-0a45a96fac4a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8fc735df-5f6e-49c7-b812-62ac8592df57,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:39.338023 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7f1ec19a-cbeb-4ca7-89f2-4daad1b8449b req-d84dd4e4-7e87-46d4-8819-b7caea7cf7dc service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0774028 Dec 09 21:31:39.361111 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Provisioning complete for port 4b5f65e7-70fc-4047-a3ff-bc617dae38a0 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:39.361591 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:39.376353 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d44fe1fe-a267-437b-a608-a9a1c92b4ac6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:39.379004 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d44fe1fe-a267-437b-a608-a9a1c92b4ac6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:39.381576 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d44fe1fe-a267-437b-a608-a9a1c92b4ac6 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/c59ebcbc-706e-4a7c-8497-83f2c69046ed HTTP/1.1" status: 204 len: 168 time: 0.2276294 Dec 09 21:31:39.384385 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f59058cb-6069-43e8-b24d-185272e83209 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:39.390015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d44fe1fe-a267-437b-a608-a9a1c92b4ac6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c59ebcbc-706e-4a7c-8497-83f2c69046ed,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:39.415971 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f59058cb-6069-43e8-b24d-185272e83209 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:39.420930 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Port 4b5f65e7-70fc-4047-a3ff-bc617dae38a0 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:31:39.434456 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Provisioning complete for port 6cf4ffbd-1ca6-4dd1-a033-c481be40b106 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:39.434678 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:39.476484 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f59058cb-6069-43e8-b24d-185272e83209 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:39.479693 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f59058cb-6069-43e8-b24d-185272e83209 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:39.486457 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f59058cb-6069-43e8-b24d-185272e83209 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/8fc735df-5f6e-49c7-b812-62ac8592df57 HTTP/1.1" status: 204 len: 168 time: 0.1643941 Dec 09 21:31:39.507325 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f59058cb-6069-43e8-b24d-185272e83209 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8fc735df-5f6e-49c7-b812-62ac8592df57,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:39.612447 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:39.625958 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Provisioning complete for port f29fe8cc-72a3-485b-a257-8a8081d710b1 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:39.626480 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:39.723452 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Provisioning complete for port 2400575d-0b51-48ba-bd46-ed904f5cdbcd triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:39.723921 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:39.786461 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a0d3196-f4fd-47fc-8245-bdc585f9a508 req-38d932b9-bb5e-40ba-8e41-44af1f079448 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:39.795272 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a0d3196-f4fd-47fc-8245-bdc585f9a508 req-38d932b9-bb5e-40ba-8e41-44af1f079448 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 945 time: 0.0745630 Dec 09 21:31:39.889536 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a0d3196-f4fd-47fc-8245-bdc585f9a508 req-9ec41a1a-8f9b-4c37-91b5-f8a7ba54b375 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/security-groups?id=02690a1b-c814-4a6b-a7d8-1252ee74106e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0930045 Dec 09 21:31:39.898836 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Provisioning complete for port 3db534ad-6c5d-4da2-b2a6-16ff51de3d1e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:39.899287 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:39.937977 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Port 3db534ad-6c5d-4da2-b2a6-16ff51de3d1e cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:31:39.954183 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Provisioning complete for port 1ac7a7b1-7d92-471a-a03b-8b88ff10b0aa triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:39.954563 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:39.990323 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Port 1ac7a7b1-7d92-471a-a03b-8b88ff10b0aa cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:31:40.000375 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Provisioning complete for port 41cdb40e-bd30-4566-a2eb-a8ec05877093 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:40.000912 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:40.186088 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Port 41cdb40e-bd30-4566-a2eb-a8ec05877093 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:31:40.197302 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Provisioning complete for port 9a59b751-0f89-4df2-b0c8-8fd95c5a1ea3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:40.197675 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:40.232143 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Port 9a59b751-0f89-4df2-b0c8-8fd95c5a1ea3 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:31:40.243041 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Provisioning complete for port 3b4701e3-b6e8-4be9-a35a-74fb297acc7d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:40.243416 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:40.290657 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Port 3b4701e3-b6e8-4be9-a35a-74fb297acc7d cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:31:40.290657 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Provisioning complete for port 0bf80ece-82d7-4c64-8066-ef5107ea9e0d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:40.290657 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:40.360348 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9301ea2-0ff8-4470-aede-fb91c4d0b8de req-d36c145e-5d56-49fc-90d5-cd70e9c77c3c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:40.368053 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f9301ea2-0ff8-4470-aede-fb91c4d0b8de req-d36c145e-5d56-49fc-90d5-cd70e9c77c3c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 947 time: 0.0603533 Dec 09 21:31:40.407806 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Provisioning complete for port 9821c003-fbcf-44bf-bf13-f8d54c4ce218 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:40.408878 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:40.425412 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f9301ea2-0ff8-4470-aede-fb91c4d0b8de req-22b5137b-9e35-4a9e-9747-6b1c507ebaf1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0562859 Dec 09 21:31:40.524284 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Provisioning complete for port 24ef0d1e-7cfa-4ade-8f5e-466567bc5628 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:40.525054 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4d1857b-fbc2-41c7-8033-4f95696f2871 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:40.553706 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45946) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:40.663210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e133126b-f471-47e2-adb8-55392467a1a0 req-45c0105b-f545-4aca-ae44-fe8fad331274 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:40.665158 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e133126b-f471-47e2-adb8-55392467a1a0 req-45c0105b-f545-4aca-ae44-fe8fad331274 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 945 time: 0.0731544 Dec 09 21:31:40.722194 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e133126b-f471-47e2-adb8-55392467a1a0 req-7cac99c3-65f7-43de-9bc3-8e1f48ca0d8e tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/security-groups?id=02690a1b-c814-4a6b-a7d8-1252ee74106e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463123 Dec 09 21:31:40.830489 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-900e45d9-ca89-49fd-93be-4f21f95b6f8d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-228958730'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:40.854537 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-900e45d9-ca89-49fd-93be-4f21f95b6f8d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Made reservation on behalf of dc5c46f00552473abc0991c0cc4a0269 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:31:40.858558 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-900e45d9-ca89-49fd-93be-4f21f95b6f8d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:40.868581 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-900e45d9-ca89-49fd-93be-4f21f95b6f8d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:40.970690 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-900e45d9-ca89-49fd-93be-4f21f95b6f8d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:40.978113 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-900e45d9-ca89-49fd-93be-4f21f95b6f8d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:41.033786 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-900e45d9-ca89-49fd-93be-4f21f95b6f8d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'SecurityGroup': ['ID=024f34fc-6cd9-4473-bef8-c81394627de8,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:41.039425 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-900e45d9-ca89-49fd-93be-4f21f95b6f8d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] vlan segment allocate from pool success with {'vlan_id': 133, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:31:41.064256 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-900e45d9-ca89-49fd-93be-4f21f95b6f8d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:41.064600 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-900e45d9-ca89-49fd-93be-4f21f95b6f8d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Added segment eae9cb14-b1cf-47b8-a274-ca6ab72583d8 of type vlan for network 406147ce-e94d-447c-8157-d0520c0fe008 Dec 09 21:31:41.114870 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-900e45d9-ca89-49fd-93be-4f21f95b6f8d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:41.148741 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-900e45d9-ca89-49fd-93be-4f21f95b6f8d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:41.156276 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-900e45d9-ca89-49fd-93be-4f21f95b6f8d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:41.157220 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-900e45d9-ca89-49fd-93be-4f21f95b6f8d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:41.239190 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-900e45d9-ca89-49fd-93be-4f21f95b6f8d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Network': ['ID=406147ce-e94d-447c-8157-d0520c0fe008,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:41.248272 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46020) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:41.248791 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-900e45d9-ca89-49fd-93be-4f21f95b6f8d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.6937578 Dec 09 21:31:41.253522 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-d95d6a18-4524-4f39-bb08-9f1d82eb28a6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1353086227'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:41.254874 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 406147ce-e94d-447c-8157-d0520c0fe008 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:31:41.302388 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d95d6a18-4524-4f39-bb08-9f1d82eb28a6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Made reservation on behalf of dc5c46f00552473abc0991c0cc4a0269 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:31:41.314640 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d95d6a18-4524-4f39-bb08-9f1d82eb28a6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:41.357270 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d95d6a18-4524-4f39-bb08-9f1d82eb28a6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] vlan segment allocate from pool success with {'vlan_id': 122, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:31:41.375711 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d95d6a18-4524-4f39-bb08-9f1d82eb28a6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:41.376320 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-d95d6a18-4524-4f39-bb08-9f1d82eb28a6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Added segment f7dc6064-2e58-45ea-8d06-e72fce48a4e1 of type vlan for network 64e20505-8304-4955-bb05-411a17db5d18 Dec 09 21:31:41.435767 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d95d6a18-4524-4f39-bb08-9f1d82eb28a6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:41.503011 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d95d6a18-4524-4f39-bb08-9f1d82eb28a6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:41.516653 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d95d6a18-4524-4f39-bb08-9f1d82eb28a6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:41.517328 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d95d6a18-4524-4f39-bb08-9f1d82eb28a6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:41.588518 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56d311f8-4b18-4b2d-ab96-edbd050abf06 req-c5dc6126-74ad-4a73-b016-e626261219d4 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:41.599083 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56d311f8-4b18-4b2d-ab96-edbd050abf06 req-c5dc6126-74ad-4a73-b016-e626261219d4 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 947 time: 0.0840909 Dec 09 21:31:41.633311 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d95d6a18-4524-4f39-bb08-9f1d82eb28a6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Network': ['ID=64e20505-8304-4955-bb05-411a17db5d18,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:41.645669 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 64e20505-8304-4955-bb05-411a17db5d18 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:31:41.652250 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d95d6a18-4524-4f39-bb08-9f1d82eb28a6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.4028437 Dec 09 21:31:41.655892 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46050) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:41.662820 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-5f65427d-077d-4f96-939c-f04a7ae280b7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'subnet': {'network_id': '406147ce-e94d-447c-8157-d0520c0fe008', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:41.706188 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56d311f8-4b18-4b2d-ab96-edbd050abf06 req-1ca7af67-fcde-4f9c-b6a1-c3dd39324042 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1089108 Dec 09 21:31:41.845109 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5f65427d-077d-4f96-939c-f04a7ae280b7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Made reservation on behalf of dc5c46f00552473abc0991c0cc4a0269 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:31:41.859554 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5f65427d-077d-4f96-939c-f04a7ae280b7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:41.920781 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af2243b7-d953-46d7-9c56-abbd7135345b req-bfd60b9d-e969-4b30-82ee-a94c7ba44aeb tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:41.929647 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af2243b7-d953-46d7-9c56-abbd7135345b req-bfd60b9d-e969-4b30-82ee-a94c7ba44aeb tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 945 time: 0.0762448 Dec 09 21:31:41.996233 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af2243b7-d953-46d7-9c56-abbd7135345b req-6746ab41-9442-4100-9aa1-b2416a181ba1 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/security-groups?id=02690a1b-c814-4a6b-a7d8-1252ee74106e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0650363 Dec 09 21:31:42.036424 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46062) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:42.163179 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5f65427d-077d-4f96-939c-f04a7ae280b7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:42.180544 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-078a3040-8934-4a9f-9dd2-e42379850fd2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:42.271696 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f65427d-077d-4f96-939c-f04a7ae280b7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Checking segment: {'id': 'eae9cb14-b1cf-47b8-a274-ca6ab72583d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '406147ce-e94d-447c-8157-d0520c0fe008'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:31:42.273108 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f65427d-077d-4f96-939c-f04a7ae280b7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network hostable DHCP agents. Network: 406147ce-e94d-447c-8157-d0520c0fe008, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:31:42.281687 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-078a3040-8934-4a9f-9dd2-e42379850fd2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:42.289971 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-078a3040-8934-4a9f-9dd2-e42379850fd2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:42.297416 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f65427d-077d-4f96-939c-f04a7ae280b7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Subnet': ['ID=e221e85c-451a-4f41-b14a-5bb277809971,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:42.319189 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-099b7ed6-c8c0-4ea3-b4ac-186868501088 req-e6c90810-ba97-445f-8546-9e9004af74e5 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:42.321062 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-099b7ed6-c8c0-4ea3-b4ac-186868501088 req-e6c90810-ba97-445f-8546-9e9004af74e5 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.10 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 945 time: 0.1189990 Dec 09 21:31:42.339246 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-078a3040-8934-4a9f-9dd2-e42379850fd2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=61969d8c-348e-4577-91fa-2fa77d9adfe7,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:42.347811 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-078a3040-8934-4a9f-9dd2-e42379850fd2 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=8514cecdb56d494f81bf5a0b117061e2&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3100343 Dec 09 21:31:42.350295 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46070) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:42.403760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f65427d-077d-4f96-939c-f04a7ae280b7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network 406147ce-e94d-447c-8157-d0520c0fe008 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:31:42.408966 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3b5ddeb0-81b9-4ad9-9853-b4b45e246c91 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:42.435147 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-5f65427d-077d-4f96-939c-f04a7ae280b7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 406147ce-e94d-447c-8157-d0520c0fe008) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:42.439845 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3b5ddeb0-81b9-4ad9-9853-b4b45e246c91 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:42.446986 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2ce17627-cece-4ca9-8922-003d847a4701 None None] Network 406147ce-e94d-447c-8157-d0520c0fe008 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:31:42.462358 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f65427d-077d-4f96-939c-f04a7ae280b7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:42.470197 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5f65427d-077d-4f96-939c-f04a7ae280b7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:42.498882 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 90f16e74-f2e6-416e-a079-f205615a0d8e details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:31:42.500071 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3b5ddeb0-81b9-4ad9-9853-b4b45e246c91 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:42.509121 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3b5ddeb0-81b9-4ad9-9853-b4b45e246c91 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:42.513171 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3b5ddeb0-81b9-4ad9-9853-b4b45e246c91 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/61969d8c-348e-4577-91fa-2fa77d9adfe7 HTTP/1.1" status: 204 len: 168 time: 0.1591384 Dec 09 21:31:42.538326 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b5ddeb0-81b9-4ad9-9853-b4b45e246c91 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=61969d8c-348e-4577-91fa-2fa77d9adfe7,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:42.557919 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5f65427d-077d-4f96-939c-f04a7ae280b7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.8980010 Dec 09 21:31:42.558240 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46074) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:42.564241 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-4731c4d9-a205-4031-893b-ab815e11ec32 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'subnet': {'network_id': '64e20505-8304-4955-bb05-411a17db5d18', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:42.600515 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-099b7ed6-c8c0-4ea3-b4ac-186868501088 req-fda002b0-eda5-4c67-8265-17c9ecb1245a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Deleting port 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:31:42.600859 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-099b7ed6-c8c0-4ea3-b4ac-186868501088 req-fda002b0-eda5-4c67-8265-17c9ecb1245a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:42.697695 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-406147ce-e94d-447c-8157-d0520c0fe008', 'network_id': '406147ce-e94d-447c-8157-d0520c0fe008', 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'fixed_ips': [{'subnet_id': 'e221e85c-451a-4f41-b14a-5bb277809971'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:31:42.699265 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:42.785069 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4731c4d9-a205-4031-893b-ab815e11ec32 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Made reservation on behalf of dc5c46f00552473abc0991c0cc4a0269 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:31:42.791812 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4731c4d9-a205-4031-893b-ab815e11ec32 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:42.825414 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-099b7ed6-c8c0-4ea3-b4ac-186868501088 req-fda002b0-eda5-4c67-8265-17c9ecb1245a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] For port 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc,segment=NetworkSegment(dc772362-7c7f-473d-bb4b-7b6705959a15),segment_id=dc772362-7c7f-473d-bb4b-7b6705959a15)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:31:42.832268 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-099b7ed6-c8c0-4ea3-b4ac-186868501088 req-fda002b0-eda5-4c67-8265-17c9ecb1245a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:42.985874 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Allocated IP 2001:db8::2 (406147ce-e94d-447c-8157-d0520c0fe008/e221e85c-451a-4f41-b14a-5bb277809971/18ce346b-1ae1-4813-ba7a-28e98644fe02) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:31:42.989915 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eb46423-24d1-4904-99f3-044dccb9d503 req-6fc9cb1d-22d5-4eea-8bc2-1cc839df2305 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:42.991860 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2eb46423-24d1-4904-99f3-044dccb9d503 req-6fc9cb1d-22d5-4eea-8bc2-1cc839df2305 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 947 time: 0.0880523 Dec 09 21:31:43.135846 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2eb46423-24d1-4904-99f3-044dccb9d503 req-d83bd516-eb59-4cfe-9ef2-c19202a51f4c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1158817 Dec 09 21:31:43.245101 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:43.289946 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:43.319703 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Network 406147ce-e94d-447c-8157-d0520c0fe008 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:31:43.322130 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4731c4d9-a205-4031-893b-ab815e11ec32 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:43.344947 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:43.356282 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:31:43.364346 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-099b7ed6-c8c0-4ea3-b4ac-186868501088 req-fda002b0-eda5-4c67-8265-17c9ecb1245a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:43.364830 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-099b7ed6-c8c0-4ea3-b4ac-186868501088 req-fda002b0-eda5-4c67-8265-17c9ecb1245a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:43.365017 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [req-099b7ed6-c8c0-4ea3-b4ac-186868501088 req-fda002b0-eda5-4c67-8265-17c9ecb1245a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Floating IP c8a74273-d4f2-4daa-b03c-d5fe21026216 disassociated. External IP: 172.25.3.35, port: 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc. Dec 09 21:31:43.365845 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-099b7ed6-c8c0-4ea3-b4ac-186868501088 req-fda002b0-eda5-4c67-8265-17c9ecb1245a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Calling delete_port for 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:31:43.377204 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-993462c4-cc0b-4fdd-95d4-a028023028a2 req-f4ba25db-b15f-471c-8581-bbc065a53d60 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:43.390927 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-993462c4-cc0b-4fdd-95d4-a028023028a2 req-f4ba25db-b15f-471c-8581-bbc065a53d60 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 945 time: 0.1822321 Dec 09 21:31:43.516022 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 90f16e74-f2e6-416e-a079-f205615a0d8e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=90f16e74-f2e6-416e-a079-f205615a0d8e,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:31:43.565783 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-993462c4-cc0b-4fdd-95d4-a028023028a2 req-dc7fbefd-61a9-414d-8548-defa6329da9f tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/security-groups?id=02690a1b-c814-4a6b-a7d8-1252ee74106e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1722231 Dec 09 21:31:43.599580 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4731c4d9-a205-4031-893b-ab815e11ec32 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Subnet': ['ID=c18b8bfe-b2f1-42b1-8850-7d3336d11c03,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:43.608504 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Pushing event updated for resources: {'Port': ['ID=18ce346b-1ae1-4813-ba7a-28e98644fe02,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:43.609609 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4731c4d9-a205-4031-893b-ab815e11ec32 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Checking segment: {'id': 'f7dc6064-2e58-45ea-8d06-e72fce48a4e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '64e20505-8304-4955-bb05-411a17db5d18'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:31:43.610176 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4731c4d9-a205-4031-893b-ab815e11ec32 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network hostable DHCP agents. Network: 64e20505-8304-4955-bb05-411a17db5d18, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:31:43.619713 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '90f16e74-f2e6-416e-a079-f205615a0d8e', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'port_id': '90f16e74-f2e6-416e-a079-f205615a0d8e', 'mac_address': 'fa:16:3e:69:c9:b5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:31:43.634209 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:43.634842 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:43.635409 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:43.636350 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:43.636776 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:43.636891 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4731c4d9-a205-4031-893b-ab815e11ec32 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network 64e20505-8304-4955-bb05-411a17db5d18 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:31:43.637443 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:43.638000 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:43.638666 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:43.639213 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:43.639864 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:43.640401 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:43.640933 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:43.641480 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:43.656889 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Attempting to bind port 18ce346b-1ae1-4813-ba7a-28e98644fe02 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:31:43.660539 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Attempting to bind port 18ce346b-1ae1-4813-ba7a-28e98644fe02 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'eae9cb14-b1cf-47b8-a274-ca6ab72583d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '406147ce-e94d-447c-8157-d0520c0fe008'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:31:43.662019 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Attempting to bind port 18ce346b-1ae1-4813-ba7a-28e98644fe02 on network 406147ce-e94d-447c-8157-d0520c0fe008 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:31:43.669089 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-4731c4d9-a205-4031-893b-ab815e11ec32 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 64e20505-8304-4955-bb05-411a17db5d18) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:43.677660 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4731c4d9-a205-4031-893b-ab815e11ec32 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:43.678538 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4731c4d9-a205-4031-893b-ab815e11ec32 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:43.681371 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-099b7ed6-c8c0-4ea3-b4ac-186868501088 req-fda002b0-eda5-4c67-8265-17c9ecb1245a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:43.716534 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fda002b0-eda5-4c67-8265-17c9ecb1245a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Pushing event deleted for resources: {'Port': ['ID=5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:43.716975 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4731c4d9-a205-4031-893b-ab815e11ec32 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.1574318 Dec 09 21:31:43.719689 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46110) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:43.724561 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-82263f3a-4975-4f3f-bc12-ccb9dd95ee9f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-2092021102', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:31:43.746481 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a68d5876-87f1-4b76-9d2a-9c166d0cef3c None None] Network 64e20505-8304-4955-bb05-411a17db5d18 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:31:43.765209 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 31, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:31:43.766989 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Checking segment: {'id': 'eae9cb14-b1cf-47b8-a274-ca6ab72583d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '406147ce-e94d-447c-8157-d0520c0fe008'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:31:43.767606 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:43.768099 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Bound using segment: {'id': 'eae9cb14-b1cf-47b8-a274-ca6ab72583d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '406147ce-e94d-447c-8157-d0520c0fe008'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:31:43.768696 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Bound port: 18ce346b-1ae1-4813-ba7a-28e98644fe02, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'eae9cb14-b1cf-47b8-a274-ca6ab72583d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '406147ce-e94d-447c-8157-d0520c0fe008'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:31:43.769207 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:43.775608 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-82263f3a-4975-4f3f-bc12-ccb9dd95ee9f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:43.777021 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-82263f3a-4975-4f3f-bc12-ccb9dd95ee9f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:43.900377 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-82263f3a-4975-4f3f-bc12-ccb9dd95ee9f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:43.909676 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-82263f3a-4975-4f3f-bc12-ccb9dd95ee9f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:43.930823 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [req-099b7ed6-c8c0-4ea3-b4ac-186868501088 req-fda002b0-eda5-4c67-8265-17c9ecb1245a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Router eeac8998-5e81-4874-bc7a-2829c8a216f7 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:31:43.947921 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-82263f3a-4975-4f3f-bc12-ccb9dd95ee9f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:43.953351 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-82263f3a-4975-4f3f-bc12-ccb9dd95ee9f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.2291064 Dec 09 21:31:43.953540 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:43.954938 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46120) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:44.071617 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 90f16e74-f2e6-416e-a079-f205615a0d8e {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:31:44.164544 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] For port 18ce346b-1ae1-4813-ba7a-28e98644fe02, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:31:44.172891 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] For port 18ce346b-1ae1-4813-ba7a-28e98644fe02, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=18ce346b-1ae1-4813-ba7a-28e98644fe02,segment=NetworkSegment(eae9cb14-b1cf-47b8-a274-ca6ab72583d8),segment_id=eae9cb14-b1cf-47b8-a274-ca6ab72583d8)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:31:44.181115 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-80286612-b396-4341-9689-9a72713e3cae None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-64e20505-8304-4955-bb05-411a17db5d18', 'network_id': '64e20505-8304-4955-bb05-411a17db5d18', 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'fixed_ips': [{'subnet_id': 'c18b8bfe-b2f1-42b1-8850-7d3336d11c03'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:31:44.182008 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-80286612-b396-4341-9689-9a72713e3cae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:44.386949 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-80286612-b396-4341-9689-9a72713e3cae None None] Allocated IP 2001:db8:1::2 (64e20505-8304-4955-bb05-411a17db5d18/c18b8bfe-b2f1-42b1-8850-7d3336d11c03/6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:31:44.447884 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:44.463888 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 90f16e74-f2e6-416e-a079-f205615a0d8e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=90f16e74-f2e6-416e-a079-f205615a0d8e,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:31:44.491568 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:44.853702 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02901ad7-16ca-419b-9cd0-11e80edc00c5 req-cf33775f-dd21-489e-9f73-1a954cda01e8 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 210 time: 0.0503168 Dec 09 21:31:44.969031 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['90f16e74-f2e6-416e-a079-f205615a0d8e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:31:45.053187 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc14f950-531a-4c1a-b579-fb07ae9ef6ab None None] Pushing event updated for resources: {'Port': ['ID=18ce346b-1ae1-4813-ba7a-28e98644fe02,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:45.084410 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-099b7ed6-c8c0-4ea3-b4ac-186868501088 req-fda002b0-eda5-4c67-8265-17c9ecb1245a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:31:45.107028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-714ec801-6b15-4780-9f29-7138ad5fe6ed None None] Sync routers for ids ['eeac8998-5e81-4874-bc7a-2829c8a216f7'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:31:45.142562 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-099b7ed6-c8c0-4ea3-b4ac-186868501088 req-fda002b0-eda5-4c67-8265-17c9ecb1245a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] No DVR routers for this DVR port 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:31:45.150423 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-099b7ed6-c8c0-4ea3-b4ac-186868501088 req-fda002b0-eda5-4c67-8265-17c9ecb1245a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:45.154634 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-099b7ed6-c8c0-4ea3-b4ac-186868501088 req-fda002b0-eda5-4c67-8265-17c9ecb1245a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.10 "DELETE /v2.0/ports/5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc HTTP/1.1" status: 204 len: 173 time: 2.8252337 Dec 09 21:31:45.155285 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '752d9ac2-7383-4bdb-b56f-3c52855d7fc9', 'name': 'network-vif-deleted', 'tag': '5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:31:45.158424 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f3746e7d-b6c5-470c-ace9-40b17df07dc2" -d '{"events": [{"server_uuid": "752d9ac2-7383-4bdb-b56f-3c52855d7fc9", "name": "network-vif-deleted", "tag": "5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:31:45.199397 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-714ec801-6b15-4780-9f29-7138ad5fe6ed None None] Routers {'eeac8998-5e81-4874-bc7a-2829c8a216f7'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:31:45.202142 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-714ec801-6b15-4780-9f29-7138ad5fe6ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 10, "extensions": [], "floating_ips": 6, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:31:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['eeac8998-5e81-4874-bc7a-2829c8a216f7'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:45.327430 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ad18f041-24c8-4c35-9afe-de4a0e23575a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:45.377161 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:31:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b6a7645f-2cda-4fb7-a5c2-90e90d19cdf8 x-openstack-request-id: req-b6a7645f-2cda-4fb7-a5c2-90e90d19cdf8 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:31:45.377558 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "752d9ac2-7383-4bdb-b56f-3c52855d7fc9", "name": "network-vif-deleted", "tag": "5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:31:45.379293 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-b6a7645f-2cda-4fb7-a5c2-90e90d19cdf8 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:31:45.379796 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '752d9ac2-7383-4bdb-b56f-3c52855d7fc9', 'name': 'network-vif-deleted', 'tag': '5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc', 'status': 'completed', 'code': 200} Dec 09 21:31:45.457967 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=90f16e74-f2e6-416e-a079-f205615a0d8e,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:45.468566 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-80286612-b396-4341-9689-9a72713e3cae None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:45.530799 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-80286612-b396-4341-9689-9a72713e3cae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:45.577141 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-714ec801-6b15-4780-9f29-7138ad5fe6ed None None] Set router eeac8998-5e81-4874-bc7a-2829c8a216f7 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:31:45.618265 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-80286612-b396-4341-9689-9a72713e3cae None None] Network 64e20505-8304-4955-bb05-411a17db5d18 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:31:45.814337 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-80286612-b396-4341-9689-9a72713e3cae None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:45.818674 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-ad18f041-24c8-4c35-9afe-de4a0e23575a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Allocated IP 2001:db8::1 (406147ce-e94d-447c-8157-d0520c0fe008/e221e85c-451a-4f41-b14a-5bb277809971/9ac7213c-28a4-48a4-8e5a-f304e387cb0e) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:31:45.905250 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80286612-b396-4341-9689-9a72713e3cae None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:31:46.040447 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ad18f041-24c8-4c35-9afe-de4a0e23575a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:46.051595 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80286612-b396-4341-9689-9a72713e3cae None None] Pushing event updated for resources: {'Port': ['ID=6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:46.159012 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ad18f041-24c8-4c35-9afe-de4a0e23575a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:46.180275 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f032a20-5ebf-4a87-ba95-66f69e8f8fed req-6d8cbd10-d767-4ba2-bd70-0ba571da5ea6 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 210 time: 0.0638943 Dec 09 21:31:46.190843 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:31:46.196558 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-80286612-b396-4341-9689-9a72713e3cae None None] Attempting to bind port 6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:31:46.197262 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-80286612-b396-4341-9689-9a72713e3cae None None] Attempting to bind port 6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f7dc6064-2e58-45ea-8d06-e72fce48a4e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '64e20505-8304-4955-bb05-411a17db5d18'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:31:46.197743 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80286612-b396-4341-9689-9a72713e3cae None None] Attempting to bind port 6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1 on network 64e20505-8304-4955-bb05-411a17db5d18 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:31:46.252159 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:31:46.252497 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 5f2548d5-b0e9-4fa4-b79d-8987e7cb40bc not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:31:46.255236 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80286612-b396-4341-9689-9a72713e3cae None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 31, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:31:46.255762 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80286612-b396-4341-9689-9a72713e3cae None None] Checking segment: {'id': 'f7dc6064-2e58-45ea-8d06-e72fce48a4e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '64e20505-8304-4955-bb05-411a17db5d18'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:31:46.258774 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-80286612-b396-4341-9689-9a72713e3cae None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:46.258774 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80286612-b396-4341-9689-9a72713e3cae None None] Bound using segment: {'id': 'f7dc6064-2e58-45ea-8d06-e72fce48a4e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '64e20505-8304-4955-bb05-411a17db5d18'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:31:46.258774 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-80286612-b396-4341-9689-9a72713e3cae None None] Bound port: 6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f7dc6064-2e58-45ea-8d06-e72fce48a4e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '64e20505-8304-4955-bb05-411a17db5d18'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:31:46.258774 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-80286612-b396-4341-9689-9a72713e3cae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:46.305039 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad18f041-24c8-4c35-9afe-de4a0e23575a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network 406147ce-e94d-447c-8157-d0520c0fe008 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:31:46.332199 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-ad18f041-24c8-4c35-9afe-de4a0e23575a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:46.338382 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad18f041-24c8-4c35-9afe-de4a0e23575a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:31:46.339564 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ad18f041-24c8-4c35-9afe-de4a0e23575a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:46.428066 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-714ec801-6b15-4780-9f29-7138ad5fe6ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'name': 'tempest-ServersTestBootFromVolume-1721587557-router', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163'}], 'enable_snat': True}, 'gw_port_id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:31Z', 'updated_at': '2021-12-09T21:28:40Z', 'revision_number': 4, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'gw_port': {'id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:5c:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1213, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:32Z', 'updated_at': '2021-12-09T21:28:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '4417739f-7bef-4bd0-b1eb-dab883253f64', 'name': '', 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'mac_address': 'fa:16:3e:a3:e6:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1221, 'fixed_ips': [{'subnet_id': '93335bf9-6f1e-4484-ae25-dca4b03b29b4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:37Z', 'updated_at': '2021-12-09T21:28:45Z', 'revision_number': 5, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'subnets': [{'id': '93335bf9-6f1e-4484-ae25-dca4b03b29b4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:46.453896 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad18f041-24c8-4c35-9afe-de4a0e23575a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Port': ['ID=9ac7213c-28a4-48a4-8e5a-f304e387cb0e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:46.538361 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-714ec801-6b15-4780-9f29-7138ad5fe6ed None None] Checking router: eeac8998-5e81-4874-bc7a-2829c8a216f7 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:31:46.570779 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-714ec801-6b15-4780-9f29-7138ad5fe6ed None None] Routers {'eeac8998-5e81-4874-bc7a-2829c8a216f7'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:31:46.571459 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-714ec801-6b15-4780-9f29-7138ad5fe6ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 10, "extensions": [], "floating_ips": 6, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:31:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['eeac8998-5e81-4874-bc7a-2829c8a216f7'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:46.578837 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-80286612-b396-4341-9689-9a72713e3cae None None] For port 6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:31:46.653004 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-80286612-b396-4341-9689-9a72713e3cae None None] For port 6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1,segment=NetworkSegment(f7dc6064-2e58-45ea-8d06-e72fce48a4e1),segment_id=f7dc6064-2e58-45ea-8d06-e72fce48a4e1)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:31:46.658829 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ad18f041-24c8-4c35-9afe-de4a0e23575a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:46.667733 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-80286612-b396-4341-9689-9a72713e3cae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:46.738859 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-86ef0285-7ae9-4442-abc6-5881699a73db None None] Network 406147ce-e94d-447c-8157-d0520c0fe008 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:31:46.911547 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-17c8d5a1-812d-43ab-aa04-9f5ea0b59ca1 None None] Provisioning complete for port 18ce346b-1ae1-4813-ba7a-28e98644fe02 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:46.911866 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-17c8d5a1-812d-43ab-aa04-9f5ea0b59ca1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:47.001931 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80286612-b396-4341-9689-9a72713e3cae None None] Pushing event updated for resources: {'Port': ['ID=6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:47.021416 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-714ec801-6b15-4780-9f29-7138ad5fe6ed None None] Set router eeac8998-5e81-4874-bc7a-2829c8a216f7 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:31:47.248899 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ad18f041-24c8-4c35-9afe-de4a0e23575a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:47.268456 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ad18f041-24c8-4c35-9afe-de4a0e23575a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:47.284736 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ad18f041-24c8-4c35-9afe-de4a0e23575a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:47.379801 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-17c8d5a1-812d-43ab-aa04-9f5ea0b59ca1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:47.394005 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c4ff03d-6795-43c9-a7d8-9ced44541427 req-279a5a5a-2ec7-41fc-9449-813b81c69f7d tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 210 time: 0.0628185 Dec 09 21:31:47.625894 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad18f041-24c8-4c35-9afe-de4a0e23575a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Port': ['ID=9ac7213c-28a4-48a4-8e5a-f304e387cb0e,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:47.695842 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad18f041-24c8-4c35-9afe-de4a0e23575a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network 406147ce-e94d-447c-8157-d0520c0fe008 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:31:47.699407 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-ad18f041-24c8-4c35-9afe-de4a0e23575a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:47.720652 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 18ce346b-1ae1-4813-ba7a-28e98644fe02 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:31:47.896488 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-17c8d5a1-812d-43ab-aa04-9f5ea0b59ca1 None None] For port 18ce346b-1ae1-4813-ba7a-28e98644fe02, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=18ce346b-1ae1-4813-ba7a-28e98644fe02,segment=NetworkSegment(eae9cb14-b1cf-47b8-a274-ca6ab72583d8),segment_id=eae9cb14-b1cf-47b8-a274-ca6ab72583d8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:31:47.923807 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-17c8d5a1-812d-43ab-aa04-9f5ea0b59ca1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:48.066906 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ad18f041-24c8-4c35-9afe-de4a0e23575a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Router e80f7e87-a887-48b5-b17f-6361e5ee661e is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:31:48.089765 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-714ec801-6b15-4780-9f29-7138ad5fe6ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'name': 'tempest-ServersTestBootFromVolume-1721587557-router', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163'}], 'enable_snat': True}, 'gw_port_id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:31Z', 'updated_at': '2021-12-09T21:28:40Z', 'revision_number': 4, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'gw_port': {'id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:5c:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1213, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:32Z', 'updated_at': '2021-12-09T21:28:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '4417739f-7bef-4bd0-b1eb-dab883253f64', 'name': '', 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'mac_address': 'fa:16:3e:a3:e6:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1221, 'fixed_ips': [{'subnet_id': '93335bf9-6f1e-4484-ae25-dca4b03b29b4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:37Z', 'updated_at': '2021-12-09T21:28:45Z', 'revision_number': 5, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'subnets': [{'id': '93335bf9-6f1e-4484-ae25-dca4b03b29b4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:48.094041 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 18ce346b-1ae1-4813-ba7a-28e98644fe02 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:48.094645 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:48.186429 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c8d5a1-812d-43ab-aa04-9f5ea0b59ca1 None None] Pushing event updated for resources: {'Port': ['ID=18ce346b-1ae1-4813-ba7a-28e98644fe02,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:48.213325 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-714ec801-6b15-4780-9f29-7138ad5fe6ed None None] The sync data for ids ['eeac8998-5e81-4874-bc7a-2829c8a216f7'] in n-d-713301-27 is: [{'id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'name': 'tempest-ServersTestBootFromVolume-1721587557-router', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163'}], 'enable_snat': True}, 'gw_port_id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:31Z', 'updated_at': '2021-12-09T21:28:40Z', 'revision_number': 4, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'gw_port': {'id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:5c:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1213, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:32Z', 'updated_at': '2021-12-09T21:28:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '4417739f-7bef-4bd0-b1eb-dab883253f64', 'name': '', 'network_id': 'b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'mac_address': 'fa:16:3e:a3:e6:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'device_owner': 'network:router_interface', 'standard_attr_id': 1221, 'fixed_ips': [{'subnet_id': '93335bf9-6f1e-4484-ae25-dca4b03b29b4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:37Z', 'updated_at': '2021-12-09T21:28:45Z', 'revision_number': 5, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'subnets': [{'id': '93335bf9-6f1e-4484-ae25-dca4b03b29b4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:31:48.247079 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2333d479-57fa-40a2-b31d-837713a24d82 None None] Provisioning complete for port 18ce346b-1ae1-4813-ba7a-28e98644fe02 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:48.247475 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2333d479-57fa-40a2-b31d-837713a24d82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:48.412964 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ad18f041-24c8-4c35-9afe-de4a0e23575a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:31:48.430618 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46204) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:48.431145 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47899712-0569-4381-9dfa-c8ad9596b0a2 None None] Sync routers for ids ['e80f7e87-a887-48b5-b17f-6361e5ee661e'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:31:48.431580 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ad18f041-24c8-4c35-9afe-de4a0e23575a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/routers/e80f7e87-a887-48b5-b17f-6361e5ee661e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.4744453 Dec 09 21:31:48.482270 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47899712-0569-4381-9dfa-c8ad9596b0a2 None None] Routers {'e80f7e87-a887-48b5-b17f-6361e5ee661e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:31:48.483002 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-47899712-0569-4381-9dfa-c8ad9596b0a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 10, "extensions": [], "floating_ips": 6, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:31:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['e80f7e87-a887-48b5-b17f-6361e5ee661e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:48.567317 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4b69020a-b4f3-4a39-881d-36532b647e59 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:48.598679 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46206) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:48.598923 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4b69020a-b4f3-4a39-881d-36532b647e59 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/ports/9ac7213c-28a4-48a4-8e5a-f304e387cb0e HTTP/1.1" status: 200 len: 911 time: 0.1637461 Dec 09 21:31:48.633256 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-47899712-0569-4381-9dfa-c8ad9596b0a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:48.661790 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47899712-0569-4381-9dfa-c8ad9596b0a2 None None] Routers {'e80f7e87-a887-48b5-b17f-6361e5ee661e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:31:48.662942 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-47899712-0569-4381-9dfa-c8ad9596b0a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 10, "extensions": [], "floating_ips": 6, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:31:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['e80f7e87-a887-48b5-b17f-6361e5ee661e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:48.753344 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a49b4dc6-05a5-4e50-8c8e-1cd030b8dae9 req-3df8f1a6-db3e-4e4e-a281-b53e777fdf3b tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 210 time: 0.1102786 Dec 09 21:31:48.786902 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-47899712-0569-4381-9dfa-c8ad9596b0a2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:48.788124 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47899712-0569-4381-9dfa-c8ad9596b0a2 None None] The sync data for ids ['e80f7e87-a887-48b5-b17f-6361e5ee661e'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:31:49.104165 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c55271df-850a-4c86-9e49-1a1198b0186b None None] New status for floating IP c8a74273-d4f2-4daa-b03c-d5fe21026216: DOWN {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:31:49.109367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 90f16e74-f2e6-416e-a079-f205615a0d8e up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:31:49.111874 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b22be87-b8ce-4d1a-beb4-d228addca752 None None] Network 64e20505-8304-4955-bb05-411a17db5d18 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:31:49.511692 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2333d479-57fa-40a2-b31d-837713a24d82 None None] Provisioning complete for port 9ac7213c-28a4-48a4-8e5a-f304e387cb0e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:49.512217 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2333d479-57fa-40a2-b31d-837713a24d82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:49.585897 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-2333d479-57fa-40a2-b31d-837713a24d82 None None] Port 9ac7213c-28a4-48a4-8e5a-f304e387cb0e cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:31:49.603268 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:31:49.611342 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 90f16e74-f2e6-416e-a079-f205615a0d8e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:49.612035 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:49.631614 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:49.774584 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:49.778907 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:49.936973 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3ee41a44-9d13-40f8-b865-b716aed942dc None None] Provisioning complete for port 6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:49.937388 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3ee41a44-9d13-40f8-b865-b716aed942dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:49.976280 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-981b77ca-54e5-4c24-988c-283c97974eff req-ed50fba2-73eb-4633-abd7-b2d5c92a16e9 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 210 time: 0.0527518 Dec 09 21:31:50.166626 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Allocated IP 2001:db8:1::1 (64e20505-8304-4955-bb05-411a17db5d18/c18b8bfe-b2f1-42b1-8850-7d3336d11c03/d6795c07-e7f8-4894-bb8f-19ea147d7274) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:31:50.288493 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:50.290330 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:50.379640 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3ee41a44-9d13-40f8-b865-b716aed942dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:50.383878 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:50.427234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1,segment=NetworkSegment(f7dc6064-2e58-45ea-8d06-e72fce48a4e1),segment_id=f7dc6064-2e58-45ea-8d06-e72fce48a4e1)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:31:50.441019 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:50.442051 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 18ce346b-1ae1-4813-ba7a-28e98644fe02 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:31:50.451361 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7ef6883d-9c98-4e81-b102-bc1197ac4a47', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '90f16e74-f2e6-416e-a079-f205615a0d8e'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:31:50.453868 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d6461e0a-34b2-4fea-a4de-048250ffe786" -d '{"events": [{"server_uuid": "7ef6883d-9c98-4e81-b102-bc1197ac4a47", "name": "network-vif-plugged", "status": "completed", "tag": "90f16e74-f2e6-416e-a079-f205615a0d8e"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:31:50.467428 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:50.562297 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network 64e20505-8304-4955-bb05-411a17db5d18 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:31:50.566162 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:50.570546 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:31:50.571118 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:50.581335 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:31:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e1cc15e2-8266-43f7-bff8-d83ccb5736cd x-openstack-request-id: req-e1cc15e2-8266-43f7-bff8-d83ccb5736cd {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:31:50.581641 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7ef6883d-9c98-4e81-b102-bc1197ac4a47", "name": "network-vif-plugged", "status": "completed", "tag": "90f16e74-f2e6-416e-a079-f205615a0d8e", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:31:50.581895 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e1cc15e2-8266-43f7-bff8-d83ccb5736cd {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:31:50.582293 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7ef6883d-9c98-4e81-b102-bc1197ac4a47', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '90f16e74-f2e6-416e-a079-f205615a0d8e', 'code': 200} Dec 09 21:31:50.590705 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 90f16e74-f2e6-416e-a079-f205615a0d8e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=90f16e74-f2e6-416e-a079-f205615a0d8e,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:31:50.637198 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:50.670419 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-3ee41a44-9d13-40f8-b865-b716aed942dc None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:31:50.670778 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-3ee41a44-9d13-40f8-b865-b716aed942dc None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:31:50.675340 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:50.721081 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 18ce346b-1ae1-4813-ba7a-28e98644fe02 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:50.721433 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:50.755834 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Port': ['ID=d6795c07-e7f8-4894-bb8f-19ea147d7274,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:50.776131 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=90f16e74-f2e6-416e-a079-f205615a0d8e,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:50.878954 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:51.122648 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8fdf0b5-555f-4fcd-9292-fab5ec59b34c req-1a9c7281-f1cf-4ef8-be25-989dddb351b8 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 210 time: 0.0491440 Dec 09 21:31:51.387374 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3ee41a44-9d13-40f8-b865-b716aed942dc None None] Provisioning complete for port 9ac7213c-28a4-48a4-8e5a-f304e387cb0e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:51.387978 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3ee41a44-9d13-40f8-b865-b716aed942dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:51.484943 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:31:51.592009 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-3ee41a44-9d13-40f8-b865-b716aed942dc None None] Port 9ac7213c-28a4-48a4-8e5a-f304e387cb0e cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:31:51.625761 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:51.628904 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:51.727658 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:51.764750 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-be2a8185-cdae-439c-a36a-0c002d9e751a None None] Provisioning complete for port 6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:51.765315 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-be2a8185-cdae-439c-a36a-0c002d9e751a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:51.775109 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:51.776796 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:51.851330 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Port': ['ID=d6795c07-e7f8-4894-bb8f-19ea147d7274,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:51.862515 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:51.862886 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:51.863204 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:51.863567 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:51.863904 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:51.864235 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:51.864565 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:51.864896 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:51.865224 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:51.865546 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:51.865868 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:51.866190 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:51.866647 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:51.901719 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-be2a8185-cdae-439c-a36a-0c002d9e751a None None] Provisioning complete for port d6795c07-e7f8-4894-bb8f-19ea147d7274 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:51.902122 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-be2a8185-cdae-439c-a36a-0c002d9e751a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:51.974357 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network 64e20505-8304-4955-bb05-411a17db5d18 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:31:51.976454 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:31:52.009201 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-be2a8185-cdae-439c-a36a-0c002d9e751a None None] Port d6795c07-e7f8-4894-bb8f-19ea147d7274 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:31:52.183996 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Router e80f7e87-a887-48b5-b17f-6361e5ee661e has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:31:52.296879 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9022fde-9933-47e5-ad71-36fc467a38bb req-87ff8521-b9bb-4903-a91d-5466829c0ae8 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 210 time: 0.0508642 Dec 09 21:31:52.498359 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e7903185-4d0e-4db3-a8e4-c8c72481981a None None] Provisioning complete for port d6795c07-e7f8-4894-bb8f-19ea147d7274 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:31:52.504953 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e7903185-4d0e-4db3-a8e4-c8c72481981a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:52.532191 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:31:52.552764 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf39ee97-bba7-4096-b607-b078a57a63f0 None None] Sync routers for ids ['e80f7e87-a887-48b5-b17f-6361e5ee661e'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:31:52.556912 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-31b8d45c-36b0-4d5c-8d41-be29b23c2fdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/routers/e80f7e87-a887-48b5-b17f-6361e5ee661e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.9570420 Dec 09 21:31:52.559634 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46280) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:52.577675 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf39ee97-bba7-4096-b607-b078a57a63f0 None None] Routers {'e80f7e87-a887-48b5-b17f-6361e5ee661e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:31:52.578354 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-bf39ee97-bba7-4096-b607-b078a57a63f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 10, "extensions": [], "floating_ips": 6, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:31:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['e80f7e87-a887-48b5-b17f-6361e5ee661e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:52.626510 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e7903185-4d0e-4db3-a8e4-c8c72481981a None None] Port d6795c07-e7f8-4894-bb8f-19ea147d7274 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:31:52.635472 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf7f034c-d8be-4c11-9bd4-453e4bcc4e3d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:31:52.638673 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cf7f034c-d8be-4c11-9bd4-453e4bcc4e3d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/ports/d6795c07-e7f8-4894-bb8f-19ea147d7274 HTTP/1.1" status: 200 len: 913 time: 0.0775886 Dec 09 21:31:52.642043 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46282) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:52.676133 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-bf39ee97-bba7-4096-b607-b078a57a63f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:52.687525 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf39ee97-bba7-4096-b607-b078a57a63f0 None None] Routers {'e80f7e87-a887-48b5-b17f-6361e5ee661e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:31:52.688799 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-bf39ee97-bba7-4096-b607-b078a57a63f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 10, "extensions": [], "floating_ips": 6, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:31:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['e80f7e87-a887-48b5-b17f-6361e5ee661e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:52.728035 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-bf39ee97-bba7-4096-b607-b078a57a63f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:52.728700 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf39ee97-bba7-4096-b607-b078a57a63f0 None None] The sync data for ids ['e80f7e87-a887-48b5-b17f-6361e5ee661e'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:31:52.783690 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46286) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:52.965406 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5110b17e-5004-4c24-975e-783bc66e5c20 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:53.166186 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5110b17e-5004-4c24-975e-783bc66e5c20 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:53.206675 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5110b17e-5004-4c24-975e-783bc66e5c20 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:53.262500 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5110b17e-5004-4c24-975e-783bc66e5c20 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=f42238f189d041cdb2f5ff8c5132219d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4776747 Dec 09 21:31:53.265478 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46290) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:53.265984 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5110b17e-5004-4c24-975e-783bc66e5c20 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9675e6d3-1146-4188-b4ba-5d9ed5523efa,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:53.279270 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5110b17e-5004-4c24-975e-783bc66e5c20 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:53.279708 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5110b17e-5004-4c24-975e-783bc66e5c20 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:53.280054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5110b17e-5004-4c24-975e-783bc66e5c20 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:53.280597 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5110b17e-5004-4c24-975e-783bc66e5c20 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:53.280936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5110b17e-5004-4c24-975e-783bc66e5c20 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:53.281389 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5110b17e-5004-4c24-975e-783bc66e5c20 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:53.282066 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5110b17e-5004-4c24-975e-783bc66e5c20 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:53.282591 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5110b17e-5004-4c24-975e-783bc66e5c20 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:53.283076 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5110b17e-5004-4c24-975e-783bc66e5c20 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:53.283585 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5110b17e-5004-4c24-975e-783bc66e5c20 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:53.284066 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5110b17e-5004-4c24-975e-783bc66e5c20 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:53.284582 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5110b17e-5004-4c24-975e-783bc66e5c20 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:53.285093 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5110b17e-5004-4c24-975e-783bc66e5c20 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:31:53.451206 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-05426830-51fd-4af0-939f-d3de6fc1f877 req-41c269f8-8669-4738-afa9-8e949e7541a9 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 210 time: 0.0321105 Dec 09 21:31:53.462910 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9b35f3fe-d13b-44bb-8f29-0ecade637d32 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:53.521413 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9b35f3fe-d13b-44bb-8f29-0ecade637d32 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:53.637902 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-73229159-35e5-472b-b98a-7c537ff24919 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:53.677405 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9b35f3fe-d13b-44bb-8f29-0ecade637d32 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:53.684435 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9b35f3fe-d13b-44bb-8f29-0ecade637d32 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:53.685863 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9b35f3fe-d13b-44bb-8f29-0ecade637d32 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/9675e6d3-1146-4188-b4ba-5d9ed5523efa HTTP/1.1" status: 204 len: 168 time: 0.4193885 Dec 09 21:31:53.718895 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b35f3fe-d13b-44bb-8f29-0ecade637d32 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9675e6d3-1146-4188-b4ba-5d9ed5523efa,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:54.033816 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-73229159-35e5-472b-b98a-7c537ff24919 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting port d6795c07-e7f8-4894-bb8f-19ea147d7274 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:31:54.034406 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-73229159-35e5-472b-b98a-7c537ff24919 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:54.173026 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-73229159-35e5-472b-b98a-7c537ff24919 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:54.208620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-73229159-35e5-472b-b98a-7c537ff24919 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Calling delete_port for d6795c07-e7f8-4894-bb8f-19ea147d7274 owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:31:54.484341 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-73229159-35e5-472b-b98a-7c537ff24919 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:54.614570 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73229159-35e5-472b-b98a-7c537ff24919 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Port': ['ID=d6795c07-e7f8-4894-bb8f-19ea147d7274,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:54.693628 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bef41015-e282-4913-abf2-5d27f14ddd23 req-18ad4a8d-30e0-45b3-a81a-4bade220b44d tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/ports?device_id=752d9ac2-7383-4bdb-b56f-3c52855d7fc9 HTTP/1.1" status: 200 len: 210 time: 0.0444920 Dec 09 21:31:54.912752 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-73229159-35e5-472b-b98a-7c537ff24919 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:55.562693 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-73229159-35e5-472b-b98a-7c537ff24919 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Router e80f7e87-a887-48b5-b17f-6361e5ee661e has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:31:55.728501 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-73229159-35e5-472b-b98a-7c537ff24919 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:31:55.744071 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03ada9a3-4f62-4bf2-9b3c-0364ba9c57be None None] Sync routers for ids ['e80f7e87-a887-48b5-b17f-6361e5ee661e'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:31:55.750366 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-73229159-35e5-472b-b98a-7c537ff24919 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/routers/e80f7e87-a887-48b5-b17f-6361e5ee661e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1039960 Dec 09 21:31:55.750833 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46356) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:55.759386 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03ada9a3-4f62-4bf2-9b3c-0364ba9c57be None None] Routers {'e80f7e87-a887-48b5-b17f-6361e5ee661e'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:31:55.760322 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-03ada9a3-4f62-4bf2-9b3c-0364ba9c57be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 10, "extensions": [], "floating_ips": 6, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:31:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['e80f7e87-a887-48b5-b17f-6361e5ee661e'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:55.900987 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-03ada9a3-4f62-4bf2-9b3c-0364ba9c57be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:55.928793 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46370) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:55.930351 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03ada9a3-4f62-4bf2-9b3c-0364ba9c57be None None] Routers {'e80f7e87-a887-48b5-b17f-6361e5ee661e'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:31:55.930991 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-03ada9a3-4f62-4bf2-9b3c-0364ba9c57be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 10, "extensions": [], "floating_ips": 6, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:31:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['e80f7e87-a887-48b5-b17f-6361e5ee661e'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:56.057847 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-03ada9a3-4f62-4bf2-9b3c-0364ba9c57be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:56.073426 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03ada9a3-4f62-4bf2-9b3c-0364ba9c57be None None] The sync data for ids ['e80f7e87-a887-48b5-b17f-6361e5ee661e'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:31:56.079227 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-826b7565-2524-450a-ad12-50e61fe01007 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:56.150311 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-826b7565-2524-450a-ad12-50e61fe01007 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:56.279542 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-826b7565-2524-450a-ad12-50e61fe01007 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:56.283394 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-826b7565-2524-450a-ad12-50e61fe01007 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:56.287019 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-826b7565-2524-450a-ad12-50e61fe01007 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "DELETE /v2.0/security-groups/02690a1b-c814-4a6b-a7d8-1252ee74106e HTTP/1.1" status: 204 len: 168 time: 0.3548691 Dec 09 21:31:56.289210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46378) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:56.333268 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-ca1af003-b905-4d2a-b62d-b224a64f3366 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] show failed (client error): The resource could not be found. Dec 09 21:31:56.334372 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ca1af003-b905-4d2a-b62d-b224a64f3366 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "GET /v2.0/security-groups/02690a1b-c814-4a6b-a7d8-1252ee74106e HTTP/1.1" status: 404 len: 347 time: 0.0441532 Dec 09 21:31:56.338237 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46380) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:56.354175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-826b7565-2524-450a-ad12-50e61fe01007 tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=02690a1b-c814-4a6b-a7d8-1252ee74106e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:56.605890 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-cd3cac7f-e0d5-486a-bb48-64d173eab72a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Deleting port 4b5f65e7-70fc-4047-a3ff-bc617dae38a0 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:31:56.606227 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd3cac7f-e0d5-486a-bb48-64d173eab72a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:56.711291 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d534fd6-8175-48db-8639-e5a68f4cc5e6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:56.844130 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd3cac7f-e0d5-486a-bb48-64d173eab72a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:56.844811 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd3cac7f-e0d5-486a-bb48-64d173eab72a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:56.867776 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-cd3cac7f-e0d5-486a-bb48-64d173eab72a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Calling delete_port for 4b5f65e7-70fc-4047-a3ff-bc617dae38a0 owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:31:57.183614 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd3cac7f-e0d5-486a-bb48-64d173eab72a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:57.232228 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-9d534fd6-8175-48db-8639-e5a68f4cc5e6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting port 9ac7213c-28a4-48a4-8e5a-f304e387cb0e {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:31:57.232721 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d534fd6-8175-48db-8639-e5a68f4cc5e6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:57.237944 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd3cac7f-e0d5-486a-bb48-64d173eab72a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Pushing event deleted for resources: {'Port': ['ID=4b5f65e7-70fc-4047-a3ff-bc617dae38a0,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:57.261025 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:57.264161 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:57.268544 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-147e80d6-b6c3-4f69-8f1c-f39c73a83031 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:31:57.391149 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd3cac7f-e0d5-486a-bb48-64d173eab72a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:57.393918 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd3cac7f-e0d5-486a-bb48-64d173eab72a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:57.395193 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cd3cac7f-e0d5-486a-bb48-64d173eab72a tempest-ServersTestBootFromVolume-2109046295 tempest-ServersTestBootFromVolume-2109046295-project] 10.222.0.13 "DELETE /v2.0/floatingips/c8a74273-d4f2-4daa-b03c-d5fe21026216 HTTP/1.1" status: 204 len: 168 time: 1.0541713 Dec 09 21:31:57.398619 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46408) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:57.430984 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d534fd6-8175-48db-8639-e5a68f4cc5e6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:57.457072 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-9d534fd6-8175-48db-8639-e5a68f4cc5e6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Calling delete_port for 9ac7213c-28a4-48a4-8e5a-f304e387cb0e owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:31:57.697657 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d534fd6-8175-48db-8639-e5a68f4cc5e6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:57.781644 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d534fd6-8175-48db-8639-e5a68f4cc5e6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Port': ['ID=9ac7213c-28a4-48a4-8e5a-f304e387cb0e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:57.940117 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d534fd6-8175-48db-8639-e5a68f4cc5e6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:58.087924 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d9ba4bae-e555-4512-888f-3e0c0e7294f9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:58.195726 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9d534fd6-8175-48db-8639-e5a68f4cc5e6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Router e80f7e87-a887-48b5-b17f-6361e5ee661e has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:31:58.349103 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9d534fd6-8175-48db-8639-e5a68f4cc5e6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:31:58.360361 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9d534fd6-8175-48db-8639-e5a68f4cc5e6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/routers/e80f7e87-a887-48b5-b17f-6361e5ee661e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6083858 Dec 09 21:31:58.361360 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46424) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:58.362608 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc9e6938-c628-4ddf-ac95-678dbbe0afbe None None] Sync routers for ids ['e80f7e87-a887-48b5-b17f-6361e5ee661e'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:31:58.386252 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc9e6938-c628-4ddf-ac95-678dbbe0afbe None None] Routers {'e80f7e87-a887-48b5-b17f-6361e5ee661e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:31:58.388818 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-cc9e6938-c628-4ddf-ac95-678dbbe0afbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 10, "extensions": [], "floating_ips": 6, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:31:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['e80f7e87-a887-48b5-b17f-6361e5ee661e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:58.455494 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8bb8634a-2ed5-46a1-a212-133bc1d19c33 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/ports?device_id=e80f7e87-a887-48b5-b17f-6361e5ee661e HTTP/1.1" status: 200 len: 205 time: 0.0898862 Dec 09 21:31:58.457288 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46426) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:58.521716 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-cc9e6938-c628-4ddf-ac95-678dbbe0afbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:58.555877 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc9e6938-c628-4ddf-ac95-678dbbe0afbe None None] Routers {'e80f7e87-a887-48b5-b17f-6361e5ee661e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:31:58.556723 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-cc9e6938-c628-4ddf-ac95-678dbbe0afbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 10, "extensions": [], "floating_ips": 6, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:31:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['e80f7e87-a887-48b5-b17f-6361e5ee661e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:58.616638 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-cc9e6938-c628-4ddf-ac95-678dbbe0afbe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:31:58.617775 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc9e6938-c628-4ddf-ac95-678dbbe0afbe None None] The sync data for ids ['e80f7e87-a887-48b5-b17f-6361e5ee661e'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:31:58.666586 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46434) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:58.712591 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4cd7dd2c-9a21-4d1d-b8fe-4efe1b2f9ca6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:58.885378 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2b409fd4-f8a5-4565-af8a-78fbfd5afcaf admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:58.954777 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4cd7dd2c-9a21-4d1d-b8fe-4efe1b2f9ca6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:58.959649 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4cd7dd2c-9a21-4d1d-b8fe-4efe1b2f9ca6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:58.985465 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2b409fd4-f8a5-4565-af8a-78fbfd5afcaf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:58.990999 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2b409fd4-f8a5-4565-af8a-78fbfd5afcaf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:59.026901 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-d9ba4bae-e555-4512-888f-3e0c0e7294f9 admin admin] Deleting port 4417739f-7bef-4bd0-b1eb-dab883253f64 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:31:59.027320 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d9ba4bae-e555-4512-888f-3e0c0e7294f9 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:59.030655 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4cd7dd2c-9a21-4d1d-b8fe-4efe1b2f9ca6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:59.031938 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4cd7dd2c-9a21-4d1d-b8fe-4efe1b2f9ca6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Fanout notify agent at l3_agent the message router_deleted on router e80f7e87-a887-48b5-b17f-6361e5ee661e {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:31:59.048760 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2b409fd4-f8a5-4565-af8a-78fbfd5afcaf admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e8065c2ac0e94f7a8e7958023c4165b6&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3800786 Dec 09 21:31:59.052319 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46438) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:59.054208 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b409fd4-f8a5-4565-af8a-78fbfd5afcaf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=04e6bbfd-6820-4dd1-b066-911444b38c81,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:59.060521 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4cd7dd2c-9a21-4d1d-b8fe-4efe1b2f9ca6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:59.065615 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4cd7dd2c-9a21-4d1d-b8fe-4efe1b2f9ca6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/routers/e80f7e87-a887-48b5-b17f-6361e5ee661e HTTP/1.1" status: 204 len: 168 time: 0.6045606 Dec 09 21:31:59.065730 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46440) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:59.163927 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e4b7f621-1c20-4cb6-b2cd-9e726382db53 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:59.198625 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-d9ba4bae-e555-4512-888f-3e0c0e7294f9 admin admin] For port 4417739f-7bef-4bd0-b1eb-dab883253f64, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=4417739f-7bef-4bd0-b1eb-dab883253f64,segment=NetworkSegment(dc772362-7c7f-473d-bb4b-7b6705959a15),segment_id=dc772362-7c7f-473d-bb4b-7b6705959a15)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:31:59.199522 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d9ba4bae-e555-4512-888f-3e0c0e7294f9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:59.200065 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-9264d5c2-e49a-473d-9e94-79a7c418e15f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting subnet c18b8bfe-b2f1-42b1-8850-7d3336d11c03 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:31:59.203718 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9264d5c2-e49a-473d-9e94-79a7c418e15f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:59.214627 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-d9ba4bae-e555-4512-888f-3e0c0e7294f9 admin admin] Calling delete_port for 4417739f-7bef-4bd0-b1eb-dab883253f64 owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:31:59.251067 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e4b7f621-1c20-4cb6-b2cd-9e726382db53 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:59.277592 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9264d5c2-e49a-473d-9e94-79a7c418e15f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:59.453954 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e4b7f621-1c20-4cb6-b2cd-9e726382db53 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:59.457265 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e4b7f621-1c20-4cb6-b2cd-9e726382db53 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:59.461455 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e4b7f621-1c20-4cb6-b2cd-9e726382db53 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/04e6bbfd-6820-4dd1-b066-911444b38c81 HTTP/1.1" status: 204 len: 168 time: 0.4026012 Dec 09 21:31:59.489805 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4b7f621-1c20-4cb6-b2cd-9e726382db53 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=04e6bbfd-6820-4dd1-b066-911444b38c81,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:59.496214 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9264d5c2-e49a-473d-9e94-79a7c418e15f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:59.637913 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9264d5c2-e49a-473d-9e94-79a7c418e15f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:59.666813 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d9ba4bae-e555-4512-888f-3e0c0e7294f9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:59.689839 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9264d5c2-e49a-473d-9e94-79a7c418e15f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Subnet': ['ID=c18b8bfe-b2f1-42b1-8850-7d3336d11c03,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:59.710729 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df2753cc-14b2-46ea-972f-a9879ea62d46 None None] Network 64e20505-8304-4955-bb05-411a17db5d18 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:31:59.712051 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9264d5c2-e49a-473d-9e94-79a7c418e15f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:59.717852 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9264d5c2-e49a-473d-9e94-79a7c418e15f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/subnets/c18b8bfe-b2f1-42b1-8850-7d3336d11c03 HTTP/1.1" status: 204 len: 168 time: 0.6488316 Dec 09 21:31:59.720113 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46454) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:31:59.727005 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9ba4bae-e555-4512-888f-3e0c0e7294f9 admin admin] Pushing event deleted for resources: {'Port': ['ID=4417739f-7bef-4bd0-b1eb-dab883253f64,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:31:59.846292 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-894208af-d649-472a-b7fd-4d97cd1cdd95 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting subnet e221e85c-451a-4f41-b14a-5bb277809971 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:31:59.851115 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-894208af-d649-472a-b7fd-4d97cd1cdd95 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:31:59.919492 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-894208af-d649-472a-b7fd-4d97cd1cdd95 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:00.075650 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-894208af-d649-472a-b7fd-4d97cd1cdd95 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:00.084393 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d9ba4bae-e555-4512-888f-3e0c0e7294f9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:00.090260 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e074f2bc-e5aa-4768-9e88-75c44297c5f1 None None] DHCP port deletion for 64e20505-8304-4955-bb05-411a17db5d18 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:32:00.178385 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-894208af-d649-472a-b7fd-4d97cd1cdd95 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:00.197122 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46458) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:00.204323 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e074f2bc-e5aa-4768-9e88-75c44297c5f1 None None] Deleting port 6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:32:00.205337 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e074f2bc-e5aa-4768-9e88-75c44297c5f1 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:00.229958 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-47044c98-3fc7-42a7-9f0f-8a694381befa admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:00.258017 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-894208af-d649-472a-b7fd-4d97cd1cdd95 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Subnet': ['ID=e221e85c-451a-4f41-b14a-5bb277809971,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:00.268525 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-894208af-d649-472a-b7fd-4d97cd1cdd95 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:00.281945 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-894208af-d649-472a-b7fd-4d97cd1cdd95 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/subnets/e221e85c-451a-4f41-b14a-5bb277809971 HTTP/1.1" status: 204 len: 168 time: 0.5590825 Dec 09 21:32:00.282239 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46460) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:00.291416 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d40069cd-a673-425a-9ca6-6c5d8d2362ad None None] Network 406147ce-e94d-447c-8157-d0520c0fe008 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:32:00.408175 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e074f2bc-e5aa-4768-9e88-75c44297c5f1 None None] For port 6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1,segment=NetworkSegment(f7dc6064-2e58-45ea-8d06-e72fce48a4e1),segment_id=f7dc6064-2e58-45ea-8d06-e72fce48a4e1)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:00.408581 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e074f2bc-e5aa-4768-9e88-75c44297c5f1 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:00.468339 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e074f2bc-e5aa-4768-9e88-75c44297c5f1 None None] Calling delete_port for 6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:32:00.499943 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-311b40e4-d027-41ff-b847-ca0e923564fe tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:00.636796 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e074f2bc-e5aa-4768-9e88-75c44297c5f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:00.685798 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-311b40e4-d027-41ff-b847-ca0e923564fe tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] The port '6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1' was deleted {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1958}} Dec 09 21:32:00.712314 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e074f2bc-e5aa-4768-9e88-75c44297c5f1 None None] No DVR routers for this DVR port 6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:32:00.717945 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ef513a66-8763-493a-8e12-16e9abbf659b None None] DHCP port deletion for 406147ce-e94d-447c-8157-d0520c0fe008 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:32:00.724159 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e074f2bc-e5aa-4768-9e88-75c44297c5f1 None None] Pushing event deleted for resources: {'Port': ['ID=6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:00.794660 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-47044c98-3fc7-42a7-9f0f-8a694381befa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:00.801740 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ef513a66-8763-493a-8e12-16e9abbf659b None None] Deleting port 18ce346b-1ae1-4813-ba7a-28e98644fe02 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:32:00.802253 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ef513a66-8763-493a-8e12-16e9abbf659b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:00.809579 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-47044c98-3fc7-42a7-9f0f-8a694381befa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:00.884244 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ef513a66-8763-493a-8e12-16e9abbf659b None None] For port 18ce346b-1ae1-4813-ba7a-28e98644fe02, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=18ce346b-1ae1-4813-ba7a-28e98644fe02,segment=NetworkSegment(eae9cb14-b1cf-47b8-a274-ca6ab72583d8),segment_id=eae9cb14-b1cf-47b8-a274-ca6ab72583d8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:00.884689 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ef513a66-8763-493a-8e12-16e9abbf659b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:00.899916 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-311b40e4-d027-41ff-b847-ca0e923564fe tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:00.903775 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ef513a66-8763-493a-8e12-16e9abbf659b None None] Calling delete_port for 18ce346b-1ae1-4813-ba7a-28e98644fe02 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:32:00.928697 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-47044c98-3fc7-42a7-9f0f-8a694381befa admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=0a931edb31a142a393e3bb815b965364&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7276065 Dec 09 21:32:00.929013 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46472) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:00.931282 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d9ba4bae-e555-4512-888f-3e0c0e7294f9 admin admin] Router eeac8998-5e81-4874-bc7a-2829c8a216f7 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:32:00.941711 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47044c98-3fc7-42a7-9f0f-8a694381befa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=abb5e868-3f14-419b-85df-6e738c8c79e2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:00.947117 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-311b40e4-d027-41ff-b847-ca0e923564fe tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['64e20505-8304-4955-bb05-411a17db5d18']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:00.962130 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-311b40e4-d027-41ff-b847-ca0e923564fe tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f7dc6064-2e58-45ea-8d06-e72fce48a4e1') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:00.962449 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-311b40e4-d027-41ff-b847-ca0e923564fe tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f7dc6064-2e58-45ea-8d06-e72fce48a4e1') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:00.976648 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-311b40e4-d027-41ff-b847-ca0e923564fe tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:01.017120 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b0f48878-cc20-49cb-89ec-aa754101a323 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:01.034098 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-311b40e4-d027-41ff-b847-ca0e923564fe tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:01.046877 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-311b40e4-d027-41ff-b847-ca0e923564fe tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Releasing vlan 122 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:32:01.047191 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-311b40e4-d027-41ff-b847-ca0e923564fe tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:32:01.050965 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:32:01.071653 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ef513a66-8763-493a-8e12-16e9abbf659b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:01.074337 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b0f48878-cc20-49cb-89ec-aa754101a323 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:01.102684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d9ba4bae-e555-4512-888f-3e0c0e7294f9 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:32:01.106930 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef513a66-8763-493a-8e12-16e9abbf659b None None] Pushing event deleted for resources: {'Port': ['ID=18ce346b-1ae1-4813-ba7a-28e98644fe02,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:01.120664 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef513a66-8763-493a-8e12-16e9abbf659b None None] No DVR routers for this DVR port 18ce346b-1ae1-4813-ba7a-28e98644fe02 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:32:01.122154 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d9ba4bae-e555-4512-888f-3e0c0e7294f9 admin admin] 10.222.0.13 "PUT /v2.0/routers/eeac8998-5e81-4874-bc7a-2829c8a216f7/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.7223372 Dec 09 21:32:01.131656 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46474) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:01.146314 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b804663-24aa-4ef8-ab3a-bacc807a3dc2 None None] Sync routers for ids ['eeac8998-5e81-4874-bc7a-2829c8a216f7'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:32:01.166674 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b804663-24aa-4ef8-ab3a-bacc807a3dc2 None None] Routers {'eeac8998-5e81-4874-bc7a-2829c8a216f7'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:32:01.167487 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-3b804663-24aa-4ef8-ab3a-bacc807a3dc2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 10, "extensions": [], "floating_ips": 6, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:31:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['eeac8998-5e81-4874-bc7a-2829c8a216f7'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:01.229665 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-311b40e4-d027-41ff-b847-ca0e923564fe tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:01.237578 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-311b40e4-d027-41ff-b847-ca0e923564fe tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:01.242439 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-311b40e4-d027-41ff-b847-ca0e923564fe tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/networks/64e20505-8304-4955-bb05-411a17db5d18 HTTP/1.1" status: 204 len: 168 time: 0.9577820 Dec 09 21:32:01.247451 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46476) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:01.281318 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-311b40e4-d027-41ff-b847-ca0e923564fe tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Network': ['ID=64e20505-8304-4955-bb05-411a17db5d18,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:01.338408 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-3b804663-24aa-4ef8-ab3a-bacc807a3dc2 None None] Set router eeac8998-5e81-4874-bc7a-2829c8a216f7 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:32:01.343431 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b0f48878-cc20-49cb-89ec-aa754101a323 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:01.346324 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b0f48878-cc20-49cb-89ec-aa754101a323 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:01.350172 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b0f48878-cc20-49cb-89ec-aa754101a323 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/abb5e868-3f14-419b-85df-6e738c8c79e2 HTTP/1.1" status: 204 len: 168 time: 0.4174540 Dec 09 21:32:01.419075 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0f48878-cc20-49cb-89ec-aa754101a323 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=abb5e868-3f14-419b-85df-6e738c8c79e2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:01.438086 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-29eb2aaa-d651-4f1f-bf57-c7924fc5b126 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:01.444912 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf5f9221-33a6-4d68-bcf9-37d7b8f643e1 admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:01.686730 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:32:01.721824 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:32:01.722642 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6a4ce8b5-728b-4a0c-a0cc-a61a43f7f8d1 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:32:01.723122 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 18ce346b-1ae1-4813-ba7a-28e98644fe02 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:32:01.752455 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-29eb2aaa-d651-4f1f-bf57-c7924fc5b126 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:01.774998 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 18ce346b-1ae1-4813-ba7a-28e98644fe02 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:32:01.775353 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 18ce346b-1ae1-4813-ba7a-28e98644fe02 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:32:01.996271 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-3b804663-24aa-4ef8-ab3a-bacc807a3dc2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'name': 'tempest-ServersTestBootFromVolume-1721587557-router', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163'}], 'enable_snat': True}, 'gw_port_id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:31Z', 'updated_at': '2021-12-09T21:31:59Z', 'revision_number': 5, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'gw_port': {'id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:5c:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1213, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:32Z', 'updated_at': '2021-12-09T21:28:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:02.028282 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b804663-24aa-4ef8-ab3a-bacc807a3dc2 None None] Checking router: eeac8998-5e81-4874-bc7a-2829c8a216f7 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:32:02.039040 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b804663-24aa-4ef8-ab3a-bacc807a3dc2 None None] Routers {'eeac8998-5e81-4874-bc7a-2829c8a216f7'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:32:02.039706 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-3b804663-24aa-4ef8-ab3a-bacc807a3dc2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 10, "extensions": [], "floating_ips": 6, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:31:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['eeac8998-5e81-4874-bc7a-2829c8a216f7'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:02.070098 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:32:02.216916 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-3b804663-24aa-4ef8-ab3a-bacc807a3dc2 None None] Set router eeac8998-5e81-4874-bc7a-2829c8a216f7 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:32:02.306922 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-29eb2aaa-d651-4f1f-bf57-c7924fc5b126 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['406147ce-e94d-447c-8157-d0520c0fe008']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:02.316932 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf5f9221-33a6-4d68-bcf9-37d7b8f643e1 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:02.324511 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-29eb2aaa-d651-4f1f-bf57-c7924fc5b126 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'eae9cb14-b1cf-47b8-a274-ca6ab72583d8') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:02.324685 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-29eb2aaa-d651-4f1f-bf57-c7924fc5b126 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'eae9cb14-b1cf-47b8-a274-ca6ab72583d8') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:02.336821 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-29eb2aaa-d651-4f1f-bf57-c7924fc5b126 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:02.379480 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-29eb2aaa-d651-4f1f-bf57-c7924fc5b126 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:02.388394 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-29eb2aaa-d651-4f1f-bf57-c7924fc5b126 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Releasing vlan 133 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:32:02.388813 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-29eb2aaa-d651-4f1f-bf57-c7924fc5b126 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:32:02.392452 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:32:02.465595 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-cf5f9221-33a6-4d68-bcf9-37d7b8f643e1 admin admin] Deleting port a86b6971-a767-4594-8a0c-17a90908b6c3 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:32:02.465989 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf5f9221-33a6-4d68-bcf9-37d7b8f643e1 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:02.557690 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-3b804663-24aa-4ef8-ab3a-bacc807a3dc2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'name': 'tempest-ServersTestBootFromVolume-1721587557-router', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163'}], 'enable_snat': True}, 'gw_port_id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:31Z', 'updated_at': '2021-12-09T21:31:59Z', 'revision_number': 5, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'gw_port': {'id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:5c:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1213, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:32Z', 'updated_at': '2021-12-09T21:28:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:02.559806 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-29eb2aaa-d651-4f1f-bf57-c7924fc5b126 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:02.596812 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3b804663-24aa-4ef8-ab3a-bacc807a3dc2 None None] The sync data for ids ['eeac8998-5e81-4874-bc7a-2829c8a216f7'] in n-d-713301-27 is: [{'id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'name': 'tempest-ServersTestBootFromVolume-1721587557-router', 'tenant_id': '77fc0831d6584a36b61a4823157f9c1d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163'}], 'enable_snat': True}, 'gw_port_id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:31Z', 'updated_at': '2021-12-09T21:31:59Z', 'revision_number': 5, 'project_id': '77fc0831d6584a36b61a4823157f9c1d', 'gw_port': {'id': 'a86b6971-a767-4594-8a0c-17a90908b6c3', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d2:5c:0e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eeac8998-5e81-4874-bc7a-2829c8a216f7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1213, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.163', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:32Z', 'updated_at': '2021-12-09T21:28:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:32:02.603784 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-29eb2aaa-d651-4f1f-bf57-c7924fc5b126 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:02.611738 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-29eb2aaa-d651-4f1f-bf57-c7924fc5b126 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/networks/406147ce-e94d-447c-8157-d0520c0fe008 HTTP/1.1" status: 204 len: 168 time: 1.3596063 Dec 09 21:32:02.612521 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46512) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:02.618837 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-de04a1cb-e145-4029-8634-ebf4e15aa770 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-520824818'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:02.655394 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29eb2aaa-d651-4f1f-bf57-c7924fc5b126 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Network': ['ID=406147ce-e94d-447c-8157-d0520c0fe008,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:02.675116 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-de04a1cb-e145-4029-8634-ebf4e15aa770 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Made reservation on behalf of dc5c46f00552473abc0991c0cc4a0269 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:32:02.679113 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-de04a1cb-e145-4029-8634-ebf4e15aa770 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:02.697968 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-cf5f9221-33a6-4d68-bcf9-37d7b8f643e1 admin admin] For port a86b6971-a767-4594-8a0c-17a90908b6c3, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a86b6971-a767-4594-8a0c-17a90908b6c3,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:02.697968 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf5f9221-33a6-4d68-bcf9-37d7b8f643e1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:02.726161 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-cf5f9221-33a6-4d68-bcf9-37d7b8f643e1 admin admin] Calling delete_port for a86b6971-a767-4594-8a0c-17a90908b6c3 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:32:02.732222 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-de04a1cb-e145-4029-8634-ebf4e15aa770 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] vlan segment allocate from pool success with {'vlan_id': 143, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:32:02.755342 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-de04a1cb-e145-4029-8634-ebf4e15aa770 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:02.755722 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-de04a1cb-e145-4029-8634-ebf4e15aa770 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Added segment 4b6f3a1f-ac89-47be-8f69-91cda270a8fe of type vlan for network f1c8b45c-51c3-48dd-ad45-340a4766abd6 Dec 09 21:32:02.875527 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-de04a1cb-e145-4029-8634-ebf4e15aa770 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:02.956872 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-de04a1cb-e145-4029-8634-ebf4e15aa770 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:02.973741 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-de04a1cb-e145-4029-8634-ebf4e15aa770 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:02.974780 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-de04a1cb-e145-4029-8634-ebf4e15aa770 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:02.981254 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf5f9221-33a6-4d68-bcf9-37d7b8f643e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:02.983838 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-71a0d326-69b6-45d8-ac4b-964ab52f7664 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:03.037404 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dbf14776-1a6e-4ae0-aa6c-236066374208 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:32:03.096339 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-de04a1cb-e145-4029-8634-ebf4e15aa770 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.4825418 Dec 09 21:32:03.101509 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46528) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:03.104283 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf5f9221-33a6-4d68-bcf9-37d7b8f643e1 admin admin] Pushing event deleted for resources: {'Port': ['ID=a86b6971-a767-4594-8a0c-17a90908b6c3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:03.109275 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-e06dbb34-8a3a-4130-a922-027dbfe7f00f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'subnet': {'network_id': 'f1c8b45c-51c3-48dd-ad45-340a4766abd6', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:03.126377 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf5f9221-33a6-4d68-bcf9-37d7b8f643e1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:03.194614 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de04a1cb-e145-4029-8634-ebf4e15aa770 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Network': ['ID=f1c8b45c-51c3-48dd-ad45-340a4766abd6,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:03.213793 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network f1c8b45c-51c3-48dd-ad45-340a4766abd6 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:32:03.287638 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf5f9221-33a6-4d68-bcf9-37d7b8f643e1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:03.291610 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf5f9221-33a6-4d68-bcf9-37d7b8f643e1 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:03.365485 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf5f9221-33a6-4d68-bcf9-37d7b8f643e1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:03.366229 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cf5f9221-33a6-4d68-bcf9-37d7b8f643e1 admin admin] Fanout notify agent at l3_agent the message router_deleted on router eeac8998-5e81-4874-bc7a-2829c8a216f7 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:32:03.378508 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf5f9221-33a6-4d68-bcf9-37d7b8f643e1 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:03.379768 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cf5f9221-33a6-4d68-bcf9-37d7b8f643e1 admin admin] 10.222.0.13 "DELETE /v2.0/routers/eeac8998-5e81-4874-bc7a-2829c8a216f7 HTTP/1.1" status: 204 len: 168 time: 2.2502041 Dec 09 21:32:03.382472 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46534) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:03.407260 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 4417739f-7bef-4bd0-b1eb-dab883253f64 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:32:03.437395 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 4417739f-7bef-4bd0-b1eb-dab883253f64 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:32:03.437864 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 4417739f-7bef-4bd0-b1eb-dab883253f64 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:32:03.456034 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e06dbb34-8a3a-4130-a922-027dbfe7f00f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Made reservation on behalf of dc5c46f00552473abc0991c0cc4a0269 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:32:03.459661 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e06dbb34-8a3a-4130-a922-027dbfe7f00f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:03.551186 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-fb57c015-dfdb-447a-b1ab-6dccb1a8a185 admin admin] Deleting subnet 93335bf9-6f1e-4484-ae25-dca4b03b29b4 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:32:03.554506 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fb57c015-dfdb-447a-b1ab-6dccb1a8a185 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:03.617803 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fb57c015-dfdb-447a-b1ab-6dccb1a8a185 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:04.204118 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fb57c015-dfdb-447a-b1ab-6dccb1a8a185 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:04.282912 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e06dbb34-8a3a-4130-a922-027dbfe7f00f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:04.328985 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fb57c015-dfdb-447a-b1ab-6dccb1a8a185 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:04.355051 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fb57c015-dfdb-447a-b1ab-6dccb1a8a185 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:04.362092 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fb57c015-dfdb-447a-b1ab-6dccb1a8a185 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/93335bf9-6f1e-4484-ae25-dca4b03b29b4 HTTP/1.1" status: 204 len: 168 time: 0.9747522 Dec 09 21:32:04.362278 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71948d9e-664e-4c0a-a95c-1b5afd5464b4 None None] Network b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:32:04.362711 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46576) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:04.368980 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e06dbb34-8a3a-4130-a922-027dbfe7f00f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Subnet': ['ID=656050ab-3f89-43f6-9ab6-f893898d871f,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:04.403343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb57c015-dfdb-447a-b1ab-6dccb1a8a185 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=93335bf9-6f1e-4484-ae25-dca4b03b29b4,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:04.409469 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e06dbb34-8a3a-4130-a922-027dbfe7f00f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Checking segment: {'id': '4b6f3a1f-ac89-47be-8f69-91cda270a8fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'f1c8b45c-51c3-48dd-ad45-340a4766abd6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:32:04.409830 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e06dbb34-8a3a-4130-a922-027dbfe7f00f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network hostable DHCP agents. Network: f1c8b45c-51c3-48dd-ad45-340a4766abd6, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:32:04.431929 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e06dbb34-8a3a-4130-a922-027dbfe7f00f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network f1c8b45c-51c3-48dd-ad45-340a4766abd6 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:32:04.449054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-e06dbb34-8a3a-4130-a922-027dbfe7f00f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, f1c8b45c-51c3-48dd-ad45-340a4766abd6) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:32:04.465804 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e06dbb34-8a3a-4130-a922-027dbfe7f00f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:04.466791 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e06dbb34-8a3a-4130-a922-027dbfe7f00f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:04.477426 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-596a43f4-3d4d-41f6-9e9c-fa30a6a806b9 None None] Network f1c8b45c-51c3-48dd-ad45-340a4766abd6 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:32:04.478473 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2bc76a7c-5139-4ed0-8ece-b2fc096282fe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:04.491260 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e06dbb34-8a3a-4130-a922-027dbfe7f00f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.3851762 Dec 09 21:32:04.491642 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46580) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:04.502197 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-bbc422e4-96ef-4948-90fc-360091db6c5c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-539617291', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:04.550710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-2bc76a7c-5139-4ed0-8ece-b2fc096282fe admin admin] Deleting port 3c106718-124c-4283-bf92-9c0013914134 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:32:04.552073 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2bc76a7c-5139-4ed0-8ece-b2fc096282fe admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:04.579746 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bbc422e4-96ef-4948-90fc-360091db6c5c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:04.581371 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bbc422e4-96ef-4948-90fc-360091db6c5c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:04.645351 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb0fecce-de3d-42ab-91e8-0be9c0a4b74a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-f1c8b45c-51c3-48dd-ad45-340a4766abd6', 'network_id': 'f1c8b45c-51c3-48dd-ad45-340a4766abd6', 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'fixed_ips': [{'subnet_id': '656050ab-3f89-43f6-9ab6-f893898d871f'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:32:04.646601 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb0fecce-de3d-42ab-91e8-0be9c0a4b74a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:04.663873 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bbc422e4-96ef-4948-90fc-360091db6c5c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:04.673809 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bbc422e4-96ef-4948-90fc-360091db6c5c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:04.693009 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-2bc76a7c-5139-4ed0-8ece-b2fc096282fe admin admin] For port 3c106718-124c-4283-bf92-9c0013914134, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=3c106718-124c-4283-bf92-9c0013914134,segment=NetworkSegment(dc772362-7c7f-473d-bb4b-7b6705959a15),segment_id=dc772362-7c7f-473d-bb4b-7b6705959a15)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:04.693380 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2bc76a7c-5139-4ed0-8ece-b2fc096282fe admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:04.711971 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-2bc76a7c-5139-4ed0-8ece-b2fc096282fe admin admin] Calling delete_port for 3c106718-124c-4283-bf92-9c0013914134 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:32:04.715866 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bbc422e4-96ef-4948-90fc-360091db6c5c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:04.724537 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46586) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:04.726803 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bbc422e4-96ef-4948-90fc-360091db6c5c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.2335780 Dec 09 21:32:04.728935 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-208064ff-0866-42a8-85a3-1d30a096c775 None None] DHCP port deletion for b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:32:04.731738 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-6469841e-7e5a-4815-bb80-81d438a1b4b5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'port': {'network_id': 'f1c8b45c-51c3-48dd-ad45-340a4766abd6', 'name': 'tempest-RoutersIpV6Test-19866107'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:04.850758 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-eb0fecce-de3d-42ab-91e8-0be9c0a4b74a None None] Allocated IP 2001:db8::2 (f1c8b45c-51c3-48dd-ad45-340a4766abd6/656050ab-3f89-43f6-9ab6-f893898d871f/8e0c0550-2bd6-48e4-85a7-4e9f697a99b2) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:32:04.857161 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-208064ff-0866-42a8-85a3-1d30a096c775 None None] Deleting port 3c106718-124c-4283-bf92-9c0013914134 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:32:04.857842 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-208064ff-0866-42a8-85a3-1d30a096c775 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:04.915633 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2bc76a7c-5139-4ed0-8ece-b2fc096282fe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:04.949359 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bc76a7c-5139-4ed0-8ece-b2fc096282fe admin admin] Pushing event deleted for resources: {'Port': ['ID=3c106718-124c-4283-bf92-9c0013914134,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:04.960014 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6469841e-7e5a-4815-bb80-81d438a1b4b5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Made reservation on behalf of dc5c46f00552473abc0991c0cc4a0269 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:32:04.965425 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6469841e-7e5a-4815-bb80-81d438a1b4b5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:04.970968 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2bc76a7c-5139-4ed0-8ece-b2fc096282fe admin admin] No DVR routers for this DVR port 3c106718-124c-4283-bf92-9c0013914134 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:32:04.998538 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-208064ff-0866-42a8-85a3-1d30a096c775 None None] For port 3c106718-124c-4283-bf92-9c0013914134, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=3c106718-124c-4283-bf92-9c0013914134,segment=NetworkSegment(dc772362-7c7f-473d-bb4b-7b6705959a15),segment_id=dc772362-7c7f-473d-bb4b-7b6705959a15)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:04.999094 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-208064ff-0866-42a8-85a3-1d30a096c775 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:05.016748 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-208064ff-0866-42a8-85a3-1d30a096c775 None None] Calling delete_port for 3c106718-124c-4283-bf92-9c0013914134 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:32:05.034945 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-6469841e-7e5a-4815-bb80-81d438a1b4b5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] device_id is not set on port fd224550-6f4a-4254-8323-bc39be7fabd4 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:32:05.117838 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e474036-7a4f-497a-8e16-eb4b042b541a req-38cfddda-a80d-4303-8a16-d081ea06e7a4 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:05.120050 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8e474036-7a4f-497a-8e16-eb4b042b541a req-38cfddda-a80d-4303-8a16-d081ea06e7a4 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 946 time: 0.0902073 Dec 09 21:32:05.128021 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2bc76a7c-5139-4ed0-8ece-b2fc096282fe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:05.180950 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-2bc76a7c-5139-4ed0-8ece-b2fc096282fe admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:05.191477 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb0fecce-de3d-42ab-91e8-0be9c0a4b74a None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:05.204789 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb0fecce-de3d-42ab-91e8-0be9c0a4b74a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:05.235629 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-208064ff-0866-42a8-85a3-1d30a096c775 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:05.237558 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-2bc76a7c-5139-4ed0-8ece-b2fc096282fe admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dc772362-7c7f-473d-bb4b-7b6705959a15') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:05.237856 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-2bc76a7c-5139-4ed0-8ece-b2fc096282fe admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dc772362-7c7f-473d-bb4b-7b6705959a15') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:05.256092 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8e474036-7a4f-497a-8e16-eb4b042b541a req-9932587e-9408-41d6-8e31-c83ec8f2c2eb tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1283331 Dec 09 21:32:05.260521 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb0fecce-de3d-42ab-91e8-0be9c0a4b74a None None] Network f1c8b45c-51c3-48dd-ad45-340a4766abd6 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:32:05.273837 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-208064ff-0866-42a8-85a3-1d30a096c775 None None] No DVR routers for this DVR port 3c106718-124c-4283-bf92-9c0013914134 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:32:05.273974 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb0fecce-de3d-42ab-91e8-0be9c0a4b74a None None] Pushing event updated for resources: {'Port': ['ID=8e0c0550-2bd6-48e4-85a7-4e9f697a99b2,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:05.277663 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-eb0fecce-de3d-42ab-91e8-0be9c0a4b74a None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:32:05.308857 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb0fecce-de3d-42ab-91e8-0be9c0a4b74a None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:32:05.314205 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-208064ff-0866-42a8-85a3-1d30a096c775 None None] Pushing event deleted for resources: {'Port': ['ID=3c106718-124c-4283-bf92-9c0013914134,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:05.321450 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2bc76a7c-5139-4ed0-8ece-b2fc096282fe admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:05.421357 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2bc76a7c-5139-4ed0-8ece-b2fc096282fe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:05.434769 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-eb0fecce-de3d-42ab-91e8-0be9c0a4b74a None None] Attempting to bind port 8e0c0550-2bd6-48e4-85a7-4e9f697a99b2 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:32:05.435376 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-eb0fecce-de3d-42ab-91e8-0be9c0a4b74a None None] Attempting to bind port 8e0c0550-2bd6-48e4-85a7-4e9f697a99b2 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '4b6f3a1f-ac89-47be-8f69-91cda270a8fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'f1c8b45c-51c3-48dd-ad45-340a4766abd6'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:32:05.435681 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb0fecce-de3d-42ab-91e8-0be9c0a4b74a None None] Attempting to bind port 8e0c0550-2bd6-48e4-85a7-4e9f697a99b2 on network f1c8b45c-51c3-48dd-ad45-340a4766abd6 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:32:05.442320 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb0fecce-de3d-42ab-91e8-0be9c0a4b74a None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 31, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:32:05.442587 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2bc76a7c-5139-4ed0-8ece-b2fc096282fe admin admin] Releasing vlan 117 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:32:05.442897 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb0fecce-de3d-42ab-91e8-0be9c0a4b74a None None] Checking segment: {'id': '4b6f3a1f-ac89-47be-8f69-91cda270a8fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'f1c8b45c-51c3-48dd-ad45-340a4766abd6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:32:05.443918 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb0fecce-de3d-42ab-91e8-0be9c0a4b74a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:05.444029 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2bc76a7c-5139-4ed0-8ece-b2fc096282fe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:05.444245 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb0fecce-de3d-42ab-91e8-0be9c0a4b74a None None] Bound using segment: {'id': '4b6f3a1f-ac89-47be-8f69-91cda270a8fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'f1c8b45c-51c3-48dd-ad45-340a4766abd6'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:32:05.444619 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-eb0fecce-de3d-42ab-91e8-0be9c0a4b74a None None] Bound port: 8e0c0550-2bd6-48e4-85a7-4e9f697a99b2, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4b6f3a1f-ac89-47be-8f69-91cda270a8fe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'f1c8b45c-51c3-48dd-ad45-340a4766abd6'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:32:05.445122 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb0fecce-de3d-42ab-91e8-0be9c0a4b74a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:32:05.448226 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:32:05.458258 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 3c106718-124c-4283-bf92-9c0013914134 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:32:05.486147 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 3c106718-124c-4283-bf92-9c0013914134 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:32:05.486492 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 3c106718-124c-4283-bf92-9c0013914134 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:32:05.486908 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a86b6971-a767-4594-8a0c-17a90908b6c3 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:32:05.532437 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: a86b6971-a767-4594-8a0c-17a90908b6c3 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:32:05.533189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a86b6971-a767-4594-8a0c-17a90908b6c3 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:32:05.566916 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-20d6d160-7d13-47b5-a8e7-1fa0fac67319 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:05.579678 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-6469841e-7e5a-4815-bb80-81d438a1b4b5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Allocated IP 2001:db8::1a8 (f1c8b45c-51c3-48dd-ad45-340a4766abd6/656050ab-3f89-43f6-9ab6-f893898d871f/fd224550-6f4a-4254-8323-bc39be7fabd4) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:32:05.589650 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-eb0fecce-de3d-42ab-91e8-0be9c0a4b74a None None] For port 8e0c0550-2bd6-48e4-85a7-4e9f697a99b2, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:32:05.594007 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-eb0fecce-de3d-42ab-91e8-0be9c0a4b74a None None] For port 8e0c0550-2bd6-48e4-85a7-4e9f697a99b2, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=8e0c0550-2bd6-48e4-85a7-4e9f697a99b2,segment=NetworkSegment(4b6f3a1f-ac89-47be-8f69-91cda270a8fe),segment_id=4b6f3a1f-ac89-47be-8f69-91cda270a8fe)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:32:05.601920 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb0fecce-de3d-42ab-91e8-0be9c0a4b74a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:05.618689 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2bc76a7c-5139-4ed0-8ece-b2fc096282fe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:05.624284 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2bc76a7c-5139-4ed0-8ece-b2fc096282fe admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:05.630276 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2bc76a7c-5139-4ed0-8ece-b2fc096282fe admin admin] 10.222.0.13 "DELETE /v2.0/networks/b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6 HTTP/1.1" status: 204 len: 168 time: 1.2635188 Dec 09 21:32:05.660316 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bc76a7c-5139-4ed0-8ece-b2fc096282fe admin admin] Pushing event deleted for resources: {'Network': ['ID=b9510e65-c8a4-4c87-aaa3-cf79fcd8a3b6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:05.689583 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb0fecce-de3d-42ab-91e8-0be9c0a4b74a None None] Pushing event updated for resources: {'Port': ['ID=8e0c0550-2bd6-48e4-85a7-4e9f697a99b2,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:05.860645 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6469841e-7e5a-4815-bb80-81d438a1b4b5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:05.955218 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6469841e-7e5a-4815-bb80-81d438a1b4b5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:06.019749 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6469841e-7e5a-4815-bb80-81d438a1b4b5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network f1c8b45c-51c3-48dd-ad45-340a4766abd6 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:32:06.028989 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-6469841e-7e5a-4815-bb80-81d438a1b4b5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:32:06.031733 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6469841e-7e5a-4815-bb80-81d438a1b4b5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:32:06.038387 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6469841e-7e5a-4815-bb80-81d438a1b4b5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:06.039094 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6469841e-7e5a-4815-bb80-81d438a1b4b5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:06.043018 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6469841e-7e5a-4815-bb80-81d438a1b4b5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Port': ['ID=fd224550-6f4a-4254-8323-bc39be7fabd4,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:06.062492 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46638) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:06.076624 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6469841e-7e5a-4815-bb80-81d438a1b4b5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 927 time: 1.3498557 Dec 09 21:32:06.079775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46642) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:06.122703 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7a6b4a1d-a61e-4623-aab1-bbf69bd1dc3e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=77fc0831d6584a36b61a4823157f9c1d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0588703 Dec 09 21:32:06.126030 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46646) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:06.198512 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b241b532-efca-497c-9130-1bc3b3d7d753 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:06.220724 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b241b532-efca-497c-9130-1bc3b3d7d753 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:06.273545 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b241b532-efca-497c-9130-1bc3b3d7d753 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:06.276722 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b241b532-efca-497c-9130-1bc3b3d7d753 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:06.277950 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b241b532-efca-497c-9130-1bc3b3d7d753 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/9dc55695-672d-4f75-a8bd-550395aa5ddb HTTP/1.1" status: 204 len: 168 time: 0.1507320 Dec 09 21:32:06.287287 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b241b532-efca-497c-9130-1bc3b3d7d753 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9dc55695-672d-4f75-a8bd-550395aa5ddb,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:06.472678 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-540d1638-dcdb-4599-87b3-a78005f06c02 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:06.592604 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:06.858029 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-540d1638-dcdb-4599-87b3-a78005f06c02 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:06.880969 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-540d1638-dcdb-4599-87b3-a78005f06c02 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:06.949710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-540d1638-dcdb-4599-87b3-a78005f06c02 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Port': ['ID=fd224550-6f4a-4254-8323-bc39be7fabd4,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:06.981300 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7ec2ccc5-9c42-4c36-8c6a-2fa67ece0c92 None None] Network f1c8b45c-51c3-48dd-ad45-340a4766abd6 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:32:07.054076 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c1e4a2d4-97b3-4361-9e2e-d7619a57365b None None] Provisioning complete for port 8e0c0550-2bd6-48e4-85a7-4e9f697a99b2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:07.054076 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c1e4a2d4-97b3-4361-9e2e-d7619a57365b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:07.191956 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-540d1638-dcdb-4599-87b3-a78005f06c02 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:07.255389 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c1e4a2d4-97b3-4361-9e2e-d7619a57365b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:07.332067 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c1e4a2d4-97b3-4361-9e2e-d7619a57365b None None] For port 8e0c0550-2bd6-48e4-85a7-4e9f697a99b2, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=8e0c0550-2bd6-48e4-85a7-4e9f697a99b2,segment=NetworkSegment(4b6f3a1f-ac89-47be-8f69-91cda270a8fe),segment_id=4b6f3a1f-ac89-47be-8f69-91cda270a8fe)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:07.338999 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c1e4a2d4-97b3-4361-9e2e-d7619a57365b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:07.447697 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1e4a2d4-97b3-4361-9e2e-d7619a57365b None None] Pushing event updated for resources: {'Port': ['ID=8e0c0550-2bd6-48e4-85a7-4e9f697a99b2,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:07.494664 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 8e0c0550-2bd6-48e4-85a7-4e9f697a99b2 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:32:07.509992 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-540d1638-dcdb-4599-87b3-a78005f06c02 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:07.577905 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 8e0c0550-2bd6-48e4-85a7-4e9f697a99b2 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:07.579291 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:07.677341 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-84182a77-9aa3-4c10-959c-8662b09d1943 None None] Provisioning complete for port 8e0c0550-2bd6-48e4-85a7-4e9f697a99b2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:07.677999 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-84182a77-9aa3-4c10-959c-8662b09d1943 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:07.885465 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-84182a77-9aa3-4c10-959c-8662b09d1943 None None] Provisioning complete for port fd224550-6f4a-4254-8323-bc39be7fabd4 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:07.885845 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-84182a77-9aa3-4c10-959c-8662b09d1943 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:07.942191 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46698) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:07.950292 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-84182a77-9aa3-4c10-959c-8662b09d1943 None None] Port fd224550-6f4a-4254-8323-bc39be7fabd4 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:32:07.952622 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:07.973948 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-540d1638-dcdb-4599-87b3-a78005f06c02 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:07.982881 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-540d1638-dcdb-4599-87b3-a78005f06c02 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:07.985028 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-540d1638-dcdb-4599-87b3-a78005f06c02 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:08.075611 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4d6af9cb-a364-4cc0-8cb6-4d1dbfea047c None None] Provisioning complete for port fd224550-6f4a-4254-8323-bc39be7fabd4 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:08.075990 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4d6af9cb-a364-4cc0-8cb6-4d1dbfea047c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:08.131574 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-4d6af9cb-a364-4cc0-8cb6-4d1dbfea047c None None] Port fd224550-6f4a-4254-8323-bc39be7fabd4 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:32:08.135882 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-0cb68271-1c8f-4035-bcd1-4240944e7863 admin admin] Request body: {'network': {'name': 'tempest-ListServerFiltersTestJSON-1852740110-network', 'tenant_id': '6c358c3d1eb04dce9614ffbe3851e040'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:08.154470 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-540d1638-dcdb-4599-87b3-a78005f06c02 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Port': ['ID=fd224550-6f4a-4254-8323-bc39be7fabd4,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:08.202307 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0cb68271-1c8f-4035-bcd1-4240944e7863 admin admin] Made reservation on behalf of 6c358c3d1eb04dce9614ffbe3851e040 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:32:08.205550 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0cb68271-1c8f-4035-bcd1-4240944e7863 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:08.219400 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0cb68271-1c8f-4035-bcd1-4240944e7863 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:08.308357 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-540d1638-dcdb-4599-87b3-a78005f06c02 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network f1c8b45c-51c3-48dd-ad45-340a4766abd6 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:32:08.317477 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-540d1638-dcdb-4599-87b3-a78005f06c02 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:32:08.339042 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0cb68271-1c8f-4035-bcd1-4240944e7863 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:08.378989 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0cb68271-1c8f-4035-bcd1-4240944e7863 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:08.394756 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-351925d1-59c4-4001-af7a-bd26a00007fc None None] Provisioning complete for port fd224550-6f4a-4254-8323-bc39be7fabd4 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:08.395182 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-351925d1-59c4-4001-af7a-bd26a00007fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:08.468982 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0cb68271-1c8f-4035-bcd1-4240944e7863 admin admin] vlan segment allocate from pool success with {'vlan_id': 137, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:32:08.475615 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-351925d1-59c4-4001-af7a-bd26a00007fc None None] Port fd224550-6f4a-4254-8323-bc39be7fabd4 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:32:08.485925 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cb68271-1c8f-4035-bcd1-4240944e7863 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b4daa16-ee9d-40f9-a306-60415764edf0,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:08.522286 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0cb68271-1c8f-4035-bcd1-4240944e7863 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:08.523250 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-0cb68271-1c8f-4035-bcd1-4240944e7863 admin admin] Added segment 0c438a9d-68a6-4675-b498-b86f6eed54d4 of type vlan for network 1b5db94a-f2e5-4ee6-b165-fbd41044188e Dec 09 21:32:08.596074 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0cb68271-1c8f-4035-bcd1-4240944e7863 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:08.605666 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 90f16e74-f2e6-416e-a079-f205615a0d8e no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:32:08.633777 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-540d1638-dcdb-4599-87b3-a78005f06c02 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Router d7a9b61a-129d-43c7-a080-cba02508a91b is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:32:08.653088 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0cb68271-1c8f-4035-bcd1-4240944e7863 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:08.654169 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0cb68271-1c8f-4035-bcd1-4240944e7863 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:08.655680 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0cb68271-1c8f-4035-bcd1-4240944e7863 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:08.747608 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:08.751384 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d404c920-e7e3-428c-b421-5e8e3b390c7d None None] Provisioning complete for port fd224550-6f4a-4254-8323-bc39be7fabd4 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:08.751768 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d404c920-e7e3-428c-b421-5e8e3b390c7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:08.771767 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cb68271-1c8f-4035-bcd1-4240944e7863 admin admin] Pushing event updated for resources: {'Network': ['ID=1b5db94a-f2e5-4ee6-b165-fbd41044188e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:08.793179 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 1b5db94a-f2e5-4ee6-b165-fbd41044188e details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:32:08.813516 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0cb68271-1c8f-4035-bcd1-4240944e7863 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.8698611 Dec 09 21:32:08.816545 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46718) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:08.830211 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-9428d3f9-586b-4e9c-8c52-02227450f2b3 admin admin] Request body: {'subnet': {'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e', 'cidr': '172.20.0.0/28', 'name': 'tempest-ListServerFiltersTestJSON-1852740110-subnet', 'tenant_id': '6c358c3d1eb04dce9614ffbe3851e040', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:08.853333 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-540d1638-dcdb-4599-87b3-a78005f06c02 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:32:08.864493 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-540d1638-dcdb-4599-87b3-a78005f06c02 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/routers/d7a9b61a-129d-43c7-a080-cba02508a91b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7790594 Dec 09 21:32:08.871141 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46724) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:08.874269 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de0c05bc-0f05-4206-b5fd-41314b170de5 None None] Sync routers for ids ['d7a9b61a-129d-43c7-a080-cba02508a91b'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:32:08.899103 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de0c05bc-0f05-4206-b5fd-41314b170de5 None None] Routers {'d7a9b61a-129d-43c7-a080-cba02508a91b'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:32:08.900006 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-de0c05bc-0f05-4206-b5fd-41314b170de5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:32:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['d7a9b61a-129d-43c7-a080-cba02508a91b'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:08.902786 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9428d3f9-586b-4e9c-8c52-02227450f2b3 admin admin] Made reservation on behalf of 6c358c3d1eb04dce9614ffbe3851e040 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:32:08.906411 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9428d3f9-586b-4e9c-8c52-02227450f2b3 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:08.938378 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2a3085c-26a0-4b34-9550-001f38ca6716 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:08.939990 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a2a3085c-26a0-4b34-9550-001f38ca6716 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/ports/fd224550-6f4a-4254-8323-bc39be7fabd4 HTTP/1.1" status: 200 len: 982 time: 0.0628791 Dec 09 21:32:08.943057 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46726) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:08.951583 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-de0c05bc-0f05-4206-b5fd-41314b170de5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:08.962722 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de0c05bc-0f05-4206-b5fd-41314b170de5 None None] Routers {'d7a9b61a-129d-43c7-a080-cba02508a91b'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:32:08.963586 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-de0c05bc-0f05-4206-b5fd-41314b170de5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:32:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['d7a9b61a-129d-43c7-a080-cba02508a91b'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:08.977842 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7ef6883d-9c98-4e81-b102-bc1197ac4a47', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '90f16e74-f2e6-416e-a079-f205615a0d8e'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:32:08.980160 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-54948133-07d5-4aeb-a34e-ee0a4d7d85ab" -d '{"events": [{"server_uuid": "7ef6883d-9c98-4e81-b102-bc1197ac4a47", "name": "network-vif-unplugged", "status": "completed", "tag": "90f16e74-f2e6-416e-a079-f205615a0d8e"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:32:09.005928 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 90f16e74-f2e6-416e-a079-f205615a0d8e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=90f16e74-f2e6-416e-a079-f205615a0d8e,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:09.008680 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d404c920-e7e3-428c-b421-5e8e3b390c7d None None] Port fd224550-6f4a-4254-8323-bc39be7fabd4 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:32:09.032724 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-de0c05bc-0f05-4206-b5fd-41314b170de5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:09.035660 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-de0c05bc-0f05-4206-b5fd-41314b170de5 None None] The sync data for ids ['d7a9b61a-129d-43c7-a080-cba02508a91b'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:32:09.041983 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:09.054071 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:32:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-85d40fe1-eff2-4b6d-a53e-e9fbdb034937 x-openstack-request-id: req-85d40fe1-eff2-4b6d-a53e-e9fbdb034937 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:32:09.054071 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7ef6883d-9c98-4e81-b102-bc1197ac4a47", "name": "network-vif-unplugged", "status": "completed", "tag": "90f16e74-f2e6-416e-a079-f205615a0d8e", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:32:09.054369 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-85d40fe1-eff2-4b6d-a53e-e9fbdb034937 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:32:09.054720 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7ef6883d-9c98-4e81-b102-bc1197ac4a47', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '90f16e74-f2e6-416e-a079-f205615a0d8e', 'code': 200} Dec 09 21:32:09.101347 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=90f16e74-f2e6-416e-a079-f205615a0d8e,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:09.165136 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9428d3f9-586b-4e9c-8c52-02227450f2b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:09.220140 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9428d3f9-586b-4e9c-8c52-02227450f2b3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e884864f-1596-4ce2-af55-9b1c3a7758eb,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:09.232491 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9428d3f9-586b-4e9c-8c52-02227450f2b3 admin admin] Checking segment: {'id': '0c438a9d-68a6-4675-b498-b86f6eed54d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:32:09.233097 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9428d3f9-586b-4e9c-8c52-02227450f2b3 admin admin] Network hostable DHCP agents. Network: 1b5db94a-f2e5-4ee6-b165-fbd41044188e, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:32:09.263349 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9428d3f9-586b-4e9c-8c52-02227450f2b3 admin admin] Network 1b5db94a-f2e5-4ee6-b165-fbd41044188e is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:32:09.278847 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-9428d3f9-586b-4e9c-8c52-02227450f2b3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 1b5db94a-f2e5-4ee6-b165-fbd41044188e) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:32:09.284376 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9428d3f9-586b-4e9c-8c52-02227450f2b3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:09.285170 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9428d3f9-586b-4e9c-8c52-02227450f2b3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:09.295541 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c57429c-0aac-4f4a-b2b6-57e7d9f32201 None None] Network 1b5db94a-f2e5-4ee6-b165-fbd41044188e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:32:09.337392 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9428d3f9-586b-4e9c-8c52-02227450f2b3 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.5161812 Dec 09 21:32:09.423798 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 8e0c0550-2bd6-48e4-85a7-4e9f697a99b2 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:32:09.473650 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99e2663f-69e0-4400-91c9-a6f8f05efe88 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:09.570860 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33ebee84-e797-47c8-9067-0c370ef1de0d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-1b5db94a-f2e5-4ee6-b165-fbd41044188e', 'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e', 'project_id': '6c358c3d1eb04dce9614ffbe3851e040', 'fixed_ips': [{'subnet_id': 'e884864f-1596-4ce2-af55-9b1c3a7758eb'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:32:09.574040 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-33ebee84-e797-47c8-9067-0c370ef1de0d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:09.606474 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 8e0c0550-2bd6-48e4-85a7-4e9f697a99b2 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:09.606861 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:09.666720 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:09.768058 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-99e2663f-69e0-4400-91c9-a6f8f05efe88 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting port fd224550-6f4a-4254-8323-bc39be7fabd4 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:32:09.768770 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99e2663f-69e0-4400-91c9-a6f8f05efe88 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:09.852373 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-33ebee84-e797-47c8-9067-0c370ef1de0d None None] Allocated IP 172.20.0.2 (1b5db94a-f2e5-4ee6-b165-fbd41044188e/e884864f-1596-4ce2-af55-9b1c3a7758eb/42a44357-1e1d-43a3-801a-87d822b70284) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:32:09.969207 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99e2663f-69e0-4400-91c9-a6f8f05efe88 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:10.000155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-99e2663f-69e0-4400-91c9-a6f8f05efe88 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Calling delete_port for fd224550-6f4a-4254-8323-bc39be7fabd4 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:32:10.145428 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-af37ceb9-e48a-4c45-955c-b01f6fc55713 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:10.154367 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-af37ceb9-e48a-4c45-955c-b01f6fc55713 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/networks?id=1b5db94a-f2e5-4ee6-b165-fbd41044188e HTTP/1.1" status: 200 len: 816 time: 0.1391921 Dec 09 21:32:10.176120 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-33ebee84-e797-47c8-9067-0c370ef1de0d None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:10.177589 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-ea94872c-8ead-441e-bfed-db02f939469d tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/quotas/6c358c3d1eb04dce9614ffbe3851e040 HTTP/1.1" status: 200 len: 375 time: 0.0217221 Dec 09 21:32:10.191670 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-33ebee84-e797-47c8-9067-0c370ef1de0d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:10.238824 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33ebee84-e797-47c8-9067-0c370ef1de0d None None] Network 1b5db94a-f2e5-4ee6-b165-fbd41044188e is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:32:10.249251 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-33ebee84-e797-47c8-9067-0c370ef1de0d None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:32:10.251506 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33ebee84-e797-47c8-9067-0c370ef1de0d None None] Pushing event updated for resources: {'Port': ['ID=42a44357-1e1d-43a3-801a-87d822b70284,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:10.253999 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-33ebee84-e797-47c8-9067-0c370ef1de0d None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:32:10.262590 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-92111c86-44be-4e17-a2ee-ff9b6068df33 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=6c358c3d1eb04dce9614ffbe3851e040&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0837538 Dec 09 21:32:10.321713 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-33ebee84-e797-47c8-9067-0c370ef1de0d None None] Attempting to bind port 42a44357-1e1d-43a3-801a-87d822b70284 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:32:10.322357 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-33ebee84-e797-47c8-9067-0c370ef1de0d None None] Attempting to bind port 42a44357-1e1d-43a3-801a-87d822b70284 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '0c438a9d-68a6-4675-b498-b86f6eed54d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:32:10.322872 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33ebee84-e797-47c8-9067-0c370ef1de0d None None] Attempting to bind port 42a44357-1e1d-43a3-801a-87d822b70284 on network 1b5db94a-f2e5-4ee6-b165-fbd41044188e {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:32:10.331605 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33ebee84-e797-47c8-9067-0c370ef1de0d None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 32, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:32:10.332081 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33ebee84-e797-47c8-9067-0c370ef1de0d None None] Checking segment: {'id': '0c438a9d-68a6-4675-b498-b86f6eed54d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:32:10.332589 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-33ebee84-e797-47c8-9067-0c370ef1de0d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:10.333099 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-33ebee84-e797-47c8-9067-0c370ef1de0d None None] Bound using segment: {'id': '0c438a9d-68a6-4675-b498-b86f6eed54d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:32:10.333872 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-33ebee84-e797-47c8-9067-0c370ef1de0d None None] Bound port: 42a44357-1e1d-43a3-801a-87d822b70284, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0c438a9d-68a6-4675-b498-b86f6eed54d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:32:10.334583 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-33ebee84-e797-47c8-9067-0c370ef1de0d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:10.383126 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99e2663f-69e0-4400-91c9-a6f8f05efe88 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:10.450041 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99e2663f-69e0-4400-91c9-a6f8f05efe88 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Port': ['ID=fd224550-6f4a-4254-8323-bc39be7fabd4,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:10.455983 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-33ebee84-e797-47c8-9067-0c370ef1de0d None None] For port 42a44357-1e1d-43a3-801a-87d822b70284, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:32:10.465335 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-33ebee84-e797-47c8-9067-0c370ef1de0d None None] For port 42a44357-1e1d-43a3-801a-87d822b70284, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=42a44357-1e1d-43a3-801a-87d822b70284,segment=NetworkSegment(0c438a9d-68a6-4675-b498-b86f6eed54d4),segment_id=0c438a9d-68a6-4675-b498-b86f6eed54d4)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:32:10.477238 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-33ebee84-e797-47c8-9067-0c370ef1de0d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:10.565432 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-77f88319-4bd7-416d-87e5-bef27f8ba94b service neutron] 10.222.0.13 "GET /v2.0/networks/1b5db94a-f2e5-4ee6-b165-fbd41044188e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2929823 Dec 09 21:32:10.604538 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 90f16e74-f2e6-416e-a079-f205615a0d8e details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:32:10.680688 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33ebee84-e797-47c8-9067-0c370ef1de0d None None] Pushing event updated for resources: {'Port': ['ID=42a44357-1e1d-43a3-801a-87d822b70284,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:10.760050 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-ff489a8e-6400-4198-88bf-88a8ac58224e service neutron] 10.222.0.13 "GET /v2.0/networks/1b5db94a-f2e5-4ee6-b165-fbd41044188e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1934977 Dec 09 21:32:10.981523 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 90f16e74-f2e6-416e-a079-f205615a0d8e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=90f16e74-f2e6-416e-a079-f205615a0d8e,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:11.088152 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '90f16e74-f2e6-416e-a079-f205615a0d8e', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'port_id': '90f16e74-f2e6-416e-a079-f205615a0d8e', 'mac_address': 'fa:16:3e:69:c9:b5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:32:11.235121 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:11.278134 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 90f16e74-f2e6-416e-a079-f205615a0d8e {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:32:11.316784 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 90f16e74-f2e6-416e-a079-f205615a0d8e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=90f16e74-f2e6-416e-a079-f205615a0d8e,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:11.323607 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:11.449134 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['90f16e74-f2e6-416e-a079-f205615a0d8e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:32:11.575128 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99e2663f-69e0-4400-91c9-a6f8f05efe88 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:11.663483 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 42a44357-1e1d-43a3-801a-87d822b70284 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:32:11.770224 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=90f16e74-f2e6-416e-a079-f205615a0d8e,revision_number=9']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:11.837453 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67cae86a-3524-4054-8365-195cc600a5c8 req-edcb00fb-7153-4863-898f-d57688882f03 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:11.852945 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67cae86a-3524-4054-8365-195cc600a5c8 req-edcb00fb-7153-4863-898f-d57688882f03 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/networks?id=1b5db94a-f2e5-4ee6-b165-fbd41044188e HTTP/1.1" status: 200 len: 816 time: 0.3796577 Dec 09 21:32:11.885907 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67cae86a-3524-4054-8365-195cc600a5c8 req-206be628-788f-45e3-9dc8-4716ad74996a tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/quotas/6c358c3d1eb04dce9614ffbe3851e040 HTTP/1.1" status: 200 len: 375 time: 0.0318775 Dec 09 21:32:11.996985 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 42a44357-1e1d-43a3-801a-87d822b70284 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:11.997555 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:12.025467 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-99e2663f-69e0-4400-91c9-a6f8f05efe88 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Router d7a9b61a-129d-43c7-a080-cba02508a91b has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:32:12.032390 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67cae86a-3524-4054-8365-195cc600a5c8 req-c49994f7-6b98-4660-89d7-a204f00ec24b tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=6c358c3d1eb04dce9614ffbe3851e040&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1454043 Dec 09 21:32:12.206470 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:12.243039 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-99e2663f-69e0-4400-91c9-a6f8f05efe88 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:32:12.255867 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f1064f4-8a79-4b7f-bdf6-ffa77c47e27f None None] Sync routers for ids ['d7a9b61a-129d-43c7-a080-cba02508a91b'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:32:12.267411 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-99e2663f-69e0-4400-91c9-a6f8f05efe88 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/routers/d7a9b61a-129d-43c7-a080-cba02508a91b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3230038 Dec 09 21:32:12.270068 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46842) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:12.319538 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67cae86a-3524-4054-8365-195cc600a5c8 req-9aae4530-8665-44cd-bb29-a6e78c7d874e service neutron] 10.222.0.13 "GET /v2.0/networks/1b5db94a-f2e5-4ee6-b165-fbd41044188e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2860298 Dec 09 21:32:12.346408 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f1064f4-8a79-4b7f-bdf6-ffa77c47e27f None None] Routers {'d7a9b61a-129d-43c7-a080-cba02508a91b'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:32:12.347076 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-9f1064f4-8a79-4b7f-bdf6-ffa77c47e27f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:32:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['d7a9b61a-129d-43c7-a080-cba02508a91b'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:12.460018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 42a44357-1e1d-43a3-801a-87d822b70284, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=42a44357-1e1d-43a3-801a-87d822b70284,segment=NetworkSegment(0c438a9d-68a6-4675-b498-b86f6eed54d4),segment_id=0c438a9d-68a6-4675-b498-b86f6eed54d4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:12.467256 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-9f1064f4-8a79-4b7f-bdf6-ffa77c47e27f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:12.472128 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:12.543087 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67cae86a-3524-4054-8365-195cc600a5c8 req-df70549d-d05f-44ea-b993-7a68b07766df service neutron] 10.222.0.13 "GET /v2.0/networks/1b5db94a-f2e5-4ee6-b165-fbd41044188e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2142494 Dec 09 21:32:12.543753 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b43e36a1-e020-4d86-b723-3ffff666df92 None None] Network 1b5db94a-f2e5-4ee6-b165-fbd41044188e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:32:12.570012 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f1064f4-8a79-4b7f-bdf6-ffa77c47e27f None None] Routers {'d7a9b61a-129d-43c7-a080-cba02508a91b'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:32:12.570930 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-9f1064f4-8a79-4b7f-bdf6-ffa77c47e27f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:32:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['d7a9b61a-129d-43c7-a080-cba02508a91b'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:12.636659 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46846) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:12.638656 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 90f16e74-f2e6-416e-a079-f205615a0d8e up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:32:12.644554 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-9f1064f4-8a79-4b7f-bdf6-ffa77c47e27f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:12.647272 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f1064f4-8a79-4b7f-bdf6-ffa77c47e27f None None] The sync data for ids ['d7a9b61a-129d-43c7-a080-cba02508a91b'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:32:12.739163 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-322c09b8-73f2-441d-9f21-593335a9a447 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] remove_router_interface failed (client error): The resource could not be found. Dec 09 21:32:12.742955 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-322c09b8-73f2-441d-9f21-593335a9a447 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/routers/d7a9b61a-129d-43c7-a080-cba02508a91b/remove_router_interface HTTP/1.1" status: 404 len: 398 time: 0.4676473 Dec 09 21:32:12.743482 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46852) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:12.747232 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=42a44357-1e1d-43a3-801a-87d822b70284,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:12.785655 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b9fc177c-f0f0-4e80-ad1b-9ef17eabe177 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/ports?device_id=d7a9b61a-129d-43c7-a080-cba02508a91b HTTP/1.1" status: 200 len: 205 time: 0.0405095 Dec 09 21:32:12.789293 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46858) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:12.833963 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e60dd095-a558-4b8f-b6a1-8ad795142cfd admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:12.838193 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-867f9cf5-637b-4a76-9724-3a8d0c093935 None None] Provisioning complete for port 42a44357-1e1d-43a3-801a-87d822b70284 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:12.838613 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-867f9cf5-637b-4a76-9724-3a8d0c093935 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:12.942156 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 90f16e74-f2e6-416e-a079-f205615a0d8e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:12.942531 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:13.035240 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d9267b0-f3af-48f5-85be-8a86f7c6117a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:13.150986 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e60dd095-a558-4b8f-b6a1-8ad795142cfd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:13.235765 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:13.266546 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-0b34e767-b813-47c1-9ab9-a6076e1c89ae tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:13.268764 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-0b34e767-b813-47c1-9ab9-a6076e1c89ae tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.31 "GET /v2.0/networks?id=1b5db94a-f2e5-4ee6-b165-fbd41044188e HTTP/1.1" status: 200 len: 816 time: 0.2569256 Dec 09 21:32:13.271328 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e60dd095-a558-4b8f-b6a1-8ad795142cfd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:13.314463 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e60dd095-a558-4b8f-b6a1-8ad795142cfd admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=f64e8433d52a4eec9fbfd896d436f80a&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6766257 Dec 09 21:32:13.320358 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-97e1b6f3-75e0-4ca2-951e-4c6caf957d64 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Request body: {'port': {'device_id': 'bfdfbd26-1bb4-4590-8cdf-732329bfb002', 'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e', 'admin_state_up': True, 'tenant_id': '6c358c3d1eb04dce9614ffbe3851e040'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:13.327058 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7ef6883d-9c98-4e81-b102-bc1197ac4a47', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '90f16e74-f2e6-416e-a079-f205615a0d8e'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:32:13.327566 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46882) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:13.354889 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-881d36f8-7ea6-44ea-87d3-ca3b83c8fabe" -d '{"events": [{"server_uuid": "7ef6883d-9c98-4e81-b102-bc1197ac4a47", "name": "network-vif-plugged", "status": "completed", "tag": "90f16e74-f2e6-416e-a079-f205615a0d8e"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:32:13.407547 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 90f16e74-f2e6-416e-a079-f205615a0d8e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=90f16e74-f2e6-416e-a079-f205615a0d8e,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:13.439837 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 42a44357-1e1d-43a3-801a-87d822b70284 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:32:13.441836 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d9267b0-f3af-48f5-85be-8a86f7c6117a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:13.445748 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d9267b0-f3af-48f5-85be-8a86f7c6117a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:13.480932 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-e3941017-49d0-4ac2-be49-7220bec71cbe service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 665 time: 0.5150037 Dec 09 21:32:13.548563 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:32:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d8f6d0c0-3fa1-45ca-892b-debcdcbf0b0f x-openstack-request-id: req-d8f6d0c0-3fa1-45ca-892b-debcdcbf0b0f {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:32:13.551868 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7ef6883d-9c98-4e81-b102-bc1197ac4a47", "name": "network-vif-plugged", "status": "completed", "tag": "90f16e74-f2e6-416e-a079-f205615a0d8e", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:32:13.552196 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-d8f6d0c0-3fa1-45ca-892b-debcdcbf0b0f {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:32:13.553317 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7ef6883d-9c98-4e81-b102-bc1197ac4a47', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '90f16e74-f2e6-416e-a079-f205615a0d8e', 'code': 200} Dec 09 21:32:13.555652 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:13.583230 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e60dd095-a558-4b8f-b6a1-8ad795142cfd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=683928da-f470-4804-a289-b8ba2e914900,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:13.590762 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d9267b0-f3af-48f5-85be-8a86f7c6117a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:13.597094 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0d9267b0-f3af-48f5-85be-8a86f7c6117a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Fanout notify agent at l3_agent the message router_deleted on router d7a9b61a-129d-43c7-a080-cba02508a91b {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:32:13.597667 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6273965d-6583-48b0-a2f6-215bacb29779 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:13.615059 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d9267b0-f3af-48f5-85be-8a86f7c6117a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:13.626683 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0d9267b0-f3af-48f5-85be-8a86f7c6117a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/routers/d7a9b61a-129d-43c7-a080-cba02508a91b HTTP/1.1" status: 204 len: 168 time: 0.8359666 Dec 09 21:32:13.655421 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46888) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:13.729832 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-7979a0e4-fa22-4a3e-82ea-e31ef7bdf346 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting subnet 656050ab-3f89-43f6-9ab6-f893898d871f {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:32:13.730060 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=90f16e74-f2e6-416e-a079-f205615a0d8e,revision_number=10']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:13.735469 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 42a44357-1e1d-43a3-801a-87d822b70284 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:13.735862 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:13.738002 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-dbe0abf5-27ba-4920-9a98-fc7f824fb457 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:13.738605 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-dbe0abf5-27ba-4920-9a98-fc7f824fb457 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:13.739169 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-dbe0abf5-27ba-4920-9a98-fc7f824fb457 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:13.739766 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-dbe0abf5-27ba-4920-9a98-fc7f824fb457 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:13.740356 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-dbe0abf5-27ba-4920-9a98-fc7f824fb457 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:13.740795 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-dbe0abf5-27ba-4920-9a98-fc7f824fb457 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:13.741319 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-dbe0abf5-27ba-4920-9a98-fc7f824fb457 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:13.743453 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-dbe0abf5-27ba-4920-9a98-fc7f824fb457 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=03e962eb7f5e4325a7c08c8b1e2a4cea&device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 6498 time: 0.1918838 Dec 09 21:32:13.747369 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7979a0e4-fa22-4a3e-82ea-e31ef7bdf346 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:13.801454 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6273965d-6583-48b0-a2f6-215bacb29779 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:13.829601 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7979a0e4-fa22-4a3e-82ea-e31ef7bdf346 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:13.874952 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6fcac51d-d3f6-465e-8221-8930df214ad7 None None] Provisioning complete for port 42a44357-1e1d-43a3-801a-87d822b70284 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:13.875498 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6fcac51d-d3f6-465e-8221-8930df214ad7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:13.899666 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-875a28c3-dee6-4c4f-a5e2-2229f7e0ff5d tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:13.909107 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-875a28c3-dee6-4c4f-a5e2-2229f7e0ff5d tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/networks?id=1b5db94a-f2e5-4ee6-b165-fbd41044188e HTTP/1.1" status: 200 len: 816 time: 0.5999849 Dec 09 21:32:13.958614 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-a6fbd30a-e8dc-4d97-a069-042a8198cae9 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/quotas/6c358c3d1eb04dce9614ffbe3851e040 HTTP/1.1" status: 200 len: 375 time: 0.0478578 Dec 09 21:32:13.973263 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-cf1cc92a-7d5d-4a95-b1bf-93ff62eeb388 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:13.973894 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-cf1cc92a-7d5d-4a95-b1bf-93ff62eeb388 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:13.974431 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-cf1cc92a-7d5d-4a95-b1bf-93ff62eeb388 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:13.976250 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-cf1cc92a-7d5d-4a95-b1bf-93ff62eeb388 service neutron] 10.222.0.10 "GET /v2.0/networks?id=f0373886-3db8-47eb-af65-78244497171e&id=a859e4ba-764a-41c0-982d-5bf79a2797a1&id=a859e4ba-764a-41c0-982d-5bf79a2797a1&id=a859e4ba-764a-41c0-982d-5bf79a2797a1&id=a859e4ba-764a-41c0-982d-5bf79a2797a1&id=a133a939-2827-4fe6-81f5-14715631c0ec&id=a133a939-2827-4fe6-81f5-14715631c0ec HTTP/1.1" status: 200 len: 2293 time: 0.1976860 Dec 09 21:32:14.042137 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-97e1b6f3-75e0-4ca2-951e-4c6caf957d64 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Made reservation on behalf of 6c358c3d1eb04dce9614ffbe3851e040 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:32:14.045052 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7979a0e4-fa22-4a3e-82ea-e31ef7bdf346 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:14.054501 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-97e1b6f3-75e0-4ca2-951e-4c6caf957d64 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:14.100403 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6273965d-6583-48b0-a2f6-215bacb29779 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:14.109455 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-17465c03-ebf7-4204-bd66-afd5bc4e3ac2 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=90180a85-620b-470e-b808-b635138111be HTTP/1.1" status: 200 len: 1002 time: 0.1225810 Dec 09 21:32:14.109647 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6273965d-6583-48b0-a2f6-215bacb29779 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:14.110797 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6273965d-6583-48b0-a2f6-215bacb29779 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/683928da-f470-4804-a289-b8ba2e914900 HTTP/1.1" status: 204 len: 168 time: 0.7604673 Dec 09 21:32:14.146797 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6273965d-6583-48b0-a2f6-215bacb29779 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=683928da-f470-4804-a289-b8ba2e914900,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:14.167208 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-d9582cef-351f-4135-8120-e59476622c26 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=6c358c3d1eb04dce9614ffbe3851e040&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2073686 Dec 09 21:32:14.175672 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7979a0e4-fa22-4a3e-82ea-e31ef7bdf346 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:14.183337 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-c31cb5ae-7913-4803-b1f8-c5e640239d1f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:14.185636 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-c31cb5ae-7913-4803-b1f8-c5e640239d1f service neutron] 10.222.0.10 "GET /v2.0/subnets?id=65df7637-0210-4526-a5dd-a692c26062b4 HTTP/1.1" status: 200 len: 851 time: 0.0679269 Dec 09 21:32:14.229173 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7979a0e4-fa22-4a3e-82ea-e31ef7bdf346 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Subnet': ['ID=656050ab-3f89-43f6-9ab6-f893898d871f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:14.269945 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0c1724d7-b670-403b-ac9c-a993044799aa None None] Network f1c8b45c-51c3-48dd-ad45-340a4766abd6 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:32:14.308138 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7979a0e4-fa22-4a3e-82ea-e31ef7bdf346 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:14.317423 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7979a0e4-fa22-4a3e-82ea-e31ef7bdf346 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/subnets/656050ab-3f89-43f6-9ab6-f893898d871f HTTP/1.1" status: 204 len: 168 time: 0.6599331 Dec 09 21:32:14.327938 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46900) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:14.330857 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-3fa8904e-5f69-4751-8f55-5a9b7e04d46f service neutron] 10.222.0.13 "GET /v2.0/networks/1b5db94a-f2e5-4ee6-b165-fbd41044188e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1507909 Dec 09 21:32:14.441019 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-2bc0c05d-e9a0-427e-97ac-37a8da793a79 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:14.451792 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-2bc0c05d-e9a0-427e-97ac-37a8da793a79 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=f0373886-3db8-47eb-af65-78244497171e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2210915 Dec 09 21:32:14.583355 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-78624792-0e55-48d9-88bc-01198dbda6a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:14.622398 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-6e33d6ab-eb3f-40fc-a1dd-244e365947ba service neutron] 10.222.0.13 "GET /v2.0/networks/1b5db94a-f2e5-4ee6-b165-fbd41044188e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2903438 Dec 09 21:32:14.636435 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-178d1157-e589-46d8-9dc0-e1cdd64b6b5d None None] DHCP port deletion for f1c8b45c-51c3-48dd-ad45-340a4766abd6 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:32:14.657925 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-97e1b6f3-75e0-4ca2-951e-4c6caf957d64 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Allocated IP 172.20.0.4 (1b5db94a-f2e5-4ee6-b165-fbd41044188e/e884864f-1596-4ce2-af55-9b1c3a7758eb/287d2e38-af6c-4fbc-b196-bebf54c65697) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:32:14.752190 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-178d1157-e589-46d8-9dc0-e1cdd64b6b5d None None] Deleting port 8e0c0550-2bd6-48e4-85a7-4e9f697a99b2 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:32:14.756854 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-178d1157-e589-46d8-9dc0-e1cdd64b6b5d None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:14.782391 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-69747151-f7ae-444e-8dce-8038c0f466e0 service neutron] 10.222.0.10 "GET /v2.0/networks/f0373886-3db8-47eb-af65-78244497171e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3258007 Dec 09 21:32:14.869626 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46906) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:14.897307 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df90e0eb-eb97-431d-90ae-06c5afde9409 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:14.922650 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-178d1157-e589-46d8-9dc0-e1cdd64b6b5d None None] For port 8e0c0550-2bd6-48e4-85a7-4e9f697a99b2, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=8e0c0550-2bd6-48e4-85a7-4e9f697a99b2,segment=NetworkSegment(4b6f3a1f-ac89-47be-8f69-91cda270a8fe),segment_id=4b6f3a1f-ac89-47be-8f69-91cda270a8fe)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:14.923185 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-178d1157-e589-46d8-9dc0-e1cdd64b6b5d None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:14.960926 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-178d1157-e589-46d8-9dc0-e1cdd64b6b5d None None] Calling delete_port for 8e0c0550-2bd6-48e4-85a7-4e9f697a99b2 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:32:14.988168 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-78624792-0e55-48d9-88bc-01198dbda6a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting port 8e0c0550-2bd6-48e4-85a7-4e9f697a99b2 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:32:14.988614 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-78624792-0e55-48d9-88bc-01198dbda6a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:15.063942 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-1b8b8fb9-ad7e-4a1b-b351-26c1b741a65d service neutron] 10.222.0.10 "GET /v2.0/networks/f0373886-3db8-47eb-af65-78244497171e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2584956 Dec 09 21:32:15.111076 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-178d1157-e589-46d8-9dc0-e1cdd64b6b5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:15.126507 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d792e9e-d497-4614-a339-172a5e751164 req-f3445c29-d122-4af1-991b-6aebd8a234b1 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 210 time: 0.0931120 Dec 09 21:32:15.174586 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-97e1b6f3-75e0-4ca2-951e-4c6caf957d64 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:15.186156 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-178d1157-e589-46d8-9dc0-e1cdd64b6b5d None None] Pushing event deleted for resources: {'Port': ['ID=8e0c0550-2bd6-48e4-85a7-4e9f697a99b2,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:15.190542 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-178d1157-e589-46d8-9dc0-e1cdd64b6b5d None None] No DVR routers for this DVR port 8e0c0550-2bd6-48e4-85a7-4e9f697a99b2 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:32:15.206300 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67cae86a-3524-4054-8365-195cc600a5c8 req-9866bbd9-e31b-41fb-b9db-fb717823446f tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:15.213863 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67cae86a-3524-4054-8365-195cc600a5c8 req-9866bbd9-e31b-41fb-b9db-fb717823446f tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.10 "GET /v2.0/networks?id=1b5db94a-f2e5-4ee6-b165-fbd41044188e HTTP/1.1" status: 200 len: 816 time: 0.4496267 Dec 09 21:32:15.234077 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-67cae86a-3524-4054-8365-195cc600a5c8 req-b934c131-ccd6-4213-9f15-3f220ba41b7f tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Request body: {'port': {'device_id': '0572d5ce-eab2-4fdc-9c73-034455c686d3', 'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e', 'admin_state_up': True, 'tenant_id': '6c358c3d1eb04dce9614ffbe3851e040'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:15.298653 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-f97bf47a-1aad-4903-ad1b-88b377d5ed96 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.81&port_id=1e946a47-f496-445b-964b-618881eab263 HTTP/1.1" status: 200 len: 217 time: 0.1536672 Dec 09 21:32:15.306702 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-78624792-0e55-48d9-88bc-01198dbda6a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] For port 8e0c0550-2bd6-48e4-85a7-4e9f697a99b2, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=8e0c0550-2bd6-48e4-85a7-4e9f697a99b2,segment=NetworkSegment(4b6f3a1f-ac89-47be-8f69-91cda270a8fe),segment_id=4b6f3a1f-ac89-47be-8f69-91cda270a8fe)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:15.306702 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-78624792-0e55-48d9-88bc-01198dbda6a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:15.392048 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-97e1b6f3-75e0-4ca2-951e-4c6caf957d64 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:15.414634 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 8e0c0550-2bd6-48e4-85a7-4e9f697a99b2 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:32:15.415222 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-78624792-0e55-48d9-88bc-01198dbda6a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Calling delete_port for 8e0c0550-2bd6-48e4-85a7-4e9f697a99b2 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:32:15.452119 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97e1b6f3-75e0-4ca2-951e-4c6caf957d64 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Pushing event updated for resources: {'Port': ['ID=287d2e38-af6c-4fbc-b196-bebf54c65697,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:15.473319 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 8e0c0550-2bd6-48e4-85a7-4e9f697a99b2 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:32:15.477463 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 8e0c0550-2bd6-48e4-85a7-4e9f697a99b2 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:32:15.483513 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-97e1b6f3-75e0-4ca2-951e-4c6caf957d64 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Network 1b5db94a-f2e5-4ee6-b165-fbd41044188e is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:32:15.490312 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-97e1b6f3-75e0-4ca2-951e-4c6caf957d64 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:32:15.508927 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-97e1b6f3-75e0-4ca2-951e-4c6caf957d64 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:32:15.516657 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-2b3841b7-2089-4125-b6ab-bb18bbf334cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:15.518884 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-2b3841b7-2089-4125-b6ab-bb18bbf334cb service neutron] 10.222.0.10 "GET /v2.0/subnets?id=a894075b-fa9f-4a27-9782-e476e86f74e0 HTTP/1.1" status: 200 len: 797 time: 0.2094030 Dec 09 21:32:15.520861 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df90e0eb-eb97-431d-90ae-06c5afde9409 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:15.561735 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df90e0eb-eb97-431d-90ae-06c5afde9409 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:15.571797 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-97e1b6f3-75e0-4ca2-951e-4c6caf957d64 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:15.573379 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-97e1b6f3-75e0-4ca2-951e-4c6caf957d64 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:15.623282 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-97e1b6f3-75e0-4ca2-951e-4c6caf957d64 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.3165085 Dec 09 21:32:15.628908 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-67cae86a-3524-4054-8365-195cc600a5c8 req-b934c131-ccd6-4213-9f15-3f220ba41b7f tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Made reservation on behalf of 6c358c3d1eb04dce9614ffbe3851e040 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:32:15.636129 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-67cae86a-3524-4054-8365-195cc600a5c8 req-b934c131-ccd6-4213-9f15-3f220ba41b7f tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:15.640614 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-df90e0eb-eb97-431d-90ae-06c5afde9409 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=3c671ff010a549f1b2d47f3ef8606586&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7686269 Dec 09 21:32:15.641484 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df90e0eb-eb97-431d-90ae-06c5afde9409 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8be140d7-8a98-46b4-9ab2-70898c249c9c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:15.652704 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46928) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:15.660122 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-1cf17050-c6b8-46cc-ad75-f878e449cbd7 service neutron] Request body: {'port': {'device_id': 'bfdfbd26-1bb4-4590-8cdf-732329bfb002', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:15.691759 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-78624792-0e55-48d9-88bc-01198dbda6a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:15.729250 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78624792-0e55-48d9-88bc-01198dbda6a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Port': ['ID=8e0c0550-2bd6-48e4-85a7-4e9f697a99b2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:15.756634 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-78624792-0e55-48d9-88bc-01198dbda6a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] No DVR routers for this DVR port 8e0c0550-2bd6-48e4-85a7-4e9f697a99b2 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:32:15.799119 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-62b790db-e1a9-49c4-a1ea-0286e002dc80 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:15.802032 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-62b790db-e1a9-49c4-a1ea-0286e002dc80 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a859e4ba-764a-41c0-982d-5bf79a2797a1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.2754819 Dec 09 21:32:15.861300 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-24c6829f-7e86-4c19-bf00-106bc44dccac None None] Provisioning complete for port 287d2e38-af6c-4fbc-b196-bebf54c65697 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:15.861619 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-24c6829f-7e86-4c19-bf00-106bc44dccac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:15.864478 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-1cf17050-c6b8-46cc-ad75-f878e449cbd7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:15.929796 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-78624792-0e55-48d9-88bc-01198dbda6a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:15.962716 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-24c6829f-7e86-4c19-bf00-106bc44dccac None None] Port 287d2e38-af6c-4fbc-b196-bebf54c65697 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:32:15.971291 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-599b0f4d-e951-4267-a268-f82be5f9ae58 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:16.016709 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-78624792-0e55-48d9-88bc-01198dbda6a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f1c8b45c-51c3-48dd-ad45-340a4766abd6']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:16.036322 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-78624792-0e55-48d9-88bc-01198dbda6a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4b6f3a1f-ac89-47be-8f69-91cda270a8fe') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:16.036978 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-78624792-0e55-48d9-88bc-01198dbda6a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4b6f3a1f-ac89-47be-8f69-91cda270a8fe') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:16.074280 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-78624792-0e55-48d9-88bc-01198dbda6a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:16.080630 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-599b0f4d-e951-4267-a268-f82be5f9ae58 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:16.113847 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-c0aabf7e-5698-4760-9d3d-c191f8ea59b3 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2916424 Dec 09 21:32:16.115253 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-78624792-0e55-48d9-88bc-01198dbda6a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:16.167741 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-78624792-0e55-48d9-88bc-01198dbda6a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Releasing vlan 143 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:32:16.168165 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-78624792-0e55-48d9-88bc-01198dbda6a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: self.session.flush() Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: self.session.flush() Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: self.session.flush() Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: self.session.flush() Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:32:16.182001 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:32:16.194264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-67cae86a-3524-4054-8365-195cc600a5c8 req-b934c131-ccd6-4213-9f15-3f220ba41b7f tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Allocated IP 172.20.0.11 (1b5db94a-f2e5-4ee6-b165-fbd41044188e/e884864f-1596-4ce2-af55-9b1c3a7758eb/e265ed07-d705-41c8-a70d-3b1f794ae6a7) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:32:16.258911 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-c49d5026-9ec0-42cf-bc83-2f0ca8c4665d service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1361980 Dec 09 21:32:16.347226 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f7ee6da5-8b11-40f0-9a12-cd7277e2f071 req-4ebeaf7c-bb59-4344-a8db-854bf443aa48 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 210 time: 0.0767691 Dec 09 21:32:16.388903 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-df26b617-9de5-4799-9337-34319d25a563 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.31&port_id=145a0cde-0fe5-4163-a063-0fdfe42f243b HTTP/1.1" status: 200 len: 217 time: 0.1184270 Dec 09 21:32:16.417118 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-78624792-0e55-48d9-88bc-01198dbda6a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:16.429949 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-78624792-0e55-48d9-88bc-01198dbda6a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:16.443265 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-78624792-0e55-48d9-88bc-01198dbda6a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/networks/f1c8b45c-51c3-48dd-ad45-340a4766abd6 HTTP/1.1" status: 204 len: 168 time: 2.1137631 Dec 09 21:32:16.444286 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46948) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:16.468671 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-599b0f4d-e951-4267-a268-f82be5f9ae58 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:16.471492 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-599b0f4d-e951-4267-a268-f82be5f9ae58 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:16.474964 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-599b0f4d-e951-4267-a268-f82be5f9ae58 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/8be140d7-8a98-46b4-9ab2-70898c249c9c HTTP/1.1" status: 204 len: 168 time: 0.7799304 Dec 09 21:32:16.522403 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-632a76b9-4de4-4830-8d74-7d2eeeb196fc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-193972678'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:16.540015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-599b0f4d-e951-4267-a268-f82be5f9ae58 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8be140d7-8a98-46b4-9ab2-70898c249c9c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:16.589216 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78624792-0e55-48d9-88bc-01198dbda6a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Network': ['ID=f1c8b45c-51c3-48dd-ad45-340a4766abd6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:16.617931 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-c052e283-7e2c-4bfb-9b25-0cc17f374a71 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:16.619920 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-c052e283-7e2c-4bfb-9b25-0cc17f374a71 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=a894075b-fa9f-4a27-9782-e476e86f74e0 HTTP/1.1" status: 200 len: 797 time: 0.2233310 Dec 09 21:32:16.625003 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-632a76b9-4de4-4830-8d74-7d2eeeb196fc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Made reservation on behalf of dc5c46f00552473abc0991c0cc4a0269 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:32:16.634087 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-632a76b9-4de4-4830-8d74-7d2eeeb196fc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:16.636891 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-67cae86a-3524-4054-8365-195cc600a5c8 req-b934c131-ccd6-4213-9f15-3f220ba41b7f tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:16.723677 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-67cae86a-3524-4054-8365-195cc600a5c8 req-b934c131-ccd6-4213-9f15-3f220ba41b7f tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:16.778955 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-632a76b9-4de4-4830-8d74-7d2eeeb196fc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] vlan segment allocate from pool success with {'vlan_id': 149, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:32:16.827622 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-632a76b9-4de4-4830-8d74-7d2eeeb196fc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:16.828252 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-632a76b9-4de4-4830-8d74-7d2eeeb196fc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Added segment 9055c882-8d23-4d06-ac3a-ba81cbed3435 of type vlan for network 14895561-e994-4995-86c1-0f7a5692e117 Dec 09 21:32:16.903389 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-67cae86a-3524-4054-8365-195cc600a5c8 req-b934c131-ccd6-4213-9f15-3f220ba41b7f tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Network 1b5db94a-f2e5-4ee6-b165-fbd41044188e is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:32:16.939567 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-67cae86a-3524-4054-8365-195cc600a5c8 req-b934c131-ccd6-4213-9f15-3f220ba41b7f tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:32:16.953875 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-67cae86a-3524-4054-8365-195cc600a5c8 req-b934c131-ccd6-4213-9f15-3f220ba41b7f tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:32:17.051307 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b934c131-ccd6-4213-9f15-3f220ba41b7f tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Pushing event updated for resources: {'Port': ['ID=e265ed07-d705-41c8-a70d-3b1f794ae6a7,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:17.170850 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67cae86a-3524-4054-8365-195cc600a5c8 req-b934c131-ccd6-4213-9f15-3f220ba41b7f tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:17.171610 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-67cae86a-3524-4054-8365-195cc600a5c8 req-b934c131-ccd6-4213-9f15-3f220ba41b7f tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:17.231782 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67cae86a-3524-4054-8365-195cc600a5c8 req-b934c131-ccd6-4213-9f15-3f220ba41b7f tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.0040271 Dec 09 21:32:17.249191 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-67cae86a-3524-4054-8365-195cc600a5c8 req-c5597628-a3c9-4e52-ad4f-911ca5f7e3d0 service neutron] Request body: {'port': {'device_id': '0572d5ce-eab2-4fdc-9c73-034455c686d3', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:17.335165 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-1cf17050-c6b8-46cc-ad75-f878e449cbd7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 287d2e38-af6c-4fbc-b196-bebf54c65697 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:32:17.355567 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-632a76b9-4de4-4830-8d74-7d2eeeb196fc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:17.364361 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-1cf17050-c6b8-46cc-ad75-f878e449cbd7 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:17.380987 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-67cae86a-3524-4054-8365-195cc600a5c8 req-c5597628-a3c9-4e52-ad4f-911ca5f7e3d0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:17.401011 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-632a76b9-4de4-4830-8d74-7d2eeeb196fc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:17.407381 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-632a76b9-4de4-4830-8d74-7d2eeeb196fc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:17.408323 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-632a76b9-4de4-4830-8d74-7d2eeeb196fc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:17.445977 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-bcd56bec-3240-48d0-81a7-9fbe11264dcc None None] Provisioning complete for port e265ed07-d705-41c8-a70d-3b1f794ae6a7 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:17.447621 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bcd56bec-3240-48d0-81a7-9fbe11264dcc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:17.480995 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-632a76b9-4de4-4830-8d74-7d2eeeb196fc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.9616737 Dec 09 21:32:17.482359 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-1cf17050-c6b8-46cc-ad75-f878e449cbd7 service neutron] Transition to ACTIVE for port object 287d2e38-af6c-4fbc-b196-bebf54c65697 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:32:17.483201 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46978) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:17.513784 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-b9829d69-956e-4876-9100-875c4aa79868 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'subnet': {'network_id': '14895561-e994-4995-86c1-0f7a5692e117', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:17.549054 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-1cf17050-c6b8-46cc-ad75-f878e449cbd7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:17.553783 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-bcd56bec-3240-48d0-81a7-9fbe11264dcc None None] Port e265ed07-d705-41c8-a70d-3b1f794ae6a7 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:32:17.607935 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-3cad6f4f-e16c-4453-b8c5-7d88cbc9c317 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:17.609606 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-3cad6f4f-e16c-4453-b8c5-7d88cbc9c317 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a859e4ba-764a-41c0-982d-5bf79a2797a1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.9434247 Dec 09 21:32:17.718195 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cf17050-c6b8-46cc-ad75-f878e449cbd7 service neutron] Pushing event updated for resources: {'Port': ['ID=287d2e38-af6c-4fbc-b196-bebf54c65697,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:17.804982 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba1e2098-dd8c-4102-af93-44846bd89fed req-cb6e221f-8314-45d4-9e16-9fe7dbd30651 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 210 time: 0.2695363 Dec 09 21:32:17.946826 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-6beb3dd8-d893-404a-9d4f-bb539e28881e tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:17.948672 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-6beb3dd8-d893-404a-9d4f-bb539e28881e tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.10 "GET /v2.0/networks?id=1b5db94a-f2e5-4ee6-b165-fbd41044188e HTTP/1.1" status: 200 len: 816 time: 0.5679848 Dec 09 21:32:18.182447 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-339447ad-3fe2-4414-8fd3-a189ef8b66d7 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5585763 Dec 09 21:32:18.183054 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-632a76b9-4de4-4830-8d74-7d2eeeb196fc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Network': ['ID=14895561-e994-4995-86c1-0f7a5692e117,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:18.189302 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-1cf17050-c6b8-46cc-ad75-f878e449cbd7 service neutron] Attempting to bind port 287d2e38-af6c-4fbc-b196-bebf54c65697 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:32:18.189649 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-1cf17050-c6b8-46cc-ad75-f878e449cbd7 service neutron] Attempting to bind port 287d2e38-af6c-4fbc-b196-bebf54c65697 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '0c438a9d-68a6-4675-b498-b86f6eed54d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:32:18.190672 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-1cf17050-c6b8-46cc-ad75-f878e449cbd7 service neutron] Attempting to bind port 287d2e38-af6c-4fbc-b196-bebf54c65697 on network 1b5db94a-f2e5-4ee6-b165-fbd41044188e {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:32:18.194917 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 14895561-e994-4995-86c1-0f7a5692e117 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:32:18.220984 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-698e72e9-64f3-43be-be60-e944d74db68d tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Request body: {'port': {'device_id': '9876e214-d2ce-42d5-9d51-0df26fa0939b', 'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e', 'admin_state_up': True, 'tenant_id': '6c358c3d1eb04dce9614ffbe3851e040'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:18.257645 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-1cf17050-c6b8-46cc-ad75-f878e449cbd7 service neutron] Port 287d2e38-af6c-4fbc-b196-bebf54c65697 on network 1b5db94a-f2e5-4ee6-b165-fbd41044188e not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:32:18.258231 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-1cf17050-c6b8-46cc-ad75-f878e449cbd7 service neutron] Attempting to bind port 287d2e38-af6c-4fbc-b196-bebf54c65697 on network 1b5db94a-f2e5-4ee6-b165-fbd41044188e {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:32:18.278264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-1cf17050-c6b8-46cc-ad75-f878e449cbd7 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 31, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:32:18.278644 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-1cf17050-c6b8-46cc-ad75-f878e449cbd7 service neutron] Checking segment: {'id': '0c438a9d-68a6-4675-b498-b86f6eed54d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:32:18.284808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-1cf17050-c6b8-46cc-ad75-f878e449cbd7 service neutron] Bound using segment: {'id': '0c438a9d-68a6-4675-b498-b86f6eed54d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:32:18.285489 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-1cf17050-c6b8-46cc-ad75-f878e449cbd7 service neutron] Bound port: 287d2e38-af6c-4fbc-b196-bebf54c65697, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0c438a9d-68a6-4675-b498-b86f6eed54d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:32:18.285875 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-1cf17050-c6b8-46cc-ad75-f878e449cbd7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:18.378507 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b9829d69-956e-4876-9100-875c4aa79868 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Made reservation on behalf of dc5c46f00552473abc0991c0cc4a0269 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:32:18.390626 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b9829d69-956e-4876-9100-875c4aa79868 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:18.810731 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-623bef0f-7990-48cb-9df1-90cab0e8c827 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5294859 Dec 09 21:32:18.817836 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b9829d69-956e-4876-9100-875c4aa79868 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:18.818334 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-698e72e9-64f3-43be-be60-e944d74db68d tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Made reservation on behalf of 6c358c3d1eb04dce9614ffbe3851e040 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:32:18.826084 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-698e72e9-64f3-43be-be60-e944d74db68d tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:19.030029 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-5a82117c-8257-4c39-a9cb-3b9c40560e76 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.110&port_id=7b66d328-f18c-4d26-af51-99c1b1f1f05e HTTP/1.1" status: 200 len: 217 time: 0.2129385 Dec 09 21:32:19.148891 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1268dcbe-c797-4c99-b86c-52669e53f90a req-455a3062-89de-44b6-9377-89ae8bd8fa45 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 210 time: 0.1098361 Dec 09 21:32:19.164606 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-7ac13ad2-260c-4a47-9810-05d712555449 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:19.166285 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-7ac13ad2-260c-4a47-9810-05d712555449 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=a894075b-fa9f-4a27-9782-e476e86f74e0 HTTP/1.1" status: 200 len: 797 time: 0.1250858 Dec 09 21:32:19.181531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9829d69-956e-4876-9100-875c4aa79868 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Subnet': ['ID=bcc3d9aa-1583-4f90-9c6b-e836366e8f18,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:19.194199 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-1cf17050-c6b8-46cc-ad75-f878e449cbd7 service neutron] For port 287d2e38-af6c-4fbc-b196-bebf54c65697, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:32:19.240477 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b9829d69-956e-4876-9100-875c4aa79868 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Checking segment: {'id': '9055c882-8d23-4d06-ac3a-ba81cbed3435', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '14895561-e994-4995-86c1-0f7a5692e117'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:32:19.241529 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b9829d69-956e-4876-9100-875c4aa79868 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network hostable DHCP agents. Network: 14895561-e994-4995-86c1-0f7a5692e117, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:32:19.249761 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-9297ed26-47a1-4bf7-a1cb-fff7039e9b06 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:19.253657 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-9297ed26-47a1-4bf7-a1cb-fff7039e9b06 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a859e4ba-764a-41c0-982d-5bf79a2797a1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0789804 Dec 09 21:32:19.291872 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-1cf17050-c6b8-46cc-ad75-f878e449cbd7 service neutron] For port 287d2e38-af6c-4fbc-b196-bebf54c65697, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=287d2e38-af6c-4fbc-b196-bebf54c65697,segment=NetworkSegment(0c438a9d-68a6-4675-b498-b86f6eed54d4),segment_id=0c438a9d-68a6-4675-b498-b86f6eed54d4)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:32:19.315768 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-1cf17050-c6b8-46cc-ad75-f878e449cbd7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:19.363505 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-1cf17050-c6b8-46cc-ad75-f878e449cbd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:19.364164 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-1cf17050-c6b8-46cc-ad75-f878e449cbd7 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:19.365585 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-1cf17050-c6b8-46cc-ad75-f878e449cbd7 service neutron] 10.222.0.31 "PUT /v2.0/ports/287d2e38-af6c-4fbc-b196-bebf54c65697 HTTP/1.1" status: 200 len: 1092 time: 3.7247231 Dec 09 21:32:19.367584 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bfdfbd26-1bb4-4590-8cdf-732329bfb002', 'tag': '287d2e38-af6c-4fbc-b196-bebf54c65697'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:32:19.379339 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0482bd0f-4fa7-4b3e-b047-d1b064a70a40" -d '{"events": [{"name": "network-changed", "server_uuid": "bfdfbd26-1bb4-4590-8cdf-732329bfb002", "tag": "287d2e38-af6c-4fbc-b196-bebf54c65697"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:32:19.399225 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-67cae86a-3524-4054-8365-195cc600a5c8 req-c5597628-a3c9-4e52-ad4f-911ca5f7e3d0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e265ed07-d705-41c8-a70d-3b1f794ae6a7 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:32:19.418783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b9829d69-956e-4876-9100-875c4aa79868 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network 14895561-e994-4995-86c1-0f7a5692e117 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:32:19.422925 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-67cae86a-3524-4054-8365-195cc600a5c8 req-c5597628-a3c9-4e52-ad4f-911ca5f7e3d0 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:19.438205 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-9f7a0c41-b424-433c-9765-c203de8ec054 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1751204 Dec 09 21:32:19.507409 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:32:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-08346fac-a9b4-46fc-8227-e10e6be492d6 x-openstack-request-id: req-08346fac-a9b4-46fc-8227-e10e6be492d6 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:32:19.507738 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bfdfbd26-1bb4-4590-8cdf-732329bfb002", "tag": "287d2e38-af6c-4fbc-b196-bebf54c65697", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:32:19.508005 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-08346fac-a9b4-46fc-8227-e10e6be492d6 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:32:19.510879 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bfdfbd26-1bb4-4590-8cdf-732329bfb002', 'tag': '287d2e38-af6c-4fbc-b196-bebf54c65697', 'status': 'completed', 'code': 200} Dec 09 21:32:19.597698 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-b9829d69-956e-4876-9100-875c4aa79868 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 14895561-e994-4995-86c1-0f7a5692e117) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:32:19.608210 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-429d5faf-af54-4c79-b873-e58c0e84b59c None None] Network 14895561-e994-4995-86c1-0f7a5692e117 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:32:19.616868 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b9829d69-956e-4876-9100-875c4aa79868 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:19.617577 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b9829d69-956e-4876-9100-875c4aa79868 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:19.632457 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-67cae86a-3524-4054-8365-195cc600a5c8 req-c5597628-a3c9-4e52-ad4f-911ca5f7e3d0 service neutron] Transition to ACTIVE for port object e265ed07-d705-41c8-a70d-3b1f794ae6a7 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:32:19.635049 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-158e59cd-0bf3-4da1-93f0-048c1dac8841 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:19.637511 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-158e59cd-0bf3-4da1-93f0-048c1dac8841 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6c358c3d1eb04dce9614ffbe3851e040&device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 1095 time: 0.2211347 Dec 09 21:32:19.643891 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cf17050-c6b8-46cc-ad75-f878e449cbd7 service neutron] Pushing event updated for resources: {'Port': ['ID=287d2e38-af6c-4fbc-b196-bebf54c65697,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:19.671692 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-67cae86a-3524-4054-8365-195cc600a5c8 req-c5597628-a3c9-4e52-ad4f-911ca5f7e3d0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:19.803196 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-e36b708b-26e9-46ca-b281-ac5426ad233d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=287d2e38-af6c-4fbc-b196-bebf54c65697 HTTP/1.1" status: 200 len: 217 time: 0.1557012 Dec 09 21:32:19.828975 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-60debb81-36ec-44f2-b365-01492c731626 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3827715 Dec 09 21:32:19.834241 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b9829d69-956e-4876-9100-875c4aa79868 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 2.3424981 Dec 09 21:32:19.841411 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47036) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:19.888850 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-2b328e84-8b5c-4a3e-8c8f-d3568348be8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:19.890572 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-2b328e84-8b5c-4a3e-8c8f-d3568348be8e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=e884864f-1596-4ce2-af55-9b1c3a7758eb HTTP/1.1" status: 200 len: 855 time: 0.0746391 Dec 09 21:32:19.909467 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-3c1a0c45-0b7d-4744-a072-a13572846d12 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-180441262', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:19.969259 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-619877e0-c56b-48e3-92cf-1a4ee1bc4922 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.206&port_id=3bbd0bd0-666a-4f39-abae-59f44d88319c HTTP/1.1" status: 200 len: 217 time: 0.1244857 Dec 09 21:32:19.978612 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-698e72e9-64f3-43be-be60-e944d74db68d tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Allocated IP 172.20.0.5 (1b5db94a-f2e5-4ee6-b165-fbd41044188e/e884864f-1596-4ce2-af55-9b1c3a7758eb/c71ed6b5-a11d-49bd-b829-084d7dc9af18) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:32:20.011221 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5597628-a3c9-4e52-ad4f-911ca5f7e3d0 service neutron] Pushing event updated for resources: {'Port': ['ID=e265ed07-d705-41c8-a70d-3b1f794ae6a7,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:20.089384 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-c2ae25fa-38e5-4ff9-9031-1cd74796217b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:20.096187 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-c2ae25fa-38e5-4ff9-9031-1cd74796217b service neutron] 10.222.0.10 "GET /v2.0/subnets?id=a894075b-fa9f-4a27-9782-e476e86f74e0 HTTP/1.1" status: 200 len: 797 time: 0.1144588 Dec 09 21:32:20.113292 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-9a052c86-5afb-41a2-ac96-0618bff14b94 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:20.115147 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-9a052c86-5afb-41a2-ac96-0618bff14b94 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1b5db94a-f2e5-4ee6-b165-fbd41044188e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2172234 Dec 09 21:32:20.142829 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-67cae86a-3524-4054-8365-195cc600a5c8 req-c5597628-a3c9-4e52-ad4f-911ca5f7e3d0 service neutron] Attempting to bind port e265ed07-d705-41c8-a70d-3b1f794ae6a7 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:32:20.144316 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-67cae86a-3524-4054-8365-195cc600a5c8 req-c5597628-a3c9-4e52-ad4f-911ca5f7e3d0 service neutron] Attempting to bind port e265ed07-d705-41c8-a70d-3b1f794ae6a7 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '0c438a9d-68a6-4675-b498-b86f6eed54d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:32:20.144828 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-67cae86a-3524-4054-8365-195cc600a5c8 req-c5597628-a3c9-4e52-ad4f-911ca5f7e3d0 service neutron] Attempting to bind port e265ed07-d705-41c8-a70d-3b1f794ae6a7 on network 1b5db94a-f2e5-4ee6-b165-fbd41044188e {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:32:20.230158 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-67cae86a-3524-4054-8365-195cc600a5c8 req-c5597628-a3c9-4e52-ad4f-911ca5f7e3d0 service neutron] Port e265ed07-d705-41c8-a70d-3b1f794ae6a7 on network 1b5db94a-f2e5-4ee6-b165-fbd41044188e not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:32:20.237384 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-67cae86a-3524-4054-8365-195cc600a5c8 req-c5597628-a3c9-4e52-ad4f-911ca5f7e3d0 service neutron] Attempting to bind port e265ed07-d705-41c8-a70d-3b1f794ae6a7 on network 1b5db94a-f2e5-4ee6-b165-fbd41044188e {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:32:20.274598 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-84acf0e9-5e40-437b-81f5-22354aab7358 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-14895561-e994-4995-86c1-0f7a5692e117', 'network_id': '14895561-e994-4995-86c1-0f7a5692e117', 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'fixed_ips': [{'subnet_id': 'bcc3d9aa-1583-4f90-9c6b-e836366e8f18'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:32:20.276997 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-84acf0e9-5e40-437b-81f5-22354aab7358 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:20.297282 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3c1a0c45-0b7d-4744-a072-a13572846d12 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:20.300861 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-67cae86a-3524-4054-8365-195cc600a5c8 req-c5597628-a3c9-4e52-ad4f-911ca5f7e3d0 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 31, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:32:20.301391 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-67cae86a-3524-4054-8365-195cc600a5c8 req-c5597628-a3c9-4e52-ad4f-911ca5f7e3d0 service neutron] Checking segment: {'id': '0c438a9d-68a6-4675-b498-b86f6eed54d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:32:20.301500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-67cae86a-3524-4054-8365-195cc600a5c8 req-c5597628-a3c9-4e52-ad4f-911ca5f7e3d0 service neutron] Bound using segment: {'id': '0c438a9d-68a6-4675-b498-b86f6eed54d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:32:20.301954 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-67cae86a-3524-4054-8365-195cc600a5c8 req-c5597628-a3c9-4e52-ad4f-911ca5f7e3d0 service neutron] Bound port: e265ed07-d705-41c8-a70d-3b1f794ae6a7, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0c438a9d-68a6-4675-b498-b86f6eed54d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:32:20.302319 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-67cae86a-3524-4054-8365-195cc600a5c8 req-c5597628-a3c9-4e52-ad4f-911ca5f7e3d0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:20.303277 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3c1a0c45-0b7d-4744-a072-a13572846d12 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:20.439987 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-16ed6484-55dd-416c-8545-e16eee42c72c service neutron] 10.222.0.31 "GET /v2.0/networks/1b5db94a-f2e5-4ee6-b165-fbd41044188e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2960634 Dec 09 21:32:20.638108 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3c1a0c45-0b7d-4744-a072-a13572846d12 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:20.647296 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-4ef91488-bc0b-43ed-8e56-c8647f07eb2b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:20.650199 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-4ef91488-bc0b-43ed-8e56-c8647f07eb2b service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a859e4ba-764a-41c0-982d-5bf79a2797a1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.5403132 Dec 09 21:32:20.666076 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3c1a0c45-0b7d-4744-a072-a13572846d12 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:20.677385 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-84acf0e9-5e40-437b-81f5-22354aab7358 None None] Allocated IP 2001:db8::2 (14895561-e994-4995-86c1-0f7a5692e117/bcc3d9aa-1583-4f90-9c6b-e836366e8f18/fb7d16f0-f6eb-4133-b3f1-5e16557b5578) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:32:20.730582 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3c1a0c45-0b7d-4744-a072-a13572846d12 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:20.731850 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3c1a0c45-0b7d-4744-a072-a13572846d12 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.8859859 Dec 09 21:32:20.773668 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47072) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:21.017569 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-84acf0e9-5e40-437b-81f5-22354aab7358 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:21.040434 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-84acf0e9-5e40-437b-81f5-22354aab7358 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:21.096630 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84acf0e9-5e40-437b-81f5-22354aab7358 None None] Network 14895561-e994-4995-86c1-0f7a5692e117 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:32:21.104460 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-84acf0e9-5e40-437b-81f5-22354aab7358 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:32:21.114080 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84acf0e9-5e40-437b-81f5-22354aab7358 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:32:21.123061 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84acf0e9-5e40-437b-81f5-22354aab7358 None None] Pushing event updated for resources: {'Port': ['ID=fb7d16f0-f6eb-4133-b3f1-5e16557b5578,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:21.219274 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-84acf0e9-5e40-437b-81f5-22354aab7358 None None] Attempting to bind port fb7d16f0-f6eb-4133-b3f1-5e16557b5578 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:32:21.220440 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-84acf0e9-5e40-437b-81f5-22354aab7358 None None] Attempting to bind port fb7d16f0-f6eb-4133-b3f1-5e16557b5578 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '9055c882-8d23-4d06-ac3a-ba81cbed3435', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '14895561-e994-4995-86c1-0f7a5692e117'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:32:21.220901 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84acf0e9-5e40-437b-81f5-22354aab7358 None None] Attempting to bind port fb7d16f0-f6eb-4133-b3f1-5e16557b5578 on network 14895561-e994-4995-86c1-0f7a5692e117 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:32:21.234652 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84acf0e9-5e40-437b-81f5-22354aab7358 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 32, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:32:21.234652 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84acf0e9-5e40-437b-81f5-22354aab7358 None None] Checking segment: {'id': '9055c882-8d23-4d06-ac3a-ba81cbed3435', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '14895561-e994-4995-86c1-0f7a5692e117'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:32:21.234652 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-84acf0e9-5e40-437b-81f5-22354aab7358 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:21.234652 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84acf0e9-5e40-437b-81f5-22354aab7358 None None] Bound using segment: {'id': '9055c882-8d23-4d06-ac3a-ba81cbed3435', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '14895561-e994-4995-86c1-0f7a5692e117'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:32:21.235196 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-84acf0e9-5e40-437b-81f5-22354aab7358 None None] Bound port: fb7d16f0-f6eb-4133-b3f1-5e16557b5578, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9055c882-8d23-4d06-ac3a-ba81cbed3435', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '14895561-e994-4995-86c1-0f7a5692e117'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:32:21.235296 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-84acf0e9-5e40-437b-81f5-22354aab7358 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:21.371541 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-84acf0e9-5e40-437b-81f5-22354aab7358 None None] For port fb7d16f0-f6eb-4133-b3f1-5e16557b5578, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:32:21.390674 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-84acf0e9-5e40-437b-81f5-22354aab7358 None None] For port fb7d16f0-f6eb-4133-b3f1-5e16557b5578, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=fb7d16f0-f6eb-4133-b3f1-5e16557b5578,segment=NetworkSegment(9055c882-8d23-4d06-ac3a-ba81cbed3435),segment_id=9055c882-8d23-4d06-ac3a-ba81cbed3435)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:32:21.401464 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-84acf0e9-5e40-437b-81f5-22354aab7358 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:21.506861 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84acf0e9-5e40-437b-81f5-22354aab7358 None None] Pushing event updated for resources: {'Port': ['ID=fb7d16f0-f6eb-4133-b3f1-5e16557b5578,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:21.510201 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6170022c-81ac-424b-af93-32531d4f2eb9 req-88cf367d-e176-4255-8584-e03c0e900721 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 210 time: 1.0688109 Dec 09 21:32:21.605664 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3af36931-13a3-48ef-8e75-ea64b5cd20d6 req-f1262b81-1192-43b9-9e6d-5b3cf4853e24 service neutron] 10.222.0.31 "GET /v2.0/networks/1b5db94a-f2e5-4ee6-b165-fbd41044188e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.1416721 Dec 09 21:32:21.782150 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-67cae86a-3524-4054-8365-195cc600a5c8 req-c5597628-a3c9-4e52-ad4f-911ca5f7e3d0 service neutron] For port e265ed07-d705-41c8-a70d-3b1f794ae6a7, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:32:21.793522 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-67cae86a-3524-4054-8365-195cc600a5c8 req-c5597628-a3c9-4e52-ad4f-911ca5f7e3d0 service neutron] For port e265ed07-d705-41c8-a70d-3b1f794ae6a7, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e265ed07-d705-41c8-a70d-3b1f794ae6a7,segment=NetworkSegment(0c438a9d-68a6-4675-b498-b86f6eed54d4),segment_id=0c438a9d-68a6-4675-b498-b86f6eed54d4)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:32:21.808079 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-67cae86a-3524-4054-8365-195cc600a5c8 req-c5597628-a3c9-4e52-ad4f-911ca5f7e3d0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:21.882034 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0482bd0f-4fa7-4b3e-b047-d1b064a70a40 req-35e5f0b6-0385-4e3d-84af-39f03a000d06 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:21.883699 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0482bd0f-4fa7-4b3e-b047-d1b064a70a40 req-35e5f0b6-0385-4e3d-84af-39f03a000d06 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6c358c3d1eb04dce9614ffbe3851e040&device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 1095 time: 0.2023401 Dec 09 21:32:21.885372 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-3f4410fa-79ab-4279-9ecb-a3e3b2b76274 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.2207429 Dec 09 21:32:21.894318 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67cae86a-3524-4054-8365-195cc600a5c8 req-c5597628-a3c9-4e52-ad4f-911ca5f7e3d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:21.894936 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-67cae86a-3524-4054-8365-195cc600a5c8 req-c5597628-a3c9-4e52-ad4f-911ca5f7e3d0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:21.897286 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67cae86a-3524-4054-8365-195cc600a5c8 req-c5597628-a3c9-4e52-ad4f-911ca5f7e3d0 service neutron] 10.222.0.10 "PUT /v2.0/ports/e265ed07-d705-41c8-a70d-3b1f794ae6a7 HTTP/1.1" status: 200 len: 1093 time: 4.6569066 Dec 09 21:32:21.897762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0572d5ce-eab2-4fdc-9c73-034455c686d3', 'tag': 'e265ed07-d705-41c8-a70d-3b1f794ae6a7'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:32:21.900412 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5639371d-43aa-43b4-a6a7-e856e337754a" -d '{"events": [{"name": "network-changed", "server_uuid": "0572d5ce-eab2-4fdc-9c73-034455c686d3", "tag": "e265ed07-d705-41c8-a70d-3b1f794ae6a7"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:32:22.059754 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:32:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c3f4f4a5-0f0a-439e-a668-6992754238a2 x-openstack-request-id: req-c3f4f4a5-0f0a-439e-a668-6992754238a2 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:32:22.060055 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0572d5ce-eab2-4fdc-9c73-034455c686d3", "tag": "e265ed07-d705-41c8-a70d-3b1f794ae6a7", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:32:22.060307 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c3f4f4a5-0f0a-439e-a668-6992754238a2 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:32:22.060713 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0572d5ce-eab2-4fdc-9c73-034455c686d3', 'tag': 'e265ed07-d705-41c8-a70d-3b1f794ae6a7', 'status': 'completed', 'code': 200} Dec 09 21:32:22.154709 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5597628-a3c9-4e52-ad4f-911ca5f7e3d0 service neutron] Pushing event updated for resources: {'Port': ['ID=e265ed07-d705-41c8-a70d-3b1f794ae6a7,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:22.159677 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-698e72e9-64f3-43be-be60-e944d74db68d tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:22.177498 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47142) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:22.222828 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67cae86a-3524-4054-8365-195cc600a5c8 req-37a12ad1-1014-458e-9982-bdcb2d188d6d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:22.224671 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67cae86a-3524-4054-8365-195cc600a5c8 req-37a12ad1-1014-458e-9982-bdcb2d188d6d service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=6c358c3d1eb04dce9614ffbe3851e040&device_id=0572d5ce-eab2-4fdc-9c73-034455c686d3 HTTP/1.1" status: 200 len: 1096 time: 0.2384377 Dec 09 21:32:22.231121 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0482bd0f-4fa7-4b3e-b047-d1b064a70a40 req-4d6754bf-9447-45f3-92b6-25d415c82ad6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:22.232960 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0482bd0f-4fa7-4b3e-b047-d1b064a70a40 req-4d6754bf-9447-45f3-92b6-25d415c82ad6 service neutron] 10.222.0.31 "GET /v2.0/networks?id=1b5db94a-f2e5-4ee6-b165-fbd41044188e HTTP/1.1" status: 200 len: 917 time: 0.3279679 Dec 09 21:32:22.290806 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0729cd6b-71ea-4f37-a7e9-0882edc99cc1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:22.392935 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-b4835e46-1eb9-4fe8-95a8-77ab4a842606 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4988191 Dec 09 21:32:22.393105 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67cae86a-3524-4054-8365-195cc600a5c8 req-1df87005-009d-4b32-bec7-c274c6c5eb9b service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=e265ed07-d705-41c8-a70d-3b1f794ae6a7 HTTP/1.1" status: 200 len: 217 time: 0.1360919 Dec 09 21:32:22.394237 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0482bd0f-4fa7-4b3e-b047-d1b064a70a40 req-605f3d6e-3aa1-45bb-80ce-3235cfa528c1 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=287d2e38-af6c-4fbc-b196-bebf54c65697 HTTP/1.1" status: 200 len: 217 time: 0.1512477 Dec 09 21:32:22.434831 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-751fc8b9-8f0d-48d4-af37-c6728144cca8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:22.537584 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67cae86a-3524-4054-8365-195cc600a5c8 req-dc9f1947-c50c-46f8-83f2-aaa69d6af60f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:22.539118 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67cae86a-3524-4054-8365-195cc600a5c8 req-dc9f1947-c50c-46f8-83f2-aaa69d6af60f service neutron] 10.222.0.10 "GET /v2.0/subnets?id=e884864f-1596-4ce2-af55-9b1c3a7758eb HTTP/1.1" status: 200 len: 855 time: 0.1133976 Dec 09 21:32:22.549902 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0482bd0f-4fa7-4b3e-b047-d1b064a70a40 req-d272cd1a-a4f5-47c6-840f-99393463a159 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:22.551323 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0482bd0f-4fa7-4b3e-b047-d1b064a70a40 req-d272cd1a-a4f5-47c6-840f-99393463a159 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=e884864f-1596-4ce2-af55-9b1c3a7758eb HTTP/1.1" status: 200 len: 855 time: 0.1485987 Dec 09 21:32:22.688449 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-751fc8b9-8f0d-48d4-af37-c6728144cca8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:22.723995 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-751fc8b9-8f0d-48d4-af37-c6728144cca8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:22.832752 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-751fc8b9-8f0d-48d4-af37-c6728144cca8 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=bdcba513c8b043e78efcf1448ac81d8f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6514654 Dec 09 21:32:22.840400 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d9a7de24-360e-4224-b24c-2018494a98e8 req-e75a7a80-ecdc-4f65-904a-5a7b55ed011d tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 210 time: 0.0791516 Dec 09 21:32:22.840989 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47158) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:22.841849 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-751fc8b9-8f0d-48d4-af37-c6728144cca8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=583346a3-f6ad-4689-b14a-27cf7da1df10,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:22.885383 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67cae86a-3524-4054-8365-195cc600a5c8 req-50c26d28-4e5e-4d6d-9d72-2c30c8a37439 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:22.887959 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67cae86a-3524-4054-8365-195cc600a5c8 req-50c26d28-4e5e-4d6d-9d72-2c30c8a37439 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=1b5db94a-f2e5-4ee6-b165-fbd41044188e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.3331616 Dec 09 21:32:22.890514 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0482bd0f-4fa7-4b3e-b047-d1b064a70a40 req-b2a3edfb-bb04-4d2c-9d7b-bcec053b97ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:22.892176 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0482bd0f-4fa7-4b3e-b047-d1b064a70a40 req-b2a3edfb-bb04-4d2c-9d7b-bcec053b97ec service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1b5db94a-f2e5-4ee6-b165-fbd41044188e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.3193092 Dec 09 21:32:23.170221 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67cae86a-3524-4054-8365-195cc600a5c8 req-ebd3198a-c851-4e76-b428-03e9cdbaa531 service neutron] 10.222.0.10 "GET /v2.0/networks/1b5db94a-f2e5-4ee6-b165-fbd41044188e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2724643 Dec 09 21:32:23.411370 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67cae86a-3524-4054-8365-195cc600a5c8 req-4c152145-f635-403b-91f5-fb53b2b3a211 service neutron] 10.222.0.10 "GET /v2.0/networks/1b5db94a-f2e5-4ee6-b165-fbd41044188e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1868391 Dec 09 21:32:23.510746 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device fb7d16f0-f6eb-4133-b3f1-5e16557b5578 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:32:23.520737 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-0729cd6b-71ea-4f37-a7e9-0882edc99cc1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Allocated IP 2001:db8::1 (14895561-e994-4995-86c1-0f7a5692e117/bcc3d9aa-1583-4f90-9c6b-e836366e8f18/3117fcc7-2bf8-465c-9eb2-4504b594de80) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:32:23.659674 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-698e72e9-64f3-43be-be60-e944d74db68d tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:23.666413 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5639371d-43aa-43b4-a6a7-e856e337754a req-13e3b44e-4fd7-4ed0-b445-dc1b9ed6982c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:23.667049 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a67411b5-c78a-4d03-8df5-2825c768020c None None] Network 14895561-e994-4995-86c1-0f7a5692e117 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:32:23.667978 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5639371d-43aa-43b4-a6a7-e856e337754a req-13e3b44e-4fd7-4ed0-b445-dc1b9ed6982c service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=6c358c3d1eb04dce9614ffbe3851e040&device_id=0572d5ce-eab2-4fdc-9c73-034455c686d3 HTTP/1.1" status: 200 len: 1096 time: 0.0999062 Dec 09 21:32:23.673448 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0482bd0f-4fa7-4b3e-b047-d1b064a70a40 req-b5b471b0-1b56-474c-a74b-8037825900db service neutron] 10.222.0.31 "GET /v2.0/networks/1b5db94a-f2e5-4ee6-b165-fbd41044188e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5010605 Dec 09 21:32:23.676798 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port fb7d16f0-f6eb-4133-b3f1-5e16557b5578 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:23.677293 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:23.706743 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-d59ce753-6839-42b3-85aa-bed57f23eddf service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.100&port_id=d0dcf098-4522-4347-b733-bbc98e48d7e0 HTTP/1.1" status: 200 len: 217 time: 0.6024878 Dec 09 21:32:23.726437 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-edbdbc7f-6044-4716-978a-33d7e7db1bfd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:23.814613 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-7eca3033-bb1b-4d8e-925f-d02287eb7e71 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:23.815028 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-7eca3033-bb1b-4d8e-925f-d02287eb7e71 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=753ba647-b0b0-482e-ac28-89c7e6adf654 HTTP/1.1" status: 200 len: 797 time: 0.0939336 Dec 09 21:32:23.853398 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-68244b43-f114-470d-9585-c4f6ccc96aa0 None None] Provisioning complete for port fb7d16f0-f6eb-4133-b3f1-5e16557b5578 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:23.853934 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-68244b43-f114-470d-9585-c4f6ccc96aa0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:23.876469 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-698e72e9-64f3-43be-be60-e944d74db68d tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Network 1b5db94a-f2e5-4ee6-b165-fbd41044188e is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:32:23.950500 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:23.995030 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-698e72e9-64f3-43be-be60-e944d74db68d tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:32:24.016627 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-698e72e9-64f3-43be-be60-e944d74db68d tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:32:24.021591 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-698e72e9-64f3-43be-be60-e944d74db68d tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Pushing event updated for resources: {'Port': ['ID=c71ed6b5-a11d-49bd-b829-084d7dc9af18,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:24.059686 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0729cd6b-71ea-4f37-a7e9-0882edc99cc1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:24.067339 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-68244b43-f114-470d-9585-c4f6ccc96aa0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:24.070402 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-edbdbc7f-6044-4716-978a-33d7e7db1bfd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:24.106344 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port fb7d16f0-f6eb-4133-b3f1-5e16557b5578, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=fb7d16f0-f6eb-4133-b3f1-5e16557b5578,segment=NetworkSegment(9055c882-8d23-4d06-ac3a-ba81cbed3435),segment_id=9055c882-8d23-4d06-ac3a-ba81cbed3435)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:24.117260 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:24.206695 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0482bd0f-4fa7-4b3e-b047-d1b064a70a40 req-4a4f72b6-20e9-43cc-afc4-9ceb0014cab0 service neutron] 10.222.0.31 "GET /v2.0/networks/1b5db94a-f2e5-4ee6-b165-fbd41044188e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5050061 Dec 09 21:32:24.210417 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0729cd6b-71ea-4f37-a7e9-0882edc99cc1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:24.246877 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5639371d-43aa-43b4-a6a7-e856e337754a req-8358a66e-b556-47dc-a0ba-3e2e39e03488 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:24.248392 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5639371d-43aa-43b4-a6a7-e856e337754a req-8358a66e-b556-47dc-a0ba-3e2e39e03488 service neutron] 10.222.0.10 "GET /v2.0/networks?id=1b5db94a-f2e5-4ee6-b165-fbd41044188e HTTP/1.1" status: 200 len: 917 time: 0.5719013 Dec 09 21:32:24.274302 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cfc12fb-201f-4e9a-9fb1-b802795d3052 req-87934cb7-94c9-407e-9a67-5b8694486b5e tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:24.292843 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3cfc12fb-201f-4e9a-9fb1-b802795d3052 req-87934cb7-94c9-407e-9a67-5b8694486b5e tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 931 time: 0.2500815 Dec 09 21:32:24.296299 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0729cd6b-71ea-4f37-a7e9-0882edc99cc1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Port': ['ID=3117fcc7-2bf8-465c-9eb2-4504b594de80,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:24.321316 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-ef8325d4-815b-40f3-934e-d0925eb6d4dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:24.323564 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-ef8325d4-815b-40f3-934e-d0925eb6d4dc service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a133a939-2827-4fe6-81f5-14715631c0ec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.4869189 Dec 09 21:32:24.332648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=fb7d16f0-f6eb-4133-b3f1-5e16557b5578,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:24.392798 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0729cd6b-71ea-4f37-a7e9-0882edc99cc1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network 14895561-e994-4995-86c1-0f7a5692e117 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:32:24.394620 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-68244b43-f114-470d-9585-c4f6ccc96aa0 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:32:24.394986 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-68244b43-f114-470d-9585-c4f6ccc96aa0 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:32:24.412255 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5639371d-43aa-43b4-a6a7-e856e337754a req-cea15444-583a-489c-b4bd-c892030bf33d service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=e265ed07-d705-41c8-a70d-3b1f794ae6a7 HTTP/1.1" status: 200 len: 217 time: 0.0828300 Dec 09 21:32:24.420319 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-698e72e9-64f3-43be-be60-e944d74db68d tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:24.421747 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-698e72e9-64f3-43be-be60-e944d74db68d tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:24.448831 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-0729cd6b-71ea-4f37-a7e9-0882edc99cc1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:32:24.457117 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-698e72e9-64f3-43be-be60-e944d74db68d tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 6.2497549 Dec 09 21:32:24.458058 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0729cd6b-71ea-4f37-a7e9-0882edc99cc1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:32:24.458934 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0729cd6b-71ea-4f37-a7e9-0882edc99cc1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:24.512234 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-edbdbc7f-6044-4716-978a-33d7e7db1bfd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:24.515940 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-edbdbc7f-6044-4716-978a-33d7e7db1bfd admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:24.517406 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-edbdbc7f-6044-4716-978a-33d7e7db1bfd admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/583346a3-f6ad-4689-b14a-27cf7da1df10 HTTP/1.1" status: 204 len: 168 time: 1.6656435 Dec 09 21:32:24.565612 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-139fc77a-626f-40fb-9140-bcd8b24c36e8 service neutron] Request body: {'port': {'device_id': '9876e214-d2ce-42d5-9d51-0df26fa0939b', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:24.568322 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edbdbc7f-6044-4716-978a-33d7e7db1bfd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=583346a3-f6ad-4689-b14a-27cf7da1df10,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:24.595195 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3cfc12fb-201f-4e9a-9fb1-b802795d3052 req-b322d2b6-7f26-4516-92a3-de51694f2c26 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2985625 Dec 09 21:32:24.596960 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5639371d-43aa-43b4-a6a7-e856e337754a req-ecce1fea-59ab-4df3-a0e6-fd219e63eb58 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:24.598668 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5639371d-43aa-43b4-a6a7-e856e337754a req-ecce1fea-59ab-4df3-a0e6-fd219e63eb58 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=e884864f-1596-4ce2-af55-9b1c3a7758eb HTTP/1.1" status: 200 len: 855 time: 0.1736724 Dec 09 21:32:24.690839 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 287d2e38-af6c-4fbc-b196-bebf54c65697 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:32:24.698587 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5639371d-43aa-43b4-a6a7-e856e337754a req-d1634581-922f-44f7-b8d4-3e87b0149755 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:24.700195 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5639371d-43aa-43b4-a6a7-e856e337754a req-d1634581-922f-44f7-b8d4-3e87b0149755 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=1b5db94a-f2e5-4ee6-b165-fbd41044188e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0934381 Dec 09 21:32:24.879151 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0729cd6b-71ea-4f37-a7e9-0882edc99cc1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:24.952647 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5639371d-43aa-43b4-a6a7-e856e337754a req-a5a94106-166a-4807-99aa-48d9d3c595ae service neutron] 10.222.0.10 "GET /v2.0/networks/1b5db94a-f2e5-4ee6-b165-fbd41044188e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2437139 Dec 09 21:32:25.011658 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 287d2e38-af6c-4fbc-b196-bebf54c65697, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=287d2e38-af6c-4fbc-b196-bebf54c65697,segment=NetworkSegment(0c438a9d-68a6-4675-b498-b86f6eed54d4),segment_id=0c438a9d-68a6-4675-b498-b86f6eed54d4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:25.061403 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '287d2e38-af6c-4fbc-b196-bebf54c65697', 'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e', 'port_id': '287d2e38-af6c-4fbc-b196-bebf54c65697', 'mac_address': 'fa:16:3e:56:82:b4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 137, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e884864f-1596-4ce2-af55-9b1c3a7758eb', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:32:25.077311 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-6b8947a7-e7db-4161-bcde-760df9d74528 service neutron] 10.222.0.10 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7442803 Dec 09 21:32:25.105654 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-139fc77a-626f-40fb-9140-bcd8b24c36e8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:25.219595 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5639371d-43aa-43b4-a6a7-e856e337754a req-cd36dfc0-8156-4693-8db5-09a1f3ad518b service neutron] 10.222.0.10 "GET /v2.0/networks/1b5db94a-f2e5-4ee6-b165-fbd41044188e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2594066 Dec 09 21:32:25.258525 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47190) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:25.280911 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8b363955-9cb3-468f-98b2-495c3177bdc2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:25.341139 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:25.372988 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8b363955-9cb3-468f-98b2-495c3177bdc2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:25.383006 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8b363955-9cb3-468f-98b2-495c3177bdc2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:25.404916 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4a755501-ea44-4d40-9207-f1bb8d2e5fbb None None] Provisioning complete for port fb7d16f0-f6eb-4133-b3f1-5e16557b5578 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:25.406870 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4a755501-ea44-4d40-9207-f1bb8d2e5fbb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:25.469773 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-dce4cd5f-66e1-41f9-8f60-bae3ce61e4c1 service neutron] 10.222.0.10 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3828380 Dec 09 21:32:25.479146 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 287d2e38-af6c-4fbc-b196-bebf54c65697 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:32:25.507984 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device fb7d16f0-f6eb-4133-b3f1-5e16557b5578 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:32:25.553362 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b363955-9cb3-468f-98b2-495c3177bdc2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e9e23536-0d8e-4c5c-8697-37489de60745,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:25.570364 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8b363955-9cb3-468f-98b2-495c3177bdc2 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=1ed60f322a714547b8556ee48de4dfd9&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3105357 Dec 09 21:32:25.572866 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47194) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:25.602039 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-f418127a-6b51-44ba-9260-582e6fa4cba2 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=b7cad057-c6e6-483b-9791-e1b1a0dd73ac HTTP/1.1" status: 200 len: 217 time: 0.1163800 Dec 09 21:32:25.623627 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 287d2e38-af6c-4fbc-b196-bebf54c65697, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=287d2e38-af6c-4fbc-b196-bebf54c65697,segment=NetworkSegment(0c438a9d-68a6-4675-b498-b86f6eed54d4),segment_id=0c438a9d-68a6-4675-b498-b86f6eed54d4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:25.646882 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:25.681752 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4a422f63-110b-4070-8fe6-b17329a773f8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:25.706163 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-dee08b85-19ca-431b-9340-aac521a818c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:25.713895 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-dee08b85-19ca-431b-9340-aac521a818c7 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=753ba647-b0b0-482e-ac28-89c7e6adf654 HTTP/1.1" status: 200 len: 797 time: 0.1012590 Dec 09 21:32:25.738364 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4a422f63-110b-4070-8fe6-b17329a773f8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:25.780287 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4a755501-ea44-4d40-9207-f1bb8d2e5fbb None None] Provisioning complete for port c71ed6b5-a11d-49bd-b829-084d7dc9af18 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:25.781356 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4a755501-ea44-4d40-9207-f1bb8d2e5fbb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:25.907277 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4a422f63-110b-4070-8fe6-b17329a773f8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:25.911811 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4a422f63-110b-4070-8fe6-b17329a773f8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:25.913275 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4a422f63-110b-4070-8fe6-b17329a773f8 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/e9e23536-0d8e-4c5c-8697-37489de60745 HTTP/1.1" status: 204 len: 168 time: 0.3394096 Dec 09 21:32:25.935598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a422f63-110b-4070-8fe6-b17329a773f8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e9e23536-0d8e-4c5c-8697-37489de60745,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:26.062553 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-5be1162e-2529-4e51-bdb4-629a0f8b2938 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:26.067076 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-5be1162e-2529-4e51-bdb4-629a0f8b2938 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a133a939-2827-4fe6-81f5-14715631c0ec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.3389506 Dec 09 21:32:26.082712 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['287d2e38-af6c-4fbc-b196-bebf54c65697'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:32:26.118027 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port fb7d16f0-f6eb-4133-b3f1-5e16557b5578 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:26.118428 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:26.177945 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=287d2e38-af6c-4fbc-b196-bebf54c65697,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:26.184502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-4a755501-ea44-4d40-9207-f1bb8d2e5fbb None None] Port c71ed6b5-a11d-49bd-b829-084d7dc9af18 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:32:26.279610 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e265ed07-d705-41c8-a70d-3b1f794ae6a7 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:32:26.331815 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4a755501-ea44-4d40-9207-f1bb8d2e5fbb None None] Provisioning complete for port 3117fcc7-2bf8-465c-9eb2-4504b594de80 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:26.331815 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4a755501-ea44-4d40-9207-f1bb8d2e5fbb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:26.439233 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-4a755501-ea44-4d40-9207-f1bb8d2e5fbb None None] Port 3117fcc7-2bf8-465c-9eb2-4504b594de80 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:32:26.466914 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-139fc77a-626f-40fb-9140-bcd8b24c36e8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c71ed6b5-a11d-49bd-b829-084d7dc9af18 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:32:26.516445 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-350cc264-cd20-464c-be85-7c9d7b49d4a1 req-e9b4d27b-b79f-4dd6-838b-d5b9dc24a980 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:26.517626 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0729cd6b-71ea-4f37-a7e9-0882edc99cc1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:26.529778 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-350cc264-cd20-464c-be85-7c9d7b49d4a1 req-e9b4d27b-b79f-4dd6-838b-d5b9dc24a980 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 931 time: 0.7843649 Dec 09 21:32:26.558291 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-139fc77a-626f-40fb-9140-bcd8b24c36e8 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:26.567392 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0729cd6b-71ea-4f37-a7e9-0882edc99cc1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:26.568320 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0729cd6b-71ea-4f37-a7e9-0882edc99cc1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:26.618633 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-350cc264-cd20-464c-be85-7c9d7b49d4a1 req-3444cd1c-056b-4eca-95c7-158c4978167f tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0853090 Dec 09 21:32:26.783689 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-139fc77a-626f-40fb-9140-bcd8b24c36e8 service neutron] Transition to ACTIVE for port object c71ed6b5-a11d-49bd-b829-084d7dc9af18 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:32:26.786482 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0729cd6b-71ea-4f37-a7e9-0882edc99cc1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Port': ['ID=3117fcc7-2bf8-465c-9eb2-4504b594de80,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:26.789980 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port e265ed07-d705-41c8-a70d-3b1f794ae6a7, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e265ed07-d705-41c8-a70d-3b1f794ae6a7,segment=NetworkSegment(0c438a9d-68a6-4675-b498-b86f6eed54d4),segment_id=0c438a9d-68a6-4675-b498-b86f6eed54d4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:26.830897 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'e265ed07-d705-41c8-a70d-3b1f794ae6a7', 'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e', 'port_id': 'e265ed07-d705-41c8-a70d-3b1f794ae6a7', 'mac_address': 'fa:16:3e:eb:a9:b0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 137, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e884864f-1596-4ce2-af55-9b1c3a7758eb', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:32:26.890374 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-139fc77a-626f-40fb-9140-bcd8b24c36e8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:26.935616 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:26.965961 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e265ed07-d705-41c8-a70d-3b1f794ae6a7 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:32:27.037640 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port e265ed07-d705-41c8-a70d-3b1f794ae6a7, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e265ed07-d705-41c8-a70d-3b1f794ae6a7,segment=NetworkSegment(0c438a9d-68a6-4675-b498-b86f6eed54d4),segment_id=0c438a9d-68a6-4675-b498-b86f6eed54d4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:27.046765 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:27.143070 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=e265ed07-d705-41c8-a70d-3b1f794ae6a7,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:27.247609 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:27.249237 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:27.328867 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-f65d0a41-60a3-48dc-874c-3042da9c4dd4 service neutron] 10.222.0.10 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.2481508 Dec 09 21:32:27.353471 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-139fc77a-626f-40fb-9140-bcd8b24c36e8 service neutron] Pushing event updated for resources: {'Port': ['ID=c71ed6b5-a11d-49bd-b829-084d7dc9af18,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:27.378591 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['e265ed07-d705-41c8-a70d-3b1f794ae6a7'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:32:27.646341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-139fc77a-626f-40fb-9140-bcd8b24c36e8 service neutron] Attempting to bind port c71ed6b5-a11d-49bd-b829-084d7dc9af18 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:32:27.646964 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-139fc77a-626f-40fb-9140-bcd8b24c36e8 service neutron] Attempting to bind port c71ed6b5-a11d-49bd-b829-084d7dc9af18 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '0c438a9d-68a6-4675-b498-b86f6eed54d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:32:27.647535 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-139fc77a-626f-40fb-9140-bcd8b24c36e8 service neutron] Attempting to bind port c71ed6b5-a11d-49bd-b829-084d7dc9af18 on network 1b5db94a-f2e5-4ee6-b165-fbd41044188e {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:32:27.656236 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0729cd6b-71ea-4f37-a7e9-0882edc99cc1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network 14895561-e994-4995-86c1-0f7a5692e117 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:32:27.666995 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-0729cd6b-71ea-4f37-a7e9-0882edc99cc1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:32:27.708436 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-139fc77a-626f-40fb-9140-bcd8b24c36e8 service neutron] Port c71ed6b5-a11d-49bd-b829-084d7dc9af18 on network 1b5db94a-f2e5-4ee6-b165-fbd41044188e not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:32:27.708774 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-139fc77a-626f-40fb-9140-bcd8b24c36e8 service neutron] Attempting to bind port c71ed6b5-a11d-49bd-b829-084d7dc9af18 on network 1b5db94a-f2e5-4ee6-b165-fbd41044188e {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:32:27.924430 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-139fc77a-626f-40fb-9140-bcd8b24c36e8 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 32, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:32:27.925197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-139fc77a-626f-40fb-9140-bcd8b24c36e8 service neutron] Checking segment: {'id': '0c438a9d-68a6-4675-b498-b86f6eed54d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:32:27.925325 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-139fc77a-626f-40fb-9140-bcd8b24c36e8 service neutron] Bound using segment: {'id': '0c438a9d-68a6-4675-b498-b86f6eed54d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:32:27.925817 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-139fc77a-626f-40fb-9140-bcd8b24c36e8 service neutron] Bound port: c71ed6b5-a11d-49bd-b829-084d7dc9af18, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0c438a9d-68a6-4675-b498-b86f6eed54d4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:32:27.926112 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-139fc77a-626f-40fb-9140-bcd8b24c36e8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:27.944317 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b97e5199-b3d1-45ad-a6b3-a097ed8aec25 req-4fa388c0-b4c9-40a6-86f1-e09fd6c5e9e7 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:27.956246 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cdf4f9a7-7cdc-4f2d-9c88-118500031275 req-d3737677-53e9-44ce-af05-07fb2816c9ef service neutron] 10.222.0.10 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6095133 Dec 09 21:32:27.960472 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b97e5199-b3d1-45ad-a6b3-a097ed8aec25 req-4fa388c0-b4c9-40a6-86f1-e09fd6c5e9e7 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 943 time: 0.1662734 Dec 09 21:32:28.122532 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b97e5199-b3d1-45ad-a6b3-a097ed8aec25 req-b0ebf7ce-a813-4fa6-826f-dc649822f978 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1610322 Dec 09 21:32:28.159622 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-139fc77a-626f-40fb-9140-bcd8b24c36e8 service neutron] For port c71ed6b5-a11d-49bd-b829-084d7dc9af18, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:32:28.161953 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0729cd6b-71ea-4f37-a7e9-0882edc99cc1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Router dd81e963-d253-47c9-86cc-d86b4560bd0d is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:32:28.170783 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-139fc77a-626f-40fb-9140-bcd8b24c36e8 service neutron] For port c71ed6b5-a11d-49bd-b829-084d7dc9af18, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=c71ed6b5-a11d-49bd-b829-084d7dc9af18,segment=NetworkSegment(0c438a9d-68a6-4675-b498-b86f6eed54d4),segment_id=0c438a9d-68a6-4675-b498-b86f6eed54d4)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:32:28.241370 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-139fc77a-626f-40fb-9140-bcd8b24c36e8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:28.307368 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-139fc77a-626f-40fb-9140-bcd8b24c36e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:28.308319 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-139fc77a-626f-40fb-9140-bcd8b24c36e8 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:28.309932 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-139fc77a-626f-40fb-9140-bcd8b24c36e8 service neutron] 10.222.0.10 "PUT /v2.0/ports/c71ed6b5-a11d-49bd-b829-084d7dc9af18 HTTP/1.1" status: 200 len: 1092 time: 3.7668073 Dec 09 21:32:28.323846 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9876e214-d2ce-42d5-9d51-0df26fa0939b', 'tag': 'c71ed6b5-a11d-49bd-b829-084d7dc9af18'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:32:28.326609 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-98734a8c-1641-49dc-ae22-fe385d5a7439" -d '{"events": [{"name": "network-changed", "server_uuid": "9876e214-d2ce-42d5-9d51-0df26fa0939b", "tag": "c71ed6b5-a11d-49bd-b829-084d7dc9af18"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:32:28.332148 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4a9eaed0-c2de-49a6-97df-75c93c602611 None None] Provisioning complete for port 3117fcc7-2bf8-465c-9eb2-4504b594de80 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:28.333263 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4a9eaed0-c2de-49a6-97df-75c93c602611 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:28.446690 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-4a9eaed0-c2de-49a6-97df-75c93c602611 None None] Port 3117fcc7-2bf8-465c-9eb2-4504b594de80 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:32:28.552249 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0729cd6b-71ea-4f37-a7e9-0882edc99cc1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:32:28.563339 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:32:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e4ec8ff0-69c5-4413-a560-661d8b96f076 x-openstack-request-id: req-e4ec8ff0-69c5-4413-a560-661d8b96f076 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:32:28.563672 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9876e214-d2ce-42d5-9d51-0df26fa0939b", "tag": "c71ed6b5-a11d-49bd-b829-084d7dc9af18", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:32:28.563930 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e4ec8ff0-69c5-4413-a560-661d8b96f076 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:32:28.564339 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9876e214-d2ce-42d5-9d51-0df26fa0939b', 'tag': 'c71ed6b5-a11d-49bd-b829-084d7dc9af18', 'status': 'completed', 'code': 200} Dec 09 21:32:28.571675 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e872390-ec80-4280-8eaa-06c4d900c648 None None] Sync routers for ids ['dd81e963-d253-47c9-86cc-d86b4560bd0d'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:32:28.593665 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0729cd6b-71ea-4f37-a7e9-0882edc99cc1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/routers/dd81e963-d253-47c9-86cc-d86b4560bd0d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.8136947 Dec 09 21:32:28.593916 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e872390-ec80-4280-8eaa-06c4d900c648 None None] Routers {'dd81e963-d253-47c9-86cc-d86b4560bd0d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:32:28.593916 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-8e872390-ec80-4280-8eaa-06c4d900c648 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:32:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['dd81e963-d253-47c9-86cc-d86b4560bd0d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:28.594138 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47290) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:28.605341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-139fc77a-626f-40fb-9140-bcd8b24c36e8 service neutron] Pushing event updated for resources: {'Port': ['ID=c71ed6b5-a11d-49bd-b829-084d7dc9af18,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:28.663913 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-0bd45d1f-b174-4df7-8122-ef4d7568f773 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:28.669795 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-0bd45d1f-b174-4df7-8122-ef4d7568f773 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=6c358c3d1eb04dce9614ffbe3851e040&device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 1095 time: 0.2816653 Dec 09 21:32:28.702861 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 287d2e38-af6c-4fbc-b196-bebf54c65697 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:32:28.729550 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-8e872390-ec80-4280-8eaa-06c4d900c648 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:28.736440 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5fa9624-7bee-4fc3-a155-8eb4f4139e15 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:28.739489 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c5fa9624-7bee-4fc3-a155-8eb4f4139e15 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/ports/3117fcc7-2bf8-465c-9eb2-4504b594de80 HTTP/1.1" status: 200 len: 911 time: 0.1428783 Dec 09 21:32:28.740906 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47300) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:28.749936 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e872390-ec80-4280-8eaa-06c4d900c648 None None] Routers {'dd81e963-d253-47c9-86cc-d86b4560bd0d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:32:28.750899 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-8e872390-ec80-4280-8eaa-06c4d900c648 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:32:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['dd81e963-d253-47c9-86cc-d86b4560bd0d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:28.828993 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-8e872390-ec80-4280-8eaa-06c4d900c648 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:28.829131 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-366bc0ff-fd63-4080-986f-69b7e4a0d1a9 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c71ed6b5-a11d-49bd-b829-084d7dc9af18 HTTP/1.1" status: 200 len: 217 time: 0.1456525 Dec 09 21:32:28.835693 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e872390-ec80-4280-8eaa-06c4d900c648 None None] The sync data for ids ['dd81e963-d253-47c9-86cc-d86b4560bd0d'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:32:28.843735 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 287d2e38-af6c-4fbc-b196-bebf54c65697 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:32:28.855651 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 287d2e38-af6c-4fbc-b196-bebf54c65697 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:28.856030 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:28.905874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-4616bc57-06c8-4240-b3f6-a1ba577f3784 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:28.908215 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-4616bc57-06c8-4240-b3f6-a1ba577f3784 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=e884864f-1596-4ce2-af55-9b1c3a7758eb HTTP/1.1" status: 200 len: 855 time: 0.0734921 Dec 09 21:32:28.986468 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-412d7615-144f-4c2c-94fe-8dd465ae510c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:28.988750 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-412d7615-144f-4c2c-94fe-8dd465ae510c service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=1b5db94a-f2e5-4ee6-b165-fbd41044188e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0722783 Dec 09 21:32:29.052406 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:29.101068 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bfdfbd26-1bb4-4590-8cdf-732329bfb002', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '287d2e38-af6c-4fbc-b196-bebf54c65697'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:32:29.103850 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-89318b1f-1e87-4e37-811b-83913df8a083" -d '{"events": [{"server_uuid": "bfdfbd26-1bb4-4590-8cdf-732329bfb002", "name": "network-vif-plugged", "status": "completed", "tag": "287d2e38-af6c-4fbc-b196-bebf54c65697"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:32:29.130010 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 287d2e38-af6c-4fbc-b196-bebf54c65697, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=287d2e38-af6c-4fbc-b196-bebf54c65697,segment=NetworkSegment(0c438a9d-68a6-4675-b498-b86f6eed54d4),segment_id=0c438a9d-68a6-4675-b498-b86f6eed54d4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:29.136866 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:29.199528 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-c31ee814-3aaa-4a54-ae01-5ae000d7c42e service neutron] 10.222.0.10 "GET /v2.0/networks/1b5db94a-f2e5-4ee6-b165-fbd41044188e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1991947 Dec 09 21:32:29.245304 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=287d2e38-af6c-4fbc-b196-bebf54c65697,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:29.252768 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:32:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d750d19f-2a10-410d-b1e9-9a367ef9ec9c x-openstack-request-id: req-d750d19f-2a10-410d-b1e9-9a367ef9ec9c {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:32:29.253080 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bfdfbd26-1bb4-4590-8cdf-732329bfb002", "name": "network-vif-plugged", "status": "completed", "tag": "287d2e38-af6c-4fbc-b196-bebf54c65697", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:32:29.253775 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-d750d19f-2a10-410d-b1e9-9a367ef9ec9c {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:32:29.254249 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bfdfbd26-1bb4-4590-8cdf-732329bfb002', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '287d2e38-af6c-4fbc-b196-bebf54c65697', 'code': 200} Dec 09 21:32:29.270748 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09e8e8f6-bf3c-4098-b527-3dea330709b6 req-bf3a2162-cc6a-44e3-931b-d96dc0e3f58e tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:29.279949 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09e8e8f6-bf3c-4098-b527-3dea330709b6 req-bf3a2162-cc6a-44e3-931b-d96dc0e3f58e tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 947 time: 1.0983107 Dec 09 21:32:29.422875 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ae4fa6c-e3e8-461e-b61f-cc113f9552dd req-c0f4f04c-a967-400c-8449-81e86456d13e service neutron] 10.222.0.10 "GET /v2.0/networks/1b5db94a-f2e5-4ee6-b165-fbd41044188e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2116554 Dec 09 21:32:29.453193 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09e8e8f6-bf3c-4098-b527-3dea330709b6 req-dc579edb-0faf-4d66-a2d0-c01ac87af3be tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=df0eeb44-314a-4a29-a8ce-fccee69f8fe4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1715436 Dec 09 21:32:29.513050 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56d7e05c-f624-454e-8d20-ea5e3b84935f req-bfe96a74-a6ed-4a45-b150-351db942fbf5 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:29.518171 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56d7e05c-f624-454e-8d20-ea5e3b84935f req-bfe96a74-a6ed-4a45-b150-351db942fbf5 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 943 time: 0.1800916 Dec 09 21:32:29.543139 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93d9b9b6-2ad0-4720-99cd-10d0cff41a3e req-8d90ec09-05f5-45fb-b386-8413a8e79315 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:29.545750 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-93d9b9b6-2ad0-4720-99cd-10d0cff41a3e req-8d90ec09-05f5-45fb-b386-8413a8e79315 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.31 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 947 time: 0.1218889 Dec 09 21:32:29.554080 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a8ad664-d034-4258-a1d8-47763b101bee req-3dee0a3b-b7ec-4875-b50c-676d81b0d40b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:29.555640 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a8ad664-d034-4258-a1d8-47763b101bee req-3dee0a3b-b7ec-4875-b50c-676d81b0d40b service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 1097 time: 0.1762745 Dec 09 21:32:29.608262 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56d7e05c-f624-454e-8d20-ea5e3b84935f req-6a0216cd-ea00-4597-a8b3-d21e55637a0d tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0889001 Dec 09 21:32:29.677361 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98734a8c-1641-49dc-ae22-fe385d5a7439 req-31eb7f1d-f4ca-4461-afcf-6299639295fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:29.679909 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-98734a8c-1641-49dc-ae22-fe385d5a7439 req-31eb7f1d-f4ca-4461-afcf-6299639295fc service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=6c358c3d1eb04dce9614ffbe3851e040&device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 1095 time: 0.1872196 Dec 09 21:32:29.706834 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a8ad664-d034-4258-a1d8-47763b101bee req-7c66346f-2908-487c-8d95-9ff10748c11e service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1128707 Dec 09 21:32:29.739095 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2680f8ec-2c1e-42df-b65f-4bd92f401417 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:29.835145 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-93d9b9b6-2ad0-4720-99cd-10d0cff41a3e req-d66eae71-3235-4463-9fe7-57ecc8cf721f tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Deleting port 778d35d4-c635-4fcb-b344-64cbb94958b9 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:32:29.836251 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-93d9b9b6-2ad0-4720-99cd-10d0cff41a3e req-d66eae71-3235-4463-9fe7-57ecc8cf721f tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:29.918915 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98734a8c-1641-49dc-ae22-fe385d5a7439 req-885231d2-f6ad-4dea-85fc-804448b83924 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:29.921184 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-98734a8c-1641-49dc-ae22-fe385d5a7439 req-885231d2-f6ad-4dea-85fc-804448b83924 service neutron] 10.222.0.10 "GET /v2.0/networks?id=1b5db94a-f2e5-4ee6-b165-fbd41044188e HTTP/1.1" status: 200 len: 917 time: 0.2216671 Dec 09 21:32:29.978474 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-98734a8c-1641-49dc-ae22-fe385d5a7439 req-2352de3b-add5-4c54-9336-31bc5f7ce5dc service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c71ed6b5-a11d-49bd-b829-084d7dc9af18 HTTP/1.1" status: 200 len: 217 time: 0.0469182 Dec 09 21:32:30.046974 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-93d9b9b6-2ad0-4720-99cd-10d0cff41a3e req-d66eae71-3235-4463-9fe7-57ecc8cf721f tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] For port 778d35d4-c635-4fcb-b344-64cbb94958b9, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=778d35d4-c635-4fcb-b344-64cbb94958b9,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:30.047739 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-93d9b9b6-2ad0-4720-99cd-10d0cff41a3e req-d66eae71-3235-4463-9fe7-57ecc8cf721f tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:30.070077 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98734a8c-1641-49dc-ae22-fe385d5a7439 req-cbff5e20-04ac-40df-8ff5-51414cabb6ac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:30.072489 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-98734a8c-1641-49dc-ae22-fe385d5a7439 req-cbff5e20-04ac-40df-8ff5-51414cabb6ac service neutron] 10.222.0.10 "GET /v2.0/subnets?id=e884864f-1596-4ce2-af55-9b1c3a7758eb HTTP/1.1" status: 200 len: 855 time: 0.0853879 Dec 09 21:32:30.086090 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-2680f8ec-2c1e-42df-b65f-4bd92f401417 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting port 3117fcc7-2bf8-465c-9eb2-4504b594de80 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:32:30.086443 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2680f8ec-2c1e-42df-b65f-4bd92f401417 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:30.202959 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98734a8c-1641-49dc-ae22-fe385d5a7439 req-b82fc780-5157-47db-be34-30841f242515 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:30.204008 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-98734a8c-1641-49dc-ae22-fe385d5a7439 req-b82fc780-5157-47db-be34-30841f242515 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=1b5db94a-f2e5-4ee6-b165-fbd41044188e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1013684 Dec 09 21:32:30.212502 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2680f8ec-2c1e-42df-b65f-4bd92f401417 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:30.250266 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-2680f8ec-2c1e-42df-b65f-4bd92f401417 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Calling delete_port for 3117fcc7-2bf8-465c-9eb2-4504b594de80 owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:32:30.293494 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e265ed07-d705-41c8-a70d-3b1f794ae6a7 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:32:30.340034 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-93d9b9b6-2ad0-4720-99cd-10d0cff41a3e req-d66eae71-3235-4463-9fe7-57ecc8cf721f tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:30.340409 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-93d9b9b6-2ad0-4720-99cd-10d0cff41a3e req-d66eae71-3235-4463-9fe7-57ecc8cf721f tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:30.340737 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [req-93d9b9b6-2ad0-4720-99cd-10d0cff41a3e req-d66eae71-3235-4463-9fe7-57ecc8cf721f tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Floating IP 287dcdd1-9e61-49f6-b207-f9e349bbb1a7 disassociated. External IP: 172.25.3.72, port: 778d35d4-c635-4fcb-b344-64cbb94958b9. Dec 09 21:32:30.341096 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-93d9b9b6-2ad0-4720-99cd-10d0cff41a3e req-d66eae71-3235-4463-9fe7-57ecc8cf721f tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Calling delete_port for 778d35d4-c635-4fcb-b344-64cbb94958b9 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:32:30.406764 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port e265ed07-d705-41c8-a70d-3b1f794ae6a7 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:32:30.411521 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port e265ed07-d705-41c8-a70d-3b1f794ae6a7 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:30.412877 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:30.622438 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-93d9b9b6-2ad0-4720-99cd-10d0cff41a3e req-d66eae71-3235-4463-9fe7-57ecc8cf721f tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:30.660075 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d66eae71-3235-4463-9fe7-57ecc8cf721f tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Pushing event deleted for resources: {'Port': ['ID=778d35d4-c635-4fcb-b344-64cbb94958b9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:30.737063 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e672319-2943-4b82-be71-a904cf463489 req-69c6c885-c77f-4d50-a5c6-02741342844b tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 210 time: 0.1249292 Dec 09 21:32:30.769498 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2680f8ec-2c1e-42df-b65f-4bd92f401417 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:30.777685 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-98734a8c-1641-49dc-ae22-fe385d5a7439 req-7969e9a8-a746-432c-adf5-3bb91f0a2474 service neutron] 10.222.0.10 "GET /v2.0/networks/1b5db94a-f2e5-4ee6-b165-fbd41044188e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5645633 Dec 09 21:32:30.858949 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2680f8ec-2c1e-42df-b65f-4bd92f401417 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Port': ['ID=3117fcc7-2bf8-465c-9eb2-4504b594de80,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:31.116157 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:31.185240 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2680f8ec-2c1e-42df-b65f-4bd92f401417 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:31.228560 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port e265ed07-d705-41c8-a70d-3b1f794ae6a7, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e265ed07-d705-41c8-a70d-3b1f794ae6a7,segment=NetworkSegment(0c438a9d-68a6-4675-b498-b86f6eed54d4),segment_id=0c438a9d-68a6-4675-b498-b86f6eed54d4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:31.229489 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [req-93d9b9b6-2ad0-4720-99cd-10d0cff41a3e req-d66eae71-3235-4463-9fe7-57ecc8cf721f tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Router 8f39d25d-26dd-4bce-b961-53cba1551e5d has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:32:31.233729 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-98734a8c-1641-49dc-ae22-fe385d5a7439 req-a367d3b4-1543-45fc-9287-d8e3e10c182b service neutron] 10.222.0.10 "GET /v2.0/networks/1b5db94a-f2e5-4ee6-b165-fbd41044188e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4437194 Dec 09 21:32:31.250984 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:31.257124 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0572d5ce-eab2-4fdc-9c73-034455c686d3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e265ed07-d705-41c8-a70d-3b1f794ae6a7'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:32:31.260457 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8cdb436f-3bf5-47b2-9fca-49e88be0e9a6" -d '{"events": [{"server_uuid": "0572d5ce-eab2-4fdc-9c73-034455c686d3", "name": "network-vif-plugged", "status": "completed", "tag": "e265ed07-d705-41c8-a70d-3b1f794ae6a7"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:32:31.370362 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:32:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a1294be5-44ed-42a9-b511-a3b97a916d5f x-openstack-request-id: req-a1294be5-44ed-42a9-b511-a3b97a916d5f {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:32:31.371044 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0572d5ce-eab2-4fdc-9c73-034455c686d3", "name": "network-vif-plugged", "status": "completed", "tag": "e265ed07-d705-41c8-a70d-3b1f794ae6a7", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:32:31.371044 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a1294be5-44ed-42a9-b511-a3b97a916d5f {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:32:31.371536 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0572d5ce-eab2-4fdc-9c73-034455c686d3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e265ed07-d705-41c8-a70d-3b1f794ae6a7', 'code': 200} Dec 09 21:32:31.418286 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0075fdd-a74b-4705-8671-67b2b7c2adb2 req-d03949c1-7a9f-4012-a6d8-852fd699f2ac tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:31.419000 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=e265ed07-d705-41c8-a70d-3b1f794ae6a7,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:31.420064 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f0075fdd-a74b-4705-8671-67b2b7c2adb2 req-d03949c1-7a9f-4012-a6d8-852fd699f2ac tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 943 time: 0.4157543 Dec 09 21:32:31.512131 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47454) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:31.535527 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-93d9b9b6-2ad0-4720-99cd-10d0cff41a3e req-d66eae71-3235-4463-9fe7-57ecc8cf721f tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:32:31.550248 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7d2e3e3-fcb7-496f-b621-60d8039a9d1a None None] Sync routers for ids ['8f39d25d-26dd-4bce-b961-53cba1551e5d'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:32:31.571743 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7d2e3e3-fcb7-496f-b621-60d8039a9d1a None None] Routers {'8f39d25d-26dd-4bce-b961-53cba1551e5d'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:32:31.572455 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b7d2e3e3-fcb7-496f-b621-60d8039a9d1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:32:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['8f39d25d-26dd-4bce-b961-53cba1551e5d'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:31.669806 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f0075fdd-a74b-4705-8671-67b2b7c2adb2 req-d3b46daf-d4de-4c37-95c5-94a62ce43cfe tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1584783 Dec 09 21:32:31.771757 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2680f8ec-2c1e-42df-b65f-4bd92f401417 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Router dd81e963-d253-47c9-86cc-d86b4560bd0d has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:32:31.782930 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-038738ee-b74a-4290-a2b1-8d509d42ce34 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:31.815009 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-b7d2e3e3-fcb7-496f-b621-60d8039a9d1a None None] Set router 8f39d25d-26dd-4bce-b961-53cba1551e5d gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:32:31.932237 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-93d9b9b6-2ad0-4720-99cd-10d0cff41a3e req-d66eae71-3235-4463-9fe7-57ecc8cf721f tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] No DVR routers for this DVR port 778d35d4-c635-4fcb-b344-64cbb94958b9 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:32:31.936985 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-93d9b9b6-2ad0-4720-99cd-10d0cff41a3e req-d66eae71-3235-4463-9fe7-57ecc8cf721f tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:31.941645 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-93d9b9b6-2ad0-4720-99cd-10d0cff41a3e req-d66eae71-3235-4463-9fe7-57ecc8cf721f tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.31 "DELETE /v2.0/ports/778d35d4-c635-4fcb-b344-64cbb94958b9 HTTP/1.1" status: 204 len: 173 time: 2.3860688 Dec 09 21:32:31.942214 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '753dc06f-e08a-4cab-82a9-7e1089901f9b', 'name': 'network-vif-deleted', 'tag': '778d35d4-c635-4fcb-b344-64cbb94958b9'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:32:31.944743 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5060a8e1-1a94-4d21-8336-1f448aa9806b" -d '{"events": [{"server_uuid": "753dc06f-e08a-4cab-82a9-7e1089901f9b", "name": "network-vif-deleted", "tag": "778d35d4-c635-4fcb-b344-64cbb94958b9"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:32:31.963679 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53fb597d-231c-4110-be78-3fc579497477 req-1388e659-4d79-4953-a580-04607e068fd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:31.965623 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-53fb597d-231c-4110-be78-3fc579497477 req-1388e659-4d79-4953-a580-04607e068fd3 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=0572d5ce-eab2-4fdc-9c73-034455c686d3 HTTP/1.1" status: 200 len: 1098 time: 0.4388957 Dec 09 21:32:32.025212 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-53fb597d-231c-4110-be78-3fc579497477 req-e15b4442-30d8-4f60-91ec-b61157ea1a63 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0522380 Dec 09 21:32:32.028018 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:32:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0601dd71-c0f1-4a8c-95b3-0260f8329fef x-openstack-request-id: req-0601dd71-c0f1-4a8c-95b3-0260f8329fef {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:32:32.028501 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "753dc06f-e08a-4cab-82a9-7e1089901f9b", "name": "network-vif-deleted", "tag": "778d35d4-c635-4fcb-b344-64cbb94958b9", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:32:32.028922 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0601dd71-c0f1-4a8c-95b3-0260f8329fef {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:32:32.029569 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '753dc06f-e08a-4cab-82a9-7e1089901f9b', 'name': 'network-vif-deleted', 'tag': '778d35d4-c635-4fcb-b344-64cbb94958b9', 'status': 'completed', 'code': 200} Dec 09 21:32:32.213904 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b7d2e3e3-fcb7-496f-b621-60d8039a9d1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'name': 'tempest-AttachVolumeShelveTestJSON-236206179-router', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203'}], 'enable_snat': True}, 'gw_port_id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:14Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'gw_port': {'id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:4c:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1175, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:15Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'a9a5d2ec-b408-4729-99d3-0e4f8f041e60', 'name': '', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'mac_address': 'fa:16:3e:40:0d:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1178, 'fixed_ips': [{'subnet_id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:19Z', 'updated_at': '2021-12-09T21:28:25Z', 'revision_number': 5, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'subnets': [{'id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:32.252232 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7d2e3e3-fcb7-496f-b621-60d8039a9d1a None None] Checking router: 8f39d25d-26dd-4bce-b961-53cba1551e5d for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:32:32.266328 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7d2e3e3-fcb7-496f-b621-60d8039a9d1a None None] Routers {'8f39d25d-26dd-4bce-b961-53cba1551e5d'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:32:32.266979 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b7d2e3e3-fcb7-496f-b621-60d8039a9d1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:32:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['8f39d25d-26dd-4bce-b961-53cba1551e5d'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:32.308504 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device c71ed6b5-a11d-49bd-b829-084d7dc9af18 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:32:32.448280 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-b7d2e3e3-fcb7-496f-b621-60d8039a9d1a None None] Set router 8f39d25d-26dd-4bce-b961-53cba1551e5d gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:32:32.490714 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2680f8ec-2c1e-42df-b65f-4bd92f401417 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:32:32.494322 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4eeca12-2b5c-4d06-85cc-fa6fc4f3e5e9 req-1a0790ca-f451-40d9-9fb2-5ee7276fa5af tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=753dc06f-e08a-4cab-82a9-7e1089901f9b HTTP/1.1" status: 200 len: 210 time: 0.5884719 Dec 09 21:32:32.501198 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2680f8ec-2c1e-42df-b65f-4bd92f401417 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/routers/dd81e963-d253-47c9-86cc-d86b4560bd0d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.7526438 Dec 09 21:32:32.501556 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47472) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:32.566956 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f1a77690-64d7-48b9-810e-875c9d83b4c6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/ports?device_id=dd81e963-d253-47c9-86cc-d86b4560bd0d HTTP/1.1" status: 200 len: 205 time: 0.0630529 Dec 09 21:32:32.574044 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47476) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:32.576965 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-038738ee-b74a-4290-a2b1-8d509d42ce34 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:32.587145 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-038738ee-b74a-4290-a2b1-8d509d42ce34 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:32.645282 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-038738ee-b74a-4290-a2b1-8d509d42ce34 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=36e89e09784044d6ab7bd5858465790c&name=default HTTP/1.1" status: 200 len: 3000 time: 1.1318705 Dec 09 21:32:32.646548 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-038738ee-b74a-4290-a2b1-8d509d42ce34 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e75f75bf-6c15-453e-bc50-dda445178281,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:32.647706 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47478) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:32.679174 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c67d0392-867b-4e14-8303-f2d9d6d3de89 None None] Sync routers for ids ['dd81e963-d253-47c9-86cc-d86b4560bd0d'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:32:32.690440 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c67d0392-867b-4e14-8303-f2d9d6d3de89 None None] Routers {'dd81e963-d253-47c9-86cc-d86b4560bd0d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:32:32.691365 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c67d0392-867b-4e14-8303-f2d9d6d3de89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:32:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['dd81e963-d253-47c9-86cc-d86b4560bd0d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:32.702605 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port c71ed6b5-a11d-49bd-b829-084d7dc9af18, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=c71ed6b5-a11d-49bd-b829-084d7dc9af18,segment=NetworkSegment(0c438a9d-68a6-4675-b498-b86f6eed54d4),segment_id=0c438a9d-68a6-4675-b498-b86f6eed54d4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:32.722165 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a2e62ef2-4527-4001-962a-bc131693ccdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:32.737066 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'c71ed6b5-a11d-49bd-b829-084d7dc9af18', 'network_id': '1b5db94a-f2e5-4ee6-b165-fbd41044188e', 'port_id': 'c71ed6b5-a11d-49bd-b829-084d7dc9af18', 'mac_address': 'fa:16:3e:e0:2a:63', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 137, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e884864f-1596-4ce2-af55-9b1c3a7758eb', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:32:32.757776 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c67d0392-867b-4e14-8303-f2d9d6d3de89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:32.784554 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c67d0392-867b-4e14-8303-f2d9d6d3de89 None None] Routers {'dd81e963-d253-47c9-86cc-d86b4560bd0d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:32:32.786532 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c67d0392-867b-4e14-8303-f2d9d6d3de89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:32:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['dd81e963-d253-47c9-86cc-d86b4560bd0d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:32.833655 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:32.857682 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c71ed6b5-a11d-49bd-b829-084d7dc9af18 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:32:32.888359 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c67d0392-867b-4e14-8303-f2d9d6d3de89 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:32.890480 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c67d0392-867b-4e14-8303-f2d9d6d3de89 None None] The sync data for ids ['dd81e963-d253-47c9-86cc-d86b4560bd0d'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:32:32.908469 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3c22dd8-3f4c-402e-9efd-6d3b652ef0b5 req-5bb73900-b855-425c-8ed7-104472b7c75e tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:32.916868 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3c22dd8-3f4c-402e-9efd-6d3b652ef0b5 req-5bb73900-b855-425c-8ed7-104472b7c75e tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 943 time: 0.1221254 Dec 09 21:32:32.919031 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port c71ed6b5-a11d-49bd-b829-084d7dc9af18, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=c71ed6b5-a11d-49bd-b829-084d7dc9af18,segment=NetworkSegment(0c438a9d-68a6-4675-b498-b86f6eed54d4),segment_id=0c438a9d-68a6-4675-b498-b86f6eed54d4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:32.931631 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:32.971256 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a2e62ef2-4527-4001-962a-bc131693ccdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:32.974900 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a2e62ef2-4527-4001-962a-bc131693ccdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:33.006762 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4ae1fcc2-b4e0-41f7-9fb9-014bc350581e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:33.016373 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b7d2e3e3-fcb7-496f-b621-60d8039a9d1a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'name': 'tempest-AttachVolumeShelveTestJSON-236206179-router', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203'}], 'enable_snat': True}, 'gw_port_id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:14Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'gw_port': {'id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:4c:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1175, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:15Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'a9a5d2ec-b408-4729-99d3-0e4f8f041e60', 'name': '', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'mac_address': 'fa:16:3e:40:0d:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1178, 'fixed_ips': [{'subnet_id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:19Z', 'updated_at': '2021-12-09T21:28:25Z', 'revision_number': 5, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'subnets': [{'id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:33.054656 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3c22dd8-3f4c-402e-9efd-6d3b652ef0b5 req-4a580f5c-ef48-4ae9-8ec1-297dc97d3f60 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1367395 Dec 09 21:32:33.060332 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7d2e3e3-fcb7-496f-b621-60d8039a9d1a None None] The sync data for ids ['8f39d25d-26dd-4bce-b961-53cba1551e5d'] in n-d-713301-27 is: [{'id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'name': 'tempest-AttachVolumeShelveTestJSON-236206179-router', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203'}], 'enable_snat': True}, 'gw_port_id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:14Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'gw_port': {'id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:4c:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1175, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:15Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'a9a5d2ec-b408-4729-99d3-0e4f8f041e60', 'name': '', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'mac_address': 'fa:16:3e:40:0d:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1178, 'fixed_ips': [{'subnet_id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:19Z', 'updated_at': '2021-12-09T21:28:25Z', 'revision_number': 5, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'subnets': [{'id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:32:33.062710 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a2e62ef2-4527-4001-962a-bc131693ccdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:33.063506 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a2e62ef2-4527-4001-962a-bc131693ccdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Fanout notify agent at l3_agent the message router_deleted on router dd81e963-d253-47c9-86cc-d86b4560bd0d {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:32:33.077954 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a2e62ef2-4527-4001-962a-bc131693ccdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:33.079216 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a2e62ef2-4527-4001-962a-bc131693ccdb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/routers/dd81e963-d253-47c9-86cc-d86b4560bd0d HTTP/1.1" status: 204 len: 168 time: 0.5013359 Dec 09 21:32:33.080673 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-21dd2e6c-e263-4496-89dc-d9cbf0a27f9d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:33.083052 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47484) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:33.089386 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=c71ed6b5-a11d-49bd-b829-084d7dc9af18,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:33.133342 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-21dd2e6c-e263-4496-89dc-d9cbf0a27f9d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:33.180186 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-2706feed-702d-4327-9868-a604f5d7c5b8 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting subnet bcc3d9aa-1583-4f90-9c6b-e836366e8f18 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:32:33.190419 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2706feed-702d-4327-9868-a604f5d7c5b8 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:33.219909 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-21dd2e6c-e263-4496-89dc-d9cbf0a27f9d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:33.222921 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-21dd2e6c-e263-4496-89dc-d9cbf0a27f9d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:33.252894 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-21dd2e6c-e263-4496-89dc-d9cbf0a27f9d admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/e75f75bf-6c15-453e-bc50-dda445178281 HTTP/1.1" status: 204 len: 168 time: 0.6026738 Dec 09 21:32:33.276552 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21dd2e6c-e263-4496-89dc-d9cbf0a27f9d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e75f75bf-6c15-453e-bc50-dda445178281,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:33.288760 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['c71ed6b5-a11d-49bd-b829-084d7dc9af18'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:32:33.320603 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2706feed-702d-4327-9868-a604f5d7c5b8 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:33.506981 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2706feed-702d-4327-9868-a604f5d7c5b8 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:33.607378 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc118e5c-5f42-47d1-b391-a78fb3d74750 None None] New status for floating IP 287dcdd1-9e61-49f6-b207-f9e349bbb1a7: DOWN {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:32:33.631823 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2706feed-702d-4327-9868-a604f5d7c5b8 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:33.680518 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2706feed-702d-4327-9868-a604f5d7c5b8 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:33.682828 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47502) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:33.686338 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2706feed-702d-4327-9868-a604f5d7c5b8 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/subnets/bcc3d9aa-1583-4f90-9c6b-e836366e8f18 HTTP/1.1" status: 204 len: 168 time: 0.6011062 Dec 09 21:32:33.710592 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47504) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:33.725981 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2706feed-702d-4327-9868-a604f5d7c5b8 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Subnet': ['ID=bcc3d9aa-1583-4f90-9c6b-e836366e8f18,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:33.750517 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1f0ed4b-242b-4df8-b754-80ad7bde7f7c None None] Network 14895561-e994-4995-86c1-0f7a5692e117 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:32:33.792359 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47506) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:33.841820 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-45d8e72a-e61c-4d57-85f6-38be6c19c649 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:33.844925 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b3149311-f1ab-4a8d-b2f1-dee85aa82c3a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:33.868568 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bc966b7a-8ddf-4be2-8b90-be95721d7410 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:33.953643 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-45d8e72a-e61c-4d57-85f6-38be6c19c649 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting port fb7d16f0-f6eb-4133-b3f1-5e16557b5578 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:32:33.954157 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-45d8e72a-e61c-4d57-85f6-38be6c19c649 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:33.959276 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bc966b7a-8ddf-4be2-8b90-be95721d7410 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:34.121676 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bc966b7a-8ddf-4be2-8b90-be95721d7410 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:34.131715 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bc966b7a-8ddf-4be2-8b90-be95721d7410 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:34.131715 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bc966b7a-8ddf-4be2-8b90-be95721d7410 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "DELETE /v2.0/security-groups/df0eeb44-314a-4a29-a8ce-fccee69f8fe4 HTTP/1.1" status: 204 len: 168 time: 0.4423287 Dec 09 21:32:34.164537 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47512) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:34.165005 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-45d8e72a-e61c-4d57-85f6-38be6c19c649 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] For port fb7d16f0-f6eb-4133-b3f1-5e16557b5578, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=fb7d16f0-f6eb-4133-b3f1-5e16557b5578,segment=NetworkSegment(9055c882-8d23-4d06-ac3a-ba81cbed3435),segment_id=9055c882-8d23-4d06-ac3a-ba81cbed3435)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:34.165005 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-45d8e72a-e61c-4d57-85f6-38be6c19c649 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:34.165518 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b3149311-f1ab-4a8d-b2f1-dee85aa82c3a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:34.165518 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc966b7a-8ddf-4be2-8b90-be95721d7410 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=df0eeb44-314a-4a29-a8ce-fccee69f8fe4,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:34.167759 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1692b25e-b43b-446f-ab1e-156e1fef4fcd None None] DHCP port deletion for 14895561-e994-4995-86c1-0f7a5692e117 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:32:34.184544 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-2272fa6c-bf06-4719-89fc-066d5b28ff34 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] show failed (client error): The resource could not be found. Dec 09 21:32:34.189063 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2272fa6c-bf06-4719-89fc-066d5b28ff34 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups/df0eeb44-314a-4a29-a8ce-fccee69f8fe4 HTTP/1.1" status: 404 len: 347 time: 0.0461295 Dec 09 21:32:34.190741 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-45d8e72a-e61c-4d57-85f6-38be6c19c649 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Calling delete_port for fb7d16f0-f6eb-4133-b3f1-5e16557b5578 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:32:34.192228 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47514) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:34.193748 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b3149311-f1ab-4a8d-b2f1-dee85aa82c3a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:34.261126 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b3149311-f1ab-4a8d-b2f1-dee85aa82c3a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=42e4b137ee69460cb6f1a211fe975e54&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4658570 Dec 09 21:32:34.261126 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3149311-f1ab-4a8d-b2f1-dee85aa82c3a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=25e0d41c-3ed3-4026-b797-d3fb8a7ee68d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:34.271922 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47522) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:34.310199 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-1692b25e-b43b-446f-ab1e-156e1fef4fcd None None] Deleting port fb7d16f0-f6eb-4133-b3f1-5e16557b5578 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:32:34.310825 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1692b25e-b43b-446f-ab1e-156e1fef4fcd None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:34.349204 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-07f0ea43-6485-4148-9838-d1a5be22e5c2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:34.386893 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-07f0ea43-6485-4148-9838-d1a5be22e5c2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:34.389815 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d097b036-f7d5-42ec-bb63-0dfcbb68e89b req-747b506f-62d2-4f46-bd99-d859cab2d710 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:34.391733 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d097b036-f7d5-42ec-bb63-0dfcbb68e89b req-747b506f-62d2-4f46-bd99-d859cab2d710 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 944 time: 0.1537685 Dec 09 21:32:34.445025 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-1692b25e-b43b-446f-ab1e-156e1fef4fcd None None] For port fb7d16f0-f6eb-4133-b3f1-5e16557b5578, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=fb7d16f0-f6eb-4133-b3f1-5e16557b5578,segment=NetworkSegment(9055c882-8d23-4d06-ac3a-ba81cbed3435),segment_id=9055c882-8d23-4d06-ac3a-ba81cbed3435)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:34.445769 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1692b25e-b43b-446f-ab1e-156e1fef4fcd None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:34.454140 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-07f0ea43-6485-4148-9838-d1a5be22e5c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:34.458322 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-07f0ea43-6485-4148-9838-d1a5be22e5c2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:34.462410 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-07f0ea43-6485-4148-9838-d1a5be22e5c2 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/25e0d41c-3ed3-4026-b797-d3fb8a7ee68d HTTP/1.1" status: 204 len: 168 time: 0.1808703 Dec 09 21:32:34.465491 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-1692b25e-b43b-446f-ab1e-156e1fef4fcd None None] Calling delete_port for fb7d16f0-f6eb-4133-b3f1-5e16557b5578 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:32:34.482200 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07f0ea43-6485-4148-9838-d1a5be22e5c2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=25e0d41c-3ed3-4026-b797-d3fb8a7ee68d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:34.526356 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d097b036-f7d5-42ec-bb63-0dfcbb68e89b req-42e50878-1d51-45ff-9991-1083b8e8bb34 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1048458 Dec 09 21:32:34.540687 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-8fbdbd71-7b90-4d1f-bfc5-50e0948b9560 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Deleting port 3b4701e3-b6e8-4be9-a35a-74fb297acc7d {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:32:34.541011 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fbdbd71-7b90-4d1f-bfc5-50e0948b9560 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:34.606453 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-45d8e72a-e61c-4d57-85f6-38be6c19c649 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:34.640068 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1692b25e-b43b-446f-ab1e-156e1fef4fcd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:34.667294 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45d8e72a-e61c-4d57-85f6-38be6c19c649 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Port': ['ID=fb7d16f0-f6eb-4133-b3f1-5e16557b5578,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:34.676537 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1692b25e-b43b-446f-ab1e-156e1fef4fcd None None] No DVR routers for this DVR port fb7d16f0-f6eb-4133-b3f1-5e16557b5578 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:32:34.677508 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45d8e72a-e61c-4d57-85f6-38be6c19c649 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] No DVR routers for this DVR port fb7d16f0-f6eb-4133-b3f1-5e16557b5578 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:32:34.684231 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1692b25e-b43b-446f-ab1e-156e1fef4fcd None None] Pushing event deleted for resources: {'Port': ['ID=fb7d16f0-f6eb-4133-b3f1-5e16557b5578,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:34.729377 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 778d35d4-c635-4fcb-b344-64cbb94958b9 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:32:34.736746 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fbdbd71-7b90-4d1f-bfc5-50e0948b9560 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:34.737080 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fbdbd71-7b90-4d1f-bfc5-50e0948b9560 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:34.768194 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-8fbdbd71-7b90-4d1f-bfc5-50e0948b9560 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Calling delete_port for 3b4701e3-b6e8-4be9-a35a-74fb297acc7d owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:32:34.781637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 778d35d4-c635-4fcb-b344-64cbb94958b9 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:32:34.784325 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 778d35d4-c635-4fcb-b344-64cbb94958b9 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:32:34.810231 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-45d8e72a-e61c-4d57-85f6-38be6c19c649 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:34.871109 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-45d8e72a-e61c-4d57-85f6-38be6c19c649 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['14895561-e994-4995-86c1-0f7a5692e117']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:34.886175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-45d8e72a-e61c-4d57-85f6-38be6c19c649 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9055c882-8d23-4d06-ac3a-ba81cbed3435') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:34.886794 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-45d8e72a-e61c-4d57-85f6-38be6c19c649 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9055c882-8d23-4d06-ac3a-ba81cbed3435') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:34.901607 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-45d8e72a-e61c-4d57-85f6-38be6c19c649 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:34.940922 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-45d8e72a-e61c-4d57-85f6-38be6c19c649 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:34.959237 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-45d8e72a-e61c-4d57-85f6-38be6c19c649 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Releasing vlan 149 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:32:34.959998 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-45d8e72a-e61c-4d57-85f6-38be6c19c649 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:32:34.962889 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:32:35.068636 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-45d8e72a-e61c-4d57-85f6-38be6c19c649 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:35.081315 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-45d8e72a-e61c-4d57-85f6-38be6c19c649 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:35.084677 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-45d8e72a-e61c-4d57-85f6-38be6c19c649 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/networks/14895561-e994-4995-86c1-0f7a5692e117 HTTP/1.1" status: 204 len: 168 time: 1.3730521 Dec 09 21:32:35.088816 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47540) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:35.093618 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-680014a0-2bb4-48b8-8f0b-a4c87cf517e2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-993672359', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}, 'admin_state_up': False}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:35.121434 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45d8e72a-e61c-4d57-85f6-38be6c19c649 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Network': ['ID=14895561-e994-4995-86c1-0f7a5692e117,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:35.132797 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-680014a0-2bb4-48b8-8f0b-a4c87cf517e2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:35.135067 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-680014a0-2bb4-48b8-8f0b-a4c87cf517e2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:35.142547 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fbdbd71-7b90-4d1f-bfc5-50e0948b9560 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:35.180127 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fbdbd71-7b90-4d1f-bfc5-50e0948b9560 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Pushing event deleted for resources: {'Port': ['ID=3b4701e3-b6e8-4be9-a35a-74fb297acc7d,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:35.201566 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f1d5822-b0c1-4ad9-befa-2db190f9c5e1 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:32:35.222021 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-680014a0-2bb4-48b8-8f0b-a4c87cf517e2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:35.321942 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fbdbd71-7b90-4d1f-bfc5-50e0948b9560 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:35.324836 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fbdbd71-7b90-4d1f-bfc5-50e0948b9560 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:35.326032 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8fbdbd71-7b90-4d1f-bfc5-50e0948b9560 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "DELETE /v2.0/floatingips/287dcdd1-9e61-49f6-b207-f9e349bbb1a7 HTTP/1.1" status: 204 len: 168 time: 1.1326122 Dec 09 21:32:35.435182 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device fb7d16f0-f6eb-4133-b3f1-5e16557b5578 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:32:35.469292 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: fb7d16f0-f6eb-4133-b3f1-5e16557b5578 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:32:35.469937 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device fb7d16f0-f6eb-4133-b3f1-5e16557b5578 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:32:35.509429 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-680014a0-2bb4-48b8-8f0b-a4c87cf517e2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:35.574681 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6b2c9fc8-fa61-4d50-a508-582a9cc366e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:35.817208 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47576) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:35.829931 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-dfc629f7-8c7d-4182-82b6-4040e09d31e0 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Request body: {'security_group': {'name': 'tempest-securitygroup--202891315', 'description': 'tempest-description--329804497'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:35.846247 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56d1b79b-421f-4020-8e76-bf747a0711d8 req-3439d605-5338-4537-9815-d18ba256e50e tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:35.855382 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56d1b79b-421f-4020-8e76-bf747a0711d8 req-3439d605-5338-4537-9815-d18ba256e50e tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 944 time: 0.1184998 Dec 09 21:32:35.918772 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dfc629f7-8c7d-4182-82b6-4040e09d31e0 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:35.920464 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-680014a0-2bb4-48b8-8f0b-a4c87cf517e2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:35.940638 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56d1b79b-421f-4020-8e76-bf747a0711d8 req-dfad1526-29ec-4954-90bd-8a81eae9180d tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0821674 Dec 09 21:32:35.940902 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-680014a0-2bb4-48b8-8f0b-a4c87cf517e2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:36.002721 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dfc629f7-8c7d-4182-82b6-4040e09d31e0 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:36.009118 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dfc629f7-8c7d-4182-82b6-4040e09d31e0 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:36.042409 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dfc629f7-8c7d-4182-82b6-4040e09d31e0 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:36.043697 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-dfc629f7-8c7d-4182-82b6-4040e09d31e0 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.2236829 Dec 09 21:32:36.048527 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfc629f7-8c7d-4182-82b6-4040e09d31e0 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Pushing event updated for resources: {'SecurityGroup': ['ID=60d89c09-154d-4fe2-b016-511afe2ed923,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:36.051142 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47584) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:36.056326 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-1037e330-2fc0-4b44-a4b8-b6b4fe8168a4 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Request body: {'security_group_rule': {'security_group_id': '60d89c09-154d-4fe2-b016-511afe2ed923', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:36.085784 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-680014a0-2bb4-48b8-8f0b-a4c87cf517e2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Allocated IP 172.25.3.254 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/03be7430-ce77-44f0-a700-99fdc4134fc3) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:32:36.124682 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1037e330-2fc0-4b44-a4b8-b6b4fe8168a4 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:36.240583 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1037e330-2fc0-4b44-a4b8-b6b4fe8168a4 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:36.253639 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-680014a0-2bb4-48b8-8f0b-a4c87cf517e2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:36.255195 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1037e330-2fc0-4b44-a4b8-b6b4fe8168a4 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:36.280337 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1037e330-2fc0-4b44-a4b8-b6b4fe8168a4 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=49d3202b-5b4f-4251-96a8-8680a6e29c50,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:36.301731 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1037e330-2fc0-4b44-a4b8-b6b4fe8168a4 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:36.305473 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1037e330-2fc0-4b44-a4b8-b6b4fe8168a4 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2506506 Dec 09 21:32:36.305831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47602) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:36.312191 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-9bfae5b0-60be-4302-be17-e45d7d310684 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Request body: {'security_group_rule': {'security_group_id': '60d89c09-154d-4fe2-b016-511afe2ed923', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:36.317075 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-680014a0-2bb4-48b8-8f0b-a4c87cf517e2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:36.340063 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device c71ed6b5-a11d-49bd-b829-084d7dc9af18 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:32:36.358927 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-680014a0-2bb4-48b8-8f0b-a4c87cf517e2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:32:36.363650 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-680014a0-2bb4-48b8-8f0b-a4c87cf517e2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:32:36.366130 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-680014a0-2bb4-48b8-8f0b-a4c87cf517e2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:32:36.381126 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9bfae5b0-60be-4302-be17-e45d7d310684 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:36.404007 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-680014a0-2bb4-48b8-8f0b-a4c87cf517e2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Port': ['ID=03be7430-ce77-44f0-a700-99fdc4134fc3,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:36.406810 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ceaba78c-26ea-4ddc-9513-46200ffc6e50 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:32:36.472869 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f081d627-ce11-43f9-8f8c-6739718dd6bc None None] Provisioning complete for port 03be7430-ce77-44f0-a700-99fdc4134fc3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:36.473545 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f081d627-ce11-43f9-8f8c-6739718dd6bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:36.499241 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port c71ed6b5-a11d-49bd-b829-084d7dc9af18 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:32:36.505108 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port c71ed6b5-a11d-49bd-b829-084d7dc9af18 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:36.505748 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:36.516227 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9bfae5b0-60be-4302-be17-e45d7d310684 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:36.523326 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9bfae5b0-60be-4302-be17-e45d7d310684 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:36.551021 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f081d627-ce11-43f9-8f8c-6739718dd6bc None None] Port 03be7430-ce77-44f0-a700-99fdc4134fc3 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:32:36.584713 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bfae5b0-60be-4302-be17-e45d7d310684 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b27cf80d-fde5-4a48-be0c-99726ba1e536,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:36.604051 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9bfae5b0-60be-4302-be17-e45d7d310684 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:36.610493 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9bfae5b0-60be-4302-be17-e45d7d310684 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3033931 Dec 09 21:32:36.611528 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47620) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:36.613717 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:36.617406 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-43b6ddb2-9fe6-4d05-ac01-5d7b17dfa399 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:36.629299 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:36.677924 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port c71ed6b5-a11d-49bd-b829-084d7dc9af18, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=c71ed6b5-a11d-49bd-b829-084d7dc9af18,segment=NetworkSegment(0c438a9d-68a6-4675-b498-b86f6eed54d4),segment_id=0c438a9d-68a6-4675-b498-b86f6eed54d4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:36.679311 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9876e214-d2ce-42d5-9d51-0df26fa0939b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c71ed6b5-a11d-49bd-b829-084d7dc9af18'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:32:36.681824 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9c4ca029-535a-4bf0-beb9-a86af7079e02" -d '{"events": [{"server_uuid": "9876e214-d2ce-42d5-9d51-0df26fa0939b", "name": "network-vif-plugged", "status": "completed", "tag": "c71ed6b5-a11d-49bd-b829-084d7dc9af18"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:32:36.684063 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-43b6ddb2-9fe6-4d05-ac01-5d7b17dfa399 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:36.687742 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:36.709582 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17c1ebd9-8af2-41c9-b47c-1973af5f7396 req-50c44521-c8ce-477d-a5e9-0a244126a8eb tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:36.711682 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-17c1ebd9-8af2-41c9-b47c-1973af5f7396 req-50c44521-c8ce-477d-a5e9-0a244126a8eb tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 947 time: 0.0884743 Dec 09 21:32:36.788564 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:32:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8bb90de9-ecb2-4c53-a9d9-a723bc8bacc8 x-openstack-request-id: req-8bb90de9-ecb2-4c53-a9d9-a723bc8bacc8 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:32:36.789101 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9876e214-d2ce-42d5-9d51-0df26fa0939b", "name": "network-vif-plugged", "status": "completed", "tag": "c71ed6b5-a11d-49bd-b829-084d7dc9af18", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:32:36.790945 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8bb90de9-ecb2-4c53-a9d9-a723bc8bacc8 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:32:36.791697 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9876e214-d2ce-42d5-9d51-0df26fa0939b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c71ed6b5-a11d-49bd-b829-084d7dc9af18', 'code': 200} Dec 09 21:32:36.797795 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=c71ed6b5-a11d-49bd-b829-084d7dc9af18,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:36.852380 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-17c1ebd9-8af2-41c9-b47c-1973af5f7396 req-2a118155-2053-4a46-83b7-93ae37ff85b1 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1320305 Dec 09 21:32:36.904824 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-43b6ddb2-9fe6-4d05-ac01-5d7b17dfa399 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:36.910440 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-680014a0-2bb4-48b8-8f0b-a4c87cf517e2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:36.962242 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-409e8aac-e9b7-451e-84bc-1eb959e103a6 req-3020c353-e969-4fbf-a3d5-f4cc627606e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:36.964196 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-409e8aac-e9b7-451e-84bc-1eb959e103a6 req-3020c353-e969-4fbf-a3d5-f4cc627606e6 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 1097 time: 0.1054223 Dec 09 21:32:37.069647 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-409e8aac-e9b7-451e-84bc-1eb959e103a6 req-845ae61a-f451-43a2-8508-35f5d0438971 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0987327 Dec 09 21:32:37.085521 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-43b6ddb2-9fe6-4d05-ac01-5d7b17dfa399 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Allocated IP 172.25.3.162 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/e6cda36f-6dd0-48a9-8759-4b3ebbb1847f) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:32:37.207379 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-680014a0-2bb4-48b8-8f0b-a4c87cf517e2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:37.233274 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1401d81a-d2f8-495d-8564-ae5eb44d4a97 req-e5c54c46-993a-46b7-8a98-a807e280b6c3 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:37.235059 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1401d81a-d2f8-495d-8564-ae5eb44d4a97 req-e5c54c46-993a-46b7-8a98-a807e280b6c3 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 945 time: 0.1375189 Dec 09 21:32:37.308721 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-43b6ddb2-9fe6-4d05-ac01-5d7b17dfa399 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:37.318645 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1401d81a-d2f8-495d-8564-ae5eb44d4a97 req-5f177f05-58e1-4380-81de-74778da05254 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0771453 Dec 09 21:32:37.363747 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-43b6ddb2-9fe6-4d05-ac01-5d7b17dfa399 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:37.392211 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-680014a0-2bb4-48b8-8f0b-a4c87cf517e2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Router 89842949-8384-4cb2-b3b9-a7b02f88760c is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:32:37.449561 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-43b6ddb2-9fe6-4d05-ac01-5d7b17dfa399 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:32:37.458223 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-43b6ddb2-9fe6-4d05-ac01-5d7b17dfa399 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:32:37.465321 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43b6ddb2-9fe6-4d05-ac01-5d7b17dfa399 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:32:37.488684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43b6ddb2-9fe6-4d05-ac01-5d7b17dfa399 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Pushing event updated for resources: {'Port': ['ID=e6cda36f-6dd0-48a9-8759-4b3ebbb1847f,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:37.513515 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b7cff66-d618-40a4-bf71-8e6115360525 req-5dc1e7a2-63b3-4795-8052-667ad881a824 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:37.515469 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4b7cff66-d618-40a4-bf71-8e6115360525 req-5dc1e7a2-63b3-4795-8052-667ad881a824 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 947 time: 0.1174307 Dec 09 21:32:37.522033 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-680014a0-2bb4-48b8-8f0b-a4c87cf517e2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:32:37.546418 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-788b70d3-1b90-42ff-9e84-68247b3b5884 None None] Sync routers for ids ['89842949-8384-4cb2-b3b9-a7b02f88760c'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:32:37.556325 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-788b70d3-1b90-42ff-9e84-68247b3b5884 None None] Routers {'89842949-8384-4cb2-b3b9-a7b02f88760c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:32:37.556942 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-788b70d3-1b90-42ff-9e84-68247b3b5884 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:32:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['89842949-8384-4cb2-b3b9-a7b02f88760c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:37.558839 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-680014a0-2bb4-48b8-8f0b-a4c87cf517e2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:37.565210 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-680014a0-2bb4-48b8-8f0b-a4c87cf517e2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 883 time: 2.4752645 Dec 09 21:32:37.565931 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47684) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:37.595784 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-788b70d3-1b90-42ff-9e84-68247b3b5884 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:37.605164 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-788b70d3-1b90-42ff-9e84-68247b3b5884 None None] Routers {'89842949-8384-4cb2-b3b9-a7b02f88760c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:32:37.605785 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-788b70d3-1b90-42ff-9e84-68247b3b5884 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:32:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['89842949-8384-4cb2-b3b9-a7b02f88760c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:37.642578 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-788b70d3-1b90-42ff-9e84-68247b3b5884 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:37.643251 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-788b70d3-1b90-42ff-9e84-68247b3b5884 None None] The sync data for ids ['89842949-8384-4cb2-b3b9-a7b02f88760c'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:32:37.646855 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47686) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:37.652223 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4b7cff66-d618-40a4-bf71-8e6115360525 req-358e2bf8-5145-426c-9659-20a0f3854b81 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1260769 Dec 09 21:32:37.667793 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-43b6ddb2-9fe6-4d05-ac01-5d7b17dfa399 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:37.722930 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-43b6ddb2-9fe6-4d05-ac01-5d7b17dfa399 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:37.732473 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6249a5bd-1bae-49cc-a973-efe15702468e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/routers/89842949-8384-4cb2-b3b9-a7b02f88760c HTTP/1.1" status: 200 len: 884 time: 0.1637139 Dec 09 21:32:37.734895 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47690) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:37.827683 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0f534b43-72c9-4104-bd27-fbf469ff9fc9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:37.893062 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-43b6ddb2-9fe6-4d05-ac01-5d7b17dfa399 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:37.899531 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-43b6ddb2-9fe6-4d05-ac01-5d7b17dfa399 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:37.914522 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:37.976117 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43b6ddb2-9fe6-4d05-ac01-5d7b17dfa399 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Pushing event updated for resources: {'Port': ['ID=e6cda36f-6dd0-48a9-8759-4b3ebbb1847f,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:37.992318 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-43b6ddb2-9fe6-4d05-ac01-5d7b17dfa399 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:38.011720 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-43b6ddb2-9fe6-4d05-ac01-5d7b17dfa399 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:38.013205 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-43b6ddb2-9fe6-4d05-ac01-5d7b17dfa399 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.4004302 Dec 09 21:32:38.258295 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-dc0ddfae-a386-491b-969f-a204a2eb0d0e tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-securitygroup--202891315&fields=id&tenant_id=29f2c1d9be9348b0888bc61ed37ed957 HTTP/1.1" status: 200 len: 267 time: 0.0447567 Dec 09 21:32:38.301597 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0f534b43-72c9-4104-bd27-fbf469ff9fc9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:38.312844 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0f534b43-72c9-4104-bd27-fbf469ff9fc9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:38.368237 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-63c95e0d-177a-4ead-bab0-50c19a80dd7c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 887 time: 0.6316206 Dec 09 21:32:38.370996 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0f534b43-72c9-4104-bd27-fbf469ff9fc9 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=16e249d82bf542d59fe8af38032ec036&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7231555 Dec 09 21:32:38.371690 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47714) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:38.372321 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f534b43-72c9-4104-bd27-fbf469ff9fc9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=62f8be7e-ef0f-490b-a22c-8265518a0865,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:38.376050 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47716) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:38.379572 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-60eddc77-ec20-45dd-ad14-360fe05bf0e3 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'router': {'name': 'updatedtempest-RoutersIpV6Test-router-993672359'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:38.387047 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-00ae9cc7-a750-46c6-8900-34b4e8aae027 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:38.388491 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-00ae9cc7-a750-46c6-8900-34b4e8aae027 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/networks?id=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 HTTP/1.1" status: 200 len: 816 time: 0.1223865 Dec 09 21:32:38.406382 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-6859de02-b299-47af-a304-389c4ece0dcd tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/quotas/29f2c1d9be9348b0888bc61ed37ed957 HTTP/1.1" status: 200 len: 375 time: 0.0112767 Dec 09 21:32:38.482729 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cb9b028-9444-48d1-ac94-5b4db48235a9 req-f654e278-3fc1-4bb3-96af-84ccc84831f9 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:38.484273 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7cb9b028-9444-48d1-ac94-5b4db48235a9 req-f654e278-3fc1-4bb3-96af-84ccc84831f9 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 945 time: 0.0769188 Dec 09 21:32:38.495317 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-795e080d-bd51-405d-9c53-dcde8df0cca1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=29f2c1d9be9348b0888bc61ed37ed957&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0790932 Dec 09 21:32:38.514638 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a1290aa-aac5-4c74-a1f2-c5be3d548e90 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:38.575722 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a1290aa-aac5-4c74-a1f2-c5be3d548e90 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:38.594948 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7cb9b028-9444-48d1-ac94-5b4db48235a9 req-3dd3dbf3-13f3-45f7-bc74-9be73c37aa61 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0985687 Dec 09 21:32:38.626502 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-846591df-43d8-4ea6-be54-bd67d56f29f6 service neutron] 10.222.0.13 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1164153 Dec 09 21:32:38.704682 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a1290aa-aac5-4c74-a1f2-c5be3d548e90 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:38.707512 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a1290aa-aac5-4c74-a1f2-c5be3d548e90 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:38.708676 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5a1290aa-aac5-4c74-a1f2-c5be3d548e90 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/62f8be7e-ef0f-490b-a22c-8265518a0865 HTTP/1.1" status: 204 len: 168 time: 0.3266637 Dec 09 21:32:38.723344 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a1290aa-aac5-4c74-a1f2-c5be3d548e90 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=62f8be7e-ef0f-490b-a22c-8265518a0865,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:38.776158 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-5b26721f-6d63-4751-9b8a-f9cb760ea05d service neutron] 10.222.0.13 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1429579 Dec 09 21:32:38.814049 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-60eddc77-ec20-45dd-ad14-360fe05bf0e3 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:38.835629 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-60eddc77-ec20-45dd-ad14-360fe05bf0e3 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-640457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-640448', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-635166'] for router, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:38.843275 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-398d18aa-fdba-49eb-9305-ef66a4399872 req-4d43b3d4-cbe9-471d-9ac8-f489372eebab tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:38.851464 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-398d18aa-fdba-49eb-9305-ef66a4399872 req-4d43b3d4-cbe9-471d-9ac8-f489372eebab tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.0651832 Dec 09 21:32:38.908441 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-398d18aa-fdba-49eb-9305-ef66a4399872 req-e36ce4c3-e0d7-4330-8034-14b47f0c80a1 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0559478 Dec 09 21:32:38.977531 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-60eddc77-ec20-45dd-ad14-360fe05bf0e3 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Router 89842949-8384-4cb2-b3b9-a7b02f88760c has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:32:39.080598 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:32:39.082100 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9abc20e-49de-4b39-ad29-4b7dba26008b req-4e399341-e1fa-4f56-932a-38e7a5d0d47b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:39.083717 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9abc20e-49de-4b39-ad29-4b7dba26008b req-4e399341-e1fa-4f56-932a-38e7a5d0d47b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 947 time: 0.0760417 Dec 09 21:32:39.112823 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a88dc9c-391a-492d-8522-82a7c5438d4c req-0e382176-e669-48ad-a7c3-647e80a3c9ae tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 210 time: 0.0280669 Dec 09 21:32:39.154853 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47742) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:39.174598 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c965c516-13de-4544-b7d8-4787de8e9718 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:39.179618 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-60eddc77-ec20-45dd-ad14-360fe05bf0e3 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:32:39.190612 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-122e4723-fe3a-4fc2-9fd6-f5c35a51ec4d None None] Sync routers for ids ['89842949-8384-4cb2-b3b9-a7b02f88760c'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:32:39.196594 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9abc20e-49de-4b39-ad29-4b7dba26008b req-f3fbd136-30a3-4d70-bdb3-9b7ee609553b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0821323 Dec 09 21:32:39.202291 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-60eddc77-ec20-45dd-ad14-360fe05bf0e3 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:39.205926 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-60eddc77-ec20-45dd-ad14-360fe05bf0e3 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/routers/89842949-8384-4cb2-b3b9-a7b02f88760c HTTP/1.1" status: 200 len: 891 time: 0.8282783 Dec 09 21:32:39.207177 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47744) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:39.219962 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-122e4723-fe3a-4fc2-9fd6-f5c35a51ec4d None None] Routers {'89842949-8384-4cb2-b3b9-a7b02f88760c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:32:39.220850 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-122e4723-fe3a-4fc2-9fd6-f5c35a51ec4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:32:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['89842949-8384-4cb2-b3b9-a7b02f88760c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:39.260704 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f36f44ad-ba0c-4d98-b97a-59e1c03e5368 req-742974cf-ce97-42ad-80cb-ec9be0f78d0c tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:39.262313 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f36f44ad-ba0c-4d98-b97a-59e1c03e5368 req-742974cf-ce97-42ad-80cb-ec9be0f78d0c tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=0572d5ce-eab2-4fdc-9c73-034455c686d3 HTTP/1.1" status: 200 len: 946 time: 0.0643041 Dec 09 21:32:39.346855 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f36f44ad-ba0c-4d98-b97a-59e1c03e5368 req-a61a6cb1-af92-4085-9975-e946dc9222e7 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0766742 Dec 09 21:32:39.434361 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c965c516-13de-4544-b7d8-4787de8e9718 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:39.440666 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2d8f16af-4d1e-4b78-aa90-0d3d153413bf tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/routers/89842949-8384-4cb2-b3b9-a7b02f88760c HTTP/1.1" status: 200 len: 891 time: 0.2323675 Dec 09 21:32:39.443783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47752) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:39.443935 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c965c516-13de-4544-b7d8-4787de8e9718 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:39.489667 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47754) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:39.491114 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-876396ab-e684-407d-b0fe-f0d29bf11ea2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/ports?device_id=89842949-8384-4cb2-b3b9-a7b02f88760c HTTP/1.1" status: 200 len: 205 time: 0.0454884 Dec 09 21:32:39.521492 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-122e4723-fe3a-4fc2-9fd6-f5c35a51ec4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:39.532553 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-122e4723-fe3a-4fc2-9fd6-f5c35a51ec4d None None] Routers {'89842949-8384-4cb2-b3b9-a7b02f88760c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:32:39.533376 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-122e4723-fe3a-4fc2-9fd6-f5c35a51ec4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:32:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['89842949-8384-4cb2-b3b9-a7b02f88760c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:39.554791 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c965c516-13de-4544-b7d8-4787de8e9718 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4bf41595-d9cc-4d15-bbe6-68b469d438bf,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:39.572643 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-122e4723-fe3a-4fc2-9fd6-f5c35a51ec4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:39.573859 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-122e4723-fe3a-4fc2-9fd6-f5c35a51ec4d None None] The sync data for ids ['89842949-8384-4cb2-b3b9-a7b02f88760c'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:32:39.584431 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c965c516-13de-4544-b7d8-4787de8e9718 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=fda1a559e79e421c95c7f1461116240d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4262810 Dec 09 21:32:39.585927 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47756) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:39.646072 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:39.691381 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5be43268-39a1-4552-bd70-d9e9d1081b09 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:39.703508 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a8ee8e7-e70a-4f9e-aa6b-8d493d58b1f6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:39.747637 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a8ee8e7-e70a-4f9e-aa6b-8d493d58b1f6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:39.848658 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5be43268-39a1-4552-bd70-d9e9d1081b09 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:39.901782 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c8c690b-de16-4d74-9505-4a0bdbc9945d req-ba915206-280d-40b1-9a69-d3364ed9c009 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:39.903742 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c8c690b-de16-4d74-9505-4a0bdbc9945d req-ba915206-280d-40b1-9a69-d3364ed9c009 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 945 time: 0.1539967 Dec 09 21:32:39.927603 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-5be43268-39a1-4552-bd70-d9e9d1081b09 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting port 03be7430-ce77-44f0-a700-99fdc4134fc3 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:32:39.928240 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5be43268-39a1-4552-bd70-d9e9d1081b09 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:39.945346 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a8ee8e7-e70a-4f9e-aa6b-8d493d58b1f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:39.948497 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a8ee8e7-e70a-4f9e-aa6b-8d493d58b1f6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:39.952602 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8a8ee8e7-e70a-4f9e-aa6b-8d493d58b1f6 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/4bf41595-d9cc-4d15-bbe6-68b469d438bf HTTP/1.1" status: 204 len: 168 time: 0.3655570 Dec 09 21:32:39.971512 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a8ee8e7-e70a-4f9e-aa6b-8d493d58b1f6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4bf41595-d9cc-4d15-bbe6-68b469d438bf,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:39.976996 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c8c690b-de16-4d74-9505-4a0bdbc9945d req-89ef1ac2-0c94-4d88-acc7-c7385673f602 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0660651 Dec 09 21:32:40.033305 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5be43268-39a1-4552-bd70-d9e9d1081b09 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:40.048428 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-5be43268-39a1-4552-bd70-d9e9d1081b09 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Calling delete_port for 03be7430-ce77-44f0-a700-99fdc4134fc3 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:32:40.271415 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8cdfb46b-af03-4685-8102-0fc06004bbc8 req-cb565153-8287-49c8-94d6-392e1f338a9b tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 210 time: 0.0476677 Dec 09 21:32:40.331012 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5be43268-39a1-4552-bd70-d9e9d1081b09 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:40.372470 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae6810d-a6d9-49d2-9470-661238c136d0 req-fb570378-d80b-4fb7-b3c1-7bb1b419768e tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:40.373514 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5290f220-ceee-455d-b0c4-c92f5cd3b1a1 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:32:40.379740 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fae6810d-a6d9-49d2-9470-661238c136d0 req-fb570378-d80b-4fb7-b3c1-7bb1b419768e tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.0761378 Dec 09 21:32:40.397363 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5be43268-39a1-4552-bd70-d9e9d1081b09 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Port': ['ID=03be7430-ce77-44f0-a700-99fdc4134fc3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:40.463066 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fae6810d-a6d9-49d2-9470-661238c136d0 req-95c05d94-2ba7-4c7d-aecf-ac84e2a836a9 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0704932 Dec 09 21:32:40.539904 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9770ac3f-d70f-4ec2-a77b-68116d3b451a req-22d57a14-1147-41f4-8d2d-dacf97be514c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:40.562214 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9770ac3f-d70f-4ec2-a77b-68116d3b451a req-22d57a14-1147-41f4-8d2d-dacf97be514c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 947 time: 0.1218755 Dec 09 21:32:40.614613 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-42ce62ac-7684-459f-affe-4a66ef950d4d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:40.616873 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-42ce62ac-7684-459f-affe-4a66ef950d4d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.31 "GET /v2.0/networks?id=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 HTTP/1.1" status: 200 len: 816 time: 0.2239952 Dec 09 21:32:40.632790 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5be43268-39a1-4552-bd70-d9e9d1081b09 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:40.696364 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9770ac3f-d70f-4ec2-a77b-68116d3b451a req-53a280b4-a9e4-4b00-b4e3-3ee3ff7f3411 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1328449 Dec 09 21:32:40.776038 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 90f16e74-f2e6-416e-a079-f205615a0d8e details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:32:40.812343 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5be43268-39a1-4552-bd70-d9e9d1081b09 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:40.817799 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5be43268-39a1-4552-bd70-d9e9d1081b09 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:40.934453 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 90f16e74-f2e6-416e-a079-f205615a0d8e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=90f16e74-f2e6-416e-a079-f205615a0d8e,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:40.958374 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5836397a-4c37-4075-b561-dc6eef1de203 req-ecca7180-195e-4a9f-8067-82be97307dc8 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:40.959893 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '90f16e74-f2e6-416e-a079-f205615a0d8e', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'port_id': '90f16e74-f2e6-416e-a079-f205615a0d8e', 'mac_address': 'fa:16:3e:69:c9:b5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:32:40.967298 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5836397a-4c37-4075-b561-dc6eef1de203 req-ecca7180-195e-4a9f-8067-82be97307dc8 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:40.975805 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5836397a-4c37-4075-b561-dc6eef1de203 req-ecca7180-195e-4a9f-8067-82be97307dc8 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:40.978134 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5836397a-4c37-4075-b561-dc6eef1de203 req-ecca7180-195e-4a9f-8067-82be97307dc8 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b&device_id=0572d5ce-eab2-4fdc-9c73-034455c686d3&device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 2417 time: 0.1844559 Dec 09 21:32:40.979905 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 90f16e74-f2e6-416e-a079-f205615a0d8e no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:32:40.995645 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5be43268-39a1-4552-bd70-d9e9d1081b09 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:40.997417 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5be43268-39a1-4552-bd70-d9e9d1081b09 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Fanout notify agent at l3_agent the message router_deleted on router 89842949-8384-4cb2-b3b9-a7b02f88760c {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:32:41.026795 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5be43268-39a1-4552-bd70-d9e9d1081b09 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:41.032327 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5be43268-39a1-4552-bd70-d9e9d1081b09 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/routers/89842949-8384-4cb2-b3b9-a7b02f88760c HTTP/1.1" status: 204 len: 168 time: 1.5412648 Dec 09 21:32:41.037899 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47802) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:41.079962 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-3c14db65-5172-43c2-acf5-e81e3b91187a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=29f2c1d9be9348b0888bc61ed37ed957 HTTP/1.1" status: 200 len: 379 time: 0.4429913 Dec 09 21:32:41.088814 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a859accc-d6fc-4cc5-8feb-631674691ba2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-278621066'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:41.090894 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:41.097091 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-3b26013e-e3fc-40f3-b239-ec5532b0444a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Request body: {'port': {'device_id': '91b064ae-1ca1-44d4-a549-a25cccd0c81b', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'admin_state_up': True, 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'security_groups': ['60d89c09-154d-4fe2-b016-511afe2ed923']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:41.112343 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 90f16e74-f2e6-416e-a079-f205615a0d8e {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:32:41.146123 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5836397a-4c37-4075-b561-dc6eef1de203 req-f92403cb-4c65-41ea-b853-93e2d980a2eb tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1600847 Dec 09 21:32:41.164188 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 90f16e74-f2e6-416e-a079-f205615a0d8e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=90f16e74-f2e6-416e-a079-f205615a0d8e,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:41.172191 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a859accc-d6fc-4cc5-8feb-631674691ba2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Made reservation on behalf of dc5c46f00552473abc0991c0cc4a0269 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:32:41.173195 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:41.182941 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a859accc-d6fc-4cc5-8feb-631674691ba2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:41.230681 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:41.237566 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a859accc-d6fc-4cc5-8feb-631674691ba2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] vlan segment allocate from pool success with {'vlan_id': 135, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:32:41.247840 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=90f16e74-f2e6-416e-a079-f205615a0d8e,revision_number=11']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:41.252915 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a859accc-d6fc-4cc5-8feb-631674691ba2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:41.253506 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-a859accc-d6fc-4cc5-8feb-631674691ba2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Added segment 6f2cd81b-b1fc-4ad6-9fbe-e99334f98aef of type vlan for network 0f00b2f0-5f6d-41d3-b316-8ad418693ba7 Dec 09 21:32:41.317648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['90f16e74-f2e6-416e-a079-f205615a0d8e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:32:41.334041 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a859accc-d6fc-4cc5-8feb-631674691ba2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:41.418087 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:32:41.419196 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:32:41.425442 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a859accc-d6fc-4cc5-8feb-631674691ba2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:41.431056 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-3b26013e-e3fc-40f3-b239-ec5532b0444a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Made reservation on behalf of 29f2c1d9be9348b0888bc61ed37ed957 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:32:41.432692 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a859accc-d6fc-4cc5-8feb-631674691ba2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:41.433638 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a859accc-d6fc-4cc5-8feb-631674691ba2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:41.435077 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-3b26013e-e3fc-40f3-b239-ec5532b0444a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:41.519246 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8995ecc2-c788-4bf1-9259-e3d6c8790fef req-4a2e2d0a-23c4-4b81-b784-2d17e08bf575 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:41.532903 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8995ecc2-c788-4bf1-9259-e3d6c8790fef req-4a2e2d0a-23c4-4b81-b784-2d17e08bf575 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 945 time: 0.1835146 Dec 09 21:32:41.594036 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a859accc-d6fc-4cc5-8feb-631674691ba2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.5548120 Dec 09 21:32:41.600365 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47830) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:41.605409 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-7c6ea068-c360-4977-89df-d7e8e4e6b117 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'subnet': {'network_id': '0f00b2f0-5f6d-41d3-b316-8ad418693ba7', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:41.607276 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-3b26013e-e3fc-40f3-b239-ec5532b0444a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Allocated IP 172.20.0.3 (e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8/ace82e8b-012a-4184-a81e-5303eecf12ff/851ff09f-496e-47bd-85bb-2e21622a44e9) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:32:41.669258 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8995ecc2-c788-4bf1-9259-e3d6c8790fef req-98411670-8245-4fc5-89ed-ff11fc7249e6 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1353700 Dec 09 21:32:41.702774 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a859accc-d6fc-4cc5-8feb-631674691ba2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Network': ['ID=0f00b2f0-5f6d-41d3-b316-8ad418693ba7,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:41.721435 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 0f00b2f0-5f6d-41d3-b316-8ad418693ba7 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:32:41.780669 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-3b26013e-e3fc-40f3-b239-ec5532b0444a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:41.821351 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1dddc7be-be2b-4768-aaa1-3792a9efb4a9 req-b429e964-8d69-403a-bbf1-05e7ab95fcee tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 210 time: 0.0373399 Dec 09 21:32:41.850599 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-3b26013e-e3fc-40f3-b239-ec5532b0444a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:41.890912 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7c6ea068-c360-4977-89df-d7e8e4e6b117 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Made reservation on behalf of dc5c46f00552473abc0991c0cc4a0269 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:32:41.901798 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c6ea068-c360-4977-89df-d7e8e4e6b117 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:41.916656 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-3b26013e-e3fc-40f3-b239-ec5532b0444a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Network e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:32:41.923474 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-3b26013e-e3fc-40f3-b239-ec5532b0444a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:32:41.925544 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-3b26013e-e3fc-40f3-b239-ec5532b0444a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:32:41.978083 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47844) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:42.002638 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b26013e-e3fc-40f3-b239-ec5532b0444a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Pushing event updated for resources: {'Port': ['ID=851ff09f-496e-47bd-85bb-2e21622a44e9,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:42.034994 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:42.064028 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-3b26013e-e3fc-40f3-b239-ec5532b0444a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:42.064707 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-3b26013e-e3fc-40f3-b239-ec5532b0444a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:42.096498 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: BUILD current_port_status: DOWN port_id 90f16e74-f2e6-416e-a079-f205615a0d8e {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:32:42.098918 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-3b26013e-e3fc-40f3-b239-ec5532b0444a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0113657 Dec 09 21:32:42.139553 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0733cd3b-385a-4c8e-b761-bf95f1f70d99 req-441ca17d-c05f-413a-9c56-f29b3366d22a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:42.141384 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0733cd3b-385a-4c8e-b761-bf95f1f70d99 req-441ca17d-c05f-413a-9c56-f29b3366d22a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 946 time: 0.0885618 Dec 09 21:32:42.156024 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 90f16e74-f2e6-416e-a079-f205615a0d8e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=90f16e74-f2e6-416e-a079-f205615a0d8e,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:42.161900 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:42.251204 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=90f16e74-f2e6-416e-a079-f205615a0d8e,revision_number=12']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:42.265660 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0733cd3b-385a-4c8e-b761-bf95f1f70d99 req-96e7e8eb-4c41-484f-8e93-f170f7ea1dde tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1151385 Dec 09 21:32:42.286455 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f6d1c12-03a6-4a9f-bac9-da0494283378 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:42.392167 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c6ea068-c360-4977-89df-d7e8e4e6b117 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:42.404753 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-d0ecaf60-2b18-4d49-885a-7e2e9b99bdde service neutron] Request body: {'port': {'device_id': '91b064ae-1ca1-44d4-a549-a25cccd0c81b', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:42.418220 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-558916f6-d1ca-416c-8081-80782da369c1 None None] Provisioning complete for port 851ff09f-496e-47bd-85bb-2e21622a44e9 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:42.423841 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-558916f6-d1ca-416c-8081-80782da369c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:42.467031 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6ea068-c360-4977-89df-d7e8e4e6b117 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Subnet': ['ID=0d2e42cf-65ac-4db2-9f05-42a136a28fa0,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:42.489849 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-d0ecaf60-2b18-4d49-885a-7e2e9b99bdde service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:42.560481 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-558916f6-d1ca-416c-8081-80782da369c1 None None] Port 851ff09f-496e-47bd-85bb-2e21622a44e9 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:32:42.582630 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c6ea068-c360-4977-89df-d7e8e4e6b117 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Checking segment: {'id': '6f2cd81b-b1fc-4ad6-9fbe-e99334f98aef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '0f00b2f0-5f6d-41d3-b316-8ad418693ba7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:32:42.582990 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c6ea068-c360-4977-89df-d7e8e4e6b117 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network hostable DHCP agents. Network: 0f00b2f0-5f6d-41d3-b316-8ad418693ba7, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:32:42.666977 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f6d1c12-03a6-4a9f-bac9-da0494283378 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:42.683325 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f6d1c12-03a6-4a9f-bac9-da0494283378 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:42.736195 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f6d1c12-03a6-4a9f-bac9-da0494283378 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=17196f78-86b6-4360-9b64-16cc30dda3b6,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:42.739594 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c6ea068-c360-4977-89df-d7e8e4e6b117 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network 0f00b2f0-5f6d-41d3-b316-8ad418693ba7 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:32:42.772781 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-7c6ea068-c360-4977-89df-d7e8e4e6b117 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 0f00b2f0-5f6d-41d3-b316-8ad418693ba7) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:32:42.784963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a8579399-962e-4d07-875b-409d2c4f3bba None None] Network 0f00b2f0-5f6d-41d3-b316-8ad418693ba7 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:32:42.802948 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c6ea068-c360-4977-89df-d7e8e4e6b117 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:42.806220 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c6ea068-c360-4977-89df-d7e8e4e6b117 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:42.821472 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7f6d1c12-03a6-4a9f-bac9-da0494283378 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=11cae3063ee94435bc0f598b15535cdf&name=default HTTP/1.1" status: 200 len: 3000 time: 0.8405681 Dec 09 21:32:42.827610 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47878) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:42.867228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 90f16e74-f2e6-416e-a079-f205615a0d8e up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:32:42.953026 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7c6ea068-c360-4977-89df-d7e8e4e6b117 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.3482091 Dec 09 21:32:42.954700 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47882) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:42.971622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-8c2d696e-5e24-4b36-b1a7-d907cb76e3b2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1901986592', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:43.085985 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f8d4e877-5ecf-452e-80e0-815cda2a207f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:43.089775 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8c2d696e-5e24-4b36-b1a7-d907cb76e3b2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:43.090813 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8c2d696e-5e24-4b36-b1a7-d907cb76e3b2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:43.104721 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-d0ecaf60-2b18-4d49-885a-7e2e9b99bdde service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 851ff09f-496e-47bd-85bb-2e21622a44e9 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:32:43.126940 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-d0ecaf60-2b18-4d49-885a-7e2e9b99bdde service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:43.159974 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-d0ecaf60-2b18-4d49-885a-7e2e9b99bdde service neutron] Transition to ACTIVE for port object 851ff09f-496e-47bd-85bb-2e21622a44e9 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:32:43.173383 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-d0ecaf60-2b18-4d49-885a-7e2e9b99bdde service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:43.222306 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f8d4e877-5ecf-452e-80e0-815cda2a207f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:43.224096 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 90f16e74-f2e6-416e-a079-f205615a0d8e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:43.225382 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:43.297943 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d40420ab-f35e-491d-ae48-09aefc9ad0db None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-0f00b2f0-5f6d-41d3-b316-8ad418693ba7', 'network_id': '0f00b2f0-5f6d-41d3-b316-8ad418693ba7', 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'fixed_ips': [{'subnet_id': '0d2e42cf-65ac-4db2-9f05-42a136a28fa0'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:32:43.298994 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d40420ab-f35e-491d-ae48-09aefc9ad0db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:43.348274 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8c2d696e-5e24-4b36-b1a7-d907cb76e3b2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:43.371551 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8c2d696e-5e24-4b36-b1a7-d907cb76e3b2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:43.406320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0ecaf60-2b18-4d49-885a-7e2e9b99bdde service neutron] Pushing event updated for resources: {'Port': ['ID=851ff09f-496e-47bd-85bb-2e21622a44e9,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:43.427831 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:43.439853 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8c2d696e-5e24-4b36-b1a7-d907cb76e3b2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:43.444934 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8c2d696e-5e24-4b36-b1a7-d907cb76e3b2 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.4873323 Dec 09 21:32:43.473540 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96d27978-67f5-49aa-b799-e6daea0d1e72 req-f9ece92f-8aff-4586-915f-12be0381921f tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:43.475199 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47890) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:43.477177 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-d0ecaf60-2b18-4d49-885a-7e2e9b99bdde service neutron] Attempting to bind port 851ff09f-496e-47bd-85bb-2e21622a44e9 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:32:43.477510 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-d0ecaf60-2b18-4d49-885a-7e2e9b99bdde service neutron] Attempting to bind port 851ff09f-496e-47bd-85bb-2e21622a44e9 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'ad90d3b7-fe41-4a28-acd8-4c934cf4d57c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:32:43.477876 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-d0ecaf60-2b18-4d49-885a-7e2e9b99bdde service neutron] Attempting to bind port 851ff09f-496e-47bd-85bb-2e21622a44e9 on network e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:32:43.478725 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96d27978-67f5-49aa-b799-e6daea0d1e72 req-f9ece92f-8aff-4586-915f-12be0381921f tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 931 time: 0.3936930 Dec 09 21:32:43.488836 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7ef6883d-9c98-4e81-b102-bc1197ac4a47', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '90f16e74-f2e6-416e-a079-f205615a0d8e'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:32:43.498326 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-67d1292a-7961-46b7-831b-5fbb218d87f3" -d '{"events": [{"server_uuid": "7ef6883d-9c98-4e81-b102-bc1197ac4a47", "name": "network-vif-plugged", "status": "completed", "tag": "90f16e74-f2e6-416e-a079-f205615a0d8e"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:32:43.564240 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f8d4e877-5ecf-452e-80e0-815cda2a207f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:43.571840 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f8d4e877-5ecf-452e-80e0-815cda2a207f admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:43.574211 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f8d4e877-5ecf-452e-80e0-815cda2a207f admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/17196f78-86b6-4360-9b64-16cc30dda3b6 HTTP/1.1" status: 204 len: 168 time: 0.7418361 Dec 09 21:32:43.624739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-d0ecaf60-2b18-4d49-885a-7e2e9b99bdde service neutron] Port 851ff09f-496e-47bd-85bb-2e21622a44e9 on network e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:32:43.627246 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-d0ecaf60-2b18-4d49-885a-7e2e9b99bdde service neutron] Attempting to bind port 851ff09f-496e-47bd-85bb-2e21622a44e9 on network e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:32:43.652834 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8d4e877-5ecf-452e-80e0-815cda2a207f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=17196f78-86b6-4360-9b64-16cc30dda3b6,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:43.700341 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96d27978-67f5-49aa-b799-e6daea0d1e72 req-0142ced4-54d2-4655-bbc2-4979245997f3 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2129636 Dec 09 21:32:43.701363 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 90f16e74-f2e6-416e-a079-f205615a0d8e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=90f16e74-f2e6-416e-a079-f205615a0d8e,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:43.760979 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:43.763743 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-d0ecaf60-2b18-4d49-885a-7e2e9b99bdde service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 32, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:32:43.764089 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-d0ecaf60-2b18-4d49-885a-7e2e9b99bdde service neutron] Checking segment: {'id': 'ad90d3b7-fe41-4a28-acd8-4c934cf4d57c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:32:43.764471 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-d0ecaf60-2b18-4d49-885a-7e2e9b99bdde service neutron] Bound using segment: {'id': 'ad90d3b7-fe41-4a28-acd8-4c934cf4d57c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:32:43.765386 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-d0ecaf60-2b18-4d49-885a-7e2e9b99bdde service neutron] Bound port: 851ff09f-496e-47bd-85bb-2e21622a44e9, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ad90d3b7-fe41-4a28-acd8-4c934cf4d57c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:32:43.765778 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-d0ecaf60-2b18-4d49-885a-7e2e9b99bdde service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:43.780170 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:32:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-32c6ec16-5620-4405-a9d1-7b1b26e3db87 x-openstack-request-id: req-32c6ec16-5620-4405-a9d1-7b1b26e3db87 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:32:43.782343 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7ef6883d-9c98-4e81-b102-bc1197ac4a47", "name": "network-vif-plugged", "status": "completed", "tag": "90f16e74-f2e6-416e-a079-f205615a0d8e", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:32:43.782852 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-32c6ec16-5620-4405-a9d1-7b1b26e3db87 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:32:43.783390 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7ef6883d-9c98-4e81-b102-bc1197ac4a47', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '90f16e74-f2e6-416e-a079-f205615a0d8e', 'code': 200} Dec 09 21:32:43.846158 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76f32f96-ded2-4458-b0b2-84db5cbe83d5 req-147ba210-1ccc-4a2d-b580-d889f47148da tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:43.859183 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-76f32f96-ded2-4458-b0b2-84db5cbe83d5 req-147ba210-1ccc-4a2d-b580-d889f47148da tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 947 time: 0.1569979 Dec 09 21:32:43.877212 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=90f16e74-f2e6-416e-a079-f205615a0d8e,revision_number=13']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:43.900607 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:43.900983 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:43.901297 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:43.901832 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:43.902190 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:43.902516 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:43.902847 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:43.903176 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:43.903532 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:43.903861 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:43.904193 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:43.904755 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:43.904860 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:43.977987 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-d40420ab-f35e-491d-ae48-09aefc9ad0db None None] Allocated IP 2001:db8::2 (0f00b2f0-5f6d-41d3-b316-8ad418693ba7/0d2e42cf-65ac-4db2-9f05-42a136a28fa0/c4bd21a9-3876-4d72-bff0-02ce13427ccc) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:32:44.039871 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-76f32f96-ded2-4458-b0b2-84db5cbe83d5 req-60679eee-be41-4000-901e-e898f5089e51 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1791151 Dec 09 21:32:44.077636 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23946b60-36d6-417b-8b85-e17a4f5aa4cb req-2202339c-1524-4eb5-9207-35c5aa407a98 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:44.088424 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-23946b60-36d6-417b-8b85-e17a4f5aa4cb req-2202339c-1524-4eb5-9207-35c5aa407a98 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.1645286 Dec 09 21:32:44.211015 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-23946b60-36d6-417b-8b85-e17a4f5aa4cb req-d56bbdd5-827a-4c2e-b943-2ecb0a05a82d tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1201661 Dec 09 21:32:44.295121 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d40420ab-f35e-491d-ae48-09aefc9ad0db None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:44.307943 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d40420ab-f35e-491d-ae48-09aefc9ad0db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:44.365093 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d40420ab-f35e-491d-ae48-09aefc9ad0db None None] Pushing event updated for resources: {'Port': ['ID=c4bd21a9-3876-4d72-bff0-02ce13427ccc,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:44.377309 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d40420ab-f35e-491d-ae48-09aefc9ad0db None None] Network 0f00b2f0-5f6d-41d3-b316-8ad418693ba7 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:32:44.378448 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-d40420ab-f35e-491d-ae48-09aefc9ad0db None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:32:44.381450 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d40420ab-f35e-491d-ae48-09aefc9ad0db None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:32:44.464420 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-d40420ab-f35e-491d-ae48-09aefc9ad0db None None] Attempting to bind port c4bd21a9-3876-4d72-bff0-02ce13427ccc on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:32:44.465059 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-d40420ab-f35e-491d-ae48-09aefc9ad0db None None] Attempting to bind port c4bd21a9-3876-4d72-bff0-02ce13427ccc by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '6f2cd81b-b1fc-4ad6-9fbe-e99334f98aef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '0f00b2f0-5f6d-41d3-b316-8ad418693ba7'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:32:44.465156 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d40420ab-f35e-491d-ae48-09aefc9ad0db None None] Attempting to bind port c4bd21a9-3876-4d72-bff0-02ce13427ccc on network 0f00b2f0-5f6d-41d3-b316-8ad418693ba7 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:32:44.478370 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d40420ab-f35e-491d-ae48-09aefc9ad0db None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 32, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:32:44.478782 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d40420ab-f35e-491d-ae48-09aefc9ad0db None None] Checking segment: {'id': '6f2cd81b-b1fc-4ad6-9fbe-e99334f98aef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '0f00b2f0-5f6d-41d3-b316-8ad418693ba7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:32:44.486363 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d40420ab-f35e-491d-ae48-09aefc9ad0db None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:44.486790 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d40420ab-f35e-491d-ae48-09aefc9ad0db None None] Bound using segment: {'id': '6f2cd81b-b1fc-4ad6-9fbe-e99334f98aef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '0f00b2f0-5f6d-41d3-b316-8ad418693ba7'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:32:44.487307 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-d40420ab-f35e-491d-ae48-09aefc9ad0db None None] Bound port: c4bd21a9-3876-4d72-bff0-02ce13427ccc, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6f2cd81b-b1fc-4ad6-9fbe-e99334f98aef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '0f00b2f0-5f6d-41d3-b316-8ad418693ba7'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:32:44.487727 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d40420ab-f35e-491d-ae48-09aefc9ad0db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:44.515041 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-d0ecaf60-2b18-4d49-885a-7e2e9b99bdde service neutron] For port 851ff09f-496e-47bd-85bb-2e21622a44e9, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:32:44.575282 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-d0ecaf60-2b18-4d49-885a-7e2e9b99bdde service neutron] For port 851ff09f-496e-47bd-85bb-2e21622a44e9, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=851ff09f-496e-47bd-85bb-2e21622a44e9,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:32:44.586595 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-d0ecaf60-2b18-4d49-885a-7e2e9b99bdde service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:44.632847 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-d40420ab-f35e-491d-ae48-09aefc9ad0db None None] For port c4bd21a9-3876-4d72-bff0-02ce13427ccc, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:32:44.637178 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-d40420ab-f35e-491d-ae48-09aefc9ad0db None None] For port c4bd21a9-3876-4d72-bff0-02ce13427ccc, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c4bd21a9-3876-4d72-bff0-02ce13427ccc,segment=NetworkSegment(6f2cd81b-b1fc-4ad6-9fbe-e99334f98aef),segment_id=6f2cd81b-b1fc-4ad6-9fbe-e99334f98aef)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:32:44.646553 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d40420ab-f35e-491d-ae48-09aefc9ad0db None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:44.661270 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-d0ecaf60-2b18-4d49-885a-7e2e9b99bdde service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:44.661765 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-d0ecaf60-2b18-4d49-885a-7e2e9b99bdde service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:44.664012 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-d0ecaf60-2b18-4d49-885a-7e2e9b99bdde service neutron] 10.222.0.31 "PUT /v2.0/ports/851ff09f-496e-47bd-85bb-2e21622a44e9 HTTP/1.1" status: 200 len: 1092 time: 2.5541439 Dec 09 21:32:44.667542 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '91b064ae-1ca1-44d4-a549-a25cccd0c81b', 'tag': '851ff09f-496e-47bd-85bb-2e21622a44e9'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:32:44.679117 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1f35336c-8fb9-4daa-8d4c-15767a84a1b1" -d '{"events": [{"name": "network-changed", "server_uuid": "91b064ae-1ca1-44d4-a549-a25cccd0c81b", "tag": "851ff09f-496e-47bd-85bb-2e21622a44e9"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:32:44.684098 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5e6c3e7d-1db2-47b2-8a25-ea2a7822e65c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:44.812722 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d40420ab-f35e-491d-ae48-09aefc9ad0db None None] Pushing event updated for resources: {'Port': ['ID=c4bd21a9-3876-4d72-bff0-02ce13427ccc,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:45.002966 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7070a4d8-a032-4386-a5ce-cc4429700e5d req-8e660938-a88a-46d1-abf1-f12ad9c4acda tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:45.010709 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7070a4d8-a032-4386-a5ce-cc4429700e5d req-8e660938-a88a-46d1-abf1-f12ad9c4acda tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 943 time: 0.0802667 Dec 09 21:32:45.086050 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-5e6c3e7d-1db2-47b2-8a25-ea2a7822e65c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Allocated IP 2001:db8::1 (0f00b2f0-5f6d-41d3-b316-8ad418693ba7/0d2e42cf-65ac-4db2-9f05-42a136a28fa0/26b5b07f-0713-44d3-bc66-464471401fae) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:32:45.183126 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7070a4d8-a032-4386-a5ce-cc4429700e5d req-12324b64-49c6-48eb-bb17-8c2891d7bc36 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1690645 Dec 09 21:32:45.222942 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:32:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-164a938a-8040-4784-b4ee-0ffba331dcb2 x-openstack-request-id: req-164a938a-8040-4784-b4ee-0ffba331dcb2 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:32:45.223236 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "91b064ae-1ca1-44d4-a549-a25cccd0c81b", "tag": "851ff09f-496e-47bd-85bb-2e21622a44e9", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:32:45.232716 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-164a938a-8040-4784-b4ee-0ffba331dcb2 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:32:45.233267 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '91b064ae-1ca1-44d4-a549-a25cccd0c81b', 'tag': '851ff09f-496e-47bd-85bb-2e21622a44e9', 'status': 'completed', 'code': 200} Dec 09 21:32:45.243953 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0ecaf60-2b18-4d49-885a-7e2e9b99bdde service neutron] Pushing event updated for resources: {'Port': ['ID=851ff09f-496e-47bd-85bb-2e21622a44e9,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:45.379087 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5e6c3e7d-1db2-47b2-8a25-ea2a7822e65c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:45.420355 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-af46da92-6571-4241-965c-12292d0b3537 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:45.427393 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-af46da92-6571-4241-965c-12292d0b3537 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=29f2c1d9be9348b0888bc61ed37ed957&device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 1095 time: 0.7024727 Dec 09 21:32:45.498404 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-116a19f6-6bf9-403f-9906-57bcb1a8fd3c req-e89912a2-9f1f-467e-861e-b2e403a26692 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:45.501265 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-f9cbdc6f-92f7-4e2f-be7e-c28949e54f58 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=851ff09f-496e-47bd-85bb-2e21622a44e9 HTTP/1.1" status: 200 len: 217 time: 0.0610297 Dec 09 21:32:45.512550 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-116a19f6-6bf9-403f-9906-57bcb1a8fd3c req-e89912a2-9f1f-467e-861e-b2e403a26692 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 947 time: 0.2028174 Dec 09 21:32:45.571078 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c4bd21a9-3876-4d72-bff0-02ce13427ccc up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:32:45.640855 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-116a19f6-6bf9-403f-9906-57bcb1a8fd3c req-c2182763-9ab8-4da4-8d91-f573924c5e1b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1142740 Dec 09 21:32:45.655384 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5e6c3e7d-1db2-47b2-8a25-ea2a7822e65c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:45.665561 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb5bcccf-348a-458f-93cb-41ebaa6e774e req-4711304d-2fa6-490b-9205-6a48af4f33cd tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:45.675868 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb5bcccf-348a-458f-93cb-41ebaa6e774e req-4711304d-2fa6-490b-9205-6a48af4f33cd tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.2897534 Dec 09 21:32:45.738928 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port c4bd21a9-3876-4d72-bff0-02ce13427ccc triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:45.740282 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:45.747494 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e6c3e7d-1db2-47b2-8a25-ea2a7822e65c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network 0f00b2f0-5f6d-41d3-b316-8ad418693ba7 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:32:45.764470 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-5e6c3e7d-1db2-47b2-8a25-ea2a7822e65c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:32:45.769579 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e6c3e7d-1db2-47b2-8a25-ea2a7822e65c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:32:45.770126 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5e6c3e7d-1db2-47b2-8a25-ea2a7822e65c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:45.780237 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-d3cdf82f-df9b-4152-88ec-7622f5ef42da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:45.784200 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-d3cdf82f-df9b-4152-88ec-7622f5ef42da service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ace82e8b-012a-4184-a81e-5303eecf12ff HTTP/1.1" status: 200 len: 855 time: 0.2438247 Dec 09 21:32:45.786511 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e6c3e7d-1db2-47b2-8a25-ea2a7822e65c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Port': ['ID=26b5b07f-0713-44d3-bc66-464471401fae,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:45.787987 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb5bcccf-348a-458f-93cb-41ebaa6e774e req-3d946d00-a134-4c8a-b280-d8bb659f7939 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1061494 Dec 09 21:32:45.945890 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-5a2c3fe5-dded-480d-9afb-ef497b38962c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:45.947640 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-5a2c3fe5-dded-480d-9afb-ef497b38962c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0928376 Dec 09 21:32:45.954507 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:46.053432 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5e6c3e7d-1db2-47b2-8a25-ea2a7822e65c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:46.056044 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port c4bd21a9-3876-4d72-bff0-02ce13427ccc, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c4bd21a9-3876-4d72-bff0-02ce13427ccc,segment=NetworkSegment(6f2cd81b-b1fc-4ad6-9fbe-e99334f98aef),segment_id=6f2cd81b-b1fc-4ad6-9fbe-e99334f98aef)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:46.068448 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:46.145371 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-035c7ecc-6619-4b63-a033-bff838da8ce2 service neutron] 10.222.0.31 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1868260 Dec 09 21:32:46.162817 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=c4bd21a9-3876-4d72-bff0-02ce13427ccc,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:46.421556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c90af6b8-d333-44b1-a11f-58312722bf9a req-2ced7084-542e-41f4-ae45-e8556eca5e3b tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:46.423862 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c90af6b8-d333-44b1-a11f-58312722bf9a req-2ced7084-542e-41f4-ae45-e8556eca5e3b tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 943 time: 0.1081746 Dec 09 21:32:46.445592 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b1b7ca6a-2623-4d25-8fbd-b2bf9032067d req-a190c0a8-5138-42c8-a033-88ecb3661464 service neutron] 10.222.0.31 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2838647 Dec 09 21:32:46.491272 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c90af6b8-d333-44b1-a11f-58312722bf9a req-586ebef3-1dcd-4364-9012-e11445981b75 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0557630 Dec 09 21:32:46.605230 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47956) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:46.712275 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f35336c-8fb9-4daa-8d4c-15767a84a1b1 req-a194586f-6fd8-4a4d-960e-0680dafc68e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:46.715235 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1f35336c-8fb9-4daa-8d4c-15767a84a1b1 req-a194586f-6fd8-4a4d-960e-0680dafc68e1 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=29f2c1d9be9348b0888bc61ed37ed957&device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 1095 time: 0.1625848 Dec 09 21:32:46.757386 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18c7d8a9-e2da-49bc-a673-1302b02abb7a None None] Network 0f00b2f0-5f6d-41d3-b316-8ad418693ba7 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:32:46.875367 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-5fc73976-9a5b-416e-b55e-c81830d7f057 tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Request body: {'network': {'name': 'tempest-ExternalNetworksTestJSON-test-network-713354902'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:46.920665 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f0383af-e12b-40df-a35c-bc4303e58b05 req-988fa4da-6947-4433-a575-ce446f70169c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:46.929039 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f0383af-e12b-40df-a35c-bc4303e58b05 req-988fa4da-6947-4433-a575-ce446f70169c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 947 time: 0.1285844 Dec 09 21:32:46.944071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f35336c-8fb9-4daa-8d4c-15767a84a1b1 req-9321d055-f737-4470-9f3f-acf994d84178 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:46.945819 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1f35336c-8fb9-4daa-8d4c-15767a84a1b1 req-9321d055-f737-4470-9f3f-acf994d84178 service neutron] 10.222.0.31 "GET /v2.0/networks?id=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 HTTP/1.1" status: 200 len: 917 time: 0.2202013 Dec 09 21:32:46.981348 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c5e3d00c-2ad0-470c-b640-474938f51f14 None None] Provisioning complete for port c4bd21a9-3876-4d72-bff0-02ce13427ccc triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:46.982239 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c5e3d00c-2ad0-470c-b640-474938f51f14 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:47.005441 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1f35336c-8fb9-4daa-8d4c-15767a84a1b1 req-87f0278f-fb2b-4fdf-944f-a5df88461d12 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=851ff09f-496e-47bd-85bb-2e21622a44e9 HTTP/1.1" status: 200 len: 217 time: 0.0509651 Dec 09 21:32:47.012173 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f0383af-e12b-40df-a35c-bc4303e58b05 req-537ff549-0e12-4a3b-ab42-ff9f5b30a7b1 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0818594 Dec 09 21:32:47.055385 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5fc73976-9a5b-416e-b55e-c81830d7f057 tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Made reservation on behalf of 646f96b4218946afb8bf7ec2c382f1a7 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:32:47.059834 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fc73976-9a5b-416e-b55e-c81830d7f057 tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:47.075078 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fc73976-9a5b-416e-b55e-c81830d7f057 tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:47.100156 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f35336c-8fb9-4daa-8d4c-15767a84a1b1 req-75ae93ed-670b-45b3-9c88-c21777c59474 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:47.101843 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1f35336c-8fb9-4daa-8d4c-15767a84a1b1 req-75ae93ed-670b-45b3-9c88-c21777c59474 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ace82e8b-012a-4184-a81e-5303eecf12ff HTTP/1.1" status: 200 len: 855 time: 0.0829484 Dec 09 21:32:47.180317 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1db99b90-4e62-4903-b17a-59f11e562677 req-23d965e9-5ea8-4349-9d79-5d362a09ae87 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:47.188825 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1db99b90-4e62-4903-b17a-59f11e562677 req-23d965e9-5ea8-4349-9d79-5d362a09ae87 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.2057924 Dec 09 21:32:47.260125 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f35336c-8fb9-4daa-8d4c-15767a84a1b1 req-19766b62-46bf-4ceb-a620-d97cd8435a11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:47.261997 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1f35336c-8fb9-4daa-8d4c-15767a84a1b1 req-19766b62-46bf-4ceb-a620-d97cd8435a11 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1210842 Dec 09 21:32:47.273884 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fc73976-9a5b-416e-b55e-c81830d7f057 tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:47.293094 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1db99b90-4e62-4903-b17a-59f11e562677 req-fb017dfd-1c04-400f-a194-da233f1201d9 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1033065 Dec 09 21:32:47.300140 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fc73976-9a5b-416e-b55e-c81830d7f057 tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:47.351908 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5e6c3e7d-1db2-47b2-8a25-ea2a7822e65c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:47.472859 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c4bd21a9-3876-4d72-bff0-02ce13427ccc up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:32:47.507802 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5e6c3e7d-1db2-47b2-8a25-ea2a7822e65c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:47.508868 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5e6c3e7d-1db2-47b2-8a25-ea2a7822e65c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:47.543431 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1f35336c-8fb9-4daa-8d4c-15767a84a1b1 req-74920c89-f3d0-4d17-9e0b-462784b116fb service neutron] 10.222.0.31 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2576895 Dec 09 21:32:47.590112 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port c4bd21a9-3876-4d72-bff0-02ce13427ccc triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:47.590712 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:47.708532 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c5f81917-1535-4468-a81e-2a7f507bdbfa None None] Provisioning complete for port 26b5b07f-0713-44d3-bc66-464471401fae triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:47.709083 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c5f81917-1535-4468-a81e-2a7f507bdbfa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:47.743032 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1f35336c-8fb9-4daa-8d4c-15767a84a1b1 req-a002a5b3-52a6-4b21-88ae-e53275f31dc0 service neutron] 10.222.0.31 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1889939 Dec 09 21:32:47.789619 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-c5f81917-1535-4468-a81e-2a7f507bdbfa None None] Port 26b5b07f-0713-44d3-bc66-464471401fae cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:32:47.824520 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c5f81917-1535-4468-a81e-2a7f507bdbfa None None] Provisioning complete for port c4bd21a9-3876-4d72-bff0-02ce13427ccc triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:47.825005 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c5f81917-1535-4468-a81e-2a7f507bdbfa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:47.909297 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e6c3e7d-1db2-47b2-8a25-ea2a7822e65c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Port': ['ID=26b5b07f-0713-44d3-bc66-464471401fae,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:48.009708 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e6c3e7d-1db2-47b2-8a25-ea2a7822e65c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network 0f00b2f0-5f6d-41d3-b316-8ad418693ba7 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:32:48.013171 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-5e6c3e7d-1db2-47b2-8a25-ea2a7822e65c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:32:48.203605 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-0a5700f9-699d-4e93-9336-1bb897b036f9 None None] Provisioning complete for port 26b5b07f-0713-44d3-bc66-464471401fae triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:48.203941 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0a5700f9-699d-4e93-9336-1bb897b036f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:48.242227 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5fc73976-9a5b-416e-b55e-c81830d7f057 tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] vlan segment allocate from pool success with {'vlan_id': 131, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:32:48.274416 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5e6c3e7d-1db2-47b2-8a25-ea2a7822e65c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Router 81d37c97-8ea4-495a-b02c-d39fe13cbfac is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:32:48.311793 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-0a5700f9-699d-4e93-9336-1bb897b036f9 None None] Port 26b5b07f-0713-44d3-bc66-464471401fae cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:32:48.344047 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fc73976-9a5b-416e-b55e-c81830d7f057 tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9d810044-2082-4685-8a9d-736715d8c54c,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:48.364723 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fc73976-9a5b-416e-b55e-c81830d7f057 tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:48.365078 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-5fc73976-9a5b-416e-b55e-c81830d7f057 tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Added segment ca7579f0-8543-4061-9b89-cab61ac6a10d of type vlan for network af373da4-f17c-434a-98cb-6515ba91132c Dec 09 21:32:48.437478 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-afc8b381-6c20-4a9b-876d-9d07e1fbfc1e None None] Provisioning complete for port 26b5b07f-0713-44d3-bc66-464471401fae triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:48.439091 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-afc8b381-6c20-4a9b-876d-9d07e1fbfc1e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:48.447310 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5e6c3e7d-1db2-47b2-8a25-ea2a7822e65c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:32:48.462156 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3536b47-adbb-480d-a680-d2af16af12c2 None None] Sync routers for ids ['81d37c97-8ea4-495a-b02c-d39fe13cbfac'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:32:48.463141 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5e6c3e7d-1db2-47b2-8a25-ea2a7822e65c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/routers/81d37c97-8ea4-495a-b02c-d39fe13cbfac/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.9804525 Dec 09 21:32:48.464056 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47980) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:48.478917 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-354fc08a-69b5-4f02-b54b-255c29ad9a72 req-6ebc3ba9-f28d-459c-b1d2-6f2374a84eb4 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:48.481479 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3536b47-adbb-480d-a680-d2af16af12c2 None None] Routers {'81d37c97-8ea4-495a-b02c-d39fe13cbfac'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:32:48.483415 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d3536b47-adbb-480d-a680-d2af16af12c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:32:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['81d37c97-8ea4-495a-b02c-d39fe13cbfac'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:48.486825 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-354fc08a-69b5-4f02-b54b-255c29ad9a72 req-6ebc3ba9-f28d-459c-b1d2-6f2374a84eb4 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 947 time: 0.3137856 Dec 09 21:32:48.500249 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fc73976-9a5b-416e-b55e-c81830d7f057 tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:48.513271 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e266e74-720d-478e-bda2-92c23456db40 req-65453a07-1c75-4ee2-8a27-5d114fa348d2 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:48.521224 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d3536b47-adbb-480d-a680-d2af16af12c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:48.521756 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e266e74-720d-478e-bda2-92c23456db40 req-65453a07-1c75-4ee2-8a27-5d114fa348d2 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 943 time: 0.3496287 Dec 09 21:32:48.531887 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3536b47-adbb-480d-a680-d2af16af12c2 None None] Routers {'81d37c97-8ea4-495a-b02c-d39fe13cbfac'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:32:48.532507 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d3536b47-adbb-480d-a680-d2af16af12c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:32:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['81d37c97-8ea4-495a-b02c-d39fe13cbfac'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:48.553849 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-afc8b381-6c20-4a9b-876d-9d07e1fbfc1e None None] Port 26b5b07f-0713-44d3-bc66-464471401fae cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:32:48.570752 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d3536b47-adbb-480d-a680-d2af16af12c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:48.571692 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3536b47-adbb-480d-a680-d2af16af12c2 None None] The sync data for ids ['81d37c97-8ea4-495a-b02c-d39fe13cbfac'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:32:48.610125 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bb551d70-8c40-474f-89e7-496b5b90a870 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:48.610655 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-354fc08a-69b5-4f02-b54b-255c29ad9a72 req-c4723df5-26d4-402e-b208-493b0eb6eec8 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1224699 Dec 09 21:32:48.611872 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bb551d70-8c40-474f-89e7-496b5b90a870 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/ports/26b5b07f-0713-44d3-bc66-464471401fae HTTP/1.1" status: 200 len: 911 time: 0.1467173 Dec 09 21:32:48.614574 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47984) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:48.631667 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b1f44954-2e5b-4bff-a501-7923c07bf8a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '0d2e42cf-65ac-4db2-9f05-42a136a28fa0'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:48.643824 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fc73976-9a5b-416e-b55e-c81830d7f057 tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:48.659621 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5fc73976-9a5b-416e-b55e-c81830d7f057 tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:48.660501 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fc73976-9a5b-416e-b55e-c81830d7f057 tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:48.783179 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e266e74-720d-478e-bda2-92c23456db40 req-fbf40a7d-ea23-46f5-8a4d-ee31bc49c05b tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2603362 Dec 09 21:32:48.810436 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5fc73976-9a5b-416e-b55e-c81830d7f057 tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 791 time: 2.2038977 Dec 09 21:32:48.822206 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47986) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:48.841508 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b1f44954-2e5b-4bff-a501-7923c07bf8a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:48.884113 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fc73976-9a5b-416e-b55e-c81830d7f057 tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Pushing event updated for resources: {'Network': ['ID=af373da4-f17c-434a-98cb-6515ba91132c,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:48.896128 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network af373da4-f17c-434a-98cb-6515ba91132c details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:32:48.911070 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70bf55e7-52db-4e0e-bc4c-7113064f5aba req-adba877d-d2fe-4ede-981c-bcc88c8306ae tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:48.921534 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-70bf55e7-52db-4e0e-bc4c-7113064f5aba req-adba877d-d2fe-4ede-981c-bcc88c8306ae tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.1907957 Dec 09 21:32:49.016989 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-70bf55e7-52db-4e0e-bc4c-7113064f5aba req-8c121ab6-bbe5-410e-b937-ac2975e0f003 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0943694 Dec 09 21:32:49.029816 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-534bc307-ee22-4b7d-96c8-0c3033591fff tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Request body: {'network': {'name': 'tempest-network--1647765787', 'router:external': True}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:49.080059 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-534bc307-ee22-4b7d-96c8-0c3033591fff tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Made reservation on behalf of 0607cac1ba1e46c59a3758dd59e93d9d for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:32:49.084002 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-534bc307-ee22-4b7d-96c8-0c3033591fff tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:49.095870 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-534bc307-ee22-4b7d-96c8-0c3033591fff tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:49.203259 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-534bc307-ee22-4b7d-96c8-0c3033591fff tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:49.210399 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-534bc307-ee22-4b7d-96c8-0c3033591fff tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:49.228204 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-534bc307-ee22-4b7d-96c8-0c3033591fff tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] vlan segment allocate from pool success with {'vlan_id': 128, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:32:49.256062 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-534bc307-ee22-4b7d-96c8-0c3033591fff tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:49.256731 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-534bc307-ee22-4b7d-96c8-0c3033591fff tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Added segment 5c048578-513b-4889-8610-fe712277b021 of type vlan for network c1427fd4-9769-4482-bfac-15490f949e40 Dec 09 21:32:49.266322 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-534bc307-ee22-4b7d-96c8-0c3033591fff tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8c01f76e-9a37-4d02-b3ce-e6b82cf2656e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:49.318370 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-534bc307-ee22-4b7d-96c8-0c3033591fff tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:49.375468 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-534bc307-ee22-4b7d-96c8-0c3033591fff tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:49.377533 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-534bc307-ee22-4b7d-96c8-0c3033591fff tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:49.378837 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-534bc307-ee22-4b7d-96c8-0c3033591fff tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:49.437649 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-534bc307-ee22-4b7d-96c8-0c3033591fff tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 863 time: 0.6100569 Dec 09 21:32:49.439101 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47992) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:49.538512 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b1f44954-2e5b-4bff-a501-7923c07bf8a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:49.564256 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b1f44954-2e5b-4bff-a501-7923c07bf8a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:49.570985 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b1f44954-2e5b-4bff-a501-7923c07bf8a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:49.572232 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b1f44954-2e5b-4bff-a501-7923c07bf8a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:49.573789 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b1f44954-2e5b-4bff-a501-7923c07bf8a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/ports/26b5b07f-0713-44d3-bc66-464471401fae HTTP/1.1" status: 200 len: 911 time: 0.9469984 Dec 09 21:32:49.585081 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47996) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:49.597897 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-534bc307-ee22-4b7d-96c8-0c3033591fff tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Pushing event updated for resources: {'Network': ['ID=c1427fd4-9769-4482-bfac-15490f949e40,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:49.635861 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network c1427fd4-9769-4482-bfac-15490f949e40 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:32:49.681566 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cf30e785-dba6-4752-9287-a958f503c28d tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:49.726187 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1f44954-2e5b-4bff-a501-7923c07bf8a1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Port': ['ID=26b5b07f-0713-44d3-bc66-464471401fae,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:49.815887 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cf30e785-dba6-4752-9287-a958f503c28d tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:49.852164 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-cf30e785-dba6-4752-9287-a958f503c28d tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c1427fd4-9769-4482-bfac-15490f949e40']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:49.870776 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d69259c2-bdb0-4ad3-aa07-6d2532f207a4 req-8e2d6813-d6f0-4c93-af41-4f4192364eaa tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:49.872421 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d69259c2-bdb0-4ad3-aa07-6d2532f207a4 req-8e2d6813-d6f0-4c93-af41-4f4192364eaa tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 947 time: 0.1243382 Dec 09 21:32:49.874938 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-cf30e785-dba6-4752-9287-a958f503c28d tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5c048578-513b-4889-8610-fe712277b021') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:49.875262 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-cf30e785-dba6-4752-9287-a958f503c28d tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5c048578-513b-4889-8610-fe712277b021') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:49.902901 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cf30e785-dba6-4752-9287-a958f503c28d tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:49.949529 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cf30e785-dba6-4752-9287-a958f503c28d tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:49.983075 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cf30e785-dba6-4752-9287-a958f503c28d tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Releasing vlan 128 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:32:49.983648 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cf30e785-dba6-4752-9287-a958f503c28d tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:32:49.988867 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:32:50.010152 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d69259c2-bdb0-4ad3-aa07-6d2532f207a4 req-f2408988-c019-4dcd-820a-8c52c7041dd3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1260827 Dec 09 21:32:50.088611 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3895119-3747-4d7c-adca-97ba2afae262 req-d40ec242-14d5-4960-9565-1761bdde512e tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:50.090259 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3895119-3747-4d7c-adca-97ba2afae262 req-d40ec242-14d5-4960-9565-1761bdde512e tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 943 time: 0.1509297 Dec 09 21:32:50.117632 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cf30e785-dba6-4752-9287-a958f503c28d tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:50.122729 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cf30e785-dba6-4752-9287-a958f503c28d tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network c1427fd4-9769-4482-bfac-15490f949e40 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Dec 09 21:32:50.125536 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cf30e785-dba6-4752-9287-a958f503c28d tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:50.129296 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cf30e785-dba6-4752-9287-a958f503c28d tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] 10.222.0.13 "DELETE /v2.0/networks/c1427fd4-9769-4482-bfac-15490f949e40 HTTP/1.1" status: 204 len: 168 time: 0.6863885 Dec 09 21:32:50.139005 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48006) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:50.144213 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a8d640e4-cbd9-47e5-bbdc-6996a48c4975 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Request body: {'network': {'router:external': True}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:50.178360 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf30e785-dba6-4752-9287-a958f503c28d tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Pushing event deleted for resources: {'Network': ['ID=c1427fd4-9769-4482-bfac-15490f949e40,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:50.225880 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3895119-3747-4d7c-adca-97ba2afae262 req-79ee5c7f-cda2-4444-b02d-4ade8598afa7 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1269672 Dec 09 21:32:50.227389 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a8d640e4-cbd9-47e5-bbdc-6996a48c4975 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Made reservation on behalf of 0607cac1ba1e46c59a3758dd59e93d9d for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:32:50.230804 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a8d640e4-cbd9-47e5-bbdc-6996a48c4975 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:50.262331 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a8d640e4-cbd9-47e5-bbdc-6996a48c4975 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] vlan segment allocate from pool success with {'vlan_id': 105, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:32:50.275328 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a8d640e4-cbd9-47e5-bbdc-6996a48c4975 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:50.275809 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-a8d640e4-cbd9-47e5-bbdc-6996a48c4975 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Added segment 190cad56-7fd1-41ad-bc7e-fa30f8553e64 of type vlan for network 9d59c78f-7a77-4ad7-845a-83ac2cc9789e Dec 09 21:32:50.387500 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a8d640e4-cbd9-47e5-bbdc-6996a48c4975 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:50.402480 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d245db31-46ed-4f4a-89ef-b161645415cb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:50.462951 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a8d640e4-cbd9-47e5-bbdc-6996a48c4975 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:50.465010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8d640e4-cbd9-47e5-bbdc-6996a48c4975 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:50.466600 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a8d640e4-cbd9-47e5-bbdc-6996a48c4975 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:50.569506 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51ed83a1-58c9-4bb9-8394-a73b7012c9f9 req-ac645d9f-1eb9-4215-a3ae-c27784ad8d5c tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:50.571361 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51ed83a1-58c9-4bb9-8394-a73b7012c9f9 req-ac645d9f-1eb9-4215-a3ae-c27784ad8d5c tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.2609251 Dec 09 21:32:50.592093 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a8d640e4-cbd9-47e5-bbdc-6996a48c4975 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 836 time: 0.4524319 Dec 09 21:32:50.613244 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48010) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:50.621655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Request body: {'subnet': {'network_id': '9d59c78f-7a77-4ad7-845a-83ac2cc9789e', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:50.651460 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8d640e4-cbd9-47e5-bbdc-6996a48c4975 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Pushing event updated for resources: {'Network': ['ID=9d59c78f-7a77-4ad7-845a-83ac2cc9789e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:50.665535 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 9d59c78f-7a77-4ad7-845a-83ac2cc9789e details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:32:50.687057 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Made reservation on behalf of 0607cac1ba1e46c59a3758dd59e93d9d for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:32:50.694259 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:50.735608 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51ed83a1-58c9-4bb9-8394-a73b7012c9f9 req-2e1ebf11-36eb-40f8-a795-1cf6e725ab94 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1476488 Dec 09 21:32:50.862966 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 851ff09f-496e-47bd-85bb-2e21622a44e9 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:32:50.944185 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-d245db31-46ed-4f4a-89ef-b161645415cb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting port 26b5b07f-0713-44d3-bc66-464471401fae {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:32:50.944747 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d245db31-46ed-4f4a-89ef-b161645415cb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:51.018360 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 851ff09f-496e-47bd-85bb-2e21622a44e9, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=851ff09f-496e-47bd-85bb-2e21622a44e9,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:51.031261 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '851ff09f-496e-47bd-85bb-2e21622a44e9', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'port_id': '851ff09f-496e-47bd-85bb-2e21622a44e9', 'mac_address': 'fa:16:3e:bb:5d:d2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:32:51.092589 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:51.117550 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 851ff09f-496e-47bd-85bb-2e21622a44e9 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:32:51.173240 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 851ff09f-496e-47bd-85bb-2e21622a44e9, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=851ff09f-496e-47bd-85bb-2e21622a44e9,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:51.180912 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:51.237373 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31cf999f-5db0-40fb-a131-b7c913a5066e req-6c9af64a-a656-4a84-b7a2-c62bc69756f8 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:51.239152 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31cf999f-5db0-40fb-a131-b7c913a5066e req-6c9af64a-a656-4a84-b7a2-c62bc69756f8 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 947 time: 0.1020646 Dec 09 21:32:51.309608 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=851ff09f-496e-47bd-85bb-2e21622a44e9,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:51.342579 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31cf999f-5db0-40fb-a131-b7c913a5066e req-bce0d5a9-6382-4a8b-a58d-1397800687a5 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0970922 Dec 09 21:32:51.440095 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['851ff09f-496e-47bd-85bb-2e21622a44e9'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:32:51.442845 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd258282-234b-40ae-988a-cbc06ce99669 req-b0e29cc7-6bf6-433c-8a97-4a1d28d6ca7e tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:51.444532 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fd258282-234b-40ae-988a-cbc06ce99669 req-b0e29cc7-6bf6-433c-8a97-4a1d28d6ca7e tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 944 time: 0.0855486 Dec 09 21:32:51.555425 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fd258282-234b-40ae-988a-cbc06ce99669 req-64e9b350-f9c0-4894-addd-127a5a6131c9 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1044633 Dec 09 21:32:51.776938 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d245db31-46ed-4f4a-89ef-b161645415cb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:51.807131 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-d245db31-46ed-4f4a-89ef-b161645415cb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Calling delete_port for 26b5b07f-0713-44d3-bc66-464471401fae owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:32:51.907533 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f62c749-278c-4ebf-bdc5-1e081eb05736 req-d5466698-ba8a-4e62-a091-107b60717c00 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:51.915165 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f62c749-278c-4ebf-bdc5-1e081eb05736 req-d5466698-ba8a-4e62-a091-107b60717c00 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.0619593 Dec 09 21:32:51.972248 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f62c749-278c-4ebf-bdc5-1e081eb05736 req-a63dfb33-7366-4276-9e1c-84d67ac52c2b tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0560584 Dec 09 21:32:52.115572 n-d-713301-27 neutron-server[103437]: DEBUG neutron.objects.ports [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103437) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 09 21:32:52.116144 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:52.204963 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Pushing event updated for resources: {'Subnet': ['ID=0568fe2e-ac02-4c0b-8777-51466f1803ff,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:52.210356 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d245db31-46ed-4f4a-89ef-b161645415cb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:52.246070 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:52.246513 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:52.246942 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:52.247380 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:52.247824 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:52.248657 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:52.249066 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:52.249464 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:52.249859 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:52.250497 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:52.250944 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:52.251364 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:52.251828 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:52.255825 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Checking segment: {'id': '190cad56-7fd1-41ad-bc7e-fa30f8553e64', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '9d59c78f-7a77-4ad7-845a-83ac2cc9789e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:32:52.256365 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Network hostable DHCP agents. Network: 9d59c78f-7a77-4ad7-845a-83ac2cc9789e, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:32:52.259566 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d245db31-46ed-4f4a-89ef-b161645415cb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Port': ['ID=26b5b07f-0713-44d3-bc66-464471401fae,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:52.446446 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Network 9d59c78f-7a77-4ad7-845a-83ac2cc9789e is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:32:52.453412 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d245db31-46ed-4f4a-89ef-b161645415cb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:52.476446 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 9d59c78f-7a77-4ad7-845a-83ac2cc9789e) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:32:52.490498 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d169c99-9f2a-4acd-8eb1-15f1d3b2e013 None None] Network 9d59c78f-7a77-4ad7-845a-83ac2cc9789e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:32:52.506100 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:52.507921 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:52.601437 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba5bc7bd-14eb-44b8-8de3-12248aae8b23 req-2d475ff0-ec0f-4153-b774-c9d7c15a1e7e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:52.603089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba5bc7bd-14eb-44b8-8de3-12248aae8b23 req-2d475ff0-ec0f-4153-b774-c9d7c15a1e7e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 947 time: 0.1416833 Dec 09 21:32:52.637660 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb0768a2-1960-4727-8c0c-3e9a97db3624 None None] Network 9d59c78f-7a77-4ad7-845a-83ac2cc9789e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:32:52.655476 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4af4f3eb-e956-48c9-a636-c2337dd049f0 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 2.0396099 Dec 09 21:32:52.656917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48040) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:52.665420 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-26c87c02-fe42-45f3-91a8-ed7292845f9e tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Request body: {'floatingip': {'floating_network_id': '9d59c78f-7a77-4ad7-845a-83ac2cc9789e'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:52.711912 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba5bc7bd-14eb-44b8-8de3-12248aae8b23 req-af554f76-450b-4eb9-839a-9a194451fe77 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0989065 Dec 09 21:32:52.856878 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26c87c02-fe42-45f3-91a8-ed7292845f9e tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks [] for floatingip, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:52.869724 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 851ff09f-496e-47bd-85bb-2e21622a44e9 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:32:52.894152 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2c28e9f-51b3-4b68-8f7b-ad380783cce8 req-8fa12d7f-288d-4779-bdd5-4bc18a4412e5 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:52.901668 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d245db31-46ed-4f4a-89ef-b161645415cb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Router 81d37c97-8ea4-495a-b02c-d39fe13cbfac has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:32:52.904781 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f2c28e9f-51b3-4b68-8f7b-ad380783cce8 req-8fa12d7f-288d-4779-bdd5-4bc18a4412e5 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 944 time: 0.1217687 Dec 09 21:32:52.968092 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 851ff09f-496e-47bd-85bb-2e21622a44e9 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:32:52.971893 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f2c28e9f-51b3-4b68-8f7b-ad380783cce8 req-c657db97-8375-41ed-ba72-c79bc9df3421 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0645492 Dec 09 21:32:52.975006 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 851ff09f-496e-47bd-85bb-2e21622a44e9 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:52.975676 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:53.097485 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d245db31-46ed-4f4a-89ef-b161645415cb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:32:53.101102 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d245db31-46ed-4f4a-89ef-b161645415cb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/routers/81d37c97-8ea4-495a-b02c-d39fe13cbfac/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.5133471 Dec 09 21:32:53.106554 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48046) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:53.125477 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37b44f9b-87a0-4ff2-b099-513cba4dffb5 None None] Sync routers for ids ['81d37c97-8ea4-495a-b02c-d39fe13cbfac'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:32:53.141053 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37b44f9b-87a0-4ff2-b099-513cba4dffb5 None None] Routers {'81d37c97-8ea4-495a-b02c-d39fe13cbfac'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:32:53.152113 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-10a4c9e7-8a13-4d94-bb64-9730ace7cf78 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/ports?device_id=81d37c97-8ea4-495a-b02c-d39fe13cbfac HTTP/1.1" status: 200 len: 205 time: 0.0383754 Dec 09 21:32:53.152113 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26c87c02-fe42-45f3-91a8-ed7292845f9e tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:53.152464 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-37b44f9b-87a0-4ff2-b099-513cba4dffb5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:32:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['81d37c97-8ea4-495a-b02c-d39fe13cbfac'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:53.161976 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3025aa4-4bc2-49de-bd50-c1af3a347cc5 req-8d6d4153-1424-46da-88c4-f1f3d1172633 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:53.164601 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3025aa4-4bc2-49de-bd50-c1af3a347cc5 req-8d6d4153-1424-46da-88c4-f1f3d1172633 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.0820847 Dec 09 21:32:53.165940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48048) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:53.283278 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee12f86e-900c-4770-b23a-9926106942fb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:53.364875 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-37b44f9b-87a0-4ff2-b099-513cba4dffb5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:53.384773 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-26c87c02-fe42-45f3-91a8-ed7292845f9e tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Allocated IP 172.20.0.5 (9d59c78f-7a77-4ad7-845a-83ac2cc9789e/0568fe2e-ac02-4c0b-8777-51466f1803ff/f11a852c-a954-4a58-b530-f48ee3f2e51b) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:32:53.399332 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37b44f9b-87a0-4ff2-b099-513cba4dffb5 None None] Routers {'81d37c97-8ea4-495a-b02c-d39fe13cbfac'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:32:53.400054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-37b44f9b-87a0-4ff2-b099-513cba4dffb5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:32:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['81d37c97-8ea4-495a-b02c-d39fe13cbfac'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:53.449016 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-37b44f9b-87a0-4ff2-b099-513cba4dffb5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:53.449712 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37b44f9b-87a0-4ff2-b099-513cba4dffb5 None None] The sync data for ids ['81d37c97-8ea4-495a-b02c-d39fe13cbfac'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:32:53.478529 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:53.524194 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '91b064ae-1ca1-44d4-a549-a25cccd0c81b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '851ff09f-496e-47bd-85bb-2e21622a44e9'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:32:53.528417 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-277888e4-1705-41ed-a8ac-23b49ca2b23d" -d '{"events": [{"server_uuid": "91b064ae-1ca1-44d4-a549-a25cccd0c81b", "name": "network-vif-plugged", "status": "completed", "tag": "851ff09f-496e-47bd-85bb-2e21622a44e9"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:32:53.553971 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 851ff09f-496e-47bd-85bb-2e21622a44e9, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=851ff09f-496e-47bd-85bb-2e21622a44e9,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:53.557915 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3025aa4-4bc2-49de-bd50-c1af3a347cc5 req-f8a5b26f-5a47-4dbf-974f-fea3b163d143 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2718649 Dec 09 21:32:53.563574 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:53.590668 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26c87c02-fe42-45f3-91a8-ed7292845f9e tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:53.629013 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:32:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cd8d9e9a-323c-4d9e-88c3-543162e236c0 x-openstack-request-id: req-cd8d9e9a-323c-4d9e-88c3-543162e236c0 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:32:53.630261 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "91b064ae-1ca1-44d4-a549-a25cccd0c81b", "name": "network-vif-plugged", "status": "completed", "tag": "851ff09f-496e-47bd-85bb-2e21622a44e9", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:32:53.630683 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-cd8d9e9a-323c-4d9e-88c3-543162e236c0 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:32:53.631245 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '91b064ae-1ca1-44d4-a549-a25cccd0c81b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '851ff09f-496e-47bd-85bb-2e21622a44e9', 'code': 200} Dec 09 21:32:53.638220 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=851ff09f-496e-47bd-85bb-2e21622a44e9,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:53.645741 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26c87c02-fe42-45f3-91a8-ed7292845f9e tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:53.691678 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee12f86e-900c-4770-b23a-9926106942fb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:53.695661 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee12f86e-900c-4770-b23a-9926106942fb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:53.761665 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee12f86e-900c-4770-b23a-9926106942fb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:53.762319 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ee12f86e-900c-4770-b23a-9926106942fb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Fanout notify agent at l3_agent the message router_deleted on router 81d37c97-8ea4-495a-b02c-d39fe13cbfac {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:32:53.772566 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee12f86e-900c-4770-b23a-9926106942fb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:53.774372 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ee12f86e-900c-4770-b23a-9926106942fb tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/routers/81d37c97-8ea4-495a-b02c-d39fe13cbfac HTTP/1.1" status: 204 len: 168 time: 0.6070826 Dec 09 21:32:53.776905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48058) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:53.782807 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26c87c02-fe42-45f3-91a8-ed7292845f9e tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Pushing event updated for resources: {'Port': ['ID=f11a852c-a954-4a58-b530-f48ee3f2e51b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:53.793799 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-26c87c02-fe42-45f3-91a8-ed7292845f9e tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Network 9d59c78f-7a77-4ad7-845a-83ac2cc9789e is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:32:53.799300 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-26c87c02-fe42-45f3-91a8-ed7292845f9e tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:32:53.801839 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26c87c02-fe42-45f3-91a8-ed7292845f9e tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:32:53.848054 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38aed93a-b4c1-45c3-83cb-281e515d9b73 req-8b71f8b6-9784-454d-b136-4b7fa3404dc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:53.850151 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-38aed93a-b4c1-45c3-83cb-281e515d9b73 req-8b71f8b6-9784-454d-b136-4b7fa3404dc9 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 1097 time: 0.1438196 Dec 09 21:32:53.853968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-d93e7c8e-7187-43a1-ba79-624b7cfc128f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting subnet 0d2e42cf-65ac-4db2-9f05-42a136a28fa0 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:32:53.857812 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d93e7c8e-7187-43a1-ba79-624b7cfc128f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:53.932350 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d93e7c8e-7187-43a1-ba79-624b7cfc128f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:53.977585 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdc6e782-4e00-411b-9033-c37af0c68f55 req-7c43f841-d16a-4f15-b62a-7bcee67debe6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:53.979550 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cdc6e782-4e00-411b-9033-c37af0c68f55 req-7c43f841-d16a-4f15-b62a-7bcee67debe6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 947 time: 0.0985277 Dec 09 21:32:54.062951 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-38aed93a-b4c1-45c3-83cb-281e515d9b73 req-47a6ed6c-7aee-478f-9c1a-87913f9d128b service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2004461 Dec 09 21:32:54.087118 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26c87c02-fe42-45f3-91a8-ed7292845f9e tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks [] for floatingip, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:54.091407 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cdc6e782-4e00-411b-9033-c37af0c68f55 req-b0ad9e84-946e-49b0-bf5a-7b08593d042e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1056037 Dec 09 21:32:54.105286 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d93e7c8e-7187-43a1-ba79-624b7cfc128f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:54.146640 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26c87c02-fe42-45f3-91a8-ed7292845f9e tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:54.197148 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a596c293-57dd-471f-9040-a82977dc86f4 req-47aa5107-6efb-434e-9d9a-bec5a7193791 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:54.198676 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a596c293-57dd-471f-9040-a82977dc86f4 req-47aa5107-6efb-434e-9d9a-bec5a7193791 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.0898170 Dec 09 21:32:54.243082 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d93e7c8e-7187-43a1-ba79-624b7cfc128f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:54.292231 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d93e7c8e-7187-43a1-ba79-624b7cfc128f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Subnet': ['ID=0d2e42cf-65ac-4db2-9f05-42a136a28fa0,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:54.303946 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d93e7c8e-7187-43a1-ba79-624b7cfc128f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:54.304292 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2acd074b-2c09-4160-af58-dc0eb32f869b None None] Network 0f00b2f0-5f6d-41d3-b316-8ad418693ba7 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:32:54.309857 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d93e7c8e-7187-43a1-ba79-624b7cfc128f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/subnets/0d2e42cf-65ac-4db2-9f05-42a136a28fa0 HTTP/1.1" status: 204 len: 168 time: 0.5285051 Dec 09 21:32:54.310554 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48064) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:54.315956 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a596c293-57dd-471f-9040-a82977dc86f4 req-8cb20336-2214-435c-83da-48a26238804c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1055942 Dec 09 21:32:54.325248 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d93e7c8e-7187-43a1-ba79-624b7cfc128f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:54.325248 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d93e7c8e-7187-43a1-ba79-624b7cfc128f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:54.325522 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d93e7c8e-7187-43a1-ba79-624b7cfc128f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:54.325929 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d93e7c8e-7187-43a1-ba79-624b7cfc128f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:54.326448 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d93e7c8e-7187-43a1-ba79-624b7cfc128f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:54.327051 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d93e7c8e-7187-43a1-ba79-624b7cfc128f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:54.327690 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d93e7c8e-7187-43a1-ba79-624b7cfc128f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:54.328097 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d93e7c8e-7187-43a1-ba79-624b7cfc128f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:54.328496 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d93e7c8e-7187-43a1-ba79-624b7cfc128f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:54.328891 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d93e7c8e-7187-43a1-ba79-624b7cfc128f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:54.329574 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d93e7c8e-7187-43a1-ba79-624b7cfc128f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:54.329702 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d93e7c8e-7187-43a1-ba79-624b7cfc128f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:54.330017 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d93e7c8e-7187-43a1-ba79-624b7cfc128f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:32:54.386678 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26c87c02-fe42-45f3-91a8-ed7292845f9e tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:54.399693 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26c87c02-fe42-45f3-91a8-ed7292845f9e tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:54.423630 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f83975b-df24-43f3-874e-1fe84bdc35a5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:54.473441 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26c87c02-fe42-45f3-91a8-ed7292845f9e tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Pushing event updated for resources: {'Port': ['ID=f11a852c-a954-4a58-b530-f48ee3f2e51b,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:54.511071 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-1f83975b-df24-43f3-874e-1fe84bdc35a5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting port c4bd21a9-3876-4d72-bff0-02ce13427ccc {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:32:54.511415 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f83975b-df24-43f3-874e-1fe84bdc35a5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:54.537667 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26c87c02-fe42-45f3-91a8-ed7292845f9e tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:54.569854 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26c87c02-fe42-45f3-91a8-ed7292845f9e tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:54.570643 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-26c87c02-fe42-45f3-91a8-ed7292845f9e tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 691 time: 1.9099002 Dec 09 21:32:54.573547 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48068) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:54.580884 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d0cde46-a2a2-46dc-a18c-2cfb39b29d01 None None] DHCP port deletion for 0f00b2f0-5f6d-41d3-b316-8ad418693ba7 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:32:54.596497 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-1f83975b-df24-43f3-874e-1fe84bdc35a5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] For port c4bd21a9-3876-4d72-bff0-02ce13427ccc, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c4bd21a9-3876-4d72-bff0-02ce13427ccc,segment=NetworkSegment(6f2cd81b-b1fc-4ad6-9fbe-e99334f98aef),segment_id=6f2cd81b-b1fc-4ad6-9fbe-e99334f98aef)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:54.596873 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f83975b-df24-43f3-874e-1fe84bdc35a5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:54.610218 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-1f83975b-df24-43f3-874e-1fe84bdc35a5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Calling delete_port for c4bd21a9-3876-4d72-bff0-02ce13427ccc owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:32:54.693691 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-0d0cde46-a2a2-46dc-a18c-2cfb39b29d01 None None] Deleting port c4bd21a9-3876-4d72-bff0-02ce13427ccc {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:32:54.694188 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0d0cde46-a2a2-46dc-a18c-2cfb39b29d01 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:54.739288 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bf844005-9deb-424a-97a1-bb8edd37901c tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] 10.222.0.13 "GET /v2.0/floatingips?floating_network_id=9d59c78f-7a77-4ad7-845a-83ac2cc9789e HTTP/1.1" status: 200 len: 689 time: 0.1529195 Dec 09 21:32:54.739554 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48072) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:54.749049 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f83975b-df24-43f3-874e-1fe84bdc35a5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:54.773452 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0d0cde46-a2a2-46dc-a18c-2cfb39b29d01 None None] For port c4bd21a9-3876-4d72-bff0-02ce13427ccc, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c4bd21a9-3876-4d72-bff0-02ce13427ccc,segment=NetworkSegment(6f2cd81b-b1fc-4ad6-9fbe-e99334f98aef),segment_id=6f2cd81b-b1fc-4ad6-9fbe-e99334f98aef)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:32:54.773854 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0d0cde46-a2a2-46dc-a18c-2cfb39b29d01 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:54.788578 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-0d0cde46-a2a2-46dc-a18c-2cfb39b29d01 None None] Calling delete_port for c4bd21a9-3876-4d72-bff0-02ce13427ccc owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:32:54.799430 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f83975b-df24-43f3-874e-1fe84bdc35a5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Port': ['ID=c4bd21a9-3876-4d72-bff0-02ce13427ccc,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:54.812210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f83975b-df24-43f3-874e-1fe84bdc35a5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] No DVR routers for this DVR port c4bd21a9-3876-4d72-bff0-02ce13427ccc on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:32:54.864247 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-938e7378-fd76-4553-810a-5340851f7425 req-0147f2b4-764c-4a11-913a-3a2c19ebb3a0 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:54.872302 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-938e7378-fd76-4553-810a-5340851f7425 req-0147f2b4-764c-4a11-913a-3a2c19ebb3a0 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.1561263 Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.874527 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.877617 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.877617 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.877617 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.877617 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.877617 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.877617 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.877617 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.877617 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.877617 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.877617 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.877617 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.877617 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.877617 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:32:54.877617 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:32:54.881210 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:54.882215 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0d0cde46-a2a2-46dc-a18c-2cfb39b29d01 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:54.917282 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d0cde46-a2a2-46dc-a18c-2cfb39b29d01 None None] Pushing event deleted for resources: {'Port': ['ID=c4bd21a9-3876-4d72-bff0-02ce13427ccc,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:54.919600 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d0cde46-a2a2-46dc-a18c-2cfb39b29d01 None None] No DVR routers for this DVR port c4bd21a9-3876-4d72-bff0-02ce13427ccc on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:32:54.962001 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f83975b-df24-43f3-874e-1fe84bdc35a5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:55.005885 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-938e7378-fd76-4553-810a-5340851f7425 req-6c242e54-58b5-4c70-93ab-0545e6b38922 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1291933 Dec 09 21:32:55.028881 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-1f83975b-df24-43f3-874e-1fe84bdc35a5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0f00b2f0-5f6d-41d3-b316-8ad418693ba7']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:55.046637 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-1f83975b-df24-43f3-874e-1fe84bdc35a5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6f2cd81b-b1fc-4ad6-9fbe-e99334f98aef') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:55.046637 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-1f83975b-df24-43f3-874e-1fe84bdc35a5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6f2cd81b-b1fc-4ad6-9fbe-e99334f98aef') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:55.065942 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f83975b-df24-43f3-874e-1fe84bdc35a5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:55.081995 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f83975b-df24-43f3-874e-1fe84bdc35a5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:55.088955 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Deleting port f11a852c-a954-4a58-b530-f48ee3f2e51b {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:32:55.089886 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:55.119672 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1f83975b-df24-43f3-874e-1fe84bdc35a5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Releasing vlan 135 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:32:55.119987 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f83975b-df24-43f3-874e-1fe84bdc35a5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:32:55.125502 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:32:55.207378 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:55.207636 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:55.235496 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Calling delete_port for f11a852c-a954-4a58-b530-f48ee3f2e51b owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:32:55.249028 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7310d17b-6136-4ddc-946a-b5dcda513adc req-40663aac-5aa4-48e3-907a-7b0d45f78620 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:55.250243 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7310d17b-6136-4ddc-946a-b5dcda513adc req-40663aac-5aa4-48e3-907a-7b0d45f78620 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 947 time: 0.0610714 Dec 09 21:32:55.251473 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f83975b-df24-43f3-874e-1fe84bdc35a5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:55.261252 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f83975b-df24-43f3-874e-1fe84bdc35a5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:55.268771 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1f83975b-df24-43f3-874e-1fe84bdc35a5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/networks/0f00b2f0-5f6d-41d3-b316-8ad418693ba7 HTTP/1.1" status: 204 len: 168 time: 0.9529431 Dec 09 21:32:55.269217 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48080) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:55.290870 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-722dcff0-4804-4a0f-9ed1-e6f870861d5a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-1679291539', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:55.333706 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-722dcff0-4804-4a0f-9ed1-e6f870861d5a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:55.334952 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-722dcff0-4804-4a0f-9ed1-e6f870861d5a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:55.345362 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f83975b-df24-43f3-874e-1fe84bdc35a5 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Network': ['ID=0f00b2f0-5f6d-41d3-b316-8ad418693ba7,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:55.384023 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7310d17b-6136-4ddc-946a-b5dcda513adc req-11a00b4c-3e48-4ddd-b109-6ca7ddd6ab36 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1195652 Dec 09 21:32:55.431250 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c4bd21a9-3876-4d72-bff0-02ce13427ccc no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:32:55.465459 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-722dcff0-4804-4a0f-9ed1-e6f870861d5a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:55.471771 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: c4bd21a9-3876-4d72-bff0-02ce13427ccc {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:32:55.472113 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c4bd21a9-3876-4d72-bff0-02ce13427ccc not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:32:55.479243 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-722dcff0-4804-4a0f-9ed1-e6f870861d5a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:55.509620 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:55.520925 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-722dcff0-4804-4a0f-9ed1-e6f870861d5a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:55.525985 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-722dcff0-4804-4a0f-9ed1-e6f870861d5a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.2387106 Dec 09 21:32:55.526587 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48084) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:55.533852 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-4b856543-90c1-488f-8a28-6cdb3bd19d45 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-2035198130'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:55.546068 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbfdf9cc-a6ed-4875-960d-59ace9aec780 req-33ef654a-3b99-4ddc-96c5-5d41df86f6f6 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:55.547641 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fbfdf9cc-a6ed-4875-960d-59ace9aec780 req-33ef654a-3b99-4ddc-96c5-5d41df86f6f6 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.0810890 Dec 09 21:32:55.557775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Pushing event deleted for resources: {'Port': ['ID=f11a852c-a954-4a58-b530-f48ee3f2e51b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:55.612031 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4b856543-90c1-488f-8a28-6cdb3bd19d45 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Made reservation on behalf of dc5c46f00552473abc0991c0cc4a0269 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:32:55.615135 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4b856543-90c1-488f-8a28-6cdb3bd19d45 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:55.626175 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:55.654826 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fbfdf9cc-a6ed-4875-960d-59ace9aec780 req-ae896069-9550-4166-bfa0-80f87ca7685c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0999811 Dec 09 21:32:55.661576 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4b856543-90c1-488f-8a28-6cdb3bd19d45 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] vlan segment allocate from pool success with {'vlan_id': 138, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:32:55.674508 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4b856543-90c1-488f-8a28-6cdb3bd19d45 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:55.674949 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-4b856543-90c1-488f-8a28-6cdb3bd19d45 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Added segment 4b275028-ecbe-4b74-8672-2d6a06274136 of type vlan for network 15534a3e-17df-4709-b8b9-bb36601767d2 Dec 09 21:32:55.733793 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:55.752859 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4b856543-90c1-488f-8a28-6cdb3bd19d45 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:55.817226 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:55.833209 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4b856543-90c1-488f-8a28-6cdb3bd19d45 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:55.839867 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4b856543-90c1-488f-8a28-6cdb3bd19d45 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:55.840112 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4b856543-90c1-488f-8a28-6cdb3bd19d45 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:55.863152 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=0568fe2e-ac02-4c0b-8777-51466f1803ff,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:55.903078 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4b856543-90c1-488f-8a28-6cdb3bd19d45 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.3737578 Dec 09 21:32:55.906854 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48090) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:55.936399 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-55fb5e9c-4442-4956-b97e-4f6210d54be7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'subnet': {'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:55.941094 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:55.952210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b856543-90c1-488f-8a28-6cdb3bd19d45 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Network': ['ID=15534a3e-17df-4709-b8b9-bb36601767d2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:55.964363 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 15534a3e-17df-4709-b8b9-bb36601767d2 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:32:55.993622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4359dafa-6588-44c6-8a2a-2a94e005c21c req-e3150251-1176-440a-9601-2428c334d639 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:55.998390 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4359dafa-6588-44c6-8a2a-2a94e005c21c req-e3150251-1176-440a-9601-2428c334d639 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.1838844 Dec 09 21:32:56.003313 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9d59c78f-7a77-4ad7-845a-83ac2cc9789e']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:56.008584 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48094) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:56.047113 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-3afed400-4ed9-4228-bf93-f7d9d2d968d1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Request body: {'floatingip': {'port_id': '851ff09f-496e-47bd-85bb-2e21622a44e9'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:56.108493 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3afed400-4ed9-4228-bf93-f7d9d2d968d1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for floatingip, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:56.113054 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '190cad56-7fd1-41ad-bc7e-fa30f8553e64') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:56.113352 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '190cad56-7fd1-41ad-bc7e-fa30f8553e64') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:56.194776 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:56.222669 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0794cd17-6662-42bb-a7ee-ebf78cb19d17 req-5af3493a-8e0d-41dc-af9a-8c0ed869b3b0 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:56.235605 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0794cd17-6662-42bb-a7ee-ebf78cb19d17 req-5af3493a-8e0d-41dc-af9a-8c0ed869b3b0 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.0954535 Dec 09 21:32:56.264147 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:56.299662 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0794cd17-6662-42bb-a7ee-ebf78cb19d17 req-a59bf058-377d-42ee-8aa7-e695c9bb8a48 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0673649 Dec 09 21:32:56.317757 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Releasing vlan 105 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:32:56.318181 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:32:56.320413 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:32:56.346504 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-55fb5e9c-4442-4956-b97e-4f6210d54be7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Made reservation on behalf of dc5c46f00552473abc0991c0cc4a0269 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:32:56.350110 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-55fb5e9c-4442-4956-b97e-4f6210d54be7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:56.538383 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:56.540372 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bba4454-89ef-4bad-85c7-d61edeaa1acf req-4fadb4f6-c4ce-47d1-ab03-c10f5a6810d9 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:56.552938 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8bba4454-89ef-4bad-85c7-d61edeaa1acf req-4fadb4f6-c4ce-47d1-ab03-c10f5a6810d9 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 947 time: 0.0841327 Dec 09 21:32:56.566951 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 9d59c78f-7a77-4ad7-845a-83ac2cc9789e {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Dec 09 21:32:56.598719 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Pushing event deleted for resources: {'Network': ['ID=9d59c78f-7a77-4ad7-845a-83ac2cc9789e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:56.601695 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:56.605177 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-117f23a7-df1a-4a6d-a8d9-fc2877c89122 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] 10.222.0.13 "DELETE /v2.0/networks/9d59c78f-7a77-4ad7-845a-83ac2cc9789e HTTP/1.1" status: 204 len: 168 time: 1.8646686 Dec 09 21:32:56.609403 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48106) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:56.760450 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-efe0d75d-0dce-4a0a-9b48-b6f180125040 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] 10.222.0.13 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 3836 time: 0.1498408 Dec 09 21:32:56.780402 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8bba4454-89ef-4bad-85c7-d61edeaa1acf req-875585b4-098f-4995-ab99-848c13122179 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2268498 Dec 09 21:32:56.780926 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48108) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:56.917811 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-55fb5e9c-4442-4956-b97e-4f6210d54be7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:56.963625 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a736264-224c-42c2-bf9f-7f805ffaa9f3 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:56.964316 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a736264-224c-42c2-bf9f-7f805ffaa9f3 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:56.964914 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a736264-224c-42c2-bf9f-7f805ffaa9f3 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:56.965565 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a736264-224c-42c2-bf9f-7f805ffaa9f3 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:56.966161 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a736264-224c-42c2-bf9f-7f805ffaa9f3 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:56.967098 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a736264-224c-42c2-bf9f-7f805ffaa9f3 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:56.967858 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a736264-224c-42c2-bf9f-7f805ffaa9f3 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:56.968453 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a736264-224c-42c2-bf9f-7f805ffaa9f3 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:56.969087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a736264-224c-42c2-bf9f-7f805ffaa9f3 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:56.969766 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a736264-224c-42c2-bf9f-7f805ffaa9f3 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:56.970381 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a736264-224c-42c2-bf9f-7f805ffaa9f3 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:56.970972 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a736264-224c-42c2-bf9f-7f805ffaa9f3 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:56.971664 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a736264-224c-42c2-bf9f-7f805ffaa9f3 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:56.972253 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a736264-224c-42c2-bf9f-7f805ffaa9f3 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:56.972838 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a736264-224c-42c2-bf9f-7f805ffaa9f3 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:56.975175 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0a736264-224c-42c2-bf9f-7f805ffaa9f3 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 9573 time: 0.1932924 Dec 09 21:32:56.978466 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48112) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:57.210919 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:57.229392 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:57.394318 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-a9df1843-720a-4c8e-b3a1-6fee1a63ef15 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] delete failed (client error): The resource could not be found. Dec 09 21:32:57.395378 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a9df1843-720a-4c8e-b3a1-6fee1a63ef15 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] 10.222.0.13 "DELETE /v2.0/floatingips/ed4694e2-b72c-48a1-96ee-58450b949077 HTTP/1.1" status: 404 len: 345 time: 0.4152288 Dec 09 21:32:57.398525 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48120) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:57.441154 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-d1922656-7e8c-4935-a3a5-e7295583f497 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] DELETE failed (client error): The resource could not be found. Dec 09 21:32:57.441981 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d1922656-7e8c-4935-a3a5-e7295583f497 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:32:57.445512 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d1922656-7e8c-4935-a3a5-e7295583f497 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] 10.222.0.13 "DELETE /v2.0/networks/9d59c78f-7a77-4ad7-845a-83ac2cc9789e HTTP/1.1" status: 404 len: 339 time: 0.0457420 Dec 09 21:32:57.473760 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48122) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:57.483902 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55fb5e9c-4442-4956-b97e-4f6210d54be7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Subnet': ['ID=338e8b5b-b539-4af6-8f24-440432e46946,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:57.486519 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-15d183d4-d673-4f78-b9be-195cc3bff237 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Request body: {'network': {'name': 'tempest-network--1079002950', 'router:external': True}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:32:57.507336 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55fb5e9c-4442-4956-b97e-4f6210d54be7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Checking segment: {'id': '4b275028-ecbe-4b74-8672-2d6a06274136', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:32:57.507735 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55fb5e9c-4442-4956-b97e-4f6210d54be7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network hostable DHCP agents. Network: 15534a3e-17df-4709-b8b9-bb36601767d2, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:32:57.524823 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44904750-53e4-43c8-a402-b25892819785 req-0f0b31df-688e-47f7-a229-c1fb3a1b3a5d tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:57.536816 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44904750-53e4-43c8-a402-b25892819785 req-0f0b31df-688e-47f7-a229-c1fb3a1b3a5d tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.1290479 Dec 09 21:32:57.574561 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-15d183d4-d673-4f78-b9be-195cc3bff237 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Made reservation on behalf of 0607cac1ba1e46c59a3758dd59e93d9d for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:32:57.578409 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-15d183d4-d673-4f78-b9be-195cc3bff237 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:57.580174 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55fb5e9c-4442-4956-b97e-4f6210d54be7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network 15534a3e-17df-4709-b8b9-bb36601767d2 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:32:57.619281 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-55fb5e9c-4442-4956-b97e-4f6210d54be7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 15534a3e-17df-4709-b8b9-bb36601767d2) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:32:57.624235 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-55fb5e9c-4442-4956-b97e-4f6210d54be7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:57.624826 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-55fb5e9c-4442-4956-b97e-4f6210d54be7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:57.630384 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6fe80c5d-b7f6-4e4a-bf62-fdedb44385f1 None None] Network 15534a3e-17df-4709-b8b9-bb36601767d2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:32:57.641690 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-15d183d4-d673-4f78-b9be-195cc3bff237 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] vlan segment allocate from pool success with {'vlan_id': 119, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:32:57.668687 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44904750-53e4-43c8-a402-b25892819785 req-bb46781b-fd46-4043-8c9e-20f11fd1dbb2 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1302381 Dec 09 21:32:57.683172 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-15d183d4-d673-4f78-b9be-195cc3bff237 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:57.684469 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-15d183d4-d673-4f78-b9be-195cc3bff237 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Added segment 0822b99f-ec35-44db-bd39-eeb1e6cf74fd of type vlan for network 35115fdb-f527-4c66-b0f7-3af2ab9f1403 Dec 09 21:32:57.714261 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-55fb5e9c-4442-4956-b97e-4f6210d54be7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.7804055 Dec 09 21:32:57.714901 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.db.resource_extend [None req-3afed400-4ed9-4228-bf93-f7d9d2d968d1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] It took 0.15 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 09 21:32:57.721490 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48124) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:57.819356 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3afed400-4ed9-4228-bf93-f7d9d2d968d1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:57.829939 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3afed400-4ed9-4228-bf93-f7d9d2d968d1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:57.836946 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9bdc01cf-6cc8-47c3-bb81-40a2437ca73f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-15534a3e-17df-4709-b8b9-bb36601767d2', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:32:57.843670 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9bdc01cf-6cc8-47c3-bb81-40a2437ca73f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:57.856618 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-15d183d4-d673-4f78-b9be-195cc3bff237 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:57.987271 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-3afed400-4ed9-4228-bf93-f7d9d2d968d1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Floating IP 71dddf51-6f7c-44b1-bcba-7f63f5b97a35 associated. External IP: 172.25.3.162, port: 851ff09f-496e-47bd-85bb-2e21622a44e9. Dec 09 21:32:58.048393 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.db.resource_extend [None req-15d183d4-d673-4f78-b9be-195cc3bff237 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] It took 0.17 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 09 21:32:58.053465 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-9bdc01cf-6cc8-47c3-bb81-40a2437ca73f None None] Allocated IP 2001:db8::2 (15534a3e-17df-4709-b8b9-bb36601767d2/338e8b5b-b539-4af6-8f24-440432e46946/97d80315-bb4a-4dac-ba42-dd827bbb3844) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:32:58.156188 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9588afec-2b40-4e22-861d-3739421acad9 req-cc353b2c-7383-4926-bffc-5901d7afce33 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:58.157775 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9588afec-2b40-4e22-861d-3739421acad9 req-cc353b2c-7383-4926-bffc-5901d7afce33 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 947 time: 0.1692502 Dec 09 21:32:58.163327 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-15d183d4-d673-4f78-b9be-195cc3bff237 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:58.164503 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-15d183d4-d673-4f78-b9be-195cc3bff237 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:58.165068 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-15d183d4-d673-4f78-b9be-195cc3bff237 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:58.322412 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9bdc01cf-6cc8-47c3-bb81-40a2437ca73f None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:58.335567 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9bdc01cf-6cc8-47c3-bb81-40a2437ca73f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:58.350827 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3afed400-4ed9-4228-bf93-f7d9d2d968d1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Router 8f39d25d-26dd-4bce-b961-53cba1551e5d has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:32:58.389601 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bdc01cf-6cc8-47c3-bb81-40a2437ca73f None None] Pushing event updated for resources: {'Port': ['ID=97d80315-bb4a-4dac-ba42-dd827bbb3844,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:58.422814 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9bdc01cf-6cc8-47c3-bb81-40a2437ca73f None None] Network 15534a3e-17df-4709-b8b9-bb36601767d2 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:32:58.424641 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-9bdc01cf-6cc8-47c3-bb81-40a2437ca73f None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:32:58.431522 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9bdc01cf-6cc8-47c3-bb81-40a2437ca73f None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:32:58.505462 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-9bdc01cf-6cc8-47c3-bb81-40a2437ca73f None None] Attempting to bind port 97d80315-bb4a-4dac-ba42-dd827bbb3844 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:32:58.505874 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-9bdc01cf-6cc8-47c3-bb81-40a2437ca73f None None] Attempting to bind port 97d80315-bb4a-4dac-ba42-dd827bbb3844 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '4b275028-ecbe-4b74-8672-2d6a06274136', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:32:58.506243 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9bdc01cf-6cc8-47c3-bb81-40a2437ca73f None None] Attempting to bind port 97d80315-bb4a-4dac-ba42-dd827bbb3844 on network 15534a3e-17df-4709-b8b9-bb36601767d2 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:32:58.513909 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9bdc01cf-6cc8-47c3-bb81-40a2437ca73f None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 32, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:32:58.513909 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9bdc01cf-6cc8-47c3-bb81-40a2437ca73f None None] Checking segment: {'id': '4b275028-ecbe-4b74-8672-2d6a06274136', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:32:58.513909 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9bdc01cf-6cc8-47c3-bb81-40a2437ca73f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:58.514352 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9bdc01cf-6cc8-47c3-bb81-40a2437ca73f None None] Bound using segment: {'id': '4b275028-ecbe-4b74-8672-2d6a06274136', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:32:58.514454 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-9bdc01cf-6cc8-47c3-bb81-40a2437ca73f None None] Bound port: 97d80315-bb4a-4dac-ba42-dd827bbb3844, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4b275028-ecbe-4b74-8672-2d6a06274136', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:32:58.514813 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9bdc01cf-6cc8-47c3-bb81-40a2437ca73f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:58.527329 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3afed400-4ed9-4228-bf93-f7d9d2d968d1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:32:58.534028 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3afed400-4ed9-4228-bf93-f7d9d2d968d1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:58.538198 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-106f5163-64d2-4b05-bcb9-4b3e80e3bc42 None None] Sync routers for ids ['8f39d25d-26dd-4bce-b961-53cba1551e5d'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:32:58.553823 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-106f5163-64d2-4b05-bcb9-4b3e80e3bc42 None None] Routers {'8f39d25d-26dd-4bce-b961-53cba1551e5d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:32:58.554989 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-106f5163-64d2-4b05-bcb9-4b3e80e3bc42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:32:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['8f39d25d-26dd-4bce-b961-53cba1551e5d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:58.567129 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3afed400-4ed9-4228-bf93-f7d9d2d968d1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "PUT /v2.0/floatingips/71dddf51-6f7c-44b1-bcba-7f63f5b97a35 HTTP/1.1" status: 200 len: 991 time: 2.5578344 Dec 09 21:32:58.569924 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '91b064ae-1ca1-44d4-a549-a25cccd0c81b', 'tag': '851ff09f-496e-47bd-85bb-2e21622a44e9'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:32:58.573929 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-faf35347-0ddb-4493-81e9-0c96dc977daf" -d '{"events": [{"name": "network-changed", "server_uuid": "91b064ae-1ca1-44d4-a549-a25cccd0c81b", "tag": "851ff09f-496e-47bd-85bb-2e21622a44e9"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:32:58.599273 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-9bdc01cf-6cc8-47c3-bb81-40a2437ca73f None None] For port 97d80315-bb4a-4dac-ba42-dd827bbb3844, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:32:58.602936 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-9bdc01cf-6cc8-47c3-bb81-40a2437ca73f None None] For port 97d80315-bb4a-4dac-ba42-dd827bbb3844, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=97d80315-bb4a-4dac-ba42-dd827bbb3844,segment=NetworkSegment(4b275028-ecbe-4b74-8672-2d6a06274136),segment_id=4b275028-ecbe-4b74-8672-2d6a06274136)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:32:58.613668 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9bdc01cf-6cc8-47c3-bb81-40a2437ca73f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:58.712141 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bdc01cf-6cc8-47c3-bb81-40a2437ca73f None None] Pushing event updated for resources: {'Port': ['ID=97d80315-bb4a-4dac-ba42-dd827bbb3844,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:58.783883 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-15d183d4-d673-4f78-b9be-195cc3bff237 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 863 time: 1.3016820 Dec 09 21:32:58.786693 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48142) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:58.798887 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15d183d4-d673-4f78-b9be-195cc3bff237 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Pushing event updated for resources: {'Network': ['ID=35115fdb-f527-4c66-b0f7-3af2ab9f1403,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:32:58.812699 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 35115fdb-f527-4c66-b0f7-3af2ab9f1403 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:32:58.848228 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0bcbe3c5-c37c-40b6-b989-78d133ec92be tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:58.862171 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-106f5163-64d2-4b05-bcb9-4b3e80e3bc42 None None] Set router 8f39d25d-26dd-4bce-b961-53cba1551e5d gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:32:58.895300 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9588afec-2b40-4e22-861d-3739421acad9 req-c43d1e3b-18ec-42be-aad8-a113a67e216a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.7193594 Dec 09 21:32:59.145024 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:32:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8a9d9f31-a85c-460c-98b6-f2a2cb08656e x-openstack-request-id: req-8a9d9f31-a85c-460c-98b6-f2a2cb08656e {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:32:59.145483 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "91b064ae-1ca1-44d4-a549-a25cccd0c81b", "tag": "851ff09f-496e-47bd-85bb-2e21622a44e9", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:32:59.145596 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8a9d9f31-a85c-460c-98b6-f2a2cb08656e {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:32:59.146023 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '91b064ae-1ca1-44d4-a549-a25cccd0c81b', 'tag': '851ff09f-496e-47bd-85bb-2e21622a44e9', 'status': 'completed', 'code': 200} Dec 09 21:32:59.211363 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d806265a-8618-4952-bddb-0e8ac50cab59 tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:59.225779 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d806265a-8618-4952-bddb-0e8ac50cab59 tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:59.260770 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d806265a-8618-4952-bddb-0e8ac50cab59 tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:59.272284 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d806265a-8618-4952-bddb-0e8ac50cab59 tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:59.280060 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d806265a-8618-4952-bddb-0e8ac50cab59 tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] 10.222.0.13 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2453 time: 0.4915931 Dec 09 21:32:59.281032 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48148) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:32:59.413855 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cae9d87-04d5-4124-8685-63e35b793ebe req-755aa582-a66a-4992-b437-05c252b21a77 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:59.427956 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8cae9d87-04d5-4124-8685-63e35b793ebe req-755aa582-a66a-4992-b437-05c252b21a77 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.2579932 Dec 09 21:32:59.446925 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faf35347-0ddb-4493-81e9-0c96dc977daf req-303790f5-ba0b-4a87-89cd-8f94dae911a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:59.448594 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-faf35347-0ddb-4493-81e9-0c96dc977daf req-303790f5-ba0b-4a87-89cd-8f94dae911a4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=29f2c1d9be9348b0888bc61ed37ed957&device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 1097 time: 0.2947471 Dec 09 21:32:59.536990 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-14ebbbc5-5dd6-499f-a82b-3d6ec07b7adb tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:59.562788 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 97d80315-bb4a-4dac-ba42-dd827bbb3844 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:32:59.567848 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-106f5163-64d2-4b05-bcb9-4b3e80e3bc42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'name': 'tempest-AttachVolumeShelveTestJSON-236206179-router', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203'}], 'enable_snat': True}, 'gw_port_id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:14Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'gw_port': {'id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:4c:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1175, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:15Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '71dddf51-6f7c-44b1-bcba-7f63f5b97a35', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'floating_ip_address': '172.25.3.162', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'port_id': '851ff09f-496e-47bd-85bb-2e21622a44e9', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1622, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'mac_address': 'fa:16:3e:bb:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91b064ae-1ca1-44d4-a549-a25cccd0c81b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:32:37Z', 'updated_at': '2021-12-09T21:32:57Z', 'revision_number': 1, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a9a5d2ec-b408-4729-99d3-0e4f8f041e60', 'name': '', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'mac_address': 'fa:16:3e:40:0d:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1178, 'fixed_ips': [{'subnet_id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:19Z', 'updated_at': '2021-12-09T21:28:25Z', 'revision_number': 5, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'subnets': [{'id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:59.645507 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-106f5163-64d2-4b05-bcb9-4b3e80e3bc42 None None] Checking router: 8f39d25d-26dd-4bce-b961-53cba1551e5d for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:32:59.668806 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-106f5163-64d2-4b05-bcb9-4b3e80e3bc42 None None] Routers {'8f39d25d-26dd-4bce-b961-53cba1551e5d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:32:59.670375 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-106f5163-64d2-4b05-bcb9-4b3e80e3bc42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:32:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['8f39d25d-26dd-4bce-b961-53cba1551e5d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:32:59.699745 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8cae9d87-04d5-4124-8685-63e35b793ebe req-9b3fab6d-1666-4ff2-876b-b97f6bfa14e5 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2653329 Dec 09 21:32:59.744115 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 97d80315-bb4a-4dac-ba42-dd827bbb3844 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:32:59.744460 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:59.859348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faf35347-0ddb-4493-81e9-0c96dc977daf req-dc41edd7-f4e5-4b62-9521-70e0d4bcd708 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:32:59.872499 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-faf35347-0ddb-4493-81e9-0c96dc977daf req-dc41edd7-f4e5-4b62-9521-70e0d4bcd708 service neutron] 10.222.0.31 "GET /v2.0/networks?id=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 HTTP/1.1" status: 200 len: 917 time: 0.4083104 Dec 09 21:32:59.879561 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-14ebbbc5-5dd6-499f-a82b-3d6ec07b7adb tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:59.888507 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-0bcbe3c5-c37c-40b6-b989-78d133ec92be tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Allocated IP 2001:db8::1 (15534a3e-17df-4709-b8b9-bb36601767d2/338e8b5b-b539-4af6-8f24-440432e46946/273536ab-ff56-4654-99d5-8fcf6bc80df2) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:32:59.963699 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:32:59.981691 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-106f5163-64d2-4b05-bcb9-4b3e80e3bc42 None None] Set router 8f39d25d-26dd-4bce-b961-53cba1551e5d gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:00.016476 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-14ebbbc5-5dd6-499f-a82b-3d6ec07b7adb tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['35115fdb-f527-4c66-b0f7-3af2ab9f1403']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:00.038048 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-14ebbbc5-5dd6-499f-a82b-3d6ec07b7adb tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0822b99f-ec35-44db-bd39-eeb1e6cf74fd') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:00.041276 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-14ebbbc5-5dd6-499f-a82b-3d6ec07b7adb tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0822b99f-ec35-44db-bd39-eeb1e6cf74fd') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:00.044448 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 97d80315-bb4a-4dac-ba42-dd827bbb3844, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=97d80315-bb4a-4dac-ba42-dd827bbb3844,segment=NetworkSegment(4b275028-ecbe-4b74-8672-2d6a06274136),segment_id=4b275028-ecbe-4b74-8672-2d6a06274136)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:00.056983 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:00.064430 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-14ebbbc5-5dd6-499f-a82b-3d6ec07b7adb tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:00.079736 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-faf35347-0ddb-4493-81e9-0c96dc977daf req-6e7998be-d02f-47f9-a332-d2320a2e1123 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=851ff09f-496e-47bd-85bb-2e21622a44e9 HTTP/1.1" status: 200 len: 999 time: 0.1827438 Dec 09 21:33:00.086163 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-14ebbbc5-5dd6-499f-a82b-3d6ec07b7adb tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:00.146239 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faf35347-0ddb-4493-81e9-0c96dc977daf req-51cb3413-3d45-4200-b17d-c83aa9c4f154 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:00.155103 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-faf35347-0ddb-4493-81e9-0c96dc977daf req-51cb3413-3d45-4200-b17d-c83aa9c4f154 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ace82e8b-012a-4184-a81e-5303eecf12ff HTTP/1.1" status: 200 len: 855 time: 0.0660167 Dec 09 21:33:00.160326 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-14ebbbc5-5dd6-499f-a82b-3d6ec07b7adb tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Releasing vlan 119 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:33:00.160740 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-14ebbbc5-5dd6-499f-a82b-3d6ec07b7adb tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:33:00.162537 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:33:00.178518 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=97d80315-bb4a-4dac-ba42-dd827bbb3844,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:00.269625 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dadef0a-515a-4dcb-812e-f22c4a32972c req-060fe29d-dbb2-4d9f-a509-b7acb4881e2a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:00.274592 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4dadef0a-515a-4dcb-812e-f22c4a32972c req-060fe29d-dbb2-4d9f-a509-b7acb4881e2a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 947 time: 0.1865792 Dec 09 21:33:00.345169 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faf35347-0ddb-4493-81e9-0c96dc977daf req-619f6ace-0031-4e2e-abd2-35d355e52e7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:00.348336 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-faf35347-0ddb-4493-81e9-0c96dc977daf req-619f6ace-0031-4e2e-abd2-35d355e52e7a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1847701 Dec 09 21:33:00.350028 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-14ebbbc5-5dd6-499f-a82b-3d6ec07b7adb tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:00.356792 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-14ebbbc5-5dd6-499f-a82b-3d6ec07b7adb tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 35115fdb-f527-4c66-b0f7-3af2ab9f1403 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Dec 09 21:33:00.370065 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-14ebbbc5-5dd6-499f-a82b-3d6ec07b7adb tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:00.384535 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bed39d2-d9b3-462c-9b07-2b80ad829e1f req-9a6bb81c-126f-4d30-bb65-2ef1be03a28d tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:00.386362 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5bed39d2-d9b3-462c-9b07-2b80ad829e1f req-9a6bb81c-126f-4d30-bb65-2ef1be03a28d tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.3992603 Dec 09 21:33:00.386998 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48164) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:00.387640 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-14ebbbc5-5dd6-499f-a82b-3d6ec07b7adb tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] 10.222.0.13 "DELETE /v2.0/networks/35115fdb-f527-4c66-b0f7-3af2ab9f1403 HTTP/1.1" status: 204 len: 168 time: 1.1043448 Dec 09 21:33:00.412932 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-d056ab10-043a-48d9-80c7-e47ac1a7f783 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Request body: {'network': {'name': 'tempest-network--1700411122', 'router:external': True}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:00.416515 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14ebbbc5-5dd6-499f-a82b-3d6ec07b7adb tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Pushing event deleted for resources: {'Network': ['ID=35115fdb-f527-4c66-b0f7-3af2ab9f1403,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:00.456221 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-106f5163-64d2-4b05-bcb9-4b3e80e3bc42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'name': 'tempest-AttachVolumeShelveTestJSON-236206179-router', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203'}], 'enable_snat': True}, 'gw_port_id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:14Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'gw_port': {'id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:4c:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1175, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:15Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '71dddf51-6f7c-44b1-bcba-7f63f5b97a35', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'floating_ip_address': '172.25.3.162', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'port_id': '851ff09f-496e-47bd-85bb-2e21622a44e9', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1622, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'mac_address': 'fa:16:3e:bb:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91b064ae-1ca1-44d4-a549-a25cccd0c81b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:32:37Z', 'updated_at': '2021-12-09T21:32:57Z', 'revision_number': 1, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a9a5d2ec-b408-4729-99d3-0e4f8f041e60', 'name': '', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'mac_address': 'fa:16:3e:40:0d:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1178, 'fixed_ips': [{'subnet_id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:19Z', 'updated_at': '2021-12-09T21:28:25Z', 'revision_number': 5, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'subnets': [{'id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:00.510716 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-106f5163-64d2-4b05-bcb9-4b3e80e3bc42 None None] The sync data for ids ['8f39d25d-26dd-4bce-b961-53cba1551e5d'] in n-d-713301-27 is: [{'id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'name': 'tempest-AttachVolumeShelveTestJSON-236206179-router', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203'}], 'enable_snat': True}, 'gw_port_id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:14Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'gw_port': {'id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:4c:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1175, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:15Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '71dddf51-6f7c-44b1-bcba-7f63f5b97a35', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'floating_ip_address': '172.25.3.162', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'port_id': '851ff09f-496e-47bd-85bb-2e21622a44e9', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 1622, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'mac_address': 'fa:16:3e:bb:5d:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91b064ae-1ca1-44d4-a549-a25cccd0c81b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:32:37Z', 'updated_at': '2021-12-09T21:32:57Z', 'revision_number': 1, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a9a5d2ec-b408-4729-99d3-0e4f8f041e60', 'name': '', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'mac_address': 'fa:16:3e:40:0d:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1178, 'fixed_ips': [{'subnet_id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:19Z', 'updated_at': '2021-12-09T21:28:25Z', 'revision_number': 5, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'subnets': [{'id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:33:00.524704 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-faf35347-0ddb-4493-81e9-0c96dc977daf req-8b80939b-1004-47da-84b5-e5296b1411f2 service neutron] 10.222.0.31 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1655338 Dec 09 21:33:00.581214 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0bcbe3c5-c37c-40b6-b989-78d133ec92be tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:00.628671 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ec97fa65-bb03-4c7b-9c90-24de96b5cc74 None None] Network 15534a3e-17df-4709-b8b9-bb36601767d2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:33:00.653726 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4dadef0a-515a-4dcb-812e-f22c4a32972c req-f8e18dbc-c0ad-45f3-88bc-fffed7e04bbe tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3606989 Dec 09 21:33:00.670511 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0bcbe3c5-c37c-40b6-b989-78d133ec92be tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:00.693939 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d056ab10-043a-48d9-80c7-e47ac1a7f783 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Made reservation on behalf of 0607cac1ba1e46c59a3758dd59e93d9d for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:33:00.696695 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-faf35347-0ddb-4493-81e9-0c96dc977daf req-cf151923-efaa-48da-b62c-cad37e77a0d3 service neutron] 10.222.0.31 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1602564 Dec 09 21:33:00.705275 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d056ab10-043a-48d9-80c7-e47ac1a7f783 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:00.786943 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8c6703f3-4403-4c67-92fe-d681c447a7bb None None] Provisioning complete for port 97d80315-bb4a-4dac-ba42-dd827bbb3844 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:00.787575 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8c6703f3-4403-4c67-92fe-d681c447a7bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:00.859921 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bcbe3c5-c37c-40b6-b989-78d133ec92be tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Port': ['ID=273536ab-ff56-4654-99d5-8fcf6bc80df2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:00.888722 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0bcbe3c5-c37c-40b6-b989-78d133ec92be tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network 15534a3e-17df-4709-b8b9-bb36601767d2 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:33:00.909563 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-0bcbe3c5-c37c-40b6-b989-78d133ec92be tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:00.914859 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0bcbe3c5-c37c-40b6-b989-78d133ec92be tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:33:00.915567 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0bcbe3c5-c37c-40b6-b989-78d133ec92be tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:00.926126 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5bed39d2-d9b3-462c-9b07-2b80ad829e1f req-48e77e12-43a2-4319-b423-976c1d54285d tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4989860 Dec 09 21:33:01.057737 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d056ab10-043a-48d9-80c7-e47ac1a7f783 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] vlan segment allocate from pool success with {'vlan_id': 101, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:33:01.136239 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d056ab10-043a-48d9-80c7-e47ac1a7f783 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:01.136836 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-d056ab10-043a-48d9-80c7-e47ac1a7f783 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Added segment b7e171bb-d10b-42cc-9fc0-c74718c95be8 of type vlan for network 303dcf31-5985-414f-86a6-a4f2e180d93c Dec 09 21:33:01.196226 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d91e1ba-816e-4edb-8d46-a7c9d44ec989 req-51306be6-2f95-4541-a2c9-238b1ca1a269 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:01.203774 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7d91e1ba-816e-4edb-8d46-a7c9d44ec989 req-51306be6-2f95-4541-a2c9-238b1ca1a269 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.1658142 Dec 09 21:33:01.283416 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e297506b-81bd-422b-adcf-6b9bcef28c70 None None] Provisioning complete for port 273536ab-ff56-4654-99d5-8fcf6bc80df2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:01.284010 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e297506b-81bd-422b-adcf-6b9bcef28c70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:01.290406 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d056ab10-043a-48d9-80c7-e47ac1a7f783 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:01.379317 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7d91e1ba-816e-4edb-8d46-a7c9d44ec989 req-9ba1891b-4b50-4f9e-90c0-14bd3863bcd6 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1745305 Dec 09 21:33:01.380229 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0bcbe3c5-c37c-40b6-b989-78d133ec92be tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:01.380767 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e297506b-81bd-422b-adcf-6b9bcef28c70 None None] Port 273536ab-ff56-4654-99d5-8fcf6bc80df2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:33:01.392483 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d056ab10-043a-48d9-80c7-e47ac1a7f783 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:01.393641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d056ab10-043a-48d9-80c7-e47ac1a7f783 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:01.394255 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d056ab10-043a-48d9-80c7-e47ac1a7f783 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:01.402747 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e297506b-81bd-422b-adcf-6b9bcef28c70 None None] Provisioning complete for port 97d80315-bb4a-4dac-ba42-dd827bbb3844 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:01.405569 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e297506b-81bd-422b-adcf-6b9bcef28c70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:01.444930 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 97d80315-bb4a-4dac-ba42-dd827bbb3844 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:33:01.544462 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d056ab10-043a-48d9-80c7-e47ac1a7f783 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Pushing event updated for resources: {'Network': ['ID=303dcf31-5985-414f-86a6-a4f2e180d93c,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:01.564547 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48172) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:01.566869 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 303dcf31-5985-414f-86a6-a4f2e180d93c details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:33:01.572695 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 97d80315-bb4a-4dac-ba42-dd827bbb3844 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:01.573272 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:01.574043 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d056ab10-043a-48d9-80c7-e47ac1a7f783 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 863 time: 1.1649728 Dec 09 21:33:01.712598 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd5d56b8-b59f-4471-a2c0-a60d4444f58e None None] New status for floating IP 71dddf51-6f7c-44b1-bcba-7f63f5b97a35: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:33:01.774931 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf5b798e-51a7-4eaa-a8a1-5debcbf6ede2 tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:01.779676 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cf5b798e-51a7-4eaa-a8a1-5debcbf6ede2 tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] 10.222.0.13 "GET /v2.0/networks/303dcf31-5985-414f-86a6-a4f2e180d93c HTTP/1.1" status: 200 len: 757 time: 0.2134931 Dec 09 21:33:01.782918 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48176) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:01.893747 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2e8eff6-c88b-4c80-a0ff-5face9fc665e tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:01.900217 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b2e8eff6-c88b-4c80-a0ff-5face9fc665e tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] 10.222.0.13 "GET /v2.0/networks/af373da4-f17c-434a-98cb-6515ba91132c HTTP/1.1" status: 200 len: 767 time: 0.1161058 Dec 09 21:33:01.900874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48180) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:01.909485 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c903ba3-0379-4e64-ae48-e88272501528 req-12e6fcad-92e1-4e64-838b-42a05c6a43b6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:01.921372 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c903ba3-0379-4e64-ae48-e88272501528 req-12e6fcad-92e1-4e64-838b-42a05c6a43b6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 947 time: 0.1345515 Dec 09 21:33:01.978056 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-476cb133-d8f5-40bf-b40f-fc44ae4c4699 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:02.027975 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c903ba3-0379-4e64-ae48-e88272501528 req-7df73e18-8568-4db0-845e-b7471b275c13 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1026287 Dec 09 21:33:02.083770 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7778e69e-ff22-471f-8768-9cdbcee91160 None None] Provisioning complete for port 273536ab-ff56-4654-99d5-8fcf6bc80df2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:02.084149 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7778e69e-ff22-471f-8768-9cdbcee91160 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:02.159843 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-476cb133-d8f5-40bf-b40f-fc44ae4c4699 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:02.166818 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0bcbe3c5-c37c-40b6-b989-78d133ec92be tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:02.186957 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0bcbe3c5-c37c-40b6-b989-78d133ec92be tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:02.189707 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0bcbe3c5-c37c-40b6-b989-78d133ec92be tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:02.228174 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-7778e69e-ff22-471f-8768-9cdbcee91160 None None] Port 273536ab-ff56-4654-99d5-8fcf6bc80df2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:33:02.233954 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-476cb133-d8f5-40bf-b40f-fc44ae4c4699 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['303dcf31-5985-414f-86a6-a4f2e180d93c']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:02.258874 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc82d29c-bffe-4cae-9cbf-60a2f65ddebb req-5e5facae-f3f3-45b1-a14d-6ec435a7ca96 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:02.258874 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc82d29c-bffe-4cae-9cbf-60a2f65ddebb req-5e5facae-f3f3-45b1-a14d-6ec435a7ca96 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.1776497 Dec 09 21:33:02.269932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-476cb133-d8f5-40bf-b40f-fc44ae4c4699 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b7e171bb-d10b-42cc-9fc0-c74718c95be8') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:02.274506 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-476cb133-d8f5-40bf-b40f-fc44ae4c4699 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b7e171bb-d10b-42cc-9fc0-c74718c95be8') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:02.308764 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bcbe3c5-c37c-40b6-b989-78d133ec92be tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Port': ['ID=273536ab-ff56-4654-99d5-8fcf6bc80df2,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:02.313431 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-476cb133-d8f5-40bf-b40f-fc44ae4c4699 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:02.352523 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-476cb133-d8f5-40bf-b40f-fc44ae4c4699 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:02.369411 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-476cb133-d8f5-40bf-b40f-fc44ae4c4699 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Releasing vlan 101 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:33:02.370327 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-476cb133-d8f5-40bf-b40f-fc44ae4c4699 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:02.400401 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc82d29c-bffe-4cae-9cbf-60a2f65ddebb req-cb2976d9-67e8-408c-808b-b1a981e5d9f8 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1220784 Dec 09 21:33:02.439815 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0bcbe3c5-c37c-40b6-b989-78d133ec92be tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network 15534a3e-17df-4709-b8b9-bb36601767d2 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:33:02.443238 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-0bcbe3c5-c37c-40b6-b989-78d133ec92be tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:33:02.523906 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:33:02.545465 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-476cb133-d8f5-40bf-b40f-fc44ae4c4699 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:02.550202 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-476cb133-d8f5-40bf-b40f-fc44ae4c4699 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 303dcf31-5985-414f-86a6-a4f2e180d93c {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Dec 09 21:33:02.566774 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-476cb133-d8f5-40bf-b40f-fc44ae4c4699 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:02.575711 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-476cb133-d8f5-40bf-b40f-fc44ae4c4699 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] 10.222.0.13 "DELETE /v2.0/networks/303dcf31-5985-414f-86a6-a4f2e180d93c HTTP/1.1" status: 204 len: 168 time: 0.6683841 Dec 09 21:33:02.580386 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48194) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:02.591867 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-e7a90aba-0f50-4c1c-b11c-c7c6461d2270 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Request body: {'network': {'name': 'tempest-network--1088368904'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:02.627532 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-476cb133-d8f5-40bf-b40f-fc44ae4c4699 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Pushing event deleted for resources: {'Network': ['ID=303dcf31-5985-414f-86a6-a4f2e180d93c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:02.669342 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e7a90aba-0f50-4c1c-b11c-c7c6461d2270 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Made reservation on behalf of 0607cac1ba1e46c59a3758dd59e93d9d for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:33:02.672874 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e7a90aba-0f50-4c1c-b11c-c7c6461d2270 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:02.703645 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bba252b4-645b-4332-9339-3245dc6ae6d8 req-84260b38-a72a-4ae3-b482-5f720fca08b7 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:02.712863 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bba252b4-645b-4332-9339-3245dc6ae6d8 req-84260b38-a72a-4ae3-b482-5f720fca08b7 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.1208754 Dec 09 21:33:02.721536 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e7a90aba-0f50-4c1c-b11c-c7c6461d2270 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] vlan segment allocate from pool success with {'vlan_id': 122, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:33:02.737736 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0bcbe3c5-c37c-40b6-b989-78d133ec92be tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Router 6c885eb2-40c3-4066-83da-e64e5ab2723e is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:33:02.745472 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e7a90aba-0f50-4c1c-b11c-c7c6461d2270 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:02.746151 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-e7a90aba-0f50-4c1c-b11c-c7c6461d2270 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Added segment 641a3c2e-6955-4a8f-99a1-b8bc736df85e of type vlan for network 29e0a4e1-e7b7-42d2-a935-cb0bb36b25ab Dec 09 21:33:02.813808 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e7a90aba-0f50-4c1c-b11c-c7c6461d2270 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:02.864508 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bba252b4-645b-4332-9339-3245dc6ae6d8 req-f1d7f961-0ada-477f-a479-6d327d929c89 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1507366 Dec 09 21:33:02.870955 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e7a90aba-0f50-4c1c-b11c-c7c6461d2270 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:02.877348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7a90aba-0f50-4c1c-b11c-c7c6461d2270 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:02.878171 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e7a90aba-0f50-4c1c-b11c-c7c6461d2270 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:02.886412 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0bcbe3c5-c37c-40b6-b989-78d133ec92be tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:33:02.896071 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0bcbe3c5-c37c-40b6-b989-78d133ec92be tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/routers/6c885eb2-40c3-4066-83da-e64e5ab2723e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.1733694 Dec 09 21:33:02.896962 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48196) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:02.903040 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-512843c5-57e2-48aa-9282-279aa13a1f9e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-859573531'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:02.928652 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-512843c5-57e2-48aa-9282-279aa13a1f9e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Made reservation on behalf of dc5c46f00552473abc0991c0cc4a0269 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:33:02.933313 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-512843c5-57e2-48aa-9282-279aa13a1f9e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:02.975710 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f5fc48e1-bb5d-4da4-9949-dc4d6e9c046a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:02.995720 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7a90aba-0f50-4c1c-b11c-c7c6461d2270 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Pushing event updated for resources: {'Network': ['ID=29e0a4e1-e7b7-42d2-a935-cb0bb36b25ab,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:02.997951 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-88660009-a58d-4fda-bb8d-9729b431ce58 None None] Provisioning complete for port 273536ab-ff56-4654-99d5-8fcf6bc80df2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:02.998572 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-88660009-a58d-4fda-bb8d-9729b431ce58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:03.016182 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-512843c5-57e2-48aa-9282-279aa13a1f9e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] vlan segment allocate from pool success with {'vlan_id': 143, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:33:03.028037 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e7a90aba-0f50-4c1c-b11c-c7c6461d2270 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 864 time: 0.4452317 Dec 09 21:33:03.031358 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48200) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:03.051068 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ffe1b8b2-e3ed-48a7-8fa2-13712cfbd1ff tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Request body: {'network': {'router:external': True}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:03.052656 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-512843c5-57e2-48aa-9282-279aa13a1f9e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:03.054109 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-512843c5-57e2-48aa-9282-279aa13a1f9e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Added segment db8dcd7d-243b-46e6-86d4-46d2f3f0dc00 of type vlan for network eeb87237-a90d-4250-8d44-cff75a6e4c02 Dec 09 21:33:03.069613 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-88660009-a58d-4fda-bb8d-9729b431ce58 None None] Port 273536ab-ff56-4654-99d5-8fcf6bc80df2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:33:03.075280 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 29e0a4e1-e7b7-42d2-a935-cb0bb36b25ab details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:33:03.131265 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-512843c5-57e2-48aa-9282-279aa13a1f9e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:03.254953 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-512843c5-57e2-48aa-9282-279aa13a1f9e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:03.256261 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] Sync routers for ids ['6c885eb2-40c3-4066-83da-e64e5ab2723e'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:33:03.272015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-512843c5-57e2-48aa-9282-279aa13a1f9e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:03.272715 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-512843c5-57e2-48aa-9282-279aa13a1f9e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:03.280001 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] Routers {'6c885eb2-40c3-4066-83da-e64e5ab2723e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:03.282113 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:32:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6c885eb2-40c3-4066-83da-e64e5ab2723e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:03.341018 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb3b5396-be6f-423a-83d4-1c2e554b93cc req-a001c6aa-e1c0-4768-8130-c3900b0d8083 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:03.342704 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eb3b5396-be6f-423a-83d4-1c2e554b93cc req-a001c6aa-e1c0-4768-8130-c3900b0d8083 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 947 time: 0.1874273 Dec 09 21:33:03.394142 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] Set router 6c885eb2-40c3-4066-83da-e64e5ab2723e gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:03.447498 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ffe1b8b2-e3ed-48a7-8fa2-13712cfbd1ff tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:03.463941 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eb3b5396-be6f-423a-83d4-1c2e554b93cc req-cba43c85-4046-49ab-b5e4-1b577818f1d4 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1097224 Dec 09 21:33:03.478077 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ffe1b8b2-e3ed-48a7-8fa2-13712cfbd1ff tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:03.484275 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-512843c5-57e2-48aa-9282-279aa13a1f9e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.5834165 Dec 09 21:33:03.526729 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48210) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:03.532807 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c7b12545-ba85-4dad-9ee2-b30c24fdae9e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'subnet': {'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:03.554622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-512843c5-57e2-48aa-9282-279aa13a1f9e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Network': ['ID=eeb87237-a90d-4250-8d44-cff75a6e4c02,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:03.598859 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network eeb87237-a90d-4250-8d44-cff75a6e4c02 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:33:03.611014 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffe1b8b2-e3ed-48a7-8fa2-13712cfbd1ff tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Pushing event updated for resources: {'Network': ['ID=29e0a4e1-e7b7-42d2-a935-cb0bb36b25ab,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:03.613901 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-ffe1b8b2-e3ed-48a7-8fa2-13712cfbd1ff tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Network 29e0a4e1-e7b7-42d2-a935-cb0bb36b25ab is not hosted by any dhcp agent {{(pid=103437) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 09 21:33:03.614785 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ffe1b8b2-e3ed-48a7-8fa2-13712cfbd1ff tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:03.615389 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ffe1b8b2-e3ed-48a7-8fa2-13712cfbd1ff tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:03.620218 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ffe1b8b2-e3ed-48a7-8fa2-13712cfbd1ff tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] 10.222.0.13 "PUT /v2.0/networks/29e0a4e1-e7b7-42d2-a935-cb0bb36b25ab HTTP/1.1" status: 200 len: 858 time: 0.5866528 Dec 09 21:33:03.620853 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48212) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:03.763547 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c7b12545-ba85-4dad-9ee2-b30c24fdae9e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Made reservation on behalf of dc5c46f00552473abc0991c0cc4a0269 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:33:03.768884 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7b12545-ba85-4dad-9ee2-b30c24fdae9e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:03.770499 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f6e16eca-de8a-4737-bcbd-0fcb5e2fa721 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:03.807264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d33f931-4b08-4b01-ab64-ee9e14d8b3aa req-3aedc03b-812b-4539-bf22-0fed31f895d3 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:03.815646 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4d33f931-4b08-4b01-ab64-ee9e14d8b3aa req-3aedc03b-812b-4539-bf22-0fed31f895d3 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.1576474 Dec 09 21:33:03.880443 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f6e16eca-de8a-4737-bcbd-0fcb5e2fa721 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:03.933163 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-f6e16eca-de8a-4737-bcbd-0fcb5e2fa721 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['29e0a4e1-e7b7-42d2-a935-cb0bb36b25ab']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:03.948988 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:01Z', 'revision_number': 2, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:01Z', 'revision_number': 2, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:03.963527 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-f6e16eca-de8a-4737-bcbd-0fcb5e2fa721 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '641a3c2e-6955-4a8f-99a1-b8bc736df85e') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:03.964106 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-f6e16eca-de8a-4737-bcbd-0fcb5e2fa721 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '641a3c2e-6955-4a8f-99a1-b8bc736df85e') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:03.988897 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f6e16eca-de8a-4737-bcbd-0fcb5e2fa721 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:03.992819 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] Checking router: 6c885eb2-40c3-4066-83da-e64e5ab2723e for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:33:03.993181 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] Updating router 6c885eb2-40c3-4066-83da-e64e5ab2723e port 273536ab-ff56-4654-99d5-8fcf6bc80df2 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:33:04.029189 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:04.033573 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f6e16eca-de8a-4737-bcbd-0fcb5e2fa721 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:04.043497 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4d33f931-4b08-4b01-ab64-ee9e14d8b3aa req-bfe600c3-d06c-4370-8432-80f8e604e730 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2253144 Dec 09 21:33:04.053108 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f6e16eca-de8a-4737-bcbd-0fcb5e2fa721 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Releasing vlan 122 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:33:04.053954 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f6e16eca-de8a-4737-bcbd-0fcb5e2fa721 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:33:04.066403 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:33:04.165625 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f2feb7d-1bdc-4dd9-8b96-284333db45fd req-50a10a6a-1af2-45f2-a298-1643eae50ae6 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:04.173058 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2f2feb7d-1bdc-4dd9-8b96-284333db45fd req-50a10a6a-1af2-45f2-a298-1643eae50ae6 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.1489532 Dec 09 21:33:04.184038 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f6e16eca-de8a-4737-bcbd-0fcb5e2fa721 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:04.189444 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f6e16eca-de8a-4737-bcbd-0fcb5e2fa721 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 29e0a4e1-e7b7-42d2-a935-cb0bb36b25ab {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Dec 09 21:33:04.197280 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f6e16eca-de8a-4737-bcbd-0fcb5e2fa721 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:04.215623 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f6e16eca-de8a-4737-bcbd-0fcb5e2fa721 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] 10.222.0.13 "DELETE /v2.0/networks/29e0a4e1-e7b7-42d2-a935-cb0bb36b25ab HTTP/1.1" status: 204 len: 168 time: 0.5858231 Dec 09 21:33:04.216410 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48224) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:04.281838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6e16eca-de8a-4737-bcbd-0fcb5e2fa721 tempest-ExternalNetworksTestJSON-1876481296 tempest-ExternalNetworksTestJSON-1876481296-project-admin] Pushing event deleted for resources: {'Network': ['ID=29e0a4e1-e7b7-42d2-a935-cb0bb36b25ab,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:04.323056 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-89546460-c87e-489e-bbe6-0a5e2f1443fb tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] DELETE failed (client error): The resource could not be found. Dec 09 21:33:04.323669 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-89546460-c87e-489e-bbe6-0a5e2f1443fb tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:33:04.328079 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-89546460-c87e-489e-bbe6-0a5e2f1443fb tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] 10.222.0.13 "DELETE /v2.0/subnets/0568fe2e-ac02-4c0b-8777-51466f1803ff HTTP/1.1" status: 404 len: 337 time: 0.1015520 Dec 09 21:33:04.330508 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48230) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:04.356096 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2f2feb7d-1bdc-4dd9-8b96-284333db45fd req-b6b035d9-940b-4e54-a258-a5e81c52ec61 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1735194 Dec 09 21:33:04.438793 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6dc2ea8d-55eb-4049-a2bb-91b2bea19d5b tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:04.471979 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:04.480273 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:04.547706 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7b12545-ba85-4dad-9ee2-b30c24fdae9e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:04.572370 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6dc2ea8d-55eb-4049-a2bb-91b2bea19d5b tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:04.620534 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-6dc2ea8d-55eb-4049-a2bb-91b2bea19d5b tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['af373da4-f17c-434a-98cb-6515ba91132c']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:04.626451 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] Attempting to bind port 273536ab-ff56-4654-99d5-8fcf6bc80df2 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:33:04.627252 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] Attempting to bind port 273536ab-ff56-4654-99d5-8fcf6bc80df2 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '4b275028-ecbe-4b74-8672-2d6a06274136', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:33:04.627643 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] Attempting to bind port 273536ab-ff56-4654-99d5-8fcf6bc80df2 on network 15534a3e-17df-4709-b8b9-bb36601767d2 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:33:04.636309 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 32, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:33:04.636683 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] Checking segment: {'id': '4b275028-ecbe-4b74-8672-2d6a06274136', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:33:04.637089 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:04.637482 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] Bound using segment: {'id': '4b275028-ecbe-4b74-8672-2d6a06274136', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:33:04.643108 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-6dc2ea8d-55eb-4049-a2bb-91b2bea19d5b tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ca7579f0-8543-4061-9b89-cab61ac6a10d') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:04.643565 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-6dc2ea8d-55eb-4049-a2bb-91b2bea19d5b tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ca7579f0-8543-4061-9b89-cab61ac6a10d') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:04.651234 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] Bound port: 273536ab-ff56-4654-99d5-8fcf6bc80df2, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4b275028-ecbe-4b74-8672-2d6a06274136', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:33:04.651823 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:04.655656 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6dc2ea8d-55eb-4049-a2bb-91b2bea19d5b tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:04.670694 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6dc2ea8d-55eb-4049-a2bb-91b2bea19d5b tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:04.696643 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6dc2ea8d-55eb-4049-a2bb-91b2bea19d5b tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Releasing vlan 131 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:33:04.697960 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6dc2ea8d-55eb-4049-a2bb-91b2bea19d5b tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:33:04.710579 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:33:04.721817 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7b12545-ba85-4dad-9ee2-b30c24fdae9e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Checking segment: {'id': 'db8dcd7d-243b-46e6-86d4-46d2f3f0dc00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:33:04.722211 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c7b12545-ba85-4dad-9ee2-b30c24fdae9e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network hostable DHCP agents. Network: eeb87237-a90d-4250-8d44-cff75a6e4c02, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:33:04.747311 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7b12545-ba85-4dad-9ee2-b30c24fdae9e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Subnet': ['ID=267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:04.758191 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] For port 273536ab-ff56-4654-99d5-8fcf6bc80df2, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:33:04.762395 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] For port 273536ab-ff56-4654-99d5-8fcf6bc80df2, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=273536ab-ff56-4654-99d5-8fcf6bc80df2,segment=NetworkSegment(4b275028-ecbe-4b74-8672-2d6a06274136),segment_id=4b275028-ecbe-4b74-8672-2d6a06274136)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:33:04.774548 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:04.784145 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-314d83f5-5acd-43df-8fda-4ffdb7dbfea6 req-fbddd9eb-8d11-4a33-94d1-0d9ba7f414cb tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:04.786343 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12b8e794-4daa-4e22-812b-9397dedbc67b None None] Pushing event updated for resources: {'Port': ['ID=273536ab-ff56-4654-99d5-8fcf6bc80df2,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:04.794358 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-314d83f5-5acd-43df-8fda-4ffdb7dbfea6 req-fbddd9eb-8d11-4a33-94d1-0d9ba7f414cb tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 947 time: 0.1512735 Dec 09 21:33:04.801662 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b8e794-4daa-4e22-812b-9397dedbc67b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:04.802407 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b8e794-4daa-4e22-812b-9397dedbc67b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:04.803012 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b8e794-4daa-4e22-812b-9397dedbc67b None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:04.803676 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b8e794-4daa-4e22-812b-9397dedbc67b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:04.804241 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b8e794-4daa-4e22-812b-9397dedbc67b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:04.805512 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b8e794-4daa-4e22-812b-9397dedbc67b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:04.806236 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b8e794-4daa-4e22-812b-9397dedbc67b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:04.806828 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b8e794-4daa-4e22-812b-9397dedbc67b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:04.807388 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b8e794-4daa-4e22-812b-9397dedbc67b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:04.807972 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b8e794-4daa-4e22-812b-9397dedbc67b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:04.808598 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b8e794-4daa-4e22-812b-9397dedbc67b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:04.809156 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b8e794-4daa-4e22-812b-9397dedbc67b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:04.809764 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b8e794-4daa-4e22-812b-9397dedbc67b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:04.833188 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c7b12545-ba85-4dad-9ee2-b30c24fdae9e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network eeb87237-a90d-4250-8d44-cff75a6e4c02 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:33:04.862656 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6dc2ea8d-55eb-4049-a2bb-91b2bea19d5b tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:04.873619 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6dc2ea8d-55eb-4049-a2bb-91b2bea19d5b tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:04.873759 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] Routers {'6c885eb2-40c3-4066-83da-e64e5ab2723e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:04.874878 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:32:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6c885eb2-40c3-4066-83da-e64e5ab2723e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:04.875936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-c7b12545-ba85-4dad-9ee2-b30c24fdae9e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, eeb87237-a90d-4250-8d44-cff75a6e4c02) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:04.887117 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1547135b-db68-40d1-a517-35fb1f931f02 None None] Network eeb87237-a90d-4250-8d44-cff75a6e4c02 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:33:04.897028 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c7b12545-ba85-4dad-9ee2-b30c24fdae9e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:04.898462 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7b12545-ba85-4dad-9ee2-b30c24fdae9e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:04.898791 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6dc2ea8d-55eb-4049-a2bb-91b2bea19d5b tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] 10.222.0.13 "DELETE /v2.0/networks/af373da4-f17c-434a-98cb-6515ba91132c HTTP/1.1" status: 204 len: 168 time: 0.5664632 Dec 09 21:33:04.933507 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dc2ea8d-55eb-4049-a2bb-91b2bea19d5b tempest-ExternalNetworksTestJSON-1906399329 tempest-ExternalNetworksTestJSON-1906399329-project] Pushing event deleted for resources: {'Network': ['ID=af373da4-f17c-434a-98cb-6515ba91132c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:04.944424 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-314d83f5-5acd-43df-8fda-4ffdb7dbfea6 req-6418597c-676c-47d4-b106-cdfcbd131aa6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1343191 Dec 09 21:33:04.983277 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c7b12545-ba85-4dad-9ee2-b30c24fdae9e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.4547350 Dec 09 21:33:04.986207 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48244) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:05.032643 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-96323bdc-f286-485d-988e-602bd42d5290 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-eeb87237-a90d-4250-8d44-cff75a6e4c02', 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02', 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'fixed_ips': [{'subnet_id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:33:05.034233 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-96323bdc-f286-485d-988e-602bd42d5290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:05.047369 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5c8ed5cb-5a00-43c7-8cea-14094f5c4e79 None None] Provisioning complete for port 273536ab-ff56-4654-99d5-8fcf6bc80df2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:05.047958 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5c8ed5cb-5a00-43c7-8cea-14094f5c4e79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:05.083456 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] Set router 6c885eb2-40c3-4066-83da-e64e5ab2723e gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:05.296179 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-96323bdc-f286-485d-988e-602bd42d5290 None None] Allocated IP 2001:db8:1::2 (eeb87237-a90d-4250-8d44-cff75a6e4c02/267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a/907f64eb-7cc4-4808-939c-0e59e7c61dba) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:33:05.378412 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12b8e794-4daa-4e22-812b-9397dedbc67b None None] Pushing event updated for resources: {'Port': ['ID=273536ab-ff56-4654-99d5-8fcf6bc80df2,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:05.384020 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a183f200-783e-4a72-bc53-42bffb4d5d38 req-a17c9b65-9707-4fb8-97de-e54655790049 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:05.385776 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a183f200-783e-4a72-bc53-42bffb4d5d38 req-a17c9b65-9707-4fb8-97de-e54655790049 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.1835029 Dec 09 21:33:05.514219 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a183f200-783e-4a72-bc53-42bffb4d5d38 req-0ba55eed-ab66-44e4-ba3b-3eb707c88818 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1187899 Dec 09 21:33:05.545656 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48264) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:05.599538 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-96323bdc-f286-485d-988e-602bd42d5290 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:05.614973 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:01Z', 'revision_number': 2, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:04Z', 'revision_number': 4, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:05.681260 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-96323bdc-f286-485d-988e-602bd42d5290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:05.694876 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f58665ed-cf3f-41ab-93a4-6a503ae75b64 req-4a0119e0-315b-4405-ab40-f192e7c55aad tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:05.699913 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4d67016-1010-454f-8ee1-83e45928a275 None None] The sync data for ids ['6c885eb2-40c3-4066-83da-e64e5ab2723e'] in n-d-713301-27 is: [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:01Z', 'revision_number': 2, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:04Z', 'revision_number': 4, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:33:05.709178 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f58665ed-cf3f-41ab-93a4-6a503ae75b64 req-4a0119e0-315b-4405-ab40-f192e7c55aad tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.2011023 Dec 09 21:33:05.893543 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-96323bdc-f286-485d-988e-602bd42d5290 None None] Network eeb87237-a90d-4250-8d44-cff75a6e4c02 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:33:05.897084 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6de40e81-434b-4e4a-9ce0-7149d038e803 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:05.907675 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-96323bdc-f286-485d-988e-602bd42d5290 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:05.913518 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96323bdc-f286-485d-988e-602bd42d5290 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:33:05.935364 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5c8ed5cb-5a00-43c7-8cea-14094f5c4e79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:05.937773 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96323bdc-f286-485d-988e-602bd42d5290 None None] Pushing event updated for resources: {'Port': ['ID=907f64eb-7cc4-4808-939c-0e59e7c61dba,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:05.955538 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f58665ed-cf3f-41ab-93a4-6a503ae75b64 req-dc255d69-51a7-47ec-bbcd-56ebf71e45d9 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2453310 Dec 09 21:33:06.035989 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d5a82063-7c13-4924-8a45-8c958623a1d1 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=646f96b4218946afb8bf7ec2c382f1a7&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4871504 Dec 09 21:33:06.038392 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48284) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:06.092139 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-96323bdc-f286-485d-988e-602bd42d5290 None None] Attempting to bind port 907f64eb-7cc4-4808-939c-0e59e7c61dba on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:33:06.101594 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-96323bdc-f286-485d-988e-602bd42d5290 None None] Attempting to bind port 907f64eb-7cc4-4808-939c-0e59e7c61dba by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'db8dcd7d-243b-46e6-86d4-46d2f3f0dc00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:33:06.101971 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96323bdc-f286-485d-988e-602bd42d5290 None None] Attempting to bind port 907f64eb-7cc4-4808-939c-0e59e7c61dba on network eeb87237-a90d-4250-8d44-cff75a6e4c02 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:33:06.188883 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-5c8ed5cb-5a00-43c7-8cea-14094f5c4e79 None None] For port 273536ab-ff56-4654-99d5-8fcf6bc80df2, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=273536ab-ff56-4654-99d5-8fcf6bc80df2,segment=NetworkSegment(4b275028-ecbe-4b74-8672-2d6a06274136),segment_id=4b275028-ecbe-4b74-8672-2d6a06274136)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:06.190416 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96323bdc-f286-485d-988e-602bd42d5290 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 32, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:33:06.190812 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96323bdc-f286-485d-988e-602bd42d5290 None None] Checking segment: {'id': 'db8dcd7d-243b-46e6-86d4-46d2f3f0dc00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:33:06.191229 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-96323bdc-f286-485d-988e-602bd42d5290 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:06.196395 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96323bdc-f286-485d-988e-602bd42d5290 None None] Bound using segment: {'id': 'db8dcd7d-243b-46e6-86d4-46d2f3f0dc00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:33:06.196930 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-96323bdc-f286-485d-988e-602bd42d5290 None None] Bound port: 907f64eb-7cc4-4808-939c-0e59e7c61dba, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'db8dcd7d-243b-46e6-86d4-46d2f3f0dc00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:33:06.197309 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-96323bdc-f286-485d-988e-602bd42d5290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:06.207995 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5c8ed5cb-5a00-43c7-8cea-14094f5c4e79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:06.276438 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c8ed5cb-5a00-43c7-8cea-14094f5c4e79 None None] Pushing event updated for resources: {'Port': ['ID=273536ab-ff56-4654-99d5-8fcf6bc80df2,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:06.276596 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1a046bc6-8ff6-4ee9-bc16-bf40aa1865c0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:06.300022 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1a046bc6-8ff6-4ee9-bc16-bf40aa1865c0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:06.325378 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a594c11-e013-4971-b814-bda0dc187829 req-30112fc5-52c3-4288-9224-0bad0cef74b3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:06.336296 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7a594c11-e013-4971-b814-bda0dc187829 req-30112fc5-52c3-4288-9224-0bad0cef74b3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 947 time: 0.1619754 Dec 09 21:33:06.338893 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-96323bdc-f286-485d-988e-602bd42d5290 None None] For port 907f64eb-7cc4-4808-939c-0e59e7c61dba, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:33:06.343911 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-96323bdc-f286-485d-988e-602bd42d5290 None None] For port 907f64eb-7cc4-4808-939c-0e59e7c61dba, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=907f64eb-7cc4-4808-939c-0e59e7c61dba,segment=NetworkSegment(db8dcd7d-243b-46e6-86d4-46d2f3f0dc00),segment_id=db8dcd7d-243b-46e6-86d4-46d2f3f0dc00)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:33:06.362640 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-96323bdc-f286-485d-988e-602bd42d5290 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:06.366968 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8782d46e-63a4-482c-a496-c54e515dc3dc None None] Provisioning complete for port 273536ab-ff56-4654-99d5-8fcf6bc80df2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:06.367583 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8782d46e-63a4-482c-a496-c54e515dc3dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:06.463131 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7a594c11-e013-4971-b814-bda0dc187829 req-cb54744f-f764-4039-9055-80d31c1fb925 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1256933 Dec 09 21:33:06.494505 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1a046bc6-8ff6-4ee9-bc16-bf40aa1865c0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:06.506318 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1a046bc6-8ff6-4ee9-bc16-bf40aa1865c0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:06.508230 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1a046bc6-8ff6-4ee9-bc16-bf40aa1865c0 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/9d810044-2082-4685-8a9d-736715d8c54c HTTP/1.1" status: 204 len: 168 time: 0.4680996 Dec 09 21:33:06.519919 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a046bc6-8ff6-4ee9-bc16-bf40aa1865c0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9d810044-2082-4685-8a9d-736715d8c54c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:06.548793 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96323bdc-f286-485d-988e-602bd42d5290 None None] Pushing event updated for resources: {'Port': ['ID=907f64eb-7cc4-4808-939c-0e59e7c61dba,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:06.682385 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:06.716216 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-49132690-57b6-42a8-93a1-26b1737c30ea tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:06.889638 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40c0ce63-4e5e-4e8b-becb-a1f88170bab5 req-5e96bbd1-3dee-45e7-bc3f-46edf6a48f33 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:06.891393 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-40c0ce63-4e5e-4e8b-becb-a1f88170bab5 req-5e96bbd1-3dee-45e7-bc3f-46edf6a48f33 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.2031271 Dec 09 21:33:06.912155 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6905c55a-f46f-4dee-b467-62c586811654 req-8efc9f2c-f141-4b1b-8f81-9e821f059dc8 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:06.914454 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6905c55a-f46f-4dee-b467-62c586811654 req-8efc9f2c-f141-4b1b-8f81-9e821f059dc8 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.1518764 Dec 09 21:33:07.031741 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-40c0ce63-4e5e-4e8b-becb-a1f88170bab5 req-c41d4163-23b8-405b-9c1f-66ad85506d90 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1139061 Dec 09 21:33:07.069610 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6905c55a-f46f-4dee-b467-62c586811654 req-6c4b6c0a-f70a-431a-82c1-1ab50211075d tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1276221 Dec 09 21:33:07.180226 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48322) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:07.211217 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0509ad48-c50b-4aaf-93f1-d48d030d8146 req-dce58756-90f0-41fb-b653-a708539f2dfc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:07.212801 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0509ad48-c50b-4aaf-93f1-d48d030d8146 req-dce58756-90f0-41fb-b653-a708539f2dfc service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6c358c3d1eb04dce9614ffbe3851e040&device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 1097 time: 0.4997771 Dec 09 21:33:07.238744 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-16ed3de8-9eb4-4284-929b-e106c48ea8b7 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=0607cac1ba1e46c59a3758dd59e93d9d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0550339 Dec 09 21:33:07.239863 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48324) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:07.274878 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-49132690-57b6-42a8-93a1-26b1737c30ea tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Allocated IP 2001:db8:1::1 (eeb87237-a90d-4250-8d44-cff75a6e4c02/267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a/aebca6d3-dcf2-40d7-897d-d683ffd7a3c5) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:33:07.302290 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-61de39b9-914f-4307-94e1-1895e3fb5902 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:07.329134 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-61de39b9-914f-4307-94e1-1895e3fb5902 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:07.397160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0509ad48-c50b-4aaf-93f1-d48d030d8146 req-9b90279c-e3fa-4dd3-a79c-201b51c8669b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:07.399049 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0509ad48-c50b-4aaf-93f1-d48d030d8146 req-9b90279c-e3fa-4dd3-a79c-201b51c8669b service neutron] 10.222.0.31 "GET /v2.0/networks?id=1b5db94a-f2e5-4ee6-b165-fbd41044188e HTTP/1.1" status: 200 len: 917 time: 0.1759841 Dec 09 21:33:07.412926 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-61de39b9-914f-4307-94e1-1895e3fb5902 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:07.415481 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-61de39b9-914f-4307-94e1-1895e3fb5902 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:07.418866 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-61de39b9-914f-4307-94e1-1895e3fb5902 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/8c01f76e-9a37-4d02-b3ce-e6b82cf2656e HTTP/1.1" status: 204 len: 168 time: 0.1758196 Dec 09 21:33:07.433508 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61de39b9-914f-4307-94e1-1895e3fb5902 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8c01f76e-9a37-4d02-b3ce-e6b82cf2656e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:07.472937 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0509ad48-c50b-4aaf-93f1-d48d030d8146 req-8f8c1d39-8c4d-4795-bdd2-ac6fd87a49a2 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=287d2e38-af6c-4fbc-b196-bebf54c65697 HTTP/1.1" status: 200 len: 217 time: 0.0638649 Dec 09 21:33:07.539074 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 273536ab-ff56-4654-99d5-8fcf6bc80df2 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:33:07.555240 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-49132690-57b6-42a8-93a1-26b1737c30ea tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:07.570651 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0509ad48-c50b-4aaf-93f1-d48d030d8146 req-335230e2-bf0c-40de-ac00-20d498855799 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:07.572206 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0509ad48-c50b-4aaf-93f1-d48d030d8146 req-335230e2-bf0c-40de-ac00-20d498855799 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=e884864f-1596-4ce2-af55-9b1c3a7758eb HTTP/1.1" status: 200 len: 855 time: 0.0871143 Dec 09 21:33:07.595542 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 273536ab-ff56-4654-99d5-8fcf6bc80df2 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:07.596138 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:07.660845 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-49132690-57b6-42a8-93a1-26b1737c30ea tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:07.667675 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0509ad48-c50b-4aaf-93f1-d48d030d8146 req-dd9fa11d-ce55-49c0-ad3c-c3ddcb67f8ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:07.669360 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0509ad48-c50b-4aaf-93f1-d48d030d8146 req-dd9fa11d-ce55-49c0-ad3c-c3ddcb67f8ef service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1b5db94a-f2e5-4ee6-b165-fbd41044188e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0867360 Dec 09 21:33:07.742627 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-49132690-57b6-42a8-93a1-26b1737c30ea tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network eeb87237-a90d-4250-8d44-cff75a6e4c02 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:33:07.780622 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-49132690-57b6-42a8-93a1-26b1737c30ea tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:07.785941 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 907f64eb-7cc4-4808-939c-0e59e7c61dba up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:33:07.797209 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49132690-57b6-42a8-93a1-26b1737c30ea tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:33:07.797209 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-49132690-57b6-42a8-93a1-26b1737c30ea tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:07.882243 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 907f64eb-7cc4-4808-939c-0e59e7c61dba triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:07.882631 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:07.898504 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49132690-57b6-42a8-93a1-26b1737c30ea tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Port': ['ID=aebca6d3-dcf2-40d7-897d-d683ffd7a3c5,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:07.998809 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12f9879f-06fb-464a-95d9-c04102e7d182 req-1832afe2-5f3c-4915-b465-6bef62e21a9a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:08.024114 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-12f9879f-06fb-464a-95d9-c04102e7d182 req-1832afe2-5f3c-4915-b465-6bef62e21a9a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 947 time: 0.1447618 Dec 09 21:33:08.033587 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:08.105839 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-12f9879f-06fb-464a-95d9-c04102e7d182 req-d30445c6-1314-4072-8426-e6d7b2831660 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0726979 Dec 09 21:33:08.136734 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:08.172002 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0509ad48-c50b-4aaf-93f1-d48d030d8146 req-be4637f6-156f-4f2f-9b8d-10e3db091859 service neutron] 10.222.0.31 "GET /v2.0/networks/1b5db94a-f2e5-4ee6-b165-fbd41044188e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4737186 Dec 09 21:33:08.246982 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 907f64eb-7cc4-4808-939c-0e59e7c61dba, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=907f64eb-7cc4-4808-939c-0e59e7c61dba,segment=NetworkSegment(db8dcd7d-243b-46e6-86d4-46d2f3f0dc00),segment_id=db8dcd7d-243b-46e6-86d4-46d2f3f0dc00)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:08.263158 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:08.303305 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-49132690-57b6-42a8-93a1-26b1737c30ea tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:08.391285 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db8a8010-5008-4a0f-9d26-6f3de37f49c1 req-d247bba8-9f68-4560-a2c4-3bb402e6d753 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:08.393615 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db8a8010-5008-4a0f-9d26-6f3de37f49c1 req-d247bba8-9f68-4560-a2c4-3bb402e6d753 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.1960716 Dec 09 21:33:08.421923 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=907f64eb-7cc4-4808-939c-0e59e7c61dba,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:08.430233 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27e00a3a-ed16-4759-90d8-624e4eaad7eb None None] Network eeb87237-a90d-4250-8d44-cff75a6e4c02 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:33:08.444660 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80933a35-af74-43f5-b713-f069f7d3acdd req-042fcc70-8a21-4da5-af0d-532692181374 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:08.453816 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-80933a35-af74-43f5-b713-f069f7d3acdd req-042fcc70-8a21-4da5-af0d-532692181374 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.1295538 Dec 09 21:33:08.520354 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db8a8010-5008-4a0f-9d26-6f3de37f49c1 req-1fd1fd00-f7c0-45f8-badf-64b201d83306 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1196060 Dec 09 21:33:08.575106 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0509ad48-c50b-4aaf-93f1-d48d030d8146 req-5290d4d4-24c2-46c6-a451-a0f231e11962 service neutron] 10.222.0.31 "GET /v2.0/networks/1b5db94a-f2e5-4ee6-b165-fbd41044188e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3869696 Dec 09 21:33:08.590821 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-80933a35-af74-43f5-b713-f069f7d3acdd req-1a78de73-4a39-4564-9c6b-3d34a460a821 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1360049 Dec 09 21:33:08.658849 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9bc15afb-06c7-4288-b7d2-9b98bee98d25 None None] Provisioning complete for port 907f64eb-7cc4-4808-939c-0e59e7c61dba triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:08.659564 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9bc15afb-06c7-4288-b7d2-9b98bee98d25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:08.937306 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 90f16e74-f2e6-416e-a079-f205615a0d8e no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:33:09.041150 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:09.075954 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7ef6883d-9c98-4e81-b102-bc1197ac4a47', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '90f16e74-f2e6-416e-a079-f205615a0d8e'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:33:09.078554 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1c29994a-2d96-4b02-8c32-af27dd8037c2" -d '{"events": [{"server_uuid": "7ef6883d-9c98-4e81-b102-bc1197ac4a47", "name": "network-vif-unplugged", "status": "completed", "tag": "90f16e74-f2e6-416e-a079-f205615a0d8e"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:33:09.081984 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-49132690-57b6-42a8-93a1-26b1737c30ea tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:09.104462 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-49132690-57b6-42a8-93a1-26b1737c30ea tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:09.105207 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-49132690-57b6-42a8-93a1-26b1737c30ea tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:09.106156 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 90f16e74-f2e6-416e-a079-f205615a0d8e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=90f16e74-f2e6-416e-a079-f205615a0d8e,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:09.120917 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:09.232725 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49132690-57b6-42a8-93a1-26b1737c30ea tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Port': ['ID=aebca6d3-dcf2-40d7-897d-d683ffd7a3c5,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:09.280592 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=90f16e74-f2e6-416e-a079-f205615a0d8e,revision_number=14']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:09.296342 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8831d684-e906-458c-90f9-9ffd8462982d None None] Provisioning complete for port 907f64eb-7cc4-4808-939c-0e59e7c61dba triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:09.297078 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8831d684-e906-458c-90f9-9ffd8462982d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:09.367813 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-49132690-57b6-42a8-93a1-26b1737c30ea tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network eeb87237-a90d-4250-8d44-cff75a6e4c02 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:33:09.370924 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-49132690-57b6-42a8-93a1-26b1737c30ea tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:09.496824 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 907f64eb-7cc4-4808-939c-0e59e7c61dba up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:33:09.559581 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8831d684-e906-458c-90f9-9ffd8462982d None None] Provisioning complete for port aebca6d3-dcf2-40d7-897d-d683ffd7a3c5 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:09.559960 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8831d684-e906-458c-90f9-9ffd8462982d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:09.573405 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-49132690-57b6-42a8-93a1-26b1737c30ea tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Router 6c885eb2-40c3-4066-83da-e64e5ab2723e has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:33:09.610271 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 907f64eb-7cc4-4808-939c-0e59e7c61dba triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:09.610271 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:09.655310 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:33:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-df07ccd7-e3ad-4dcf-9d9a-78a854f2df3e x-openstack-request-id: req-df07ccd7-e3ad-4dcf-9d9a-78a854f2df3e {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:33:09.655701 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7ef6883d-9c98-4e81-b102-bc1197ac4a47", "name": "network-vif-unplugged", "status": "completed", "tag": "90f16e74-f2e6-416e-a079-f205615a0d8e", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:33:09.655907 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-df07ccd7-e3ad-4dcf-9d9a-78a854f2df3e {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:33:09.656774 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7ef6883d-9c98-4e81-b102-bc1197ac4a47', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '90f16e74-f2e6-416e-a079-f205615a0d8e', 'code': 200} Dec 09 21:33:09.658996 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-8831d684-e906-458c-90f9-9ffd8462982d None None] Port aebca6d3-dcf2-40d7-897d-d683ffd7a3c5 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:33:09.670176 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:09.800212 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d5f4ca19-19dd-4ac9-8951-b70d706aefcd None None] Provisioning complete for port aebca6d3-dcf2-40d7-897d-d683ffd7a3c5 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:09.800586 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d5f4ca19-19dd-4ac9-8951-b70d706aefcd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:09.808966 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-49132690-57b6-42a8-93a1-26b1737c30ea tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:33:09.841662 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-49132690-57b6-42a8-93a1-26b1737c30ea tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/routers/6c885eb2-40c3-4066-83da-e64e5ab2723e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.8538153 Dec 09 21:33:09.842865 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] Sync routers for ids ['6c885eb2-40c3-4066-83da-e64e5ab2723e'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:33:09.843654 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48438) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:09.857396 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] Routers {'6c885eb2-40c3-4066-83da-e64e5ab2723e'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:09.858115 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6c885eb2-40c3-4066-83da-e64e5ab2723e'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:09.868142 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-12fb33ef-9290-4d74-a7f1-97ba6d68383a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-1446848897'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:09.933971 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-12fb33ef-9290-4d74-a7f1-97ba6d68383a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Made reservation on behalf of dc5c46f00552473abc0991c0cc4a0269 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:33:09.947764 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d5f4ca19-19dd-4ac9-8951-b70d706aefcd None None] Port aebca6d3-dcf2-40d7-897d-d683ffd7a3c5 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:33:09.962482 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-12fb33ef-9290-4d74-a7f1-97ba6d68383a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:09.966151 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da4a12f-1f88-439f-8fb9-906bef614e52 req-51328c0e-45ea-44af-8c7c-be5ff2d23165 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:09.969015 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4da4a12f-1f88-439f-8fb9-906bef614e52 req-51328c0e-45ea-44af-8c7c-be5ff2d23165 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.2911944 Dec 09 21:33:09.979789 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-537a0c05-4217-4f47-88fa-a13317cd2e93 req-511ef7b7-c095-4bf0-9cc2-97e3941fa4f9 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:09.982920 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-537a0c05-4217-4f47-88fa-a13317cd2e93 req-511ef7b7-c095-4bf0-9cc2-97e3941fa4f9 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.2054706 Dec 09 21:33:09.983786 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] Set router 6c885eb2-40c3-4066-83da-e64e5ab2723e gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:10.005535 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-12fb33ef-9290-4d74-a7f1-97ba6d68383a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] vlan segment allocate from pool success with {'vlan_id': 101, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:33:10.017741 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-12fb33ef-9290-4d74-a7f1-97ba6d68383a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:10.018151 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-12fb33ef-9290-4d74-a7f1-97ba6d68383a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Added segment aefee495-6d7c-460f-b4a3-a320048af8d9 of type vlan for network 8e0cfbe6-9002-42c6-8e79-8d95b404c162 Dec 09 21:33:10.057423 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4da4a12f-1f88-439f-8fb9-906bef614e52 req-433c48ef-13f7-4eb6-883e-ff52627e9f4d tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0731313 Dec 09 21:33:10.103177 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-537a0c05-4217-4f47-88fa-a13317cd2e93 req-41edabb8-bdbb-4427-b6df-1789818eacaa tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1093214 Dec 09 21:33:10.134283 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-12fb33ef-9290-4d74-a7f1-97ba6d68383a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:10.216118 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-12fb33ef-9290-4d74-a7f1-97ba6d68383a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:10.226816 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-0c863205-c656-4399-8215-07d269762dae None None] Provisioning complete for port aebca6d3-dcf2-40d7-897d-d683ffd7a3c5 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:10.227186 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0c863205-c656-4399-8215-07d269762dae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:10.238341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12fb33ef-9290-4d74-a7f1-97ba6d68383a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:10.241357 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-12fb33ef-9290-4d74-a7f1-97ba6d68383a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:10.302899 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-12fb33ef-9290-4d74-a7f1-97ba6d68383a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.4565012 Dec 09 21:33:10.303576 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-0c863205-c656-4399-8215-07d269762dae None None] Port aebca6d3-dcf2-40d7-897d-d683ffd7a3c5 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:33:10.304837 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48474) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:10.311147 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-88572788-b849-4514-8212-60c7f3772318 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'subnet': {'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162', 'cidr': '2001:db8:2::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:2::1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:10.381719 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12fb33ef-9290-4d74-a7f1-97ba6d68383a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Network': ['ID=8e0cfbe6-9002-42c6-8e79-8d95b404c162,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:10.403362 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 8e0cfbe6-9002-42c6-8e79-8d95b404c162 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:33:10.416789 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48478) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:10.503331 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:08Z', 'revision_number': 3, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:06Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'aebca6d3-dcf2-40d7-897d-d683ffd7a3c5', 'name': '', 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:dd:5f:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:07Z', 'updated_at': '2021-12-09T21:33:08Z', 'revision_number': 2, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:10.529627 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-0c024b0c-5db9-4fc2-b0ba-eb81e14811f4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Request body: {'network': {'name': 'tempest-RoutersAdminTest-1591076647', 'router:external': True}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:10.533262 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] Checking router: 6c885eb2-40c3-4066-83da-e64e5ab2723e for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:33:10.533619 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] Updating router 6c885eb2-40c3-4066-83da-e64e5ab2723e port aebca6d3-dcf2-40d7-897d-d683ffd7a3c5 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:33:10.538156 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1fed8ed-8a0d-4221-8556-d1ec47a60243 req-f9894951-ac71-445b-b3b6-37920f9facc9 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:10.539754 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e1fed8ed-8a0d-4221-8556-d1ec47a60243 req-f9894951-ac71-445b-b3b6-37920f9facc9 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.2007906 Dec 09 21:33:10.558533 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:10.561490 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02591754-9cc9-4fbd-9b6f-bdff185a86f6 req-d14b67ee-c897-46a2-916c-81cc80453e36 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:10.563075 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02591754-9cc9-4fbd-9b6f-bdff185a86f6 req-d14b67ee-c897-46a2-916c-81cc80453e36 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1013775 Dec 09 21:33:10.564923 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-88572788-b849-4514-8212-60c7f3772318 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Made reservation on behalf of dc5c46f00552473abc0991c0cc4a0269 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:33:10.568408 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-88572788-b849-4514-8212-60c7f3772318 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:10.580709 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0c024b0c-5db9-4fc2-b0ba-eb81e14811f4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Made reservation on behalf of 355561057aae464295eb0ce91a41002c for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:33:10.583521 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0c024b0c-5db9-4fc2-b0ba-eb81e14811f4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:10.593947 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0c024b0c-5db9-4fc2-b0ba-eb81e14811f4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:10.677790 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0c024b0c-5db9-4fc2-b0ba-eb81e14811f4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:10.685440 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0c024b0c-5db9-4fc2-b0ba-eb81e14811f4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:10.708032 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0c024b0c-5db9-4fc2-b0ba-eb81e14811f4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] vlan segment allocate from pool success with {'vlan_id': 105, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:33:10.729402 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0c024b0c-5db9-4fc2-b0ba-eb81e14811f4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:10.729786 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-0c024b0c-5db9-4fc2-b0ba-eb81e14811f4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Added segment 16c86a17-27d9-463d-840f-fb913df25746 of type vlan for network e27c361e-5c1d-4309-9f23-0b199b13ac47 Dec 09 21:33:10.737932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c024b0c-5db9-4fc2-b0ba-eb81e14811f4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e8d5e173-9364-4c1e-b4e0-399e11ea9e5e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:10.783046 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0c024b0c-5db9-4fc2-b0ba-eb81e14811f4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:10.817545 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0c024b0c-5db9-4fc2-b0ba-eb81e14811f4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:10.819472 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c024b0c-5db9-4fc2-b0ba-eb81e14811f4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:10.822247 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0c024b0c-5db9-4fc2-b0ba-eb81e14811f4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:10.858474 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:10.864955 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:10.887807 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c024b0c-5db9-4fc2-b0ba-eb81e14811f4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Pushing event updated for resources: {'Network': ['ID=e27c361e-5c1d-4309-9f23-0b199b13ac47,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:10.905718 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network e27c361e-5c1d-4309-9f23-0b199b13ac47 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:33:10.908057 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0c024b0c-5db9-4fc2-b0ba-eb81e14811f4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 871 time: 0.4902542 Dec 09 21:33:10.909879 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48482) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:10.916306 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-1a691f52-417a-4700-b84e-007c2109eb37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Request body: {'subnet': {'network_id': 'e27c361e-5c1d-4309-9f23-0b199b13ac47', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:10.944897 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1a691f52-417a-4700-b84e-007c2109eb37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Made reservation on behalf of 355561057aae464295eb0ce91a41002c for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:33:10.948897 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a691f52-417a-4700-b84e-007c2109eb37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:10.955969 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a42bf4d3-7b70-4bbc-b953-c371a7e28316 None None] Pushing event updated for resources: {'Port': ['ID=aebca6d3-dcf2-40d7-897d-d683ffd7a3c5,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:11.092860 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e1fed8ed-8a0d-4221-8556-d1ec47a60243 req-3386f6ec-85bd-4989-a42b-5102aa511f58 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5455811 Dec 09 21:33:11.172899 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02591754-9cc9-4fbd-9b6f-bdff185a86f6 req-ee070ec8-8fc1-4751-9829-52c0036a29d1 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5917408 Dec 09 21:33:11.265368 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] Attempting to bind port aebca6d3-dcf2-40d7-897d-d683ffd7a3c5 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:33:11.266018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] Attempting to bind port aebca6d3-dcf2-40d7-897d-d683ffd7a3c5 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'db8dcd7d-243b-46e6-86d4-46d2f3f0dc00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:33:11.268712 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] Attempting to bind port aebca6d3-dcf2-40d7-897d-d683ffd7a3c5 on network eeb87237-a90d-4250-8d44-cff75a6e4c02 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:33:11.284343 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 33, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:33:11.284729 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] Checking segment: {'id': 'db8dcd7d-243b-46e6-86d4-46d2f3f0dc00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:33:11.285144 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:11.285593 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] Bound using segment: {'id': 'db8dcd7d-243b-46e6-86d4-46d2f3f0dc00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:33:11.286106 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] Bound port: aebca6d3-dcf2-40d7-897d-d683ffd7a3c5, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'db8dcd7d-243b-46e6-86d4-46d2f3f0dc00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:33:11.286453 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:11.297642 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d5df99e-daab-4ffd-a45b-57b77df915c4 req-9e5d42d4-82b7-4c04-bcd4-2003da0a0a49 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:11.304008 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d5df99e-daab-4ffd-a45b-57b77df915c4 req-9e5d42d4-82b7-4c04-bcd4-2003da0a0a49 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=0572d5ce-eab2-4fdc-9c73-034455c686d3 HTTP/1.1" status: 200 len: 946 time: 0.0954273 Dec 09 21:33:11.363719 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b44a0bc2-db66-44a6-b212-8d1af155f019 None None] Provisioning complete for port aebca6d3-dcf2-40d7-897d-d683ffd7a3c5 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:11.364187 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b44a0bc2-db66-44a6-b212-8d1af155f019 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:11.378661 n-d-713301-27 neutron-server[103437]: DEBUG neutron.objects.ports [None req-1a691f52-417a-4700-b84e-007c2109eb37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103437) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 09 21:33:11.379248 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a691f52-417a-4700-b84e-007c2109eb37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:11.400992 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] For port aebca6d3-dcf2-40d7-897d-d683ffd7a3c5, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:33:11.405743 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] For port aebca6d3-dcf2-40d7-897d-d683ffd7a3c5, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=aebca6d3-dcf2-40d7-897d-d683ffd7a3c5,segment=NetworkSegment(db8dcd7d-243b-46e6-86d4-46d2f3f0dc00),segment_id=db8dcd7d-243b-46e6-86d4-46d2f3f0dc00)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:33:11.413610 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:11.425982 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-b44a0bc2-db66-44a6-b212-8d1af155f019 None None] Port aebca6d3-dcf2-40d7-897d-d683ffd7a3c5 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:33:11.430189 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4543f9c-e3bb-40bf-a481-a9bfa101c324 req-4699f7e8-dcfc-4b11-9cf6-5f391f8e546a tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:11.431850 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4543f9c-e3bb-40bf-a481-a9bfa101c324 req-4699f7e8-dcfc-4b11-9cf6-5f391f8e546a tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.1189475 Dec 09 21:33:11.432880 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-88572788-b849-4514-8212-60c7f3772318 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:11.440360 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a691f52-417a-4700-b84e-007c2109eb37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Pushing event updated for resources: {'Subnet': ['ID=d9ca0339-2812-429c-9183-5fd9dd4b1548,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:11.449228 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a691f52-417a-4700-b84e-007c2109eb37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Checking segment: {'id': '16c86a17-27d9-463d-840f-fb913df25746', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': 'e27c361e-5c1d-4309-9f23-0b199b13ac47'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:33:11.449600 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a691f52-417a-4700-b84e-007c2109eb37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Network hostable DHCP agents. Network: e27c361e-5c1d-4309-9f23-0b199b13ac47, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:33:11.471335 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d5df99e-daab-4ffd-a45b-57b77df915c4 req-0bb73285-5e28-4015-8a29-bcbc971ff92e tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1659813 Dec 09 21:33:11.472927 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a691f52-417a-4700-b84e-007c2109eb37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Network e27c361e-5c1d-4309-9f23-0b199b13ac47 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:33:11.474717 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] Routers {'6c885eb2-40c3-4066-83da-e64e5ab2723e'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:11.475457 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6c885eb2-40c3-4066-83da-e64e5ab2723e'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:11.489315 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-1a691f52-417a-4700-b84e-007c2109eb37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, e27c361e-5c1d-4309-9f23-0b199b13ac47) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:11.513273 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1a691f52-417a-4700-b84e-007c2109eb37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:11.513889 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a691f52-417a-4700-b84e-007c2109eb37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:11.522663 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7d1db9d6-49db-4718-a8f8-38aa3e316efe None None] Network e27c361e-5c1d-4309-9f23-0b199b13ac47 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:33:11.530850 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88572788-b849-4514-8212-60c7f3772318 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Subnet': ['ID=f6a9f8ec-203e-476b-a436-3472ba061489,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:11.561769 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1a691f52-417a-4700-b84e-007c2109eb37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 0.6499734 Dec 09 21:33:11.564207 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48498) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:11.572912 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a42bf4d3-7b70-4bbc-b953-c371a7e28316 None None] Pushing event updated for resources: {'Port': ['ID=aebca6d3-dcf2-40d7-897d-d683ffd7a3c5,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:11.581541 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88572788-b849-4514-8212-60c7f3772318 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Checking segment: {'id': 'aefee495-6d7c-460f-b4a3-a320048af8d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:33:11.581898 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88572788-b849-4514-8212-60c7f3772318 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network hostable DHCP agents. Network: 8e0cfbe6-9002-42c6-8e79-8d95b404c162, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:33:11.589503 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-436ae49c-361f-446a-b345-167113fc217c tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminTest-568355081', 'network_id': 'e27c361e-5c1d-4309-9f23-0b199b13ac47'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:11.597206 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4543f9c-e3bb-40bf-a481-a9bfa101c324 req-e7435db4-a3ea-4b8d-99c4-13043ef2b89c tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1387756 Dec 09 21:33:11.627758 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88572788-b849-4514-8212-60c7f3772318 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network 8e0cfbe6-9002-42c6-8e79-8d95b404c162 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:33:11.643403 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-436ae49c-361f-446a-b345-167113fc217c tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Made reservation on behalf of 355561057aae464295eb0ce91a41002c for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:33:11.646151 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-88572788-b849-4514-8212-60c7f3772318 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 8e0cfbe6-9002-42c6-8e79-8d95b404c162) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:11.646530 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-436ae49c-361f-446a-b345-167113fc217c tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:11.672715 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88572788-b849-4514-8212-60c7f3772318 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:11.673304 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-436ae49c-361f-446a-b345-167113fc217c tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] device_id is not set on port 38fcf64b-8503-4c42-86b9-546d476569a6 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:33:11.674807 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-88572788-b849-4514-8212-60c7f3772318 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:11.707087 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-88572788-b849-4514-8212-60c7f3772318 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.4007893 Dec 09 21:33:11.710012 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ffd00da0-296d-4bbf-9eb0-b2ae7d984cd3 None None] Network 8e0cfbe6-9002-42c6-8e79-8d95b404c162 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:33:11.710276 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48502) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:11.820320 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] Set router 6c885eb2-40c3-4066-83da-e64e5ab2723e gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:11.831478 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-436ae49c-361f-446a-b345-167113fc217c tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Allocated IP 172.20.0.12 (e27c361e-5c1d-4309-9f23-0b199b13ac47/d9ca0339-2812-429c-9183-5fd9dd4b1548/38fcf64b-8503-4c42-86b9-546d476569a6) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:33:12.041117 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5259c124-7572-4cf6-b449-9503b11d9641 req-a18e5a8d-54fa-4e71-8004-e7112af9d2e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:12.042668 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5259c124-7572-4cf6-b449-9503b11d9641 req-a18e5a8d-54fa-4e71-8004-e7112af9d2e0 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 1097 time: 0.0919816 Dec 09 21:33:12.104069 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53bc5627-3252-467f-9255-6d372864ac65 None None] Network e27c361e-5c1d-4309-9f23-0b199b13ac47 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:33:12.150244 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5259c124-7572-4cf6-b449-9503b11d9641 req-bcbd4f1d-13d8-403e-a1d4-7d868011c57b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:12.152151 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5259c124-7572-4cf6-b449-9503b11d9641 req-bcbd4f1d-13d8-403e-a1d4-7d868011c57b service neutron] 10.222.0.31 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 913 time: 0.0999830 Dec 09 21:33:12.157688 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-436ae49c-361f-446a-b345-167113fc217c tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:12.165424 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b3136a1d-440d-43e8-9d54-1ed3478627af None None] Provisioning complete for port aebca6d3-dcf2-40d7-897d-d683ffd7a3c5 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:12.167309 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b3136a1d-440d-43e8-9d54-1ed3478627af None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:12.244967 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5259c124-7572-4cf6-b449-9503b11d9641 req-b6ec2ca1-8483-4e80-a741-9f40370a0e6f service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=90f16e74-f2e6-416e-a079-f205615a0d8e HTTP/1.1" status: 200 len: 1000 time: 0.0853798 Dec 09 21:33:12.247372 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6b10a19-de79-451a-9df9-8467ad715b56 req-3423ccd9-b0d8-44ea-a656-391e2ffe79d8 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:12.252006 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a6b10a19-de79-451a-9df9-8467ad715b56 req-3423ccd9-b0d8-44ea-a656-391e2ffe79d8 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 945 time: 0.1817627 Dec 09 21:33:12.283169 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-436ae49c-361f-446a-b345-167113fc217c tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:12.315728 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c450cb93-abb5-4602-9259-a026fd8cb937 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-8e0cfbe6-9002-42c6-8e79-8d95b404c162', 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162', 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'fixed_ips': [{'subnet_id': 'f6a9f8ec-203e-476b-a436-3472ba061489'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:33:12.316640 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c450cb93-abb5-4602-9259-a026fd8cb937 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:12.342537 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-436ae49c-361f-446a-b345-167113fc217c tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Network e27c361e-5c1d-4309-9f23-0b199b13ac47 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:33:12.347345 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5259c124-7572-4cf6-b449-9503b11d9641 req-9a08fbe8-0f5a-4e84-ba8a-60a906cb9be9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:12.348978 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5259c124-7572-4cf6-b449-9503b11d9641 req-9a08fbe8-0f5a-4e84-ba8a-60a906cb9be9 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 200 len: 851 time: 0.0957940 Dec 09 21:33:12.350694 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-436ae49c-361f-446a-b345-167113fc217c tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:12.352676 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-436ae49c-361f-446a-b345-167113fc217c tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Pushing event updated for resources: {'Port': ['ID=38fcf64b-8503-4c42-86b9-546d476569a6,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:12.354880 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-436ae49c-361f-446a-b345-167113fc217c tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:33:12.406012 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2240ed08-ca74-4cf1-ad0c-369d12917caf req-cb534048-7daa-4aa3-9b72-6e938ad2850a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:12.411914 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2240ed08-ca74-4cf1-ad0c-369d12917caf req-cb534048-7daa-4aa3-9b72-6e938ad2850a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1906972 Dec 09 21:33:12.431883 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a6b10a19-de79-451a-9df9-8467ad715b56 req-d681104e-3b4f-4662-bf59-47c2f54d9ec5 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1650107 Dec 09 21:33:12.438086 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5ea95d4-886d-4d5f-998e-f2080bd2aaf7 req-8fb70190-d4ab-448e-810d-31c45bf9fbc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:12.439730 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5ea95d4-886d-4d5f-998e-f2080bd2aaf7 req-8fb70190-d4ab-448e-810d-31c45bf9fbc6 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=aacb3291db4d4252a9225e8fe617f667&device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 1098 time: 0.2101431 Dec 09 21:33:12.586681 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b3136a1d-440d-43e8-9d54-1ed3478627af None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:12.609425 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-c450cb93-abb5-4602-9259-a026fd8cb937 None None] Allocated IP 2001:db8:2::2 (8e0cfbe6-9002-42c6-8e79-8d95b404c162/f6a9f8ec-203e-476b-a436-3472ba061489/64c16765-599f-4fe9-a043-c428c204b3c2) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:33:12.628457 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6fc9baa-09a5-4f89-9a17-90d68e966fa1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:12.657482 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2240ed08-ca74-4cf1-ad0c-369d12917caf req-4df31de8-8471-477b-b467-78e8ad978968 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2217510 Dec 09 21:33:12.665965 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:08Z', 'revision_number': 3, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:06Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'aebca6d3-dcf2-40d7-897d-d683ffd7a3c5', 'name': '', 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:dd:5f:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:07Z', 'updated_at': '2021-12-09T21:33:11Z', 'revision_number': 4, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:12.668905 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-b3136a1d-440d-43e8-9d54-1ed3478627af None None] For port aebca6d3-dcf2-40d7-897d-d683ffd7a3c5, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=aebca6d3-dcf2-40d7-897d-d683ffd7a3c5,segment=NetworkSegment(db8dcd7d-243b-46e6-86d4-46d2f3f0dc00),segment_id=db8dcd7d-243b-46e6-86d4-46d2f3f0dc00)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:12.706326 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b3136a1d-440d-43e8-9d54-1ed3478627af None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:12.708258 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe6ed22f-3273-42c4-b2bc-2929af055a47 None None] The sync data for ids ['6c885eb2-40c3-4066-83da-e64e5ab2723e'] in n-d-713301-27 is: [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:08Z', 'revision_number': 3, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:06Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'aebca6d3-dcf2-40d7-897d-d683ffd7a3c5', 'name': '', 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:dd:5f:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:07Z', 'updated_at': '2021-12-09T21:33:11Z', 'revision_number': 4, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:33:12.721831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5ea95d4-886d-4d5f-998e-f2080bd2aaf7 req-6cc1d6b9-91b5-4785-a43a-7cdad1c908b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:12.723146 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5ea95d4-886d-4d5f-998e-f2080bd2aaf7 req-6cc1d6b9-91b5-4785-a43a-7cdad1c908b0 service neutron] 10.222.0.31 "GET /v2.0/networks?id=935b09ce-7410-4b66-82be-99978deb6717 HTTP/1.1" status: 200 len: 912 time: 0.2639685 Dec 09 21:33:12.760814 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-436ae49c-361f-446a-b345-167113fc217c tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:12.760814 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-436ae49c-361f-446a-b345-167113fc217c tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:12.765516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5259c124-7572-4cf6-b449-9503b11d9641 req-78545079-84de-4b09-b21c-174532ca4d45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:12.767032 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5259c124-7572-4cf6-b449-9503b11d9641 req-78545079-84de-4b09-b21c-174532ca4d45 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.4096568 Dec 09 21:33:12.792205 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-436ae49c-361f-446a-b345-167113fc217c tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1023 time: 1.2246261 Dec 09 21:33:12.808749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7ce94fb-2be1-43e7-8c92-49b7bdc2011d req-ab82b4a5-8f4d-4198-95c8-3573ee209fa3 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:12.816781 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c7ce94fb-2be1-43e7-8c92-49b7bdc2011d req-ab82b4a5-8f4d-4198-95c8-3573ee209fa3 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.2206573 Dec 09 21:33:12.818931 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48510) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:12.850456 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-a3c7a9e3-b7d8-4807-ac1c-19dc378eb44b req-d62c90c9-303a-4584-b846-69ec43cc0b68 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:33:12.862496 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a3c7a9e3-b7d8-4807-ac1c-19dc378eb44b req-d62c90c9-303a-4584-b846-69ec43cc0b68 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0388706 Dec 09 21:33:12.913756 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3136a1d-440d-43e8-9d54-1ed3478627af None None] Pushing event updated for resources: {'Port': ['ID=aebca6d3-dcf2-40d7-897d-d683ffd7a3c5,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:12.940324 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c450cb93-abb5-4602-9259-a026fd8cb937 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:12.951771 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c450cb93-abb5-4602-9259-a026fd8cb937 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:12.952396 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5259c124-7572-4cf6-b449-9503b11d9641 req-8b289303-ceaf-49e9-ae58-b5362613dede service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1768312 Dec 09 21:33:13.011134 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c450cb93-abb5-4602-9259-a026fd8cb937 None None] Network 8e0cfbe6-9002-42c6-8e79-8d95b404c162 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:33:13.017933 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-c450cb93-abb5-4602-9259-a026fd8cb937 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:13.022624 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c450cb93-abb5-4602-9259-a026fd8cb937 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:33:13.026219 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c450cb93-abb5-4602-9259-a026fd8cb937 None None] Pushing event updated for resources: {'Port': ['ID=64c16765-599f-4fe9-a043-c428c204b3c2,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:13.091504 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-3828a0c4-06f3-42ab-b734-0c8acbb321dc service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 665 time: 0.1977103 Dec 09 21:33:13.096732 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-c450cb93-abb5-4602-9259-a026fd8cb937 None None] Attempting to bind port 64c16765-599f-4fe9-a043-c428c204b3c2 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:33:13.097256 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-c450cb93-abb5-4602-9259-a026fd8cb937 None None] Attempting to bind port 64c16765-599f-4fe9-a043-c428c204b3c2 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'aefee495-6d7c-460f-b4a3-a320048af8d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:33:13.097715 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c450cb93-abb5-4602-9259-a026fd8cb937 None None] Attempting to bind port 64c16765-599f-4fe9-a043-c428c204b3c2 on network 8e0cfbe6-9002-42c6-8e79-8d95b404c162 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:33:13.102821 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5259c124-7572-4cf6-b449-9503b11d9641 req-98426962-a023-4cec-8961-0b07cb248b32 service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1415312 Dec 09 21:33:13.103527 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c450cb93-abb5-4602-9259-a026fd8cb937 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 33, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:33:13.104002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c450cb93-abb5-4602-9259-a026fd8cb937 None None] Checking segment: {'id': 'aefee495-6d7c-460f-b4a3-a320048af8d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:33:13.104480 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c450cb93-abb5-4602-9259-a026fd8cb937 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:13.105028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c450cb93-abb5-4602-9259-a026fd8cb937 None None] Bound using segment: {'id': 'aefee495-6d7c-460f-b4a3-a320048af8d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:33:13.105555 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-c450cb93-abb5-4602-9259-a026fd8cb937 None None] Bound port: 64c16765-599f-4fe9-a043-c428c204b3c2, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aefee495-6d7c-460f-b4a3-a320048af8d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:33:13.106124 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c450cb93-abb5-4602-9259-a026fd8cb937 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:13.188411 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c450cb93-abb5-4602-9259-a026fd8cb937 None None] For port 64c16765-599f-4fe9-a043-c428c204b3c2, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:33:13.195281 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c450cb93-abb5-4602-9259-a026fd8cb937 None None] For port 64c16765-599f-4fe9-a043-c428c204b3c2, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=64c16765-599f-4fe9-a043-c428c204b3c2,segment=NetworkSegment(aefee495-6d7c-460f-b4a3-a320048af8d9),segment_id=aefee495-6d7c-460f-b4a3-a320048af8d9)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:33:13.204495 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c450cb93-abb5-4602-9259-a026fd8cb937 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:13.215977 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-1360ac78-3e30-4ad9-83b8-95793cbd3437 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:13.217516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-1360ac78-3e30-4ad9-83b8-95793cbd3437 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:13.218941 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-1360ac78-3e30-4ad9-83b8-95793cbd3437 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:13.219634 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-1360ac78-3e30-4ad9-83b8-95793cbd3437 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:13.220308 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-1360ac78-3e30-4ad9-83b8-95793cbd3437 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:13.221419 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-1360ac78-3e30-4ad9-83b8-95793cbd3437 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:13.222222 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-1360ac78-3e30-4ad9-83b8-95793cbd3437 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:13.223097 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5ea95d4-886d-4d5f-998e-f2080bd2aaf7 req-4a88e91e-ab52-463b-8dc9-0248323f89f6 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=042e101d-fba7-4c12-8471-48255f57bee1 HTTP/1.1" status: 200 len: 1002 time: 0.4674366 Dec 09 21:33:13.224836 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-1360ac78-3e30-4ad9-83b8-95793cbd3437 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0a5d0e4652be4d8b87936a559840cc87&device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 6509 time: 0.0815578 Dec 09 21:33:13.268645 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c7ce94fb-2be1-43e7-8c92-49b7bdc2011d req-694e99fe-82ea-4cbe-813f-0760b29bbe14 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4503934 Dec 09 21:33:13.278398 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-a6fc9baa-09a5-4f89-9a17-90d68e966fa1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Allocated IP 2001:db8:2::1 (8e0cfbe6-9002-42c6-8e79-8d95b404c162/f6a9f8ec-203e-476b-a436-3472ba061489/6d011808-2a44-4e33-ba9f-38ccde498262) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:33:13.290354 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c450cb93-abb5-4602-9259-a026fd8cb937 None None] Pushing event updated for resources: {'Port': ['ID=64c16765-599f-4fe9-a043-c428c204b3c2,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:13.459497 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5ea95d4-886d-4d5f-998e-f2080bd2aaf7 req-9154f36b-dfea-4b7d-8488-c4c099854c2d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:13.461696 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5ea95d4-886d-4d5f-998e-f2080bd2aaf7 req-9154f36b-dfea-4b7d-8488-c4c099854c2d service neutron] 10.222.0.31 "GET /v2.0/subnets?id=10ff3f47-d1f4-47a0-808e-f885899dfb29 HTTP/1.1" status: 200 len: 850 time: 0.2266920 Dec 09 21:33:13.466106 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-108eb7a6-7209-420a-9b2b-e4f9b40a63b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:13.470306 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-108eb7a6-7209-420a-9b2b-e4f9b40a63b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:13.471712 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-108eb7a6-7209-420a-9b2b-e4f9b40a63b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:13.473345 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-108eb7a6-7209-420a-9b2b-e4f9b40a63b8 service neutron] 10.222.0.10 "GET /v2.0/networks?id=361619eb-51a4-4728-b2cc-72e27ec4eca5&id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&id=ae9d25d5-c9a2-4627-a465-8324b17541d9&id=ae9d25d5-c9a2-4627-a465-8324b17541d9 HTTP/1.1" status: 200 len: 2296 time: 0.2181139 Dec 09 21:33:13.485127 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device aebca6d3-dcf2-40d7-897d-d683ffd7a3c5 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:33:13.499663 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a3c7a9e3-b7d8-4807-ac1c-19dc378eb44b req-9d9b691c-624d-4ab8-b4f1-f17edb728a27 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D172.20.0.11&fields=device_id HTTP/1.1" status: 200 len: 262 time: 0.5979717 Dec 09 21:33:13.576455 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port aebca6d3-dcf2-40d7-897d-d683ffd7a3c5 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:13.577764 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:13.634317 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-f53b9dab-dbfe-4351-916c-c2c3f3981bb7 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a HTTP/1.1" status: 200 len: 1002 time: 0.1526084 Dec 09 21:33:13.752643 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-36e06658-d34c-46d3-b4db-f5f438a997fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:13.754171 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-36e06658-d34c-46d3-b4db-f5f438a997fd service neutron] 10.222.0.10 "GET /v2.0/subnets?id=d989acab-7cdc-482f-a350-344dd6e11873 HTTP/1.1" status: 200 len: 856 time: 0.1096787 Dec 09 21:33:13.783243 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-bf108b57-87ae-4c29-a3e8-c7018368ad25 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Deleting port 38fcf64b-8503-4c42-86b9-546d476569a6 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:13.784054 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf108b57-87ae-4c29-a3e8-c7018368ad25 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:13.894721 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-60952681-1cb4-49b5-a996-6ef6633d4483 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:13.897113 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-60952681-1cb4-49b5-a996-6ef6633d4483 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=361619eb-51a4-4728-b2cc-72e27ec4eca5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1341481 Dec 09 21:33:13.963464 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5ea95d4-886d-4d5f-998e-f2080bd2aaf7 req-a2509beb-f68d-436c-a14e-bdce91555806 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:13.965149 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5ea95d4-886d-4d5f-998e-f2080bd2aaf7 req-a2509beb-f68d-436c-a14e-bdce91555806 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=935b09ce-7410-4b66-82be-99978deb6717&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.4397738 Dec 09 21:33:14.006411 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-b234a958-158d-4155-942b-0f740fc31ed5 service neutron] 10.222.0.10 "GET /v2.0/networks/361619eb-51a4-4728-b2cc-72e27ec4eca5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0995486 Dec 09 21:33:14.047904 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6fc9baa-09a5-4f89-9a17-90d68e966fa1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:14.106121 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-856bcd43-edfd-4d76-a93d-6d680755e5e1 service neutron] 10.222.0.10 "GET /v2.0/networks/361619eb-51a4-4728-b2cc-72e27ec4eca5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0919242 Dec 09 21:33:14.109354 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf108b57-87ae-4c29-a3e8-c7018368ad25 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:14.124051 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42491ccb-e630-42e7-8cc9-0e44e90d4041 req-90f9fa10-971a-4715-b7e0-5b1aa7af9947 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:14.125651 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42491ccb-e630-42e7-8cc9-0e44e90d4041 req-90f9fa10-971a-4715-b7e0-5b1aa7af9947 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.2769461 Dec 09 21:33:14.149332 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-4516a876-6b70-4f47-a1f9-aa6c15b3f4b3 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.107&port_id=18d9d7fa-fedf-4844-90ef-6757eb984ae2 HTTP/1.1" status: 200 len: 217 time: 0.0364819 Dec 09 21:33:14.151864 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-bf108b57-87ae-4c29-a3e8-c7018368ad25 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Calling delete_port for 38fcf64b-8503-4c42-86b9-546d476569a6 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:33:14.196755 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-834284de-ccb3-4263-a763-bceea7d50c60 req-cd75a8f9-c367-421d-bc7a-436e9a973cc4 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:14.198168 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-834284de-ccb3-4263-a763-bceea7d50c60 req-cd75a8f9-c367-421d-bc7a-436e9a973cc4 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.2424200 Dec 09 21:33:14.205263 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-00c0a850-4ae2-479f-b872-1396a04188b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:14.206761 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-00c0a850-4ae2-479f-b872-1396a04188b2 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=871c2dc1-486e-4fcf-a882-5a1394082fc5 HTTP/1.1" status: 200 len: 797 time: 0.0506105 Dec 09 21:33:14.255398 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-5e7fc318-7371-454c-999f-0ab3d08035bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:14.256965 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-5e7fc318-7371-454c-999f-0ab3d08035bc service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0423586 Dec 09 21:33:14.264330 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5ea95d4-886d-4d5f-998e-f2080bd2aaf7 req-d709af21-3fba-4997-a141-b5b23a1a0a13 service neutron] 10.222.0.31 "GET /v2.0/networks/935b09ce-7410-4b66-82be-99978deb6717?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2777326 Dec 09 21:33:14.280169 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6fc9baa-09a5-4f89-9a17-90d68e966fa1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:14.360804 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-34061797-79ab-4584-a4f5-ccc57614de83 service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0961747 Dec 09 21:33:14.372695 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42491ccb-e630-42e7-8cc9-0e44e90d4041 req-6e6fdf2d-57f9-4c5f-9b8c-a4df2cca0997 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2339315 Dec 09 21:33:14.408175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a6fc9baa-09a5-4f89-9a17-90d68e966fa1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network 8e0cfbe6-9002-42c6-8e79-8d95b404c162 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:33:14.424778 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-834284de-ccb3-4263-a763-bceea7d50c60 req-3b0848e8-65af-448b-93f2-38de937fc942 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2136521 Dec 09 21:33:14.457696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-a6fc9baa-09a5-4f89-9a17-90d68e966fa1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:14.461403 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6fc9baa-09a5-4f89-9a17-90d68e966fa1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:33:14.462029 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6fc9baa-09a5-4f89-9a17-90d68e966fa1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:14.471333 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6fc9baa-09a5-4f89-9a17-90d68e966fa1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Port': ['ID=6d011808-2a44-4e33-ba9f-38ccde498262,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:14.491556 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-14f37a79-10b7-46e6-95ce-1ac917368294 service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1226397 Dec 09 21:33:14.537966 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-951121e7-b79b-41dd-8175-5e6c2e0b0f54 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.197&port_id=1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f HTTP/1.1" status: 200 len: 217 time: 0.0383992 Dec 09 21:33:14.614595 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-4b2ac77d-ee02-4146-90c3-ba679cc176d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:14.616196 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-4b2ac77d-ee02-4146-90c3-ba679cc176d2 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=871c2dc1-486e-4fcf-a882-5a1394082fc5 HTTP/1.1" status: 200 len: 797 time: 0.0714333 Dec 09 21:33:14.673764 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-0196227f-1cc0-4cec-9538-eef97c3dfa5f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:14.675348 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-0196227f-1cc0-4cec-9538-eef97c3dfa5f service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0462222 Dec 09 21:33:14.778419 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-2a94cf27-0827-436b-a7e1-1f3bb3895f37 service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0952456 Dec 09 21:33:14.869614 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eac5d0ea-2961-4eed-a7c1-783cb2833258 None None] Network 8e0cfbe6-9002-42c6-8e79-8d95b404c162 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:33:14.892321 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-5073a003-028c-4566-a813-16d18addda9e service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1071432 Dec 09 21:33:14.935244 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-87f02063-8e5c-4a33-b6bf-f316d9316cf6 None None] Provisioning complete for port 64c16765-599f-4fe9-a043-c428c204b3c2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:14.935810 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-87f02063-8e5c-4a33-b6bf-f316d9316cf6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:14.937890 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-f9fca7fb-9836-47ac-ae10-a08748c0c2e8 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.40&port_id=38f97951-e872-4c24-947f-934429895ad3 HTTP/1.1" status: 200 len: 217 time: 0.0377066 Dec 09 21:33:15.001429 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-663e94ce-cabe-4aef-9636-d480e1625cf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:15.002932 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-663e94ce-cabe-4aef-9636-d480e1625cf0 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=871c2dc1-486e-4fcf-a882-5a1394082fc5 HTTP/1.1" status: 200 len: 797 time: 0.0536919 Dec 09 21:33:15.056985 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-87f02063-8e5c-4a33-b6bf-f316d9316cf6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:15.065081 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-88707643-b1a2-4fb2-b668-e6eb9258d35b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:15.066900 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-88707643-b1a2-4fb2-b668-e6eb9258d35b service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0562878 Dec 09 21:33:15.078059 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5ea95d4-886d-4d5f-998e-f2080bd2aaf7 req-30c0f06d-804c-497a-891e-eb271727cc1b service neutron] 10.222.0.31 "GET /v2.0/networks/935b09ce-7410-4b66-82be-99978deb6717?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7917099 Dec 09 21:33:15.095345 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-87f02063-8e5c-4a33-b6bf-f316d9316cf6 None None] For port 64c16765-599f-4fe9-a043-c428c204b3c2, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=64c16765-599f-4fe9-a043-c428c204b3c2,segment=NetworkSegment(aefee495-6d7c-460f-b4a3-a320048af8d9),segment_id=aefee495-6d7c-460f-b4a3-a320048af8d9)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:15.104236 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-87f02063-8e5c-4a33-b6bf-f316d9316cf6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:15.114510 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09cbe0da-9398-4684-8b96-aaf0923b3e23 req-e1ce3af2-1ce4-4563-bac6-4222e4e1c8e6 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:15.122348 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09cbe0da-9398-4684-8b96-aaf0923b3e23 req-e1ce3af2-1ce4-4563-bac6-4222e4e1c8e6 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.6548705 Dec 09 21:33:15.139653 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf108b57-87ae-4c29-a3e8-c7018368ad25 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:15.156042 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5259ba8-4b7f-4ba4-825a-14a2c8664da8 req-6aa038d8-5f17-429d-9284-7afa4aba52e4 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:15.163627 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c5259ba8-4b7f-4ba4-825a-14a2c8664da8 req-6aa038d8-5f17-429d-9284-7afa4aba52e4 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=0572d5ce-eab2-4fdc-9c73-034455c686d3 HTTP/1.1" status: 200 len: 946 time: 0.2317634 Dec 09 21:33:15.176017 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87f02063-8e5c-4a33-b6bf-f316d9316cf6 None None] Pushing event updated for resources: {'Port': ['ID=64c16765-599f-4fe9-a043-c428c204b3c2,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:15.218900 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-1b24f625-e0b8-4ee4-ab08-eadc26375b87 service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1418607 Dec 09 21:33:15.231508 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf108b57-87ae-4c29-a3e8-c7018368ad25 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Pushing event deleted for resources: {'Port': ['ID=38fcf64b-8503-4c42-86b9-546d476569a6,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:15.259202 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6fc9baa-09a5-4f89-9a17-90d68e966fa1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:15.318301 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-cf51bc08-2e42-497d-9e8e-10966d844458 service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0934262 Dec 09 21:33:15.359958 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09cbe0da-9398-4684-8b96-aaf0923b3e23 req-bc4090ba-22e2-4ce2-96e8-c8676e5c395d tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2338512 Dec 09 21:33:15.373505 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-545c812d-e67d-4c88-9698-a81cac3937fa service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.103&port_id=57519c10-1d02-4ce7-b4be-b37a7bd58b09 HTTP/1.1" status: 200 len: 217 time: 0.0406427 Dec 09 21:33:15.419096 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c5259ba8-4b7f-4ba4-825a-14a2c8664da8 req-fe504218-cb66-47c0-b428-628dfbe0b413 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2545552 Dec 09 21:33:15.441365 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf108b57-87ae-4c29-a3e8-c7018368ad25 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:15.448499 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bf108b57-87ae-4c29-a3e8-c7018368ad25 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "DELETE /v2.0/ports/38fcf64b-8503-4c42-86b9-546d476569a6 HTTP/1.1" status: 204 len: 168 time: 2.6135747 Dec 09 21:33:15.452658 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48538) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:15.458033 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-813d1687-f33f-4023-b4b4-1222b1d84e79 None None] Provisioning complete for port 6d011808-2a44-4e33-ba9f-38ccde498262 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:15.458289 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-813d1687-f33f-4023-b4b4-1222b1d84e79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:15.462112 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-edddc446-58ad-4c22-8963-3bbed2ac0f28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:15.466835 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-edddc446-58ad-4c22-8963-3bbed2ac0f28 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=871c2dc1-486e-4fcf-a882-5a1394082fc5 HTTP/1.1" status: 200 len: 797 time: 0.0907242 Dec 09 21:33:15.467832 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-dee4c8dd-a918-4ef4-8b8e-37ecb65c3aa0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': 'e27c361e-5c1d-4309-9f23-0b199b13ac47', 'external_fixed_ips': [{'subnet_id': 'd9ca0339-2812-429c-9183-5fd9dd4b1548', 'ip_address': '172.20.0.12'}]}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:15.557725 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 64c16765-599f-4fe9-a043-c428c204b3c2 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:33:15.568347 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-c091c1b4-a406-4edb-a42b-7a36ecbd02da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:15.571131 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-c091c1b4-a406-4edb-a42b-7a36ecbd02da service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0977814 Dec 09 21:33:15.580688 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-813d1687-f33f-4023-b4b4-1222b1d84e79 None None] Port 6d011808-2a44-4e33-ba9f-38ccde498262 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:33:15.616529 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-813d1687-f33f-4023-b4b4-1222b1d84e79 None None] Provisioning complete for port 64c16765-599f-4fe9-a043-c428c204b3c2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:15.617001 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-813d1687-f33f-4023-b4b4-1222b1d84e79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:15.644178 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dee4c8dd-a918-4ef4-8b8e-37ecb65c3aa0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:15.645254 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dee4c8dd-a918-4ef4-8b8e-37ecb65c3aa0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:15.686164 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-e1d26ede-3e19-4ee3-88b0-fd673d1502fa service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1077158 Dec 09 21:33:15.711892 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 64c16765-599f-4fe9-a043-c428c204b3c2 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:15.712298 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:15.772683 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b9aaaf4-802d-48ac-ba3f-bc5f16fca633 req-f7bcc0f0-19fd-4b88-8204-e1c5be841308 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:15.781252 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4b9aaaf4-802d-48ac-ba3f-bc5f16fca633 req-f7bcc0f0-19fd-4b88-8204-e1c5be841308 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1986966 Dec 09 21:33:15.859930 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-c2196f66-ab06-41d0-bee0-cd090d7ccd49 service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1579182 Dec 09 21:33:15.861769 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dee4c8dd-a918-4ef4-8b8e-37ecb65c3aa0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:15.905419 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-951b33dc-0ef3-491a-a33e-318825e09bbf service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.100&port_id=f6c2c656-c5c9-4a38-baf6-3924df82937d HTTP/1.1" status: 200 len: 217 time: 0.0377362 Dec 09 21:33:15.910892 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ec3f8d38-9582-4efd-aca7-1c5ed4925647 None None] Provisioning complete for port 6d011808-2a44-4e33-ba9f-38ccde498262 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:15.911479 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ec3f8d38-9582-4efd-aca7-1c5ed4925647 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:15.949842 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ec3f8d38-9582-4efd-aca7-1c5ed4925647 None None] Port 6d011808-2a44-4e33-ba9f-38ccde498262 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:33:15.966176 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-7d6a1cef-3729-448e-b29d-3c52ca4b53db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:15.967830 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-7d6a1cef-3729-448e-b29d-3c52ca4b53db service neutron] 10.222.0.10 "GET /v2.0/subnets?id=2b4dff83-a3e7-4d10-a901-43c21154e5da HTTP/1.1" status: 200 len: 797 time: 0.0559773 Dec 09 21:33:15.968835 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acd94a62-1ee6-4254-a4ed-b11d9679296a req-4fc4f0c8-1f00-4c66-83d8-4db2469a0540 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:15.970352 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-acd94a62-1ee6-4254-a4ed-b11d9679296a req-4fc4f0c8-1f00-4c66-83d8-4db2469a0540 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 945 time: 0.2767518 Dec 09 21:33:16.013871 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-2d8858bd-0040-4676-bc33-545b8f6ae615 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:16.015782 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-2d8858bd-0040-4676-bc33-545b8f6ae615 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=ae9d25d5-c9a2-4627-a465-8324b17541d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0408375 Dec 09 21:33:16.050573 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4b9aaaf4-802d-48ac-ba3f-bc5f16fca633 req-ae6c5ba0-cdc0-42b2-a5e8-5c78c5b963c1 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2684002 Dec 09 21:33:16.071616 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:33:16.133816 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-2e89c4d4-e9e7-4171-891b-d646bd848653 service neutron] 10.222.0.10 "GET /v2.0/networks/ae9d25d5-c9a2-4627-a465-8324b17541d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1097157 Dec 09 21:33:16.139422 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dee4c8dd-a918-4ef4-8b8e-37ecb65c3aa0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:16.169139 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6fc9baa-09a5-4f89-9a17-90d68e966fa1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:16.189136 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-acd94a62-1ee6-4254-a4ed-b11d9679296a req-539edaff-c354-4da6-8144-405058024b1e tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2107058 Dec 09 21:33:16.190799 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6fc9baa-09a5-4f89-9a17-90d68e966fa1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:16.191619 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6fc9baa-09a5-4f89-9a17-90d68e966fa1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:16.271099 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-a3499a3d-1404-426f-9f1a-2713b8067bb9 service neutron] 10.222.0.10 "GET /v2.0/networks/ae9d25d5-c9a2-4627-a465-8324b17541d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1198819 Dec 09 21:33:16.320630 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6fc9baa-09a5-4f89-9a17-90d68e966fa1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Port': ['ID=6d011808-2a44-4e33-ba9f-38ccde498262,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:16.327923 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-5d0f09f9-891a-4a4c-a411-aad6a24a4875 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=2c568c8f-47ca-4f47-ab71-187026ca02db HTTP/1.1" status: 200 len: 217 time: 0.0409100 Dec 09 21:33:16.382230 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-06a4fa5b-8f1c-43e0-8b13-33cd4ad0ab0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:16.383763 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-06a4fa5b-8f1c-43e0-8b13-33cd4ad0ab0c service neutron] 10.222.0.10 "GET /v2.0/subnets?id=2b4dff83-a3e7-4d10-a901-43c21154e5da HTTP/1.1" status: 200 len: 797 time: 0.0485134 Dec 09 21:33:16.430290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-5fc1813e-c044-4675-a8f7-189de1fe3c33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:16.431797 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-5fc1813e-c044-4675-a8f7-189de1fe3c33 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=ae9d25d5-c9a2-4627-a465-8324b17541d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0413556 Dec 09 21:33:16.434816 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e064d66a-db85-4e07-a3d4-c3044559382a req-7153bcf6-9749-4759-8f9a-7398bebc59fd tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:16.436918 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e064d66a-db85-4e07-a3d4-c3044559382a req-7153bcf6-9749-4759-8f9a-7398bebc59fd tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.2001724 Dec 09 21:33:16.489466 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a6fc9baa-09a5-4f89-9a17-90d68e966fa1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network 8e0cfbe6-9002-42c6-8e79-8d95b404c162 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:33:16.499396 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-a6fc9baa-09a5-4f89-9a17-90d68e966fa1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:16.517183 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ba74ce1-d029-4216-845e-5f26a2f3ef4d req-4b75b232-8b4e-48ee-8cb3-608e4eb62283 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:16.523628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ba74ce1-d029-4216-845e-5f26a2f3ef4d req-4b75b232-8b4e-48ee-8cb3-608e4eb62283 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:16.524983 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-51b61a19-0e51-4648-b601-639cf1b4e50a service neutron] 10.222.0.10 "GET /v2.0/networks/ae9d25d5-c9a2-4627-a465-8324b17541d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0861948 Dec 09 21:33:16.530069 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ba74ce1-d029-4216-845e-5f26a2f3ef4d req-4b75b232-8b4e-48ee-8cb3-608e4eb62283 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:16.531761 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ba74ce1-d029-4216-845e-5f26a2f3ef4d req-4b75b232-8b4e-48ee-8cb3-608e4eb62283 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b&device_id=0572d5ce-eab2-4fdc-9c73-034455c686d3&device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 2417 time: 0.1766980 Dec 09 21:33:16.604552 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e064d66a-db85-4e07-a3d4-c3044559382a req-a48ac1ed-7f3b-4492-b221-11cc4da02111 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1538129 Dec 09 21:33:16.624323 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4093d50-1cd4-4ce3-bfde-2f217d05dc0a req-80514714-a710-4cda-8b49-df9e99d71c4c service neutron] 10.222.0.10 "GET /v2.0/networks/ae9d25d5-c9a2-4627-a465-8324b17541d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0921609 Dec 09 21:33:16.730304 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ba74ce1-d029-4216-845e-5f26a2f3ef4d req-5e33d247-adcf-4d88-8572-084ae84108ab tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1881192 Dec 09 21:33:16.787189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6d5a72dc-f5b0-4c63-8d3d-756699802226 None None] Provisioning complete for port 6d011808-2a44-4e33-ba9f-38ccde498262 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:16.787640 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6d5a72dc-f5b0-4c63-8d3d-756699802226 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:16.838262 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-6d5a72dc-f5b0-4c63-8d3d-756699802226 None None] Port 6d011808-2a44-4e33-ba9f-38ccde498262 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:33:16.845729 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a6fc9baa-09a5-4f89-9a17-90d68e966fa1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Router 6c885eb2-40c3-4066-83da-e64e5ab2723e has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:33:16.878407 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dee4c8dd-a918-4ef4-8b8e-37ecb65c3aa0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:16.889217 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12465374-004c-4d97-9f81-0fce443a98b8 req-40a44cef-de91-4308-bdab-822eaef8430e tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:16.890988 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-12465374-004c-4d97-9f81-0fce443a98b8 req-40a44cef-de91-4308-bdab-822eaef8430e tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.1662061 Dec 09 21:33:16.946958 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dee4c8dd-a918-4ef4-8b8e-37ecb65c3aa0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:16.952578 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-465262b4-4471-4e50-a513-eec7d4bf272c req-cd74c4c0-b5dd-4c84-b0fc-aee23369f285 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:33:16.953571 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-465262b4-4471-4e50-a513-eec7d4bf272c req-cd74c4c0-b5dd-4c84-b0fc-aee23369f285 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0416093 Dec 09 21:33:17.142378 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-12465374-004c-4d97-9f81-0fce443a98b8 req-510447ac-83ec-4b1d-9ee3-b6f8523491f7 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2314212 Dec 09 21:33:17.147462 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a6fc9baa-09a5-4f89-9a17-90d68e966fa1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:33:17.155497 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a6fc9baa-09a5-4f89-9a17-90d68e966fa1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/routers/6c885eb2-40c3-4066-83da-e64e5ab2723e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.4439416 Dec 09 21:33:17.158237 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48560) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:17.165043 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-871f8005-df70-4a3e-b90f-bdcd89665cb3 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'network': {'name': 'tempest-RoutersIpV6Test-531076520'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:17.174555 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] Sync routers for ids ['6c885eb2-40c3-4066-83da-e64e5ab2723e'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:33:17.185965 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] Routers {'6c885eb2-40c3-4066-83da-e64e5ab2723e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:17.186971 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6c885eb2-40c3-4066-83da-e64e5ab2723e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:17.221257 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-871f8005-df70-4a3e-b90f-bdcd89665cb3 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Made reservation on behalf of dc5c46f00552473abc0991c0cc4a0269 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:33:17.223381 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-465262b4-4471-4e50-a513-eec7d4bf272c req-c03f3b24-132a-419a-98d4-6ab01a2f2098 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D172.20.0.&fields=device_id HTTP/1.1" status: 200 len: 463 time: 0.2310624 Dec 09 21:33:17.225398 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-871f8005-df70-4a3e-b90f-bdcd89665cb3 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:17.270084 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-871f8005-df70-4a3e-b90f-bdcd89665cb3 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] vlan segment allocate from pool success with {'vlan_id': 119, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:33:17.282484 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-871f8005-df70-4a3e-b90f-bdcd89665cb3 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:17.283123 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-871f8005-df70-4a3e-b90f-bdcd89665cb3 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Added segment aa51ef62-e8c5-4a58-a997-624640e44c0b of type vlan for network b9102456-983e-454d-9648-31350235da23 Dec 09 21:33:17.286788 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-dee4c8dd-a918-4ef4-8b8e-37ecb65c3aa0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Allocated IP 172.20.0.12 (e27c361e-5c1d-4309-9f23-0b199b13ac47/d9ca0339-2812-429c-9183-5fd9dd4b1548/ade63aae-4cf1-42d5-9437-66baa9ba047f) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:33:17.297063 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] Set router 6c885eb2-40c3-4066-83da-e64e5ab2723e gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:17.349412 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-871f8005-df70-4a3e-b90f-bdcd89665cb3 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:17.384349 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-871f8005-df70-4a3e-b90f-bdcd89665cb3 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:17.393300 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-871f8005-df70-4a3e-b90f-bdcd89665cb3 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:17.394755 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-871f8005-df70-4a3e-b90f-bdcd89665cb3 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:17.436584 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-871f8005-df70-4a3e-b90f-bdcd89665cb3 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.2764232 Dec 09 21:33:17.438923 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48574) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:17.445633 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-5d190ec8-b1e0-4fed-9a43-1742533e2814 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'subnet': {'network_id': 'b9102456-983e-454d-9648-31350235da23', 'cidr': '2001:db8:3::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:3::1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:17.491760 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-074b3285-0387-4f88-8294-1321e886a7ac tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:17.500803 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-074b3285-0387-4f88-8294-1321e886a7ac tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 812 time: 0.2304766 Dec 09 21:33:17.508671 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-871f8005-df70-4a3e-b90f-bdcd89665cb3 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Network': ['ID=b9102456-983e-454d-9648-31350235da23,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:17.527028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network b9102456-983e-454d-9648-31350235da23 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:33:17.538455 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:15Z', 'revision_number': 4, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:06Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6d011808-2a44-4e33-ba9f-38ccde498262', 'name': '', 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:52:62:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1694, 'fixed_ips': [{'subnet_id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:12Z', 'updated_at': '2021-12-09T21:33:15Z', 'revision_number': 2, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'aebca6d3-dcf2-40d7-897d-d683ffd7a3c5', 'name': '', 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:dd:5f:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:07Z', 'updated_at': '2021-12-09T21:33:12Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:17.567445 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-8309ba03-2250-4254-8e44-50b870b5ecf4 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/quotas/a36a93590a9f45e1b9b3f78753bb8e12 HTTP/1.1" status: 200 len: 375 time: 0.0653989 Dec 09 21:33:17.580638 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] Checking router: 6c885eb2-40c3-4066-83da-e64e5ab2723e for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:33:17.581490 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] Updating router 6c885eb2-40c3-4066-83da-e64e5ab2723e port 6d011808-2a44-4e33-ba9f-38ccde498262 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:33:17.618174 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:17.618795 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dee4c8dd-a918-4ef4-8b8e-37ecb65c3aa0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:17.673318 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5d190ec8-b1e0-4fed-9a43-1742533e2814 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Made reservation on behalf of dc5c46f00552473abc0991c0cc4a0269 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:33:17.676951 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5d190ec8-b1e0-4fed-9a43-1742533e2814 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:17.690448 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-7a499490-9885-4dbc-9f1a-5236b9a83e14 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1221015 Dec 09 21:33:17.949232 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:17.957039 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:18.182594 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91faa253-6d08-4a70-b6b0-577cca7e255b None None] Pushing event updated for resources: {'Port': ['ID=6d011808-2a44-4e33-ba9f-38ccde498262,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:18.201865 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] Attempting to bind port 6d011808-2a44-4e33-ba9f-38ccde498262 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:33:18.202381 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] Attempting to bind port 6d011808-2a44-4e33-ba9f-38ccde498262 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'aefee495-6d7c-460f-b4a3-a320048af8d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:33:18.202847 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] Attempting to bind port 6d011808-2a44-4e33-ba9f-38ccde498262 on network 8e0cfbe6-9002-42c6-8e79-8d95b404c162 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:33:18.209500 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 33, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:33:18.210030 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] Checking segment: {'id': 'aefee495-6d7c-460f-b4a3-a320048af8d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:33:18.210547 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:18.211031 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] Bound using segment: {'id': 'aefee495-6d7c-460f-b4a3-a320048af8d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:33:18.211652 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] Bound port: 6d011808-2a44-4e33-ba9f-38ccde498262, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aefee495-6d7c-460f-b4a3-a320048af8d9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:33:18.212733 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:18.221310 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dee4c8dd-a918-4ef4-8b8e-37ecb65c3aa0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:18.273566 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-00a9eabe-025b-4993-985e-aeb9ea972481 None None] Provisioning complete for port 6d011808-2a44-4e33-ba9f-38ccde498262 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:18.274265 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-00a9eabe-025b-4993-985e-aeb9ea972481 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:18.292391 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dee4c8dd-a918-4ef4-8b8e-37ecb65c3aa0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Network e27c361e-5c1d-4309-9f23-0b199b13ac47 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:33:18.298193 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] For port 6d011808-2a44-4e33-ba9f-38ccde498262, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:33:18.303354 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] For port 6d011808-2a44-4e33-ba9f-38ccde498262, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6d011808-2a44-4e33-ba9f-38ccde498262,segment=NetworkSegment(aefee495-6d7c-460f-b4a3-a320048af8d9),segment_id=aefee495-6d7c-460f-b4a3-a320048af8d9)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:33:18.304156 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-dee4c8dd-a918-4ef4-8b8e-37ecb65c3aa0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:18.310105 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:18.312784 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dee4c8dd-a918-4ef4-8b8e-37ecb65c3aa0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:33:18.320374 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-00a9eabe-025b-4993-985e-aeb9ea972481 None None] Port 6d011808-2a44-4e33-ba9f-38ccde498262 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:33:18.323473 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dee4c8dd-a918-4ef4-8b8e-37ecb65c3aa0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Pushing event updated for resources: {'Port': ['ID=ade63aae-4cf1-42d5-9437-66baa9ba047f,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:18.365106 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-3a4e00c1-ecbf-4988-ad6b-17240cd7a494 service neutron] 10.222.0.13 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6622744 Dec 09 21:33:18.380688 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] Routers {'6c885eb2-40c3-4066-83da-e64e5ab2723e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:18.381522 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6c885eb2-40c3-4066-83da-e64e5ab2723e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:18.486587 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91faa253-6d08-4a70-b6b0-577cca7e255b None None] Pushing event updated for resources: {'Port': ['ID=6d011808-2a44-4e33-ba9f-38ccde498262,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:18.508337 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] Set router 6c885eb2-40c3-4066-83da-e64e5ab2723e gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:18.651915 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c4e4b239-311c-424f-87bc-e007ea597802 None None] Provisioning complete for port 6d011808-2a44-4e33-ba9f-38ccde498262 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:18.652555 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c4e4b239-311c-424f-87bc-e007ea597802 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:18.671077 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-27f5ae56-8e23-4045-ab32-1eac9bb1b7d7 service neutron] 10.222.0.13 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2986145 Dec 09 21:33:18.673262 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5d190ec8-b1e0-4fed-9a43-1742533e2814 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:18.784119 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:15Z', 'revision_number': 4, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:06Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6d011808-2a44-4e33-ba9f-38ccde498262', 'name': '', 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:52:62:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1694, 'fixed_ips': [{'subnet_id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:12Z', 'updated_at': '2021-12-09T21:33:18Z', 'revision_number': 4, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'aebca6d3-dcf2-40d7-897d-d683ffd7a3c5', 'name': '', 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:dd:5f:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:07Z', 'updated_at': '2021-12-09T21:33:12Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:18.786992 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d190ec8-b1e0-4fed-9a43-1742533e2814 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Subnet': ['ID=21435ea9-4cdd-441f-bce0-c107eec29d73,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:18.824551 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5dbb765d-b0eb-4c3e-9c13-b6b6ee61d363 None None] The sync data for ids ['6c885eb2-40c3-4066-83da-e64e5ab2723e'] in n-d-713301-27 is: [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:15Z', 'revision_number': 4, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:06Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6d011808-2a44-4e33-ba9f-38ccde498262', 'name': '', 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:52:62:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1694, 'fixed_ips': [{'subnet_id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:12Z', 'updated_at': '2021-12-09T21:33:18Z', 'revision_number': 4, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'aebca6d3-dcf2-40d7-897d-d683ffd7a3c5', 'name': '', 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:dd:5f:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:07Z', 'updated_at': '2021-12-09T21:33:12Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:33:18.840440 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c4e4b239-311c-424f-87bc-e007ea597802 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:18.895176 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d190ec8-b1e0-4fed-9a43-1742533e2814 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Checking segment: {'id': 'aa51ef62-e8c5-4a58-a997-624640e44c0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'b9102456-983e-454d-9648-31350235da23'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:33:18.895176 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d190ec8-b1e0-4fed-9a43-1742533e2814 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network hostable DHCP agents. Network: b9102456-983e-454d-9648-31350235da23, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:33:18.936187 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dee4c8dd-a918-4ef4-8b8e-37ecb65c3aa0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:18.950551 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c4e4b239-311c-424f-87bc-e007ea597802 None None] For port 6d011808-2a44-4e33-ba9f-38ccde498262, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6d011808-2a44-4e33-ba9f-38ccde498262,segment=NetworkSegment(aefee495-6d7c-460f-b4a3-a320048af8d9),segment_id=aefee495-6d7c-460f-b4a3-a320048af8d9)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:18.958856 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c4e4b239-311c-424f-87bc-e007ea597802 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:19.021315 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4e4b239-311c-424f-87bc-e007ea597802 None None] Pushing event updated for resources: {'Port': ['ID=6d011808-2a44-4e33-ba9f-38ccde498262,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:19.035654 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c22122b-2c80-4413-b880-f1b71bbb4474 req-36387722-0956-4971-858b-684981bc12c8 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 210 time: 0.0495205 Dec 09 21:33:19.036398 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d190ec8-b1e0-4fed-9a43-1742533e2814 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network b9102456-983e-454d-9648-31350235da23 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:33:19.083529 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-5d190ec8-b1e0-4fed-9a43-1742533e2814 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, b9102456-983e-454d-9648-31350235da23) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:19.093320 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5d190ec8-b1e0-4fed-9a43-1742533e2814 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:19.094051 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5d190ec8-b1e0-4fed-9a43-1742533e2814 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:19.109876 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af92ca90-1797-4040-8fd2-b6db23874384 None None] Network b9102456-983e-454d-9648-31350235da23 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:33:19.144022 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5d190ec8-b1e0-4fed-9a43-1742533e2814 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 1.7032301 Dec 09 21:33:19.146721 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48600) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:19.341701 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dee4c8dd-a918-4ef4-8b8e-37ecb65c3aa0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:19.356563 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e630a8ed-90fd-4c4e-bc3f-a01b2779bc3f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-b9102456-983e-454d-9648-31350235da23', 'network_id': 'b9102456-983e-454d-9648-31350235da23', 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'fixed_ips': [{'subnet_id': '21435ea9-4cdd-441f-bce0-c107eec29d73'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:33:19.357684 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e630a8ed-90fd-4c4e-bc3f-a01b2779bc3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:19.576776 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6d011808-2a44-4e33-ba9f-38ccde498262 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:33:19.605964 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dee4c8dd-a918-4ef4-8b8e-37ecb65c3aa0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Router 56dc2ec0-42a3-4c2d-952a-b52465909182 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:33:19.686979 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-e630a8ed-90fd-4c4e-bc3f-a01b2779bc3f None None] Allocated IP 2001:db8:3::2 (b9102456-983e-454d-9648-31350235da23/21435ea9-4cdd-441f-bce0-c107eec29d73/c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:33:19.762501 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dee4c8dd-a918-4ef4-8b8e-37ecb65c3aa0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:33:19.765475 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 6d011808-2a44-4e33-ba9f-38ccde498262 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:19.774197 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:19.783232 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e99649ed-c089-41bc-83fe-2e9fb61db238 None None] Sync routers for ids ['56dc2ec0-42a3-4c2d-952a-b52465909182'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:33:19.807257 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dee4c8dd-a918-4ef4-8b8e-37ecb65c3aa0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:19.812871 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-dee4c8dd-a918-4ef4-8b8e-37ecb65c3aa0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 876 time: 4.3562570 Dec 09 21:33:19.813183 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48614) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:19.879503 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e2ab63e6-71f5-4aed-8b1c-bc43a20c3cbf tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:19.906598 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e99649ed-c089-41bc-83fe-2e9fb61db238 None None] Routers {'56dc2ec0-42a3-4c2d-952a-b52465909182'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:19.907523 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-e99649ed-c089-41bc-83fe-2e9fb61db238 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['56dc2ec0-42a3-4c2d-952a-b52465909182'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:20.062578 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-edbd4386-c08c-4266-aeb9-1882c4838e37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:20.117718 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cea87326-08e3-4d14-b8ef-be1de4278005 req-4ccf4421-dcfb-4c6d-8efb-2d6d65283cd1 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:20.126141 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cea87326-08e3-4d14-b8ef-be1de4278005 req-4ccf4421-dcfb-4c6d-8efb-2d6d65283cd1 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 945 time: 0.1196182 Dec 09 21:33:20.191816 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e630a8ed-90fd-4c4e-bc3f-a01b2779bc3f None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:20.212896 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-e99649ed-c089-41bc-83fe-2e9fb61db238 None None] Set router 56dc2ec0-42a3-4c2d-952a-b52465909182 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:20.240463 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d96ee108-880c-4298-b333-2959c7df2bbb req-67fca981-4174-4926-b80b-3fffd8d9c46f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 210 time: 0.0426118 Dec 09 21:33:20.302330 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cea87326-08e3-4d14-b8ef-be1de4278005 req-4281a2bd-7ccd-4380-b372-44e026ba396e tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1752064 Dec 09 21:33:20.304566 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-edbd4386-c08c-4266-aeb9-1882c4838e37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:20.310560 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-e2ab63e6-71f5-4aed-8b1c-bc43a20c3cbf tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Allocated IP 2001:db8:3::1 (b9102456-983e-454d-9648-31350235da23/21435ea9-4cdd-441f-bce0-c107eec29d73/8f2b6f61-c226-4e58-95f7-107c2d25e2f0) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:33:20.363310 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e630a8ed-90fd-4c4e-bc3f-a01b2779bc3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:20.406593 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-edbd4386-c08c-4266-aeb9-1882c4838e37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Deleting port ade63aae-4cf1-42d5-9437-66baa9ba047f {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:20.406939 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-edbd4386-c08c-4266-aeb9-1882c4838e37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:20.434019 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e630a8ed-90fd-4c4e-bc3f-a01b2779bc3f None None] Network b9102456-983e-454d-9648-31350235da23 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:33:20.439730 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-e630a8ed-90fd-4c4e-bc3f-a01b2779bc3f None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:20.446424 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e630a8ed-90fd-4c4e-bc3f-a01b2779bc3f None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:33:20.461157 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e630a8ed-90fd-4c4e-bc3f-a01b2779bc3f None None] Pushing event updated for resources: {'Port': ['ID=c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:20.466914 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e2ab63e6-71f5-4aed-8b1c-bc43a20c3cbf tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:20.495561 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-edbd4386-c08c-4266-aeb9-1882c4838e37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:20.506859 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e2ab63e6-71f5-4aed-8b1c-bc43a20c3cbf tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:20.509196 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-edbd4386-c08c-4266-aeb9-1882c4838e37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Calling delete_port for ade63aae-4cf1-42d5-9437-66baa9ba047f owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:33:20.522649 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e630a8ed-90fd-4c4e-bc3f-a01b2779bc3f None None] Attempting to bind port c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:33:20.523366 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e630a8ed-90fd-4c4e-bc3f-a01b2779bc3f None None] Attempting to bind port c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'aa51ef62-e8c5-4a58-a997-624640e44c0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'b9102456-983e-454d-9648-31350235da23'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:33:20.523792 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e630a8ed-90fd-4c4e-bc3f-a01b2779bc3f None None] Attempting to bind port c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63 on network b9102456-983e-454d-9648-31350235da23 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:33:20.530030 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e630a8ed-90fd-4c4e-bc3f-a01b2779bc3f None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 33, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:33:20.530413 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e630a8ed-90fd-4c4e-bc3f-a01b2779bc3f None None] Checking segment: {'id': 'aa51ef62-e8c5-4a58-a997-624640e44c0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'b9102456-983e-454d-9648-31350235da23'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:33:20.530815 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e630a8ed-90fd-4c4e-bc3f-a01b2779bc3f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:20.531211 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e630a8ed-90fd-4c4e-bc3f-a01b2779bc3f None None] Bound using segment: {'id': 'aa51ef62-e8c5-4a58-a997-624640e44c0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'b9102456-983e-454d-9648-31350235da23'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:33:20.531713 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e630a8ed-90fd-4c4e-bc3f-a01b2779bc3f None None] Bound port: c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aa51ef62-e8c5-4a58-a997-624640e44c0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'b9102456-983e-454d-9648-31350235da23'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:33:20.532095 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e630a8ed-90fd-4c4e-bc3f-a01b2779bc3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:20.534696 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-e99649ed-c089-41bc-83fe-2e9fb61db238 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '56dc2ec0-42a3-4c2d-952a-b52465909182', 'name': '', 'tenant_id': '355561057aae464295eb0ce91a41002c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'e27c361e-5c1d-4309-9f23-0b199b13ac47', 'external_fixed_ips': [{'subnet_id': 'd9ca0339-2812-429c-9183-5fd9dd4b1548', 'ip_address': '172.20.0.12'}], 'enable_snat': True}, 'gw_port_id': 'ade63aae-4cf1-42d5-9437-66baa9ba047f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:33:15Z', 'updated_at': '2021-12-09T21:33:18Z', 'revision_number': 3, 'project_id': '355561057aae464295eb0ce91a41002c', 'gw_port': {'id': 'ade63aae-4cf1-42d5-9437-66baa9ba047f', 'name': '', 'network_id': 'e27c361e-5c1d-4309-9f23-0b199b13ac47', 'tenant_id': '', 'mac_address': 'fa:16:3e:ac:59:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '56dc2ec0-42a3-4c2d-952a-b52465909182', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1696, 'fixed_ips': [{'subnet_id': 'd9ca0339-2812-429c-9183-5fd9dd4b1548', 'ip_address': '172.20.0.12', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:16Z', 'updated_at': '2021-12-09T21:33:17Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd9ca0339-2812-429c-9183-5fd9dd4b1548', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:20.558867 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e2ab63e6-71f5-4aed-8b1c-bc43a20c3cbf tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network b9102456-983e-454d-9648-31350235da23 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:33:20.565024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-e2ab63e6-71f5-4aed-8b1c-bc43a20c3cbf tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:20.569265 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e99649ed-c089-41bc-83fe-2e9fb61db238 None None] Checking router: 56dc2ec0-42a3-4c2d-952a-b52465909182 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:33:20.569641 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e99649ed-c089-41bc-83fe-2e9fb61db238 None None] Updating router 56dc2ec0-42a3-4c2d-952a-b52465909182 port ade63aae-4cf1-42d5-9437-66baa9ba047f binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:33:20.572187 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2ab63e6-71f5-4aed-8b1c-bc43a20c3cbf tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:33:20.573681 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e2ab63e6-71f5-4aed-8b1c-bc43a20c3cbf tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:20.600450 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e99649ed-c089-41bc-83fe-2e9fb61db238 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:20.634203 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2ab63e6-71f5-4aed-8b1c-bc43a20c3cbf tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Port': ['ID=8f2b6f61-c226-4e58-95f7-107c2d25e2f0,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:20.688392 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e630a8ed-90fd-4c4e-bc3f-a01b2779bc3f None None] For port c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:33:20.739250 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-edbd4386-c08c-4266-aeb9-1882c4838e37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:20.743381 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e630a8ed-90fd-4c4e-bc3f-a01b2779bc3f None None] For port c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63,segment=NetworkSegment(aa51ef62-e8c5-4a58-a997-624640e44c0b),segment_id=aa51ef62-e8c5-4a58-a997-624640e44c0b)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:33:20.756032 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e630a8ed-90fd-4c4e-bc3f-a01b2779bc3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:20.792473 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e2ab63e6-71f5-4aed-8b1c-bc43a20c3cbf tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:20.826206 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edbd4386-c08c-4266-aeb9-1882c4838e37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Pushing event deleted for resources: {'Port': ['ID=ade63aae-4cf1-42d5-9437-66baa9ba047f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:20.931459 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69e70919-3b6e-4152-ab60-ec61608df7cf req-3bee1a19-61c2-46ed-afa5-29dc6e2d15f0 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1472647 Dec 09 21:33:20.947469 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-edbd4386-c08c-4266-aeb9-1882c4838e37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:20.963976 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-e8d7d477-ec98-4aac-bb57-f6cdfea9dfd5 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:20.965198 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-e8d7d477-ec98-4aac-bb57-f6cdfea9dfd5 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.10 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 812 time: 0.3020785 Dec 09 21:33:20.982565 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-c146b027-3791-4439-98da-814a9a2a0e4a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Request body: {'port': {'device_id': '18e7aa5b-b78c-4cc4-9e5e-e407c47a414c', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'admin_state_up': True, 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:21.022853 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e630a8ed-90fd-4c4e-bc3f-a01b2779bc3f None None] Pushing event updated for resources: {'Port': ['ID=c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:21.073115 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-edbd4386-c08c-4266-aeb9-1882c4838e37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:21.077777 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-edbd4386-c08c-4266-aeb9-1882c4838e37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:21.094433 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69e70919-3b6e-4152-ab60-ec61608df7cf req-d7a7bf2c-c5cb-4559-ad89-c92e19c95c72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:21.096036 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69e70919-3b6e-4152-ab60-ec61608df7cf req-d7a7bf2c-c5cb-4559-ad89-c92e19c95c72 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 1097 time: 0.0829804 Dec 09 21:33:21.156878 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-edbd4386-c08c-4266-aeb9-1882c4838e37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:21.157445 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-edbd4386-c08c-4266-aeb9-1882c4838e37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 56dc2ec0-42a3-4c2d-952a-b52465909182 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:33:21.167150 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-edbd4386-c08c-4266-aeb9-1882c4838e37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:21.171582 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-edbd4386-c08c-4266-aeb9-1882c4838e37 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "DELETE /v2.0/routers/56dc2ec0-42a3-4c2d-952a-b52465909182 HTTP/1.1" status: 204 len: 168 time: 1.3567500 Dec 09 21:33:21.171582 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48626) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:21.237795 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-e99649ed-c089-41bc-83fe-2e9fb61db238 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:33:21.238229 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-e99649ed-c089-41bc-83fe-2e9fb61db238 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:33:21.279875 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-e0f77451-d5b3-4c3a-bd57-ebdd6a172add tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Deleting subnet d9ca0339-2812-429c-9183-5fd9dd4b1548 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:33:21.284329 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0f77451-d5b3-4c3a-bd57-ebdd6a172add tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:21.326898 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0f77451-d5b3-4c3a-bd57-ebdd6a172add tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:21.376188 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69e70919-3b6e-4152-ab60-ec61608df7cf req-e85d45c3-982f-4501-b037-6bc7bca4fe00 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:21.377883 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69e70919-3b6e-4152-ab60-ec61608df7cf req-e85d45c3-982f-4501-b037-6bc7bca4fe00 service neutron] 10.222.0.31 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 913 time: 0.2405221 Dec 09 21:33:21.413985 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4edad765-5f3e-4ce0-ae16-373c9a44df95 req-896252a8-5c68-4e34-b50c-faad103b8820 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 210 time: 0.0468810 Dec 09 21:33:21.442409 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0f77451-d5b3-4c3a-bd57-ebdd6a172add tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:21.530638 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9053540-0d34-49f2-83f2-f5bd3bdb0cfa req-afca946c-fce8-413d-a530-0e636ba77349 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:21.532288 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d9053540-0d34-49f2-83f2-f5bd3bdb0cfa req-afca946c-fce8-413d-a530-0e636ba77349 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.10 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 945 time: 0.1187370 Dec 09 21:33:21.580066 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69e70919-3b6e-4152-ab60-ec61608df7cf req-c9fd7a10-52de-4654-a2c3-54261d7eef58 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=90f16e74-f2e6-416e-a079-f205615a0d8e HTTP/1.1" status: 200 len: 1000 time: 0.1870720 Dec 09 21:33:21.654845 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-c146b027-3791-4439-98da-814a9a2a0e4a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Made reservation on behalf of a36a93590a9f45e1b9b3f78753bb8e12 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:33:21.656971 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0f77451-d5b3-4c3a-bd57-ebdd6a172add tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:21.658151 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-c146b027-3791-4439-98da-814a9a2a0e4a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:21.687363 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69e70919-3b6e-4152-ab60-ec61608df7cf req-ede06289-4a24-4ff1-9663-0b14820de3ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:21.689112 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69e70919-3b6e-4152-ab60-ec61608df7cf req-ede06289-4a24-4ff1-9663-0b14820de3ff service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 200 len: 851 time: 0.0921195 Dec 09 21:33:21.698111 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca0277d1-c2c6-4a0a-a0b4-309822c51518 req-98b3eb48-3ef3-4bce-a381-cdf6ee7735e4 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:21.699558 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ca0277d1-c2c6-4a0a-a0b4-309822c51518 req-98b3eb48-3ef3-4bce-a381-cdf6ee7735e4 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 945 time: 0.2294691 Dec 09 21:33:21.700774 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0f77451-d5b3-4c3a-bd57-ebdd6a172add tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=d9ca0339-2812-429c-9183-5fd9dd4b1548,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:21.706405 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0f77451-d5b3-4c3a-bd57-ebdd6a172add tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:21.712735 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e0f77451-d5b3-4c3a-bd57-ebdd6a172add tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "DELETE /v2.0/subnets/d9ca0339-2812-429c-9183-5fd9dd4b1548 HTTP/1.1" status: 204 len: 168 time: 0.5306509 Dec 09 21:33:21.718530 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48636) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:21.762872 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e99649ed-c089-41bc-83fe-2e9fb61db238 None None] Port ade63aae-4cf1-42d5-9437-66baa9ba047f not found while updating agent binding for router 56dc2ec0-42a3-4c2d-952a-b52465909182. {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:216}} Dec 09 21:33:21.772125 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e99649ed-c089-41bc-83fe-2e9fb61db238 None None] Routers set() bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:21.772652 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e99649ed-c089-41bc-83fe-2e9fb61db238 None None] Router IDs set() for agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Dec 09 21:33:21.773648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_agentschedulers_db [None req-e99649ed-c089-41bc-83fe-2e9fb61db238 None None] Agent requested router IDs not scheduled to it. Scheduled: []. Unscheduled: {'56dc2ec0-42a3-4c2d-952a-b52465909182'}. Agent: Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent'). {{(pid=103439) list_active_sync_routers_on_active_l3_agent /opt/stack/neutron/neutron/db/l3_agentschedulers_db.py:353}} Dec 09 21:33:21.774128 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e99649ed-c089-41bc-83fe-2e9fb61db238 None None] The sync data for ids ['56dc2ec0-42a3-4c2d-952a-b52465909182'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:33:21.787779 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69e70919-3b6e-4152-ab60-ec61608df7cf req-83b174cf-7f66-4dd4-80f1-25e4c1890cfb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:21.789309 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69e70919-3b6e-4152-ab60-ec61608df7cf req-83b174cf-7f66-4dd4-80f1-25e4c1890cfb service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0859630 Dec 09 21:33:21.794111 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ca0277d1-c2c6-4a0a-a0b4-309822c51518 req-b9531cdc-958f-40b1-8fd1-20e4aa88055f tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0829945 Dec 09 21:33:21.891593 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e2ab63e6-71f5-4aed-8b1c-bc43a20c3cbf tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:21.902820 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69e70919-3b6e-4152-ab60-ec61608df7cf req-339a4c9a-38ec-4f27-83df-fa2a2ca574fb service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1020377 Dec 09 21:33:21.903427 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e2ab63e6-71f5-4aed-8b1c-bc43a20c3cbf tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:21.904287 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e2ab63e6-71f5-4aed-8b1c-bc43a20c3cbf tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:21.928114 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31306dfb-eca2-4f97-8bfe-0f645bc1e923 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:21.932251 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-d9053540-0d34-49f2-83f2-f5bd3bdb0cfa req-8a111eda-3306-40e2-9a6a-b455bec8c763 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Deleting port c71ed6b5-a11d-49bd-b829-084d7dc9af18 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:21.932590 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d9053540-0d34-49f2-83f2-f5bd3bdb0cfa req-8a111eda-3306-40e2-9a6a-b455bec8c763 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:22.032681 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69e70919-3b6e-4152-ab60-ec61608df7cf req-c7fa25be-fc85-495a-b3b3-2546855c8b2b service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1219525 Dec 09 21:33:22.091943 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2ab63e6-71f5-4aed-8b1c-bc43a20c3cbf tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event updated for resources: {'Port': ['ID=8f2b6f61-c226-4e58-95f7-107c2d25e2f0,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:22.114314 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-c146b027-3791-4439-98da-814a9a2a0e4a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Allocated IP 172.20.0.7 (2c03082f-742a-4ae3-9d23-6178c7ff2a0a/d776263b-6b97-44cc-bef5-299b9262dfec/d5571683-a9bc-4155-85b9-b1ef208e21e9) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:33:22.252997 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd41a910-5645-4de1-a1e1-c7b06a4151b2 None None] Network b9102456-983e-454d-9648-31350235da23 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:33:22.267269 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31306dfb-eca2-4f97-8bfe-0f645bc1e923 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:22.282092 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-d9053540-0d34-49f2-83f2-f5bd3bdb0cfa req-8a111eda-3306-40e2-9a6a-b455bec8c763 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] For port c71ed6b5-a11d-49bd-b829-084d7dc9af18, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=c71ed6b5-a11d-49bd-b829-084d7dc9af18,segment=NetworkSegment(0c438a9d-68a6-4675-b498-b86f6eed54d4),segment_id=0c438a9d-68a6-4675-b498-b86f6eed54d4)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:22.282461 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d9053540-0d34-49f2-83f2-f5bd3bdb0cfa req-8a111eda-3306-40e2-9a6a-b455bec8c763 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:22.316206 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-d9053540-0d34-49f2-83f2-f5bd3bdb0cfa req-8a111eda-3306-40e2-9a6a-b455bec8c763 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Calling delete_port for c71ed6b5-a11d-49bd-b829-084d7dc9af18 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:33:22.321109 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-31306dfb-eca2-4f97-8bfe-0f645bc1e923 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e27c361e-5c1d-4309-9f23-0b199b13ac47']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:22.337532 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e2ab63e6-71f5-4aed-8b1c-bc43a20c3cbf tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Network b9102456-983e-454d-9648-31350235da23 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:33:22.339889 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-0313f401-6e96-446b-a543-631875f53621 None None] Provisioning complete for port c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:22.340275 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0313f401-6e96-446b-a543-631875f53621 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:22.346800 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-31306dfb-eca2-4f97-8bfe-0f645bc1e923 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '16c86a17-27d9-463d-840f-fb913df25746') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:22.347082 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-31306dfb-eca2-4f97-8bfe-0f645bc1e923 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '16c86a17-27d9-463d-840f-fb913df25746') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:22.354513 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-e2ab63e6-71f5-4aed-8b1c-bc43a20c3cbf tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:22.387945 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31306dfb-eca2-4f97-8bfe-0f645bc1e923 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:22.442257 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0313f401-6e96-446b-a543-631875f53621 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:22.470230 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31306dfb-eca2-4f97-8bfe-0f645bc1e923 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:22.483929 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0313f401-6e96-446b-a543-631875f53621 None None] For port c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63,segment=NetworkSegment(aa51ef62-e8c5-4a58-a997-624640e44c0b),segment_id=aa51ef62-e8c5-4a58-a997-624640e44c0b)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:22.493271 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0313f401-6e96-446b-a543-631875f53621 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:22.526842 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-31306dfb-eca2-4f97-8bfe-0f645bc1e923 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Releasing vlan 105 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:33:22.527262 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31306dfb-eca2-4f97-8bfe-0f645bc1e923 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:33:22.555703 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:33:22.569540 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d953c8cd-5311-4543-9053-19a449f49afb req-1440c188-f77e-4223-a65d-d11825686fdd tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 210 time: 0.0464590 Dec 09 21:33:22.592011 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0313f401-6e96-446b-a543-631875f53621 None None] Pushing event updated for resources: {'Port': ['ID=c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:22.690027 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31306dfb-eca2-4f97-8bfe-0f645bc1e923 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:22.695891 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-c146b027-3791-4439-98da-814a9a2a0e4a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:22.698930 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e2ab63e6-71f5-4aed-8b1c-bc43a20c3cbf tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Router 6c885eb2-40c3-4066-83da-e64e5ab2723e has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:33:22.704418 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-31306dfb-eca2-4f97-8bfe-0f645bc1e923 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network e27c361e-5c1d-4309-9f23-0b199b13ac47 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Dec 09 21:33:22.709617 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31306dfb-eca2-4f97-8bfe-0f645bc1e923 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:22.712927 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-31306dfb-eca2-4f97-8bfe-0f645bc1e923 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "DELETE /v2.0/networks/e27c361e-5c1d-4309-9f23-0b199b13ac47 HTTP/1.1" status: 204 len: 168 time: 0.9934762 Dec 09 21:33:22.729501 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31306dfb-eca2-4f97-8bfe-0f645bc1e923 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Pushing event deleted for resources: {'Network': ['ID=e27c361e-5c1d-4309-9f23-0b199b13ac47,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:22.822235 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-109df1c2-56d2-4463-bd60-710414e807f1 None None] Provisioning complete for port 8f2b6f61-c226-4e58-95f7-107c2d25e2f0 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:22.823430 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-109df1c2-56d2-4463-bd60-710414e807f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:22.901608 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-109df1c2-56d2-4463-bd60-710414e807f1 None None] Port 8f2b6f61-c226-4e58-95f7-107c2d25e2f0 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:33:22.904869 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d9053540-0d34-49f2-83f2-f5bd3bdb0cfa req-8a111eda-3306-40e2-9a6a-b455bec8c763 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:22.916324 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-109df1c2-56d2-4463-bd60-710414e807f1 None None] Provisioning complete for port c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:22.916900 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-109df1c2-56d2-4463-bd60-710414e807f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:22.931271 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-c146b027-3791-4439-98da-814a9a2a0e4a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:22.954780 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-57627e24-9b12-49c2-ab8b-c8179a92da0a req-92fb9cb0-e8a2-49f4-8c76-7891d73b98cf tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 210 time: 0.0366375 Dec 09 21:33:22.960263 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['e265ed07-d705-41c8-a70d-3b1f794ae6a7'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:33:22.962501 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['287d2e38-af6c-4fbc-b196-bebf54c65697'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:33:22.990217 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e2ab63e6-71f5-4aed-8b1c-bc43a20c3cbf tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:33:23.008726 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e2ab63e6-71f5-4aed-8b1c-bc43a20c3cbf tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/routers/6c885eb2-40c3-4066-83da-e64e5ab2723e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.8606153 Dec 09 21:33:23.009700 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a111eda-3306-40e2-9a6a-b455bec8c763 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Pushing event deleted for resources: {'Port': ['ID=c71ed6b5-a11d-49bd-b829-084d7dc9af18,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:23.011753 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48654) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:23.032660 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-95c914ad-df64-4ee3-a04d-f9879727a1a9 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'router': {'routes': [{'nexthop': '2001:db8:1::2', 'destination': '2001:db8:1::/64'}, {'nexthop': '2001:db8:2::2', 'destination': '2001:db8:2::/64'}, {'nexthop': '2001:db8:3::2', 'destination': '2001:db8:3::/64'}, {'nexthop': '2001:db8::2', 'destination': '2001:db8::/64'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:23.042844 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48658) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:23.049062 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-ffc4e4b4-c7d7-4c68-bda3-fb78bbc64801 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Request body: {'router': {'name': 'tempest-router--499415862', 'project_id': '38e86b4641254a09a61f9be7441c4550'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:23.080086 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ffc4e4b4-c7d7-4c68-bda3-fb78bbc64801 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:23.081334 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ffc4e4b4-c7d7-4c68-bda3-fb78bbc64801 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:23.102874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c146b027-3791-4439-98da-814a9a2a0e4a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Pushing event updated for resources: {'Port': ['ID=d5571683-a9bc-4155-85b9-b1ef208e21e9,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:23.209587 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ffc4e4b4-c7d7-4c68-bda3-fb78bbc64801 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:23.220813 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ffc4e4b4-c7d7-4c68-bda3-fb78bbc64801 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:23.239468 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-d9053540-0d34-49f2-83f2-f5bd3bdb0cfa req-8a111eda-3306-40e2-9a6a-b455bec8c763 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] No DVR routers for this DVR port c71ed6b5-a11d-49bd-b829-084d7dc9af18 on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:33:23.242553 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d9053540-0d34-49f2-83f2-f5bd3bdb0cfa req-8a111eda-3306-40e2-9a6a-b455bec8c763 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:23.247490 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d9053540-0d34-49f2-83f2-f5bd3bdb0cfa req-8a111eda-3306-40e2-9a6a-b455bec8c763 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.10 "DELETE /v2.0/ports/c71ed6b5-a11d-49bd-b829-084d7dc9af18 HTTP/1.1" status: 204 len: 173 time: 1.6953921 Dec 09 21:33:23.250936 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-c146b027-3791-4439-98da-814a9a2a0e4a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:33:23.253486 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9876e214-d2ce-42d5-9d51-0df26fa0939b', 'name': 'network-vif-deleted', 'tag': 'c71ed6b5-a11d-49bd-b829-084d7dc9af18'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:33:23.256610 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-da58c42f-2fe5-4202-afc4-172bae946f40" -d '{"events": [{"server_uuid": "9876e214-d2ce-42d5-9d51-0df26fa0939b", "name": "network-vif-deleted", "tag": "c71ed6b5-a11d-49bd-b829-084d7dc9af18"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:33:23.266699 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-c146b027-3791-4439-98da-814a9a2a0e4a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:23.270652 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-c146b027-3791-4439-98da-814a9a2a0e4a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:33:23.291758 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ffc4e4b4-c7d7-4c68-bda3-fb78bbc64801 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:23.294715 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ffc4e4b4-c7d7-4c68-bda3-fb78bbc64801 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 722 time: 0.2492344 Dec 09 21:33:23.302543 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48662) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:23.352491 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:33:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0ce8f3f1-85ff-4313-a113-18fe4640f3ec x-openstack-request-id: req-0ce8f3f1-85ff-4313-a113-18fe4640f3ec {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:33:23.352901 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9876e214-d2ce-42d5-9d51-0df26fa0939b", "name": "network-vif-deleted", "tag": "c71ed6b5-a11d-49bd-b829-084d7dc9af18", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:33:23.353241 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0ce8f3f1-85ff-4313-a113-18fe4640f3ec {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:33:23.354249 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9876e214-d2ce-42d5-9d51-0df26fa0939b', 'name': 'network-vif-deleted', 'tag': 'c71ed6b5-a11d-49bd-b829-084d7dc9af18', 'status': 'completed', 'code': 200} Dec 09 21:33:23.373602 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6b63e691-8fb6-4fc9-8f2f-ad0a51b8ba35 None None] Provisioning complete for port 8f2b6f61-c226-4e58-95f7-107c2d25e2f0 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:23.373989 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6b63e691-8fb6-4fc9-8f2f-ad0a51b8ba35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:23.413839 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] Sync routers for ids ['6c885eb2-40c3-4066-83da-e64e5ab2723e'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:33:23.440369 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] Routers {'6c885eb2-40c3-4066-83da-e64e5ab2723e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:23.441391 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6c885eb2-40c3-4066-83da-e64e5ab2723e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:23.494590 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-6b63e691-8fb6-4fc9-8f2f-ad0a51b8ba35 None None] Port 8f2b6f61-c226-4e58-95f7-107c2d25e2f0 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:33:23.511853 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-c146b027-3791-4439-98da-814a9a2a0e4a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:23.513110 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-c146b027-3791-4439-98da-814a9a2a0e4a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:23.584705 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-011c1522-aaa1-4b26-86e7-f2358cb3662c tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:23.589541 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-c146b027-3791-4439-98da-814a9a2a0e4a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.6071103 Dec 09 21:33:23.630328 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a2055fbd-ebfd-4fc8-a105-eeea40a80b0e None None] Provisioning complete for port 8f2b6f61-c226-4e58-95f7-107c2d25e2f0 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:23.630735 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a2055fbd-ebfd-4fc8-a105-eeea40a80b0e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:23.634649 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-2be49cf4-de21-4ab2-b679-12057bb491b2 service neutron] Request body: {'port': {'device_id': '18e7aa5b-b78c-4cc4-9e5e-e407c47a414c', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:23.689178 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:33:23.779282 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] Set router 6c885eb2-40c3-4066-83da-e64e5ab2723e gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:23.779640 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a2055fbd-ebfd-4fc8-a105-eeea40a80b0e None None] Port 8f2b6f61-c226-4e58-95f7-107c2d25e2f0 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:33:23.833738 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-011c1522-aaa1-4b26-86e7-f2358cb3662c tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:23.836418 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-011c1522-aaa1-4b26-86e7-f2358cb3662c tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:23.844890 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:23.848554 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:23.919195 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-2be49cf4-de21-4ab2-b679-12057bb491b2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:23.949537 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-306da18c-a628-424b-b45d-1daee14afbc8 None None] Provisioning complete for port d5571683-a9bc-4155-85b9-b1ef208e21e9 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:23.950720 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-306da18c-a628-424b-b45d-1daee14afbc8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:24.022309 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-306da18c-a628-424b-b45d-1daee14afbc8 None None] Port d5571683-a9bc-4155-85b9-b1ef208e21e9 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:33:24.193540 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:20Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:06Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6d011808-2a44-4e33-ba9f-38ccde498262', 'name': '', 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:52:62:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1694, 'fixed_ips': [{'subnet_id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:12Z', 'updated_at': '2021-12-09T21:33:18Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8f2b6f61-c226-4e58-95f7-107c2d25e2f0', 'name': '', 'network_id': 'b9102456-983e-454d-9648-31350235da23', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:62:52:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1701, 'fixed_ips': [{'subnet_id': '21435ea9-4cdd-441f-bce0-c107eec29d73', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:20Z', 'updated_at': '2021-12-09T21:33:21Z', 'revision_number': 2, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '21435ea9-4cdd-441f-bce0-c107eec29d73', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'aebca6d3-dcf2-40d7-897d-d683ffd7a3c5', 'name': '', 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:dd:5f:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:07Z', 'updated_at': '2021-12-09T21:33:12Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:24.226653 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] Checking router: 6c885eb2-40c3-4066-83da-e64e5ab2723e for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:33:24.227040 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] Updating router 6c885eb2-40c3-4066-83da-e64e5ab2723e port 8f2b6f61-c226-4e58-95f7-107c2d25e2f0 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:33:24.256704 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:24.260750 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.extraroute_db [None req-95c914ad-df64-4ee3-a04d-f9879727a1a9 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Added routes are [{'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}, {'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}] {{(pid=103437) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Dec 09 21:33:24.286543 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.extraroute_db [None req-95c914ad-df64-4ee3-a04d-f9879727a1a9 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Removed routes are [] {{(pid=103437) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Dec 09 21:33:24.286888 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-95c914ad-df64-4ee3-a04d-f9879727a1a9 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:24.410441 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b096e8d-a757-49e0-b408-8eb2b19df94d req-96d0833e-fb7a-4e7b-b54b-b9d8c9170c33 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=9876e214-d2ce-42d5-9d51-0df26fa0939b HTTP/1.1" status: 200 len: 210 time: 0.0492909 Dec 09 21:33:24.421818 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-011c1522-aaa1-4b26-86e7-f2358cb3662c tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:24.422729 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-011c1522-aaa1-4b26-86e7-f2358cb3662c tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 9b489658-073f-40a6-982c-7f800c3b5d91 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:33:24.432638 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-011c1522-aaa1-4b26-86e7-f2358cb3662c tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:24.434213 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-011c1522-aaa1-4b26-86e7-f2358cb3662c tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "DELETE /v2.0/routers/9b489658-073f-40a6-982c-7f800c3b5d91 HTTP/1.1" status: 204 len: 168 time: 1.1297452 Dec 09 21:33:24.447125 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf4cdb23-19ab-4da2-a4b7-8ad295ca7d1b req-e4f3ce0b-be63-4970-a9d4-7b5ab78ff55b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:24.455246 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf4cdb23-19ab-4da2-a4b7-8ad295ca7d1b req-e4f3ce0b-be63-4970-a9d4-7b5ab78ff55b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 931 time: 0.0923321 Dec 09 21:33:24.527867 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf4cdb23-19ab-4da2-a4b7-8ad295ca7d1b req-8259a0c1-b483-4931-9801-b5c1c30decf5 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0713496 Dec 09 21:33:24.603632 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48676) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:24.609433 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:24.618463 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:24.620145 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device c71ed6b5-a11d-49bd-b829-084d7dc9af18 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:33:24.663351 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: c71ed6b5-a11d-49bd-b829-084d7dc9af18 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:33:24.663764 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device c71ed6b5-a11d-49bd-b829-084d7dc9af18 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:33:24.676793 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7eb7e31-db3e-4da9-9053-674f8c246f4a None None] Pushing event updated for resources: {'Port': ['ID=8f2b6f61-c226-4e58-95f7-107c2d25e2f0,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:24.732599 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] Attempting to bind port 8f2b6f61-c226-4e58-95f7-107c2d25e2f0 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:33:24.732960 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] Attempting to bind port 8f2b6f61-c226-4e58-95f7-107c2d25e2f0 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'aa51ef62-e8c5-4a58-a997-624640e44c0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'b9102456-983e-454d-9648-31350235da23'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:33:24.733323 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] Attempting to bind port 8f2b6f61-c226-4e58-95f7-107c2d25e2f0 on network b9102456-983e-454d-9648-31350235da23 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:33:24.740176 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 33, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:33:24.740922 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] Checking segment: {'id': 'aa51ef62-e8c5-4a58-a997-624640e44c0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'b9102456-983e-454d-9648-31350235da23'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:33:24.741584 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:24.741972 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] Bound using segment: {'id': 'aa51ef62-e8c5-4a58-a997-624640e44c0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'b9102456-983e-454d-9648-31350235da23'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:33:24.742480 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] Bound port: 8f2b6f61-c226-4e58-95f7-107c2d25e2f0, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aa51ef62-e8c5-4a58-a997-624640e44c0b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'b9102456-983e-454d-9648-31350235da23'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:33:24.742864 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:24.834491 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] For port 8f2b6f61-c226-4e58-95f7-107c2d25e2f0, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:33:24.840559 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-2be49cf4-de21-4ab2-b679-12057bb491b2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d5571683-a9bc-4155-85b9-b1ef208e21e9 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:33:24.841281 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] For port 8f2b6f61-c226-4e58-95f7-107c2d25e2f0, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=8f2b6f61-c226-4e58-95f7-107c2d25e2f0,segment=NetworkSegment(aa51ef62-e8c5-4a58-a997-624640e44c0b),segment_id=aa51ef62-e8c5-4a58-a997-624640e44c0b)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:33:24.852091 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:24.879663 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-2be49cf4-de21-4ab2-b679-12057bb491b2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:24.911526 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-2be49cf4-de21-4ab2-b679-12057bb491b2 service neutron] Transition to ACTIVE for port object d5571683-a9bc-4155-85b9-b1ef208e21e9 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:33:24.921820 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-2be49cf4-de21-4ab2-b679-12057bb491b2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:24.926419 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] Routers {'6c885eb2-40c3-4066-83da-e64e5ab2723e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:24.927392 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6c885eb2-40c3-4066-83da-e64e5ab2723e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:24.927669 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-95c914ad-df64-4ee3-a04d-f9879727a1a9 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:24.973430 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2be49cf4-de21-4ab2-b679-12057bb491b2 service neutron] Pushing event updated for resources: {'Port': ['ID=d5571683-a9bc-4155-85b9-b1ef208e21e9,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:24.980154 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-95c914ad-df64-4ee3-a04d-f9879727a1a9 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-640457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-640448', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-635166'] for router, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:25.046026 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-2a982da6-c51c-4406-a98d-78f2964ead3a tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-352412560', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}, 'admin_state_up': False}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:25.052229 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] Set router 6c885eb2-40c3-4066-83da-e64e5ab2723e gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:25.083339 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1e67e80b-a175-4217-886c-a7034b263c89 None None] Provisioning complete for port 8f2b6f61-c226-4e58-95f7-107c2d25e2f0 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:25.083968 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1e67e80b-a175-4217-886c-a7034b263c89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:25.117637 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2a982da6-c51c-4406-a98d-78f2964ead3a tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:25.121723 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2a982da6-c51c-4406-a98d-78f2964ead3a tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:25.203716 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2a982da6-c51c-4406-a98d-78f2964ead3a tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:25.234456 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-95c914ad-df64-4ee3-a04d-f9879727a1a9 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Router 6c885eb2-40c3-4066-83da-e64e5ab2723e has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:33:25.251390 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7eb7e31-db3e-4da9-9053-674f8c246f4a None None] Pushing event updated for resources: {'Port': ['ID=8f2b6f61-c226-4e58-95f7-107c2d25e2f0,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:25.267744 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-2be49cf4-de21-4ab2-b679-12057bb491b2 service neutron] Attempting to bind port d5571683-a9bc-4155-85b9-b1ef208e21e9 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:33:25.268160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-2be49cf4-de21-4ab2-b679-12057bb491b2 service neutron] Attempting to bind port d5571683-a9bc-4155-85b9-b1ef208e21e9 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:33:25.268418 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-2be49cf4-de21-4ab2-b679-12057bb491b2 service neutron] Attempting to bind port d5571683-a9bc-4155-85b9-b1ef208e21e9 on network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:33:25.275362 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1e67e80b-a175-4217-886c-a7034b263c89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:25.339292 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-2be49cf4-de21-4ab2-b679-12057bb491b2 service neutron] Port d5571683-a9bc-4155-85b9-b1ef208e21e9 on network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:33:25.344658 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-2be49cf4-de21-4ab2-b679-12057bb491b2 service neutron] Attempting to bind port d5571683-a9bc-4155-85b9-b1ef208e21e9 on network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:33:25.362515 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-1e67e80b-a175-4217-886c-a7034b263c89 None None] For port 8f2b6f61-c226-4e58-95f7-107c2d25e2f0, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=8f2b6f61-c226-4e58-95f7-107c2d25e2f0,segment=NetworkSegment(aa51ef62-e8c5-4a58-a997-624640e44c0b),segment_id=aa51ef62-e8c5-4a58-a997-624640e44c0b)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:25.368068 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1e67e80b-a175-4217-886c-a7034b263c89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:25.387857 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-2be49cf4-de21-4ab2-b679-12057bb491b2 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 32, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:33:25.388889 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-2be49cf4-de21-4ab2-b679-12057bb491b2 service neutron] Checking segment: {'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:33:25.389264 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-2be49cf4-de21-4ab2-b679-12057bb491b2 service neutron] Bound using segment: {'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:33:25.389718 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-2be49cf4-de21-4ab2-b679-12057bb491b2 service neutron] Bound port: d5571683-a9bc-4155-85b9-b1ef208e21e9, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:33:25.390097 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-2be49cf4-de21-4ab2-b679-12057bb491b2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:25.428389 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2a982da6-c51c-4406-a98d-78f2964ead3a tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:25.440108 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e67e80b-a175-4217-886c-a7034b263c89 None None] Pushing event updated for resources: {'Port': ['ID=8f2b6f61-c226-4e58-95f7-107c2d25e2f0,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:25.452541 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-95c914ad-df64-4ee3-a04d-f9879727a1a9 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:33:25.460893 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-95c914ad-df64-4ee3-a04d-f9879727a1a9 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:25.464863 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-95c914ad-df64-4ee3-a04d-f9879727a1a9 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/routers/6c885eb2-40c3-4066-83da-e64e5ab2723e HTTP/1.1" status: 200 len: 954 time: 2.4408872 Dec 09 21:33:25.465537 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48686) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:25.495357 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a536887c-d8ce-437a-ada1-8447bba5f696 None None] Provisioning complete for port 8f2b6f61-c226-4e58-95f7-107c2d25e2f0 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:25.495909 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a536887c-d8ce-437a-ada1-8447bba5f696 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:25.497060 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-2be49cf4-de21-4ab2-b679-12057bb491b2 service neutron] For port d5571683-a9bc-4155-85b9-b1ef208e21e9, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:33:25.500995 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-2be49cf4-de21-4ab2-b679-12057bb491b2 service neutron] For port d5571683-a9bc-4155-85b9-b1ef208e21e9, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=d5571683-a9bc-4155-85b9-b1ef208e21e9,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:33:25.511119 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-2be49cf4-de21-4ab2-b679-12057bb491b2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:25.580600 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-2be49cf4-de21-4ab2-b679-12057bb491b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:25.581452 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-2be49cf4-de21-4ab2-b679-12057bb491b2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:25.583520 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-2be49cf4-de21-4ab2-b679-12057bb491b2 service neutron] 10.222.0.10 "PUT /v2.0/ports/d5571683-a9bc-4155-85b9-b1ef208e21e9 HTTP/1.1" status: 200 len: 1092 time: 1.9643734 Dec 09 21:33:25.600818 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '18e7aa5b-b78c-4cc4-9e5e-e407c47a414c', 'tag': 'd5571683-a9bc-4155-85b9-b1ef208e21e9'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:33:25.604154 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a809b8cb-fc26-43fb-a7d1-9dabc68c54a8" -d '{"events": [{"name": "network-changed", "server_uuid": "18e7aa5b-b78c-4cc4-9e5e-e407c47a414c", "tag": "d5571683-a9bc-4155-85b9-b1ef208e21e9"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:33:25.686953 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:24Z', 'revision_number': 6, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:06Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6d011808-2a44-4e33-ba9f-38ccde498262', 'name': '', 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:52:62:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1694, 'fixed_ips': [{'subnet_id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:12Z', 'updated_at': '2021-12-09T21:33:18Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8f2b6f61-c226-4e58-95f7-107c2d25e2f0', 'name': '', 'network_id': 'b9102456-983e-454d-9648-31350235da23', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:62:52:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1701, 'fixed_ips': [{'subnet_id': '21435ea9-4cdd-441f-bce0-c107eec29d73', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:20Z', 'updated_at': '2021-12-09T21:33:24Z', 'revision_number': 4, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '21435ea9-4cdd-441f-bce0-c107eec29d73', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'aebca6d3-dcf2-40d7-897d-d683ffd7a3c5', 'name': '', 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:dd:5f:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:07Z', 'updated_at': '2021-12-09T21:33:12Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:25.715493 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e7096d9d-42d3-46b9-9c1e-ece5ed624784 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/routers/6c885eb2-40c3-4066-83da-e64e5ab2723e HTTP/1.1" status: 200 len: 954 time: 0.2471993 Dec 09 21:33:25.718440 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48696) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:25.731112 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-57ea1a66-d571-4e40-a4b0-7df2d1519d60 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'router': {'routes': None}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:25.760756 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43471a7a-1d56-4853-99f7-844b1bceaab2 None None] The sync data for ids ['6c885eb2-40c3-4066-83da-e64e5ab2723e'] in n-d-713301-27 is: [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}, {'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:24Z', 'revision_number': 6, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:06Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6d011808-2a44-4e33-ba9f-38ccde498262', 'name': '', 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:52:62:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1694, 'fixed_ips': [{'subnet_id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:12Z', 'updated_at': '2021-12-09T21:33:18Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8f2b6f61-c226-4e58-95f7-107c2d25e2f0', 'name': '', 'network_id': 'b9102456-983e-454d-9648-31350235da23', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:62:52:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1701, 'fixed_ips': [{'subnet_id': '21435ea9-4cdd-441f-bce0-c107eec29d73', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:20Z', 'updated_at': '2021-12-09T21:33:24Z', 'revision_number': 4, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '21435ea9-4cdd-441f-bce0-c107eec29d73', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'aebca6d3-dcf2-40d7-897d-d683ffd7a3c5', 'name': '', 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:dd:5f:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:07Z', 'updated_at': '2021-12-09T21:33:12Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:33:25.787232 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2be49cf4-de21-4ab2-b679-12057bb491b2 service neutron] Pushing event updated for resources: {'Port': ['ID=d5571683-a9bc-4155-85b9-b1ef208e21e9,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:25.820589 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-7b853af9-42d2-4ca5-be48-d744bebf341a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:25.822181 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-7b853af9-42d2-4ca5-be48-d744bebf341a service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 1095 time: 0.1712976 Dec 09 21:33:25.842327 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:33:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b6c45e4a-1a81-4a42-b0b9-042fcd36f31f x-openstack-request-id: req-b6c45e4a-1a81-4a42-b0b9-042fcd36f31f {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:33:25.843657 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "18e7aa5b-b78c-4cc4-9e5e-e407c47a414c", "tag": "d5571683-a9bc-4155-85b9-b1ef208e21e9", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:33:25.844246 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-b6c45e4a-1a81-4a42-b0b9-042fcd36f31f {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:33:25.844809 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '18e7aa5b-b78c-4cc4-9e5e-e407c47a414c', 'tag': 'd5571683-a9bc-4155-85b9-b1ef208e21e9', 'status': 'completed', 'code': 200} Dec 09 21:33:25.900554 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-36fc52d3-82c0-4407-91a6-646497888c6d service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d5571683-a9bc-4155-85b9-b1ef208e21e9 HTTP/1.1" status: 200 len: 217 time: 0.0664487 Dec 09 21:33:25.972605 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-612b7f9a-4c52-46aa-9848-a4189bec5b1f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:25.974645 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-612b7f9a-4c52-46aa-9848-a4189bec5b1f service neutron] 10.222.0.10 "GET /v2.0/subnets?id=d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 200 len: 851 time: 0.0660090 Dec 09 21:33:26.005031 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c06ef42-b7a5-4481-826d-26ffdeeb80d3 req-5070b862-d5d0-46f4-92c3-6becd7d864f2 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:26.009030 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1c06ef42-b7a5-4481-826d-26ffdeeb80d3 req-5070b862-d5d0-46f4-92c3-6becd7d864f2 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 943 time: 0.2018666 Dec 09 21:33:26.041654 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-b7b662cb-3998-4e9f-ae8d-997432285a0a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:26.043227 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-b7b662cb-3998-4e9f-ae8d-997432285a0a service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0602827 Dec 09 21:33:26.162120 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-6be8ff4b-bfc7-43ea-8132-aab6c0158a8f service neutron] 10.222.0.10 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1109452 Dec 09 21:33:26.205938 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2a982da6-c51c-4406-a98d-78f2964ead3a tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:26.218410 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-188dad8f-17d0-4060-8ba8-3ff8d5f4fd8e req-69ea5c0c-e459-4861-a936-7c199a6e7b16 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:26.220017 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-188dad8f-17d0-4060-8ba8-3ff8d5f4fd8e req-69ea5c0c-e459-4861-a936-7c199a6e7b16 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=0572d5ce-eab2-4fdc-9c73-034455c686d3 HTTP/1.1" status: 200 len: 946 time: 0.2738829 Dec 09 21:33:26.263058 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-13bea2db-4e38-4bd6-9a75-d9d667bde4e4 req-8ade4408-21c8-47d3-bff5-ac1ff008fb1c service neutron] 10.222.0.10 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0930593 Dec 09 21:33:26.277485 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2a982da6-c51c-4406-a98d-78f2964ead3a tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:26.355763 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1c06ef42-b7a5-4481-826d-26ffdeeb80d3 req-89992465-9cfa-4a61-8792-c524f203be39 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3049593 Dec 09 21:33:26.377844 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a809b8cb-fc26-43fb-a7d1-9dabc68c54a8 req-fc765478-243c-42a6-90a6-492559a07cc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:26.379544 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a809b8cb-fc26-43fb-a7d1-9dabc68c54a8 req-fc765478-243c-42a6-90a6-492559a07cc6 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 1095 time: 0.0630133 Dec 09 21:33:26.464546 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-188dad8f-17d0-4060-8ba8-3ff8d5f4fd8e req-79498e6b-679a-4821-97b6-89cb36486298 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2050679 Dec 09 21:33:26.499840 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a809b8cb-fc26-43fb-a7d1-9dabc68c54a8 req-46e7f4e7-a649-49a9-a5d0-99625bc51ff6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:26.501989 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a809b8cb-fc26-43fb-a7d1-9dabc68c54a8 req-46e7f4e7-a649-49a9-a5d0-99625bc51ff6 service neutron] 10.222.0.10 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 913 time: 0.1126585 Dec 09 21:33:26.560269 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a809b8cb-fc26-43fb-a7d1-9dabc68c54a8 req-e2f89d0b-723e-4a44-92b3-509534fc7793 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d5571683-a9bc-4155-85b9-b1ef208e21e9 HTTP/1.1" status: 200 len: 217 time: 0.0486307 Dec 09 21:33:26.593892 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-2a982da6-c51c-4406-a98d-78f2964ead3a tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Allocated IP 172.25.3.130 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/e9fe81ac-ae48-4760-9bf2-591ef2c0c174) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:33:26.620083 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a809b8cb-fc26-43fb-a7d1-9dabc68c54a8 req-f74d0332-945b-4130-bdd7-4ef4da26bcf7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:26.621877 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a809b8cb-fc26-43fb-a7d1-9dabc68c54a8 req-f74d0332-945b-4130-bdd7-4ef4da26bcf7 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 200 len: 851 time: 0.0544064 Dec 09 21:33:26.681144 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a809b8cb-fc26-43fb-a7d1-9dabc68c54a8 req-a2770c23-6c3f-410d-829b-3c80bf1166d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:26.682837 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a809b8cb-fc26-43fb-a7d1-9dabc68c54a8 req-a2770c23-6c3f-410d-829b-3c80bf1166d6 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0504355 Dec 09 21:33:26.702742 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.extraroute_db [None req-57ea1a66-d571-4e40-a4b0-7df2d1519d60 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Added routes are [] {{(pid=103438) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Dec 09 21:33:26.703067 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.extraroute_db [None req-57ea1a66-d571-4e40-a4b0-7df2d1519d60 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Removed routes are [{'destination': '2001:db8:3::/64', 'nexthop': '2001:db8:3::2'}, {'destination': '2001:db8::/64', 'nexthop': '2001:db8::2'}, {'destination': '2001:db8:1::/64', 'nexthop': '2001:db8:1::2'}, {'destination': '2001:db8:2::/64', 'nexthop': '2001:db8:2::2'}] {{(pid=103438) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Dec 09 21:33:26.755768 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a46262c-010f-4368-99fd-082021043f67 None None] Sync routers for ids ['6c885eb2-40c3-4066-83da-e64e5ab2723e'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:33:26.764294 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-57ea1a66-d571-4e40-a4b0-7df2d1519d60 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:26.768096 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a46262c-010f-4368-99fd-082021043f67 None None] Routers {'6c885eb2-40c3-4066-83da-e64e5ab2723e'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:26.769282 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-4a46262c-010f-4368-99fd-082021043f67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6c885eb2-40c3-4066-83da-e64e5ab2723e'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:26.780321 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2a982da6-c51c-4406-a98d-78f2964ead3a tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:26.845022 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a809b8cb-fc26-43fb-a7d1-9dabc68c54a8 req-ad2f9fe3-790d-465e-bf3e-0eec1ea4602c service neutron] 10.222.0.10 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1506786 Dec 09 21:33:26.868814 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-4a46262c-010f-4368-99fd-082021043f67 None None] Set router 6c885eb2-40c3-4066-83da-e64e5ab2723e gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:26.924872 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2a982da6-c51c-4406-a98d-78f2964ead3a tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:26.947144 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a809b8cb-fc26-43fb-a7d1-9dabc68c54a8 req-f0383ce5-7aa3-4df1-b8cd-907f984a3704 service neutron] 10.222.0.10 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0932274 Dec 09 21:33:26.996292 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a982da6-c51c-4406-a98d-78f2964ead3a tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:33:27.006000 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-2a982da6-c51c-4406-a98d-78f2964ead3a tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:27.018278 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a982da6-c51c-4406-a98d-78f2964ead3a tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:33:27.022144 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa995d25-990c-42cd-9202-78312a99457d None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:33:27.039506 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a982da6-c51c-4406-a98d-78f2964ead3a tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Pushing event updated for resources: {'Port': ['ID=e9fe81ac-ae48-4760-9bf2-591ef2c0c174,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:27.044899 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-57ea1a66-d571-4e40-a4b0-7df2d1519d60 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:27.054542 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-57ea1a66-d571-4e40-a4b0-7df2d1519d60 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-640457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-640448', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-635166'] for router, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:27.104280 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-4a46262c-010f-4368-99fd-082021043f67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:26Z', 'revision_number': 7, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:06Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6d011808-2a44-4e33-ba9f-38ccde498262', 'name': '', 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:52:62:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1694, 'fixed_ips': [{'subnet_id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:12Z', 'updated_at': '2021-12-09T21:33:18Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8f2b6f61-c226-4e58-95f7-107c2d25e2f0', 'name': '', 'network_id': 'b9102456-983e-454d-9648-31350235da23', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:62:52:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1701, 'fixed_ips': [{'subnet_id': '21435ea9-4cdd-441f-bce0-c107eec29d73', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:20Z', 'updated_at': '2021-12-09T21:33:25Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '21435ea9-4cdd-441f-bce0-c107eec29d73', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'aebca6d3-dcf2-40d7-897d-d683ffd7a3c5', 'name': '', 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:dd:5f:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:07Z', 'updated_at': '2021-12-09T21:33:12Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:27.135072 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a46262c-010f-4368-99fd-082021043f67 None None] Checking router: 6c885eb2-40c3-4066-83da-e64e5ab2723e for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:33:27.138398 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-15e71502-236a-4f14-a434-f7f1cf2938bc None None] Provisioning complete for port e9fe81ac-ae48-4760-9bf2-591ef2c0c174 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:27.138995 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-15e71502-236a-4f14-a434-f7f1cf2938bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:27.184679 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14b00edf-6c13-43d9-a47b-3a8118f97508 req-67c6266b-0929-4fe0-a9ac-233044771db1 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:27.187178 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14b00edf-6c13-43d9-a47b-3a8118f97508 req-67c6266b-0929-4fe0-a9ac-233044771db1 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.10 "GET /v2.0/ports?device_id=0572d5ce-eab2-4fdc-9c73-034455c686d3 HTTP/1.1" status: 200 len: 946 time: 0.0651693 Dec 09 21:33:27.189373 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a46262c-010f-4368-99fd-082021043f67 None None] Routers {'6c885eb2-40c3-4066-83da-e64e5ab2723e'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:27.190016 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-4a46262c-010f-4368-99fd-082021043f67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6c885eb2-40c3-4066-83da-e64e5ab2723e'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:27.244175 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-15e71502-236a-4f14-a434-f7f1cf2938bc None None] Port e9fe81ac-ae48-4760-9bf2-591ef2c0c174 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:33:27.271178 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-57ea1a66-d571-4e40-a4b0-7df2d1519d60 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Router 6c885eb2-40c3-4066-83da-e64e5ab2723e has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:33:27.279101 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:27.286538 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:27.302777 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-14b00edf-6c13-43d9-a47b-3a8118f97508 req-99581a1b-e57c-43ad-9218-aa804fd3310e tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Deleting port e265ed07-d705-41c8-a70d-3b1f794ae6a7 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:27.303187 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-14b00edf-6c13-43d9-a47b-3a8118f97508 req-99581a1b-e57c-43ad-9218-aa804fd3310e tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:27.305789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-4a46262c-010f-4368-99fd-082021043f67 None None] Set router 6c885eb2-40c3-4066-83da-e64e5ab2723e gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:27.439945 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-14b00edf-6c13-43d9-a47b-3a8118f97508 req-99581a1b-e57c-43ad-9218-aa804fd3310e tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] For port e265ed07-d705-41c8-a70d-3b1f794ae6a7, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e265ed07-d705-41c8-a70d-3b1f794ae6a7,segment=NetworkSegment(0c438a9d-68a6-4675-b498-b86f6eed54d4),segment_id=0c438a9d-68a6-4675-b498-b86f6eed54d4)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:27.440299 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-14b00edf-6c13-43d9-a47b-3a8118f97508 req-99581a1b-e57c-43ad-9218-aa804fd3310e tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:27.465581 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-14b00edf-6c13-43d9-a47b-3a8118f97508 req-99581a1b-e57c-43ad-9218-aa804fd3310e tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Calling delete_port for e265ed07-d705-41c8-a70d-3b1f794ae6a7 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:33:27.528580 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 8f2b6f61-c226-4e58-95f7-107c2d25e2f0 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:33:27.622999 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 8f2b6f61-c226-4e58-95f7-107c2d25e2f0 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:27.623554 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:27.645984 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-14b00edf-6c13-43d9-a47b-3a8118f97508 req-99581a1b-e57c-43ad-9218-aa804fd3310e tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:27.661397 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['e265ed07-d705-41c8-a70d-3b1f794ae6a7'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:33:27.681530 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99581a1b-e57c-43ad-9218-aa804fd3310e tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Pushing event deleted for resources: {'Port': ['ID=e265ed07-d705-41c8-a70d-3b1f794ae6a7,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:27.686791 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['287d2e38-af6c-4fbc-b196-bebf54c65697'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:33:27.742381 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-4a46262c-010f-4368-99fd-082021043f67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:26Z', 'revision_number': 7, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:06Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6d011808-2a44-4e33-ba9f-38ccde498262', 'name': '', 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:52:62:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1694, 'fixed_ips': [{'subnet_id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:12Z', 'updated_at': '2021-12-09T21:33:18Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8f2b6f61-c226-4e58-95f7-107c2d25e2f0', 'name': '', 'network_id': 'b9102456-983e-454d-9648-31350235da23', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:62:52:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1701, 'fixed_ips': [{'subnet_id': '21435ea9-4cdd-441f-bce0-c107eec29d73', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:20Z', 'updated_at': '2021-12-09T21:33:25Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '21435ea9-4cdd-441f-bce0-c107eec29d73', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'aebca6d3-dcf2-40d7-897d-d683ffd7a3c5', 'name': '', 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:dd:5f:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:07Z', 'updated_at': '2021-12-09T21:33:12Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:27.743128 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-14b00edf-6c13-43d9-a47b-3a8118f97508 req-99581a1b-e57c-43ad-9218-aa804fd3310e tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] No DVR routers for this DVR port e265ed07-d705-41c8-a70d-3b1f794ae6a7 on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:33:27.746662 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-14b00edf-6c13-43d9-a47b-3a8118f97508 req-99581a1b-e57c-43ad-9218-aa804fd3310e tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:27.752516 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14b00edf-6c13-43d9-a47b-3a8118f97508 req-99581a1b-e57c-43ad-9218-aa804fd3310e tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.10 "DELETE /v2.0/ports/e265ed07-d705-41c8-a70d-3b1f794ae6a7 HTTP/1.1" status: 204 len: 173 time: 0.5576415 Dec 09 21:33:27.780501 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a46262c-010f-4368-99fd-082021043f67 None None] The sync data for ids ['6c885eb2-40c3-4066-83da-e64e5ab2723e'] in n-d-713301-27 is: [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:26Z', 'revision_number': 7, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:06Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6d011808-2a44-4e33-ba9f-38ccde498262', 'name': '', 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:52:62:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1694, 'fixed_ips': [{'subnet_id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:12Z', 'updated_at': '2021-12-09T21:33:18Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8f2b6f61-c226-4e58-95f7-107c2d25e2f0', 'name': '', 'network_id': 'b9102456-983e-454d-9648-31350235da23', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:62:52:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1701, 'fixed_ips': [{'subnet_id': '21435ea9-4cdd-441f-bce0-c107eec29d73', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:20Z', 'updated_at': '2021-12-09T21:33:25Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '21435ea9-4cdd-441f-bce0-c107eec29d73', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'aebca6d3-dcf2-40d7-897d-d683ffd7a3c5', 'name': '', 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:dd:5f:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:07Z', 'updated_at': '2021-12-09T21:33:12Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:33:27.846112 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0572d5ce-eab2-4fdc-9c73-034455c686d3', 'name': 'network-vif-deleted', 'tag': 'e265ed07-d705-41c8-a70d-3b1f794ae6a7'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:33:27.848825 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6694354a-d5ef-4bd2-8586-9f6ade561685" -d '{"events": [{"server_uuid": "0572d5ce-eab2-4fdc-9c73-034455c686d3", "name": "network-vif-deleted", "tag": "e265ed07-d705-41c8-a70d-3b1f794ae6a7"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:33:27.857729 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2ce4332-0c55-40af-8254-e215a71900d6 req-65131e64-23b2-47f3-be5a-c0264387204e tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=0572d5ce-eab2-4fdc-9c73-034455c686d3 HTTP/1.1" status: 200 len: 210 time: 0.0485389 Dec 09 21:33:28.040255 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-57ea1a66-d571-4e40-a4b0-7df2d1519d60 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:33:28.050212 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-57ea1a66-d571-4e40-a4b0-7df2d1519d60 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:28.051809 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-57ea1a66-d571-4e40-a4b0-7df2d1519d60 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/routers/6c885eb2-40c3-4066-83da-e64e5ab2723e HTTP/1.1" status: 200 len: 704 time: 2.3284492 Dec 09 21:33:28.055730 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48720) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:28.083340 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3853d681-7201-400f-9a08-2f6cab57a9c1 req-a21cae3c-d2e9-49df-a52f-6642ab812c22 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:28.091534 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3853d681-7201-400f-9a08-2f6cab57a9c1 req-a21cae3c-d2e9-49df-a52f-6642ab812c22 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 943 time: 0.2918901 Dec 09 21:33:28.097341 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:33:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-749420b7-7875-4355-9cea-d68b1dccc667 x-openstack-request-id: req-749420b7-7875-4355-9cea-d68b1dccc667 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:33:28.097709 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0572d5ce-eab2-4fdc-9c73-034455c686d3", "name": "network-vif-deleted", "tag": "e265ed07-d705-41c8-a70d-3b1f794ae6a7", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:33:28.098036 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-749420b7-7875-4355-9cea-d68b1dccc667 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:33:28.098555 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0572d5ce-eab2-4fdc-9c73-034455c686d3', 'name': 'network-vif-deleted', 'tag': 'e265ed07-d705-41c8-a70d-3b1f794ae6a7', 'status': 'completed', 'code': 200} Dec 09 21:33:28.180016 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2a982da6-c51c-4406-a98d-78f2964ead3a tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:28.269529 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-12f051a3-3368-4e91-bf9d-acde802fc426 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/routers/6c885eb2-40c3-4066-83da-e64e5ab2723e HTTP/1.1" status: 200 len: 704 time: 0.2111566 Dec 09 21:33:28.272322 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48722) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:28.292955 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3853d681-7201-400f-9a08-2f6cab57a9c1 req-7ecc198b-a521-49f3-86b6-6ec5517c5ad6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2003365 Dec 09 21:33:28.303827 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41aa8b33-e70c-4d3b-839c-9eec723baa0b None None] Sync routers for ids ['6c885eb2-40c3-4066-83da-e64e5ab2723e'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:33:28.316058 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41aa8b33-e70c-4d3b-839c-9eec723baa0b None None] Routers {'6c885eb2-40c3-4066-83da-e64e5ab2723e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:28.317413 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-41aa8b33-e70c-4d3b-839c-9eec723baa0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6c885eb2-40c3-4066-83da-e64e5ab2723e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:28.425318 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-41aa8b33-e70c-4d3b-839c-9eec723baa0b None None] Set router 6c885eb2-40c3-4066-83da-e64e5ab2723e gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:28.453862 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2a982da6-c51c-4406-a98d-78f2964ead3a tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:28.592332 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2a982da6-c51c-4406-a98d-78f2964ead3a tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Router 45060f0f-1084-4860-ab91-389234af6c7c is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:33:28.619869 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device d5571683-a9bc-4155-85b9-b1ef208e21e9 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:33:28.652686 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bff791eb-19d9-4c48-911c-8ff27f73c511 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:28.676368 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-41aa8b33-e70c-4d3b-839c-9eec723baa0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:26Z', 'revision_number': 7, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:06Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6d011808-2a44-4e33-ba9f-38ccde498262', 'name': '', 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:52:62:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1694, 'fixed_ips': [{'subnet_id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:12Z', 'updated_at': '2021-12-09T21:33:18Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8f2b6f61-c226-4e58-95f7-107c2d25e2f0', 'name': '', 'network_id': 'b9102456-983e-454d-9648-31350235da23', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:62:52:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1701, 'fixed_ips': [{'subnet_id': '21435ea9-4cdd-441f-bce0-c107eec29d73', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:20Z', 'updated_at': '2021-12-09T21:33:25Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '21435ea9-4cdd-441f-bce0-c107eec29d73', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'aebca6d3-dcf2-40d7-897d-d683ffd7a3c5', 'name': '', 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:dd:5f:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:07Z', 'updated_at': '2021-12-09T21:33:12Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:28.710659 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41aa8b33-e70c-4d3b-839c-9eec723baa0b None None] Checking router: 6c885eb2-40c3-4066-83da-e64e5ab2723e for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:33:28.723926 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41aa8b33-e70c-4d3b-839c-9eec723baa0b None None] Routers {'6c885eb2-40c3-4066-83da-e64e5ab2723e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:28.724553 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-41aa8b33-e70c-4d3b-839c-9eec723baa0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6c885eb2-40c3-4066-83da-e64e5ab2723e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:28.741087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2a982da6-c51c-4406-a98d-78f2964ead3a tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:33:28.752070 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port d5571683-a9bc-4155-85b9-b1ef208e21e9, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=d5571683-a9bc-4155-85b9-b1ef208e21e9,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:28.756322 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90749ae5-a511-4710-b284-189c91bc023f None None] Sync routers for ids ['45060f0f-1084-4860-ab91-389234af6c7c'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:33:28.774003 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2a982da6-c51c-4406-a98d-78f2964ead3a tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:28.779543 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2a982da6-c51c-4406-a98d-78f2964ead3a tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 884 time: 4.1746743 Dec 09 21:33:28.780703 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48726) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:28.784060 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90749ae5-a511-4710-b284-189c91bc023f None None] Routers {'45060f0f-1084-4860-ab91-389234af6c7c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:28.784707 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-90749ae5-a511-4710-b284-189c91bc023f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['45060f0f-1084-4860-ab91-389234af6c7c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:28.824618 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'd5571683-a9bc-4155-85b9-b1ef208e21e9', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'port_id': 'd5571683-a9bc-4155-85b9-b1ef208e21e9', 'mac_address': 'fa:16:3e:f2:7c:7d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:33:28.824618 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-90749ae5-a511-4710-b284-189c91bc023f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:28.842726 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-41aa8b33-e70c-4d3b-839c-9eec723baa0b None None] Set router 6c885eb2-40c3-4066-83da-e64e5ab2723e gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:28.863949 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:28.884730 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d5571683-a9bc-4155-85b9-b1ef208e21e9 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:33:28.889144 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90749ae5-a511-4710-b284-189c91bc023f None None] Routers {'45060f0f-1084-4860-ab91-389234af6c7c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:28.889795 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-90749ae5-a511-4710-b284-189c91bc023f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['45060f0f-1084-4860-ab91-389234af6c7c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:28.935772 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-90749ae5-a511-4710-b284-189c91bc023f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:28.935772 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90749ae5-a511-4710-b284-189c91bc023f None None] The sync data for ids ['45060f0f-1084-4860-ab91-389234af6c7c'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:33:28.951320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48732) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:28.952776 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4b2584f5-1660-408a-b1b3-0b92591d32a3 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "GET /v2.0/routers/45060f0f-1084-4860-ab91-389234af6c7c HTTP/1.1" status: 200 len: 920 time: 0.1699901 Dec 09 21:33:28.965813 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-bff791eb-19d9-4c48-911c-8ff27f73c511 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting port 8f2b6f61-c226-4e58-95f7-107c2d25e2f0 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:28.966450 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bff791eb-19d9-4c48-911c-8ff27f73c511 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:28.968912 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port d5571683-a9bc-4155-85b9-b1ef208e21e9, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=d5571683-a9bc-4155-85b9-b1ef208e21e9,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:28.978039 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:29.034135 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=d5571683-a9bc-4155-85b9-b1ef208e21e9,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:29.037418 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-abddfc67-5e25-45e2-9dc6-3306070f9605 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "GET /v2.0/ports?device_id=45060f0f-1084-4860-ab91-389234af6c7c HTTP/1.1" status: 200 len: 205 time: 0.0835712 Dec 09 21:33:29.040783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48736) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:29.144955 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-41aa8b33-e70c-4d3b-839c-9eec723baa0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:26Z', 'revision_number': 7, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:06Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6d011808-2a44-4e33-ba9f-38ccde498262', 'name': '', 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:52:62:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1694, 'fixed_ips': [{'subnet_id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:12Z', 'updated_at': '2021-12-09T21:33:18Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8f2b6f61-c226-4e58-95f7-107c2d25e2f0', 'name': '', 'network_id': 'b9102456-983e-454d-9648-31350235da23', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:62:52:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1701, 'fixed_ips': [{'subnet_id': '21435ea9-4cdd-441f-bce0-c107eec29d73', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:20Z', 'updated_at': '2021-12-09T21:33:25Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '21435ea9-4cdd-441f-bce0-c107eec29d73', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'aebca6d3-dcf2-40d7-897d-d683ffd7a3c5', 'name': '', 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:dd:5f:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:07Z', 'updated_at': '2021-12-09T21:33:12Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:29.159421 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-bff791eb-19d9-4c48-911c-8ff27f73c511 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] For port 8f2b6f61-c226-4e58-95f7-107c2d25e2f0, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=8f2b6f61-c226-4e58-95f7-107c2d25e2f0,segment=NetworkSegment(aa51ef62-e8c5-4a58-a997-624640e44c0b),segment_id=aa51ef62-e8c5-4a58-a997-624640e44c0b)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:29.159949 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bff791eb-19d9-4c48-911c-8ff27f73c511 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:29.175094 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41aa8b33-e70c-4d3b-839c-9eec723baa0b None None] The sync data for ids ['6c885eb2-40c3-4066-83da-e64e5ab2723e'] in n-d-713301-27 is: [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:26Z', 'revision_number': 7, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:06Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6d011808-2a44-4e33-ba9f-38ccde498262', 'name': '', 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:52:62:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1694, 'fixed_ips': [{'subnet_id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:12Z', 'updated_at': '2021-12-09T21:33:18Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '8f2b6f61-c226-4e58-95f7-107c2d25e2f0', 'name': '', 'network_id': 'b9102456-983e-454d-9648-31350235da23', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:62:52:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1701, 'fixed_ips': [{'subnet_id': '21435ea9-4cdd-441f-bce0-c107eec29d73', 'ip_address': '2001:db8:3::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:20Z', 'updated_at': '2021-12-09T21:33:25Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '21435ea9-4cdd-441f-bce0-c107eec29d73', 'cidr': '2001:db8:3::/64', 'gateway_ip': '2001:db8:3::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'aebca6d3-dcf2-40d7-897d-d683ffd7a3c5', 'name': '', 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:dd:5f:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:07Z', 'updated_at': '2021-12-09T21:33:12Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:33:29.185251 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-bff791eb-19d9-4c48-911c-8ff27f73c511 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Calling delete_port for 8f2b6f61-c226-4e58-95f7-107c2d25e2f0 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:33:29.254073 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1704466a-4389-4bac-a187-3452410f2150 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:29.304196 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['d5571683-a9bc-4155-85b9-b1ef208e21e9'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:33:29.320024 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b44f4aa-f90f-4218-a75a-7c42d443afb5 req-8d952494-296d-4ad1-9c2d-f38391feb236 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:29.321902 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b44f4aa-f90f-4218-a75a-7c42d443afb5 req-8d952494-296d-4ad1-9c2d-f38391feb236 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.1160808 Dec 09 21:33:29.408425 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bff791eb-19d9-4c48-911c-8ff27f73c511 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:29.436541 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bff791eb-19d9-4c48-911c-8ff27f73c511 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Port': ['ID=8f2b6f61-c226-4e58-95f7-107c2d25e2f0,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:29.480024 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b44f4aa-f90f-4218-a75a-7c42d443afb5 req-8ef544aa-f4b2-4423-995c-92d7881d5b0a tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1499898 Dec 09 21:33:29.514724 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-629e3179-6ff2-4499-955d-5d99a62d5c97 req-a3b576c7-d312-443b-b4e3-f2f31bbed06d tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:29.516856 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-629e3179-6ff2-4499-955d-5d99a62d5c97 req-a3b576c7-d312-443b-b4e3-f2f31bbed06d tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 944 time: 0.1155434 Dec 09 21:33:29.518845 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1704466a-4389-4bac-a187-3452410f2150 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:29.586999 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bff791eb-19d9-4c48-911c-8ff27f73c511 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:29.596255 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-629e3179-6ff2-4499-955d-5d99a62d5c97 req-e367b461-3c5a-4add-97ca-837300f1c354 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0713403 Dec 09 21:33:29.617576 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-1704466a-4389-4bac-a187-3452410f2150 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Deleting port e9fe81ac-ae48-4760-9bf2-591ef2c0c174 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:29.617927 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1704466a-4389-4bac-a187-3452410f2150 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:29.702010 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1704466a-4389-4bac-a187-3452410f2150 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:29.719362 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-1704466a-4389-4bac-a187-3452410f2150 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Calling delete_port for e9fe81ac-ae48-4760-9bf2-591ef2c0c174 owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:33:29.810992 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bff791eb-19d9-4c48-911c-8ff27f73c511 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Router 6c885eb2-40c3-4066-83da-e64e5ab2723e has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:33:29.890027 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1704466a-4389-4bac-a187-3452410f2150 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:29.909409 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bff791eb-19d9-4c48-911c-8ff27f73c511 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:33:29.914786 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bff791eb-19d9-4c48-911c-8ff27f73c511 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/routers/6c885eb2-40c3-4066-83da-e64e5ab2723e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6406164 Dec 09 21:33:29.918496 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48746) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:29.919540 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1704466a-4389-4bac-a187-3452410f2150 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Pushing event deleted for resources: {'Port': ['ID=e9fe81ac-ae48-4760-9bf2-591ef2c0c174,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:29.920752 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90e90968-f430-40fc-afc7-1839beed9bf0 None None] Sync routers for ids ['6c885eb2-40c3-4066-83da-e64e5ab2723e'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:33:29.932702 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ee1ff8e-86bb-49ba-b832-ccc687dc0ce8 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:33:29.942328 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90e90968-f430-40fc-afc7-1839beed9bf0 None None] Routers {'6c885eb2-40c3-4066-83da-e64e5ab2723e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:29.942956 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-90e90968-f430-40fc-afc7-1839beed9bf0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6c885eb2-40c3-4066-83da-e64e5ab2723e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:29.991302 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-08ec3fd7-191d-4d44-aee0-065bc13a4ace tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting subnet 21435ea9-4cdd-441f-bce0-c107eec29d73 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:33:29.994744 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-08ec3fd7-191d-4d44-aee0-065bc13a4ace tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:29.999376 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1704466a-4389-4bac-a187-3452410f2150 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:30.039480 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-08ec3fd7-191d-4d44-aee0-065bc13a4ace tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:30.043859 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-90e90968-f430-40fc-afc7-1839beed9bf0 None None] Set router 6c885eb2-40c3-4066-83da-e64e5ab2723e gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:30.097053 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1704466a-4389-4bac-a187-3452410f2150 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:30.099400 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1704466a-4389-4bac-a187-3452410f2150 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:30.147218 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-08ec3fd7-191d-4d44-aee0-065bc13a4ace tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:30.149245 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1704466a-4389-4bac-a187-3452410f2150 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:30.149881 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1704466a-4389-4bac-a187-3452410f2150 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Fanout notify agent at l3_agent the message router_deleted on router 45060f0f-1084-4860-ab91-389234af6c7c {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:33:30.163714 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1704466a-4389-4bac-a187-3452410f2150 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:30.165459 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1704466a-4389-4bac-a187-3452410f2150 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "DELETE /v2.0/routers/45060f0f-1084-4860-ab91-389234af6c7c HTTP/1.1" status: 204 len: 168 time: 1.1230230 Dec 09 21:33:30.168667 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48750) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:30.173289 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-836e9a8a-1dde-45f5-a871-8664dfc5514b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Request body: {'router': {'name': 'tempest-snat-router-1453739307', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'enable_snat': False}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:30.199523 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-836e9a8a-1dde-45f5-a871-8664dfc5514b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:30.201592 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-836e9a8a-1dde-45f5-a871-8664dfc5514b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:30.231393 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-08ec3fd7-191d-4d44-aee0-065bc13a4ace tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:30.258048 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5cbcd6a6-4882-4ac6-8975-97ac111d38ec None None] Network b9102456-983e-454d-9648-31350235da23 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:33:30.271700 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-90e90968-f430-40fc-afc7-1839beed9bf0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:29Z', 'revision_number': 8, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:06Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6d011808-2a44-4e33-ba9f-38ccde498262', 'name': '', 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:52:62:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1694, 'fixed_ips': [{'subnet_id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:12Z', 'updated_at': '2021-12-09T21:33:18Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'aebca6d3-dcf2-40d7-897d-d683ffd7a3c5', 'name': '', 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:dd:5f:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:07Z', 'updated_at': '2021-12-09T21:33:12Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:30.272218 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-08ec3fd7-191d-4d44-aee0-065bc13a4ace tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:30.279633 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-08ec3fd7-191d-4d44-aee0-065bc13a4ace tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/subnets/21435ea9-4cdd-441f-bce0-c107eec29d73 HTTP/1.1" status: 204 len: 168 time: 0.3571854 Dec 09 21:33:30.279633 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08ec3fd7-191d-4d44-aee0-065bc13a4ace tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Subnet': ['ID=21435ea9-4cdd-441f-bce0-c107eec29d73,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:30.280531 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48754) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:30.285144 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-836e9a8a-1dde-45f5-a871-8664dfc5514b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:30.313205 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90e90968-f430-40fc-afc7-1839beed9bf0 None None] Checking router: 6c885eb2-40c3-4066-83da-e64e5ab2723e for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:33:30.328869 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90e90968-f430-40fc-afc7-1839beed9bf0 None None] Routers {'6c885eb2-40c3-4066-83da-e64e5ab2723e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:30.329611 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-90e90968-f430-40fc-afc7-1839beed9bf0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6c885eb2-40c3-4066-83da-e64e5ab2723e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:30.384028 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5cc1f412-c2cf-4248-bc8b-d47f1451119e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:30.451371 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-5cc1f412-c2cf-4248-bc8b-d47f1451119e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting port c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:30.451976 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5cc1f412-c2cf-4248-bc8b-d47f1451119e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:30.474960 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-836e9a8a-1dde-45f5-a871-8664dfc5514b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:30.484072 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ade61cbc-6260-420d-a4d7-e379f42099d9 None None] DHCP port deletion for b9102456-983e-454d-9648-31350235da23 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:33:30.539367 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-5cc1f412-c2cf-4248-bc8b-d47f1451119e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] For port c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63,segment=NetworkSegment(aa51ef62-e8c5-4a58-a997-624640e44c0b),segment_id=aa51ef62-e8c5-4a58-a997-624640e44c0b)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:30.540164 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5cc1f412-c2cf-4248-bc8b-d47f1451119e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:30.570557 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-90e90968-f430-40fc-afc7-1839beed9bf0 None None] Set router 6c885eb2-40c3-4066-83da-e64e5ab2723e gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:30.647493 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54592ae1-ce4c-4259-be75-a5a362261999 req-9ee2a158-2677-4962-b498-daedb06c4fff tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:30.649704 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-54592ae1-ce4c-4259-be75-a5a362261999 req-9ee2a158-2677-4962-b498-daedb06c4fff tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.0743854 Dec 09 21:33:30.784737 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device d5571683-a9bc-4155-85b9-b1ef208e21e9 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:33:30.853057 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ade61cbc-6260-420d-a4d7-e379f42099d9 None None] Deleting port c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:30.853431 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ade61cbc-6260-420d-a4d7-e379f42099d9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:30.870138 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b32b532d-080e-4661-aede-21bacc62b531 req-f58bc67c-5669-4e39-a99f-f53368e02767 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:30.871903 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b32b532d-080e-4661-aede-21bacc62b531 req-f58bc67c-5669-4e39-a99f-f53368e02767 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 944 time: 0.1397028 Dec 09 21:33:30.878561 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-836e9a8a-1dde-45f5-a871-8664dfc5514b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:30.907998 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-90e90968-f430-40fc-afc7-1839beed9bf0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:29Z', 'revision_number': 8, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:06Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6d011808-2a44-4e33-ba9f-38ccde498262', 'name': '', 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:52:62:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1694, 'fixed_ips': [{'subnet_id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:12Z', 'updated_at': '2021-12-09T21:33:18Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'aebca6d3-dcf2-40d7-897d-d683ffd7a3c5', 'name': '', 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:dd:5f:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:07Z', 'updated_at': '2021-12-09T21:33:12Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:30.911855 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-836e9a8a-1dde-45f5-a871-8664dfc5514b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:30.922796 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ade61cbc-6260-420d-a4d7-e379f42099d9 None None] For port c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63,segment=NetworkSegment(aa51ef62-e8c5-4a58-a997-624640e44c0b),segment_id=aa51ef62-e8c5-4a58-a997-624640e44c0b)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:30.923337 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ade61cbc-6260-420d-a4d7-e379f42099d9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:30.937978 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ade61cbc-6260-420d-a4d7-e379f42099d9 None None] Calling delete_port for c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:33:30.938846 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-5cc1f412-c2cf-4248-bc8b-d47f1451119e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Calling delete_port for c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:33:30.943992 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-54592ae1-ce4c-4259-be75-a5a362261999 req-97689b15-7c5b-4c3f-83be-1ddb0de4fd6c tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/security-groups?id=1b4daa16-ee9d-40f9-a306-60415764edf0&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1792986 Dec 09 21:33:30.949408 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90e90968-f430-40fc-afc7-1839beed9bf0 None None] The sync data for ids ['6c885eb2-40c3-4066-83da-e64e5ab2723e'] in n-d-713301-27 is: [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:29Z', 'revision_number': 8, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:06Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '6d011808-2a44-4e33-ba9f-38ccde498262', 'name': '', 'network_id': '8e0cfbe6-9002-42c6-8e79-8d95b404c162', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:52:62:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1694, 'fixed_ips': [{'subnet_id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'ip_address': '2001:db8:2::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:12Z', 'updated_at': '2021-12-09T21:33:18Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': 'f6a9f8ec-203e-476b-a436-3472ba061489', 'cidr': '2001:db8:2::/64', 'gateway_ip': '2001:db8:2::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'aebca6d3-dcf2-40d7-897d-d683ffd7a3c5', 'name': '', 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:dd:5f:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:07Z', 'updated_at': '2021-12-09T21:33:12Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:33:31.003415 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port d5571683-a9bc-4155-85b9-b1ef208e21e9 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:33:31.013857 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port d5571683-a9bc-4155-85b9-b1ef208e21e9 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:31.014931 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:31.051532 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5cc1f412-c2cf-4248-bc8b-d47f1451119e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:31.070071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5cc1f412-c2cf-4248-bc8b-d47f1451119e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] No DVR routers for this DVR port c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:33:31.072092 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ade61cbc-6260-420d-a4d7-e379f42099d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:31.082772 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b32b532d-080e-4661-aede-21bacc62b531 req-407585fb-04b8-4ff0-abc8-c8887450099b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1826503 Dec 09 21:33:31.104077 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ade61cbc-6260-420d-a4d7-e379f42099d9 None None] Pushing event deleted for resources: {'Port': ['ID=c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:31.112990 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ade61cbc-6260-420d-a4d7-e379f42099d9 None None] No DVR routers for this DVR port c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:33:31.117804 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cc1f412-c2cf-4248-bc8b-d47f1451119e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Port': ['ID=c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:31.137141 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02786c7a-a717-467e-9d65-06561c1e24ce req-e95f9e1c-c661-4b2e-8f93-81fff4f7cdc4 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:31.138794 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02786c7a-a717-467e-9d65-06561c1e24ce req-e95f9e1c-c661-4b2e-8f93-81fff4f7cdc4 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.31 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 945 time: 0.1187785 Dec 09 21:33:31.166812 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:31.191601 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5cc1f412-c2cf-4248-bc8b-d47f1451119e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:31.195669 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '18e7aa5b-b78c-4cc4-9e5e-e407c47a414c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd5571683-a9bc-4155-85b9-b1ef208e21e9'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:33:31.198044 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-343b6fb7-eda1-441a-b2f8-579ce1f900c9" -d '{"events": [{"server_uuid": "18e7aa5b-b78c-4cc4-9e5e-e407c47a414c", "name": "network-vif-plugged", "status": "completed", "tag": "d5571683-a9bc-4155-85b9-b1ef208e21e9"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:33:31.211853 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port d5571683-a9bc-4155-85b9-b1ef208e21e9, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=d5571683-a9bc-4155-85b9-b1ef208e21e9,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:31.213032 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-5cc1f412-c2cf-4248-bc8b-d47f1451119e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b9102456-983e-454d-9648-31350235da23']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:31.219106 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:31.220207 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e265ed07-d705-41c8-a70d-3b1f794ae6a7 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:33:31.223578 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-5cc1f412-c2cf-4248-bc8b-d47f1451119e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'aa51ef62-e8c5-4a58-a997-624640e44c0b') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:31.223802 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-5cc1f412-c2cf-4248-bc8b-d47f1451119e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'aa51ef62-e8c5-4a58-a997-624640e44c0b') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:31.228185 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-836e9a8a-1dde-45f5-a871-8664dfc5514b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Allocated IP 172.25.3.207 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/d2b1d986-b470-480d-bf5b-52ae11af0b62) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:33:31.234163 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5cc1f412-c2cf-4248-bc8b-d47f1451119e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:31.248494 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5cc1f412-c2cf-4248-bc8b-d47f1451119e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:31.255087 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5cc1f412-c2cf-4248-bc8b-d47f1451119e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Releasing vlan 119 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:33:31.255464 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5cc1f412-c2cf-4248-bc8b-d47f1451119e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:33:31.269500 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:33:31.272196 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:33:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7e349dcb-610c-4cf9-bf97-645251ea8db3 x-openstack-request-id: req-7e349dcb-610c-4cf9-bf97-645251ea8db3 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:33:31.272196 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "18e7aa5b-b78c-4cc4-9e5e-e407c47a414c", "name": "network-vif-plugged", "status": "completed", "tag": "d5571683-a9bc-4155-85b9-b1ef208e21e9", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:33:31.272196 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-7e349dcb-610c-4cf9-bf97-645251ea8db3 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:33:31.273451 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '18e7aa5b-b78c-4cc4-9e5e-e407c47a414c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd5571683-a9bc-4155-85b9-b1ef208e21e9', 'code': 200} Dec 09 21:33:31.273729 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: e265ed07-d705-41c8-a70d-3b1f794ae6a7 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:33:31.274065 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e265ed07-d705-41c8-a70d-3b1f794ae6a7 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:33:31.308861 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=d5571683-a9bc-4155-85b9-b1ef208e21e9,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:31.345387 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5cc1f412-c2cf-4248-bc8b-d47f1451119e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:31.412570 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5cc1f412-c2cf-4248-bc8b-d47f1451119e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:31.416887 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5cc1f412-c2cf-4248-bc8b-d47f1451119e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/networks/b9102456-983e-454d-9648-31350235da23 HTTP/1.1" status: 204 len: 168 time: 1.1356268 Dec 09 21:33:31.420389 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48768) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:31.436100 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:33:31.443917 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-02786c7a-a717-467e-9d65-06561c1e24ce req-baa6dbab-ecc6-4f50-9a31-a40bea8cedc4 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Deleting port 287d2e38-af6c-4fbc-b196-bebf54c65697 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:31.444288 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-02786c7a-a717-467e-9d65-06561c1e24ce req-baa6dbab-ecc6-4f50-9a31-a40bea8cedc4 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:31.460487 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:33:31.460830 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c53f7bc6-bfbe-4985-a879-f8fe6e0ffa63 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:33:31.461255 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 8f2b6f61-c226-4e58-95f7-107c2d25e2f0 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:33:31.476832 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cc1f412-c2cf-4248-bc8b-d47f1451119e tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Network': ['ID=b9102456-983e-454d-9648-31350235da23,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:31.486127 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 8f2b6f61-c226-4e58-95f7-107c2d25e2f0 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:33:31.486502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 8f2b6f61-c226-4e58-95f7-107c2d25e2f0 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:33:31.524090 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d2c69d-1806-4511-8752-e93d2da7be66 req-3c967b1b-d0cd-4573-933f-f1f2902341d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:31.525638 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d5d2c69d-1806-4511-8752-e93d2da7be66 req-3c967b1b-d0cd-4573-933f-f1f2902341d3 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 1097 time: 0.1783233 Dec 09 21:33:31.536477 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-836e9a8a-1dde-45f5-a871-8664dfc5514b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:31.565276 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-02786c7a-a717-467e-9d65-06561c1e24ce req-baa6dbab-ecc6-4f50-9a31-a40bea8cedc4 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] For port 287d2e38-af6c-4fbc-b196-bebf54c65697, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=287d2e38-af6c-4fbc-b196-bebf54c65697,segment=NetworkSegment(0c438a9d-68a6-4675-b498-b86f6eed54d4),segment_id=0c438a9d-68a6-4675-b498-b86f6eed54d4)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:31.565636 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-02786c7a-a717-467e-9d65-06561c1e24ce req-baa6dbab-ecc6-4f50-9a31-a40bea8cedc4 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:31.586998 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-02786c7a-a717-467e-9d65-06561c1e24ce req-baa6dbab-ecc6-4f50-9a31-a40bea8cedc4 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Calling delete_port for 287d2e38-af6c-4fbc-b196-bebf54c65697 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:33:31.638470 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-836e9a8a-1dde-45f5-a871-8664dfc5514b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:31.651675 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d5d2c69d-1806-4511-8752-e93d2da7be66 req-45d6768c-e95d-44dc-b679-7f7d6e501431 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1185908 Dec 09 21:33:31.684138 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-836e9a8a-1dde-45f5-a871-8664dfc5514b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:33:31.693904 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-836e9a8a-1dde-45f5-a871-8664dfc5514b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:31.700798 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-836e9a8a-1dde-45f5-a871-8664dfc5514b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:33:31.708542 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-36fea4d2-86fd-42ec-8614-c82f1c2ad5cb None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:33:31.726468 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-836e9a8a-1dde-45f5-a871-8664dfc5514b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Pushing event updated for resources: {'Port': ['ID=d2b1d986-b470-480d-bf5b-52ae11af0b62,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:31.809110 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-87b1b5d3-4baf-483f-821a-c7ff9cdfd4be None None] Provisioning complete for port d2b1d986-b470-480d-bf5b-52ae11af0b62 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:31.809492 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-87b1b5d3-4baf-483f-821a-c7ff9cdfd4be None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:31.827662 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-43ecf064-130c-45eb-b27a-97fd3a04fbb1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:31.851342 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-87b1b5d3-4baf-483f-821a-c7ff9cdfd4be None None] Port d2b1d986-b470-480d-bf5b-52ae11af0b62 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:33:31.893856 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-02786c7a-a717-467e-9d65-06561c1e24ce req-baa6dbab-ecc6-4f50-9a31-a40bea8cedc4 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:31.916879 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['287d2e38-af6c-4fbc-b196-bebf54c65697'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:33:31.947810 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baa6dbab-ecc6-4f50-9a31-a40bea8cedc4 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Pushing event deleted for resources: {'Port': ['ID=287d2e38-af6c-4fbc-b196-bebf54c65697,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:32.060016 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-02786c7a-a717-467e-9d65-06561c1e24ce req-baa6dbab-ecc6-4f50-9a31-a40bea8cedc4 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] No DVR routers for this DVR port 287d2e38-af6c-4fbc-b196-bebf54c65697 on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:33:32.064897 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-02786c7a-a717-467e-9d65-06561c1e24ce req-baa6dbab-ecc6-4f50-9a31-a40bea8cedc4 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:32.068164 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02786c7a-a717-467e-9d65-06561c1e24ce req-baa6dbab-ecc6-4f50-9a31-a40bea8cedc4 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.31 "DELETE /v2.0/ports/287d2e38-af6c-4fbc-b196-bebf54c65697 HTTP/1.1" status: 204 len: 173 time: 0.9154296 Dec 09 21:33:32.072861 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bfdfbd26-1bb4-4590-8cdf-732329bfb002', 'name': 'network-vif-deleted', 'tag': '287d2e38-af6c-4fbc-b196-bebf54c65697'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:33:32.076085 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a7e019ab-33da-4fdd-8ab5-e094d9390f67" -d '{"events": [{"server_uuid": "bfdfbd26-1bb4-4590-8cdf-732329bfb002", "name": "network-vif-deleted", "tag": "287d2e38-af6c-4fbc-b196-bebf54c65697"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:33:32.136307 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-28989096-4ff2-443f-9359-2ece5c543978 req-60064870-d888-4cc1-9e9f-3400815b3d71 tempest-ListServerFiltersTestJSON-629656253 tempest-ListServerFiltersTestJSON-629656253-project] 10.222.0.13 "GET /v2.0/ports?device_id=bfdfbd26-1bb4-4590-8cdf-732329bfb002 HTTP/1.1" status: 200 len: 210 time: 0.1006818 Dec 09 21:33:32.156920 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-43ecf064-130c-45eb-b27a-97fd3a04fbb1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting port 6d011808-2a44-4e33-ba9f-38ccde498262 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:32.157805 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-43ecf064-130c-45eb-b27a-97fd3a04fbb1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:32.182782 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-836e9a8a-1dde-45f5-a871-8664dfc5514b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:32.304419 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-43ecf064-130c-45eb-b27a-97fd3a04fbb1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] For port 6d011808-2a44-4e33-ba9f-38ccde498262, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6d011808-2a44-4e33-ba9f-38ccde498262,segment=NetworkSegment(aefee495-6d7c-460f-b4a3-a320048af8d9),segment_id=aefee495-6d7c-460f-b4a3-a320048af8d9)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:32.304919 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-43ecf064-130c-45eb-b27a-97fd3a04fbb1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:32.319841 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-43ecf064-130c-45eb-b27a-97fd3a04fbb1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Calling delete_port for 6d011808-2a44-4e33-ba9f-38ccde498262 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:33:32.505534 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-43ecf064-130c-45eb-b27a-97fd3a04fbb1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:32.536405 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43ecf064-130c-45eb-b27a-97fd3a04fbb1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Port': ['ID=6d011808-2a44-4e33-ba9f-38ccde498262,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:32.665613 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-43ecf064-130c-45eb-b27a-97fd3a04fbb1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:32.693876 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:33:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0bdf1f55-b25f-46ba-aa0f-9ac612e3be36 x-openstack-request-id: req-0bdf1f55-b25f-46ba-aa0f-9ac612e3be36 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:33:32.694155 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bfdfbd26-1bb4-4590-8cdf-732329bfb002", "name": "network-vif-deleted", "tag": "287d2e38-af6c-4fbc-b196-bebf54c65697", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:33:32.694836 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0bdf1f55-b25f-46ba-aa0f-9ac612e3be36 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:33:32.694836 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bfdfbd26-1bb4-4590-8cdf-732329bfb002', 'name': 'network-vif-deleted', 'tag': '287d2e38-af6c-4fbc-b196-bebf54c65697', 'status': 'completed', 'code': 200} Dec 09 21:33:32.792005 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c2c0174-5fda-4e28-a7b0-8bab5fc23175 req-7456f93c-55e3-47d2-8bb4-982666061f6a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:32.799971 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c2c0174-5fda-4e28-a7b0-8bab5fc23175 req-7456f93c-55e3-47d2-8bb4-982666061f6a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 945 time: 0.1077785 Dec 09 21:33:32.898437 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c2c0174-5fda-4e28-a7b0-8bab5fc23175 req-d5d02ab5-3b56-4909-a759-b912127b2b4b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0972121 Dec 09 21:33:32.903502 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-836e9a8a-1dde-45f5-a871-8664dfc5514b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:32.910641 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-43ecf064-130c-45eb-b27a-97fd3a04fbb1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Router 6c885eb2-40c3-4066-83da-e64e5ab2723e has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:33:32.950317 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3590c2c8-f296-4296-b8a6-6dad24f1c471 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:33.014475 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-43ecf064-130c-45eb-b27a-97fd3a04fbb1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:33:33.022672 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-43ecf064-130c-45eb-b27a-97fd3a04fbb1 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/routers/6c885eb2-40c3-4066-83da-e64e5ab2723e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6003542 Dec 09 21:33:33.023632 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48784) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:33.025653 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90439d81-4576-4e4f-a59f-3fc48a74c452 None None] Sync routers for ids ['6c885eb2-40c3-4066-83da-e64e5ab2723e'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:33:33.038895 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90439d81-4576-4e4f-a59f-3fc48a74c452 None None] Routers {'6c885eb2-40c3-4066-83da-e64e5ab2723e'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:33.039684 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-90439d81-4576-4e4f-a59f-3fc48a74c452 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6c885eb2-40c3-4066-83da-e64e5ab2723e'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:33.042697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-836e9a8a-1dde-45f5-a871-8664dfc5514b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Router a2c7f18d-2988-4425-bc10-4b68903df665 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:33:33.076199 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-ca4182e5-3282-46c0-9005-48844a2da982 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting subnet f6a9f8ec-203e-476b-a436-3472ba061489 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:33:33.079369 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ca4182e5-3282-46c0-9005-48844a2da982 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:33.127291 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ca4182e5-3282-46c0-9005-48844a2da982 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:33.132913 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-90439d81-4576-4e4f-a59f-3fc48a74c452 None None] Set router 6c885eb2-40c3-4066-83da-e64e5ab2723e gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:33.155219 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-836e9a8a-1dde-45f5-a871-8664dfc5514b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:33:33.184652 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] Sync routers for ids ['a2c7f18d-2988-4425-bc10-4b68903df665'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:33:33.186715 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-836e9a8a-1dde-45f5-a871-8664dfc5514b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:33.191284 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-836e9a8a-1dde-45f5-a871-8664dfc5514b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 908 time: 3.0214579 Dec 09 21:33:33.193916 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48790) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:33.203204 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] Routers {'a2c7f18d-2988-4425-bc10-4b68903df665'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:33.203876 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a2c7f18d-2988-4425-bc10-4b68903df665'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:33.246333 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48792) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:33.303097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-35d32e1b-0a4c-4992-a8fb-6142548ebd0b admin admin] Deleting subnet e884864f-1596-4ce2-af55-9b1c3a7758eb {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:33:33.308132 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-35d32e1b-0a4c-4992-a8fb-6142548ebd0b admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:33.332535 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d2a57ed0-6afa-4941-9615-275adf7519b8 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "GET /v2.0/routers/a2c7f18d-2988-4425-bc10-4b68903df665 HTTP/1.1" status: 200 len: 909 time: 0.1351676 Dec 09 21:33:33.333391 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48794) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:33.338364 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a32946ae-d860-4371-98c7-65aa94da11b4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Request body: {'router': {'name': 'tempest-snat-router-1453739307', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'enable_snat': True}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:33.338761 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] Set router a2c7f18d-2988-4425-bc10-4b68903df665 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:33.357920 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ca4182e5-3282-46c0-9005-48844a2da982 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:33.367899 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a32946ae-d860-4371-98c7-65aa94da11b4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:33.369113 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a32946ae-d860-4371-98c7-65aa94da11b4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:33.396362 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-35d32e1b-0a4c-4992-a8fb-6142548ebd0b admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:33.423782 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-90439d81-4576-4e4f-a59f-3fc48a74c452 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:32Z', 'revision_number': 9, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:06Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'aebca6d3-dcf2-40d7-897d-d683ffd7a3c5', 'name': '', 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:dd:5f:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:07Z', 'updated_at': '2021-12-09T21:33:12Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:33.490882 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90439d81-4576-4e4f-a59f-3fc48a74c452 None None] Checking router: 6c885eb2-40c3-4066-83da-e64e5ab2723e for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:33:33.498213 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a32946ae-d860-4371-98c7-65aa94da11b4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:33.499496 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ca4182e5-3282-46c0-9005-48844a2da982 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:33.514036 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90439d81-4576-4e4f-a59f-3fc48a74c452 None None] Routers {'6c885eb2-40c3-4066-83da-e64e5ab2723e'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:33.515006 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-90439d81-4576-4e4f-a59f-3fc48a74c452 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6c885eb2-40c3-4066-83da-e64e5ab2723e'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:33.544288 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca4182e5-3282-46c0-9005-48844a2da982 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Subnet': ['ID=f6a9f8ec-203e-476b-a436-3472ba061489,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:33.552971 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ca4182e5-3282-46c0-9005-48844a2da982 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:33.555966 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ca4182e5-3282-46c0-9005-48844a2da982 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/subnets/f6a9f8ec-203e-476b-a436-3472ba061489 HTTP/1.1" status: 204 len: 168 time: 0.5305796 Dec 09 21:33:33.558742 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48800) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:33.573010 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-35d32e1b-0a4c-4992-a8fb-6142548ebd0b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:33.645684 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ccb01dcb-c2e1-4625-b8f1-b910db9be2b0 None None] Network 8e0cfbe6-9002-42c6-8e79-8d95b404c162 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:33:33.649169 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a2c7f18d-2988-4425-bc10-4b68903df665', 'name': 'tempest-snat-router-1453739307', 'tenant_id': '355561057aae464295eb0ce91a41002c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.207'}], 'enable_snat': False}, 'gw_port_id': 'd2b1d986-b470-480d-bf5b-52ae11af0b62', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:33:30Z', 'updated_at': '2021-12-09T21:33:31Z', 'revision_number': 3, 'project_id': '355561057aae464295eb0ce91a41002c', 'gw_port': {'id': 'd2b1d986-b470-480d-bf5b-52ae11af0b62', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:51:50:6a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a2c7f18d-2988-4425-bc10-4b68903df665', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1707, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:30Z', 'updated_at': '2021-12-09T21:33:31Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:33.670804 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d7a5c5a-7db8-4e26-a025-79b83e6b3c53 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:33.682760 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a32946ae-d860-4371-98c7-65aa94da11b4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:33.683824 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] Checking router: a2c7f18d-2988-4425-bc10-4b68903df665 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:33:33.684041 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] Updating router a2c7f18d-2988-4425-bc10-4b68903df665 port d2b1d986-b470-480d-bf5b-52ae11af0b62 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:33:33.712168 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-35d32e1b-0a4c-4992-a8fb-6142548ebd0b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:33.716381 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:33.752490 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35d32e1b-0a4c-4992-a8fb-6142548ebd0b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e884864f-1596-4ce2-af55-9b1c3a7758eb,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:33.754693 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-35d32e1b-0a4c-4992-a8fb-6142548ebd0b admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:33.760845 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-35d32e1b-0a4c-4992-a8fb-6142548ebd0b admin admin] 10.222.0.13 "DELETE /v2.0/subnets/e884864f-1596-4ce2-af55-9b1c3a7758eb HTTP/1.1" status: 204 len: 168 time: 0.5134726 Dec 09 21:33:33.761617 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48802) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:33.771173 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-52ca2f47-0483-4123-ad44-c0f4c90787e6 None None] Network 1b5db94a-f2e5-4ee6-b165-fbd41044188e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:33:33.780957 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-5d7a5c5a-7db8-4e26-a025-79b83e6b3c53 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting port 64c16765-599f-4fe9-a043-c428c204b3c2 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:33.781370 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d7a5c5a-7db8-4e26-a025-79b83e6b3c53 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:33.821469 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-90439d81-4576-4e4f-a59f-3fc48a74c452 None None] Set router 6c885eb2-40c3-4066-83da-e64e5ab2723e gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:33.850463 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-5d7a5c5a-7db8-4e26-a025-79b83e6b3c53 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] For port 64c16765-599f-4fe9-a043-c428c204b3c2, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=64c16765-599f-4fe9-a043-c428c204b3c2,segment=NetworkSegment(aefee495-6d7c-460f-b4a3-a320048af8d9),segment_id=aefee495-6d7c-460f-b4a3-a320048af8d9)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:33.850821 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d7a5c5a-7db8-4e26-a025-79b83e6b3c53 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:33.864928 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-5d7a5c5a-7db8-4e26-a025-79b83e6b3c53 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Calling delete_port for 64c16765-599f-4fe9-a043-c428c204b3c2 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:33:33.865349 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b58559f2-4efa-4abf-ab7c-bf0386be39e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:33.998512 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d7a5c5a-7db8-4e26-a025-79b83e6b3c53 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.033285 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a32946ae-d860-4371-98c7-65aa94da11b4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.036992 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-b58559f2-4efa-4abf-ab7c-bf0386be39e7 admin admin] Deleting port 42a44357-1e1d-43a3-801a-87d822b70284 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:34.037323 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b58559f2-4efa-4abf-ab7c-bf0386be39e7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.039383 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d7a5c5a-7db8-4e26-a025-79b83e6b3c53 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Port': ['ID=64c16765-599f-4fe9-a043-c428c204b3c2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:34.046146 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d7a5c5a-7db8-4e26-a025-79b83e6b3c53 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] No DVR routers for this DVR port 64c16765-599f-4fe9-a043-c428c204b3c2 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:33:34.057003 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f376993-61e5-4197-b622-117238eb1ed1 None None] DHCP port deletion for 8e0cfbe6-9002-42c6-8e79-8d95b404c162 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:33:34.075527 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a32946ae-d860-4371-98c7-65aa94da11b4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.110955 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.121044 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.169090 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d7a5c5a-7db8-4e26-a025-79b83e6b3c53 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.173725 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] Attempting to bind port d2b1d986-b470-480d-bf5b-52ae11af0b62 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:33:34.174217 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] Attempting to bind port d2b1d986-b470-480d-bf5b-52ae11af0b62 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:33:34.175517 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] Attempting to bind port d2b1d986-b470-480d-bf5b-52ae11af0b62 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:33:34.182197 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6c67c03e-c28b-41d7-8fd1-aeb602fcb254 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:33:34.193815 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-5d7a5c5a-7db8-4e26-a025-79b83e6b3c53 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8e0cfbe6-9002-42c6-8e79-8d95b404c162']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:34.200814 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 33, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:33:34.201441 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:33:34.201821 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.202274 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:33:34.203711 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] Bound port: d2b1d986-b470-480d-bf5b-52ae11af0b62, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:33:34.204254 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.204378 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-5d7a5c5a-7db8-4e26-a025-79b83e6b3c53 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'aefee495-6d7c-460f-b4a3-a320048af8d9') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:34.204638 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-5d7a5c5a-7db8-4e26-a025-79b83e6b3c53 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'aefee495-6d7c-460f-b4a3-a320048af8d9') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:34.214702 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d7a5c5a-7db8-4e26-a025-79b83e6b3c53 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.228518 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d7a5c5a-7db8-4e26-a025-79b83e6b3c53 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.234775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5d7a5c5a-7db8-4e26-a025-79b83e6b3c53 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Releasing vlan 101 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:33:34.235204 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d7a5c5a-7db8-4e26-a025-79b83e6b3c53 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.244941 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d09c6420-b09d-42ee-8421-4f09bff046d7 None None] DHCP port deletion for 1b5db94a-f2e5-4ee6-b165-fbd41044188e request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:33:34.252371 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e362334f-77d9-4232-bc3a-b8e2e851e53c None None] Pushing event updated for resources: {'Port': ['ID=d2b1d986-b470-480d-bf5b-52ae11af0b62,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:34.288360 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] For port d2b1d986-b470-480d-bf5b-52ae11af0b62, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:33:34.292517 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] For port d2b1d986-b470-480d-bf5b-52ae11af0b62, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d2b1d986-b470-480d-bf5b-52ae11af0b62,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:33:34.303713 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.314921 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-b58559f2-4efa-4abf-ab7c-bf0386be39e7 admin admin] For port 42a44357-1e1d-43a3-801a-87d822b70284, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=42a44357-1e1d-43a3-801a-87d822b70284,segment=NetworkSegment(0c438a9d-68a6-4675-b498-b86f6eed54d4),segment_id=0c438a9d-68a6-4675-b498-b86f6eed54d4)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:34.315671 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b58559f2-4efa-4abf-ab7c-bf0386be39e7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.320688 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-0fb71510-a6ff-4cf4-a7a1-f045b42bdb7e None None] Provisioning complete for port d2b1d986-b470-480d-bf5b-52ae11af0b62 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:34.321184 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0fb71510-a6ff-4cf4-a7a1-f045b42bdb7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.347041 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8d2b325-8270-4dec-aad3-25832d577310 req-93db0885-4e7a-4419-806d-6aac0505562e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:33:34.350457 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:33:34.356095 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a8d2b325-8270-4dec-aad3-25832d577310 req-93db0885-4e7a-4419-806d-6aac0505562e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 945 time: 0.2966478 Dec 09 21:33:34.358132 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d7a5c5a-7db8-4e26-a025-79b83e6b3c53 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.374815 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d7a5c5a-7db8-4e26-a025-79b83e6b3c53 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.382891 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5d7a5c5a-7db8-4e26-a025-79b83e6b3c53 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/networks/8e0cfbe6-9002-42c6-8e79-8d95b404c162 HTTP/1.1" status: 204 len: 168 time: 0.8230858 Dec 09 21:33:34.388947 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-90439d81-4576-4e4f-a59f-3fc48a74c452 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:32Z', 'revision_number': 9, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:06Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'aebca6d3-dcf2-40d7-897d-d683ffd7a3c5', 'name': '', 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:dd:5f:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:07Z', 'updated_at': '2021-12-09T21:33:12Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:34.391859 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48808) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:34.394650 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d0c78e42-84ff-48a5-9d85-e4de246e4495 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:33:34.403641 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e362334f-77d9-4232-bc3a-b8e2e851e53c None None] Pushing event updated for resources: {'Port': ['ID=d2b1d986-b470-480d-bf5b-52ae11af0b62,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:34.406853 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] Routers {'a2c7f18d-2988-4425-bc10-4b68903df665'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:34.407132 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a2c7f18d-2988-4425-bc10-4b68903df665'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:34.408095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-b58559f2-4efa-4abf-ab7c-bf0386be39e7 admin admin] Calling delete_port for 42a44357-1e1d-43a3-801a-87d822b70284 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:33:34.432339 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d09c6420-b09d-42ee-8421-4f09bff046d7 None None] Deleting port 42a44357-1e1d-43a3-801a-87d822b70284 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:34.432786 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d09c6420-b09d-42ee-8421-4f09bff046d7 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.437724 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90439d81-4576-4e4f-a59f-3fc48a74c452 None None] The sync data for ids ['6c885eb2-40c3-4066-83da-e64e5ab2723e'] in n-d-713301-27 is: [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:32Z', 'revision_number': 9, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:06Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'aebca6d3-dcf2-40d7-897d-d683ffd7a3c5', 'name': '', 'network_id': 'eeb87237-a90d-4250-8d44-cff75a6e4c02', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:dd:5f:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1680, 'fixed_ips': [{'subnet_id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'ip_address': '2001:db8:1::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:07Z', 'updated_at': '2021-12-09T21:33:12Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a', 'cidr': '2001:db8:1::/64', 'gateway_ip': '2001:db8:1::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:33:34.484691 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d7a5c5a-7db8-4e26-a025-79b83e6b3c53 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Network': ['ID=8e0cfbe6-9002-42c6-8e79-8d95b404c162,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:34.518649 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-a32946ae-d860-4371-98c7-65aa94da11b4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Allocated IP 172.25.3.52 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/05dce107-b6d3-46b3-a925-e6b9511d26e9) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:33:34.556107 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-d09c6420-b09d-42ee-8421-4f09bff046d7 None None] For port 42a44357-1e1d-43a3-801a-87d822b70284, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=42a44357-1e1d-43a3-801a-87d822b70284,segment=NetworkSegment(0c438a9d-68a6-4675-b498-b86f6eed54d4),segment_id=0c438a9d-68a6-4675-b498-b86f6eed54d4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:34.556945 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d09c6420-b09d-42ee-8421-4f09bff046d7 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.567010 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a8d2b325-8270-4dec-aad3-25832d577310 req-cda11e24-97bf-4105-ba46-3b9d06857225 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2031324 Dec 09 21:33:34.607872 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d09c6420-b09d-42ee-8421-4f09bff046d7 None None] Calling delete_port for 42a44357-1e1d-43a3-801a-87d822b70284 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:33:34.614330 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] Set router a2c7f18d-2988-4425-bc10-4b68903df665 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:34.617335 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0fb71510-a6ff-4cf4-a7a1-f045b42bdb7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.656722 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0fb71510-a6ff-4cf4-a7a1-f045b42bdb7e None None] For port d2b1d986-b470-480d-bf5b-52ae11af0b62, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d2b1d986-b470-480d-bf5b-52ae11af0b62,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:34.698826 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0fb71510-a6ff-4cf4-a7a1-f045b42bdb7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.726892 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b58559f2-4efa-4abf-ab7c-bf0386be39e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.779293 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b58559f2-4efa-4abf-ab7c-bf0386be39e7 admin admin] Pushing event deleted for resources: {'Port': ['ID=42a44357-1e1d-43a3-801a-87d822b70284,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:34.784329 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a32946ae-d860-4371-98c7-65aa94da11b4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.785235 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fb71510-a6ff-4cf4-a7a1-f045b42bdb7e None None] Pushing event updated for resources: {'Port': ['ID=d2b1d986-b470-480d-bf5b-52ae11af0b62,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:34.793712 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b58559f2-4efa-4abf-ab7c-bf0386be39e7 admin admin] No DVR routers for this DVR port 42a44357-1e1d-43a3-801a-87d822b70284 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:33:34.834953 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d09c6420-b09d-42ee-8421-4f09bff046d7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.868188 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d09c6420-b09d-42ee-8421-4f09bff046d7 None None] No DVR routers for this DVR port 42a44357-1e1d-43a3-801a-87d822b70284 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:33:34.928054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d09c6420-b09d-42ee-8421-4f09bff046d7 None None] Pushing event deleted for resources: {'Port': ['ID=42a44357-1e1d-43a3-801a-87d822b70284,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:34.947377 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-879fe695-0515-4d25-afda-f2f01da37115 None None] Provisioning complete for port d2b1d986-b470-480d-bf5b-52ae11af0b62 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:34.947992 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-879fe695-0515-4d25-afda-f2f01da37115 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:34.986365 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a2c7f18d-2988-4425-bc10-4b68903df665', 'name': 'tempest-snat-router-1453739307', 'tenant_id': '355561057aae464295eb0ce91a41002c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.207'}], 'enable_snat': False}, 'gw_port_id': 'd2b1d986-b470-480d-bf5b-52ae11af0b62', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:33:30Z', 'updated_at': '2021-12-09T21:33:31Z', 'revision_number': 3, 'project_id': '355561057aae464295eb0ce91a41002c', 'gw_port': {'id': 'd2b1d986-b470-480d-bf5b-52ae11af0b62', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:51:50:6a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a2c7f18d-2988-4425-bc10-4b68903df665', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1707, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:30Z', 'updated_at': '2021-12-09T21:33:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:35.026444 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1ce4f68-d323-465f-ae8a-1bf4a48d4a58 None None] The sync data for ids ['a2c7f18d-2988-4425-bc10-4b68903df665'] in n-d-713301-27 is: [{'id': 'a2c7f18d-2988-4425-bc10-4b68903df665', 'name': 'tempest-snat-router-1453739307', 'tenant_id': '355561057aae464295eb0ce91a41002c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.207'}], 'enable_snat': False}, 'gw_port_id': 'd2b1d986-b470-480d-bf5b-52ae11af0b62', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:33:30Z', 'updated_at': '2021-12-09T21:33:31Z', 'revision_number': 3, 'project_id': '355561057aae464295eb0ce91a41002c', 'gw_port': {'id': 'd2b1d986-b470-480d-bf5b-52ae11af0b62', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:51:50:6a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a2c7f18d-2988-4425-bc10-4b68903df665', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1707, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:30Z', 'updated_at': '2021-12-09T21:33:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:33:35.036131 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b58559f2-4efa-4abf-ab7c-bf0386be39e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:35.042053 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0ad7194e-6200-4cf5-b0c2-133e5dae7320 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:35.070033 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-b58559f2-4efa-4abf-ab7c-bf0386be39e7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1b5db94a-f2e5-4ee6-b165-fbd41044188e']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:35.087457 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c108bc78-5c5f-4c2c-b184-6f0361525fad req-1761f956-7349-4f17-9250-0f019d572b77 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:35.089842 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 287d2e38-af6c-4fbc-b196-bebf54c65697 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:33:35.095878 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c108bc78-5c5f-4c2c-b184-6f0361525fad req-1761f956-7349-4f17-9250-0f019d572b77 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 945 time: 0.1416996 Dec 09 21:33:35.102956 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a32946ae-d860-4371-98c7-65aa94da11b4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:35.113165 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-b58559f2-4efa-4abf-ab7c-bf0386be39e7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0c438a9d-68a6-4675-b498-b86f6eed54d4') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:35.113493 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-b58559f2-4efa-4abf-ab7c-bf0386be39e7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0c438a9d-68a6-4675-b498-b86f6eed54d4') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:35.126014 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 287d2e38-af6c-4fbc-b196-bebf54c65697 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:33:35.126464 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 287d2e38-af6c-4fbc-b196-bebf54c65697 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:33:35.160779 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b58559f2-4efa-4abf-ab7c-bf0386be39e7 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:35.194803 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a32946ae-d860-4371-98c7-65aa94da11b4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:33:35.206309 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b58559f2-4efa-4abf-ab7c-bf0386be39e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:35.214883 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-a32946ae-d860-4371-98c7-65aa94da11b4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:35.222866 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a32946ae-d860-4371-98c7-65aa94da11b4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:33:35.233538 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03130572-ae53-400b-aae8-82a6bcafd140 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:33:35.242218 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c108bc78-5c5f-4c2c-b184-6f0361525fad req-8f64d349-0b33-4ec0-bd0c-691944fbcff7 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1416643 Dec 09 21:33:35.262694 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b58559f2-4efa-4abf-ab7c-bf0386be39e7 admin admin] Releasing vlan 137 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:33:35.263074 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b58559f2-4efa-4abf-ab7c-bf0386be39e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:33:35.265424 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:33:35.267948 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a32946ae-d860-4371-98c7-65aa94da11b4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Pushing event updated for resources: {'Port': ['ID=05dce107-b6d3-46b3-a925-e6b9511d26e9,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:35.379500 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d8500188-61ed-4a60-ad0a-9a5ced74171a None None] Provisioning complete for port 05dce107-b6d3-46b3-a925-e6b9511d26e9 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:35.379874 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d8500188-61ed-4a60-ad0a-9a5ced74171a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:35.412918 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-0ad7194e-6200-4cf5-b0c2-133e5dae7320 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting port aebca6d3-dcf2-40d7-897d-d683ffd7a3c5 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:35.413860 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0ad7194e-6200-4cf5-b0c2-133e5dae7320 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:35.454132 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b58559f2-4efa-4abf-ab7c-bf0386be39e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:35.479740 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b58559f2-4efa-4abf-ab7c-bf0386be39e7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:35.484049 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b58559f2-4efa-4abf-ab7c-bf0386be39e7 admin admin] 10.222.0.13 "DELETE /v2.0/networks/1b5db94a-f2e5-4ee6-b165-fbd41044188e HTTP/1.1" status: 204 len: 168 time: 1.7180130 Dec 09 21:33:35.497169 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b58559f2-4efa-4abf-ab7c-bf0386be39e7 admin admin] Pushing event deleted for resources: {'Network': ['ID=1b5db94a-f2e5-4ee6-b165-fbd41044188e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:35.571603 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-0ad7194e-6200-4cf5-b0c2-133e5dae7320 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] For port aebca6d3-dcf2-40d7-897d-d683ffd7a3c5, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=aebca6d3-dcf2-40d7-897d-d683ffd7a3c5,segment=NetworkSegment(db8dcd7d-243b-46e6-86d4-46d2f3f0dc00),segment_id=db8dcd7d-243b-46e6-86d4-46d2f3f0dc00)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:35.571992 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0ad7194e-6200-4cf5-b0c2-133e5dae7320 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:35.597170 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-0ad7194e-6200-4cf5-b0c2-133e5dae7320 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Calling delete_port for aebca6d3-dcf2-40d7-897d-d683ffd7a3c5 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:33:35.712123 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 42a44357-1e1d-43a3-801a-87d822b70284 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:33:35.812413 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 42a44357-1e1d-43a3-801a-87d822b70284 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:33:35.813112 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 42a44357-1e1d-43a3-801a-87d822b70284 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:33:35.813709 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 64c16765-599f-4fe9-a043-c428c204b3c2 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:33:35.840026 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a32946ae-d860-4371-98c7-65aa94da11b4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:35.849361 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0ad7194e-6200-4cf5-b0c2-133e5dae7320 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:35.868126 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 64c16765-599f-4fe9-a043-c428c204b3c2 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:33:35.868646 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 64c16765-599f-4fe9-a043-c428c204b3c2 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:33:35.869097 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6d011808-2a44-4e33-ba9f-38ccde498262 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:33:35.884147 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d8500188-61ed-4a60-ad0a-9a5ced74171a None None] Port 05dce107-b6d3-46b3-a925-e6b9511d26e9 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:33:35.898684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48826) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:35.914329 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-85ca0dfd-d4c6-4a1c-bc23-183b8dcf7934 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:35.923481 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 6d011808-2a44-4e33-ba9f-38ccde498262 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:33:35.923847 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6d011808-2a44-4e33-ba9f-38ccde498262 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:33:35.927252 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ad7194e-6200-4cf5-b0c2-133e5dae7320 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Port': ['ID=aebca6d3-dcf2-40d7-897d-d683ffd7a3c5,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:36.286952 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-41aafc94-1e00-4826-a1b0-efb45689eee0 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=6c358c3d1eb04dce9614ffbe3851e040&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3816957 Dec 09 21:33:36.289727 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48830) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:36.373829 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0ad7194e-6200-4cf5-b0c2-133e5dae7320 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:36.465103 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eb26874d-65dd-4665-9593-386d7896a0c6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:36.475894 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2f5af02-c4a8-4ef4-8685-e5a94187d9ca req-2aae9806-557f-4948-9053-95c8b6369f9e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:36.477392 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c2f5af02-c4a8-4ef4-8685-e5a94187d9ca req-2aae9806-557f-4948-9053-95c8b6369f9e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 945 time: 0.1190598 Dec 09 21:33:36.513944 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a32946ae-d860-4371-98c7-65aa94da11b4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:36.517013 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eb26874d-65dd-4665-9593-386d7896a0c6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:36.565162 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0ad7194e-6200-4cf5-b0c2-133e5dae7320 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Router 6c885eb2-40c3-4066-83da-e64e5ab2723e has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:33:36.596214 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:36.622696 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c2f5af02-c4a8-4ef4-8685-e5a94187d9ca req-9b444f60-5f82-4583-9772-5cede890029a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1299515 Dec 09 21:33:36.668685 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0ad7194e-6200-4cf5-b0c2-133e5dae7320 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:33:36.676505 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0ad7194e-6200-4cf5-b0c2-133e5dae7320 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/routers/6c885eb2-40c3-4066-83da-e64e5ab2723e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2745242 Dec 09 21:33:36.677020 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48834) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:36.678907 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d41e8766-690f-4575-a45b-5fd478ea5fe1 None None] Sync routers for ids ['6c885eb2-40c3-4066-83da-e64e5ab2723e'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:33:36.680563 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eb26874d-65dd-4665-9593-386d7896a0c6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:36.683256 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eb26874d-65dd-4665-9593-386d7896a0c6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:36.684755 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-eb26874d-65dd-4665-9593-386d7896a0c6 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/1b4daa16-ee9d-40f9-a306-60415764edf0 HTTP/1.1" status: 204 len: 168 time: 0.3933337 Dec 09 21:33:36.698263 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d41e8766-690f-4575-a45b-5fd478ea5fe1 None None] Routers {'6c885eb2-40c3-4066-83da-e64e5ab2723e'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:36.699460 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-d41e8766-690f-4575-a45b-5fd478ea5fe1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6c885eb2-40c3-4066-83da-e64e5ab2723e'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:36.705859 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb26874d-65dd-4665-9593-386d7896a0c6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b4daa16-ee9d-40f9-a306-60415764edf0,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:36.741452 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-0cb29ba1-a102-4a14-b01b-b602a4c0b7e8 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting subnet 267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:33:36.744931 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0cb29ba1-a102-4a14-b01b-b602a4c0b7e8 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:36.751571 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a32946ae-d860-4371-98c7-65aa94da11b4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Router f37c5d07-7f70-4df7-add0-c90a28da7e81 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:33:36.800757 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0cb29ba1-a102-4a14-b01b-b602a4c0b7e8 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:36.895891 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-d41e8766-690f-4575-a45b-5fd478ea5fe1 None None] Set router 6c885eb2-40c3-4066-83da-e64e5ab2723e gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:36.975284 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0cb29ba1-a102-4a14-b01b-b602a4c0b7e8 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:36.982853 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a32946ae-d860-4371-98c7-65aa94da11b4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:33:36.993115 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Sync routers for ids ['f37c5d07-7f70-4df7-add0-c90a28da7e81'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:33:37.009750 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Routers {'f37c5d07-7f70-4df7-add0-c90a28da7e81'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:37.011250 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f37c5d07-7f70-4df7-add0-c90a28da7e81'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:37.019737 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a32946ae-d860-4371-98c7-65aa94da11b4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:37.024198 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48844) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:37.029242 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a32946ae-d860-4371-98c7-65aa94da11b4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 906 time: 3.6946232 Dec 09 21:33:37.146462 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Set router f37c5d07-7f70-4df7-add0-c90a28da7e81 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:37.176087 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0cb29ba1-a102-4a14-b01b-b602a4c0b7e8 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:37.223258 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-d41e8766-690f-4575-a45b-5fd478ea5fe1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:35Z', 'revision_number': 10, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:06Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:37.223639 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0cb29ba1-a102-4a14-b01b-b602a4c0b7e8 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:37.227173 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0cb29ba1-a102-4a14-b01b-b602a4c0b7e8 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/subnets/267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a HTTP/1.1" status: 204 len: 168 time: 0.5491083 Dec 09 21:33:37.230015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48852) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:37.231593 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cb29ba1-a102-4a14-b01b-b602a4c0b7e8 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Subnet': ['ID=267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:37.246807 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9bb79e56-0058-45c4-ad67-d6782c6dcd04 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "GET /v2.0/routers/f37c5d07-7f70-4df7-add0-c90a28da7e81 HTTP/1.1" status: 200 len: 907 time: 0.2180462 Dec 09 21:33:37.251892 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48854) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:37.298840 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15bf13de-a68a-4282-a734-dc82bf3f6d40 None None] Network eeb87237-a90d-4250-8d44-cff75a6e4c02 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:33:37.302184 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d41e8766-690f-4575-a45b-5fd478ea5fe1 None None] Checking router: 6c885eb2-40c3-4066-83da-e64e5ab2723e for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:33:37.399067 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-987d8e24-a41f-44d6-9a91-e5134e257acc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:37.449600 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cb50021b-57fd-41ac-8a6c-b0e10c819aa4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:37.454366 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d41e8766-690f-4575-a45b-5fd478ea5fe1 None None] Routers {'6c885eb2-40c3-4066-83da-e64e5ab2723e'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:37.455010 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-d41e8766-690f-4575-a45b-5fd478ea5fe1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6c885eb2-40c3-4066-83da-e64e5ab2723e'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:37.502495 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-987d8e24-a41f-44d6-9a91-e5134e257acc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting port 907f64eb-7cc4-4808-939c-0e59e7c61dba {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:37.503700 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-987d8e24-a41f-44d6-9a91-e5134e257acc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:37.620581 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-987d8e24-a41f-44d6-9a91-e5134e257acc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] For port 907f64eb-7cc4-4808-939c-0e59e7c61dba, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=907f64eb-7cc4-4808-939c-0e59e7c61dba,segment=NetworkSegment(db8dcd7d-243b-46e6-86d4-46d2f3f0dc00),segment_id=db8dcd7d-243b-46e6-86d4-46d2f3f0dc00)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:37.621187 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-987d8e24-a41f-44d6-9a91-e5134e257acc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:37.622666 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f37c5d07-7f70-4df7-add0-c90a28da7e81', 'name': 'tempest-snat-router-1453739307', 'tenant_id': '355561057aae464295eb0ce91a41002c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.52'}], 'enable_snat': True}, 'gw_port_id': '05dce107-b6d3-46b3-a925-e6b9511d26e9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:33:33Z', 'updated_at': '2021-12-09T21:33:35Z', 'revision_number': 3, 'project_id': '355561057aae464295eb0ce91a41002c', 'gw_port': {'id': '05dce107-b6d3-46b3-a925-e6b9511d26e9', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:b2:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f37c5d07-7f70-4df7-add0-c90a28da7e81', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1709, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:33:34Z', 'updated_at': '2021-12-09T21:33:34Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:37.637792 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-987d8e24-a41f-44d6-9a91-e5134e257acc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Calling delete_port for 907f64eb-7cc4-4808-939c-0e59e7c61dba owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:33:37.652659 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Checking router: f37c5d07-7f70-4df7-add0-c90a28da7e81 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:33:37.653359 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Updating router f37c5d07-7f70-4df7-add0-c90a28da7e81 port 05dce107-b6d3-46b3-a925-e6b9511d26e9 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:33:37.659033 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d2b1d986-b470-480d-bf5b-52ae11af0b62 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:33:37.665162 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cb50021b-57fd-41ac-8a6c-b0e10c819aa4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:37.694587 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:37.767022 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-d41e8766-690f-4575-a45b-5fd478ea5fe1 None None] Set router 6c885eb2-40c3-4066-83da-e64e5ab2723e gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:37.787037 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-cb50021b-57fd-41ac-8a6c-b0e10c819aa4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Deleting port 05dce107-b6d3-46b3-a925-e6b9511d26e9 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:37.787385 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cb50021b-57fd-41ac-8a6c-b0e10c819aa4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:37.892769 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18b2fc44-fa35-487c-8ccb-a1da8bafbadd None None] DHCP port deletion for eeb87237-a90d-4250-8d44-cff75a6e4c02 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:33:37.912620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48870) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:37.916648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port d2b1d986-b470-480d-bf5b-52ae11af0b62 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:37.917013 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:37.956884 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bb115fe-847a-4f50-aef8-75c22c3ce5ab req-63b6e81a-eee9-42a8-9a45-4aa8662ef34a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:37.958718 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4bb115fe-847a-4f50-aef8-75c22c3ce5ab req-63b6e81a-eee9-42a8-9a45-4aa8662ef34a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 945 time: 0.2006500 Dec 09 21:33:37.960511 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-987d8e24-a41f-44d6-9a91-e5134e257acc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:37.990126 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-987d8e24-a41f-44d6-9a91-e5134e257acc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Port': ['ID=907f64eb-7cc4-4808-939c-0e59e7c61dba,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:38.007635 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-987d8e24-a41f-44d6-9a91-e5134e257acc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] No DVR routers for this DVR port 907f64eb-7cc4-4808-939c-0e59e7c61dba on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:33:38.067293 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cb50021b-57fd-41ac-8a6c-b0e10c819aa4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.094126 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4bb115fe-847a-4f50-aef8-75c22c3ce5ab req-24c4f50a-93db-4ab1-a410-ce617e826cd4 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1054552 Dec 09 21:33:38.107207 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-cb50021b-57fd-41ac-8a6c-b0e10c819aa4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Calling delete_port for 05dce107-b6d3-46b3-a925-e6b9511d26e9 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:33:38.118647 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.128473 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.144387 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-987d8e24-a41f-44d6-9a91-e5134e257acc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.168558 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-1f3663ee-bf8c-43cb-b2c1-419fe7fb88b0 admin admin] Request body: {'network': {'name': 'tempest-ServersNegativeTestJSON-24121319-network', 'tenant_id': 'b65669b5d4924ee090e9583aa839a399'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:38.189347 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Attempting to bind port 05dce107-b6d3-46b3-a925-e6b9511d26e9 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:33:38.189925 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Attempting to bind port 05dce107-b6d3-46b3-a925-e6b9511d26e9 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:33:38.190491 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Attempting to bind port 05dce107-b6d3-46b3-a925-e6b9511d26e9 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:33:38.191714 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.203278 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c2f47f7-b777-43f3-a55a-ec626ec97cba None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:33:38.204580 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1f3663ee-bf8c-43cb-b2c1-419fe7fb88b0 admin admin] Made reservation on behalf of b65669b5d4924ee090e9583aa839a399 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:33:38.207684 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f3663ee-bf8c-43cb-b2c1-419fe7fb88b0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.208694 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 33, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:33:38.209251 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:33:38.209904 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.210387 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:33:38.211056 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Bound port: 05dce107-b6d3-46b3-a925-e6b9511d26e9, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:33:38.212322 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.217096 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-987d8e24-a41f-44d6-9a91-e5134e257acc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['eeb87237-a90d-4250-8d44-cff75a6e4c02']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:38.245159 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f3663ee-bf8c-43cb-b2c1-419fe7fb88b0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.257246 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-987d8e24-a41f-44d6-9a91-e5134e257acc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'db8dcd7d-243b-46e6-86d4-46d2f3f0dc00') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:38.257536 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-987d8e24-a41f-44d6-9a91-e5134e257acc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'db8dcd7d-243b-46e6-86d4-46d2f3f0dc00') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:38.275325 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-18b2fc44-fa35-487c-8ccb-a1da8bafbadd None None] Deleting port 907f64eb-7cc4-4808-939c-0e59e7c61dba {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:38.275744 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-18b2fc44-fa35-487c-8ccb-a1da8bafbadd None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.276223 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-987d8e24-a41f-44d6-9a91-e5134e257acc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.279781 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] For port 05dce107-b6d3-46b3-a925-e6b9511d26e9, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:33:38.290004 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e06e7a5-6bbe-4489-a7bf-52b7b8356450 None None] Pushing event updated for resources: {'Port': ['ID=05dce107-b6d3-46b3-a925-e6b9511d26e9,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:38.303848 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-987d8e24-a41f-44d6-9a91-e5134e257acc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.308889 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.db.api [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Dec 09 21:33:38.308889 n-d-713301-27 neutron-server[103440]: [SQL: INSERT INTO ml2_port_binding_levels (port_id, host, level, driver, segment_id) VALUES (%(port_id)s, %(host)s, %(level)s, %(driver)s, %(segment_id)s)] Dec 09 21:33:38.308889 n-d-713301-27 neutron-server[103440]: [parameters: {'port_id': '05dce107-b6d3-46b3-a925-e6b9511d26e9', 'host': 'n-d-713301-27', 'level': 0, 'driver': 'openvswitch', 'segment_id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19'}] Dec 09 21:33:38.308889 n-d-713301-27 neutron-server[103440]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=103440) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:33:38.309714 n-d-713301-27 neutron-server[103440]: DEBUG oslo_db.api [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin._bind_port_if_needed {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:33:38.316423 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-987d8e24-a41f-44d6-9a91-e5134e257acc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Releasing vlan 143 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:33:38.316836 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-987d8e24-a41f-44d6-9a91-e5134e257acc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:33:38.320374 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:33:38.354947 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cb50021b-57fd-41ac-8a6c-b0e10c819aa4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.381243 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb50021b-57fd-41ac-8a6c-b0e10c819aa4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Pushing event deleted for resources: {'Port': ['ID=05dce107-b6d3-46b3-a925-e6b9511d26e9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:38.402693 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0099656f-f9d9-4306-88f8-7a082979f3a7 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:33:38.415093 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-18b2fc44-fa35-487c-8ccb-a1da8bafbadd None None] For port 907f64eb-7cc4-4808-939c-0e59e7c61dba, host n-d-713301-27, got binding levels [] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:38.415631 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-18b2fc44-fa35-487c-8ccb-a1da8bafbadd None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.418101 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-987d8e24-a41f-44d6-9a91-e5134e257acc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.418434 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a6d5a6e0-5a07-478b-87bc-5eadacaedc63 None None] Provisioning complete for port 05dce107-b6d3-46b3-a925-e6b9511d26e9 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:38.418434 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a6d5a6e0-5a07-478b-87bc-5eadacaedc63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.424040 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-987d8e24-a41f-44d6-9a91-e5134e257acc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.430210 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-987d8e24-a41f-44d6-9a91-e5134e257acc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/networks/eeb87237-a90d-4250-8d44-cff75a6e4c02 HTTP/1.1" status: 204 len: 168 time: 1.1966043 Dec 09 21:33:38.430718 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48880) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:38.449420 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-987d8e24-a41f-44d6-9a91-e5134e257acc tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Network': ['ID=eeb87237-a90d-4250-8d44-cff75a6e4c02,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:38.463709 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a6d5a6e0-5a07-478b-87bc-5eadacaedc63 None None] Port 05dce107-b6d3-46b3-a925-e6b9511d26e9 was deleted so its status cannot be updated. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:335}} Dec 09 21:33:38.466813 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-18b2fc44-fa35-487c-8ccb-a1da8bafbadd None None] Calling delete_port for 907f64eb-7cc4-4808-939c-0e59e7c61dba owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:33:38.469610 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.ipam_backend_mixin [None req-18b2fc44-fa35-487c-8ccb-a1da8bafbadd None None] Port 907f64eb-7cc4-4808-939c-0e59e7c61dba was not found and therefore no delete operation was performed {{(pid=103439) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 09 21:33:38.471325 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f3663ee-bf8c-43cb-b2c1-419fe7fb88b0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.472633 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-18b2fc44-fa35-487c-8ccb-a1da8bafbadd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.477258 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f3663ee-bf8c-43cb-b2c1-419fe7fb88b0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.484563 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-d41e8766-690f-4575-a45b-5fd478ea5fe1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:35Z', 'revision_number': 10, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:06Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:38.505404 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-18b2fc44-fa35-487c-8ccb-a1da8bafbadd None None] Network eeb87237-a90d-4250-8d44-cff75a6e4c02 is not hosted by any dhcp agent {{(pid=103439) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 09 21:33:38.505693 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1f3663ee-bf8c-43cb-b2c1-419fe7fb88b0 admin admin] vlan segment allocate from pool success with {'vlan_id': 107, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:33:38.506197 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18b2fc44-fa35-487c-8ccb-a1da8bafbadd None None] No DVR routers for this DVR port 907f64eb-7cc4-4808-939c-0e59e7c61dba on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:33:38.516381 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f3663ee-bf8c-43cb-b2c1-419fe7fb88b0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9cc9673e-b099-41ab-8794-d9dc3c1a9e23,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:38.524978 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cb50021b-57fd-41ac-8a6c-b0e10c819aa4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.527541 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f3663ee-bf8c-43cb-b2c1-419fe7fb88b0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.527842 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-1f3663ee-bf8c-43cb-b2c1-419fe7fb88b0 admin admin] Added segment dcec1a9e-3140-49cf-a664-3f1f0937898f of type vlan for network 88af5e51-6d1a-432d-8676-517f449774a3 Dec 09 21:33:38.538418 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18b2fc44-fa35-487c-8ccb-a1da8bafbadd None None] Pushing event deleted for resources: {'Port': ['ID=907f64eb-7cc4-4808-939c-0e59e7c61dba,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:38.541582 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d41e8766-690f-4575-a45b-5fd478ea5fe1 None None] The sync data for ids ['6c885eb2-40c3-4066-83da-e64e5ab2723e'] in n-d-713301-27 is: [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:35Z', 'revision_number': 10, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None, '_interfaces': [{'id': '273536ab-ff56-4654-99d5-8fcf6bc80df2', 'name': '', 'network_id': '15534a3e-17df-4709-b8b9-bb36601767d2', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'mac_address': 'fa:16:3e:f7:0f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'device_owner': 'network:router_interface', 'standard_attr_id': 1671, 'fixed_ips': [{'subnet_id': '338e8b5b-b539-4af6-8f24-440432e46946', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:32:59Z', 'updated_at': '2021-12-09T21:33:06Z', 'revision_number': 5, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'subnets': [{'id': '338e8b5b-b539-4af6-8f24-440432e46946', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:33:38.586844 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f3663ee-bf8c-43cb-b2c1-419fe7fb88b0 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.611782 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f3663ee-bf8c-43cb-b2c1-419fe7fb88b0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.612774 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f3663ee-bf8c-43cb-b2c1-419fe7fb88b0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:38.613355 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f3663ee-bf8c-43cb-b2c1-419fe7fb88b0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.629860 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cb50021b-57fd-41ac-8a6c-b0e10c819aa4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.634048 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cb50021b-57fd-41ac-8a6c-b0e10c819aa4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.654670 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1f3663ee-bf8c-43cb-b2c1-419fe7fb88b0 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.7299166 Dec 09 21:33:38.654953 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48882) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:38.682246 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f3663ee-bf8c-43cb-b2c1-419fe7fb88b0 admin admin] Pushing event updated for resources: {'Network': ['ID=88af5e51-6d1a-432d-8676-517f449774a3,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:38.683493 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-44e07726-7f95-4c82-963a-3c92a13dc5dc admin admin] Request body: {'subnet': {'network_id': '88af5e51-6d1a-432d-8676-517f449774a3', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersNegativeTestJSON-24121319-subnet', 'tenant_id': 'b65669b5d4924ee090e9583aa839a399', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:38.693686 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 88af5e51-6d1a-432d-8676-517f449774a3 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:33:38.754656 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cb50021b-57fd-41ac-8a6c-b0e10c819aa4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.754656 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cb50021b-57fd-41ac-8a6c-b0e10c819aa4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Fanout notify agent at l3_agent the message router_deleted on router f37c5d07-7f70-4df7-add0-c90a28da7e81 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:33:38.762597 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cb50021b-57fd-41ac-8a6c-b0e10c819aa4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.766613 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cb50021b-57fd-41ac-8a6c-b0e10c819aa4 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "DELETE /v2.0/routers/f37c5d07-7f70-4df7-add0-c90a28da7e81 HTTP/1.1" status: 204 len: 168 time: 1.5132871 Dec 09 21:33:38.766802 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48886) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:38.786876 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-44e07726-7f95-4c82-963a-3c92a13dc5dc admin admin] Made reservation on behalf of b65669b5d4924ee090e9583aa839a399 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:33:38.789234 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-44e07726-7f95-4c82-963a-3c92a13dc5dc admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.831921 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Attempting to bind port 05dce107-b6d3-46b3-a925-e6b9511d26e9 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:33:38.833022 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Attempting to bind port 05dce107-b6d3-46b3-a925-e6b9511d26e9 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:33:38.833526 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Attempting to bind port 05dce107-b6d3-46b3-a925-e6b9511d26e9 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:33:38.839615 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 33, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:33:38.840105 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:33:38.840509 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.841536 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:33:38.842042 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Bound port: 05dce107-b6d3-46b3-a925-e6b9511d26e9, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:33:38.842448 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:38.860324 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.plugin [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Port 05dce107-b6d3-46b3-a925-e6b9511d26e9 has been deleted concurrently {{(pid=103440) _commit_port_binding /opt/stack/neutron/neutron/plugins/ml2/plugin.py:665}} Dec 09 21:33:38.869380 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Routers set() bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:38.869746 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Router IDs set() for agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Dec 09 21:33:38.870395 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_agentschedulers_db [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] Agent requested router IDs not scheduled to it. Scheduled: []. Unscheduled: {'f37c5d07-7f70-4df7-add0-c90a28da7e81'}. Agent: Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent'). {{(pid=103440) list_active_sync_routers_on_active_l3_agent /opt/stack/neutron/neutron/db/l3_agentschedulers_db.py:353}} Dec 09 21:33:38.870765 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e0d8971-76b6-4a89-be97-35ba614a18a5 None None] The sync data for ids ['f37c5d07-7f70-4df7-add0-c90a28da7e81'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:33:38.885016 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-759b427d-d179-4d2b-8092-444e1a2dac8b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:39.003400 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-759b427d-d179-4d2b-8092-444e1a2dac8b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:39.061458 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-759b427d-d179-4d2b-8092-444e1a2dac8b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Deleting port d2b1d986-b470-480d-bf5b-52ae11af0b62 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:39.061807 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-759b427d-d179-4d2b-8092-444e1a2dac8b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:39.067088 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-44e07726-7f95-4c82-963a-3c92a13dc5dc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:39.131491 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44e07726-7f95-4c82-963a-3c92a13dc5dc admin admin] Pushing event updated for resources: {'Subnet': ['ID=4700ee88-1952-42ab-9242-d93b9f07f2be,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:39.149992 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-759b427d-d179-4d2b-8092-444e1a2dac8b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] For port d2b1d986-b470-480d-bf5b-52ae11af0b62, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d2b1d986-b470-480d-bf5b-52ae11af0b62,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:39.150598 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-759b427d-d179-4d2b-8092-444e1a2dac8b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:39.155993 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44e07726-7f95-4c82-963a-3c92a13dc5dc admin admin] Checking segment: {'id': 'dcec1a9e-3140-49cf-a664-3f1f0937898f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '88af5e51-6d1a-432d-8676-517f449774a3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:33:39.156364 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44e07726-7f95-4c82-963a-3c92a13dc5dc admin admin] Network hostable DHCP agents. Network: 88af5e51-6d1a-432d-8676-517f449774a3, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:33:39.166235 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d8fda709-f59c-416a-b86e-070769edda0d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:39.182489 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-759b427d-d179-4d2b-8092-444e1a2dac8b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Calling delete_port for d2b1d986-b470-480d-bf5b-52ae11af0b62 owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:33:39.248117 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44e07726-7f95-4c82-963a-3c92a13dc5dc admin admin] Network 88af5e51-6d1a-432d-8676-517f449774a3 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:33:39.262058 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-44e07726-7f95-4c82-963a-3c92a13dc5dc admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 88af5e51-6d1a-432d-8676-517f449774a3) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:39.270084 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44e07726-7f95-4c82-963a-3c92a13dc5dc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:39.270832 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-44e07726-7f95-4c82-963a-3c92a13dc5dc admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:39.272529 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28041774-ad22-49c2-b1c6-b67be60cc42b None None] Network 88af5e51-6d1a-432d-8676-517f449774a3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:33:39.278292 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2acf16f2-1ba3-431f-b772-be9f41aaa85a req-a2806ebd-f060-4ed6-b218-cfff8516a7d5 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:39.280029 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2acf16f2-1ba3-431f-b772-be9f41aaa85a req-a2806ebd-f060-4ed6-b218-cfff8516a7d5 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 945 time: 0.0916712 Dec 09 21:33:39.319898 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-44e07726-7f95-4c82-963a-3c92a13dc5dc admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.6627586 Dec 09 21:33:39.389835 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2acf16f2-1ba3-431f-b772-be9f41aaa85a req-55c312a0-349b-4563-a1b7-1cfddca0db9e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0973184 Dec 09 21:33:39.494051 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-759b427d-d179-4d2b-8092-444e1a2dac8b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:39.496942 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-d8fda709-f59c-416a-b86e-070769edda0d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting port 273536ab-ff56-4654-99d5-8fcf6bc80df2 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:39.497369 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d8fda709-f59c-416a-b86e-070769edda0d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:39.541722 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-759b427d-d179-4d2b-8092-444e1a2dac8b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Pushing event deleted for resources: {'Port': ['ID=d2b1d986-b470-480d-bf5b-52ae11af0b62,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:39.613572 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 907f64eb-7cc4-4808-939c-0e59e7c61dba no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:33:39.615593 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e594079a-8395-40ee-b1a9-048f4c8e8a6f None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:33:39.617335 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-759b427d-d179-4d2b-8092-444e1a2dac8b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:39.636198 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-d8fda709-f59c-416a-b86e-070769edda0d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] For port 273536ab-ff56-4654-99d5-8fcf6bc80df2, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=273536ab-ff56-4654-99d5-8fcf6bc80df2,segment=NetworkSegment(4b275028-ecbe-4b74-8672-2d6a06274136),segment_id=4b275028-ecbe-4b74-8672-2d6a06274136)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:39.636654 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d8fda709-f59c-416a-b86e-070769edda0d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:39.645617 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-999bf254-b113-4a3f-9ccf-24f78183f620 None None] Network 88af5e51-6d1a-432d-8676-517f449774a3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:33:39.655704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-d8fda709-f59c-416a-b86e-070769edda0d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Calling delete_port for 273536ab-ff56-4654-99d5-8fcf6bc80df2 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:33:39.665803 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 907f64eb-7cc4-4808-939c-0e59e7c61dba {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:33:39.666391 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 907f64eb-7cc4-4808-939c-0e59e7c61dba not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:33:39.667005 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device aebca6d3-dcf2-40d7-897d-d683ffd7a3c5 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:33:39.702231 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: aebca6d3-dcf2-40d7-897d-d683ffd7a3c5 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:33:39.703516 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device aebca6d3-dcf2-40d7-897d-d683ffd7a3c5 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:33:39.705257 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:39.724148 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-759b427d-d179-4d2b-8092-444e1a2dac8b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:39.726723 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-759b427d-d179-4d2b-8092-444e1a2dac8b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:39.785806 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-759b427d-d179-4d2b-8092-444e1a2dac8b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:39.786340 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-759b427d-d179-4d2b-8092-444e1a2dac8b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Fanout notify agent at l3_agent the message router_deleted on router a2c7f18d-2988-4425-bc10-4b68903df665 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:33:39.791703 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-759b427d-d179-4d2b-8092-444e1a2dac8b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:39.796685 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-759b427d-d179-4d2b-8092-444e1a2dac8b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "DELETE /v2.0/routers/a2c7f18d-2988-4425-bc10-4b68903df665 HTTP/1.1" status: 204 len: 168 time: 1.0288565 Dec 09 21:33:39.796915 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48906) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:39.851739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-7629e1a6-6230-4e6f-b616-171353e9e1b6 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-627231174', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}, 'admin_state_up': False}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:39.906052 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7629e1a6-6230-4e6f-b616-171353e9e1b6 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:39.907377 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7629e1a6-6230-4e6f-b616-171353e9e1b6 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:39.945334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-12ef8857-85ae-44c4-a69b-81c242306f11 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:39.946736 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-12ef8857-85ae-44c4-a69b-81c242306f11 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/networks?id=88af5e51-6d1a-432d-8676-517f449774a3 HTTP/1.1" status: 200 len: 812 time: 0.1198428 Dec 09 21:33:39.964581 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-6c23fee8-7fb6-4718-b2f0-ac620996ac32 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/quotas/b65669b5d4924ee090e9583aa839a399 HTTP/1.1" status: 200 len: 375 time: 0.0109553 Dec 09 21:33:40.004399 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-2fbd4038-8e3c-42c2-81cf-5e09703f3a9a tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=b65669b5d4924ee090e9583aa839a399&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0319762 Dec 09 21:33:40.006102 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7629e1a6-6230-4e6f-b616-171353e9e1b6 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:40.009622 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d8fda709-f59c-416a-b86e-070769edda0d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:40.073500 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8fda709-f59c-416a-b86e-070769edda0d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Port': ['ID=273536ab-ff56-4654-99d5-8fcf6bc80df2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:40.158727 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c0a3f16f-5301-47e2-841d-8e233d11826e service neutron] 10.222.0.13 "GET /v2.0/networks/88af5e51-6d1a-432d-8676-517f449774a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1443622 Dec 09 21:33:40.248279 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d8fda709-f59c-416a-b86e-070769edda0d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:40.274571 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-031e84f5-a9db-4d5a-bc63-82186be12dc3 service neutron] 10.222.0.13 "GET /v2.0/networks/88af5e51-6d1a-432d-8676-517f449774a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1086226 Dec 09 21:33:40.297943 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7629e1a6-6230-4e6f-b616-171353e9e1b6 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:40.484214 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c8a615f8-eae3-4581-a14f-281913ef75fc req-2a95ffa3-76a5-4d53-8230-ef1ce2b372a1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 210 time: 0.0308268 Dec 09 21:33:40.514824 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d8fda709-f59c-416a-b86e-070769edda0d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Router 6c885eb2-40c3-4066-83da-e64e5ab2723e has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:33:40.568070 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea462c08-a594-4e3d-8c9e-665275dba7d8 req-ff982014-cfb2-4041-b306-12e31d54bf11 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:40.569744 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea462c08-a594-4e3d-8c9e-665275dba7d8 req-ff982014-cfb2-4041-b306-12e31d54bf11 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 945 time: 0.0583062 Dec 09 21:33:40.613913 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d8fda709-f59c-416a-b86e-070769edda0d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:33:40.621984 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d8fda709-f59c-416a-b86e-070769edda0d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/routers/6c885eb2-40c3-4066-83da-e64e5ab2723e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1846004 Dec 09 21:33:40.622453 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48930) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:40.626325 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e3cefaa-ec5f-427e-8c44-2af037dd63b4 None None] Sync routers for ids ['6c885eb2-40c3-4066-83da-e64e5ab2723e'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:33:40.638138 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e3cefaa-ec5f-427e-8c44-2af037dd63b4 None None] Routers {'6c885eb2-40c3-4066-83da-e64e5ab2723e'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:40.639211 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-8e3cefaa-ec5f-427e-8c44-2af037dd63b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6c885eb2-40c3-4066-83da-e64e5ab2723e'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:40.647628 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea462c08-a594-4e3d-8c9e-665275dba7d8 req-da59551c-3e16-418a-9c8d-62742675f66a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0700791 Dec 09 21:33:40.714883 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-4fc64718-5b10-4b57-b871-20cacd11e5ed tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting subnet 338e8b5b-b539-4af6-8f24-440432e46946 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:33:40.719869 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4fc64718-5b10-4b57-b871-20cacd11e5ed tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:40.744205 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-8e3cefaa-ec5f-427e-8c44-2af037dd63b4 None None] Set router 6c885eb2-40c3-4066-83da-e64e5ab2723e gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:40.787913 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4fc64718-5b10-4b57-b871-20cacd11e5ed tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:40.817473 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-8e3cefaa-ec5f-427e-8c44-2af037dd63b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:39Z', 'revision_number': 11, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:40.848644 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e3cefaa-ec5f-427e-8c44-2af037dd63b4 None None] Checking router: 6c885eb2-40c3-4066-83da-e64e5ab2723e for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:33:40.863431 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e3cefaa-ec5f-427e-8c44-2af037dd63b4 None None] Routers {'6c885eb2-40c3-4066-83da-e64e5ab2723e'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:40.864779 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-8e3cefaa-ec5f-427e-8c44-2af037dd63b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6c885eb2-40c3-4066-83da-e64e5ab2723e'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:40.903829 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4fc64718-5b10-4b57-b871-20cacd11e5ed tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:40.958701 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-8e3cefaa-ec5f-427e-8c44-2af037dd63b4 None None] Set router 6c885eb2-40c3-4066-83da-e64e5ab2723e gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:40.998044 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4fc64718-5b10-4b57-b871-20cacd11e5ed tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:41.033272 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fc64718-5b10-4b57-b871-20cacd11e5ed tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Subnet': ['ID=338e8b5b-b539-4af6-8f24-440432e46946,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:41.041582 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4fc64718-5b10-4b57-b871-20cacd11e5ed tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:41.046420 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4fc64718-5b10-4b57-b871-20cacd11e5ed tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/subnets/338e8b5b-b539-4af6-8f24-440432e46946 HTTP/1.1" status: 204 len: 168 time: 0.4115822 Dec 09 21:33:41.047042 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e811577-57ac-4f9d-9cb2-1aaa8950401f None None] Network 15534a3e-17df-4709-b8b9-bb36601767d2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:33:41.049197 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48936) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:41.050774 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-8e3cefaa-ec5f-427e-8c44-2af037dd63b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:39Z', 'revision_number': 11, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:41.058469 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7629e1a6-6230-4e6f-b616-171353e9e1b6 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:41.084284 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7629e1a6-6230-4e6f-b616-171353e9e1b6 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:41.088338 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e3cefaa-ec5f-427e-8c44-2af037dd63b4 None None] The sync data for ids ['6c885eb2-40c3-4066-83da-e64e5ab2723e'] in n-d-713301-27 is: [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:39Z', 'revision_number': 11, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:33:41.147044 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a90dad53-8914-4a2c-aeae-2342988e7193 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:41.230984 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-a90dad53-8914-4a2c-aeae-2342988e7193 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Deleting port 97d80315-bb4a-4dac-ba42-dd827bbb3844 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:41.231397 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a90dad53-8914-4a2c-aeae-2342988e7193 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:41.246659 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-7629e1a6-6230-4e6f-b616-171353e9e1b6 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Allocated IP 172.25.3.46 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/cc349323-57e8-442a-af7c-5a72842f2f9c) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:33:41.307193 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-a90dad53-8914-4a2c-aeae-2342988e7193 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] For port 97d80315-bb4a-4dac-ba42-dd827bbb3844, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=97d80315-bb4a-4dac-ba42-dd827bbb3844,segment=NetworkSegment(4b275028-ecbe-4b74-8672-2d6a06274136),segment_id=4b275028-ecbe-4b74-8672-2d6a06274136)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:41.307419 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a90dad53-8914-4a2c-aeae-2342988e7193 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:41.320369 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-a90dad53-8914-4a2c-aeae-2342988e7193 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Calling delete_port for 97d80315-bb4a-4dac-ba42-dd827bbb3844 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:33:41.368027 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7629e1a6-6230-4e6f-b616-171353e9e1b6 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:41.400777 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a90dad53-8914-4a2c-aeae-2342988e7193 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:41.404996 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7629e1a6-6230-4e6f-b616-171353e9e1b6 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:41.430005 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a90dad53-8914-4a2c-aeae-2342988e7193 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Port': ['ID=97d80315-bb4a-4dac-ba42-dd827bbb3844,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:41.433361 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a90dad53-8914-4a2c-aeae-2342988e7193 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] No DVR routers for this DVR port 97d80315-bb4a-4dac-ba42-dd827bbb3844 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:33:41.444558 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7629e1a6-6230-4e6f-b616-171353e9e1b6 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:33:41.447478 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-7629e1a6-6230-4e6f-b616-171353e9e1b6 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:41.450313 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7629e1a6-6230-4e6f-b616-171353e9e1b6 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:33:41.472917 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3198fb23-bead-4e7b-a1d1-de91c86fcef7 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:33:41.502426 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b700ed2b-9de5-476e-85a4-24477332f858 None None] DHCP port deletion for 15534a3e-17df-4709-b8b9-bb36601767d2 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:33:41.546249 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7629e1a6-6230-4e6f-b616-171353e9e1b6 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Pushing event updated for resources: {'Port': ['ID=cc349323-57e8-442a-af7c-5a72842f2f9c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:41.554078 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a90dad53-8914-4a2c-aeae-2342988e7193 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:41.579396 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4c5b8de7-5768-4044-a117-148ecad29f0b None None] Provisioning complete for port cc349323-57e8-442a-af7c-5a72842f2f9c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:41.580120 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4c5b8de7-5768-4044-a117-148ecad29f0b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:41.591991 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-a90dad53-8914-4a2c-aeae-2342988e7193 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['15534a3e-17df-4709-b8b9-bb36601767d2']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:41.604221 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-a90dad53-8914-4a2c-aeae-2342988e7193 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4b275028-ecbe-4b74-8672-2d6a06274136') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:41.604559 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-a90dad53-8914-4a2c-aeae-2342988e7193 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4b275028-ecbe-4b74-8672-2d6a06274136') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:41.617114 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a90dad53-8914-4a2c-aeae-2342988e7193 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:41.644732 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d2b1d986-b470-480d-bf5b-52ae11af0b62 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:33:41.670007 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: d2b1d986-b470-480d-bf5b-52ae11af0b62 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:33:41.670615 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d2b1d986-b470-480d-bf5b-52ae11af0b62 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:33:41.671184 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 97d80315-bb4a-4dac-ba42-dd827bbb3844 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:33:41.673453 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a90dad53-8914-4a2c-aeae-2342988e7193 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:41.684300 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-87d1f64c-0ba8-48cc-81f1-f1723888d863 req-116b2cc7-66f3-4391-8e84-2ef8aabbf91f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 210 time: 0.0551901 Dec 09 21:33:41.699007 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a90dad53-8914-4a2c-aeae-2342988e7193 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Releasing vlan 138 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:33:41.699007 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a90dad53-8914-4a2c-aeae-2342988e7193 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:33:41.707269 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:33:41.717404 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-4c5b8de7-5768-4044-a117-148ecad29f0b None None] Port cc349323-57e8-442a-af7c-5a72842f2f9c cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:33:41.720432 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 97d80315-bb4a-4dac-ba42-dd827bbb3844 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:33:41.720781 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 97d80315-bb4a-4dac-ba42-dd827bbb3844 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:33:41.721644 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 273536ab-ff56-4654-99d5-8fcf6bc80df2 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:33:41.765741 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 273536ab-ff56-4654-99d5-8fcf6bc80df2 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:33:41.766758 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 273536ab-ff56-4654-99d5-8fcf6bc80df2 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:33:41.907710 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7629e1a6-6230-4e6f-b616-171353e9e1b6 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:42.137324 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7629e1a6-6230-4e6f-b616-171353e9e1b6 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:42.139880 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a90dad53-8914-4a2c-aeae-2342988e7193 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:42.149165 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a90dad53-8914-4a2c-aeae-2342988e7193 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:42.152271 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a90dad53-8914-4a2c-aeae-2342988e7193 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/networks/15534a3e-17df-4709-b8b9-bb36601767d2 HTTP/1.1" status: 204 len: 168 time: 1.1020565 Dec 09 21:33:42.160805 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-47ef74d9-3798-4ae9-858a-18be13934513 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:42.162241 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-47ef74d9-3798-4ae9-858a-18be13934513 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.31 "GET /v2.0/networks?id=88af5e51-6d1a-432d-8676-517f449774a3 HTTP/1.1" status: 200 len: 812 time: 0.4716671 Dec 09 21:33:42.164711 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48948) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:42.169120 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-1cf6f332-2cc2-4151-89fd-1a74f063d95c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'router': {'routes': None}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:42.185887 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-06b91183-e055-4214-8d4a-429b69c3625e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Request body: {'port': {'device_id': 'af704653-9f02-4515-9fb8-0f0869d126b2', 'network_id': '88af5e51-6d1a-432d-8676-517f449774a3', 'admin_state_up': True, 'tenant_id': 'b65669b5d4924ee090e9583aa839a399'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:42.222681 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a90dad53-8914-4a2c-aeae-2342988e7193 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Pushing event deleted for resources: {'Network': ['ID=15534a3e-17df-4709-b8b9-bb36601767d2,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:42.248244 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6f8190e-88a6-4d15-a0ff-a2082275bfee req-95b9a05d-1278-4902-ba8a-5390af3316c7 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:42.249754 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6f8190e-88a6-4d15-a0ff-a2082275bfee req-95b9a05d-1278-4902-ba8a-5390af3316c7 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 945 time: 0.4406080 Dec 09 21:33:42.274466 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7629e1a6-6230-4e6f-b616-171353e9e1b6 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Router f481ade3-fe68-44bd-9335-d2f406796da4 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:33:42.386369 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7629e1a6-6230-4e6f-b616-171353e9e1b6 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:33:42.402500 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-198604da-9b76-4de9-b145-f68456f88c25 None None] Sync routers for ids ['f481ade3-fe68-44bd-9335-d2f406796da4'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:33:42.412957 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7629e1a6-6230-4e6f-b616-171353e9e1b6 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:42.414912 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7629e1a6-6230-4e6f-b616-171353e9e1b6 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 883 time: 2.5671091 Dec 09 21:33:42.417295 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48954) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:42.423204 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-cc7c9722-6d22-4db4-b42b-a5db774a4ce0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'enable_snat': False}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:42.423679 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-198604da-9b76-4de9-b145-f68456f88c25 None None] Routers {'f481ade3-fe68-44bd-9335-d2f406796da4'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:42.426884 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-198604da-9b76-4de9-b145-f68456f88c25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f481ade3-fe68-44bd-9335-d2f406796da4'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:42.452488 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.extraroute_db [None req-1cf6f332-2cc2-4151-89fd-1a74f063d95c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Added routes are [] {{(pid=103438) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Dec 09 21:33:42.452791 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.extraroute_db [None req-1cf6f332-2cc2-4151-89fd-1a74f063d95c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Removed routes are [] {{(pid=103438) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Dec 09 21:33:42.453158 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1cf6f332-2cc2-4151-89fd-1a74f063d95c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:42.469016 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6f8190e-88a6-4d15-a0ff-a2082275bfee req-bd308cc6-8bd0-44cb-934a-2afe452b0f93 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1916847 Dec 09 21:33:42.476173 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-198604da-9b76-4de9-b145-f68456f88c25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:42.486348 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-198604da-9b76-4de9-b145-f68456f88c25 None None] Routers {'f481ade3-fe68-44bd-9335-d2f406796da4'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:42.486881 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-198604da-9b76-4de9-b145-f68456f88c25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f481ade3-fe68-44bd-9335-d2f406796da4'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:42.526343 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-198604da-9b76-4de9-b145-f68456f88c25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:42.527473 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-198604da-9b76-4de9-b145-f68456f88c25 None None] The sync data for ids ['f481ade3-fe68-44bd-9335-d2f406796da4'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:33:42.589529 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-06b91183-e055-4214-8d4a-429b69c3625e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Made reservation on behalf of b65669b5d4924ee090e9583aa839a399 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:33:42.593185 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-06b91183-e055-4214-8d4a-429b69c3625e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:42.634346 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1cf6f332-2cc2-4151-89fd-1a74f063d95c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:42.641572 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1cf6f332-2cc2-4151-89fd-1a74f063d95c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-640457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-640448', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-635166'] for router, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:42.749031 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cc7c9722-6d22-4db4-b42b-a5db774a4ce0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:42.777084 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1cf6f332-2cc2-4151-89fd-1a74f063d95c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Router 6c885eb2-40c3-4066-83da-e64e5ab2723e has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:33:42.811636 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9782d569-7ce8-46ce-9186-88f4170f9344 req-3a236057-dde2-418b-8c99-b1d4d700ea0b tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 210 time: 0.0555525 Dec 09 21:33:42.874846 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-06b91183-e055-4214-8d4a-429b69c3625e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Allocated IP 172.20.0.5 (88af5e51-6d1a-432d-8676-517f449774a3/4700ee88-1952-42ab-9242-d93b9f07f2be/1e54159e-3c83-49a1-a5b5-3e2b29336c43) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:33:42.915333 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1cf6f332-2cc2-4151-89fd-1a74f063d95c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:33:42.923506 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1cf6f332-2cc2-4151-89fd-1a74f063d95c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:42.924828 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1cf6f332-2cc2-4151-89fd-1a74f063d95c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/routers/6c885eb2-40c3-4066-83da-e64e5ab2723e HTTP/1.1" status: 200 len: 705 time: 0.7591345 Dec 09 21:33:42.929764 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48958) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:42.934994 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f66ea031-ffe5-4074-842e-84041fa14a62 None None] Sync routers for ids ['6c885eb2-40c3-4066-83da-e64e5ab2723e'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:33:42.960411 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f66ea031-ffe5-4074-842e-84041fa14a62 None None] Routers {'6c885eb2-40c3-4066-83da-e64e5ab2723e'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:42.960411 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-f66ea031-ffe5-4074-842e-84041fa14a62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6c885eb2-40c3-4066-83da-e64e5ab2723e'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:42.967030 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-249c7afc-de86-412d-8add-492629df0f3c tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/ports?device_id=6c885eb2-40c3-4066-83da-e64e5ab2723e HTTP/1.1" status: 200 len: 205 time: 0.0361557 Dec 09 21:33:42.969417 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48960) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:43.065442 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c6dd14a-fca7-454d-b5b0-f4752f95ae9b tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:43.069564 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-f66ea031-ffe5-4074-842e-84041fa14a62 None None] Set router 6c885eb2-40c3-4066-83da-e64e5ab2723e gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:43.134196 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-f66ea031-ffe5-4074-842e-84041fa14a62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:39Z', 'revision_number': 11, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:43.183769 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f66ea031-ffe5-4074-842e-84041fa14a62 None None] Checking router: 6c885eb2-40c3-4066-83da-e64e5ab2723e for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:33:43.200345 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cc7c9722-6d22-4db4-b42b-a5db774a4ce0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:43.203912 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cc7c9722-6d22-4db4-b42b-a5db774a4ce0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-640457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-640448', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-635166'] for router, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:43.209171 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f66ea031-ffe5-4074-842e-84041fa14a62 None None] Routers {'6c885eb2-40c3-4066-83da-e64e5ab2723e'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:43.209782 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-f66ea031-ffe5-4074-842e-84041fa14a62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6c885eb2-40c3-4066-83da-e64e5ab2723e'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:43.281399 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-f66ea031-ffe5-4074-842e-84041fa14a62 None None] Set router 6c885eb2-40c3-4066-83da-e64e5ab2723e gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:43.284340 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c6dd14a-fca7-454d-b5b0-f4752f95ae9b tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:43.289339 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c6dd14a-fca7-454d-b5b0-f4752f95ae9b tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:43.315234 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cc7c9722-6d22-4db4-b42b-a5db774a4ce0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Router f481ade3-fe68-44bd-9335-d2f406796da4 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:33:43.333818 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-f66ea031-ffe5-4074-842e-84041fa14a62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:39Z', 'revision_number': 11, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:43.366164 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f66ea031-ffe5-4074-842e-84041fa14a62 None None] The sync data for ids ['6c885eb2-40c3-4066-83da-e64e5ab2723e'] in n-d-713301-27 is: [{'id': '6c885eb2-40c3-4066-83da-e64e5ab2723e', 'name': 'tempest-RoutersIpV6Test-router-1679291539', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:32:55Z', 'updated_at': '2021-12-09T21:33:39Z', 'revision_number': 11, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:33:43.442202 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cc7c9722-6d22-4db4-b42b-a5db774a4ce0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:33:43.454715 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44c2d78b-8128-4c01-addd-60f036cb6818 None None] Sync routers for ids ['f481ade3-fe68-44bd-9335-d2f406796da4'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:33:43.456564 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cc7c9722-6d22-4db4-b42b-a5db774a4ce0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:43.459937 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cc7c9722-6d22-4db4-b42b-a5db774a4ce0 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "PUT /v2.0/routers/f481ade3-fe68-44bd-9335-d2f406796da4 HTTP/1.1" status: 200 len: 920 time: 1.0414758 Dec 09 21:33:43.460807 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48966) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:43.470818 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44c2d78b-8128-4c01-addd-60f036cb6818 None None] Routers {'f481ade3-fe68-44bd-9335-d2f406796da4'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:43.472048 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-44c2d78b-8128-4c01-addd-60f036cb6818 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f481ade3-fe68-44bd-9335-d2f406796da4'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:43.514535 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-44c2d78b-8128-4c01-addd-60f036cb6818 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:43.532839 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44c2d78b-8128-4c01-addd-60f036cb6818 None None] Routers {'f481ade3-fe68-44bd-9335-d2f406796da4'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:43.533734 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-44c2d78b-8128-4c01-addd-60f036cb6818 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f481ade3-fe68-44bd-9335-d2f406796da4'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:43.576435 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-44c2d78b-8128-4c01-addd-60f036cb6818 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:43.577867 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44c2d78b-8128-4c01-addd-60f036cb6818 None None] The sync data for ids ['f481ade3-fe68-44bd-9335-d2f406796da4'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:33:43.634129 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-05ebb107-47c4-4df6-861b-da8570d6441c tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "GET /v2.0/routers/f481ade3-fe68-44bd-9335-d2f406796da4 HTTP/1.1" status: 200 len: 920 time: 0.1720273 Dec 09 21:33:43.634545 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-06b91183-e055-4214-8d4a-429b69c3625e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:43.637700 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48972) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:43.685433 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c6dd14a-fca7-454d-b5b0-f4752f95ae9b tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:43.685789 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7c6dd14a-fca7-454d-b5b0-f4752f95ae9b tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Fanout notify agent at l3_agent the message router_deleted on router 6c885eb2-40c3-4066-83da-e64e5ab2723e {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:33:43.711897 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c6dd14a-fca7-454d-b5b0-f4752f95ae9b tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:43.712978 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7c6dd14a-fca7-454d-b5b0-f4752f95ae9b tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/routers/6c885eb2-40c3-4066-83da-e64e5ab2723e HTTP/1.1" status: 204 len: 168 time: 0.7426646 Dec 09 21:33:43.717505 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48974) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:43.723036 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2624d30e-28ba-4d5d-9af6-96a1ced57759 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'router': {'name': 'tempest-RoutersIpV6Test-router-462470649', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:43.751547 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2624d30e-28ba-4d5d-9af6-96a1ced57759 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:43.752997 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2624d30e-28ba-4d5d-9af6-96a1ced57759 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:43.769198 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ac8e2fc-de42-451e-906a-7f2fc2d023e1 req-55bf8123-10fe-4c4d-b889-8dc2a1a855bc tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:43.771497 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0ac8e2fc-de42-451e-906a-7f2fc2d023e1 req-55bf8123-10fe-4c4d-b889-8dc2a1a855bc tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 945 time: 0.1502244 Dec 09 21:33:43.789044 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e1540afb-27a5-4963-9fee-4cccd16672bc tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:43.791506 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e1540afb-27a5-4963-9fee-4cccd16672bc tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "GET /v2.0/ports?network_id=97925a19-460a-4476-8208-41db134b6c83&device_id=f481ade3-fe68-44bd-9335-d2f406796da4&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.1503949 Dec 09 21:33:43.795602 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-06b91183-e055-4214-8d4a-429b69c3625e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:43.795602 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48976) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:43.828214 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2624d30e-28ba-4d5d-9af6-96a1ced57759 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:43.832835 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2624d30e-28ba-4d5d-9af6-96a1ced57759 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:43.852513 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2624d30e-28ba-4d5d-9af6-96a1ced57759 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:43.856510 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2624d30e-28ba-4d5d-9af6-96a1ced57759 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 703 time: 0.1344593 Dec 09 21:33:43.856764 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48980) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:43.861860 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ab17a7a0-64b1-4abc-9fa9-f4ddf005656a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Request body: {'router': {'admin_state_up': True}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:43.885106 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-06b91183-e055-4214-8d4a-429b69c3625e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Network 88af5e51-6d1a-432d-8676-517f449774a3 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:33:43.924728 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-06b91183-e055-4214-8d4a-429b69c3625e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:43.945878 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-06b91183-e055-4214-8d4a-429b69c3625e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:33:43.997066 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0ac8e2fc-de42-451e-906a-7f2fc2d023e1 req-6da0f9f2-d979-4a26-ba39-9d0ce6f5b1ef tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2167594 Dec 09 21:33:43.997772 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06b91183-e055-4214-8d4a-429b69c3625e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Pushing event updated for resources: {'Port': ['ID=1e54159e-3c83-49a1-a5b5-3e2b29336c43,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:44.032583 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1f389e84-110b-4147-86ff-570ed5a98e7a tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:44.033999 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1f389e84-110b-4147-86ff-570ed5a98e7a tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 881 time: 0.2363529 Dec 09 21:33:44.038133 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48982) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:44.076312 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-06b91183-e055-4214-8d4a-429b69c3625e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:44.076842 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-06b91183-e055-4214-8d4a-429b69c3625e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:44.079481 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ab17a7a0-64b1-4abc-9fa9-f4ddf005656a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:44.086388 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42b5c87b-1f81-422a-b523-bb90b0527770 req-3c30b217-8881-4039-a134-622b881724b4 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:44.088007 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42b5c87b-1f81-422a-b523-bb90b0527770 req-3c30b217-8881-4039-a134-622b881724b4 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 931 time: 0.1743054 Dec 09 21:33:44.090058 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4d8d8f7d-8983-46c7-bf60-320907645f82 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "GET /v2.0/ports?device_id=f481ade3-fe68-44bd-9335-d2f406796da4 HTTP/1.1" status: 200 len: 205 time: 0.0502193 Dec 09 21:33:44.093803 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ab17a7a0-64b1-4abc-9fa9-f4ddf005656a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-640457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-640448', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-635166'] for router, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:44.096640 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48984) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:44.116368 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-06b91183-e055-4214-8d4a-429b69c3625e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.9345183 Dec 09 21:33:44.133616 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c18776c8-e0e8-4ecf-90e8-6ca9a22ee569 service neutron] Request body: {'port': {'device_id': 'af704653-9f02-4515-9fb8-0f0869d126b2', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:44.171347 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42b5c87b-1f81-422a-b523-bb90b0527770 req-cc43cc40-b9df-4d84-8e69-5f216d0a2ce2 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0744207 Dec 09 21:33:44.204842 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c18776c8-e0e8-4ecf-90e8-6ca9a22ee569 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:44.283748 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b795917b-12d5-43f5-9bc3-af389ee74f3c tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:44.319272 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ab17a7a0-64b1-4abc-9fa9-f4ddf005656a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Router 894c24f3-21ce-418b-8258-4ec6b4cad20c is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:33:44.529061 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c18776c8-e0e8-4ecf-90e8-6ca9a22ee569 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1e54159e-3c83-49a1-a5b5-3e2b29336c43 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:33:44.537464 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c18776c8-e0e8-4ecf-90e8-6ca9a22ee569 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:44.555850 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c18776c8-e0e8-4ecf-90e8-6ca9a22ee569 service neutron] Transition to ACTIVE for port object 1e54159e-3c83-49a1-a5b5-3e2b29336c43 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:33:44.561516 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c18776c8-e0e8-4ecf-90e8-6ca9a22ee569 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:44.620609 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c18776c8-e0e8-4ecf-90e8-6ca9a22ee569 service neutron] Pushing event updated for resources: {'Port': ['ID=1e54159e-3c83-49a1-a5b5-3e2b29336c43,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:44.694722 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c18776c8-e0e8-4ecf-90e8-6ca9a22ee569 service neutron] Attempting to bind port 1e54159e-3c83-49a1-a5b5-3e2b29336c43 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:33:44.695422 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c18776c8-e0e8-4ecf-90e8-6ca9a22ee569 service neutron] Attempting to bind port 1e54159e-3c83-49a1-a5b5-3e2b29336c43 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'dcec1a9e-3140-49cf-a664-3f1f0937898f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '88af5e51-6d1a-432d-8676-517f449774a3'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:33:44.695422 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c18776c8-e0e8-4ecf-90e8-6ca9a22ee569 service neutron] Attempting to bind port 1e54159e-3c83-49a1-a5b5-3e2b29336c43 on network 88af5e51-6d1a-432d-8676-517f449774a3 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:33:44.700150 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c18776c8-e0e8-4ecf-90e8-6ca9a22ee569 service neutron] Port 1e54159e-3c83-49a1-a5b5-3e2b29336c43 on network 88af5e51-6d1a-432d-8676-517f449774a3 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:33:44.700624 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c18776c8-e0e8-4ecf-90e8-6ca9a22ee569 service neutron] Attempting to bind port 1e54159e-3c83-49a1-a5b5-3e2b29336c43 on network 88af5e51-6d1a-432d-8676-517f449774a3 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:33:44.706277 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c18776c8-e0e8-4ecf-90e8-6ca9a22ee569 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 33, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:33:44.706616 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c18776c8-e0e8-4ecf-90e8-6ca9a22ee569 service neutron] Checking segment: {'id': 'dcec1a9e-3140-49cf-a664-3f1f0937898f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '88af5e51-6d1a-432d-8676-517f449774a3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:33:44.706998 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c18776c8-e0e8-4ecf-90e8-6ca9a22ee569 service neutron] Bound using segment: {'id': 'dcec1a9e-3140-49cf-a664-3f1f0937898f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '88af5e51-6d1a-432d-8676-517f449774a3'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:33:44.707450 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c18776c8-e0e8-4ecf-90e8-6ca9a22ee569 service neutron] Bound port: 1e54159e-3c83-49a1-a5b5-3e2b29336c43, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dcec1a9e-3140-49cf-a664-3f1f0937898f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '88af5e51-6d1a-432d-8676-517f449774a3'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:33:44.707821 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c18776c8-e0e8-4ecf-90e8-6ca9a22ee569 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:44.754598 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ab17a7a0-64b1-4abc-9fa9-f4ddf005656a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:33:44.762162 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ab17a7a0-64b1-4abc-9fa9-f4ddf005656a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:44.763458 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ab17a7a0-64b1-4abc-9fa9-f4ddf005656a tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "PUT /v2.0/routers/894c24f3-21ce-418b-8258-4ec6b4cad20c HTTP/1.1" status: 200 len: 697 time: 0.9053376 Dec 09 21:33:44.765217 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5c34939-7eec-435d-a413-40fb3e24e286 None None] Sync routers for ids ['894c24f3-21ce-418b-8258-4ec6b4cad20c'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:33:44.766297 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48994) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:44.777628 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5c34939-7eec-435d-a413-40fb3e24e286 None None] Routers {'894c24f3-21ce-418b-8258-4ec6b4cad20c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:44.778557 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a5c34939-7eec-435d-a413-40fb3e24e286 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['894c24f3-21ce-418b-8258-4ec6b4cad20c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:44.781619 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b795917b-12d5-43f5-9bc3-af389ee74f3c tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:44.833970 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c18776c8-e0e8-4ecf-90e8-6ca9a22ee569 service neutron] For port 1e54159e-3c83-49a1-a5b5-3e2b29336c43, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:33:44.850043 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-a5c34939-7eec-435d-a413-40fb3e24e286 None None] Set router 894c24f3-21ce-418b-8258-4ec6b4cad20c gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:44.856513 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-b795917b-12d5-43f5-9bc3-af389ee74f3c tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Deleting port cc349323-57e8-442a-af7c-5a72842f2f9c {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:44.856860 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b795917b-12d5-43f5-9bc3-af389ee74f3c tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:44.884902 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c18776c8-e0e8-4ecf-90e8-6ca9a22ee569 service neutron] For port 1e54159e-3c83-49a1-a5b5-3e2b29336c43, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1e54159e-3c83-49a1-a5b5-3e2b29336c43,segment=NetworkSegment(dcec1a9e-3140-49cf-a664-3f1f0937898f),segment_id=dcec1a9e-3140-49cf-a664-3f1f0937898f)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:33:44.896065 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cc58fee5-ac0f-4d6e-a0df-d5a183f6a846 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/routers/894c24f3-21ce-418b-8258-4ec6b4cad20c HTTP/1.1" status: 200 len: 703 time: 0.1259301 Dec 09 21:33:44.896312 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48996) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:44.906499 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c18776c8-e0e8-4ecf-90e8-6ca9a22ee569 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:44.941910 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b795917b-12d5-43f5-9bc3-af389ee74f3c tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:44.948103 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-dbc98b9a-53bc-462a-85f0-205d0461b06d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/ports?device_id=894c24f3-21ce-418b-8258-4ec6b4cad20c HTTP/1.1" status: 200 len: 205 time: 0.0485611 Dec 09 21:33:44.949986 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48998) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:44.957169 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-b795917b-12d5-43f5-9bc3-af389ee74f3c tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Calling delete_port for cc349323-57e8-442a-af7c-5a72842f2f9c owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:33:45.002115 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c18776c8-e0e8-4ecf-90e8-6ca9a22ee569 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:45.002882 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c18776c8-e0e8-4ecf-90e8-6ca9a22ee569 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:45.004356 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c18776c8-e0e8-4ecf-90e8-6ca9a22ee569 service neutron] 10.222.0.31 "PUT /v2.0/ports/1e54159e-3c83-49a1-a5b5-3e2b29336c43 HTTP/1.1" status: 200 len: 1092 time: 0.8755336 Dec 09 21:33:45.047603 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'af704653-9f02-4515-9fb8-0f0869d126b2', 'tag': '1e54159e-3c83-49a1-a5b5-3e2b29336c43'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:33:45.057931 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-359f4bad-59a5-4d67-b73a-797efbabf4d9" -d '{"events": [{"name": "network-changed", "server_uuid": "af704653-9f02-4515-9fb8-0f0869d126b2", "tag": "1e54159e-3c83-49a1-a5b5-3e2b29336c43"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:33:45.081559 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a5c34939-7eec-435d-a413-40fb3e24e286 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '894c24f3-21ce-418b-8258-4ec6b4cad20c', 'name': 'tempest-RoutersIpV6Test-router-462470649', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:33:43Z', 'updated_at': '2021-12-09T21:33:44Z', 'revision_number': 2, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:45.102808 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-349e65b1-6564-4642-91e4-39479e57de86 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:45.131008 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5c34939-7eec-435d-a413-40fb3e24e286 None None] Checking router: 894c24f3-21ce-418b-8258-4ec6b4cad20c for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:33:45.139705 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5c34939-7eec-435d-a413-40fb3e24e286 None None] Routers {'894c24f3-21ce-418b-8258-4ec6b4cad20c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:45.140334 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a5c34939-7eec-435d-a413-40fb3e24e286 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['894c24f3-21ce-418b-8258-4ec6b4cad20c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:45.146043 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:33:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dbc5e1ee-a153-421f-8a79-d24c191b77a9 x-openstack-request-id: req-dbc5e1ee-a153-421f-8a79-d24c191b77a9 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:33:45.146331 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "af704653-9f02-4515-9fb8-0f0869d126b2", "tag": "1e54159e-3c83-49a1-a5b5-3e2b29336c43", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:33:45.146584 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-dbc5e1ee-a153-421f-8a79-d24c191b77a9 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:33:45.147377 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'af704653-9f02-4515-9fb8-0f0869d126b2', 'tag': '1e54159e-3c83-49a1-a5b5-3e2b29336c43', 'status': 'completed', 'code': 200} Dec 09 21:33:45.149949 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c18776c8-e0e8-4ecf-90e8-6ca9a22ee569 service neutron] Pushing event updated for resources: {'Port': ['ID=1e54159e-3c83-49a1-a5b5-3e2b29336c43,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:45.159265 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b795917b-12d5-43f5-9bc3-af389ee74f3c tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:45.191616 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b795917b-12d5-43f5-9bc3-af389ee74f3c tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Pushing event deleted for resources: {'Port': ['ID=cc349323-57e8-442a-af7c-5a72842f2f9c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:45.226138 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-98069ce4-bbd4-467c-9230-37e5228c6960 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:33:45.236136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-a5c34939-7eec-435d-a413-40fb3e24e286 None None] Set router 894c24f3-21ce-418b-8258-4ec6b4cad20c gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:33:45.278381 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-742aae77-a88c-43b0-83ba-6455abafe212 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:45.279944 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-742aae77-a88c-43b0-83ba-6455abafe212 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=b65669b5d4924ee090e9583aa839a399&device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 1095 time: 0.2171869 Dec 09 21:33:45.298155 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a5c34939-7eec-435d-a413-40fb3e24e286 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '894c24f3-21ce-418b-8258-4ec6b4cad20c', 'name': 'tempest-RoutersIpV6Test-router-462470649', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:33:43Z', 'updated_at': '2021-12-09T21:33:44Z', 'revision_number': 2, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:45.301799 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b795917b-12d5-43f5-9bc3-af389ee74f3c tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:45.328763 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5c34939-7eec-435d-a413-40fb3e24e286 None None] The sync data for ids ['894c24f3-21ce-418b-8258-4ec6b4cad20c'] in n-d-713301-27 is: [{'id': '894c24f3-21ce-418b-8258-4ec6b4cad20c', 'name': 'tempest-RoutersIpV6Test-router-462470649', 'tenant_id': 'dc5c46f00552473abc0991c0cc4a0269', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:33:43Z', 'updated_at': '2021-12-09T21:33:44Z', 'revision_number': 2, 'project_id': 'dc5c46f00552473abc0991c0cc4a0269', 'gw_port_host': None}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:33:45.350038 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-349e65b1-6564-4642-91e4-39479e57de86 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:45.378643 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-349e65b1-6564-4642-91e4-39479e57de86 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:45.388440 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bb20414-de56-4319-87b2-62dbbdaa9712 req-1d72c9e8-88b2-4fac-bfa9-21e8fbb18125 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:45.390044 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0bb20414-de56-4319-87b2-62dbbdaa9712 req-1d72c9e8-88b2-4fac-bfa9-21e8fbb18125 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 945 time: 0.2410979 Dec 09 21:33:45.394583 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-a4b93403-a8d4-4e25-b671-20c84fa77bca service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=1e54159e-3c83-49a1-a5b5-3e2b29336c43 HTTP/1.1" status: 200 len: 217 time: 0.0985031 Dec 09 21:33:45.404492 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b795917b-12d5-43f5-9bc3-af389ee74f3c tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:45.406863 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b795917b-12d5-43f5-9bc3-af389ee74f3c tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:45.455270 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b795917b-12d5-43f5-9bc3-af389ee74f3c tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:45.456220 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b795917b-12d5-43f5-9bc3-af389ee74f3c tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Fanout notify agent at l3_agent the message router_deleted on router f481ade3-fe68-44bd-9335-d2f406796da4 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:33:45.464437 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b795917b-12d5-43f5-9bc3-af389ee74f3c tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:45.469251 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b795917b-12d5-43f5-9bc3-af389ee74f3c tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "DELETE /v2.0/routers/f481ade3-fe68-44bd-9335-d2f406796da4 HTTP/1.1" status: 204 len: 168 time: 1.3680203 Dec 09 21:33:45.469605 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49008) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:45.474421 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-f24a2615-7ebd-4768-b374-a8bd2c21152c tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1096893049', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:45.485590 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-349e65b1-6564-4642-91e4-39479e57de86 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:45.486127 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-349e65b1-6564-4642-91e4-39479e57de86 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Fanout notify agent at l3_agent the message router_deleted on router 894c24f3-21ce-418b-8258-4ec6b4cad20c {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:33:45.501575 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-349e65b1-6564-4642-91e4-39479e57de86 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:45.502132 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f24a2615-7ebd-4768-b374-a8bd2c21152c tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:45.502677 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-349e65b1-6564-4642-91e4-39479e57de86 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/routers/894c24f3-21ce-418b-8258-4ec6b4cad20c HTTP/1.1" status: 204 len: 168 time: 0.5516169 Dec 09 21:33:45.503214 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f24a2615-7ebd-4768-b374-a8bd2c21152c tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:45.509704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49010) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:45.518487 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c50ba94b-9955-4f65-84c3-6648119409f8 req-92971bc8-7c54-4e46-9db8-ac82f1b0782c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:45.520093 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c50ba94b-9955-4f65-84c3-6648119409f8 req-92971bc8-7c54-4e46-9db8-ac82f1b0782c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 943 time: 0.2382698 Dec 09 21:33:45.544560 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b9a97928-32ce-460c-bd72-d93353386e1f tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/ports?device_id=894c24f3-21ce-418b-8258-4ec6b4cad20c HTTP/1.1" status: 200 len: 205 time: 0.0322518 Dec 09 21:33:45.547448 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49012) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:45.551657 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c6ead999-a9fe-484e-965e-ffbdf919bc2d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:45.553051 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-c6ead999-a9fe-484e-965e-ffbdf919bc2d service neutron] 10.222.0.31 "GET /v2.0/subnets?id=4700ee88-1952-42ab-9242-d93b9f07f2be HTTP/1.1" status: 200 len: 852 time: 0.1097269 Dec 09 21:33:45.563600 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0bb20414-de56-4319-87b2-62dbbdaa9712 req-27abdc17-7b13-4d3c-8447-66a88324a330 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1655858 Dec 09 21:33:45.606764 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-61222157-bc5b-412e-a10f-113617e668e6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] delete failed (client error): The resource could not be found. Dec 09 21:33:45.608122 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-61222157-bc5b-412e-a10f-113617e668e6 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/routers/894c24f3-21ce-418b-8258-4ec6b4cad20c HTTP/1.1" status: 404 len: 336 time: 0.0595689 Dec 09 21:33:45.611693 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49016) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:45.619687 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-b9380b88-6c9b-433a-9d23-4de3cec0e69f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=88af5e51-6d1a-432d-8676-517f449774a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0457532 Dec 09 21:33:45.641576 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-58f209bd-4b3d-416f-a37a-2ea080d8e165 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] DELETE failed (client error): The resource could not be found. Dec 09 21:33:45.642138 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-58f209bd-4b3d-416f-a37a-2ea080d8e165 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:33:45.645344 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-58f209bd-4b3d-416f-a37a-2ea080d8e165 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/subnets/21435ea9-4cdd-441f-bce0-c107eec29d73 HTTP/1.1" status: 404 len: 337 time: 0.0329342 Dec 09 21:33:45.658102 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c50ba94b-9955-4f65-84c3-6648119409f8 req-e7a68152-cae3-4d34-8b0e-bba56016abac tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1234574 Dec 09 21:33:45.661477 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49018) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:45.685802 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f24a2615-7ebd-4768-b374-a8bd2c21152c tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:45.692033 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f24a2615-7ebd-4768-b374-a8bd2c21152c tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:45.710582 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-3b066c96-00c1-47d1-a0df-b2c4d4d9235d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] DELETE failed (client error): The resource could not be found. Dec 09 21:33:45.711662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3b066c96-00c1-47d1-a0df-b2c4d4d9235d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:33:45.714841 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3b066c96-00c1-47d1-a0df-b2c4d4d9235d tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/subnets/f6a9f8ec-203e-476b-a436-3472ba061489 HTTP/1.1" status: 404 len: 337 time: 0.0532248 Dec 09 21:33:45.716324 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f24a2615-7ebd-4768-b374-a8bd2c21152c tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:45.718739 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49022) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:45.719313 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f24a2615-7ebd-4768-b374-a8bd2c21152c tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 0.2483480 Dec 09 21:33:45.721721 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49024) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:45.726699 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-8a98c81e-895b-431f-85a4-87d3a8fc80b7 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Request body: {'router': {'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:45.948259 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a98c81e-895b-431f-85a4-87d3a8fc80b7 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:46.018161 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-2a317efc-8466-437a-9a64-76f87850a443 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] DELETE failed (client error): The resource could not be found. Dec 09 21:33:46.018955 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2a317efc-8466-437a-9a64-76f87850a443 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:33:46.022081 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2a317efc-8466-437a-9a64-76f87850a443 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/subnets/267fdb8c-06c0-4e8e-8f6b-3eaa18b5c75a HTTP/1.1" status: 404 len: 337 time: 0.3023856 Dec 09 21:33:46.025898 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49026) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:46.057616 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-436826e7-ace3-434f-b730-2d0e4325f466 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] DELETE failed (client error): The resource could not be found. Dec 09 21:33:46.058080 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-436826e7-ace3-434f-b730-2d0e4325f466 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:33:46.061172 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-436826e7-ace3-434f-b730-2d0e4325f466 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/subnets/338e8b5b-b539-4af6-8f24-440432e46946 HTTP/1.1" status: 404 len: 337 time: 0.0343771 Dec 09 21:33:46.064096 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49028) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:46.101133 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8f18948e-d500-45d8-9a96-cfcabd94abc0 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/ports?device_id=6c885eb2-40c3-4066-83da-e64e5ab2723e HTTP/1.1" status: 200 len: 205 time: 0.0359237 Dec 09 21:33:46.103367 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49030) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:46.112491 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-ba9529fe-6243-49ae-af53-18c846cec9ce service neutron] 10.222.0.31 "GET /v2.0/networks/88af5e51-6d1a-432d-8676-517f449774a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4817910 Dec 09 21:33:46.149239 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-dac93c50-7987-4c0a-9aa2-010a59ac18e0 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] delete failed (client error): The resource could not be found. Dec 09 21:33:46.152949 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-dac93c50-7987-4c0a-9aa2-010a59ac18e0 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/routers/6c885eb2-40c3-4066-83da-e64e5ab2723e HTTP/1.1" status: 404 len: 336 time: 0.0459576 Dec 09 21:33:46.157822 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49032) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:46.163738 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a98c81e-895b-431f-85a4-87d3a8fc80b7 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:46.182567 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a98c81e-895b-431f-85a4-87d3a8fc80b7 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:46.195162 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7db55ffb-5a30-45fa-9de5-0a327961fe55 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/ports?device_id=81d37c97-8ea4-495a-b02c-d39fe13cbfac HTTP/1.1" status: 200 len: 205 time: 0.0362422 Dec 09 21:33:46.202011 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49034) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:46.270356 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-697306e4-9794-4b23-b164-a8f416f10940 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] delete failed (client error): The resource could not be found. Dec 09 21:33:46.274701 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-697306e4-9794-4b23-b164-a8f416f10940 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/routers/81d37c97-8ea4-495a-b02c-d39fe13cbfac HTTP/1.1" status: 404 len: 336 time: 0.0686245 Dec 09 21:33:46.277699 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49036) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:46.307118 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d7e38b21-d7b2-49ca-896e-d40a9d07deaf req-77593bd7-3127-4a46-a1eb-063b792ea465 service neutron] 10.222.0.31 "GET /v2.0/networks/88af5e51-6d1a-432d-8676-517f449774a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1601994 Dec 09 21:33:46.310529 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-d7eb0ca5-bdca-4bce-9850-887db854dac7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] DELETE failed (client error): The resource could not be found. Dec 09 21:33:46.311043 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d7eb0ca5-bdca-4bce-9850-887db854dac7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:33:46.316067 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d7eb0ca5-bdca-4bce-9850-887db854dac7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/subnets/0d2e42cf-65ac-4db2-9f05-42a136a28fa0 HTTP/1.1" status: 404 len: 337 time: 0.0370686 Dec 09 21:33:46.318538 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49038) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:46.333230 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-8a98c81e-895b-431f-85a4-87d3a8fc80b7 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Allocated IP 172.25.3.80 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/02644b89-bf6e-4e0f-8df2-ef58640bf79e) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:33:46.351694 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cdb9cb65-9a1c-4e86-8b06-e6595c723598 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/ports?device_id=89842949-8384-4cb2-b3b9-a7b02f88760c HTTP/1.1" status: 200 len: 205 time: 0.0317621 Dec 09 21:33:46.360792 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49040) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:46.423009 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-29405d06-6ea2-4ed3-84be-157b6dc15938 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] delete failed (client error): The resource could not be found. Dec 09 21:33:46.426316 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-29405d06-6ea2-4ed3-84be-157b6dc15938 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/routers/89842949-8384-4cb2-b3b9-a7b02f88760c HTTP/1.1" status: 404 len: 336 time: 0.0618980 Dec 09 21:33:46.426882 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49042) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:46.453582 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-359f4bad-59a5-4d67-b73a-797efbabf4d9 req-e2a2fd22-36cb-4f01-a68b-983d539746e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:46.455088 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-359f4bad-59a5-4d67-b73a-797efbabf4d9 req-e2a2fd22-36cb-4f01-a68b-983d539746e4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=b65669b5d4924ee090e9583aa839a399&device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 1095 time: 0.0839875 Dec 09 21:33:46.462262 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-703e50d3-2b84-4cc4-b244-b63a9f32e7d8 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/ports?device_id=dd81e963-d253-47c9-86cc-d86b4560bd0d HTTP/1.1" status: 200 len: 205 time: 0.0341794 Dec 09 21:33:46.465420 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49044) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:46.511518 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a98c81e-895b-431f-85a4-87d3a8fc80b7 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:46.514007 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-80e6adc5-799a-4950-a62d-70ba1bf6e173 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] delete failed (client error): The resource could not be found. Dec 09 21:33:46.515062 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-80e6adc5-799a-4950-a62d-70ba1bf6e173 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/routers/dd81e963-d253-47c9-86cc-d86b4560bd0d HTTP/1.1" status: 404 len: 336 time: 0.0486882 Dec 09 21:33:46.517754 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49046) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:46.549922 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a98c81e-895b-431f-85a4-87d3a8fc80b7 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:46.554190 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-835d7fce-dc8b-4a72-932f-b40bf24e2704 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] DELETE failed (client error): The resource could not be found. Dec 09 21:33:46.554647 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-835d7fce-dc8b-4a72-932f-b40bf24e2704 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:33:46.557707 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-835d7fce-dc8b-4a72-932f-b40bf24e2704 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/subnets/bcc3d9aa-1583-4f90-9c6b-e836366e8f18 HTTP/1.1" status: 404 len: 337 time: 0.0390024 Dec 09 21:33:46.561679 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49048) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:46.594129 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a98c81e-895b-431f-85a4-87d3a8fc80b7 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:33:46.595950 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a37cfc3b-8fb8-4135-8553-c261e1b512d7 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/ports?device_id=d7a9b61a-129d-43c7-a080-cba02508a91b HTTP/1.1" status: 200 len: 205 time: 0.0332778 Dec 09 21:33:46.598510 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49052) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:46.600218 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-8a98c81e-895b-431f-85a4-87d3a8fc80b7 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:46.607113 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a98c81e-895b-431f-85a4-87d3a8fc80b7 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:33:46.618573 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-41de572a-4e90-4744-b17f-72254254a086 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:33:46.639873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a98c81e-895b-431f-85a4-87d3a8fc80b7 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Pushing event updated for resources: {'Port': ['ID=02644b89-bf6e-4e0f-8df2-ef58640bf79e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:46.651421 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-359f4bad-59a5-4d67-b73a-797efbabf4d9 req-dc929016-6b8c-45f7-9fc8-c2f55cc30075 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:46.653345 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-359f4bad-59a5-4d67-b73a-797efbabf4d9 req-dc929016-6b8c-45f7-9fc8-c2f55cc30075 service neutron] 10.222.0.31 "GET /v2.0/networks?id=88af5e51-6d1a-432d-8676-517f449774a3 HTTP/1.1" status: 200 len: 913 time: 0.1897333 Dec 09 21:33:46.657877 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-3357bb56-e4a4-450c-a927-b2ddf3202bc9 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] delete failed (client error): The resource could not be found. Dec 09 21:33:46.658989 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3357bb56-e4a4-450c-a927-b2ddf3202bc9 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/routers/d7a9b61a-129d-43c7-a080-cba02508a91b HTTP/1.1" status: 404 len: 336 time: 0.0595965 Dec 09 21:33:46.668909 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49054) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:46.676350 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d287e7b0-773b-437c-b912-6d43cff5b4fd None None] Provisioning complete for port 02644b89-bf6e-4e0f-8df2-ef58640bf79e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:46.676949 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d287e7b0-773b-437c-b912-6d43cff5b4fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:46.727706 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d287e7b0-773b-437c-b912-6d43cff5b4fd None None] Port 02644b89-bf6e-4e0f-8df2-ef58640bf79e cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:33:46.756867 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-359f4bad-59a5-4d67-b73a-797efbabf4d9 req-8a8aabc9-ada3-42d5-a2c9-27d5694bc223 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=1e54159e-3c83-49a1-a5b5-3e2b29336c43 HTTP/1.1" status: 200 len: 217 time: 0.0887127 Dec 09 21:33:46.763548 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-c7ff47ff-c1c0-4f3d-8d22-ddb3b23c6f77 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] DELETE failed (client error): The resource could not be found. Dec 09 21:33:46.764073 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c7ff47ff-c1c0-4f3d-8d22-ddb3b23c6f77 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:33:46.769793 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c7ff47ff-c1c0-4f3d-8d22-ddb3b23c6f77 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/subnets/656050ab-3f89-43f6-9ab6-f893898d871f HTTP/1.1" status: 404 len: 337 time: 0.0975006 Dec 09 21:33:46.775263 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49064) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:46.805486 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-41d4dacf-0c45-426e-93ed-6d305b5a4296 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "GET /v2.0/ports?device_id=e80f7e87-a887-48b5-b17f-6361e5ee661e HTTP/1.1" status: 200 len: 205 time: 0.0290191 Dec 09 21:33:46.807803 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49066) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:46.821186 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a380bfda-0093-4ce5-ae40-0cbbde655f93 req-940cd7ad-b4e5-4528-94df-e8e2b3b90873 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:46.822820 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a380bfda-0093-4ce5-ae40-0cbbde655f93 req-940cd7ad-b4e5-4528-94df-e8e2b3b90873 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 945 time: 0.1685250 Dec 09 21:33:46.855977 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-8fe41742-846f-44b1-9bc5-714541075ca3 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] delete failed (client error): The resource could not be found. Dec 09 21:33:46.859720 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8fe41742-846f-44b1-9bc5-714541075ca3 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/routers/e80f7e87-a887-48b5-b17f-6361e5ee661e HTTP/1.1" status: 404 len: 336 time: 0.0484707 Dec 09 21:33:46.860389 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49068) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:46.874614 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-359f4bad-59a5-4d67-b73a-797efbabf4d9 req-627792e4-e884-4678-84f4-d929234db063 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:46.876218 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-359f4bad-59a5-4d67-b73a-797efbabf4d9 req-627792e4-e884-4678-84f4-d929234db063 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=4700ee88-1952-42ab-9242-d93b9f07f2be HTTP/1.1" status: 200 len: 852 time: 0.1078799 Dec 09 21:33:46.894009 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-73d6b308-ae0c-45f9-96c3-ea6f36df8733 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] DELETE failed (client error): The resource could not be found. Dec 09 21:33:46.894472 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-73d6b308-ae0c-45f9-96c3-ea6f36df8733 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:33:46.900511 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-73d6b308-ae0c-45f9-96c3-ea6f36df8733 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/subnets/c18b8bfe-b2f1-42b1-8850-7d3336d11c03 HTTP/1.1" status: 404 len: 337 time: 0.0368378 Dec 09 21:33:46.902172 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49070) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:46.936122 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cf827f2-df09-457b-a315-3f4b5dafccac req-c09e27e3-4135-455a-a8e3-2ccef9be7147 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:46.937629 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7cf827f2-df09-457b-a315-3f4b5dafccac req-c09e27e3-4135-455a-a8e3-2ccef9be7147 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 943 time: 0.1138031 Dec 09 21:33:46.942327 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-359f4bad-59a5-4d67-b73a-797efbabf4d9 req-27b73f46-6bbd-4b3d-9503-7a18ccf7b751 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=88af5e51-6d1a-432d-8676-517f449774a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0487173 Dec 09 21:33:46.946945 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a380bfda-0093-4ce5-ae40-0cbbde655f93 req-61591e2f-4529-4811-ad51-b2202a4e515f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1128962 Dec 09 21:33:46.957848 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-c07422bb-699d-49de-849b-0ca7da3f6d69 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] DELETE failed (client error): The resource could not be found. Dec 09 21:33:46.958310 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c07422bb-699d-49de-849b-0ca7da3f6d69 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:33:46.961378 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c07422bb-699d-49de-849b-0ca7da3f6d69 tempest-RoutersIpV6Test-1169763270 tempest-RoutersIpV6Test-1169763270-project] 10.222.0.13 "DELETE /v2.0/subnets/e221e85c-451a-4f41-b14a-5bb277809971 HTTP/1.1" status: 404 len: 337 time: 0.0596356 Dec 09 21:33:47.051876 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a98c81e-895b-431f-85a4-87d3a8fc80b7 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:47.065658 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7cf827f2-df09-457b-a315-3f4b5dafccac req-5654f68d-2735-4be6-8626-2e15e5f354ae tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1177111 Dec 09 21:33:47.097725 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-359f4bad-59a5-4d67-b73a-797efbabf4d9 req-d788f183-8762-4de6-9141-fc9d4a3006dd service neutron] 10.222.0.31 "GET /v2.0/networks/88af5e51-6d1a-432d-8676-517f449774a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1430047 Dec 09 21:33:47.200058 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-359f4bad-59a5-4d67-b73a-797efbabf4d9 req-7304e1c4-580f-4af9-a4f9-1d309ed79844 service neutron] 10.222.0.31 "GET /v2.0/networks/88af5e51-6d1a-432d-8676-517f449774a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0906363 Dec 09 21:33:47.222706 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49076) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:47.276870 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a98c81e-895b-431f-85a4-87d3a8fc80b7 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:47.280526 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a98c81e-895b-431f-85a4-87d3a8fc80b7 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-640457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-640448', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-635166'] for router, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:47.363293 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3825a9ac-dc1a-49df-a98a-a925c018b458 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=dc5c46f00552473abc0991c0cc4a0269&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1391582 Dec 09 21:33:47.365886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49080) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:47.412535 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8a98c81e-895b-431f-85a4-87d3a8fc80b7 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Router bacd70e7-15b4-4408-ac76-c0772ac2a7b1 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:33:47.414182 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e146f8e7-7c59-47d1-9757-aa5166dbe9f2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:47.435285 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e146f8e7-7c59-47d1-9757-aa5166dbe9f2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:47.482271 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e146f8e7-7c59-47d1-9757-aa5166dbe9f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:47.485105 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e146f8e7-7c59-47d1-9757-aa5166dbe9f2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:47.486281 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e146f8e7-7c59-47d1-9757-aa5166dbe9f2 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/024f34fc-6cd9-4473-bef8-c81394627de8 HTTP/1.1" status: 204 len: 168 time: 0.1195219 Dec 09 21:33:47.494121 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e146f8e7-7c59-47d1-9757-aa5166dbe9f2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=024f34fc-6cd9-4473-bef8-c81394627de8,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:47.524787 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8a98c81e-895b-431f-85a4-87d3a8fc80b7 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:33:47.531872 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a98c81e-895b-431f-85a4-87d3a8fc80b7 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:47.535375 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8a98c81e-895b-431f-85a4-87d3a8fc80b7 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "PUT /v2.0/routers/bacd70e7-15b4-4408-ac76-c0772ac2a7b1 HTTP/1.1" status: 200 len: 879 time: 1.8101540 Dec 09 21:33:47.535795 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49084) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:47.537280 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44a06db6-0cf1-4ec0-ae84-5fc27b9edfdf None None] Sync routers for ids ['bacd70e7-15b4-4408-ac76-c0772ac2a7b1'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:33:47.549400 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44a06db6-0cf1-4ec0-ae84-5fc27b9edfdf None None] Routers {'bacd70e7-15b4-4408-ac76-c0772ac2a7b1'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:47.550040 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-44a06db6-0cf1-4ec0-ae84-5fc27b9edfdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['bacd70e7-15b4-4408-ac76-c0772ac2a7b1'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:47.588720 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-44a06db6-0cf1-4ec0-ae84-5fc27b9edfdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:47.598815 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44a06db6-0cf1-4ec0-ae84-5fc27b9edfdf None None] Routers {'bacd70e7-15b4-4408-ac76-c0772ac2a7b1'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:47.599462 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-44a06db6-0cf1-4ec0-ae84-5fc27b9edfdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['bacd70e7-15b4-4408-ac76-c0772ac2a7b1'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:47.634534 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-44a06db6-0cf1-4ec0-ae84-5fc27b9edfdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:47.635183 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-44a06db6-0cf1-4ec0-ae84-5fc27b9edfdf None None] The sync data for ids ['bacd70e7-15b4-4408-ac76-c0772ac2a7b1'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:33:47.644911 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-711f8dee-6c2e-4614-8dbe-85463e31033e tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "GET /v2.0/routers/bacd70e7-15b4-4408-ac76-c0772ac2a7b1 HTTP/1.1" status: 200 len: 920 time: 0.1079295 Dec 09 21:33:47.647696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49088) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:47.689282 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9cf40f9d-26cc-4670-90a7-931428e0fac6 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:47.690719 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9cf40f9d-26cc-4670-90a7-931428e0fac6 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "GET /v2.0/ports?network_id=97925a19-460a-4476-8208-41db134b6c83&device_id=bacd70e7-15b4-4408-ac76-c0772ac2a7b1&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.0414588 Dec 09 21:33:47.693422 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49090) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:47.784334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e24dd346-da0c-4af4-841b-2901bf157916 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:47.787522 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e24dd346-da0c-4af4-841b-2901bf157916 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 881 time: 0.0923676 Dec 09 21:33:47.792052 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49098) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:47.823795 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-293dbaa8-21ef-4f22-8b22-744c69c9e12f tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "GET /v2.0/ports?device_id=bacd70e7-15b4-4408-ac76-c0772ac2a7b1 HTTP/1.1" status: 200 len: 205 time: 0.0282016 Dec 09 21:33:47.823994 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49102) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:47.935484 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dbf66c23-805c-420c-8392-635d68f88c00 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:48.074955 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dbf66c23-805c-420c-8392-635d68f88c00 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:48.092520 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe67a05a-bd97-4c92-96ba-ccbf87164b48 req-44507513-91b0-4292-bab5-b6cfa7bb5d99 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:48.094107 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe67a05a-bd97-4c92-96ba-ccbf87164b48 req-44507513-91b0-4292-bab5-b6cfa7bb5d99 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 945 time: 0.0724974 Dec 09 21:33:48.206652 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe67a05a-bd97-4c92-96ba-ccbf87164b48 req-63177031-5c0b-4a7d-bee5-ce8fb7adbf8a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0881364 Dec 09 21:33:48.208028 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49122) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:48.215901 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-dbf66c23-805c-420c-8392-635d68f88c00 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Deleting port 02644b89-bf6e-4e0f-8df2-ef58640bf79e {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:48.215901 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dbf66c23-805c-420c-8392-635d68f88c00 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:48.240124 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9db02058-58e9-400f-8d57-636ffd84de88 req-d38a858f-4dbb-4bea-a9f0-7e16f3dd4977 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:48.241926 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9db02058-58e9-400f-8d57-636ffd84de88 req-d38a858f-4dbb-4bea-a9f0-7e16f3dd4977 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 943 time: 0.0918050 Dec 09 21:33:48.318288 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-cda7f314-8b59-4435-91d0-f28c248a8295 tempest-DvrRoutersNegativeTest-1220543360 tempest-DvrRoutersNegativeTest-1220543360-project] Request body: {'router': {'name': 'tempest-DvrRoutersNegativeTest-router-1122299420', 'external_gateway_info': {}, 'admin_state_up': False, 'distributed': True}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:48.321367 n-d-713301-27 neutron-server[103437]: DEBUG neutron.policy [None req-cda7f314-8b59-4435-91d0-f28c248a8295 tempest-DvrRoutersNegativeTest-1220543360 tempest-DvrRoutersNegativeTest-1220543360-project] Enforcing rules: ['create_router', 'create_router:external_gateway_info', 'create_router:distributed'] {{(pid=103437) log_rule_list /opt/stack/neutron/neutron/policy.py:450}} Dec 09 21:33:48.321770 n-d-713301-27 neutron-server[103437]: DEBUG neutron.policy [None req-cda7f314-8b59-4435-91d0-f28c248a8295 tempest-DvrRoutersNegativeTest-1220543360 tempest-DvrRoutersNegativeTest-1220543360-project] Failed policy check for 'create_router' {{(pid=103437) enforce /opt/stack/neutron/neutron/policy.py:524}} Dec 09 21:33:48.322321 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-cda7f314-8b59-4435-91d0-f28c248a8295 tempest-DvrRoutersNegativeTest-1220543360 tempest-DvrRoutersNegativeTest-1220543360-project] create failed (client error): Access was denied to this resource. Dec 09 21:33:48.323260 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cda7f314-8b59-4435-91d0-f28c248a8295 tempest-DvrRoutersNegativeTest-1220543360 tempest-DvrRoutersNegativeTest-1220543360-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 403 len: 414 time: 0.1142085 Dec 09 21:33:48.338947 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9db02058-58e9-400f-8d57-636ffd84de88 req-5994d920-0c5e-477a-930a-d0aad303e117 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0863817 Dec 09 21:33:48.348915 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dbf66c23-805c-420c-8392-635d68f88c00 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:48.362773 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-dbf66c23-805c-420c-8392-635d68f88c00 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Calling delete_port for 02644b89-bf6e-4e0f-8df2-ef58640bf79e owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:33:48.529757 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dbf66c23-805c-420c-8392-635d68f88c00 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:48.556711 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbf66c23-805c-420c-8392-635d68f88c00 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Pushing event deleted for resources: {'Port': ['ID=02644b89-bf6e-4e0f-8df2-ef58640bf79e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:48.569380 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-206ce4b7-a5e8-4959-8266-721656cff19e None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:33:48.574868 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49130) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:48.616235 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dbf66c23-805c-420c-8392-635d68f88c00 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:48.688600 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8efbbd8f-23f5-417b-af9e-63f1fa897344 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:48.705395 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dbf66c23-805c-420c-8392-635d68f88c00 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:48.707799 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dbf66c23-805c-420c-8392-635d68f88c00 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:48.755543 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dbf66c23-805c-420c-8392-635d68f88c00 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:48.756048 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dbf66c23-805c-420c-8392-635d68f88c00 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Fanout notify agent at l3_agent the message router_deleted on router bacd70e7-15b4-4408-ac76-c0772ac2a7b1 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:33:48.763646 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8efbbd8f-23f5-417b-af9e-63f1fa897344 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:48.765591 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dbf66c23-805c-420c-8392-635d68f88c00 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:48.766783 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-dbf66c23-805c-420c-8392-635d68f88c00 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "DELETE /v2.0/routers/bacd70e7-15b4-4408-ac76-c0772ac2a7b1 HTTP/1.1" status: 204 len: 168 time: 0.9418542 Dec 09 21:33:48.768520 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8efbbd8f-23f5-417b-af9e-63f1fa897344 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:48.770664 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49134) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:48.775611 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-9136406a-a8ce-4381-b347-83c47476c356 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1234978835', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:48.798526 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9136406a-a8ce-4381-b347-83c47476c356 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:48.799803 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9136406a-a8ce-4381-b347-83c47476c356 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:48.810062 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8efbbd8f-23f5-417b-af9e-63f1fa897344 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=8efef27fe6924eb892831192512a36d0&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2333868 Dec 09 21:33:48.810943 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8efbbd8f-23f5-417b-af9e-63f1fa897344 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=18123cba-85eb-41e1-aee2-fed071df17e2,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:48.813290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49136) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:48.864288 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d9eb647d-17fa-454d-b3c6-bf0d49f73bed admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:48.868543 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9136406a-a8ce-4381-b347-83c47476c356 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:48.874995 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9136406a-a8ce-4381-b347-83c47476c356 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:48.889052 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d9eb647d-17fa-454d-b3c6-bf0d49f73bed admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:48.895716 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9136406a-a8ce-4381-b347-83c47476c356 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:48.897134 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9136406a-a8ce-4381-b347-83c47476c356 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 0.1254156 Dec 09 21:33:48.902173 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49140) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:48.906109 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-88aed573-685e-4b5d-9ed8-7df1b7085f99 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'enable_snat': True}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:48.940664 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d9eb647d-17fa-454d-b3c6-bf0d49f73bed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:48.943608 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d9eb647d-17fa-454d-b3c6-bf0d49f73bed admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:48.944936 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d9eb647d-17fa-454d-b3c6-bf0d49f73bed admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/18123cba-85eb-41e1-aee2-fed071df17e2 HTTP/1.1" status: 204 len: 168 time: 0.1307316 Dec 09 21:33:48.952761 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9eb647d-17fa-454d-b3c6-bf0d49f73bed admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=18123cba-85eb-41e1-aee2-fed071df17e2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:49.145888 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1e54159e-3c83-49a1-a5b5-3e2b29336c43 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:33:49.277864 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 1e54159e-3c83-49a1-a5b5-3e2b29336c43, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1e54159e-3c83-49a1-a5b5-3e2b29336c43,segment=NetworkSegment(dcec1a9e-3140-49cf-a664-3f1f0937898f),segment_id=dcec1a9e-3140-49cf-a664-3f1f0937898f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:49.296967 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '1e54159e-3c83-49a1-a5b5-3e2b29336c43', 'network_id': '88af5e51-6d1a-432d-8676-517f449774a3', 'port_id': '1e54159e-3c83-49a1-a5b5-3e2b29336c43', 'mac_address': 'fa:16:3e:66:78:8f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 107, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4700ee88-1952-42ab-9242-d93b9f07f2be', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:33:49.355192 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:49.371313 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1e54159e-3c83-49a1-a5b5-3e2b29336c43 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:33:49.374522 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-88aed573-685e-4b5d-9ed8-7df1b7085f99 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:49.395493 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 1e54159e-3c83-49a1-a5b5-3e2b29336c43, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1e54159e-3c83-49a1-a5b5-3e2b29336c43,segment=NetworkSegment(dcec1a9e-3140-49cf-a664-3f1f0937898f),segment_id=dcec1a9e-3140-49cf-a664-3f1f0937898f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:49.401628 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:49.457166 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7848d375-34d2-4331-9cb6-776a87bf4aa0 req-05864fe7-eb33-429e-87cc-053d9efb5278 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:49.458737 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7848d375-34d2-4331-9cb6-776a87bf4aa0 req-05864fe7-eb33-429e-87cc-053d9efb5278 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 945 time: 0.0872157 Dec 09 21:33:49.464083 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=1e54159e-3c83-49a1-a5b5-3e2b29336c43,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:49.473643 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:49.474005 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:49.474363 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:49.474914 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:49.475259 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:49.475611 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:49.475946 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:49.476276 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:49.476599 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:49.476926 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:49.477252 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:49.477758 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:49.478080 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:49.585647 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69ce132f-2575-41eb-ba63-09f6434cfabf req-e2b2761b-33b7-4dbd-90f2-674fcff71f57 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:49.587133 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69ce132f-2575-41eb-ba63-09f6434cfabf req-e2b2761b-33b7-4dbd-90f2-674fcff71f57 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 944 time: 0.1274807 Dec 09 21:33:49.594320 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7848d375-34d2-4331-9cb6-776a87bf4aa0 req-8c7ea997-6f0d-4da3-9e2c-5b27b45f40e6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1221986 Dec 09 21:33:49.670432 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['1e54159e-3c83-49a1-a5b5-3e2b29336c43'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:33:49.697627 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49174) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:49.733798 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69ce132f-2575-41eb-ba63-09f6434cfabf req-901a9193-7184-4821-a979-ce4eb513e920 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1302614 Dec 09 21:33:49.756683 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-88aed573-685e-4b5d-9ed8-7df1b7085f99 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:49.780012 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-88aed573-685e-4b5d-9ed8-7df1b7085f99 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:49.815005 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-441d2bd0-372c-45f7-8ccd-08a4e6f199f9 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group': {'name': 'default'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:49.815005 n-d-713301-27 neutron-server[103437]: WARNING neutron.api.v2.base [None req-441d2bd0-372c-45f7-8ccd-08a4e6f199f9 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Dec 09 21:33:49.815700 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-441d2bd0-372c-45f7-8ccd-08a4e6f199f9 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] create failed (client error): There was a conflict when trying to complete your request. Dec 09 21:33:49.822350 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-441d2bd0-372c-45f7-8ccd-08a4e6f199f9 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 409 len: 330 time: 0.1230834 Dec 09 21:33:49.823247 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49178) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:49.829091 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-5b1fd18f-ebc0-4249-bc51-9898c82c4e71 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group': {'name': 'tempest-secgroup--1669991065'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:49.859009 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b1fd18f-ebc0-4249-bc51-9898c82c4e71 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:49.866970 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b1fd18f-ebc0-4249-bc51-9898c82c4e71 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:49.905509 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-88aed573-685e-4b5d-9ed8-7df1b7085f99 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Allocated IP 172.25.3.133 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/fa697e5d-b044-4b66-afb6-0cb9f66e0f71) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:33:49.950592 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b1fd18f-ebc0-4249-bc51-9898c82c4e71 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:49.954755 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b1fd18f-ebc0-4249-bc51-9898c82c4e71 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:49.997743 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b1fd18f-ebc0-4249-bc51-9898c82c4e71 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8db77c7d-cb1d-4abc-8e30-b36d19876b4c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:50.018010 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-88aed573-685e-4b5d-9ed8-7df1b7085f99 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.033851 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b1fd18f-ebc0-4249-bc51-9898c82c4e71 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.038680 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b1fd18f-ebc0-4249-bc51-9898c82c4e71 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.054274 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-88aed573-685e-4b5d-9ed8-7df1b7085f99 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.068037 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b1fd18f-ebc0-4249-bc51-9898c82c4e71 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.069317 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5b1fd18f-ebc0-4249-bc51-9898c82c4e71 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.2448459 Dec 09 21:33:50.073359 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49182) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:50.078581 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-7ba507ae-c781-486d-9a8d-87bdc6c98918 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group_rule': {'security_group_id': '5e1fa6b9-a7b8-4296-b77f-fbc14e6919a9', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:50.083857 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b1fd18f-ebc0-4249-bc51-9898c82c4e71 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5e1fa6b9-a7b8-4296-b77f-fbc14e6919a9,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:50.096402 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88aed573-685e-4b5d-9ed8-7df1b7085f99 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:33:50.099579 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-88aed573-685e-4b5d-9ed8-7df1b7085f99 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:50.103130 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88aed573-685e-4b5d-9ed8-7df1b7085f99 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:33:50.114477 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ba507ae-c781-486d-9a8d-87bdc6c98918 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.125669 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fadee0c9-aa1d-4985-bd6c-dcb09a2e8bf1 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:33:50.140337 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88aed573-685e-4b5d-9ed8-7df1b7085f99 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Pushing event updated for resources: {'Port': ['ID=fa697e5d-b044-4b66-afb6-0cb9f66e0f71,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:50.173318 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4cec6ebd-f077-404a-a55f-ad0dd8b0f959 None None] Provisioning complete for port fa697e5d-b044-4b66-afb6-0cb9f66e0f71 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:50.174062 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4cec6ebd-f077-404a-a55f-ad0dd8b0f959 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.180043 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ba507ae-c781-486d-9a8d-87bdc6c98918 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.189863 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ba507ae-c781-486d-9a8d-87bdc6c98918 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.217292 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ba507ae-c781-486d-9a8d-87bdc6c98918 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cd475f94-85fd-451e-8535-602dfbbc9895,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:50.217596 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-4cec6ebd-f077-404a-a55f-ad0dd8b0f959 None None] Port fa697e5d-b044-4b66-afb6-0cb9f66e0f71 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:33:50.235868 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ba507ae-c781-486d-9a8d-87bdc6c98918 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.239553 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7ba507ae-c781-486d-9a8d-87bdc6c98918 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1625865 Dec 09 21:33:50.240375 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49186) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:50.245918 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ef28144c-beb9-47d7-a008-24f4a323b5b2 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group_rule': {'security_group_id': '5e1fa6b9-a7b8-4296-b77f-fbc14e6919a9', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:50.274202 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ef28144c-beb9-47d7-a008-24f4a323b5b2 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.320189 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-ef28144c-beb9-47d7-a008-24f4a323b5b2 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] create failed (client error): There was a conflict when trying to complete your request. Dec 09 21:33:50.321167 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ef28144c-beb9-47d7-a008-24f4a323b5b2 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 409 len: 366 time: 0.0797296 Dec 09 21:33:50.323930 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49188) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:50.379691 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-88aed573-685e-4b5d-9ed8-7df1b7085f99 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.380315 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b7bc49f-f88b-4b21-bbe5-dd3864c93b21 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.412148 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b7bc49f-f88b-4b21-bbe5-dd3864c93b21 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.466494 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b7bc49f-f88b-4b21-bbe5-dd3864c93b21 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.469217 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b7bc49f-f88b-4b21-bbe5-dd3864c93b21 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.470398 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1b7bc49f-f88b-4b21-bbe5-dd3864c93b21 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "DELETE /v2.0/security-groups/5e1fa6b9-a7b8-4296-b77f-fbc14e6919a9 HTTP/1.1" status: 204 len: 168 time: 0.1455638 Dec 09 21:33:50.473172 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49192) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:50.479462 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b7bc49f-f88b-4b21-bbe5-dd3864c93b21 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5e1fa6b9-a7b8-4296-b77f-fbc14e6919a9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:50.569465 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a9b49f8f-a0ad-426f-88d0-9c5d0a214db6 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0949643 Dec 09 21:33:50.573657 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49194) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:50.578551 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-8daa7586-a39a-41fe-9789-b54ee339c088 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group': {'name': 'tempest-secgroup--843301162'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:50.601559 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8daa7586-a39a-41fe-9789-b54ee339c088 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.626979 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-88aed573-685e-4b5d-9ed8-7df1b7085f99 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.630884 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-88aed573-685e-4b5d-9ed8-7df1b7085f99 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-640457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-640448', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-635166'] for router, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.678054 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8daa7586-a39a-41fe-9789-b54ee339c088 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.682645 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8daa7586-a39a-41fe-9789-b54ee339c088 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.711654 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8daa7586-a39a-41fe-9789-b54ee339c088 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.712922 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8daa7586-a39a-41fe-9789-b54ee339c088 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.1381850 Dec 09 21:33:50.715883 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49198) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:50.720210 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-f9d35e29-ad1d-4d56-b40c-8424d3ee01f3 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group_rule': {'security_group_id': 'aa003866-6611-408b-8712-890ea9f78bf7', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'bad_ethertype'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:50.720968 n-d-713301-27 neutron-server[103437]: WARNING neutron.api.v2.base [None req-f9d35e29-ad1d-4d56-b40c-8424d3ee01f3 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] An exception happened while processing the request body. The exception message is [Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6'].].: securitygroup.SecurityGroupRuleInvalidEtherType: Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6']. Dec 09 21:33:50.721490 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-f9d35e29-ad1d-4d56-b40c-8424d3ee01f3 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:33:50.722429 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f9d35e29-ad1d-4d56-b40c-8424d3ee01f3 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 396 time: 0.0056250 Dec 09 21:33:50.724506 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8daa7586-a39a-41fe-9789-b54ee339c088 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Pushing event updated for resources: {'SecurityGroup': ['ID=aa003866-6611-408b-8712-890ea9f78bf7,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:50.726560 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49200) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:50.772085 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51398511-1c97-4967-b5cb-275c7e94f541 req-d7e16c9e-3c7f-4622-a06e-e89f2eb6c21c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:50.773947 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51398511-1c97-4967-b5cb-275c7e94f541 req-d7e16c9e-3c7f-4622-a06e-e89f2eb6c21c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 945 time: 0.0978191 Dec 09 21:33:50.787657 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ba1fe029-3782-4cb4-8f5a-ad47afccf8d3 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.817891 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ba1fe029-3782-4cb4-8f5a-ad47afccf8d3 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.848519 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51398511-1c97-4967-b5cb-275c7e94f541 req-ef408fdf-83d2-4acf-a317-786df6b8e183 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0659263 Dec 09 21:33:50.862957 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-88aed573-685e-4b5d-9ed8-7df1b7085f99 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Router a10fcc1a-935f-4633-87e3-f027af6f6656 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:33:50.872438 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ba1fe029-3782-4cb4-8f5a-ad47afccf8d3 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.878309 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ba1fe029-3782-4cb4-8f5a-ad47afccf8d3 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:50.879652 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ba1fe029-3782-4cb4-8f5a-ad47afccf8d3 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "DELETE /v2.0/security-groups/aa003866-6611-408b-8712-890ea9f78bf7 HTTP/1.1" status: 204 len: 168 time: 0.1472163 Dec 09 21:33:50.882127 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49204) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:50.890021 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba1fe029-3782-4cb4-8f5a-ad47afccf8d3 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa003866-6611-408b-8712-890ea9f78bf7,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:50.943407 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1929e10-8923-4c81-ba94-13d3810f1244 req-a1c6d06a-b570-4d68-b7b3-e206c43e7605 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:50.944917 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d1929e10-8923-4c81-ba94-13d3810f1244 req-a1c6d06a-b570-4d68-b7b3-e206c43e7605 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 944 time: 0.1161788 Dec 09 21:33:51.027901 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-07b921dd-d065-4ae8-9e64-65aecb06879a tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1445839 Dec 09 21:33:51.032938 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49208) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:51.037787 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-1ce88487-50cd-4290-aba3-cd6ccd9ad39a tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group': {'name': 'tempest-secgroup--1686451256'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:51.063759 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d1929e10-8923-4c81-ba94-13d3810f1244 req-811ce833-4cc4-4939-965a-a6ee11b3625c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1112344 Dec 09 21:33:51.064000 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ce88487-50cd-4290-aba3-cd6ccd9ad39a tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:51.064867 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-88aed573-685e-4b5d-9ed8-7df1b7085f99 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:33:51.069623 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-88aed573-685e-4b5d-9ed8-7df1b7085f99 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:51.070336 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-88aed573-685e-4b5d-9ed8-7df1b7085f99 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "PUT /v2.0/routers/a10fcc1a-935f-4633-87e3-f027af6f6656 HTTP/1.1" status: 200 len: 915 time: 2.1679151 Dec 09 21:33:51.073096 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49210) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:51.080388 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cfeecc90-19fa-4d86-a637-fdc2088edb05 None None] Sync routers for ids ['a10fcc1a-935f-4633-87e3-f027af6f6656'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:33:51.094284 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cfeecc90-19fa-4d86-a637-fdc2088edb05 None None] Routers {'a10fcc1a-935f-4633-87e3-f027af6f6656'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:51.095002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-cfeecc90-19fa-4d86-a637-fdc2088edb05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a10fcc1a-935f-4633-87e3-f027af6f6656'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:51.129136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-cfeecc90-19fa-4d86-a637-fdc2088edb05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:51.138516 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cfeecc90-19fa-4d86-a637-fdc2088edb05 None None] Routers {'a10fcc1a-935f-4633-87e3-f027af6f6656'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:51.139212 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-cfeecc90-19fa-4d86-a637-fdc2088edb05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a10fcc1a-935f-4633-87e3-f027af6f6656'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:51.150334 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ce88487-50cd-4290-aba3-cd6ccd9ad39a tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:51.154784 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ce88487-50cd-4290-aba3-cd6ccd9ad39a tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:51.178061 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1e54159e-3c83-49a1-a5b5-3e2b29336c43 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:33:51.180591 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-cfeecc90-19fa-4d86-a637-fdc2088edb05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:51.181269 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cfeecc90-19fa-4d86-a637-fdc2088edb05 None None] The sync data for ids ['a10fcc1a-935f-4633-87e3-f027af6f6656'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:33:51.185279 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ce88487-50cd-4290-aba3-cd6ccd9ad39a tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f93620de-63c4-4114-9a97-fcac909307af,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:51.189723 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ce88487-50cd-4290-aba3-cd6ccd9ad39a tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:51.190982 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1ce88487-50cd-4290-aba3-cd6ccd9ad39a tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.1569600 Dec 09 21:33:51.193863 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49212) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:51.198706 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-12f728a8-1d10-4e70-921c-2dabb3da872f tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "GET /v2.0/routers/a10fcc1a-935f-4633-87e3-f027af6f6656 HTTP/1.1" status: 200 len: 921 time: 0.1242571 Dec 09 21:33:51.201775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-bdfbc979-f46b-426e-83dc-4a6077848524 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group_rule': {'security_group_id': 'f93620de-63c4-4114-9a97-fcac909307af', 'protocol': 'bad_protocol_name', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:51.201775 n-d-713301-27 neutron-server[103437]: WARNING neutron.api.v2.base [None req-bdfbc979-f46b-426e-83dc-4a6077848524 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] An exception happened while processing the request body. The exception message is [Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported.].: securitygroup.SecurityGroupRuleInvalidProtocol: Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported. Dec 09 21:33:51.202054 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-bdfbc979-f46b-426e-83dc-4a6077848524 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:33:51.202825 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49214) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:51.209564 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bdfbc979-f46b-426e-83dc-4a6077848524 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 667 time: 0.0122311 Dec 09 21:33:51.210223 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49216) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:51.240175 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 1e54159e-3c83-49a1-a5b5-3e2b29336c43 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:33:51.244330 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 1e54159e-3c83-49a1-a5b5-3e2b29336c43 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:51.244700 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:51.248872 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dbe9f718-13ca-4274-9994-999c0ba782da tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:51.264139 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-dbe9f718-13ca-4274-9994-999c0ba782da tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "GET /v2.0/ports?network_id=97925a19-460a-4476-8208-41db134b6c83&device_id=a10fcc1a-935f-4633-87e3-f027af6f6656&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.0599337 Dec 09 21:33:51.265718 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49220) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:51.278728 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ae45e02-9971-40fb-8488-33b3be721e07 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:51.304448 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ae45e02-9971-40fb-8488-33b3be721e07 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:51.329444 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:51.354118 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'af704653-9f02-4515-9fb8-0f0869d126b2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1e54159e-3c83-49a1-a5b5-3e2b29336c43'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:33:51.356600 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a2cccd12-c349-43aa-8eea-c149f1a1596f" -d '{"events": [{"server_uuid": "af704653-9f02-4515-9fb8-0f0869d126b2", "name": "network-vif-plugged", "status": "completed", "tag": "1e54159e-3c83-49a1-a5b5-3e2b29336c43"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:33:51.367999 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ae45e02-9971-40fb-8488-33b3be721e07 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:51.372120 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2b7c068f-7737-463f-87a8-8100bcc3aab8 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:51.372330 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ae45e02-9971-40fb-8488-33b3be721e07 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:51.375899 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8ae45e02-9971-40fb-8488-33b3be721e07 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "DELETE /v2.0/security-groups/f93620de-63c4-4114-9a97-fcac909307af HTTP/1.1" status: 204 len: 168 time: 0.1628401 Dec 09 21:33:51.376965 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2b7c068f-7737-463f-87a8-8100bcc3aab8 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 881 time: 0.1101074 Dec 09 21:33:51.377507 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 1e54159e-3c83-49a1-a5b5-3e2b29336c43, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1e54159e-3c83-49a1-a5b5-3e2b29336c43,segment=NetworkSegment(dcec1a9e-3140-49cf-a664-3f1f0937898f),segment_id=dcec1a9e-3140-49cf-a664-3f1f0937898f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:33:51.377644 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49224) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:51.378375 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49226) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:51.383918 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ae45e02-9971-40fb-8488-33b3be721e07 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f93620de-63c4-4114-9a97-fcac909307af,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:51.384269 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:51.425737 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:33:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e3dd4dee-a341-416a-b1b2-e1ec72e57141 x-openstack-request-id: req-e3dd4dee-a341-416a-b1b2-e1ec72e57141 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:33:51.426130 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "af704653-9f02-4515-9fb8-0f0869d126b2", "name": "network-vif-plugged", "status": "completed", "tag": "1e54159e-3c83-49a1-a5b5-3e2b29336c43", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:33:51.426471 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e3dd4dee-a341-416a-b1b2-e1ec72e57141 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:33:51.426931 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'af704653-9f02-4515-9fb8-0f0869d126b2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1e54159e-3c83-49a1-a5b5-3e2b29336c43', 'code': 200} Dec 09 21:33:51.456499 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=1e54159e-3c83-49a1-a5b5-3e2b29336c43,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:51.691092 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-88fb6c7b-b910-406c-b0be-d4c39bcca579 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "GET /v2.0/ports?device_id=a10fcc1a-935f-4633-87e3-f027af6f6656 HTTP/1.1" status: 200 len: 205 time: 0.0479348 Dec 09 21:33:51.693920 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49230) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:51.720448 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-26dcd6f2-116d-4087-86c4-09bd5728bf86 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.3409922 Dec 09 21:33:51.724497 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49232) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:51.729220 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-7c5567db-b045-4bd5-8fda-f11336cbcaec tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group': {'name': 'tempest-secgroup--325170929'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:51.734566 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abd800d7-c1e3-46db-afcd-15cc7878a39d req-b086445c-5346-4012-8e55-afef90a01018 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:51.736039 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-abd800d7-c1e3-46db-afcd-15cc7878a39d req-b086445c-5346-4012-8e55-afef90a01018 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 1097 time: 0.0834270 Dec 09 21:33:51.779285 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c5567db-b045-4bd5-8fda-f11336cbcaec tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:51.806262 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:51.811063 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-abd800d7-c1e3-46db-afcd-15cc7878a39d req-4f5940ae-231f-4e1f-833d-dc9908eeced1 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0673680 Dec 09 21:33:51.871074 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c5567db-b045-4bd5-8fda-f11336cbcaec tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:51.875873 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c5567db-b045-4bd5-8fda-f11336cbcaec tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:51.909217 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c5567db-b045-4bd5-8fda-f11336cbcaec tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:51.913163 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7c5567db-b045-4bd5-8fda-f11336cbcaec tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.1853261 Dec 09 21:33:51.913363 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49236) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:51.916706 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:51.917985 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-7448d8bb-ca1c-445d-aa59-a22c5df40745 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group_rule': {'security_group_id': '1bcf3de8-3835-4568-a56c-13f0fdbbd2c4', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '192.168.1./24'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:51.935503 n-d-713301-27 neutron-server[103438]: WARNING neutron.api.v2.base [None req-7448d8bb-ca1c-445d-aa59-a22c5df40745 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1./24 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1./24 given as IP prefix. Dec 09 21:33:51.936803 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-7448d8bb-ca1c-445d-aa59-a22c5df40745 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:33:51.940588 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7448d8bb-ca1c-445d-aa59-a22c5df40745 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0235906 Dec 09 21:33:51.940588 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c5567db-b045-4bd5-8fda-f11336cbcaec tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1bcf3de8-3835-4568-a56c-13f0fdbbd2c4,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:51.941531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49238) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:51.945935 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-fce708de-ed6c-4ca8-bf6e-0be266fa7630 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group_rule': {'security_group_id': '1bcf3de8-3835-4568-a56c-13f0fdbbd2c4', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '192.168.1.1/33'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:51.946835 n-d-713301-27 neutron-server[103438]: WARNING neutron.api.v2.base [None req-fce708de-ed6c-4ca8-bf6e-0be266fa7630 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1.1/33 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1.1/33 given as IP prefix. Dec 09 21:33:51.949034 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-fce708de-ed6c-4ca8-bf6e-0be266fa7630 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:33:51.951244 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fce708de-ed6c-4ca8-bf6e-0be266fa7630 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 320 time: 0.0081344 Dec 09 21:33:51.954047 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49240) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:51.958905 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-e22676fd-671f-40af-8ec2-a45cbd885b59 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group_rule': {'security_group_id': '1bcf3de8-3835-4568-a56c-13f0fdbbd2c4', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': 'bad_prefix'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:51.960723 n-d-713301-27 neutron-server[103437]: WARNING neutron.api.v2.base [None req-e22676fd-671f-40af-8ec2-a45cbd885b59 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] An exception happened while processing the request body. The exception message is [Invalid CIDR bad_prefix given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR bad_prefix given as IP prefix. Dec 09 21:33:51.961225 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-e22676fd-671f-40af-8ec2-a45cbd885b59 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:33:51.964599 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e22676fd-671f-40af-8ec2-a45cbd885b59 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0071797 Dec 09 21:33:51.965319 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49242) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:51.970113 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-1384a174-ef29-4e0e-89ff-bcd328c9397b tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group_rule': {'security_group_id': '1bcf3de8-3835-4568-a56c-13f0fdbbd2c4', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '256'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:51.971576 n-d-713301-27 neutron-server[103438]: WARNING neutron.api.v2.base [None req-1384a174-ef29-4e0e-89ff-bcd328c9397b tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 256 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 256 given as IP prefix. Dec 09 21:33:51.972065 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-1384a174-ef29-4e0e-89ff-bcd328c9397b tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:33:51.973005 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1384a174-ef29-4e0e-89ff-bcd328c9397b tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 309 time: 0.0062943 Dec 09 21:33:51.977113 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49244) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:52.006900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Deleting port fa697e5d-b044-4b66-afb6-0cb9f66e0f71 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:52.007242 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:52.008360 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea113ac4-d5c4-4175-ab68-04bad6f9f619 req-ae7e350c-08fa-45d7-9343-ba48dbdee8aa tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:52.009879 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea113ac4-d5c4-4175-ab68-04bad6f9f619 req-ae7e350c-08fa-45d7-9343-ba48dbdee8aa tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 945 time: 0.0539031 Dec 09 21:33:52.062125 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea113ac4-d5c4-4175-ab68-04bad6f9f619 req-e78decf9-10c2-4a76-abd2-549f0d8773cd tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458136 Dec 09 21:33:52.094507 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3963bb73-d029-4839-84c3-2b7e407b81a2 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:52.122770 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:52.138104 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3963bb73-d029-4839-84c3-2b7e407b81a2 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:52.147845 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Calling delete_port for fa697e5d-b044-4b66-afb6-0cb9f66e0f71 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:33:52.198604 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d63a5658-8bd3-4fd6-8704-fde5433ff2f8 req-c835e120-efc7-44f4-b701-fd66e2821c56 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:52.200183 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d63a5658-8bd3-4fd6-8704-fde5433ff2f8 req-c835e120-efc7-44f4-b701-fd66e2821c56 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0551710 Dec 09 21:33:52.229395 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3963bb73-d029-4839-84c3-2b7e407b81a2 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:52.232514 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3963bb73-d029-4839-84c3-2b7e407b81a2 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:52.233671 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3963bb73-d029-4839-84c3-2b7e407b81a2 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "DELETE /v2.0/security-groups/1bcf3de8-3835-4568-a56c-13f0fdbbd2c4 HTTP/1.1" status: 204 len: 168 time: 0.2555072 Dec 09 21:33:52.238235 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49250) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:52.247155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3963bb73-d029-4839-84c3-2b7e407b81a2 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1bcf3de8-3835-4568-a56c-13f0fdbbd2c4,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:52.264169 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d63a5658-8bd3-4fd6-8704-fde5433ff2f8 req-a2039b9e-f03e-4707-8097-d8fd83939f07 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0575271 Dec 09 21:33:52.300145 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c53067db-e1d9-4496-9b0d-9b6dc3a3f4c0 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0607946 Dec 09 21:33:52.304299 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49252) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:52.309187 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-bece5fc6-0811-4988-ab51-8cab9095d7d1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group': {'name': 'tempest-secgroup--1369408118'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:52.333118 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bece5fc6-0811-4988-ab51-8cab9095d7d1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:52.354290 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:52.392167 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Pushing event deleted for resources: {'Port': ['ID=fa697e5d-b044-4b66-afb6-0cb9f66e0f71,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:52.407836 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e9da6808-cd8a-4ade-9ebb-223cb5b6f57b None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:33:52.412238 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bece5fc6-0811-4988-ab51-8cab9095d7d1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:52.418014 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bece5fc6-0811-4988-ab51-8cab9095d7d1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:52.418555 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:52.419304 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:52.419798 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:52.420157 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:52.420569 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:52.420838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:52.421177 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:52.421547 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:52.421834 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:52.422194 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:52.422489 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:52.422820 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:52.423151 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:52.451657 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bece5fc6-0811-4988-ab51-8cab9095d7d1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Pushing event updated for resources: {'SecurityGroup': ['ID=750def41-d415-4bd7-87d3-f42e213cef67,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:52.456047 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bece5fc6-0811-4988-ab51-8cab9095d7d1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:52.457278 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bece5fc6-0811-4988-ab51-8cab9095d7d1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.1517444 Dec 09 21:33:52.460794 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49256) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:52.465435 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-2b8e9af6-8ca8-4f6c-992f-fd029b832a91 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group_rule': {'security_group_id': '750def41-d415-4bd7-87d3-f42e213cef67', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 80, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:52.466192 n-d-713301-27 neutron-server[103438]: WARNING neutron.api.v2.base [None req-2b8e9af6-8ca8-4f6c-992f-fd029b832a91 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Dec 09 21:33:52.466714 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-2b8e9af6-8ca8-4f6c-992f-fd029b832a91 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:33:52.467684 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2b8e9af6-8ca8-4f6c-992f-fd029b832a91 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0059111 Dec 09 21:33:52.470307 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49258) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:52.473722 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:52.474551 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-dd25fb18-8ff5-438b-b4ab-123eba77918b tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group_rule': {'security_group_id': '750def41-d415-4bd7-87d3-f42e213cef67', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 79, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:52.513634 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-dd25fb18-8ff5-438b-b4ab-123eba77918b tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:33:52.514812 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-dd25fb18-8ff5-438b-b4ab-123eba77918b tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.0436034 Dec 09 21:33:52.517734 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49260) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:52.522411 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-649686d3-4c65-4b2b-988d-c02aa928ab50 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group_rule': {'security_group_id': '750def41-d415-4bd7-87d3-f42e213cef67', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:52.522862 n-d-713301-27 neutron-server[103438]: WARNING neutron.api.v2.base [None req-649686d3-4c65-4b2b-988d-c02aa928ab50 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] An exception happened while processing the request body. The exception message is [Invalid value for port 65536].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port 65536 Dec 09 21:33:52.523745 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-649686d3-4c65-4b2b-988d-c02aa928ab50 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:33:52.524688 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-649686d3-4c65-4b2b-988d-c02aa928ab50 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0059986 Dec 09 21:33:52.527137 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49262) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:52.531585 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-1aaebc14-8f8f-4a3f-aaf9-f41de4658d07 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group_rule': {'security_group_id': '750def41-d415-4bd7-87d3-f42e213cef67', 'protocol': 'tcp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:52.573393 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-1aaebc14-8f8f-4a3f-aaf9-f41de4658d07 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:33:52.576112 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1aaebc14-8f8f-4a3f-aaf9-f41de4658d07 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.0478122 Dec 09 21:33:52.577880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49266) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:52.583528 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-7f8ef059-3faa-4a9a-97d8-568c2c3b77af tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group_rule': {'security_group_id': '750def41-d415-4bd7-87d3-f42e213cef67', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:52.584006 n-d-713301-27 neutron-server[103438]: WARNING neutron.api.v2.base [None req-7f8ef059-3faa-4a9a-97d8-568c2c3b77af tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Dec 09 21:33:52.584517 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-7f8ef059-3faa-4a9a-97d8-568c2c3b77af tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:33:52.588191 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7f8ef059-3faa-4a9a-97d8-568c2c3b77af tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0064030 Dec 09 21:33:52.588403 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49268) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:52.594059 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-56688596-b078-4e70-8e4a-4eff30295c15 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group_rule': {'security_group_id': '750def41-d415-4bd7-87d3-f42e213cef67', 'protocol': 'icmp', 'port_range_min': 1, 'port_range_max': 256, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:52.632767 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-56688596-b078-4e70-8e4a-4eff30295c15 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:33:52.633980 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-56688596-b078-4e70-8e4a-4eff30295c15 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.0446830 Dec 09 21:33:52.636901 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49270) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:52.641834 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-5a92c90e-9c66-4039-bbe9-78f36bd28c6e tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group_rule': {'security_group_id': '750def41-d415-4bd7-87d3-f42e213cef67', 'protocol': 'icmp', 'port_range_min': -1, 'port_range_max': 25, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:52.642313 n-d-713301-27 neutron-server[103438]: WARNING neutron.api.v2.base [None req-5a92c90e-9c66-4039-bbe9-78f36bd28c6e tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] An exception happened while processing the request body. The exception message is [Invalid value for port -1].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -1 Dec 09 21:33:52.642789 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-5a92c90e-9c66-4039-bbe9-78f36bd28c6e tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:33:52.643791 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5a92c90e-9c66-4039-bbe9-78f36bd28c6e tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0057228 Dec 09 21:33:52.646480 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49272) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:52.651162 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c291f22c-db21-4f91-b794-760755d121f6 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group_rule': {'security_group_id': '750def41-d415-4bd7-87d3-f42e213cef67', 'protocol': 'icmp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:52.690123 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-c291f22c-db21-4f91-b794-760755d121f6 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:33:52.694402 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c291f22c-db21-4f91-b794-760755d121f6 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 373 time: 0.0470214 Dec 09 21:33:52.695066 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49274) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:52.699663 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c8750b7f-4f64-46b3-a3d1-ea9707bbd6bc tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group_rule': {'security_group_id': '750def41-d415-4bd7-87d3-f42e213cef67', 'protocol': 'icmp', 'port_range_min': 300, 'port_range_max': 1, 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:52.740038 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-c8750b7f-4f64-46b3-a3d1-ea9707bbd6bc tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:33:52.743725 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c8750b7f-4f64-46b3-a3d1-ea9707bbd6bc tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.0449066 Dec 09 21:33:52.744032 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49276) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:52.798832 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-44f9d6cf-33bd-4205-82fa-00057ba198dc tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:52.823625 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-44f9d6cf-33bd-4205-82fa-00057ba198dc tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:52.871615 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-44f9d6cf-33bd-4205-82fa-00057ba198dc tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:52.874650 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-44f9d6cf-33bd-4205-82fa-00057ba198dc tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:52.875878 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-44f9d6cf-33bd-4205-82fa-00057ba198dc tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "DELETE /v2.0/security-groups/750def41-d415-4bd7-87d3-f42e213cef67 HTTP/1.1" status: 204 len: 168 time: 0.1308832 Dec 09 21:33:52.878590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49278) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:52.884815 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44f9d6cf-33bd-4205-82fa-00057ba198dc tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=750def41-d415-4bd7-87d3-f42e213cef67,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:52.889727 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:52.897329 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:52.969186 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:52.969712 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Fanout notify agent at l3_agent the message router_deleted on router a10fcc1a-935f-4633-87e3-f027af6f6656 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:33:52.977289 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:52.978406 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9cb95620-0fcd-4e93-b78f-123b710a3dbf tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "DELETE /v2.0/routers/a10fcc1a-935f-4633-87e3-f027af6f6656 HTTP/1.1" status: 204 len: 168 time: 1.2834697 Dec 09 21:33:52.982839 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3dbd1120-fe61-4f01-92de-7c48d1b587e2 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1025620 Dec 09 21:33:52.983593 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49280) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:52.987806 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49282) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:52.988300 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-41018d89-590b-44ba-8bfe-a29a0f039393 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-1991972363', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:52.992262 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-343071d2-1b87-4da9-90df-77b3f0d14ff5 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group': {'name': 'tempest-secgroup--1197128635'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:53.009178 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.db.api [None req-343071d2-1b87-4da9-90df-77b3f0d14ff5 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Dec 09 21:33:53.009178 n-d-713301-27 neutron-server[103438]: [SQL: INSERT INTO reservations (project_id, id, expiration) VALUES (%(project_id)s, %(id)s, %(expiration)s)] Dec 09 21:33:53.009178 n-d-713301-27 neutron-server[103438]: [parameters: {'project_id': '286e5890c24742d79ccff8293d923026', 'id': 'ebcd0ea1-68ae-40f8-b4ff-7d922dd42507', 'expiration': datetime.datetime(2021, 12, 9, 21, 35, 53, 5736)}] Dec 09 21:33:53.009178 n-d-713301-27 neutron-server[103438]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=103438) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:33:53.009657 n-d-713301-27 neutron-server[103438]: DEBUG oslo_db.api [None req-343071d2-1b87-4da9-90df-77b3f0d14ff5 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:33:53.017937 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-41018d89-590b-44ba-8bfe-a29a0f039393 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:53.019042 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-41018d89-590b-44ba-8bfe-a29a0f039393 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:53.070215 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-41018d89-590b-44ba-8bfe-a29a0f039393 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:53.071747 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:33:53.075744 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-41018d89-590b-44ba-8bfe-a29a0f039393 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:53.094320 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-41018d89-590b-44ba-8bfe-a29a0f039393 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:53.098347 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-41018d89-590b-44ba-8bfe-a29a0f039393 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 0.1113629 Dec 09 21:33:53.098742 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49286) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:53.103108 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-5d2397c4-4594-40f5-ad03-14a429e1eb9a tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'enable_snat': False}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:53.186697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d74f5db0-ffcc-4097-9a81-0b5e9f847e67 req-dfb46765-9f10-47b7-8563-c39d6553b7e3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:53.188267 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d74f5db0-ffcc-4097-9a81-0b5e9f847e67 req-dfb46765-9f10-47b7-8563-c39d6553b7e3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 945 time: 0.0538104 Dec 09 21:33:53.238271 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d74f5db0-ffcc-4097-9a81-0b5e9f847e67 req-79b2571a-0e6a-4646-80c5-cd8545bea893 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435667 Dec 09 21:33:53.317247 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d2397c4-4594-40f5-ad03-14a429e1eb9a tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:53.392429 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abdab8ed-f3c7-4a89-847a-1e50f5befa29 req-43fc4e1d-9972-4aed-8ccc-7ccb510747f7 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:53.394077 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-abdab8ed-f3c7-4a89-847a-1e50f5befa29 req-43fc4e1d-9972-4aed-8ccc-7ccb510747f7 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0545902 Dec 09 21:33:53.444651 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-abdab8ed-f3c7-4a89-847a-1e50f5befa29 req-f6d49f3a-9f7f-49a3-afdc-778ab9231c09 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441539 Dec 09 21:33:53.526692 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d2397c4-4594-40f5-ad03-14a429e1eb9a tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:53.537869 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-343071d2-1b87-4da9-90df-77b3f0d14ff5 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:53.546542 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d2397c4-4594-40f5-ad03-14a429e1eb9a tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:53.620070 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-343071d2-1b87-4da9-90df-77b3f0d14ff5 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:53.627460 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-343071d2-1b87-4da9-90df-77b3f0d14ff5 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:53.673338 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-5d2397c4-4594-40f5-ad03-14a429e1eb9a tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Allocated IP 172.25.3.82 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/80b417c0-0e85-4d33-8f72-f04cb1a2ccf2) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:33:53.683293 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-343071d2-1b87-4da9-90df-77b3f0d14ff5 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:53.684647 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-343071d2-1b87-4da9-90df-77b3f0d14ff5 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.6960349 Dec 09 21:33:53.689883 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49308) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:53.692649 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-9fbbd5a0-d177-4608-b970-6a14203f40bc tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group_rule': {'security_group_id': 'f409bb78-3c18-451e-90e7-f8efac4bb765', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_group_id': 'bad_group_id'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:53.695031 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-343071d2-1b87-4da9-90df-77b3f0d14ff5 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f409bb78-3c18-451e-90e7-f8efac4bb765,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:53.765751 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-6c2b56c0-9f0c-4eab-b0a6-0b1e19922dcb tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:53.767311 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-6c2b56c0-9f0c-4eab-b0a6-0b1e19922dcb tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/networks?id=88af5e51-6d1a-432d-8676-517f449774a3 HTTP/1.1" status: 200 len: 812 time: 0.1219959 Dec 09 21:33:53.783694 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-772d288c-8c18-4480-911e-face4f31992f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/quotas/b65669b5d4924ee090e9583aa839a399 HTTP/1.1" status: 200 len: 375 time: 0.0102932 Dec 09 21:33:53.803120 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-9fbbd5a0-d177-4608-b970-6a14203f40bc tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] create failed (client error): The resource could not be found. Dec 09 21:33:53.804252 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9fbbd5a0-d177-4608-b970-6a14203f40bc tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 323 time: 0.1153581 Dec 09 21:33:53.809516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49310) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:53.813782 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-c8dcd583-fd92-4f8f-9b60-cdf6bbf05dae tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group_rule': {'security_group_id': 'f409bb78-3c18-451e-90e7-f8efac4bb765', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_group_id': 'c586b0ac-ffe0-4b21-8b80-5589941a7c15'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:53.837657 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d2397c4-4594-40f5-ad03-14a429e1eb9a tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:53.844723 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-b769aef4-0388-47d2-9d7c-1dc17cfd035a tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=b65669b5d4924ee090e9583aa839a399&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0550997 Dec 09 21:33:53.900002 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d2397c4-4594-40f5-ad03-14a429e1eb9a tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:53.909033 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-c8dcd583-fd92-4f8f-9b60-cdf6bbf05dae tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] create failed (client error): The resource could not be found. Dec 09 21:33:53.912798 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c8dcd583-fd92-4f8f-9b60-cdf6bbf05dae tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.0998392 Dec 09 21:33:53.913596 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49314) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:53.942117 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5d2397c4-4594-40f5-ad03-14a429e1eb9a tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:33:53.945093 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-5d2397c4-4594-40f5-ad03-14a429e1eb9a tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:53.948712 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d2397c4-4594-40f5-ad03-14a429e1eb9a tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:33:53.960815 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-92dc0755-2dca-4575-b15c-f5b206cfe68d None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:33:53.976382 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d2397c4-4594-40f5-ad03-14a429e1eb9a tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Pushing event updated for resources: {'Port': ['ID=80b417c0-0e85-4d33-8f72-f04cb1a2ccf2,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:54.043631 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-577f63d6-31bb-4580-ac9f-df7c35985860 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:54.065819 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3f7abf44-3f6e-474c-9f98-9b4c5ffe6228 None None] Provisioning complete for port 80b417c0-0e85-4d33-8f72-f04cb1a2ccf2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:54.066619 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3f7abf44-3f6e-474c-9f98-9b4c5ffe6228 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:54.079099 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-02df10e8-8552-44ca-bffd-d301939f57c4 service neutron] 10.222.0.13 "GET /v2.0/networks/88af5e51-6d1a-432d-8676-517f449774a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2268400 Dec 09 21:33:54.080696 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-577f63d6-31bb-4580-ac9f-df7c35985860 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:54.107185 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-3f7abf44-3f6e-474c-9f98-9b4c5ffe6228 None None] Port 80b417c0-0e85-4d33-8f72-f04cb1a2ccf2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:33:54.189220 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-577f63d6-31bb-4580-ac9f-df7c35985860 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:54.191826 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-577f63d6-31bb-4580-ac9f-df7c35985860 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:54.195844 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-577f63d6-31bb-4580-ac9f-df7c35985860 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "DELETE /v2.0/security-groups/f409bb78-3c18-451e-90e7-f8efac4bb765 HTTP/1.1" status: 204 len: 168 time: 0.2783909 Dec 09 21:33:54.199945 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49316) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:54.212741 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-064b09dd-453a-4440-9223-7872bf9cdbcd service neutron] 10.222.0.13 "GET /v2.0/networks/88af5e51-6d1a-432d-8676-517f449774a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1242332 Dec 09 21:33:54.213819 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-577f63d6-31bb-4580-ac9f-df7c35985860 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f409bb78-3c18-451e-90e7-f8efac4bb765,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:54.246749 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d2397c4-4594-40f5-ad03-14a429e1eb9a tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:54.302168 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-566d8a45-221c-41aa-8194-2087d6040fa3 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1011128 Dec 09 21:33:54.307029 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49322) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:54.311928 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a2abf7a5-7867-4950-8497-fff8a1a30570 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group_rule': {'security_group_id': '693d61bf-0ded-4cfe-b36b-1679059e24e4', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:54.418074 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f0ad4d8-43f9-4a9e-b918-977f4a36ac15 req-c0b617b6-8bf9-49c0-9c3e-c9054a8bbff3 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=a5d6b08b-3aad-419a-9ec3-3d21a5bfac11 HTTP/1.1" status: 200 len: 210 time: 0.0310051 Dec 09 21:33:54.430826 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a7bfd23-2039-440b-97fc-ec7b59dc3ef7 req-85443007-faa0-47b3-a493-59e5cf8e1fee tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:54.434533 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a7bfd23-2039-440b-97fc-ec7b59dc3ef7 req-85443007-faa0-47b3-a493-59e5cf8e1fee tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 945 time: 0.1088529 Dec 09 21:33:54.450214 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-a2abf7a5-7867-4950-8497-fff8a1a30570 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] create failed (client error): The resource could not be found. Dec 09 21:33:54.451877 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a2abf7a5-7867-4950-8497-fff8a1a30570 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.1437109 Dec 09 21:33:54.456886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49328) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:54.461242 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-6a36519d-0310-44f3-ab3f-e4dcb69ff1c1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group': {'name': 'tempest-secgroup--191326858'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:54.506495 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a7bfd23-2039-440b-97fc-ec7b59dc3ef7 req-8397b1b1-da33-4496-af31-765012854e5c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0660892 Dec 09 21:33:54.509517 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6a36519d-0310-44f3-ab3f-e4dcb69ff1c1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:54.511320 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d2397c4-4594-40f5-ad03-14a429e1eb9a tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:54.515354 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d2397c4-4594-40f5-ad03-14a429e1eb9a tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-640457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-640448', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-635166'] for router, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:54.590609 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6a36519d-0310-44f3-ab3f-e4dcb69ff1c1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:54.594881 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6a36519d-0310-44f3-ab3f-e4dcb69ff1c1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:54.627414 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6a36519d-0310-44f3-ab3f-e4dcb69ff1c1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:54.628674 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6a36519d-0310-44f3-ab3f-e4dcb69ff1c1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.1709473 Dec 09 21:33:54.630657 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a36519d-0310-44f3-ab3f-e4dcb69ff1c1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ba8bb406-faec-41d9-8db7-c95f6fd5ee6c,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:54.631761 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49336) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:54.636989 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-e31a69b5-fdc1-4989-81ba-132f1a1921d2 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group': {'name': 'tempest-secgroup--1177562787'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:54.639284 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a36519d-0310-44f3-ab3f-e4dcb69ff1c1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:54.639670 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a36519d-0310-44f3-ab3f-e4dcb69ff1c1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:54.640009 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a36519d-0310-44f3-ab3f-e4dcb69ff1c1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:54.640347 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a36519d-0310-44f3-ab3f-e4dcb69ff1c1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:54.640702 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a36519d-0310-44f3-ab3f-e4dcb69ff1c1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:54.641011 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a36519d-0310-44f3-ab3f-e4dcb69ff1c1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:54.641340 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a36519d-0310-44f3-ab3f-e4dcb69ff1c1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:54.641659 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a36519d-0310-44f3-ab3f-e4dcb69ff1c1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:54.641977 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a36519d-0310-44f3-ab3f-e4dcb69ff1c1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:54.642299 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a36519d-0310-44f3-ab3f-e4dcb69ff1c1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:54.642616 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a36519d-0310-44f3-ab3f-e4dcb69ff1c1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:54.642936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a36519d-0310-44f3-ab3f-e4dcb69ff1c1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:54.643457 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a36519d-0310-44f3-ab3f-e4dcb69ff1c1 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:33:54.676559 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e31a69b5-fdc1-4989-81ba-132f1a1921d2 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:54.689521 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5d2397c4-4594-40f5-ad03-14a429e1eb9a tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Router 5f2119e0-1a75-40a2-a420-84f362d52869 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:33:54.840653 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e31a69b5-fdc1-4989-81ba-132f1a1921d2 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:54.846540 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e31a69b5-fdc1-4989-81ba-132f1a1921d2 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:54.852627 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5d2397c4-4594-40f5-ad03-14a429e1eb9a tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:33:54.862488 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d2397c4-4594-40f5-ad03-14a429e1eb9a tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:54.862727 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1ffd0a3-d1f7-4331-946d-4e0bac7d6b2f None None] Sync routers for ids ['5f2119e0-1a75-40a2-a420-84f362d52869'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:33:54.863944 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5d2397c4-4594-40f5-ad03-14a429e1eb9a tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "PUT /v2.0/routers/5f2119e0-1a75-40a2-a420-84f362d52869 HTTP/1.1" status: 200 len: 915 time: 1.7641718 Dec 09 21:33:54.866802 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49342) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:54.874684 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1ffd0a3-d1f7-4331-946d-4e0bac7d6b2f None None] Routers {'5f2119e0-1a75-40a2-a420-84f362d52869'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:54.875316 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f1ffd0a3-d1f7-4331-946d-4e0bac7d6b2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['5f2119e0-1a75-40a2-a420-84f362d52869'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:54.886797 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e31a69b5-fdc1-4989-81ba-132f1a1921d2 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:54.888231 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e31a69b5-fdc1-4989-81ba-132f1a1921d2 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.2553656 Dec 09 21:33:54.890347 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e31a69b5-fdc1-4989-81ba-132f1a1921d2 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Pushing event updated for resources: {'SecurityGroup': ['ID=bf27e7b6-1d45-4b26-a45c-bb99ed89ca13,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:54.892385 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49344) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:54.897327 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-f77b885a-b193-44a2-ab19-354264bce570 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group_rule': {'security_group_id': 'ba8bb406-faec-41d9-8db7-c95f6fd5ee6c', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '172.20.0.0/16', 'remote_group_id': 'bf27e7b6-1d45-4b26-a45c-bb99ed89ca13'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:54.914606 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f1ffd0a3-d1f7-4331-946d-4e0bac7d6b2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:54.924271 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1ffd0a3-d1f7-4331-946d-4e0bac7d6b2f None None] Routers {'5f2119e0-1a75-40a2-a420-84f362d52869'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:54.924860 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f1ffd0a3-d1f7-4331-946d-4e0bac7d6b2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['5f2119e0-1a75-40a2-a420-84f362d52869'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:54.944806 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-f77b885a-b193-44a2-ab19-354264bce570 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:33:54.946711 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f77b885a-b193-44a2-ab19-354264bce570 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 387 time: 0.0526960 Dec 09 21:33:54.948847 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49346) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:54.958709 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f1ffd0a3-d1f7-4331-946d-4e0bac7d6b2f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:54.959651 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1ffd0a3-d1f7-4331-946d-4e0bac7d6b2f None None] The sync data for ids ['5f2119e0-1a75-40a2-a420-84f362d52869'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:33:55.013188 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9fcfa808-dd30-4162-bc76-37d91c78b463 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:55.026612 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c854fe32-000e-408d-b07e-a45ab2580d1f tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "GET /v2.0/routers/5f2119e0-1a75-40a2-a420-84f362d52869 HTTP/1.1" status: 200 len: 921 time: 0.1583018 Dec 09 21:33:55.029714 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49350) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:55.042151 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9fcfa808-dd30-4162-bc76-37d91c78b463 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:55.071420 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9bd54482-6dbf-466e-b59d-83e0402ad0a9 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:55.076681 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9bd54482-6dbf-466e-b59d-83e0402ad0a9 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "GET /v2.0/ports?network_id=97925a19-460a-4476-8208-41db134b6c83&device_id=5f2119e0-1a75-40a2-a420-84f362d52869&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.0423481 Dec 09 21:33:55.076681 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49352) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:55.093946 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9fcfa808-dd30-4162-bc76-37d91c78b463 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:55.096613 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9fcfa808-dd30-4162-bc76-37d91c78b463 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:55.097846 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9fcfa808-dd30-4162-bc76-37d91c78b463 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "DELETE /v2.0/security-groups/bf27e7b6-1d45-4b26-a45c-bb99ed89ca13 HTTP/1.1" status: 204 len: 168 time: 0.1475241 Dec 09 21:33:55.103953 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49354) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:55.131348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fcfa808-dd30-4162-bc76-37d91c78b463 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=bf27e7b6-1d45-4b26-a45c-bb99ed89ca13,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:55.166406 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1d0875b-3d54-478e-90a2-a7d4fb43020b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:55.168097 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c1d0875b-3d54-478e-90a2-a7d4fb43020b tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 881 time: 0.0912733 Dec 09 21:33:55.171129 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49356) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:55.174818 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b036fc4d-dbe9-4a3b-a99a-d6aa3730845c tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4544 time: 0.0657692 Dec 09 21:33:55.175049 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49358) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:55.203413 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a3336f3c-3e7a-4e2e-89a7-cf49e8e14106 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "GET /v2.0/ports?device_id=5f2119e0-1a75-40a2-a420-84f362d52869 HTTP/1.1" status: 200 len: 205 time: 0.0304658 Dec 09 21:33:55.205289 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49360) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:55.226291 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6847075d-238a-4cba-95ae-1cc81f76b751 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:55.248390 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6847075d-238a-4cba-95ae-1cc81f76b751 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:55.294455 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6847075d-238a-4cba-95ae-1cc81f76b751 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:55.298192 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6847075d-238a-4cba-95ae-1cc81f76b751 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:55.301869 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6847075d-238a-4cba-95ae-1cc81f76b751 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "DELETE /v2.0/security-groups/ba8bb406-faec-41d9-8db7-c95f6fd5ee6c HTTP/1.1" status: 204 len: 168 time: 0.1235440 Dec 09 21:33:55.303235 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49364) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:55.322236 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d640e8dd-9832-4ced-89c8-3f40926fd164 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:55.322729 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6847075d-238a-4cba-95ae-1cc81f76b751 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ba8bb406-faec-41d9-8db7-c95f6fd5ee6c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:55.364122 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-89ac4d53-47cd-43e7-ad72-09686e551d53 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0552514 Dec 09 21:33:55.364835 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49366) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:55.369418 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a2cb8a86-a89e-4779-835a-02523bef9a23 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group': {'name': 'tempest-secgroup--547567530'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:55.394583 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a2cb8a86-a89e-4779-835a-02523bef9a23 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:55.464291 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d640e8dd-9832-4ced-89c8-3f40926fd164 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:55.573003 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a2cb8a86-a89e-4779-835a-02523bef9a23 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:55.574847 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfd10c02-d34a-4b17-b6e2-7b8d8b062cd9 req-b91345eb-4606-4cd0-a2c9-ca9a7f3942b4 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=a5d6b08b-3aad-419a-9ec3-3d21a5bfac11 HTTP/1.1" status: 200 len: 210 time: 0.0374179 Dec 09 21:33:55.592240 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a2cb8a86-a89e-4779-835a-02523bef9a23 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:55.612913 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-d640e8dd-9832-4ced-89c8-3f40926fd164 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Deleting port 80b417c0-0e85-4d33-8f72-f04cb1a2ccf2 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:55.615852 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d640e8dd-9832-4ced-89c8-3f40926fd164 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:55.680046 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a2cb8a86-a89e-4779-835a-02523bef9a23 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:55.683870 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a2cb8a86-a89e-4779-835a-02523bef9a23 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.3155246 Dec 09 21:33:55.685989 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49382) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:55.711536 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-afddd506-065e-40d3-bfef-aea71104dc19 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Request body: {'security_group': {'name': 'default'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:55.712218 n-d-713301-27 neutron-server[103438]: WARNING neutron.api.v2.base [None req-afddd506-065e-40d3-bfef-aea71104dc19 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Dec 09 21:33:55.712901 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-afddd506-065e-40d3-bfef-aea71104dc19 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] update failed (client error): There was a conflict when trying to complete your request. Dec 09 21:33:55.716949 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-afddd506-065e-40d3-bfef-aea71104dc19 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "PUT /v2.0/security-groups/838a5774-7d54-4850-b8b5-ee9ec7d5851b HTTP/1.1" status: 409 len: 330 time: 0.0087881 Dec 09 21:33:55.720088 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49384) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:55.775956 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2cb8a86-a89e-4779-835a-02523bef9a23 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Pushing event updated for resources: {'SecurityGroup': ['ID=838a5774-7d54-4850-b8b5-ee9ec7d5851b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:55.787943 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-69c0369b-c60c-4222-9786-f666bb340530 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:55.790963 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-69c0369b-c60c-4222-9786-f666bb340530 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.10 "GET /v2.0/networks?id=88af5e51-6d1a-432d-8676-517f449774a3 HTTP/1.1" status: 200 len: 812 time: 0.3473907 Dec 09 21:33:55.808532 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-ce18c055-1081-4baf-b9b7-256426d013d1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Request body: {'port': {'device_id': 'a5d6b08b-3aad-419a-9ec3-3d21a5bfac11', 'network_id': '88af5e51-6d1a-432d-8676-517f449774a3', 'admin_state_up': True, 'tenant_id': 'b65669b5d4924ee090e9583aa839a399'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:55.824052 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d5fcd2d-c701-40bd-b76d-d0403a09cd87 req-a19a088b-af3d-41b7-9bd5-a7669c84f414 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:55.824052 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7d5fcd2d-c701-40bd-b76d-d0403a09cd87 req-a19a088b-af3d-41b7-9bd5-a7669c84f414 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 945 time: 0.1748438 Dec 09 21:33:55.827893 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d640e8dd-9832-4ced-89c8-3f40926fd164 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:55.862258 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-d640e8dd-9832-4ced-89c8-3f40926fd164 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Calling delete_port for 80b417c0-0e85-4d33-8f72-f04cb1a2ccf2 owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:33:55.939301 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6e2ba2c7-9abc-42a8-9eef-3e3d7d18a29e tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:55.939632 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-ce18c055-1081-4baf-b9b7-256426d013d1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Made reservation on behalf of b65669b5d4924ee090e9583aa839a399 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:33:55.943055 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-ce18c055-1081-4baf-b9b7-256426d013d1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:55.948225 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7d5fcd2d-c701-40bd-b76d-d0403a09cd87 req-ce94809e-ec92-4ff0-84b6-4d4b685ee61c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1177509 Dec 09 21:33:55.972823 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6e2ba2c7-9abc-42a8-9eef-3e3d7d18a29e tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:56.057921 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6e2ba2c7-9abc-42a8-9eef-3e3d7d18a29e tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:56.061394 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6e2ba2c7-9abc-42a8-9eef-3e3d7d18a29e tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:56.062770 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6e2ba2c7-9abc-42a8-9eef-3e3d7d18a29e tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "DELETE /v2.0/security-groups/838a5774-7d54-4850-b8b5-ee9ec7d5851b HTTP/1.1" status: 204 len: 168 time: 0.3373320 Dec 09 21:33:56.065951 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49388) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:56.076670 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e2ba2c7-9abc-42a8-9eef-3e3d7d18a29e tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=838a5774-7d54-4850-b8b5-ee9ec7d5851b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:56.100245 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-ce18c055-1081-4baf-b9b7-256426d013d1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Allocated IP 172.20.0.10 (88af5e51-6d1a-432d-8676-517f449774a3/4700ee88-1952-42ab-9242-d93b9f07f2be/ead67a5d-6122-4a97-abb6-aebbb4de0c1c) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:33:56.126776 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d640e8dd-9832-4ced-89c8-3f40926fd164 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:56.141120 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-562fc98d-c692-4283-9944-d2d636657efb tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0738726 Dec 09 21:33:56.147076 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49390) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:56.155101 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d640e8dd-9832-4ced-89c8-3f40926fd164 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Pushing event deleted for resources: {'Port': ['ID=80b417c0-0e85-4d33-8f72-f04cb1a2ccf2,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:56.168569 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-075583d3-5ef9-4862-b967-a648b5ff47be None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:33:56.179057 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-7d1fdcaa-fb5e-4d66-a77a-2ccff35eb871 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] delete failed (client error): The resource could not be found. Dec 09 21:33:56.184772 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7d1fdcaa-fb5e-4d66-a77a-2ccff35eb871 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "DELETE /v2.0/security-groups/dcf7e241-4df4-45f2-9032-db0951c910c6 HTTP/1.1" status: 404 len: 347 time: 0.0321176 Dec 09 21:33:56.184772 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49392) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:56.208024 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-633da143-0c50-4ecb-a5ac-8d67c70ce8e3 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] show failed (client error): The resource could not be found. Dec 09 21:33:56.214177 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-633da143-0c50-4ecb-a5ac-8d67c70ce8e3 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "GET /v2.0/security-groups/217c7e48-1dbe-4507-982d-0cb3532c982d HTTP/1.1" status: 404 len: 347 time: 0.0240049 Dec 09 21:33:56.217051 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49394) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:56.239938 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-75157deb-9948-404e-9e40-8af9e3945149 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] show failed (client error): The resource could not be found. Dec 09 21:33:56.245191 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-75157deb-9948-404e-9e40-8af9e3945149 tempest-NegativeSecGroupTest-347239310 tempest-NegativeSecGroupTest-347239310-project] 10.222.0.13 "GET /v2.0/security-group-rules/c5285589-0a16-4df4-8ff7-33a75bc32d0f HTTP/1.1" status: 404 len: 356 time: 0.0211744 Dec 09 21:33:56.245191 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d640e8dd-9832-4ced-89c8-3f40926fd164 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:56.347488 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-ce18c055-1081-4baf-b9b7-256426d013d1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:56.357081 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d640e8dd-9832-4ced-89c8-3f40926fd164 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:56.359511 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d640e8dd-9832-4ced-89c8-3f40926fd164 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:56.417820 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-ce18c055-1081-4baf-b9b7-256426d013d1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:56.433939 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['1e54159e-3c83-49a1-a5b5-3e2b29336c43'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:33:56.453202 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d640e8dd-9832-4ced-89c8-3f40926fd164 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:56.454010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d640e8dd-9832-4ced-89c8-3f40926fd164 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Fanout notify agent at l3_agent the message router_deleted on router 5f2119e0-1a75-40a2-a420-84f362d52869 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:33:56.470770 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d640e8dd-9832-4ced-89c8-3f40926fd164 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:56.478211 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d640e8dd-9832-4ced-89c8-3f40926fd164 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "DELETE /v2.0/routers/5f2119e0-1a75-40a2-a420-84f362d52869 HTTP/1.1" status: 204 len: 168 time: 1.2657354 Dec 09 21:33:56.478211 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49400) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:56.484346 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a16ba552-b57c-4039-a5fb-e3f9b7457244 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Request body: {'router': {'name': 'tempest-RoutersAdminTest-router-44001661', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}, 'admin_state_up': False}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:56.487786 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-ce18c055-1081-4baf-b9b7-256426d013d1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Network 88af5e51-6d1a-432d-8676-517f449774a3 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:33:56.493337 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-ce18c055-1081-4baf-b9b7-256426d013d1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:56.498313 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-ce18c055-1081-4baf-b9b7-256426d013d1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:33:56.502515 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce18c055-1081-4baf-b9b7-256426d013d1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Pushing event updated for resources: {'Port': ['ID=ead67a5d-6122-4a97-abb6-aebbb4de0c1c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:56.527172 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a16ba552-b57c-4039-a5fb-e3f9b7457244 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:56.528974 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a16ba552-b57c-4039-a5fb-e3f9b7457244 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:56.573805 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-ce18c055-1081-4baf-b9b7-256426d013d1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:56.579938 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-ce18c055-1081-4baf-b9b7-256426d013d1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:56.591534 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49404) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:56.609660 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a16ba552-b57c-4039-a5fb-e3f9b7457244 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:56.618686 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-ce18c055-1081-4baf-b9b7-256426d013d1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8179212 Dec 09 21:33:56.633841 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-39787c32-0842-44a1-812c-d0820ca12fb3 service neutron] Request body: {'port': {'device_id': 'a5d6b08b-3aad-419a-9ec3-3d21a5bfac11', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:56.732418 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-39787c32-0842-44a1-812c-d0820ca12fb3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:56.861217 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a16ba552-b57c-4039-a5fb-e3f9b7457244 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:56.879723 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-06d0181c-9da2-4f72-89d2-709594da023e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=286e5890c24742d79ccff8293d923026&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2874734 Dec 09 21:33:56.881867 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49416) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:56.905067 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66e30d7c-ebd6-479a-9b8a-c9e40ce11845 req-8afa2555-e432-4d25-9446-ddd9ca9c180c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:56.907768 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66e30d7c-ebd6-479a-9b8a-c9e40ce11845 req-8afa2555-e432-4d25-9446-ddd9ca9c180c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=a5d6b08b-3aad-419a-9ec3-3d21a5bfac11 HTTP/1.1" status: 200 len: 932 time: 0.1716704 Dec 09 21:33:56.985574 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-89940a7f-1486-42b4-9372-9bb3bad713ac admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:56.988413 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66e30d7c-ebd6-479a-9b8a-c9e40ce11845 req-1e4f99cc-c06e-4e41-b349-f764f38a6396 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0680623 Dec 09 21:33:57.007711 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-89940a7f-1486-42b4-9372-9bb3bad713ac admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:57.081362 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-89940a7f-1486-42b4-9372-9bb3bad713ac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:57.084124 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-89940a7f-1486-42b4-9372-9bb3bad713ac admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:57.088657 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-89940a7f-1486-42b4-9372-9bb3bad713ac admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/8db77c7d-cb1d-4abc-8e30-b36d19876b4c HTTP/1.1" status: 204 len: 168 time: 0.2025313 Dec 09 21:33:57.100463 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89940a7f-1486-42b4-9372-9bb3bad713ac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8db77c7d-cb1d-4abc-8e30-b36d19876b4c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:57.232641 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-39787c32-0842-44a1-812c-d0820ca12fb3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ead67a5d-6122-4a97-abb6-aebbb4de0c1c {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:33:57.244421 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-39787c32-0842-44a1-812c-d0820ca12fb3 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:57.252470 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:57.260316 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-39787c32-0842-44a1-812c-d0820ca12fb3 service neutron] Transition to ACTIVE for port object ead67a5d-6122-4a97-abb6-aebbb4de0c1c will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:33:57.265177 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:57.266059 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-39787c32-0842-44a1-812c-d0820ca12fb3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:57.377473 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39787c32-0842-44a1-812c-d0820ca12fb3 service neutron] Pushing event updated for resources: {'Port': ['ID=ead67a5d-6122-4a97-abb6-aebbb4de0c1c,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:57.439396 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-39787c32-0842-44a1-812c-d0820ca12fb3 service neutron] Attempting to bind port ead67a5d-6122-4a97-abb6-aebbb4de0c1c on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:33:57.439396 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-39787c32-0842-44a1-812c-d0820ca12fb3 service neutron] Attempting to bind port ead67a5d-6122-4a97-abb6-aebbb4de0c1c by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'dcec1a9e-3140-49cf-a664-3f1f0937898f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '88af5e51-6d1a-432d-8676-517f449774a3'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:33:57.439755 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-39787c32-0842-44a1-812c-d0820ca12fb3 service neutron] Attempting to bind port ead67a5d-6122-4a97-abb6-aebbb4de0c1c on network 88af5e51-6d1a-432d-8676-517f449774a3 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:33:57.444392 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-39787c32-0842-44a1-812c-d0820ca12fb3 service neutron] Port ead67a5d-6122-4a97-abb6-aebbb4de0c1c on network 88af5e51-6d1a-432d-8676-517f449774a3 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:33:57.444834 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-39787c32-0842-44a1-812c-d0820ca12fb3 service neutron] Attempting to bind port ead67a5d-6122-4a97-abb6-aebbb4de0c1c on network 88af5e51-6d1a-432d-8676-517f449774a3 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:33:57.451671 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-39787c32-0842-44a1-812c-d0820ca12fb3 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 33, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:33:57.451671 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-39787c32-0842-44a1-812c-d0820ca12fb3 service neutron] Checking segment: {'id': 'dcec1a9e-3140-49cf-a664-3f1f0937898f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '88af5e51-6d1a-432d-8676-517f449774a3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:33:57.452261 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-39787c32-0842-44a1-812c-d0820ca12fb3 service neutron] Bound using segment: {'id': 'dcec1a9e-3140-49cf-a664-3f1f0937898f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '88af5e51-6d1a-432d-8676-517f449774a3'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:33:57.452937 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-39787c32-0842-44a1-812c-d0820ca12fb3 service neutron] Bound port: ead67a5d-6122-4a97-abb6-aebbb4de0c1c, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dcec1a9e-3140-49cf-a664-3f1f0937898f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '88af5e51-6d1a-432d-8676-517f449774a3'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:33:57.453394 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-39787c32-0842-44a1-812c-d0820ca12fb3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:57.467364 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3b62293-2507-4108-b1c9-90a3644d59b4 req-295c0a42-64f8-4be5-9ead-2cbb2a66871b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:57.474773 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a3b62293-2507-4108-b1c9-90a3644d59b4 req-295c0a42-64f8-4be5-9ead-2cbb2a66871b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 945 time: 0.1219983 Dec 09 21:33:57.550095 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-39787c32-0842-44a1-812c-d0820ca12fb3 service neutron] For port ead67a5d-6122-4a97-abb6-aebbb4de0c1c, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:33:57.555421 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-39787c32-0842-44a1-812c-d0820ca12fb3 service neutron] For port ead67a5d-6122-4a97-abb6-aebbb4de0c1c, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=ead67a5d-6122-4a97-abb6-aebbb4de0c1c,segment=NetworkSegment(dcec1a9e-3140-49cf-a664-3f1f0937898f),segment_id=dcec1a9e-3140-49cf-a664-3f1f0937898f)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:33:57.563609 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-39787c32-0842-44a1-812c-d0820ca12fb3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:57.618110 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-39787c32-0842-44a1-812c-d0820ca12fb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:57.618827 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-39787c32-0842-44a1-812c-d0820ca12fb3 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:57.620334 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-39787c32-0842-44a1-812c-d0820ca12fb3 service neutron] 10.222.0.10 "PUT /v2.0/ports/ead67a5d-6122-4a97-abb6-aebbb4de0c1c HTTP/1.1" status: 200 len: 1093 time: 0.9913704 Dec 09 21:33:57.620849 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a5d6b08b-3aad-419a-9ec3-3d21a5bfac11', 'tag': 'ead67a5d-6122-4a97-abb6-aebbb4de0c1c'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:33:57.624455 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-926fa895-20ac-4195-891b-5a52d125aed6" -d '{"events": [{"name": "network-changed", "server_uuid": "a5d6b08b-3aad-419a-9ec3-3d21a5bfac11", "tag": "ead67a5d-6122-4a97-abb6-aebbb4de0c1c"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:33:57.652151 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39787c32-0842-44a1-812c-d0820ca12fb3 service neutron] Pushing event updated for resources: {'Port': ['ID=ead67a5d-6122-4a97-abb6-aebbb4de0c1c,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:57.688227 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a16ba552-b57c-4039-a5fb-e3f9b7457244 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:57.716053 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:33:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6a2fe807-6f38-4fb8-b6a0-afbd7313f933 x-openstack-request-id: req-6a2fe807-6f38-4fb8-b6a0-afbd7313f933 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:33:57.716350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a3b62293-2507-4108-b1c9-90a3644d59b4 req-219d2f99-049f-4328-b749-7c83ddfddfb9 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2406223 Dec 09 21:33:57.716460 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a5d6b08b-3aad-419a-9ec3-3d21a5bfac11", "tag": "ead67a5d-6122-4a97-abb6-aebbb4de0c1c", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:33:57.716723 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-6a2fe807-6f38-4fb8-b6a0-afbd7313f933 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:33:57.717319 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a5d6b08b-3aad-419a-9ec3-3d21a5bfac11', 'tag': 'ead67a5d-6122-4a97-abb6-aebbb4de0c1c', 'status': 'completed', 'code': 200} Dec 09 21:33:57.717441 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a16ba552-b57c-4039-a5fb-e3f9b7457244 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:57.739913 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-afbf8c43-709a-4028-b286-00a145d24f8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:57.741747 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-afbf8c43-709a-4028-b286-00a145d24f8e service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=b65669b5d4924ee090e9583aa839a399&device_id=a5d6b08b-3aad-419a-9ec3-3d21a5bfac11 HTTP/1.1" status: 200 len: 1096 time: 0.0635180 Dec 09 21:33:57.792112 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-9e585bca-1dc3-489b-838f-7f2e2ac9e702 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=ead67a5d-6122-4a97-abb6-aebbb4de0c1c HTTP/1.1" status: 200 len: 217 time: 0.0411177 Dec 09 21:33:57.863521 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-f5524d60-1832-4b66-a6cb-f3dbf4df1dd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:57.865401 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-f5524d60-1832-4b66-a6cb-f3dbf4df1dd0 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=4700ee88-1952-42ab-9242-d93b9f07f2be HTTP/1.1" status: 200 len: 852 time: 0.0650561 Dec 09 21:33:57.925082 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-a16ba552-b57c-4039-a5fb-e3f9b7457244 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Allocated IP 172.25.3.13 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/a0c66ba1-bf6c-48ca-932c-c44ea0ddf9c6) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:33:57.950099 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-ddb686ca-0d1a-48e9-bda5-c51db9d2346a service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=88af5e51-6d1a-432d-8676-517f449774a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0647106 Dec 09 21:33:58.083286 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-a8c5bbcd-5e8e-4a96-9276-886165d626b0 service neutron] 10.222.0.10 "GET /v2.0/networks/88af5e51-6d1a-432d-8676-517f449774a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1245406 Dec 09 21:33:58.112624 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a16ba552-b57c-4039-a5fb-e3f9b7457244 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:58.193150 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bd6a7c2-dcf7-4817-84fe-14495f6399f3 req-012b7adf-5ed2-4e88-927a-8ba7ff462587 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:58.194691 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3bd6a7c2-dcf7-4817-84fe-14495f6399f3 req-012b7adf-5ed2-4e88-927a-8ba7ff462587 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=a5d6b08b-3aad-419a-9ec3-3d21a5bfac11 HTTP/1.1" status: 200 len: 944 time: 0.0809693 Dec 09 21:33:58.205811 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b54f9975-8a3e-448a-b7af-a7c905bf2763 req-95019379-cff8-490d-94c0-b5ec1cb52395 service neutron] 10.222.0.10 "GET /v2.0/networks/88af5e51-6d1a-432d-8676-517f449774a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1142993 Dec 09 21:33:58.210059 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a16ba552-b57c-4039-a5fb-e3f9b7457244 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:58.282017 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a16ba552-b57c-4039-a5fb-e3f9b7457244 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:33:58.286385 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-a16ba552-b57c-4039-a5fb-e3f9b7457244 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:33:58.290221 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a16ba552-b57c-4039-a5fb-e3f9b7457244 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:33:58.303337 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-926fa895-20ac-4195-891b-5a52d125aed6 req-40a3b6b1-f371-44c7-901a-74dadb8d04a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:58.304896 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-926fa895-20ac-4195-891b-5a52d125aed6 req-40a3b6b1-f371-44c7-901a-74dadb8d04a9 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=b65669b5d4924ee090e9583aa839a399&device_id=a5d6b08b-3aad-419a-9ec3-3d21a5bfac11 HTTP/1.1" status: 200 len: 1096 time: 0.0502739 Dec 09 21:33:58.305848 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-622e6d36-18f2-4777-b4f3-dc3fe422d6ba None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:33:58.361199 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-0c926868-4cea-4f1c-ae3c-7b46dd7573f0 None None] Provisioning complete for port a0c66ba1-bf6c-48ca-932c-c44ea0ddf9c6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:33:58.361923 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0c926868-4cea-4f1c-ae3c-7b46dd7573f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:58.378181 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a16ba552-b57c-4039-a5fb-e3f9b7457244 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Pushing event updated for resources: {'Port': ['ID=a0c66ba1-bf6c-48ca-932c-c44ea0ddf9c6,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:33:58.403282 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3bd6a7c2-dcf7-4817-84fe-14495f6399f3 req-6c64e786-80f7-4c6f-9c46-6d331cd325a3 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2011790 Dec 09 21:33:58.407277 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-0c926868-4cea-4f1c-ae3c-7b46dd7573f0 None None] Port a0c66ba1-bf6c-48ca-932c-c44ea0ddf9c6 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:33:58.441106 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-926fa895-20ac-4195-891b-5a52d125aed6 req-84469150-c1cf-427a-a1d3-c86089af26ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:58.442997 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-926fa895-20ac-4195-891b-5a52d125aed6 req-84469150-c1cf-427a-a1d3-c86089af26ba service neutron] 10.222.0.10 "GET /v2.0/networks?id=88af5e51-6d1a-432d-8676-517f449774a3 HTTP/1.1" status: 200 len: 913 time: 0.1277928 Dec 09 21:33:58.502652 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-926fa895-20ac-4195-891b-5a52d125aed6 req-8eb9d27d-d1ad-49af-ae66-ca4050a5e22c service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=ead67a5d-6122-4a97-abb6-aebbb4de0c1c HTTP/1.1" status: 200 len: 217 time: 0.0508938 Dec 09 21:33:58.576666 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-926fa895-20ac-4195-891b-5a52d125aed6 req-a30fbd6c-fa5b-4b44-a2bf-de5d90a68099 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:58.578396 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-926fa895-20ac-4195-891b-5a52d125aed6 req-a30fbd6c-fa5b-4b44-a2bf-de5d90a68099 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=4700ee88-1952-42ab-9242-d93b9f07f2be HTTP/1.1" status: 200 len: 852 time: 0.0682979 Dec 09 21:33:58.624923 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-926fa895-20ac-4195-891b-5a52d125aed6 req-e34a5d51-fc16-48ac-8b0b-193c7160076c service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=88af5e51-6d1a-432d-8676-517f449774a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0367095 Dec 09 21:33:58.691800 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a16ba552-b57c-4039-a5fb-e3f9b7457244 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:58.735313 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-926fa895-20ac-4195-891b-5a52d125aed6 req-6a09adec-e226-4ef6-b501-52d74cbb54c9 service neutron] 10.222.0.10 "GET /v2.0/networks/88af5e51-6d1a-432d-8676-517f449774a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1010242 Dec 09 21:33:59.056061 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a16ba552-b57c-4039-a5fb-e3f9b7457244 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:59.085032 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e2b8689-1074-447f-a48c-fe58a4c7f3b4 req-311f897f-2d6e-45ed-a770-ee09ef37069a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:59.092809 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e2b8689-1074-447f-a48c-fe58a4c7f3b4 req-311f897f-2d6e-45ed-a770-ee09ef37069a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 945 time: 0.2311304 Dec 09 21:33:59.234703 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-926fa895-20ac-4195-891b-5a52d125aed6 req-b324a786-2b78-43de-9b06-e40fabf14f66 service neutron] 10.222.0.10 "GET /v2.0/networks/88af5e51-6d1a-432d-8676-517f449774a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4903133 Dec 09 21:33:59.236024 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e2b8689-1074-447f-a48c-fe58a4c7f3b4 req-dc64654f-7668-4d86-8191-cb03a45e62c8 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1394451 Dec 09 21:33:59.338885 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a16ba552-b57c-4039-a5fb-e3f9b7457244 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Router 633a2277-d6ce-4d40-837e-e9d58bd8d35d is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:33:59.456947 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a16ba552-b57c-4039-a5fb-e3f9b7457244 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:33:59.470286 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0462f24-2ff5-4b33-8672-7ff37aea42c9 None None] Sync routers for ids ['633a2277-d6ce-4d40-837e-e9d58bd8d35d'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:33:59.485976 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0462f24-2ff5-4b33-8672-7ff37aea42c9 None None] Routers {'633a2277-d6ce-4d40-837e-e9d58bd8d35d'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:59.486879 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a0462f24-2ff5-4b33-8672-7ff37aea42c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['633a2277-d6ce-4d40-837e-e9d58bd8d35d'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:59.511770 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a16ba552-b57c-4039-a5fb-e3f9b7457244 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:59.516124 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49498) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:33:59.519590 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a16ba552-b57c-4039-a5fb-e3f9b7457244 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 882 time: 3.0420845 Dec 09 21:33:59.521496 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-6767dbf5-0e5f-4247-b381-8d3980b75dfc tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Request body: {'router': {'external_gateway_info': {}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:33:59.525823 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a0462f24-2ff5-4b33-8672-7ff37aea42c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:59.536317 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0462f24-2ff5-4b33-8672-7ff37aea42c9 None None] Routers {'633a2277-d6ce-4d40-837e-e9d58bd8d35d'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:33:59.537301 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a0462f24-2ff5-4b33-8672-7ff37aea42c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['633a2277-d6ce-4d40-837e-e9d58bd8d35d'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:59.545218 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2ebada2-aeae-492c-8de6-9422ed534005 req-7ab87af4-719a-47b8-ba6b-a373a2932e9f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:33:59.547018 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d2ebada2-aeae-492c-8de6-9422ed534005 req-7ab87af4-719a-47b8-ba6b-a373a2932e9f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=a5d6b08b-3aad-419a-9ec3-3d21a5bfac11 HTTP/1.1" status: 200 len: 944 time: 0.0683811 Dec 09 21:33:59.573164 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a0462f24-2ff5-4b33-8672-7ff37aea42c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:33:59.574069 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0462f24-2ff5-4b33-8672-7ff37aea42c9 None None] The sync data for ids ['633a2277-d6ce-4d40-837e-e9d58bd8d35d'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:33:59.636496 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d2ebada2-aeae-492c-8de6-9422ed534005 req-309c595a-eea1-40f0-a2ac-caf310a87f53 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0819192 Dec 09 21:33:59.919705 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6767dbf5-0e5f-4247-b381-8d3980b75dfc tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:59.932181 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6767dbf5-0e5f-4247-b381-8d3980b75dfc tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:33:59.990584 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-6767dbf5-0e5f-4247-b381-8d3980b75dfc tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Deleting port a0c66ba1-bf6c-48ca-932c-c44ea0ddf9c6 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:33:59.990934 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6767dbf5-0e5f-4247-b381-8d3980b75dfc tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:00.073901 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6767dbf5-0e5f-4247-b381-8d3980b75dfc tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:00.089890 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-6767dbf5-0e5f-4247-b381-8d3980b75dfc tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Calling delete_port for a0c66ba1-bf6c-48ca-932c-c44ea0ddf9c6 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:34:00.371128 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6767dbf5-0e5f-4247-b381-8d3980b75dfc tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:00.387887 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e3cfab6-3762-4351-a419-6167599f3da7 req-ac4e484e-b53c-44df-ba98-2f90c4c1f9df tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:00.390422 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e3cfab6-3762-4351-a419-6167599f3da7 req-ac4e484e-b53c-44df-ba98-2f90c4c1f9df tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 945 time: 0.0609660 Dec 09 21:34:00.414075 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6767dbf5-0e5f-4247-b381-8d3980b75dfc tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Pushing event deleted for resources: {'Port': ['ID=a0c66ba1-bf6c-48ca-932c-c44ea0ddf9c6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:00.431282 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ee87ee2-ec05-41d6-9653-c99f50571baf None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:34:00.471979 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e3cfab6-3762-4351-a419-6167599f3da7 req-6fb65e8e-50cc-4eed-ba3a-61b712f330e8 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0750594 Dec 09 21:34:00.496695 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6767dbf5-0e5f-4247-b381-8d3980b75dfc tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:00.695168 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b88eab8d-4c11-43e6-9183-773d277b804a req-2fedbdfa-b818-4ba9-831f-fd11e99b48b6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:00.697442 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b88eab8d-4c11-43e6-9183-773d277b804a req-2fedbdfa-b818-4ba9-831f-fd11e99b48b6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0590608 Dec 09 21:34:00.750503 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6767dbf5-0e5f-4247-b381-8d3980b75dfc tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:00.754409 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6767dbf5-0e5f-4247-b381-8d3980b75dfc tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-640457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-640448', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-635166'] for router, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:00.775348 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device ead67a5d-6122-4a97-abb6-aebbb4de0c1c details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:34:00.821356 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b88eab8d-4c11-43e6-9183-773d277b804a req-818f1598-b4e6-4e3c-96ac-d1c04c5ec6ea tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1153822 Dec 09 21:34:00.869011 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5a88694-2bf6-4a76-a236-f88a79432c32 req-f82532b2-ba74-410a-9ef7-f85e7a51070c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:00.877197 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5a88694-2bf6-4a76-a236-f88a79432c32 req-f82532b2-ba74-410a-9ef7-f85e7a51070c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=a5d6b08b-3aad-419a-9ec3-3d21a5bfac11 HTTP/1.1" status: 200 len: 944 time: 0.1126308 Dec 09 21:34:00.931069 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port ead67a5d-6122-4a97-abb6-aebbb4de0c1c, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=ead67a5d-6122-4a97-abb6-aebbb4de0c1c,segment=NetworkSegment(dcec1a9e-3140-49cf-a664-3f1f0937898f),segment_id=dcec1a9e-3140-49cf-a664-3f1f0937898f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:34:00.949118 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6767dbf5-0e5f-4247-b381-8d3980b75dfc tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Router 633a2277-d6ce-4d40-837e-e9d58bd8d35d has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:34:00.953947 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'ead67a5d-6122-4a97-abb6-aebbb4de0c1c', 'network_id': '88af5e51-6d1a-432d-8676-517f449774a3', 'port_id': 'ead67a5d-6122-4a97-abb6-aebbb4de0c1c', 'mac_address': 'fa:16:3e:53:8b:a2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 107, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4700ee88-1952-42ab-9242-d93b9f07f2be', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:34:00.959097 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5a88694-2bf6-4a76-a236-f88a79432c32 req-7f4d96d2-7e6a-4e3e-a54e-1d353ee37a1e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0810180 Dec 09 21:34:01.036202 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:01.061455 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ead67a5d-6122-4a97-abb6-aebbb4de0c1c {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:34:01.064183 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8365b1f7-6557-4a07-a16a-b9a3ff852e3b req-a62a33ae-84f4-490d-b33c-58b9d7029211 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:01.065962 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8365b1f7-6557-4a07-a16a-b9a3ff852e3b req-a62a33ae-84f4-490d-b33c-58b9d7029211 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0556989 Dec 09 21:34:01.079117 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6767dbf5-0e5f-4247-b381-8d3980b75dfc tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:34:01.088185 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6767dbf5-0e5f-4247-b381-8d3980b75dfc tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:01.089366 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6767dbf5-0e5f-4247-b381-8d3980b75dfc tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "PUT /v2.0/routers/633a2277-d6ce-4d40-837e-e9d58bd8d35d HTTP/1.1" status: 200 len: 704 time: 1.5719373 Dec 09 21:34:01.092091 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81c1763f-6f3e-455d-81a1-bf890783eb96 None None] Sync routers for ids ['633a2277-d6ce-4d40-837e-e9d58bd8d35d'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:34:01.092859 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49598) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:01.109670 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81c1763f-6f3e-455d-81a1-bf890783eb96 None None] Routers {'633a2277-d6ce-4d40-837e-e9d58bd8d35d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:34:01.110296 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-81c1763f-6f3e-455d-81a1-bf890783eb96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['633a2277-d6ce-4d40-837e-e9d58bd8d35d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:01.124066 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port ead67a5d-6122-4a97-abb6-aebbb4de0c1c, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=ead67a5d-6122-4a97-abb6-aebbb4de0c1c,segment=NetworkSegment(dcec1a9e-3140-49cf-a664-3f1f0937898f),segment_id=dcec1a9e-3140-49cf-a664-3f1f0937898f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:34:01.132951 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:01.182221 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-81c1763f-6f3e-455d-81a1-bf890783eb96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:01.195850 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-170456ea-d44d-4486-8134-890fcef3cd05 tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "GET /v2.0/routers/633a2277-d6ce-4d40-837e-e9d58bd8d35d HTTP/1.1" status: 200 len: 739 time: 0.0993328 Dec 09 21:34:01.196641 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81c1763f-6f3e-455d-81a1-bf890783eb96 None None] Routers {'633a2277-d6ce-4d40-837e-e9d58bd8d35d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:34:01.197365 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49602) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:01.201683 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-81c1763f-6f3e-455d-81a1-bf890783eb96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 10, "log_agent_heartbeats": false, "routers": 10},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:33:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['633a2277-d6ce-4d40-837e-e9d58bd8d35d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:01.213817 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8365b1f7-6557-4a07-a16a-b9a3ff852e3b req-8bc774c1-3457-43f7-a4d8-6ca6b4b51bd2 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1401393 Dec 09 21:34:01.228355 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=ead67a5d-6122-4a97-abb6-aebbb4de0c1c,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:01.249936 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-81c1763f-6f3e-455d-81a1-bf890783eb96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:01.250636 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81c1763f-6f3e-455d-81a1-bf890783eb96 None None] The sync data for ids ['633a2277-d6ce-4d40-837e-e9d58bd8d35d'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:34:01.292124 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-35187070-535d-42cc-9d70-e576e915e76a tempest-RoutersAdminTest-159296854 tempest-RoutersAdminTest-159296854-project-admin] 10.222.0.13 "GET /v2.0/ports?network_id=97925a19-460a-4476-8208-41db134b6c83&device_id=633a2277-d6ce-4d40-837e-e9d58bd8d35d HTTP/1.1" status: 200 len: 205 time: 0.0924704 Dec 09 21:34:01.295268 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49608) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:01.337102 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3f8a3ea1-cfcc-44cb-9083-63176d47edb8 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "GET /v2.0/ports?device_id=633a2277-d6ce-4d40-837e-e9d58bd8d35d HTTP/1.1" status: 200 len: 205 time: 0.0373502 Dec 09 21:34:01.337932 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49612) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:01.393313 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49616) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:01.461035 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['ead67a5d-6122-4a97-abb6-aebbb4de0c1c'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:34:01.489853 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d0a8e544-7763-44e4-a219-d682fe379aa5 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:01.536886 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-47f3eb3d-97e0-444f-98e6-d2ea50a9b134 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:01.627997 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-47f3eb3d-97e0-444f-98e6-d2ea50a9b134 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:01.633185 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-47f3eb3d-97e0-444f-98e6-d2ea50a9b134 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:01.678917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47f3eb3d-97e0-444f-98e6-d2ea50a9b134 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2e9f0f9b-e344-4a7a-8037-82b0200bd8c0,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:01.697428 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-47f3eb3d-97e0-444f-98e6-d2ea50a9b134 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=651955b40d2e4cf49256e9e76251dbbc&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3004565 Dec 09 21:34:01.697616 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49630) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:01.747970 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d0a8e544-7763-44e4-a219-d682fe379aa5 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:01.751920 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d0a8e544-7763-44e4-a219-d682fe379aa5 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:01.761237 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b46bb8a-c15c-4ff1-9ebf-5f87def17a8f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:01.789563 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b46bb8a-c15c-4ff1-9ebf-5f87def17a8f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:01.816759 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-553fe2c1-5c05-40e1-ad32-b912fe35680e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:01.823389 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-553fe2c1-5c05-40e1-ad32-b912fe35680e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 812 time: 0.2855294 Dec 09 21:34:01.826961 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d0a8e544-7763-44e4-a219-d682fe379aa5 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:01.827762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d0a8e544-7763-44e4-a219-d682fe379aa5 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Fanout notify agent at l3_agent the message router_deleted on router 633a2277-d6ce-4d40-837e-e9d58bd8d35d {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:34:01.834611 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d0a8e544-7763-44e4-a219-d682fe379aa5 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:01.835791 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d0a8e544-7763-44e4-a219-d682fe379aa5 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "DELETE /v2.0/routers/633a2277-d6ce-4d40-837e-e9d58bd8d35d HTTP/1.1" status: 204 len: 168 time: 0.4973333 Dec 09 21:34:01.845054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49632) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:01.861154 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b46bb8a-c15c-4ff1-9ebf-5f87def17a8f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:01.864543 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b46bb8a-c15c-4ff1-9ebf-5f87def17a8f admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:01.864689 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-866eb312-3e43-47be-b677-6a378a54284b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/quotas/a36a93590a9f45e1b9b3f78753bb8e12 HTTP/1.1" status: 200 len: 375 time: 0.0393002 Dec 09 21:34:01.866156 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5b46bb8a-c15c-4ff1-9ebf-5f87def17a8f admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/2e9f0f9b-e344-4a7a-8037-82b0200bd8c0 HTTP/1.1" status: 204 len: 168 time: 0.1675465 Dec 09 21:34:01.878318 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b46bb8a-c15c-4ff1-9ebf-5f87def17a8f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2e9f0f9b-e344-4a7a-8037-82b0200bd8c0,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:01.890903 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49636) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:01.891814 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6c85b8c5-aa0f-443d-84e3-3ac82cdaf315 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "GET /v2.0/ports?device_id=633a2277-d6ce-4d40-837e-e9d58bd8d35d HTTP/1.1" status: 200 len: 205 time: 0.0459836 Dec 09 21:34:01.944684 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-051a75fc-1128-4b26-b6fc-eea76c39235c tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] delete failed (client error): The resource could not be found. Dec 09 21:34:01.945852 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-051a75fc-1128-4b26-b6fc-eea76c39235c tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "DELETE /v2.0/routers/633a2277-d6ce-4d40-837e-e9d58bd8d35d HTTP/1.1" status: 404 len: 336 time: 0.0533061 Dec 09 21:34:01.948655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49638) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:01.968767 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-5f02051c-fda1-49b1-88b3-48170350bed0 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&fields=id HTTP/1.1" status: 200 len: 394 time: 0.0848300 Dec 09 21:34:02.006828 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d63fc818-185e-4f1e-a683-79f639612b0f tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "GET /v2.0/ports?device_id=5f2119e0-1a75-40a2-a420-84f362d52869 HTTP/1.1" status: 200 len: 205 time: 0.0566494 Dec 09 21:34:02.007481 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49644) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:02.046730 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-c5cebfbe-2383-48b0-97ee-e3a0ccdf1a30 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] delete failed (client error): The resource could not be found. Dec 09 21:34:02.047797 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c5cebfbe-2383-48b0-97ee-e3a0ccdf1a30 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "DELETE /v2.0/routers/5f2119e0-1a75-40a2-a420-84f362d52869 HTTP/1.1" status: 404 len: 336 time: 0.0394087 Dec 09 21:34:02.050377 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49648) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:02.082935 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-587df6be-000b-4b15-ad29-e5cebd994ae8 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "GET /v2.0/ports?device_id=a10fcc1a-935f-4633-87e3-f027af6f6656 HTTP/1.1" status: 200 len: 205 time: 0.0311875 Dec 09 21:34:02.085348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49650) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:02.102193 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-97a3128f-6892-4655-8d1f-4076c317f006 service neutron] 10.222.0.13 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1200645 Dec 09 21:34:02.135215 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-52ead6a3-6f74-40ca-947a-630125d0e3c4 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] delete failed (client error): The resource could not be found. Dec 09 21:34:02.136570 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-52ead6a3-6f74-40ca-947a-630125d0e3c4 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "DELETE /v2.0/routers/a10fcc1a-935f-4633-87e3-f027af6f6656 HTTP/1.1" status: 404 len: 336 time: 0.0502617 Dec 09 21:34:02.139667 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49652) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:02.166954 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6bcc32d8-511f-42ab-a5a3-1da222111a46 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "GET /v2.0/ports?device_id=bacd70e7-15b4-4408-ac76-c0772ac2a7b1 HTTP/1.1" status: 200 len: 205 time: 0.0261374 Dec 09 21:34:02.169595 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49654) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:02.209386 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-2c769c1c-64df-4078-8923-db2320082e1b tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] delete failed (client error): The resource could not be found. Dec 09 21:34:02.210232 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-166aa3ce-0930-4f72-8ed9-21a92083b2f4 req-90b5f1d5-1ebb-417f-ab14-2134c18ffbfd tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:02.210473 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2c769c1c-64df-4078-8923-db2320082e1b tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "DELETE /v2.0/routers/bacd70e7-15b4-4408-ac76-c0772ac2a7b1 HTTP/1.1" status: 404 len: 336 time: 0.0399094 Dec 09 21:34:02.211781 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-166aa3ce-0930-4f72-8ed9-21a92083b2f4 req-90b5f1d5-1ebb-417f-ab14-2134c18ffbfd tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=a5d6b08b-3aad-419a-9ec3-3d21a5bfac11 HTTP/1.1" status: 200 len: 945 time: 0.1122055 Dec 09 21:34:02.213101 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49656) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:02.239759 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1274197b-d103-41f1-b8d6-765a93760be6 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "GET /v2.0/ports?device_id=f481ade3-fe68-44bd-9335-d2f406796da4 HTTP/1.1" status: 200 len: 205 time: 0.0254197 Dec 09 21:34:02.241752 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49658) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:02.242078 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49660) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:02.260007 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-73b71bbc-4e51-4813-b13b-5deede6b766a service neutron] 10.222.0.13 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1482482 Dec 09 21:34:02.285468 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-166aa3ce-0930-4f72-8ed9-21a92083b2f4 req-3d19e4cb-b041-4c0d-b1f2-1f5760931e49 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0626931 Dec 09 21:34:02.294566 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d3a9f1e-db0e-423a-aa3d-d4f555a078f5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:02.296849 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-5c1c7a0a-f954-4e8b-814c-3ae83c67cdab tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] delete failed (client error): The resource could not be found. Dec 09 21:34:02.297939 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5c1c7a0a-f954-4e8b-814c-3ae83c67cdab tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "DELETE /v2.0/routers/f481ade3-fe68-44bd-9335-d2f406796da4 HTTP/1.1" status: 404 len: 336 time: 0.0537722 Dec 09 21:34:02.300816 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49664) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:02.337533 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6813da44-e4ca-4b41-8141-9cd133dd22bc tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "GET /v2.0/ports?device_id=45060f0f-1084-4860-ab91-389234af6c7c HTTP/1.1" status: 200 len: 205 time: 0.0328341 Dec 09 21:34:02.337920 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49668) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:02.383084 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-994e42b1-a766-4b1b-8d72-4f01b786818f tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] delete failed (client error): The resource could not be found. Dec 09 21:34:02.384283 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-994e42b1-a766-4b1b-8d72-4f01b786818f tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "DELETE /v2.0/routers/45060f0f-1084-4860-ab91-389234af6c7c HTTP/1.1" status: 404 len: 336 time: 0.0455863 Dec 09 21:34:02.386931 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49670) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:02.415186 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-f0bd7446-c0c5-49fd-98de-34525c558041 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] DELETE failed (client error): The resource could not be found. Dec 09 21:34:02.415676 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f0bd7446-c0c5-49fd-98de-34525c558041 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:34:02.416627 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d3a9f1e-db0e-423a-aa3d-d4f555a078f5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:02.423022 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d3a9f1e-db0e-423a-aa3d-d4f555a078f5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:02.433169 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f0bd7446-c0c5-49fd-98de-34525c558041 tempest-RoutersAdminTest-871181317 tempest-RoutersAdminTest-871181317-project] 10.222.0.13 "DELETE /v2.0/subnets/d9ca0339-2812-429c-9183-5fd9dd4b1548 HTTP/1.1" status: 404 len: 337 time: 0.0420697 Dec 09 21:34:02.467500 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9d3a9f1e-db0e-423a-aa3d-d4f555a078f5 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=371b1eaaa6b94f12b6130d668d2cd4ce&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2222328 Dec 09 21:34:02.467500 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d3a9f1e-db0e-423a-aa3d-d4f555a078f5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=74aa6807-ba73-4613-be21-ad982186f93f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:02.468736 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49678) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:02.501731 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fd048346-852e-4c0d-a1db-d51553a0f0c8 req-1d1c0c34-d5a7-4baf-a177-ffc117e4c97c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=78dd0620-865a-48a9-adf6-d64588d364fc HTTP/1.1" status: 200 len: 210 time: 0.0562303 Dec 09 21:34:02.554867 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9936c783-4e67-4bd3-aaf7-49421bfcdcf7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:02.589848 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9936c783-4e67-4bd3-aaf7-49421bfcdcf7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:02.651832 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9936c783-4e67-4bd3-aaf7-49421bfcdcf7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:02.655053 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9936c783-4e67-4bd3-aaf7-49421bfcdcf7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:02.656427 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9936c783-4e67-4bd3-aaf7-49421bfcdcf7 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/74aa6807-ba73-4613-be21-ad982186f93f HTTP/1.1" status: 204 len: 168 time: 0.1747999 Dec 09 21:34:02.665634 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9936c783-4e67-4bd3-aaf7-49421bfcdcf7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=74aa6807-ba73-4613-be21-ad982186f93f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:02.816835 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49696) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:02.824265 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device ead67a5d-6122-4a97-abb6-aebbb4de0c1c up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:34:02.874081 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d6acd55-1574-4a73-a66c-8113798c085a req-b8399c89-13cd-44d7-b8df-8896ed88ab0e tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:02.875701 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d6acd55-1574-4a73-a66c-8113798c085a req-b8399c89-13cd-44d7-b8df-8896ed88ab0e tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.0925553 Dec 09 21:34:02.909022 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port ead67a5d-6122-4a97-abb6-aebbb4de0c1c completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:34:02.912676 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port ead67a5d-6122-4a97-abb6-aebbb4de0c1c triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:02.913058 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:02.984534 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d6acd55-1574-4a73-a66c-8113798c085a req-6e7f1ce8-2461-40b8-ab1c-3469e903aa4a tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0943065 Dec 09 21:34:03.010406 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-54339f38-a6b5-4dc3-8542-5e5e4b04ac37 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:03.064903 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:03.100082 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a5d6b08b-3aad-419a-9ec3-3d21a5bfac11', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ead67a5d-6122-4a97-abb6-aebbb4de0c1c'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:34:03.103142 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6a2cc97b-6c83-42f7-9e62-66dd995f0025" -d '{"events": [{"server_uuid": "a5d6b08b-3aad-419a-9ec3-3d21a5bfac11", "name": "network-vif-plugged", "status": "completed", "tag": "ead67a5d-6122-4a97-abb6-aebbb4de0c1c"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:34:03.124871 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port ead67a5d-6122-4a97-abb6-aebbb4de0c1c, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=ead67a5d-6122-4a97-abb6-aebbb4de0c1c,segment=NetworkSegment(dcec1a9e-3140-49cf-a664-3f1f0937898f),segment_id=dcec1a9e-3140-49cf-a664-3f1f0937898f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:34:03.132735 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:03.180574 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-27d6e636-2c24-4be5-b524-048c6f32e52e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:03.224516 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=ead67a5d-6122-4a97-abb6-aebbb4de0c1c,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:03.243494 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:34:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e7c4b66d-cbec-4758-b936-a9c2fceba47b x-openstack-request-id: req-e7c4b66d-cbec-4758-b936-a9c2fceba47b {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:34:03.244163 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a5d6b08b-3aad-419a-9ec3-3d21a5bfac11", "name": "network-vif-plugged", "status": "completed", "tag": "ead67a5d-6122-4a97-abb6-aebbb4de0c1c", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:34:03.244730 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e7c4b66d-cbec-4758-b936-a9c2fceba47b {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:34:03.245574 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a5d6b08b-3aad-419a-9ec3-3d21a5bfac11', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ead67a5d-6122-4a97-abb6-aebbb4de0c1c', 'code': 200} Dec 09 21:34:03.281406 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-27d6e636-2c24-4be5-b524-048c6f32e52e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:03.285298 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-27d6e636-2c24-4be5-b524-048c6f32e52e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:03.353858 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-27d6e636-2c24-4be5-b524-048c6f32e52e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=11b992c3617641369639f03efa25de1d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5357645 Dec 09 21:34:03.355874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27d6e636-2c24-4be5-b524-048c6f32e52e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e32ff605-aef7-4315-ab9c-4e9980447d25,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:03.356967 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49708) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:03.373244 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df8bf8c5-61d8-4532-933c-7995e870ff73 req-dd0163e2-2808-4520-8c4e-7aee0270aa58 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:03.375051 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df8bf8c5-61d8-4532-933c-7995e870ff73 req-dd0163e2-2808-4520-8c4e-7aee0270aa58 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=a5d6b08b-3aad-419a-9ec3-3d21a5bfac11 HTTP/1.1" status: 200 len: 1098 time: 0.0774808 Dec 09 21:34:03.426608 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df8bf8c5-61d8-4532-933c-7995e870ff73 req-97355b45-c42b-464c-a139-426c1fce5546 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434549 Dec 09 21:34:03.454303 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53eab3ea-507f-4668-a953-e2052886ca8b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:03.465250 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdadaabe-cd12-4c53-ac5a-9dc6047c98a0 req-221904ef-99eb-4d17-9bad-75a68c5c3aab tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:03.466956 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bdadaabe-cd12-4c53-ac5a-9dc6047c98a0 req-221904ef-99eb-4d17-9bad-75a68c5c3aab tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=a5d6b08b-3aad-419a-9ec3-3d21a5bfac11 HTTP/1.1" status: 200 len: 946 time: 0.0936651 Dec 09 21:34:03.501168 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53eab3ea-507f-4668-a953-e2052886ca8b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:03.556602 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bdadaabe-cd12-4c53-ac5a-9dc6047c98a0 req-5bdd9284-10a8-420f-92aa-8549985f685b tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0802484 Dec 09 21:34:03.584403 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53eab3ea-507f-4668-a953-e2052886ca8b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:03.587280 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53eab3ea-507f-4668-a953-e2052886ca8b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:03.589073 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-53eab3ea-507f-4668-a953-e2052886ca8b admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/e32ff605-aef7-4315-ab9c-4e9980447d25 HTTP/1.1" status: 204 len: 168 time: 0.2309999 Dec 09 21:34:03.600789 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53eab3ea-507f-4668-a953-e2052886ca8b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e32ff605-aef7-4315-ab9c-4e9980447d25,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:03.693733 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-49f054e7-bdd7-4fbf-96b7-be05fa549d32 req-6556b442-6cd6-4608-b5f0-35754453e9a4 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=78dd0620-865a-48a9-adf6-d64588d364fc HTTP/1.1" status: 200 len: 210 time: 0.0590532 Dec 09 21:34:03.894081 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-b17d9ea1-4313-4a73-abff-0baeb6d33032 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:03.895713 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-b17d9ea1-4313-4a73-abff-0baeb6d33032 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.31 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 812 time: 0.1410706 Dec 09 21:34:03.911428 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d78f48bf-b467-4ff4-89c0-095b5a672c9f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Request body: {'port': {'device_id': '78dd0620-865a-48a9-adf6-d64588d364fc', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'admin_state_up': True, 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:03.997699 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49720) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:04.054389 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-50320908-6439-4a68-a8d9-3b81d598dd13 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=355561057aae464295eb0ce91a41002c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0554745 Dec 09 21:34:04.056618 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d78f48bf-b467-4ff4-89c0-095b5a672c9f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Made reservation on behalf of a36a93590a9f45e1b9b3f78753bb8e12 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:34:04.057557 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49724) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:04.060743 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d78f48bf-b467-4ff4-89c0-095b5a672c9f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:04.115832 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77e4bc8f-179e-4cdc-9373-4280ef66f57b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:04.143987 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77e4bc8f-179e-4cdc-9373-4280ef66f57b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:04.171416 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-344983d1-8a52-4ffe-a3ac-2ef4c13a27ef req-67ef3c6a-2c97-4b49-b8da-b011db1620e0 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:04.173153 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-344983d1-8a52-4ffe-a3ac-2ef4c13a27ef req-67ef3c6a-2c97-4b49-b8da-b011db1620e0 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.0989861 Dec 09 21:34:04.213483 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77e4bc8f-179e-4cdc-9373-4280ef66f57b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:04.216421 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77e4bc8f-179e-4cdc-9373-4280ef66f57b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:04.220069 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-77e4bc8f-179e-4cdc-9373-4280ef66f57b admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/e8d5e173-9364-4c1e-b4e0-399e11ea9e5e HTTP/1.1" status: 204 len: 168 time: 0.1589408 Dec 09 21:34:04.227079 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77e4bc8f-179e-4cdc-9373-4280ef66f57b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e8d5e173-9364-4c1e-b4e0-399e11ea9e5e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:04.268511 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d78f48bf-b467-4ff4-89c0-095b5a672c9f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Allocated IP 172.20.0.6 (2c03082f-742a-4ae3-9d23-6178c7ff2a0a/d776263b-6b97-44cc-bef5-299b9262dfec/ae3b2bf8-8e63-4473-8cc8-206c769cc38a) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:34:04.277080 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-344983d1-8a52-4ffe-a3ac-2ef4c13a27ef req-bb0a7f8d-3d60-4051-af80-914d1cded443 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0972121 Dec 09 21:34:04.436947 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d78f48bf-b467-4ff4-89c0-095b5a672c9f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:04.485005 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d78f48bf-b467-4ff4-89c0-095b5a672c9f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:04.498493 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['d5571683-a9bc-4155-85b9-b1ef208e21e9'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:34:04.541466 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d78f48bf-b467-4ff4-89c0-095b5a672c9f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:34:04.548537 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d78f48bf-b467-4ff4-89c0-095b5a672c9f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:34:04.551318 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d78f48bf-b467-4ff4-89c0-095b5a672c9f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:34:04.589411 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d78f48bf-b467-4ff4-89c0-095b5a672c9f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Pushing event updated for resources: {'Port': ['ID=ae3b2bf8-8e63-4473-8cc8-206c769cc38a,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:04.623108 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d78f48bf-b467-4ff4-89c0-095b5a672c9f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:04.624193 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d78f48bf-b467-4ff4-89c0-095b5a672c9f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:04.645938 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d78f48bf-b467-4ff4-89c0-095b5a672c9f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7389226 Dec 09 21:34:04.662255 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d73cbf07-636f-4ecb-ae67-3f0abdc7e7a6 service neutron] Request body: {'port': {'device_id': '78dd0620-865a-48a9-adf6-d64588d364fc', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:04.987729 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-acb64d6e-fdab-436a-910d-d61b4738a398 None None] Provisioning complete for port ae3b2bf8-8e63-4473-8cc8-206c769cc38a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:04.988095 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-acb64d6e-fdab-436a-910d-d61b4738a398 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:05.029250 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-acb64d6e-fdab-436a-910d-d61b4738a398 None None] Port ae3b2bf8-8e63-4473-8cc8-206c769cc38a cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:34:05.033744 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d73cbf07-636f-4ecb-ae67-3f0abdc7e7a6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:05.110763 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32631176-bc0a-41d6-825a-03a2b4663099 req-bc9fad50-df3f-4513-b2b2-397e4078f167 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:05.112167 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32631176-bc0a-41d6-825a-03a2b4663099 req-bc9fad50-df3f-4513-b2b2-397e4078f167 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=a5d6b08b-3aad-419a-9ec3-3d21a5bfac11 HTTP/1.1" status: 200 len: 946 time: 0.3847930 Dec 09 21:34:05.142098 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dd33f14-40af-4b9d-8e0d-9a1037bb0dff req-c400eadb-3f89-4f7e-80b8-451c3cedcc67 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:05.143587 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2dd33f14-40af-4b9d-8e0d-9a1037bb0dff req-c400eadb-3f89-4f7e-80b8-451c3cedcc67 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=78dd0620-865a-48a9-adf6-d64588d364fc HTTP/1.1" status: 200 len: 931 time: 0.1248112 Dec 09 21:34:05.298986 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32631176-bc0a-41d6-825a-03a2b4663099 req-2f10ac5e-38d4-4d93-a102-df7f08308749 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1733501 Dec 09 21:34:05.331903 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2dd33f14-40af-4b9d-8e0d-9a1037bb0dff req-adaf25ac-ffbe-4e8c-b2a8-7c2dd89789f4 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1775570 Dec 09 21:34:05.494600 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d73cbf07-636f-4ecb-ae67-3f0abdc7e7a6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ae3b2bf8-8e63-4473-8cc8-206c769cc38a {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:34:05.504741 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d73cbf07-636f-4ecb-ae67-3f0abdc7e7a6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:05.526455 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-43834f4a-6bfe-4f7a-96fb-0d21735c9d75 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:05.528314 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d73cbf07-636f-4ecb-ae67-3f0abdc7e7a6 service neutron] Transition to ACTIVE for port object ae3b2bf8-8e63-4473-8cc8-206c769cc38a will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:34:05.536564 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39f6580b-64fa-4fbf-b0af-bb247f75b58e req-2bd4334a-13ce-4589-8cc1-61de3e1f86bb tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:05.538125 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-39f6580b-64fa-4fbf-b0af-bb247f75b58e req-2bd4334a-13ce-4589-8cc1-61de3e1f86bb tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.0770402 Dec 09 21:34:05.539249 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d73cbf07-636f-4ecb-ae67-3f0abdc7e7a6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:05.633035 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d73cbf07-636f-4ecb-ae67-3f0abdc7e7a6 service neutron] Pushing event updated for resources: {'Port': ['ID=ae3b2bf8-8e63-4473-8cc8-206c769cc38a,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:05.699854 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-39f6580b-64fa-4fbf-b0af-bb247f75b58e req-c04a80bb-16f5-4529-8cde-00218f797b65 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1251159 Dec 09 21:34:05.750546 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49780) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:05.786152 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42026d60-3029-4856-b5cc-5de19c5e422c req-5be36426-21be-447a-a98f-f6e12d46ebe2 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:05.788219 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42026d60-3029-4856-b5cc-5de19c5e422c req-5be36426-21be-447a-a98f-f6e12d46ebe2 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=a5d6b08b-3aad-419a-9ec3-3d21a5bfac11 HTTP/1.1" status: 200 len: 946 time: 0.1262405 Dec 09 21:34:05.788539 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d73cbf07-636f-4ecb-ae67-3f0abdc7e7a6 service neutron] Attempting to bind port ae3b2bf8-8e63-4473-8cc8-206c769cc38a on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:34:05.788874 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d73cbf07-636f-4ecb-ae67-3f0abdc7e7a6 service neutron] Attempting to bind port ae3b2bf8-8e63-4473-8cc8-206c769cc38a by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:34:05.789207 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d73cbf07-636f-4ecb-ae67-3f0abdc7e7a6 service neutron] Attempting to bind port ae3b2bf8-8e63-4473-8cc8-206c769cc38a on network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:34:05.811188 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d73cbf07-636f-4ecb-ae67-3f0abdc7e7a6 service neutron] Port ae3b2bf8-8e63-4473-8cc8-206c769cc38a on network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:34:05.811598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d73cbf07-636f-4ecb-ae67-3f0abdc7e7a6 service neutron] Attempting to bind port ae3b2bf8-8e63-4473-8cc8-206c769cc38a on network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:34:05.825075 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d73cbf07-636f-4ecb-ae67-3f0abdc7e7a6 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 33, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:34:05.825427 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d73cbf07-636f-4ecb-ae67-3f0abdc7e7a6 service neutron] Checking segment: {'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:34:05.825953 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d73cbf07-636f-4ecb-ae67-3f0abdc7e7a6 service neutron] Bound using segment: {'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:34:05.826228 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d73cbf07-636f-4ecb-ae67-3f0abdc7e7a6 service neutron] Bound port: ae3b2bf8-8e63-4473-8cc8-206c769cc38a, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:34:05.826588 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d73cbf07-636f-4ecb-ae67-3f0abdc7e7a6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:05.889788 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42026d60-3029-4856-b5cc-5de19c5e422c req-20beb8b3-9212-4e24-aed4-b320a1867722 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0893497 Dec 09 21:34:05.896471 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-13f2c0b0-ddf6-46dd-b187-b49b525480d4 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Request body: {'network': {'name': 'tempest-RoutersIpV6AdminTest-745269180', 'router:external': True}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:05.935983 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d73cbf07-636f-4ecb-ae67-3f0abdc7e7a6 service neutron] For port ae3b2bf8-8e63-4473-8cc8-206c769cc38a, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:34:05.939250 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d73cbf07-636f-4ecb-ae67-3f0abdc7e7a6 service neutron] For port ae3b2bf8-8e63-4473-8cc8-206c769cc38a, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ae3b2bf8-8e63-4473-8cc8-206c769cc38a,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:34:05.940312 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-13f2c0b0-ddf6-46dd-b187-b49b525480d4 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Made reservation on behalf of 1005793cd9644188b8b2a19213843cae for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:34:05.942784 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-13f2c0b0-ddf6-46dd-b187-b49b525480d4 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:05.946318 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d73cbf07-636f-4ecb-ae67-3f0abdc7e7a6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:05.960818 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-13f2c0b0-ddf6-46dd-b187-b49b525480d4 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:05.992211 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d73cbf07-636f-4ecb-ae67-3f0abdc7e7a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:05.992853 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d73cbf07-636f-4ecb-ae67-3f0abdc7e7a6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:05.994399 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-d73cbf07-636f-4ecb-ae67-3f0abdc7e7a6 service neutron] 10.222.0.31 "PUT /v2.0/ports/ae3b2bf8-8e63-4473-8cc8-206c769cc38a HTTP/1.1" status: 200 len: 1092 time: 1.3386486 Dec 09 21:34:05.994853 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '78dd0620-865a-48a9-adf6-d64588d364fc', 'tag': 'ae3b2bf8-8e63-4473-8cc8-206c769cc38a'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:34:05.997453 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d33bace9-626e-4068-b080-3f6094798dce" -d '{"events": [{"name": "network-changed", "server_uuid": "78dd0620-865a-48a9-adf6-d64588d364fc", "tag": "ae3b2bf8-8e63-4473-8cc8-206c769cc38a"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:34:06.038315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d73cbf07-636f-4ecb-ae67-3f0abdc7e7a6 service neutron] Pushing event updated for resources: {'Port': ['ID=ae3b2bf8-8e63-4473-8cc8-206c769cc38a,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:06.060566 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:34:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-93946889-d090-4bb4-96f0-edf633a6c7de x-openstack-request-id: req-93946889-d090-4bb4-96f0-edf633a6c7de {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:34:06.060977 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "78dd0620-865a-48a9-adf6-d64588d364fc", "tag": "ae3b2bf8-8e63-4473-8cc8-206c769cc38a", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:34:06.061330 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-93946889-d090-4bb4-96f0-edf633a6c7de {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:34:06.061784 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '78dd0620-865a-48a9-adf6-d64588d364fc', 'tag': 'ae3b2bf8-8e63-4473-8cc8-206c769cc38a', 'status': 'completed', 'code': 200} Dec 09 21:34:06.132952 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-13f2c0b0-ddf6-46dd-b187-b49b525480d4 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:06.141405 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-a75a2eca-e41c-424c-af92-940e41daef7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:06.142985 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-a75a2eca-e41c-424c-af92-940e41daef7a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&device_id=78dd0620-865a-48a9-adf6-d64588d364fc HTTP/1.1" status: 200 len: 1095 time: 0.0791440 Dec 09 21:34:06.148914 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-13f2c0b0-ddf6-46dd-b187-b49b525480d4 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:06.170765 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-13f2c0b0-ddf6-46dd-b187-b49b525480d4 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] vlan segment allocate from pool success with {'vlan_id': 146, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:34:06.236784 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-19513dc9-e54c-4be8-b38a-35afce4ab219 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=ae3b2bf8-8e63-4473-8cc8-206c769cc38a HTTP/1.1" status: 200 len: 217 time: 0.0716214 Dec 09 21:34:06.237850 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-13f2c0b0-ddf6-46dd-b187-b49b525480d4 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:06.238199 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-13f2c0b0-ddf6-46dd-b187-b49b525480d4 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Added segment 1dd943ca-1000-49a0-9ef3-1fae4d91396d of type vlan for network 259ffcf6-cee7-4f89-990c-478f5ea3fe3f Dec 09 21:34:06.248050 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13f2c0b0-ddf6-46dd-b187-b49b525480d4 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=00c380ee-482e-427e-82bc-30178253d289,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:06.328144 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-13f2c0b0-ddf6-46dd-b187-b49b525480d4 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:06.338711 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-b3ffda22-fbed-4af4-9dd6-a9465c9aa066 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:06.340263 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-b3ffda22-fbed-4af4-9dd6-a9465c9aa066 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 200 len: 851 time: 0.0933442 Dec 09 21:34:06.391733 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-13f2c0b0-ddf6-46dd-b187-b49b525480d4 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:06.392747 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13f2c0b0-ddf6-46dd-b187-b49b525480d4 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:06.393636 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-13f2c0b0-ddf6-46dd-b187-b49b525480d4 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:06.430294 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-aa6f8b73-ec29-4923-8861-44d9bedb133d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:06.432019 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-aa6f8b73-ec29-4923-8861-44d9bedb133d service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0836439 Dec 09 21:34:06.476380 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-13f2c0b0-ddf6-46dd-b187-b49b525480d4 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 874 time: 0.7222884 Dec 09 21:34:06.476703 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49792) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:06.482052 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-f5709e31-bb11-4308-ad7c-68e86defd278 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Request body: {'subnet': {'network_id': '259ffcf6-cee7-4f89-990c-478f5ea3fe3f', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'enable_dhcp': False}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:06.510205 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f5709e31-bb11-4308-ad7c-68e86defd278 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Made reservation on behalf of 1005793cd9644188b8b2a19213843cae for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:34:06.513263 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5709e31-bb11-4308-ad7c-68e86defd278 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:06.523558 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13f2c0b0-ddf6-46dd-b187-b49b525480d4 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Pushing event updated for resources: {'Network': ['ID=259ffcf6-cee7-4f89-990c-478f5ea3fe3f,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:06.538871 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 259ffcf6-cee7-4f89-990c-478f5ea3fe3f details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:34:06.596337 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53cc6fcb-bf2b-4d72-8e10-bdcdd5dff885 req-fc2fccb6-03c0-4135-976c-5f4dd7eeb93c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:06.598584 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-53cc6fcb-bf2b-4d72-8e10-bdcdd5dff885 req-fc2fccb6-03c0-4135-976c-5f4dd7eeb93c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=78dd0620-865a-48a9-adf6-d64588d364fc HTTP/1.1" status: 200 len: 943 time: 0.1766660 Dec 09 21:34:06.625927 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:06.635491 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-0b777523-7fa9-4d30-87f3-ea7ebd97d78a service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1862164 Dec 09 21:34:06.682625 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-53cc6fcb-bf2b-4d72-8e10-bdcdd5dff885 req-52d4a8b1-154c-4087-85e1-e9ce520aa788 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0760612 Dec 09 21:34:06.765637 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf6df53c-c75b-4278-a911-19fcff34e54d req-00cf2c4e-83bb-47cf-97a3-032926112f9e service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1201613 Dec 09 21:34:06.838170 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33ddb8dc-cef8-4aac-ac67-ac9ab23e16fe req-21c63a79-47c3-4587-b470-7f63edc2f5e1 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:06.839751 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-33ddb8dc-cef8-4aac-ac67-ac9ab23e16fe req-21c63a79-47c3-4587-b470-7f63edc2f5e1 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.0624220 Dec 09 21:34:06.844122 n-d-713301-27 neutron-server[103437]: DEBUG neutron.objects.ports [None req-f5709e31-bb11-4308-ad7c-68e86defd278 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103437) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 09 21:34:06.844665 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5709e31-bb11-4308-ad7c-68e86defd278 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:06.908521 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d33bace9-626e-4068-b080-3f6094798dce req-41e2ce07-8056-4dd4-88ef-437f09e5b67f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:06.909951 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d33bace9-626e-4068-b080-3f6094798dce req-41e2ce07-8056-4dd4-88ef-437f09e5b67f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&device_id=78dd0620-865a-48a9-adf6-d64588d364fc HTTP/1.1" status: 200 len: 1095 time: 0.0887954 Dec 09 21:34:06.946500 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-33ddb8dc-cef8-4aac-ac67-ac9ab23e16fe req-6536419e-40d2-455b-823a-74214456ca82 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0850723 Dec 09 21:34:06.952612 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65dea6d9-81c2-44dd-89ff-996041cc791a req-452cb6be-e622-47e3-8d67-2e017e759993 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:06.954169 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-65dea6d9-81c2-44dd-89ff-996041cc791a req-452cb6be-e622-47e3-8d67-2e017e759993 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.10 "GET /v2.0/ports?device_id=a5d6b08b-3aad-419a-9ec3-3d21a5bfac11 HTTP/1.1" status: 200 len: 946 time: 0.1187568 Dec 09 21:34:06.955304 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5709e31-bb11-4308-ad7c-68e86defd278 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Pushing event updated for resources: {'Subnet': ['ID=83e0c8c5-a7c8-4b62-90d7-9bddcca3a8ed,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:06.971599 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5709e31-bb11-4308-ad7c-68e86defd278 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Checking segment: {'id': '1dd943ca-1000-49a0-9ef3-1fae4d91396d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '259ffcf6-cee7-4f89-990c-478f5ea3fe3f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:34:06.971965 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5709e31-bb11-4308-ad7c-68e86defd278 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Network hostable DHCP agents. Network: 259ffcf6-cee7-4f89-990c-478f5ea3fe3f, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:34:07.043705 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5709e31-bb11-4308-ad7c-68e86defd278 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Network 259ffcf6-cee7-4f89-990c-478f5ea3fe3f is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:34:07.049637 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d33bace9-626e-4068-b080-3f6094798dce req-1c033f6a-f01b-42a6-8819-701745f412a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:07.051126 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d33bace9-626e-4068-b080-3f6094798dce req-1c033f6a-f01b-42a6-8819-701745f412a9 service neutron] 10.222.0.31 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 913 time: 0.1286206 Dec 09 21:34:07.060057 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-f5709e31-bb11-4308-ad7c-68e86defd278 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 259ffcf6-cee7-4f89-990c-478f5ea3fe3f) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:34:07.063682 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b37a0447-9315-40d5-80d5-21a7e4ef2c4a req-81013b6b-70bc-4e5e-8bc9-03dec6dff911 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:07.064738 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5709e31-bb11-4308-ad7c-68e86defd278 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:07.065205 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b37a0447-9315-40d5-80d5-21a7e4ef2c4a req-81013b6b-70bc-4e5e-8bc9-03dec6dff911 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=a5d6b08b-3aad-419a-9ec3-3d21a5bfac11 HTTP/1.1" status: 200 len: 946 time: 0.0732985 Dec 09 21:34:07.069502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b186d9ea-9d11-47aa-90ad-e4d6787ad7b2 None None] Network 259ffcf6-cee7-4f89-990c-478f5ea3fe3f requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:34:07.072229 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5709e31-bb11-4308-ad7c-68e86defd278 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:07.096320 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f5709e31-bb11-4308-ad7c-68e86defd278 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 822 time: 0.6184633 Dec 09 21:34:07.099192 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49800) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:07.105316 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-0d0c513f-994a-4389-88d7-907fde084935 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Request body: {'port': {'name': 'tempest-RoutersIpV6AdminTest-673158436', 'network_id': '259ffcf6-cee7-4f89-990c-478f5ea3fe3f'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:07.111962 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-65dea6d9-81c2-44dd-89ff-996041cc791a req-9aec4e1d-732a-4df8-ad84-f5a4fe56041c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Deleting port ead67a5d-6122-4a97-abb6-aebbb4de0c1c {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:34:07.112424 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-65dea6d9-81c2-44dd-89ff-996041cc791a req-9aec4e1d-732a-4df8-ad84-f5a4fe56041c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:07.128489 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d33bace9-626e-4068-b080-3f6094798dce req-2eeacb84-eec2-4dc2-97de-a5ea30434d23 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=ae3b2bf8-8e63-4473-8cc8-206c769cc38a HTTP/1.1" status: 200 len: 217 time: 0.0622828 Dec 09 21:34:07.182272 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5406c5bb-03b7-4c05-b7b8-11c8f9a78703 None None] Network 259ffcf6-cee7-4f89-990c-478f5ea3fe3f requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:34:07.188290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d0c513f-994a-4389-88d7-907fde084935 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Made reservation on behalf of 1005793cd9644188b8b2a19213843cae for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:34:07.190546 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d0c513f-994a-4389-88d7-907fde084935 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:07.212096 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b37a0447-9315-40d5-80d5-21a7e4ef2c4a req-007ec154-cc8f-4e98-bae9-4a52e4de8441 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1260252 Dec 09 21:34:07.216090 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d33bace9-626e-4068-b080-3f6094798dce req-e6ce5daa-d698-432e-9930-a1caefc712be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:07.217579 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d33bace9-626e-4068-b080-3f6094798dce req-e6ce5daa-d698-432e-9930-a1caefc712be service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 200 len: 851 time: 0.0807314 Dec 09 21:34:07.226580 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-0d0c513f-994a-4389-88d7-907fde084935 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] device_id is not set on port 07f813e6-3b23-4059-b055-a1fa8508dfc5 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:34:07.236934 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-65dea6d9-81c2-44dd-89ff-996041cc791a req-9aec4e1d-732a-4df8-ad84-f5a4fe56041c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] For port ead67a5d-6122-4a97-abb6-aebbb4de0c1c, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=ead67a5d-6122-4a97-abb6-aebbb4de0c1c,segment=NetworkSegment(dcec1a9e-3140-49cf-a664-3f1f0937898f),segment_id=dcec1a9e-3140-49cf-a664-3f1f0937898f)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:34:07.237308 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-65dea6d9-81c2-44dd-89ff-996041cc791a req-9aec4e1d-732a-4df8-ad84-f5a4fe56041c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:07.272095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d33bace9-626e-4068-b080-3f6094798dce req-2e4d6958-373f-48d8-9e3d-491b208f750e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:07.274003 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d33bace9-626e-4068-b080-3f6094798dce req-2e4d6958-373f-48d8-9e3d-491b208f750e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0477669 Dec 09 21:34:07.281703 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-65dea6d9-81c2-44dd-89ff-996041cc791a req-9aec4e1d-732a-4df8-ad84-f5a4fe56041c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Calling delete_port for ead67a5d-6122-4a97-abb6-aebbb4de0c1c owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:34:07.373358 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d33bace9-626e-4068-b080-3f6094798dce req-01ed35e9-905a-4294-a4b5-434c457707cb service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0907228 Dec 09 21:34:07.394329 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-0d0c513f-994a-4389-88d7-907fde084935 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Allocated IP 2001:db8::204 (259ffcf6-cee7-4f89-990c-478f5ea3fe3f/83e0c8c5-a7c8-4b62-90d7-9bddcca3a8ed/07f813e6-3b23-4059-b055-a1fa8508dfc5) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:34:07.468457 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d33bace9-626e-4068-b080-3f6094798dce req-3c31dddc-f06f-48ea-93c3-fcd17d3229b6 service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0871553 Dec 09 21:34:07.512302 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-65dea6d9-81c2-44dd-89ff-996041cc791a req-9aec4e1d-732a-4df8-ad84-f5a4fe56041c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:07.525576 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['1e54159e-3c83-49a1-a5b5-3e2b29336c43'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:34:07.529758 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['ead67a5d-6122-4a97-abb6-aebbb4de0c1c'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:34:07.570524 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9aec4e1d-732a-4df8-ad84-f5a4fe56041c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Pushing event deleted for resources: {'Port': ['ID=ead67a5d-6122-4a97-abb6-aebbb4de0c1c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:07.623744 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-65dea6d9-81c2-44dd-89ff-996041cc791a req-9aec4e1d-732a-4df8-ad84-f5a4fe56041c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] No DVR routers for this DVR port ead67a5d-6122-4a97-abb6-aebbb4de0c1c on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:34:07.630434 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-65dea6d9-81c2-44dd-89ff-996041cc791a req-9aec4e1d-732a-4df8-ad84-f5a4fe56041c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:07.633771 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-65dea6d9-81c2-44dd-89ff-996041cc791a req-9aec4e1d-732a-4df8-ad84-f5a4fe56041c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.10 "DELETE /v2.0/ports/ead67a5d-6122-4a97-abb6-aebbb4de0c1c HTTP/1.1" status: 204 len: 173 time: 0.6717989 Dec 09 21:34:07.634234 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a5d6b08b-3aad-419a-9ec3-3d21a5bfac11', 'name': 'network-vif-deleted', 'tag': 'ead67a5d-6122-4a97-abb6-aebbb4de0c1c'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:34:07.636537 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aa819974-a4f5-491f-981b-247441b1dcb5" -d '{"events": [{"server_uuid": "a5d6b08b-3aad-419a-9ec3-3d21a5bfac11", "name": "network-vif-deleted", "tag": "ead67a5d-6122-4a97-abb6-aebbb4de0c1c"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:34:07.659634 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d0c513f-994a-4389-88d7-907fde084935 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:07.682407 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:34:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b1087600-a0fe-4b39-9ff7-1a88c93c6aa0 x-openstack-request-id: req-b1087600-a0fe-4b39-9ff7-1a88c93c6aa0 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:34:07.682699 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a5d6b08b-3aad-419a-9ec3-3d21a5bfac11", "name": "network-vif-deleted", "tag": "ead67a5d-6122-4a97-abb6-aebbb4de0c1c", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:34:07.682953 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-b1087600-a0fe-4b39-9ff7-1a88c93c6aa0 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:34:07.683358 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a5d6b08b-3aad-419a-9ec3-3d21a5bfac11', 'name': 'network-vif-deleted', 'tag': 'ead67a5d-6122-4a97-abb6-aebbb4de0c1c', 'status': 'completed', 'code': 200} Dec 09 21:34:07.721787 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d0c513f-994a-4389-88d7-907fde084935 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:07.781496 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d0c513f-994a-4389-88d7-907fde084935 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Network 259ffcf6-cee7-4f89-990c-478f5ea3fe3f is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:34:07.786887 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-0d0c513f-994a-4389-88d7-907fde084935 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:34:07.794521 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d0c513f-994a-4389-88d7-907fde084935 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:34:07.794521 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d0c513f-994a-4389-88d7-907fde084935 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:07.794521 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d0c513f-994a-4389-88d7-907fde084935 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:07.797617 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d0c513f-994a-4389-88d7-907fde084935 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Pushing event updated for resources: {'Port': ['ID=07f813e6-3b23-4059-b055-a1fa8508dfc5,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:07.816024 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0d0c513f-994a-4389-88d7-907fde084935 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1029 time: 0.7154272 Dec 09 21:34:07.817837 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49810) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:07.829597 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32eea4da-33c0-411d-8f46-c77f0b4421cc req-3c913e44-559a-4ea4-91bb-ac30a034e49a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:07.831249 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32eea4da-33c0-411d-8f46-c77f0b4421cc req-3c913e44-559a-4ea4-91bb-ac30a034e49a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=78dd0620-865a-48a9-adf6-d64588d364fc HTTP/1.1" status: 200 len: 943 time: 0.0664425 Dec 09 21:34:07.881688 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32eea4da-33c0-411d-8f46-c77f0b4421cc req-2c1e2dc9-3e8a-43f7-bd00-3323907eaf33 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443466 Dec 09 21:34:07.904955 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1663096d-6752-4c8a-ac3f-c8ccfd74b2f2 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Deleting port 07f813e6-3b23-4059-b055-a1fa8508dfc5 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:34:07.904955 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1663096d-6752-4c8a-ac3f-c8ccfd74b2f2 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:07.929256 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:08.000199 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1663096d-6752-4c8a-ac3f-c8ccfd74b2f2 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:08.014914 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1663096d-6752-4c8a-ac3f-c8ccfd74b2f2 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Calling delete_port for 07f813e6-3b23-4059-b055-a1fa8508dfc5 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:34:08.092150 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f03775dc-b7a1-4aca-aeb6-7b905617ec5e req-f325f181-4958-470f-b8bd-f69f612a51e6 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:08.093854 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f03775dc-b7a1-4aca-aeb6-7b905617ec5e req-f325f181-4958-470f-b8bd-f69f612a51e6 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.0549695 Dec 09 21:34:08.150821 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1663096d-6752-4c8a-ac3f-c8ccfd74b2f2 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:08.155174 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f03775dc-b7a1-4aca-aeb6-7b905617ec5e req-88b62ac6-28ef-41f1-ad85-23fb98eaa0b4 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0535073 Dec 09 21:34:08.186149 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1663096d-6752-4c8a-ac3f-c8ccfd74b2f2 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Pushing event deleted for resources: {'Port': ['ID=07f813e6-3b23-4059-b055-a1fa8508dfc5,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:08.208186 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1663096d-6752-4c8a-ac3f-c8ccfd74b2f2 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:08.212330 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1663096d-6752-4c8a-ac3f-c8ccfd74b2f2 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "DELETE /v2.0/ports/07f813e6-3b23-4059-b055-a1fa8508dfc5 HTTP/1.1" status: 204 len: 168 time: 0.3924191 Dec 09 21:34:08.214111 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49816) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:08.218305 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-cbdc9465-7620-47ff-b374-fc57fb16aa3c tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '259ffcf6-cee7-4f89-990c-478f5ea3fe3f', 'external_fixed_ips': [{'subnet_id': '83e0c8c5-a7c8-4b62-90d7-9bddcca3a8ed', 'ip_address': '2001:db8::204'}]}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:08.240975 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cbdc9465-7620-47ff-b374-fc57fb16aa3c tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:08.242075 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cbdc9465-7620-47ff-b374-fc57fb16aa3c tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:08.294154 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cbdc9465-7620-47ff-b374-fc57fb16aa3c tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:08.373201 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5dba40c-e7b8-47f3-bc25-39f7e34d35b4 req-1d9e2936-f826-4367-bea2-033b244772fa tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:08.374902 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5dba40c-e7b8-47f3-bc25-39f7e34d35b4 req-1d9e2936-f826-4367-bea2-033b244772fa tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0556409 Dec 09 21:34:08.429465 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5dba40c-e7b8-47f3-bc25-39f7e34d35b4 req-1b4ea70e-e77a-4cac-b411-80ee6bf10d23 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0480497 Dec 09 21:34:08.657292 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16752261-c90d-47b6-aa29-c344d6011349 req-f1493858-1107-4927-876e-24812f5444ac tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:08.659352 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-16752261-c90d-47b6-aa29-c344d6011349 req-f1493858-1107-4927-876e-24812f5444ac tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0546777 Dec 09 21:34:08.708735 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-16752261-c90d-47b6-aa29-c344d6011349 req-67de343c-6310-439f-a33a-a196e2074109 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435946 Dec 09 21:34:08.742064 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cbdc9465-7620-47ff-b374-fc57fb16aa3c tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:08.828988 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18f19034-462a-46f1-ac4c-90b5221baf69 req-bc54982a-1cda-438d-9ab5-a3ae0e01dce5 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:08.830572 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-18f19034-462a-46f1-ac4c-90b5221baf69 req-bc54982a-1cda-438d-9ab5-a3ae0e01dce5 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0500946 Dec 09 21:34:08.884631 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-18f19034-462a-46f1-ac4c-90b5221baf69 req-5bc04c96-3393-432b-a8f5-1ee35ea1e3b3 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467260 Dec 09 21:34:08.951540 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cbdc9465-7620-47ff-b374-fc57fb16aa3c tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:08.971406 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cbdc9465-7620-47ff-b374-fc57fb16aa3c tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:09.013982 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17e8d007-7ca7-425b-95d8-b8c56167e397 req-fe6937cb-75d7-488e-8252-be69064b6ba2 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:09.015758 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-17e8d007-7ca7-425b-95d8-b8c56167e397 req-fe6937cb-75d7-488e-8252-be69064b6ba2 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=78dd0620-865a-48a9-adf6-d64588d364fc HTTP/1.1" status: 200 len: 943 time: 0.0566621 Dec 09 21:34:09.068422 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-17e8d007-7ca7-425b-95d8-b8c56167e397 req-133f24f3-9cd8-458f-a7cf-bd420556bef6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464118 Dec 09 21:34:09.184019 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-cbdc9465-7620-47ff-b374-fc57fb16aa3c tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Allocated IP 2001:db8::204 (259ffcf6-cee7-4f89-990c-478f5ea3fe3f/83e0c8c5-a7c8-4b62-90d7-9bddcca3a8ed/68bc0c0e-01cc-422f-a5ba-73dad64ae492) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:34:09.223273 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device ae3b2bf8-8e63-4473-8cc8-206c769cc38a details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:34:09.311622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd12f880-21bb-4650-8734-f20ce7286c2d req-3d2655e2-4690-46ea-9eb8-15ff59bb6e24 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:09.313643 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd12f880-21bb-4650-8734-f20ce7286c2d req-3d2655e2-4690-46ea-9eb8-15ff59bb6e24 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.0695512 Dec 09 21:34:09.318264 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cbdc9465-7620-47ff-b374-fc57fb16aa3c tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:09.357122 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cbdc9465-7620-47ff-b374-fc57fb16aa3c tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:09.357583 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port ae3b2bf8-8e63-4473-8cc8-206c769cc38a, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ae3b2bf8-8e63-4473-8cc8-206c769cc38a,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:34:09.372220 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'ae3b2bf8-8e63-4473-8cc8-206c769cc38a', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'port_id': 'ae3b2bf8-8e63-4473-8cc8-206c769cc38a', 'mac_address': 'fa:16:3e:8b:84:dc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:34:09.376085 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd12f880-21bb-4650-8734-f20ce7286c2d req-56f9befd-ff64-4706-ba71-5b23880a56c3 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0559797 Dec 09 21:34:09.417414 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:09.425674 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cbdc9465-7620-47ff-b374-fc57fb16aa3c tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Network 259ffcf6-cee7-4f89-990c-478f5ea3fe3f is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:34:09.430460 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-cbdc9465-7620-47ff-b374-fc57fb16aa3c tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:34:09.430652 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ae3b2bf8-8e63-4473-8cc8-206c769cc38a {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:34:09.433293 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbdc9465-7620-47ff-b374-fc57fb16aa3c tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:34:09.452386 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port ae3b2bf8-8e63-4473-8cc8-206c769cc38a, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ae3b2bf8-8e63-4473-8cc8-206c769cc38a,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:34:09.458082 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:09.482210 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbdc9465-7620-47ff-b374-fc57fb16aa3c tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Pushing event updated for resources: {'Port': ['ID=68bc0c0e-01cc-422f-a5ba-73dad64ae492,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:09.515979 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=ae3b2bf8-8e63-4473-8cc8-206c769cc38a,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:09.626579 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:09.684353 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cbdc9465-7620-47ff-b374-fc57fb16aa3c tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:09.708189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['ae3b2bf8-8e63-4473-8cc8-206c769cc38a'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:34:09.905538 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cbdc9465-7620-47ff-b374-fc57fb16aa3c tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:10.042643 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cbdc9465-7620-47ff-b374-fc57fb16aa3c tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Router 6e3e8de5-939d-4073-ac82-4384eda151e8 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:34:10.166011 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cbdc9465-7620-47ff-b374-fc57fb16aa3c tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:34:10.180647 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bf567ce-8e8d-433d-b3d0-361a1483fb88 None None] Sync routers for ids ['6e3e8de5-939d-4073-ac82-4384eda151e8'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:34:10.187194 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cbdc9465-7620-47ff-b374-fc57fb16aa3c tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:10.189073 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cbdc9465-7620-47ff-b374-fc57fb16aa3c tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 878 time: 1.9740629 Dec 09 21:34:10.192122 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49856) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:10.196018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1bf567ce-8e8d-433d-b3d0-361a1483fb88 None None] Routers {'6e3e8de5-939d-4073-ac82-4384eda151e8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:34:10.196650 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-1bf567ce-8e8d-433d-b3d0-361a1483fb88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:34:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6e3e8de5-939d-4073-ac82-4384eda151e8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:10.218448 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86a854c3-5068-45b9-9098-a8e0dd72afcc req-5bbd42d5-777d-402a-9c8b-91336001a481 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:10.220180 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86a854c3-5068-45b9-9098-a8e0dd72afcc req-5bbd42d5-777d-402a-9c8b-91336001a481 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=78dd0620-865a-48a9-adf6-d64588d364fc HTTP/1.1" status: 200 len: 944 time: 0.0642099 Dec 09 21:34:10.280153 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86a854c3-5068-45b9-9098-a8e0dd72afcc req-be04c7a6-1ebd-43c0-9618-3eb72ed571a4 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467658 Dec 09 21:34:10.313418 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d993886-d708-43d5-9cc5-06e8bc6ef645 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:10.434335 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d993886-d708-43d5-9cc5-06e8bc6ef645 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:10.504085 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-5d993886-d708-43d5-9cc5-06e8bc6ef645 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Deleting port 68bc0c0e-01cc-422f-a5ba-73dad64ae492 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:34:10.504435 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d993886-d708-43d5-9cc5-06e8bc6ef645 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:10.507861 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-1bf567ce-8e8d-433d-b3d0-361a1483fb88 None None] Set router 6e3e8de5-939d-4073-ac82-4384eda151e8 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:34:10.551928 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e00c6b68-30a4-480d-a599-98a11f6d57af req-547f6e46-18f9-45b7-8912-36e52864e36a tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:10.554243 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e00c6b68-30a4-480d-a599-98a11f6d57af req-547f6e46-18f9-45b7-8912-36e52864e36a tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.0751035 Dec 09 21:34:10.602455 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d993886-d708-43d5-9cc5-06e8bc6ef645 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:10.615115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-5d993886-d708-43d5-9cc5-06e8bc6ef645 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Calling delete_port for 68bc0c0e-01cc-422f-a5ba-73dad64ae492 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:34:10.635058 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e00c6b68-30a4-480d-a599-98a11f6d57af req-e5af30f5-db9d-454a-b250-250508665ace tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0720806 Dec 09 21:34:10.650429 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-112c0dde-03c4-4f56-ae7a-ca7b6283a0aa req-ac9d8a81-ed7d-430c-af5d-05cbe635648f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:10.651991 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-112c0dde-03c4-4f56-ae7a-ca7b6283a0aa req-ac9d8a81-ed7d-430c-af5d-05cbe635648f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0734632 Dec 09 21:34:10.709782 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-112c0dde-03c4-4f56-ae7a-ca7b6283a0aa req-1df0aa17-d4ad-438d-a95e-b61bf2d1d5dd tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494616 Dec 09 21:34:10.710120 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-1bf567ce-8e8d-433d-b3d0-361a1483fb88 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6e3e8de5-939d-4073-ac82-4384eda151e8', 'name': '', 'tenant_id': '1005793cd9644188b8b2a19213843cae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '259ffcf6-cee7-4f89-990c-478f5ea3fe3f', 'external_fixed_ips': [{'subnet_id': '83e0c8c5-a7c8-4b62-90d7-9bddcca3a8ed', 'ip_address': '2001:db8::204'}], 'enable_snat': True}, 'gw_port_id': '68bc0c0e-01cc-422f-a5ba-73dad64ae492', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:34:08Z', 'updated_at': '2021-12-09T21:34:09Z', 'revision_number': 3, 'project_id': '1005793cd9644188b8b2a19213843cae', 'gw_port': {'id': '68bc0c0e-01cc-422f-a5ba-73dad64ae492', 'name': '', 'network_id': '259ffcf6-cee7-4f89-990c-478f5ea3fe3f', 'tenant_id': '', 'mac_address': 'fa:16:3e:56:80:f2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6e3e8de5-939d-4073-ac82-4384eda151e8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1795, 'fixed_ips': [{'subnet_id': '83e0c8c5-a7c8-4b62-90d7-9bddcca3a8ed', 'ip_address': '2001:db8::204', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:34:08Z', 'updated_at': '2021-12-09T21:34:09Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '83e0c8c5-a7c8-4b62-90d7-9bddcca3a8ed', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:10.740279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bf567ce-8e8d-433d-b3d0-361a1483fb88 None None] Checking router: 6e3e8de5-939d-4073-ac82-4384eda151e8 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:34:10.740785 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bf567ce-8e8d-433d-b3d0-361a1483fb88 None None] Updating router 6e3e8de5-939d-4073-ac82-4384eda151e8 port 68bc0c0e-01cc-422f-a5ba-73dad64ae492 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:34:10.777016 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1bf567ce-8e8d-433d-b3d0-361a1483fb88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:10.817330 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d993886-d708-43d5-9cc5-06e8bc6ef645 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:10.851827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf3fa73c-6b65-4cd9-bc12-16b71b5c6a01 req-a45f2155-1085-47ba-9a1f-55171d35352c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:10.855199 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d993886-d708-43d5-9cc5-06e8bc6ef645 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Pushing event deleted for resources: {'Port': ['ID=68bc0c0e-01cc-422f-a5ba-73dad64ae492,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:10.864487 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf3fa73c-6b65-4cd9-bc12-16b71b5c6a01 req-a45f2155-1085-47ba-9a1f-55171d35352c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0681267 Dec 09 21:34:10.870079 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device ead67a5d-6122-4a97-abb6-aebbb4de0c1c no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:34:10.887931 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d993886-d708-43d5-9cc5-06e8bc6ef645 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:10.899314 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: ead67a5d-6122-4a97-abb6-aebbb4de0c1c {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:34:10.899678 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device ead67a5d-6122-4a97-abb6-aebbb4de0c1c not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:34:10.923064 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf3fa73c-6b65-4cd9-bc12-16b71b5c6a01 req-3d1b51d0-7fa9-4d0f-a0e4-9a7254b7b0cb tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0575254 Dec 09 21:34:10.982410 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d993886-d708-43d5-9cc5-06e8bc6ef645 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:10.984909 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d993886-d708-43d5-9cc5-06e8bc6ef645 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:11.034810 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d993886-d708-43d5-9cc5-06e8bc6ef645 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:11.035867 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5d993886-d708-43d5-9cc5-06e8bc6ef645 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 6e3e8de5-939d-4073-ac82-4384eda151e8 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:34:11.040705 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d993886-d708-43d5-9cc5-06e8bc6ef645 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:11.044581 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5d993886-d708-43d5-9cc5-06e8bc6ef645 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "DELETE /v2.0/routers/6e3e8de5-939d-4073-ac82-4384eda151e8 HTTP/1.1" status: 204 len: 168 time: 0.8489590 Dec 09 21:34:11.044937 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49882) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:11.072415 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-1bf567ce-8e8d-433d-b3d0-361a1483fb88 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:34:11.072764 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-1bf567ce-8e8d-433d-b3d0-361a1483fb88 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:34:11.092696 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-65226cc8-a6eb-4685-bb65-51003f95ce94 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Deleting subnet 83e0c8c5-a7c8-4b62-90d7-9bddcca3a8ed {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:34:11.095945 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-65226cc8-a6eb-4685-bb65-51003f95ce94 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:11.132695 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-65226cc8-a6eb-4685-bb65-51003f95ce94 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:11.199801 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-65226cc8-a6eb-4685-bb65-51003f95ce94 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:11.249927 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device ae3b2bf8-8e63-4473-8cc8-206c769cc38a up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:34:11.259422 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-65226cc8-a6eb-4685-bb65-51003f95ce94 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:11.286792 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65226cc8-a6eb-4685-bb65-51003f95ce94 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Pushing event deleted for resources: {'Subnet': ['ID=83e0c8c5-a7c8-4b62-90d7-9bddcca3a8ed,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:11.290518 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-65226cc8-a6eb-4685-bb65-51003f95ce94 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:11.298471 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-65226cc8-a6eb-4685-bb65-51003f95ce94 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "DELETE /v2.0/subnets/83e0c8c5-a7c8-4b62-90d7-9bddcca3a8ed HTTP/1.1" status: 204 len: 168 time: 0.2481778 Dec 09 21:34:11.298471 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49890) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:11.331793 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port ae3b2bf8-8e63-4473-8cc8-206c769cc38a completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:34:11.336349 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port ae3b2bf8-8e63-4473-8cc8-206c769cc38a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:11.336771 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:11.370476 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-593f8925-1854-427b-bbd9-a5c565528ffb tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:11.416573 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a54707d5-517b-4666-abad-39c01bea9b0c req-63189e79-5904-41ea-b3f6-2b16b98fbaa9 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:11.418235 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a54707d5-517b-4666-abad-39c01bea9b0c req-63189e79-5904-41ea-b3f6-2b16b98fbaa9 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=78dd0620-865a-48a9-adf6-d64588d364fc HTTP/1.1" status: 200 len: 944 time: 0.0558672 Dec 09 21:34:11.455547 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:11.466431 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-593f8925-1854-427b-bbd9-a5c565528ffb tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:11.483661 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a54707d5-517b-4666-abad-39c01bea9b0c req-6b684d6b-7f78-4185-b2f2-abf82dfd6516 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0548854 Dec 09 21:34:11.490056 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-593f8925-1854-427b-bbd9-a5c565528ffb tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['259ffcf6-cee7-4f89-990c-478f5ea3fe3f']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:11.492647 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '78dd0620-865a-48a9-adf6-d64588d364fc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ae3b2bf8-8e63-4473-8cc8-206c769cc38a'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:34:11.495086 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ef850d17-01b7-40da-a9f9-d7c23d8b7c4e" -d '{"events": [{"server_uuid": "78dd0620-865a-48a9-adf6-d64588d364fc", "name": "network-vif-plugged", "status": "completed", "tag": "ae3b2bf8-8e63-4473-8cc8-206c769cc38a"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:34:11.500674 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-593f8925-1854-427b-bbd9-a5c565528ffb tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1dd943ca-1000-49a0-9ef3-1fae4d91396d') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:11.500984 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-593f8925-1854-427b-bbd9-a5c565528ffb tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1dd943ca-1000-49a0-9ef3-1fae4d91396d') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:11.509343 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port ae3b2bf8-8e63-4473-8cc8-206c769cc38a, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ae3b2bf8-8e63-4473-8cc8-206c769cc38a,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:34:11.511064 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-593f8925-1854-427b-bbd9-a5c565528ffb tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:11.515676 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:11.527736 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-593f8925-1854-427b-bbd9-a5c565528ffb tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:11.536417 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-593f8925-1854-427b-bbd9-a5c565528ffb tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Releasing vlan 146 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:34:11.536916 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-593f8925-1854-427b-bbd9-a5c565528ffb tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:11.554408 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:34:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1d064f49-389c-4a08-911a-478e8178af5c x-openstack-request-id: req-1d064f49-389c-4a08-911a-478e8178af5c {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:34:11.554710 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "78dd0620-865a-48a9-adf6-d64588d364fc", "name": "network-vif-plugged", "status": "completed", "tag": "ae3b2bf8-8e63-4473-8cc8-206c769cc38a", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:34:11.555093 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-1d064f49-389c-4a08-911a-478e8178af5c {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:34:11.555514 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '78dd0620-865a-48a9-adf6-d64588d364fc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ae3b2bf8-8e63-4473-8cc8-206c769cc38a', 'code': 200} Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/neutron_lib/db/model_query.py:331: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: items = [ Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:34:11.599643 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:34:11.606278 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-593f8925-1854-427b-bbd9-a5c565528ffb tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:11.610342 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bf567ce-8e8d-433d-b3d0-361a1483fb88 None None] Port 68bc0c0e-01cc-422f-a5ba-73dad64ae492 not found while updating agent binding for router 6e3e8de5-939d-4073-ac82-4384eda151e8. {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:216}} Dec 09 21:34:11.612469 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-593f8925-1854-427b-bbd9-a5c565528ffb tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Fanout notify agent at l3_agent the message fipnamespace_delete_on_ext_net for external_network 259ffcf6-cee7-4f89-990c-478f5ea3fe3f {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:120}} Dec 09 21:34:11.622440 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=ae3b2bf8-8e63-4473-8cc8-206c769cc38a,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:11.628932 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1bf567ce-8e8d-433d-b3d0-361a1483fb88 None None] Routers set() bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:34:11.629538 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1bf567ce-8e8d-433d-b3d0-361a1483fb88 None None] Router IDs set() for agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Dec 09 21:34:11.630318 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_agentschedulers_db [None req-1bf567ce-8e8d-433d-b3d0-361a1483fb88 None None] Agent requested router IDs not scheduled to it. Scheduled: []. Unscheduled: {'6e3e8de5-939d-4073-ac82-4384eda151e8'}. Agent: Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:34:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent'). {{(pid=103439) list_active_sync_routers_on_active_l3_agent /opt/stack/neutron/neutron/db/l3_agentschedulers_db.py:353}} Dec 09 21:34:11.630858 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bf567ce-8e8d-433d-b3d0-361a1483fb88 None None] The sync data for ids ['6e3e8de5-939d-4073-ac82-4384eda151e8'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:34:11.644567 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-593f8925-1854-427b-bbd9-a5c565528ffb tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:11.655278 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-593f8925-1854-427b-bbd9-a5c565528ffb tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "DELETE /v2.0/networks/259ffcf6-cee7-4f89-990c-478f5ea3fe3f HTTP/1.1" status: 204 len: 168 time: 0.3573551 Dec 09 21:34:11.657561 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-593f8925-1854-427b-bbd9-a5c565528ffb tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Pushing event deleted for resources: {'Network': ['ID=259ffcf6-cee7-4f89-990c-478f5ea3fe3f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:11.779427 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31da8360-fd8f-434c-a9f5-1c72adccd77d req-ef3dd053-46da-4f3d-a8f0-29250a24b948 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:11.788446 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31da8360-fd8f-434c-a9f5-1c72adccd77d req-ef3dd053-46da-4f3d-a8f0-29250a24b948 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.0735714 Dec 09 21:34:11.792396 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bef3d25-f03e-4ff6-8385-0df84b77ebe2 req-2779dc2f-2bf0-4f5d-886b-af59e74d8f66 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:11.794130 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8bef3d25-f03e-4ff6-8385-0df84b77ebe2 req-2779dc2f-2bf0-4f5d-886b-af59e74d8f66 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=78dd0620-865a-48a9-adf6-d64588d364fc HTTP/1.1" status: 200 len: 1097 time: 0.1707940 Dec 09 21:34:11.894168 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31da8360-fd8f-434c-a9f5-1c72adccd77d req-6eb04ee4-c020-41d0-a1b8-391e26b9b830 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1047637 Dec 09 21:34:11.903696 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8bef3d25-f03e-4ff6-8385-0df84b77ebe2 req-546c32e0-9681-4e10-b89e-60a585f0a6c0 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1012065 Dec 09 21:34:11.967748 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49910) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:11.972845 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-46d134e2-7762-40e5-9475-5f6e55bf9a2d tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Request body: {'router': {'name': 'tempest-router--2099545733', 'project_id': '9e46f86d01bc4546bb850e22a89a88d1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:12.001949 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-46d134e2-7762-40e5-9475-5f6e55bf9a2d tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:12.003211 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-46d134e2-7762-40e5-9475-5f6e55bf9a2d tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:12.065172 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-46d134e2-7762-40e5-9475-5f6e55bf9a2d tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:12.071380 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-46d134e2-7762-40e5-9475-5f6e55bf9a2d tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:12.089532 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-46d134e2-7762-40e5-9475-5f6e55bf9a2d tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:12.090989 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-46d134e2-7762-40e5-9475-5f6e55bf9a2d tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 723 time: 0.1221883 Dec 09 21:34:12.094533 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49912) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:12.168578 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf839b3a-c38f-4c2b-a8d3-18a5421bb8ed tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:12.325836 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf839b3a-c38f-4c2b-a8d3-18a5421bb8ed tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:12.328060 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf839b3a-c38f-4c2b-a8d3-18a5421bb8ed tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:12.371945 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf839b3a-c38f-4c2b-a8d3-18a5421bb8ed tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:12.372585 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cf839b3a-c38f-4c2b-a8d3-18a5421bb8ed tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Fanout notify agent at l3_agent the message router_deleted on router de7fb50f-4d23-4886-8019-7ac4746153e6 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:34:12.376874 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf839b3a-c38f-4c2b-a8d3-18a5421bb8ed tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:12.378018 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cf839b3a-c38f-4c2b-a8d3-18a5421bb8ed tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "DELETE /v2.0/routers/de7fb50f-4d23-4886-8019-7ac4746153e6 HTTP/1.1" status: 204 len: 168 time: 0.2824955 Dec 09 21:34:12.471125 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96dc4101-4f65-4997-b05b-132c3c1400a8 req-d55b146d-9415-4d8d-8a1c-9361697a32aa tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:12.472673 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96dc4101-4f65-4997-b05b-132c3c1400a8 req-d55b146d-9415-4d8d-8a1c-9361697a32aa tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0489836 Dec 09 21:34:12.487783 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49926) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:12.532708 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96dc4101-4f65-4997-b05b-132c3c1400a8 req-b3780382-92d6-464d-bbf1-a7606f232c9d tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0539904 Dec 09 21:34:12.601844 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53a139fc-b0b5-467a-bc00-f39d9a5ab883 req-35225758-2ea7-4c33-9bef-bee7d451ce44 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:12.607976 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-53a139fc-b0b5-467a-bc00-f39d9a5ab883 req-35225758-2ea7-4c33-9bef-bee7d451ce44 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=78dd0620-865a-48a9-adf6-d64588d364fc HTTP/1.1" status: 200 len: 945 time: 0.0539250 Dec 09 21:34:12.681798 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-53a139fc-b0b5-467a-bc00-f39d9a5ab883 req-fd637e17-90f2-4cb9-b620-e92a57d63b89 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0721638 Dec 09 21:34:12.694373 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-688869f9-ff5f-4030-b044-fdbdfb4ad74b req-497b31b6-882c-4a77-85c7-e0c2b75b8444 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:12.696204 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-688869f9-ff5f-4030-b044-fdbdfb4ad74b req-497b31b6-882c-4a77-85c7-e0c2b75b8444 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0783689 Dec 09 21:34:12.704525 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-eb51ed99-ca58-4199-93b5-029675814fe7 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-1619398056', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}, 'admin_state_up': False}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:12.730543 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb51ed99-ca58-4199-93b5-029675814fe7 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:12.731650 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb51ed99-ca58-4199-93b5-029675814fe7 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:12.748543 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-688869f9-ff5f-4030-b044-fdbdfb4ad74b req-789330b2-afd7-4c9c-89d0-c0c773503e9d tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440948 Dec 09 21:34:12.787935 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb51ed99-ca58-4199-93b5-029675814fe7 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:13.005900 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23289a82-0105-44c3-bb70-393926cea9fd req-08567912-9387-4f15-b7be-1784c79a3a70 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:13.007974 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-23289a82-0105-44c3-bb70-393926cea9fd req-08567912-9387-4f15-b7be-1784c79a3a70 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0639224 Dec 09 21:34:13.080611 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-23289a82-0105-44c3-bb70-393926cea9fd req-bc295552-74b9-4403-8827-6569629d2a5a tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0655138 Dec 09 21:34:13.139971 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63093f04-ca6b-4b76-a607-bee3e1ac4847 req-6a0f03b6-af9a-4b4a-8285-4325d55cc280 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:13.141565 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63093f04-ca6b-4b76-a607-bee3e1ac4847 req-6a0f03b6-af9a-4b4a-8285-4325d55cc280 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.0570326 Dec 09 21:34:13.198506 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63093f04-ca6b-4b76-a607-bee3e1ac4847 req-16aef39e-de1e-47dd-b6e6-24d6bb3f9e8f tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0492864 Dec 09 21:34:13.245042 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb51ed99-ca58-4199-93b5-029675814fe7 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:13.281742 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75e35f25-1b8f-4e5f-85b9-33b70b2802d2 req-9de6d8c5-9988-4fea-a617-f3e851a25114 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:13.283213 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-75e35f25-1b8f-4e5f-85b9-33b70b2802d2 req-9de6d8c5-9988-4fea-a617-f3e851a25114 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0542734 Dec 09 21:34:13.331491 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-75e35f25-1b8f-4e5f-85b9-33b70b2802d2 req-884c0417-b8e3-46e4-a3df-5bd39a1fa029 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418468 Dec 09 21:34:13.446429 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb51ed99-ca58-4199-93b5-029675814fe7 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:13.465105 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb51ed99-ca58-4199-93b5-029675814fe7 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:13.504465 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da79aa09-793f-4bd2-ab9e-519abde6ff61 req-d6a87582-9894-4021-a371-2f3f95432343 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:13.505852 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da79aa09-793f-4bd2-ab9e-519abde6ff61 req-d6a87582-9894-4021-a371-2f3f95432343 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0498483 Dec 09 21:34:13.555399 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da79aa09-793f-4bd2-ab9e-519abde6ff61 req-96ab9121-f2a8-48cd-890f-098c9f16ae42 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422955 Dec 09 21:34:13.574421 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-eb51ed99-ca58-4199-93b5-029675814fe7 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Allocated IP 172.25.3.119 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/6fd035d7-4477-4c09-a541-d26589ae78bd) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:34:13.673508 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-077aff21-4254-4d42-a31f-a035ba040364 req-3d41f6b9-955a-43ea-acb9-46ee2f686ddb tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:13.675127 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-077aff21-4254-4d42-a31f-a035ba040364 req-3d41f6b9-955a-43ea-acb9-46ee2f686ddb tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0495839 Dec 09 21:34:13.675292 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb51ed99-ca58-4199-93b5-029675814fe7 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:13.709740 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb51ed99-ca58-4199-93b5-029675814fe7 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:13.727738 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-077aff21-4254-4d42-a31f-a035ba040364 req-d4ff75ec-c928-474e-bf73-591d620d2f1f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459635 Dec 09 21:34:13.748075 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb51ed99-ca58-4199-93b5-029675814fe7 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:34:13.752151 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-eb51ed99-ca58-4199-93b5-029675814fe7 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:34:13.757922 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb51ed99-ca58-4199-93b5-029675814fe7 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:34:13.764653 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb51ed99-ca58-4199-93b5-029675814fe7 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Pushing event updated for resources: {'Port': ['ID=6fd035d7-4477-4c09-a541-d26589ae78bd,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:13.770239 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d8608c54-9ab9-466c-a408-341f054ac286 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:34:13.822582 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b094016e-88a2-421f-b25d-a521a7abbee0 req-cd9a546a-3269-42ff-a5e5-be0afd0cf47d tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:13.828065 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b094016e-88a2-421f-b25d-a521a7abbee0 req-cd9a546a-3269-42ff-a5e5-be0afd0cf47d tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=78dd0620-865a-48a9-adf6-d64588d364fc HTTP/1.1" status: 200 len: 945 time: 0.0713749 Dec 09 21:34:13.866229 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-0c6677a3-6dd3-4a4f-ad4d-2bca1683d7ce None None] Provisioning complete for port 6fd035d7-4477-4c09-a541-d26589ae78bd triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:13.866852 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0c6677a3-6dd3-4a4f-ad4d-2bca1683d7ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:13.883179 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b094016e-88a2-421f-b25d-a521a7abbee0 req-280eda71-e49b-48d6-b096-d531793edb4c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524616 Dec 09 21:34:13.906820 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-0c6677a3-6dd3-4a4f-ad4d-2bca1683d7ce None None] Port 6fd035d7-4477-4c09-a541-d26589ae78bd cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:34:13.969192 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a5f6db-5e93-4179-a8da-c2072dc4871f req-a245374f-17a3-4e26-897c-e1acad468834 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:13.971761 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85a5f6db-5e93-4179-a8da-c2072dc4871f req-a245374f-17a3-4e26-897c-e1acad468834 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0668383 Dec 09 21:34:13.983517 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-af9f3ede-aaeb-496d-8183-549d4bb2ad9e service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 665 time: 0.0862856 Dec 09 21:34:14.025534 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85a5f6db-5e93-4179-a8da-c2072dc4871f req-483171f8-e2c9-4e1d-82c6-8141962866cd tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474672 Dec 09 21:34:14.141637 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-c0814994-5f48-42d3-b210-458c192ec4f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:14.142121 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-c0814994-5f48-42d3-b210-458c192ec4f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:14.142566 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-c0814994-5f48-42d3-b210-458c192ec4f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:14.143029 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-c0814994-5f48-42d3-b210-458c192ec4f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:14.143517 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-c0814994-5f48-42d3-b210-458c192ec4f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:14.143983 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-c0814994-5f48-42d3-b210-458c192ec4f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:14.144436 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-c0814994-5f48-42d3-b210-458c192ec4f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:14.146404 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-c0814994-5f48-42d3-b210-458c192ec4f9 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=03e962eb7f5e4325a7c08c8b1e2a4cea&device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 6498 time: 0.1016903 Dec 09 21:34:14.151806 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5475abfd-aebe-4aa6-af68-f769d36467a7 req-288823c2-4dc7-4aa4-b249-c4ca7edb2769 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:14.153717 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5475abfd-aebe-4aa6-af68-f769d36467a7 req-288823c2-4dc7-4aa4-b249-c4ca7edb2769 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0531518 Dec 09 21:34:14.155859 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb51ed99-ca58-4199-93b5-029675814fe7 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:14.204295 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5475abfd-aebe-4aa6-af68-f769d36467a7 req-062f4835-d47c-4221-ab7e-a0a14c18aab2 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440867 Dec 09 21:34:14.334352 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f62c8b7-b89a-4e5c-ac26-d433fba80987 req-7127eaf7-3ac4-4632-bc70-4ca3d22156f7 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:14.336168 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f62c8b7-b89a-4e5c-ac26-d433fba80987 req-7127eaf7-3ac4-4632-bc70-4ca3d22156f7 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.0503523 Dec 09 21:34:14.373357 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-a1179bdf-b806-44d7-875f-ddfc420071f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:14.373973 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-a1179bdf-b806-44d7-875f-ddfc420071f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:14.374397 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-a1179bdf-b806-44d7-875f-ddfc420071f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:14.376049 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-a1179bdf-b806-44d7-875f-ddfc420071f3 service neutron] 10.222.0.10 "GET /v2.0/networks?id=f0373886-3db8-47eb-af65-78244497171e&id=a859e4ba-764a-41c0-982d-5bf79a2797a1&id=a859e4ba-764a-41c0-982d-5bf79a2797a1&id=a859e4ba-764a-41c0-982d-5bf79a2797a1&id=a859e4ba-764a-41c0-982d-5bf79a2797a1&id=a133a939-2827-4fe6-81f5-14715631c0ec&id=a133a939-2827-4fe6-81f5-14715631c0ec HTTP/1.1" status: 200 len: 2293 time: 0.1835840 Dec 09 21:34:14.414070 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b58a1e0a-db38-434d-be71-c9fd6d4b6220 req-ebeb1678-f4ec-44f3-8239-9c229c26a944 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:14.415568 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b58a1e0a-db38-434d-be71-c9fd6d4b6220 req-ebeb1678-f4ec-44f3-8239-9c229c26a944 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0769742 Dec 09 21:34:14.423426 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f62c8b7-b89a-4e5c-ac26-d433fba80987 req-360fc6fc-f0e1-483e-bb46-b44a51ba4206 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0764070 Dec 09 21:34:14.475979 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b58a1e0a-db38-434d-be71-c9fd6d4b6220 req-b779de9d-ec27-4d41-85a3-ba6eca9b6092 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0506871 Dec 09 21:34:14.490802 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-50f7a168-1049-43ea-a46f-a0ca3069bca5 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=90180a85-620b-470e-b808-b635138111be HTTP/1.1" status: 200 len: 1002 time: 0.1067429 Dec 09 21:34:14.493536 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb51ed99-ca58-4199-93b5-029675814fe7 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:14.622658 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-392ca517-486e-46e4-bdc9-86dbb7ff6011 req-939f14a4-7112-4034-82cd-df8fe0251a74 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:14.625267 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-392ca517-486e-46e4-bdc9-86dbb7ff6011 req-939f14a4-7112-4034-82cd-df8fe0251a74 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0579147 Dec 09 21:34:14.628778 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-55a54f94-a0d1-4a70-9ec8-5396c4f6c7d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:14.630406 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-55a54f94-a0d1-4a70-9ec8-5396c4f6c7d3 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=65df7637-0210-4526-a5dd-a692c26062b4 HTTP/1.1" status: 200 len: 851 time: 0.1326373 Dec 09 21:34:14.705307 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-55528674-f5b0-4a02-936b-228422141247 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:14.706822 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-55528674-f5b0-4a02-936b-228422141247 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=f0373886-3db8-47eb-af65-78244497171e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0678940 Dec 09 21:34:14.723480 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eb51ed99-ca58-4199-93b5-029675814fe7 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Router 7879dcb7-b8b8-480b-a3a0-0e698207cc2d is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:34:14.735086 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-392ca517-486e-46e4-bdc9-86dbb7ff6011 req-7cb33d0c-9fbe-48b2-b312-379efff7c484 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1037014 Dec 09 21:34:14.747614 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea944286-d8ef-4413-9214-e60ccf277c95 req-4151dfeb-c358-4ef5-8ca8-06b8c92d698b tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:14.749120 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea944286-d8ef-4413-9214-e60ccf277c95 req-4151dfeb-c358-4ef5-8ca8-06b8c92d698b tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.1023605 Dec 09 21:34:14.762444 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-396eeb70-b84a-4469-9176-22412d24fa94 req-81b9c177-4cac-48be-9888-0a407bf6d5be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:14.764169 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-396eeb70-b84a-4469-9176-22412d24fa94 req-81b9c177-4cac-48be-9888-0a407bf6d5be service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=aacb3291db4d4252a9225e8fe617f667&device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 1098 time: 0.0781739 Dec 09 21:34:14.879836 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea944286-d8ef-4413-9214-e60ccf277c95 req-e7b21947-1f31-4709-947e-9eced8fe7f46 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1221802 Dec 09 21:34:14.913864 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-5debe763-0764-4594-a53d-d5ced8a59cf9 service neutron] 10.222.0.10 "GET /v2.0/networks/f0373886-3db8-47eb-af65-78244497171e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1995146 Dec 09 21:34:14.914838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eb51ed99-ca58-4199-93b5-029675814fe7 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:34:14.924391 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b408d32-182e-4920-b483-a6e3b7a51ec0 None None] Sync routers for ids ['7879dcb7-b8b8-480b-a3a0-0e698207cc2d'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:34:14.936175 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b408d32-182e-4920-b483-a6e3b7a51ec0 None None] Routers {'7879dcb7-b8b8-480b-a3a0-0e698207cc2d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:34:14.936970 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2b408d32-182e-4920-b483-a6e3b7a51ec0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:34:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7879dcb7-b8b8-480b-a3a0-0e698207cc2d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:14.958390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-396eeb70-b84a-4469-9176-22412d24fa94 req-aa6ae997-5b1e-45d0-8f85-1a5cce03a71e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:14.959041 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb51ed99-ca58-4199-93b5-029675814fe7 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:14.962874 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-396eeb70-b84a-4469-9176-22412d24fa94 req-aa6ae997-5b1e-45d0-8f85-1a5cce03a71e service neutron] 10.222.0.31 "GET /v2.0/networks?id=935b09ce-7410-4b66-82be-99978deb6717 HTTP/1.1" status: 200 len: 912 time: 0.1876128 Dec 09 21:34:14.963047 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-eb51ed99-ca58-4199-93b5-029675814fe7 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 889 time: 2.4714890 Dec 09 21:34:14.969963 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b42a0d33-bb6f-4979-898c-92fc3d50036c req-fa769f73-0553-4f4f-945b-4baaead13eda tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:14.970403 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b42a0d33-bb6f-4979-898c-92fc3d50036c req-fa769f73-0553-4f4f-945b-4baaead13eda tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0893130 Dec 09 21:34:14.970880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49996) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:14.983483 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2b408d32-182e-4920-b483-a6e3b7a51ec0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:14.995047 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b408d32-182e-4920-b483-a6e3b7a51ec0 None None] Routers {'7879dcb7-b8b8-480b-a3a0-0e698207cc2d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:34:14.998221 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2b408d32-182e-4920-b483-a6e3b7a51ec0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:34:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7879dcb7-b8b8-480b-a3a0-0e698207cc2d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:15.026686 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-28f74006-5de6-46d2-8794-84df76c9285d service neutron] 10.222.0.10 "GET /v2.0/networks/f0373886-3db8-47eb-af65-78244497171e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1048822 Dec 09 21:34:15.038676 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2b408d32-182e-4920-b483-a6e3b7a51ec0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:15.039370 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b408d32-182e-4920-b483-a6e3b7a51ec0 None None] The sync data for ids ['7879dcb7-b8b8-480b-a3a0-0e698207cc2d'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:34:15.070387 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-9224a87e-b698-4d31-b84f-3d8d2fcf9871 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.81&port_id=1e946a47-f496-445b-964b-618881eab263 HTTP/1.1" status: 200 len: 217 time: 0.0372014 Dec 09 21:34:15.124912 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-bedd09f6-1a46-44a4-b057-0d1532e64059 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:15.126574 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-bedd09f6-1a46-44a4-b057-0d1532e64059 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=a894075b-fa9f-4a27-9782-e476e86f74e0 HTTP/1.1" status: 200 len: 797 time: 0.0496433 Dec 09 21:34:15.181613 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-c3663f4a-2c3b-4d26-9b87-7676358e35ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:15.183244 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-c3663f4a-2c3b-4d26-9b87-7676358e35ec service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a859e4ba-764a-41c0-982d-5bf79a2797a1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0486329 Dec 09 21:34:15.276970 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-dfc4ff5f-9b9b-4b3d-94c3-ceed71d9454a service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0864809 Dec 09 21:34:15.373628 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-0f3048e8-ede9-4724-8de8-456393d34a0f service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0894084 Dec 09 21:34:15.391854 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-396eeb70-b84a-4469-9176-22412d24fa94 req-06c769f1-f448-4f5f-b561-c8083dc19052 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=042e101d-fba7-4c12-8471-48255f57bee1 HTTP/1.1" status: 200 len: 1002 time: 0.4199545 Dec 09 21:34:15.418246 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7c128d66-753c-4b57-97e5-34e7a47f9dc0 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "GET /v2.0/routers/7879dcb7-b8b8-480b-a3a0-0e698207cc2d HTTP/1.1" status: 200 len: 925 time: 0.4450831 Dec 09 21:34:15.418951 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-b069e06f-9a90-4e6d-8c7e-f1406b8878a2 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.31&port_id=145a0cde-0fe5-4163-a063-0fdfe42f243b HTTP/1.1" status: 200 len: 217 time: 0.0367458 Dec 09 21:34:15.421046 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50004) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:15.450027 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b42a0d33-bb6f-4979-898c-92fc3d50036c req-b2078854-75c6-4bca-9753-32db78e3851e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4164531 Dec 09 21:34:15.455025 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d3e3bfc1-5cf4-46b5-8db1-10219d4294e0 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "GET /v2.0/ports?device_id=7879dcb7-b8b8-480b-a3a0-0e698207cc2d HTTP/1.1" status: 200 len: 205 time: 0.0306304 Dec 09 21:34:15.455852 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50006) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:15.491293 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-c24b8282-59e8-4024-988e-b10e0f6f4173 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:15.493004 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-c24b8282-59e8-4024-988e-b10e0f6f4173 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=a894075b-fa9f-4a27-9782-e476e86f74e0 HTTP/1.1" status: 200 len: 797 time: 0.0630937 Dec 09 21:34:15.501451 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-396eeb70-b84a-4469-9176-22412d24fa94 req-dc45eb99-40ff-46e3-8029-3302b03bcac5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:15.502923 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-396eeb70-b84a-4469-9176-22412d24fa94 req-dc45eb99-40ff-46e3-8029-3302b03bcac5 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=10ff3f47-d1f4-47a0-808e-f885899dfb29 HTTP/1.1" status: 200 len: 850 time: 0.1006150 Dec 09 21:34:15.542463 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-fe5ad08c-d1e4-4389-8780-cd707ae7027d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:15.545610 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-fe5ad08c-d1e4-4389-8780-cd707ae7027d service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a859e4ba-764a-41c0-982d-5bf79a2797a1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0444846 Dec 09 21:34:15.633902 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cfbb5583-6ab4-4a07-a008-120291ad0cbc tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:15.643272 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-fb34c519-3d9a-4e2f-b20d-707d3f432584 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0907009 Dec 09 21:34:15.672819 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-396eeb70-b84a-4469-9176-22412d24fa94 req-5204a5ac-c1dd-4e6a-803a-ec2bb8580a4d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:15.674318 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-396eeb70-b84a-4469-9176-22412d24fa94 req-5204a5ac-c1dd-4e6a-803a-ec2bb8580a4d service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=935b09ce-7410-4b66-82be-99978deb6717&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1607189 Dec 09 21:34:15.688464 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25163ca8-c29c-472a-b65b-740be5002233 req-69f0e499-782b-4b97-8017-0dca64d5c1e4 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:15.689952 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25163ca8-c29c-472a-b65b-740be5002233 req-69f0e499-782b-4b97-8017-0dca64d5c1e4 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.1473687 Dec 09 21:34:15.739639 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-8d30e267-236c-4bf1-a836-57374cf68a95 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0883985 Dec 09 21:34:15.781188 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-f8ece439-f5bb-4f40-b4a1-0ec05c765b00 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.110&port_id=7b66d328-f18c-4d26-af51-99c1b1f1f05e HTTP/1.1" status: 200 len: 217 time: 0.0346625 Dec 09 21:34:15.843575 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-0ff57a70-04f8-4edd-aee1-263857ab06b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:15.845016 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-0ff57a70-04f8-4edd-aee1-263857ab06b3 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=a894075b-fa9f-4a27-9782-e476e86f74e0 HTTP/1.1" status: 200 len: 797 time: 0.0570321 Dec 09 21:34:15.849208 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cfbb5583-6ab4-4a07-a008-120291ad0cbc tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:15.864057 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25163ca8-c29c-472a-b65b-740be5002233 req-d7f4336f-d763-4764-a2bf-259bce6278c1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1626508 Dec 09 21:34:15.871891 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-396eeb70-b84a-4469-9176-22412d24fa94 req-ba931b95-a8a9-48d2-b5c2-f5d7f017351a service neutron] 10.222.0.31 "GET /v2.0/networks/935b09ce-7410-4b66-82be-99978deb6717?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1809251 Dec 09 21:34:15.905823 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-414f6aaa-f472-4f09-9aec-49842ecbeb64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:15.907425 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-414f6aaa-f472-4f09-9aec-49842ecbeb64 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a859e4ba-764a-41c0-982d-5bf79a2797a1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0540490 Dec 09 21:34:16.016835 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-8159c1b5-a952-46d6-9b55-af9af9630f4b service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1017084 Dec 09 21:34:16.019839 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-cfbb5583-6ab4-4a07-a008-120291ad0cbc tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Deleting port 6fd035d7-4477-4c09-a541-d26589ae78bd {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:34:16.020170 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cfbb5583-6ab4-4a07-a008-120291ad0cbc tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:16.113166 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-2d593612-e2a8-4e98-abb1-a11159060b63 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0881233 Dec 09 21:34:16.124605 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-396eeb70-b84a-4469-9176-22412d24fa94 req-1ca64eaf-803c-4beb-95a2-c1184d9a896e service neutron] 10.222.0.31 "GET /v2.0/networks/935b09ce-7410-4b66-82be-99978deb6717?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2310042 Dec 09 21:34:16.136089 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96f3a668-902a-4178-8c8f-7407d8591a97 req-ac9f2d5d-3128-4d06-89fb-a15047f9bbe1 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:16.138257 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96f3a668-902a-4178-8c8f-7407d8591a97 req-ac9f2d5d-3128-4d06-89fb-a15047f9bbe1 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.1714535 Dec 09 21:34:16.156512 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-59e3a143-ab22-4941-b022-a42820d3f568 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.206&port_id=3bbd0bd0-666a-4f39-abae-59f44d88319c HTTP/1.1" status: 200 len: 217 time: 0.0367434 Dec 09 21:34:16.209669 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-d218ab97-76b3-4935-8bd7-9cd1a5186aa4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:16.211180 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-d218ab97-76b3-4935-8bd7-9cd1a5186aa4 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=a894075b-fa9f-4a27-9782-e476e86f74e0 HTTP/1.1" status: 200 len: 797 time: 0.0475411 Dec 09 21:34:16.219216 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cfbb5583-6ab4-4a07-a008-120291ad0cbc tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:16.247635 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-cfbb5583-6ab4-4a07-a008-120291ad0cbc tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Calling delete_port for 6fd035d7-4477-4c09-a541-d26589ae78bd owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:34:16.257404 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-8e85380f-86d6-4422-8fec-96b79bd51c7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:16.259087 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-8e85380f-86d6-4422-8fec-96b79bd51c7c service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a859e4ba-764a-41c0-982d-5bf79a2797a1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0408738 Dec 09 21:34:16.259903 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e995d6e9-0ea7-411a-911d-835679749ba0 req-46ec0de4-e652-40b7-ba0c-eca8f004536e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:16.261397 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e995d6e9-0ea7-411a-911d-835679749ba0 req-46ec0de4-e652-40b7-ba0c-eca8f004536e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/networks?id=88af5e51-6d1a-432d-8676-517f449774a3 HTTP/1.1" status: 200 len: 812 time: 0.2392755 Dec 09 21:34:16.288687 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96f3a668-902a-4178-8c8f-7407d8591a97 req-0a0a261a-eeb6-4940-839f-dd889a7f1597 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1211982 Dec 09 21:34:16.291544 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e995d6e9-0ea7-411a-911d-835679749ba0 req-eb40eb43-49cb-4c2e-91a2-8631be427240 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/quotas/b65669b5d4924ee090e9583aa839a399 HTTP/1.1" status: 200 len: 375 time: 0.0238304 Dec 09 21:34:16.358252 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-547bc45b-8d09-4619-bd07-8bdd6cede944 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0918279 Dec 09 21:34:16.417871 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e995d6e9-0ea7-411a-911d-835679749ba0 req-a4ef6c6b-1b05-4638-9828-ab1083b79743 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=b65669b5d4924ee090e9583aa839a399&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0925987 Dec 09 21:34:16.470743 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-2389357e-da43-46e7-b048-2c43e7e4a6a6 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1053612 Dec 09 21:34:16.492552 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cfbb5583-6ab4-4a07-a008-120291ad0cbc tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:16.522662 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-a2ed9ebb-db7c-4c75-b7d1-d671859b13b3 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.100&port_id=d0dcf098-4522-4347-b733-bbc98e48d7e0 HTTP/1.1" status: 200 len: 217 time: 0.0451701 Dec 09 21:34:16.538448 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfbb5583-6ab4-4a07-a008-120291ad0cbc tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Pushing event deleted for resources: {'Port': ['ID=6fd035d7-4477-4c09-a541-d26589ae78bd,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:16.555363 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7a0f4254-674f-4a9f-8fbb-ea0845cf4848 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:34:16.578268 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-c03f6673-bbd8-4d79-b346-7777bb3ca3ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:16.579878 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-c03f6673-bbd8-4d79-b346-7777bb3ca3ec service neutron] 10.222.0.10 "GET /v2.0/subnets?id=753ba647-b0b0-482e-ac28-89c7e6adf654 HTTP/1.1" status: 200 len: 797 time: 0.0507562 Dec 09 21:34:16.625598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e64320b5-93f2-4afa-9655-5580bd2d30a3 req-153c04aa-ab10-457b-8768-80633aeb8219 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:16.627075 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e64320b5-93f2-4afa-9655-5580bd2d30a3 req-153c04aa-ab10-457b-8768-80633aeb8219 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0998800 Dec 09 21:34:16.638547 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cfbb5583-6ab4-4a07-a008-120291ad0cbc tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:16.642482 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-6be67b9b-0c5a-4340-9b29-7052d09012c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:16.645205 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-6be67b9b-0c5a-4340-9b29-7052d09012c3 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a133a939-2827-4fe6-81f5-14715631c0ec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0573225 Dec 09 21:34:16.755635 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-98070697-5ca0-4ed7-b3a5-5d6fe2f9caef service neutron] 10.222.0.10 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0952289 Dec 09 21:34:16.757198 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cfbb5583-6ab4-4a07-a008-120291ad0cbc tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:16.760943 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cfbb5583-6ab4-4a07-a008-120291ad0cbc tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:16.808242 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e64320b5-93f2-4afa-9655-5580bd2d30a3 req-67d17de2-0ea8-4152-a3c5-a9e878b2611c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1672885 Dec 09 21:34:16.817360 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cfbb5583-6ab4-4a07-a008-120291ad0cbc tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:16.817968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cfbb5583-6ab4-4a07-a008-120291ad0cbc tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Fanout notify agent at l3_agent the message router_deleted on router 7879dcb7-b8b8-480b-a3a0-0e698207cc2d {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:34:16.831142 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cfbb5583-6ab4-4a07-a008-120291ad0cbc tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:16.832318 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cfbb5583-6ab4-4a07-a008-120291ad0cbc tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "DELETE /v2.0/routers/7879dcb7-b8b8-480b-a3a0-0e698207cc2d HTTP/1.1" status: 204 len: 168 time: 1.3758705 Dec 09 21:34:16.836345 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50036) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:16.841237 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-29e55015-cf94-4425-9e6d-b5df6dfe5ea0 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Request body: {'router': {'name': 'tempest-snat-router-1837363479', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'enable_snat': False}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:16.859093 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-baac1ee4-b1e2-48d3-b165-11574449fa78 service neutron] 10.222.0.10 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0946827 Dec 09 21:34:16.866047 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-29e55015-cf94-4425-9e6d-b5df6dfe5ea0 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:16.867100 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-29e55015-cf94-4425-9e6d-b5df6dfe5ea0 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:16.911298 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-339f3925-8e26-4c97-a619-8179a9438efe service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=b7cad057-c6e6-483b-9791-e1b1a0dd73ac HTTP/1.1" status: 200 len: 217 time: 0.0444801 Dec 09 21:34:16.954085 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-29e55015-cf94-4425-9e6d-b5df6dfe5ea0 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:16.964876 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-7d3e86a5-49f3-4149-9536-a11b124be992 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:16.966967 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-7d3e86a5-49f3-4149-9536-a11b124be992 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=753ba647-b0b0-482e-ac28-89c7e6adf654 HTTP/1.1" status: 200 len: 797 time: 0.0493834 Dec 09 21:34:17.015662 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-58d7b66d-f661-44e6-b951-a347f3706450 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:17.017199 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-58d7b66d-f661-44e6-b951-a347f3706450 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a133a939-2827-4fe6-81f5-14715631c0ec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0410891 Dec 09 21:34:17.038987 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f1f01d2-54c3-4c67-8e04-18ee582c64f6 req-173e1848-d929-411d-a7d9-d05332beebb2 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:17.040643 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1f1f01d2-54c3-4c67-8e04-18ee582c64f6 req-173e1848-d929-411d-a7d9-d05332beebb2 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.1408508 Dec 09 21:34:17.110702 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-7e0ff766-5063-4a59-83dc-6d83781de406 service neutron] 10.222.0.10 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0862563 Dec 09 21:34:17.120968 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-29e55015-cf94-4425-9e6d-b5df6dfe5ea0 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:17.211312 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92ea7bdb-5280-46e1-8c06-f0886cca91c3 req-97a838f5-5c4b-4b13-92da-9e4b15a9410b service neutron] 10.222.0.10 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0928609 Dec 09 21:34:17.419169 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1f1f01d2-54c3-4c67-8e04-18ee582c64f6 req-3e1146ec-0438-4dd9-9962-c5e714320169 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3457794 Dec 09 21:34:17.474918 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ec53ee6-0cf8-4fa4-8c83-82ad7a924549 req-e6b370dd-7f24-4bb6-bfd6-e2162d2269ac tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:17.476682 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ec53ee6-0cf8-4fa4-8c83-82ad7a924549 req-e6b370dd-7f24-4bb6-bfd6-e2162d2269ac tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.0785160 Dec 09 21:34:17.560644 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ec53ee6-0cf8-4fa4-8c83-82ad7a924549 req-6f2da7ce-6a22-4227-9d8d-95606b9b09af tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0598278 Dec 09 21:34:17.700346 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d90c3d6d-110e-4ab9-87c7-c5e554ce9431 req-28415302-8d72-4282-a7ed-6aeb2098d8ca tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?name=does_not_exist&fields=id&tenant_id=b65669b5d4924ee090e9583aa839a399 HTTP/1.1" status: 200 len: 221 time: 0.0583568 Dec 09 21:34:17.707958 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-29e55015-cf94-4425-9e6d-b5df6dfe5ea0 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:17.728125 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-29e55015-cf94-4425-9e6d-b5df6dfe5ea0 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:17.859132 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ff190e2-d2fa-4a73-9217-15da5a81e494 req-9aaee994-3ac4-4da8-91c2-9ee2797c4677 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:17.860392 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1ff190e2-d2fa-4a73-9217-15da5a81e494 req-9aaee994-3ac4-4da8-91c2-9ee2797c4677 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0952735 Dec 09 21:34:17.885223 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-29e55015-cf94-4425-9e6d-b5df6dfe5ea0 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Allocated IP 172.25.3.179 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:34:17.952493 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1ff190e2-d2fa-4a73-9217-15da5a81e494 req-6f077296-ef49-449d-8893-bd8a0dd60725 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0843341 Dec 09 21:34:18.042033 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-29e55015-cf94-4425-9e6d-b5df6dfe5ea0 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:18.094343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1798a8f6-d556-4d3a-9d16-e865fd5880d4 req-e0b8688b-38d4-438f-9229-93556bf6dd46 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:18.095845 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1798a8f6-d556-4d3a-9d16-e865fd5880d4 req-e0b8688b-38d4-438f-9229-93556bf6dd46 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0677562 Dec 09 21:34:18.110261 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-29e55015-cf94-4425-9e6d-b5df6dfe5ea0 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:18.167129 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-29e55015-cf94-4425-9e6d-b5df6dfe5ea0 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:34:18.177152 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-29e55015-cf94-4425-9e6d-b5df6dfe5ea0 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:34:18.182695 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29e55015-cf94-4425-9e6d-b5df6dfe5ea0 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:34:18.190985 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49ba8a35-0d0a-46c9-9abe-2f3ba4593fcd None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:34:18.210562 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29e55015-cf94-4425-9e6d-b5df6dfe5ea0 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Pushing event updated for resources: {'Port': ['ID=ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:18.216801 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1798a8f6-d556-4d3a-9d16-e865fd5880d4 req-064cb1f9-6880-4d4f-98b0-c9137a6b8585 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1150906 Dec 09 21:34:18.258544 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-90bfa4b3-9949-40f7-916b-459d5ff5eff6 None None] Provisioning complete for port ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:18.258995 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-90bfa4b3-9949-40f7-916b-459d5ff5eff6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:18.299876 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-90bfa4b3-9949-40f7-916b-459d5ff5eff6 None None] Port ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:34:18.392836 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0597bfa-bcdf-4189-a33e-d14ba474d89d req-c7f93799-040d-48b4-aa67-54d8b3de4e77 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:18.394382 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f0597bfa-bcdf-4189-a33e-d14ba474d89d req-c7f93799-040d-48b4-aa67-54d8b3de4e77 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0677981 Dec 09 21:34:18.516203 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f0597bfa-bcdf-4189-a33e-d14ba474d89d req-cba8e31f-0d92-4632-9375-f6d91acfc33a tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0867364 Dec 09 21:34:18.527905 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-29e55015-cf94-4425-9e6d-b5df6dfe5ea0 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:18.710155 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5ffb923-6090-46d9-85e1-4c539333224c req-9a064be7-da15-4155-b11c-6556ced06a5f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:18.711640 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e5ffb923-6090-46d9-85e1-4c539333224c req-9a064be7-da15-4155-b11c-6556ced06a5f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.1252875 Dec 09 21:34:18.797293 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-29e55015-cf94-4425-9e6d-b5df6dfe5ea0 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:18.803292 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e5ffb923-6090-46d9-85e1-4c539333224c req-38d97333-3640-4a8a-b13f-08d3ae4b1e86 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0850055 Dec 09 21:34:18.953980 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a8525bc-9480-48f0-b924-2d93f934a366 req-ce977365-4ee7-4597-9a9c-ddca64f43f60 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:18.955429 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5a8525bc-9480-48f0-b924-2d93f934a366 req-ce977365-4ee7-4597-9a9c-ddca64f43f60 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0679517 Dec 09 21:34:18.985223 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-29e55015-cf94-4425-9e6d-b5df6dfe5ea0 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Router 24144312-f333-48e4-9a6e-0d06d4715d46 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:34:19.016773 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5a8525bc-9480-48f0-b924-2d93f934a366 req-eca29ea7-11c7-48d2-96b4-4b47c26b86f5 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0546165 Dec 09 21:34:19.138587 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-29e55015-cf94-4425-9e6d-b5df6dfe5ea0 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:34:19.149054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] Sync routers for ids ['24144312-f333-48e4-9a6e-0d06d4715d46'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:34:19.162484 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] Routers {'24144312-f333-48e4-9a6e-0d06d4715d46'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:34:19.163040 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4d34e5a-013c-444e-9ff7-e2240d7cee94 req-031c4fb7-4efd-47ce-af8d-70dfef406d80 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:19.163450 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:34:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['24144312-f333-48e4-9a6e-0d06d4715d46'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:19.164560 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4d34e5a-013c-444e-9ff7-e2240d7cee94 req-031c4fb7-4efd-47ce-af8d-70dfef406d80 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0727110 Dec 09 21:34:19.167697 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-29e55015-cf94-4425-9e6d-b5df6dfe5ea0 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:19.172368 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-29e55015-cf94-4425-9e6d-b5df6dfe5ea0 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 908 time: 2.3316877 Dec 09 21:34:19.172368 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50088) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:19.284665 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] Set router 24144312-f333-48e4-9a6e-0d06d4715d46 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:34:19.287491 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4d34e5a-013c-444e-9ff7-e2240d7cee94 req-6596b1e8-11d7-4976-9e26-fa5940daebf3 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1165359 Dec 09 21:34:19.311370 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-73711171-5130-4aea-94fb-3066b206891c tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "GET /v2.0/routers/24144312-f333-48e4-9a6e-0d06d4715d46 HTTP/1.1" status: 200 len: 909 time: 0.1384399 Dec 09 21:34:19.313822 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50092) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:19.318732 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a50977a8-e44e-4807-94f7-b00c8b0a2abe tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Request body: {'router': {'name': 'tempest-snat-router-1837363479', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'enable_snat': True}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:19.349465 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a50977a8-e44e-4807-94f7-b00c8b0a2abe tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:19.350542 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a50977a8-e44e-4807-94f7-b00c8b0a2abe tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:19.411896 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a50977a8-e44e-4807-94f7-b00c8b0a2abe tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:19.432174 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84d9dec9-d129-4c7c-a2d9-2d9d4c4f2501 req-4a977172-b9f5-485a-adfe-9e9d604b2e15 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:19.434140 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84d9dec9-d129-4c7c-a2d9-2d9d4c4f2501 req-4a977172-b9f5-485a-adfe-9e9d604b2e15 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0572698 Dec 09 21:34:19.479599 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24144312-f333-48e4-9a6e-0d06d4715d46', 'name': 'tempest-snat-router-1837363479', 'tenant_id': '1005793cd9644188b8b2a19213843cae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.179'}], 'enable_snat': False}, 'gw_port_id': 'ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:34:16Z', 'updated_at': '2021-12-09T21:34:18Z', 'revision_number': 3, 'project_id': '1005793cd9644188b8b2a19213843cae', 'gw_port': {'id': 'ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:0d:26:b0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '24144312-f333-48e4-9a6e-0d06d4715d46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1800, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.179', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:34:17Z', 'updated_at': '2021-12-09T21:34:17Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:19.489514 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84d9dec9-d129-4c7c-a2d9-2d9d4c4f2501 req-f5097214-b82c-4dab-852e-a6864d469ff5 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0487301 Dec 09 21:34:19.518186 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] Checking router: 24144312-f333-48e4-9a6e-0d06d4715d46 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:34:19.518714 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] Updating router 24144312-f333-48e4-9a6e-0d06d4715d46 port ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:34:19.549588 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:19.638061 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-519c3eb1-aae1-4c78-a26f-f863dda5911f req-5c5a7031-16d0-4444-a4c9-c644ac6fbb54 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:19.639932 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-519c3eb1-aae1-4c78-a26f-f863dda5911f req-5c5a7031-16d0-4444-a4c9-c644ac6fbb54 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0736384 Dec 09 21:34:19.703793 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-519c3eb1-aae1-4c78-a26f-f863dda5911f req-35b5c6f9-dc16-4778-86fe-a813f30d598b tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0548878 Dec 09 21:34:19.863597 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:19.872811 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:19.902575 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a50977a8-e44e-4807-94f7-b00c8b0a2abe tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:19.904630 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac996910-210c-4d15-a9fb-69a50f4cd130 req-501a4feb-0994-4aa1-8cb4-a7bf2ae996e6 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:19.906390 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac996910-210c-4d15-a9fb-69a50f4cd130 req-501a4feb-0994-4aa1-8cb4-a7bf2ae996e6 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.1003320 Dec 09 21:34:19.924249 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3372342b-2bb4-485e-bd20-6062fd0af98a None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:34:19.951409 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] Attempting to bind port ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:34:19.951840 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] Attempting to bind port ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:34:19.952203 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] Attempting to bind port ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:34:19.959021 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac996910-210c-4d15-a9fb-69a50f4cd130 req-8ddccd32-fcf7-4f20-9f6d-637227948b7f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444264 Dec 09 21:34:19.965970 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-935d9bd9-125e-47da-88d4-8dd1b7730d87 None None] Pushing event updated for resources: {'Port': ['ID=ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:19.968173 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 34, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:34:19.968685 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:34:19.969338 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:19.969723 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:34:19.970220 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] Bound port: ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:34:19.970579 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:20.040457 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] For port ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:34:20.044240 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] For port ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:34:20.050373 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2393b630-23a3-4f0a-a030-0c0138fe1c6d None None] Provisioning complete for port ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:20.050766 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2393b630-23a3-4f0a-a030-0c0138fe1c6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:20.086169 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:20.094956 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e048945-7dc9-425b-b3a7-701953a7bf84 req-3172e440-d2fe-45a7-8591-f38fe6111a37 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:20.096670 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e048945-7dc9-425b-b3a7-701953a7bf84 req-3172e440-d2fe-45a7-8591-f38fe6111a37 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0526299 Dec 09 21:34:20.111613 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a50977a8-e44e-4807-94f7-b00c8b0a2abe tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:20.131043 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a50977a8-e44e-4807-94f7-b00c8b0a2abe tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:20.148534 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b7efeb7a-d6be-43b7-b383-db4ab0262dfe None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:34:20.159333 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e048945-7dc9-425b-b3a7-701953a7bf84 req-43092fbb-0c2f-4a97-9786-1f028751ae9d tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0549774 Dec 09 21:34:20.175077 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] Routers {'24144312-f333-48e4-9a6e-0d06d4715d46'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:34:20.175746 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:34:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['24144312-f333-48e4-9a6e-0d06d4715d46'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:20.178346 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-935d9bd9-125e-47da-88d4-8dd1b7730d87 None None] Pushing event updated for resources: {'Port': ['ID=ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:20.261028 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-a50977a8-e44e-4807-94f7-b00c8b0a2abe tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Allocated IP 172.25.3.78 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/e9f2765c-c1c5-4b27-82ac-6ee05c3c6264) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:34:20.268618 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2393b630-23a3-4f0a-a030-0c0138fe1c6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:20.317656 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d5d773b-5135-41c9-a3e9-ceb0482e8ff8 req-464a2b9c-a06e-4934-8480-2c4c0185a088 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:20.319311 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d5d773b-5135-41c9-a3e9-ceb0482e8ff8 req-464a2b9c-a06e-4934-8480-2c4c0185a088 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0615363 Dec 09 21:34:20.330002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2393b630-23a3-4f0a-a030-0c0138fe1c6d None None] For port ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:34:20.340269 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2393b630-23a3-4f0a-a030-0c0138fe1c6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:20.348204 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] Set router 24144312-f333-48e4-9a6e-0d06d4715d46 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:34:20.374394 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d5d773b-5135-41c9-a3e9-ceb0482e8ff8 req-734066a9-ded3-4852-9f54-217ced5fa934 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474019 Dec 09 21:34:20.390560 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a50977a8-e44e-4807-94f7-b00c8b0a2abe tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:20.433115 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a50977a8-e44e-4807-94f7-b00c8b0a2abe tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:20.468851 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a50977a8-e44e-4807-94f7-b00c8b0a2abe tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:34:20.473613 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-a50977a8-e44e-4807-94f7-b00c8b0a2abe tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:34:20.477087 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a50977a8-e44e-4807-94f7-b00c8b0a2abe tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:34:20.497543 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-86c40b54-a967-44e8-b648-0d8245b5a5e1 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:34:20.510777 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a50977a8-e44e-4807-94f7-b00c8b0a2abe tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Pushing event updated for resources: {'Port': ['ID=e9f2765c-c1c5-4b27-82ac-6ee05c3c6264,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:20.511096 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2bd6a7d-b7e4-4b89-8b3b-2c7898686929 req-14041415-a280-4bb6-bcf1-97ab9dede894 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:20.513142 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2bd6a7d-b7e4-4b89-8b3b-2c7898686929 req-14041415-a280-4bb6-bcf1-97ab9dede894 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0626993 Dec 09 21:34:20.531160 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2393b630-23a3-4f0a-a030-0c0138fe1c6d None None] Pushing event updated for resources: {'Port': ['ID=ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:20.546685 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-36c28584-b192-46df-a90e-48c4172d03ae None None] Provisioning complete for port ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:20.547075 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-36c28584-b192-46df-a90e-48c4172d03ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:20.572356 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2bd6a7d-b7e4-4b89-8b3b-2c7898686929 req-052e755c-dc0c-4901-b821-af6df36272ee tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474870 Dec 09 21:34:20.741365 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcbadd45-04b6-4357-a220-7f593e34764c req-0bcfae99-756f-476f-a620-975fa36167d6 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:20.744196 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dcbadd45-04b6-4357-a220-7f593e34764c req-0bcfae99-756f-476f-a620-975fa36167d6 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0681071 Dec 09 21:34:20.780785 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a50977a8-e44e-4807-94f7-b00c8b0a2abe tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:20.812637 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dcbadd45-04b6-4357-a220-7f593e34764c req-c71664ec-c3ba-4a7d-9857-94f9bfed7d85 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0618093 Dec 09 21:34:20.888206 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24144312-f333-48e4-9a6e-0d06d4715d46', 'name': 'tempest-snat-router-1837363479', 'tenant_id': '1005793cd9644188b8b2a19213843cae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.179'}], 'enable_snat': False}, 'gw_port_id': 'ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:34:16Z', 'updated_at': '2021-12-09T21:34:18Z', 'revision_number': 3, 'project_id': '1005793cd9644188b8b2a19213843cae', 'gw_port': {'id': 'ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:0d:26:b0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '24144312-f333-48e4-9a6e-0d06d4715d46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1800, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.179', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:34:17Z', 'updated_at': '2021-12-09T21:34:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:20.922601 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d1452ae-8491-4334-a0a4-d67d006080e2 None None] The sync data for ids ['24144312-f333-48e4-9a6e-0d06d4715d46'] in n-d-713301-27 is: [{'id': '24144312-f333-48e4-9a6e-0d06d4715d46', 'name': 'tempest-snat-router-1837363479', 'tenant_id': '1005793cd9644188b8b2a19213843cae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.179'}], 'enable_snat': False}, 'gw_port_id': 'ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:34:16Z', 'updated_at': '2021-12-09T21:34:18Z', 'revision_number': 3, 'project_id': '1005793cd9644188b8b2a19213843cae', 'gw_port': {'id': 'ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:0d:26:b0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '24144312-f333-48e4-9a6e-0d06d4715d46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1800, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.179', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:34:17Z', 'updated_at': '2021-12-09T21:34:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': False, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:34:20.944831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b667f2a-825e-446c-8253-14d2eae13d58 req-e55f13f5-3403-4def-8454-285f52bb5d76 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:20.946681 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b667f2a-825e-446c-8253-14d2eae13d58 req-e55f13f5-3403-4def-8454-285f52bb5d76 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0582991 Dec 09 21:34:20.992094 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ba04f188-2df2-44c7-a416-fa6e7b2c71f6 None None] Provisioning complete for port e9f2765c-c1c5-4b27-82ac-6ee05c3c6264 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:20.992614 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ba04f188-2df2-44c7-a416-fa6e7b2c71f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:21.014539 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b667f2a-825e-446c-8253-14d2eae13d58 req-8159b758-22e7-4c6b-a79f-1851722f4559 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0618017 Dec 09 21:34:21.028139 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a50977a8-e44e-4807-94f7-b00c8b0a2abe tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:21.045740 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ba04f188-2df2-44c7-a416-fa6e7b2c71f6 None None] Port e9f2765c-c1c5-4b27-82ac-6ee05c3c6264 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:34:21.166968 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a50977a8-e44e-4807-94f7-b00c8b0a2abe tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Router 7cace83f-c3a0-45a4-9a92-287d605ecaab is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:34:21.291927 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d984219d-7285-4551-84c8-13f8e987c376 req-6f4d104d-1f3e-48ae-bdd8-b55eebfd76ad tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:21.293599 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d984219d-7285-4551-84c8-13f8e987c376 req-6f4d104d-1f3e-48ae-bdd8-b55eebfd76ad tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0606420 Dec 09 21:34:21.297160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a50977a8-e44e-4807-94f7-b00c8b0a2abe tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:34:21.307798 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Sync routers for ids ['7cace83f-c3a0-45a4-9a92-287d605ecaab'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:34:21.319246 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a50977a8-e44e-4807-94f7-b00c8b0a2abe tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:21.325255 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Routers {'7cace83f-c3a0-45a4-9a92-287d605ecaab'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:34:21.325514 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a50977a8-e44e-4807-94f7-b00c8b0a2abe tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 906 time: 2.0073984 Dec 09 21:34:21.325642 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:34:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7cace83f-c3a0-45a4-9a92-287d605ecaab'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:21.327600 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50138) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:21.376769 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d984219d-7285-4551-84c8-13f8e987c376 req-9f1f6171-adb8-41d1-8240-5a620a25947e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0749507 Dec 09 21:34:21.474535 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Set router 7cace83f-c3a0-45a4-9a92-287d605ecaab gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:34:21.536941 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-861815f2-dfa7-4c4d-8518-6c0be622354d tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "GET /v2.0/routers/7cace83f-c3a0-45a4-9a92-287d605ecaab HTTP/1.1" status: 200 len: 907 time: 0.2080209 Dec 09 21:34:21.545262 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50142) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:21.549635 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:34:21.612834 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:21.613215 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:21.690865 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7cace83f-c3a0-45a4-9a92-287d605ecaab', 'name': 'tempest-snat-router-1837363479', 'tenant_id': '1005793cd9644188b8b2a19213843cae', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78'}], 'enable_snat': True}, 'gw_port_id': 'e9f2765c-c1c5-4b27-82ac-6ee05c3c6264', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:34:19Z', 'updated_at': '2021-12-09T21:34:20Z', 'revision_number': 3, 'project_id': '1005793cd9644188b8b2a19213843cae', 'gw_port': {'id': 'e9f2765c-c1c5-4b27-82ac-6ee05c3c6264', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:e2:00:76', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7cace83f-c3a0-45a4-9a92-287d605ecaab', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1802, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:34:20Z', 'updated_at': '2021-12-09T21:34:20Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:21.697231 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2beed04a-70f6-44e9-b67e-3cbf143d1cc7 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:21.738030 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Checking router: 7cace83f-c3a0-45a4-9a92-287d605ecaab for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:34:21.738380 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Updating router 7cace83f-c3a0-45a4-9a92-287d605ecaab port e9f2765c-c1c5-4b27-82ac-6ee05c3c6264 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:34:21.805030 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:21.890871 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2beed04a-70f6-44e9-b67e-3cbf143d1cc7 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:21.975125 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5313144-d19c-4420-9799-52fd05df6768 req-60daf860-9aaf-45bb-a675-4d94c705e830 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:21.983832 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-2beed04a-70f6-44e9-b67e-3cbf143d1cc7 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Deleting port e9f2765c-c1c5-4b27-82ac-6ee05c3c6264 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:34:21.984178 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2beed04a-70f6-44e9-b67e-3cbf143d1cc7 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:21.984339 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c5313144-d19c-4420-9799-52fd05df6768 req-60daf860-9aaf-45bb-a675-4d94c705e830 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.4965467 Dec 09 21:34:22.006542 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e918d932-7bbc-4f9b-8911-a3639717960d req-b4044507-5cac-4413-b825-ff80651af239 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0923445 Dec 09 21:34:22.088317 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2beed04a-70f6-44e9-b67e-3cbf143d1cc7 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:22.088845 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c5313144-d19c-4420-9799-52fd05df6768 req-8783112c-e277-491a-996f-5343a68df0cd tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0997825 Dec 09 21:34:22.106539 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-2beed04a-70f6-44e9-b67e-3cbf143d1cc7 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Calling delete_port for e9f2765c-c1c5-4b27-82ac-6ee05c3c6264 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:34:22.121434 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e918d932-7bbc-4f9b-8911-a3639717960d req-b2eaa6f6-8b87-4347-a4af-20ce80c6ecd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:22.125965 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e918d932-7bbc-4f9b-8911-a3639717960d req-b2eaa6f6-8b87-4347-a4af-20ce80c6ecd6 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=aacb3291db4d4252a9225e8fe617f667&device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 1098 time: 0.0849843 Dec 09 21:34:22.239702 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:22.246959 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:22.297003 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e918d932-7bbc-4f9b-8911-a3639717960d req-64f03619-da69-41ec-acc9-3434086ed463 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:22.298494 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e918d932-7bbc-4f9b-8911-a3639717960d req-64f03619-da69-41ec-acc9-3434086ed463 service neutron] 10.222.0.31 "GET /v2.0/networks?id=935b09ce-7410-4b66-82be-99978deb6717 HTTP/1.1" status: 200 len: 912 time: 0.1467719 Dec 09 21:34:22.301919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6b62e4d4-502a-4785-909b-d235ebab7f8c None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:34:22.310190 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Attempting to bind port e9f2765c-c1c5-4b27-82ac-6ee05c3c6264 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:34:22.311491 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Attempting to bind port e9f2765c-c1c5-4b27-82ac-6ee05c3c6264 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:34:22.312045 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Attempting to bind port e9f2765c-c1c5-4b27-82ac-6ee05c3c6264 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:34:22.320584 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7f05a54-e8cc-4dbc-94f0-55a638d82dac req-d96ede88-85fd-4cc6-b439-1b1e76facfc5 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:22.321512 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 34, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:34:22.321898 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:34:22.322310 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:22.322705 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:34:22.323176 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Bound port: e9f2765c-c1c5-4b27-82ac-6ee05c3c6264, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:34:22.323949 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d7f05a54-e8cc-4dbc-94f0-55a638d82dac req-d96ede88-85fd-4cc6-b439-1b1e76facfc5 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0781994 Dec 09 21:34:22.326501 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:22.345577 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2beed04a-70f6-44e9-b67e-3cbf143d1cc7 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:22.351499 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36a3e5ca-4e35-4ad1-ba1b-af8920aece88 None None] Pushing event updated for resources: {'Port': ['ID=e9f2765c-c1c5-4b27-82ac-6ee05c3c6264,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:22.364911 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36a3e5ca-4e35-4ad1-ba1b-af8920aece88 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:22.365542 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36a3e5ca-4e35-4ad1-ba1b-af8920aece88 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:22.366043 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36a3e5ca-4e35-4ad1-ba1b-af8920aece88 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:22.366535 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36a3e5ca-4e35-4ad1-ba1b-af8920aece88 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:22.367025 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36a3e5ca-4e35-4ad1-ba1b-af8920aece88 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:22.367553 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36a3e5ca-4e35-4ad1-ba1b-af8920aece88 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:22.368037 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36a3e5ca-4e35-4ad1-ba1b-af8920aece88 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:22.368519 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36a3e5ca-4e35-4ad1-ba1b-af8920aece88 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:22.369006 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36a3e5ca-4e35-4ad1-ba1b-af8920aece88 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:22.369489 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36a3e5ca-4e35-4ad1-ba1b-af8920aece88 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:22.370000 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36a3e5ca-4e35-4ad1-ba1b-af8920aece88 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:22.370478 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36a3e5ca-4e35-4ad1-ba1b-af8920aece88 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:22.371003 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36a3e5ca-4e35-4ad1-ba1b-af8920aece88 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:22.373015 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5d9e0117-91f7-4c0a-9f56-89bb864666c3 None None] Could not find standard attr ID for object e9f2765c-c1c5-4b27-82ac-6ee05c3c6264. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:34:22.377348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2beed04a-70f6-44e9-b67e-3cbf143d1cc7 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Pushing event deleted for resources: {'Port': ['ID=e9f2765c-c1c5-4b27-82ac-6ee05c3c6264,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:22.397403 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cdf7bf8a-43e6-45b2-9fd9-5a99e3f4aab9 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:34:22.417359 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.db.api [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Retry wrapper got retriable exception: UPDATE statement on table 'ml2_port_bindings' expected to update 1 row(s); 0 were matched. {{(pid=103440) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:34:22.417722 n-d-713301-27 neutron-server[103440]: DEBUG oslo_db.api [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin._bind_port_if_needed {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:34:22.420577 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e918d932-7bbc-4f9b-8911-a3639717960d req-7c747ffe-dfd9-430f-ab22-fc82ebad1d65 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=042e101d-fba7-4c12-8471-48255f57bee1 HTTP/1.1" status: 200 len: 1002 time: 0.1143208 Dec 09 21:34:22.450922 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2beed04a-70f6-44e9-b67e-3cbf143d1cc7 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:22.475641 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d7f05a54-e8cc-4dbc-94f0-55a638d82dac req-06237ffb-fe24-46d9-9f92-d93fc0b689e9 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1140640 Dec 09 21:34:22.488660 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e918d932-7bbc-4f9b-8911-a3639717960d req-bb31218f-b843-47f9-937b-46c03e3d0a50 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:22.490269 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e918d932-7bbc-4f9b-8911-a3639717960d req-bb31218f-b843-47f9-937b-46c03e3d0a50 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=10ff3f47-d1f4-47a0-808e-f885899dfb29 HTTP/1.1" status: 200 len: 850 time: 0.0615151 Dec 09 21:34:22.546030 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e918d932-7bbc-4f9b-8911-a3639717960d req-6273dba3-81cb-4da2-9eed-67eeb24b2c2b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:22.547634 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e918d932-7bbc-4f9b-8911-a3639717960d req-6273dba3-81cb-4da2-9eed-67eeb24b2c2b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=935b09ce-7410-4b66-82be-99978deb6717&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0461631 Dec 09 21:34:22.550986 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2beed04a-70f6-44e9-b67e-3cbf143d1cc7 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:22.553189 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2beed04a-70f6-44e9-b67e-3cbf143d1cc7 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:22.601008 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2beed04a-70f6-44e9-b67e-3cbf143d1cc7 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:22.601536 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2beed04a-70f6-44e9-b67e-3cbf143d1cc7 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 7cace83f-c3a0-45a4-9a92-287d605ecaab {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:34:22.606144 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2beed04a-70f6-44e9-b67e-3cbf143d1cc7 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:22.607304 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2beed04a-70f6-44e9-b67e-3cbf143d1cc7 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "DELETE /v2.0/routers/7cace83f-c3a0-45a4-9a92-287d605ecaab HTTP/1.1" status: 204 len: 168 time: 1.0607672 Dec 09 21:34:22.610083 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50160) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:22.668549 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e77c85eb-3387-4220-b315-11b5c06d1553 req-bc5ba59a-ac9b-456d-9052-0b14c91fcbd4 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:22.670174 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e77c85eb-3387-4220-b315-11b5c06d1553 req-bc5ba59a-ac9b-456d-9052-0b14c91fcbd4 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.1049118 Dec 09 21:34:22.702451 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e918d932-7bbc-4f9b-8911-a3639717960d req-727e2446-2d95-4d7e-b2d2-a00117fe773c service neutron] 10.222.0.31 "GET /v2.0/networks/935b09ce-7410-4b66-82be-99978deb6717?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1460891 Dec 09 21:34:22.729732 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bdde3cb5-aff1-4ca9-84e1-5c6008ff4619 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:22.756689 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e77c85eb-3387-4220-b315-11b5c06d1553 req-20d5a81c-29fe-4bdd-bf95-60defa632804 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0785849 Dec 09 21:34:22.821383 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e918d932-7bbc-4f9b-8911-a3639717960d req-12610633-3ed5-4ce3-bd61-92292b39724d service neutron] 10.222.0.31 "GET /v2.0/networks/935b09ce-7410-4b66-82be-99978deb6717?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1083229 Dec 09 21:34:22.859937 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bdde3cb5-aff1-4ca9-84e1-5c6008ff4619 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:22.937253 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Attempting to bind port e9f2765c-c1c5-4b27-82ac-6ee05c3c6264 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:34:22.937949 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Attempting to bind port e9f2765c-c1c5-4b27-82ac-6ee05c3c6264 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:34:22.938507 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Attempting to bind port e9f2765c-c1c5-4b27-82ac-6ee05c3c6264 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:34:22.945309 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-bdde3cb5-aff1-4ca9-84e1-5c6008ff4619 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Deleting port ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:34:22.945857 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bdde3cb5-aff1-4ca9-84e1-5c6008ff4619 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:22.949891 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 34, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:34:22.950853 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:34:22.951482 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:22.952037 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:34:22.952651 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Bound port: e9f2765c-c1c5-4b27-82ac-6ee05c3c6264, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:34:22.953093 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:22.959406 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97fdb545-ce0d-4aee-a9d8-91cc7107975b req-3dbc4e06-a7ae-4065-9191-92162ffa0217 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:22.967393 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-97fdb545-ce0d-4aee-a9d8-91cc7107975b req-3dbc4e06-a7ae-4065-9191-92162ffa0217 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0644102 Dec 09 21:34:22.975011 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.plugin [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Port e9f2765c-c1c5-4b27-82ac-6ee05c3c6264 has been deleted concurrently {{(pid=103440) _commit_port_binding /opt/stack/neutron/neutron/plugins/ml2/plugin.py:665}} Dec 09 21:34:22.998560 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Routers set() bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:34:22.998938 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Router IDs set() for agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Dec 09 21:34:22.999590 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_agentschedulers_db [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] Agent requested router IDs not scheduled to it. Scheduled: []. Unscheduled: {'7cace83f-c3a0-45a4-9a92-287d605ecaab'}. Agent: Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:34:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent'). {{(pid=103440) list_active_sync_routers_on_active_l3_agent /opt/stack/neutron/neutron/db/l3_agentschedulers_db.py:353}} Dec 09 21:34:22.999964 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52ff9927-14f8-4d60-a4cb-bea9fb595d28 None None] The sync data for ids ['7cace83f-c3a0-45a4-9a92-287d605ecaab'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:34:23.047030 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-97fdb545-ce0d-4aee-a9d8-91cc7107975b req-5e9a1417-87bb-489d-8ffd-35ec5407060a tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0780296 Dec 09 21:34:23.068928 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-bdde3cb5-aff1-4ca9-84e1-5c6008ff4619 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] For port ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:34:23.069126 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bdde3cb5-aff1-4ca9-84e1-5c6008ff4619 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:23.083922 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-bdde3cb5-aff1-4ca9-84e1-5c6008ff4619 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Calling delete_port for ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:34:23.184067 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a05dcb2-3370-4810-96f3-9b25820d224a req-feae51d4-ea4a-4397-a846-71a81e416266 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:23.197173 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a05dcb2-3370-4810-96f3-9b25820d224a req-feae51d4-ea4a-4397-a846-71a81e416266 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0749562 Dec 09 21:34:23.249183 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a05dcb2-3370-4810-96f3-9b25820d224a req-682dac8e-c10e-4e66-a8f3-23a017af0716 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0510633 Dec 09 21:34:23.484164 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75ee8fca-3231-44a2-8819-84a631d9d6b2 req-46246814-303a-4de7-b9c5-a2a6c90161c4 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:23.485587 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-75ee8fca-3231-44a2-8819-84a631d9d6b2 req-46246814-303a-4de7-b9c5-a2a6c90161c4 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0533013 Dec 09 21:34:23.535016 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-75ee8fca-3231-44a2-8819-84a631d9d6b2 req-b7efab34-c835-4ee5-998d-afdf6ae8a509 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429995 Dec 09 21:34:23.610078 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bdde3cb5-aff1-4ca9-84e1-5c6008ff4619 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:23.649264 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdde3cb5-aff1-4ca9-84e1-5c6008ff4619 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Pushing event deleted for resources: {'Port': ['ID=ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:23.659275 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-63c9f7ed-f730-41a9-855f-c57c3488d65d None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:34:23.720662 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bdde3cb5-aff1-4ca9-84e1-5c6008ff4619 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:23.818268 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bdde3cb5-aff1-4ca9-84e1-5c6008ff4619 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:23.820387 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bdde3cb5-aff1-4ca9-84e1-5c6008ff4619 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:23.878589 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bdde3cb5-aff1-4ca9-84e1-5c6008ff4619 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:23.879251 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bdde3cb5-aff1-4ca9-84e1-5c6008ff4619 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 24144312-f333-48e4-9a6e-0d06d4715d46 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:34:23.883702 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bdde3cb5-aff1-4ca9-84e1-5c6008ff4619 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:23.884853 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bdde3cb5-aff1-4ca9-84e1-5c6008ff4619 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "DELETE /v2.0/routers/24144312-f333-48e4-9a6e-0d06d4715d46 HTTP/1.1" status: 204 len: 168 time: 1.2737906 Dec 09 21:34:23.889632 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50180) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:23.895290 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-19fdbc61-2bf9-48d7-8c44-56ecbfbaa2c9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-384741426', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}, 'admin_state_up': False}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:23.927478 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-19fdbc61-2bf9-48d7-8c44-56ecbfbaa2c9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:23.928877 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-19fdbc61-2bf9-48d7-8c44-56ecbfbaa2c9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:23.987629 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-19fdbc61-2bf9-48d7-8c44-56ecbfbaa2c9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:24.137909 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-19fdbc61-2bf9-48d7-8c44-56ecbfbaa2c9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:24.342580 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-19fdbc61-2bf9-48d7-8c44-56ecbfbaa2c9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:24.361967 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-19fdbc61-2bf9-48d7-8c44-56ecbfbaa2c9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:24.472371 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-19fdbc61-2bf9-48d7-8c44-56ecbfbaa2c9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Allocated IP 172.25.3.47 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/a3551920-85a4-43fb-87ae-dff85397e53e) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:34:24.584076 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-19fdbc61-2bf9-48d7-8c44-56ecbfbaa2c9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:24.640977 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-19fdbc61-2bf9-48d7-8c44-56ecbfbaa2c9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:24.698748 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-19fdbc61-2bf9-48d7-8c44-56ecbfbaa2c9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:34:24.701926 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19fdbc61-2bf9-48d7-8c44-56ecbfbaa2c9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Pushing event updated for resources: {'Port': ['ID=a3551920-85a4-43fb-87ae-dff85397e53e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:24.705268 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-19fdbc61-2bf9-48d7-8c44-56ecbfbaa2c9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:34:24.714866 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-212eee01-a72f-4f80-b14c-dcbabfeb57be req-53252c1c-03d9-4288-91c1-7b18ef6b0b08 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:24.716808 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-212eee01-a72f-4f80-b14c-dcbabfeb57be req-53252c1c-03d9-4288-91c1-7b18ef6b0b08 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.1063917 Dec 09 21:34:24.717749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19fdbc61-2bf9-48d7-8c44-56ecbfbaa2c9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:34:24.719243 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-db851fc5-1ef9-4436-9081-4324d4f6dca0 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:34:24.808051 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3d9871bd-e32a-4583-8b22-4e95441af221 None None] Provisioning complete for port a3551920-85a4-43fb-87ae-dff85397e53e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:24.808478 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3d9871bd-e32a-4583-8b22-4e95441af221 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:24.841630 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-3d9871bd-e32a-4583-8b22-4e95441af221 None None] Port a3551920-85a4-43fb-87ae-dff85397e53e cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:34:24.852179 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-212eee01-a72f-4f80-b14c-dcbabfeb57be req-496399bf-a45b-47db-8161-ae7f2eed0312 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1137147 Dec 09 21:34:25.004923 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-19fdbc61-2bf9-48d7-8c44-56ecbfbaa2c9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:25.193262 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac745e28-cb04-434f-ac42-98f1302171c7 req-65149599-b30f-45f9-938b-609f478505b1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:25.194776 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac745e28-cb04-434f-ac42-98f1302171c7 req-65149599-b30f-45f9-938b-609f478505b1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.1247628 Dec 09 21:34:25.286948 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac745e28-cb04-434f-ac42-98f1302171c7 req-c0e9208d-c2b2-4f04-bfc2-d6adce1f1d32 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0817895 Dec 09 21:34:25.292096 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-19fdbc61-2bf9-48d7-8c44-56ecbfbaa2c9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:25.431101 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-19fdbc61-2bf9-48d7-8c44-56ecbfbaa2c9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Router c44ce115-28e9-4f9f-a65b-1286323d72af is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:34:25.456707 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:34:25.477726 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:34:25.478075 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device ab7922cc-91dc-4b12-a4ef-eb73e0c0efa3 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:34:25.537793 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-19fdbc61-2bf9-48d7-8c44-56ecbfbaa2c9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:34:25.547997 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1385eb86-8ce7-49b5-8136-32cece2f7f57 None None] Sync routers for ids ['c44ce115-28e9-4f9f-a65b-1286323d72af'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:34:25.560747 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-19fdbc61-2bf9-48d7-8c44-56ecbfbaa2c9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:25.562012 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-19fdbc61-2bf9-48d7-8c44-56ecbfbaa2c9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 887 time: 1.6713064 Dec 09 21:34:25.562220 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1385eb86-8ce7-49b5-8136-32cece2f7f57 None None] Routers {'c44ce115-28e9-4f9f-a65b-1286323d72af'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:34:25.563086 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-1385eb86-8ce7-49b5-8136-32cece2f7f57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:34:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['c44ce115-28e9-4f9f-a65b-1286323d72af'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:25.565073 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50206) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:25.569407 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-04eb8fa9-099a-4bc9-a394-ffb2e4e8d026 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'enable_snat': False}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:25.596118 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-1385eb86-8ce7-49b5-8136-32cece2f7f57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:25.605531 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1385eb86-8ce7-49b5-8136-32cece2f7f57 None None] Routers {'c44ce115-28e9-4f9f-a65b-1286323d72af'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:34:25.606212 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-1385eb86-8ce7-49b5-8136-32cece2f7f57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:34:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['c44ce115-28e9-4f9f-a65b-1286323d72af'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:25.638425 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-1385eb86-8ce7-49b5-8136-32cece2f7f57 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:25.639048 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1385eb86-8ce7-49b5-8136-32cece2f7f57 None None] The sync data for ids ['c44ce115-28e9-4f9f-a65b-1286323d72af'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:34:26.119861 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-04eb8fa9-099a-4bc9-a394-ffb2e4e8d026 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:26.453476 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-502642b7-8815-43ed-bd73-466035ba519c req-504789f2-2c65-4fdc-a144-19d1b524bcee tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:26.454980 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-502642b7-8815-43ed-bd73-466035ba519c req-504789f2-2c65-4fdc-a144-19d1b524bcee tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0937209 Dec 09 21:34:26.576506 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-502642b7-8815-43ed-bd73-466035ba519c req-8f806c23-cfb4-488e-88eb-ed2b80cf6a96 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1136031 Dec 09 21:34:26.588313 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-04eb8fa9-099a-4bc9-a394-ffb2e4e8d026 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:26.592389 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-04eb8fa9-099a-4bc9-a394-ffb2e4e8d026 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-640457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-640448', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-635166'] for router, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:26.732347 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-04eb8fa9-099a-4bc9-a394-ffb2e4e8d026 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Router c44ce115-28e9-4f9f-a65b-1286323d72af has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:34:26.747245 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cb90218-ad4d-46ca-852e-24e0114bc52a req-edee27fd-287b-4d88-bdda-736f3019a569 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:26.748775 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3cb90218-ad4d-46ca-852e-24e0114bc52a req-edee27fd-287b-4d88-bdda-736f3019a569 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0728886 Dec 09 21:34:26.865872 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3cb90218-ad4d-46ca-852e-24e0114bc52a req-41e16af0-e825-4454-8096-ccaea27caaff tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1102662 Dec 09 21:34:26.884210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-04eb8fa9-099a-4bc9-a394-ffb2e4e8d026 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:34:26.889511 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-04eb8fa9-099a-4bc9-a394-ffb2e4e8d026 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:26.890350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-04eb8fa9-099a-4bc9-a394-ffb2e4e8d026 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "PUT /v2.0/routers/c44ce115-28e9-4f9f-a65b-1286323d72af HTTP/1.1" status: 200 len: 924 time: 1.3242261 Dec 09 21:34:26.892846 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50222) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:26.895670 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d782082c-43ea-43b2-9a79-a613ebbd04e3 None None] Sync routers for ids ['c44ce115-28e9-4f9f-a65b-1286323d72af'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:34:26.907743 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d782082c-43ea-43b2-9a79-a613ebbd04e3 None None] Routers {'c44ce115-28e9-4f9f-a65b-1286323d72af'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:34:26.908403 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d782082c-43ea-43b2-9a79-a613ebbd04e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:34:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['c44ce115-28e9-4f9f-a65b-1286323d72af'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:26.941137 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d782082c-43ea-43b2-9a79-a613ebbd04e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:26.950316 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d782082c-43ea-43b2-9a79-a613ebbd04e3 None None] Routers {'c44ce115-28e9-4f9f-a65b-1286323d72af'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:34:26.950906 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d782082c-43ea-43b2-9a79-a613ebbd04e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:34:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['c44ce115-28e9-4f9f-a65b-1286323d72af'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:26.986152 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d782082c-43ea-43b2-9a79-a613ebbd04e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:26.986704 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d782082c-43ea-43b2-9a79-a613ebbd04e3 None None] The sync data for ids ['c44ce115-28e9-4f9f-a65b-1286323d72af'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:34:27.030059 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-070d582d-6ca8-44e7-8276-37a10a728ed0 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "GET /v2.0/routers/c44ce115-28e9-4f9f-a65b-1286323d72af HTTP/1.1" status: 200 len: 924 time: 0.1361153 Dec 09 21:34:27.033180 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50226) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:27.046010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eead34c-1f99-49ab-98ea-e904fbb14853 req-c6b7459e-718a-4c6a-97c4-609edb6f2221 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:27.047453 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9eead34c-1f99-49ab-98ea-e904fbb14853 req-c6b7459e-718a-4c6a-97c4-609edb6f2221 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0608244 Dec 09 21:34:27.100363 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9eead34c-1f99-49ab-98ea-e904fbb14853 req-ea0f9390-9e4b-429f-8f85-456f45a4f816 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467181 Dec 09 21:34:27.106736 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2fbe7044-581b-467c-b0b5-a7fa1bd5bc70 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:27.108365 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2fbe7044-581b-467c-b0b5-a7fa1bd5bc70 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "GET /v2.0/ports?network_id=97925a19-460a-4476-8208-41db134b6c83&device_id=c44ce115-28e9-4f9f-a65b-1286323d72af&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.0741587 Dec 09 21:34:27.111186 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50228) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:27.203427 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-219d058c-dfa4-4224-a2b4-73c7d6400770 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:27.204878 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-219d058c-dfa4-4224-a2b4-73c7d6400770 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 881 time: 0.0926428 Dec 09 21:34:27.207815 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50238) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:27.228199 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d90d41e-b9b4-4158-86c0-615f0e9285d5 req-5a2196e2-1fbb-422a-935c-31db16616dbb tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:27.229655 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8d90d41e-b9b4-4158-86c0-615f0e9285d5 req-5a2196e2-1fbb-422a-935c-31db16616dbb tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0577424 Dec 09 21:34:27.236926 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:27.239015 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:27.243480 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-263a38bf-2774-48a7-9fe1-eed3fc24737d tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "GET /v2.0/ports?device_id=c44ce115-28e9-4f9f-a65b-1286323d72af HTTP/1.1" status: 200 len: 205 time: 0.0341177 Dec 09 21:34:27.245672 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50240) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:27.315489 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8d90d41e-b9b4-4158-86c0-615f0e9285d5 req-e238e9e5-d4a8-4f7d-98de-dc06f07841cf tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0788214 Dec 09 21:34:27.324025 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38b22bef-4215-4c60-b9d0-61e25ebb8277 req-a52dacc1-5fe1-427d-b1b4-78217574744b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:27.325508 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38b22bef-4215-4c60-b9d0-61e25ebb8277 req-a52dacc1-5fe1-427d-b1b4-78217574744b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0733624 Dec 09 21:34:27.363220 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f139139e-fd07-4ab7-b867-fd14be35e16f tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:27.384852 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38b22bef-4215-4c60-b9d0-61e25ebb8277 req-ca8bca85-4541-440d-9264-fc28766fb377 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465105 Dec 09 21:34:27.479838 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f139139e-fd07-4ab7-b867-fd14be35e16f tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:27.537969 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-f139139e-fd07-4ab7-b867-fd14be35e16f tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Deleting port a3551920-85a4-43fb-87ae-dff85397e53e {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:34:27.538318 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f139139e-fd07-4ab7-b867-fd14be35e16f tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:27.586386 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8d34572-1876-44dd-adca-681a7d8d50d0 req-b6c9972b-d234-42f0-8dac-a5a8e184a17f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:27.588011 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8d34572-1876-44dd-adca-681a7d8d50d0 req-b6c9972b-d234-42f0-8dac-a5a8e184a17f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0860918 Dec 09 21:34:27.596401 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c87f72d-b00b-47d7-8bd7-1a023a15d4e1 req-7f801e3a-860a-41e2-b6ef-651ad578b640 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:27.597808 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c87f72d-b00b-47d7-8bd7-1a023a15d4e1 req-7f801e3a-860a-41e2-b6ef-651ad578b640 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0617156 Dec 09 21:34:27.618938 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f139139e-fd07-4ab7-b867-fd14be35e16f tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:27.632059 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-f139139e-fd07-4ab7-b867-fd14be35e16f tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Calling delete_port for a3551920-85a4-43fb-87ae-dff85397e53e owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:34:27.666313 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8d34572-1876-44dd-adca-681a7d8d50d0 req-cfa23be2-049a-4382-a728-35f048c39b8d tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0675404 Dec 09 21:34:27.678878 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c87f72d-b00b-47d7-8bd7-1a023a15d4e1 req-9e09b095-8b6a-4a75-a6d3-5f479bcc7f43 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0732965 Dec 09 21:34:27.817701 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f139139e-fd07-4ab7-b867-fd14be35e16f tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:27.823456 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88a8f56e-8119-437f-9633-09da8f3e26f9 req-7495db8d-faac-4604-b996-6d467b8e746f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:27.823456 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-88a8f56e-8119-437f-9633-09da8f3e26f9 req-7495db8d-faac-4604-b996-6d467b8e746f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0569255 Dec 09 21:34:27.845800 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f139139e-fd07-4ab7-b867-fd14be35e16f tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Pushing event deleted for resources: {'Port': ['ID=a3551920-85a4-43fb-87ae-dff85397e53e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:27.872226 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7f85469-e88c-4b17-9f06-5c7ab3b7bef5 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:34:27.903398 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-88a8f56e-8119-437f-9633-09da8f3e26f9 req-d0eca07b-1b2c-444d-b5bd-4031586b8785 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0742710 Dec 09 21:34:27.911874 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f139139e-fd07-4ab7-b867-fd14be35e16f tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:27.955632 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ec845e1-e647-4aea-ab51-6b4055f8127c req-74e43a53-1f97-482d-9fe1-739ae47d0a08 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:27.957391 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ec845e1-e647-4aea-ab51-6b4055f8127c req-74e43a53-1f97-482d-9fe1-739ae47d0a08 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0529950 Dec 09 21:34:28.012856 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ec845e1-e647-4aea-ab51-6b4055f8127c req-d31a750c-5153-41a2-843d-e903267f4b86 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0489371 Dec 09 21:34:28.014344 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f139139e-fd07-4ab7-b867-fd14be35e16f tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:28.016645 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f139139e-fd07-4ab7-b867-fd14be35e16f tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:28.068536 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f139139e-fd07-4ab7-b867-fd14be35e16f tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:28.069312 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f139139e-fd07-4ab7-b867-fd14be35e16f tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Fanout notify agent at l3_agent the message router_deleted on router c44ce115-28e9-4f9f-a65b-1286323d72af {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:34:28.078283 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0cee961-1ba7-472d-bbcd-93471697b6d9 req-762386d7-40c9-4b97-ae53-8e3ae5814a82 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:28.079870 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0cee961-1ba7-472d-bbcd-93471697b6d9 req-762386d7-40c9-4b97-ae53-8e3ae5814a82 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0547757 Dec 09 21:34:28.084912 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f139139e-fd07-4ab7-b867-fd14be35e16f tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:28.086160 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f139139e-fd07-4ab7-b867-fd14be35e16f tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "DELETE /v2.0/routers/c44ce115-28e9-4f9f-a65b-1286323d72af HTTP/1.1" status: 204 len: 168 time: 0.8394966 Dec 09 21:34:28.090432 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50266) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:28.095210 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-eeaa9584-67ce-4634-9ee8-73222ad3b34e tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-1108380650', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:28.120190 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eeaa9584-67ce-4634-9ee8-73222ad3b34e tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:28.121548 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eeaa9584-67ce-4634-9ee8-73222ad3b34e tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:28.137368 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0cee961-1ba7-472d-bbcd-93471697b6d9 req-1c0b37c3-b864-492d-955b-de934bc23024 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469954 Dec 09 21:34:28.176161 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eeaa9584-67ce-4634-9ee8-73222ad3b34e tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:28.180753 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eeaa9584-67ce-4634-9ee8-73222ad3b34e tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:28.203784 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eeaa9584-67ce-4634-9ee8-73222ad3b34e tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:28.207887 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-eeaa9584-67ce-4634-9ee8-73222ad3b34e tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.1137967 Dec 09 21:34:28.208341 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50272) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:28.213823 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-d6ecaaa9-6421-46a0-9564-a19979658cb8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Request body: {'router': {'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:28.374553 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5920a1c7-c434-4edf-9cb4-fcebaaec257a req-7999149f-0786-40c0-9f6a-351b052e1440 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:28.376031 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5920a1c7-c434-4edf-9cb4-fcebaaec257a req-7999149f-0786-40c0-9f6a-351b052e1440 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.1589246 Dec 09 21:34:28.513769 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6ecaaa9-6421-46a0-9564-a19979658cb8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:28.541885 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39d3f33e-0989-4ed7-8078-9a67e79d9b06 req-e4866487-276a-459d-945d-4311160e8e27 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:28.543586 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-39d3f33e-0989-4ed7-8078-9a67e79d9b06 req-e4866487-276a-459d-945d-4311160e8e27 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1889327 Dec 09 21:34:28.548085 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5920a1c7-c434-4edf-9cb4-fcebaaec257a req-e6ccd070-7d59-4a2b-ba63-ef098d4f0cff tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1444466 Dec 09 21:34:28.627857 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-39d3f33e-0989-4ed7-8078-9a67e79d9b06 req-742a7307-c939-4bf2-a9ae-066dd5f3d743 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0704482 Dec 09 21:34:29.052606 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6ecaaa9-6421-46a0-9564-a19979658cb8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:29.073402 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6ecaaa9-6421-46a0-9564-a19979658cb8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:29.122870 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-342d6518-4887-4a9e-923b-592524709726 req-c1e5e22f-20ae-46bc-aa41-d3c7ffde0ff2 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:29.124318 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-342d6518-4887-4a9e-923b-592524709726 req-c1e5e22f-20ae-46bc-aa41-d3c7ffde0ff2 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.3606205 Dec 09 21:34:29.214459 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-342d6518-4887-4a9e-923b-592524709726 req-5a2e4a09-cf9f-4dd7-b605-1056cea66af4 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0833998 Dec 09 21:34:29.235203 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-d6ecaaa9-6421-46a0-9564-a19979658cb8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Allocated IP 172.25.3.230 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/cbcb5503-b738-41f5-9395-d1534f4b819c) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:34:29.368269 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-507c9dba-5ec2-4378-b747-8015fdb881c2 req-760278da-20bc-4a63-9a54-ee07a1108e31 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:29.369730 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-507c9dba-5ec2-4378-b747-8015fdb881c2 req-760278da-20bc-4a63-9a54-ee07a1108e31 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0791523 Dec 09 21:34:29.372792 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6ecaaa9-6421-46a0-9564-a19979658cb8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:29.437554 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-507c9dba-5ec2-4378-b747-8015fdb881c2 req-afbfe9a1-f40e-4f8f-8763-7aa3ad4c721a tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0602708 Dec 09 21:34:29.440262 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6ecaaa9-6421-46a0-9564-a19979658cb8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:29.482123 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d6ecaaa9-6421-46a0-9564-a19979658cb8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:34:29.485208 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-d6ecaaa9-6421-46a0-9564-a19979658cb8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:34:29.491030 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6ecaaa9-6421-46a0-9564-a19979658cb8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:34:29.500151 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32b27115-59a4-4a0b-999c-63dff9dbcefb None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:34:29.514247 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6ecaaa9-6421-46a0-9564-a19979658cb8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Pushing event updated for resources: {'Port': ['ID=cbcb5503-b738-41f5-9395-d1534f4b819c,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:29.624986 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-768a8d9c-ee72-44a6-b928-900c86589dfd None None] Provisioning complete for port cbcb5503-b738-41f5-9395-d1534f4b819c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:29.625443 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-768a8d9c-ee72-44a6-b928-900c86589dfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:29.663715 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-768a8d9c-ee72-44a6-b928-900c86589dfd None None] Port cbcb5503-b738-41f5-9395-d1534f4b819c cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:34:29.682722 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85418f00-d4ea-47bd-8293-d81061846189 req-7d9c6aa3-88f8-4933-91e0-a0ae0e09bf8a tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:29.684889 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85418f00-d4ea-47bd-8293-d81061846189 req-7d9c6aa3-88f8-4933-91e0-a0ae0e09bf8a tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.1494942 Dec 09 21:34:29.835389 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85418f00-d4ea-47bd-8293-d81061846189 req-0a49c2d9-db7e-4bc5-aecf-02b64e756670 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1434033 Dec 09 21:34:29.875039 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4a279ff-56a1-45b4-bdff-e36dada37951 req-124ec734-f760-4ba8-83f4-9c12f9375a72 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:29.876584 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d4a279ff-56a1-45b4-bdff-e36dada37951 req-124ec734-f760-4ba8-83f4-9c12f9375a72 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1277297 Dec 09 21:34:29.881312 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6ecaaa9-6421-46a0-9564-a19979658cb8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:30.000993 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d4a279ff-56a1-45b4-bdff-e36dada37951 req-34008cf1-78a6-4770-a643-4c8f4f513dd0 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1175518 Dec 09 21:34:30.071006 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:34:30.147301 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33d68dce-f06f-414f-96f9-68bbedaa7722 req-c52a9c1b-947b-422e-876a-2b98279ac772 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:30.149174 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-33d68dce-f06f-414f-96f9-68bbedaa7722 req-c52a9c1b-947b-422e-876a-2b98279ac772 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0946324 Dec 09 21:34:30.165260 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6ecaaa9-6421-46a0-9564-a19979658cb8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:30.174975 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6ecaaa9-6421-46a0-9564-a19979658cb8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-640457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-640448', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-635166'] for router, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:30.244991 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-33d68dce-f06f-414f-96f9-68bbedaa7722 req-a9d5ff58-374c-46c9-b441-c1c97212780e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0881293 Dec 09 21:34:30.329104 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d6ecaaa9-6421-46a0-9564-a19979658cb8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Router 824d46af-34de-4800-8780-79bfdc1f6a67 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:34:30.469390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdca9f78-dd98-46a3-8a48-a788d046f553 req-78bce5c7-7568-4d23-b6b9-0f49565a1a4b tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:30.470746 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fdca9f78-dd98-46a3-8a48-a788d046f553 req-78bce5c7-7568-4d23-b6b9-0f49565a1a4b tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0978343 Dec 09 21:34:30.475850 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d6ecaaa9-6421-46a0-9564-a19979658cb8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:34:30.484866 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6ecaaa9-6421-46a0-9564-a19979658cb8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:30.485957 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4b7be89-9d99-4a6d-8d58-4477b733b2b0 None None] Sync routers for ids ['824d46af-34de-4800-8780-79bfdc1f6a67'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:34:30.486191 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d6ecaaa9-6421-46a0-9564-a19979658cb8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "PUT /v2.0/routers/824d46af-34de-4800-8780-79bfdc1f6a67 HTTP/1.1" status: 200 len: 884 time: 2.2764585 Dec 09 21:34:30.488944 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50306) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:30.509136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4b7be89-9d99-4a6d-8d58-4477b733b2b0 None None] Routers {'824d46af-34de-4800-8780-79bfdc1f6a67'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:34:30.509802 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b4b7be89-9d99-4a6d-8d58-4477b733b2b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:34:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['824d46af-34de-4800-8780-79bfdc1f6a67'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:30.544301 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fdca9f78-dd98-46a3-8a48-a788d046f553 req-21e7adf9-ff2d-4770-863f-962c450ba93d tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0659177 Dec 09 21:34:30.547356 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b4b7be89-9d99-4a6d-8d58-4477b733b2b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:30.558261 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4b7be89-9d99-4a6d-8d58-4477b733b2b0 None None] Routers {'824d46af-34de-4800-8780-79bfdc1f6a67'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:34:30.558890 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b4b7be89-9d99-4a6d-8d58-4477b733b2b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:34:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['824d46af-34de-4800-8780-79bfdc1f6a67'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:30.590939 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b4b7be89-9d99-4a6d-8d58-4477b733b2b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:30.591619 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4b7be89-9d99-4a6d-8d58-4477b733b2b0 None None] The sync data for ids ['824d46af-34de-4800-8780-79bfdc1f6a67'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:34:30.608875 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-33b9cc9a-a80c-4c59-a587-62add9616865 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "GET /v2.0/routers/824d46af-34de-4800-8780-79bfdc1f6a67 HTTP/1.1" status: 200 len: 925 time: 0.1186607 Dec 09 21:34:30.611618 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50310) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:30.652297 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68b40e6d-7acc-46ea-9178-3978b941076e tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:30.653864 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-68b40e6d-7acc-46ea-9178-3978b941076e tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "GET /v2.0/ports?network_id=97925a19-460a-4476-8208-41db134b6c83&device_id=824d46af-34de-4800-8780-79bfdc1f6a67&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.0413284 Dec 09 21:34:30.656572 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50312) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:30.664798 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c076ad00-3e77-4a60-8842-70a0310f5a2e req-46f0c29b-eb1a-494c-ae32-82d26263cde2 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:30.666301 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c076ad00-3e77-4a60-8842-70a0310f5a2e req-46f0c29b-eb1a-494c-ae32-82d26263cde2 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0488706 Dec 09 21:34:30.714648 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c076ad00-3e77-4a60-8842-70a0310f5a2e req-6b94585e-1dc6-453a-8ab6-50705a95172f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415370 Dec 09 21:34:30.746029 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b23afef4-4f54-4fd5-a6ca-acd6fe3f9aa9 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:30.750142 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b23afef4-4f54-4fd5-a6ca-acd6fe3f9aa9 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 881 time: 0.0900078 Dec 09 21:34:30.750404 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50318) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:30.778485 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9474037c-51d7-4ef4-8d2f-43048e7b7cfd tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "GET /v2.0/ports?device_id=824d46af-34de-4800-8780-79bfdc1f6a67 HTTP/1.1" status: 200 len: 205 time: 0.0268698 Dec 09 21:34:30.780922 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50322) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:30.910286 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51981396-7fd4-42b5-b3e6-77b6ccceac04 req-eca4152e-2a1d-4cea-b74c-d65c690b36b7 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:30.911951 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51981396-7fd4-42b5-b3e6-77b6ccceac04 req-eca4152e-2a1d-4cea-b74c-d65c690b36b7 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0903397 Dec 09 21:34:30.937751 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f60c093d-683e-4c94-ad69-221c392fb7f5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:31.012224 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51981396-7fd4-42b5-b3e6-77b6ccceac04 req-79e1119c-7db7-4824-bb3d-f5f1669351e4 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0932732 Dec 09 21:34:31.071837 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f60c093d-683e-4c94-ad69-221c392fb7f5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:31.182487 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88616d35-0214-4a0d-82e7-8a6a19884184 req-a076191b-213e-40a9-abfd-e37da8cba47e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:31.184023 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-88616d35-0214-4a0d-82e7-8a6a19884184 req-a076191b-213e-40a9-abfd-e37da8cba47e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1006687 Dec 09 21:34:31.207689 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2b21bba-54e4-4c16-b19f-aa06df842a9d req-b3829040-0875-4903-b2c6-b6c85e3757ad tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:31.209214 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2b21bba-54e4-4c16-b19f-aa06df842a9d req-b3829040-0875-4903-b2c6-b6c85e3757ad tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0838945 Dec 09 21:34:31.237422 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-f60c093d-683e-4c94-ad69-221c392fb7f5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Deleting port cbcb5503-b738-41f5-9395-d1534f4b819c {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:34:31.237664 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f60c093d-683e-4c94-ad69-221c392fb7f5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:31.334191 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-88616d35-0214-4a0d-82e7-8a6a19884184 req-66236820-925d-402b-a0b9-bac54c1ab302 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1426694 Dec 09 21:34:31.338953 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2b21bba-54e4-4c16-b19f-aa06df842a9d req-267febfe-d9d1-481e-89d0-d4f28dc8c06f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1194830 Dec 09 21:34:31.357849 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f60c093d-683e-4c94-ad69-221c392fb7f5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:31.370534 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-f60c093d-683e-4c94-ad69-221c392fb7f5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Calling delete_port for cbcb5503-b738-41f5-9395-d1534f4b819c owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:34:31.556751 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9203f9f3-5e67-4ffd-8035-59290ba6c774 req-2724b34e-3db4-4179-a26d-fd1aaf6c3cd5 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:31.558141 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9203f9f3-5e67-4ffd-8035-59290ba6c774 req-2724b34e-3db4-4179-a26d-fd1aaf6c3cd5 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0881245 Dec 09 21:34:31.591865 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f60c093d-683e-4c94-ad69-221c392fb7f5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:31.640473 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f60c093d-683e-4c94-ad69-221c392fb7f5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Pushing event deleted for resources: {'Port': ['ID=cbcb5503-b738-41f5-9395-d1534f4b819c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:31.647368 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb45b3fc-7e80-4484-a6aa-8ae0af242f9d None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:34:31.648704 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9203f9f3-5e67-4ffd-8035-59290ba6c774 req-cb60e91f-a892-46a6-87b6-8db94be137ff tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0836890 Dec 09 21:34:31.700940 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f60c093d-683e-4c94-ad69-221c392fb7f5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:31.815566 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f60c093d-683e-4c94-ad69-221c392fb7f5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:31.824679 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f60c093d-683e-4c94-ad69-221c392fb7f5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:31.877314 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94358c49-8e8b-49b5-a0d3-5622682051a4 req-a927928f-d3e6-4a86-b8a1-7c225f3e6709 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:31.878825 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94358c49-8e8b-49b5-a0d3-5622682051a4 req-a927928f-d3e6-4a86-b8a1-7c225f3e6709 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.1516387 Dec 09 21:34:31.879930 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f60c093d-683e-4c94-ad69-221c392fb7f5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:31.880440 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f60c093d-683e-4c94-ad69-221c392fb7f5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Fanout notify agent at l3_agent the message router_deleted on router 824d46af-34de-4800-8780-79bfdc1f6a67 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:34:31.887243 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f60c093d-683e-4c94-ad69-221c392fb7f5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:31.888436 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f60c093d-683e-4c94-ad69-221c392fb7f5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "DELETE /v2.0/routers/824d46af-34de-4800-8780-79bfdc1f6a67 HTTP/1.1" status: 204 len: 168 time: 1.1064978 Dec 09 21:34:31.892350 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50340) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:31.896514 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-79a962ca-f0e5-45a4-acd6-e8bb9b9a5da5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-1487757438', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:31.938019 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-79a962ca-f0e5-45a4-acd6-e8bb9b9a5da5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:31.938995 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-79a962ca-f0e5-45a4-acd6-e8bb9b9a5da5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:31.968006 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94358c49-8e8b-49b5-a0d3-5622682051a4 req-f8316d8d-75b5-4845-9906-1de888a9c0db tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0786061 Dec 09 21:34:32.009830 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-79a962ca-f0e5-45a4-acd6-e8bb9b9a5da5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:32.016070 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-79a962ca-f0e5-45a4-acd6-e8bb9b9a5da5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:32.037410 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-79a962ca-f0e5-45a4-acd6-e8bb9b9a5da5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:32.037410 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-79a962ca-f0e5-45a4-acd6-e8bb9b9a5da5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.1437290 Dec 09 21:34:32.039851 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50348) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:32.045048 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-4dc062bb-b3ac-40ee-95d3-c6b676e90065 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'enable_snat': True}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:32.534031 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc38ef0e-608b-4175-8f1b-687382f5b74b req-62a455de-5f82-4b74-8078-6ae92f3337e7 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:32.535535 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc38ef0e-608b-4175-8f1b-687382f5b74b req-62a455de-5f82-4b74-8078-6ae92f3337e7 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.4218390 Dec 09 21:34:32.573390 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4dc062bb-b3ac-40ee-95d3-c6b676e90065 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:32.592857 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98e7abb9-c0c4-4f4a-9c41-58ec2432fdd9 req-b6538a28-afe4-40b0-836e-6e2b101aede0 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:32.594332 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98e7abb9-c0c4-4f4a-9c41-58ec2432fdd9 req-b6538a28-afe4-40b0-836e-6e2b101aede0 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1779013 Dec 09 21:34:32.651897 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc38ef0e-608b-4175-8f1b-687382f5b74b req-0738be78-04ff-4b76-9d41-7d82f8dac53b tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0899682 Dec 09 21:34:32.689651 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98e7abb9-c0c4-4f4a-9c41-58ec2432fdd9 req-8d41d65a-6854-477a-b3d6-604d35c01597 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0827751 Dec 09 21:34:32.785611 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba3355c0-2819-41ae-9860-16a7490b01f8 req-3e548be5-1138-4a3d-beef-666fff57931e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:32.787084 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba3355c0-2819-41ae-9860-16a7490b01f8 req-3e548be5-1138-4a3d-beef-666fff57931e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0639932 Dec 09 21:34:32.924159 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba3355c0-2819-41ae-9860-16a7490b01f8 req-f5f9bff7-bc8c-4bfc-a73f-af5c2cdbfcd2 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1030095 Dec 09 21:34:32.929837 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4dc062bb-b3ac-40ee-95d3-c6b676e90065 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:32.942673 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a0672bfa-7085-48c8-ae05-90f6ed1bcb2f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:32.951679 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4dc062bb-b3ac-40ee-95d3-c6b676e90065 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:33.089959 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-4dc062bb-b3ac-40ee-95d3-c6b676e90065 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Allocated IP 172.25.3.100 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/c7baeb6b-2f2c-41f1-9edd-b27fcaa04ed6) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:34:33.109215 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49709870-a3c3-4f91-90e4-38032fe9f9c7 req-3d995075-42ad-47c3-b15b-783d294dcc4a tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:33.110704 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-49709870-a3c3-4f91-90e4-38032fe9f9c7 req-3d995075-42ad-47c3-b15b-783d294dcc4a tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0989759 Dec 09 21:34:33.214023 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-49709870-a3c3-4f91-90e4-38032fe9f9c7 req-cf5a0081-0726-4460-bc80-b57eca45a18c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0956731 Dec 09 21:34:33.244102 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4dc062bb-b3ac-40ee-95d3-c6b676e90065 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:33.284450 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4dc062bb-b3ac-40ee-95d3-c6b676e90065 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:33.357019 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4dc062bb-b3ac-40ee-95d3-c6b676e90065 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:34:33.364320 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-4dc062bb-b3ac-40ee-95d3-c6b676e90065 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:34:33.371843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4dc062bb-b3ac-40ee-95d3-c6b676e90065 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:34:33.374762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dc062bb-b3ac-40ee-95d3-c6b676e90065 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Pushing event updated for resources: {'Port': ['ID=c7baeb6b-2f2c-41f1-9edd-b27fcaa04ed6,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:33.377496 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-29e1037c-500b-4cb9-977e-45eeb7095fa0 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:34:33.409455 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6c14dee8-6f90-4672-930b-1d6f036f3673 None None] Provisioning complete for port c7baeb6b-2f2c-41f1-9edd-b27fcaa04ed6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:33.409808 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6c14dee8-6f90-4672-930b-1d6f036f3673 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:33.420049 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03167305-ce68-40e2-afae-7534c9160238 req-52448ce5-82b0-4743-ac70-6e5a92eca53e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:33.421581 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-03167305-ce68-40e2-afae-7534c9160238 req-52448ce5-82b0-4743-ac70-6e5a92eca53e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.1299191 Dec 09 21:34:33.447183 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-6c14dee8-6f90-4672-930b-1d6f036f3673 None None] Port c7baeb6b-2f2c-41f1-9edd-b27fcaa04ed6 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:34:33.554135 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-03167305-ce68-40e2-afae-7534c9160238 req-2f9247fd-4eef-47dd-aacb-3f69b81d8801 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1257570 Dec 09 21:34:33.674169 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4dc062bb-b3ac-40ee-95d3-c6b676e90065 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:33.857549 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e631136-49d4-48a0-8499-1e90568321ea req-e4718be4-4543-4dbc-85c5-0ab223c4bc05 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:33.859112 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e631136-49d4-48a0-8499-1e90568321ea req-e4718be4-4543-4dbc-85c5-0ab223c4bc05 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0972788 Dec 09 21:34:33.950051 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4dc062bb-b3ac-40ee-95d3-c6b676e90065 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:33.982366 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4dc062bb-b3ac-40ee-95d3-c6b676e90065 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-640457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-640448', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-635166'] for router, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:33.989477 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e631136-49d4-48a0-8499-1e90568321ea req-1a93128e-0d2d-413a-8371-766e57c6bd48 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1160207 Dec 09 21:34:34.046066 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d506fb81-faad-4448-ba7c-9259afd05a03 req-47cde4f1-ca61-40ff-bed8-a7ac3a748f71 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:34.047728 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d506fb81-faad-4448-ba7c-9259afd05a03 req-47cde4f1-ca61-40ff-bed8-a7ac3a748f71 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.1065614 Dec 09 21:34:34.143738 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d506fb81-faad-4448-ba7c-9259afd05a03 req-1b165000-aab7-4a94-8f16-81a9cb8ace42 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0894837 Dec 09 21:34:34.173638 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4dc062bb-b3ac-40ee-95d3-c6b676e90065 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Router 62f682d3-d03e-4bb0-97bc-740de2e7ff53 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:34:34.285427 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4dc062bb-b3ac-40ee-95d3-c6b676e90065 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:34:34.290090 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4dc062bb-b3ac-40ee-95d3-c6b676e90065 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:34.291229 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4dc062bb-b3ac-40ee-95d3-c6b676e90065 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "PUT /v2.0/routers/62f682d3-d03e-4bb0-97bc-740de2e7ff53 HTTP/1.1" status: 200 len: 919 time: 2.2503724 Dec 09 21:34:34.294485 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50390) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:34.296725 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-967dcdee-db1c-4f54-ac4c-a822195bf502 None None] Sync routers for ids ['62f682d3-d03e-4bb0-97bc-740de2e7ff53'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:34:34.307162 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-967dcdee-db1c-4f54-ac4c-a822195bf502 None None] Routers {'62f682d3-d03e-4bb0-97bc-740de2e7ff53'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:34:34.307790 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-967dcdee-db1c-4f54-ac4c-a822195bf502 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:34:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['62f682d3-d03e-4bb0-97bc-740de2e7ff53'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:34.339523 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-967dcdee-db1c-4f54-ac4c-a822195bf502 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:34.348710 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-967dcdee-db1c-4f54-ac4c-a822195bf502 None None] Routers {'62f682d3-d03e-4bb0-97bc-740de2e7ff53'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:34:34.349281 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-967dcdee-db1c-4f54-ac4c-a822195bf502 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:34:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['62f682d3-d03e-4bb0-97bc-740de2e7ff53'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:34.383471 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-967dcdee-db1c-4f54-ac4c-a822195bf502 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:34.384126 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-967dcdee-db1c-4f54-ac4c-a822195bf502 None None] The sync data for ids ['62f682d3-d03e-4bb0-97bc-740de2e7ff53'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:34:34.402238 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a2cd6400-d2e6-42a4-8c99-b883b194a0cd tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "GET /v2.0/routers/62f682d3-d03e-4bb0-97bc-740de2e7ff53 HTTP/1.1" status: 200 len: 925 time: 0.1064405 Dec 09 21:34:34.405711 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50392) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:34.446790 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7c50ae-c2dd-46b5-92f4-6c95aea7ede3 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:34.448339 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-eb7c50ae-c2dd-46b5-92f4-6c95aea7ede3 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "GET /v2.0/ports?network_id=97925a19-460a-4476-8208-41db134b6c83&device_id=62f682d3-d03e-4bb0-97bc-740de2e7ff53&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 945 time: 0.0416689 Dec 09 21:34:34.451213 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50394) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:34.532337 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1db8bb6f-4047-4678-af07-e9e125131f84 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:34.533646 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1db8bb6f-4047-4678-af07-e9e125131f84 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 881 time: 0.0815122 Dec 09 21:34:34.536646 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50396) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:34.802143 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5267fc1d-87d2-4a67-94df-7d2ee7e442d4 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "GET /v2.0/ports?device_id=62f682d3-d03e-4bb0-97bc-740de2e7ff53 HTTP/1.1" status: 200 len: 205 time: 0.2642310 Dec 09 21:34:34.804475 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50398) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:34.916899 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-96fd38bb-0ea9-406b-8e59-e366ad1a7fa5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:35.021692 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-96fd38bb-0ea9-406b-8e59-e366ad1a7fa5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:35.113410 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-96fd38bb-0ea9-406b-8e59-e366ad1a7fa5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Deleting port c7baeb6b-2f2c-41f1-9edd-b27fcaa04ed6 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:34:35.113757 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-96fd38bb-0ea9-406b-8e59-e366ad1a7fa5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:35.153140 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a89dff4-5e42-4483-93a6-fdbb1dfb9311 req-a873f679-bcc6-419a-b7bb-031f51bd583f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:35.154611 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5a89dff4-5e42-4483-93a6-fdbb1dfb9311 req-a873f679-bcc6-419a-b7bb-031f51bd583f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0865667 Dec 09 21:34:35.259739 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-96fd38bb-0ea9-406b-8e59-e366ad1a7fa5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:35.276227 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-96fd38bb-0ea9-406b-8e59-e366ad1a7fa5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Calling delete_port for c7baeb6b-2f2c-41f1-9edd-b27fcaa04ed6 owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:34:35.283285 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5a89dff4-5e42-4483-93a6-fdbb1dfb9311 req-01e7de5e-84a1-4ce8-9761-440fc8f840a2 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0990653 Dec 09 21:34:35.343252 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-259dcf06-9388-4276-9e57-f316af9f5c9b req-3360f45c-5cb0-4e99-8e5f-7a31a556d655 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:35.344704 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-259dcf06-9388-4276-9e57-f316af9f5c9b req-3360f45c-5cb0-4e99-8e5f-7a31a556d655 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.1215148 Dec 09 21:34:35.441245 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-259dcf06-9388-4276-9e57-f316af9f5c9b req-cd2f41ec-5755-4c29-bb0f-b6e919c1ea4a tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0892394 Dec 09 21:34:35.496561 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-96fd38bb-0ea9-406b-8e59-e366ad1a7fa5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:35.522497 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-827d83cb-7d2b-4aca-a548-9884ef70eaa6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:35.525932 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96fd38bb-0ea9-406b-8e59-e366ad1a7fa5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Pushing event deleted for resources: {'Port': ['ID=c7baeb6b-2f2c-41f1-9edd-b27fcaa04ed6,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:35.541689 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04368c27-dabe-4308-92a8-e838ca1aad69 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:34:35.588764 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-96fd38bb-0ea9-406b-8e59-e366ad1a7fa5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:35.679823 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-96fd38bb-0ea9-406b-8e59-e366ad1a7fa5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:35.682115 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-96fd38bb-0ea9-406b-8e59-e366ad1a7fa5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:35.732272 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-96fd38bb-0ea9-406b-8e59-e366ad1a7fa5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:35.732822 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-96fd38bb-0ea9-406b-8e59-e366ad1a7fa5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Fanout notify agent at l3_agent the message router_deleted on router 62f682d3-d03e-4bb0-97bc-740de2e7ff53 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:34:35.740078 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-96fd38bb-0ea9-406b-8e59-e366ad1a7fa5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:35.741190 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-96fd38bb-0ea9-406b-8e59-e366ad1a7fa5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "DELETE /v2.0/routers/62f682d3-d03e-4bb0-97bc-740de2e7ff53 HTTP/1.1" status: 204 len: 168 time: 0.9358566 Dec 09 21:34:35.745070 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50410) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:35.749550 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-25c7435c-2215-4fac-8bf1-6fbd2e8988dd tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-844839776', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:35.776164 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-25c7435c-2215-4fac-8bf1-6fbd2e8988dd tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:35.777246 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-25c7435c-2215-4fac-8bf1-6fbd2e8988dd tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:35.827635 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-25c7435c-2215-4fac-8bf1-6fbd2e8988dd tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:35.832994 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-25c7435c-2215-4fac-8bf1-6fbd2e8988dd tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:35.853867 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-25c7435c-2215-4fac-8bf1-6fbd2e8988dd tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:35.855035 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-25c7435c-2215-4fac-8bf1-6fbd2e8988dd tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 708 time: 0.1088536 Dec 09 21:34:35.858365 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50412) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:35.862595 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-f13af2bb-0be6-47f8-b131-90d2b7e20304 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'enable_snat': False}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:36.085748 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f13af2bb-0be6-47f8-b131-90d2b7e20304 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:36.286652 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f13af2bb-0be6-47f8-b131-90d2b7e20304 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:36.305663 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f13af2bb-0be6-47f8-b131-90d2b7e20304 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:36.441266 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e909868c-f0c1-46de-a9f1-4c4ddb9b43cf req-7f240bee-04c1-4f8e-a155-d74cc4669d3b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:36.442774 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e909868c-f0c1-46de-a9f1-4c4ddb9b43cf req-7f240bee-04c1-4f8e-a155-d74cc4669d3b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0867541 Dec 09 21:34:36.456340 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-f13af2bb-0be6-47f8-b131-90d2b7e20304 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Allocated IP 172.25.3.93 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/715992c9-c9f0-419c-a3aa-3827489718f2) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:34:36.553953 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e909868c-f0c1-46de-a9f1-4c4ddb9b43cf req-c8bb97d5-4b02-469e-a86f-d02a61f403cd tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0995209 Dec 09 21:34:36.588708 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:36.625500 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f13af2bb-0be6-47f8-b131-90d2b7e20304 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:36.633605 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0603eca1-6f8d-404f-861f-caa1e1ad4682 req-31181f62-31d6-4bd9-90b7-dfc0ff60f9bb tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:36.635097 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0603eca1-6f8d-404f-861f-caa1e1ad4682 req-31181f62-31d6-4bd9-90b7-dfc0ff60f9bb tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0855114 Dec 09 21:34:36.699454 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0603eca1-6f8d-404f-861f-caa1e1ad4682 req-d67aab7d-a0bf-4c00-a7bf-36f4d79c3d55 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0576270 Dec 09 21:34:36.700893 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f13af2bb-0be6-47f8-b131-90d2b7e20304 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:36.739617 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f13af2bb-0be6-47f8-b131-90d2b7e20304 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:34:36.742558 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-f13af2bb-0be6-47f8-b131-90d2b7e20304 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:34:36.746105 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f13af2bb-0be6-47f8-b131-90d2b7e20304 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:34:36.756278 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f6ad071e-16d3-4e0c-b424-cacb6db7294a None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:34:36.777554 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f13af2bb-0be6-47f8-b131-90d2b7e20304 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Pushing event updated for resources: {'Port': ['ID=715992c9-c9f0-419c-a3aa-3827489718f2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:36.792940 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-cc92db13-7dc6-43c0-975b-aed379f76686 None None] Provisioning complete for port 715992c9-c9f0-419c-a3aa-3827489718f2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:36.793388 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cc92db13-7dc6-43c0-975b-aed379f76686 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:36.827598 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-cc92db13-7dc6-43c0-975b-aed379f76686 None None] Port 715992c9-c9f0-419c-a3aa-3827489718f2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:34:37.263265 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f13af2bb-0be6-47f8-b131-90d2b7e20304 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:37.461638 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f13af2bb-0be6-47f8-b131-90d2b7e20304 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:37.465125 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f13af2bb-0be6-47f8-b131-90d2b7e20304 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-640457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-640448', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-635166'] for router, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:37.602898 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f13af2bb-0be6-47f8-b131-90d2b7e20304 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Router 9a384259-6a33-4653-aac2-c494aa2264f0 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:34:37.744287 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-020ae700-51f4-4a9a-a80a-c3fad022b9a4 req-9a1991f4-5f41-4b17-ba5f-ec05bd4cb8eb tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:37.746525 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-020ae700-51f4-4a9a-a80a-c3fad022b9a4 req-9a1991f4-5f41-4b17-ba5f-ec05bd4cb8eb tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0978587 Dec 09 21:34:37.751031 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f13af2bb-0be6-47f8-b131-90d2b7e20304 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:34:37.756704 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f13af2bb-0be6-47f8-b131-90d2b7e20304 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:37.759764 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f13af2bb-0be6-47f8-b131-90d2b7e20304 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "PUT /v2.0/routers/9a384259-6a33-4653-aac2-c494aa2264f0 HTTP/1.1" status: 200 len: 918 time: 1.8979335 Dec 09 21:34:37.760046 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50434) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:37.760554 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4bc6ddf-8545-4329-851b-936441936177 None None] Sync routers for ids ['9a384259-6a33-4653-aac2-c494aa2264f0'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:34:37.772506 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4bc6ddf-8545-4329-851b-936441936177 None None] Routers {'9a384259-6a33-4653-aac2-c494aa2264f0'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:34:37.773495 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a4bc6ddf-8545-4329-851b-936441936177 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:34:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9a384259-6a33-4653-aac2-c494aa2264f0'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:37.810775 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a4bc6ddf-8545-4329-851b-936441936177 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:37.822255 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4bc6ddf-8545-4329-851b-936441936177 None None] Routers {'9a384259-6a33-4653-aac2-c494aa2264f0'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:34:37.822255 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a4bc6ddf-8545-4329-851b-936441936177 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:34:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9a384259-6a33-4653-aac2-c494aa2264f0'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:37.856455 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a4bc6ddf-8545-4329-851b-936441936177 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:37.857430 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4bc6ddf-8545-4329-851b-936441936177 None None] The sync data for ids ['9a384259-6a33-4653-aac2-c494aa2264f0'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:34:37.904825 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-020ae700-51f4-4a9a-a80a-c3fad022b9a4 req-4ba727d1-3bc2-4535-8643-bb7b84cd4ff1 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1506753 Dec 09 21:34:37.930700 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:37.936100 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fca012b-3103-4554-8906-5ff71cbd9c6b req-5ba4f689-78a4-44b0-a172-2ece3d45c6fd tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:37.937638 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0fca012b-3103-4554-8906-5ff71cbd9c6b req-5ba4f689-78a4-44b0-a172-2ece3d45c6fd tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.1595235 Dec 09 21:34:37.942742 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e101f6ca-0215-4e8d-9750-46a2c696eee0 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "GET /v2.0/routers/9a384259-6a33-4653-aac2-c494aa2264f0 HTTP/1.1" status: 200 len: 924 time: 0.1789501 Dec 09 21:34:37.942962 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50436) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:38.017553 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb686b91-501c-469b-aa28-016cd07291b8 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:38.018986 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cb686b91-501c-469b-aa28-016cd07291b8 tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "GET /v2.0/ports?network_id=97925a19-460a-4476-8208-41db134b6c83&device_id=9a384259-6a33-4653-aac2-c494aa2264f0&device_owner=network%3Arouter_gateway HTTP/1.1" status: 200 len: 944 time: 0.0750363 Dec 09 21:34:38.021995 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50438) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:38.022746 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0fca012b-3103-4554-8906-5ff71cbd9c6b req-aca81c8a-3e9b-4166-8240-eb553868e42c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712729 Dec 09 21:34:38.109481 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6e549b0a-1e7c-4dd1-bb7f-242890b3c1fd tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:38.110910 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6e549b0a-1e7c-4dd1-bb7f-242890b3c1fd tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "GET /v2.0/networks/97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 881 time: 0.0873430 Dec 09 21:34:38.113859 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50440) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:38.140099 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9dd63b95-01a6-4e27-9068-3c772a3d87f4 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "GET /v2.0/ports?device_id=9a384259-6a33-4653-aac2-c494aa2264f0 HTTP/1.1" status: 200 len: 205 time: 0.0251925 Dec 09 21:34:38.142604 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50442) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:38.247912 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c4de146-6bf6-4c21-871b-06515de4e8e8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:38.352749 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c4de146-6bf6-4c21-871b-06515de4e8e8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:38.408096 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-4c4de146-6bf6-4c21-871b-06515de4e8e8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Deleting port 715992c9-c9f0-419c-a3aa-3827489718f2 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:34:38.408437 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c4de146-6bf6-4c21-871b-06515de4e8e8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:38.485381 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c4de146-6bf6-4c21-871b-06515de4e8e8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:38.497568 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-4c4de146-6bf6-4c21-871b-06515de4e8e8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Calling delete_port for 715992c9-c9f0-419c-a3aa-3827489718f2 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:34:38.666246 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c4de146-6bf6-4c21-871b-06515de4e8e8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:38.694208 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c4de146-6bf6-4c21-871b-06515de4e8e8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Pushing event deleted for resources: {'Port': ['ID=715992c9-c9f0-419c-a3aa-3827489718f2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:38.708914 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e8cad11a-60b3-44cd-ac85-27fdb569a590 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:34:38.759038 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c4de146-6bf6-4c21-871b-06515de4e8e8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:38.851411 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c4de146-6bf6-4c21-871b-06515de4e8e8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:38.853722 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c4de146-6bf6-4c21-871b-06515de4e8e8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:38.900323 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c4de146-6bf6-4c21-871b-06515de4e8e8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:38.901291 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4c4de146-6bf6-4c21-871b-06515de4e8e8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Fanout notify agent at l3_agent the message router_deleted on router 9a384259-6a33-4653-aac2-c494aa2264f0 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:34:38.909209 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c4de146-6bf6-4c21-871b-06515de4e8e8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:38.910387 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4c4de146-6bf6-4c21-871b-06515de4e8e8 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "DELETE /v2.0/routers/9a384259-6a33-4653-aac2-c494aa2264f0 HTTP/1.1" status: 204 len: 168 time: 0.7668462 Dec 09 21:34:38.914327 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50452) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:38.919269 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-daa62a10-1e2c-4a20-86c8-718daebe69b1 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Request body: {'router': {'name': 'tempest-RoutersIpV6AdminTest-router-1047288411', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}, 'admin_state_up': False}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:38.950316 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-daa62a10-1e2c-4a20-86c8-718daebe69b1 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:38.951409 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-daa62a10-1e2c-4a20-86c8-718daebe69b1 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:39.009652 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-daa62a10-1e2c-4a20-86c8-718daebe69b1 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:39.168250 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9493a60c-c116-4ac9-863a-95f7c877440e req-1ad0d232-e38c-4d2c-bfaa-b9b4aaa94ff6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:39.169725 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9493a60c-c116-4ac9-863a-95f7c877440e req-1ad0d232-e38c-4d2c-bfaa-b9b4aaa94ff6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1701882 Dec 09 21:34:39.208149 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-daa62a10-1e2c-4a20-86c8-718daebe69b1 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:39.259426 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b9b62ae-5aaa-4711-bbfb-369890c718b3 req-77528d6a-92e9-4c75-89c1-f504c01d756e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:39.260934 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2b9b62ae-5aaa-4711-bbfb-369890c718b3 req-77528d6a-92e9-4c75-89c1-f504c01d756e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.1648619 Dec 09 21:34:39.296824 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9493a60c-c116-4ac9-863a-95f7c877440e req-c5ae4a0d-1327-4047-b32e-98aa74a7649b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0998275 Dec 09 21:34:39.341410 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2b9b62ae-5aaa-4711-bbfb-369890c718b3 req-c4f82fe5-61ca-4ae9-a75d-8aae90641f7e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0707753 Dec 09 21:34:39.518785 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-daa62a10-1e2c-4a20-86c8-718daebe69b1 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:39.561113 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-daa62a10-1e2c-4a20-86c8-718daebe69b1 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:39.638769 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:39.650656 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-324475ed-189f-4e69-93d2-9c47f236325d req-4c27f130-52b2-4965-a1ab-7b52f34cb795 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:39.652553 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-324475ed-189f-4e69-93d2-9c47f236325d req-4c27f130-52b2-4965-a1ab-7b52f34cb795 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1647272 Dec 09 21:34:39.666762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0d1ef47-3a41-4f42-b237-b019c4cb1d6f req-ed7aa28d-5f53-41be-b6a5-1f13c0d10025 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:39.668690 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c0d1ef47-3a41-4f42-b237-b019c4cb1d6f req-ed7aa28d-5f53-41be-b6a5-1f13c0d10025 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 1097 time: 0.1168399 Dec 09 21:34:39.818088 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-daa62a10-1e2c-4a20-86c8-718daebe69b1 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Allocated IP 172.25.3.228 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/d547a545-622c-460a-b612-ea7dcd4da2d1) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:34:39.831639 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-324475ed-189f-4e69-93d2-9c47f236325d req-c9f960a0-72d2-46ac-9529-2b4b269f94f7 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1678791 Dec 09 21:34:39.868162 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0d1ef47-3a41-4f42-b237-b019c4cb1d6f req-5c36de33-e221-4d3d-a4b2-d62d30c2100d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:39.869718 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c0d1ef47-3a41-4f42-b237-b019c4cb1d6f req-5c36de33-e221-4d3d-a4b2-d62d30c2100d service neutron] 10.222.0.31 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 913 time: 0.1893189 Dec 09 21:34:40.228265 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c0d1ef47-3a41-4f42-b237-b019c4cb1d6f req-ee50d0e6-e13f-4623-95cf-fe8626636b30 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=90f16e74-f2e6-416e-a079-f205615a0d8e HTTP/1.1" status: 200 len: 1000 time: 0.3483155 Dec 09 21:34:40.281052 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-daa62a10-1e2c-4a20-86c8-718daebe69b1 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:40.297586 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0d1ef47-3a41-4f42-b237-b019c4cb1d6f req-d2effc81-c3d4-461c-9992-0306869c39fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:40.299040 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c0d1ef47-3a41-4f42-b237-b019c4cb1d6f req-d2effc81-c3d4-461c-9992-0306869c39fb service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 200 len: 851 time: 0.0622032 Dec 09 21:34:40.349731 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-daa62a10-1e2c-4a20-86c8-718daebe69b1 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:40.388502 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0d1ef47-3a41-4f42-b237-b019c4cb1d6f req-6da98e64-5f84-417f-b252-96a3890765b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:40.390051 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c0d1ef47-3a41-4f42-b237-b019c4cb1d6f req-6da98e64-5f84-417f-b252-96a3890765b2 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0798903 Dec 09 21:34:40.403194 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-daa62a10-1e2c-4a20-86c8-718daebe69b1 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:34:40.417714 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-daa62a10-1e2c-4a20-86c8-718daebe69b1 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:34:40.432756 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce0c1256-7c44-4135-9ddb-75b944c9c008 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:34:40.450486 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-daa62a10-1e2c-4a20-86c8-718daebe69b1 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:34:40.474866 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-da42c749-4d4d-4003-976d-30f8f4a60f5a None None] Provisioning complete for port d547a545-622c-460a-b612-ea7dcd4da2d1 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:40.475757 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-da42c749-4d4d-4003-976d-30f8f4a60f5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:40.479181 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daa62a10-1e2c-4a20-86c8-718daebe69b1 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Pushing event updated for resources: {'Port': ['ID=d547a545-622c-460a-b612-ea7dcd4da2d1,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:40.521446 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-da42c749-4d4d-4003-976d-30f8f4a60f5a None None] Port d547a545-622c-460a-b612-ea7dcd4da2d1 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:34:40.650747 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6dc30b2-e75b-432b-8092-3d97103282a2 req-0e07caa0-ca78-4b67-b286-d6a320c67184 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:40.652461 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6dc30b2-e75b-432b-8092-3d97103282a2 req-0e07caa0-ca78-4b67-b286-d6a320c67184 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.2363565 Dec 09 21:34:40.657176 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c0d1ef47-3a41-4f42-b237-b019c4cb1d6f req-41af0660-6408-472d-9062-f245dd43e74c service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2563958 Dec 09 21:34:40.836251 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6dc30b2-e75b-432b-8092-3d97103282a2 req-07d9fc30-7adb-4eee-9557-8cf304177988 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1605234 Dec 09 21:34:40.856953 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c0d1ef47-3a41-4f42-b237-b019c4cb1d6f req-6893184f-7515-4dd6-9492-7a2b7775d3d5 service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1823721 Dec 09 21:34:40.916753 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-daa62a10-1e2c-4a20-86c8-718daebe69b1 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:41.144323 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-daa62a10-1e2c-4a20-86c8-718daebe69b1 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:41.162595 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b1d73be-0b73-4ea3-a1a4-177c07015731 req-bd5f9ebf-a329-42d5-a564-1ee7906738a6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:41.164227 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b1d73be-0b73-4ea3-a1a4-177c07015731 req-bd5f9ebf-a329-42d5-a564-1ee7906738a6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0928004 Dec 09 21:34:41.279905 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b1d73be-0b73-4ea3-a1a4-177c07015731 req-cc0c2800-ca03-4662-8bcd-782643970dba tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0863643 Dec 09 21:34:41.323142 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-daa62a10-1e2c-4a20-86c8-718daebe69b1 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Router b850f52a-e72c-4b79-8e90-cc44ef28afe3 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:34:41.447937 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-daa62a10-1e2c-4a20-86c8-718daebe69b1 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:34:41.457739 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e3462a6-b58e-4e42-9d85-6b55b1e4a1ae None None] Sync routers for ids ['b850f52a-e72c-4b79-8e90-cc44ef28afe3'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:34:41.468442 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e3462a6-b58e-4e42-9d85-6b55b1e4a1ae None None] Routers {'b850f52a-e72c-4b79-8e90-cc44ef28afe3'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:34:41.469067 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-8e3462a6-b58e-4e42-9d85-6b55b1e4a1ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:34:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['b850f52a-e72c-4b79-8e90-cc44ef28afe3'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:41.479039 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-daa62a10-1e2c-4a20-86c8-718daebe69b1 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:41.483200 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-daa62a10-1e2c-4a20-86c8-718daebe69b1 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 889 time: 2.5651193 Dec 09 21:34:41.483365 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50494) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:41.487921 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-2f3ea5e4-67c8-4e03-8513-dc646bd604ca tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Request body: {'router': {'external_gateway_info': {}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:41.502346 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-8e3462a6-b58e-4e42-9d85-6b55b1e4a1ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:41.510989 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e3462a6-b58e-4e42-9d85-6b55b1e4a1ae None None] Routers {'b850f52a-e72c-4b79-8e90-cc44ef28afe3'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:34:41.511638 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-8e3462a6-b58e-4e42-9d85-6b55b1e4a1ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:34:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['b850f52a-e72c-4b79-8e90-cc44ef28afe3'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:41.548085 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-8e3462a6-b58e-4e42-9d85-6b55b1e4a1ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:41.548921 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e3462a6-b58e-4e42-9d85-6b55b1e4a1ae None None] The sync data for ids ['b850f52a-e72c-4b79-8e90-cc44ef28afe3'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:34:42.113100 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4006962e-0bfa-42e8-8d9d-827de68dda56 req-e131617c-c608-4a35-8889-cf014d039e37 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:42.114473 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4006962e-0bfa-42e8-8d9d-827de68dda56 req-e131617c-c608-4a35-8889-cf014d039e37 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.1342807 Dec 09 21:34:42.121549 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09d7be85-90ff-4e5a-b5e3-aaeee1d0e522 req-189e65a7-b1ca-4744-8d79-0deec6cc6bba tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:42.122891 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09d7be85-90ff-4e5a-b5e3-aaeee1d0e522 req-189e65a7-b1ca-4744-8d79-0deec6cc6bba tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.1413991 Dec 09 21:34:42.126021 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f3ea5e4-67c8-4e03-8513-dc646bd604ca tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:42.163858 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f3ea5e4-67c8-4e03-8513-dc646bd604ca tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:42.227721 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09d7be85-90ff-4e5a-b5e3-aaeee1d0e522 req-d54a8d27-7a78-4089-bf3a-84c1e6450b82 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0977604 Dec 09 21:34:42.234574 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4006962e-0bfa-42e8-8d9d-827de68dda56 req-a0f832e8-7715-44b2-ad3e-1d9748d9f599 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1105094 Dec 09 21:34:42.262695 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-2f3ea5e4-67c8-4e03-8513-dc646bd604ca tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Deleting port d547a545-622c-460a-b612-ea7dcd4da2d1 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:34:42.263020 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f3ea5e4-67c8-4e03-8513-dc646bd604ca tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:42.337770 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f3ea5e4-67c8-4e03-8513-dc646bd604ca tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:42.351087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-2f3ea5e4-67c8-4e03-8513-dc646bd604ca tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Calling delete_port for d547a545-622c-460a-b612-ea7dcd4da2d1 owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:34:42.447087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e852bc8e-60ac-4124-b9c3-ab012c9769b1 req-0583af0a-0797-4f0a-ae2f-d1c846ac652d tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:42.448648 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e852bc8e-60ac-4124-b9c3-ab012c9769b1 req-0583af0a-0797-4f0a-ae2f-d1c846ac652d tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0987518 Dec 09 21:34:42.542193 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e852bc8e-60ac-4124-b9c3-ab012c9769b1 req-8c504aeb-637f-411b-8e42-61212a1acb0c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0863166 Dec 09 21:34:42.594318 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f3ea5e4-67c8-4e03-8513-dc646bd604ca tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:42.621927 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f3ea5e4-67c8-4e03-8513-dc646bd604ca tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Pushing event deleted for resources: {'Port': ['ID=d547a545-622c-460a-b612-ea7dcd4da2d1,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:42.643092 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e11d3fcb-b8d5-4b23-8699-59534d999d10 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:34:42.717218 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f3ea5e4-67c8-4e03-8513-dc646bd604ca tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:42.725888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-191a947f-5038-4705-b229-ae68615ee24e req-3b8fe9b0-5aaa-4d41-a5d6-af163ed3fd31 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:42.727385 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-191a947f-5038-4705-b229-ae68615ee24e req-3b8fe9b0-5aaa-4d41-a5d6-af163ed3fd31 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1089087 Dec 09 21:34:42.895729 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-191a947f-5038-4705-b229-ae68615ee24e req-bbb63022-e990-45ea-b119-67e6f31f44ea tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1370819 Dec 09 21:34:42.967814 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f3ea5e4-67c8-4e03-8513-dc646bd604ca tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:42.972605 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f3ea5e4-67c8-4e03-8513-dc646bd604ca tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-640457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-640448', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-635166'] for router, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:43.066415 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2f3ea5e4-67c8-4e03-8513-dc646bd604ca tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Router b850f52a-e72c-4b79-8e90-cc44ef28afe3 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:34:43.168248 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2f3ea5e4-67c8-4e03-8513-dc646bd604ca tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:34:43.175249 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f3ea5e4-67c8-4e03-8513-dc646bd604ca tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:43.176458 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2f3ea5e4-67c8-4e03-8513-dc646bd604ca tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "PUT /v2.0/routers/b850f52a-e72c-4b79-8e90-cc44ef28afe3 HTTP/1.1" status: 200 len: 710 time: 1.6921492 Dec 09 21:34:43.177769 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-868b2380-0e4c-4373-ba2b-1a8a015ac295 None None] Sync routers for ids ['b850f52a-e72c-4b79-8e90-cc44ef28afe3'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:34:43.179429 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50526) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:43.189136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-868b2380-0e4c-4373-ba2b-1a8a015ac295 None None] Routers {'b850f52a-e72c-4b79-8e90-cc44ef28afe3'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:34:43.189755 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-868b2380-0e4c-4373-ba2b-1a8a015ac295 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:34:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['b850f52a-e72c-4b79-8e90-cc44ef28afe3'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:43.225436 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-868b2380-0e4c-4373-ba2b-1a8a015ac295 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:43.234429 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-868b2380-0e4c-4373-ba2b-1a8a015ac295 None None] Routers {'b850f52a-e72c-4b79-8e90-cc44ef28afe3'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:34:43.235023 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-868b2380-0e4c-4373-ba2b-1a8a015ac295 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:34:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['b850f52a-e72c-4b79-8e90-cc44ef28afe3'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:43.266947 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87f690be-5826-4d60-b582-ac38a80a759e req-9ef901f8-cb17-4ac1-8c22-b69604635a4a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:43.268580 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-868b2380-0e4c-4373-ba2b-1a8a015ac295 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:43.268814 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-87f690be-5826-4d60-b582-ac38a80a759e req-9ef901f8-cb17-4ac1-8c22-b69604635a4a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1574910 Dec 09 21:34:43.269337 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-868b2380-0e4c-4373-ba2b-1a8a015ac295 None None] The sync data for ids ['b850f52a-e72c-4b79-8e90-cc44ef28afe3'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:34:43.271977 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e90b26a1-012a-484e-9241-4bc6cf87c67a tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "GET /v2.0/routers/b850f52a-e72c-4b79-8e90-cc44ef28afe3 HTTP/1.1" status: 200 len: 745 time: 0.0914555 Dec 09 21:34:43.274548 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50532) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:43.307287 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-aca77c2a-ae66-45fd-8e95-69a56dd1c06a tempest-RoutersIpV6AdminTest-303133041 tempest-RoutersIpV6AdminTest-303133041-project-admin] 10.222.0.13 "GET /v2.0/ports?network_id=97925a19-460a-4476-8208-41db134b6c83&device_id=b850f52a-e72c-4b79-8e90-cc44ef28afe3 HTTP/1.1" status: 200 len: 205 time: 0.0302420 Dec 09 21:34:43.309922 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50534) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:43.335690 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ecc25f3b-211a-44eb-bbcc-e6592b608f00 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "GET /v2.0/ports?device_id=b850f52a-e72c-4b79-8e90-cc44ef28afe3 HTTP/1.1" status: 200 len: 205 time: 0.0245852 Dec 09 21:34:43.338157 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50536) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:43.350951 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-87f690be-5826-4d60-b582-ac38a80a759e req-e96fb52d-5546-4a23-bdc7-e198cc3364b3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0678635 Dec 09 21:34:43.374743 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a051704-48be-4cc8-a117-d001754e7ec7 req-3243e3ad-78d4-44f6-a006-bbf3ef41c053 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:43.374743 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a051704-48be-4cc8-a117-d001754e7ec7 req-3243e3ad-78d4-44f6-a006-bbf3ef41c053 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0665748 Dec 09 21:34:43.418019 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f33336d7-40cc-477c-8ecf-3181752174c5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:43.438642 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a051704-48be-4cc8-a117-d001754e7ec7 req-ec3fcc0e-5049-465a-bb96-a8eb75a26ced tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0630634 Dec 09 21:34:43.483783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6036ee94-f882-41ec-b39d-2b166e3eb291 req-79db25a3-d753-4866-8230-a7b7535af03c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:43.485277 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6036ee94-f882-41ec-b39d-2b166e3eb291 req-79db25a3-d753-4866-8230-a7b7535af03c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.0602925 Dec 09 21:34:43.536409 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6036ee94-f882-41ec-b39d-2b166e3eb291 req-8810c9db-21ad-485f-be62-2c2c53fa9a61 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445707 Dec 09 21:34:43.585065 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f33336d7-40cc-477c-8ecf-3181752174c5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:43.587966 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f33336d7-40cc-477c-8ecf-3181752174c5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:43.632583 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f33336d7-40cc-477c-8ecf-3181752174c5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:43.633188 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f33336d7-40cc-477c-8ecf-3181752174c5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Fanout notify agent at l3_agent the message router_deleted on router b850f52a-e72c-4b79-8e90-cc44ef28afe3 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:34:43.641684 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f33336d7-40cc-477c-8ecf-3181752174c5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:43.646995 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f33336d7-40cc-477c-8ecf-3181752174c5 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "DELETE /v2.0/routers/b850f52a-e72c-4b79-8e90-cc44ef28afe3 HTTP/1.1" status: 204 len: 168 time: 0.3040006 Dec 09 21:34:43.647104 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50542) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:43.663268 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-325489a5-617d-4179-a081-64a3f8fbffeb req-2bcddac4-b02b-4f74-a4f1-cef93bb5e50d tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:43.664759 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-325489a5-617d-4179-a081-64a3f8fbffeb req-2bcddac4-b02b-4f74-a4f1-cef93bb5e50d tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0605426 Dec 09 21:34:43.687091 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bdb7fd0e-56f3-4d22-8dc5-751e5972b102 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "GET /v2.0/ports?device_id=b850f52a-e72c-4b79-8e90-cc44ef28afe3 HTTP/1.1" status: 200 len: 205 time: 0.0390186 Dec 09 21:34:43.689748 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50544) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:43.727485 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-09ded9bf-d4a2-4a14-8241-416d739e52fc tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] delete failed (client error): The resource could not be found. Dec 09 21:34:43.731205 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-09ded9bf-d4a2-4a14-8241-416d739e52fc tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "DELETE /v2.0/routers/b850f52a-e72c-4b79-8e90-cc44ef28afe3 HTTP/1.1" status: 404 len: 336 time: 0.0378170 Dec 09 21:34:43.731366 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-325489a5-617d-4179-a081-64a3f8fbffeb req-20759f09-ffbe-43f8-87f2-54fc374ad0c6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441015 Dec 09 21:34:43.731590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50546) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:43.763270 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d11cafef-7f48-4fa6-8cca-82524095b51d tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "GET /v2.0/ports?device_id=9a384259-6a33-4653-aac2-c494aa2264f0 HTTP/1.1" status: 200 len: 205 time: 0.0304887 Dec 09 21:34:43.765687 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50548) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:43.802904 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-2e32936d-15c7-4ce4-8a4f-31c42c80060d tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] delete failed (client error): The resource could not be found. Dec 09 21:34:43.803974 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2e32936d-15c7-4ce4-8a4f-31c42c80060d tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "DELETE /v2.0/routers/9a384259-6a33-4653-aac2-c494aa2264f0 HTTP/1.1" status: 404 len: 336 time: 0.0373929 Dec 09 21:34:43.806607 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50550) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:43.832988 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-94385013-947e-4491-9aaa-5a3df6a30ab0 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "GET /v2.0/ports?device_id=62f682d3-d03e-4bb0-97bc-740de2e7ff53 HTTP/1.1" status: 200 len: 205 time: 0.0252876 Dec 09 21:34:43.835850 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50552) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:43.875005 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-482d5b77-ddac-4792-89ea-d92bf897b1c2 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] delete failed (client error): The resource could not be found. Dec 09 21:34:43.876087 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-482d5b77-ddac-4792-89ea-d92bf897b1c2 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "DELETE /v2.0/routers/62f682d3-d03e-4bb0-97bc-740de2e7ff53 HTTP/1.1" status: 404 len: 336 time: 0.0393491 Dec 09 21:34:43.878732 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50556) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:43.906329 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6036132f-285a-4a0e-bd5d-8633addc2d31 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "GET /v2.0/ports?device_id=824d46af-34de-4800-8780-79bfdc1f6a67 HTTP/1.1" status: 200 len: 205 time: 0.0265124 Dec 09 21:34:43.909749 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50558) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:43.946117 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-88a479ae-756e-43a2-89b4-844cc4715d7f tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] delete failed (client error): The resource could not be found. Dec 09 21:34:43.947170 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-88a479ae-756e-43a2-89b4-844cc4715d7f tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "DELETE /v2.0/routers/824d46af-34de-4800-8780-79bfdc1f6a67 HTTP/1.1" status: 404 len: 336 time: 0.0365016 Dec 09 21:34:43.949880 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50562) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:43.976163 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-986ca820-0c5b-4e72-af80-6e0a570f3a62 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "GET /v2.0/ports?device_id=c44ce115-28e9-4f9f-a65b-1286323d72af HTTP/1.1" status: 200 len: 205 time: 0.0251000 Dec 09 21:34:43.978604 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50564) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:44.323321 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-ff3604d1-bed4-44c8-8728-8ff9fe7546e9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] delete failed (client error): The resource could not be found. Dec 09 21:34:44.324739 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ff3604d1-bed4-44c8-8728-8ff9fe7546e9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "DELETE /v2.0/routers/c44ce115-28e9-4f9f-a65b-1286323d72af HTTP/1.1" status: 404 len: 336 time: 0.3451984 Dec 09 21:34:44.329250 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50566) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:44.361439 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-038abd3b-710b-4694-b80a-4f3f69258815 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "GET /v2.0/ports?device_id=7879dcb7-b8b8-480b-a3a0-0e698207cc2d HTTP/1.1" status: 200 len: 205 time: 0.0306554 Dec 09 21:34:44.363897 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50568) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:44.400255 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-0cac8839-0c18-4d03-b635-c1e1c6cbf1b9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] delete failed (client error): The resource could not be found. Dec 09 21:34:44.401242 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0cac8839-0c18-4d03-b635-c1e1c6cbf1b9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "DELETE /v2.0/routers/7879dcb7-b8b8-480b-a3a0-0e698207cc2d HTTP/1.1" status: 404 len: 336 time: 0.0364451 Dec 09 21:34:44.405190 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50570) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:44.430923 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-45cfe290-bbed-40f2-ba4c-c7d89d6b38c9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] DELETE failed (client error): The resource could not be found. Dec 09 21:34:44.431347 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-45cfe290-bbed-40f2-ba4c-c7d89d6b38c9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:34:44.434362 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-45cfe290-bbed-40f2-ba4c-c7d89d6b38c9 tempest-RoutersIpV6AdminTest-100669273 tempest-RoutersIpV6AdminTest-100669273-project] 10.222.0.13 "DELETE /v2.0/subnets/83e0c8c5-a7c8-4b62-90d7-9bddcca3a8ed HTTP/1.1" status: 404 len: 337 time: 0.0282311 Dec 09 21:34:44.563370 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5be74ae7-06b7-4ad7-ba68-c357ff696e2f req-bd13f59f-90f3-4ec2-a47c-f147fba42b76 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:44.564943 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5be74ae7-06b7-4ad7-ba68-c357ff696e2f req-bd13f59f-90f3-4ec2-a47c-f147fba42b76 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0560379 Dec 09 21:34:44.634471 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5be74ae7-06b7-4ad7-ba68-c357ff696e2f req-a0aa072f-35ab-45f3-83ca-6ecfed0ec06e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0618703 Dec 09 21:34:44.670488 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbf619e0-9cef-41b6-8754-2d618c3801c8 req-69d0686f-edde-4d10-84ea-12f7c50f28d1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:44.672048 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fbf619e0-9cef-41b6-8754-2d618c3801c8 req-69d0686f-edde-4d10-84ea-12f7c50f28d1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.0511744 Dec 09 21:34:44.700130 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50580) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:44.720268 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fbf619e0-9cef-41b6-8754-2d618c3801c8 req-b508ac60-0ce4-462e-94e1-1c89e6540417 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419848 Dec 09 21:34:44.805590 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e16f39b9-b9ac-4cd6-ab57-f5b9112ad886 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:44.852011 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a3ee44-97d0-452b-84cf-e8476c644564 req-d79e7ce7-1482-4812-9d29-29f7705fc469 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:44.853470 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a7a3ee44-97d0-452b-84cf-e8476c644564 req-d79e7ce7-1482-4812-9d29-29f7705fc469 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0526865 Dec 09 21:34:44.883104 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e16f39b9-b9ac-4cd6-ab57-f5b9112ad886 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:44.888829 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e16f39b9-b9ac-4cd6-ab57-f5b9112ad886 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:44.903280 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a7a3ee44-97d0-452b-84cf-e8476c644564 req-784a30ca-780f-4d6c-b6c6-8bf0c8295ec0 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426102 Dec 09 21:34:44.931547 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e16f39b9-b9ac-4cd6-ab57-f5b9112ad886 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=98f0b594e52445ab894ef5aae2d15fb0&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2278020 Dec 09 21:34:44.932468 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50590) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:44.944603 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e16f39b9-b9ac-4cd6-ab57-f5b9112ad886 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c4ea9fd7-e50f-43af-803b-2b75e0b11ac6,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:44.986815 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cb50d519-2863-4f4e-8d1c-796e2ef3a99f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:45.009853 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cb50d519-2863-4f4e-8d1c-796e2ef3a99f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:45.073264 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cb50d519-2863-4f4e-8d1c-796e2ef3a99f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:45.076704 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cb50d519-2863-4f4e-8d1c-796e2ef3a99f admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:45.077950 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cb50d519-2863-4f4e-8d1c-796e2ef3a99f admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/c4ea9fd7-e50f-43af-803b-2b75e0b11ac6 HTTP/1.1" status: 204 len: 168 time: 0.1452153 Dec 09 21:34:45.086474 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb50d519-2863-4f4e-8d1c-796e2ef3a99f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c4ea9fd7-e50f-43af-803b-2b75e0b11ac6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:45.152163 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b77c5ae-a2f3-4cb4-aecc-967ed6a1aad7 req-aa5c23b3-2033-46f6-bb57-ed3e9d1fe3c9 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:45.153821 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8b77c5ae-a2f3-4cb4-aecc-967ed6a1aad7 req-aa5c23b3-2033-46f6-bb57-ed3e9d1fe3c9 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0672131 Dec 09 21:34:45.202811 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8b77c5ae-a2f3-4cb4-aecc-967ed6a1aad7 req-d8034a7a-d642-47b9-a446-c4861f0440b4 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424659 Dec 09 21:34:45.351251 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50602) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:45.391861 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7b757780-0281-466e-a431-fdcc61debb1e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=1005793cd9644188b8b2a19213843cae&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0393469 Dec 09 21:34:45.394317 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50604) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:45.442650 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9c708fb8-ce76-4587-938c-4f961bb6add3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:45.467656 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9c708fb8-ce76-4587-938c-4f961bb6add3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:45.517993 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9c708fb8-ce76-4587-938c-4f961bb6add3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:45.521672 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9c708fb8-ce76-4587-938c-4f961bb6add3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:45.523574 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9c708fb8-ce76-4587-938c-4f961bb6add3 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/00c380ee-482e-427e-82bc-30178253d289 HTTP/1.1" status: 204 len: 168 time: 0.1283479 Dec 09 21:34:45.532213 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c708fb8-ce76-4587-938c-4f961bb6add3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=00c380ee-482e-427e-82bc-30178253d289,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:45.758816 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d783bf93-904b-45d8-a7fd-8fc6893ba7a3 req-e934a45b-e668-49eb-befe-c51bd38fe140 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:45.760358 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d783bf93-904b-45d8-a7fd-8fc6893ba7a3 req-e934a45b-e668-49eb-befe-c51bd38fe140 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0510116 Dec 09 21:34:45.834858 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d783bf93-904b-45d8-a7fd-8fc6893ba7a3 req-838e21f2-d4f1-4501-8087-203863b0559b tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0683970 Dec 09 21:34:45.859910 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04af52e9-3e12-4a6c-9e2c-16ef296238ca req-ec7a2f51-61ea-48c2-8161-09c27af5f1e9 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:45.861600 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04af52e9-3e12-4a6c-9e2c-16ef296238ca req-ec7a2f51-61ea-48c2-8161-09c27af5f1e9 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.0625384 Dec 09 21:34:45.915772 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04af52e9-3e12-4a6c-9e2c-16ef296238ca req-b34224be-abe8-42a4-8fb3-f43a8be874f5 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0474577 Dec 09 21:34:46.241356 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50636) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:46.324399 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8df5fff0-0ce8-42c3-90d8-c80854203f10 req-527d0959-7a56-45d8-b99b-4bbcc2454e60 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:46.325930 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8df5fff0-0ce8-42c3-90d8-c80854203f10 req-527d0959-7a56-45d8-b99b-4bbcc2454e60 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0505793 Dec 09 21:34:46.349568 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-d21db36e-427e-4344-8ab1-7d5678c573f3 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Request body: {'network': {'name': 'tempest-AllowedAddressPairIpV6TestJSON-test-network-1470741290'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:46.390246 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8df5fff0-0ce8-42c3-90d8-c80854203f10 req-9b42590d-3b07-4fb0-982c-7592387231f0 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0582888 Dec 09 21:34:46.390943 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d21db36e-427e-4344-8ab1-7d5678c573f3 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Made reservation on behalf of 3537a9ac4df74eed882aa675bc321479 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:34:46.394173 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d21db36e-427e-4344-8ab1-7d5678c573f3 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:46.403545 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d21db36e-427e-4344-8ab1-7d5678c573f3 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:46.507056 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d21db36e-427e-4344-8ab1-7d5678c573f3 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:46.514249 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d21db36e-427e-4344-8ab1-7d5678c573f3 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:46.546036 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d71fb16-70bc-4d8f-8176-dd9ce2bc2abe req-9fdfa12f-122e-4a3d-b063-5f8b1381feaf tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:46.547553 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3d71fb16-70bc-4d8f-8176-dd9ce2bc2abe req-9fdfa12f-122e-4a3d-b063-5f8b1381feaf tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0844724 Dec 09 21:34:46.552628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d21db36e-427e-4344-8ab1-7d5678c573f3 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] vlan segment allocate from pool success with {'vlan_id': 147, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:34:46.584261 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d21db36e-427e-4344-8ab1-7d5678c573f3 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:46.584609 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-d21db36e-427e-4344-8ab1-7d5678c573f3 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Added segment f4d52833-5328-447b-87f4-c7aa5b40ed4e of type vlan for network 7af48b2e-8a2a-4f9c-811e-6bfe1768f78b Dec 09 21:34:46.587304 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d21db36e-427e-4344-8ab1-7d5678c573f3 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8c0470e3-0f09-41d0-bde6-7b3d0d27f8a1,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:46.653394 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d21db36e-427e-4344-8ab1-7d5678c573f3 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:46.659808 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3d71fb16-70bc-4d8f-8176-dd9ce2bc2abe req-2e1102e1-439e-480e-8bb3-56237bf8829c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1023653 Dec 09 21:34:46.683066 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d21db36e-427e-4344-8ab1-7d5678c573f3 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:46.689666 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d21db36e-427e-4344-8ab1-7d5678c573f3 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:46.690435 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d21db36e-427e-4344-8ab1-7d5678c573f3 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:46.769522 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d21db36e-427e-4344-8ab1-7d5678c573f3 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 798 time: 0.5270164 Dec 09 21:34:46.771829 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d21db36e-427e-4344-8ab1-7d5678c573f3 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Pushing event updated for resources: {'Network': ['ID=7af48b2e-8a2a-4f9c-811e-6bfe1768f78b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:46.772641 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50644) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:46.779281 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-53148fe3-3126-49fc-8d49-4cfbea48c958 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Request body: {'subnet': {'network_id': '7af48b2e-8a2a-4f9c-811e-6bfe1768f78b', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:46.783576 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 7af48b2e-8a2a-4f9c-811e-6bfe1768f78b details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:34:46.810026 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4819685-4859-4099-8669-d9c4c691bb85 req-17ac4f32-8bc7-4b14-b578-c96c3ba89adf tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:46.812015 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4819685-4859-4099-8669-d9c4c691bb85 req-17ac4f32-8bc7-4b14-b578-c96c3ba89adf tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0554678 Dec 09 21:34:46.878102 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4819685-4859-4099-8669-d9c4c691bb85 req-c474360f-11b1-4dd0-b9ae-c1aa09e8a25b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0561073 Dec 09 21:34:46.889218 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-53148fe3-3126-49fc-8d49-4cfbea48c958 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Made reservation on behalf of 3537a9ac4df74eed882aa675bc321479 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:34:46.892975 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-53148fe3-3126-49fc-8d49-4cfbea48c958 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:46.959844 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a364b3c2-d513-4956-bd4c-aeb7a8f49016 req-69e9635b-0975-4195-9e10-c44be3b755d3 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:46.961461 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a364b3c2-d513-4956-bd4c-aeb7a8f49016 req-69e9635b-0975-4195-9e10-c44be3b755d3 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0527291 Dec 09 21:34:47.038520 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a364b3c2-d513-4956-bd4c-aeb7a8f49016 req-061e34b9-5742-42ba-8a02-e65826e7272d tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0662353 Dec 09 21:34:47.047276 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81382499-1fa0-490f-b36b-961d3ca2e8de req-8b3f03c9-9693-4535-b556-c43dd1e6b67d tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:47.048621 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-81382499-1fa0-490f-b36b-961d3ca2e8de req-8b3f03c9-9693-4535-b556-c43dd1e6b67d tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0862229 Dec 09 21:34:47.099691 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-53148fe3-3126-49fc-8d49-4cfbea48c958 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:47.117273 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-81382499-1fa0-490f-b36b-961d3ca2e8de req-cf7246be-b230-45a4-a4e5-2804131d1702 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0556283 Dec 09 21:34:47.159084 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c7e0195-2fb4-466f-9b33-5a4e5051d601 req-db0033ca-c256-4c94-b9b0-10f1ff8a40ac tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:47.160851 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4c7e0195-2fb4-466f-9b33-5a4e5051d601 req-db0033ca-c256-4c94-b9b0-10f1ff8a40ac tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.0569770 Dec 09 21:34:47.176773 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53148fe3-3126-49fc-8d49-4cfbea48c958 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Pushing event updated for resources: {'Subnet': ['ID=0e6e23e9-d1e0-43d8-a2cf-6e5b692c2686,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:47.185998 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53148fe3-3126-49fc-8d49-4cfbea48c958 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Checking segment: {'id': 'f4d52833-5328-447b-87f4-c7aa5b40ed4e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '7af48b2e-8a2a-4f9c-811e-6bfe1768f78b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:34:47.186369 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53148fe3-3126-49fc-8d49-4cfbea48c958 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Network hostable DHCP agents. Network: 7af48b2e-8a2a-4f9c-811e-6bfe1768f78b, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:34:47.205316 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53148fe3-3126-49fc-8d49-4cfbea48c958 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Network 7af48b2e-8a2a-4f9c-811e-6bfe1768f78b is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:34:47.212872 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4c7e0195-2fb4-466f-9b33-5a4e5051d601 req-b692bc49-c5cb-4822-92de-7a5e299b8357 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448897 Dec 09 21:34:47.216059 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-53148fe3-3126-49fc-8d49-4cfbea48c958 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 7af48b2e-8a2a-4f9c-811e-6bfe1768f78b) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:34:47.223879 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-53148fe3-3126-49fc-8d49-4cfbea48c958 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:47.224581 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-53148fe3-3126-49fc-8d49-4cfbea48c958 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:47.224881 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1ced6a0-6966-46f6-8073-e7129cdd09c8 None None] Network 7af48b2e-8a2a-4f9c-811e-6bfe1768f78b requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:34:47.252875 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-53148fe3-3126-49fc-8d49-4cfbea48c958 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4786959 Dec 09 21:34:47.256596 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50658) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:47.263139 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-04503b18-01aa-46ff-b8e5-249142463b5c tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Request body: {'port': {'network_id': '7af48b2e-8a2a-4f9c-811e-6bfe1768f78b', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-758822098'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:47.339502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-607f7c14-dc6d-45fb-86ac-c5e3a45e475b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-7af48b2e-8a2a-4f9c-811e-6bfe1768f78b', 'network_id': '7af48b2e-8a2a-4f9c-811e-6bfe1768f78b', 'project_id': '3537a9ac4df74eed882aa675bc321479', 'fixed_ips': [{'subnet_id': '0e6e23e9-d1e0-43d8-a2cf-6e5b692c2686'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:34:47.340390 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-607f7c14-dc6d-45fb-86ac-c5e3a45e475b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:47.377690 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-04503b18-01aa-46ff-b8e5-249142463b5c tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Made reservation on behalf of 3537a9ac4df74eed882aa675bc321479 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:34:47.381283 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04503b18-01aa-46ff-b8e5-249142463b5c tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:47.398418 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-04503b18-01aa-46ff-b8e5-249142463b5c tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] device_id is not set on port ac85147d-04c7-43d3-ac8d-462c5fc034f4 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:34:47.478689 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-607f7c14-dc6d-45fb-86ac-c5e3a45e475b None None] Allocated IP 2001:db8::2 (7af48b2e-8a2a-4f9c-811e-6bfe1768f78b/0e6e23e9-d1e0-43d8-a2cf-6e5b692c2686/642dd612-680b-42b2-8855-c10479698139) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:34:47.619312 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-607f7c14-dc6d-45fb-86ac-c5e3a45e475b None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:47.628073 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-607f7c14-dc6d-45fb-86ac-c5e3a45e475b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:47.669872 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-607f7c14-dc6d-45fb-86ac-c5e3a45e475b None None] Network 7af48b2e-8a2a-4f9c-811e-6bfe1768f78b is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:34:47.672713 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-607f7c14-dc6d-45fb-86ac-c5e3a45e475b None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:34:47.678178 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-607f7c14-dc6d-45fb-86ac-c5e3a45e475b None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:34:47.685329 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-607f7c14-dc6d-45fb-86ac-c5e3a45e475b None None] Pushing event updated for resources: {'Port': ['ID=642dd612-680b-42b2-8855-c10479698139,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:47.691037 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-04503b18-01aa-46ff-b8e5-249142463b5c tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Allocated IP 2001:db8::134 (7af48b2e-8a2a-4f9c-811e-6bfe1768f78b/0e6e23e9-d1e0-43d8-a2cf-6e5b692c2686/ac85147d-04c7-43d3-ac8d-462c5fc034f4) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:34:47.735458 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-607f7c14-dc6d-45fb-86ac-c5e3a45e475b None None] Attempting to bind port 642dd612-680b-42b2-8855-c10479698139 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:34:47.735745 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-607f7c14-dc6d-45fb-86ac-c5e3a45e475b None None] Attempting to bind port 642dd612-680b-42b2-8855-c10479698139 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f4d52833-5328-447b-87f4-c7aa5b40ed4e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '7af48b2e-8a2a-4f9c-811e-6bfe1768f78b'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:34:47.736111 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-607f7c14-dc6d-45fb-86ac-c5e3a45e475b None None] Attempting to bind port 642dd612-680b-42b2-8855-c10479698139 on network 7af48b2e-8a2a-4f9c-811e-6bfe1768f78b {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:34:47.741028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-607f7c14-dc6d-45fb-86ac-c5e3a45e475b None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 34, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:34:47.741402 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-607f7c14-dc6d-45fb-86ac-c5e3a45e475b None None] Checking segment: {'id': 'f4d52833-5328-447b-87f4-c7aa5b40ed4e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '7af48b2e-8a2a-4f9c-811e-6bfe1768f78b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:34:47.741810 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-607f7c14-dc6d-45fb-86ac-c5e3a45e475b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:47.742201 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-607f7c14-dc6d-45fb-86ac-c5e3a45e475b None None] Bound using segment: {'id': 'f4d52833-5328-447b-87f4-c7aa5b40ed4e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '7af48b2e-8a2a-4f9c-811e-6bfe1768f78b'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:34:47.742664 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-607f7c14-dc6d-45fb-86ac-c5e3a45e475b None None] Bound port: 642dd612-680b-42b2-8855-c10479698139, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f4d52833-5328-447b-87f4-c7aa5b40ed4e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '7af48b2e-8a2a-4f9c-811e-6bfe1768f78b'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:34:47.743046 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-607f7c14-dc6d-45fb-86ac-c5e3a45e475b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:47.807360 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-607f7c14-dc6d-45fb-86ac-c5e3a45e475b None None] For port 642dd612-680b-42b2-8855-c10479698139, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:34:47.810907 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-607f7c14-dc6d-45fb-86ac-c5e3a45e475b None None] For port 642dd612-680b-42b2-8855-c10479698139, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=642dd612-680b-42b2-8855-c10479698139,segment=NetworkSegment(f4d52833-5328-447b-87f4-c7aa5b40ed4e),segment_id=f4d52833-5328-447b-87f4-c7aa5b40ed4e)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:34:47.816850 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-607f7c14-dc6d-45fb-86ac-c5e3a45e475b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:47.846174 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04503b18-01aa-46ff-b8e5-249142463b5c tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:47.881913 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-607f7c14-dc6d-45fb-86ac-c5e3a45e475b None None] Pushing event updated for resources: {'Port': ['ID=642dd612-680b-42b2-8855-c10479698139,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:47.889993 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04503b18-01aa-46ff-b8e5-249142463b5c tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:47.937726 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-04503b18-01aa-46ff-b8e5-249142463b5c tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Network 7af48b2e-8a2a-4f9c-811e-6bfe1768f78b is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:34:47.941099 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-04503b18-01aa-46ff-b8e5-249142463b5c tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:34:47.947238 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04503b18-01aa-46ff-b8e5-249142463b5c tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:34:47.953106 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-04503b18-01aa-46ff-b8e5-249142463b5c tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:47.953751 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04503b18-01aa-46ff-b8e5-249142463b5c tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:47.962979 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04503b18-01aa-46ff-b8e5-249142463b5c tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Pushing event updated for resources: {'Port': ['ID=ac85147d-04c7-43d3-ac8d-462c5fc034f4,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:47.977501 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-04503b18-01aa-46ff-b8e5-249142463b5c tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 0.7191145 Dec 09 21:34:47.980606 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50660) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:47.985575 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-e1cf73e8-1bc5-4cea-9910-7176087ab71a tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Request body: {'port': {'network_id': '7af48b2e-8a2a-4f9c-811e-6bfe1768f78b', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-771320029', 'allowed_address_pairs': [{'ip_address': '2001:db8::134', 'mac_address': 'fa:16:3e:18:83:99'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:48.126576 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e1cf73e8-1bc5-4cea-9910-7176087ab71a tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Made reservation on behalf of 3537a9ac4df74eed882aa675bc321479 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:34:48.187721 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-550901f2-c0f5-4cde-96d8-080330724075 req-af4e3798-c35a-4628-8e36-954fbcd4086c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:48.189382 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-550901f2-c0f5-4cde-96d8-080330724075 req-af4e3798-c35a-4628-8e36-954fbcd4086c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0606282 Dec 09 21:34:48.218019 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e1cf73e8-1bc5-4cea-9910-7176087ab71a tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:48.235805 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-e1cf73e8-1bc5-4cea-9910-7176087ab71a tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] device_id is not set on port 25f2f8c2-7b91-4056-a4fa-e435a03d45cf yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:34:48.375051 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-e1cf73e8-1bc5-4cea-9910-7176087ab71a tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Allocated IP 2001:db8::18c (7af48b2e-8a2a-4f9c-811e-6bfe1768f78b/0e6e23e9-d1e0-43d8-a2cf-6e5b692c2686/25f2f8c2-7b91-4056-a4fa-e435a03d45cf) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:34:48.497767 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-550901f2-c0f5-4cde-96d8-080330724075 req-51b7c558-baae-4625-9762-1d4214195efc tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3017540 Dec 09 21:34:48.544484 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67f65f9b-c9a2-4daf-abc6-1e397e986ade req-64963e26-3312-43f0-bdb2-6113f2c8f2e3 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:48.547005 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67f65f9b-c9a2-4daf-abc6-1e397e986ade req-64963e26-3312-43f0-bdb2-6113f2c8f2e3 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.0659492 Dec 09 21:34:48.548546 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e1cf73e8-1bc5-4cea-9910-7176087ab71a tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:48.590499 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e1cf73e8-1bc5-4cea-9910-7176087ab71a tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:48.610339 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67f65f9b-c9a2-4daf-abc6-1e397e986ade req-a328cdb6-33c7-4ea8-977b-618b336ab3d4 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0563567 Dec 09 21:34:48.642097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e1cf73e8-1bc5-4cea-9910-7176087ab71a tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Network 7af48b2e-8a2a-4f9c-811e-6bfe1768f78b is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:34:48.645270 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-e1cf73e8-1bc5-4cea-9910-7176087ab71a tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:34:48.651821 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1cf73e8-1bc5-4cea-9910-7176087ab71a tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:34:48.657814 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e1cf73e8-1bc5-4cea-9910-7176087ab71a tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:48.658450 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e1cf73e8-1bc5-4cea-9910-7176087ab71a tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:48.665260 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1cf73e8-1bc5-4cea-9910-7176087ab71a tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Pushing event updated for resources: {'Port': ['ID=25f2f8c2-7b91-4056-a4fa-e435a03d45cf,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:48.682193 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e1cf73e8-1bc5-4cea-9910-7176087ab71a tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1007 time: 0.7004957 Dec 09 21:34:48.684818 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50670) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:48.738927 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f99000c7-467d-4e39-9fd5-4e9c587dc31d tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:48.745159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f99000c7-467d-4e39-9fd5-4e9c587dc31d tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:48.751368 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f99000c7-467d-4e39-9fd5-4e9c587dc31d tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:48.753159 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f99000c7-467d-4e39-9fd5-4e9c587dc31d tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2480 time: 0.0673900 Dec 09 21:34:48.756162 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50672) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:48.861027 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0194f7a9-23d8-4cc5-9e53-a8c1d42bf2e0 None None] Network 7af48b2e-8a2a-4f9c-811e-6bfe1768f78b requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:34:48.861576 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-737a5083-378b-49fa-a061-ce25beb1efb1 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Deleting port 25f2f8c2-7b91-4056-a4fa-e435a03d45cf {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:34:48.861576 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-737a5083-378b-49fa-a061-ce25beb1efb1 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:48.934137 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-03e3c667-669c-4bfb-89a8-f08dfdd78307 None None] Provisioning complete for port 642dd612-680b-42b2-8855-c10479698139 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:48.934520 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-03e3c667-669c-4bfb-89a8-f08dfdd78307 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:48.949349 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-737a5083-378b-49fa-a061-ce25beb1efb1 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:48.961495 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-737a5083-378b-49fa-a061-ce25beb1efb1 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Calling delete_port for 25f2f8c2-7b91-4056-a4fa-e435a03d45cf owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:34:49.047710 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-03e3c667-669c-4bfb-89a8-f08dfdd78307 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:49.081195 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-03e3c667-669c-4bfb-89a8-f08dfdd78307 None None] For port 642dd612-680b-42b2-8855-c10479698139, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=642dd612-680b-42b2-8855-c10479698139,segment=NetworkSegment(f4d52833-5328-447b-87f4-c7aa5b40ed4e),segment_id=f4d52833-5328-447b-87f4-c7aa5b40ed4e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:34:49.087169 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-03e3c667-669c-4bfb-89a8-f08dfdd78307 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:49.100987 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-737a5083-378b-49fa-a061-ce25beb1efb1 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:49.134012 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-737a5083-378b-49fa-a061-ce25beb1efb1 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Pushing event deleted for resources: {'Port': ['ID=25f2f8c2-7b91-4056-a4fa-e435a03d45cf,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:49.137069 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03e3c667-669c-4bfb-89a8-f08dfdd78307 None None] Pushing event updated for resources: {'Port': ['ID=642dd612-680b-42b2-8855-c10479698139,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:49.255907 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-737a5083-378b-49fa-a061-ce25beb1efb1 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:49.259279 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-737a5083-378b-49fa-a061-ce25beb1efb1 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "DELETE /v2.0/ports/25f2f8c2-7b91-4056-a4fa-e435a03d45cf HTTP/1.1" status: 204 len: 168 time: 0.5021038 Dec 09 21:34:49.262178 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50674) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:49.287156 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-3f878ac0-430f-4925-b8f7-dcd62c24b8b3 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] GET failed (client error): The resource could not be found. Dec 09 21:34:49.288667 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3f878ac0-430f-4925-b8f7-dcd62c24b8b3 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "GET /v2.0/ports/25f2f8c2-7b91-4056-a4fa-e435a03d45cf HTTP/1.1" status: 404 len: 333 time: 0.0255330 Dec 09 21:34:49.292606 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50676) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:49.297677 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-92c13f1b-f1ff-41a5-8169-5fe692f675b8 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Request body: {'port': {'network_id': '7af48b2e-8a2a-4f9c-811e-6bfe1768f78b', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-909331519'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:49.342744 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d1a4ce1f-5f32-48f2-b4fc-fbcf26e72890 None None] Provisioning complete for port ac85147d-04c7-43d3-ac8d-462c5fc034f4 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:49.342744 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d1a4ce1f-5f32-48f2-b4fc-fbcf26e72890 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:49.406310 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d1a4ce1f-5f32-48f2-b4fc-fbcf26e72890 None None] Port ac85147d-04c7-43d3-ac8d-462c5fc034f4 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:34:49.409708 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d1a4ce1f-5f32-48f2-b4fc-fbcf26e72890 None None] Could not find standard attr ID for object 25f2f8c2-7b91-4056-a4fa-e435a03d45cf. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:34:49.421202 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d1a4ce1f-5f32-48f2-b4fc-fbcf26e72890 None None] Provisioning complete for port 642dd612-680b-42b2-8855-c10479698139 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:49.421568 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d1a4ce1f-5f32-48f2-b4fc-fbcf26e72890 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:49.431023 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-92c13f1b-f1ff-41a5-8169-5fe692f675b8 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Made reservation on behalf of 3537a9ac4df74eed882aa675bc321479 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:34:49.435718 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-92c13f1b-f1ff-41a5-8169-5fe692f675b8 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:49.458025 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-92c13f1b-f1ff-41a5-8169-5fe692f675b8 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] device_id is not set on port 796b0ebc-f41c-4aa3-a227-d08b7ce0adfc yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:34:49.556233 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 642dd612-680b-42b2-8855-c10479698139 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:34:49.611984 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 642dd612-680b-42b2-8855-c10479698139 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:49.612495 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:49.639264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-92c13f1b-f1ff-41a5-8169-5fe692f675b8 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Allocated IP 2001:db8::251 (7af48b2e-8a2a-4f9c-811e-6bfe1768f78b/0e6e23e9-d1e0-43d8-a2cf-6e5b692c2686/796b0ebc-f41c-4aa3-a227-d08b7ce0adfc) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:34:49.670045 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b72c7db-0c71-49d3-9c6a-0fff7186e856 req-f09445d1-abf3-4466-be7b-5103189f7137 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:49.671907 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b72c7db-0c71-49d3-9c6a-0fff7186e856 req-f09445d1-abf3-4466-be7b-5103189f7137 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0890894 Dec 09 21:34:49.689674 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a191e910-1c2e-4130-93dc-a8c5dae85129 None None] Provisioning complete for port ac85147d-04c7-43d3-ac8d-462c5fc034f4 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:49.690173 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a191e910-1c2e-4130-93dc-a8c5dae85129 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:49.734466 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a191e910-1c2e-4130-93dc-a8c5dae85129 None None] Port ac85147d-04c7-43d3-ac8d-462c5fc034f4 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:34:49.827823 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b72c7db-0c71-49d3-9c6a-0fff7186e856 req-b71a0a1e-b97a-4988-8f90-e3b816d048f9 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1434197 Dec 09 21:34:49.851391 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-13beee8a-63ca-43ce-aa92-17a2020ce52e None None] Could not find standard attr ID for object 25f2f8c2-7b91-4056-a4fa-e435a03d45cf. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:34:49.870948 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe86493e-aadb-406c-89d8-280d08b0c57f req-41c11aa3-8e2c-4b81-86c3-991fd6d51ed5 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:49.872724 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe86493e-aadb-406c-89d8-280d08b0c57f req-41c11aa3-8e2c-4b81-86c3-991fd6d51ed5 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.1261270 Dec 09 21:34:49.898347 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-92c13f1b-f1ff-41a5-8169-5fe692f675b8 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:49.952155 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe86493e-aadb-406c-89d8-280d08b0c57f req-67d0b3e7-80a4-4649-a84d-eebd8f0f80cf tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0709651 Dec 09 21:34:49.965234 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-92c13f1b-f1ff-41a5-8169-5fe692f675b8 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:50.013525 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92c13f1b-f1ff-41a5-8169-5fe692f675b8 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Network 7af48b2e-8a2a-4f9c-811e-6bfe1768f78b is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:34:50.016760 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-92c13f1b-f1ff-41a5-8169-5fe692f675b8 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:34:50.022573 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92c13f1b-f1ff-41a5-8169-5fe692f675b8 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:34:50.028668 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-92c13f1b-f1ff-41a5-8169-5fe692f675b8 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:50.029298 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-92c13f1b-f1ff-41a5-8169-5fe692f675b8 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:50.035865 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92c13f1b-f1ff-41a5-8169-5fe692f675b8 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Pushing event updated for resources: {'Port': ['ID=796b0ebc-f41c-4aa3-a227-d08b7ce0adfc,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:50.055178 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-92c13f1b-f1ff-41a5-8169-5fe692f675b8 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 0.7615032 Dec 09 21:34:50.057921 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50688) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:50.063498 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-96b133c7-379e-4bdb-a0ae-c3249340230c tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::134', 'mac_address': 'fa:16:3e:18:83:99'}]}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:50.217775 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-96b133c7-379e-4bdb-a0ae-c3249340230c tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:50.275182 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-98c5bbce-dfab-48a8-a615-1458541c0f39 None None] Provisioning complete for port 796b0ebc-f41c-4aa3-a227-d08b7ce0adfc triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:50.275828 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-98c5bbce-dfab-48a8-a615-1458541c0f39 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:50.312942 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-98c5bbce-dfab-48a8-a615-1458541c0f39 None None] Port 796b0ebc-f41c-4aa3-a227-d08b7ce0adfc cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:34:50.398983 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-96b133c7-379e-4bdb-a0ae-c3249340230c tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:50.404672 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-96b133c7-379e-4bdb-a0ae-c3249340230c tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:50.436760 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-96b133c7-379e-4bdb-a0ae-c3249340230c tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] In _notify_port_updated(), no bound segment for port 796b0ebc-f41c-4aa3-a227-d08b7ce0adfc on network 7af48b2e-8a2a-4f9c-811e-6bfe1768f78b {{(pid=103438) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:34:50.442232 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-96b133c7-379e-4bdb-a0ae-c3249340230c tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:50.442887 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-96b133c7-379e-4bdb-a0ae-c3249340230c tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:50.447143 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-96b133c7-379e-4bdb-a0ae-c3249340230c tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "PUT /v2.0/ports/796b0ebc-f41c-4aa3-a227-d08b7ce0adfc HTTP/1.1" status: 200 len: 1002 time: 0.3851516 Dec 09 21:34:50.447492 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50692) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:50.462013 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96b133c7-379e-4bdb-a0ae-c3249340230c tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Pushing event updated for resources: {'Port': ['ID=796b0ebc-f41c-4aa3-a227-d08b7ce0adfc,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:50.554711 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-20858324-d5be-4974-a724-6a4aa03140cc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Deleting port 796b0ebc-f41c-4aa3-a227-d08b7ce0adfc {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:34:50.555092 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-20858324-d5be-4974-a724-6a4aa03140cc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:50.641576 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-20858324-d5be-4974-a724-6a4aa03140cc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:50.653608 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-20858324-d5be-4974-a724-6a4aa03140cc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Calling delete_port for 796b0ebc-f41c-4aa3-a227-d08b7ce0adfc owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:34:50.736933 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-52523635-f1b1-429b-9129-008a60bc1e26 None None] Provisioning complete for port 796b0ebc-f41c-4aa3-a227-d08b7ce0adfc triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:50.737257 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-52523635-f1b1-429b-9129-008a60bc1e26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:50.772528 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-52523635-f1b1-429b-9129-008a60bc1e26 None None] Port 796b0ebc-f41c-4aa3-a227-d08b7ce0adfc cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:34:50.790383 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-20858324-d5be-4974-a724-6a4aa03140cc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:50.820460 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20858324-d5be-4974-a724-6a4aa03140cc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Pushing event deleted for resources: {'Port': ['ID=796b0ebc-f41c-4aa3-a227-d08b7ce0adfc,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:50.913328 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-20858324-d5be-4974-a724-6a4aa03140cc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:50.919984 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-20858324-d5be-4974-a724-6a4aa03140cc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "DELETE /v2.0/ports/796b0ebc-f41c-4aa3-a227-d08b7ce0adfc HTTP/1.1" status: 204 len: 168 time: 0.4714208 Dec 09 21:34:50.920626 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50698) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:50.946168 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-3c73af53-f08b-48bf-96f3-3f83b8954cf1 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] GET failed (client error): The resource could not be found. Dec 09 21:34:50.949963 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3c73af53-f08b-48bf-96f3-3f83b8954cf1 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "GET /v2.0/ports/796b0ebc-f41c-4aa3-a227-d08b7ce0adfc HTTP/1.1" status: 404 len: 333 time: 0.0261109 Dec 09 21:34:50.951621 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50700) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:50.956647 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-618fc11d-a6e5-49f3-bc2c-54dfe8186dd4 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Request body: {'port': {'network_id': '7af48b2e-8a2a-4f9c-811e-6bfe1768f78b', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-191704984'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:50.978995 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fa46bf5-e7b8-4a9f-8bfe-a7aa0bdea0d2 req-621ad9c6-a12f-4d80-a629-29ce72b71266 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:50.980807 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5fa46bf5-e7b8-4a9f-8bfe-a7aa0bdea0d2 req-621ad9c6-a12f-4d80-a629-29ce72b71266 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0654774 Dec 09 21:34:51.043151 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5fa46bf5-e7b8-4a9f-8bfe-a7aa0bdea0d2 req-3ab6d43d-cb6e-4fca-aa56-9a25340e1b11 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0560462 Dec 09 21:34:51.089550 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-618fc11d-a6e5-49f3-bc2c-54dfe8186dd4 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Made reservation on behalf of 3537a9ac4df74eed882aa675bc321479 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:34:51.092701 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fee2949b-43c3-482d-97b7-f6e60a191de5 req-7e5d1075-ecfe-4b4a-b750-62c58f645525 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:51.093088 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-618fc11d-a6e5-49f3-bc2c-54dfe8186dd4 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:51.094223 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fee2949b-43c3-482d-97b7-f6e60a191de5 req-7e5d1075-ecfe-4b4a-b750-62c58f645525 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.0500655 Dec 09 21:34:51.110718 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-618fc11d-a6e5-49f3-bc2c-54dfe8186dd4 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] device_id is not set on port d866ba43-c705-4ec8-88b2-dc782eb6aab0 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:34:51.146918 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fee2949b-43c3-482d-97b7-f6e60a191de5 req-91865eb7-0438-455c-ab0e-881692480e5d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0465207 Dec 09 21:34:51.225572 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-618fc11d-a6e5-49f3-bc2c-54dfe8186dd4 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Allocated IP 2001:db8::217 (7af48b2e-8a2a-4f9c-811e-6bfe1768f78b/0e6e23e9-d1e0-43d8-a2cf-6e5b692c2686/d866ba43-c705-4ec8-88b2-dc782eb6aab0) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:34:51.388917 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-618fc11d-a6e5-49f3-bc2c-54dfe8186dd4 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:51.428828 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-618fc11d-a6e5-49f3-bc2c-54dfe8186dd4 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:51.444240 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1e54159e-3c83-49a1-a5b5-3e2b29336c43 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:34:51.471819 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-618fc11d-a6e5-49f3-bc2c-54dfe8186dd4 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Network 7af48b2e-8a2a-4f9c-811e-6bfe1768f78b is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:34:51.474938 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-618fc11d-a6e5-49f3-bc2c-54dfe8186dd4 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:34:51.481006 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-618fc11d-a6e5-49f3-bc2c-54dfe8186dd4 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:34:51.486932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-618fc11d-a6e5-49f3-bc2c-54dfe8186dd4 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:51.487582 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-618fc11d-a6e5-49f3-bc2c-54dfe8186dd4 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:51.498830 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-618fc11d-a6e5-49f3-bc2c-54dfe8186dd4 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Pushing event updated for resources: {'Port': ['ID=d866ba43-c705-4ec8-88b2-dc782eb6aab0,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:51.519480 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-618fc11d-a6e5-49f3-bc2c-54dfe8186dd4 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 0.5656509 Dec 09 21:34:51.521245 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50706) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:51.526916 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-18d9a5b9-7e19-42b6-bfa6-258be13e5e19 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::/48', 'mac_address': 'fa:16:3e:18:83:99'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:51.557366 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 1e54159e-3c83-49a1-a5b5-3e2b29336c43, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1e54159e-3c83-49a1-a5b5-3e2b29336c43,segment=NetworkSegment(dcec1a9e-3140-49cf-a664-3f1f0937898f),segment_id=dcec1a9e-3140-49cf-a664-3f1f0937898f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:34:51.573992 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '1e54159e-3c83-49a1-a5b5-3e2b29336c43', 'network_id': '88af5e51-6d1a-432d-8676-517f449774a3', 'port_id': '1e54159e-3c83-49a1-a5b5-3e2b29336c43', 'mac_address': 'fa:16:3e:66:78:8f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 107, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4700ee88-1952-42ab-9242-d93b9f07f2be', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:34:51.615495 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-18d9a5b9-7e19-42b6-bfa6-258be13e5e19 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:51.619755 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:51.634176 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 1e54159e-3c83-49a1-a5b5-3e2b29336c43 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:34:51.657293 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 1e54159e-3c83-49a1-a5b5-3e2b29336c43, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1e54159e-3c83-49a1-a5b5-3e2b29336c43,segment=NetworkSegment(dcec1a9e-3140-49cf-a664-3f1f0937898f),segment_id=dcec1a9e-3140-49cf-a664-3f1f0937898f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:34:51.662910 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:51.722312 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=1e54159e-3c83-49a1-a5b5-3e2b29336c43,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:51.731516 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:51.731937 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:51.732345 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:51.732746 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:51.733200 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:51.733611 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:51.734002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:51.734392 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:51.734779 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:51.735167 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:51.735581 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:51.735967 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:51.736397 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:51.768485 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['1e54159e-3c83-49a1-a5b5-3e2b29336c43'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:34:51.851993 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-18d9a5b9-7e19-42b6-bfa6-258be13e5e19 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:51.858764 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-18d9a5b9-7e19-42b6-bfa6-258be13e5e19 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:51.874985 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-18d9a5b9-7e19-42b6-bfa6-258be13e5e19 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] In _notify_port_updated(), no bound segment for port d866ba43-c705-4ec8-88b2-dc782eb6aab0 on network 7af48b2e-8a2a-4f9c-811e-6bfe1768f78b {{(pid=103437) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:34:51.881467 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18d9a5b9-7e19-42b6-bfa6-258be13e5e19 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:51.882173 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-18d9a5b9-7e19-42b6-bfa6-258be13e5e19 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:51.886478 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-18d9a5b9-7e19-42b6-bfa6-258be13e5e19 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "PUT /v2.0/ports/d866ba43-c705-4ec8-88b2-dc782eb6aab0 HTTP/1.1" status: 200 len: 1002 time: 0.3613248 Dec 09 21:34:51.886748 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50722) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:51.934590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18d9a5b9-7e19-42b6-bfa6-258be13e5e19 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Pushing event updated for resources: {'Port': ['ID=d866ba43-c705-4ec8-88b2-dc782eb6aab0,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:52.026800 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-68ee9f77-1d3e-4eb1-b263-bcc0bb1b8229 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Deleting port d866ba43-c705-4ec8-88b2-dc782eb6aab0 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:34:52.027749 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68ee9f77-1d3e-4eb1-b263-bcc0bb1b8229 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:52.125946 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8d640119-3d5c-48f6-95b7-9b378019e0f0 None None] Provisioning complete for port d866ba43-c705-4ec8-88b2-dc782eb6aab0 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:52.125946 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8d640119-3d5c-48f6-95b7-9b378019e0f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:52.209423 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68ee9f77-1d3e-4eb1-b263-bcc0bb1b8229 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:52.213984 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-8d640119-3d5c-48f6-95b7-9b378019e0f0 None None] Port d866ba43-c705-4ec8-88b2-dc782eb6aab0 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:34:52.220174 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63e64501-4c16-43ed-94e9-00e56d921af8 req-d25de504-b351-4c01-8521-de37c2d226fc tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:52.225549 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63e64501-4c16-43ed-94e9-00e56d921af8 req-d25de504-b351-4c01-8521-de37c2d226fc tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 944 time: 0.0805085 Dec 09 21:34:52.251697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-68ee9f77-1d3e-4eb1-b263-bcc0bb1b8229 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Calling delete_port for d866ba43-c705-4ec8-88b2-dc782eb6aab0 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:34:52.338438 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a1123e53-4a1d-4a4f-bce2-edf58702be0d None None] Provisioning complete for port d866ba43-c705-4ec8-88b2-dc782eb6aab0 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:52.339072 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a1123e53-4a1d-4a4f-bce2-edf58702be0d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:52.360080 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63e64501-4c16-43ed-94e9-00e56d921af8 req-f1a347c9-7c49-4562-bad7-93331f8fdaef tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1278536 Dec 09 21:34:52.384158 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a1123e53-4a1d-4a4f-bce2-edf58702be0d None None] Port d866ba43-c705-4ec8-88b2-dc782eb6aab0 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:34:52.408234 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3719b00a-a8c4-40e2-be14-b29d3efe64cf req-62a81a8a-276b-4e7a-a001-d320e036c37c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:52.415678 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3719b00a-a8c4-40e2-be14-b29d3efe64cf req-62a81a8a-276b-4e7a-a001-d320e036c37c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.1657531 Dec 09 21:34:52.496912 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3719b00a-a8c4-40e2-be14-b29d3efe64cf req-496e33ac-1af8-48b5-a262-ecb996f947b3 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0802555 Dec 09 21:34:52.539333 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68ee9f77-1d3e-4eb1-b263-bcc0bb1b8229 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:52.578538 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68ee9f77-1d3e-4eb1-b263-bcc0bb1b8229 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Pushing event deleted for resources: {'Port': ['ID=d866ba43-c705-4ec8-88b2-dc782eb6aab0,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:52.617520 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68ee9f77-1d3e-4eb1-b263-bcc0bb1b8229 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:52.625898 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50746) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:52.637210 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-68ee9f77-1d3e-4eb1-b263-bcc0bb1b8229 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "DELETE /v2.0/ports/d866ba43-c705-4ec8-88b2-dc782eb6aab0 HTTP/1.1" status: 204 len: 168 time: 0.7491593 Dec 09 21:34:52.656993 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-0767249c-cf45-45b8-b13c-328de576bec3 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] GET failed (client error): The resource could not be found. Dec 09 21:34:52.662687 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50748) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:52.668093 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0767249c-cf45-45b8-b13c-328de576bec3 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "GET /v2.0/ports/d866ba43-c705-4ec8-88b2-dc782eb6aab0 HTTP/1.1" status: 404 len: 333 time: 0.0403602 Dec 09 21:34:52.672883 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-fa5317df-46ce-4e4c-acca-e77fc7d26c23 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Request body: {'port': {'network_id': '7af48b2e-8a2a-4f9c-811e-6bfe1768f78b', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-1380881413'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:52.813656 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fa5317df-46ce-4e4c-acca-e77fc7d26c23 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Made reservation on behalf of 3537a9ac4df74eed882aa675bc321479 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:34:52.821641 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fa5317df-46ce-4e4c-acca-e77fc7d26c23 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:52.842988 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-fa5317df-46ce-4e4c-acca-e77fc7d26c23 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] device_id is not set on port 4bd59b6b-6a63-4f4a-b56f-5565ae9c1045 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:34:52.991429 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-fa5317df-46ce-4e4c-acca-e77fc7d26c23 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Allocated IP 2001:db8::149 (7af48b2e-8a2a-4f9c-811e-6bfe1768f78b/0e6e23e9-d1e0-43d8-a2cf-6e5b692c2686/4bd59b6b-6a63-4f4a-b56f-5565ae9c1045) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:34:53.170414 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fa5317df-46ce-4e4c-acca-e77fc7d26c23 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:53.213228 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fa5317df-46ce-4e4c-acca-e77fc7d26c23 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:53.251008 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fa5317df-46ce-4e4c-acca-e77fc7d26c23 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Network 7af48b2e-8a2a-4f9c-811e-6bfe1768f78b is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:34:53.254201 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-fa5317df-46ce-4e4c-acca-e77fc7d26c23 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:34:53.268512 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa5317df-46ce-4e4c-acca-e77fc7d26c23 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:34:53.280879 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa5317df-46ce-4e4c-acca-e77fc7d26c23 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:53.281793 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fa5317df-46ce-4e4c-acca-e77fc7d26c23 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:53.319292 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fa5317df-46ce-4e4c-acca-e77fc7d26c23 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 944 time: 0.6554086 Dec 09 21:34:53.322301 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50754) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:53.324338 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa5317df-46ce-4e4c-acca-e77fc7d26c23 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Pushing event updated for resources: {'Port': ['ID=4bd59b6b-6a63-4f4a-b56f-5565ae9c1045,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:53.329304 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Request body: {'port': {'network_id': '7af48b2e-8a2a-4f9c-811e-6bfe1768f78b', 'name': 'tempest-AllowedAddressPairIpV6TestJSON-533329017'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:53.471398 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 851ff09f-496e-47bd-85bb-2e21622a44e9 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:34:53.473759 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1e54159e-3c83-49a1-a5b5-3e2b29336c43 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:34:53.509178 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Made reservation on behalf of 3537a9ac4df74eed882aa675bc321479 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:34:53.513417 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:53.544669 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] device_id is not set on port cde6ed3a-9b7a-49f8-b524-d29b52b8eab2 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:34:53.582047 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83e4fa6f-cc51-43b4-a907-e1ccb8c154fb req-c516575d-dc3a-411a-be84-ff2a40d6e07c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:53.591599 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83e4fa6f-cc51-43b4-a907-e1ccb8c154fb req-c516575d-dc3a-411a-be84-ff2a40d6e07c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 944 time: 0.1150944 Dec 09 21:34:53.667960 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 1e54159e-3c83-49a1-a5b5-3e2b29336c43 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:53.668353 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:53.704331 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83e4fa6f-cc51-43b4-a907-e1ccb8c154fb req-228cd3ef-359a-4611-bbed-3af4df27bd40 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1115949 Dec 09 21:34:53.720341 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a64b639-a846-44ba-8c12-02b93f14864e req-26d04d85-a6cb-45ca-8b20-d10d7b58d183 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:53.723924 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 851ff09f-496e-47bd-85bb-2e21622a44e9, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=851ff09f-496e-47bd-85bb-2e21622a44e9,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:34:53.729593 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2a64b639-a846-44ba-8c12-02b93f14864e req-26d04d85-a6cb-45ca-8b20-d10d7b58d183 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.0830286 Dec 09 21:34:53.759321 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-886bd904-66ed-49e5-b3a0-92d4cec0d87c None None] Provisioning complete for port 4bd59b6b-6a63-4f4a-b56f-5565ae9c1045 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:53.759739 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-886bd904-66ed-49e5-b3a0-92d4cec0d87c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:53.761376 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '851ff09f-496e-47bd-85bb-2e21622a44e9', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'port_id': '851ff09f-496e-47bd-85bb-2e21622a44e9', 'mac_address': 'fa:16:3e:bb:5d:d2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:34:53.800479 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2a64b639-a846-44ba-8c12-02b93f14864e req-37736907-d4ec-4887-87ee-16ddaae302d8 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0693221 Dec 09 21:34:53.811040 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Allocated IP 2001:db8::1b0 (7af48b2e-8a2a-4f9c-811e-6bfe1768f78b/0e6e23e9-d1e0-43d8-a2cf-6e5b692c2686/cde6ed3a-9b7a-49f8-b524-d29b52b8eab2) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:34:53.847155 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-886bd904-66ed-49e5-b3a0-92d4cec0d87c None None] Port 4bd59b6b-6a63-4f4a-b56f-5565ae9c1045 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:34:53.909458 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:53.937566 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:53.979940 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 1e54159e-3c83-49a1-a5b5-3e2b29336c43, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1e54159e-3c83-49a1-a5b5-3e2b29336c43,segment=NetworkSegment(dcec1a9e-3140-49cf-a664-3f1f0937898f),segment_id=dcec1a9e-3140-49cf-a664-3f1f0937898f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:34:53.982777 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'af704653-9f02-4515-9fb8-0f0869d126b2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1e54159e-3c83-49a1-a5b5-3e2b29336c43'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:34:53.986191 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bdb28938-efab-4aef-a2d4-0393c4dc9254" -d '{"events": [{"server_uuid": "af704653-9f02-4515-9fb8-0f0869d126b2", "name": "network-vif-plugged", "status": "completed", "tag": "1e54159e-3c83-49a1-a5b5-3e2b29336c43"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:34:53.990419 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:53.995950 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 851ff09f-496e-47bd-85bb-2e21622a44e9 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:34:54.039485 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:54.043720 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 851ff09f-496e-47bd-85bb-2e21622a44e9, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=851ff09f-496e-47bd-85bb-2e21622a44e9,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:34:54.045567 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:34:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c10db657-f2c8-4a92-a099-f015837ccae5 x-openstack-request-id: req-c10db657-f2c8-4a92-a099-f015837ccae5 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:34:54.045870 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "af704653-9f02-4515-9fb8-0f0869d126b2", "name": "network-vif-plugged", "status": "completed", "tag": "1e54159e-3c83-49a1-a5b5-3e2b29336c43", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:34:54.046516 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c10db657-f2c8-4a92-a099-f015837ccae5 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:34:54.046516 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'af704653-9f02-4515-9fb8-0f0869d126b2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1e54159e-3c83-49a1-a5b5-3e2b29336c43', 'code': 200} Dec 09 21:34:54.069437 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=1e54159e-3c83-49a1-a5b5-3e2b29336c43,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:54.072184 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:54.095190 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:54.128584 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=851ff09f-496e-47bd-85bb-2e21622a44e9,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:54.158058 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Network 7af48b2e-8a2a-4f9c-811e-6bfe1768f78b is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:34:54.166189 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:34:54.172765 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:34:54.178468 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:54.182264 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:54.193585 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Pushing event updated for resources: {'Port': ['ID=cde6ed3a-9b7a-49f8-b524-d29b52b8eab2,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:54.206986 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['851ff09f-496e-47bd-85bb-2e21622a44e9'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:34:54.207716 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:54.208879 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:54.209271 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:54.209637 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:54.210032 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:54.210573 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:54.210923 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:54.211286 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:54.212838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:54.212838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:54.212838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:54.212838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:54.213243 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:54.222924 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ae26385c-a504-4b02-a3e1-9f15485d29a7 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 943 time: 0.8993862 Dec 09 21:34:54.223122 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50766) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:54.230290 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-da737a48-661c-4b85-9b88-fdcda4473d89 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Request body: {'port': {'allowed_address_pairs': [{'ip_address': '2001:db8::134', 'mac_address': 'fa:16:3e:18:83:99'}, {'ip_address': '2001:db8::149', 'mac_address': 'fa:16:3e:f7:be:8d'}]}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:34:54.322105 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da737a48-661c-4b85-9b88-fdcda4473d89 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:54.546334 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da737a48-661c-4b85-9b88-fdcda4473d89 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:54.554463 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da737a48-661c-4b85-9b88-fdcda4473d89 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:54.582273 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3c2506f5-3cc3-4184-a748-3c68fa7b4d1a None None] Provisioning complete for port cde6ed3a-9b7a-49f8-b524-d29b52b8eab2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:54.583171 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3c2506f5-3cc3-4184-a748-3c68fa7b4d1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:54.613101 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-da737a48-661c-4b85-9b88-fdcda4473d89 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] In _notify_port_updated(), no bound segment for port cde6ed3a-9b7a-49f8-b524-d29b52b8eab2 on network 7af48b2e-8a2a-4f9c-811e-6bfe1768f78b {{(pid=103438) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:34:54.618643 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-da737a48-661c-4b85-9b88-fdcda4473d89 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:54.619298 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da737a48-661c-4b85-9b88-fdcda4473d89 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:54.625255 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-da737a48-661c-4b85-9b88-fdcda4473d89 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "PUT /v2.0/ports/cde6ed3a-9b7a-49f8-b524-d29b52b8eab2 HTTP/1.1" status: 200 len: 1067 time: 0.4009414 Dec 09 21:34:54.628448 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50768) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:54.642510 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da737a48-661c-4b85-9b88-fdcda4473d89 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Pushing event updated for resources: {'Port': ['ID=cde6ed3a-9b7a-49f8-b524-d29b52b8eab2,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:54.669575 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-3c2506f5-3cc3-4184-a748-3c68fa7b4d1a None None] Port cde6ed3a-9b7a-49f8-b524-d29b52b8eab2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:34:54.779838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-7b764a13-93b0-48ac-b045-0b7c9333caa2 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Deleting port cde6ed3a-9b7a-49f8-b524-d29b52b8eab2 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:34:54.780280 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7b764a13-93b0-48ac-b045-0b7c9333caa2 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:54.930474 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c829a76-de49-435d-9f7b-0005bea0ed38 req-9208bb37-5962-4f5c-aa99-773f392693c1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:54.941651 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c829a76-de49-435d-9f7b-0005bea0ed38 req-9208bb37-5962-4f5c-aa99-773f392693c1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.1301422 Dec 09 21:34:54.966198 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7b764a13-93b0-48ac-b045-0b7c9333caa2 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:54.994787 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-7b764a13-93b0-48ac-b045-0b7c9333caa2 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Calling delete_port for cde6ed3a-9b7a-49f8-b524-d29b52b8eab2 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:34:55.089682 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-184cceb3-1503-419c-a7b9-4b04be57b18c req-6c64d1cd-d6e5-4c20-85c3-7672f27eecf3 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:55.091241 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-184cceb3-1503-419c-a7b9-4b04be57b18c req-6c64d1cd-d6e5-4c20-85c3-7672f27eecf3 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 944 time: 0.1353137 Dec 09 21:34:55.107047 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c829a76-de49-435d-9f7b-0005bea0ed38 req-3d068bb8-753e-42bb-85fe-c56f51a1e1ac tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1607633 Dec 09 21:34:55.156304 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b912e515-a705-4699-a1ce-bf4267693566 None None] Provisioning complete for port cde6ed3a-9b7a-49f8-b524-d29b52b8eab2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:55.159993 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b912e515-a705-4699-a1ce-bf4267693566 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:55.171772 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7b764a13-93b0-48ac-b045-0b7c9333caa2 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:55.192949 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-184cceb3-1503-419c-a7b9-4b04be57b18c req-d2d778c7-e408-4cce-a726-fee533b2b758 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0847764 Dec 09 21:34:55.220594 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b764a13-93b0-48ac-b045-0b7c9333caa2 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Pushing event deleted for resources: {'Port': ['ID=cde6ed3a-9b7a-49f8-b524-d29b52b8eab2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:55.290042 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-b912e515-a705-4699-a1ce-bf4267693566 None None] Port cde6ed3a-9b7a-49f8-b524-d29b52b8eab2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:34:55.493058 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 851ff09f-496e-47bd-85bb-2e21622a44e9 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:34:55.501117 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7b764a13-93b0-48ac-b045-0b7c9333caa2 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:55.507158 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50800) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:55.507875 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7b764a13-93b0-48ac-b045-0b7c9333caa2 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "DELETE /v2.0/ports/cde6ed3a-9b7a-49f8-b524-d29b52b8eab2 HTTP/1.1" status: 204 len: 168 time: 0.8780446 Dec 09 21:34:55.554213 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-347d651e-4b1c-4965-bb9a-f23ebae28cb8 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] GET failed (client error): The resource could not be found. Dec 09 21:34:55.566075 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50804) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:55.578191 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-347d651e-4b1c-4965-bb9a-f23ebae28cb8 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "GET /v2.0/ports/cde6ed3a-9b7a-49f8-b524-d29b52b8eab2 HTTP/1.1" status: 404 len: 333 time: 0.0689540 Dec 09 21:34:55.608704 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 851ff09f-496e-47bd-85bb-2e21622a44e9 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:34:55.609692 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:55.712461 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-fd593958-52a2-4e57-997b-98ccd993aacb tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Deleting port 4bd59b6b-6a63-4f4a-b56f-5565ae9c1045 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:34:55.713677 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd593958-52a2-4e57-997b-98ccd993aacb tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:55.768399 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:55.849685 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 851ff09f-496e-47bd-85bb-2e21622a44e9, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=851ff09f-496e-47bd-85bb-2e21622a44e9,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:34:55.862061 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:55.932830 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd593958-52a2-4e57-997b-98ccd993aacb tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:55.949613 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=851ff09f-496e-47bd-85bb-2e21622a44e9,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:55.954724 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-fd593958-52a2-4e57-997b-98ccd993aacb tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Calling delete_port for 4bd59b6b-6a63-4f4a-b56f-5565ae9c1045 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:34:56.047907 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '91b064ae-1ca1-44d4-a549-a25cccd0c81b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '851ff09f-496e-47bd-85bb-2e21622a44e9'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:34:56.050266 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cadbf5ee-4791-4ea3-8e17-3b8327da5403" -d '{"events": [{"server_uuid": "91b064ae-1ca1-44d4-a549-a25cccd0c81b", "name": "network-vif-plugged", "status": "completed", "tag": "851ff09f-496e-47bd-85bb-2e21622a44e9"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:34:56.108652 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:34:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-33ef05d1-3494-4785-8b80-ad7d6d0f821d x-openstack-request-id: req-33ef05d1-3494-4785-8b80-ad7d6d0f821d {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:34:56.108954 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "91b064ae-1ca1-44d4-a549-a25cccd0c81b", "name": "network-vif-plugged", "status": "completed", "tag": "851ff09f-496e-47bd-85bb-2e21622a44e9", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:34:56.109215 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-33ef05d1-3494-4785-8b80-ad7d6d0f821d {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:34:56.109623 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '91b064ae-1ca1-44d4-a549-a25cccd0c81b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '851ff09f-496e-47bd-85bb-2e21622a44e9', 'code': 200} Dec 09 21:34:56.156856 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd593958-52a2-4e57-997b-98ccd993aacb tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:56.206258 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd593958-52a2-4e57-997b-98ccd993aacb tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Pushing event deleted for resources: {'Port': ['ID=4bd59b6b-6a63-4f4a-b56f-5565ae9c1045,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:56.252220 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd593958-52a2-4e57-997b-98ccd993aacb tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:56.257010 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fd593958-52a2-4e57-997b-98ccd993aacb tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "DELETE /v2.0/ports/4bd59b6b-6a63-4f4a-b56f-5565ae9c1045 HTTP/1.1" status: 204 len: 168 time: 0.6878848 Dec 09 21:34:56.258825 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50812) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:56.279603 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18599af3-50d3-44dc-98af-3c50e7a59dfd req-9d87851f-27cf-47d3-b1ca-9a3aa4a823a6 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:56.288719 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-18599af3-50d3-44dc-98af-3c50e7a59dfd req-9d87851f-27cf-47d3-b1ca-9a3aa4a823a6 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0875957 Dec 09 21:34:56.291696 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-a875cb08-99f5-48da-b70e-05a254d5b5dd tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] GET failed (client error): The resource could not be found. Dec 09 21:34:56.293692 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a875cb08-99f5-48da-b70e-05a254d5b5dd tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "GET /v2.0/ports/4bd59b6b-6a63-4f4a-b56f-5565ae9c1045 HTTP/1.1" status: 404 len: 333 time: 0.0336807 Dec 09 21:34:56.297786 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50818) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:56.469544 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-18599af3-50d3-44dc-98af-3c50e7a59dfd req-ef9de368-6740-454a-a11e-f5f0eb76e678 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1797750 Dec 09 21:34:56.499008 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d41f39b-ef03-4c84-92f7-6e33f289c2ea req-e775496c-7b83-498e-bb2f-bbc8be8ad9eb tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:56.506437 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d41f39b-ef03-4c84-92f7-6e33f289c2ea req-e775496c-7b83-498e-bb2f-bbc8be8ad9eb tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.1271422 Dec 09 21:34:56.549112 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-0ae9ab7a-0f3b-4c22-bf8c-1b1d97282acc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Deleting port ac85147d-04c7-43d3-ac8d-462c5fc034f4 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:34:56.549824 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0ae9ab7a-0f3b-4c22-bf8c-1b1d97282acc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:56.656130 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d41f39b-ef03-4c84-92f7-6e33f289c2ea req-de170a3c-33af-424c-9210-cea717263d46 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1486578 Dec 09 21:34:56.866010 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0ae9ab7a-0f3b-4c22-bf8c-1b1d97282acc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:56.880264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-0ae9ab7a-0f3b-4c22-bf8c-1b1d97282acc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Calling delete_port for ac85147d-04c7-43d3-ac8d-462c5fc034f4 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:34:57.124208 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0ae9ab7a-0f3b-4c22-bf8c-1b1d97282acc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:57.173581 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ae9ab7a-0f3b-4c22-bf8c-1b1d97282acc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Pushing event deleted for resources: {'Port': ['ID=ac85147d-04c7-43d3-ac8d-462c5fc034f4,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:57.304473 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:57.310965 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae9ab7a-0f3b-4c22-bf8c-1b1d97282acc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:57.311418 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae9ab7a-0f3b-4c22-bf8c-1b1d97282acc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:57.312082 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae9ab7a-0f3b-4c22-bf8c-1b1d97282acc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:57.312424 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae9ab7a-0f3b-4c22-bf8c-1b1d97282acc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:57.312756 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae9ab7a-0f3b-4c22-bf8c-1b1d97282acc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:57.313084 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae9ab7a-0f3b-4c22-bf8c-1b1d97282acc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:57.313410 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae9ab7a-0f3b-4c22-bf8c-1b1d97282acc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:57.315662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae9ab7a-0f3b-4c22-bf8c-1b1d97282acc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:57.316022 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae9ab7a-0f3b-4c22-bf8c-1b1d97282acc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:57.316353 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae9ab7a-0f3b-4c22-bf8c-1b1d97282acc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:57.322915 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae9ab7a-0f3b-4c22-bf8c-1b1d97282acc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:57.327151 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae9ab7a-0f3b-4c22-bf8c-1b1d97282acc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:57.327786 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae9ab7a-0f3b-4c22-bf8c-1b1d97282acc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:34:57.329330 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:57.343508 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0ae9ab7a-0f3b-4c22-bf8c-1b1d97282acc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:57.351140 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0ae9ab7a-0f3b-4c22-bf8c-1b1d97282acc tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "DELETE /v2.0/ports/ac85147d-04c7-43d3-ac8d-462c5fc034f4 HTTP/1.1" status: 204 len: 168 time: 1.0461116 Dec 09 21:34:57.353725 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50834) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:57.472760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-f2b36d4d-2583-4bf4-b35f-cc1a35baba87 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Deleting subnet 0e6e23e9-d1e0-43d8-a2cf-6e5b692c2686 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:34:57.482070 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f2b36d4d-2583-4bf4-b35f-cc1a35baba87 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:57.504392 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dce884b4-8d5d-42f6-ab0c-63dac9d1b519 req-1ea8a2a4-b0d4-4dc9-8a0d-833162477cf9 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:57.513966 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dce884b4-8d5d-42f6-ab0c-63dac9d1b519 req-1ea8a2a4-b0d4-4dc9-8a0d-833162477cf9 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.1338258 Dec 09 21:34:57.595810 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f2b36d4d-2583-4bf4-b35f-cc1a35baba87 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:57.645104 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dce884b4-8d5d-42f6-ab0c-63dac9d1b519 req-b9acbb49-7f30-4384-a9c4-c06d17782fae tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1286795 Dec 09 21:34:57.780521 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e2dd20d-3ea6-46e0-8eb3-6f5f1dca606b req-6e563a3c-cd2f-4c86-ab77-b1b6468ee4de tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:57.809336 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e2dd20d-3ea6-46e0-8eb3-6f5f1dca606b req-6e563a3c-cd2f-4c86-ab77-b1b6468ee4de tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.1311383 Dec 09 21:34:57.819724 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f2b36d4d-2583-4bf4-b35f-cc1a35baba87 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:57.924226 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e2dd20d-3ea6-46e0-8eb3-6f5f1dca606b req-3cc9985e-04e0-4ca9-94f3-65bbbbcad598 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1076088 Dec 09 21:34:57.937865 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f2b36d4d-2583-4bf4-b35f-cc1a35baba87 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:57.989576 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b36d4d-2583-4bf4-b35f-cc1a35baba87 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Pushing event deleted for resources: {'Subnet': ['ID=0e6e23e9-d1e0-43d8-a2cf-6e5b692c2686,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:58.021904 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f2b36d4d-2583-4bf4-b35f-cc1a35baba87 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:58.023268 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dda1d8a8-6ec1-4f94-853e-1772a0622b84 None None] Network 7af48b2e-8a2a-4f9c-811e-6bfe1768f78b requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:34:58.029549 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f2b36d4d-2583-4bf4-b35f-cc1a35baba87 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "DELETE /v2.0/subnets/0e6e23e9-d1e0-43d8-a2cf-6e5b692c2686 HTTP/1.1" status: 204 len: 168 time: 0.6743557 Dec 09 21:34:58.031832 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50844) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:58.079806 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc80c4eb-eeca-4b05-a7d5-6d6eae6eda17 req-3a8a87f2-6a7d-4c83-95a9-17fd9d997fe5 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:58.091746 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fc80c4eb-eeca-4b05-a7d5-6d6eae6eda17 req-3a8a87f2-6a7d-4c83-95a9-17fd9d997fe5 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.1360126 Dec 09 21:34:58.164203 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ff28951-570f-45f7-8788-a472cdef7587 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:58.180164 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fc80c4eb-eeca-4b05-a7d5-6d6eae6eda17 req-8481dfdc-a637-49f2-86ac-982e2e2437a8 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0873339 Dec 09 21:34:58.234730 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-8ff28951-570f-45f7-8788-a472cdef7587 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Deleting port 642dd612-680b-42b2-8855-c10479698139 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:34:58.235080 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ff28951-570f-45f7-8788-a472cdef7587 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:58.294500 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9face240-dffe-4583-8c46-6eb59a3f2879 None None] DHCP port deletion for 7af48b2e-8a2a-4f9c-811e-6bfe1768f78b request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:34:58.382769 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-8ff28951-570f-45f7-8788-a472cdef7587 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] For port 642dd612-680b-42b2-8855-c10479698139, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=642dd612-680b-42b2-8855-c10479698139,segment=NetworkSegment(f4d52833-5328-447b-87f4-c7aa5b40ed4e),segment_id=f4d52833-5328-447b-87f4-c7aa5b40ed4e)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:34:58.383377 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ff28951-570f-45f7-8788-a472cdef7587 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:58.404174 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-8ff28951-570f-45f7-8788-a472cdef7587 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Calling delete_port for 642dd612-680b-42b2-8855-c10479698139 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:34:58.442371 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9face240-dffe-4583-8c46-6eb59a3f2879 None None] Deleting port 642dd612-680b-42b2-8855-c10479698139 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:34:58.442969 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9face240-dffe-4583-8c46-6eb59a3f2879 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:58.572929 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-9face240-dffe-4583-8c46-6eb59a3f2879 None None] For port 642dd612-680b-42b2-8855-c10479698139, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=642dd612-680b-42b2-8855-c10479698139,segment=NetworkSegment(f4d52833-5328-447b-87f4-c7aa5b40ed4e),segment_id=f4d52833-5328-447b-87f4-c7aa5b40ed4e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:34:58.573676 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9face240-dffe-4583-8c46-6eb59a3f2879 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:58.587284 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ff28951-570f-45f7-8788-a472cdef7587 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:58.607869 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9face240-dffe-4583-8c46-6eb59a3f2879 None None] Calling delete_port for 642dd612-680b-42b2-8855-c10479698139 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:34:58.631328 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ff28951-570f-45f7-8788-a472cdef7587 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Pushing event deleted for resources: {'Port': ['ID=642dd612-680b-42b2-8855-c10479698139,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:58.657557 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ff28951-570f-45f7-8788-a472cdef7587 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] No DVR routers for this DVR port 642dd612-680b-42b2-8855-c10479698139 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:34:58.801585 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9face240-dffe-4583-8c46-6eb59a3f2879 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:58.853361 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9face240-dffe-4583-8c46-6eb59a3f2879 None None] Pushing event deleted for resources: {'Port': ['ID=642dd612-680b-42b2-8855-c10479698139,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:58.863262 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ff28951-570f-45f7-8788-a472cdef7587 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:58.874306 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9face240-dffe-4583-8c46-6eb59a3f2879 None None] No DVR routers for this DVR port 642dd612-680b-42b2-8855-c10479698139 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:34:58.920243 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-8ff28951-570f-45f7-8788-a472cdef7587 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7af48b2e-8a2a-4f9c-811e-6bfe1768f78b']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:58.935465 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-8ff28951-570f-45f7-8788-a472cdef7587 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f4d52833-5328-447b-87f4-c7aa5b40ed4e') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:58.935874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-8ff28951-570f-45f7-8788-a472cdef7587 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f4d52833-5328-447b-87f4-c7aa5b40ed4e') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:34:58.947420 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ff28951-570f-45f7-8788-a472cdef7587 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:58.981015 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ff28951-570f-45f7-8788-a472cdef7587 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:58.993466 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02502851-86a7-4b4c-bc95-213df98dcfd9 req-b709e89f-8d5b-42eb-9f88-fe44f1d2cc26 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:59.000031 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8ff28951-570f-45f7-8788-a472cdef7587 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Releasing vlan 147 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:34:59.000523 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ff28951-570f-45f7-8788-a472cdef7587 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/neutron_lib/db/model_query.py:331: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: items = [ Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:34:59.007167 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:34:59.014975 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02502851-86a7-4b4c-bc95-213df98dcfd9 req-b709e89f-8d5b-42eb-9f88-fe44f1d2cc26 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.2048793 Dec 09 21:34:59.096150 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ff28951-570f-45f7-8788-a472cdef7587 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:59.101043 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ff28951-570f-45f7-8788-a472cdef7587 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:34:59.115335 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8ff28951-570f-45f7-8788-a472cdef7587 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] 10.222.0.13 "DELETE /v2.0/networks/7af48b2e-8a2a-4f9c-811e-6bfe1768f78b HTTP/1.1" status: 204 len: 168 time: 1.0822101 Dec 09 21:34:59.144777 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ff28951-570f-45f7-8788-a472cdef7587 tempest-AllowedAddressPairIpV6TestJSON-877136483 tempest-AllowedAddressPairIpV6TestJSON-877136483-project] Pushing event deleted for resources: {'Network': ['ID=7af48b2e-8a2a-4f9c-811e-6bfe1768f78b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:34:59.165453 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02502851-86a7-4b4c-bc95-213df98dcfd9 req-67df7e14-19d4-4fd8-813f-309c51516ca6 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1271305 Dec 09 21:34:59.283049 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b9f9ea9-7602-4a80-972a-357d59abeb2f req-33c29cd7-71f3-4404-8a2f-617a0a25c84b tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:59.292796 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b9f9ea9-7602-4a80-972a-357d59abeb2f req-33c29cd7-71f3-4404-8a2f-617a0a25c84b tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.1754510 Dec 09 21:34:59.532867 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b9f9ea9-7602-4a80-972a-357d59abeb2f req-ff16c16f-1311-4c76-a2f7-8b5f3aafae79 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2273231 Dec 09 21:34:59.591225 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a2d106f-a52a-442a-864f-490ace4ac29d req-69884bf4-e52f-4227-8334-2d0f21d38854 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:34:59.602276 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2a2d106f-a52a-442a-864f-490ace4ac29d req-69884bf4-e52f-4227-8334-2d0f21d38854 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.31 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.2026358 Dec 09 21:34:59.613455 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 642dd612-680b-42b2-8855-c10479698139 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:34:59.679204 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 642dd612-680b-42b2-8855-c10479698139 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:34:59.680368 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 642dd612-680b-42b2-8855-c10479698139 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:34:59.685532 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50862) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:34:59.937765 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-eda98924-c449-4141-8599-2edf5893ce5c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=3537a9ac4df74eed882aa675bc321479&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2506940 Dec 09 21:34:59.938943 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50866) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:00.048748 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ab29b6e-8ead-4197-b4ad-a549e601a1b0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:00.077800 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ab29b6e-8ead-4197-b4ad-a549e601a1b0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:00.144137 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ab29b6e-8ead-4197-b4ad-a549e601a1b0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:00.154699 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ab29b6e-8ead-4197-b4ad-a549e601a1b0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:00.157565 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5be71646-3168-4b5b-9369-48209b45b39a req-3d4a6277-b9ee-4363-ba61-f195f84ff6c1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:00.160460 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3ab29b6e-8ead-4197-b4ad-a549e601a1b0 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/8c0470e3-0f09-41d0-bde6-7b3d0d27f8a1 HTTP/1.1" status: 204 len: 168 time: 0.2200184 Dec 09 21:35:00.170415 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ab29b6e-8ead-4197-b4ad-a549e601a1b0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8c0470e3-0f09-41d0-bde6-7b3d0d27f8a1,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:00.177948 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5be71646-3168-4b5b-9369-48209b45b39a req-3d4a6277-b9ee-4363-ba61-f195f84ff6c1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.6436982 Dec 09 21:35:00.292479 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5be71646-3168-4b5b-9369-48209b45b39a req-8552a444-be55-4f51-8594-171609e57410 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0973186 Dec 09 21:35:00.316696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-2a2d106f-a52a-442a-864f-490ace4ac29d req-9fcaa706-bf2b-4d69-b74e-9b00f4887854 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Deleting port 042e101d-fba7-4c12-8471-48255f57bee1 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:35:00.317054 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2a2d106f-a52a-442a-864f-490ace4ac29d req-9fcaa706-bf2b-4d69-b74e-9b00f4887854 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:00.641612 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-2a2d106f-a52a-442a-864f-490ace4ac29d req-9fcaa706-bf2b-4d69-b74e-9b00f4887854 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] For port 042e101d-fba7-4c12-8471-48255f57bee1, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=042e101d-fba7-4c12-8471-48255f57bee1,segment=NetworkSegment(d3bafd14-6a72-4dc5-8e4d-11da22a389ed),segment_id=d3bafd14-6a72-4dc5-8e4d-11da22a389ed)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:35:00.642491 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2a2d106f-a52a-442a-864f-490ace4ac29d req-9fcaa706-bf2b-4d69-b74e-9b00f4887854 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:00.982010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9430f7a7-2064-4ef2-9aa6-46ee8addb203 req-27d09d99-190e-4ef2-a867-39bd97537198 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:00.990396 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9430f7a7-2064-4ef2-9aa6-46ee8addb203 req-27d09d99-190e-4ef2-a867-39bd97537198 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 946 time: 0.4540019 Dec 09 21:35:01.058193 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9968bb6a-2bc2-4604-aea8-d9a90c8d45ee req-b310caf9-d05b-4db5-b753-4a24bdeaeafa tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:01.065808 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9968bb6a-2bc2-4604-aea8-d9a90c8d45ee req-b310caf9-d05b-4db5-b753-4a24bdeaeafa tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.4063947 Dec 09 21:35:01.174247 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9430f7a7-2064-4ef2-9aa6-46ee8addb203 req-9897ac7d-3011-49b0-8a29-bb68c9723be7 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=15f9ec10-291b-4d5f-8acd-a537b0bfe76b&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1775668 Dec 09 21:35:01.311971 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2a2d106f-a52a-442a-864f-490ace4ac29d req-9fcaa706-bf2b-4d69-b74e-9b00f4887854 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:01.313119 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2a2d106f-a52a-442a-864f-490ace4ac29d req-9fcaa706-bf2b-4d69-b74e-9b00f4887854 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:01.313807 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [req-2a2d106f-a52a-442a-864f-490ace4ac29d req-9fcaa706-bf2b-4d69-b74e-9b00f4887854 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Floating IP 314ffaf2-8bb1-44c3-9e47-3fb70d04ddee disassociated. External IP: 172.25.3.170, port: 042e101d-fba7-4c12-8471-48255f57bee1. Dec 09 21:35:01.314414 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-2a2d106f-a52a-442a-864f-490ace4ac29d req-9fcaa706-bf2b-4d69-b74e-9b00f4887854 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Calling delete_port for 042e101d-fba7-4c12-8471-48255f57bee1 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:35:01.361731 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9968bb6a-2bc2-4604-aea8-d9a90c8d45ee req-2554b2bb-53bc-4d03-819b-8c0def847ec4 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2949169 Dec 09 21:35:01.474000 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50908) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:01.521160 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db2d9c0e-e2ee-432b-b6d5-b75a9df951d9 req-603e8267-507b-4c72-8274-b79360dca951 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:01.523243 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db2d9c0e-e2ee-432b-b6d5-b75a9df951d9 req-603e8267-507b-4c72-8274-b79360dca951 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.0826414 Dec 09 21:35:01.656543 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-c2588340-c12a-44d4-9a63-0fdcaf5d5357 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Request body: {'network': {'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-test-network-1946164306'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:01.709597 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db2d9c0e-e2ee-432b-b6d5-b75a9df951d9 req-46928af3-c107-4258-9215-12eed56efbc3 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1780415 Dec 09 21:35:01.712512 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2a2d106f-a52a-442a-864f-490ace4ac29d req-9fcaa706-bf2b-4d69-b74e-9b00f4887854 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:01.720469 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c2588340-c12a-44d4-9a63-0fdcaf5d5357 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Made reservation on behalf of 9f4d38f818a94ba5b3467a48bcb9306c for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:01.726144 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c2588340-c12a-44d4-9a63-0fdcaf5d5357 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:01.742452 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c2588340-c12a-44d4-9a63-0fdcaf5d5357 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:01.930172 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fcaa706-bf2b-4d69-b74e-9b00f4887854 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Pushing event deleted for resources: {'Port': ['ID=042e101d-fba7-4c12-8471-48255f57bee1,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:01.937546 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [req-2a2d106f-a52a-442a-864f-490ace4ac29d req-9fcaa706-bf2b-4d69-b74e-9b00f4887854 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Router a0406620-d595-409c-958d-7a486a49577c has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:35:01.940368 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c2588340-c12a-44d4-9a63-0fdcaf5d5357 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:01.949533 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c2588340-c12a-44d4-9a63-0fdcaf5d5357 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:02.002237 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2588340-c12a-44d4-9a63-0fdcaf5d5357 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7ae70f87-9871-4238-ad98-f49d5ac64419,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:02.016074 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c2588340-c12a-44d4-9a63-0fdcaf5d5357 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] vlan segment allocate from pool success with {'vlan_id': 138, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:35:02.045173 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c2588340-c12a-44d4-9a63-0fdcaf5d5357 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:02.045173 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-c2588340-c12a-44d4-9a63-0fdcaf5d5357 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Added segment f4338cc9-8b63-443b-88e9-e8598d01beee of type vlan for network 86072419-49ea-476c-b820-ed3dbcf0e0de Dec 09 21:35:02.141848 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c2588340-c12a-44d4-9a63-0fdcaf5d5357 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:02.148711 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-2a2d106f-a52a-442a-864f-490ace4ac29d req-9fcaa706-bf2b-4d69-b74e-9b00f4887854 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:35:02.176413 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-872b43b6-39b4-42f1-bbaf-fa424c3e1ac7 None None] Sync routers for ids ['a0406620-d595-409c-958d-7a486a49577c'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:35:02.202311 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-872b43b6-39b4-42f1-bbaf-fa424c3e1ac7 None None] Routers {'a0406620-d595-409c-958d-7a486a49577c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:35:02.202988 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-872b43b6-39b4-42f1-bbaf-fa424c3e1ac7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:34:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a0406620-d595-409c-958d-7a486a49577c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:02.220211 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c2588340-c12a-44d4-9a63-0fdcaf5d5357 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:02.229797 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c2588340-c12a-44d4-9a63-0fdcaf5d5357 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:02.231140 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-2a2d106f-a52a-442a-864f-490ace4ac29d req-9fcaa706-bf2b-4d69-b74e-9b00f4887854 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] No DVR routers for this DVR port 042e101d-fba7-4c12-8471-48255f57bee1 on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:35:02.236073 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2a2d106f-a52a-442a-864f-490ace4ac29d req-9fcaa706-bf2b-4d69-b74e-9b00f4887854 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:02.236291 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c2588340-c12a-44d4-9a63-0fdcaf5d5357 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:02.263953 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2a2d106f-a52a-442a-864f-490ace4ac29d req-9fcaa706-bf2b-4d69-b74e-9b00f4887854 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.31 "DELETE /v2.0/ports/042e101d-fba7-4c12-8471-48255f57bee1 HTTP/1.1" status: 204 len: 173 time: 2.6258786 Dec 09 21:35:02.264632 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'de68791c-82e4-4147-88d4-7a0ce0f25710', 'name': 'network-vif-deleted', 'tag': '042e101d-fba7-4c12-8471-48255f57bee1'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:35:02.269633 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-95aab7a3-18a3-4305-9ed9-8c32e3aff5ee" -d '{"events": [{"server_uuid": "de68791c-82e4-4147-88d4-7a0ce0f25710", "name": "network-vif-deleted", "tag": "042e101d-fba7-4c12-8471-48255f57bee1"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:35:02.450352 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3719823c-6187-404d-97cc-e3d5edf3aa3a req-2f0ae91e-93a4-4bc2-b9bd-2d4f4ea67971 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=de68791c-82e4-4147-88d4-7a0ce0f25710 HTTP/1.1" status: 200 len: 210 time: 0.0879767 Dec 09 21:35:02.456828 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:35:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cb1bfcf9-b80d-4b73-bc43-6926e05faab0 x-openstack-request-id: req-cb1bfcf9-b80d-4b73-bc43-6926e05faab0 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:35:02.458101 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "de68791c-82e4-4147-88d4-7a0ce0f25710", "name": "network-vif-deleted", "tag": "042e101d-fba7-4c12-8471-48255f57bee1", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:35:02.459820 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-cb1bfcf9-b80d-4b73-bc43-6926e05faab0 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:35:02.460533 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'de68791c-82e4-4147-88d4-7a0ce0f25710', 'name': 'network-vif-deleted', 'tag': '042e101d-fba7-4c12-8471-48255f57bee1', 'status': 'completed', 'code': 200} Dec 09 21:35:02.464831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50922) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:02.466980 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c2588340-c12a-44d4-9a63-0fdcaf5d5357 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 796 time: 0.9801955 Dec 09 21:35:02.483714 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-eccfe48d-44a1-4813-a017-ffe04d4d72ad tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Request body: {'subnet': {'network_id': '86072419-49ea-476c-b820-ed3dbcf0e0de', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:02.532792 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-872b43b6-39b4-42f1-bbaf-fa424c3e1ac7 None None] Set router a0406620-d595-409c-958d-7a486a49577c gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:35:02.577215 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2588340-c12a-44d4-9a63-0fdcaf5d5357 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Pushing event updated for resources: {'Network': ['ID=86072419-49ea-476c-b820-ed3dbcf0e0de,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:02.594440 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 86072419-49ea-476c-b820-ed3dbcf0e0de details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:35:02.732067 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c242aff-f1d9-4273-8ca7-d6a2398493cd req-1f97783c-2cd8-4f29-9fab-667ab21e8f32 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:02.734065 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c242aff-f1d9-4273-8ca7-d6a2398493cd req-1f97783c-2cd8-4f29-9fab-667ab21e8f32 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.1092393 Dec 09 21:35:02.789693 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eccfe48d-44a1-4813-a017-ffe04d4d72ad tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Made reservation on behalf of 9f4d38f818a94ba5b3467a48bcb9306c for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:02.815611 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eccfe48d-44a1-4813-a017-ffe04d4d72ad tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:02.973673 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2fcfc7de-81dc-4b15-8a9e-4af54392e90a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:03.067611 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-872b43b6-39b4-42f1-bbaf-fa424c3e1ac7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0406620-d595-409c-958d-7a486a49577c', 'name': 'tempest-AttachVolumeTestJSON-1079676770-router', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210'}], 'enable_snat': True}, 'gw_port_id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:32Z', 'updated_at': '2021-12-09T21:30:38Z', 'revision_number': 4, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'gw_port': {'id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:0e:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1399, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:33Z', 'updated_at': '2021-12-09T21:30:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'dbff506a-7b73-4238-9fda-dd193910d0ce', 'name': '', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'mac_address': 'fa:16:3e:94:28:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:37Z', 'updated_at': '2021-12-09T21:30:42Z', 'revision_number': 5, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'subnets': [{'id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:03.093107 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c242aff-f1d9-4273-8ca7-d6a2398493cd req-15e8293f-ab48-4d89-a3e3-d12b82d14848 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3521540 Dec 09 21:35:03.122630 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9051907a-fb1f-44c3-b4a8-925f05b935a5 req-52b2a6d8-a8ad-4a9d-b96d-71ccd71cef37 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:03.130300 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9051907a-fb1f-44c3-b4a8-925f05b935a5 req-52b2a6d8-a8ad-4a9d-b96d-71ccd71cef37 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.2474134 Dec 09 21:35:03.145617 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-872b43b6-39b4-42f1-bbaf-fa424c3e1ac7 None None] Checking router: a0406620-d595-409c-958d-7a486a49577c for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:35:03.171462 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-872b43b6-39b4-42f1-bbaf-fa424c3e1ac7 None None] Routers {'a0406620-d595-409c-958d-7a486a49577c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:35:03.172101 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-872b43b6-39b4-42f1-bbaf-fa424c3e1ac7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:34:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a0406620-d595-409c-958d-7a486a49577c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:03.251231 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9051907a-fb1f-44c3-b4a8-925f05b935a5 req-910e00de-faaf-4668-bace-806a050c7db4 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1160924 Dec 09 21:35:03.412820 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-872b43b6-39b4-42f1-bbaf-fa424c3e1ac7 None None] Set router a0406620-d595-409c-958d-7a486a49577c gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:35:03.420210 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eccfe48d-44a1-4813-a017-ffe04d4d72ad tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:03.531729 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eccfe48d-44a1-4813-a017-ffe04d4d72ad tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Pushing event updated for resources: {'Subnet': ['ID=d4fcf60a-a648-40dc-bd05-97389860d251,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:03.561783 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 042e101d-fba7-4c12-8471-48255f57bee1 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:35:03.607226 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50934) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:03.622477 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eccfe48d-44a1-4813-a017-ffe04d4d72ad tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Checking segment: {'id': 'f4338cc9-8b63-443b-88e9-e8598d01beee', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '86072419-49ea-476c-b820-ed3dbcf0e0de'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:35:03.623304 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eccfe48d-44a1-4813-a017-ffe04d4d72ad tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Network hostable DHCP agents. Network: 86072419-49ea-476c-b820-ed3dbcf0e0de, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:35:03.651003 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eccfe48d-44a1-4813-a017-ffe04d4d72ad tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Network 86072419-49ea-476c-b820-ed3dbcf0e0de is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:35:03.662207 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 042e101d-fba7-4c12-8471-48255f57bee1 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:35:03.667781 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 042e101d-fba7-4c12-8471-48255f57bee1 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:35:03.670674 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-eccfe48d-44a1-4813-a017-ffe04d4d72ad tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 86072419-49ea-476c-b820-ed3dbcf0e0de) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:03.680858 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97b1d4bf-9790-4cdd-a61c-678708c4b0ea None None] Network 86072419-49ea-476c-b820-ed3dbcf0e0de requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:35:03.685971 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eccfe48d-44a1-4813-a017-ffe04d4d72ad tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:03.689045 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eccfe48d-44a1-4813-a017-ffe04d4d72ad tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:03.733362 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-872b43b6-39b4-42f1-bbaf-fa424c3e1ac7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0406620-d595-409c-958d-7a486a49577c', 'name': 'tempest-AttachVolumeTestJSON-1079676770-router', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210'}], 'enable_snat': True}, 'gw_port_id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:32Z', 'updated_at': '2021-12-09T21:30:38Z', 'revision_number': 4, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'gw_port': {'id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:0e:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1399, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:33Z', 'updated_at': '2021-12-09T21:30:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'dbff506a-7b73-4238-9fda-dd193910d0ce', 'name': '', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'mac_address': 'fa:16:3e:94:28:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:37Z', 'updated_at': '2021-12-09T21:30:42Z', 'revision_number': 5, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'subnets': [{'id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:03.772559 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-eccfe48d-44a1-4813-a017-ffe04d4d72ad tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.2988486 Dec 09 21:35:03.773607 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50938) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:03.786449 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-e6deec67-3167-48fc-92df-c03146a6df3a tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Request body: {'port': {'network_id': '86072419-49ea-476c-b820-ed3dbcf0e0de', 'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-1573914241'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:03.819213 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b59cbff-4f19-435b-b5b4-aa1f7d857b82 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:03.839873 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-872b43b6-39b4-42f1-bbaf-fa424c3e1ac7 None None] The sync data for ids ['a0406620-d595-409c-958d-7a486a49577c'] in n-d-713301-27 is: [{'id': 'a0406620-d595-409c-958d-7a486a49577c', 'name': 'tempest-AttachVolumeTestJSON-1079676770-router', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210'}], 'enable_snat': True}, 'gw_port_id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:32Z', 'updated_at': '2021-12-09T21:30:38Z', 'revision_number': 4, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'gw_port': {'id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:0e:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1399, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:33Z', 'updated_at': '2021-12-09T21:30:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'dbff506a-7b73-4238-9fda-dd193910d0ce', 'name': '', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'mac_address': 'fa:16:3e:94:28:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:37Z', 'updated_at': '2021-12-09T21:30:42Z', 'revision_number': 5, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'subnets': [{'id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:35:03.891923 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b59cbff-4f19-435b-b5b4-aa1f7d857b82 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:03.997032 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b59cbff-4f19-435b-b5b4-aa1f7d857b82 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:04.001068 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b59cbff-4f19-435b-b5b4-aa1f7d857b82 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:04.003080 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5b59cbff-4f19-435b-b5b4-aa1f7d857b82 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "DELETE /v2.0/security-groups/15f9ec10-291b-4d5f-8acd-a537b0bfe76b HTTP/1.1" status: 204 len: 168 time: 0.3945031 Dec 09 21:35:04.008513 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50940) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:04.023365 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48632d9f-f874-4aff-ba02-3896c258fa64 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-86072419-49ea-476c-b820-ed3dbcf0e0de', 'network_id': '86072419-49ea-476c-b820-ed3dbcf0e0de', 'project_id': '9f4d38f818a94ba5b3467a48bcb9306c', 'fixed_ips': [{'subnet_id': 'd4fcf60a-a648-40dc-bd05-97389860d251'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:35:04.024615 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-48632d9f-f874-4aff-ba02-3896c258fa64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:04.024798 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b59cbff-4f19-435b-b5b4-aa1f7d857b82 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=15f9ec10-291b-4d5f-8acd-a537b0bfe76b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:04.080865 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-048da217-585f-42b6-b038-9244a260c042 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] show failed (client error): The resource could not be found. Dec 09 21:35:04.084252 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-048da217-585f-42b6-b038-9244a260c042 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups/15f9ec10-291b-4d5f-8acd-a537b0bfe76b HTTP/1.1" status: 404 len: 347 time: 0.0747955 Dec 09 21:35:04.087686 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50942) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:04.141020 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e6deec67-3167-48fc-92df-c03146a6df3a tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Made reservation on behalf of 9f4d38f818a94ba5b3467a48bcb9306c for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:04.145000 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e6deec67-3167-48fc-92df-c03146a6df3a tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:04.200216 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-e6deec67-3167-48fc-92df-c03146a6df3a tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] device_id is not set on port 50804e7a-11e2-48a6-99fb-3531a11cd510 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:35:04.389745 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-48632d9f-f874-4aff-ba02-3896c258fa64 None None] Allocated IP 2001:db8::2 (86072419-49ea-476c-b820-ed3dbcf0e0de/d4fcf60a-a648-40dc-bd05-97389860d251/5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:35:04.465271 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-76c3eea8-8d79-4b01-9dc1-3c0e6f07e3b9 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Deleting port 41cdb40e-bd30-4566-a2eb-a8ec05877093 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:35:04.465517 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-76c3eea8-8d79-4b01-9dc1-3c0e6f07e3b9 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:04.474215 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f9798b6-996c-4bb9-90b2-80ed9ad4a01a req-b26f7372-d51c-42e0-9fde-f010c9c0705b tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:04.486050 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f9798b6-996c-4bb9-90b2-80ed9ad4a01a req-b26f7372-d51c-42e0-9fde-f010c9c0705b tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.1795166 Dec 09 21:35:04.523531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f2ec55f-30d8-47fe-9659-25c220920188 req-ec12e23e-58c6-4f43-8303-de6161efb9ec tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:04.532026 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7f2ec55f-30d8-47fe-9659-25c220920188 req-ec12e23e-58c6-4f43-8303-de6161efb9ec tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.1092091 Dec 09 21:35:04.596917 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-48632d9f-f874-4aff-ba02-3896c258fa64 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:04.602677 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d902492-a934-4257-a53f-3f61d882f8ec None None] New status for floating IP 314ffaf2-8bb1-44c3-9e47-3fb70d04ddee: DOWN {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:35:04.608406 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f9798b6-996c-4bb9-90b2-80ed9ad4a01a req-00ca4769-fc83-4088-bcc5-da0f70b1755b tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1207936 Dec 09 21:35:04.610884 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-48632d9f-f874-4aff-ba02-3896c258fa64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:04.637999 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7f2ec55f-30d8-47fe-9659-25c220920188 req-0763be26-7169-4942-8864-78f5701b1690 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1046751 Dec 09 21:35:04.726577 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-76c3eea8-8d79-4b01-9dc1-3c0e6f07e3b9 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:04.731763 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-76c3eea8-8d79-4b01-9dc1-3c0e6f07e3b9 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:04.762757 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-76c3eea8-8d79-4b01-9dc1-3c0e6f07e3b9 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Calling delete_port for 41cdb40e-bd30-4566-a2eb-a8ec05877093 owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:35:04.790604 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-e6deec67-3167-48fc-92df-c03146a6df3a tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Allocated IP 2001:db8::173 (86072419-49ea-476c-b820-ed3dbcf0e0de/d4fcf60a-a648-40dc-bd05-97389860d251/50804e7a-11e2-48a6-99fb-3531a11cd510) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:35:04.872624 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48632d9f-f874-4aff-ba02-3896c258fa64 None None] Network 86072419-49ea-476c-b820-ed3dbcf0e0de is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:35:04.876131 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-48632d9f-f874-4aff-ba02-3896c258fa64 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:04.878871 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48632d9f-f874-4aff-ba02-3896c258fa64 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:35:04.975154 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48632d9f-f874-4aff-ba02-3896c258fa64 None None] Pushing event updated for resources: {'Port': ['ID=5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:05.149106 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-48632d9f-f874-4aff-ba02-3896c258fa64 None None] Attempting to bind port 5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:35:05.151661 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-48632d9f-f874-4aff-ba02-3896c258fa64 None None] Attempting to bind port 5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f4338cc9-8b63-443b-88e9-e8598d01beee', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '86072419-49ea-476c-b820-ed3dbcf0e0de'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:35:05.154458 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48632d9f-f874-4aff-ba02-3896c258fa64 None None] Attempting to bind port 5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986 on network 86072419-49ea-476c-b820-ed3dbcf0e0de {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:35:05.182658 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48632d9f-f874-4aff-ba02-3896c258fa64 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 34, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:35:05.184436 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48632d9f-f874-4aff-ba02-3896c258fa64 None None] Checking segment: {'id': 'f4338cc9-8b63-443b-88e9-e8598d01beee', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '86072419-49ea-476c-b820-ed3dbcf0e0de'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:35:05.185414 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-48632d9f-f874-4aff-ba02-3896c258fa64 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:05.186355 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48632d9f-f874-4aff-ba02-3896c258fa64 None None] Bound using segment: {'id': 'f4338cc9-8b63-443b-88e9-e8598d01beee', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '86072419-49ea-476c-b820-ed3dbcf0e0de'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:35:05.187688 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-48632d9f-f874-4aff-ba02-3896c258fa64 None None] Bound port: 5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f4338cc9-8b63-443b-88e9-e8598d01beee', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '86072419-49ea-476c-b820-ed3dbcf0e0de'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:35:05.189657 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-48632d9f-f874-4aff-ba02-3896c258fa64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:05.236877 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-76c3eea8-8d79-4b01-9dc1-3c0e6f07e3b9 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:05.312433 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e6deec67-3167-48fc-92df-c03146a6df3a tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:05.356129 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e6deec67-3167-48fc-92df-c03146a6df3a tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:05.410356 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76c3eea8-8d79-4b01-9dc1-3c0e6f07e3b9 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Pushing event deleted for resources: {'Port': ['ID=41cdb40e-bd30-4566-a2eb-a8ec05877093,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:05.420742 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6deec67-3167-48fc-92df-c03146a6df3a tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Network 86072419-49ea-476c-b820-ed3dbcf0e0de is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:35:05.446844 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6deec67-3167-48fc-92df-c03146a6df3a tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Pushing event updated for resources: {'Port': ['ID=50804e7a-11e2-48a6-99fb-3531a11cd510,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:05.451932 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-e6deec67-3167-48fc-92df-c03146a6df3a tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:05.454992 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-48632d9f-f874-4aff-ba02-3896c258fa64 None None] For port 5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:35:05.459462 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-48632d9f-f874-4aff-ba02-3896c258fa64 None None] For port 5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986,segment=NetworkSegment(f4338cc9-8b63-443b-88e9-e8598d01beee),segment_id=f4338cc9-8b63-443b-88e9-e8598d01beee)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:35:05.462341 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6deec67-3167-48fc-92df-c03146a6df3a tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:35:05.473399 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-695f8724-c615-4ba4-b9ea-6de2f1498b29 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:35:05.479676 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-48632d9f-f874-4aff-ba02-3896c258fa64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:05.480762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e6deec67-3167-48fc-92df-c03146a6df3a tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:05.482347 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e6deec67-3167-48fc-92df-c03146a6df3a tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:05.496563 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-76c3eea8-8d79-4b01-9dc1-3c0e6f07e3b9 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:05.507919 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-76c3eea8-8d79-4b01-9dc1-3c0e6f07e3b9 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:05.514895 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-76c3eea8-8d79-4b01-9dc1-3c0e6f07e3b9 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "DELETE /v2.0/floatingips/314ffaf2-8bb1-44c3-9e47-3fb70d04ddee HTTP/1.1" status: 204 len: 168 time: 1.4252157 Dec 09 21:35:05.532553 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e6deec67-3167-48fc-92df-c03146a6df3a tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 942 time: 1.7578053 Dec 09 21:35:05.536003 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50956) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:05.542471 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-593f3060-d955-47a5-ac51-a02419c419f9 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Request body: {'port': {'network_id': '86072419-49ea-476c-b820-ed3dbcf0e0de', 'name': 'tempest-ExtraDHCPOptionsIpV6TestJSON-481247875', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '2015::dead', 'opt_name': 'tftp-server'}, {'opt_value': '2015::badd', 'opt_name': 'server-ip-address'}]}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:05.548280 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.api.validators [None req-593f3060-d955-47a5-ac51-a02419c419f9 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] bootfile-name is not in valid_values {{(pid=103438) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 09 21:35:05.548896 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.api.validators [None req-593f3060-d955-47a5-ac51-a02419c419f9 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] tftp-server is not in valid_values {{(pid=103438) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 09 21:35:05.549423 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.api.validators [None req-593f3060-d955-47a5-ac51-a02419c419f9 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] server-ip-address is not in valid_values {{(pid=103438) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 09 21:35:05.581003 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48632d9f-f874-4aff-ba02-3896c258fa64 None None] Pushing event updated for resources: {'Port': ['ID=5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:05.665177 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-df43ab8a-12dc-4a69-aa51-d2d483921853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:05.826737 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-593f3060-d955-47a5-ac51-a02419c419f9 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Made reservation on behalf of 9f4d38f818a94ba5b3467a48bcb9306c for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:05.836381 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50966) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:05.837207 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-593f3060-d955-47a5-ac51-a02419c419f9 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:05.843746 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-7c725c60-8fac-45c7-b39b-ddbeeb617111 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1446596926', 'description': 'tempest-description--430924681'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:05.918806 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7c725c60-8fac-45c7-b39b-ddbeeb617111 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:05.927666 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-593f3060-d955-47a5-ac51-a02419c419f9 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] device_id is not set on port b2c96ca5-1210-41a8-843a-175b55a5b7f6 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:35:05.964699 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d995bdfe-bcf9-45c0-b75c-6dab56c27261 req-509ed5a7-106d-4da1-854f-82d1753964c1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:05.973518 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d995bdfe-bcf9-45c0-b75c-6dab56c27261 req-509ed5a7-106d-4da1-854f-82d1753964c1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.1863384 Dec 09 21:35:06.110167 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7c725c60-8fac-45c7-b39b-ddbeeb617111 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:06.118584 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7c725c60-8fac-45c7-b39b-ddbeeb617111 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:06.152192 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5e300c2-a04d-4906-abe6-9b6af95087e6 req-6d905b39-6524-4f6b-91e8-02e8c76242f8 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:06.153824 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5e300c2-a04d-4906-abe6-9b6af95087e6 req-6d905b39-6524-4f6b-91e8-02e8c76242f8 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.2135077 Dec 09 21:35:06.186823 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d995bdfe-bcf9-45c0-b75c-6dab56c27261 req-962cf9af-484c-460b-9dea-1bc3bbc8cd2f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2118876 Dec 09 21:35:06.197506 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c725c60-8fac-45c7-b39b-ddbeeb617111 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Pushing event updated for resources: {'SecurityGroup': ['ID=19432415-a2e0-4a11-9022-46c83da8ae04,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:06.225292 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7c725c60-8fac-45c7-b39b-ddbeeb617111 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:06.229297 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7c725c60-8fac-45c7-b39b-ddbeeb617111 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1798 time: 0.3890572 Dec 09 21:35:06.229502 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50970) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:06.250242 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-bd92a1eb-33bc-467a-8a8f-70a1033bdea0 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Request body: {'security_group_rule': {'security_group_id': '19432415-a2e0-4a11-9022-46c83da8ae04', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:06.312850 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bd92a1eb-33bc-467a-8a8f-70a1033bdea0 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:06.433325 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bd92a1eb-33bc-467a-8a8f-70a1033bdea0 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:06.453585 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bd92a1eb-33bc-467a-8a8f-70a1033bdea0 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:06.467694 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5e300c2-a04d-4906-abe6-9b6af95087e6 req-b1df8e28-a4f2-4c1a-b2f8-0d7c1ca128ed tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3057454 Dec 09 21:35:06.473714 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-593f3060-d955-47a5-ac51-a02419c419f9 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Allocated IP 2001:db8::34a (86072419-49ea-476c-b820-ed3dbcf0e0de/d4fcf60a-a648-40dc-bd05-97389860d251/b2c96ca5-1210-41a8-843a-175b55a5b7f6) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:35:06.553054 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd92a1eb-33bc-467a-8a8f-70a1033bdea0 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=784c4e36-62c9-4e64-9404-05f4e32891fc,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:06.559356 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bd92a1eb-33bc-467a-8a8f-70a1033bdea0 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:06.568261 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bd92a1eb-33bc-467a-8a8f-70a1033bdea0 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3352363 Dec 09 21:35:06.570601 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50972) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:06.622904 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:06.631340 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-3a253de0-8349-4e3b-81ea-2db877c6bbc6 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Request body: {'security_group_rule': {'security_group_id': '19432415-a2e0-4a11-9022-46c83da8ae04', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:06.728439 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3a253de0-8349-4e3b-81ea-2db877c6bbc6 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:06.837816 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3a253de0-8349-4e3b-81ea-2db877c6bbc6 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:06.845950 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3a253de0-8349-4e3b-81ea-2db877c6bbc6 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:06.922071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a253de0-8349-4e3b-81ea-2db877c6bbc6 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2a342f2c-bedd-4d48-aa5a-686fec833456,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:06.952529 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3a253de0-8349-4e3b-81ea-2db877c6bbc6 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:06.960948 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3a253de0-8349-4e3b-81ea-2db877c6bbc6 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3887126 Dec 09 21:35:06.963236 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50980) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:06.970557 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-282e4884-0688-4456-9f79-387408f826ae tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:07.029169 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-282e4884-0688-4456-9f79-387408f826ae tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for floatingip, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:07.080046 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:35:07.115597 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-593f3060-d955-47a5-ac51-a02419c419f9 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:07.222612 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-593f3060-d955-47a5-ac51-a02419c419f9 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:07.370083 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-593f3060-d955-47a5-ac51-a02419c419f9 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Pushing event updated for resources: {'Port': ['ID=b2c96ca5-1210-41a8-843a-175b55a5b7f6,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:07.394517 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-593f3060-d955-47a5-ac51-a02419c419f9 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Network 86072419-49ea-476c-b820-ed3dbcf0e0de is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:35:07.396038 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-593f3060-d955-47a5-ac51-a02419c419f9 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:07.405111 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-593f3060-d955-47a5-ac51-a02419c419f9 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:35:07.416080 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-593f3060-d955-47a5-ac51-a02419c419f9 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:07.416988 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-593f3060-d955-47a5-ac51-a02419c419f9 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:07.464060 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-593f3060-d955-47a5-ac51-a02419c419f9 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1149 time: 1.9259448 Dec 09 21:35:07.466632 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50986) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:07.682357 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:35:07.789002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:07.789703 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:07.813410 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7a44eaf-4a5a-47f7-b977-2d971e31f3e1 req-a87fb338-98e2-4598-bfb0-f1378ea1b4d2 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:07.821170 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7a44eaf-4a5a-47f7-b977-2d971e31f3e1 req-a87fb338-98e2-4598-bfb0-f1378ea1b4d2 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.3561468 Dec 09 21:35:07.839960 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a94e022-aa3a-4f4c-9942-6155c5c36f3b tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:07.845864 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a94e022-aa3a-4f4c-9942-6155c5c36f3b tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:07.864369 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a94e022-aa3a-4f4c-9942-6155c5c36f3b tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:07.866122 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9a94e022-aa3a-4f4c-9942-6155c5c36f3b tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2621 time: 0.3822291 Dec 09 21:35:07.869328 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50992) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:07.949711 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-951a1375-e8b8-4a97-ab5b-713b17493004 None None] Network 86072419-49ea-476c-b820-ed3dbcf0e0de requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:35:08.107778 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-282e4884-0688-4456-9f79-387408f826ae tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:08.158470 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:08.161310 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8fe72713-8ca4-4383-a395-34abe28b6e7f None None] Provisioning complete for port 5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:08.161843 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8fe72713-8ca4-4383-a395-34abe28b6e7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:08.459058 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:08.509417 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986,segment=NetworkSegment(f4338cc9-8b63-443b-88e9-e8598d01beee),segment_id=f4338cc9-8b63-443b-88e9-e8598d01beee)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:35:08.519988 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-282e4884-0688-4456-9f79-387408f826ae tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Allocated IP 172.25.3.18 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/aed82311-6a0a-41bb-8cd5-a1b3c898776e) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:35:08.548347 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:08.711507 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:08.848228 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-282e4884-0688-4456-9f79-387408f826ae tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:08.928446 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-282e4884-0688-4456-9f79-387408f826ae tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:09.016855 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-282e4884-0688-4456-9f79-387408f826ae tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:35:09.030514 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-282e4884-0688-4456-9f79-387408f826ae tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:09.038463 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b34fc9a6-077c-47e3-be72-fdf843fd3574 req-f7772900-7250-4e02-b945-7b4e56e819fc tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:09.039828 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-282e4884-0688-4456-9f79-387408f826ae tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:35:09.048864 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b34fc9a6-077c-47e3-be72-fdf843fd3574 req-f7772900-7250-4e02-b945-7b4e56e819fc tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 1.3185673 Dec 09 21:35:09.090364 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7a44eaf-4a5a-47f7-b977-2d971e31f3e1 req-02fbe6c3-8a82-4a29-b39f-2728fb18ab93 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.2682827 Dec 09 21:35:09.103357 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-282e4884-0688-4456-9f79-387408f826ae tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Pushing event updated for resources: {'Port': ['ID=aed82311-6a0a-41bb-8cd5-a1b3c898776e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:09.161993 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b34fc9a6-077c-47e3-be72-fdf843fd3574 req-56d7820f-c6e7-4e25-a919-308a24d65bc9 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1039796 Dec 09 21:35:09.171420 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d4b3e117-089d-4170-b686-55644effda64 None None] Provisioning complete for port b2c96ca5-1210-41a8-843a-175b55a5b7f6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:09.172152 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d4b3e117-089d-4170-b686-55644effda64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:09.173171 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-90dadb32-01dd-433b-9dfc-d940358e8ee0 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Deleting port b2c96ca5-1210-41a8-843a-175b55a5b7f6 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:35:09.173722 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-90dadb32-01dd-433b-9dfc-d940358e8ee0 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:09.195390 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-282e4884-0688-4456-9f79-387408f826ae tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:09.283098 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-282e4884-0688-4456-9f79-387408f826ae tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:09.332921 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d4b3e117-089d-4170-b686-55644effda64 None None] Port b2c96ca5-1210-41a8-843a-175b55a5b7f6 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:35:09.363597 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d4b3e117-089d-4170-b686-55644effda64 None None] Provisioning complete for port 50804e7a-11e2-48a6-99fb-3531a11cd510 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:09.364218 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d4b3e117-089d-4170-b686-55644effda64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:09.440167 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-90dadb32-01dd-433b-9dfc-d940358e8ee0 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:09.455305 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d4b3e117-089d-4170-b686-55644effda64 None None] Port 50804e7a-11e2-48a6-99fb-3531a11cd510 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:35:09.473451 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-90dadb32-01dd-433b-9dfc-d940358e8ee0 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Calling delete_port for b2c96ca5-1210-41a8-843a-175b55a5b7f6 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:35:09.483348 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d4b3e117-089d-4170-b686-55644effda64 None None] Provisioning complete for port 5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:09.483812 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d4b3e117-089d-4170-b686-55644effda64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:09.565994 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-282e4884-0688-4456-9f79-387408f826ae tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:09.576428 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-282e4884-0688-4456-9f79-387408f826ae tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:09.584494 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:35:09.690687 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:09.779022 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:09.779682 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:09.783276 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-90dadb32-01dd-433b-9dfc-d940358e8ee0 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:09.784745 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-282e4884-0688-4456-9f79-387408f826ae tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:09.790907 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-282e4884-0688-4456-9f79-387408f826ae tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Pushing event updated for resources: {'Port': ['ID=aed82311-6a0a-41bb-8cd5-a1b3c898776e,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:09.830079 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-282e4884-0688-4456-9f79-387408f826ae tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:09.831646 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-282e4884-0688-4456-9f79-387408f826ae tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 2.8660889 Dec 09 21:35:09.847985 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e9edbd2-e5f0-434e-b585-e56a5de70a48 req-0993a4c7-952d-4dc2-9a89-1096ae16835a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:09.849558 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e9edbd2-e5f0-434e-b585-e56a5de70a48 req-0993a4c7-952d-4dc2-9a89-1096ae16835a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=b65669b5d4924ee090e9583aa839a399&device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 1097 time: 0.3619986 Dec 09 21:35:09.850505 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90dadb32-01dd-433b-9dfc-d940358e8ee0 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Pushing event deleted for resources: {'Port': ['ID=b2c96ca5-1210-41a8-843a-175b55a5b7f6,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:09.918780 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-01e7fe5c-956a-4ed3-8683-49bd2733b037 None None] Provisioning complete for port 50804e7a-11e2-48a6-99fb-3531a11cd510 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:09.919292 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-01e7fe5c-956a-4ed3-8683-49bd2733b037 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:09.964919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-01e7fe5c-956a-4ed3-8683-49bd2733b037 None None] Port 50804e7a-11e2-48a6-99fb-3531a11cd510 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:35:09.990471 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e9edbd2-e5f0-434e-b585-e56a5de70a48 req-c776edb6-492b-4b84-a233-deca28ae1961 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:09.992348 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e9edbd2-e5f0-434e-b585-e56a5de70a48 req-c776edb6-492b-4b84-a233-deca28ae1961 service neutron] 10.222.0.31 "GET /v2.0/networks?id=88af5e51-6d1a-432d-8676-517f449774a3 HTTP/1.1" status: 200 len: 913 time: 0.1288903 Dec 09 21:35:09.997039 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-90dadb32-01dd-433b-9dfc-d940358e8ee0 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:10.004751 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51008) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:10.005130 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-90dadb32-01dd-433b-9dfc-d940358e8ee0 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] 10.222.0.13 "DELETE /v2.0/ports/b2c96ca5-1210-41a8-843a-175b55a5b7f6 HTTP/1.1" status: 204 len: 168 time: 2.1344230 Dec 09 21:35:10.018675 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-7cb139c9-7df2-44d5-90d2-7f4658846566 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Request body: {'port': {'name': 'tempest-new-port-name-2083817118', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '2015::dead', 'opt_name': 'tftp-server'}, {'opt_value': '2015::badd', 'opt_name': 'server-ip-address'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:10.029999 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.api.validators [None req-7cb139c9-7df2-44d5-90d2-7f4658846566 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] bootfile-name is not in valid_values {{(pid=103437) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 09 21:35:10.029999 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.api.validators [None req-7cb139c9-7df2-44d5-90d2-7f4658846566 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] tftp-server is not in valid_values {{(pid=103437) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 09 21:35:10.029999 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.api.validators [None req-7cb139c9-7df2-44d5-90d2-7f4658846566 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] server-ip-address is not in valid_values {{(pid=103437) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 09 21:35:10.051963 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e9edbd2-e5f0-434e-b585-e56a5de70a48 req-45aae4ea-66fa-46bb-a6d2-63b0edf3e53d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=1e54159e-3c83-49a1-a5b5-3e2b29336c43 HTTP/1.1" status: 200 len: 217 time: 0.0456367 Dec 09 21:35:10.092118 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-95c3b5be-695b-4074-ae45-edb0dc456d5b None None] Could not find standard attr ID for object b2c96ca5-1210-41a8-843a-175b55a5b7f6. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:35:10.116796 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e9edbd2-e5f0-434e-b585-e56a5de70a48 req-f60d6c58-b934-4582-b911-62d819a7b3c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:10.118823 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e9edbd2-e5f0-434e-b585-e56a5de70a48 req-f60d6c58-b934-4582-b911-62d819a7b3c6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=4700ee88-1952-42ab-9242-d93b9f07f2be HTTP/1.1" status: 200 len: 852 time: 0.0593920 Dec 09 21:35:10.167069 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7cb139c9-7df2-44d5-90d2-7f4658846566 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:10.172245 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e9edbd2-e5f0-434e-b585-e56a5de70a48 req-51c4b59c-82b6-4370-88ef-b6f4bb12a935 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=88af5e51-6d1a-432d-8676-517f449774a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0405004 Dec 09 21:35:10.324620 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-04de32a7-eb13-4a7b-b4b0-fad7173dcc16 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-securitygroup--1446596926&fields=id&tenant_id=aacb3291db4d4252a9225e8fe617f667 HTTP/1.1" status: 200 len: 267 time: 0.1550486 Dec 09 21:35:10.444101 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7cb139c9-7df2-44d5-90d2-7f4658846566 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:10.452437 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7cb139c9-7df2-44d5-90d2-7f4658846566 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:10.482615 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a24908ab-7110-49fb-b342-535c7cdbe006 req-34063047-69d7-4e4f-abb5-97504d79d9f4 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:10.491074 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a24908ab-7110-49fb-b342-535c7cdbe006 req-34063047-69d7-4e4f-abb5-97504d79d9f4 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.2639780 Dec 09 21:35:10.522263 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-7cb139c9-7df2-44d5-90d2-7f4658846566 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] In _notify_port_updated(), no bound segment for port 50804e7a-11e2-48a6-99fb-3531a11cd510 on network 86072419-49ea-476c-b820-ed3dbcf0e0de {{(pid=103437) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:35:10.531386 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7cb139c9-7df2-44d5-90d2-7f4658846566 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:10.532020 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7cb139c9-7df2-44d5-90d2-7f4658846566 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:10.535943 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e9edbd2-e5f0-434e-b585-e56a5de70a48 req-af9ce3c9-1a71-4844-a5a8-32e42bc7d7af service neutron] 10.222.0.31 "GET /v2.0/networks/88af5e51-6d1a-432d-8676-517f449774a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3546698 Dec 09 21:35:10.536272 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51028) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:10.536986 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7cb139c9-7df2-44d5-90d2-7f4658846566 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] 10.222.0.13 "PUT /v2.0/ports/50804e7a-11e2-48a6-99fb-3531a11cd510 HTTP/1.1" status: 200 len: 1130 time: 0.5304871 Dec 09 21:35:10.565101 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cb139c9-7df2-44d5-90d2-7f4658846566 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Pushing event updated for resources: {'Port': ['ID=50804e7a-11e2-48a6-99fb-3531a11cd510,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:10.612626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d5a737d9-a95a-481f-a466-6660559300c0 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:10.614295 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d5a737d9-a95a-481f-a466-6660559300c0 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] 10.222.0.13 "GET /v2.0/ports/50804e7a-11e2-48a6-99fb-3531a11cd510 HTTP/1.1" status: 200 len: 1130 time: 0.0711999 Dec 09 21:35:10.618052 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51030) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:10.676777 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a24908ab-7110-49fb-b342-535c7cdbe006 req-2127ccbc-9f6a-45a5-9e4f-802359de4e21 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1847811 Dec 09 21:35:10.702040 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-841fcc52-a069-491d-83a9-a98f22d592ad tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:10.702040 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-841fcc52-a069-491d-83a9-a98f22d592ad tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/networks?id=935b09ce-7410-4b66-82be-99978deb6717 HTTP/1.1" status: 200 len: 811 time: 0.3742023 Dec 09 21:35:10.781787 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-278c1900-4513-4570-b824-0924d954cfff tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/quotas/aacb3291db4d4252a9225e8fe617f667 HTTP/1.1" status: 200 len: 375 time: 0.0199227 Dec 09 21:35:10.806351 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-f45469e8-a1d1-4b07-a9fb-b2a013b77cd0 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Deleting port 50804e7a-11e2-48a6-99fb-3531a11cd510 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:35:10.806686 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f45469e8-a1d1-4b07-a9fb-b2a013b77cd0 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:10.856561 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e9edbd2-e5f0-434e-b585-e56a5de70a48 req-e5437a38-366d-4701-a69f-17ca759d87bb service neutron] 10.222.0.31 "GET /v2.0/networks/88af5e51-6d1a-432d-8676-517f449774a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2590656 Dec 09 21:35:10.893653 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-31677e37-ee87-4b68-9b75-26509e4479e2 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=aacb3291db4d4252a9225e8fe617f667&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0993330 Dec 09 21:35:10.924511 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-610ce0ec-ad67-4866-aefc-456b026db3d0 req-796987f5-5d10-459c-9cd6-68e89b208390 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:10.926276 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-610ce0ec-ad67-4866-aefc-456b026db3d0 req-796987f5-5d10-459c-9cd6-68e89b208390 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.0896564 Dec 09 21:35:10.930595 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-68c53f34-45f6-4a12-a988-7d0a26d72fff None None] Provisioning complete for port 50804e7a-11e2-48a6-99fb-3531a11cd510 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:10.935628 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-68c53f34-45f6-4a12-a988-7d0a26d72fff None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:10.950829 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f45469e8-a1d1-4b07-a9fb-b2a013b77cd0 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:10.979967 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-f45469e8-a1d1-4b07-a9fb-b2a013b77cd0 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Calling delete_port for 50804e7a-11e2-48a6-99fb-3531a11cd510 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:35:10.982304 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-68c53f34-45f6-4a12-a988-7d0a26d72fff None None] Port 50804e7a-11e2-48a6-99fb-3531a11cd510 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:35:11.084721 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-610ce0ec-ad67-4866-aefc-456b026db3d0 req-43ce1662-4bf8-4d3e-819b-1f3cc1b65281 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1235292 Dec 09 21:35:11.097443 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-635a0f35-a15d-427e-9425-70e5791f0403 service neutron] 10.222.0.13 "GET /v2.0/networks/935b09ce-7410-4b66-82be-99978deb6717?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1693869 Dec 09 21:35:11.164965 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f45469e8-a1d1-4b07-a9fb-b2a013b77cd0 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:11.201100 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f45469e8-a1d1-4b07-a9fb-b2a013b77cd0 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Pushing event deleted for resources: {'Port': ['ID=50804e7a-11e2-48a6-99fb-3531a11cd510,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:11.290438 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f45469e8-a1d1-4b07-a9fb-b2a013b77cd0 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:11.291413 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f45469e8-a1d1-4b07-a9fb-b2a013b77cd0 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] 10.222.0.13 "DELETE /v2.0/ports/50804e7a-11e2-48a6-99fb-3531a11cd510 HTTP/1.1" status: 204 len: 168 time: 0.6718330 Dec 09 21:35:11.298969 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51032) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:11.368166 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-98c3cf83-e3d4-4a9a-bb19-7165486d282a service neutron] 10.222.0.13 "GET /v2.0/networks/935b09ce-7410-4b66-82be-99978deb6717?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2512312 Dec 09 21:35:11.398281 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-a72e2b22-3f4e-4f56-9368-f7207e3f06ac tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Deleting subnet d4fcf60a-a648-40dc-bd05-97389860d251 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:35:11.401748 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a72e2b22-3f4e-4f56-9368-f7207e3f06ac tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:11.468171 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a72e2b22-3f4e-4f56-9368-f7207e3f06ac tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:11.633621 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f382c4cc-fa7f-49d8-acf0-0c18a93b3c6c req-b8b4a9f6-b121-4344-a601-faf3d56997f9 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7 HTTP/1.1" status: 200 len: 210 time: 0.0629246 Dec 09 21:35:11.649041 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a72e2b22-3f4e-4f56-9368-f7207e3f06ac tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:11.729148 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a72e2b22-3f4e-4f56-9368-f7207e3f06ac tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:11.745353 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a72e2b22-3f4e-4f56-9368-f7207e3f06ac tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:11.749863 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a72e2b22-3f4e-4f56-9368-f7207e3f06ac tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] 10.222.0.13 "DELETE /v2.0/subnets/d4fcf60a-a648-40dc-bd05-97389860d251 HTTP/1.1" status: 204 len: 168 time: 0.4501901 Dec 09 21:35:11.752457 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51048) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:11.759106 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42153edb-2cf1-4a8f-92cf-d11e10e13400 None None] Network 86072419-49ea-476c-b820-ed3dbcf0e0de requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:35:11.805587 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a72e2b22-3f4e-4f56-9368-f7207e3f06ac tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Pushing event deleted for resources: {'Subnet': ['ID=d4fcf60a-a648-40dc-bd05-97389860d251,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:11.875380 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23715418-2735-4245-9df3-3125ea331d1f req-bdaa44a3-bcc6-4441-93de-52c30ffe949c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:11.877172 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-23715418-2735-4245-9df3-3125ea331d1f req-bdaa44a3-bcc6-4441-93de-52c30ffe949c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0739002 Dec 09 21:35:11.976376 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9fa123f-2b81-49d4-81df-007b329a0762 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:12.002133 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-23715418-2735-4245-9df3-3125ea331d1f req-bb554632-85a0-4343-b7ee-246a370b97ea tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1181188 Dec 09 21:35:12.018233 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ffe98e16-579e-4d8e-966d-42350d8d0c4b None None] DHCP port deletion for 86072419-49ea-476c-b820-ed3dbcf0e0de request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:35:12.088153 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-e9fa123f-2b81-49d4-81df-007b329a0762 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Deleting port 5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:35:12.088662 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9fa123f-2b81-49d4-81df-007b329a0762 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:12.116789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ffe98e16-579e-4d8e-966d-42350d8d0c4b None None] Deleting port 5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:35:12.117367 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ffe98e16-579e-4d8e-966d-42350d8d0c4b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:12.217856 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ffe98e16-579e-4d8e-966d-42350d8d0c4b None None] For port 5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986,segment=NetworkSegment(f4338cc9-8b63-443b-88e9-e8598d01beee),segment_id=f4338cc9-8b63-443b-88e9-e8598d01beee)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:35:12.220618 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ffe98e16-579e-4d8e-966d-42350d8d0c4b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:12.228000 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-e9fa123f-2b81-49d4-81df-007b329a0762 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] For port 5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986,segment=NetworkSegment(f4338cc9-8b63-443b-88e9-e8598d01beee),segment_id=f4338cc9-8b63-443b-88e9-e8598d01beee)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:35:12.228600 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9fa123f-2b81-49d4-81df-007b329a0762 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:12.258762 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ffe98e16-579e-4d8e-966d-42350d8d0c4b None None] Calling delete_port for 5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:35:12.268210 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-e9fa123f-2b81-49d4-81df-007b329a0762 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Calling delete_port for 5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:35:12.308057 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2a30a96-661c-45fd-8750-45f5bdddf9ff req-f4031755-d64f-4d92-a2cc-d2673bf68c05 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:12.314547 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c2a30a96-661c-45fd-8750-45f5bdddf9ff req-f4031755-d64f-4d92-a2cc-d2673bf68c05 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.1091788 Dec 09 21:35:12.414184 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9fa123f-2b81-49d4-81df-007b329a0762 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:12.443682 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ffe98e16-579e-4d8e-966d-42350d8d0c4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:12.450171 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c2a30a96-661c-45fd-8750-45f5bdddf9ff req-3a39ba88-bf26-4069-b2cf-c9a4edf013e7 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1226699 Dec 09 21:35:12.460285 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9fa123f-2b81-49d4-81df-007b329a0762 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Pushing event deleted for resources: {'Port': ['ID=5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:12.469023 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9fa123f-2b81-49d4-81df-007b329a0762 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] No DVR routers for this DVR port 5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:35:12.474805 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ffe98e16-579e-4d8e-966d-42350d8d0c4b None None] No DVR routers for this DVR port 5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:35:12.509602 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffe98e16-579e-4d8e-966d-42350d8d0c4b None None] Pushing event deleted for resources: {'Port': ['ID=5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:12.599895 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9fa123f-2b81-49d4-81df-007b329a0762 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:12.624748 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-e9fa123f-2b81-49d4-81df-007b329a0762 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['86072419-49ea-476c-b820-ed3dbcf0e0de']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:12.637975 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-e9fa123f-2b81-49d4-81df-007b329a0762 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f4338cc9-8b63-443b-88e9-e8598d01beee') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:12.638277 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-e9fa123f-2b81-49d4-81df-007b329a0762 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f4338cc9-8b63-443b-88e9-e8598d01beee') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:12.648398 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9fa123f-2b81-49d4-81df-007b329a0762 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:12.664487 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9fa123f-2b81-49d4-81df-007b329a0762 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:12.671862 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e9fa123f-2b81-49d4-81df-007b329a0762 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Releasing vlan 138 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:35:12.672267 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9fa123f-2b81-49d4-81df-007b329a0762 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:35:12.675686 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:35:12.750848 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35260811-8d43-41f0-a618-f6cc7df36fda req-1c46dbc5-fb15-4105-a05d-c500b266fc94 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7 HTTP/1.1" status: 200 len: 210 time: 0.0392411 Dec 09 21:35:12.755622 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9fa123f-2b81-49d4-81df-007b329a0762 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:12.764396 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9fa123f-2b81-49d4-81df-007b329a0762 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:12.771048 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e9fa123f-2b81-49d4-81df-007b329a0762 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] 10.222.0.13 "DELETE /v2.0/networks/86072419-49ea-476c-b820-ed3dbcf0e0de HTTP/1.1" status: 204 len: 168 time: 1.0166841 Dec 09 21:35:12.801449 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9fa123f-2b81-49d4-81df-007b329a0762 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877 tempest-ExtraDHCPOptionsIpV6TestJSON-1980229877-project] Pushing event deleted for resources: {'Network': ['ID=86072419-49ea-476c-b820-ed3dbcf0e0de,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:12.969378 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-c5420ebf-8684-447d-a4c2-ce3da7e3910b tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:12.970967 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-c5420ebf-8684-447d-a4c2-ce3da7e3910b tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.10 "GET /v2.0/networks?id=935b09ce-7410-4b66-82be-99978deb6717 HTTP/1.1" status: 200 len: 811 time: 0.1149223 Dec 09 21:35:13.042038 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-60d16de4-b156-40f0-8032-a05e60e6c760 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.10 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=aacb3291db4d4252a9225e8fe617f667 HTTP/1.1" status: 200 len: 380 time: 0.0615702 Dec 09 21:35:13.056682 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-acb974af-6222-4163-a97c-26b4ed276183 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Request body: {'port': {'device_id': '0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'admin_state_up': True, 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'security_groups': ['19432415-a2e0-4a11-9022-46c83da8ae04']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:13.095059 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51078) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:13.166321 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeb89d8b-145a-4d3c-8e91-fb8b24c111dd req-316ef637-09d3-454e-86ac-5081cb9369f6 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:13.168024 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eeb89d8b-145a-4d3c-8e91-fb8b24c111dd req-316ef637-09d3-454e-86ac-5081cb9369f6 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.0603883 Dec 09 21:35:13.211416 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-acb974af-6222-4163-a97c-26b4ed276183 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Made reservation on behalf of aacb3291db4d4252a9225e8fe617f667 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:13.216788 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-acb974af-6222-4163-a97c-26b4ed276183 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:13.229528 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eeb89d8b-145a-4d3c-8e91-fb8b24c111dd req-d48ac4ac-5433-46d7-a167-77ee2aac5363 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0553863 Dec 09 21:35:13.325753 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3394f515-74d1-46e4-a826-e3fd032a1b29 req-9e1f0c18-9786-459f-8c7f-74fb376293f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:13.327273 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3394f515-74d1-46e4-a826-e3fd032a1b29 req-9e1f0c18-9786-459f-8c7f-74fb376293f4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=29f2c1d9be9348b0888bc61ed37ed957&device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 1097 time: 0.0865018 Dec 09 21:35:13.358858 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-acb974af-6222-4163-a97c-26b4ed276183 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Allocated IP 172.20.0.5 (935b09ce-7410-4b66-82be-99978deb6717/10ff3f47-d1f4-47a0-808e-f885899dfb29/ad97d669-4d68-4099-b1bd-992fd4cfb91c) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:35:13.376916 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-62d09b1a-c012-4fc8-9681-b4ad47278c85 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=9f4d38f818a94ba5b3467a48bcb9306c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2780380 Dec 09 21:35:13.377511 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51086) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:13.438898 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-568c568c-7b8d-4632-9875-cf68285c9962 req-f72148be-f617-4b55-adfe-2728bdb4d091 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:13.440492 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-568c568c-7b8d-4632-9875-cf68285c9962 req-f72148be-f617-4b55-adfe-2728bdb4d091 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 945 time: 0.1315293 Dec 09 21:35:13.484853 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3394f515-74d1-46e4-a826-e3fd032a1b29 req-c2bbef7a-12e8-4259-892b-7d2fa872550b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:13.486347 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3394f515-74d1-46e4-a826-e3fd032a1b29 req-c2bbef7a-12e8-4259-892b-7d2fa872550b service neutron] 10.222.0.31 "GET /v2.0/networks?id=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 HTTP/1.1" status: 200 len: 917 time: 0.1491196 Dec 09 21:35:13.507357 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9876e120-fce5-43b6-bf70-75abb6f4cff1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:13.534608 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:35:13.535315 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-568c568c-7b8d-4632-9875-cf68285c9962 req-5504b149-d7d9-486c-8431-407e43ddca3b tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0862582 Dec 09 21:35:13.575700 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9876e120-fce5-43b6-bf70-75abb6f4cff1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:13.579987 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:35:13.580331 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5d07ce2e-6d19-4cfe-bc8e-1396a2d7e986 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:35:13.595154 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1e54159e-3c83-49a1-a5b5-3e2b29336c43 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:35:13.609126 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3394f515-74d1-46e4-a826-e3fd032a1b29 req-cc7671bf-b8b0-41c9-8e1b-bf67699e89df service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=851ff09f-496e-47bd-85bb-2e21622a44e9 HTTP/1.1" status: 200 len: 1001 time: 0.0901875 Dec 09 21:35:13.623181 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-acb974af-6222-4163-a97c-26b4ed276183 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:13.690964 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9876e120-fce5-43b6-bf70-75abb6f4cff1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:13.695373 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9876e120-fce5-43b6-bf70-75abb6f4cff1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:13.697815 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9876e120-fce5-43b6-bf70-75abb6f4cff1 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/7ae70f87-9871-4238-ad98-f49d5ac64419 HTTP/1.1" status: 204 len: 168 time: 0.3191869 Dec 09 21:35:13.701484 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-acb974af-6222-4163-a97c-26b4ed276183 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:13.725049 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:13.742492 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-438ac6c7-ae54-4528-a17b-0270e2cdc323 req-52928290-b66e-4366-a14c-aaebdd28ab8c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:13.750490 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-438ac6c7-ae54-4528-a17b-0270e2cdc323 req-52928290-b66e-4366-a14c-aaebdd28ab8c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.1401594 Dec 09 21:35:13.760892 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9876e120-fce5-43b6-bf70-75abb6f4cff1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7ae70f87-9871-4238-ad98-f49d5ac64419,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:13.765084 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 1e54159e-3c83-49a1-a5b5-3e2b29336c43, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1e54159e-3c83-49a1-a5b5-3e2b29336c43,segment=NetworkSegment(dcec1a9e-3140-49cf-a664-3f1f0937898f),segment_id=dcec1a9e-3140-49cf-a664-3f1f0937898f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:35:13.765485 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3394f515-74d1-46e4-a826-e3fd032a1b29 req-904bd8c5-1c3b-4241-b5db-52f6a4630cf2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:13.766221 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'af704653-9f02-4515-9fb8-0f0869d126b2', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '1e54159e-3c83-49a1-a5b5-3e2b29336c43'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:35:13.767062 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3394f515-74d1-46e4-a826-e3fd032a1b29 req-904bd8c5-1c3b-4241-b5db-52f6a4630cf2 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ace82e8b-012a-4184-a81e-5303eecf12ff HTTP/1.1" status: 200 len: 855 time: 0.1449423 Dec 09 21:35:13.768786 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9c392013-b6e2-408c-ae98-09786153f38b" -d '{"events": [{"server_uuid": "af704653-9f02-4515-9fb8-0f0869d126b2", "name": "network-vif-unplugged", "status": "completed", "tag": "1e54159e-3c83-49a1-a5b5-3e2b29336c43"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:35:13.774263 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:13.783603 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-acb974af-6222-4163-a97c-26b4ed276183 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Network 935b09ce-7410-4b66-82be-99978deb6717 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:35:13.795216 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-acb974af-6222-4163-a97c-26b4ed276183 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:13.800818 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-acb974af-6222-4163-a97c-26b4ed276183 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:35:13.859743 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=1e54159e-3c83-49a1-a5b5-3e2b29336c43,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:13.890520 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-438ac6c7-ae54-4528-a17b-0270e2cdc323 req-5c1a1552-47f2-43e6-9ef4-ac62aad54fda tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1388605 Dec 09 21:35:13.893568 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Thu, 09 Dec 2021 21:35:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a2768f28-487a-4e98-8f9d-02ec5d284f18 x-openstack-request-id: req-a2768f28-487a-4e98-8f9d-02ec5d284f18 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:35:13.893861 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "af704653-9f02-4515-9fb8-0f0869d126b2", "name": "network-vif-unplugged", "status": "failed", "tag": "1e54159e-3c83-49a1-a5b5-3e2b29336c43", "code": 422}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:35:13.894115 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a2768f28-487a-4e98-8f9d-02ec5d284f18 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:35:13.895057 n-d-713301-27 neutron-server[103439]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'af704653-9f02-4515-9fb8-0f0869d126b2', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '1e54159e-3c83-49a1-a5b5-3e2b29336c43', 'code': 422} returned with failed status Dec 09 21:35:13.902157 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3394f515-74d1-46e4-a826-e3fd032a1b29 req-27b60237-b1ff-48d9-a795-8d8ce2ed8808 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:13.903726 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3394f515-74d1-46e4-a826-e3fd032a1b29 req-27b60237-b1ff-48d9-a795-8d8ce2ed8808 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1275961 Dec 09 21:35:14.015338 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-acb974af-6222-4163-a97c-26b4ed276183 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:14.016200 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-acb974af-6222-4163-a97c-26b4ed276183 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:14.032343 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acb974af-6222-4163-a97c-26b4ed276183 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Pushing event updated for resources: {'Port': ['ID=ad97d669-4d68-4099-b1bd-992fd4cfb91c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:14.056869 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-acb974af-6222-4163-a97c-26b4ed276183 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0085878 Dec 09 21:35:14.063518 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3394f515-74d1-46e4-a826-e3fd032a1b29 req-68f16657-ff21-4980-b325-f5ec82bca2d6 service neutron] 10.222.0.31 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1496663 Dec 09 21:35:14.068345 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-6d1bf9d2-f874-467c-9011-6ef142c5abbd service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 665 time: 0.1619463 Dec 09 21:35:14.081647 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-99ccb59d-461f-4cfd-8f4f-6957fb5ac935 service neutron] Request body: {'port': {'device_id': '0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:14.099221 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-018493ba-2148-4ee8-b5e9-ea67c431a2e0 req-e5393b4b-c7aa-4c55-b3fa-4b4b0114a83f tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:14.100921 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-018493ba-2148-4ee8-b5e9-ea67c431a2e0 req-e5393b4b-c7aa-4c55-b3fa-4b4b0114a83f tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7 HTTP/1.1" status: 200 len: 931 time: 0.0903893 Dec 09 21:35:14.248967 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6b4c4eea-c78f-4404-905e-6d1f1d38ce4b None None] Provisioning complete for port ad97d669-4d68-4099-b1bd-992fd4cfb91c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:14.249822 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6b4c4eea-c78f-4404-905e-6d1f1d38ce4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:14.268989 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-018493ba-2148-4ee8-b5e9-ea67c431a2e0 req-a26ff6b4-2aff-48fe-b3f2-777ddb73bf07 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=19432415-a2e0-4a11-9022-46c83da8ae04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1554301 Dec 09 21:35:14.271087 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-99ccb59d-461f-4cfd-8f4f-6957fb5ac935 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:14.315180 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-6b4c4eea-c78f-4404-905e-6d1f1d38ce4b None None] Port ad97d669-4d68-4099-b1bd-992fd4cfb91c cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:35:14.324301 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3394f515-74d1-46e4-a826-e3fd032a1b29 req-f40be295-9a6e-40d9-bd65-5f42c9c4742d service neutron] 10.222.0.31 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2474957 Dec 09 21:35:14.342598 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fdd53a22-ff39-4d09-9e9c-476445c958af req-07c47327-1dd6-47a5-b4ec-343235e876f0 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0859125 Dec 09 21:35:14.343118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d9cf7f4-4bf4-41da-be6e-cd0eb1b04764 req-dd7e45db-f015-4437-9832-0c1d4694666d tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:14.351378 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d9cf7f4-4bf4-41da-be6e-cd0eb1b04764 req-dd7e45db-f015-4437-9832-0c1d4694666d tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 943 time: 0.1074953 Dec 09 21:35:14.352634 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-073eadd2-8e65-467b-b43f-435af946e59b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:14.353322 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-073eadd2-8e65-467b-b43f-435af946e59b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:14.353845 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-073eadd2-8e65-467b-b43f-435af946e59b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:14.354372 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-073eadd2-8e65-467b-b43f-435af946e59b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:14.354830 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-073eadd2-8e65-467b-b43f-435af946e59b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:14.355387 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-073eadd2-8e65-467b-b43f-435af946e59b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:14.355899 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-073eadd2-8e65-467b-b43f-435af946e59b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:14.357995 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-073eadd2-8e65-467b-b43f-435af946e59b service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0a5d0e4652be4d8b87936a559840cc87&device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 6509 time: 0.2120211 Dec 09 21:35:14.434351 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d9cf7f4-4bf4-41da-be6e-cd0eb1b04764 req-b095b093-426b-44c5-88b0-12d36d716130 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0816617 Dec 09 21:35:14.627022 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-7d4c2591-ccc6-40d2-8697-6c09c548a918 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:14.627562 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-7d4c2591-ccc6-40d2-8697-6c09c548a918 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:14.628083 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-7d4c2591-ccc6-40d2-8697-6c09c548a918 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:14.629851 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-7d4c2591-ccc6-40d2-8697-6c09c548a918 service neutron] 10.222.0.10 "GET /v2.0/networks?id=361619eb-51a4-4728-b2cc-72e27ec4eca5&id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&id=ae9d25d5-c9a2-4627-a465-8324b17541d9&id=ae9d25d5-c9a2-4627-a465-8324b17541d9 HTTP/1.1" status: 200 len: 2296 time: 0.1887288 Dec 09 21:35:14.762775 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-f1161c06-7bf6-4c45-aaa1-afc0f5759109 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a HTTP/1.1" status: 200 len: 1002 time: 0.1148946 Dec 09 21:35:14.765933 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51144) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:14.786228 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-99ccb59d-461f-4cfd-8f4f-6957fb5ac935 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ad97d669-4d68-4099-b1bd-992fd4cfb91c {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:35:14.812338 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-99ccb59d-461f-4cfd-8f4f-6957fb5ac935 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:14.835075 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-99ccb59d-461f-4cfd-8f4f-6957fb5ac935 service neutron] Transition to ACTIVE for port object ad97d669-4d68-4099-b1bd-992fd4cfb91c will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:35:14.840783 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-99ccb59d-461f-4cfd-8f4f-6957fb5ac935 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:14.843796 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-452596fe-d023-410a-9e99-acaf64202944 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:14.845315 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-452596fe-d023-410a-9e99-acaf64202944 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=d989acab-7cdc-482f-a350-344dd6e11873 HTTP/1.1" status: 200 len: 856 time: 0.0684886 Dec 09 21:35:14.912557 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-b17b270d-4c48-4dce-b457-b1c9c54b3552 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Request body: {'network': {'name': 'tempest-FloatingIPNegativeTestJSON-test-network-1502169003'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:14.938877 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99ccb59d-461f-4cfd-8f4f-6957fb5ac935 service neutron] Pushing event updated for resources: {'Port': ['ID=ad97d669-4d68-4099-b1bd-992fd4cfb91c,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:14.970906 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b17b270d-4c48-4dce-b457-b1c9c54b3552 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Made reservation on behalf of ecc44ce822d64b69a363fb65aee7aba0 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:14.974979 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b17b270d-4c48-4dce-b457-b1c9c54b3552 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:14.980189 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-3feb8e4f-7098-430f-90db-ba6d8c3f8ac7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:14.981722 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-3feb8e4f-7098-430f-90db-ba6d8c3f8ac7 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=361619eb-51a4-4728-b2cc-72e27ec4eca5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1121135 Dec 09 21:35:14.993514 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b17b270d-4c48-4dce-b457-b1c9c54b3552 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:15.079598 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-99ccb59d-461f-4cfd-8f4f-6957fb5ac935 service neutron] Attempting to bind port ad97d669-4d68-4099-b1bd-992fd4cfb91c on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:35:15.080214 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-99ccb59d-461f-4cfd-8f4f-6957fb5ac935 service neutron] Attempting to bind port ad97d669-4d68-4099-b1bd-992fd4cfb91c by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'd3bafd14-6a72-4dc5-8e4d-11da22a389ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '935b09ce-7410-4b66-82be-99978deb6717'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:35:15.080346 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-99ccb59d-461f-4cfd-8f4f-6957fb5ac935 service neutron] Attempting to bind port ad97d669-4d68-4099-b1bd-992fd4cfb91c on network 935b09ce-7410-4b66-82be-99978deb6717 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:35:15.089110 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-99ccb59d-461f-4cfd-8f4f-6957fb5ac935 service neutron] Port ad97d669-4d68-4099-b1bd-992fd4cfb91c on network 935b09ce-7410-4b66-82be-99978deb6717 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:35:15.089879 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-99ccb59d-461f-4cfd-8f4f-6957fb5ac935 service neutron] Attempting to bind port ad97d669-4d68-4099-b1bd-992fd4cfb91c on network 935b09ce-7410-4b66-82be-99978deb6717 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:35:15.095819 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-623620f1-dd05-4ae8-a8bd-0a604ebbb0da req-b8905bf3-7967-4ba8-be11-9999f4343dfa tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:15.097507 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-623620f1-dd05-4ae8-a8bd-0a604ebbb0da req-b8905bf3-7967-4ba8-be11-9999f4343dfa tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.0854466 Dec 09 21:35:15.100185 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-99ccb59d-461f-4cfd-8f4f-6957fb5ac935 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 34, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:35:15.100527 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-99ccb59d-461f-4cfd-8f4f-6957fb5ac935 service neutron] Checking segment: {'id': 'd3bafd14-6a72-4dc5-8e4d-11da22a389ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '935b09ce-7410-4b66-82be-99978deb6717'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:35:15.100912 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-99ccb59d-461f-4cfd-8f4f-6957fb5ac935 service neutron] Bound using segment: {'id': 'd3bafd14-6a72-4dc5-8e4d-11da22a389ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '935b09ce-7410-4b66-82be-99978deb6717'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:35:15.101348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-99ccb59d-461f-4cfd-8f4f-6957fb5ac935 service neutron] Bound port: ad97d669-4d68-4099-b1bd-992fd4cfb91c, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd3bafd14-6a72-4dc5-8e4d-11da22a389ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '935b09ce-7410-4b66-82be-99978deb6717'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:35:15.101781 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-99ccb59d-461f-4cfd-8f4f-6957fb5ac935 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:15.128070 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-9618553a-4faf-4115-a4dc-3072aea0cbba service neutron] 10.222.0.10 "GET /v2.0/networks/361619eb-51a4-4728-b2cc-72e27ec4eca5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1378658 Dec 09 21:35:15.152057 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b17b270d-4c48-4dce-b457-b1c9c54b3552 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:15.163331 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b17b270d-4c48-4dce-b457-b1c9c54b3552 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:15.182906 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-623620f1-dd05-4ae8-a8bd-0a604ebbb0da req-8775b232-7f01-412c-bf45-b50c5f5fcc5a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0787191 Dec 09 21:35:15.196536 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b17b270d-4c48-4dce-b457-b1c9c54b3552 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] vlan segment allocate from pool success with {'vlan_id': 137, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:35:15.207695 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b17b270d-4c48-4dce-b457-b1c9c54b3552 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Pushing event updated for resources: {'SecurityGroup': ['ID=49ddb38d-0387-4f04-9816-b5d05f7c3b4e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:15.213266 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b17b270d-4c48-4dce-b457-b1c9c54b3552 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:15.214316 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-b17b270d-4c48-4dce-b457-b1c9c54b3552 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Added segment cf548278-150e-452f-8c72-997eedda8d62 of type vlan for network 1e591eba-fb21-4ad9-9d15-aeb856903ce8 Dec 09 21:35:15.246599 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-99ccb59d-461f-4cfd-8f4f-6957fb5ac935 service neutron] For port ad97d669-4d68-4099-b1bd-992fd4cfb91c, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:35:15.264424 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-99ccb59d-461f-4cfd-8f4f-6957fb5ac935 service neutron] For port ad97d669-4d68-4099-b1bd-992fd4cfb91c, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=ad97d669-4d68-4099-b1bd-992fd4cfb91c,segment=NetworkSegment(d3bafd14-6a72-4dc5-8e4d-11da22a389ed),segment_id=d3bafd14-6a72-4dc5-8e4d-11da22a389ed)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:35:15.271699 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b17b270d-4c48-4dce-b457-b1c9c54b3552 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:15.272325 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-99ccb59d-461f-4cfd-8f4f-6957fb5ac935 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:15.285447 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-07cc4d39-7fc5-4b0a-beab-150334f1d8ec service neutron] 10.222.0.10 "GET /v2.0/networks/361619eb-51a4-4728-b2cc-72e27ec4eca5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1377327 Dec 09 21:35:15.347380 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-99ccb59d-461f-4cfd-8f4f-6957fb5ac935 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:15.348032 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-99ccb59d-461f-4cfd-8f4f-6957fb5ac935 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:15.349461 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-99ccb59d-461f-4cfd-8f4f-6957fb5ac935 service neutron] 10.222.0.10 "PUT /v2.0/ports/ad97d669-4d68-4099-b1bd-992fd4cfb91c HTTP/1.1" status: 200 len: 1092 time: 1.2800713 Dec 09 21:35:15.352197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7', 'tag': 'ad97d669-4d68-4099-b1bd-992fd4cfb91c'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:35:15.356823 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d26a32dc-a493-420a-8e97-c200ac62c21b" -d '{"events": [{"name": "network-changed", "server_uuid": "0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7", "tag": "ad97d669-4d68-4099-b1bd-992fd4cfb91c"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:35:15.363482 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-75cd6532-d7a3-4aee-ae9a-e40cab4d2d3c service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.107&port_id=18d9d7fa-fedf-4844-90ef-6757eb984ae2 HTTP/1.1" status: 200 len: 217 time: 0.0594862 Dec 09 21:35:15.366080 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd53a22-ff39-4d09-9e9c-476445c958af req-57bc9135-3627-403f-a0dd-0d88d3768640 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:15.367629 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fdd53a22-ff39-4d09-9e9c-476445c958af req-57bc9135-3627-403f-a0dd-0d88d3768640 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2&tenant_id=b65669b5d4924ee090e9583aa839a399 HTTP/1.1" status: 200 len: 1095 time: 0.0931051 Dec 09 21:35:15.368237 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b17b270d-4c48-4dce-b457-b1c9c54b3552 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:15.374087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b17b270d-4c48-4dce-b457-b1c9c54b3552 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:15.374798 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b17b270d-4c48-4dce-b457-b1c9c54b3552 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:15.419728 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99ccb59d-461f-4cfd-8f4f-6957fb5ac935 service neutron] Pushing event updated for resources: {'Port': ['ID=ad97d669-4d68-4099-b1bd-992fd4cfb91c,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:15.466729 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:35:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b45aa4e6-c24f-4c1e-9c58-9502e1d710f0 x-openstack-request-id: req-b45aa4e6-c24f-4c1e-9c58-9502e1d710f0 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:35:15.467026 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7", "tag": "ad97d669-4d68-4099-b1bd-992fd4cfb91c", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:35:15.467277 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-b45aa4e6-c24f-4c1e-9c58-9502e1d710f0 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:35:15.467737 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7', 'tag': 'ad97d669-4d68-4099-b1bd-992fd4cfb91c', 'status': 'completed', 'code': 200} Dec 09 21:35:15.470368 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-98c94467-0821-42c4-8bb3-2d24928cadc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:15.471918 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-98c94467-0821-42c4-8bb3-2d24928cadc0 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=871c2dc1-486e-4fcf-a882-5a1394082fc5 HTTP/1.1" status: 200 len: 797 time: 0.1020584 Dec 09 21:35:15.482464 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b17b270d-4c48-4dce-b457-b1c9c54b3552 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 794 time: 0.7151949 Dec 09 21:35:15.489602 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51158) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:15.514317 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2541463f-bc4c-4a1b-9e63-344ea2660e8a tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Request body: {'subnet': {'network_id': '1e591eba-fb21-4ad9-9d15-aeb856903ce8', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:15.529417 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b17b270d-4c48-4dce-b457-b1c9c54b3552 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Pushing event updated for resources: {'Network': ['ID=1e591eba-fb21-4ad9-9d15-aeb856903ce8,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:15.540452 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 1e591eba-fb21-4ad9-9d15-aeb856903ce8 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:35:15.565557 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-efaf80b3-5a53-4d4e-ac4d-986a3c49a527 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:15.567202 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-efaf80b3-5a53-4d4e-ac4d-986a3c49a527 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=aacb3291db4d4252a9225e8fe617f667&device_id=0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7 HTTP/1.1" status: 200 len: 1095 time: 0.1408961 Dec 09 21:35:15.577980 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3440443-4860-4173-87d0-3dfcfa50f55e req-8d7f763b-ea93-438a-94d6-1cc4efeadc79 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:15.579780 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a3440443-4860-4173-87d0-3dfcfa50f55e req-8d7f763b-ea93-438a-94d6-1cc4efeadc79 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7 HTTP/1.1" status: 200 len: 943 time: 0.1687255 Dec 09 21:35:15.587020 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd53a22-ff39-4d09-9e9c-476445c958af req-f90ea451-bebf-4c06-9cd3-401a740ab91a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:15.588565 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fdd53a22-ff39-4d09-9e9c-476445c958af req-f90ea451-bebf-4c06-9cd3-401a740ab91a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=b65669b5d4924ee090e9583aa839a399&device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 1095 time: 0.1786499 Dec 09 21:35:15.659670 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-7d2956d2-007b-496e-9d7c-7ec11f1860c1 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ad97d669-4d68-4099-b1bd-992fd4cfb91c HTTP/1.1" status: 200 len: 217 time: 0.0542147 Dec 09 21:35:15.664195 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce39a9e4-c384-4ba0-bc0f-a08152374639 req-3636a848-416b-46f2-8165-eb3f868b4903 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:15.665481 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-519decf6-7f61-461c-badc-739ac0379ee5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:15.665760 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ce39a9e4-c384-4ba0-bc0f-a08152374639 req-3636a848-416b-46f2-8165-eb3f868b4903 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 943 time: 0.1338856 Dec 09 21:35:15.666948 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-519decf6-7f61-461c-badc-739ac0379ee5 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1869230 Dec 09 21:35:15.736630 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a3440443-4860-4173-87d0-3dfcfa50f55e req-7572d251-2c34-4ec0-baea-60af201300e6 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=19432415-a2e0-4a11-9022-46c83da8ae04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1458299 Dec 09 21:35:15.774662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd53a22-ff39-4d09-9e9c-476445c958af req-b421c53b-cad8-4f1a-b8ef-d32e7c268cc8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:15.776236 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fdd53a22-ff39-4d09-9e9c-476445c958af req-b421c53b-cad8-4f1a-b8ef-d32e7c268cc8 service neutron] 10.222.0.31 "GET /v2.0/networks?id=88af5e51-6d1a-432d-8676-517f449774a3 HTTP/1.1" status: 200 len: 913 time: 0.1767592 Dec 09 21:35:15.779756 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ce39a9e4-c384-4ba0-bc0f-a08152374639 req-bad09bf3-3b84-4504-8f60-a2bd353a071a tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0803022 Dec 09 21:35:15.800863 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-b367c2f0-407b-4f12-9764-bd7c63100c18 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:15.803044 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-b367c2f0-407b-4f12-9764-bd7c63100c18 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=10ff3f47-d1f4-47a0-808e-f885899dfb29 HTTP/1.1" status: 200 len: 850 time: 0.1305845 Dec 09 21:35:15.805449 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2541463f-bc4c-4a1b-9e63-344ea2660e8a tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Made reservation on behalf of ecc44ce822d64b69a363fb65aee7aba0 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:15.817098 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2541463f-bc4c-4a1b-9e63-344ea2660e8a tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:15.830363 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fdd53a22-ff39-4d09-9e9c-476445c958af req-f4a6b2f8-a8da-496e-b64a-7db0f754b0f8 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=1e54159e-3c83-49a1-a5b5-3e2b29336c43 HTTP/1.1" status: 200 len: 217 time: 0.0456548 Dec 09 21:35:15.882811 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd53a22-ff39-4d09-9e9c-476445c958af req-8331675f-bd6f-4c91-a036-658e422710dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:15.884449 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fdd53a22-ff39-4d09-9e9c-476445c958af req-8331675f-bd6f-4c91-a036-658e422710dc service neutron] 10.222.0.31 "GET /v2.0/subnets?id=4700ee88-1952-42ab-9242-d93b9f07f2be HTTP/1.1" status: 200 len: 852 time: 0.0474348 Dec 09 21:35:15.922020 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fdd53a22-ff39-4d09-9e9c-476445c958af req-6a63bdfa-1dfa-4a17-9dd9-ae10adfebe11 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=88af5e51-6d1a-432d-8676-517f449774a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0305991 Dec 09 21:35:15.923126 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-df8f9661-98e6-4220-9602-959852a856c7 service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2397499 Dec 09 21:35:15.953559 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-533b7105-d550-4ec5-8b3d-a1ee4eb58b22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:15.955145 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-533b7105-d550-4ec5-8b3d-a1ee4eb58b22 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=935b09ce-7410-4b66-82be-99978deb6717&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1399658 Dec 09 21:35:16.029462 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fdd53a22-ff39-4d09-9e9c-476445c958af req-c716fa2d-2bc8-45d7-b7c3-b7b5d78c87c4 service neutron] 10.222.0.31 "GET /v2.0/networks/88af5e51-6d1a-432d-8676-517f449774a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0958529 Dec 09 21:35:16.123263 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fdd53a22-ff39-4d09-9e9c-476445c958af req-7103c851-bda9-4e88-886d-07f6682b9c57 service neutron] 10.222.0.31 "GET /v2.0/networks/88af5e51-6d1a-432d-8676-517f449774a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0849211 Dec 09 21:35:16.373234 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffd4aafd-470c-4a07-a82b-6b9be17fbe88 req-3fa2130e-ab6f-4f28-b5ff-7bd0b69f0696 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:16.376503 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ffd4aafd-470c-4a07-a82b-6b9be17fbe88 req-3fa2130e-ab6f-4f28-b5ff-7bd0b69f0696 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 945 time: 0.0698767 Dec 09 21:35:16.433001 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ffd4aafd-470c-4a07-a82b-6b9be17fbe88 req-7f0932a9-1d80-47db-a901-0e63848d41be tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0518198 Dec 09 21:35:16.488536 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-7870cae4-c6cf-473b-811b-3c752e7c5aad service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5545356 Dec 09 21:35:16.566250 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-83fd98df-1bd3-4e71-b342-a9c57cf784c2 service neutron] 10.222.0.10 "GET /v2.0/networks/935b09ce-7410-4b66-82be-99978deb6717?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5976365 Dec 09 21:35:16.571483 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-7a173715-4f65-4b3e-8116-dbe01ec9583b service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.197&port_id=1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f HTTP/1.1" status: 200 len: 217 time: 0.0543985 Dec 09 21:35:16.684474 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f8e5b9a9-18d7-4008-b878-113507c5153e req-77f319a0-e32d-4ab3-96da-1cfd9e7488d9 service neutron] 10.222.0.10 "GET /v2.0/networks/935b09ce-7410-4b66-82be-99978deb6717?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1026819 Dec 09 21:35:16.687189 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2541463f-bc4c-4a1b-9e63-344ea2660e8a tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:16.814745 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-fb733893-5f03-41f0-8fb8-0c7137e7397a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:16.816241 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-fb733893-5f03-41f0-8fb8-0c7137e7397a service neutron] 10.222.0.10 "GET /v2.0/subnets?id=871c2dc1-486e-4fcf-a882-5a1394082fc5 HTTP/1.1" status: 200 len: 797 time: 0.2369833 Dec 09 21:35:16.845198 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2541463f-bc4c-4a1b-9e63-344ea2660e8a tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Pushing event updated for resources: {'Subnet': ['ID=53db963e-6c4f-4819-b56b-49f6b3f8d870,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:16.887423 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d26a32dc-a493-420a-8e97-c200ac62c21b req-3d2b39f2-e19f-44ba-b537-34c7b6914039 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:16.888987 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d26a32dc-a493-420a-8e97-c200ac62c21b req-3d2b39f2-e19f-44ba-b537-34c7b6914039 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=aacb3291db4d4252a9225e8fe617f667&device_id=0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7 HTTP/1.1" status: 200 len: 1095 time: 0.1360922 Dec 09 21:35:16.896096 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2541463f-bc4c-4a1b-9e63-344ea2660e8a tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Checking segment: {'id': 'cf548278-150e-452f-8c72-997eedda8d62', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1e591eba-fb21-4ad9-9d15-aeb856903ce8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:35:16.896531 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2541463f-bc4c-4a1b-9e63-344ea2660e8a tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Network hostable DHCP agents. Network: 1e591eba-fb21-4ad9-9d15-aeb856903ce8, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:35:16.941451 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-4cd93484-cf06-4a5c-b53a-0c27ae610463 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:16.943028 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-4cd93484-cf06-4a5c-b53a-0c27ae610463 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1134775 Dec 09 21:35:17.016704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2541463f-bc4c-4a1b-9e63-344ea2660e8a tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Network 1e591eba-fb21-4ad9-9d15-aeb856903ce8 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:35:17.121742 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-2541463f-bc4c-4a1b-9e63-344ea2660e8a tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 1e591eba-fb21-4ad9-9d15-aeb856903ce8) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:17.134132 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2186ed11-e7a2-4da2-8dee-2a18bb4e84f5 None None] Network 1e591eba-fb21-4ad9-9d15-aeb856903ce8 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:35:17.139710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2541463f-bc4c-4a1b-9e63-344ea2660e8a tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:17.140608 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2541463f-bc4c-4a1b-9e63-344ea2660e8a tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:17.152730 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d26a32dc-a493-420a-8e97-c200ac62c21b req-cba1f91e-6078-4890-b794-88186511e9aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:17.154671 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d26a32dc-a493-420a-8e97-c200ac62c21b req-cba1f91e-6078-4890-b794-88186511e9aa service neutron] 10.222.0.10 "GET /v2.0/networks?id=935b09ce-7410-4b66-82be-99978deb6717 HTTP/1.1" status: 200 len: 912 time: 0.2410655 Dec 09 21:35:17.183855 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2541463f-bc4c-4a1b-9e63-344ea2660e8a tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.6918578 Dec 09 21:35:17.213144 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51206) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:17.220413 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-d88a8b52-bcf1-4bda-9b99-56d3cdd380e0 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Request body: {'router': {'name': 'tempest-FloatingIPNegativeTestJSON-router-929238415', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:17.227135 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d26a32dc-a493-420a-8e97-c200ac62c21b req-02cfdd6b-5367-4a9b-9769-3e197f1b8a71 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ad97d669-4d68-4099-b1bd-992fd4cfb91c HTTP/1.1" status: 200 len: 217 time: 0.0626574 Dec 09 21:35:17.230112 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-3f5779dc-0e81-4331-984c-05a807f20461 service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2699032 Dec 09 21:35:17.316573 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d88a8b52-bcf1-4bda-9b99-56d3cdd380e0 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:17.318038 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d88a8b52-bcf1-4bda-9b99-56d3cdd380e0 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:17.394937 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d26a32dc-a493-420a-8e97-c200ac62c21b req-6091eb11-7863-4b43-9653-e5d3c8b707bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:17.396781 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d26a32dc-a493-420a-8e97-c200ac62c21b req-6091eb11-7863-4b43-9653-e5d3c8b707bb service neutron] 10.222.0.10 "GET /v2.0/subnets?id=10ff3f47-d1f4-47a0-808e-f885899dfb29 HTTP/1.1" status: 200 len: 850 time: 0.1557019 Dec 09 21:35:17.415549 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d64c49a1-0ce7-4c21-beb8-3d534f42ab07 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-1e591eba-fb21-4ad9-9d15-aeb856903ce8', 'network_id': '1e591eba-fb21-4ad9-9d15-aeb856903ce8', 'project_id': 'ecc44ce822d64b69a363fb65aee7aba0', 'fixed_ips': [{'subnet_id': '53db963e-6c4f-4819-b56b-49f6b3f8d870'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:35:17.416723 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d64c49a1-0ce7-4c21-beb8-3d534f42ab07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:17.564324 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d88a8b52-bcf1-4bda-9b99-56d3cdd380e0 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:17.572847 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd447c1-32bc-47d4-b991-4f93721dbff1 req-c9ca85e8-6a92-4693-89ab-964bac0ac6cc tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:17.585181 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ecd447c1-32bc-47d4-b991-4f93721dbff1 req-c9ca85e8-6a92-4693-89ab-964bac0ac6cc tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7 HTTP/1.1" status: 200 len: 943 time: 0.6355698 Dec 09 21:35:17.589216 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-5f3d865a-cbaa-4219-b6bf-f286ab3dc052 service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3468699 Dec 09 21:35:17.590408 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d88a8b52-bcf1-4bda-9b99-56d3cdd380e0 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:17.616662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af402aa8-5632-444e-aa43-8cdd895c0d00 req-dd817645-7308-466c-9caf-65b29dc89bd0 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:17.619391 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 851ff09f-496e-47bd-85bb-2e21622a44e9 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:35:17.626106 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af402aa8-5632-444e-aa43-8cdd895c0d00 req-dd817645-7308-466c-9caf-65b29dc89bd0 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 943 time: 0.1490266 Dec 09 21:35:17.679486 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d26a32dc-a493-420a-8e97-c200ac62c21b req-7ec9fc48-6aed-4423-a28d-68fe7c3a7c34 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:17.688400 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d26a32dc-a493-420a-8e97-c200ac62c21b req-7ec9fc48-6aed-4423-a28d-68fe7c3a7c34 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=935b09ce-7410-4b66-82be-99978deb6717&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2799556 Dec 09 21:35:17.689758 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-a27e813e-48d8-4730-af89-c520f48f1460 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.40&port_id=38f97951-e872-4c24-947f-934429895ad3 HTTP/1.1" status: 200 len: 217 time: 0.0923846 Dec 09 21:35:17.691803 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af402aa8-5632-444e-aa43-8cdd895c0d00 req-ed86c41a-c7b6-4e7c-9a54-611b65b9f288 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0646000 Dec 09 21:35:17.692914 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d88a8b52-bcf1-4bda-9b99-56d3cdd380e0 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:17.694019 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d88a8b52-bcf1-4bda-9b99-56d3cdd380e0 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 714 time: 0.4793308 Dec 09 21:35:17.697432 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51210) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:17.723503 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-d64c49a1-0ce7-4c21-beb8-3d534f42ab07 None None] Allocated IP 172.20.0.2 (1e591eba-fb21-4ad9-9d15-aeb856903ce8/53db963e-6c4f-4819-b56b-49f6b3f8d870/e26c5721-6e4d-487b-bf70-5bb7727d23ff) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:35:17.774512 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ecd447c1-32bc-47d4-b991-4f93721dbff1 req-df95fac1-960f-4944-8e49-fb78a7f7b212 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=19432415-a2e0-4a11-9022-46c83da8ae04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1881819 Dec 09 21:35:17.815594 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:17.873814 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '91b064ae-1ca1-44d4-a549-a25cccd0c81b', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '851ff09f-496e-47bd-85bb-2e21622a44e9'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:35:17.876368 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-597f0570-f71a-4aa6-8123-112ef24ab789" -d '{"events": [{"server_uuid": "91b064ae-1ca1-44d4-a549-a25cccd0c81b", "name": "network-vif-unplugged", "status": "completed", "tag": "851ff09f-496e-47bd-85bb-2e21622a44e9"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:35:17.928732 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d26a32dc-a493-420a-8e97-c200ac62c21b req-8bde6a87-8a2c-42e7-bc6b-dc02ed18d69a service neutron] 10.222.0.10 "GET /v2.0/networks/935b09ce-7410-4b66-82be-99978deb6717?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2178338 Dec 09 21:35:17.943916 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 851ff09f-496e-47bd-85bb-2e21622a44e9, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=851ff09f-496e-47bd-85bb-2e21622a44e9,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:35:17.994775 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:17.996580 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1e54159e-3c83-49a1-a5b5-3e2b29336c43 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:35:18.039581 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Thu, 09 Dec 2021 21:35:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b3db58dd-4bd4-44c3-89f4-4e3c67f29ce6 x-openstack-request-id: req-b3db58dd-4bd4-44c3-89f4-4e3c67f29ce6 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:35:18.039857 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "91b064ae-1ca1-44d4-a549-a25cccd0c81b", "name": "network-vif-unplugged", "status": "failed", "tag": "851ff09f-496e-47bd-85bb-2e21622a44e9", "code": 422}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:35:18.040221 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-b3db58dd-4bd4-44c3-89f4-4e3c67f29ce6 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:35:18.040868 n-d-713301-27 neutron-server[103439]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '91b064ae-1ca1-44d4-a549-a25cccd0c81b', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '851ff09f-496e-47bd-85bb-2e21622a44e9', 'code': 422} returned with failed status Dec 09 21:35:18.117722 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=851ff09f-496e-47bd-85bb-2e21622a44e9,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:18.124305 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-28342f73-21d5-424c-9292-2fbe80431b50 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:18.125889 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-28342f73-21d5-424c-9292-2fbe80431b50 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=871c2dc1-486e-4fcf-a882-5a1394082fc5 HTTP/1.1" status: 200 len: 797 time: 0.4172440 Dec 09 21:35:18.267848 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d64c49a1-0ce7-4c21-beb8-3d534f42ab07 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:18.278281 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d64c49a1-0ce7-4c21-beb8-3d534f42ab07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:18.300211 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d26a32dc-a493-420a-8e97-c200ac62c21b req-5896c19a-fd49-414b-9ba2-1826fef47659 service neutron] 10.222.0.10 "GET /v2.0/networks/935b09ce-7410-4b66-82be-99978deb6717?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3536170 Dec 09 21:35:18.319925 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d64c49a1-0ce7-4c21-beb8-3d534f42ab07 None None] Network 1e591eba-fb21-4ad9-9d15-aeb856903ce8 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:35:18.332885 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-0aeea9b4-69cd-4092-9b89-0931480a4c36 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:18.334834 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-0aeea9b4-69cd-4092-9b89-0931480a4c36 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1618595 Dec 09 21:35:18.345521 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-d64c49a1-0ce7-4c21-beb8-3d534f42ab07 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:18.349669 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d64c49a1-0ce7-4c21-beb8-3d534f42ab07 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:35:18.353830 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d64c49a1-0ce7-4c21-beb8-3d534f42ab07 None None] Pushing event updated for resources: {'Port': ['ID=e26c5721-6e4d-487b-bf70-5bb7727d23ff,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:18.463081 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-d64c49a1-0ce7-4c21-beb8-3d534f42ab07 None None] Attempting to bind port e26c5721-6e4d-487b-bf70-5bb7727d23ff on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:35:18.463081 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-d64c49a1-0ce7-4c21-beb8-3d534f42ab07 None None] Attempting to bind port e26c5721-6e4d-487b-bf70-5bb7727d23ff by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'cf548278-150e-452f-8c72-997eedda8d62', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1e591eba-fb21-4ad9-9d15-aeb856903ce8'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:35:18.463081 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d64c49a1-0ce7-4c21-beb8-3d534f42ab07 None None] Attempting to bind port e26c5721-6e4d-487b-bf70-5bb7727d23ff on network 1e591eba-fb21-4ad9-9d15-aeb856903ce8 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:35:18.484900 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d64c49a1-0ce7-4c21-beb8-3d534f42ab07 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 35, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:35:18.488736 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d64c49a1-0ce7-4c21-beb8-3d534f42ab07 None None] Checking segment: {'id': 'cf548278-150e-452f-8c72-997eedda8d62', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1e591eba-fb21-4ad9-9d15-aeb856903ce8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:35:18.488736 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d64c49a1-0ce7-4c21-beb8-3d534f42ab07 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:18.489111 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d64c49a1-0ce7-4c21-beb8-3d534f42ab07 None None] Bound using segment: {'id': 'cf548278-150e-452f-8c72-997eedda8d62', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1e591eba-fb21-4ad9-9d15-aeb856903ce8'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:35:18.495798 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-d64c49a1-0ce7-4c21-beb8-3d534f42ab07 None None] Bound port: e26c5721-6e4d-487b-bf70-5bb7727d23ff, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cf548278-150e-452f-8c72-997eedda8d62', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '1e591eba-fb21-4ad9-9d15-aeb856903ce8'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:35:18.496590 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d64c49a1-0ce7-4c21-beb8-3d534f42ab07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:18.498113 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-713a95d8-ebc5-47a4-954c-f2835dd24527 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:18.515766 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-db63d7be-a531-4cfd-9b47-95614610072d service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1311102 Dec 09 21:35:18.585547 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-d64c49a1-0ce7-4c21-beb8-3d534f42ab07 None None] For port e26c5721-6e4d-487b-bf70-5bb7727d23ff, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:35:18.599634 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-d64c49a1-0ce7-4c21-beb8-3d534f42ab07 None None] For port e26c5721-6e4d-487b-bf70-5bb7727d23ff, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e26c5721-6e4d-487b-bf70-5bb7727d23ff,segment=NetworkSegment(cf548278-150e-452f-8c72-997eedda8d62),segment_id=cf548278-150e-452f-8c72-997eedda8d62)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:35:18.610171 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d64c49a1-0ce7-4c21-beb8-3d534f42ab07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:18.701670 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d64c49a1-0ce7-4c21-beb8-3d534f42ab07 None None] Pushing event updated for resources: {'Port': ['ID=e26c5721-6e4d-487b-bf70-5bb7727d23ff,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:18.798999 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25dd5461-adba-4a98-b521-84f774adcfc5 req-324bc826-bf58-45e1-b065-0e055708f5b6 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:18.812282 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25dd5461-adba-4a98-b521-84f774adcfc5 req-324bc826-bf58-45e1-b065-0e055708f5b6 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 943 time: 0.1151662 Dec 09 21:35:18.828234 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-f633ecc5-279c-4566-b583-ef4ca988772c service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3042083 Dec 09 21:35:18.955987 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-37293b55-c07c-4f50-b5eb-e8d743b06c03 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.103&port_id=57519c10-1d02-4ce7-b4be-b37a7bd58b09 HTTP/1.1" status: 200 len: 217 time: 0.1206524 Dec 09 21:35:18.962686 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25dd5461-adba-4a98-b521-84f774adcfc5 req-d06d2bb5-b2b1-463e-9716-1453871d1e59 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1453593 Dec 09 21:35:18.984151 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d34ff356-559c-4f0f-b076-fe55d313adbe req-bdfdd258-d8b4-400f-867b-4fe982adf5b6 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:18.999015 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d34ff356-559c-4f0f-b076-fe55d313adbe req-bdfdd258-d8b4-400f-867b-4fe982adf5b6 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 943 time: 0.1333876 Dec 09 21:35:19.139613 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d34ff356-559c-4f0f-b076-fe55d313adbe req-5229d04e-1147-47b2-b72a-8b2bdd9c29ae tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1395061 Dec 09 21:35:19.183077 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-713a95d8-ebc5-47a4-954c-f2835dd24527 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Allocated IP 172.20.0.1 (1e591eba-fb21-4ad9-9d15-aeb856903ce8/53db963e-6c4f-4819-b56b-49f6b3f8d870/e3ca0dac-1a39-43eb-b703-132e0a2ff55b) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:35:19.217230 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19de00eb-ca50-4bdb-8f9e-70d5969cd4c8 req-1a9baca8-b751-4c13-ac19-688538c699b8 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:19.223762 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19de00eb-ca50-4bdb-8f9e-70d5969cd4c8 req-1a9baca8-b751-4c13-ac19-688538c699b8 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7 HTTP/1.1" status: 200 len: 943 time: 0.0694473 Dec 09 21:35:19.225665 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device ad97d669-4d68-4099-b1bd-992fd4cfb91c details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:35:19.320221 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19de00eb-ca50-4bdb-8f9e-70d5969cd4c8 req-3d7d1daf-617a-4136-a126-5ab8227d9121 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=19432415-a2e0-4a11-9022-46c83da8ae04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0900445 Dec 09 21:35:19.343819 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-cf2ef7b3-bec2-4e86-aa38-434fe2010133 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:19.345498 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-cf2ef7b3-bec2-4e86-aa38-434fe2010133 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=871c2dc1-486e-4fcf-a882-5a1394082fc5 HTTP/1.1" status: 200 len: 797 time: 0.3820906 Dec 09 21:35:19.470767 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port ad97d669-4d68-4099-b1bd-992fd4cfb91c, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=ad97d669-4d68-4099-b1bd-992fd4cfb91c,segment=NetworkSegment(d3bafd14-6a72-4dc5-8e4d-11da22a389ed),segment_id=d3bafd14-6a72-4dc5-8e4d-11da22a389ed)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:35:19.510893 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'ad97d669-4d68-4099-b1bd-992fd4cfb91c', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'port_id': 'ad97d669-4d68-4099-b1bd-992fd4cfb91c', 'mac_address': 'fa:16:3e:6b:cd:41', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:35:19.536096 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-fd9a54e5-bbb4-4563-a9df-79a332d42a71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:19.537694 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-fd9a54e5-bbb4-4563-a9df-79a332d42a71 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1246104 Dec 09 21:35:19.569460 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:19.579281 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-713a95d8-ebc5-47a4-954c-f2835dd24527 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:19.600887 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ad97d669-4d68-4099-b1bd-992fd4cfb91c {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:35:19.649437 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port ad97d669-4d68-4099-b1bd-992fd4cfb91c, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=ad97d669-4d68-4099-b1bd-992fd4cfb91c,segment=NetworkSegment(d3bafd14-6a72-4dc5-8e4d-11da22a389ed),segment_id=d3bafd14-6a72-4dc5-8e4d-11da22a389ed)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:35:19.649437 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e26c5721-6e4d-487b-bf70-5bb7727d23ff up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:35:19.689238 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:19.722084 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-713a95d8-ebc5-47a4-954c-f2835dd24527 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:19.746624 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1d7a2ec2-a0c5-4f57-85e9-f907aa13fe17 req-7d2da2a3-4c22-4055-92e7-b842d4b2ab74 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.4803433 Dec 09 21:35:19.812593 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-1d7a2ec2-a0c5-4f57-85e9-f907aa13fe17 req-5fbb88cd-58b9-4745-96a4-0385ccbc8041 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:35:19.814341 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1d7a2ec2-a0c5-4f57-85e9-f907aa13fe17 req-5fbb88cd-58b9-4745-96a4-0385ccbc8041 service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0114021 Dec 09 21:35:19.850824 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=ad97d669-4d68-4099-b1bd-992fd4cfb91c,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:19.856539 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-713a95d8-ebc5-47a4-954c-f2835dd24527 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Network 1e591eba-fb21-4ad9-9d15-aeb856903ce8 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:35:19.863065 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-713a95d8-ebc5-47a4-954c-f2835dd24527 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:19.869696 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-713a95d8-ebc5-47a4-954c-f2835dd24527 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:35:19.889296 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port e26c5721-6e4d-487b-bf70-5bb7727d23ff triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:19.889906 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:19.944216 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-713a95d8-ebc5-47a4-954c-f2835dd24527 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Pushing event updated for resources: {'Port': ['ID=e3ca0dac-1a39-43eb-b703-132e0a2ff55b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:19.977555 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-eb2f24cb-2811-4d7a-b3cf-83c261e6226e service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3960419 Dec 09 21:35:20.042644 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:20.049694 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['ad97d669-4d68-4099-b1bd-992fd4cfb91c'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:35:20.209055 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-40450264-331b-4156-a1bc-3d3dd8d6039e service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2168281 Dec 09 21:35:20.213083 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87cbdb5e-a2d1-49ea-9ca3-dd5039f76cc9 req-7ec7dc5d-eaad-40a8-beb2-09d4d5419744 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:20.216788 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-713a95d8-ebc5-47a4-954c-f2835dd24527 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:20.239809 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-87cbdb5e-a2d1-49ea-9ca3-dd5039f76cc9 req-7ec7dc5d-eaad-40a8-beb2-09d4d5419744 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 943 time: 0.1465309 Dec 09 21:35:20.261047 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port e26c5721-6e4d-487b-bf70-5bb7727d23ff, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e26c5721-6e4d-487b-bf70-5bb7727d23ff,segment=NetworkSegment(cf548278-150e-452f-8c72-997eedda8d62),segment_id=cf548278-150e-452f-8c72-997eedda8d62)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:35:20.320885 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:20.410535 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-87cbdb5e-a2d1-49ea-9ca3-dd5039f76cc9 req-cb7ed50b-90cd-4ebb-9823-d659f2a37ac0 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1697652 Dec 09 21:35:20.485620 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-88225c8e-9411-46e2-8107-7d787d5a7a9e service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.100&port_id=f6c2c656-c5c9-4a38-baf6-3924df82937d HTTP/1.1" status: 200 len: 217 time: 0.1454670 Dec 09 21:35:20.489006 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eee264ec-1cd8-4708-bd6a-48de02f83cda req-fe441344-f67e-43cb-a761-84c3d47e7b0f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:20.502864 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eee264ec-1cd8-4708-bd6a-48de02f83cda req-fe441344-f67e-43cb-a761-84c3d47e7b0f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 943 time: 0.1755230 Dec 09 21:35:20.607140 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-9d8f48aa-06d8-4269-b167-462aca97f9ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:20.608710 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-9d8f48aa-06d8-4269-b167-462aca97f9ba service neutron] 10.222.0.10 "GET /v2.0/subnets?id=2b4dff83-a3e7-4d10-a901-43c21154e5da HTTP/1.1" status: 200 len: 797 time: 0.1131713 Dec 09 21:35:20.618538 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=e26c5721-6e4d-487b-bf70-5bb7727d23ff,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:20.622888 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eee264ec-1cd8-4708-bd6a-48de02f83cda req-3d3d6845-8afc-4c1e-b344-a1900aa1e232 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1191249 Dec 09 21:35:20.667840 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-166fe9a7-5100-4267-906c-b544624cc501 None None] Network 1e591eba-fb21-4ad9-9d15-aeb856903ce8 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:35:20.744834 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-713a95d8-ebc5-47a4-954c-f2835dd24527 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:20.781781 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-7f04d744-25b3-4a9e-a7a4-daae3089ff85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:20.784047 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-7f04d744-25b3-4a9e-a7a4-daae3089ff85 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=ae9d25d5-c9a2-4627-a465-8324b17541d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1650238 Dec 09 21:35:20.797951 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e86d67f-5108-4001-b809-28556055ff25 req-80191774-db9a-4f5f-94d7-a1f64301af46 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:20.799712 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e86d67f-5108-4001-b809-28556055ff25 req-80191774-db9a-4f5f-94d7-a1f64301af46 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7 HTTP/1.1" status: 200 len: 944 time: 0.0938933 Dec 09 21:35:20.842466 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ec02f1a1-a5fb-40af-9536-f49b665dc845 None None] Provisioning complete for port e26c5721-6e4d-487b-bf70-5bb7727d23ff triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:20.842728 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ec02f1a1-a5fb-40af-9536-f49b665dc845 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:20.892965 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e86d67f-5108-4001-b809-28556055ff25 req-18233cd7-170a-49f7-abe2-cf134948ac6f tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=19432415-a2e0-4a11-9022-46c83da8ae04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0809660 Dec 09 21:35:21.257646 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a71b33ef-b154-43cb-a5e2-f6f96ecdb7fb None None] Provisioning complete for port e26c5721-6e4d-487b-bf70-5bb7727d23ff triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:21.257999 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a71b33ef-b154-43cb-a5e2-f6f96ecdb7fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:21.371717 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a71b33ef-b154-43cb-a5e2-f6f96ecdb7fb None None] Provisioning complete for port e3ca0dac-1a39-43eb-b703-132e0a2ff55b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:21.371998 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a71b33ef-b154-43cb-a5e2-f6f96ecdb7fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:21.413749 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a71b33ef-b154-43cb-a5e2-f6f96ecdb7fb None None] Port e3ca0dac-1a39-43eb-b703-132e0a2ff55b cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:35:21.539108 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-cb85276f-4fcc-45d6-9127-f9304e526b4c service neutron] 10.222.0.10 "GET /v2.0/networks/ae9d25d5-c9a2-4627-a465-8324b17541d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6965630 Dec 09 21:35:21.544597 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-883502fd-1e70-49d8-adc7-c942d4ec865b None None] Provisioning complete for port e3ca0dac-1a39-43eb-b703-132e0a2ff55b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:21.547952 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-883502fd-1e70-49d8-adc7-c942d4ec865b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:21.635717 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0903e537-c8e5-427d-8a9a-7de99206306b req-a4e303fd-f627-4abe-b626-c1824b574c40 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:21.643782 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0903e537-c8e5-427d-8a9a-7de99206306b req-a4e303fd-f627-4abe-b626-c1824b574c40 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 943 time: 0.0762200 Dec 09 21:35:21.733311 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0903e537-c8e5-427d-8a9a-7de99206306b req-1584caca-d8a3-49bd-9425-0c9bac718d81 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0831666 Dec 09 21:35:21.757474 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-0f25b3fb-951c-4fbe-8bab-12c2dba0f564 service neutron] 10.222.0.10 "GET /v2.0/networks/ae9d25d5-c9a2-4627-a465-8324b17541d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2063744 Dec 09 21:35:21.804006 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e26c5721-6e4d-487b-bf70-5bb7727d23ff up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:35:21.830026 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-71354ecb-3d5f-4e9f-bd7f-bd81742977d2 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=2c568c8f-47ca-4f47-ab71-187026ca02db HTTP/1.1" status: 200 len: 217 time: 0.0558188 Dec 09 21:35:21.832957 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-713a95d8-ebc5-47a4-954c-f2835dd24527 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:21.861047 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-883502fd-1e70-49d8-adc7-c942d4ec865b None None] Port e3ca0dac-1a39-43eb-b703-132e0a2ff55b cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:35:21.878923 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port e26c5721-6e4d-487b-bf70-5bb7727d23ff triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:21.879217 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:21.935761 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-18145c60-a677-4417-b939-85f9d3ea033b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:21.937891 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-18145c60-a677-4417-b939-85f9d3ea033b service neutron] 10.222.0.10 "GET /v2.0/subnets?id=2b4dff83-a3e7-4d10-a901-43c21154e5da HTTP/1.1" status: 200 len: 797 time: 0.0987570 Dec 09 21:35:21.939468 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-713a95d8-ebc5-47a4-954c-f2835dd24527 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:21.973432 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d01cd71-a77e-4f26-b0b7-6cd5712bf8d7 req-21dfc3f2-6386-44ad-aa95-bb57d0974c65 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:21.987068 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1d01cd71-a77e-4f26-b0b7-6cd5712bf8d7 req-21dfc3f2-6386-44ad-aa95-bb57d0974c65 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 943 time: 0.1827545 Dec 09 21:35:22.077098 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-713a95d8-ebc5-47a4-954c-f2835dd24527 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Pushing event updated for resources: {'Port': ['ID=e3ca0dac-1a39-43eb-b703-132e0a2ff55b,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:22.093805 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1d01cd71-a77e-4f26-b0b7-6cd5712bf8d7 req-f1805688-1451-464b-bdf0-031591f14ec1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0985234 Dec 09 21:35:22.097501 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-faecfea3-4318-4ddc-806a-692dd0f93611 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:22.100039 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-faecfea3-4318-4ddc-806a-692dd0f93611 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=ae9d25d5-c9a2-4627-a465-8324b17541d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1280057 Dec 09 21:35:22.101282 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-713a95d8-ebc5-47a4-954c-f2835dd24527 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:22.165763 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5ad40ae-e93a-443a-b65b-d76aad8ffb57 req-c856b3f5-899a-424a-a1c8-f989f8bfc3cd tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:22.168645 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d5ad40ae-e93a-443a-b65b-d76aad8ffb57 req-c856b3f5-899a-424a-a1c8-f989f8bfc3cd tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7 HTTP/1.1" status: 200 len: 944 time: 0.0863390 Dec 09 21:35:22.256209 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d5ad40ae-e93a-443a-b65b-d76aad8ffb57 req-744426d5-715c-41c0-9c81-567ec53df8b0 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=19432415-a2e0-4a11-9022-46c83da8ae04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0802970 Dec 09 21:35:22.292663 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-6eaef14c-6350-475e-ab4e-7d0911072edb service neutron] 10.222.0.10 "GET /v2.0/networks/ae9d25d5-c9a2-4627-a465-8324b17541d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1817031 Dec 09 21:35:22.300291 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-713a95d8-ebc5-47a4-954c-f2835dd24527 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Network 1e591eba-fb21-4ad9-9d15-aeb856903ce8 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:35:22.309154 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-713a95d8-ebc5-47a4-954c-f2835dd24527 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:22.484010 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14cba603-742c-475a-84f2-942aae1d4ac4 req-3795467e-fd9d-4573-9116-da4856e35767 service neutron] 10.222.0.10 "GET /v2.0/networks/ae9d25d5-c9a2-4627-a465-8324b17541d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1825671 Dec 09 21:35:22.516426 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-713a95d8-ebc5-47a4-954c-f2835dd24527 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Router b3dc3842-95a1-437b-9d4a-20ff5c626723 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:35:22.590208 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7ed911f7-8547-4c4f-95c4-2e1326a5a7ec None None] Provisioning complete for port e3ca0dac-1a39-43eb-b703-132e0a2ff55b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:22.590493 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7ed911f7-8547-4c4f-95c4-2e1326a5a7ec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:22.629252 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-7ed911f7-8547-4c4f-95c4-2e1326a5a7ec None None] Port e3ca0dac-1a39-43eb-b703-132e0a2ff55b cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:35:22.648302 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-713a95d8-ebc5-47a4-954c-f2835dd24527 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:35:22.654349 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-713a95d8-ebc5-47a4-954c-f2835dd24527 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] 10.222.0.13 "PUT /v2.0/routers/b3dc3842-95a1-437b-9d4a-20ff5c626723/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.9547138 Dec 09 21:35:22.656692 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51276) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:22.660841 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9eb6e4e8-19c3-4f24-9997-d69b92cf12d2 None None] Sync routers for ids ['b3dc3842-95a1-437b-9d4a-20ff5c626723'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:35:22.661721 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-e30c689d-51d2-49bd-8291-9710df7d6f8e tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Request body: {'port': {'network_id': '1e591eba-fb21-4ad9-9d15-aeb856903ce8', 'name': 'tempest-FloatingIPNegativeTestJSON-1697360662'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:22.671824 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9eb6e4e8-19c3-4f24-9997-d69b92cf12d2 None None] Routers {'b3dc3842-95a1-437b-9d4a-20ff5c626723'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:35:22.672665 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-9eb6e4e8-19c3-4f24-9997-d69b92cf12d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:35:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['b3dc3842-95a1-437b-9d4a-20ff5c626723'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:22.712408 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-9eb6e4e8-19c3-4f24-9997-d69b92cf12d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:22.722174 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9eb6e4e8-19c3-4f24-9997-d69b92cf12d2 None None] Routers {'b3dc3842-95a1-437b-9d4a-20ff5c626723'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:35:22.723008 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-9eb6e4e8-19c3-4f24-9997-d69b92cf12d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:35:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['b3dc3842-95a1-437b-9d4a-20ff5c626723'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:22.766013 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-9eb6e4e8-19c3-4f24-9997-d69b92cf12d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:22.766715 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9eb6e4e8-19c3-4f24-9997-d69b92cf12d2 None None] The sync data for ids ['b3dc3842-95a1-437b-9d4a-20ff5c626723'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:35:22.809286 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e30c689d-51d2-49bd-8291-9710df7d6f8e tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Made reservation on behalf of ecc44ce822d64b69a363fb65aee7aba0 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:22.817376 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e30c689d-51d2-49bd-8291-9710df7d6f8e tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:22.873213 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-e30c689d-51d2-49bd-8291-9710df7d6f8e tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] device_id is not set on port 9c70717e-cc6e-419f-b872-6be6384995a0 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:35:22.959893 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-809500db-40ca-4f7f-b185-87131a465314 req-6d43cdc4-8d55-4d3e-b8df-63327dd42abf tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:22.974491 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-809500db-40ca-4f7f-b185-87131a465314 req-6d43cdc4-8d55-4d3e-b8df-63327dd42abf tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 943 time: 0.1531565 Dec 09 21:35:23.082286 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-809500db-40ca-4f7f-b185-87131a465314 req-155adf90-6165-4ef1-8e48-986b5fd7e0a1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1046674 Dec 09 21:35:23.099974 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-e30c689d-51d2-49bd-8291-9710df7d6f8e tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Allocated IP 172.20.0.12 (1e591eba-fb21-4ad9-9d15-aeb856903ce8/53db963e-6c4f-4819-b56b-49f6b3f8d870/9c70717e-cc6e-419f-b872-6be6384995a0) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:35:23.272413 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device ad97d669-4d68-4099-b1bd-992fd4cfb91c up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:35:23.339028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port ad97d669-4d68-4099-b1bd-992fd4cfb91c completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:35:23.348400 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port ad97d669-4d68-4099-b1bd-992fd4cfb91c triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:23.349367 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:23.421020 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5beb9bb2-ea31-4b5c-adbb-d794e8468bf0 req-10f60f59-f270-4720-9cf8-9a67523f6fea tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:23.422604 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5beb9bb2-ea31-4b5c-adbb-d794e8468bf0 req-10f60f59-f270-4720-9cf8-9a67523f6fea tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 943 time: 0.1547599 Dec 09 21:35:23.441788 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2276985-d571-48da-be30-51cbff4b3790 req-c0af2f94-2e22-44f6-9e47-add4b7a39310 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:23.443302 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2276985-d571-48da-be30-51cbff4b3790 req-c0af2f94-2e22-44f6-9e47-add4b7a39310 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1925299 Dec 09 21:35:23.455711 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:23.482853 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ad97d669-4d68-4099-b1bd-992fd4cfb91c'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:35:23.485370 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-955b5e70-bac0-46c7-b9f1-102557a19dcd" -d '{"events": [{"server_uuid": "0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7", "name": "network-vif-plugged", "status": "completed", "tag": "ad97d669-4d68-4099-b1bd-992fd4cfb91c"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:35:23.500039 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port ad97d669-4d68-4099-b1bd-992fd4cfb91c, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=ad97d669-4d68-4099-b1bd-992fd4cfb91c,segment=NetworkSegment(d3bafd14-6a72-4dc5-8e4d-11da22a389ed),segment_id=d3bafd14-6a72-4dc5-8e4d-11da22a389ed)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:35:23.503408 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e30c689d-51d2-49bd-8291-9710df7d6f8e tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:23.506628 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:23.549198 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5beb9bb2-ea31-4b5c-adbb-d794e8468bf0 req-865417e0-46e8-4184-bc84-e083e19f042c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1182370 Dec 09 21:35:23.574978 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=ad97d669-4d68-4099-b1bd-992fd4cfb91c,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:23.581042 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2276985-d571-48da-be30-51cbff4b3790 req-82d6d2b2-a373-4c14-86d9-88c9e47ec91d tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1281278 Dec 09 21:35:23.598912 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e30c689d-51d2-49bd-8291-9710df7d6f8e tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:23.639075 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:35:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ba17e225-48ed-408b-ad47-f3d2f93c187c x-openstack-request-id: req-ba17e225-48ed-408b-ad47-f3d2f93c187c {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:35:23.639657 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7", "name": "network-vif-plugged", "status": "completed", "tag": "ad97d669-4d68-4099-b1bd-992fd4cfb91c", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:35:23.640087 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-ba17e225-48ed-408b-ad47-f3d2f93c187c {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:35:23.640701 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ad97d669-4d68-4099-b1bd-992fd4cfb91c', 'code': 200} Dec 09 21:35:23.654054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e30c689d-51d2-49bd-8291-9710df7d6f8e tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Network 1e591eba-fb21-4ad9-9d15-aeb856903ce8 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:35:23.656020 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-e30c689d-51d2-49bd-8291-9710df7d6f8e tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:23.660147 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e30c689d-51d2-49bd-8291-9710df7d6f8e tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:35:23.768736 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e30c689d-51d2-49bd-8291-9710df7d6f8e tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Pushing event updated for resources: {'Port': ['ID=9c70717e-cc6e-419f-b872-6be6384995a0,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:23.803353 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cac12148-fc27-4755-879f-721fc152a6bd req-afa8c69f-4f4f-4fe3-bece-3daaab6c044a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:23.804977 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cac12148-fc27-4755-879f-721fc152a6bd req-afa8c69f-4f4f-4fe3-bece-3daaab6c044a service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7 HTTP/1.1" status: 200 len: 1097 time: 0.0722578 Dec 09 21:35:23.844422 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a62651c-bfd4-4f10-b536-cca6f2a87b83 req-f0e88d7d-a961-49d5-b1df-652a2476ec82 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:23.854127 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5a62651c-bfd4-4f10-b536-cca6f2a87b83 req-f0e88d7d-a961-49d5-b1df-652a2476ec82 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7 HTTP/1.1" status: 200 len: 945 time: 0.1696029 Dec 09 21:35:23.888828 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e30c689d-51d2-49bd-8291-9710df7d6f8e tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:23.889543 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e30c689d-51d2-49bd-8291-9710df7d6f8e tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:23.905145 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cac12148-fc27-4755-879f-721fc152a6bd req-1f556ae0-dd86-4c56-b070-d6631b887cbb service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=19432415-a2e0-4a11-9022-46c83da8ae04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0918567 Dec 09 21:35:23.961909 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5a62651c-bfd4-4f10-b536-cca6f2a87b83 req-edf32365-c12c-45a5-9f1a-148c5623a86b tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=19432415-a2e0-4a11-9022-46c83da8ae04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1018186 Dec 09 21:35:23.969826 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51300) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:23.974505 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ec99da50-d6b5-4e9b-9815-046d7071014d tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:23.982763 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e30c689d-51d2-49bd-8291-9710df7d6f8e tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.3244979 Dec 09 21:35:24.021095 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ec99da50-d6b5-4e9b-9815-046d7071014d tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks [] for floatingip, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:24.064579 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c19f9284-a04f-4e39-afd3-35abed745fdf None None] Provisioning complete for port 9c70717e-cc6e-419f-b872-6be6384995a0 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:24.065624 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c19f9284-a04f-4e39-afd3-35abed745fdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:24.131095 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-c19f9284-a04f-4e39-afd3-35abed745fdf None None] Port 9c70717e-cc6e-419f-b872-6be6384995a0 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:35:24.219985 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ec99da50-d6b5-4e9b-9815-046d7071014d tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:24.258467 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea511194-90da-477f-9218-008f7d60b8d6 req-a02b2f2e-42d7-4886-af8e-a7a0aad020ad tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:24.267326 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea511194-90da-477f-9218-008f7d60b8d6 req-a02b2f2e-42d7-4886-af8e-a7a0aad020ad tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 943 time: 0.1019604 Dec 09 21:35:24.316038 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea511194-90da-477f-9218-008f7d60b8d6 req-a5c18d41-92dc-4bcf-bc95-32c17ca946c1 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0476749 Dec 09 21:35:24.362336 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-ec99da50-d6b5-4e9b-9815-046d7071014d tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Allocated IP 172.25.3.29 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/33808ef5-b47b-4ca4-9055-971f75dd31ff) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:35:24.495878 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ec99da50-d6b5-4e9b-9815-046d7071014d tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:24.531405 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ec99da50-d6b5-4e9b-9815-046d7071014d tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:24.571252 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec99da50-d6b5-4e9b-9815-046d7071014d tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:35:24.574710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-ec99da50-d6b5-4e9b-9815-046d7071014d tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:24.580969 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec99da50-d6b5-4e9b-9815-046d7071014d tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:35:24.616262 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec99da50-d6b5-4e9b-9815-046d7071014d tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Pushing event updated for resources: {'Port': ['ID=33808ef5-b47b-4ca4-9055-971f75dd31ff,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:24.725990 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ec99da50-d6b5-4e9b-9815-046d7071014d tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:24.752500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aa09cff-6da6-49c7-81bc-963fc1efed8e req-b44f5d7b-c009-4e55-871a-13369a53c0ea tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:24.753923 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7aa09cff-6da6-49c7-81bc-963fc1efed8e req-b44f5d7b-c009-4e55-871a-13369a53c0ea tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 943 time: 0.1136725 Dec 09 21:35:24.760917 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ec99da50-d6b5-4e9b-9815-046d7071014d tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:24.766587 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ad43675-c334-4aac-b88f-98ad1f64f4d9 req-433b5f23-1071-454f-9439-7c2ea6ba06d1 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:24.768129 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ad43675-c334-4aac-b88f-98ad1f64f4d9 req-433b5f23-1071-454f-9439-7c2ea6ba06d1 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0742197 Dec 09 21:35:24.900781 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7aa09cff-6da6-49c7-81bc-963fc1efed8e req-20a6e26c-d46a-4f88-96b1-f3bf3d4234d5 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1214378 Dec 09 21:35:24.905443 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ad43675-c334-4aac-b88f-98ad1f64f4d9 req-9a11bc49-d664-46c0-a94c-ad998fb1ea69 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1299441 Dec 09 21:35:25.054056 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ec99da50-d6b5-4e9b-9815-046d7071014d tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:25.063063 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ec99da50-d6b5-4e9b-9815-046d7071014d tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:25.097298 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b83be1b2-afc4-4ff4-b958-b479296f838b req-fca6c561-214c-4666-9152-b0c419327afa tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:25.105364 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b83be1b2-afc4-4ff4-b958-b479296f838b req-fca6c561-214c-4666-9152-b0c419327afa tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7 HTTP/1.1" status: 200 len: 945 time: 0.0723796 Dec 09 21:35:25.168672 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec99da50-d6b5-4e9b-9815-046d7071014d tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Pushing event updated for resources: {'Port': ['ID=33808ef5-b47b-4ca4-9055-971f75dd31ff,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:25.190420 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b83be1b2-afc4-4ff4-b958-b479296f838b req-b3463132-0b9d-4552-9d2c-4e0c6b4f5796 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=19432415-a2e0-4a11-9022-46c83da8ae04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0840452 Dec 09 21:35:25.200233 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ec99da50-d6b5-4e9b-9815-046d7071014d tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:25.230485 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ec99da50-d6b5-4e9b-9815-046d7071014d tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:25.231872 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ec99da50-d6b5-4e9b-9815-046d7071014d tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.2610219 Dec 09 21:35:25.234814 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51314) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:25.239472 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-8a65ef1a-4e30-4b0f-90fe-1d420a86e026 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Request body: {'floatingip': {'port_id': '9c70717e-cc6e-419f-b872-6be6384995a0', 'fixed_ip_address': '172.20.0.12'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:25.288966 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a65ef1a-4e30-4b0f-90fe-1d420a86e026 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks [] for floatingip, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:25.412341 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-8a65ef1a-4e30-4b0f-90fe-1d420a86e026 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] update failed (client error): The resource could not be found. Dec 09 21:35:25.413422 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8a65ef1a-4e30-4b0f-90fe-1d420a86e026 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] 10.222.0.13 "PUT /v2.0/floatingips/860f958f-1d5f-4ee8-a470-f96875b3e2ec HTTP/1.1" status: 404 len: 507 time: 0.1775231 Dec 09 21:35:25.417122 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51320) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:25.478129 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-801fffd5-8954-47fe-a931-6edf648be41b req-a352c8a0-1f2d-400d-a4d6-a82228035d84 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:25.485064 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-801fffd5-8954-47fe-a931-6edf648be41b req-a352c8a0-1f2d-400d-a4d6-a82228035d84 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 943 time: 0.0695541 Dec 09 21:35:25.532853 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-801fffd5-8954-47fe-a931-6edf648be41b req-99b4dcbf-af83-4c56-b59e-0971889da59c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456984 Dec 09 21:35:25.577536 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-d81d6154-0457-4053-85c7-3c18ed8c0deb tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Deleting port 33808ef5-b47b-4ca4-9055-971f75dd31ff {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:35:25.577960 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d81d6154-0457-4053-85c7-3c18ed8c0deb tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:25.658390 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d81d6154-0457-4053-85c7-3c18ed8c0deb tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:25.658716 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d81d6154-0457-4053-85c7-3c18ed8c0deb tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:25.671278 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-d81d6154-0457-4053-85c7-3c18ed8c0deb tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Calling delete_port for 33808ef5-b47b-4ca4-9055-971f75dd31ff owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:35:25.811950 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d81d6154-0457-4053-85c7-3c18ed8c0deb tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:25.841448 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d81d6154-0457-4053-85c7-3c18ed8c0deb tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Pushing event deleted for resources: {'Port': ['ID=33808ef5-b47b-4ca4-9055-971f75dd31ff,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:25.909092 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d81d6154-0457-4053-85c7-3c18ed8c0deb tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:25.911757 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d81d6154-0457-4053-85c7-3c18ed8c0deb tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:25.913002 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d81d6154-0457-4053-85c7-3c18ed8c0deb tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] 10.222.0.13 "DELETE /v2.0/floatingips/860f958f-1d5f-4ee8-a470-f96875b3e2ec HTTP/1.1" status: 204 len: 168 time: 0.4949365 Dec 09 21:35:25.917054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51322) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:25.923107 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-f2ad3629-8e71-40f6-b5fe-a7fc1c3e2c0c tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Request body: {'floatingip': {'floating_network_id': '1e591eba-fb21-4ad9-9d15-aeb856903ce8', 'port_id': '9c70717e-cc6e-419f-b872-6be6384995a0', 'fixed_ip_address': '172.20.0.12'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:25.951606 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f2ad3629-8e71-40f6-b5fe-a7fc1c3e2c0c tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:26.137772 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d5ceed1-5d71-46a5-8431-fb144cec4d2e req-83d9a637-1b78-46bf-806a-c6988103db86 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:26.139903 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d5ceed1-5d71-46a5-8431-fb144cec4d2e req-83d9a637-1b78-46bf-806a-c6988103db86 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 943 time: 0.1536551 Dec 09 21:35:26.164773 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12dcd8be-7db4-4a85-9c79-400c045b940a req-a6acc14b-72c1-49ba-afca-365947ae1a0c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:26.166634 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-12dcd8be-7db4-4a85-9c79-400c045b940a req-a6acc14b-72c1-49ba-afca-365947ae1a0c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1087215 Dec 09 21:35:26.268805 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d5ceed1-5d71-46a5-8431-fb144cec4d2e req-42b2712b-c2cb-4a57-8cec-a09580912301 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1209614 Dec 09 21:35:26.274201 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-12dcd8be-7db4-4a85-9c79-400c045b940a req-06532b4b-a62b-4202-a85b-23bde1332582 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0947676 Dec 09 21:35:26.276593 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-f2ad3629-8e71-40f6-b5fe-a7fc1c3e2c0c tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:35:26.281327 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f2ad3629-8e71-40f6-b5fe-a7fc1c3e2c0c tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 400 len: 373 time: 0.3595986 Dec 09 21:35:26.282021 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51334) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:26.286051 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-2b9b5684-e43c-4664-ba30-69868abc2a2c tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': '9c70717e-cc6e-419f-b872-6be6384995a0', 'fixed_ip_address': '172.20.0.12'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:26.349062 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2b9b5684-e43c-4664-ba30-69868abc2a2c tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:26.452624 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cef8bd76-6e86-428b-9d19-a433b1d6b936 req-4e316f61-d4a5-4837-a343-672f15337442 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:26.462658 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cef8bd76-6e86-428b-9d19-a433b1d6b936 req-4e316f61-d4a5-4837-a343-672f15337442 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7 HTTP/1.1" status: 200 len: 945 time: 0.0909240 Dec 09 21:35:26.549005 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cef8bd76-6e86-428b-9d19-a433b1d6b936 req-a46cc9a0-451a-4026-8070-c82afde130b3 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=19432415-a2e0-4a11-9022-46c83da8ae04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0651789 Dec 09 21:35:26.562618 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2b9b5684-e43c-4664-ba30-69868abc2a2c tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:26.763877 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-2b9b5684-e43c-4664-ba30-69868abc2a2c tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Allocated IP 172.25.3.106 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/8423c43f-6855-460d-a17e-fbca8e368423) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:35:26.781255 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0484c7c4-7efd-4127-bb22-fe5dcd8a37ad req-3ae1bf7d-82ec-4754-baac-4808a19f81ed tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:26.782774 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0484c7c4-7efd-4127-bb22-fe5dcd8a37ad req-3ae1bf7d-82ec-4754-baac-4808a19f81ed tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7 HTTP/1.1" status: 200 len: 945 time: 0.1478560 Dec 09 21:35:26.796205 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51342) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:26.796808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecad99e2-9190-4b62-9ddf-642f6cef1b0d req-bad2df8b-7a72-479f-b719-81cd4e88b010 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:26.797369 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-8e9eeb08-eb4a-4b84-a2f2-2368ca6adcfd tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Request body: {'floatingip': {'port_id': 'ad97d669-4d68-4099-b1bd-992fd4cfb91c'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:26.798104 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ecad99e2-9190-4b62-9ddf-642f6cef1b0d req-bad2df8b-7a72-479f-b719-81cd4e88b010 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 943 time: 0.1488369 Dec 09 21:35:26.842869 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e9eeb08-eb4a-4b84-a2f2-2368ca6adcfd tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for floatingip, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:26.907628 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ecad99e2-9190-4b62-9ddf-642f6cef1b0d req-25ae108c-deb7-4789-bae0-8e0ca75db731 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1025419 Dec 09 21:35:26.931516 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2b9b5684-e43c-4664-ba30-69868abc2a2c tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:26.967537 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2b9b5684-e43c-4664-ba30-69868abc2a2c tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:27.007786 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b9b5684-e43c-4664-ba30-69868abc2a2c tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:35:27.012246 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-2b9b5684-e43c-4664-ba30-69868abc2a2c tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:27.018021 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b9b5684-e43c-4664-ba30-69868abc2a2c tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:35:27.025880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b9b5684-e43c-4664-ba30-69868abc2a2c tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Pushing event updated for resources: {'Port': ['ID=8423c43f-6855-460d-a17e-fbca8e368423,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:27.188909 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-2b9b5684-e43c-4664-ba30-69868abc2a2c tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Deleting port 8423c43f-6855-460d-a17e-fbca8e368423 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:35:27.189258 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2b9b5684-e43c-4664-ba30-69868abc2a2c tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:27.228985 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:27.246332 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:27.270092 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2b9b5684-e43c-4664-ba30-69868abc2a2c tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:27.270337 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2b9b5684-e43c-4664-ba30-69868abc2a2c tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:27.284060 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-2b9b5684-e43c-4664-ba30-69868abc2a2c tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Calling delete_port for 8423c43f-6855-460d-a17e-fbca8e368423 owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:35:27.304642 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e9eeb08-eb4a-4b84-a2f2-2368ca6adcfd tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:27.312484 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e9eeb08-eb4a-4b84-a2f2-2368ca6adcfd tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:27.447030 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-8e9eeb08-eb4a-4b84-a2f2-2368ca6adcfd tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Floating IP 2c536504-55a9-47a6-b355-f598885671a2 associated. External IP: 172.25.3.18, port: ad97d669-4d68-4099-b1bd-992fd4cfb91c. Dec 09 21:35:27.533861 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f401e4f-9a7a-455f-aaf6-7bc8a974dca8 req-51c15cd3-aefc-44da-9773-a2773e85ac88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:27.535242 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f401e4f-9a7a-455f-aaf6-7bc8a974dca8 req-51c15cd3-aefc-44da-9773-a2773e85ac88 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 1097 time: 0.1142125 Dec 09 21:35:27.542880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c7f482a-2e95-44c3-8069-8730b8b6aced req-6d0b8a98-149f-426e-a191-f77bb7bc2a20 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:27.544407 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4c7f482a-2e95-44c3-8069-8730b8b6aced req-6d0b8a98-149f-426e-a191-f77bb7bc2a20 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1770408 Dec 09 21:35:27.561351 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f8d32cb-6aae-4dc2-bf18-3e59911d3d31 req-124c9635-1958-4085-afdd-e50f58523555 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:27.562835 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f8d32cb-6aae-4dc2-bf18-3e59911d3d31 req-124c9635-1958-4085-afdd-e50f58523555 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 943 time: 0.1540318 Dec 09 21:35:27.670304 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8e9eeb08-eb4a-4b84-a2f2-2368ca6adcfd tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Router a0406620-d595-409c-958d-7a486a49577c has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:35:27.673104 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2b9b5684-e43c-4664-ba30-69868abc2a2c tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:27.737887 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b9b5684-e43c-4664-ba30-69868abc2a2c tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Pushing event deleted for resources: {'Port': ['ID=8423c43f-6855-460d-a17e-fbca8e368423,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:27.752300 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f8d32cb-6aae-4dc2-bf18-3e59911d3d31 req-69c6bc8c-10ad-4b8c-ae61-69d9cd5ed903 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1651309 Dec 09 21:35:27.755342 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4c7f482a-2e95-44c3-8069-8730b8b6aced req-cab842d6-18f5-4cdd-9c86-37e9ea85bc31 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1874502 Dec 09 21:35:27.800103 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8e9eeb08-eb4a-4b84-a2f2-2368ca6adcfd tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:35:27.809363 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f401e4f-9a7a-455f-aaf6-7bc8a974dca8 req-38053281-1e19-463b-8b34-60c8efccf992 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:27.811318 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f401e4f-9a7a-455f-aaf6-7bc8a974dca8 req-38053281-1e19-463b-8b34-60c8efccf992 service neutron] 10.222.0.31 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 913 time: 0.2655578 Dec 09 21:35:27.814674 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a927b1c-da83-48eb-8af5-d20994586dbf None None] Sync routers for ids ['a0406620-d595-409c-958d-7a486a49577c'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:35:27.815456 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e9eeb08-eb4a-4b84-a2f2-2368ca6adcfd tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:27.839900 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a927b1c-da83-48eb-8af5-d20994586dbf None None] Routers {'a0406620-d595-409c-958d-7a486a49577c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:35:27.843314 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-8a927b1c-da83-48eb-8af5-d20994586dbf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:35:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a0406620-d595-409c-958d-7a486a49577c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:27.856544 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8e9eeb08-eb4a-4b84-a2f2-2368ca6adcfd tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "PUT /v2.0/floatingips/2c536504-55a9-47a6-b355-f598885671a2 HTTP/1.1" status: 200 len: 990 time: 1.0632882 Dec 09 21:35:27.857495 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7', 'tag': 'ad97d669-4d68-4099-b1bd-992fd4cfb91c'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:35:27.862575 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2bfe2a42-b6ae-45e3-8f0f-46283535900f" -d '{"events": [{"name": "network-changed", "server_uuid": "0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7", "tag": "ad97d669-4d68-4099-b1bd-992fd4cfb91c"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:35:27.936500 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f401e4f-9a7a-455f-aaf6-7bc8a974dca8 req-5c0a56fb-5607-4422-a6e7-5f9091a4f8e2 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=90f16e74-f2e6-416e-a079-f205615a0d8e HTTP/1.1" status: 200 len: 1000 time: 0.1153257 Dec 09 21:35:27.946674 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-2b9b5684-e43c-4664-ba30-69868abc2a2c tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] create failed (client error): The resource could not be found. Dec 09 21:35:27.947831 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2b9b5684-e43c-4664-ba30-69868abc2a2c tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 404 len: 507 time: 1.6653194 Dec 09 21:35:27.951275 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51358) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:27.979253 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:35:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9ed4aa7d-b953-4c9e-b51a-d2ee47b58819 x-openstack-request-id: req-9ed4aa7d-b953-4c9e-b51a-d2ee47b58819 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:35:27.979734 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7", "tag": "ad97d669-4d68-4099-b1bd-992fd4cfb91c", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:35:27.979858 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-9ed4aa7d-b953-4c9e-b51a-d2ee47b58819 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:35:27.980238 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7', 'tag': 'ad97d669-4d68-4099-b1bd-992fd4cfb91c', 'status': 'completed', 'code': 200} Dec 09 21:35:28.020415 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-8a927b1c-da83-48eb-8af5-d20994586dbf None None] Set router a0406620-d595-409c-958d-7a486a49577c gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:35:28.056805 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d7a2ec2-a0c5-4f57-85e9-f907aa13fe17 req-0b48c72d-d6a4-4b4a-b645-dcb59567e21a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:28.059019 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1d7a2ec2-a0c5-4f57-85e9-f907aa13fe17 req-0b48c72d-d6a4-4b4a-b645-dcb59567e21a service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b&tenant_id=29f2c1d9be9348b0888bc61ed37ed957 HTTP/1.1" status: 200 len: 1095 time: 0.1416721 Dec 09 21:35:28.062157 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bfe2a42-b6ae-45e3-8f0f-46283535900f req-850908d6-29dc-4774-8940-7818af5a0e17 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:28.063689 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2bfe2a42-b6ae-45e3-8f0f-46283535900f req-850908d6-29dc-4774-8940-7818af5a0e17 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=aacb3291db4d4252a9225e8fe617f667&device_id=0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7 HTTP/1.1" status: 200 len: 1097 time: 0.0826337 Dec 09 21:35:28.209414 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d7a2ec2-a0c5-4f57-85e9-f907aa13fe17 req-6aa62dbd-8a6f-45f6-8fa9-5073316f7840 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:28.211149 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1d7a2ec2-a0c5-4f57-85e9-f907aa13fe17 req-6aa62dbd-8a6f-45f6-8fa9-5073316f7840 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=29f2c1d9be9348b0888bc61ed37ed957&device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 1095 time: 0.1165633 Dec 09 21:35:28.215369 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bfe2a42-b6ae-45e3-8f0f-46283535900f req-a87438b1-452f-4f47-90bb-98f206b0ba0b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:28.218263 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2bfe2a42-b6ae-45e3-8f0f-46283535900f req-a87438b1-452f-4f47-90bb-98f206b0ba0b service neutron] 10.222.0.10 "GET /v2.0/networks?id=935b09ce-7410-4b66-82be-99978deb6717 HTTP/1.1" status: 200 len: 912 time: 0.1465302 Dec 09 21:35:28.278988 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-8a927b1c-da83-48eb-8af5-d20994586dbf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0406620-d595-409c-958d-7a486a49577c', 'name': 'tempest-AttachVolumeTestJSON-1079676770-router', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210'}], 'enable_snat': True}, 'gw_port_id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:32Z', 'updated_at': '2021-12-09T21:30:38Z', 'revision_number': 4, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'gw_port': {'id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:0e:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1399, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:33Z', 'updated_at': '2021-12-09T21:30:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '2c536504-55a9-47a6-b355-f598885671a2', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'floating_ip_address': '172.25.3.18', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'a0406620-d595-409c-958d-7a486a49577c', 'port_id': 'ad97d669-4d68-4099-b1bd-992fd4cfb91c', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 1850, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'mac_address': 'fa:16:3e:6b:cd:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:35:09Z', 'updated_at': '2021-12-09T21:35:27Z', 'revision_number': 1, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbff506a-7b73-4238-9fda-dd193910d0ce', 'name': '', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'mac_address': 'fa:16:3e:94:28:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:37Z', 'updated_at': '2021-12-09T21:30:42Z', 'revision_number': 5, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'subnets': [{'id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:28.308733 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a927b1c-da83-48eb-8af5-d20994586dbf None None] Checking router: a0406620-d595-409c-958d-7a486a49577c for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:35:28.317979 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a927b1c-da83-48eb-8af5-d20994586dbf None None] Routers {'a0406620-d595-409c-958d-7a486a49577c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:35:28.318614 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-8a927b1c-da83-48eb-8af5-d20994586dbf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:35:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a0406620-d595-409c-958d-7a486a49577c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:28.390010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f401e4f-9a7a-455f-aaf6-7bc8a974dca8 req-d9d88004-272e-44e8-9b16-e90dda9647ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:28.391961 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f401e4f-9a7a-455f-aaf6-7bc8a974dca8 req-d9d88004-272e-44e8-9b16-e90dda9647ea service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 200 len: 851 time: 0.4396865 Dec 09 21:35:28.411317 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43d7fba7-5d65-4f3e-b62b-455ba92e8e65 req-a125f7ed-b7d0-40fb-bc20-1d2973dae92a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:28.413191 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43d7fba7-5d65-4f3e-b62b-455ba92e8e65 req-a125f7ed-b7d0-40fb-bc20-1d2973dae92a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 943 time: 0.1542668 Dec 09 21:35:28.444296 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-8a927b1c-da83-48eb-8af5-d20994586dbf None None] Set router a0406620-d595-409c-958d-7a486a49577c gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:35:28.508827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-f0bf8687-4c0d-4d2e-8185-007a24f336d0 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Deleting port 9c70717e-cc6e-419f-b872-6be6384995a0 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:35:28.509245 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0bf8687-4c0d-4d2e-8185-007a24f336d0 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:28.516543 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43d7fba7-5d65-4f3e-b62b-455ba92e8e65 req-f64d77d8-042f-4f2d-b579-4a5d15c15fc4 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0906625 Dec 09 21:35:28.520141 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f401e4f-9a7a-455f-aaf6-7bc8a974dca8 req-3031c4f3-6575-48b7-85ce-6c5bed3695dd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:28.521993 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f401e4f-9a7a-455f-aaf6-7bc8a974dca8 req-3031c4f3-6575-48b7-85ce-6c5bed3695dd service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1075618 Dec 09 21:35:28.693835 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0bf8687-4c0d-4d2e-8185-007a24f336d0 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:28.722072 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-f0bf8687-4c0d-4d2e-8185-007a24f336d0 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Calling delete_port for 9c70717e-cc6e-419f-b872-6be6384995a0 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:35:28.726457 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f401e4f-9a7a-455f-aaf6-7bc8a974dca8 req-166b5298-2348-4b85-89db-18f72276285f service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1853368 Dec 09 21:35:28.727872 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2bfe2a42-b6ae-45e3-8f0f-46283535900f req-2f7fbd4c-9768-483c-b069-a01f8c322403 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ad97d669-4d68-4099-b1bd-992fd4cfb91c HTTP/1.1" status: 200 len: 998 time: 0.4995391 Dec 09 21:35:28.733642 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-8a927b1c-da83-48eb-8af5-d20994586dbf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0406620-d595-409c-958d-7a486a49577c', 'name': 'tempest-AttachVolumeTestJSON-1079676770-router', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210'}], 'enable_snat': True}, 'gw_port_id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:32Z', 'updated_at': '2021-12-09T21:30:38Z', 'revision_number': 4, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'gw_port': {'id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:0e:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1399, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:33Z', 'updated_at': '2021-12-09T21:30:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '2c536504-55a9-47a6-b355-f598885671a2', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'floating_ip_address': '172.25.3.18', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'a0406620-d595-409c-958d-7a486a49577c', 'port_id': 'ad97d669-4d68-4099-b1bd-992fd4cfb91c', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 1850, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'mac_address': 'fa:16:3e:6b:cd:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:35:09Z', 'updated_at': '2021-12-09T21:35:27Z', 'revision_number': 1, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbff506a-7b73-4238-9fda-dd193910d0ce', 'name': '', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'mac_address': 'fa:16:3e:94:28:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:37Z', 'updated_at': '2021-12-09T21:30:42Z', 'revision_number': 5, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'subnets': [{'id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:28.770263 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8a927b1c-da83-48eb-8af5-d20994586dbf None None] The sync data for ids ['a0406620-d595-409c-958d-7a486a49577c'] in n-d-713301-27 is: [{'id': 'a0406620-d595-409c-958d-7a486a49577c', 'name': 'tempest-AttachVolumeTestJSON-1079676770-router', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210'}], 'enable_snat': True}, 'gw_port_id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:32Z', 'updated_at': '2021-12-09T21:30:38Z', 'revision_number': 4, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'gw_port': {'id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:0e:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1399, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:33Z', 'updated_at': '2021-12-09T21:30:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '2c536504-55a9-47a6-b355-f598885671a2', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'floating_ip_address': '172.25.3.18', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'a0406620-d595-409c-958d-7a486a49577c', 'port_id': 'ad97d669-4d68-4099-b1bd-992fd4cfb91c', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 1850, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'mac_address': 'fa:16:3e:6b:cd:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:35:09Z', 'updated_at': '2021-12-09T21:35:27Z', 'revision_number': 1, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'dbff506a-7b73-4238-9fda-dd193910d0ce', 'name': '', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'mac_address': 'fa:16:3e:94:28:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:37Z', 'updated_at': '2021-12-09T21:30:42Z', 'revision_number': 5, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'subnets': [{'id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:35:28.794478 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d7a2ec2-a0c5-4f57-85e9-f907aa13fe17 req-d7cca854-249c-4f9a-a0c6-0ca6c5ff0be8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:28.796064 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1d7a2ec2-a0c5-4f57-85e9-f907aa13fe17 req-d7cca854-249c-4f9a-a0c6-0ca6c5ff0be8 service neutron] 10.222.0.31 "GET /v2.0/networks?id=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 HTTP/1.1" status: 200 len: 917 time: 0.5769162 Dec 09 21:35:28.863290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bfe2a42-b6ae-45e3-8f0f-46283535900f req-970c97be-c4bf-44a6-8a0a-74efdc8b9b2b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:28.865072 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2bfe2a42-b6ae-45e3-8f0f-46283535900f req-970c97be-c4bf-44a6-8a0a-74efdc8b9b2b service neutron] 10.222.0.10 "GET /v2.0/subnets?id=10ff3f47-d1f4-47a0-808e-f885899dfb29 HTTP/1.1" status: 200 len: 850 time: 0.1285896 Dec 09 21:35:28.918916 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1d7a2ec2-a0c5-4f57-85e9-f907aa13fe17 req-2d4aa756-7bba-4163-9ada-3d34653636d4 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=851ff09f-496e-47bd-85bb-2e21622a44e9 HTTP/1.1" status: 200 len: 999 time: 0.1117697 Dec 09 21:35:28.954914 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bfe2a42-b6ae-45e3-8f0f-46283535900f req-0398660a-bae3-4f7f-8718-489ef50bf4a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:28.956839 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2bfe2a42-b6ae-45e3-8f0f-46283535900f req-0398660a-bae3-4f7f-8718-489ef50bf4a7 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=935b09ce-7410-4b66-82be-99978deb6717&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0827889 Dec 09 21:35:29.004314 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d7a2ec2-a0c5-4f57-85e9-f907aa13fe17 req-e6f24885-2d48-4053-a4da-5eb95a4d3f5f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:29.004581 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f401e4f-9a7a-455f-aaf6-7bc8a974dca8 req-19dacd09-9514-4ba5-b5c0-ee5ce78c1e5c service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2696221 Dec 09 21:35:29.005802 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1d7a2ec2-a0c5-4f57-85e9-f907aa13fe17 req-e6f24885-2d48-4053-a4da-5eb95a4d3f5f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=ace82e8b-012a-4184-a81e-5303eecf12ff HTTP/1.1" status: 200 len: 855 time: 0.0813177 Dec 09 21:35:29.015186 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e98b7f4-8142-4166-83c0-ac5cc9bcd3e1 req-9ae5487a-5c57-44d9-bdc4-39ef918e1577 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:29.016813 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8e98b7f4-8142-4166-83c0-ac5cc9bcd3e1 req-9ae5487a-5c57-44d9-bdc4-39ef918e1577 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 943 time: 0.1417432 Dec 09 21:35:29.026765 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a9c8d3d-8818-4141-9327-49568bce84af req-4d1de828-c8a7-43c0-8d03-886a2375f01a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:29.028385 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a9c8d3d-8818-4141-9327-49568bce84af req-4d1de828-c8a7-43c0-8d03-886a2375f01a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1573467 Dec 09 21:35:29.055119 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-61eedced-bb0e-4ed4-bc2e-cded280cc608 None None] New status for floating IP 2c536504-55a9-47a6-b355-f598885671a2: ACTIVE {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:35:29.104988 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2bfe2a42-b6ae-45e3-8f0f-46283535900f req-ce2d0cc1-4893-40c9-8500-948c1ab57c90 service neutron] 10.222.0.10 "GET /v2.0/networks/935b09ce-7410-4b66-82be-99978deb6717?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1398077 Dec 09 21:35:29.107713 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d7a2ec2-a0c5-4f57-85e9-f907aa13fe17 req-c5540f94-3111-46e2-8edd-2a9bfe11bcdb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:29.109129 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1d7a2ec2-a0c5-4f57-85e9-f907aa13fe17 req-c5540f94-3111-46e2-8edd-2a9bfe11bcdb service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0629437 Dec 09 21:35:29.175338 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0bf8687-4c0d-4d2e-8185-007a24f336d0 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:29.193862 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a9c8d3d-8818-4141-9327-49568bce84af req-9177cda7-c015-43f0-a845-ebf75a3155fd tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1532457 Dec 09 21:35:29.234629 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0bf8687-4c0d-4d2e-8185-007a24f336d0 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Pushing event deleted for resources: {'Port': ['ID=9c70717e-cc6e-419f-b872-6be6384995a0,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:29.249733 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8e98b7f4-8142-4166-83c0-ac5cc9bcd3e1 req-84327ed2-9cf3-4040-b3bd-c113e3eb73be tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2201943 Dec 09 21:35:29.324338 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1d7a2ec2-a0c5-4f57-85e9-f907aa13fe17 req-5331d751-d269-472b-9b4f-d7f1671de2c7 service neutron] 10.222.0.31 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2020013 Dec 09 21:35:29.357214 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2bfe2a42-b6ae-45e3-8f0f-46283535900f req-5c793534-e7d2-40ef-9a76-76a82d9bd75b service neutron] 10.222.0.10 "GET /v2.0/networks/935b09ce-7410-4b66-82be-99978deb6717?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2219307 Dec 09 21:35:29.370519 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0bf8687-4c0d-4d2e-8185-007a24f336d0 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:29.388034 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f0bf8687-4c0d-4d2e-8185-007a24f336d0 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] 10.222.0.13 "DELETE /v2.0/ports/9c70717e-cc6e-419f-b872-6be6384995a0 HTTP/1.1" status: 204 len: 168 time: 1.4263158 Dec 09 21:35:29.389041 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51370) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:29.500626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a10822df-754f-4129-bce3-05a8e4721b22 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:29.502363 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a10822df-754f-4129-bce3-05a8e4721b22 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] 10.222.0.13 "GET /v2.0/ports?device_id=b3dc3842-95a1-437b-9d4a-20ff5c626723 HTTP/1.1" status: 200 len: 913 time: 0.1122720 Dec 09 21:35:29.505145 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51372) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:29.513287 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1d7a2ec2-a0c5-4f57-85e9-f907aa13fe17 req-3a1a9cfb-87b9-4efb-b688-d32e9982a75d service neutron] 10.222.0.31 "GET /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1548719 Dec 09 21:35:29.653347 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1e54159e-3c83-49a1-a5b5-3e2b29336c43 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:35:29.736190 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8825b07b-99b4-44b7-8de9-021cd7f39535 req-4e8f90ab-c0e8-4c51-b271-5bfb3909052b tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:29.737769 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8825b07b-99b4-44b7-8de9-021cd7f39535 req-4e8f90ab-c0e8-4c51-b271-5bfb3909052b tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 943 time: 0.1315324 Dec 09 21:35:29.761752 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 1e54159e-3c83-49a1-a5b5-3e2b29336c43, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1e54159e-3c83-49a1-a5b5-3e2b29336c43,segment=NetworkSegment(dcec1a9e-3140-49cf-a664-3f1f0937898f),segment_id=dcec1a9e-3140-49cf-a664-3f1f0937898f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:35:29.778974 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '1e54159e-3c83-49a1-a5b5-3e2b29336c43', 'network_id': '88af5e51-6d1a-432d-8676-517f449774a3', 'port_id': '1e54159e-3c83-49a1-a5b5-3e2b29336c43', 'mac_address': 'fa:16:3e:66:78:8f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 107, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4700ee88-1952-42ab-9242-d93b9f07f2be', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:35:29.843773 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:29.861754 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8825b07b-99b4-44b7-8de9-021cd7f39535 req-cc211b55-6f8e-4e79-bb28-6c380be7cca0 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1149447 Dec 09 21:35:29.870864 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1e54159e-3c83-49a1-a5b5-3e2b29336c43 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:35:29.907113 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 1e54159e-3c83-49a1-a5b5-3e2b29336c43, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1e54159e-3c83-49a1-a5b5-3e2b29336c43,segment=NetworkSegment(dcec1a9e-3140-49cf-a664-3f1f0937898f),segment_id=dcec1a9e-3140-49cf-a664-3f1f0937898f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:35:29.919138 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:29.974908 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=1e54159e-3c83-49a1-a5b5-3e2b29336c43,revision_number=9']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:30.048536 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b2cb885d-80d7-424f-a7d0-cffb8dc233b8 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:30.143703 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['1e54159e-3c83-49a1-a5b5-3e2b29336c43'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:35:30.457274 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa34c646-7daf-48a9-a3c8-fcded65df8b9 req-bb21e970-09b2-4e09-9e81-20d8250ca5d0 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:30.458804 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aa34c646-7daf-48a9-a3c8-fcded65df8b9 req-bb21e970-09b2-4e09-9e81-20d8250ca5d0 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1351621 Dec 09 21:35:30.491503 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c40c418c-fce1-4c89-bcb0-9f1eb7d8796b req-372309cb-580a-488e-9493-b23b419b20b0 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:30.492947 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c40c418c-fce1-4c89-bcb0-9f1eb7d8796b req-372309cb-580a-488e-9493-b23b419b20b0 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 944 time: 0.1290030 Dec 09 21:35:30.554211 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aa34c646-7daf-48a9-a3c8-fcded65df8b9 req-3f7f434f-5385-43cb-a59f-c625992d1963 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0887496 Dec 09 21:35:30.562020 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-b2cb885d-80d7-424f-a7d0-cffb8dc233b8 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Deleting port e3ca0dac-1a39-43eb-b703-132e0a2ff55b {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:35:30.562397 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b2cb885d-80d7-424f-a7d0-cffb8dc233b8 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:30.603298 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c40c418c-fce1-4c89-bcb0-9f1eb7d8796b req-042c469d-6ce5-4d15-893a-2c1f3d476c74 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1025426 Dec 09 21:35:30.710615 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b2cb885d-80d7-424f-a7d0-cffb8dc233b8 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:30.724202 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-b2cb885d-80d7-424f-a7d0-cffb8dc233b8 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Calling delete_port for e3ca0dac-1a39-43eb-b703-132e0a2ff55b owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:35:30.914098 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b2cb885d-80d7-424f-a7d0-cffb8dc233b8 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:30.946272 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2cb885d-80d7-424f-a7d0-cffb8dc233b8 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Pushing event deleted for resources: {'Port': ['ID=e3ca0dac-1a39-43eb-b703-132e0a2ff55b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:31.090447 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e919f11-fb62-4a97-899e-fec1956ff59a req-6bad9f24-3b7c-48c5-a2cf-93b2b987b20f tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:31.091990 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e919f11-fb62-4a97-899e-fec1956ff59a req-6bad9f24-3b7c-48c5-a2cf-93b2b987b20f tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 943 time: 0.1217775 Dec 09 21:35:31.137010 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b2cb885d-80d7-424f-a7d0-cffb8dc233b8 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:31.245649 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e919f11-fb62-4a97-899e-fec1956ff59a req-7eca5881-a242-467a-8103-d7b572af0f4a tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1192200 Dec 09 21:35:31.584316 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b2cb885d-80d7-424f-a7d0-cffb8dc233b8 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Router b3dc3842-95a1-437b-9d4a-20ff5c626723 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:35:31.671817 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1e54159e-3c83-49a1-a5b5-3e2b29336c43 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:35:31.673709 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b2cb885d-80d7-424f-a7d0-cffb8dc233b8 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:35:31.678880 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b2cb885d-80d7-424f-a7d0-cffb8dc233b8 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] 10.222.0.13 "PUT /v2.0/routers/b3dc3842-95a1-437b-9d4a-20ff5c626723/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1725788 Dec 09 21:35:31.681505 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51410) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:31.721921 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c84f3413-8236-4093-99c5-c881ca0a33fd None None] Sync routers for ids ['b3dc3842-95a1-437b-9d4a-20ff5c626723'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:35:31.754468 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c84f3413-8236-4093-99c5-c881ca0a33fd None None] Routers {'b3dc3842-95a1-437b-9d4a-20ff5c626723'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:35:31.755412 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-c84f3413-8236-4093-99c5-c881ca0a33fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:35:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['b3dc3842-95a1-437b-9d4a-20ff5c626723'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:31.815279 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f06b9879-4492-4de1-ad5f-02e1e6cd4f83 req-8b75d711-d618-4a37-9bf1-06c71efdded0 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:31.816176 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-28c7db87-0d38-4915-915b-68ca53e412d2 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:31.824526 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f06b9879-4492-4de1-ad5f-02e1e6cd4f83 req-8b75d711-d618-4a37-9bf1-06c71efdded0 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 944 time: 0.0927403 Dec 09 21:35:31.851031 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-c84f3413-8236-4093-99c5-c881ca0a33fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:31.881348 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 1e54159e-3c83-49a1-a5b5-3e2b29336c43 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:31.882117 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:31.884412 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c84f3413-8236-4093-99c5-c881ca0a33fd None None] Routers {'b3dc3842-95a1-437b-9d4a-20ff5c626723'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:35:31.886067 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-c84f3413-8236-4093-99c5-c881ca0a33fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:35:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['b3dc3842-95a1-437b-9d4a-20ff5c626723'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:31.930113 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f06b9879-4492-4de1-ad5f-02e1e6cd4f83 req-08ce07ea-f8db-4d27-b75e-5262b1d59bce tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1045880 Dec 09 21:35:31.948997 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-c84f3413-8236-4093-99c5-c881ca0a33fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:31.949785 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c84f3413-8236-4093-99c5-c881ca0a33fd None None] The sync data for ids ['b3dc3842-95a1-437b-9d4a-20ff5c626723'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:35:32.037630 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:32.063827 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'af704653-9f02-4515-9fb8-0f0869d126b2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1e54159e-3c83-49a1-a5b5-3e2b29336c43'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:35:32.066094 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d488fd70-5461-4688-9b34-e13260e8fc75" -d '{"events": [{"server_uuid": "af704653-9f02-4515-9fb8-0f0869d126b2", "name": "network-vif-plugged", "status": "completed", "tag": "1e54159e-3c83-49a1-a5b5-3e2b29336c43"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:35:32.069500 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-28c7db87-0d38-4915-915b-68ca53e412d2 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:32.071766 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-28c7db87-0d38-4915-915b-68ca53e412d2 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:32.080704 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 1e54159e-3c83-49a1-a5b5-3e2b29336c43, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1e54159e-3c83-49a1-a5b5-3e2b29336c43,segment=NetworkSegment(dcec1a9e-3140-49cf-a664-3f1f0937898f),segment_id=dcec1a9e-3140-49cf-a664-3f1f0937898f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:35:32.089088 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:32.132089 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-28c7db87-0d38-4915-915b-68ca53e412d2 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:32.132658 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-28c7db87-0d38-4915-915b-68ca53e412d2 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Fanout notify agent at l3_agent the message router_deleted on router b3dc3842-95a1-437b-9d4a-20ff5c626723 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:35:32.133711 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:35:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-12520ad3-4613-417e-aee0-bed3530a2084 x-openstack-request-id: req-12520ad3-4613-417e-aee0-bed3530a2084 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:35:32.134888 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "af704653-9f02-4515-9fb8-0f0869d126b2", "name": "network-vif-plugged", "status": "completed", "tag": "1e54159e-3c83-49a1-a5b5-3e2b29336c43", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:35:32.143865 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-12520ad3-4613-417e-aee0-bed3530a2084 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:35:32.144517 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'af704653-9f02-4515-9fb8-0f0869d126b2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1e54159e-3c83-49a1-a5b5-3e2b29336c43', 'code': 200} Dec 09 21:35:32.145558 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-28c7db87-0d38-4915-915b-68ca53e412d2 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:32.146706 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-28c7db87-0d38-4915-915b-68ca53e412d2 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] 10.222.0.13 "DELETE /v2.0/routers/b3dc3842-95a1-437b-9d4a-20ff5c626723 HTTP/1.1" status: 204 len: 168 time: 0.4638748 Dec 09 21:35:32.149760 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51418) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:32.171498 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=1e54159e-3c83-49a1-a5b5-3e2b29336c43,revision_number=10']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:32.210324 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-da22574e-9a84-4307-aa72-103632b72f10 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Deleting subnet 53db963e-6c4f-4819-b56b-49f6b3f8d870 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:35:32.214371 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da22574e-9a84-4307-aa72-103632b72f10 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:32.258377 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da22574e-9a84-4307-aa72-103632b72f10 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:32.388792 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da22574e-9a84-4307-aa72-103632b72f10 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:32.430559 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1311e22-b474-4104-b9f6-1b327f43f13e req-cf1175b2-bdff-4634-9f23-d9af3ecc46ca tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:32.433239 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c1311e22-b474-4104-b9f6-1b327f43f13e req-cf1175b2-bdff-4634-9f23-d9af3ecc46ca tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 943 time: 0.0900805 Dec 09 21:35:32.497640 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c1311e22-b474-4104-b9f6-1b327f43f13e req-c2b6adf9-e726-4e71-952c-aae2a54c86b9 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0584416 Dec 09 21:35:32.498929 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da22574e-9a84-4307-aa72-103632b72f10 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:32.532841 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da22574e-9a84-4307-aa72-103632b72f10 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Pushing event deleted for resources: {'Subnet': ['ID=53db963e-6c4f-4819-b56b-49f6b3f8d870,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:32.536717 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da22574e-9a84-4307-aa72-103632b72f10 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:32.540056 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-da22574e-9a84-4307-aa72-103632b72f10 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] 10.222.0.13 "DELETE /v2.0/subnets/53db963e-6c4f-4819-b56b-49f6b3f8d870 HTTP/1.1" status: 204 len: 168 time: 0.3888931 Dec 09 21:35:32.542655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51422) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:32.544858 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b89db30-927f-4ff8-8900-d8cd24c0dd2b None None] Network 1e591eba-fb21-4ad9-9d15-aeb856903ce8 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:35:32.646275 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bc441d1c-8e70-4b2b-8ac6-f166d289d949 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:32.710763 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-bc441d1c-8e70-4b2b-8ac6-f166d289d949 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Deleting port e26c5721-6e4d-487b-bf70-5bb7727d23ff {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:35:32.711379 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bc441d1c-8e70-4b2b-8ac6-f166d289d949 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:32.715731 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-26a05250-33f4-4aad-9e66-bd75d5d08f02 None None] DHCP port deletion for 1e591eba-fb21-4ad9-9d15-aeb856903ce8 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:35:32.771766 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-26a05250-33f4-4aad-9e66-bd75d5d08f02 None None] Deleting port e26c5721-6e4d-487b-bf70-5bb7727d23ff {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:35:32.772075 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-26a05250-33f4-4aad-9e66-bd75d5d08f02 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:32.786327 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-bc441d1c-8e70-4b2b-8ac6-f166d289d949 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] For port e26c5721-6e4d-487b-bf70-5bb7727d23ff, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e26c5721-6e4d-487b-bf70-5bb7727d23ff,segment=NetworkSegment(cf548278-150e-452f-8c72-997eedda8d62),segment_id=cf548278-150e-452f-8c72-997eedda8d62)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:35:32.787061 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bc441d1c-8e70-4b2b-8ac6-f166d289d949 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:32.811957 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-bc441d1c-8e70-4b2b-8ac6-f166d289d949 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Calling delete_port for e26c5721-6e4d-487b-bf70-5bb7727d23ff owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:35:32.867399 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-26a05250-33f4-4aad-9e66-bd75d5d08f02 None None] For port e26c5721-6e4d-487b-bf70-5bb7727d23ff, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e26c5721-6e4d-487b-bf70-5bb7727d23ff,segment=NetworkSegment(cf548278-150e-452f-8c72-997eedda8d62),segment_id=cf548278-150e-452f-8c72-997eedda8d62)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:35:32.868109 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-26a05250-33f4-4aad-9e66-bd75d5d08f02 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:32.887720 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-26a05250-33f4-4aad-9e66-bd75d5d08f02 None None] Calling delete_port for e26c5721-6e4d-487b-bf70-5bb7727d23ff owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:35:32.934567 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bc441d1c-8e70-4b2b-8ac6-f166d289d949 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:32.955582 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc441d1c-8e70-4b2b-8ac6-f166d289d949 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] No DVR routers for this DVR port e26c5721-6e4d-487b-bf70-5bb7727d23ff on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:35:33.016919 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cdd0eb55-5d3d-4797-be73-86b97e20c004 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:33.025705 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc441d1c-8e70-4b2b-8ac6-f166d289d949 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Pushing event deleted for resources: {'Port': ['ID=e26c5721-6e4d-487b-bf70-5bb7727d23ff,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:33.084525 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-26a05250-33f4-4aad-9e66-bd75d5d08f02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:33.145788 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26a05250-33f4-4aad-9e66-bd75d5d08f02 None None] Pushing event deleted for resources: {'Port': ['ID=e26c5721-6e4d-487b-bf70-5bb7727d23ff,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:33.172199 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26a05250-33f4-4aad-9e66-bd75d5d08f02 None None] No DVR routers for this DVR port e26c5721-6e4d-487b-bf70-5bb7727d23ff on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:35:33.197529 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fb6481a-bc20-4612-9da5-1d1549eec5f6 req-e25a3092-5707-4af4-834c-483da95708dd tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:33.205989 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fb6481a-bc20-4612-9da5-1d1549eec5f6 req-e25a3092-5707-4af4-834c-483da95708dd tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.1689141 Dec 09 21:35:33.209448 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bc441d1c-8e70-4b2b-8ac6-f166d289d949 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:33.242248 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-bc441d1c-8e70-4b2b-8ac6-f166d289d949 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1e591eba-fb21-4ad9-9d15-aeb856903ce8']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:33.253473 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-bc441d1c-8e70-4b2b-8ac6-f166d289d949 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cf548278-150e-452f-8c72-997eedda8d62') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:33.253776 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-bc441d1c-8e70-4b2b-8ac6-f166d289d949 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cf548278-150e-452f-8c72-997eedda8d62') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:33.263734 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bc441d1c-8e70-4b2b-8ac6-f166d289d949 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:33.272087 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fb6481a-bc20-4612-9da5-1d1549eec5f6 req-4bafa555-619c-4b3f-b4ca-8a6e169df955 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0651693 Dec 09 21:35:33.279522 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bc441d1c-8e70-4b2b-8ac6-f166d289d949 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:33.287331 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bc441d1c-8e70-4b2b-8ac6-f166d289d949 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Releasing vlan 137 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:35:33.287808 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bc441d1c-8e70-4b2b-8ac6-f166d289d949 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:35:33.292239 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:35:33.357894 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bc441d1c-8e70-4b2b-8ac6-f166d289d949 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:33.365775 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bc441d1c-8e70-4b2b-8ac6-f166d289d949 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:33.369063 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bc441d1c-8e70-4b2b-8ac6-f166d289d949 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] 10.222.0.13 "DELETE /v2.0/networks/1e591eba-fb21-4ad9-9d15-aeb856903ce8 HTTP/1.1" status: 204 len: 168 time: 0.8252020 Dec 09 21:35:33.380691 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc441d1c-8e70-4b2b-8ac6-f166d289d949 tempest-FloatingIPNegativeTestJSON-763777433 tempest-FloatingIPNegativeTestJSON-763777433-project] Pushing event deleted for resources: {'Network': ['ID=1e591eba-fb21-4ad9-9d15-aeb856903ce8,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:33.513257 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e26c5721-6e4d-487b-bf70-5bb7727d23ff no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:35:33.554216 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: e26c5721-6e4d-487b-bf70-5bb7727d23ff {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:35:33.554640 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e26c5721-6e4d-487b-bf70-5bb7727d23ff not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:35:33.654683 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34ecb259-8a4a-4840-b34e-bb92a2d5365b req-781979d3-03b7-4102-9d2e-b1351e439964 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:33.656570 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-34ecb259-8a4a-4840-b34e-bb92a2d5365b req-781979d3-03b7-4102-9d2e-b1351e439964 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 943 time: 0.0659468 Dec 09 21:35:33.680903 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51440) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:33.716507 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-34ecb259-8a4a-4840-b34e-bb92a2d5365b req-817a43e8-3603-4711-b396-94ab6f5a0a78 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0527885 Dec 09 21:35:33.820439 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-598d6883-d2e3-4671-919e-099d3d24ae60 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ecc44ce822d64b69a363fb65aee7aba0&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1377394 Dec 09 21:35:33.822813 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51444) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:33.874198 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24430758-82e8-433a-811c-b578c9fb8423 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:33.898363 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24430758-82e8-433a-811c-b578c9fb8423 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:33.955354 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24430758-82e8-433a-811c-b578c9fb8423 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:33.960556 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24430758-82e8-433a-811c-b578c9fb8423 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:33.964717 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-24430758-82e8-433a-811c-b578c9fb8423 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/49ddb38d-0387-4f04-9816-b5d05f7c3b4e HTTP/1.1" status: 204 len: 168 time: 0.1394703 Dec 09 21:35:33.973840 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24430758-82e8-433a-811c-b578c9fb8423 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=49ddb38d-0387-4f04-9816-b5d05f7c3b4e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:34.439975 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8453f4bb-0ad9-4bfc-bd37-048d46ab7ab8 req-68c98ec6-344b-480f-94eb-bb06a06e292f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:34.441637 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8453f4bb-0ad9-4bfc-bd37-048d46ab7ab8 req-68c98ec6-344b-480f-94eb-bb06a06e292f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0807145 Dec 09 21:35:34.524390 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8453f4bb-0ad9-4bfc-bd37-048d46ab7ab8 req-34cf4b9d-86f0-40d8-9e1d-2be091842cad tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0713732 Dec 09 21:35:34.739838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51474) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:34.870924 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Request body: {'networks': [{'name': 'tempest-network--1349439689'}, {'name': 'tempest-network--1513286053'}]} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:34.871651 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Request body: {'network': {'name': 'tempest-network--1349439689'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:34.871781 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Request body: {'network': {'name': 'tempest-network--1513286053'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:34.879423 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c59f7d37-e2f6-4383-ae24-1b0f4ccd485a req-85720e31-e22e-4964-b659-422cc4955cb2 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:34.883081 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c59f7d37-e2f6-4383-ae24-1b0f4ccd485a req-85720e31-e22e-4964-b659-422cc4955cb2 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 943 time: 0.0666368 Dec 09 21:35:34.896435 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Made reservation on behalf of 0719b38b77e54a78a81bc92bc07b682c for: {'network': 2} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:34.903031 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:34.913858 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:34.936050 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c59f7d37-e2f6-4383-ae24-1b0f4ccd485a req-7d5af3f4-c60b-4af3-8004-281f2b519573 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0477457 Dec 09 21:35:35.038608 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:35.049901 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:35.064185 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:35.125501 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] vlan segment allocate from pool success with {'vlan_id': 115, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:35:35.127902 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f29693be-ae57-4c5c-93be-0dc3b17562e0,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:35.142408 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:35.142878 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Added segment dfa045ec-76d4-495e-978b-e3b4634ccb40 of type vlan for network 7ffda6af-c9c3-41f6-9eb3-cf528397f104 Dec 09 21:35:35.207377 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:35.250836 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] vlan segment allocate from pool success with {'vlan_id': 142, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:35:35.264042 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:35.264405 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Added segment cd9702d1-dc98-4c60-8bc0-639eb6fb455c of type vlan for network dc97c0fe-0aaf-447b-955a-5e1b99d5f1d2 Dec 09 21:35:35.312018 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:35.341987 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:35.342615 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:35.349215 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:35.355498 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:35.356191 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:35.405680 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 1320 time: 0.6644762 Dec 09 21:35:35.409790 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51486) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:35.449830 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Pushing event updated for resources: {'Network': ['ID=7ffda6af-c9c3-41f6-9eb3-cf528397f104,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:35.461445 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 7ffda6af-c9c3-41f6-9eb3-cf528397f104 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:35:35.561387 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a8d2bda-aa40-413e-8d5e-5a5069977e65 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Pushing event updated for resources: {'Network': ['ID=dc97c0fe-0aaf-447b-955a-5e1b99d5f1d2,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:35.584462 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network dc97c0fe-0aaf-447b-955a-5e1b99d5f1d2 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:35:35.646997 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e0829ef9-bc86-4ca5-9b40-ecae0785ea35 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:35.712561 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5890ed17-f42b-4611-a1e4-259ca752a6e9 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:35.719003 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5890ed17-f42b-4611-a1e4-259ca752a6e9 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:35.725492 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5890ed17-f42b-4611-a1e4-259ca752a6e9 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:35.732318 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5890ed17-f42b-4611-a1e4-259ca752a6e9 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:35.734060 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5890ed17-f42b-4611-a1e4-259ca752a6e9 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] 10.222.0.13 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2407 time: 0.3229399 Dec 09 21:35:35.737152 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51490) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:35.754982 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93c3addc-c395-4d74-94fa-da8f6679c330 req-35d5b729-e0db-4e9f-82f6-0361ed8048d5 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:35.758604 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-93c3addc-c395-4d74-94fa-da8f6679c330 req-35d5b729-e0db-4e9f-82f6-0361ed8048d5 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.1121852 Dec 09 21:35:35.815705 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-93c3addc-c395-4d74-94fa-da8f6679c330 req-a03f2dbc-2107-461e-ab1f-4d83a1ad0f7a tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0520751 Dec 09 21:35:35.824572 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a12e5520-84c5-4e7d-a85c-74be174ffcca tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:35.915711 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a12e5520-84c5-4e7d-a85c-74be174ffcca tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:35.944759 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-a12e5520-84c5-4e7d-a85c-74be174ffcca tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7ffda6af-c9c3-41f6-9eb3-cf528397f104']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:35.954565 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-a12e5520-84c5-4e7d-a85c-74be174ffcca tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dfa045ec-76d4-495e-978b-e3b4634ccb40') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:35.954884 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-a12e5520-84c5-4e7d-a85c-74be174ffcca tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dfa045ec-76d4-495e-978b-e3b4634ccb40') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:35.965720 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a12e5520-84c5-4e7d-a85c-74be174ffcca tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:35.980740 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a12e5520-84c5-4e7d-a85c-74be174ffcca tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:35.989934 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a12e5520-84c5-4e7d-a85c-74be174ffcca tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Releasing vlan 115 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:35:35.990713 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a12e5520-84c5-4e7d-a85c-74be174ffcca tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:35:35.995113 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:35:36.103118 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a12e5520-84c5-4e7d-a85c-74be174ffcca tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:36.113896 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a12e5520-84c5-4e7d-a85c-74be174ffcca tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:36.117218 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a12e5520-84c5-4e7d-a85c-74be174ffcca tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] 10.222.0.13 "DELETE /v2.0/networks/7ffda6af-c9c3-41f6-9eb3-cf528397f104 HTTP/1.1" status: 204 len: 168 time: 0.3790281 Dec 09 21:35:36.126512 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51498) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:36.126676 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8de9a204-9661-4f85-8b01-d2816ee7c876 req-8cd3bc77-3508-4557-b306-33d556905a3d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:36.128243 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8de9a204-9661-4f85-8b01-d2816ee7c876 req-8cd3bc77-3508-4557-b306-33d556905a3d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 943 time: 0.0938346 Dec 09 21:35:36.142067 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a12e5520-84c5-4e7d-a85c-74be174ffcca tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Pushing event deleted for resources: {'Network': ['ID=7ffda6af-c9c3-41f6-9eb3-cf528397f104,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:36.206615 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8de9a204-9661-4f85-8b01-d2816ee7c876 req-63950b25-5d83-43ba-b427-0d28d091b28c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0706444 Dec 09 21:35:36.233072 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c3fecdb9-f48a-449c-8ac5-5a375496d455 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:36.363470 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c3fecdb9-f48a-449c-8ac5-5a375496d455 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:36.390911 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-c3fecdb9-f48a-449c-8ac5-5a375496d455 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['dc97c0fe-0aaf-447b-955a-5e1b99d5f1d2']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:36.404988 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-c3fecdb9-f48a-449c-8ac5-5a375496d455 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cd9702d1-dc98-4c60-8bc0-639eb6fb455c') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:36.405342 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-c3fecdb9-f48a-449c-8ac5-5a375496d455 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cd9702d1-dc98-4c60-8bc0-639eb6fb455c') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:36.421710 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c3fecdb9-f48a-449c-8ac5-5a375496d455 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:36.437531 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c3fecdb9-f48a-449c-8ac5-5a375496d455 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:36.443407 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c3fecdb9-f48a-449c-8ac5-5a375496d455 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Releasing vlan 142 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:35:36.443821 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c3fecdb9-f48a-449c-8ac5-5a375496d455 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:35:36.446701 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:35:36.507515 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c3fecdb9-f48a-449c-8ac5-5a375496d455 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:36.514465 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c3fecdb9-f48a-449c-8ac5-5a375496d455 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:36.519982 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c3fecdb9-f48a-449c-8ac5-5a375496d455 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] 10.222.0.13 "DELETE /v2.0/networks/dc97c0fe-0aaf-447b-955a-5e1b99d5f1d2 HTTP/1.1" status: 204 len: 168 time: 0.3902071 Dec 09 21:35:36.520260 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51504) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:36.544097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3fecdb9-f48a-449c-8ac5-5a375496d455 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Pushing event deleted for resources: {'Network': ['ID=dc97c0fe-0aaf-447b-955a-5e1b99d5f1d2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:36.600724 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:36.658627 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df1cfe9f-0e29-41f6-ae16-f79873ad0afe tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:36.664763 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df1cfe9f-0e29-41f6-ae16-f79873ad0afe tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:36.671208 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51506) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:36.671501 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-df1cfe9f-0e29-41f6-ae16-f79873ad0afe tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] 10.222.0.13 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1339 time: 0.1500599 Dec 09 21:35:36.678511 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-3f8bc0ed-0238-4f36-9460-6949cf8e80e4 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-225749051'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:36.700684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3f8bc0ed-0238-4f36-9460-6949cf8e80e4 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Made reservation on behalf of 0719b38b77e54a78a81bc92bc07b682c for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:36.704136 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f8bc0ed-0238-4f36-9460-6949cf8e80e4 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:36.736769 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3f8bc0ed-0238-4f36-9460-6949cf8e80e4 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] vlan segment allocate from pool success with {'vlan_id': 100, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:35:36.750366 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f8bc0ed-0238-4f36-9460-6949cf8e80e4 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:36.750900 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-3f8bc0ed-0238-4f36-9460-6949cf8e80e4 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Added segment ffd7a1cd-0251-43a6-8709-c844b5a89285 of type vlan for network f25c130c-a2ad-47e2-b0d4-935d44eef4e8 Dec 09 21:35:36.795300 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f8bc0ed-0238-4f36-9460-6949cf8e80e4 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:36.821176 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f8bc0ed-0238-4f36-9460-6949cf8e80e4 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:36.827340 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f8bc0ed-0238-4f36-9460-6949cf8e80e4 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:36.827837 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f8bc0ed-0238-4f36-9460-6949cf8e80e4 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:36.879973 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3f8bc0ed-0238-4f36-9460-6949cf8e80e4 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 0.2064617 Dec 09 21:35:36.882821 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51510) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:36.888379 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-3b490f8b-676d-4c43-a19b-8b2e1972a93d tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-1969951573'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:36.933274 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f8bc0ed-0238-4f36-9460-6949cf8e80e4 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Pushing event updated for resources: {'Network': ['ID=f25c130c-a2ad-47e2-b0d4-935d44eef4e8,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:36.945599 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network f25c130c-a2ad-47e2-b0d4-935d44eef4e8 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:35:36.948383 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3b490f8b-676d-4c43-a19b-8b2e1972a93d tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Made reservation on behalf of 0719b38b77e54a78a81bc92bc07b682c for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:36.952041 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3b490f8b-676d-4c43-a19b-8b2e1972a93d tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:36.986619 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6d9e8f6-48b9-485b-a9b0-b2636cb6929b req-af71e8b9-0152-4eea-99b2-43f358e52ef1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:36.988590 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a6d9e8f6-48b9-485b-a9b0-b2636cb6929b req-af71e8b9-0152-4eea-99b2-43f358e52ef1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0694828 Dec 09 21:35:37.000540 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3b490f8b-676d-4c43-a19b-8b2e1972a93d tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] vlan segment allocate from pool success with {'vlan_id': 134, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:35:37.019860 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3b490f8b-676d-4c43-a19b-8b2e1972a93d tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:37.020219 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-3b490f8b-676d-4c43-a19b-8b2e1972a93d tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Added segment 16790b31-e175-4053-a460-69e1e4dedfd6 of type vlan for network fe6813fe-21a7-4410-bf15-c47e4c407d26 Dec 09 21:35:37.061362 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a6d9e8f6-48b9-485b-a9b0-b2636cb6929b req-6ae58e8b-2de0-4823-be57-a6782fc0c0a4 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0624280 Dec 09 21:35:37.102032 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3b490f8b-676d-4c43-a19b-8b2e1972a93d tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:37.128370 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3b490f8b-676d-4c43-a19b-8b2e1972a93d tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:37.134164 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b490f8b-676d-4c43-a19b-8b2e1972a93d tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:37.134852 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3b490f8b-676d-4c43-a19b-8b2e1972a93d tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:37.173136 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3b490f8b-676d-4c43-a19b-8b2e1972a93d tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 0.2891054 Dec 09 21:35:37.176440 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51512) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:37.182174 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Request body: {'ports': [{'network_id': 'f25c130c-a2ad-47e2-b0d4-935d44eef4e8', 'name': 'tempest-port--1882518571', 'admin_state_up': True}, {'network_id': 'fe6813fe-21a7-4410-bf15-c47e4c407d26', 'admin_state_up': False}]} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:37.182764 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Request body: {'port': {'network_id': 'f25c130c-a2ad-47e2-b0d4-935d44eef4e8', 'name': 'tempest-port--1882518571', 'admin_state_up': True}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:37.183246 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Request body: {'port': {'network_id': 'fe6813fe-21a7-4410-bf15-c47e4c407d26', 'admin_state_up': False}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:37.221392 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b490f8b-676d-4c43-a19b-8b2e1972a93d tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Pushing event updated for resources: {'Network': ['ID=fe6813fe-21a7-4410-bf15-c47e4c407d26,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:37.232226 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network fe6813fe-21a7-4410-bf15-c47e4c407d26 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:35:37.442968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4a9cebb-5519-4f7e-9ec1-188d4a2183c8 req-5e1a5d9d-36c2-498c-b853-aec48400958d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:37.444500 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c4a9cebb-5519-4f7e-9ec1-188d4a2183c8 req-5e1a5d9d-36c2-498c-b853-aec48400958d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 943 time: 0.1142254 Dec 09 21:35:37.481418 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Made reservation on behalf of 0719b38b77e54a78a81bc92bc07b682c for: {'port': 2} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:37.486379 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:37.513422 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:37.530987 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c4a9cebb-5519-4f7e-9ec1-188d4a2183c8 req-6ad759f7-b480-48fd-a445-9194beb2e8ff tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0800312 Dec 09 21:35:37.609397 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] device_id is not set on port 83ea1322-993e-4dfe-bcbf-21aff2c256ff yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:35:37.732085 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:37.812179 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] device_id is not set on port 8bb48bb7-f525-4a18-9127-53bd778a4d37 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:35:37.931864 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:37.936586 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:37.984485 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:38.055187 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Pushing event updated for resources: {'Port': ['ID=83ea1322-993e-4dfe-bcbf-21aff2c256ff,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:38.063885 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Checking segment: {'id': 'ffd7a1cd-0251-43a6-8709-c844b5a89285', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'f25c130c-a2ad-47e2-b0d4-935d44eef4e8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:35:38.064248 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Network hostable DHCP agents. Network: f25c130c-a2ad-47e2-b0d4-935d44eef4e8, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:35:38.084125 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Network f25c130c-a2ad-47e2-b0d4-935d44eef4e8 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:35:38.096356 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, f25c130c-a2ad-47e2-b0d4-935d44eef4e8) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:38.100480 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:35:38.101859 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:38.111380 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dce14b17-0c15-4e4c-a75c-4784949e56dd None None] Network f25c130c-a2ad-47e2-b0d4-935d44eef4e8 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:35:38.205261 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Pushing event updated for resources: {'Port': ['ID=8bb48bb7-f525-4a18-9127-53bd778a4d37,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:38.229143 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Checking segment: {'id': '16790b31-e175-4053-a460-69e1e4dedfd6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'fe6813fe-21a7-4410-bf15-c47e4c407d26'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:35:38.229538 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Network hostable DHCP agents. Network: fe6813fe-21a7-4410-bf15-c47e4c407d26, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:35:38.242486 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41a94bca-1c82-4c4e-ae82-6f09c25f9126 req-96af812c-1e62-40ca-9de5-d20bd3220b10 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:38.244256 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-41a94bca-1c82-4c4e-ae82-6f09c25f9126 req-96af812c-1e62-40ca-9de5-d20bd3220b10 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0945895 Dec 09 21:35:38.314035 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Network fe6813fe-21a7-4410-bf15-c47e4c407d26 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:35:38.342752 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-41a94bca-1c82-4c4e-ae82-6f09c25f9126 req-a602f3eb-9a6b-49e5-bd07-e834ec856dcf tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0904241 Dec 09 21:35:38.343958 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, fe6813fe-21a7-4410-bf15-c47e4c407d26) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:38.349064 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:35:38.359647 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5033c604-380e-4717-bf40-bc51af9f536d None None] Network fe6813fe-21a7-4410-bf15-c47e4c407d26 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:35:38.360139 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:38.366053 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:38.366781 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:38.400192 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-792cb42a-150c-4c00-98f8-e7ecbfb54ad6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1450 time: 1.2195468 Dec 09 21:35:38.400582 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51526) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:38.485094 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4600b9e7-030b-4d07-b383-bf92289791a2 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:38.497081 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4600b9e7-030b-4d07-b383-bf92289791a2 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:38.508403 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51532) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:38.517469 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4600b9e7-030b-4d07-b383-bf92289791a2 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1445 time: 0.1062427 Dec 09 21:35:38.686264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f679092-dc0a-45c8-99a1-4f59096dbc2a req-3cf29cd8-3eec-41f6-9b92-0ac7b5a85c41 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:38.687754 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f679092-dc0a-45c8-99a1-4f59096dbc2a req-3cf29cd8-3eec-41f6-9b92-0ac7b5a85c41 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 943 time: 0.0628901 Dec 09 21:35:38.713078 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-83a47fb2-29ad-4181-8a63-6a3ecc4d6dd5 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Deleting port 83ea1322-993e-4dfe-bcbf-21aff2c256ff {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:35:38.713315 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83a47fb2-29ad-4181-8a63-6a3ecc4d6dd5 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:38.801359 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83a47fb2-29ad-4181-8a63-6a3ecc4d6dd5 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:38.807012 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f679092-dc0a-45c8-99a1-4f59096dbc2a req-0cf9cd9b-2473-4c60-bc4d-61e54eaf9e07 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1119585 Dec 09 21:35:38.819142 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-83a47fb2-29ad-4181-8a63-6a3ecc4d6dd5 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Calling delete_port for 83ea1322-993e-4dfe-bcbf-21aff2c256ff owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:35:38.912875 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83a47fb2-29ad-4181-8a63-6a3ecc4d6dd5 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:38.947615 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83a47fb2-29ad-4181-8a63-6a3ecc4d6dd5 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Pushing event deleted for resources: {'Port': ['ID=83ea1322-993e-4dfe-bcbf-21aff2c256ff,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:38.951181 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83a47fb2-29ad-4181-8a63-6a3ecc4d6dd5 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:38.954487 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-83a47fb2-29ad-4181-8a63-6a3ecc4d6dd5 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] 10.222.0.13 "DELETE /v2.0/ports/83ea1322-993e-4dfe-bcbf-21aff2c256ff HTTP/1.1" status: 204 len: 168 time: 0.4450219 Dec 09 21:35:38.957138 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51538) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:39.065323 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-2e76aedb-5eb5-4de0-93ad-d9cb655c926c tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Deleting port 8bb48bb7-f525-4a18-9127-53bd778a4d37 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:35:39.065663 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e76aedb-5eb5-4de0-93ad-d9cb655c926c tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:39.138955 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e76aedb-5eb5-4de0-93ad-d9cb655c926c tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:39.152335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-2e76aedb-5eb5-4de0-93ad-d9cb655c926c tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Calling delete_port for 8bb48bb7-f525-4a18-9127-53bd778a4d37 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:35:39.245033 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e76aedb-5eb5-4de0-93ad-d9cb655c926c tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:39.286139 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e76aedb-5eb5-4de0-93ad-d9cb655c926c tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:39.290419 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2e76aedb-5eb5-4de0-93ad-d9cb655c926c tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] 10.222.0.13 "DELETE /v2.0/ports/8bb48bb7-f525-4a18-9127-53bd778a4d37 HTTP/1.1" status: 204 len: 168 time: 0.3307087 Dec 09 21:35:39.291763 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e76aedb-5eb5-4de0-93ad-d9cb655c926c tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Pushing event deleted for resources: {'Port': ['ID=8bb48bb7-f525-4a18-9127-53bd778a4d37,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:39.292219 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51540) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:39.327138 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-66f10ed7-6eaa-4278-88e9-f138b697413a tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0335488 Dec 09 21:35:39.330655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51542) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:39.336279 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ce24ad78-83d5-416a-a671-4963897d1c02 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-1280948059'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:39.361935 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ce24ad78-83d5-416a-a671-4963897d1c02 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Made reservation on behalf of 0719b38b77e54a78a81bc92bc07b682c for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:39.366358 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ce24ad78-83d5-416a-a671-4963897d1c02 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:39.394261 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ce24ad78-83d5-416a-a671-4963897d1c02 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] vlan segment allocate from pool success with {'vlan_id': 111, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:35:39.412591 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ce24ad78-83d5-416a-a671-4963897d1c02 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:39.413913 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-ce24ad78-83d5-416a-a671-4963897d1c02 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Added segment 3fb27ce2-b460-4629-b9e1-4927411473e2 of type vlan for network 0e07cdc1-0bba-47e5-862b-2d42e802f873 Dec 09 21:35:39.469114 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ce24ad78-83d5-416a-a671-4963897d1c02 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:39.499997 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ce24ad78-83d5-416a-a671-4963897d1c02 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:39.507799 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ce24ad78-83d5-416a-a671-4963897d1c02 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:39.508481 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ce24ad78-83d5-416a-a671-4963897d1c02 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:39.539779 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdf17fa3-d854-4144-9a07-6fbf7ab19d33 req-cb4dd72a-341b-45e2-a72b-1bae76dc6ec4 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:39.541425 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fdf17fa3-d854-4144-9a07-6fbf7ab19d33 req-cb4dd72a-341b-45e2-a72b-1bae76dc6ec4 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0871742 Dec 09 21:35:39.585006 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ce24ad78-83d5-416a-a671-4963897d1c02 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 0.2507818 Dec 09 21:35:39.585296 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51550) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:39.590109 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-d13ba37f-0351-4568-92eb-f287706a2abb tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Request body: {'network': {'name': 'tempest-BulkNetworkOpsIpV6Test-test-network-1824053373'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:39.594739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce24ad78-83d5-416a-a671-4963897d1c02 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Pushing event updated for resources: {'Network': ['ID=0e07cdc1-0bba-47e5-862b-2d42e802f873,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:39.609074 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 0e07cdc1-0bba-47e5-862b-2d42e802f873 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:35:39.620743 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d13ba37f-0351-4568-92eb-f287706a2abb tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Made reservation on behalf of 0719b38b77e54a78a81bc92bc07b682c for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:39.626035 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d13ba37f-0351-4568-92eb-f287706a2abb tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:39.627250 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fdf17fa3-d854-4144-9a07-6fbf7ab19d33 req-e66f6091-fda2-4fe6-b879-7b7c511a90a7 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0786810 Dec 09 21:35:39.664159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d13ba37f-0351-4568-92eb-f287706a2abb tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] vlan segment allocate from pool success with {'vlan_id': 130, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:35:39.680108 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d13ba37f-0351-4568-92eb-f287706a2abb tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:39.680794 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-d13ba37f-0351-4568-92eb-f287706a2abb tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Added segment 9b3e6e6b-d750-41b0-b9c7-ee98b7ace662 of type vlan for network c88f1a8b-5156-45f3-acb6-ac02900a7273 Dec 09 21:35:39.709323 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:39.732506 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d13ba37f-0351-4568-92eb-f287706a2abb tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:39.756660 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d13ba37f-0351-4568-92eb-f287706a2abb tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:39.762255 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d13ba37f-0351-4568-92eb-f287706a2abb tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:39.762861 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d13ba37f-0351-4568-92eb-f287706a2abb tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:39.798118 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d13ba37f-0351-4568-92eb-f287706a2abb tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 0.2117920 Dec 09 21:35:39.835896 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d13ba37f-0351-4568-92eb-f287706a2abb tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Pushing event updated for resources: {'Network': ['ID=c88f1a8b-5156-45f3-acb6-ac02900a7273,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:39.847214 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network c88f1a8b-5156-45f3-acb6-ac02900a7273 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:35:39.947956 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54920ad2-1c3c-4d6b-af8c-46b567ae3757 req-8d694375-1afa-450b-af72-feeca661077d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:39.949564 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-54920ad2-1c3c-4d6b-af8c-46b567ae3757 req-8d694375-1afa-450b-af72-feeca661077d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 943 time: 0.0559657 Dec 09 21:35:39.995982 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-54920ad2-1c3c-4d6b-af8c-46b567ae3757 req-87166055-d251-4b0d-a922-eafed8a35826 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402842 Dec 09 21:35:40.369968 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7b1c45c-5d24-4ccf-813b-6bebf1557858 req-e3b6eaa7-c13a-451e-a67e-7cd5b7587e46 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:40.371493 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c7b1c45c-5d24-4ccf-813b-6bebf1557858 req-e3b6eaa7-c13a-451e-a67e-7cd5b7587e46 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 1098 time: 0.0417309 Dec 09 21:35:40.421102 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c7b1c45c-5d24-4ccf-813b-6bebf1557858 req-1dab6c31-4bd5-4189-b605-83df76600d56 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394943 Dec 09 21:35:40.745154 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fafe823-2fbc-4537-9cae-a503ae65c059 req-8aa78c1c-bb8e-4be9-a2f0-4ee71adaa16f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:40.746668 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6fafe823-2fbc-4537-9cae-a503ae65c059 req-8aa78c1c-bb8e-4be9-a2f0-4ee71adaa16f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0507460 Dec 09 21:35:40.798857 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6fafe823-2fbc-4537-9cae-a503ae65c059 req-25d3baea-61bc-47b9-bde8-fd295814605c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462046 Dec 09 21:35:41.124471 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-846ec1e4-3edd-4364-b7b3-30bb97bb2a8d req-55f4b189-0946-49dc-88d6-c10e27c6ebd9 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:41.125926 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-846ec1e4-3edd-4364-b7b3-30bb97bb2a8d req-55f4b189-0946-49dc-88d6-c10e27c6ebd9 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 943 time: 0.0531635 Dec 09 21:35:41.175532 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-846ec1e4-3edd-4364-b7b3-30bb97bb2a8d req-a0a9b576-018c-42e0-9453-3074cae3b7b7 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430734 Dec 09 21:35:41.932525 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcc68f4a-d94a-47d1-85c0-8494bbd05909 req-f266dc74-130b-4f78-a403-0c429e3582bd tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:41.934150 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bcc68f4a-d94a-47d1-85c0-8494bbd05909 req-f266dc74-130b-4f78-a403-0c429e3582bd tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0584819 Dec 09 21:35:41.986690 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bcc68f4a-d94a-47d1-85c0-8494bbd05909 req-f54e80fc-2caf-4bf6-aac3-f1ead507e3e3 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451660 Dec 09 21:35:42.309060 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2527e45-631e-4414-a9f3-d935397d031b req-0727bd0c-f9aa-4448-ba73-2dd7653cd10e tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:42.310592 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b2527e45-631e-4414-a9f3-d935397d031b req-0727bd0c-f9aa-4448-ba73-2dd7653cd10e tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 943 time: 0.0570352 Dec 09 21:35:42.363336 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b2527e45-631e-4414-a9f3-d935397d031b req-a658f4fc-98ed-4664-a613-65095963267e tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440950 Dec 09 21:35:43.041354 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51618) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:43.046699 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-50774bd6-bd19-472c-a9d1-0b996fb161cf tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Request body: {'subnets': [{'network_id': '0e07cdc1-0bba-47e5-862b-2d42e802f873', 'cidr': '2001:db8::/64', 'name': 'tempest-subnet--1914896216', 'ip_version': 6}, {'network_id': 'c88f1a8b-5156-45f3-acb6-ac02900a7273', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6}]} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:43.047027 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-50774bd6-bd19-472c-a9d1-0b996fb161cf tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Request body: {'subnet': {'network_id': '0e07cdc1-0bba-47e5-862b-2d42e802f873', 'cidr': '2001:db8::/64', 'name': 'tempest-subnet--1914896216', 'ip_version': 6}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:43.047724 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-50774bd6-bd19-472c-a9d1-0b996fb161cf tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Request body: {'subnet': {'network_id': 'c88f1a8b-5156-45f3-acb6-ac02900a7273', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:43.190811 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2248dc2f-2504-48da-82cc-56432d36f3ff req-9debf1ef-2e21-45b8-a9a0-78322e072ea3 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:43.192309 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2248dc2f-2504-48da-82cc-56432d36f3ff req-9debf1ef-2e21-45b8-a9a0-78322e072ea3 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.1180685 Dec 09 21:35:43.278244 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2248dc2f-2504-48da-82cc-56432d36f3ff req-a20c8b52-face-4c23-be2f-5a68c423ba12 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0620499 Dec 09 21:35:43.279340 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-50774bd6-bd19-472c-a9d1-0b996fb161cf tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Made reservation on behalf of 0719b38b77e54a78a81bc92bc07b682c for: {'subnet': 2} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:43.283703 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-50774bd6-bd19-472c-a9d1-0b996fb161cf tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:43.284039 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-50774bd6-bd19-472c-a9d1-0b996fb161cf tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:43.425336 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20287181-2af5-4156-9f14-9cbba532e553 req-0b997bb6-d70c-489d-8bdf-6368bcfa151f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:43.426817 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20287181-2af5-4156-9f14-9cbba532e553 req-0b997bb6-d70c-489d-8bdf-6368bcfa151f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0720849 Dec 09 21:35:43.561619 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20287181-2af5-4156-9f14-9cbba532e553 req-4b6c6fd0-0861-4a59-b0ef-cd277a3348b6 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1093976 Dec 09 21:35:43.581412 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1b71016-e484-416f-89b9-2c02d68d93e2 req-c9740860-62d5-42ae-83a0-c97c0aa122ad tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:43.590492 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d1b71016-e484-416f-89b9-2c02d68d93e2 req-c9740860-62d5-42ae-83a0-c97c0aa122ad tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 943 time: 0.1319478 Dec 09 21:35:43.724474 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d1b71016-e484-416f-89b9-2c02d68d93e2 req-02510fa3-3ef9-48e3-877c-c3e672134d2c tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1310368 Dec 09 21:35:43.732136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 851ff09f-496e-47bd-85bb-2e21622a44e9 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:35:43.761334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcf40115-cc32-43c5-95ca-0ea2542b02b8 req-b49ec060-f725-4013-8e6f-797bb0566935 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:43.762862 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fcf40115-cc32-43c5-95ca-0ea2542b02b8 req-b49ec060-f725-4013-8e6f-797bb0566935 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.1115153 Dec 09 21:35:43.844940 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 851ff09f-496e-47bd-85bb-2e21622a44e9, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=851ff09f-496e-47bd-85bb-2e21622a44e9,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:35:43.856691 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '851ff09f-496e-47bd-85bb-2e21622a44e9', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'port_id': '851ff09f-496e-47bd-85bb-2e21622a44e9', 'mac_address': 'fa:16:3e:bb:5d:d2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:35:43.868807 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fcf40115-cc32-43c5-95ca-0ea2542b02b8 req-1190518e-2492-4560-96f8-166f9bec4225 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0795305 Dec 09 21:35:43.891573 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-50774bd6-bd19-472c-a9d1-0b996fb161cf tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:43.899214 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:43.915798 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 851ff09f-496e-47bd-85bb-2e21622a44e9 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:35:43.943053 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 851ff09f-496e-47bd-85bb-2e21622a44e9, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=851ff09f-496e-47bd-85bb-2e21622a44e9,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:35:43.948930 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:43.991231 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50774bd6-bd19-472c-a9d1-0b996fb161cf tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Pushing event updated for resources: {'Subnet': ['ID=c6b67af7-324e-4149-97e8-d169f3894559,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:44.008852 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=851ff09f-496e-47bd-85bb-2e21622a44e9,revision_number=9']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:44.021600 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-50774bd6-bd19-472c-a9d1-0b996fb161cf tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Checking segment: {'id': '3fb27ce2-b460-4629-b9e1-4927411473e2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '0e07cdc1-0bba-47e5-862b-2d42e802f873'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:35:44.021962 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-50774bd6-bd19-472c-a9d1-0b996fb161cf tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Network hostable DHCP agents. Network: 0e07cdc1-0bba-47e5-862b-2d42e802f873, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:35:44.053097 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ef0bdf-940f-4765-8f5a-dfcd93fe4c1e req-99dd6f69-a437-42b0-b85b-b371b296db9c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:44.054608 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-23ef0bdf-940f-4765-8f5a-dfcd93fe4c1e req-99dd6f69-a437-42b0-b85b-b371b296db9c tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0896254 Dec 09 21:35:44.055672 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-50774bd6-bd19-472c-a9d1-0b996fb161cf tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Network 0e07cdc1-0bba-47e5-862b-2d42e802f873 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:35:44.069294 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-50774bd6-bd19-472c-a9d1-0b996fb161cf tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 0e07cdc1-0bba-47e5-862b-2d42e802f873) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:44.069963 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:35:44.074453 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-50774bd6-bd19-472c-a9d1-0b996fb161cf tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:44.078381 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f0552445-0e67-4865-999f-5b8a64e23b8e None None] Network 0e07cdc1-0bba-47e5-862b-2d42e802f873 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:35:44.162600 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-23ef0bdf-940f-4765-8f5a-dfcd93fe4c1e req-4c64a0bb-eeb4-4ac4-94a7-50cd7d4aa0d4 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1015964 Dec 09 21:35:44.168654 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50774bd6-bd19-472c-a9d1-0b996fb161cf tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Pushing event updated for resources: {'Subnet': ['ID=28a76e6c-fe9b-4c09-8fd6-9ac58503fedf,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:44.183356 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['851ff09f-496e-47bd-85bb-2e21622a44e9'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:35:44.183634 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-50774bd6-bd19-472c-a9d1-0b996fb161cf tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Checking segment: {'id': '9b3e6e6b-d750-41b0-b9c7-ee98b7ace662', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'c88f1a8b-5156-45f3-acb6-ac02900a7273'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:35:44.184081 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-50774bd6-bd19-472c-a9d1-0b996fb161cf tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Network hostable DHCP agents. Network: c88f1a8b-5156-45f3-acb6-ac02900a7273, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:35:44.194301 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-92c3b5ba-75f0-4c83-b788-ea245a344ab8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-0e07cdc1-0bba-47e5-862b-2d42e802f873', 'network_id': '0e07cdc1-0bba-47e5-862b-2d42e802f873', 'project_id': '0719b38b77e54a78a81bc92bc07b682c', 'fixed_ips': [{'subnet_id': 'c6b67af7-324e-4149-97e8-d169f3894559'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:35:44.196357 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-92c3b5ba-75f0-4c83-b788-ea245a344ab8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:44.209214 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-50774bd6-bd19-472c-a9d1-0b996fb161cf tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Network c88f1a8b-5156-45f3-acb6-ac02900a7273 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:35:44.222387 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-50774bd6-bd19-472c-a9d1-0b996fb161cf tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, c88f1a8b-5156-45f3-acb6-ac02900a7273) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:44.229451 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-50774bd6-bd19-472c-a9d1-0b996fb161cf tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:44.229970 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-50774bd6-bd19-472c-a9d1-0b996fb161cf tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:44.230659 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-50774bd6-bd19-472c-a9d1-0b996fb161cf tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:44.233919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85be3c93-072d-4104-8e12-cf183a3af4d8 None None] Network c88f1a8b-5156-45f3-acb6-ac02900a7273 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:35:44.255754 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51640) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:44.256422 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-50774bd6-bd19-472c-a9d1-0b996fb161cf tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 1476 time: 1.2133160 Dec 09 21:35:44.308728 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60dff814-db1c-4c06-a10d-c3294e82ae0a req-c6cb4143-1b84-4aca-a2fd-3bc3d8bcce45 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:44.310384 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60dff814-db1c-4c06-a10d-c3294e82ae0a req-c6cb4143-1b84-4aca-a2fd-3bc3d8bcce45 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0533233 Dec 09 21:35:44.359746 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42ce571a-c1b9-4c8d-a227-ceafc507cb2b tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:44.362469 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42ce571a-c1b9-4c8d-a227-ceafc507cb2b tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:44.364585 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42ce571a-c1b9-4c8d-a227-ceafc507cb2b tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:44.365990 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60dff814-db1c-4c06-a10d-c3294e82ae0a req-23a0aa3c-69c0-49f8-9700-f2dde8b1c6c1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0487058 Dec 09 21:35:44.366634 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-42ce571a-c1b9-4c8d-a227-ceafc507cb2b tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2102 time: 0.1085949 Dec 09 21:35:44.376217 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51642) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:44.447923 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-1c8db632-e625-4c50-838f-07b50ac15280 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Deleting subnet c6b67af7-324e-4149-97e8-d169f3894559 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:35:44.481002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-767711aa-58ab-4def-82b5-8335e7be5bf7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-c88f1a8b-5156-45f3-acb6-ac02900a7273', 'network_id': 'c88f1a8b-5156-45f3-acb6-ac02900a7273', 'project_id': '0719b38b77e54a78a81bc92bc07b682c', 'fixed_ips': [{'subnet_id': '28a76e6c-fe9b-4c09-8fd6-9ac58503fedf'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:35:44.481972 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-767711aa-58ab-4def-82b5-8335e7be5bf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:44.511052 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1ca2199-583a-4d5a-b1ba-c73536491bed req-b694f05e-3b6c-44f4-91ad-3fdf0381ee29 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:44.511988 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-92c3b5ba-75f0-4c83-b788-ea245a344ab8 None None] Allocated IP 2001:db8::1 (0e07cdc1-0bba-47e5-862b-2d42e802f873/c6b67af7-324e-4149-97e8-d169f3894559/64f95379-0d01-4b40-ba49-2ce5e5ddb9a7) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:35:44.512561 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f1ca2199-583a-4d5a-b1ba-c73536491bed req-b694f05e-3b6c-44f4-91ad-3fdf0381ee29 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0519497 Dec 09 21:35:44.562945 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f1ca2199-583a-4d5a-b1ba-c73536491bed req-f09aafeb-7690-44e3-9069-400a398562a8 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432210 Dec 09 21:35:44.686505 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18b45ec9-01bb-4bcc-a052-7ed568404d26 req-75b4f41b-5eb5-4bde-95fb-af5006fe4202 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:44.688014 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-18b45ec9-01bb-4bcc-a052-7ed568404d26 req-75b4f41b-5eb5-4bde-95fb-af5006fe4202 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0511277 Dec 09 21:35:44.741489 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-18b45ec9-01bb-4bcc-a052-7ed568404d26 req-c9782f5a-7147-4068-a6aa-b3a44f249d63 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0472107 Dec 09 21:35:44.745821 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-767711aa-58ab-4def-82b5-8335e7be5bf7 None None] Allocated IP 2001:db8:0:1::1 (c88f1a8b-5156-45f3-acb6-ac02900a7273/28a76e6c-fe9b-4c09-8fd6-9ac58503fedf/2cddd9a8-2c42-4329-b75c-fec39693a222) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:35:44.824651 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-92c3b5ba-75f0-4c83-b788-ea245a344ab8 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:44.846397 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1c8db632-e625-4c50-838f-07b50ac15280 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:44.857900 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-92c3b5ba-75f0-4c83-b788-ea245a344ab8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:44.898748 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c29efe6-c226-4d3f-816d-3759cf959277 req-1ce735fd-1a16-4acd-bf23-9574ee93c2ba tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:44.900674 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c29efe6-c226-4d3f-816d-3759cf959277 req-1ce735fd-1a16-4acd-bf23-9574ee93c2ba tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 944 time: 0.0873330 Dec 09 21:35:44.913880 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1c8db632-e625-4c50-838f-07b50ac15280 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:44.919575 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92c3b5ba-75f0-4c83-b788-ea245a344ab8 None None] Network 0e07cdc1-0bba-47e5-862b-2d42e802f873 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:35:44.926711 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92c3b5ba-75f0-4c83-b788-ea245a344ab8 None None] Pushing event updated for resources: {'Port': ['ID=64f95379-0d01-4b40-ba49-2ce5e5ddb9a7,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:44.929251 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-92c3b5ba-75f0-4c83-b788-ea245a344ab8 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:44.934128 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92c3b5ba-75f0-4c83-b788-ea245a344ab8 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:35:45.073337 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c29efe6-c226-4d3f-816d-3759cf959277 req-5f71464e-d8c7-4a89-80e8-562bb0607168 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1104777 Dec 09 21:35:45.117937 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1c8db632-e625-4c50-838f-07b50ac15280 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:45.162651 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-499e727a-f9e9-4b24-9ad2-42238b4ee77e req-0eefbd24-6120-46d7-ac07-9bb469e81a75 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:45.164909 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-499e727a-f9e9-4b24-9ad2-42238b4ee77e req-0eefbd24-6120-46d7-ac07-9bb469e81a75 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.1058345 Dec 09 21:35:45.191342 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-767711aa-58ab-4def-82b5-8335e7be5bf7 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:45.192656 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-92c3b5ba-75f0-4c83-b788-ea245a344ab8 None None] Attempting to bind port 64f95379-0d01-4b40-ba49-2ce5e5ddb9a7 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:35:45.192988 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-92c3b5ba-75f0-4c83-b788-ea245a344ab8 None None] Attempting to bind port 64f95379-0d01-4b40-ba49-2ce5e5ddb9a7 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '3fb27ce2-b460-4629-b9e1-4927411473e2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '0e07cdc1-0bba-47e5-862b-2d42e802f873'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:35:45.193342 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92c3b5ba-75f0-4c83-b788-ea245a344ab8 None None] Attempting to bind port 64f95379-0d01-4b40-ba49-2ce5e5ddb9a7 on network 0e07cdc1-0bba-47e5-862b-2d42e802f873 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:35:45.200497 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92c3b5ba-75f0-4c83-b788-ea245a344ab8 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 35, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:35:45.200948 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92c3b5ba-75f0-4c83-b788-ea245a344ab8 None None] Checking segment: {'id': '3fb27ce2-b460-4629-b9e1-4927411473e2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '0e07cdc1-0bba-47e5-862b-2d42e802f873'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:35:45.202043 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-92c3b5ba-75f0-4c83-b788-ea245a344ab8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:45.202043 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92c3b5ba-75f0-4c83-b788-ea245a344ab8 None None] Bound using segment: {'id': '3fb27ce2-b460-4629-b9e1-4927411473e2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '0e07cdc1-0bba-47e5-862b-2d42e802f873'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:35:45.202332 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-92c3b5ba-75f0-4c83-b788-ea245a344ab8 None None] Bound port: 64f95379-0d01-4b40-ba49-2ce5e5ddb9a7, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3fb27ce2-b460-4629-b9e1-4927411473e2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '0e07cdc1-0bba-47e5-862b-2d42e802f873'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:35:45.202728 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-92c3b5ba-75f0-4c83-b788-ea245a344ab8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:45.205575 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-767711aa-58ab-4def-82b5-8335e7be5bf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:45.242605 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1c8db632-e625-4c50-838f-07b50ac15280 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:45.253665 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-499e727a-f9e9-4b24-9ad2-42238b4ee77e req-218ebf65-20b3-40f0-926a-1512aaa24e69 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0766585 Dec 09 21:35:45.276541 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-767711aa-58ab-4def-82b5-8335e7be5bf7 None None] Network c88f1a8b-5156-45f3-acb6-ac02900a7273 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:35:45.285822 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-767711aa-58ab-4def-82b5-8335e7be5bf7 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:45.295405 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-767711aa-58ab-4def-82b5-8335e7be5bf7 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:35:45.306339 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-767711aa-58ab-4def-82b5-8335e7be5bf7 None None] Pushing event updated for resources: {'Port': ['ID=2cddd9a8-2c42-4329-b75c-fec39693a222,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:45.324779 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-92c3b5ba-75f0-4c83-b788-ea245a344ab8 None None] For port 64f95379-0d01-4b40-ba49-2ce5e5ddb9a7, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:35:45.328665 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-92c3b5ba-75f0-4c83-b788-ea245a344ab8 None None] For port 64f95379-0d01-4b40-ba49-2ce5e5ddb9a7, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=64f95379-0d01-4b40-ba49-2ce5e5ddb9a7,segment=NetworkSegment(3fb27ce2-b460-4629-b9e1-4927411473e2),segment_id=3fb27ce2-b460-4629-b9e1-4927411473e2)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:35:45.343972 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-92c3b5ba-75f0-4c83-b788-ea245a344ab8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:45.410802 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-767711aa-58ab-4def-82b5-8335e7be5bf7 None None] Attempting to bind port 2cddd9a8-2c42-4329-b75c-fec39693a222 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:35:45.411170 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-767711aa-58ab-4def-82b5-8335e7be5bf7 None None] Attempting to bind port 2cddd9a8-2c42-4329-b75c-fec39693a222 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '9b3e6e6b-d750-41b0-b9c7-ee98b7ace662', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'c88f1a8b-5156-45f3-acb6-ac02900a7273'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:35:45.411591 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-767711aa-58ab-4def-82b5-8335e7be5bf7 None None] Attempting to bind port 2cddd9a8-2c42-4329-b75c-fec39693a222 on network c88f1a8b-5156-45f3-acb6-ac02900a7273 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:35:45.450093 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-767711aa-58ab-4def-82b5-8335e7be5bf7 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 35, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:35:45.450471 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-767711aa-58ab-4def-82b5-8335e7be5bf7 None None] Checking segment: {'id': '9b3e6e6b-d750-41b0-b9c7-ee98b7ace662', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'c88f1a8b-5156-45f3-acb6-ac02900a7273'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:35:45.450881 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-767711aa-58ab-4def-82b5-8335e7be5bf7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:45.451270 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-767711aa-58ab-4def-82b5-8335e7be5bf7 None None] Bound using segment: {'id': '9b3e6e6b-d750-41b0-b9c7-ee98b7ace662', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'c88f1a8b-5156-45f3-acb6-ac02900a7273'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:35:45.451794 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-767711aa-58ab-4def-82b5-8335e7be5bf7 None None] Bound port: 2cddd9a8-2c42-4329-b75c-fec39693a222, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9b3e6e6b-d750-41b0-b9c7-ee98b7ace662', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'c88f1a8b-5156-45f3-acb6-ac02900a7273'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:35:45.452180 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-767711aa-58ab-4def-82b5-8335e7be5bf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:45.460586 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92c3b5ba-75f0-4c83-b788-ea245a344ab8 None None] Pushing event updated for resources: {'Port': ['ID=64f95379-0d01-4b40-ba49-2ce5e5ddb9a7,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:45.503480 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-08561af1-29d9-45af-901c-8c21755f3442 None None] Network 0e07cdc1-0bba-47e5-862b-2d42e802f873 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:35:45.587300 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c8db632-e625-4c50-838f-07b50ac15280 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Pushing event deleted for resources: {'Subnet': ['ID=c6b67af7-324e-4149-97e8-d169f3894559,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:45.591999 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1c8db632-e625-4c50-838f-07b50ac15280 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:45.597686 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1c8db632-e625-4c50-838f-07b50ac15280 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] 10.222.0.13 "DELETE /v2.0/subnets/c6b67af7-324e-4149-97e8-d169f3894559 HTTP/1.1" status: 204 len: 168 time: 1.2110832 Dec 09 21:35:45.598818 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51664) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:45.600939 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-767711aa-58ab-4def-82b5-8335e7be5bf7 None None] For port 2cddd9a8-2c42-4329-b75c-fec39693a222, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:35:45.615429 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-767711aa-58ab-4def-82b5-8335e7be5bf7 None None] For port 2cddd9a8-2c42-4329-b75c-fec39693a222, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2cddd9a8-2c42-4329-b75c-fec39693a222,segment=NetworkSegment(9b3e6e6b-d750-41b0-b9c7-ee98b7ace662),segment_id=9b3e6e6b-d750-41b0-b9c7-ee98b7ace662)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:35:45.623762 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-767711aa-58ab-4def-82b5-8335e7be5bf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:45.650423 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6df35e6-a5e7-48b0-8316-5ff9aa387cbc req-b6dd8717-3b6e-4ab4-b6a4-711d8bcb97fc tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:45.656366 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6df35e6-a5e7-48b0-8316-5ff9aa387cbc req-b6dd8717-3b6e-4ab4-b6a4-711d8bcb97fc tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:45.662592 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6df35e6-a5e7-48b0-8316-5ff9aa387cbc req-b6dd8717-3b6e-4ab4-b6a4-711d8bcb97fc tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:45.668625 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6df35e6-a5e7-48b0-8316-5ff9aa387cbc req-b6dd8717-3b6e-4ab4-b6a4-711d8bcb97fc tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:45.674633 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6df35e6-a5e7-48b0-8316-5ff9aa387cbc req-b6dd8717-3b6e-4ab4-b6a4-711d8bcb97fc tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:45.680660 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6df35e6-a5e7-48b0-8316-5ff9aa387cbc req-b6dd8717-3b6e-4ab4-b6a4-711d8bcb97fc tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:45.684320 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-767711aa-58ab-4def-82b5-8335e7be5bf7 None None] Pushing event updated for resources: {'Port': ['ID=2cddd9a8-2c42-4329-b75c-fec39693a222,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:45.686863 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6df35e6-a5e7-48b0-8316-5ff9aa387cbc req-b6dd8717-3b6e-4ab4-b6a4-711d8bcb97fc tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:45.691969 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a6df35e6-a5e7-48b0-8316-5ff9aa387cbc req-b6dd8717-3b6e-4ab4-b6a4-711d8bcb97fc tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5434 time: 0.4660101 Dec 09 21:35:45.720008 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-864ce912-103e-4c63-b826-1bf3b91f9631 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Deleting subnet 28a76e6c-fe9b-4c09-8fd6-9ac58503fedf {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:35:45.726400 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-864ce912-103e-4c63-b826-1bf3b91f9631 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:45.731151 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 851ff09f-496e-47bd-85bb-2e21622a44e9 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:35:45.782271 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 851ff09f-496e-47bd-85bb-2e21622a44e9 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:45.782940 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:45.796745 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-864ce912-103e-4c63-b826-1bf3b91f9631 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:45.828481 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a6df35e6-a5e7-48b0-8316-5ff9aa387cbc req-04eddd25-6d72-43e9-bb17-f640eb729dd8 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1325228 Dec 09 21:35:45.901274 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:45.940739 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '91b064ae-1ca1-44d4-a549-a25cccd0c81b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '851ff09f-496e-47bd-85bb-2e21622a44e9'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:35:45.941262 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-864ce912-103e-4c63-b826-1bf3b91f9631 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:45.943116 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-27e65710-9685-4804-b260-ca9ab6fbd3ed" -d '{"events": [{"server_uuid": "91b064ae-1ca1-44d4-a549-a25cccd0c81b", "name": "network-vif-plugged", "status": "completed", "tag": "851ff09f-496e-47bd-85bb-2e21622a44e9"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:35:45.970660 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 851ff09f-496e-47bd-85bb-2e21622a44e9, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=851ff09f-496e-47bd-85bb-2e21622a44e9,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:35:45.979942 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:46.010829 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:35:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-da667594-f6a2-4b89-b0e1-82f13d8d332d x-openstack-request-id: req-da667594-f6a2-4b89-b0e1-82f13d8d332d {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:35:46.011235 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "91b064ae-1ca1-44d4-a549-a25cccd0c81b", "name": "network-vif-plugged", "status": "completed", "tag": "851ff09f-496e-47bd-85bb-2e21622a44e9", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:35:46.011380 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-da667594-f6a2-4b89-b0e1-82f13d8d332d {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:35:46.011809 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '91b064ae-1ca1-44d4-a549-a25cccd0c81b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '851ff09f-496e-47bd-85bb-2e21622a44e9', 'code': 200} Dec 09 21:35:46.051995 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=851ff09f-496e-47bd-85bb-2e21622a44e9,revision_number=10']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:46.063822 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1836bf93-e24b-429b-97f9-2eddedd7ae42 req-8f86c4d4-a9d5-4a8c-aefb-4cfd3ddd23e2 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:46.069988 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1836bf93-e24b-429b-97f9-2eddedd7ae42 req-8f86c4d4-a9d5-4a8c-aefb-4cfd3ddd23e2 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:46.077256 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1836bf93-e24b-429b-97f9-2eddedd7ae42 req-8f86c4d4-a9d5-4a8c-aefb-4cfd3ddd23e2 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:46.083461 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1836bf93-e24b-429b-97f9-2eddedd7ae42 req-8f86c4d4-a9d5-4a8c-aefb-4cfd3ddd23e2 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:46.090204 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1836bf93-e24b-429b-97f9-2eddedd7ae42 req-8f86c4d4-a9d5-4a8c-aefb-4cfd3ddd23e2 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:46.096140 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1836bf93-e24b-429b-97f9-2eddedd7ae42 req-8f86c4d4-a9d5-4a8c-aefb-4cfd3ddd23e2 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:46.102046 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1836bf93-e24b-429b-97f9-2eddedd7ae42 req-8f86c4d4-a9d5-4a8c-aefb-4cfd3ddd23e2 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:46.104887 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1836bf93-e24b-429b-97f9-2eddedd7ae42 req-8f86c4d4-a9d5-4a8c-aefb-4cfd3ddd23e2 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5434 time: 0.1338570 Dec 09 21:35:46.119054 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-864ce912-103e-4c63-b826-1bf3b91f9631 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:46.151208 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-864ce912-103e-4c63-b826-1bf3b91f9631 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Pushing event deleted for resources: {'Subnet': ['ID=28a76e6c-fe9b-4c09-8fd6-9ac58503fedf,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:46.153325 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-864ce912-103e-4c63-b826-1bf3b91f9631 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:46.156607 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-864ce912-103e-4c63-b826-1bf3b91f9631 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] 10.222.0.13 "DELETE /v2.0/subnets/28a76e6c-fe9b-4c09-8fd6-9ac58503fedf HTTP/1.1" status: 204 len: 168 time: 0.5576301 Dec 09 21:35:46.159138 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51674) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:46.183151 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd4bccf3-d528-4631-b884-70dcc6d007af req-40bb6a1e-641c-42dc-90c9-079a28d0a6c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:46.184788 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd4bccf3-d528-4631-b884-70dcc6d007af req-40bb6a1e-641c-42dc-90c9-079a28d0a6c2 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 1098 time: 0.0441658 Dec 09 21:35:46.235092 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd4bccf3-d528-4631-b884-70dcc6d007af req-29784b8b-7fea-40de-880b-af1bb739eebd service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419421 Dec 09 21:35:46.281074 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9db40d57-f951-463a-ab55-27310ce53f80 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:46.282543 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9db40d57-f951-463a-ab55-27310ce53f80 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1219480 Dec 09 21:35:46.286345 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51680) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:46.296264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37fa41ed-f466-4bd3-88bf-597c7ad408cf req-2e8d307c-9728-4327-9c82-bad070467513 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:46.299560 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-37fa41ed-f466-4bd3-88bf-597c7ad408cf req-2e8d307c-9728-4327-9c82-bad070467513 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 946 time: 0.1134546 Dec 09 21:35:46.371922 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-37fa41ed-f466-4bd3-88bf-597c7ad408cf req-3aa182c4-f113-4513-9859-d35f39af4083 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0669758 Dec 09 21:35:46.377666 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6cc70a8-b077-4c6b-af71-f11bb027e134 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:46.392691 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc4f22d0-d49f-433f-b26d-9f8a493c0d10 req-873df6e1-cffa-434f-b5c8-2f3391a32599 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:46.394381 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc4f22d0-d49f-433f-b26d-9f8a493c0d10 req-873df6e1-cffa-434f-b5c8-2f3391a32599 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0611038 Dec 09 21:35:46.438973 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c6cc70a8-b077-4c6b-af71-f11bb027e134 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Deleting port 2cddd9a8-2c42-4329-b75c-fec39693a222 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:35:46.439572 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6cc70a8-b077-4c6b-af71-f11bb027e134 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:46.454139 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc4f22d0-d49f-433f-b26d-9f8a493c0d10 req-775daa45-9b7e-46d6-86a4-67569de1ef2a tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0526512 Dec 09 21:35:46.525651 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-c6cc70a8-b077-4c6b-af71-f11bb027e134 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] For port 2cddd9a8-2c42-4329-b75c-fec39693a222, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2cddd9a8-2c42-4329-b75c-fec39693a222,segment=NetworkSegment(9b3e6e6b-d750-41b0-b9c7-ee98b7ace662),segment_id=9b3e6e6b-d750-41b0-b9c7-ee98b7ace662)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:35:46.526437 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6cc70a8-b077-4c6b-af71-f11bb027e134 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:46.541139 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c6cc70a8-b077-4c6b-af71-f11bb027e134 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Calling delete_port for 2cddd9a8-2c42-4329-b75c-fec39693a222 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:35:46.632981 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6cc70a8-b077-4c6b-af71-f11bb027e134 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:46.665512 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6cc70a8-b077-4c6b-af71-f11bb027e134 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Pushing event deleted for resources: {'Port': ['ID=2cddd9a8-2c42-4329-b75c-fec39693a222,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:46.673126 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6cc70a8-b077-4c6b-af71-f11bb027e134 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] No DVR routers for this DVR port 2cddd9a8-2c42-4329-b75c-fec39693a222 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:35:46.784511 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad64ef86-9557-461a-a671-87badf31fea2 req-a77c1b48-8e08-4314-9580-8e9fdf2bbc53 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:46.786165 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ad64ef86-9557-461a-a671-87badf31fea2 req-a77c1b48-8e08-4314-9580-8e9fdf2bbc53 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0861995 Dec 09 21:35:46.797558 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6cc70a8-b077-4c6b-af71-f11bb027e134 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:46.824576 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-c6cc70a8-b077-4c6b-af71-f11bb027e134 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c88f1a8b-5156-45f3-acb6-ac02900a7273']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:46.835663 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bb36747-7498-4d29-ac22-20899825b5c7 req-8fb450a7-9e94-4b49-904a-a0d64c7cca86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:46.837206 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5bb36747-7498-4d29-ac22-20899825b5c7 req-8fb450a7-9e94-4b49-904a-a0d64c7cca86 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=b65669b5d4924ee090e9583aa839a399&device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 1098 time: 0.0975223 Dec 09 21:35:46.839601 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-c6cc70a8-b077-4c6b-af71-f11bb027e134 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9b3e6e6b-d750-41b0-b9c7-ee98b7ace662') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:46.840243 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-c6cc70a8-b077-4c6b-af71-f11bb027e134 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9b3e6e6b-d750-41b0-b9c7-ee98b7ace662') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:46.848582 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a15d687f-7fb2-44ef-8f90-1b06d360ba5a None None] Network c88f1a8b-5156-45f3-acb6-ac02900a7273 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:35:46.852108 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ad64ef86-9557-461a-a671-87badf31fea2 req-4b3fe188-dd7f-492d-8fcb-e416ba7cbae9 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0539777 Dec 09 21:35:46.863759 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6cc70a8-b077-4c6b-af71-f11bb027e134 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:46.895788 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6cc70a8-b077-4c6b-af71-f11bb027e134 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:46.933153 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c6cc70a8-b077-4c6b-af71-f11bb027e134 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Releasing vlan 130 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:35:46.933444 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6cc70a8-b077-4c6b-af71-f11bb027e134 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:35:46.937028 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:35:46.942473 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9304a574-b8b5-4904-82a7-01d473c23b7b None None] Could not find standard attr ID for object 2cddd9a8-2c42-4329-b75c-fec39693a222. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:35:46.988807 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9f27ca83-1694-4c34-aca7-2608238c509c None None] DHCP port deletion for c88f1a8b-5156-45f3-acb6-ac02900a7273 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:35:47.009920 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a6e50149-565f-4b5e-898d-7c14f340be5c None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 21:35:47.012419 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bb36747-7498-4d29-ac22-20899825b5c7 req-51cbc4ee-a372-495a-a29d-29757182c953 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:47.013973 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5bb36747-7498-4d29-ac22-20899825b5c7 req-51cbc4ee-a372-495a-a29d-29757182c953 service neutron] 10.222.0.31 "GET /v2.0/networks?id=88af5e51-6d1a-432d-8676-517f449774a3 HTTP/1.1" status: 200 len: 913 time: 0.1665282 Dec 09 21:35:47.018007 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6cc70a8-b077-4c6b-af71-f11bb027e134 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:47.027520 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6cc70a8-b077-4c6b-af71-f11bb027e134 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:47.031065 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c6cc70a8-b077-4c6b-af71-f11bb027e134 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] 10.222.0.13 "DELETE /v2.0/networks/c88f1a8b-5156-45f3-acb6-ac02900a7273 HTTP/1.1" status: 204 len: 168 time: 0.7426991 Dec 09 21:35:47.033808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51690) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:47.079704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6cc70a8-b077-4c6b-af71-f11bb027e134 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Pushing event deleted for resources: {'Network': ['ID=c88f1a8b-5156-45f3-acb6-ac02900a7273,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:47.082923 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5bb36747-7498-4d29-ac22-20899825b5c7 req-b53b93d0-5542-4177-ad32-3bc9c41f5913 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=1e54159e-3c83-49a1-a5b5-3e2b29336c43 HTTP/1.1" status: 200 len: 217 time: 0.0567272 Dec 09 21:35:47.123000 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e4f0cb9d-ac8d-46d5-b8f1-b1f164f6b967 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:47.138823 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bb36747-7498-4d29-ac22-20899825b5c7 req-9f8845e9-8ddc-4ed5-bb77-58e3333fc5c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:47.140377 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5bb36747-7498-4d29-ac22-20899825b5c7 req-9f8845e9-8ddc-4ed5-bb77-58e3333fc5c4 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=4700ee88-1952-42ab-9242-d93b9f07f2be HTTP/1.1" status: 200 len: 852 time: 0.0467069 Dec 09 21:35:47.169229 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a6e50149-565f-4b5e-898d-7c14f340be5c None None] Resources bound (agent type, host, resource id): {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 09 21:35:47.175188 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5bb36747-7498-4d29-ac22-20899825b5c7 req-ef019d5d-3e80-466c-957c-e5e74d9e4ded service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=88af5e51-6d1a-432d-8676-517f449774a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0260434 Dec 09 21:35:47.179484 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-e4f0cb9d-ac8d-46d5-b8f1-b1f164f6b967 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Deleting port 64f95379-0d01-4b40-ba49-2ce5e5ddb9a7 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:35:47.179861 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e4f0cb9d-ac8d-46d5-b8f1-b1f164f6b967 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:47.262695 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-e4f0cb9d-ac8d-46d5-b8f1-b1f164f6b967 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] For port 64f95379-0d01-4b40-ba49-2ce5e5ddb9a7, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=64f95379-0d01-4b40-ba49-2ce5e5ddb9a7,segment=NetworkSegment(3fb27ce2-b460-4629-b9e1-4927411473e2),segment_id=3fb27ce2-b460-4629-b9e1-4927411473e2)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:35:47.263361 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e4f0cb9d-ac8d-46d5-b8f1-b1f164f6b967 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:47.281441 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-e4f0cb9d-ac8d-46d5-b8f1-b1f164f6b967 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Calling delete_port for 64f95379-0d01-4b40-ba49-2ce5e5ddb9a7 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:35:47.286627 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5bb36747-7498-4d29-ac22-20899825b5c7 req-3b673290-5a6c-47a0-9223-ee6ab93c8fa1 service neutron] 10.222.0.31 "GET /v2.0/networks/88af5e51-6d1a-432d-8676-517f449774a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1022594 Dec 09 21:35:47.390650 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e4f0cb9d-ac8d-46d5-b8f1-b1f164f6b967 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:47.405352 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4f0cb9d-ac8d-46d5-b8f1-b1f164f6b967 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] No DVR routers for this DVR port 64f95379-0d01-4b40-ba49-2ce5e5ddb9a7 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:35:47.417997 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5bb36747-7498-4d29-ac22-20899825b5c7 req-c75cf9b2-369f-4b66-a303-e15e11e4237a service neutron] 10.222.0.31 "GET /v2.0/networks/88af5e51-6d1a-432d-8676-517f449774a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1152184 Dec 09 21:35:47.433035 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4f0cb9d-ac8d-46d5-b8f1-b1f164f6b967 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Pushing event deleted for resources: {'Port': ['ID=64f95379-0d01-4b40-ba49-2ce5e5ddb9a7,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:47.516639 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e4f0cb9d-ac8d-46d5-b8f1-b1f164f6b967 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:47.573557 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e4f0cb9d-ac8d-46d5-b8f1-b1f164f6b967 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0e07cdc1-0bba-47e5-862b-2d42e802f873']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:47.586714 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e4f0cb9d-ac8d-46d5-b8f1-b1f164f6b967 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3fb27ce2-b460-4629-b9e1-4927411473e2') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:47.587010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e4f0cb9d-ac8d-46d5-b8f1-b1f164f6b967 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3fb27ce2-b460-4629-b9e1-4927411473e2') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:47.599866 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e4f0cb9d-ac8d-46d5-b8f1-b1f164f6b967 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:47.620693 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b8c93bc-8d5a-4100-a0a5-c60a00a783bc req-52d5655b-977a-4f32-b029-fac551dd44c8 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:47.622181 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2b8c93bc-8d5a-4100-a0a5-c60a00a783bc req-52d5655b-977a-4f32-b029-fac551dd44c8 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 946 time: 0.1077099 Dec 09 21:35:47.623222 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e4f0cb9d-ac8d-46d5-b8f1-b1f164f6b967 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:47.630395 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e4f0cb9d-ac8d-46d5-b8f1-b1f164f6b967 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Releasing vlan 111 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:35:47.630783 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e4f0cb9d-ac8d-46d5-b8f1-b1f164f6b967 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:35:47.635140 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:35:47.669339 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7443e43d-ab56-47ba-b84e-73db7332c6b4 None None] Provisioning complete for port 1e54159e-3c83-49a1-a5b5-3e2b29336c43 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:47.669777 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7443e43d-ab56-47ba-b84e-73db7332c6b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:47.717999 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e4f0cb9d-ac8d-46d5-b8f1-b1f164f6b967 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:47.725821 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e4f0cb9d-ac8d-46d5-b8f1-b1f164f6b967 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:47.731676 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51730) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:47.731883 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e4f0cb9d-ac8d-46d5-b8f1-b1f164f6b967 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] 10.222.0.13 "DELETE /v2.0/networks/0e07cdc1-0bba-47e5-862b-2d42e802f873 HTTP/1.1" status: 204 len: 168 time: 0.6967983 Dec 09 21:35:47.757066 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2b8c93bc-8d5a-4100-a0a5-c60a00a783bc req-e2e092a9-57e1-4b01-97fb-e149ef1cfabd tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1256483 Dec 09 21:35:47.758558 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4f0cb9d-ac8d-46d5-b8f1-b1f164f6b967 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Pushing event deleted for resources: {'Network': ['ID=0e07cdc1-0bba-47e5-862b-2d42e802f873,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:48.026452 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ada2b513-43e0-4b18-ad80-3ba4514c08ff req-01d3dff2-a6b2-4bea-8575-10c022658871 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:48.028249 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ada2b513-43e0-4b18-ad80-3ba4514c08ff req-01d3dff2-a6b2-4bea-8575-10c022658871 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0860960 Dec 09 21:35:48.121376 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ada2b513-43e0-4b18-ad80-3ba4514c08ff req-ddcbd8ab-ce1d-4730-95b2-e04373555151 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0786223 Dec 09 21:35:48.247665 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d6a9e6d1-4d6d-41f4-ae26-a8d0c445d3b6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:48.325318 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51754) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:48.340380 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d6a9e6d1-4d6d-41f4-ae26-a8d0c445d3b6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:48.362345 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-d6a9e6d1-4d6d-41f4-ae26-a8d0c445d3b6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fe6813fe-21a7-4410-bf15-c47e4c407d26']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:48.376160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-d6a9e6d1-4d6d-41f4-ae26-a8d0c445d3b6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '16790b31-e175-4053-a460-69e1e4dedfd6') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:48.376462 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-d6a9e6d1-4d6d-41f4-ae26-a8d0c445d3b6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '16790b31-e175-4053-a460-69e1e4dedfd6') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:48.386752 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d6a9e6d1-4d6d-41f4-ae26-a8d0c445d3b6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:48.401386 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d6a9e6d1-4d6d-41f4-ae26-a8d0c445d3b6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:48.408473 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d6a9e6d1-4d6d-41f4-ae26-a8d0c445d3b6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Releasing vlan 134 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:35:48.408890 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d6a9e6d1-4d6d-41f4-ae26-a8d0c445d3b6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:35:48.412038 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:35:48.419210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3237769-de5a-4d17-b4a5-2a4a2971933e req-ad12a241-3dd3-478d-a177-beb80a3e409e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:48.419728 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3237769-de5a-4d17-b4a5-2a4a2971933e req-ad12a241-3dd3-478d-a177-beb80a3e409e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:48.420207 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3237769-de5a-4d17-b4a5-2a4a2971933e req-ad12a241-3dd3-478d-a177-beb80a3e409e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:48.420672 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3237769-de5a-4d17-b4a5-2a4a2971933e req-ad12a241-3dd3-478d-a177-beb80a3e409e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:48.421146 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3237769-de5a-4d17-b4a5-2a4a2971933e req-ad12a241-3dd3-478d-a177-beb80a3e409e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:48.421608 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3237769-de5a-4d17-b4a5-2a4a2971933e req-ad12a241-3dd3-478d-a177-beb80a3e409e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:48.422066 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3237769-de5a-4d17-b4a5-2a4a2971933e req-ad12a241-3dd3-478d-a177-beb80a3e409e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:48.424078 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3237769-de5a-4d17-b4a5-2a4a2971933e req-ad12a241-3dd3-478d-a177-beb80a3e409e service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 6498 time: 0.0976772 Dec 09 21:35:48.470252 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d6a9e6d1-4d6d-41f4-ae26-a8d0c445d3b6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:48.478812 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3237769-de5a-4d17-b4a5-2a4a2971933e req-02b2c442-b216-4b25-83d9-f12034106b66 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0483053 Dec 09 21:35:48.480021 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d6a9e6d1-4d6d-41f4-ae26-a8d0c445d3b6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:48.483674 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d6a9e6d1-4d6d-41f4-ae26-a8d0c445d3b6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] 10.222.0.13 "DELETE /v2.0/networks/fe6813fe-21a7-4410-bf15-c47e4c407d26 HTTP/1.1" status: 204 len: 168 time: 0.7504752 Dec 09 21:35:48.486346 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51760) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:48.495222 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6a9e6d1-4d6d-41f4-ae26-a8d0c445d3b6 tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Pushing event deleted for resources: {'Network': ['ID=fe6813fe-21a7-4410-bf15-c47e4c407d26,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:48.578083 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f7448fc-d20d-4359-b17a-71e726fd23ce tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:48.664434 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f7448fc-d20d-4359-b17a-71e726fd23ce tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:48.686377 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-2f7448fc-d20d-4359-b17a-71e726fd23ce tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f25c130c-a2ad-47e2-b0d4-935d44eef4e8']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:48.696026 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-2f7448fc-d20d-4359-b17a-71e726fd23ce tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ffd7a1cd-0251-43a6-8709-c844b5a89285') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:48.696332 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-2f7448fc-d20d-4359-b17a-71e726fd23ce tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ffd7a1cd-0251-43a6-8709-c844b5a89285') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:48.710509 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f7448fc-d20d-4359-b17a-71e726fd23ce tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:48.725069 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f7448fc-d20d-4359-b17a-71e726fd23ce tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:48.731863 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2f7448fc-d20d-4359-b17a-71e726fd23ce tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Releasing vlan 100 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:35:48.732252 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f7448fc-d20d-4359-b17a-71e726fd23ce tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:35:48.735245 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:35:48.800157 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f7448fc-d20d-4359-b17a-71e726fd23ce tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:48.808388 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f7448fc-d20d-4359-b17a-71e726fd23ce tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:48.811652 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2f7448fc-d20d-4359-b17a-71e726fd23ce tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] 10.222.0.13 "DELETE /v2.0/networks/f25c130c-a2ad-47e2-b0d4-935d44eef4e8 HTTP/1.1" status: 204 len: 168 time: 0.3242114 Dec 09 21:35:48.825719 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f7448fc-d20d-4359-b17a-71e726fd23ce tempest-BulkNetworkOpsIpV6Test-2068487983 tempest-BulkNetworkOpsIpV6Test-2068487983-project] Pushing event deleted for resources: {'Network': ['ID=f25c130c-a2ad-47e2-b0d4-935d44eef4e8,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:48.893616 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93c5fdd2-a4de-487e-9def-f5502919a943 req-775ddd1f-ab09-487e-9537-132674ab4c3e tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:48.895244 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-93c5fdd2-a4de-487e-9def-f5502919a943 req-775ddd1f-ab09-487e-9537-132674ab4c3e tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 946 time: 0.0503774 Dec 09 21:35:48.950147 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-93c5fdd2-a4de-487e-9def-f5502919a943 req-09b86487-1203-47a6-a771-3e1c8b2a2e50 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0478668 Dec 09 21:35:49.073690 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51776) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:49.260425 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-85109c5f-b867-4c56-8a6d-dfbeb3f601f4 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=0719b38b77e54a78a81bc92bc07b682c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1851571 Dec 09 21:35:49.263068 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51782) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:49.279316 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4786ff7c-c6cb-4e94-8ff0-f1cccbdd5ed1 req-0ff7f14f-ab24-4fc4-a573-396398315e12 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:49.280835 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4786ff7c-c6cb-4e94-8ff0-f1cccbdd5ed1 req-0ff7f14f-ab24-4fc4-a573-396398315e12 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0802808 Dec 09 21:35:49.353176 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fd7c5f03-a15c-4b16-90df-169d08dab3f4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:49.357456 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4786ff7c-c6cb-4e94-8ff0-f1cccbdd5ed1 req-b309551e-d8bd-4017-bb70-eff246281f69 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0693638 Dec 09 21:35:49.378006 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fd7c5f03-a15c-4b16-90df-169d08dab3f4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:49.439386 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fd7c5f03-a15c-4b16-90df-169d08dab3f4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:49.442113 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fd7c5f03-a15c-4b16-90df-169d08dab3f4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:49.443248 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fd7c5f03-a15c-4b16-90df-169d08dab3f4 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/f29693be-ae57-4c5c-93be-0dc3b17562e0 HTTP/1.1" status: 204 len: 168 time: 0.1792514 Dec 09 21:35:49.476340 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd7c5f03-a15c-4b16-90df-169d08dab3f4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f29693be-ae57-4c5c-93be-0dc3b17562e0,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:49.498288 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fb9c94d-47d5-4ef4-a5f8-d31a284eb87f req-544060a8-b8d7-4151-ae61-ce7c5b521cb2 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:49.499850 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5fb9c94d-47d5-4ef4-a5f8-d31a284eb87f req-544060a8-b8d7-4151-ae61-ce7c5b521cb2 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0713768 Dec 09 21:35:49.551388 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5fb9c94d-47d5-4ef4-a5f8-d31a284eb87f req-70d5981b-58c2-4d28-b4ef-ea4637f661ec tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438564 Dec 09 21:35:49.691991 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9756cba9-ab57-415b-8632-2ddac1a53fc3 req-7c4b9ec5-c69b-4db8-b8e5-f057ae9375de tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:49.693511 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9756cba9-ab57-415b-8632-2ddac1a53fc3 req-7c4b9ec5-c69b-4db8-b8e5-f057ae9375de tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0507920 Dec 09 21:35:49.741937 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9756cba9-ab57-415b-8632-2ddac1a53fc3 req-a0bbcd64-4cc0-4e6f-99c5-5301c9bf2635 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420935 Dec 09 21:35:49.862762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff2efa80-09e5-4713-817d-54af8b148f20 req-f787c284-3757-431a-89b2-f6f04c54462f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:49.864058 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ff2efa80-09e5-4713-817d-54af8b148f20 req-f787c284-3757-431a-89b2-f6f04c54462f tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0499892 Dec 09 21:35:49.918036 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ff2efa80-09e5-4713-817d-54af8b148f20 req-b1994381-1c46-4b0b-ab5d-57a520cfca5e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475917 Dec 09 21:35:50.093977 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51820) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:50.094501 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaca7609-d67c-4e85-be11-f4da328c3b85 req-75bc5ec9-1a75-4fe2-90b5-f9df5681d0be tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:50.095997 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eaca7609-d67c-4e85-be11-f4da328c3b85 req-75bc5ec9-1a75-4fe2-90b5-f9df5681d0be tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0496829 Dec 09 21:35:50.145459 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eaca7609-d67c-4e85-be11-f4da328c3b85 req-0f47da20-f7cc-47cf-b7c5-78ba7405145a tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431383 Dec 09 21:35:50.201313 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-82766e92-604c-4af7-b3a3-b66fc87be7d8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-362364822'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:50.224589 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-82766e92-604c-4af7-b3a3-b66fc87be7d8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Made reservation on behalf of 106acb1a6547449093d08a9502ab70fb for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:50.228129 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82766e92-604c-4af7-b3a3-b66fc87be7d8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:50.236756 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82766e92-604c-4af7-b3a3-b66fc87be7d8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:50.267704 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f297bc17-6441-4088-89ec-c51a197409c4 req-6dc16052-13fb-4a7d-8958-3bb2af20018d tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:50.269210 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f297bc17-6441-4088-89ec-c51a197409c4 req-6dc16052-13fb-4a7d-8958-3bb2af20018d tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0541453 Dec 09 21:35:50.319278 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f297bc17-6441-4088-89ec-c51a197409c4 req-2ad046c4-9b8f-4f00-aaef-09a6b66a289d tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431347 Dec 09 21:35:50.319812 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82766e92-604c-4af7-b3a3-b66fc87be7d8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:50.325131 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82766e92-604c-4af7-b3a3-b66fc87be7d8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:50.353138 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-82766e92-604c-4af7-b3a3-b66fc87be7d8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] vlan segment allocate from pool success with {'vlan_id': 128, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:35:50.363847 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82766e92-604c-4af7-b3a3-b66fc87be7d8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'SecurityGroup': ['ID=034961e8-8442-48f0-a0f8-254524eb11df,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:50.369520 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82766e92-604c-4af7-b3a3-b66fc87be7d8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:50.370273 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-82766e92-604c-4af7-b3a3-b66fc87be7d8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Added segment 6ecee335-d5f9-4e22-b28f-82924fed3364 of type vlan for network f803ad5e-7819-4f9a-985a-010d8e7385f1 Dec 09 21:35:50.410915 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82766e92-604c-4af7-b3a3-b66fc87be7d8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:50.436360 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82766e92-604c-4af7-b3a3-b66fc87be7d8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:50.441902 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82766e92-604c-4af7-b3a3-b66fc87be7d8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:50.442479 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82766e92-604c-4af7-b3a3-b66fc87be7d8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:50.462886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73eb7e7e-e764-49b8-ad84-c0575fbbc4a6 req-5cc926f8-1fe4-4163-9e17-489d721e918d tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:50.464482 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-73eb7e7e-e764-49b8-ad84-c0575fbbc4a6 req-5cc926f8-1fe4-4163-9e17-489d721e918d tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0562282 Dec 09 21:35:50.473483 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-82766e92-604c-4af7-b3a3-b66fc87be7d8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.3783588 Dec 09 21:35:50.528684 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-73eb7e7e-e764-49b8-ad84-c0575fbbc4a6 req-d163ffb6-d5a3-4d5a-b4f3-697bfc9b43d6 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0569131 Dec 09 21:35:50.531909 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82766e92-604c-4af7-b3a3-b66fc87be7d8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'Network': ['ID=f803ad5e-7819-4f9a-985a-010d8e7385f1,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:50.560612 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network f803ad5e-7819-4f9a-985a-010d8e7385f1 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:35:50.650449 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dfb7d4c-2f6a-473f-a58f-29025972ff17 req-10f5dfda-b3bd-44c5-a351-65379c7a9db5 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:50.651942 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8dfb7d4c-2f6a-473f-a58f-29025972ff17 req-10f5dfda-b3bd-44c5-a351-65379c7a9db5 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0491865 Dec 09 21:35:50.699321 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8dfb7d4c-2f6a-473f-a58f-29025972ff17 req-ef08d675-185d-4e64-b680-d311811d33a8 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410101 Dec 09 21:35:50.875087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d2e20a7-377e-4f5f-8f6e-a552d96c2d19 req-2133334b-f56b-4b82-a338-a7eacc477550 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:50.876879 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d2e20a7-377e-4f5f-8f6e-a552d96c2d19 req-2133334b-f56b-4b82-a338-a7eacc477550 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0566132 Dec 09 21:35:50.931287 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d2e20a7-377e-4f5f-8f6e-a552d96c2d19 req-7bdfad06-bbd1-4994-ab92-1dd0b174fd60 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434721 Dec 09 21:35:51.046632 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a37dc7f-36b4-45cb-a769-7b09f6cfd73a req-101d5b0f-8743-40d5-b88a-45acf3d2a3dd tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:51.048177 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2a37dc7f-36b4-45cb-a769-7b09f6cfd73a req-101d5b0f-8743-40d5-b88a-45acf3d2a3dd tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0495620 Dec 09 21:35:51.095709 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2a37dc7f-36b4-45cb-a769-7b09f6cfd73a req-dafcef8b-f447-43bd-bd26-664fb4262bb6 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412164 Dec 09 21:35:51.236999 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9201f078-db15-4617-a85c-6cbdad105fe6 req-6a309c50-a366-4bda-a33a-563f3e04a3a1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:51.238397 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9201f078-db15-4617-a85c-6cbdad105fe6 req-6a309c50-a366-4bda-a33a-563f3e04a3a1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0493586 Dec 09 21:35:51.291114 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9201f078-db15-4617-a85c-6cbdad105fe6 req-48ecb65d-8665-4174-ab90-8b0fcfe898ce tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462112 Dec 09 21:35:51.407720 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2047ba6e-ce7a-4f3e-ad7d-2b4d57679656 req-e7e9026f-c3a2-4980-8480-be1096239792 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:51.409217 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2047ba6e-ce7a-4f3e-ad7d-2b4d57679656 req-e7e9026f-c3a2-4980-8480-be1096239792 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0498326 Dec 09 21:35:51.456561 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2047ba6e-ce7a-4f3e-ad7d-2b4d57679656 req-84bd6c20-4b97-4265-be46-7c9e5f049771 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413265 Dec 09 21:35:51.583750 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d39bca9c-12af-4885-9003-26f44304391c req-84c3487b-dde5-4de5-8031-f9bd31154cb4 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:51.591221 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d39bca9c-12af-4885-9003-26f44304391c req-84c3487b-dde5-4de5-8031-f9bd31154cb4 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0567319 Dec 09 21:35:51.638025 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d39bca9c-12af-4885-9003-26f44304391c req-5342b198-9c47-452f-9ffd-d8689c84bd64 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436051 Dec 09 21:35:51.762473 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc101530-d8e3-4c19-81cf-044cdc12e963 req-7ac429e0-8a31-4ed4-b8bb-5eee9ee30dad tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:51.764210 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fc101530-d8e3-4c19-81cf-044cdc12e963 req-7ac429e0-8a31-4ed4-b8bb-5eee9ee30dad tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0589373 Dec 09 21:35:51.828686 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fc101530-d8e3-4c19-81cf-044cdc12e963 req-adfbc342-cde5-4098-bdb6-c7a47754d0d5 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0582895 Dec 09 21:35:51.953448 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e0199fe-9822-4f69-a56b-33a32b61c7c4 req-f6f41a9f-e41e-4be4-b044-ce18b9f22d56 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:51.954943 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e0199fe-9822-4f69-a56b-33a32b61c7c4 req-f6f41a9f-e41e-4be4-b044-ce18b9f22d56 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0503490 Dec 09 21:35:52.002154 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e0199fe-9822-4f69-a56b-33a32b61c7c4 req-61c1e4a8-e27e-4e04-8c03-74039e350ac1 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410852 Dec 09 21:35:53.686539 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51874) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:53.691868 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-08c64373-afe3-4bda-bc14-35eda588f4b8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Request body: {'subnet': {'network_id': 'f803ad5e-7819-4f9a-985a-010d8e7385f1', 'cidr': '2001:db8:0:ffff::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:ffff::1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:53.792192 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-08c64373-afe3-4bda-bc14-35eda588f4b8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Made reservation on behalf of 106acb1a6547449093d08a9502ab70fb for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:53.796055 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-08c64373-afe3-4bda-bc14-35eda588f4b8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:53.995772 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-08c64373-afe3-4bda-bc14-35eda588f4b8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:54.058559 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08c64373-afe3-4bda-bc14-35eda588f4b8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'Subnet': ['ID=333c35b6-bca0-444e-81db-95346c6f0abf,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:54.069552 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08c64373-afe3-4bda-bc14-35eda588f4b8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Checking segment: {'id': '6ecee335-d5f9-4e22-b28f-82924fed3364', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'f803ad5e-7819-4f9a-985a-010d8e7385f1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:35:54.069961 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-08c64373-afe3-4bda-bc14-35eda588f4b8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Network hostable DHCP agents. Network: f803ad5e-7819-4f9a-985a-010d8e7385f1, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:35:54.089179 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-08c64373-afe3-4bda-bc14-35eda588f4b8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Network f803ad5e-7819-4f9a-985a-010d8e7385f1 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:35:54.099129 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-08c64373-afe3-4bda-bc14-35eda588f4b8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, f803ad5e-7819-4f9a-985a-010d8e7385f1) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:54.104356 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-08c64373-afe3-4bda-bc14-35eda588f4b8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:54.104981 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-08c64373-afe3-4bda-bc14-35eda588f4b8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:54.109687 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e6028d4-e3e6-4fc1-84a6-b0a43f5e8b42 None None] Network f803ad5e-7819-4f9a-985a-010d8e7385f1 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:35:54.123610 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-08c64373-afe3-4bda-bc14-35eda588f4b8 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.4358158 Dec 09 21:35:54.127215 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51880) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:54.131833 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-294569478'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:54.154275 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Made reservation on behalf of 106acb1a6547449093d08a9502ab70fb for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:54.158081 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:54.190522 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] vlan segment allocate from pool success with {'vlan_id': 127, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:35:54.208500 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:54.209055 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Added segment ae8ebff3-5634-4616-b9bf-e15c90e8921c of type vlan for network c34f64f0-43c8-4815-865c-5c68d6439ec4 Dec 09 21:35:54.225061 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-f803ad5e-7819-4f9a-985a-010d8e7385f1', 'network_id': 'f803ad5e-7819-4f9a-985a-010d8e7385f1', 'project_id': '106acb1a6547449093d08a9502ab70fb', 'fixed_ips': [{'subnet_id': '333c35b6-bca0-444e-81db-95346c6f0abf'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:35:54.226222 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:54.275646 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:54.308758 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:54.316045 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:54.316982 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:54.357442 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51888) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:54.358019 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.2297091 Dec 09 21:35:54.364926 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-0ab37ca0-fa58-4189-a1e9-eb7872e4659d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Request body: {'subnet': {'network_id': 'c34f64f0-43c8-4815-865c-5c68d6439ec4', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'enable_dhcp': True}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:54.409796 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'Network': ['ID=c34f64f0-43c8-4815-865c-5c68d6439ec4,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:54.419656 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.420010 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.420509 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.420848 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.421179 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.421548 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.421883 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.422441 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.422775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.423099 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.423422 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.423780 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.424098 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4bedaf7b-8976-41dc-a800-0c35092fa231 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.433054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Allocated IP 2001:db8:0:ffff::2 (f803ad5e-7819-4f9a-985a-010d8e7385f1/333c35b6-bca0-444e-81db-95346c6f0abf/a1bb8df8-7c15-4208-aaeb-5e05198c6d35) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:35:54.440286 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network c34f64f0-43c8-4815-865c-5c68d6439ec4 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:35:54.515900 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0ab37ca0-fa58-4189-a1e9-eb7872e4659d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Made reservation on behalf of 106acb1a6547449093d08a9502ab70fb for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:54.519945 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0ab37ca0-fa58-4189-a1e9-eb7872e4659d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:54.666214 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:54.675413 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:54.717427 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Network f803ad5e-7819-4f9a-985a-010d8e7385f1 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:35:54.720257 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:54.730039 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:35:54.737515 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Pushing event updated for resources: {'Port': ['ID=a1bb8df8-7c15-4208-aaeb-5e05198c6d35,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:54.753352 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0ab37ca0-fa58-4189-a1e9-eb7872e4659d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:54.753606 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.753606 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.753823 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.754212 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.754548 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.754878 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.755242 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.755631 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.755964 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.756285 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.756608 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.756931 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.757254 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:54.835663 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ab37ca0-fa58-4189-a1e9-eb7872e4659d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'Subnet': ['ID=42a3385c-4e5d-484a-a57a-f0a652fedfcb,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:54.844927 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ab37ca0-fa58-4189-a1e9-eb7872e4659d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Checking segment: {'id': 'ae8ebff3-5634-4616-b9bf-e15c90e8921c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': 'c34f64f0-43c8-4815-865c-5c68d6439ec4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:35:54.845388 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ab37ca0-fa58-4189-a1e9-eb7872e4659d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Network hostable DHCP agents. Network: c34f64f0-43c8-4815-865c-5c68d6439ec4, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:35:54.859276 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Attempting to bind port a1bb8df8-7c15-4208-aaeb-5e05198c6d35 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:35:54.860737 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Attempting to bind port a1bb8df8-7c15-4208-aaeb-5e05198c6d35 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '6ecee335-d5f9-4e22-b28f-82924fed3364', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'f803ad5e-7819-4f9a-985a-010d8e7385f1'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:35:54.861301 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Attempting to bind port a1bb8df8-7c15-4208-aaeb-5e05198c6d35 on network f803ad5e-7819-4f9a-985a-010d8e7385f1 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:35:54.868905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ab37ca0-fa58-4189-a1e9-eb7872e4659d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Network c34f64f0-43c8-4815-865c-5c68d6439ec4 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:35:54.869221 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 35, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:35:54.869798 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Checking segment: {'id': '6ecee335-d5f9-4e22-b28f-82924fed3364', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'f803ad5e-7819-4f9a-985a-010d8e7385f1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:35:54.870565 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:54.871109 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Bound using segment: {'id': '6ecee335-d5f9-4e22-b28f-82924fed3364', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'f803ad5e-7819-4f9a-985a-010d8e7385f1'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:35:54.871987 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Bound port: a1bb8df8-7c15-4208-aaeb-5e05198c6d35, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6ecee335-d5f9-4e22-b28f-82924fed3364', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 128, 'network_id': 'f803ad5e-7819-4f9a-985a-010d8e7385f1'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:35:54.873471 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:54.892388 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-0ab37ca0-fa58-4189-a1e9-eb7872e4659d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, c34f64f0-43c8-4815-865c-5c68d6439ec4) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:54.905694 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ab37ca0-fa58-4189-a1e9-eb7872e4659d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:54.906235 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0ab37ca0-fa58-4189-a1e9-eb7872e4659d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:54.920439 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2df537be-33e7-4add-abee-04b9955008f8 None None] Network c34f64f0-43c8-4815-865c-5c68d6439ec4 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:35:54.935863 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51892) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:54.944287 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0ab37ca0-fa58-4189-a1e9-eb7872e4659d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 812 time: 0.5841300 Dec 09 21:35:55.044220 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] For port a1bb8df8-7c15-4208-aaeb-5e05198c6d35, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:35:55.049085 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] For port a1bb8df8-7c15-4208-aaeb-5e05198c6d35, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a1bb8df8-7c15-4208-aaeb-5e05198c6d35,segment=NetworkSegment(6ecee335-d5f9-4e22-b28f-82924fed3364),segment_id=6ecee335-d5f9-4e22-b28f-82924fed3364)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:35:55.060560 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:55.096856 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-48fadeb2-3ed5-4f39-9c78-3e1d8d9ec4b7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:55.113732 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2cd431d8-10d2-4196-9892-639154af5714 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-c34f64f0-43c8-4815-865c-5c68d6439ec4', 'network_id': 'c34f64f0-43c8-4815-865c-5c68d6439ec4', 'project_id': '106acb1a6547449093d08a9502ab70fb', 'fixed_ips': [{'subnet_id': '42a3385c-4e5d-484a-a57a-f0a652fedfcb'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:35:55.113732 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2cd431d8-10d2-4196-9892-639154af5714 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:55.167030 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-48fadeb2-3ed5-4f39-9c78-3e1d8d9ec4b7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:55.255133 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-48fadeb2-3ed5-4f39-9c78-3e1d8d9ec4b7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:55.257498 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36fa42f7-ab6b-4940-bb48-a0fe78f66c05 None None] Pushing event updated for resources: {'Port': ['ID=a1bb8df8-7c15-4208-aaeb-5e05198c6d35,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server [None req-2cd431d8-10d2-4196-9892-639154af5714 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 42a3385c-4e5d-484a-a57a-f0a652fedfcb: This subnet is being modified by another concurrent operation. Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 306, in create_dhcp_port Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1485, in create_port Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1450, in _create_port_db Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1460, in create_port_db Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnet.lock_register( Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise exception Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 42a3385c-4e5d-484a-a57a-f0a652fedfcb: This subnet is being modified by another concurrent operation. Dec 09 21:35:55.273694 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Dec 09 21:35:55.299192 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-56d671cf-bfa8-4298-a1b8-e0c491ba1a7d None None] Network c34f64f0-43c8-4815-865c-5c68d6439ec4 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:35:55.305939 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48fadeb2-3ed5-4f39-9c78-3e1d8d9ec4b7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Subnet': ['ID=42a3385c-4e5d-484a-a57a-f0a652fedfcb,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:55.379212 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-48fadeb2-3ed5-4f39-9c78-3e1d8d9ec4b7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:55.405854 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-48fadeb2-3ed5-4f39-9c78-3e1d8d9ec4b7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c34f64f0-43c8-4815-865c-5c68d6439ec4']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:55.422110 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-48fadeb2-3ed5-4f39-9c78-3e1d8d9ec4b7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ae8ebff3-5634-4616-b9bf-e15c90e8921c') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:55.422110 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-48fadeb2-3ed5-4f39-9c78-3e1d8d9ec4b7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ae8ebff3-5634-4616-b9bf-e15c90e8921c') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:55.457531 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-48fadeb2-3ed5-4f39-9c78-3e1d8d9ec4b7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:55.493307 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-48fadeb2-3ed5-4f39-9c78-3e1d8d9ec4b7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:55.511703 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-48fadeb2-3ed5-4f39-9c78-3e1d8d9ec4b7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Releasing vlan 127 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:35:55.512243 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-48fadeb2-3ed5-4f39-9c78-3e1d8d9ec4b7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:35:55.636998 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:35:55.667249 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-48fadeb2-3ed5-4f39-9c78-3e1d8d9ec4b7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:55.686198 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a1bb8df8-7c15-4208-aaeb-5e05198c6d35 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:35:55.692268 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-48fadeb2-3ed5-4f39-9c78-3e1d8d9ec4b7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:55.700551 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-48fadeb2-3ed5-4f39-9c78-3e1d8d9ec4b7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/networks/c34f64f0-43c8-4815-865c-5c68d6439ec4 HTTP/1.1" status: 204 len: 168 time: 0.7602930 Dec 09 21:35:55.701801 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51898) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:55.719050 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-fcce05fa-ef1c-4aa6-bdd1-22e0e01b598b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-501578313'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:55.727892 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48fadeb2-3ed5-4f39-9c78-3e1d8d9ec4b7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Network': ['ID=c34f64f0-43c8-4815-865c-5c68d6439ec4,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:55.743276 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port a1bb8df8-7c15-4208-aaeb-5e05198c6d35 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:55.743848 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:55.768217 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fcce05fa-ef1c-4aa6-bdd1-22e0e01b598b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Made reservation on behalf of 106acb1a6547449093d08a9502ab70fb for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:55.777562 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fcce05fa-ef1c-4aa6-bdd1-22e0e01b598b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:55.812568 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fcce05fa-ef1c-4aa6-bdd1-22e0e01b598b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] vlan segment allocate from pool success with {'vlan_id': 133, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:35:55.825984 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fcce05fa-ef1c-4aa6-bdd1-22e0e01b598b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:55.826469 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-fcce05fa-ef1c-4aa6-bdd1-22e0e01b598b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Added segment c9f0c2d8-ca15-4401-8dfc-2596b86360e8 of type vlan for network 6f356cc9-34a5-4f0a-84a8-1242014e658b Dec 09 21:35:55.845422 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:55.872725 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fcce05fa-ef1c-4aa6-bdd1-22e0e01b598b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:55.880292 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port a1bb8df8-7c15-4208-aaeb-5e05198c6d35, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a1bb8df8-7c15-4208-aaeb-5e05198c6d35,segment=NetworkSegment(6ecee335-d5f9-4e22-b28f-82924fed3364),segment_id=6ecee335-d5f9-4e22-b28f-82924fed3364)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:35:55.884875 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:55.907309 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fcce05fa-ef1c-4aa6-bdd1-22e0e01b598b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:55.915770 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fcce05fa-ef1c-4aa6-bdd1-22e0e01b598b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:55.916803 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fcce05fa-ef1c-4aa6-bdd1-22e0e01b598b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:55.939202 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=a1bb8df8-7c15-4208-aaeb-5e05198c6d35,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:55.957910 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fcce05fa-ef1c-4aa6-bdd1-22e0e01b598b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.2542164 Dec 09 21:35:55.960692 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51902) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:55.967640 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-45a0d384-b2a4-4887-ac69-8e0ed2b01a96 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Request body: {'subnet': {'network_id': '6f356cc9-34a5-4f0a-84a8-1242014e658b', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::2'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:56.018591 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcce05fa-ef1c-4aa6-bdd1-22e0e01b598b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'Network': ['ID=6f356cc9-34a5-4f0a-84a8-1242014e658b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:56.036183 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 6f356cc9-34a5-4f0a-84a8-1242014e658b details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:35:56.120735 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-45a0d384-b2a4-4887-ac69-8e0ed2b01a96 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Made reservation on behalf of 106acb1a6547449093d08a9502ab70fb for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:56.125139 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-45a0d384-b2a4-4887-ac69-8e0ed2b01a96 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:56.338237 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-45a0d384-b2a4-4887-ac69-8e0ed2b01a96 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:56.402047 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b28c13d-3046-4bb2-97c3-9ff2cc983695 None None] Network f803ad5e-7819-4f9a-985a-010d8e7385f1 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:35:56.412299 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45a0d384-b2a4-4887-ac69-8e0ed2b01a96 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'Subnet': ['ID=d98c7eb1-9086-4940-868f-92bb2777b776,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:56.419998 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45a0d384-b2a4-4887-ac69-8e0ed2b01a96 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Checking segment: {'id': 'c9f0c2d8-ca15-4401-8dfc-2596b86360e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '6f356cc9-34a5-4f0a-84a8-1242014e658b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:35:56.420358 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-45a0d384-b2a4-4887-ac69-8e0ed2b01a96 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Network hostable DHCP agents. Network: 6f356cc9-34a5-4f0a-84a8-1242014e658b, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:35:56.438105 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-45a0d384-b2a4-4887-ac69-8e0ed2b01a96 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Network 6f356cc9-34a5-4f0a-84a8-1242014e658b is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:35:56.452327 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-45a0d384-b2a4-4887-ac69-8e0ed2b01a96 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 6f356cc9-34a5-4f0a-84a8-1242014e658b) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:56.461701 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-45a0d384-b2a4-4887-ac69-8e0ed2b01a96 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:56.462753 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-45a0d384-b2a4-4887-ac69-8e0ed2b01a96 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:56.473380 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9949768e-73fb-4eb7-8bd1-e022a42f0479 None None] Network 6f356cc9-34a5-4f0a-84a8-1242014e658b requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:35:56.492577 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-45a0d384-b2a4-4887-ac69-8e0ed2b01a96 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 865 time: 0.5306137 Dec 09 21:35:56.495962 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51908) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:56.511355 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-c7182b9e-6f8d-4d7f-ad38-e1e7ee1e94c5 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1775568130'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:56.534776 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c7182b9e-6f8d-4d7f-ad38-e1e7ee1e94c5 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Made reservation on behalf of 106acb1a6547449093d08a9502ab70fb for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:56.538916 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c7182b9e-6f8d-4d7f-ad38-e1e7ee1e94c5 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:56.568306 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1554297b-0a92-43a2-ada8-d5fd6b812537 None None] Provisioning complete for port a1bb8df8-7c15-4208-aaeb-5e05198c6d35 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:56.568670 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1554297b-0a92-43a2-ada8-d5fd6b812537 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:56.569481 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c7182b9e-6f8d-4d7f-ad38-e1e7ee1e94c5 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] vlan segment allocate from pool success with {'vlan_id': 105, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:35:56.582098 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c7182b9e-6f8d-4d7f-ad38-e1e7ee1e94c5 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:56.582440 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-c7182b9e-6f8d-4d7f-ad38-e1e7ee1e94c5 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Added segment 93d8fd3a-86d3-4643-a66f-0c7109b32aac of type vlan for network c7966c98-65ee-4f8f-b2e6-23c529ebca83 Dec 09 21:35:56.633009 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c7182b9e-6f8d-4d7f-ad38-e1e7ee1e94c5 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:56.654080 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1adc89d2-b047-4052-af51-8b63ba8f5e7f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-6f356cc9-34a5-4f0a-84a8-1242014e658b', 'network_id': '6f356cc9-34a5-4f0a-84a8-1242014e658b', 'project_id': '106acb1a6547449093d08a9502ab70fb', 'fixed_ips': [{'subnet_id': 'd98c7eb1-9086-4940-868f-92bb2777b776'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:35:56.654942 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1adc89d2-b047-4052-af51-8b63ba8f5e7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:56.662039 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c7182b9e-6f8d-4d7f-ad38-e1e7ee1e94c5 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:56.669165 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c7182b9e-6f8d-4d7f-ad38-e1e7ee1e94c5 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:56.669675 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c7182b9e-6f8d-4d7f-ad38-e1e7ee1e94c5 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:56.713152 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c7182b9e-6f8d-4d7f-ad38-e1e7ee1e94c5 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.2157924 Dec 09 21:35:56.716751 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51910) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:56.721818 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-315a2acb-b874-4b82-92b3-7621764e44cb tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Request body: {'subnet': {'network_id': 'c7966c98-65ee-4f8f-b2e6-23c529ebca83', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'allocation_pools': [{'start': '2001:db8::3', 'end': '2001:db8::7'}]}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:56.775077 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7182b9e-6f8d-4d7f-ad38-e1e7ee1e94c5 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'Network': ['ID=c7966c98-65ee-4f8f-b2e6-23c529ebca83,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:56.796099 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network c7966c98-65ee-4f8f-b2e6-23c529ebca83 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:35:56.886817 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-315a2acb-b874-4b82-92b3-7621764e44cb tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Made reservation on behalf of 106acb1a6547449093d08a9502ab70fb for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:56.891034 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-315a2acb-b874-4b82-92b3-7621764e44cb tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:56.928245 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-1adc89d2-b047-4052-af51-8b63ba8f5e7f None None] Allocated IP 2001:db8::3 (6f356cc9-34a5-4f0a-84a8-1242014e658b/d98c7eb1-9086-4940-868f-92bb2777b776/251fbc8e-86af-4b4b-b5a7-6614df880418) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:35:56.965965 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.ipam_backend_mixin [None req-315a2acb-b874-4b82-92b3-7621764e44cb tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Performing IP validity checks on allocation pools {{(pid=103438) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Dec 09 21:35:56.966486 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.ipam_backend_mixin [None req-315a2acb-b874-4b82-92b3-7621764e44cb tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Checking for overlaps among allocation pools and gateway ip {{(pid=103438) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Dec 09 21:35:57.063423 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-183546bd-3263-4044-a745-32f17613a0d5 None None] Provisioning complete for port a1bb8df8-7c15-4208-aaeb-5e05198c6d35 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:57.063751 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-183546bd-3263-4044-a745-32f17613a0d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:57.123836 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-315a2acb-b874-4b82-92b3-7621764e44cb tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:57.139822 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1adc89d2-b047-4052-af51-8b63ba8f5e7f None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:57.149621 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1adc89d2-b047-4052-af51-8b63ba8f5e7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:57.191041 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-315a2acb-b874-4b82-92b3-7621764e44cb tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'Subnet': ['ID=08584ab9-470f-452d-be6f-a4087984a7a4,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:57.212933 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-315a2acb-b874-4b82-92b3-7621764e44cb tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Checking segment: {'id': '93d8fd3a-86d3-4643-a66f-0c7109b32aac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': 'c7966c98-65ee-4f8f-b2e6-23c529ebca83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:35:57.213574 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-315a2acb-b874-4b82-92b3-7621764e44cb tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Network hostable DHCP agents. Network: c7966c98-65ee-4f8f-b2e6-23c529ebca83, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:35:57.218834 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1adc89d2-b047-4052-af51-8b63ba8f5e7f None None] Network 6f356cc9-34a5-4f0a-84a8-1242014e658b is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:35:57.233364 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-1adc89d2-b047-4052-af51-8b63ba8f5e7f None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:57.238308 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1adc89d2-b047-4052-af51-8b63ba8f5e7f None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:35:57.242279 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-315a2acb-b874-4b82-92b3-7621764e44cb tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Network c7966c98-65ee-4f8f-b2e6-23c529ebca83 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:35:57.246967 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1adc89d2-b047-4052-af51-8b63ba8f5e7f None None] Pushing event updated for resources: {'Port': ['ID=251fbc8e-86af-4b4b-b5a7-6614df880418,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:57.265379 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:57.267095 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:57.268048 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-315a2acb-b874-4b82-92b3-7621764e44cb tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, c7966c98-65ee-4f8f-b2e6-23c529ebca83) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:57.273361 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-315a2acb-b874-4b82-92b3-7621764e44cb tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:57.274389 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-315a2acb-b874-4b82-92b3-7621764e44cb tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:57.284140 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-460eeff5-ba7c-484c-9848-ec3f01ff4039 None None] Network c7966c98-65ee-4f8f-b2e6-23c529ebca83 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:35:57.297675 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-315a2acb-b874-4b82-92b3-7621764e44cb tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 803 time: 0.5798028 Dec 09 21:35:57.300265 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51918) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:57.368265 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-1adc89d2-b047-4052-af51-8b63ba8f5e7f None None] Attempting to bind port 251fbc8e-86af-4b4b-b5a7-6614df880418 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:35:57.368882 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-1adc89d2-b047-4052-af51-8b63ba8f5e7f None None] Attempting to bind port 251fbc8e-86af-4b4b-b5a7-6614df880418 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'c9f0c2d8-ca15-4401-8dfc-2596b86360e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '6f356cc9-34a5-4f0a-84a8-1242014e658b'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:35:57.368882 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1adc89d2-b047-4052-af51-8b63ba8f5e7f None None] Attempting to bind port 251fbc8e-86af-4b4b-b5a7-6614df880418 on network 6f356cc9-34a5-4f0a-84a8-1242014e658b {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:35:57.387620 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1adc89d2-b047-4052-af51-8b63ba8f5e7f None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 35, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:35:57.387999 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1adc89d2-b047-4052-af51-8b63ba8f5e7f None None] Checking segment: {'id': 'c9f0c2d8-ca15-4401-8dfc-2596b86360e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '6f356cc9-34a5-4f0a-84a8-1242014e658b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:35:57.388396 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1adc89d2-b047-4052-af51-8b63ba8f5e7f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:57.388778 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1adc89d2-b047-4052-af51-8b63ba8f5e7f None None] Bound using segment: {'id': 'c9f0c2d8-ca15-4401-8dfc-2596b86360e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '6f356cc9-34a5-4f0a-84a8-1242014e658b'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:35:57.389243 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-1adc89d2-b047-4052-af51-8b63ba8f5e7f None None] Bound port: 251fbc8e-86af-4b4b-b5a7-6614df880418, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c9f0c2d8-ca15-4401-8dfc-2596b86360e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '6f356cc9-34a5-4f0a-84a8-1242014e658b'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:35:57.389618 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1adc89d2-b047-4052-af51-8b63ba8f5e7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:57.411178 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7fb42870-ac8e-4272-8270-24593f1c4f84 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:57.469633 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7fb42870-ac8e-4272-8270-24593f1c4f84 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:57.471523 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c005349a-ec66-4253-99ea-412c0d205c3f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-c7966c98-65ee-4f8f-b2e6-23c529ebca83', 'network_id': 'c7966c98-65ee-4f8f-b2e6-23c529ebca83', 'project_id': '106acb1a6547449093d08a9502ab70fb', 'fixed_ips': [{'subnet_id': '08584ab9-470f-452d-be6f-a4087984a7a4'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:35:57.474493 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c005349a-ec66-4253-99ea-412c0d205c3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:57.492528 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-1adc89d2-b047-4052-af51-8b63ba8f5e7f None None] For port 251fbc8e-86af-4b4b-b5a7-6614df880418, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:35:57.512427 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-1adc89d2-b047-4052-af51-8b63ba8f5e7f None None] For port 251fbc8e-86af-4b4b-b5a7-6614df880418, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=251fbc8e-86af-4b4b-b5a7-6614df880418,segment=NetworkSegment(c9f0c2d8-ca15-4401-8dfc-2596b86360e8),segment_id=c9f0c2d8-ca15-4401-8dfc-2596b86360e8)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:35:57.549737 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1adc89d2-b047-4052-af51-8b63ba8f5e7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:57.555404 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7fb42870-ac8e-4272-8270-24593f1c4f84 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:57.600253 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fb42870-ac8e-4272-8270-24593f1c4f84 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Subnet': ['ID=08584ab9-470f-452d-be6f-a4087984a7a4,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:57.615704 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a1bb8df8-7c15-4208-aaeb-5e05198c6d35 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:35:57.680899 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7fb42870-ac8e-4272-8270-24593f1c4f84 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:57.721628 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-7fb42870-ac8e-4272-8270-24593f1c4f84 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c7966c98-65ee-4f8f-b2e6-23c529ebca83']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:57.734482 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-7fb42870-ac8e-4272-8270-24593f1c4f84 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '93d8fd3a-86d3-4643-a66f-0c7109b32aac') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:57.734868 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-7fb42870-ac8e-4272-8270-24593f1c4f84 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '93d8fd3a-86d3-4643-a66f-0c7109b32aac') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:57.748316 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7fb42870-ac8e-4272-8270-24593f1c4f84 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:57.753422 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1adc89d2-b047-4052-af51-8b63ba8f5e7f None None] Pushing event updated for resources: {'Port': ['ID=251fbc8e-86af-4b4b-b5a7-6614df880418,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server [None req-c005349a-ec66-4253-99ea-412c0d205c3f None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 08584ab9-470f-452d-be6f-a4087984a7a4: This subnet is being modified by another concurrent operation. Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 306, in create_dhcp_port Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1485, in create_port Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1450, in _create_port_db Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1460, in create_port_db Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnet.lock_register( Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise exception Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 08584ab9-470f-452d-be6f-a4087984a7a4: This subnet is being modified by another concurrent operation. Dec 09 21:35:57.758313 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Dec 09 21:35:57.781560 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f611f0f9-bc1c-4b8e-9a65-f2e5b1fde8c6 None None] Network c7966c98-65ee-4f8f-b2e6-23c529ebca83 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:35:57.783342 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7fb42870-ac8e-4272-8270-24593f1c4f84 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:57.796987 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7fb42870-ac8e-4272-8270-24593f1c4f84 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Releasing vlan 105 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:35:57.797547 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7fb42870-ac8e-4272-8270-24593f1c4f84 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:35:57.804439 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:35:57.833766 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port a1bb8df8-7c15-4208-aaeb-5e05198c6d35 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:57.834149 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:57.933510 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7fb42870-ac8e-4272-8270-24593f1c4f84 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:57.939162 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7fb42870-ac8e-4272-8270-24593f1c4f84 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:57.943018 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7fb42870-ac8e-4272-8270-24593f1c4f84 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/networks/c7966c98-65ee-4f8f-b2e6-23c529ebca83 HTTP/1.1" status: 204 len: 168 time: 0.6417062 Dec 09 21:35:57.946925 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51930) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:57.982321 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fb42870-ac8e-4272-8270-24593f1c4f84 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Network': ['ID=c7966c98-65ee-4f8f-b2e6-23c529ebca83,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:58.010079 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-629389635'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:58.060322 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-644b1b9e-e0b3-468d-a07f-a7162da811ac req-0139221b-3387-46bf-8747-fde3046cb29e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:58.069968 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-644b1b9e-e0b3-468d-a07f-a7162da811ac req-0139221b-3387-46bf-8747-fde3046cb29e tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.1554272 Dec 09 21:35:58.093048 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Made reservation on behalf of 106acb1a6547449093d08a9502ab70fb for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:58.096892 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:58.159117 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-644b1b9e-e0b3-468d-a07f-a7162da811ac req-3304ab1e-cfe8-41d3-a93b-b3b234a92631 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0877802 Dec 09 21:35:58.165635 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] vlan segment allocate from pool success with {'vlan_id': 135, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:35:58.179493 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:58.180083 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Added segment a5e2e9ea-d605-449a-a7e4-39610ba4e58a of type vlan for network b10818be-4493-4b43-a8db-e1fb4b1fa122 Dec 09 21:35:58.221951 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:58.254148 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:58.260157 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:58.261092 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:58.300431 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.3479755 Dec 09 21:35:58.306056 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51936) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:58.310839 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-90f098dd-fe86-49c1-82ee-615b08e4ddb2 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Request body: {'subnet': {'network_id': 'b10818be-4493-4b43-a8db-e1fb4b1fa122', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'host_routes': [{'destination': '2001::/64', 'nexthop': '2003::1'}], 'dns_nameservers': ['2001:4860:4860::8844', '2001:4860:4860::8888']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:58.353849 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'Network': ['ID=b10818be-4493-4b43-a8db-e1fb4b1fa122,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:58.370965 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:58.371342 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:58.371696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:58.372026 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:58.372348 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:58.372910 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:58.373244 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:58.373594 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:58.373915 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:58.374228 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:58.374550 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:58.374858 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:58.375156 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0d563183-9b02-4f8b-98cc-aed2a39ae131 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:35:58.388341 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network b10818be-4493-4b43-a8db-e1fb4b1fa122 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:35:58.445259 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-90f098dd-fe86-49c1-82ee-615b08e4ddb2 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Made reservation on behalf of 106acb1a6547449093d08a9502ab70fb for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:58.448878 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-90f098dd-fe86-49c1-82ee-615b08e4ddb2 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:58.663752 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-90f098dd-fe86-49c1-82ee-615b08e4ddb2 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:58.724093 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90f098dd-fe86-49c1-82ee-615b08e4ddb2 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'Subnet': ['ID=0b44a566-6ba8-4a09-9612-cb7b65bed049,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:58.734979 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90f098dd-fe86-49c1-82ee-615b08e4ddb2 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Checking segment: {'id': 'a5e2e9ea-d605-449a-a7e4-39610ba4e58a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'b10818be-4493-4b43-a8db-e1fb4b1fa122'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:35:58.735334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-90f098dd-fe86-49c1-82ee-615b08e4ddb2 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Network hostable DHCP agents. Network: b10818be-4493-4b43-a8db-e1fb4b1fa122, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:35:58.752539 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-90f098dd-fe86-49c1-82ee-615b08e4ddb2 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Network b10818be-4493-4b43-a8db-e1fb4b1fa122 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:35:58.762175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-90f098dd-fe86-49c1-82ee-615b08e4ddb2 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, b10818be-4493-4b43-a8db-e1fb4b1fa122) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:58.768170 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90f098dd-fe86-49c1-82ee-615b08e4ddb2 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:58.769139 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-90f098dd-fe86-49c1-82ee-615b08e4ddb2 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:58.770299 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b506177-5586-4fdb-a928-f6dce868834c None None] Network b10818be-4493-4b43-a8db-e1fb4b1fa122 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:35:58.793325 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-90f098dd-fe86-49c1-82ee-615b08e4ddb2 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 904 time: 0.4832466 Dec 09 21:35:58.793542 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51938) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:58.880776 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-606ca226-fdf0-4af4-8cc5-462656a09645 None None] Network 6f356cc9-34a5-4f0a-84a8-1242014e658b requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:35:58.897864 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af6b52d6-76a3-4e44-8b58-02a9a2ad9f17 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-b10818be-4493-4b43-a8db-e1fb4b1fa122', 'network_id': 'b10818be-4493-4b43-a8db-e1fb4b1fa122', 'project_id': '106acb1a6547449093d08a9502ab70fb', 'fixed_ips': [{'subnet_id': '0b44a566-6ba8-4a09-9612-cb7b65bed049'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:35:58.898735 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-af6b52d6-76a3-4e44-8b58-02a9a2ad9f17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:58.901409 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0350f3f2-a9ab-4dd1-8787-d7ed64432c81 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:58.954273 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0350f3f2-a9ab-4dd1-8787-d7ed64432c81 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:59.016729 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0350f3f2-a9ab-4dd1-8787-d7ed64432c81 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:59.038070 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c44e39ea-6217-4ec9-96a3-8e1ed52d2ee9 None None] Provisioning complete for port 251fbc8e-86af-4b4b-b5a7-6614df880418 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:59.038486 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c44e39ea-6217-4ec9-96a3-8e1ed52d2ee9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:59.044413 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0350f3f2-a9ab-4dd1-8787-d7ed64432c81 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Subnet': ['ID=0b44a566-6ba8-4a09-9612-cb7b65bed049,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server [None req-af6b52d6-76a3-4e44-8b58-02a9a2ad9f17 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 0b44a566-6ba8-4a09-9612-cb7b65bed049: This subnet is being modified by another concurrent operation. Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 306, in create_dhcp_port Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1485, in create_port Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1450, in _create_port_db Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1460, in create_port_db Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnet.lock_register( Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise exception Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 0b44a566-6ba8-4a09-9612-cb7b65bed049: This subnet is being modified by another concurrent operation. Dec 09 21:35:59.098742 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Dec 09 21:35:59.108703 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0350f3f2-a9ab-4dd1-8787-d7ed64432c81 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:59.122443 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea3882e3-d80b-46d2-8676-e696271201f9 None None] Network b10818be-4493-4b43-a8db-e1fb4b1fa122 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:35:59.132513 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-0350f3f2-a9ab-4dd1-8787-d7ed64432c81 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b10818be-4493-4b43-a8db-e1fb4b1fa122']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:59.142991 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-0350f3f2-a9ab-4dd1-8787-d7ed64432c81 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a5e2e9ea-d605-449a-a7e4-39610ba4e58a') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:59.143343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-0350f3f2-a9ab-4dd1-8787-d7ed64432c81 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a5e2e9ea-d605-449a-a7e4-39610ba4e58a') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:35:59.154257 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0350f3f2-a9ab-4dd1-8787-d7ed64432c81 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:59.170919 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0350f3f2-a9ab-4dd1-8787-d7ed64432c81 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:59.179664 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0350f3f2-a9ab-4dd1-8787-d7ed64432c81 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Releasing vlan 135 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:35:59.180292 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0350f3f2-a9ab-4dd1-8787-d7ed64432c81 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:35:59.185060 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:35:59.222378 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c44e39ea-6217-4ec9-96a3-8e1ed52d2ee9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:59.271312 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0350f3f2-a9ab-4dd1-8787-d7ed64432c81 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:59.276665 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0350f3f2-a9ab-4dd1-8787-d7ed64432c81 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:59.280205 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0350f3f2-a9ab-4dd1-8787-d7ed64432c81 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/networks/b10818be-4493-4b43-a8db-e1fb4b1fa122 HTTP/1.1" status: 204 len: 168 time: 0.4857094 Dec 09 21:35:59.285499 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51944) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:59.292399 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-c445d47a-dab2-4d81-b914-81e1abe63938 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-909920692'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:59.320663 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0350f3f2-a9ab-4dd1-8787-d7ed64432c81 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Network': ['ID=b10818be-4493-4b43-a8db-e1fb4b1fa122,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:59.335520 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c445d47a-dab2-4d81-b914-81e1abe63938 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Made reservation on behalf of 106acb1a6547449093d08a9502ab70fb for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:59.340170 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c44e39ea-6217-4ec9-96a3-8e1ed52d2ee9 None None] For port 251fbc8e-86af-4b4b-b5a7-6614df880418, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=251fbc8e-86af-4b4b-b5a7-6614df880418,segment=NetworkSegment(c9f0c2d8-ca15-4401-8dfc-2596b86360e8),segment_id=c9f0c2d8-ca15-4401-8dfc-2596b86360e8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:35:59.341503 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c445d47a-dab2-4d81-b914-81e1abe63938 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:59.346897 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c461d6d-20e6-41b3-bdc6-c09e48caab34 req-615bd0af-32f5-480e-ba9e-b9ef113d0e8a tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:59.347905 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c44e39ea-6217-4ec9-96a3-8e1ed52d2ee9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:59.348732 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c461d6d-20e6-41b3-bdc6-c09e48caab34 req-615bd0af-32f5-480e-ba9e-b9ef113d0e8a tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0890400 Dec 09 21:35:59.389634 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be1d6937-f8af-400b-bb7f-9853c7ee5b2f None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 21:35:59.391746 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c445d47a-dab2-4d81-b914-81e1abe63938 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] vlan segment allocate from pool success with {'vlan_id': 131, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:35:59.404729 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c445d47a-dab2-4d81-b914-81e1abe63938 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:59.405087 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-c445d47a-dab2-4d81-b914-81e1abe63938 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Added segment 43435e63-4283-461e-bc44-1a8c6286cc78 of type vlan for network 9a6ec510-0e53-48e0-b7c2-57a700c9e461 Dec 09 21:35:59.425876 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c461d6d-20e6-41b3-bdc6-c09e48caab34 req-76341986-5413-421f-8e18-59a7b049c331 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/security-groups?id=9cc9673e-b099-41ab-8794-d9dc3c1a9e23&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0653844 Dec 09 21:35:59.451289 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c445d47a-dab2-4d81-b914-81e1abe63938 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:59.481341 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c445d47a-dab2-4d81-b914-81e1abe63938 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:59.488594 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c445d47a-dab2-4d81-b914-81e1abe63938 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:59.489302 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c445d47a-dab2-4d81-b914-81e1abe63938 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:59.532869 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c445d47a-dab2-4d81-b914-81e1abe63938 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.2460313 Dec 09 21:35:59.536004 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51948) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:59.542009 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-b562c2c6-5937-44e0-b748-09c78c24c0c4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Request body: {'subnet': {'network_id': '9a6ec510-0e53-48e0-b7c2-57a700c9e461', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:35:59.596343 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c445d47a-dab2-4d81-b914-81e1abe63938 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'Network': ['ID=9a6ec510-0e53-48e0-b7c2-57a700c9e461,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:59.613435 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 251fbc8e-86af-4b4b-b5a7-6614df880418 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:35:59.627821 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 9a6ec510-0e53-48e0-b7c2-57a700c9e461 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:35:59.637532 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b562c2c6-5937-44e0-b748-09c78c24c0c4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Made reservation on behalf of 106acb1a6547449093d08a9502ab70fb for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:35:59.641367 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b562c2c6-5937-44e0-b748-09c78c24c0c4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:59.677931 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c44e39ea-6217-4ec9-96a3-8e1ed52d2ee9 None None] Pushing event updated for resources: {'Port': ['ID=251fbc8e-86af-4b4b-b5a7-6614df880418,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:59.741909 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7331afc0-6c45-4bda-9ac8-0a0adb82cd35 None None] Provisioning complete for port 251fbc8e-86af-4b4b-b5a7-6614df880418 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:59.742286 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7331afc0-6c45-4bda-9ac8-0a0adb82cd35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:59.833066 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b562c2c6-5937-44e0-b748-09c78c24c0c4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:59.848997 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 251fbc8e-86af-4b4b-b5a7-6614df880418 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:35:59.849582 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:59.874655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a23b160e-4eeb-4fe2-a02b-134eb95edd73 req-681e0193-1ef4-453e-802b-39f223a0c307 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:59.877007 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a23b160e-4eeb-4fe2-a02b-134eb95edd73 req-681e0193-1ef4-453e-802b-39f223a0c307 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.31 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 946 time: 0.0654879 Dec 09 21:35:59.898688 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b562c2c6-5937-44e0-b748-09c78c24c0c4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'Subnet': ['ID=b4c6f5b6-844f-47d8-b167-6127838825bf,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:35:59.901672 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b562c2c6-5937-44e0-b748-09c78c24c0c4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Checking segment: {'id': '43435e63-4283-461e-bc44-1a8c6286cc78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 131, 'network_id': '9a6ec510-0e53-48e0-b7c2-57a700c9e461'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:35:59.902232 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b562c2c6-5937-44e0-b748-09c78c24c0c4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Network hostable DHCP agents. Network: 9a6ec510-0e53-48e0-b7c2-57a700c9e461, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:35:59.921684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b562c2c6-5937-44e0-b748-09c78c24c0c4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Network 9a6ec510-0e53-48e0-b7c2-57a700c9e461 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:35:59.938981 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-b562c2c6-5937-44e0-b748-09c78c24c0c4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 9a6ec510-0e53-48e0-b7c2-57a700c9e461) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:35:59.944288 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b562c2c6-5937-44e0-b748-09c78c24c0c4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:35:59.945265 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b562c2c6-5937-44e0-b748-09c78c24c0c4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:35:59.970287 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b562c2c6-5937-44e0-b748-09c78c24c0c4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 812 time: 0.4330406 Dec 09 21:35:59.972101 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51950) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:35:59.987306 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be1d6937-f8af-400b-bb7f-9853c7ee5b2f None None] Resources bound (agent type, host, resource id): {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 09 21:36:00.046028 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-a23b160e-4eeb-4fe2-a02b-134eb95edd73 req-c457ac67-201c-44ae-8a7e-13ad72fb45e5 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Deleting port 1e54159e-3c83-49a1-a5b5-3e2b29336c43 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:36:00.046710 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a23b160e-4eeb-4fe2-a02b-134eb95edd73 req-c457ac67-201c-44ae-8a7e-13ad72fb45e5 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:00.086662 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e441a507-adc4-46af-b2d7-c83a593cd489 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:00.145164 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-a23b160e-4eeb-4fe2-a02b-134eb95edd73 req-c457ac67-201c-44ae-8a7e-13ad72fb45e5 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] For port 1e54159e-3c83-49a1-a5b5-3e2b29336c43, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=1e54159e-3c83-49a1-a5b5-3e2b29336c43,segment=NetworkSegment(dcec1a9e-3140-49cf-a664-3f1f0937898f),segment_id=dcec1a9e-3140-49cf-a664-3f1f0937898f)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:00.145917 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a23b160e-4eeb-4fe2-a02b-134eb95edd73 req-c457ac67-201c-44ae-8a7e-13ad72fb45e5 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:00.148879 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e441a507-adc4-46af-b2d7-c83a593cd489 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:00.161321 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-a23b160e-4eeb-4fe2-a02b-134eb95edd73 req-c457ac67-201c-44ae-8a7e-13ad72fb45e5 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Calling delete_port for 1e54159e-3c83-49a1-a5b5-3e2b29336c43 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:36:00.215989 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e441a507-adc4-46af-b2d7-c83a593cd489 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:00.244892 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e441a507-adc4-46af-b2d7-c83a593cd489 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Subnet': ['ID=b4c6f5b6-844f-47d8-b167-6127838825bf,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:00.350144 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a23b160e-4eeb-4fe2-a02b-134eb95edd73 req-c457ac67-201c-44ae-8a7e-13ad72fb45e5 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:00.354952 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e441a507-adc4-46af-b2d7-c83a593cd489 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:00.368411 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['1e54159e-3c83-49a1-a5b5-3e2b29336c43'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:36:00.379887 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c457ac67-201c-44ae-8a7e-13ad72fb45e5 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Pushing event deleted for resources: {'Port': ['ID=1e54159e-3c83-49a1-a5b5-3e2b29336c43,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:00.385588 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e441a507-adc4-46af-b2d7-c83a593cd489 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9a6ec510-0e53-48e0-b7c2-57a700c9e461']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:00.399372 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e441a507-adc4-46af-b2d7-c83a593cd489 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '43435e63-4283-461e-bc44-1a8c6286cc78') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:00.399729 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e441a507-adc4-46af-b2d7-c83a593cd489 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '43435e63-4283-461e-bc44-1a8c6286cc78') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:00.402851 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3b097e57-4ab2-4d14-ad4d-70ebe7c572e1 None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 21:36:00.430390 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-a23b160e-4eeb-4fe2-a02b-134eb95edd73 req-c457ac67-201c-44ae-8a7e-13ad72fb45e5 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] No DVR routers for this DVR port 1e54159e-3c83-49a1-a5b5-3e2b29336c43 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:36:00.432970 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a23b160e-4eeb-4fe2-a02b-134eb95edd73 req-c457ac67-201c-44ae-8a7e-13ad72fb45e5 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:00.436891 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a23b160e-4eeb-4fe2-a02b-134eb95edd73 req-c457ac67-201c-44ae-8a7e-13ad72fb45e5 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.31 "DELETE /v2.0/ports/1e54159e-3c83-49a1-a5b5-3e2b29336c43 HTTP/1.1" status: 204 len: 173 time: 0.5521049 Dec 09 21:36:00.437361 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'af704653-9f02-4515-9fb8-0f0869d126b2', 'name': 'network-vif-deleted', 'tag': '1e54159e-3c83-49a1-a5b5-3e2b29336c43'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:36:00.438004 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e441a507-adc4-46af-b2d7-c83a593cd489 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:00.439741 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d593e4a2-0b14-4664-8535-84f752aacff0" -d '{"events": [{"server_uuid": "af704653-9f02-4515-9fb8-0f0869d126b2", "name": "network-vif-deleted", "tag": "1e54159e-3c83-49a1-a5b5-3e2b29336c43"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:36:00.461036 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e441a507-adc4-46af-b2d7-c83a593cd489 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:00.468775 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e441a507-adc4-46af-b2d7-c83a593cd489 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Releasing vlan 131 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:36:00.469605 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e441a507-adc4-46af-b2d7-c83a593cd489 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:36:00.474231 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:36:00.512011 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:36:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-94a9246e-f650-4c93-a108-9a79dd29708e x-openstack-request-id: req-94a9246e-f650-4c93-a108-9a79dd29708e {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:36:00.512310 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "af704653-9f02-4515-9fb8-0f0869d126b2", "name": "network-vif-deleted", "tag": "1e54159e-3c83-49a1-a5b5-3e2b29336c43", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:36:00.512566 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-94a9246e-f650-4c93-a108-9a79dd29708e {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:36:00.512979 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'af704653-9f02-4515-9fb8-0f0869d126b2', 'name': 'network-vif-deleted', 'tag': '1e54159e-3c83-49a1-a5b5-3e2b29336c43', 'status': 'completed', 'code': 200} Dec 09 21:36:00.578504 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e441a507-adc4-46af-b2d7-c83a593cd489 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:00.604466 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3b097e57-4ab2-4d14-ad4d-70ebe7c572e1 None None] Resources bound (agent type, host, resource id): {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 09 21:36:00.607406 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f17494ca-c77e-41d0-859e-b3be96c4d432 req-1274d522-a930-471c-81d7-1894b63b7390 tempest-ServersNegativeTestJSON-997748189 tempest-ServersNegativeTestJSON-997748189-project] 10.222.0.13 "GET /v2.0/ports?device_id=af704653-9f02-4515-9fb8-0f0869d126b2 HTTP/1.1" status: 200 len: 210 time: 0.0403299 Dec 09 21:36:00.608483 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e441a507-adc4-46af-b2d7-c83a593cd489 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:00.617386 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51960) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:00.617566 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e441a507-adc4-46af-b2d7-c83a593cd489 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/networks/9a6ec510-0e53-48e0-b7c2-57a700c9e461 HTTP/1.1" status: 204 len: 168 time: 0.6442294 Dec 09 21:36:00.623207 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-cd1ffdca-297f-4a9a-979e-3fe4a3cba40d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-970007264'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:00.631904 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e441a507-adc4-46af-b2d7-c83a593cd489 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Network': ['ID=9a6ec510-0e53-48e0-b7c2-57a700c9e461,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:00.659623 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cd1ffdca-297f-4a9a-979e-3fe4a3cba40d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Made reservation on behalf of 106acb1a6547449093d08a9502ab70fb for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:36:00.665067 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd1ffdca-297f-4a9a-979e-3fe4a3cba40d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:00.693073 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cd1ffdca-297f-4a9a-979e-3fe4a3cba40d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] vlan segment allocate from pool success with {'vlan_id': 123, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:36:00.704976 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd1ffdca-297f-4a9a-979e-3fe4a3cba40d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:00.705324 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-cd1ffdca-297f-4a9a-979e-3fe4a3cba40d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Added segment 4fd7d816-fcfb-4cc5-8e40-4a7945a20ae4 of type vlan for network 5bb06521-7b99-4b40-a820-86aa2f15e7e3 Dec 09 21:36:00.760499 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd1ffdca-297f-4a9a-979e-3fe4a3cba40d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:00.785920 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd1ffdca-297f-4a9a-979e-3fe4a3cba40d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:00.791700 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd1ffdca-297f-4a9a-979e-3fe4a3cba40d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:00.792313 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd1ffdca-297f-4a9a-979e-3fe4a3cba40d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:00.833020 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cd1ffdca-297f-4a9a-979e-3fe4a3cba40d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.2145131 Dec 09 21:36:00.835963 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51962) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:00.841144 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-cb2f5ac1-c683-49c6-be43-4ef12cada56e tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Request body: {'subnet': {'network_id': '5bb06521-7b99-4b40-a820-86aa2f15e7e3', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:00.865136 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd1ffdca-297f-4a9a-979e-3fe4a3cba40d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'Network': ['ID=5bb06521-7b99-4b40-a820-86aa2f15e7e3,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:00.878883 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 5bb06521-7b99-4b40-a820-86aa2f15e7e3 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:36:00.929742 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cb2f5ac1-c683-49c6-be43-4ef12cada56e tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Made reservation on behalf of 106acb1a6547449093d08a9502ab70fb for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:36:00.933385 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cb2f5ac1-c683-49c6-be43-4ef12cada56e tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:00.959903 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a3517788-bf81-4429-9dc2-5705a2fb3a7b None None] Network 9a6ec510-0e53-48e0-b7c2-57a700c9e461 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:00.961760 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6fca5105-d83f-4da2-907d-469f90aad0e0 None None] DHCP port deletion for 88af5e51-6d1a-432d-8676-517f449774a3 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:36:00.986822 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a3517788-bf81-4429-9dc2-5705a2fb3a7b None None] Network 9a6ec510-0e53-48e0-b7c2-57a700c9e461 could not be found, it might have been deleted concurrently. {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:224}} Dec 09 21:36:00.996452 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71d456c1-ef97-48a3-8234-8bd861c551ab None None] Network 9a6ec510-0e53-48e0-b7c2-57a700c9e461 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:01.009869 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71d456c1-ef97-48a3-8234-8bd861c551ab None None] Network 9a6ec510-0e53-48e0-b7c2-57a700c9e461 could not be found, it might have been deleted concurrently. {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:224}} Dec 09 21:36:01.396566 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cb2f5ac1-c683-49c6-be43-4ef12cada56e tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:01.459704 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb2f5ac1-c683-49c6-be43-4ef12cada56e tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'Subnet': ['ID=95860e0b-69b2-4921-be7d-f8f647877bab,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:01.473018 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cb2f5ac1-c683-49c6-be43-4ef12cada56e tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Checking segment: {'id': '4fd7d816-fcfb-4cc5-8e40-4a7945a20ae4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '5bb06521-7b99-4b40-a820-86aa2f15e7e3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:36:01.473382 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb2f5ac1-c683-49c6-be43-4ef12cada56e tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Network hostable DHCP agents. Network: 5bb06521-7b99-4b40-a820-86aa2f15e7e3, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:36:01.492530 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb2f5ac1-c683-49c6-be43-4ef12cada56e tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Network 5bb06521-7b99-4b40-a820-86aa2f15e7e3 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:36:01.504653 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-cb2f5ac1-c683-49c6-be43-4ef12cada56e tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 5bb06521-7b99-4b40-a820-86aa2f15e7e3) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:01.509005 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb2f5ac1-c683-49c6-be43-4ef12cada56e tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:01.509670 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cb2f5ac1-c683-49c6-be43-4ef12cada56e tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:01.515331 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3f1a949-f087-45ee-be45-bea3e2252606 None None] Network 5bb06521-7b99-4b40-a820-86aa2f15e7e3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:01.532238 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cb2f5ac1-c683-49c6-be43-4ef12cada56e tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.6923847 Dec 09 21:36:01.532550 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51968) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:01.538329 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-d753857a-1b74-4d11-a8eb-909c0e70ff74 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Request body: {'subnet': {'network_id': '5bb06521-7b99-4b40-a820-86aa2f15e7e3', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:01.582478 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 251fbc8e-86af-4b4b-b5a7-6614df880418 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:36:01.660145 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d753857a-1b74-4d11-a8eb-909c0e70ff74 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Made reservation on behalf of 106acb1a6547449093d08a9502ab70fb for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:36:01.664041 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 251fbc8e-86af-4b4b-b5a7-6614df880418 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:01.664418 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:01.667475 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-219edec5-8eab-477b-a59d-d27c2b45c930 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-5bb06521-7b99-4b40-a820-86aa2f15e7e3', 'network_id': '5bb06521-7b99-4b40-a820-86aa2f15e7e3', 'project_id': '106acb1a6547449093d08a9502ab70fb', 'fixed_ips': [{'subnet_id': '95860e0b-69b2-4921-be7d-f8f647877bab'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:36:01.667643 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d753857a-1b74-4d11-a8eb-909c0e70ff74 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:01.668314 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-219edec5-8eab-477b-a59d-d27c2b45c930 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:01.883992 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-219edec5-8eab-477b-a59d-d27c2b45c930 None None] Allocated IP 2001:db8::2 (5bb06521-7b99-4b40-a820-86aa2f15e7e3/95860e0b-69b2-4921-be7d-f8f647877bab/8ae411d9-1c4b-4c74-bd82-a6642b6bd85c) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:36:01.946992 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d753857a-1b74-4d11-a8eb-909c0e70ff74 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:01.953621 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51972) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:01.994036 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d753857a-1b74-4d11-a8eb-909c0e70ff74 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Network 5bb06521-7b99-4b40-a820-86aa2f15e7e3 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:36:01.997834 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-d753857a-1b74-4d11-a8eb-909c0e70ff74 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:02.002496 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d753857a-1b74-4d11-a8eb-909c0e70ff74 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:02.002729 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-3e15fe28-8315-4313-8509-64229690b215 admin admin] Deleting subnet 4700ee88-1952-42ab-9242-d93b9f07f2be {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:36:02.003525 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d753857a-1b74-4d11-a8eb-909c0e70ff74 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.006405 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3e15fe28-8315-4313-8509-64229690b215 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.016009 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d753857a-1b74-4d11-a8eb-909c0e70ff74 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'Subnet': ['ID=4a3ceb02-26d8-4f01-acb7-a76eda2a5391,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:02.028782 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d753857a-1b74-4d11-a8eb-909c0e70ff74 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 0.4944110 Dec 09 21:36:02.031642 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51974) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:02.046320 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3e15fe28-8315-4313-8509-64229690b215 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.051772 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-219edec5-8eab-477b-a59d-d27c2b45c930 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.057846 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-219edec5-8eab-477b-a59d-d27c2b45c930 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.089842 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3e15fe28-8315-4313-8509-64229690b215 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.095430 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2687e7ae-e58e-4568-92a5-d0979206db55 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:02.096139 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-219edec5-8eab-477b-a59d-d27c2b45c930 None None] Network 5bb06521-7b99-4b40-a820-86aa2f15e7e3 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:36:02.097317 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2687e7ae-e58e-4568-92a5-d0979206db55 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:02.098910 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2687e7ae-e58e-4568-92a5-d0979206db55 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:02.100991 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2687e7ae-e58e-4568-92a5-d0979206db55 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:02.101125 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-219edec5-8eab-477b-a59d-d27c2b45c930 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:02.102787 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2687e7ae-e58e-4568-92a5-d0979206db55 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:02.103876 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-219edec5-8eab-477b-a59d-d27c2b45c930 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:36:02.104812 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2687e7ae-e58e-4568-92a5-d0979206db55 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 3330 time: 0.0718985 Dec 09 21:36:02.108746 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51976) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:02.117269 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-219edec5-8eab-477b-a59d-d27c2b45c930 None None] Pushing event updated for resources: {'Port': ['ID=8ae411d9-1c4b-4c74-bd82-a6642b6bd85c,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:02.118146 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-b3347742-0275-4896-97ff-14fef35fb037 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-639037372'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:02.153470 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b3347742-0275-4896-97ff-14fef35fb037 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Made reservation on behalf of 106acb1a6547449093d08a9502ab70fb for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:36:02.157205 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b3347742-0275-4896-97ff-14fef35fb037 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.166511 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-219edec5-8eab-477b-a59d-d27c2b45c930 None None] Attempting to bind port 8ae411d9-1c4b-4c74-bd82-a6642b6bd85c on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:36:02.166882 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-219edec5-8eab-477b-a59d-d27c2b45c930 None None] Attempting to bind port 8ae411d9-1c4b-4c74-bd82-a6642b6bd85c by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '4fd7d816-fcfb-4cc5-8e40-4a7945a20ae4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '5bb06521-7b99-4b40-a820-86aa2f15e7e3'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:36:02.167280 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-219edec5-8eab-477b-a59d-d27c2b45c930 None None] Attempting to bind port 8ae411d9-1c4b-4c74-bd82-a6642b6bd85c on network 5bb06521-7b99-4b40-a820-86aa2f15e7e3 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:36:02.172338 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-219edec5-8eab-477b-a59d-d27c2b45c930 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 35, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:36:02.172804 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-219edec5-8eab-477b-a59d-d27c2b45c930 None None] Checking segment: {'id': '4fd7d816-fcfb-4cc5-8e40-4a7945a20ae4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '5bb06521-7b99-4b40-a820-86aa2f15e7e3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:36:02.173204 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-219edec5-8eab-477b-a59d-d27c2b45c930 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.173592 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-219edec5-8eab-477b-a59d-d27c2b45c930 None None] Bound using segment: {'id': '4fd7d816-fcfb-4cc5-8e40-4a7945a20ae4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '5bb06521-7b99-4b40-a820-86aa2f15e7e3'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:36:02.174052 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-219edec5-8eab-477b-a59d-d27c2b45c930 None None] Bound port: 8ae411d9-1c4b-4c74-bd82-a6642b6bd85c, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4fd7d816-fcfb-4cc5-8e40-4a7945a20ae4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '5bb06521-7b99-4b40-a820-86aa2f15e7e3'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:36:02.174482 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-219edec5-8eab-477b-a59d-d27c2b45c930 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.185616 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3e15fe28-8315-4313-8509-64229690b215 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.194687 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b3347742-0275-4896-97ff-14fef35fb037 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] vlan segment allocate from pool success with {'vlan_id': 146, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:36:02.221557 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3e15fe28-8315-4313-8509-64229690b215 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.225261 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3e15fe28-8315-4313-8509-64229690b215 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/4700ee88-1952-42ab-9242-d93b9f07f2be HTTP/1.1" status: 204 len: 168 time: 0.2703533 Dec 09 21:36:02.227505 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e15fe28-8315-4313-8509-64229690b215 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4700ee88-1952-42ab-9242-d93b9f07f2be,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:02.228337 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51978) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:02.230964 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22871faa-3de0-45db-baad-cf09b2e80d1d None None] Network 88af5e51-6d1a-432d-8676-517f449774a3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:02.233286 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b3347742-0275-4896-97ff-14fef35fb037 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.233631 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-b3347742-0275-4896-97ff-14fef35fb037 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Added segment 8b1d3596-7f80-430b-a316-98a04f2845b6 of type vlan for network 8bd558ba-874a-4f3c-ad0a-afcc7bd684c3 Dec 09 21:36:02.262525 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-219edec5-8eab-477b-a59d-d27c2b45c930 None None] For port 8ae411d9-1c4b-4c74-bd82-a6642b6bd85c, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:36:02.279807 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b3347742-0275-4896-97ff-14fef35fb037 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.303518 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-219edec5-8eab-477b-a59d-d27c2b45c930 None None] For port 8ae411d9-1c4b-4c74-bd82-a6642b6bd85c, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=8ae411d9-1c4b-4c74-bd82-a6642b6bd85c,segment=NetworkSegment(4fd7d816-fcfb-4cc5-8e40-4a7945a20ae4),segment_id=4fd7d816-fcfb-4cc5-8e40-4a7945a20ae4)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:36:02.309566 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b3347742-0275-4896-97ff-14fef35fb037 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.311268 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-91250a61-dcdf-45a3-aa64-612cc32b5846 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.316087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b3347742-0275-4896-97ff-14fef35fb037 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:02.316771 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b3347742-0275-4896-97ff-14fef35fb037 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.324215 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-219edec5-8eab-477b-a59d-d27c2b45c930 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.353959 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce3dce9f-b569-4c0e-a089-aebc8aff8220 None None] DHCP port deletion for 88af5e51-6d1a-432d-8676-517f449774a3 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:36:02.390897 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-219edec5-8eab-477b-a59d-d27c2b45c930 None None] Pushing event updated for resources: {'Port': ['ID=8ae411d9-1c4b-4c74-bd82-a6642b6bd85c,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:02.402622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3347742-0275-4896-97ff-14fef35fb037 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'Network': ['ID=8bd558ba-874a-4f3c-ad0a-afcc7bd684c3,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:02.406239 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-91250a61-dcdf-45a3-aa64-612cc32b5846 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.412117 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 8bd558ba-874a-4f3c-ad0a-afcc7bd684c3 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:36:02.421414 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b3347742-0275-4896-97ff-14fef35fb037 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.3115830 Dec 09 21:36:02.423974 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51980) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:02.430624 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-9c2ad088-527f-4ac5-98af-a88e5c0dd768 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Request body: {'network': {'name': 'New_network'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:02.436618 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-91250a61-dcdf-45a3-aa64-612cc32b5846 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['88af5e51-6d1a-432d-8676-517f449774a3']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:02.447880 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-91250a61-dcdf-45a3-aa64-612cc32b5846 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dcec1a9e-3140-49cf-a664-3f1f0937898f') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:02.448179 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-91250a61-dcdf-45a3-aa64-612cc32b5846 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dcec1a9e-3140-49cf-a664-3f1f0937898f') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:02.464520 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-91250a61-dcdf-45a3-aa64-612cc32b5846 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.489059 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-91250a61-dcdf-45a3-aa64-612cc32b5846 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.497680 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-91250a61-dcdf-45a3-aa64-612cc32b5846 admin admin] Releasing vlan 107 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:36:02.498153 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-91250a61-dcdf-45a3-aa64-612cc32b5846 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:36:02.500336 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:36:02.570316 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-91250a61-dcdf-45a3-aa64-612cc32b5846 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.587631 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-91250a61-dcdf-45a3-aa64-612cc32b5846 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.591161 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-91250a61-dcdf-45a3-aa64-612cc32b5846 admin admin] 10.222.0.13 "DELETE /v2.0/networks/88af5e51-6d1a-432d-8676-517f449774a3 HTTP/1.1" status: 204 len: 168 time: 0.3604949 Dec 09 21:36:02.592095 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91250a61-dcdf-45a3-aa64-612cc32b5846 admin admin] Pushing event deleted for resources: {'Network': ['ID=88af5e51-6d1a-432d-8676-517f449774a3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:02.661438 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9c2ad088-527f-4ac5-98af-a88e5c0dd768 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.676849 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9c2ad088-527f-4ac5-98af-a88e5c0dd768 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.701092 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-9c2ad088-527f-4ac5-98af-a88e5c0dd768 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Network 8bd558ba-874a-4f3c-ad0a-afcc7bd684c3 is not hosted by any dhcp agent {{(pid=103438) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 09 21:36:02.707218 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9c2ad088-527f-4ac5-98af-a88e5c0dd768 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:02.708034 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9c2ad088-527f-4ac5-98af-a88e5c0dd768 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.709173 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9c2ad088-527f-4ac5-98af-a88e5c0dd768 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "PUT /v2.0/networks/8bd558ba-874a-4f3c-ad0a-afcc7bd684c3 HTTP/1.1" status: 200 len: 723 time: 0.2838764 Dec 09 21:36:02.712227 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51988) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:02.721311 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-534208d5-7aec-4262-a9bd-50eaf0b0f0a3 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Request body: {'subnet': {'network_id': '8bd558ba-874a-4f3c-ad0a-afcc7bd684c3', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:02.784004 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c2ad088-527f-4ac5-98af-a88e5c0dd768 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'Network': ['ID=8bd558ba-874a-4f3c-ad0a-afcc7bd684c3,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:02.796999 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 8bd558ba-874a-4f3c-ad0a-afcc7bd684c3 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:36:02.854859 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51990) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:02.870680 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-534208d5-7aec-4262-a9bd-50eaf0b0f0a3 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Made reservation on behalf of 106acb1a6547449093d08a9502ab70fb for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:36:02.874839 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-534208d5-7aec-4262-a9bd-50eaf0b0f0a3 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.898367 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-851ca5c9-6601-4275-b5d6-3e9026014e77 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=b65669b5d4924ee090e9583aa839a399&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0422118 Dec 09 21:36:02.901146 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51992) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:02.951963 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-81e2280c-a651-4563-b227-d5c1f92908c1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.958749 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-abdac49e-e77e-445c-a7ca-6ea871811064 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:02.985041 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-abdac49e-e77e-445c-a7ca-6ea871811064 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:03.038524 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-abdac49e-e77e-445c-a7ca-6ea871811064 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:03.041771 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-abdac49e-e77e-445c-a7ca-6ea871811064 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:03.042951 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-abdac49e-e77e-445c-a7ca-6ea871811064 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/9cc9673e-b099-41ab-8794-d9dc3c1a9e23 HTTP/1.1" status: 204 len: 168 time: 0.1408334 Dec 09 21:36:03.051581 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abdac49e-e77e-445c-a7ca-6ea871811064 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9cc9673e-b099-41ab-8794-d9dc3c1a9e23,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:03.075949 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-534208d5-7aec-4262-a9bd-50eaf0b0f0a3 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:03.138423 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-534208d5-7aec-4262-a9bd-50eaf0b0f0a3 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'Subnet': ['ID=27ab7646-b81d-4673-ad4a-601f72029ce4,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:03.146414 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-534208d5-7aec-4262-a9bd-50eaf0b0f0a3 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Checking segment: {'id': '8b1d3596-7f80-430b-a316-98a04f2845b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '8bd558ba-874a-4f3c-ad0a-afcc7bd684c3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:36:03.146778 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-534208d5-7aec-4262-a9bd-50eaf0b0f0a3 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Network hostable DHCP agents. Network: 8bd558ba-874a-4f3c-ad0a-afcc7bd684c3, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:36:03.168163 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-534208d5-7aec-4262-a9bd-50eaf0b0f0a3 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Network 8bd558ba-874a-4f3c-ad0a-afcc7bd684c3 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:36:03.180368 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-534208d5-7aec-4262-a9bd-50eaf0b0f0a3 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 8bd558ba-874a-4f3c-ad0a-afcc7bd684c3) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:03.185338 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-534208d5-7aec-4262-a9bd-50eaf0b0f0a3 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:03.186194 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-534208d5-7aec-4262-a9bd-50eaf0b0f0a3 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:03.191953 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d74cdd25-419d-4ece-8cdc-4f1f500244fe None None] Network 8bd558ba-874a-4f3c-ad0a-afcc7bd684c3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:03.208648 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51996) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:03.208818 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-534208d5-7aec-4262-a9bd-50eaf0b0f0a3 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4954751 Dec 09 21:36:03.214386 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-75b80774-fbf7-4eac-8aad-fda0a13e88fd tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Request body: {'subnet': {'name': 'New_subnet'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:03.326049 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f6a10b7-b2ad-466a-ae66-26f96b66519c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-8bd558ba-874a-4f3c-ad0a-afcc7bd684c3', 'network_id': '8bd558ba-874a-4f3c-ad0a-afcc7bd684c3', 'project_id': '106acb1a6547449093d08a9502ab70fb', 'fixed_ips': [{'subnet_id': '27ab7646-b81d-4673-ad4a-601f72029ce4'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:36:03.327072 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0f6a10b7-b2ad-466a-ae66-26f96b66519c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:03.346442 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-75b80774-fbf7-4eac-8aad-fda0a13e88fd tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-8601298'] for subnet, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:03.515296 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-75b80774-fbf7-4eac-8aad-fda0a13e88fd tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8731650215464', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-8621804'] for subnet, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:03.533543 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-75b80774-fbf7-4eac-8aad-fda0a13e88fd tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:03.534395 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-75b80774-fbf7-4eac-8aad-fda0a13e88fd tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:03.539790 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52010) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:03.552799 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-75b80774-fbf7-4eac-8aad-fda0a13e88fd tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "PUT /v2.0/subnets/27ab7646-b81d-4673-ad4a-601f72029ce4 HTTP/1.1" status: 200 len: 826 time: 0.3421335 Dec 09 21:36:03.639541 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-0f6a10b7-b2ad-466a-ae66-26f96b66519c None None] Allocated IP 2001:db8::2 (8bd558ba-874a-4f3c-ad0a-afcc7bd684c3/27ab7646-b81d-4673-ad4a-601f72029ce4/b2816c19-a2c0-4aed-b1d5-908d7592ea63) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:36:03.645655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75b80774-fbf7-4eac-8aad-fda0a13e88fd tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'Subnet': ['ID=27ab7646-b81d-4673-ad4a-601f72029ce4,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:03.670580 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 8ae411d9-1c4b-4c74-bd82-a6642b6bd85c up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:36:03.718608 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:03.784597 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:03.915842 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c18e319d-f51e-46d6-a73c-1dd9afc4cbfa None None] Network 5bb06521-7b99-4b40-a820-86aa2f15e7e3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:03.919349 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1e54159e-3c83-49a1-a5b5-3e2b29336c43 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:36:03.971325 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 1e54159e-3c83-49a1-a5b5-3e2b29336c43 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:36:03.972059 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 1e54159e-3c83-49a1-a5b5-3e2b29336c43 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:36:04.065654 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e0f06df7-282b-4264-8c46-4366bae113de None None] Provisioning complete for port 8ae411d9-1c4b-4c74-bd82-a6642b6bd85c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:04.066034 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e0f06df7-282b-4264-8c46-4366bae113de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:04.176561 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 8ae411d9-1c4b-4c74-bd82-a6642b6bd85c triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:04.176943 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:04.256113 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0f6a10b7-b2ad-466a-ae66-26f96b66519c None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:04.272293 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0f6a10b7-b2ad-466a-ae66-26f96b66519c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:04.287806 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:04.323867 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e0f06df7-282b-4264-8c46-4366bae113de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:04.327624 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Subnet': ['ID=27ab7646-b81d-4673-ad4a-601f72029ce4,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:04.337821 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f6a10b7-b2ad-466a-ae66-26f96b66519c None None] Network 8bd558ba-874a-4f3c-ad0a-afcc7bd684c3 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:36:04.357096 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-0f6a10b7-b2ad-466a-ae66-26f96b66519c None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:04.379796 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f6a10b7-b2ad-466a-ae66-26f96b66519c None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:36:04.381555 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f6a10b7-b2ad-466a-ae66-26f96b66519c None None] Pushing event updated for resources: {'Port': ['ID=b2816c19-a2c0-4aed-b1d5-908d7592ea63,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:04.404340 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:04.426930 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8bd558ba-874a-4f3c-ad0a-afcc7bd684c3']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:04.440599 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8b1d3596-7f80-430b-a316-98a04f2845b6') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:04.441061 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8b1d3596-7f80-430b-a316-98a04f2845b6') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:04.455894 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:04.468774 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e0f06df7-282b-4264-8c46-4366bae113de None None] For port 8ae411d9-1c4b-4c74-bd82-a6642b6bd85c, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=8ae411d9-1c4b-4c74-bd82-a6642b6bd85c,segment=NetworkSegment(4fd7d816-fcfb-4cc5-8e40-4a7945a20ae4),segment_id=4fd7d816-fcfb-4cc5-8e40-4a7945a20ae4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:04.476785 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:04.484317 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Releasing vlan 146 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:36:04.484791 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:36:04.487947 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:36:04.494007 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-73d4fb5a-3c2f-4999-ab65-cf902690fb69 None None] Update dhcp port {'port': {'network_id': '5bb06521-7b99-4b40-a820-86aa2f15e7e3', 'fixed_ips': [{'subnet_id': '95860e0b-69b2-4921-be7d-f8f647877bab', 'ip_address': '2001:db8::2'}, {'subnet_id': '4a3ceb02-26d8-4f01-acb7-a76eda2a5391'}], 'binding:host_id': 'n-d-713301-27'}, 'id': '8ae411d9-1c4b-4c74-bd82-a6642b6bd85c'} from n-d-713301-27. {{(pid=103439) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 09 21:36:04.495786 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e0f06df7-282b-4264-8c46-4366bae113de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:04.504525 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:04.559386 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0f6a10b7-b2ad-466a-ae66-26f96b66519c None None] Attempting to bind port b2816c19-a2c0-4aed-b1d5-908d7592ea63 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:36:04.559818 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0f6a10b7-b2ad-466a-ae66-26f96b66519c None None] Attempting to bind port b2816c19-a2c0-4aed-b1d5-908d7592ea63 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '8b1d3596-7f80-430b-a316-98a04f2845b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '8bd558ba-874a-4f3c-ad0a-afcc7bd684c3'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:36:04.559946 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.db.api [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 09 21:36:04.559946 n-d-713301-27 neutron-server[103438]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 09 21:36:04.559946 n-d-713301-27 neutron-server[103438]: [parameters: {'id': '8bd558ba-874a-4f3c-ad0a-afcc7bd684c3'}] Dec 09 21:36:04.559946 n-d-713301-27 neutron-server[103438]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103438) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:36:04.560695 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f6a10b7-b2ad-466a-ae66-26f96b66519c None None] Attempting to bind port b2816c19-a2c0-4aed-b1d5-908d7592ea63 on network 8bd558ba-874a-4f3c-ad0a-afcc7bd684c3 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:36:04.560889 n-d-713301-27 neutron-server[103438]: DEBUG oslo_db.api [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:36:04.586045 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-73d4fb5a-3c2f-4999-ab65-cf902690fb69 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:04.589382 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f6a10b7-b2ad-466a-ae66-26f96b66519c None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 35, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:36:04.590008 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f6a10b7-b2ad-466a-ae66-26f96b66519c None None] Checking segment: {'id': '8b1d3596-7f80-430b-a316-98a04f2845b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '8bd558ba-874a-4f3c-ad0a-afcc7bd684c3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:36:04.590589 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0f6a10b7-b2ad-466a-ae66-26f96b66519c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:04.591182 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f6a10b7-b2ad-466a-ae66-26f96b66519c None None] Bound using segment: {'id': '8b1d3596-7f80-430b-a316-98a04f2845b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '8bd558ba-874a-4f3c-ad0a-afcc7bd684c3'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:36:04.591963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0f6a10b7-b2ad-466a-ae66-26f96b66519c None None] Bound port: b2816c19-a2c0-4aed-b1d5-908d7592ea63, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8b1d3596-7f80-430b-a316-98a04f2845b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '8bd558ba-874a-4f3c-ad0a-afcc7bd684c3'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:36:04.592565 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0f6a10b7-b2ad-466a-ae66-26f96b66519c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:04.649032 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0f06df7-282b-4264-8c46-4366bae113de None None] Pushing event updated for resources: {'Port': ['ID=8ae411d9-1c4b-4c74-bd82-a6642b6bd85c,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:04.716843 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:36:04.717215 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:36:04.803179 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0f6a10b7-b2ad-466a-ae66-26f96b66519c None None] For port b2816c19-a2c0-4aed-b1d5-908d7592ea63, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:36:04.808516 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0f6a10b7-b2ad-466a-ae66-26f96b66519c None None] For port b2816c19-a2c0-4aed-b1d5-908d7592ea63, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b2816c19-a2c0-4aed-b1d5-908d7592ea63,segment=NetworkSegment(8b1d3596-7f80-430b-a316-98a04f2845b6),segment_id=8b1d3596-7f80-430b-a316-98a04f2845b6)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:36:04.814752 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0f6a10b7-b2ad-466a-ae66-26f96b66519c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:04.932345 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-73d4fb5a-3c2f-4999-ab65-cf902690fb69 None None] Allocated IP 172.20.0.1 (5bb06521-7b99-4b40-a820-86aa2f15e7e3/4a3ceb02-26d8-4f01-acb7-a76eda2a5391/8ae411d9-1c4b-4c74-bd82-a6642b6bd85c) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:36:04.943511 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f6a10b7-b2ad-466a-ae66-26f96b66519c None None] Pushing event updated for resources: {'Port': ['ID=b2816c19-a2c0-4aed-b1d5-908d7592ea63,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:04.988683 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46c24355-00a4-44a9-8b30-8cf63759699c None None] Network 8bd558ba-874a-4f3c-ad0a-afcc7bd684c3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:05.061397 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:05.114676 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-73d4fb5a-3c2f-4999-ab65-cf902690fb69 None None] For port 8ae411d9-1c4b-4c74-bd82-a6642b6bd85c, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=8ae411d9-1c4b-4c74-bd82-a6642b6bd85c,segment=NetworkSegment(4fd7d816-fcfb-4cc5-8e40-4a7945a20ae4),segment_id=4fd7d816-fcfb-4cc5-8e40-4a7945a20ae4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:05.125224 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Deleting port b2816c19-a2c0-4aed-b1d5-908d7592ea63 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:36:05.125605 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:05.151548 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-73d4fb5a-3c2f-4999-ab65-cf902690fb69 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:05.159738 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-73d4fb5a-3c2f-4999-ab65-cf902690fb69 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:05.169818 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22c92303-b941-4a05-b3ec-8f6657318634 None None] Network 8bd558ba-874a-4f3c-ad0a-afcc7bd684c3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:05.202268 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] For port b2816c19-a2c0-4aed-b1d5-908d7592ea63, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b2816c19-a2c0-4aed-b1d5-908d7592ea63,segment=NetworkSegment(8b1d3596-7f80-430b-a316-98a04f2845b6),segment_id=8b1d3596-7f80-430b-a316-98a04f2845b6)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:05.202682 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:05.228339 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Calling delete_port for b2816c19-a2c0-4aed-b1d5-908d7592ea63 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:36:05.354545 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73d4fb5a-3c2f-4999-ab65-cf902690fb69 None None] Pushing event updated for resources: {'Port': ['ID=8ae411d9-1c4b-4c74-bd82-a6642b6bd85c,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:05.360496 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:05.391078 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Port': ['ID=b2816c19-a2c0-4aed-b1d5-908d7592ea63,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:05.406210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77f8a85b-d470-4699-b6cf-06ddc8f05393 req-c0083f04-18b3-43e6-96f4-e825b0d72ec7 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:05.407817 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-77f8a85b-d470-4699-b6cf-06ddc8f05393 req-c0083f04-18b3-43e6-96f4-e825b0d72ec7 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0874717 Dec 09 21:36:05.410798 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] No DVR routers for this DVR port b2816c19-a2c0-4aed-b1d5-908d7592ea63 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:36:05.514929 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-77f8a85b-d470-4699-b6cf-06ddc8f05393 req-f1195797-8aff-43a8-9a63-aa2925c2b2a2 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0755324 Dec 09 21:36:05.549301 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c3dc315a-495c-4a5c-94ff-9b96f0440a89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:05.562480 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:05.584566 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 8ae411d9-1c4b-4c74-bd82-a6642b6bd85c up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:36:05.602354 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8bd558ba-874a-4f3c-ad0a-afcc7bd684c3']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:05.616133 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8b1d3596-7f80-430b-a316-98a04f2845b6') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:05.616960 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8b1d3596-7f80-430b-a316-98a04f2845b6') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:05.650182 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:05.663035 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 8ae411d9-1c4b-4c74-bd82-a6642b6bd85c triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:05.663398 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:05.709820 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:05.725273 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Releasing vlan 146 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:36:05.725914 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:36:05.730807 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:36:05.742203 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f9d3059-04b0-4f97-8d31-34ea580f4374 req-c3194676-c326-4b77-8071-f55a8558f0b7 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:05.744685 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1f9d3059-04b0-4f97-8d31-34ea580f4374 req-c3194676-c326-4b77-8071-f55a8558f0b7 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0914195 Dec 09 21:36:05.865024 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:05.881417 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:05.885142 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/networks/8bd558ba-874a-4f3c-ad0a-afcc7bd684c3 HTTP/1.1" status: 204 len: 168 time: 2.3426783 Dec 09 21:36:05.890161 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52078) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:05.933252 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-da8f0c30-35e4-4e89-9bc1-a324a1d06fb6 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] DELETE failed (client error): The resource could not be found. Dec 09 21:36:05.933806 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-da8f0c30-35e4-4e89-9bc1-a324a1d06fb6 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:36:05.945838 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-da8f0c30-35e4-4e89-9bc1-a324a1d06fb6 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/networks/8bd558ba-874a-4f3c-ad0a-afcc7bd684c3 HTTP/1.1" status: 404 len: 339 time: 0.0544167 Dec 09 21:36:05.949576 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52082) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:05.951687 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-590dfabd-a9a8-4e68-85fe-8e3619fd635f tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Network': ['ID=8bd558ba-874a-4f3c-ad0a-afcc7bd684c3,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:05.961634 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1f9d3059-04b0-4f97-8d31-34ea580f4374 req-8392b54e-7a6c-4c63-ae50-c14024d4a114 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2000163 Dec 09 21:36:05.965812 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-d4ea8430-8a15-4596-985e-a23c9362856d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-493050268', 'description': 'd1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:06.004260 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d4ea8430-8a15-4596-985e-a23c9362856d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Made reservation on behalf of 106acb1a6547449093d08a9502ab70fb for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:36:06.011065 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d4ea8430-8a15-4596-985e-a23c9362856d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:06.050782 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d4ea8430-8a15-4596-985e-a23c9362856d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] vlan segment allocate from pool success with {'vlan_id': 134, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:36:06.063074 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d4ea8430-8a15-4596-985e-a23c9362856d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:06.063932 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-d4ea8430-8a15-4596-985e-a23c9362856d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Added segment 0408f208-ed74-403e-b24a-0949fced382c of type vlan for network c83f9145-cac5-475b-80dc-a24cce52b7b2 Dec 09 21:36:06.147131 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d4ea8430-8a15-4596-985e-a23c9362856d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:06.184093 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d4ea8430-8a15-4596-985e-a23c9362856d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:06.191867 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d4ea8430-8a15-4596-985e-a23c9362856d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:06.192707 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d4ea8430-8a15-4596-985e-a23c9362856d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:06.202544 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52094) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:06.231551 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dfa7ac6c-0380-4896-819b-c3b1741779c0 None None] Network 5bb06521-7b99-4b40-a820-86aa2f15e7e3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:06.236108 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d4ea8430-8a15-4596-985e-a23c9362856d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 0.2839172 Dec 09 21:36:06.239165 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52100) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:06.298747 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4ea8430-8a15-4596-985e-a23c9362856d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'Network': ['ID=c83f9145-cac5-475b-80dc-a24cce52b7b2,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:06.322706 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network c83f9145-cac5-475b-80dc-a24cce52b7b2 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:36:06.369957 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-126fd6f9-6315-40fa-8005-f04dc85f9b43 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:06.374471 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-126fd6f9-6315-40fa-8005-f04dc85f9b43 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "GET /v2.0/networks?id=c83f9145-cac5-475b-80dc-a24cce52b7b2 HTTP/1.1" status: 200 len: 764 time: 0.1315484 Dec 09 21:36:06.375173 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52104) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:06.381088 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-17c2ac6e-601f-486d-baf8-10fe9827a794 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Request body: {'network': {'description': 'd2'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:06.397974 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d5d5c441-3182-47d2-9247-5e03dc248ee8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:06.414185 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-12b270c2-b497-4dc2-9f89-a3f696dece27 None None] Provisioning complete for port 8ae411d9-1c4b-4c74-bd82-a6642b6bd85c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:06.415381 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-12b270c2-b497-4dc2-9f89-a3f696dece27 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:06.454503 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-391602e3-ce56-441d-922e-037bfcb96180 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:06.463169 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-391602e3-ce56-441d-922e-037bfcb96180 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 812 time: 0.1964452 Dec 09 21:36:06.490043 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-2a073ec1-f152-413e-9802-a75706512e81 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/quotas/a36a93590a9f45e1b9b3f78753bb8e12 HTTP/1.1" status: 200 len: 375 time: 0.0260177 Dec 09 21:36:06.567775 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-17c2ac6e-601f-486d-baf8-10fe9827a794 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:06.595019 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d5d5c441-3182-47d2-9247-5e03dc248ee8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:06.603659 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:06.603949 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d5d5c441-3182-47d2-9247-5e03dc248ee8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:06.605384 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-17c2ac6e-601f-486d-baf8-10fe9827a794 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:06.629586 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-17c2ac6e-601f-486d-baf8-10fe9827a794 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Network c83f9145-cac5-475b-80dc-a24cce52b7b2 is not hosted by any dhcp agent {{(pid=103437) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 09 21:36:06.640965 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17c2ac6e-601f-486d-baf8-10fe9827a794 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:06.642242 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-17c2ac6e-601f-486d-baf8-10fe9827a794 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:06.647155 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-17c2ac6e-601f-486d-baf8-10fe9827a794 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "PUT /v2.0/networks/c83f9145-cac5-475b-80dc-a24cce52b7b2 HTTP/1.1" status: 200 len: 761 time: 0.2705960 Dec 09 21:36:06.647867 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-08c1f6e1-1950-42d9-80f5-919044eba3cd tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&fields=id HTTP/1.1" status: 200 len: 440 time: 0.1293969 Dec 09 21:36:06.648161 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52106) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:06.684487 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d5d5c441-3182-47d2-9247-5e03dc248ee8 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=f9afd602778147a7bf146e2be05233c0&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4808211 Dec 09 21:36:06.690503 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52108) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:06.694441 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5d5c441-3182-47d2-9247-5e03dc248ee8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c0f094db-47d4-412f-97c1-288517328bc6,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:06.782080 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-584641d4-e559-4bb8-95a2-db10a9848e43 service neutron] 10.222.0.13 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1179066 Dec 09 21:36:06.783950 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de92bb4f-7401-4631-a21a-e9a53a0dc37e None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 21:36:06.843400 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16c43ddd-1de9-47de-803d-19847c679078 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:06.845763 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-16c43ddd-1de9-47de-803d-19847c679078 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "GET /v2.0/networks?id=c83f9145-cac5-475b-80dc-a24cce52b7b2 HTTP/1.1" status: 200 len: 764 time: 0.1935575 Dec 09 21:36:06.847234 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c2ac6e-601f-486d-baf8-10fe9827a794 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'Network': ['ID=c83f9145-cac5-475b-80dc-a24cce52b7b2,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:06.855763 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52112) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:06.938064 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-84a09e1f-8092-4dd2-8dd0-40de5900cf2e service neutron] 10.222.0.13 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1481130 Dec 09 21:36:06.975097 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network c83f9145-cac5-475b-80dc-a24cce52b7b2 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:36:07.096930 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-55853d7c-0935-4f88-9330-fa9283f7387b None None] Provisioning complete for port 8ae411d9-1c4b-4c74-bd82-a6642b6bd85c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:07.097277 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-55853d7c-0935-4f88-9330-fa9283f7387b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:07.159532 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52429e6b-9591-4f86-993a-53b4fe195661 req-5036e4d6-0e5a-46a4-b188-fe253a617cb3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=62e2a8f5-9097-4f6a-a915-2c8303b50c10 HTTP/1.1" status: 200 len: 210 time: 0.0444577 Dec 09 21:36:07.194876 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ade2e792-f4fe-4c19-94f3-26182fec3e7b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:07.214245 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b68848e9-74ef-49f9-b721-d9999db989f7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:07.216064 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b68848e9-74ef-49f9-b721-d9999db989f7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 782 time: 0.3589838 Dec 09 21:36:07.218791 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52120) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:07.285147 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ade2e792-f4fe-4c19-94f3-26182fec3e7b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:07.292779 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6caaff7f-25a6-4cf1-a059-854b5c1bd359 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "GET /v2.0/subnets?network_id=97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 207 time: 0.0728872 Dec 09 21:36:07.297763 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52126) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:07.314185 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de92bb4f-7401-4631-a21a-e9a53a0dc37e None None] Resources bound (agent type, host, resource id): {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 09 21:36:07.382564 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ade2e792-f4fe-4c19-94f3-26182fec3e7b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:07.388070 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ade2e792-f4fe-4c19-94f3-26182fec3e7b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:07.393184 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ade2e792-f4fe-4c19-94f3-26182fec3e7b admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/c0f094db-47d4-412f-97c1-288517328bc6 HTTP/1.1" status: 204 len: 168 time: 0.7014115 Dec 09 21:36:07.408488 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ade2e792-f4fe-4c19-94f3-26182fec3e7b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c0f094db-47d4-412f-97c1-288517328bc6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:07.569488 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8c63e11-eede-4771-8179-07ad573c3ffb tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:07.578472 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8c63e11-eede-4771-8179-07ad573c3ffb tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:07.588155 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8c63e11-eede-4771-8179-07ad573c3ffb tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:07.594473 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8c63e11-eede-4771-8179-07ad573c3ffb tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:07.600518 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8c63e11-eede-4771-8179-07ad573c3ffb tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:07.606383 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8c63e11-eede-4771-8179-07ad573c3ffb tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:07.612294 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e8c63e11-eede-4771-8179-07ad573c3ffb tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "GET /v2.0/networks HTTP/1.1" status: 200 len: 3728 time: 0.3092160 Dec 09 21:36:07.612980 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52138) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:07.930341 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52142) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:07.949973 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-924fb673-3ff5-4977-ab67-23c2bf5d8ef2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:07.997845 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:08.082391 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-924fb673-3ff5-4977-ab67-23c2bf5d8ef2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:08.087684 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-924fb673-3ff5-4977-ab67-23c2bf5d8ef2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:08.130370 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-924fb673-3ff5-4977-ab67-23c2bf5d8ef2 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=6d9833d5b5a646cfa230fbf5098bd5df&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1983130 Dec 09 21:36:08.131279 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-924fb673-3ff5-4977-ab67-23c2bf5d8ef2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ffb3fefa-4822-4a40-bf09-dc1698b98484,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:08.135282 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52146) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:08.208771 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-85a098ae-b182-4876-a8eb-9d997a296dbf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:08.244477 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-59e35544-f193-4865-8295-b26b86c96fb3 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "GET /v2.0/networks?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 810 time: 0.6303995 Dec 09 21:36:08.248158 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52150) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:08.257559 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-85a098ae-b182-4876-a8eb-9d997a296dbf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:08.260916 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ed90bc0a-7951-4447-9627-f35b7406c622 req-a4c71579-7155-4a03-90d5-cc3237ee18e0 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=62e2a8f5-9097-4f6a-a915-2c8303b50c10 HTTP/1.1" status: 200 len: 210 time: 0.0322146 Dec 09 21:36:08.311999 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-85a098ae-b182-4876-a8eb-9d997a296dbf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:08.314628 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-85a098ae-b182-4876-a8eb-9d997a296dbf admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:08.315990 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-85a098ae-b182-4876-a8eb-9d997a296dbf admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/ffb3fefa-4822-4a40-bf09-dc1698b98484 HTTP/1.1" status: 204 len: 168 time: 0.1796546 Dec 09 21:36:08.320347 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78030569-5931-40ae-ad77-99ac1d090eb9 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:08.322223 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78030569-5931-40ae-ad77-99ac1d090eb9 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:08.323919 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78030569-5931-40ae-ad77-99ac1d090eb9 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:08.325865 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78030569-5931-40ae-ad77-99ac1d090eb9 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:08.327378 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78030569-5931-40ae-ad77-99ac1d090eb9 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:08.328525 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85a098ae-b182-4876-a8eb-9d997a296dbf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ffb3fefa-4822-4a40-bf09-dc1698b98484,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:08.332748 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-78030569-5931-40ae-ad77-99ac1d090eb9 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 3330 time: 0.0801582 Dec 09 21:36:08.333621 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52154) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:08.399609 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-20912147-ee58-45d6-b682-d04599ec9958 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['shared'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:08.401300 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-20912147-ee58-45d6-b682-d04599ec9958 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['shared'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:08.403321 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-20912147-ee58-45d6-b682-d04599ec9958 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['shared'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:08.404790 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-20912147-ee58-45d6-b682-d04599ec9958 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['shared'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:08.406235 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-20912147-ee58-45d6-b682-d04599ec9958 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['shared'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:08.411389 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-20912147-ee58-45d6-b682-d04599ec9958 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "GET /v2.0/subnets?fields=id&fields=network_id HTTP/1.1" status: 200 len: 697 time: 0.0706909 Dec 09 21:36:08.411797 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52156) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:08.600864 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc3f7103-06d4-4b88-b06f-7649c577acbc tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:08.606697 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-dc3f7103-06d4-4b88-b06f-7649c577acbc tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "GET /v2.0/networks/f803ad5e-7819-4f9a-985a-010d8e7385f1 HTTP/1.1" status: 200 len: 803 time: 0.1895101 Dec 09 21:36:08.607078 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52160) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:08.632876 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-8dc406c5-911d-438d-a408-a73ecb56f6ff tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:08.632876 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-8dc406c5-911d-438d-a408-a73ecb56f6ff tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.31 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 812 time: 0.1754243 Dec 09 21:36:08.644405 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-e24362ee-e7e3-41ab-9a0b-87e0f04522e3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Request body: {'port': {'device_id': '62e2a8f5-9097-4f6a-a915-2c8303b50c10', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'admin_state_up': True, 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:08.719809 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-dbe501ac-1bf4-4b33-a469-e5595912be1e tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "GET /v2.0/networks/f803ad5e-7819-4f9a-985a-010d8e7385f1?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 319 time: 0.1114929 Dec 09 21:36:08.723305 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52168) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:08.769377 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-e24362ee-e7e3-41ab-9a0b-87e0f04522e3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Made reservation on behalf of a36a93590a9f45e1b9b3f78753bb8e12 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:36:08.776224 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-e24362ee-e7e3-41ab-9a0b-87e0f04522e3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:08.780557 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84b4e17d-03d5-4878-a088-8d1923cac552 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:08.781921 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-84b4e17d-03d5-4878-a088-8d1923cac552 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "GET /v2.0/subnets/333c35b6-bca0-444e-81db-95346c6f0abf HTTP/1.1" status: 200 len: 843 time: 0.0577281 Dec 09 21:36:08.786180 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52172) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:08.847153 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-836c8680-f103-4c29-95f6-b32efa90a220 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['shared'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:08.848924 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-836c8680-f103-4c29-95f6-b32efa90a220 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "GET /v2.0/subnets/333c35b6-bca0-444e-81db-95346c6f0abf?fields=id&fields=network_id HTTP/1.1" status: 200 len: 302 time: 0.0618322 Dec 09 21:36:08.853212 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52174) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:08.859064 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-812d7c46-e623-439a-a9b2-9093f81ef73a tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-735083186'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:08.880122 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-812d7c46-e623-439a-a9b2-9093f81ef73a tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Made reservation on behalf of 106acb1a6547449093d08a9502ab70fb for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:36:08.884124 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-812d7c46-e623-439a-a9b2-9093f81ef73a tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:08.912671 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-812d7c46-e623-439a-a9b2-9093f81ef73a tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] vlan segment allocate from pool success with {'vlan_id': 130, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:36:08.925175 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-812d7c46-e623-439a-a9b2-9093f81ef73a tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:08.925534 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-812d7c46-e623-439a-a9b2-9093f81ef73a tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Added segment 1a60bfbe-bd64-4166-b10b-2aae043492a0 of type vlan for network a063c9bb-30d5-4b77-b604-04964503ca13 Dec 09 21:36:08.933434 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-e24362ee-e7e3-41ab-9a0b-87e0f04522e3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Allocated IP 172.20.0.3 (2c03082f-742a-4ae3-9d23-6178c7ff2a0a/d776263b-6b97-44cc-bef5-299b9262dfec/75fe8bb3-adef-484f-9f51-fd3c79998fce) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:36:08.971871 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-812d7c46-e623-439a-a9b2-9093f81ef73a tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:08.999180 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-812d7c46-e623-439a-a9b2-9093f81ef73a tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:09.005721 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-812d7c46-e623-439a-a9b2-9093f81ef73a tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:09.006327 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-812d7c46-e623-439a-a9b2-9093f81ef73a tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:09.053735 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-812d7c46-e623-439a-a9b2-9093f81ef73a tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.1989162 Dec 09 21:36:09.057324 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52184) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:09.067376 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-70b9af44-cbbf-4c28-9cff-4ac99d250535 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Request body: {'subnet': {'network_id': 'a063c9bb-30d5-4b77-b604-04964503ca13', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'host_routes': [{'destination': '2001::/64', 'nexthop': '2003::1'}], 'dns_nameservers': ['2001:4860:4860::8844', '2001:4860:4860::8888'], 'allocation_pools': [{'start': '2001:db8::3', 'end': '2001:db8::7'}]}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:09.112126 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-e24362ee-e7e3-41ab-9a0b-87e0f04522e3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:09.114516 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-812d7c46-e623-439a-a9b2-9093f81ef73a tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'Network': ['ID=a063c9bb-30d5-4b77-b604-04964503ca13,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:09.127866 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network a063c9bb-30d5-4b77-b604-04964503ca13 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:36:09.183831 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-e24362ee-e7e3-41ab-9a0b-87e0f04522e3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:09.207683 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['ae3b2bf8-8e63-4473-8cc8-206c769cc38a'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:36:09.214178 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['d5571683-a9bc-4155-85b9-b1ef208e21e9'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:36:09.225566 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-70b9af44-cbbf-4c28-9cff-4ac99d250535 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Made reservation on behalf of 106acb1a6547449093d08a9502ab70fb for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:36:09.231306 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70b9af44-cbbf-4c28-9cff-4ac99d250535 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:09.236592 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-e24362ee-e7e3-41ab-9a0b-87e0f04522e3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:36:09.240394 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-e24362ee-e7e3-41ab-9a0b-87e0f04522e3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:09.245332 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-e24362ee-e7e3-41ab-9a0b-87e0f04522e3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:36:09.279536 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e24362ee-e7e3-41ab-9a0b-87e0f04522e3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Pushing event updated for resources: {'Port': ['ID=75fe8bb3-adef-484f-9f51-fd3c79998fce,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:09.341222 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-e24362ee-e7e3-41ab-9a0b-87e0f04522e3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:09.341921 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-e24362ee-e7e3-41ab-9a0b-87e0f04522e3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:09.370683 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.ipam_backend_mixin [None req-70b9af44-cbbf-4c28-9cff-4ac99d250535 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Performing IP validity checks on allocation pools {{(pid=103438) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Dec 09 21:36:09.371207 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.ipam_backend_mixin [None req-70b9af44-cbbf-4c28-9cff-4ac99d250535 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Checking for overlaps among allocation pools and gateway ip {{(pid=103438) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Dec 09 21:36:09.373894 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-e24362ee-e7e3-41ab-9a0b-87e0f04522e3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7350383 Dec 09 21:36:09.388962 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-07513bd2-1cf7-40db-928e-dbd144d54298 service neutron] Request body: {'port': {'device_id': '62e2a8f5-9097-4f6a-a915-2c8303b50c10', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:09.465661 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-07513bd2-1cf7-40db-928e-dbd144d54298 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:09.518293 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66110ae6-3535-42fa-bbb5-8b41bbcbdd27 req-37338f24-426b-4ab9-adc6-18466a0726e8 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:09.527060 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66110ae6-3535-42fa-bbb5-8b41bbcbdd27 req-37338f24-426b-4ab9-adc6-18466a0726e8 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=62e2a8f5-9097-4f6a-a915-2c8303b50c10 HTTP/1.1" status: 200 len: 931 time: 0.1312294 Dec 09 21:36:09.639183 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66110ae6-3535-42fa-bbb5-8b41bbcbdd27 req-d47c841b-deb8-4ae5-bb81-9eb679fa4cc7 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1071389 Dec 09 21:36:09.641490 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:09.686229 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9a5c152a-f7d6-4bc3-bfd4-676d64af44b9 None None] Provisioning complete for port 75fe8bb3-adef-484f-9f51-fd3c79998fce triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:09.686598 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9a5c152a-f7d6-4bc3-bfd4-676d64af44b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:09.709027 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70b9af44-cbbf-4c28-9cff-4ac99d250535 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:09.724055 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9a5c152a-f7d6-4bc3-bfd4-676d64af44b9 None None] Port 75fe8bb3-adef-484f-9f51-fd3c79998fce cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:36:09.784684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70b9af44-cbbf-4c28-9cff-4ac99d250535 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Checking segment: {'id': '1a60bfbe-bd64-4166-b10b-2aae043492a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'a063c9bb-30d5-4b77-b604-04964503ca13'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:36:09.785056 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70b9af44-cbbf-4c28-9cff-4ac99d250535 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Network hostable DHCP agents. Network: a063c9bb-30d5-4b77-b604-04964503ca13, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:36:09.794054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70b9af44-cbbf-4c28-9cff-4ac99d250535 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'Subnet': ['ID=40d18461-f36e-4550-89a1-506671a37e0e,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:09.812674 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-70b9af44-cbbf-4c28-9cff-4ac99d250535 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Network a063c9bb-30d5-4b77-b604-04964503ca13 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:36:09.823521 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-70b9af44-cbbf-4c28-9cff-4ac99d250535 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, a063c9bb-30d5-4b77-b604-04964503ca13) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:09.832143 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0599cd5e-187c-48e0-aaa5-5575e88a8ad3 None None] Network a063c9bb-30d5-4b77-b604-04964503ca13 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:09.832296 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70b9af44-cbbf-4c28-9cff-4ac99d250535 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:09.832854 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70b9af44-cbbf-4c28-9cff-4ac99d250535 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-560651'] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:09.847416 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-07513bd2-1cf7-40db-928e-dbd144d54298 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 75fe8bb3-adef-484f-9f51-fd3c79998fce {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:36:09.856679 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-07513bd2-1cf7-40db-928e-dbd144d54298 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:09.862657 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-70b9af44-cbbf-4c28-9cff-4ac99d250535 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 895 time: 0.8005788 Dec 09 21:36:09.862993 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52204) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:09.869146 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a6e5e300-6bd2-47f3-a8c8-cb1de22cbb7d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Request body: {'subnet': {'name': 'New_subnet', 'host_routes': [{'destination': '2001::/64', 'nexthop': '2005::1'}], 'dns_nameservers': ['2001:4860:4860::7744', '2001:4860:4860::7888'], 'gateway_ip': '2001:db8::2', 'enable_dhcp': True}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:09.874158 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-07513bd2-1cf7-40db-928e-dbd144d54298 service neutron] Transition to ACTIVE for port object 75fe8bb3-adef-484f-9f51-fd3c79998fce will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:36:09.881556 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-07513bd2-1cf7-40db-928e-dbd144d54298 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:09.984402 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07513bd2-1cf7-40db-928e-dbd144d54298 service neutron] Pushing event updated for resources: {'Port': ['ID=75fe8bb3-adef-484f-9f51-fd3c79998fce,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:09.989325 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab76ce18-50ba-4853-80cf-5d16fea69648 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-a063c9bb-30d5-4b77-b604-04964503ca13', 'network_id': 'a063c9bb-30d5-4b77-b604-04964503ca13', 'project_id': '106acb1a6547449093d08a9502ab70fb', 'fixed_ips': [{'subnet_id': '40d18461-f36e-4550-89a1-506671a37e0e'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:36:09.990234 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ab76ce18-50ba-4853-80cf-5d16fea69648 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:10.014385 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6e5e300-6bd2-47f3-a8c8-cb1de22cbb7d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-8592471'] for subnet, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:10.068737 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-07513bd2-1cf7-40db-928e-dbd144d54298 service neutron] Attempting to bind port 75fe8bb3-adef-484f-9f51-fd3c79998fce on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:36:10.068737 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-07513bd2-1cf7-40db-928e-dbd144d54298 service neutron] Attempting to bind port 75fe8bb3-adef-484f-9f51-fd3c79998fce by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:36:10.068737 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-07513bd2-1cf7-40db-928e-dbd144d54298 service neutron] Attempting to bind port 75fe8bb3-adef-484f-9f51-fd3c79998fce on network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:36:10.075869 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-07513bd2-1cf7-40db-928e-dbd144d54298 service neutron] Port 75fe8bb3-adef-484f-9f51-fd3c79998fce on network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:36:10.076202 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-07513bd2-1cf7-40db-928e-dbd144d54298 service neutron] Attempting to bind port 75fe8bb3-adef-484f-9f51-fd3c79998fce on network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:36:10.083698 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-07513bd2-1cf7-40db-928e-dbd144d54298 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 35, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:36:10.084824 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-07513bd2-1cf7-40db-928e-dbd144d54298 service neutron] Checking segment: {'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:36:10.085232 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-07513bd2-1cf7-40db-928e-dbd144d54298 service neutron] Bound using segment: {'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:36:10.085672 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-07513bd2-1cf7-40db-928e-dbd144d54298 service neutron] Bound port: 75fe8bb3-adef-484f-9f51-fd3c79998fce, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:36:10.088976 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-07513bd2-1cf7-40db-928e-dbd144d54298 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:10.194166 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-07513bd2-1cf7-40db-928e-dbd144d54298 service neutron] For port 75fe8bb3-adef-484f-9f51-fd3c79998fce, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:36:10.198910 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-07513bd2-1cf7-40db-928e-dbd144d54298 service neutron] For port 75fe8bb3-adef-484f-9f51-fd3c79998fce, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=75fe8bb3-adef-484f-9f51-fd3c79998fce,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:36:10.207878 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-07513bd2-1cf7-40db-928e-dbd144d54298 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:10.281527 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6e5e300-6bd2-47f3-a8c8-cb1de22cbb7d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8731650215464', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-8812010'] for subnet, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:10.285337 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-07513bd2-1cf7-40db-928e-dbd144d54298 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:10.285977 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-07513bd2-1cf7-40db-928e-dbd144d54298 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:10.287431 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-07513bd2-1cf7-40db-928e-dbd144d54298 service neutron] 10.222.0.31 "PUT /v2.0/ports/75fe8bb3-adef-484f-9f51-fd3c79998fce HTTP/1.1" status: 200 len: 1092 time: 0.9039156 Dec 09 21:36:10.287939 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '62e2a8f5-9097-4f6a-a915-2c8303b50c10', 'tag': '75fe8bb3-adef-484f-9f51-fd3c79998fce'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:36:10.290293 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bbfcce23-0ad6-4800-815d-067c0e503a90" -d '{"events": [{"name": "network-changed", "server_uuid": "62e2a8f5-9097-4f6a-a915-2c8303b50c10", "tag": "75fe8bb3-adef-484f-9f51-fd3c79998fce"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:36:10.325483 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a6e5e300-6bd2-47f3-a8c8-cb1de22cbb7d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:10.327530 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6e5e300-6bd2-47f3-a8c8-cb1de22cbb7d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:10.331112 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a6e5e300-6bd2-47f3-a8c8-cb1de22cbb7d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "PUT /v2.0/subnets/40d18461-f36e-4550-89a1-506671a37e0e HTTP/1.1" status: 200 len: 900 time: 0.4644005 Dec 09 21:36:10.335368 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52220) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:10.380402 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:36:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2a0c8d2f-d849-4f89-a7bb-e4ab195ae4e7 x-openstack-request-id: req-2a0c8d2f-d849-4f89-a7bb-e4ab195ae4e7 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:36:10.380686 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "62e2a8f5-9097-4f6a-a915-2c8303b50c10", "tag": "75fe8bb3-adef-484f-9f51-fd3c79998fce", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:36:10.380991 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-2a0c8d2f-d849-4f89-a7bb-e4ab195ae4e7 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:36:10.381399 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '62e2a8f5-9097-4f6a-a915-2c8303b50c10', 'tag': '75fe8bb3-adef-484f-9f51-fd3c79998fce', 'status': 'completed', 'code': 200} Dec 09 21:36:10.403802 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-ab76ce18-50ba-4853-80cf-5d16fea69648 None None] Allocated IP 2001:db8::3 (a063c9bb-30d5-4b77-b604-04964503ca13/40d18461-f36e-4550-89a1-506671a37e0e/e0057fca-913c-42a6-9409-1d18ed01c8e7) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:36:10.428723 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6e5e300-6bd2-47f3-a8c8-cb1de22cbb7d tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event updated for resources: {'Subnet': ['ID=40d18461-f36e-4550-89a1-506671a37e0e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:10.452926 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07513bd2-1cf7-40db-928e-dbd144d54298 service neutron] Pushing event updated for resources: {'Port': ['ID=75fe8bb3-adef-484f-9f51-fd3c79998fce,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:10.541836 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-30e32be1-cd0a-41af-a4c6-63955bedb599 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:10.543416 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-30e32be1-cd0a-41af-a4c6-63955bedb599 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&device_id=62e2a8f5-9097-4f6a-a915-2c8303b50c10 HTTP/1.1" status: 200 len: 1095 time: 0.1649110 Dec 09 21:36:10.596486 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-c32198bb-4e22-421b-9d39-990f35c67921 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=75fe8bb3-adef-484f-9f51-fd3c79998fce HTTP/1.1" status: 200 len: 217 time: 0.0449874 Dec 09 21:36:10.617502 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ab76ce18-50ba-4853-80cf-5d16fea69648 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:10.626711 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ab76ce18-50ba-4853-80cf-5d16fea69648 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:10.641999 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-96520830-519b-4bf2-960b-2c009b9bef35 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:10.674774 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-b3cff989-548b-4b63-bbb2-aed4b8aeafad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:10.676592 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-b3cff989-548b-4b63-bbb2-aed4b8aeafad service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 200 len: 851 time: 0.0707002 Dec 09 21:36:10.691871 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab76ce18-50ba-4853-80cf-5d16fea69648 None None] Network a063c9bb-30d5-4b77-b604-04964503ca13 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:36:10.704265 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-ab76ce18-50ba-4853-80cf-5d16fea69648 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:10.706706 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab76ce18-50ba-4853-80cf-5d16fea69648 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:36:10.709241 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab76ce18-50ba-4853-80cf-5d16fea69648 None None] Pushing event updated for resources: {'Port': ['ID=e0057fca-913c-42a6-9409-1d18ed01c8e7,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:10.750570 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-65f95238-a704-4066-a62a-14f52c322fa5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:10.752257 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-65f95238-a704-4066-a62a-14f52c322fa5 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0540049 Dec 09 21:36:10.764258 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-96520830-519b-4bf2-960b-2c009b9bef35 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Deleting port e0057fca-913c-42a6-9409-1d18ed01c8e7 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:36:10.764600 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-96520830-519b-4bf2-960b-2c009b9bef35 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:10.789974 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-ab76ce18-50ba-4853-80cf-5d16fea69648 None None] Attempting to bind port e0057fca-913c-42a6-9409-1d18ed01c8e7 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:36:10.790970 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-ab76ce18-50ba-4853-80cf-5d16fea69648 None None] Attempting to bind port e0057fca-913c-42a6-9409-1d18ed01c8e7 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '1a60bfbe-bd64-4166-b10b-2aae043492a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'a063c9bb-30d5-4b77-b604-04964503ca13'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:36:10.791630 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab76ce18-50ba-4853-80cf-5d16fea69648 None None] Attempting to bind port e0057fca-913c-42a6-9409-1d18ed01c8e7 on network a063c9bb-30d5-4b77-b604-04964503ca13 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:36:10.799951 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ac57394-7402-4082-a30c-3a4c8b81b9e5 req-d4e04b1a-655c-4183-8785-cec35f27f311 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:10.803023 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab76ce18-50ba-4853-80cf-5d16fea69648 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 36, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:36:10.803402 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab76ce18-50ba-4853-80cf-5d16fea69648 None None] Checking segment: {'id': '1a60bfbe-bd64-4166-b10b-2aae043492a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'a063c9bb-30d5-4b77-b604-04964503ca13'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:36:10.803839 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ab76ce18-50ba-4853-80cf-5d16fea69648 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:10.804235 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab76ce18-50ba-4853-80cf-5d16fea69648 None None] Bound using segment: {'id': '1a60bfbe-bd64-4166-b10b-2aae043492a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'a063c9bb-30d5-4b77-b604-04964503ca13'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:36:10.804944 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-ab76ce18-50ba-4853-80cf-5d16fea69648 None None] Bound port: e0057fca-913c-42a6-9409-1d18ed01c8e7, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1a60bfbe-bd64-4166-b10b-2aae043492a0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': 'a063c9bb-30d5-4b77-b604-04964503ca13'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:36:10.805366 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ab76ce18-50ba-4853-80cf-5d16fea69648 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:10.810841 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ac57394-7402-4082-a30c-3a4c8b81b9e5 req-d4e04b1a-655c-4183-8785-cec35f27f311 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=62e2a8f5-9097-4f6a-a915-2c8303b50c10 HTTP/1.1" status: 200 len: 943 time: 0.0818627 Dec 09 21:36:10.884061 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ac57394-7402-4082-a30c-3a4c8b81b9e5 req-16419a16-e862-4f7e-92ad-75d1239bb943 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0671945 Dec 09 21:36:10.901504 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ab76ce18-50ba-4853-80cf-5d16fea69648 None None] For port e0057fca-913c-42a6-9409-1d18ed01c8e7, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:36:10.904876 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ab76ce18-50ba-4853-80cf-5d16fea69648 None None] For port e0057fca-913c-42a6-9409-1d18ed01c8e7, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e0057fca-913c-42a6-9409-1d18ed01c8e7,segment=NetworkSegment(1a60bfbe-bd64-4166-b10b-2aae043492a0),segment_id=1a60bfbe-bd64-4166-b10b-2aae043492a0)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:36:10.910654 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ab76ce18-50ba-4853-80cf-5d16fea69648 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:10.928311 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-96520830-519b-4bf2-960b-2c009b9bef35 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] For port e0057fca-913c-42a6-9409-1d18ed01c8e7, host n-d-713301-27, got binding levels [] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:10.928680 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-96520830-519b-4bf2-960b-2c009b9bef35 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:10.938786 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-810d333e-580f-4158-ac75-8a59da26b810 service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1764925 Dec 09 21:36:10.944671 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-96520830-519b-4bf2-960b-2c009b9bef35 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Calling delete_port for e0057fca-913c-42a6-9409-1d18ed01c8e7 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:36:10.987317 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab76ce18-50ba-4853-80cf-5d16fea69648 None None] Pushing event updated for resources: {'Port': ['ID=e0057fca-913c-42a6-9409-1d18ed01c8e7,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:11.091311 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ab5ea3c2-a3aa-47ab-a6eb-431f79dc00e3 req-f2ef3d4c-ae48-4c01-acc2-3a062a0adee6 service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1442401 Dec 09 21:36:11.214032 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-96520830-519b-4bf2-960b-2c009b9bef35 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:11.247273 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96520830-519b-4bf2-960b-2c009b9bef35 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Port': ['ID=e0057fca-913c-42a6-9409-1d18ed01c8e7,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:11.255041 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbfcce23-0ad6-4800-815d-067c0e503a90 req-960a5e1e-d15f-42a9-9432-230cc0e96fea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:11.256565 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bbfcce23-0ad6-4800-815d-067c0e503a90 req-960a5e1e-d15f-42a9-9432-230cc0e96fea service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&device_id=62e2a8f5-9097-4f6a-a915-2c8303b50c10 HTTP/1.1" status: 200 len: 1095 time: 0.1137776 Dec 09 21:36:11.343121 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96520830-519b-4bf2-960b-2c009b9bef35 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] No DVR routers for this DVR port e0057fca-913c-42a6-9409-1d18ed01c8e7 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:36:11.437087 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-96520830-519b-4bf2-960b-2c009b9bef35 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:11.468723 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbfcce23-0ad6-4800-815d-067c0e503a90 req-14a39962-26ed-4ca9-85a4-a294a189a6e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:11.470300 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bbfcce23-0ad6-4800-815d-067c0e503a90 req-14a39962-26ed-4ca9-85a4-a294a189a6e7 service neutron] 10.222.0.31 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 913 time: 0.2060943 Dec 09 21:36:11.526068 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bbfcce23-0ad6-4800-815d-067c0e503a90 req-b73edc6c-b4b2-4f73-992d-51dbf2a39759 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=75fe8bb3-adef-484f-9f51-fd3c79998fce HTTP/1.1" status: 200 len: 217 time: 0.0462334 Dec 09 21:36:11.595036 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbfcce23-0ad6-4800-815d-067c0e503a90 req-992c3430-a2eb-4a66-97ee-e09d6e331f31 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:11.596578 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bbfcce23-0ad6-4800-815d-067c0e503a90 req-992c3430-a2eb-4a66-97ee-e09d6e331f31 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 200 len: 851 time: 0.0600348 Dec 09 21:36:11.597951 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-96520830-519b-4bf2-960b-2c009b9bef35 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:11.632125 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96520830-519b-4bf2-960b-2c009b9bef35 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Subnet': ['ID=40d18461-f36e-4550-89a1-506671a37e0e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:11.714495 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-96520830-519b-4bf2-960b-2c009b9bef35 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:11.727222 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbfcce23-0ad6-4800-815d-067c0e503a90 req-9188f851-eea5-4cd7-83ce-63846b0e9e70 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:11.728886 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bbfcce23-0ad6-4800-815d-067c0e503a90 req-9188f851-eea5-4cd7-83ce-63846b0e9e70 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1064959 Dec 09 21:36:11.749967 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-96520830-519b-4bf2-960b-2c009b9bef35 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a063c9bb-30d5-4b77-b604-04964503ca13']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:11.771036 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-96520830-519b-4bf2-960b-2c009b9bef35 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1a60bfbe-bd64-4166-b10b-2aae043492a0') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:11.771338 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-96520830-519b-4bf2-960b-2c009b9bef35 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1a60bfbe-bd64-4166-b10b-2aae043492a0') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:11.779914 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52246) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:11.789595 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-96520830-519b-4bf2-960b-2c009b9bef35 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:11.831815 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-96520830-519b-4bf2-960b-2c009b9bef35 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:11.841570 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-96520830-519b-4bf2-960b-2c009b9bef35 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Releasing vlan 130 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:36:11.842004 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-96520830-519b-4bf2-960b-2c009b9bef35 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:36:11.845075 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:36:11.904086 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b1f0c550-4334-43fa-b41f-e6de454d3ad1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:11.910789 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bbfcce23-0ad6-4800-815d-067c0e503a90 req-cbca8924-2625-4db8-ac7d-16158d14b397 service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1727788 Dec 09 21:36:11.951118 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-96520830-519b-4bf2-960b-2c009b9bef35 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:11.967000 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-96520830-519b-4bf2-960b-2c009b9bef35 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:11.970319 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-96520830-519b-4bf2-960b-2c009b9bef35 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/networks/a063c9bb-30d5-4b77-b604-04964503ca13 HTTP/1.1" status: 204 len: 168 time: 1.6264277 Dec 09 21:36:11.978982 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52252) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:12.016608 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96520830-519b-4bf2-960b-2c009b9bef35 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Network': ['ID=a063c9bb-30d5-4b77-b604-04964503ca13,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:12.036106 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-15915c0f-4fea-4185-bb31-50d58594c92c tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] DELETE failed (client error): The resource could not be found. Dec 09 21:36:12.036572 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-15915c0f-4fea-4185-bb31-50d58594c92c tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:36:12.043671 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-15915c0f-4fea-4185-bb31-50d58594c92c tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/subnets/40d18461-f36e-4550-89a1-506671a37e0e HTTP/1.1" status: 404 len: 337 time: 0.0625131 Dec 09 21:36:12.044318 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52254) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:12.050829 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bbfcce23-0ad6-4800-815d-067c0e503a90 req-fb1933eb-8bf4-42c4-914f-3e218e17ca60 service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1296325 Dec 09 21:36:12.102163 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b1f0c550-4334-43fa-b41f-e6de454d3ad1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:12.103632 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-7c257771-083c-4016-ab24-bc2a1345ea24 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] DELETE failed (client error): The resource could not be found. Dec 09 21:36:12.104144 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7c257771-083c-4016-ab24-bc2a1345ea24 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:36:12.109669 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7c257771-083c-4016-ab24-bc2a1345ea24 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/networks/a063c9bb-30d5-4b77-b604-04964503ca13 HTTP/1.1" status: 404 len: 339 time: 0.0387914 Dec 09 21:36:12.110104 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52256) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:12.110455 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b1f0c550-4334-43fa-b41f-e6de454d3ad1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:12.143575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6901a58a-f0f2-4720-a936-f2d55016f855 req-79449177-869a-4223-8971-9399e38459ec tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:12.146199 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3cc39e4a-fd31-4cc2-a9e8-5f3b6fd1cf81 None None] Could not find standard attr ID for object e0057fca-913c-42a6-9409-1d18ed01c8e7. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:36:12.150682 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6901a58a-f0f2-4720-a936-f2d55016f855 req-79449177-869a-4223-8971-9399e38459ec tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=62e2a8f5-9097-4f6a-a915-2c8303b50c10 HTTP/1.1" status: 200 len: 943 time: 0.1576002 Dec 09 21:36:12.184690 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1f0c550-4334-43fa-b41f-e6de454d3ad1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2e37ed65-1f0f-4b13-a902-ea9d0b8cdfc2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:12.189917 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b1f0c550-4334-43fa-b41f-e6de454d3ad1 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=35034143e9da46b4a19ac765dcc6f863&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4089665 Dec 09 21:36:12.197041 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52258) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:12.203978 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17e9bc41-f0bd-4465-90bc-e9b1015c719f None None] DHCP port deletion for a063c9bb-30d5-4b77-b604-04964503ca13 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:36:12.226156 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f81fdad4-4572-4c1a-a8fa-8d30da6dfcf7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:12.226506 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c40e1a29-9c0a-4fdb-82d8-3a5c7da84aa2 None None] Network a063c9bb-30d5-4b77-b604-04964503ca13 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:12.227995 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6901a58a-f0f2-4720-a936-f2d55016f855 req-ec7cadad-5502-467d-bd4c-8c265a88bced tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0692947 Dec 09 21:36:12.239637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c40e1a29-9c0a-4fdb-82d8-3a5c7da84aa2 None None] Network a063c9bb-30d5-4b77-b604-04964503ca13 could not be found, it might have been deleted concurrently. {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:224}} Dec 09 21:36:12.249830 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58ad4b93-f46c-4eb6-b6b4-b75b633602d5 None None] Network a063c9bb-30d5-4b77-b604-04964503ca13 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:12.262191 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58ad4b93-f46c-4eb6-b6b4-b75b633602d5 None None] Network a063c9bb-30d5-4b77-b604-04964503ca13 could not be found, it might have been deleted concurrently. {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:224}} Dec 09 21:36:12.314624 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c21f5211-2861-4675-9c1c-fbc112cd5f54 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:12.355143 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f81fdad4-4572-4c1a-a8fa-8d30da6dfcf7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:12.384859 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c21f5211-2861-4675-9c1c-fbc112cd5f54 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:12.392852 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-f81fdad4-4572-4c1a-a8fa-8d30da6dfcf7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c83f9145-cac5-475b-80dc-a24cce52b7b2']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:12.409202 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-f81fdad4-4572-4c1a-a8fa-8d30da6dfcf7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0408f208-ed74-403e-b24a-0949fced382c') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:12.409427 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-f81fdad4-4572-4c1a-a8fa-8d30da6dfcf7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0408f208-ed74-403e-b24a-0949fced382c') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:12.429525 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f81fdad4-4572-4c1a-a8fa-8d30da6dfcf7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:12.445717 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f81fdad4-4572-4c1a-a8fa-8d30da6dfcf7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:12.453118 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f81fdad4-4572-4c1a-a8fa-8d30da6dfcf7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Releasing vlan 134 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:36:12.453540 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f81fdad4-4572-4c1a-a8fa-8d30da6dfcf7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:36:12.456550 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:36:12.480190 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c21f5211-2861-4675-9c1c-fbc112cd5f54 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:12.482726 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c21f5211-2861-4675-9c1c-fbc112cd5f54 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:12.483893 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c21f5211-2861-4675-9c1c-fbc112cd5f54 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/2e37ed65-1f0f-4b13-a902-ea9d0b8cdfc2 HTTP/1.1" status: 204 len: 168 time: 0.2864423 Dec 09 21:36:12.525206 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c21f5211-2861-4675-9c1c-fbc112cd5f54 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2e37ed65-1f0f-4b13-a902-ea9d0b8cdfc2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:12.538568 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f81fdad4-4572-4c1a-a8fa-8d30da6dfcf7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:12.547543 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f81fdad4-4572-4c1a-a8fa-8d30da6dfcf7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:12.555009 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52266) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:12.555223 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f81fdad4-4572-4c1a-a8fa-8d30da6dfcf7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/networks/c83f9145-cac5-475b-80dc-a24cce52b7b2 HTTP/1.1" status: 204 len: 168 time: 0.4438522 Dec 09 21:36:12.581383 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f81fdad4-4572-4c1a-a8fa-8d30da6dfcf7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Network': ['ID=c83f9145-cac5-475b-80dc-a24cce52b7b2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:12.590512 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-d6a6d093-a5ad-4496-ad17-1ad779f65e15 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] DELETE failed (client error): The resource could not be found. Dec 09 21:36:12.591092 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d6a6d093-a5ad-4496-ad17-1ad779f65e15 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:36:12.594550 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d6a6d093-a5ad-4496-ad17-1ad779f65e15 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/subnets/27ab7646-b81d-4673-ad4a-601f72029ce4 HTTP/1.1" status: 404 len: 337 time: 0.0375493 Dec 09 21:36:12.597147 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52268) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:12.619188 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-763b83c1-c158-4d0f-b571-be92f1184a99 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] DELETE failed (client error): The resource could not be found. Dec 09 21:36:12.619709 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-763b83c1-c158-4d0f-b571-be92f1184a99 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:36:12.623387 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-763b83c1-c158-4d0f-b571-be92f1184a99 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/networks/8bd558ba-874a-4f3c-ad0a-afcc7bd684c3 HTTP/1.1" status: 404 len: 339 time: 0.0252783 Dec 09 21:36:12.626062 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52272) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:12.680079 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-d80f969c-241a-43ce-a86e-585c4c5fb10c tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Deleting subnet 4a3ceb02-26d8-4f01-acb7-a76eda2a5391 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:36:12.683152 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d80f969c-241a-43ce-a86e-585c4c5fb10c tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:12.724240 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d80f969c-241a-43ce-a86e-585c4c5fb10c tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:12.789446 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52274) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:12.803600 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9a6c453f-147f-45c6-aae4-4c1ea9c66013 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:12.810411 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d80f969c-241a-43ce-a86e-585c4c5fb10c tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:12.879203 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d80f969c-241a-43ce-a86e-585c4c5fb10c tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:12.886298 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9a6c453f-147f-45c6-aae4-4c1ea9c66013 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:12.890431 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9a6c453f-147f-45c6-aae4-4c1ea9c66013 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:12.914528 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d80f969c-241a-43ce-a86e-585c4c5fb10c tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Subnet': ['ID=4a3ceb02-26d8-4f01-acb7-a76eda2a5391,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:12.921162 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d80f969c-241a-43ce-a86e-585c4c5fb10c tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:12.921902 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6d34b1b9-740e-4494-9f7c-c42cfc255f53 None None] Network 5bb06521-7b99-4b40-a820-86aa2f15e7e3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:12.925006 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d80f969c-241a-43ce-a86e-585c4c5fb10c tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/subnets/4a3ceb02-26d8-4f01-acb7-a76eda2a5391 HTTP/1.1" status: 204 len: 168 time: 0.2979558 Dec 09 21:36:12.927772 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52276) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:12.941223 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9a6c453f-147f-45c6-aae4-4c1ea9c66013 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=bbf84fdca5ec4cafadb4b5c7bc848b48&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1503863 Dec 09 21:36:12.941791 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52278) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:12.943942 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a6c453f-147f-45c6-aae4-4c1ea9c66013 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b87b6768-463a-41dd-9cac-08d07fe1e4e9,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:12.990632 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-da4f1ddc-3dfb-4dec-a60d-d30be92aa950 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Deleting subnet 95860e0b-69b2-4921-be7d-f8f647877bab {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:36:12.994519 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da4f1ddc-3dfb-4dec-a60d-d30be92aa950 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:13.000191 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-11e543af-83db-4566-ad3e-4386ff26d503 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:13.022156 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-11e543af-83db-4566-ad3e-4386ff26d503 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:13.042033 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da4f1ddc-3dfb-4dec-a60d-d30be92aa950 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:13.084890 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-11e543af-83db-4566-ad3e-4386ff26d503 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:13.087786 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-11e543af-83db-4566-ad3e-4386ff26d503 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:13.088960 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-11e543af-83db-4566-ad3e-4386ff26d503 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/b87b6768-463a-41dd-9cac-08d07fe1e4e9 HTTP/1.1" status: 204 len: 168 time: 0.1460600 Dec 09 21:36:13.097778 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11e543af-83db-4566-ad3e-4386ff26d503 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b87b6768-463a-41dd-9cac-08d07fe1e4e9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:13.150265 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da4f1ddc-3dfb-4dec-a60d-d30be92aa950 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:13.214436 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da4f1ddc-3dfb-4dec-a60d-d30be92aa950 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:13.243480 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da4f1ddc-3dfb-4dec-a60d-d30be92aa950 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Subnet': ['ID=95860e0b-69b2-4921-be7d-f8f647877bab,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:13.261839 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da4f1ddc-3dfb-4dec-a60d-d30be92aa950 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:13.272247 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-da4f1ddc-3dfb-4dec-a60d-d30be92aa950 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/subnets/95860e0b-69b2-4921-be7d-f8f647877bab HTTP/1.1" status: 204 len: 168 time: 0.3434217 Dec 09 21:36:13.275317 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52284) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:13.367727 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9860b60a-1ef6-482c-b81c-e581e453efc2 req-d52eb5aa-cfaa-40cc-829b-060bdf78b220 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:13.369373 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9860b60a-1ef6-482c-b81c-e581e453efc2 req-d52eb5aa-cfaa-40cc-829b-060bdf78b220 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=62e2a8f5-9097-4f6a-a915-2c8303b50c10 HTTP/1.1" status: 200 len: 943 time: 0.0577049 Dec 09 21:36:13.380756 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2dc00f9e-153a-4650-9719-1dd7b1d6466b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:13.433914 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9860b60a-1ef6-482c-b81c-e581e453efc2 req-e6113383-03ea-4128-937b-271f4847f8d2 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0523684 Dec 09 21:36:13.446320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-2dc00f9e-153a-4650-9719-1dd7b1d6466b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Deleting port 8ae411d9-1c4b-4c74-bd82-a6642b6bd85c {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:36:13.446762 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2dc00f9e-153a-4650-9719-1dd7b1d6466b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:13.523201 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-2dc00f9e-153a-4650-9719-1dd7b1d6466b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] For port 8ae411d9-1c4b-4c74-bd82-a6642b6bd85c, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=8ae411d9-1c4b-4c74-bd82-a6642b6bd85c,segment=NetworkSegment(4fd7d816-fcfb-4cc5-8e40-4a7945a20ae4),segment_id=4fd7d816-fcfb-4cc5-8e40-4a7945a20ae4)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:13.523641 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2dc00f9e-153a-4650-9719-1dd7b1d6466b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:13.533479 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e0057fca-913c-42a6-9409-1d18ed01c8e7 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:36:13.544612 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-2dc00f9e-153a-4650-9719-1dd7b1d6466b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Calling delete_port for 8ae411d9-1c4b-4c74-bd82-a6642b6bd85c owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:36:13.554563 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: e0057fca-913c-42a6-9409-1d18ed01c8e7 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:36:13.554912 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e0057fca-913c-42a6-9409-1d18ed01c8e7 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:36:13.650560 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2dc00f9e-153a-4650-9719-1dd7b1d6466b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:13.667168 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2dc00f9e-153a-4650-9719-1dd7b1d6466b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] No DVR routers for this DVR port 8ae411d9-1c4b-4c74-bd82-a6642b6bd85c on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:36:13.695312 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dc00f9e-153a-4650-9719-1dd7b1d6466b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Port': ['ID=8ae411d9-1c4b-4c74-bd82-a6642b6bd85c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:13.742490 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15d3ba29-5e48-4050-8f37-0d3db3841f38 None None] Network 5bb06521-7b99-4b40-a820-86aa2f15e7e3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:13.781117 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2dc00f9e-153a-4650-9719-1dd7b1d6466b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:13.804849 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8032d246-d838-4b0c-b3df-4dcc371da23d None None] Could not find standard attr ID for object 8ae411d9-1c4b-4c74-bd82-a6642b6bd85c. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:36:13.805304 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-2dc00f9e-153a-4650-9719-1dd7b1d6466b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5bb06521-7b99-4b40-a820-86aa2f15e7e3']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:13.816641 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-2dc00f9e-153a-4650-9719-1dd7b1d6466b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4fd7d816-fcfb-4cc5-8e40-4a7945a20ae4') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:13.816947 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-2dc00f9e-153a-4650-9719-1dd7b1d6466b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4fd7d816-fcfb-4cc5-8e40-4a7945a20ae4') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:13.831691 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2dc00f9e-153a-4650-9719-1dd7b1d6466b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:13.846759 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2dc00f9e-153a-4650-9719-1dd7b1d6466b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:13.853743 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2dc00f9e-153a-4650-9719-1dd7b1d6466b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Releasing vlan 123 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:36:13.854193 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2dc00f9e-153a-4650-9719-1dd7b1d6466b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:36:13.857492 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:36:13.884740 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 75fe8bb3-adef-484f-9f51-fd3c79998fce details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:36:13.907606 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9517ca2d-4f03-412f-8631-e6f7488402a0 None None] DHCP port deletion for 5bb06521-7b99-4b40-a820-86aa2f15e7e3 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:36:13.927457 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2dc00f9e-153a-4650-9719-1dd7b1d6466b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:13.935402 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2dc00f9e-153a-4650-9719-1dd7b1d6466b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:13.941791 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2dc00f9e-153a-4650-9719-1dd7b1d6466b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/networks/5bb06521-7b99-4b40-a820-86aa2f15e7e3 HTTP/1.1" status: 204 len: 168 time: 0.6652782 Dec 09 21:36:13.941942 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52308) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:13.957121 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dc00f9e-153a-4650-9719-1dd7b1d6466b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Network': ['ID=5bb06521-7b99-4b40-a820-86aa2f15e7e3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:13.982224 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-5f6d00e0-6b31-4e63-8cd3-05c3b9c644b7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] DELETE failed (client error): The resource could not be found. Dec 09 21:36:13.982567 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5f6d00e0-6b31-4e63-8cd3-05c3b9c644b7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:36:13.985879 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5f6d00e0-6b31-4e63-8cd3-05c3b9c644b7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/subnets/b4c6f5b6-844f-47d8-b167-6127838825bf HTTP/1.1" status: 404 len: 337 time: 0.0429487 Dec 09 21:36:13.988763 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52310) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:14.011761 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-6ea9bcac-fe22-43f4-91e7-e543d328523b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] DELETE failed (client error): The resource could not be found. Dec 09 21:36:14.012737 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6ea9bcac-fe22-43f4-91e7-e543d328523b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:36:14.015179 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 75fe8bb3-adef-484f-9f51-fd3c79998fce, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=75fe8bb3-adef-484f-9f51-fd3c79998fce,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:14.018426 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6ea9bcac-fe22-43f4-91e7-e543d328523b tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/networks/9a6ec510-0e53-48e0-b7c2-57a700c9e461 HTTP/1.1" status: 404 len: 339 time: 0.0262573 Dec 09 21:36:14.018617 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52314) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:14.028763 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '75fe8bb3-adef-484f-9f51-fd3c79998fce', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'port_id': '75fe8bb3-adef-484f-9f51-fd3c79998fce', 'mac_address': 'fa:16:3e:05:79:ad', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:36:14.047945 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-ea4f169b-c3c6-40f8-918b-b4242df86a85 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] DELETE failed (client error): The resource could not be found. Dec 09 21:36:14.048409 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ea4f169b-c3c6-40f8-918b-b4242df86a85 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:36:14.053874 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ea4f169b-c3c6-40f8-918b-b4242df86a85 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/subnets/0b44a566-6ba8-4a09-9612-cb7b65bed049 HTTP/1.1" status: 404 len: 337 time: 0.0318565 Dec 09 21:36:14.054275 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52316) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:14.070588 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:14.072627 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-645997a4-c72d-46d5-96a8-cced9bb390db tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] DELETE failed (client error): The resource could not be found. Dec 09 21:36:14.073136 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-645997a4-c72d-46d5-96a8-cced9bb390db tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:36:14.076204 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-645997a4-c72d-46d5-96a8-cced9bb390db tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/networks/b10818be-4493-4b43-a8db-e1fb4b1fa122 HTTP/1.1" status: 404 len: 339 time: 0.0209229 Dec 09 21:36:14.079045 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52318) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:14.084734 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 75fe8bb3-adef-484f-9f51-fd3c79998fce {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:36:14.105236 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 75fe8bb3-adef-484f-9f51-fd3c79998fce, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=75fe8bb3-adef-484f-9f51-fd3c79998fce,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:14.106600 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-ad8ef1b9-2409-44f6-96d7-67372ee8407c tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] DELETE failed (client error): The resource could not be found. Dec 09 21:36:14.107006 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ad8ef1b9-2409-44f6-96d7-67372ee8407c tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:36:14.112834 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ad8ef1b9-2409-44f6-96d7-67372ee8407c tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/subnets/08584ab9-470f-452d-be6f-a4087984a7a4 HTTP/1.1" status: 404 len: 337 time: 0.0301361 Dec 09 21:36:14.113055 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52320) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:14.114162 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:14.131806 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-6ecd33d4-d58c-4bab-8be9-d691decb1e07 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] DELETE failed (client error): The resource could not be found. Dec 09 21:36:14.132279 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6ecd33d4-d58c-4bab-8be9-d691decb1e07 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:36:14.137940 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6ecd33d4-d58c-4bab-8be9-d691decb1e07 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/networks/c7966c98-65ee-4f8f-b2e6-23c529ebca83 HTTP/1.1" status: 404 len: 339 time: 0.0214627 Dec 09 21:36:14.138172 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52322) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:14.170748 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=75fe8bb3-adef-484f-9f51-fd3c79998fce,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:14.191737 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-f0a40f4c-06a2-49f2-b3b7-169e2e724b69 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Deleting subnet d98c7eb1-9086-4940-868f-92bb2777b776 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:36:14.194965 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0a40f4c-06a2-49f2-b3b7-169e2e724b69 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:14.239965 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0a40f4c-06a2-49f2-b3b7-169e2e724b69 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:14.327723 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0a40f4c-06a2-49f2-b3b7-169e2e724b69 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:14.356447 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['75fe8bb3-adef-484f-9f51-fd3c79998fce'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:36:14.393701 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0a40f4c-06a2-49f2-b3b7-169e2e724b69 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:14.427475 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0a40f4c-06a2-49f2-b3b7-169e2e724b69 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Subnet': ['ID=d98c7eb1-9086-4940-868f-92bb2777b776,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:14.432701 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0a40f4c-06a2-49f2-b3b7-169e2e724b69 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:14.438688 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f0a40f4c-06a2-49f2-b3b7-169e2e724b69 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/subnets/d98c7eb1-9086-4940-868f-92bb2777b776 HTTP/1.1" status: 204 len: 168 time: 0.2992475 Dec 09 21:36:14.438903 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52334) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:14.566557 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2fb5c764-6edc-4972-a8e5-b1cc6db69ea7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:14.587157 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20c5b615-e03c-489f-8031-fdb993271f80 None None] Network 6f356cc9-34a5-4f0a-84a8-1242014e658b requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:14.647921 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-2fb5c764-6edc-4972-a8e5-b1cc6db69ea7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Deleting port 251fbc8e-86af-4b4b-b5a7-6614df880418 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:36:14.648617 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2fb5c764-6edc-4972-a8e5-b1cc6db69ea7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:14.732113 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-2fb5c764-6edc-4972-a8e5-b1cc6db69ea7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] For port 251fbc8e-86af-4b4b-b5a7-6614df880418, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=251fbc8e-86af-4b4b-b5a7-6614df880418,segment=NetworkSegment(c9f0c2d8-ca15-4401-8dfc-2596b86360e8),segment_id=c9f0c2d8-ca15-4401-8dfc-2596b86360e8)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:14.732995 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2fb5c764-6edc-4972-a8e5-b1cc6db69ea7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:14.748311 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-2fb5c764-6edc-4972-a8e5-b1cc6db69ea7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Calling delete_port for 251fbc8e-86af-4b4b-b5a7-6614df880418 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:36:14.832856 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a146e965-88f7-4131-8ad0-e74eb6b10336 None None] DHCP port deletion for 6f356cc9-34a5-4f0a-84a8-1242014e658b request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:36:14.874936 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2fb5c764-6edc-4972-a8e5-b1cc6db69ea7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:14.896392 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a146e965-88f7-4131-8ad0-e74eb6b10336 None None] Deleting port 251fbc8e-86af-4b4b-b5a7-6614df880418 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:36:14.896900 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a146e965-88f7-4131-8ad0-e74eb6b10336 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:14.914753 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fb5c764-6edc-4972-a8e5-b1cc6db69ea7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Port': ['ID=251fbc8e-86af-4b4b-b5a7-6614df880418,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:14.927042 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2fb5c764-6edc-4972-a8e5-b1cc6db69ea7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] No DVR routers for this DVR port 251fbc8e-86af-4b4b-b5a7-6614df880418 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:36:14.969232 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a146e965-88f7-4131-8ad0-e74eb6b10336 None None] For port 251fbc8e-86af-4b4b-b5a7-6614df880418, host n-d-713301-27, got binding levels [] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:14.969919 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a146e965-88f7-4131-8ad0-e74eb6b10336 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:14.984238 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a146e965-88f7-4131-8ad0-e74eb6b10336 None None] Calling delete_port for 251fbc8e-86af-4b4b-b5a7-6614df880418 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:36:14.985275 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2229b29-85a7-4e59-86b2-057173b5fa9c req-f6795552-585d-419e-9f4a-9b2414694a3a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:14.988008 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.ipam_backend_mixin [None req-a146e965-88f7-4131-8ad0-e74eb6b10336 None None] Port 251fbc8e-86af-4b4b-b5a7-6614df880418 was not found and therefore no delete operation was performed {{(pid=103439) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 09 21:36:14.989976 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a146e965-88f7-4131-8ad0-e74eb6b10336 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:14.992678 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2229b29-85a7-4e59-86b2-057173b5fa9c req-f6795552-585d-419e-9f4a-9b2414694a3a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=62e2a8f5-9097-4f6a-a915-2c8303b50c10 HTTP/1.1" status: 200 len: 944 time: 0.4656587 Dec 09 21:36:15.020254 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a146e965-88f7-4131-8ad0-e74eb6b10336 None None] Pushing event deleted for resources: {'Port': ['ID=251fbc8e-86af-4b4b-b5a7-6614df880418,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:15.022888 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a146e965-88f7-4131-8ad0-e74eb6b10336 None None] No DVR routers for this DVR port 251fbc8e-86af-4b4b-b5a7-6614df880418 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:36:15.068903 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2229b29-85a7-4e59-86b2-057173b5fa9c req-b08ea4b8-0dbb-4990-bd71-82a58d22f3e9 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0715261 Dec 09 21:36:15.073077 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2fb5c764-6edc-4972-a8e5-b1cc6db69ea7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:15.093633 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-2fb5c764-6edc-4972-a8e5-b1cc6db69ea7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6f356cc9-34a5-4f0a-84a8-1242014e658b']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:15.103329 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-2fb5c764-6edc-4972-a8e5-b1cc6db69ea7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c9f0c2d8-ca15-4401-8dfc-2596b86360e8') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:15.103714 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-2fb5c764-6edc-4972-a8e5-b1cc6db69ea7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c9f0c2d8-ca15-4401-8dfc-2596b86360e8') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:15.113434 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2fb5c764-6edc-4972-a8e5-b1cc6db69ea7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:15.126773 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2fb5c764-6edc-4972-a8e5-b1cc6db69ea7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:15.133747 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2fb5c764-6edc-4972-a8e5-b1cc6db69ea7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Releasing vlan 133 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:36:15.134201 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2fb5c764-6edc-4972-a8e5-b1cc6db69ea7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:36:15.137460 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:36:15.196707 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2fb5c764-6edc-4972-a8e5-b1cc6db69ea7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:15.205141 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2fb5c764-6edc-4972-a8e5-b1cc6db69ea7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:15.208244 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2fb5c764-6edc-4972-a8e5-b1cc6db69ea7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/networks/6f356cc9-34a5-4f0a-84a8-1242014e658b HTTP/1.1" status: 204 len: 168 time: 0.7684064 Dec 09 21:36:15.211033 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52356) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:15.222218 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fb5c764-6edc-4972-a8e5-b1cc6db69ea7 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Network': ['ID=6f356cc9-34a5-4f0a-84a8-1242014e658b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:15.238872 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-cd31c8ac-866b-47c3-b7e0-01a3687bfa60 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] DELETE failed (client error): The resource could not be found. Dec 09 21:36:15.239326 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cd31c8ac-866b-47c3-b7e0-01a3687bfa60 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:36:15.242494 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cd31c8ac-866b-47c3-b7e0-01a3687bfa60 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/subnets/42a3385c-4e5d-484a-a57a-f0a652fedfcb HTTP/1.1" status: 404 len: 337 time: 0.0302899 Dec 09 21:36:15.245350 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52358) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:15.262916 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-f3f14b56-48e3-4bfc-8902-e2c7a5d66491 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] DELETE failed (client error): The resource could not be found. Dec 09 21:36:15.263410 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f3f14b56-48e3-4bfc-8902-e2c7a5d66491 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:36:15.266410 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f3f14b56-48e3-4bfc-8902-e2c7a5d66491 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/networks/c34f64f0-43c8-4815-865c-5c68d6439ec4 HTTP/1.1" status: 404 len: 339 time: 0.0201476 Dec 09 21:36:15.268873 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52362) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:15.322055 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-2bc468ea-571e-4c3d-ac27-b2374c7b66e3 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Deleting subnet 333c35b6-bca0-444e-81db-95346c6f0abf {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:36:15.325193 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2bc468ea-571e-4c3d-ac27-b2374c7b66e3 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:15.366151 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2bc468ea-571e-4c3d-ac27-b2374c7b66e3 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:15.453533 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2bc468ea-571e-4c3d-ac27-b2374c7b66e3 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:15.523095 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2bc468ea-571e-4c3d-ac27-b2374c7b66e3 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:15.552042 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bc468ea-571e-4c3d-ac27-b2374c7b66e3 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Subnet': ['ID=333c35b6-bca0-444e-81db-95346c6f0abf,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:15.554041 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2bc468ea-571e-4c3d-ac27-b2374c7b66e3 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:15.557338 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2bc468ea-571e-4c3d-ac27-b2374c7b66e3 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/subnets/333c35b6-bca0-444e-81db-95346c6f0abf HTTP/1.1" status: 204 len: 168 time: 0.2875240 Dec 09 21:36:15.559910 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52370) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:15.561703 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3941f0e4-dea5-4de8-9038-1482781e78df None None] Network f803ad5e-7819-4f9a-985a-010d8e7385f1 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:15.565249 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 251fbc8e-86af-4b4b-b5a7-6614df880418 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:36:15.596187 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 251fbc8e-86af-4b4b-b5a7-6614df880418 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:36:15.597218 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 251fbc8e-86af-4b4b-b5a7-6614df880418 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:36:15.597635 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 8ae411d9-1c4b-4c74-bd82-a6642b6bd85c no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:36:15.627728 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 8ae411d9-1c4b-4c74-bd82-a6642b6bd85c {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:36:15.628073 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 8ae411d9-1c4b-4c74-bd82-a6642b6bd85c not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:36:15.648547 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fde65e02-6029-469f-bad9-28e19b96f5a4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:15.710175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-fde65e02-6029-469f-bad9-28e19b96f5a4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Deleting port a1bb8df8-7c15-4208-aaeb-5e05198c6d35 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:36:15.710508 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fde65e02-6029-469f-bad9-28e19b96f5a4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:15.784221 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-fde65e02-6029-469f-bad9-28e19b96f5a4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] For port a1bb8df8-7c15-4208-aaeb-5e05198c6d35, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a1bb8df8-7c15-4208-aaeb-5e05198c6d35,segment=NetworkSegment(6ecee335-d5f9-4e22-b28f-82924fed3364),segment_id=6ecee335-d5f9-4e22-b28f-82924fed3364)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:15.784543 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fde65e02-6029-469f-bad9-28e19b96f5a4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:15.795054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e8ac781f-1f55-421a-8bf0-b46c1161543e None None] DHCP port deletion for f803ad5e-7819-4f9a-985a-010d8e7385f1 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:36:15.801575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-fde65e02-6029-469f-bad9-28e19b96f5a4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Calling delete_port for a1bb8df8-7c15-4208-aaeb-5e05198c6d35 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:36:15.852111 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e8ac781f-1f55-421a-8bf0-b46c1161543e None None] Deleting port a1bb8df8-7c15-4208-aaeb-5e05198c6d35 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:36:15.852683 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e8ac781f-1f55-421a-8bf0-b46c1161543e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:15.886236 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 75fe8bb3-adef-484f-9f51-fd3c79998fce up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:36:15.927238 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c48b2036-7d49-4577-8fd7-e196ea308801 req-b01107c1-5e66-442d-bd00-2bc6e008dbd3 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0425727 Dec 09 21:36:15.933798 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fde65e02-6029-469f-bad9-28e19b96f5a4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:15.959407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e8ac781f-1f55-421a-8bf0-b46c1161543e None None] For port a1bb8df8-7c15-4208-aaeb-5e05198c6d35, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a1bb8df8-7c15-4208-aaeb-5e05198c6d35,segment=NetworkSegment(6ecee335-d5f9-4e22-b28f-82924fed3364),segment_id=6ecee335-d5f9-4e22-b28f-82924fed3364)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:15.959836 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e8ac781f-1f55-421a-8bf0-b46c1161543e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:15.967319 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fde65e02-6029-469f-bad9-28e19b96f5a4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Port': ['ID=a1bb8df8-7c15-4208-aaeb-5e05198c6d35,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:15.969838 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fde65e02-6029-469f-bad9-28e19b96f5a4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] No DVR routers for this DVR port a1bb8df8-7c15-4208-aaeb-5e05198c6d35 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:36:15.981621 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e8ac781f-1f55-421a-8bf0-b46c1161543e None None] Calling delete_port for a1bb8df8-7c15-4208-aaeb-5e05198c6d35 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:36:16.029850 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c48b2036-7d49-4577-8fd7-e196ea308801 req-be826076-a5d2-4253-bf39-28040aca27c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:16.031946 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c48b2036-7d49-4577-8fd7-e196ea308801 req-be826076-a5d2-4253-bf39-28040aca27c3 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 1097 time: 0.0755057 Dec 09 21:36:16.040353 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 75fe8bb3-adef-484f-9f51-fd3c79998fce completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:36:16.046846 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 75fe8bb3-adef-484f-9f51-fd3c79998fce triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:16.047222 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:16.070705 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fde65e02-6029-469f-bad9-28e19b96f5a4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:16.113881 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-fde65e02-6029-469f-bad9-28e19b96f5a4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f803ad5e-7819-4f9a-985a-010d8e7385f1']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:16.136991 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e8ac781f-1f55-421a-8bf0-b46c1161543e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:16.140031 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-fde65e02-6029-469f-bad9-28e19b96f5a4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6ecee335-d5f9-4e22-b28f-82924fed3364') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:16.140356 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-fde65e02-6029-469f-bad9-28e19b96f5a4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6ecee335-d5f9-4e22-b28f-82924fed3364') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:16.172565 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8ac781f-1f55-421a-8bf0-b46c1161543e None None] No DVR routers for this DVR port a1bb8df8-7c15-4208-aaeb-5e05198c6d35 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:36:16.178238 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fde65e02-6029-469f-bad9-28e19b96f5a4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:16.178915 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8ac781f-1f55-421a-8bf0-b46c1161543e None None] Pushing event deleted for resources: {'Port': ['ID=a1bb8df8-7c15-4208-aaeb-5e05198c6d35,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:16.199048 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:16.212452 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fde65e02-6029-469f-bad9-28e19b96f5a4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:16.221924 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fde65e02-6029-469f-bad9-28e19b96f5a4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Releasing vlan 128 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:36:16.222800 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fde65e02-6029-469f-bad9-28e19b96f5a4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:36:16.226576 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:36:16.248295 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 75fe8bb3-adef-484f-9f51-fd3c79998fce, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=75fe8bb3-adef-484f-9f51-fd3c79998fce,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:16.249468 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f2745c2-597a-47f5-a928-f3f5828c89ad req-adb9addf-6a3e-4e20-94ed-86de63b95270 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:16.249616 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '62e2a8f5-9097-4f6a-a915-2c8303b50c10', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '75fe8bb3-adef-484f-9f51-fd3c79998fce'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:36:16.253006 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-17d0c23a-0d89-45f5-af00-e588966d853a" -d '{"events": [{"server_uuid": "62e2a8f5-9097-4f6a-a915-2c8303b50c10", "name": "network-vif-plugged", "status": "completed", "tag": "75fe8bb3-adef-484f-9f51-fd3c79998fce"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:36:16.257367 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f2745c2-597a-47f5-a928-f3f5828c89ad req-adb9addf-6a3e-4e20-94ed-86de63b95270 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=62e2a8f5-9097-4f6a-a915-2c8303b50c10 HTTP/1.1" status: 200 len: 944 time: 0.0891504 Dec 09 21:36:16.271106 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:16.340961 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fde65e02-6029-469f-bad9-28e19b96f5a4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:16.358177 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fde65e02-6029-469f-bad9-28e19b96f5a4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:16.361548 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fde65e02-6029-469f-bad9-28e19b96f5a4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] 10.222.0.13 "DELETE /v2.0/networks/f803ad5e-7819-4f9a-985a-010d8e7385f1 HTTP/1.1" status: 204 len: 168 time: 0.8006158 Dec 09 21:36:16.401728 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:36:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-85912b7f-b7b4-4f35-887d-2b4158300fce x-openstack-request-id: req-85912b7f-b7b4-4f35-887d-2b4158300fce {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:36:16.401890 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f2745c2-597a-47f5-a928-f3f5828c89ad req-7eaeb97a-510d-4cf3-90e1-733e791fe80b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1433449 Dec 09 21:36:16.402028 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "62e2a8f5-9097-4f6a-a915-2c8303b50c10", "name": "network-vif-plugged", "status": "completed", "tag": "75fe8bb3-adef-484f-9f51-fd3c79998fce", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:36:16.402267 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-85912b7f-b7b4-4f35-887d-2b4158300fce {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:36:16.402838 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fde65e02-6029-469f-bad9-28e19b96f5a4 tempest-NetworksIpV6Test-1183395013 tempest-NetworksIpV6Test-1183395013-project] Pushing event deleted for resources: {'Network': ['ID=f803ad5e-7819-4f9a-985a-010d8e7385f1,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:16.402964 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '62e2a8f5-9097-4f6a-a915-2c8303b50c10', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '75fe8bb3-adef-484f-9f51-fd3c79998fce', 'code': 200} Dec 09 21:36:16.405661 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=75fe8bb3-adef-484f-9f51-fd3c79998fce,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:16.655310 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c48b2036-7d49-4577-8fd7-e196ea308801 req-889273f4-ea03-44fb-addd-f6b10247bd51 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:16.656846 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c48b2036-7d49-4577-8fd7-e196ea308801 req-889273f4-ea03-44fb-addd-f6b10247bd51 service neutron] 10.222.0.10 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 913 time: 0.6030834 Dec 09 21:36:16.673510 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eec0f6cc-4170-4b40-aa0a-9f8d6265ea35 req-23d2232d-6122-42ea-ab17-b02efdd927a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:16.674983 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-eec0f6cc-4170-4b40-aa0a-9f8d6265ea35 req-23d2232d-6122-42ea-ab17-b02efdd927a3 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=62e2a8f5-9097-4f6a-a915-2c8303b50c10 HTTP/1.1" status: 200 len: 1097 time: 0.0670254 Dec 09 21:36:16.707877 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c48b2036-7d49-4577-8fd7-e196ea308801 req-f7e86841-dfe6-42f6-97a7-a282956e6998 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d5571683-a9bc-4155-85b9-b1ef208e21e9 HTTP/1.1" status: 200 len: 217 time: 0.0430672 Dec 09 21:36:16.708738 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52406) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:16.788804 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c48b2036-7d49-4577-8fd7-e196ea308801 req-de32b18a-8a06-4357-91b0-dda148744342 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:16.796054 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c48b2036-7d49-4577-8fd7-e196ea308801 req-de32b18a-8a06-4357-91b0-dda148744342 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 200 len: 851 time: 0.0745084 Dec 09 21:36:16.796054 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-eec0f6cc-4170-4b40-aa0a-9f8d6265ea35 req-ab559893-d0df-481a-9080-3aa88bd4a61d service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0913577 Dec 09 21:36:16.853591 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c48b2036-7d49-4577-8fd7-e196ea308801 req-8c9c47ae-e33a-4937-87f0-e2fab73202d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:16.855506 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c48b2036-7d49-4577-8fd7-e196ea308801 req-8c9c47ae-e33a-4937-87f0-e2fab73202d5 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0574553 Dec 09 21:36:16.860789 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6b1627f5-20ab-419a-b5a4-45a9bf6bdcec admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=106acb1a6547449093d08a9502ab70fb&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1502843 Dec 09 21:36:16.863529 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52416) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:16.926981 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-57440342-d3ae-47ba-9ecd-d8baf0af75d9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:16.955798 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-57440342-d3ae-47ba-9ecd-d8baf0af75d9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:16.962354 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c48b2036-7d49-4577-8fd7-e196ea308801 req-b65f4c09-3d97-4bf2-b8ec-de5a53336d5f service neutron] 10.222.0.10 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0995035 Dec 09 21:36:17.006746 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-57440342-d3ae-47ba-9ecd-d8baf0af75d9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:17.009761 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-57440342-d3ae-47ba-9ecd-d8baf0af75d9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:17.013601 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-57440342-d3ae-47ba-9ecd-d8baf0af75d9 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/034961e8-8442-48f0-a0f8-254524eb11df HTTP/1.1" status: 204 len: 168 time: 0.1457436 Dec 09 21:36:17.027899 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57440342-d3ae-47ba-9ecd-d8baf0af75d9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=034961e8-8442-48f0-a0f8-254524eb11df,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:17.074821 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c48b2036-7d49-4577-8fd7-e196ea308801 req-746197a6-82ec-4596-baae-b077de7e0668 service neutron] 10.222.0.10 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1053572 Dec 09 21:36:17.529444 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ab9a97b-f5c5-44a5-bd52-f8eb5c3a6eae req-fcde4f30-d437-432b-a63d-11e7dd1aaad3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:17.539050 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ab9a97b-f5c5-44a5-bd52-f8eb5c3a6eae req-fcde4f30-d437-432b-a63d-11e7dd1aaad3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=62e2a8f5-9097-4f6a-a915-2c8303b50c10 HTTP/1.1" status: 200 len: 945 time: 0.0702977 Dec 09 21:36:17.557462 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a1bb8df8-7c15-4208-aaeb-5e05198c6d35 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:36:17.581509 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: a1bb8df8-7c15-4208-aaeb-5e05198c6d35 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:36:17.581979 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a1bb8df8-7c15-4208-aaeb-5e05198c6d35 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:36:17.601500 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ab9a97b-f5c5-44a5-bd52-f8eb5c3a6eae req-24643bdb-38e6-4810-8db6-60422f78930e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0613441 Dec 09 21:36:17.807404 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52452) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:18.032494 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-7f0c8fa8-f4cd-4833-91b3-0d1dd95c2fe6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Request body: {'router': {'name': 'tempest-RoutersNegativeIpV6Test-router-877371214', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:18.054727 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f0c8fa8-f4cd-4833-91b3-0d1dd95c2fe6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:18.055955 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f0c8fa8-f4cd-4833-91b3-0d1dd95c2fe6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:18.106337 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f0c8fa8-f4cd-4833-91b3-0d1dd95c2fe6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:18.111582 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f0c8fa8-f4cd-4833-91b3-0d1dd95c2fe6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:18.130204 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f0c8fa8-f4cd-4833-91b3-0d1dd95c2fe6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:18.131372 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7f0c8fa8-f4cd-4833-91b3-0d1dd95c2fe6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 711 time: 0.3228686 Dec 09 21:36:18.134938 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52464) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:18.139867 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-3139d2dc-1248-4abf-a209-46fd37c25b1c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Request body: {'network': {'name': 'tempest-RoutersNegativeIpV6Test-test-network-1831744710'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:18.161281 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3139d2dc-1248-4abf-a209-46fd37c25b1c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Made reservation on behalf of c655af29a1ac4879926cfb49e8e4183d for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:36:18.164900 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3139d2dc-1248-4abf-a209-46fd37c25b1c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:18.174227 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3139d2dc-1248-4abf-a209-46fd37c25b1c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:18.248939 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3139d2dc-1248-4abf-a209-46fd37c25b1c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:18.254025 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3139d2dc-1248-4abf-a209-46fd37c25b1c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:18.284464 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3139d2dc-1248-4abf-a209-46fd37c25b1c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] vlan segment allocate from pool success with {'vlan_id': 147, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:36:18.290148 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3139d2dc-1248-4abf-a209-46fd37c25b1c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3d2ef909-b6c9-433d-a964-2f48f49125bc,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:18.298696 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3139d2dc-1248-4abf-a209-46fd37c25b1c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:18.299065 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-3139d2dc-1248-4abf-a209-46fd37c25b1c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Added segment 9844037c-af3c-4f3d-9bbb-c167df5df582 of type vlan for network 2dd7c378-e8e7-4621-bb82-5ecdbafef420 Dec 09 21:36:18.343731 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3139d2dc-1248-4abf-a209-46fd37c25b1c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:18.370687 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3139d2dc-1248-4abf-a209-46fd37c25b1c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:18.376231 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3139d2dc-1248-4abf-a209-46fd37c25b1c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:18.376812 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3139d2dc-1248-4abf-a209-46fd37c25b1c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:18.414063 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3139d2dc-1248-4abf-a209-46fd37c25b1c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 791 time: 0.2780154 Dec 09 21:36:18.417978 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52470) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:18.424433 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-94e39fd0-1346-4084-9879-5f512c917c18 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Request body: {'subnet': {'network_id': '2dd7c378-e8e7-4621-bb82-5ecdbafef420', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:18.448315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3139d2dc-1248-4abf-a209-46fd37c25b1c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event updated for resources: {'Network': ['ID=2dd7c378-e8e7-4621-bb82-5ecdbafef420,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:18.458994 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 2dd7c378-e8e7-4621-bb82-5ecdbafef420 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:36:18.546263 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-94e39fd0-1346-4084-9879-5f512c917c18 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Made reservation on behalf of c655af29a1ac4879926cfb49e8e4183d for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:36:18.550113 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94e39fd0-1346-4084-9879-5f512c917c18 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:18.734886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-886a23c0-98df-44e3-8eb7-ea83586d21e0 req-9a5c334e-5f66-4264-af26-7c0b4469d57e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:18.736569 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-886a23c0-98df-44e3-8eb7-ea83586d21e0 req-9a5c334e-5f66-4264-af26-7c0b4469d57e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=62e2a8f5-9097-4f6a-a915-2c8303b50c10 HTTP/1.1" status: 200 len: 945 time: 0.0619156 Dec 09 21:36:18.739779 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94e39fd0-1346-4084-9879-5f512c917c18 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:18.793329 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-886a23c0-98df-44e3-8eb7-ea83586d21e0 req-074ad71f-f0f0-49b2-a30e-4aa9138b4e51 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0489032 Dec 09 21:36:18.813240 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94e39fd0-1346-4084-9879-5f512c917c18 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Checking segment: {'id': '9844037c-af3c-4f3d-9bbb-c167df5df582', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '2dd7c378-e8e7-4621-bb82-5ecdbafef420'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:36:18.813590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94e39fd0-1346-4084-9879-5f512c917c18 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Network hostable DHCP agents. Network: 2dd7c378-e8e7-4621-bb82-5ecdbafef420, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:36:18.816016 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94e39fd0-1346-4084-9879-5f512c917c18 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event updated for resources: {'Subnet': ['ID=b87ba2e9-fe7e-4a2f-9e6c-190332e65ef1,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:18.836943 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94e39fd0-1346-4084-9879-5f512c917c18 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Network 2dd7c378-e8e7-4621-bb82-5ecdbafef420 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:36:18.847286 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-94e39fd0-1346-4084-9879-5f512c917c18 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 2dd7c378-e8e7-4621-bb82-5ecdbafef420) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:18.852922 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-94e39fd0-1346-4084-9879-5f512c917c18 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:18.853677 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94e39fd0-1346-4084-9879-5f512c917c18 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:18.860124 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc5f0d5f-d7ff-4704-8547-f81ca0424834 None None] Network 2dd7c378-e8e7-4621-bb82-5ecdbafef420 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:18.886572 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-94e39fd0-1346-4084-9879-5f512c917c18 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4674332 Dec 09 21:36:18.890092 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52482) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:18.900093 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-42860b21-0ee5-482f-8f3d-2b53e156a505 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Request body: {'network': {'name': 'tempest-router-network01--2073565564'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:18.926089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f6147b8-841c-4957-a4b6-22e07c751217 req-43886e75-975e-40ba-ad11-8dba623bee48 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?name=default&fields=id&tenant_id=a36a93590a9f45e1b9b3f78753bb8e12 HTTP/1.1" status: 200 len: 267 time: 0.0548704 Dec 09 21:36:18.928159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-42860b21-0ee5-482f-8f3d-2b53e156a505 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Made reservation on behalf of c655af29a1ac4879926cfb49e8e4183d for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:36:18.932119 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42860b21-0ee5-482f-8f3d-2b53e156a505 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:18.988603 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-42860b21-0ee5-482f-8f3d-2b53e156a505 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] vlan segment allocate from pool success with {'vlan_id': 106, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:36:18.995637 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f6147b8-841c-4957-a4b6-22e07c751217 req-2db2a0b4-b9b8-4ed9-a3cf-9e11ead9af4c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:18.997026 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f6147b8-841c-4957-a4b6-22e07c751217 req-2db2a0b4-b9b8-4ed9-a3cf-9e11ead9af4c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=62e2a8f5-9097-4f6a-a915-2c8303b50c10 HTTP/1.1" status: 200 len: 945 time: 0.0638549 Dec 09 21:36:19.006360 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42860b21-0ee5-482f-8f3d-2b53e156a505 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:19.007115 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-42860b21-0ee5-482f-8f3d-2b53e156a505 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Added segment 5312a65b-2088-4471-aaff-ce07fbe1d1a1 of type vlan for network 832a7450-f598-4d98-8dc0-070aca3694e2 Dec 09 21:36:19.014363 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-5f6147b8-841c-4957-a4b6-22e07c751217 req-fabeee95-8357-4dcc-ac2a-9b28e937b035 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Request body: {'port': {'security_groups': []}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:19.014628 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0033543d-272f-409b-a6e4-11e7b5f6b664 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-2dd7c378-e8e7-4621-bb82-5ecdbafef420', 'network_id': '2dd7c378-e8e7-4621-bb82-5ecdbafef420', 'project_id': 'c655af29a1ac4879926cfb49e8e4183d', 'fixed_ips': [{'subnet_id': 'b87ba2e9-fe7e-4a2f-9e6c-190332e65ef1'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:36:19.016800 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0033543d-272f-409b-a6e4-11e7b5f6b664 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:19.065407 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42860b21-0ee5-482f-8f3d-2b53e156a505 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:19.100970 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42860b21-0ee5-482f-8f3d-2b53e156a505 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:19.108664 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-42860b21-0ee5-482f-8f3d-2b53e156a505 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:19.109840 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42860b21-0ee5-482f-8f3d-2b53e156a505 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:19.134871 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-42860b21-0ee5-482f-8f3d-2b53e156a505 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.2435200 Dec 09 21:36:19.142262 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52492) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:19.150912 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-40a42bd0-6c9d-4a08-a556-8e37fcc3b17e tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Request body: {'network': {'name': 'tempest-router-network02--1877564296'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:19.175588 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5f6147b8-841c-4957-a4b6-22e07c751217 req-fabeee95-8357-4dcc-ac2a-9b28e937b035 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:19.219648 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42860b21-0ee5-482f-8f3d-2b53e156a505 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event updated for resources: {'Network': ['ID=832a7450-f598-4d98-8dc0-070aca3694e2,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:19.236198 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 832a7450-f598-4d98-8dc0-070aca3694e2 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:36:19.240310 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-0033543d-272f-409b-a6e4-11e7b5f6b664 None None] Allocated IP 2001:db8::2 (2dd7c378-e8e7-4621-bb82-5ecdbafef420/b87ba2e9-fe7e-4a2f-9e6c-190332e65ef1/18683261-1ff4-4746-ade2-fc2e188298b7) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:36:19.274432 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9427f85f-a561-46a8-9e3b-cb7eae726441 req-6db7027e-0600-4f77-aea2-3495cdb02fe0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:19.280482 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9427f85f-a561-46a8-9e3b-cb7eae726441 req-6db7027e-0600-4f77-aea2-3495cdb02fe0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:19.286418 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9427f85f-a561-46a8-9e3b-cb7eae726441 req-6db7027e-0600-4f77-aea2-3495cdb02fe0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:19.292499 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9427f85f-a561-46a8-9e3b-cb7eae726441 req-6db7027e-0600-4f77-aea2-3495cdb02fe0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:19.298423 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9427f85f-a561-46a8-9e3b-cb7eae726441 req-6db7027e-0600-4f77-aea2-3495cdb02fe0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:19.304230 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9427f85f-a561-46a8-9e3b-cb7eae726441 req-6db7027e-0600-4f77-aea2-3495cdb02fe0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:19.310134 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9427f85f-a561-46a8-9e3b-cb7eae726441 req-6db7027e-0600-4f77-aea2-3495cdb02fe0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:19.312187 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9427f85f-a561-46a8-9e3b-cb7eae726441 req-6db7027e-0600-4f77-aea2-3495cdb02fe0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5445 time: 0.2048311 Dec 09 21:36:19.315217 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-40a42bd0-6c9d-4a08-a556-8e37fcc3b17e tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Made reservation on behalf of c655af29a1ac4879926cfb49e8e4183d for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:36:19.318670 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-40a42bd0-6c9d-4a08-a556-8e37fcc3b17e tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:19.431699 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-40a42bd0-6c9d-4a08-a556-8e37fcc3b17e tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] vlan segment allocate from pool success with {'vlan_id': 118, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:36:19.464637 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0033543d-272f-409b-a6e4-11e7b5f6b664 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:19.467353 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-40a42bd0-6c9d-4a08-a556-8e37fcc3b17e tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:19.467722 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-40a42bd0-6c9d-4a08-a556-8e37fcc3b17e tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Added segment 78d96733-0720-44d5-97bf-be03bbf3ee99 of type vlan for network 60615649-0a44-41cc-96b0-9d95f10619d0 Dec 09 21:36:19.471830 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0033543d-272f-409b-a6e4-11e7b5f6b664 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:19.477006 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9427f85f-a561-46a8-9e3b-cb7eae726441 req-1f2ad816-fc08-4e99-bbd0-488b4ac15ebc tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1550767 Dec 09 21:36:19.497110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-5f6147b8-841c-4957-a4b6-22e07c751217 req-fabeee95-8357-4dcc-ac2a-9b28e937b035 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] For port 75fe8bb3-adef-484f-9f51-fd3c79998fce, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=75fe8bb3-adef-484f-9f51-fd3c79998fce,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:19.542054 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-40a42bd0-6c9d-4a08-a556-8e37fcc3b17e tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:19.553142 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0033543d-272f-409b-a6e4-11e7b5f6b664 None None] Pushing event updated for resources: {'Port': ['ID=18683261-1ff4-4746-ade2-fc2e188298b7,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:19.556677 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0033543d-272f-409b-a6e4-11e7b5f6b664 None None] Network 2dd7c378-e8e7-4621-bb82-5ecdbafef420 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:36:19.558559 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-0033543d-272f-409b-a6e4-11e7b5f6b664 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:19.560713 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0033543d-272f-409b-a6e4-11e7b5f6b664 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:36:19.567959 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5f6147b8-841c-4957-a4b6-22e07c751217 req-fabeee95-8357-4dcc-ac2a-9b28e937b035 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:19.587892 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5f6147b8-841c-4957-a4b6-22e07c751217 req-fabeee95-8357-4dcc-ac2a-9b28e937b035 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:19.613623 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['ae3b2bf8-8e63-4473-8cc8-206c769cc38a', '75fe8bb3-adef-484f-9f51-fd3c79998fce'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:36:19.615758 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['d5571683-a9bc-4155-85b9-b1ef208e21e9'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:36:19.618778 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-40a42bd0-6c9d-4a08-a556-8e37fcc3b17e tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:19.626274 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40a42bd0-6c9d-4a08-a556-8e37fcc3b17e tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:19.626274 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-40a42bd0-6c9d-4a08-a556-8e37fcc3b17e tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:19.674174 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0033543d-272f-409b-a6e4-11e7b5f6b664 None None] Attempting to bind port 18683261-1ff4-4746-ade2-fc2e188298b7 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:36:19.674174 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0033543d-272f-409b-a6e4-11e7b5f6b664 None None] Attempting to bind port 18683261-1ff4-4746-ade2-fc2e188298b7 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '9844037c-af3c-4f3d-9bbb-c167df5df582', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '2dd7c378-e8e7-4621-bb82-5ecdbafef420'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:36:19.674174 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0033543d-272f-409b-a6e4-11e7b5f6b664 None None] Attempting to bind port 18683261-1ff4-4746-ade2-fc2e188298b7 on network 2dd7c378-e8e7-4621-bb82-5ecdbafef420 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:36:19.684320 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f6147b8-841c-4957-a4b6-22e07c751217 req-fabeee95-8357-4dcc-ac2a-9b28e937b035 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:19.685244 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5f6147b8-841c-4957-a4b6-22e07c751217 req-fabeee95-8357-4dcc-ac2a-9b28e937b035 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:19.685940 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0033543d-272f-409b-a6e4-11e7b5f6b664 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 36, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:36:19.686451 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0033543d-272f-409b-a6e4-11e7b5f6b664 None None] Checking segment: {'id': '9844037c-af3c-4f3d-9bbb-c167df5df582', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '2dd7c378-e8e7-4621-bb82-5ecdbafef420'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:36:19.686959 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0033543d-272f-409b-a6e4-11e7b5f6b664 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:19.687121 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f6147b8-841c-4957-a4b6-22e07c751217 req-fabeee95-8357-4dcc-ac2a-9b28e937b035 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "PUT /v2.0/ports/75fe8bb3-adef-484f-9f51-fd3c79998fce HTTP/1.1" status: 200 len: 904 time: 0.6830442 Dec 09 21:36:19.687567 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0033543d-272f-409b-a6e4-11e7b5f6b664 None None] Bound using segment: {'id': '9844037c-af3c-4f3d-9bbb-c167df5df582', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '2dd7c378-e8e7-4621-bb82-5ecdbafef420'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:36:19.688394 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0033543d-272f-409b-a6e4-11e7b5f6b664 None None] Bound port: 18683261-1ff4-4746-ade2-fc2e188298b7, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9844037c-af3c-4f3d-9bbb-c167df5df582', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '2dd7c378-e8e7-4621-bb82-5ecdbafef420'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:36:19.688671 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0033543d-272f-409b-a6e4-11e7b5f6b664 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:19.705407 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '62e2a8f5-9097-4f6a-a915-2c8303b50c10', 'tag': '75fe8bb3-adef-484f-9f51-fd3c79998fce'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:36:19.707687 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c7d1f4dd-694b-492c-acc7-78ed1ead8b63" -d '{"events": [{"name": "network-changed", "server_uuid": "62e2a8f5-9097-4f6a-a915-2c8303b50c10", "tag": "75fe8bb3-adef-484f-9f51-fd3c79998fce"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:36:19.740576 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-40a42bd0-6c9d-4a08-a556-8e37fcc3b17e tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.5948467 Dec 09 21:36:19.745190 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52506) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:19.752870 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-cedcfbe0-6f24-4a10-bb58-42546db38acf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Request body: {'subnet': {'network_id': '832a7450-f598-4d98-8dc0-070aca3694e2', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:19.791460 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40a42bd0-6c9d-4a08-a556-8e37fcc3b17e tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event updated for resources: {'Network': ['ID=60615649-0a44-41cc-96b0-9d95f10619d0,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:19.793836 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fabeee95-8357-4dcc-ac2a-9b28e937b035 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Pushing event updated for resources: {'Port': ['ID=75fe8bb3-adef-484f-9f51-fd3c79998fce,revision_number=6']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:19.811894 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['75fe8bb3-adef-484f-9f51-fd3c79998fce'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:36:19.871775 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fea9757-c27e-4fa8-b581-4ee7f63f96c1 req-9ffa8914-6d8c-4fcd-91eb-7cdb007b607d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:19.877719 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fea9757-c27e-4fa8-b581-4ee7f63f96c1 req-9ffa8914-6d8c-4fcd-91eb-7cdb007b607d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:19.884245 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fea9757-c27e-4fa8-b581-4ee7f63f96c1 req-9ffa8914-6d8c-4fcd-91eb-7cdb007b607d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:19.890425 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fea9757-c27e-4fa8-b581-4ee7f63f96c1 req-9ffa8914-6d8c-4fcd-91eb-7cdb007b607d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:19.897010 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 60615649-0a44-41cc-96b0-9d95f10619d0 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:36:19.898037 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fea9757-c27e-4fa8-b581-4ee7f63f96c1 req-9ffa8914-6d8c-4fcd-91eb-7cdb007b607d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:19.900222 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cedcfbe0-6f24-4a10-bb58-42546db38acf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Made reservation on behalf of c655af29a1ac4879926cfb49e8e4183d for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:36:19.903894 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0033543d-272f-409b-a6e4-11e7b5f6b664 None None] For port 18683261-1ff4-4746-ade2-fc2e188298b7, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:36:19.904530 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fea9757-c27e-4fa8-b581-4ee7f63f96c1 req-9ffa8914-6d8c-4fcd-91eb-7cdb007b607d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:19.910745 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fea9757-c27e-4fa8-b581-4ee7f63f96c1 req-9ffa8914-6d8c-4fcd-91eb-7cdb007b607d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:19.910961 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cedcfbe0-6f24-4a10-bb58-42546db38acf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:19.924800 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fea9757-c27e-4fa8-b581-4ee7f63f96c1 req-9ffa8914-6d8c-4fcd-91eb-7cdb007b607d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5445 time: 0.2889392 Dec 09 21:36:19.967736 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a83056e-d9a2-4904-adbf-04a42f045bdc req-25e2744b-0c1f-470a-b2d9-61d4dccd85db tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:19.969330 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4a83056e-d9a2-4904-adbf-04a42f045bdc req-25e2744b-0c1f-470a-b2d9-61d4dccd85db tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=62e2a8f5-9097-4f6a-a915-2c8303b50c10 HTTP/1.1" status: 200 len: 907 time: 0.1682389 Dec 09 21:36:19.991193 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:36:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b231d82a-fdc4-4b1b-ac7b-31445b97732c x-openstack-request-id: req-b231d82a-fdc4-4b1b-ac7b-31445b97732c {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:36:19.991703 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "62e2a8f5-9097-4f6a-a915-2c8303b50c10", "tag": "75fe8bb3-adef-484f-9f51-fd3c79998fce", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:36:19.992838 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-b231d82a-fdc4-4b1b-ac7b-31445b97732c {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:36:19.993534 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '62e2a8f5-9097-4f6a-a915-2c8303b50c10', 'tag': '75fe8bb3-adef-484f-9f51-fd3c79998fce', 'status': 'completed', 'code': 200} Dec 09 21:36:20.112472 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0033543d-272f-409b-a6e4-11e7b5f6b664 None None] For port 18683261-1ff4-4746-ade2-fc2e188298b7, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=18683261-1ff4-4746-ade2-fc2e188298b7,segment=NetworkSegment(9844037c-af3c-4f3d-9bbb-c167df5df582),segment_id=9844037c-af3c-4f3d-9bbb-c167df5df582)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:36:20.135455 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7d1f4dd-694b-492c-acc7-78ed1ead8b63 req-5e845423-e82a-488f-93ce-a7ca0aa5eb2f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:20.137228 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c7d1f4dd-694b-492c-acc7-78ed1ead8b63 req-5e845423-e82a-488f-93ce-a7ca0aa5eb2f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&device_id=62e2a8f5-9097-4f6a-a915-2c8303b50c10 HTTP/1.1" status: 200 len: 1059 time: 0.1132352 Dec 09 21:36:20.141908 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0033543d-272f-409b-a6e4-11e7b5f6b664 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:20.198186 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbcf0fd9-573d-4ccb-932c-6b9628005a5f req-64fbbfb6-0be9-4f8c-a264-ad91db73b478 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:20.206582 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fbcf0fd9-573d-4ccb-932c-6b9628005a5f req-64fbbfb6-0be9-4f8c-a264-ad91db73b478 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0968552 Dec 09 21:36:20.267486 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fbcf0fd9-573d-4ccb-932c-6b9628005a5f req-dd7e900b-d570-465d-8931-f510eeac3bdd tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0593085 Dec 09 21:36:20.295017 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0033543d-272f-409b-a6e4-11e7b5f6b664 None None] Pushing event updated for resources: {'Port': ['ID=18683261-1ff4-4746-ade2-fc2e188298b7,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:20.408892 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7d1f4dd-694b-492c-acc7-78ed1ead8b63 req-f192ae6b-6c31-49ec-bd43-7b88aab95fbd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:20.410623 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c7d1f4dd-694b-492c-acc7-78ed1ead8b63 req-f192ae6b-6c31-49ec-bd43-7b88aab95fbd service neutron] 10.222.0.31 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 913 time: 0.2652328 Dec 09 21:36:20.411601 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-cdd75940-a70a-4eb2-b162-b7676852ab8b None None] Provisioning complete for port 75fe8bb3-adef-484f-9f51-fd3c79998fce triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:20.411904 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cdd75940-a70a-4eb2-b162-b7676852ab8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:20.430651 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cedcfbe0-6f24-4a10-bb58-42546db38acf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:20.464824 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71538610-3047-443d-9ce1-6599b9bca0fb req-c948de60-12e6-4883-9743-e2dbecfc627f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:20.473761 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71538610-3047-443d-9ce1-6599b9bca0fb req-c948de60-12e6-4883-9743-e2dbecfc627f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1007316 Dec 09 21:36:20.474987 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c7d1f4dd-694b-492c-acc7-78ed1ead8b63 req-22f40d3b-b091-4da6-acc2-05a057aa9adb service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=75fe8bb3-adef-484f-9f51-fd3c79998fce HTTP/1.1" status: 200 len: 217 time: 0.0544410 Dec 09 21:36:20.548507 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71538610-3047-443d-9ce1-6599b9bca0fb req-a699bc9c-5afe-4f52-bab6-89a2213696c1 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0733604 Dec 09 21:36:20.628975 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cedcfbe0-6f24-4a10-bb58-42546db38acf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event updated for resources: {'Subnet': ['ID=70783e0e-9435-496c-bfcb-e212fdc7e52a,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:20.645022 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7d1f4dd-694b-492c-acc7-78ed1ead8b63 req-57dedfc1-7572-47a2-8c44-4f230180776e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:20.648263 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c7d1f4dd-694b-492c-acc7-78ed1ead8b63 req-57dedfc1-7572-47a2-8c44-4f230180776e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 200 len: 851 time: 0.1500161 Dec 09 21:36:20.655054 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cedcfbe0-6f24-4a10-bb58-42546db38acf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Checking segment: {'id': '5312a65b-2088-4471-aaff-ce07fbe1d1a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '832a7450-f598-4d98-8dc0-070aca3694e2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:36:20.656733 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cedcfbe0-6f24-4a10-bb58-42546db38acf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Network hostable DHCP agents. Network: 832a7450-f598-4d98-8dc0-070aca3694e2, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:36:20.731989 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cedcfbe0-6f24-4a10-bb58-42546db38acf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Network 832a7450-f598-4d98-8dc0-070aca3694e2 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:36:20.743932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7d1f4dd-694b-492c-acc7-78ed1ead8b63 req-cc3f3284-4838-4b17-912c-d49e80fcc89a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:20.746055 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c7d1f4dd-694b-492c-acc7-78ed1ead8b63 req-cc3f3284-4838-4b17-912c-d49e80fcc89a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0881107 Dec 09 21:36:20.747601 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-cedcfbe0-6f24-4a10-bb58-42546db38acf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 832a7450-f598-4d98-8dc0-070aca3694e2) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:20.755718 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cedcfbe0-6f24-4a10-bb58-42546db38acf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:20.756536 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cedcfbe0-6f24-4a10-bb58-42546db38acf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:20.764818 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e3dee177-5b56-455e-b322-820d838c974e None None] Network 832a7450-f598-4d98-8dc0-070aca3694e2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:20.826609 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52532) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:20.832816 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-5028a237-9b42-4b8d-a16a-e4cf132aac4f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Request body: {'subnet': {'network_id': '60615649-0a44-41cc-96b0-9d95f10619d0', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:20.838104 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cedcfbe0-6f24-4a10-bb58-42546db38acf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.0900826 Dec 09 21:36:20.913863 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c7d1f4dd-694b-492c-acc7-78ed1ead8b63 req-24d37e97-bcca-4e9f-8012-b2b6cdc0d3fa service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1599889 Dec 09 21:36:20.968918 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f22755f-41a4-4e57-9fdb-6d12318226a4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-832a7450-f598-4d98-8dc0-070aca3694e2', 'network_id': '832a7450-f598-4d98-8dc0-070aca3694e2', 'project_id': 'c655af29a1ac4879926cfb49e8e4183d', 'fixed_ips': [{'subnet_id': '70783e0e-9435-496c-bfcb-e212fdc7e52a'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:36:20.970645 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6f22755f-41a4-4e57-9fdb-6d12318226a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:21.012538 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5028a237-9b42-4b8d-a16a-e4cf132aac4f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Made reservation on behalf of c655af29a1ac4879926cfb49e8e4183d for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:36:21.016184 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5028a237-9b42-4b8d-a16a-e4cf132aac4f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:21.040158 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c7d1f4dd-694b-492c-acc7-78ed1ead8b63 req-4120c6d4-606c-4a32-ae28-1c96cdd9a074 service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1176846 Dec 09 21:36:21.070885 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:36:21.180005 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-6f22755f-41a4-4e57-9fdb-6d12318226a4 None None] Allocated IP 2001:db8::2 (832a7450-f598-4d98-8dc0-070aca3694e2/70783e0e-9435-496c-bfcb-e212fdc7e52a/0cbb1260-61c8-4855-b217-085b9d1bbf01) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:36:21.192862 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d10df5a-cb04-4413-aced-d38e660557dd req-36cf983c-17d0-43ed-a7a0-d500db032c67 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:21.194897 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d10df5a-cb04-4413-aced-d38e660557dd req-36cf983c-17d0-43ed-a7a0-d500db032c67 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 812 time: 0.2565374 Dec 09 21:36:21.227198 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d10df5a-cb04-4413-aced-d38e660557dd req-95cc7e08-19dc-44bb-a3e1-212e1f09c71a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/quotas/a36a93590a9f45e1b9b3f78753bb8e12 HTTP/1.1" status: 200 len: 375 time: 0.0249233 Dec 09 21:36:21.387598 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d10df5a-cb04-4413-aced-d38e660557dd req-a3d73df9-7a00-4666-92a0-a3b64c825f16 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&fields=id HTTP/1.1" status: 200 len: 486 time: 0.1381333 Dec 09 21:36:21.388545 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6f22755f-41a4-4e57-9fdb-6d12318226a4 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:21.398303 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6f22755f-41a4-4e57-9fdb-6d12318226a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:21.449446 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f22755f-41a4-4e57-9fdb-6d12318226a4 None None] Pushing event updated for resources: {'Port': ['ID=0cbb1260-61c8-4855-b217-085b9d1bbf01,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:21.457159 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f22755f-41a4-4e57-9fdb-6d12318226a4 None None] Network 832a7450-f598-4d98-8dc0-070aca3694e2 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:36:21.458857 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-6f22755f-41a4-4e57-9fdb-6d12318226a4 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:21.461213 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f22755f-41a4-4e57-9fdb-6d12318226a4 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:36:21.545175 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5028a237-9b42-4b8d-a16a-e4cf132aac4f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:21.568209 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6f22755f-41a4-4e57-9fdb-6d12318226a4 None None] Attempting to bind port 0cbb1260-61c8-4855-b217-085b9d1bbf01 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:36:21.568916 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6f22755f-41a4-4e57-9fdb-6d12318226a4 None None] Attempting to bind port 0cbb1260-61c8-4855-b217-085b9d1bbf01 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '5312a65b-2088-4471-aaff-ce07fbe1d1a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '832a7450-f598-4d98-8dc0-070aca3694e2'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:36:21.569460 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f22755f-41a4-4e57-9fdb-6d12318226a4 None None] Attempting to bind port 0cbb1260-61c8-4855-b217-085b9d1bbf01 on network 832a7450-f598-4d98-8dc0-070aca3694e2 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:36:21.575263 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f22755f-41a4-4e57-9fdb-6d12318226a4 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 36, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:36:21.575968 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f22755f-41a4-4e57-9fdb-6d12318226a4 None None] Checking segment: {'id': '5312a65b-2088-4471-aaff-ce07fbe1d1a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '832a7450-f598-4d98-8dc0-070aca3694e2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:36:21.576565 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6f22755f-41a4-4e57-9fdb-6d12318226a4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:21.577156 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f22755f-41a4-4e57-9fdb-6d12318226a4 None None] Bound using segment: {'id': '5312a65b-2088-4471-aaff-ce07fbe1d1a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '832a7450-f598-4d98-8dc0-070aca3694e2'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:36:21.577804 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6f22755f-41a4-4e57-9fdb-6d12318226a4 None None] Bound port: 0cbb1260-61c8-4855-b217-085b9d1bbf01, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5312a65b-2088-4471-aaff-ce07fbe1d1a1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': '832a7450-f598-4d98-8dc0-070aca3694e2'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:36:21.578367 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6f22755f-41a4-4e57-9fdb-6d12318226a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:21.648407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 18683261-1ff4-4746-ade2-fc2e188298b7 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:36:21.669510 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d10df5a-cb04-4413-aced-d38e660557dd req-139c9ec4-0d20-45e7-8ba1-6f376c3942b6 service neutron] 10.222.0.13 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2806437 Dec 09 21:36:21.703295 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5028a237-9b42-4b8d-a16a-e4cf132aac4f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event updated for resources: {'Subnet': ['ID=b1c82ce0-dc10-42dc-b45e-91449f0fa588,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:21.732819 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5028a237-9b42-4b8d-a16a-e4cf132aac4f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Checking segment: {'id': '78d96733-0720-44d5-97bf-be03bbf3ee99', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '60615649-0a44-41cc-96b0-9d95f10619d0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:36:21.733189 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5028a237-9b42-4b8d-a16a-e4cf132aac4f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Network hostable DHCP agents. Network: 60615649-0a44-41cc-96b0-9d95f10619d0, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:36:21.813624 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5028a237-9b42-4b8d-a16a-e4cf132aac4f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Network 60615649-0a44-41cc-96b0-9d95f10619d0 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:36:21.832416 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d10df5a-cb04-4413-aced-d38e660557dd req-965f8f28-b1e0-4ae4-bdc9-80c0e540b5e7 service neutron] 10.222.0.13 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1607084 Dec 09 21:36:21.845319 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-5028a237-9b42-4b8d-a16a-e4cf132aac4f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 60615649-0a44-41cc-96b0-9d95f10619d0) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:21.852612 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5028a237-9b42-4b8d-a16a-e4cf132aac4f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:21.853234 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5028a237-9b42-4b8d-a16a-e4cf132aac4f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:21.880548 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5028a237-9b42-4b8d-a16a-e4cf132aac4f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 1.0532339 Dec 09 21:36:21.882054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ddeb3396-621e-40f6-88ac-04bd676109e9 None None] Network 2dd7c378-e8e7-4621-bb82-5ecdbafef420 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:21.883665 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52558) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:21.885294 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e3ce7e05-0d2b-47cd-85e7-c4fdad458c0e None None] Network 60615649-0a44-41cc-96b0-9d95f10619d0 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:22.069682 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1bec813a-be70-49f7-9386-29a61f107077 None None] Provisioning complete for port 18683261-1ff4-4746-ade2-fc2e188298b7 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:22.070372 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1bec813a-be70-49f7-9386-29a61f107077 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:22.088549 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a1d0900-ccda-4f51-801b-61d0cf781f18 req-0cbadda4-3277-4e24-abf1-9ec94a7fde3d tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 210 time: 0.0496461 Dec 09 21:36:22.157810 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6f22755f-41a4-4e57-9fdb-6d12318226a4 None None] For port 0cbb1260-61c8-4855-b217-085b9d1bbf01, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:36:22.216764 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6f22755f-41a4-4e57-9fdb-6d12318226a4 None None] For port 0cbb1260-61c8-4855-b217-085b9d1bbf01, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=0cbb1260-61c8-4855-b217-085b9d1bbf01,segment=NetworkSegment(5312a65b-2088-4471-aaff-ce07fbe1d1a1),segment_id=5312a65b-2088-4471-aaff-ce07fbe1d1a1)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:36:22.256435 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6f22755f-41a4-4e57-9fdb-6d12318226a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:22.284617 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 18683261-1ff4-4746-ade2-fc2e188298b7 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:22.284988 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:22.344820 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d0a13120-3dc1-449d-ae22-4d1ff4ffea98 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-60615649-0a44-41cc-96b0-9d95f10619d0', 'network_id': '60615649-0a44-41cc-96b0-9d95f10619d0', 'project_id': 'c655af29a1ac4879926cfb49e8e4183d', 'fixed_ips': [{'subnet_id': 'b1c82ce0-dc10-42dc-b45e-91449f0fa588'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:36:22.345783 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d0a13120-3dc1-449d-ae22-4d1ff4ffea98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:22.422890 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c2db088-b17b-47c9-ae0d-4d977c0627e0 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:22.577767 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f22755f-41a4-4e57-9fdb-6d12318226a4 None None] Pushing event updated for resources: {'Port': ['ID=0cbb1260-61c8-4855-b217-085b9d1bbf01,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:22.580597 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1bec813a-be70-49f7-9386-29a61f107077 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:22.681413 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-1bec813a-be70-49f7-9386-29a61f107077 None None] For port 18683261-1ff4-4746-ade2-fc2e188298b7, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=18683261-1ff4-4746-ade2-fc2e188298b7,segment=NetworkSegment(9844037c-af3c-4f3d-9bbb-c167df5df582),segment_id=9844037c-af3c-4f3d-9bbb-c167df5df582)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:22.762669 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ada48239-8c63-4217-89bc-c16f68e14c3e req-cb14d468-fc68-443e-878d-b68b8af5e342 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:22.773547 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ada48239-8c63-4217-89bc-c16f68e14c3e req-cb14d468-fc68-443e-878d-b68b8af5e342 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 946 time: 0.2152565 Dec 09 21:36:22.793058 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1bec813a-be70-49f7-9386-29a61f107077 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:23.045073 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52606) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:23.057963 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ada48239-8c63-4217-89bc-c16f68e14c3e req-17f67eb9-8666-4598-a48e-3f271a3dabd5 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2826405 Dec 09 21:36:23.100172 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bec813a-be70-49f7-9386-29a61f107077 None None] Pushing event updated for resources: {'Port': ['ID=18683261-1ff4-4746-ade2-fc2e188298b7,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:23.126588 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-d0a13120-3dc1-449d-ae22-4d1ff4ffea98 None None] Allocated IP 2001:db8::2 (60615649-0a44-41cc-96b0-9d95f10619d0/b1c82ce0-dc10-42dc-b45e-91449f0fa588/00259158-6c71-4dd2-99a3-40829e1a80bb) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:36:23.152332 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3b910d6d-1651-4622-9000-8d697207adc9 None None] Provisioning complete for port 18683261-1ff4-4746-ade2-fc2e188298b7 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:23.152987 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3b910d6d-1651-4622-9000-8d697207adc9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:23.161826 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-93523cde-b662-40bf-af1a-6c4629a4307b req-0db67882-3f90-4be0-9cb1-392692fa8357 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.2473640 Dec 09 21:36:23.228720 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-6c2db088-b17b-47c9-ae0d-4d977c0627e0 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Allocated IP 2001:db8::1 (832a7450-f598-4d98-8dc0-070aca3694e2/70783e0e-9435-496c-bfcb-e212fdc7e52a/74608280-c47c-4b51-b0b7-02d0a0cb8fd9) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:36:23.271981 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ca88dbf9-712e-4837-bdd7-748b972d9022 req-50a0b33d-f85a-4cc3-b4d5-a6f4780a3e46 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 210 time: 0.0458944 Dec 09 21:36:23.407548 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d0a13120-3dc1-449d-ae22-4d1ff4ffea98 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:23.416422 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d0a13120-3dc1-449d-ae22-4d1ff4ffea98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:23.462566 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0a13120-3dc1-449d-ae22-4d1ff4ffea98 None None] Network 60615649-0a44-41cc-96b0-9d95f10619d0 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:36:23.467992 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-d0a13120-3dc1-449d-ae22-4d1ff4ffea98 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:23.477480 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0a13120-3dc1-449d-ae22-4d1ff4ffea98 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:36:23.485731 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0a13120-3dc1-449d-ae22-4d1ff4ffea98 None None] Pushing event updated for resources: {'Port': ['ID=00259158-6c71-4dd2-99a3-40829e1a80bb,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:23.569861 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-d0a13120-3dc1-449d-ae22-4d1ff4ffea98 None None] Attempting to bind port 00259158-6c71-4dd2-99a3-40829e1a80bb on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:36:23.574588 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-d0a13120-3dc1-449d-ae22-4d1ff4ffea98 None None] Attempting to bind port 00259158-6c71-4dd2-99a3-40829e1a80bb by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '78d96733-0720-44d5-97bf-be03bbf3ee99', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '60615649-0a44-41cc-96b0-9d95f10619d0'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:36:23.575255 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0a13120-3dc1-449d-ae22-4d1ff4ffea98 None None] Attempting to bind port 00259158-6c71-4dd2-99a3-40829e1a80bb on network 60615649-0a44-41cc-96b0-9d95f10619d0 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:36:23.591877 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0a13120-3dc1-449d-ae22-4d1ff4ffea98 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 36, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:36:23.592259 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0a13120-3dc1-449d-ae22-4d1ff4ffea98 None None] Checking segment: {'id': '78d96733-0720-44d5-97bf-be03bbf3ee99', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '60615649-0a44-41cc-96b0-9d95f10619d0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:36:23.592682 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d0a13120-3dc1-449d-ae22-4d1ff4ffea98 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:23.593065 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0a13120-3dc1-449d-ae22-4d1ff4ffea98 None None] Bound using segment: {'id': '78d96733-0720-44d5-97bf-be03bbf3ee99', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '60615649-0a44-41cc-96b0-9d95f10619d0'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:36:23.593539 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-d0a13120-3dc1-449d-ae22-4d1ff4ffea98 None None] Bound port: 00259158-6c71-4dd2-99a3-40829e1a80bb, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '78d96733-0720-44d5-97bf-be03bbf3ee99', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '60615649-0a44-41cc-96b0-9d95f10619d0'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:36:23.593913 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d0a13120-3dc1-449d-ae22-4d1ff4ffea98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:23.599424 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93523cde-b662-40bf-af1a-6c4629a4307b req-ce1d7322-8f5c-42a8-83f3-92067804d63c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:23.601680 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-93523cde-b662-40bf-af1a-6c4629a4307b req-ce1d7322-8f5c-42a8-83f3-92067804d63c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 1097 time: 0.2690012 Dec 09 21:36:23.617174 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c2db088-b17b-47c9-ae0d-4d977c0627e0 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:23.627559 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fae1b63-14b1-4c36-a099-b327e4827f19 req-449a9c90-f489-48af-9577-60f049d03295 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:23.628152 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fae1b63-14b1-4c36-a099-b327e4827f19 req-449a9c90-f489-48af-9577-60f049d03295 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:23.628593 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fae1b63-14b1-4c36-a099-b327e4827f19 req-449a9c90-f489-48af-9577-60f049d03295 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:23.629049 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fae1b63-14b1-4c36-a099-b327e4827f19 req-449a9c90-f489-48af-9577-60f049d03295 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:23.629501 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fae1b63-14b1-4c36-a099-b327e4827f19 req-449a9c90-f489-48af-9577-60f049d03295 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:23.629951 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fae1b63-14b1-4c36-a099-b327e4827f19 req-449a9c90-f489-48af-9577-60f049d03295 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:23.630404 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fae1b63-14b1-4c36-a099-b327e4827f19 req-449a9c90-f489-48af-9577-60f049d03295 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:23.638841 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6fae1b63-14b1-4c36-a099-b327e4827f19 req-449a9c90-f489-48af-9577-60f049d03295 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 6509 time: 0.5842800 Dec 09 21:36:23.717912 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-d0a13120-3dc1-449d-ae22-4d1ff4ffea98 None None] For port 00259158-6c71-4dd2-99a3-40829e1a80bb, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:36:23.724426 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-d0a13120-3dc1-449d-ae22-4d1ff4ffea98 None None] For port 00259158-6c71-4dd2-99a3-40829e1a80bb, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=00259158-6c71-4dd2-99a3-40829e1a80bb,segment=NetworkSegment(78d96733-0720-44d5-97bf-be03bbf3ee99),segment_id=78d96733-0720-44d5-97bf-be03bbf3ee99)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:36:23.733892 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d0a13120-3dc1-449d-ae22-4d1ff4ffea98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:23.760397 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93523cde-b662-40bf-af1a-6c4629a4307b req-70748188-dd8c-4eb6-a4fe-02f90740b696 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:23.761936 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-93523cde-b662-40bf-af1a-6c4629a4307b req-70748188-dd8c-4eb6-a4fe-02f90740b696 service neutron] 10.222.0.31 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 913 time: 0.1209605 Dec 09 21:36:23.819684 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0cbb1260-61c8-4855-b217-085b9d1bbf01 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:36:23.908314 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0a13120-3dc1-449d-ae22-4d1ff4ffea98 None None] Pushing event updated for resources: {'Port': ['ID=00259158-6c71-4dd2-99a3-40829e1a80bb,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:23.941807 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 0cbb1260-61c8-4855-b217-085b9d1bbf01 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:23.944826 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:23.977653 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5af7fd14-c6ba-404e-b95c-360e3cd99396 req-3a7c343f-ceae-48cc-a81b-6d03860093a7 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:23.984605 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5af7fd14-c6ba-404e-b95c-360e3cd99396 req-3a7c343f-ceae-48cc-a81b-6d03860093a7 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.31 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 946 time: 0.1659100 Dec 09 21:36:24.065058 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:24.125066 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 0cbb1260-61c8-4855-b217-085b9d1bbf01, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=0cbb1260-61c8-4855-b217-085b9d1bbf01,segment=NetworkSegment(5312a65b-2088-4471-aaff-ce07fbe1d1a1),segment_id=5312a65b-2088-4471-aaff-ce07fbe1d1a1)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:24.172448 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:24.174626 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 18683261-1ff4-4746-ade2-fc2e188298b7 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:36:24.184290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d10df5a-cb04-4413-aced-d38e660557dd req-61ab269d-0e47-4188-b339-992c2c2174d3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:24.186242 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6d10df5a-cb04-4413-aced-d38e660557dd req-61ab269d-0e47-4188-b339-992c2c2174d3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.10 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 812 time: 0.2992055 Dec 09 21:36:24.218323 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-6d10df5a-cb04-4413-aced-d38e660557dd req-17191962-938d-4f26-8e95-001950e4f560 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Request body: {'port': {'device_id': 'cbee2951-c573-41f4-8f85-c7c77ec3d8d6', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'admin_state_up': True, 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:24.309439 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6fae1b63-14b1-4c36-a099-b327e4827f19 req-3a5719a8-9f62-4d35-b6b8-7a3006539970 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=ae1d5335-d417-46c6-9564-e81ad355759f&id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.6695962 Dec 09 21:36:24.349018 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c2db088-b17b-47c9-ae0d-4d977c0627e0 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:24.356568 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b7fbfe06-a9f6-4af8-963e-e206de4b5646 None None] Network 832a7450-f598-4d98-8dc0-070aca3694e2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:24.363780 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f755a762-7f6c-4e22-a3d8-deb17bd7d6d6 req-b25ee7f9-6a42-4372-a4fc-981ee003a50d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:24.367428 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-93523cde-b662-40bf-af1a-6c4629a4307b req-5c34ffa0-2ade-4e6b-b14d-49b6c69117a5 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=90f16e74-f2e6-416e-a079-f205615a0d8e HTTP/1.1" status: 200 len: 1000 time: 0.5961468 Dec 09 21:36:24.371478 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f755a762-7f6c-4e22-a3d8-deb17bd7d6d6 req-b25ee7f9-6a42-4372-a4fc-981ee003a50d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 946 time: 0.1535063 Dec 09 21:36:24.388762 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=0cbb1260-61c8-4855-b217-085b9d1bbf01,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:24.417466 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-5af7fd14-c6ba-404e-b95c-360e3cd99396 req-0ff60592-c306-4e26-a938-d7df27339394 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Deleting port 851ff09f-496e-47bd-85bb-2e21622a44e9 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:36:24.417798 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5af7fd14-c6ba-404e-b95c-360e3cd99396 req-0ff60592-c306-4e26-a938-d7df27339394 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:24.471304 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f755a762-7f6c-4e22-a3d8-deb17bd7d6d6 req-f2be5c3a-5351-48dc-87fc-c8e95873f359 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups?id=60d89c09-154d-4fe2-b016-511afe2ed923&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0988226 Dec 09 21:36:24.533429 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-58529d5c-1d98-4e43-b600-c0545171fbd9 None None] Provisioning complete for port 0cbb1260-61c8-4855-b217-085b9d1bbf01 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:24.533858 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-58529d5c-1d98-4e43-b600-c0545171fbd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:24.540454 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6c2db088-b17b-47c9-ae0d-4d977c0627e0 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Network 832a7450-f598-4d98-8dc0-070aca3694e2 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:36:24.548539 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-6c2db088-b17b-47c9-ae0d-4d977c0627e0 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:24.561137 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c2db088-b17b-47c9-ae0d-4d977c0627e0 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:36:24.561698 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c2db088-b17b-47c9-ae0d-4d977c0627e0 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:24.572091 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93523cde-b662-40bf-af1a-6c4629a4307b req-62996c78-4506-4afa-be88-fd684849f80c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:24.573710 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-93523cde-b662-40bf-af1a-6c4629a4307b req-62996c78-4506-4afa-be88-fd684849f80c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 200 len: 851 time: 0.1431186 Dec 09 21:36:24.575077 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd10bd1c-b9ee-4b35-b1d5-48ea06eaa4c4 req-c5a30ed8-48e3-426a-b2dc-d9fe00596125 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 210 time: 0.0833268 Dec 09 21:36:24.617555 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-5af7fd14-c6ba-404e-b95c-360e3cd99396 req-0ff60592-c306-4e26-a938-d7df27339394 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] For port 851ff09f-496e-47bd-85bb-2e21622a44e9, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=851ff09f-496e-47bd-85bb-2e21622a44e9,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:24.618314 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5af7fd14-c6ba-404e-b95c-360e3cd99396 req-0ff60592-c306-4e26-a938-d7df27339394 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:24.627998 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c2db088-b17b-47c9-ae0d-4d977c0627e0 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event updated for resources: {'Port': ['ID=74608280-c47c-4b51-b0b7-02d0a0cb8fd9,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:24.657870 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 18683261-1ff4-4746-ade2-fc2e188298b7 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:24.658508 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:24.743416 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93523cde-b662-40bf-af1a-6c4629a4307b req-430a091d-dd79-49b2-be7b-bce347f5f692 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:24.745080 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-93523cde-b662-40bf-af1a-6c4629a4307b req-430a091d-dd79-49b2-be7b-bce347f5f692 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1283326 Dec 09 21:36:24.747055 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6d10df5a-cb04-4413-aced-d38e660557dd req-17191962-938d-4f26-8e95-001950e4f560 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Made reservation on behalf of a36a93590a9f45e1b9b3f78753bb8e12 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:36:24.752356 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6d10df5a-cb04-4413-aced-d38e660557dd req-17191962-938d-4f26-8e95-001950e4f560 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:24.894004 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5af7fd14-c6ba-404e-b95c-360e3cd99396 req-0ff60592-c306-4e26-a938-d7df27339394 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:24.894759 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5af7fd14-c6ba-404e-b95c-360e3cd99396 req-0ff60592-c306-4e26-a938-d7df27339394 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:24.895248 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [req-5af7fd14-c6ba-404e-b95c-360e3cd99396 req-0ff60592-c306-4e26-a938-d7df27339394 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Floating IP 71dddf51-6f7c-44b1-bcba-7f63f5b97a35 disassociated. External IP: 172.25.3.162, port: 851ff09f-496e-47bd-85bb-2e21622a44e9. Dec 09 21:36:24.896741 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-5af7fd14-c6ba-404e-b95c-360e3cd99396 req-0ff60592-c306-4e26-a938-d7df27339394 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Calling delete_port for 851ff09f-496e-47bd-85bb-2e21622a44e9 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:36:24.938174 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c2db088-b17b-47c9-ae0d-4d977c0627e0 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:25.146356 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5af7fd14-c6ba-404e-b95c-360e3cd99396 req-0ff60592-c306-4e26-a938-d7df27339394 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:25.208882 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ff60592-c306-4e26-a938-d7df27339394 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Pushing event deleted for resources: {'Port': ['ID=851ff09f-496e-47bd-85bb-2e21622a44e9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:25.346789 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-93523cde-b662-40bf-af1a-6c4629a4307b req-be484cc3-95eb-4061-adfd-8d5a1c48685e service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5882115 Dec 09 21:36:25.353510 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-536b5bb1-83f7-49f5-9641-7377b0a4c207 None None] Provisioning complete for port 74608280-c47c-4b51-b0b7-02d0a0cb8fd9 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:25.354177 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-536b5bb1-83f7-49f5-9641-7377b0a4c207 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:25.392976 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [req-5af7fd14-c6ba-404e-b95c-360e3cd99396 req-0ff60592-c306-4e26-a938-d7df27339394 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Router 8f39d25d-26dd-4bce-b961-53cba1551e5d has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:36:25.428376 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-536b5bb1-83f7-49f5-9641-7377b0a4c207 None None] Port 74608280-c47c-4b51-b0b7-02d0a0cb8fd9 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:36:25.447000 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-536b5bb1-83f7-49f5-9641-7377b0a4c207 None None] Provisioning complete for port 0cbb1260-61c8-4855-b217-085b9d1bbf01 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:25.447670 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-536b5bb1-83f7-49f5-9641-7377b0a4c207 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:25.469525 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c2db088-b17b-47c9-ae0d-4d977c0627e0 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:25.495655 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c2db088-b17b-47c9-ae0d-4d977c0627e0 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:25.496495 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c2db088-b17b-47c9-ae0d-4d977c0627e0 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:25.523104 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-62e9c0ba-090e-444d-a9b9-717e96565bae None None] Network 60615649-0a44-41cc-96b0-9d95f10619d0 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:25.732238 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38c324b0-58c9-43a9-9cdf-5399442b69cf req-c38f336d-556d-4561-8637-784001a3c622 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/ports?device_id=91b064ae-1ca1-44d4-a549-a25cccd0c81b HTTP/1.1" status: 200 len: 210 time: 0.0326188 Dec 09 21:36:25.737372 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-5af7fd14-c6ba-404e-b95c-360e3cd99396 req-0ff60592-c306-4e26-a938-d7df27339394 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:36:25.749752 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-208ec7db-f962-49e5-8069-8c0370f875d8 None None] Sync routers for ids ['8f39d25d-26dd-4bce-b961-53cba1551e5d'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:36:25.763677 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-6d10df5a-cb04-4413-aced-d38e660557dd req-17191962-938d-4f26-8e95-001950e4f560 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Allocated IP 172.20.0.14 (2c03082f-742a-4ae3-9d23-6178c7ff2a0a/d776263b-6b97-44cc-bef5-299b9262dfec/028345f8-c21b-4afa-a015-34707fd8ba09) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:36:25.774461 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c2db088-b17b-47c9-ae0d-4d977c0627e0 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event updated for resources: {'Port': ['ID=74608280-c47c-4b51-b0b7-02d0a0cb8fd9,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:25.775844 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-208ec7db-f962-49e5-8069-8c0370f875d8 None None] Routers {'8f39d25d-26dd-4bce-b961-53cba1551e5d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:36:25.778572 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-208ec7db-f962-49e5-8069-8c0370f875d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:36:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['8f39d25d-26dd-4bce-b961-53cba1551e5d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:25.828401 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-5af7fd14-c6ba-404e-b95c-360e3cd99396 req-0ff60592-c306-4e26-a938-d7df27339394 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] No DVR routers for this DVR port 851ff09f-496e-47bd-85bb-2e21622a44e9 on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:36:25.866090 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-93523cde-b662-40bf-af1a-6c4629a4307b req-e54f49ab-0bb4-49b5-b153-2569b79eecb6 service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4787686 Dec 09 21:36:25.886772 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eee296ef-5d56-4765-b11a-b2749b8cb000 req-e081dca1-0da0-4ee3-97d5-1af692ecd8b1 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 210 time: 0.0896046 Dec 09 21:36:25.890351 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5af7fd14-c6ba-404e-b95c-360e3cd99396 req-0ff60592-c306-4e26-a938-d7df27339394 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:25.894740 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5af7fd14-c6ba-404e-b95c-360e3cd99396 req-0ff60592-c306-4e26-a938-d7df27339394 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.31 "DELETE /v2.0/ports/851ff09f-496e-47bd-85bb-2e21622a44e9 HTTP/1.1" status: 204 len: 173 time: 1.9028163 Dec 09 21:36:25.901114 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '91b064ae-1ca1-44d4-a549-a25cccd0c81b', 'name': 'network-vif-deleted', 'tag': '851ff09f-496e-47bd-85bb-2e21622a44e9'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:36:25.909502 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ea541872-237a-483f-a518-74aa3b833054" -d '{"events": [{"server_uuid": "91b064ae-1ca1-44d4-a549-a25cccd0c81b", "name": "network-vif-deleted", "tag": "851ff09f-496e-47bd-85bb-2e21622a44e9"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:36:25.967394 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52658) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:25.998605 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0cbb1260-61c8-4855-b217-085b9d1bbf01 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:36:26.010052 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6c2db088-b17b-47c9-ae0d-4d977c0627e0 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Network 832a7450-f598-4d98-8dc0-070aca3694e2 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:36:26.013598 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:36:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c4baed48-f324-439e-acdd-7e9b13ae1ee4 x-openstack-request-id: req-c4baed48-f324-439e-acdd-7e9b13ae1ee4 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:36:26.014911 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "91b064ae-1ca1-44d4-a549-a25cccd0c81b", "name": "network-vif-deleted", "tag": "851ff09f-496e-47bd-85bb-2e21622a44e9", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:36:26.017162 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c4baed48-f324-439e-acdd-7e9b13ae1ee4 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:36:26.018153 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '91b064ae-1ca1-44d4-a549-a25cccd0c81b', 'name': 'network-vif-deleted', 'tag': '851ff09f-496e-47bd-85bb-2e21622a44e9', 'status': 'completed', 'code': 200} Dec 09 21:36:26.020365 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-6c2db088-b17b-47c9-ae0d-4d977c0627e0 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:26.164323 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 0cbb1260-61c8-4855-b217-085b9d1bbf01 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:26.165103 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:26.168851 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-208ec7db-f962-49e5-8069-8c0370f875d8 None None] Set router 8f39d25d-26dd-4bce-b961-53cba1551e5d gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:36:26.219291 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cb0d6d21-1a70-40d9-9bbd-9381f45ddd32 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:26.349820 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 00259158-6c71-4dd2-99a3-40829e1a80bb up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:36:26.358945 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-02bb14bc-ce1c-47b9-8f27-f9cb2ad4ad2b None None] Provisioning complete for port 74608280-c47c-4b51-b0b7-02d0a0cb8fd9 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:26.359704 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-02bb14bc-ce1c-47b9-8f27-f9cb2ad4ad2b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:26.420228 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cb0d6d21-1a70-40d9-9bbd-9381f45ddd32 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:26.429749 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cb0d6d21-1a70-40d9-9bbd-9381f45ddd32 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:26.491789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-02bb14bc-ce1c-47b9-8f27-f9cb2ad4ad2b None None] Port 74608280-c47c-4b51-b0b7-02d0a0cb8fd9 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:36:26.514300 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-02bb14bc-ce1c-47b9-8f27-f9cb2ad4ad2b None None] Provisioning complete for port 00259158-6c71-4dd2-99a3-40829e1a80bb triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:26.515131 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-02bb14bc-ce1c-47b9-8f27-f9cb2ad4ad2b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:26.518789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 00259158-6c71-4dd2-99a3-40829e1a80bb triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:26.519496 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:26.524567 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-208ec7db-f962-49e5-8069-8c0370f875d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'name': 'tempest-AttachVolumeShelveTestJSON-236206179-router', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203'}], 'enable_snat': True}, 'gw_port_id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:14Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'gw_port': {'id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:4c:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1175, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:15Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'a9a5d2ec-b408-4729-99d3-0e4f8f041e60', 'name': '', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'mac_address': 'fa:16:3e:40:0d:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1178, 'fixed_ips': [{'subnet_id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:19Z', 'updated_at': '2021-12-09T21:28:25Z', 'revision_number': 5, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'subnets': [{'id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:26.561344 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-208ec7db-f962-49e5-8069-8c0370f875d8 None None] Checking router: 8f39d25d-26dd-4bce-b961-53cba1551e5d for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:36:26.563941 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cb0d6d21-1a70-40d9-9bbd-9381f45ddd32 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=59b445a674cc48909041dc816d4739d8&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5951419 Dec 09 21:36:26.570951 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb0d6d21-1a70-40d9-9bbd-9381f45ddd32 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9474aea6-1886-4035-8f1d-e8acada89935,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:26.576302 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52664) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:26.578602 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-208ec7db-f962-49e5-8069-8c0370f875d8 None None] Routers {'8f39d25d-26dd-4bce-b961-53cba1551e5d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:36:26.579228 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-208ec7db-f962-49e5-8069-8c0370f875d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:36:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['8f39d25d-26dd-4bce-b961-53cba1551e5d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:26.641338 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-75a953a8-8000-4c70-804e-68a93e9ab3ea admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:26.674760 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-75a953a8-8000-4c70-804e-68a93e9ab3ea admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:26.713697 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:26.716102 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-02bb14bc-ce1c-47b9-8f27-f9cb2ad4ad2b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:26.737038 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-208ec7db-f962-49e5-8069-8c0370f875d8 None None] Set router 8f39d25d-26dd-4bce-b961-53cba1551e5d gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:36:26.739722 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-75a953a8-8000-4c70-804e-68a93e9ab3ea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:26.744679 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-75a953a8-8000-4c70-804e-68a93e9ab3ea admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:26.756596 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6d10df5a-cb04-4413-aced-d38e660557dd req-17191962-938d-4f26-8e95-001950e4f560 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:26.762933 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-75a953a8-8000-4c70-804e-68a93e9ab3ea admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/9474aea6-1886-4035-8f1d-e8acada89935 HTTP/1.1" status: 204 len: 168 time: 0.1748886 Dec 09 21:36:26.787363 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-02bb14bc-ce1c-47b9-8f27-f9cb2ad4ad2b None None] For port 00259158-6c71-4dd2-99a3-40829e1a80bb, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=00259158-6c71-4dd2-99a3-40829e1a80bb,segment=NetworkSegment(78d96733-0720-44d5-97bf-be03bbf3ee99),segment_id=78d96733-0720-44d5-97bf-be03bbf3ee99)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:26.787696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75a953a8-8000-4c70-804e-68a93e9ab3ea admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9474aea6-1886-4035-8f1d-e8acada89935,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:26.803485 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-02bb14bc-ce1c-47b9-8f27-f9cb2ad4ad2b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:26.825086 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6c2db088-b17b-47c9-ae0d-4d977c0627e0 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Router 3e8195d6-e93d-4782-b590-1c86852aa5e6 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:36:26.882135 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52672) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:26.953224 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:36:26.953494 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:36:26.970549 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02bb14bc-ce1c-47b9-8f27-f9cb2ad4ad2b None None] Pushing event updated for resources: {'Port': ['ID=00259158-6c71-4dd2-99a3-40829e1a80bb,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:26.979859 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5528aebe-ebfb-4eb0-9148-f2b6e14dc0af None None] Provisioning complete for port 74608280-c47c-4b51-b0b7-02d0a0cb8fd9 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:26.980321 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5528aebe-ebfb-4eb0-9148-f2b6e14dc0af None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:26.995013 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6c2db088-b17b-47c9-ae0d-4d977c0627e0 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:36:27.003981 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6c2db088-b17b-47c9-ae0d-4d977c0627e0 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "PUT /v2.0/routers/3e8195d6-e93d-4782-b590-1c86852aa5e6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.1176805 Dec 09 21:36:27.008354 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3dda4c1b-5716-431f-8952-7e3d96857e2b tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:27.010204 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52678) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:27.030377 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8bc86942-8b21-434e-a9c7-38a6a6759350 None None] Sync routers for ids ['3e8195d6-e93d-4782-b590-1c86852aa5e6'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:36:27.064020 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6d10df5a-cb04-4413-aced-d38e660557dd req-17191962-938d-4f26-8e95-001950e4f560 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:27.082664 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-208ec7db-f962-49e5-8069-8c0370f875d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'name': 'tempest-AttachVolumeShelveTestJSON-236206179-router', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203'}], 'enable_snat': True}, 'gw_port_id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:14Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'gw_port': {'id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:4c:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1175, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:15Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'a9a5d2ec-b408-4729-99d3-0e4f8f041e60', 'name': '', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'mac_address': 'fa:16:3e:40:0d:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1178, 'fixed_ips': [{'subnet_id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:19Z', 'updated_at': '2021-12-09T21:28:25Z', 'revision_number': 5, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'subnets': [{'id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:27.086394 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3dda4c1b-5716-431f-8952-7e3d96857e2b tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:27.098513 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['ae3b2bf8-8e63-4473-8cc8-206c769cc38a'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:36:27.101786 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['d5571683-a9bc-4155-85b9-b1ef208e21e9'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:36:27.130650 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-208ec7db-f962-49e5-8069-8c0370f875d8 None None] The sync data for ids ['8f39d25d-26dd-4bce-b961-53cba1551e5d'] in n-d-713301-27 is: [{'id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'name': 'tempest-AttachVolumeShelveTestJSON-236206179-router', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203'}], 'enable_snat': True}, 'gw_port_id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:14Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'gw_port': {'id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:4c:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1175, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:15Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'a9a5d2ec-b408-4729-99d3-0e4f8f041e60', 'name': '', 'network_id': 'e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'mac_address': 'fa:16:3e:40:0d:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_interface', 'standard_attr_id': 1178, 'fixed_ips': [{'subnet_id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:19Z', 'updated_at': '2021-12-09T21:28:25Z', 'revision_number': 5, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'subnets': [{'id': 'ace82e8b-012a-4184-a81e-5303eecf12ff', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:36:27.134773 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-981ba42c-289c-4129-a0aa-ba0d90913069 req-63d2b165-14d5-4bba-9a7b-4e904caea084 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:27.137969 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-981ba42c-289c-4129-a0aa-ba0d90913069 req-63d2b165-14d5-4bba-9a7b-4e904caea084 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 932 time: 0.1168244 Dec 09 21:36:27.175860 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8bc86942-8b21-434e-a9c7-38a6a6759350 None None] Routers {'3e8195d6-e93d-4782-b590-1c86852aa5e6'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:36:27.176863 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-8bc86942-8b21-434e-a9c7-38a6a6759350 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:36:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3e8195d6-e93d-4782-b590-1c86852aa5e6'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:27.178864 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-5528aebe-ebfb-4eb0-9148-f2b6e14dc0af None None] Port 74608280-c47c-4b51-b0b7-02d0a0cb8fd9 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:36:27.200326 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6d10df5a-cb04-4413-aced-d38e660557dd req-17191962-938d-4f26-8e95-001950e4f560 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:36:27.203979 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17191962-938d-4f26-8e95-001950e4f560 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Pushing event updated for resources: {'Port': ['ID=028345f8-c21b-4afa-a015-34707fd8ba09,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:27.216186 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-6d10df5a-cb04-4413-aced-d38e660557dd req-17191962-938d-4f26-8e95-001950e4f560 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:27.218903 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-6d10df5a-cb04-4413-aced-d38e660557dd req-17191962-938d-4f26-8e95-001950e4f560 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:36:27.246394 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-981ba42c-289c-4129-a0aa-ba0d90913069 req-77fc2cd5-5627-48aa-abf9-1688b6d717d2 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0954959 Dec 09 21:36:27.247962 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3dda4c1b-5716-431f-8952-7e3d96857e2b tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:27.251160 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3dda4c1b-5716-431f-8952-7e3d96857e2b tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:27.252968 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3dda4c1b-5716-431f-8952-7e3d96857e2b tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "DELETE /v2.0/security-groups/60d89c09-154d-4fe2-b016-511afe2ed923 HTTP/1.1" status: 204 len: 168 time: 0.3694084 Dec 09 21:36:27.271538 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52680) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:27.273119 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dda4c1b-5716-431f-8952-7e3d96857e2b tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=60d89c09-154d-4fe2-b016-511afe2ed923,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:27.290970 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-e5121782-78a5-4afc-abcc-5115d128104d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] show failed (client error): The resource could not be found. Dec 09 21:36:27.292126 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e5121782-78a5-4afc-abcc-5115d128104d tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "GET /v2.0/security-groups/60d89c09-154d-4fe2-b016-511afe2ed923 HTTP/1.1" status: 404 len: 347 time: 0.0164795 Dec 09 21:36:27.295144 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52682) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:27.295881 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-8bc86942-8b21-434e-a9c7-38a6a6759350 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:27.307657 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52684) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:27.383360 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:27.384228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5528aebe-ebfb-4eb0-9148-f2b6e14dc0af None None] Provisioning complete for port 00259158-6c71-4dd2-99a3-40829e1a80bb triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:27.384474 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5528aebe-ebfb-4eb0-9148-f2b6e14dc0af None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:27.385285 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-93372d61-445c-49d2-b8d2-aef0d1dc416d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:27.386820 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:27.399422 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8bc86942-8b21-434e-a9c7-38a6a6759350 None None] Routers {'3e8195d6-e93d-4782-b590-1c86852aa5e6'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:36:27.400159 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-8bc86942-8b21-434e-a9c7-38a6a6759350 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:36:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3e8195d6-e93d-4782-b590-1c86852aa5e6'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:27.507597 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-8bc86942-8b21-434e-a9c7-38a6a6759350 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:27.509021 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8bc86942-8b21-434e-a9c7-38a6a6759350 None None] The sync data for ids ['3e8195d6-e93d-4782-b590-1c86852aa5e6'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:36:27.522571 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d10df5a-cb04-4413-aced-d38e660557dd req-17191962-938d-4f26-8e95-001950e4f560 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:27.523246 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6d10df5a-cb04-4413-aced-d38e660557dd req-17191962-938d-4f26-8e95-001950e4f560 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:27.563064 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6d10df5a-cb04-4413-aced-d38e660557dd req-17191962-938d-4f26-8e95-001950e4f560 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.3516061 Dec 09 21:36:27.573752 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-b89d8591-efae-4890-ab0e-7d276e5e2031 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Deleting port e6cda36f-6dd0-48a9-8759-4b3ebbb1847f {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:36:27.574308 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b89d8591-efae-4890-ab0e-7d276e5e2031 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:27.598334 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-6d10df5a-cb04-4413-aced-d38e660557dd req-2dd44ab7-03bc-4282-ba52-5de7e0c3145f service neutron] Request body: {'port': {'device_id': 'cbee2951-c573-41f4-8f85-c7c77ec3d8d6', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:27.654323 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00b08225-13f3-4bfb-986c-6b675db2beaf None None] New status for floating IP 71dddf51-6f7c-44b1-bcba-7f63f5b97a35: DOWN {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:36:27.693255 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6d10df5a-cb04-4413-aced-d38e660557dd req-2dd44ab7-03bc-4282-ba52-5de7e0c3145f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:27.732282 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-93372d61-445c-49d2-b8d2-aef0d1dc416d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:27.734367 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b89d8591-efae-4890-ab0e-7d276e5e2031 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:27.734701 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b89d8591-efae-4890-ab0e-7d276e5e2031 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:27.744357 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-93372d61-445c-49d2-b8d2-aef0d1dc416d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:27.784962 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93372d61-445c-49d2-b8d2-aef0d1dc416d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f1e5bb90-3507-4a91-b323-b364a4a3a705,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:27.799164 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 00259158-6c71-4dd2-99a3-40829e1a80bb up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:36:27.800875 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-b89d8591-efae-4890-ab0e-7d276e5e2031 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Calling delete_port for e6cda36f-6dd0-48a9-8759-4b3ebbb1847f owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:36:27.824943 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-d27c2f08-e010-47b0-a274-6f0e8a5c52a8 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] add_router_interface failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:36:27.826031 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d27c2f08-e010-47b0-a274-6f0e8a5c52a8 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "PUT /v2.0/routers/3e8195d6-e93d-4782-b590-1c86852aa5e6/add_router_interface HTTP/1.1" status: 400 len: 438 time: 0.8147933 Dec 09 21:36:27.832758 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52688) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:27.845162 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-93372d61-445c-49d2-b8d2-aef0d1dc416d admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=92c7df1a868344fcb603e077c895afcb&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5328496 Dec 09 21:36:27.846055 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52690) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:27.946417 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-59064bdb-a600-4ac5-8df4-77092b5edf95 None None] Provisioning complete for port 028345f8-c21b-4afa-a015-34707fd8ba09 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:27.946913 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-59064bdb-a600-4ac5-8df4-77092b5edf95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:27.951948 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 851ff09f-496e-47bd-85bb-2e21622a44e9 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:36:27.958921 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1502806b-4a75-46ee-af53-de1aa3a88aad admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:27.992046 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1502806b-4a75-46ee-af53-de1aa3a88aad admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:28.000381 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 851ff09f-496e-47bd-85bb-2e21622a44e9 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:36:28.000736 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 851ff09f-496e-47bd-85bb-2e21622a44e9 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:36:28.014794 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 00259158-6c71-4dd2-99a3-40829e1a80bb triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:28.015161 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:28.037286 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-59064bdb-a600-4ac5-8df4-77092b5edf95 None None] Port 028345f8-c21b-4afa-a015-34707fd8ba09 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:36:28.076027 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b89d8591-efae-4890-ab0e-7d276e5e2031 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:28.284155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-6d10df5a-cb04-4413-aced-d38e660557dd req-2dd44ab7-03bc-4282-ba52-5de7e0c3145f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 028345f8-c21b-4afa-a015-34707fd8ba09 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:36:28.293547 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6d10df5a-cb04-4413-aced-d38e660557dd req-2dd44ab7-03bc-4282-ba52-5de7e0c3145f service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:28.367131 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58df749d-1a1d-454b-ba4c-7f9035417c5c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:28.390686 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b89d8591-efae-4890-ab0e-7d276e5e2031 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Pushing event deleted for resources: {'Port': ['ID=e6cda36f-6dd0-48a9-8759-4b3ebbb1847f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:28.406102 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-6d10df5a-cb04-4413-aced-d38e660557dd req-2dd44ab7-03bc-4282-ba52-5de7e0c3145f service neutron] Transition to ACTIVE for port object 028345f8-c21b-4afa-a015-34707fd8ba09 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:36:28.407134 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1502806b-4a75-46ee-af53-de1aa3a88aad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:28.409722 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1502806b-4a75-46ee-af53-de1aa3a88aad admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:28.410857 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1502806b-4a75-46ee-af53-de1aa3a88aad admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/f1e5bb90-3507-4a91-b323-b364a4a3a705 HTTP/1.1" status: 204 len: 168 time: 0.5623775 Dec 09 21:36:28.438337 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1502806b-4a75-46ee-af53-de1aa3a88aad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f1e5bb90-3507-4a91-b323-b364a4a3a705,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:28.441387 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6d10df5a-cb04-4413-aced-d38e660557dd req-2dd44ab7-03bc-4282-ba52-5de7e0c3145f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:28.497717 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24a7a277-0847-4ac6-aea2-4efba0470623 req-8b0b64aa-c4b8-484d-8772-8fffa4cc7663 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:28.499326 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-24a7a277-0847-4ac6-aea2-4efba0470623 req-8b0b64aa-c4b8-484d-8772-8fffa4cc7663 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 932 time: 0.1128619 Dec 09 21:36:28.518954 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b89d8591-efae-4890-ab0e-7d276e5e2031 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:28.521673 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b89d8591-efae-4890-ab0e-7d276e5e2031 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:28.523057 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b89d8591-efae-4890-ab0e-7d276e5e2031 tempest-AttachVolumeShelveTestJSON-1193154378 tempest-AttachVolumeShelveTestJSON-1193154378-project] 10.222.0.13 "DELETE /v2.0/floatingips/71dddf51-6f7c-44b1-bcba-7f63f5b97a35 HTTP/1.1" status: 204 len: 168 time: 1.2268291 Dec 09 21:36:28.604751 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-24a7a277-0847-4ac6-aea2-4efba0470623 req-54cb8483-f5b9-401a-9016-b9777efbe4a2 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0891695 Dec 09 21:36:28.655594 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dd44ab7-03bc-4282-ba52-5de7e0c3145f service neutron] Pushing event updated for resources: {'Port': ['ID=028345f8-c21b-4afa-a015-34707fd8ba09,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:28.762204 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-6d10df5a-cb04-4413-aced-d38e660557dd req-2dd44ab7-03bc-4282-ba52-5de7e0c3145f service neutron] Attempting to bind port 028345f8-c21b-4afa-a015-34707fd8ba09 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:36:28.762555 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-6d10df5a-cb04-4413-aced-d38e660557dd req-2dd44ab7-03bc-4282-ba52-5de7e0c3145f service neutron] Attempting to bind port 028345f8-c21b-4afa-a015-34707fd8ba09 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:36:28.762966 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6d10df5a-cb04-4413-aced-d38e660557dd req-2dd44ab7-03bc-4282-ba52-5de7e0c3145f service neutron] Attempting to bind port 028345f8-c21b-4afa-a015-34707fd8ba09 on network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:36:28.768614 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6d10df5a-cb04-4413-aced-d38e660557dd req-2dd44ab7-03bc-4282-ba52-5de7e0c3145f service neutron] Port 028345f8-c21b-4afa-a015-34707fd8ba09 on network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:36:28.768945 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6d10df5a-cb04-4413-aced-d38e660557dd req-2dd44ab7-03bc-4282-ba52-5de7e0c3145f service neutron] Attempting to bind port 028345f8-c21b-4afa-a015-34707fd8ba09 on network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:36:28.805158 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6d10df5a-cb04-4413-aced-d38e660557dd req-2dd44ab7-03bc-4282-ba52-5de7e0c3145f service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 36, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:36:28.805514 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6d10df5a-cb04-4413-aced-d38e660557dd req-2dd44ab7-03bc-4282-ba52-5de7e0c3145f service neutron] Checking segment: {'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:36:28.805906 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6d10df5a-cb04-4413-aced-d38e660557dd req-2dd44ab7-03bc-4282-ba52-5de7e0c3145f service neutron] Bound using segment: {'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:36:28.806587 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-6d10df5a-cb04-4413-aced-d38e660557dd req-2dd44ab7-03bc-4282-ba52-5de7e0c3145f service neutron] Bound port: 028345f8-c21b-4afa-a015-34707fd8ba09, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:36:28.806953 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6d10df5a-cb04-4413-aced-d38e660557dd req-2dd44ab7-03bc-4282-ba52-5de7e0c3145f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:28.911852 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-6d10df5a-cb04-4413-aced-d38e660557dd req-2dd44ab7-03bc-4282-ba52-5de7e0c3145f service neutron] For port 028345f8-c21b-4afa-a015-34707fd8ba09, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:36:28.933836 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-6d10df5a-cb04-4413-aced-d38e660557dd req-2dd44ab7-03bc-4282-ba52-5de7e0c3145f service neutron] For port 028345f8-c21b-4afa-a015-34707fd8ba09, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=028345f8-c21b-4afa-a015-34707fd8ba09,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:36:28.937157 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-58df749d-1a1d-454b-ba4c-7f9035417c5c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Deleting port 74608280-c47c-4b51-b0b7-02d0a0cb8fd9 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:36:28.937502 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58df749d-1a1d-454b-ba4c-7f9035417c5c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:28.942953 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6d10df5a-cb04-4413-aced-d38e660557dd req-2dd44ab7-03bc-4282-ba52-5de7e0c3145f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:28.959264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52704) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:28.975359 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fe090cc4-b308-4dc5-95ed-0b1bdb3a6743 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:29.038566 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d10df5a-cb04-4413-aced-d38e660557dd req-2dd44ab7-03bc-4282-ba52-5de7e0c3145f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:29.039225 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6d10df5a-cb04-4413-aced-d38e660557dd req-2dd44ab7-03bc-4282-ba52-5de7e0c3145f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:29.040858 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6d10df5a-cb04-4413-aced-d38e660557dd req-2dd44ab7-03bc-4282-ba52-5de7e0c3145f service neutron] 10.222.0.10 "PUT /v2.0/ports/028345f8-c21b-4afa-a015-34707fd8ba09 HTTP/1.1" status: 200 len: 1093 time: 1.4493406 Dec 09 21:36:29.043107 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cbee2951-c573-41f4-8f85-c7c77ec3d8d6', 'tag': '028345f8-c21b-4afa-a015-34707fd8ba09'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:36:29.045544 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c6afcbd4-740a-474b-b46c-9fcbecc13f1d" -d '{"events": [{"name": "network-changed", "server_uuid": "cbee2951-c573-41f4-8f85-c7c77ec3d8d6", "tag": "028345f8-c21b-4afa-a015-34707fd8ba09"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:36:29.095038 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dd44ab7-03bc-4282-ba52-5de7e0c3145f service neutron] Pushing event updated for resources: {'Port': ['ID=028345f8-c21b-4afa-a015-34707fd8ba09,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:29.105253 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fe090cc4-b308-4dc5-95ed-0b1bdb3a6743 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:29.110701 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fe090cc4-b308-4dc5-95ed-0b1bdb3a6743 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:29.118012 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:36:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a04547b1-d48d-4bf8-9ab9-6af18260688d x-openstack-request-id: req-a04547b1-d48d-4bf8-9ab9-6af18260688d {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:36:29.118605 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cbee2951-c573-41f4-8f85-c7c77ec3d8d6", "tag": "028345f8-c21b-4afa-a015-34707fd8ba09", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:36:29.119149 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a04547b1-d48d-4bf8-9ab9-6af18260688d {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:36:29.119918 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cbee2951-c573-41f4-8f85-c7c77ec3d8d6', 'tag': '028345f8-c21b-4afa-a015-34707fd8ba09', 'status': 'completed', 'code': 200} Dec 09 21:36:29.126999 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58df749d-1a1d-454b-ba4c-7f9035417c5c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:29.148313 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-58df749d-1a1d-454b-ba4c-7f9035417c5c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Calling delete_port for 74608280-c47c-4b51-b0b7-02d0a0cb8fd9 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:36:29.154398 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fe090cc4-b308-4dc5-95ed-0b1bdb3a6743 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=2238425799f146ccbc4486da0373ffc9&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1917162 Dec 09 21:36:29.154398 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe090cc4-b308-4dc5-95ed-0b1bdb3a6743 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ece687c7-0ffe-4a80-90e3-259ce3cefad0,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:29.155309 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52708) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:29.211558 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-35c274f2-1da0-4ac1-8775-e508aa0cba9d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:29.236708 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-35c274f2-1da0-4ac1-8775-e508aa0cba9d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:29.296279 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-35c274f2-1da0-4ac1-8775-e508aa0cba9d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:29.301551 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-35c274f2-1da0-4ac1-8775-e508aa0cba9d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:29.305237 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-35c274f2-1da0-4ac1-8775-e508aa0cba9d admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/ece687c7-0ffe-4a80-90e3-259ce3cefad0 HTTP/1.1" status: 204 len: 168 time: 0.1465409 Dec 09 21:36:29.326084 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35c274f2-1da0-4ac1-8775-e508aa0cba9d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ece687c7-0ffe-4a80-90e3-259ce3cefad0,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:29.365856 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d10df5a-cb04-4413-aced-d38e660557dd req-b507a643-9516-45f8-b087-fc3129bd515c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:29.367634 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6d10df5a-cb04-4413-aced-d38e660557dd req-b507a643-9516-45f8-b087-fc3129bd515c service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 1096 time: 0.2581217 Dec 09 21:36:29.417372 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6d10df5a-cb04-4413-aced-d38e660557dd req-1d2fbea1-8be7-46f9-a59e-b8d153e88e2c service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=028345f8-c21b-4afa-a015-34707fd8ba09 HTTP/1.1" status: 200 len: 217 time: 0.0407276 Dec 09 21:36:29.516069 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d10df5a-cb04-4413-aced-d38e660557dd req-8f3e192d-dbb4-4dc4-8fbb-5f023c9da705 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:29.517690 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6d10df5a-cb04-4413-aced-d38e660557dd req-8f3e192d-dbb4-4dc4-8fbb-5f023c9da705 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 200 len: 851 time: 0.0939267 Dec 09 21:36:29.523829 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58df749d-1a1d-454b-ba4c-7f9035417c5c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:29.604123 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58df749d-1a1d-454b-ba4c-7f9035417c5c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event deleted for resources: {'Port': ['ID=74608280-c47c-4b51-b0b7-02d0a0cb8fd9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:29.713709 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58df749d-1a1d-454b-ba4c-7f9035417c5c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:29.764154 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d10df5a-cb04-4413-aced-d38e660557dd req-ed607bf7-4c14-4f56-acf8-fdc3749e3379 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:29.765769 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6d10df5a-cb04-4413-aced-d38e660557dd req-ed607bf7-4c14-4f56-acf8-fdc3749e3379 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2382751 Dec 09 21:36:29.771336 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08c88c00-d177-43d3-8e04-d7b29bdf7c67 req-f6a1a972-3984-45da-9899-cea5bd4e9234 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:29.775695 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-08c88c00-d177-43d3-8e04-d7b29bdf7c67 req-f6a1a972-3984-45da-9899-cea5bd4e9234 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 944 time: 0.0921113 Dec 09 21:36:29.865473 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-08c88c00-d177-43d3-8e04-d7b29bdf7c67 req-cc87a0a9-03e8-4c90-b1dd-96603084de6a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0824931 Dec 09 21:36:30.055361 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-58df749d-1a1d-454b-ba4c-7f9035417c5c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Router 3e8195d6-e93d-4782-b590-1c86852aa5e6 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:36:30.071721 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6d10df5a-cb04-4413-aced-d38e660557dd req-82caa28c-b8da-47ad-9537-0c883c2fcdc8 service neutron] 10.222.0.10 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1672378 Dec 09 21:36:30.162286 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-58df749d-1a1d-454b-ba4c-7f9035417c5c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:36:30.173952 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52738) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:30.174122 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-58df749d-1a1d-454b-ba4c-7f9035417c5c tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "PUT /v2.0/routers/3e8195d6-e93d-4782-b590-1c86852aa5e6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3401914 Dec 09 21:36:30.177598 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6035cc4a-d150-44ff-9dcb-a0c099de33a7 None None] Sync routers for ids ['3e8195d6-e93d-4782-b590-1c86852aa5e6'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:36:30.195961 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6035cc4a-d150-44ff-9dcb-a0c099de33a7 None None] Routers {'3e8195d6-e93d-4782-b590-1c86852aa5e6'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:36:30.196809 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6035cc4a-d150-44ff-9dcb-a0c099de33a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:36:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3e8195d6-e93d-4782-b590-1c86852aa5e6'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:30.222685 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-15906c5c-bfbc-47c9-b2f0-179b1619dde7 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] delete failed (client error): The resource could not be found. Dec 09 21:36:30.224064 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-15906c5c-bfbc-47c9-b2f0-179b1619dde7 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "DELETE /v2.0/routers/tempest-non_exist_router-1854641707 HTTP/1.1" status: 404 len: 335 time: 0.0484388 Dec 09 21:36:30.228013 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52740) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:30.236370 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-f0ac8457-2cee-4cbd-a914-a2b0f78956bf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Request body: {'router': {'external_gateway_info': {'network_id': '3e8195d6-e93d-4782-b590-1c86852aa5e6'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:30.261677 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6035cc4a-d150-44ff-9dcb-a0c099de33a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:30.275221 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6035cc4a-d150-44ff-9dcb-a0c099de33a7 None None] Routers {'3e8195d6-e93d-4782-b590-1c86852aa5e6'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:36:30.276085 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6035cc4a-d150-44ff-9dcb-a0c099de33a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:36:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3e8195d6-e93d-4782-b590-1c86852aa5e6'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:30.316352 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6035cc4a-d150-44ff-9dcb-a0c099de33a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:30.317188 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6035cc4a-d150-44ff-9dcb-a0c099de33a7 None None] The sync data for ids ['3e8195d6-e93d-4782-b590-1c86852aa5e6'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:36:30.338688 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6d10df5a-cb04-4413-aced-d38e660557dd req-21954f48-b89f-464b-a055-add86e4bcf69 service neutron] 10.222.0.10 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1968825 Dec 09 21:36:30.598883 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52748) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:30.722473 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-46e7e18b-ef13-4caf-b30d-6155e76aa9d0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:30.810333 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-46e7e18b-ef13-4caf-b30d-6155e76aa9d0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:30.816862 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-46e7e18b-ef13-4caf-b30d-6155e76aa9d0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:30.867280 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f0ac8457-2cee-4cbd-a914-a2b0f78956bf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:30.888532 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6afcbd4-740a-474b-b46c-9fcbecc13f1d req-e1fc1eec-73c0-4eeb-b6ff-a1119529b237 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:30.890931 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c6afcbd4-740a-474b-b46c-9fcbecc13f1d req-e1fc1eec-73c0-4eeb-b6ff-a1119529b237 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 1096 time: 0.1285641 Dec 09 21:36:30.909529 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-46e7e18b-ef13-4caf-b30d-6155e76aa9d0 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=4203720785e848dda7436159a3c24ab4&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3094385 Dec 09 21:36:30.910363 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46e7e18b-ef13-4caf-b30d-6155e76aa9d0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=706109e5-3d10-438c-aa60-a595dca4d54e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:30.913153 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52758) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:30.962361 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-f0ac8457-2cee-4cbd-a914-a2b0f78956bf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] update failed (client error): The resource could not be found. Dec 09 21:36:30.963559 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f0ac8457-2cee-4cbd-a914-a2b0f78956bf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "PUT /v2.0/routers/3e8195d6-e93d-4782-b590-1c86852aa5e6 HTTP/1.1" status: 404 len: 339 time: 0.7345402 Dec 09 21:36:30.974192 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52760) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:30.982943 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a3dba6ea-1aab-4164-bdf7-feab65a919e5 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Request body: {'network': {'name': 'tempest-RoutersNegativeIpV6Test-test-network-526420478'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:31.013504 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a0a6cde8-4eef-4673-8af2-c946aae4f98b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:31.045395 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a0a6cde8-4eef-4673-8af2-c946aae4f98b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:31.050145 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a3dba6ea-1aab-4164-bdf7-feab65a919e5 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Made reservation on behalf of c655af29a1ac4879926cfb49e8e4183d for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:36:31.053755 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a3dba6ea-1aab-4164-bdf7-feab65a919e5 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:31.067794 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1ad2148-67e4-44c1-acdf-6870a76887a2 req-803b505b-b0eb-43a9-9c1c-eed6d55e08bd tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:31.069708 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c1ad2148-67e4-44c1-acdf-6870a76887a2 req-803b505b-b0eb-43a9-9c1c-eed6d55e08bd tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 944 time: 0.0897427 Dec 09 21:36:31.074267 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6afcbd4-740a-474b-b46c-9fcbecc13f1d req-d0ee1f45-c84b-4544-95a5-faaebe23eba1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:31.075980 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c6afcbd4-740a-474b-b46c-9fcbecc13f1d req-d0ee1f45-c84b-4544-95a5-faaebe23eba1 service neutron] 10.222.0.10 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 913 time: 0.1721101 Dec 09 21:36:31.094795 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a3dba6ea-1aab-4164-bdf7-feab65a919e5 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] vlan segment allocate from pool success with {'vlan_id': 108, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:36:31.130871 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c6afcbd4-740a-474b-b46c-9fcbecc13f1d req-f551e6cc-e4bc-4a98-9d11-b34c92ffe06a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=028345f8-c21b-4afa-a015-34707fd8ba09 HTTP/1.1" status: 200 len: 217 time: 0.0451705 Dec 09 21:36:31.142226 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c1ad2148-67e4-44c1-acdf-6870a76887a2 req-bb5f809d-bcc1-4a38-84e8-76bf96bb5ae0 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0571594 Dec 09 21:36:31.151229 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a0a6cde8-4eef-4673-8af2-c946aae4f98b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:31.155497 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a0a6cde8-4eef-4673-8af2-c946aae4f98b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:31.156782 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a0a6cde8-4eef-4673-8af2-c946aae4f98b admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/706109e5-3d10-438c-aa60-a595dca4d54e HTTP/1.1" status: 204 len: 168 time: 0.2426977 Dec 09 21:36:31.171339 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0a6cde8-4eef-4673-8af2-c946aae4f98b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=706109e5-3d10-438c-aa60-a595dca4d54e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:31.176063 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a3dba6ea-1aab-4164-bdf7-feab65a919e5 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:31.176425 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-a3dba6ea-1aab-4164-bdf7-feab65a919e5 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Added segment e66130d0-11c4-419c-a08c-03067c52cc5c of type vlan for network 6f35126d-3545-4fd2-aa57-a1c731aff784 Dec 09 21:36:31.231087 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6afcbd4-740a-474b-b46c-9fcbecc13f1d req-3fbeb6e8-423b-4e25-8263-9b8cb17e6333 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:31.232617 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c6afcbd4-740a-474b-b46c-9fcbecc13f1d req-3fbeb6e8-423b-4e25-8263-9b8cb17e6333 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 200 len: 851 time: 0.0938435 Dec 09 21:36:31.234351 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a3dba6ea-1aab-4164-bdf7-feab65a919e5 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:31.290497 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a3dba6ea-1aab-4164-bdf7-feab65a919e5 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:31.296381 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3dba6ea-1aab-4164-bdf7-feab65a919e5 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:31.297138 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a3dba6ea-1aab-4164-bdf7-feab65a919e5 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:31.313850 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6afcbd4-740a-474b-b46c-9fcbecc13f1d req-dd871365-be93-4fce-a517-4e08904b64b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:31.315383 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c6afcbd4-740a-474b-b46c-9fcbecc13f1d req-dd871365-be93-4fce-a517-4e08904b64b7 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0740745 Dec 09 21:36:31.371829 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a3dba6ea-1aab-4164-bdf7-feab65a919e5 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 790 time: 0.3938754 Dec 09 21:36:31.373358 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52766) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:31.377371 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-876fad5d-16b9-44ae-b006-0e2c8f661392 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Request body: {'subnet': {'network_id': '6f35126d-3545-4fd2-aa57-a1c731aff784', 'cidr': '2001:db8:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:1::1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:31.478384 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-876fad5d-16b9-44ae-b006-0e2c8f661392 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Made reservation on behalf of c655af29a1ac4879926cfb49e8e4183d for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:36:31.486104 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-876fad5d-16b9-44ae-b006-0e2c8f661392 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:31.486228 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c6afcbd4-740a-474b-b46c-9fcbecc13f1d req-8dec0fee-0e7a-41fd-8ee7-c1a4628dca24 service neutron] 10.222.0.10 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1549256 Dec 09 21:36:31.486228 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3dba6ea-1aab-4164-bdf7-feab65a919e5 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event updated for resources: {'Network': ['ID=6f35126d-3545-4fd2-aa57-a1c731aff784,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:31.500528 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 6f35126d-3545-4fd2-aa57-a1c731aff784 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:36:31.645085 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c6afcbd4-740a-474b-b46c-9fcbecc13f1d req-162b5dc6-b16f-4fb7-b4a9-7d7c126f4e75 service neutron] 10.222.0.10 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1469989 Dec 09 21:36:31.722355 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-876fad5d-16b9-44ae-b006-0e2c8f661392 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:31.785076 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-876fad5d-16b9-44ae-b006-0e2c8f661392 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event updated for resources: {'Subnet': ['ID=c9278d47-c10b-43e2-9ecd-a8ad0a1fd219,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:31.797214 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-876fad5d-16b9-44ae-b006-0e2c8f661392 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Checking segment: {'id': 'e66130d0-11c4-419c-a08c-03067c52cc5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '6f35126d-3545-4fd2-aa57-a1c731aff784'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:36:31.797518 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-876fad5d-16b9-44ae-b006-0e2c8f661392 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Network hostable DHCP agents. Network: 6f35126d-3545-4fd2-aa57-a1c731aff784, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:36:31.818025 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-876fad5d-16b9-44ae-b006-0e2c8f661392 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Network 6f35126d-3545-4fd2-aa57-a1c731aff784 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:36:31.830948 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-876fad5d-16b9-44ae-b006-0e2c8f661392 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 6f35126d-3545-4fd2-aa57-a1c731aff784) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:31.837302 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-876fad5d-16b9-44ae-b006-0e2c8f661392 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:31.838111 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-876fad5d-16b9-44ae-b006-0e2c8f661392 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:31.841395 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8edc5ad9-fedc-4a95-955c-3b3eb44eb872 None None] Network 6f35126d-3545-4fd2-aa57-a1c731aff784 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:31.874766 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-876fad5d-16b9-44ae-b006-0e2c8f661392 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 830 time: 0.4969521 Dec 09 21:36:31.874766 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52782) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:31.880542 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-d26646ca-e49d-466f-8888-6291da234878 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Request body: {'router': {'external_gateway_info': {'network_id': '6f35126d-3545-4fd2-aa57-a1c731aff784'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:31.996541 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ad83f0c-21f3-415e-b47d-b8130874ad6e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-6f35126d-3545-4fd2-aa57-a1c731aff784', 'network_id': '6f35126d-3545-4fd2-aa57-a1c731aff784', 'project_id': 'c655af29a1ac4879926cfb49e8e4183d', 'fixed_ips': [{'subnet_id': 'c9278d47-c10b-43e2-9ecd-a8ad0a1fd219'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:36:31.997446 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9ad83f0c-21f3-415e-b47d-b8130874ad6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:32.183355 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-9ad83f0c-21f3-415e-b47d-b8130874ad6e None None] Allocated IP 2001:db8:1::2 (6f35126d-3545-4fd2-aa57-a1c731aff784/c9278d47-c10b-43e2-9ecd-a8ad0a1fd219/a0dc9ecc-57f1-4076-80bd-5efc78b83646) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:36:32.362841 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9ad83f0c-21f3-415e-b47d-b8130874ad6e None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:32.372190 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9ad83f0c-21f3-415e-b47d-b8130874ad6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:32.392443 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d26646ca-e49d-466f-8888-6291da234878 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:32.424520 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ad83f0c-21f3-415e-b47d-b8130874ad6e None None] Network 6f35126d-3545-4fd2-aa57-a1c731aff784 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:36:32.434393 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-9ad83f0c-21f3-415e-b47d-b8130874ad6e None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:32.439842 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ad83f0c-21f3-415e-b47d-b8130874ad6e None None] Pushing event updated for resources: {'Port': ['ID=a0dc9ecc-57f1-4076-80bd-5efc78b83646,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:32.443313 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ad83f0c-21f3-415e-b47d-b8130874ad6e None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:36:32.473637 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d37a27e4-f429-4442-8ce5-51406507efa2 req-7070486f-9c89-4975-a3c7-5f2692bdbb61 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:32.475210 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d37a27e4-f429-4442-8ce5-51406507efa2 req-7070486f-9c89-4975-a3c7-5f2692bdbb61 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 944 time: 0.2092657 Dec 09 21:36:32.561959 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-9ad83f0c-21f3-415e-b47d-b8130874ad6e None None] Attempting to bind port a0dc9ecc-57f1-4076-80bd-5efc78b83646 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:36:32.562480 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-9ad83f0c-21f3-415e-b47d-b8130874ad6e None None] Attempting to bind port a0dc9ecc-57f1-4076-80bd-5efc78b83646 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'e66130d0-11c4-419c-a08c-03067c52cc5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '6f35126d-3545-4fd2-aa57-a1c731aff784'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:36:32.564219 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ad83f0c-21f3-415e-b47d-b8130874ad6e None None] Attempting to bind port a0dc9ecc-57f1-4076-80bd-5efc78b83646 on network 6f35126d-3545-4fd2-aa57-a1c731aff784 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:36:32.575332 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ad83f0c-21f3-415e-b47d-b8130874ad6e None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 36, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:36:32.575737 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ad83f0c-21f3-415e-b47d-b8130874ad6e None None] Checking segment: {'id': 'e66130d0-11c4-419c-a08c-03067c52cc5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '6f35126d-3545-4fd2-aa57-a1c731aff784'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:36:32.578724 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9ad83f0c-21f3-415e-b47d-b8130874ad6e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:32.579153 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ad83f0c-21f3-415e-b47d-b8130874ad6e None None] Bound using segment: {'id': 'e66130d0-11c4-419c-a08c-03067c52cc5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '6f35126d-3545-4fd2-aa57-a1c731aff784'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:36:32.579674 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-9ad83f0c-21f3-415e-b47d-b8130874ad6e None None] Bound port: a0dc9ecc-57f1-4076-80bd-5efc78b83646, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e66130d0-11c4-419c-a08c-03067c52cc5c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '6f35126d-3545-4fd2-aa57-a1c731aff784'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:36:32.580066 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9ad83f0c-21f3-415e-b47d-b8130874ad6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:32.679121 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d37a27e4-f429-4442-8ce5-51406507efa2 req-42d36c62-91bd-42ee-abf7-963a072b17a1 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1885464 Dec 09 21:36:32.708039 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-9ad83f0c-21f3-415e-b47d-b8130874ad6e None None] For port a0dc9ecc-57f1-4076-80bd-5efc78b83646, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:36:32.717101 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-9ad83f0c-21f3-415e-b47d-b8130874ad6e None None] For port a0dc9ecc-57f1-4076-80bd-5efc78b83646, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a0dc9ecc-57f1-4076-80bd-5efc78b83646,segment=NetworkSegment(e66130d0-11c4-419c-a08c-03067c52cc5c),segment_id=e66130d0-11c4-419c-a08c-03067c52cc5c)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:36:32.726073 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9ad83f0c-21f3-415e-b47d-b8130874ad6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:32.731125 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-d26646ca-e49d-466f-8888-6291da234878 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] update failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:36:32.737689 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52826) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:32.740001 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d26646ca-e49d-466f-8888-6291da234878 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "PUT /v2.0/routers/3e8195d6-e93d-4782-b590-1c86852aa5e6 HTTP/1.1" status: 400 len: 364 time: 0.8635888 Dec 09 21:36:32.818579 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ad83f0c-21f3-415e-b47d-b8130874ad6e None None] Pushing event updated for resources: {'Port': ['ID=a0dc9ecc-57f1-4076-80bd-5efc78b83646,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:32.971940 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-09f5320b-6fb8-4f28-996e-1626640a9f77 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:33.186331 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c7efdbe-78ac-4694-8c09-ebc6394d688d tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:33.206405 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52834) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:33.393834 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6877f58c-4526-4b1c-8df4-49bd9e43504a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:33.461444 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-4c7efdbe-78ac-4694-8c09-ebc6394d688d tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Allocated IP 2001:db8::1 (2dd7c378-e8e7-4621-bb82-5ecdbafef420/b87ba2e9-fe7e-4a2f-9e6c-190332e65ef1/4fa8cdbd-92c5-4641-91cf-e5398195f59e) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:36:33.478868 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6877f58c-4526-4b1c-8df4-49bd9e43504a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:33.484400 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6877f58c-4526-4b1c-8df4-49bd9e43504a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:33.527028 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6877f58c-4526-4b1c-8df4-49bd9e43504a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=5921eebfc08e4c9dad697c04f1f7731f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3193789 Dec 09 21:36:33.529726 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52840) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:33.536472 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6877f58c-4526-4b1c-8df4-49bd9e43504a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=04502b79-f2e5-4aad-b82a-cdf4b2e1808d,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:33.585706 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-39dc22c2-8bba-4950-a580-9aa94ab5e163 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:33.599357 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c7efdbe-78ac-4694-8c09-ebc6394d688d tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:33.608938 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-39dc22c2-8bba-4950-a580-9aa94ab5e163 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:33.638097 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c7efdbe-78ac-4694-8c09-ebc6394d688d tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:33.679106 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 028345f8-c21b-4afa-a015-34707fd8ba09 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:36:33.680494 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-39dc22c2-8bba-4950-a580-9aa94ab5e163 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:33.684901 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-39dc22c2-8bba-4950-a580-9aa94ab5e163 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:33.707188 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-39dc22c2-8bba-4950-a580-9aa94ab5e163 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/04502b79-f2e5-4aad-b82a-cdf4b2e1808d HTTP/1.1" status: 204 len: 168 time: 0.1726258 Dec 09 21:36:33.718432 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c7efdbe-78ac-4694-8c09-ebc6394d688d tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event updated for resources: {'Port': ['ID=4fa8cdbd-92c5-4641-91cf-e5398195f59e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:33.730549 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c7efdbe-78ac-4694-8c09-ebc6394d688d tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Network 2dd7c378-e8e7-4621-bb82-5ecdbafef420 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:36:33.735970 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-4c7efdbe-78ac-4694-8c09-ebc6394d688d tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:33.740077 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c7efdbe-78ac-4694-8c09-ebc6394d688d tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:36:33.740716 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c7efdbe-78ac-4694-8c09-ebc6394d688d tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:33.764670 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39dc22c2-8bba-4950-a580-9aa94ab5e163 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=04502b79-f2e5-4aad-b82a-cdf4b2e1808d,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:33.886141 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a0dc9ecc-57f1-4076-80bd-5efc78b83646 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:36:33.960804 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 028345f8-c21b-4afa-a015-34707fd8ba09, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=028345f8-c21b-4afa-a015-34707fd8ba09,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:34.001228 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e18b50c6-f63a-4b73-93e4-131acee46368 req-4b465a53-e601-413d-8001-b54b969fba33 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:34.014338 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e18b50c6-f63a-4b73-93e4-131acee46368 req-4b465a53-e601-413d-8001-b54b969fba33 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 944 time: 0.1351049 Dec 09 21:36:34.027425 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '028345f8-c21b-4afa-a015-34707fd8ba09', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'port_id': '028345f8-c21b-4afa-a015-34707fd8ba09', 'mac_address': 'fa:16:3e:01:5e:29', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:36:34.042109 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c7efdbe-78ac-4694-8c09-ebc6394d688d tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:34.127791 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:34.144742 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port a0dc9ecc-57f1-4076-80bd-5efc78b83646 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:34.145114 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:34.152098 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e18b50c6-f63a-4b73-93e4-131acee46368 req-74d936e2-1a05-4402-a187-d83c9cb98fee tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1342108 Dec 09 21:36:34.250232 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 028345f8-c21b-4afa-a015-34707fd8ba09 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:36:34.304600 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 028345f8-c21b-4afa-a015-34707fd8ba09, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=028345f8-c21b-4afa-a015-34707fd8ba09,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:34.338594 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:34.447788 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c7efdbe-78ac-4694-8c09-ebc6394d688d tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:34.456354 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c7efdbe-78ac-4694-8c09-ebc6394d688d tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:34.457469 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c7efdbe-78ac-4694-8c09-ebc6394d688d tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:34.537479 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c7efdbe-78ac-4694-8c09-ebc6394d688d tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event updated for resources: {'Port': ['ID=4fa8cdbd-92c5-4641-91cf-e5398195f59e,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:34.569726 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-55d16b75-926e-4698-b7c7-9514f3eef49c None None] Network 6f35126d-3545-4fd2-aa57-a1c731aff784 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:34.577472 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=028345f8-c21b-4afa-a015-34707fd8ba09,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:34.590939 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f45f22ca-619e-450d-94d2-9322402a4c1e None None] Provisioning complete for port 4fa8cdbd-92c5-4641-91cf-e5398195f59e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:34.591313 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f45f22ca-619e-450d-94d2-9322402a4c1e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:34.613896 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c7efdbe-78ac-4694-8c09-ebc6394d688d tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Network 2dd7c378-e8e7-4621-bb82-5ecdbafef420 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:36:34.615905 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-4c7efdbe-78ac-4694-8c09-ebc6394d688d tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:34.642268 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:34.763849 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port a0dc9ecc-57f1-4076-80bd-5efc78b83646, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a0dc9ecc-57f1-4076-80bd-5efc78b83646,segment=NetworkSegment(e66130d0-11c4-419c-a08c-03067c52cc5c),segment_id=e66130d0-11c4-419c-a08c-03067c52cc5c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:34.766182 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['028345f8-c21b-4afa-a015-34707fd8ba09'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:36:34.784952 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4c7efdbe-78ac-4694-8c09-ebc6394d688d tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Router 3e8195d6-e93d-4782-b590-1c86852aa5e6 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:36:34.795961 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:34.798489 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f45f22ca-619e-450d-94d2-9322402a4c1e None None] Port 4fa8cdbd-92c5-4641-91cf-e5398195f59e cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:36:34.923024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4c7efdbe-78ac-4694-8c09-ebc6394d688d tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:36:34.931603 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4c7efdbe-78ac-4694-8c09-ebc6394d688d tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "PUT /v2.0/routers/3e8195d6-e93d-4782-b590-1c86852aa5e6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1903455 Dec 09 21:36:34.931850 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52868) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:34.944694 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-355ff309-693e-4779-b0df-bc45e8e49256 None None] Sync routers for ids ['3e8195d6-e93d-4782-b590-1c86852aa5e6'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:36:34.964515 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-355ff309-693e-4779-b0df-bc45e8e49256 None None] Routers {'3e8195d6-e93d-4782-b590-1c86852aa5e6'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:36:34.968433 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-355ff309-693e-4779-b0df-bc45e8e49256 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:36:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3e8195d6-e93d-4782-b590-1c86852aa5e6'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:34.988825 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d980d5ff-38fb-47de-8b76-ea40fd678dda None None] Provisioning complete for port a0dc9ecc-57f1-4076-80bd-5efc78b83646 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:34.993146 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d980d5ff-38fb-47de-8b76-ea40fd678dda None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:35.056340 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-88cc0434-fc90-4d61-9eee-d42d930ec1d5 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:35.066825 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-355ff309-693e-4779-b0df-bc45e8e49256 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:35.090656 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=a0dc9ecc-57f1-4076-80bd-5efc78b83646,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:35.097301 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-355ff309-693e-4779-b0df-bc45e8e49256 None None] Routers {'3e8195d6-e93d-4782-b590-1c86852aa5e6'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:36:35.098157 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-355ff309-693e-4779-b0df-bc45e8e49256 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 5, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:36:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3e8195d6-e93d-4782-b590-1c86852aa5e6'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:35.171798 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-88cc0434-fc90-4d61-9eee-d42d930ec1d5 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] delete failed (client error): There was a conflict when trying to complete your request. Dec 09 21:36:35.172988 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-88cc0434-fc90-4d61-9eee-d42d930ec1d5 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "DELETE /v2.0/routers/3e8195d6-e93d-4782-b590-1c86852aa5e6 HTTP/1.1" status: 409 len: 329 time: 0.2401912 Dec 09 21:36:35.176150 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52874) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:35.180843 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-355ff309-693e-4779-b0df-bc45e8e49256 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:35.181634 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-355ff309-693e-4779-b0df-bc45e8e49256 None None] The sync data for ids ['3e8195d6-e93d-4782-b590-1c86852aa5e6'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:36:35.353750 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbbdc79f-4adc-4073-a5b8-4577d6878dea req-4266debc-c2fe-47a1-a81b-f3400dad6ff2 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:35.361350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bbbdc79f-4adc-4073-a5b8-4577d6878dea req-4266debc-c2fe-47a1-a81b-f3400dad6ff2 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 945 time: 0.0793688 Dec 09 21:36:35.394108 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5a7ce484-461c-4b2a-acf5-8f04370682aa None None] Provisioning complete for port a0dc9ecc-57f1-4076-80bd-5efc78b83646 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:35.394566 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5a7ce484-461c-4b2a-acf5-8f04370682aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:35.506559 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bbbdc79f-4adc-4073-a5b8-4577d6878dea req-cc53b6e4-7acc-4dde-bc3a-96e9e808eaf7 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1245780 Dec 09 21:36:35.512368 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5a7ce484-461c-4b2a-acf5-8f04370682aa None None] Provisioning complete for port 4fa8cdbd-92c5-4641-91cf-e5398195f59e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:35.512745 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5a7ce484-461c-4b2a-acf5-8f04370682aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:35.569106 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-5a7ce484-461c-4b2a-acf5-8f04370682aa None None] Port 4fa8cdbd-92c5-4641-91cf-e5398195f59e cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:36:35.570612 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4fa82801-94aa-4990-b446-0a94a5a4f6d0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:35.678045 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-16ff63bd-9fc9-486a-854c-1c334b987a29 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:35.767316 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a0dc9ecc-57f1-4076-80bd-5efc78b83646 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:36:35.826092 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port a0dc9ecc-57f1-4076-80bd-5efc78b83646 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:35.826374 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:35.986303 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-16ff63bd-9fc9-486a-854c-1c334b987a29 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Deleting port 4fa8cdbd-92c5-4641-91cf-e5398195f59e {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:36:35.986750 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-16ff63bd-9fc9-486a-854c-1c334b987a29 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:36.082440 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-16ff63bd-9fc9-486a-854c-1c334b987a29 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:36.097575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-16ff63bd-9fc9-486a-854c-1c334b987a29 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Calling delete_port for 4fa8cdbd-92c5-4641-91cf-e5398195f59e owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:36:36.270282 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52900) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:36.300838 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-16ff63bd-9fc9-486a-854c-1c334b987a29 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:36.332897 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16ff63bd-9fc9-486a-854c-1c334b987a29 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event deleted for resources: {'Port': ['ID=4fa8cdbd-92c5-4641-91cf-e5398195f59e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:36.403374 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-23cc16d4-6d76-421d-a458-e089187f99d2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:36.442703 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-16ff63bd-9fc9-486a-854c-1c334b987a29 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:36.544032 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-23cc16d4-6d76-421d-a458-e089187f99d2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:36.552814 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-23cc16d4-6d76-421d-a458-e089187f99d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:36.606822 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:36.625006 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-23cc16d4-6d76-421d-a458-e089187f99d2 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=1144ab4d17a247b8af5870eb35e45ea6&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3511329 Dec 09 21:36:36.625006 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23cc16d4-6d76-421d-a458-e089187f99d2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=feaeb3fa-16e8-4b8b-b50a-ef355bc0d029,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:36.626756 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52914) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:36.641051 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52916) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:36.702754 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fa56f8ba-9621-4e9e-bfd8-f7de549d613c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:36.713361 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-16ff63bd-9fc9-486a-854c-1c334b987a29 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Router 3e8195d6-e93d-4782-b590-1c86852aa5e6 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:36:36.739241 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fa56f8ba-9621-4e9e-bfd8-f7de549d613c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:36.832925 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07f640af-224a-4063-9e08-24e869f0571f req-7f29fae7-37f0-4c30-bd9a-8501eb1ec7ff tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:36.834682 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07f640af-224a-4063-9e08-24e869f0571f req-7f29fae7-37f0-4c30-bd9a-8501eb1ec7ff tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 945 time: 0.1337233 Dec 09 21:36:36.839953 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-16ff63bd-9fc9-486a-854c-1c334b987a29 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:36:36.849224 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-16ff63bd-9fc9-486a-854c-1c334b987a29 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "PUT /v2.0/routers/3e8195d6-e93d-4782-b590-1c86852aa5e6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6713376 Dec 09 21:36:36.850961 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52920) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:36.857630 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7df85675-ce09-4404-add3-75ae0a132d8c None None] Sync routers for ids ['3e8195d6-e93d-4782-b590-1c86852aa5e6'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:36:36.878240 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7df85675-ce09-4404-add3-75ae0a132d8c None None] Routers {'3e8195d6-e93d-4782-b590-1c86852aa5e6'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:36:36.880150 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-7df85675-ce09-4404-add3-75ae0a132d8c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:36:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3e8195d6-e93d-4782-b590-1c86852aa5e6'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:36.909896 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-6ef2450a-8afb-4c89-a35d-d28c30f5a88f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] show failed (client error): The resource could not be found. Dec 09 21:36:36.916616 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6ef2450a-8afb-4c89-a35d-d28c30f5a88f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "GET /v2.0/routers/tempest-non_exist_router-800352369 HTTP/1.1" status: 404 len: 334 time: 0.0591161 Dec 09 21:36:36.916841 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52922) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:36.921297 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-07a06b13-1628-42d1-90c7-97a9026b7eb9 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Request body: {'router': {'name': 'new_name'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:36.929739 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-7df85675-ce09-4404-add3-75ae0a132d8c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:36.947669 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7df85675-ce09-4404-add3-75ae0a132d8c None None] Routers {'3e8195d6-e93d-4782-b590-1c86852aa5e6'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:36:36.948626 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-7df85675-ce09-4404-add3-75ae0a132d8c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:36:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3e8195d6-e93d-4782-b590-1c86852aa5e6'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:36.956490 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fa56f8ba-9621-4e9e-bfd8-f7de549d613c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:36.959494 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fa56f8ba-9621-4e9e-bfd8-f7de549d613c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:36.963304 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fa56f8ba-9621-4e9e-bfd8-f7de549d613c admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/feaeb3fa-16e8-4b8b-b50a-ef355bc0d029 HTTP/1.1" status: 204 len: 168 time: 0.3329215 Dec 09 21:36:36.968559 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-07a06b13-1628-42d1-90c7-97a9026b7eb9 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] update failed (client error): The resource could not be found. Dec 09 21:36:36.975300 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-07a06b13-1628-42d1-90c7-97a9026b7eb9 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "PUT /v2.0/routers/tempest-non_exist_router-2088554135 HTTP/1.1" status: 404 len: 335 time: 0.0518215 Dec 09 21:36:36.977426 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52926) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:36.991799 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07f640af-224a-4063-9e08-24e869f0571f req-7d59b2e9-c6a7-41cc-bac4-854b723f4ba6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1414738 Dec 09 21:36:37.005319 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa56f8ba-9621-4e9e-bfd8-f7de549d613c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=feaeb3fa-16e8-4b8b-b50a-ef355bc0d029,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:37.037813 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-7df85675-ce09-4404-add3-75ae0a132d8c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:37.038473 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7df85675-ce09-4404-add3-75ae0a132d8c None None] The sync data for ids ['3e8195d6-e93d-4782-b590-1c86852aa5e6'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:36:37.070609 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-6229d25d-a278-4c53-a5a8-c70a3e90887f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Deleting subnet c9278d47-c10b-43e2-9ecd-a8ad0a1fd219 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:36:37.075986 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6229d25d-a278-4c53-a5a8-c70a3e90887f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:37.164110 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6229d25d-a278-4c53-a5a8-c70a3e90887f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:37.252927 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b818b1e1-741b-4ba3-9dbd-c0750c0e7d11 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:37.313352 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6229d25d-a278-4c53-a5a8-c70a3e90887f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:37.411662 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6229d25d-a278-4c53-a5a8-c70a3e90887f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:37.438100 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d9f31859-8e2d-4faf-87bc-d304188951f4 None None] Network 6f35126d-3545-4fd2-aa57-a1c731aff784 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:37.439087 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6229d25d-a278-4c53-a5a8-c70a3e90887f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:37.443348 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6229d25d-a278-4c53-a5a8-c70a3e90887f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "DELETE /v2.0/subnets/c9278d47-c10b-43e2-9ecd-a8ad0a1fd219 HTTP/1.1" status: 204 len: 168 time: 0.4649181 Dec 09 21:36:37.444081 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52930) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:37.452859 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52932) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:37.469080 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6229d25d-a278-4c53-a5a8-c70a3e90887f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event deleted for resources: {'Subnet': ['ID=c9278d47-c10b-43e2-9ecd-a8ad0a1fd219,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:37.478600 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53137827-3bee-4255-b09f-02083f73eb50 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:37.581494 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53137827-3bee-4255-b09f-02083f73eb50 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:37.591253 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53137827-3bee-4255-b09f-02083f73eb50 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:37.600838 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e1ac1e9-02cb-4c78-af94-4a0a20343ef6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:37.638988 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53137827-3bee-4255-b09f-02083f73eb50 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=166abafa-dc34-4204-a8bb-0d96c8c3070e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:37.654766 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17f6373c-24a8-4dfb-8f45-2972b7f33522 None None] DHCP port deletion for 6f35126d-3545-4fd2-aa57-a1c731aff784 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:36:37.668969 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-53137827-3bee-4255-b09f-02083f73eb50 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e335c9a710f74e0eb8c62b5b12da0230&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2043040 Dec 09 21:36:37.669985 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52936) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:37.684685 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 028345f8-c21b-4afa-a015-34707fd8ba09 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:36:37.733480 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-48603373-e17e-4b62-b807-c0d717bd3d02 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:37.760881 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-17f6373c-24a8-4dfb-8f45-2972b7f33522 None None] Deleting port a0dc9ecc-57f1-4076-80bd-5efc78b83646 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:36:37.761251 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-17f6373c-24a8-4dfb-8f45-2972b7f33522 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:37.766405 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-b818b1e1-741b-4ba3-9dbd-c0750c0e7d11 admin admin] Deleting port a9a5d2ec-b408-4729-99d3-0e4f8f041e60 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:36:37.766807 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b818b1e1-741b-4ba3-9dbd-c0750c0e7d11 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:37.767091 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-48603373-e17e-4b62-b807-c0d717bd3d02 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:37.777905 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a0dc9ecc-57f1-4076-80bd-5efc78b83646 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:36:37.782668 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 028345f8-c21b-4afa-a015-34707fd8ba09 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:36:37.797409 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-8e1ac1e9-02cb-4c78-af94-4a0a20343ef6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Deleting port a0dc9ecc-57f1-4076-80bd-5efc78b83646 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:36:37.797642 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e1ac1e9-02cb-4c78-af94-4a0a20343ef6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:37.818485 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 028345f8-c21b-4afa-a015-34707fd8ba09 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:37.818890 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:37.859573 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-48603373-e17e-4b62-b807-c0d717bd3d02 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:37.867414 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-48603373-e17e-4b62-b807-c0d717bd3d02 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:37.871307 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-48603373-e17e-4b62-b807-c0d717bd3d02 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/166abafa-dc34-4204-a8bb-0d96c8c3070e HTTP/1.1" status: 204 len: 168 time: 0.1977429 Dec 09 21:36:37.879093 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48603373-e17e-4b62-b807-c0d717bd3d02 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=166abafa-dc34-4204-a8bb-0d96c8c3070e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:37.926094 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-17f6373c-24a8-4dfb-8f45-2972b7f33522 None None] For port a0dc9ecc-57f1-4076-80bd-5efc78b83646, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a0dc9ecc-57f1-4076-80bd-5efc78b83646,segment=NetworkSegment(e66130d0-11c4-419c-a08c-03067c52cc5c),segment_id=e66130d0-11c4-419c-a08c-03067c52cc5c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:37.926685 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-8e1ac1e9-02cb-4c78-af94-4a0a20343ef6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] For port a0dc9ecc-57f1-4076-80bd-5efc78b83646, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a0dc9ecc-57f1-4076-80bd-5efc78b83646,segment=NetworkSegment(e66130d0-11c4-419c-a08c-03067c52cc5c),segment_id=e66130d0-11c4-419c-a08c-03067c52cc5c)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:37.926844 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-17f6373c-24a8-4dfb-8f45-2972b7f33522 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:37.926965 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e1ac1e9-02cb-4c78-af94-4a0a20343ef6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:37.967449 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-17f6373c-24a8-4dfb-8f45-2972b7f33522 None None] Calling delete_port for a0dc9ecc-57f1-4076-80bd-5efc78b83646 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:36:37.985333 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:37.987796 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-8e1ac1e9-02cb-4c78-af94-4a0a20343ef6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Calling delete_port for a0dc9ecc-57f1-4076-80bd-5efc78b83646 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:36:38.006782 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-b818b1e1-741b-4ba3-9dbd-c0750c0e7d11 admin admin] For port a9a5d2ec-b408-4729-99d3-0e4f8f041e60, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a9a5d2ec-b408-4729-99d3-0e4f8f041e60,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:38.007266 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b818b1e1-741b-4ba3-9dbd-c0750c0e7d11 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:38.061316 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-b818b1e1-741b-4ba3-9dbd-c0750c0e7d11 admin admin] Calling delete_port for a9a5d2ec-b408-4729-99d3-0e4f8f041e60 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:36:38.098329 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:38.131587 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:38.148986 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5597ddf3-6d9c-4dda-af57-651fdebc4f04 req-85e1adb9-ff9b-4859-bbf9-d156c3c70805 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:38.151708 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5597ddf3-6d9c-4dda-af57-651fdebc4f04 req-85e1adb9-ff9b-4859-bbf9-d156c3c70805 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 945 time: 0.0647964 Dec 09 21:36:38.171135 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port a0dc9ecc-57f1-4076-80bd-5efc78b83646, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a0dc9ecc-57f1-4076-80bd-5efc78b83646,segment=NetworkSegment(e66130d0-11c4-419c-a08c-03067c52cc5c),segment_id=e66130d0-11c4-419c-a08c-03067c52cc5c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:38.176164 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cbee2951-c573-41f4-8f85-c7c77ec3d8d6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '028345f8-c21b-4afa-a015-34707fd8ba09'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:36:38.178749 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f20ae783-fd32-4de8-be3b-34bc3f1fa8f0" -d '{"events": [{"server_uuid": "cbee2951-c573-41f4-8f85-c7c77ec3d8d6", "name": "network-vif-plugged", "status": "completed", "tag": "028345f8-c21b-4afa-a015-34707fd8ba09"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:36:38.203355 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:38.216870 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 028345f8-c21b-4afa-a015-34707fd8ba09, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=028345f8-c21b-4afa-a015-34707fd8ba09,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:38.235161 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:38.236956 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-17f6373c-24a8-4dfb-8f45-2972b7f33522 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:38.240238 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5597ddf3-6d9c-4dda-af57-651fdebc4f04 req-d7c58237-d8d7-4234-a4d2-6639221ec91d tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0806561 Dec 09 21:36:38.260576 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e1ac1e9-02cb-4c78-af94-4a0a20343ef6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:38.260818 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:36:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-04165971-50bb-4433-bdbc-fb29bf634d1b x-openstack-request-id: req-04165971-50bb-4433-bdbc-fb29bf634d1b {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:36:38.261673 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cbee2951-c573-41f4-8f85-c7c77ec3d8d6", "name": "network-vif-plugged", "status": "completed", "tag": "028345f8-c21b-4afa-a015-34707fd8ba09", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:36:38.261673 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-04165971-50bb-4433-bdbc-fb29bf634d1b {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:36:38.261673 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cbee2951-c573-41f4-8f85-c7c77ec3d8d6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '028345f8-c21b-4afa-a015-34707fd8ba09', 'code': 200} Dec 09 21:36:38.265226 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event deleted for resources: {'Port': ['ID=a0dc9ecc-57f1-4076-80bd-5efc78b83646,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:38.276647 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e1ac1e9-02cb-4c78-af94-4a0a20343ef6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] No DVR routers for this DVR port a0dc9ecc-57f1-4076-80bd-5efc78b83646 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:36:38.280283 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17f6373c-24a8-4dfb-8f45-2972b7f33522 None None] No DVR routers for this DVR port a0dc9ecc-57f1-4076-80bd-5efc78b83646 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:36:38.339901 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=028345f8-c21b-4afa-a015-34707fd8ba09,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:38.366659 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17f6373c-24a8-4dfb-8f45-2972b7f33522 None None] Pushing event deleted for resources: {'Port': ['ID=a0dc9ecc-57f1-4076-80bd-5efc78b83646,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:38.661436 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e1ac1e9-02cb-4c78-af94-4a0a20343ef6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event deleted for resources: {'Port': ['ID=a0dc9ecc-57f1-4076-80bd-5efc78b83646,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:38.785637 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e1ac1e9-02cb-4c78-af94-4a0a20343ef6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:38.823218 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ab3882d-ef1b-4af5-9103-0030c751593b req-53d7740a-4023-43f0-89d4-ce3ad1dff6bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:38.824794 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4ab3882d-ef1b-4af5-9103-0030c751593b req-53d7740a-4023-43f0-89d4-ce3ad1dff6bd service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 1098 time: 0.1744986 Dec 09 21:36:38.838022 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-8e1ac1e9-02cb-4c78-af94-4a0a20343ef6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6f35126d-3545-4fd2-aa57-a1c731aff784']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:38.864363 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-8e1ac1e9-02cb-4c78-af94-4a0a20343ef6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e66130d0-11c4-419c-a08c-03067c52cc5c') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:38.864720 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-8e1ac1e9-02cb-4c78-af94-4a0a20343ef6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e66130d0-11c4-419c-a08c-03067c52cc5c') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:38.876057 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b818b1e1-741b-4ba3-9dbd-c0750c0e7d11 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:38.879089 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e1ac1e9-02cb-4c78-af94-4a0a20343ef6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:38.921655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b818b1e1-741b-4ba3-9dbd-c0750c0e7d11 admin admin] Pushing event deleted for resources: {'Port': ['ID=a9a5d2ec-b408-4729-99d3-0e4f8f041e60,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:38.930758 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e1ac1e9-02cb-4c78-af94-4a0a20343ef6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:38.970601 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8e1ac1e9-02cb-4c78-af94-4a0a20343ef6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Releasing vlan 108 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:36:38.971012 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e1ac1e9-02cb-4c78-af94-4a0a20343ef6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: self.session.flush() Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: self.session.flush() Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: self.session.flush() Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: self.session.flush() Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:36:38.974625 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:36:38.989262 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4ab3882d-ef1b-4af5-9103-0030c751593b req-077de7d5-e3e4-4c08-a466-80d9bd14e81f service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1545253 Dec 09 21:36:39.064576 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e1ac1e9-02cb-4c78-af94-4a0a20343ef6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:39.072818 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e1ac1e9-02cb-4c78-af94-4a0a20343ef6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:39.078242 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8e1ac1e9-02cb-4c78-af94-4a0a20343ef6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "DELETE /v2.0/networks/6f35126d-3545-4fd2-aa57-a1c731aff784 HTTP/1.1" status: 204 len: 168 time: 1.6194460 Dec 09 21:36:39.078713 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52970) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:39.125156 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e1ac1e9-02cb-4c78-af94-4a0a20343ef6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event deleted for resources: {'Network': ['ID=6f35126d-3545-4fd2-aa57-a1c731aff784,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:39.148682 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-8891fb23-ff37-4743-a51d-1cf7c9f8f194 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Deleting subnet b1c82ce0-dc10-42dc-b45e-91449f0fa588 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:36:39.152383 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8891fb23-ff37-4743-a51d-1cf7c9f8f194 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:39.195776 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8891fb23-ff37-4743-a51d-1cf7c9f8f194 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:39.196367 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b818b1e1-741b-4ba3-9dbd-c0750c0e7d11 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:39.310044 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8891fb23-ff37-4743-a51d-1cf7c9f8f194 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:39.406304 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11b1967b-1a92-49f0-9165-4f7426d81296 req-8c0d5d24-736e-48de-806e-5fe9f95ba799 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:39.407848 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11b1967b-1a92-49f0-9165-4f7426d81296 req-8c0d5d24-736e-48de-806e-5fe9f95ba799 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 946 time: 0.0886264 Dec 09 21:36:39.433015 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8891fb23-ff37-4743-a51d-1cf7c9f8f194 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:39.441403 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b818b1e1-741b-4ba3-9dbd-c0750c0e7d11 admin admin] Router 8f39d25d-26dd-4bce-b961-53cba1551e5d has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:36:39.475397 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8891fb23-ff37-4743-a51d-1cf7c9f8f194 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event deleted for resources: {'Subnet': ['ID=b1c82ce0-dc10-42dc-b45e-91449f0fa588,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:39.484105 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8891fb23-ff37-4743-a51d-1cf7c9f8f194 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:39.487279 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8891fb23-ff37-4743-a51d-1cf7c9f8f194 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "DELETE /v2.0/subnets/b1c82ce0-dc10-42dc-b45e-91449f0fa588 HTTP/1.1" status: 204 len: 168 time: 0.4067941 Dec 09 21:36:39.491185 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52988) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:39.492971 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd99f38b-2646-4358-bdd4-30fae9573922 None None] Network 60615649-0a44-41cc-96b0-9d95f10619d0 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:39.500271 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11b1967b-1a92-49f0-9165-4f7426d81296 req-96365a57-275c-4196-9226-d847d646536b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0820301 Dec 09 21:36:39.592310 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-dccd8155-8b93-4cd1-bee5-4804f3c6d2a8 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Deleting subnet 70783e0e-9435-496c-bfcb-e212fdc7e52a {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:36:39.596827 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dccd8155-8b93-4cd1-bee5-4804f3c6d2a8 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:39.640206 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:39.657416 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b818b1e1-741b-4ba3-9dbd-c0750c0e7d11 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:36:39.666805 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b818b1e1-741b-4ba3-9dbd-c0750c0e7d11 admin admin] 10.222.0.13 "PUT /v2.0/routers/8f39d25d-26dd-4bce-b961-53cba1551e5d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0222440 Dec 09 21:36:39.667622 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dccd8155-8b93-4cd1-bee5-4804f3c6d2a8 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:39.668315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53000) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:39.678888 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99c7fc37-d90e-45fb-9348-65e724fa0090 None None] Sync routers for ids ['8f39d25d-26dd-4bce-b961-53cba1551e5d'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:36:39.709257 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99c7fc37-d90e-45fb-9348-65e724fa0090 None None] Routers {'8f39d25d-26dd-4bce-b961-53cba1551e5d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:36:39.709901 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-99c7fc37-d90e-45fb-9348-65e724fa0090 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:36:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['8f39d25d-26dd-4bce-b961-53cba1551e5d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:39.740021 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7af5d7f6-e4b6-4f01-80cf-236d80065827 None None] DHCP port deletion for 60615649-0a44-41cc-96b0-9d95f10619d0 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:36:39.818109 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-7af5d7f6-e4b6-4f01-80cf-236d80065827 None None] Deleting port 00259158-6c71-4dd2-99a3-40829e1a80bb {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:36:39.819548 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7af5d7f6-e4b6-4f01-80cf-236d80065827 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:39.844932 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dccd8155-8b93-4cd1-bee5-4804f3c6d2a8 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:39.889073 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f876676d-4454-4064-bc99-fdd665538df6 admin admin] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:39.927984 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dccd8155-8b93-4cd1-bee5-4804f3c6d2a8 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:39.928380 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-7af5d7f6-e4b6-4f01-80cf-236d80065827 None None] For port 00259158-6c71-4dd2-99a3-40829e1a80bb, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=00259158-6c71-4dd2-99a3-40829e1a80bb,segment=NetworkSegment(78d96733-0720-44d5-97bf-be03bbf3ee99),segment_id=78d96733-0720-44d5-97bf-be03bbf3ee99)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:39.928912 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7af5d7f6-e4b6-4f01-80cf-236d80065827 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:39.951939 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-7af5d7f6-e4b6-4f01-80cf-236d80065827 None None] Calling delete_port for 00259158-6c71-4dd2-99a3-40829e1a80bb owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:36:39.992559 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dccd8155-8b93-4cd1-bee5-4804f3c6d2a8 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event deleted for resources: {'Subnet': ['ID=70783e0e-9435-496c-bfcb-e212fdc7e52a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:39.999555 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dccd8155-8b93-4cd1-bee5-4804f3c6d2a8 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:40.003047 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-dccd8155-8b93-4cd1-bee5-4804f3c6d2a8 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "DELETE /v2.0/subnets/70783e0e-9435-496c-bfcb-e212fdc7e52a HTTP/1.1" status: 204 len: 168 time: 0.5083330 Dec 09 21:36:40.003047 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53030) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:40.092250 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71bb413f-c4c8-4d1f-894b-28a6a5decdb7 None None] Network 832a7450-f598-4d98-8dc0-070aca3694e2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:40.094199 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-99c7fc37-d90e-45fb-9348-65e724fa0090 None None] Set router 8f39d25d-26dd-4bce-b961-53cba1551e5d gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:36:40.117843 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f876676d-4454-4064-bc99-fdd665538df6 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:40.149190 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70eb001f-d6cf-454d-9aa5-76b1f05e4fdf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:40.192954 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-f876676d-4454-4064-bc99-fdd665538df6 admin admin] Deleting port 24ef0d1e-7cfa-4ade-8f5e-466567bc5628 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:36:40.194060 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f876676d-4454-4064-bc99-fdd665538df6 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:40.215092 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-70eb001f-d6cf-454d-9aa5-76b1f05e4fdf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Deleting port 00259158-6c71-4dd2-99a3-40829e1a80bb {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:36:40.215548 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70eb001f-d6cf-454d-9aa5-76b1f05e4fdf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:40.308486 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7af5d7f6-e4b6-4f01-80cf-236d80065827 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:40.325922 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-70eb001f-d6cf-454d-9aa5-76b1f05e4fdf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] For port 00259158-6c71-4dd2-99a3-40829e1a80bb, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=00259158-6c71-4dd2-99a3-40829e1a80bb,segment=NetworkSegment(78d96733-0720-44d5-97bf-be03bbf3ee99),segment_id=78d96733-0720-44d5-97bf-be03bbf3ee99)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:40.326399 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70eb001f-d6cf-454d-9aa5-76b1f05e4fdf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:40.332624 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-f876676d-4454-4064-bc99-fdd665538df6 admin admin] For port 24ef0d1e-7cfa-4ade-8f5e-466567bc5628, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=24ef0d1e-7cfa-4ade-8f5e-466567bc5628,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:40.333241 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f876676d-4454-4064-bc99-fdd665538df6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:40.340124 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7af5d7f6-e4b6-4f01-80cf-236d80065827 None None] Pushing event deleted for resources: {'Port': ['ID=00259158-6c71-4dd2-99a3-40829e1a80bb,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:40.341643 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-70eb001f-d6cf-454d-9aa5-76b1f05e4fdf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Calling delete_port for 00259158-6c71-4dd2-99a3-40829e1a80bb owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:36:40.342010 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7af5d7f6-e4b6-4f01-80cf-236d80065827 None None] No DVR routers for this DVR port 00259158-6c71-4dd2-99a3-40829e1a80bb on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:36:40.378328 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-f876676d-4454-4064-bc99-fdd665538df6 admin admin] Calling delete_port for 24ef0d1e-7cfa-4ade-8f5e-466567bc5628 owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:36:40.444034 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70eb001f-d6cf-454d-9aa5-76b1f05e4fdf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:40.444479 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e8ebfdb5-34b3-4964-b9be-32ed0ecfd25a None None] DHCP port deletion for 832a7450-f598-4d98-8dc0-070aca3694e2 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:36:40.445425 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-99c7fc37-d90e-45fb-9348-65e724fa0090 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'name': 'tempest-AttachVolumeShelveTestJSON-236206179-router', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203'}], 'enable_snat': True}, 'gw_port_id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:14Z', 'updated_at': '2021-12-09T21:36:38Z', 'revision_number': 5, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'gw_port': {'id': '24ef0d1e-7cfa-4ade-8f5e-466567bc5628', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:4c:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1175, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.203', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:28:15Z', 'updated_at': '2021-12-09T21:28:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:40.483644 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70eb001f-d6cf-454d-9aa5-76b1f05e4fdf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event deleted for resources: {'Port': ['ID=00259158-6c71-4dd2-99a3-40829e1a80bb,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:40.486915 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99c7fc37-d90e-45fb-9348-65e724fa0090 None None] Checking router: 8f39d25d-26dd-4bce-b961-53cba1551e5d for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:36:40.488574 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70eb001f-d6cf-454d-9aa5-76b1f05e4fdf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] No DVR routers for this DVR port 00259158-6c71-4dd2-99a3-40829e1a80bb on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:36:40.500106 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99c7fc37-d90e-45fb-9348-65e724fa0090 None None] Routers {'8f39d25d-26dd-4bce-b961-53cba1551e5d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:36:40.500754 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-99c7fc37-d90e-45fb-9348-65e724fa0090 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:36:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['8f39d25d-26dd-4bce-b961-53cba1551e5d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:40.527018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e8ebfdb5-34b3-4964-b9be-32ed0ecfd25a None None] Deleting port 0cbb1260-61c8-4855-b217-085b9d1bbf01 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:36:40.528688 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e8ebfdb5-34b3-4964-b9be-32ed0ecfd25a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:40.658217 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e8ebfdb5-34b3-4964-b9be-32ed0ecfd25a None None] For port 0cbb1260-61c8-4855-b217-085b9d1bbf01, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=0cbb1260-61c8-4855-b217-085b9d1bbf01,segment=NetworkSegment(5312a65b-2088-4471-aaff-ce07fbe1d1a1),segment_id=5312a65b-2088-4471-aaff-ce07fbe1d1a1)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:40.658652 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e8ebfdb5-34b3-4964-b9be-32ed0ecfd25a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:40.660041 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-99c7fc37-d90e-45fb-9348-65e724fa0090 None None] Set router 8f39d25d-26dd-4bce-b961-53cba1551e5d gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:36:40.667463 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70eb001f-d6cf-454d-9aa5-76b1f05e4fdf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:40.675717 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e8ebfdb5-34b3-4964-b9be-32ed0ecfd25a None None] Calling delete_port for 0cbb1260-61c8-4855-b217-085b9d1bbf01 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:36:40.694258 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-70eb001f-d6cf-454d-9aa5-76b1f05e4fdf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['60615649-0a44-41cc-96b0-9d95f10619d0']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:40.708209 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-70eb001f-d6cf-454d-9aa5-76b1f05e4fdf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '78d96733-0720-44d5-97bf-be03bbf3ee99') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:40.708788 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-70eb001f-d6cf-454d-9aa5-76b1f05e4fdf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '78d96733-0720-44d5-97bf-be03bbf3ee99') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:40.722500 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70eb001f-d6cf-454d-9aa5-76b1f05e4fdf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:40.738333 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70eb001f-d6cf-454d-9aa5-76b1f05e4fdf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:40.756788 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-70eb001f-d6cf-454d-9aa5-76b1f05e4fdf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Releasing vlan 118 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:36:40.757916 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70eb001f-d6cf-454d-9aa5-76b1f05e4fdf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:36:40.762009 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:36:40.776978 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e8ebfdb5-34b3-4964-b9be-32ed0ecfd25a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:40.788995 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-99c7fc37-d90e-45fb-9348-65e724fa0090 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'name': 'tempest-AttachVolumeShelveTestJSON-236206179-router', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:14Z', 'updated_at': '2021-12-09T21:36:40Z', 'revision_number': 6, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:40.839269 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99c7fc37-d90e-45fb-9348-65e724fa0090 None None] The sync data for ids ['8f39d25d-26dd-4bce-b961-53cba1551e5d'] in n-d-713301-27 is: [{'id': '8f39d25d-26dd-4bce-b961-53cba1551e5d', 'name': 'tempest-AttachVolumeShelveTestJSON-236206179-router', 'tenant_id': '29f2c1d9be9348b0888bc61ed37ed957', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:28:14Z', 'updated_at': '2021-12-09T21:36:40Z', 'revision_number': 6, 'project_id': '29f2c1d9be9348b0888bc61ed37ed957', 'gw_port_host': None}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:36:40.847992 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8ebfdb5-34b3-4964-b9be-32ed0ecfd25a None None] Pushing event deleted for resources: {'Port': ['ID=0cbb1260-61c8-4855-b217-085b9d1bbf01,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:40.850158 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8ebfdb5-34b3-4964-b9be-32ed0ecfd25a None None] No DVR routers for this DVR port 0cbb1260-61c8-4855-b217-085b9d1bbf01 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:36:40.873814 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebd5f325-53b2-4b2a-8946-14d0d5265078 req-c021e57a-1a52-43cb-87ef-d34163308d2f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:40.875405 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ebd5f325-53b2-4b2a-8946-14d0d5265078 req-c021e57a-1a52-43cb-87ef-d34163308d2f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 946 time: 0.0888305 Dec 09 21:36:40.919696 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70eb001f-d6cf-454d-9aa5-76b1f05e4fdf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:40.932762 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70eb001f-d6cf-454d-9aa5-76b1f05e4fdf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:40.942057 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-70eb001f-d6cf-454d-9aa5-76b1f05e4fdf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "DELETE /v2.0/networks/60615649-0a44-41cc-96b0-9d95f10619d0 HTTP/1.1" status: 204 len: 168 time: 0.9348643 Dec 09 21:36:40.955420 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53072) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:40.990163 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70eb001f-d6cf-454d-9aa5-76b1f05e4fdf tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event deleted for resources: {'Network': ['ID=60615649-0a44-41cc-96b0-9d95f10619d0,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:41.023750 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53074) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:41.068382 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ebd5f325-53b2-4b2a-8946-14d0d5265078 req-46389809-2180-4f17-9689-f4acbfa1cb32 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1329827 Dec 09 21:36:41.117604 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2d952de0-a0f7-443e-945a-353626e6bb99 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.163794 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26287305-3ff2-4ec9-9347-5bac96bf7c9a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.243654 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2d952de0-a0f7-443e-945a-353626e6bb99 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.266250 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26287305-3ff2-4ec9-9347-5bac96bf7c9a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.271081 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26287305-3ff2-4ec9-9347-5bac96bf7c9a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.283271 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-2d952de0-a0f7-443e-945a-353626e6bb99 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['832a7450-f598-4d98-8dc0-070aca3694e2']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:41.308160 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f876676d-4454-4064-bc99-fdd665538df6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.312771 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-26287305-3ff2-4ec9-9347-5bac96bf7c9a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=40a26969404f49faad6825ec01d3f4b0&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2876444 Dec 09 21:36:41.312962 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-2d952de0-a0f7-443e-945a-353626e6bb99 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5312a65b-2088-4471-aaff-ce07fbe1d1a1') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:41.313142 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-2d952de0-a0f7-443e-945a-353626e6bb99 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5312a65b-2088-4471-aaff-ce07fbe1d1a1') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:41.313656 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26287305-3ff2-4ec9-9347-5bac96bf7c9a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9d83b379-fcb1-4f88-adc8-21cc919952ad,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:41.316318 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53082) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:41.341540 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2d952de0-a0f7-443e-945a-353626e6bb99 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.374505 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f876676d-4454-4064-bc99-fdd665538df6 admin admin] Pushing event deleted for resources: {'Port': ['ID=24ef0d1e-7cfa-4ade-8f5e-466567bc5628,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:41.382212 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c8094926-513c-4122-ba19-e15a8ada552f None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:36:41.406049 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2d952de0-a0f7-443e-945a-353626e6bb99 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.447000 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2d952de0-a0f7-443e-945a-353626e6bb99 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Releasing vlan 106 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:36:41.447453 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2d952de0-a0f7-443e-945a-353626e6bb99 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:36:41.451663 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:36:41.474939 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a93440a-0bbb-4a39-a62f-9227521466ae req-25dfb7b6-c63f-446b-a51d-e87836574c94 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:41.476662 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a93440a-0bbb-4a39-a62f-9227521466ae req-25dfb7b6-c63f-446b-a51d-e87836574c94 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 946 time: 0.2138512 Dec 09 21:36:41.563631 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ea0be630-d5f6-4f9a-9f49-adc384b4fadc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.570744 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2d952de0-a0f7-443e-945a-353626e6bb99 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.573660 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f876676d-4454-4064-bc99-fdd665538df6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.588841 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2d952de0-a0f7-443e-945a-353626e6bb99 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.592058 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2d952de0-a0f7-443e-945a-353626e6bb99 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "DELETE /v2.0/networks/832a7450-f598-4d98-8dc0-070aca3694e2 HTTP/1.1" status: 204 len: 168 time: 0.6355205 Dec 09 21:36:41.594930 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53084) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:41.660790 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-59bb778f-6da7-4949-a3f4-b57326c9979f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Deleting subnet b87ba2e9-fe7e-4a2f-9e6c-190332e65ef1 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:36:41.664298 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59bb778f-6da7-4949-a3f4-b57326c9979f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.705108 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d952de0-a0f7-443e-945a-353626e6bb99 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event deleted for resources: {'Network': ['ID=832a7450-f598-4d98-8dc0-070aca3694e2,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:41.715066 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59bb778f-6da7-4949-a3f4-b57326c9979f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.718761 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f876676d-4454-4064-bc99-fdd665538df6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.721981 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ea0be630-d5f6-4f9a-9f49-adc384b4fadc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.724861 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f876676d-4454-4064-bc99-fdd665538df6 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.740009 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a93440a-0bbb-4a39-a62f-9227521466ae req-b600b792-0de0-43bc-b3ac-47ba3fc4fef1 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2518747 Dec 09 21:36:41.759550 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0cbb1260-61c8-4855-b217-085b9d1bbf01 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:36:41.780697 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 0cbb1260-61c8-4855-b217-085b9d1bbf01 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:36:41.781041 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0cbb1260-61c8-4855-b217-085b9d1bbf01 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:36:41.781657 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 24ef0d1e-7cfa-4ade-8f5e-466567bc5628 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:36:41.803645 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 24ef0d1e-7cfa-4ade-8f5e-466567bc5628 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:36:41.804355 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 24ef0d1e-7cfa-4ade-8f5e-466567bc5628 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:36:41.804847 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a9a5d2ec-b408-4729-99d3-0e4f8f041e60 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:36:41.813314 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59bb778f-6da7-4949-a3f4-b57326c9979f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.815777 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f876676d-4454-4064-bc99-fdd665538df6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.816460 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f876676d-4454-4064-bc99-fdd665538df6 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 8f39d25d-26dd-4bce-b961-53cba1551e5d {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:36:41.821842 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f876676d-4454-4064-bc99-fdd665538df6 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.823068 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f876676d-4454-4064-bc99-fdd665538df6 admin admin] 10.222.0.13 "DELETE /v2.0/routers/8f39d25d-26dd-4bce-b961-53cba1551e5d HTTP/1.1" status: 204 len: 168 time: 2.1524653 Dec 09 21:36:41.825844 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53086) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:41.834963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: a9a5d2ec-b408-4729-99d3-0e4f8f041e60 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:36:41.835314 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a9a5d2ec-b408-4729-99d3-0e4f8f041e60 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:36:41.836203 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 00259158-6c71-4dd2-99a3-40829e1a80bb no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:36:41.861986 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 00259158-6c71-4dd2-99a3-40829e1a80bb {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:36:41.862392 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 00259158-6c71-4dd2-99a3-40829e1a80bb not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:36:41.873408 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ea0be630-d5f6-4f9a-9f49-adc384b4fadc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.876422 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ea0be630-d5f6-4f9a-9f49-adc384b4fadc admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.879899 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ea0be630-d5f6-4f9a-9f49-adc384b4fadc admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/9d83b379-fcb1-4f88-adc8-21cc919952ad HTTP/1.1" status: 204 len: 168 time: 0.5474739 Dec 09 21:36:41.891301 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea0be630-d5f6-4f9a-9f49-adc384b4fadc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9d83b379-fcb1-4f88-adc8-21cc919952ad,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:41.900120 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-6b4a978c-8c58-4941-968a-93a7549608af admin admin] Deleting subnet ace82e8b-012a-4184-a81e-5303eecf12ff {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:36:41.904069 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6b4a978c-8c58-4941-968a-93a7549608af admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.910069 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59bb778f-6da7-4949-a3f4-b57326c9979f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.951739 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6b4a978c-8c58-4941-968a-93a7549608af admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.979931 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59bb778f-6da7-4949-a3f4-b57326c9979f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event deleted for resources: {'Subnet': ['ID=b87ba2e9-fe7e-4a2f-9e6c-190332e65ef1,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:41.996094 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59bb778f-6da7-4949-a3f4-b57326c9979f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:41.996759 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-98b94c6d-8225-43e4-a8b1-d5584655673f None None] Network 2dd7c378-e8e7-4621-bb82-5ecdbafef420 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:42.001517 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-59bb778f-6da7-4949-a3f4-b57326c9979f tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "DELETE /v2.0/subnets/b87ba2e9-fe7e-4a2f-9e6c-190332e65ef1 HTTP/1.1" status: 204 len: 168 time: 0.4054639 Dec 09 21:36:42.004458 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53092) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:42.133023 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-120e404d-402d-481f-a723-c31b944fa4c6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.141787 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6b4a978c-8c58-4941-968a-93a7549608af admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.193804 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3250ef5-4f40-4e3d-aa6a-7419ecfd1dcb None None] DHCP port deletion for 2dd7c378-e8e7-4621-bb82-5ecdbafef420 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:36:42.234869 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6b4a978c-8c58-4941-968a-93a7549608af admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.246021 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-120e404d-402d-481f-a723-c31b944fa4c6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Deleting port 18683261-1ff4-4746-ade2-fc2e188298b7 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:36:42.246761 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-120e404d-402d-481f-a723-c31b944fa4c6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.247692 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d3250ef5-4f40-4e3d-aa6a-7419ecfd1dcb None None] Deleting port 18683261-1ff4-4746-ade2-fc2e188298b7 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:36:42.248069 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d3250ef5-4f40-4e3d-aa6a-7419ecfd1dcb None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.272016 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53096) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:42.276596 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b4a978c-8c58-4941-968a-93a7549608af admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ace82e8b-012a-4184-a81e-5303eecf12ff,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:42.282198 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6b4a978c-8c58-4941-968a-93a7549608af admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.287660 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6b4a978c-8c58-4941-968a-93a7549608af admin admin] 10.222.0.13 "DELETE /v2.0/subnets/ace82e8b-012a-4184-a81e-5303eecf12ff HTTP/1.1" status: 204 len: 168 time: 0.4586432 Dec 09 21:36:42.295246 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53098) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:42.300703 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b72e190c-d618-4834-884f-8876a9e12595 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.310061 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-58d18d5d-596c-4885-962c-4571fbef2df1 None None] Network e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:42.339953 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-d3250ef5-4f40-4e3d-aa6a-7419ecfd1dcb None None] For port 18683261-1ff4-4746-ade2-fc2e188298b7, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=18683261-1ff4-4746-ade2-fc2e188298b7,segment=NetworkSegment(9844037c-af3c-4f3d-9bbb-c167df5df582),segment_id=9844037c-af3c-4f3d-9bbb-c167df5df582)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:42.340811 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d3250ef5-4f40-4e3d-aa6a-7419ecfd1dcb None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.364734 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-120e404d-402d-481f-a723-c31b944fa4c6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] For port 18683261-1ff4-4746-ade2-fc2e188298b7, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=18683261-1ff4-4746-ade2-fc2e188298b7,segment=NetworkSegment(9844037c-af3c-4f3d-9bbb-c167df5df582),segment_id=9844037c-af3c-4f3d-9bbb-c167df5df582)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:42.365037 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-120e404d-402d-481f-a723-c31b944fa4c6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.367128 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d3250ef5-4f40-4e3d-aa6a-7419ecfd1dcb None None] Calling delete_port for 18683261-1ff4-4746-ade2-fc2e188298b7 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:36:42.382245 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b72e190c-d618-4834-884f-8876a9e12595 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.387070 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b72e190c-d618-4834-884f-8876a9e12595 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.412637 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-120e404d-402d-481f-a723-c31b944fa4c6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Calling delete_port for 18683261-1ff4-4746-ade2-fc2e188298b7 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:36:42.422676 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f268cc9-1bd0-4ceb-a348-703b4704c191 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.429976 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b72e190c-d618-4834-884f-8876a9e12595 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3b8bd467-05c1-47b9-b9bf-2f4c5b6f8014,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:42.435632 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b72e190c-d618-4834-884f-8876a9e12595 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=146a6bd6b24b446c8bf0ecea3b646264&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1608026 Dec 09 21:36:42.438364 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53100) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:42.586243 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-120e404d-402d-481f-a723-c31b944fa4c6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.590308 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53dbe96b-e647-4317-9def-e18030b92408 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.629580 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-120e404d-402d-481f-a723-c31b944fa4c6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event deleted for resources: {'Port': ['ID=18683261-1ff4-4746-ade2-fc2e188298b7,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:42.631564 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-120e404d-402d-481f-a723-c31b944fa4c6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] No DVR routers for this DVR port 18683261-1ff4-4746-ade2-fc2e188298b7 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:36:42.643786 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-1f268cc9-1bd0-4ceb-a348-703b4704c191 admin admin] Deleting port f0107249-478c-46d2-8518-d2a9b5ed6220 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:36:42.644101 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f268cc9-1bd0-4ceb-a348-703b4704c191 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.651928 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53dbe96b-e647-4317-9def-e18030b92408 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.662270 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d3250ef5-4f40-4e3d-aa6a-7419ecfd1dcb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.691292 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3250ef5-4f40-4e3d-aa6a-7419ecfd1dcb None None] Pushing event deleted for resources: {'Port': ['ID=18683261-1ff4-4746-ade2-fc2e188298b7,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:42.694538 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3250ef5-4f40-4e3d-aa6a-7419ecfd1dcb None None] No DVR routers for this DVR port 18683261-1ff4-4746-ade2-fc2e188298b7 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:36:42.736287 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa1277f5-cde4-418d-9fcb-0ac63ba734cc None None] DHCP port deletion for e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:36:42.784993 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-aa1277f5-cde4-418d-9fcb-0ac63ba734cc None None] Deleting port f0107249-478c-46d2-8518-d2a9b5ed6220 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:36:42.785691 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aa1277f5-cde4-418d-9fcb-0ac63ba734cc None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.794849 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-120e404d-402d-481f-a723-c31b944fa4c6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.850892 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-aa1277f5-cde4-418d-9fcb-0ac63ba734cc None None] For port f0107249-478c-46d2-8518-d2a9b5ed6220, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f0107249-478c-46d2-8518-d2a9b5ed6220,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:42.851246 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aa1277f5-cde4-418d-9fcb-0ac63ba734cc None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.858154 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-120e404d-402d-481f-a723-c31b944fa4c6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2dd7c378-e8e7-4621-bb82-5ecdbafef420']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:42.864313 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-aa1277f5-cde4-418d-9fcb-0ac63ba734cc None None] Calling delete_port for f0107249-478c-46d2-8518-d2a9b5ed6220 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:36:42.876301 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-1f268cc9-1bd0-4ceb-a348-703b4704c191 admin admin] For port f0107249-478c-46d2-8518-d2a9b5ed6220, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f0107249-478c-46d2-8518-d2a9b5ed6220,segment=NetworkSegment(ad90d3b7-fe41-4a28-acd8-4c934cf4d57c),segment_id=ad90d3b7-fe41-4a28-acd8-4c934cf4d57c)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:42.876707 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f268cc9-1bd0-4ceb-a348-703b4704c191 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.889416 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-120e404d-402d-481f-a723-c31b944fa4c6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9844037c-af3c-4f3d-9bbb-c167df5df582') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:42.889726 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-120e404d-402d-481f-a723-c31b944fa4c6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9844037c-af3c-4f3d-9bbb-c167df5df582') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:42.902211 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-1f268cc9-1bd0-4ceb-a348-703b4704c191 admin admin] Calling delete_port for f0107249-478c-46d2-8518-d2a9b5ed6220 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:36:42.904830 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-120e404d-402d-481f-a723-c31b944fa4c6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.931422 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-120e404d-402d-481f-a723-c31b944fa4c6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.933474 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53dbe96b-e647-4317-9def-e18030b92408 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.936038 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-53dbe96b-e647-4317-9def-e18030b92408 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.937191 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-53dbe96b-e647-4317-9def-e18030b92408 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/3b8bd467-05c1-47b9-b9bf-2f4c5b6f8014 HTTP/1.1" status: 204 len: 168 time: 0.4976580 Dec 09 21:36:42.953803 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aa1277f5-cde4-418d-9fcb-0ac63ba734cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.977098 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-120e404d-402d-481f-a723-c31b944fa4c6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Releasing vlan 147 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:36:42.977524 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-120e404d-402d-481f-a723-c31b944fa4c6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:42.980326 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa1277f5-cde4-418d-9fcb-0ac63ba734cc None None] Pushing event deleted for resources: {'Port': ['ID=f0107249-478c-46d2-8518-d2a9b5ed6220,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:36:42.982018 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:36:42.985032 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa1277f5-cde4-418d-9fcb-0ac63ba734cc None None] No DVR routers for this DVR port f0107249-478c-46d2-8518-d2a9b5ed6220 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:36:43.004010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b384894-e1ea-466c-8f2b-937435a48465 req-513fba84-e735-4221-8e63-754b3c530cfb tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:43.005546 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8b384894-e1ea-466c-8f2b-937435a48465 req-513fba84-e735-4221-8e63-754b3c530cfb tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 946 time: 0.1939192 Dec 09 21:36:43.012652 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53dbe96b-e647-4317-9def-e18030b92408 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b8bd467-05c1-47b9-b9bf-2f4c5b6f8014,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:43.094937 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-120e404d-402d-481f-a723-c31b944fa4c6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:43.113067 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-120e404d-402d-481f-a723-c31b944fa4c6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:43.116233 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-120e404d-402d-481f-a723-c31b944fa4c6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "DELETE /v2.0/networks/2dd7c378-e8e7-4621-bb82-5ecdbafef420 HTTP/1.1" status: 204 len: 168 time: 1.1108282 Dec 09 21:36:43.119388 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53108) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:43.137718 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-120e404d-402d-481f-a723-c31b944fa4c6 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Pushing event deleted for resources: {'Network': ['ID=2dd7c378-e8e7-4621-bb82-5ecdbafef420,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:43.145250 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f268cc9-1bd0-4ceb-a348-703b4704c191 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:43.153231 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8b384894-e1ea-466c-8f2b-937435a48465 req-031abf5d-7afd-46e3-ab63-39e2c428eb9c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1310294 Dec 09 21:36:43.159607 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-dfca863e-8813-4b95-9acd-5b70ccf01f3b tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "GET /v2.0/ports?device_id=3e8195d6-e93d-4782-b590-1c86852aa5e6 HTTP/1.1" status: 200 len: 205 time: 0.0357082 Dec 09 21:36:43.171404 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53110) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:43.181181 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f268cc9-1bd0-4ceb-a348-703b4704c191 admin admin] Pushing event deleted for resources: {'Port': ['ID=f0107249-478c-46d2-8518-d2a9b5ed6220,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:43.185092 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f268cc9-1bd0-4ceb-a348-703b4704c191 admin admin] No DVR routers for this DVR port f0107249-478c-46d2-8518-d2a9b5ed6220 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:36:43.263982 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26f4845a-3e28-430a-b964-73db42896d00 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:43.270308 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f268cc9-1bd0-4ceb-a348-703b4704c191 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:43.293683 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-1f268cc9-1bd0-4ceb-a348-703b4704c191 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:43.305742 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-1f268cc9-1bd0-4ceb-a348-703b4704c191 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ad90d3b7-fe41-4a28-acd8-4c934cf4d57c') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:43.306304 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-1f268cc9-1bd0-4ceb-a348-703b4704c191 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ad90d3b7-fe41-4a28-acd8-4c934cf4d57c') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:43.316785 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f268cc9-1bd0-4ceb-a348-703b4704c191 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:43.331200 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f268cc9-1bd0-4ceb-a348-703b4704c191 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:43.337879 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1f268cc9-1bd0-4ceb-a348-703b4704c191 admin admin] Releasing vlan 144 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:36:43.338535 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f268cc9-1bd0-4ceb-a348-703b4704c191 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:36:43.351244 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:36:43.402588 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f268cc9-1bd0-4ceb-a348-703b4704c191 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:43.415059 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f268cc9-1bd0-4ceb-a348-703b4704c191 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:43.422123 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1f268cc9-1bd0-4ceb-a348-703b4704c191 admin admin] 10.222.0.13 "DELETE /v2.0/networks/e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8 HTTP/1.1" status: 204 len: 168 time: 1.1254590 Dec 09 21:36:43.433837 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f268cc9-1bd0-4ceb-a348-703b4704c191 admin admin] Pushing event deleted for resources: {'Network': ['ID=e3bf72b1-3ad6-4d78-9632-c3dc2545b1c8,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:43.447097 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26f4845a-3e28-430a-b964-73db42896d00 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:43.449500 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26f4845a-3e28-430a-b964-73db42896d00 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:43.509139 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26f4845a-3e28-430a-b964-73db42896d00 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:43.509973 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-26f4845a-3e28-430a-b964-73db42896d00 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Fanout notify agent at l3_agent the message router_deleted on router 3e8195d6-e93d-4782-b590-1c86852aa5e6 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:36:43.521138 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26f4845a-3e28-430a-b964-73db42896d00 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:43.525866 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-26f4845a-3e28-430a-b964-73db42896d00 tempest-RoutersNegativeIpV6Test-403309190 tempest-RoutersNegativeIpV6Test-403309190-project] 10.222.0.13 "DELETE /v2.0/routers/3e8195d6-e93d-4782-b590-1c86852aa5e6 HTTP/1.1" status: 204 len: 168 time: 0.3530362 Dec 09 21:36:43.632043 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53140) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:43.695373 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-613c92b1-80c0-490b-9bfc-baa4b66b1238 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=29f2c1d9be9348b0888bc61ed37ed957&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0618870 Dec 09 21:36:43.698349 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53142) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:43.756229 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22a59f2e-59a9-41d2-b744-5f28fdf5580b req-36cd288f-0d75-48fd-ba3d-3f21cf5aca4e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:43.758880 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22a59f2e-59a9-41d2-b744-5f28fdf5580b req-36cd288f-0d75-48fd-ba3d-3f21cf5aca4e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 946 time: 0.1061425 Dec 09 21:36:43.759827 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f0107249-478c-46d2-8518-d2a9b5ed6220 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:36:43.782703 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: f0107249-478c-46d2-8518-d2a9b5ed6220 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:36:43.783057 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f0107249-478c-46d2-8518-d2a9b5ed6220 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:36:43.783517 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 18683261-1ff4-4746-ade2-fc2e188298b7 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:36:43.791805 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-57387fea-99a6-4bd8-aec6-75ae33aae515 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:43.806392 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 18683261-1ff4-4746-ade2-fc2e188298b7 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:36:43.807665 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 18683261-1ff4-4746-ade2-fc2e188298b7 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:36:43.834860 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-57387fea-99a6-4bd8-aec6-75ae33aae515 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:43.870072 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53148) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:43.893677 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22a59f2e-59a9-41d2-b744-5f28fdf5580b req-bb039e90-578f-4db5-8196-b76b9b9421e4 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0957601 Dec 09 21:36:43.925211 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-57387fea-99a6-4bd8-aec6-75ae33aae515 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:43.928059 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-57387fea-99a6-4bd8-aec6-75ae33aae515 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:43.929288 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-57387fea-99a6-4bd8-aec6-75ae33aae515 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/b3df31c8-3004-4dae-848a-df0a458122c0 HTTP/1.1" status: 204 len: 168 time: 0.2303975 Dec 09 21:36:43.938335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57387fea-99a6-4bd8-aec6-75ae33aae515 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b3df31c8-3004-4dae-848a-df0a458122c0,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:44.150877 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4f35c898-789f-42c7-848c-d12a30f5bea3 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=c655af29a1ac4879926cfb49e8e4183d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2769058 Dec 09 21:36:44.151642 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53160) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:44.207821 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee6d70b9-9fc5-413f-aac5-677d544a448c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:44.232035 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee6d70b9-9fc5-413f-aac5-677d544a448c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:44.285136 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee6d70b9-9fc5-413f-aac5-677d544a448c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:44.288438 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee6d70b9-9fc5-413f-aac5-677d544a448c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:44.289745 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ee6d70b9-9fc5-413f-aac5-677d544a448c admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/3d2ef909-b6c9-433d-a964-2f48f49125bc HTTP/1.1" status: 204 len: 168 time: 0.1370645 Dec 09 21:36:44.300847 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee6d70b9-9fc5-413f-aac5-677d544a448c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3d2ef909-b6c9-433d-a964-2f48f49125bc,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:45.054294 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d95aefc3-4eeb-4314-a234-3a7539d88a75 req-531cc9e6-f83b-4264-9cbb-361032b38972 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:45.056124 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d95aefc3-4eeb-4314-a234-3a7539d88a75 req-531cc9e6-f83b-4264-9cbb-361032b38972 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 946 time: 0.0573912 Dec 09 21:36:45.114125 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d95aefc3-4eeb-4314-a234-3a7539d88a75 req-cf40588a-2a6b-4107-b4b4-386ca2dc40b8 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497797 Dec 09 21:36:45.678885 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 028345f8-c21b-4afa-a015-34707fd8ba09 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:36:45.771950 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53256) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:45.809762 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 028345f8-c21b-4afa-a015-34707fd8ba09, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=028345f8-c21b-4afa-a015-34707fd8ba09,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:45.823830 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '028345f8-c21b-4afa-a015-34707fd8ba09', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'port_id': '028345f8-c21b-4afa-a015-34707fd8ba09', 'mac_address': 'fa:16:3e:01:5e:29', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:36:45.866943 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:45.881396 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 028345f8-c21b-4afa-a015-34707fd8ba09 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:36:45.903585 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 028345f8-c21b-4afa-a015-34707fd8ba09, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=028345f8-c21b-4afa-a015-34707fd8ba09,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:45.908370 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:45.960160 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=028345f8-c21b-4afa-a015-34707fd8ba09,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:46.019111 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-107df2ff-2954-428f-8473-1b0f7e49b2a4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:46.042315 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-107df2ff-2954-428f-8473-1b0f7e49b2a4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for floatingip, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:46.065392 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['028345f8-c21b-4afa-a015-34707fd8ba09'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:36:46.202186 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-107df2ff-2954-428f-8473-1b0f7e49b2a4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:46.253188 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b75c1871-c684-4f73-8949-7da05170551b req-de99d37f-b2e8-4fc1-9187-0f633b224394 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:46.263771 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b75c1871-c684-4f73-8949-7da05170551b req-de99d37f-b2e8-4fc1-9187-0f633b224394 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 945 time: 0.0643487 Dec 09 21:36:46.323079 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b75c1871-c684-4f73-8949-7da05170551b req-ce29cc89-5b9b-4266-b77d-c593c6ff37ba tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0579340 Dec 09 21:36:46.370729 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-107df2ff-2954-428f-8473-1b0f7e49b2a4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Allocated IP 172.25.3.80 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/3ec52eb4-67ef-46f4-aec7-81c9fd4717ee) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:36:46.494762 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-107df2ff-2954-428f-8473-1b0f7e49b2a4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:46.576468 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-107df2ff-2954-428f-8473-1b0f7e49b2a4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:46.661696 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-107df2ff-2954-428f-8473-1b0f7e49b2a4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Pushing event updated for resources: {'Port': ['ID=3ec52eb4-67ef-46f4-aec7-81c9fd4717ee,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:46.676248 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-107df2ff-2954-428f-8473-1b0f7e49b2a4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:36:46.677857 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-107df2ff-2954-428f-8473-1b0f7e49b2a4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:46.680696 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-107df2ff-2954-428f-8473-1b0f7e49b2a4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:36:46.816782 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-107df2ff-2954-428f-8473-1b0f7e49b2a4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:46.881445 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-107df2ff-2954-428f-8473-1b0f7e49b2a4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:47.123660 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-107df2ff-2954-428f-8473-1b0f7e49b2a4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:47.133856 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-107df2ff-2954-428f-8473-1b0f7e49b2a4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:47.266347 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-107df2ff-2954-428f-8473-1b0f7e49b2a4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Pushing event updated for resources: {'Port': ['ID=3ec52eb4-67ef-46f4-aec7-81c9fd4717ee,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:47.292968 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-107df2ff-2954-428f-8473-1b0f7e49b2a4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:47.313173 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-107df2ff-2954-428f-8473-1b0f7e49b2a4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:47.314479 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-107df2ff-2954-428f-8473-1b0f7e49b2a4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.5402250 Dec 09 21:36:47.318089 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53316) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:47.324223 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-d3a5b61d-8d7d-4fe6-826d-afe910682cbe tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Request body: {'network': {'name': 'tempest-FloatingIPAdminTestJSON-test-network-1523051350'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:47.374322 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d3a5b61d-8d7d-4fe6-826d-afe910682cbe tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Made reservation on behalf of 5063643820ef4888b4eb80cecf86fa5d for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:36:47.382884 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3a5b61d-8d7d-4fe6-826d-afe910682cbe tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:47.396861 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3a5b61d-8d7d-4fe6-826d-afe910682cbe tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:47.583381 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3a5b61d-8d7d-4fe6-826d-afe910682cbe tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:47.610586 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeb78410-40da-4049-aad5-26c5903c39a7 req-5f9cc514-75a5-4aa6-bc8a-2a808f58e387 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:47.628282 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aeb78410-40da-4049-aad5-26c5903c39a7 req-5f9cc514-75a5-4aa6-bc8a-2a808f58e387 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 945 time: 0.1339042 Dec 09 21:36:47.655675 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3a5b61d-8d7d-4fe6-826d-afe910682cbe tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:47.676315 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 028345f8-c21b-4afa-a015-34707fd8ba09 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:36:47.733839 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d3a5b61d-8d7d-4fe6-826d-afe910682cbe tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] vlan segment allocate from pool success with {'vlan_id': 138, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:36:47.756369 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3a5b61d-8d7d-4fe6-826d-afe910682cbe tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:47.756848 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-d3a5b61d-8d7d-4fe6-826d-afe910682cbe tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Added segment 1a7691d2-0b69-4d0d-82be-5dd10b8f2227 of type vlan for network 798bf9a7-5407-4015-bd1b-58dc2ed1c248 Dec 09 21:36:47.767407 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3a5b61d-8d7d-4fe6-826d-afe910682cbe tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3a91512e-744a-42da-bfc2-e5247ea8870d,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:47.779350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aeb78410-40da-4049-aad5-26c5903c39a7 req-2e5ffc5d-eb29-4b4d-9583-27e203cc3688 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1501472 Dec 09 21:36:47.785280 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 028345f8-c21b-4afa-a015-34707fd8ba09 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:47.785917 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:47.827939 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3a5b61d-8d7d-4fe6-826d-afe910682cbe tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:47.862402 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3a5b61d-8d7d-4fe6-826d-afe910682cbe tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:47.869364 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d3a5b61d-8d7d-4fe6-826d-afe910682cbe tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:47.878475 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3a5b61d-8d7d-4fe6-826d-afe910682cbe tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:47.927710 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:47.949822 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d3a5b61d-8d7d-4fe6-826d-afe910682cbe tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 791 time: 0.6304474 Dec 09 21:36:47.951409 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53328) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:47.958262 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-5dfa227b-1b9e-46c2-851e-333880eed500 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Request body: {'subnet': {'network_id': '798bf9a7-5407-4015-bd1b-58dc2ed1c248', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:47.986282 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cbee2951-c573-41f4-8f85-c7c77ec3d8d6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '028345f8-c21b-4afa-a015-34707fd8ba09'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:36:47.994391 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aae68252-b04d-4732-9c48-e5306ffa8251" -d '{"events": [{"server_uuid": "cbee2951-c573-41f4-8f85-c7c77ec3d8d6", "name": "network-vif-plugged", "status": "completed", "tag": "028345f8-c21b-4afa-a015-34707fd8ba09"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:36:48.008955 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3a5b61d-8d7d-4fe6-826d-afe910682cbe tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Pushing event updated for resources: {'Network': ['ID=798bf9a7-5407-4015-bd1b-58dc2ed1c248,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:48.023706 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 798bf9a7-5407-4015-bd1b-58dc2ed1c248 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:36:48.102921 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:36:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-01a7585b-56e0-4edf-94ff-e7be28aa36af x-openstack-request-id: req-01a7585b-56e0-4edf-94ff-e7be28aa36af {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:36:48.103543 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cbee2951-c573-41f4-8f85-c7c77ec3d8d6", "name": "network-vif-plugged", "status": "completed", "tag": "028345f8-c21b-4afa-a015-34707fd8ba09", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:36:48.103984 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-01a7585b-56e0-4edf-94ff-e7be28aa36af {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:36:48.104548 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cbee2951-c573-41f4-8f85-c7c77ec3d8d6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '028345f8-c21b-4afa-a015-34707fd8ba09', 'code': 200} Dec 09 21:36:48.105119 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5dfa227b-1b9e-46c2-851e-333880eed500 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Made reservation on behalf of 5063643820ef4888b4eb80cecf86fa5d for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:36:48.110215 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 028345f8-c21b-4afa-a015-34707fd8ba09, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=028345f8-c21b-4afa-a015-34707fd8ba09,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:48.112916 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5dfa227b-1b9e-46c2-851e-333880eed500 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:48.117423 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:48.207301 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=028345f8-c21b-4afa-a015-34707fd8ba09,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:48.352695 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5dfa227b-1b9e-46c2-851e-333880eed500 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:48.428479 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dfa227b-1b9e-46c2-851e-333880eed500 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Pushing event updated for resources: {'Subnet': ['ID=ab90c6cf-fa45-489b-981e-c2e76fab0296,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:48.437332 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5dfa227b-1b9e-46c2-851e-333880eed500 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Checking segment: {'id': '1a7691d2-0b69-4d0d-82be-5dd10b8f2227', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '798bf9a7-5407-4015-bd1b-58dc2ed1c248'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:36:48.437807 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5dfa227b-1b9e-46c2-851e-333880eed500 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Network hostable DHCP agents. Network: 798bf9a7-5407-4015-bd1b-58dc2ed1c248, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:36:48.461988 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5dfa227b-1b9e-46c2-851e-333880eed500 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Network 798bf9a7-5407-4015-bd1b-58dc2ed1c248 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:36:48.481537 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-5dfa227b-1b9e-46c2-851e-333880eed500 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 798bf9a7-5407-4015-bd1b-58dc2ed1c248) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:48.490671 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ee1a3b28-1300-4ff2-af84-401c3756f7bc None None] Network 798bf9a7-5407-4015-bd1b-58dc2ed1c248 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:48.497374 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5dfa227b-1b9e-46c2-851e-333880eed500 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:48.498648 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5dfa227b-1b9e-46c2-851e-333880eed500 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:48.531627 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5dfa227b-1b9e-46c2-851e-333880eed500 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.5783441 Dec 09 21:36:48.534413 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53338) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:48.541084 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-3e44879c-d975-4794-aa06-76cb7689af74 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Request body: {'router': {'name': 'tempest-FloatingIPAdminTestJSON-router-1182954618', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}, 'admin_state_up': False}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:48.578445 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e44879c-d975-4794-aa06-76cb7689af74 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:48.582076 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e44879c-d975-4794-aa06-76cb7689af74 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:48.650512 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e09d160b-fff7-47a5-9eef-f325ed60b8b3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-798bf9a7-5407-4015-bd1b-58dc2ed1c248', 'network_id': '798bf9a7-5407-4015-bd1b-58dc2ed1c248', 'project_id': '5063643820ef4888b4eb80cecf86fa5d', 'fixed_ips': [{'subnet_id': 'ab90c6cf-fa45-489b-981e-c2e76fab0296'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:36:48.653541 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e09d160b-fff7-47a5-9eef-f325ed60b8b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:48.657007 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e44879c-d975-4794-aa06-76cb7689af74 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:48.848050 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-e09d160b-fff7-47a5-9eef-f325ed60b8b3 None None] Allocated IP 172.20.0.2 (798bf9a7-5407-4015-bd1b-58dc2ed1c248/ab90c6cf-fa45-489b-981e-c2e76fab0296/e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:36:48.860599 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e44879c-d975-4794-aa06-76cb7689af74 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:49.077750 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e09d160b-fff7-47a5-9eef-f325ed60b8b3 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:49.086986 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-986fa139-a1f7-477d-9ee1-7a4a631f5c28 req-b4148cf5-38e6-421c-b161-d4310dacdd25 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:49.089060 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e09d160b-fff7-47a5-9eef-f325ed60b8b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:49.100011 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-986fa139-a1f7-477d-9ee1-7a4a631f5c28 req-b4148cf5-38e6-421c-b161-d4310dacdd25 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 946 time: 0.1099141 Dec 09 21:36:49.139493 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e09d160b-fff7-47a5-9eef-f325ed60b8b3 None None] Network 798bf9a7-5407-4015-bd1b-58dc2ed1c248 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:36:49.143185 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-e09d160b-fff7-47a5-9eef-f325ed60b8b3 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:49.147816 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e09d160b-fff7-47a5-9eef-f325ed60b8b3 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:36:49.162054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e09d160b-fff7-47a5-9eef-f325ed60b8b3 None None] Pushing event updated for resources: {'Port': ['ID=e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:49.204019 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-986fa139-a1f7-477d-9ee1-7a4a631f5c28 req-bf78d821-bb37-45f9-9e3b-88f48a10d233 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0998652 Dec 09 21:36:49.234301 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e09d160b-fff7-47a5-9eef-f325ed60b8b3 None None] Attempting to bind port e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:36:49.234767 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e09d160b-fff7-47a5-9eef-f325ed60b8b3 None None] Attempting to bind port e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '1a7691d2-0b69-4d0d-82be-5dd10b8f2227', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '798bf9a7-5407-4015-bd1b-58dc2ed1c248'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:36:49.235206 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e09d160b-fff7-47a5-9eef-f325ed60b8b3 None None] Attempting to bind port e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3 on network 798bf9a7-5407-4015-bd1b-58dc2ed1c248 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:36:49.241024 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e09d160b-fff7-47a5-9eef-f325ed60b8b3 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 36, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:36:49.241474 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e09d160b-fff7-47a5-9eef-f325ed60b8b3 None None] Checking segment: {'id': '1a7691d2-0b69-4d0d-82be-5dd10b8f2227', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '798bf9a7-5407-4015-bd1b-58dc2ed1c248'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:36:49.242224 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e09d160b-fff7-47a5-9eef-f325ed60b8b3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:49.242645 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e09d160b-fff7-47a5-9eef-f325ed60b8b3 None None] Bound using segment: {'id': '1a7691d2-0b69-4d0d-82be-5dd10b8f2227', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '798bf9a7-5407-4015-bd1b-58dc2ed1c248'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:36:49.243194 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e09d160b-fff7-47a5-9eef-f325ed60b8b3 None None] Bound port: e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1a7691d2-0b69-4d0d-82be-5dd10b8f2227', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': '798bf9a7-5407-4015-bd1b-58dc2ed1c248'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:36:49.243720 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e09d160b-fff7-47a5-9eef-f325ed60b8b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:49.244352 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53352) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:49.285011 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e44879c-d975-4794-aa06-76cb7689af74 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:49.308640 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e44879c-d975-4794-aa06-76cb7689af74 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:49.321110 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e09d160b-fff7-47a5-9eef-f325ed60b8b3 None None] For port e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:36:49.325565 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e09d160b-fff7-47a5-9eef-f325ed60b8b3 None None] For port e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3,segment=NetworkSegment(1a7691d2-0b69-4d0d-82be-5dd10b8f2227),segment_id=1a7691d2-0b69-4d0d-82be-5dd10b8f2227)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:36:49.332548 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e09d160b-fff7-47a5-9eef-f325ed60b8b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:49.407536 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-caf26014-fd2f-49fa-bf90-1748bbf8c830 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:49.407973 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e09d160b-fff7-47a5-9eef-f325ed60b8b3 None None] Pushing event updated for resources: {'Port': ['ID=e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:49.468348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-3e44879c-d975-4794-aa06-76cb7689af74 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Allocated IP 172.25.3.149 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/bddf7394-37b8-4c2b-9bb2-6ff772f3e456) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:36:49.537355 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-caf26014-fd2f-49fa-bf90-1748bbf8c830 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:49.543483 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-caf26014-fd2f-49fa-bf90-1748bbf8c830 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:49.598309 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-caf26014-fd2f-49fa-bf90-1748bbf8c830 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e286e29f2a9f44208690821bab0c09fd&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3528306 Dec 09 21:36:49.598993 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53356) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:49.601062 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-caf26014-fd2f-49fa-bf90-1748bbf8c830 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d9c3c8f9-4a8e-4bfd-a6af-3be022d5161d,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:49.641699 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e44879c-d975-4794-aa06-76cb7689af74 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:49.732127 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7fd8874-83f0-4661-a427-6d725d5b9d6e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:49.766726 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7fd8874-83f0-4661-a427-6d725d5b9d6e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:49.781146 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e44879c-d975-4794-aa06-76cb7689af74 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:49.852683 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7fd8874-83f0-4661-a427-6d725d5b9d6e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:49.855255 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7fd8874-83f0-4661-a427-6d725d5b9d6e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:49.855739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e44879c-d975-4794-aa06-76cb7689af74 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Pushing event updated for resources: {'Port': ['ID=bddf7394-37b8-4c2b-9bb2-6ff772f3e456,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:49.856630 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b7fd8874-83f0-4661-a427-6d725d5b9d6e admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/d9c3c8f9-4a8e-4bfd-a6af-3be022d5161d HTTP/1.1" status: 204 len: 168 time: 0.2565482 Dec 09 21:36:49.873344 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7fd8874-83f0-4661-a427-6d725d5b9d6e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d9c3c8f9-4a8e-4bfd-a6af-3be022d5161d,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:49.876465 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3e44879c-d975-4794-aa06-76cb7689af74 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:36:49.878111 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-3e44879c-d975-4794-aa06-76cb7689af74 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:49.880568 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e44879c-d975-4794-aa06-76cb7689af74 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:36:49.894876 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0e6837dc-27f5-418d-a929-c92a3714bb8d None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:36:49.975876 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:36:50.085520 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1efbb285-6074-4ea7-ae28-dffbd7ee8f03 None None] Provisioning complete for port bddf7394-37b8-4c2b-9bb2-6ff772f3e456 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:50.086040 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1efbb285-6074-4ea7-ae28-dffbd7ee8f03 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:50.187088 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:50.192824 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:50.200828 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-1efbb285-6074-4ea7-ae28-dffbd7ee8f03 None None] Port bddf7394-37b8-4c2b-9bb2-6ff772f3e456 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:36:50.236294 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e44879c-d975-4794-aa06-76cb7689af74 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:50.385595 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:50.393748 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53370) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:50.455300 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-90c56e11-ac58-41fd-be38-2410087ce295 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:50.463591 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3,segment=NetworkSegment(1a7691d2-0b69-4d0d-82be-5dd10b8f2227),segment_id=1a7691d2-0b69-4d0d-82be-5dd10b8f2227)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:36:50.475322 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:50.482782 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dde798d-6356-4fa2-9b2f-a4f94fb50b3f req-fd0679b9-3cbc-41e4-a5d8-bcd90fd5493c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:50.490878 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1dde798d-6356-4fa2-9b2f-a4f94fb50b3f req-fd0679b9-3cbc-41e4-a5d8-bcd90fd5493c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 946 time: 0.1406476 Dec 09 21:36:50.576269 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1dde798d-6356-4fa2-9b2f-a4f94fb50b3f req-28b37dde-d240-4d3a-a65e-5a51765eb9dc tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0843282 Dec 09 21:36:50.607962 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:50.682091 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-90c56e11-ac58-41fd-be38-2410087ce295 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:50.690660 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-90c56e11-ac58-41fd-be38-2410087ce295 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:50.734264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90c56e11-ac58-41fd-be38-2410087ce295 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cf40343c-c043-46f7-a21c-400716cc6fa9,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:50.756877 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-90c56e11-ac58-41fd-be38-2410087ce295 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=17cc0fe71b364f13bea60ea0ea1a4244&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3575654 Dec 09 21:36:50.759685 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53376) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:50.887072 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-507a3d0c-d38c-49a7-b93d-ec7a23684375 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:50.958785 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-507a3d0c-d38c-49a7-b93d-ec7a23684375 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:51.046475 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-507a3d0c-d38c-49a7-b93d-ec7a23684375 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:51.063999 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-507a3d0c-d38c-49a7-b93d-ec7a23684375 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:51.065703 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-507a3d0c-d38c-49a7-b93d-ec7a23684375 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/cf40343c-c043-46f7-a21c-400716cc6fa9 HTTP/1.1" status: 204 len: 168 time: 0.3050737 Dec 09 21:36:51.080782 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-507a3d0c-d38c-49a7-b93d-ec7a23684375 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cf40343c-c043-46f7-a21c-400716cc6fa9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:51.158851 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-efa95b01-60ea-45db-8b9a-402026f1ed94 None None] Network 798bf9a7-5407-4015-bd1b-58dc2ed1c248 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:36:51.275585 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4a712c3e-398d-4ad2-9643-37cd045e7810 None None] Provisioning complete for port e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:51.276364 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4a712c3e-398d-4ad2-9643-37cd045e7810 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:51.439395 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e44879c-d975-4794-aa06-76cb7689af74 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:51.692344 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3e44879c-d975-4794-aa06-76cb7689af74 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Router 65a7e817-a36b-4ed9-a7cc-e3f31939f4f0 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:36:51.793162 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-988a252f-db29-48c7-bef3-c23417a98b79 None None] Provisioning complete for port e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:51.795148 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-988a252f-db29-48c7-bef3-c23417a98b79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:51.857237 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:36:51.889144 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd01cd30-3c58-45e4-b184-a7c8ef3c2edc req-12986149-ec74-4287-a97f-ea0e7a1ecf97 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:51.892680 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fd01cd30-3c58-45e4-b184-a7c8ef3c2edc req-12986149-ec74-4287-a97f-ea0e7a1ecf97 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 946 time: 0.1613584 Dec 09 21:36:51.985015 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3e44879c-d975-4794-aa06-76cb7689af74 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:36:52.025701 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fd01cd30-3c58-45e4-b184-a7c8ef3c2edc req-883641ca-7f65-43d2-ae32-bbbcf94a9d00 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1187496 Dec 09 21:36:52.093284 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e44879c-d975-4794-aa06-76cb7689af74 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:52.107150 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53410) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:52.127160 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3e44879c-d975-4794-aa06-76cb7689af74 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 892 time: 3.5909908 Dec 09 21:36:52.150212 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35e6f1d4-6fd8-44c7-8d60-82b4682bb252 None None] Sync routers for ids ['65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:36:52.238842 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35e6f1d4-6fd8-44c7-8d60-82b4682bb252 None None] Routers {'65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:36:52.240276 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-35e6f1d4-6fd8-44c7-8d60-82b4682bb252 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:36:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:52.287915 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:52.288379 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:52.292166 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-35e6f1d4-6fd8-44c7-8d60-82b4682bb252 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:52.325096 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35e6f1d4-6fd8-44c7-8d60-82b4682bb252 None None] Routers {'65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:36:52.325732 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-35e6f1d4-6fd8-44c7-8d60-82b4682bb252 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:36:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:52.365828 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-35e6f1d4-6fd8-44c7-8d60-82b4682bb252 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:52.366478 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35e6f1d4-6fd8-44c7-8d60-82b4682bb252 None None] The sync data for ids ['65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:36:53.214345 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c22f64b5-4c78-4d44-a502-cdd1c9660126 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:53.298291 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f698eb46-3b4d-4399-8639-13b9f33c9c55 req-8d94e8d4-9a9f-43e2-88b0-dd95084020ee tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:53.305932 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f698eb46-3b4d-4399-8639-13b9f33c9c55 req-8d94e8d4-9a9f-43e2-88b0-dd95084020ee tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 946 time: 0.1855881 Dec 09 21:36:53.414120 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f698eb46-3b4d-4399-8639-13b9f33c9c55 req-66230167-d079-4a57-a1de-f15a1830e03c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1028185 Dec 09 21:36:53.704367 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-c22f64b5-4c78-4d44-a502-cdd1c9660126 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Allocated IP 172.20.0.1 (798bf9a7-5407-4015-bd1b-58dc2ed1c248/ab90c6cf-fa45-489b-981e-c2e76fab0296/872886d4-5e73-4bf7-a9e3-bc448f93ad28) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:36:53.891113 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c22f64b5-4c78-4d44-a502-cdd1c9660126 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:53.940551 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c22f64b5-4c78-4d44-a502-cdd1c9660126 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:53.989523 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c22f64b5-4c78-4d44-a502-cdd1c9660126 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Network 798bf9a7-5407-4015-bd1b-58dc2ed1c248 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:36:53.993120 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-c22f64b5-4c78-4d44-a502-cdd1c9660126 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:53.999582 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c22f64b5-4c78-4d44-a502-cdd1c9660126 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:36:54.006242 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c22f64b5-4c78-4d44-a502-cdd1c9660126 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Pushing event updated for resources: {'Port': ['ID=872886d4-5e73-4bf7-a9e3-bc448f93ad28,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:54.073780 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c22f64b5-4c78-4d44-a502-cdd1c9660126 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:54.297909 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c22f64b5-4c78-4d44-a502-cdd1c9660126 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:54.409887 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-299892bd-bb21-44a1-bf2a-840c4a06877b None None] Provisioning complete for port 872886d4-5e73-4bf7-a9e3-bc448f93ad28 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:54.411918 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-299892bd-bb21-44a1-bf2a-840c4a06877b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:54.511825 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-299892bd-bb21-44a1-bf2a-840c4a06877b None None] Port 872886d4-5e73-4bf7-a9e3-bc448f93ad28 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:36:54.643620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b37492e5-e33b-4b4a-bd3a-4e188566b3c7 req-c39df4b3-40b4-49fb-bf94-c55270339d47 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:54.651657 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b37492e5-e33b-4b4a-bd3a-4e188566b3c7 req-c39df4b3-40b4-49fb-bf94-c55270339d47 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 946 time: 0.0932171 Dec 09 21:36:54.754347 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b37492e5-e33b-4b4a-bd3a-4e188566b3c7 req-7f623135-bba8-444b-9685-93b19e31c272 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1017075 Dec 09 21:36:54.832429 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c22f64b5-4c78-4d44-a502-cdd1c9660126 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:54.843377 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c22f64b5-4c78-4d44-a502-cdd1c9660126 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:55.027649 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c22f64b5-4c78-4d44-a502-cdd1c9660126 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Pushing event updated for resources: {'Port': ['ID=872886d4-5e73-4bf7-a9e3-bc448f93ad28,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:55.047408 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c22f64b5-4c78-4d44-a502-cdd1c9660126 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:55.232202 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c22f64b5-4c78-4d44-a502-cdd1c9660126 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Network 798bf9a7-5407-4015-bd1b-58dc2ed1c248 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:36:55.233779 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-c22f64b5-4c78-4d44-a502-cdd1c9660126 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:55.526379 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c22f64b5-4c78-4d44-a502-cdd1c9660126 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Router 65a7e817-a36b-4ed9-a7cc-e3f31939f4f0 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:36:55.654279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-46dbf181-7347-481e-9235-1513df6f474d None None] Provisioning complete for port 872886d4-5e73-4bf7-a9e3-bc448f93ad28 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:55.654838 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-46dbf181-7347-481e-9235-1513df6f474d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:55.700438 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-46dbf181-7347-481e-9235-1513df6f474d None None] Port 872886d4-5e73-4bf7-a9e3-bc448f93ad28 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:36:55.711752 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c22f64b5-4c78-4d44-a502-cdd1c9660126 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:36:55.717638 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c22f64b5-4c78-4d44-a502-cdd1c9660126 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] 10.222.0.13 "PUT /v2.0/routers/65a7e817-a36b-4ed9-a7cc-e3f31939f4f0/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.6164792 Dec 09 21:36:55.720166 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53510) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:55.726660 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Request body: {'port': {'network_id': '798bf9a7-5407-4015-bd1b-58dc2ed1c248', 'name': 'tempest-FloatingIPAdminTestJSON-970221759'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:55.732137 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26505d60-49db-4184-b80f-4330eb3273d9 None None] Sync routers for ids ['65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:36:55.749703 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26505d60-49db-4184-b80f-4330eb3273d9 None None] Routers {'65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:36:55.750346 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-26505d60-49db-4184-b80f-4330eb3273d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:36:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:55.840073 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-26505d60-49db-4184-b80f-4330eb3273d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:55.872491 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26505d60-49db-4184-b80f-4330eb3273d9 None None] Routers {'65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:36:55.873582 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-26505d60-49db-4184-b80f-4330eb3273d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:36:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:55.953645 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Made reservation on behalf of 5063643820ef4888b4eb80cecf86fa5d for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:36:55.957609 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-26505d60-49db-4184-b80f-4330eb3273d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:36:55.957787 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:55.958956 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-26505d60-49db-4184-b80f-4330eb3273d9 None None] The sync data for ids ['65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:36:55.999175 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] device_id is not set on port 6c0c567c-4049-4321-9e9f-9495ddb75533 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:36:56.007632 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7757400-828c-4c9d-9df0-d1c54176a97a req-1282bbb5-d65d-4191-807f-91ab9abac8ed tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:56.009584 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7757400-828c-4c9d-9df0-d1c54176a97a req-1282bbb5-d65d-4191-807f-91ab9abac8ed tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 946 time: 0.1153517 Dec 09 21:36:56.071551 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7757400-828c-4c9d-9df0-d1c54176a97a req-a73a1865-9a6e-40a7-8d29-eeedc9f77a7e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0555704 Dec 09 21:36:56.212434 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Allocated IP 172.20.0.14 (798bf9a7-5407-4015-bd1b-58dc2ed1c248/ab90c6cf-fa45-489b-981e-c2e76fab0296/6c0c567c-4049-4321-9e9f-9495ddb75533) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:36:56.495096 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:56.539137 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:56.608861 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Network 798bf9a7-5407-4015-bd1b-58dc2ed1c248 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:36:56.612340 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:56.616344 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:36:56.649601 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Pushing event updated for resources: {'Port': ['ID=6c0c567c-4049-4321-9e9f-9495ddb75533,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:56.665782 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:36:56.666348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:36:56.666895 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:36:56.667513 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:36:56.668115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:36:56.668793 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:36:56.669331 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:36:56.669916 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:36:56.670530 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:36:56.671227 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:36:56.678927 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:36:56.679429 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:36:56.679968 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:36:56.707755 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:56.708598 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:56.762828 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2c87d5d2-d3bc-45e6-b224-003eef05abb3 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0403059 Dec 09 21:36:56.775388 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53540) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:36:57.037913 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-19900508-867e-4344-9757-b6e02d208478 None None] Provisioning complete for port 6c0c567c-4049-4321-9e9f-9495ddb75533 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:36:57.038496 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-19900508-867e-4344-9757-b6e02d208478 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:57.079290 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-19900508-867e-4344-9757-b6e02d208478 None None] Port 6c0c567c-4049-4321-9e9f-9495ddb75533 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:36:57.209724 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a142e1d6-2ee0-422d-ba43-096d62a4ff5c tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'project_id': '5063643820ef4888b4eb80cecf86fa5d', 'port_id': '6c0c567c-4049-4321-9e9f-9495ddb75533'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:36:57.249321 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a142e1d6-2ee0-422d-ba43-096d62a4ff5c tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks [] for floatingip, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:57.282080 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:57.323641 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:57.345139 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47e12542-f5ab-490f-8eef-4b68f1a7c4bc req-91d1e954-95b9-46ff-b7e3-207af9dea11e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:57.347350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-47e12542-f5ab-490f-8eef-4b68f1a7c4bc req-91d1e954-95b9-46ff-b7e3-207af9dea11e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 946 time: 0.1316607 Dec 09 21:36:57.419914 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-47e12542-f5ab-490f-8eef-4b68f1a7c4bc req-4226ab20-aa25-447b-8fee-e0cc2f8aba99 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0650904 Dec 09 21:36:57.421025 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a142e1d6-2ee0-422d-ba43-096d62a4ff5c tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:57.740443 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-a142e1d6-2ee0-422d-ba43-096d62a4ff5c tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Allocated IP 172.25.3.165 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/61bc999a-8a47-4c8b-ac3b-644819a95800) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:36:57.895659 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a142e1d6-2ee0-422d-ba43-096d62a4ff5c tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:57.940166 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a142e1d6-2ee0-422d-ba43-096d62a4ff5c tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:57.985979 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a142e1d6-2ee0-422d-ba43-096d62a4ff5c tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:36:57.989692 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-a142e1d6-2ee0-422d-ba43-096d62a4ff5c tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:36:57.993431 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a142e1d6-2ee0-422d-ba43-096d62a4ff5c tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:36:58.025519 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a142e1d6-2ee0-422d-ba43-096d62a4ff5c tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Pushing event updated for resources: {'Port': ['ID=61bc999a-8a47-4c8b-ac3b-644819a95800,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:58.073058 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:36:58.699779 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a142e1d6-2ee0-422d-ba43-096d62a4ff5c tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks [] for floatingip, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:58.733175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c164cec-7ec5-4cc8-b138-fd1b8b8b19a0 req-ad3c0da1-c03c-41e1-af10-d9ec1925919f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:36:58.736855 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1c164cec-7ec5-4cc8-b138-fd1b8b8b19a0 req-ad3c0da1-c03c-41e1-af10-d9ec1925919f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 946 time: 0.1517701 Dec 09 21:36:58.864571 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a142e1d6-2ee0-422d-ba43-096d62a4ff5c tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:58.890517 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1c164cec-7ec5-4cc8-b138-fd1b8b8b19a0 req-807786bb-0e0b-435e-9548-f2beb8238d56 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1308405 Dec 09 21:36:59.306769 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a142e1d6-2ee0-422d-ba43-096d62a4ff5c tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:59.316216 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a142e1d6-2ee0-422d-ba43-096d62a4ff5c tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:59.504268 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a142e1d6-2ee0-422d-ba43-096d62a4ff5c tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Pushing event updated for resources: {'Port': ['ID=61bc999a-8a47-4c8b-ac3b-644819a95800,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:36:59.520217 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a142e1d6-2ee0-422d-ba43-096d62a4ff5c tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:36:59.647846 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-a142e1d6-2ee0-422d-ba43-096d62a4ff5c tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Floating IP 169886ad-df51-4c7b-ac24-a84ad5c58984 associated. External IP: 172.25.3.165, port: 6c0c567c-4049-4321-9e9f-9495ddb75533. Dec 09 21:36:59.955404 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a142e1d6-2ee0-422d-ba43-096d62a4ff5c tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Router 65a7e817-a36b-4ed9-a7cc-e3f31939f4f0 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:37:00.096459 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a49b6a4-1240-4f82-bdb5-4483a900bb66 req-2c5c4d1a-cccc-474a-8acb-41f43533c131 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:00.099773 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a49b6a4-1240-4f82-bdb5-4483a900bb66 req-2c5c4d1a-cccc-474a-8acb-41f43533c131 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 946 time: 0.0938785 Dec 09 21:37:00.121882 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a142e1d6-2ee0-422d-ba43-096d62a4ff5c tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:37:00.130415 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f8e32de-81cc-4530-b143-cf72c81202b5 None None] Sync routers for ids ['65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:37:00.145319 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f8e32de-81cc-4530-b143-cf72c81202b5 None None] Routers {'65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:37:00.146526 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5f8e32de-81cc-4530-b143-cf72c81202b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:36:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:00.149915 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a142e1d6-2ee0-422d-ba43-096d62a4ff5c tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:00.207429 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a142e1d6-2ee0-422d-ba43-096d62a4ff5c tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 988 time: 3.4307973 Dec 09 21:37:00.210073 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53710) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:00.218395 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5f8e32de-81cc-4530-b143-cf72c81202b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:00.227877 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a49b6a4-1240-4f82-bdb5-4483a900bb66 req-a19c7af4-0e24-4120-8054-cb7a92efb0fc tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1151779 Dec 09 21:37:00.240899 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f8e32de-81cc-4530-b143-cf72c81202b5 None None] Routers {'65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:37:00.241947 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5f8e32de-81cc-4530-b143-cf72c81202b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:36:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:00.387773 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53716) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:00.398623 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7af3974b-7f2d-4ee9-8ff9-f621108152f6 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] 10.222.0.13 "GET /v2.0/floatingips/169886ad-df51-4c7b-ac24-a84ad5c58984 HTTP/1.1" status: 200 len: 983 time: 0.1866832 Dec 09 21:37:00.399351 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53720) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:00.571630 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5f8e32de-81cc-4530-b143-cf72c81202b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:00.573330 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f8e32de-81cc-4530-b143-cf72c81202b5 None None] The sync data for ids ['65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:37:00.614585 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e89ee2fc-ae95-4171-9f31-5488c2b96d05 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:00.640142 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2becfd9f-fdc8-40aa-aae4-6d71fe30f0d7 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] 10.222.0.13 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 4606 time: 0.2306056 Dec 09 21:37:00.641791 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53724) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:00.726030 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e89ee2fc-ae95-4171-9f31-5488c2b96d05 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:00.740723 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e89ee2fc-ae95-4171-9f31-5488c2b96d05 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:00.808835 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e89ee2fc-ae95-4171-9f31-5488c2b96d05 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ff8c990d164b45748aeec53a13ae5a78&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4197366 Dec 09 21:37:00.810332 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e89ee2fc-ae95-4171-9f31-5488c2b96d05 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c7d841e-484d-4eb9-ae98-25cb68781d70,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:00.810554 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53726) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:00.823976 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ee2fc-ae95-4171-9f31-5488c2b96d05 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:00.824823 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ee2fc-ae95-4171-9f31-5488c2b96d05 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:00.825384 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ee2fc-ae95-4171-9f31-5488c2b96d05 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:00.826133 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ee2fc-ae95-4171-9f31-5488c2b96d05 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:00.827257 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ee2fc-ae95-4171-9f31-5488c2b96d05 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:00.827831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ee2fc-ae95-4171-9f31-5488c2b96d05 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:00.828621 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ee2fc-ae95-4171-9f31-5488c2b96d05 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:00.829167 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ee2fc-ae95-4171-9f31-5488c2b96d05 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:00.829843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ee2fc-ae95-4171-9f31-5488c2b96d05 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:00.830408 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ee2fc-ae95-4171-9f31-5488c2b96d05 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:00.830951 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ee2fc-ae95-4171-9f31-5488c2b96d05 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:00.836148 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ee2fc-ae95-4171-9f31-5488c2b96d05 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:00.838748 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e89ee2fc-ae95-4171-9f31-5488c2b96d05 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:00.915035 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93bdd0ae-cbfe-4f62-8059-1ff8a0c605d3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:00.917972 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-3690ffef-fab7-4fdf-8e32-4b3a652c20a0 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Deleting port 61bc999a-8a47-4c8b-ac3b-644819a95800 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:37:00.918286 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3690ffef-fab7-4fdf-8e32-4b3a652c20a0 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:00.973326 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93bdd0ae-cbfe-4f62-8059-1ff8a0c605d3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:01.066758 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3690ffef-fab7-4fdf-8e32-4b3a652c20a0 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:01.067204 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3690ffef-fab7-4fdf-8e32-4b3a652c20a0 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:01.097295 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-3690ffef-fab7-4fdf-8e32-4b3a652c20a0 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Calling delete_port for 61bc999a-8a47-4c8b-ac3b-644819a95800 owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:37:01.119772 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93bdd0ae-cbfe-4f62-8059-1ff8a0c605d3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:01.125071 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93bdd0ae-cbfe-4f62-8059-1ff8a0c605d3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:01.128712 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-93bdd0ae-cbfe-4f62-8059-1ff8a0c605d3 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/5c7d841e-484d-4eb9-ae98-25cb68781d70 HTTP/1.1" status: 204 len: 168 time: 0.3146243 Dec 09 21:37:01.397887 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1ddf5a6-b8a4-4ce8-ac00-3727bf686616 req-f6664dfa-3078-4c39-b5c7-6fc7d83a8b98 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:01.409999 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f1ddf5a6-b8a4-4ce8-ac00-3727bf686616 req-f6664dfa-3078-4c39-b5c7-6fc7d83a8b98 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 946 time: 0.0896862 Dec 09 21:37:01.502290 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f1ddf5a6-b8a4-4ce8-ac00-3727bf686616 req-3074d087-791d-45df-80cd-43126fc2677e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0904741 Dec 09 21:37:01.650273 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53748) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:01.665620 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-63a3b496-d78d-478e-bd0a-bd3f2148d073 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:01.831832 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-63a3b496-d78d-478e-bd0a-bd3f2148d073 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:01.838155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93bdd0ae-cbfe-4f62-8059-1ff8a0c605d3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c7d841e-484d-4eb9-ae98-25cb68781d70,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:01.840484 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-63a3b496-d78d-478e-bd0a-bd3f2148d073 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:01.891693 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3690ffef-fab7-4fdf-8e32-4b3a652c20a0 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:01.925454 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-63a3b496-d78d-478e-bd0a-bd3f2148d073 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=1d9dea5568bd409583b96aa2849e08e5&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2727056 Dec 09 21:37:01.926205 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53750) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:01.926856 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63a3b496-d78d-478e-bd0a-bd3f2148d073 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=186ad63c-f9cf-49a0-b87a-979da9574d0b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:01.967620 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3690ffef-fab7-4fdf-8e32-4b3a652c20a0 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Pushing event deleted for resources: {'Port': ['ID=61bc999a-8a47-4c8b-ac3b-644819a95800,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:02.030594 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3690ffef-fab7-4fdf-8e32-4b3a652c20a0 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:02.030935 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-3690ffef-fab7-4fdf-8e32-4b3a652c20a0 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Floating IP 169886ad-df51-4c7b-ac24-a84ad5c58984 disassociated (deleted). External IP: 172.25.3.165, port: 6c0c567c-4049-4321-9e9f-9495ddb75533. Dec 09 21:37:02.032016 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4f081d6d-cd59-4c29-b718-32d88b686114 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:02.066109 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4f081d6d-cd59-4c29-b718-32d88b686114 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:02.163604 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4f081d6d-cd59-4c29-b718-32d88b686114 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:02.179075 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4f081d6d-cd59-4c29-b718-32d88b686114 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:02.179075 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4f081d6d-cd59-4c29-b718-32d88b686114 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/186ad63c-f9cf-49a0-b87a-979da9574d0b HTTP/1.1" status: 204 len: 168 time: 0.2465353 Dec 09 21:37:02.227854 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f081d6d-cd59-4c29-b718-32d88b686114 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=186ad63c-f9cf-49a0-b87a-979da9574d0b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:02.481154 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3690ffef-fab7-4fdf-8e32-4b3a652c20a0 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Router 65a7e817-a36b-4ed9-a7cc-e3f31939f4f0 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:37:02.664237 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51cae816-254f-4b6c-a11e-1cccdbfec2e0 req-4ff683cb-b723-4c85-9543-36842f503e4a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:02.672271 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51cae816-254f-4b6c-a11e-1cccdbfec2e0 req-4ff683cb-b723-4c85-9543-36842f503e4a tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 946 time: 0.0624769 Dec 09 21:37:02.709126 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3690ffef-fab7-4fdf-8e32-4b3a652c20a0 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:37:02.722951 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90e4b5b0-918c-4c47-b33d-6f931e6760ff None None] Sync routers for ids ['65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:37:02.724798 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3690ffef-fab7-4fdf-8e32-4b3a652c20a0 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:02.734451 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51cae816-254f-4b6c-a11e-1cccdbfec2e0 req-5cae37bd-c257-4958-a9aa-0fe26c91dd60 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0586457 Dec 09 21:37:02.753576 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90e4b5b0-918c-4c47-b33d-6f931e6760ff None None] Routers {'65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:37:02.755998 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-90e4b5b0-918c-4c47-b33d-6f931e6760ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:36:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:02.773086 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3690ffef-fab7-4fdf-8e32-4b3a652c20a0 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] 10.222.0.13 "DELETE /v2.0/floatingips/169886ad-df51-4c7b-ac24-a84ad5c58984 HTTP/1.1" status: 204 len: 168 time: 2.1293721 Dec 09 21:37:02.776617 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53778) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:02.781146 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-12c85e59-aea9-4b2d-b518-a349494f7798 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:02.817700 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-12c85e59-aea9-4b2d-b518-a349494f7798 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:02.840362 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-90e4b5b0-918c-4c47-b33d-6f931e6760ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:02.854820 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90e4b5b0-918c-4c47-b33d-6f931e6760ff None None] Routers {'65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:37:02.855462 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-90e4b5b0-918c-4c47-b33d-6f931e6760ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:36:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:02.899114 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-90e4b5b0-918c-4c47-b33d-6f931e6760ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:02.900143 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90e4b5b0-918c-4c47-b33d-6f931e6760ff None None] The sync data for ids ['65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:37:02.959322 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5b1c42fa-28d5-4722-91da-073cb7820066 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:03.004080 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-12c85e59-aea9-4b2d-b518-a349494f7798 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:03.164397 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-12c85e59-aea9-4b2d-b518-a349494f7798 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Allocated IP 172.25.3.244 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/2720a6be-0f22-49d9-8d6a-8441596450c0) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:37:03.342011 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-12c85e59-aea9-4b2d-b518-a349494f7798 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:03.448164 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-12c85e59-aea9-4b2d-b518-a349494f7798 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:03.517995 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12c85e59-aea9-4b2d-b518-a349494f7798 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:37:03.548903 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-12c85e59-aea9-4b2d-b518-a349494f7798 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:37:03.562169 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12c85e59-aea9-4b2d-b518-a349494f7798 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:37:03.566528 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12c85e59-aea9-4b2d-b518-a349494f7798 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Pushing event updated for resources: {'Port': ['ID=2720a6be-0f22-49d9-8d6a-8441596450c0,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:03.679186 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-12c85e59-aea9-4b2d-b518-a349494f7798 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:03.782608 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-12c85e59-aea9-4b2d-b518-a349494f7798 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:03.996442 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33007081-2924-411f-9d27-6cb513d798a7 req-d05f4d6d-fca6-4521-af4c-0cecec856ab2 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:03.998517 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-33007081-2924-411f-9d27-6cb513d798a7 req-d05f4d6d-fca6-4521-af4c-0cecec856ab2 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 946 time: 0.1048799 Dec 09 21:37:04.083270 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-12c85e59-aea9-4b2d-b518-a349494f7798 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:04.088366 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-33007081-2924-411f-9d27-6cb513d798a7 req-0a8bf903-e085-4d7a-aa81-6257341453c1 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0809453 Dec 09 21:37:04.090009 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-12c85e59-aea9-4b2d-b518-a349494f7798 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:04.167107 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12c85e59-aea9-4b2d-b518-a349494f7798 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Pushing event updated for resources: {'Port': ['ID=2720a6be-0f22-49d9-8d6a-8441596450c0,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:04.184794 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-12c85e59-aea9-4b2d-b518-a349494f7798 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:04.204233 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-12c85e59-aea9-4b2d-b518-a349494f7798 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:04.205729 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-12c85e59-aea9-4b2d-b518-a349494f7798 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.4280956 Dec 09 21:37:04.209091 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53842) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:04.381646 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4a77610-fddc-4227-8982-58195313c636 req-87ec2acf-e95b-466a-8b48-9fb8bd96909c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:04.383893 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b4a77610-fddc-4227-8982-58195313c636 req-87ec2acf-e95b-466a-8b48-9fb8bd96909c service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 1098 time: 0.0573096 Dec 09 21:37:04.457789 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-3226ab57-6f5f-4bb9-bca4-f676ec50f091 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:04.497637 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3226ab57-6f5f-4bb9-bca4-f676ec50f091 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Publish callbacks [] for floatingip, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:04.522866 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4a77610-fddc-4227-8982-58195313c636 req-6c93e520-22e2-41fd-9f42-d34bf92e72ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:04.524671 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b4a77610-fddc-4227-8982-58195313c636 req-6c93e520-22e2-41fd-9f42-d34bf92e72ce service neutron] 10.222.0.10 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 913 time: 0.1323676 Dec 09 21:37:04.583850 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b4a77610-fddc-4227-8982-58195313c636 req-5cae56e3-b9c4-4bea-b46d-44d45ac77c95 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=028345f8-c21b-4afa-a015-34707fd8ba09 HTTP/1.1" status: 200 len: 217 time: 0.0483298 Dec 09 21:37:04.663773 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4a77610-fddc-4227-8982-58195313c636 req-1d2e294c-c215-434b-b1f9-5500d9c7ab13 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:04.665339 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b4a77610-fddc-4227-8982-58195313c636 req-1d2e294c-c215-434b-b1f9-5500d9c7ab13 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 200 len: 851 time: 0.0528460 Dec 09 21:37:04.727846 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4a77610-fddc-4227-8982-58195313c636 req-19af22f5-55e8-489f-9e6b-d40394cf5520 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:04.729466 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b4a77610-fddc-4227-8982-58195313c636 req-19af22f5-55e8-489f-9e6b-d40394cf5520 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0564902 Dec 09 21:37:04.781849 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3226ab57-6f5f-4bb9-bca4-f676ec50f091 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:04.899321 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b4a77610-fddc-4227-8982-58195313c636 req-85bc2d44-65d4-4d64-8f4c-aedac0605d18 service neutron] 10.222.0.10 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1590250 Dec 09 21:37:05.016867 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-3226ab57-6f5f-4bb9-bca4-f676ec50f091 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Allocated IP 172.25.3.129 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/19ec7afd-d578-435f-944f-0e903137e5db) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:37:05.068439 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b4a77610-fddc-4227-8982-58195313c636 req-1318c27b-3800-4ac8-8aca-5855cc4758d5 service neutron] 10.222.0.10 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1459968 Dec 09 21:37:05.179071 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3226ab57-6f5f-4bb9-bca4-f676ec50f091 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:05.225827 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3226ab57-6f5f-4bb9-bca4-f676ec50f091 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:05.275020 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3226ab57-6f5f-4bb9-bca4-f676ec50f091 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:37:05.296019 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09134431-4191-4bcf-a75b-1b7ddda45df8 req-56658464-7b8f-4151-b64c-e76853753b3f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:05.298747 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09134431-4191-4bcf-a75b-1b7ddda45df8 req-56658464-7b8f-4151-b64c-e76853753b3f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 946 time: 0.0914974 Dec 09 21:37:05.323503 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-3226ab57-6f5f-4bb9-bca4-f676ec50f091 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:37:05.334165 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3226ab57-6f5f-4bb9-bca4-f676ec50f091 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:37:05.361411 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09134431-4191-4bcf-a75b-1b7ddda45df8 req-2ca73748-d85c-46bd-913d-8b5b0f387730 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0553606 Dec 09 21:37:05.421736 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3226ab57-6f5f-4bb9-bca4-f676ec50f091 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Pushing event updated for resources: {'Port': ['ID=19ec7afd-d578-435f-944f-0e903137e5db,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:05.477090 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3226ab57-6f5f-4bb9-bca4-f676ec50f091 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:05.515558 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3226ab57-6f5f-4bb9-bca4-f676ec50f091 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:05.541500 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9c8c3d14-f49a-4b53-8271-958ffbba19e5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:05.716373 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3226ab57-6f5f-4bb9-bca4-f676ec50f091 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:05.721610 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3226ab57-6f5f-4bb9-bca4-f676ec50f091 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:05.808489 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3226ab57-6f5f-4bb9-bca4-f676ec50f091 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Pushing event updated for resources: {'Port': ['ID=19ec7afd-d578-435f-944f-0e903137e5db,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:05.814988 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3226ab57-6f5f-4bb9-bca4-f676ec50f091 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:05.840119 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3226ab57-6f5f-4bb9-bca4-f676ec50f091 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:05.841954 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3226ab57-6f5f-4bb9-bca4-f676ec50f091 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.6316261 Dec 09 21:37:05.844394 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53906) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:05.921941 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f53e82ef-3326-4426-b208-5eef60b9e10b tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] 10.222.0.13 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 4791 time: 0.0739410 Dec 09 21:37:05.922216 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53912) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:06.004319 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53914) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:06.004873 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4987bad1-d64c-4a5f-a571-aea25beaae3a tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] 10.222.0.13 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 690 time: 0.0808840 Dec 09 21:37:06.146493 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-99c29a74-567f-4a09-832e-c8d56c688d75 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Deleting port 19ec7afd-d578-435f-944f-0e903137e5db {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:37:06.147331 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99c29a74-567f-4a09-832e-c8d56c688d75 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:06.235347 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99c29a74-567f-4a09-832e-c8d56c688d75 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:06.235700 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99c29a74-567f-4a09-832e-c8d56c688d75 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:06.248068 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-99c29a74-567f-4a09-832e-c8d56c688d75 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Calling delete_port for 19ec7afd-d578-435f-944f-0e903137e5db owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:37:06.419908 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99c29a74-567f-4a09-832e-c8d56c688d75 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:06.465346 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99c29a74-567f-4a09-832e-c8d56c688d75 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Pushing event deleted for resources: {'Port': ['ID=19ec7afd-d578-435f-944f-0e903137e5db,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:06.594645 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99c29a74-567f-4a09-832e-c8d56c688d75 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:06.597755 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99c29a74-567f-4a09-832e-c8d56c688d75 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:06.603168 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53940) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:06.606580 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:06.612256 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-99c29a74-567f-4a09-832e-c8d56c688d75 tempest-FloatingIPAdminTestJSON-1740174504 tempest-FloatingIPAdminTestJSON-1740174504-project] 10.222.0.13 "DELETE /v2.0/floatingips/a853165e-a9a1-4738-bca1-cddc7958afde HTTP/1.1" status: 204 len: 168 time: 0.6059928 Dec 09 21:37:06.656576 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d67bddd-7ddc-44a5-bebc-c032fddeda1c req-749381fc-7325-48a6-aac3-4a6c5db5d51e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:06.659063 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d67bddd-7ddc-44a5-bebc-c032fddeda1c req-749381fc-7325-48a6-aac3-4a6c5db5d51e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 946 time: 0.1427836 Dec 09 21:37:06.805077 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d67bddd-7ddc-44a5-bebc-c032fddeda1c req-e43dabb8-b00c-40d5-8aad-5c205badcd53 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1358485 Dec 09 21:37:06.835319 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-35c41816-e879-4582-b20c-2041e8ebded1 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Deleting port 2720a6be-0f22-49d9-8d6a-8441596450c0 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:37:06.835319 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-35c41816-e879-4582-b20c-2041e8ebded1 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:06.979401 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-35c41816-e879-4582-b20c-2041e8ebded1 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:06.979981 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-35c41816-e879-4582-b20c-2041e8ebded1 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:07.004969 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-35c41816-e879-4582-b20c-2041e8ebded1 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Calling delete_port for 2720a6be-0f22-49d9-8d6a-8441596450c0 owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:37:07.192990 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-35c41816-e879-4582-b20c-2041e8ebded1 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:07.229839 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35c41816-e879-4582-b20c-2041e8ebded1 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Pushing event deleted for resources: {'Port': ['ID=2720a6be-0f22-49d9-8d6a-8441596450c0,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:07.340727 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-35c41816-e879-4582-b20c-2041e8ebded1 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:07.345721 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-35c41816-e879-4582-b20c-2041e8ebded1 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:07.350946 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53954) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:07.354304 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-35c41816-e879-4582-b20c-2041e8ebded1 tempest-FloatingIPAdminTestJSON-1646246440 tempest-FloatingIPAdminTestJSON-1646246440-project-admin] 10.222.0.13 "DELETE /v2.0/floatingips/d4dd52a2-46c7-4f7b-a43a-391b6c77e2c2 HTTP/1.1" status: 204 len: 168 time: 0.7482004 Dec 09 21:37:07.463983 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-08748265-ca22-447b-80be-238d9114c80a tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Deleting port 6c0c567c-4049-4321-9e9f-9495ddb75533 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:37:07.464524 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-08748265-ca22-447b-80be-238d9114c80a tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:07.616455 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-08748265-ca22-447b-80be-238d9114c80a tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:07.651376 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-08748265-ca22-447b-80be-238d9114c80a tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Calling delete_port for 6c0c567c-4049-4321-9e9f-9495ddb75533 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:37:07.757546 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 028345f8-c21b-4afa-a015-34707fd8ba09 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:37:07.865035 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-08748265-ca22-447b-80be-238d9114c80a tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:07.967284 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:08.024813 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08748265-ca22-447b-80be-238d9114c80a tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Pushing event deleted for resources: {'Port': ['ID=6c0c567c-4049-4321-9e9f-9495ddb75533,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:08.090598 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cbee2951-c573-41f4-8f85-c7c77ec3d8d6', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '028345f8-c21b-4afa-a015-34707fd8ba09'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:37:08.093423 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dd9de1e3-2350-440a-b39f-35f8ec283613" -d '{"events": [{"server_uuid": "cbee2951-c573-41f4-8f85-c7c77ec3d8d6", "name": "network-vif-unplugged", "status": "completed", "tag": "028345f8-c21b-4afa-a015-34707fd8ba09"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:37:08.155271 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:08.169513 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 028345f8-c21b-4afa-a015-34707fd8ba09, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=028345f8-c21b-4afa-a015-34707fd8ba09,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:37:08.186009 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:08.198814 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Thu, 09 Dec 2021 21:37:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c813e9e0-1311-4df8-b692-e1cf32c01897 x-openstack-request-id: req-c813e9e0-1311-4df8-b692-e1cf32c01897 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:37:08.204788 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cbee2951-c573-41f4-8f85-c7c77ec3d8d6", "name": "network-vif-unplugged", "status": "failed", "tag": "028345f8-c21b-4afa-a015-34707fd8ba09", "code": 422}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:37:08.206604 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c813e9e0-1311-4df8-b692-e1cf32c01897 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:37:08.208227 n-d-713301-27 neutron-server[103439]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'cbee2951-c573-41f4-8f85-c7c77ec3d8d6', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '028345f8-c21b-4afa-a015-34707fd8ba09', 'code': 422} returned with failed status Dec 09 21:37:08.273424 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f47c719-6b07-42d6-8991-c5708565ad65 req-0b49169b-1c2e-476c-b03c-6e67baa98bee tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:08.276062 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1f47c719-6b07-42d6-8991-c5708565ad65 req-0b49169b-1c2e-476c-b03c-6e67baa98bee tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 946 time: 0.2088115 Dec 09 21:37:08.388815 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=028345f8-c21b-4afa-a015-34707fd8ba09,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:08.413963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:08.427706 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:08.428479 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:08.429304 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:08.430878 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:08.431963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:08.432327 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:08.432667 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:08.434026 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:08.434429 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:08.435100 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1f47c719-6b07-42d6-8991-c5708565ad65 req-d3bb1191-0d64-48a9-b088-38c749cd4ade tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1388760 Dec 09 21:37:08.439949 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:08.440703 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-08748265-ca22-447b-80be-238d9114c80a tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:08.441238 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:08.442567 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:08.459953 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53982) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:08.481482 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-08748265-ca22-447b-80be-238d9114c80a tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] 10.222.0.13 "DELETE /v2.0/ports/6c0c567c-4049-4321-9e9f-9495ddb75533 HTTP/1.1" status: 204 len: 168 time: 1.1178563 Dec 09 21:37:08.570728 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05a598c0-c716-417f-b065-c7a1c02064c0 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:08.580437 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53992) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:08.595272 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-05a598c0-c716-417f-b065-c7a1c02064c0 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] 10.222.0.13 "GET /v2.0/ports?device_id=65a7e817-a36b-4ed9-a7cc-e3f31939f4f0 HTTP/1.1" status: 200 len: 913 time: 0.1335149 Dec 09 21:37:08.761798 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22f2d95a-4d44-4064-8ce0-f23e5f7dd5f3 req-87df77a2-e536-47d0-aea7-86f6b51e053b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:08.768098 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22f2d95a-4d44-4064-8ce0-f23e5f7dd5f3 req-87df77a2-e536-47d0-aea7-86f6b51e053b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1248989 Dec 09 21:37:09.281316 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22f2d95a-4d44-4064-8ce0-f23e5f7dd5f3 req-5ed4d376-5d5c-4d5b-b16f-5aa03fa5081f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5114686 Dec 09 21:37:09.505321 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeb8059f-6de1-4083-a025-90f5b78dc7b3 req-5054100a-39a1-40e2-bc48-1edb17ab55d8 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:09.514609 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aeb8059f-6de1-4083-a025-90f5b78dc7b3 req-5054100a-39a1-40e2-bc48-1edb17ab55d8 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0796795 Dec 09 21:37:09.608893 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aeb8059f-6de1-4083-a025-90f5b78dc7b3 req-de0ae80d-8b42-4086-b3d3-69f8cd734290 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0933812 Dec 09 21:37:09.652037 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5837b5f8-6ce1-4127-a762-7b29ac66bb1d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:09.659228 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:09.951706 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83ee4a08-971a-42c0-9e2d-502de91153fd req-f9addd67-5bd0-41b6-9c88-61bc0687e0b5 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:09.953523 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83ee4a08-971a-42c0-9e2d-502de91153fd req-f9addd67-5bd0-41b6-9c88-61bc0687e0b5 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0926750 Dec 09 21:37:10.087560 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83ee4a08-971a-42c0-9e2d-502de91153fd req-3c25d51a-7f13-430a-acc4-814ffaf12326 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1235068 Dec 09 21:37:10.094031 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-5837b5f8-6ce1-4127-a762-7b29ac66bb1d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Deleting port 872886d4-5e73-4bf7-a9e3-bc448f93ad28 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:37:10.094657 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5837b5f8-6ce1-4127-a762-7b29ac66bb1d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:10.228412 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5837b5f8-6ce1-4127-a762-7b29ac66bb1d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:10.241951 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-5837b5f8-6ce1-4127-a762-7b29ac66bb1d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Calling delete_port for 872886d4-5e73-4bf7-a9e3-bc448f93ad28 owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:37:10.454555 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5837b5f8-6ce1-4127-a762-7b29ac66bb1d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:10.483616 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5837b5f8-6ce1-4127-a762-7b29ac66bb1d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Pushing event deleted for resources: {'Port': ['ID=872886d4-5e73-4bf7-a9e3-bc448f93ad28,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:10.650414 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54038) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:10.714941 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5837b5f8-6ce1-4127-a762-7b29ac66bb1d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:10.847406 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-63337148-f26d-4372-99bd-ab4fa23aa9bd admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:10.940733 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-63337148-f26d-4372-99bd-ab4fa23aa9bd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:10.946140 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-63337148-f26d-4372-99bd-ab4fa23aa9bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:10.973259 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5837b5f8-6ce1-4127-a762-7b29ac66bb1d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Router 65a7e817-a36b-4ed9-a7cc-e3f31939f4f0 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:37:10.998500 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63337148-f26d-4372-99bd-ab4fa23aa9bd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d1bea3b2-5d15-4dc7-bffc-5a2b56e9fe7f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:11.008658 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-63337148-f26d-4372-99bd-ab4fa23aa9bd admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=6ec0c8410a7b49998be16b63bedeefd5&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3570971 Dec 09 21:37:11.009319 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54042) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:11.063717 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c142ff01-8454-4219-8609-190f0ef3dd63 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:11.088113 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c142ff01-8454-4219-8609-190f0ef3dd63 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:11.100279 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5837b5f8-6ce1-4127-a762-7b29ac66bb1d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:37:11.108804 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5837b5f8-6ce1-4127-a762-7b29ac66bb1d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] 10.222.0.13 "PUT /v2.0/routers/65a7e817-a36b-4ed9-a7cc-e3f31939f4f0/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5245376 Dec 09 21:37:11.109098 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54044) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:11.111388 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-576d80bf-352b-4859-b10b-e64560ef2765 None None] Sync routers for ids ['65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:37:11.140608 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-576d80bf-352b-4859-b10b-e64560ef2765 None None] Routers {'65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:37:11.143528 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-576d80bf-352b-4859-b10b-e64560ef2765 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:37:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:11.160251 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c142ff01-8454-4219-8609-190f0ef3dd63 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:11.164345 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c142ff01-8454-4219-8609-190f0ef3dd63 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:11.170075 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c142ff01-8454-4219-8609-190f0ef3dd63 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/d1bea3b2-5d15-4dc7-bffc-5a2b56e9fe7f HTTP/1.1" status: 204 len: 168 time: 0.1590402 Dec 09 21:37:11.192122 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c142ff01-8454-4219-8609-190f0ef3dd63 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d1bea3b2-5d15-4dc7-bffc-5a2b56e9fe7f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:11.224122 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-576d80bf-352b-4859-b10b-e64560ef2765 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:11.258608 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-576d80bf-352b-4859-b10b-e64560ef2765 None None] Routers {'65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:37:11.259986 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-576d80bf-352b-4859-b10b-e64560ef2765 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:37:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:11.280368 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8906ed26-550b-48ae-a3b7-5fd6ed579b8d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:11.335947 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-576d80bf-352b-4859-b10b-e64560ef2765 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:11.337010 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-576d80bf-352b-4859-b10b-e64560ef2765 None None] The sync data for ids ['65a7e817-a36b-4ed9-a7cc-e3f31939f4f0'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:37:11.371365 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d0d5dc7-09f0-47d1-9989-7836aaa65b4c req-3ce00c0d-9047-454a-9dce-9617f1812928 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:11.373035 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7d0d5dc7-09f0-47d1-9989-7836aaa65b4c req-3ce00c0d-9047-454a-9dce-9617f1812928 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1123989 Dec 09 21:37:11.473395 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7d0d5dc7-09f0-47d1-9989-7836aaa65b4c req-5387d8ad-df74-4ca7-89b5-24eae3df2062 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0645502 Dec 09 21:37:11.486241 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8906ed26-550b-48ae-a3b7-5fd6ed579b8d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:11.552773 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-8906ed26-550b-48ae-a3b7-5fd6ed579b8d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Deleting port bddf7394-37b8-4c2b-9bb2-6ff772f3e456 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:37:11.553137 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8906ed26-550b-48ae-a3b7-5fd6ed579b8d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:11.621174 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54058) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:11.635705 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-277d7845-c105-4016-b601-b1f2ce518bc5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:11.662578 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8906ed26-550b-48ae-a3b7-5fd6ed579b8d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:11.690313 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-8906ed26-550b-48ae-a3b7-5fd6ed579b8d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Calling delete_port for bddf7394-37b8-4c2b-9bb2-6ff772f3e456 owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:37:11.765668 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-277d7845-c105-4016-b601-b1f2ce518bc5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:11.773682 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-277d7845-c105-4016-b601-b1f2ce518bc5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:11.815316 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-277d7845-c105-4016-b601-b1f2ce518bc5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=efe51c89-20e2-403e-8d19-f289fdf97147,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:11.868173 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-277d7845-c105-4016-b601-b1f2ce518bc5 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=30c047141bb84dae98f6e4dcae36b535&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2458680 Dec 09 21:37:11.869874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54060) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:11.886951 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8906ed26-550b-48ae-a3b7-5fd6ed579b8d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:11.915668 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2ba43d23-c2c3-435e-b427-b538017ba1fc None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:37:11.938106 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8906ed26-550b-48ae-a3b7-5fd6ed579b8d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Pushing event deleted for resources: {'Port': ['ID=bddf7394-37b8-4c2b-9bb2-6ff772f3e456,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:11.966442 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c8b581b-7508-46f2-b7e0-74aa02fa00d8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:11.994925 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c8b581b-7508-46f2-b7e0-74aa02fa00d8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:12.005075 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8906ed26-550b-48ae-a3b7-5fd6ed579b8d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:12.055564 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c8b581b-7508-46f2-b7e0-74aa02fa00d8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:12.058534 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c8b581b-7508-46f2-b7e0-74aa02fa00d8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:12.062692 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5c8b581b-7508-46f2-b7e0-74aa02fa00d8 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/efe51c89-20e2-403e-8d19-f289fdf97147 HTTP/1.1" status: 204 len: 168 time: 0.1915526 Dec 09 21:37:12.071011 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c8b581b-7508-46f2-b7e0-74aa02fa00d8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=efe51c89-20e2-403e-8d19-f289fdf97147,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:12.115247 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8906ed26-550b-48ae-a3b7-5fd6ed579b8d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:12.118426 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8906ed26-550b-48ae-a3b7-5fd6ed579b8d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:12.170483 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8906ed26-550b-48ae-a3b7-5fd6ed579b8d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:12.170976 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8906ed26-550b-48ae-a3b7-5fd6ed579b8d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Fanout notify agent at l3_agent the message router_deleted on router 65a7e817-a36b-4ed9-a7cc-e3f31939f4f0 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:37:12.184034 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8906ed26-550b-48ae-a3b7-5fd6ed579b8d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:12.187498 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8906ed26-550b-48ae-a3b7-5fd6ed579b8d tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] 10.222.0.13 "DELETE /v2.0/routers/65a7e817-a36b-4ed9-a7cc-e3f31939f4f0 HTTP/1.1" status: 204 len: 168 time: 1.0751059 Dec 09 21:37:12.188317 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54064) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:12.247540 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-57d2a1ee-d71b-42ea-8b6c-c40a3912b7d4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Deleting subnet ab90c6cf-fa45-489b-981e-c2e76fab0296 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:37:12.251037 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-57d2a1ee-d71b-42ea-8b6c-c40a3912b7d4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:12.307385 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-57d2a1ee-d71b-42ea-8b6c-c40a3912b7d4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:12.421529 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-57d2a1ee-d71b-42ea-8b6c-c40a3912b7d4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:12.493498 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-57d2a1ee-d71b-42ea-8b6c-c40a3912b7d4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:12.524473 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57d2a1ee-d71b-42ea-8b6c-c40a3912b7d4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Pushing event deleted for resources: {'Subnet': ['ID=ab90c6cf-fa45-489b-981e-c2e76fab0296,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:12.526520 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-57d2a1ee-d71b-42ea-8b6c-c40a3912b7d4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:12.532426 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-57d2a1ee-d71b-42ea-8b6c-c40a3912b7d4 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] 10.222.0.13 "DELETE /v2.0/subnets/ab90c6cf-fa45-489b-981e-c2e76fab0296 HTTP/1.1" status: 204 len: 168 time: 0.3404417 Dec 09 21:37:12.532650 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54082) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:12.537237 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3030fc2d-a872-4102-a179-76b97819563f None None] Network 798bf9a7-5407-4015-bd1b-58dc2ed1c248 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:37:12.634136 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fcc2594-0f17-44d6-9805-1374a7158f9f tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:12.727722 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bf8f0ef-c780-42d6-9ac3-f8712d3cf2a4 req-95605ffe-db03-44a5-a984-fcaafcd1a555 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:12.734877 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6bf8f0ef-c780-42d6-9ac3-f8712d3cf2a4 req-95605ffe-db03-44a5-a984-fcaafcd1a555 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0972989 Dec 09 21:37:12.748621 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c30635c7-ab0f-467b-adb7-e944b4d172e4 None None] DHCP port deletion for 798bf9a7-5407-4015-bd1b-58dc2ed1c248 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:37:12.790541 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-5fcc2594-0f17-44d6-9805-1374a7158f9f tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Deleting port e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:37:12.790888 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fcc2594-0f17-44d6-9805-1374a7158f9f tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:12.806004 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6bf8f0ef-c780-42d6-9ac3-f8712d3cf2a4 req-546a757a-88d1-4f78-a62b-ab329664e329 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0701025 Dec 09 21:37:12.808901 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-c30635c7-ab0f-467b-adb7-e944b4d172e4 None None] Deleting port e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:37:12.809214 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c30635c7-ab0f-467b-adb7-e944b4d172e4 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:12.876984 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-5fcc2594-0f17-44d6-9805-1374a7158f9f tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] For port e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3,segment=NetworkSegment(1a7691d2-0b69-4d0d-82be-5dd10b8f2227),segment_id=1a7691d2-0b69-4d0d-82be-5dd10b8f2227)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:37:12.877733 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fcc2594-0f17-44d6-9805-1374a7158f9f tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:12.894492 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c30635c7-ab0f-467b-adb7-e944b4d172e4 None None] For port e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3,segment=NetworkSegment(1a7691d2-0b69-4d0d-82be-5dd10b8f2227),segment_id=1a7691d2-0b69-4d0d-82be-5dd10b8f2227)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:37:12.894896 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c30635c7-ab0f-467b-adb7-e944b4d172e4 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:12.901380 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-5fcc2594-0f17-44d6-9805-1374a7158f9f tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Calling delete_port for e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:37:12.910327 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-c30635c7-ab0f-467b-adb7-e944b4d172e4 None None] Calling delete_port for e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:37:12.998938 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fcc2594-0f17-44d6-9805-1374a7158f9f tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:37:13.013202 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:37:13.020016 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c30635c7-ab0f-467b-adb7-e944b4d172e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:13.032167 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fcc2594-0f17-44d6-9805-1374a7158f9f tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Pushing event deleted for resources: {'Port': ['ID=e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:13.034499 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c30635c7-ab0f-467b-adb7-e944b4d172e4 None None] No DVR routers for this DVR port e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:37:13.035830 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fcc2594-0f17-44d6-9805-1374a7158f9f tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] No DVR routers for this DVR port e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:37:13.065300 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c30635c7-ab0f-467b-adb7-e944b4d172e4 None None] Pushing event deleted for resources: {'Port': ['ID=e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:13.128494 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fcc2594-0f17-44d6-9805-1374a7158f9f tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:13.150533 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-5fcc2594-0f17-44d6-9805-1374a7158f9f tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['798bf9a7-5407-4015-bd1b-58dc2ed1c248']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:13.160147 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-5fcc2594-0f17-44d6-9805-1374a7158f9f tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1a7691d2-0b69-4d0d-82be-5dd10b8f2227') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:13.160446 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-5fcc2594-0f17-44d6-9805-1374a7158f9f tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1a7691d2-0b69-4d0d-82be-5dd10b8f2227') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:13.177189 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fcc2594-0f17-44d6-9805-1374a7158f9f tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:13.200685 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fcc2594-0f17-44d6-9805-1374a7158f9f tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:13.207257 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5fcc2594-0f17-44d6-9805-1374a7158f9f tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Releasing vlan 138 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:37:13.207917 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fcc2594-0f17-44d6-9805-1374a7158f9f tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:37:13.211343 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:37:13.284146 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fcc2594-0f17-44d6-9805-1374a7158f9f tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:13.289588 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fcc2594-0f17-44d6-9805-1374a7158f9f tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:13.294487 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5fcc2594-0f17-44d6-9805-1374a7158f9f tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] 10.222.0.13 "DELETE /v2.0/networks/798bf9a7-5407-4015-bd1b-58dc2ed1c248 HTTP/1.1" status: 204 len: 168 time: 0.7606535 Dec 09 21:37:13.298288 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54100) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:13.320563 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fcc2594-0f17-44d6-9805-1374a7158f9f tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Pushing event deleted for resources: {'Network': ['ID=798bf9a7-5407-4015-bd1b-58dc2ed1c248,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:13.458171 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-7f0a789b-c116-47cc-8785-3e6da1c79689 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Deleting port 3ec52eb4-67ef-46f4-aec7-81c9fd4717ee {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:37:13.458601 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7f0a789b-c116-47cc-8785-3e6da1c79689 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:13.549392 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7f0a789b-c116-47cc-8785-3e6da1c79689 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:13.549850 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7f0a789b-c116-47cc-8785-3e6da1c79689 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:13.581693 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-7f0a789b-c116-47cc-8785-3e6da1c79689 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Calling delete_port for 3ec52eb4-67ef-46f4-aec7-81c9fd4717ee owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:37:13.743125 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7f0a789b-c116-47cc-8785-3e6da1c79689 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:13.780953 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f0a789b-c116-47cc-8785-3e6da1c79689 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Pushing event deleted for resources: {'Port': ['ID=3ec52eb4-67ef-46f4-aec7-81c9fd4717ee,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:13.784793 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:37:13.814341 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:37:13.814701 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e126dddd-f3c7-4d30-b7ba-7f93b1a92dc3 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:37:13.860205 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7f0a789b-c116-47cc-8785-3e6da1c79689 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:13.863592 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7f0a789b-c116-47cc-8785-3e6da1c79689 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:13.867094 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7f0a789b-c116-47cc-8785-3e6da1c79689 tempest-FloatingIPAdminTestJSON-49941237 tempest-FloatingIPAdminTestJSON-49941237-project] 10.222.0.13 "DELETE /v2.0/floatingips/0937faa9-c8f8-4931-86bc-ea6beee77e6b HTTP/1.1" status: 204 len: 168 time: 0.5654912 Dec 09 21:37:13.962834 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa553bca-682b-43c0-a1b1-c19d6fb2ecb6 req-8bc22e0a-9b2d-4d67-8863-ba9c3839340e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:13.971091 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fa553bca-682b-43c0-a1b1-c19d6fb2ecb6 req-8bc22e0a-9b2d-4d67-8863-ba9c3839340e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0751884 Dec 09 21:37:14.035746 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fa553bca-682b-43c0-a1b1-c19d6fb2ecb6 req-cead6950-146b-4f98-9da9-50ebe91867f4 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0551009 Dec 09 21:37:14.170311 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54130) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:14.314688 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0093a6f6-2020-4c39-87c1-059c4b834321 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=5063643820ef4888b4eb80cecf86fa5d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1405845 Dec 09 21:37:14.314688 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54140) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:14.366588 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b71507a4-a377-4077-80ed-6e5b48091cf8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:14.398031 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b71507a4-a377-4077-80ed-6e5b48091cf8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:14.454772 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b71507a4-a377-4077-80ed-6e5b48091cf8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:14.458590 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b71507a4-a377-4077-80ed-6e5b48091cf8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:14.460150 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b71507a4-a377-4077-80ed-6e5b48091cf8 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/3a91512e-744a-42da-bfc2-e5247ea8870d HTTP/1.1" status: 204 len: 168 time: 0.1445706 Dec 09 21:37:14.477757 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b71507a4-a377-4077-80ed-6e5b48091cf8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3a91512e-744a-42da-bfc2-e5247ea8870d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:14.904634 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54172) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:14.923919 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4edb2782-4d90-45b0-8be7-c594509c435a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:15.066141 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4edb2782-4d90-45b0-8be7-c594509c435a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:15.074103 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4edb2782-4d90-45b0-8be7-c594509c435a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:15.127634 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4edb2782-4d90-45b0-8be7-c594509c435a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=f47ba3c4ca6b429aa80b2c84bbb38c07&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2212472 Dec 09 21:37:15.133042 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54182) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:15.163833 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4edb2782-4d90-45b0-8be7-c594509c435a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=59853ebf-d07b-47f8-8b36-05295c755cc5,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:15.196701 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-975f8562-1fb4-416d-a9a1-78fb80f14916 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:15.197221 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a69c308-4e63-4818-b199-2507952a9231 req-1ad026f3-1fbf-4e6d-b2c1-4bc38d361055 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:15.199431 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a69c308-4e63-4818-b199-2507952a9231 req-1ad026f3-1fbf-4e6d-b2c1-4bc38d361055 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0786595 Dec 09 21:37:15.220675 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-975f8562-1fb4-416d-a9a1-78fb80f14916 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:15.308505 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a69c308-4e63-4818-b199-2507952a9231 req-00acc60d-a790-43bf-bfe2-6231df4c439e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1019020 Dec 09 21:37:15.330759 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-975f8562-1fb4-416d-a9a1-78fb80f14916 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:15.334145 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-975f8562-1fb4-416d-a9a1-78fb80f14916 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:15.338767 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-975f8562-1fb4-416d-a9a1-78fb80f14916 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/59853ebf-d07b-47f8-8b36-05295c755cc5 HTTP/1.1" status: 204 len: 168 time: 0.2044191 Dec 09 21:37:15.347086 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-975f8562-1fb4-416d-a9a1-78fb80f14916 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=59853ebf-d07b-47f8-8b36-05295c755cc5,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:15.615882 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54200) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:15.738210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54208) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:15.752734 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c4050d47-077e-46e2-a424-cfadae83fed8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:15.840564 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c4050d47-077e-46e2-a424-cfadae83fed8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:15.841512 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ccb166d-24b9-4d06-abc3-290f7933a9db admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:15.847328 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c4050d47-077e-46e2-a424-cfadae83fed8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:15.886804 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c4050d47-077e-46e2-a424-cfadae83fed8 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=b5d722d76a2e4999bc53d30e8cd9ce45&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1471856 Dec 09 21:37:15.887930 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4050d47-077e-46e2-a424-cfadae83fed8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c8b757e-8aa6-4c94-9f6f-34558f40e5a9,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:15.889868 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54212) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:15.986020 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-437a35ea-6c13-4561-9af7-fa0cbdea3c36 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:15.997684 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ccb166d-24b9-4d06-abc3-290f7933a9db admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:16.003603 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3ccb166d-24b9-4d06-abc3-290f7933a9db admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:16.035113 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-437a35ea-6c13-4561-9af7-fa0cbdea3c36 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:16.077138 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3ccb166d-24b9-4d06-abc3-290f7933a9db admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=21c35201c07f495aa3d735d6b6e702d6&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4600258 Dec 09 21:37:16.079824 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54218) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:16.081917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ccb166d-24b9-4d06-abc3-290f7933a9db admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2cc4db65-f119-46ff-985a-9f7ff2483051,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:16.113581 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-437a35ea-6c13-4561-9af7-fa0cbdea3c36 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:16.116834 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-437a35ea-6c13-4561-9af7-fa0cbdea3c36 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:16.118319 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-437a35ea-6c13-4561-9af7-fa0cbdea3c36 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/5c8b757e-8aa6-4c94-9f6f-34558f40e5a9 HTTP/1.1" status: 204 len: 168 time: 0.2146575 Dec 09 21:37:16.127473 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-437a35ea-6c13-4561-9af7-fa0cbdea3c36 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c8b757e-8aa6-4c94-9f6f-34558f40e5a9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:16.158988 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a4a98dbd-e5d1-4649-841d-10b6b1604cad admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:16.182138 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a4a98dbd-e5d1-4649-841d-10b6b1604cad admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:16.232131 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a4a98dbd-e5d1-4649-841d-10b6b1604cad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:16.235703 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a4a98dbd-e5d1-4649-841d-10b6b1604cad admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:16.237033 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a4a98dbd-e5d1-4649-841d-10b6b1604cad admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/2cc4db65-f119-46ff-985a-9f7ff2483051 HTTP/1.1" status: 204 len: 168 time: 0.1561887 Dec 09 21:37:16.248819 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4a98dbd-e5d1-4649-841d-10b6b1604cad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2cc4db65-f119-46ff-985a-9f7ff2483051,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:16.458642 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52b1b92-c1ca-423d-83ac-0f239623659b req-d1c65186-3c2a-4a5b-b1d8-f78f7959885d tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:16.461712 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a52b1b92-c1ca-423d-83ac-0f239623659b req-d1c65186-3c2a-4a5b-b1d8-f78f7959885d tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0669069 Dec 09 21:37:16.511374 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a52b1b92-c1ca-423d-83ac-0f239623659b req-1bd4283b-ce60-4611-866d-421292cf8c49 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426159 Dec 09 21:37:16.644676 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54240) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:16.659770 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9dff4559-34b8-408e-9585-715e99e7d12e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:16.745630 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9dff4559-34b8-408e-9585-715e99e7d12e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:16.754449 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9dff4559-34b8-408e-9585-715e99e7d12e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:16.811519 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9dff4559-34b8-408e-9585-715e99e7d12e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=205f754233144486b6ad651e75937b97&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1655908 Dec 09 21:37:16.812478 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dff4559-34b8-408e-9585-715e99e7d12e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0b115cb0-6698-4937-ae0a-eb3aa38f3c9b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:16.814392 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54250) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:16.881365 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b9242078-1f84-4974-8909-ee6f9c03000f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:16.927927 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b9242078-1f84-4974-8909-ee6f9c03000f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:16.956832 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-547c0445-0d14-4fc6-9789-d467c995ddaf service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 665 time: 0.0869658 Dec 09 21:37:17.000123 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b9242078-1f84-4974-8909-ee6f9c03000f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:17.004592 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b9242078-1f84-4974-8909-ee6f9c03000f admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:17.009325 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b9242078-1f84-4974-8909-ee6f9c03000f admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/0b115cb0-6698-4937-ae0a-eb3aa38f3c9b HTTP/1.1" status: 204 len: 168 time: 0.1905315 Dec 09 21:37:17.048506 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9242078-1f84-4974-8909-ee6f9c03000f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0b115cb0-6698-4937-ae0a-eb3aa38f3c9b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:17.075468 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-cfbb2825-0531-467f-b91b-d58e49d9193a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:17.075963 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-cfbb2825-0531-467f-b91b-d58e49d9193a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:17.076431 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-cfbb2825-0531-467f-b91b-d58e49d9193a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:17.076973 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-cfbb2825-0531-467f-b91b-d58e49d9193a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:17.077615 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-cfbb2825-0531-467f-b91b-d58e49d9193a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:17.077991 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-cfbb2825-0531-467f-b91b-d58e49d9193a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:17.078449 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-cfbb2825-0531-467f-b91b-d58e49d9193a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:17.080575 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-cfbb2825-0531-467f-b91b-d58e49d9193a service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=03e962eb7f5e4325a7c08c8b1e2a4cea&device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 6498 time: 0.0688818 Dec 09 21:37:17.206627 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-8026232d-0b3b-46a7-b920-541c34f06bd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:17.207092 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-8026232d-0b3b-46a7-b920-541c34f06bd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:17.207566 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-8026232d-0b3b-46a7-b920-541c34f06bd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:17.209914 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-8026232d-0b3b-46a7-b920-541c34f06bd2 service neutron] 10.222.0.10 "GET /v2.0/networks?id=f0373886-3db8-47eb-af65-78244497171e&id=a859e4ba-764a-41c0-982d-5bf79a2797a1&id=a859e4ba-764a-41c0-982d-5bf79a2797a1&id=a859e4ba-764a-41c0-982d-5bf79a2797a1&id=a859e4ba-764a-41c0-982d-5bf79a2797a1&id=a133a939-2827-4fe6-81f5-14715631c0ec&id=a133a939-2827-4fe6-81f5-14715631c0ec HTTP/1.1" status: 200 len: 2293 time: 0.1038735 Dec 09 21:37:17.276454 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-be05c7f5-f180-491a-89a6-a10dd97f02dc service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=90180a85-620b-470e-b808-b635138111be HTTP/1.1" status: 200 len: 1002 time: 0.0601835 Dec 09 21:37:17.337269 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-af52abc4-70a1-4543-abe0-af31570dcac7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:17.339551 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-af52abc4-70a1-4543-abe0-af31570dcac7 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=65df7637-0210-4526-a5dd-a692c26062b4 HTTP/1.1" status: 200 len: 851 time: 0.0562124 Dec 09 21:37:17.425294 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-66eb567d-8cd4-41da-8a83-37dc9474b808 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:17.427097 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-66eb567d-8cd4-41da-8a83-37dc9474b808 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=f0373886-3db8-47eb-af65-78244497171e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0807943 Dec 09 21:37:17.533660 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-0061e38c-ba40-4a43-b414-6752435eb069 service neutron] 10.222.0.10 "GET /v2.0/networks/f0373886-3db8-47eb-af65-78244497171e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0983007 Dec 09 21:37:17.659939 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e4f065e-e06a-4d52-8d46-2d73d8834f6e req-54c628f5-7110-4d86-b169-b76d0e1b4a91 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:17.659939 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e4f065e-e06a-4d52-8d46-2d73d8834f6e req-54c628f5-7110-4d86-b169-b76d0e1b4a91 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.0702183 Dec 09 21:37:17.679835 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-4cf6c54a-31f1-47cf-be0f-3e572a7bccbf service neutron] 10.222.0.10 "GET /v2.0/networks/f0373886-3db8-47eb-af65-78244497171e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1388931 Dec 09 21:37:17.726707 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-98a2f5d0-03ec-4da5-a127-cb058f2566b8 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.81&port_id=1e946a47-f496-445b-964b-618881eab263 HTTP/1.1" status: 200 len: 217 time: 0.0378392 Dec 09 21:37:17.733394 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e4f065e-e06a-4d52-8d46-2d73d8834f6e req-b4209fd8-7cce-4646-a934-f09767ba67c3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0621808 Dec 09 21:37:17.796581 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-69590543-db57-4cb2-9ccc-d308bad17a85 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:17.798272 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-69590543-db57-4cb2-9ccc-d308bad17a85 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=a894075b-fa9f-4a27-9782-e476e86f74e0 HTTP/1.1" status: 200 len: 797 time: 0.0640674 Dec 09 21:37:17.879562 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-0d243252-604e-4989-8462-f9194c441513 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:17.881337 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-0d243252-604e-4989-8462-f9194c441513 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a859e4ba-764a-41c0-982d-5bf79a2797a1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0746298 Dec 09 21:37:17.999635 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-905cd46b-ac01-4b1a-aebc-bb4f06ba9ae6 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1108372 Dec 09 21:37:18.106332 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-f0d4285a-252d-4ac1-adce-efdb9f2fa154 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0993991 Dec 09 21:37:18.151003 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-e091cfb8-859f-473b-8827-2fd401e63c1c service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.31&port_id=145a0cde-0fe5-4163-a063-0fdfe42f243b HTTP/1.1" status: 200 len: 217 time: 0.0365171 Dec 09 21:37:18.207018 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-333db214-b89b-40a6-83fd-00328a01be00 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:18.208789 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-333db214-b89b-40a6-83fd-00328a01be00 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=a894075b-fa9f-4a27-9782-e476e86f74e0 HTTP/1.1" status: 200 len: 797 time: 0.0504334 Dec 09 21:37:18.255472 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-19efa1a9-3942-4446-bf5d-14b314b18367 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:18.257357 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-19efa1a9-3942-4446-bf5d-14b314b18367 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a859e4ba-764a-41c0-982d-5bf79a2797a1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0418415 Dec 09 21:37:18.354220 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-ab2857b5-f019-4456-a49c-9b98c78ed3f1 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0900176 Dec 09 21:37:18.398776 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54314) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:18.460574 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-d260ded5-13d1-4e32-99cc-56070dd250ef service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0997190 Dec 09 21:37:18.504555 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-aa1c8462-fb9f-47e5-96a4-462d04ec56a4 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.110&port_id=7b66d328-f18c-4d26-af51-99c1b1f1f05e HTTP/1.1" status: 200 len: 217 time: 0.0373828 Dec 09 21:37:18.559723 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-0b177606-aea8-4c31-b655-d250b9fc5e7d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:18.561233 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-0b177606-aea8-4c31-b655-d250b9fc5e7d service neutron] 10.222.0.10 "GET /v2.0/subnets?id=a894075b-fa9f-4a27-9782-e476e86f74e0 HTTP/1.1" status: 200 len: 797 time: 0.0501966 Dec 09 21:37:18.606965 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-e8b58adb-7f4f-45d0-88e5-fbae855b6e74 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:18.608533 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-e8b58adb-7f4f-45d0-88e5-fbae855b6e74 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a859e4ba-764a-41c0-982d-5bf79a2797a1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0402114 Dec 09 21:37:18.672854 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-49883a58-23b4-434d-8960-979b1f5afcac tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] Request body: {'metering_label': {'description': 'metering label created by tempest', 'name': 'tempest-metering-label-10032170'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:18.673327 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-49883a58-23b4-434d-8960-979b1f5afcac tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] Unknown quota resources ['metering_label']. {{(pid=103437) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 09 21:37:18.939042 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-49883a58-23b4-434d-8960-979b1f5afcac tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:18.940248 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-49883a58-23b4-434d-8960-979b1f5afcac tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] 10.222.0.13 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 476 time: 0.5402663 Dec 09 21:37:18.942680 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-b563634b-17ff-4aa4-8b4b-fcee9e60746a service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3271577 Dec 09 21:37:18.943313 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54342) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:18.948659 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fa4c52f-c186-4a9d-bb6f-7268c924bf50 req-9abda12c-7050-4070-93d5-7211017d50f7 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:18.949213 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-802127c3-7f0c-476d-9b4f-a96a031fbe08 tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': 'fd02::/64', 'direction': 'ingress', 'metering_label_id': '7a758ac2-3be9-4240-ae80-cf3e2eb24eae'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:18.949213 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-802127c3-7f0c-476d-9b4f-a96a031fbe08 tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=103437) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 09 21:37:18.950352 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0fa4c52f-c186-4a9d-bb6f-7268c924bf50 req-9abda12c-7050-4070-93d5-7211017d50f7 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1090789 Dec 09 21:37:19.019970 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0fa4c52f-c186-4a9d-bb6f-7268c924bf50 req-b7d60139-5d12-449c-8594-378e23a934de tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0625134 Dec 09 21:37:19.499049 n-d-713301-27 neutron-server[103437]: WARNING neutron.services.metering.metering_plugin [None req-802127c3-7f0c-476d-9b4f-a96a031fbe08 tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Dec 09 21:37:19.533503 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-7e40f611-3a00-471e-b86b-bc41a4ef6816 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1131709 Dec 09 21:37:19.616372 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-802127c3-7f0c-476d-9b4f-a96a031fbe08 tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:19.620855 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54368) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:19.621069 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-802127c3-7f0c-476d-9b4f-a96a031fbe08 tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] 10.222.0.13 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 464 time: 0.6763833 Dec 09 21:37:19.625691 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-db865b72-9951-4c91-9492-1ade20fa813e tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': 'fd03::/64', 'direction': 'ingress', 'metering_label_id': '7a758ac2-3be9-4240-ae80-cf3e2eb24eae'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:19.626241 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-db865b72-9951-4c91-9492-1ade20fa813e tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=103438) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 09 21:37:19.653599 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-b697025d-1e5b-4b8b-a367-7f3947e90b1f service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.206&port_id=3bbd0bd0-666a-4f39-abae-59f44d88319c HTTP/1.1" status: 200 len: 217 time: 0.0788734 Dec 09 21:37:19.729110 n-d-713301-27 neutron-server[103438]: WARNING neutron.services.metering.metering_plugin [None req-db865b72-9951-4c91-9492-1ade20fa813e tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Dec 09 21:37:19.729404 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-0cab141b-2203-4f8c-b0b0-e56575588e45 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:19.730788 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-0cab141b-2203-4f8c-b0b0-e56575588e45 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=a894075b-fa9f-4a27-9782-e476e86f74e0 HTTP/1.1" status: 200 len: 797 time: 0.0673921 Dec 09 21:37:19.821115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-0e73a683-2b5a-45d0-ba78-ebfa39daf6bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:19.822777 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-0e73a683-2b5a-45d0-ba78-ebfa39daf6bf service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a859e4ba-764a-41c0-982d-5bf79a2797a1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0851083 Dec 09 21:37:20.080572 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-cae1865b-3eed-4028-a8cc-665eee4c4c13 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2480698 Dec 09 21:37:20.202878 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-db865b72-9951-4c91-9492-1ade20fa813e tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:20.203737 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-db865b72-9951-4c91-9492-1ade20fa813e tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] 10.222.0.13 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 464 time: 0.5818014 Dec 09 21:37:20.206540 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54384) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:20.244863 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7684072d-8fab-466f-858c-a3e50a379168 tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] 10.222.0.13 "GET /v2.0/metering/metering-label-rules?id=3a55a70d-1079-42ba-a403-b017fac958e5 HTTP/1.1" status: 200 len: 462 time: 0.0368977 Dec 09 21:37:20.245514 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54388) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:20.275264 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-61ecce98-7b6b-4105-905e-76243dcb9790 service neutron] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1876295 Dec 09 21:37:20.351380 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-4b6fc99e-35b2-4c37-9dc5-dcda6e5dc0cd service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.100&port_id=d0dcf098-4522-4347-b733-bbc98e48d7e0 HTTP/1.1" status: 200 len: 217 time: 0.0662529 Dec 09 21:37:20.392144 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6f152c62-3ef4-4a0b-989f-8957c01f73cc tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:20.395580 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6f152c62-3ef4-4a0b-989f-8957c01f73cc tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] 10.222.0.13 "DELETE /v2.0/metering/metering-label-rules/3a55a70d-1079-42ba-a403-b017fac958e5 HTTP/1.1" status: 204 len: 168 time: 0.1467941 Dec 09 21:37:20.396204 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54394) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:20.406692 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-96ca0056-3f15-448c-a410-4e4f4c2708bf tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] 10.222.0.13 "GET /v2.0/metering/metering-label-rules?id=3a55a70d-1079-42ba-a403-b017fac958e5 HTTP/1.1" status: 200 len: 221 time: 0.0086851 Dec 09 21:37:20.410676 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54396) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:20.416745 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-0e1c1b00-01dd-48c1-af2d-3bd2f402eda4 tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] Request body: {'metering_label': {'name': 'tempest-metering-label--398502222', 'description': 'label created by tempest'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:20.417674 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-b1e259bb-bab3-47fc-89e7-067df4ec3275 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:20.418428 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-0e1c1b00-01dd-48c1-af2d-3bd2f402eda4 tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] Unknown quota resources ['metering_label']. {{(pid=103438) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 09 21:37:20.419854 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-b1e259bb-bab3-47fc-89e7-067df4ec3275 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=753ba647-b0b0-482e-ac28-89c7e6adf654 HTTP/1.1" status: 200 len: 797 time: 0.0610144 Dec 09 21:37:20.485627 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-7fa1dd74-be38-4825-9030-e1d0cea7c6f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:20.488441 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-7fa1dd74-be38-4825-9030-e1d0cea7c6f1 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a133a939-2827-4fe6-81f5-14715631c0ec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0601826 Dec 09 21:37:20.603631 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-ce8103fc-33ac-4ae7-9373-4bc0f3017902 service neutron] 10.222.0.10 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1070161 Dec 09 21:37:20.680102 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e1c1b00-01dd-48c1-af2d-3bd2f402eda4 tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:20.687350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0e1c1b00-01dd-48c1-af2d-3bd2f402eda4 tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] 10.222.0.13 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 469 time: 0.2718205 Dec 09 21:37:20.687350 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54402) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:20.728773 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-5a714b0a-72a0-4946-97b1-9e832d097475 service neutron] 10.222.0.10 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1169579 Dec 09 21:37:20.770752 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-42c18668-9740-4c17-a1c3-e7b83cbfc959 tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] 10.222.0.13 "GET /v2.0/metering/metering-labels?id=60956bc0-af96-415e-b24c-bdd6b7667e22 HTTP/1.1" status: 200 len: 467 time: 0.0823128 Dec 09 21:37:20.770995 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54406) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:20.777538 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54408) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:20.792757 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-a9aec865-22fa-4488-a219-c0fc29618903 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=b7cad057-c6e6-483b-9791-e1b1a0dd73ac HTTP/1.1" status: 200 len: 217 time: 0.0552366 Dec 09 21:37:20.845358 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-3d3f30c8-efd4-43bb-9e09-b3c25c740369 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:20.846863 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-3d3f30c8-efd4-43bb-9e09-b3c25c740369 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=753ba647-b0b0-482e-ac28-89c7e6adf654 HTTP/1.1" status: 200 len: 797 time: 0.0466027 Dec 09 21:37:20.905363 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-7768b8fa-0269-4c93-8fec-d8ada35fb01c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:20.907279 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-7768b8fa-0269-4c93-8fec-d8ada35fb01c service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a133a939-2827-4fe6-81f5-14715631c0ec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0527644 Dec 09 21:37:20.981279 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-579b63b1-2a6a-4e70-9fc0-aa23051bfd9a tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:20.985396 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-579b63b1-2a6a-4e70-9fc0-aa23051bfd9a tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] 10.222.0.13 "DELETE /v2.0/metering/metering-labels/60956bc0-af96-415e-b24c-bdd6b7667e22 HTTP/1.1" status: 204 len: 168 time: 0.2134376 Dec 09 21:37:20.985997 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54414) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:21.002401 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-72de16c5-075d-4de4-85de-64407c67f813 tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] 10.222.0.13 "GET /v2.0/metering/metering-labels?id=60956bc0-af96-415e-b24c-bdd6b7667e22 HTTP/1.1" status: 200 len: 216 time: 0.0152812 Dec 09 21:37:21.003137 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54416) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:21.016058 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-aca8fabc-9353-41cd-81e2-9d7ebcc80aba tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] 10.222.0.13 "GET /v2.0/metering/metering-label-rules?id=33 HTTP/1.1" status: 200 len: 221 time: 0.0116885 Dec 09 21:37:21.016780 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54418) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:21.023066 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-74474187-d529-4753-90ea-856fe1172e76 service neutron] 10.222.0.10 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1081810 Dec 09 21:37:21.034713 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-200cd6ed-366b-41f3-bd69-535332aad241 tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] 10.222.0.13 "GET /v2.0/metering/metering-labels?id=33 HTTP/1.1" status: 200 len: 216 time: 0.0122049 Dec 09 21:37:21.036635 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54420) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:21.050474 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7e14ed9c-a2a2-4951-858c-1a7328cdcbb7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:21.111555 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-81514ea2-19bb-4ec5-8db2-a69ad47d40f9 tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] 10.222.0.13 "GET /v2.0/metering/metering-labels/7a758ac2-3be9-4240-ae80-cf3e2eb24eae HTTP/1.1" status: 200 len: 471 time: 0.0690989 Dec 09 21:37:21.111934 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54424) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:21.131596 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fe07e8ab-7c80-493b-aae9-ccc26e8b2c3b tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] 10.222.0.13 "GET /v2.0/metering/metering-label-rules/b3fb7090-1345-46de-9b44-6dc32670cbd3 HTTP/1.1" status: 200 len: 459 time: 0.0149801 Dec 09 21:37:21.131833 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54426) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:21.146110 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a8b1b6a3-788a-47bc-bdfc-6c7855057990 req-3f5d87d5-f280-481c-b288-d3f50e8a2af2 service neutron] 10.222.0.10 "GET /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1163983 Dec 09 21:37:21.269365 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-50e64c77-55b1-4189-befc-2f55a0d0fbcb tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:21.270514 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-50e64c77-55b1-4189-befc-2f55a0d0fbcb tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] 10.222.0.13 "DELETE /v2.0/metering/metering-label-rules/b3fb7090-1345-46de-9b44-6dc32670cbd3 HTTP/1.1" status: 204 len: 168 time: 0.1381044 Dec 09 21:37:21.273984 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54430) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:21.279981 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7e14ed9c-a2a2-4951-858c-1a7328cdcbb7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:21.285410 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7e14ed9c-a2a2-4951-858c-1a7328cdcbb7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:21.324896 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7e14ed9c-a2a2-4951-858c-1a7328cdcbb7 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e07f48a04bb8467f812a35c82236ef78&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5463614 Dec 09 21:37:21.326930 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e14ed9c-a2a2-4951-858c-1a7328cdcbb7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=925601cc-0aec-4a20-96db-7a77ad3f1aab,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:21.327902 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54432) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:21.531309 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5ee90565-42bd-4f88-b074-8f14232953e8 tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:21.532496 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5ee90565-42bd-4f88-b074-8f14232953e8 tempest-MeteringIpV6TestJSON-1881675270 tempest-MeteringIpV6TestJSON-1881675270-project-admin] 10.222.0.13 "DELETE /v2.0/metering/metering-labels/7a758ac2-3be9-4240-ae80-cf3e2eb24eae HTTP/1.1" status: 204 len: 168 time: 0.2572181 Dec 09 21:37:21.535620 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-14c70a70-3d0e-4174-a63b-56f8a3a7c86a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:21.567348 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-14c70a70-3d0e-4174-a63b-56f8a3a7c86a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:21.635222 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-14c70a70-3d0e-4174-a63b-56f8a3a7c86a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:21.639628 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-14c70a70-3d0e-4174-a63b-56f8a3a7c86a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:21.644042 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-14c70a70-3d0e-4174-a63b-56f8a3a7c86a admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/925601cc-0aec-4a20-96db-7a77ad3f1aab HTTP/1.1" status: 204 len: 168 time: 0.3148754 Dec 09 21:37:21.654638 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14c70a70-3d0e-4174-a63b-56f8a3a7c86a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=925601cc-0aec-4a20-96db-7a77ad3f1aab,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:21.872945 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54456) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:21.908337 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54460) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:22.141309 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-56ad4c3a-a9f9-4277-ac8d-23254bd2bf4f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:22.162524 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-11fc8a8b-91f6-4d77-ba1e-3ec01abb56f7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:22.233623 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-56ad4c3a-a9f9-4277-ac8d-23254bd2bf4f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:22.240527 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-56ad4c3a-a9f9-4277-ac8d-23254bd2bf4f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:22.260550 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-11fc8a8b-91f6-4d77-ba1e-3ec01abb56f7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:22.265343 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-11fc8a8b-91f6-4d77-ba1e-3ec01abb56f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:22.280914 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56ad4c3a-a9f9-4277-ac8d-23254bd2bf4f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=850b9983-493e-44bd-b76f-9734888e2f10,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:22.297208 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54466) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:22.307560 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-56ad4c3a-a9f9-4277-ac8d-23254bd2bf4f admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=64d0da1dfed44bd796af4394bc926c60&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3976920 Dec 09 21:37:22.309962 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54468) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:22.326266 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-11fc8a8b-91f6-4d77-ba1e-3ec01abb56f7 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ca8b26e24f724ad8a67a072c8ddfb9ff&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4525251 Dec 09 21:37:22.332300 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54470) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:22.333062 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6841d590-faa3-4376-8668-bd2bc600b57d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:22.408850 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6f2d66ba-407b-4d2e-81b7-f4f4b2908449 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:22.417507 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6841d590-faa3-4376-8668-bd2bc600b57d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:22.418758 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11fc8a8b-91f6-4d77-ba1e-3ec01abb56f7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e496d026-3720-40b0-863f-804261b4d38d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:22.424463 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6841d590-faa3-4376-8668-bd2bc600b57d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:22.438936 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6f2d66ba-407b-4d2e-81b7-f4f4b2908449 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:22.457693 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-21793fc1-7efa-4b50-bf48-65962d8cb834 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:22.471944 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6841d590-faa3-4376-8668-bd2bc600b57d admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=d4f255ec95454c83835791ce729385ae&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1618834 Dec 09 21:37:22.472215 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54472) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:22.478332 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6841d590-faa3-4376-8668-bd2bc600b57d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=898b9e77-18e4-49f0-a7d5-bc5b2b67e59b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:22.493326 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-21793fc1-7efa-4b50-bf48-65962d8cb834 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:22.531011 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1243ddbb-7b4d-483b-878a-aade85d17e4d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:22.536046 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6f2d66ba-407b-4d2e-81b7-f4f4b2908449 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:22.539201 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6f2d66ba-407b-4d2e-81b7-f4f4b2908449 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:22.540467 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6f2d66ba-407b-4d2e-81b7-f4f4b2908449 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/850b9983-493e-44bd-b76f-9734888e2f10 HTTP/1.1" status: 204 len: 168 time: 0.2293532 Dec 09 21:37:22.558035 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1243ddbb-7b4d-483b-878a-aade85d17e4d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:22.560500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f2d66ba-407b-4d2e-81b7-f4f4b2908449 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=850b9983-493e-44bd-b76f-9734888e2f10,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:22.570148 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-21793fc1-7efa-4b50-bf48-65962d8cb834 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:22.572885 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-21793fc1-7efa-4b50-bf48-65962d8cb834 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:22.576444 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-21793fc1-7efa-4b50-bf48-65962d8cb834 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/e496d026-3720-40b0-863f-804261b4d38d HTTP/1.1" status: 204 len: 168 time: 0.2407513 Dec 09 21:37:22.600647 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21793fc1-7efa-4b50-bf48-65962d8cb834 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e496d026-3720-40b0-863f-804261b4d38d,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:22.640775 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1243ddbb-7b4d-483b-878a-aade85d17e4d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:22.643870 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1243ddbb-7b4d-483b-878a-aade85d17e4d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:22.645519 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1243ddbb-7b4d-483b-878a-aade85d17e4d admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/898b9e77-18e4-49f0-a7d5-bc5b2b67e59b HTTP/1.1" status: 204 len: 168 time: 0.1725092 Dec 09 21:37:22.655545 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1243ddbb-7b4d-483b-878a-aade85d17e4d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=898b9e77-18e4-49f0-a7d5-bc5b2b67e59b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:22.968103 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54486) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:22.984212 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7baf1fa2-8667-4b22-99c5-4cf369c688bf admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:23.116460 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7baf1fa2-8667-4b22-99c5-4cf369c688bf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:23.121709 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7baf1fa2-8667-4b22-99c5-4cf369c688bf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:23.181339 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7baf1fa2-8667-4b22-99c5-4cf369c688bf admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=bba60105e60e476fac668b597dfb223a&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2107141 Dec 09 21:37:23.181339 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7baf1fa2-8667-4b22-99c5-4cf369c688bf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e32af42c-16bf-40ed-ac53-f554942655d9,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:23.182775 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54492) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:23.228332 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54496) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:23.245506 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ab18d714-0e40-4399-9ee2-ff22d175de1a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:23.264593 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fcf24cd-a351-4468-9e10-8d0f29046676 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:23.299223 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fcf24cd-a351-4468-9e10-8d0f29046676 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:23.353460 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ab18d714-0e40-4399-9ee2-ff22d175de1a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:23.368667 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ab18d714-0e40-4399-9ee2-ff22d175de1a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:23.381654 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fcf24cd-a351-4468-9e10-8d0f29046676 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:23.386192 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fcf24cd-a351-4468-9e10-8d0f29046676 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:23.388047 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8fcf24cd-a351-4468-9e10-8d0f29046676 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/e32af42c-16bf-40ed-ac53-f554942655d9 HTTP/1.1" status: 204 len: 168 time: 0.2036304 Dec 09 21:37:23.430856 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ab18d714-0e40-4399-9ee2-ff22d175de1a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=42e003268f1e40c7a73a375b14375329&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2013390 Dec 09 21:37:23.431503 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54504) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:23.438399 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab18d714-0e40-4399-9ee2-ff22d175de1a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7918980b-08c6-4ac0-a2bc-7fdc9e47fea9,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:23.482517 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fcf24cd-a351-4468-9e10-8d0f29046676 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e32af42c-16bf-40ed-ac53-f554942655d9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:23.525184 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-537e05c2-35df-47db-a4bd-61cac3b22001 req-b5f7d680-aa7e-4e32-8915-ca99a7e35c36 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=78dd0620-865a-48a9-adf6-d64588d364fc&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1358039 Dec 09 21:37:23.532505 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d36c5f25-c0ad-48b6-aa4f-80f93e366c85 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:23.564710 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d36c5f25-c0ad-48b6-aa4f-80f93e366c85 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:23.636290 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-537e05c2-35df-47db-a4bd-61cac3b22001 req-b6630e6e-e4db-4bac-9cec-02dc02fe77bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:23.639627 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-537e05c2-35df-47db-a4bd-61cac3b22001 req-b6630e6e-e4db-4bac-9cec-02dc02fe77bb service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&device_id=78dd0620-865a-48a9-adf6-d64588d364fc HTTP/1.1" status: 200 len: 1097 time: 0.0915985 Dec 09 21:37:23.648752 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d36c5f25-c0ad-48b6-aa4f-80f93e366c85 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:23.654833 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d36c5f25-c0ad-48b6-aa4f-80f93e366c85 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:23.659277 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d36c5f25-c0ad-48b6-aa4f-80f93e366c85 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/7918980b-08c6-4ac0-a2bc-7fdc9e47fea9 HTTP/1.1" status: 204 len: 168 time: 0.2265732 Dec 09 21:37:23.671017 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d36c5f25-c0ad-48b6-aa4f-80f93e366c85 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7918980b-08c6-4ac0-a2bc-7fdc9e47fea9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:23.791832 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-537e05c2-35df-47db-a4bd-61cac3b22001 req-42f98e5c-c285-43ac-8f9d-a103d85133a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:23.793820 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-537e05c2-35df-47db-a4bd-61cac3b22001 req-42f98e5c-c285-43ac-8f9d-a103d85133a8 service neutron] 10.222.0.31 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 913 time: 0.1304293 Dec 09 21:37:23.850548 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-537e05c2-35df-47db-a4bd-61cac3b22001 req-4f61aaf1-1a22-43e3-be26-5b7b54d3e866 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=ae3b2bf8-8e63-4473-8cc8-206c769cc38a HTTP/1.1" status: 200 len: 217 time: 0.0491567 Dec 09 21:37:23.910800 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-537e05c2-35df-47db-a4bd-61cac3b22001 req-7886326e-22b3-4e81-9e5a-1eb62d3b4371 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:23.913570 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-537e05c2-35df-47db-a4bd-61cac3b22001 req-7886326e-22b3-4e81-9e5a-1eb62d3b4371 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 200 len: 851 time: 0.0553777 Dec 09 21:37:23.987693 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-537e05c2-35df-47db-a4bd-61cac3b22001 req-e600132e-8049-4553-b4ca-fedbb343f2f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:23.990019 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-537e05c2-35df-47db-a4bd-61cac3b22001 req-e600132e-8049-4553-b4ca-fedbb343f2f0 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0701303 Dec 09 21:37:24.098232 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-537e05c2-35df-47db-a4bd-61cac3b22001 req-8f1d0ad3-330c-446f-a708-240fdad13809 service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0997956 Dec 09 21:37:24.218838 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-537e05c2-35df-47db-a4bd-61cac3b22001 req-938e543a-9e7f-4aeb-a591-cbfecf28a877 service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1134176 Dec 09 21:37:25.724178 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54602) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:25.841721 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a2916bdc-2e00-4a51-9f8a-0759dd29f2b9 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] Request body: {'metering_label': {'description': 'metering label created by tempest', 'name': 'tempest-metering-label-1177483494'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:25.842550 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a2916bdc-2e00-4a51-9f8a-0759dd29f2b9 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] Unknown quota resources ['metering_label']. {{(pid=103437) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 09 21:37:25.974072 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a2916bdc-2e00-4a51-9f8a-0759dd29f2b9 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:25.978345 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a2916bdc-2e00-4a51-9f8a-0759dd29f2b9 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] 10.222.0.13 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 478 time: 0.2500107 Dec 09 21:37:25.978543 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54618) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:25.983281 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2d238e62-2cd5-4d4b-82c4-9b0f17ba44a1 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': '10.0.0.0/24', 'direction': 'ingress', 'metering_label_id': '9e2c3fd9-4f6e-4be2-bc73-2faa4a081646'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:25.983815 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2d238e62-2cd5-4d4b-82c4-9b0f17ba44a1 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=103437) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 09 21:37:26.048423 n-d-713301-27 neutron-server[103437]: WARNING neutron.services.metering.metering_plugin [None req-2d238e62-2cd5-4d4b-82c4-9b0f17ba44a1 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Dec 09 21:37:26.135645 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d238e62-2cd5-4d4b-82c4-9b0f17ba44a1 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:26.137090 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2d238e62-2cd5-4d4b-82c4-9b0f17ba44a1 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] 10.222.0.13 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 466 time: 0.1571515 Dec 09 21:37:26.140318 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54628) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:26.144718 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-11fab2f1-a607-45f1-89d5-9cd8accdd767 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] Request body: {'metering_label_rule': {'remote_ip_prefix': '10.0.1.0/24', 'direction': 'ingress', 'metering_label_id': '9e2c3fd9-4f6e-4be2-bc73-2faa4a081646'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:26.145220 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-11fab2f1-a607-45f1-89d5-9cd8accdd767 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] Unknown quota resources ['metering_label_rule']. {{(pid=103438) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 09 21:37:26.197739 n-d-713301-27 neutron-server[103438]: WARNING neutron.services.metering.metering_plugin [None req-11fab2f1-a607-45f1-89d5-9cd8accdd767 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] The use of 'remote_ip_prefix' in metering label rules is deprecated and will be removed in future releases. One should use instead the 'source_ip_prefix' and/or 'destination_ip_prefix' parameters. For more details, you can check the spec: https://review.opendev.org/#/c/744702/. Dec 09 21:37:26.279901 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-11fab2f1-a607-45f1-89d5-9cd8accdd767 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:26.281303 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-11fab2f1-a607-45f1-89d5-9cd8accdd767 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] 10.222.0.13 "POST /v2.0/metering/metering-label-rules HTTP/1.1" status: 201 len: 466 time: 0.1399939 Dec 09 21:37:26.284221 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54632) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:26.294488 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-034a97f0-2452-43c7-8f7f-afaf915b10fd tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] 10.222.0.13 "GET /v2.0/metering/metering-label-rules?id=fc68b042-19ab-4875-b862-c0d49d1af8ea HTTP/1.1" status: 200 len: 464 time: 0.0089772 Dec 09 21:37:26.297133 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54634) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:26.401074 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8940aeee-64ff-485f-a64b-135b8cb41ec4 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:26.402213 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8940aeee-64ff-485f-a64b-135b8cb41ec4 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] 10.222.0.13 "DELETE /v2.0/metering/metering-label-rules/fc68b042-19ab-4875-b862-c0d49d1af8ea HTTP/1.1" status: 204 len: 168 time: 0.1040120 Dec 09 21:37:26.405344 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54636) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:26.441866 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e495b3d4-3d43-4a35-8559-bb25fffc7939 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] 10.222.0.13 "GET /v2.0/metering/metering-label-rules?id=fc68b042-19ab-4875-b862-c0d49d1af8ea HTTP/1.1" status: 200 len: 221 time: 0.0353007 Dec 09 21:37:26.445672 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54640) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:26.450044 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-5f7a3842-91bc-4d29-b508-b0aec38b65f4 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] Request body: {'metering_label': {'name': 'tempest-metering-label--865040149', 'description': 'label created by tempest'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:26.450565 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-5f7a3842-91bc-4d29-b508-b0aec38b65f4 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] Unknown quota resources ['metering_label']. {{(pid=103437) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 09 21:37:26.529459 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54642) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:26.615023 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5f7a3842-91bc-4d29-b508-b0aec38b65f4 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:26.618768 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5f7a3842-91bc-4d29-b508-b0aec38b65f4 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] 10.222.0.13 "POST /v2.0/metering/metering-labels HTTP/1.1" status: 201 len: 469 time: 0.1696596 Dec 09 21:37:26.619161 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54646) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:26.682476 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee9525f8-e8fd-4d62-81d6-f31bfb0d59b3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:26.685665 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-323807f6-ea0d-4359-8b61-5d28f4f5e780 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] 10.222.0.13 "GET /v2.0/metering/metering-labels?id=f7bd15dd-87d1-4073-a429-c20b955ad858 HTTP/1.1" status: 200 len: 467 time: 0.0653985 Dec 09 21:37:26.688587 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54650) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:26.786910 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee9525f8-e8fd-4d62-81d6-f31bfb0d59b3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:26.795058 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee9525f8-e8fd-4d62-81d6-f31bfb0d59b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:26.849877 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ee9525f8-e8fd-4d62-81d6-f31bfb0d59b3 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=5be16b15a64b484d933b2cca8b93f2f8&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3192043 Dec 09 21:37:26.851136 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54656) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:26.859199 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee9525f8-e8fd-4d62-81d6-f31bfb0d59b3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=023a3b3a-d3c1-458c-aa16-dbf03700f0ff,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:26.924028 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-27deb291-d685-44fd-ba8a-0ef86087299f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:26.956198 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-27deb291-d685-44fd-ba8a-0ef86087299f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:26.965049 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24664536-dc52-4474-94cf-6a5dba27c71f tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:26.968411 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-24664536-dc52-4474-94cf-6a5dba27c71f tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] 10.222.0.13 "DELETE /v2.0/metering/metering-labels/f7bd15dd-87d1-4073-a429-c20b955ad858 HTTP/1.1" status: 204 len: 168 time: 0.2783699 Dec 09 21:37:26.971236 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54662) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:26.984465 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a6878485-b68c-4a04-8968-bd514751d474 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] 10.222.0.13 "GET /v2.0/metering/metering-labels?id=f7bd15dd-87d1-4073-a429-c20b955ad858 HTTP/1.1" status: 200 len: 216 time: 0.0116379 Dec 09 21:37:26.988071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54666) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:27.000434 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2202f0f5-8f3e-4476-bfbb-5d5ccec57234 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] 10.222.0.13 "GET /v2.0/metering/metering-label-rules?id=33 HTTP/1.1" status: 200 len: 221 time: 0.0094254 Dec 09 21:37:27.003725 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54668) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:27.020060 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f8a669c4-a661-43c3-b5cf-a94215231686 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] 10.222.0.13 "GET /v2.0/metering/metering-labels?id=33 HTTP/1.1" status: 200 len: 216 time: 0.0149982 Dec 09 21:37:27.024340 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54670) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:27.029557 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-27deb291-d685-44fd-ba8a-0ef86087299f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:27.034079 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-27deb291-d685-44fd-ba8a-0ef86087299f admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:27.038051 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-27deb291-d685-44fd-ba8a-0ef86087299f admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/023a3b3a-d3c1-458c-aa16-dbf03700f0ff HTTP/1.1" status: 204 len: 168 time: 0.1819334 Dec 09 21:37:27.047696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27deb291-d685-44fd-ba8a-0ef86087299f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=023a3b3a-d3c1-458c-aa16-dbf03700f0ff,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:27.092627 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54676) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:27.092755 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b3a4d8e1-6725-4fb8-8924-0ee1015d0bc8 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] 10.222.0.13 "GET /v2.0/metering/metering-labels/9e2c3fd9-4f6e-4be2-bc73-2faa4a081646 HTTP/1.1" status: 200 len: 473 time: 0.0665574 Dec 09 21:37:27.105489 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-93ed28e5-278a-49d2-831f-08bb1d51cee0 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] 10.222.0.13 "GET /v2.0/metering/metering-label-rules/555042d5-0101-45c1-ab5e-62894823a2d9 HTTP/1.1" status: 200 len: 461 time: 0.0089507 Dec 09 21:37:27.105933 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54678) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:27.260479 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-01082488-6833-4836-96f1-be097382c459 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] Publish callbacks [] for metering_label_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:27.264070 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-01082488-6833-4836-96f1-be097382c459 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] 10.222.0.13 "DELETE /v2.0/metering/metering-label-rules/555042d5-0101-45c1-ab5e-62894823a2d9 HTTP/1.1" status: 204 len: 168 time: 0.1572361 Dec 09 21:37:27.264582 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54688) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:27.281780 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:27.282475 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:27.403061 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54696) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:27.418688 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-85f23963-e1b6-4428-825a-0276a384e0f0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:27.511161 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-90066e2b-e31e-4c86-a32e-c7b719156446 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] Publish callbacks [] for metering_label, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:27.513113 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-90066e2b-e31e-4c86-a32e-c7b719156446 tempest-MeteringTestJSON-960786193 tempest-MeteringTestJSON-960786193-project-admin] 10.222.0.13 "DELETE /v2.0/metering/metering-labels/9e2c3fd9-4f6e-4be2-bc73-2faa4a081646 HTTP/1.1" status: 204 len: 168 time: 0.2474484 Dec 09 21:37:27.526432 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-85f23963-e1b6-4428-825a-0276a384e0f0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:27.532415 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-85f23963-e1b6-4428-825a-0276a384e0f0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:27.578801 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-85f23963-e1b6-4428-825a-0276a384e0f0 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=a9de88cdcce043bd9d72a89f77895c36&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1745882 Dec 09 21:37:27.580037 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85f23963-e1b6-4428-825a-0276a384e0f0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a9e506ae-6b2d-4340-92fe-2829e4325f90,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:27.581547 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54706) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:27.640455 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a5472d4-b1d5-49cd-80fa-a7c2c5b129c6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:27.665084 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a5472d4-b1d5-49cd-80fa-a7c2c5b129c6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:27.731353 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a5472d4-b1d5-49cd-80fa-a7c2c5b129c6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:27.735684 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a5472d4-b1d5-49cd-80fa-a7c2c5b129c6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:27.737161 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1a5472d4-b1d5-49cd-80fa-a7c2c5b129c6 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/a9e506ae-6b2d-4340-92fe-2829e4325f90 HTTP/1.1" status: 204 len: 168 time: 0.1544671 Dec 09 21:37:27.767936 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a5472d4-b1d5-49cd-80fa-a7c2c5b129c6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a9e506ae-6b2d-4340-92fe-2829e4325f90,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:27.869925 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54712) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:28.013784 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c9459366-6dae-4dcd-b63b-74851381bcd8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:28.104549 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c9459366-6dae-4dcd-b63b-74851381bcd8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:28.109315 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c9459366-6dae-4dcd-b63b-74851381bcd8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:28.152022 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9459366-6dae-4dcd-b63b-74851381bcd8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ba301130-fb08-471f-925c-892d077cd4ad,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:28.159496 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c9459366-6dae-4dcd-b63b-74851381bcd8 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=c3056c54f66b47e28895048874e49ec9&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2864494 Dec 09 21:37:28.161672 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54720) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:28.212534 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-624bc823-493b-42dd-b445-17e96945fa16 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:28.236471 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-624bc823-493b-42dd-b445-17e96945fa16 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:28.292796 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-624bc823-493b-42dd-b445-17e96945fa16 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:28.296171 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-624bc823-493b-42dd-b445-17e96945fa16 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:28.297523 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-624bc823-493b-42dd-b445-17e96945fa16 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/ba301130-fb08-471f-925c-892d077cd4ad HTTP/1.1" status: 204 len: 168 time: 0.1349506 Dec 09 21:37:28.306683 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-624bc823-493b-42dd-b445-17e96945fa16 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ba301130-fb08-471f-925c-892d077cd4ad,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:28.666669 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54744) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:28.693437 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-67eb3123-bcd7-4634-a7f2-c629504cb843 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:28.773930 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-67eb3123-bcd7-4634-a7f2-c629504cb843 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:28.778866 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-67eb3123-bcd7-4634-a7f2-c629504cb843 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:28.825223 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-67eb3123-bcd7-4634-a7f2-c629504cb843 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=b664a505cffd44a2ac24626dcd544b44&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1564112 Dec 09 21:37:28.827658 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67eb3123-bcd7-4634-a7f2-c629504cb843 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4117f2f1-4eba-4bd2-ae27-2826682eb6f9,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:28.828325 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54748) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:28.890101 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dc56055d-8d6f-465c-984c-cce65396d6dc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:28.919068 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dc56055d-8d6f-465c-984c-cce65396d6dc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:28.967886 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dc56055d-8d6f-465c-984c-cce65396d6dc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:28.970528 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dc56055d-8d6f-465c-984c-cce65396d6dc admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:28.974414 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-dc56055d-8d6f-465c-984c-cce65396d6dc admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/4117f2f1-4eba-4bd2-ae27-2826682eb6f9 HTTP/1.1" status: 204 len: 168 time: 0.1421053 Dec 09 21:37:28.983949 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc56055d-8d6f-465c-984c-cce65396d6dc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4117f2f1-4eba-4bd2-ae27-2826682eb6f9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:30.583081 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54822) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:30.792880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-f6ac144d-a1ae-4f57-8d3e-7349d9ac4e63 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Request body: {'router': {'name': 'tempest-pretest-check-1958433132'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:30.827344 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f6ac144d-a1ae-4f57-8d3e-7349d9ac4e63 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:30.829871 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f6ac144d-a1ae-4f57-8d3e-7349d9ac4e63 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:30.893794 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f6ac144d-a1ae-4f57-8d3e-7349d9ac4e63 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:30.901503 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f6ac144d-a1ae-4f57-8d3e-7349d9ac4e63 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:30.923365 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f6ac144d-a1ae-4f57-8d3e-7349d9ac4e63 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:30.924842 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f6ac144d-a1ae-4f57-8d3e-7349d9ac4e63 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 729 time: 0.3404820 Dec 09 21:37:30.927619 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54836) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:31.014559 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8efb56b4-56f4-4659-b2ad-58119a569095 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.163874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54844) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:31.184847 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8efb56b4-56f4-4659-b2ad-58119a569095 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.187502 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8efb56b4-56f4-4659-b2ad-58119a569095 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.237497 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8efb56b4-56f4-4659-b2ad-58119a569095 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.238317 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8efb56b4-56f4-4659-b2ad-58119a569095 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Fanout notify agent at l3_agent the message router_deleted on router dd4691ca-6364-4979-9faa-2ed6bfa8cc7f {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:37:31.243653 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8efb56b4-56f4-4659-b2ad-58119a569095 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.247342 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54850) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:31.247540 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8efb56b4-56f4-4659-b2ad-58119a569095 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] 10.222.0.13 "DELETE /v2.0/routers/dd4691ca-6364-4979-9faa-2ed6bfa8cc7f HTTP/1.1" status: 204 len: 168 time: 0.3181601 Dec 09 21:37:31.253393 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-6965b763-82ff-4161-95f8-9ec72c5c4880 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Request body: {'router': {'name': 'tempest-router-140914735', 'distributed': False}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:31.277106 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6965b763-82ff-4161-95f8-9ec72c5c4880 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.278484 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6965b763-82ff-4161-95f8-9ec72c5c4880 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.301640 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0df05539-13a4-463a-8b12-3e7a0704f54e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.362852 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6965b763-82ff-4161-95f8-9ec72c5c4880 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.372966 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6965b763-82ff-4161-95f8-9ec72c5c4880 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.398582 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6965b763-82ff-4161-95f8-9ec72c5c4880 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.400090 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6965b763-82ff-4161-95f8-9ec72c5c4880 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 721 time: 0.1515160 Dec 09 21:37:31.403179 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54854) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:31.484941 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2bef48c2-13a0-4485-b8aa-2c953155465f tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.582625 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0df05539-13a4-463a-8b12-3e7a0704f54e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.587263 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0df05539-13a4-463a-8b12-3e7a0704f54e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.706718 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2bef48c2-13a0-4485-b8aa-2c953155465f tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.709696 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2bef48c2-13a0-4485-b8aa-2c953155465f tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.713893 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0df05539-13a4-463a-8b12-3e7a0704f54e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=53be2e5f-9d5d-47c6-a5ad-8304fc8565c2,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:31.721677 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0df05539-13a4-463a-8b12-3e7a0704f54e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=9a131e7e70864bedab14a1ab21cd51ae&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5557446 Dec 09 21:37:31.724482 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54864) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:31.767966 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2bef48c2-13a0-4485-b8aa-2c953155465f tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.768547 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2bef48c2-13a0-4485-b8aa-2c953155465f tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Fanout notify agent at l3_agent the message router_deleted on router dfebf048-b51a-4530-bc28-03db146234fd {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:37:31.777921 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2bef48c2-13a0-4485-b8aa-2c953155465f tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.779024 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2bef48c2-13a0-4485-b8aa-2c953155465f tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] 10.222.0.13 "DELETE /v2.0/routers/dfebf048-b51a-4530-bc28-03db146234fd HTTP/1.1" status: 204 len: 168 time: 0.3749018 Dec 09 21:37:31.782601 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54868) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:31.787124 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a8113bad-4e86-4cf9-a53b-f43f074612cc tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Request body: {'router': {'name': 'tempest-router-1442746839', 'distributed': False, 'admin_state_up': False, 'ha': False, 'project_id': 'a91e8873f85e4ff8935dfd3c2ece2996'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:31.801704 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62ea425a-f4e5-43cb-95bc-18ba3269e443 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.810841 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8113bad-4e86-4cf9-a53b-f43f074612cc tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.812037 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8113bad-4e86-4cf9-a53b-f43f074612cc tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.825728 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62ea425a-f4e5-43cb-95bc-18ba3269e443 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.867605 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8113bad-4e86-4cf9-a53b-f43f074612cc tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.872595 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8113bad-4e86-4cf9-a53b-f43f074612cc tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.883196 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62ea425a-f4e5-43cb-95bc-18ba3269e443 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.885872 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62ea425a-f4e5-43cb-95bc-18ba3269e443 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.887088 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-62ea425a-f4e5-43cb-95bc-18ba3269e443 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/53be2e5f-9d5d-47c6-a5ad-8304fc8565c2 HTTP/1.1" status: 204 len: 168 time: 0.1615298 Dec 09 21:37:31.896581 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62ea425a-f4e5-43cb-95bc-18ba3269e443 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=53be2e5f-9d5d-47c6-a5ad-8304fc8565c2,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:31.900517 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8113bad-4e86-4cf9-a53b-f43f074612cc tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:31.902167 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a8113bad-4e86-4cf9-a53b-f43f074612cc tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 723 time: 0.1182480 Dec 09 21:37:31.905580 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54874) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:31.910542 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a98c7f20-d300-4e7e-971f-5dc7795937c9 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Request body: {'router': {'distributed': True}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:32.122117 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a98c7f20-d300-4e7e-971f-5dc7795937c9 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:32.122455 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a98c7f20-d300-4e7e-971f-5dc7795937c9 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks [] for router, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:32.204385 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.l3_router.service_providers.driver_controller [None req-a98c7f20-d300-4e7e-971f-5dc7795937c9 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Get a provider driver handle based on the ha flag: False and distributed flag: True {{(pid=103438) _update_router_provider /opt/stack/neutron/neutron/services/l3_router/service_providers/driver_controller.py:160}} Dec 09 21:37:32.204618 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.l3_router.service_providers.driver_controller [None req-a98c7f20-d300-4e7e-971f-5dc7795937c9 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Router 3cbc3973-2d2c-4ea7-ac88-958712582009 migrating from provider to provider. {{(pid=103438) _update_router_provider /opt/stack/neutron/neutron/services/l3_router/service_providers/driver_controller.py:167}} Dec 09 21:37:32.205349 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a98c7f20-d300-4e7e-971f-5dc7795937c9 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:32.210717 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a98c7f20-d300-4e7e-971f-5dc7795937c9 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:32.215301 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a98c7f20-d300-4e7e-971f-5dc7795937c9 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-640457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-640448', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-635166'] for router, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:32.606801 n-d-713301-27 neutron-server[103438]: WARNING neutron.scheduler.l3_agent_scheduler [None req-a98c7f20-d300-4e7e-971f-5dc7795937c9 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] No L3 agents can host the router 3cbc3973-2d2c-4ea7-ac88-958712582009 Dec 09 21:37:32.706506 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a98c7f20-d300-4e7e-971f-5dc7795937c9 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Hosts for router 3cbc3973-2d2c-4ea7-ac88-958712582009: [] {{(pid=103438) _get_dvr_hosts_for_router /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:328}} Dec 09 21:37:32.730645 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a98c7f20-d300-4e7e-971f-5dc7795937c9 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Hosts for other DVR routers connected to router 3cbc3973-2d2c-4ea7-ac88-958712582009: set() {{(pid=103438) _get_other_dvr_hosts /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:345}} Dec 09 21:37:32.733335 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a98c7f20-d300-4e7e-971f-5dc7795937c9 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:32.736044 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a98c7f20-d300-4e7e-971f-5dc7795937c9 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] 10.222.0.13 "PUT /v2.0/routers/3cbc3973-2d2c-4ea7-ac88-958712582009 HTTP/1.1" status: 200 len: 717 time: 0.8290260 Dec 09 21:37:32.737556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54906) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:32.816012 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b25c9967-9a9e-42d0-8929-f53a03ee7cfd tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] 10.222.0.13 "GET /v2.0/routers/3cbc3973-2d2c-4ea7-ac88-958712582009 HTTP/1.1" status: 200 len: 717 time: 0.0747993 Dec 09 21:37:32.816270 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54910) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:32.948719 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c0801ac9-5b11-4f19-b263-903f5788449b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:33.122680 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-aff8d1f1-c218-43ec-88f6-0c3fbcf99ef2 tempest-RoutersTestDVR-2039853535 tempest-RoutersTestDVR-2039853535-project] 10.222.0.13 "GET /v2.0/routers/3cbc3973-2d2c-4ea7-ac88-958712582009 HTTP/1.1" status: 200 len: 683 time: 0.3053620 Dec 09 21:37:33.125580 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54920) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:33.199804 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3159b01f-4cd7-4666-8b4a-0f6db0ca7508 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:33.389409 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3159b01f-4cd7-4666-8b4a-0f6db0ca7508 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:33.391755 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3159b01f-4cd7-4666-8b4a-0f6db0ca7508 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:33.441663 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3159b01f-4cd7-4666-8b4a-0f6db0ca7508 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:33.441663 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3159b01f-4cd7-4666-8b4a-0f6db0ca7508 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 3cbc3973-2d2c-4ea7-ac88-958712582009 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:37:33.446690 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3159b01f-4cd7-4666-8b4a-0f6db0ca7508 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:33.448483 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3159b01f-4cd7-4666-8b4a-0f6db0ca7508 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] 10.222.0.13 "DELETE /v2.0/routers/3cbc3973-2d2c-4ea7-ac88-958712582009 HTTP/1.1" status: 204 len: 168 time: 0.3216634 Dec 09 21:37:33.452205 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54932) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:33.457289 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c7b4ea35-f3d7-4529-9821-2df82f3fde8c tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Request body: {'router': {'name': 'tempest-router-1205425496', 'distributed': True}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:33.483455 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7b4ea35-f3d7-4529-9821-2df82f3fde8c tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:33.485315 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7b4ea35-f3d7-4529-9821-2df82f3fde8c tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:33.551702 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7b4ea35-f3d7-4529-9821-2df82f3fde8c tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:33.557565 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7b4ea35-f3d7-4529-9821-2df82f3fde8c tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:33.596776 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7b4ea35-f3d7-4529-9821-2df82f3fde8c tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:33.601886 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c7b4ea35-f3d7-4529-9821-2df82f3fde8c tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 721 time: 0.1458850 Dec 09 21:37:33.602214 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54938) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:33.685170 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e95844dd-a717-4a55-b886-44a165207e29 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:33.858489 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e95844dd-a717-4a55-b886-44a165207e29 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:33.860696 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e95844dd-a717-4a55-b886-44a165207e29 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:33.905618 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e95844dd-a717-4a55-b886-44a165207e29 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:33.906142 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e95844dd-a717-4a55-b886-44a165207e29 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Fanout notify agent at l3_agent the message router_deleted on router a0db2ffe-85d1-4323-abb9-d5bc05d06d7f {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:37:33.915706 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e95844dd-a717-4a55-b886-44a165207e29 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:33.919963 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e95844dd-a717-4a55-b886-44a165207e29 tempest-RoutersTestDVR-597757680 tempest-RoutersTestDVR-597757680-project-admin] 10.222.0.13 "DELETE /v2.0/routers/a0db2ffe-85d1-4323-abb9-d5bc05d06d7f HTTP/1.1" status: 204 len: 168 time: 0.3165193 Dec 09 21:37:34.263595 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54954) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:34.373954 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-17f34c31-f061-4728-b549-1c9e6f2696c0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:34.458471 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-17f34c31-f061-4728-b549-1c9e6f2696c0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:34.464372 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-17f34c31-f061-4728-b549-1c9e6f2696c0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:34.507270 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-17f34c31-f061-4728-b549-1c9e6f2696c0 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=a91e8873f85e4ff8935dfd3c2ece2996&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2401276 Dec 09 21:37:34.507697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54968) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:34.515113 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17f34c31-f061-4728-b549-1c9e6f2696c0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0d9f21e5-fb35-4080-8b5f-b34c797361c0,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:34.566776 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dc87a59c-e9d0-4a36-a3f4-be015404192d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:34.596210 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dc87a59c-e9d0-4a36-a3f4-be015404192d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:34.649313 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dc87a59c-e9d0-4a36-a3f4-be015404192d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:34.653293 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dc87a59c-e9d0-4a36-a3f4-be015404192d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:34.656996 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-dc87a59c-e9d0-4a36-a3f4-be015404192d admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/0d9f21e5-fb35-4080-8b5f-b34c797361c0 HTTP/1.1" status: 204 len: 168 time: 0.1458917 Dec 09 21:37:34.678138 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc87a59c-e9d0-4a36-a3f4-be015404192d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0d9f21e5-fb35-4080-8b5f-b34c797361c0,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:35.072795 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:37:35.180904 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55010) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:35.197600 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3bf6e38e-e670-4768-98fc-10b8b3737fe2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:35.305020 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3bf6e38e-e670-4768-98fc-10b8b3737fe2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:35.311275 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3bf6e38e-e670-4768-98fc-10b8b3737fe2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:35.342459 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bf6e38e-e670-4768-98fc-10b8b3737fe2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0b9960b3-5806-4acc-879a-a286b70be46a,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:35.373447 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3bf6e38e-e670-4768-98fc-10b8b3737fe2 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=c35b770174ba4e28b03792ed4c3f9a02&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1892951 Dec 09 21:37:35.373758 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55014) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:35.434902 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-04bf429c-cde8-4651-abdc-1f5176696d6a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:35.463063 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-04bf429c-cde8-4651-abdc-1f5176696d6a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:35.550643 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-04bf429c-cde8-4651-abdc-1f5176696d6a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:35.559130 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-04bf429c-cde8-4651-abdc-1f5176696d6a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:35.560745 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-04bf429c-cde8-4651-abdc-1f5176696d6a admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/0b9960b3-5806-4acc-879a-a286b70be46a HTTP/1.1" status: 204 len: 168 time: 0.1859591 Dec 09 21:37:35.567949 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-046a5f0b-99dd-460a-9887-cd789362e2f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:35.579328 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04bf429c-cde8-4651-abdc-1f5176696d6a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0b9960b3-5806-4acc-879a-a286b70be46a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:36.419840 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55064) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:36.592702 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55070) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:36.615928 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:36.696455 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-226130de-8785-423e-840f-f3db9d60e562 tempest-AgentManagementNegativeTest-837272671 tempest-AgentManagementNegativeTest-837272671-project] 10.222.0.13 "GET /v2.0/agents HTTP/1.1" status: 200 len: 207 time: 0.1012433 Dec 09 21:37:36.730575 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1c133adc-537c-450a-92ca-f60ea28f26ec admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:36.838553 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1c133adc-537c-450a-92ca-f60ea28f26ec admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:36.843146 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1c133adc-537c-450a-92ca-f60ea28f26ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:36.877824 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c133adc-537c-450a-92ca-f60ea28f26ec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eacc5ace-4601-4bf4-8212-6f2ff9b55e8a,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:36.908956 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1c133adc-537c-450a-92ca-f60ea28f26ec admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=529ff55bd7a84c429f6efeed7b8e8152&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4863276 Dec 09 21:37:36.911646 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55080) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:36.973029 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b5a7cee1-c3bd-4247-be46-29538a926306 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:36.980359 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55082) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:37.006757 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b5a7cee1-c3bd-4247-be46-29538a926306 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:37.067358 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b5a7cee1-c3bd-4247-be46-29538a926306 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:37.071104 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b5a7cee1-c3bd-4247-be46-29538a926306 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:37.078880 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b5a7cee1-c3bd-4247-be46-29538a926306 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/eacc5ace-4601-4bf4-8212-6f2ff9b55e8a HTTP/1.1" status: 204 len: 168 time: 0.1654856 Dec 09 21:37:37.091807 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5a7cee1-c3bd-4247-be46-29538a926306 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eacc5ace-4601-4bf4-8212-6f2ff9b55e8a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:37.172090 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf00a634-57de-4463-a851-4573831f2065 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:37.275687 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf00a634-57de-4463-a851-4573831f2065 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:37.282746 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf00a634-57de-4463-a851-4573831f2065 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:37.317198 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bf00a634-57de-4463-a851-4573831f2065 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=0f949ffcef9343b0a5ae897c19e121d4&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3334436 Dec 09 21:37:37.317437 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55092) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:37.357270 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf00a634-57de-4463-a851-4573831f2065 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=65cc870f-96af-4ef5-a9b9-7abce466e7d2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:37.398008 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a0553c62-d675-44ef-91ee-e01062feb919 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:37.427679 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a0553c62-d675-44ef-91ee-e01062feb919 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:37.482951 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a0553c62-d675-44ef-91ee-e01062feb919 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:37.487255 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a0553c62-d675-44ef-91ee-e01062feb919 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:37.488480 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a0553c62-d675-44ef-91ee-e01062feb919 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/65cc870f-96af-4ef5-a9b9-7abce466e7d2 HTTP/1.1" status: 204 len: 168 time: 0.1701150 Dec 09 21:37:37.498272 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0553c62-d675-44ef-91ee-e01062feb919 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=65cc870f-96af-4ef5-a9b9-7abce466e7d2,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:37.508687 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55096) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:37.531804 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7df6a547-2111-42f3-9710-872ccb2e0f93 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:37.648787 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7df6a547-2111-42f3-9710-872ccb2e0f93 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:37.654170 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7df6a547-2111-42f3-9710-872ccb2e0f93 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:37.701150 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7df6a547-2111-42f3-9710-872ccb2e0f93 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=95c846c31990461c89c49556ec4933b4&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1903193 Dec 09 21:37:37.702371 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7df6a547-2111-42f3-9710-872ccb2e0f93 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7a8da902-3697-4c95-acc9-68fd866b7ed3,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:37.703936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55098) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:37.784829 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a79aee97-68ae-44ae-b7fc-3194d830f999 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:37.818293 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a79aee97-68ae-44ae-b7fc-3194d830f999 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:37.905476 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a79aee97-68ae-44ae-b7fc-3194d830f999 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:37.908755 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a79aee97-68ae-44ae-b7fc-3194d830f999 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:37.913355 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a79aee97-68ae-44ae-b7fc-3194d830f999 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/7a8da902-3697-4c95-acc9-68fd866b7ed3 HTTP/1.1" status: 204 len: 168 time: 0.2083192 Dec 09 21:37:37.922715 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a79aee97-68ae-44ae-b7fc-3194d830f999 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7a8da902-3697-4c95-acc9-68fd866b7ed3,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:37.969382 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:38.464246 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55136) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:38.606721 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ae4e4597-4973-4a8a-8123-6f2f807a705b tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Request body: {'router': {'name': 'tempest-RoutersNegativeTest-router-503725225', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:38.640856 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae4e4597-4973-4a8a-8123-6f2f807a705b tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:38.643076 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae4e4597-4973-4a8a-8123-6f2f807a705b tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:38.724960 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae4e4597-4973-4a8a-8123-6f2f807a705b tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:38.731259 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae4e4597-4973-4a8a-8123-6f2f807a705b tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:38.754263 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae4e4597-4973-4a8a-8123-6f2f807a705b tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:38.756057 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ae4e4597-4973-4a8a-8123-6f2f807a705b tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 707 time: 0.2904119 Dec 09 21:37:38.759008 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55148) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:38.765750 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-597257e7-092a-49e1-9331-4270cc6fcd6a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Request body: {'network': {'name': 'tempest-RoutersNegativeTest-test-network-729923755'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:38.796983 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-597257e7-092a-49e1-9331-4270cc6fcd6a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Made reservation on behalf of 54c2ac9b331d4794a0ce58f8a47c8e80 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:37:38.800956 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-597257e7-092a-49e1-9331-4270cc6fcd6a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:38.810985 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-597257e7-092a-49e1-9331-4270cc6fcd6a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:38.918905 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-597257e7-092a-49e1-9331-4270cc6fcd6a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:38.926743 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-597257e7-092a-49e1-9331-4270cc6fcd6a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:38.947908 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-597257e7-092a-49e1-9331-4270cc6fcd6a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] vlan segment allocate from pool success with {'vlan_id': 102, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:37:38.961618 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-597257e7-092a-49e1-9331-4270cc6fcd6a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:38.962234 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-597257e7-092a-49e1-9331-4270cc6fcd6a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Added segment 76984479-c633-4f9c-b8b2-de009dc509fd of type vlan for network 0801dc22-1800-4894-89f9-dfbc338ac3c7 Dec 09 21:37:39.023137 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-597257e7-092a-49e1-9331-4270cc6fcd6a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:39.085692 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-597257e7-092a-49e1-9331-4270cc6fcd6a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9ea2e206-9245-4b6f-8f9d-20876f9ebbda,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:39.089767 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-597257e7-092a-49e1-9331-4270cc6fcd6a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:39.095414 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-597257e7-092a-49e1-9331-4270cc6fcd6a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:39.096634 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-597257e7-092a-49e1-9331-4270cc6fcd6a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:39.173904 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-597257e7-092a-49e1-9331-4270cc6fcd6a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.4105890 Dec 09 21:37:39.174063 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55160) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:39.180008 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-1e84124e-ca2c-434d-acac-68ccfaf4b94a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Request body: {'subnet': {'network_id': '0801dc22-1800-4894-89f9-dfbc338ac3c7', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:39.253149 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-597257e7-092a-49e1-9331-4270cc6fcd6a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Pushing event updated for resources: {'Network': ['ID=0801dc22-1800-4894-89f9-dfbc338ac3c7,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:39.265072 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 0801dc22-1800-4894-89f9-dfbc338ac3c7 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:37:39.356236 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1e84124e-ca2c-434d-acac-68ccfaf4b94a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Made reservation on behalf of 54c2ac9b331d4794a0ce58f8a47c8e80 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:37:39.360033 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1e84124e-ca2c-434d-acac-68ccfaf4b94a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:39.611295 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1e84124e-ca2c-434d-acac-68ccfaf4b94a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:39.650003 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:39.700654 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e84124e-ca2c-434d-acac-68ccfaf4b94a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Pushing event updated for resources: {'Subnet': ['ID=657c90d6-3d5c-4662-9469-7c036d9c1427,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:39.733923 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e84124e-ca2c-434d-acac-68ccfaf4b94a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Checking segment: {'id': '76984479-c633-4f9c-b8b2-de009dc509fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '0801dc22-1800-4894-89f9-dfbc338ac3c7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:37:39.734563 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1e84124e-ca2c-434d-acac-68ccfaf4b94a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Network hostable DHCP agents. Network: 0801dc22-1800-4894-89f9-dfbc338ac3c7, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:37:39.759500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1e84124e-ca2c-434d-acac-68ccfaf4b94a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Network 0801dc22-1800-4894-89f9-dfbc338ac3c7 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:37:39.773895 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-1e84124e-ca2c-434d-acac-68ccfaf4b94a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 0801dc22-1800-4894-89f9-dfbc338ac3c7) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:37:39.782163 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e84124e-ca2c-434d-acac-68ccfaf4b94a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:39.782571 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1eb26655-7979-439c-b63e-70bd033bde67 None None] Network 0801dc22-1800-4894-89f9-dfbc338ac3c7 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:37:39.782814 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1e84124e-ca2c-434d-acac-68ccfaf4b94a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:39.840139 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1e84124e-ca2c-434d-acac-68ccfaf4b94a tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.6649663 Dec 09 21:37:39.843323 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55182) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:39.848465 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-9c6445ac-443b-4d9e-b1fd-cbacbca2d423 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Request body: {'network': {'name': 'tempest-router-network01--456338522'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:39.895033 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9c6445ac-443b-4d9e-b1fd-cbacbca2d423 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Made reservation on behalf of 54c2ac9b331d4794a0ce58f8a47c8e80 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:37:39.899949 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9c6445ac-443b-4d9e-b1fd-cbacbca2d423 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:39.960868 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9c6445ac-443b-4d9e-b1fd-cbacbca2d423 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] vlan segment allocate from pool success with {'vlan_id': 147, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:37:39.986952 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9c6445ac-443b-4d9e-b1fd-cbacbca2d423 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:39.989291 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-9c6445ac-443b-4d9e-b1fd-cbacbca2d423 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Added segment 132a2620-bb6d-48f6-af90-5bc0c853f6d8 of type vlan for network 4b5a3188-c7f2-4be0-aa36-2d366f493d66 Dec 09 21:37:40.066055 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2f1c6430-996f-4392-b6e5-9f6332e69187 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-0801dc22-1800-4894-89f9-dfbc338ac3c7', 'network_id': '0801dc22-1800-4894-89f9-dfbc338ac3c7', 'project_id': '54c2ac9b331d4794a0ce58f8a47c8e80', 'fixed_ips': [{'subnet_id': '657c90d6-3d5c-4662-9469-7c036d9c1427'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:37:40.066977 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2f1c6430-996f-4392-b6e5-9f6332e69187 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:40.110763 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9c6445ac-443b-4d9e-b1fd-cbacbca2d423 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:40.141399 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9c6445ac-443b-4d9e-b1fd-cbacbca2d423 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:40.154831 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9c6445ac-443b-4d9e-b1fd-cbacbca2d423 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:40.156113 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9c6445ac-443b-4d9e-b1fd-cbacbca2d423 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:40.259354 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-2f1c6430-996f-4392-b6e5-9f6332e69187 None None] Allocated IP 172.20.0.2 (0801dc22-1800-4894-89f9-dfbc338ac3c7/657c90d6-3d5c-4662-9469-7c036d9c1427/33e1bebe-426e-4f3a-9830-bddda9c66a81) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:37:40.355600 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c6445ac-443b-4d9e-b1fd-cbacbca2d423 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Pushing event updated for resources: {'Network': ['ID=4b5a3188-c7f2-4be0-aa36-2d366f493d66,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:40.369649 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 4b5a3188-c7f2-4be0-aa36-2d366f493d66 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:37:40.377259 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9c6445ac-443b-4d9e-b1fd-cbacbca2d423 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.5300457 Dec 09 21:37:40.377752 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55196) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:40.383633 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-f7326482-5581-4893-a00e-e8ba4f6536fe tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Request body: {'network': {'name': 'tempest-router-network02--1643840412'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:40.430363 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f7326482-5581-4893-a00e-e8ba4f6536fe tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Made reservation on behalf of 54c2ac9b331d4794a0ce58f8a47c8e80 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:37:40.434275 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f7326482-5581-4893-a00e-e8ba4f6536fe tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:40.473315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f7326482-5581-4893-a00e-e8ba4f6536fe tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] vlan segment allocate from pool success with {'vlan_id': 124, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:37:40.494939 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f7326482-5581-4893-a00e-e8ba4f6536fe tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:40.504756 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-f7326482-5581-4893-a00e-e8ba4f6536fe tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Added segment 8870fd07-fc23-4b81-ada4-c5f85689b638 of type vlan for network c069cacf-ee85-491f-b027-7eaec12acf6b Dec 09 21:37:40.608798 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f7326482-5581-4893-a00e-e8ba4f6536fe tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:40.681232 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f7326482-5581-4893-a00e-e8ba4f6536fe tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:40.694902 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7326482-5581-4893-a00e-e8ba4f6536fe tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:40.697835 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2f1c6430-996f-4392-b6e5-9f6332e69187 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:40.698440 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f7326482-5581-4893-a00e-e8ba4f6536fe tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:40.709173 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2f1c6430-996f-4392-b6e5-9f6332e69187 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:40.732431 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f1c6430-996f-4392-b6e5-9f6332e69187 None None] Network 0801dc22-1800-4894-89f9-dfbc338ac3c7 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:37:40.735341 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-2f1c6430-996f-4392-b6e5-9f6332e69187 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:37:40.739358 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f1c6430-996f-4392-b6e5-9f6332e69187 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:37:40.818114 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f7326482-5581-4893-a00e-e8ba4f6536fe tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.4388986 Dec 09 21:37:40.821462 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55212) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:40.827370 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-bacb2423-4db9-412d-8b6c-8cb18db33aef tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Request body: {'subnet': {'network_id': '4b5a3188-c7f2-4be0-aa36-2d366f493d66', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:40.894348 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f1c6430-996f-4392-b6e5-9f6332e69187 None None] Pushing event updated for resources: {'Port': ['ID=33e1bebe-426e-4f3a-9830-bddda9c66a81,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:40.925372 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2f1c6430-996f-4392-b6e5-9f6332e69187 None None] Attempting to bind port 33e1bebe-426e-4f3a-9830-bddda9c66a81 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:37:40.925766 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2f1c6430-996f-4392-b6e5-9f6332e69187 None None] Attempting to bind port 33e1bebe-426e-4f3a-9830-bddda9c66a81 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '76984479-c633-4f9c-b8b2-de009dc509fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '0801dc22-1800-4894-89f9-dfbc338ac3c7'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:37:40.926108 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f1c6430-996f-4392-b6e5-9f6332e69187 None None] Attempting to bind port 33e1bebe-426e-4f3a-9830-bddda9c66a81 on network 0801dc22-1800-4894-89f9-dfbc338ac3c7 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:37:40.939648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f1c6430-996f-4392-b6e5-9f6332e69187 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 37, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:37:40.940037 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f1c6430-996f-4392-b6e5-9f6332e69187 None None] Checking segment: {'id': '76984479-c633-4f9c-b8b2-de009dc509fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '0801dc22-1800-4894-89f9-dfbc338ac3c7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:37:40.941006 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2f1c6430-996f-4392-b6e5-9f6332e69187 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:40.943568 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f1c6430-996f-4392-b6e5-9f6332e69187 None None] Bound using segment: {'id': '76984479-c633-4f9c-b8b2-de009dc509fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '0801dc22-1800-4894-89f9-dfbc338ac3c7'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:37:40.944285 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2f1c6430-996f-4392-b6e5-9f6332e69187 None None] Bound port: 33e1bebe-426e-4f3a-9830-bddda9c66a81, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '76984479-c633-4f9c-b8b2-de009dc509fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 102, 'network_id': '0801dc22-1800-4894-89f9-dfbc338ac3c7'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:37:40.945069 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2f1c6430-996f-4392-b6e5-9f6332e69187 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:40.951315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7326482-5581-4893-a00e-e8ba4f6536fe tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Pushing event updated for resources: {'Network': ['ID=c069cacf-ee85-491f-b027-7eaec12acf6b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:41.070173 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network c069cacf-ee85-491f-b027-7eaec12acf6b details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:37:41.205374 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2f1c6430-996f-4392-b6e5-9f6332e69187 None None] For port 33e1bebe-426e-4f3a-9830-bddda9c66a81, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:37:41.210391 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2f1c6430-996f-4392-b6e5-9f6332e69187 None None] For port 33e1bebe-426e-4f3a-9830-bddda9c66a81, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=33e1bebe-426e-4f3a-9830-bddda9c66a81,segment=NetworkSegment(76984479-c633-4f9c-b8b2-de009dc509fd),segment_id=76984479-c633-4f9c-b8b2-de009dc509fd)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:37:41.220943 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2f1c6430-996f-4392-b6e5-9f6332e69187 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:41.365723 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f1c6430-996f-4392-b6e5-9f6332e69187 None None] Pushing event updated for resources: {'Port': ['ID=33e1bebe-426e-4f3a-9830-bddda9c66a81,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:41.377654 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bacb2423-4db9-412d-8b6c-8cb18db33aef tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Made reservation on behalf of 54c2ac9b331d4794a0ce58f8a47c8e80 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:37:41.382182 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bacb2423-4db9-412d-8b6c-8cb18db33aef tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:41.612319 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55222) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:41.635242 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bacb2423-4db9-412d-8b6c-8cb18db33aef tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:41.745040 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bacb2423-4db9-412d-8b6c-8cb18db33aef tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Pushing event updated for resources: {'Subnet': ['ID=537a6db5-9528-44c5-b845-de5a63012920,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:41.776632 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bacb2423-4db9-412d-8b6c-8cb18db33aef tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Checking segment: {'id': '132a2620-bb6d-48f6-af90-5bc0c853f6d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '4b5a3188-c7f2-4be0-aa36-2d366f493d66'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:37:41.778948 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bacb2423-4db9-412d-8b6c-8cb18db33aef tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Network hostable DHCP agents. Network: 4b5a3188-c7f2-4be0-aa36-2d366f493d66, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:37:41.811854 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bacb2423-4db9-412d-8b6c-8cb18db33aef tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Network 4b5a3188-c7f2-4be0-aa36-2d366f493d66 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:37:41.835766 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-bacb2423-4db9-412d-8b6c-8cb18db33aef tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 4b5a3188-c7f2-4be0-aa36-2d366f493d66) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:37:41.840728 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bacb2423-4db9-412d-8b6c-8cb18db33aef tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:41.841555 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bacb2423-4db9-412d-8b6c-8cb18db33aef tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:41.846739 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0923be37-4eea-4f11-8db1-77a4f26c423b None None] Network 4b5a3188-c7f2-4be0-aa36-2d366f493d66 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:37:41.874443 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bacb2423-4db9-412d-8b6c-8cb18db33aef tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.0517437 Dec 09 21:37:41.877069 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55228) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:41.882852 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-82404a66-4465-4a69-841e-ebdc7705a93b tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Request body: {'subnet': {'network_id': 'c069cacf-ee85-491f-b027-7eaec12acf6b', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:41.893151 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bc7b5835-5a5f-4402-8e97-b5f259995267 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:41.984182 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 33e1bebe-426e-4f3a-9830-bddda9c66a81 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:37:42.059616 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8102ffe7-e021-41c0-ba80-b367f9896d53 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-4b5a3188-c7f2-4be0-aa36-2d366f493d66', 'network_id': '4b5a3188-c7f2-4be0-aa36-2d366f493d66', 'project_id': '54c2ac9b331d4794a0ce58f8a47c8e80', 'fixed_ips': [{'subnet_id': '537a6db5-9528-44c5-b845-de5a63012920'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:37:42.060618 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8102ffe7-e021-41c0-ba80-b367f9896d53 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:42.064724 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bc7b5835-5a5f-4402-8e97-b5f259995267 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:42.065951 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-82404a66-4465-4a69-841e-ebdc7705a93b tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Made reservation on behalf of 54c2ac9b331d4794a0ce58f8a47c8e80 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:37:42.070007 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bc7b5835-5a5f-4402-8e97-b5f259995267 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:42.071234 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82404a66-4465-4a69-841e-ebdc7705a93b tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:42.106588 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7b5835-5a5f-4402-8e97-b5f259995267 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6b47f755-c25c-4908-81d8-7152a6d735f4,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:42.129436 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bc7b5835-5a5f-4402-8e97-b5f259995267 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=a35158ef570f4c96916b02e8acb0e77c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5158117 Dec 09 21:37:42.135972 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55232) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:42.203061 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-47dd2df4-bb0d-416c-a180-7c132a427ba9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:42.249223 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 33e1bebe-426e-4f3a-9830-bddda9c66a81 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:37:42.251313 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:42.252831 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-47dd2df4-bb0d-416c-a180-7c132a427ba9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:42.358807 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-47dd2df4-bb0d-416c-a180-7c132a427ba9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:42.371958 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-47dd2df4-bb0d-416c-a180-7c132a427ba9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:42.378799 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-47dd2df4-bb0d-416c-a180-7c132a427ba9 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/6b47f755-c25c-4908-81d8-7152a6d735f4 HTTP/1.1" status: 204 len: 168 time: 0.2417464 Dec 09 21:37:42.406271 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47dd2df4-bb0d-416c-a180-7c132a427ba9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6b47f755-c25c-4908-81d8-7152a6d735f4,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:42.419396 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-8102ffe7-e021-41c0-ba80-b367f9896d53 None None] Allocated IP 172.20.0.2 (4b5a3188-c7f2-4be0-aa36-2d366f493d66/537a6db5-9528-44c5-b845-de5a63012920/f83d39c0-605a-479c-927f-8dc34522d17f) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:37:42.435668 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82404a66-4465-4a69-841e-ebdc7705a93b tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:42.527957 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82404a66-4465-4a69-841e-ebdc7705a93b tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Pushing event updated for resources: {'Subnet': ['ID=2cae6daa-b360-443a-94f3-69d70802cb95,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:42.539465 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82404a66-4465-4a69-841e-ebdc7705a93b tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Checking segment: {'id': '8870fd07-fc23-4b81-ada4-c5f85689b638', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'c069cacf-ee85-491f-b027-7eaec12acf6b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:37:42.540111 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82404a66-4465-4a69-841e-ebdc7705a93b tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Network hostable DHCP agents. Network: c069cacf-ee85-491f-b027-7eaec12acf6b, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:37:42.567519 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82404a66-4465-4a69-841e-ebdc7705a93b tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Network c069cacf-ee85-491f-b027-7eaec12acf6b is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:37:42.579866 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-82404a66-4465-4a69-841e-ebdc7705a93b tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, c069cacf-ee85-491f-b027-7eaec12acf6b) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:37:42.586154 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82404a66-4465-4a69-841e-ebdc7705a93b tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:42.586867 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82404a66-4465-4a69-841e-ebdc7705a93b tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:42.591236 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-74d74cbd-802e-427e-8390-ba13f08ad102 None None] Network c069cacf-ee85-491f-b027-7eaec12acf6b requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:37:42.619505 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-82404a66-4465-4a69-841e-ebdc7705a93b tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.7410107 Dec 09 21:37:42.622468 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55238) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:42.625849 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:42.909142 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55244) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:42.933753 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ecd5271b-7a39-422f-ac9b-6f251e762afd admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:42.934017 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7989fb28-301d-4e9d-b0da-c55d3dc173aa None None] Network 0801dc22-1800-4894-89f9-dfbc338ac3c7 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:37:43.002709 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 33e1bebe-426e-4f3a-9830-bddda9c66a81, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=33e1bebe-426e-4f3a-9830-bddda9c66a81,segment=NetworkSegment(76984479-c633-4f9c-b8b2-de009dc509fd),segment_id=76984479-c633-4f9c-b8b2-de009dc509fd)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:37:43.025032 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:43.089337 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bd8f2acb-944f-4f24-a0cd-faa676d04499 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:43.099113 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6a1fa865-62f9-41f6-a0b5-90b8fc451ab5 None None] Provisioning complete for port 33e1bebe-426e-4f3a-9830-bddda9c66a81 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:37:43.099553 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6a1fa865-62f9-41f6-a0b5-90b8fc451ab5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:43.138691 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ecd5271b-7a39-422f-ac9b-6f251e762afd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:43.151023 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=33e1bebe-426e-4f3a-9830-bddda9c66a81,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:43.153019 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ecd5271b-7a39-422f-ac9b-6f251e762afd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:43.299860 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ecd5271b-7a39-422f-ac9b-6f251e762afd admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=b4e924a142274969af0eaef6b0e253fd&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3885984 Dec 09 21:37:43.309910 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55252) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:43.330850 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecd5271b-7a39-422f-ac9b-6f251e762afd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7da8947a-47f6-487b-a8f4-8e49b480f905,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:43.398564 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3630ef20-d70a-4599-aae2-b16e22f75d7e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:43.426830 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3630ef20-d70a-4599-aae2-b16e22f75d7e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:43.431377 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa422023-b70a-40ca-a69e-8f06a3ec51ed None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-c069cacf-ee85-491f-b027-7eaec12acf6b', 'network_id': 'c069cacf-ee85-491f-b027-7eaec12acf6b', 'project_id': '54c2ac9b331d4794a0ce58f8a47c8e80', 'fixed_ips': [{'subnet_id': '2cae6daa-b360-443a-94f3-69d70802cb95'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:37:43.432433 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fa422023-b70a-40ca-a69e-8f06a3ec51ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:43.441250 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8102ffe7-e021-41c0-ba80-b367f9896d53 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:43.486318 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8102ffe7-e021-41c0-ba80-b367f9896d53 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:43.499475 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3630ef20-d70a-4599-aae2-b16e22f75d7e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:43.503061 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3630ef20-d70a-4599-aae2-b16e22f75d7e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:43.507730 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3630ef20-d70a-4599-aae2-b16e22f75d7e admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/7da8947a-47f6-487b-a8f4-8e49b480f905 HTTP/1.1" status: 204 len: 168 time: 0.1967309 Dec 09 21:37:43.516927 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3630ef20-d70a-4599-aae2-b16e22f75d7e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7da8947a-47f6-487b-a8f4-8e49b480f905,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:43.666892 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-bd8f2acb-944f-4f24-a0cd-faa676d04499 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Allocated IP 172.20.0.1 (4b5a3188-c7f2-4be0-aa36-2d366f493d66/537a6db5-9528-44c5-b845-de5a63012920/8b4a70b9-ce04-4545-bedd-3a88cb9fd848) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:37:43.727404 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8102ffe7-e021-41c0-ba80-b367f9896d53 None None] Pushing event updated for resources: {'Port': ['ID=f83d39c0-605a-479c-927f-8dc34522d17f,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:43.889083 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8102ffe7-e021-41c0-ba80-b367f9896d53 None None] Network 4b5a3188-c7f2-4be0-aa36-2d366f493d66 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:37:43.920216 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 33e1bebe-426e-4f3a-9830-bddda9c66a81 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:37:43.986459 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-8102ffe7-e021-41c0-ba80-b367f9896d53 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:37:43.995347 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8102ffe7-e021-41c0-ba80-b367f9896d53 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:37:44.035021 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bd8f2acb-944f-4f24-a0cd-faa676d04499 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:44.102083 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bd8f2acb-944f-4f24-a0cd-faa676d04499 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:44.180295 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bd8f2acb-944f-4f24-a0cd-faa676d04499 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Network 4b5a3188-c7f2-4be0-aa36-2d366f493d66 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:37:44.191648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-8102ffe7-e021-41c0-ba80-b367f9896d53 None None] Attempting to bind port f83d39c0-605a-479c-927f-8dc34522d17f on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:37:44.192278 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-8102ffe7-e021-41c0-ba80-b367f9896d53 None None] Attempting to bind port f83d39c0-605a-479c-927f-8dc34522d17f by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '132a2620-bb6d-48f6-af90-5bc0c853f6d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '4b5a3188-c7f2-4be0-aa36-2d366f493d66'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:37:44.193709 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8102ffe7-e021-41c0-ba80-b367f9896d53 None None] Attempting to bind port f83d39c0-605a-479c-927f-8dc34522d17f on network 4b5a3188-c7f2-4be0-aa36-2d366f493d66 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:37:44.196725 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-bd8f2acb-944f-4f24-a0cd-faa676d04499 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:37:44.207424 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd8f2acb-944f-4f24-a0cd-faa676d04499 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:37:44.215735 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 33e1bebe-426e-4f3a-9830-bddda9c66a81 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:37:44.216763 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:44.279087 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8102ffe7-e021-41c0-ba80-b367f9896d53 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 37, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:37:44.280016 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8102ffe7-e021-41c0-ba80-b367f9896d53 None None] Checking segment: {'id': '132a2620-bb6d-48f6-af90-5bc0c853f6d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '4b5a3188-c7f2-4be0-aa36-2d366f493d66'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:37:44.280501 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8102ffe7-e021-41c0-ba80-b367f9896d53 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:44.280977 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8102ffe7-e021-41c0-ba80-b367f9896d53 None None] Bound using segment: {'id': '132a2620-bb6d-48f6-af90-5bc0c853f6d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '4b5a3188-c7f2-4be0-aa36-2d366f493d66'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:37:44.281579 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-8102ffe7-e021-41c0-ba80-b367f9896d53 None None] Bound port: f83d39c0-605a-479c-927f-8dc34522d17f, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '132a2620-bb6d-48f6-af90-5bc0c853f6d8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 147, 'network_id': '4b5a3188-c7f2-4be0-aa36-2d366f493d66'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:37:44.282159 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8102ffe7-e021-41c0-ba80-b367f9896d53 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:44.283311 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd8f2acb-944f-4f24-a0cd-faa676d04499 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Pushing event updated for resources: {'Port': ['ID=8b4a70b9-ce04-4545-bedd-3a88cb9fd848,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:44.333273 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bd8f2acb-944f-4f24-a0cd-faa676d04499 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:44.432811 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-fa422023-b70a-40ca-a69e-8f06a3ec51ed None None] Allocated IP 172.20.0.2 (c069cacf-ee85-491f-b027-7eaec12acf6b/2cae6daa-b360-443a-94f3-69d70802cb95/ee0bf36b-5618-4777-b4c6-c6b8f64f18fd) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:37:44.618671 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bd8f2acb-944f-4f24-a0cd-faa676d04499 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:44.627472 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-594b0aaf-1597-4c58-9467-bc109f813bef None None] Provisioning complete for port 33e1bebe-426e-4f3a-9830-bddda9c66a81 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:37:44.627885 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-594b0aaf-1597-4c58-9467-bc109f813bef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:44.780094 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fa422023-b70a-40ca-a69e-8f06a3ec51ed None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:44.804820 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-8102ffe7-e021-41c0-ba80-b367f9896d53 None None] For port f83d39c0-605a-479c-927f-8dc34522d17f, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:37:44.894558 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fa422023-b70a-40ca-a69e-8f06a3ec51ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:44.966868 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-8102ffe7-e021-41c0-ba80-b367f9896d53 None None] For port f83d39c0-605a-479c-927f-8dc34522d17f, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f83d39c0-605a-479c-927f-8dc34522d17f,segment=NetworkSegment(132a2620-bb6d-48f6-af90-5bc0c853f6d8),segment_id=132a2620-bb6d-48f6-af90-5bc0c853f6d8)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:37:44.970653 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa422023-b70a-40ca-a69e-8f06a3ec51ed None None] Pushing event updated for resources: {'Port': ['ID=ee0bf36b-5618-4777-b4c6-c6b8f64f18fd,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:45.012404 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bd8f2acb-944f-4f24-a0cd-faa676d04499 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:45.017801 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8102ffe7-e021-41c0-ba80-b367f9896d53 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:45.019243 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bd8f2acb-944f-4f24-a0cd-faa676d04499 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:45.075106 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8102ffe7-e021-41c0-ba80-b367f9896d53 None None] Pushing event updated for resources: {'Port': ['ID=f83d39c0-605a-479c-927f-8dc34522d17f,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:45.090646 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fa422023-b70a-40ca-a69e-8f06a3ec51ed None None] Network c069cacf-ee85-491f-b027-7eaec12acf6b is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:37:45.098419 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-fa422023-b70a-40ca-a69e-8f06a3ec51ed None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:37:45.105216 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa422023-b70a-40ca-a69e-8f06a3ec51ed None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:37:45.121912 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd8f2acb-944f-4f24-a0cd-faa676d04499 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Pushing event updated for resources: {'Port': ['ID=8b4a70b9-ce04-4545-bedd-3a88cb9fd848,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:45.156707 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bd8f2acb-944f-4f24-a0cd-faa676d04499 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:45.184152 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-fa422023-b70a-40ca-a69e-8f06a3ec51ed None None] Attempting to bind port ee0bf36b-5618-4777-b4c6-c6b8f64f18fd on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:37:45.184533 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-fa422023-b70a-40ca-a69e-8f06a3ec51ed None None] Attempting to bind port ee0bf36b-5618-4777-b4c6-c6b8f64f18fd by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '8870fd07-fc23-4b81-ada4-c5f85689b638', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'c069cacf-ee85-491f-b027-7eaec12acf6b'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:37:45.185418 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa422023-b70a-40ca-a69e-8f06a3ec51ed None None] Attempting to bind port ee0bf36b-5618-4777-b4c6-c6b8f64f18fd on network c069cacf-ee85-491f-b027-7eaec12acf6b {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:37:45.190849 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa422023-b70a-40ca-a69e-8f06a3ec51ed None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 37, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:37:45.191231 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa422023-b70a-40ca-a69e-8f06a3ec51ed None None] Checking segment: {'id': '8870fd07-fc23-4b81-ada4-c5f85689b638', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'c069cacf-ee85-491f-b027-7eaec12acf6b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:37:45.191782 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fa422023-b70a-40ca-a69e-8f06a3ec51ed None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:45.192189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa422023-b70a-40ca-a69e-8f06a3ec51ed None None] Bound using segment: {'id': '8870fd07-fc23-4b81-ada4-c5f85689b638', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'c069cacf-ee85-491f-b027-7eaec12acf6b'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:37:45.192658 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-fa422023-b70a-40ca-a69e-8f06a3ec51ed None None] Bound port: ee0bf36b-5618-4777-b4c6-c6b8f64f18fd, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8870fd07-fc23-4b81-ada4-c5f85689b638', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'c069cacf-ee85-491f-b027-7eaec12acf6b'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:37:45.193127 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fa422023-b70a-40ca-a69e-8f06a3ec51ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:45.273472 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bd8f2acb-944f-4f24-a0cd-faa676d04499 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Network 4b5a3188-c7f2-4be0-aa36-2d366f493d66 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:37:45.277499 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-bd8f2acb-944f-4f24-a0cd-faa676d04499 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:37:45.278318 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-fa422023-b70a-40ca-a69e-8f06a3ec51ed None None] For port ee0bf36b-5618-4777-b4c6-c6b8f64f18fd, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:37:45.281824 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-fa422023-b70a-40ca-a69e-8f06a3ec51ed None None] For port ee0bf36b-5618-4777-b4c6-c6b8f64f18fd, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=ee0bf36b-5618-4777-b4c6-c6b8f64f18fd,segment=NetworkSegment(8870fd07-fc23-4b81-ada4-c5f85689b638),segment_id=8870fd07-fc23-4b81-ada4-c5f85689b638)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:37:45.290636 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fa422023-b70a-40ca-a69e-8f06a3ec51ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:45.351749 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa422023-b70a-40ca-a69e-8f06a3ec51ed None None] Pushing event updated for resources: {'Port': ['ID=ee0bf36b-5618-4777-b4c6-c6b8f64f18fd,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:45.429437 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55296) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:45.603863 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bd8f2acb-944f-4f24-a0cd-faa676d04499 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Router 7ed3b09c-7780-49b1-aff1-9907ad810d61 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:37:45.648720 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7aa080ae-09f0-4154-8f4d-754230032328 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:45.814780 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7aa080ae-09f0-4154-8f4d-754230032328 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:45.821822 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7aa080ae-09f0-4154-8f4d-754230032328 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:45.841010 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bd8f2acb-944f-4f24-a0cd-faa676d04499 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:37:45.855261 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6de7c561-cc7f-49cf-98dc-6c0250761e49 None None] Sync routers for ids ['7ed3b09c-7780-49b1-aff1-9907ad810d61'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:37:45.859012 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bd8f2acb-944f-4f24-a0cd-faa676d04499 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "PUT /v2.0/routers/7ed3b09c-7780-49b1-aff1-9907ad810d61/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2285914 Dec 09 21:37:45.859695 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55306) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:45.867478 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6de7c561-cc7f-49cf-98dc-6c0250761e49 None None] Routers {'7ed3b09c-7780-49b1-aff1-9907ad810d61'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:37:45.873276 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-6de7c561-cc7f-49cf-98dc-6c0250761e49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:37:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7ed3b09c-7780-49b1-aff1-9907ad810d61'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:45.874277 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7aa080ae-09f0-4154-8f4d-754230032328 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=b93f43e9c80843b7865094593c260c49&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4430964 Dec 09 21:37:45.875110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55308) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:45.978834 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7aa080ae-09f0-4154-8f4d-754230032328 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8d86b28a-949e-4bdc-8c23-9f413aee9bd4,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:45.989268 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-6de7c561-cc7f-49cf-98dc-6c0250761e49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:46.028354 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f5672ce-8745-4ba4-91b0-3d0ee3e868b0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:46.044475 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6de7c561-cc7f-49cf-98dc-6c0250761e49 None None] Routers {'7ed3b09c-7780-49b1-aff1-9907ad810d61'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:37:46.045128 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-6de7c561-cc7f-49cf-98dc-6c0250761e49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:37:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7ed3b09c-7780-49b1-aff1-9907ad810d61'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:46.078051 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f5672ce-8745-4ba4-91b0-3d0ee3e868b0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:46.113674 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device ee0bf36b-5618-4777-b4c6-c6b8f64f18fd up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:37:46.126060 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-6de7c561-cc7f-49cf-98dc-6c0250761e49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:46.127022 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6de7c561-cc7f-49cf-98dc-6c0250761e49 None None] The sync data for ids ['7ed3b09c-7780-49b1-aff1-9907ad810d61'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:37:46.197778 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f5672ce-8745-4ba4-91b0-3d0ee3e868b0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:46.201056 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f5672ce-8745-4ba4-91b0-3d0ee3e868b0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:46.202483 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3f5672ce-8745-4ba4-91b0-3d0ee3e868b0 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/8d86b28a-949e-4bdc-8c23-9f413aee9bd4 HTTP/1.1" status: 204 len: 168 time: 0.3247795 Dec 09 21:37:46.216082 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f5672ce-8745-4ba4-91b0-3d0ee3e868b0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d86b28a-949e-4bdc-8c23-9f413aee9bd4,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:46.316582 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port ee0bf36b-5618-4777-b4c6-c6b8f64f18fd triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:37:46.320260 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:46.543171 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:46.592438 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port ee0bf36b-5618-4777-b4c6-c6b8f64f18fd, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=ee0bf36b-5618-4777-b4c6-c6b8f64f18fd,segment=NetworkSegment(8870fd07-fc23-4b81-ada4-c5f85689b638),segment_id=8870fd07-fc23-4b81-ada4-c5f85689b638)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:37:46.600484 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:46.602615 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f83d39c0-605a-479c-927f-8dc34522d17f up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:37:46.732942 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=ee0bf36b-5618-4777-b4c6-c6b8f64f18fd,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:46.802396 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f83d39c0-605a-479c-927f-8dc34522d17f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:37:46.803333 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:47.122757 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8fb85b09-6f49-47b6-b524-236a0c2f3d1b None None] Network 4b5a3188-c7f2-4be0-aa36-2d366f493d66 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:37:47.170207 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-2b26aeec-e646-4970-9127-a9083413f68c tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] add_router_interface failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:37:47.170997 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2b26aeec-e646-4970-9127-a9083413f68c tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "PUT /v2.0/routers/7ed3b09c-7780-49b1-aff1-9907ad810d61/add_router_interface HTTP/1.1" status: 400 len: 438 time: 1.3073997 Dec 09 21:37:47.174299 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55332) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:47.219233 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-0b2de397-2fdd-41c0-9aaa-69877bfe04bd None None] Provisioning complete for port f83d39c0-605a-479c-927f-8dc34522d17f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:37:47.219635 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0b2de397-2fdd-41c0-9aaa-69877bfe04bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:47.402468 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:47.446015 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0b2de397-2fdd-41c0-9aaa-69877bfe04bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:47.495275 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-217700bb-466a-401f-8165-f8d7fbf77e71 None None] Network c069cacf-ee85-491f-b027-7eaec12acf6b requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:37:47.503215 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port f83d39c0-605a-479c-927f-8dc34522d17f, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f83d39c0-605a-479c-927f-8dc34522d17f,segment=NetworkSegment(132a2620-bb6d-48f6-af90-5bc0c853f6d8),segment_id=132a2620-bb6d-48f6-af90-5bc0c853f6d8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:37:47.538535 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:47.677283 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-0b2de397-2fdd-41c0-9aaa-69877bfe04bd None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:37:47.677939 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-0b2de397-2fdd-41c0-9aaa-69877bfe04bd None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:37:47.711145 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=f83d39c0-605a-479c-927f-8dc34522d17f,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:47.894340 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device ee0bf36b-5618-4777-b4c6-c6b8f64f18fd up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:37:47.901934 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e8c92477-a173-4534-8401-97c8599a49dc tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:48.002507 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port ee0bf36b-5618-4777-b4c6-c6b8f64f18fd triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:37:48.003034 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:48.128390 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f83d39c0-605a-479c-927f-8dc34522d17f up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:37:48.283222 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f83d39c0-605a-479c-927f-8dc34522d17f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:37:48.283719 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:48.296146 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-e8c92477-a173-4534-8401-97c8599a49dc tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Deleting port 8b4a70b9-ce04-4545-bedd-3a88cb9fd848 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:37:48.297953 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e8c92477-a173-4534-8401-97c8599a49dc tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:48.409899 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-fcd0a668-45f7-4493-8c66-b762e71e838c None None] Provisioning complete for port f83d39c0-605a-479c-927f-8dc34522d17f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:37:48.410338 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fcd0a668-45f7-4493-8c66-b762e71e838c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:48.417062 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e8c92477-a173-4534-8401-97c8599a49dc tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:48.439646 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-e8c92477-a173-4534-8401-97c8599a49dc tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Calling delete_port for 8b4a70b9-ce04-4545-bedd-3a88cb9fd848 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:37:48.644821 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-fcd0a668-45f7-4493-8c66-b762e71e838c None None] Provisioning complete for port 8b4a70b9-ce04-4545-bedd-3a88cb9fd848 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:37:48.645186 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fcd0a668-45f7-4493-8c66-b762e71e838c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:48.696019 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-fcd0a668-45f7-4493-8c66-b762e71e838c None None] Port 8b4a70b9-ce04-4545-bedd-3a88cb9fd848 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:37:48.708065 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-fcd0a668-45f7-4493-8c66-b762e71e838c None None] Provisioning complete for port ee0bf36b-5618-4777-b4c6-c6b8f64f18fd triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:37:48.708441 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fcd0a668-45f7-4493-8c66-b762e71e838c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:48.778684 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e8c92477-a173-4534-8401-97c8599a49dc tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:48.820192 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8c92477-a173-4534-8401-97c8599a49dc tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Pushing event deleted for resources: {'Port': ['ID=8b4a70b9-ce04-4545-bedd-3a88cb9fd848,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:48.965893 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-51a07784-d3d6-4f04-89c4-60b85161e8f3 None None] Could not find standard attr ID for object 8b4a70b9-ce04-4545-bedd-3a88cb9fd848. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:37:49.041378 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e8c92477-a173-4534-8401-97c8599a49dc tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:49.227904 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e8c92477-a173-4534-8401-97c8599a49dc tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Router 7ed3b09c-7780-49b1-aff1-9907ad810d61 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:37:49.306745 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e8c92477-a173-4534-8401-97c8599a49dc tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:37:49.316137 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e8c92477-a173-4534-8401-97c8599a49dc tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "PUT /v2.0/routers/7ed3b09c-7780-49b1-aff1-9907ad810d61/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1371076 Dec 09 21:37:49.316358 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55360) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:49.323977 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8a0ed67-b339-48f1-b7e8-16714f0e83e6 None None] Sync routers for ids ['7ed3b09c-7780-49b1-aff1-9907ad810d61'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:37:49.338903 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8a0ed67-b339-48f1-b7e8-16714f0e83e6 None None] Routers {'7ed3b09c-7780-49b1-aff1-9907ad810d61'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:37:49.339937 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-c8a0ed67-b339-48f1-b7e8-16714f0e83e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:37:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7ed3b09c-7780-49b1-aff1-9907ad810d61'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:49.361473 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-9c24c96c-72b4-4b7c-bb56-3b9b9e634865 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] delete failed (client error): The resource could not be found. Dec 09 21:37:49.362911 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9c24c96c-72b4-4b7c-bb56-3b9b9e634865 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "DELETE /v2.0/routers/tempest-non_exist_router-911575953 HTTP/1.1" status: 404 len: 334 time: 0.0455556 Dec 09 21:37:49.367010 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55362) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:49.372472 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-94693a3a-a44c-4002-a9bd-be5c36dbfa51 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Request body: {'router': {'external_gateway_info': {'network_id': '7ed3b09c-7780-49b1-aff1-9907ad810d61'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:49.381386 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-c8a0ed67-b339-48f1-b7e8-16714f0e83e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:49.390160 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8a0ed67-b339-48f1-b7e8-16714f0e83e6 None None] Routers {'7ed3b09c-7780-49b1-aff1-9907ad810d61'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:37:49.390748 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-c8a0ed67-b339-48f1-b7e8-16714f0e83e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:37:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7ed3b09c-7780-49b1-aff1-9907ad810d61'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:49.423910 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-c8a0ed67-b339-48f1-b7e8-16714f0e83e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:49.424558 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8a0ed67-b339-48f1-b7e8-16714f0e83e6 None None] The sync data for ids ['7ed3b09c-7780-49b1-aff1-9907ad810d61'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:37:49.611699 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-94693a3a-a44c-4002-a9bd-be5c36dbfa51 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:49.640778 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-94693a3a-a44c-4002-a9bd-be5c36dbfa51 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] update failed (client error): The resource could not be found. Dec 09 21:37:49.641903 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-94693a3a-a44c-4002-a9bd-be5c36dbfa51 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "PUT /v2.0/routers/7ed3b09c-7780-49b1-aff1-9907ad810d61 HTTP/1.1" status: 404 len: 339 time: 0.2734957 Dec 09 21:37:49.645827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55366) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:49.941479 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6351a9a9-9649-47c6-8633-42918708e1b9 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:50.200698 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-6351a9a9-9649-47c6-8633-42918708e1b9 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Allocated IP 172.20.0.1 (0801dc22-1800-4894-89f9-dfbc338ac3c7/657c90d6-3d5c-4662-9469-7c036d9c1427/bcf2a27b-da49-42f0-ac56-71d09efd1a1a) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:37:50.341043 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6351a9a9-9649-47c6-8633-42918708e1b9 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:50.384911 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6351a9a9-9649-47c6-8633-42918708e1b9 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:50.435202 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6351a9a9-9649-47c6-8633-42918708e1b9 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Network 0801dc22-1800-4894-89f9-dfbc338ac3c7 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:37:50.438899 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-6351a9a9-9649-47c6-8633-42918708e1b9 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:37:50.441727 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6351a9a9-9649-47c6-8633-42918708e1b9 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:37:50.479376 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6351a9a9-9649-47c6-8633-42918708e1b9 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Pushing event updated for resources: {'Port': ['ID=bcf2a27b-da49-42f0-ac56-71d09efd1a1a,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:50.508073 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6351a9a9-9649-47c6-8633-42918708e1b9 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:50.708796 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6351a9a9-9649-47c6-8633-42918708e1b9 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:50.913854 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c617d2b7-2dcd-41ee-9276-0f541646d443 None None] Provisioning complete for port bcf2a27b-da49-42f0-ac56-71d09efd1a1a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:37:50.914974 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c617d2b7-2dcd-41ee-9276-0f541646d443 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:50.964119 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-c617d2b7-2dcd-41ee-9276-0f541646d443 None None] Port bcf2a27b-da49-42f0-ac56-71d09efd1a1a cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:37:51.351971 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09621251-d25c-459d-8ebc-8676f8ef909e req-2a75fa7c-358c-4eb9-9995-16f6318bb703 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:51.357723 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09621251-d25c-459d-8ebc-8676f8ef909e req-2a75fa7c-358c-4eb9-9995-16f6318bb703 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:51.363521 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09621251-d25c-459d-8ebc-8676f8ef909e req-2a75fa7c-358c-4eb9-9995-16f6318bb703 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:51.369472 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09621251-d25c-459d-8ebc-8676f8ef909e req-2a75fa7c-358c-4eb9-9995-16f6318bb703 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:51.375303 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09621251-d25c-459d-8ebc-8676f8ef909e req-2a75fa7c-358c-4eb9-9995-16f6318bb703 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:51.381122 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09621251-d25c-459d-8ebc-8676f8ef909e req-2a75fa7c-358c-4eb9-9995-16f6318bb703 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:51.386909 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09621251-d25c-459d-8ebc-8676f8ef909e req-2a75fa7c-358c-4eb9-9995-16f6318bb703 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:51.388840 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09621251-d25c-459d-8ebc-8676f8ef909e req-2a75fa7c-358c-4eb9-9995-16f6318bb703 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5434 time: 0.1286473 Dec 09 21:37:51.516951 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09621251-d25c-459d-8ebc-8676f8ef909e req-bd9a49e4-bc47-4d3e-b29c-ad3844fac0a8 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1207964 Dec 09 21:37:51.536519 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6351a9a9-9649-47c6-8633-42918708e1b9 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:51.543141 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6351a9a9-9649-47c6-8633-42918708e1b9 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:51.627185 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6351a9a9-9649-47c6-8633-42918708e1b9 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Pushing event updated for resources: {'Port': ['ID=bcf2a27b-da49-42f0-ac56-71d09efd1a1a,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:51.630311 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6351a9a9-9649-47c6-8633-42918708e1b9 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:51.732224 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6351a9a9-9649-47c6-8633-42918708e1b9 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Network 0801dc22-1800-4894-89f9-dfbc338ac3c7 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:37:51.733652 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-6351a9a9-9649-47c6-8633-42918708e1b9 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:37:51.872106 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6351a9a9-9649-47c6-8633-42918708e1b9 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Router 7ed3b09c-7780-49b1-aff1-9907ad810d61 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:37:51.998779 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-db4ba82c-3b1a-4cd8-b1ff-e71937038867 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:52.005668 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-db4ba82c-3b1a-4cd8-b1ff-e71937038867 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:52.015117 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-db4ba82c-3b1a-4cd8-b1ff-e71937038867 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:52.019042 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6351a9a9-9649-47c6-8633-42918708e1b9 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:37:52.023496 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-db4ba82c-3b1a-4cd8-b1ff-e71937038867 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:52.029022 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35e57c98-dba4-4df1-a9f4-7566b558935c None None] Sync routers for ids ['7ed3b09c-7780-49b1-aff1-9907ad810d61'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:37:52.032219 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6351a9a9-9649-47c6-8633-42918708e1b9 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "PUT /v2.0/routers/7ed3b09c-7780-49b1-aff1-9907ad810d61/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3847172 Dec 09 21:37:52.032462 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-db4ba82c-3b1a-4cd8-b1ff-e71937038867 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:52.037988 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55404) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:52.039184 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35e57c98-dba4-4df1-a9f4-7566b558935c None None] Routers {'7ed3b09c-7780-49b1-aff1-9907ad810d61'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:37:52.039739 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-35e57c98-dba4-4df1-a9f4-7566b558935c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:37:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7ed3b09c-7780-49b1-aff1-9907ad810d61'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:52.039907 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-db4ba82c-3b1a-4cd8-b1ff-e71937038867 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:52.045716 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-db4ba82c-3b1a-4cd8-b1ff-e71937038867 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:52.047961 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-db4ba82c-3b1a-4cd8-b1ff-e71937038867 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.10 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 5434 time: 0.1392391 Dec 09 21:37:52.081539 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-35e57c98-dba4-4df1-a9f4-7566b558935c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:52.094438 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35e57c98-dba4-4df1-a9f4-7566b558935c None None] Routers {'7ed3b09c-7780-49b1-aff1-9907ad810d61'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:37:52.095303 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-35e57c98-dba4-4df1-a9f4-7566b558935c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:37:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7ed3b09c-7780-49b1-aff1-9907ad810d61'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:52.101160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-e413d102-4e78-4192-9c28-a4f90cc7778d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['binding:profile'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:52.102589 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-e413d102-4e78-4192-9c28-a4f90cc7778d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.10 "GET /v2.0/ports/1e946a47-f496-445b-964b-618881eab263?fields=binding%3Aprofile&fields=network_id HTTP/1.1" status: 200 len: 260 time: 0.0442085 Dec 09 21:37:52.110658 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a9288b37-208e-4b38-96c3-73be8dc3138d None None] Provisioning complete for port bcf2a27b-da49-42f0-ac56-71d09efd1a1a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:37:52.111244 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a9288b37-208e-4b38-96c3-73be8dc3138d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:52.133392 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-35e57c98-dba4-4df1-a9f4-7566b558935c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:52.134348 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35e57c98-dba4-4df1-a9f4-7566b558935c None None] The sync data for ids ['7ed3b09c-7780-49b1-aff1-9907ad810d61'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:37:52.194104 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a9288b37-208e-4b38-96c3-73be8dc3138d None None] Port bcf2a27b-da49-42f0-ac56-71d09efd1a1a cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:37:52.218576 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ba1e3d25-0584-47ad-abad-1c2a8fbe49a7 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:52.237286 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-119de20e-0eef-44f0-b853-433cbd1ec624 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.10 "GET /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1?fields=dns_domain HTTP/1.1" status: 200 len: 212 time: 0.1279256 Dec 09 21:37:52.249410 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-41e9e251-5ff7-4326-b5bc-cce16efe6b0b service neutron] Request body: {'port': {'device_id': '', 'device_owner': '', 'binding:host_id': None, 'binding:profile': {}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:52.317585 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-41e9e251-5ff7-4326-b5bc-cce16efe6b0b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:52.337363 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-ba1e3d25-0584-47ad-abad-1c2a8fbe49a7 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] delete failed (client error): There was a conflict when trying to complete your request. Dec 09 21:37:52.345191 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ba1e3d25-0584-47ad-abad-1c2a8fbe49a7 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "DELETE /v2.0/routers/7ed3b09c-7780-49b1-aff1-9907ad810d61 HTTP/1.1" status: 409 len: 329 time: 0.3033128 Dec 09 21:37:52.345936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55412) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:52.493596 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-41e9e251-5ff7-4326-b5bc-cce16efe6b0b service neutron] For port 1e946a47-f496-445b-964b-618881eab263, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1e946a47-f496-445b-964b-618881eab263,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:37:52.562216 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-41e9e251-5ff7-4326-b5bc-cce16efe6b0b service neutron] For port 1e946a47-f496-445b-964b-618881eab263, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:37:52.599062 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-41e9e251-5ff7-4326-b5bc-cce16efe6b0b service neutron] device_id is not set on port 1e946a47-f496-445b-964b-618881eab263 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:37:52.611035 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-41e9e251-5ff7-4326-b5bc-cce16efe6b0b service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:52.630843 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-41e9e251-5ff7-4326-b5bc-cce16efe6b0b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:52.658962 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72296dbb-f03c-42e5-8745-1f3e117171cc req-fdbf2adf-531e-4806-bb6a-7607a25347ff tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:52.666693 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72296dbb-f03c-42e5-8745-1f3e117171cc req-fdbf2adf-531e-4806-bb6a-7607a25347ff tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7 HTTP/1.1" status: 200 len: 945 time: 0.1234188 Dec 09 21:37:52.702996 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-41e9e251-5ff7-4326-b5bc-cce16efe6b0b service neutron] No DVR routers for this DVR port 1e946a47-f496-445b-964b-618881eab263 on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:37:52.728641 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41e9e251-5ff7-4326-b5bc-cce16efe6b0b service neutron] Pushing event updated for resources: {'Port': ['ID=1e946a47-f496-445b-964b-618881eab263,revision_number=6']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:52.776071 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72296dbb-f03c-42e5-8745-1f3e117171cc req-272ecf91-be74-4bf0-9764-c4cca4ea77d0 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=19432415-a2e0-4a11-9022-46c83da8ae04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1083932 Dec 09 21:37:52.779566 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-41e9e251-5ff7-4326-b5bc-cce16efe6b0b service neutron] In _notify_port_updated(), no bound segment for port 1e946a47-f496-445b-964b-618881eab263 on network a859e4ba-764a-41c0-982d-5bf79a2797a1 {{(pid=103437) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:37:52.781943 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-41e9e251-5ff7-4326-b5bc-cce16efe6b0b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:52.784950 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-41e9e251-5ff7-4326-b5bc-cce16efe6b0b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:52.787918 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-41e9e251-5ff7-4326-b5bc-cce16efe6b0b service neutron] 10.222.0.10 "PUT /v2.0/ports/1e946a47-f496-445b-964b-618881eab263 HTTP/1.1" status: 200 len: 1026 time: 0.5413253 Dec 09 21:37:52.896819 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-0d73dabe-14b6-45c0-8b92-892cb2ec9708 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['binding:profile'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:52.906816 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-0d73dabe-14b6-45c0-8b92-892cb2ec9708 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.10 "GET /v2.0/ports/145a0cde-0fe5-4163-a063-0fdfe42f243b?fields=binding%3Aprofile&fields=network_id HTTP/1.1" status: 200 len: 260 time: 0.1020670 Dec 09 21:37:52.923019 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-483ff6d9-753f-41d0-9479-fd94820d0272 service neutron] Request body: {'port': {'device_id': '', 'device_owner': '', 'binding:host_id': None, 'binding:profile': {}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:52.948421 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-451d0dab-1a66-42d9-b542-a4b0adc53a96 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:53.014234 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-483ff6d9-753f-41d0-9479-fd94820d0272 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:53.027388 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4653d3f5-9dc8-4203-9b68-bd133d6b5d1d None None] Provisioning complete for port 1e946a47-f496-445b-964b-618881eab263 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:37:53.027765 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4653d3f5-9dc8-4203-9b68-bd133d6b5d1d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:53.066936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65b6b95e-05cf-484a-9fd8-934c94babd1e req-569c043e-ff0f-4e36-9458-5b262af08bf1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:53.073780 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65b6b95e-05cf-484a-9fd8-934c94babd1e req-569c043e-ff0f-4e36-9458-5b262af08bf1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:53.074295 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-4653d3f5-9dc8-4203-9b68-bd133d6b5d1d None None] Port 1e946a47-f496-445b-964b-618881eab263 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:37:53.080187 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65b6b95e-05cf-484a-9fd8-934c94babd1e req-569c043e-ff0f-4e36-9458-5b262af08bf1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:53.086533 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65b6b95e-05cf-484a-9fd8-934c94babd1e req-569c043e-ff0f-4e36-9458-5b262af08bf1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:53.092412 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65b6b95e-05cf-484a-9fd8-934c94babd1e req-569c043e-ff0f-4e36-9458-5b262af08bf1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:53.098234 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65b6b95e-05cf-484a-9fd8-934c94babd1e req-569c043e-ff0f-4e36-9458-5b262af08bf1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:53.100870 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-65b6b95e-05cf-484a-9fd8-934c94babd1e req-569c043e-ff0f-4e36-9458-5b262af08bf1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 4661 time: 0.1899819 Dec 09 21:37:53.183299 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-483ff6d9-753f-41d0-9479-fd94820d0272 service neutron] For port 145a0cde-0fe5-4163-a063-0fdfe42f243b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=145a0cde-0fe5-4163-a063-0fdfe42f243b,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:37:53.221662 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-483ff6d9-753f-41d0-9479-fd94820d0272 service neutron] For port 145a0cde-0fe5-4163-a063-0fdfe42f243b, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:37:53.239378 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-65b6b95e-05cf-484a-9fd8-934c94babd1e req-b86d1864-a189-407e-a4df-399bf4aaa291 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=c9dd44b4-64da-4ec9-9419-32736736a6d2&id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1225660 Dec 09 21:37:53.259212 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-483ff6d9-753f-41d0-9479-fd94820d0272 service neutron] device_id is not set on port 145a0cde-0fe5-4163-a063-0fdfe42f243b yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:37:53.284974 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-483ff6d9-753f-41d0-9479-fd94820d0272 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:53.291305 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-483ff6d9-753f-41d0-9479-fd94820d0272 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:53.367040 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-483ff6d9-753f-41d0-9479-fd94820d0272 service neutron] No DVR routers for this DVR port 145a0cde-0fe5-4163-a063-0fdfe42f243b on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:37:53.369469 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-483ff6d9-753f-41d0-9479-fd94820d0272 service neutron] Pushing event updated for resources: {'Port': ['ID=145a0cde-0fe5-4163-a063-0fdfe42f243b,revision_number=6']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:53.404481 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-451d0dab-1a66-42d9-b542-a4b0adc53a96 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Deleting port bcf2a27b-da49-42f0-ac56-71d09efd1a1a {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:37:53.404887 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-451d0dab-1a66-42d9-b542-a4b0adc53a96 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:53.435711 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-483ff6d9-753f-41d0-9479-fd94820d0272 service neutron] In _notify_port_updated(), no bound segment for port 145a0cde-0fe5-4163-a063-0fdfe42f243b on network a859e4ba-764a-41c0-982d-5bf79a2797a1 {{(pid=103437) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:37:53.436706 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-483ff6d9-753f-41d0-9479-fd94820d0272 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:53.437539 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-483ff6d9-753f-41d0-9479-fd94820d0272 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:53.438399 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-483ff6d9-753f-41d0-9479-fd94820d0272 service neutron] 10.222.0.10 "PUT /v2.0/ports/145a0cde-0fe5-4163-a063-0fdfe42f243b HTTP/1.1" status: 200 len: 1027 time: 0.5227222 Dec 09 21:37:53.528620 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-451d0dab-1a66-42d9-b542-a4b0adc53a96 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:53.550590 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-451d0dab-1a66-42d9-b542-a4b0adc53a96 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Calling delete_port for bcf2a27b-da49-42f0-ac56-71d09efd1a1a owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:37:53.582341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-441dec46-80fc-4c87-87bd-2d7ec871f696 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Deleting port b7cad057-c6e6-483b-9791-e1b1a0dd73ac {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:37:53.582745 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-441dec46-80fc-4c87-87bd-2d7ec871f696 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:53.610599 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c6dc324c-5a5c-47c5-801f-d1ab6ad4905a None None] Provisioning complete for port 145a0cde-0fe5-4163-a063-0fdfe42f243b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:37:53.611781 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6dc324c-5a5c-47c5-801f-d1ab6ad4905a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:53.656188 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-c6dc324c-5a5c-47c5-801f-d1ab6ad4905a None None] Port 145a0cde-0fe5-4163-a063-0fdfe42f243b cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:37:53.750469 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-441dec46-80fc-4c87-87bd-2d7ec871f696 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] For port b7cad057-c6e6-483b-9791-e1b1a0dd73ac, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=b7cad057-c6e6-483b-9791-e1b1a0dd73ac,segment=NetworkSegment(8ca86951-e612-4db0-90f4-834b52fd24e0),segment_id=8ca86951-e612-4db0-90f4-834b52fd24e0)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:37:53.750842 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-441dec46-80fc-4c87-87bd-2d7ec871f696 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:53.767741 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-441dec46-80fc-4c87-87bd-2d7ec871f696 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Calling delete_port for b7cad057-c6e6-483b-9791-e1b1a0dd73ac owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:37:53.773506 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-451d0dab-1a66-42d9-b542-a4b0adc53a96 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:53.804720 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-451d0dab-1a66-42d9-b542-a4b0adc53a96 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Pushing event deleted for resources: {'Port': ['ID=bcf2a27b-da49-42f0-ac56-71d09efd1a1a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:54.017341 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-451d0dab-1a66-42d9-b542-a4b0adc53a96 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:54.018581 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device b7cad057-c6e6-483b-9791-e1b1a0dd73ac no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:37:54.032167 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-441dec46-80fc-4c87-87bd-2d7ec871f696 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:54.034809 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c53a0006-d15d-4281-8806-deee5634c770 req-78e123e6-79c0-4f71-95f4-7803fdc05181 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:54.043481 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c53a0006-d15d-4281-8806-deee5634c770 req-78e123e6-79c0-4f71-95f4-7803fdc05181 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7 HTTP/1.1" status: 200 len: 945 time: 0.1699758 Dec 09 21:37:54.111046 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No active binding found for port b7cad057-c6e6-483b-9791-e1b1a0dd73ac {{(pid=103439) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:216}} Dec 09 21:37:54.111399 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device b7cad057-c6e6-483b-9791-e1b1a0dd73ac not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:37:54.111835 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 7b66d328-f18c-4d26-af51-99c1b1f1f05e no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:37:54.200924 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:54.206805 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c53a0006-d15d-4281-8806-deee5634c770 req-51dab5ae-7631-4fe3-a108-c36e69d0cd8e tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=19432415-a2e0-4a11-9022-46c83da8ae04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1623096 Dec 09 21:37:54.240261 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '7b66d328-f18c-4d26-af51-99c1b1f1f05e'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:37:54.243243 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6a988a4b-54bf-40ed-a77d-caa149db4481" -d '{"events": [{"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-unplugged", "status": "completed", "tag": "7b66d328-f18c-4d26-af51-99c1b1f1f05e"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:37:54.259042 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 7b66d328-f18c-4d26-af51-99c1b1f1f05e, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=7b66d328-f18c-4d26-af51-99c1b1f1f05e,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:37:54.278055 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:54.286713 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 145a0cde-0fe5-4163-a063-0fdfe42f243b no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:37:54.368773 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-451d0dab-1a66-42d9-b542-a4b0adc53a96 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Router 7ed3b09c-7780-49b1-aff1-9907ad810d61 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:37:54.397541 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:37:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-df8283ea-9369-4073-980e-c254a74071b6 x-openstack-request-id: req-df8283ea-9369-4073-980e-c254a74071b6 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:37:54.398309 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-unplugged", "status": "completed", "tag": "7b66d328-f18c-4d26-af51-99c1b1f1f05e", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:37:54.398722 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-df8283ea-9369-4073-980e-c254a74071b6 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:37:54.399271 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '7b66d328-f18c-4d26-af51-99c1b1f1f05e', 'code': 200} Dec 09 21:37:54.448550 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=7b66d328-f18c-4d26-af51-99c1b1f1f05e,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:54.454380 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-441dec46-80fc-4c87-87bd-2d7ec871f696 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event deleted for resources: {'Port': ['ID=b7cad057-c6e6-483b-9791-e1b1a0dd73ac,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:54.468482 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 145a0cde-0fe5-4163-a063-0fdfe42f243b not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:37:54.469148 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1e946a47-f496-445b-964b-618881eab263 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:37:54.494869 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-451d0dab-1a66-42d9-b542-a4b0adc53a96 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:37:54.501279 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-451d0dab-1a66-42d9-b542-a4b0adc53a96 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "PUT /v2.0/routers/7ed3b09c-7780-49b1-aff1-9907ad810d61/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1543262 Dec 09 21:37:54.517704 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55436) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:54.519788 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-441dec46-80fc-4c87-87bd-2d7ec871f696 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] No DVR routers for this DVR port b7cad057-c6e6-483b-9791-e1b1a0dd73ac on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:37:54.524235 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-441dec46-80fc-4c87-87bd-2d7ec871f696 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:54.528978 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-441dec46-80fc-4c87-87bd-2d7ec871f696 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.10 "DELETE /v2.0/ports/b7cad057-c6e6-483b-9791-e1b1a0dd73ac HTTP/1.1" status: 204 len: 173 time: 1.0816526 Dec 09 21:37:54.530248 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-deleted', 'tag': 'b7cad057-c6e6-483b-9791-e1b1a0dd73ac'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:37:54.531291 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80e87692-d193-41b1-bcd4-9d738bed0285 None None] Sync routers for ids ['7ed3b09c-7780-49b1-aff1-9907ad810d61'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:37:54.532695 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0105733e-7a90-43b1-81ea-809235e54364" -d '{"events": [{"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-deleted", "tag": "b7cad057-c6e6-483b-9791-e1b1a0dd73ac"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:37:54.533736 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1e946a47-f496-445b-964b-618881eab263 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:37:54.534148 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device d0dcf098-4522-4347-b733-bbc98e48d7e0 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:37:54.565899 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80e87692-d193-41b1-bcd4-9d738bed0285 None None] Routers {'7ed3b09c-7780-49b1-aff1-9907ad810d61'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:37:54.566557 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-80e87692-d193-41b1-bcd4-9d738bed0285 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:37:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7ed3b09c-7780-49b1-aff1-9907ad810d61'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:54.571302 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-ca731709-406c-417f-81bd-94357d1404f1 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] show failed (client error): The resource could not be found. Dec 09 21:37:54.572681 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ca731709-406c-417f-81bd-94357d1404f1 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "GET /v2.0/routers/tempest-non_exist_router-763087654 HTTP/1.1" status: 404 len: 334 time: 0.0492477 Dec 09 21:37:54.578182 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55440) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:54.594237 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fc42fbb-631d-48e0-a2ea-2293281b418c req-961bcc0f-5bbe-4947-9eed-80cf9cdf140c tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:54.596197 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3fc42fbb-631d-48e0-a2ea-2293281b418c req-961bcc0f-5bbe-4947-9eed-80cf9cdf140c tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.10 "GET /v2.0/ports?device_id=0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7 HTTP/1.1" status: 200 len: 945 time: 0.1614873 Dec 09 21:37:54.599750 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-cddc1cd9-7371-48f9-943b-98a399907918 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Request body: {'router': {'name': 'new_name'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:37:54.601466 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9db9d802-a3b1-46f8-91b4-4135aa631280 req-403c37e3-e8c3-4be9-869d-a056179b5e3f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:54.608627 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9db9d802-a3b1-46f8-91b4-4135aa631280 req-403c37e3-e8c3-4be9-869d-a056179b5e3f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:54.613333 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-80e87692-d193-41b1-bcd4-9d738bed0285 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:54.619782 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9db9d802-a3b1-46f8-91b4-4135aa631280 req-403c37e3-e8c3-4be9-869d-a056179b5e3f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:54.627666 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9db9d802-a3b1-46f8-91b4-4135aa631280 req-403c37e3-e8c3-4be9-869d-a056179b5e3f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:54.629685 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9db9d802-a3b1-46f8-91b4-4135aa631280 req-403c37e3-e8c3-4be9-869d-a056179b5e3f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 3150 time: 0.1450050 Dec 09 21:37:54.632411 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80e87692-d193-41b1-bcd4-9d738bed0285 None None] Routers {'7ed3b09c-7780-49b1-aff1-9907ad810d61'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:37:54.633046 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-80e87692-d193-41b1-bcd4-9d738bed0285 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:37:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7ed3b09c-7780-49b1-aff1-9907ad810d61'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:54.674907 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-80e87692-d193-41b1-bcd4-9d738bed0285 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:54.675637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80e87692-d193-41b1-bcd4-9d738bed0285 None None] The sync data for ids ['7ed3b09c-7780-49b1-aff1-9907ad810d61'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:37:54.696704 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-cddc1cd9-7371-48f9-943b-98a399907918 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] update failed (client error): The resource could not be found. Dec 09 21:37:54.698010 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cddc1cd9-7371-48f9-943b-98a399907918 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "PUT /v2.0/routers/tempest-non_exist_router-1985463053 HTTP/1.1" status: 404 len: 335 time: 0.1178181 Dec 09 21:37:54.702159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55442) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:54.705152 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9db9d802-a3b1-46f8-91b4-4135aa631280 req-03372bd8-d191-4442-bcde-c11f7da6aab1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0623448 Dec 09 21:37:54.725631 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:54.791330 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port d0dcf098-4522-4347-b733-bbc98e48d7e0, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=d0dcf098-4522-4347-b733-bbc98e48d7e0,segment=NetworkSegment(8ca86951-e612-4db0-90f4-834b52fd24e0),segment_id=8ca86951-e612-4db0-90f4-834b52fd24e0)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:37:54.795287 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:37:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a0030a62-f25e-410b-9c75-55d7274e7c41 x-openstack-request-id: req-a0030a62-f25e-410b-9c75-55d7274e7c41 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:37:54.795654 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-deleted", "tag": "b7cad057-c6e6-483b-9791-e1b1a0dd73ac", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:37:54.795924 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a0030a62-f25e-410b-9c75-55d7274e7c41 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:37:54.796435 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-deleted', 'tag': 'b7cad057-c6e6-483b-9791-e1b1a0dd73ac', 'status': 'completed', 'code': 200} Dec 09 21:37:54.803699 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:54.805911 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 90180a85-620b-470e-b808-b635138111be no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:37:54.832571 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-bbcda484-d1f1-4b24-8c82-87d9f0ac8ef1 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Deleting subnet 2cae6daa-b360-443a-94f3-69d70802cb95 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:37:54.841101 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bbcda484-d1f1-4b24-8c82-87d9f0ac8ef1 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:54.874927 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-28f4114e-032a-4ae5-8123-fe4edd467416 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Deleting port 7b66d328-f18c-4d26-af51-99c1b1f1f05e {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:37:54.875284 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-28f4114e-032a-4ae5-8123-fe4edd467416 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:54.900708 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=d0dcf098-4522-4347-b733-bbc98e48d7e0,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:54.964677 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:55.002000 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-28f4114e-032a-4ae5-8123-fe4edd467416 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] For port 7b66d328-f18c-4d26-af51-99c1b1f1f05e, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=7b66d328-f18c-4d26-af51-99c1b1f1f05e,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:37:55.002577 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-28f4114e-032a-4ae5-8123-fe4edd467416 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:55.002850 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 90180a85-620b-470e-b808-b635138111be, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=90180a85-620b-470e-b808-b635138111be,segment=NetworkSegment(f5a54e61-4fb1-4afa-9a27-98e2163b0365),segment_id=f5a54e61-4fb1-4afa-9a27-98e2163b0365)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:37:55.011455 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:55.018223 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 3bbd0bd0-666a-4f39-abae-59f44d88319c no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:37:55.051173 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-28f4114e-032a-4ae5-8123-fe4edd467416 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Calling delete_port for 7b66d328-f18c-4d26-af51-99c1b1f1f05e owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:37:55.080264 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bbcda484-d1f1-4b24-8c82-87d9f0ac8ef1 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:55.151859 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-3fc42fbb-631d-48e0-a2ea-2293281b418c req-e7e4f1b2-9796-4c67-8b85-4fba565ec367 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Deleting port ad97d669-4d68-4099-b1bd-992fd4cfb91c {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:37:55.152063 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-3fc42fbb-631d-48e0-a2ea-2293281b418c req-e7e4f1b2-9796-4c67-8b85-4fba565ec367 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:55.162781 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=90180a85-620b-470e-b808-b635138111be,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:55.250940 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:55.284285 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-3fc42fbb-631d-48e0-a2ea-2293281b418c req-e7e4f1b2-9796-4c67-8b85-4fba565ec367 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] For port ad97d669-4d68-4099-b1bd-992fd4cfb91c, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=ad97d669-4d68-4099-b1bd-992fd4cfb91c,segment=NetworkSegment(d3bafd14-6a72-4dc5-8e4d-11da22a389ed),segment_id=d3bafd14-6a72-4dc5-8e4d-11da22a389ed)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:37:55.284577 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-3fc42fbb-631d-48e0-a2ea-2293281b418c req-e7e4f1b2-9796-4c67-8b85-4fba565ec367 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:55.322085 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 3bbd0bd0-666a-4f39-abae-59f44d88319c, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3bbd0bd0-666a-4f39-abae-59f44d88319c,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:37:55.331727 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:55.395823 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=3bbd0bd0-666a-4f39-abae-59f44d88319c,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:55.404917 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acd8c1f7-9728-454a-8098-efc6705429a9 req-93c3eafb-e249-4288-9e30-f1932a8768b5 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:55.413481 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-acd8c1f7-9728-454a-8098-efc6705429a9 req-93c3eafb-e249-4288-9e30-f1932a8768b5 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7 HTTP/1.1" status: 200 len: 945 time: 0.1187148 Dec 09 21:37:55.428487 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bbcda484-d1f1-4b24-8c82-87d9f0ac8ef1 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:55.483084 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-acd8c1f7-9728-454a-8098-efc6705429a9 req-631401bb-8370-4a1c-86ed-3bb6986709e9 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups?id=19432415-a2e0-4a11-9022-46c83da8ae04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0633957 Dec 09 21:37:55.636263 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-28f4114e-032a-4ae5-8123-fe4edd467416 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:55.670359 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bbcda484-d1f1-4b24-8c82-87d9f0ac8ef1 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:55.686457 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28f4114e-032a-4ae5-8123-fe4edd467416 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event deleted for resources: {'Port': ['ID=7b66d328-f18c-4d26-af51-99c1b1f1f05e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:55.718119 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-3fc42fbb-631d-48e0-a2ea-2293281b418c req-e7e4f1b2-9796-4c67-8b85-4fba565ec367 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:55.718540 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-3fc42fbb-631d-48e0-a2ea-2293281b418c req-e7e4f1b2-9796-4c67-8b85-4fba565ec367 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:55.718767 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [req-3fc42fbb-631d-48e0-a2ea-2293281b418c req-e7e4f1b2-9796-4c67-8b85-4fba565ec367 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Floating IP 2c536504-55a9-47a6-b355-f598885671a2 disassociated. External IP: 172.25.3.18, port: ad97d669-4d68-4099-b1bd-992fd4cfb91c. Dec 09 21:37:55.719120 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-3fc42fbb-631d-48e0-a2ea-2293281b418c req-e7e4f1b2-9796-4c67-8b85-4fba565ec367 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Calling delete_port for ad97d669-4d68-4099-b1bd-992fd4cfb91c owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:37:55.729893 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbcda484-d1f1-4b24-8c82-87d9f0ac8ef1 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Pushing event deleted for resources: {'Subnet': ['ID=2cae6daa-b360-443a-94f3-69d70802cb95,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:55.754083 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ff85a47e-31b2-4d71-9005-434f26d5e54b None None] Network c069cacf-ee85-491f-b027-7eaec12acf6b requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:37:55.762198 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bbcda484-d1f1-4b24-8c82-87d9f0ac8ef1 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:55.763863 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bbcda484-d1f1-4b24-8c82-87d9f0ac8ef1 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "DELETE /v2.0/subnets/2cae6daa-b360-443a-94f3-69d70802cb95 HTTP/1.1" status: 204 len: 168 time: 1.0577152 Dec 09 21:37:55.776789 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55460) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:55.814391 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-28f4114e-032a-4ae5-8123-fe4edd467416 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] No DVR routers for this DVR port 7b66d328-f18c-4d26-af51-99c1b1f1f05e on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:37:55.817680 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-28f4114e-032a-4ae5-8123-fe4edd467416 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:55.826032 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-28f4114e-032a-4ae5-8123-fe4edd467416 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.10 "DELETE /v2.0/ports/7b66d328-f18c-4d26-af51-99c1b1f1f05e HTTP/1.1" status: 204 len: 173 time: 1.2847371 Dec 09 21:37:55.988435 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-7f9d0f83-87d8-453f-888d-49ec7745fbed tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Deleting subnet 537a6db5-9528-44c5-b845-de5a63012920 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:37:55.996165 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f9d0f83-87d8-453f-888d-49ec7745fbed tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:56.012982 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-3fc42fbb-631d-48e0-a2ea-2293281b418c req-e7e4f1b2-9796-4c67-8b85-4fba565ec367 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:56.015521 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d29332d9-05c8-40e6-b4f2-93c4fc7a5da6 None None] DHCP port deletion for c069cacf-ee85-491f-b027-7eaec12acf6b request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:37:56.032631 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Deleting port 90180a85-620b-470e-b808-b635138111be {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:37:56.032631 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:56.065508 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7e4f1b2-9796-4c67-8b85-4fba565ec367 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Pushing event deleted for resources: {'Port': ['ID=ad97d669-4d68-4099-b1bd-992fd4cfb91c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:56.176721 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d29332d9-05c8-40e6-b4f2-93c4fc7a5da6 None None] Deleting port ee0bf36b-5618-4777-b4c6-c6b8f64f18fd {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:37:56.179784 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d29332d9-05c8-40e6-b4f2-93c4fc7a5da6 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:56.276074 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] For port 90180a85-620b-470e-b808-b635138111be, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=90180a85-620b-470e-b808-b635138111be,segment=NetworkSegment(f5a54e61-4fb1-4afa-9a27-98e2163b0365),segment_id=f5a54e61-4fb1-4afa-9a27-98e2163b0365)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:37:56.276456 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:56.380294 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-d29332d9-05c8-40e6-b4f2-93c4fc7a5da6 None None] For port ee0bf36b-5618-4777-b4c6-c6b8f64f18fd, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=ee0bf36b-5618-4777-b4c6-c6b8f64f18fd,segment=NetworkSegment(8870fd07-fc23-4b81-ada4-c5f85689b638),segment_id=8870fd07-fc23-4b81-ada4-c5f85689b638)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:37:56.380656 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d29332d9-05c8-40e6-b4f2-93c4fc7a5da6 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:56.400756 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'd0dcf098-4522-4347-b733-bbc98e48d7e0'}, {'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '90180a85-620b-470e-b808-b635138111be'}, {'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '3bbd0bd0-666a-4f39-abae-59f44d88319c'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:37:56.402983 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d6c412e6-5f8f-49f2-92e4-f8ee5744a308" -d '{"events": [{"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-unplugged", "status": "completed", "tag": "d0dcf098-4522-4347-b733-bbc98e48d7e0"}, {"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-unplugged", "status": "completed", "tag": "90180a85-620b-470e-b808-b635138111be"}, {"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-unplugged", "status": "completed", "tag": "3bbd0bd0-666a-4f39-abae-59f44d88319c"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:37:56.417611 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d29332d9-05c8-40e6-b4f2-93c4fc7a5da6 None None] Calling delete_port for ee0bf36b-5618-4777-b4c6-c6b8f64f18fd owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:37:56.449341 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a385a919-3a9f-4bfd-9c69-19e707952c31 req-858f5962-383c-4c27-bdde-824339e31387 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:56.455897 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a385a919-3a9f-4bfd-9c69-19e707952c31 req-858f5962-383c-4c27-bdde-824339e31387 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:56.462126 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a385a919-3a9f-4bfd-9c69-19e707952c31 req-858f5962-383c-4c27-bdde-824339e31387 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:56.471335 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a385a919-3a9f-4bfd-9c69-19e707952c31 req-858f5962-383c-4c27-bdde-824339e31387 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 2411 time: 0.6087554 Dec 09 21:37:56.516519 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:56.522843 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f9d0f83-87d8-453f-888d-49ec7745fbed tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:56.525013 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:56.525478 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Floating IP 12695033-260e-4718-a36f-6ec3b27ba7c8 disassociated. External IP: 172.25.3.134, port: 90180a85-620b-470e-b808-b635138111be. Dec 09 21:37:56.525947 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Calling delete_port for 90180a85-620b-470e-b808-b635138111be owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:37:56.569583 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d29332d9-05c8-40e6-b4f2-93c4fc7a5da6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:56.659867 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [req-3fc42fbb-631d-48e0-a2ea-2293281b418c req-e7e4f1b2-9796-4c67-8b85-4fba565ec367 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Router a0406620-d595-409c-958d-7a486a49577c has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:37:56.669405 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a385a919-3a9f-4bfd-9c69-19e707952c31 req-7fb790f3-2348-42b2-add1-875f77acbc54 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1968610 Dec 09 21:37:56.684562 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d29332d9-05c8-40e6-b4f2-93c4fc7a5da6 None None] Pushing event deleted for resources: {'Port': ['ID=ee0bf36b-5618-4777-b4c6-c6b8f64f18fd,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:56.702791 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d29332d9-05c8-40e6-b4f2-93c4fc7a5da6 None None] No DVR routers for this DVR port ee0bf36b-5618-4777-b4c6-c6b8f64f18fd on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:37:56.756459 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 531 Content-Type: application/json Date: Thu, 09 Dec 2021 21:37:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e0a4a704-a2bb-4449-8d3d-d542dcc052f9 x-openstack-request-id: req-e0a4a704-a2bb-4449-8d3d-d542dcc052f9 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:37:56.757409 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-unplugged", "status": "completed", "tag": "d0dcf098-4522-4347-b733-bbc98e48d7e0", "code": 200}, {"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-unplugged", "status": "completed", "tag": "90180a85-620b-470e-b808-b635138111be", "code": 200}, {"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-unplugged", "status": "completed", "tag": "3bbd0bd0-666a-4f39-abae-59f44d88319c", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:37:56.757833 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e0a4a704-a2bb-4449-8d3d-d542dcc052f9 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:37:56.758541 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'd0dcf098-4522-4347-b733-bbc98e48d7e0', 'code': 200} Dec 09 21:37:56.759239 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '90180a85-620b-470e-b808-b635138111be', 'code': 200} Dec 09 21:37:56.759522 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '3bbd0bd0-666a-4f39-abae-59f44d88319c', 'code': 200} Dec 09 21:37:56.768293 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f9d0f83-87d8-453f-888d-49ec7745fbed tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:56.799302 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-deleted', 'tag': '7b66d328-f18c-4d26-af51-99c1b1f1f05e'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:37:56.802687 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bd238195-97ff-4dee-bedd-9de3fa2f830b" -d '{"events": [{"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-deleted", "tag": "7b66d328-f18c-4d26-af51-99c1b1f1f05e"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:37:56.867063 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-249d84f1-e908-40db-9d9b-b14dce62e77d req-4ec19344-8872-4986-b453-176cbc386331 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7 HTTP/1.1" status: 200 len: 210 time: 0.0287199 Dec 09 21:37:56.964068 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f9d0f83-87d8-453f-888d-49ec7745fbed tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:57.020588 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f9d0f83-87d8-453f-888d-49ec7745fbed tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Pushing event deleted for resources: {'Subnet': ['ID=537a6db5-9528-44c5-b845-de5a63012920,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:57.029919 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f9d0f83-87d8-453f-888d-49ec7745fbed tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:57.036048 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e6ea6aa8-807d-48d6-912d-3d1a904aad62 None None] Network 4b5a3188-c7f2-4be0-aa36-2d366f493d66 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:37:57.044310 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7f9d0f83-87d8-453f-888d-49ec7745fbed tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "DELETE /v2.0/subnets/537a6db5-9528-44c5-b845-de5a63012920 HTTP/1.1" status: 204 len: 168 time: 1.2646081 Dec 09 21:37:57.046956 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55470) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:57.152638 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-95344d74-b612-4243-868b-c8b0d74ae145 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:57.183123 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:37:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a2b27f4a-9671-404a-8b84-cb3d22bfb491 x-openstack-request-id: req-a2b27f4a-9671-404a-8b84-cb3d22bfb491 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:37:57.183741 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-deleted", "tag": "7b66d328-f18c-4d26-af51-99c1b1f1f05e", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:37:57.183741 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a2b27f4a-9671-404a-8b84-cb3d22bfb491 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:37:57.184103 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-deleted', 'tag': '7b66d328-f18c-4d26-af51-99c1b1f1f05e', 'status': 'completed', 'code': 200} Dec 09 21:37:57.220635 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:57.231781 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-3fc42fbb-631d-48e0-a2ea-2293281b418c req-e7e4f1b2-9796-4c67-8b85-4fba565ec367 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:37:57.243510 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8e3955c-e411-4b1e-af02-95fadff3725c None None] Sync routers for ids ['a0406620-d595-409c-958d-7a486a49577c'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:37:57.261410 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8e3955c-e411-4b1e-af02-95fadff3725c None None] Routers {'a0406620-d595-409c-958d-7a486a49577c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:37:57.262015 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e8e3955c-e411-4b1e-af02-95fadff3725c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:37:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a0406620-d595-409c-958d-7a486a49577c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:57.286111 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event deleted for resources: {'Port': ['ID=90180a85-620b-470e-b808-b635138111be,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:57.304657 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-3fc42fbb-631d-48e0-a2ea-2293281b418c req-e7e4f1b2-9796-4c67-8b85-4fba565ec367 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] No DVR routers for this DVR port ad97d669-4d68-4099-b1bd-992fd4cfb91c on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:37:57.311165 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-3fc42fbb-631d-48e0-a2ea-2293281b418c req-e7e4f1b2-9796-4c67-8b85-4fba565ec367 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:57.313303 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:57.314499 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3fc42fbb-631d-48e0-a2ea-2293281b418c req-e7e4f1b2-9796-4c67-8b85-4fba565ec367 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.10 "DELETE /v2.0/ports/ad97d669-4d68-4099-b1bd-992fd4cfb91c HTTP/1.1" status: 204 len: 173 time: 2.7087288 Dec 09 21:37:57.318004 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2caab2f5-62f7-4cf9-b2a3-b6480aa0f876 None None] DHCP port deletion for 4b5a3188-c7f2-4be0-aa36-2d366f493d66 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:37:57.321210 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:57.321567 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:57.322105 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:57.322457 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:57.322802 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:57.323141 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:57.323492 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:57.323830 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:57.324158 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:57.324484 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:57.325373 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:57.325721 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:57.326221 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:37:57.363808 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-95344d74-b612-4243-868b-c8b0d74ae145 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:57.365077 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:57.442201 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-95344d74-b612-4243-868b-c8b0d74ae145 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c069cacf-ee85-491f-b027-7eaec12acf6b']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:57.464783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-95344d74-b612-4243-868b-c8b0d74ae145 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8870fd07-fc23-4b81-ada4-c5f85689b638') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:57.465494 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-95344d74-b612-4243-868b-c8b0d74ae145 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8870fd07-fc23-4b81-ada4-c5f85689b638') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:57.467526 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-2caab2f5-62f7-4cf9-b2a3-b6480aa0f876 None None] Deleting port f83d39c0-605a-479c-927f-8dc34522d17f {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:37:57.468650 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2caab2f5-62f7-4cf9-b2a3-b6480aa0f876 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:57.482047 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Router f2b3fc08-9e60-4600-9a8b-7400a9e940a0 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:37:57.484214 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-95344d74-b612-4243-868b-c8b0d74ae145 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:57.524514 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-95344d74-b612-4243-868b-c8b0d74ae145 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:57.535947 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-95344d74-b612-4243-868b-c8b0d74ae145 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Releasing vlan 124 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:37:57.536618 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-95344d74-b612-4243-868b-c8b0d74ae145 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:37:57.539940 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:37:57.542644 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-e8e3955c-e411-4b1e-af02-95fadff3725c None None] Set router a0406620-d595-409c-958d-7a486a49577c gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:37:57.664613 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-95344d74-b612-4243-868b-c8b0d74ae145 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:57.686907 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-95344d74-b612-4243-868b-c8b0d74ae145 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:57.704532 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-95344d74-b612-4243-868b-c8b0d74ae145 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "DELETE /v2.0/networks/c069cacf-ee85-491f-b027-7eaec12acf6b HTTP/1.1" status: 204 len: 168 time: 0.6542175 Dec 09 21:37:57.706940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55474) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:57.750383 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:37:57.804103 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95344d74-b612-4243-868b-c8b0d74ae145 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Pushing event deleted for resources: {'Network': ['ID=c069cacf-ee85-491f-b027-7eaec12acf6b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:57.874761 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] No DVR routers for this DVR port 90180a85-620b-470e-b808-b635138111be on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:37:57.880176 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:57.885491 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-287eaf5c-ca05-4279-9196-4ed0d3cc8450 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.10 "DELETE /v2.0/ports/90180a85-620b-470e-b808-b635138111be HTTP/1.1" status: 204 len: 173 time: 2.0452025 Dec 09 21:37:58.040043 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2caab2f5-62f7-4cf9-b2a3-b6480aa0f876 None None] For port f83d39c0-605a-479c-927f-8dc34522d17f, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f83d39c0-605a-479c-927f-8dc34522d17f,segment=NetworkSegment(132a2620-bb6d-48f6-af90-5bc0c853f6d8),segment_id=132a2620-bb6d-48f6-af90-5bc0c853f6d8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:37:58.040872 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2caab2f5-62f7-4cf9-b2a3-b6480aa0f876 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:58.052185 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device ee0bf36b-5618-4777-b4c6-c6b8f64f18fd no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:37:58.062559 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e8e3955c-e411-4b1e-af02-95fadff3725c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0406620-d595-409c-958d-7a486a49577c', 'name': 'tempest-AttachVolumeTestJSON-1079676770-router', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210'}], 'enable_snat': True}, 'gw_port_id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:32Z', 'updated_at': '2021-12-09T21:30:38Z', 'revision_number': 4, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'gw_port': {'id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:0e:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1399, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:33Z', 'updated_at': '2021-12-09T21:30:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'dbff506a-7b73-4238-9fda-dd193910d0ce', 'name': '', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'mac_address': 'fa:16:3e:94:28:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:37Z', 'updated_at': '2021-12-09T21:30:42Z', 'revision_number': 5, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'subnets': [{'id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:58.066392 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-046752a9-c361-440c-9aec-2d71499a6e73 None None] Sync routers for ids ['f2b3fc08-9e60-4600-9a8b-7400a9e940a0'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:37:58.069681 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device ad97d669-4d68-4099-b1bd-992fd4cfb91c no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:37:58.102941 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e6e82a50-74f0-4453-a133-3d307a78e7b3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:58.124831 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: ad97d669-4d68-4099-b1bd-992fd4cfb91c {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:37:58.125189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device ad97d669-4d68-4099-b1bd-992fd4cfb91c not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:37:58.180169 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-e365a39b-1799-495f-a7d2-ca41e8f69a88 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Deleting port 3bbd0bd0-666a-4f39-abae-59f44d88319c {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:37:58.180608 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-e365a39b-1799-495f-a7d2-ca41e8f69a88 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:58.192581 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-2caab2f5-62f7-4cf9-b2a3-b6480aa0f876 None None] Calling delete_port for f83d39c0-605a-479c-927f-8dc34522d17f owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:37:58.206834 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: ee0bf36b-5618-4777-b4c6-c6b8f64f18fd {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:37:58.207234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device ee0bf36b-5618-4777-b4c6-c6b8f64f18fd not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:37:58.211163 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f83d39c0-605a-479c-927f-8dc34522d17f no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:37:58.214735 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a46fb08-cec5-4086-8496-8d62364d9c03 req-fa3eef0e-302a-4346-b838-417ca9d387b0 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:58.222320 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a46fb08-cec5-4086-8496-8d62364d9c03 req-fa3eef0e-302a-4346-b838-417ca9d387b0 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:58.230961 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7a46fb08-cec5-4086-8496-8d62364d9c03 req-fa3eef0e-302a-4346-b838-417ca9d387b0 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 1677 time: 0.2602077 Dec 09 21:37:58.264928 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8e3955c-e411-4b1e-af02-95fadff3725c None None] Checking router: a0406620-d595-409c-958d-7a486a49577c for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:37:58.282406 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8e3955c-e411-4b1e-af02-95fadff3725c None None] Routers {'a0406620-d595-409c-958d-7a486a49577c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:37:58.283031 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e8e3955c-e411-4b1e-af02-95fadff3725c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:37:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a0406620-d595-409c-958d-7a486a49577c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:58.303693 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-e6e82a50-74f0-4453-a133-3d307a78e7b3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Deleting port f83d39c0-605a-479c-927f-8dc34522d17f {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:37:58.303693 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e6e82a50-74f0-4453-a133-3d307a78e7b3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:58.317792 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7a46fb08-cec5-4086-8496-8d62364d9c03 req-ce02c51b-1d6a-41da-8c57-489fb10c1bee tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0856831 Dec 09 21:37:58.319376 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-046752a9-c361-440c-9aec-2d71499a6e73 None None] Routers {'f2b3fc08-9e60-4600-9a8b-7400a9e940a0'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:37:58.320339 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-046752a9-c361-440c-9aec-2d71499a6e73 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:37:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f2b3fc08-9e60-4600-9a8b-7400a9e940a0'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:58.359717 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2caab2f5-62f7-4cf9-b2a3-b6480aa0f876 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:58.408784 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-e365a39b-1799-495f-a7d2-ca41e8f69a88 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] For port 3bbd0bd0-666a-4f39-abae-59f44d88319c, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3bbd0bd0-666a-4f39-abae-59f44d88319c,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:37:58.409426 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-e365a39b-1799-495f-a7d2-ca41e8f69a88 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:58.451921 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-e365a39b-1799-495f-a7d2-ca41e8f69a88 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Calling delete_port for 3bbd0bd0-666a-4f39-abae-59f44d88319c owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:37:58.469021 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-e6e82a50-74f0-4453-a133-3d307a78e7b3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] For port f83d39c0-605a-479c-927f-8dc34522d17f, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f83d39c0-605a-479c-927f-8dc34522d17f,segment=NetworkSegment(132a2620-bb6d-48f6-af90-5bc0c853f6d8),segment_id=132a2620-bb6d-48f6-af90-5bc0c853f6d8)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:37:58.471687 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e6e82a50-74f0-4453-a133-3d307a78e7b3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:58.525447 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-e6e82a50-74f0-4453-a133-3d307a78e7b3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Calling delete_port for f83d39c0-605a-479c-927f-8dc34522d17f owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:37:58.532670 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55484) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:58.538525 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2caab2f5-62f7-4cf9-b2a3-b6480aa0f876 None None] No DVR routers for this DVR port f83d39c0-605a-479c-927f-8dc34522d17f on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:37:58.559705 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2caab2f5-62f7-4cf9-b2a3-b6480aa0f876 None None] Pushing event deleted for resources: {'Port': ['ID=f83d39c0-605a-479c-927f-8dc34522d17f,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:58.573271 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-e8e3955c-e411-4b1e-af02-95fadff3725c None None] Set router a0406620-d595-409c-958d-7a486a49577c gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:37:58.625704 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No active binding found for port f83d39c0-605a-479c-927f-8dc34522d17f {{(pid=103439) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:216}} Dec 09 21:37:58.626187 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f83d39c0-605a-479c-927f-8dc34522d17f not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:37:58.674558 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-e365a39b-1799-495f-a7d2-ca41e8f69a88 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:58.686416 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-046752a9-c361-440c-9aec-2d71499a6e73 None None] Set router f2b3fc08-9e60-4600-9a8b-7400a9e940a0 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:37:58.756040 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cb077d3f-9440-4d99-b5cc-bc901aeb102d tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:58.782804 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e365a39b-1799-495f-a7d2-ca41e8f69a88 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event deleted for resources: {'Port': ['ID=3bbd0bd0-666a-4f39-abae-59f44d88319c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:58.794114 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cb077d3f-9440-4d99-b5cc-bc901aeb102d tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:58.807684 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-e365a39b-1799-495f-a7d2-ca41e8f69a88 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] No DVR routers for this DVR port 3bbd0bd0-666a-4f39-abae-59f44d88319c on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:37:58.810962 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-e365a39b-1799-495f-a7d2-ca41e8f69a88 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:58.816039 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-e365a39b-1799-495f-a7d2-ca41e8f69a88 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.10 "DELETE /v2.0/ports/3bbd0bd0-666a-4f39-abae-59f44d88319c HTTP/1.1" status: 204 len: 173 time: 0.9247789 Dec 09 21:37:58.872386 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e6e82a50-74f0-4453-a133-3d307a78e7b3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:58.901185 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6e82a50-74f0-4453-a133-3d307a78e7b3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Pushing event deleted for resources: {'Port': ['ID=f83d39c0-605a-479c-927f-8dc34522d17f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:58.906402 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6e82a50-74f0-4453-a133-3d307a78e7b3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] No DVR routers for this DVR port f83d39c0-605a-479c-927f-8dc34522d17f on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:37:58.933989 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cb077d3f-9440-4d99-b5cc-bc901aeb102d tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:58.936660 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cb077d3f-9440-4d99-b5cc-bc901aeb102d tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:58.940336 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cb077d3f-9440-4d99-b5cc-bc901aeb102d tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "DELETE /v2.0/security-groups/19432415-a2e0-4a11-9022-46c83da8ae04 HTTP/1.1" status: 204 len: 168 time: 0.4041958 Dec 09 21:37:58.940817 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55486) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:58.950465 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e8e3955c-e411-4b1e-af02-95fadff3725c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0406620-d595-409c-958d-7a486a49577c', 'name': 'tempest-AttachVolumeTestJSON-1079676770-router', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210'}], 'enable_snat': True}, 'gw_port_id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:32Z', 'updated_at': '2021-12-09T21:30:38Z', 'revision_number': 4, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'gw_port': {'id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:0e:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1399, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:33Z', 'updated_at': '2021-12-09T21:30:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'dbff506a-7b73-4238-9fda-dd193910d0ce', 'name': '', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'mac_address': 'fa:16:3e:94:28:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:37Z', 'updated_at': '2021-12-09T21:30:42Z', 'revision_number': 5, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'subnets': [{'id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:58.975648 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb077d3f-9440-4d99-b5cc-bc901aeb102d tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=19432415-a2e0-4a11-9022-46c83da8ae04,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:58.980396 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-49925050-d5e7-4b78-98dc-cac08c99c0d8 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] show failed (client error): The resource could not be found. Dec 09 21:37:58.984257 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-49925050-d5e7-4b78-98dc-cac08c99c0d8 tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "GET /v2.0/security-groups/19432415-a2e0-4a11-9022-46c83da8ae04 HTTP/1.1" status: 404 len: 347 time: 0.0369868 Dec 09 21:37:58.985547 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55488) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:59.010847 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8e3955c-e411-4b1e-af02-95fadff3725c None None] The sync data for ids ['a0406620-d595-409c-958d-7a486a49577c'] in n-d-713301-27 is: [{'id': 'a0406620-d595-409c-958d-7a486a49577c', 'name': 'tempest-AttachVolumeTestJSON-1079676770-router', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210'}], 'enable_snat': True}, 'gw_port_id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:32Z', 'updated_at': '2021-12-09T21:30:38Z', 'revision_number': 4, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'gw_port': {'id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:0e:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1399, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:33Z', 'updated_at': '2021-12-09T21:30:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'dbff506a-7b73-4238-9fda-dd193910d0ce', 'name': '', 'network_id': '935b09ce-7410-4b66-82be-99978deb6717', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'mac_address': 'fa:16:3e:94:28:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_interface', 'standard_attr_id': 1405, 'fixed_ips': [{'subnet_id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:37Z', 'updated_at': '2021-12-09T21:30:42Z', 'revision_number': 5, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'subnets': [{'id': '10ff3f47-d1f4-47a0-808e-f885899dfb29', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:37:59.023240 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e6e82a50-74f0-4453-a133-3d307a78e7b3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:59.057499 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-046752a9-c361-440c-9aec-2d71499a6e73 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'name': 'tempest-TaggedBootDevicesTest-1896005035-router', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127'}], 'enable_snat': True}, 'gw_port_id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:00Z', 'updated_at': '2021-12-09T21:27:06Z', 'revision_number': 4, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'gw_port': {'id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a1:90:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1069, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:01Z', 'updated_at': '2021-12-09T21:27:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '07784993-5ed4-492f-8151-3e60e91832c1', 'name': '', 'network_id': 'f0373886-3db8-47eb-af65-78244497171e', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'mac_address': 'fa:16:3e:31:30:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'device_owner': 'network:router_interface', 'standard_attr_id': 1073, 'fixed_ips': [{'subnet_id': '65df7637-0210-4526-a5dd-a692c26062b4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:05Z', 'updated_at': '2021-12-09T21:27:12Z', 'revision_number': 5, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'subnets': [{'id': '65df7637-0210-4526-a5dd-a692c26062b4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:59.062446 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e6e82a50-74f0-4453-a133-3d307a78e7b3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4b5a3188-c7f2-4be0-aa36-2d366f493d66']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:59.089010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e6e82a50-74f0-4453-a133-3d307a78e7b3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '132a2620-bb6d-48f6-af90-5bc0c853f6d8') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:59.092360 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e6e82a50-74f0-4453-a133-3d307a78e7b3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '132a2620-bb6d-48f6-af90-5bc0c853f6d8') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:59.105263 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-046752a9-c361-440c-9aec-2d71499a6e73 None None] Checking router: f2b3fc08-9e60-4600-9a8b-7400a9e940a0 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:37:59.118973 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e6e82a50-74f0-4453-a133-3d307a78e7b3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:59.130458 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-046752a9-c361-440c-9aec-2d71499a6e73 None None] Routers {'f2b3fc08-9e60-4600-9a8b-7400a9e940a0'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:37:59.131099 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-046752a9-c361-440c-9aec-2d71499a6e73 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:37:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f2b3fc08-9e60-4600-9a8b-7400a9e940a0'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:59.143216 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e6e82a50-74f0-4453-a133-3d307a78e7b3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:59.145557 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-c20faee3-57e4-4375-ba15-b4c93b106f45 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Deleting port d0dcf098-4522-4347-b733-bbc98e48d7e0 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:37:59.146155 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-c20faee3-57e4-4375-ba15-b4c93b106f45 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:59.168069 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e6e82a50-74f0-4453-a133-3d307a78e7b3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Releasing vlan 147 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:37:59.169058 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e6e82a50-74f0-4453-a133-3d307a78e7b3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:37:59.176458 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:37:59.188784 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7', 'name': 'network-vif-deleted', 'tag': 'ad97d669-4d68-4099-b1bd-992fd4cfb91c'}, {'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-deleted', 'tag': '90180a85-620b-470e-b808-b635138111be'}, {'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-deleted', 'tag': '3bbd0bd0-666a-4f39-abae-59f44d88319c'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:37:59.191332 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e5b994d7-14d6-496b-87d1-0ad40d277af8" -d '{"events": [{"server_uuid": "0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7", "name": "network-vif-deleted", "tag": "ad97d669-4d68-4099-b1bd-992fd4cfb91c"}, {"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-deleted", "tag": "90180a85-620b-470e-b808-b635138111be"}, {"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-deleted", "tag": "3bbd0bd0-666a-4f39-abae-59f44d88319c"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:37:59.303346 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e6e82a50-74f0-4453-a133-3d307a78e7b3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:59.311576 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e6e82a50-74f0-4453-a133-3d307a78e7b3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:59.319397 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e6e82a50-74f0-4453-a133-3d307a78e7b3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "DELETE /v2.0/networks/4b5a3188-c7f2-4be0-aa36-2d366f493d66 HTTP/1.1" status: 204 len: 168 time: 1.6058850 Dec 09 21:37:59.321244 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55494) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:37:59.346767 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6e82a50-74f0-4453-a133-3d307a78e7b3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Pushing event deleted for resources: {'Network': ['ID=4b5a3188-c7f2-4be0-aa36-2d366f493d66,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:37:59.347218 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-046752a9-c361-440c-9aec-2d71499a6e73 None None] Set router f2b3fc08-9e60-4600-9a8b-7400a9e940a0 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:37:59.418925 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-75c57c93-f8f4-4be1-8a4b-075908d17de3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Deleting subnet 657c90d6-3d5c-4662-9469-7c036d9c1427 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:37:59.436237 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-75c57c93-f8f4-4be1-8a4b-075908d17de3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:59.486360 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-75c57c93-f8f4-4be1-8a4b-075908d17de3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:59.509972 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-708d0540-4063-491b-b67d-7a80a006109b None None] New status for floating IP 2c536504-55a9-47a6-b355-f598885671a2: DOWN {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:37:59.541159 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 525 Content-Type: application/json Date: Thu, 09 Dec 2021 21:37:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-efccdde5-34d8-4930-8c85-9a0c00a9557a x-openstack-request-id: req-efccdde5-34d8-4930-8c85-9a0c00a9557a {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:37:59.541458 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7", "name": "network-vif-deleted", "tag": "ad97d669-4d68-4099-b1bd-992fd4cfb91c", "status": "completed", "code": 200}, {"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-deleted", "tag": "90180a85-620b-470e-b808-b635138111be", "status": "completed", "code": 200}, {"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-deleted", "tag": "3bbd0bd0-666a-4f39-abae-59f44d88319c", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:37:59.541707 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-efccdde5-34d8-4930-8c85-9a0c00a9557a {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:37:59.542086 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0f7f7e0a-5b98-4ac9-bce5-3155e2c3e8b7', 'name': 'network-vif-deleted', 'tag': 'ad97d669-4d68-4099-b1bd-992fd4cfb91c', 'status': 'completed', 'code': 200} Dec 09 21:37:59.542336 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-deleted', 'tag': '90180a85-620b-470e-b808-b635138111be', 'status': 'completed', 'code': 200} Dec 09 21:37:59.542583 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-deleted', 'tag': '3bbd0bd0-666a-4f39-abae-59f44d88319c', 'status': 'completed', 'code': 200} Dec 09 21:37:59.546665 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-50b1dd1e-5a1d-4546-b0c0-a5b37442acdf tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Deleting port aed82311-6a0a-41bb-8cd5-a1b3c898776e {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:37:59.547004 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-50b1dd1e-5a1d-4546-b0c0-a5b37442acdf tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:59.564698 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd3e603e-9b92-4336-8aaf-2e13020ffba5 req-d25703d0-c084-4ec3-af7c-7f84727044a2 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:37:59.566423 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fd3e603e-9b92-4336-8aaf-2e13020ffba5 req-d25703d0-c084-4ec3-af7c-7f84727044a2 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 943 time: 0.0674789 Dec 09 21:37:59.633471 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-c20faee3-57e4-4375-ba15-b4c93b106f45 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] For port d0dcf098-4522-4347-b733-bbc98e48d7e0, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=d0dcf098-4522-4347-b733-bbc98e48d7e0,segment=NetworkSegment(8ca86951-e612-4db0-90f4-834b52fd24e0),segment_id=8ca86951-e612-4db0-90f4-834b52fd24e0)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:37:59.633845 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-c20faee3-57e4-4375-ba15-b4c93b106f45 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:59.655059 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fd3e603e-9b92-4336-8aaf-2e13020ffba5 req-6e5919b5-7147-400f-bc5a-cffee75d8ca8 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups?id=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0801773 Dec 09 21:37:59.664646 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-046752a9-c361-440c-9aec-2d71499a6e73 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'name': 'tempest-TaggedBootDevicesTest-1896005035-router', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127'}], 'enable_snat': True}, 'gw_port_id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:00Z', 'updated_at': '2021-12-09T21:27:06Z', 'revision_number': 4, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'gw_port': {'id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a1:90:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1069, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:01Z', 'updated_at': '2021-12-09T21:27:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '07784993-5ed4-492f-8151-3e60e91832c1', 'name': '', 'network_id': 'f0373886-3db8-47eb-af65-78244497171e', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'mac_address': 'fa:16:3e:31:30:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'device_owner': 'network:router_interface', 'standard_attr_id': 1073, 'fixed_ips': [{'subnet_id': '65df7637-0210-4526-a5dd-a692c26062b4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:05Z', 'updated_at': '2021-12-09T21:27:12Z', 'revision_number': 5, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'subnets': [{'id': '65df7637-0210-4526-a5dd-a692c26062b4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:37:59.694579 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-046752a9-c361-440c-9aec-2d71499a6e73 None None] The sync data for ids ['f2b3fc08-9e60-4600-9a8b-7400a9e940a0'] in n-d-713301-27 is: [{'id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'name': 'tempest-TaggedBootDevicesTest-1896005035-router', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127'}], 'enable_snat': True}, 'gw_port_id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:00Z', 'updated_at': '2021-12-09T21:27:06Z', 'revision_number': 4, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'gw_port': {'id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a1:90:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1069, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:01Z', 'updated_at': '2021-12-09T21:27:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '07784993-5ed4-492f-8151-3e60e91832c1', 'name': '', 'network_id': 'f0373886-3db8-47eb-af65-78244497171e', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'mac_address': 'fa:16:3e:31:30:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'device_owner': 'network:router_interface', 'standard_attr_id': 1073, 'fixed_ips': [{'subnet_id': '65df7637-0210-4526-a5dd-a692c26062b4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:05Z', 'updated_at': '2021-12-09T21:27:12Z', 'revision_number': 5, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'subnets': [{'id': '65df7637-0210-4526-a5dd-a692c26062b4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:37:59.719212 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-c20faee3-57e4-4375-ba15-b4c93b106f45 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Calling delete_port for d0dcf098-4522-4347-b733-bbc98e48d7e0 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:37:59.824035 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-50b1dd1e-5a1d-4546-b0c0-a5b37442acdf tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:59.824250 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-50b1dd1e-5a1d-4546-b0c0-a5b37442acdf tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:59.832992 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-75c57c93-f8f4-4be1-8a4b-075908d17de3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:37:59.866830 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-50b1dd1e-5a1d-4546-b0c0-a5b37442acdf tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Calling delete_port for aed82311-6a0a-41bb-8cd5-a1b3c898776e owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:37:59.965255 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f40ec184-b78d-42d9-abf1-1ab7a53e2858 None None] New status for floating IP 12695033-260e-4718-a36f-6ec3b27ba7c8: DOWN {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:38:00.020163 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-75c57c93-f8f4-4be1-8a4b-075908d17de3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:00.074933 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75c57c93-f8f4-4be1-8a4b-075908d17de3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Pushing event deleted for resources: {'Subnet': ['ID=657c90d6-3d5c-4662-9469-7c036d9c1427,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:00.077123 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-75c57c93-f8f4-4be1-8a4b-075908d17de3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:00.080396 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-75c57c93-f8f4-4be1-8a4b-075908d17de3 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "DELETE /v2.0/subnets/657c90d6-3d5c-4662-9469-7c036d9c1427 HTTP/1.1" status: 204 len: 168 time: 0.7515965 Dec 09 21:38:00.082979 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55500) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:00.126033 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88ad27a6-a195-4745-a07c-d08b0d34d189 None None] Network 0801dc22-1800-4894-89f9-dfbc338ac3c7 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:38:00.127986 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-c20faee3-57e4-4375-ba15-b4c93b106f45 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:00.160888 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c20faee3-57e4-4375-ba15-b4c93b106f45 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event deleted for resources: {'Port': ['ID=d0dcf098-4522-4347-b733-bbc98e48d7e0,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:00.230042 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-c20faee3-57e4-4375-ba15-b4c93b106f45 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] No DVR routers for this DVR port d0dcf098-4522-4347-b733-bbc98e48d7e0 on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:38:00.232059 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-50b1dd1e-5a1d-4546-b0c0-a5b37442acdf tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:00.234498 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-c20faee3-57e4-4375-ba15-b4c93b106f45 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:00.237869 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-31b46b38-e4f3-4f04-a3ff-df27abe2a2dc req-c20faee3-57e4-4375-ba15-b4c93b106f45 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.10 "DELETE /v2.0/ports/d0dcf098-4522-4347-b733-bbc98e48d7e0 HTTP/1.1" status: 204 len: 173 time: 1.4143834 Dec 09 21:38:00.251844 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:00.288479 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50b1dd1e-5a1d-4546-b0c0-a5b37442acdf tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Pushing event deleted for resources: {'Port': ['ID=aed82311-6a0a-41bb-8cd5-a1b3c898776e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:00.350488 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f9fc0823-0165-4a0f-a0b1-76fa2def0b1b None None] DHCP port deletion for 0801dc22-1800-4894-89f9-dfbc338ac3c7 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:38:00.368443 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-50b1dd1e-5a1d-4546-b0c0-a5b37442acdf tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:00.371040 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-50b1dd1e-5a1d-4546-b0c0-a5b37442acdf tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:00.375881 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-50b1dd1e-5a1d-4546-b0c0-a5b37442acdf tempest-AttachVolumeTestJSON-146873469 tempest-AttachVolumeTestJSON-146873469-project] 10.222.0.13 "DELETE /v2.0/floatingips/2c536504-55a9-47a6-b355-f598885671a2 HTTP/1.1" status: 204 len: 168 time: 1.3891149 Dec 09 21:38:00.389783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Deleting port 33e1bebe-426e-4f3a-9830-bddda9c66a81 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:00.390489 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:00.466531 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f9fc0823-0165-4a0f-a0b1-76fa2def0b1b None None] Deleting port 33e1bebe-426e-4f3a-9830-bddda9c66a81 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:00.467017 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f9fc0823-0165-4a0f-a0b1-76fa2def0b1b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:00.510463 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] For port 33e1bebe-426e-4f3a-9830-bddda9c66a81, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=33e1bebe-426e-4f3a-9830-bddda9c66a81,segment=NetworkSegment(76984479-c633-4f9c-b8b2-de009dc509fd),segment_id=76984479-c633-4f9c-b8b2-de009dc509fd)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:00.512720 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:00.547777 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Calling delete_port for 33e1bebe-426e-4f3a-9830-bddda9c66a81 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:00.603682 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f9fc0823-0165-4a0f-a0b1-76fa2def0b1b None None] For port 33e1bebe-426e-4f3a-9830-bddda9c66a81, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=33e1bebe-426e-4f3a-9830-bddda9c66a81,segment=NetworkSegment(76984479-c633-4f9c-b8b2-de009dc509fd),segment_id=76984479-c633-4f9c-b8b2-de009dc509fd)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:00.603682 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f9fc0823-0165-4a0f-a0b1-76fa2def0b1b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:00.622960 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f9fc0823-0165-4a0f-a0b1-76fa2def0b1b None None] Calling delete_port for 33e1bebe-426e-4f3a-9830-bddda9c66a81 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:00.739422 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:00.802153 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f9fc0823-0165-4a0f-a0b1-76fa2def0b1b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:00.806086 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Pushing event deleted for resources: {'Port': ['ID=33e1bebe-426e-4f3a-9830-bddda9c66a81,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:00.825916 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] No DVR routers for this DVR port 33e1bebe-426e-4f3a-9830-bddda9c66a81 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:38:00.841270 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9fc0823-0165-4a0f-a0b1-76fa2def0b1b None None] Pushing event deleted for resources: {'Port': ['ID=33e1bebe-426e-4f3a-9830-bddda9c66a81,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:00.858447 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f35dc3cf-b3e1-4138-a731-0ea4896f6bfa req-3d6aac3c-e15e-454b-8962-31f630aa330c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 210 time: 0.0489054 Dec 09 21:38:00.865692 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9fc0823-0165-4a0f-a0b1-76fa2def0b1b None None] No DVR routers for this DVR port 33e1bebe-426e-4f3a-9830-bddda9c66a81 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:38:00.960974 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:00.984017 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0801dc22-1800-4894-89f9-dfbc338ac3c7']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:00.995953 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '76984479-c633-4f9c-b8b2-de009dc509fd') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:00.996256 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '76984479-c633-4f9c-b8b2-de009dc509fd') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:01.014143 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:01.029879 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:01.037414 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Releasing vlan 102 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:38:01.037811 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:38:01.041117 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:38:01.098796 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:01.106201 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:01.111928 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "DELETE /v2.0/networks/0801dc22-1800-4894-89f9-dfbc338ac3c7 HTTP/1.1" status: 204 len: 168 time: 1.0235920 Dec 09 21:38:01.112368 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55510) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:01.128886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Pushing event deleted for resources: {'Network': ['ID=0801dc22-1800-4894-89f9-dfbc338ac3c7,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:01.137609 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:01.137958 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:01.138296 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:01.138628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:01.138989 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:01.139316 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:01.139692 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:01.140068 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:01.140332 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:01.140651 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:01.140974 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:01.141179 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-60bd57ea-411a-4451-b546-9238bece42b8 tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ed3b09c-7780-49b1-aff1-9907ad810d61 HTTP/1.1" status: 200 len: 205 time: 0.0275707 Dec 09 21:38:01.141314 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:01.141639 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e3b4b376-cb39-4d8a-9b5a-e3edff66d4ee tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:01.143391 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55512) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:01.219838 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-36cc0df2-2d4d-4c66-b6d5-332f52ab717c tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:01.382798 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-36cc0df2-2d4d-4c66-b6d5-332f52ab717c tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:01.384952 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-36cc0df2-2d4d-4c66-b6d5-332f52ab717c tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:01.433881 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-36cc0df2-2d4d-4c66-b6d5-332f52ab717c tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:01.434568 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-36cc0df2-2d4d-4c66-b6d5-332f52ab717c tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Fanout notify agent at l3_agent the message router_deleted on router 7ed3b09c-7780-49b1-aff1-9907ad810d61 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:38:01.442044 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-36cc0df2-2d4d-4c66-b6d5-332f52ab717c tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:01.445808 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-36cc0df2-2d4d-4c66-b6d5-332f52ab717c tempest-RoutersNegativeTest-311012091 tempest-RoutersNegativeTest-311012091-project] 10.222.0.13 "DELETE /v2.0/routers/7ed3b09c-7780-49b1-aff1-9907ad810d61 HTTP/1.1" status: 204 len: 168 time: 0.2989917 Dec 09 21:38:01.544286 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-deleted', 'tag': 'd0dcf098-4522-4347-b733-bbc98e48d7e0'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:38:01.546753 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-66063f67-b69e-4e51-abc8-37dfa6740eb7" -d '{"events": [{"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-deleted", "tag": "d0dcf098-4522-4347-b733-bbc98e48d7e0"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:38:01.585578 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:38:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-27db6eb7-a8f8-4569-a3d3-684003b05e2f x-openstack-request-id: req-27db6eb7-a8f8-4569-a3d3-684003b05e2f {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:38:01.586234 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9390f3e3-0261-4b70-8f7f-05a5583377da", "name": "network-vif-deleted", "tag": "d0dcf098-4522-4347-b733-bbc98e48d7e0", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:38:01.586687 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-27db6eb7-a8f8-4569-a3d3-684003b05e2f {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:38:01.587135 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9390f3e3-0261-4b70-8f7f-05a5583377da', 'name': 'network-vif-deleted', 'tag': 'd0dcf098-4522-4347-b733-bbc98e48d7e0', 'status': 'completed', 'code': 200} Dec 09 21:38:01.712960 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55522) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:01.845398 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 33e1bebe-426e-4f3a-9830-bddda9c66a81 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:38:01.876640 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 33e1bebe-426e-4f3a-9830-bddda9c66a81 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:38:01.876996 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 33e1bebe-426e-4f3a-9830-bddda9c66a81 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:38:01.914481 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4a502f13-0d74-431f-9b21-53588e87eaf5 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=54c2ac9b331d4794a0ce58f8a47c8e80&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2003446 Dec 09 21:38:01.917138 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55534) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:01.993008 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2445ed3c-25d2-4026-a70c-25b8f8f932fa admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:01.996957 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0e720f34-5b65-4f4c-80c0-0b1ef0b7ed8f req-a3186c9b-2235-4d7c-837d-241ee3b05569 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 210 time: 0.0363276 Dec 09 21:38:02.018146 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2445ed3c-25d2-4026-a70c-25b8f8f932fa admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:02.080182 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2445ed3c-25d2-4026-a70c-25b8f8f932fa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:02.082975 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2445ed3c-25d2-4026-a70c-25b8f8f932fa admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:02.086625 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2445ed3c-25d2-4026-a70c-25b8f8f932fa admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/9ea2e206-9245-4b6f-8f9d-20876f9ebbda HTTP/1.1" status: 204 len: 168 time: 0.1656303 Dec 09 21:38:02.092837 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2445ed3c-25d2-4026-a70c-25b8f8f932fa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9ea2e206-9245-4b6f-8f9d-20876f9ebbda,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:02.830632 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55570) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:02.947043 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-c433e931-2c07-49a9-9d76-a9441804c5a5 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] Request body: {'network': {'name': 'tempest-TagsTest-test-network-581527346'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:38:02.953708 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-971638ca-49e1-4198-9f77-b676c943b1da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:02.973599 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c433e931-2c07-49a9-9d76-a9441804c5a5 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] Made reservation on behalf of 03fd1051595b4df89ab225f401c81188 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:38:02.977982 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c433e931-2c07-49a9-9d76-a9441804c5a5 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:02.987279 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c433e931-2c07-49a9-9d76-a9441804c5a5 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:03.099235 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c433e931-2c07-49a9-9d76-a9441804c5a5 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:03.113992 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c433e931-2c07-49a9-9d76-a9441804c5a5 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:03.157458 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a87b9912-3c0a-4074-9ca5-c375a64ea59d req-9f7d62ab-360b-41b2-992c-fd14a59a5424 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 210 time: 0.0554709 Dec 09 21:38:03.158763 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c433e931-2c07-49a9-9d76-a9441804c5a5 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] vlan segment allocate from pool success with {'vlan_id': 118, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:38:03.194629 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c433e931-2c07-49a9-9d76-a9441804c5a5 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:03.194985 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-c433e931-2c07-49a9-9d76-a9441804c5a5 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] Added segment c3421bdc-a780-46e2-841a-4a04ade4586f of type vlan for network 09a8ad60-7f94-46cb-b01b-cc07e2427bdd Dec 09 21:38:03.207886 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c433e931-2c07-49a9-9d76-a9441804c5a5 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c1c83e35-17ab-485a-bc87-b8f91685e2d1,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:03.245085 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c433e931-2c07-49a9-9d76-a9441804c5a5 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:03.275571 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c433e931-2c07-49a9-9d76-a9441804c5a5 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:03.281700 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c433e931-2c07-49a9-9d76-a9441804c5a5 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:03.282299 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c433e931-2c07-49a9-9d76-a9441804c5a5 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:03.330335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55576) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:03.330714 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c433e931-2c07-49a9-9d76-a9441804c5a5 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 775 time: 0.4963806 Dec 09 21:38:03.335507 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-2b879eea-1be4-469a-8abc-55e7a5cf95db tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'networks', '09a8ad60-7f94-46cb-b01b-cc07e2427bdd', 'tempest-TagsTest-Tag-1612481211') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:03.372508 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c433e931-2c07-49a9-9d76-a9441804c5a5 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] Pushing event updated for resources: {'Network': ['ID=09a8ad60-7f94-46cb-b01b-cc07e2427bdd,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:03.384452 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 09a8ad60-7f94-46cb-b01b-cc07e2427bdd details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:38:03.459983 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2b879eea-1be4-469a-8abc-55e7a5cf95db tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] 10.222.0.13 "PUT /v2.0/networks/09a8ad60-7f94-46cb-b01b-cc07e2427bdd/tags/tempest-TagsTest-Tag-1612481211 HTTP/1.1" status: 201 len: 201 time: 0.1283555 Dec 09 21:38:03.462671 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55582) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:03.467295 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-4676c662-1022-489c-8566-0abab66ed52f tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '09a8ad60-7f94-46cb-b01b-cc07e2427bdd', 'tempest-TagsTest-Tag-1612481211') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:03.561251 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4676c662-1022-489c-8566-0abab66ed52f tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] 10.222.0.13 "GET /v2.0/networks/09a8ad60-7f94-46cb-b01b-cc07e2427bdd/tags/tempest-TagsTest-Tag-1612481211 HTTP/1.1" status: 204 len: 168 time: 0.0951462 Dec 09 21:38:03.562093 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55586) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:03.570917 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-d4e7b5c1-25f8-4c54-8e49-69eee878018e tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'networks', '09a8ad60-7f94-46cb-b01b-cc07e2427bdd') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:03.664052 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d4e7b5c1-25f8-4c54-8e49-69eee878018e tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] 10.222.0.13 "GET /v2.0/networks/09a8ad60-7f94-46cb-b01b-cc07e2427bdd/tags HTTP/1.1" status: 200 len: 238 time: 0.0992341 Dec 09 21:38:03.666361 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55590) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:03.671468 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-d6feabca-17bd-47ac-9c7b-717a24f8c9c7 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'networks', '09a8ad60-7f94-46cb-b01b-cc07e2427bdd', {'tags': ['tempest-TagsTest-Tag-1940667630', 'tempest-TagsTest-Tag-790953142', 'tempest-TagsTest-Tag-1469498836']}) {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:03.765872 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d6feabca-17bd-47ac-9c7b-717a24f8c9c7 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] 10.222.0.13 "PUT /v2.0/networks/09a8ad60-7f94-46cb-b01b-cc07e2427bdd/tags HTTP/1.1" status: 200 len: 308 time: 0.0956295 Dec 09 21:38:03.766377 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55594) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:03.772592 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-b4c25e8d-b417-43db-9582-79fa231771d8 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'networks', '09a8ad60-7f94-46cb-b01b-cc07e2427bdd', 'tempest-TagsTest-Tag-1940667630') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:03.881021 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b4c25e8d-b417-43db-9582-79fa231771d8 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] 10.222.0.13 "DELETE /v2.0/networks/09a8ad60-7f94-46cb-b01b-cc07e2427bdd/tags/tempest-TagsTest-Tag-1940667630 HTTP/1.1" status: 204 len: 168 time: 0.1128831 Dec 09 21:38:03.883491 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55596) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:03.888620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-680e6237-1b52-4190-bf67-30a8143af0b6 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '09a8ad60-7f94-46cb-b01b-cc07e2427bdd', 'tempest-TagsTest-Tag-1940667630') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:03.965349 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-680e6237-1b52-4190-bf67-30a8143af0b6 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] show failed (client error): The resource could not be found. Dec 09 21:38:03.968943 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-680e6237-1b52-4190-bf67-30a8143af0b6 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] 10.222.0.13 "GET /v2.0/networks/09a8ad60-7f94-46cb-b01b-cc07e2427bdd/tags/tempest-TagsTest-Tag-1940667630 HTTP/1.1" status: 404 len: 326 time: 0.0819666 Dec 09 21:38:03.969156 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55598) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:03.973571 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-b1235a76-7919-4711-9a87-f25356b72d9a tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '09a8ad60-7f94-46cb-b01b-cc07e2427bdd', 'tempest-TagsTest-Tag-790953142') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:04.055504 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b1235a76-7919-4711-9a87-f25356b72d9a tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] 10.222.0.13 "GET /v2.0/networks/09a8ad60-7f94-46cb-b01b-cc07e2427bdd/tags/tempest-TagsTest-Tag-790953142 HTTP/1.1" status: 204 len: 168 time: 0.0828373 Dec 09 21:38:04.055845 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55600) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:04.061492 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-5fec723b-32f8-4c56-9fcb-3a123f46cb50 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '09a8ad60-7f94-46cb-b01b-cc07e2427bdd', 'tempest-TagsTest-Tag-1469498836') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:04.137133 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5fec723b-32f8-4c56-9fcb-3a123f46cb50 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] 10.222.0.13 "GET /v2.0/networks/09a8ad60-7f94-46cb-b01b-cc07e2427bdd/tags/tempest-TagsTest-Tag-1469498836 HTTP/1.1" status: 204 len: 168 time: 0.0799577 Dec 09 21:38:04.139883 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55602) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:04.144487 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-8992f91c-f4a4-44b8-8222-beef9deed7c7 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'networks', '09a8ad60-7f94-46cb-b01b-cc07e2427bdd') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:04.235932 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8992f91c-f4a4-44b8-8222-beef9deed7c7 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] 10.222.0.13 "DELETE /v2.0/networks/09a8ad60-7f94-46cb-b01b-cc07e2427bdd/tags HTTP/1.1" status: 204 len: 168 time: 0.0923083 Dec 09 21:38:04.236319 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55606) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:04.242417 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-4899ebc5-bfac-4152-aecf-06b7dbdd9bb8 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '09a8ad60-7f94-46cb-b01b-cc07e2427bdd', 'tempest-TagsTest-Tag-790953142') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:04.302215 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3d80bb5a-0056-44be-9eed-bffd9f024ead req-116e1cf9-f861-4290-896b-672e68eea7d8 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 210 time: 0.0289705 Dec 09 21:38:04.332622 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-4899ebc5-bfac-4152-aecf-06b7dbdd9bb8 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] show failed (client error): The resource could not be found. Dec 09 21:38:04.333786 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4899ebc5-bfac-4152-aecf-06b7dbdd9bb8 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] 10.222.0.13 "GET /v2.0/networks/09a8ad60-7f94-46cb-b01b-cc07e2427bdd/tags/tempest-TagsTest-Tag-790953142 HTTP/1.1" status: 404 len: 325 time: 0.0964057 Dec 09 21:38:04.337437 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55608) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:04.342054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-bbcee52c-000c-44c7-b2a4-da527012b38a tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'networks', '09a8ad60-7f94-46cb-b01b-cc07e2427bdd', 'tempest-TagsTest-Tag-1469498836') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:04.414242 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-bbcee52c-000c-44c7-b2a4-da527012b38a tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] show failed (client error): The resource could not be found. Dec 09 21:38:04.418070 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bbcee52c-000c-44c7-b2a4-da527012b38a tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] 10.222.0.13 "GET /v2.0/networks/09a8ad60-7f94-46cb-b01b-cc07e2427bdd/tags/tempest-TagsTest-Tag-1469498836 HTTP/1.1" status: 404 len: 326 time: 0.0769444 Dec 09 21:38:04.418456 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55610) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:04.422918 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-7bfeae64-b61b-4697-bc0b-3c33c59566f6 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'networks', '09a8ad60-7f94-46cb-b01b-cc07e2427bdd') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:04.503148 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7bfeae64-b61b-4697-bc0b-3c33c59566f6 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] 10.222.0.13 "DELETE /v2.0/networks/09a8ad60-7f94-46cb-b01b-cc07e2427bdd/tags HTTP/1.1" status: 204 len: 168 time: 0.0796680 Dec 09 21:38:04.503399 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55612) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:04.580715 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-89b67b00-6a88-40a1-bcf3-5d25fc314ea3 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:04.679671 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-89b67b00-6a88-40a1-bcf3-5d25fc314ea3 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:04.700265 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-89b67b00-6a88-40a1-bcf3-5d25fc314ea3 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['09a8ad60-7f94-46cb-b01b-cc07e2427bdd']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:04.709719 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-89b67b00-6a88-40a1-bcf3-5d25fc314ea3 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c3421bdc-a780-46e2-841a-4a04ade4586f') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:04.710018 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-89b67b00-6a88-40a1-bcf3-5d25fc314ea3 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c3421bdc-a780-46e2-841a-4a04ade4586f') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:04.719382 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-89b67b00-6a88-40a1-bcf3-5d25fc314ea3 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:04.732483 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-89b67b00-6a88-40a1-bcf3-5d25fc314ea3 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:04.738338 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-89b67b00-6a88-40a1-bcf3-5d25fc314ea3 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] Releasing vlan 118 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:38:04.738718 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-89b67b00-6a88-40a1-bcf3-5d25fc314ea3 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:38:04.741996 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:38:04.807567 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-89b67b00-6a88-40a1-bcf3-5d25fc314ea3 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:04.817329 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-89b67b00-6a88-40a1-bcf3-5d25fc314ea3 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:04.823909 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-89b67b00-6a88-40a1-bcf3-5d25fc314ea3 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] 10.222.0.13 "DELETE /v2.0/networks/09a8ad60-7f94-46cb-b01b-cc07e2427bdd HTTP/1.1" status: 204 len: 168 time: 0.3169601 Dec 09 21:38:04.839161 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89b67b00-6a88-40a1-bcf3-5d25fc314ea3 tempest-TagsTest-1268488469 tempest-TagsTest-1268488469-project] Pushing event deleted for resources: {'Network': ['ID=09a8ad60-7f94-46cb-b01b-cc07e2427bdd,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:05.099642 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55622) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:05.242639 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-50cdd543-ec14-48ca-b336-977a1d3368fd admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=03fd1051595b4df89ab225f401c81188&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1414862 Dec 09 21:38:05.245253 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55626) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:05.301038 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-818e0ab6-579f-45dd-8194-2fdfb08bf5f6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:05.326827 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-818e0ab6-579f-45dd-8194-2fdfb08bf5f6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:05.432427 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-818e0ab6-579f-45dd-8194-2fdfb08bf5f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:05.436431 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-818e0ab6-579f-45dd-8194-2fdfb08bf5f6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:05.440283 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-818e0ab6-579f-45dd-8194-2fdfb08bf5f6 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/c1c83e35-17ab-485a-bc87-b8f91685e2d1 HTTP/1.1" status: 204 len: 168 time: 0.1917188 Dec 09 21:38:05.468939 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-01076424-5702-4b83-bff8-394a6ec4d70b req-c9fc6a2b-fd52-4513-be1d-6c0260d9068a tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 210 time: 0.0395775 Dec 09 21:38:05.476131 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-818e0ab6-579f-45dd-8194-2fdfb08bf5f6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c1c83e35-17ab-485a-bc87-b8f91685e2d1,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:05.543377 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0a1c84bf-a8b6-40c3-a088-d52b71854f69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:06.615829 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:06.757625 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fc6ab2a2-ca9d-4446-b1a6-9ac28f66a0da req-cde072b3-a251-43ed-b868-1c3889f4f2b1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 210 time: 0.0814519 Dec 09 21:38:07.964572 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:07.978572 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-92e91e40-bff8-4052-8d43-aaec5f0df056 req-d9655445-a2af-4740-b8e6-9a2f50270d1c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 210 time: 0.0571191 Dec 09 21:38:08.753716 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55724) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:08.894017 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-924d9de9-105a-4dca-bf89-61a9e5c7a49b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:08.997278 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-924d9de9-105a-4dca-bf89-61a9e5c7a49b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:09.006057 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-924d9de9-105a-4dca-bf89-61a9e5c7a49b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:09.061285 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55730) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:09.061877 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-924d9de9-105a-4dca-bf89-61a9e5c7a49b admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=60e5588891d64fe2a49d4d090ca1064b&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3064675 Dec 09 21:38:09.062449 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-924d9de9-105a-4dca-bf89-61a9e5c7a49b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b530a6bd-cf1f-4f29-8e33-734953d8bd70,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:09.111125 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0cd8b17e-d046-4c65-8d47-b6ced94f26c7 req-df0d423e-dfa3-40a7-bf09-ccf170789e74 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 210 time: 0.0301657 Dec 09 21:38:09.137110 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a721cb89-88b0-4c55-97f7-cf58c458e385 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:09.172199 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a721cb89-88b0-4c55-97f7-cf58c458e385 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:09.261843 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a721cb89-88b0-4c55-97f7-cf58c458e385 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:09.265117 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a721cb89-88b0-4c55-97f7-cf58c458e385 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:09.270521 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a721cb89-88b0-4c55-97f7-cf58c458e385 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/b530a6bd-cf1f-4f29-8e33-734953d8bd70 HTTP/1.1" status: 204 len: 168 time: 0.2080390 Dec 09 21:38:09.288858 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a721cb89-88b0-4c55-97f7-cf58c458e385 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b530a6bd-cf1f-4f29-8e33-734953d8bd70,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:09.673904 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:09.853875 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55788) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:09.885509 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac1e0ffe-f6ac-4c9e-989d-af38439a7d08 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:10.034727 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac1e0ffe-f6ac-4c9e-989d-af38439a7d08 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:10.043875 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac1e0ffe-f6ac-4c9e-989d-af38439a7d08 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:10.121085 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ac1e0ffe-f6ac-4c9e-989d-af38439a7d08 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ca822e574c564151936da58c9e99f139&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2620842 Dec 09 21:38:10.121621 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55796) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:10.157342 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac1e0ffe-f6ac-4c9e-989d-af38439a7d08 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a882234-e82f-497a-b94c-bcfd3c5dd145,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:10.307746 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2f11b08-dfd8-40aa-b947-11d94ab2e3a6 req-a732cf1f-51d0-4b40-8e8f-2408795ec5e6 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 210 time: 0.0767951 Dec 09 21:38:10.351717 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a70e3ac-8f8c-4528-bd23-ede27ca2b5fe admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:10.400441 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a70e3ac-8f8c-4528-bd23-ede27ca2b5fe admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:10.468876 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a70e3ac-8f8c-4528-bd23-ede27ca2b5fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:10.472732 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a70e3ac-8f8c-4528-bd23-ede27ca2b5fe admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:10.474791 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8a70e3ac-8f8c-4528-bd23-ede27ca2b5fe admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/9a882234-e82f-497a-b94c-bcfd3c5dd145 HTTP/1.1" status: 204 len: 168 time: 0.3527186 Dec 09 21:38:10.487543 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a70e3ac-8f8c-4528-bd23-ede27ca2b5fe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a882234-e82f-497a-b94c-bcfd3c5dd145,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:11.509499 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3ddb7bb9-11dd-4d36-9bdf-c3333d3d4e7b req-95f76c28-3457-477a-9946-9f374dde0e79 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 210 time: 0.0672276 Dec 09 21:38:12.072428 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:38:12.644553 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2a42aee0-e73b-4c52-836e-4ebcda389b0f req-799eb055-6035-4f37-931d-aecfe993447c tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 210 time: 0.0361867 Dec 09 21:38:13.612405 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55906) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:13.873147 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32fb2427-e8de-4e18-8ecc-910b011d4ee5 req-c6e4bb1a-400b-4da2-9dff-9527d60da7d1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 210 time: 0.1186640 Dec 09 21:38:13.919360 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ad028e48-5351-44db-80e2-c751494626df admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:14.112986 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ad028e48-5351-44db-80e2-c751494626df admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:14.123061 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ad028e48-5351-44db-80e2-c751494626df admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:14.179089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ad028e48-5351-44db-80e2-c751494626df admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=b60d4fd4f5e44f099320319a74d0429f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5643752 Dec 09 21:38:14.180236 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad028e48-5351-44db-80e2-c751494626df admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=61af8ae2-e226-4b73-b937-adc7c560100b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:14.182231 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55916) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:14.257071 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bdeb3890-4fe5-41b4-8a9d-4545acc90666 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:14.284376 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bdeb3890-4fe5-41b4-8a9d-4545acc90666 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:14.341503 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bdeb3890-4fe5-41b4-8a9d-4545acc90666 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:14.344910 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bdeb3890-4fe5-41b4-8a9d-4545acc90666 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:14.346176 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bdeb3890-4fe5-41b4-8a9d-4545acc90666 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/61af8ae2-e226-4b73-b937-adc7c560100b HTTP/1.1" status: 204 len: 168 time: 0.1628070 Dec 09 21:38:14.354788 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdeb3890-4fe5-41b4-8a9d-4545acc90666 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=61af8ae2-e226-4b73-b937-adc7c560100b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:15.044434 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3914b742-a19d-4b36-8d11-c72c04119635 req-7d855838-e8ca-4c16-aa78-5689f41e2221 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 210 time: 0.0436795 Dec 09 21:38:16.157597 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-70081b25-441c-43da-9704-b9ba315747e6 req-c52c2a92-fed1-4a89-a86e-c065237755ee tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 210 time: 0.0298290 Dec 09 21:38:16.470151 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55998) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:16.722109 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-331b1e5c-e4fe-4a5d-9c4c-367084483d76 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:16.819407 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-331b1e5c-e4fe-4a5d-9c4c-367084483d76 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:16.829390 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-331b1e5c-e4fe-4a5d-9c4c-367084483d76 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:16.882408 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-331b1e5c-e4fe-4a5d-9c4c-367084483d76 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=38b4dfc17eae496686fc52411f152d2f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4113696 Dec 09 21:38:16.883548 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-331b1e5c-e4fe-4a5d-9c4c-367084483d76 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0a3ddb64-9dd2-424c-a443-5e895e523ddf,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:16.885494 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56006) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:17.034514 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ffbc7a73-0dd4-401a-9e05-7a924afc8e40 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:17.060840 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ffbc7a73-0dd4-401a-9e05-7a924afc8e40 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:17.125845 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-d72caa40-dd7d-454c-952e-0f4262a8fe68 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 665 time: 0.2457082 Dec 09 21:38:17.127058 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ffbc7a73-0dd4-401a-9e05-7a924afc8e40 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:17.130136 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ffbc7a73-0dd4-401a-9e05-7a924afc8e40 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:17.131625 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ffbc7a73-0dd4-401a-9e05-7a924afc8e40 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/0a3ddb64-9dd2-424c-a443-5e895e523ddf HTTP/1.1" status: 204 len: 168 time: 0.2353406 Dec 09 21:38:17.160168 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffbc7a73-0dd4-401a-9e05-7a924afc8e40 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0a3ddb64-9dd2-424c-a443-5e895e523ddf,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:17.327071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-c3434c26-6d8e-4afa-b259-c4662bca5d6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:17.327585 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-c3434c26-6d8e-4afa-b259-c4662bca5d6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:17.328210 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-c3434c26-6d8e-4afa-b259-c4662bca5d6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:17.328808 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-c3434c26-6d8e-4afa-b259-c4662bca5d6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:17.329834 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-c3434c26-6d8e-4afa-b259-c4662bca5d6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:17.330850 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-c3434c26-6d8e-4afa-b259-c4662bca5d6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:17.331476 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-c3434c26-6d8e-4afa-b259-c4662bca5d6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:17.335401 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-c3434c26-6d8e-4afa-b259-c4662bca5d6c service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0a5d0e4652be4d8b87936a559840cc87&device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 6509 time: 0.1625032 Dec 09 21:38:17.411530 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fbf64ce7-e6aa-4356-959f-d9b3b13298d8 req-1e5e6a36-f9ad-41b2-81f3-cc52cef2d1d0 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 210 time: 0.0525002 Dec 09 21:38:17.548999 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-c1bea960-403a-4e09-a4a8-201aad35173d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:17.549564 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-c1bea960-403a-4e09-a4a8-201aad35173d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:17.550030 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-c1bea960-403a-4e09-a4a8-201aad35173d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:17.552192 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-c1bea960-403a-4e09-a4a8-201aad35173d service neutron] 10.222.0.10 "GET /v2.0/networks?id=361619eb-51a4-4728-b2cc-72e27ec4eca5&id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&id=ae9d25d5-c9a2-4627-a465-8324b17541d9&id=ae9d25d5-c9a2-4627-a465-8324b17541d9 HTTP/1.1" status: 200 len: 2296 time: 0.1704268 Dec 09 21:38:17.653531 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-10eef01b-28c1-489f-8bdf-8dadd9552e92 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a HTTP/1.1" status: 200 len: 1002 time: 0.0930951 Dec 09 21:38:17.726508 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-bb6ac802-12b3-4499-ab8c-90e8556b0f9d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:17.728444 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-bb6ac802-12b3-4499-ab8c-90e8556b0f9d service neutron] 10.222.0.10 "GET /v2.0/subnets?id=d989acab-7cdc-482f-a350-344dd6e11873 HTTP/1.1" status: 200 len: 856 time: 0.0671263 Dec 09 21:38:17.816279 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-28e00045-77d8-4e73-8e66-5317e22950c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:17.818122 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-28e00045-77d8-4e73-8e66-5317e22950c4 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=361619eb-51a4-4728-b2cc-72e27ec4eca5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0826290 Dec 09 21:38:17.829601 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-4cf60e1a-8f7e-4023-8109-07b00f6a263e service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:17.830653 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-4cf60e1a-8f7e-4023-8109-07b00f6a263e service neutron] 10.222.0.10 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0054359 Dec 09 21:38:18.000952 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-748dbbbc-53d1-467e-9784-99c1553645b2 service neutron] 10.222.0.10 "GET /v2.0/networks/361619eb-51a4-4728-b2cc-72e27ec4eca5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1620278 Dec 09 21:38:18.160520 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-b26883b3-6318-469c-ad86-4a727fd057d6 service neutron] 10.222.0.10 "GET /v2.0/networks/361619eb-51a4-4728-b2cc-72e27ec4eca5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1521809 Dec 09 21:38:18.267200 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-73673a29-80b2-44d8-8192-9b881a074e4a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.107&port_id=18d9d7fa-fedf-4844-90ef-6757eb984ae2 HTTP/1.1" status: 200 len: 217 time: 0.0865223 Dec 09 21:38:18.344699 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-357658b8-6c50-40c9-81f3-0f64b1d086cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:18.347202 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-357658b8-6c50-40c9-81f3-0f64b1d086cb service neutron] 10.222.0.10 "GET /v2.0/subnets?id=871c2dc1-486e-4fcf-a882-5a1394082fc5 HTTP/1.1" status: 200 len: 797 time: 0.0720997 Dec 09 21:38:18.413059 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-49562dbc-7210-4912-8124-0254a8d1987b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:18.414899 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-49562dbc-7210-4912-8124-0254a8d1987b service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0617583 Dec 09 21:38:18.505703 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56054) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.596673 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9591cd7c-cd6d-4738-b2bd-e24ce8dedc5e req-615109ee-5997-40cf-887f-dfbfe0725d05 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 210 time: 0.0584583 Dec 09 21:38:18.652106 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-256e47fa-6103-4703-bfbe-f97ef9f819a3 service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2295175 Dec 09 21:38:18.682799 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-4b4d3e7e-8d7b-4459-8a8f-67eef7012812 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.684609 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4b4d3e7e-8d7b-4459-8a8f-67eef7012812 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.1772430 Dec 09 21:38:18.687590 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56058) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.691951 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-9a1a3dc1-89f6-4e02-ad42-980f82e08838 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/address-group returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.693585 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9a1a3dc1-89f6-4e02-ad42-980f82e08838 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/address-group HTTP/1.1" status: 200 len: 353 time: 0.0048883 Dec 09 21:38:18.697271 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56060) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.701837 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [None req-801f28fe-8da3-4394-a3fd-3edb1ca3d8e2 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/address-scope returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.706778 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-801f28fe-8da3-4394-a3fd-3edb1ca3d8e2 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/address-scope HTTP/1.1" status: 200 len: 357 time: 0.0063083 Dec 09 21:38:18.707071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56064) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.714339 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [None req-60f2c53c-3f94-42ea-9012-e4677cd28451 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/router-admin-state-down-before-update returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.717674 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-60f2c53c-3f94-42ea-9012-e4677cd28451 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/router-admin-state-down-before-update HTTP/1.1" status: 200 len: 506 time: 0.0071507 Dec 09 21:38:18.718620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56066) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.723263 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-fbac169c-22f8-4de2-a760-0d601f136c87 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/agent returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.727912 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fbac169c-22f8-4de2-a760-0d601f136c87 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/agent HTTP/1.1" status: 200 len: 347 time: 0.0080822 Dec 09 21:38:18.728830 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56068) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.733381 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-eecc6b38-9f59-4cf0-8ee4-2bf02de1246a tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/agent-resources-synced returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.737500 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-eecc6b38-9f59-4cf0-8ee4-2bf02de1246a tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/agent-resources-synced HTTP/1.1" status: 200 len: 417 time: 0.0075850 Dec 09 21:38:18.738237 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56070) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.742907 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-02d21335-a821-4c0c-b4a9-2e327c07d047 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/allowed-address-pairs returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.747045 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-02d21335-a821-4c0c-b4a9-2e327c07d047 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/allowed-address-pairs HTTP/1.1" status: 200 len: 378 time: 0.0075088 Dec 09 21:38:18.747830 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56072) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.752949 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-6ab3cb9c-22d3-4da9-8d14-97768011eff2 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/auto-allocated-topology returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.757713 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6ab3cb9c-22d3-4da9-8d14-97768011eff2 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/auto-allocated-topology HTTP/1.1" status: 200 len: 394 time: 0.0084751 Dec 09 21:38:18.758455 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56074) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.763716 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-1d31a27c-3e1b-448c-a9ec-2682f95de53b tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/availability_zone returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.768019 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1d31a27c-3e1b-448c-a9ec-2682f95de53b tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/availability_zone HTTP/1.1" status: 200 len: 372 time: 0.0083108 Dec 09 21:38:18.768793 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56076) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.775009 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-9947016a-59fe-40d9-ba07-8f37684aa2e8 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/availability_zone_filter returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.779785 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9947016a-59fe-40d9-ba07-8f37684aa2e8 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/availability_zone_filter HTTP/1.1" status: 200 len: 414 time: 0.0093052 Dec 09 21:38:18.780577 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56078) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.794106 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-d6ebf075-c014-4cd3-bfb2-31a246c3981a tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/default-subnetpools returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.794106 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d6ebf075-c014-4cd3-bfb2-31a246c3981a tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/default-subnetpools HTTP/1.1" status: 200 len: 405 time: 0.0100670 Dec 09 21:38:18.797661 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56080) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.801216 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-85cefa4c-b79f-4241-8d2e-0e9715f0f23f tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/dhcp_agent_scheduler returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.812733 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-85cefa4c-b79f-4241-8d2e-0e9715f0f23f tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/dhcp_agent_scheduler HTTP/1.1" status: 200 len: 381 time: 0.0117574 Dec 09 21:38:18.814293 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56082) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.822802 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-877f74de-50a0-4f48-a03d-25c96c2abe68 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/dvr returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.827997 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-877f74de-50a0-4f48-a03d-25c96c2abe68 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/dvr HTTP/1.1" status: 200 len: 387 time: 0.0124481 Dec 09 21:38:18.828689 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56084) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.835592 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-749ef5e0-0a66-44a0-a15f-bae36e2b43ca tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/empty-string-filtering returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.839644 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-749ef5e0-0a66-44a0-a15f-bae36e2b43ca tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/empty-string-filtering HTTP/1.1" status: 200 len: 413 time: 0.0097771 Dec 09 21:38:18.840403 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56086) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.845151 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-a7cac870-513b-4419-a1aa-f57c970a7b32 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/external-net returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.849297 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a7cac870-513b-4419-a1aa-f57c970a7b32 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/external-net HTTP/1.1" status: 200 len: 394 time: 0.0063653 Dec 09 21:38:18.850204 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56088) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.856610 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-742c0c4a-3ca7-4a46-9b50-a810c5277d21 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/extra_dhcp_opt returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.857696 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-742c0c4a-3ca7-4a46-9b50-a810c5277d21 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/extra_dhcp_opt HTTP/1.1" status: 200 len: 498 time: 0.0065727 Dec 09 21:38:18.860537 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56090) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.869164 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-2ec919f1-e71e-4e1a-896f-253d30b037c2 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/extraroute returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.870790 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2ec919f1-e71e-4e1a-896f-253d30b037c2 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/extraroute HTTP/1.1" status: 200 len: 375 time: 0.0091436 Dec 09 21:38:18.873800 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56092) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.881460 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-6af8bbf9-6e0e-4e51-8644-d36e3524daab tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/extraroute-atomic returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.883886 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6af8bbf9-6e0e-4e51-8644-d36e3524daab tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/extraroute-atomic HTTP/1.1" status: 200 len: 444 time: 0.0090511 Dec 09 21:38:18.885390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56094) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.890157 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-0fa9c52a-22aa-4432-89b2-d7695f3d18ff tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/filter-validation returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.894066 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0fa9c52a-22aa-4432-89b2-d7695f3d18ff tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/filter-validation HTTP/1.1" status: 200 len: 392 time: 0.0076368 Dec 09 21:38:18.894668 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56096) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.900560 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-b06c5ccf-91ec-46df-98a3-d9ea74b1ad8f tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/fip-port-details returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.904634 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b06c5ccf-91ec-46df-98a3-d9ea74b1ad8f tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/fip-port-details HTTP/1.1" status: 200 len: 406 time: 0.0088265 Dec 09 21:38:18.905568 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56098) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.912471 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-e3ebe1d9-dc80-4a83-86e0-70e59944aa68 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/flavors returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.917473 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e3ebe1d9-dc80-4a83-86e0-70e59944aa68 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/flavors HTTP/1.1" status: 200 len: 387 time: 0.0090420 Dec 09 21:38:18.918952 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56100) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.925558 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-cd40e58e-ded6-405d-8654-2dee0d877785 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/floatingip-pools returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.926661 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cd40e58e-ded6-405d-8654-2dee0d877785 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/floatingip-pools HTTP/1.1" status: 200 len: 382 time: 0.0059354 Dec 09 21:38:18.929554 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56102) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.934641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-b5c394f3-5c87-44ff-9f6d-31d253898993 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/ip-substring-filtering returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.935845 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b5c394f3-5c87-44ff-9f6d-31d253898993 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/ip-substring-filtering HTTP/1.1" status: 200 len: 416 time: 0.0052066 Dec 09 21:38:18.938982 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56104) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.947888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-7f295e0b-af29-4cc6-af4c-b599503e4dcb tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/router returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.955911 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7f295e0b-af29-4cc6-af4c-b599503e4dcb tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/router HTTP/1.1" status: 200 len: 450 time: 0.0120323 Dec 09 21:38:18.956463 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56108) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.968522 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-3f1a63ce-de73-42cf-bc32-f5c5212c880d tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/ext-gw-mode returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.971972 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3f1a63ce-de73-42cf-bc32-f5c5212c880d tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/ext-gw-mode HTTP/1.1" status: 200 len: 462 time: 0.0121121 Dec 09 21:38:18.977494 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56110) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.983972 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-a18ed404-de98-4526-9d75-9e75ba0b06ad tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/l3-ha returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:18.987328 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a18ed404-de98-4526-9d75-9e75ba0b06ad tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/l3-ha HTTP/1.1" status: 200 len: 360 time: 0.0071323 Dec 09 21:38:18.988657 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56112) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:18.999160 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-b195f44d-ea58-4305-a853-2de7c2383f79 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/l3-flavors returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.002559 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b195f44d-ea58-4305-a853-2de7c2383f79 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/l3-flavors HTTP/1.1" status: 200 len: 366 time: 0.0105901 Dec 09 21:38:19.003010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56114) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.007541 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-0da93b12-89c9-4be0-8ce4-d86c25c2fad5 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/l3-port-ip-change-not-allowed returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.011686 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0da93b12-89c9-4be0-8ce4-d86c25c2fad5 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/l3-port-ip-change-not-allowed HTTP/1.1" status: 200 len: 439 time: 0.0076280 Dec 09 21:38:19.012262 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56116) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.017021 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-5267d266-6e25-461a-bd7b-a9604153e0ff tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/l3_agent_scheduler returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.020046 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5267d266-6e25-461a-bd7b-a9604153e0ff tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/l3_agent_scheduler HTTP/1.1" status: 200 len: 374 time: 0.0068233 Dec 09 21:38:19.020957 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56118) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.025917 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-4644c981-18ab-41e5-9d54-28b92b6e3e19 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/metering returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.029572 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4644c981-18ab-41e5-9d54-28b92b6e3e19 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/metering HTTP/1.1" status: 200 len: 357 time: 0.0071929 Dec 09 21:38:19.030155 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56120) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.034569 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-bdd3cce4-f48c-4f09-acf1-bd7eb18e9825 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/metering_source_and_destination_fields returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.038201 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bdd3cce4-f48c-4f09-acf1-bd7eb18e9825 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/metering_source_and_destination_fields HTTP/1.1" status: 200 len: 515 time: 0.0069227 Dec 09 21:38:19.038760 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56122) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.042969 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-16ba746b-f298-4fd3-9b58-5b749a6915f2 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/multi-provider returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.046634 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-16ba746b-f298-4fd3-9b58-5b749a6915f2 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/multi-provider HTTP/1.1" status: 200 len: 406 time: 0.0070064 Dec 09 21:38:19.047385 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56124) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.051145 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-ca74876b-d0a1-4c28-9ec4-3e834fcdb0e3 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/net-mtu returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.055797 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ca74876b-d0a1-4c28-9ec4-3e834fcdb0e3 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/net-mtu HTTP/1.1" status: 200 len: 370 time: 0.0074921 Dec 09 21:38:19.056342 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56126) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.060785 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-5f0bf268-6921-40a3-aca3-b94e63baf196 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/net-mtu-writable returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.064136 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56128) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.064617 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5f0bf268-6921-40a3-aca3-b94e63baf196 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/net-mtu-writable HTTP/1.1" status: 200 len: 401 time: 0.0070298 Dec 09 21:38:19.072013 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [None req-b27efd8e-e6c9-4643-a9fe-14412a76929e tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/network_availability_zone returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.072013 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b27efd8e-e6c9-4643-a9fe-14412a76929e tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/network_availability_zone HTTP/1.1" status: 200 len: 394 time: 0.0061743 Dec 09 21:38:19.074113 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56130) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.079749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-2812086a-55c9-43dd-be7d-d6585ba98025 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/network-ip-availability returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.084134 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2812086a-55c9-43dd-be7d-d6585ba98025 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/network-ip-availability HTTP/1.1" status: 200 len: 410 time: 0.0086942 Dec 09 21:38:19.084936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56132) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.097388 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-f8fcc5ea-a39d-4913-949b-0e2d437eef61 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/pagination returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.098518 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f8fcc5ea-a39d-4913-949b-0e2d437eef61 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/pagination HTTP/1.1" status: 200 len: 386 time: 0.0064974 Dec 09 21:38:19.101205 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56136) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.104973 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-7288c157-d25c-4dcc-bc6f-415161a179e1 service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4453487 Dec 09 21:38:19.109786 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [None req-f44cd284-8bb0-4182-a603-01f4d81fbd31 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/port-device-profile returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.109786 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f44cd284-8bb0-4182-a603-01f4d81fbd31 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/port-device-profile HTTP/1.1" status: 200 len: 383 time: 0.0064561 Dec 09 21:38:19.111892 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56138) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.118763 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [None req-85da03cb-d7ed-475b-a6e5-3128d0895d2b tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/port-mac-address-regenerate returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.119839 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-85da03cb-d7ed-475b-a6e5-3128d0895d2b tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/port-mac-address-regenerate HTTP/1.1" status: 200 len: 403 time: 0.0062530 Dec 09 21:38:19.122442 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56142) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.127736 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-bf46b220-94db-4084-bd33-af6cfdc272dc tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/port-numa-affinity-policy returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.128693 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bf46b220-94db-4084-bd33-af6cfdc272dc tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/port-numa-affinity-policy HTTP/1.1" status: 200 len: 392 time: 0.0051205 Dec 09 21:38:19.131300 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56144) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.135304 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-096bc665-b937-4f3c-9a8f-b4d417c32103 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/binding returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.138326 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-096bc665-b937-4f3c-9a8f-b4d417c32103 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/binding HTTP/1.1" status: 200 len: 387 time: 0.0040240 Dec 09 21:38:19.138590 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56146) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.145681 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-9aa7d13e-147f-49b0-83b5-0d33379ce75e tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/binding-extended returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.149562 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9aa7d13e-147f-49b0-83b5-0d33379ce75e tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/binding-extended HTTP/1.1" status: 200 len: 406 time: 0.0079865 Dec 09 21:38:19.149732 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56148) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.156810 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-6e0b1339-e831-4dbd-94bc-8dcad24e14a8 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/port-security returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.160445 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6e0b1339-e831-4dbd-94bc-8dcad24e14a8 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/port-security HTTP/1.1" status: 200 len: 354 time: 0.0073409 Dec 09 21:38:19.161966 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56150) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.164491 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-9aeea052-fc5b-45c2-87ea-75afebe356b2 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.197&port_id=1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f HTTP/1.1" status: 200 len: 217 time: 0.0494735 Dec 09 21:38:19.166938 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-d14ddf57-6043-4b3a-b94a-c5d46bdf8b12 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/project-id returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.169574 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d14ddf57-6043-4b3a-b94a-c5d46bdf8b12 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/project-id HTTP/1.1" status: 200 len: 398 time: 0.0066741 Dec 09 21:38:19.172798 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56152) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.186368 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-4ab8c52b-82ad-4dc9-b98d-304a0cefad54 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/provider returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.188108 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4ab8c52b-82ad-4dc9-b98d-304a0cefad54 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/provider HTTP/1.1" status: 200 len: 385 time: 0.0129728 Dec 09 21:38:19.190021 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56156) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.214859 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-ac7f2376-9dd1-48cb-8220-404d025af7d7 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/quota-check-limit returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.214859 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ac7f2376-9dd1-48cb-8220-404d025af7d7 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/quota-check-limit HTTP/1.1" status: 200 len: 420 time: 0.0171247 Dec 09 21:38:19.214859 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56158) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.223080 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-fd831e62-15ca-4706-bb4f-acd531307b50 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/quotas returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.229554 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fd831e62-15ca-4706-bb4f-acd531307b50 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/quotas HTTP/1.1" status: 200 len: 386 time: 0.0149345 Dec 09 21:38:19.230146 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56162) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.234213 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-9f291f10-b099-4d5b-8f21-dd8f5083177d tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/quota_details returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.237755 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-96cbf1ba-2643-4cab-a395-5178670f59ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:19.239921 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-96cbf1ba-2643-4cab-a395-5178670f59ab service neutron] 10.222.0.10 "GET /v2.0/subnets?id=871c2dc1-486e-4fcf-a882-5a1394082fc5 HTTP/1.1" status: 200 len: 797 time: 0.0682890 Dec 09 21:38:19.240148 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9f291f10-b099-4d5b-8f21-dd8f5083177d tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/quota_details HTTP/1.1" status: 200 len: 407 time: 0.0072274 Dec 09 21:38:19.240890 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56164) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.245662 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [None req-bc589e9a-2b75-4cc2-87fe-ed1a40b4c3b7 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/rbac-policies returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.246885 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bc589e9a-2b75-4cc2-87fe-ed1a40b4c3b7 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/rbac-policies HTTP/1.1" status: 200 len: 417 time: 0.0050406 Dec 09 21:38:19.249419 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56166) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.253771 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [None req-1591c844-7115-4883-b907-6aba2cdfaa2e tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/rbac-address-group returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.255706 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1591c844-7115-4883-b907-6aba2cdfaa2e tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/rbac-address-group HTTP/1.1" status: 200 len: 392 time: 0.0051889 Dec 09 21:38:19.258373 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56168) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.263872 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-6e23cea0-c740-41b9-8129-ee865584c276 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/rbac-address-scope returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.267569 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56170) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.268409 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6e23cea0-c740-41b9-8129-ee865584c276 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/rbac-address-scope HTTP/1.1" status: 200 len: 384 time: 0.0084491 Dec 09 21:38:19.274365 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [None req-a2185a3b-3cd1-4ff3-8d6e-7de928c66f4a tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/rbac-security-groups returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.275749 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a2185a3b-3cd1-4ff3-8d6e-7de928c66f4a tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/rbac-security-groups HTTP/1.1" status: 200 len: 404 time: 0.0069711 Dec 09 21:38:19.278851 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56172) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.283157 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-95bbd9ce-26b3-4bab-ba6c-edf50d4f5ec6 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/rbac-subnetpool returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.288060 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-95bbd9ce-26b3-4bab-ba6c-edf50d4f5ec6 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/rbac-subnetpool HTTP/1.1" status: 200 len: 375 time: 0.0073400 Dec 09 21:38:19.291370 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56174) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.301184 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [None req-6b0da435-3728-491b-b2dc-f4a69bf22502 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/revision-if-match returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.302228 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6b0da435-3728-491b-b2dc-f4a69bf22502 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/revision-if-match HTTP/1.1" status: 200 len: 441 time: 0.0096014 Dec 09 21:38:19.305349 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56176) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.310575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-d5ac34c7-d603-4833-a4a0-0dfd4457368a tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/standard-attr-revisions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.314095 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56178) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.314207 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d5ac34c7-d603-4833-a4a0-0dfd4457368a tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/standard-attr-revisions HTTP/1.1" status: 200 len: 423 time: 0.0077226 Dec 09 21:38:19.320165 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [None req-25a2d237-24c3-4612-82fd-e28ddc1b5dc2 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/router_availability_zone returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.321129 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-25a2d237-24c3-4612-82fd-e28ddc1b5dc2 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/router_availability_zone HTTP/1.1" status: 200 len: 391 time: 0.0061171 Dec 09 21:38:19.324336 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56180) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.324626 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-82a8d0aa-28d6-477a-a1e0-677468e62b49 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:19.326230 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-82a8d0aa-28d6-477a-a1e0-677468e62b49 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0783212 Dec 09 21:38:19.331527 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-0d8af9eb-1702-4486-9e52-dcae1f353ff0 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/security-groups-normalized-cidr returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.331527 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0d8af9eb-1702-4486-9e52-dcae1f353ff0 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/security-groups-normalized-cidr HTTP/1.1" status: 200 len: 445 time: 0.0053272 Dec 09 21:38:19.333935 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56182) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.344895 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-a7b813dc-92dd-4083-8b5c-6f65e3a7e52e tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/port-security-groups-filtering returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.346080 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a7b813dc-92dd-4083-8b5c-6f65e3a7e52e tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/port-security-groups-filtering HTTP/1.1" status: 200 len: 422 time: 0.0103941 Dec 09 21:38:19.351006 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56184) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.356493 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-7202ddf3-f81d-4d71-8019-8c0a94bdb656 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/security-groups-remote-address-group returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.357643 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7202ddf3-f81d-4d71-8019-8c0a94bdb656 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/security-groups-remote-address-group HTTP/1.1" status: 200 len: 448 time: 0.0057554 Dec 09 21:38:19.361579 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56186) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.369404 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-e1b42ff6-4ea3-411d-ab6a-80dd72ef50d8 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/security-groups-shared-filtering returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.374007 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56188) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.376445 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e1b42ff6-4ea3-411d-ab6a-80dd72ef50d8 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/security-groups-shared-filtering HTTP/1.1" status: 200 len: 435 time: 0.0132327 Dec 09 21:38:19.388885 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [None req-36077536-61b4-4d76-92fb-17caa7602522 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/security-group returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.390079 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-36077536-61b4-4d76-92fb-17caa7602522 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/security-group HTTP/1.1" status: 200 len: 364 time: 0.0147831 Dec 09 21:38:19.392805 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56190) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.398565 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-25374cd7-47f0-43b6-bf1c-b6297f8e5bb4 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/service-type returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.401798 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-25374cd7-47f0-43b6-bf1c-b6297f8e5bb4 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/service-type HTTP/1.1" status: 200 len: 415 time: 0.0079629 Dec 09 21:38:19.402388 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56192) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.411181 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-81b0d484-5b0d-4def-825e-6895351acb7a tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/sorting returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.415089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-81b0d484-5b0d-4def-825e-6895351acb7a tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/sorting HTTP/1.1" status: 200 len: 377 time: 0.0117068 Dec 09 21:38:19.415840 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56194) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.420885 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-3dddab30-ecc2-42f8-b32a-a87769ec6e8e tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/standard-attr-description returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.424497 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3dddab30-ecc2-42f8-b32a-a87769ec6e8e tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/standard-attr-description HTTP/1.1" status: 200 len: 408 time: 0.0070438 Dec 09 21:38:19.425057 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56196) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.439408 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-968bf5d9-9a09-4914-b9e2-fb692c77e791 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/stateful-security-group returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.443286 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-968bf5d9-9a09-4914-b9e2-fb692c77e791 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/stateful-security-group HTTP/1.1" status: 200 len: 402 time: 0.0144763 Dec 09 21:38:19.444332 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56200) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.457056 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [None req-6d16ffed-efc5-432a-a4a3-a65d7b37d9f9 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/subnet_onboard returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.461505 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6d16ffed-efc5-432a-a4a3-a65d7b37d9f9 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/subnet_onboard HTTP/1.1" status: 200 len: 391 time: 0.0097978 Dec 09 21:38:19.463182 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56204) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.475894 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [None req-f82d4493-e9a4-4a2d-8a10-f067892b1e94 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/subnet-service-types returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.479791 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f82d4493-e9a4-4a2d-8a10-f067892b1e94 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/subnet-service-types HTTP/1.1" status: 200 len: 400 time: 0.0138414 Dec 09 21:38:19.482533 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56206) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.486764 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-077126ee-8c04-41fe-bcdc-41d11db13bb5 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/subnet_allocation returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.490379 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-077126ee-8c04-41fe-bcdc-41d11db13bb5 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/subnet_allocation HTTP/1.1" status: 200 len: 388 time: 0.0042000 Dec 09 21:38:19.490583 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56208) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.495119 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-2770737d-be21-4e4f-b685-87fb288fdb0f tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/subnetpool-prefix-ops returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.498345 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2770737d-be21-4e4f-b685-87fb288fdb0f tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/subnetpool-prefix-ops HTTP/1.1" status: 200 len: 418 time: 0.0046287 Dec 09 21:38:19.498862 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56210) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.507465 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [None req-5b0fbd1a-42a6-4c00-9756-9ee0e65169a6 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/standard-attr-tag returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.511282 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5b0fbd1a-42a6-4c00-9756-9ee0e65169a6 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/standard-attr-tag HTTP/1.1" status: 200 len: 537 time: 0.0084147 Dec 09 21:38:19.511640 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56212) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:19.516165 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [None req-2d8b9f8f-d536-459d-863d-2b4afad41b45 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] http://10.222.0.13:9696/v2.0/extensions/standard-attr-timestamp returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:19.517085 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2d8b9f8f-d536-459d-863d-2b4afad41b45 tempest-ExtensionsTestJSON-214515519 tempest-ExtensionsTestJSON-214515519-project] 10.222.0.13 "GET /v2.0/extensions/standard-attr-timestamp HTTP/1.1" status: 200 len: 449 time: 0.0042181 Dec 09 21:38:19.529381 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-1c14bdfb-b60a-432c-993c-8ac438ca1db8 service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1927235 Dec 09 21:38:19.635569 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-a3bb1ee0-284e-45d5-9dfc-c8adda8b0e31 service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0986247 Dec 09 21:38:19.761930 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-56cb35ad-f190-49fc-bb95-bd5aad712c6a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.40&port_id=38f97951-e872-4c24-947f-934429895ad3 HTTP/1.1" status: 200 len: 217 time: 0.1178160 Dec 09 21:38:19.776597 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f45a3b3f-def0-48d4-880a-81ee8a174889 req-5138e3e6-4ea1-4536-8d96-9462b1438e71 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/ports?device_id=9390f3e3-0261-4b70-8f7f-05a5583377da HTTP/1.1" status: 200 len: 210 time: 0.0374990 Dec 09 21:38:19.849787 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-ba957fcd-3c0f-4dc7-be94-9b87b1199fc8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:19.851365 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-ba957fcd-3c0f-4dc7-be94-9b87b1199fc8 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=871c2dc1-486e-4fcf-a882-5a1394082fc5 HTTP/1.1" status: 200 len: 797 time: 0.0843658 Dec 09 21:38:19.949324 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-5d9fc49c-fda5-404f-a448-c77aea447e2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:19.952977 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-5d9fc49c-fda5-404f-a448-c77aea447e2c service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0922246 Dec 09 21:38:20.055032 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56222) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:20.161060 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-bb03a87e-e640-44f8-b465-42d7a68d9aed service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2015657 Dec 09 21:38:20.277682 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-5aa7758c-c8fa-48bb-bd73-6effe1a2a9fd service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1089146 Dec 09 21:38:20.281688 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89bdb751-33b5-48a7-9476-c6e18afc2a99 req-446bd303-7182-4fe5-9061-badb9bf1ca73 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:20.285039 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89bdb751-33b5-48a7-9476-c6e18afc2a99 req-446bd303-7182-4fe5-9061-badb9bf1ca73 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1004913 Dec 09 21:38:20.337462 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3985ef10-aa23-41bb-8c9d-d11b371834f9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:20.359394 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-e9be9342-9413-492d-90fc-51cf7b3f499b service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.1.1.103&port_id=57519c10-1d02-4ce7-b4be-b37a7bd58b09 HTTP/1.1" status: 200 len: 217 time: 0.0733671 Dec 09 21:38:20.483635 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3985ef10-aa23-41bb-8c9d-d11b371834f9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:20.506573 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-0b865317-ea0c-48ce-817e-e9705ddd43e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:20.513304 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-0b865317-ea0c-48ce-817e-e9705ddd43e3 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=871c2dc1-486e-4fcf-a882-5a1394082fc5 HTTP/1.1" status: 200 len: 797 time: 0.1320970 Dec 09 21:38:20.569484 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89bdb751-33b5-48a7-9476-c6e18afc2a99 req-e41d7d4e-76a3-4236-b753-16aafe9accba tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2613041 Dec 09 21:38:20.571871 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3985ef10-aa23-41bb-8c9d-d11b371834f9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:20.631509 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-1a44049c-9f1f-4389-9ddc-2d96efd4c2b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:20.639508 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-1a44049c-9f1f-4389-9ddc-2d96efd4c2b3 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=69c5e9e4-78c6-4a6b-9b16-9f1da643282c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1161964 Dec 09 21:38:20.681914 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3985ef10-aa23-41bb-8c9d-d11b371834f9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2fd4eb55-a9f9-4797-a688-df67ab17753e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:20.691846 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3985ef10-aa23-41bb-8c9d-d11b371834f9 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=12eb0fbb6a6543dbbc3b1ae4a585b818&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6355786 Dec 09 21:38:20.692663 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56234) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:20.793972 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b2210525-2bd4-4825-8342-7f29247bfd51 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:20.830925 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b2210525-2bd4-4825-8342-7f29247bfd51 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:20.906601 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-089e8285-97c8-4ebc-b98c-de8b69b821c5 service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2579825 Dec 09 21:38:20.936583 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b2210525-2bd4-4825-8342-7f29247bfd51 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:20.940540 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b2210525-2bd4-4825-8342-7f29247bfd51 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:20.946049 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b2210525-2bd4-4825-8342-7f29247bfd51 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/2fd4eb55-a9f9-4797-a688-df67ab17753e HTTP/1.1" status: 204 len: 168 time: 0.2521510 Dec 09 21:38:20.966533 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2210525-2bd4-4825-8342-7f29247bfd51 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2fd4eb55-a9f9-4797-a688-df67ab17753e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:21.110000 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-7f7ed201-5d67-418c-8011-88b2ad107810 service neutron] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1951363 Dec 09 21:38:21.177442 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-4bdabe43-28aa-4924-837e-9b03c2c9493e service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.100&port_id=f6c2c656-c5c9-4a38-baf6-3924df82937d HTTP/1.1" status: 200 len: 217 time: 0.0614915 Dec 09 21:38:21.214104 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-597c2ede-0600-48f6-90e4-e32ef4b7eeec req-f4cea210-c229-4b5c-834d-743353a6f5b3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:21.216843 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-597c2ede-0600-48f6-90e4-e32ef4b7eeec req-f4cea210-c229-4b5c-834d-743353a6f5b3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.2341578 Dec 09 21:38:21.246119 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b10334f9-40ef-4121-953e-e650ab0bdd93 req-b65bc647-2468-45af-a4be-efb74defd181 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:21.248225 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b10334f9-40ef-4121-953e-e650ab0bdd93 req-b65bc647-2468-45af-a4be-efb74defd181 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 1097 time: 0.3509398 Dec 09 21:38:21.266160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-6fa4b1c9-fdfe-4991-9387-aafa3f3a2e1c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:21.267908 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-6fa4b1c9-fdfe-4991-9387-aafa3f3a2e1c service neutron] 10.222.0.10 "GET /v2.0/subnets?id=2b4dff83-a3e7-4d10-a901-43c21154e5da HTTP/1.1" status: 200 len: 797 time: 0.0841210 Dec 09 21:38:21.355124 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-e9655a5d-4160-4c76-af94-99e78bf4ae2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:21.358792 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-e9655a5d-4160-4c76-af94-99e78bf4ae2c service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=ae9d25d5-c9a2-4627-a465-8324b17541d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.0829623 Dec 09 21:38:21.512682 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-597c2ede-0600-48f6-90e4-e32ef4b7eeec req-f39598a0-3d12-4a14-82ee-0132cad9386c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2884347 Dec 09 21:38:21.515217 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b10334f9-40ef-4121-953e-e650ab0bdd93 req-a33c905c-329f-4558-9763-cd76d3ec32f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:21.520648 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b10334f9-40ef-4121-953e-e650ab0bdd93 req-a33c905c-329f-4558-9763-cd76d3ec32f1 service neutron] 10.222.0.31 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 913 time: 0.2405767 Dec 09 21:38:21.571241 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-b0fbbca8-8b25-40ca-a27b-6696614a29e5 service neutron] 10.222.0.10 "GET /v2.0/networks/ae9d25d5-c9a2-4627-a465-8324b17541d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2035637 Dec 09 21:38:21.647116 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b10334f9-40ef-4121-953e-e650ab0bdd93 req-30f41ae9-9eeb-4d52-9db3-b881bfdb944e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=90f16e74-f2e6-416e-a079-f205615a0d8e HTTP/1.1" status: 200 len: 1000 time: 0.1181211 Dec 09 21:38:21.717505 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56260) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:21.721166 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b10334f9-40ef-4121-953e-e650ab0bdd93 req-ee2e412f-5386-4e67-b0a0-1d7341b41c8d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:21.730213 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b10334f9-40ef-4121-953e-e650ab0bdd93 req-ee2e412f-5386-4e67-b0a0-1d7341b41c8d service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 200 len: 851 time: 0.0694685 Dec 09 21:38:21.811732 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-0bcab333-ba45-4c8b-8071-820de02872f4 service neutron] 10.222.0.10 "GET /v2.0/networks/ae9d25d5-c9a2-4627-a465-8324b17541d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2302582 Dec 09 21:38:21.837795 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b10334f9-40ef-4121-953e-e650ab0bdd93 req-b6c3fe7f-c07d-4769-857b-49e714bb56e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:21.842699 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b10334f9-40ef-4121-953e-e650ab0bdd93 req-b6c3fe7f-c07d-4769-857b-49e714bb56e5 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1015508 Dec 09 21:38:21.856012 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-b10334f9-40ef-4121-953e-e650ab0bdd93 req-bb61962c-7eaf-46e8-84c5-d78b37de5630 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:38:21.859868 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b10334f9-40ef-4121-953e-e650ab0bdd93 req-bb61962c-7eaf-46e8-84c5-d78b37de5630 service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0083234 Dec 09 21:38:21.869899 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-d327beb6-3683-4620-9ef0-c1483423e72c service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=10.2.2.200&port_id=2c568c8f-47ca-4f47-ab71-187026ca02db HTTP/1.1" status: 200 len: 217 time: 0.0497694 Dec 09 21:38:21.872541 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af3ea776-3aa8-4d0d-8733-86a52e8c514a tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:21.951748 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af3ea776-3aa8-4d0d-8733-86a52e8c514a tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:21.991953 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-6b2bc6cb-1817-4270-ba73-302287b2fef5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:21.993434 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-6b2bc6cb-1817-4270-ba73-302287b2fef5 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=2b4dff83-a3e7-4d10-a901-43c21154e5da HTTP/1.1" status: 200 len: 797 time: 0.1115460 Dec 09 21:38:21.998236 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b10334f9-40ef-4121-953e-e650ab0bdd93 req-9a05daac-cdc0-47b8-bd1d-be88a50481d8 service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1291878 Dec 09 21:38:22.061732 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af3ea776-3aa8-4d0d-8733-86a52e8c514a tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:22.070659 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af3ea776-3aa8-4d0d-8733-86a52e8c514a tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:22.071875 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-af3ea776-3aa8-4d0d-8733-86a52e8c514a tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "DELETE /v2.0/security-groups/7eb72df0-7940-41d2-b7f8-e0c3cff1ced2 HTTP/1.1" status: 204 len: 168 time: 0.3534126 Dec 09 21:38:22.082827 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56270) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:22.129537 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b10334f9-40ef-4121-953e-e650ab0bdd93 req-a69bffca-5979-4246-81cd-aa9da13ef316 service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1220551 Dec 09 21:38:22.133236 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af3ea776-3aa8-4d0d-8733-86a52e8c514a tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7eb72df0-7940-41d2-b7f8-e0c3cff1ced2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:22.151045 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-60b3df88-eb7d-4ad0-bef6-0c8a8fe436c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:22.154646 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-60b3df88-eb7d-4ad0-bef6-0c8a8fe436c6 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=ae9d25d5-c9a2-4627-a465-8324b17541d9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1162 time: 0.1510413 Dec 09 21:38:22.155696 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-d0c35d21-40cb-423f-b0b0-ba88595e67f2 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] show failed (client error): The resource could not be found. Dec 09 21:38:22.156717 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d0c35d21-40cb-423f-b0b0-ba88595e67f2 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "GET /v2.0/security-groups/7eb72df0-7940-41d2-b7f8-e0c3cff1ced2 HTTP/1.1" status: 404 len: 347 time: 0.0752015 Dec 09 21:38:22.161972 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56274) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:22.287764 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-337f3f45-b62e-49a2-8f92-a68fe603ba48 service neutron] 10.222.0.10 "GET /v2.0/networks/ae9d25d5-c9a2-4627-a465-8324b17541d9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1274810 Dec 09 21:38:22.376229 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-7eca8a4b-0d6d-4c8e-a421-85298b81f8ac tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Deleting port 1ac7a7b1-7d92-471a-a03b-8b88ff10b0aa {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:22.376894 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7eca8a4b-0d6d-4c8e-a421-85298b81f8ac tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:22.417624 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56280) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:22.418023 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-df1a3d2b-14a2-4c7f-be3b-aec745cd6471 req-3a23c071-c60f-4831-963c-2bc3f303a9f6 service neutron] 10.222.0.10 "GET /v2.0/networks/ae9d25d5-c9a2-4627-a465-8324b17541d9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1220303 Dec 09 21:38:22.485012 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7eca8a4b-0d6d-4c8e-a421-85298b81f8ac tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:22.485678 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7eca8a4b-0d6d-4c8e-a421-85298b81f8ac tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:22.504158 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-7eca8a4b-0d6d-4c8e-a421-85298b81f8ac tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Calling delete_port for 1ac7a7b1-7d92-471a-a03b-8b88ff10b0aa owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:22.569863 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-bf134ade-b03d-43a4-a4fd-2d482b518545 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Request body: {'network': {'name': 'tempest-ExtraDHCPOptionsTestJSON-test-network-1161471636'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:38:22.657599 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bf134ade-b03d-43a4-a4fd-2d482b518545 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Made reservation on behalf of 090194789ad44e71986cd1d4018b9671 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:38:22.661576 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf134ade-b03d-43a4-a4fd-2d482b518545 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:22.683457 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf134ade-b03d-43a4-a4fd-2d482b518545 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:22.729186 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-187169ef-139f-403c-8a4c-47cb10ab5092 req-35124898-c03c-429e-966d-1c093166cca3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:22.730905 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-187169ef-139f-403c-8a4c-47cb10ab5092 req-35124898-c03c-429e-966d-1c093166cca3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1285577 Dec 09 21:38:22.889313 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-187169ef-139f-403c-8a4c-47cb10ab5092 req-167a7364-301e-422e-aaa2-ccb682ecbe9e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1448052 Dec 09 21:38:22.895349 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7eca8a4b-0d6d-4c8e-a421-85298b81f8ac tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:22.931367 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eca8a4b-0d6d-4c8e-a421-85298b81f8ac tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event deleted for resources: {'Port': ['ID=1ac7a7b1-7d92-471a-a03b-8b88ff10b0aa,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:22.955366 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8239c7c8-2c49-4ac1-a654-695a1b52e33a None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:38:23.007555 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf134ade-b03d-43a4-a4fd-2d482b518545 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:23.027633 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf134ade-b03d-43a4-a4fd-2d482b518545 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:23.077638 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bf134ade-b03d-43a4-a4fd-2d482b518545 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] vlan segment allocate from pool success with {'vlan_id': 111, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:38:23.082388 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7eca8a4b-0d6d-4c8e-a421-85298b81f8ac tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:23.087191 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7eca8a4b-0d6d-4c8e-a421-85298b81f8ac tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:23.091085 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7eca8a4b-0d6d-4c8e-a421-85298b81f8ac tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "DELETE /v2.0/floatingips/12695033-260e-4718-a36f-6ec3b27ba7c8 HTTP/1.1" status: 204 len: 168 time: 0.9238462 Dec 09 21:38:23.093027 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56298) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:23.112603 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf134ade-b03d-43a4-a4fd-2d482b518545 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9b5688e2-86d2-49d7-82f1-b7a4bb251d13,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:23.117327 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf134ade-b03d-43a4-a4fd-2d482b518545 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:23.117675 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-bf134ade-b03d-43a4-a4fd-2d482b518545 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Added segment 3a34ab19-ea7d-4463-8683-e5acf02733c0 of type vlan for network e298ce53-cbb6-468b-a308-987703b107dd Dec 09 21:38:23.174618 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf134ade-b03d-43a4-a4fd-2d482b518545 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:23.212671 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf134ade-b03d-43a4-a4fd-2d482b518545 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:23.228099 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf134ade-b03d-43a4-a4fd-2d482b518545 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:23.228983 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf134ade-b03d-43a4-a4fd-2d482b518545 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:23.276406 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bf134ade-b03d-43a4-a4fd-2d482b518545 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 792 time: 0.8569701 Dec 09 21:38:23.279287 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56300) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:23.299785 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-16386579-72a8-4ff9-893b-11230b1edbbf tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Deleting port 145a0cde-0fe5-4163-a063-0fdfe42f243b {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:23.300239 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16386579-72a8-4ff9-893b-11230b1edbbf tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:23.334690 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf134ade-b03d-43a4-a4fd-2d482b518545 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Pushing event updated for resources: {'Network': ['ID=e298ce53-cbb6-468b-a308-987703b107dd,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:23.353064 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network e298ce53-cbb6-468b-a308-987703b107dd details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:38:23.367235 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-9293ecf7-8b3b-4972-98b9-916343033776 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Request body: {'subnet': {'network_id': 'e298ce53-cbb6-468b-a308-987703b107dd', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:38:23.437888 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16386579-72a8-4ff9-893b-11230b1edbbf tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:23.454407 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-16386579-72a8-4ff9-893b-11230b1edbbf tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Calling delete_port for 145a0cde-0fe5-4163-a063-0fdfe42f243b owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:23.579003 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9293ecf7-8b3b-4972-98b9-916343033776 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Made reservation on behalf of 090194789ad44e71986cd1d4018b9671 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:38:23.583357 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9293ecf7-8b3b-4972-98b9-916343033776 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:23.615270 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16386579-72a8-4ff9-893b-11230b1edbbf tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:23.651974 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16386579-72a8-4ff9-893b-11230b1edbbf tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event deleted for resources: {'Port': ['ID=145a0cde-0fe5-4163-a063-0fdfe42f243b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:23.751217 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16386579-72a8-4ff9-893b-11230b1edbbf tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:23.758168 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-16386579-72a8-4ff9-893b-11230b1edbbf tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "DELETE /v2.0/ports/145a0cde-0fe5-4163-a063-0fdfe42f243b HTTP/1.1" status: 204 len: 168 time: 0.6629977 Dec 09 21:38:23.760531 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56304) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:23.848803 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9293ecf7-8b3b-4972-98b9-916343033776 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:23.906323 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-7e02258d-4586-4503-b0a9-b8e8c643c52d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Deleting port 1e946a47-f496-445b-964b-618881eab263 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:23.906848 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7e02258d-4586-4503-b0a9-b8e8c643c52d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:24.054818 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7e02258d-4586-4503-b0a9-b8e8c643c52d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:24.095473 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-7e02258d-4586-4503-b0a9-b8e8c643c52d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Calling delete_port for 1e946a47-f496-445b-964b-618881eab263 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:24.386048 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7e02258d-4586-4503-b0a9-b8e8c643c52d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:24.425428 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e02258d-4586-4503-b0a9-b8e8c643c52d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event deleted for resources: {'Port': ['ID=1e946a47-f496-445b-964b-618881eab263,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:24.444202 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9293ecf7-8b3b-4972-98b9-916343033776 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Pushing event updated for resources: {'Subnet': ['ID=176a6b00-3ca2-4ff2-af5c-ac34530547b8,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:24.460997 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a22f0e56-d4b1-4e52-85fe-dbce933fd83a req-42c7222c-1c65-4dd1-8cdc-f3d2bb70203e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:24.463935 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a22f0e56-d4b1-4e52-85fe-dbce933fd83a req-42c7222c-1c65-4dd1-8cdc-f3d2bb70203e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1302881 Dec 09 21:38:24.464616 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9293ecf7-8b3b-4972-98b9-916343033776 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Checking segment: {'id': '3a34ab19-ea7d-4463-8683-e5acf02733c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'e298ce53-cbb6-468b-a308-987703b107dd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:38:24.465071 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9293ecf7-8b3b-4972-98b9-916343033776 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Network hostable DHCP agents. Network: e298ce53-cbb6-468b-a308-987703b107dd, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:38:24.503817 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9293ecf7-8b3b-4972-98b9-916343033776 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Network e298ce53-cbb6-468b-a308-987703b107dd is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:38:24.527779 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-9293ecf7-8b3b-4972-98b9-916343033776 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, e298ce53-cbb6-468b-a308-987703b107dd) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:38:24.536085 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6b24fea4-a07c-4638-be73-3b2e646529b3 None None] Network e298ce53-cbb6-468b-a308-987703b107dd requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:38:24.560114 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a22f0e56-d4b1-4e52-85fe-dbce933fd83a req-365f1a51-7fa6-424d-88e2-d285a7d3db06 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0875754 Dec 09 21:38:24.564188 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9293ecf7-8b3b-4972-98b9-916343033776 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:24.565542 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9293ecf7-8b3b-4972-98b9-916343033776 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:24.600377 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9293ecf7-8b3b-4972-98b9-916343033776 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.2657008 Dec 09 21:38:24.600878 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56316) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:24.623371 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-545a66a2-309e-4154-b74e-5a8d3d06534d tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Request body: {'port': {'network_id': 'e298ce53-cbb6-468b-a308-987703b107dd', 'name': 'tempest-ExtraDHCPOptionsTestJSON-1052819626'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:38:24.624130 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7e02258d-4586-4503-b0a9-b8e8c643c52d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:24.628774 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7e02258d-4586-4503-b0a9-b8e8c643c52d tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "DELETE /v2.0/ports/1e946a47-f496-445b-964b-618881eab263 HTTP/1.1" status: 204 len: 168 time: 0.8668821 Dec 09 21:38:24.631908 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56318) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:24.745772 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-ac4698f0-c006-4268-af88-8c0734e70402 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Deleting subnet 753ba647-b0b0-482e-ac28-89c7e6adf654 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:38:24.755088 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac4698f0-c006-4268-af88-8c0734e70402 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:24.791607 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-e298ce53-cbb6-468b-a308-987703b107dd', 'network_id': 'e298ce53-cbb6-468b-a308-987703b107dd', 'project_id': '090194789ad44e71986cd1d4018b9671', 'fixed_ips': [{'subnet_id': '176a6b00-3ca2-4ff2-af5c-ac34530547b8'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:38:24.792819 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:24.844882 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac4698f0-c006-4268-af88-8c0734e70402 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:24.864162 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-545a66a2-309e-4154-b74e-5a8d3d06534d tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Made reservation on behalf of 090194789ad44e71986cd1d4018b9671 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:38:24.867966 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-545a66a2-309e-4154-b74e-5a8d3d06534d tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:24.936876 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78024f40-05f3-44ad-8813-6219a356bb26 req-ed0d712f-7917-4d3f-ba71-bd497b05a41b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:24.941417 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78024f40-05f3-44ad-8813-6219a356bb26 req-ed0d712f-7917-4d3f-ba71-bd497b05a41b tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1871986 Dec 09 21:38:24.949690 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-545a66a2-309e-4154-b74e-5a8d3d06534d tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] device_id is not set on port d2fbcb49-d4ad-47a2-89ed-b6840cd14037 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:38:25.013088 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac4698f0-c006-4268-af88-8c0734e70402 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:25.048096 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Allocated IP 172.20.0.2 (e298ce53-cbb6-468b-a308-987703b107dd/176a6b00-3ca2-4ff2-af5c-ac34530547b8/cb59c333-139c-43c4-a05a-a2c61800f72c) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:38:25.118917 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac4698f0-c006-4268-af88-8c0734e70402 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:25.121628 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78024f40-05f3-44ad-8813-6219a356bb26 req-fa39d819-1cf9-4ab0-a9b7-d1d3bf98e5c0 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463333 Dec 09 21:38:25.168080 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac4698f0-c006-4268-af88-8c0734e70402 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event deleted for resources: {'Subnet': ['ID=753ba647-b0b0-482e-ac28-89c7e6adf654,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:25.179132 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac4698f0-c006-4268-af88-8c0734e70402 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:25.182677 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9fcfa800-9d51-4693-b251-55ac9f21c973 None None] Network a133a939-2827-4fe6-81f5-14715631c0ec requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:38:25.183365 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ac4698f0-c006-4268-af88-8c0734e70402 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "DELETE /v2.0/subnets/753ba647-b0b0-482e-ac28-89c7e6adf654 HTTP/1.1" status: 204 len: 168 time: 0.5504057 Dec 09 21:38:25.185951 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56328) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:25.257611 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-12f0e444-b1c4-4f2e-a44b-eddae57bb42b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Deleting subnet a894075b-fa9f-4a27-9782-e476e86f74e0 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:38:25.273841 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-12f0e444-b1c4-4f2e-a44b-eddae57bb42b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:25.371363 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-12f0e444-b1c4-4f2e-a44b-eddae57bb42b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:25.421261 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:25.437104 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:25.505274 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Network e298ce53-cbb6-468b-a308-987703b107dd is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:38:25.509482 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:38:25.513847 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:38:25.534961 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Pushing event updated for resources: {'Port': ['ID=cb59c333-139c-43c4-a05a-a2c61800f72c,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:25.586874 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-12f0e444-b1c4-4f2e-a44b-eddae57bb42b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:25.596065 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-55e26d4a-0494-40b5-9e4a-c2dd54d698aa None None] DHCP port deletion for a133a939-2827-4fe6-81f5-14715631c0ec request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:38:25.623117 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:25.623868 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:25.624427 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:25.624974 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:25.625524 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:25.626077 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:25.626649 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:25.627182 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:25.627742 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:25.628288 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:25.640056 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:25.640737 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:25.641273 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:25.699272 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-12f0e444-b1c4-4f2e-a44b-eddae57bb42b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:25.714989 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Attempting to bind port cb59c333-139c-43c4-a05a-a2c61800f72c on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:38:25.716887 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Attempting to bind port cb59c333-139c-43c4-a05a-a2c61800f72c by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '3a34ab19-ea7d-4463-8683-e5acf02733c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'e298ce53-cbb6-468b-a308-987703b107dd'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:38:25.718234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Attempting to bind port cb59c333-139c-43c4-a05a-a2c61800f72c on network e298ce53-cbb6-468b-a308-987703b107dd {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:38:25.729062 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-12f0e444-b1c4-4f2e-a44b-eddae57bb42b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:25.736439 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-12f0e444-b1c4-4f2e-a44b-eddae57bb42b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "DELETE /v2.0/subnets/a894075b-fa9f-4a27-9782-e476e86f74e0 HTTP/1.1" status: 204 len: 168 time: 0.5492089 Dec 09 21:38:25.739818 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-297a0011-6d60-4414-8c86-f264a5e69b2d req-02ef2a22-0f02-490e-824d-0a7982bcaa3b service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=62e2a8f5-9097-4f6a-a915-2c8303b50c10&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.3617518 Dec 09 21:38:25.742690 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56334) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:25.772371 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16dc1ca3-6b7c-4718-92a6-cce36f0a78dd req-17d9d64c-b3c7-449d-94eb-d4cd0d0b1ae3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:25.780800 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-16dc1ca3-6b7c-4718-92a6-cce36f0a78dd req-17d9d64c-b3c7-449d-94eb-d4cd0d0b1ae3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.3047848 Dec 09 21:38:25.784183 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-545a66a2-309e-4154-b74e-5a8d3d06534d tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Allocated IP 172.20.0.6 (e298ce53-cbb6-468b-a308-987703b107dd/176a6b00-3ca2-4ff2-af5c-ac34530547b8/d2fbcb49-d4ad-47a2-89ed-b6840cd14037) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:38:25.830789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a651f964-4b7e-4370-a44f-d71afd1eeaf3 None None] Network a859e4ba-764a-41c0-982d-5bf79a2797a1 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:38:25.844081 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 38, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:38:25.844485 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Checking segment: {'id': '3a34ab19-ea7d-4463-8683-e5acf02733c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'e298ce53-cbb6-468b-a308-987703b107dd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:38:25.844904 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:25.845306 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Bound using segment: {'id': '3a34ab19-ea7d-4463-8683-e5acf02733c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'e298ce53-cbb6-468b-a308-987703b107dd'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:38:25.848955 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Bound port: cb59c333-139c-43c4-a05a-a2c61800f72c, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3a34ab19-ea7d-4463-8683-e5acf02733c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'e298ce53-cbb6-468b-a308-987703b107dd'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:38:25.849410 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:25.856517 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12f0e444-b1c4-4f2e-a44b-eddae57bb42b tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event deleted for resources: {'Subnet': ['ID=a894075b-fa9f-4a27-9782-e476e86f74e0,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:25.931273 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-16dc1ca3-6b7c-4718-92a6-cce36f0a78dd req-2dff51be-cc67-4b5b-b3f1-c4c8be48d8e9 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1494570 Dec 09 21:38:25.941184 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-297a0011-6d60-4414-8c86-f264a5e69b2d req-8b0a7ebf-9d5c-4075-b169-078749e77e97 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:25.942931 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-297a0011-6d60-4414-8c86-f264a5e69b2d req-8b0a7ebf-9d5c-4075-b169-078749e77e97 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&device_id=62e2a8f5-9097-4f6a-a915-2c8303b50c10 HTTP/1.1" status: 200 len: 1059 time: 0.1556766 Dec 09 21:38:25.969313 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 597635f0-9f73-4c25-9ef3-19098dd68e58 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:38:26.066290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56340) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:26.090959 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5f5e3b1f-142f-48d2-8bba-ff039638404f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:26.113852 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-297a0011-6d60-4414-8c86-f264a5e69b2d req-4c043d30-2a69-4046-ae99-7157ea15aa53 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:26.115958 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-297a0011-6d60-4414-8c86-f264a5e69b2d req-4c043d30-2a69-4046-ae99-7157ea15aa53 service neutron] 10.222.0.31 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 913 time: 0.1486690 Dec 09 21:38:26.258738 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-297a0011-6d60-4414-8c86-f264a5e69b2d req-d9e883ac-4d4b-49f1-91f5-d84f97560c0f service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=75fe8bb3-adef-484f-9f51-fd3c79998fce HTTP/1.1" status: 200 len: 217 time: 0.1114604 Dec 09 21:38:26.306738 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-5f5e3b1f-142f-48d2-8bba-ff039638404f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Deleting port 597635f0-9f73-4c25-9ef3-19098dd68e58 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:26.307091 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5f5e3b1f-142f-48d2-8bba-ff039638404f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:26.402805 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-297a0011-6d60-4414-8c86-f264a5e69b2d req-f629129d-b957-404f-88d6-0502f4899b0f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:26.406979 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-297a0011-6d60-4414-8c86-f264a5e69b2d req-f629129d-b957-404f-88d6-0502f4899b0f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 200 len: 851 time: 0.1338356 Dec 09 21:38:26.532426 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-5f5e3b1f-142f-48d2-8bba-ff039638404f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] For port 597635f0-9f73-4c25-9ef3-19098dd68e58, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=597635f0-9f73-4c25-9ef3-19098dd68e58,segment=NetworkSegment(8ca86951-e612-4db0-90f4-834b52fd24e0),segment_id=8ca86951-e612-4db0-90f4-834b52fd24e0)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:26.532878 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5f5e3b1f-142f-48d2-8bba-ff039638404f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:26.624043 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-297a0011-6d60-4414-8c86-f264a5e69b2d req-e78a234f-a874-48b6-8981-d941bef99384 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:26.625484 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-297a0011-6d60-4414-8c86-f264a5e69b2d req-e78a234f-a874-48b6-8981-d941bef99384 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1443799 Dec 09 21:38:26.649605 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-5f5e3b1f-142f-48d2-8bba-ff039638404f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Calling delete_port for 597635f0-9f73-4c25-9ef3-19098dd68e58 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:26.741417 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] For port cb59c333-139c-43c4-a05a-a2c61800f72c, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:38:26.749321 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] For port cb59c333-139c-43c4-a05a-a2c61800f72c, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=cb59c333-139c-43c4-a05a-a2c61800f72c,segment=NetworkSegment(3a34ab19-ea7d-4463-8683-e5acf02733c0),segment_id=3a34ab19-ea7d-4463-8683-e5acf02733c0)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:38:26.752881 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-545a66a2-309e-4154-b74e-5a8d3d06534d tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:26.778404 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-55e26d4a-0494-40b5-9e4a-c2dd54d698aa None None] Deleting port 597635f0-9f73-4c25-9ef3-19098dd68e58 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:26.778778 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-55e26d4a-0494-40b5-9e4a-c2dd54d698aa None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:26.780806 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:26.984782 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-297a0011-6d60-4414-8c86-f264a5e69b2d req-69d4294b-079b-4afe-bb8b-812ab64098e9 service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3433261 Dec 09 21:38:27.052501 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-55e26d4a-0494-40b5-9e4a-c2dd54d698aa None None] For port 597635f0-9f73-4c25-9ef3-19098dd68e58, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=597635f0-9f73-4c25-9ef3-19098dd68e58,segment=NetworkSegment(8ca86951-e612-4db0-90f4-834b52fd24e0),segment_id=8ca86951-e612-4db0-90f4-834b52fd24e0)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:27.053383 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-55e26d4a-0494-40b5-9e4a-c2dd54d698aa None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:27.077862 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5f5e3b1f-142f-48d2-8bba-ff039638404f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:27.088930 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-55e26d4a-0494-40b5-9e4a-c2dd54d698aa None None] Calling delete_port for 597635f0-9f73-4c25-9ef3-19098dd68e58 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:27.094887 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f68060a-8630-46ef-9789-1d8e6cf39892 None None] Pushing event updated for resources: {'Port': ['ID=cb59c333-139c-43c4-a05a-a2c61800f72c,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:27.121078 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-545a66a2-309e-4154-b74e-5a8d3d06534d tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:27.146794 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:27.196499 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f5e3b1f-142f-48d2-8bba-ff039638404f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event deleted for resources: {'Port': ['ID=597635f0-9f73-4c25-9ef3-19098dd68e58,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:27.198366 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f5e3b1f-142f-48d2-8bba-ff039638404f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] No DVR routers for this DVR port 597635f0-9f73-4c25-9ef3-19098dd68e58 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:38:27.228223 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49cfab5a-7a05-4c2b-bede-073dcb99bc3f None None] DHCP port deletion for a859e4ba-764a-41c0-982d-5bf79a2797a1 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:38:27.319390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-545a66a2-309e-4154-b74e-5a8d3d06534d tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Network e298ce53-cbb6-468b-a308-987703b107dd is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:38:27.346314 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-545a66a2-309e-4154-b74e-5a8d3d06534d tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Pushing event updated for resources: {'Port': ['ID=d2fbcb49-d4ad-47a2-89ed-b6840cd14037,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:27.369219 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-545a66a2-309e-4154-b74e-5a8d3d06534d tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:38:27.388864 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5f5e3b1f-142f-48d2-8bba-ff039638404f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:27.417971 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-545a66a2-309e-4154-b74e-5a8d3d06534d tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:38:27.448417 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-5f5e3b1f-142f-48d2-8bba-ff039638404f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a133a939-2827-4fe6-81f5-14715631c0ec']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:27.500342 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-55e26d4a-0494-40b5-9e4a-c2dd54d698aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:27.506006 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-5f5e3b1f-142f-48d2-8bba-ff039638404f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8ca86951-e612-4db0-90f4-834b52fd24e0') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:27.506301 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-5f5e3b1f-142f-48d2-8bba-ff039638404f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8ca86951-e612-4db0-90f4-834b52fd24e0') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:27.516253 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:27.519633 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5f5e3b1f-142f-48d2-8bba-ff039638404f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:27.544626 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5f5e3b1f-142f-48d2-8bba-ff039638404f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:27.554754 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5f5e3b1f-142f-48d2-8bba-ff039638404f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Releasing vlan 104 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:38:27.555165 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5f5e3b1f-142f-48d2-8bba-ff039638404f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:38:27.561218 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:38:27.687335 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:27.710337 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55e26d4a-0494-40b5-9e4a-c2dd54d698aa None None] Pushing event deleted for resources: {'Port': ['ID=597635f0-9f73-4c25-9ef3-19098dd68e58,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:27.714813 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5f5e3b1f-142f-48d2-8bba-ff039638404f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:27.726980 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55e26d4a-0494-40b5-9e4a-c2dd54d698aa None None] No DVR routers for this DVR port 597635f0-9f73-4c25-9ef3-19098dd68e58 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:38:27.733860 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-015ee88c-8d15-4e73-858e-38470819b017 req-0815f899-9876-464f-bc8a-17f652263da5 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:27.743089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-015ee88c-8d15-4e73-858e-38470819b017 req-0815f899-9876-464f-bc8a-17f652263da5 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.4219346 Dec 09 21:38:27.746550 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5f5e3b1f-142f-48d2-8bba-ff039638404f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:27.750410 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5f5e3b1f-142f-48d2-8bba-ff039638404f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "DELETE /v2.0/networks/a133a939-2827-4fe6-81f5-14715631c0ec HTTP/1.1" status: 204 len: 168 time: 2.0066597 Dec 09 21:38:27.752908 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f5e3b1f-142f-48d2-8bba-ff039638404f tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event deleted for resources: {'Network': ['ID=a133a939-2827-4fe6-81f5-14715631c0ec,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:27.755703 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56366) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:27.786013 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-545a66a2-309e-4154-b74e-5a8d3d06534d tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:27.786013 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-545a66a2-309e-4154-b74e-5a8d3d06534d tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:27.820022 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-49cfab5a-7a05-4c2b-bede-073dcb99bc3f None None] Deleting port 733d9248-a81b-4611-8784-329c6a7090a3 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:27.820022 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-49cfab5a-7a05-4c2b-bede-073dcb99bc3f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:27.857563 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-545a66a2-309e-4154-b74e-5a8d3d06534d tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 935 time: 3.2497094 Dec 09 21:38:27.868921 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56370) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:27.876652 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-297a0011-6d60-4414-8c86-f264a5e69b2d req-8885d5ae-08c0-4801-bb72-c388d1190c24 service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8796184 Dec 09 21:38:27.895888 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-82c6eaa7-9b4c-477a-87d3-bcbea4d2837b tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Request body: {'port': {'network_id': 'e298ce53-cbb6-468b-a308-987703b107dd', 'name': 'tempest-ExtraDHCPOptionsTestJSON-1952535517', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '123.123.123.123', 'opt_name': 'tftp-server'}, {'opt_value': '123.123.123.45', 'opt_name': 'server-ip-address'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:38:27.903817 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.api.validators [None req-82c6eaa7-9b4c-477a-87d3-bcbea4d2837b tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] bootfile-name is not in valid_values {{(pid=103437) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 09 21:38:27.911665 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.api.validators [None req-82c6eaa7-9b4c-477a-87d3-bcbea4d2837b tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] tftp-server is not in valid_values {{(pid=103437) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 09 21:38:27.911873 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.api.validators [None req-82c6eaa7-9b4c-477a-87d3-bcbea4d2837b tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] server-ip-address is not in valid_values {{(pid=103437) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 09 21:38:27.941044 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-015ee88c-8d15-4e73-858e-38470819b017 req-6530d534-5daa-4968-852c-dacdc6758887 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1791239 Dec 09 21:38:27.990457 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-49cfab5a-7a05-4c2b-bede-073dcb99bc3f None None] For port 733d9248-a81b-4611-8784-329c6a7090a3, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=733d9248-a81b-4611-8784-329c6a7090a3,segment=NetworkSegment(669c24e6-ecea-4894-adc4-51a9b461417f),segment_id=669c24e6-ecea-4894-adc4-51a9b461417f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:27.990980 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-49cfab5a-7a05-4c2b-bede-073dcb99bc3f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:28.025897 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device cb59c333-139c-43c4-a05a-a2c61800f72c up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:38:28.048665 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd0f9365-c1f0-4331-8150-0308d55abad1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:28.074489 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-49cfab5a-7a05-4c2b-bede-073dcb99bc3f None None] Calling delete_port for 733d9248-a81b-4611-8784-329c6a7090a3 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:28.136269 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc10c8f3-c442-46a5-b969-709a5010c7f5 req-edbc2bc8-0c33-4c6f-a598-136c09cda029 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:28.143770 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc10c8f3-c442-46a5-b969-709a5010c7f5 req-edbc2bc8-0c33-4c6f-a598-136c09cda029 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:28.151707 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc10c8f3-c442-46a5-b969-709a5010c7f5 req-edbc2bc8-0c33-4c6f-a598-136c09cda029 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:28.159339 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc10c8f3-c442-46a5-b969-709a5010c7f5 req-edbc2bc8-0c33-4c6f-a598-136c09cda029 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:28.167834 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc10c8f3-c442-46a5-b969-709a5010c7f5 req-edbc2bc8-0c33-4c6f-a598-136c09cda029 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:28.175293 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc10c8f3-c442-46a5-b969-709a5010c7f5 req-edbc2bc8-0c33-4c6f-a598-136c09cda029 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:28.179501 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port cb59c333-139c-43c4-a05a-a2c61800f72c triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:38:28.179880 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:28.185909 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc10c8f3-c442-46a5-b969-709a5010c7f5 req-edbc2bc8-0c33-4c6f-a598-136c09cda029 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:28.189334 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cc10c8f3-c442-46a5-b969-709a5010c7f5 req-edbc2bc8-0c33-4c6f-a598-136c09cda029 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5445 time: 0.1285086 Dec 09 21:38:28.292744 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-49cfab5a-7a05-4c2b-bede-073dcb99bc3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:28.332592 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cc10c8f3-c442-46a5-b969-709a5010c7f5 req-35b39256-26a4-44d0-9fd8-878d9892a7d3 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1345849 Dec 09 21:38:28.333535 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49cfab5a-7a05-4c2b-bede-073dcb99bc3f None None] No DVR routers for this DVR port 733d9248-a81b-4611-8784-329c6a7090a3 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:38:28.334951 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49cfab5a-7a05-4c2b-bede-073dcb99bc3f None None] Pushing event deleted for resources: {'Port': ['ID=733d9248-a81b-4611-8784-329c6a7090a3,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:28.427853 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:28.498276 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port cb59c333-139c-43c4-a05a-a2c61800f72c, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=cb59c333-139c-43c4-a05a-a2c61800f72c,segment=NetworkSegment(3a34ab19-ea7d-4463-8683-e5acf02733c0),segment_id=3a34ab19-ea7d-4463-8683-e5acf02733c0)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:28.506736 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:28.620586 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=cb59c333-139c-43c4-a05a-a2c61800f72c,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:28.666599 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 733d9248-a81b-4611-8784-329c6a7090a3 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:38:28.713646 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 733d9248-a81b-4611-8784-329c6a7090a3 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:38:28.714378 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 733d9248-a81b-4611-8784-329c6a7090a3 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:38:28.776921 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc18942d-40a8-439a-8f6e-5c0ff356e15b req-f67e92c5-5229-4d47-9e64-23438c0c5c68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:28.779129 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc18942d-40a8-439a-8f6e-5c0ff356e15b req-f67e92c5-5229-4d47-9e64-23438c0c5c68 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 1097 time: 0.1318858 Dec 09 21:38:28.803679 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ae557c5-a54b-4ba4-87b2-2572a2e0e15f req-e17e4358-217a-4739-a214-403271a73320 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:28.812092 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ae557c5-a54b-4ba4-87b2-2572a2e0e15f req-e17e4358-217a-4739-a214-403271a73320 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1548610 Dec 09 21:38:28.849120 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d0fbea87-1cff-4ca6-a42e-407619162372 None None] Network e298ce53-cbb6-468b-a308-987703b107dd requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:38:28.901963 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-cf9ba5be-6d5d-44a2-b9e9-b946e11d0a4f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:28.909601 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-cf9ba5be-6d5d-44a2-b9e9-b946e11d0a4f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:28.916527 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-cf9ba5be-6d5d-44a2-b9e9-b946e11d0a4f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:28.928325 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-cf9ba5be-6d5d-44a2-b9e9-b946e11d0a4f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:28.935715 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-cf9ba5be-6d5d-44a2-b9e9-b946e11d0a4f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:28.944323 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-cf9ba5be-6d5d-44a2-b9e9-b946e11d0a4f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:28.952890 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-cf9ba5be-6d5d-44a2-b9e9-b946e11d0a4f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:28.955720 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-cf9ba5be-6d5d-44a2-b9e9-b946e11d0a4f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.10 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5445 time: 0.3456702 Dec 09 21:38:28.962190 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ff8ee9df-a30e-4a59-a947-4be406b199d7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:28.966807 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-92c6c327-088e-4547-ad66-47a006f01241 None None] Provisioning complete for port cb59c333-139c-43c4-a05a-a2c61800f72c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:38:28.969141 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-92c6c327-088e-4547-ad66-47a006f01241 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:28.969600 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ae557c5-a54b-4ba4-87b2-2572a2e0e15f req-350c50fb-8dd0-4308-b535-55e36afa6f90 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1540420 Dec 09 21:38:29.025825 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc18942d-40a8-439a-8f6e-5c0ff356e15b req-771cd4e7-3327-42ef-9991-2dd404adc5e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:29.027335 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc18942d-40a8-439a-8f6e-5c0ff356e15b req-771cd4e7-3327-42ef-9991-2dd404adc5e8 service neutron] 10.222.0.31 "GET /v2.0/networks?id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 200 len: 913 time: 0.2370954 Dec 09 21:38:29.060861 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd0f9365-c1f0-4331-8150-0308d55abad1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:29.138105 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc18942d-40a8-439a-8f6e-5c0ff356e15b req-e6bc685f-bc62-4827-b5f9-adb169164684 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=90f16e74-f2e6-416e-a079-f205615a0d8e HTTP/1.1" status: 200 len: 1000 time: 0.0960097 Dec 09 21:38:29.138803 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-82c6eaa7-9b4c-477a-87d3-bcbea4d2837b tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Made reservation on behalf of 090194789ad44e71986cd1d4018b9671 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:38:29.139636 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82c6eaa7-9b4c-477a-87d3-bcbea4d2837b tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:29.163575 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-cd0f9365-c1f0-4331-8150-0308d55abad1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a859e4ba-764a-41c0-982d-5bf79a2797a1']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:29.171751 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-82e47e58-0a65-41e2-b9f4-d52f42d50f1c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['binding:profile'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:29.173425 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-82e47e58-0a65-41e2-b9f4-d52f42d50f1c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.10 "GET /v2.0/ports/1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f?fields=binding%3Aprofile&fields=network_id HTTP/1.1" status: 200 len: 260 time: 0.2018993 Dec 09 21:38:29.198502 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-cd0f9365-c1f0-4331-8150-0308d55abad1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '669c24e6-ecea-4894-adc4-51a9b461417f') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:29.198502 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-cd0f9365-c1f0-4331-8150-0308d55abad1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '669c24e6-ecea-4894-adc4-51a9b461417f') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:29.227597 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-82c6eaa7-9b4c-477a-87d3-bcbea4d2837b tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] device_id is not set on port c69ad629-9533-4362-bda3-b033eb3152da yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:38:29.250644 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd0f9365-c1f0-4331-8150-0308d55abad1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:29.270660 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc18942d-40a8-439a-8f6e-5c0ff356e15b req-b0e832e5-8c53-4066-a666-8d8e9fa55455 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:29.281779 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc18942d-40a8-439a-8f6e-5c0ff356e15b req-b0e832e5-8c53-4066-a666-8d8e9fa55455 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 200 len: 851 time: 0.1368217 Dec 09 21:38:29.368248 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc18942d-40a8-439a-8f6e-5c0ff356e15b req-cc8deb46-b45b-4a59-b37e-f035a62fe01a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:29.371841 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc18942d-40a8-439a-8f6e-5c0ff356e15b req-cc8deb46-b45b-4a59-b37e-f035a62fe01a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=2c03082f-742a-4ae3-9d23-6178c7ff2a0a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0821621 Dec 09 21:38:29.383019 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd0f9365-c1f0-4331-8150-0308d55abad1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:29.600683 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-82c6eaa7-9b4c-477a-87d3-bcbea4d2837b tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Allocated IP 172.20.0.14 (e298ce53-cbb6-468b-a308-987703b107dd/176a6b00-3ca2-4ff2-af5c-ac34530547b8/c69ad629-9533-4362-bda3-b033eb3152da) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:38:29.674923 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09786140-75c1-43d4-ab60-ba97156b8563 req-765ebb6e-c5e0-4b9a-bd05-e5f2bc78c12e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:29.681569 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09786140-75c1-43d4-ab60-ba97156b8563 req-765ebb6e-c5e0-4b9a-bd05-e5f2bc78c12e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:29.689018 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09786140-75c1-43d4-ab60-ba97156b8563 req-765ebb6e-c5e0-4b9a-bd05-e5f2bc78c12e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:29.694154 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09786140-75c1-43d4-ab60-ba97156b8563 req-765ebb6e-c5e0-4b9a-bd05-e5f2bc78c12e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:29.701607 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09786140-75c1-43d4-ab60-ba97156b8563 req-765ebb6e-c5e0-4b9a-bd05-e5f2bc78c12e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:29.708509 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09786140-75c1-43d4-ab60-ba97156b8563 req-765ebb6e-c5e0-4b9a-bd05-e5f2bc78c12e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:29.714500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09786140-75c1-43d4-ab60-ba97156b8563 req-765ebb6e-c5e0-4b9a-bd05-e5f2bc78c12e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:29.716633 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09786140-75c1-43d4-ab60-ba97156b8563 req-765ebb6e-c5e0-4b9a-bd05-e5f2bc78c12e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 5445 time: 0.1991904 Dec 09 21:38:29.724558 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a8ec9e2b-ce1d-4fc1-a2f3-fa5a25c7aab6 None None] Provisioning complete for port cb59c333-139c-43c4-a05a-a2c61800f72c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:38:29.725113 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a8ec9e2b-ce1d-4fc1-a2f3-fa5a25c7aab6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:29.738042 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc18942d-40a8-439a-8f6e-5c0ff356e15b req-1be794e8-b8f6-40fc-8927-4a1fe6844328 service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3587894 Dec 09 21:38:29.846566 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82c6eaa7-9b4c-477a-87d3-bcbea4d2837b tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:29.858244 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cd0f9365-c1f0-4331-8150-0308d55abad1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Releasing vlan 112 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:38:29.858533 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd0f9365-c1f0-4331-8150-0308d55abad1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:29.877310 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc18942d-40a8-439a-8f6e-5c0ff356e15b req-4460dd33-a3cf-4c58-b124-7a05d5413625 service neutron] 10.222.0.31 "GET /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1299298 Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:38:29.938597 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:38:29.942123 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device cb59c333-139c-43c4-a05a-a2c61800f72c up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:38:29.970862 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09786140-75c1-43d4-ab60-ba97156b8563 req-874867c7-e0fc-4c52-a473-32efdaeddab4 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.2431660 Dec 09 21:38:29.991648 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd0f9365-c1f0-4331-8150-0308d55abad1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:30.010664 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd0f9365-c1f0-4331-8150-0308d55abad1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:30.014553 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cd0f9365-c1f0-4331-8150-0308d55abad1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] 10.222.0.13 "DELETE /v2.0/networks/a859e4ba-764a-41c0-982d-5bf79a2797a1 HTTP/1.1" status: 204 len: 168 time: 2.2579286 Dec 09 21:38:30.018629 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd0f9365-c1f0-4331-8150-0308d55abad1 tempest-TaggedBootDevicesTest-389996249 tempest-TaggedBootDevicesTest-389996249-project] Pushing event deleted for resources: {'Network': ['ID=a859e4ba-764a-41c0-982d-5bf79a2797a1,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:30.028404 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-0301f8d6-577d-4830-a0d1-a5b4328fddf1 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.10 "GET /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c?fields=dns_domain HTTP/1.1" status: 200 len: 212 time: 0.8447804 Dec 09 21:38:30.053181 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-a1722c7e-8dfc-4520-8938-9967ed535193 service neutron] Request body: {'port': {'device_id': '', 'device_owner': '', 'binding:host_id': None, 'binding:profile': {}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:38:30.120599 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-a1722c7e-8dfc-4520-8938-9967ed535193 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:30.149287 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a8ec9e2b-ce1d-4fc1-a2f3-fa5a25c7aab6 None None] Provisioning complete for port d2fbcb49-d4ad-47a2-89ed-b6840cd14037 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:38:30.149977 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a8ec9e2b-ce1d-4fc1-a2f3-fa5a25c7aab6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:30.185203 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10fa674a-6a07-42c8-aa17-93c802930cde req-09f96601-7324-4a21-aafb-828207a8000d tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:30.193071 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a8ec9e2b-ce1d-4fc1-a2f3-fa5a25c7aab6 None None] Port d2fbcb49-d4ad-47a2-89ed-b6840cd14037 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:38:30.201146 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-10fa674a-6a07-42c8-aa17-93c802930cde req-09f96601-7324-4a21-aafb-828207a8000d tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1000991 Dec 09 21:38:30.208352 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port cb59c333-139c-43c4-a05a-a2c61800f72c triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:38:30.210143 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:30.215229 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82c6eaa7-9b4c-477a-87d3-bcbea4d2837b tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:30.273537 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-10fa674a-6a07-42c8-aa17-93c802930cde req-35e9a725-e64e-4bb5-9df0-06bd867d4cee tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0710084 Dec 09 21:38:30.280001 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82c6eaa7-9b4c-477a-87d3-bcbea4d2837b tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Pushing event updated for resources: {'Port': ['ID=c69ad629-9533-4362-bda3-b033eb3152da,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:30.334345 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82c6eaa7-9b4c-477a-87d3-bcbea4d2837b tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Network e298ce53-cbb6-468b-a308-987703b107dd is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:38:30.339535 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-82c6eaa7-9b4c-477a-87d3-bcbea4d2837b tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:38:30.339671 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8d24981a-485d-4d59-9619-0e5775e2be29 None None] Provisioning complete for port d2fbcb49-d4ad-47a2-89ed-b6840cd14037 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:38:30.339950 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8d24981a-485d-4d59-9619-0e5775e2be29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:30.352388 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82c6eaa7-9b4c-477a-87d3-bcbea4d2837b tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:38:30.398351 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-8d24981a-485d-4d59-9619-0e5775e2be29 None None] Port d2fbcb49-d4ad-47a2-89ed-b6840cd14037 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:38:30.478768 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82c6eaa7-9b4c-477a-87d3-bcbea4d2837b tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:30.479517 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82c6eaa7-9b4c-477a-87d3-bcbea4d2837b tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:30.508923 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-82c6eaa7-9b4c-477a-87d3-bcbea4d2837b tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1153 time: 2.6367908 Dec 09 21:38:30.511713 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56402) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:30.518015 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-a1722c7e-8dfc-4520-8938-9967ed535193 service neutron] For port 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:30.553347 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-ff8ee9df-a30e-4a59-a947-4be406b199d7 admin admin] Deleting port dbff506a-7b73-4238-9fda-dd193910d0ce {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:30.553698 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ff8ee9df-a30e-4a59-a947-4be406b199d7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:30.583382 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-a1722c7e-8dfc-4520-8938-9967ed535193 service neutron] For port 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:38:30.670409 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12eb11e1-7fd1-4b0b-b1ab-9f4592554e0a tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:30.671522 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-a1722c7e-8dfc-4520-8938-9967ed535193 service neutron] device_id is not set on port 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:38:30.678294 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12eb11e1-7fd1-4b0b-b1ab-9f4592554e0a tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:30.689942 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12eb11e1-7fd1-4b0b-b1ab-9f4592554e0a tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:30.695044 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-12eb11e1-7fd1-4b0b-b1ab-9f4592554e0a tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 2619 time: 0.1791124 Dec 09 21:38:30.695828 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56406) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:30.702177 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-a1722c7e-8dfc-4520-8938-9967ed535193 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:30.733878 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-748eefc0-2bf1-4b5b-9caa-ed29963d8abf None None] Provisioning complete for port c69ad629-9533-4362-bda3-b033eb3152da triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:38:30.752988 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-748eefc0-2bf1-4b5b-9caa-ed29963d8abf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:30.753748 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-a1722c7e-8dfc-4520-8938-9967ed535193 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:30.806951 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-748eefc0-2bf1-4b5b-9caa-ed29963d8abf None None] Port c69ad629-9533-4362-bda3-b033eb3152da cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:38:30.825556 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-ff8ee9df-a30e-4a59-a947-4be406b199d7 admin admin] For port dbff506a-7b73-4238-9fda-dd193910d0ce, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=dbff506a-7b73-4238-9fda-dd193910d0ce,segment=NetworkSegment(d3bafd14-6a72-4dc5-8e4d-11da22a389ed),segment_id=d3bafd14-6a72-4dc5-8e4d-11da22a389ed)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:30.825916 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ff8ee9df-a30e-4a59-a947-4be406b199d7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:30.880221 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-ff8ee9df-a30e-4a59-a947-4be406b199d7 admin admin] Calling delete_port for dbff506a-7b73-4238-9fda-dd193910d0ce owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:30.907761 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-ba4939f8-262a-4bf9-9447-8e7ac0d2c89c tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Deleting port c69ad629-9533-4362-bda3-b033eb3152da {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:30.908366 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ba4939f8-262a-4bf9-9447-8e7ac0d2c89c tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:31.106433 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-a1722c7e-8dfc-4520-8938-9967ed535193 service neutron] No DVR routers for this DVR port 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:38:31.124911 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ba4939f8-262a-4bf9-9447-8e7ac0d2c89c tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:31.166325 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1722c7e-8dfc-4520-8938-9967ed535193 service neutron] Pushing event updated for resources: {'Port': ['ID=1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f,revision_number=6']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:31.184750 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-ba4939f8-262a-4bf9-9447-8e7ac0d2c89c tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Calling delete_port for c69ad629-9533-4362-bda3-b033eb3152da owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:31.198826 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-a1722c7e-8dfc-4520-8938-9967ed535193 service neutron] In _notify_port_updated(), no bound segment for port 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f on network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c {{(pid=103437) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:38:31.199814 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-a1722c7e-8dfc-4520-8938-9967ed535193 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:31.200537 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-a1722c7e-8dfc-4520-8938-9967ed535193 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:31.202964 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-a1722c7e-8dfc-4520-8938-9967ed535193 service neutron] 10.222.0.10 "PUT /v2.0/ports/1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f HTTP/1.1" status: 200 len: 1033 time: 1.1552587 Dec 09 21:38:31.310934 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-e0f79870-a1df-4ab3-ba98-7c2d5c33464b tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['binding:profile'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:31.325104 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-e0f79870-a1df-4ab3-ba98-7c2d5c33464b tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.10 "GET /v2.0/ports/18d9d7fa-fedf-4844-90ef-6757eb984ae2?fields=binding%3Aprofile&fields=network_id HTTP/1.1" status: 200 len: 260 time: 0.1121802 Dec 09 21:38:31.325283 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f31b030-8d5b-4e26-b3de-efdeedb76b13 req-9b7ba652-7438-4793-8301-4ac94a61e8bd tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:31.332349 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f31b030-8d5b-4e26-b3de-efdeedb76b13 req-9b7ba652-7438-4793-8301-4ac94a61e8bd tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:31.338805 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f31b030-8d5b-4e26-b3de-efdeedb76b13 req-9b7ba652-7438-4793-8301-4ac94a61e8bd tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:31.345165 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f31b030-8d5b-4e26-b3de-efdeedb76b13 req-9b7ba652-7438-4793-8301-4ac94a61e8bd tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:31.346365 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-99b0927f-223d-4ef2-b81f-fa2e136b6b55 None None] Provisioning complete for port 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:38:31.346821 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-99b0927f-223d-4ef2-b81f-fa2e136b6b55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:31.351551 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f31b030-8d5b-4e26-b3de-efdeedb76b13 req-9b7ba652-7438-4793-8301-4ac94a61e8bd tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:31.357885 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f31b030-8d5b-4e26-b3de-efdeedb76b13 req-9b7ba652-7438-4793-8301-4ac94a61e8bd tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:31.359925 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f31b030-8d5b-4e26-b3de-efdeedb76b13 req-9b7ba652-7438-4793-8301-4ac94a61e8bd tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 4665 time: 0.2810032 Dec 09 21:38:31.373613 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-5417e9f9-fb2f-46ec-9d50-d7b8d0d96791 service neutron] Request body: {'port': {'device_id': '', 'device_owner': '', 'binding:host_id': None, 'binding:profile': {}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:38:31.434222 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-99b0927f-223d-4ef2-b81f-fa2e136b6b55 None None] Port 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:38:31.452394 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ff8ee9df-a30e-4a59-a947-4be406b199d7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:31.457253 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-5417e9f9-fb2f-46ec-9d50-d7b8d0d96791 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:31.485226 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f31b030-8d5b-4e26-b3de-efdeedb76b13 req-2cdcaa30-4a97-4fdf-bc22-3c7f96eec222 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&id=ae1d5335-d417-46c6-9564-e81ad355759f&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1140423 Dec 09 21:38:31.534490 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff8ee9df-a30e-4a59-a947-4be406b199d7 admin admin] Pushing event deleted for resources: {'Port': ['ID=dbff506a-7b73-4238-9fda-dd193910d0ce,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:31.642381 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ba4939f8-262a-4bf9-9447-8e7ac0d2c89c tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:31.701202 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba4939f8-262a-4bf9-9447-8e7ac0d2c89c tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Pushing event deleted for resources: {'Port': ['ID=c69ad629-9533-4362-bda3-b033eb3152da,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:31.886784 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ba4939f8-262a-4bf9-9447-8e7ac0d2c89c tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:31.894386 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ba4939f8-262a-4bf9-9447-8e7ac0d2c89c tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] 10.222.0.13 "DELETE /v2.0/ports/c69ad629-9533-4362-bda3-b033eb3152da HTTP/1.1" status: 204 len: 168 time: 1.1943476 Dec 09 21:38:31.898491 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56434) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:31.905170 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-0e6faf23-a82e-484c-ad54-ed7e52dff165 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Request body: {'port': {'name': 'tempest-new-port-name-1138439706', 'extra_dhcp_opts': [{'opt_value': 'pxelinux.0', 'opt_name': 'bootfile-name'}, {'opt_value': '123.123.123.123', 'opt_name': 'tftp-server'}, {'opt_value': '123.123.123.45', 'opt_name': 'server-ip-address'}]}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:38:31.905571 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.api.validators [None req-0e6faf23-a82e-484c-ad54-ed7e52dff165 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] bootfile-name is not in valid_values {{(pid=103438) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 09 21:38:31.906163 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.api.validators [None req-0e6faf23-a82e-484c-ad54-ed7e52dff165 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] tftp-server is not in valid_values {{(pid=103438) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 09 21:38:31.906627 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.api.validators [None req-0e6faf23-a82e-484c-ad54-ed7e52dff165 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] server-ip-address is not in valid_values {{(pid=103438) validate_values /usr/local/lib/python3.8/dist-packages/neutron_lib/api/validators/__init__.py:164}} Dec 09 21:38:31.951063 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6196600-440a-4b1c-b9c3-d38b2d5191aa req-03f2d6ad-126d-40c4-9eea-8a24f6603142 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:31.964316 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d6196600-440a-4b1c-b9c3-d38b2d5191aa req-03f2d6ad-126d-40c4-9eea-8a24f6603142 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.3039811 Dec 09 21:38:32.072116 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-5417e9f9-fb2f-46ec-9d50-d7b8d0d96791 service neutron] For port 18d9d7fa-fedf-4844-90ef-6757eb984ae2, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=18d9d7fa-fedf-4844-90ef-6757eb984ae2,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:32.081567 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e6faf23-a82e-484c-ad54-ed7e52dff165 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:32.111599 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ff8ee9df-a30e-4a59-a947-4be406b199d7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:32.162520 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d6196600-440a-4b1c-b9c3-d38b2d5191aa req-e10ce9ab-a222-47ba-8955-5184c83cfa82 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1921935 Dec 09 21:38:32.203026 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 2c568c8f-47ca-4f47-ab71-187026ca02db no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:38:32.227535 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-5417e9f9-fb2f-46ec-9d50-d7b8d0d96791 service neutron] For port 18d9d7fa-fedf-4844-90ef-6757eb984ae2, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:38:32.375979 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e6faf23-a82e-484c-ad54-ed7e52dff165 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:32.395827 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:32.416559 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e6faf23-a82e-484c-ad54-ed7e52dff165 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:32.439364 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-5417e9f9-fb2f-46ec-9d50-d7b8d0d96791 service neutron] device_id is not set on port 18d9d7fa-fedf-4844-90ef-6757eb984ae2 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:38:32.444492 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2c568c8f-47ca-4f47-ab71-187026ca02db'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:38:32.447029 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b633d658-ce6d-4822-9525-0cc58918fd47" -d '{"events": [{"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-unplugged", "status": "completed", "tag": "2c568c8f-47ca-4f47-ab71-187026ca02db"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:38:32.468847 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-5417e9f9-fb2f-46ec-9d50-d7b8d0d96791 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:32.476435 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 2c568c8f-47ca-4f47-ab71-187026ca02db, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=2c568c8f-47ca-4f47-ab71-187026ca02db,segment=NetworkSegment(a40eb34b-04cf-427f-a562-8a47c01a297b),segment_id=a40eb34b-04cf-427f-a562-8a47c01a297b)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:32.488988 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:32.490036 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device f6c2c656-c5c9-4a38-baf6-3924df82937d no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:38:32.500811 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-5417e9f9-fb2f-46ec-9d50-d7b8d0d96791 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:32.572257 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e6faf23-a82e-484c-ad54-ed7e52dff165 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Pushing event updated for resources: {'Port': ['ID=d2fbcb49-d4ad-47a2-89ed-b6840cd14037,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:32.693334 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=2c568c8f-47ca-4f47-ab71-187026ca02db,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:32.711757 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-5417e9f9-fb2f-46ec-9d50-d7b8d0d96791 service neutron] No DVR routers for this DVR port 18d9d7fa-fedf-4844-90ef-6757eb984ae2 on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:38:32.725604 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8ce9c73-65c6-4f58-87c8-b19a47cb55b4 req-d7d5291f-bca4-441f-8dc2-62a89a8cf1a8 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:32.736081 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8ce9c73-65c6-4f58-87c8-b19a47cb55b4 req-d7d5291f-bca4-441f-8dc2-62a89a8cf1a8 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.3573873 Dec 09 21:38:32.797158 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:32.801566 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-0e6faf23-a82e-484c-ad54-ed7e52dff165 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] In _notify_port_updated(), no bound segment for port d2fbcb49-d4ad-47a2-89ed-b6840cd14037 on network e298ce53-cbb6-468b-a308-987703b107dd {{(pid=103438) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:38:32.825550 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0e6faf23-a82e-484c-ad54-ed7e52dff165 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:32.826262 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e6faf23-a82e-484c-ad54-ed7e52dff165 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:32.838761 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0e6faf23-a82e-484c-ad54-ed7e52dff165 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] 10.222.0.13 "PUT /v2.0/ports/d2fbcb49-d4ad-47a2-89ed-b6840cd14037 HTTP/1.1" status: 200 len: 1136 time: 0.9380498 Dec 09 21:38:32.839504 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56448) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:32.867428 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-5417e9f9-fb2f-46ec-9d50-d7b8d0d96791 service neutron] In _notify_port_updated(), no bound segment for port 18d9d7fa-fedf-4844-90ef-6757eb984ae2 on network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c {{(pid=103437) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:38:32.867689 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port f6c2c656-c5c9-4a38-baf6-3924df82937d, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=f6c2c656-c5c9-4a38-baf6-3924df82937d,segment=NetworkSegment(a40eb34b-04cf-427f-a562-8a47c01a297b),segment_id=a40eb34b-04cf-427f-a562-8a47c01a297b)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:32.870391 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-5417e9f9-fb2f-46ec-9d50-d7b8d0d96791 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:32.872256 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-5417e9f9-fb2f-46ec-9d50-d7b8d0d96791 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:32.876221 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-5417e9f9-fb2f-46ec-9d50-d7b8d0d96791 service neutron] 10.222.0.10 "PUT /v2.0/ports/18d9d7fa-fedf-4844-90ef-6757eb984ae2 HTTP/1.1" status: 200 len: 1032 time: 1.5060322 Dec 09 21:38:32.877870 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:32.878722 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:38:32.889410 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5417e9f9-fb2f-46ec-9d50-d7b8d0d96791 service neutron] Pushing event updated for resources: {'Port': ['ID=18d9d7fa-fedf-4844-90ef-6757eb984ae2,revision_number=6']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:33.026136 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-782e6895-01ad-4f0a-8db2-01e0fb523fab tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:33.033239 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-782e6895-01ad-4f0a-8db2-01e0fb523fab tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] 10.222.0.13 "GET /v2.0/ports/d2fbcb49-d4ad-47a2-89ed-b6840cd14037 HTTP/1.1" status: 200 len: 1136 time: 0.1925642 Dec 09 21:38:33.039540 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-97336e07-7d45-423a-b233-59262e53dd32 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:33.049202 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=f6c2c656-c5c9-4a38-baf6-3924df82937d,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:33.052659 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:38:33.053332 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 57519c10-1d02-4ce7-b4be-b37a7bd58b09 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:38:33.056843 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56450) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:33.057442 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8ce9c73-65c6-4f58-87c8-b19a47cb55b4 req-09979c02-660c-47bb-bdc8-50c5fdfd8c36 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3166971 Dec 09 21:38:33.180199 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3ec5add5-c81b-4b9e-818e-505fc4de7c7e None None] Provisioning complete for port 18d9d7fa-fedf-4844-90ef-6757eb984ae2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:38:33.180703 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3ec5add5-c81b-4b9e-818e-505fc4de7c7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:33.231394 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-3ec5add5-c81b-4b9e-818e-505fc4de7c7e None None] Port 18d9d7fa-fedf-4844-90ef-6757eb984ae2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:38:33.254458 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3ec5add5-c81b-4b9e-818e-505fc4de7c7e None None] Provisioning complete for port d2fbcb49-d4ad-47a2-89ed-b6840cd14037 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:38:33.254458 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3ec5add5-c81b-4b9e-818e-505fc4de7c7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:33.257648 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:33.322605 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 57519c10-1d02-4ce7-b4be-b37a7bd58b09, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=57519c10-1d02-4ce7-b4be-b37a7bd58b09,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:33.328205 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:38:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a9b2849c-1c36-4217-be5e-b9f13de4a34f x-openstack-request-id: req-a9b2849c-1c36-4217-be5e-b9f13de4a34f {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:38:33.329718 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-unplugged", "status": "completed", "tag": "2c568c8f-47ca-4f47-ab71-187026ca02db", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:38:33.330120 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a9b2849c-1c36-4217-be5e-b9f13de4a34f {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:38:33.331874 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2c568c8f-47ca-4f47-ab71-187026ca02db', 'code': 200} Dec 09 21:38:33.438760 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:33.440322 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 38f97951-e872-4c24-947f-934429895ad3 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:38:33.593610 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-3ec5add5-c81b-4b9e-818e-505fc4de7c7e None None] Port d2fbcb49-d4ad-47a2-89ed-b6840cd14037 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:38:33.601191 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=57519c10-1d02-4ce7-b4be-b37a7bd58b09,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:33.610991 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-950c6f2f-96d7-40fe-98a7-49374e515b37 req-f30a8b8f-b5fd-4e67-a831-05aaf27e756b tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:33.624295 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-950c6f2f-96d7-40fe-98a7-49374e515b37 req-f30a8b8f-b5fd-4e67-a831-05aaf27e756b tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:33.631992 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-950c6f2f-96d7-40fe-98a7-49374e515b37 req-f30a8b8f-b5fd-4e67-a831-05aaf27e756b tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:33.639913 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-950c6f2f-96d7-40fe-98a7-49374e515b37 req-f30a8b8f-b5fd-4e67-a831-05aaf27e756b tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:33.655767 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:33.656329 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-950c6f2f-96d7-40fe-98a7-49374e515b37 req-f30a8b8f-b5fd-4e67-a831-05aaf27e756b tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:33.658419 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-950c6f2f-96d7-40fe-98a7-49374e515b37 req-f30a8b8f-b5fd-4e67-a831-05aaf27e756b tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 3880 time: 0.2134476 Dec 09 21:38:33.727333 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ff8ee9df-a30e-4a59-a947-4be406b199d7 admin admin] Router a0406620-d595-409c-958d-7a486a49577c has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:38:33.744705 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 38f97951-e872-4c24-947f-934429895ad3, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=38f97951-e872-4c24-947f-934429895ad3,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:33.752154 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:33.752941 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 18d9d7fa-fedf-4844-90ef-6757eb984ae2 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:38:33.795695 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-950c6f2f-96d7-40fe-98a7-49374e515b37 req-f5df4c2f-46bb-4201-86c0-b53ee55a217c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1125557 Dec 09 21:38:33.805263 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-a8b516e3-5575-4f1f-b814-cd1b0f55ebd9 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Deleting port 57519c10-1d02-4ce7-b4be-b37a7bd58b09 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:33.805731 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-a8b516e3-5575-4f1f-b814-cd1b0f55ebd9 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:33.888681 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-7a26664b-bf3d-4507-ab99-aeda07044cf0 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Deleting port d2fbcb49-d4ad-47a2-89ed-b6840cd14037 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:33.889130 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a26664b-bf3d-4507-ab99-aeda07044cf0 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:33.908918 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 18d9d7fa-fedf-4844-90ef-6757eb984ae2 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:38:33.915145 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:38:34.087667 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-a8b516e3-5575-4f1f-b814-cd1b0f55ebd9 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] For port 57519c10-1d02-4ce7-b4be-b37a7bd58b09, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=57519c10-1d02-4ce7-b4be-b37a7bd58b09,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:34.088412 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-a8b516e3-5575-4f1f-b814-cd1b0f55ebd9 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:34.115078 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-a8b516e3-5575-4f1f-b814-cd1b0f55ebd9 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Calling delete_port for 57519c10-1d02-4ce7-b4be-b37a7bd58b09 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:34.129758 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a26664b-bf3d-4507-ab99-aeda07044cf0 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:34.136309 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ff8ee9df-a30e-4a59-a947-4be406b199d7 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:38:34.150001 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39ff3c9b-81e5-4a50-8b79-fded20c80b07 None None] Sync routers for ids ['a0406620-d595-409c-958d-7a486a49577c'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:38:34.153358 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ff8ee9df-a30e-4a59-a947-4be406b199d7 admin admin] 10.222.0.13 "PUT /v2.0/routers/a0406620-d595-409c-958d-7a486a49577c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 8.0848675 Dec 09 21:38:34.154976 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56478) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:34.161829 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-7a26664b-bf3d-4507-ab99-aeda07044cf0 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Calling delete_port for d2fbcb49-d4ad-47a2-89ed-b6840cd14037 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:34.173752 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39ff3c9b-81e5-4a50-8b79-fded20c80b07 None None] Routers {'a0406620-d595-409c-958d-7a486a49577c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:38:34.186948 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-39ff3c9b-81e5-4a50-8b79-fded20c80b07 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:38:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a0406620-d595-409c-958d-7a486a49577c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:34.319890 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d71a9299-9bbc-43bb-b780-addf8f00b793 admin admin] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:34.453605 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d71a9299-9bbc-43bb-b780-addf8f00b793 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:34.492674 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-a8b516e3-5575-4f1f-b814-cd1b0f55ebd9 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:34.513514 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-39ff3c9b-81e5-4a50-8b79-fded20c80b07 None None] Set router a0406620-d595-409c-958d-7a486a49577c gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:38:34.532768 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-d71a9299-9bbc-43bb-b780-addf8f00b793 admin admin] Deleting port 6cf4ffbd-1ca6-4dd1-a033-c481be40b106 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:34.533628 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d71a9299-9bbc-43bb-b780-addf8f00b793 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:34.579983 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8b516e3-5575-4f1f-b814-cd1b0f55ebd9 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event deleted for resources: {'Port': ['ID=57519c10-1d02-4ce7-b4be-b37a7bd58b09,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:34.684650 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=38f97951-e872-4c24-947f-934429895ad3,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:34.773322 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-a8b516e3-5575-4f1f-b814-cd1b0f55ebd9 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] No DVR routers for this DVR port 57519c10-1d02-4ce7-b4be-b37a7bd58b09 on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:38:34.822065 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-a8b516e3-5575-4f1f-b814-cd1b0f55ebd9 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:34.825951 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-a8b516e3-5575-4f1f-b814-cd1b0f55ebd9 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.10 "DELETE /v2.0/ports/57519c10-1d02-4ce7-b4be-b37a7bd58b09 HTTP/1.1" status: 204 len: 173 time: 1.9262426 Dec 09 21:38:34.826708 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-deleted', 'tag': '57519c10-1d02-4ce7-b4be-b37a7bd58b09'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:38:34.829219 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-243e446b-c13e-41ce-befa-a23d179eeb65" -d '{"events": [{"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-deleted", "tag": "57519c10-1d02-4ce7-b4be-b37a7bd58b09"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:38:34.847739 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-39ff3c9b-81e5-4a50-8b79-fded20c80b07 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0406620-d595-409c-958d-7a486a49577c', 'name': 'tempest-AttachVolumeTestJSON-1079676770-router', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210'}], 'enable_snat': True}, 'gw_port_id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:32Z', 'updated_at': '2021-12-09T21:38:31Z', 'revision_number': 5, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'gw_port': {'id': '6cf4ffbd-1ca6-4dd1-a033-c481be40b106', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:0e:fb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a0406620-d595-409c-958d-7a486a49577c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1399, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.210', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:30:33Z', 'updated_at': '2021-12-09T21:30:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:34.878749 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:34.904835 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39ff3c9b-81e5-4a50-8b79-fded20c80b07 None None] Checking router: a0406620-d595-409c-958d-7a486a49577c for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:38:34.911755 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-d71a9299-9bbc-43bb-b780-addf8f00b793 admin admin] For port 6cf4ffbd-1ca6-4dd1-a033-c481be40b106, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6cf4ffbd-1ca6-4dd1-a033-c481be40b106,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:34.912224 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d71a9299-9bbc-43bb-b780-addf8f00b793 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:34.917884 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39ff3c9b-81e5-4a50-8b79-fded20c80b07 None None] Routers {'a0406620-d595-409c-958d-7a486a49577c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:38:34.918941 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-39ff3c9b-81e5-4a50-8b79-fded20c80b07 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:38:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a0406620-d595-409c-958d-7a486a49577c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:34.941727 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-d71a9299-9bbc-43bb-b780-addf8f00b793 admin admin] Calling delete_port for 6cf4ffbd-1ca6-4dd1-a033-c481be40b106 owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:34.952914 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a,segment=NetworkSegment(7cf32f95-b9ab-465b-889c-7d7de3246a6f),segment_id=7cf32f95-b9ab-465b-889c-7d7de3246a6f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:34.966854 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:35.063301 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a26664b-bf3d-4507-ab99-aeda07044cf0 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:35.132856 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a26664b-bf3d-4507-ab99-aeda07044cf0 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Pushing event deleted for resources: {'Port': ['ID=d2fbcb49-d4ad-47a2-89ed-b6840cd14037,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:35.156576 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:35.169723 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-39ff3c9b-81e5-4a50-8b79-fded20c80b07 None None] Set router a0406620-d595-409c-958d-7a486a49577c gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:38:35.288046 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a26664b-bf3d-4507-ab99-aeda07044cf0 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:35.300983 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7a26664b-bf3d-4507-ab99-aeda07044cf0 tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] 10.222.0.13 "DELETE /v2.0/ports/d2fbcb49-d4ad-47a2-89ed-b6840cd14037 HTTP/1.1" status: 204 len: 168 time: 2.2408123 Dec 09 21:38:35.304024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56532) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:35.310177 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-39ff3c9b-81e5-4a50-8b79-fded20c80b07 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a0406620-d595-409c-958d-7a486a49577c', 'name': 'tempest-AttachVolumeTestJSON-1079676770-router', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:32Z', 'updated_at': '2021-12-09T21:38:34Z', 'revision_number': 6, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:35.333028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'f6c2c656-c5c9-4a38-baf6-3924df82937d'}, {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '57519c10-1d02-4ce7-b4be-b37a7bd58b09'}, {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '38f97951-e872-4c24-947f-934429895ad3'}, {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:38:35.335696 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ebeb4e62-f6ef-4c7c-a2f7-04c4ddba7d89" -d '{"events": [{"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-unplugged", "status": "completed", "tag": "f6c2c656-c5c9-4a38-baf6-3924df82937d"}, {"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-unplugged", "status": "completed", "tag": "57519c10-1d02-4ce7-b4be-b37a7bd58b09"}, {"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-unplugged", "status": "completed", "tag": "38f97951-e872-4c24-947f-934429895ad3"}, {"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-unplugged", "status": "completed", "tag": "7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:38:35.365709 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-39ff3c9b-81e5-4a50-8b79-fded20c80b07 None None] The sync data for ids ['a0406620-d595-409c-958d-7a486a49577c'] in n-d-713301-27 is: [{'id': 'a0406620-d595-409c-958d-7a486a49577c', 'name': 'tempest-AttachVolumeTestJSON-1079676770-router', 'tenant_id': 'aacb3291db4d4252a9225e8fe617f667', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:30:32Z', 'updated_at': '2021-12-09T21:38:34Z', 'revision_number': 6, 'project_id': 'aacb3291db4d4252a9225e8fe617f667', 'gw_port_host': None}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:38:35.487202 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-86f457bf-ee2c-43c2-8184-936c600d263c tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Deleting subnet 176a6b00-3ca2-4ff2-af5c-ac34530547b8 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:38:35.495924 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86f457bf-ee2c-43c2-8184-936c600d263c tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:35.505468 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d71a9299-9bbc-43bb-b780-addf8f00b793 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:35.552459 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1880acc6-a758-4475-980f-b7fd249d5322 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:35.567327 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-75694369-601b-4040-93f7-28103f9c729a None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:38:35.588927 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d71a9299-9bbc-43bb-b780-addf8f00b793 admin admin] Pushing event deleted for resources: {'Port': ['ID=6cf4ffbd-1ca6-4dd1-a033-c481be40b106,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:35.592536 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86f457bf-ee2c-43c2-8184-936c600d263c tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:35.687694 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ce9c700-f476-4a5a-91fe-99a58a052753 req-cf8a9ac8-df34-4135-8f2b-2697961be4ab tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:35.689541 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ce9c700-f476-4a5a-91fe-99a58a052753 req-cf8a9ac8-df34-4135-8f2b-2697961be4ab tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=cbee2951-c573-41f4-8f85-c7c77ec3d8d6 HTTP/1.1" status: 200 len: 944 time: 0.2427051 Dec 09 21:38:35.810324 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-d0d6e9c6-f5b7-47b9-9e91-681303047809 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Deleting port 38f97951-e872-4c24-947f-934429895ad3 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:35.810853 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-d0d6e9c6-f5b7-47b9-9e91-681303047809 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:35.879474 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86f457bf-ee2c-43c2-8184-936c600d263c tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:35.894985 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d71a9299-9bbc-43bb-b780-addf8f00b793 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:36.057657 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d71a9299-9bbc-43bb-b780-addf8f00b793 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:36.060209 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d71a9299-9bbc-43bb-b780-addf8f00b793 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:36.100548 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-d0d6e9c6-f5b7-47b9-9e91-681303047809 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] For port 38f97951-e872-4c24-947f-934429895ad3, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=38f97951-e872-4c24-947f-934429895ad3,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:36.101190 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-d0d6e9c6-f5b7-47b9-9e91-681303047809 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:36.121728 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-d0d6e9c6-f5b7-47b9-9e91-681303047809 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Calling delete_port for 38f97951-e872-4c24-947f-934429895ad3 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:36.124185 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86f457bf-ee2c-43c2-8184-936c600d263c tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:36.138090 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d71a9299-9bbc-43bb-b780-addf8f00b793 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:36.138639 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d71a9299-9bbc-43bb-b780-addf8f00b793 admin admin] Fanout notify agent at l3_agent the message router_deleted on router a0406620-d595-409c-958d-7a486a49577c {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:38:36.143131 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-6ce9c700-f476-4a5a-91fe-99a58a052753 req-654f0782-8f1a-4be4-b5cb-d8d981c68bd6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Deleting port 028345f8-c21b-4afa-a015-34707fd8ba09 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:36.143131 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6ce9c700-f476-4a5a-91fe-99a58a052753 req-654f0782-8f1a-4be4-b5cb-d8d981c68bd6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:36.178037 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86f457bf-ee2c-43c2-8184-936c600d263c tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Pushing event deleted for resources: {'Subnet': ['ID=176a6b00-3ca2-4ff2-af5c-ac34530547b8,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:36.186616 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d71a9299-9bbc-43bb-b780-addf8f00b793 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:36.190219 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d71a9299-9bbc-43bb-b780-addf8f00b793 admin admin] 10.222.0.13 "DELETE /v2.0/routers/a0406620-d595-409c-958d-7a486a49577c HTTP/1.1" status: 204 len: 168 time: 2.0302253 Dec 09 21:38:36.194316 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d65e5ee4-3f73-4c26-9ed9-16d039deda78 None None] Network e298ce53-cbb6-468b-a308-987703b107dd requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:38:36.230349 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86f457bf-ee2c-43c2-8184-936c600d263c tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:36.233853 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-86f457bf-ee2c-43c2-8184-936c600d263c tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] 10.222.0.13 "DELETE /v2.0/subnets/176a6b00-3ca2-4ff2-af5c-ac34530547b8 HTTP/1.1" status: 204 len: 168 time: 0.9278898 Dec 09 21:38:36.237661 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56542) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:36.237661 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56544) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:36.278209 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-6ce9c700-f476-4a5a-91fe-99a58a052753 req-654f0782-8f1a-4be4-b5cb-d8d981c68bd6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] For port 028345f8-c21b-4afa-a015-34707fd8ba09, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=028345f8-c21b-4afa-a015-34707fd8ba09,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:36.278594 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6ce9c700-f476-4a5a-91fe-99a58a052753 req-654f0782-8f1a-4be4-b5cb-d8d981c68bd6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:36.294143 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-6ce9c700-f476-4a5a-91fe-99a58a052753 req-654f0782-8f1a-4be4-b5cb-d8d981c68bd6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Calling delete_port for 028345f8-c21b-4afa-a015-34707fd8ba09 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:36.298600 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device dbff506a-7b73-4238-9fda-dd193910d0ce no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:38:36.351040 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: dbff506a-7b73-4238-9fda-dd193910d0ce {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:38:36.351379 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device dbff506a-7b73-4238-9fda-dd193910d0ce not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:38:36.386344 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04882c1e-b3de-4ad6-af13-d54d250e321e tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:36.510158 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-4eafb2ac-c67a-44ac-9b1d-2c7c277ec3a2 admin admin] Deleting subnet 10ff3f47-d1f4-47a0-808e-f885899dfb29 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:38:36.514184 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4eafb2ac-c67a-44ac-9b1d-2c7c277ec3a2 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:36.516224 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6ce9c700-f476-4a5a-91fe-99a58a052753 req-654f0782-8f1a-4be4-b5cb-d8d981c68bd6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:36.530378 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['d5571683-a9bc-4155-85b9-b1ef208e21e9'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:38:36.532804 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['ae3b2bf8-8e63-4473-8cc8-206c769cc38a'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:38:36.558016 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4eafb2ac-c67a-44ac-9b1d-2c7c277ec3a2 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:36.576466 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-654f0782-8f1a-4be4-b5cb-d8d981c68bd6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Pushing event deleted for resources: {'Port': ['ID=028345f8-c21b-4afa-a015-34707fd8ba09,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:36.673411 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-6ce9c700-f476-4a5a-91fe-99a58a052753 req-654f0782-8f1a-4be4-b5cb-d8d981c68bd6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] No DVR routers for this DVR port 028345f8-c21b-4afa-a015-34707fd8ba09 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:38:36.681085 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6ce9c700-f476-4a5a-91fe-99a58a052753 req-654f0782-8f1a-4be4-b5cb-d8d981c68bd6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:36.692775 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ce9c700-f476-4a5a-91fe-99a58a052753 req-654f0782-8f1a-4be4-b5cb-d8d981c68bd6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "DELETE /v2.0/ports/028345f8-c21b-4afa-a015-34707fd8ba09 HTTP/1.1" status: 204 len: 173 time: 0.9951532 Dec 09 21:38:36.693289 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cbee2951-c573-41f4-8f85-c7c77ec3d8d6', 'name': 'network-vif-deleted', 'tag': '028345f8-c21b-4afa-a015-34707fd8ba09'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:38:36.695679 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a4085421-3626-4994-b723-35f8a80b3401" -d '{"events": [{"server_uuid": "cbee2951-c573-41f4-8f85-c7c77ec3d8d6", "name": "network-vif-deleted", "tag": "028345f8-c21b-4afa-a015-34707fd8ba09"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:38:36.712762 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4eafb2ac-c67a-44ac-9b1d-2c7c277ec3a2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:36.758642 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0fbab4e2-5ea6-4b74-aedd-be57e32b02ae None None] DHCP port deletion for e298ce53-cbb6-468b-a308-987703b107dd request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:38:36.895684 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4eafb2ac-c67a-44ac-9b1d-2c7c277ec3a2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:36.913480 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:36.938551 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eafb2ac-c67a-44ac-9b1d-2c7c277ec3a2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=10ff3f47-d1f4-47a0-808e-f885899dfb29,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:36.942180 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4eafb2ac-c67a-44ac-9b1d-2c7c277ec3a2 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:36.949432 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56556) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:36.962199 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4eafb2ac-c67a-44ac-9b1d-2c7c277ec3a2 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/10ff3f47-d1f4-47a0-808e-f885899dfb29 HTTP/1.1" status: 204 len: 168 time: 0.7239947 Dec 09 21:38:36.983127 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e1908923-6f7f-4cc4-9dc4-305e99ea4645 None None] Network 935b09ce-7410-4b66-82be-99978deb6717 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:38:37.050171 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-04882c1e-b3de-4ad6-af13-d54d250e321e tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Deleting port cb59c333-139c-43c4-a05a-a2c61800f72c {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:37.055091 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04882c1e-b3de-4ad6-af13-d54d250e321e tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:37.128188 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3dcefda2-59e3-4361-883e-148c072d9189 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:37.276181 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-d0d6e9c6-f5b7-47b9-9e91-681303047809 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:37.319540 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-3dcefda2-59e3-4361-883e-148c072d9189 admin admin] Deleting port b8354390-a3b8-468e-b70c-d491e3ea4213 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:37.320441 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3dcefda2-59e3-4361-883e-148c072d9189 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:37.381679 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-0fbab4e2-5ea6-4b74-aedd-be57e32b02ae None None] Deleting port cb59c333-139c-43c4-a05a-a2c61800f72c {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:37.382228 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0fbab4e2-5ea6-4b74-aedd-be57e32b02ae None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:37.426178 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0d6e9c6-f5b7-47b9-9e91-681303047809 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event deleted for resources: {'Port': ['ID=38f97951-e872-4c24-947f-934429895ad3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:37.513590 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-3dcefda2-59e3-4361-883e-148c072d9189 admin admin] For port b8354390-a3b8-468e-b70c-d491e3ea4213, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b8354390-a3b8-468e-b70c-d491e3ea4213,segment=NetworkSegment(d3bafd14-6a72-4dc5-8e4d-11da22a389ed),segment_id=d3bafd14-6a72-4dc5-8e4d-11da22a389ed)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:37.516050 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3dcefda2-59e3-4361-883e-148c072d9189 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:37.534513 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-3dcefda2-59e3-4361-883e-148c072d9189 admin admin] Calling delete_port for b8354390-a3b8-468e-b70c-d491e3ea4213 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:37.540003 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-d0d6e9c6-f5b7-47b9-9e91-681303047809 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] No DVR routers for this DVR port 38f97951-e872-4c24-947f-934429895ad3 on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:38:37.544501 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-d0d6e9c6-f5b7-47b9-9e91-681303047809 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:37.547883 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-d0d6e9c6-f5b7-47b9-9e91-681303047809 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.10 "DELETE /v2.0/ports/38f97951-e872-4c24-947f-934429895ad3 HTTP/1.1" status: 204 len: 173 time: 2.7157362 Dec 09 21:38:37.558834 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-04882c1e-b3de-4ad6-af13-d54d250e321e tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] For port cb59c333-139c-43c4-a05a-a2c61800f72c, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=cb59c333-139c-43c4-a05a-a2c61800f72c,segment=NetworkSegment(3a34ab19-ea7d-4463-8683-e5acf02733c0),segment_id=3a34ab19-ea7d-4463-8683-e5acf02733c0)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:37.559214 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04882c1e-b3de-4ad6-af13-d54d250e321e tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:37.626568 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-04882c1e-b3de-4ad6-af13-d54d250e321e tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Calling delete_port for cb59c333-139c-43c4-a05a-a2c61800f72c owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:37.708487 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-94d79468-199b-4a04-8607-a13bdc4fbcdd None None] DHCP port deletion for 935b09ce-7410-4b66-82be-99978deb6717 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:38:37.779344 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0fbab4e2-5ea6-4b74-aedd-be57e32b02ae None None] For port cb59c333-139c-43c4-a05a-a2c61800f72c, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=cb59c333-139c-43c4-a05a-a2c61800f72c,segment=NetworkSegment(3a34ab19-ea7d-4463-8683-e5acf02733c0),segment_id=3a34ab19-ea7d-4463-8683-e5acf02733c0)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:37.779841 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0fbab4e2-5ea6-4b74-aedd-be57e32b02ae None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:37.916997 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97fb2c89-3f1b-42a0-bd48-b72856067a66 req-061e07e7-0fab-4e01-a261-a217bab7e02e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:37.942353 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97fb2c89-3f1b-42a0-bd48-b72856067a66 req-061e07e7-0fab-4e01-a261-a217bab7e02e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:37.946455 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97fb2c89-3f1b-42a0-bd48-b72856067a66 req-061e07e7-0fab-4e01-a261-a217bab7e02e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:37.977685 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-97fb2c89-3f1b-42a0-bd48-b72856067a66 req-061e07e7-0fab-4e01-a261-a217bab7e02e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 2411 time: 0.3005586 Dec 09 21:38:38.106900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-e1f29e55-dca6-4a45-8dfe-24b38df8e8be tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Deleting port f6c2c656-c5c9-4a38-baf6-3924df82937d {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:38.111936 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-e1f29e55-dca6-4a45-8dfe-24b38df8e8be tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:38.135078 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-0fbab4e2-5ea6-4b74-aedd-be57e32b02ae None None] Calling delete_port for cb59c333-139c-43c4-a05a-a2c61800f72c owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:38.183202 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3dcefda2-59e3-4361-883e-148c072d9189 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:38.283192 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dcefda2-59e3-4361-883e-148c072d9189 admin admin] Pushing event deleted for resources: {'Port': ['ID=b8354390-a3b8-468e-b70c-d491e3ea4213,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:38.292731 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04882c1e-b3de-4ad6-af13-d54d250e321e tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:38.316195 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-97fb2c89-3f1b-42a0-bd48-b72856067a66 req-814125e9-189d-41af-bb4a-8373d0b214eb tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3371675 Dec 09 21:38:38.322724 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3dcefda2-59e3-4361-883e-148c072d9189 admin admin] No DVR routers for this DVR port b8354390-a3b8-468e-b70c-d491e3ea4213 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:38:38.354201 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6cf4ffbd-1ca6-4dd1-a033-c481be40b106 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:38:38.370169 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04882c1e-b3de-4ad6-af13-d54d250e321e tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Pushing event deleted for resources: {'Port': ['ID=cb59c333-139c-43c4-a05a-a2c61800f72c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:38.372734 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0fbab4e2-5ea6-4b74-aedd-be57e32b02ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:38.382277 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04882c1e-b3de-4ad6-af13-d54d250e321e tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] No DVR routers for this DVR port cb59c333-139c-43c4-a05a-a2c61800f72c on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:38:38.476609 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:38:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e378e785-f683-461b-a2e9-abb50cb370ac x-openstack-request-id: req-e378e785-f683-461b-a2e9-abb50cb370ac {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:38:38.476937 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-deleted", "tag": "57519c10-1d02-4ce7-b4be-b37a7bd58b09", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:38:38.477196 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e378e785-f683-461b-a2e9-abb50cb370ac {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:38:38.477603 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-deleted', 'tag': '57519c10-1d02-4ce7-b4be-b37a7bd58b09', 'status': 'completed', 'code': 200} Dec 09 21:38:38.500420 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3dcefda2-59e3-4361-883e-148c072d9189 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:38.520383 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-e1f29e55-dca6-4a45-8dfe-24b38df8e8be tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] For port f6c2c656-c5c9-4a38-baf6-3924df82937d, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=f6c2c656-c5c9-4a38-baf6-3924df82937d,segment=NetworkSegment(a40eb34b-04cf-427f-a562-8a47c01a297b),segment_id=a40eb34b-04cf-427f-a562-8a47c01a297b)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:38.521920 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-e1f29e55-dca6-4a45-8dfe-24b38df8e8be tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:38.524146 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 704 Content-Type: application/json Date: Thu, 09 Dec 2021 21:38:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f733fdc3-111d-4b76-b4c3-7823f6d60c43 x-openstack-request-id: req-f733fdc3-111d-4b76-b4c3-7823f6d60c43 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:38:38.524747 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-unplugged", "status": "completed", "tag": "f6c2c656-c5c9-4a38-baf6-3924df82937d", "code": 200}, {"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-unplugged", "status": "completed", "tag": "57519c10-1d02-4ce7-b4be-b37a7bd58b09", "code": 200}, {"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-unplugged", "status": "completed", "tag": "38f97951-e872-4c24-947f-934429895ad3", "code": 200}, {"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-unplugged", "status": "completed", "tag": "7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:38:38.524747 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f733fdc3-111d-4b76-b4c3-7823f6d60c43 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:38:38.525162 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'f6c2c656-c5c9-4a38-baf6-3924df82937d', 'code': 200} Dec 09 21:38:38.525578 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '57519c10-1d02-4ce7-b4be-b37a7bd58b09', 'code': 200} Dec 09 21:38:38.526007 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '38f97951-e872-4c24-947f-934429895ad3', 'code': 200} Dec 09 21:38:38.526405 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a', 'code': 200} Dec 09 21:38:38.541253 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-e1f29e55-dca6-4a45-8dfe-24b38df8e8be tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Calling delete_port for f6c2c656-c5c9-4a38-baf6-3924df82937d owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:38.555428 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0fbab4e2-5ea6-4b74-aedd-be57e32b02ae None None] No DVR routers for this DVR port cb59c333-139c-43c4-a05a-a2c61800f72c on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:38:38.565648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fbab4e2-5ea6-4b74-aedd-be57e32b02ae None None] Pushing event deleted for resources: {'Port': ['ID=cb59c333-139c-43c4-a05a-a2c61800f72c,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:38.578645 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 6cf4ffbd-1ca6-4dd1-a033-c481be40b106 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:38:38.579215 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6cf4ffbd-1ca6-4dd1-a033-c481be40b106 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:38:38.579790 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device cb59c333-139c-43c4-a05a-a2c61800f72c no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:38:38.581312 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-3dcefda2-59e3-4361-883e-148c072d9189 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['935b09ce-7410-4b66-82be-99978deb6717']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:38.594660 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:38.622447 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-3dcefda2-59e3-4361-883e-148c072d9189 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd3bafd14-6a72-4dc5-8e4d-11da22a389ed') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:38.622747 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-3dcefda2-59e3-4361-883e-148c072d9189 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd3bafd14-6a72-4dc5-8e4d-11da22a389ed') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:38.632788 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-94d79468-199b-4a04-8607-a13bdc4fbcdd None None] Deleting port b8354390-a3b8-468e-b70c-d491e3ea4213 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:38.633387 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-94d79468-199b-4a04-8607-a13bdc4fbcdd None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:38.640147 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: cb59c333-139c-43c4-a05a-a2c61800f72c {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:38:38.640696 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device cb59c333-139c-43c4-a05a-a2c61800f72c not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:38:38.641256 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b8354390-a3b8-468e-b70c-d491e3ea4213 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:38:38.681472 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3dcefda2-59e3-4361-883e-148c072d9189 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:38.709389 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3dcefda2-59e3-4361-883e-148c072d9189 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:38.723311 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3dcefda2-59e3-4361-883e-148c072d9189 admin admin] Releasing vlan 125 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:38:38.724035 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3dcefda2-59e3-4361-883e-148c072d9189 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:38.733328 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 180 Content-Type: application/json Date: Thu, 09 Dec 2021 21:38:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-22e0e172-4887-4a9f-9fb5-31a4ee02d854 x-openstack-request-id: req-22e0e172-4887-4a9f-9fb5-31a4ee02d854 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:38:38.733742 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cbee2951-c573-41f4-8f85-c7c77ec3d8d6", "name": "network-vif-deleted", "tag": "028345f8-c21b-4afa-a015-34707fd8ba09", "status": "failed", "code": 422}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:38:38.734124 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-22e0e172-4887-4a9f-9fb5-31a4ee02d854 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:38:38.734604 n-d-713301-27 neutron-server[103438]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'cbee2951-c573-41f4-8f85-c7c77ec3d8d6', 'name': 'network-vif-deleted', 'tag': '028345f8-c21b-4afa-a015-34707fd8ba09', 'status': 'failed', 'code': 422} returned with failed status Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:38:38.735331 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:38:38.739917 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: b8354390-a3b8-468e-b70c-d491e3ea4213 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:38:38.742518 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b8354390-a3b8-468e-b70c-d491e3ea4213 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:38:38.792186 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04882c1e-b3de-4ad6-af13-d54d250e321e tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:38.845394 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-04882c1e-b3de-4ad6-af13-d54d250e321e tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e298ce53-cbb6-468b-a308-987703b107dd']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:38.868567 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-04882c1e-b3de-4ad6-af13-d54d250e321e tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3a34ab19-ea7d-4463-8683-e5acf02733c0') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:38.869024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-04882c1e-b3de-4ad6-af13-d54d250e321e tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3a34ab19-ea7d-4463-8683-e5acf02733c0') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:38.871122 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3dcefda2-59e3-4361-883e-148c072d9189 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:38.878115 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3dcefda2-59e3-4361-883e-148c072d9189 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:38.886912 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3dcefda2-59e3-4361-883e-148c072d9189 admin admin] 10.222.0.13 "DELETE /v2.0/networks/935b09ce-7410-4b66-82be-99978deb6717 HTTP/1.1" status: 204 len: 168 time: 1.9361567 Dec 09 21:38:38.904377 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04882c1e-b3de-4ad6-af13-d54d250e321e tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:38.914142 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dcefda2-59e3-4361-883e-148c072d9189 admin admin] Pushing event deleted for resources: {'Network': ['ID=935b09ce-7410-4b66-82be-99978deb6717,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:38.925208 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04882c1e-b3de-4ad6-af13-d54d250e321e tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:38.932955 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-04882c1e-b3de-4ad6-af13-d54d250e321e tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Releasing vlan 111 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:38:38.933519 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04882c1e-b3de-4ad6-af13-d54d250e321e tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:38:39.006630 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:38:39.018068 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04882c1e-b3de-4ad6-af13-d54d250e321e tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:39.062264 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-94d79468-199b-4a04-8607-a13bdc4fbcdd None None] For port b8354390-a3b8-468e-b70c-d491e3ea4213, host n-d-713301-27, got binding levels [] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:39.064731 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-94d79468-199b-4a04-8607-a13bdc4fbcdd None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:39.104451 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-94d79468-199b-4a04-8607-a13bdc4fbcdd None None] Calling delete_port for b8354390-a3b8-468e-b70c-d491e3ea4213 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:39.115954 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04882c1e-b3de-4ad6-af13-d54d250e321e tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:39.117462 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.ipam_backend_mixin [None req-94d79468-199b-4a04-8607-a13bdc4fbcdd None None] Port b8354390-a3b8-468e-b70c-d491e3ea4213 was not found and therefore no delete operation was performed {{(pid=103439) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 09 21:38:39.124207 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-94d79468-199b-4a04-8607-a13bdc4fbcdd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:39.136430 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-04882c1e-b3de-4ad6-af13-d54d250e321e tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] 10.222.0.13 "DELETE /v2.0/networks/e298ce53-cbb6-468b-a308-987703b107dd HTTP/1.1" status: 204 len: 168 time: 2.8966374 Dec 09 21:38:39.275138 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04882c1e-b3de-4ad6-af13-d54d250e321e tempest-ExtraDHCPOptionsTestJSON-1776962382 tempest-ExtraDHCPOptionsTestJSON-1776962382-project] Pushing event deleted for resources: {'Network': ['ID=e298ce53-cbb6-468b-a308-987703b107dd,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:39.279145 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-94d79468-199b-4a04-8607-a13bdc4fbcdd None None] Network 935b09ce-7410-4b66-82be-99978deb6717 is not hosted by any dhcp agent {{(pid=103439) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 09 21:38:39.284287 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94d79468-199b-4a04-8607-a13bdc4fbcdd None None] No DVR routers for this DVR port b8354390-a3b8-468e-b70c-d491e3ea4213 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:38:39.298802 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94d79468-199b-4a04-8607-a13bdc4fbcdd None None] Pushing event deleted for resources: {'Port': ['ID=b8354390-a3b8-468e-b70c-d491e3ea4213,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:39.302968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56592) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:39.494355 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-e1f29e55-dca6-4a45-8dfe-24b38df8e8be tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:39.515819 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-67fc1a4d-9398-4502-9406-7102e5a5733c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=aacb3291db4d4252a9225e8fe617f667&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2114017 Dec 09 21:38:39.528302 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56600) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:39.549545 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb290f7a-a85e-460b-ab76-7026206f2e05 req-ac9e1053-05ec-4d40-9a65-b5f0809171d1 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:39.563251 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eb290f7a-a85e-460b-ab76-7026206f2e05 req-ac9e1053-05ec-4d40-9a65-b5f0809171d1 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=62e2a8f5-9097-4f6a-a915-2c8303b50c10 HTTP/1.1" status: 200 len: 907 time: 0.1350288 Dec 09 21:38:39.566581 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1f29e55-dca6-4a45-8dfe-24b38df8e8be tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event deleted for resources: {'Port': ['ID=f6c2c656-c5c9-4a38-baf6-3924df82937d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:39.695953 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:39.708814 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-e1f29e55-dca6-4a45-8dfe-24b38df8e8be tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] No DVR routers for this DVR port f6c2c656-c5c9-4a38-baf6-3924df82937d on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:38:39.715677 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-e1f29e55-dca6-4a45-8dfe-24b38df8e8be tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:39.719183 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-e1f29e55-dca6-4a45-8dfe-24b38df8e8be tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.10 "DELETE /v2.0/ports/f6c2c656-c5c9-4a38-baf6-3924df82937d HTTP/1.1" status: 204 len: 173 time: 2.1569400 Dec 09 21:38:39.886920 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56604) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:39.944527 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-466b6355-1930-4517-9560-f6fbbc06a5ff tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Deleting port 2c568c8f-47ca-4f47-ab71-187026ca02db {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:39.944879 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-466b6355-1930-4517-9560-f6fbbc06a5ff tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:40.195340 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-466b6355-1930-4517-9560-f6fbbc06a5ff tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] For port 2c568c8f-47ca-4f47-ab71-187026ca02db, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=2c568c8f-47ca-4f47-ab71-187026ca02db,segment=NetworkSegment(a40eb34b-04cf-427f-a562-8a47c01a297b),segment_id=a40eb34b-04cf-427f-a562-8a47c01a297b)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:40.196049 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-466b6355-1930-4517-9560-f6fbbc06a5ff tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:40.223492 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-466b6355-1930-4517-9560-f6fbbc06a5ff tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Calling delete_port for 2c568c8f-47ca-4f47-ab71-187026ca02db owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:40.320643 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c70922b0-0282-419d-8f50-cca10f251369 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:40.342675 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff832b91-0dac-43a9-90b9-deba552d9c89 req-3b36467f-b105-44e1-8d60-f85690c4aefe tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:40.349910 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff832b91-0dac-43a9-90b9-deba552d9c89 req-3b36467f-b105-44e1-8d60-f85690c4aefe tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:40.352036 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ff832b91-0dac-43a9-90b9-deba552d9c89 req-3b36467f-b105-44e1-8d60-f85690c4aefe tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 1678 time: 0.0852373 Dec 09 21:38:40.388754 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c70922b0-0282-419d-8f50-cca10f251369 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:40.450363 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6bc47537-3ba4-427e-9a3a-e2a20b2a1fd5 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=090194789ad44e71986cd1d4018b9671&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5561485 Dec 09 21:38:40.450363 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-466b6355-1930-4517-9560-f6fbbc06a5ff tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:40.451463 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56612) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:40.473000 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ff832b91-0dac-43a9-90b9-deba552d9c89 req-1f85fc85-9796-4417-b5d3-90d8ad09a01b tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1060436 Dec 09 21:38:40.495327 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-deleted', 'tag': '38f97951-e872-4c24-947f-934429895ad3'}, {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-deleted', 'tag': 'f6c2c656-c5c9-4a38-baf6-3924df82937d'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:38:40.497799 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2b62f21b-e1d3-4a1e-bc92-536bc5c91e86" -d '{"events": [{"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-deleted", "tag": "38f97951-e872-4c24-947f-934429895ad3"}, {"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-deleted", "tag": "f6c2c656-c5c9-4a38-baf6-3924df82937d"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:38:40.515710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-466b6355-1930-4517-9560-f6fbbc06a5ff tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event deleted for resources: {'Port': ['ID=2c568c8f-47ca-4f47-ab71-187026ca02db,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:40.523856 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c70922b0-0282-419d-8f50-cca10f251369 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:40.529869 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c70922b0-0282-419d-8f50-cca10f251369 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:40.537864 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c70922b0-0282-419d-8f50-cca10f251369 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/9842a51d-6296-4920-8474-10ad60f68659 HTTP/1.1" status: 204 len: 168 time: 1.0031586 Dec 09 21:38:40.548967 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c70922b0-0282-419d-8f50-cca10f251369 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9842a51d-6296-4920-8474-10ad60f68659,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:40.636455 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Thu, 09 Dec 2021 21:38:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d1e20ac0-66db-485b-bb66-61dd70c03780 x-openstack-request-id: req-d1e20ac0-66db-485b-bb66-61dd70c03780 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:38:40.640437 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-deleted", "tag": "38f97951-e872-4c24-947f-934429895ad3", "status": "completed", "code": 200}, {"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-deleted", "tag": "f6c2c656-c5c9-4a38-baf6-3924df82937d", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:38:40.640841 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-d1e20ac0-66db-485b-bb66-61dd70c03780 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:38:40.641514 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-deleted', 'tag': '38f97951-e872-4c24-947f-934429895ad3', 'status': 'completed', 'code': 200} Dec 09 21:38:40.641862 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-deleted', 'tag': 'f6c2c656-c5c9-4a38-baf6-3924df82937d', 'status': 'completed', 'code': 200} Dec 09 21:38:40.648433 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-466b6355-1930-4517-9560-f6fbbc06a5ff tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] No DVR routers for this DVR port 2c568c8f-47ca-4f47-ab71-187026ca02db on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:38:40.653924 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-466b6355-1930-4517-9560-f6fbbc06a5ff tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:40.663833 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-466b6355-1930-4517-9560-f6fbbc06a5ff tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.10 "DELETE /v2.0/ports/2c568c8f-47ca-4f47-ab71-187026ca02db HTTP/1.1" status: 204 len: 173 time: 0.9362493 Dec 09 21:38:40.683077 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f9bf2a4-3c21-4ba4-a6e4-a9eb4e0e38a3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:40.693141 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2be9061-2638-45c0-a582-79784472c35d req-99678fed-0f0e-4b5c-b0bc-19980b50e74e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:40.695246 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2be9061-2638-45c0-a582-79784472c35d req-99678fed-0f0e-4b5c-b0bc-19980b50e74e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.31 "GET /v2.0/ports?device_id=62e2a8f5-9097-4f6a-a915-2c8303b50c10 HTTP/1.1" status: 200 len: 907 time: 0.0885742 Dec 09 21:38:40.715378 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f9bf2a4-3c21-4ba4-a6e4-a9eb4e0e38a3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:40.779903 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f9bf2a4-3c21-4ba4-a6e4-a9eb4e0e38a3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:40.782223 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f9bf2a4-3c21-4ba4-a6e4-a9eb4e0e38a3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:40.786186 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3f9bf2a4-3c21-4ba4-a6e4-a9eb4e0e38a3 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/9b5688e2-86d2-49d7-82f1-b7a4bb251d13 HTTP/1.1" status: 204 len: 168 time: 0.3315351 Dec 09 21:38:40.851067 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f9bf2a4-3c21-4ba4-a6e4-a9eb4e0e38a3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9b5688e2-86d2-49d7-82f1-b7a4bb251d13,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:40.945091 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-b0d8c733-afe5-433b-bc46-76f37904e36c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Deleting port 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:40.945728 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-b0d8c733-afe5-433b-bc46-76f37904e36c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:40.993082 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c41a9a3-5a35-4517-97cb-b9c5450779d3 req-ccfac3e9-42e1-490d-814a-8b84068489aa tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:41.007072 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c41a9a3-5a35-4517-97cb-b9c5450779d3 req-ccfac3e9-42e1-490d-814a-8b84068489aa tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=62e2a8f5-9097-4f6a-a915-2c8303b50c10 HTTP/1.1" status: 200 len: 907 time: 0.2399948 Dec 09 21:38:41.043252 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-e2be9061-2638-45c0-a582-79784472c35d req-9bf59ccf-e9cc-4f83-be2a-d4cbc9be5b5e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Deleting port 75fe8bb3-adef-484f-9f51-fd3c79998fce {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:41.043958 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e2be9061-2638-45c0-a582-79784472c35d req-9bf59ccf-e9cc-4f83-be2a-d4cbc9be5b5e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:41.173315 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-b0d8c733-afe5-433b-bc46-76f37904e36c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] For port 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a,segment=NetworkSegment(7cf32f95-b9ab-465b-889c-7d7de3246a6f),segment_id=7cf32f95-b9ab-465b-889c-7d7de3246a6f)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:41.173818 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-b0d8c733-afe5-433b-bc46-76f37904e36c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:41.176973 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-e2be9061-2638-45c0-a582-79784472c35d req-9bf59ccf-e9cc-4f83-be2a-d4cbc9be5b5e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] For port 75fe8bb3-adef-484f-9f51-fd3c79998fce, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=75fe8bb3-adef-484f-9f51-fd3c79998fce,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:41.177946 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e2be9061-2638-45c0-a582-79784472c35d req-9bf59ccf-e9cc-4f83-be2a-d4cbc9be5b5e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:41.219784 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-e2be9061-2638-45c0-a582-79784472c35d req-9bf59ccf-e9cc-4f83-be2a-d4cbc9be5b5e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Calling delete_port for 75fe8bb3-adef-484f-9f51-fd3c79998fce owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:41.427238 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e2be9061-2638-45c0-a582-79784472c35d req-9bf59ccf-e9cc-4f83-be2a-d4cbc9be5b5e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:41.472528 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bf59ccf-e9cc-4f83-be2a-d4cbc9be5b5e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Pushing event deleted for resources: {'Port': ['ID=75fe8bb3-adef-484f-9f51-fd3c79998fce,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:41.576164 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-e2be9061-2638-45c0-a582-79784472c35d req-9bf59ccf-e9cc-4f83-be2a-d4cbc9be5b5e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] No DVR routers for this DVR port 75fe8bb3-adef-484f-9f51-fd3c79998fce on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:38:41.579141 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e2be9061-2638-45c0-a582-79784472c35d req-9bf59ccf-e9cc-4f83-be2a-d4cbc9be5b5e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:41.587677 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2be9061-2638-45c0-a582-79784472c35d req-9bf59ccf-e9cc-4f83-be2a-d4cbc9be5b5e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.31 "DELETE /v2.0/ports/75fe8bb3-adef-484f-9f51-fd3c79998fce HTTP/1.1" status: 204 len: 173 time: 0.8858230 Dec 09 21:38:41.588325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '62e2a8f5-9097-4f6a-a915-2c8303b50c10', 'name': 'network-vif-deleted', 'tag': '75fe8bb3-adef-484f-9f51-fd3c79998fce'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:38:41.590957 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b1ffa4ec-c296-4235-9ba0-aee3c118b780" -d '{"events": [{"server_uuid": "62e2a8f5-9097-4f6a-a915-2c8303b50c10", "name": "network-vif-deleted", "tag": "75fe8bb3-adef-484f-9f51-fd3c79998fce"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:38:41.651964 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-b0d8c733-afe5-433b-bc46-76f37904e36c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:41.652560 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-b0d8c733-afe5-433b-bc46-76f37904e36c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:41.652662 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-b0d8c733-afe5-433b-bc46-76f37904e36c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Floating IP 3435483a-a00a-4fba-97af-9cb9ff87f279 disassociated. External IP: 172.25.3.201, port: 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a. Dec 09 21:38:41.653004 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-b0d8c733-afe5-433b-bc46-76f37904e36c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Calling delete_port for 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:41.718833 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e2db438-f6a7-49d8-be9a-08c3f90f3dab req-4c561aee-41f7-438c-af76-7224b11db577 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:41.721909 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e2db438-f6a7-49d8-be9a-08c3f90f3dab req-4c561aee-41f7-438c-af76-7224b11db577 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 944 time: 0.1108394 Dec 09 21:38:41.904986 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e2db438-f6a7-49d8-be9a-08c3f90f3dab req-5927907a-9c78-40c2-8591-5770f8c7e9be tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups?id=66e1817f-e10c-4faf-abd8-bc5e8fda7f97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1754570 Dec 09 21:38:41.962977 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-b0d8c733-afe5-433b-bc46-76f37904e36c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:41.989831 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:38:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a69a07c3-4901-4989-bdf1-73da90459e92 x-openstack-request-id: req-a69a07c3-4901-4989-bdf1-73da90459e92 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:38:41.990135 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "62e2a8f5-9097-4f6a-a915-2c8303b50c10", "name": "network-vif-deleted", "tag": "75fe8bb3-adef-484f-9f51-fd3c79998fce", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:38:41.990392 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a69a07c3-4901-4989-bdf1-73da90459e92 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:38:41.990805 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '62e2a8f5-9097-4f6a-a915-2c8303b50c10', 'name': 'network-vif-deleted', 'tag': '75fe8bb3-adef-484f-9f51-fd3c79998fce', 'status': 'completed', 'code': 200} Dec 09 21:38:42.077064 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0d8c733-afe5-433b-bc46-76f37904e36c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event deleted for resources: {'Port': ['ID=7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:42.217794 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ed75403b-857b-433b-82ea-261e08952c30 req-09b3b183-f472-4c1a-ac06-ef4a5597cd65 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=62e2a8f5-9097-4f6a-a915-2c8303b50c10 HTTP/1.1" status: 200 len: 210 time: 0.0570920 Dec 09 21:38:42.624437 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56684) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:42.747587 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-62b1c56e-98f7-4920-ae16-1ba0c0dbb248 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-test-network-1616595106'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:38:42.823780 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-62b1c56e-98f7-4920-ae16-1ba0c0dbb248 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:38:42.834834 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62b1c56e-98f7-4920-ae16-1ba0c0dbb248 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:42.851747 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62b1c56e-98f7-4920-ae16-1ba0c0dbb248 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:42.964241 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-deleted', 'tag': '2c568c8f-47ca-4f47-ab71-187026ca02db'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:38:42.966670 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ae2dc4c7-5425-48a3-ba6f-86ffee5c6baa" -d '{"events": [{"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-deleted", "tag": "2c568c8f-47ca-4f47-ab71-187026ca02db"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:38:43.019122 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62b1c56e-98f7-4920-ae16-1ba0c0dbb248 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:43.028754 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62b1c56e-98f7-4920-ae16-1ba0c0dbb248 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:43.043041 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-b0d8c733-afe5-433b-bc46-76f37904e36c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Router 4757617b-081d-4a51-a741-443e352d3856 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:38:43.087684 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-34f83197-f938-4006-8623-d8a49ba7a4d6 req-7050d53c-9d51-45fe-97ee-ddd2e8d8e3e3 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 210 time: 0.0369999 Dec 09 21:38:43.101699 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-62b1c56e-98f7-4920-ae16-1ba0c0dbb248 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] vlan segment allocate from pool success with {'vlan_id': 130, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:38:43.111323 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62b1c56e-98f7-4920-ae16-1ba0c0dbb248 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6895b185-77a6-4346-afaf-cfcf881dfd8e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:43.122013 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62b1c56e-98f7-4920-ae16-1ba0c0dbb248 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:43.122349 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-62b1c56e-98f7-4920-ae16-1ba0c0dbb248 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Added segment 8d15e2ef-b82d-433a-a244-0bedb82cd38c of type vlan for network 12b747a3-de78-4645-83a0-a5e2eec09a63 Dec 09 21:38:43.203645 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62b1c56e-98f7-4920-ae16-1ba0c0dbb248 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:43.216136 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:38:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2f7362fe-625c-4c3d-a5c1-384784da07a6 x-openstack-request-id: req-2f7362fe-625c-4c3d-a5c1-384784da07a6 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:38:43.216362 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-deleted", "tag": "2c568c8f-47ca-4f47-ab71-187026ca02db", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:38:43.216581 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-2f7362fe-625c-4c3d-a5c1-384784da07a6 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:38:43.216947 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-deleted', 'tag': '2c568c8f-47ca-4f47-ab71-187026ca02db', 'status': 'completed', 'code': 200} Dec 09 21:38:43.248405 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-b0d8c733-afe5-433b-bc46-76f37904e36c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:38:43.250504 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62b1c56e-98f7-4920-ae16-1ba0c0dbb248 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:43.267545 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-62b1c56e-98f7-4920-ae16-1ba0c0dbb248 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:43.268206 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62b1c56e-98f7-4920-ae16-1ba0c0dbb248 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:43.269234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45c68c9d-c004-4c3a-953f-8da188c48ea7 None None] Sync routers for ids ['4757617b-081d-4a51-a741-443e352d3856'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:38:43.282956 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45c68c9d-c004-4c3a-953f-8da188c48ea7 None None] Routers {'4757617b-081d-4a51-a741-443e352d3856'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:38:43.283619 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-45c68c9d-c004-4c3a-953f-8da188c48ea7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:38:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4757617b-081d-4a51-a741-443e352d3856'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:43.368953 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-b0d8c733-afe5-433b-bc46-76f37904e36c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] No DVR routers for this DVR port 7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:38:43.383620 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-b0d8c733-afe5-433b-bc46-76f37904e36c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:43.396836 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9df68da5-f6eb-40b7-80a6-e961a30d4f3e req-b0d8c733-afe5-433b-bc46-76f37904e36c tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.10 "DELETE /v2.0/ports/7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a HTTP/1.1" status: 204 len: 173 time: 2.7147808 Dec 09 21:38:43.463992 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-62b1c56e-98f7-4920-ae16-1ba0c0dbb248 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 781 time: 0.8379586 Dec 09 21:38:43.465060 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62b1c56e-98f7-4920-ae16-1ba0c0dbb248 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Network': ['ID=12b747a3-de78-4645-83a0-a5e2eec09a63,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:43.466592 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56716) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:43.471882 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ebf2735b-78e3-4c35-a301-07d62addb9ea tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'port': {'network_id': '12b747a3-de78-4645-83a0-a5e2eec09a63', 'name': 'tempest-PortsTestJSON-27940416'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:38:43.501829 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 12b747a3-de78-4645-83a0-a5e2eec09a63 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:38:43.642864 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aabe2a69-057b-4af6-8b92-b1ac808d60c7 req-b924bd6c-cff0-49d9-9e2f-643d754f04b2 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:43.655276 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aabe2a69-057b-4af6-8b92-b1ac808d60c7 req-b924bd6c-cff0-49d9-9e2f-643d754f04b2 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=78dd0620-865a-48a9-adf6-d64588d364fc HTTP/1.1" status: 200 len: 945 time: 0.0784111 Dec 09 21:38:43.669144 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ebf2735b-78e3-4c35-a301-07d62addb9ea tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:38:43.673249 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ebf2735b-78e3-4c35-a301-07d62addb9ea tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:43.715920 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-ebf2735b-78e3-4c35-a301-07d62addb9ea tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] device_id is not set on port 2c0d4683-2706-41db-8c7f-caeeb25ac34f yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:38:43.752909 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-45c68c9d-c004-4c3a-953f-8da188c48ea7 None None] Set router 4757617b-081d-4a51-a741-443e352d3856 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:38:43.788849 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aabe2a69-057b-4af6-8b92-b1ac808d60c7 req-f57cd2f1-04c6-4b3c-bfc8-e9f928a0236e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1247833 Dec 09 21:38:44.080634 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ebf2735b-78e3-4c35-a301-07d62addb9ea tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:44.158665 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ebf2735b-78e3-4c35-a301-07d62addb9ea tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:44.273102 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-45c68c9d-c004-4c3a-953f-8da188c48ea7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4757617b-081d-4a51-a741-443e352d3856', 'name': 'tempest-TaggedBootDevicesTest_v242-1825188234-router', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97'}], 'enable_snat': True}, 'gw_port_id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:24Z', 'updated_at': '2021-12-09T21:27:29Z', 'revision_number': 4, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'gw_port': {'id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1113, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:25Z', 'updated_at': '2021-12-09T21:27:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '19d4a80e-ba79-4490-8a95-e9c7e2370cf8', 'name': '', 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'mac_address': 'fa:16:3e:47:22:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_interface', 'standard_attr_id': 1115, 'fixed_ips': [{'subnet_id': 'd989acab-7cdc-482f-a350-344dd6e11873', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:28Z', 'updated_at': '2021-12-09T21:27:39Z', 'revision_number': 5, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'subnets': [{'id': 'd989acab-7cdc-482f-a350-344dd6e11873', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:44.359144 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45c68c9d-c004-4c3a-953f-8da188c48ea7 None None] Checking router: 4757617b-081d-4a51-a741-443e352d3856 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:38:44.381800 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45c68c9d-c004-4c3a-953f-8da188c48ea7 None None] Routers {'4757617b-081d-4a51-a741-443e352d3856'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:38:44.382756 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-45c68c9d-c004-4c3a-953f-8da188c48ea7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:38:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4757617b-081d-4a51-a741-443e352d3856'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:44.393936 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-138be16a-41a9-4ab6-8754-ec669efb0292 req-08150d4a-3fa1-4b81-b3e0-392442a0ce80 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 210 time: 0.1006200 Dec 09 21:38:44.460388 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebf2735b-78e3-4c35-a301-07d62addb9ea tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Port': ['ID=2c0d4683-2706-41db-8c7f-caeeb25ac34f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:44.478493 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ebf2735b-78e3-4c35-a301-07d62addb9ea tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Checking segment: {'id': '8d15e2ef-b82d-433a-a244-0bedb82cd38c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '12b747a3-de78-4645-83a0-a5e2eec09a63'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:38:44.479101 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ebf2735b-78e3-4c35-a301-07d62addb9ea tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network hostable DHCP agents. Network: 12b747a3-de78-4645-83a0-a5e2eec09a63, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:38:44.509380 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ebf2735b-78e3-4c35-a301-07d62addb9ea tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network 12b747a3-de78-4645-83a0-a5e2eec09a63 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:38:44.521870 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 75fe8bb3-adef-484f-9f51-fd3c79998fce no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:38:44.547946 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-ebf2735b-78e3-4c35-a301-07d62addb9ea tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 12b747a3-de78-4645-83a0-a5e2eec09a63) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:38:44.554306 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ebf2735b-78e3-4c35-a301-07d62addb9ea tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:38:44.566936 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ebf2735b-78e3-4c35-a301-07d62addb9ea tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:44.572800 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf81e552-3124-4663-b90e-0e7dde92dabc None None] Network 12b747a3-de78-4645-83a0-a5e2eec09a63 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:38:44.574348 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ebf2735b-78e3-4c35-a301-07d62addb9ea tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:44.598230 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ebf2735b-78e3-4c35-a301-07d62addb9ea tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 844 time: 1.1302404 Dec 09 21:38:44.601160 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56764) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:44.609225 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-0b3c10a1-b7f7-4564-89ef-d56cf99a0733 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-371708558'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:38:44.664424 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0b3c10a1-b7f7-4564-89ef-d56cf99a0733 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:38:44.671170 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0b3c10a1-b7f7-4564-89ef-d56cf99a0733 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:44.741025 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0b3c10a1-b7f7-4564-89ef-d56cf99a0733 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] vlan segment allocate from pool success with {'vlan_id': 122, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:38:44.761478 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-45c68c9d-c004-4c3a-953f-8da188c48ea7 None None] Set router 4757617b-081d-4a51-a741-443e352d3856 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:38:44.771643 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0b3c10a1-b7f7-4564-89ef-d56cf99a0733 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:44.773853 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-0b3c10a1-b7f7-4564-89ef-d56cf99a0733 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Added segment 44e9b826-fc7c-4ac0-a8f0-36a76a91ce03 of type vlan for network 07588d8a-7cb0-4fe2-b431-4541c61a2d54 Dec 09 21:38:44.850154 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0b3c10a1-b7f7-4564-89ef-d56cf99a0733 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:44.860160 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 75fe8bb3-adef-484f-9f51-fd3c79998fce {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:38:44.860509 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 75fe8bb3-adef-484f-9f51-fd3c79998fce not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:38:44.935133 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46aa5b38-61fd-4fd1-8474-1d307de168bc req-47fdd223-9ed8-4999-b87c-a274fc5ef85f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:44.939137 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46aa5b38-61fd-4fd1-8474-1d307de168bc req-47fdd223-9ed8-4999-b87c-a274fc5ef85f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.31 "GET /v2.0/ports?device_id=78dd0620-865a-48a9-adf6-d64588d364fc HTTP/1.1" status: 200 len: 945 time: 0.0862093 Dec 09 21:38:45.087135 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0b3c10a1-b7f7-4564-89ef-d56cf99a0733 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:45.093892 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b3c10a1-b7f7-4564-89ef-d56cf99a0733 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:45.094669 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0b3c10a1-b7f7-4564-89ef-d56cf99a0733 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:45.186543 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f9562c4-0b3c-44e1-91d5-022e754d7580 req-5be4d6e5-0ca7-4140-af13-393f50f29556 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:45.218675 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7f9562c4-0b3c-44e1-91d5-022e754d7580 req-5be4d6e5-0ca7-4140-af13-393f50f29556 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=78dd0620-865a-48a9-adf6-d64588d364fc HTTP/1.1" status: 200 len: 945 time: 0.2742260 Dec 09 21:38:45.218971 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-deleted', 'tag': '7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:38:45.221515 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-66cfd84f-7d4b-4817-9ce6-2f69d33b0fb7" -d '{"events": [{"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-deleted", "tag": "7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:38:45.342165 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0b3c10a1-b7f7-4564-89ef-d56cf99a0733 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.7395885 Dec 09 21:38:45.344762 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56786) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:45.351981 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'ports': [{'network_id': '12b747a3-de78-4645-83a0-a5e2eec09a63'}, {'network_id': '07588d8a-7cb0-4fe2-b431-4541c61a2d54'}]} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:38:45.352568 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'port': {'network_id': '12b747a3-de78-4645-83a0-a5e2eec09a63'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:38:45.353299 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'port': {'network_id': '07588d8a-7cb0-4fe2-b431-4541c61a2d54'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:38:45.365878 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-46aa5b38-61fd-4fd1-8474-1d307de168bc req-c545a32a-e55f-4bdc-a964-8438fca3bebf tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Deleting port ae3b2bf8-8e63-4473-8cc8-206c769cc38a {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:45.366316 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-46aa5b38-61fd-4fd1-8474-1d307de168bc req-c545a32a-e55f-4bdc-a964-8438fca3bebf tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:45.369404 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b3c10a1-b7f7-4564-89ef-d56cf99a0733 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Network': ['ID=07588d8a-7cb0-4fe2-b431-4541c61a2d54,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:45.397210 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 07588d8a-7cb0-4fe2-b431-4541c61a2d54 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:38:45.432161 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7f9562c4-0b3c-44e1-91d5-022e754d7580 req-6b9dfb41-1f3e-44c2-ab5c-060f6ea8543c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2122169 Dec 09 21:38:45.432823 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56790) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:45.558590 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-46aa5b38-61fd-4fd1-8474-1d307de168bc req-c545a32a-e55f-4bdc-a964-8438fca3bebf tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] For port ae3b2bf8-8e63-4473-8cc8-206c769cc38a, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ae3b2bf8-8e63-4473-8cc8-206c769cc38a,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:45.570240 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-46aa5b38-61fd-4fd1-8474-1d307de168bc req-c545a32a-e55f-4bdc-a964-8438fca3bebf tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:45.598799 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:38:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a584be13-42f1-4591-a2fc-a2699fdacd9a x-openstack-request-id: req-a584be13-42f1-4591-a2fc-a2699fdacd9a {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:38:45.599270 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0436dc41-5aa7-49ed-ab16-926def9c60ce", "name": "network-vif-deleted", "tag": "7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:38:45.599721 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a584be13-42f1-4591-a2fc-a2699fdacd9a {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:38:45.600390 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0436dc41-5aa7-49ed-ab16-926def9c60ce', 'name': 'network-vif-deleted', 'tag': '7b67fc93-6ae0-4b19-a6c3-bfe219fc0f4a', 'status': 'completed', 'code': 200} Dec 09 21:38:45.666471 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-46aa5b38-61fd-4fd1-8474-1d307de168bc req-c545a32a-e55f-4bdc-a964-8438fca3bebf tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Calling delete_port for ae3b2bf8-8e63-4473-8cc8-206c769cc38a owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:45.680986 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-130b2e2f-1a36-4908-bb2f-0f439336193f req-36a69b42-e4e7-4831-9365-c0417952238b tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 210 time: 0.0852137 Dec 09 21:38:45.730100 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ab88e121-a765-4bbe-84d5-3614c78c3e3c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:45.834025 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'port': 2} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:38:45.839347 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:45.874473 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:45.963948 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-46aa5b38-61fd-4fd1-8474-1d307de168bc req-c545a32a-e55f-4bdc-a964-8438fca3bebf tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:45.992642 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['d5571683-a9bc-4155-85b9-b1ef208e21e9'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:38:46.003875 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c545a32a-e55f-4bdc-a964-8438fca3bebf tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Pushing event deleted for resources: {'Port': ['ID=ae3b2bf8-8e63-4473-8cc8-206c769cc38a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:46.074370 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] device_id is not set on port 3820a638-2e79-48f6-a2bf-2df704b5c990 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:38:46.081352 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['ae3b2bf8-8e63-4473-8cc8-206c769cc38a'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:38:46.118534 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-46aa5b38-61fd-4fd1-8474-1d307de168bc req-c545a32a-e55f-4bdc-a964-8438fca3bebf tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] No DVR routers for this DVR port ae3b2bf8-8e63-4473-8cc8-206c769cc38a on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:38:46.129889 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-46aa5b38-61fd-4fd1-8474-1d307de168bc req-c545a32a-e55f-4bdc-a964-8438fca3bebf tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:46.133267 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46aa5b38-61fd-4fd1-8474-1d307de168bc req-c545a32a-e55f-4bdc-a964-8438fca3bebf tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.31 "DELETE /v2.0/ports/ae3b2bf8-8e63-4473-8cc8-206c769cc38a HTTP/1.1" status: 204 len: 173 time: 1.1179113 Dec 09 21:38:46.141391 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '78dd0620-865a-48a9-adf6-d64588d364fc', 'name': 'network-vif-deleted', 'tag': 'ae3b2bf8-8e63-4473-8cc8-206c769cc38a'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:38:46.146731 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4993ee20-f7d1-488e-9f30-f67c3ba01892" -d '{"events": [{"server_uuid": "78dd0620-865a-48a9-adf6-d64588d364fc", "name": "network-vif-deleted", "tag": "ae3b2bf8-8e63-4473-8cc8-206c769cc38a"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:38:46.217909 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:46.253735 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:38:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1494c48b-3ba7-4b8e-92e9-9031ee31f4ae x-openstack-request-id: req-1494c48b-3ba7-4b8e-92e9-9031ee31f4ae {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:38:46.254438 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "78dd0620-865a-48a9-adf6-d64588d364fc", "name": "network-vif-deleted", "tag": "ae3b2bf8-8e63-4473-8cc8-206c769cc38a", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:38:46.255539 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-1494c48b-3ba7-4b8e-92e9-9031ee31f4ae {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:38:46.256190 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '78dd0620-865a-48a9-adf6-d64588d364fc', 'name': 'network-vif-deleted', 'tag': 'ae3b2bf8-8e63-4473-8cc8-206c769cc38a', 'status': 'completed', 'code': 200} Dec 09 21:38:46.273095 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ab88e121-a765-4bbe-84d5-3614c78c3e3c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:46.285863 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ab88e121-a765-4bbe-84d5-3614c78c3e3c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:46.288796 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-45c68c9d-c004-4c3a-953f-8da188c48ea7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4757617b-081d-4a51-a741-443e352d3856', 'name': 'tempest-TaggedBootDevicesTest_v242-1825188234-router', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97'}], 'enable_snat': True}, 'gw_port_id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:24Z', 'updated_at': '2021-12-09T21:27:29Z', 'revision_number': 4, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'gw_port': {'id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1113, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:25Z', 'updated_at': '2021-12-09T21:27:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '19d4a80e-ba79-4490-8a95-e9c7e2370cf8', 'name': '', 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'mac_address': 'fa:16:3e:47:22:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_interface', 'standard_attr_id': 1115, 'fixed_ips': [{'subnet_id': 'd989acab-7cdc-482f-a350-344dd6e11873', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:28Z', 'updated_at': '2021-12-09T21:27:39Z', 'revision_number': 5, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'subnets': [{'id': 'd989acab-7cdc-482f-a350-344dd6e11873', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:46.343035 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45c68c9d-c004-4c3a-953f-8da188c48ea7 None None] The sync data for ids ['4757617b-081d-4a51-a741-443e352d3856'] in n-d-713301-27 is: [{'id': '4757617b-081d-4a51-a741-443e352d3856', 'name': 'tempest-TaggedBootDevicesTest_v242-1825188234-router', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97'}], 'enable_snat': True}, 'gw_port_id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:24Z', 'updated_at': '2021-12-09T21:27:29Z', 'revision_number': 4, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'gw_port': {'id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1113, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:25Z', 'updated_at': '2021-12-09T21:27:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '19d4a80e-ba79-4490-8a95-e9c7e2370cf8', 'name': '', 'network_id': '361619eb-51a4-4728-b2cc-72e27ec4eca5', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'mac_address': 'fa:16:3e:47:22:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_interface', 'standard_attr_id': 1115, 'fixed_ips': [{'subnet_id': 'd989acab-7cdc-482f-a350-344dd6e11873', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:28Z', 'updated_at': '2021-12-09T21:27:39Z', 'revision_number': 5, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'subnets': [{'id': 'd989acab-7cdc-482f-a350-344dd6e11873', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:38:46.348164 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab88e121-a765-4bbe-84d5-3614c78c3e3c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b53cb4e0-ce7a-4c0b-b389-a97ac26439fb,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:46.373013 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] device_id is not set on port 871dbe29-6bf8-4e5e-9c94-5c5f5959c91f yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:38:46.396655 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ab88e121-a765-4bbe-84d5-3614c78c3e3c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=5adaa521431a46f6bec3d0cad1f07540&name=default HTTP/1.1" status: 200 len: 3000 time: 0.9568446 Dec 09 21:38:46.397153 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56802) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:46.539309 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-abf03c3b-ddf6-465e-a812-2b4214925772 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:46.635651 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-abf03c3b-ddf6-465e-a812-2b4214925772 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:46.666942 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:46.800108 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c959c79c-1293-4530-acb1-b7385c0f4b60 req-fb60b97d-f602-4606-8485-19028cdcb47d tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=78dd0620-865a-48a9-adf6-d64588d364fc HTTP/1.1" status: 200 len: 210 time: 0.0985820 Dec 09 21:38:46.803358 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:46.849266 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-abf03c3b-ddf6-465e-a812-2b4214925772 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:46.853169 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-abf03c3b-ddf6-465e-a812-2b4214925772 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:46.854734 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-abf03c3b-ddf6-465e-a812-2b4214925772 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/b53cb4e0-ce7a-4c0b-b389-a97ac26439fb HTTP/1.1" status: 204 len: 168 time: 0.4566522 Dec 09 21:38:46.869753 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abf03c3b-ddf6-465e-a812-2b4214925772 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b53cb4e0-ce7a-4c0b-b389-a97ac26439fb,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:46.976610 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network 12b747a3-de78-4645-83a0-a5e2eec09a63 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:38:46.981228 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:38:46.987575 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:38:46.989371 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:47.005961 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a970f92e-792e-4772-a956-5f30772eb4cc None None] New status for floating IP 3435483a-a00a-4fba-97af-9cb9ff87f279: DOWN {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:38:47.047028 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Port': ['ID=3820a638-2e79-48f6-a2bf-2df704b5c990,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:47.127865 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4be49338-dcaa-4fea-964e-707db7dd7e35 req-ee512a0f-6590-458d-8b82-722c4f97ce9d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 210 time: 0.0918748 Dec 09 21:38:47.145634 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Checking segment: {'id': '44e9b826-fc7c-4ac0-a8f0-36a76a91ce03', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': '07588d8a-7cb0-4fe2-b431-4541c61a2d54'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:38:47.146503 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network hostable DHCP agents. Network: 07588d8a-7cb0-4fe2-b431-4541c61a2d54, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:38:47.176548 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Port': ['ID=871dbe29-6bf8-4e5e-9c94-5c5f5959c91f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:47.190535 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network 07588d8a-7cb0-4fe2-b431-4541c61a2d54 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:38:47.208021 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 07588d8a-7cb0-4fe2-b431-4541c61a2d54) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:38:47.214321 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:38:47.218109 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed3dbf48-6c56-4023-99ff-b416fac1f83f None None] Network 07588d8a-7cb0-4fe2-b431-4541c61a2d54 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:38:47.224169 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:47.230010 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:47.230835 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:47.267656 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a947ceef-2678-449c-bebf-cdcffec3de71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1425 time: 1.9209654 Dec 09 21:38:47.269696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56822) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:47.440077 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56826) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:47.467001 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ef567e2a-c0a2-4b62-9c92-a56465cb7099 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:47.483700 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-bc8f6425-9e17-4533-852c-fd1a8e483623 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting port 871dbe29-6bf8-4e5e-9c94-5c5f5959c91f {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:47.484048 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bc8f6425-9e17-4533-852c-fd1a8e483623 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:47.612464 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bc8f6425-9e17-4533-852c-fd1a8e483623 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:47.658626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-bc8f6425-9e17-4533-852c-fd1a8e483623 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Calling delete_port for 871dbe29-6bf8-4e5e-9c94-5c5f5959c91f owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:47.712431 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ef567e2a-c0a2-4b62-9c92-a56465cb7099 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:47.722117 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ef567e2a-c0a2-4b62-9c92-a56465cb7099 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:47.787723 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bc8f6425-9e17-4533-852c-fd1a8e483623 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:47.832249 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc8f6425-9e17-4533-852c-fd1a8e483623 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Port': ['ID=871dbe29-6bf8-4e5e-9c94-5c5f5959c91f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:47.847645 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ef567e2a-c0a2-4b62-9c92-a56465cb7099 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=b45e9a5b5445462f8458c83f70bd80ba&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4045300 Dec 09 21:38:47.851860 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bc8f6425-9e17-4533-852c-fd1a8e483623 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:47.855769 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bc8f6425-9e17-4533-852c-fd1a8e483623 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/ports/871dbe29-6bf8-4e5e-9c94-5c5f5959c91f HTTP/1.1" status: 204 len: 168 time: 0.5848312 Dec 09 21:38:47.856351 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef567e2a-c0a2-4b62-9c92-a56465cb7099 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b0ee0bd3-bea6-46aa-91c6-ce2830a6faba,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:47.856646 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56830) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:47.858417 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56832) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:48.004664 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8b1789c-95e7-4e69-9b5d-9473443d0bfc tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:48.010682 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8b1789c-95e7-4e69-9b5d-9473443d0bfc tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:48.014731 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e8b1789c-95e7-4e69-9b5d-9473443d0bfc tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1450 time: 0.1463168 Dec 09 21:38:48.014731 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-927dd9e6-fd58-453d-88d6-fd6478f854ee admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:48.015709 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56838) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:48.068696 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-927dd9e6-fd58-453d-88d6-fd6478f854ee admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:48.188288 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-0e31dc55-9e26-4d23-b7ee-8e8ea1032d23 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting port 3820a638-2e79-48f6-a2bf-2df704b5c990 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:48.188777 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e31dc55-9e26-4d23-b7ee-8e8ea1032d23 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:48.218068 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-927dd9e6-fd58-453d-88d6-fd6478f854ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:48.220787 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-927dd9e6-fd58-453d-88d6-fd6478f854ee admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:48.222095 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-927dd9e6-fd58-453d-88d6-fd6478f854ee admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/b0ee0bd3-bea6-46aa-91c6-ce2830a6faba HTTP/1.1" status: 204 len: 168 time: 0.3644831 Dec 09 21:38:48.240664 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e64e582e-6d76-4f84-901b-f9b21715ef6e req-3ee02db6-cf30-4a43-b94e-a5ddfc6199db tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:48.248468 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e64e582e-6d76-4f84-901b-f9b21715ef6e req-3ee02db6-cf30-4a43-b94e-a5ddfc6199db tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 945 time: 0.1161542 Dec 09 21:38:48.304312 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927dd9e6-fd58-453d-88d6-fd6478f854ee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b0ee0bd3-bea6-46aa-91c6-ce2830a6faba,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:48.321245 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e31dc55-9e26-4d23-b7ee-8e8ea1032d23 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:48.345243 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-0e31dc55-9e26-4d23-b7ee-8e8ea1032d23 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Calling delete_port for 3820a638-2e79-48f6-a2bf-2df704b5c990 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:48.433799 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e64e582e-6d76-4f84-901b-f9b21715ef6e req-f48b8996-1933-4019-819a-af2159737f46 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=6ed93d17-f72b-4798-a8c8-e7aa9862a531&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1794319 Dec 09 21:38:48.503966 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d619847-3c15-4b50-bf49-41592cef2ec8 req-fc908449-3201-42d7-8635-ce761744212c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:48.505717 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1d619847-3c15-4b50-bf49-41592cef2ec8 req-fc908449-3201-42d7-8635-ce761744212c tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.10 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 945 time: 0.1074760 Dec 09 21:38:48.552243 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e31dc55-9e26-4d23-b7ee-8e8ea1032d23 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:48.570559 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device ae3b2bf8-8e63-4473-8cc8-206c769cc38a no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:38:48.621587 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e31dc55-9e26-4d23-b7ee-8e8ea1032d23 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Port': ['ID=3820a638-2e79-48f6-a2bf-2df704b5c990,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:48.634338 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: ae3b2bf8-8e63-4473-8cc8-206c769cc38a {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:38:48.634928 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device ae3b2bf8-8e63-4473-8cc8-206c769cc38a not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:38:48.682685 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf1abe7d-9f5a-4e48-95d4-75b32e8885bc req-8880ff04-7d9a-4789-8349-0436e90ef159 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 210 time: 0.0840387 Dec 09 21:38:48.683667 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e31dc55-9e26-4d23-b7ee-8e8ea1032d23 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:48.699980 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56862) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:48.700190 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0e31dc55-9e26-4d23-b7ee-8e8ea1032d23 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/ports/3820a638-2e79-48f6-a2bf-2df704b5c990 HTTP/1.1" status: 204 len: 168 time: 0.6825197 Dec 09 21:38:48.762501 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-1d619847-3c15-4b50-bf49-41592cef2ec8 req-1880af3e-21f3-4cc9-9962-9b5fca96519f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Deleting port d5571683-a9bc-4155-85b9-b1ef208e21e9 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:48.763731 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1d619847-3c15-4b50-bf49-41592cef2ec8 req-1880af3e-21f3-4cc9-9962-9b5fca96519f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:48.912943 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-1d619847-3c15-4b50-bf49-41592cef2ec8 req-1880af3e-21f3-4cc9-9962-9b5fca96519f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] For port d5571683-a9bc-4155-85b9-b1ef208e21e9, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=d5571683-a9bc-4155-85b9-b1ef208e21e9,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:48.913315 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1d619847-3c15-4b50-bf49-41592cef2ec8 req-1880af3e-21f3-4cc9-9962-9b5fca96519f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:48.929226 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-1d619847-3c15-4b50-bf49-41592cef2ec8 req-1880af3e-21f3-4cc9-9962-9b5fca96519f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Calling delete_port for d5571683-a9bc-4155-85b9-b1ef208e21e9 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:49.072995 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:38:49.163536 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff124b13-e222-47c8-99ed-bf68fd6eef6d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:49.165037 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ff124b13-e222-47c8-99ed-bf68fd6eef6d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 842 time: 0.4624321 Dec 09 21:38:49.166022 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1d619847-3c15-4b50-bf49-41592cef2ec8 req-1880af3e-21f3-4cc9-9962-9b5fca96519f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:49.167750 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56878) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:49.178422 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['d5571683-a9bc-4155-85b9-b1ef208e21e9'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:38:49.249518 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-32177cea-89e0-41ae-ba91-c6438e1e6dea tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] GET failed (client error): The resource could not be found. Dec 09 21:38:49.253807 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-32177cea-89e0-41ae-ba91-c6438e1e6dea tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports/871dbe29-6bf8-4e5e-9c94-5c5f5959c91f HTTP/1.1" status: 404 len: 333 time: 0.0849166 Dec 09 21:38:49.256740 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56882) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:49.259940 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1880af3e-21f3-4cc9-9962-9b5fca96519f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Pushing event deleted for resources: {'Port': ['ID=d5571683-a9bc-4155-85b9-b1ef208e21e9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:49.310394 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-e1caaddf-55b3-43b1-a7ca-5b1b501e4941 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] GET failed (client error): The resource could not be found. Dec 09 21:38:49.316407 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e1caaddf-55b3-43b1-a7ca-5b1b501e4941 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports/3820a638-2e79-48f6-a2bf-2df704b5c990 HTTP/1.1" status: 404 len: 333 time: 0.0584078 Dec 09 21:38:49.318083 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56886) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:49.424299 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-1d619847-3c15-4b50-bf49-41592cef2ec8 req-1880af3e-21f3-4cc9-9962-9b5fca96519f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] No DVR routers for this DVR port d5571683-a9bc-4155-85b9-b1ef208e21e9 on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:38:49.429873 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1d619847-3c15-4b50-bf49-41592cef2ec8 req-1880af3e-21f3-4cc9-9962-9b5fca96519f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:49.439379 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1d619847-3c15-4b50-bf49-41592cef2ec8 req-1880af3e-21f3-4cc9-9962-9b5fca96519f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.10 "DELETE /v2.0/ports/d5571683-a9bc-4155-85b9-b1ef208e21e9 HTTP/1.1" status: 204 len: 173 time: 0.9265649 Dec 09 21:38:49.443478 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '18e7aa5b-b78c-4cc4-9e5e-e407c47a414c', 'name': 'network-vif-deleted', 'tag': 'd5571683-a9bc-4155-85b9-b1ef208e21e9'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:38:49.446200 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dd728fc9-e45e-4662-bc36-82d9038961be" -d '{"events": [{"server_uuid": "18e7aa5b-b78c-4cc4-9e5e-e407c47a414c", "name": "network-vif-deleted", "tag": "d5571683-a9bc-4155-85b9-b1ef208e21e9"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:38:49.546568 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e18e15f2-a6cb-416b-a349-1e8c2dcbbb2e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:49.616360 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1422e032-9307-4732-9343-bd75ee84ab60 req-5e2d684c-6dd3-4c5f-b642-a2e4d9dbc5b0 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=18e7aa5b-b78c-4cc4-9e5e-e407c47a414c HTTP/1.1" status: 200 len: 210 time: 0.0644944 Dec 09 21:38:49.696773 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:38:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-22da36b9-43ec-4dc1-a361-af8753f50935 x-openstack-request-id: req-22da36b9-43ec-4dc1-a361-af8753f50935 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:38:49.697259 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "18e7aa5b-b78c-4cc4-9e5e-e407c47a414c", "name": "network-vif-deleted", "tag": "d5571683-a9bc-4155-85b9-b1ef208e21e9", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:38:49.697689 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-22da36b9-43ec-4dc1-a361-af8753f50935 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:38:49.698302 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '18e7aa5b-b78c-4cc4-9e5e-e407c47a414c', 'name': 'network-vif-deleted', 'tag': 'd5571683-a9bc-4155-85b9-b1ef208e21e9', 'status': 'completed', 'code': 200} Dec 09 21:38:49.783357 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e18e15f2-a6cb-416b-a349-1e8c2dcbbb2e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:49.825220 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e18e15f2-a6cb-416b-a349-1e8c2dcbbb2e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['07588d8a-7cb0-4fe2-b431-4541c61a2d54']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:49.845752 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e18e15f2-a6cb-416b-a349-1e8c2dcbbb2e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '44e9b826-fc7c-4ac0-a8f0-36a76a91ce03') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:49.846050 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e18e15f2-a6cb-416b-a349-1e8c2dcbbb2e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '44e9b826-fc7c-4ac0-a8f0-36a76a91ce03') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:49.865725 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e18e15f2-a6cb-416b-a349-1e8c2dcbbb2e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:49.904624 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e18e15f2-a6cb-416b-a349-1e8c2dcbbb2e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:49.957166 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-492166d9-81ae-492f-98c9-d62d924b3031 req-7e0ad3d5-72d7-4199-a301-e0598cc77a27 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 210 time: 0.0729055 Dec 09 21:38:49.965123 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e18e15f2-a6cb-416b-a349-1e8c2dcbbb2e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Releasing vlan 122 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:38:49.965714 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e18e15f2-a6cb-416b-a349-1e8c2dcbbb2e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:38:49.969312 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:38:50.119621 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e18e15f2-a6cb-416b-a349-1e8c2dcbbb2e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:50.127159 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e18e15f2-a6cb-416b-a349-1e8c2dcbbb2e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:50.136709 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56906) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:50.136880 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e18e15f2-a6cb-416b-a349-1e8c2dcbbb2e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/networks/07588d8a-7cb0-4fe2-b431-4541c61a2d54 HTTP/1.1" status: 204 len: 168 time: 0.8176312 Dec 09 21:38:50.146664 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-922536fd-3ce9-4f98-af2b-64cd8b197b6c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1500674887'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:38:50.149255 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e18e15f2-a6cb-416b-a349-1e8c2dcbbb2e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Network': ['ID=07588d8a-7cb0-4fe2-b431-4541c61a2d54,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:50.204088 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-922536fd-3ce9-4f98-af2b-64cd8b197b6c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:38:50.209481 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-922536fd-3ce9-4f98-af2b-64cd8b197b6c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:50.256280 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-922536fd-3ce9-4f98-af2b-64cd8b197b6c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] vlan segment allocate from pool success with {'vlan_id': 122, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:38:50.271702 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-922536fd-3ce9-4f98-af2b-64cd8b197b6c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:50.272255 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-922536fd-3ce9-4f98-af2b-64cd8b197b6c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Added segment 5cdaa101-6d30-4122-889c-c4f5b1a0f531 of type vlan for network d8df9bec-0af4-44ca-a082-80a1076dc386 Dec 09 21:38:50.344269 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-922536fd-3ce9-4f98-af2b-64cd8b197b6c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:50.398774 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-922536fd-3ce9-4f98-af2b-64cd8b197b6c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:50.413580 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-922536fd-3ce9-4f98-af2b-64cd8b197b6c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:50.426049 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-922536fd-3ce9-4f98-af2b-64cd8b197b6c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:50.503937 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56916) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:50.508650 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-922536fd-3ce9-4f98-af2b-64cd8b197b6c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.3700573 Dec 09 21:38:50.509796 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-4eba5ea2-069b-4b98-9290-989e7d682724 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'subnet': {'network_id': 'd8df9bec-0af4-44ca-a082-80a1076dc386', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'allocation_pools': [{'start': '172.20.0.2', 'end': '172.20.0.14'}]}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:38:50.516815 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-922536fd-3ce9-4f98-af2b-64cd8b197b6c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Network': ['ID=d8df9bec-0af4-44ca-a082-80a1076dc386,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:50.543991 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network d8df9bec-0af4-44ca-a082-80a1076dc386 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:38:50.817126 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4eba5ea2-069b-4b98-9290-989e7d682724 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:38:50.835503 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4eba5ea2-069b-4b98-9290-989e7d682724 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:50.993506 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.ipam_backend_mixin [None req-4eba5ea2-069b-4b98-9290-989e7d682724 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Performing IP validity checks on allocation pools {{(pid=103438) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Dec 09 21:38:50.994616 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.ipam_backend_mixin [None req-4eba5ea2-069b-4b98-9290-989e7d682724 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Checking for overlaps among allocation pools and gateway ip {{(pid=103438) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Dec 09 21:38:51.222455 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e26b2f83-ca47-4850-9d5b-f5c287df0e68 req-2cb67db0-89f6-469d-be81-ebf9c773c424 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:51.230572 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e26b2f83-ca47-4850-9d5b-f5c287df0e68 req-2cb67db0-89f6-469d-be81-ebf9c773c424 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.1464415 Dec 09 21:38:51.252019 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4eba5ea2-069b-4b98-9290-989e7d682724 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:51.333009 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e26b2f83-ca47-4850-9d5b-f5c287df0e68 req-e3accd8a-7418-4161-8aa0-f5b7193e6d53 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1015863 Dec 09 21:38:51.342084 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eba5ea2-069b-4b98-9290-989e7d682724 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Subnet': ['ID=fa911e28-17e4-4b0e-915d-a636717cbed3,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:51.373374 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4eba5ea2-069b-4b98-9290-989e7d682724 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Checking segment: {'id': '5cdaa101-6d30-4122-889c-c4f5b1a0f531', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'd8df9bec-0af4-44ca-a082-80a1076dc386'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:38:51.373748 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4eba5ea2-069b-4b98-9290-989e7d682724 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network hostable DHCP agents. Network: d8df9bec-0af4-44ca-a082-80a1076dc386, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:38:51.395592 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4eba5ea2-069b-4b98-9290-989e7d682724 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network d8df9bec-0af4-44ca-a082-80a1076dc386 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:38:51.407317 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-4eba5ea2-069b-4b98-9290-989e7d682724 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, d8df9bec-0af4-44ca-a082-80a1076dc386) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:38:51.417466 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d2e66be-8d44-4ece-90f3-6c15aed599f1 None None] Network d8df9bec-0af4-44ca-a082-80a1076dc386 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:38:51.425689 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4eba5ea2-069b-4b98-9290-989e7d682724 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:51.426774 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4eba5ea2-069b-4b98-9290-989e7d682724 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:51.469251 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4eba5ea2-069b-4b98-9290-989e7d682724 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.9640281 Dec 09 21:38:51.472076 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56946) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:51.480484 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-7efe73c1-8334-407b-8ebd-5bc6ce8c7d71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'port': {'network_id': 'd8df9bec-0af4-44ca-a082-80a1076dc386', 'name': 'tempest-PortsTestJSON-285797955'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:38:51.531654 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8fe00ff-2b9d-4922-98c1-2481f813051d req-6c5a13d1-4d3e-40ab-bd7f-8d2320568922 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 210 time: 0.0467396 Dec 09 21:38:51.662657 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c3a2353-0280-498d-bc74-52119fca1603 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-d8df9bec-0af4-44ca-a082-80a1076dc386', 'network_id': 'd8df9bec-0af4-44ca-a082-80a1076dc386', 'project_id': 'e8bdea0c320d4955bc3ba905696bda85', 'fixed_ips': [{'subnet_id': 'fa911e28-17e4-4b0e-915d-a636717cbed3'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:38:51.664238 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2c3a2353-0280-498d-bc74-52119fca1603 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:51.744328 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7efe73c1-8334-407b-8ebd-5bc6ce8c7d71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:38:51.748127 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7efe73c1-8334-407b-8ebd-5bc6ce8c7d71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:51.788676 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-7efe73c1-8334-407b-8ebd-5bc6ce8c7d71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] device_id is not set on port b2b099b6-47c7-40f6-ab2f-bbafbb503d8e yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:38:51.951453 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-2c3a2353-0280-498d-bc74-52119fca1603 None None] Allocated IP 172.20.0.2 (d8df9bec-0af4-44ca-a082-80a1076dc386/fa911e28-17e4-4b0e-915d-a636717cbed3/658e168b-f062-4ac3-9b26-295a62f92d25) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:38:52.212967 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2c3a2353-0280-498d-bc74-52119fca1603 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:52.231406 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2c3a2353-0280-498d-bc74-52119fca1603 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:52.350014 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c3a2353-0280-498d-bc74-52119fca1603 None None] Network d8df9bec-0af4-44ca-a082-80a1076dc386 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:38:52.363672 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device d5571683-a9bc-4155-85b9-b1ef208e21e9 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:38:52.365264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-7efe73c1-8334-407b-8ebd-5bc6ce8c7d71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Allocated IP 172.20.0.3 (d8df9bec-0af4-44ca-a082-80a1076dc386/fa911e28-17e4-4b0e-915d-a636717cbed3/b2b099b6-47c7-40f6-ab2f-bbafbb503d8e) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:38:52.444931 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-2c3a2353-0280-498d-bc74-52119fca1603 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:38:52.451806 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c3a2353-0280-498d-bc74-52119fca1603 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:38:52.464178 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: d5571683-a9bc-4155-85b9-b1ef208e21e9 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:38:52.470366 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device d5571683-a9bc-4155-85b9-b1ef208e21e9 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:38:52.563884 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c3a2353-0280-498d-bc74-52119fca1603 None None] Pushing event updated for resources: {'Port': ['ID=658e168b-f062-4ac3-9b26-295a62f92d25,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:52.663085 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4ccee80-9eb3-4a55-b22a-ccf858954fc7 req-a9c689a3-ca87-42dc-83a8-2571bb6793ee tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:52.666785 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e4ccee80-9eb3-4a55-b22a-ccf858954fc7 req-a9c689a3-ca87-42dc-83a8-2571bb6793ee tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.31 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.2907143 Dec 09 21:38:52.705853 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2c3a2353-0280-498d-bc74-52119fca1603 None None] Attempting to bind port 658e168b-f062-4ac3-9b26-295a62f92d25 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:38:52.706533 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2c3a2353-0280-498d-bc74-52119fca1603 None None] Attempting to bind port 658e168b-f062-4ac3-9b26-295a62f92d25 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '5cdaa101-6d30-4122-889c-c4f5b1a0f531', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'd8df9bec-0af4-44ca-a082-80a1076dc386'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:38:52.707162 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c3a2353-0280-498d-bc74-52119fca1603 None None] Attempting to bind port 658e168b-f062-4ac3-9b26-295a62f92d25 on network d8df9bec-0af4-44ca-a082-80a1076dc386 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:38:52.736189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c3a2353-0280-498d-bc74-52119fca1603 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 38, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:38:52.737762 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c3a2353-0280-498d-bc74-52119fca1603 None None] Checking segment: {'id': '5cdaa101-6d30-4122-889c-c4f5b1a0f531', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'd8df9bec-0af4-44ca-a082-80a1076dc386'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:38:52.738252 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2c3a2353-0280-498d-bc74-52119fca1603 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:52.738933 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c3a2353-0280-498d-bc74-52119fca1603 None None] Bound using segment: {'id': '5cdaa101-6d30-4122-889c-c4f5b1a0f531', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'd8df9bec-0af4-44ca-a082-80a1076dc386'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:38:52.742114 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2c3a2353-0280-498d-bc74-52119fca1603 None None] Bound port: 658e168b-f062-4ac3-9b26-295a62f92d25, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5cdaa101-6d30-4122-889c-c4f5b1a0f531', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 122, 'network_id': 'd8df9bec-0af4-44ca-a082-80a1076dc386'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:38:52.742550 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2c3a2353-0280-498d-bc74-52119fca1603 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:52.830619 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a57d88c-0ba2-465b-9565-c02def8a1a57 req-07ebf27b-3402-447d-9fb4-ebe790e4ef8e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:52.838953 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5a57d88c-0ba2-465b-9565-c02def8a1a57 req-07ebf27b-3402-447d-9fb4-ebe790e4ef8e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.3199458 Dec 09 21:38:52.900000 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2c3a2353-0280-498d-bc74-52119fca1603 None None] For port 658e168b-f062-4ac3-9b26-295a62f92d25, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:38:52.903770 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2c3a2353-0280-498d-bc74-52119fca1603 None None] For port 658e168b-f062-4ac3-9b26-295a62f92d25, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=658e168b-f062-4ac3-9b26-295a62f92d25,segment=NetworkSegment(5cdaa101-6d30-4122-889c-c4f5b1a0f531),segment_id=5cdaa101-6d30-4122-889c-c4f5b1a0f531)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:38:52.913461 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2c3a2353-0280-498d-bc74-52119fca1603 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:53.051994 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c3a2353-0280-498d-bc74-52119fca1603 None None] Pushing event updated for resources: {'Port': ['ID=658e168b-f062-4ac3-9b26-295a62f92d25,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:53.107223 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5a57d88c-0ba2-465b-9565-c02def8a1a57 req-67087bbb-9a7d-49fd-8be8-5e13270ddc8e tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2669101 Dec 09 21:38:53.181426 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7efe73c1-8334-407b-8ebd-5bc6ce8c7d71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:53.186887 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-e4ccee80-9eb3-4a55-b22a-ccf858954fc7 req-976ffd86-b4ae-45cc-9e36-3ff806f1f1d6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Deleting port 90f16e74-f2e6-416e-a079-f205615a0d8e {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:53.187221 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e4ccee80-9eb3-4a55-b22a-ccf858954fc7 req-976ffd86-b4ae-45cc-9e36-3ff806f1f1d6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:53.390938 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25e569f4-75b4-4736-bf50-f64d065972e8 req-9b05a3cc-06d8-48bd-9929-4f7f1de113d8 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 210 time: 0.0688071 Dec 09 21:38:53.470971 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-e4ccee80-9eb3-4a55-b22a-ccf858954fc7 req-976ffd86-b4ae-45cc-9e36-3ff806f1f1d6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] For port 90f16e74-f2e6-416e-a079-f205615a0d8e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=90f16e74-f2e6-416e-a079-f205615a0d8e,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:53.471809 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e4ccee80-9eb3-4a55-b22a-ccf858954fc7 req-976ffd86-b4ae-45cc-9e36-3ff806f1f1d6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:53.475930 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7efe73c1-8334-407b-8ebd-5bc6ce8c7d71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:53.533955 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7efe73c1-8334-407b-8ebd-5bc6ce8c7d71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network d8df9bec-0af4-44ca-a082-80a1076dc386 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:38:53.568451 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-7efe73c1-8334-407b-8ebd-5bc6ce8c7d71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:38:53.574724 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7efe73c1-8334-407b-8ebd-5bc6ce8c7d71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:38:53.716275 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7efe73c1-8334-407b-8ebd-5bc6ce8c7d71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Port': ['ID=b2b099b6-47c7-40f6-ab2f-bbafbb503d8e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:53.757716 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7efe73c1-8334-407b-8ebd-5bc6ce8c7d71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:53.762575 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7efe73c1-8334-407b-8ebd-5bc6ce8c7d71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:53.835927 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7efe73c1-8334-407b-8ebd-5bc6ce8c7d71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 923 time: 2.3616419 Dec 09 21:38:53.838749 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57018) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:53.952733 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e4ccee80-9eb3-4a55-b22a-ccf858954fc7 req-976ffd86-b4ae-45cc-9e36-3ff806f1f1d6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:53.954466 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e4ccee80-9eb3-4a55-b22a-ccf858954fc7 req-976ffd86-b4ae-45cc-9e36-3ff806f1f1d6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:53.954788 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [req-e4ccee80-9eb3-4a55-b22a-ccf858954fc7 req-976ffd86-b4ae-45cc-9e36-3ff806f1f1d6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Floating IP 221af2a9-94eb-44be-8e07-2d0f9a4d191b disassociated. External IP: 172.25.3.249, port: 90f16e74-f2e6-416e-a079-f205615a0d8e. Dec 09 21:38:53.955776 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-e4ccee80-9eb3-4a55-b22a-ccf858954fc7 req-976ffd86-b4ae-45cc-9e36-3ff806f1f1d6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Calling delete_port for 90f16e74-f2e6-416e-a079-f205615a0d8e owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:54.060447 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-9db78b0e-a9bd-4de3-9f08-a458f05b081a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting port b2b099b6-47c7-40f6-ab2f-bbafbb503d8e {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:54.060801 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9db78b0e-a9bd-4de3-9f08-a458f05b081a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:54.353209 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9db78b0e-a9bd-4de3-9f08-a458f05b081a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:54.385308 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-9db78b0e-a9bd-4de3-9f08-a458f05b081a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Calling delete_port for b2b099b6-47c7-40f6-ab2f-bbafbb503d8e owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:54.499431 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 658e168b-f062-4ac3-9b26-295a62f92d25 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:38:54.541603 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e4ccee80-9eb3-4a55-b22a-ccf858954fc7 req-976ffd86-b4ae-45cc-9e36-3ff806f1f1d6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:54.572418 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a98e2cd4-5d90-4627-9bcf-38c6f8b1da04 req-b3b09b57-5c8c-42ea-b0fd-8435fab5fabd tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:54.583319 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a98e2cd4-5d90-4627-9bcf-38c6f8b1da04 req-b3b09b57-5c8c-42ea-b0fd-8435fab5fabd tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 945 time: 0.2774289 Dec 09 21:38:54.650839 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 658e168b-f062-4ac3-9b26-295a62f92d25 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:38:54.651683 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:54.739879 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9db78b0e-a9bd-4de3-9f08-a458f05b081a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:54.780282 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-57179273-51f7-48b6-93d2-e43a0c9409b9 None None] Network d8df9bec-0af4-44ca-a082-80a1076dc386 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:38:54.790011 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9db78b0e-a9bd-4de3-9f08-a458f05b081a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Port': ['ID=b2b099b6-47c7-40f6-ab2f-bbafbb503d8e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:54.988186 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9db78b0e-a9bd-4de3-9f08-a458f05b081a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:55.003149 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9db78b0e-a9bd-4de3-9f08-a458f05b081a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/ports/b2b099b6-47c7-40f6-ab2f-bbafbb503d8e HTTP/1.1" status: 204 len: 168 time: 1.1626410 Dec 09 21:38:55.007898 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57042) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:55.060250 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6be7f298-e2a3-4b78-a60b-251c557a7f4b None None] Provisioning complete for port 658e168b-f062-4ac3-9b26-295a62f92d25 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:38:55.060633 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6be7f298-e2a3-4b78-a60b-251c557a7f4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:55.081709 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-f4582540-4a01-4426-8302-4cdaa332a69c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] DELETE failed (client error): The resource could not be found. Dec 09 21:38:55.087773 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f4582540-4a01-4426-8302-4cdaa332a69c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:38:55.102861 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f4582540-4a01-4426-8302-4cdaa332a69c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/ports/b2b099b6-47c7-40f6-ab2f-bbafbb503d8e HTTP/1.1" status: 404 len: 333 time: 0.0896361 Dec 09 21:38:55.108672 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57046) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:55.157267 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-fcef6056-a45c-4656-a046-cd44a969bf06 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] GET failed (client error): The resource could not be found. Dec 09 21:38:55.172045 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fcef6056-a45c-4656-a046-cd44a969bf06 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports/b2b099b6-47c7-40f6-ab2f-bbafbb503d8e HTTP/1.1" status: 404 len: 333 time: 0.0656302 Dec 09 21:38:55.172748 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57048) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:55.203342 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:55.273473 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-be6c39b6-1cc0-4220-a757-f59860688ca3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting subnet fa911e28-17e4-4b0e-915d-a636717cbed3 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:38:55.286563 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-be6c39b6-1cc0-4220-a757-f59860688ca3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:55.289742 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6be7f298-e2a3-4b78-a60b-251c557a7f4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:55.313733 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-976ffd86-b4ae-45cc-9e36-3ff806f1f1d6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Pushing event deleted for resources: {'Port': ['ID=90f16e74-f2e6-416e-a079-f205615a0d8e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:55.317769 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 658e168b-f062-4ac3-9b26-295a62f92d25, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=658e168b-f062-4ac3-9b26-295a62f92d25,segment=NetworkSegment(5cdaa101-6d30-4122-889c-c4f5b1a0f531),segment_id=5cdaa101-6d30-4122-889c-c4f5b1a0f531)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:55.356922 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:55.425723 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-be6c39b6-1cc0-4220-a757-f59860688ca3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:55.437771 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=658e168b-f062-4ac3-9b26-295a62f92d25,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:55.504874 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-6be7f298-e2a3-4b78-a60b-251c557a7f4b None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:38:55.505537 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-6be7f298-e2a3-4b78-a60b-251c557a7f4b None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:38:55.616273 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-be6c39b6-1cc0-4220-a757-f59860688ca3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:55.657622 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a98e2cd4-5d90-4627-9bcf-38c6f8b1da04 req-d431ea4b-571b-4c0c-95d0-3a9e8c494fd3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups?id=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 1.0719576 Dec 09 21:38:55.749995 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [req-e4ccee80-9eb3-4a55-b22a-ccf858954fc7 req-976ffd86-b4ae-45cc-9e36-3ff806f1f1d6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Router 1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:38:55.865770 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-be6c39b6-1cc0-4220-a757-f59860688ca3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:55.896950 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-be6c39b6-1cc0-4220-a757-f59860688ca3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:55.932132 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-be6c39b6-1cc0-4220-a757-f59860688ca3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/subnets/fa911e28-17e4-4b0e-915d-a636717cbed3 HTTP/1.1" status: 204 len: 168 time: 0.7582917 Dec 09 21:38:55.953693 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57060) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:55.957389 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dcd332f3-93ba-467c-a493-7cc181673096 None None] Network d8df9bec-0af4-44ca-a082-80a1076dc386 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:38:55.985188 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be6c39b6-1cc0-4220-a757-f59860688ca3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Subnet': ['ID=fa911e28-17e4-4b0e-915d-a636717cbed3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:56.162874 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20526f3f-d8c7-41bc-940d-07824c3aacad req-e81a82ee-f126-49b0-bcf6-356154930db1 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 210 time: 0.3616998 Dec 09 21:38:56.386868 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-685ce6f4-792e-49a8-9905-a4aed6bd8831 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:56.413546 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-52fd268c-ecbb-47bf-9de6-0577f601e982 None None] Could not find standard attr ID for object b2b099b6-47c7-40f6-ab2f-bbafbb503d8e. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:38:56.420301 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-e4ccee80-9eb3-4a55-b22a-ccf858954fc7 req-976ffd86-b4ae-45cc-9e36-3ff806f1f1d6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:38:56.442763 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75a8d47b-8619-49b1-a513-64db52457c33 None None] Sync routers for ids ['1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:38:56.459860 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eec4e5a4-0e52-4539-abdb-762a727256e6 None None] DHCP port deletion for d8df9bec-0af4-44ca-a082-80a1076dc386 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:38:56.484305 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-52fd268c-ecbb-47bf-9de6-0577f601e982 None None] Provisioning complete for port 658e168b-f062-4ac3-9b26-295a62f92d25 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:38:56.496073 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-52fd268c-ecbb-47bf-9de6-0577f601e982 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:56.574734 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-e4ccee80-9eb3-4a55-b22a-ccf858954fc7 req-976ffd86-b4ae-45cc-9e36-3ff806f1f1d6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] No DVR routers for this DVR port 90f16e74-f2e6-416e-a079-f205615a0d8e on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:38:56.578125 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-e4ccee80-9eb3-4a55-b22a-ccf858954fc7 req-976ffd86-b4ae-45cc-9e36-3ff806f1f1d6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:56.581650 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e4ccee80-9eb3-4a55-b22a-ccf858954fc7 req-976ffd86-b4ae-45cc-9e36-3ff806f1f1d6 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.31 "DELETE /v2.0/ports/90f16e74-f2e6-416e-a079-f205615a0d8e HTTP/1.1" status: 204 len: 173 time: 3.9031904 Dec 09 21:38:56.582098 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7ef6883d-9c98-4e81-b102-bc1197ac4a47', 'name': 'network-vif-deleted', 'tag': '90f16e74-f2e6-416e-a079-f205615a0d8e'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:38:56.588629 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2c19bd88-6aa5-4981-b512-596eb6e111bf" -d '{"events": [{"server_uuid": "7ef6883d-9c98-4e81-b102-bc1197ac4a47", "name": "network-vif-deleted", "tag": "90f16e74-f2e6-416e-a079-f205615a0d8e"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:38:56.601787 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75a8d47b-8619-49b1-a513-64db52457c33 None None] Routers {'1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:38:56.602425 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-75a8d47b-8619-49b1-a513-64db52457c33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:38:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:56.621861 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 90f16e74-f2e6-416e-a079-f205615a0d8e no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:38:56.635946 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-685ce6f4-792e-49a8-9905-a4aed6bd8831 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting port 658e168b-f062-4ac3-9b26-295a62f92d25 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:56.636278 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-685ce6f4-792e-49a8-9905-a4aed6bd8831 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:56.671398 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:38:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4ee89357-4c49-47c7-bf00-d89826664e7b x-openstack-request-id: req-4ee89357-4c49-47c7-bf00-d89826664e7b {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:38:56.671729 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7ef6883d-9c98-4e81-b102-bc1197ac4a47", "name": "network-vif-deleted", "tag": "90f16e74-f2e6-416e-a079-f205615a0d8e", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:38:56.672007 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-4ee89357-4c49-47c7-bf00-d89826664e7b {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:38:56.672398 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7ef6883d-9c98-4e81-b102-bc1197ac4a47', 'name': 'network-vif-deleted', 'tag': '90f16e74-f2e6-416e-a079-f205615a0d8e', 'status': 'completed', 'code': 200} Dec 09 21:38:56.720780 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 90f16e74-f2e6-416e-a079-f205615a0d8e {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:38:56.721137 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 90f16e74-f2e6-416e-a079-f205615a0d8e not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:38:56.833214 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-eec4e5a4-0e52-4539-abdb-762a727256e6 None None] Deleting port 658e168b-f062-4ac3-9b26-295a62f92d25 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:56.833324 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eec4e5a4-0e52-4539-abdb-762a727256e6 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:56.872133 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-685ce6f4-792e-49a8-9905-a4aed6bd8831 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] For port 658e168b-f062-4ac3-9b26-295a62f92d25, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=658e168b-f062-4ac3-9b26-295a62f92d25,segment=NetworkSegment(5cdaa101-6d30-4122-889c-c4f5b1a0f531),segment_id=5cdaa101-6d30-4122-889c-c4f5b1a0f531)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:56.872493 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-685ce6f4-792e-49a8-9905-a4aed6bd8831 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:56.907941 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-685ce6f4-792e-49a8-9905-a4aed6bd8831 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Calling delete_port for 658e168b-f062-4ac3-9b26-295a62f92d25 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:56.931502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-75a8d47b-8619-49b1-a513-64db52457c33 None None] Set router 1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:38:56.981780 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-eec4e5a4-0e52-4539-abdb-762a727256e6 None None] For port 658e168b-f062-4ac3-9b26-295a62f92d25, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=658e168b-f062-4ac3-9b26-295a62f92d25,segment=NetworkSegment(5cdaa101-6d30-4122-889c-c4f5b1a0f531),segment_id=5cdaa101-6d30-4122-889c-c4f5b1a0f531)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:38:56.982184 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eec4e5a4-0e52-4539-abdb-762a727256e6 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:57.003062 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-eec4e5a4-0e52-4539-abdb-762a727256e6 None None] Calling delete_port for 658e168b-f062-4ac3-9b26-295a62f92d25 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:57.057855 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-685ce6f4-792e-49a8-9905-a4aed6bd8831 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:57.124530 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d58371e2-68c1-4966-bf2a-f5049109a2b7 req-e83ca6fe-c5c9-4cbb-8405-86e6b9edd03f tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/ports?device_id=7ef6883d-9c98-4e81-b102-bc1197ac4a47 HTTP/1.1" status: 200 len: 210 time: 0.0859048 Dec 09 21:38:57.189576 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-685ce6f4-792e-49a8-9905-a4aed6bd8831 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Port': ['ID=658e168b-f062-4ac3-9b26-295a62f92d25,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:57.202191 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-685ce6f4-792e-49a8-9905-a4aed6bd8831 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] No DVR routers for this DVR port 658e168b-f062-4ac3-9b26-295a62f92d25 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:38:57.401095 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-685ce6f4-792e-49a8-9905-a4aed6bd8831 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:57.410808 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:57.414767 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:57.518751 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-685ce6f4-792e-49a8-9905-a4aed6bd8831 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d8df9bec-0af4-44ca-a082-80a1076dc386']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:57.620296 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-685ce6f4-792e-49a8-9905-a4aed6bd8831 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5cdaa101-6d30-4122-889c-c4f5b1a0f531') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:57.620506 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-685ce6f4-792e-49a8-9905-a4aed6bd8831 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5cdaa101-6d30-4122-889c-c4f5b1a0f531') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:57.663592 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-685ce6f4-792e-49a8-9905-a4aed6bd8831 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:57.714081 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-685ce6f4-792e-49a8-9905-a4aed6bd8831 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:57.725304 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-685ce6f4-792e-49a8-9905-a4aed6bd8831 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Releasing vlan 122 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:38:57.725966 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-685ce6f4-792e-49a8-9905-a4aed6bd8831 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:38:57.802927 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:38:57.817266 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8556d9cc-050f-45b2-b659-3876495df784 req-579685cd-06dc-4c16-aeeb-3c03f9f29a8d tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 210 time: 0.3618505 Dec 09 21:38:57.824613 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-685ce6f4-792e-49a8-9905-a4aed6bd8831 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:57.845069 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-685ce6f4-792e-49a8-9905-a4aed6bd8831 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:57.852514 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-685ce6f4-792e-49a8-9905-a4aed6bd8831 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/networks/d8df9bec-0af4-44ca-a082-80a1076dc386 HTTP/1.1" status: 204 len: 168 time: 1.8304429 Dec 09 21:38:57.854519 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57106) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:57.863869 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-2079175764'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:38:57.947545 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-685ce6f4-792e-49a8-9905-a4aed6bd8831 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Network': ['ID=d8df9bec-0af4-44ca-a082-80a1076dc386,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:57.952628 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:38:57.986533 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:58.032062 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eec4e5a4-0e52-4539-abdb-762a727256e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:58.048430 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] vlan segment allocate from pool success with {'vlan_id': 111, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:38:58.058477 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-eec4e5a4-0e52-4539-abdb-762a727256e6 None None] Network d8df9bec-0af4-44ca-a082-80a1076dc386 is not hosted by any dhcp agent {{(pid=103439) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 09 21:38:58.072001 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:58.072482 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eec4e5a4-0e52-4539-abdb-762a727256e6 None None] No DVR routers for this DVR port 658e168b-f062-4ac3-9b26-295a62f92d25 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:38:58.072984 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Added segment 48c3ca64-0aa3-4478-bfbf-ce89b684e6d5 of type vlan for network 50569dc8-e38b-459d-a118-74171d689fb2 Dec 09 21:38:58.126869 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eec4e5a4-0e52-4539-abdb-762a727256e6 None None] Pushing event deleted for resources: {'Port': ['ID=658e168b-f062-4ac3-9b26-295a62f92d25,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:58.168851 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-75a8d47b-8619-49b1-a513-64db52457c33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'name': 'tempest-ServerActionsTestJSON-1559985225-router', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242'}], 'enable_snat': True}, 'gw_port_id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:29:30Z', 'updated_at': '2021-12-09T21:29:37Z', 'revision_number': 4, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'gw_port': {'id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:d4:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1299, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:29:31Z', 'updated_at': '2021-12-09T21:29:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '1ab9d8fe-6942-4722-90aa-1232fb6aab84', 'name': '', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'mac_address': 'fa:16:3e:3c:b2:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'device_owner': 'network:router_interface', 'standard_attr_id': 1300, 'fixed_ips': [{'subnet_id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:29:36Z', 'updated_at': '2021-12-09T21:29:41Z', 'revision_number': 5, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'subnets': [{'id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:58.242430 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75a8d47b-8619-49b1-a513-64db52457c33 None None] Checking router: 1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:38:58.253044 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:58.292617 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75a8d47b-8619-49b1-a513-64db52457c33 None None] Routers {'1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:38:58.293416 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-75a8d47b-8619-49b1-a513-64db52457c33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:38:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:58.301571 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57118) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:58.337685 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:58.356486 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:38:58.360727 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:58.466127 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 658e168b-f062-4ac3-9b26-295a62f92d25 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:38:58.466666 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0eea78f7-8170-4ddc-8a30-d49c356422ff tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:58.504425 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Network': ['ID=50569dc8-e38b-459d-a118-74171d689fb2,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:58.517185 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:58.517769 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:58.518279 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:58.519995 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:58.520952 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:58.521428 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:58.522018 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:58.522902 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:58.523453 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:58.524005 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:58.524963 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:58.525485 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:58.525949 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:38:58.547060 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-62da3cde-4b11-49d1-89f0-93661141ed81 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.6906440 Dec 09 21:38:58.549207 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0eea78f7-8170-4ddc-8a30-d49c356422ff tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:58.550952 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57122) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:58.563225 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-fa98aad7-8820-4cab-a31e-a8071cc3016e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'subnet': {'network_id': '50569dc8-e38b-459d-a118-74171d689fb2', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:38:58.651199 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 50569dc8-e38b-459d-a118-74171d689fb2 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:38:58.669330 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0eea78f7-8170-4ddc-8a30-d49c356422ff tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:58.673100 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 658e168b-f062-4ac3-9b26-295a62f92d25 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:38:58.675053 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 658e168b-f062-4ac3-9b26-295a62f92d25 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:38:58.680174 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0eea78f7-8170-4ddc-8a30-d49c356422ff tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:58.682627 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0eea78f7-8170-4ddc-8a30-d49c356422ff tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "DELETE /v2.0/security-groups/8af3855c-aec1-4d4b-9b6b-aa6f0a87db66 HTTP/1.1" status: 204 len: 168 time: 0.3785043 Dec 09 21:38:58.710939 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57124) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:58.717439 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0eea78f7-8170-4ddc-8a30-d49c356422ff tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8af3855c-aec1-4d4b-9b6b-aa6f0a87db66,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:58.758257 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-e21c4b42-427d-46db-8e65-993025f843f4 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] show failed (client error): The resource could not be found. Dec 09 21:38:58.759371 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e21c4b42-427d-46db-8e65-993025f843f4 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "GET /v2.0/security-groups/8af3855c-aec1-4d4b-9b6b-aa6f0a87db66 HTTP/1.1" status: 404 len: 347 time: 0.0351279 Dec 09 21:38:58.764136 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57130) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:58.838725 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fa98aad7-8820-4cab-a31e-a8071cc3016e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:38:58.843842 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fa98aad7-8820-4cab-a31e-a8071cc3016e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:59.029809 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-75a8d47b-8619-49b1-a513-64db52457c33 None None] Set router 1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:38:59.068677 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d211240-10a7-4370-a9cf-d0831d61e9ea req-f8c14ff6-c02c-460c-8399-152aa517ca67 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 210 time: 0.0516498 Dec 09 21:38:59.144416 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-ee7941d0-4ab6-4f7a-81d7-07d9bc89ba58 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Deleting port 3db534ad-6c5d-4da2-b2a6-16ff51de3d1e {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:38:59.146164 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee7941d0-4ab6-4f7a-81d7-07d9bc89ba58 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:59.167900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57142) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:38:59.426418 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee7941d0-4ab6-4f7a-81d7-07d9bc89ba58 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:59.426905 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee7941d0-4ab6-4f7a-81d7-07d9bc89ba58 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:59.440096 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-ee7941d0-4ab6-4f7a-81d7-07d9bc89ba58 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Calling delete_port for 3db534ad-6c5d-4da2-b2a6-16ff51de3d1e owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:38:59.498168 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-75a8d47b-8619-49b1-a513-64db52457c33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'name': 'tempest-ServerActionsTestJSON-1559985225-router', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242'}], 'enable_snat': True}, 'gw_port_id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:29:30Z', 'updated_at': '2021-12-09T21:29:37Z', 'revision_number': 4, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'gw_port': {'id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:d4:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1299, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:29:31Z', 'updated_at': '2021-12-09T21:29:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '1ab9d8fe-6942-4722-90aa-1232fb6aab84', 'name': '', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'mac_address': 'fa:16:3e:3c:b2:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'device_owner': 'network:router_interface', 'standard_attr_id': 1300, 'fixed_ips': [{'subnet_id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:29:36Z', 'updated_at': '2021-12-09T21:29:41Z', 'revision_number': 5, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'subnets': [{'id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:38:59.530116 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75a8d47b-8619-49b1-a513-64db52457c33 None None] The sync data for ids ['1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'] in n-d-713301-27 is: [{'id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'name': 'tempest-ServerActionsTestJSON-1559985225-router', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242'}], 'enable_snat': True}, 'gw_port_id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:29:30Z', 'updated_at': '2021-12-09T21:29:37Z', 'revision_number': 4, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'gw_port': {'id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:d4:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1299, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:29:31Z', 'updated_at': '2021-12-09T21:29:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '1ab9d8fe-6942-4722-90aa-1232fb6aab84', 'name': '', 'network_id': '2c03082f-742a-4ae3-9d23-6178c7ff2a0a', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'mac_address': 'fa:16:3e:3c:b2:ae', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'device_owner': 'network:router_interface', 'standard_attr_id': 1300, 'fixed_ips': [{'subnet_id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:29:36Z', 'updated_at': '2021-12-09T21:29:41Z', 'revision_number': 5, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'subnets': [{'id': 'd776263b-6b97-44cc-bef5-299b9262dfec', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:38:59.559650 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fa98aad7-8820-4cab-a31e-a8071cc3016e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:59.772508 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee7941d0-4ab6-4f7a-81d7-07d9bc89ba58 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:38:59.852834 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee7941d0-4ab6-4f7a-81d7-07d9bc89ba58 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Pushing event deleted for resources: {'Port': ['ID=3db534ad-6c5d-4da2-b2a6-16ff51de3d1e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:38:59.889373 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19d6e3e6-f179-447a-a3dd-4e79b639c671 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:39:00.036467 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa98aad7-8820-4cab-a31e-a8071cc3016e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Subnet': ['ID=1fe0f923-b8b9-49c1-9996-cc0ec9bb1eb8,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:00.067060 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee7941d0-4ab6-4f7a-81d7-07d9bc89ba58 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:00.076357 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee7941d0-4ab6-4f7a-81d7-07d9bc89ba58 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:00.077611 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ee7941d0-4ab6-4f7a-81d7-07d9bc89ba58 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] 10.222.0.13 "DELETE /v2.0/floatingips/221af2a9-94eb-44be-8e07-2d0f9a4d191b HTTP/1.1" status: 204 len: 168 time: 1.3124702 Dec 09 21:39:00.080628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57164) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:00.153923 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f70a630-4493-4de7-8bc1-436cc6f263d3 None None] New status for floating IP 221af2a9-94eb-44be-8e07-2d0f9a4d191b: DOWN {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:39:00.403563 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa98aad7-8820-4cab-a31e-a8071cc3016e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Checking segment: {'id': '48c3ca64-0aa3-4478-bfbf-ce89b684e6d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '50569dc8-e38b-459d-a118-74171d689fb2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:39:00.404090 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fa98aad7-8820-4cab-a31e-a8071cc3016e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network hostable DHCP agents. Network: 50569dc8-e38b-459d-a118-74171d689fb2, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:39:00.460113 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fa98aad7-8820-4cab-a31e-a8071cc3016e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network 50569dc8-e38b-459d-a118-74171d689fb2 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:39:00.463502 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09743d01-6f27-4a80-9ed3-850aee5dfb81 req-792d4d29-d7bf-45ec-a7b3-028e3534def2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 210 time: 0.1729524 Dec 09 21:39:00.496035 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-fa98aad7-8820-4cab-a31e-a8071cc3016e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 50569dc8-e38b-459d-a118-74171d689fb2) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:00.501922 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa98aad7-8820-4cab-a31e-a8071cc3016e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:00.502564 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fa98aad7-8820-4cab-a31e-a8071cc3016e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:00.513280 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f08ab771-1afd-4967-8132-b0093f42870b None None] Network 50569dc8-e38b-459d-a118-74171d689fb2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:00.564738 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fa98aad7-8820-4cab-a31e-a8071cc3016e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.0100858 Dec 09 21:39:00.565868 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57174) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:00.578485 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-8899b87f-9cee-48de-bc5c-274c84ea172f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'port': {'network_id': '50569dc8-e38b-459d-a118-74171d689fb2', 'security_groups': [], 'name': 'tempest-PortsTestJSON-182562942'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:00.756886 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-689d4477-9b24-4075-894e-eeb9a2e29e1c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-50569dc8-e38b-459d-a118-74171d689fb2', 'network_id': '50569dc8-e38b-459d-a118-74171d689fb2', 'project_id': 'e8bdea0c320d4955bc3ba905696bda85', 'fixed_ips': [{'subnet_id': '1fe0f923-b8b9-49c1-9996-cc0ec9bb1eb8'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:39:00.761614 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-689d4477-9b24-4075-894e-eeb9a2e29e1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:00.882410 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a653e124-3f1e-4d5f-ab77-2ebc6c46d954 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:01.181584 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:01.199273 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8899b87f-9cee-48de-bc5c-274c84ea172f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:01.213224 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8899b87f-9cee-48de-bc5c-274c84ea172f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:01.237680 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-689d4477-9b24-4075-894e-eeb9a2e29e1c None None] Allocated IP 172.20.0.2 (50569dc8-e38b-459d-a118-74171d689fb2/1fe0f923-b8b9-49c1-9996-cc0ec9bb1eb8/593841d3-b83c-4989-b6ec-1d6293d3b20e) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:39:01.347030 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-8899b87f-9cee-48de-bc5c-274c84ea172f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] device_id is not set on port 5aa5d381-6511-4f20-a7a1-82d3d1a3af61 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:39:01.497638 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-689d4477-9b24-4075-894e-eeb9a2e29e1c None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:01.517636 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-689d4477-9b24-4075-894e-eeb9a2e29e1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:01.568561 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-689d4477-9b24-4075-894e-eeb9a2e29e1c None None] Network 50569dc8-e38b-459d-a118-74171d689fb2 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:39:01.579037 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-689d4477-9b24-4075-894e-eeb9a2e29e1c None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:01.587095 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-689d4477-9b24-4075-894e-eeb9a2e29e1c None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:39:01.687675 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-8899b87f-9cee-48de-bc5c-274c84ea172f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Allocated IP 172.20.0.10 (50569dc8-e38b-459d-a118-74171d689fb2/1fe0f923-b8b9-49c1-9996-cc0ec9bb1eb8/5aa5d381-6511-4f20-a7a1-82d3d1a3af61) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:39:01.713919 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d90714c0-4c2d-4859-954e-0d4fd8bc1a7f req-aa5b95e0-1ce6-4926-9b37-34ec22309405 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 210 time: 0.0625217 Dec 09 21:39:01.774121 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] Deleting port 1ab9d8fe-6942-4722-90aa-1232fb6aab84 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:01.774501 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:01.813084 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-689d4477-9b24-4075-894e-eeb9a2e29e1c None None] Attempting to bind port 593841d3-b83c-4989-b6ec-1d6293d3b20e on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:39:01.813523 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-689d4477-9b24-4075-894e-eeb9a2e29e1c None None] Attempting to bind port 593841d3-b83c-4989-b6ec-1d6293d3b20e by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '48c3ca64-0aa3-4478-bfbf-ce89b684e6d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '50569dc8-e38b-459d-a118-74171d689fb2'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:39:01.813894 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-689d4477-9b24-4075-894e-eeb9a2e29e1c None None] Attempting to bind port 593841d3-b83c-4989-b6ec-1d6293d3b20e on network 50569dc8-e38b-459d-a118-74171d689fb2 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:39:01.843906 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-689d4477-9b24-4075-894e-eeb9a2e29e1c None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 38, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:39:01.844300 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-689d4477-9b24-4075-894e-eeb9a2e29e1c None None] Checking segment: {'id': '48c3ca64-0aa3-4478-bfbf-ce89b684e6d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '50569dc8-e38b-459d-a118-74171d689fb2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:39:01.844681 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-689d4477-9b24-4075-894e-eeb9a2e29e1c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:01.845073 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-689d4477-9b24-4075-894e-eeb9a2e29e1c None None] Bound using segment: {'id': '48c3ca64-0aa3-4478-bfbf-ce89b684e6d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '50569dc8-e38b-459d-a118-74171d689fb2'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:39:01.845544 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-689d4477-9b24-4075-894e-eeb9a2e29e1c None None] Bound port: 593841d3-b83c-4989-b6ec-1d6293d3b20e, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '48c3ca64-0aa3-4478-bfbf-ce89b684e6d5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '50569dc8-e38b-459d-a118-74171d689fb2'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:39:01.845923 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-689d4477-9b24-4075-894e-eeb9a2e29e1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:01.931873 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] For port 1ab9d8fe-6942-4722-90aa-1232fb6aab84, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=1ab9d8fe-6942-4722-90aa-1232fb6aab84,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:01.932234 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:01.973329 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] Calling delete_port for 1ab9d8fe-6942-4722-90aa-1232fb6aab84 owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:02.007661 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8899b87f-9cee-48de-bc5c-274c84ea172f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:02.010008 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-689d4477-9b24-4075-894e-eeb9a2e29e1c None None] For port 593841d3-b83c-4989-b6ec-1d6293d3b20e, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:39:02.016314 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-689d4477-9b24-4075-894e-eeb9a2e29e1c None None] For port 593841d3-b83c-4989-b6ec-1d6293d3b20e, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=593841d3-b83c-4989-b6ec-1d6293d3b20e,segment=NetworkSegment(48c3ca64-0aa3-4478-bfbf-ce89b684e6d5),segment_id=48c3ca64-0aa3-4478-bfbf-ce89b684e6d5)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:39:02.024135 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-689d4477-9b24-4075-894e-eeb9a2e29e1c None None] Pushing event updated for resources: {'Port': ['ID=593841d3-b83c-4989-b6ec-1d6293d3b20e,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:02.034783 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-689d4477-9b24-4075-894e-eeb9a2e29e1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:02.182588 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-689d4477-9b24-4075-894e-eeb9a2e29e1c None None] Pushing event updated for resources: {'Port': ['ID=593841d3-b83c-4989-b6ec-1d6293d3b20e,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:02.190564 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8899b87f-9cee-48de-bc5c-274c84ea172f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:02.288458 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8899b87f-9cee-48de-bc5c-274c84ea172f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Port': ['ID=5aa5d381-6511-4f20-a7a1-82d3d1a3af61,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:02.306550 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8899b87f-9cee-48de-bc5c-274c84ea172f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network 50569dc8-e38b-459d-a118-74171d689fb2 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:39:02.363690 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-8899b87f-9cee-48de-bc5c-274c84ea172f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:02.367112 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8899b87f-9cee-48de-bc5c-274c84ea172f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:39:02.417412 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:02.464834 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8899b87f-9cee-48de-bc5c-274c84ea172f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:02.465767 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8899b87f-9cee-48de-bc5c-274c84ea172f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:02.509361 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] Pushing event deleted for resources: {'Port': ['ID=1ab9d8fe-6942-4722-90aa-1232fb6aab84,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:02.516299 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8899b87f-9cee-48de-bc5c-274c84ea172f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 886 time: 1.9483302 Dec 09 21:39:02.519248 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:02.519375 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57202) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:02.519698 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:02.520146 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:02.521538 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:02.521538 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:02.521859 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:02.522181 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:02.522820 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:02.523173 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:02.523517 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:02.523842 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:02.524376 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:02.524697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:02.533441 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-a653e124-3f1e-4d5f-ab77-2ebc6c46d954 admin admin] Deleting port 07784993-5ed4-492f-8151-3e60e91832c1 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:02.534773 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a653e124-3f1e-4d5f-ab77-2ebc6c46d954 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:02.958203 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-13d220d4-ce0e-459b-857b-131f71c0cf9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:03.037390 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d4bbd4c8-6c0c-454f-953c-af2cd0ac870c req-9446f4df-8d0c-42f5-9105-739f0b504833 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 210 time: 0.0602653 Dec 09 21:39:03.085064 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:03.388642 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-a653e124-3f1e-4d5f-ab77-2ebc6c46d954 admin admin] For port 07784993-5ed4-492f-8151-3e60e91832c1, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=07784993-5ed4-492f-8151-3e60e91832c1,segment=NetworkSegment(f5a54e61-4fb1-4afa-9a27-98e2163b0365),segment_id=f5a54e61-4fb1-4afa-9a27-98e2163b0365)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:03.389206 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a653e124-3f1e-4d5f-ab77-2ebc6c46d954 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:03.438681 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-a653e124-3f1e-4d5f-ab77-2ebc6c46d954 admin admin] Calling delete_port for 07784993-5ed4-492f-8151-3e60e91832c1 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:03.469700 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-31f3fe5e-4819-4ace-b252-1f96d3efdd2c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting port 5aa5d381-6511-4f20-a7a1-82d3d1a3af61 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:03.470232 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31f3fe5e-4819-4ace-b252-1f96d3efdd2c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:03.500156 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] Router 1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:39:03.607117 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31f3fe5e-4819-4ace-b252-1f96d3efdd2c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:03.634847 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-31f3fe5e-4819-4ace-b252-1f96d3efdd2c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Calling delete_port for 5aa5d381-6511-4f20-a7a1-82d3d1a3af61 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:03.734625 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:39:03.750653 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87537dfb-19c6-43b4-a105-7262e9bfc0dc None None] Sync routers for ids ['1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:39:03.752346 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e38d61f9-62ea-4b3e-b7c8-9a9591f0ecc2 admin admin] 10.222.0.13 "PUT /v2.0/routers/1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.6705697 Dec 09 21:39:03.753169 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57226) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:03.772904 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87537dfb-19c6-43b4-a105-7262e9bfc0dc None None] Routers {'1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:39:03.774108 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-87537dfb-19c6-43b4-a105-7262e9bfc0dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:38:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:03.981174 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31f3fe5e-4819-4ace-b252-1f96d3efdd2c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:04.031403 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-87537dfb-19c6-43b4-a105-7262e9bfc0dc None None] Set router 1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:39:04.076433 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31f3fe5e-4819-4ace-b252-1f96d3efdd2c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Port': ['ID=5aa5d381-6511-4f20-a7a1-82d3d1a3af61,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:04.107815 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57232) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:04.127284 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3bd80754-7b14-4376-8ce5-8c09600b56c3 admin admin] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:04.236612 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-338acff9-96f8-4ce2-b91f-f24a70f9d397 None None] Network 50569dc8-e38b-459d-a118-74171d689fb2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:04.254841 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31f3fe5e-4819-4ace-b252-1f96d3efdd2c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:04.257885 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57236) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:04.262865 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-31f3fe5e-4819-4ace-b252-1f96d3efdd2c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/ports/5aa5d381-6511-4f20-a7a1-82d3d1a3af61 HTTP/1.1" status: 204 len: 168 time: 1.7402711 Dec 09 21:39:04.266101 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57240) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:04.589017 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a653e124-3f1e-4d5f-ab77-2ebc6c46d954 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:04.725132 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8a193761-29e9-4002-b148-9f2dd27d9fd8 None None] Provisioning complete for port 593841d3-b83c-4989-b6ec-1d6293d3b20e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:04.726110 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8a193761-29e9-4002-b148-9f2dd27d9fd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:04.747995 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 593841d3-b83c-4989-b6ec-1d6293d3b20e up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:39:05.016673 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a653e124-3f1e-4d5f-ab77-2ebc6c46d954 admin admin] Pushing event deleted for resources: {'Port': ['ID=07784993-5ed4-492f-8151-3e60e91832c1,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:05.050147 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77ad1510-0bd6-4469-8c57-e681a3386243 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:05.186685 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 593841d3-b83c-4989-b6ec-1d6293d3b20e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:05.187287 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:05.195985 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af165e35-483a-4eb3-8251-fec2bea9db67 req-8a36e1e7-4373-4b5f-8bf3-25d40314f0e5 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 210 time: 0.9349897 Dec 09 21:39:05.199478 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-c76568e2-dd9e-44a3-af2c-f758b58ea307 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] GET failed (client error): The resource could not be found. Dec 09 21:39:05.205493 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c76568e2-dd9e-44a3-af2c-f758b58ea307 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports/5aa5d381-6511-4f20-a7a1-82d3d1a3af61 HTTP/1.1" status: 404 len: 333 time: 0.9163694 Dec 09 21:39:05.222760 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57248) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:05.249795 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-87537dfb-19c6-43b4-a105-7262e9bfc0dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'name': 'tempest-ServerActionsTestJSON-1559985225-router', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242'}], 'enable_snat': True}, 'gw_port_id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:29:30Z', 'updated_at': '2021-12-09T21:39:02Z', 'revision_number': 5, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'gw_port': {'id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:d4:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1299, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:29:31Z', 'updated_at': '2021-12-09T21:29:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:05.303050 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8a193761-29e9-4002-b148-9f2dd27d9fd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:05.325519 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77ad1510-0bd6-4469-8c57-e681a3386243 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:05.334412 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77ad1510-0bd6-4469-8c57-e681a3386243 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:05.349437 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87537dfb-19c6-43b4-a105-7262e9bfc0dc None None] Checking router: 1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:39:05.412736 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87537dfb-19c6-43b4-a105-7262e9bfc0dc None None] Routers {'1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:39:05.413503 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-87537dfb-19c6-43b4-a105-7262e9bfc0dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:38:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:05.442701 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-aacfe5ca-a0ba-43eb-8834-fbb758ed85e5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:05.542863 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-97a8bcc8-f17f-426e-9f20-81ddeecad358 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting subnet 1fe0f923-b8b9-49c1-9996-cc0ec9bb1eb8 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:39:05.582430 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-77ad1510-0bd6-4469-8c57-e681a3386243 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=8bff8587c366402c96f577e25c06c064&name=default HTTP/1.1" status: 200 len: 3000 time: 1.4722795 Dec 09 21:39:05.594563 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57252) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:05.601972 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77ad1510-0bd6-4469-8c57-e681a3386243 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ee67d3e5-bff0-484e-b5c2-346c36279554,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:05.628339 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a653e124-3f1e-4d5f-ab77-2ebc6c46d954 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:05.640176 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-97a8bcc8-f17f-426e-9f20-81ddeecad358 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:05.699460 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-97a8bcc8-f17f-426e-9f20-81ddeecad358 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:05.868147 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:05.869211 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3bd80754-7b14-4376-8ce5-8c09600b56c3 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:05.995781 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bfd3662d-a322-49c8-99b1-35aff4d81c14 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:06.037940 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bfd3662d-a322-49c8-99b1-35aff4d81c14 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:06.095246 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-87537dfb-19c6-43b4-a105-7262e9bfc0dc None None] Set router 1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:39:06.150870 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-aacfe5ca-a0ba-43eb-8834-fbb758ed85e5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:06.174505 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-aacfe5ca-a0ba-43eb-8834-fbb758ed85e5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:06.185879 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a653e124-3f1e-4d5f-ab77-2ebc6c46d954 admin admin] Router f2b3fc08-9e60-4600-9a8b-7400a9e940a0 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:39:06.198703 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-3bd80754-7b14-4376-8ce5-8c09600b56c3 admin admin] Deleting port 0bf80ece-82d7-4c64-8066-ef5107ea9e0d {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:06.199268 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3bd80754-7b14-4376-8ce5-8c09600b56c3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:06.250104 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aacfe5ca-a0ba-43eb-8834-fbb758ed85e5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=93aabe4e-1024-46c0-a9c1-798787878f47,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:06.271840 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-8a193761-29e9-4002-b148-9f2dd27d9fd8 None None] For port 593841d3-b83c-4989-b6ec-1d6293d3b20e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=593841d3-b83c-4989-b6ec-1d6293d3b20e,segment=NetworkSegment(48c3ca64-0aa3-4478-bfbf-ce89b684e6d5),segment_id=48c3ca64-0aa3-4478-bfbf-ce89b684e6d5)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:06.325239 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-97a8bcc8-f17f-426e-9f20-81ddeecad358 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:06.331150 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8a193761-29e9-4002-b148-9f2dd27d9fd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:06.425405 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1012321b-05f5-455b-b4b7-e02243e731ce None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:06.445339 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a653e124-3f1e-4d5f-ab77-2ebc6c46d954 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:39:06.456741 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c35f7959-b26f-4142-8a21-69b752904763 None None] Sync routers for ids ['f2b3fc08-9e60-4600-9a8b-7400a9e940a0'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:39:06.469918 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a653e124-3f1e-4d5f-ab77-2ebc6c46d954 admin admin] 10.222.0.13 "PUT /v2.0/routers/f2b3fc08-9e60-4600-9a8b-7400a9e940a0/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 7.2950065 Dec 09 21:39:06.470158 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-48c9919f-e44a-4109-a356-826c1d77b97c None None] Could not find standard attr ID for object 5aa5d381-6511-4f20-a7a1-82d3d1a3af61. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:39:06.473337 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c35f7959-b26f-4142-8a21-69b752904763 None None] Routers {'f2b3fc08-9e60-4600-9a8b-7400a9e940a0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:39:06.474785 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57268) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:06.482986 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c35f7959-b26f-4142-8a21-69b752904763 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:39:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f2b3fc08-9e60-4600-9a8b-7400a9e940a0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:06.511140 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-48c9919f-e44a-4109-a356-826c1d77b97c None None] Provisioning complete for port 593841d3-b83c-4989-b6ec-1d6293d3b20e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:06.514376 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-48c9919f-e44a-4109-a356-826c1d77b97c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:06.550992 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-3bd80754-7b14-4376-8ce5-8c09600b56c3 admin admin] For port 0bf80ece-82d7-4c64-8066-ef5107ea9e0d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=0bf80ece-82d7-4c64-8066-ef5107ea9e0d,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:06.551373 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3bd80754-7b14-4376-8ce5-8c09600b56c3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:06.572303 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a193761-29e9-4002-b148-9f2dd27d9fd8 None None] Pushing event updated for resources: {'Port': ['ID=593841d3-b83c-4989-b6ec-1d6293d3b20e,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:06.597957 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-3bd80754-7b14-4376-8ce5-8c09600b56c3 admin admin] Calling delete_port for 0bf80ece-82d7-4c64-8066-ef5107ea9e0d owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:06.686163 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:06.702497 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-c35f7959-b26f-4142-8a21-69b752904763 None None] Set router f2b3fc08-9e60-4600-9a8b-7400a9e940a0 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:39:06.702801 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-199812a4-4a1e-4cb5-95b7-7979a4774ca9 admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:06.775091 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bfd3662d-a322-49c8-99b1-35aff4d81c14 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:06.781828 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bfd3662d-a322-49c8-99b1-35aff4d81c14 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:06.785728 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bfd3662d-a322-49c8-99b1-35aff4d81c14 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/ee67d3e5-bff0-484e-b5c2-346c36279554 HTTP/1.1" status: 204 len: 168 time: 1.1891751 Dec 09 21:39:06.795126 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-87537dfb-19c6-43b4-a105-7262e9bfc0dc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'name': 'tempest-ServerActionsTestJSON-1559985225-router', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242'}], 'enable_snat': True}, 'gw_port_id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:29:30Z', 'updated_at': '2021-12-09T21:39:02Z', 'revision_number': 5, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'gw_port': {'id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:d4:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1299, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:29:31Z', 'updated_at': '2021-12-09T21:29:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:06.840848 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-87537dfb-19c6-43b4-a105-7262e9bfc0dc None None] The sync data for ids ['1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586'] in n-d-713301-27 is: [{'id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'name': 'tempest-ServerActionsTestJSON-1559985225-router', 'tenant_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242'}], 'enable_snat': True}, 'gw_port_id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:29:30Z', 'updated_at': '2021-12-09T21:39:02Z', 'revision_number': 5, 'project_id': 'a36a93590a9f45e1b9b3f78753bb8e12', 'gw_port': {'id': '0bf80ece-82d7-4c64-8066-ef5107ea9e0d', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:d4:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1299, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:29:31Z', 'updated_at': '2021-12-09T21:29:39Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:39:06.922446 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-199812a4-4a1e-4cb5-95b7-7979a4774ca9 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:06.928658 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8febb8b-9456-4d28-a98a-d18c4b5a6555 req-967b9d78-bc2b-4d89-9344-e9a8e9df9497 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 210 time: 0.1349540 Dec 09 21:39:06.937732 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-aacfe5ca-a0ba-43eb-8834-fbb758ed85e5 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=4801450b1b2d4b8c819a3f3742d6bf57&name=default HTTP/1.1" status: 200 len: 3000 time: 2.6740003 Dec 09 21:39:06.940758 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57278) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:07.056827 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-135a952b-bfba-4e88-846d-13de76d5ce86 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:07.062042 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c35f7959-b26f-4142-8a21-69b752904763 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'name': 'tempest-TaggedBootDevicesTest-1896005035-router', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127'}], 'enable_snat': True}, 'gw_port_id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:00Z', 'updated_at': '2021-12-09T21:39:04Z', 'revision_number': 5, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'gw_port': {'id': '419b54cc-ec88-493d-a1d4-a2bb128da19c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:a1:90:41', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1069, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.127', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:01Z', 'updated_at': '2021-12-09T21:27:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:07.082621 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-135a952b-bfba-4e88-846d-13de76d5ce86 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:07.096396 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfd3662d-a322-49c8-99b1-35aff4d81c14 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ee67d3e5-bff0-484e-b5c2-346c36279554,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:07.099085 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c35f7959-b26f-4142-8a21-69b752904763 None None] Checking router: f2b3fc08-9e60-4600-9a8b-7400a9e940a0 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:39:07.105368 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-97a8bcc8-f17f-426e-9f20-81ddeecad358 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:07.110441 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c35f7959-b26f-4142-8a21-69b752904763 None None] Routers {'f2b3fc08-9e60-4600-9a8b-7400a9e940a0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:39:07.111247 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c35f7959-b26f-4142-8a21-69b752904763 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:39:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f2b3fc08-9e60-4600-9a8b-7400a9e940a0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:07.189744 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:39:07.190486 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:39:07.197024 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-135a952b-bfba-4e88-846d-13de76d5ce86 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:07.204999 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-135a952b-bfba-4e88-846d-13de76d5ce86 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:07.207559 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-135a952b-bfba-4e88-846d-13de76d5ce86 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/93aabe4e-1024-46c0-a9c1-798787878f47 HTTP/1.1" status: 204 len: 168 time: 0.2632320 Dec 09 21:39:07.235580 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97a8bcc8-f17f-426e-9f20-81ddeecad358 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Subnet': ['ID=1fe0f923-b8b9-49c1-9996-cc0ec9bb1eb8,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:07.236719 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-135a952b-bfba-4e88-846d-13de76d5ce86 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=93aabe4e-1024-46c0-a9c1-798787878f47,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:07.237636 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a0aeda52-3fbc-450b-8150-8519ca986be6 None None] Network 50569dc8-e38b-459d-a118-74171d689fb2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:07.244944 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-97a8bcc8-f17f-426e-9f20-81ddeecad358 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:07.252553 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-97a8bcc8-f17f-426e-9f20-81ddeecad358 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/subnets/1fe0f923-b8b9-49c1-9996-cc0ec9bb1eb8 HTTP/1.1" status: 204 len: 168 time: 2.0151772 Dec 09 21:39:07.257213 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57288) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:07.379173 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-c35f7959-b26f-4142-8a21-69b752904763 None None] Set router f2b3fc08-9e60-4600-9a8b-7400a9e940a0 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:39:07.412072 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3bd80754-7b14-4376-8ce5-8c09600b56c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:07.498294 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-abc65a22-4143-461d-b18e-b4d32d110f33 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:39:07.518258 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bd80754-7b14-4376-8ce5-8c09600b56c3 admin admin] Pushing event deleted for resources: {'Port': ['ID=0bf80ece-82d7-4c64-8066-ef5107ea9e0d,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:07.577459 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c35f7959-b26f-4142-8a21-69b752904763 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'name': 'tempest-TaggedBootDevicesTest-1896005035-router', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:00Z', 'updated_at': '2021-12-09T21:39:06Z', 'revision_number': 6, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:07.579707 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-199812a4-4a1e-4cb5-95b7-7979a4774ca9 admin admin] Deleting port 419b54cc-ec88-493d-a1d4-a2bb128da19c {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:07.580071 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-199812a4-4a1e-4cb5-95b7-7979a4774ca9 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:07.628796 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3bd80754-7b14-4376-8ce5-8c09600b56c3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:07.653853 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00ebbf4d-a9ae-4ff5-8801-0f084ed89273 None None] DHCP port deletion for 50569dc8-e38b-459d-a118-74171d689fb2 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:39:07.665411 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-68e77539-3e58-4c92-afd7-a36bb9c2a575 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:07.677444 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c35f7959-b26f-4142-8a21-69b752904763 None None] The sync data for ids ['f2b3fc08-9e60-4600-9a8b-7400a9e940a0'] in n-d-713301-27 is: [{'id': 'f2b3fc08-9e60-4600-9a8b-7400a9e940a0', 'name': 'tempest-TaggedBootDevicesTest-1896005035-router', 'tenant_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:00Z', 'updated_at': '2021-12-09T21:39:06Z', 'revision_number': 6, 'project_id': '03e962eb7f5e4325a7c08c8b1e2a4cea', 'gw_port_host': None}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:39:07.836685 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-00ebbf4d-a9ae-4ff5-8801-0f084ed89273 None None] Deleting port 593841d3-b83c-4989-b6ec-1d6293d3b20e {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:07.837065 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-00ebbf4d-a9ae-4ff5-8801-0f084ed89273 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:07.841297 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3bd80754-7b14-4376-8ce5-8c09600b56c3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:07.845315 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3bd80754-7b14-4376-8ce5-8c09600b56c3 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:07.911292 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-199812a4-4a1e-4cb5-95b7-7979a4774ca9 admin admin] For port 419b54cc-ec88-493d-a1d4-a2bb128da19c, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=419b54cc-ec88-493d-a1d4-a2bb128da19c,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:07.912250 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-199812a4-4a1e-4cb5-95b7-7979a4774ca9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:07.942535 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-199812a4-4a1e-4cb5-95b7-7979a4774ca9 admin admin] Calling delete_port for 419b54cc-ec88-493d-a1d4-a2bb128da19c owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:07.950317 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3bd80754-7b14-4376-8ce5-8c09600b56c3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:07.950864 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3bd80754-7b14-4376-8ce5-8c09600b56c3 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:39:07.958262 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3bd80754-7b14-4376-8ce5-8c09600b56c3 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:07.958688 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-68e77539-3e58-4c92-afd7-a36bb9c2a575 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting port 593841d3-b83c-4989-b6ec-1d6293d3b20e {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:07.959241 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-68e77539-3e58-4c92-afd7-a36bb9c2a575 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:07.959493 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3bd80754-7b14-4376-8ce5-8c09600b56c3 admin admin] 10.222.0.13 "DELETE /v2.0/routers/1332ad4a-ca4d-4ffa-9c2a-b55db6ab9586 HTTP/1.1" status: 204 len: 168 time: 4.2022395 Dec 09 21:39:07.964704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57302) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:07.985187 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-00ebbf4d-a9ae-4ff5-8801-0f084ed89273 None None] For port 593841d3-b83c-4989-b6ec-1d6293d3b20e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=593841d3-b83c-4989-b6ec-1d6293d3b20e,segment=NetworkSegment(48c3ca64-0aa3-4478-bfbf-ce89b684e6d5),segment_id=48c3ca64-0aa3-4478-bfbf-ce89b684e6d5)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:07.988292 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-00ebbf4d-a9ae-4ff5-8801-0f084ed89273 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:08.070369 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-00ebbf4d-a9ae-4ff5-8801-0f084ed89273 None None] Calling delete_port for 593841d3-b83c-4989-b6ec-1d6293d3b20e owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:08.206886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57308) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:08.212619 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc7af9df-c91c-4bb0-b7d1-9f6d793cb4e9 req-61c235d6-3faf-4cb0-9db2-1005c6d7df15 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 210 time: 0.0753381 Dec 09 21:39:08.260828 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-68e77539-3e58-4c92-afd7-a36bb9c2a575 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] For port 593841d3-b83c-4989-b6ec-1d6293d3b20e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=593841d3-b83c-4989-b6ec-1d6293d3b20e,segment=NetworkSegment(48c3ca64-0aa3-4478-bfbf-ce89b684e6d5),segment_id=48c3ca64-0aa3-4478-bfbf-ce89b684e6d5)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:08.261335 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-68e77539-3e58-4c92-afd7-a36bb9c2a575 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:08.279972 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:08.280536 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-68e77539-3e58-4c92-afd7-a36bb9c2a575 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Calling delete_port for 593841d3-b83c-4989-b6ec-1d6293d3b20e owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:08.305721 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2bced351-8220-41d3-9465-fa68a69b28c0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:08.389826 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-00ebbf4d-a9ae-4ff5-8801-0f084ed89273 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:08.423337 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00ebbf4d-a9ae-4ff5-8801-0f084ed89273 None None] Pushing event deleted for resources: {'Port': ['ID=593841d3-b83c-4989-b6ec-1d6293d3b20e,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:08.428678 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00ebbf4d-a9ae-4ff5-8801-0f084ed89273 None None] No DVR routers for this DVR port 593841d3-b83c-4989-b6ec-1d6293d3b20e on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:39:08.473649 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2bced351-8220-41d3-9465-fa68a69b28c0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:08.485112 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2bced351-8220-41d3-9465-fa68a69b28c0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:08.501199 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-68e77539-3e58-4c92-afd7-a36bb9c2a575 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:08.551148 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-18808f2f-b6e0-4757-90be-7da7d569e7fc admin admin] Deleting subnet d776263b-6b97-44cc-bef5-299b9262dfec {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:39:08.559583 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68e77539-3e58-4c92-afd7-a36bb9c2a575 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Port': ['ID=593841d3-b83c-4989-b6ec-1d6293d3b20e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:08.563260 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-18808f2f-b6e0-4757-90be-7da7d569e7fc admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:08.571660 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2bced351-8220-41d3-9465-fa68a69b28c0 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ada7ecfef67c487187992418cdd506c9&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3577263 Dec 09 21:39:08.597028 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57314) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:08.603683 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68e77539-3e58-4c92-afd7-a36bb9c2a575 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] No DVR routers for this DVR port 593841d3-b83c-4989-b6ec-1d6293d3b20e on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:39:08.612900 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bced351-8220-41d3-9465-fa68a69b28c0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=12654f09-7e05-44cb-91b2-18af139066b9,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:08.762535 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-18808f2f-b6e0-4757-90be-7da7d569e7fc admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:08.957700 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 1ab9d8fe-6942-4722-90aa-1232fb6aab84 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:39:09.011785 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 1ab9d8fe-6942-4722-90aa-1232fb6aab84 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:39:09.023790 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 1ab9d8fe-6942-4722-90aa-1232fb6aab84 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:39:09.024416 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 07784993-5ed4-492f-8151-3e60e91832c1 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:39:09.106695 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-68e77539-3e58-4c92-afd7-a36bb9c2a575 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:09.138337 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 07784993-5ed4-492f-8151-3e60e91832c1 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:39:09.139102 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 07784993-5ed4-492f-8151-3e60e91832c1 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:39:09.139866 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 593841d3-b83c-4989-b6ec-1d6293d3b20e no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:39:09.144491 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-18808f2f-b6e0-4757-90be-7da7d569e7fc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:09.156119 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57334) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:09.164303 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee069e2a-8a0b-4dc1-a1ed-d4bf7f02cc7d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:09.203088 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 593841d3-b83c-4989-b6ec-1d6293d3b20e {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:39:09.207569 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 593841d3-b83c-4989-b6ec-1d6293d3b20e not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:39:09.317142 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-404ad53a-de0f-4ba2-9645-53dc9de8e8d8 admin admin] Request body: {'network': {'name': 'tempest-TestServerAdvancedOps-699788962-network', 'tenant_id': 'ec2fddf1ed684b7e8c8deb49d8c06a18'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:09.337424 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee069e2a-8a0b-4dc1-a1ed-d4bf7f02cc7d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:09.359145 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-68e77539-3e58-4c92-afd7-a36bb9c2a575 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['50569dc8-e38b-459d-a118-74171d689fb2']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:09.376641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-404ad53a-de0f-4ba2-9645-53dc9de8e8d8 admin admin] Made reservation on behalf of ec2fddf1ed684b7e8c8deb49d8c06a18 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:09.384671 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-404ad53a-de0f-4ba2-9645-53dc9de8e8d8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:09.395309 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-68e77539-3e58-4c92-afd7-a36bb9c2a575 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '48c3ca64-0aa3-4478-bfbf-ce89b684e6d5') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:09.396304 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-68e77539-3e58-4c92-afd7-a36bb9c2a575 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '48c3ca64-0aa3-4478-bfbf-ce89b684e6d5') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:09.406855 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-68e77539-3e58-4c92-afd7-a36bb9c2a575 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:09.421872 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-404ad53a-de0f-4ba2-9645-53dc9de8e8d8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:09.423612 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-68e77539-3e58-4c92-afd7-a36bb9c2a575 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:09.431972 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-68e77539-3e58-4c92-afd7-a36bb9c2a575 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Releasing vlan 111 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:39:09.432540 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-68e77539-3e58-4c92-afd7-a36bb9c2a575 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: self.session.flush() Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: self.session.flush() Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: self.session.flush() Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: self.session.flush() Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:39:09.507085 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:39:09.524750 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-404ad53a-de0f-4ba2-9645-53dc9de8e8d8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:09.528381 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89c86638-194d-44a2-b182-594aa3949eee req-b2b23576-91fe-4c4e-bdd6-def2fb3f08df tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 210 time: 0.1660759 Dec 09 21:39:09.536893 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-199812a4-4a1e-4cb5-95b7-7979a4774ca9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:09.546743 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-404ad53a-de0f-4ba2-9645-53dc9de8e8d8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:09.575059 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-404ad53a-de0f-4ba2-9645-53dc9de8e8d8 admin admin] vlan segment allocate from pool success with {'vlan_id': 138, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:39:09.591000 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-18808f2f-b6e0-4757-90be-7da7d569e7fc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:09.592363 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-404ad53a-de0f-4ba2-9645-53dc9de8e8d8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8ee4757d-9f67-4d3c-994b-59905d6c5b2b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:09.607001 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-404ad53a-de0f-4ba2-9645-53dc9de8e8d8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:09.607348 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-404ad53a-de0f-4ba2-9645-53dc9de8e8d8 admin admin] Added segment e0f6fb16-426b-4e5a-a33f-f4e36fbfbd55 of type vlan for network a71f32bb-6d3a-4295-a0cb-027407f942be Dec 09 21:39:09.614443 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-68e77539-3e58-4c92-afd7-a36bb9c2a575 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:09.643958 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18808f2f-b6e0-4757-90be-7da7d569e7fc admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d776263b-6b97-44cc-bef5-299b9262dfec,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:09.654253 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:09.664389 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-68e77539-3e58-4c92-afd7-a36bb9c2a575 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:09.666640 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-404ad53a-de0f-4ba2-9645-53dc9de8e8d8 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:09.671631 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-68e77539-3e58-4c92-afd7-a36bb9c2a575 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/networks/50569dc8-e38b-459d-a118-74171d689fb2 HTTP/1.1" status: 204 len: 168 time: 2.4088385 Dec 09 21:39:09.671794 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57348) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:09.672917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-199812a4-4a1e-4cb5-95b7-7979a4774ca9 admin admin] Pushing event deleted for resources: {'Port': ['ID=419b54cc-ec88-493d-a1d4-a2bb128da19c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:09.688661 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68e77539-3e58-4c92-afd7-a36bb9c2a575 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Network': ['ID=50569dc8-e38b-459d-a118-74171d689fb2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:09.689325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-3d61cbe4-b92e-455d-a94b-4093446dfd33 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'port': {'network_id': '12b747a3-de78-4645-83a0-a5e2eec09a63', 'name': 'tempest-PortsTestJSON-1579360409'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:09.691778 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-18808f2f-b6e0-4757-90be-7da7d569e7fc admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:09.696023 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-18808f2f-b6e0-4757-90be-7da7d569e7fc admin admin] 10.222.0.13 "DELETE /v2.0/subnets/d776263b-6b97-44cc-bef5-299b9262dfec HTTP/1.1" status: 204 len: 168 time: 1.7302246 Dec 09 21:39:09.701025 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57350) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:09.702949 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7df27cd0-1491-4b13-bfa8-67b5d45167f2 None None] Network 2c03082f-742a-4ae3-9d23-6178c7ff2a0a requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:09.744252 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-77485f3e-2f24-4567-9fa4-0b27d0f1422f None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:39:09.810310 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.db.resource_extend [None req-404ad53a-de0f-4ba2-9645-53dc9de8e8d8 admin admin] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 09 21:39:09.856384 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-404ad53a-de0f-4ba2-9645-53dc9de8e8d8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:09.858170 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-404ad53a-de0f-4ba2-9645-53dc9de8e8d8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:09.860061 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-404ad53a-de0f-4ba2-9645-53dc9de8e8d8 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:09.992087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-404ad53a-de0f-4ba2-9645-53dc9de8e8d8 admin admin] Pushing event updated for resources: {'Network': ['ID=a71f32bb-6d3a-4295-a0cb-027407f942be,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:10.003301 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0bf80ece-82d7-4c64-8066-ef5107ea9e0d no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:39:10.017389 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3d61cbe4-b92e-455d-a94b-4093446dfd33 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:10.037666 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d61cbe4-b92e-455d-a94b-4093446dfd33 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:10.057560 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-404ad53a-de0f-4ba2-9645-53dc9de8e8d8 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.8971829 Dec 09 21:39:10.072251 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-05125afa-5ad0-40b2-9a98-96d2683076eb None None] DHCP port deletion for 2c03082f-742a-4ae3-9d23-6178c7ff2a0a request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:39:10.084287 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57356) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:10.104971 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-9a4198f6-0c39-4d24-921a-40e9a66e2edd admin admin] Request body: {'subnet': {'network_id': 'a71f32bb-6d3a-4295-a0cb-027407f942be', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerAdvancedOps-699788962-subnet', 'tenant_id': 'ec2fddf1ed684b7e8c8deb49d8c06a18', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:10.118652 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-3d61cbe4-b92e-455d-a94b-4093446dfd33 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] device_id is not set on port 26de7ee9-34f0-4e8d-8047-e4a778ea0cb7 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:39:10.139684 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee069e2a-8a0b-4dc1-a1ed-d4bf7f02cc7d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:10.144258 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee069e2a-8a0b-4dc1-a1ed-d4bf7f02cc7d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:10.145993 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network a71f32bb-6d3a-4295-a0cb-027407f942be details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:39:10.146278 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ee069e2a-8a0b-4dc1-a1ed-d4bf7f02cc7d admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/12654f09-7e05-44cb-91b2-18af139066b9 HTTP/1.1" status: 204 len: 168 time: 1.5451496 Dec 09 21:39:10.182727 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9a4198f6-0c39-4d24-921a-40e9a66e2edd admin admin] Made reservation on behalf of ec2fddf1ed684b7e8c8deb49d8c06a18 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:10.185646 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9a4198f6-0c39-4d24-921a-40e9a66e2edd admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:10.209883 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25974a32-5f70-4852-bd42-f3c911051533 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:10.245489 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-199812a4-4a1e-4cb5-95b7-7979a4774ca9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:10.249981 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee069e2a-8a0b-4dc1-a1ed-d4bf7f02cc7d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=12654f09-7e05-44cb-91b2-18af139066b9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:10.275814 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 0bf80ece-82d7-4c64-8066-ef5107ea9e0d {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:39:10.276608 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0bf80ece-82d7-4c64-8066-ef5107ea9e0d not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:39:10.277193 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 419b54cc-ec88-493d-a1d4-a2bb128da19c no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:39:10.317211 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 419b54cc-ec88-493d-a1d4-a2bb128da19c {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:39:10.317843 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 419b54cc-ec88-493d-a1d4-a2bb128da19c not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:39:10.356993 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-05125afa-5ad0-40b2-9a98-96d2683076eb None None] Deleting port d2525219-68b7-4035-9de7-ec388a6121a8 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:10.357837 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-05125afa-5ad0-40b2-9a98-96d2683076eb None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:10.430454 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-05125afa-5ad0-40b2-9a98-96d2683076eb None None] For port d2525219-68b7-4035-9de7-ec388a6121a8, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d2525219-68b7-4035-9de7-ec388a6121a8,segment=NetworkSegment(83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d),segment_id=83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:10.431173 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-05125afa-5ad0-40b2-9a98-96d2683076eb None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:10.457002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-05125afa-5ad0-40b2-9a98-96d2683076eb None None] Calling delete_port for d2525219-68b7-4035-9de7-ec388a6121a8 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:10.521871 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d61cbe4-b92e-455d-a94b-4093446dfd33 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:10.567754 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-05125afa-5ad0-40b2-9a98-96d2683076eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:10.597619 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-199812a4-4a1e-4cb5-95b7-7979a4774ca9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:10.604197 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-199812a4-4a1e-4cb5-95b7-7979a4774ca9 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:10.668085 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05125afa-5ad0-40b2-9a98-96d2683076eb None None] No DVR routers for this DVR port d2525219-68b7-4035-9de7-ec388a6121a8 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:39:10.689039 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05125afa-5ad0-40b2-9a98-96d2683076eb None None] Pushing event deleted for resources: {'Port': ['ID=d2525219-68b7-4035-9de7-ec388a6121a8,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:10.747852 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-199812a4-4a1e-4cb5-95b7-7979a4774ca9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:10.750466 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-199812a4-4a1e-4cb5-95b7-7979a4774ca9 admin admin] Fanout notify agent at l3_agent the message router_deleted on router f2b3fc08-9e60-4600-9a8b-7400a9e940a0 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:39:10.756992 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-25974a32-5f70-4852-bd42-f3c911051533 admin admin] Deleting port d2525219-68b7-4035-9de7-ec388a6121a8 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:10.759236 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25974a32-5f70-4852-bd42-f3c911051533 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:10.775874 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-199812a4-4a1e-4cb5-95b7-7979a4774ca9 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:10.777602 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-199812a4-4a1e-4cb5-95b7-7979a4774ca9 admin admin] 10.222.0.13 "DELETE /v2.0/routers/f2b3fc08-9e60-4600-9a8b-7400a9e940a0 HTTP/1.1" status: 204 len: 168 time: 4.3017151 Dec 09 21:39:10.780378 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57368) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:10.822423 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9a4198f6-0c39-4d24-921a-40e9a66e2edd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:10.934910 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-efeb84ca-e6f9-4325-8675-3c1354f9ef9f req-d4840c7b-6806-4471-b53c-824866690c9a tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 210 time: 0.2326984 Dec 09 21:39:10.937793 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a4198f6-0c39-4d24-921a-40e9a66e2edd admin admin] Pushing event updated for resources: {'Subnet': ['ID=ee1b3d8d-21b5-45b8-802b-af8c84fb9577,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:10.990294 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d61cbe4-b92e-455d-a94b-4093446dfd33 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:11.023412 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-fb7ebd01-fd99-4792-9e52-7d4c9ba9c9d3 admin admin] Deleting subnet 65df7637-0210-4526-a5dd-a692c26062b4 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:39:11.027213 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fb7ebd01-fd99-4792-9e52-7d4c9ba9c9d3 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:11.083607 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fb7ebd01-fd99-4792-9e52-7d4c9ba9c9d3 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:11.108527 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d61cbe4-b92e-455d-a94b-4093446dfd33 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network 12b747a3-de78-4645-83a0-a5e2eec09a63 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:39:11.112300 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-3d61cbe4-b92e-455d-a94b-4093446dfd33 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:11.114998 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d61cbe4-b92e-455d-a94b-4093446dfd33 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:39:11.125762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d61cbe4-b92e-455d-a94b-4093446dfd33 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:11.126798 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d61cbe4-b92e-455d-a94b-4093446dfd33 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:11.151385 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a4198f6-0c39-4d24-921a-40e9a66e2edd admin admin] Checking segment: {'id': 'e0f6fb16-426b-4e5a-a33f-f4e36fbfbd55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'a71f32bb-6d3a-4295-a0cb-027407f942be'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:39:11.151787 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a4198f6-0c39-4d24-921a-40e9a66e2edd admin admin] Network hostable DHCP agents. Network: a71f32bb-6d3a-4295-a0cb-027407f942be, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:39:11.165541 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3d61cbe4-b92e-455d-a94b-4093446dfd33 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 846 time: 1.4913197 Dec 09 21:39:11.170367 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57380) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:11.188436 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d61cbe4-b92e-455d-a94b-4093446dfd33 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Port': ['ID=26de7ee9-34f0-4e8d-8047-e4a778ea0cb7,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:11.223218 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a4198f6-0c39-4d24-921a-40e9a66e2edd admin admin] Network a71f32bb-6d3a-4295-a0cb-027407f942be is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:39:11.270374 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-9a4198f6-0c39-4d24-921a-40e9a66e2edd admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, a71f32bb-6d3a-4295-a0cb-027407f942be) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:11.275430 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a4198f6-0c39-4d24-921a-40e9a66e2edd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:11.276703 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9a4198f6-0c39-4d24-921a-40e9a66e2edd admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:11.286888 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-75663cd3-c2e1-4cb9-87e7-273001409798 None None] Network a71f32bb-6d3a-4295-a0cb-027407f942be requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:11.300031 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fb7ebd01-fd99-4792-9e52-7d4c9ba9c9d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:11.304323 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-25974a32-5f70-4852-bd42-f3c911051533 admin admin] For port d2525219-68b7-4035-9de7-ec388a6121a8, host n-d-713301-27, got binding levels [] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:11.304906 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25974a32-5f70-4852-bd42-f3c911051533 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:11.325141 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9a4198f6-0c39-4d24-921a-40e9a66e2edd admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.2373490 Dec 09 21:39:11.349232 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-25974a32-5f70-4852-bd42-f3c911051533 admin admin] Calling delete_port for d2525219-68b7-4035-9de7-ec388a6121a8 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:11.355109 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.ipam_backend_mixin [None req-25974a32-5f70-4852-bd42-f3c911051533 admin admin] Port d2525219-68b7-4035-9de7-ec388a6121a8 was not found and therefore no delete operation was performed {{(pid=103437) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 09 21:39:11.361394 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25974a32-5f70-4852-bd42-f3c911051533 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:11.370940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-11010509-e781-4ba5-97fe-8d69c6b21893 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting port 26de7ee9-34f0-4e8d-8047-e4a778ea0cb7 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:11.371278 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-11010509-e781-4ba5-97fe-8d69c6b21893 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:11.415416 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25974a32-5f70-4852-bd42-f3c911051533 admin admin] No DVR routers for this DVR port d2525219-68b7-4035-9de7-ec388a6121a8 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:39:11.421628 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25974a32-5f70-4852-bd42-f3c911051533 admin admin] Pushing event deleted for resources: {'Port': ['ID=d2525219-68b7-4035-9de7-ec388a6121a8,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:11.523532 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c1a278bc-775e-474a-b0a0-1817536e3550 None None] Network a71f32bb-6d3a-4295-a0cb-027407f942be requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:11.534271 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fb7ebd01-fd99-4792-9e52-7d4c9ba9c9d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:11.584108 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-11010509-e781-4ba5-97fe-8d69c6b21893 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:11.622016 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-11010509-e781-4ba5-97fe-8d69c6b21893 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Calling delete_port for 26de7ee9-34f0-4e8d-8047-e4a778ea0cb7 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:11.631598 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25974a32-5f70-4852-bd42-f3c911051533 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:11.663759 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb7ebd01-fd99-4792-9e52-7d4c9ba9c9d3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=65df7637-0210-4526-a5dd-a692c26062b4,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:11.669877 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fb7ebd01-fd99-4792-9e52-7d4c9ba9c9d3 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:11.674208 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fb7ebd01-fd99-4792-9e52-7d4c9ba9c9d3 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/65df7637-0210-4526-a5dd-a692c26062b4 HTTP/1.1" status: 204 len: 168 time: 0.8612404 Dec 09 21:39:11.685093 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57394) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:11.686466 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7d6a61c6-64f8-4833-a01f-814fa1634c2f None None] Network f0373886-3db8-47eb-af65-78244497171e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:11.759026 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b33518d-3229-4b82-b802-c20cf43afbe7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:11.763879 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-25974a32-5f70-4852-bd42-f3c911051533 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2c03082f-742a-4ae3-9d23-6178c7ff2a0a']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:11.778708 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-25974a32-5f70-4852-bd42-f3c911051533 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:11.779044 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-25974a32-5f70-4852-bd42-f3c911051533 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '83cd31a7-8aea-4a8d-b8d4-cdb6b9f4af8d') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:11.817100 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25974a32-5f70-4852-bd42-f3c911051533 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:11.829377 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-11010509-e781-4ba5-97fe-8d69c6b21893 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:11.861390 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25974a32-5f70-4852-bd42-f3c911051533 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:11.870921 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-25974a32-5f70-4852-bd42-f3c911051533 admin admin] Releasing vlan 139 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:39:11.871375 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25974a32-5f70-4852-bd42-f3c911051533 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:39:11.933896 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:39:11.941034 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11010509-e781-4ba5-97fe-8d69c6b21893 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Port': ['ID=26de7ee9-34f0-4e8d-8047-e4a778ea0cb7,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:11.955725 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90cb4895-0ede-4766-85a0-e1316ca57805 None None] DHCP port deletion for f0373886-3db8-47eb-af65-78244497171e request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:39:11.962042 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-11010509-e781-4ba5-97fe-8d69c6b21893 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:11.967727 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-11010509-e781-4ba5-97fe-8d69c6b21893 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/ports/26de7ee9-34f0-4e8d-8047-e4a778ea0cb7 HTTP/1.1" status: 204 len: 168 time: 0.7963414 Dec 09 21:39:11.970663 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57400) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:11.977394 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-60e2ecfb-6bc3-4428-bcf8-de94b092ab6f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'port': {'network_id': '12b747a3-de78-4645-83a0-a5e2eec09a63', 'mac_address': 'fa:16:3e:a2:86:84', 'name': 'tempest-PortsTestJSON-819861023'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:11.993839 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25974a32-5f70-4852-bd42-f3c911051533 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:12.004998 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25974a32-5f70-4852-bd42-f3c911051533 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:12.010436 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-25974a32-5f70-4852-bd42-f3c911051533 admin admin] 10.222.0.13 "DELETE /v2.0/networks/2c03082f-742a-4ae3-9d23-6178c7ff2a0a HTTP/1.1" status: 204 len: 168 time: 2.3081446 Dec 09 21:39:12.015676 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d2525219-68b7-4035-9de7-ec388a6121a8 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:39:12.060968 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25974a32-5f70-4852-bd42-f3c911051533 admin admin] Pushing event deleted for resources: {'Network': ['ID=2c03082f-742a-4ae3-9d23-6178c7ff2a0a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:12.068131 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: d2525219-68b7-4035-9de7-ec388a6121a8 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:39:12.068473 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d2525219-68b7-4035-9de7-ec388a6121a8 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:39:12.101781 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1b33518d-3229-4b82-b802-c20cf43afbe7 admin admin] Deleting port 33623e1c-80ee-46d8-a56b-36b3b16079f6 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:12.102125 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b33518d-3229-4b82-b802-c20cf43afbe7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:12.126377 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-90cb4895-0ede-4766-85a0-e1316ca57805 None None] Deleting port 33623e1c-80ee-46d8-a56b-36b3b16079f6 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:12.126787 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-90cb4895-0ede-4766-85a0-e1316ca57805 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:12.143976 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71d8d4da-e371-4b25-9741-c11c7ef2c870 req-06b3e988-b9fd-4fe6-9602-b5209aa00bd1 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 210 time: 0.0901158 Dec 09 21:39:12.189238 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-60e2ecfb-6bc3-4428-bcf8-de94b092ab6f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:12.199080 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-90cb4895-0ede-4766-85a0-e1316ca57805 None None] For port 33623e1c-80ee-46d8-a56b-36b3b16079f6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=33623e1c-80ee-46d8-a56b-36b3b16079f6,segment=NetworkSegment(f5a54e61-4fb1-4afa-9a27-98e2163b0365),segment_id=f5a54e61-4fb1-4afa-9a27-98e2163b0365)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:12.199481 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-90cb4895-0ede-4766-85a0-e1316ca57805 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:12.213818 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-90cb4895-0ede-4766-85a0-e1316ca57805 None None] Calling delete_port for 33623e1c-80ee-46d8-a56b-36b3b16079f6 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:12.257459 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-1b33518d-3229-4b82-b802-c20cf43afbe7 admin admin] For port 33623e1c-80ee-46d8-a56b-36b3b16079f6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=33623e1c-80ee-46d8-a56b-36b3b16079f6,segment=NetworkSegment(f5a54e61-4fb1-4afa-9a27-98e2163b0365),segment_id=f5a54e61-4fb1-4afa-9a27-98e2163b0365)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:12.258379 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b33518d-3229-4b82-b802-c20cf43afbe7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:12.276981 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1b33518d-3229-4b82-b802-c20cf43afbe7 admin admin] Calling delete_port for 33623e1c-80ee-46d8-a56b-36b3b16079f6 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:12.349517 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-90cb4895-0ede-4766-85a0-e1316ca57805 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:12.355180 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60e2ecfb-6bc3-4428-bcf8-de94b092ab6f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:12.386624 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90cb4895-0ede-4766-85a0-e1316ca57805 None None] No DVR routers for this DVR port 33623e1c-80ee-46d8-a56b-36b3b16079f6 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:39:12.395965 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90cb4895-0ede-4766-85a0-e1316ca57805 None None] Pushing event deleted for resources: {'Port': ['ID=33623e1c-80ee-46d8-a56b-36b3b16079f6,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:12.411806 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57414) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:12.423255 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-60e2ecfb-6bc3-4428-bcf8-de94b092ab6f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] device_id is not set on port e5ff5b5c-5b71-419b-bf1b-e45e51f9ccea yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:39:12.462849 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b33518d-3229-4b82-b802-c20cf43afbe7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:12.552066 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b33518d-3229-4b82-b802-c20cf43afbe7 admin admin] Pushing event deleted for resources: {'Port': ['ID=33623e1c-80ee-46d8-a56b-36b3b16079f6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:12.556147 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b33518d-3229-4b82-b802-c20cf43afbe7 admin admin] No DVR routers for this DVR port 33623e1c-80ee-46d8-a56b-36b3b16079f6 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:39:12.598085 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cd9a9e36-cf72-4b45-a90e-4d7db3b9393f admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=a36a93590a9f45e1b9b3f78753bb8e12&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1811287 Dec 09 21:39:12.608209 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57420) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:12.655928 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60e2ecfb-6bc3-4428-bcf8-de94b092ab6f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:12.670029 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b33518d-3229-4b82-b802-c20cf43afbe7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:12.701066 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60e2ecfb-6bc3-4428-bcf8-de94b092ab6f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:12.712433 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-1b33518d-3229-4b82-b802-c20cf43afbe7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f0373886-3db8-47eb-af65-78244497171e']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:12.728266 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-1b33518d-3229-4b82-b802-c20cf43afbe7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f5a54e61-4fb1-4afa-9a27-98e2163b0365') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:12.728266 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-1b33518d-3229-4b82-b802-c20cf43afbe7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f5a54e61-4fb1-4afa-9a27-98e2163b0365') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:12.747361 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b33518d-3229-4b82-b802-c20cf43afbe7 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:12.756941 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-00e718dc-e3f9-47bd-b6b2-f27400010fc2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:12.769695 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b33518d-3229-4b82-b802-c20cf43afbe7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:12.802274 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-00e718dc-e3f9-47bd-b6b2-f27400010fc2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:12.823393 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-60e2ecfb-6bc3-4428-bcf8-de94b092ab6f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network 12b747a3-de78-4645-83a0-a5e2eec09a63 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:39:12.829572 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-60e2ecfb-6bc3-4428-bcf8-de94b092ab6f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:12.845394 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60e2ecfb-6bc3-4428-bcf8-de94b092ab6f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:39:12.856424 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1b33518d-3229-4b82-b802-c20cf43afbe7 admin admin] Releasing vlan 141 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:39:12.856848 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b33518d-3229-4b82-b802-c20cf43afbe7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:39:12.858865 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:39:12.860705 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-60e2ecfb-6bc3-4428-bcf8-de94b092ab6f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:12.860705 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60e2ecfb-6bc3-4428-bcf8-de94b092ab6f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:12.872728 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-00e718dc-e3f9-47bd-b6b2-f27400010fc2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:12.875288 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-00e718dc-e3f9-47bd-b6b2-f27400010fc2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:12.876804 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-00e718dc-e3f9-47bd-b6b2-f27400010fc2 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/6ed93d17-f72b-4798-a8c8-e7aa9862a531 HTTP/1.1" status: 204 len: 168 time: 0.2676117 Dec 09 21:39:12.887011 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60e2ecfb-6bc3-4428-bcf8-de94b092ab6f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Port': ['ID=e5ff5b5c-5b71-419b-bf1b-e45e51f9ccea,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:12.911069 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-60e2ecfb-6bc3-4428-bcf8-de94b092ab6f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 845 time: 0.9386096 Dec 09 21:39:12.914236 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57434) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:12.920599 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00e718dc-e3f9-47bd-b6b2-f27400010fc2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ed93d17-f72b-4798-a8c8-e7aa9862a531,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:12.946248 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b33518d-3229-4b82-b802-c20cf43afbe7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:12.956028 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b33518d-3229-4b82-b802-c20cf43afbe7 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:12.963151 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1b33518d-3229-4b82-b802-c20cf43afbe7 admin admin] 10.222.0.13 "DELETE /v2.0/networks/f0373886-3db8-47eb-af65-78244497171e HTTP/1.1" status: 204 len: 168 time: 1.2743657 Dec 09 21:39:12.964403 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57436) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:12.989727 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-774c2a05-5369-4d35-97de-5a0500c941ef tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:12.994457 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-774c2a05-5369-4d35-97de-5a0500c941ef tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports/e5ff5b5c-5b71-419b-bf1b-e45e51f9ccea HTTP/1.1" status: 200 len: 840 time: 0.0765316 Dec 09 21:39:12.994457 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57440) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:12.999197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b33518d-3229-4b82-b802-c20cf43afbe7 admin admin] Pushing event deleted for resources: {'Network': ['ID=f0373886-3db8-47eb-af65-78244497171e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:13.155808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-b7c8a83d-817a-4c09-8fc5-93bed0de80c9 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting port e5ff5b5c-5b71-419b-bf1b-e45e51f9ccea {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:13.156278 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7c8a83d-817a-4c09-8fc5-93bed0de80c9 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:13.278929 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7c8a83d-817a-4c09-8fc5-93bed0de80c9 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:13.302793 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-b7c8a83d-817a-4c09-8fc5-93bed0de80c9 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Calling delete_port for e5ff5b5c-5b71-419b-bf1b-e45e51f9ccea owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:13.488003 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-def3a1f9-448b-4bf2-93dd-ca47da57a510 req-3011a926-ec01-4d42-b24f-ed855cd2b299 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/ports?device_id=0436dc41-5aa7-49ed-ab16-926def9c60ce HTTP/1.1" status: 200 len: 210 time: 0.1634858 Dec 09 21:39:13.498446 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-759bf494-0909-4a72-8555-45f3812bb7aa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:13.548765 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7c8a83d-817a-4c09-8fc5-93bed0de80c9 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:13.581152 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7c8a83d-817a-4c09-8fc5-93bed0de80c9 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Port': ['ID=e5ff5b5c-5b71-419b-bf1b-e45e51f9ccea,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:13.590748 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7c8a83d-817a-4c09-8fc5-93bed0de80c9 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:13.597987 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b7c8a83d-817a-4c09-8fc5-93bed0de80c9 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/ports/e5ff5b5c-5b71-419b-bf1b-e45e51f9ccea HTTP/1.1" status: 204 len: 168 time: 0.5998425 Dec 09 21:39:13.599668 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57454) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:13.637287 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-4ffa0320-d0f8-4506-b100-8d11a96d4073 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] GET failed (client error): The resource could not be found. Dec 09 21:39:13.638756 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4ffa0320-d0f8-4506-b100-8d11a96d4073 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports/e5ff5b5c-5b71-419b-bf1b-e45e51f9ccea HTTP/1.1" status: 404 len: 333 time: 0.0381281 Dec 09 21:39:13.642348 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57460) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:13.653195 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c46c966a-e06d-4695-8084-6b7e83a8214f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'port': {'network_id': '12b747a3-de78-4645-83a0-a5e2eec09a63', 'name': 'tempest-PortsTestJSON-1347316791'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:13.688505 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57464) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:13.761557 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-22108b41-f091-47d3-a782-16d3a165c33e admin admin] Request body: {'network': {'name': 'tempest-TestServerAdvancedOps-781160381-network', 'tenant_id': '043e580fa3c545cdab2b7168775a5759'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:13.799027 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.db.api [None req-22108b41-f091-47d3-a782-16d3a165c33e admin admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Dec 09 21:39:13.799027 n-d-713301-27 neutron-server[103438]: [SQL: INSERT INTO reservations (project_id, id, expiration) VALUES (%(project_id)s, %(id)s, %(expiration)s)] Dec 09 21:39:13.799027 n-d-713301-27 neutron-server[103438]: [parameters: {'project_id': '043e580fa3c545cdab2b7168775a5759', 'id': '9b53d52d-3f73-4322-a047-61ac0a024505', 'expiration': datetime.datetime(2021, 12, 9, 21, 41, 13, 791548)}] Dec 09 21:39:13.799027 n-d-713301-27 neutron-server[103438]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=103438) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:39:13.799548 n-d-713301-27 neutron-server[103438]: DEBUG oslo_db.api [None req-22108b41-f091-47d3-a782-16d3a165c33e admin admin] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:39:13.809588 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c46c966a-e06d-4695-8084-6b7e83a8214f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:13.820982 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c46c966a-e06d-4695-8084-6b7e83a8214f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:13.880245 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-c46c966a-e06d-4695-8084-6b7e83a8214f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] device_id is not set on port e53104b8-f869-47dd-b4dc-c09afee5f2ba yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:39:13.958165 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 33623e1c-80ee-46d8-a56b-36b3b16079f6 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:39:13.974054 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-759bf494-0909-4a72-8555-45f3812bb7aa admin admin] Deleting port 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:13.978927 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-759bf494-0909-4a72-8555-45f3812bb7aa admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:14.009995 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 33623e1c-80ee-46d8-a56b-36b3b16079f6 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:39:14.011310 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 33623e1c-80ee-46d8-a56b-36b3b16079f6 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:39:14.101905 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c46c966a-e06d-4695-8084-6b7e83a8214f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:14.112145 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-759bf494-0909-4a72-8555-45f3812bb7aa admin admin] For port 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f,segment=NetworkSegment(cba73bdd-55aa-420b-957f-16ad6c3beaed),segment_id=cba73bdd-55aa-420b-957f-16ad6c3beaed)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:14.112526 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-759bf494-0909-4a72-8555-45f3812bb7aa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:14.133511 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-759bf494-0909-4a72-8555-45f3812bb7aa admin admin] Calling delete_port for 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:14.146728 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c46c966a-e06d-4695-8084-6b7e83a8214f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:14.201828 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c46c966a-e06d-4695-8084-6b7e83a8214f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network 12b747a3-de78-4645-83a0-a5e2eec09a63 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:39:14.205871 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-c46c966a-e06d-4695-8084-6b7e83a8214f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:14.210848 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c46c966a-e06d-4695-8084-6b7e83a8214f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:39:14.217405 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c46c966a-e06d-4695-8084-6b7e83a8214f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:14.218035 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c46c966a-e06d-4695-8084-6b7e83a8214f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:14.234011 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c46c966a-e06d-4695-8084-6b7e83a8214f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Port': ['ID=e53104b8-f869-47dd-b4dc-c09afee5f2ba,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:14.249647 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c46c966a-e06d-4695-8084-6b7e83a8214f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 846 time: 0.6051140 Dec 09 21:39:14.252178 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57484) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:14.261486 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-03fc828d-cb21-432b-8392-3ae55ea4544d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'port': {'name': 'New_Port', 'admin_state_up': False}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:14.353950 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-03fc828d-cb21-432b-8392-3ae55ea4544d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:14.399948 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-759bf494-0909-4a72-8555-45f3812bb7aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:14.406224 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-22108b41-f091-47d3-a782-16d3a165c33e admin admin] Made reservation on behalf of 043e580fa3c545cdab2b7168775a5759 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:14.409349 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-22108b41-f091-47d3-a782-16d3a165c33e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:14.423256 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-22108b41-f091-47d3-a782-16d3a165c33e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:14.451651 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-759bf494-0909-4a72-8555-45f3812bb7aa admin admin] Pushing event deleted for resources: {'Port': ['ID=7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:14.628435 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57500) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:14.780264 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-759bf494-0909-4a72-8555-45f3812bb7aa admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:14.807533 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ab7cdf47-99bc-4349-834a-5e432c23144f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:14.843473 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-03fc828d-cb21-432b-8392-3ae55ea4544d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:14.872854 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-03fc828d-cb21-432b-8392-3ae55ea4544d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:14.888334 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ab7cdf47-99bc-4349-834a-5e432c23144f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:14.936744 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-22108b41-f091-47d3-a782-16d3a165c33e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:14.948553 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-03fc828d-cb21-432b-8392-3ae55ea4544d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] In _notify_port_updated(), no bound segment for port e53104b8-f869-47dd-b4dc-c09afee5f2ba on network 12b747a3-de78-4645-83a0-a5e2eec09a63 {{(pid=103438) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:39:14.971885 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03fc828d-cb21-432b-8392-3ae55ea4544d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:14.972621 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-03fc828d-cb21-432b-8392-3ae55ea4544d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:14.973991 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-03fc828d-cb21-432b-8392-3ae55ea4544d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "PUT /v2.0/ports/e53104b8-f869-47dd-b4dc-c09afee5f2ba HTTP/1.1" status: 200 len: 818 time: 0.7192945 Dec 09 21:39:14.975159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57512) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:14.980279 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57514) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:14.981045 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-22108b41-f091-47d3-a782-16d3a165c33e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:14.994033 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-22108b41-f091-47d3-a782-16d3a165c33e admin admin] vlan segment allocate from pool success with {'vlan_id': 140, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:39:15.003921 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-22108b41-f091-47d3-a782-16d3a165c33e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:15.003921 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-22108b41-f091-47d3-a782-16d3a165c33e admin admin] Added segment 67e6119c-4e9a-41d7-9c8b-42b30eebd14a of type vlan for network 1449cd60-9b94-4b25-a551-c1e66610232e Dec 09 21:39:15.069457 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-22108b41-f091-47d3-a782-16d3a165c33e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:15.107303 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-759bf494-0909-4a72-8555-45f3812bb7aa admin admin] Router 31a00d4e-6581-4747-824c-a35acf7b5352 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:39:15.121823 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03fc828d-cb21-432b-8392-3ae55ea4544d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Port': ['ID=e53104b8-f869-47dd-b4dc-c09afee5f2ba,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:15.185171 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-d87243da-a32d-4545-9ed5-6c500cec6576 admin admin] Request body: {'network': {'name': 'tempest-ServerGroupTestJSON-1763708436-network', 'tenant_id': '37bf08f44fbc4ad89743914d8e228eb0'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:15.204805 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22108b41-f091-47d3-a782-16d3a165c33e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f44224f1-aa35-4d98-8069-cb8eef82c01b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:15.215479 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ab7cdf47-99bc-4349-834a-5e432c23144f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:15.218242 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ab7cdf47-99bc-4349-834a-5e432c23144f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:15.219900 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ab7cdf47-99bc-4349-834a-5e432c23144f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "DELETE /v2.0/security-groups/66e1817f-e10c-4faf-abd8-bc5e8fda7f97 HTTP/1.1" status: 204 len: 168 time: 0.5847631 Dec 09 21:39:15.232137 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57526) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:15.233475 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab7cdf47-99bc-4349-834a-5e432c23144f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=66e1817f-e10c-4faf-abd8-bc5e8fda7f97,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:15.243094 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-22108b41-f091-47d3-a782-16d3a165c33e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:15.244108 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-22108b41-f091-47d3-a782-16d3a165c33e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:15.244962 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-22108b41-f091-47d3-a782-16d3a165c33e admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:15.273962 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-0f9cb5d9-a3a9-47e3-9653-f0b35e9bb050 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] show failed (client error): The resource could not be found. Dec 09 21:39:15.275591 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0f9cb5d9-a3a9-47e3-9653-f0b35e9bb050 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "GET /v2.0/security-groups/66e1817f-e10c-4faf-abd8-bc5e8fda7f97 HTTP/1.1" status: 404 len: 347 time: 0.0387192 Dec 09 21:39:15.279093 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57528) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:15.293537 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d87243da-a32d-4545-9ed5-6c500cec6576 admin admin] Made reservation on behalf of 37bf08f44fbc4ad89743914d8e228eb0 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:15.296943 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d87243da-a32d-4545-9ed5-6c500cec6576 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:15.311095 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d87243da-a32d-4545-9ed5-6c500cec6576 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:15.323648 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-759bf494-0909-4a72-8555-45f3812bb7aa admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:39:15.331945 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-759bf494-0909-4a72-8555-45f3812bb7aa admin admin] 10.222.0.13 "PUT /v2.0/routers/31a00d4e-6581-4747-824c-a35acf7b5352/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3661883 Dec 09 21:39:15.335177 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57530) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:15.336908 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb56e600-13e4-4ba5-a4ba-e274d7dad1cb None None] Sync routers for ids ['31a00d4e-6581-4747-824c-a35acf7b5352'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:39:15.357794 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb56e600-13e4-4ba5-a4ba-e274d7dad1cb None None] Routers {'31a00d4e-6581-4747-824c-a35acf7b5352'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:39:15.358710 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-fb56e600-13e4-4ba5-a4ba-e274d7dad1cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:39:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['31a00d4e-6581-4747-824c-a35acf7b5352'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:15.396629 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-22108b41-f091-47d3-a782-16d3a165c33e admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 1.6397123 Dec 09 21:39:15.400753 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57534) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:15.408181 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-47e0e980-eb55-4afa-b3c6-8e56298a423d admin admin] Request body: {'subnet': {'network_id': '1449cd60-9b94-4b25-a551-c1e66610232e', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerAdvancedOps-781160381-subnet', 'tenant_id': '043e580fa3c545cdab2b7168775a5759', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:15.470837 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22108b41-f091-47d3-a782-16d3a165c33e admin admin] Pushing event updated for resources: {'Network': ['ID=1449cd60-9b94-4b25-a551-c1e66610232e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:15.481788 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-60b5a4bd-d636-4f2c-b35e-5ea4404f780f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting port e53104b8-f869-47dd-b4dc-c09afee5f2ba {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:15.482152 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60b5a4bd-d636-4f2c-b35e-5ea4404f780f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:15.507745 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-47e0e980-eb55-4afa-b3c6-8e56298a423d admin admin] Made reservation on behalf of 043e580fa3c545cdab2b7168775a5759 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:15.510640 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-47e0e980-eb55-4afa-b3c6-8e56298a423d admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:15.557543 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-fb56e600-13e4-4ba5-a4ba-e274d7dad1cb None None] Set router 31a00d4e-6581-4747-824c-a35acf7b5352 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:39:15.558413 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60b5a4bd-d636-4f2c-b35e-5ea4404f780f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:15.571350 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-60b5a4bd-d636-4f2c-b35e-5ea4404f780f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Calling delete_port for e53104b8-f869-47dd-b4dc-c09afee5f2ba owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:15.611316 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2228cb4a-e87c-461b-9da8-e6789546f4c0 admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:15.650532 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 1449cd60-9b94-4b25-a551-c1e66610232e details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:39:15.661694 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60b5a4bd-d636-4f2c-b35e-5ea4404f780f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:15.699831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-d60007c9-14c6-4b06-8635-90e5244cd4e0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Deleting port 9a59b751-0f89-4df2-b0c8-8fd95c5a1ea3 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:15.700012 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d60007c9-14c6-4b06-8635-90e5244cd4e0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:15.707678 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60b5a4bd-d636-4f2c-b35e-5ea4404f780f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:15.714146 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-60b5a4bd-d636-4f2c-b35e-5ea4404f780f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/ports/e53104b8-f869-47dd-b4dc-c09afee5f2ba HTTP/1.1" status: 204 len: 168 time: 0.6663160 Dec 09 21:39:15.715079 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60b5a4bd-d636-4f2c-b35e-5ea4404f780f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Port': ['ID=e53104b8-f869-47dd-b4dc-c09afee5f2ba,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:15.727543 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57538) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:15.727811 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57540) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:15.728303 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d87243da-a32d-4545-9ed5-6c500cec6576 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:15.841764 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d51cb8b-6442-4001-8066-6d487b65d864 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:15.846227 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0d51cb8b-6442-4001-8066-6d487b65d864 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 842 time: 0.1174192 Dec 09 21:39:15.850777 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57544) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:15.875713 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d60007c9-14c6-4b06-8635-90e5244cd4e0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:15.876112 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d60007c9-14c6-4b06-8635-90e5244cd4e0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:15.903570 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-2f6b39cf-6d0d-4b45-aa93-d09587f57829 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] GET failed (client error): The resource could not be found. Dec 09 21:39:15.909663 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2f6b39cf-6d0d-4b45-aa93-d09587f57829 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports/e53104b8-f869-47dd-b4dc-c09afee5f2ba HTTP/1.1" status: 404 len: 333 time: 0.0577457 Dec 09 21:39:15.910315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57546) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:15.916222 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-d60007c9-14c6-4b06-8635-90e5244cd4e0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Calling delete_port for 9a59b751-0f89-4df2-b0c8-8fd95c5a1ea3 owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:15.921415 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-14a38cbe-5dec-4d72-8be4-eadeb477a463 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-512820877'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:16.004623 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-085e49d4-ad6c-4155-9bfa-f83443d39105 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:16.008129 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-14a38cbe-5dec-4d72-8be4-eadeb477a463 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:16.011949 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-14a38cbe-5dec-4d72-8be4-eadeb477a463 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:16.101353 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-14a38cbe-5dec-4d72-8be4-eadeb477a463 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] vlan segment allocate from pool success with {'vlan_id': 119, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:39:16.124577 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-14a38cbe-5dec-4d72-8be4-eadeb477a463 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:16.124924 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-14a38cbe-5dec-4d72-8be4-eadeb477a463 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Added segment 75657263-ba28-4011-a293-01c4f28442f4 of type vlan for network e7bdf216-9307-460a-aa2d-f1a37aada31e Dec 09 21:39:16.148784 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d87243da-a32d-4545-9ed5-6c500cec6576 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:16.187682 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d87243da-a32d-4545-9ed5-6c500cec6576 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=67510712-ba9d-4f78-9590-39f7011e7609,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:16.218932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d87243da-a32d-4545-9ed5-6c500cec6576 admin admin] vlan segment allocate from pool success with {'vlan_id': 143, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:39:16.239600 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-47e0e980-eb55-4afa-b3c6-8e56298a423d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:16.240925 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-14a38cbe-5dec-4d72-8be4-eadeb477a463 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:16.244105 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d87243da-a32d-4545-9ed5-6c500cec6576 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:16.244702 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-d87243da-a32d-4545-9ed5-6c500cec6576 admin admin] Added segment 1e281a9e-ceca-4b82-a4db-f71cde3ef950 of type vlan for network 6234858b-69ec-4f21-b01b-eb3e9bd6848b Dec 09 21:39:16.259127 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d60007c9-14c6-4b06-8635-90e5244cd4e0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:16.276344 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2228cb4a-e87c-461b-9da8-e6789546f4c0 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:16.309121 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-085e49d4-ad6c-4155-9bfa-f83443d39105 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:16.311964 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d60007c9-14c6-4b06-8635-90e5244cd4e0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event deleted for resources: {'Port': ['ID=9a59b751-0f89-4df2-b0c8-8fd95c5a1ea3,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:16.322885 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-085e49d4-ad6c-4155-9bfa-f83443d39105 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:16.343905 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c2e6280e-f346-4fde-8840-b9ae0d0f52a1 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:39:16.357565 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-14a38cbe-5dec-4d72-8be4-eadeb477a463 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:16.364035 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14a38cbe-5dec-4d72-8be4-eadeb477a463 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:16.364642 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-14a38cbe-5dec-4d72-8be4-eadeb477a463 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:16.364756 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d87243da-a32d-4545-9ed5-6c500cec6576 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:16.373936 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47e0e980-eb55-4afa-b3c6-8e56298a423d admin admin] Pushing event updated for resources: {'Subnet': ['ID=12b57eb6-5bed-4a5e-b2a3-38e67792abc0,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:16.398231 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-fb56e600-13e4-4ba5-a4ba-e274d7dad1cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '31a00d4e-6581-4747-824c-a35acf7b5352', 'name': 'tempest-TaggedBootDevicesTest-1740845933-router', 'tenant_id': 'f8441d8d390b442691a162db541a51b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.158'}], 'enable_snat': True}, 'gw_port_id': '2400575d-0b51-48ba-bd46-ed904f5cdbcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:10Z', 'updated_at': '2021-12-09T21:39:14Z', 'revision_number': 5, 'project_id': 'f8441d8d390b442691a162db541a51b0', 'gw_port': {'id': '2400575d-0b51-48ba-bd46-ed904f5cdbcd', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:0d:d4:57', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '31a00d4e-6581-4747-824c-a35acf7b5352', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1093, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.158', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:11Z', 'updated_at': '2021-12-09T21:27:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:16.423342 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47e0e980-eb55-4afa-b3c6-8e56298a423d admin admin] Checking segment: {'id': '67e6119c-4e9a-41d7-9c8b-42b30eebd14a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '1449cd60-9b94-4b25-a551-c1e66610232e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:39:16.424046 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-47e0e980-eb55-4afa-b3c6-8e56298a423d admin admin] Network hostable DHCP agents. Network: 1449cd60-9b94-4b25-a551-c1e66610232e, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:39:16.430279 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d87243da-a32d-4545-9ed5-6c500cec6576 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:16.431489 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d87243da-a32d-4545-9ed5-6c500cec6576 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:16.432219 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d87243da-a32d-4545-9ed5-6c500cec6576 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:16.453701 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb56e600-13e4-4ba5-a4ba-e274d7dad1cb None None] Checking router: 31a00d4e-6581-4747-824c-a35acf7b5352 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:39:16.456052 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-085e49d4-ad6c-4155-9bfa-f83443d39105 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e5409b14-8895-41fd-82d1-f90da0451d05,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:16.465547 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-085e49d4-ad6c-4155-9bfa-f83443d39105 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=6803cae23d3349aaad64bb4226ed514b&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7328527 Dec 09 21:39:16.473094 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb56e600-13e4-4ba5-a4ba-e274d7dad1cb None None] Routers {'31a00d4e-6581-4747-824c-a35acf7b5352'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:39:16.473725 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-fb56e600-13e4-4ba5-a4ba-e274d7dad1cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:39:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['31a00d4e-6581-4747-824c-a35acf7b5352'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:16.475186 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57552) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:16.528873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-2228cb4a-e87c-461b-9da8-e6789546f4c0 admin admin] Deleting port 2400575d-0b51-48ba-bd46-ed904f5cdbcd {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:16.529498 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2228cb4a-e87c-461b-9da8-e6789546f4c0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:16.534168 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d87243da-a32d-4545-9ed5-6c500cec6576 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 1.5578296 Dec 09 21:39:16.541491 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-14a38cbe-5dec-4d72-8be4-eadeb477a463 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.6264725 Dec 09 21:39:16.542595 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14a38cbe-5dec-4d72-8be4-eadeb477a463 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Network': ['ID=e7bdf216-9307-460a-aa2d-f1a37aada31e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:16.546133 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57556) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:16.546573 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57558) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:16.555655 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network e7bdf216-9307-460a-aa2d-f1a37aada31e details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:39:16.556887 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-7090abcb-f566-4f8e-8f28-612130e56157 admin admin] Request body: {'subnet': {'network_id': '6234858b-69ec-4f21-b01b-eb3e9bd6848b', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerGroupTestJSON-1763708436-subnet', 'tenant_id': '37bf08f44fbc4ad89743914d8e228eb0', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:16.589793 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-5aa53306-b8c5-4b82-aba5-532535a65582 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'subnet': {'network_id': 'e7bdf216-9307-460a-aa2d-f1a37aada31e', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:16.600374 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d60007c9-14c6-4b06-8635-90e5244cd4e0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:16.604034 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d60007c9-14c6-4b06-8635-90e5244cd4e0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:16.608032 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d60007c9-14c6-4b06-8635-90e5244cd4e0 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "DELETE /v2.0/floatingips/3435483a-a00a-4fba-97af-9cb9ff87f279 HTTP/1.1" status: 204 len: 168 time: 1.3145156 Dec 09 21:39:16.608032 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7090abcb-f566-4f8e-8f28-612130e56157 admin admin] Made reservation on behalf of 37bf08f44fbc4ad89743914d8e228eb0 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:16.609676 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7090abcb-f566-4f8e-8f28-612130e56157 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:16.611693 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-47e0e980-eb55-4afa-b3c6-8e56298a423d admin admin] Network 1449cd60-9b94-4b25-a551-c1e66610232e is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:39:16.613864 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57560) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:16.625679 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57564) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:16.637596 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d87243da-a32d-4545-9ed5-6c500cec6576 admin admin] Pushing event updated for resources: {'Network': ['ID=6234858b-69ec-4f21-b01b-eb3e9bd6848b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:16.664295 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 6234858b-69ec-4f21-b01b-eb3e9bd6848b details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:39:16.673799 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-fb56e600-13e4-4ba5-a4ba-e274d7dad1cb None None] Set router 31a00d4e-6581-4747-824c-a35acf7b5352 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:39:16.702339 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-47e0e980-eb55-4afa-b3c6-8e56298a423d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 1449cd60-9b94-4b25-a551-c1e66610232e) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:16.728342 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47e0e980-eb55-4afa-b3c6-8e56298a423d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:16.728946 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-47e0e980-eb55-4afa-b3c6-8e56298a423d admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:16.747870 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-671490ef-97e6-4ab6-99f2-f0c93d401411 None None] Network 1449cd60-9b94-4b25-a551-c1e66610232e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:16.771689 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e7b651a2-6993-4462-bca8-4b94d3014940 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:16.775930 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-fb56e600-13e4-4ba5-a4ba-e274d7dad1cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '31a00d4e-6581-4747-824c-a35acf7b5352', 'name': 'tempest-TaggedBootDevicesTest-1740845933-router', 'tenant_id': 'f8441d8d390b442691a162db541a51b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:10Z', 'updated_at': '2021-12-09T21:39:16Z', 'revision_number': 6, 'project_id': 'f8441d8d390b442691a162db541a51b0', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:16.799017 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-47e0e980-eb55-4afa-b3c6-8e56298a423d admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.3951936 Dec 09 21:39:16.816372 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-2228cb4a-e87c-461b-9da8-e6789546f4c0 admin admin] For port 2400575d-0b51-48ba-bd46-ed904f5cdbcd, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2400575d-0b51-48ba-bd46-ed904f5cdbcd,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:16.816754 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2228cb4a-e87c-461b-9da8-e6789546f4c0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:16.834151 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e7b651a2-6993-4462-bca8-4b94d3014940 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:16.845311 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-2228cb4a-e87c-461b-9da8-e6789546f4c0 admin admin] Calling delete_port for 2400575d-0b51-48ba-bd46-ed904f5cdbcd owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:16.892419 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb56e600-13e4-4ba5-a4ba-e274d7dad1cb None None] The sync data for ids ['31a00d4e-6581-4747-824c-a35acf7b5352'] in n-d-713301-27 is: [{'id': '31a00d4e-6581-4747-824c-a35acf7b5352', 'name': 'tempest-TaggedBootDevicesTest-1740845933-router', 'tenant_id': 'f8441d8d390b442691a162db541a51b0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:10Z', 'updated_at': '2021-12-09T21:39:16Z', 'revision_number': 6, 'project_id': 'f8441d8d390b442691a162db541a51b0', 'gw_port_host': None}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:39:16.932788 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c8eea089-02ec-4895-b59c-7908caf9aa31 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Deleting port 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:16.933138 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8eea089-02ec-4895-b59c-7908caf9aa31 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:17.007722 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f6fadedd-3de1-4d79-85f7-ddf4b85449de None None] Network 1449cd60-9b94-4b25-a551-c1e66610232e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:17.084366 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e7b651a2-6993-4462-bca8-4b94d3014940 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:17.087198 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e7b651a2-6993-4462-bca8-4b94d3014940 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:17.088526 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e7b651a2-6993-4462-bca8-4b94d3014940 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/e5409b14-8895-41fd-82d1-f90da0451d05 HTTP/1.1" status: 204 len: 168 time: 0.6084390 Dec 09 21:39:17.106921 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7b651a2-6993-4462-bca8-4b94d3014940 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e5409b14-8895-41fd-82d1-f90da0451d05,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:17.198771 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8eea089-02ec-4895-b59c-7908caf9aa31 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:17.218909 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c8eea089-02ec-4895-b59c-7908caf9aa31 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Calling delete_port for 1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:17.284714 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2228cb4a-e87c-461b-9da8-e6789546f4c0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:17.318996 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-94659971-1693-4674-8b51-59e40e2e542e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:17.338238 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2228cb4a-e87c-461b-9da8-e6789546f4c0 admin admin] Pushing event deleted for resources: {'Port': ['ID=2400575d-0b51-48ba-bd46-ed904f5cdbcd,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:17.364791 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1a27054e-8921-40c0-828d-8735e483ade7 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:39:17.434746 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-94659971-1693-4674-8b51-59e40e2e542e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:17.452311 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-94659971-1693-4674-8b51-59e40e2e542e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:17.474329 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2228cb4a-e87c-461b-9da8-e6789546f4c0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:17.504538 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-94659971-1693-4674-8b51-59e40e2e542e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=d6d3650ab5ee4d38a726e63eecc1592a&name=default HTTP/1.1" status: 200 len: 3000 time: 0.8772590 Dec 09 21:39:17.514084 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57584) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:17.526618 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5aa53306-b8c5-4b82-aba5-532535a65582 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:17.530169 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5aa53306-b8c5-4b82-aba5-532535a65582 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:17.603845 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94659971-1693-4674-8b51-59e40e2e542e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d4c57485-6732-4682-b71a-c5c999960d74,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:17.606255 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57594) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:17.613175 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2228cb4a-e87c-461b-9da8-e6789546f4c0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:17.623700 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2228cb4a-e87c-461b-9da8-e6789546f4c0 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:17.637054 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-763de736-cf2f-45b3-9fa9-50a274ce6f4b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:17.681711 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8eea089-02ec-4895-b59c-7908caf9aa31 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:17.724829 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8eea089-02ec-4895-b59c-7908caf9aa31 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event deleted for resources: {'Port': ['ID=1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:17.727743 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2228cb4a-e87c-461b-9da8-e6789546f4c0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:17.728438 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2228cb4a-e87c-461b-9da8-e6789546f4c0 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 31a00d4e-6581-4747-824c-a35acf7b5352 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:39:17.732601 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2228cb4a-e87c-461b-9da8-e6789546f4c0 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:17.736435 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2228cb4a-e87c-461b-9da8-e6789546f4c0 admin admin] 10.222.0.13 "DELETE /v2.0/routers/31a00d4e-6581-4747-824c-a35acf7b5352 HTTP/1.1" status: 204 len: 168 time: 2.3974011 Dec 09 21:39:17.738239 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57596) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:17.835479 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8eea089-02ec-4895-b59c-7908caf9aa31 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:17.842636 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c8eea089-02ec-4895-b59c-7908caf9aa31 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "DELETE /v2.0/ports/1c0cd3a8-e3ff-46ea-89da-1a8ad0e4449f HTTP/1.1" status: 204 len: 168 time: 1.2222886 Dec 09 21:39:17.844503 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57600) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:17.902058 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-05c23d1d-ebf3-4e20-9237-8c6008b1fcab admin admin] Deleting subnet feaf79a7-d79d-4e19-b68a-52abdef41e8b {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:39:17.925273 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-05c23d1d-ebf3-4e20-9237-8c6008b1fcab admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:17.928313 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-763de736-cf2f-45b3-9fa9-50a274ce6f4b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:17.937826 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2400575d-0b51-48ba-bd46-ed904f5cdbcd no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:39:17.938014 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-763de736-cf2f-45b3-9fa9-50a274ce6f4b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:17.957834 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 2400575d-0b51-48ba-bd46-ed904f5cdbcd {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:39:17.958182 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2400575d-0b51-48ba-bd46-ed904f5cdbcd not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:39:17.958596 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:39:17.973869 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7090abcb-f566-4f8e-8f28-612130e56157 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:17.990925 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:39:17.991315 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7c3ad1fb-c2f3-4d0b-bd3b-1287652b670f not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:39:18.003989 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-34820ebc-a058-4bc6-804a-979f0bd987c5 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:18.007722 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-763de736-cf2f-45b3-9fa9-50a274ce6f4b admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ce1bde20387c45da9e5fc5ed2d3b1d1e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3951881 Dec 09 21:39:18.007868 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-34820ebc-a058-4bc6-804a-979f0bd987c5 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/networks?id=a71f32bb-6d3a-4295-a0cb-027407f942be HTTP/1.1" status: 200 len: 811 time: 0.4077389 Dec 09 21:39:18.008166 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57602) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:18.011133 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-763de736-cf2f-45b3-9fa9-50a274ce6f4b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c2a3aab3-a6d1-41bd-8b86-9063cdfb4652,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:18.049049 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-05c23d1d-ebf3-4e20-9237-8c6008b1fcab admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:18.061833 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-22f1b38c-579b-4090-897a-8592a27d3513 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Deleting port 18d9d7fa-fedf-4844-90ef-6757eb984ae2 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:18.062184 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-22f1b38c-579b-4090-897a-8592a27d3513 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:18.082336 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1a405f73-ce6d-4f53-9003-e1ec091243e3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:18.105803 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d58d4d36-86c9-402e-93ef-1b4f0db5da53 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:18.143627 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7090abcb-f566-4f8e-8f28-612130e56157 admin admin] Pushing event updated for resources: {'Subnet': ['ID=442ba23b-1dd6-4dce-ba48-8a9cc723c83d,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:18.171290 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5aa53306-b8c5-4b82-aba5-532535a65582 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:18.176858 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d58d4d36-86c9-402e-93ef-1b4f0db5da53 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:18.184874 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-ea001619-a239-49c7-98a4-0e2068e48f0d tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/quotas/ec2fddf1ed684b7e8c8deb49d8c06a18 HTTP/1.1" status: 200 len: 375 time: 0.0764155 Dec 09 21:39:18.195910 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1a405f73-ce6d-4f53-9003-e1ec091243e3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:18.212090 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-22f1b38c-579b-4090-897a-8592a27d3513 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:18.227679 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7090abcb-f566-4f8e-8f28-612130e56157 admin admin] Checking segment: {'id': '1e281a9e-ceca-4b82-a4db-f71cde3ef950', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '6234858b-69ec-4f21-b01b-eb3e9bd6848b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:39:18.228058 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7090abcb-f566-4f8e-8f28-612130e56157 admin admin] Network hostable DHCP agents. Network: 6234858b-69ec-4f21-b01b-eb3e9bd6848b, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:39:18.242113 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-22f1b38c-579b-4090-897a-8592a27d3513 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Calling delete_port for 18d9d7fa-fedf-4844-90ef-6757eb984ae2 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:18.319933 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d58d4d36-86c9-402e-93ef-1b4f0db5da53 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:18.323183 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d58d4d36-86c9-402e-93ef-1b4f0db5da53 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:18.324417 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d58d4d36-86c9-402e-93ef-1b4f0db5da53 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/c2a3aab3-a6d1-41bd-8b86-9063cdfb4652 HTTP/1.1" status: 204 len: 168 time: 0.3141863 Dec 09 21:39:18.338066 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d58d4d36-86c9-402e-93ef-1b4f0db5da53 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c2a3aab3-a6d1-41bd-8b86-9063cdfb4652,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:18.343891 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-528bfc5c-94d5-48a3-8d43-2c36b5497d9a tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=ec2fddf1ed684b7e8c8deb49d8c06a18&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1196046 Dec 09 21:39:18.368023 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7090abcb-f566-4f8e-8f28-612130e56157 admin admin] Network 6234858b-69ec-4f21-b01b-eb3e9bd6848b is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:39:18.385091 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5aa53306-b8c5-4b82-aba5-532535a65582 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Subnet': ['ID=95ad4dcb-14e2-441c-a38e-b25e43db09c8,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:18.404855 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-7090abcb-f566-4f8e-8f28-612130e56157 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 6234858b-69ec-4f21-b01b-eb3e9bd6848b) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:18.409392 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7090abcb-f566-4f8e-8f28-612130e56157 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:18.410171 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7090abcb-f566-4f8e-8f28-612130e56157 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:18.413299 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-05c23d1d-ebf3-4e20-9237-8c6008b1fcab admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:18.424941 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0fe0655d-e061-4385-87c3-2b7c2c920b12 None None] Network 6234858b-69ec-4f21-b01b-eb3e9bd6848b requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:18.451090 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5aa53306-b8c5-4b82-aba5-532535a65582 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Checking segment: {'id': '75657263-ba28-4011-a293-01c4f28442f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'e7bdf216-9307-460a-aa2d-f1a37aada31e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:39:18.451485 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5aa53306-b8c5-4b82-aba5-532535a65582 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network hostable DHCP agents. Network: e7bdf216-9307-460a-aa2d-f1a37aada31e, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:39:18.460996 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-22f1b38c-579b-4090-897a-8592a27d3513 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:18.468931 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7090abcb-f566-4f8e-8f28-612130e56157 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.9197514 Dec 09 21:39:18.469666 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1a405f73-ce6d-4f53-9003-e1ec091243e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:18.472397 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1a405f73-ce6d-4f53-9003-e1ec091243e3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:18.473471 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1a405f73-ce6d-4f53-9003-e1ec091243e3 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/d4c57485-6732-4682-b71a-c5c999960d74 HTTP/1.1" status: 204 len: 168 time: 0.9584365 Dec 09 21:39:18.498026 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a405f73-ce6d-4f53-9003-e1ec091243e3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d4c57485-6732-4682-b71a-c5c999960d74,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:18.514600 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5aa53306-b8c5-4b82-aba5-532535a65582 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network e7bdf216-9307-460a-aa2d-f1a37aada31e is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:39:18.534425 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22f1b38c-579b-4090-897a-8592a27d3513 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event deleted for resources: {'Port': ['ID=18d9d7fa-fedf-4844-90ef-6757eb984ae2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:18.551705 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-5aa53306-b8c5-4b82-aba5-532535a65582 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, e7bdf216-9307-460a-aa2d-f1a37aada31e) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:18.558112 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5aa53306-b8c5-4b82-aba5-532535a65582 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:18.558777 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5aa53306-b8c5-4b82-aba5-532535a65582 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:18.564074 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-05c23d1d-ebf3-4e20-9237-8c6008b1fcab admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:18.564973 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9738a049-e5b9-452f-8757-9c79031e1a24 None None] Network 6234858b-69ec-4f21-b01b-eb3e9bd6848b requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:18.609353 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e34260bd-6c34-4282-80c0-0dfd367f0db8 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:39:18.617997 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e34260bd-6c34-4282-80c0-0dfd367f0db8 service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.2732096 Dec 09 21:39:18.631522 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-05c23d1d-ebf3-4e20-9237-8c6008b1fcab admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:18.634987 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-05c23d1d-ebf3-4e20-9237-8c6008b1fcab admin admin] 10.222.0.13 "DELETE /v2.0/subnets/feaf79a7-d79d-4e19-b68a-52abdef41e8b HTTP/1.1" status: 204 len: 168 time: 0.8924510 Dec 09 21:39:18.635893 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05c23d1d-ebf3-4e20-9237-8c6008b1fcab admin admin] Pushing event deleted for resources: {'Subnet': ['ID=feaf79a7-d79d-4e19-b68a-52abdef41e8b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:18.647904 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57612) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:18.649820 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d0a9a67-195a-4143-8be3-2e6d2e8c588e None None] Network e7bdf216-9307-460a-aa2d-f1a37aada31e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:18.653280 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49f44491-c8f9-4443-bd12-685593f6776a None None] Network fc8cdf15-d749-4170-8af1-e4f121fd1c72 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:18.663352 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5aa53306-b8c5-4b82-aba5-532535a65582 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 2.0805819 Dec 09 21:39:18.668543 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57614) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:18.677724 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-de01aaa2-2331-46fe-a400-2c2207a3083f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'subnet': {'network_id': 'e7bdf216-9307-460a-aa2d-f1a37aada31e', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:18.709014 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-22f1b38c-579b-4090-897a-8592a27d3513 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:18.713009 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-22f1b38c-579b-4090-897a-8592a27d3513 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "DELETE /v2.0/ports/18d9d7fa-fedf-4844-90ef-6757eb984ae2 HTTP/1.1" status: 204 len: 168 time: 0.8675668 Dec 09 21:39:18.720191 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57618) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:18.906299 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e469ba9a-6072-4e73-aad1-34b53d0ebdb5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-e7bdf216-9307-460a-aa2d-f1a37aada31e', 'network_id': 'e7bdf216-9307-460a-aa2d-f1a37aada31e', 'project_id': 'e8bdea0c320d4955bc3ba905696bda85', 'fixed_ips': [{'subnet_id': '95ad4dcb-14e2-441c-a38e-b25e43db09c8'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:39:18.907207 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e469ba9a-6072-4e73-aad1-34b53d0ebdb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:18.917221 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-849d1a17-8208-4d22-ada9-bce93b975c3a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:18.934900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-6c647d8a-6ec8-4d26-ab07-6f07c719b377 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Deleting subnet 2b4dff83-a3e7-4d10-a901-43c21154e5da {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:39:18.949748 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c647d8a-6ec8-4d26-ab07-6f07c719b377 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:19.059668 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-235ed5a6-5691-4846-8203-6735c1e39bd7 None None] DHCP port deletion for fc8cdf15-d749-4170-8af1-e4f121fd1c72 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:39:19.074307 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c647d8a-6ec8-4d26-ab07-6f07c719b377 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:19.126330 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-4c16e698-d4b1-49ed-bbd4-2957a5d77d7b service neutron] 10.222.0.13 "GET /v2.0/networks/a71f32bb-6d3a-4295-a0cb-027407f942be?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5067043 Dec 09 21:39:19.163647 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-de01aaa2-2331-46fe-a400-2c2207a3083f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:19.171370 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de01aaa2-2331-46fe-a400-2c2207a3083f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:19.219177 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57632) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:19.226647 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-235ed5a6-5691-4846-8203-6735c1e39bd7 None None] Deleting port e50fe61d-462c-4e08-9b0a-318666886803 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:19.227099 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-235ed5a6-5691-4846-8203-6735c1e39bd7 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:19.243125 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-e469ba9a-6072-4e73-aad1-34b53d0ebdb5 None None] Allocated IP 172.20.0.2 (e7bdf216-9307-460a-aa2d-f1a37aada31e/95ad4dcb-14e2-441c-a38e-b25e43db09c8/cf0495d5-be33-4a6e-95b9-f79fa439861d) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:39:19.277827 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7a1b1d63-c451-4ecd-bfad-ef1e2bef3f91 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:19.285190 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-849d1a17-8208-4d22-ada9-bce93b975c3a admin admin] Deleting port e50fe61d-462c-4e08-9b0a-318666886803 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:19.285525 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-849d1a17-8208-4d22-ada9-bce93b975c3a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:19.318791 n-d-713301-27 neutron-server[103437]: INFO neutron.db.ipam_backend_mixin [None req-de01aaa2-2331-46fe-a400-2c2207a3083f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet 95ad4dcb-14e2-441c-a38e-b25e43db09c8 (CIDR: 172.20.0.0/28) Dec 09 21:39:19.324392 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-235ed5a6-5691-4846-8203-6735c1e39bd7 None None] For port e50fe61d-462c-4e08-9b0a-318666886803, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e50fe61d-462c-4e08-9b0a-318666886803,segment=NetworkSegment(cba73bdd-55aa-420b-957f-16ad6c3beaed),segment_id=cba73bdd-55aa-420b-957f-16ad6c3beaed)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:19.325051 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-235ed5a6-5691-4846-8203-6735c1e39bd7 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:19.326939 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-de01aaa2-2331-46fe-a400-2c2207a3083f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:39:19.327421 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-de01aaa2-2331-46fe-a400-2c2207a3083f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:39:19.348448 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-235ed5a6-5691-4846-8203-6735c1e39bd7 None None] Calling delete_port for e50fe61d-462c-4e08-9b0a-318666886803 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:19.355337 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e810264b-0071-4802-b8ed-6fd5a7a278d4 service neutron] 10.222.0.13 "GET /v2.0/networks/a71f32bb-6d3a-4295-a0cb-027407f942be?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2280061 Dec 09 21:39:19.388671 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-de01aaa2-2331-46fe-a400-2c2207a3083f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.7190130 Dec 09 21:39:19.391590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57634) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:19.397570 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-7fe85cdb-174e-4748-9eeb-44e05612f44a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'subnet': {'network_id': 'e7bdf216-9307-460a-aa2d-f1a37aada31e', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:19.473450 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-849d1a17-8208-4d22-ada9-bce93b975c3a admin admin] For port e50fe61d-462c-4e08-9b0a-318666886803, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e50fe61d-462c-4e08-9b0a-318666886803,segment=NetworkSegment(cba73bdd-55aa-420b-957f-16ad6c3beaed),segment_id=cba73bdd-55aa-420b-957f-16ad6c3beaed)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:19.474096 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-849d1a17-8208-4d22-ada9-bce93b975c3a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:19.497206 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-849d1a17-8208-4d22-ada9-bce93b975c3a admin admin] Calling delete_port for e50fe61d-462c-4e08-9b0a-318666886803 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:19.499358 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c647d8a-6ec8-4d26-ab07-6f07c719b377 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:19.528262 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e469ba9a-6072-4e73-aad1-34b53d0ebdb5 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:19.544994 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-235ed5a6-5691-4846-8203-6735c1e39bd7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:19.557242 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e469ba9a-6072-4e73-aad1-34b53d0ebdb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:19.562490 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-235ed5a6-5691-4846-8203-6735c1e39bd7 None None] No DVR routers for this DVR port e50fe61d-462c-4e08-9b0a-318666886803 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:39:19.606258 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-235ed5a6-5691-4846-8203-6735c1e39bd7 None None] Pushing event deleted for resources: {'Port': ['ID=e50fe61d-462c-4e08-9b0a-318666886803,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:19.656416 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e469ba9a-6072-4e73-aad1-34b53d0ebdb5 None None] Pushing event updated for resources: {'Port': ['ID=cf0495d5-be33-4a6e-95b9-f79fa439861d,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:19.662047 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7a1b1d63-c451-4ecd-bfad-ef1e2bef3f91 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:19.670252 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7a1b1d63-c451-4ecd-bfad-ef1e2bef3f91 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:19.673651 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c647d8a-6ec8-4d26-ab07-6f07c719b377 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:19.677479 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e469ba9a-6072-4e73-aad1-34b53d0ebdb5 None None] Network e7bdf216-9307-460a-aa2d-f1a37aada31e is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:39:19.679114 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-e469ba9a-6072-4e73-aad1-34b53d0ebdb5 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:19.684223 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e469ba9a-6072-4e73-aad1-34b53d0ebdb5 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:39:19.724490 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7a1b1d63-c451-4ecd-bfad-ef1e2bef3f91 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=dde1b73a318e415eba71c28d3f81309e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5032923 Dec 09 21:39:19.727707 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57650) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:19.738832 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c647d8a-6ec8-4d26-ab07-6f07c719b377 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event deleted for resources: {'Subnet': ['ID=2b4dff83-a3e7-4d10-a901-43c21154e5da,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:19.740646 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7fe85cdb-174e-4748-9eeb-44e05612f44a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:19.743093 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-849d1a17-8208-4d22-ada9-bce93b975c3a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:19.744232 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7fe85cdb-174e-4748-9eeb-44e05612f44a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:19.785336 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a1b1d63-c451-4ecd-bfad-ef1e2bef3f91 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=85fd237d-fda2-4939-a443-3ced636792a4,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:19.797278 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c647d8a-6ec8-4d26-ab07-6f07c719b377 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:19.799307 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-849d1a17-8208-4d22-ada9-bce93b975c3a admin admin] No DVR routers for this DVR port e50fe61d-462c-4e08-9b0a-318666886803 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:39:19.803571 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6c647d8a-6ec8-4d26-ab07-6f07c719b377 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "DELETE /v2.0/subnets/2b4dff83-a3e7-4d10-a901-43c21154e5da HTTP/1.1" status: 204 len: 168 time: 1.0796471 Dec 09 21:39:19.804857 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57652) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:19.805782 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-849d1a17-8208-4d22-ada9-bce93b975c3a admin admin] Pushing event deleted for resources: {'Port': ['ID=e50fe61d-462c-4e08-9b0a-318666886803,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:19.818789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ff6cde06-56d2-4fe6-9fdc-95c613098623 None None] Network ae9d25d5-c9a2-4627-a465-8324b17541d9 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:19.869466 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e469ba9a-6072-4e73-aad1-34b53d0ebdb5 None None] Attempting to bind port cf0495d5-be33-4a6e-95b9-f79fa439861d on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:39:19.869844 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e469ba9a-6072-4e73-aad1-34b53d0ebdb5 None None] Attempting to bind port cf0495d5-be33-4a6e-95b9-f79fa439861d by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '75657263-ba28-4011-a293-01c4f28442f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'e7bdf216-9307-460a-aa2d-f1a37aada31e'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:39:19.870210 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e469ba9a-6072-4e73-aad1-34b53d0ebdb5 None None] Attempting to bind port cf0495d5-be33-4a6e-95b9-f79fa439861d on network e7bdf216-9307-460a-aa2d-f1a37aada31e {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:39:19.903894 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e469ba9a-6072-4e73-aad1-34b53d0ebdb5 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 39, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:39:19.907298 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e469ba9a-6072-4e73-aad1-34b53d0ebdb5 None None] Checking segment: {'id': '75657263-ba28-4011-a293-01c4f28442f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'e7bdf216-9307-460a-aa2d-f1a37aada31e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:39:19.907298 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e469ba9a-6072-4e73-aad1-34b53d0ebdb5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:19.907900 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e469ba9a-6072-4e73-aad1-34b53d0ebdb5 None None] Bound using segment: {'id': '75657263-ba28-4011-a293-01c4f28442f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'e7bdf216-9307-460a-aa2d-f1a37aada31e'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:39:19.908366 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e469ba9a-6072-4e73-aad1-34b53d0ebdb5 None None] Bound port: cf0495d5-be33-4a6e-95b9-f79fa439861d, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '75657263-ba28-4011-a293-01c4f28442f4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'e7bdf216-9307-460a-aa2d-f1a37aada31e'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:39:19.908860 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e469ba9a-6072-4e73-aad1-34b53d0ebdb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:19.915217 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-bdfe510d-45aa-441c-b810-8e46f1ec5e3f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Deleting subnet 871c2dc1-486e-4fcf-a882-5a1394082fc5 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:39:19.926758 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bdfe510d-45aa-441c-b810-8e46f1ec5e3f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:19.954837 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5432b1b5-9975-48f4-b13a-9d9d82d0875d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:19.966965 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-849d1a17-8208-4d22-ada9-bce93b975c3a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:20.015931 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-849d1a17-8208-4d22-ada9-bce93b975c3a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fc8cdf15-d749-4170-8af1-e4f121fd1c72']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:20.029277 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-849d1a17-8208-4d22-ada9-bce93b975c3a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cba73bdd-55aa-420b-957f-16ad6c3beaed') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:20.029672 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-849d1a17-8208-4d22-ada9-bce93b975c3a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cba73bdd-55aa-420b-957f-16ad6c3beaed') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:20.041280 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bdfe510d-45aa-441c-b810-8e46f1ec5e3f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:20.041410 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-849d1a17-8208-4d22-ada9-bce93b975c3a admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:20.058297 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-849d1a17-8208-4d22-ada9-bce93b975c3a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:20.066782 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-849d1a17-8208-4d22-ada9-bce93b975c3a admin admin] Releasing vlan 113 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:39:20.067414 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-849d1a17-8208-4d22-ada9-bce93b975c3a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:39:20.138529 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:39:20.149366 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-849d1a17-8208-4d22-ada9-bce93b975c3a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:20.167866 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-849d1a17-8208-4d22-ada9-bce93b975c3a admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:20.177641 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-849d1a17-8208-4d22-ada9-bce93b975c3a admin admin] 10.222.0.13 "DELETE /v2.0/networks/fc8cdf15-d749-4170-8af1-e4f121fd1c72 HTTP/1.1" status: 204 len: 168 time: 1.5260694 Dec 09 21:39:20.210846 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5432b1b5-9975-48f4-b13a-9d9d82d0875d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:20.213842 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-849d1a17-8208-4d22-ada9-bce93b975c3a admin admin] Pushing event deleted for resources: {'Network': ['ID=fc8cdf15-d749-4170-8af1-e4f121fd1c72,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:20.297516 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5432b1b5-9975-48f4-b13a-9d9d82d0875d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:20.301622 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5432b1b5-9975-48f4-b13a-9d9d82d0875d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:20.303814 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5432b1b5-9975-48f4-b13a-9d9d82d0875d admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/85fd237d-fda2-4939-a443-3ced636792a4 HTTP/1.1" status: 204 len: 168 time: 0.5751021 Dec 09 21:39:20.318100 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5432b1b5-9975-48f4-b13a-9d9d82d0875d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=85fd237d-fda2-4939-a443-3ced636792a4,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:20.370589 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bdfe510d-45aa-441c-b810-8e46f1ec5e3f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:20.445614 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-353dabe5-eaba-4d03-9df9-5bb37a50fc38 req-eb29d70d-9207-476e-af22-2fc50c1830c2 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/ports?device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 210 time: 0.1255248 Dec 09 21:39:20.464874 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e50fe61d-462c-4e08-9b0a-318666886803 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:39:20.527656 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: e50fe61d-462c-4e08-9b0a-318666886803 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:39:20.528392 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e50fe61d-462c-4e08-9b0a-318666886803 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:39:20.536251 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7fe85cdb-174e-4748-9eeb-44e05612f44a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:20.578713 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e469ba9a-6072-4e73-aad1-34b53d0ebdb5 None None] For port cf0495d5-be33-4a6e-95b9-f79fa439861d, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:39:20.583776 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e469ba9a-6072-4e73-aad1-34b53d0ebdb5 None None] For port cf0495d5-be33-4a6e-95b9-f79fa439861d, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=cf0495d5-be33-4a6e-95b9-f79fa439861d,segment=NetworkSegment(75657263-ba28-4011-a293-01c4f28442f4),segment_id=75657263-ba28-4011-a293-01c4f28442f4)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:39:20.590364 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57672) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:20.590737 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e469ba9a-6072-4e73-aad1-34b53d0ebdb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:20.614527 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bdfe510d-45aa-441c-b810-8e46f1ec5e3f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:20.653342 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bdfe510d-45aa-441c-b810-8e46f1ec5e3f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:20.667144 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bdfe510d-45aa-441c-b810-8e46f1ec5e3f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "DELETE /v2.0/subnets/871c2dc1-486e-4fcf-a882-5a1394082fc5 HTTP/1.1" status: 204 len: 168 time: 0.8623140 Dec 09 21:39:20.671828 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57676) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:20.699466 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7fe85cdb-174e-4748-9eeb-44e05612f44a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network e7bdf216-9307-460a-aa2d-f1a37aada31e is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:39:20.707970 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e469ba9a-6072-4e73-aad1-34b53d0ebdb5 None None] Pushing event updated for resources: {'Port': ['ID=cf0495d5-be33-4a6e-95b9-f79fa439861d,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:20.714939 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-7fe85cdb-174e-4748-9eeb-44e05612f44a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:20.723837 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7fe85cdb-174e-4748-9eeb-44e05612f44a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:20.724621 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7fe85cdb-174e-4748-9eeb-44e05612f44a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:20.726129 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-072e265b-c008-4e73-a5cb-cf02c9bc314b None None] Network 69c5e9e4-78c6-4a6b-9b16-9f1da643282c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:20.742792 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fe85cdb-174e-4748-9eeb-44e05612f44a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Subnet': ['ID=48fe293e-4e46-42c3-955e-3c0061f59c22,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:20.749051 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57678) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:20.750436 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-546c9f44-9b8b-4cb5-a91a-0edc55abee3a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=03e962eb7f5e4325a7c08c8b1e2a4cea&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1580930 Dec 09 21:39:20.844015 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdfe510d-45aa-441c-b810-8e46f1ec5e3f tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event deleted for resources: {'Subnet': ['ID=871c2dc1-486e-4fcf-a882-5a1394082fc5,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:20.857705 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7fe85cdb-174e-4748-9eeb-44e05612f44a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 1.4650433 Dec 09 21:39:20.860993 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57680) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:20.869931 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e79791a2-d03b-4c38-bbb5-d893a14abcc2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:20.871275 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-43043593-0125-4dab-946c-f8cf4acf58be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'port': {'network_id': 'e7bdf216-9307-460a-aa2d-f1a37aada31e', 'fixed_ips': [{'subnet_id': '95ad4dcb-14e2-441c-a38e-b25e43db09c8'}, {'subnet_id': '48fe293e-4e46-42c3-955e-3c0061f59c22'}], 'name': 'tempest-PortsTestJSON-561705265'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:20.878813 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-828c67b5-0ee7-49d2-8ee2-d7908899ce14 None None] DHCP port deletion for ae9d25d5-c9a2-4627-a465-8324b17541d9 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:39:20.969728 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cbc39bfe-cee6-4fdf-a80f-ffe0cfa5473d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:21.047839 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cbc39bfe-cee6-4fdf-a80f-ffe0cfa5473d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:21.083470 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-e79791a2-d03b-4c38-bbb5-d893a14abcc2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Deleting port e89c3350-d1c3-4579-9a89-153f406f40ea {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:21.084091 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e79791a2-d03b-4c38-bbb5-d893a14abcc2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:21.146463 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-828c67b5-0ee7-49d2-8ee2-d7908899ce14 None None] Deleting port e89c3350-d1c3-4579-9a89-153f406f40ea {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:21.146842 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-828c67b5-0ee7-49d2-8ee2-d7908899ce14 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:21.166699 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-e79791a2-d03b-4c38-bbb5-d893a14abcc2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] For port e89c3350-d1c3-4579-9a89-153f406f40ea, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e89c3350-d1c3-4579-9a89-153f406f40ea,segment=NetworkSegment(a40eb34b-04cf-427f-a562-8a47c01a297b),segment_id=a40eb34b-04cf-427f-a562-8a47c01a297b)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:21.167067 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e79791a2-d03b-4c38-bbb5-d893a14abcc2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:21.189584 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b885e02-402f-4e47-a421-8ceb2d34a0f0 None None] DHCP port deletion for 69c5e9e4-78c6-4a6b-9b16-9f1da643282c request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:39:21.196962 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-e79791a2-d03b-4c38-bbb5-d893a14abcc2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Calling delete_port for e89c3350-d1c3-4579-9a89-153f406f40ea owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:21.225343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-43043593-0125-4dab-946c-f8cf4acf58be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:21.422021 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cbc39bfe-cee6-4fdf-a80f-ffe0cfa5473d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:21.423073 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-828c67b5-0ee7-49d2-8ee2-d7908899ce14 None None] For port e89c3350-d1c3-4579-9a89-153f406f40ea, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e89c3350-d1c3-4579-9a89-153f406f40ea,segment=NetworkSegment(a40eb34b-04cf-427f-a562-8a47c01a297b),segment_id=a40eb34b-04cf-427f-a562-8a47c01a297b)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:21.424856 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cbc39bfe-cee6-4fdf-a80f-ffe0cfa5473d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:21.428371 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cbc39bfe-cee6-4fdf-a80f-ffe0cfa5473d admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/c9dd44b4-64da-4ec9-9419-32736736a6d2 HTTP/1.1" status: 204 len: 168 time: 0.6699431 Dec 09 21:39:21.433251 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-828c67b5-0ee7-49d2-8ee2-d7908899ce14 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:21.481039 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-828c67b5-0ee7-49d2-8ee2-d7908899ce14 None None] Calling delete_port for e89c3350-d1c3-4579-9a89-153f406f40ea owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:21.522114 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-43043593-0125-4dab-946c-f8cf4acf58be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:21.556949 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbc39bfe-cee6-4fdf-a80f-ffe0cfa5473d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c9dd44b4-64da-4ec9-9419-32736736a6d2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:21.577697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-43043593-0125-4dab-946c-f8cf4acf58be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] device_id is not set on port f1027ff4-b141-4182-870b-0919f06b9112 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:39:21.664795 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-7b885e02-402f-4e47-a421-8ceb2d34a0f0 None None] Deleting port c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:21.665322 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7b885e02-402f-4e47-a421-8ceb2d34a0f0 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:21.719240 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-631947df-65b7-44d4-8fba-b385b0f02532 req-0ff78a48-2472-42c3-a9a3-41dd42c2273d tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/ports?device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 210 time: 0.1229055 Dec 09 21:39:21.738315 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-7b885e02-402f-4e47-a421-8ceb2d34a0f0 None None] For port c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9,segment=NetworkSegment(06cdf949-c592-4827-b617-66043758d462),segment_id=06cdf949-c592-4827-b617-66043758d462)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:21.739323 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7b885e02-402f-4e47-a421-8ceb2d34a0f0 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:21.758424 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-7b885e02-402f-4e47-a421-8ceb2d34a0f0 None None] Calling delete_port for c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:21.965001 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7b885e02-402f-4e47-a421-8ceb2d34a0f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:22.121248 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device cf0495d5-be33-4a6e-95b9-f79fa439861d up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:39:22.212652 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b885e02-402f-4e47-a421-8ceb2d34a0f0 None None] Pushing event deleted for resources: {'Port': ['ID=c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:22.215387 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-43043593-0125-4dab-946c-f8cf4acf58be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Allocated IP 172.20.0.9 (e7bdf216-9307-460a-aa2d-f1a37aada31e/95ad4dcb-14e2-441c-a38e-b25e43db09c8/f1027ff4-b141-4182-870b-0919f06b9112) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:39:22.235110 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b885e02-402f-4e47-a421-8ceb2d34a0f0 None None] No DVR routers for this DVR port c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:39:22.242592 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57730) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:22.268311 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port cf0495d5-be33-4a6e-95b9-f79fa439861d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:22.269312 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:22.274521 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-43043593-0125-4dab-946c-f8cf4acf58be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Allocated IP 172.20.0.26 (e7bdf216-9307-460a-aa2d-f1a37aada31e/48fe293e-4e46-42c3-955e-3c0061f59c22/f1027ff4-b141-4182-870b-0919f06b9112) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:39:22.306876 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-828c67b5-0ee7-49d2-8ee2-d7908899ce14 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:22.310117 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e79791a2-d03b-4c38-bbb5-d893a14abcc2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:22.375499 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-828c67b5-0ee7-49d2-8ee2-d7908899ce14 None None] Pushing event deleted for resources: {'Port': ['ID=e89c3350-d1c3-4579-9a89-153f406f40ea,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:22.379581 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e79791a2-d03b-4c38-bbb5-d893a14abcc2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] No DVR routers for this DVR port e89c3350-d1c3-4579-9a89-153f406f40ea on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:39:22.382105 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-828c67b5-0ee7-49d2-8ee2-d7908899ce14 None None] No DVR routers for this DVR port e89c3350-d1c3-4579-9a89-153f406f40ea on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:39:22.395147 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e79791a2-d03b-4c38-bbb5-d893a14abcc2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event deleted for resources: {'Port': ['ID=e89c3350-d1c3-4579-9a89-153f406f40ea,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:22.470088 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-9348853a-c707-4766-83a8-f8a4ecb0f7ea tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:22.472724 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-9348853a-c707-4766-83a8-f8a4ecb0f7ea tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.10 "GET /v2.0/networks?id=a71f32bb-6d3a-4295-a0cb-027407f942be HTTP/1.1" status: 200 len: 811 time: 1.0344818 Dec 09 21:39:22.491670 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2fcd74b7-739a-44f0-b5e2-dad3f138c410 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=f8441d8d390b442691a162db541a51b0&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2394192 Dec 09 21:39:22.500957 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57738) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:22.501127 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-b2f316f1-8f81-4acb-a238-302d41cf5514 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Request body: {'port': {'device_id': 'b84755f7-f8f4-472b-bd23-cc1d256a5497', 'network_id': 'a71f32bb-6d3a-4295-a0cb-027407f942be', 'admin_state_up': True, 'tenant_id': 'ec2fddf1ed684b7e8c8deb49d8c06a18'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:22.501649 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:22.554637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port cf0495d5-be33-4a6e-95b9-f79fa439861d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=cf0495d5-be33-4a6e-95b9-f79fa439861d,segment=NetworkSegment(75657263-ba28-4011-a293-01c4f28442f4),segment_id=75657263-ba28-4011-a293-01c4f28442f4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:22.565891 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:22.607193 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e79791a2-d03b-4c38-bbb5-d893a14abcc2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:22.722878 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-82f1cd96-ff62-47ca-b58a-35328119bc02 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:22.762671 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-e79791a2-d03b-4c38-bbb5-d893a14abcc2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ae9d25d5-c9a2-4627-a465-8324b17541d9']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:22.779768 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-e79791a2-d03b-4c38-bbb5-d893a14abcc2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a40eb34b-04cf-427f-a562-8a47c01a297b') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:22.780322 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-e79791a2-d03b-4c38-bbb5-d893a14abcc2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a40eb34b-04cf-427f-a562-8a47c01a297b') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:22.802536 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=cf0495d5-be33-4a6e-95b9-f79fa439861d,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:22.809082 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e89c3350-d1c3-4579-9a89-153f406f40ea no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:39:22.836493 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-82f1cd96-ff62-47ca-b58a-35328119bc02 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:22.847559 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e79791a2-d03b-4c38-bbb5-d893a14abcc2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:22.867891 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e79791a2-d03b-4c38-bbb5-d893a14abcc2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:22.875159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e79791a2-d03b-4c38-bbb5-d893a14abcc2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Releasing vlan 145 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:39:22.875646 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e79791a2-d03b-4c38-bbb5-d893a14abcc2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:22.877993 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: e89c3350-d1c3-4579-9a89-153f406f40ea {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:39:22.878141 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e89c3350-d1c3-4579-9a89-153f406f40ea not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:39:22.878559 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:39:22.902067 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:39:22.902422 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c123ca2a-cdb3-40c8-a80e-fc9b0cedefe9 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:39:22.920094 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8eb8841c-3839-4626-a6a4-d79c886ee942 None None] Network e7bdf216-9307-460a-aa2d-f1a37aada31e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:39:22.992657 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:39:23.034408 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e79791a2-d03b-4c38-bbb5-d893a14abcc2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:23.037487 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-43043593-0125-4dab-946c-f8cf4acf58be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:23.059298 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e79791a2-d03b-4c38-bbb5-d893a14abcc2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:23.068640 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e79791a2-d03b-4c38-bbb5-d893a14abcc2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "DELETE /v2.0/networks/ae9d25d5-c9a2-4627-a465-8324b17541d9 HTTP/1.1" status: 204 len: 168 time: 2.3904855 Dec 09 21:39:23.072331 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-b2f316f1-8f81-4acb-a238-302d41cf5514 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Made reservation on behalf of ec2fddf1ed684b7e8c8deb49d8c06a18 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:23.076353 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57770) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:23.081439 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-b2f316f1-8f81-4acb-a238-302d41cf5514 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:23.105786 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3716fc23-7dac-425e-9f33-866cbce443aa req-53041947-d629-4117-b562-0257c7e389ff tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:23.110214 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3716fc23-7dac-425e-9f33-866cbce443aa req-53041947-d629-4117-b562-0257c7e389ff tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] 10.222.0.13 "GET /v2.0/networks?id=6234858b-69ec-4f21-b01b-eb3e9bd6848b HTTP/1.1" status: 200 len: 810 time: 0.2506237 Dec 09 21:39:23.128474 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e79791a2-d03b-4c38-bbb5-d893a14abcc2 tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event deleted for resources: {'Network': ['ID=ae9d25d5-c9a2-4627-a465-8324b17541d9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:23.160294 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-82f1cd96-ff62-47ca-b58a-35328119bc02 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:23.163336 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-82f1cd96-ff62-47ca-b58a-35328119bc02 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:23.164831 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-82f1cd96-ff62-47ca-b58a-35328119bc02 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/d53dc779-90c9-4258-80f1-e7f29604f817 HTTP/1.1" status: 204 len: 168 time: 0.6630154 Dec 09 21:39:23.186099 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2eb18583-334f-4074-a840-6b3e1564c8e4 None None] Provisioning complete for port cf0495d5-be33-4a6e-95b9-f79fa439861d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:23.186476 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2eb18583-334f-4074-a840-6b3e1564c8e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:23.202088 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3716fc23-7dac-425e-9f33-866cbce443aa req-ed33b73d-46c6-4a74-bd24-ecf2775605fb tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] 10.222.0.13 "GET /v2.0/quotas/37bf08f44fbc4ad89743914d8e228eb0 HTTP/1.1" status: 200 len: 375 time: 0.0903420 Dec 09 21:39:23.210690 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82f1cd96-ff62-47ca-b58a-35328119bc02 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d53dc779-90c9-4258-80f1-e7f29604f817,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:23.307806 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3716fc23-7dac-425e-9f33-866cbce443aa req-44b3c640-2dc3-4010-9098-137157795eba tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=37bf08f44fbc4ad89743914d8e228eb0&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1039078 Dec 09 21:39:23.346579 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-43043593-0125-4dab-946c-f8cf4acf58be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:23.377705 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57780) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:23.398303 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-b2f316f1-8f81-4acb-a238-302d41cf5514 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Allocated IP 172.20.0.8 (a71f32bb-6d3a-4295-a0cb-027407f942be/ee1b3d8d-21b5-45b8-802b-af8c84fb9577/101912b6-96a7-4280-822a-8c03b59cc0b0) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:39:23.412283 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e21b5000-d8d7-4872-bc7b-605c1e943494 None None] Update dhcp port {'port': {'network_id': 'e7bdf216-9307-460a-aa2d-f1a37aada31e', 'fixed_ips': [{'subnet_id': '95ad4dcb-14e2-441c-a38e-b25e43db09c8', 'ip_address': '172.20.0.2'}, {'subnet_id': '48fe293e-4e46-42c3-955e-3c0061f59c22'}], 'binding:host_id': 'n-d-713301-27'}, 'id': 'cf0495d5-be33-4a6e-95b9-f79fa439861d'} from n-d-713301-27. {{(pid=103439) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 09 21:39:23.447041 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e21b5000-d8d7-4872-bc7b-605c1e943494 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:23.511057 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43043593-0125-4dab-946c-f8cf4acf58be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Port': ['ID=f1027ff4-b141-4182-870b-0919f06b9112,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:23.522280 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3716fc23-7dac-425e-9f33-866cbce443aa req-c49e15fb-69c3-495d-ae48-61c147e1b3f4 service neutron] 10.222.0.13 "GET /v2.0/networks/6234858b-69ec-4f21-b01b-eb3e9bd6848b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2133436 Dec 09 21:39:23.616483 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f200f395-accd-4447-b3d0-f692f224c51e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:23.621273 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-b2f316f1-8f81-4acb-a238-302d41cf5514 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:23.641782 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3716fc23-7dac-425e-9f33-866cbce443aa req-662897d3-02ef-40d9-81bf-0b304e4775b3 service neutron] 10.222.0.13 "GET /v2.0/networks/6234858b-69ec-4f21-b01b-eb3e9bd6848b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1185639 Dec 09 21:39:23.646919 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-43043593-0125-4dab-946c-f8cf4acf58be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network e7bdf216-9307-460a-aa2d-f1a37aada31e is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:39:23.676925 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-e21b5000-d8d7-4872-bc7b-605c1e943494 None None] Allocated IP 172.20.0.18 (e7bdf216-9307-460a-aa2d-f1a37aada31e/48fe293e-4e46-42c3-955e-3c0061f59c22/cf0495d5-be33-4a6e-95b9-f79fa439861d) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:39:23.681906 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-43043593-0125-4dab-946c-f8cf4acf58be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:23.685422 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-b2f316f1-8f81-4acb-a238-302d41cf5514 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:23.687080 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43043593-0125-4dab-946c-f8cf4acf58be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:39:23.800232 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f200f395-accd-4447-b3d0-f692f224c51e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:23.819842 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43043593-0125-4dab-946c-f8cf4acf58be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:23.820554 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-43043593-0125-4dab-946c-f8cf4acf58be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:23.825386 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-b2f316f1-8f81-4acb-a238-302d41cf5514 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Network a71f32bb-6d3a-4295-a0cb-027407f942be is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:39:23.841101 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-f200f395-accd-4447-b3d0-f692f224c51e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['69c5e9e4-78c6-4a6b-9b16-9f1da643282c']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:23.842174 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-b2f316f1-8f81-4acb-a238-302d41cf5514 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:23.854069 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-f200f395-accd-4447-b3d0-f692f224c51e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '06cdf949-c592-4827-b617-66043758d462') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:23.854406 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-f200f395-accd-4447-b3d0-f692f224c51e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '06cdf949-c592-4827-b617-66043758d462') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:23.854891 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-b2f316f1-8f81-4acb-a238-302d41cf5514 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:39:23.867318 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-43043593-0125-4dab-946c-f8cf4acf58be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1003 time: 3.0022545 Dec 09 21:39:23.871707 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f200f395-accd-4447-b3d0-f692f224c51e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:23.872185 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2f316f1-8f81-4acb-a238-302d41cf5514 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Pushing event updated for resources: {'Port': ['ID=101912b6-96a7-4280-822a-8c03b59cc0b0,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:23.879178 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57788) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:23.888122 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-ded03222-6fbc-495e-8f7c-afa53789989a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '95ad4dcb-14e2-441c-a38e-b25e43db09c8'}]}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:23.892406 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e21b5000-d8d7-4872-bc7b-605c1e943494 None None] For port cf0495d5-be33-4a6e-95b9-f79fa439861d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=cf0495d5-be33-4a6e-95b9-f79fa439861d,segment=NetworkSegment(75657263-ba28-4011-a293-01c4f28442f4),segment_id=75657263-ba28-4011-a293-01c4f28442f4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:23.944912 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e21b5000-d8d7-4872-bc7b-605c1e943494 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:23.969370 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e21b5000-d8d7-4872-bc7b-605c1e943494 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:23.990454 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f200f395-accd-4447-b3d0-f692f224c51e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:24.008865 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-b2f316f1-8f81-4acb-a238-302d41cf5514 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:24.009361 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-b2f316f1-8f81-4acb-a238-302d41cf5514 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:24.010270 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f200f395-accd-4447-b3d0-f692f224c51e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Releasing vlan 132 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:39:24.010635 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f200f395-accd-4447-b3d0-f692f224c51e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:39:24.036432 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:39:24.056410 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device cf0495d5-be33-4a6e-95b9-f79fa439861d up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:39:24.077656 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-63eff5d6-f2b7-4ab2-8ebc-ab51e4921fa8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:24.119358 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-b2f316f1-8f81-4acb-a238-302d41cf5514 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.6277292 Dec 09 21:39:24.145086 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e2d14992-d8f6-4167-ae80-cbb64d0daccb service neutron] Request body: {'port': {'device_id': 'b84755f7-f8f4-472b-bd23-cc1d256a5497', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:24.205922 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e21b5000-d8d7-4872-bc7b-605c1e943494 None None] Pushing event updated for resources: {'Port': ['ID=cf0495d5-be33-4a6e-95b9-f79fa439861d,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:24.217323 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port cf0495d5-be33-4a6e-95b9-f79fa439861d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:24.217715 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:24.330359 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ded03222-6fbc-495e-8f7c-afa53789989a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:24.369621 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e2d14992-d8f6-4167-ae80-cbb64d0daccb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:24.374588 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f200f395-accd-4447-b3d0-f692f224c51e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:24.388406 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f200f395-accd-4447-b3d0-f692f224c51e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:24.392191 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f200f395-accd-4447-b3d0-f692f224c51e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] 10.222.0.13 "DELETE /v2.0/networks/69c5e9e4-78c6-4a6b-9b16-9f1da643282c HTTP/1.1" status: 204 len: 168 time: 1.3147678 Dec 09 21:39:24.419279 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f200f395-accd-4447-b3d0-f692f224c51e tempest-TaggedBootDevicesTest_v242-1171608294 tempest-TaggedBootDevicesTest_v242-1171608294-project] Pushing event deleted for resources: {'Network': ['ID=69c5e9e4-78c6-4a6b-9b16-9f1da643282c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:24.440503 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35f60e29-6d6c-4c95-87e9-192539b661fb req-031c532e-7cf9-41e0-b7e9-34e0de18c4ad tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:24.453410 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35f60e29-6d6c-4c95-87e9-192539b661fb req-031c532e-7cf9-41e0-b7e9-34e0de18c4ad tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/ports?device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 931 time: 0.3424919 Dec 09 21:39:24.510593 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-63eff5d6-f2b7-4ab2-8ebc-ab51e4921fa8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:24.524439 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-63eff5d6-f2b7-4ab2-8ebc-ab51e4921fa8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:24.718304 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63eff5d6-f2b7-4ab2-8ebc-ab51e4921fa8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dbdbad4d-adec-4ab7-b567-5f7cb9548e50,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:24.735277 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-63eff5d6-f2b7-4ab2-8ebc-ab51e4921fa8 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=40c926ebc5cb41a498187a0132cb7de4&name=default HTTP/1.1" status: 200 len: 3000 time: 1.3564098 Dec 09 21:39:24.735974 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57820) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:24.946656 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf458cb8-f4cb-47f7-a738-9f256e9b57e8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:25.026648 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57828) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:25.032636 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf458cb8-f4cb-47f7-a738-9f256e9b57e8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:25.148186 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e2d14992-d8f6-4167-ae80-cbb64d0daccb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 101912b6-96a7-4280-822a-8c03b59cc0b0 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:39:25.170319 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e2d14992-d8f6-4167-ae80-cbb64d0daccb service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:25.236101 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35f60e29-6d6c-4c95-87e9-192539b661fb req-9fa4be09-5ea0-44e1-bec9-bc77339937b7 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/security-groups?id=8ee4757d-9f67-4d3c-994b-59905d6c5b2b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7664883 Dec 09 21:39:25.245376 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-689aa8ce-f786-4026-a090-5d92b791fcdc admin admin] Request body: {'network': {'name': 'tempest-ServerAddressesTestJSON-1225631258-network', 'tenant_id': '36fd5c73acc341269fd595119af9d891'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:25.280315 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28878df3-b79e-4bb5-a8be-97917805c6a7 None None] Network e7bdf216-9307-460a-aa2d-f1a37aada31e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:25.286374 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e2d14992-d8f6-4167-ae80-cbb64d0daccb service neutron] Transition to ACTIVE for port object 101912b6-96a7-4280-822a-8c03b59cc0b0 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:39:25.289140 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf458cb8-f4cb-47f7-a738-9f256e9b57e8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:25.292130 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cf458cb8-f4cb-47f7-a738-9f256e9b57e8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:25.294114 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cf458cb8-f4cb-47f7-a738-9f256e9b57e8 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/dbdbad4d-adec-4ab7-b567-5f7cb9548e50 HTTP/1.1" status: 204 len: 168 time: 0.5498421 Dec 09 21:39:25.307749 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf458cb8-f4cb-47f7-a738-9f256e9b57e8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dbdbad4d-adec-4ab7-b567-5f7cb9548e50,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:25.320317 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-689aa8ce-f786-4026-a090-5d92b791fcdc admin admin] Made reservation on behalf of 36fd5c73acc341269fd595119af9d891 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:25.324183 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-689aa8ce-f786-4026-a090-5d92b791fcdc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:25.327956 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e2d14992-d8f6-4167-ae80-cbb64d0daccb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:25.399231 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-86776b86-4a30-43e9-abeb-682def788ef4 None None] Provisioning complete for port cf0495d5-be33-4a6e-95b9-f79fa439861d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:25.399628 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-86776b86-4a30-43e9-abeb-682def788ef4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:25.406712 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-689aa8ce-f786-4026-a090-5d92b791fcdc admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:25.471474 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2d14992-d8f6-4167-ae80-cbb64d0daccb service neutron] Pushing event updated for resources: {'Port': ['ID=101912b6-96a7-4280-822a-8c03b59cc0b0,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:25.520133 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-ded03222-6fbc-495e-8f7c-afa53789989a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Delete allocated IP 172.20.0.26 (e7bdf216-9307-460a-aa2d-f1a37aada31e/48fe293e-4e46-42c3-955e-3c0061f59c22) {{(pid=103438) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Dec 09 21:39:25.602394 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e2d14992-d8f6-4167-ae80-cbb64d0daccb service neutron] Attempting to bind port 101912b6-96a7-4280-822a-8c03b59cc0b0 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:39:25.603165 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e2d14992-d8f6-4167-ae80-cbb64d0daccb service neutron] Attempting to bind port 101912b6-96a7-4280-822a-8c03b59cc0b0 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'e0f6fb16-426b-4e5a-a33f-f4e36fbfbd55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'a71f32bb-6d3a-4295-a0cb-027407f942be'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:39:25.603732 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e2d14992-d8f6-4167-ae80-cbb64d0daccb service neutron] Attempting to bind port 101912b6-96a7-4280-822a-8c03b59cc0b0 on network a71f32bb-6d3a-4295-a0cb-027407f942be {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:39:25.611935 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e2d14992-d8f6-4167-ae80-cbb64d0daccb service neutron] Port 101912b6-96a7-4280-822a-8c03b59cc0b0 on network a71f32bb-6d3a-4295-a0cb-027407f942be not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:39:25.612604 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e2d14992-d8f6-4167-ae80-cbb64d0daccb service neutron] Attempting to bind port 101912b6-96a7-4280-822a-8c03b59cc0b0 on network a71f32bb-6d3a-4295-a0cb-027407f942be {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:39:25.623454 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e2d14992-d8f6-4167-ae80-cbb64d0daccb service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 38, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:39:25.624235 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e2d14992-d8f6-4167-ae80-cbb64d0daccb service neutron] Checking segment: {'id': 'e0f6fb16-426b-4e5a-a33f-f4e36fbfbd55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'a71f32bb-6d3a-4295-a0cb-027407f942be'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:39:25.624824 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e2d14992-d8f6-4167-ae80-cbb64d0daccb service neutron] Bound using segment: {'id': 'e0f6fb16-426b-4e5a-a33f-f4e36fbfbd55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'a71f32bb-6d3a-4295-a0cb-027407f942be'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:39:25.626514 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e2d14992-d8f6-4167-ae80-cbb64d0daccb service neutron] Bound port: 101912b6-96a7-4280-822a-8c03b59cc0b0, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e0f6fb16-426b-4e5a-a33f-f4e36fbfbd55', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'a71f32bb-6d3a-4295-a0cb-027407f942be'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:39:25.627202 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e2d14992-d8f6-4167-ae80-cbb64d0daccb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:25.665697 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aceb2a63-5403-422a-ae84-f81b026628fb req-14fcd1a0-0d36-4a07-93b4-892a85cfb9bd tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] 10.222.0.13 "GET /v2.0/ports?device_id=4619a834-a481-4429-bb09-806f8f9bd76d HTTP/1.1" status: 200 len: 210 time: 0.0842385 Dec 09 21:39:25.727464 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-689aa8ce-f786-4026-a090-5d92b791fcdc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:25.750121 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-689aa8ce-f786-4026-a090-5d92b791fcdc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:25.829933 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-689aa8ce-f786-4026-a090-5d92b791fcdc admin admin] vlan segment allocate from pool success with {'vlan_id': 145, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:39:25.879843 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-689aa8ce-f786-4026-a090-5d92b791fcdc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:25.884626 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-689aa8ce-f786-4026-a090-5d92b791fcdc admin admin] Added segment 21ec9cce-e1fc-4f03-b167-7ca6b7df97ea of type vlan for network 87a22671-0e6a-414f-86be-13172b5f3f96 Dec 09 21:39:25.965481 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-369fcd07-cf9e-493b-8353-030f18361e23 None None] Provisioning complete for port cf0495d5-be33-4a6e-95b9-f79fa439861d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:25.965845 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-369fcd07-cf9e-493b-8353-030f18361e23 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:25.970143 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57848) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:26.006225 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-689aa8ce-f786-4026-a090-5d92b791fcdc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e1c1ce62-2b22-487b-b831-0504741b720a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:26.070360 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0651ab6d-26b1-45d3-8792-5f0e8b683ae8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:26.077235 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:39:26.078786 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device cf0495d5-be33-4a6e-95b9-f79fa439861d up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:39:26.088024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e2d14992-d8f6-4167-ae80-cbb64d0daccb service neutron] For port 101912b6-96a7-4280-822a-8c03b59cc0b0, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:39:26.091032 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3716fc23-7dac-425e-9f33-866cbce443aa req-f30c55ce-8522-46cb-870c-612aed182aaa tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:26.092992 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3716fc23-7dac-425e-9f33-866cbce443aa req-f30c55ce-8522-46cb-870c-612aed182aaa tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] 10.222.0.31 "GET /v2.0/networks?id=6234858b-69ec-4f21-b01b-eb3e9bd6848b HTTP/1.1" status: 200 len: 810 time: 0.2871728 Dec 09 21:39:26.102193 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ded03222-6fbc-495e-8f7c-afa53789989a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:26.113830 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-3716fc23-7dac-425e-9f33-866cbce443aa req-a80e6f44-3c38-469a-9c7d-0d937773f94b tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Request body: {'port': {'device_id': '4619a834-a481-4429-bb09-806f8f9bd76d', 'network_id': '6234858b-69ec-4f21-b01b-eb3e9bd6848b', 'admin_state_up': True, 'tenant_id': '37bf08f44fbc4ad89743914d8e228eb0'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:26.121492 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-689aa8ce-f786-4026-a090-5d92b791fcdc admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:26.132988 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e2d14992-d8f6-4167-ae80-cbb64d0daccb service neutron] For port 101912b6-96a7-4280-822a-8c03b59cc0b0, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=101912b6-96a7-4280-822a-8c03b59cc0b0,segment=NetworkSegment(e0f6fb16-426b-4e5a-a33f-f4e36fbfbd55),segment_id=e0f6fb16-426b-4e5a-a33f-f4e36fbfbd55)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:39:26.149015 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e2d14992-d8f6-4167-ae80-cbb64d0daccb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:26.241136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port cf0495d5-be33-4a6e-95b9-f79fa439861d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:26.242018 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:26.258059 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ded03222-6fbc-495e-8f7c-afa53789989a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:26.307615 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-369fcd07-cf9e-493b-8353-030f18361e23 None None] Provisioning complete for port f1027ff4-b141-4182-870b-0919f06b9112 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:26.308708 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-369fcd07-cf9e-493b-8353-030f18361e23 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:26.355484 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e2d14992-d8f6-4167-ae80-cbb64d0daccb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:26.356117 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e2d14992-d8f6-4167-ae80-cbb64d0daccb service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:26.357906 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-e2d14992-d8f6-4167-ae80-cbb64d0daccb service neutron] 10.222.0.10 "PUT /v2.0/ports/101912b6-96a7-4280-822a-8c03b59cc0b0 HTTP/1.1" status: 200 len: 1092 time: 2.2253542 Dec 09 21:39:26.384647 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b84755f7-f8f4-472b-bd23-cc1d256a5497', 'tag': '101912b6-96a7-4280-822a-8c03b59cc0b0'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:39:26.387417 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9391c2da-026f-4d24-92b0-d891766627f2" -d '{"events": [{"name": "network-changed", "server_uuid": "b84755f7-f8f4-472b-bd23-cc1d256a5497", "tag": "101912b6-96a7-4280-822a-8c03b59cc0b0"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:39:26.403195 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-689aa8ce-f786-4026-a090-5d92b791fcdc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:26.404378 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-689aa8ce-f786-4026-a090-5d92b791fcdc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:26.404969 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-689aa8ce-f786-4026-a090-5d92b791fcdc admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:26.437353 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-369fcd07-cf9e-493b-8353-030f18361e23 None None] Port f1027ff4-b141-4182-870b-0919f06b9112 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:39:26.489397 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3716fc23-7dac-425e-9f33-866cbce443aa req-a80e6f44-3c38-469a-9c7d-0d937773f94b tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Made reservation on behalf of 37bf08f44fbc4ad89743914d8e228eb0 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:26.493375 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3716fc23-7dac-425e-9f33-866cbce443aa req-a80e6f44-3c38-469a-9c7d-0d937773f94b tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:26.496132 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ded03222-6fbc-495e-8f7c-afa53789989a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Port': ['ID=f1027ff4-b141-4182-870b-0919f06b9112,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:26.536791 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2d14992-d8f6-4167-ae80-cbb64d0daccb service neutron] Pushing event updated for resources: {'Port': ['ID=101912b6-96a7-4280-822a-8c03b59cc0b0,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:26.543426 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-689aa8ce-f786-4026-a090-5d92b791fcdc admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 1.5135272 Dec 09 21:39:26.554698 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57862) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:26.570082 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-bf7e6468-faac-4317-9f44-282c43e4cf92 admin admin] Request body: {'subnet': {'network_id': '87a22671-0e6a-414f-86be-13172b5f3f96', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerAddressesTestJSON-1225631258-subnet', 'tenant_id': '36fd5c73acc341269fd595119af9d891', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:26.570853 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-82766dc1-6d01-469c-ab88-f3a3e8d575d8 None None] Provisioning complete for port f1027ff4-b141-4182-870b-0919f06b9112 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:26.574828 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-82766dc1-6d01-469c-ab88-f3a3e8d575d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:26.618368 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-ded03222-6fbc-495e-8f7c-afa53789989a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] In _notify_port_updated(), no bound segment for port f1027ff4-b141-4182-870b-0919f06b9112 on network e7bdf216-9307-460a-aa2d-f1a37aada31e {{(pid=103438) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:39:26.632651 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-689aa8ce-f786-4026-a090-5d92b791fcdc admin admin] Pushing event updated for resources: {'Network': ['ID=87a22671-0e6a-414f-86be-13172b5f3f96,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:26.633208 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ded03222-6fbc-495e-8f7c-afa53789989a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:26.637043 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ded03222-6fbc-495e-8f7c-afa53789989a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:26.638440 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ded03222-6fbc-495e-8f7c-afa53789989a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "PUT /v2.0/ports/f1027ff4-b141-4182-870b-0919f06b9112 HTTP/1.1" status: 200 len: 918 time: 2.7581563 Dec 09 21:39:26.650103 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57866) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:26.652332 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-c8b6a2f7-85e1-40c6-8abe-dafaf17e0ee2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:26.656108 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-c8b6a2f7-85e1-40c6-8abe-dafaf17e0ee2 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ec2fddf1ed684b7e8c8deb49d8c06a18&device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 1095 time: 0.2182996 Dec 09 21:39:26.661361 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-cff08963-f3d2-430c-abc4-b0f97520b8b4 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '95ad4dcb-14e2-441c-a38e-b25e43db09c8'}, {'subnet_id': '48fe293e-4e46-42c3-955e-3c0061f59c22'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:26.663014 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-82766dc1-6d01-469c-ab88-f3a3e8d575d8 None None] Port f1027ff4-b141-4182-870b-0919f06b9112 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:39:26.664832 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 87a22671-0e6a-414f-86be-13172b5f3f96 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:39:26.689356 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8edf19c9-f4a8-4dd3-8277-397e73bfb3fc req-b0dffb58-4cbe-4162-afc2-63ed382adbee tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:26.701521 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8edf19c9-f4a8-4dd3-8277-397e73bfb3fc req-b0dffb58-4cbe-4162-afc2-63ed382adbee tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/ports?device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 943 time: 0.2659781 Dec 09 21:39:26.755680 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0651ab6d-26b1-45d3-8792-5f0e8b683ae8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:26.784035 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-0f8ae7c1-c34b-497e-a1bb-df0ad128352c None None] Provisioning complete for port f1027ff4-b141-4182-870b-0919f06b9112 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:26.784420 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0f8ae7c1-c34b-497e-a1bb-df0ad128352c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:26.801602 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-af67097e-2f29-4e23-ad3b-f570ef2e1260 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=101912b6-96a7-4280-822a-8c03b59cc0b0 HTTP/1.1" status: 200 len: 217 time: 0.1252561 Dec 09 21:39:26.802206 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0651ab6d-26b1-45d3-8792-5f0e8b683ae8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:26.823895 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bf7e6468-faac-4317-9f44-282c43e4cf92 admin admin] Made reservation on behalf of 36fd5c73acc341269fd595119af9d891 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:26.826182 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bf7e6468-faac-4317-9f44-282c43e4cf92 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:26.889095 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-0f8ae7c1-c34b-497e-a1bb-df0ad128352c None None] Port f1027ff4-b141-4182-870b-0919f06b9112 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:39:26.911231 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8edf19c9-f4a8-4dd3-8277-397e73bfb3fc req-3de9ff95-8f48-4ca0-87e6-bf5e0fa6d842 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/security-groups?id=8ee4757d-9f67-4d3c-994b-59905d6c5b2b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2088077 Dec 09 21:39:26.955064 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-3716fc23-7dac-425e-9f33-866cbce443aa req-a80e6f44-3c38-469a-9c7d-0d937773f94b tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Allocated IP 172.20.0.2 (6234858b-69ec-4f21-b01b-eb3e9bd6848b/442ba23b-1dd6-4dce-ba48-8a9cc723c83d/6c9a3e10-d6a0-46ac-9270-26bf85000b0e) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:39:26.955772 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0651ab6d-26b1-45d3-8792-5f0e8b683ae8 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=994ed17f756740a5bb37a7fb8c62dba8&name=default HTTP/1.1" status: 200 len: 3000 time: 0.9814565 Dec 09 21:39:26.960223 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57878) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:27.044384 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:39:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ac6a5b2d-ce33-440f-a141-dede0e0b74e7 x-openstack-request-id: req-ac6a5b2d-ce33-440f-a141-dede0e0b74e7 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:39:27.044693 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b84755f7-f8f4-472b-bd23-cc1d256a5497", "tag": "101912b6-96a7-4280-822a-8c03b59cc0b0", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:39:27.044954 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-ac6a5b2d-ce33-440f-a141-dede0e0b74e7 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:39:27.046045 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b84755f7-f8f4-472b-bd23-cc1d256a5497', 'tag': '101912b6-96a7-4280-822a-8c03b59cc0b0', 'status': 'completed', 'code': 200} Dec 09 21:39:27.051590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0651ab6d-26b1-45d3-8792-5f0e8b683ae8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bdc9047c-2b1e-41e6-9fff-112dc30a69f0,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:27.146539 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-281bbf8f-da3c-4984-89b4-3781dc291837 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:27.148671 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-281bbf8f-da3c-4984-89b4-3781dc291837 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=ee1b3d8d-21b5-45b8-802b-af8c84fb9577 HTTP/1.1" status: 200 len: 851 time: 0.3394036 Dec 09 21:39:27.155932 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cff08963-f3d2-430c-abc4-b0f97520b8b4 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:27.183489 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-223bc895-d273-42b8-99d9-832d33a1e0b0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:27.213392 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-4a2f8ecd-c9be-479f-a028-7b36b67dad4b service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a71f32bb-6d3a-4295-a0cb-027407f942be&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0414093 Dec 09 21:39:27.253222 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:27.266249 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac9d0ca8-fc9f-40f6-972e-397e88451bd3 req-3a0bfc98-1544-484a-992b-8e506c6e6485 tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] 10.222.0.13 "GET /v2.0/ports?device_id=4619a834-a481-4429-bb09-806f8f9bd76d HTTP/1.1" status: 200 len: 210 time: 0.1562681 Dec 09 21:39:27.282755 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:27.304643 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-223bc895-d273-42b8-99d9-832d33a1e0b0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:27.319982 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57884) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:27.362683 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3716fc23-7dac-425e-9f33-866cbce443aa req-a80e6f44-3c38-469a-9c7d-0d937773f94b tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:27.408484 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-223bc895-d273-42b8-99d9-832d33a1e0b0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:27.411253 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-223bc895-d273-42b8-99d9-832d33a1e0b0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:27.415658 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-223bc895-d273-42b8-99d9-832d33a1e0b0 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/bdc9047c-2b1e-41e6-9fff-112dc30a69f0 HTTP/1.1" status: 204 len: 168 time: 0.4512172 Dec 09 21:39:27.426395 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-223bc895-d273-42b8-99d9-832d33a1e0b0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bdc9047c-2b1e-41e6-9fff-112dc30a69f0,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:27.453047 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3716fc23-7dac-425e-9f33-866cbce443aa req-a80e6f44-3c38-469a-9c7d-0d937773f94b tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:27.509204 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3716fc23-7dac-425e-9f33-866cbce443aa req-a80e6f44-3c38-469a-9c7d-0d937773f94b tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Network 6234858b-69ec-4f21-b01b-eb3e9bd6848b is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:39:27.533485 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-3716fc23-7dac-425e-9f33-866cbce443aa req-a80e6f44-3c38-469a-9c7d-0d937773f94b tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:27.552041 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-3716fc23-7dac-425e-9f33-866cbce443aa req-a80e6f44-3c38-469a-9c7d-0d937773f94b tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:39:27.561781 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-82b59b0e-1215-47e1-9817-9ea9c2dafcb0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:27.598888 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-bec08469-edec-45db-b643-41f71881870d service neutron] 10.222.0.10 "GET /v2.0/networks/a71f32bb-6d3a-4295-a0cb-027407f942be?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3686953 Dec 09 21:39:27.615235 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a80e6f44-3c38-469a-9c7d-0d937773f94b tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Pushing event updated for resources: {'Port': ['ID=6c9a3e10-d6a0-46ac-9270-26bf85000b0e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:27.650599 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3716fc23-7dac-425e-9f33-866cbce443aa req-a80e6f44-3c38-469a-9c7d-0d937773f94b tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:27.651246 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3716fc23-7dac-425e-9f33-866cbce443aa req-a80e6f44-3c38-469a-9c7d-0d937773f94b tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:27.670378 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bf7e6468-faac-4317-9f44-282c43e4cf92 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:27.684684 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3716fc23-7dac-425e-9f33-866cbce443aa req-a80e6f44-3c38-469a-9c7d-0d937773f94b tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5799747 Dec 09 21:39:27.702236 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-3716fc23-7dac-425e-9f33-866cbce443aa req-c9ee8b52-afb9-42d4-9297-b8aaaa28e1fd service neutron] Request body: {'port': {'device_id': '4619a834-a481-4429-bb09-806f8f9bd76d', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:27.774487 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3716fc23-7dac-425e-9f33-866cbce443aa req-c9ee8b52-afb9-42d4-9297-b8aaaa28e1fd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:27.817081 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-82b59b0e-1215-47e1-9817-9ea9c2dafcb0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:27.839839 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf7e6468-faac-4317-9f44-282c43e4cf92 admin admin] Pushing event updated for resources: {'Subnet': ['ID=250bd3c5-f070-4269-9a20-15374747311c,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:27.847672 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf7e6468-faac-4317-9f44-282c43e4cf92 admin admin] Checking segment: {'id': '21ec9cce-e1fc-4f03-b167-7ca6b7df97ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '87a22671-0e6a-414f-86be-13172b5f3f96'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:39:27.848043 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf7e6468-faac-4317-9f44-282c43e4cf92 admin admin] Network hostable DHCP agents. Network: 87a22671-0e6a-414f-86be-13172b5f3f96, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:39:27.849126 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-82b59b0e-1215-47e1-9817-9ea9c2dafcb0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:27.872849 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-cff08963-f3d2-430c-abc4-b0f97520b8b4 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Allocated IP 172.20.0.24 (e7bdf216-9307-460a-aa2d-f1a37aada31e/48fe293e-4e46-42c3-955e-3c0061f59c22/f1027ff4-b141-4182-870b-0919f06b9112) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:39:27.884721 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9564757b-29ab-4c7b-aee0-527ee3649669 req-2fbafca8-4015-4ba6-b4fd-18ab4736e191 service neutron] 10.222.0.10 "GET /v2.0/networks/a71f32bb-6d3a-4295-a0cb-027407f942be?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2770703 Dec 09 21:39:27.907638 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf7e6468-faac-4317-9f44-282c43e4cf92 admin admin] Network 87a22671-0e6a-414f-86be-13172b5f3f96 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:39:27.923186 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-82b59b0e-1215-47e1-9817-9ea9c2dafcb0 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=1e49bd144e914885a78f702363622855&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5996382 Dec 09 21:39:27.925702 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57896) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:28.031224 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82b59b0e-1215-47e1-9817-9ea9c2dafcb0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=27dd3e1d-a48a-4d4d-80f4-bcc33ad3ec03,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:28.105350 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2729ee0e-5055-47e2-b48d-869199730f77 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:28.159246 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8b74535-7822-4ad4-aab1-df40ed2905c0 req-2fa03405-c1f6-440f-9a00-bbf6a7e5ef93 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:28.161037 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8b74535-7822-4ad4-aab1-df40ed2905c0 req-2fa03405-c1f6-440f-9a00-bbf6a7e5ef93 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/ports?device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 943 time: 0.1265595 Dec 09 21:39:28.177024 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2729ee0e-5055-47e2-b48d-869199730f77 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:28.330033 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8b74535-7822-4ad4-aab1-df40ed2905c0 req-7f0b7c1c-7f0c-4e94-bc0b-ca1ae56c748c tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/security-groups?id=8ee4757d-9f67-4d3c-994b-59905d6c5b2b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1574020 Dec 09 21:39:28.371936 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-bf7e6468-faac-4317-9f44-282c43e4cf92 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 87a22671-0e6a-414f-86be-13172b5f3f96) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:28.382857 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7cb33a35-79b8-4bc6-9cc6-089d64cd003c None None] Network 87a22671-0e6a-414f-86be-13172b5f3f96 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:28.383426 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf7e6468-faac-4317-9f44-282c43e4cf92 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:28.383561 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bf7e6468-faac-4317-9f44-282c43e4cf92 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:28.394804 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2729ee0e-5055-47e2-b48d-869199730f77 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:28.399346 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2729ee0e-5055-47e2-b48d-869199730f77 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:28.400697 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2729ee0e-5055-47e2-b48d-869199730f77 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/27dd3e1d-a48a-4d4d-80f4-bcc33ad3ec03 HTTP/1.1" status: 204 len: 168 time: 0.4701288 Dec 09 21:39:28.418921 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9391c2da-026f-4d24-92b0-d891766627f2 req-d4a7557f-e31f-410a-a326-14cd11a86aae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:28.420779 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9391c2da-026f-4d24-92b0-d891766627f2 req-d4a7557f-e31f-410a-a326-14cd11a86aae service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ec2fddf1ed684b7e8c8deb49d8c06a18&device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 1095 time: 0.1160529 Dec 09 21:39:28.446484 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2729ee0e-5055-47e2-b48d-869199730f77 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=27dd3e1d-a48a-4d4d-80f4-bcc33ad3ec03,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:28.451252 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bf7e6468-faac-4317-9f44-282c43e4cf92 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 1.8888874 Dec 09 21:39:28.496476 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-3716fc23-7dac-425e-9f33-866cbce443aa req-c9ee8b52-afb9-42d4-9297-b8aaaa28e1fd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6c9a3e10-d6a0-46ac-9270-26bf85000b0e {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:39:28.525411 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3716fc23-7dac-425e-9f33-866cbce443aa req-c9ee8b52-afb9-42d4-9297-b8aaaa28e1fd service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:28.550891 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cff08963-f3d2-430c-abc4-b0f97520b8b4 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:28.580288 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cff08963-f3d2-430c-abc4-b0f97520b8b4 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:28.616353 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb8ec04e-d2cd-4790-a39f-2b51b8e6e7b1 None None] Network 87a22671-0e6a-414f-86be-13172b5f3f96 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:28.637887 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-3716fc23-7dac-425e-9f33-866cbce443aa req-c9ee8b52-afb9-42d4-9297-b8aaaa28e1fd service neutron] Transition to ACTIVE for port object 6c9a3e10-d6a0-46ac-9270-26bf85000b0e will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:39:28.660258 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3716fc23-7dac-425e-9f33-866cbce443aa req-c9ee8b52-afb9-42d4-9297-b8aaaa28e1fd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:28.701158 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f33f62be-b549-4107-b86c-3960eb6bcd6d req-e753ff3b-be45-4ff9-bc89-2d222fdbec4a tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:28.707323 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f33f62be-b549-4107-b86c-3960eb6bcd6d req-e753ff3b-be45-4ff9-bc89-2d222fdbec4a tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] 10.222.0.13 "GET /v2.0/ports?device_id=4619a834-a481-4429-bb09-806f8f9bd76d HTTP/1.1" status: 200 len: 931 time: 0.1967378 Dec 09 21:39:28.722459 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cff08963-f3d2-430c-abc4-b0f97520b8b4 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Port': ['ID=f1027ff4-b141-4182-870b-0919f06b9112,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:28.744805 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9391c2da-026f-4d24-92b0-d891766627f2 req-2e60b015-b0b1-40ac-9985-099327ffdcd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:28.746460 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9391c2da-026f-4d24-92b0-d891766627f2 req-2e60b015-b0b1-40ac-9985-099327ffdcd7 service neutron] 10.222.0.10 "GET /v2.0/networks?id=a71f32bb-6d3a-4295-a0cb-027407f942be HTTP/1.1" status: 200 len: 912 time: 0.3175101 Dec 09 21:39:28.837330 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9391c2da-026f-4d24-92b0-d891766627f2 req-4380fd5d-9379-4539-9cad-6f8dc9b47844 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=101912b6-96a7-4280-822a-8c03b59cc0b0 HTTP/1.1" status: 200 len: 217 time: 0.0678482 Dec 09 21:39:28.938831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9ee8b52-afb9-42d4-9297-b8aaaa28e1fd service neutron] Pushing event updated for resources: {'Port': ['ID=6c9a3e10-d6a0-46ac-9270-26bf85000b0e,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:28.962078 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f33f62be-b549-4107-b86c-3960eb6bcd6d req-5f7ee211-6246-4962-8a70-62a6b64586f5 tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] 10.222.0.13 "GET /v2.0/security-groups?id=67510712-ba9d-4f78-9590-39f7011e7609&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1582618 Dec 09 21:39:28.997143 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-3716fc23-7dac-425e-9f33-866cbce443aa req-c9ee8b52-afb9-42d4-9297-b8aaaa28e1fd service neutron] Attempting to bind port 6c9a3e10-d6a0-46ac-9270-26bf85000b0e on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:39:28.997571 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-3716fc23-7dac-425e-9f33-866cbce443aa req-c9ee8b52-afb9-42d4-9297-b8aaaa28e1fd service neutron] Attempting to bind port 6c9a3e10-d6a0-46ac-9270-26bf85000b0e by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '1e281a9e-ceca-4b82-a4db-f71cde3ef950', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '6234858b-69ec-4f21-b01b-eb3e9bd6848b'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:39:28.997968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3716fc23-7dac-425e-9f33-866cbce443aa req-c9ee8b52-afb9-42d4-9297-b8aaaa28e1fd service neutron] Attempting to bind port 6c9a3e10-d6a0-46ac-9270-26bf85000b0e on network 6234858b-69ec-4f21-b01b-eb3e9bd6848b {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:39:29.003891 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3716fc23-7dac-425e-9f33-866cbce443aa req-c9ee8b52-afb9-42d4-9297-b8aaaa28e1fd service neutron] Port 6c9a3e10-d6a0-46ac-9270-26bf85000b0e on network 6234858b-69ec-4f21-b01b-eb3e9bd6848b not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:39:29.004216 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3716fc23-7dac-425e-9f33-866cbce443aa req-c9ee8b52-afb9-42d4-9297-b8aaaa28e1fd service neutron] Attempting to bind port 6c9a3e10-d6a0-46ac-9270-26bf85000b0e on network 6234858b-69ec-4f21-b01b-eb3e9bd6848b {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:39:29.009492 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3716fc23-7dac-425e-9f33-866cbce443aa req-c9ee8b52-afb9-42d4-9297-b8aaaa28e1fd service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 39, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:39:29.009955 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3716fc23-7dac-425e-9f33-866cbce443aa req-c9ee8b52-afb9-42d4-9297-b8aaaa28e1fd service neutron] Checking segment: {'id': '1e281a9e-ceca-4b82-a4db-f71cde3ef950', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '6234858b-69ec-4f21-b01b-eb3e9bd6848b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:39:29.010343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3716fc23-7dac-425e-9f33-866cbce443aa req-c9ee8b52-afb9-42d4-9297-b8aaaa28e1fd service neutron] Bound using segment: {'id': '1e281a9e-ceca-4b82-a4db-f71cde3ef950', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '6234858b-69ec-4f21-b01b-eb3e9bd6848b'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:39:29.010773 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-3716fc23-7dac-425e-9f33-866cbce443aa req-c9ee8b52-afb9-42d4-9297-b8aaaa28e1fd service neutron] Bound port: 6c9a3e10-d6a0-46ac-9270-26bf85000b0e, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1e281a9e-ceca-4b82-a4db-f71cde3ef950', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 143, 'network_id': '6234858b-69ec-4f21-b01b-eb3e9bd6848b'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:39:29.011131 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3716fc23-7dac-425e-9f33-866cbce443aa req-c9ee8b52-afb9-42d4-9297-b8aaaa28e1fd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:29.017786 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9391c2da-026f-4d24-92b0-d891766627f2 req-8602a009-da7b-4507-8f0a-3779e7b2e2de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:29.019856 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9391c2da-026f-4d24-92b0-d891766627f2 req-8602a009-da7b-4507-8f0a-3779e7b2e2de service neutron] 10.222.0.10 "GET /v2.0/subnets?id=ee1b3d8d-21b5-45b8-802b-af8c84fb9577 HTTP/1.1" status: 200 len: 851 time: 0.1480944 Dec 09 21:39:29.026209 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-cff08963-f3d2-430c-abc4-b0f97520b8b4 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] In _notify_port_updated(), no bound segment for port f1027ff4-b141-4182-870b-0919f06b9112 on network e7bdf216-9307-460a-aa2d-f1a37aada31e {{(pid=103437) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:39:29.035005 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cff08963-f3d2-430c-abc4-b0f97520b8b4 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:29.035902 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cff08963-f3d2-430c-abc4-b0f97520b8b4 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:29.037462 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cff08963-f3d2-430c-abc4-b0f97520b8b4 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "PUT /v2.0/ports/f1027ff4-b141-4182-870b-0919f06b9112 HTTP/1.1" status: 200 len: 998 time: 2.3812923 Dec 09 21:39:29.047064 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57926) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:29.095853 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-3716fc23-7dac-425e-9f33-866cbce443aa req-c9ee8b52-afb9-42d4-9297-b8aaaa28e1fd service neutron] For port 6c9a3e10-d6a0-46ac-9270-26bf85000b0e, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:39:29.099578 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-3716fc23-7dac-425e-9f33-866cbce443aa req-c9ee8b52-afb9-42d4-9297-b8aaaa28e1fd service neutron] For port 6c9a3e10-d6a0-46ac-9270-26bf85000b0e, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6c9a3e10-d6a0-46ac-9270-26bf85000b0e,segment=NetworkSegment(1e281a9e-ceca-4b82-a4db-f71cde3ef950),segment_id=1e281a9e-ceca-4b82-a4db-f71cde3ef950)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:39:29.106308 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3716fc23-7dac-425e-9f33-866cbce443aa req-c9ee8b52-afb9-42d4-9297-b8aaaa28e1fd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:29.130164 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3716fc23-7dac-425e-9f33-866cbce443aa req-c9ee8b52-afb9-42d4-9297-b8aaaa28e1fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:29.130812 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3716fc23-7dac-425e-9f33-866cbce443aa req-c9ee8b52-afb9-42d4-9297-b8aaaa28e1fd service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:29.141492 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3716fc23-7dac-425e-9f33-866cbce443aa req-c9ee8b52-afb9-42d4-9297-b8aaaa28e1fd service neutron] 10.222.0.31 "PUT /v2.0/ports/6c9a3e10-d6a0-46ac-9270-26bf85000b0e HTTP/1.1" status: 200 len: 1092 time: 1.4369690 Dec 09 21:39:29.142489 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4619a834-a481-4429-bb09-806f8f9bd76d', 'tag': '6c9a3e10-d6a0-46ac-9270-26bf85000b0e'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:39:29.146073 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9c2097ea-06ed-4d8d-abdd-b3c77a2fa90b" -d '{"events": [{"name": "network-changed", "server_uuid": "4619a834-a481-4429-bb09-806f8f9bd76d", "tag": "6c9a3e10-d6a0-46ac-9270-26bf85000b0e"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:39:29.200440 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9391c2da-026f-4d24-92b0-d891766627f2 req-f5b75413-c925-494f-a7a9-d4df76f68206 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a71f32bb-6d3a-4295-a0cb-027407f942be&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1616790 Dec 09 21:39:29.263749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9ee8b52-afb9-42d4-9297-b8aaaa28e1fd service neutron] Pushing event updated for resources: {'Port': ['ID=6c9a3e10-d6a0-46ac-9270-26bf85000b0e,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:29.280580 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3716fc23-7dac-425e-9f33-866cbce443aa req-b12cf076-2bf9-42b8-a20a-7a23680efcee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:29.282991 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3716fc23-7dac-425e-9f33-866cbce443aa req-b12cf076-2bf9-42b8-a20a-7a23680efcee service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=37bf08f44fbc4ad89743914d8e228eb0&device_id=4619a834-a481-4429-bb09-806f8f9bd76d HTTP/1.1" status: 200 len: 1095 time: 0.0929401 Dec 09 21:39:29.363279 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3716fc23-7dac-425e-9f33-866cbce443aa req-209af7ea-9b8f-41eb-b867-83df16ab15dc service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=6c9a3e10-d6a0-46ac-9270-26bf85000b0e HTTP/1.1" status: 200 len: 217 time: 0.0696807 Dec 09 21:39:29.364818 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:39:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-43c9294c-f879-46bf-9dd9-66a78d25dbb1 x-openstack-request-id: req-43c9294c-f879-46bf-9dd9-66a78d25dbb1 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:39:29.365109 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4619a834-a481-4429-bb09-806f8f9bd76d", "tag": "6c9a3e10-d6a0-46ac-9270-26bf85000b0e", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:39:29.365899 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-43c9294c-f879-46bf-9dd9-66a78d25dbb1 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:39:29.366307 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4619a834-a481-4429-bb09-806f8f9bd76d', 'tag': '6c9a3e10-d6a0-46ac-9270-26bf85000b0e', 'status': 'completed', 'code': 200} Dec 09 21:39:29.397080 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-778bd879-2361-457a-94d7-af61d990c23e None None] Provisioning complete for port f1027ff4-b141-4182-870b-0919f06b9112 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:29.397558 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-778bd879-2361-457a-94d7-af61d990c23e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:29.436189 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3716fc23-7dac-425e-9f33-866cbce443aa req-e1cf21a1-d000-4468-a767-02b1dcf8de0b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:29.438190 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3716fc23-7dac-425e-9f33-866cbce443aa req-e1cf21a1-d000-4468-a767-02b1dcf8de0b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=442ba23b-1dd6-4dce-ba48-8a9cc723c83d HTTP/1.1" status: 200 len: 850 time: 0.0677195 Dec 09 21:39:29.483614 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3716fc23-7dac-425e-9f33-866cbce443aa req-d24b4760-3958-454e-a2c1-acd13db6b109 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=6234858b-69ec-4f21-b01b-eb3e9bd6848b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0372787 Dec 09 21:39:29.531819 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9391c2da-026f-4d24-92b0-d891766627f2 req-d674f25b-3948-4b04-863e-484761719385 service neutron] 10.222.0.10 "GET /v2.0/networks/a71f32bb-6d3a-4295-a0cb-027407f942be?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2219212 Dec 09 21:39:29.564295 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-206c9842-4b1a-4c7d-8529-e33c648f56f7 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting port f1027ff4-b141-4182-870b-0919f06b9112 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:29.564685 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-206c9842-4b1a-4c7d-8529-e33c648f56f7 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:29.604840 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3f57f66-8430-4e8c-8b9b-1b2ac3c14f76 req-96cc2782-2285-40ed-bc7a-72423f76d0a0 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:29.607300 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3f57f66-8430-4e8c-8b9b-1b2ac3c14f76 req-96cc2782-2285-40ed-bc7a-72423f76d0a0 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/ports?device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 943 time: 0.1268165 Dec 09 21:39:29.681113 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3f57f66-8430-4e8c-8b9b-1b2ac3c14f76 req-16014749-9333-4149-a4c0-d2a63d2d621e tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/security-groups?id=8ee4757d-9f67-4d3c-994b-59905d6c5b2b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0662477 Dec 09 21:39:29.684828 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3716fc23-7dac-425e-9f33-866cbce443aa req-85ee6562-af27-494b-a311-e78bf8e8706b service neutron] 10.222.0.31 "GET /v2.0/networks/6234858b-69ec-4f21-b01b-eb3e9bd6848b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1904285 Dec 09 21:39:29.777518 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-778bd879-2361-457a-94d7-af61d990c23e None None] Port f1027ff4-b141-4182-870b-0919f06b9112 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:39:29.825117 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-206c9842-4b1a-4c7d-8529-e33c648f56f7 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:29.879637 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3716fc23-7dac-425e-9f33-866cbce443aa req-932e9105-48c2-4baf-9c64-96c9ed66c9f6 service neutron] 10.222.0.31 "GET /v2.0/networks/6234858b-69ec-4f21-b01b-eb3e9bd6848b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1810219 Dec 09 21:39:29.937534 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-206c9842-4b1a-4c7d-8529-e33c648f56f7 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Calling delete_port for f1027ff4-b141-4182-870b-0919f06b9112 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:29.960480 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9391c2da-026f-4d24-92b0-d891766627f2 req-79668e7c-5e92-4881-8da5-a6ecd909e10a service neutron] 10.222.0.10 "GET /v2.0/networks/a71f32bb-6d3a-4295-a0cb-027407f942be?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4118721 Dec 09 21:39:30.019567 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c2097ea-06ed-4d8d-abdd-b3c77a2fa90b req-71b24d54-5b1e-4d38-8184-9dade1111096 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:30.021826 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c2097ea-06ed-4d8d-abdd-b3c77a2fa90b req-71b24d54-5b1e-4d38-8184-9dade1111096 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=37bf08f44fbc4ad89743914d8e228eb0&device_id=4619a834-a481-4429-bb09-806f8f9bd76d HTTP/1.1" status: 200 len: 1095 time: 0.0855787 Dec 09 21:39:30.229920 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c2097ea-06ed-4d8d-abdd-b3c77a2fa90b req-063f346a-4463-4e97-a514-501ffb9a9cc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:30.231715 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c2097ea-06ed-4d8d-abdd-b3c77a2fa90b req-063f346a-4463-4e97-a514-501ffb9a9cc6 service neutron] 10.222.0.31 "GET /v2.0/networks?id=6234858b-69ec-4f21-b01b-eb3e9bd6848b HTTP/1.1" status: 200 len: 911 time: 0.2026644 Dec 09 21:39:30.239590 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-206c9842-4b1a-4c7d-8529-e33c648f56f7 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:30.292500 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c2097ea-06ed-4d8d-abdd-b3c77a2fa90b req-671a1a91-ce8e-4c01-836c-4452127b8fce service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=6c9a3e10-d6a0-46ac-9270-26bf85000b0e HTTP/1.1" status: 200 len: 217 time: 0.0512938 Dec 09 21:39:30.302502 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-11538a4c-52d1-468e-851f-bb7fd7681eb4 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:30.304521 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-11538a4c-52d1-468e-851f-bb7fd7681eb4 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.13 "GET /v2.0/networks?id=87a22671-0e6a-414f-86be-13172b5f3f96 HTTP/1.1" status: 200 len: 814 time: 0.2143648 Dec 09 21:39:30.314467 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-206c9842-4b1a-4c7d-8529-e33c648f56f7 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Port': ['ID=f1027ff4-b141-4182-870b-0919f06b9112,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:30.376111 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 101912b6-96a7-4280-822a-8c03b59cc0b0 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:39:30.397165 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-f9d8590b-9c3d-4e09-a9ae-977fb4731fc8 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.13 "GET /v2.0/quotas/36fd5c73acc341269fd595119af9d891 HTTP/1.1" status: 200 len: 375 time: 0.0812507 Dec 09 21:39:30.461461 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-822b91f6-90f6-4042-b0d2-05c26c5c8ea4 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=36fd5c73acc341269fd595119af9d891&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0609424 Dec 09 21:39:30.473230 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c2097ea-06ed-4d8d-abdd-b3c77a2fa90b req-faf441e2-bd0c-4f0b-b333-5fb8caddd648 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:30.474826 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c2097ea-06ed-4d8d-abdd-b3c77a2fa90b req-faf441e2-bd0c-4f0b-b333-5fb8caddd648 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=442ba23b-1dd6-4dce-ba48-8a9cc723c83d HTTP/1.1" status: 200 len: 850 time: 0.1693218 Dec 09 21:39:30.565454 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-206c9842-4b1a-4c7d-8529-e33c648f56f7 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:30.573977 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-206c9842-4b1a-4c7d-8529-e33c648f56f7 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/ports/f1027ff4-b141-4182-870b-0919f06b9112 HTTP/1.1" status: 204 len: 168 time: 1.5244377 Dec 09 21:39:30.574650 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57994) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:30.598982 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c2097ea-06ed-4d8d-abdd-b3c77a2fa90b req-da838d89-b61a-427a-abc8-27a28a649d3b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=6234858b-69ec-4f21-b01b-eb3e9bd6848b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1028700 Dec 09 21:39:30.628529 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-93959a42-6ef8-4745-bec8-931976e5ada0 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] GET failed (client error): The resource could not be found. Dec 09 21:39:30.634111 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57996) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:30.635871 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 101912b6-96a7-4280-822a-8c03b59cc0b0, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=101912b6-96a7-4280-822a-8c03b59cc0b0,segment=NetworkSegment(e0f6fb16-426b-4e5a-a33f-f4e36fbfbd55),segment_id=e0f6fb16-426b-4e5a-a33f-f4e36fbfbd55)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:30.643043 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-93959a42-6ef8-4745-bec8-931976e5ada0 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports/f1027ff4-b141-4182-870b-0919f06b9112 HTTP/1.1" status: 404 len: 333 time: 0.0629346 Dec 09 21:39:30.665556 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '101912b6-96a7-4280-822a-8c03b59cc0b0', 'network_id': 'a71f32bb-6d3a-4295-a0cb-027407f942be', 'port_id': '101912b6-96a7-4280-822a-8c03b59cc0b0', 'mac_address': 'fa:16:3e:63:a0:c1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 138, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ee1b3d8d-21b5-45b8-802b-af8c84fb9577', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:39:30.760476 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:30.785324 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 101912b6-96a7-4280-822a-8c03b59cc0b0 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:39:30.809972 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 101912b6-96a7-4280-822a-8c03b59cc0b0, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=101912b6-96a7-4280-822a-8c03b59cc0b0,segment=NetworkSegment(e0f6fb16-426b-4e5a-a33f-f4e36fbfbd55),segment_id=e0f6fb16-426b-4e5a-a33f-f4e36fbfbd55)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:30.820333 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:30.876791 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-6dac0025-4ad8-49dd-9491-a912225f0e4b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting subnet 48fe293e-4e46-42c3-955e-3c0061f59c22 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:39:30.884800 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=101912b6-96a7-4280-822a-8c03b59cc0b0,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:30.893284 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:30.894213 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:30.894738 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:30.895608 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:30.896119 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:30.896607 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:30.897088 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:30.897568 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:30.898045 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:30.898529 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:30.899005 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:30.899578 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:30.900220 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:30.907706 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6dac0025-4ad8-49dd-9491-a912225f0e4b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:30.933894 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c2097ea-06ed-4d8d-abdd-b3c77a2fa90b req-2a71bced-9e99-48f9-8657-eed47732fbad service neutron] 10.222.0.31 "GET /v2.0/networks/6234858b-69ec-4f21-b01b-eb3e9bd6848b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3278251 Dec 09 21:39:30.945991 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-2fd9ac88-78b6-486b-b326-7ff779226c13 service neutron] 10.222.0.13 "GET /v2.0/networks/87a22671-0e6a-414f-86be-13172b5f3f96?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4558315 Dec 09 21:39:31.016464 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6dac0025-4ad8-49dd-9491-a912225f0e4b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:31.022151 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['101912b6-96a7-4280-822a-8c03b59cc0b0'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:39:31.465543 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58026) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:31.562205 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-1e1c0756-04ef-4fcd-a3d8-2cfcbd2a8538 service neutron] 10.222.0.13 "GET /v2.0/networks/87a22671-0e6a-414f-86be-13172b5f3f96?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5947583 Dec 09 21:39:31.581170 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c2097ea-06ed-4d8d-abdd-b3c77a2fa90b req-de85e46d-ed16-4c48-a8f7-a687831a0ede service neutron] 10.222.0.31 "GET /v2.0/networks/6234858b-69ec-4f21-b01b-eb3e9bd6848b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6374888 Dec 09 21:39:31.619611 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b503545d-e41e-48ca-9962-b6673986da9c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:31.651486 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6dac0025-4ad8-49dd-9491-a912225f0e4b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:31.740085 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6dac0025-4ad8-49dd-9491-a912225f0e4b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:31.794951 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dac0025-4ad8-49dd-9491-a912225f0e4b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Subnet': ['ID=48fe293e-4e46-42c3-955e-3c0061f59c22,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:31.801198 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6dac0025-4ad8-49dd-9491-a912225f0e4b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:31.801548 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b503545d-e41e-48ca-9962-b6673986da9c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:31.812563 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49563ccb-9cf9-433b-9f67-6983c67a4315 None None] Network e7bdf216-9307-460a-aa2d-f1a37aada31e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:31.813593 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58038) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:31.816524 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6dac0025-4ad8-49dd-9491-a912225f0e4b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/subnets/48fe293e-4e46-42c3-955e-3c0061f59c22 HTTP/1.1" status: 204 len: 168 time: 1.1446831 Dec 09 21:39:31.942478 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-e194a193-4457-4f7a-b549-8fdb9836016f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting subnet 95ad4dcb-14e2-441c-a38e-b25e43db09c8 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:39:31.946109 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b503545d-e41e-48ca-9962-b6673986da9c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:31.961011 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e194a193-4457-4f7a-b549-8fdb9836016f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:31.977034 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-683a4544-434b-456b-9a11-723af9c08789 req-cb483f0f-5e15-465a-8e64-7607ab525e2f tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:31.981271 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-683a4544-434b-456b-9a11-723af9c08789 req-cb483f0f-5e15-465a-8e64-7607ab525e2f tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] 10.222.0.13 "GET /v2.0/ports?device_id=4619a834-a481-4429-bb09-806f8f9bd76d HTTP/1.1" status: 200 len: 943 time: 0.1149058 Dec 09 21:39:32.104270 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-683a4544-434b-456b-9a11-723af9c08789 req-0d1f8d32-4a8c-4d7d-be17-e8fe4798fcf3 tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] 10.222.0.13 "GET /v2.0/security-groups?id=67510712-ba9d-4f78-9590-39f7011e7609&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1157737 Dec 09 21:39:32.151509 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58044) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:32.151659 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b503545d-e41e-48ca-9962-b6673986da9c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=f617dc1e303a4a4fbb234bd08af266b3&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6819508 Dec 09 21:39:32.154467 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e194a193-4457-4f7a-b549-8fdb9836016f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:32.157547 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b503545d-e41e-48ca-9962-b6673986da9c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=82b2c8ca-9605-410f-b84b-698ff31b400f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:32.345845 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-92acd21b-caca-4902-b70d-d0f418b5af22 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:32.384943 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-92acd21b-caca-4902-b70d-d0f418b5af22 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:32.391288 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 101912b6-96a7-4280-822a-8c03b59cc0b0 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:39:32.408074 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e194a193-4457-4f7a-b549-8fdb9836016f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:32.597434 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4af73de-54f5-4f3b-8751-62b189ea60de req-cf7def21-437a-4645-bb4a-a27f5a104c42 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:32.599057 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d4af73de-54f5-4f3b-8751-62b189ea60de req-cf7def21-437a-4645-bb4a-a27f5a104c42 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/ports?device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 944 time: 0.3281791 Dec 09 21:39:32.620809 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 101912b6-96a7-4280-822a-8c03b59cc0b0 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:39:32.628328 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 101912b6-96a7-4280-822a-8c03b59cc0b0 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:32.628756 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:32.659898 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e194a193-4457-4f7a-b549-8fdb9836016f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:32.669171 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-92acd21b-caca-4902-b70d-d0f418b5af22 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:32.685237 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-92acd21b-caca-4902-b70d-d0f418b5af22 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:32.687677 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-92acd21b-caca-4902-b70d-d0f418b5af22 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/82b2c8ca-9605-410f-b84b-698ff31b400f HTTP/1.1" status: 204 len: 168 time: 0.5350440 Dec 09 21:39:32.748829 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92acd21b-caca-4902-b70d-d0f418b5af22 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=82b2c8ca-9605-410f-b84b-698ff31b400f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:32.765159 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6c9a3e10-d6a0-46ac-9270-26bf85000b0e details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:39:32.769140 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e194a193-4457-4f7a-b549-8fdb9836016f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Subnet': ['ID=95ad4dcb-14e2-441c-a38e-b25e43db09c8,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:32.771400 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e194a193-4457-4f7a-b549-8fdb9836016f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:32.791044 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e194a193-4457-4f7a-b549-8fdb9836016f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/subnets/95ad4dcb-14e2-441c-a38e-b25e43db09c8 HTTP/1.1" status: 204 len: 168 time: 0.9732807 Dec 09 21:39:32.800470 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58054) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:32.872273 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d4af73de-54f5-4f3b-8751-62b189ea60de req-36b07322-7965-413f-8624-e68f0037bbf2 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/security-groups?id=8ee4757d-9f67-4d3c-994b-59905d6c5b2b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2324638 Dec 09 21:39:33.015925 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:33.016492 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d598b80f-731f-4017-a8b8-f8c84ff57845 req-bb1eaf7a-a7e7-4ee9-b5b7-f25ca35a337a tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.13 "GET /v2.0/ports?device_id=70db7a29-670a-4a39-969f-14680973ca12 HTTP/1.1" status: 200 len: 210 time: 0.0807409 Dec 09 21:39:33.054142 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-10b9a9dd-ae77-4ef0-85b2-2984b20cb453 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:33.058367 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.resource_extend [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] It took 0.18 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 09 21:39:33.140037 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2f31dfec-1eae-4a8f-8f74-8c6bfe6f8167 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:33.152712 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b84755f7-f8f4-472b-bd23-cc1d256a5497', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '101912b6-96a7-4280-822a-8c03b59cc0b0'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:39:33.157064 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-87c2456c-1076-4332-a8f6-5a2d68eb9e5c" -d '{"events": [{"server_uuid": "b84755f7-f8f4-472b-bd23-cc1d256a5497", "name": "network-vif-plugged", "status": "completed", "tag": "101912b6-96a7-4280-822a-8c03b59cc0b0"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:39:33.209829 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 101912b6-96a7-4280-822a-8c03b59cc0b0, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=101912b6-96a7-4280-822a-8c03b59cc0b0,segment=NetworkSegment(e0f6fb16-426b-4e5a-a33f-f4e36fbfbd55),segment_id=e0f6fb16-426b-4e5a-a33f-f4e36fbfbd55)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:33.227840 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bdfc14cd-1405-4da6-ba78-db3c6ec33f3d None None] Network e7bdf216-9307-460a-aa2d-f1a37aada31e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:33.232663 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:33.253870 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-10b9a9dd-ae77-4ef0-85b2-2984b20cb453 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting port cf0495d5-be33-4a6e-95b9-f79fa439861d {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:33.254304 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-10b9a9dd-ae77-4ef0-85b2-2984b20cb453 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:33.300796 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6c9a3e10-d6a0-46ac-9270-26bf85000b0e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6c9a3e10-d6a0-46ac-9270-26bf85000b0e,segment=NetworkSegment(1e281a9e-ceca-4b82-a4db-f71cde3ef950),segment_id=1e281a9e-ceca-4b82-a4db-f71cde3ef950)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:33.384817 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c3655097-3500-403d-9593-a608dcd869a8 None None] Provisioning complete for port cf0495d5-be33-4a6e-95b9-f79fa439861d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:33.384962 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c3655097-3500-403d-9593-a608dcd869a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:33.386646 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '6c9a3e10-d6a0-46ac-9270-26bf85000b0e', 'network_id': '6234858b-69ec-4f21-b01b-eb3e9bd6848b', 'port_id': '6c9a3e10-d6a0-46ac-9270-26bf85000b0e', 'mac_address': 'fa:16:3e:e4:d6:24', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 143, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '442ba23b-1dd6-4dce-ba48-8a9cc723c83d', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:39:33.412083 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f816dac-d476-41b1-b015-01aa00a6a926 req-e1f5e312-2f7f-404b-b975-8560ea3aa9fb tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:33.437093 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=101912b6-96a7-4280-822a-8c03b59cc0b0,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:33.446312 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f816dac-d476-41b1-b015-01aa00a6a926 req-e1f5e312-2f7f-404b-b975-8560ea3aa9fb tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] 10.222.0.13 "GET /v2.0/ports?device_id=4619a834-a481-4429-bb09-806f8f9bd76d HTTP/1.1" status: 200 len: 943 time: 0.1583672 Dec 09 21:39:33.489063 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:33.502799 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-10b9a9dd-ae77-4ef0-85b2-2984b20cb453 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] For port cf0495d5-be33-4a6e-95b9-f79fa439861d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=cf0495d5-be33-4a6e-95b9-f79fa439861d,segment=NetworkSegment(75657263-ba28-4011-a293-01c4f28442f4),segment_id=75657263-ba28-4011-a293-01c4f28442f4)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:33.503397 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-10b9a9dd-ae77-4ef0-85b2-2984b20cb453 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:33.538418 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6c9a3e10-d6a0-46ac-9270-26bf85000b0e {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:39:33.542958 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-10b9a9dd-ae77-4ef0-85b2-2984b20cb453 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Calling delete_port for cf0495d5-be33-4a6e-95b9-f79fa439861d owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:33.572529 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f816dac-d476-41b1-b015-01aa00a6a926 req-a72aad70-e8b4-4536-ae1e-0fda7a4086c0 tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] 10.222.0.13 "GET /v2.0/security-groups?id=67510712-ba9d-4f78-9590-39f7011e7609&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1253569 Dec 09 21:39:33.666328 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:39:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f812bf69-d670-4ba0-bbf8-69e23d64e4fd x-openstack-request-id: req-f812bf69-d670-4ba0-bbf8-69e23d64e4fd {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:39:33.666625 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b84755f7-f8f4-472b-bd23-cc1d256a5497", "name": "network-vif-plugged", "status": "completed", "tag": "101912b6-96a7-4280-822a-8c03b59cc0b0", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:39:33.667071 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f812bf69-d670-4ba0-bbf8-69e23d64e4fd {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:39:33.667691 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b84755f7-f8f4-472b-bd23-cc1d256a5497', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '101912b6-96a7-4280-822a-8c03b59cc0b0', 'code': 200} Dec 09 21:39:33.668991 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10491887-8815-486f-91a8-462025bb5a5b None None] DHCP port deletion for e7bdf216-9307-460a-aa2d-f1a37aada31e request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:39:33.682399 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6c9a3e10-d6a0-46ac-9270-26bf85000b0e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6c9a3e10-d6a0-46ac-9270-26bf85000b0e,segment=NetworkSegment(1e281a9e-ceca-4b82-a4db-f71cde3ef950),segment_id=1e281a9e-ceca-4b82-a4db-f71cde3ef950)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:33.710687 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:33.728100 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-10b9a9dd-ae77-4ef0-85b2-2984b20cb453 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:33.796122 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-10491887-8815-486f-91a8-462025bb5a5b None None] Deleting port cf0495d5-be33-4a6e-95b9-f79fa439861d {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:33.796122 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-10491887-8815-486f-91a8-462025bb5a5b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:33.814030 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10b9a9dd-ae77-4ef0-85b2-2984b20cb453 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Port': ['ID=cf0495d5-be33-4a6e-95b9-f79fa439861d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:33.815533 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=6c9a3e10-d6a0-46ac-9270-26bf85000b0e,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:33.849962 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10b9a9dd-ae77-4ef0-85b2-2984b20cb453 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] No DVR routers for this DVR port cf0495d5-be33-4a6e-95b9-f79fa439861d on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:39:33.995208 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-10491887-8815-486f-91a8-462025bb5a5b None None] For port cf0495d5-be33-4a6e-95b9-f79fa439861d, host n-d-713301-27, got binding levels [] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:33.996585 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-10491887-8815-486f-91a8-462025bb5a5b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:34.033256 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['6c9a3e10-d6a0-46ac-9270-26bf85000b0e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:39:34.078251 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-10491887-8815-486f-91a8-462025bb5a5b None None] Calling delete_port for cf0495d5-be33-4a6e-95b9-f79fa439861d owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:34.082489 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device cf0495d5-be33-4a6e-95b9-f79fa439861d no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:39:34.086774 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.ipam_backend_mixin [None req-10491887-8815-486f-91a8-462025bb5a5b None None] Port cf0495d5-be33-4a6e-95b9-f79fa439861d was not found and therefore no delete operation was performed {{(pid=103439) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 09 21:39:34.114631 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-10491887-8815-486f-91a8-462025bb5a5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:34.129412 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10491887-8815-486f-91a8-462025bb5a5b None None] No DVR routers for this DVR port cf0495d5-be33-4a6e-95b9-f79fa439861d on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:39:34.132938 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: cf0495d5-be33-4a6e-95b9-f79fa439861d {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:39:34.133812 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device cf0495d5-be33-4a6e-95b9-f79fa439861d not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:39:34.142251 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c729906-0db6-409e-850c-3509af590796 req-806d5ebe-cebd-440c-86df-c0e70639d582 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:34.144152 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4c729906-0db6-409e-850c-3509af590796 req-806d5ebe-cebd-440c-86df-c0e70639d582 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/ports?device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 945 time: 0.1679602 Dec 09 21:39:34.191484 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-10b9a9dd-ae77-4ef0-85b2-2984b20cb453 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:34.217325 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-10b9a9dd-ae77-4ef0-85b2-2984b20cb453 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e7bdf216-9307-460a-aa2d-f1a37aada31e']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:34.225853 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10491887-8815-486f-91a8-462025bb5a5b None None] Pushing event deleted for resources: {'Port': ['ID=cf0495d5-be33-4a6e-95b9-f79fa439861d,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:34.245111 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-10b9a9dd-ae77-4ef0-85b2-2984b20cb453 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '75657263-ba28-4011-a293-01c4f28442f4') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:34.245525 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-10b9a9dd-ae77-4ef0-85b2-2984b20cb453 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '75657263-ba28-4011-a293-01c4f28442f4') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:34.269228 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-10b9a9dd-ae77-4ef0-85b2-2984b20cb453 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:34.271782 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4c729906-0db6-409e-850c-3509af590796 req-916b0993-6af9-4b14-9cba-9884aa4a7ce8 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/security-groups?id=8ee4757d-9f67-4d3c-994b-59905d6c5b2b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1191485 Dec 09 21:39:34.296166 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-10b9a9dd-ae77-4ef0-85b2-2984b20cb453 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:34.310999 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-10b9a9dd-ae77-4ef0-85b2-2984b20cb453 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Releasing vlan 119 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:39:34.311338 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-10b9a9dd-ae77-4ef0-85b2-2984b20cb453 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:39:34.394227 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:39:34.397368 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04ff63e5-e9a3-4875-beaf-6175d396a54c req-da8bd9ed-8c1b-4c68-b918-421aa82d0401 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.13 "GET /v2.0/ports?device_id=70db7a29-670a-4a39-969f-14680973ca12 HTTP/1.1" status: 200 len: 210 time: 0.0420723 Dec 09 21:39:34.457594 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-10b9a9dd-ae77-4ef0-85b2-2984b20cb453 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:34.472727 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-10b9a9dd-ae77-4ef0-85b2-2984b20cb453 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:34.481241 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58100) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:34.481676 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-10b9a9dd-ae77-4ef0-85b2-2984b20cb453 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/networks/e7bdf216-9307-460a-aa2d-f1a37aada31e HTTP/1.1" status: 204 len: 168 time: 1.6791947 Dec 09 21:39:34.488798 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b06fdc1-41f7-42a0-a923-e333b30bc100 req-fc1618b6-0c7a-43c0-a42c-322e534084a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:34.491310 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4b06fdc1-41f7-42a0-a923-e333b30bc100 req-fc1618b6-0c7a-43c0-a42c-322e534084a8 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 1097 time: 0.6916349 Dec 09 21:39:34.517574 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10b9a9dd-ae77-4ef0-85b2-2984b20cb453 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Network': ['ID=e7bdf216-9307-460a-aa2d-f1a37aada31e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:34.570643 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-97c428c6-589e-4128-89fa-2d789a64fefc tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:34.572316 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-97c428c6-589e-4128-89fa-2d789a64fefc tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.10 "GET /v2.0/networks?id=87a22671-0e6a-414f-86be-13172b5f3f96 HTTP/1.1" status: 200 len: 814 time: 0.5965757 Dec 09 21:39:34.597940 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-37a41248-546e-49c6-8e44-9882f6ff1c3d tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Request body: {'port': {'device_id': '70db7a29-670a-4a39-969f-14680973ca12', 'network_id': '87a22671-0e6a-414f-86be-13172b5f3f96', 'admin_state_up': True, 'tenant_id': '36fd5c73acc341269fd595119af9d891'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:34.608118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cbc24e78-1e98-44d0-a0d7-b27c7de0d7cd tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:34.614019 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cbc24e78-1e98-44d0-a0d7-b27c7de0d7cd tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 842 time: 0.1316621 Dec 09 21:39:34.618731 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58106) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:34.619483 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4b06fdc1-41f7-42a0-a923-e333b30bc100 req-6f128fd3-50a1-416b-8b9e-153a49565fa5 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=8ee4757d-9f67-4d3c-994b-59905d6c5b2b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1110191 Dec 09 21:39:34.684396 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-dd0f3fa1-f431-481a-88f0-8c2414aebb15 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 284 time: 0.0640433 Dec 09 21:39:34.687799 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58108) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:34.699422 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-7883bfa2-ee40-4db6-9bce-031e3f2132a3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-647123997'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:34.756080 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6c9a3e10-d6a0-46ac-9270-26bf85000b0e up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:39:34.793806 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5880a544-104a-4176-be8d-198b9f3f9871 req-9b0c80a6-b72e-4d1f-a05d-64c290034684 tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:34.802971 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5880a544-104a-4176-be8d-198b9f3f9871 req-9b0c80a6-b72e-4d1f-a05d-64c290034684 tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] 10.222.0.13 "GET /v2.0/ports?device_id=4619a834-a481-4429-bb09-806f8f9bd76d HTTP/1.1" status: 200 len: 944 time: 0.0995963 Dec 09 21:39:34.821425 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7883bfa2-ee40-4db6-9bce-031e3f2132a3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:34.826128 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7883bfa2-ee40-4db6-9bce-031e3f2132a3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:34.857824 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-37a41248-546e-49c6-8e44-9882f6ff1c3d tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Made reservation on behalf of 36fd5c73acc341269fd595119af9d891 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:34.862751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 6c9a3e10-d6a0-46ac-9270-26bf85000b0e completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:39:34.863224 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-37a41248-546e-49c6-8e44-9882f6ff1c3d tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:34.867561 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 6c9a3e10-d6a0-46ac-9270-26bf85000b0e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:34.867799 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:34.960498 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5880a544-104a-4176-be8d-198b9f3f9871 req-3f80a9cc-1499-4c9d-8621-be358914c9a0 tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] 10.222.0.13 "GET /v2.0/security-groups?id=67510712-ba9d-4f78-9590-39f7011e7609&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1469274 Dec 09 21:39:34.984990 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7883bfa2-ee40-4db6-9bce-031e3f2132a3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] vlan segment allocate from pool success with {'vlan_id': 113, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:39:35.009924 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7883bfa2-ee40-4db6-9bce-031e3f2132a3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:35.010540 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-7883bfa2-ee40-4db6-9bce-031e3f2132a3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Added segment ef2dadc8-8fb8-4456-b117-b78bc745a628 of type vlan for network d37a530f-3e45-486f-b834-d3f63ac2dcc8 Dec 09 21:39:35.011353 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:35.064680 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6c9a3e10-d6a0-46ac-9270-26bf85000b0e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6c9a3e10-d6a0-46ac-9270-26bf85000b0e,segment=NetworkSegment(1e281a9e-ceca-4b82-a4db-f71cde3ef950),segment_id=1e281a9e-ceca-4b82-a4db-f71cde3ef950)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:35.074152 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:35.103560 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7883bfa2-ee40-4db6-9bce-031e3f2132a3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:35.125087 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-37a41248-546e-49c6-8e44-9882f6ff1c3d tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Allocated IP 172.20.0.14 (87a22671-0e6a-414f-86be-13172b5f3f96/250bd3c5-f070-4269-9a20-15374747311c/2727a3d5-3409-4051-aa40-248e3e2d9858) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:39:35.169605 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=6c9a3e10-d6a0-46ac-9270-26bf85000b0e,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:35.191793 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7883bfa2-ee40-4db6-9bce-031e3f2132a3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:35.222542 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7883bfa2-ee40-4db6-9bce-031e3f2132a3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:35.227560 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7883bfa2-ee40-4db6-9bce-031e3f2132a3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:35.317394 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7883bfa2-ee40-4db6-9bce-031e3f2132a3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.6221406 Dec 09 21:39:35.320515 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58138) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:35.327966 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-232c9dcb-09d5-42de-93ed-22937c6f3989 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'subnet': {'network_id': 'd37a530f-3e45-486f-b834-d3f63ac2dcc8', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:35.404067 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7883bfa2-ee40-4db6-9bce-031e3f2132a3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Network': ['ID=d37a530f-3e45-486f-b834-d3f63ac2dcc8,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:35.414733 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network d37a530f-3e45-486f-b834-d3f63ac2dcc8 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:39:35.420805 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-37a41248-546e-49c6-8e44-9882f6ff1c3d tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:35.517095 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-37a41248-546e-49c6-8e44-9882f6ff1c3d tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:35.600127 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-37a41248-546e-49c6-8e44-9882f6ff1c3d tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Network 87a22671-0e6a-414f-86be-13172b5f3f96 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:39:35.607287 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-37a41248-546e-49c6-8e44-9882f6ff1c3d tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:35.607287 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-37a41248-546e-49c6-8e44-9882f6ff1c3d tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:39:35.664207 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-37a41248-546e-49c6-8e44-9882f6ff1c3d tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:35.665144 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-37a41248-546e-49c6-8e44-9882f6ff1c3d tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:35.670275 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c4fbb537-03c8-411b-8b84-f6a7a264a99e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:35.673008 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4619a834-a481-4429-bb09-806f8f9bd76d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6c9a3e10-d6a0-46ac-9270-26bf85000b0e'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:39:35.681622 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2b3cf169-3b5c-4fef-8bd6-406e95874774" -d '{"events": [{"server_uuid": "4619a834-a481-4429-bb09-806f8f9bd76d", "name": "network-vif-plugged", "status": "completed", "tag": "6c9a3e10-d6a0-46ac-9270-26bf85000b0e"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:39:35.686846 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-232c9dcb-09d5-42de-93ed-22937c6f3989 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:35.691407 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37a41248-546e-49c6-8e44-9882f6ff1c3d tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Pushing event updated for resources: {'Port': ['ID=2727a3d5-3409-4051-aa40-248e3e2d9858,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:35.699464 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-37a41248-546e-49c6-8e44-9882f6ff1c3d tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.1087728 Dec 09 21:39:35.711668 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-232c9dcb-09d5-42de-93ed-22937c6f3989 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:35.714002 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-3513e612-14a2-4654-a853-3a626bd5e29b service neutron] Request body: {'port': {'device_id': '70db7a29-670a-4a39-969f-14680973ca12', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:35.796732 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-3513e612-14a2-4654-a853-3a626bd5e29b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:35.902336 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7968af85-6e48-4a72-bddb-d766b263670d req-5b702abd-82af-4724-a835-a6c902670483 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:35.904923 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7968af85-6e48-4a72-bddb-d766b263670d req-5b702abd-82af-4724-a835-a6c902670483 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/ports?device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 945 time: 0.4001040 Dec 09 21:39:36.000353 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7968af85-6e48-4a72-bddb-d766b263670d req-1fbe9bb1-8723-4dbf-8860-11a6a21d0217 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/security-groups?id=8ee4757d-9f67-4d3c-994b-59905d6c5b2b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0885844 Dec 09 21:39:36.234893 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cb3bc9b-3b22-4375-bafb-b3913e7bd84c req-982f04c4-f607-45ed-b882-5957bd2aa5ea tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:36.243919 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1cb3bc9b-3b22-4375-bafb-b3913e7bd84c req-982f04c4-f607-45ed-b882-5957bd2aa5ea tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.13 "GET /v2.0/ports?device_id=70db7a29-670a-4a39-969f-14680973ca12 HTTP/1.1" status: 200 len: 932 time: 0.1246393 Dec 09 21:39:36.247594 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-232c9dcb-09d5-42de-93ed-22937c6f3989 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:36.372096 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1cb3bc9b-3b22-4375-bafb-b3913e7bd84c req-c3345df4-f56d-45fa-a256-dd62eecf7b38 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.13 "GET /v2.0/security-groups?id=e1c1ce62-2b22-487b-b831-0504741b720a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1250904 Dec 09 21:39:36.398684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-232c9dcb-09d5-42de-93ed-22937c6f3989 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Checking segment: {'id': 'ef2dadc8-8fb8-4456-b117-b78bc745a628', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': 'd37a530f-3e45-486f-b834-d3f63ac2dcc8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:39:36.399060 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-232c9dcb-09d5-42de-93ed-22937c6f3989 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network hostable DHCP agents. Network: d37a530f-3e45-486f-b834-d3f63ac2dcc8, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:39:36.409904 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-232c9dcb-09d5-42de-93ed-22937c6f3989 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Subnet': ['ID=7436ce42-ee15-41bb-969b-33c87ec74858,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:36.428230 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-3513e612-14a2-4654-a853-3a626bd5e29b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2727a3d5-3409-4051-aa40-248e3e2d9858 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:39:36.443256 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-232c9dcb-09d5-42de-93ed-22937c6f3989 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network d37a530f-3e45-486f-b834-d3f63ac2dcc8 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:39:36.450415 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-3513e612-14a2-4654-a853-3a626bd5e29b service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:36.454715 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:39:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-749a0329-95cd-4097-be03-7d60a6067c08 x-openstack-request-id: req-749a0329-95cd-4097-be03-7d60a6067c08 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:39:36.455411 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4619a834-a481-4429-bb09-806f8f9bd76d", "name": "network-vif-plugged", "status": "completed", "tag": "6c9a3e10-d6a0-46ac-9270-26bf85000b0e", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:39:36.455411 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-749a0329-95cd-4097-be03-7d60a6067c08 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:39:36.455819 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4619a834-a481-4429-bb09-806f8f9bd76d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6c9a3e10-d6a0-46ac-9270-26bf85000b0e', 'code': 200} Dec 09 21:39:36.466576 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-232c9dcb-09d5-42de-93ed-22937c6f3989 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, d37a530f-3e45-486f-b834-d3f63ac2dcc8) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:36.472179 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-232c9dcb-09d5-42de-93ed-22937c6f3989 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:36.473019 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-232c9dcb-09d5-42de-93ed-22937c6f3989 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:36.478297 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-3513e612-14a2-4654-a853-3a626bd5e29b service neutron] Transition to ACTIVE for port object 2727a3d5-3409-4051-aa40-248e3e2d9858 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:39:36.488546 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1eeea40a-6fd1-4eb9-a1e9-28013d44f0cd None None] Network d37a530f-3e45-486f-b834-d3f63ac2dcc8 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:36.489329 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-3513e612-14a2-4654-a853-3a626bd5e29b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:36.517495 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-232c9dcb-09d5-42de-93ed-22937c6f3989 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.1937187 Dec 09 21:39:36.521436 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58244) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:36.603117 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-69dc8cfc-e3b9-4b23-b5b2-87c5fe31f1f3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'port': {'network_id': 'd37a530f-3e45-486f-b834-d3f63ac2dcc8', 'name': 'tempest-PortsTestJSON-466220167'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:36.697897 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df7e83d3-2614-435d-9d7b-6d670da00cab None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-d37a530f-3e45-486f-b834-d3f63ac2dcc8', 'network_id': 'd37a530f-3e45-486f-b834-d3f63ac2dcc8', 'project_id': 'e8bdea0c320d4955bc3ba905696bda85', 'fixed_ips': [{'subnet_id': '7436ce42-ee15-41bb-969b-33c87ec74858'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:39:36.699380 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-df7e83d3-2614-435d-9d7b-6d670da00cab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:36.702124 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc73307b-1d68-4282-9d8d-ebc8d0f8cfdd req-ae72fa6e-66e4-49a5-b691-84ead5fc31e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:36.708299 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3513e612-14a2-4654-a853-3a626bd5e29b service neutron] Pushing event updated for resources: {'Port': ['ID=2727a3d5-3409-4051-aa40-248e3e2d9858,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:36.723646 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc73307b-1d68-4282-9d8d-ebc8d0f8cfdd req-ae72fa6e-66e4-49a5-b691-84ead5fc31e7 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=4619a834-a481-4429-bb09-806f8f9bd76d HTTP/1.1" status: 200 len: 1097 time: 0.1816730 Dec 09 21:39:36.734770 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:36.843177 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc73307b-1d68-4282-9d8d-ebc8d0f8cfdd req-06ef0285-b316-43d1-8f80-0e4dcde65320 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=67510712-ba9d-4f78-9590-39f7011e7609&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1124618 Dec 09 21:39:36.890762 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-3513e612-14a2-4654-a853-3a626bd5e29b service neutron] Attempting to bind port 2727a3d5-3409-4051-aa40-248e3e2d9858 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:39:36.891192 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-3513e612-14a2-4654-a853-3a626bd5e29b service neutron] Attempting to bind port 2727a3d5-3409-4051-aa40-248e3e2d9858 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '21ec9cce-e1fc-4f03-b167-7ca6b7df97ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '87a22671-0e6a-414f-86be-13172b5f3f96'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:39:36.891624 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-3513e612-14a2-4654-a853-3a626bd5e29b service neutron] Attempting to bind port 2727a3d5-3409-4051-aa40-248e3e2d9858 on network 87a22671-0e6a-414f-86be-13172b5f3f96 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:39:36.902437 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91345d03-cef9-45ae-8395-884a071f7df6 req-6df98c84-5654-4af9-bb3a-5f77379526ef tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:36.904033 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-3513e612-14a2-4654-a853-3a626bd5e29b service neutron] Port 2727a3d5-3409-4051-aa40-248e3e2d9858 on network 87a22671-0e6a-414f-86be-13172b5f3f96 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:39:36.905144 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-3513e612-14a2-4654-a853-3a626bd5e29b service neutron] Attempting to bind port 2727a3d5-3409-4051-aa40-248e3e2d9858 on network 87a22671-0e6a-414f-86be-13172b5f3f96 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:39:36.917543 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-91345d03-cef9-45ae-8395-884a071f7df6 req-6df98c84-5654-4af9-bb3a-5f77379526ef tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] 10.222.0.13 "GET /v2.0/ports?device_id=4619a834-a481-4429-bb09-806f8f9bd76d HTTP/1.1" status: 200 len: 945 time: 0.3102448 Dec 09 21:39:36.933020 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-3513e612-14a2-4654-a853-3a626bd5e29b service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 39, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:39:36.934361 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-3513e612-14a2-4654-a853-3a626bd5e29b service neutron] Checking segment: {'id': '21ec9cce-e1fc-4f03-b167-7ca6b7df97ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '87a22671-0e6a-414f-86be-13172b5f3f96'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:39:36.937342 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-3513e612-14a2-4654-a853-3a626bd5e29b service neutron] Bound using segment: {'id': '21ec9cce-e1fc-4f03-b167-7ca6b7df97ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '87a22671-0e6a-414f-86be-13172b5f3f96'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:39:36.937949 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-3513e612-14a2-4654-a853-3a626bd5e29b service neutron] Bound port: 2727a3d5-3409-4051-aa40-248e3e2d9858, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21ec9cce-e1fc-4f03-b167-7ca6b7df97ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': '87a22671-0e6a-414f-86be-13172b5f3f96'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:39:36.938681 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-3513e612-14a2-4654-a853-3a626bd5e29b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:37.021070 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-69dc8cfc-e3b9-4b23-b5b2-87c5fe31f1f3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:37.026280 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-69dc8cfc-e3b9-4b23-b5b2-87c5fe31f1f3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:37.078998 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-69dc8cfc-e3b9-4b23-b5b2-87c5fe31f1f3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] device_id is not set on port e1c9ec83-40f1-4059-bdf3-b58f95c350f6 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:39:37.088490 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-df7e83d3-2614-435d-9d7b-6d670da00cab None None] Allocated IP 172.20.0.2 (d37a530f-3e45-486f-b834-d3f63ac2dcc8/7436ce42-ee15-41bb-969b-33c87ec74858/5c485bd0-5ac4-43cd-b3e2-69f993f32c4f) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:39:37.100770 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-91345d03-cef9-45ae-8395-884a071f7df6 req-875e3b45-f5b4-4266-bfb7-dd62c3e4130d tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] 10.222.0.13 "GET /v2.0/security-groups?id=67510712-ba9d-4f78-9590-39f7011e7609&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1805437 Dec 09 21:39:37.200299 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-3513e612-14a2-4654-a853-3a626bd5e29b service neutron] For port 2727a3d5-3409-4051-aa40-248e3e2d9858, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:39:37.252553 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-3513e612-14a2-4654-a853-3a626bd5e29b service neutron] For port 2727a3d5-3409-4051-aa40-248e3e2d9858, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=2727a3d5-3409-4051-aa40-248e3e2d9858,segment=NetworkSegment(21ec9cce-e1fc-4f03-b167-7ca6b7df97ea),segment_id=21ec9cce-e1fc-4f03-b167-7ca6b7df97ea)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:39:37.261914 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-3513e612-14a2-4654-a853-3a626bd5e29b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:37.265295 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41c285db-4edf-42e0-93ff-b94e57b42027 req-8e6e78b6-0b11-4a8b-addb-2fd53d0952d9 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:37.274141 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-41c285db-4edf-42e0-93ff-b94e57b42027 req-8e6e78b6-0b11-4a8b-addb-2fd53d0952d9 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/ports?device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 945 time: 0.0890217 Dec 09 21:39:37.316182 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-3513e612-14a2-4654-a853-3a626bd5e29b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:37.317508 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-3513e612-14a2-4654-a853-3a626bd5e29b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:37.320501 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-3513e612-14a2-4654-a853-3a626bd5e29b service neutron] 10.222.0.10 "PUT /v2.0/ports/2727a3d5-3409-4051-aa40-248e3e2d9858 HTTP/1.1" status: 200 len: 1093 time: 1.6118898 Dec 09 21:39:37.320738 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-df7e83d3-2614-435d-9d7b-6d670da00cab None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:37.321320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '70db7a29-670a-4a39-969f-14680973ca12', 'tag': '2727a3d5-3409-4051-aa40-248e3e2d9858'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:39:37.324294 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-34647d01-a41a-4e5d-9898-bfade9c72c7e" -d '{"events": [{"name": "network-changed", "server_uuid": "70db7a29-670a-4a39-969f-14680973ca12", "tag": "2727a3d5-3409-4051-aa40-248e3e2d9858"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:39:37.333442 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-df7e83d3-2614-435d-9d7b-6d670da00cab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:37.359065 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-41c285db-4edf-42e0-93ff-b94e57b42027 req-5c49865c-2bc7-4c58-abfd-efd7c05affee tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/security-groups?id=8ee4757d-9f67-4d3c-994b-59905d6c5b2b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0836890 Dec 09 21:39:37.410211 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-df7e83d3-2614-435d-9d7b-6d670da00cab None None] Network d37a530f-3e45-486f-b834-d3f63ac2dcc8 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:39:37.413459 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-df7e83d3-2614-435d-9d7b-6d670da00cab None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:37.416001 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df7e83d3-2614-435d-9d7b-6d670da00cab None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:39:37.427638 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df7e83d3-2614-435d-9d7b-6d670da00cab None None] Pushing event updated for resources: {'Port': ['ID=5c485bd0-5ac4-43cd-b3e2-69f993f32c4f,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:37.502288 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:39:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a30b9378-bf0c-4a8b-8e84-2147742e517e x-openstack-request-id: req-a30b9378-bf0c-4a8b-8e84-2147742e517e {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:39:37.502871 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "70db7a29-670a-4a39-969f-14680973ca12", "tag": "2727a3d5-3409-4051-aa40-248e3e2d9858", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:39:37.502871 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a30b9378-bf0c-4a8b-8e84-2147742e517e {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:39:37.504176 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '70db7a29-670a-4a39-969f-14680973ca12', 'tag': '2727a3d5-3409-4051-aa40-248e3e2d9858', 'status': 'completed', 'code': 200} Dec 09 21:39:37.533011 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3513e612-14a2-4654-a853-3a626bd5e29b service neutron] Pushing event updated for resources: {'Port': ['ID=2727a3d5-3409-4051-aa40-248e3e2d9858,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:37.539223 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-df7e83d3-2614-435d-9d7b-6d670da00cab None None] Attempting to bind port 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:39:37.542606 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-df7e83d3-2614-435d-9d7b-6d670da00cab None None] Attempting to bind port 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'ef2dadc8-8fb8-4456-b117-b78bc745a628', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': 'd37a530f-3e45-486f-b834-d3f63ac2dcc8'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:39:37.543599 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df7e83d3-2614-435d-9d7b-6d670da00cab None None] Attempting to bind port 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f on network d37a530f-3e45-486f-b834-d3f63ac2dcc8 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:39:37.554487 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-914d3d9f-8f85-40d2-bfd8-b0ffb4510d75 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:37.557200 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df7e83d3-2614-435d-9d7b-6d670da00cab None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 39, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:39:37.557595 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df7e83d3-2614-435d-9d7b-6d670da00cab None None] Checking segment: {'id': 'ef2dadc8-8fb8-4456-b117-b78bc745a628', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': 'd37a530f-3e45-486f-b834-d3f63ac2dcc8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:39:37.558009 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-df7e83d3-2614-435d-9d7b-6d670da00cab None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:37.558410 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df7e83d3-2614-435d-9d7b-6d670da00cab None None] Bound using segment: {'id': 'ef2dadc8-8fb8-4456-b117-b78bc745a628', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': 'd37a530f-3e45-486f-b834-d3f63ac2dcc8'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:39:37.560319 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-914d3d9f-8f85-40d2-bfd8-b0ffb4510d75 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=36fd5c73acc341269fd595119af9d891&device_id=70db7a29-670a-4a39-969f-14680973ca12 HTTP/1.1" status: 200 len: 1096 time: 0.1936867 Dec 09 21:39:37.565988 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-69dc8cfc-e3b9-4b23-b5b2-87c5fe31f1f3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Allocated IP 172.20.0.9 (d37a530f-3e45-486f-b834-d3f63ac2dcc8/7436ce42-ee15-41bb-969b-33c87ec74858/e1c9ec83-40f1-4059-bdf3-b58f95c350f6) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:39:37.571326 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-df7e83d3-2614-435d-9d7b-6d670da00cab None None] Bound port: 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ef2dadc8-8fb8-4456-b117-b78bc745a628', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': 'd37a530f-3e45-486f-b834-d3f63ac2dcc8'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:39:37.573246 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-df7e83d3-2614-435d-9d7b-6d670da00cab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:37.678389 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35105393-1e60-47ca-a55f-442b76b4eecd req-644200c4-bb77-4ae2-9bd7-1fa0e07078dd tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:37.679324 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-df7e83d3-2614-435d-9d7b-6d670da00cab None None] For port 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:39:37.683344 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-df7e83d3-2614-435d-9d7b-6d670da00cab None None] For port 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5c485bd0-5ac4-43cd-b3e2-69f993f32c4f,segment=NetworkSegment(ef2dadc8-8fb8-4456-b117-b78bc745a628),segment_id=ef2dadc8-8fb8-4456-b117-b78bc745a628)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:39:37.691486 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-d36e1ffd-c21a-4209-82a0-6eed9cb064bf service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=2727a3d5-3409-4051-aa40-248e3e2d9858 HTTP/1.1" status: 200 len: 217 time: 0.1200094 Dec 09 21:39:37.692033 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-df7e83d3-2614-435d-9d7b-6d670da00cab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:37.696997 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35105393-1e60-47ca-a55f-442b76b4eecd req-644200c4-bb77-4ae2-9bd7-1fa0e07078dd tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/ports?device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 945 time: 0.1079113 Dec 09 21:39:37.844477 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df7e83d3-2614-435d-9d7b-6d670da00cab None None] Pushing event updated for resources: {'Port': ['ID=5c485bd0-5ac4-43cd-b3e2-69f993f32c4f,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:37.882684 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-0ae5f7a9-269b-44ef-8340-b6584c4947ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:37.885778 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-0ae5f7a9-269b-44ef-8340-b6584c4947ce service neutron] 10.222.0.10 "GET /v2.0/subnets?id=250bd3c5-f070-4269-9a20-15374747311c HTTP/1.1" status: 200 len: 854 time: 0.1837506 Dec 09 21:39:37.953348 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35105393-1e60-47ca-a55f-442b76b4eecd req-e1b3abd5-f605-4791-9d0f-72e1494885a2 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/security-groups?id=8ee4757d-9f67-4d3c-994b-59905d6c5b2b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2543736 Dec 09 21:39:37.966695 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:38.041318 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-b61c3e80-f80d-49ec-94dc-31a4aa05ae0b service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=87a22671-0e6a-414f-86be-13172b5f3f96&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1382818 Dec 09 21:39:38.160312 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-69dc8cfc-e3b9-4b23-b5b2-87c5fe31f1f3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:38.216002 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-ebf3ff89-163e-4042-8d4b-b57254f3d941 service neutron] 10.222.0.10 "GET /v2.0/networks/87a22671-0e6a-414f-86be-13172b5f3f96?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1665416 Dec 09 21:39:38.218485 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0288d32d-27fd-4f44-a63a-f8f533424756 req-18a15e6c-c477-4a0e-b767-53dfa735babb tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:38.221351 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0288d32d-27fd-4f44-a63a-f8f533424756 req-18a15e6c-c477-4a0e-b767-53dfa735babb tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.13 "GET /v2.0/ports?device_id=70db7a29-670a-4a39-969f-14680973ca12 HTTP/1.1" status: 200 len: 944 time: 0.0926006 Dec 09 21:39:38.335745 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0288d32d-27fd-4f44-a63a-f8f533424756 req-153cff66-2f95-4eca-b318-03c4dfa5e80f tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.13 "GET /v2.0/security-groups?id=e1c1ce62-2b22-487b-b831-0504741b720a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1081047 Dec 09 21:39:38.356632 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-69dc8cfc-e3b9-4b23-b5b2-87c5fe31f1f3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:38.480753 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-69dc8cfc-e3b9-4b23-b5b2-87c5fe31f1f3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network d37a530f-3e45-486f-b834-d3f63ac2dcc8 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:39:38.486521 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-69dc8cfc-e3b9-4b23-b5b2-87c5fe31f1f3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:38.506947 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69dc8cfc-e3b9-4b23-b5b2-87c5fe31f1f3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:39:38.547502 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69dc8cfc-e3b9-4b23-b5b2-87c5fe31f1f3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Port': ['ID=e1c9ec83-40f1-4059-bdf3-b58f95c350f6,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:38.563738 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ae37b22-0b70-4446-b178-ca1d091c6656 req-4f15faf5-c63f-4a85-94df-826c65258c81 service neutron] 10.222.0.10 "GET /v2.0/networks/87a22671-0e6a-414f-86be-13172b5f3f96?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3383381 Dec 09 21:39:38.599514 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-69dc8cfc-e3b9-4b23-b5b2-87c5fe31f1f3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:38.600990 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-69dc8cfc-e3b9-4b23-b5b2-87c5fe31f1f3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:38.630312 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58362) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:38.630816 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-69dc8cfc-e3b9-4b23-b5b2-87c5fe31f1f3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 923 time: 2.0350921 Dec 09 21:39:38.636015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a9940b26-ccac-4580-8a01-49ef53c89f71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'port': {'network_id': 'd37a530f-3e45-486f-b834-d3f63ac2dcc8', 'name': 'tempest-PortsTestJSON-1821063009'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:38.748007 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34647d01-a41a-4e5d-9898-bfade9c72c7e req-debc60e3-e658-4223-a119-60a9e007fe65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:38.749827 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-34647d01-a41a-4e5d-9898-bfade9c72c7e req-debc60e3-e658-4223-a119-60a9e007fe65 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=36fd5c73acc341269fd595119af9d891&device_id=70db7a29-670a-4a39-969f-14680973ca12 HTTP/1.1" status: 200 len: 1096 time: 0.0884857 Dec 09 21:39:38.980722 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-381c2ba6-9b5d-48ba-b4f4-7d132a25e5e1 req-787dc420-1c8a-4356-b7cf-a8d54b4a4872 tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:39.006273 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-381c2ba6-9b5d-48ba-b4f4-7d132a25e5e1 req-787dc420-1c8a-4356-b7cf-a8d54b4a4872 tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] 10.222.0.13 "GET /v2.0/ports?device_id=4619a834-a481-4429-bb09-806f8f9bd76d HTTP/1.1" status: 200 len: 945 time: 0.2360349 Dec 09 21:39:39.200530 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-381c2ba6-9b5d-48ba-b4f4-7d132a25e5e1 req-55be0a76-96e7-4a6f-8813-96c21a862da6 tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] 10.222.0.13 "GET /v2.0/security-groups?id=67510712-ba9d-4f78-9590-39f7011e7609&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1795611 Dec 09 21:39:39.274712 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a9940b26-ccac-4580-8a01-49ef53c89f71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:39.279162 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a9940b26-ccac-4580-8a01-49ef53c89f71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:39.336600 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-a9940b26-ccac-4580-8a01-49ef53c89f71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] device_id is not set on port 80072430-e50e-466f-acc2-17f292594b61 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:39:39.553012 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58390) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:39.559852 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b17edc36-8562-487c-b5ce-5cea83edad76 None None] Network d37a530f-3e45-486f-b834-d3f63ac2dcc8 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:39.596161 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-420a2bf9-cc5e-4d75-8cc7-61a95b3e2077 req-3fd88d5b-ce84-46ba-9e4c-85bfeb0ced90 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:39.607235 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-420a2bf9-cc5e-4d75-8cc7-61a95b3e2077 req-3fd88d5b-ce84-46ba-9e4c-85bfeb0ced90 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/ports?device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 945 time: 0.2728686 Dec 09 21:39:39.693960 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34647d01-a41a-4e5d-9898-bfade9c72c7e req-ccf36d24-f324-47b0-b56a-51a85ba5cd53 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:39.696021 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-34647d01-a41a-4e5d-9898-bfade9c72c7e req-ccf36d24-f324-47b0-b56a-51a85ba5cd53 service neutron] 10.222.0.10 "GET /v2.0/networks?id=87a22671-0e6a-414f-86be-13172b5f3f96 HTTP/1.1" status: 200 len: 915 time: 0.9312871 Dec 09 21:39:39.750749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-a9940b26-ccac-4580-8a01-49ef53c89f71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Allocated IP 172.20.0.3 (d37a530f-3e45-486f-b834-d3f63ac2dcc8/7436ce42-ee15-41bb-969b-33c87ec74858/80072430-e50e-466f-acc2-17f292594b61) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:39:39.760904 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-34647d01-a41a-4e5d-9898-bfade9c72c7e req-5ab39c23-e53d-417b-9576-40361deb793a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=2727a3d5-3409-4051-aa40-248e3e2d9858 HTTP/1.1" status: 200 len: 217 time: 0.0556333 Dec 09 21:39:39.841914 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34647d01-a41a-4e5d-9898-bfade9c72c7e req-139b8e17-f4c4-43a3-a5ce-04db1c593140 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:39.844639 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-34647d01-a41a-4e5d-9898-bfade9c72c7e req-139b8e17-f4c4-43a3-a5ce-04db1c593140 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=250bd3c5-f070-4269-9a20-15374747311c HTTP/1.1" status: 200 len: 854 time: 0.0777819 Dec 09 21:39:39.857061 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c370d3db-de11-42d2-901a-75f24b64de2b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:39.888441 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-dfee5a6a-56cc-4732-a49b-55be60bb9fc7 None None] Provisioning complete for port 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:39.889013 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dfee5a6a-56cc-4732-a49b-55be60bb9fc7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:39.917401 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-34647d01-a41a-4e5d-9898-bfade9c72c7e req-2fcec0e8-a3e3-4ecf-9ab2-a03fd14fd10f service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=87a22671-0e6a-414f-86be-13172b5f3f96&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0634580 Dec 09 21:39:39.922639 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:40.056958 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c370d3db-de11-42d2-901a-75f24b64de2b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:40.081311 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:39:40.082994 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-420a2bf9-cc5e-4d75-8cc7-61a95b3e2077 req-a3264d84-6687-4af3-a37d-64c72a6b50df tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/security-groups?id=8ee4757d-9f67-4d3c-994b-59905d6c5b2b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4742916 Dec 09 21:39:40.098287 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c370d3db-de11-42d2-901a-75f24b64de2b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:40.186779 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-34647d01-a41a-4e5d-9898-bfade9c72c7e req-f00141c9-c101-42f7-914c-638a2f2585a4 service neutron] 10.222.0.10 "GET /v2.0/networks/87a22671-0e6a-414f-86be-13172b5f3f96?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2624488 Dec 09 21:39:40.224794 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dfee5a6a-56cc-4732-a49b-55be60bb9fc7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:40.230566 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:40.232714 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:40.286841 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c370d3db-de11-42d2-901a-75f24b64de2b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e29ebb35-742a-4fcb-943d-eda0ebbc5851,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:40.311268 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c370d3db-de11-42d2-901a-75f24b64de2b admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=7ace727116c049d0926fccac18061525&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7462316 Dec 09 21:39:40.350948 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58400) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:40.436902 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-34647d01-a41a-4e5d-9898-bfade9c72c7e req-148a7825-86af-47f2-a8d8-a0f6ecaa3b2a service neutron] 10.222.0.10 "GET /v2.0/networks/87a22671-0e6a-414f-86be-13172b5f3f96?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2425003 Dec 09 21:39:40.537314 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb1b17f1-52d5-4820-b7b9-04c018aa2666 req-5ce667dd-5df9-4044-ac28-0497b7ce7d13 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:40.547544 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bb1b17f1-52d5-4820-b7b9-04c018aa2666 req-5ce667dd-5df9-4044-ac28-0497b7ce7d13 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.13 "GET /v2.0/ports?device_id=70db7a29-670a-4a39-969f-14680973ca12 HTTP/1.1" status: 200 len: 944 time: 0.1972589 Dec 09 21:39:40.557743 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a9940b26-ccac-4580-8a01-49ef53c89f71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:40.561878 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-93b66796-3648-4a3b-b5c4-6a01ac2bcd85 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:40.613361 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-93b66796-3648-4a3b-b5c4-6a01ac2bcd85 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:40.657200 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 2727a3d5-3409-4051-aa40-248e3e2d9858 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:39:40.670557 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:40.703006 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-dfee5a6a-56cc-4732-a49b-55be60bb9fc7 None None] For port 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5c485bd0-5ac4-43cd-b3e2-69f993f32c4f,segment=NetworkSegment(ef2dadc8-8fb8-4456-b117-b78bc745a628),segment_id=ef2dadc8-8fb8-4456-b117-b78bc745a628)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:40.720296 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bb1b17f1-52d5-4820-b7b9-04c018aa2666 req-9fe42283-35c2-467a-9c10-83361d128557 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.13 "GET /v2.0/security-groups?id=e1c1ce62-2b22-487b-b831-0504741b720a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1716199 Dec 09 21:39:40.736906 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dfee5a6a-56cc-4732-a49b-55be60bb9fc7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:40.808099 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a9940b26-ccac-4580-8a01-49ef53c89f71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:40.823234 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-93b66796-3648-4a3b-b5c4-6a01ac2bcd85 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:40.830084 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-93b66796-3648-4a3b-b5c4-6a01ac2bcd85 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:40.837200 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-93b66796-3648-4a3b-b5c4-6a01ac2bcd85 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/e29ebb35-742a-4fcb-943d-eda0ebbc5851 HTTP/1.1" status: 204 len: 168 time: 0.4852066 Dec 09 21:39:40.878654 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfee5a6a-56cc-4732-a49b-55be60bb9fc7 None None] Pushing event updated for resources: {'Port': ['ID=5c485bd0-5ac4-43cd-b3e2-69f993f32c4f,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:40.884794 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:39:40.885164 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:39:40.904430 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 2727a3d5-3409-4051-aa40-248e3e2d9858, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=2727a3d5-3409-4051-aa40-248e3e2d9858,segment=NetworkSegment(21ec9cce-e1fc-4f03-b167-7ca6b7df97ea),segment_id=21ec9cce-e1fc-4f03-b167-7ca6b7df97ea)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:40.907524 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7ae3115f-8704-4864-84bc-3ae717ce1006 None None] Provisioning complete for port e1c9ec83-40f1-4059-bdf3-b58f95c350f6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:40.907936 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7ae3115f-8704-4864-84bc-3ae717ce1006 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:40.917438 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93b66796-3648-4a3b-b5c4-6a01ac2bcd85 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e29ebb35-742a-4fcb-943d-eda0ebbc5851,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:40.953374 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '2727a3d5-3409-4051-aa40-248e3e2d9858', 'network_id': '87a22671-0e6a-414f-86be-13172b5f3f96', 'port_id': '2727a3d5-3409-4051-aa40-248e3e2d9858', 'mac_address': 'fa:16:3e:af:94:50', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 145, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '250bd3c5-f070-4269-9a20-15374747311c', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:39:40.962532 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a9940b26-ccac-4580-8a01-49ef53c89f71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network d37a530f-3e45-486f-b834-d3f63ac2dcc8 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:39:40.975961 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-7ae3115f-8704-4864-84bc-3ae717ce1006 None None] Port e1c9ec83-40f1-4059-bdf3-b58f95c350f6 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:39:40.985208 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-a9940b26-ccac-4580-8a01-49ef53c89f71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:40.991265 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9940b26-ccac-4580-8a01-49ef53c89f71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Port': ['ID=80072430-e50e-466f-acc2-17f292594b61,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:40.996551 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a9940b26-ccac-4580-8a01-49ef53c89f71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:39:41.071243 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:41.074084 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7ae3115f-8704-4864-84bc-3ae717ce1006 None None] Provisioning complete for port 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:41.074294 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7ae3115f-8704-4864-84bc-3ae717ce1006 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:41.112405 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a9940b26-ccac-4580-8a01-49ef53c89f71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:41.115254 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a9940b26-ccac-4580-8a01-49ef53c89f71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:41.132735 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2727a3d5-3409-4051-aa40-248e3e2d9858 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:39:41.159933 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a9940b26-ccac-4580-8a01-49ef53c89f71 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 2.5260880 Dec 09 21:39:41.161458 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58410) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:41.168762 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-068f0778-2fe7-435e-9081-2e3b42e65cb8 req-f2eb3437-5705-4c80-b4cc-e4a98f5750fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:41.179890 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-068f0778-2fe7-435e-9081-2e3b42e65cb8 req-f2eb3437-5705-4c80-b4cc-e4a98f5750fe service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ec2fddf1ed684b7e8c8deb49d8c06a18&device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 1097 time: 0.1212740 Dec 09 21:39:41.181800 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 2727a3d5-3409-4051-aa40-248e3e2d9858, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=2727a3d5-3409-4051-aa40-248e3e2d9858,segment=NetworkSegment(21ec9cce-e1fc-4f03-b167-7ca6b7df97ea),segment_id=21ec9cce-e1fc-4f03-b167-7ca6b7df97ea)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:41.198327 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:41.428351 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1d932b9-6e6f-4d49-ae4a-dfac0105a864 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:41.436997 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c1d932b9-6e6f-4d49-ae4a-dfac0105a864 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports?fixed_ips=ip_address%3D172.20.0.9 HTTP/1.1" status: 200 len: 921 time: 0.2723453 Dec 09 21:39:41.438479 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58420) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:41.459953 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['2727a3d5-3409-4051-aa40-248e3e2d9858'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:39:41.514485 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=2727a3d5-3409-4051-aa40-248e3e2d9858,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:41.530810 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-068f0778-2fe7-435e-9081-2e3b42e65cb8 req-a61a475a-e5ea-446a-b2f1-00d5c5ba9878 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:41.534472 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-068f0778-2fe7-435e-9081-2e3b42e65cb8 req-a61a475a-e5ea-446a-b2f1-00d5c5ba9878 service neutron] 10.222.0.10 "GET /v2.0/networks?id=a71f32bb-6d3a-4295-a0cb-027407f942be HTTP/1.1" status: 200 len: 912 time: 0.3448064 Dec 09 21:39:41.592619 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5acfb2bc-5907-474f-bc64-d4c27dc0fa10 req-ec99c060-31da-44ac-931a-fab326755611 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:41.598355 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5acfb2bc-5907-474f-bc64-d4c27dc0fa10 req-ec99c060-31da-44ac-931a-fab326755611 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/ports?device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 945 time: 0.1599967 Dec 09 21:39:41.651416 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-068f0778-2fe7-435e-9081-2e3b42e65cb8 req-cf425f44-5aa5-4368-9950-172059b25e84 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=101912b6-96a7-4280-822a-8c03b59cc0b0 HTTP/1.1" status: 200 len: 217 time: 0.1083672 Dec 09 21:39:41.712997 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5acfb2bc-5907-474f-bc64-d4c27dc0fa10 req-deb2b74e-4ab2-4e9d-98f1-b9bd2ff7d29b tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/security-groups?id=8ee4757d-9f67-4d3c-994b-59905d6c5b2b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1076941 Dec 09 21:39:41.741637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-79612245-9111-4112-8aaf-171b78acb876 None None] Provisioning complete for port 80072430-e50e-466f-acc2-17f292594b61 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:41.744911 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-79612245-9111-4112-8aaf-171b78acb876 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:41.848494 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-068f0778-2fe7-435e-9081-2e3b42e65cb8 req-7b2100c8-9bd8-43f9-ab84-e011b4caedbe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:41.852071 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-068f0778-2fe7-435e-9081-2e3b42e65cb8 req-7b2100c8-9bd8-43f9-ab84-e011b4caedbe service neutron] 10.222.0.10 "GET /v2.0/subnets?id=ee1b3d8d-21b5-45b8-802b-af8c84fb9577 HTTP/1.1" status: 200 len: 851 time: 0.1902862 Dec 09 21:39:41.884578 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-79612245-9111-4112-8aaf-171b78acb876 None None] Port 80072430-e50e-466f-acc2-17f292594b61 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:39:41.929729 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce629b6-61af-4508-9f23-bdda823be8a7 req-0f02af53-f9a7-4509-a832-83ff5e665bc7 tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:41.940975 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ce629b6-61af-4508-9f23-bdda823be8a7 req-0f02af53-f9a7-4509-a832-83ff5e665bc7 tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] 10.222.0.13 "GET /v2.0/ports?device_id=4619a834-a481-4429-bb09-806f8f9bd76d HTTP/1.1" status: 200 len: 945 time: 0.1147306 Dec 09 21:39:41.963308 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-068f0778-2fe7-435e-9081-2e3b42e65cb8 req-32dbe6e2-aceb-4870-b48f-b361182cfb37 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a71f32bb-6d3a-4295-a0cb-027407f942be&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1002617 Dec 09 21:39:41.970529 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-baeba238-d9b8-4ca2-8d14-4825d956909b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting port 80072430-e50e-466f-acc2-17f292594b61 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:41.970950 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-baeba238-d9b8-4ca2-8d14-4825d956909b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:42.057649 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ce629b6-61af-4508-9f23-bdda823be8a7 req-c81e2a19-4aad-4576-9b5f-63aa3087c659 tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] 10.222.0.13 "GET /v2.0/security-groups?id=67510712-ba9d-4f78-9590-39f7011e7609&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1148627 Dec 09 21:39:42.074045 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:39:42.220784 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58448) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:42.247111 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:42.250240 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:42.259366 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0dfe9b0-36f5-4951-8163-0322396849a6 req-6771ef81-7548-4698-a050-5e0b6401ab9b tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:42.271298 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b0dfe9b0-36f5-4951-8163-0322396849a6 req-6771ef81-7548-4698-a050-5e0b6401ab9b tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.13 "GET /v2.0/ports?device_id=70db7a29-670a-4a39-969f-14680973ca12 HTTP/1.1" status: 200 len: 945 time: 0.1040287 Dec 09 21:39:42.330291 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-068f0778-2fe7-435e-9081-2e3b42e65cb8 req-daaf5bb3-a3d8-43c3-abef-91175e855848 service neutron] 10.222.0.10 "GET /v2.0/networks/a71f32bb-6d3a-4295-a0cb-027407f942be?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3509338 Dec 09 21:39:42.380833 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b0dfe9b0-36f5-4951-8163-0322396849a6 req-644113a0-02c5-4a91-93ea-b6098eefcec1 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.13 "GET /v2.0/security-groups?id=e1c1ce62-2b22-487b-b831-0504741b720a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1084323 Dec 09 21:39:42.384440 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-baeba238-d9b8-4ca2-8d14-4825d956909b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:42.437369 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-baeba238-d9b8-4ca2-8d14-4825d956909b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Calling delete_port for 80072430-e50e-466f-acc2-17f292594b61 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:42.618647 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73f93378-ba59-42d8-bdfa-0031e73c90af req-56be047a-962e-4fa9-b846-8fb3033551bb tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:42.620191 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-73f93378-ba59-42d8-bdfa-0031e73c90af req-56be047a-962e-4fa9-b846-8fb3033551bb tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] 10.222.0.31 "GET /v2.0/ports?device_id=4619a834-a481-4429-bb09-806f8f9bd76d HTTP/1.1" status: 200 len: 945 time: 0.0887952 Dec 09 21:39:42.621151 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24eaf1ed-11e0-4fdf-b077-78d534fa3152 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:42.636147 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-068f0778-2fe7-435e-9081-2e3b42e65cb8 req-5ed1c27a-480b-4074-a0b9-ca234ef88d10 service neutron] 10.222.0.10 "GET /v2.0/networks/a71f32bb-6d3a-4295-a0cb-027407f942be?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2968135 Dec 09 21:39:42.670381 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-baeba238-d9b8-4ca2-8d14-4825d956909b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:42.716649 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baeba238-d9b8-4ca2-8d14-4825d956909b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Port': ['ID=80072430-e50e-466f-acc2-17f292594b61,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:42.851280 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-73f93378-ba59-42d8-bdfa-0031e73c90af req-e9b9af70-d33b-4ae4-8f4c-46815f5c1ad0 tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Deleting port 6c9a3e10-d6a0-46ac-9270-26bf85000b0e {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:42.852012 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-73f93378-ba59-42d8-bdfa-0031e73c90af req-e9b9af70-d33b-4ae4-8f4c-46815f5c1ad0 tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:42.859684 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-baeba238-d9b8-4ca2-8d14-4825d956909b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:42.867229 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-baeba238-d9b8-4ca2-8d14-4825d956909b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/ports/80072430-e50e-466f-acc2-17f292594b61 HTTP/1.1" status: 204 len: 168 time: 1.4276462 Dec 09 21:39:42.867894 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58462) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:42.894344 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-a74e3ebe-f470-4ca9-b94f-22ce0c66d982 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] GET failed (client error): The resource could not be found. Dec 09 21:39:42.899774 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a74e3ebe-f470-4ca9-b94f-22ce0c66d982 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports/80072430-e50e-466f-acc2-17f292594b61 HTTP/1.1" status: 404 len: 333 time: 0.0305624 Dec 09 21:39:42.900411 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58464) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:42.962532 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-73f93378-ba59-42d8-bdfa-0031e73c90af req-e9b9af70-d33b-4ae4-8f4c-46815f5c1ad0 tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] For port 6c9a3e10-d6a0-46ac-9270-26bf85000b0e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6c9a3e10-d6a0-46ac-9270-26bf85000b0e,segment=NetworkSegment(1e281a9e-ceca-4b82-a4db-f71cde3ef950),segment_id=1e281a9e-ceca-4b82-a4db-f71cde3ef950)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:42.962912 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-73f93378-ba59-42d8-bdfa-0031e73c90af req-e9b9af70-d33b-4ae4-8f4c-46815f5c1ad0 tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:42.978615 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-73f93378-ba59-42d8-bdfa-0031e73c90af req-e9b9af70-d33b-4ae4-8f4c-46815f5c1ad0 tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Calling delete_port for 6c9a3e10-d6a0-46ac-9270-26bf85000b0e owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:43.129182 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-ec88231d-bf94-4b1f-8836-3b0977c1e876 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting port e1c9ec83-40f1-4059-bdf3-b58f95c350f6 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:43.129532 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ec88231d-bf94-4b1f-8836-3b0977c1e876 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:43.159411 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-73f93378-ba59-42d8-bdfa-0031e73c90af req-e9b9af70-d33b-4ae4-8f4c-46815f5c1ad0 tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:43.276765 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9b9af70-d33b-4ae4-8f4c-46815f5c1ad0 tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Pushing event deleted for resources: {'Port': ['ID=6c9a3e10-d6a0-46ac-9270-26bf85000b0e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:43.306100 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24eaf1ed-11e0-4fdf-b077-78d534fa3152 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:43.343488 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24eaf1ed-11e0-4fdf-b077-78d534fa3152 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:43.362161 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ec88231d-bf94-4b1f-8836-3b0977c1e876 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:43.379680 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-ec88231d-bf94-4b1f-8836-3b0977c1e876 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Calling delete_port for e1c9ec83-40f1-4059-bdf3-b58f95c350f6 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:43.384999 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d57ae9e5-c706-46a6-9704-e914a0857a66 req-4fd5e2a8-7a45-408a-a6fc-8489af320e7b tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:43.400204 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d57ae9e5-c706-46a6-9704-e914a0857a66 req-4fd5e2a8-7a45-408a-a6fc-8489af320e7b tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/ports?device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 945 time: 0.2591002 Dec 09 21:39:43.402332 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-73f93378-ba59-42d8-bdfa-0031e73c90af req-e9b9af70-d33b-4ae4-8f4c-46815f5c1ad0 tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] No DVR routers for this DVR port 6c9a3e10-d6a0-46ac-9270-26bf85000b0e on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:39:43.424063 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-73f93378-ba59-42d8-bdfa-0031e73c90af req-e9b9af70-d33b-4ae4-8f4c-46815f5c1ad0 tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:43.427362 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-73f93378-ba59-42d8-bdfa-0031e73c90af req-e9b9af70-d33b-4ae4-8f4c-46815f5c1ad0 tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] 10.222.0.31 "DELETE /v2.0/ports/6c9a3e10-d6a0-46ac-9270-26bf85000b0e HTTP/1.1" status: 204 len: 173 time: 0.7972279 Dec 09 21:39:43.432944 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4619a834-a481-4429-bb09-806f8f9bd76d', 'name': 'network-vif-deleted', 'tag': '6c9a3e10-d6a0-46ac-9270-26bf85000b0e'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:39:43.435189 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3ff9e784-9e25-46b8-8d16-271aea39167b" -d '{"events": [{"server_uuid": "4619a834-a481-4429-bb09-806f8f9bd76d", "name": "network-vif-deleted", "tag": "6c9a3e10-d6a0-46ac-9270-26bf85000b0e"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:39:43.472760 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-24eaf1ed-11e0-4fdf-b077-78d534fa3152 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e65e152652e64d808560eab65f12937d&name=default HTTP/1.1" status: 200 len: 3000 time: 1.2490368 Dec 09 21:39:43.476816 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58484) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:43.477751 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24eaf1ed-11e0-4fdf-b077-78d534fa3152 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cebb6f6e-8f9c-4b29-bd15-c57ae5c2ce57,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:43.572290 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d57ae9e5-c706-46a6-9704-e914a0857a66 req-08cc8b57-b7c2-4959-9cd9-259dba6b0359 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/security-groups?id=8ee4757d-9f67-4d3c-994b-59905d6c5b2b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1710489 Dec 09 21:39:43.632790 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6b08802f-0e86-46f9-9116-819935950e30 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:43.678518 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6b08802f-0e86-46f9-9116-819935950e30 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:43.732249 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ec88231d-bf94-4b1f-8836-3b0977c1e876 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:43.745798 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d6d9c9f8-540d-4f2c-a06a-eb69578262da req-09b5de3e-2ade-48c3-bb72-7fd8c6c6da74 tempest-ServerGroupTestJSON-503443492 tempest-ServerGroupTestJSON-503443492-project] 10.222.0.13 "GET /v2.0/ports?device_id=4619a834-a481-4429-bb09-806f8f9bd76d HTTP/1.1" status: 200 len: 210 time: 0.0578856 Dec 09 21:39:43.769780 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec88231d-bf94-4b1f-8836-3b0977c1e876 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Port': ['ID=e1c9ec83-40f1-4059-bdf3-b58f95c350f6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:43.784111 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6b08802f-0e86-46f9-9116-819935950e30 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:43.786732 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6b08802f-0e86-46f9-9116-819935950e30 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:43.804234 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6b08802f-0e86-46f9-9116-819935950e30 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/cebb6f6e-8f9c-4b29-bd15-c57ae5c2ce57 HTTP/1.1" status: 204 len: 168 time: 0.3235085 Dec 09 21:39:43.818685 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b08802f-0e86-46f9-9116-819935950e30 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cebb6f6e-8f9c-4b29-bd15-c57ae5c2ce57,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:43.982472 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ec88231d-bf94-4b1f-8836-3b0977c1e876 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:43.987587 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ec88231d-bf94-4b1f-8836-3b0977c1e876 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/ports/e1c9ec83-40f1-4059-bdf3-b58f95c350f6 HTTP/1.1" status: 204 len: 168 time: 1.0861163 Dec 09 21:39:43.991077 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58496) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:44.002789 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cabbd5e1-4935-42f7-ba1f-26d4adc72cf1 req-b66a6aee-f933-41a7-9fd5-a2d915596e9c tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:44.005109 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cabbd5e1-4935-42f7-ba1f-26d4adc72cf1 req-b66a6aee-f933-41a7-9fd5-a2d915596e9c tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.13 "GET /v2.0/ports?device_id=70db7a29-670a-4a39-969f-14680973ca12 HTTP/1.1" status: 200 len: 945 time: 0.0690444 Dec 09 21:39:44.050535 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-dbbf5f6a-2204-48e3-bbb3-fbe41165408f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] GET failed (client error): The resource could not be found. Dec 09 21:39:44.052092 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-dbbf5f6a-2204-48e3-bbb3-fbe41165408f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports/e1c9ec83-40f1-4059-bdf3-b58f95c350f6 HTTP/1.1" status: 404 len: 333 time: 0.0599895 Dec 09 21:39:44.054865 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58500) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:44.143204 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cabbd5e1-4935-42f7-ba1f-26d4adc72cf1 req-59cbcadf-eed4-448e-80d0-85fe0dfc4afb tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.13 "GET /v2.0/security-groups?id=e1c1ce62-2b22-487b-b831-0504741b720a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1076400 Dec 09 21:39:44.155958 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-041ea9e0-a1c2-4bfa-a588-91eae8977ee5 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting subnet 7436ce42-ee15-41bb-969b-33c87ec74858 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:39:44.159505 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-041ea9e0-a1c2-4bfa-a588-91eae8977ee5 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:44.218345 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-041ea9e0-a1c2-4bfa-a588-91eae8977ee5 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:44.232256 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:39:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9a524ded-779f-4614-ae00-b0e7006a4774 x-openstack-request-id: req-9a524ded-779f-4614-ae00-b0e7006a4774 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:39:44.232552 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4619a834-a481-4429-bb09-806f8f9bd76d", "name": "network-vif-deleted", "tag": "6c9a3e10-d6a0-46ac-9270-26bf85000b0e", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:39:44.232802 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-9a524ded-779f-4614-ae00-b0e7006a4774 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:39:44.233206 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4619a834-a481-4429-bb09-806f8f9bd76d', 'name': 'network-vif-deleted', 'tag': '6c9a3e10-d6a0-46ac-9270-26bf85000b0e', 'status': 'completed', 'code': 200} Dec 09 21:39:44.324416 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-041ea9e0-a1c2-4bfa-a588-91eae8977ee5 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:44.398725 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-041ea9e0-a1c2-4bfa-a588-91eae8977ee5 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:44.417529 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58508) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:44.428953 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-041ea9e0-a1c2-4bfa-a588-91eae8977ee5 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Subnet': ['ID=7436ce42-ee15-41bb-969b-33c87ec74858,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:44.433406 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-041ea9e0-a1c2-4bfa-a588-91eae8977ee5 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:44.440040 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-041ea9e0-a1c2-4bfa-a588-91eae8977ee5 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/subnets/7436ce42-ee15-41bb-969b-33c87ec74858 HTTP/1.1" status: 204 len: 168 time: 0.3808527 Dec 09 21:39:44.440040 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58512) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:44.443651 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce789232-4411-4c6f-8210-e55240a10433 None None] Network d37a530f-3e45-486f-b834-d3f63ac2dcc8 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:44.446975 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 2727a3d5-3409-4051-aa40-248e3e2d9858 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:39:44.468588 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1831e78c-69ae-4416-a5fe-718dcab70c2b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:44.527928 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7920db96-91dd-4b1a-8293-90ac60a31c31 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:44.590517 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-7920db96-91dd-4b1a-8293-90ac60a31c31 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting port 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:44.590926 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7920db96-91dd-4b1a-8293-90ac60a31c31 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:44.612671 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 2727a3d5-3409-4051-aa40-248e3e2d9858 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:39:44.625597 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 2727a3d5-3409-4051-aa40-248e3e2d9858 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:44.626057 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:44.672643 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-7920db96-91dd-4b1a-8293-90ac60a31c31 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] For port 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5c485bd0-5ac4-43cd-b3e2-69f993f32c4f,segment=NetworkSegment(ef2dadc8-8fb8-4456-b117-b78bc745a628),segment_id=ef2dadc8-8fb8-4456-b117-b78bc745a628)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:44.673631 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7920db96-91dd-4b1a-8293-90ac60a31c31 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:44.683248 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1831e78c-69ae-4416-a5fe-718dcab70c2b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:44.697241 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-7920db96-91dd-4b1a-8293-90ac60a31c31 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Calling delete_port for 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:44.716644 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1831e78c-69ae-4416-a5fe-718dcab70c2b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:44.726492 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-67a10733-d12a-4f46-ab83-210f04a3c38c None None] DHCP port deletion for d37a530f-3e45-486f-b834-d3f63ac2dcc8 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:39:44.785501 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1831e78c-69ae-4416-a5fe-718dcab70c2b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d2388fb6-ddee-44dc-9815-7837eed47786,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:44.793054 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1831e78c-69ae-4416-a5fe-718dcab70c2b admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=2cc7265dcba146afadb2c298a5472c0c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3744125 Dec 09 21:39:44.796102 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58530) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:44.819062 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3aa0d620-8b2e-4c18-a336-5aaed0a5b3a5 req-e57b6fdc-29fe-40e1-90e9-ebed3d6a3cec tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:44.821171 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3aa0d620-8b2e-4c18-a336-5aaed0a5b3a5 req-e57b6fdc-29fe-40e1-90e9-ebed3d6a3cec tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/ports?device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 945 time: 0.1291816 Dec 09 21:39:44.845135 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6c9a3e10-d6a0-46ac-9270-26bf85000b0e no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:39:44.853557 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7920db96-91dd-4b1a-8293-90ac60a31c31 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:44.877214 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 6c9a3e10-d6a0-46ac-9270-26bf85000b0e {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:39:44.877783 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6c9a3e10-d6a0-46ac-9270-26bf85000b0e not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:39:44.890602 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:44.902663 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7920db96-91dd-4b1a-8293-90ac60a31c31 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Port': ['ID=5c485bd0-5ac4-43cd-b3e2-69f993f32c4f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:44.912659 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3aa0d620-8b2e-4c18-a336-5aaed0a5b3a5 req-b4d6df01-4f95-4e6a-8714-fffe0926a0b3 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/security-groups?id=8ee4757d-9f67-4d3c-994b-59905d6c5b2b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0813885 Dec 09 21:39:44.913350 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4122dce4-1215-4b32-94b5-1cf77f10b1bd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:44.922471 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '70db7a29-670a-4a39-969f-14680973ca12', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2727a3d5-3409-4051-aa40-248e3e2d9858'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:39:44.925288 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0daa49cf-c732-4eb3-9dd9-b196a0a9adfb" -d '{"events": [{"server_uuid": "70db7a29-670a-4a39-969f-14680973ca12", "name": "network-vif-plugged", "status": "completed", "tag": "2727a3d5-3409-4051-aa40-248e3e2d9858"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:39:44.945598 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7920db96-91dd-4b1a-8293-90ac60a31c31 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] No DVR routers for this DVR port 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:39:44.948070 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-67a10733-d12a-4f46-ab83-210f04a3c38c None None] Deleting port 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:44.948603 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-67a10733-d12a-4f46-ab83-210f04a3c38c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:44.960576 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4122dce4-1215-4b32-94b5-1cf77f10b1bd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:44.961703 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58540) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:44.968668 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 2727a3d5-3409-4051-aa40-248e3e2d9858, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=2727a3d5-3409-4051-aa40-248e3e2d9858,segment=NetworkSegment(21ec9cce-e1fc-4f03-b167-7ca6b7df97ea),segment_id=21ec9cce-e1fc-4f03-b167-7ca6b7df97ea)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:44.981413 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:45.054599 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4122dce4-1215-4b32-94b5-1cf77f10b1bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:45.057845 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4122dce4-1215-4b32-94b5-1cf77f10b1bd admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:45.059246 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4122dce4-1215-4b32-94b5-1cf77f10b1bd admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/d2388fb6-ddee-44dc-9815-7837eed47786 HTTP/1.1" status: 204 len: 168 time: 0.2617352 Dec 09 21:39:45.078513 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4122dce4-1215-4b32-94b5-1cf77f10b1bd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d2388fb6-ddee-44dc-9815-7837eed47786,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:45.190520 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=2727a3d5-3409-4051-aa40-248e3e2d9858,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:45.198863 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7920db96-91dd-4b1a-8293-90ac60a31c31 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:45.205017 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:39:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-56e8f850-2db2-4256-9530-89925a1b8d80 x-openstack-request-id: req-56e8f850-2db2-4256-9530-89925a1b8d80 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:39:45.205179 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "70db7a29-670a-4a39-969f-14680973ca12", "name": "network-vif-plugged", "status": "completed", "tag": "2727a3d5-3409-4051-aa40-248e3e2d9858", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:39:45.205481 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-56e8f850-2db2-4256-9530-89925a1b8d80 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:39:45.206006 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '70db7a29-670a-4a39-969f-14680973ca12', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2727a3d5-3409-4051-aa40-248e3e2d9858', 'code': 200} Dec 09 21:39:45.208570 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-67a10733-d12a-4f46-ab83-210f04a3c38c None None] For port 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f, host n-d-713301-27, got binding levels [] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:45.209168 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-67a10733-d12a-4f46-ab83-210f04a3c38c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:45.231540 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-67a10733-d12a-4f46-ab83-210f04a3c38c None None] Calling delete_port for 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:45.240102 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.ipam_backend_mixin [None req-67a10733-d12a-4f46-ab83-210f04a3c38c None None] Port 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f was not found and therefore no delete operation was performed {{(pid=103439) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 09 21:39:45.243186 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-67a10733-d12a-4f46-ab83-210f04a3c38c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:45.286061 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-7920db96-91dd-4b1a-8293-90ac60a31c31 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d37a530f-3e45-486f-b834-d3f63ac2dcc8']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:45.305824 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-7920db96-91dd-4b1a-8293-90ac60a31c31 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ef2dadc8-8fb8-4456-b117-b78bc745a628') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:45.306098 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-7920db96-91dd-4b1a-8293-90ac60a31c31 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ef2dadc8-8fb8-4456-b117-b78bc745a628') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:45.310038 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c691df8-118c-4fb6-bd30-7ff3a0ccf780 req-b262ec2e-c62c-4f22-9897-dea18227d79d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:45.311513 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4c691df8-118c-4fb6-bd30-7ff3a0ccf780 req-b262ec2e-c62c-4f22-9897-dea18227d79d service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=70db7a29-670a-4a39-969f-14680973ca12 HTTP/1.1" status: 200 len: 1098 time: 0.1003551 Dec 09 21:39:45.323146 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67a10733-d12a-4f46-ab83-210f04a3c38c None None] Pushing event deleted for resources: {'Port': ['ID=5c485bd0-5ac4-43cd-b3e2-69f993f32c4f,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:45.334723 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67a10733-d12a-4f46-ab83-210f04a3c38c None None] No DVR routers for this DVR port 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:39:45.338600 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7920db96-91dd-4b1a-8293-90ac60a31c31 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:45.395587 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7920db96-91dd-4b1a-8293-90ac60a31c31 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:45.415832 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7920db96-91dd-4b1a-8293-90ac60a31c31 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Releasing vlan 113 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:39:45.416408 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7920db96-91dd-4b1a-8293-90ac60a31c31 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:39:45.423605 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:39:45.544501 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7920db96-91dd-4b1a-8293-90ac60a31c31 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:45.566665 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7920db96-91dd-4b1a-8293-90ac60a31c31 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:45.571499 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7920db96-91dd-4b1a-8293-90ac60a31c31 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/networks/d37a530f-3e45-486f-b834-d3f63ac2dcc8 HTTP/1.1" status: 204 len: 168 time: 1.1298440 Dec 09 21:39:45.575983 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58566) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:45.579064 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4c691df8-118c-4fb6-bd30-7ff3a0ccf780 req-27e668d2-450c-44d2-9d1b-15907375df4c service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=e1c1ce62-2b22-487b-b831-0504741b720a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2582638 Dec 09 21:39:45.595252 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-d91cac54-353c-4e35-a299-79fcabf9c8ad tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-1671818327'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:45.623093 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7920db96-91dd-4b1a-8293-90ac60a31c31 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Network': ['ID=d37a530f-3e45-486f-b834-d3f63ac2dcc8,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:45.629581 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d91cac54-353c-4e35-a299-79fcabf9c8ad tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:45.635616 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d91cac54-353c-4e35-a299-79fcabf9c8ad tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:45.699133 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d91cac54-353c-4e35-a299-79fcabf9c8ad tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] vlan segment allocate from pool success with {'vlan_id': 133, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:39:45.714263 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d91cac54-353c-4e35-a299-79fcabf9c8ad tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:45.714889 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-d91cac54-353c-4e35-a299-79fcabf9c8ad tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Added segment 5e3ed5f9-bba3-4814-bcd2-51baac318ef8 of type vlan for network 4deb4d96-8534-4a2b-bff0-e0a7bde8d20c Dec 09 21:39:45.773114 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d91cac54-353c-4e35-a299-79fcabf9c8ad tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:45.807827 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d91cac54-353c-4e35-a299-79fcabf9c8ad tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:45.816435 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d91cac54-353c-4e35-a299-79fcabf9c8ad tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:45.817335 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d91cac54-353c-4e35-a299-79fcabf9c8ad tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:45.845819 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d50093c8-e1af-4137-8915-c285f758f283 req-eeee2927-c615-4fbe-b630-c63d1c565339 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:45.857998 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d50093c8-e1af-4137-8915-c285f758f283 req-eeee2927-c615-4fbe-b630-c63d1c565339 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.13 "GET /v2.0/ports?device_id=70db7a29-670a-4a39-969f-14680973ca12 HTTP/1.1" status: 200 len: 946 time: 0.2962310 Dec 09 21:39:45.912532 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d91cac54-353c-4e35-a299-79fcabf9c8ad tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.3322861 Dec 09 21:39:45.916060 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58582) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:45.926280 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-5e1ed26b-f9da-4e5e-9330-9342cc488f6d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'subnet': {'network_id': '4deb4d96-8534-4a2b-bff0-e0a7bde8d20c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:45.985298 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d91cac54-353c-4e35-a299-79fcabf9c8ad tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Network': ['ID=4deb4d96-8534-4a2b-bff0-e0a7bde8d20c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:46.001202 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 4deb4d96-8534-4a2b-bff0-e0a7bde8d20c details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:39:46.080895 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d50093c8-e1af-4137-8915-c285f758f283 req-ad4ed199-5c89-4d22-b64d-2096e966f479 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.13 "GET /v2.0/security-groups?id=e1c1ce62-2b22-487b-b831-0504741b720a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2197571 Dec 09 21:39:46.090545 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5e1ed26b-f9da-4e5e-9330-9342cc488f6d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:46.094806 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5e1ed26b-f9da-4e5e-9330-9342cc488f6d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:46.100208 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:39:46.134796 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:39:46.135202 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5c485bd0-5ac4-43cd-b3e2-69f993f32c4f not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:39:46.312081 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5def7eda-5f6d-4d36-b14f-97daa6375ab2 req-4092dcfd-37db-4a7e-812c-57714fbee3cd tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:46.313354 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5def7eda-5f6d-4d36-b14f-97daa6375ab2 req-4092dcfd-37db-4a7e-812c-57714fbee3cd tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/ports?device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 945 time: 0.1253068 Dec 09 21:39:46.370115 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58598) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:46.400092 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5def7eda-5f6d-4d36-b14f-97daa6375ab2 req-12791aaf-ef69-404d-8032-9e3d4dcdf33d tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/security-groups?id=8ee4757d-9f67-4d3c-994b-59905d6c5b2b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0801039 Dec 09 21:39:46.408424 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0fe951d6-9462-4973-bfad-b033f9a694f2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:46.411729 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5e1ed26b-f9da-4e5e-9330-9342cc488f6d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:46.527138 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e1ed26b-f9da-4e5e-9330-9342cc488f6d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Subnet': ['ID=8ad02fb3-05c8-40d9-b3fa-88efc1ce8ed6,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:46.548464 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e1ed26b-f9da-4e5e-9330-9342cc488f6d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Checking segment: {'id': '5e3ed5f9-bba3-4814-bcd2-51baac318ef8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '4deb4d96-8534-4a2b-bff0-e0a7bde8d20c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:39:46.549581 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e1ed26b-f9da-4e5e-9330-9342cc488f6d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network hostable DHCP agents. Network: 4deb4d96-8534-4a2b-bff0-e0a7bde8d20c, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:39:46.579599 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e1ed26b-f9da-4e5e-9330-9342cc488f6d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network 4deb4d96-8534-4a2b-bff0-e0a7bde8d20c is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:39:46.608291 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-5e1ed26b-f9da-4e5e-9330-9342cc488f6d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 4deb4d96-8534-4a2b-bff0-e0a7bde8d20c) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:46.614479 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e1ed26b-f9da-4e5e-9330-9342cc488f6d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:46.615074 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5e1ed26b-f9da-4e5e-9330-9342cc488f6d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:46.621948 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e02f7e3d-800a-41dd-a7c0-615fc013b601 None None] Network 4deb4d96-8534-4a2b-bff0-e0a7bde8d20c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:46.654443 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5e1ed26b-f9da-4e5e-9330-9342cc488f6d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.7369115 Dec 09 21:39:46.658088 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58612) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:46.667620 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-420cbcf8-b138-4d54-bcca-0c0ae9b394a2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'port': {'network_id': '4deb4d96-8534-4a2b-bff0-e0a7bde8d20c', 'name': 'tempest-PortsTestJSON-1755918367', 'fixed_ips': [{'subnet_id': '8ad02fb3-05c8-40d9-b3fa-88efc1ce8ed6', 'ip_address': '172.20.0.10'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:46.866324 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e6d87679-5271-493a-a457-200f1f1de5e4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-4deb4d96-8534-4a2b-bff0-e0a7bde8d20c', 'network_id': '4deb4d96-8534-4a2b-bff0-e0a7bde8d20c', 'project_id': 'e8bdea0c320d4955bc3ba905696bda85', 'fixed_ips': [{'subnet_id': '8ad02fb3-05c8-40d9-b3fa-88efc1ce8ed6'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:39:46.867289 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e6d87679-5271-493a-a457-200f1f1de5e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:46.876685 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-420cbcf8-b138-4d54-bcca-0c0ae9b394a2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:46.904929 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b139c8e-c645-4391-b29b-93ebd80d1473 req-7365e705-1f53-4d94-b9b0-5a987ee169de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:46.906118 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0b139c8e-c645-4391-b29b-93ebd80d1473 req-7365e705-1f53-4d94-b9b0-5a987ee169de service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ec2fddf1ed684b7e8c8deb49d8c06a18&device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 1097 time: 0.1241686 Dec 09 21:39:46.927421 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b9b3c416-81e9-4f00-b3ab-12948b628a34 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:47.015803 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-e6d87679-5271-493a-a457-200f1f1de5e4 None None] Allocated IP 172.20.0.2 (4deb4d96-8534-4a2b-bff0-e0a7bde8d20c/8ad02fb3-05c8-40d9-b3fa-88efc1ce8ed6/6995bb11-cc60-4d4d-aade-e196cb9db6ff) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:39:47.030720 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2f18c84-e99c-4df7-b548-bee470a79620 req-ef289795-213a-46d5-850a-5cbf2d4d4737 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:47.033001 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f2f18c84-e99c-4df7-b548-bee470a79620 req-ef289795-213a-46d5-850a-5cbf2d4d4737 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/ports?device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 945 time: 0.1488628 Dec 09 21:39:47.052852 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-420cbcf8-b138-4d54-bcca-0c0ae9b394a2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:47.081987 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b139c8e-c645-4391-b29b-93ebd80d1473 req-fcb62d49-be55-4494-bfad-7437bae77e82 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:47.083742 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0b139c8e-c645-4391-b29b-93ebd80d1473 req-fcb62d49-be55-4494-bfad-7437bae77e82 service neutron] 10.222.0.10 "GET /v2.0/networks?id=a71f32bb-6d3a-4295-a0cb-027407f942be HTTP/1.1" status: 200 len: 912 time: 0.1681724 Dec 09 21:39:47.084933 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-420cbcf8-b138-4d54-bcca-0c0ae9b394a2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] device_id is not set on port 4fe1399f-de23-4511-8a68-c99758e5c8ce yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:39:47.116749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-0fe951d6-9462-4973-bfad-b033f9a694f2 admin admin] Deleting port 19d4a80e-ba79-4490-8a95-e9c7e2370cf8 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:47.117091 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0fe951d6-9462-4973-bfad-b033f9a694f2 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:47.135577 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0b139c8e-c645-4391-b29b-93ebd80d1473 req-c314eaa6-785c-4885-a14b-984f8ec1fbac service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=101912b6-96a7-4280-822a-8c03b59cc0b0 HTTP/1.1" status: 200 len: 217 time: 0.0442550 Dec 09 21:39:47.180799 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e6d87679-5271-493a-a457-200f1f1de5e4 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:47.190552 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e6d87679-5271-493a-a457-200f1f1de5e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:47.219960 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58624) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:47.232043 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b139c8e-c645-4391-b29b-93ebd80d1473 req-25484c2f-6b41-4418-9eb4-c01b3da92d3d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:47.233683 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0b139c8e-c645-4391-b29b-93ebd80d1473 req-25484c2f-6b41-4418-9eb4-c01b3da92d3d service neutron] 10.222.0.10 "GET /v2.0/subnets?id=ee1b3d8d-21b5-45b8-802b-af8c84fb9577 HTTP/1.1" status: 200 len: 851 time: 0.0664787 Dec 09 21:39:47.241900 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6d87679-5271-493a-a457-200f1f1de5e4 None None] Network 4deb4d96-8534-4a2b-bff0-e0a7bde8d20c is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:39:47.247653 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-e6d87679-5271-493a-a457-200f1f1de5e4 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:47.252266 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6d87679-5271-493a-a457-200f1f1de5e4 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:39:47.276076 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0b139c8e-c645-4391-b29b-93ebd80d1473 req-4e4d1e40-497d-437c-9726-395da03bf3fc service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a71f32bb-6d3a-4295-a0cb-027407f942be&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0340950 Dec 09 21:39:47.316797 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6d87679-5271-493a-a457-200f1f1de5e4 None None] Pushing event updated for resources: {'Port': ['ID=6995bb11-cc60-4d4d-aade-e196cb9db6ff,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:47.335962 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e6d87679-5271-493a-a457-200f1f1de5e4 None None] Attempting to bind port 6995bb11-cc60-4d4d-aade-e196cb9db6ff on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:39:47.336879 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e6d87679-5271-493a-a457-200f1f1de5e4 None None] Attempting to bind port 6995bb11-cc60-4d4d-aade-e196cb9db6ff by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '5e3ed5f9-bba3-4814-bcd2-51baac318ef8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '4deb4d96-8534-4a2b-bff0-e0a7bde8d20c'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:39:47.337510 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6d87679-5271-493a-a457-200f1f1de5e4 None None] Attempting to bind port 6995bb11-cc60-4d4d-aade-e196cb9db6ff on network 4deb4d96-8534-4a2b-bff0-e0a7bde8d20c {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:39:47.344198 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6d87679-5271-493a-a457-200f1f1de5e4 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 39, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:39:47.344957 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6d87679-5271-493a-a457-200f1f1de5e4 None None] Checking segment: {'id': '5e3ed5f9-bba3-4814-bcd2-51baac318ef8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '4deb4d96-8534-4a2b-bff0-e0a7bde8d20c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:39:47.345797 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e6d87679-5271-493a-a457-200f1f1de5e4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:47.346371 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e6d87679-5271-493a-a457-200f1f1de5e4 None None] Bound using segment: {'id': '5e3ed5f9-bba3-4814-bcd2-51baac318ef8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '4deb4d96-8534-4a2b-bff0-e0a7bde8d20c'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:39:47.347290 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e6d87679-5271-493a-a457-200f1f1de5e4 None None] Bound port: 6995bb11-cc60-4d4d-aade-e196cb9db6ff, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5e3ed5f9-bba3-4814-bcd2-51baac318ef8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '4deb4d96-8534-4a2b-bff0-e0a7bde8d20c'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:39:47.347921 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e6d87679-5271-493a-a457-200f1f1de5e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:47.426678 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e6d87679-5271-493a-a457-200f1f1de5e4 None None] For port 6995bb11-cc60-4d4d-aade-e196cb9db6ff, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:39:47.431485 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e6d87679-5271-493a-a457-200f1f1de5e4 None None] For port 6995bb11-cc60-4d4d-aade-e196cb9db6ff, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6995bb11-cc60-4d4d-aade-e196cb9db6ff,segment=NetworkSegment(5e3ed5f9-bba3-4814-bcd2-51baac318ef8),segment_id=5e3ed5f9-bba3-4814-bcd2-51baac318ef8)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:39:47.440386 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e6d87679-5271-493a-a457-200f1f1de5e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:47.520302 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6d87679-5271-493a-a457-200f1f1de5e4 None None] Pushing event updated for resources: {'Port': ['ID=6995bb11-cc60-4d4d-aade-e196cb9db6ff,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:47.521724 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f2f18c84-e99c-4df7-b548-bee470a79620 req-1ce2da92-4c02-4a69-a39e-f047e7e2d3c6 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/security-groups?id=8ee4757d-9f67-4d3c-994b-59905d6c5b2b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4724782 Dec 09 21:39:47.548627 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b9b3c416-81e9-4f00-b3ab-12948b628a34 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:47.587901 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b9b3c416-81e9-4f00-b3ab-12948b628a34 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:47.675781 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9b3c416-81e9-4f00-b3ab-12948b628a34 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=14e13803-9a70-4464-a2bd-7d3746fcc16c,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:47.699624 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b9b3c416-81e9-4f00-b3ab-12948b628a34 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=79182e9c74a04219a694491dde7e69f7&name=default HTTP/1.1" status: 200 len: 3000 time: 1.3253331 Dec 09 21:39:47.701992 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58630) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:47.723771 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-0fe951d6-9462-4973-bfad-b033f9a694f2 admin admin] For port 19d4a80e-ba79-4490-8a95-e9c7e2370cf8, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=19d4a80e-ba79-4490-8a95-e9c7e2370cf8,segment=NetworkSegment(7cf32f95-b9ab-465b-889c-7d7de3246a6f),segment_id=7cf32f95-b9ab-465b-889c-7d7de3246a6f)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:47.731783 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0fe951d6-9462-4973-bfad-b033f9a694f2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:47.758862 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f59cda3-260e-4511-8ac4-780d9f54808c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:47.788537 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-0fe951d6-9462-4973-bfad-b033f9a694f2 admin admin] Calling delete_port for 19d4a80e-ba79-4490-8a95-e9c7e2370cf8 owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:47.806789 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-420cbcf8-b138-4d54-bcca-0c0ae9b394a2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Allocated IP 172.20.0.10 (4deb4d96-8534-4a2b-bff0-e0a7bde8d20c/8ad02fb3-05c8-40d9-b3fa-88efc1ce8ed6/4fe1399f-de23-4511-8a68-c99758e5c8ce) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:39:47.810198 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0b139c8e-c645-4391-b29b-93ebd80d1473 req-5df38bca-e3a9-48f1-8f10-b1aeee17c36f service neutron] 10.222.0.10 "GET /v2.0/networks/a71f32bb-6d3a-4295-a0cb-027407f942be?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5060368 Dec 09 21:39:47.815855 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19921072-4c18-4392-ac35-57398802183d req-4d2fa627-7dc9-41e5-bc42-1131f8f2a26d tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:47.817567 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19921072-4c18-4392-ac35-57398802183d req-4d2fa627-7dc9-41e5-bc42-1131f8f2a26d tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.13 "GET /v2.0/ports?device_id=70db7a29-670a-4a39-969f-14680973ca12 HTTP/1.1" status: 200 len: 946 time: 0.1717701 Dec 09 21:39:47.896208 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b6caa3f3-55dc-4714-b9f3-db3b75f9767d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:47.966986 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b6caa3f3-55dc-4714-b9f3-db3b75f9767d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:48.036939 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6995bb11-cc60-4d4d-aade-e196cb9db6ff up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:39:48.044982 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f59cda3-260e-4511-8ac4-780d9f54808c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:48.048260 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19921072-4c18-4392-ac35-57398802183d req-9b2c544a-8e3b-4f2a-96a5-8a22fb5d01c9 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.13 "GET /v2.0/security-groups?id=e1c1ce62-2b22-487b-b831-0504741b720a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1755102 Dec 09 21:39:48.069135 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f59cda3-260e-4511-8ac4-780d9f54808c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:48.070226 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0b139c8e-c645-4391-b29b-93ebd80d1473 req-4ed74b27-1549-489a-85a0-07834424d95a service neutron] 10.222.0.10 "GET /v2.0/networks/a71f32bb-6d3a-4295-a0cb-027407f942be?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2483802 Dec 09 21:39:48.110452 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b6caa3f3-55dc-4714-b9f3-db3b75f9767d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:48.119040 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b6caa3f3-55dc-4714-b9f3-db3b75f9767d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:48.120351 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 6995bb11-cc60-4d4d-aade-e196cb9db6ff triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:48.120623 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b6caa3f3-55dc-4714-b9f3-db3b75f9767d admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/14e13803-9a70-4464-a2bd-7d3746fcc16c HTTP/1.1" status: 204 len: 168 time: 0.4125137 Dec 09 21:39:48.121207 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:48.132635 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3f59cda3-260e-4511-8ac4-780d9f54808c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=16dd104d71cd4006bdd2122cd42d67cf&name=default HTTP/1.1" status: 200 len: 3000 time: 0.9109392 Dec 09 21:39:48.138638 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58638) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:48.140764 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f59cda3-260e-4511-8ac4-780d9f54808c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9e868ff4-0825-4609-a2b8-03d969506e33,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:48.160531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6caa3f3-55dc-4714-b9f3-db3b75f9767d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=14e13803-9a70-4464-a2bd-7d3746fcc16c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:48.184787 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-420cbcf8-b138-4d54-bcca-0c0ae9b394a2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:48.256236 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2fde7853-d068-411b-9980-b4ace4af1bac admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:48.290751 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2fde7853-d068-411b-9980-b4ace4af1bac admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:48.290894 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0fe951d6-9462-4973-bfad-b033f9a694f2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:48.300008 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-420cbcf8-b138-4d54-bcca-0c0ae9b394a2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:48.308417 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:48.348865 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fe951d6-9462-4973-bfad-b033f9a694f2 admin admin] Pushing event deleted for resources: {'Port': ['ID=19d4a80e-ba79-4490-8a95-e9c7e2370cf8,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:48.401566 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 6995bb11-cc60-4d4d-aade-e196cb9db6ff, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6995bb11-cc60-4d4d-aade-e196cb9db6ff,segment=NetworkSegment(5e3ed5f9-bba3-4814-bcd2-51baac318ef8),segment_id=5e3ed5f9-bba3-4814-bcd2-51baac318ef8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:48.416632 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:48.424073 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-420cbcf8-b138-4d54-bcca-0c0ae9b394a2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network 4deb4d96-8534-4a2b-bff0-e0a7bde8d20c is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:39:48.428943 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-420cbcf8-b138-4d54-bcca-0c0ae9b394a2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:48.434184 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-420cbcf8-b138-4d54-bcca-0c0ae9b394a2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:39:48.533967 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-420cbcf8-b138-4d54-bcca-0c0ae9b394a2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Port': ['ID=4fe1399f-de23-4511-8a68-c99758e5c8ce,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:48.551718 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2fde7853-d068-411b-9980-b4ace4af1bac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:48.554317 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2fde7853-d068-411b-9980-b4ace4af1bac admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:48.559614 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2fde7853-d068-411b-9980-b4ace4af1bac admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/9e868ff4-0825-4609-a2b8-03d969506e33 HTTP/1.1" status: 204 len: 168 time: 0.4195781 Dec 09 21:39:48.572035 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fde7853-d068-411b-9980-b4ace4af1bac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e868ff4-0825-4609-a2b8-03d969506e33,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:48.580231 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-420cbcf8-b138-4d54-bcca-0c0ae9b394a2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:48.580998 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-420cbcf8-b138-4d54-bcca-0c0ae9b394a2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:48.605156 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-420cbcf8-b138-4d54-bcca-0c0ae9b394a2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 925 time: 1.9452553 Dec 09 21:39:48.608079 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58658) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:48.614534 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-c1438c1b-2ad1-4f59-91d3-f175086efe17 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'port': {'network_id': '4deb4d96-8534-4a2b-bff0-e0a7bde8d20c', 'name': 'tempest-PortsTestJSON-816487935', 'fixed_ips': [{'subnet_id': '8ad02fb3-05c8-40d9-b3fa-88efc1ce8ed6', 'ip_address': '172.20.0.9'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:48.750732 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0fe951d6-9462-4973-bfad-b033f9a694f2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:48.841045 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58662) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:48.853718 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58664) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:48.919139 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70635a2f-7b37-4e69-a8a8-bfa5bef4cb89 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:48.950979 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=6995bb11-cc60-4d4d-aade-e196cb9db6ff,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:49.038403 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c1438c1b-2ad1-4f59-91d3-f175086efe17 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:49.044558 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c1438c1b-2ad1-4f59-91d3-f175086efe17 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:49.070440 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-cefcd40f-cb82-4f59-99e7-85045dc5f70c admin admin] Deleting subnet 442ba23b-1dd6-4dce-ba48-8a9cc723c83d {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:39:49.071796 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-c1438c1b-2ad1-4f59-91d3-f175086efe17 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] device_id is not set on port ba7124ff-89ba-40a3-a532-40804130cab5 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:39:49.082838 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cefcd40f-cb82-4f59-99e7-85045dc5f70c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:49.150613 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35547512-b04c-49c9-a7f7-63376537a2b6 req-df8df146-153e-445d-aa7f-ba5b51052c28 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:49.156302 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70635a2f-7b37-4e69-a8a8-bfa5bef4cb89 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:49.158935 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6cc969d8-b58f-46ef-b2dd-035396c17008 None None] Network 4deb4d96-8534-4a2b-bff0-e0a7bde8d20c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:49.159498 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35547512-b04c-49c9-a7f7-63376537a2b6 req-df8df146-153e-445d-aa7f-ba5b51052c28 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/ports?device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 945 time: 0.1984923 Dec 09 21:39:49.180761 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-70635a2f-7b37-4e69-a8a8-bfa5bef4cb89 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:49.186612 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cefcd40f-cb82-4f59-99e7-85045dc5f70c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:49.232505 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-70635a2f-7b37-4e69-a8a8-bfa5bef4cb89 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=7506a292b2e44bd98f52d8ae0f52050c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3843141 Dec 09 21:39:49.239223 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58676) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:49.250567 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70635a2f-7b37-4e69-a8a8-bfa5bef4cb89 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0028f9aa-4463-4090-9277-2259cc34ca25,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:49.287556 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7bb1dbc7-1d1a-49cc-9582-540d1631cd74 None None] Provisioning complete for port 6995bb11-cc60-4d4d-aade-e196cb9db6ff triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:49.287556 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7bb1dbc7-1d1a-49cc-9582-540d1631cd74 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:49.323253 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35547512-b04c-49c9-a7f7-63376537a2b6 req-89274434-c2e3-4dd8-bfac-20d690f15e8b tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/security-groups?id=8ee4757d-9f67-4d3c-994b-59905d6c5b2b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1628423 Dec 09 21:39:49.327061 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-c1438c1b-2ad1-4f59-91d3-f175086efe17 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Allocated IP 172.20.0.9 (4deb4d96-8534-4a2b-bff0-e0a7bde8d20c/8ad02fb3-05c8-40d9-b3fa-88efc1ce8ed6/ba7124ff-89ba-40a3-a532-40804130cab5) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:39:49.354465 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f6cad608-5163-45b2-a276-6e8c9c9f99b2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:49.401021 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f6cad608-5163-45b2-a276-6e8c9c9f99b2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:49.409180 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cefcd40f-cb82-4f59-99e7-85045dc5f70c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:49.546411 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f47008f-cfe3-49f4-a59a-002a3dbb6cee req-f00d8916-89e5-40c3-9864-028cd2d85fd5 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:49.553892 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f47008f-cfe3-49f4-a59a-002a3dbb6cee req-f00d8916-89e5-40c3-9864-028cd2d85fd5 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.13 "GET /v2.0/ports?device_id=70db7a29-670a-4a39-969f-14680973ca12 HTTP/1.1" status: 200 len: 946 time: 0.0999992 Dec 09 21:39:49.560254 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0fe951d6-9462-4973-bfad-b033f9a694f2 admin admin] Router 4757617b-081d-4a51-a741-443e352d3856 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:39:49.582342 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c1438c1b-2ad1-4f59-91d3-f175086efe17 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:49.613626 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f47008f-cfe3-49f4-a59a-002a3dbb6cee req-6893b936-7d77-4ee3-8737-61d85b2e45df tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.13 "GET /v2.0/security-groups?id=e1c1ce62-2b22-487b-b831-0504741b720a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0586963 Dec 09 21:39:49.619774 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c1438c1b-2ad1-4f59-91d3-f175086efe17 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:49.624035 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cefcd40f-cb82-4f59-99e7-85045dc5f70c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:49.636523 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f6cad608-5163-45b2-a276-6e8c9c9f99b2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:49.639873 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f6cad608-5163-45b2-a276-6e8c9c9f99b2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:49.641237 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f6cad608-5163-45b2-a276-6e8c9c9f99b2 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/0028f9aa-4463-4090-9277-2259cc34ca25 HTTP/1.1" status: 204 len: 168 time: 0.4010313 Dec 09 21:39:49.659038 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6cad608-5163-45b2-a276-6e8c9c9f99b2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0028f9aa-4463-4090-9277-2259cc34ca25,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:49.659884 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cefcd40f-cb82-4f59-99e7-85045dc5f70c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=442ba23b-1dd6-4dce-ba48-8a9cc723c83d,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:49.669786 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cefcd40f-cb82-4f59-99e7-85045dc5f70c admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:49.672981 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cefcd40f-cb82-4f59-99e7-85045dc5f70c admin admin] 10.222.0.13 "DELETE /v2.0/subnets/442ba23b-1dd6-4dce-ba48-8a9cc723c83d HTTP/1.1" status: 204 len: 168 time: 0.8106604 Dec 09 21:39:49.710886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58688) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:49.733347 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1438c1b-2ad1-4f59-91d3-f175086efe17 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network 4deb4d96-8534-4a2b-bff0-e0a7bde8d20c is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:39:49.736724 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-c1438c1b-2ad1-4f59-91d3-f175086efe17 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:49.741370 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1438c1b-2ad1-4f59-91d3-f175086efe17 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:39:49.798146 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1438c1b-2ad1-4f59-91d3-f175086efe17 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Port': ['ID=ba7124ff-89ba-40a3-a532-40804130cab5,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:49.812802 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-128aaedd-4b9e-4f05-ba02-be73c02b77ed None None] Provisioning complete for port 6995bb11-cc60-4d4d-aade-e196cb9db6ff triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:49.813521 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-128aaedd-4b9e-4f05-ba02-be73c02b77ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:49.830684 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9af3ad24-714a-4f54-9db6-ecd43cf7030b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:49.845689 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1438c1b-2ad1-4f59-91d3-f175086efe17 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:49.848433 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c1438c1b-2ad1-4f59-91d3-f175086efe17 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:49.872029 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c1438c1b-2ad1-4f59-91d3-f175086efe17 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 923 time: 1.2625017 Dec 09 21:39:49.874542 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58694) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:50.029897 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9af3ad24-714a-4f54-9db6-ecd43cf7030b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:50.047634 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-128aaedd-4b9e-4f05-ba02-be73c02b77ed None None] Provisioning complete for port 4fe1399f-de23-4511-8a68-c99758e5c8ce triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:50.048511 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-128aaedd-4b9e-4f05-ba02-be73c02b77ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:50.058199 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-9af3ad24-714a-4f54-9db6-ecd43cf7030b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6234858b-69ec-4f21-b01b-eb3e9bd6848b']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:50.077745 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-9af3ad24-714a-4f54-9db6-ecd43cf7030b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1e281a9e-ceca-4b82-a4db-f71cde3ef950') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:50.078353 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-9af3ad24-714a-4f54-9db6-ecd43cf7030b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1e281a9e-ceca-4b82-a4db-f71cde3ef950') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:50.089925 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9af3ad24-714a-4f54-9db6-ecd43cf7030b admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:50.104109 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9af3ad24-714a-4f54-9db6-ecd43cf7030b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:50.111193 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9af3ad24-714a-4f54-9db6-ecd43cf7030b admin admin] Releasing vlan 143 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:39:50.111715 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9af3ad24-714a-4f54-9db6-ecd43cf7030b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:50.118422 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6995bb11-cc60-4d4d-aade-e196cb9db6ff up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:39:50.182443 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6cad3a1-e3a6-42ed-87d4-685ec713c7cb req-b60baf57-cafa-4423-8428-d6afaf15cc6b tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:50.184105 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d6cad3a1-e3a6-42ed-87d4-685ec713c7cb req-b60baf57-cafa-4423-8428-d6afaf15cc6b tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.10 "GET /v2.0/ports?device_id=70db7a29-670a-4a39-969f-14680973ca12 HTTP/1.1" status: 200 len: 946 time: 0.2342255 Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:39:50.194519 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:39:50.213074 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0fe951d6-9462-4973-bfad-b033f9a694f2 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:39:50.217058 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba1ca5fa-35fc-4132-9709-a0a7cba7016b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:50.218853 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ba1ca5fa-35fc-4132-9709-a0a7cba7016b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D172.20.0.1 HTTP/1.1" status: 200 len: 923 time: 0.3431175 Dec 09 21:39:50.224831 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1da238f-fe66-4ab3-b294-0b149d2bd567 None None] Sync routers for ids ['4757617b-081d-4a51-a741-443e352d3856'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:39:50.229890 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0fe951d6-9462-4973-bfad-b033f9a694f2 admin admin] 10.222.0.13 "PUT /v2.0/routers/4757617b-081d-4a51-a741-443e352d3856/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.2665396 Dec 09 21:39:50.231039 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58698) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:50.239334 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-128aaedd-4b9e-4f05-ba02-be73c02b77ed None None] Port 4fe1399f-de23-4511-8a68-c99758e5c8ce cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:39:50.243788 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9af3ad24-714a-4f54-9db6-ecd43cf7030b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:50.245656 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58700) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:50.255255 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1da238f-fe66-4ab3-b294-0b149d2bd567 None None] Routers {'4757617b-081d-4a51-a741-443e352d3856'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:39:50.255933 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d1da238f-fe66-4ab3-b294-0b149d2bd567 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:39:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4757617b-081d-4a51-a741-443e352d3856'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:50.296265 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 6995bb11-cc60-4d4d-aade-e196cb9db6ff triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:50.297350 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:50.357805 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9af3ad24-714a-4f54-9db6-ecd43cf7030b admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:50.368561 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9af3ad24-714a-4f54-9db6-ecd43cf7030b admin admin] 10.222.0.13 "DELETE /v2.0/networks/6234858b-69ec-4f21-b01b-eb3e9bd6848b HTTP/1.1" status: 204 len: 168 time: 0.6543872 Dec 09 21:39:50.461961 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9af3ad24-714a-4f54-9db6-ecd43cf7030b admin admin] Pushing event deleted for resources: {'Network': ['ID=6234858b-69ec-4f21-b01b-eb3e9bd6848b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:50.475489 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d8ad3f16-0b05-4dc7-bc0d-4017883b70a7 None None] Provisioning complete for port 4fe1399f-de23-4511-8a68-c99758e5c8ce triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:50.476687 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d8ad3f16-0b05-4dc7-bc0d-4017883b70a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:50.559167 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-d6cad3a1-e3a6-42ed-87d4-685ec713c7cb req-d6796c20-eaf3-4bec-95fd-e395487de107 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Deleting port 2727a3d5-3409-4051-aa40-248e3e2d9858 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:50.559536 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d6cad3a1-e3a6-42ed-87d4-685ec713c7cb req-d6796c20-eaf3-4bec-95fd-e395487de107 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:50.578002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d8ad3f16-0b05-4dc7-bc0d-4017883b70a7 None None] Port 4fe1399f-de23-4511-8a68-c99758e5c8ce cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:39:50.594620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47494f33-fe38-4e8f-8c29-7b62c13bce33 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:50.601255 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47494f33-fe38-4e8f-8c29-7b62c13bce33 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:50.603035 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-d1da238f-fe66-4ab3-b294-0b149d2bd567 None None] Set router 4757617b-081d-4a51-a741-443e352d3856 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:39:50.610476 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47494f33-fe38-4e8f-8c29-7b62c13bce33 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:50.610476 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-47494f33-fe38-4e8f-8c29-7b62c13bce33 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D172.20.0. HTTP/1.1" status: 200 len: 2379 time: 0.3770666 Dec 09 21:39:50.613123 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58714) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:50.613460 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58716) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:50.649256 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47b8cade-9ff5-4157-a664-21aaa5cdc71c req-48d14d76-bdf0-4886-8947-ba2195ae0578 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:50.656763 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-47b8cade-9ff5-4157-a664-21aaa5cdc71c req-48d14d76-bdf0-4886-8947-ba2195ae0578 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/ports?device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 945 time: 0.1960912 Dec 09 21:39:50.704272 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-08222944-886f-495c-b7ef-8e5cfb96783d None None] Provisioning complete for port ba7124ff-89ba-40a3-a532-40804130cab5 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:39:50.704851 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d9f5e80-5111-4ea2-87dd-d002adedc572 admin admin] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:50.705877 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-08222944-886f-495c-b7ef-8e5cfb96783d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:50.795592 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-08222944-886f-495c-b7ef-8e5cfb96783d None None] Port ba7124ff-89ba-40a3-a532-40804130cab5 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:39:50.796326 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-d6cad3a1-e3a6-42ed-87d4-685ec713c7cb req-d6796c20-eaf3-4bec-95fd-e395487de107 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] For port 2727a3d5-3409-4051-aa40-248e3e2d9858, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=2727a3d5-3409-4051-aa40-248e3e2d9858,segment=NetworkSegment(21ec9cce-e1fc-4f03-b167-7ca6b7df97ea),segment_id=21ec9cce-e1fc-4f03-b167-7ca6b7df97ea)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:50.796326 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d6cad3a1-e3a6-42ed-87d4-685ec713c7cb req-d6796c20-eaf3-4bec-95fd-e395487de107 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:50.810993 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-d6cad3a1-e3a6-42ed-87d4-685ec713c7cb req-d6796c20-eaf3-4bec-95fd-e395487de107 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Calling delete_port for 2727a3d5-3409-4051-aa40-248e3e2d9858 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:50.898989 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4924727c-249e-4639-90aa-fedfee6fc82a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=37bf08f44fbc4ad89743914d8e228eb0&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2842753 Dec 09 21:39:50.920586 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58728) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:50.950709 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-47b8cade-9ff5-4157-a664-21aaa5cdc71c req-7b66ebbc-8606-403b-8787-1324f951bcfe tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/security-groups?id=8ee4757d-9f67-4d3c-994b-59905d6c5b2b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2885377 Dec 09 21:39:51.004251 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d1da238f-fe66-4ab3-b294-0b149d2bd567 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4757617b-081d-4a51-a741-443e352d3856', 'name': 'tempest-TaggedBootDevicesTest_v242-1825188234-router', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97'}], 'enable_snat': True}, 'gw_port_id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:24Z', 'updated_at': '2021-12-09T21:39:48Z', 'revision_number': 5, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'gw_port': {'id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1113, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:25Z', 'updated_at': '2021-12-09T21:27:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:51.019204 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d9f5e80-5111-4ea2-87dd-d002adedc572 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:51.040792 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5cf4ccbf-4c5b-4056-ae0a-6b9870563121 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:51.063255 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1da238f-fe66-4ab3-b294-0b149d2bd567 None None] Checking router: 4757617b-081d-4a51-a741-443e352d3856 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:39:51.075240 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1da238f-fe66-4ab3-b294-0b149d2bd567 None None] Routers {'4757617b-081d-4a51-a741-443e352d3856'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:39:51.076230 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d1da238f-fe66-4ab3-b294-0b149d2bd567 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:39:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4757617b-081d-4a51-a741-443e352d3856'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:51.081709 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5cf4ccbf-4c5b-4056-ae0a-6b9870563121 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:51.105645 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-a1838563-dbe2-416f-9962-85c851ced8a9 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting port ba7124ff-89ba-40a3-a532-40804130cab5 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:51.106521 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a1838563-dbe2-416f-9962-85c851ced8a9 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:51.197738 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5cf4ccbf-4c5b-4056-ae0a-6b9870563121 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:51.203958 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5cf4ccbf-4c5b-4056-ae0a-6b9870563121 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:51.206933 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5cf4ccbf-4c5b-4056-ae0a-6b9870563121 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/67510712-ba9d-4f78-9590-39f7011e7609 HTTP/1.1" status: 204 len: 168 time: 0.2812750 Dec 09 21:39:51.225358 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cf4ccbf-4c5b-4056-ae0a-6b9870563121 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=67510712-ba9d-4f78-9590-39f7011e7609,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:51.244434 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d6cad3a1-e3a6-42ed-87d4-685ec713c7cb req-d6796c20-eaf3-4bec-95fd-e395487de107 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:51.331717 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6796c20-eaf3-4bec-95fd-e395487de107 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Pushing event deleted for resources: {'Port': ['ID=2727a3d5-3409-4051-aa40-248e3e2d9858,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:51.336573 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a1838563-dbe2-416f-9962-85c851ced8a9 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:51.349768 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-a1838563-dbe2-416f-9962-85c851ced8a9 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Calling delete_port for ba7124ff-89ba-40a3-a532-40804130cab5 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:51.391927 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-d1da238f-fe66-4ab3-b294-0b149d2bd567 None None] Set router 4757617b-081d-4a51-a741-443e352d3856 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:39:51.447060 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-d6cad3a1-e3a6-42ed-87d4-685ec713c7cb req-d6796c20-eaf3-4bec-95fd-e395487de107 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] No DVR routers for this DVR port 2727a3d5-3409-4051-aa40-248e3e2d9858 on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:39:51.452254 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d6cad3a1-e3a6-42ed-87d4-685ec713c7cb req-d6796c20-eaf3-4bec-95fd-e395487de107 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:51.465252 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d6cad3a1-e3a6-42ed-87d4-685ec713c7cb req-d6796c20-eaf3-4bec-95fd-e395487de107 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.10 "DELETE /v2.0/ports/2727a3d5-3409-4051-aa40-248e3e2d9858 HTTP/1.1" status: 204 len: 173 time: 1.2615201 Dec 09 21:39:51.465775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '70db7a29-670a-4a39-969f-14680973ca12', 'name': 'network-vif-deleted', 'tag': '2727a3d5-3409-4051-aa40-248e3e2d9858'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:39:51.478917 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ade227bb-5cc1-4ead-ae2f-12d744673465" -d '{"events": [{"server_uuid": "70db7a29-670a-4a39-969f-14680973ca12", "name": "network-vif-deleted", "tag": "2727a3d5-3409-4051-aa40-248e3e2d9858"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:39:51.553066 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0684d4a7-048d-45f8-a8ba-baacce7350ad req-7c8bb862-2467-4153-ba97-eda26c796fa6 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:51.563992 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0684d4a7-048d-45f8-a8ba-baacce7350ad req-7c8bb862-2467-4153-ba97-eda26c796fa6 tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.13 "GET /v2.0/ports?device_id=70db7a29-670a-4a39-969f-14680973ca12 HTTP/1.1" status: 200 len: 867 time: 0.4980998 Dec 09 21:39:51.622816 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-3d9f5e80-5111-4ea2-87dd-d002adedc572 admin admin] Deleting port f29fe8cc-72a3-485b-a257-8a8081d710b1 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:51.623748 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d9f5e80-5111-4ea2-87dd-d002adedc572 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:51.656547 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a1838563-dbe2-416f-9962-85c851ced8a9 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:51.686554 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d1da238f-fe66-4ab3-b294-0b149d2bd567 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4757617b-081d-4a51-a741-443e352d3856', 'name': 'tempest-TaggedBootDevicesTest_v242-1825188234-router', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97'}], 'enable_snat': True}, 'gw_port_id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:24Z', 'updated_at': '2021-12-09T21:39:48Z', 'revision_number': 5, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'gw_port': {'id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1113, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:25Z', 'updated_at': '2021-12-09T21:27:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:51.728657 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1da238f-fe66-4ab3-b294-0b149d2bd567 None None] The sync data for ids ['4757617b-081d-4a51-a741-443e352d3856'] in n-d-713301-27 is: [{'id': '4757617b-081d-4a51-a741-443e352d3856', 'name': 'tempest-TaggedBootDevicesTest_v242-1825188234-router', 'tenant_id': '0a5d0e4652be4d8b87936a559840cc87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97'}], 'enable_snat': True}, 'gw_port_id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:24Z', 'updated_at': '2021-12-09T21:39:48Z', 'revision_number': 5, 'project_id': '0a5d0e4652be4d8b87936a559840cc87', 'gw_port': {'id': 'f29fe8cc-72a3-485b-a257-8a8081d710b1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:79:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4757617b-081d-4a51-a741-443e352d3856', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1113, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.97', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:25Z', 'updated_at': '2021-12-09T21:27:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:39:51.748343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1838563-dbe2-416f-9962-85c851ced8a9 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Port': ['ID=ba7124ff-89ba-40a3-a532-40804130cab5,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:51.908668 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a1838563-dbe2-416f-9962-85c851ced8a9 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:51.915272 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58766) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:51.915603 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a1838563-dbe2-416f-9962-85c851ced8a9 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/ports/ba7124ff-89ba-40a3-a532-40804130cab5 HTTP/1.1" status: 204 len: 168 time: 1.2996197 Dec 09 21:39:51.927032 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0684d4a7-048d-45f8-a8ba-baacce7350ad req-57797240-90f9-4e3b-a9a2-55cfca36370b tempest-ServerAddressesTestJSON-761647974 tempest-ServerAddressesTestJSON-761647974-project] 10.222.0.13 "GET /v2.0/security-groups?id=e1c1ce62-2b22-487b-b831-0504741b720a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3620286 Dec 09 21:39:51.966848 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-a888d36f-e19a-4134-8476-56c5ef7b9f8b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] GET failed (client error): The resource could not be found. Dec 09 21:39:51.969161 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a888d36f-e19a-4134-8476-56c5ef7b9f8b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports/ba7124ff-89ba-40a3-a532-40804130cab5 HTTP/1.1" status: 404 len: 333 time: 0.0523465 Dec 09 21:39:51.975633 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58770) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:52.054168 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-3d9f5e80-5111-4ea2-87dd-d002adedc572 admin admin] For port f29fe8cc-72a3-485b-a257-8a8081d710b1, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f29fe8cc-72a3-485b-a257-8a8081d710b1,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:52.054552 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d9f5e80-5111-4ea2-87dd-d002adedc572 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:52.106488 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-3d9f5e80-5111-4ea2-87dd-d002adedc572 admin admin] Calling delete_port for f29fe8cc-72a3-485b-a257-8a8081d710b1 owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:52.147772 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-421bcff9-14bc-44b7-a457-fad2565e7208 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting port 4fe1399f-de23-4511-8a68-c99758e5c8ce {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:52.148797 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-421bcff9-14bc-44b7-a457-fad2565e7208 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:52.206711 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 19d4a80e-ba79-4490-8a95-e9c7e2370cf8 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:39:52.277403 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 19d4a80e-ba79-4490-8a95-e9c7e2370cf8 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:39:52.278231 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 19d4a80e-ba79-4490-8a95-e9c7e2370cf8 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:39:52.375893 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-421bcff9-14bc-44b7-a457-fad2565e7208 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:52.397321 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-421bcff9-14bc-44b7-a457-fad2565e7208 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Calling delete_port for 4fe1399f-de23-4511-8a68-c99758e5c8ce owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:52.422635 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:39:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-102e71a3-57c8-4fb9-9e17-58d42ca0cf32 x-openstack-request-id: req-102e71a3-57c8-4fb9-9e17-58d42ca0cf32 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:39:52.423379 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "70db7a29-670a-4a39-969f-14680973ca12", "name": "network-vif-deleted", "tag": "2727a3d5-3409-4051-aa40-248e3e2d9858", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:39:52.425868 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-102e71a3-57c8-4fb9-9e17-58d42ca0cf32 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:39:52.427052 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '70db7a29-670a-4a39-969f-14680973ca12', 'name': 'network-vif-deleted', 'tag': '2727a3d5-3409-4051-aa40-248e3e2d9858', 'status': 'completed', 'code': 200} Dec 09 21:39:52.498518 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 2727a3d5-3409-4051-aa40-248e3e2d9858 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:39:52.534939 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 2727a3d5-3409-4051-aa40-248e3e2d9858 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:39:52.535298 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 2727a3d5-3409-4051-aa40-248e3e2d9858 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:39:52.538151 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d9f5e80-5111-4ea2-87dd-d002adedc572 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:52.577528 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d9f5e80-5111-4ea2-87dd-d002adedc572 admin admin] Pushing event deleted for resources: {'Port': ['ID=f29fe8cc-72a3-485b-a257-8a8081d710b1,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:52.609451 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4263c744-9f6b-4e10-91a5-d684727160b8 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:39:52.655827 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-421bcff9-14bc-44b7-a457-fad2565e7208 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:52.685382 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-421bcff9-14bc-44b7-a457-fad2565e7208 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Port': ['ID=4fe1399f-de23-4511-8a68-c99758e5c8ce,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:52.702495 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d9f5e80-5111-4ea2-87dd-d002adedc572 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:52.752037 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58794) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:52.774463 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-421bcff9-14bc-44b7-a457-fad2565e7208 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:52.780729 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-421bcff9-14bc-44b7-a457-fad2565e7208 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/ports/4fe1399f-de23-4511-8a68-c99758e5c8ce HTTP/1.1" status: 204 len: 168 time: 0.8012104 Dec 09 21:39:52.782578 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58798) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:52.826869 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-f6855934-f2dc-44c9-8ea4-47cd96cc4852 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] GET failed (client error): The resource could not be found. Dec 09 21:39:52.831200 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f6855934-f2dc-44c9-8ea4-47cd96cc4852 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports/4fe1399f-de23-4511-8a68-c99758e5c8ce HTTP/1.1" status: 404 len: 333 time: 0.0448613 Dec 09 21:39:52.834082 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58804) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:52.942310 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-93319bae-6f96-4d50-84f6-9d23ae340198 admin admin] Request body: {'network': {'name': 'tempest-ServerPasswordTestJSON-2082527118-network', 'tenant_id': '57607f00f2d942f4b6f084f9e9a9493a'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:52.992539 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-1a82b83e-1d64-41a7-b5ad-3da1136a5c1f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting subnet 8ad02fb3-05c8-40d9-b3fa-88efc1ce8ed6 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:39:52.997833 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a82b83e-1d64-41a7-b5ad-3da1136a5c1f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.043603 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-93319bae-6f96-4d50-84f6-9d23ae340198 admin admin] Made reservation on behalf of 57607f00f2d942f4b6f084f9e9a9493a for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:53.046291 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93319bae-6f96-4d50-84f6-9d23ae340198 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.062113 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93319bae-6f96-4d50-84f6-9d23ae340198 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.069126 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a82b83e-1d64-41a7-b5ad-3da1136a5c1f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.168976 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a01d79-73e1-44a3-b059-2e2b40872fae req-dfa4b426-8832-429f-a4e8-d59f36faee32 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:53.177302 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a7a01d79-73e1-44a3-b059-2e2b40872fae req-dfa4b426-8832-429f-a4e8-d59f36faee32 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/ports?device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 945 time: 0.6047087 Dec 09 21:39:53.205546 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a82b83e-1d64-41a7-b5ad-3da1136a5c1f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.243241 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d9f5e80-5111-4ea2-87dd-d002adedc572 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.247051 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d9f5e80-5111-4ea2-87dd-d002adedc572 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.265422 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93319bae-6f96-4d50-84f6-9d23ae340198 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.271220 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93319bae-6f96-4d50-84f6-9d23ae340198 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.309864 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93319bae-6f96-4d50-84f6-9d23ae340198 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e060d354-4177-4c8e-8083-b0266b57b04e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:53.315000 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a7a01d79-73e1-44a3-b059-2e2b40872fae req-1435ab2b-7562-48ef-80de-90d9d8cde8de tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/security-groups?id=8ee4757d-9f67-4d3c-994b-59905d6c5b2b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1336813 Dec 09 21:39:53.318783 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a82b83e-1d64-41a7-b5ad-3da1136a5c1f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.331867 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d9f5e80-5111-4ea2-87dd-d002adedc572 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.332651 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3d9f5e80-5111-4ea2-87dd-d002adedc572 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4757617b-081d-4a51-a741-443e352d3856 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:39:53.341629 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-93319bae-6f96-4d50-84f6-9d23ae340198 admin admin] vlan segment allocate from pool success with {'vlan_id': 139, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:39:53.344093 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc0d91a2-9939-4ca0-a3da-ce09450a270c None None] Network 4deb4d96-8534-4a2b-bff0-e0a7bde8d20c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:53.355261 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d9f5e80-5111-4ea2-87dd-d002adedc572 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.358337 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3d9f5e80-5111-4ea2-87dd-d002adedc572 admin admin] 10.222.0.13 "DELETE /v2.0/routers/4757617b-081d-4a51-a741-443e352d3856 HTTP/1.1" status: 204 len: 168 time: 3.0892479 Dec 09 21:39:53.362308 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58826) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:53.366305 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a82b83e-1d64-41a7-b5ad-3da1136a5c1f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.379048 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1a82b83e-1d64-41a7-b5ad-3da1136a5c1f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/subnets/8ad02fb3-05c8-40d9-b3fa-88efc1ce8ed6 HTTP/1.1" status: 204 len: 168 time: 0.5437412 Dec 09 21:39:53.382951 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58828) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:53.393574 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a82b83e-1d64-41a7-b5ad-3da1136a5c1f tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Subnet': ['ID=8ad02fb3-05c8-40d9-b3fa-88efc1ce8ed6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:53.399707 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93319bae-6f96-4d50-84f6-9d23ae340198 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.400444 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-93319bae-6f96-4d50-84f6-9d23ae340198 admin admin] Added segment 563bc4db-400a-4e89-baf0-c14fd72fdac2 of type vlan for network f4182a82-fb46-4a98-997f-e7a875730a8e Dec 09 21:39:53.430966 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58830) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:53.499815 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-8fa681ae-7b21-4ef9-8ba0-a3f6c0f5a26b admin admin] Deleting subnet d989acab-7cdc-482f-a350-344dd6e11873 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:39:53.506084 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fa681ae-7b21-4ef9-8ba0-a3f6c0f5a26b admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.568365 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fa681ae-7b21-4ef9-8ba0-a3f6c0f5a26b admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.615535 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93319bae-6f96-4d50-84f6-9d23ae340198 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.621217 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-450c5727-0881-4344-becf-0c26171238be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.627531 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-34afc0a4-0e5f-4bf6-a654-f3ebd0eae2f4 admin admin] Deleting subnet 250bd3c5-f070-4269-9a20-15374747311c {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:39:53.633591 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-34afc0a4-0e5f-4bf6-a654-f3ebd0eae2f4 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.700270 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fa681ae-7b21-4ef9-8ba0-a3f6c0f5a26b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.716185 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-34afc0a4-0e5f-4bf6-a654-f3ebd0eae2f4 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.740363 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93319bae-6f96-4d50-84f6-9d23ae340198 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.741264 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-93319bae-6f96-4d50-84f6-9d23ae340198 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:53.741839 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93319bae-6f96-4d50-84f6-9d23ae340198 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.768004 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fa681ae-7b21-4ef9-8ba0-a3f6c0f5a26b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.815241 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fa681ae-7b21-4ef9-8ba0-a3f6c0f5a26b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d989acab-7cdc-482f-a350-344dd6e11873,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:53.817947 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fa681ae-7b21-4ef9-8ba0-a3f6c0f5a26b admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.821927 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8fa681ae-7b21-4ef9-8ba0-a3f6c0f5a26b admin admin] 10.222.0.13 "DELETE /v2.0/subnets/d989acab-7cdc-482f-a350-344dd6e11873 HTTP/1.1" status: 204 len: 168 time: 0.4561453 Dec 09 21:39:53.824615 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58848) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:53.827055 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-93319bae-6f96-4d50-84f6-9d23ae340198 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 1.0738950 Dec 09 21:39:53.831987 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca35b27c-c5d1-4f0c-a195-c5c66fbde181 None None] Network 361619eb-51a4-4728-b2cc-72e27ec4eca5 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:53.833919 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58850) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:53.841402 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-e96df368-b0a8-4906-b7f6-6c10092ae0c9 admin admin] Request body: {'subnet': {'network_id': 'f4182a82-fb46-4a98-997f-e7a875730a8e', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerPasswordTestJSON-2082527118-subnet', 'tenant_id': '57607f00f2d942f4b6f084f9e9a9493a', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:53.847730 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93319bae-6f96-4d50-84f6-9d23ae340198 admin admin] Pushing event updated for resources: {'Network': ['ID=f4182a82-fb46-4a98-997f-e7a875730a8e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:53.854501 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-34afc0a4-0e5f-4bf6-a654-f3ebd0eae2f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.878835 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network f4182a82-fb46-4a98-997f-e7a875730a8e details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:39:53.939176 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-450c5727-0881-4344-becf-0c26171238be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting port 6995bb11-cc60-4d4d-aade-e196cb9db6ff {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:53.939805 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-450c5727-0881-4344-becf-0c26171238be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.957071 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e62f21fb-0b48-46b3-ba5a-7e4c10a3e853 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.963897 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e96df368-b0a8-4906-b7f6-6c10092ae0c9 admin admin] Made reservation on behalf of 57607f00f2d942f4b6f084f9e9a9493a for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:53.967032 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e96df368-b0a8-4906-b7f6-6c10092ae0c9 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:53.982895 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de334563-1596-4a17-9e5e-b719c26240df None None] DHCP port deletion for 4deb4d96-8534-4a2b-bff0-e0a7bde8d20c request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:39:54.062857 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-e62f21fb-0b48-46b3-ba5a-7e4c10a3e853 admin admin] Deleting port 86083fc5-2b62-435e-b3a7-5150d6e88905 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:54.065933 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e62f21fb-0b48-46b3-ba5a-7e4c10a3e853 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:54.095127 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6995bb11-cc60-4d4d-aade-e196cb9db6ff no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:39:54.180453 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-34afc0a4-0e5f-4bf6-a654-f3ebd0eae2f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:54.184827 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-450c5727-0881-4344-becf-0c26171238be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] For port 6995bb11-cc60-4d4d-aade-e196cb9db6ff, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6995bb11-cc60-4d4d-aade-e196cb9db6ff,segment=NetworkSegment(5e3ed5f9-bba3-4814-bcd2-51baac318ef8),segment_id=5e3ed5f9-bba3-4814-bcd2-51baac318ef8)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:54.185407 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-450c5727-0881-4344-becf-0c26171238be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:54.187821 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-e62f21fb-0b48-46b3-ba5a-7e4c10a3e853 admin admin] For port 86083fc5-2b62-435e-b3a7-5150d6e88905, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=86083fc5-2b62-435e-b3a7-5150d6e88905,segment=NetworkSegment(7cf32f95-b9ab-465b-889c-7d7de3246a6f),segment_id=7cf32f95-b9ab-465b-889c-7d7de3246a6f)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:54.188283 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e62f21fb-0b48-46b3-ba5a-7e4c10a3e853 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:54.227453 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-e62f21fb-0b48-46b3-ba5a-7e4c10a3e853 admin admin] Calling delete_port for 86083fc5-2b62-435e-b3a7-5150d6e88905 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:54.240645 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-450c5727-0881-4344-becf-0c26171238be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Calling delete_port for 6995bb11-cc60-4d4d-aade-e196cb9db6ff owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:54.243619 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34afc0a4-0e5f-4bf6-a654-f3ebd0eae2f4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=250bd3c5-f070-4269-9a20-15374747311c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:54.249152 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-34afc0a4-0e5f-4bf6-a654-f3ebd0eae2f4 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:54.253037 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-34afc0a4-0e5f-4bf6-a654-f3ebd0eae2f4 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/250bd3c5-f070-4269-9a20-15374747311c HTTP/1.1" status: 204 len: 168 time: 0.8209302 Dec 09 21:39:54.255594 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58866) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:54.290398 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:54.320057 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63d4d7e3-063b-460b-b336-688028761d1a req-2acec619-3c55-42d5-99b8-cd5f4ede3e86 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:54.322775 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-63d4d7e3-063b-460b-b336-688028761d1a req-2acec619-3c55-42d5-99b8-cd5f4ede3e86 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.10 "GET /v2.0/ports?device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 945 time: 0.2304897 Dec 09 21:39:54.339611 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 6995bb11-cc60-4d4d-aade-e196cb9db6ff, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6995bb11-cc60-4d4d-aade-e196cb9db6ff,segment=NetworkSegment(5e3ed5f9-bba3-4814-bcd2-51baac318ef8),segment_id=5e3ed5f9-bba3-4814-bcd2-51baac318ef8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:54.357584 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:54.358941 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f29fe8cc-72a3-485b-a257-8a8081d710b1 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:39:54.422371 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e69a6df-ca3c-4364-990c-a1007d1e5857 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:54.433979 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: f29fe8cc-72a3-485b-a257-8a8081d710b1 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:39:54.434534 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f29fe8cc-72a3-485b-a257-8a8081d710b1 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:39:54.440525 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=6995bb11-cc60-4d4d-aade-e196cb9db6ff,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:54.452421 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-de334563-1596-4a17-9e5e-b719c26240df None None] Deleting port 6995bb11-cc60-4d4d-aade-e196cb9db6ff {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:54.452966 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-de334563-1596-4a17-9e5e-b719c26240df None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:54.521228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-de334563-1596-4a17-9e5e-b719c26240df None None] For port 6995bb11-cc60-4d4d-aade-e196cb9db6ff, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6995bb11-cc60-4d4d-aade-e196cb9db6ff,segment=NetworkSegment(5e3ed5f9-bba3-4814-bcd2-51baac318ef8),segment_id=5e3ed5f9-bba3-4814-bcd2-51baac318ef8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:54.522083 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-de334563-1596-4a17-9e5e-b719c26240df None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:54.524547 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e62f21fb-0b48-46b3-ba5a-7e4c10a3e853 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:54.537072 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-de334563-1596-4a17-9e5e-b719c26240df None None] Calling delete_port for 6995bb11-cc60-4d4d-aade-e196cb9db6ff owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:54.622318 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e69a6df-ca3c-4364-990c-a1007d1e5857 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:54.633087 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-de334563-1596-4a17-9e5e-b719c26240df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:54.668283 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de334563-1596-4a17-9e5e-b719c26240df None None] Pushing event deleted for resources: {'Port': ['ID=6995bb11-cc60-4d4d-aade-e196cb9db6ff,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:54.670307 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de334563-1596-4a17-9e5e-b719c26240df None None] No DVR routers for this DVR port 6995bb11-cc60-4d4d-aade-e196cb9db6ff on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:39:54.704581 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d094281-6a79-45f8-9925-88848fcc6ae0 req-41136ead-2ab0-49d4-9380-df627c1104b4 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:54.706299 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d094281-6a79-45f8-9925-88848fcc6ae0 req-41136ead-2ab0-49d4-9380-df627c1104b4 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/ports?device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 945 time: 0.2793028 Dec 09 21:39:54.720849 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-5e69a6df-ca3c-4364-990c-a1007d1e5857 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['87a22671-0e6a-414f-86be-13172b5f3f96']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:54.727782 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e96df368-b0a8-4906-b7f6-6c10092ae0c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:54.733138 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e62f21fb-0b48-46b3-ba5a-7e4c10a3e853 admin admin] Pushing event deleted for resources: {'Port': ['ID=86083fc5-2b62-435e-b3a7-5150d6e88905,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:54.739943 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e62f21fb-0b48-46b3-ba5a-7e4c10a3e853 admin admin] No DVR routers for this DVR port 86083fc5-2b62-435e-b3a7-5150d6e88905 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:39:54.747403 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-5e69a6df-ca3c-4364-990c-a1007d1e5857 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '21ec9cce-e1fc-4f03-b167-7ca6b7df97ea') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:54.747718 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-5e69a6df-ca3c-4364-990c-a1007d1e5857 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '21ec9cce-e1fc-4f03-b167-7ca6b7df97ea') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:54.772663 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-450c5727-0881-4344-becf-0c26171238be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:54.783945 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7423e24d-f4d7-4f68-badd-0178cfadb470 None None] DHCP port deletion for 361619eb-51a4-4728-b2cc-72e27ec4eca5 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:39:54.796352 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-450c5727-0881-4344-becf-0c26171238be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] No DVR routers for this DVR port 6995bb11-cc60-4d4d-aade-e196cb9db6ff on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:39:54.817517 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e69a6df-ca3c-4364-990c-a1007d1e5857 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:54.854758 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-63d4d7e3-063b-460b-b336-688028761d1a req-9b62e3b7-e40f-4213-9d7d-24bbd6d7ebe6 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Deleting port 101912b6-96a7-4280-822a-8c03b59cc0b0 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:54.855101 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-63d4d7e3-063b-460b-b336-688028761d1a req-9b62e3b7-e40f-4213-9d7d-24bbd6d7ebe6 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:54.878584 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d094281-6a79-45f8-9925-88848fcc6ae0 req-38825b00-4c1f-4ee1-9f2f-42e73198a190 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/security-groups?id=8ee4757d-9f67-4d3c-994b-59905d6c5b2b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1467061 Dec 09 21:39:54.881543 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e69a6df-ca3c-4364-990c-a1007d1e5857 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:54.898159 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5e69a6df-ca3c-4364-990c-a1007d1e5857 admin admin] Releasing vlan 145 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:39:54.898561 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e69a6df-ca3c-4364-990c-a1007d1e5857 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:39:54.900419 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:39:54.936907 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e62f21fb-0b48-46b3-ba5a-7e4c10a3e853 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:54.952670 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-450c5727-0881-4344-becf-0c26171238be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Port': ['ID=6995bb11-cc60-4d4d-aade-e196cb9db6ff,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:54.965978 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e96df368-b0a8-4906-b7f6-6c10092ae0c9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8a9e717f-5672-430b-b60c-abd3e3f39a5f,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:55.021753 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e62f21fb-0b48-46b3-ba5a-7e4c10a3e853 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['361619eb-51a4-4728-b2cc-72e27ec4eca5']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:55.030917 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e69a6df-ca3c-4364-990c-a1007d1e5857 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:55.037265 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e69a6df-ca3c-4364-990c-a1007d1e5857 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:55.041485 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5e69a6df-ca3c-4364-990c-a1007d1e5857 admin admin] 10.222.0.13 "DELETE /v2.0/networks/87a22671-0e6a-414f-86be-13172b5f3f96 HTTP/1.1" status: 204 len: 168 time: 0.7840877 Dec 09 21:39:55.047299 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e62f21fb-0b48-46b3-ba5a-7e4c10a3e853 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7cf32f95-b9ab-465b-889c-7d7de3246a6f') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:55.048687 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e62f21fb-0b48-46b3-ba5a-7e4c10a3e853 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7cf32f95-b9ab-465b-889c-7d7de3246a6f') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:55.070395 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-63d4d7e3-063b-460b-b336-688028761d1a req-9b62e3b7-e40f-4213-9d7d-24bbd6d7ebe6 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] For port 101912b6-96a7-4280-822a-8c03b59cc0b0, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=101912b6-96a7-4280-822a-8c03b59cc0b0,segment=NetworkSegment(e0f6fb16-426b-4e5a-a33f-f4e36fbfbd55),segment_id=e0f6fb16-426b-4e5a-a33f-f4e36fbfbd55)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:55.070759 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-63d4d7e3-063b-460b-b336-688028761d1a req-9b62e3b7-e40f-4213-9d7d-24bbd6d7ebe6 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:55.074221 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-450c5727-0881-4344-becf-0c26171238be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:55.091377 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e96df368-b0a8-4906-b7f6-6c10092ae0c9 admin admin] Checking segment: {'id': '563bc4db-400a-4e89-baf0-c14fd72fdac2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'f4182a82-fb46-4a98-997f-e7a875730a8e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:39:55.091760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e96df368-b0a8-4906-b7f6-6c10092ae0c9 admin admin] Network hostable DHCP agents. Network: f4182a82-fb46-4a98-997f-e7a875730a8e, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:39:55.108627 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-63d4d7e3-063b-460b-b336-688028761d1a req-9b62e3b7-e40f-4213-9d7d-24bbd6d7ebe6 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Calling delete_port for 101912b6-96a7-4280-822a-8c03b59cc0b0 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:55.108773 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e62f21fb-0b48-46b3-ba5a-7e4c10a3e853 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:55.112723 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-450c5727-0881-4344-becf-0c26171238be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4deb4d96-8534-4a2b-bff0-e0a7bde8d20c']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:55.128996 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e62f21fb-0b48-46b3-ba5a-7e4c10a3e853 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:55.133633 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-450c5727-0881-4344-becf-0c26171238be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5e3ed5f9-bba3-4814-bcd2-51baac318ef8') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:55.133910 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-450c5727-0881-4344-becf-0c26171238be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5e3ed5f9-bba3-4814-bcd2-51baac318ef8') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:39:55.148851 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-450c5727-0881-4344-becf-0c26171238be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:55.150788 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e69a6df-ca3c-4364-990c-a1007d1e5857 admin admin] Pushing event deleted for resources: {'Network': ['ID=87a22671-0e6a-414f-86be-13172b5f3f96,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:55.160372 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e62f21fb-0b48-46b3-ba5a-7e4c10a3e853 admin admin] Releasing vlan 148 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:39:55.160806 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e62f21fb-0b48-46b3-ba5a-7e4c10a3e853 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:39:55.163332 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:39:55.206805 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e96df368-b0a8-4906-b7f6-6c10092ae0c9 admin admin] Network f4182a82-fb46-4a98-997f-e7a875730a8e is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:39:55.210033 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-450c5727-0881-4344-becf-0c26171238be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:55.221523 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-450c5727-0881-4344-becf-0c26171238be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Releasing vlan 133 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:39:55.222005 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-450c5727-0881-4344-becf-0c26171238be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: self.session.flush() Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: self.session.flush() Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: self.session.flush() Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: self.session.flush() Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:39:55.229654 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:39:55.267003 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e62f21fb-0b48-46b3-ba5a-7e4c10a3e853 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:55.274446 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e62f21fb-0b48-46b3-ba5a-7e4c10a3e853 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:55.281436 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e62f21fb-0b48-46b3-ba5a-7e4c10a3e853 admin admin] 10.222.0.13 "DELETE /v2.0/networks/361619eb-51a4-4728-b2cc-72e27ec4eca5 HTTP/1.1" status: 204 len: 168 time: 1.4555080 Dec 09 21:39:55.283556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58908) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:55.309018 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58910) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:55.358145 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e62f21fb-0b48-46b3-ba5a-7e4c10a3e853 admin admin] Pushing event deleted for resources: {'Network': ['ID=361619eb-51a4-4728-b2cc-72e27ec4eca5,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:55.452356 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e4752857-2290-4110-9af8-52d44818e5db admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=36fd5c73acc341269fd595119af9d891&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1420546 Dec 09 21:39:55.455791 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58920) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:55.584745 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1ffc2299-0558-4a14-9a6c-a0470f340f61 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:55.651937 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1ffc2299-0558-4a14-9a6c-a0470f340f61 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:55.667686 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-e96df368-b0a8-4906-b7f6-6c10092ae0c9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, f4182a82-fb46-4a98-997f-e7a875730a8e) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:55.678119 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fda35110-10f2-477e-b39b-7cba14f754f8 None None] Network f4182a82-fb46-4a98-997f-e7a875730a8e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:55.679873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e96df368-b0a8-4906-b7f6-6c10092ae0c9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:55.680460 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e96df368-b0a8-4906-b7f6-6c10092ae0c9 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:55.793313 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1ffc2299-0558-4a14-9a6c-a0470f340f61 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:55.801449 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1ffc2299-0558-4a14-9a6c-a0470f340f61 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:55.805925 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1ffc2299-0558-4a14-9a6c-a0470f340f61 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/e1c1ce62-2b22-487b-b831-0504741b720a HTTP/1.1" status: 204 len: 168 time: 0.3370845 Dec 09 21:39:55.817523 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ffc2299-0558-4a14-9a6c-a0470f340f61 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e1c1ce62-2b22-487b-b831-0504741b720a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:55.852648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f1aaf8a-7dff-4b5e-a496-58f185c54688 None None] Network f4182a82-fb46-4a98-997f-e7a875730a8e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:55.916477 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e96df368-b0a8-4906-b7f6-6c10092ae0c9 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 2.0732973 Dec 09 21:39:55.934176 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-450c5727-0881-4344-becf-0c26171238be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:55.937194 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-63d4d7e3-063b-460b-b336-688028761d1a req-9b62e3b7-e40f-4213-9d7d-24bbd6d7ebe6 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:55.945610 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-450c5727-0881-4344-becf-0c26171238be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:55.954939 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['101912b6-96a7-4280-822a-8c03b59cc0b0'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:39:55.955327 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58950) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:55.957543 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-450c5727-0881-4344-becf-0c26171238be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/networks/4deb4d96-8534-4a2b-bff0-e0a7bde8d20c HTTP/1.1" status: 204 len: 168 time: 2.5724778 Dec 09 21:39:55.964451 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-5d57be9d-42b8-4ebe-803e-fee5781bb70d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'network': {'name': 'tempest-PortsTestJSON-795701775'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:55.996990 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7a37e16f-4bc5-4503-953f-fb2faa3b1c69 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:56.027222 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-450c5727-0881-4344-becf-0c26171238be tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Network': ['ID=4deb4d96-8534-4a2b-bff0-e0a7bde8d20c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:56.063269 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b62e3b7-e40f-4213-9d7d-24bbd6d7ebe6 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Pushing event deleted for resources: {'Port': ['ID=101912b6-96a7-4280-822a-8c03b59cc0b0,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:56.128571 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-63d4d7e3-063b-460b-b336-688028761d1a req-9b62e3b7-e40f-4213-9d7d-24bbd6d7ebe6 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] No DVR routers for this DVR port 101912b6-96a7-4280-822a-8c03b59cc0b0 on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:39:56.133214 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-63d4d7e3-063b-460b-b336-688028761d1a req-9b62e3b7-e40f-4213-9d7d-24bbd6d7ebe6 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:56.148023 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-63d4d7e3-063b-460b-b336-688028761d1a req-9b62e3b7-e40f-4213-9d7d-24bbd6d7ebe6 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.10 "DELETE /v2.0/ports/101912b6-96a7-4280-822a-8c03b59cc0b0 HTTP/1.1" status: 204 len: 173 time: 1.8163667 Dec 09 21:39:56.148716 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b84755f7-f8f4-472b-bd23-cc1d256a5497', 'name': 'network-vif-deleted', 'tag': '101912b6-96a7-4280-822a-8c03b59cc0b0'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:39:56.160978 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f3927f3d-6d61-47ae-9701-21d0bf8847f6" -d '{"events": [{"server_uuid": "b84755f7-f8f4-472b-bd23-cc1d256a5497", "name": "network-vif-deleted", "tag": "101912b6-96a7-4280-822a-8c03b59cc0b0"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:39:56.174173 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 86083fc5-2b62-435e-b3a7-5150d6e88905 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:39:56.248661 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 86083fc5-2b62-435e-b3a7-5150d6e88905 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:39:56.250424 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 86083fc5-2b62-435e-b3a7-5150d6e88905 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:39:56.406031 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9690b115-5029-403e-b5f8-fa82dbb4a0b0 req-0b01ae1d-ef47-4de6-8cee-7b94e3ccb834 tempest-TestServerAdvancedOps-900289733 tempest-TestServerAdvancedOps-900289733-project] 10.222.0.13 "GET /v2.0/ports?device_id=b84755f7-f8f4-472b-bd23-cc1d256a5497 HTTP/1.1" status: 200 len: 210 time: 0.2048852 Dec 09 21:39:56.408185 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5d57be9d-42b8-4ebe-803e-fee5781bb70d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:56.412110 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5d57be9d-42b8-4ebe-803e-fee5781bb70d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:56.451038 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5d57be9d-42b8-4ebe-803e-fee5781bb70d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] vlan segment allocate from pool success with {'vlan_id': 118, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:39:56.466923 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5d57be9d-42b8-4ebe-803e-fee5781bb70d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:56.467681 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-5d57be9d-42b8-4ebe-803e-fee5781bb70d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Added segment ef2748bc-7ba5-4b81-a9b8-bae847ca5231 of type vlan for network 06ebb5fc-e0f4-4630-93c4-509954a9e0b0 Dec 09 21:39:56.482146 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:39:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7f8ad31d-4483-4d86-8001-321802e7543b x-openstack-request-id: req-7f8ad31d-4483-4d86-8001-321802e7543b {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:39:56.483109 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b84755f7-f8f4-472b-bd23-cc1d256a5497", "name": "network-vif-deleted", "tag": "101912b6-96a7-4280-822a-8c03b59cc0b0", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:39:56.483526 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-7f8ad31d-4483-4d86-8001-321802e7543b {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:39:56.484383 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b84755f7-f8f4-472b-bd23-cc1d256a5497', 'name': 'network-vif-deleted', 'tag': '101912b6-96a7-4280-822a-8c03b59cc0b0', 'status': 'completed', 'code': 200} Dec 09 21:39:56.581055 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5d57be9d-42b8-4ebe-803e-fee5781bb70d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:56.656309 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5d57be9d-42b8-4ebe-803e-fee5781bb70d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:56.665214 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5d57be9d-42b8-4ebe-803e-fee5781bb70d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:56.665214 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5d57be9d-42b8-4ebe-803e-fee5781bb70d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:56.756823 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5d57be9d-42b8-4ebe-803e-fee5781bb70d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.7991190 Dec 09 21:39:56.758762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-7a37e16f-4bc5-4503-953f-fb2faa3b1c69 admin admin] Deleting port 21963cc5-b64c-44cd-847e-fb5f82ccd3f9 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:39:56.759498 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59024) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:56.767055 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-f5f2b044-6a53-4a26-bed4-c8c97a4d56eb tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'subnet': {'network_id': '06ebb5fc-e0f4-4630-93c4-509954a9e0b0', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:56.770570 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7a37e16f-4bc5-4503-953f-fb2faa3b1c69 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:56.848270 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d57be9d-42b8-4ebe-803e-fee5781bb70d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Network': ['ID=06ebb5fc-e0f4-4630-93c4-509954a9e0b0,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:56.865851 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 06ebb5fc-e0f4-4630-93c4-509954a9e0b0 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:39:56.968552 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f5f2b044-6a53-4a26-bed4-c8c97a4d56eb tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:56.975251 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5f2b044-6a53-4a26-bed4-c8c97a4d56eb tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:57.025569 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-7a37e16f-4bc5-4503-953f-fb2faa3b1c69 admin admin] For port 21963cc5-b64c-44cd-847e-fb5f82ccd3f9, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=21963cc5-b64c-44cd-847e-fb5f82ccd3f9,segment=NetworkSegment(b277bb60-9cde-4512-80aa-21951c30630a),segment_id=b277bb60-9cde-4512-80aa-21951c30630a)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:39:57.026130 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7a37e16f-4bc5-4503-953f-fb2faa3b1c69 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:57.088528 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-06b1f32c-28e6-4f49-943b-bce83000dbf9 tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:57.090274 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-06b1f32c-28e6-4f49-943b-bce83000dbf9 tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/networks?id=f4182a82-fb46-4a98-997f-e7a875730a8e HTTP/1.1" status: 200 len: 813 time: 0.1791506 Dec 09 21:39:57.091325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-7a37e16f-4bc5-4503-953f-fb2faa3b1c69 admin admin] Calling delete_port for 21963cc5-b64c-44cd-847e-fb5f82ccd3f9 owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:39:57.119780 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-a62ac666-ef25-4cd0-9f46-86bae2c7e41a tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/quotas/57607f00f2d942f4b6f084f9e9a9493a HTTP/1.1" status: 200 len: 375 time: 0.0132608 Dec 09 21:39:57.216021 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-9bd8f889-c487-48cf-8989-41a3a1449f45 tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=57607f00f2d942f4b6f084f9e9a9493a&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0608699 Dec 09 21:39:57.285203 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5f2b044-6a53-4a26-bed4-c8c97a4d56eb tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:57.287510 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:57.294325 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:57.330804 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-1a4a111f-4ae1-41f1-9962-5e2d5bc894cd service neutron] 10.222.0.13 "GET /v2.0/networks/f4182a82-fb46-4a98-997f-e7a875730a8e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1041546 Dec 09 21:39:57.359331 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59062) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:57.387985 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5f2b044-6a53-4a26-bed4-c8c97a4d56eb tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Subnet': ['ID=423f17aa-f4f8-4e49-80d6-5cbbdd88375d,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:57.429674 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5f2b044-6a53-4a26-bed4-c8c97a4d56eb tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Checking segment: {'id': 'ef2748bc-7ba5-4b81-a9b8-bae847ca5231', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '06ebb5fc-e0f4-4630-93c4-509954a9e0b0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:39:57.430347 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5f2b044-6a53-4a26-bed4-c8c97a4d56eb tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network hostable DHCP agents. Network: 06ebb5fc-e0f4-4630-93c4-509954a9e0b0, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:39:57.460548 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5f2b044-6a53-4a26-bed4-c8c97a4d56eb tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network 06ebb5fc-e0f4-4630-93c4-509954a9e0b0 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:39:57.476819 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-f5f2b044-6a53-4a26-bed4-c8c97a4d56eb tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 06ebb5fc-e0f4-4630-93c4-509954a9e0b0) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:57.481766 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5f2b044-6a53-4a26-bed4-c8c97a4d56eb tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:57.482680 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5f2b044-6a53-4a26-bed4-c8c97a4d56eb tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:57.490106 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-733c63ba-d5a0-47fb-add7-4d0d715982e8 None None] Network 06ebb5fc-e0f4-4630-93c4-509954a9e0b0 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:39:57.515223 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-39625b32-dd3c-475d-8fb7-2bc839e5907d service neutron] 10.222.0.13 "GET /v2.0/networks/f4182a82-fb46-4a98-997f-e7a875730a8e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1709352 Dec 09 21:39:57.515791 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f5f2b044-6a53-4a26-bed4-c8c97a4d56eb tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.7514136 Dec 09 21:39:57.515791 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59070) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:57.524247 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-3cf03ded-0172-4bb8-9b08-3be24233da6e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'router': {'name': 'tempest-PortsTestJSON-router-759251656', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:57.582539 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3cf03ded-0172-4bb8-9b08-3be24233da6e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:57.584064 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3cf03ded-0172-4bb8-9b08-3be24233da6e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:57.626683 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-70c41a56-f4e0-4b5c-8ed3-4a9364b47a92 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-2013763698-network', 'tenant_id': '69d79e96ec1c418aa6c619846f0fe02e'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:57.663788 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6acc22e8-4621-473c-97b8-dff850af3faf None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-06ebb5fc-e0f4-4630-93c4-509954a9e0b0', 'network_id': '06ebb5fc-e0f4-4630-93c4-509954a9e0b0', 'project_id': 'e8bdea0c320d4955bc3ba905696bda85', 'fixed_ips': [{'subnet_id': '423f17aa-f4f8-4e49-80d6-5cbbdd88375d'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:39:57.666569 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6acc22e8-4621-473c-97b8-dff850af3faf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:57.682467 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-70c41a56-f4e0-4b5c-8ed3-4a9364b47a92 admin admin] Made reservation on behalf of 69d79e96ec1c418aa6c619846f0fe02e for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:57.686352 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70c41a56-f4e0-4b5c-8ed3-4a9364b47a92 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:57.690030 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7a37e16f-4bc5-4503-953f-fb2faa3b1c69 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:57.727428 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70c41a56-f4e0-4b5c-8ed3-4a9364b47a92 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:57.732119 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a37e16f-4bc5-4503-953f-fb2faa3b1c69 admin admin] Pushing event deleted for resources: {'Port': ['ID=21963cc5-b64c-44cd-847e-fb5f82ccd3f9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:57.807799 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59082) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:57.831486 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3cf03ded-0172-4bb8-9b08-3be24233da6e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:57.859760 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3cf03ded-0172-4bb8-9b08-3be24233da6e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:57.894611 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3cf03ded-0172-4bb8-9b08-3be24233da6e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:57.896470 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3cf03ded-0172-4bb8-9b08-3be24233da6e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 701 time: 0.3799336 Dec 09 21:39:57.899040 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59092) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:57.916560 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'port': {'network_id': '06ebb5fc-e0f4-4630-93c4-509954a9e0b0', 'name': 'tempest-PortsTestJSON-1302160858'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:58.088695 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-65180b2e-7d1a-4d74-a03b-1fb32d92cb6b req-7b39b5ca-aba1-4adf-99da-41f610e07d46 tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/ports?device_id=04a29bbd-d29d-4109-877b-a0cf1fbf9046 HTTP/1.1" status: 200 len: 210 time: 0.1722016 Dec 09 21:39:58.103310 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-6acc22e8-4621-473c-97b8-dff850af3faf None None] Allocated IP 172.20.0.2 (06ebb5fc-e0f4-4630-93c4-509954a9e0b0/423f17aa-f4f8-4e49-80d6-5cbbdd88375d/d7077264-be0e-4f8d-abfb-3566397c1ccb) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:39:58.155181 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-e6fb443d-28b7-42cc-9c07-9ce77ae1b083 admin admin] Deleting subnet ee1b3d8d-21b5-45b8-802b-af8c84fb9577 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:39:58.184682 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e6fb443d-28b7-42cc-9c07-9ce77ae1b083 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:58.209888 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:58.215734 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:58.249408 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] device_id is not set on port e8eec1d3-ade1-4e88-9005-7833645e5705 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:39:58.371060 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e6fb443d-28b7-42cc-9c07-9ce77ae1b083 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:58.372425 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6acc22e8-4621-473c-97b8-dff850af3faf None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:58.397143 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6acc22e8-4621-473c-97b8-dff850af3faf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:58.412494 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7a37e16f-4bc5-4503-953f-fb2faa3b1c69 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:58.438785 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70c41a56-f4e0-4b5c-8ed3-4a9364b47a92 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:58.492340 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70c41a56-f4e0-4b5c-8ed3-4a9364b47a92 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:58.499103 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Allocated IP 172.20.0.6 (06ebb5fc-e0f4-4630-93c4-509954a9e0b0/423f17aa-f4f8-4e49-80d6-5cbbdd88375d/e8eec1d3-ade1-4e88-9005-7833645e5705) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:39:58.505166 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-70c41a56-f4e0-4b5c-8ed3-4a9364b47a92 admin admin] vlan segment allocate from pool success with {'vlan_id': 123, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:39:58.516649 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70c41a56-f4e0-4b5c-8ed3-4a9364b47a92 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:58.517281 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-70c41a56-f4e0-4b5c-8ed3-4a9364b47a92 admin admin] Added segment 387b2307-6c4a-4b56-8fe0-5bcb0370db1c of type vlan for network 71038cd4-0600-4b06-91f9-ae7f4f4807f9 Dec 09 21:39:58.525090 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6acc22e8-4621-473c-97b8-dff850af3faf None None] Network 06ebb5fc-e0f4-4630-93c4-509954a9e0b0 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:39:58.526246 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 101912b6-96a7-4280-822a-8c03b59cc0b0 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:39:58.554247 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-6acc22e8-4621-473c-97b8-dff850af3faf None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:58.560530 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6acc22e8-4621-473c-97b8-dff850af3faf None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:39:58.563884 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6acc22e8-4621-473c-97b8-dff850af3faf None None] Pushing event updated for resources: {'Port': ['ID=d7077264-be0e-4f8d-abfb-3566397c1ccb,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:58.575636 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 101912b6-96a7-4280-822a-8c03b59cc0b0 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:39:58.577187 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 101912b6-96a7-4280-822a-8c03b59cc0b0 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:39:58.596566 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70c41a56-f4e0-4b5c-8ed3-4a9364b47a92 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:58.634551 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e6fb443d-28b7-42cc-9c07-9ce77ae1b083 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:58.638299 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70c41a56-f4e0-4b5c-8ed3-4a9364b47a92 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:58.639258 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70c41a56-f4e0-4b5c-8ed3-4a9364b47a92 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:58.639879 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70c41a56-f4e0-4b5c-8ed3-4a9364b47a92 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:58.683277 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6acc22e8-4621-473c-97b8-dff850af3faf None None] Attempting to bind port d7077264-be0e-4f8d-abfb-3566397c1ccb on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:39:58.684067 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6acc22e8-4621-473c-97b8-dff850af3faf None None] Attempting to bind port d7077264-be0e-4f8d-abfb-3566397c1ccb by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'ef2748bc-7ba5-4b81-a9b8-bae847ca5231', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '06ebb5fc-e0f4-4630-93c4-509954a9e0b0'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:39:58.684712 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6acc22e8-4621-473c-97b8-dff850af3faf None None] Attempting to bind port d7077264-be0e-4f8d-abfb-3566397c1ccb on network 06ebb5fc-e0f4-4630-93c4-509954a9e0b0 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:39:58.690887 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6acc22e8-4621-473c-97b8-dff850af3faf None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 39, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:39:58.691328 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6acc22e8-4621-473c-97b8-dff850af3faf None None] Checking segment: {'id': 'ef2748bc-7ba5-4b81-a9b8-bae847ca5231', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '06ebb5fc-e0f4-4630-93c4-509954a9e0b0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:39:58.705758 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6acc22e8-4621-473c-97b8-dff850af3faf None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:58.706460 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6acc22e8-4621-473c-97b8-dff850af3faf None None] Bound using segment: {'id': 'ef2748bc-7ba5-4b81-a9b8-bae847ca5231', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '06ebb5fc-e0f4-4630-93c4-509954a9e0b0'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:39:58.707002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6acc22e8-4621-473c-97b8-dff850af3faf None None] Bound port: d7077264-be0e-4f8d-abfb-3566397c1ccb, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ef2748bc-7ba5-4b81-a9b8-bae847ca5231', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 118, 'network_id': '06ebb5fc-e0f4-4630-93c4-509954a9e0b0'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:39:58.707415 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6acc22e8-4621-473c-97b8-dff850af3faf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:58.739958 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:58.772641 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-70c41a56-f4e0-4b5c-8ed3-4a9364b47a92 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 892 time: 1.4121914 Dec 09 21:39:58.781832 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59146) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:58.807087 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6acc22e8-4621-473c-97b8-dff850af3faf None None] For port d7077264-be0e-4f8d-abfb-3566397c1ccb, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:39:58.810710 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:58.823392 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6acc22e8-4621-473c-97b8-dff850af3faf None None] For port d7077264-be0e-4f8d-abfb-3566397c1ccb, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d7077264-be0e-4f8d-abfb-3566397c1ccb,segment=NetworkSegment(ef2748bc-7ba5-4b81-a9b8-bae847ca5231),segment_id=ef2748bc-7ba5-4b81-a9b8-bae847ca5231)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:39:58.827175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70c41a56-f4e0-4b5c-8ed3-4a9364b47a92 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8d4a008f-197d-4501-abd1-093027cfd51b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:58.835393 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6acc22e8-4621-473c-97b8-dff850af3faf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:58.912317 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-45ef4b72-5afb-4fb2-94d7-a13af954821e admin admin] Request body: {'subnet': {'network_id': '71038cd4-0600-4b06-91f9-ae7f4f4807f9', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-2013763698-subnet', 'tenant_id': '69d79e96ec1c418aa6c619846f0fe02e', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:58.915987 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70c41a56-f4e0-4b5c-8ed3-4a9364b47a92 admin admin] Pushing event updated for resources: {'Network': ['ID=71038cd4-0600-4b06-91f9-ae7f4f4807f9,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:58.943523 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 71038cd4-0600-4b06-91f9-ae7f4f4807f9 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:39:58.949777 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network 06ebb5fc-e0f4-4630-93c4-509954a9e0b0 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:39:58.962875 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:39:58.978456 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:39:59.000804 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e6fb443d-28b7-42cc-9c07-9ce77ae1b083 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:59.023292 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Port': ['ID=e8eec1d3-ade1-4e88-9005-7833645e5705,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:59.041601 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:59.042264 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:59.043015 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:59.043636 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:59.044223 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:59.044786 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:59.045584 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:59.046275 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:59.046826 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:59.047395 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:59.048262 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:59.048807 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:59.050165 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:39:59.065222 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-45ef4b72-5afb-4fb2-94d7-a13af954821e admin admin] Made reservation on behalf of 69d79e96ec1c418aa6c619846f0fe02e for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:39:59.075254 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-45ef4b72-5afb-4fb2-94d7-a13af954821e admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:59.090814 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:59.092873 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:59.101403 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6acc22e8-4621-473c-97b8-dff850af3faf None None] Pushing event updated for resources: {'Port': ['ID=d7077264-be0e-4f8d-abfb-3566397c1ccb,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:59.130120 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7acd9a5e-3c12-4bf7-8e4e-e36215dc6648 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 1.2297697 Dec 09 21:39:59.132645 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59168) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:59.155014 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6fb443d-28b7-42cc-9c07-9ce77ae1b083 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ee1b3d8d-21b5-45b8-802b-af8c84fb9577,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:39:59.157608 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e6fb443d-28b7-42cc-9c07-9ce77ae1b083 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:59.166076 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e6fb443d-28b7-42cc-9c07-9ce77ae1b083 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/ee1b3d8d-21b5-45b8-802b-af8c84fb9577 HTTP/1.1" status: 204 len: 168 time: 1.3449507 Dec 09 21:39:59.215294 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59170) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:39:59.618393 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3677131e-625c-4069-badd-f86426744939 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:59.811324 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-422e73d3-f35c-4ce5-a707-eb55c3e4e68a tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:39:59.813538 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-422e73d3-f35c-4ce5-a707-eb55c3e4e68a tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.10 "GET /v2.0/networks?id=f4182a82-fb46-4a98-997f-e7a875730a8e HTTP/1.1" status: 200 len: 813 time: 0.4616919 Dec 09 21:39:59.821572 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-402aadf7-0f9e-430a-a1c7-2cb4531b2247 req-b5f5c606-d489-472f-8354-2a1e2f32605f tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/ports?device_id=04a29bbd-d29d-4109-877b-a0cf1fbf9046 HTTP/1.1" status: 200 len: 210 time: 0.0416236 Dec 09 21:39:59.856657 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-8c50b8fe-0467-4341-b836-13aed5eef7fe tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Request body: {'port': {'device_id': '04a29bbd-d29d-4109-877b-a0cf1fbf9046', 'network_id': 'f4182a82-fb46-4a98-997f-e7a875730a8e', 'admin_state_up': True, 'tenant_id': '57607f00f2d942f4b6f084f9e9a9493a'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:39:59.914894 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3677131e-625c-4069-badd-f86426744939 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:39:59.951007 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7a37e16f-4bc5-4503-953f-fb2faa3b1c69 admin admin] Router bf1205e6-b4d1-485d-b2f3-3ea9a434d27e has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:39:59.982545 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-3677131e-625c-4069-badd-f86426744939 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a71f32bb-6d3a-4295-a0cb-027407f942be']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:00.048150 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-3677131e-625c-4069-badd-f86426744939 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e0f6fb16-426b-4e5a-a33f-f4e36fbfbd55') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:00.048802 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-3677131e-625c-4069-badd-f86426744939 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e0f6fb16-426b-4e5a-a33f-f4e36fbfbd55') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:00.072666 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3677131e-625c-4069-badd-f86426744939 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:00.114804 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d7077264-be0e-4f8d-abfb-3566397c1ccb up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:40:00.123651 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7a37e16f-4bc5-4503-953f-fb2faa3b1c69 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:40:00.131842 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3677131e-625c-4069-badd-f86426744939 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:00.157132 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3677131e-625c-4069-badd-f86426744939 admin admin] Releasing vlan 138 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:40:00.157946 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3677131e-625c-4069-badd-f86426744939 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:40:00.160300 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:40:00.165993 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7a37e16f-4bc5-4503-953f-fb2faa3b1c69 admin admin] 10.222.0.13 "PUT /v2.0/routers/bf1205e6-b4d1-485d-b2f3-3ea9a434d27e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 4.8812318 Dec 09 21:40:00.170252 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59212) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:00.174460 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-967f0253-a7ff-4f9c-a8a3-c7526ee62bc2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:00.196953 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15251cf9-e5e8-4139-8c48-0949240fad84 None None] Sync routers for ids ['bf1205e6-b4d1-485d-b2f3-3ea9a434d27e'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:40:00.233466 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15251cf9-e5e8-4139-8c48-0949240fad84 None None] Routers {'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:40:00.235019 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-15251cf9-e5e8-4139-8c48-0949240fad84 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:39:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['bf1205e6-b4d1-485d-b2f3-3ea9a434d27e'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:00.291512 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-45ef4b72-5afb-4fb2-94d7-a13af954821e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:00.441881 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59216) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:00.517663 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c793ded2-2e0a-4bfa-8bbe-ea21b4baedfd admin admin] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:00.536515 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-967f0253-a7ff-4f9c-a8a3-c7526ee62bc2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:00.546887 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-967f0253-a7ff-4f9c-a8a3-c7526ee62bc2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:00.578781 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3677131e-625c-4069-badd-f86426744939 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:00.584378 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3677131e-625c-4069-badd-f86426744939 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:00.588514 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3677131e-625c-4069-badd-f86426744939 admin admin] 10.222.0.13 "DELETE /v2.0/networks/a71f32bb-6d3a-4295-a0cb-027407f942be HTTP/1.1" status: 204 len: 168 time: 1.3721542 Dec 09 21:40:00.595966 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-8c50b8fe-0467-4341-b836-13aed5eef7fe tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Made reservation on behalf of 57607f00f2d942f4b6f084f9e9a9493a for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:00.600381 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-8c50b8fe-0467-4341-b836-13aed5eef7fe tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:00.602309 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59222) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:00.602649 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port d7077264-be0e-4f8d-abfb-3566397c1ccb triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:00.603026 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:00.616274 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45ef4b72-5afb-4fb2-94d7-a13af954821e admin admin] Checking segment: {'id': '387b2307-6c4a-4b56-8fe0-5bcb0370db1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '71038cd4-0600-4b06-91f9-ae7f4f4807f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:40:00.616649 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-45ef4b72-5afb-4fb2-94d7-a13af954821e admin admin] Network hostable DHCP agents. Network: 71038cd4-0600-4b06-91f9-ae7f4f4807f9, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:40:00.618864 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45ef4b72-5afb-4fb2-94d7-a13af954821e admin admin] Pushing event updated for resources: {'Subnet': ['ID=12d97cfc-9264-49cb-8e47-fd225cb6d30b,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:00.650219 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-15251cf9-e5e8-4139-8c48-0949240fad84 None None] Set router bf1205e6-b4d1-485d-b2f3-3ea9a434d27e gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:40:00.779343 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-967f0253-a7ff-4f9c-a8a3-c7526ee62bc2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Port': ['ID=e8eec1d3-ade1-4e88-9005-7833645e5705,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:00.779926 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c793ded2-2e0a-4bfa-8bbe-ea21b4baedfd admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:00.785594 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-e21c805b-f6dd-491a-a629-c17f12181eba admin admin] Deleting subnet 12b57eb6-5bed-4a5e-b2a3-38e67792abc0 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:40:00.788673 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3677131e-625c-4069-badd-f86426744939 admin admin] Pushing event deleted for resources: {'Network': ['ID=a71f32bb-6d3a-4295-a0cb-027407f942be,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:00.807262 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-229f6b62-5fe4-4d45-acf2-644f47191b33 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:00.811857 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e21c805b-f6dd-491a-a629-c17f12181eba admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:00.834184 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0e1739ec-6763-48e8-8802-91aba4836b82 None None] Network 06ebb5fc-e0f4-4630-93c4-509954a9e0b0 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:00.843736 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-45ef4b72-5afb-4fb2-94d7-a13af954821e admin admin] Network 71038cd4-0600-4b06-91f9-ae7f4f4807f9 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:40:00.860934 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-45ef4b72-5afb-4fb2-94d7-a13af954821e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 71038cd4-0600-4b06-91f9-ae7f4f4807f9) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:00.888103 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-45ef4b72-5afb-4fb2-94d7-a13af954821e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:00.888741 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-45ef4b72-5afb-4fb2-94d7-a13af954821e admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:00.892560 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-feacfcba-aa44-4d41-8cd0-6c589ec2e0a5 None None] Network 71038cd4-0600-4b06-91f9-ae7f4f4807f9 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:00.936401 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-45ef4b72-5afb-4fb2-94d7-a13af954821e admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 856 time: 2.1007442 Dec 09 21:40:00.944082 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59226) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:00.953841 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-2013763698-router', 'tenant_id': '69d79e96ec1c418aa6c619846f0fe02e', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:00.986896 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-8c50b8fe-0467-4341-b836-13aed5eef7fe tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Allocated IP 172.20.0.3 (f4182a82-fb46-4a98-997f-e7a875730a8e/8a9e717f-5672-430b-b60c-abd3e3f39a5f/3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:40:00.992077 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:00.993328 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:01.000380 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-092312bc-1916-4033-b059-00fd8ddb2eff None None] Provisioning complete for port d7077264-be0e-4f8d-abfb-3566397c1ccb triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:01.000836 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-092312bc-1916-4033-b059-00fd8ddb2eff None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:01.050382 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:01.083669 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4d921fd5-1d8a-488f-bda6-33ea7e0ac932 req-bac073cf-614b-4127-8651-38b5c1135be5 tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/ports?device_id=04a29bbd-d29d-4109-877b-a0cf1fbf9046 HTTP/1.1" status: 200 len: 210 time: 0.1007538 Dec 09 21:40:01.090794 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-c793ded2-2e0a-4bfa-8bbe-ea21b4baedfd admin admin] Deleting port 0ca4bf99-2fc0-4203-9d93-7f254c7af4df {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:40:01.091145 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c793ded2-2e0a-4bfa-8bbe-ea21b4baedfd admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:01.105699 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:01.170188 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-8c50b8fe-0467-4341-b836-13aed5eef7fe tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:01.210471 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port d7077264-be0e-4f8d-abfb-3566397c1ccb, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d7077264-be0e-4f8d-abfb-3566397c1ccb,segment=NetworkSegment(ef2748bc-7ba5-4b81-a9b8-bae847ca5231),segment_id=ef2748bc-7ba5-4b81-a9b8-bae847ca5231)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:01.230854 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-8c50b8fe-0467-4341-b836-13aed5eef7fe tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:01.272347 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af4a5c6a-3762-4fa5-bdf3-348c39bfec69 None None] Network 71038cd4-0600-4b06-91f9-ae7f4f4807f9 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:01.282319 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-15251cf9-e5e8-4139-8c48-0949240fad84 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e', 'name': 'tempest-TaggedBootDevicesTest_v242-485407257-router', 'tenant_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.4'}], 'enable_snat': True}, 'gw_port_id': '0ca4bf99-2fc0-4203-9d93-7f254c7af4df', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:33Z', 'updated_at': '2021-12-09T21:39:57Z', 'revision_number': 5, 'project_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'gw_port': {'id': '0ca4bf99-2fc0-4203-9d93-7f254c7af4df', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:10:14:ff', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 1126, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.4', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:27:33Z', 'updated_at': '2021-12-09T21:27:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:01.307255 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-8c50b8fe-0467-4341-b836-13aed5eef7fe tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Network f4182a82-fb46-4a98-997f-e7a875730a8e is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:40:01.309950 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-229f6b62-5fe4-4d45-acf2-644f47191b33 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:01.322266 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15251cf9-e5e8-4139-8c48-0949240fad84 None None] Checking router: bf1205e6-b4d1-485d-b2f3-3ea9a434d27e for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:40:01.329080 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:01.334260 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c50b8fe-0467-4341-b836-13aed5eef7fe tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Pushing event updated for resources: {'Port': ['ID=3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:01.345540 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-8c50b8fe-0467-4341-b836-13aed5eef7fe tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:01.354707 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-8c50b8fe-0467-4341-b836-13aed5eef7fe tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:40:01.355018 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-229f6b62-5fe4-4d45-acf2-644f47191b33 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:01.388146 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15251cf9-e5e8-4139-8c48-0949240fad84 None None] Routers {'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:40:01.389123 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-15251cf9-e5e8-4139-8c48-0949240fad84 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:39:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['bf1205e6-b4d1-485d-b2f3-3ea9a434d27e'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:01.395120 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e21c805b-f6dd-491a-a629-c17f12181eba admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:01.417933 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-229f6b62-5fe4-4d45-acf2-644f47191b33 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=1e9566e7adb0432e99dd6ed565b1b543&name=default HTTP/1.1" status: 200 len: 3000 time: 0.9675167 Dec 09 21:40:01.420310 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:01.423406 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-229f6b62-5fe4-4d45-acf2-644f47191b33 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88f17cbc-ee87-436a-ab82-ffa71b59c81d,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:01.426095 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59228) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:01.437206 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-c793ded2-2e0a-4bfa-8bbe-ea21b4baedfd admin admin] For port 0ca4bf99-2fc0-4203-9d93-7f254c7af4df, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=0ca4bf99-2fc0-4203-9d93-7f254c7af4df,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:01.437626 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c793ded2-2e0a-4bfa-8bbe-ea21b4baedfd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:01.464558 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-c793ded2-2e0a-4bfa-8bbe-ea21b4baedfd admin admin] Calling delete_port for 0ca4bf99-2fc0-4203-9d93-7f254c7af4df owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:40:01.589234 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-8c50b8fe-0467-4341-b836-13aed5eef7fe tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:01.590209 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-8c50b8fe-0467-4341-b836-13aed5eef7fe tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:01.593904 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=d7077264-be0e-4f8d-abfb-3566397c1ccb,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:01.612227 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e21c805b-f6dd-491a-a629-c17f12181eba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:01.613175 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-15251cf9-e5e8-4139-8c48-0949240fad84 None None] Set router bf1205e6-b4d1-485d-b2f3-3ea9a434d27e gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:40:01.703753 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-8c50b8fe-0467-4341-b836-13aed5eef7fe tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.8750803 Dec 09 21:40:01.741597 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-bb228cf0-0d03-4722-af3b-e696fbb6e3f3 service neutron] Request body: {'port': {'device_id': '04a29bbd-d29d-4109-877b-a0cf1fbf9046', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:01.748944 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-15251cf9-e5e8-4139-8c48-0949240fad84 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e', 'name': 'tempest-TaggedBootDevicesTest_v242-485407257-router', 'tenant_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:33Z', 'updated_at': '2021-12-09T21:40:00Z', 'revision_number': 6, 'project_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:01.755649 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4e2bf4b8-6e94-40b9-ad9a-e9858ec057e6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:01.788649 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-15251cf9-e5e8-4139-8c48-0949240fad84 None None] The sync data for ids ['bf1205e6-b4d1-485d-b2f3-3ea9a434d27e'] in n-d-713301-27 is: [{'id': 'bf1205e6-b4d1-485d-b2f3-3ea9a434d27e', 'name': 'tempest-TaggedBootDevicesTest_v242-485407257-router', 'tenant_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:27:33Z', 'updated_at': '2021-12-09T21:40:00Z', 'revision_number': 6, 'project_id': 'c7a32d3f9ddc4d84b214b72938d8d6bd', 'gw_port_host': None}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:40:01.826378 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-967f0253-a7ff-4f9c-a8a3-c7526ee62bc2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:01.849660 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4e2bf4b8-6e94-40b9-ad9a-e9858ec057e6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:01.870481 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:01.896439 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:01.945972 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c793ded2-2e0a-4bfa-8bbe-ea21b4baedfd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:01.951667 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4e2bf4b8-6e94-40b9-ad9a-e9858ec057e6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:01.954506 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4e2bf4b8-6e94-40b9-ad9a-e9858ec057e6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:01.955964 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4e2bf4b8-6e94-40b9-ad9a-e9858ec057e6 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/88f17cbc-ee87-436a-ab82-ffa71b59c81d HTTP/1.1" status: 204 len: 168 time: 0.4932654 Dec 09 21:40:02.002032 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c793ded2-2e0a-4bfa-8bbe-ea21b4baedfd admin admin] Pushing event deleted for resources: {'Port': ['ID=0ca4bf99-2fc0-4203-9d93-7f254c7af4df,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:02.024681 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d576b2ab-a934-4d83-b81a-ebd48855a4c2 None None] Provisioning complete for port d7077264-be0e-4f8d-abfb-3566397c1ccb triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:02.025319 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d576b2ab-a934-4d83-b81a-ebd48855a4c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:02.028671 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f0b6c9c8-fa2e-468c-80b4-8d9e1dd823cc None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:40:02.075427 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e2bf4b8-6e94-40b9-ad9a-e9858ec057e6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88f17cbc-ee87-436a-ab82-ffa71b59c81d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:02.091249 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c793ded2-2e0a-4bfa-8bbe-ea21b4baedfd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:02.101775 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e21c805b-f6dd-491a-a629-c17f12181eba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:02.138139 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-bb228cf0-0d03-4722-af3b-e696fbb6e3f3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:02.147967 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e21c805b-f6dd-491a-a629-c17f12181eba admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:02.171166 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e21c805b-f6dd-491a-a629-c17f12181eba admin admin] 10.222.0.13 "DELETE /v2.0/subnets/12b57eb6-5bed-4a5e-b2a3-38e67792abc0 HTTP/1.1" status: 204 len: 168 time: 1.5628867 Dec 09 21:40:02.237834 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59236) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:02.324966 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d576b2ab-a934-4d83-b81a-ebd48855a4c2 None None] Provisioning complete for port e8eec1d3-ade1-4e88-9005-7833645e5705 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:02.325441 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d576b2ab-a934-4d83-b81a-ebd48855a4c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:02.398145 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Allocated IP 172.25.3.51 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/4d6d5feb-4ea8-48a8-a767-e7322d78726b) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:40:02.407023 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d576b2ab-a934-4d83-b81a-ebd48855a4c2 None None] Port e8eec1d3-ade1-4e88-9005-7833645e5705 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:40:02.448478 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e21c805b-f6dd-491a-a629-c17f12181eba admin admin] Pushing event deleted for resources: {'Subnet': ['ID=12b57eb6-5bed-4a5e-b2a3-38e67792abc0,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:02.553656 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e66be8e0-9ff7-4f5a-83c4-1996c60adb6e None None] Provisioning complete for port e8eec1d3-ade1-4e88-9005-7833645e5705 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:02.554028 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e66be8e0-9ff7-4f5a-83c4-1996c60adb6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:02.575692 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c793ded2-2e0a-4bfa-8bbe-ea21b4baedfd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:02.584620 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c793ded2-2e0a-4bfa-8bbe-ea21b4baedfd admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:02.619347 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e66be8e0-9ff7-4f5a-83c4-1996c60adb6e None None] Port e8eec1d3-ade1-4e88-9005-7833645e5705 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:40:02.628343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a186df71-18e3-413d-aa4a-b083f5f76a88 req-00aefb62-a519-4658-b67b-8cf2b91238e8 tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:02.631615 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a186df71-18e3-413d-aa4a-b083f5f76a88 req-00aefb62-a519-4658-b67b-8cf2b91238e8 tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/ports?device_id=04a29bbd-d29d-4109-877b-a0cf1fbf9046 HTTP/1.1" status: 200 len: 931 time: 0.3598089 Dec 09 21:40:02.647013 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-967f0253-a7ff-4f9c-a8a3-c7526ee62bc2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:02.725861 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d7077264-be0e-4f8d-abfb-3566397c1ccb up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:40:02.771404 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c793ded2-2e0a-4bfa-8bbe-ea21b4baedfd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:02.771978 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c793ded2-2e0a-4bfa-8bbe-ea21b4baedfd admin admin] Fanout notify agent at l3_agent the message router_deleted on router bf1205e6-b4d1-485d-b2f3-3ea9a434d27e {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:40:02.779238 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c793ded2-2e0a-4bfa-8bbe-ea21b4baedfd admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:02.781547 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c4459f68-3199-4485-b973-23bdaabd2c77 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:02.784020 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c793ded2-2e0a-4bfa-8bbe-ea21b4baedfd admin admin] 10.222.0.13 "DELETE /v2.0/routers/bf1205e6-b4d1-485d-b2f3-3ea9a434d27e HTTP/1.1" status: 204 len: 168 time: 2.6113176 Dec 09 21:40:02.788810 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:02.790105 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59248) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:02.813043 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-653e2276-b2ec-44cd-ab58-eace933ba8fc None None] Provisioning complete for port e8eec1d3-ade1-4e88-9005-7833645e5705 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:02.813214 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-653e2276-b2ec-44cd-ab58-eace933ba8fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:02.878160 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port d7077264-be0e-4f8d-abfb-3566397c1ccb triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:02.878532 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:02.885664 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-2c5e1d0d-abd6-4b02-9682-84b96a8d481e admin admin] Deleting subnet 549d348b-5c92-4b49-aa63-dbd8d0a93c5c {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:40:02.891189 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2c5e1d0d-abd6-4b02-9682-84b96a8d481e admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:02.948066 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2c5e1d0d-abd6-4b02-9682-84b96a8d481e admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:02.997477 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-653e2276-b2ec-44cd-ab58-eace933ba8fc None None] Port e8eec1d3-ade1-4e88-9005-7833645e5705 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:40:03.011070 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a186df71-18e3-413d-aa4a-b083f5f76a88 req-cbf007e1-d57f-4ab2-a6ca-7206b177a5d3 tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/security-groups?id=e060d354-4177-4c8e-8083-b0266b57b04e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3055630 Dec 09 21:40:03.019572 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1df316e8-64c6-40b7-8e17-aacda0136bbb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:03.081435 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:40:03.099332 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2c5e1d0d-abd6-4b02-9682-84b96a8d481e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:03.139753 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:03.142149 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 21963cc5-b64c-44cd-847e-fb5f82ccd3f9 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:40:03.206114 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:40:03.221173 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:03.226937 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:40:03.306980 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Pushing event updated for resources: {'Port': ['ID=4d6d5feb-4ea8-48a8-a767-e7322d78726b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:03.328095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:03.328450 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:03.328789 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:03.329338 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:03.329797 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:03.330075 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:03.330411 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:03.330957 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:03.331322 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:03.331808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:03.332065 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:03.332393 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:03.332721 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:03.339622 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2c5e1d0d-abd6-4b02-9682-84b96a8d481e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:03.411412 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c5e1d0d-abd6-4b02-9682-84b96a8d481e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=549d348b-5c92-4b49-aa63-dbd8d0a93c5c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:03.435737 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-13ef081a-89c4-4d83-8a46-560b04356cb7 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:40:03.453184 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2c5e1d0d-abd6-4b02-9682-84b96a8d481e admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:03.459601 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2c5e1d0d-abd6-4b02-9682-84b96a8d481e admin admin] 10.222.0.13 "DELETE /v2.0/subnets/549d348b-5c92-4b49-aa63-dbd8d0a93c5c HTTP/1.1" status: 204 len: 168 time: 0.6660039 Dec 09 21:40:03.460235 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59266) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:03.483475 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-938a8e9e-3e5e-4e29-817b-58acfc797cc9 None None] Network 59e2b0d9-72ce-453d-a928-6c19b34a60c9 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:03.489038 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 21963cc5-b64c-44cd-847e-fb5f82ccd3f9 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:40:03.489403 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 21963cc5-b64c-44cd-847e-fb5f82ccd3f9 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:40:03.629528 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-604e1edb-ec33-4665-8e91-a1a1b97dfad7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:03.683032 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8ebcbb60-5961-446e-be88-b450c11ef98e None None] Provisioning complete for port 4d6d5feb-4ea8-48a8-a767-e7322d78726b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:03.683412 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8ebcbb60-5961-446e-be88-b450c11ef98e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:03.755332 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-8ebcbb60-5961-446e-be88-b450c11ef98e None None] Port 4d6d5feb-4ea8-48a8-a767-e7322d78726b cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:40:03.805464 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:03.828787 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-967f0253-a7ff-4f9c-a8a3-c7526ee62bc2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:03.847563 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-967f0253-a7ff-4f9c-a8a3-c7526ee62bc2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:03.863853 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9a177669-08de-442a-9692-bcfc1d060bcd None None] DHCP port deletion for 59e2b0d9-72ce-453d-a928-6c19b34a60c9 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:40:03.926135 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-967f0253-a7ff-4f9c-a8a3-c7526ee62bc2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Port': ['ID=e8eec1d3-ade1-4e88-9005-7833645e5705,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:04.029356 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0ca4bf99-2fc0-4203-9d93-7f254c7af4df no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:40:04.053518 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c4459f68-3199-4485-b973-23bdaabd2c77 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:04.086158 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9a177669-08de-442a-9692-bcfc1d060bcd None None] Deleting port f465eaff-f85c-43ee-8cce-e6a6b7924ac1 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:40:04.086539 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9a177669-08de-442a-9692-bcfc1d060bcd None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:04.088456 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 0ca4bf99-2fc0-4203-9d93-7f254c7af4df {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:40:04.088786 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0ca4bf99-2fc0-4203-9d93-7f254c7af4df not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:40:04.098604 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-c4459f68-3199-4485-b973-23bdaabd2c77 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1449cd60-9b94-4b25-a551-c1e66610232e']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:04.099632 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f465eaff-f85c-43ee-8cce-e6a6b7924ac1 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:40:04.113682 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-967f0253-a7ff-4f9c-a8a3-c7526ee62bc2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:04.136420 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-c4459f68-3199-4485-b973-23bdaabd2c77 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '67e6119c-4e9a-41d7-9c8b-42b30eebd14a') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:04.137011 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-c4459f68-3199-4485-b973-23bdaabd2c77 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '67e6119c-4e9a-41d7-9c8b-42b30eebd14a') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:04.182350 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c4459f68-3199-4485-b973-23bdaabd2c77 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:04.237220 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-bb228cf0-0d03-4722-af3b-e696fbb6e3f3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:40:04.289520 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-9a177669-08de-442a-9692-bcfc1d060bcd None None] For port f465eaff-f85c-43ee-8cce-e6a6b7924ac1, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f465eaff-f85c-43ee-8cce-e6a6b7924ac1,segment=NetworkSegment(b277bb60-9cde-4512-80aa-21951c30630a),segment_id=b277bb60-9cde-4512-80aa-21951c30630a)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:04.289928 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9a177669-08de-442a-9692-bcfc1d060bcd None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:04.301898 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-bb228cf0-0d03-4722-af3b-e696fbb6e3f3 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:04.305922 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9a177669-08de-442a-9692-bcfc1d060bcd None None] Calling delete_port for f465eaff-f85c-43ee-8cce-e6a6b7924ac1 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:40:04.316234 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c4459f68-3199-4485-b973-23bdaabd2c77 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:04.332733 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c4459f68-3199-4485-b973-23bdaabd2c77 admin admin] Releasing vlan 140 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:40:04.332848 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c4459f68-3199-4485-b973-23bdaabd2c77 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:40:04.335085 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:40:04.413885 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:04.467875 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port f465eaff-f85c-43ee-8cce-e6a6b7924ac1, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f465eaff-f85c-43ee-8cce-e6a6b7924ac1,segment=NetworkSegment(b277bb60-9cde-4512-80aa-21951c30630a),segment_id=b277bb60-9cde-4512-80aa-21951c30630a)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:04.475893 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:04.480148 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-967f0253-a7ff-4f9c-a8a3-c7526ee62bc2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network 06ebb5fc-e0f4-4630-93c4-509954a9e0b0 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:40:04.484205 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-967f0253-a7ff-4f9c-a8a3-c7526ee62bc2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:04.501377 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-bb228cf0-0d03-4722-af3b-e696fbb6e3f3 service neutron] Transition to ACTIVE for port object 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:40:04.503634 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c4459f68-3199-4485-b973-23bdaabd2c77 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:04.507826 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-604e1edb-ec33-4665-8e91-a1a1b97dfad7 admin admin] Deleting port f465eaff-f85c-43ee-8cce-e6a6b7924ac1 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:40:04.508617 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-604e1edb-ec33-4665-8e91-a1a1b97dfad7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:04.523012 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9a177669-08de-442a-9692-bcfc1d060bcd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:04.565092 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a177669-08de-442a-9692-bcfc1d060bcd None None] No DVR routers for this DVR port f465eaff-f85c-43ee-8cce-e6a6b7924ac1 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:40:04.593878 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c4459f68-3199-4485-b973-23bdaabd2c77 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:04.600611 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=f465eaff-f85c-43ee-8cce-e6a6b7924ac1,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:04.629109 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c4459f68-3199-4485-b973-23bdaabd2c77 admin admin] 10.222.0.13 "DELETE /v2.0/networks/1449cd60-9b94-4b25-a551-c1e66610232e HTTP/1.1" status: 204 len: 168 time: 2.3641059 Dec 09 21:40:04.668273 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a177669-08de-442a-9692-bcfc1d060bcd None None] Pushing event deleted for resources: {'Port': ['ID=f465eaff-f85c-43ee-8cce-e6a6b7924ac1,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:04.675830 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-bb228cf0-0d03-4722-af3b-e696fbb6e3f3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:04.683127 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4459f68-3199-4485-b973-23bdaabd2c77 admin admin] Pushing event deleted for resources: {'Network': ['ID=1449cd60-9b94-4b25-a551-c1e66610232e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:04.767191 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb228cf0-0d03-4722-af3b-e696fbb6e3f3 service neutron] Pushing event updated for resources: {'Port': ['ID=3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:04.781653 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:04.894038 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f2e192d7-01a6-42a1-885d-8570de882e5c None None] Provisioning complete for port e8eec1d3-ade1-4e88-9005-7833645e5705 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:04.894038 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f2e192d7-01a6-42a1-885d-8570de882e5c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:04.952513 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59360) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:04.978919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f2e192d7-01a6-42a1-885d-8570de882e5c None None] Port e8eec1d3-ade1-4e88-9005-7833645e5705 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:40:05.004866 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdfe886e-ff0e-453d-b12c-bac08d2c241d req-f7828503-bde9-41e5-9bb1-631b2714d5ef tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:05.012921 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fdfe886e-ff0e-453d-b12c-bac08d2c241d req-f7828503-bde9-41e5-9bb1-631b2714d5ef tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/ports?device_id=04a29bbd-d29d-4109-877b-a0cf1fbf9046 HTTP/1.1" status: 200 len: 931 time: 0.5909050 Dec 09 21:40:05.030741 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-604e1edb-ec33-4665-8e91-a1a1b97dfad7 admin admin] For port f465eaff-f85c-43ee-8cce-e6a6b7924ac1, host n-d-713301-27, got binding levels [] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:05.031112 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-604e1edb-ec33-4665-8e91-a1a1b97dfad7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:05.033047 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59362) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:05.052973 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-604e1edb-ec33-4665-8e91-a1a1b97dfad7 admin admin] Calling delete_port for f465eaff-f85c-43ee-8cce-e6a6b7924ac1 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:40:05.059036 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.ipam_backend_mixin [None req-604e1edb-ec33-4665-8e91-a1a1b97dfad7 admin admin] Port f465eaff-f85c-43ee-8cce-e6a6b7924ac1 was not found and therefore no delete operation was performed {{(pid=103438) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 09 21:40:05.066420 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-bb228cf0-0d03-4722-af3b-e696fbb6e3f3 service neutron] Attempting to bind port 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:05.066776 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-bb228cf0-0d03-4722-af3b-e696fbb6e3f3 service neutron] Attempting to bind port 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '563bc4db-400a-4e89-baf0-c14fd72fdac2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'f4182a82-fb46-4a98-997f-e7a875730a8e'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:05.067500 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-bb228cf0-0d03-4722-af3b-e696fbb6e3f3 service neutron] Attempting to bind port 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a on network f4182a82-fb46-4a98-997f-e7a875730a8e {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:05.070507 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-604e1edb-ec33-4665-8e91-a1a1b97dfad7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:05.073340 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-967f0253-a7ff-4f9c-a8a3-c7526ee62bc2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Router 56d27d58-8d2b-4901-9065-eea963d17d36 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:40:05.080399 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d180e771-9163-44a7-bcf0-97eb4da8f052 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ec2fddf1ed684b7e8c8deb49d8c06a18&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1236920 Dec 09 21:40:05.080399 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-bb228cf0-0d03-4722-af3b-e696fbb6e3f3 service neutron] Port 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a on network f4182a82-fb46-4a98-997f-e7a875730a8e not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:05.080399 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-bb228cf0-0d03-4722-af3b-e696fbb6e3f3 service neutron] Attempting to bind port 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a on network f4182a82-fb46-4a98-997f-e7a875730a8e {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:05.084578 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59366) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:05.102447 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-bb228cf0-0d03-4722-af3b-e696fbb6e3f3 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 39, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:40:05.102820 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-bb228cf0-0d03-4722-af3b-e696fbb6e3f3 service neutron] Checking segment: {'id': '563bc4db-400a-4e89-baf0-c14fd72fdac2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'f4182a82-fb46-4a98-997f-e7a875730a8e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:40:05.103168 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-bb228cf0-0d03-4722-af3b-e696fbb6e3f3 service neutron] Bound using segment: {'id': '563bc4db-400a-4e89-baf0-c14fd72fdac2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'f4182a82-fb46-4a98-997f-e7a875730a8e'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:40:05.103672 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-bb228cf0-0d03-4722-af3b-e696fbb6e3f3 service neutron] Bound port: 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '563bc4db-400a-4e89-baf0-c14fd72fdac2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'f4182a82-fb46-4a98-997f-e7a875730a8e'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:40:05.104067 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-bb228cf0-0d03-4722-af3b-e696fbb6e3f3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:05.109039 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-604e1edb-ec33-4665-8e91-a1a1b97dfad7 admin admin] No DVR routers for this DVR port f465eaff-f85c-43ee-8cce-e6a6b7924ac1 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:40:05.150410 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-604e1edb-ec33-4665-8e91-a1a1b97dfad7 admin admin] Pushing event deleted for resources: {'Port': ['ID=f465eaff-f85c-43ee-8cce-e6a6b7924ac1,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:05.227737 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fdfe886e-ff0e-453d-b12c-bac08d2c241d req-2a6f9df4-684c-4776-a385-0c21f6bd7863 tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/security-groups?id=e060d354-4177-4c8e-8083-b0266b57b04e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2097590 Dec 09 21:40:05.265227 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de97329d-d78b-40a7-a6e0-a69543785742 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:05.280013 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-604e1edb-ec33-4665-8e91-a1a1b97dfad7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:05.305404 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e4234502-8c68-4844-8436-acf2f48d3f01 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:05.308588 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-604e1edb-ec33-4665-8e91-a1a1b97dfad7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['59e2b0d9-72ce-453d-a928-6c19b34a60c9']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:05.322219 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-604e1edb-ec33-4665-8e91-a1a1b97dfad7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b277bb60-9cde-4512-80aa-21951c30630a') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:05.322546 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-604e1edb-ec33-4665-8e91-a1a1b97dfad7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b277bb60-9cde-4512-80aa-21951c30630a') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:05.335104 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-967f0253-a7ff-4f9c-a8a3-c7526ee62bc2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:40:05.335691 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-604e1edb-ec33-4665-8e91-a1a1b97dfad7 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:05.341712 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-bb228cf0-0d03-4722-af3b-e696fbb6e3f3 service neutron] For port 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:40:05.347863 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-967f0253-a7ff-4f9c-a8a3-c7526ee62bc2 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "PUT /v2.0/routers/56d27d58-8d2b-4901-9065-eea963d17d36/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.2139738 Dec 09 21:40:05.354995 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-604e1edb-ec33-4665-8e91-a1a1b97dfad7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:05.357534 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59368) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:05.359066 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01172cbe-5c67-461c-839e-27d262861fe2 None None] Sync routers for ids ['56d27d58-8d2b-4901-9065-eea963d17d36'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:40:05.374428 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01172cbe-5c67-461c-839e-27d262861fe2 None None] Routers {'56d27d58-8d2b-4901-9065-eea963d17d36'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:40:05.375002 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-01172cbe-5c67-461c-839e-27d262861fe2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:39:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['56d27d58-8d2b-4901-9065-eea963d17d36'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:05.377572 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-604e1edb-ec33-4665-8e91-a1a1b97dfad7 admin admin] Releasing vlan 116 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:40:05.377996 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-604e1edb-ec33-4665-8e91-a1a1b97dfad7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:40:05.380164 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:40:05.382213 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-bb228cf0-0d03-4722-af3b-e696fbb6e3f3 service neutron] For port 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a,segment=NetworkSegment(563bc4db-400a-4e89-baf0-c14fd72fdac2),segment_id=563bc4db-400a-4e89-baf0-c14fd72fdac2)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:40:05.387697 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e4234502-8c68-4844-8436-acf2f48d3f01 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:05.392332 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Router 9c4c11de-65ec-4b4c-b697-aa53f60d18e2 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:40:05.420322 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-bb228cf0-0d03-4722-af3b-e696fbb6e3f3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:05.443723 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-01172cbe-5c67-461c-839e-27d262861fe2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:05.452399 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01172cbe-5c67-461c-839e-27d262861fe2 None None] Routers {'56d27d58-8d2b-4901-9065-eea963d17d36'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:40:05.453005 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-01172cbe-5c67-461c-839e-27d262861fe2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:39:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['56d27d58-8d2b-4901-9065-eea963d17d36'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:05.486806 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-01172cbe-5c67-461c-839e-27d262861fe2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:05.487754 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01172cbe-5c67-461c-839e-27d262861fe2 None None] The sync data for ids ['56d27d58-8d2b-4901-9065-eea963d17d36'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:40:05.504605 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-604e1edb-ec33-4665-8e91-a1a1b97dfad7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:05.508425 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-bb228cf0-0d03-4722-af3b-e696fbb6e3f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:05.509054 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-bb228cf0-0d03-4722-af3b-e696fbb6e3f3 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:05.510455 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-bb228cf0-0d03-4722-af3b-e696fbb6e3f3 service neutron] 10.222.0.10 "PUT /v2.0/ports/3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a HTTP/1.1" status: 200 len: 1092 time: 3.7733779 Dec 09 21:40:05.512973 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '04a29bbd-d29d-4109-877b-a0cf1fbf9046', 'tag': '3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:40:05.515195 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-51c4d289-8c81-410f-ba6b-e115c4cb9174" -d '{"events": [{"name": "network-changed", "server_uuid": "04a29bbd-d29d-4109-877b-a0cf1fbf9046", "tag": "3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:40:05.517157 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-604e1edb-ec33-4665-8e91-a1a1b97dfad7 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:05.523246 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-604e1edb-ec33-4665-8e91-a1a1b97dfad7 admin admin] 10.222.0.13 "DELETE /v2.0/networks/59e2b0d9-72ce-453d-a928-6c19b34a60c9 HTTP/1.1" status: 204 len: 168 time: 2.0589855 Dec 09 21:40:05.583749 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3ed3cf8d-0b0b-4269-8b97-62c8675ef56c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:05.617055 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de97329d-d78b-40a7-a6e0-a69543785742 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:05.618639 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-604e1edb-ec33-4665-8e91-a1a1b97dfad7 admin admin] Pushing event deleted for resources: {'Network': ['ID=59e2b0d9-72ce-453d-a928-6c19b34a60c9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:05.619717 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:40:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c0a739ad-3bb1-4973-adc2-60529cdb8705 x-openstack-request-id: req-c0a739ad-3bb1-4973-adc2-60529cdb8705 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:40:05.620299 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "04a29bbd-d29d-4109-877b-a0cf1fbf9046", "tag": "3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:40:05.620754 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c0a739ad-3bb1-4973-adc2-60529cdb8705 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:40:05.625505 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '04a29bbd-d29d-4109-877b-a0cf1fbf9046', 'tag': '3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a', 'status': 'completed', 'code': 200} Dec 09 21:40:05.639842 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7e4db23-a67b-4648-9d1c-a17fa67a89cb tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:05.645782 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e7e4db23-a67b-4648-9d1c-a17fa67a89cb tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports?device_id=56d27d58-8d2b-4901-9065-eea963d17d36 HTTP/1.1" status: 200 len: 982 time: 0.2784665 Dec 09 21:40:05.660296 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59374) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:05.661014 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb228cf0-0d03-4722-af3b-e696fbb6e3f3 service neutron] Pushing event updated for resources: {'Port': ['ID=3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:05.671469 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de97329d-d78b-40a7-a6e0-a69543785742 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:05.714691 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:40:05.730425 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] Sync routers for ids ['9c4c11de-65ec-4b4c-b697-aa53f60d18e2'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:40:05.738778 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:05.740517 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-60635565-d592-4d14-9df9-e8d82d1d42d2 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 930 time: 4.7952135 Dec 09 21:40:05.743265 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59376) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:05.748633 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] Routers {'9c4c11de-65ec-4b4c-b697-aa53f60d18e2'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:40:05.749606 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:40:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9c4c11de-65ec-4b4c-b697-aa53f60d18e2'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:05.751831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59378) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:05.756005 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e4234502-8c68-4844-8436-acf2f48d3f01 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:05.758549 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e4234502-8c68-4844-8436-acf2f48d3f01 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:05.762061 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e4234502-8c68-4844-8436-acf2f48d3f01 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/8ee4757d-9f67-4d3c-994b-59905d6c5b2b HTTP/1.1" status: 204 len: 168 time: 0.6742887 Dec 09 21:40:05.833803 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-de97329d-d78b-40a7-a6e0-a69543785742 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=b2f97d082fa342c5822e6ceb9eb994ec&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7912192 Dec 09 21:40:05.836731 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59384) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:05.842471 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de97329d-d78b-40a7-a6e0-a69543785742 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bca5f529-d6ce-4708-bf9e-9af7b45ea625,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:05.856119 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-886ac314-3d6b-417a-85fa-dac3fb011b4c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:05.860214 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-886ac314-3d6b-417a-85fa-dac3fb011b4c service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=57607f00f2d942f4b6f084f9e9a9493a&device_id=04a29bbd-d29d-4109-877b-a0cf1fbf9046 HTTP/1.1" status: 200 len: 1095 time: 0.2650266 Dec 09 21:40:05.889870 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4234502-8c68-4844-8436-acf2f48d3f01 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8ee4757d-9f67-4d3c-994b-59905d6c5b2b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:05.917969 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e447f3f9-e994-433e-9133-b69ef8e04181 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=0a5d0e4652be4d8b87936a559840cc87&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1635334 Dec 09 21:40:05.923407 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59386) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:05.941184 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-389bd61c-dc2b-4c63-a194-dc1f0af02277 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a HTTP/1.1" status: 200 len: 217 time: 0.0666115 Dec 09 21:40:05.947905 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] Set router 9c4c11de-65ec-4b4c-b697-aa53f60d18e2 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:40:06.094080 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-aa01c1e2-6b2a-4d23-9883-7d2dc2b0fdbe admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:06.102213 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-b54cc89a-a6f5-49a8-8d83-870085d29fea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:06.103675 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-b54cc89a-a6f5-49a8-8d83-870085d29fea service neutron] 10.222.0.10 "GET /v2.0/subnets?id=8a9e717f-5672-430b-b60c-abd3e3f39a5f HTTP/1.1" status: 200 len: 853 time: 0.1548254 Dec 09 21:40:06.128621 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-691160ea-4acf-4217-b3da-04ab3b4ffbc8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:06.187085 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-af7fee04-3dd9-4b5a-80b0-144e88b141cd service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=f4182a82-fb46-4a98-997f-e7a875730a8e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0482357 Dec 09 21:40:06.190197 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-aa01c1e2-6b2a-4d23-9883-7d2dc2b0fdbe admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:06.235691 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-691160ea-4acf-4217-b3da-04ab3b4ffbc8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:06.249958 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c4c11de-65ec-4b4c-b697-aa53f60d18e2', 'name': 'tempest-ServerRescueNegativeTestJSON-2013763698-router', 'tenant_id': '69d79e96ec1c418aa6c619846f0fe02e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.51'}], 'enable_snat': True}, 'gw_port_id': '4d6d5feb-4ea8-48a8-a767-e7322d78726b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:40:00Z', 'updated_at': '2021-12-09T21:40:03Z', 'revision_number': 3, 'project_id': '69d79e96ec1c418aa6c619846f0fe02e', 'gw_port': {'id': '4d6d5feb-4ea8-48a8-a767-e7322d78726b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:82:b2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c4c11de-65ec-4b4c-b697-aa53f60d18e2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2459, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:40:01Z', 'updated_at': '2021-12-09T21:40:02Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:06.326873 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] Checking router: 9c4c11de-65ec-4b4c-b697-aa53f60d18e2 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:40:06.327574 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] Updating router 9c4c11de-65ec-4b4c-b697-aa53f60d18e2 port 4d6d5feb-4ea8-48a8-a767-e7322d78726b binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:40:06.368626 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:06.413007 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-20b7755e-6acd-4d33-a75f-73d75d8c354f service neutron] 10.222.0.10 "GET /v2.0/networks/f4182a82-fb46-4a98-997f-e7a875730a8e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2178607 Dec 09 21:40:06.447869 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-aa01c1e2-6b2a-4d23-9883-7d2dc2b0fdbe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:06.450598 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-aa01c1e2-6b2a-4d23-9883-7d2dc2b0fdbe admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:06.451806 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-aa01c1e2-6b2a-4d23-9883-7d2dc2b0fdbe admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/bca5f529-d6ce-4708-bf9e-9af7b45ea625 HTTP/1.1" status: 204 len: 168 time: 0.6140380 Dec 09 21:40:06.510095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa01c1e2-6b2a-4d23-9883-7d2dc2b0fdbe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bca5f529-d6ce-4708-bf9e-9af7b45ea625,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:06.523843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59396) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:06.604662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8f2db1-2021-4484-9036-d6b831185ddd req-991fc008-0c85-4b5b-8f10-8c86bf4e309e tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:06.606936 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4a8f2db1-2021-4484-9036-d6b831185ddd req-991fc008-0c85-4b5b-8f10-8c86bf4e309e tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/ports?device_id=04a29bbd-d29d-4109-877b-a0cf1fbf9046 HTTP/1.1" status: 200 len: 943 time: 0.2121084 Dec 09 21:40:06.607213 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aad74afc-8c6d-4ddb-a916-b71dcecb1b08 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:06.647389 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-691160ea-4acf-4217-b3da-04ab3b4ffbc8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:06.650045 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-691160ea-4acf-4217-b3da-04ab3b4ffbc8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:06.651181 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-691160ea-4acf-4217-b3da-04ab3b4ffbc8 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/ae1d5335-d417-46c6-9564-e81ad355759f HTTP/1.1" status: 204 len: 168 time: 0.7251291 Dec 09 21:40:06.677631 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-691160ea-4acf-4217-b3da-04ab3b4ffbc8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ae1d5335-d417-46c6-9564-e81ad355759f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:06.687670 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:06.701778 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0da1ed7d-1422-4f19-b982-0d54d815178f admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=043e580fa3c545cdab2b7168775a5759&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1689637 Dec 09 21:40:06.702186 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59402) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:06.889016 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0afd4d7d-77da-4c7d-949b-d31a3eaf471d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:06.916399 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0afd4d7d-77da-4c7d-949b-d31a3eaf471d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:06.920897 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:06.935392 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:06.974080 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4a8f2db1-2021-4484-9036-d6b831185ddd req-65d833e5-9b5e-49da-b501-ecc654c26904 tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/security-groups?id=e060d354-4177-4c8e-8083-b0266b57b04e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3468935 Dec 09 21:40:06.978172 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0afd4d7d-77da-4c7d-949b-d31a3eaf471d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:06.994002 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0afd4d7d-77da-4c7d-949b-d31a3eaf471d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:07.003746 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0afd4d7d-77da-4c7d-949b-d31a3eaf471d admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/f44224f1-aa35-4d98-8069-cb8eef82c01b HTTP/1.1" status: 204 len: 168 time: 0.2953897 Dec 09 21:40:07.022709 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0afd4d7d-77da-4c7d-949b-d31a3eaf471d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f44224f1-aa35-4d98-8069-cb8eef82c01b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:07.031264 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7cdc384d-ae36-42ee-b00f-0a7794bcd5af None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:40:07.061289 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] Attempting to bind port 4d6d5feb-4ea8-48a8-a767-e7322d78726b on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:07.061661 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] Attempting to bind port 4d6d5feb-4ea8-48a8-a767-e7322d78726b by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:07.062025 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] Attempting to bind port 4d6d5feb-4ea8-48a8-a767-e7322d78726b on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:07.097812 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41a7182b-7eac-4778-a476-0fe7c9841792 None None] Pushing event updated for resources: {'Port': ['ID=4d6d5feb-4ea8-48a8-a767-e7322d78726b,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:07.100038 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f626ae89-115c-4c5e-94c7-60d928ea53a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:07.117799 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 39, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:40:07.118720 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:40:07.119189 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:07.120236 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:40:07.120747 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] Bound port: 4d6d5feb-4ea8-48a8-a767-e7322d78726b, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:40:07.121135 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:07.141241 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-caec819e-3527-4f5c-a6bc-5afdda12d52f req-05b21248-2971-4b7b-b0ae-2616cf357bd0 service neutron] 10.222.0.10 "GET /v2.0/networks/f4182a82-fb46-4a98-997f-e7a875730a8e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7180603 Dec 09 21:40:07.270772 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] For port 4d6d5feb-4ea8-48a8-a767-e7322d78726b, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:40:07.277262 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] For port 4d6d5feb-4ea8-48a8-a767-e7322d78726b, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=4d6d5feb-4ea8-48a8-a767-e7322d78726b,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:40:07.297282 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:07.372628 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59414) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:07.441268 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51c4d289-8c81-410f-ba6b-e115c4cb9174 req-12e1f98c-82f4-46be-908b-7a5b5ad521de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:07.449993 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-51c4d289-8c81-410f-ba6b-e115c4cb9174 req-12e1f98c-82f4-46be-908b-7a5b5ad521de service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=57607f00f2d942f4b6f084f9e9a9493a&device_id=04a29bbd-d29d-4109-877b-a0cf1fbf9046 HTTP/1.1" status: 200 len: 1095 time: 0.1935256 Dec 09 21:40:07.452580 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2dbe436b-024e-49e2-ba63-89833fe0c654 None None] Provisioning complete for port 4d6d5feb-4ea8-48a8-a767-e7322d78726b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:07.452957 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2dbe436b-024e-49e2-ba63-89833fe0c654 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:07.574993 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-f626ae89-115c-4c5e-94c7-60d928ea53a6 admin admin] Allocated IP 172.20.0.1 (71038cd4-0600-4b06-91f9-ae7f4f4807f9/12d97cfc-9264-49cb-8e47-fd225cb6d30b/c147a416-ff0a-4bae-9503-ebf0727fc69d) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:40:07.610697 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51c4d289-8c81-410f-ba6b-e115c4cb9174 req-8791f1fd-91dc-466e-81ce-2024d94bc124 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:07.612163 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a39c4337-00a6-46fb-a3eb-dcb84df5c324 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:40:07.614906 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-51c4d289-8c81-410f-ba6b-e115c4cb9174 req-8791f1fd-91dc-466e-81ce-2024d94bc124 service neutron] 10.222.0.10 "GET /v2.0/networks?id=f4182a82-fb46-4a98-997f-e7a875730a8e HTTP/1.1" status: 200 len: 914 time: 0.1459727 Dec 09 21:40:07.643747 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] Routers {'9c4c11de-65ec-4b4c-b697-aa53f60d18e2'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:40:07.645691 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:40:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9c4c11de-65ec-4b4c-b697-aa53f60d18e2'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:07.703233 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-51c4d289-8c81-410f-ba6b-e115c4cb9174 req-3be1dcac-eef1-4ce6-997c-f8747229cb6d service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a HTTP/1.1" status: 200 len: 217 time: 0.0693321 Dec 09 21:40:07.813403 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-56b25e82-c88e-4ca4-8df6-d3c5ef12f805 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=c7a32d3f9ddc4d84b214b72938d8d6bd&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4325187 Dec 09 21:40:07.813403 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51c4d289-8c81-410f-ba6b-e115c4cb9174 req-99b8d883-d8a1-43fb-83b7-245393478a35 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:07.815325 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-51c4d289-8c81-410f-ba6b-e115c4cb9174 req-99b8d883-d8a1-43fb-83b7-245393478a35 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=8a9e717f-5672-430b-b60c-abd3e3f39a5f HTTP/1.1" status: 200 len: 853 time: 0.1021585 Dec 09 21:40:07.816046 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59420) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:07.870760 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-51c4d289-8c81-410f-ba6b-e115c4cb9174 req-601bed16-a0dd-4e8f-a1b3-159649af5536 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=f4182a82-fb46-4a98-997f-e7a875730a8e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0455348 Dec 09 21:40:07.890397 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f626ae89-115c-4c5e-94c7-60d928ea53a6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:07.989815 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f626ae89-115c-4c5e-94c7-60d928ea53a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:08.009774 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-51c4d289-8c81-410f-ba6b-e115c4cb9174 req-16ef0673-a561-4b14-819c-0806aa895e3c service neutron] 10.222.0.10 "GET /v2.0/networks/f4182a82-fb46-4a98-997f-e7a875730a8e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1224895 Dec 09 21:40:08.096118 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41a7182b-7eac-4778-a476-0fe7c9841792 None None] Pushing event updated for resources: {'Port': ['ID=4d6d5feb-4ea8-48a8-a767-e7322d78726b,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:08.097440 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f626ae89-115c-4c5e-94c7-60d928ea53a6 admin admin] Network 71038cd4-0600-4b06-91f9-ae7f4f4807f9 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:40:08.098642 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-aad74afc-8c6d-4ddb-a916-b71dcecb1b08 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting port e8eec1d3-ade1-4e88-9005-7833645e5705 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:40:08.098938 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aad74afc-8c6d-4ddb-a916-b71dcecb1b08 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:08.107290 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-f626ae89-115c-4c5e-94c7-60d928ea53a6 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:08.119200 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f626ae89-115c-4c5e-94c7-60d928ea53a6 admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:40:08.170969 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] Set router 9c4c11de-65ec-4b4c-b697-aa53f60d18e2 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:40:08.181204 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:08.189757 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f626ae89-115c-4c5e-94c7-60d928ea53a6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:08.227502 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aad74afc-8c6d-4ddb-a916-b71dcecb1b08 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:08.243740 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-aad74afc-8c6d-4ddb-a916-b71dcecb1b08 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Calling delete_port for e8eec1d3-ade1-4e88-9005-7833645e5705 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:40:08.251045 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f626ae89-115c-4c5e-94c7-60d928ea53a6 admin admin] Pushing event updated for resources: {'Port': ['ID=c147a416-ff0a-4bae-9503-ebf0727fc69d,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:08.432556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c2eaed3-24e8-4b7c-9823-5a868b91a34a req-6f456225-41c6-4729-b3fc-759e4bacce60 tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:08.437636 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c2eaed3-24e8-4b7c-9823-5a868b91a34a req-6f456225-41c6-4729-b3fc-759e4bacce60 tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/ports?device_id=04a29bbd-d29d-4109-877b-a0cf1fbf9046 HTTP/1.1" status: 200 len: 943 time: 0.2441742 Dec 09 21:40:08.450124 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2dbe436b-024e-49e2-ba63-89833fe0c654 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:08.490337 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-474cf296-3f92-4fe0-8035-ddcb1994570a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:08.491974 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aad74afc-8c6d-4ddb-a916-b71dcecb1b08 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:08.505519 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2dbe436b-024e-49e2-ba63-89833fe0c654 None None] For port 4d6d5feb-4ea8-48a8-a767-e7322d78726b, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=4d6d5feb-4ea8-48a8-a767-e7322d78726b,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:08.516434 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2dbe436b-024e-49e2-ba63-89833fe0c654 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:08.551577 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aad74afc-8c6d-4ddb-a916-b71dcecb1b08 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Port': ['ID=e8eec1d3-ade1-4e88-9005-7833645e5705,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:08.583041 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c2eaed3-24e8-4b7c-9823-5a868b91a34a req-6bf6c98d-de74-4a04-a776-fdf356dfebc0 tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/security-groups?id=e060d354-4177-4c8e-8083-b0266b57b04e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1381187 Dec 09 21:40:08.617192 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dbe436b-024e-49e2-ba63-89833fe0c654 None None] Pushing event updated for resources: {'Port': ['ID=4d6d5feb-4ea8-48a8-a767-e7322d78726b,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:08.641166 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f626ae89-115c-4c5e-94c7-60d928ea53a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:08.673257 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c4c11de-65ec-4b4c-b697-aa53f60d18e2', 'name': 'tempest-ServerRescueNegativeTestJSON-2013763698-router', 'tenant_id': '69d79e96ec1c418aa6c619846f0fe02e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.51'}], 'enable_snat': True}, 'gw_port_id': '4d6d5feb-4ea8-48a8-a767-e7322d78726b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:40:00Z', 'updated_at': '2021-12-09T21:40:03Z', 'revision_number': 3, 'project_id': '69d79e96ec1c418aa6c619846f0fe02e', 'gw_port': {'id': '4d6d5feb-4ea8-48a8-a767-e7322d78726b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:82:b2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c4c11de-65ec-4b4c-b697-aa53f60d18e2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2459, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:40:01Z', 'updated_at': '2021-12-09T21:40:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:08.689492 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-474cf296-3f92-4fe0-8035-ddcb1994570a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:08.744602 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8b285d8a-aa30-4833-9d23-89a869769b4e None None] Provisioning complete for port 4d6d5feb-4ea8-48a8-a767-e7322d78726b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:08.744936 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8b285d8a-aa30-4833-9d23-89a869769b4e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:08.802277 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb890980-2f29-4285-88b3-15392f7bdf95 None None] The sync data for ids ['9c4c11de-65ec-4b4c-b697-aa53f60d18e2'] in n-d-713301-27 is: [{'id': '9c4c11de-65ec-4b4c-b697-aa53f60d18e2', 'name': 'tempest-ServerRescueNegativeTestJSON-2013763698-router', 'tenant_id': '69d79e96ec1c418aa6c619846f0fe02e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.51'}], 'enable_snat': True}, 'gw_port_id': '4d6d5feb-4ea8-48a8-a767-e7322d78726b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:40:00Z', 'updated_at': '2021-12-09T21:40:03Z', 'revision_number': 3, 'project_id': '69d79e96ec1c418aa6c619846f0fe02e', 'gw_port': {'id': '4d6d5feb-4ea8-48a8-a767-e7322d78726b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:82:b2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c4c11de-65ec-4b4c-b697-aa53f60d18e2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2459, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:40:01Z', 'updated_at': '2021-12-09T21:40:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:40:08.926885 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-51c4d289-8c81-410f-ba6b-e115c4cb9174 req-4f2e19ed-4297-4488-ad7c-ba47468123fa service neutron] 10.222.0.10 "GET /v2.0/networks/f4182a82-fb46-4a98-997f-e7a875730a8e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.9014039 Dec 09 21:40:08.951633 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aad74afc-8c6d-4ddb-a916-b71dcecb1b08 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:09.062211 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f626ae89-115c-4c5e-94c7-60d928ea53a6 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:09.069214 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f626ae89-115c-4c5e-94c7-60d928ea53a6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:09.172562 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f626ae89-115c-4c5e-94c7-60d928ea53a6 admin admin] Pushing event updated for resources: {'Port': ['ID=c147a416-ff0a-4bae-9503-ebf0727fc69d,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:09.223268 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-474cf296-3f92-4fe0-8035-ddcb1994570a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:09.232419 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-474cf296-3f92-4fe0-8035-ddcb1994570a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:09.241909 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-474cf296-3f92-4fe0-8035-ddcb1994570a admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/6b84f656-3301-4a13-a1de-21553f1e9e68 HTTP/1.1" status: 204 len: 168 time: 1.4213805 Dec 09 21:40:09.264762 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f626ae89-115c-4c5e-94c7-60d928ea53a6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:09.354057 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-474cf296-3f92-4fe0-8035-ddcb1994570a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6b84f656-3301-4a13-a1de-21553f1e9e68,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:09.364255 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aad74afc-8c6d-4ddb-a916-b71dcecb1b08 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Router 56d27d58-8d2b-4901-9065-eea963d17d36 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:40:09.501732 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f626ae89-115c-4c5e-94c7-60d928ea53a6 admin admin] Network 71038cd4-0600-4b06-91f9-ae7f4f4807f9 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:40:09.503474 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-f626ae89-115c-4c5e-94c7-60d928ea53a6 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:09.621048 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aad74afc-8c6d-4ddb-a916-b71dcecb1b08 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:40:09.632883 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4986606-7a50-4e7c-8d17-c58b860f8cb2 None None] Sync routers for ids ['56d27d58-8d2b-4901-9065-eea963d17d36'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:40:09.655909 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4986606-7a50-4e7c-8d17-c58b860f8cb2 None None] Routers {'56d27d58-8d2b-4901-9065-eea963d17d36'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:40:09.656738 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e4986606-7a50-4e7c-8d17-c58b860f8cb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:40:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['56d27d58-8d2b-4901-9065-eea963d17d36'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:09.658564 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-aad74afc-8c6d-4ddb-a916-b71dcecb1b08 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "PUT /v2.0/routers/56d27d58-8d2b-4901-9065-eea963d17d36/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.9823058 Dec 09 21:40:09.661326 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59474) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:09.726257 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-951690c5-8ed6-46a0-be0e-0fb884757a22 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] GET failed (client error): The resource could not be found. Dec 09 21:40:09.726770 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:09.733967 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-951690c5-8ed6-46a0-be0e-0fb884757a22 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports/e8eec1d3-ade1-4e88-9005-7833645e5705 HTTP/1.1" status: 404 len: 333 time: 0.0675159 Dec 09 21:40:09.737502 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59476) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:09.756976 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e4986606-7a50-4e7c-8d17-c58b860f8cb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:09.783845 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4986606-7a50-4e7c-8d17-c58b860f8cb2 None None] Routers {'56d27d58-8d2b-4901-9065-eea963d17d36'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:40:09.785908 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e4986606-7a50-4e7c-8d17-c58b860f8cb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:40:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['56d27d58-8d2b-4901-9065-eea963d17d36'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:09.890488 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e4986606-7a50-4e7c-8d17-c58b860f8cb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:09.896835 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4986606-7a50-4e7c-8d17-c58b860f8cb2 None None] The sync data for ids ['56d27d58-8d2b-4901-9065-eea963d17d36'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:40:09.935335 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02132d4f-7bc0-4f1a-b8d2-48f7eb3761a3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:09.979957 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f626ae89-115c-4c5e-94c7-60d928ea53a6 admin admin] Router 9c4c11de-65ec-4b4c-b697-aa53f60d18e2 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:40:10.011758 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cffe70eb-be93-4b36-8e08-f508bc46d6bd req-ce0a78d6-2c53-4c20-bee1-8c665b36359b tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:10.025872 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cffe70eb-be93-4b36-8e08-f508bc46d6bd req-ce0a78d6-2c53-4c20-bee1-8c665b36359b tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/ports?device_id=04a29bbd-d29d-4109-877b-a0cf1fbf9046 HTTP/1.1" status: 200 len: 943 time: 0.2067914 Dec 09 21:40:10.104125 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 4d6d5feb-4ea8-48a8-a767-e7322d78726b up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:40:10.212369 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 4d6d5feb-4ea8-48a8-a767-e7322d78726b triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:10.212741 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:10.222602 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59492) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:10.307689 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02132d4f-7bc0-4f1a-b8d2-48f7eb3761a3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:10.309964 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02132d4f-7bc0-4f1a-b8d2-48f7eb3761a3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:10.363184 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f626ae89-115c-4c5e-94c7-60d928ea53a6 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:40:10.385141 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02132d4f-7bc0-4f1a-b8d2-48f7eb3761a3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:10.385659 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-02132d4f-7bc0-4f1a-b8d2-48f7eb3761a3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Fanout notify agent at l3_agent the message router_deleted on router 56d27d58-8d2b-4901-9065-eea963d17d36 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:40:10.393474 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02132d4f-7bc0-4f1a-b8d2-48f7eb3761a3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:10.397708 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-02132d4f-7bc0-4f1a-b8d2-48f7eb3761a3 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/routers/56d27d58-8d2b-4901-9065-eea963d17d36 HTTP/1.1" status: 204 len: 168 time: 0.6558347 Dec 09 21:40:10.397806 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59498) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:10.427493 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cffe70eb-be93-4b36-8e08-f508bc46d6bd req-d500be00-dceb-412c-8b71-b14b7fcccffc tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/security-groups?id=e060d354-4177-4c8e-8083-b0266b57b04e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4006841 Dec 09 21:40:10.451125 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f626ae89-115c-4c5e-94c7-60d928ea53a6 admin admin] 10.222.0.13 "PUT /v2.0/routers/9c4c11de-65ec-4b4c-b697-aa53f60d18e2/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.6985490 Dec 09 21:40:10.513933 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-137bedf5-758c-49b0-8925-0f6385eaa188 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting subnet 423f17aa-f4f8-4e49-80d6-5cbbdd88375d {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:40:10.523016 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-137bedf5-758c-49b0-8925-0f6385eaa188 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:10.574012 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:40:10.576718 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-0f12055f-ef82-4109-9d99-e447bc00caa0 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Request body: {'quota': {'network': 2}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:10.601216 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-137bedf5-758c-49b0-8925-0f6385eaa188 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:10.654793 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0f12055f-ef82-4109-9d99-e447bc00caa0 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] 10.222.0.13 "PUT /v2.0/quotas/d1ea86c9a3e0461094318efafa99a9e6 HTTP/1.1" status: 200 len: 368 time: 0.4310501 Dec 09 21:40:10.657983 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59516) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:10.667150 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-22e06141-5dd5-4fe1-82f2-fe15f7eb751e tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Request body: {'network': {'project_id': 'd1ea86c9a3e0461094318efafa99a9e6'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:10.754741 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-22e06141-5dd5-4fe1-82f2-fe15f7eb751e tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Made reservation on behalf of d1ea86c9a3e0461094318efafa99a9e6 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:10.763611 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-22e06141-5dd5-4fe1-82f2-fe15f7eb751e tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:10.775780 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-22e06141-5dd5-4fe1-82f2-fe15f7eb751e tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:10.810995 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-137bedf5-758c-49b0-8925-0f6385eaa188 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:10.880141 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a,segment=NetworkSegment(563bc4db-400a-4e89-baf0-c14fd72fdac2),segment_id=563bc4db-400a-4e89-baf0-c14fd72fdac2)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:10.909500 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a', 'network_id': 'f4182a82-fb46-4a98-997f-e7a875730a8e', 'port_id': '3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a', 'mac_address': 'fa:16:3e:82:13:76', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8a9e717f-5672-430b-b60c-abd3e3f39a5f', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:40:10.928696 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-137bedf5-758c-49b0-8925-0f6385eaa188 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:10.976343 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:10.997402 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-137bedf5-758c-49b0-8925-0f6385eaa188 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:10.998772 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f325b3f-261f-4db9-bbc9-9fd8e55021cb None None] Network 06ebb5fc-e0f4-4630-93c4-509954a9e0b0 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:11.007958 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-137bedf5-758c-49b0-8925-0f6385eaa188 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/subnets/423f17aa-f4f8-4e49-80d6-5cbbdd88375d HTTP/1.1" status: 204 len: 168 time: 0.6091025 Dec 09 21:40:11.008863 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-137bedf5-758c-49b0-8925-0f6385eaa188 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Subnet': ['ID=423f17aa-f4f8-4e49-80d6-5cbbdd88375d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:11.012127 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59532) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:11.061399 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-22e06141-5dd5-4fe1-82f2-fe15f7eb751e tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:11.082123 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-22e06141-5dd5-4fe1-82f2-fe15f7eb751e tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:11.154253 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-22e06141-5dd5-4fe1-82f2-fe15f7eb751e tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] vlan segment allocate from pool success with {'vlan_id': 144, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:40:11.174997 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-22e06141-5dd5-4fe1-82f2-fe15f7eb751e tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:11.175713 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-22e06141-5dd5-4fe1-82f2-fe15f7eb751e tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Added segment 1aa47b27-be70-4791-93f9-946fd1d6233d of type vlan for network 6e3e46f8-567b-42b3-a342-11857fd9c863 Dec 09 21:40:11.176104 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3458b9ef-f140-4fa9-a62f-3984dd8c2935 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:11.259794 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-22e06141-5dd5-4fe1-82f2-fe15f7eb751e tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:11.261364 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-3458b9ef-f140-4fa9-a62f-3984dd8c2935 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting port d7077264-be0e-4f8d-abfb-3566397c1ccb {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:40:11.262258 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3458b9ef-f140-4fa9-a62f-3984dd8c2935 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:11.262371 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22e06141-5dd5-4fe1-82f2-fe15f7eb751e tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1fcce80b-2194-4cd9-a244-9075de806654,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:11.298346 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-22e06141-5dd5-4fe1-82f2-fe15f7eb751e tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:11.299973 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-22e06141-5dd5-4fe1-82f2-fe15f7eb751e tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:11.300861 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-22e06141-5dd5-4fe1-82f2-fe15f7eb751e tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:11.375454 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:40:11.390132 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-22e06141-5dd5-4fe1-82f2-fe15f7eb751e tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 837 time: 0.7306361 Dec 09 21:40:11.391496 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-3458b9ef-f140-4fa9-a62f-3984dd8c2935 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] For port d7077264-be0e-4f8d-abfb-3566397c1ccb, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d7077264-be0e-4f8d-abfb-3566397c1ccb,segment=NetworkSegment(ef2748bc-7ba5-4b81-a9b8-bae847ca5231),segment_id=ef2748bc-7ba5-4b81-a9b8-bae847ca5231)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:11.392279 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3458b9ef-f140-4fa9-a62f-3984dd8c2935 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:11.393365 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59546) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:11.400156 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-84594832-f03e-40b9-a424-32df33935ba3 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Request body: {'network': {'project_id': 'd1ea86c9a3e0461094318efafa99a9e6'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:11.447606 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a,segment=NetworkSegment(563bc4db-400a-4e89-baf0-c14fd72fdac2),segment_id=563bc4db-400a-4e89-baf0-c14fd72fdac2)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:11.455278 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22e06141-5dd5-4fe1-82f2-fe15f7eb751e tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Pushing event updated for resources: {'Network': ['ID=6e3e46f8-567b-42b3-a342-11857fd9c863,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:11.458749 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:11.486614 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-84594832-f03e-40b9-a424-32df33935ba3 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Made reservation on behalf of d1ea86c9a3e0461094318efafa99a9e6 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:11.490086 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-84594832-f03e-40b9-a424-32df33935ba3 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:11.528758 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 6e3e46f8-567b-42b3-a342-11857fd9c863 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:40:11.576717 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-84594832-f03e-40b9-a424-32df33935ba3 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] vlan segment allocate from pool success with {'vlan_id': 140, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:40:11.594169 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-84594832-f03e-40b9-a424-32df33935ba3 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:11.595011 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-84594832-f03e-40b9-a424-32df33935ba3 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Added segment 44e0056c-fd14-44b4-91b5-c16f2d69a8ba of type vlan for network af58721d-10e6-4c77-bec2-5930b1afd3e2 Dec 09 21:40:11.650325 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb6fac03-22ea-4b9c-9cbc-f81832b2a885 None None] DHCP port deletion for 06ebb5fc-e0f4-4630-93c4-509954a9e0b0 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:40:11.661305 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:11.667189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:40:11.675371 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-84594832-f03e-40b9-a424-32df33935ba3 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:11.720884 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-84594832-f03e-40b9-a424-32df33935ba3 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:11.721619 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] Sync routers for ids ['9c4c11de-65ec-4b4c-b697-aa53f60d18e2'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:40:11.722116 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84594832-f03e-40b9-a424-32df33935ba3 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:11.722800 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-84594832-f03e-40b9-a424-32df33935ba3 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:11.761585 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] Routers {'9c4c11de-65ec-4b4c-b697-aa53f60d18e2'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:40:11.764551 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:40:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9c4c11de-65ec-4b4c-b697-aa53f60d18e2'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:11.802113 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84594832-f03e-40b9-a424-32df33935ba3 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Pushing event updated for resources: {'Network': ['ID=af58721d-10e6-4c77-bec2-5930b1afd3e2,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:11.829136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network af58721d-10e6-4c77-bec2-5930b1afd3e2 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:40:11.841040 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-84594832-f03e-40b9-a424-32df33935ba3 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 837 time: 0.4464331 Dec 09 21:40:11.842115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59556) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:11.849537 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-3458b9ef-f140-4fa9-a62f-3984dd8c2935 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Calling delete_port for d7077264-be0e-4f8d-abfb-3566397c1ccb owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:40:11.849726 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ebab39ce-9a1c-4030-ad70-87197cbad618 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Request body: {'network': {'project_id': 'd1ea86c9a3e0461094318efafa99a9e6'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:11.865227 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-ebab39ce-9a1c-4030-ad70-87197cbad618 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] POST failed (client error): There was a conflict when trying to complete your request. Dec 09 21:40:11.865853 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ebab39ce-9a1c-4030-ad70-87197cbad618 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] No notification will be sent due to unsuccessful status code: 409 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:40:11.872346 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59558) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:11.873037 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ebab39ce-9a1c-4030-ad70-87197cbad618 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 409 len: 310 time: 0.0288129 Dec 09 21:40:11.898128 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-eb6fac03-22ea-4b9c-9cbc-f81832b2a885 None None] Deleting port d7077264-be0e-4f8d-abfb-3566397c1ccb {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:40:11.898746 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb6fac03-22ea-4b9c-9cbc-f81832b2a885 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:12.003683 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d7077264-be0e-4f8d-abfb-3566397c1ccb no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:40:12.039541 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c649a34a-9b30-40dc-b063-0312c9444e7c tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=d1ea86c9a3e0461094318efafa99a9e6&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1520956 Dec 09 21:40:12.042333 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59562) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:12.080992 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-73beee3b-0907-48d7-b484-b3b31b06bdbc tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:12.082537 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-73beee3b-0907-48d7-b484-b3b31b06bdbc tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/networks?id=71038cd4-0600-4b06-91f9-ae7f4f4807f9 HTTP/1.1" status: 200 len: 819 time: 0.2344589 Dec 09 21:40:12.110100 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3458b9ef-f140-4fa9-a62f-3984dd8c2935 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:12.140093 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] Set router 9c4c11de-65ec-4b4c-b697-aa53f60d18e2 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:40:12.149367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-eb6fac03-22ea-4b9c-9cbc-f81832b2a885 None None] For port d7077264-be0e-4f8d-abfb-3566397c1ccb, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d7077264-be0e-4f8d-abfb-3566397c1ccb,segment=NetworkSegment(ef2748bc-7ba5-4b81-a9b8-bae847ca5231),segment_id=ef2748bc-7ba5-4b81-a9b8-bae847ca5231)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:12.149814 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb6fac03-22ea-4b9c-9cbc-f81832b2a885 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:12.158442 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-53659961-0ec6-4cd5-92d8-51d1eb18022f tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/quotas/69d79e96ec1c418aa6c619846f0fe02e HTTP/1.1" status: 200 len: 375 time: 0.0613859 Dec 09 21:40:12.172341 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3458b9ef-f140-4fa9-a62f-3984dd8c2935 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Port': ['ID=d7077264-be0e-4f8d-abfb-3566397c1ccb,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:12.177742 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3458b9ef-f140-4fa9-a62f-3984dd8c2935 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] No DVR routers for this DVR port d7077264-be0e-4f8d-abfb-3566397c1ccb on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:40:12.207354 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-eb6fac03-22ea-4b9c-9cbc-f81832b2a885 None None] Calling delete_port for d7077264-be0e-4f8d-abfb-3566397c1ccb owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:40:12.220465 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No active binding found for port d7077264-be0e-4f8d-abfb-3566397c1ccb {{(pid=103439) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:216}} Dec 09 21:40:12.220902 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d7077264-be0e-4f8d-abfb-3566397c1ccb not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:40:12.234599 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-197cbc13-4c52-4c02-8b0d-30e27b642e1f tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:12.287089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-dcc4fe27-a4e9-43a6-a8b8-537f941c5a46 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=69d79e96ec1c418aa6c619846f0fe02e&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1277678 Dec 09 21:40:12.320768 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3458b9ef-f140-4fa9-a62f-3984dd8c2935 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:12.330362 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-197cbc13-4c52-4c02-8b0d-30e27b642e1f tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:12.371324 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-3458b9ef-f140-4fa9-a62f-3984dd8c2935 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['06ebb5fc-e0f4-4630-93c4-509954a9e0b0']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:12.400210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-3458b9ef-f140-4fa9-a62f-3984dd8c2935 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ef2748bc-7ba5-4b81-a9b8-bae847ca5231') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:12.400537 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-3458b9ef-f140-4fa9-a62f-3984dd8c2935 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ef2748bc-7ba5-4b81-a9b8-bae847ca5231') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:12.438848 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3458b9ef-f140-4fa9-a62f-3984dd8c2935 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:12.467486 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3458b9ef-f140-4fa9-a62f-3984dd8c2935 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:12.478434 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb6fac03-22ea-4b9c-9cbc-f81832b2a885 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:12.485513 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3458b9ef-f140-4fa9-a62f-3984dd8c2935 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Releasing vlan 118 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:40:12.486135 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3458b9ef-f140-4fa9-a62f-3984dd8c2935 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:40:12.492013 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:40:12.509094 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb6fac03-22ea-4b9c-9cbc-f81832b2a885 None None] Pushing event deleted for resources: {'Port': ['ID=d7077264-be0e-4f8d-abfb-3566397c1ccb,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:12.512852 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-197cbc13-4c52-4c02-8b0d-30e27b642e1f tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:12.517702 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-197cbc13-4c52-4c02-8b0d-30e27b642e1f tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:12.519082 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb6fac03-22ea-4b9c-9cbc-f81832b2a885 None None] No DVR routers for this DVR port d7077264-be0e-4f8d-abfb-3566397c1ccb on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:40:12.521238 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-197cbc13-4c52-4c02-8b0d-30e27b642e1f tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] 10.222.0.13 "DELETE /v2.0/security-groups/1fcce80b-2194-4cd9-a244-9075de806654 HTTP/1.1" status: 204 len: 168 time: 0.4787729 Dec 09 21:40:12.523325 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59572) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:12.537943 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-954b6bd4-78ae-40cc-b3ab-9d765fb13523 service neutron] 10.222.0.13 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2191129 Dec 09 21:40:12.548044 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c4c11de-65ec-4b4c-b697-aa53f60d18e2', 'name': 'tempest-ServerRescueNegativeTestJSON-2013763698-router', 'tenant_id': '69d79e96ec1c418aa6c619846f0fe02e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.51'}], 'enable_snat': True}, 'gw_port_id': '4d6d5feb-4ea8-48a8-a767-e7322d78726b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:40:00Z', 'updated_at': '2021-12-09T21:40:08Z', 'revision_number': 4, 'project_id': '69d79e96ec1c418aa6c619846f0fe02e', 'gw_port': {'id': '4d6d5feb-4ea8-48a8-a767-e7322d78726b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:82:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c4c11de-65ec-4b4c-b697-aa53f60d18e2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2459, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:40:01Z', 'updated_at': '2021-12-09T21:40:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'c147a416-ff0a-4bae-9503-ebf0727fc69d', 'name': '', 'network_id': '71038cd4-0600-4b06-91f9-ae7f4f4807f9', 'tenant_id': '69d79e96ec1c418aa6c619846f0fe02e', 'mac_address': 'fa:16:3e:cc:4c:08', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c4c11de-65ec-4b4c-b697-aa53f60d18e2', 'device_owner': 'network:router_interface', 'standard_attr_id': 2465, 'fixed_ips': [{'subnet_id': '12d97cfc-9264-49cb-8e47-fd225cb6d30b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:40:07Z', 'updated_at': '2021-12-09T21:40:08Z', 'revision_number': 2, 'project_id': '69d79e96ec1c418aa6c619846f0fe02e', 'subnets': [{'id': '12d97cfc-9264-49cb-8e47-fd225cb6d30b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:12.579575 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] Checking router: 9c4c11de-65ec-4b4c-b697-aa53f60d18e2 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:40:12.580124 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] Updating router 9c4c11de-65ec-4b4c-b697-aa53f60d18e2 port c147a416-ff0a-4bae-9503-ebf0727fc69d binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:40:12.605295 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-197cbc13-4c52-4c02-8b0d-30e27b642e1f tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1fcce80b-2194-4cd9-a244-9075de806654,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:12.608177 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:12.629912 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71b9a9da-c78f-4034-b851-6c82ebd0cfb2 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:12.675884 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3458b9ef-f140-4fa9-a62f-3984dd8c2935 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:12.681432 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3458b9ef-f140-4fa9-a62f-3984dd8c2935 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:12.692439 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3458b9ef-f140-4fa9-a62f-3984dd8c2935 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/networks/06ebb5fc-e0f4-4630-93c4-509954a9e0b0 HTTP/1.1" status: 204 len: 168 time: 1.6790276 Dec 09 21:40:12.695021 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59574) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:12.731244 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3458b9ef-f140-4fa9-a62f-3984dd8c2935 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Network': ['ID=06ebb5fc-e0f4-4630-93c4-509954a9e0b0,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:12.764292 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71b9a9da-c78f-4034-b851-6c82ebd0cfb2 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:12.777331 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d23942c-e986-48e6-acaf-c2d7a19ca23b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:12.785158 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1d23942c-e986-48e6-acaf-c2d7a19ca23b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports/2c0d4683-2706-41db-8c7f-caeeb25ac34f HTTP/1.1" status: 200 len: 839 time: 0.0683959 Dec 09 21:40:12.789319 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-71b9a9da-c78f-4034-b851-6c82ebd0cfb2 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['af58721d-10e6-4c77-bec2-5930b1afd3e2']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:12.791407 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59580) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:12.805027 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-c7d22de0-916f-4901-a8bb-a012a2a807a7 service neutron] 10.222.0.13 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2660925 Dec 09 21:40:12.830089 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-71b9a9da-c78f-4034-b851-6c82ebd0cfb2 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '44e0056c-fd14-44b4-91b5-c16f2d69a8ba') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:12.830873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-71b9a9da-c78f-4034-b851-6c82ebd0cfb2 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '44e0056c-fd14-44b4-91b5-c16f2d69a8ba') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:12.846598 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71b9a9da-c78f-4034-b851-6c82ebd0cfb2 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:12.862760 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9100589e-34d1-43c3-8f73-a4d0262f7d09 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports/2c0d4683-2706-41db-8c7f-caeeb25ac34f?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 281 time: 0.0666964 Dec 09 21:40:12.863402 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59582) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:12.867561 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71b9a9da-c78f-4034-b851-6c82ebd0cfb2 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:12.874095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-83cd1073-0fb4-43ef-b033-bfbb5a85aed7 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'subnet': {'network_id': '12b747a3-de78-4645-83a0-a5e2eec09a63', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:12.875023 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-71b9a9da-c78f-4034-b851-6c82ebd0cfb2 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Releasing vlan 140 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:40:12.876342 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71b9a9da-c78f-4034-b851-6c82ebd0cfb2 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:40:12.879776 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:40:12.937874 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71b9a9da-c78f-4034-b851-6c82ebd0cfb2 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:12.943832 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71b9a9da-c78f-4034-b851-6c82ebd0cfb2 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:12.950219 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-71b9a9da-c78f-4034-b851-6c82ebd0cfb2 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] 10.222.0.13 "DELETE /v2.0/networks/af58721d-10e6-4c77-bec2-5930b1afd3e2 HTTP/1.1" status: 204 len: 168 time: 0.4232869 Dec 09 21:40:12.950515 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59584) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:12.971670 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71b9a9da-c78f-4034-b851-6c82ebd0cfb2 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Pushing event deleted for resources: {'Network': ['ID=af58721d-10e6-4c77-bec2-5930b1afd3e2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:13.036059 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:13.058621 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:13.111926 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-72c46663-9084-4c37-a3ff-2df09c3652c1 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:13.122397 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-83cd1073-0fb4-43ef-b033-bfbb5a85aed7 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:13.127513 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83cd1073-0fb4-43ef-b033-bfbb5a85aed7 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:13.146664 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0861e969-2642-4887-9ee5-81451ba6cc8a None None] Pushing event updated for resources: {'Port': ['ID=c147a416-ff0a-4bae-9503-ebf0727fc69d,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:13.244971 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] Attempting to bind port c147a416-ff0a-4bae-9503-ebf0727fc69d on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:13.246884 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] Attempting to bind port c147a416-ff0a-4bae-9503-ebf0727fc69d by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '387b2307-6c4a-4b56-8fe0-5bcb0370db1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '71038cd4-0600-4b06-91f9-ae7f4f4807f9'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:13.247694 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-72c46663-9084-4c37-a3ff-2df09c3652c1 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:13.248271 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] Attempting to bind port c147a416-ff0a-4bae-9503-ebf0727fc69d on network 71038cd4-0600-4b06-91f9-ae7f4f4807f9 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:13.261294 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 40, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:40:13.261795 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] Checking segment: {'id': '387b2307-6c4a-4b56-8fe0-5bcb0370db1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '71038cd4-0600-4b06-91f9-ae7f4f4807f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:40:13.262289 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:13.262850 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] Bound using segment: {'id': '387b2307-6c4a-4b56-8fe0-5bcb0370db1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '71038cd4-0600-4b06-91f9-ae7f4f4807f9'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:40:13.263427 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] Bound port: c147a416-ff0a-4bae-9503-ebf0727fc69d, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '387b2307-6c4a-4b56-8fe0-5bcb0370db1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '71038cd4-0600-4b06-91f9-ae7f4f4807f9'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:40:13.263971 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:13.270558 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-72c46663-9084-4c37-a3ff-2df09c3652c1 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6e3e46f8-567b-42b3-a342-11857fd9c863']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:13.280793 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-72c46663-9084-4c37-a3ff-2df09c3652c1 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1aa47b27-be70-4791-93f9-946fd1d6233d') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:13.281071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-72c46663-9084-4c37-a3ff-2df09c3652c1 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1aa47b27-be70-4791-93f9-946fd1d6233d') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:13.323156 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-72c46663-9084-4c37-a3ff-2df09c3652c1 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:13.348154 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-72c46663-9084-4c37-a3ff-2df09c3652c1 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:13.355406 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] For port c147a416-ff0a-4bae-9503-ebf0727fc69d, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:40:13.358710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-72c46663-9084-4c37-a3ff-2df09c3652c1 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Releasing vlan 144 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:40:13.359133 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-72c46663-9084-4c37-a3ff-2df09c3652c1 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:13.359695 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] For port c147a416-ff0a-4bae-9503-ebf0727fc69d, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c147a416-ff0a-4bae-9503-ebf0727fc69d,segment=NetworkSegment(387b2307-6c4a-4b56-8fe0-5bcb0370db1c),segment_id=387b2307-6c4a-4b56-8fe0-5bcb0370db1c)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:40:13.366599 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:40:13.372779 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:40:13.460862 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-72c46663-9084-4c37-a3ff-2df09c3652c1 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:13.507048 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-72c46663-9084-4c37-a3ff-2df09c3652c1 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:13.523015 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-72c46663-9084-4c37-a3ff-2df09c3652c1 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] 10.222.0.13 "DELETE /v2.0/networks/6e3e46f8-567b-42b3-a342-11857fd9c863 HTTP/1.1" status: 204 len: 168 time: 0.5711341 Dec 09 21:40:13.527859 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72c46663-9084-4c37-a3ff-2df09c3652c1 tempest-QuotasNegativeTest-889410578 tempest-QuotasNegativeTest-889410578-project-admin] Pushing event deleted for resources: {'Network': ['ID=6e3e46f8-567b-42b3-a342-11857fd9c863,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:13.593119 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] Routers {'9c4c11de-65ec-4b4c-b697-aa53f60d18e2'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:40:13.593771 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:40:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9c4c11de-65ec-4b4c-b697-aa53f60d18e2'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:13.608046 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0861e969-2642-4887-9ee5-81451ba6cc8a None None] Pushing event updated for resources: {'Port': ['ID=c147a416-ff0a-4bae-9503-ebf0727fc69d,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:13.640714 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26ba1e08-e024-4364-b556-41fe03d65431 req-fcd62b5e-e141-4b77-ab19-b9e24ee8428d tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:13.648399 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-26ba1e08-e024-4364-b556-41fe03d65431 req-fcd62b5e-e141-4b77-ab19-b9e24ee8428d tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/ports?device_id=04a29bbd-d29d-4109-877b-a0cf1fbf9046 HTTP/1.1" status: 200 len: 944 time: 0.1025598 Dec 09 21:40:13.688414 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83cd1073-0fb4-43ef-b033-bfbb5a85aed7 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:13.777907 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-26ba1e08-e024-4364-b556-41fe03d65431 req-37b38bd9-32cf-45b6-a6f8-39f87bdbf803 tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/security-groups?id=e060d354-4177-4c8e-8083-b0266b57b04e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1285408 Dec 09 21:40:13.816747 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83cd1073-0fb4-43ef-b033-bfbb5a85aed7 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network 12b747a3-de78-4645-83a0-a5e2eec09a63 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:40:13.824795 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-83cd1073-0fb4-43ef-b033-bfbb5a85aed7 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:13.830905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83cd1073-0fb4-43ef-b033-bfbb5a85aed7 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:13.832170 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83cd1073-0fb4-43ef-b033-bfbb5a85aed7 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:13.842723 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b0b3b42-c37a-4d6d-94cb-c2fd315384f9 None None] Network 12b747a3-de78-4645-83a0-a5e2eec09a63 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:13.871367 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83cd1073-0fb4-43ef-b033-bfbb5a85aed7 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Subnet': ['ID=db7b139a-e4a1-4bdd-ab45-5fa8c8400a0b,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:13.879203 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-83cd1073-0fb4-43ef-b033-bfbb5a85aed7 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.0136361 Dec 09 21:40:13.881455 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59628) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:13.887006 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-718fe343-9766-4ac7-bb4e-c43fb8b1d564 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'security_group': {'name': 'tempest-secgroup-1569539920'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:13.928955 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-718fe343-9766-4ac7-bb4e-c43fb8b1d564 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:13.966992 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4962a971-7db8-4fb4-895f-8a42850e9bd6 req-87398aa1-0385-450a-887d-9f8eb6cd3d97 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 210 time: 0.0540187 Dec 09 21:40:13.982197 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] Set router 9c4c11de-65ec-4b4c-b697-aa53f60d18e2 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:40:14.112743 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-718fe343-9766-4ac7-bb4e-c43fb8b1d564 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:14.126327 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-718fe343-9766-4ac7-bb4e-c43fb8b1d564 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:14.229832 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50a05eb9-3a94-4063-8cd4-60f46e40e0ea req-af8b47c7-9a56-468f-a49b-211cabc6f927 tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb4b94af-3092-4329-b88b-a06c713c5b7c HTTP/1.1" status: 200 len: 210 time: 0.1101048 Dec 09 21:40:14.235233 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-718fe343-9766-4ac7-bb4e-c43fb8b1d564 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4f709219-0f76-4f0c-a35f-0e6bd1104f6a,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:14.245690 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-718fe343-9766-4ac7-bb4e-c43fb8b1d564 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:14.263122 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-718fe343-9766-4ac7-bb4e-c43fb8b1d564 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.3804111 Dec 09 21:40:14.265927 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59646) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:14.272535 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-07dae31a-2fe0-4d74-b77c-bd70b98d0864 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'security_group': {'name': 'tempest-secgroup-897611111'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:14.317870 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-07dae31a-2fe0-4d74-b77c-bd70b98d0864 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:14.495997 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-36fd5ff1-63b8-4d78-82c8-928368df03fa tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:14.506473 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-36fd5ff1-63b8-4d78-82c8-928368df03fa tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/networks?id=71038cd4-0600-4b06-91f9-ae7f4f4807f9 HTTP/1.1" status: 200 len: 819 time: 0.1486952 Dec 09 21:40:14.513965 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-07dae31a-2fe0-4d74-b77c-bd70b98d0864 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:14.526199 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-07dae31a-2fe0-4d74-b77c-bd70b98d0864 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:14.528722 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-25d222ee-9905-4ed8-abba-8c4275dbb63f tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/quotas/69d79e96ec1c418aa6c619846f0fe02e HTTP/1.1" status: 200 len: 375 time: 0.0206873 Dec 09 21:40:14.575371 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-07dae31a-2fe0-4d74-b77c-bd70b98d0864 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:14.579595 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-07dae31a-2fe0-4d74-b77c-bd70b98d0864 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.3090508 Dec 09 21:40:14.580593 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59664) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:14.587364 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-df4b7591-c6c8-417d-834c-cf43523d1386 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-1587888288', 'security_groups': ['4ef1aaa3-1ca3-439a-8a3b-3d1f51c08932'], 'network_id': '12b747a3-de78-4645-83a0-a5e2eec09a63', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': 'db7b139a-e4a1-4bdd-ab45-5fa8c8400a0b'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:14.642998 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:40:14.643632 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-067775b4-15bc-461c-b4e3-2e22c97296f8 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=69d79e96ec1c418aa6c619846f0fe02e&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1134636 Dec 09 21:40:14.743073 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07dae31a-2fe0-4d74-b77c-bd70b98d0864 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4ef1aaa3-1ca3-439a-8a3b-3d1f51c08932,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:14.763912 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-df4b7591-c6c8-417d-834c-cf43523d1386 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:14.833385 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59670) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:14.916430 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-3d42ec1d-78b4-415e-b607-ef4e7721e64a service neutron] 10.222.0.13 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2604578 Dec 09 21:40:14.930444 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df4b7591-c6c8-417d-834c-cf43523d1386 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:14.961400 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c3d1783-d9b2-4848-960f-b5188b4c44f7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-12b747a3-de78-4645-83a0-a5e2eec09a63', 'network_id': '12b747a3-de78-4645-83a0-a5e2eec09a63', 'project_id': 'e8bdea0c320d4955bc3ba905696bda85', 'fixed_ips': [{'subnet_id': 'db7b139a-e4a1-4bdd-ab45-5fa8c8400a0b'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:40:14.964445 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8c3d1783-d9b2-4848-960f-b5188b4c44f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:14.976066 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-df4b7591-c6c8-417d-834c-cf43523d1386 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] device_id is not set on port 5cde4983-dbe9-4726-a138-e6798f96c2cd yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:40:15.055828 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-c0b455e4-bc54-4073-823b-7a5be8b0ec68 service neutron] 10.222.0.13 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1378233 Dec 09 21:40:15.084349 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:40:15.101316 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:15.101767 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:15.118815 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-67c94a65-a5ee-4a0d-b7f0-6e40d6282acf admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:15.241516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-df4b7591-c6c8-417d-834c-cf43523d1386 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Allocated IP 172.20.0.6 (12b747a3-de78-4645-83a0-a5e2eec09a63/db7b139a-e4a1-4bdd-ab45-5fa8c8400a0b/5cde4983-dbe9-4726-a138-e6798f96c2cd) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:40:15.312518 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-67c94a65-a5ee-4a0d-b7f0-6e40d6282acf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:15.322916 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-67c94a65-a5ee-4a0d-b7f0-6e40d6282acf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:15.357928 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:15.396472 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '04a29bbd-d29d-4109-877b-a0cf1fbf9046', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:40:15.398893 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bd1278eb-ac3a-41a3-b017-fc2c63789fbf" -d '{"events": [{"server_uuid": "04a29bbd-d29d-4109-877b-a0cf1fbf9046", "name": "network-vif-plugged", "status": "completed", "tag": "3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:40:15.410328 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-67c94a65-a5ee-4a0d-b7f0-6e40d6282acf admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=96b93414578e4a9c95bf20e6f489460b&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5755315 Dec 09 21:40:15.412808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59694) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:15.449360 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a,segment=NetworkSegment(563bc4db-400a-4e89-baf0-c14fd72fdac2),segment_id=563bc4db-400a-4e89-baf0-c14fd72fdac2)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:15.461612 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:15.498736 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67c94a65-a5ee-4a0d-b7f0-6e40d6282acf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fe804b71-942e-40d8-ad2a-7fdae0b67168,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:15.575157 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c4c11de-65ec-4b4c-b697-aa53f60d18e2', 'name': 'tempest-ServerRescueNegativeTestJSON-2013763698-router', 'tenant_id': '69d79e96ec1c418aa6c619846f0fe02e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.51'}], 'enable_snat': True}, 'gw_port_id': '4d6d5feb-4ea8-48a8-a767-e7322d78726b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:40:00Z', 'updated_at': '2021-12-09T21:40:08Z', 'revision_number': 4, 'project_id': '69d79e96ec1c418aa6c619846f0fe02e', 'gw_port': {'id': '4d6d5feb-4ea8-48a8-a767-e7322d78726b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:82:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c4c11de-65ec-4b4c-b697-aa53f60d18e2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2459, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:40:01Z', 'updated_at': '2021-12-09T21:40:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'c147a416-ff0a-4bae-9503-ebf0727fc69d', 'name': '', 'network_id': '71038cd4-0600-4b06-91f9-ae7f4f4807f9', 'tenant_id': '69d79e96ec1c418aa6c619846f0fe02e', 'mac_address': 'fa:16:3e:cc:4c:08', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c4c11de-65ec-4b4c-b697-aa53f60d18e2', 'device_owner': 'network:router_interface', 'standard_attr_id': 2465, 'fixed_ips': [{'subnet_id': '12d97cfc-9264-49cb-8e47-fd225cb6d30b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:40:07Z', 'updated_at': '2021-12-09T21:40:13Z', 'revision_number': 4, 'project_id': '69d79e96ec1c418aa6c619846f0fe02e', 'subnets': [{'id': '12d97cfc-9264-49cb-8e47-fd225cb6d30b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:15.623813 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-820ab0c2-7300-4311-ab53-6af8c824584b None None] The sync data for ids ['9c4c11de-65ec-4b4c-b697-aa53f60d18e2'] in n-d-713301-27 is: [{'id': '9c4c11de-65ec-4b4c-b697-aa53f60d18e2', 'name': 'tempest-ServerRescueNegativeTestJSON-2013763698-router', 'tenant_id': '69d79e96ec1c418aa6c619846f0fe02e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.51'}], 'enable_snat': True}, 'gw_port_id': '4d6d5feb-4ea8-48a8-a767-e7322d78726b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:40:00Z', 'updated_at': '2021-12-09T21:40:08Z', 'revision_number': 4, 'project_id': '69d79e96ec1c418aa6c619846f0fe02e', 'gw_port': {'id': '4d6d5feb-4ea8-48a8-a767-e7322d78726b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:82:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c4c11de-65ec-4b4c-b697-aa53f60d18e2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2459, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:40:01Z', 'updated_at': '2021-12-09T21:40:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'c147a416-ff0a-4bae-9503-ebf0727fc69d', 'name': '', 'network_id': '71038cd4-0600-4b06-91f9-ae7f4f4807f9', 'tenant_id': '69d79e96ec1c418aa6c619846f0fe02e', 'mac_address': 'fa:16:3e:cc:4c:08', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c4c11de-65ec-4b4c-b697-aa53f60d18e2', 'device_owner': 'network:router_interface', 'standard_attr_id': 2465, 'fixed_ips': [{'subnet_id': '12d97cfc-9264-49cb-8e47-fd225cb6d30b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:40:07Z', 'updated_at': '2021-12-09T21:40:13Z', 'revision_number': 4, 'project_id': '69d79e96ec1c418aa6c619846f0fe02e', 'subnets': [{'id': '12d97cfc-9264-49cb-8e47-fd225cb6d30b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:40:15.647551 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df4b7591-c6c8-417d-834c-cf43523d1386 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:15.697696 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:15.800941 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7515d964-981d-4d1d-b8b4-77f264fb4075 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:15.834620 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df4b7591-c6c8-417d-834c-cf43523d1386 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:15.893048 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7515d964-981d-4d1d-b8b4-77f264fb4075 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:15.909375 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-df4b7591-c6c8-417d-834c-cf43523d1386 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network 12b747a3-de78-4645-83a0-a5e2eec09a63 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:40:15.939199 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-df4b7591-c6c8-417d-834c-cf43523d1386 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:15.950348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df4b7591-c6c8-417d-834c-cf43523d1386 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:40:16.005242 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0bd2f11-9176-4aa1-8c20-d3b35dcdbd0c req-1ac17b96-f3d4-4b75-a5d8-faddafdab327 tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:16.014510 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d0bd2f11-9176-4aa1-8c20-d3b35dcdbd0c req-1ac17b96-f3d4-4b75-a5d8-faddafdab327 tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/ports?device_id=04a29bbd-d29d-4109-877b-a0cf1fbf9046 HTTP/1.1" status: 200 len: 945 time: 0.2235858 Dec 09 21:40:16.055990 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-8c3d1783-d9b2-4848-960f-b5188b4c44f7 None None] Allocated IP 172.20.0.2 (12b747a3-de78-4645-83a0-a5e2eec09a63/db7b139a-e4a1-4bdd-ab45-5fa8c8400a0b/3f60f042-287b-46d5-b55e-b5cb81c168ba) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:40:16.080787 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-b297a1a4-5db6-4f00-aa2a-81ed1ba54d7a tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:16.084008 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-b297a1a4-5db6-4f00-aa2a-81ed1ba54d7a tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.31 "GET /v2.0/networks?id=71038cd4-0600-4b06-91f9-ae7f4f4807f9 HTTP/1.1" status: 200 len: 819 time: 0.5648384 Dec 09 21:40:16.116032 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-11e6e08c-7a00-4c17-ab99-3456596fbb06 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Request body: {'port': {'device_id': 'f875c61b-474a-40dc-aa86-15edf61f643d', 'network_id': '71038cd4-0600-4b06-91f9-ae7f4f4807f9', 'admin_state_up': True, 'tenant_id': '69d79e96ec1c418aa6c619846f0fe02e'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:16.123657 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df4b7591-c6c8-417d-834c-cf43523d1386 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Port': ['ID=5cde4983-dbe9-4726-a138-e6798f96c2cd,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:16.150702 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c147a416-ff0a-4bae-9503-ebf0727fc69d up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:40:16.295219 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df4b7591-c6c8-417d-834c-cf43523d1386 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:16.296245 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df4b7591-c6c8-417d-834c-cf43523d1386 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:16.297453 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d0bd2f11-9176-4aa1-8c20-d3b35dcdbd0c req-161e691f-3b6c-49f8-a9e4-88c1a8ff6e0d tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/security-groups?id=e060d354-4177-4c8e-8083-b0266b57b04e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2817471 Dec 09 21:40:16.334357 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7515d964-981d-4d1d-b8b4-77f264fb4075 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:16.336943 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-df4b7591-c6c8-417d-834c-cf43523d1386 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 924 time: 1.7551477 Dec 09 21:40:16.338632 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7515d964-981d-4d1d-b8b4-77f264fb4075 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:16.339689 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59722) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:16.339801 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7515d964-981d-4d1d-b8b4-77f264fb4075 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/fe804b71-942e-40d8-ad2a-7fdae0b67168 HTTP/1.1" status: 204 len: 168 time: 0.9260733 Dec 09 21:40:16.350901 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-005f60b4-8cf6-4928-acd2-6a2420895904 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'subnet': {'network_id': '12b747a3-de78-4645-83a0-a5e2eec09a63', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:16.440554 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7515d964-981d-4d1d-b8b4-77f264fb4075 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe804b71-942e-40d8-ad2a-7fdae0b67168,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:16.577066 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port c147a416-ff0a-4bae-9503-ebf0727fc69d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:16.577548 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:16.608948 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-65c3a434-5e74-4802-b7d3-a36d4548d7ef req-9d430142-f21f-4f56-9905-edd180420bfe tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 210 time: 0.1178939 Dec 09 21:40:16.631283 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-005f60b4-8cf6-4928-acd2-6a2420895904 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:16.636336 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-005f60b4-8cf6-4928-acd2-6a2420895904 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:16.705566 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-11e6e08c-7a00-4c17-ab99-3456596fbb06 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Made reservation on behalf of 69d79e96ec1c418aa6c619846f0fe02e for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:16.710229 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-11e6e08c-7a00-4c17-ab99-3456596fbb06 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:16.781286 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:40:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8c49b638-e771-40da-8991-17643d0365c6 x-openstack-request-id: req-8c49b638-e771-40da-8991-17643d0365c6 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:40:16.782014 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "04a29bbd-d29d-4109-877b-a0cf1fbf9046", "name": "network-vif-plugged", "status": "completed", "tag": "3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:40:16.782014 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8c49b638-e771-40da-8991-17643d0365c6 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:40:16.782594 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '04a29bbd-d29d-4109-877b-a0cf1fbf9046', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a', 'code': 200} Dec 09 21:40:16.823526 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8c3d1783-d9b2-4848-960f-b5188b4c44f7 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:16.842659 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8c3d1783-d9b2-4848-960f-b5188b4c44f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:17.074023 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-11e6e08c-7a00-4c17-ab99-3456596fbb06 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Allocated IP 172.20.0.13 (71038cd4-0600-4b06-91f9-ae7f4f4807f9/12d97cfc-9264-49cb-8e47-fd225cb6d30b/be95aa8d-fc0e-4d77-a861-33c1637e4f3e) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:40:17.091672 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:17.162969 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c3d1783-d9b2-4848-960f-b5188b4c44f7 None None] Network 12b747a3-de78-4645-83a0-a5e2eec09a63 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:40:17.203416 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c3d1783-d9b2-4848-960f-b5188b4c44f7 None None] Pushing event updated for resources: {'Port': ['ID=3f60f042-287b-46d5-b55e-b5cb81c168ba,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:17.217390 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-8c3d1783-d9b2-4848-960f-b5188b4c44f7 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:17.220063 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3699965a-0c69-4ed1-8b44-2ddd511c11e2 req-d4e44e40-ad86-4da8-9749-506f2e7fb165 tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0974712 Dec 09 21:40:17.220614 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59734) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:17.229138 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c3d1783-d9b2-4848-960f-b5188b4c44f7 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:40:17.265241 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b62b7642-f848-4b15-bd4d-1734f5c49f5f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:17.388730 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port c147a416-ff0a-4bae-9503-ebf0727fc69d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c147a416-ff0a-4bae-9503-ebf0727fc69d,segment=NetworkSegment(387b2307-6c4a-4b56-8fe0-5bcb0370db1c),segment_id=387b2307-6c4a-4b56-8fe0-5bcb0370db1c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:17.424773 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-8c3d1783-d9b2-4848-960f-b5188b4c44f7 None None] Attempting to bind port 3f60f042-287b-46d5-b55e-b5cb81c168ba on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:17.425616 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-8c3d1783-d9b2-4848-960f-b5188b4c44f7 None None] Attempting to bind port 3f60f042-287b-46d5-b55e-b5cb81c168ba by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '8d15e2ef-b82d-433a-a244-0bedb82cd38c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '12b747a3-de78-4645-83a0-a5e2eec09a63'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:17.426239 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c3d1783-d9b2-4848-960f-b5188b4c44f7 None None] Attempting to bind port 3f60f042-287b-46d5-b55e-b5cb81c168ba on network 12b747a3-de78-4645-83a0-a5e2eec09a63 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:17.431291 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:17.499934 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c3d1783-d9b2-4848-960f-b5188b4c44f7 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 40, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:40:17.500819 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c3d1783-d9b2-4848-960f-b5188b4c44f7 None None] Checking segment: {'id': '8d15e2ef-b82d-433a-a244-0bedb82cd38c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '12b747a3-de78-4645-83a0-a5e2eec09a63'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:40:17.501520 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8c3d1783-d9b2-4848-960f-b5188b4c44f7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:17.502264 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c3d1783-d9b2-4848-960f-b5188b4c44f7 None None] Bound using segment: {'id': '8d15e2ef-b82d-433a-a244-0bedb82cd38c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '12b747a3-de78-4645-83a0-a5e2eec09a63'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:40:17.503082 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-8c3d1783-d9b2-4848-960f-b5188b4c44f7 None None] Bound port: 3f60f042-287b-46d5-b55e-b5cb81c168ba, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8d15e2ef-b82d-433a-a244-0bedb82cd38c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '12b747a3-de78-4645-83a0-a5e2eec09a63'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:40:17.503692 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8c3d1783-d9b2-4848-960f-b5188b4c44f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:17.548673 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-73b29aea-851e-4014-a728-37389f5ea0ca req-0a75f515-d21e-49ca-b142-75eb0104c4df service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=fb4b94af-3092-4329-b88b-a06c713c5b7c HTTP/1.1" status: 200 len: 210 time: 0.1018844 Dec 09 21:40:17.620951 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b270e5d-bf7f-476b-8771-9fed2ae6dcb2 req-71fffc99-7e7a-41ed-9f1a-1a46bc521d16 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:17.621202 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=c147a416-ff0a-4bae-9503-ebf0727fc69d,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:17.622652 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8b270e5d-bf7f-476b-8771-9fed2ae6dcb2 req-71fffc99-7e7a-41ed-9f1a-1a46bc521d16 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=04a29bbd-d29d-4109-877b-a0cf1fbf9046 HTTP/1.1" status: 200 len: 1097 time: 0.2576365 Dec 09 21:40:17.630774 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a19d0b57-6149-413b-8117-2e9183424679 req-9309806e-0697-47d9-b966-1a015900202f tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:17.632774 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a19d0b57-6149-413b-8117-2e9183424679 req-9309806e-0697-47d9-b966-1a015900202f tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/ports?device_id=04a29bbd-d29d-4109-877b-a0cf1fbf9046 HTTP/1.1" status: 200 len: 945 time: 0.2479491 Dec 09 21:40:17.634435 n-d-713301-27 neutron-server[103437]: INFO neutron.db.ipam_backend_mixin [None req-005f60b4-8cf6-4928-acd2-6a2420895904 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet db7b139a-e4a1-4bdd-ab45-5fa8c8400a0b (CIDR: 172.20.0.0/28) Dec 09 21:40:17.651618 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-005f60b4-8cf6-4928-acd2-6a2420895904 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:40:17.652376 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-005f60b4-8cf6-4928-acd2-6a2420895904 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:40:17.685575 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-11e6e08c-7a00-4c17-ab99-3456596fbb06 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:17.695671 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-8c3d1783-d9b2-4848-960f-b5188b4c44f7 None None] For port 3f60f042-287b-46d5-b55e-b5cb81c168ba, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:40:17.696989 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b62b7642-f848-4b15-bd4d-1734f5c49f5f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:17.711367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-8c3d1783-d9b2-4848-960f-b5188b4c44f7 None None] For port 3f60f042-287b-46d5-b55e-b5cb81c168ba, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=3f60f042-287b-46d5-b55e-b5cb81c168ba,segment=NetworkSegment(8d15e2ef-b82d-433a-a244-0bedb82cd38c),segment_id=8d15e2ef-b82d-433a-a244-0bedb82cd38c)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:40:17.711988 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8b270e5d-bf7f-476b-8771-9fed2ae6dcb2 req-30ce488e-cefb-403a-992a-bc3c0eb222ff service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=e060d354-4177-4c8e-8083-b0266b57b04e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0731950 Dec 09 21:40:17.717625 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b62b7642-f848-4b15-bd4d-1734f5c49f5f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:17.722158 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8c3d1783-d9b2-4848-960f-b5188b4c44f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:17.726092 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-6d583254-4cf5-4fe0-83cd-39348b25a81b tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:17.729886 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-6d583254-4cf5-4fe0-83cd-39348b25a81b tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.10 "GET /v2.0/networks?id=71038cd4-0600-4b06-91f9-ae7f4f4807f9 HTTP/1.1" status: 200 len: 819 time: 0.3659961 Dec 09 21:40:17.741299 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-005f60b4-8cf6-4928-acd2-6a2420895904 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 1.4001102 Dec 09 21:40:17.744549 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59748) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:17.753895 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-263c0ecb-bf85-430a-8777-6fa4a21e62f1 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'subnet': {'network_id': '12b747a3-de78-4645-83a0-a5e2eec09a63', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:17.772234 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a19d0b57-6149-413b-8117-2e9183424679 req-568b3356-cf2a-4a56-9664-9f2de3a1f1c7 tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/security-groups?id=e060d354-4177-4c8e-8083-b0266b57b04e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1222589 Dec 09 21:40:17.835202 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c3d1783-d9b2-4848-960f-b5188b4c44f7 None None] Pushing event updated for resources: {'Port': ['ID=3f60f042-287b-46d5-b55e-b5cb81c168ba,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:17.869974 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b62b7642-f848-4b15-bd4d-1734f5c49f5f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2a1c2afc-8296-4cdc-8b5a-cda993e39b75,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:17.892452 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b62b7642-f848-4b15-bd4d-1734f5c49f5f admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=854583825a464c6d91eefb3ab425307a&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6689839 Dec 09 21:40:17.896700 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59754) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:17.901496 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-11e6e08c-7a00-4c17-ab99-3456596fbb06 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:18.039498 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-868c1d40-9ea7-458c-b52a-297de7985ba1 req-98e5d316-0841-4207-8329-721b406eb5c3 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 210 time: 0.0831156 Dec 09 21:40:18.113207 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-11e6e08c-7a00-4c17-ab99-3456596fbb06 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Network 71038cd4-0600-4b06-91f9-ae7f4f4807f9 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:40:18.117717 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c147a416-ff0a-4bae-9503-ebf0727fc69d up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:40:18.121408 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-213c9cfe-e3fd-4b52-937a-7436c57a3a6a tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Request body: {'port': {'device_id': 'b2888c0f-bfde-4e70-90c2-123c413557f5', 'network_id': '71038cd4-0600-4b06-91f9-ae7f4f4807f9', 'admin_state_up': True, 'tenant_id': '69d79e96ec1c418aa6c619846f0fe02e'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:18.146743 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-11e6e08c-7a00-4c17-ab99-3456596fbb06 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:18.150886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-11e6e08c-7a00-4c17-ab99-3456596fbb06 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:40:18.153706 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-263c0ecb-bf85-430a-8777-6fa4a21e62f1 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:18.158167 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-263c0ecb-bf85-430a-8777-6fa4a21e62f1 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:18.227749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11e6e08c-7a00-4c17-ab99-3456596fbb06 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Pushing event updated for resources: {'Port': ['ID=be95aa8d-fc0e-4d77-a861-33c1637e4f3e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:18.246747 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e5379b4b-028d-4097-bba1-08ddedd052ef admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:18.256129 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port c147a416-ff0a-4bae-9503-ebf0727fc69d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:18.257493 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:18.266034 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-11e6e08c-7a00-4c17-ab99-3456596fbb06 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:18.266762 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-11e6e08c-7a00-4c17-ab99-3456596fbb06 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:18.345964 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e5379b4b-028d-4097-bba1-08ddedd052ef admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:18.444801 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-11e6e08c-7a00-4c17-ab99-3456596fbb06 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.3498218 Dec 09 21:40:18.472872 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-e9a8d343-fd22-46b1-9719-57f63fd01ba2 service neutron] Request body: {'port': {'device_id': 'f875c61b-474a-40dc-aa86-15edf61f643d', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:18.522572 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-add541cd-85ca-4e1a-b5a2-a961d6a7d563 req-a570d966-4ddc-4567-aa29-4dbf12af3aa5 tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0932391 Dec 09 21:40:18.534091 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e5379b4b-028d-4097-bba1-08ddedd052ef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:18.537262 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e5379b4b-028d-4097-bba1-08ddedd052ef admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:18.538970 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e5379b4b-028d-4097-bba1-08ddedd052ef admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/2a1c2afc-8296-4cdc-8b5a-cda993e39b75 HTTP/1.1" status: 204 len: 168 time: 0.6391304 Dec 09 21:40:18.553019 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5379b4b-028d-4097-bba1-08ddedd052ef admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2a1c2afc-8296-4cdc-8b5a-cda993e39b75,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:18.571410 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-213c9cfe-e3fd-4b52-937a-7436c57a3a6a tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Made reservation on behalf of 69d79e96ec1c418aa6c619846f0fe02e for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:18.578274 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-213c9cfe-e3fd-4b52-937a-7436c57a3a6a tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:18.620557 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-e9a8d343-fd22-46b1-9719-57f63fd01ba2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:18.833572 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-213c9cfe-e3fd-4b52-937a-7436c57a3a6a tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Allocated IP 172.20.0.7 (71038cd4-0600-4b06-91f9-ae7f4f4807f9/12d97cfc-9264-49cb-8e47-fd225cb6d30b/10ac5a10-4f73-4f89-b652-3c81390af0aa) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:40:18.847004 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-263c0ecb-bf85-430a-8777-6fa4a21e62f1 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:18.959354 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20927779-a42c-4d09-848b-3bf7490c1923 req-e203262f-afef-44f0-82b9-cd9723f4da92 tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:18.967416 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20927779-a42c-4d09-848b-3bf7490c1923 req-e203262f-afef-44f0-82b9-cd9723f4da92 tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/ports?device_id=04a29bbd-d29d-4109-877b-a0cf1fbf9046 HTTP/1.1" status: 200 len: 945 time: 0.0623729 Dec 09 21:40:19.011906 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-263c0ecb-bf85-430a-8777-6fa4a21e62f1 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network 12b747a3-de78-4645-83a0-a5e2eec09a63 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:40:19.016523 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-263c0ecb-bf85-430a-8777-6fa4a21e62f1 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:19.020734 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-263c0ecb-bf85-430a-8777-6fa4a21e62f1 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:19.021688 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-263c0ecb-bf85-430a-8777-6fa4a21e62f1 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:19.039174 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20927779-a42c-4d09-848b-3bf7490c1923 req-52e04eac-86c3-4192-8bfa-506860ff19de tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/security-groups?id=e060d354-4177-4c8e-8083-b0266b57b04e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0707524 Dec 09 21:40:19.131340 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-263c0ecb-bf85-430a-8777-6fa4a21e62f1 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 1.3834651 Dec 09 21:40:19.132177 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59784) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:19.139070 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-263c0ecb-bf85-430a-8777-6fa4a21e62f1 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Subnet': ['ID=7bbf8dea-d19e-405c-b7e5-dc8a3c4226f2,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:19.141310 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c792587b-8b6d-4cc8-9493-b2f1e69ea218 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-1127191805', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': '7bbf8dea-d19e-405c-b7e5-dc8a3c4226f2'}], 'security_groups': ['4f709219-0f76-4f0c-a35f-0e6bd1104f6a']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:19.234303 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-213c9cfe-e3fd-4b52-937a-7436c57a3a6a tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:19.310276 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-944ec7d1-5acd-4b50-bca5-48c96e011b0c req-7f46f423-4cbe-4588-9152-9d7973f11661 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0720227 Dec 09 21:40:19.387629 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-213c9cfe-e3fd-4b52-937a-7436c57a3a6a tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:19.459419 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1eea8cc1-6810-471e-8778-a017aa23beab None None] Network 12b747a3-de78-4645-83a0-a5e2eec09a63 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:19.486967 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c792587b-8b6d-4cc8-9493-b2f1e69ea218 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:19.505383 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-213c9cfe-e3fd-4b52-937a-7436c57a3a6a tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Network 71038cd4-0600-4b06-91f9-ae7f4f4807f9 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:40:19.506343 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-213c9cfe-e3fd-4b52-937a-7436c57a3a6a tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Pushing event updated for resources: {'Port': ['ID=10ac5a10-4f73-4f89-b652-3c81390af0aa,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:19.512749 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-213c9cfe-e3fd-4b52-937a-7436c57a3a6a tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:19.515251 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-213c9cfe-e3fd-4b52-937a-7436c57a3a6a tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:40:19.579638 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-213c9cfe-e3fd-4b52-937a-7436c57a3a6a tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:19.580430 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-213c9cfe-e3fd-4b52-937a-7436c57a3a6a tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:19.613700 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-213c9cfe-e3fd-4b52-937a-7436c57a3a6a tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5156007 Dec 09 21:40:19.624115 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2e16c087-69b6-461d-b4df-814d370ec96b None None] Provisioning complete for port 3f60f042-287b-46d5-b55e-b5cb81c168ba triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:19.624717 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2e16c087-69b6-461d-b4df-814d370ec96b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:19.637683 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6b0c722-184c-4ecd-859b-6ac5a31d8938 req-af17fa55-b13a-478e-876a-6632b543e17f tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:19.646135 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6b0c722-184c-4ecd-859b-6ac5a31d8938 req-af17fa55-b13a-478e-876a-6632b543e17f tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 931 time: 0.2186048 Dec 09 21:40:19.653255 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-25f5a91f-1f7a-4bc6-8f41-3a5c3f48c924 service neutron] Request body: {'port': {'device_id': 'b2888c0f-bfde-4e70-90c2-123c413557f5', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:19.801237 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-25f5a91f-1f7a-4bc6-8f41-3a5c3f48c924 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:19.801773 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2e16c087-69b6-461d-b4df-814d370ec96b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:19.814922 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6b0c722-184c-4ecd-859b-6ac5a31d8938 req-2c271a75-b625-4b65-9baf-baa647dc580c tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1627233 Dec 09 21:40:19.850727 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2e16c087-69b6-461d-b4df-814d370ec96b None None] For port 3f60f042-287b-46d5-b55e-b5cb81c168ba, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=3f60f042-287b-46d5-b55e-b5cb81c168ba,segment=NetworkSegment(8d15e2ef-b82d-433a-a244-0bedb82cd38c),segment_id=8d15e2ef-b82d-433a-a244-0bedb82cd38c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:19.894099 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2e16c087-69b6-461d-b4df-814d370ec96b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:19.934872 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-e9a8d343-fd22-46b1-9719-57f63fd01ba2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id be95aa8d-fc0e-4d77-a861-33c1637e4f3e {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:40:19.974527 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-e9a8d343-fd22-46b1-9719-57f63fd01ba2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:20.056032 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0cdb63b4-d9ad-41fa-a131-a4c8e968180d req-78bc7e3a-eabf-4fd4-b9ed-d9b843dbfc57 tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0478308 Dec 09 21:40:20.064703 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e16c087-69b6-461d-b4df-814d370ec96b None None] Pushing event updated for resources: {'Port': ['ID=3f60f042-287b-46d5-b55e-b5cb81c168ba,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:20.067775 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4191cfbb-ae7e-451b-9fad-35a139964a56 None None] Update dhcp port {'port': {'network_id': '12b747a3-de78-4645-83a0-a5e2eec09a63', 'fixed_ips': [{'subnet_id': 'db7b139a-e4a1-4bdd-ab45-5fa8c8400a0b', 'ip_address': '172.20.0.2'}, {'subnet_id': '7bbf8dea-d19e-405c-b7e5-dc8a3c4226f2'}], 'binding:host_id': 'n-d-713301-27'}, 'id': '3f60f042-287b-46d5-b55e-b5cb81c168ba'} from n-d-713301-27. {{(pid=103439) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 09 21:40:20.083961 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-691ac00b-c780-4ce6-a0af-4fc9e9fba259 req-6e7886bd-8d63-448e-9b64-e90f92259408 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=04a29bbd-d29d-4109-877b-a0cf1fbf9046&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1913686 Dec 09 21:40:20.123976 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4191cfbb-ae7e-451b-9fad-35a139964a56 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:20.138725 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2e16c087-69b6-461d-b4df-814d370ec96b None None] Provisioning complete for port 2c0d4683-2706-41db-8c7f-caeeb25ac34f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:20.139082 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2e16c087-69b6-461d-b4df-814d370ec96b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:20.211876 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 3f60f042-287b-46d5-b55e-b5cb81c168ba up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:40:20.282708 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-691ac00b-c780-4ce6-a0af-4fc9e9fba259 req-aae0ec11-fd07-4b88-ad7f-1ed71d9ca478 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:20.285508 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-e9a8d343-fd22-46b1-9719-57f63fd01ba2 service neutron] Transition to ACTIVE for port object be95aa8d-fc0e-4d77-a861-33c1637e4f3e will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:40:20.296725 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-691ac00b-c780-4ce6-a0af-4fc9e9fba259 req-aae0ec11-fd07-4b88-ad7f-1ed71d9ca478 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=57607f00f2d942f4b6f084f9e9a9493a&device_id=04a29bbd-d29d-4109-877b-a0cf1fbf9046 HTTP/1.1" status: 200 len: 1097 time: 0.1257796 Dec 09 21:40:20.303486 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-e9a8d343-fd22-46b1-9719-57f63fd01ba2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:20.450626 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-2e16c087-69b6-461d-b4df-814d370ec96b None None] Port 2c0d4683-2706-41db-8c7f-caeeb25ac34f cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:40:20.541293 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 3f60f042-287b-46d5-b55e-b5cb81c168ba triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:20.541976 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:20.574480 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-691ac00b-c780-4ce6-a0af-4fc9e9fba259 req-94af4935-1be1-4247-b0f8-24cdd8dbc4c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:20.576016 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-691ac00b-c780-4ce6-a0af-4fc9e9fba259 req-94af4935-1be1-4247-b0f8-24cdd8dbc4c5 service neutron] 10.222.0.10 "GET /v2.0/networks?id=f4182a82-fb46-4a98-997f-e7a875730a8e HTTP/1.1" status: 200 len: 914 time: 0.2399387 Dec 09 21:40:20.635905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9a8d343-fd22-46b1-9719-57f63fd01ba2 service neutron] Pushing event updated for resources: {'Port': ['ID=be95aa8d-fc0e-4d77-a861-33c1637e4f3e,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:20.648459 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-691ac00b-c780-4ce6-a0af-4fc9e9fba259 req-195812fa-db61-4f74-a3f8-993d28229b0a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a HTTP/1.1" status: 200 len: 217 time: 0.0629880 Dec 09 21:40:20.654663 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-c792587b-8b6d-4cc8-9493-b2f1e69ea218 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Delete allocated IP 172.20.0.6 (12b747a3-de78-4645-83a0-a5e2eec09a63/db7b139a-e4a1-4bdd-ab45-5fa8c8400a0b) {{(pid=103438) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Dec 09 21:40:20.727066 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-c792587b-8b6d-4cc8-9493-b2f1e69ea218 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Allocated IP 172.20.0.23 (12b747a3-de78-4645-83a0-a5e2eec09a63/7bbf8dea-d19e-405c-b7e5-dc8a3c4226f2/5cde4983-dbe9-4726-a138-e6798f96c2cd) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:40:20.763067 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-25f5a91f-1f7a-4bc6-8f41-3a5c3f48c924 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 10ac5a10-4f73-4f89-b652-3c81390af0aa {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:40:20.773426 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c738ef8-359f-4ea5-bc46-5096abb1ee7b req-a2c1dfe3-cc1e-4026-bcb2-140e2b6dc14f tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:20.775075 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4c738ef8-359f-4ea5-bc46-5096abb1ee7b req-a2c1dfe3-cc1e-4026-bcb2-140e2b6dc14f tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/ports?device_id=04a29bbd-d29d-4109-877b-a0cf1fbf9046 HTTP/1.1" status: 200 len: 945 time: 0.3718939 Dec 09 21:40:20.791249 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-25f5a91f-1f7a-4bc6-8f41-3a5c3f48c924 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:20.798158 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-e9a8d343-fd22-46b1-9719-57f63fd01ba2 service neutron] Attempting to bind port be95aa8d-fc0e-4d77-a861-33c1637e4f3e on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:20.798492 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-e9a8d343-fd22-46b1-9719-57f63fd01ba2 service neutron] Attempting to bind port be95aa8d-fc0e-4d77-a861-33c1637e4f3e by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '387b2307-6c4a-4b56-8fe0-5bcb0370db1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '71038cd4-0600-4b06-91f9-ae7f4f4807f9'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:20.798818 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-e9a8d343-fd22-46b1-9719-57f63fd01ba2 service neutron] Attempting to bind port be95aa8d-fc0e-4d77-a861-33c1637e4f3e on network 71038cd4-0600-4b06-91f9-ae7f4f4807f9 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:20.825571 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-691ac00b-c780-4ce6-a0af-4fc9e9fba259 req-408789bd-e181-43b3-82df-496becb68b39 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:20.825571 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-691ac00b-c780-4ce6-a0af-4fc9e9fba259 req-408789bd-e181-43b3-82df-496becb68b39 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=8a9e717f-5672-430b-b60c-abd3e3f39a5f HTTP/1.1" status: 200 len: 853 time: 0.1159234 Dec 09 21:40:20.825571 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-25f5a91f-1f7a-4bc6-8f41-3a5c3f48c924 service neutron] Transition to ACTIVE for port object 10ac5a10-4f73-4f89-b652-3c81390af0aa will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:40:20.833408 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-25f5a91f-1f7a-4bc6-8f41-3a5c3f48c924 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:20.834662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-e9a8d343-fd22-46b1-9719-57f63fd01ba2 service neutron] Port be95aa8d-fc0e-4d77-a861-33c1637e4f3e on network 71038cd4-0600-4b06-91f9-ae7f4f4807f9 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:20.834988 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-e9a8d343-fd22-46b1-9719-57f63fd01ba2 service neutron] Attempting to bind port be95aa8d-fc0e-4d77-a861-33c1637e4f3e on network 71038cd4-0600-4b06-91f9-ae7f4f4807f9 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:20.859259 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-e9a8d343-fd22-46b1-9719-57f63fd01ba2 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 39, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:40:20.860026 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-e9a8d343-fd22-46b1-9719-57f63fd01ba2 service neutron] Checking segment: {'id': '387b2307-6c4a-4b56-8fe0-5bcb0370db1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '71038cd4-0600-4b06-91f9-ae7f4f4807f9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:40:20.860500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-e9a8d343-fd22-46b1-9719-57f63fd01ba2 service neutron] Bound using segment: {'id': '387b2307-6c4a-4b56-8fe0-5bcb0370db1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '71038cd4-0600-4b06-91f9-ae7f4f4807f9'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:40:20.861001 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-e9a8d343-fd22-46b1-9719-57f63fd01ba2 service neutron] Bound port: be95aa8d-fc0e-4d77-a861-33c1637e4f3e, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '387b2307-6c4a-4b56-8fe0-5bcb0370db1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '71038cd4-0600-4b06-91f9-ae7f4f4807f9'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:40:20.863118 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-e9a8d343-fd22-46b1-9719-57f63fd01ba2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:20.954456 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-691ac00b-c780-4ce6-a0af-4fc9e9fba259 req-01a052b1-b3a2-4899-a2c0-0189439f3054 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=f4182a82-fb46-4a98-997f-e7a875730a8e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1182919 Dec 09 21:40:21.053791 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59844) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:21.097145 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25f5a91f-1f7a-4bc6-8f41-3a5c3f48c924 service neutron] Pushing event updated for resources: {'Port': ['ID=10ac5a10-4f73-4f89-b652-3c81390af0aa,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:21.121005 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4c738ef8-359f-4ea5-bc46-5096abb1ee7b req-93bf1367-de9e-4754-a0ba-0e5bc3496f32 tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/security-groups?id=e060d354-4177-4c8e-8083-b0266b57b04e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3196166 Dec 09 21:40:21.201466 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-25f5a91f-1f7a-4bc6-8f41-3a5c3f48c924 service neutron] Attempting to bind port 10ac5a10-4f73-4f89-b652-3c81390af0aa on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:21.201806 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-25f5a91f-1f7a-4bc6-8f41-3a5c3f48c924 service neutron] Attempting to bind port 10ac5a10-4f73-4f89-b652-3c81390af0aa by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '387b2307-6c4a-4b56-8fe0-5bcb0370db1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '71038cd4-0600-4b06-91f9-ae7f4f4807f9'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:21.202137 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-25f5a91f-1f7a-4bc6-8f41-3a5c3f48c924 service neutron] Attempting to bind port 10ac5a10-4f73-4f89-b652-3c81390af0aa on network 71038cd4-0600-4b06-91f9-ae7f4f4807f9 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:21.218551 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-e9a8d343-fd22-46b1-9719-57f63fd01ba2 service neutron] For port be95aa8d-fc0e-4d77-a861-33c1637e4f3e, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:40:21.238388 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-25f5a91f-1f7a-4bc6-8f41-3a5c3f48c924 service neutron] Port 10ac5a10-4f73-4f89-b652-3c81390af0aa on network 71038cd4-0600-4b06-91f9-ae7f4f4807f9 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:21.238741 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-25f5a91f-1f7a-4bc6-8f41-3a5c3f48c924 service neutron] Attempting to bind port 10ac5a10-4f73-4f89-b652-3c81390af0aa on network 71038cd4-0600-4b06-91f9-ae7f4f4807f9 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:21.248184 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-691ac00b-c780-4ce6-a0af-4fc9e9fba259 req-0f521516-785c-40f4-b966-e1eb724860d4 service neutron] 10.222.0.10 "GET /v2.0/networks/f4182a82-fb46-4a98-997f-e7a875730a8e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2587762 Dec 09 21:40:21.249135 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-25f5a91f-1f7a-4bc6-8f41-3a5c3f48c924 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 39, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:40:21.249470 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-25f5a91f-1f7a-4bc6-8f41-3a5c3f48c924 service neutron] Checking segment: {'id': '387b2307-6c4a-4b56-8fe0-5bcb0370db1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '71038cd4-0600-4b06-91f9-ae7f4f4807f9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:40:21.249856 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-25f5a91f-1f7a-4bc6-8f41-3a5c3f48c924 service neutron] Bound using segment: {'id': '387b2307-6c4a-4b56-8fe0-5bcb0370db1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '71038cd4-0600-4b06-91f9-ae7f4f4807f9'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:40:21.250552 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-25f5a91f-1f7a-4bc6-8f41-3a5c3f48c924 service neutron] Bound port: 10ac5a10-4f73-4f89-b652-3c81390af0aa, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '387b2307-6c4a-4b56-8fe0-5bcb0370db1c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': '71038cd4-0600-4b06-91f9-ae7f4f4807f9'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:40:21.250853 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-25f5a91f-1f7a-4bc6-8f41-3a5c3f48c924 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:21.272193 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-e9a8d343-fd22-46b1-9719-57f63fd01ba2 service neutron] For port be95aa8d-fc0e-4d77-a861-33c1637e4f3e, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=be95aa8d-fc0e-4d77-a861-33c1637e4f3e,segment=NetworkSegment(387b2307-6c4a-4b56-8fe0-5bcb0370db1c),segment_id=387b2307-6c4a-4b56-8fe0-5bcb0370db1c)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:40:21.296151 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c792587b-8b6d-4cc8-9493-b2f1e69ea218 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:21.309367 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c792587b-8b6d-4cc8-9493-b2f1e69ea218 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:21.311648 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-e9a8d343-fd22-46b1-9719-57f63fd01ba2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:21.333561 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55a4550e-0234-41fd-94de-417ea55db640 req-01a7c770-4de5-4c57-9b01-a7a03b4c8ab1 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:21.341266 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-55a4550e-0234-41fd-94de-417ea55db640 req-01a7c770-4de5-4c57-9b01-a7a03b4c8ab1 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 943 time: 0.1099615 Dec 09 21:40:21.359932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-25f5a91f-1f7a-4bc6-8f41-3a5c3f48c924 service neutron] For port 10ac5a10-4f73-4f89-b652-3c81390af0aa, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:40:21.364267 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-25f5a91f-1f7a-4bc6-8f41-3a5c3f48c924 service neutron] For port 10ac5a10-4f73-4f89-b652-3c81390af0aa, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=10ac5a10-4f73-4f89-b652-3c81390af0aa,segment=NetworkSegment(387b2307-6c4a-4b56-8fe0-5bcb0370db1c),segment_id=387b2307-6c4a-4b56-8fe0-5bcb0370db1c)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:40:21.379556 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-25f5a91f-1f7a-4bc6-8f41-3a5c3f48c924 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:21.413628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-e9a8d343-fd22-46b1-9719-57f63fd01ba2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:21.414266 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-e9a8d343-fd22-46b1-9719-57f63fd01ba2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:21.418172 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-e9a8d343-fd22-46b1-9719-57f63fd01ba2 service neutron] 10.222.0.31 "PUT /v2.0/ports/be95aa8d-fc0e-4d77-a861-33c1637e4f3e HTTP/1.1" status: 200 len: 1093 time: 2.9518366 Dec 09 21:40:21.437239 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-4191cfbb-ae7e-451b-9fad-35a139964a56 None None] Allocated IP 172.20.0.18 (12b747a3-de78-4645-83a0-a5e2eec09a63/7bbf8dea-d19e-405c-b7e5-dc8a3c4226f2/3f60f042-287b-46d5-b55e-b5cb81c168ba) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:40:21.455464 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f875c61b-474a-40dc-aa86-15edf61f643d', 'tag': 'be95aa8d-fc0e-4d77-a861-33c1637e4f3e'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:40:21.457847 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-72ec82e2-711e-47dd-80d3-82bf7b5fbd89" -d '{"events": [{"name": "network-changed", "server_uuid": "f875c61b-474a-40dc-aa86-15edf61f643d", "tag": "be95aa8d-fc0e-4d77-a861-33c1637e4f3e"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:40:21.495724 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-25f5a91f-1f7a-4bc6-8f41-3a5c3f48c924 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:21.497826 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-25f5a91f-1f7a-4bc6-8f41-3a5c3f48c924 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:21.501293 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-25f5a91f-1f7a-4bc6-8f41-3a5c3f48c924 service neutron] 10.222.0.10 "PUT /v2.0/ports/10ac5a10-4f73-4f89-b652-3c81390af0aa HTTP/1.1" status: 200 len: 1092 time: 1.8631299 Dec 09 21:40:21.505674 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b2888c0f-bfde-4e70-90c2-123c413557f5', 'tag': '10ac5a10-4f73-4f89-b652-3c81390af0aa'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:40:21.513172 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2107189d-c762-4cc2-971a-8b309218b535" -d '{"events": [{"name": "network-changed", "server_uuid": "b2888c0f-bfde-4e70-90c2-123c413557f5", "tag": "10ac5a10-4f73-4f89-b652-3c81390af0aa"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:40:21.552347 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-55a4550e-0234-41fd-94de-417ea55db640 req-8563f7b9-a249-495c-addc-80b99f877a52 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1957355 Dec 09 21:40:21.586230 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25f5a91f-1f7a-4bc6-8f41-3a5c3f48c924 service neutron] Pushing event updated for resources: {'Port': ['ID=10ac5a10-4f73-4f89-b652-3c81390af0aa,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:21.617623 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9a8d343-fd22-46b1-9719-57f63fd01ba2 service neutron] Pushing event updated for resources: {'Port': ['ID=be95aa8d-fc0e-4d77-a861-33c1637e4f3e,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:21.621664 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-4191cfbb-ae7e-451b-9fad-35a139964a56 None None] For port 3f60f042-287b-46d5-b55e-b5cb81c168ba, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=3f60f042-287b-46d5-b55e-b5cb81c168ba,segment=NetworkSegment(8d15e2ef-b82d-433a-a244-0bedb82cd38c),segment_id=8d15e2ef-b82d-433a-a244-0bedb82cd38c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:21.622703 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2f834aa2-161c-4483-8e21-44d67296dd57 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] Request body: {'network': {'name': 'tempest-PortsAdminExtendedAttrsTestJSON-test-network-938594118'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:21.635578 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-691ac00b-c780-4ce6-a0af-4fc9e9fba259 req-a6933278-686a-4749-83dd-c4501861d06b service neutron] 10.222.0.10 "GET /v2.0/networks/f4182a82-fb46-4a98-997f-e7a875730a8e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3720353 Dec 09 21:40:21.666035 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4191cfbb-ae7e-451b-9fad-35a139964a56 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:21.666859 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-70503566-1b47-47af-8d9d-757d92117815 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:21.668921 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-70503566-1b47-47af-8d9d-757d92117815 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=69d79e96ec1c418aa6c619846f0fe02e&device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 1095 time: 0.1123788 Dec 09 21:40:21.670032 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2f834aa2-161c-4483-8e21-44d67296dd57 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] Made reservation on behalf of 113655eb75db4936a301d5c3fe065143 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:21.674785 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f834aa2-161c-4483-8e21-44d67296dd57 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:21.682966 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4191cfbb-ae7e-451b-9fad-35a139964a56 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:21.693583 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f834aa2-161c-4483-8e21-44d67296dd57 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:21.748905 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-1c446719-ebdc-4df9-9aa0-46b3431d25c9 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=10ac5a10-4f73-4f89-b652-3c81390af0aa HTTP/1.1" status: 200 len: 217 time: 0.0700314 Dec 09 21:40:21.819706 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4191cfbb-ae7e-451b-9fad-35a139964a56 None None] Pushing event updated for resources: {'Port': ['ID=3f60f042-287b-46d5-b55e-b5cb81c168ba,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:21.845171 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-5c418d14-732c-487a-8672-0d86646574f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:21.846809 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-5c418d14-732c-487a-8672-0d86646574f9 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=12d97cfc-9264-49cb-8e47-fd225cb6d30b HTTP/1.1" status: 200 len: 859 time: 0.0912271 Dec 09 21:40:21.889163 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-cc597948-cb8e-45ea-9b65-53723175d8e9 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=71038cd4-0600-4b06-91f9-ae7f4f4807f9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0315349 Dec 09 21:40:21.951739 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f834aa2-161c-4483-8e21-44d67296dd57 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:21.990429 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f834aa2-161c-4483-8e21-44d67296dd57 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:22.030594 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2f834aa2-161c-4483-8e21-44d67296dd57 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] vlan segment allocate from pool success with {'vlan_id': 103, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:40:22.062793 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f834aa2-161c-4483-8e21-44d67296dd57 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] Pushing event updated for resources: {'SecurityGroup': ['ID=627bf5cf-cf6a-4511-9a38-60a34c112968,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:22.070127 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f834aa2-161c-4483-8e21-44d67296dd57 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:22.070640 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-2f834aa2-161c-4483-8e21-44d67296dd57 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] Added segment 54c99a9c-b2a4-4759-bd3b-a83f82435607 of type vlan for network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 Dec 09 21:40:22.074387 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-8741e4c2-11a2-49c0-8f98-ed609ccfbd44 service neutron] 10.222.0.10 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1769812 Dec 09 21:40:22.105599 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 3f60f042-287b-46d5-b55e-b5cb81c168ba up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:40:22.146841 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f834aa2-161c-4483-8e21-44d67296dd57 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:22.184043 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-c792587b-8b6d-4cc8-9493-b2f1e69ea218 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] In _notify_port_updated(), no bound segment for port 5cde4983-dbe9-4726-a138-e6798f96c2cd on network 12b747a3-de78-4645-83a0-a5e2eec09a63 {{(pid=103438) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:40:22.191231 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c792587b-8b6d-4cc8-9493-b2f1e69ea218 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:22.192335 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c792587b-8b6d-4cc8-9493-b2f1e69ea218 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:22.193209 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f834aa2-161c-4483-8e21-44d67296dd57 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:22.194228 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c792587b-8b6d-4cc8-9493-b2f1e69ea218 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "PUT /v2.0/ports/5cde4983-dbe9-4726-a138-e6798f96c2cd HTTP/1.1" status: 200 len: 921 time: 3.0609605 Dec 09 21:40:22.201271 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f834aa2-161c-4483-8e21-44d67296dd57 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:22.202321 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f834aa2-161c-4483-8e21-44d67296dd57 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:22.205253 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59870) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:22.208251 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7953592d-d1f0-4494-bf0d-be9d5e14cf32 req-f2c49c1d-fc16-4667-acf7-80adabc94472 tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0762804 Dec 09 21:40:22.213742 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 3f60f042-287b-46d5-b55e-b5cb81c168ba triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:22.214001 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:22.262270 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-9f52ca1c-e497-4199-807f-dabdc94d16cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:22.264581 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-9f52ca1c-e497-4199-807f-dabdc94d16cf service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=69d79e96ec1c418aa6c619846f0fe02e&device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 1096 time: 0.7663555 Dec 09 21:40:22.267673 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c792587b-8b6d-4cc8-9493-b2f1e69ea218 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Port': ['ID=5cde4983-dbe9-4726-a138-e6798f96c2cd,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:22.278799 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f76ddc7-da6c-481e-bc9a-147c91f927c3 req-267da47e-a08d-4920-beab-da63d46a9f66 tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:22.280980 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1f76ddc7-da6c-481e-bc9a-147c91f927c3 req-267da47e-a08d-4920-beab-da63d46a9f66 tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.10 "GET /v2.0/ports?device_id=04a29bbd-d29d-4109-877b-a0cf1fbf9046 HTTP/1.1" status: 200 len: 945 time: 0.6392899 Dec 09 21:40:22.292173 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e6d00709-13c4-4f53-921a-0dab0366be02 req-a008c55f-e5f1-4818-b827-f45e2e4dd8a7 service neutron] 10.222.0.10 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2086737 Dec 09 21:40:22.326577 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-5ecdfa03-6232-46ec-a205-3c63e0e944cf service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=be95aa8d-fc0e-4d77-a861-33c1637e4f3e HTTP/1.1" status: 200 len: 217 time: 0.0436120 Dec 09 21:40:22.330055 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:40:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b3dac3b8-89e7-4abe-bc09-8ca07a554659 x-openstack-request-id: req-b3dac3b8-89e7-4abe-bc09-8ca07a554659 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:40:22.330636 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f875c61b-474a-40dc-aa86-15edf61f643d", "tag": "be95aa8d-fc0e-4d77-a861-33c1637e4f3e", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:40:22.331136 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-b3dac3b8-89e7-4abe-bc09-8ca07a554659 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:40:22.331923 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f875c61b-474a-40dc-aa86-15edf61f643d', 'tag': 'be95aa8d-fc0e-4d77-a861-33c1637e4f3e', 'status': 'completed', 'code': 200} Dec 09 21:40:22.402012 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2f834aa2-161c-4483-8e21-44d67296dd57 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 798 time: 1.3426230 Dec 09 21:40:22.447283 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-bba5ccbd-edbf-4ba8-8db6-c7d659a4770c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:22.449041 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-bba5ccbd-edbf-4ba8-8db6-c7d659a4770c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=12d97cfc-9264-49cb-8e47-fd225cb6d30b HTTP/1.1" status: 200 len: 859 time: 0.1105201 Dec 09 21:40:22.462500 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f834aa2-161c-4483-8e21-44d67296dd57 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] Pushing event updated for resources: {'Network': ['ID=6efd539b-a928-4cd4-86d2-56bf17c4fd70,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:22.471239 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:40:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2d16e51f-d434-4598-900e-7cd0c1b29e48 x-openstack-request-id: req-2d16e51f-d434-4598-900e-7cd0c1b29e48 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:40:22.471575 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b2888c0f-bfde-4e70-90c2-123c413557f5", "tag": "10ac5a10-4f73-4f89-b652-3c81390af0aa", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:40:22.471836 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-2d16e51f-d434-4598-900e-7cd0c1b29e48 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:40:22.472247 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b2888c0f-bfde-4e70-90c2-123c413557f5', 'tag': '10ac5a10-4f73-4f89-b652-3c81390af0aa', 'status': 'completed', 'code': 200} Dec 09 21:40:22.475494 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:40:22.501023 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-68e8a7d8-14d8-4551-ba60-17134c60a306 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=71038cd4-0600-4b06-91f9-ae7f4f4807f9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0414672 Dec 09 21:40:22.582658 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-1f76ddc7-da6c-481e-bc9a-147c91f927c3 req-4e0c5d8f-bdf1-49b0-aa4d-29102a0543ee tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Deleting port 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:40:22.584176 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1f76ddc7-da6c-481e-bc9a-147c91f927c3 req-4e0c5d8f-bdf1-49b0-aa4d-29102a0543ee tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:22.605859 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2107189d-c762-4cc2-971a-8b309218b535 req-27b8c4b0-b54c-44fb-a4b9-b5a945f91dc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:22.607429 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2107189d-c762-4cc2-971a-8b309218b535 req-27b8c4b0-b54c-44fb-a4b9-b5a945f91dc4 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=69d79e96ec1c418aa6c619846f0fe02e&device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 1095 time: 0.1279221 Dec 09 21:40:22.652580 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-8685c8fa-e7f3-4777-b12d-13a7457f3ece tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting port 5cde4983-dbe9-4726-a138-e6798f96c2cd {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:40:22.652829 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8685c8fa-e7f3-4777-b12d-13a7457f3ece tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:22.679591 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-1f76ddc7-da6c-481e-bc9a-147c91f927c3 req-4e0c5d8f-bdf1-49b0-aa4d-29102a0543ee tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] For port 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a,segment=NetworkSegment(563bc4db-400a-4e89-baf0-c14fd72fdac2),segment_id=563bc4db-400a-4e89-baf0-c14fd72fdac2)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:22.680561 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1f76ddc7-da6c-481e-bc9a-147c91f927c3 req-4e0c5d8f-bdf1-49b0-aa4d-29102a0543ee tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:22.693483 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-1f76ddc7-da6c-481e-bc9a-147c91f927c3 req-4e0c5d8f-bdf1-49b0-aa4d-29102a0543ee tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Calling delete_port for 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:40:22.793554 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2107189d-c762-4cc2-971a-8b309218b535 req-7f2d96ce-83ef-4bfd-93ce-3a2f078033bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:22.795216 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2107189d-c762-4cc2-971a-8b309218b535 req-7f2d96ce-83ef-4bfd-93ce-3a2f078033bc service neutron] 10.222.0.10 "GET /v2.0/networks?id=71038cd4-0600-4b06-91f9-ae7f4f4807f9 HTTP/1.1" status: 200 len: 920 time: 0.1686366 Dec 09 21:40:22.804902 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8685c8fa-e7f3-4777-b12d-13a7457f3ece tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:22.863541 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2107189d-c762-4cc2-971a-8b309218b535 req-bde8bfee-72ee-4b66-a198-22d373db2f2b service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=10ac5a10-4f73-4f89-b652-3c81390af0aa HTTP/1.1" status: 200 len: 217 time: 0.0559020 Dec 09 21:40:22.869495 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-8685c8fa-e7f3-4777-b12d-13a7457f3ece tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Calling delete_port for 5cde4983-dbe9-4726-a138-e6798f96c2cd owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:40:22.928344 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2107189d-c762-4cc2-971a-8b309218b535 req-a0504e25-f5cd-4b90-a994-5dcd0a272d21 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:22.929843 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2107189d-c762-4cc2-971a-8b309218b535 req-a0504e25-f5cd-4b90-a994-5dcd0a272d21 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=12d97cfc-9264-49cb-8e47-fd225cb6d30b HTTP/1.1" status: 200 len: 859 time: 0.0561700 Dec 09 21:40:22.931097 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aae74a1-6c4d-436f-b715-be7e5c665372 req-569baa83-42da-4e5c-bad2-5613ecb9a95c tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:22.939284 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6aae74a1-6c4d-436f-b715-be7e5c665372 req-569baa83-42da-4e5c-bad2-5613ecb9a95c tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/ports?device_id=04a29bbd-d29d-4109-877b-a0cf1fbf9046 HTTP/1.1" status: 200 len: 945 time: 0.2250545 Dec 09 21:40:22.981978 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-9ed93bbf-2324-4eea-bc67-880af5485642 service neutron] 10.222.0.31 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4725602 Dec 09 21:40:23.008895 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2107189d-c762-4cc2-971a-8b309218b535 req-6a740f86-e576-44dd-a59e-a6b27327fa4c service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=71038cd4-0600-4b06-91f9-ae7f4f4807f9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0710506 Dec 09 21:40:23.045910 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6aae74a1-6c4d-436f-b715-be7e5c665372 req-6ebe4260-ad42-4937-b4d7-eb967d9dcbd9 tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.13 "GET /v2.0/security-groups?id=e060d354-4177-4c8e-8083-b0266b57b04e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1014206 Dec 09 21:40:23.117449 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-958e629a-eab9-4516-8522-d5cbf4414b1b None None] Provisioning complete for port 3f60f042-287b-46d5-b55e-b5cb81c168ba triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:23.118044 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-958e629a-eab9-4516-8522-d5cbf4414b1b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:23.220828 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2107189d-c762-4cc2-971a-8b309218b535 req-5a3d01f1-332a-4e9f-a2f1-f608573f0de6 service neutron] 10.222.0.10 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2034218 Dec 09 21:40:23.298727 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32a2b93a-16b8-43a9-a831-4fd6c7769e03 req-23e0ad8d-1ea4-4440-b005-fad070a9b51d service neutron] 10.222.0.31 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3065360 Dec 09 21:40:23.300822 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1f76ddc7-da6c-481e-bc9a-147c91f927c3 req-4e0c5d8f-bdf1-49b0-aa4d-29102a0543ee tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:23.340274 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e0c5d8f-bdf1-49b0-aa4d-29102a0543ee tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Pushing event deleted for resources: {'Port': ['ID=3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:23.367504 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-958e629a-eab9-4516-8522-d5cbf4414b1b None None] Provisioning complete for port 5cde4983-dbe9-4726-a138-e6798f96c2cd triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:23.367886 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-958e629a-eab9-4516-8522-d5cbf4414b1b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:23.433310 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-1f76ddc7-da6c-481e-bc9a-147c91f927c3 req-4e0c5d8f-bdf1-49b0-aa4d-29102a0543ee tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] No DVR routers for this DVR port 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:40:23.441852 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8685c8fa-e7f3-4777-b12d-13a7457f3ece tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:23.442024 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1f76ddc7-da6c-481e-bc9a-147c91f927c3 req-4e0c5d8f-bdf1-49b0-aa4d-29102a0543ee tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:23.445344 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1f76ddc7-da6c-481e-bc9a-147c91f927c3 req-4e0c5d8f-bdf1-49b0-aa4d-29102a0543ee tempest-ServerPasswordTestJSON-218045141 tempest-ServerPasswordTestJSON-218045141-project] 10.222.0.10 "DELETE /v2.0/ports/3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a HTTP/1.1" status: 204 len: 173 time: 1.1173258 Dec 09 21:40:23.464983 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72ec82e2-711e-47dd-80d3-82bf7b5fbd89 req-5b28d12b-24a8-4261-8845-91d6b7b13594 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:23.466921 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72ec82e2-711e-47dd-80d3-82bf7b5fbd89 req-5b28d12b-24a8-4261-8845-91d6b7b13594 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=69d79e96ec1c418aa6c619846f0fe02e&device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 1096 time: 0.1003132 Dec 09 21:40:23.475672 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-958e629a-eab9-4516-8522-d5cbf4414b1b None None] Port 5cde4983-dbe9-4726-a138-e6798f96c2cd cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:40:23.498078 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8685c8fa-e7f3-4777-b12d-13a7457f3ece tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Port': ['ID=5cde4983-dbe9-4726-a138-e6798f96c2cd,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:23.508774 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-958e629a-eab9-4516-8522-d5cbf4414b1b None None] Provisioning complete for port 2c0d4683-2706-41db-8c7f-caeeb25ac34f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:23.509155 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-958e629a-eab9-4516-8522-d5cbf4414b1b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:23.591565 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-958e629a-eab9-4516-8522-d5cbf4414b1b None None] Port 2c0d4683-2706-41db-8c7f-caeeb25ac34f cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:40:23.640163 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72ec82e2-711e-47dd-80d3-82bf7b5fbd89 req-f823f4b4-6e34-4767-8310-0defbf3756e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:23.642076 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72ec82e2-711e-47dd-80d3-82bf7b5fbd89 req-f823f4b4-6e34-4767-8310-0defbf3756e0 service neutron] 10.222.0.31 "GET /v2.0/networks?id=71038cd4-0600-4b06-91f9-ae7f4f4807f9 HTTP/1.1" status: 200 len: 920 time: 0.1569614 Dec 09 21:40:23.710002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-92008974-f8c2-4edb-870a-eb9bf977aeb9 None None] Could not find standard attr ID for object 5cde4983-dbe9-4726-a138-e6798f96c2cd. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:40:23.748867 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72ec82e2-711e-47dd-80d3-82bf7b5fbd89 req-c1a1da71-6bbe-49e8-8ed3-06b57baf3935 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=be95aa8d-fc0e-4d77-a861-33c1637e4f3e HTTP/1.1" status: 200 len: 217 time: 0.0987437 Dec 09 21:40:23.857940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59912) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:23.863829 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Request body: {'port': {'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70', 'binding:host_id': 'n-h1-713301-27', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-987220013'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:23.906222 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Made reservation on behalf of dd6dde7f70a24c428d1d7ab0334a12ff for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:23.910962 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:23.945714 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72ec82e2-711e-47dd-80d3-82bf7b5fbd89 req-9822fb6d-51e7-4205-a7bf-45b38428942d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:23.947198 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72ec82e2-711e-47dd-80d3-82bf7b5fbd89 req-9822fb6d-51e7-4205-a7bf-45b38428942d service neutron] 10.222.0.31 "GET /v2.0/subnets?id=12d97cfc-9264-49cb-8e47-fd225cb6d30b HTTP/1.1" status: 200 len: 859 time: 0.1853521 Dec 09 21:40:23.948766 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:24.015209 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72ec82e2-711e-47dd-80d3-82bf7b5fbd89 req-022423fb-d9ba-4767-897c-67b66c1c296e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=71038cd4-0600-4b06-91f9-ae7f4f4807f9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0552137 Dec 09 21:40:24.056646 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2107189d-c762-4cc2-971a-8b309218b535 req-ccefa647-b9c9-4a21-afd6-cf0799ade63d service neutron] 10.222.0.10 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8209491 Dec 09 21:40:24.089278 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8685c8fa-e7f3-4777-b12d-13a7457f3ece tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:24.103206 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8685c8fa-e7f3-4777-b12d-13a7457f3ece tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/ports/5cde4983-dbe9-4726-a138-e6798f96c2cd HTTP/1.1" status: 204 len: 168 time: 1.8140118 Dec 09 21:40:24.103901 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59918) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:24.130340 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-056686af-f874-4919-89f2-d734a3c53103 req-86e598ec-7cca-4138-9580-fdca6627475f tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:24.137912 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-3b0d057d-3675-4b97-ac40-420e2b1f9911 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] GET failed (client error): The resource could not be found. Dec 09 21:40:24.138120 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-056686af-f874-4919-89f2-d734a3c53103 req-86e598ec-7cca-4138-9580-fdca6627475f tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 943 time: 0.1944263 Dec 09 21:40:24.142839 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3b0d057d-3675-4b97-ac40-420e2b1f9911 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports/5cde4983-dbe9-4726-a138-e6798f96c2cd HTTP/1.1" status: 404 len: 333 time: 0.0375669 Dec 09 21:40:24.143698 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59922) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:24.229253 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b252996-718f-489a-ac76-6c5b0df4dbc8 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:24.235080 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-774b4a34-1da0-474a-8890-9f3b6a23cfe5 None None] Could not find standard attr ID for object 5cde4983-dbe9-4726-a138-e6798f96c2cd. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:40:24.248594 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72ec82e2-711e-47dd-80d3-82bf7b5fbd89 req-0aa1342a-d61b-4a32-a242-6eabe3de0797 service neutron] 10.222.0.31 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2245169 Dec 09 21:40:24.256450 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b252996-718f-489a-ac76-6c5b0df4dbc8 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:24.257293 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-056686af-f874-4919-89f2-d734a3c53103 req-4780925b-b6cd-4d45-b108-bbc3c7d57257 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1183569 Dec 09 21:40:24.316620 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:24.321083 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b252996-718f-489a-ac76-6c5b0df4dbc8 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:24.323925 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b252996-718f-489a-ac76-6c5b0df4dbc8 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:24.327923 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5b252996-718f-489a-ac76-6c5b0df4dbc8 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/security-groups/4ef1aaa3-1ca3-439a-8a3b-3d1f51c08932 HTTP/1.1" status: 204 len: 168 time: 0.1823401 Dec 09 21:40:24.328837 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59924) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:24.334018 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '04a29bbd-d29d-4109-877b-a0cf1fbf9046', 'name': 'network-vif-deleted', 'tag': '3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:40:24.336345 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8ca4fa97-e27b-4cb0-b9d3-df60473a2c5a" -d '{"events": [{"server_uuid": "04a29bbd-d29d-4109-877b-a0cf1fbf9046", "name": "network-vif-deleted", "tag": "3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:40:24.348542 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:24.359065 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b252996-718f-489a-ac76-6c5b0df4dbc8 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4ef1aaa3-1ca3-439a-8a3b-3d1f51c08932,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:24.371508 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] device_id is not set on port 2b2de3cd-a826-421e-a93e-af341c8848f9 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:40:24.431731 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ca2c68d6-e929-4e39-bdb4-772ed312b68e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:24.470857 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ca2c68d6-e929-4e39-bdb4-772ed312b68e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:24.557187 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ca2c68d6-e929-4e39-bdb4-772ed312b68e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:24.560527 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ca2c68d6-e929-4e39-bdb4-772ed312b68e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:24.561996 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ca2c68d6-e929-4e39-bdb4-772ed312b68e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/security-groups/4f709219-0f76-4f0c-a35f-0e6bd1104f6a HTTP/1.1" status: 204 len: 168 time: 0.2287161 Dec 09 21:40:24.566788 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59934) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:24.625659 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca2c68d6-e929-4e39-bdb4-772ed312b68e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4f709219-0f76-4f0c-a35f-0e6bd1104f6a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:24.653974 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-945e5732-cd1b-4aa5-b530-e2c43abd739d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting subnet db7b139a-e4a1-4bdd-ab45-5fa8c8400a0b {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:40:24.655389 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da882cbb-5b4b-4526-ab00-206addb50320 req-f82d8d32-f416-4d20-a851-1ded241b3521 tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.1812851 Dec 09 21:40:24.661385 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-945e5732-cd1b-4aa5-b530-e2c43abd739d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:24.669672 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72ec82e2-711e-47dd-80d3-82bf7b5fbd89 req-616328f3-5073-4ec8-93bf-c97cefb64caf service neutron] 10.222.0.31 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4071317 Dec 09 21:40:24.674450 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=271cba32-1d73-4c36-ae21-4bdd5b81ec53,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:24.743600 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59942) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:24.782793 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-945e5732-cd1b-4aa5-b530-e2c43abd739d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:24.814772 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 10ac5a10-4f73-4f89-b652-3c81390af0aa details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:40:24.816767 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:40:24.835615 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-e33528bf-4c7c-4b2e-ac6b-dd2394010d1a admin admin] Deleting subnet 8a9e717f-5672-430b-b60c-abd3e3f39a5f {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:40:24.841672 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e33528bf-4c7c-4b2e-ac6b-dd2394010d1a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:24.863906 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:40:24.864500 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:40:24.904273 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device be95aa8d-fc0e-4d77-a861-33c1637e4f3e details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:40:24.905440 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e33528bf-4c7c-4b2e-ac6b-dd2394010d1a admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:24.907751 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:40:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e288084c-c603-4117-af71-ef545ef94079 x-openstack-request-id: req-e288084c-c603-4117-af71-ef545ef94079 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:40:24.908095 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "04a29bbd-d29d-4109-877b-a0cf1fbf9046", "name": "network-vif-deleted", "tag": "3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:40:24.909312 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e288084c-c603-4117-af71-ef545ef94079 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:40:24.910967 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '04a29bbd-d29d-4109-877b-a0cf1fbf9046', 'name': 'network-vif-deleted', 'tag': '3852a2c8-ddd9-4bc0-9d87-b0ff33ad929a', 'status': 'completed', 'code': 200} Dec 09 21:40:24.944767 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-945e5732-cd1b-4aa5-b530-e2c43abd739d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:25.025924 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e33528bf-4c7c-4b2e-ac6b-dd2394010d1a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:25.060355 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] device_id is not set on port 2b2de3cd-a826-421e-a93e-af341c8848f9 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:40:25.079513 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-945e5732-cd1b-4aa5-b530-e2c43abd739d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:25.083202 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:25.096194 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:25.119219 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-945e5732-cd1b-4aa5-b530-e2c43abd739d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Subnet': ['ID=db7b139a-e4a1-4bdd-ab45-5fa8c8400a0b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:25.126737 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-945e5732-cd1b-4aa5-b530-e2c43abd739d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:25.134336 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-945e5732-cd1b-4aa5-b530-e2c43abd739d tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/subnets/db7b139a-e4a1-4bdd-ab45-5fa8c8400a0b HTTP/1.1" status: 204 len: 168 time: 0.5623450 Dec 09 21:40:25.134336 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59948) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:25.145887 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-5daa7db0-25f0-48d1-b481-f8c8ec0c8e1c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'subnet': {'network_id': '12b747a3-de78-4645-83a0-a5e2eec09a63', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:25.178049 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e33528bf-4c7c-4b2e-ac6b-dd2394010d1a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:25.222109 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Checking segment: {'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:40:25.222896 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Network hostable DHCP agents. Network: 6efd539b-a928-4cd4-86d2-56bf17c4fd70, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:40:25.226567 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Pushing event updated for resources: {'Port': ['ID=2b2de3cd-a826-421e-a93e-af341c8848f9,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:25.231053 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e33528bf-4c7c-4b2e-ac6b-dd2394010d1a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8a9e717f-5672-430b-b60c-abd3e3f39a5f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:25.231238 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port be95aa8d-fc0e-4d77-a861-33c1637e4f3e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=be95aa8d-fc0e-4d77-a861-33c1637e4f3e,segment=NetworkSegment(387b2307-6c4a-4b56-8fe0-5bcb0370db1c),segment_id=387b2307-6c4a-4b56-8fe0-5bcb0370db1c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:25.233595 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e33528bf-4c7c-4b2e-ac6b-dd2394010d1a admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:25.240613 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e33528bf-4c7c-4b2e-ac6b-dd2394010d1a admin admin] 10.222.0.13 "DELETE /v2.0/subnets/8a9e717f-5672-430b-b60c-abd3e3f39a5f HTTP/1.1" status: 204 len: 168 time: 0.4939423 Dec 09 21:40:25.241518 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59950) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:25.295176 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 10ac5a10-4f73-4f89-b652-3c81390af0aa, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=10ac5a10-4f73-4f89-b652-3c81390af0aa,segment=NetworkSegment(387b2307-6c4a-4b56-8fe0-5bcb0370db1c),segment_id=387b2307-6c4a-4b56-8fe0-5bcb0370db1c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:25.315902 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:40:25.322012 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '10ac5a10-4f73-4f89-b652-3c81390af0aa', 'network_id': '71038cd4-0600-4b06-91f9-ae7f4f4807f9', 'port_id': '10ac5a10-4f73-4f89-b652-3c81390af0aa', 'mac_address': 'fa:16:3e:a7:fc:8c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 123, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '12d97cfc-9264-49cb-8e47-fd225cb6d30b', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:40:25.331038 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27561a9e-9661-44e9-9d52-966b83e099a1 None None] Network 12b747a3-de78-4645-83a0-a5e2eec09a63 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:25.335510 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'be95aa8d-fc0e-4d77-a861-33c1637e4f3e', 'network_id': '71038cd4-0600-4b06-91f9-ae7f4f4807f9', 'port_id': 'be95aa8d-fc0e-4d77-a861-33c1637e4f3e', 'mac_address': 'fa:16:3e:31:1a:bd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 123, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '12d97cfc-9264-49cb-8e47-fd225cb6d30b', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:40:25.397476 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 6efd539b-a928-4cd4-86d2-56bf17c4fd70) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:25.416066 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ecb20064-6a12-4bae-a643-e3d007e1b018 None None] Network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:25.430341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5daa7db0-25f0-48d1-b481-f8c8ec0c8e1c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:25.433972 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5daa7db0-25f0-48d1-b481-f8c8ec0c8e1c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:25.438624 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:40:25.450574 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e53f0ade-5915-4d9c-ac3b-87442efa4b3f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:25.476283 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:25.476921 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:25.477509 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:25.495595 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab2f4369-29db-4326-976c-1ac09d620900 req-eb7b7277-d63c-4e63-b101-692809a50598 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:25.497800 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab2f4369-29db-4326-976c-1ac09d620900 req-eb7b7277-d63c-4e63-b101-692809a50598 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 943 time: 0.1057887 Dec 09 21:40:25.501407 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port 2b2de3cd-a826-421e-a93e-af341c8848f9 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:25.502014 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:25.503803 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 2 to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 Dec 09 21:40:25.520723 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:25.564165 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:25.565077 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:25.565635 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:25.566186 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id be95aa8d-fc0e-4d77-a861-33c1637e4f3e {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:40:25.571120 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:25.585623 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port 2b2de3cd-a826-421e-a93e-af341c8848f9 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:25.586299 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:25.595842 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 3 to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 Dec 09 21:40:25.611568 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 10ac5a10-4f73-4f89-b652-3c81390af0aa {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:40:25.663192 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port be95aa8d-fc0e-4d77-a861-33c1637e4f3e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=be95aa8d-fc0e-4d77-a861-33c1637e4f3e,segment=NetworkSegment(387b2307-6c4a-4b56-8fe0-5bcb0370db1c),segment_id=387b2307-6c4a-4b56-8fe0-5bcb0370db1c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:25.690692 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e53f0ade-5915-4d9c-ac3b-87442efa4b3f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:25.697619 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab2f4369-29db-4326-976c-1ac09d620900 req-57404089-ac25-477c-8bfc-25fa644a6403 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1900871 Dec 09 21:40:25.706381 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:25.706916 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:25.708011 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:25.715651 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port 2b2de3cd-a826-421e-a93e-af341c8848f9 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:25.715998 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:25.716402 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 4 to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 Dec 09 21:40:25.718740 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:25.735613 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 10ac5a10-4f73-4f89-b652-3c81390af0aa, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=10ac5a10-4f73-4f89-b652-3c81390af0aa,segment=NetworkSegment(387b2307-6c4a-4b56-8fe0-5bcb0370db1c),segment_id=387b2307-6c4a-4b56-8fe0-5bcb0370db1c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:25.762743 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:25.775934 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:25.776331 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:25.776675 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:25.780509 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e53f0ade-5915-4d9c-ac3b-87442efa4b3f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f4182a82-fb46-4a98-997f-e7a875730a8e']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:25.791954 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5daa7db0-25f0-48d1-b481-f8c8ec0c8e1c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:25.804699 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port 2b2de3cd-a826-421e-a93e-af341c8848f9 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:25.805034 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:25.806814 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e53f0ade-5915-4d9c-ac3b-87442efa4b3f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '563bc4db-400a-4e89-baf0-c14fd72fdac2') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:25.807108 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e53f0ade-5915-4d9c-ac3b-87442efa4b3f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '563bc4db-400a-4e89-baf0-c14fd72fdac2') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:25.808764 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 5 to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 Dec 09 21:40:25.809873 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=be95aa8d-fc0e-4d77-a861-33c1637e4f3e,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:25.847079 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e53f0ade-5915-4d9c-ac3b-87442efa4b3f admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:25.881953 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5daa7db0-25f0-48d1-b481-f8c8ec0c8e1c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Subnet': ['ID=b3e0381c-9f11-4fed-a7da-bac9fe24aeef,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:25.895925 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:25.896645 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:25.896993 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:25.903023 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8233118-3980-45bf-aeee-fbe0983658ff req-4dd1e369-e2ae-44c4-8458-f3bde545f00a tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0588167 Dec 09 21:40:25.903752 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=10ac5a10-4f73-4f89-b652-3c81390af0aa,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:25.903940 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5daa7db0-25f0-48d1-b481-f8c8ec0c8e1c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network 12b747a3-de78-4645-83a0-a5e2eec09a63 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:40:25.905390 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-5daa7db0-25f0-48d1-b481-f8c8ec0c8e1c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:25.905647 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e53f0ade-5915-4d9c-ac3b-87442efa4b3f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:25.908563 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port 2b2de3cd-a826-421e-a93e-af341c8848f9 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:25.909325 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:25.911357 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 6 to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 Dec 09 21:40:25.914255 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5daa7db0-25f0-48d1-b481-f8c8ec0c8e1c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:25.915260 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5daa7db0-25f0-48d1-b481-f8c8ec0c8e1c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:25.921662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e53f0ade-5915-4d9c-ac3b-87442efa4b3f admin admin] Releasing vlan 139 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:40:25.922104 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e53f0ade-5915-4d9c-ac3b-87442efa4b3f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:40:25.924260 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:40:25.942244 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:25.942606 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:25.942915 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:25.945839 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59966) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:25.947388 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5daa7db0-25f0-48d1-b481-f8c8ec0c8e1c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.8119824 Dec 09 21:40:25.957323 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a372fa15-b958-4f8c-81eb-a70014375c46 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'security_group': {'name': 'tempest-secgroup-1536339700'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:25.979415 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['be95aa8d-fc0e-4d77-a861-33c1637e4f3e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:40:25.985463 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['10ac5a10-4f73-4f89-b652-3c81390af0aa'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:40:26.036437 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port 2b2de3cd-a826-421e-a93e-af341c8848f9 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:26.037379 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:26.038555 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 7 to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 Dec 09 21:40:26.045524 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a372fa15-b958-4f8c-81eb-a70014375c46 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:26.069887 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e53f0ade-5915-4d9c-ac3b-87442efa4b3f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:26.084137 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e53f0ade-5915-4d9c-ac3b-87442efa4b3f admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:26.088705 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e53f0ade-5915-4d9c-ac3b-87442efa4b3f admin admin] 10.222.0.13 "DELETE /v2.0/networks/f4182a82-fb46-4a98-997f-e7a875730a8e HTTP/1.1" status: 204 len: 168 time: 0.8455141 Dec 09 21:40:26.099310 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:26.106049 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:26.106969 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:26.158474 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e53f0ade-5915-4d9c-ac3b-87442efa4b3f admin admin] Pushing event deleted for resources: {'Network': ['ID=f4182a82-fb46-4a98-997f-e7a875730a8e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:26.160454 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port 2b2de3cd-a826-421e-a93e-af341c8848f9 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:26.160785 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:26.172273 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 8 to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 Dec 09 21:40:26.208986 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:26.209485 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:26.209942 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:26.273882 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a372fa15-b958-4f8c-81eb-a70014375c46 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:26.278292 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port 2b2de3cd-a826-421e-a93e-af341c8848f9 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:26.278925 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:26.280613 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 9 to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 Dec 09 21:40:26.292720 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a372fa15-b958-4f8c-81eb-a70014375c46 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:26.326242 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:26.326626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:26.326917 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:26.358151 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port 2b2de3cd-a826-421e-a93e-af341c8848f9 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:26.358484 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:26.361658 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 10 to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 Dec 09 21:40:26.366271 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a372fa15-b958-4f8c-81eb-a70014375c46 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:26.370686 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59974) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:26.375837 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-13e726a3-c930-44bb-85e6-816b8049a706 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'security_group': {'name': 'tempest-secgroup-1304218018'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:26.379657 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a372fa15-b958-4f8c-81eb-a70014375c46 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.4150620 Dec 09 21:40:26.388211 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a372fa15-b958-4f8c-81eb-a70014375c46 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'SecurityGroup': ['ID=98e9269d-92fc-45d8-aa1a-7334e0035224,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:26.409159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59976) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:26.416023 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:26.416514 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:26.416694 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:26.417237 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-13e726a3-c930-44bb-85e6-816b8049a706 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:26.427080 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port 2b2de3cd-a826-421e-a93e-af341c8848f9 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:26.427847 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port 2b2de3cd-a826-421e-a93e-af341c8848f9 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:26.428633 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:26.480021 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a8c35f54-e131-420a-8b0f-98c62566ddbd admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=57607f00f2d942f4b6f084f9e9a9493a&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0692558 Dec 09 21:40:26.482519 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59978) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:26.529761 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-13e726a3-c930-44bb-85e6-816b8049a706 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:26.536980 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-13e726a3-c930-44bb-85e6-816b8049a706 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:26.572862 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13e726a3-c930-44bb-85e6-816b8049a706 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c70baeea-eb65-4486-a58f-771f0b8c2f1c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:26.591067 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] For port 2b2de3cd-a826-421e-a93e-af341c8848f9, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:40:26.591533 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempted to set empty binding levels {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Dec 09 21:40:26.595350 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-13e726a3-c930-44bb-85e6-816b8049a706 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:26.595665 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-50859384-6b8f-4b23-b9bf-91825fd944b2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:26.598461 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-13e726a3-c930-44bb-85e6-816b8049a706 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.2266939 Dec 09 21:40:26.602614 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59984) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:26.612832 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-6f5f3a8f-05e9-433b-8563-6ecf7d78aa9a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'security_group': {'name': 'tempest-secgroup-1779598915'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:26.619930 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:26.630637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53258947-b2f0-4c58-b116-1c82929349a4 None None] Network 12b747a3-de78-4645-83a0-a5e2eec09a63 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:26.662288 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-50859384-6b8f-4b23-b9bf-91825fd944b2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:26.684077 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:26.684816 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:26.709143 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6f5f3a8f-05e9-433b-8563-6ecf7d78aa9a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:26.712723 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 10ac5a10-4f73-4f89-b652-3c81390af0aa up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:40:26.739416 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Pushing event updated for resources: {'Port': ['ID=2b2de3cd-a826-421e-a93e-af341c8848f9,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:26.759234 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ed4b6d09-07a1-40e9-ae11-bc8cf483f738 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 980 time: 2.8999143 Dec 09 21:40:26.764429 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59990) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:26.767819 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-87cd2138-8b1d-4052-9285-509bdbebdbc3 None None] Provisioning complete for port 3f60f042-287b-46d5-b55e-b5cb81c168ba triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:26.768200 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-87cd2138-8b1d-4052-9285-509bdbebdbc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:26.779290 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-82c8ba6e-2990-4f5d-ba43-c8f7f39d3e27 req-9568af6f-c81f-4fce-b513-9eb42ec355c5 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=fb4b94af-3092-4329-b88b-a06c713c5b7c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0452974 Dec 09 21:40:26.811923 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-50859384-6b8f-4b23-b9bf-91825fd944b2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:26.817331 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-50859384-6b8f-4b23-b9bf-91825fd944b2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:26.822550 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-50859384-6b8f-4b23-b9bf-91825fd944b2 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/e060d354-4177-4c8e-8083-b0266b57b04e HTTP/1.1" status: 204 len: 168 time: 0.3366842 Dec 09 21:40:26.868522 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50859384-6b8f-4b23-b9bf-91825fd944b2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e060d354-4177-4c8e-8083-b0266b57b04e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:26.883357 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-a6043e2d-e1ec-45da-b7ae-f1326a250cff tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Deleting port 2b2de3cd-a826-421e-a93e-af341c8848f9 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:40:26.883841 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a6043e2d-e1ec-45da-b7ae-f1326a250cff tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:26.908009 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device be95aa8d-fc0e-4d77-a861-33c1637e4f3e up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:40:26.975351 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-82c8ba6e-2990-4f5d-ba43-c8f7f39d3e27 req-3ef1b1df-6464-4a5b-9911-567e1dd67e75 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=46cc52272a6f4269af0142f9b3345dac&device_id=fb4b94af-3092-4329-b88b-a06c713c5b7c HTTP/1.1" status: 200 len: 210 time: 0.0906074 Dec 09 21:40:27.006457 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 10ac5a10-4f73-4f89-b652-3c81390af0aa completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:40:27.032014 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 10ac5a10-4f73-4f89-b652-3c81390af0aa triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:27.032860 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:27.057202 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-a6043e2d-e1ec-45da-b7ae-f1326a250cff tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] For port 2b2de3cd-a826-421e-a93e-af341c8848f9, host n-h1-713301-27, got binding levels [] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:27.057610 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a6043e2d-e1ec-45da-b7ae-f1326a250cff tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:27.077365 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6f5f3a8f-05e9-433b-8563-6ecf7d78aa9a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:27.080299 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-82c8ba6e-2990-4f5d-ba43-c8f7f39d3e27 req-5b9918d9-8e2a-4128-9b91-97c4412d2fca service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=46cc52272a6f4269af0142f9b3345dac&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0788045 Dec 09 21:40:27.082558 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-a6043e2d-e1ec-45da-b7ae-f1326a250cff tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Calling delete_port for 2b2de3cd-a826-421e-a93e-af341c8848f9 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:40:27.092711 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-87cd2138-8b1d-4052-9285-509bdbebdbc3 None None] Provisioning complete for port 2c0d4683-2706-41db-8c7f-caeeb25ac34f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:27.093008 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-87cd2138-8b1d-4052-9285-509bdbebdbc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:27.093250 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b929626-733a-419b-8b23-2c061699726c req-72913e63-7292-4b9a-80f4-a05e9b895a64 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:27.095635 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b929626-733a-419b-8b23-2c061699726c req-72913e63-7292-4b9a-80f4-a05e9b895a64 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 944 time: 0.2389891 Dec 09 21:40:27.146498 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6f5f3a8f-05e9-433b-8563-6ecf7d78aa9a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:27.205199 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a6043e2d-e1ec-45da-b7ae-f1326a250cff tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:27.216331 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:27.244078 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6043e2d-e1ec-45da-b7ae-f1326a250cff tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Pushing event deleted for resources: {'Port': ['ID=2b2de3cd-a826-421e-a93e-af341c8848f9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:27.248069 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-87cd2138-8b1d-4052-9285-509bdbebdbc3 None None] Port 2c0d4683-2706-41db-8c7f-caeeb25ac34f cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:40:27.260583 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a6043e2d-e1ec-45da-b7ae-f1326a250cff tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:27.265461 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a6043e2d-e1ec-45da-b7ae-f1326a250cff tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] 10.222.0.13 "DELETE /v2.0/ports/2b2de3cd-a826-421e-a93e-af341c8848f9 HTTP/1.1" status: 204 len: 168 time: 0.4988654 Dec 09 21:40:27.268206 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60002) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:27.287683 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port be95aa8d-fc0e-4d77-a861-33c1637e4f3e completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:40:27.294659 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b929626-733a-419b-8b23-2c061699726c req-c91c9e20-65e6-4b0e-bae0-3ac7789b40cb tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1799109 Dec 09 21:40:27.303446 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-4e28c849-918a-4556-b07c-6c7302b218cb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] GET failed (client error): The resource could not be found. Dec 09 21:40:27.305068 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4e28c849-918a-4556-b07c-6c7302b218cb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] 10.222.0.13 "GET /v2.0/ports/2b2de3cd-a826-421e-a93e-af341c8848f9 HTTP/1.1" status: 404 len: 333 time: 0.0354068 Dec 09 21:40:27.309390 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60004) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:27.321901 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-22049c88-f1e8-4f49-b375-324450cfe7db tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Request body: {'port': {'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-1113797239'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:27.326553 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b2888c0f-bfde-4e70-90c2-123c413557f5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '10ac5a10-4f73-4f89-b652-3c81390af0aa'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:40:27.337322 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-50031df0-f777-48b4-a413-9051502c9de9" -d '{"events": [{"server_uuid": "b2888c0f-bfde-4e70-90c2-123c413557f5", "name": "network-vif-plugged", "status": "completed", "tag": "10ac5a10-4f73-4f89-b652-3c81390af0aa"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:40:27.353866 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port be95aa8d-fc0e-4d77-a861-33c1637e4f3e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:27.354239 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:27.354732 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6f5f3a8f-05e9-433b-8563-6ecf7d78aa9a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:27.356080 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6f5f3a8f-05e9-433b-8563-6ecf7d78aa9a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.7523720 Dec 09 21:40:27.360403 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60010) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:27.367208 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f5f3a8f-05e9-433b-8563-6ecf7d78aa9a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a05feec8-cbc0-4af6-9481-701e3b463a09,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:27.392239 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b95762db-6b3d-48d6-858a-775f7aae5f05 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-81446644', 'security_groups': ['a05feec8-cbc0-4af6-9481-701e3b463a09'], 'network_id': '12b747a3-de78-4645-83a0-a5e2eec09a63', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': 'b3e0381c-9f11-4fed-a7da-bac9fe24aeef'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:27.415510 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:27.423052 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 10ac5a10-4f73-4f89-b652-3c81390af0aa, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=10ac5a10-4f73-4f89-b652-3c81390af0aa,segment=NetworkSegment(387b2307-6c4a-4b56-8fe0-5bcb0370db1c),segment_id=387b2307-6c4a-4b56-8fe0-5bcb0370db1c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:27.424664 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:27.426411 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eed6ae56-1a3a-4192-8112-79c471c6b81f None None] Update dhcp port {'port': {'network_id': '12b747a3-de78-4645-83a0-a5e2eec09a63', 'fixed_ips': [{'subnet_id': '7bbf8dea-d19e-405c-b7e5-dc8a3c4226f2', 'ip_address': '172.20.0.18'}, {'subnet_id': 'b3e0381c-9f11-4fed-a7da-bac9fe24aeef'}], 'binding:host_id': 'n-d-713301-27'}, 'id': '3f60f042-287b-46d5-b55e-b5cb81c168ba'} from n-d-713301-27. {{(pid=103439) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 09 21:40:27.451168 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:27.454265 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-22049c88-f1e8-4f49-b375-324450cfe7db tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Made reservation on behalf of dd6dde7f70a24c428d1d7ab0334a12ff for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:27.456992 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-22049c88-f1e8-4f49-b375-324450cfe7db tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:27.506794 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3c9b22c6-ce80-4310-a8fb-84122e89e41a req-b7dd3339-8176-45e3-8bee-846d6bad3052 tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0550671 Dec 09 21:40:27.518964 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82c8ba6e-2990-4f5d-ba43-c8f7f39d3e27 req-655ca333-a5c5-4811-92be-a3a57ef82237 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:27.522107 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-22049c88-f1e8-4f49-b375-324450cfe7db tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] device_id is not set on port 44808c26-3b18-4179-854e-d1e23abecd38 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:40:27.524090 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-82c8ba6e-2990-4f5d-ba43-c8f7f39d3e27 req-655ca333-a5c5-4811-92be-a3a57ef82237 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4243588 Dec 09 21:40:27.537689 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=10ac5a10-4f73-4f89-b652-3c81390af0aa,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:27.553817 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eed6ae56-1a3a-4192-8112-79c471c6b81f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:27.664712 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:40:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0bfb7382-b079-4c67-b829-6901b782581f x-openstack-request-id: req-0bfb7382-b079-4c67-b829-6901b782581f {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:40:27.665441 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b95762db-6b3d-48d6-858a-775f7aae5f05 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:27.665574 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b2888c0f-bfde-4e70-90c2-123c413557f5", "name": "network-vif-plugged", "status": "completed", "tag": "10ac5a10-4f73-4f89-b652-3c81390af0aa", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:40:27.665574 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0bfb7382-b079-4c67-b829-6901b782581f {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:40:27.665740 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b2888c0f-bfde-4e70-90c2-123c413557f5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '10ac5a10-4f73-4f89-b652-3c81390af0aa', 'code': 200} Dec 09 21:40:27.678397 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:27.881088 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b95762db-6b3d-48d6-858a-775f7aae5f05 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:27.889021 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-22049c88-f1e8-4f49-b375-324450cfe7db tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:27.921659 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4526db9-5a11-4e95-b97c-0e90b938e16b req-9c3e8cc0-3ede-4c28-81ab-1454a4736deb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:27.923805 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d4526db9-5a11-4e95-b97c-0e90b938e16b req-9c3e8cc0-3ede-4c28-81ab-1454a4736deb service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 1097 time: 0.1963382 Dec 09 21:40:27.925179 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-b95762db-6b3d-48d6-858a-775f7aae5f05 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] device_id is not set on port 3d9a376b-9453-4ae2-8d58-8912f29c259f yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:40:28.064241 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port be95aa8d-fc0e-4d77-a861-33c1637e4f3e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=be95aa8d-fc0e-4d77-a861-33c1637e4f3e,segment=NetworkSegment(387b2307-6c4a-4b56-8fe0-5bcb0370db1c),segment_id=387b2307-6c4a-4b56-8fe0-5bcb0370db1c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:28.066107 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-eed6ae56-1a3a-4192-8112-79c471c6b81f None None] Allocated IP 172.20.0.2 (12b747a3-de78-4645-83a0-a5e2eec09a63/b3e0381c-9f11-4fed-a7da-bac9fe24aeef/3f60f042-287b-46d5-b55e-b5cb81c168ba) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:40:28.066759 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-22049c88-f1e8-4f49-b375-324450cfe7db tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:28.071630 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:28.082374 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d4526db9-5a11-4e95-b97c-0e90b938e16b req-4c2dd6c7-db1a-4c55-9178-b7437818fcbb service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1490424 Dec 09 21:40:28.097562 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60038) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:28.159100 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-22049c88-f1e8-4f49-b375-324450cfe7db tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:40:28.168936 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-22049c88-f1e8-4f49-b375-324450cfe7db tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:28.176176 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22049c88-f1e8-4f49-b375-324450cfe7db tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:40:28.177122 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-22049c88-f1e8-4f49-b375-324450cfe7db tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:28.177741 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-22049c88-f1e8-4f49-b375-324450cfe7db tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:28.184215 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22049c88-f1e8-4f49-b375-324450cfe7db tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Pushing event updated for resources: {'Port': ['ID=44808c26-3b18-4179-854e-d1e23abecd38,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:28.192378 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=be95aa8d-fc0e-4d77-a861-33c1637e4f3e,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:28.210470 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-22049c88-f1e8-4f49-b375-324450cfe7db tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 960 time: 0.8965902 Dec 09 21:40:28.210814 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60042) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:28.216032 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Request body: {'port': {'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:28.224847 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-eed6ae56-1a3a-4192-8112-79c471c6b81f None None] For port 3f60f042-287b-46d5-b55e-b5cb81c168ba, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=3f60f042-287b-46d5-b55e-b5cb81c168ba,segment=NetworkSegment(8d15e2ef-b82d-433a-a244-0bedb82cd38c),segment_id=8d15e2ef-b82d-433a-a244-0bedb82cd38c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:28.259375 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eed6ae56-1a3a-4192-8112-79c471c6b81f None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:28.266139 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eed6ae56-1a3a-4192-8112-79c471c6b81f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:28.287790 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-abd9922e-f141-4807-99e8-edc440d3f968 admin admin] Request body: {'network': {'name': 'tempest-ServersTestJSON-828306888-network', 'tenant_id': '0569bc74c98b4ae2980de7af929e97eb'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:28.353411 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:28.370308 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-b95762db-6b3d-48d6-858a-775f7aae5f05 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Allocated IP 172.20.0.5 (12b747a3-de78-4645-83a0-a5e2eec09a63/b3e0381c-9f11-4fed-a7da-bac9fe24aeef/3d9a376b-9453-4ae2-8d58-8912f29c259f) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:40:28.403528 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eed6ae56-1a3a-4192-8112-79c471c6b81f None None] Pushing event updated for resources: {'Port': ['ID=3f60f042-287b-46d5-b55e-b5cb81c168ba,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:28.488188 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-abd9922e-f141-4807-99e8-edc440d3f968 admin admin] Made reservation on behalf of 0569bc74c98b4ae2980de7af929e97eb for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:28.490467 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-abd9922e-f141-4807-99e8-edc440d3f968 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:28.526193 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-abd9922e-f141-4807-99e8-edc440d3f968 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:28.573404 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b95762db-6b3d-48d6-858a-775f7aae5f05 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:28.604990 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecc34c07-c280-4bd1-9c0d-8b386f320e5f req-2f4d807b-80dc-4ceb-9edf-8840ef99fd73 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:28.606972 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ecc34c07-c280-4bd1-9c0d-8b386f320e5f req-2f4d807b-80dc-4ceb-9edf-8840ef99fd73 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.1201761 Dec 09 21:40:28.615145 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b95762db-6b3d-48d6-858a-775f7aae5f05 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:28.636921 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] device_id is not set on port 44808c26-3b18-4179-854e-d1e23abecd38 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:40:28.663406 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:28.664400 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b95762db-6b3d-48d6-858a-775f7aae5f05 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network 12b747a3-de78-4645-83a0-a5e2eec09a63 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:40:28.674778 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-b95762db-6b3d-48d6-858a-775f7aae5f05 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:28.677110 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b95762db-6b3d-48d6-858a-775f7aae5f05 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Port': ['ID=3d9a376b-9453-4ae2-8d58-8912f29c259f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:28.680095 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b95762db-6b3d-48d6-858a-775f7aae5f05 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:40:28.705550 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:28.753845 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b95762db-6b3d-48d6-858a-775f7aae5f05 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:28.754641 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b95762db-6b3d-48d6-858a-775f7aae5f05 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:28.784542 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b95762db-6b3d-48d6-858a-775f7aae5f05 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 922 time: 1.4208810 Dec 09 21:40:28.789201 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60058) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:28.799109 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-6943518f-c1ed-4151-a1e3-67385d3c53cc tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'subnet': {'network_id': '12b747a3-de78-4645-83a0-a5e2eec09a63', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:28.804159 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ecc34c07-c280-4bd1-9c0d-8b386f320e5f req-c5f45e98-028f-40da-abfd-b90239cfee87 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1858897 Dec 09 21:40:28.822162 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Pushing event updated for resources: {'Port': ['ID=44808c26-3b18-4179-854e-d1e23abecd38,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:28.832468 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-abd9922e-f141-4807-99e8-edc440d3f968 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:28.867400 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-abd9922e-f141-4807-99e8-edc440d3f968 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:28.886219 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:28.886571 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:28.886919 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:28.898767 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-abd9922e-f141-4807-99e8-edc440d3f968 admin admin] vlan segment allocate from pool success with {'vlan_id': 124, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:40:28.916203 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port 44808c26-3b18-4179-854e-d1e23abecd38 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:28.916564 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:28.925526 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 2 to bind port 44808c26-3b18-4179-854e-d1e23abecd38 Dec 09 21:40:28.931390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abd9922e-f141-4807-99e8-edc440d3f968 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aa1e3507-1069-4293-bda7-11f629ade927,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:28.934241 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-abd9922e-f141-4807-99e8-edc440d3f968 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:28.934604 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-abd9922e-f141-4807-99e8-edc440d3f968 admin admin] Added segment fbdfbe70-d844-485b-ae9b-b09d060fd481 of type vlan for network ba3aee78-4661-4c71-9b18-af1e6a07faff Dec 09 21:40:28.964870 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fb58919b-29e2-4f28-9c7c-10ecbbdf00ae req-3720bfa0-4b73-438e-a6e5-e24f0a0fe789 tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0551617 Dec 09 21:40:28.974711 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:28.975575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:28.975750 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:29.007926 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port 44808c26-3b18-4179-854e-d1e23abecd38 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:29.008179 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:29.012280 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 3 to bind port 44808c26-3b18-4179-854e-d1e23abecd38 Dec 09 21:40:29.022265 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6943518f-c1ed-4151-a1e3-67385d3c53cc tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:29.027127 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6943518f-c1ed-4151-a1e3-67385d3c53cc tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:29.038354 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-abd9922e-f141-4807-99e8-edc440d3f968 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:29.040717 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:29.041055 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:29.041395 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:29.066798 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port 44808c26-3b18-4179-854e-d1e23abecd38 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:29.067150 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:29.070178 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 4 to bind port 44808c26-3b18-4179-854e-d1e23abecd38 Dec 09 21:40:29.097492 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:29.097836 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:29.098179 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:29.103637 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port 44808c26-3b18-4179-854e-d1e23abecd38 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:29.103970 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:29.104365 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 5 to bind port 44808c26-3b18-4179-854e-d1e23abecd38 Dec 09 21:40:29.114569 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-abd9922e-f141-4807-99e8-edc440d3f968 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:29.115679 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-abd9922e-f141-4807-99e8-edc440d3f968 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:29.116264 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-abd9922e-f141-4807-99e8-edc440d3f968 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:29.153560 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:29.153929 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:29.154241 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:29.179375 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-abd9922e-f141-4807-99e8-edc440d3f968 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 878 time: 1.0779831 Dec 09 21:40:29.179375 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port 44808c26-3b18-4179-854e-d1e23abecd38 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:29.179779 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:29.180196 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60064) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:29.180772 n-d-713301-27 neutron-server[103437]: INFO neutron.db.ipam_backend_mixin [None req-6943518f-c1ed-4151-a1e3-67385d3c53cc tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Validation for CIDR: 172.20.0.0/28 failed - overlaps with subnet b3e0381c-9f11-4fed-a7da-bac9fe24aeef (CIDR: 172.20.0.0/28) Dec 09 21:40:29.186191 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-6943518f-c1ed-4151-a1e3-67385d3c53cc tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:40:29.186798 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6943518f-c1ed-4151-a1e3-67385d3c53cc tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:40:29.204708 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 6 to bind port 44808c26-3b18-4179-854e-d1e23abecd38 Dec 09 21:40:29.208313 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6943518f-c1ed-4151-a1e3-67385d3c53cc tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.4178371 Dec 09 21:40:29.209244 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60066) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:29.217142 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b673129d-b7b0-4d52-a9c3-153a3fdd4333 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'subnet': {'network_id': '12b747a3-de78-4645-83a0-a5e2eec09a63', 'cidr': '172.20.0.16/28', 'ip_version': 4, 'gateway_ip': '172.20.0.17'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:29.220005 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-3ecf3dbf-f2fb-4c7b-9840-a3905783e6d1 admin admin] Request body: {'subnet': {'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersTestJSON-828306888-subnet', 'tenant_id': '0569bc74c98b4ae2980de7af929e97eb', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:29.230807 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abd9922e-f141-4807-99e8-edc440d3f968 admin admin] Pushing event updated for resources: {'Network': ['ID=ba3aee78-4661-4c71-9b18-af1e6a07faff,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:29.240175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:29.240678 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:29.241173 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:29.253394 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port 44808c26-3b18-4179-854e-d1e23abecd38 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:29.253990 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:29.256059 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 7 to bind port 44808c26-3b18-4179-854e-d1e23abecd38 Dec 09 21:40:29.262930 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network ba3aee78-4661-4c71-9b18-af1e6a07faff details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:40:29.274964 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3ecf3dbf-f2fb-4c7b-9840-a3905783e6d1 admin admin] Made reservation on behalf of 0569bc74c98b4ae2980de7af929e97eb for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:29.277342 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3ecf3dbf-f2fb-4c7b-9840-a3905783e6d1 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:29.285655 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-aee9e55e-9306-418d-b07e-243fc9b3bb07 None None] Provisioning complete for port 3f60f042-287b-46d5-b55e-b5cb81c168ba triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:29.286372 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aee9e55e-9306-418d-b07e-243fc9b3bb07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:29.310118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:29.310461 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:29.310812 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:29.324744 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port 44808c26-3b18-4179-854e-d1e23abecd38 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:29.325080 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:29.350672 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 8 to bind port 44808c26-3b18-4179-854e-d1e23abecd38 Dec 09 21:40:29.380309 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:29.380885 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:29.381390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:29.393080 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port 44808c26-3b18-4179-854e-d1e23abecd38 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:29.393420 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:29.396199 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 9 to bind port 44808c26-3b18-4179-854e-d1e23abecd38 Dec 09 21:40:29.442905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:29.443245 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:29.449656 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:29.451072 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-aee9e55e-9306-418d-b07e-243fc9b3bb07 None None] Provisioning complete for port 2c0d4683-2706-41db-8c7f-caeeb25ac34f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:29.451880 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aee9e55e-9306-418d-b07e-243fc9b3bb07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:29.456853 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b673129d-b7b0-4d52-a9c3-153a3fdd4333 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:29.460569 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b673129d-b7b0-4d52-a9c3-153a3fdd4333 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:29.489235 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-aee9e55e-9306-418d-b07e-243fc9b3bb07 None None] Port 2c0d4683-2706-41db-8c7f-caeeb25ac34f cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:40:29.525925 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port 44808c26-3b18-4179-854e-d1e23abecd38 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:29.526396 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:29.528755 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 10 to bind port 44808c26-3b18-4179-854e-d1e23abecd38 Dec 09 21:40:29.571988 n-d-713301-27 neutron-server[103437]: INFO neutron.db.ipam_backend_mixin [None req-b673129d-b7b0-4d52-a9c3-153a3fdd4333 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Validation for CIDR: 172.20.0.16/28 failed - overlaps with subnet 7bbf8dea-d19e-405c-b7e5-dc8a3c4226f2 (CIDR: 172.20.0.16/28) Dec 09 21:40:29.576280 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-b673129d-b7b0-4d52-a9c3-153a3fdd4333 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:40:29.576926 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b673129d-b7b0-4d52-a9c3-153a3fdd4333 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:40:29.579063 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:29.579577 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:29.580007 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:29.592208 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port 44808c26-3b18-4179-854e-d1e23abecd38 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:29.592691 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port 44808c26-3b18-4179-854e-d1e23abecd38 on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:29.593227 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:29.596749 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b673129d-b7b0-4d52-a9c3-153a3fdd4333 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 425 time: 0.3852756 Dec 09 21:40:29.597356 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60072) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:29.602358 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-d024c351-9230-43a6-92a3-5c5b18f6cf24 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'subnet': {'network_id': '12b747a3-de78-4645-83a0-a5e2eec09a63', 'cidr': '172.20.0.32/28', 'ip_version': 4, 'gateway_ip': '172.20.0.33'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:29.615161 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-671f1c04-c5de-46c5-8e65-a958147b4ce6 None None] Provisioning complete for port 3d9a376b-9453-4ae2-8d58-8912f29c259f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:29.615869 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-671f1c04-c5de-46c5-8e65-a958147b4ce6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:29.637012 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3ecf3dbf-f2fb-4c7b-9840-a3905783e6d1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:29.660184 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-671f1c04-c5de-46c5-8e65-a958147b4ce6 None None] Port 3d9a376b-9453-4ae2-8d58-8912f29c259f cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:40:29.667084 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f875c61b-474a-40dc-aa86-15edf61f643d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'be95aa8d-fc0e-4d77-a861-33c1637e4f3e'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:40:29.670875 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f016ba51-f622-418e-ac84-6d5109cc5b60" -d '{"events": [{"server_uuid": "f875c61b-474a-40dc-aa86-15edf61f643d", "name": "network-vif-plugged", "status": "completed", "tag": "be95aa8d-fc0e-4d77-a861-33c1637e4f3e"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:40:29.711423 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] For port 44808c26-3b18-4179-854e-d1e23abecd38, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:40:29.711857 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempted to set empty binding levels {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Dec 09 21:40:29.713278 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ecf3dbf-f2fb-4c7b-9840-a3905783e6d1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b61ac70f-1e8d-40a8-9031-bab15f73fa0a,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:29.724357 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:29.737864 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:40:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-472535e3-deb0-49a3-b9de-573b5593d79f x-openstack-request-id: req-472535e3-deb0-49a3-b9de-573b5593d79f {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:40:29.738250 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f875c61b-474a-40dc-aa86-15edf61f643d", "name": "network-vif-plugged", "status": "completed", "tag": "be95aa8d-fc0e-4d77-a861-33c1637e4f3e", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:40:29.738642 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-472535e3-deb0-49a3-b9de-573b5593d79f {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:40:29.739071 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f875c61b-474a-40dc-aa86-15edf61f643d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'be95aa8d-fc0e-4d77-a861-33c1637e4f3e', 'code': 200} Dec 09 21:40:29.748805 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d024c351-9230-43a6-92a3-5c5b18f6cf24 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Made reservation on behalf of e8bdea0c320d4955bc3ba905696bda85 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:29.755481 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d024c351-9230-43a6-92a3-5c5b18f6cf24 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:29.808769 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] In _notify_port_updated(), no bound segment for port 44808c26-3b18-4179-854e-d1e23abecd38 on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:40:29.810350 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:29.811049 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:29.814756 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] 10.222.0.13 "PUT /v2.0/ports/44808c26-3b18-4179-854e-d1e23abecd38 HTTP/1.1" status: 200 len: 976 time: 1.6007283 Dec 09 21:40:29.815730 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ecf3dbf-f2fb-4c7b-9840-a3905783e6d1 admin admin] Checking segment: {'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:40:29.816148 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ecf3dbf-f2fb-4c7b-9840-a3905783e6d1 admin admin] Network hostable DHCP agents. Network: ba3aee78-4661-4c71-9b18-af1e6a07faff, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:40:29.821557 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60082) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:30.024322 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d024c351-9230-43a6-92a3-5c5b18f6cf24 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:30.072622 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d024c351-9230-43a6-92a3-5c5b18f6cf24 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Network 12b747a3-de78-4645-83a0-a5e2eec09a63 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:40:30.075891 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-d024c351-9230-43a6-92a3-5c5b18f6cf24 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:30.080319 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d024c351-9230-43a6-92a3-5c5b18f6cf24 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:30.080905 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d024c351-9230-43a6-92a3-5c5b18f6cf24 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:30.092505 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aebf79d9-d09e-423c-909d-76f37b3b05da None None] Network 12b747a3-de78-4645-83a0-a5e2eec09a63 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:30.097658 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d024c351-9230-43a6-92a3-5c5b18f6cf24 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Subnet': ['ID=7bf13a7c-5b49-48fb-84c2-6ebd90353ec1,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:30.110249 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d024c351-9230-43a6-92a3-5c5b18f6cf24 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 804 time: 0.5116687 Dec 09 21:40:30.111092 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60092) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:30.116765 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2161fb98-d236-4b52-9a36-9fb6ef50d54b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Request body: {'port': {'name': 'tempest-PortsTestJSON-1246990977', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': '7bf13a7c-5b49-48fb-84c2-6ebd90353ec1'}], 'security_groups': ['98e9269d-92fc-45d8-aa1a-7334e0035224', 'c70baeea-eb65-4486-a58f-771f0b8c2f1c']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:30.190537 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-101c1afc-cf24-46e8-85ab-ecf8df5731bb tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Pushing event updated for resources: {'Port': ['ID=44808c26-3b18-4179-854e-d1e23abecd38,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:30.233954 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2161fb98-d236-4b52-9a36-9fb6ef50d54b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:30.289768 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 3f60f042-287b-46d5-b55e-b5cb81c168ba up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:40:30.331886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ecf3dbf-f2fb-4c7b-9840-a3905783e6d1 admin admin] Network ba3aee78-4661-4c71-9b18-af1e6a07faff is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:40:30.343787 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb001973-8764-498e-b1f5-94e9ce1ab00f tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:30.345084 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb001973-8764-498e-b1f5-94e9ce1ab00f tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:30.345694 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb001973-8764-498e-b1f5-94e9ce1ab00f tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:30.346298 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb001973-8764-498e-b1f5-94e9ce1ab00f tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:30.346898 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb001973-8764-498e-b1f5-94e9ce1ab00f tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:30.347514 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb001973-8764-498e-b1f5-94e9ce1ab00f tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:30.348105 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb001973-8764-498e-b1f5-94e9ce1ab00f tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:30.348690 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb001973-8764-498e-b1f5-94e9ce1ab00f tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:30.349274 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb001973-8764-498e-b1f5-94e9ce1ab00f tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:30.349895 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb001973-8764-498e-b1f5-94e9ce1ab00f tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:30.350485 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb001973-8764-498e-b1f5-94e9ce1ab00f tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:30.351067 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb001973-8764-498e-b1f5-94e9ce1ab00f tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:30.357321 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-eb001973-8764-498e-b1f5-94e9ce1ab00f tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 10816 time: 0.5346072 Dec 09 21:40:30.362537 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60098) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:30.366979 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a668b4c6-780d-40a8-a8ee-b77828c2b74d req-689cf6a6-0c4e-4890-880c-114614ee8564 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:30.368761 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a668b4c6-780d-40a8-a8ee-b77828c2b74d req-689cf6a6-0c4e-4890-880c-114614ee8564 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 1098 time: 0.1795375 Dec 09 21:40:30.407541 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6c67995e-5a7c-490f-9f60-fd4f7f095624 None None] Update dhcp port {'port': {'network_id': '12b747a3-de78-4645-83a0-a5e2eec09a63', 'fixed_ips': [{'subnet_id': '7bbf8dea-d19e-405c-b7e5-dc8a3c4226f2', 'ip_address': '172.20.0.18'}, {'subnet_id': 'b3e0381c-9f11-4fed-a7da-bac9fe24aeef', 'ip_address': '172.20.0.2'}, {'subnet_id': '7bf13a7c-5b49-48fb-84c2-6ebd90353ec1'}], 'binding:host_id': 'n-d-713301-27'}, 'id': '3f60f042-287b-46d5-b55e-b5cb81c168ba'} from n-d-713301-27. {{(pid=103439) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 09 21:40:30.412867 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-3ecf3dbf-f2fb-4c7b-9840-a3905783e6d1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, ba3aee78-4661-4c71-9b18-af1e6a07faff) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:30.427348 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ecf3dbf-f2fb-4c7b-9840-a3905783e6d1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:30.428335 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3ecf3dbf-f2fb-4c7b-9840-a3905783e6d1 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:30.444981 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6c67995e-5a7c-490f-9f60-fd4f7f095624 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:30.447092 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-70cc2c36-8b26-43df-8538-3ceeaf582e91 None None] Network ba3aee78-4661-4c71-9b18-af1e6a07faff requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:30.459713 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c28ea2e1-2701-4990-93e1-8aa995f62254 req-90fabf00-600d-44fb-994e-33c89e5dfb6b tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:30.463913 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c28ea2e1-2701-4990-93e1-8aa995f62254 req-90fabf00-600d-44fb-994e-33c89e5dfb6b tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.2405868 Dec 09 21:40:30.473320 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a668b4c6-780d-40a8-a8ee-b77828c2b74d req-076ef2f5-9aba-4158-b706-dec55d2b19b8 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0927684 Dec 09 21:40:30.519873 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 3f60f042-287b-46d5-b55e-b5cb81c168ba triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:30.520356 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:30.548067 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3ecf3dbf-f2fb-4c7b-9840-a3905783e6d1 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 842 time: 1.3399529 Dec 09 21:40:30.647777 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c28ea2e1-2701-4990-93e1-8aa995f62254 req-fe17be77-d1d2-481a-9d26-918e3482edbc tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1792283 Dec 09 21:40:30.659743 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-c7c604f8-d113-4196-95ab-d8e3a3d66dc3 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Deleting port 44808c26-3b18-4179-854e-d1e23abecd38 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:40:30.662389 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7c604f8-d113-4196-95ab-d8e3a3d66dc3 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:30.699294 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-faa2daf3-93a9-4719-bfc2-e428528d34b0 None None] Network ba3aee78-4661-4c71-9b18-af1e6a07faff requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:30.726157 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-2161fb98-d236-4b52-9a36-9fb6ef50d54b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Delete allocated IP 172.20.0.5 (12b747a3-de78-4645-83a0-a5e2eec09a63/b3e0381c-9f11-4fed-a7da-bac9fe24aeef) {{(pid=103437) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Dec 09 21:40:30.750998 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-2161fb98-d236-4b52-9a36-9fb6ef50d54b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Allocated IP 172.20.0.45 (12b747a3-de78-4645-83a0-a5e2eec09a63/7bf13a7c-5b49-48fb-84c2-6ebd90353ec1/3d9a376b-9453-4ae2-8d58-8912f29c259f) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:40:30.871798 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d21f10e9-1a66-4f7c-b2ad-a7653035bc5a req-7a59fe59-54e7-4018-a902-2f2e7d56e966 tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0588515 Dec 09 21:40:30.872898 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-c7c604f8-d113-4196-95ab-d8e3a3d66dc3 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] For port 44808c26-3b18-4179-854e-d1e23abecd38, host n-h1-713301-27, got binding levels [] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:30.873332 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7c604f8-d113-4196-95ab-d8e3a3d66dc3 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:30.886849 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-c7c604f8-d113-4196-95ab-d8e3a3d66dc3 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Calling delete_port for 44808c26-3b18-4179-854e-d1e23abecd38 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:40:31.000084 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7c604f8-d113-4196-95ab-d8e3a3d66dc3 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:31.016970 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2161fb98-d236-4b52-9a36-9fb6ef50d54b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:31.025029 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2161fb98-d236-4b52-9a36-9fb6ef50d54b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:31.035949 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7c604f8-d113-4196-95ab-d8e3a3d66dc3 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Pushing event deleted for resources: {'Port': ['ID=44808c26-3b18-4179-854e-d1e23abecd38,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:31.044074 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7c604f8-d113-4196-95ab-d8e3a3d66dc3 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:31.050096 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c7c604f8-d113-4196-95ab-d8e3a3d66dc3 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] 10.222.0.13 "DELETE /v2.0/ports/44808c26-3b18-4179-854e-d1e23abecd38 HTTP/1.1" status: 204 len: 168 time: 0.6766489 Dec 09 21:40:31.050574 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60118) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:31.095792 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-d49ba16e-10e4-4911-846a-97fca3d947f8 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] GET failed (client error): The resource could not be found. Dec 09 21:40:31.097288 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d49ba16e-10e4-4911-846a-97fca3d947f8 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] 10.222.0.13 "GET /v2.0/ports/44808c26-3b18-4179-854e-d1e23abecd38 HTTP/1.1" status: 404 len: 333 time: 0.0457277 Dec 09 21:40:31.101822 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60124) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:31.106812 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-90bd76d8-45fe-447e-876a-5ac7e4bd80aa tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Request body: {'port': {'name': 'tempest-PortsAdminExtendedAttrsTestJSON-179804784', 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:31.142359 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-6c67995e-5a7c-490f-9f60-fd4f7f095624 None None] Allocated IP 172.20.0.34 (12b747a3-de78-4645-83a0-a5e2eec09a63/7bf13a7c-5b49-48fb-84c2-6ebd90353ec1/3f60f042-287b-46d5-b55e-b5cb81c168ba) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:40:31.160385 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-90bd76d8-45fe-447e-876a-5ac7e4bd80aa tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Made reservation on behalf of dd6dde7f70a24c428d1d7ab0334a12ff for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:31.163612 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-90bd76d8-45fe-447e-876a-5ac7e4bd80aa tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:31.184190 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-90bd76d8-45fe-447e-876a-5ac7e4bd80aa tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] device_id is not set on port 14bfd827-948c-4c08-96b8-67dfcf3fe616 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:40:31.260038 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2161fb98-d236-4b52-9a36-9fb6ef50d54b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event updated for resources: {'Port': ['ID=3d9a376b-9453-4ae2-8d58-8912f29c259f,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:31.282368 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-2161fb98-d236-4b52-9a36-9fb6ef50d54b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] In _notify_port_updated(), no bound segment for port 3d9a376b-9453-4ae2-8d58-8912f29c259f on network 12b747a3-de78-4645-83a0-a5e2eec09a63 {{(pid=103437) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:40:31.290196 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2161fb98-d236-4b52-9a36-9fb6ef50d54b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:31.290853 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2161fb98-d236-4b52-9a36-9fb6ef50d54b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:31.292974 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2161fb98-d236-4b52-9a36-9fb6ef50d54b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "PUT /v2.0/ports/3d9a376b-9453-4ae2-8d58-8912f29c259f HTTP/1.1" status: 200 len: 960 time: 1.1805248 Dec 09 21:40:31.297637 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60126) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:31.300734 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6c67995e-5a7c-490f-9f60-fd4f7f095624 None None] For port 3f60f042-287b-46d5-b55e-b5cb81c168ba, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=3f60f042-287b-46d5-b55e-b5cb81c168ba,segment=NetworkSegment(8d15e2ef-b82d-433a-a244-0bedb82cd38c),segment_id=8d15e2ef-b82d-433a-a244-0bedb82cd38c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:31.305360 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a150ea5f-8b43-460a-950f-bd4f902ee981 req-bff01789-9ab2-4e12-90eb-316744f24b8b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:31.306507 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a150ea5f-8b43-460a-950f-bd4f902ee981 req-bff01789-9ab2-4e12-90eb-316744f24b8b service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=69d79e96ec1c418aa6c619846f0fe02e&device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 1097 time: 0.1683183 Dec 09 21:40:31.359610 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6c67995e-5a7c-490f-9f60-fd4f7f095624 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:31.366153 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6c67995e-5a7c-490f-9f60-fd4f7f095624 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:31.443485 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a150ea5f-8b43-460a-950f-bd4f902ee981 req-2e617370-b8a0-4945-a059-9ee5427a8908 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:31.446027 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a150ea5f-8b43-460a-950f-bd4f902ee981 req-2e617370-b8a0-4945-a059-9ee5427a8908 service neutron] 10.222.0.10 "GET /v2.0/networks?id=71038cd4-0600-4b06-91f9-ae7f4f4807f9 HTTP/1.1" status: 200 len: 920 time: 0.1312127 Dec 09 21:40:31.502801 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c67995e-5a7c-490f-9f60-fd4f7f095624 None None] Pushing event updated for resources: {'Port': ['ID=3f60f042-287b-46d5-b55e-b5cb81c168ba,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:31.513414 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a150ea5f-8b43-460a-950f-bd4f902ee981 req-37bb6b5e-f8e2-42fc-8f95-145041516826 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=10ac5a10-4f73-4f89-b652-3c81390af0aa HTTP/1.1" status: 200 len: 217 time: 0.0583909 Dec 09 21:40:31.518757 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c67995e-5a7c-490f-9f60-fd4f7f095624 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:31.519941 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c67995e-5a7c-490f-9f60-fd4f7f095624 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:31.519941 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c67995e-5a7c-490f-9f60-fd4f7f095624 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:31.520229 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c67995e-5a7c-490f-9f60-fd4f7f095624 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:31.520526 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c67995e-5a7c-490f-9f60-fd4f7f095624 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:31.520859 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c67995e-5a7c-490f-9f60-fd4f7f095624 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:31.521188 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c67995e-5a7c-490f-9f60-fd4f7f095624 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:31.526060 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c67995e-5a7c-490f-9f60-fd4f7f095624 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:31.526452 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c67995e-5a7c-490f-9f60-fd4f7f095624 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:31.526796 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c67995e-5a7c-490f-9f60-fd4f7f095624 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:31.527139 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c67995e-5a7c-490f-9f60-fd4f7f095624 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:31.528400 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c67995e-5a7c-490f-9f60-fd4f7f095624 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:31.528747 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c67995e-5a7c-490f-9f60-fd4f7f095624 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:31.548801 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-90bd76d8-45fe-447e-876a-5ac7e4bd80aa tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:31.570785 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-089d2a96-b01d-438a-9196-037d2270e22b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting port 3d9a376b-9453-4ae2-8d58-8912f29c259f {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:40:31.571145 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-089d2a96-b01d-438a-9196-037d2270e22b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:31.583417 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a150ea5f-8b43-460a-950f-bd4f902ee981 req-a1d44d52-c4b4-4e97-9941-f67daabeba76 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:31.584995 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a150ea5f-8b43-460a-950f-bd4f902ee981 req-a1d44d52-c4b4-4e97-9941-f67daabeba76 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=12d97cfc-9264-49cb-8e47-fd225cb6d30b HTTP/1.1" status: 200 len: 859 time: 0.0607240 Dec 09 21:40:31.620476 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a150ea5f-8b43-460a-950f-bd4f902ee981 req-9a31ab99-ffef-4912-9c72-706d632f145c service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=71038cd4-0600-4b06-91f9-ae7f4f4807f9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0278897 Dec 09 21:40:31.668264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-600bedbb-02b3-42b1-aea5-233524402e69 req-0290f1b9-e017-40fe-99d1-c5ca8e7a8274 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:31.669680 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-600bedbb-02b3-42b1-aea5-233524402e69 req-0290f1b9-e017-40fe-99d1-c5ca8e7a8274 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/networks?id=ba3aee78-4661-4c71-9b18-af1e6a07faff HTTP/1.1" status: 200 len: 805 time: 0.3105896 Dec 09 21:40:31.715470 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-600bedbb-02b3-42b1-aea5-233524402e69 req-e43f9886-70e1-47d7-bb7c-8ba87e96c550 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/quotas/0569bc74c98b4ae2980de7af929e97eb HTTP/1.1" status: 200 len: 375 time: 0.0255382 Dec 09 21:40:31.737110 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-90bd76d8-45fe-447e-876a-5ac7e4bd80aa tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:31.743637 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a150ea5f-8b43-460a-950f-bd4f902ee981 req-c8503328-9bc4-4465-9e5c-ff3906bb6e66 service neutron] 10.222.0.10 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1142540 Dec 09 21:40:31.818270 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90bd76d8-45fe-447e-876a-5ac7e4bd80aa tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Pushing event updated for resources: {'Port': ['ID=14bfd827-948c-4c08-96b8-67dfcf3fe616,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:31.836808 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-600bedbb-02b3-42b1-aea5-233524402e69 req-0282a6e2-4a02-490e-8ed5-fba70630c59e tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=0569bc74c98b4ae2980de7af929e97eb&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1128540 Dec 09 21:40:31.841941 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-089d2a96-b01d-438a-9196-037d2270e22b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:31.856924 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-089d2a96-b01d-438a-9196-037d2270e22b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Calling delete_port for 3d9a376b-9453-4ae2-8d58-8912f29c259f owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:40:31.900340 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a150ea5f-8b43-460a-950f-bd4f902ee981 req-5cbf7f60-1188-458f-b68e-cc6087b8f64e service neutron] 10.222.0.10 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1431921 Dec 09 21:40:31.949710 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-90bd76d8-45fe-447e-876a-5ac7e4bd80aa tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:40:31.985339 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-90bd76d8-45fe-447e-876a-5ac7e4bd80aa tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:31.994250 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90bd76d8-45fe-447e-876a-5ac7e4bd80aa tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:40:31.995212 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90bd76d8-45fe-447e-876a-5ac7e4bd80aa tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:31.995851 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-90bd76d8-45fe-447e-876a-5ac7e4bd80aa tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:32.039649 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-90bd76d8-45fe-447e-876a-5ac7e4bd80aa tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 959 time: 0.9344254 Dec 09 21:40:32.040666 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60152) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:32.078239 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-600bedbb-02b3-42b1-aea5-233524402e69 req-d05bfbef-db70-472f-b5b9-2996c908f67c service neutron] 10.222.0.13 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2109435 Dec 09 21:40:32.098162 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db6cec5e-ab13-4a5b-8e1a-e8b5bddf9538 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:32.102116 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-db6cec5e-ab13-4a5b-8e1a-e8b5bddf9538 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] 10.222.0.13 "GET /v2.0/ports/14bfd827-948c-4c08-96b8-67dfcf3fe616 HTTP/1.1" status: 200 len: 954 time: 0.0568497 Dec 09 21:40:32.102598 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60158) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:32.223729 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c8403201-9df5-42d4-9b88-578ff8cf677c tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Deleting port 14bfd827-948c-4c08-96b8-67dfcf3fe616 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:40:32.224079 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8403201-9df5-42d4-9b88-578ff8cf677c tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:32.238623 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-089d2a96-b01d-438a-9196-037d2270e22b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:32.291767 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-089d2a96-b01d-438a-9196-037d2270e22b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Port': ['ID=3d9a376b-9453-4ae2-8d58-8912f29c259f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:32.306034 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8403201-9df5-42d4-9b88-578ff8cf677c tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:32.317530 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4280fe23-b9b0-46e2-88ff-4434301cc9d8 None None] Provisioning complete for port 3f60f042-287b-46d5-b55e-b5cb81c168ba triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:32.319202 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4280fe23-b9b0-46e2-88ff-4434301cc9d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:32.321017 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-600bedbb-02b3-42b1-aea5-233524402e69 req-8eb933c4-8a5d-4c14-8253-ef8f1dda43ac service neutron] 10.222.0.13 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2353890 Dec 09 21:40:32.321450 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 3f60f042-287b-46d5-b55e-b5cb81c168ba up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:40:32.337772 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c8403201-9df5-42d4-9b88-578ff8cf677c tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Calling delete_port for 14bfd827-948c-4c08-96b8-67dfcf3fe616 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:40:32.415610 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-089d2a96-b01d-438a-9196-037d2270e22b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:32.419548 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-089d2a96-b01d-438a-9196-037d2270e22b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/ports/3d9a376b-9453-4ae2-8d58-8912f29c259f HTTP/1.1" status: 204 len: 168 time: 1.1207628 Dec 09 21:40:32.422067 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60162) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:32.475405 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-fccecf4b-69f5-40ef-bd73-51db777fcf64 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] GET failed (client error): The resource could not be found. Dec 09 21:40:32.480587 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60168) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:32.489619 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8403201-9df5-42d4-9b88-578ff8cf677c tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:32.490649 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fccecf4b-69f5-40ef-bd73-51db777fcf64 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports/3d9a376b-9453-4ae2-8d58-8912f29c259f HTTP/1.1" status: 404 len: 333 time: 0.0664923 Dec 09 21:40:32.491371 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 3f60f042-287b-46d5-b55e-b5cb81c168ba triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:32.491820 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:32.560412 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8403201-9df5-42d4-9b88-578ff8cf677c tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Pushing event deleted for resources: {'Port': ['ID=14bfd827-948c-4c08-96b8-67dfcf3fe616,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:32.577631 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4280fe23-b9b0-46e2-88ff-4434301cc9d8 None None] Could not find standard attr ID for object 3d9a376b-9453-4ae2-8d58-8912f29c259f. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:40:32.596067 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8403201-9df5-42d4-9b88-578ff8cf677c tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:32.600191 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c8403201-9df5-42d4-9b88-578ff8cf677c tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] 10.222.0.13 "DELETE /v2.0/ports/14bfd827-948c-4c08-96b8-67dfcf3fe616 HTTP/1.1" status: 204 len: 168 time: 0.4964399 Dec 09 21:40:32.603336 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60172) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:32.625053 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cc5dca5c-bf4e-47cd-badb-25338e1f51de tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:32.643196 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4280fe23-b9b0-46e2-88ff-4434301cc9d8 None None] Provisioning complete for port 2c0d4683-2706-41db-8c7f-caeeb25ac34f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:32.643601 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4280fe23-b9b0-46e2-88ff-4434301cc9d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:32.647847 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-bc7f5b60-bbec-40dd-ac57-f2a134f03af5 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] GET failed (client error): The resource could not be found. Dec 09 21:40:32.650302 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bc7f5b60-bbec-40dd-ac57-f2a134f03af5 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] 10.222.0.13 "GET /v2.0/ports/14bfd827-948c-4c08-96b8-67dfcf3fe616 HTTP/1.1" status: 404 len: 333 time: 0.0458391 Dec 09 21:40:32.654315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60174) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:32.667130 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4d77b23-bd6a-4b82-beef-2f96dfc49ad7 req-2dbbe2c3-27f3-4c96-8084-1516e14261aa tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:32.672394 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4d77b23-bd6a-4b82-beef-2f96dfc49ad7 req-2dbbe2c3-27f3-4c96-8084-1516e14261aa tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.1535857 Dec 09 21:40:32.677785 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cc5dca5c-bf4e-47cd-badb-25338e1f51de tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:32.683713 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-0d0c6529-0067-4173-bd22-3f473b6ae275 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Request body: {'port': {'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70', 'name': 'tempest-PortsAdminExtendedAttrsTestJSON-450672303'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:32.737873 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-4280fe23-b9b0-46e2-88ff-4434301cc9d8 None None] Port 2c0d4683-2706-41db-8c7f-caeeb25ac34f cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:40:32.750930 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d0c6529-0067-4173-bd22-3f473b6ae275 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Made reservation on behalf of dd6dde7f70a24c428d1d7ab0334a12ff for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:32.754408 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d0c6529-0067-4173-bd22-3f473b6ae275 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:32.790421 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cc5dca5c-bf4e-47cd-badb-25338e1f51de tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:32.795807 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-0d0c6529-0067-4173-bd22-3f473b6ae275 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] device_id is not set on port cf74b9d0-67ff-4fd2-90de-8b721530cc1f yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:40:32.799426 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cc5dca5c-bf4e-47cd-badb-25338e1f51de tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:32.807205 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60180) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:32.808463 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cc5dca5c-bf4e-47cd-badb-25338e1f51de tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/security-groups/a05feec8-cbc0-4af6-9481-701e3b463a09 HTTP/1.1" status: 204 len: 168 time: 0.3266678 Dec 09 21:40:32.834511 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc5dca5c-bf4e-47cd-badb-25338e1f51de tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a05feec8-cbc0-4af6-9481-701e3b463a09,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:32.910134 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4d77b23-bd6a-4b82-beef-2f96dfc49ad7 req-45694d57-2b70-4e9e-b445-3a54eec9b6a8 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1792853 Dec 09 21:40:32.998730 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a91e1910-fe26-4004-a04d-92a511d1ea2b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:33.023771 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-550538b1-a5cf-41c5-ba00-914eb1ac8fc9 None None] Could not find standard attr ID for object 3d9a376b-9453-4ae2-8d58-8912f29c259f. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:40:33.034546 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7205a5a6-e0f2-4e2d-a989-2a6560369edb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:33.066139 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a91e1910-fe26-4004-a04d-92a511d1ea2b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:33.149458 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ea17e1c-ff8f-4de5-8c70-da8a761ded39 req-d464a55c-c510-47d6-a2e1-754f0fe20c11 tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0854907 Dec 09 21:40:33.194073 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d0c6529-0067-4173-bd22-3f473b6ae275 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:33.236998 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a91e1910-fe26-4004-a04d-92a511d1ea2b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:33.239565 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a91e1910-fe26-4004-a04d-92a511d1ea2b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:33.241462 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a91e1910-fe26-4004-a04d-92a511d1ea2b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/security-groups/c70baeea-eb65-4486-a58f-771f0b8c2f1c HTTP/1.1" status: 204 len: 168 time: 0.4329047 Dec 09 21:40:33.244236 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60194) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:33.311428 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7955fa72-7cee-42a9-8a55-81ee4250ff4a req-5d0cf90f-179c-4aa5-80e0-cf82987114ae tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1faa187b-0441-47d3-8d37-6489d51928bb HTTP/1.1" status: 200 len: 210 time: 0.0782406 Dec 09 21:40:33.318470 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25307a84-05e0-4341-95f0-2c90d4ea5f00 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:33.329587 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a91e1910-fe26-4004-a04d-92a511d1ea2b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c70baeea-eb65-4486-a58f-771f0b8c2f1c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:33.335410 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d0c6529-0067-4173-bd22-3f473b6ae275 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:33.345380 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25307a84-05e0-4341-95f0-2c90d4ea5f00 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:33.409169 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25307a84-05e0-4341-95f0-2c90d4ea5f00 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:33.411850 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25307a84-05e0-4341-95f0-2c90d4ea5f00 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:33.415543 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-25307a84-05e0-4341-95f0-2c90d4ea5f00 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/security-groups/98e9269d-92fc-45d8-aa1a-7334e0035224 HTTP/1.1" status: 204 len: 168 time: 0.1678340 Dec 09 21:40:33.415704 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d0c6529-0067-4173-bd22-3f473b6ae275 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:40:33.415926 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60196) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:33.418829 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-0d0c6529-0067-4173-bd22-3f473b6ae275 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:33.427364 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d0c6529-0067-4173-bd22-3f473b6ae275 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:40:33.428334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d0c6529-0067-4173-bd22-3f473b6ae275 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:33.429094 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d0c6529-0067-4173-bd22-3f473b6ae275 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:33.460577 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25307a84-05e0-4341-95f0-2c90d4ea5f00 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=98e9269d-92fc-45d8-aa1a-7334e0035224,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:33.460916 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d0c6529-0067-4173-bd22-3f473b6ae275 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Pushing event updated for resources: {'Port': ['ID=cf74b9d0-67ff-4fd2-90de-8b721530cc1f,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:33.473519 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0d0c6529-0067-4173-bd22-3f473b6ae275 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 959 time: 0.7991407 Dec 09 21:40:33.476467 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60198) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:33.487508 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Request body: {'port': {'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:33.497197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-18573c1f-ef5e-4051-b497-e718025a6d76 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting subnet b3e0381c-9f11-4fed-a7da-bac9fe24aeef {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:40:33.501161 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-18573c1f-ef5e-4051-b497-e718025a6d76 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:33.549690 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-18573c1f-ef5e-4051-b497-e718025a6d76 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:33.551360 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:33.651947 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-18573c1f-ef5e-4051-b497-e718025a6d76 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:33.714606 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-18573c1f-ef5e-4051-b497-e718025a6d76 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:33.741609 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] device_id is not set on port cf74b9d0-67ff-4fd2-90de-8b721530cc1f yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:40:33.744318 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18573c1f-ef5e-4051-b497-e718025a6d76 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Subnet': ['ID=b3e0381c-9f11-4fed-a7da-bac9fe24aeef,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:33.749464 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-18573c1f-ef5e-4051-b497-e718025a6d76 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:33.751778 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:33.756975 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-18573c1f-ef5e-4051-b497-e718025a6d76 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/subnets/b3e0381c-9f11-4fed-a7da-bac9fe24aeef HTTP/1.1" status: 204 len: 168 time: 0.3305085 Dec 09 21:40:33.757983 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60204) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:33.761133 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18621a46-f0b6-41ec-9ce9-2c89b1b665ed None None] Network 12b747a3-de78-4645-83a0-a5e2eec09a63 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:33.767794 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:33.916755 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:33.916878 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:33.917210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:33.924416 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-a7c6b6c7-a02d-4f7f-bd17-b8ebd5464d7c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting subnet 7bf13a7c-5b49-48fb-84c2-6ebd90353ec1 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:40:33.944140 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Pushing event updated for resources: {'Port': ['ID=cf74b9d0-67ff-4fd2-90de-8b721530cc1f,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:33.946710 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a7c6b6c7-a02d-4f7f-bd17-b8ebd5464d7c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:33.974467 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:33.974707 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:33.979756 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 2 to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f Dec 09 21:40:34.069015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:34.069442 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:34.069777 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:34.098747 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a7c6b6c7-a02d-4f7f-bd17-b8ebd5464d7c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:34.134347 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:34.134591 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:34.140690 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 3 to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f Dec 09 21:40:34.155263 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-600bedbb-02b3-42b1-aea5-233524402e69 req-b2f31c46-f47b-4dff-9a9e-715639a102fd tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:34.156930 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-600bedbb-02b3-42b1-aea5-233524402e69 req-b2f31c46-f47b-4dff-9a9e-715639a102fd tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "GET /v2.0/networks?id=ba3aee78-4661-4c71-9b18-af1e6a07faff HTTP/1.1" status: 200 len: 805 time: 0.3322322 Dec 09 21:40:34.176987 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-600bedbb-02b3-42b1-aea5-233524402e69 req-80e5e165-9659-4e1d-8c70-6c07aeb18dea tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Request body: {'port': {'device_id': '1faa187b-0441-47d3-8d37-6489d51928bb', 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff', 'admin_state_up': True, 'tenant_id': '0569bc74c98b4ae2980de7af929e97eb'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:34.204379 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:34.204712 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:34.205039 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:34.219078 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4e7c069-d956-48e1-a9ff-fc4bd8e6485d req-c4c332b1-048d-40b8-a8a6-308cf6d8aadf tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:34.220673 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4e7c069-d956-48e1-a9ff-fc4bd8e6485d req-c4c332b1-048d-40b8-a8a6-308cf6d8aadf tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.1806970 Dec 09 21:40:34.260507 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:34.260845 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:34.297725 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 4 to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f Dec 09 21:40:34.341138 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:34.341675 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:34.341798 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:34.344638 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a7c6b6c7-a02d-4f7f-bd17-b8ebd5464d7c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:34.394923 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:34.395281 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:34.399794 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 5 to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f Dec 09 21:40:34.436320 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4e7c069-d956-48e1-a9ff-fc4bd8e6485d req-2ab5cd39-9d40-4bd2-a842-1b710dd4d380 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1817000 Dec 09 21:40:34.448803 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:34.449137 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:34.449474 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:34.461465 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:34.461797 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:34.463538 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 6 to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f Dec 09 21:40:34.491177 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-600bedbb-02b3-42b1-aea5-233524402e69 req-80e5e165-9659-4e1d-8c70-6c07aeb18dea tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Made reservation on behalf of 0569bc74c98b4ae2980de7af929e97eb for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:34.494630 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-600bedbb-02b3-42b1-aea5-233524402e69 req-80e5e165-9659-4e1d-8c70-6c07aeb18dea tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:34.498716 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:34.499323 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:34.499949 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:34.516453 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a7c6b6c7-a02d-4f7f-bd17-b8ebd5464d7c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:34.547640 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:34.548299 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:34.552632 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 7 to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f Dec 09 21:40:34.561686 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7c6b6c7-a02d-4f7f-bd17-b8ebd5464d7c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Subnet': ['ID=7bf13a7c-5b49-48fb-84c2-6ebd90353ec1,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:34.584689 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a7c6b6c7-a02d-4f7f-bd17-b8ebd5464d7c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:34.588278 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a7c6b6c7-a02d-4f7f-bd17-b8ebd5464d7c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/subnets/7bf13a7c-5b49-48fb-84c2-6ebd90353ec1 HTTP/1.1" status: 204 len: 168 time: 0.8290515 Dec 09 21:40:34.591292 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e9110877-d2e3-48c9-9f9d-02bda7cc6945 None None] Provisioning complete for port 3f60f042-287b-46d5-b55e-b5cb81c168ba triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:34.591909 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e9110877-d2e3-48c9-9f9d-02bda7cc6945 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:34.592457 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60226) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:34.596442 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a9b05003-a177-44f4-8891-c73de776d49a None None] Network 12b747a3-de78-4645-83a0-a5e2eec09a63 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:34.628622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:34.633052 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:34.633052 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:34.637463 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-d9307388-9af4-4d49-bc8e-d143411f4149 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] DELETE failed (client error): The resource could not be found. Dec 09 21:40:34.637463 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d9307388-9af4-4d49-bc8e-d143411f4149 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:40:34.639348 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba752230-feda-40a6-813f-1263a4fc7b6c req-d3a446dc-125b-4cc0-a5a8-4c757aefb0ed tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0886917 Dec 09 21:40:34.640089 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d9307388-9af4-4d49-bc8e-d143411f4149 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/subnets/b3e0381c-9f11-4fed-a7da-bac9fe24aeef HTTP/1.1" status: 404 len: 337 time: 0.0465660 Dec 09 21:40:34.643143 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60228) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:34.651588 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:34.651926 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:34.654816 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 8 to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f Dec 09 21:40:34.716325 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-71d55569-c07d-4cfb-b962-ac71b2cde404 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting subnet 7bbf8dea-d19e-405c-b7e5-dc8a3c4226f2 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:40:34.721582 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71d55569-c07d-4cfb-b962-ac71b2cde404 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:34.777863 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71d55569-c07d-4cfb-b962-ac71b2cde404 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:34.802682 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:34.803274 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:34.803530 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:34.806556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-600bedbb-02b3-42b1-aea5-233524402e69 req-80e5e165-9659-4e1d-8c70-6c07aeb18dea tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Allocated IP 172.20.0.9 (ba3aee78-4661-4c71-9b18-af1e6a07faff/b61ac70f-1e8d-40a8-9031-bab15f73fa0a/5df02334-3682-4a91-b22d-133fa1bcb473) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:40:34.826060 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-30e232e3-7912-4c8f-84a1-a272098b7262 req-144e2401-70dc-41db-97d3-05f3df23de55 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1faa187b-0441-47d3-8d37-6489d51928bb HTTP/1.1" status: 200 len: 210 time: 0.0570016 Dec 09 21:40:34.831202 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:34.832019 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:34.833487 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 9 to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f Dec 09 21:40:34.858155 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:34.858488 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:34.858878 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:34.874976 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:34.875314 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:34.881505 n-d-713301-27 neutron-server[103438]: INFO neutron.plugins.ml2.plugin [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempt 10 to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f Dec 09 21:40:34.907206 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:34.907557 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:34.907899 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempting to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:34.917266 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71d55569-c07d-4cfb-b962-ac71b2cde404 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:34.925894 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:34.926227 n-d-713301-27 neutron-server[103438]: ERROR neutron.plugins.ml2.managers [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Failed to bind port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on host n-h1-713301-27 for vnic_type normal using segments [{'id': '54c99a9c-b2a4-4759-bd3b-a83f82435607', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '6efd539b-a928-4cd4-86d2-56bf17c4fd70'}] Dec 09 21:40:34.926737 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:35.020749 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71d55569-c07d-4cfb-b962-ac71b2cde404 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:35.063950 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e9110877-d2e3-48c9-9f9d-02bda7cc6945 None None] Provisioning complete for port 2c0d4683-2706-41db-8c7f-caeeb25ac34f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:35.064494 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e9110877-d2e3-48c9-9f9d-02bda7cc6945 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:35.069024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71d55569-c07d-4cfb-b962-ac71b2cde404 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Subnet': ['ID=7bbf8dea-d19e-405c-b7e5-dc8a3c4226f2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:35.070596 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71d55569-c07d-4cfb-b962-ac71b2cde404 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:35.078781 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60236) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:35.080882 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-71d55569-c07d-4cfb-b962-ac71b2cde404 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/subnets/7bbf8dea-d19e-405c-b7e5-dc8a3c4226f2 HTTP/1.1" status: 204 len: 168 time: 0.4368780 Dec 09 21:40:35.081222 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] For port cf74b9d0-67ff-4fd2-90de-8b721530cc1f, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:40:35.081588 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attempted to set empty binding levels {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:65}} Dec 09 21:40:35.097980 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:35.111543 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e9110877-d2e3-48c9-9f9d-02bda7cc6945 None None] Port 2c0d4683-2706-41db-8c7f-caeeb25ac34f cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:40:35.118427 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-600bedbb-02b3-42b1-aea5-233524402e69 req-80e5e165-9659-4e1d-8c70-6c07aeb18dea tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:35.128178 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-17e4e08d-c2f6-4234-8077-8ef74a18267c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] DELETE failed (client error): The resource could not be found. Dec 09 21:40:35.128637 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-17e4e08d-c2f6-4234-8077-8ef74a18267c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:40:35.134093 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-17e4e08d-c2f6-4234-8077-8ef74a18267c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/subnets/db7b139a-e4a1-4bdd-ab45-5fa8c8400a0b HTTP/1.1" status: 404 len: 337 time: 0.0519321 Dec 09 21:40:35.135137 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60238) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:35.159953 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] In _notify_port_updated(), no bound segment for port cf74b9d0-67ff-4fd2-90de-8b721530cc1f on network 6efd539b-a928-4cd4-86d2-56bf17c4fd70 {{(pid=103438) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:40:35.160826 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:35.161433 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:35.165206 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] 10.222.0.13 "PUT /v2.0/ports/cf74b9d0-67ff-4fd2-90de-8b721530cc1f HTTP/1.1" status: 200 len: 975 time: 1.6841052 Dec 09 21:40:35.167695 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60240) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:35.179558 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ec093597-8625-41bd-be22-ad22510cedac tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "GET /v2.0/ports?device_id=56d27d58-8d2b-4901-9065-eea963d17d36 HTTP/1.1" status: 200 len: 205 time: 0.0423524 Dec 09 21:40:35.181646 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60242) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:35.219205 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16a5145e-27a6-4dc6-a536-1a010138b328 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Pushing event updated for resources: {'Port': ['ID=cf74b9d0-67ff-4fd2-90de-8b721530cc1f,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:35.222554 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-ef661ab7-7dd1-4a24-9eb4-5279da45045c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] delete failed (client error): The resource could not be found. Dec 09 21:40:35.225969 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ef661ab7-7dd1-4a24-9eb4-5279da45045c tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/routers/56d27d58-8d2b-4901-9065-eea963d17d36 HTTP/1.1" status: 404 len: 336 time: 0.0401485 Dec 09 21:40:35.226304 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60248) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:35.254301 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-130e004e-0da5-46c3-bc0b-cdeb44ffeb8b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] DELETE failed (client error): The resource could not be found. Dec 09 21:40:35.254767 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-130e004e-0da5-46c3-bc0b-cdeb44ffeb8b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:40:35.259551 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-130e004e-0da5-46c3-bc0b-cdeb44ffeb8b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/subnets/423f17aa-f4f8-4e49-80d6-5cbbdd88375d HTTP/1.1" status: 404 len: 337 time: 0.0313907 Dec 09 21:40:35.261076 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60250) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:35.278831 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-600bedbb-02b3-42b1-aea5-233524402e69 req-80e5e165-9659-4e1d-8c70-6c07aeb18dea tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:35.305130 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-56afa079-88f4-4f73-ac7b-e12ef88dba87 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] DELETE failed (client error): The resource could not be found. Dec 09 21:40:35.305593 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-56afa079-88f4-4f73-ac7b-e12ef88dba87 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:40:35.309808 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-56afa079-88f4-4f73-ac7b-e12ef88dba87 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/subnets/8ad02fb3-05c8-40d9-b3fa-88efc1ce8ed6 HTTP/1.1" status: 404 len: 337 time: 0.0474231 Dec 09 21:40:35.312421 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60252) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:35.342496 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-ff9ad194-86ac-49ce-97b6-accb10bbea99 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] DELETE failed (client error): The resource could not be found. Dec 09 21:40:35.343654 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ff9ad194-86ac-49ce-97b6-accb10bbea99 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:40:35.349726 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ff9ad194-86ac-49ce-97b6-accb10bbea99 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/subnets/7436ce42-ee15-41bb-969b-33c87ec74858 HTTP/1.1" status: 404 len: 337 time: 0.0361965 Dec 09 21:40:35.350336 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60254) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:35.352071 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-600bedbb-02b3-42b1-aea5-233524402e69 req-80e5e165-9659-4e1d-8c70-6c07aeb18dea tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Network ba3aee78-4661-4c71-9b18-af1e6a07faff is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:40:35.362406 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-4c92e4ea-86f8-4ad0-a95f-17c6c53c4b81 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Deleting port cf74b9d0-67ff-4fd2-90de-8b721530cc1f {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:40:35.362781 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4c92e4ea-86f8-4ad0-a95f-17c6c53c4b81 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:35.364724 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-600bedbb-02b3-42b1-aea5-233524402e69 req-80e5e165-9659-4e1d-8c70-6c07aeb18dea tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:35.368362 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80e5e165-9659-4e1d-8c70-6c07aeb18dea tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Pushing event updated for resources: {'Port': ['ID=5df02334-3682-4a91-b22d-133fa1bcb473,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:35.378837 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-26310cd7-b7d1-4a46-a21e-9e1deb81671b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] DELETE failed (client error): The resource could not be found. Dec 09 21:40:35.379585 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-26310cd7-b7d1-4a46-a21e-9e1deb81671b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:40:35.384625 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-26310cd7-b7d1-4a46-a21e-9e1deb81671b tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/ports/f1027ff4-b141-4182-870b-0919f06b9112 HTTP/1.1" status: 404 len: 333 time: 0.0333099 Dec 09 21:40:35.385630 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60256) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:35.390145 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-600bedbb-02b3-42b1-aea5-233524402e69 req-80e5e165-9659-4e1d-8c70-6c07aeb18dea tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:40:35.412995 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-465a168f-30bb-449f-b72a-a4bd37cb0264 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] DELETE failed (client error): The resource could not be found. Dec 09 21:40:35.413608 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-465a168f-30bb-449f-b72a-a4bd37cb0264 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:40:35.419411 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-465a168f-30bb-449f-b72a-a4bd37cb0264 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/subnets/48fe293e-4e46-42c3-955e-3c0061f59c22 HTTP/1.1" status: 404 len: 337 time: 0.0302396 Dec 09 21:40:35.419992 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60258) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:35.454580 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-f680104e-7be4-46cc-bd2f-a2d4d88ba55e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] DELETE failed (client error): The resource could not be found. Dec 09 21:40:35.455044 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f680104e-7be4-46cc-bd2f-a2d4d88ba55e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:40:35.460433 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f680104e-7be4-46cc-bd2f-a2d4d88ba55e tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/subnets/95ad4dcb-14e2-441c-a38e-b25e43db09c8 HTTP/1.1" status: 404 len: 337 time: 0.0366118 Dec 09 21:40:35.461025 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60260) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:35.486754 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-4c92e4ea-86f8-4ad0-a95f-17c6c53c4b81 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] For port cf74b9d0-67ff-4fd2-90de-8b721530cc1f, host n-h1-713301-27, got binding levels [] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:35.487266 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4c92e4ea-86f8-4ad0-a95f-17c6c53c4b81 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:35.495354 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-600bedbb-02b3-42b1-aea5-233524402e69 req-80e5e165-9659-4e1d-8c70-6c07aeb18dea tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:35.496106 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-600bedbb-02b3-42b1-aea5-233524402e69 req-80e5e165-9659-4e1d-8c70-6c07aeb18dea tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:35.496497 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-b8df8602-4ccd-49e3-82dd-8d41b389a38a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] DELETE failed (client error): The resource could not be found. Dec 09 21:40:35.497156 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b8df8602-4ccd-49e3-82dd-8d41b389a38a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:40:35.504601 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b8df8602-4ccd-49e3-82dd-8d41b389a38a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/ports/5aa5d381-6511-4f20-a7a1-82d3d1a3af61 HTTP/1.1" status: 404 len: 333 time: 0.0423541 Dec 09 21:40:35.506623 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60264) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:35.527741 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-4c92e4ea-86f8-4ad0-a95f-17c6c53c4b81 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Calling delete_port for cf74b9d0-67ff-4fd2-90de-8b721530cc1f owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:40:35.554181 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e0414ee2-d07c-409c-911b-9778b34188d7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:35.560345 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-600bedbb-02b3-42b1-aea5-233524402e69 req-80e5e165-9659-4e1d-8c70-6c07aeb18dea tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3913727 Dec 09 21:40:35.563879 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-0e6ff75a-9d85-45be-901c-2a302948b23a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] DELETE failed (client error): The resource could not be found. Dec 09 21:40:35.564333 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0e6ff75a-9d85-45be-901c-2a302948b23a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:40:35.569902 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0e6ff75a-9d85-45be-901c-2a302948b23a tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/subnets/1fe0f923-b8b9-49c1-9996-cc0ec9bb1eb8 HTTP/1.1" status: 404 len: 337 time: 0.0549047 Dec 09 21:40:35.572089 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60270) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:35.585693 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-600bedbb-02b3-42b1-aea5-233524402e69 req-36ec0b92-649b-4063-aac7-327faa72d76b service neutron] Request body: {'port': {'device_id': '1faa187b-0441-47d3-8d37-6489d51928bb', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:35.628590 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-65aff8e1-8ae2-4dd8-a958-7efaebeada25 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] DELETE failed (client error): The resource could not be found. Dec 09 21:40:35.629816 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-65aff8e1-8ae2-4dd8-a958-7efaebeada25 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:40:35.633440 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-65aff8e1-8ae2-4dd8-a958-7efaebeada25 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/subnets/fa911e28-17e4-4b0e-915d-a636717cbed3 HTTP/1.1" status: 404 len: 337 time: 0.0600908 Dec 09 21:40:35.636058 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60272) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:35.732967 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-d4e0c239-ad04-4989-99e7-f7390232b878 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Deleting port 2c0d4683-2706-41db-8c7f-caeeb25ac34f {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:40:35.733317 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d4e0c239-ad04-4989-99e7-f7390232b878 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:35.775463 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-651a75aa-afac-49d0-a674-cc779595f1a6 None None] Network 12b747a3-de78-4645-83a0-a5e2eec09a63 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:35.825199 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d4e0c239-ad04-4989-99e7-f7390232b878 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:35.839208 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-d4e0c239-ad04-4989-99e7-f7390232b878 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Calling delete_port for 2c0d4683-2706-41db-8c7f-caeeb25ac34f owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:40:35.893968 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-667a584f-73c2-4d6b-b802-5100311fba0c None None] Provisioning complete for port 3f60f042-287b-46d5-b55e-b5cb81c168ba triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:35.895075 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-667a584f-73c2-4d6b-b802-5100311fba0c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:36.024563 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-667a584f-73c2-4d6b-b802-5100311fba0c None None] Provisioning complete for port 2c0d4683-2706-41db-8c7f-caeeb25ac34f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:36.024939 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-667a584f-73c2-4d6b-b802-5100311fba0c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:36.064065 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f9ad5e0a-561c-48ea-a4eb-951f24abbc8c None None] DHCP port deletion for 12b747a3-de78-4645-83a0-a5e2eec09a63 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:40:36.087999 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-667a584f-73c2-4d6b-b802-5100311fba0c None None] Port 2c0d4683-2706-41db-8c7f-caeeb25ac34f cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:40:36.135088 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f9ad5e0a-561c-48ea-a4eb-951f24abbc8c None None] Deleting port 3f60f042-287b-46d5-b55e-b5cb81c168ba {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:40:36.135350 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f9ad5e0a-561c-48ea-a4eb-951f24abbc8c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:36.175725 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25d93661-4619-428d-8e0c-9057563d0bc3 req-206bb0f4-ab71-4b9a-ada0-aa80460f4ca6 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:36.177437 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25d93661-4619-428d-8e0c-9057563d0bc3 req-206bb0f4-ab71-4b9a-ada0-aa80460f4ca6 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.6283522 Dec 09 21:40:36.200075 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4c92e4ea-86f8-4ad0-a95f-17c6c53c4b81 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:36.230501 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f9ad5e0a-561c-48ea-a4eb-951f24abbc8c None None] For port 3f60f042-287b-46d5-b55e-b5cb81c168ba, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=3f60f042-287b-46d5-b55e-b5cb81c168ba,segment=NetworkSegment(8d15e2ef-b82d-433a-a244-0bedb82cd38c),segment_id=8d15e2ef-b82d-433a-a244-0bedb82cd38c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:36.230912 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f9ad5e0a-561c-48ea-a4eb-951f24abbc8c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:36.246502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f9ad5e0a-561c-48ea-a4eb-951f24abbc8c None None] Calling delete_port for 3f60f042-287b-46d5-b55e-b5cb81c168ba owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:40:36.281469 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4c92e4ea-86f8-4ad0-a95f-17c6c53c4b81 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:36.289568 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4c92e4ea-86f8-4ad0-a95f-17c6c53c4b81 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] 10.222.0.13 "DELETE /v2.0/ports/cf74b9d0-67ff-4fd2-90de-8b721530cc1f HTTP/1.1" status: 204 len: 168 time: 1.1186018 Dec 09 21:40:36.289568 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c92e4ea-86f8-4ad0-a95f-17c6c53c4b81 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] Pushing event deleted for resources: {'Port': ['ID=cf74b9d0-67ff-4fd2-90de-8b721530cc1f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:36.291587 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-600bedbb-02b3-42b1-aea5-233524402e69 req-36ec0b92-649b-4063-aac7-327faa72d76b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:36.295967 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60288) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:36.327126 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-e0990b33-974e-4df8-b201-6230524947f7 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] GET failed (client error): The resource could not be found. Dec 09 21:40:36.332468 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e0990b33-974e-4df8-b201-6230524947f7 tempest-PortsAdminExtendedAttrsTestJSON-742981567 tempest-PortsAdminExtendedAttrsTestJSON-742981567-project-admin] 10.222.0.13 "GET /v2.0/ports/cf74b9d0-67ff-4fd2-90de-8b721530cc1f HTTP/1.1" status: 404 len: 333 time: 0.0319650 Dec 09 21:40:36.333045 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60290) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:36.353025 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25d93661-4619-428d-8e0c-9057563d0bc3 req-ff2d9c76-cc3e-47e6-9faf-cc04dd754de3 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1485684 Dec 09 21:40:36.359978 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 3f60f042-287b-46d5-b55e-b5cb81c168ba no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:40:36.399851 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f9ad5e0a-561c-48ea-a4eb-951f24abbc8c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:36.442226 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9ad5e0a-561c-48ea-a4eb-951f24abbc8c None None] Pushing event deleted for resources: {'Port': ['ID=3f60f042-287b-46d5-b55e-b5cb81c168ba,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:36.449667 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d4e0c239-ad04-4989-99e7-f7390232b878 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:36.451061 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9ad5e0a-561c-48ea-a4eb-951f24abbc8c None None] No DVR routers for this DVR port 3f60f042-287b-46d5-b55e-b5cb81c168ba on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:40:36.456212 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2b21cf3d-15f6-4e2e-be9b-2ea5bc424b97 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:36.457792 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No active binding found for port 3f60f042-287b-46d5-b55e-b5cb81c168ba {{(pid=103439) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:216}} Dec 09 21:40:36.458379 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 3f60f042-287b-46d5-b55e-b5cb81c168ba not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:40:36.502143 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4e0c239-ad04-4989-99e7-f7390232b878 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Port': ['ID=2c0d4683-2706-41db-8c7f-caeeb25ac34f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:36.511975 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d4e0c239-ad04-4989-99e7-f7390232b878 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:36.515724 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d4e0c239-ad04-4989-99e7-f7390232b878 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/ports/2c0d4683-2706-41db-8c7f-caeeb25ac34f HTTP/1.1" status: 204 len: 168 time: 0.8786421 Dec 09 21:40:36.520419 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60292) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:36.534366 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dec08b8a-38db-4cee-b9cf-a314737050a7 req-7749ded3-dee1-4013-bb8f-a218e60c6cf9 tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0409076 Dec 09 21:40:36.628576 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:36.629885 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-78bee9ba-0335-4e39-a4e1-e38eecf6d3c6 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:36.705301 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fa1886c-1845-48ad-a0d6-dcba2bf1afea req-357685c3-81c7-4b82-9c79-615ccd5ad7ce tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:36.706900 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6fa1886c-1845-48ad-a0d6-dcba2bf1afea req-357685c3-81c7-4b82-9c79-615ccd5ad7ce tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1faa187b-0441-47d3-8d37-6489d51928bb HTTP/1.1" status: 200 len: 931 time: 0.0803254 Dec 09 21:40:36.726372 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2b21cf3d-15f6-4e2e-be9b-2ea5bc424b97 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:36.778040 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-2b21cf3d-15f6-4e2e-be9b-2ea5bc424b97 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6efd539b-a928-4cd4-86d2-56bf17c4fd70']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:36.799177 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-600bedbb-02b3-42b1-aea5-233524402e69 req-36ec0b92-649b-4063-aac7-327faa72d76b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5df02334-3682-4a91-b22d-133fa1bcb473 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:40:36.809143 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-78bee9ba-0335-4e39-a4e1-e38eecf6d3c6 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:36.813321 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-600bedbb-02b3-42b1-aea5-233524402e69 req-36ec0b92-649b-4063-aac7-327faa72d76b service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:36.818276 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-2b21cf3d-15f6-4e2e-be9b-2ea5bc424b97 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '54c99a9c-b2a4-4759-bd3b-a83f82435607') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:36.818580 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-2b21cf3d-15f6-4e2e-be9b-2ea5bc424b97 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '54c99a9c-b2a4-4759-bd3b-a83f82435607') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:36.828028 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6fa1886c-1845-48ad-a0d6-dcba2bf1afea req-930ed049-7b37-4dd3-b1b8-a4e2b3cef249 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1124473 Dec 09 21:40:36.837452 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2b21cf3d-15f6-4e2e-be9b-2ea5bc424b97 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:36.839537 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-600bedbb-02b3-42b1-aea5-233524402e69 req-36ec0b92-649b-4063-aac7-327faa72d76b service neutron] Transition to ACTIVE for port object 5df02334-3682-4a91-b22d-133fa1bcb473 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:40:36.846364 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-78bee9ba-0335-4e39-a4e1-e38eecf6d3c6 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['12b747a3-de78-4645-83a0-a5e2eec09a63']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:36.851108 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-600bedbb-02b3-42b1-aea5-233524402e69 req-36ec0b92-649b-4063-aac7-327faa72d76b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:36.862034 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-78bee9ba-0335-4e39-a4e1-e38eecf6d3c6 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8d15e2ef-b82d-433a-a244-0bedb82cd38c') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:36.862332 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-78bee9ba-0335-4e39-a4e1-e38eecf6d3c6 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8d15e2ef-b82d-433a-a244-0bedb82cd38c') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:36.864350 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2b21cf3d-15f6-4e2e-be9b-2ea5bc424b97 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:36.876805 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-78bee9ba-0335-4e39-a4e1-e38eecf6d3c6 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:36.878716 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2b21cf3d-15f6-4e2e-be9b-2ea5bc424b97 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] Releasing vlan 103 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:40:36.879135 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2b21cf3d-15f6-4e2e-be9b-2ea5bc424b97 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:40:36.882252 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:40:36.915771 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-78bee9ba-0335-4e39-a4e1-e38eecf6d3c6 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:36.931097 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36ec0b92-649b-4063-aac7-327faa72d76b service neutron] Pushing event updated for resources: {'Port': ['ID=5df02334-3682-4a91-b22d-133fa1bcb473,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:36.955255 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-78bee9ba-0335-4e39-a4e1-e38eecf6d3c6 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Releasing vlan 130 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:40:36.955691 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-78bee9ba-0335-4e39-a4e1-e38eecf6d3c6 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:40:36.958926 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:40:36.996082 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2b21cf3d-15f6-4e2e-be9b-2ea5bc424b97 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:37.006597 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-600bedbb-02b3-42b1-aea5-233524402e69 req-36ec0b92-649b-4063-aac7-327faa72d76b service neutron] Attempting to bind port 5df02334-3682-4a91-b22d-133fa1bcb473 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:37.006947 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-600bedbb-02b3-42b1-aea5-233524402e69 req-36ec0b92-649b-4063-aac7-327faa72d76b service neutron] Attempting to bind port 5df02334-3682-4a91-b22d-133fa1bcb473 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:37.007275 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-600bedbb-02b3-42b1-aea5-233524402e69 req-36ec0b92-649b-4063-aac7-327faa72d76b service neutron] Attempting to bind port 5df02334-3682-4a91-b22d-133fa1bcb473 on network ba3aee78-4661-4c71-9b18-af1e6a07faff {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:37.011707 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-600bedbb-02b3-42b1-aea5-233524402e69 req-36ec0b92-649b-4063-aac7-327faa72d76b service neutron] Port 5df02334-3682-4a91-b22d-133fa1bcb473 on network ba3aee78-4661-4c71-9b18-af1e6a07faff not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:37.012031 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-600bedbb-02b3-42b1-aea5-233524402e69 req-36ec0b92-649b-4063-aac7-327faa72d76b service neutron] Attempting to bind port 5df02334-3682-4a91-b22d-133fa1bcb473 on network ba3aee78-4661-4c71-9b18-af1e6a07faff {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:37.018880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-600bedbb-02b3-42b1-aea5-233524402e69 req-36ec0b92-649b-4063-aac7-327faa72d76b service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 40, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:40:37.019613 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-600bedbb-02b3-42b1-aea5-233524402e69 req-36ec0b92-649b-4063-aac7-327faa72d76b service neutron] Checking segment: {'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:40:37.020015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-600bedbb-02b3-42b1-aea5-233524402e69 req-36ec0b92-649b-4063-aac7-327faa72d76b service neutron] Bound using segment: {'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:40:37.020495 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-600bedbb-02b3-42b1-aea5-233524402e69 req-36ec0b92-649b-4063-aac7-327faa72d76b service neutron] Bound port: 5df02334-3682-4a91-b22d-133fa1bcb473, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:40:37.020906 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-600bedbb-02b3-42b1-aea5-233524402e69 req-36ec0b92-649b-4063-aac7-327faa72d76b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:37.048074 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2b21cf3d-15f6-4e2e-be9b-2ea5bc424b97 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:37.058887 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2b21cf3d-15f6-4e2e-be9b-2ea5bc424b97 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] 10.222.0.13 "DELETE /v2.0/networks/6efd539b-a928-4cd4-86d2-56bf17c4fd70 HTTP/1.1" status: 204 len: 168 time: 0.7200940 Dec 09 21:40:37.058887 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b21cf3d-15f6-4e2e-be9b-2ea5bc424b97 tempest-PortsAdminExtendedAttrsTestJSON-291438231 tempest-PortsAdminExtendedAttrsTestJSON-291438231-project] Pushing event deleted for resources: {'Network': ['ID=6efd539b-a928-4cd4-86d2-56bf17c4fd70,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:37.075312 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-78bee9ba-0335-4e39-a4e1-e38eecf6d3c6 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:37.082366 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-78bee9ba-0335-4e39-a4e1-e38eecf6d3c6 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:37.085531 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-78bee9ba-0335-4e39-a4e1-e38eecf6d3c6 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] 10.222.0.13 "DELETE /v2.0/networks/12b747a3-de78-4645-83a0-a5e2eec09a63 HTTP/1.1" status: 204 len: 168 time: 0.5642772 Dec 09 21:40:37.106591 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-600bedbb-02b3-42b1-aea5-233524402e69 req-36ec0b92-649b-4063-aac7-327faa72d76b service neutron] For port 5df02334-3682-4a91-b22d-133fa1bcb473, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:40:37.110760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78bee9ba-0335-4e39-a4e1-e38eecf6d3c6 tempest-PortsTestJSON-228094338 tempest-PortsTestJSON-228094338-project] Pushing event deleted for resources: {'Network': ['ID=12b747a3-de78-4645-83a0-a5e2eec09a63,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:37.111650 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-600bedbb-02b3-42b1-aea5-233524402e69 req-36ec0b92-649b-4063-aac7-327faa72d76b service neutron] For port 5df02334-3682-4a91-b22d-133fa1bcb473, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=5df02334-3682-4a91-b22d-133fa1bcb473,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:40:37.119577 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-600bedbb-02b3-42b1-aea5-233524402e69 req-36ec0b92-649b-4063-aac7-327faa72d76b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:37.177791 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-600bedbb-02b3-42b1-aea5-233524402e69 req-36ec0b92-649b-4063-aac7-327faa72d76b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:37.178458 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-600bedbb-02b3-42b1-aea5-233524402e69 req-36ec0b92-649b-4063-aac7-327faa72d76b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:37.179849 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-600bedbb-02b3-42b1-aea5-233524402e69 req-36ec0b92-649b-4063-aac7-327faa72d76b service neutron] 10.222.0.31 "PUT /v2.0/ports/5df02334-3682-4a91-b22d-133fa1bcb473 HTTP/1.1" status: 200 len: 1092 time: 1.5998797 Dec 09 21:40:37.188088 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1faa187b-0441-47d3-8d37-6489d51928bb', 'tag': '5df02334-3682-4a91-b22d-133fa1bcb473'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:40:37.190746 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-01310f94-72bf-468f-8b5b-e728404ce618" -d '{"events": [{"name": "network-changed", "server_uuid": "1faa187b-0441-47d3-8d37-6489d51928bb", "tag": "5df02334-3682-4a91-b22d-133fa1bcb473"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:40:37.216584 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36ec0b92-649b-4063-aac7-327faa72d76b service neutron] Pushing event updated for resources: {'Port': ['ID=5df02334-3682-4a91-b22d-133fa1bcb473,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:37.270551 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:40:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7aa6c24d-eaa4-4974-9150-d6abdad8e0c0 x-openstack-request-id: req-7aa6c24d-eaa4-4974-9150-d6abdad8e0c0 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:40:37.271024 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1faa187b-0441-47d3-8d37-6489d51928bb", "tag": "5df02334-3682-4a91-b22d-133fa1bcb473", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:40:37.271212 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-7aa6c24d-eaa4-4974-9150-d6abdad8e0c0 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:40:37.271649 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1faa187b-0441-47d3-8d37-6489d51928bb', 'tag': '5df02334-3682-4a91-b22d-133fa1bcb473', 'status': 'completed', 'code': 200} Dec 09 21:40:37.293682 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-600bedbb-02b3-42b1-aea5-233524402e69 req-7d5e61f4-941d-4208-959f-1e2ede1ac0d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:37.295259 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-600bedbb-02b3-42b1-aea5-233524402e69 req-7d5e61f4-941d-4208-959f-1e2ede1ac0d2 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0569bc74c98b4ae2980de7af929e97eb&device_id=1faa187b-0441-47d3-8d37-6489d51928bb HTTP/1.1" status: 200 len: 1095 time: 0.0686085 Dec 09 21:40:37.336853 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60318) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:37.358416 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-600bedbb-02b3-42b1-aea5-233524402e69 req-822d393a-699d-4c39-94bc-929e7f09a9d6 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=5df02334-3682-4a91-b22d-133fa1bcb473 HTTP/1.1" status: 200 len: 217 time: 0.0529480 Dec 09 21:40:37.425775 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-600bedbb-02b3-42b1-aea5-233524402e69 req-2bc4977b-1239-4507-822f-ef56620457ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:37.427232 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-600bedbb-02b3-42b1-aea5-233524402e69 req-2bc4977b-1239-4507-822f-ef56620457ea service neutron] 10.222.0.31 "GET /v2.0/subnets?id=b61ac70f-1e8d-40a8-9031-bab15f73fa0a HTTP/1.1" status: 200 len: 845 time: 0.0606914 Dec 09 21:40:37.432418 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60324) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:37.480168 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-600bedbb-02b3-42b1-aea5-233524402e69 req-4e25d2ab-5247-4aa0-b808-9d45a885f522 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ba3aee78-4661-4c71-9b18-af1e6a07faff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0437949 Dec 09 21:40:37.567762 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b6d16336-cdce-4aeb-bf2e-4724905db762 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=113655eb75db4936a301d5c3fe065143&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2271464 Dec 09 21:40:37.568083 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-408a337b-5d55-4229-bd76-ee3eb74817df admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e8bdea0c320d4955bc3ba905696bda85&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1343999 Dec 09 21:40:37.568791 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60334) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:37.574813 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60336) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:37.599307 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e8d0cdb-d6fc-4755-a9c4-1459636dee43 req-c0a1e211-fcdf-43ce-9ad8-c32eadc585a3 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:37.600846 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0e8d0cdb-d6fc-4755-a9c4-1459636dee43 req-c0a1e211-fcdf-43ce-9ad8-c32eadc585a3 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.1234674 Dec 09 21:40:37.636151 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-600bedbb-02b3-42b1-aea5-233524402e69 req-869b0667-9146-4f75-84da-554bcfa57ac5 service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1394463 Dec 09 21:40:37.658129 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-023e2748-a0be-4ee5-a835-bfcba12a69a1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:37.659905 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a8a097a-1472-415e-be13-b7e21f4ff489 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:37.685483 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0e8d0cdb-d6fc-4755-a9c4-1459636dee43 req-b77130dd-2892-41e3-9e39-c8841eeee505 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0766463 Dec 09 21:40:37.696040 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-023e2748-a0be-4ee5-a835-bfcba12a69a1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:37.698864 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a8a097a-1472-415e-be13-b7e21f4ff489 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:37.747921 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-600bedbb-02b3-42b1-aea5-233524402e69 req-741ab48b-f3a0-447e-bf74-a10a10761260 service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1018560 Dec 09 21:40:37.799475 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-023e2748-a0be-4ee5-a835-bfcba12a69a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:37.802409 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-023e2748-a0be-4ee5-a835-bfcba12a69a1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:37.806343 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-023e2748-a0be-4ee5-a835-bfcba12a69a1 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/627bf5cf-cf6a-4511-9a38-60a34c112968 HTTP/1.1" status: 204 len: 168 time: 0.2366016 Dec 09 21:40:37.809752 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a8a097a-1472-415e-be13-b7e21f4ff489 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:37.812816 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a8a097a-1472-415e-be13-b7e21f4ff489 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:37.814183 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7a8a097a-1472-415e-be13-b7e21f4ff489 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/6895b185-77a6-4346-afaf-cfcf881dfd8e HTTP/1.1" status: 204 len: 168 time: 0.2381697 Dec 09 21:40:37.816036 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a3fa8eb-a8ec-4611-8e7a-51c7dff6d120 req-a51600bc-b1ec-4fd2-8c37-b6f8d0e9737f tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0514672 Dec 09 21:40:37.824396 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-023e2748-a0be-4ee5-a835-bfcba12a69a1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=627bf5cf-cf6a-4511-9a38-60a34c112968,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:37.842259 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a8a097a-1472-415e-be13-b7e21f4ff489 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6895b185-77a6-4346-afaf-cfcf881dfd8e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:37.868551 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01310f94-72bf-468f-8b5b-e728404ce618 req-59df4c0f-39af-475e-89ad-a10a2cb5d0b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:37.870192 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-01310f94-72bf-468f-8b5b-e728404ce618 req-59df4c0f-39af-475e-89ad-a10a2cb5d0b0 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0569bc74c98b4ae2980de7af929e97eb&device_id=1faa187b-0441-47d3-8d37-6489d51928bb HTTP/1.1" status: 200 len: 1095 time: 0.0647669 Dec 09 21:40:37.971106 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:38.064858 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d3fa494-dc6a-40cc-9579-3f565d9ed92e req-4ae9ca8b-b445-4f1d-88a3-e414efdae943 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:38.066399 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1d3fa494-dc6a-40cc-9579-3f565d9ed92e req-4ae9ca8b-b445-4f1d-88a3-e414efdae943 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1faa187b-0441-47d3-8d37-6489d51928bb HTTP/1.1" status: 200 len: 943 time: 0.0677772 Dec 09 21:40:38.100540 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01310f94-72bf-468f-8b5b-e728404ce618 req-8dfce061-63ea-401a-8c4e-582a9235645f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:38.102007 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-01310f94-72bf-468f-8b5b-e728404ce618 req-8dfce061-63ea-401a-8c4e-582a9235645f service neutron] 10.222.0.31 "GET /v2.0/networks?id=ba3aee78-4661-4c71-9b18-af1e6a07faff HTTP/1.1" status: 200 len: 906 time: 0.2241056 Dec 09 21:40:38.183085 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-01310f94-72bf-468f-8b5b-e728404ce618 req-0bf502ef-b3f2-4d16-9f10-ba9bb9ad113b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=5df02334-3682-4a91-b22d-133fa1bcb473 HTTP/1.1" status: 200 len: 217 time: 0.0707076 Dec 09 21:40:38.186834 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1d3fa494-dc6a-40cc-9579-3f565d9ed92e req-6df80832-c0e9-45e2-bd9b-f22dcb4f63ef tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1127274 Dec 09 21:40:38.256491 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01310f94-72bf-468f-8b5b-e728404ce618 req-54aee0ef-2073-49f9-ab28-5ff4dd017893 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:38.258581 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-01310f94-72bf-468f-8b5b-e728404ce618 req-54aee0ef-2073-49f9-ab28-5ff4dd017893 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=b61ac70f-1e8d-40a8-9031-bab15f73fa0a HTTP/1.1" status: 200 len: 845 time: 0.0668294 Dec 09 21:40:38.302265 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-01310f94-72bf-468f-8b5b-e728404ce618 req-de7ca4d2-f1c0-4348-81e7-a60145b107c1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ba3aee78-4661-4c71-9b18-af1e6a07faff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0349066 Dec 09 21:40:38.317193 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60364) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:38.399022 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-38f94255-c2ee-4dcb-a34d-8fb62ba68b86 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=dd6dde7f70a24c428d1d7ab0334a12ff&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0798185 Dec 09 21:40:38.401859 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60368) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:38.412462 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-01310f94-72bf-468f-8b5b-e728404ce618 req-89d2ab0c-5699-42f1-9bf9-bc9b46b22794 service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1024797 Dec 09 21:40:38.463779 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1f49f4ab-9b9b-4154-8a74-3ccdb87a831c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:38.488422 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1f49f4ab-9b9b-4154-8a74-3ccdb87a831c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:38.544692 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1f49f4ab-9b9b-4154-8a74-3ccdb87a831c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:38.547598 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1f49f4ab-9b9b-4154-8a74-3ccdb87a831c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:38.551500 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1f49f4ab-9b9b-4154-8a74-3ccdb87a831c admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/271cba32-1d73-4c36-ae21-4bdd5b81ec53 HTTP/1.1" status: 204 len: 168 time: 0.1454306 Dec 09 21:40:38.560052 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f49f4ab-9b9b-4154-8a74-3ccdb87a831c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=271cba32-1d73-4c36-ae21-4bdd5b81ec53,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:38.572077 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-01310f94-72bf-468f-8b5b-e728404ce618 req-89f7e2d5-5ae8-4187-b77d-2577c703b4c1 service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1433213 Dec 09 21:40:38.814070 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60392) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:38.842228 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cce9bea-2817-4734-8b38-c5cae9b77273 req-7e0c36ff-dc71-4dee-b6ae-a639b0dc00d2 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:38.844834 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7cce9bea-2817-4734-8b38-c5cae9b77273 req-7e0c36ff-dc71-4dee-b6ae-a639b0dc00d2 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.0794785 Dec 09 21:40:38.908834 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7cce9bea-2817-4734-8b38-c5cae9b77273 req-77aa7fee-c883-49dd-9c6a-d900279f3cb3 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0545740 Dec 09 21:40:38.959247 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d6d6c3f6-d25d-48a9-b154-0396824c7d5e tempest-ServiceProvidersTest-16139735 tempest-ServiceProvidersTest-16139735-project] 10.222.0.13 "GET /v2.0/service-providers HTTP/1.1" status: 200 len: 498 time: 0.1440547 Dec 09 21:40:38.976716 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 5df02334-3682-4a91-b22d-133fa1bcb473 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:40:39.023495 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44a963ff-7a1e-4252-8693-dda9886d5178 req-22fa9640-e119-4096-9066-2c6a724d52d5 tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0315628 Dec 09 21:40:39.123547 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 5df02334-3682-4a91-b22d-133fa1bcb473, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=5df02334-3682-4a91-b22d-133fa1bcb473,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:39.146003 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '5df02334-3682-4a91-b22d-133fa1bcb473', 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff', 'port_id': '5df02334-3682-4a91-b22d-133fa1bcb473', 'mac_address': 'fa:16:3e:a7:6f:89', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b61ac70f-1e8d-40a8-9031-bab15f73fa0a', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:40:39.200242 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:39.222864 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5df02334-3682-4a91-b22d-133fa1bcb473 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:40:39.274300 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 5df02334-3682-4a91-b22d-133fa1bcb473, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=5df02334-3682-4a91-b22d-133fa1bcb473,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:39.280967 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:39.284091 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60420) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:39.341026 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8000d5b8-c8f8-4b07-86dc-452de8165151 req-b465b9ca-4a19-4d24-821f-1119c047131b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:39.350869 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8000d5b8-c8f8-4b07-86dc-452de8165151 req-b465b9ca-4a19-4d24-821f-1119c047131b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1faa187b-0441-47d3-8d37-6489d51928bb HTTP/1.1" status: 200 len: 944 time: 0.0764251 Dec 09 21:40:39.355235 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=5df02334-3682-4a91-b22d-133fa1bcb473,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:39.402797 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8000d5b8-c8f8-4b07-86dc-452de8165151 req-2d2c3897-b449-44fb-851e-c5b690f3db2e tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503757 Dec 09 21:40:39.481472 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3fd02080-5414-43b6-95c4-ae13e802ac0d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:39.517066 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['5df02334-3682-4a91-b22d-133fa1bcb473'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:40:39.576726 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3fd02080-5414-43b6-95c4-ae13e802ac0d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:39.582082 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3fd02080-5414-43b6-95c4-ae13e802ac0d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:39.619341 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60434) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:39.634813 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3fd02080-5414-43b6-95c4-ae13e802ac0d admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=96631b2ace9641c5b40554bcfb7d63db&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3493881 Dec 09 21:40:39.637560 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60438) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:39.640605 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fd02080-5414-43b6-95c4-ae13e802ac0d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=215b48a9-38b0-48c9-8355-f640368c1d60,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:39.677298 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:39.714693 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d024cfbb-0c3a-43b3-9d4c-c590440aaf2d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:39.746261 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d024cfbb-0c3a-43b3-9d4c-c590440aaf2d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:39.761625 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-5e6aafa5-3fa0-474d-8c81-c3d74c2e4999 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1347938278'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:39.806356 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5e6aafa5-3fa0-474d-8c81-c3d74c2e4999 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Made reservation on behalf of 8d03fcad771c485fa5e2c1775828f3a7 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:39.810182 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e6aafa5-3fa0-474d-8c81-c3d74c2e4999 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:39.820688 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e6aafa5-3fa0-474d-8c81-c3d74c2e4999 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:39.839488 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d024cfbb-0c3a-43b3-9d4c-c590440aaf2d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:39.842154 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d024cfbb-0c3a-43b3-9d4c-c590440aaf2d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:39.843502 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d024cfbb-0c3a-43b3-9d4c-c590440aaf2d admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/215b48a9-38b0-48c9-8355-f640368c1d60 HTTP/1.1" status: 204 len: 168 time: 0.2045867 Dec 09 21:40:39.862409 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d024cfbb-0c3a-43b3-9d4c-c590440aaf2d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=215b48a9-38b0-48c9-8355-f640368c1d60,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:39.942205 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e6aafa5-3fa0-474d-8c81-c3d74c2e4999 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:39.949816 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e6aafa5-3fa0-474d-8c81-c3d74c2e4999 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:39.981692 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5e6aafa5-3fa0-474d-8c81-c3d74c2e4999 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] vlan segment allocate from pool success with {'vlan_id': 129, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:40:40.016964 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e6aafa5-3fa0-474d-8c81-c3d74c2e4999 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8eb97a37-262f-4b7a-a32a-bc5fc1baeb93,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:40.034027 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e6aafa5-3fa0-474d-8c81-c3d74c2e4999 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:40.034360 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-5e6aafa5-3fa0-474d-8c81-c3d74c2e4999 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Added segment e3897138-5662-4ad4-be68-fd266660ce00 of type vlan for network 5fa22bcb-aab0-4d2e-acc0-554514c04095 Dec 09 21:40:40.083988 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:40:40.102884 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8da95595-221b-4de5-8717-dcefdc7453ef req-c1f289a8-d5f1-47fa-8915-25e7d5788edf tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:40.104716 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8da95595-221b-4de5-8717-dcefdc7453ef req-c1f289a8-d5f1-47fa-8915-25e7d5788edf tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.1118131 Dec 09 21:40:40.106662 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e6aafa5-3fa0-474d-8c81-c3d74c2e4999 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:40.189442 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8da95595-221b-4de5-8717-dcefdc7453ef req-ddf79a69-9a55-4686-be35-e4cb8e62779e tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0765207 Dec 09 21:40:40.190541 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e6aafa5-3fa0-474d-8c81-c3d74c2e4999 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:40.196504 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e6aafa5-3fa0-474d-8c81-c3d74c2e4999 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:40.197479 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e6aafa5-3fa0-474d-8c81-c3d74c2e4999 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:40.231501 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5e6aafa5-3fa0-474d-8c81-c3d74c2e4999 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.6111569 Dec 09 21:40:40.278249 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e6aafa5-3fa0-474d-8c81-c3d74c2e4999 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Network': ['ID=5fa22bcb-aab0-4d2e-acc0-554514c04095,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:40.293139 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 5fa22bcb-aab0-4d2e-acc0-554514c04095 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:40:40.364828 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60468) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:40.370560 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-05b7e2ac-ca27-42ec-960f-86763e23fa0a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'subnet': {'network_id': '5fa22bcb-aab0-4d2e-acc0-554514c04095', 'cidr': '172.20.255.240/28', 'ip_version': 4, 'gateway_ip': '172.20.255.241'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:40.386912 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6005089-3688-482f-94c6-c82d0b8cd289 req-34889b27-83e8-44db-90f3-c3f7af74e5c2 tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0461416 Dec 09 21:40:40.515140 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-05b7e2ac-ca27-42ec-960f-86763e23fa0a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Made reservation on behalf of 8d03fcad771c485fa5e2c1775828f3a7 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:40.520628 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-05b7e2ac-ca27-42ec-960f-86763e23fa0a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:40.572855 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b0694aa-ce10-4820-9d6f-53cd67696954 req-6933d9b2-b6df-4301-94f3-a28d77b89c97 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:40.580972 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b0694aa-ce10-4820-9d6f-53cd67696954 req-6933d9b2-b6df-4301-94f3-a28d77b89c97 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1faa187b-0441-47d3-8d37-6489d51928bb HTTP/1.1" status: 200 len: 944 time: 0.0868902 Dec 09 21:40:40.642021 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b0694aa-ce10-4820-9d6f-53cd67696954 req-14415a59-154d-46b8-b65b-9063a403807f tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0597961 Dec 09 21:40:40.773608 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-05b7e2ac-ca27-42ec-960f-86763e23fa0a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:40.830781 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05b7e2ac-ca27-42ec-960f-86763e23fa0a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Subnet': ['ID=24c8e276-4190-4038-8903-43f80ae0e34a,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:40.851924 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05b7e2ac-ca27-42ec-960f-86763e23fa0a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Checking segment: {'id': 'e3897138-5662-4ad4-be68-fd266660ce00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': '5fa22bcb-aab0-4d2e-acc0-554514c04095'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:40:40.852299 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05b7e2ac-ca27-42ec-960f-86763e23fa0a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Network hostable DHCP agents. Network: 5fa22bcb-aab0-4d2e-acc0-554514c04095, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:40:40.870147 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05b7e2ac-ca27-42ec-960f-86763e23fa0a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Network 5fa22bcb-aab0-4d2e-acc0-554514c04095 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:40:40.883036 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-05b7e2ac-ca27-42ec-960f-86763e23fa0a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 5fa22bcb-aab0-4d2e-acc0-554514c04095) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:40.888877 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05b7e2ac-ca27-42ec-960f-86763e23fa0a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:40.889930 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-05b7e2ac-ca27-42ec-960f-86763e23fa0a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:40.896484 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c168a40-1992-4588-9dca-9076a368a865 None None] Network 5fa22bcb-aab0-4d2e-acc0-554514c04095 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:40.913695 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-05b7e2ac-ca27-42ec-960f-86763e23fa0a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 816 time: 0.5475566 Dec 09 21:40:40.917612 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60488) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:40.923599 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-d9066e7b-deca-4d12-ad10-b9f9a415732a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-312643575'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:40.950047 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d9066e7b-deca-4d12-ad10-b9f9a415732a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Made reservation on behalf of 8d03fcad771c485fa5e2c1775828f3a7 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:40.957901 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d9066e7b-deca-4d12-ad10-b9f9a415732a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:40.990091 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d9066e7b-deca-4d12-ad10-b9f9a415732a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] vlan segment allocate from pool success with {'vlan_id': 134, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:40:40.999754 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d9066e7b-deca-4d12-ad10-b9f9a415732a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:41.000281 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-d9066e7b-deca-4d12-ad10-b9f9a415732a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Added segment a03ac457-a159-4c3a-ac11-54383f6437c0 of type vlan for network 682fa031-32a5-4912-90b9-b7b4ae53eab1 Dec 09 21:40:41.001036 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 5df02334-3682-4a91-b22d-133fa1bcb473 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:40:41.047912 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d9066e7b-deca-4d12-ad10-b9f9a415732a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:41.082702 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d9066e7b-deca-4d12-ad10-b9f9a415732a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:41.090822 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9066e7b-deca-4d12-ad10-b9f9a415732a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:41.090822 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d9066e7b-deca-4d12-ad10-b9f9a415732a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:41.105953 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 5df02334-3682-4a91-b22d-133fa1bcb473 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:40:41.111277 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da4a3a3c-da7a-4359-bf95-0eff7c074ab7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-5fa22bcb-aab0-4d2e-acc0-554514c04095', 'network_id': '5fa22bcb-aab0-4d2e-acc0-554514c04095', 'project_id': '8d03fcad771c485fa5e2c1775828f3a7', 'fixed_ips': [{'subnet_id': '24c8e276-4190-4038-8903-43f80ae0e34a'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:40:41.112491 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-da4a3a3c-da7a-4359-bf95-0eff7c074ab7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:41.125385 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 5df02334-3682-4a91-b22d-133fa1bcb473 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:41.126112 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:41.135713 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60498) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:41.135935 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d9066e7b-deca-4d12-ad10-b9f9a415732a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.2168703 Dec 09 21:40:41.141422 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-e9c28912-d34f-4d44-9cd7-750b1fc67cc4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'subnet': {'network_id': '682fa031-32a5-4912-90b9-b7b4ae53eab1', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': True, 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:41.224691 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9066e7b-deca-4d12-ad10-b9f9a415732a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Network': ['ID=682fa031-32a5-4912-90b9-b7b4ae53eab1,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:41.278355 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 682fa031-32a5-4912-90b9-b7b4ae53eab1 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:40:41.319803 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e9c28912-d34f-4d44-9cd7-750b1fc67cc4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Made reservation on behalf of 8d03fcad771c485fa5e2c1775828f3a7 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:41.324548 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9c28912-d34f-4d44-9cd7-750b1fc67cc4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:41.365378 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3024cb22-81ca-41b1-9918-0293e8135257 req-d69bf201-8020-4cb7-be8d-a8e5fe350d41 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:41.383688 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3024cb22-81ca-41b1-9918-0293e8135257 req-d69bf201-8020-4cb7-be8d-a8e5fe350d41 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.0854363 Dec 09 21:40:41.456093 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3024cb22-81ca-41b1-9918-0293e8135257 req-4ac61f0b-e326-47c6-bcc0-c18e63fcad21 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0713463 Dec 09 21:40:41.509600 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-da4a3a3c-da7a-4359-bf95-0eff7c074ab7 None None] Allocated IP 172.20.255.242 (5fa22bcb-aab0-4d2e-acc0-554514c04095/24c8e276-4190-4038-8903-43f80ae0e34a/cf84fc46-3581-4fe7-a325-790de85d63a8) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:40:41.574896 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8bb1db5a-9736-42bc-ab68-91ee24612d6e req-c1d70e32-7b47-4587-a10c-973e07484a33 tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0278785 Dec 09 21:40:41.638822 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:41.696081 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9c28912-d34f-4d44-9cd7-750b1fc67cc4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:41.699333 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1faa187b-0441-47d3-8d37-6489d51928bb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5df02334-3682-4a91-b22d-133fa1bcb473'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:40:41.702171 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-012fa2f6-f189-4afc-9a23-930a6fe2363f" -d '{"events": [{"server_uuid": "1faa187b-0441-47d3-8d37-6489d51928bb", "name": "network-vif-plugged", "status": "completed", "tag": "5df02334-3682-4a91-b22d-133fa1bcb473"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:40:41.730267 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 5df02334-3682-4a91-b22d-133fa1bcb473, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=5df02334-3682-4a91-b22d-133fa1bcb473,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:41.740779 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:41.750292 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-da4a3a3c-da7a-4359-bf95-0eff7c074ab7 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:41.784596 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9c28912-d34f-4d44-9cd7-750b1fc67cc4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Subnet': ['ID=3b92e14d-ae1e-4c04-b429-1f3b54ff410a,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:41.807319 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c6a38ba-56d0-413c-825b-9751a84bcfca req-29d5d3d4-3947-4d80-97cf-90661936e307 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:41.807819 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-da4a3a3c-da7a-4359-bf95-0eff7c074ab7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:41.811673 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4c6a38ba-56d0-413c-825b-9751a84bcfca req-29d5d3d4-3947-4d80-97cf-90661936e307 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1faa187b-0441-47d3-8d37-6489d51928bb HTTP/1.1" status: 200 len: 945 time: 0.0871353 Dec 09 21:40:41.824486 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9c28912-d34f-4d44-9cd7-750b1fc67cc4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Checking segment: {'id': 'a03ac457-a159-4c3a-ac11-54383f6437c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': '682fa031-32a5-4912-90b9-b7b4ae53eab1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:40:41.825333 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9c28912-d34f-4d44-9cd7-750b1fc67cc4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Network hostable DHCP agents. Network: 682fa031-32a5-4912-90b9-b7b4ae53eab1, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:40:41.865279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da4a3a3c-da7a-4359-bf95-0eff7c074ab7 None None] Network 5fa22bcb-aab0-4d2e-acc0-554514c04095 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:40:41.867552 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-da4a3a3c-da7a-4359-bf95-0eff7c074ab7 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:41.868699 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e9c28912-d34f-4d44-9cd7-750b1fc67cc4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Network 682fa031-32a5-4912-90b9-b7b4ae53eab1 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:40:41.869937 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=5df02334-3682-4a91-b22d-133fa1bcb473,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:41.880852 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da4a3a3c-da7a-4359-bf95-0eff7c074ab7 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:40:41.893001 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-e9c28912-d34f-4d44-9cd7-750b1fc67cc4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 682fa031-32a5-4912-90b9-b7b4ae53eab1) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:41.912403 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e9c28912-d34f-4d44-9cd7-750b1fc67cc4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:41.913996 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9c28912-d34f-4d44-9cd7-750b1fc67cc4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:41.932571 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-47c14f7c-f8e0-4e49-ac1d-515799e7d6c8 None None] Network 682fa031-32a5-4912-90b9-b7b4ae53eab1 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:41.954770 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4c6a38ba-56d0-413c-825b-9751a84bcfca req-7574518e-568c-47a5-8c1f-0fcf9975b3e3 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1076863 Dec 09 21:40:41.961477 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e9c28912-d34f-4d44-9cd7-750b1fc67cc4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 873 time: 0.8236322 Dec 09 21:40:41.963217 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60534) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:42.019904 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:40:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1ba421ca-3767-4b73-985b-825bddb665cd x-openstack-request-id: req-1ba421ca-3767-4b73-985b-825bddb665cd {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:40:42.020201 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1faa187b-0441-47d3-8d37-6489d51928bb", "name": "network-vif-plugged", "status": "completed", "tag": "5df02334-3682-4a91-b22d-133fa1bcb473", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:40:42.020455 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-1ba421ca-3767-4b73-985b-825bddb665cd {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:40:42.020852 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1faa187b-0441-47d3-8d37-6489d51928bb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5df02334-3682-4a91-b22d-133fa1bcb473', 'code': 200} Dec 09 21:40:42.054565 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da4a3a3c-da7a-4359-bf95-0eff7c074ab7 None None] Pushing event updated for resources: {'Port': ['ID=cf84fc46-3581-4fe7-a325-790de85d63a8,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:42.060797 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-da4a3a3c-da7a-4359-bf95-0eff7c074ab7 None None] Attempting to bind port cf84fc46-3581-4fe7-a325-790de85d63a8 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:42.061096 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-da4a3a3c-da7a-4359-bf95-0eff7c074ab7 None None] Attempting to bind port cf84fc46-3581-4fe7-a325-790de85d63a8 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'e3897138-5662-4ad4-be68-fd266660ce00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': '5fa22bcb-aab0-4d2e-acc0-554514c04095'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:42.061457 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da4a3a3c-da7a-4359-bf95-0eff7c074ab7 None None] Attempting to bind port cf84fc46-3581-4fe7-a325-790de85d63a8 on network 5fa22bcb-aab0-4d2e-acc0-554514c04095 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:42.070319 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da4a3a3c-da7a-4359-bf95-0eff7c074ab7 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 40, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:40:42.070866 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da4a3a3c-da7a-4359-bf95-0eff7c074ab7 None None] Checking segment: {'id': 'e3897138-5662-4ad4-be68-fd266660ce00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': '5fa22bcb-aab0-4d2e-acc0-554514c04095'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:40:42.071085 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-da4a3a3c-da7a-4359-bf95-0eff7c074ab7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:42.071571 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da4a3a3c-da7a-4359-bf95-0eff7c074ab7 None None] Bound using segment: {'id': 'e3897138-5662-4ad4-be68-fd266660ce00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': '5fa22bcb-aab0-4d2e-acc0-554514c04095'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:40:42.071970 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-da4a3a3c-da7a-4359-bf95-0eff7c074ab7 None None] Bound port: cf84fc46-3581-4fe7-a325-790de85d63a8, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e3897138-5662-4ad4-be68-fd266660ce00', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 129, 'network_id': '5fa22bcb-aab0-4d2e-acc0-554514c04095'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:40:42.072363 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-da4a3a3c-da7a-4359-bf95-0eff7c074ab7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:42.174974 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:42.185773 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-39b9dc87-db5b-4139-9b53-09dac5396996 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-682fa031-32a5-4912-90b9-b7b4ae53eab1', 'network_id': '682fa031-32a5-4912-90b9-b7b4ae53eab1', 'project_id': '8d03fcad771c485fa5e2c1775828f3a7', 'fixed_ips': [{'subnet_id': '3b92e14d-ae1e-4c04-b429-1f3b54ff410a'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:40:42.185773 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-39b9dc87-db5b-4139-9b53-09dac5396996 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:42.200167 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f7e209a-3c2b-4e20-8930-3d43701805a3 req-7a771211-a663-46d5-a713-2f743abc0536 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:42.203393 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1f7e209a-3c2b-4e20-8930-3d43701805a3 req-7a771211-a663-46d5-a713-2f743abc0536 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=1faa187b-0441-47d3-8d37-6489d51928bb HTTP/1.1" status: 200 len: 1097 time: 0.0909905 Dec 09 21:40:42.240340 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-da4a3a3c-da7a-4359-bf95-0eff7c074ab7 None None] For port cf84fc46-3581-4fe7-a325-790de85d63a8, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:40:42.275659 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1f7e209a-3c2b-4e20-8930-3d43701805a3 req-e9669bd7-434a-4cfa-b248-3ecb57f551d3 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0596042 Dec 09 21:40:42.310090 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:42.375318 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-da4a3a3c-da7a-4359-bf95-0eff7c074ab7 None None] For port cf84fc46-3581-4fe7-a325-790de85d63a8, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=cf84fc46-3581-4fe7-a325-790de85d63a8,segment=NetworkSegment(e3897138-5662-4ad4-be68-fd266660ce00),segment_id=e3897138-5662-4ad4-be68-fd266660ce00)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:40:42.396110 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-da4a3a3c-da7a-4359-bf95-0eff7c074ab7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:42.464552 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-39b9dc87-db5b-4139-9b53-09dac5396996 None None] Allocated IP 172.20.0.2 (682fa031-32a5-4912-90b9-b7b4ae53eab1/3b92e14d-ae1e-4c04-b429-1f3b54ff410a/a8893edb-dea6-441e-9898-8184b95141e4) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:40:42.485853 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da4a3a3c-da7a-4359-bf95-0eff7c074ab7 None None] Pushing event updated for resources: {'Port': ['ID=cf84fc46-3581-4fe7-a325-790de85d63a8,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:42.634875 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba9a95dc-901b-440b-901a-abbb5058efe1 req-29071af3-5a00-4176-bc3a-d75da1ba151b tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:42.637241 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba9a95dc-901b-440b-901a-abbb5058efe1 req-29071af3-5a00-4176-bc3a-d75da1ba151b tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.0820293 Dec 09 21:40:42.666435 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-39b9dc87-db5b-4139-9b53-09dac5396996 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:42.676002 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-39b9dc87-db5b-4139-9b53-09dac5396996 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:42.699051 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:42.715378 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-39b9dc87-db5b-4139-9b53-09dac5396996 None None] Network 682fa031-32a5-4912-90b9-b7b4ae53eab1 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:40:42.718492 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-39b9dc87-db5b-4139-9b53-09dac5396996 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:42.722253 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39b9dc87-db5b-4139-9b53-09dac5396996 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:40:42.802204 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39b9dc87-db5b-4139-9b53-09dac5396996 None None] Pushing event updated for resources: {'Port': ['ID=a8893edb-dea6-441e-9898-8184b95141e4,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:42.820093 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba9a95dc-901b-440b-901a-abbb5058efe1 req-199511b6-68d3-4c33-a2ca-1df573753ae6 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1764374 Dec 09 21:40:42.826548 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-39b9dc87-db5b-4139-9b53-09dac5396996 None None] Attempting to bind port a8893edb-dea6-441e-9898-8184b95141e4 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:42.826920 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-39b9dc87-db5b-4139-9b53-09dac5396996 None None] Attempting to bind port a8893edb-dea6-441e-9898-8184b95141e4 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'a03ac457-a159-4c3a-ac11-54383f6437c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': '682fa031-32a5-4912-90b9-b7b4ae53eab1'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:42.827279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39b9dc87-db5b-4139-9b53-09dac5396996 None None] Attempting to bind port a8893edb-dea6-441e-9898-8184b95141e4 on network 682fa031-32a5-4912-90b9-b7b4ae53eab1 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:42.834300 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39b9dc87-db5b-4139-9b53-09dac5396996 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 40, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:40:42.834671 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39b9dc87-db5b-4139-9b53-09dac5396996 None None] Checking segment: {'id': 'a03ac457-a159-4c3a-ac11-54383f6437c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': '682fa031-32a5-4912-90b9-b7b4ae53eab1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:40:42.835070 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-39b9dc87-db5b-4139-9b53-09dac5396996 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:42.835477 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-39b9dc87-db5b-4139-9b53-09dac5396996 None None] Bound using segment: {'id': 'a03ac457-a159-4c3a-ac11-54383f6437c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': '682fa031-32a5-4912-90b9-b7b4ae53eab1'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:40:42.835948 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-39b9dc87-db5b-4139-9b53-09dac5396996 None None] Bound port: a8893edb-dea6-441e-9898-8184b95141e4, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a03ac457-a159-4c3a-ac11-54383f6437c0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': '682fa031-32a5-4912-90b9-b7b4ae53eab1'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:40:42.836327 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-39b9dc87-db5b-4139-9b53-09dac5396996 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:42.841838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Subnet': ['ID=3b92e14d-ae1e-4c04-b429-1f3b54ff410a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:42.929274 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:42.965943 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['682fa031-32a5-4912-90b9-b7b4ae53eab1']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:42.982096 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-39b9dc87-db5b-4139-9b53-09dac5396996 None None] For port a8893edb-dea6-441e-9898-8184b95141e4, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:40:42.988873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a03ac457-a159-4c3a-ac11-54383f6437c0') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:42.989094 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-39b9dc87-db5b-4139-9b53-09dac5396996 None None] For port a8893edb-dea6-441e-9898-8184b95141e4, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a8893edb-dea6-441e-9898-8184b95141e4,segment=NetworkSegment(a03ac457-a159-4c3a-ac11-54383f6437c0),segment_id=a03ac457-a159-4c3a-ac11-54383f6437c0)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:40:42.989609 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a03ac457-a159-4c3a-ac11-54383f6437c0') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:43.000575 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-39b9dc87-db5b-4139-9b53-09dac5396996 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:43.002119 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:43.026641 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:43.030339 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-804aaa17-1485-4636-980f-6272f7380fb6 req-82c6e2f5-21f7-4fe6-aabf-1276768e4f4c tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0802937 Dec 09 21:40:43.041936 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Releasing vlan 134 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:40:43.042627 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:40:43.046216 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:40:43.141551 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39b9dc87-db5b-4139-9b53-09dac5396996 None None] Pushing event updated for resources: {'Port': ['ID=a8893edb-dea6-441e-9898-8184b95141e4,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:43.177924 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d09982bb-d7d4-46c3-84fd-3398df1d3e2b None None] Network 682fa031-32a5-4912-90b9-b7b4ae53eab1 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:43.199459 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.db.api [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 09 21:40:43.199459 n-d-713301-27 neutron-server[103437]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 09 21:40:43.199459 n-d-713301-27 neutron-server[103437]: [parameters: {'id': '682fa031-32a5-4912-90b9-b7b4ae53eab1'}] Dec 09 21:40:43.199459 n-d-713301-27 neutron-server[103437]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103437) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:40:43.200886 n-d-713301-27 neutron-server[103437]: DEBUG oslo_db.api [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:40:43.277445 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9778b5e-eb37-4206-a618-736f6851ac92 req-5972cfb6-c256-4795-97fd-b7c01e8b0b3d tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:43.277445 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9778b5e-eb37-4206-a618-736f6851ac92 req-5972cfb6-c256-4795-97fd-b7c01e8b0b3d tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1faa187b-0441-47d3-8d37-6489d51928bb HTTP/1.1" status: 200 len: 945 time: 0.1007338 Dec 09 21:40:43.343803 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9778b5e-eb37-4206-a618-736f6851ac92 req-455a469c-1241-494e-a6c3-0841f84f05d0 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0623574 Dec 09 21:40:43.702151 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:43.772163 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Deleting port a8893edb-dea6-441e-9898-8184b95141e4 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:40:43.772498 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:43.867711 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] For port a8893edb-dea6-441e-9898-8184b95141e4, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a8893edb-dea6-441e-9898-8184b95141e4,segment=NetworkSegment(a03ac457-a159-4c3a-ac11-54383f6437c0),segment_id=a03ac457-a159-4c3a-ac11-54383f6437c0)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:43.868100 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:43.883026 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Calling delete_port for a8893edb-dea6-441e-9898-8184b95141e4 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:40:43.960783 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c38dc991-7898-45f1-be7b-992d0efae5d8 None None] Network 5fa22bcb-aab0-4d2e-acc0-554514c04095 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:44.001774 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:44.029778 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac0ddae1-8287-45c6-b589-3a96c43ef410 req-00d8e3d6-0297-462b-8867-e3ec286e9fd4 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:44.031974 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Port': ['ID=a8893edb-dea6-441e-9898-8184b95141e4,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:44.032127 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-03c5dddc-9f2d-44e9-ba24-282a293d740f None None] Provisioning complete for port cf84fc46-3581-4fe7-a325-790de85d63a8 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:44.032426 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-03c5dddc-9f2d-44e9-ba24-282a293d740f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:44.032889 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac0ddae1-8287-45c6-b589-3a96c43ef410 req-00d8e3d6-0297-462b-8867-e3ec286e9fd4 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.1031938 Dec 09 21:40:44.042959 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No DVR routers for this DVR port a8893edb-dea6-441e-9898-8184b95141e4 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:40:44.110513 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac0ddae1-8287-45c6-b589-3a96c43ef410 req-af8cf658-3733-4883-b4a9-be17a0c3cb7d tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0666263 Dec 09 21:40:44.155130 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:44.183345 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['682fa031-32a5-4912-90b9-b7b4ae53eab1']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:44.196088 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a03ac457-a159-4c3a-ac11-54383f6437c0') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:44.196088 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a03ac457-a159-4c3a-ac11-54383f6437c0') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:44.216196 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:44.238579 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:44.246849 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Releasing vlan 134 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:40:44.247272 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:40:44.251774 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:40:44.407388 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2265f72e-e55c-4293-8c66-9db65801c95b req-288aa79e-af6d-4e86-ae41-9584e3be8c52 tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0928195 Dec 09 21:40:44.427239 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:44.442011 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:44.449246 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/networks/682fa031-32a5-4912-90b9-b7b4ae53eab1 HTTP/1.1" status: 204 len: 168 time: 2.4819970 Dec 09 21:40:44.452928 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60606) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:44.459716 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-ca296b17-6949-4e7f-81f5-a26651e8e7ed tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1730232056'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:44.466035 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device cf84fc46-3581-4fe7-a325-790de85d63a8 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:40:44.485375 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d48df2a-17fa-4343-a556-c12739e8c9c8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Network': ['ID=682fa031-32a5-4912-90b9-b7b4ae53eab1,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:44.495330 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ca296b17-6949-4e7f-81f5-a26651e8e7ed tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Made reservation on behalf of 8d03fcad771c485fa5e2c1775828f3a7 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:44.500924 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ca296b17-6949-4e7f-81f5-a26651e8e7ed tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:44.537615 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ca296b17-6949-4e7f-81f5-a26651e8e7ed tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] vlan segment allocate from pool success with {'vlan_id': 136, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:40:44.576458 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ca296b17-6949-4e7f-81f5-a26651e8e7ed tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:44.577245 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-ca296b17-6949-4e7f-81f5-a26651e8e7ed tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Added segment c58d9ba8-a249-4b31-933d-81bcf6586c01 of type vlan for network d215b568-30c6-4d22-8443-503f2b0c1fb5 Dec 09 21:40:44.580253 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port cf84fc46-3581-4fe7-a325-790de85d63a8 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:44.580628 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:44.610000 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-03c5dddc-9f2d-44e9-ba24-282a293d740f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:44.637117 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cae7bce0-7a42-4d50-88c9-c219edfdd2dc req-4061e75e-5455-4da2-91d4-f7a7e81cc9d3 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:44.640208 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cae7bce0-7a42-4d50-88c9-c219edfdd2dc req-4061e75e-5455-4da2-91d4-f7a7e81cc9d3 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1faa187b-0441-47d3-8d37-6489d51928bb HTTP/1.1" status: 200 len: 945 time: 0.1000023 Dec 09 21:40:44.645301 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ca296b17-6949-4e7f-81f5-a26651e8e7ed tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:44.679995 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-03c5dddc-9f2d-44e9-ba24-282a293d740f None None] For port cf84fc46-3581-4fe7-a325-790de85d63a8, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=cf84fc46-3581-4fe7-a325-790de85d63a8,segment=NetworkSegment(e3897138-5662-4ad4-be68-fd266660ce00),segment_id=e3897138-5662-4ad4-be68-fd266660ce00)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:44.688634 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-03c5dddc-9f2d-44e9-ba24-282a293d740f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:44.717042 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ca296b17-6949-4e7f-81f5-a26651e8e7ed tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:44.724654 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca296b17-6949-4e7f-81f5-a26651e8e7ed tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:44.729055 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ca296b17-6949-4e7f-81f5-a26651e8e7ed tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:44.755251 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cae7bce0-7a42-4d50-88c9-c219edfdd2dc req-425047b4-0955-4c04-859e-33baa9a17050 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1053288 Dec 09 21:40:44.769780 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ca296b17-6949-4e7f-81f5-a26651e8e7ed tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.3146470 Dec 09 21:40:44.772778 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60612) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:44.787594 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-11b192ef-a82e-4f46-ad0a-9ac66cb2f049 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'subnet': {'network_id': 'd215b568-30c6-4d22-8443-503f2b0c1fb5', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:44.789305 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03c5dddc-9f2d-44e9-ba24-282a293d740f None None] Pushing event updated for resources: {'Port': ['ID=cf84fc46-3581-4fe7-a325-790de85d63a8,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:44.848256 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca296b17-6949-4e7f-81f5-a26651e8e7ed tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Network': ['ID=d215b568-30c6-4d22-8443-503f2b0c1fb5,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:44.860072 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network d215b568-30c6-4d22-8443-503f2b0c1fb5 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:40:44.930709 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-11b192ef-a82e-4f46-ad0a-9ac66cb2f049 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Made reservation on behalf of 8d03fcad771c485fa5e2c1775828f3a7 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:44.935230 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-11b192ef-a82e-4f46-ad0a-9ac66cb2f049 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:44.944096 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc55c201-3352-4045-b604-1766e3d85296 None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 21:40:45.033402 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc55c201-3352-4045-b604-1766e3d85296 None None] Resources bound (agent type, host, resource id): {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 09 21:40:45.040678 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1d251b44-04a0-49b3-9caa-5495bd8a5888 None None] Provisioning complete for port cf84fc46-3581-4fe7-a325-790de85d63a8 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:45.040974 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1d251b44-04a0-49b3-9caa-5495bd8a5888 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:45.046994 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.ipam_backend_mixin [None req-11b192ef-a82e-4f46-ad0a-9ac66cb2f049 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Performing IP validity checks on allocation pools {{(pid=103437) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Dec 09 21:40:45.049286 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.ipam_backend_mixin [None req-11b192ef-a82e-4f46-ad0a-9ac66cb2f049 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Checking for overlaps among allocation pools and gateway ip {{(pid=103437) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Dec 09 21:40:45.192763 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c639f97-e313-4cba-a992-44c143af8e4a req-4bca1f1c-d3d4-44b1-9047-92a5a9a05fd5 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:45.200053 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c639f97-e313-4cba-a992-44c143af8e4a req-4bca1f1c-d3d4-44b1-9047-92a5a9a05fd5 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/networks?id=ba3aee78-4661-4c71-9b18-af1e6a07faff HTTP/1.1" status: 200 len: 805 time: 0.1355677 Dec 09 21:40:45.216092 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c639f97-e313-4cba-a992-44c143af8e4a req-6fb66839-efac-4f8f-b023-17372d8d48c3 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/quotas/0569bc74c98b4ae2980de7af929e97eb HTTP/1.1" status: 200 len: 375 time: 0.0140057 Dec 09 21:40:45.219278 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-11b192ef-a82e-4f46-ad0a-9ac66cb2f049 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:45.273960 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c639f97-e313-4cba-a992-44c143af8e4a req-9efb2ea7-6ecb-4e5c-8cb3-1599de68ed5a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=0569bc74c98b4ae2980de7af929e97eb&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0549576 Dec 09 21:40:45.324415 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11b192ef-a82e-4f46-ad0a-9ac66cb2f049 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Checking segment: {'id': 'c58d9ba8-a249-4b31-933d-81bcf6586c01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'd215b568-30c6-4d22-8443-503f2b0c1fb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:40:45.324675 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11b192ef-a82e-4f46-ad0a-9ac66cb2f049 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Network hostable DHCP agents. Network: d215b568-30c6-4d22-8443-503f2b0c1fb5, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:40:45.333781 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11b192ef-a82e-4f46-ad0a-9ac66cb2f049 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Subnet': ['ID=509dccb9-131a-4307-8b51-6e6460c1c10a,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:45.358469 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11b192ef-a82e-4f46-ad0a-9ac66cb2f049 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Network d215b568-30c6-4d22-8443-503f2b0c1fb5 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:40:45.372097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-11b192ef-a82e-4f46-ad0a-9ac66cb2f049 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, d215b568-30c6-4d22-8443-503f2b0c1fb5) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:45.381514 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-11b192ef-a82e-4f46-ad0a-9ac66cb2f049 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:45.383584 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-11b192ef-a82e-4f46-ad0a-9ac66cb2f049 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:45.411105 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb3698a8-e57d-49a4-96f8-d47a22053ff4 None None] Network d215b568-30c6-4d22-8443-503f2b0c1fb5 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:45.419831 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-11b192ef-a82e-4f46-ad0a-9ac66cb2f049 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 792 time: 0.6444666 Dec 09 21:40:45.421817 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60640) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:45.462250 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c639f97-e313-4cba-a992-44c143af8e4a req-a4f0350d-8b72-4ed6-9eed-02996a519c10 service neutron] 10.222.0.13 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1873286 Dec 09 21:40:45.525399 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b85f9371-5aac-46e6-b9a1-ffb0d709e23e None None] Provisioning complete for port 5df02334-3682-4a91-b22d-133fa1bcb473 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:45.525900 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b85f9371-5aac-46e6-b9a1-ffb0d709e23e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:45.585240 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c639f97-e313-4cba-a992-44c143af8e4a req-ae4ed4b0-442e-4cc7-85fc-e69675db860f service neutron] 10.222.0.13 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1208019 Dec 09 21:40:45.592698 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8049a28-d009-4136-bbed-ea49a555efc8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:45.626711 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72e60eb7-84f5-4230-af92-066bc64aecb6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-d215b568-30c6-4d22-8443-503f2b0c1fb5', 'network_id': 'd215b568-30c6-4d22-8443-503f2b0c1fb5', 'project_id': '8d03fcad771c485fa5e2c1775828f3a7', 'fixed_ips': [{'subnet_id': '509dccb9-131a-4307-8b51-6e6460c1c10a'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:40:45.627635 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-72e60eb7-84f5-4230-af92-066bc64aecb6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:45.696256 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8049a28-d009-4136-bbed-ea49a555efc8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:45.789966 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8049a28-d009-4136-bbed-ea49a555efc8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:45.855488 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8049a28-d009-4136-bbed-ea49a555efc8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Subnet': ['ID=509dccb9-131a-4307-8b51-6e6460c1c10a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server [None req-72e60eb7-84f5-4230-af92-066bc64aecb6 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 509dccb9-131a-4307-8b51-6e6460c1c10a: This subnet is being modified by another concurrent operation. Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 306, in create_dhcp_port Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1485, in create_port Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1450, in _create_port_db Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1460, in create_port_db Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnet.lock_register( Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise exception Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 509dccb9-131a-4307-8b51-6e6460c1c10a: This subnet is being modified by another concurrent operation. Dec 09 21:40:45.896055 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Dec 09 21:40:45.960436 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0992c63-3da0-4604-a96a-51db4e5ecf9b None None] Network d215b568-30c6-4d22-8443-503f2b0c1fb5 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:46.029191 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c346754-c96b-4c68-a25b-d8f17075492c req-1fa8c75a-72b2-4d2f-a1fd-77816b9caad4 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:46.046453 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4c346754-c96b-4c68-a25b-d8f17075492c req-1fa8c75a-72b2-4d2f-a1fd-77816b9caad4 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.1884048 Dec 09 21:40:46.079221 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8049a28-d009-4136-bbed-ea49a555efc8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:46.099069 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b85f9371-5aac-46e6-b9a1-ffb0d709e23e None None] Provisioning complete for port be95aa8d-fc0e-4d77-a861-33c1637e4f3e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:46.101224 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b85f9371-5aac-46e6-b9a1-ffb0d709e23e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:46.112013 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-f8049a28-d009-4136-bbed-ea49a555efc8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d215b568-30c6-4d22-8443-503f2b0c1fb5']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:46.124132 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-f8049a28-d009-4136-bbed-ea49a555efc8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c58d9ba8-a249-4b31-933d-81bcf6586c01') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:46.124719 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-f8049a28-d009-4136-bbed-ea49a555efc8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c58d9ba8-a249-4b31-933d-81bcf6586c01') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:46.137640 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8049a28-d009-4136-bbed-ea49a555efc8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:46.155557 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8049a28-d009-4136-bbed-ea49a555efc8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:46.176663 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f8049a28-d009-4136-bbed-ea49a555efc8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Releasing vlan 136 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:40:46.178954 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8049a28-d009-4136-bbed-ea49a555efc8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:40:46.190614 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:40:46.204062 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4c346754-c96b-4c68-a25b-d8f17075492c req-16de0ed2-487e-4d23-b58f-513cbf6df29e tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1539526 Dec 09 21:40:46.205084 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4bc40fd4-283b-43ba-9ceb-90e9971d6a59 None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 21:40:46.297702 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device cf84fc46-3581-4fe7-a325-790de85d63a8 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:40:46.308211 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8049a28-d009-4136-bbed-ea49a555efc8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:46.317381 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8049a28-d009-4136-bbed-ea49a555efc8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:46.322157 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f8049a28-d009-4136-bbed-ea49a555efc8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/networks/d215b568-30c6-4d22-8443-503f2b0c1fb5 HTTP/1.1" status: 204 len: 168 time: 0.8993247 Dec 09 21:40:46.325936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60682) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:46.335894 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-39bead21-7a7d-45ae-bd58-7588866c6072 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1411763133'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:46.340276 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8049a28-d009-4136-bbed-ea49a555efc8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Network': ['ID=d215b568-30c6-4d22-8443-503f2b0c1fb5,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:46.412215 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b85f9371-5aac-46e6-b9a1-ffb0d709e23e None None] Provisioning complete for port c147a416-ff0a-4bae-9503-ebf0727fc69d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:46.412715 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b85f9371-5aac-46e6-b9a1-ffb0d709e23e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:46.419281 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-013d8db1-8929-4427-b934-9dcd4cdf39a5 req-566c8d08-581c-4099-96af-daee6ea1eb30 tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0627859 Dec 09 21:40:46.440626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-39bead21-7a7d-45ae-bd58-7588866c6072 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Made reservation on behalf of 8d03fcad771c485fa5e2c1775828f3a7 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:46.448351 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-39bead21-7a7d-45ae-bd58-7588866c6072 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:46.488150 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4bc40fd4-283b-43ba-9ceb-90e9971d6a59 None None] Resources bound (agent type, host, resource id): {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 09 21:40:46.520909 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-39bead21-7a7d-45ae-bd58-7588866c6072 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] vlan segment allocate from pool success with {'vlan_id': 141, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:40:46.555976 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-39bead21-7a7d-45ae-bd58-7588866c6072 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:46.558931 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-39bead21-7a7d-45ae-bd58-7588866c6072 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Added segment 73ca31ef-c8d7-4480-be3c-27e193593628 of type vlan for network 1cfafc03-a00a-4988-b227-f3b31e5bca30 Dec 09 21:40:46.611582 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-39bead21-7a7d-45ae-bd58-7588866c6072 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:46.668469 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-39bead21-7a7d-45ae-bd58-7588866c6072 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:46.675961 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39bead21-7a7d-45ae-bd58-7588866c6072 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:46.676917 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-39bead21-7a7d-45ae-bd58-7588866c6072 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:46.734306 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-39bead21-7a7d-45ae-bd58-7588866c6072 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.4062386 Dec 09 21:40:46.737401 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60692) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:46.746434 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-81c13eb2-6d1e-4b30-97dc-2411e8555265 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'subnet': {'network_id': '1cfafc03-a00a-4988-b227-f3b31e5bca30', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'enable_dhcp': True}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:46.849388 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39bead21-7a7d-45ae-bd58-7588866c6072 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Network': ['ID=1cfafc03-a00a-4988-b227-f3b31e5bca30,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:46.850285 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port cf84fc46-3581-4fe7-a325-790de85d63a8 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:46.851568 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:46.898112 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 1cfafc03-a00a-4988-b227-f3b31e5bca30 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:40:46.945475 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-81c13eb2-6d1e-4b30-97dc-2411e8555265 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Made reservation on behalf of 8d03fcad771c485fa5e2c1775828f3a7 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:46.957041 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-81c13eb2-6d1e-4b30-97dc-2411e8555265 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:47.169649 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8053a6da-9368-4c29-a0bc-687ef426ade5 req-87d39455-3bda-44ae-a84a-a10926f86a43 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=ae24945c-a683-4d83-ab3e-52a7a8e3becd HTTP/1.1" status: 200 len: 210 time: 0.0506380 Dec 09 21:40:47.206902 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b85f9371-5aac-46e6-b9a1-ffb0d709e23e None None] Provisioning complete for port 10ac5a10-4f73-4f89-b652-3c81390af0aa triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:47.217092 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b85f9371-5aac-46e6-b9a1-ffb0d709e23e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:47.313158 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-81c13eb2-6d1e-4b30-97dc-2411e8555265 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:47.406449 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-81c13eb2-6d1e-4b30-97dc-2411e8555265 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Checking segment: {'id': '73ca31ef-c8d7-4480-be3c-27e193593628', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '1cfafc03-a00a-4988-b227-f3b31e5bca30'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:40:47.406854 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-81c13eb2-6d1e-4b30-97dc-2411e8555265 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Network hostable DHCP agents. Network: 1cfafc03-a00a-4988-b227-f3b31e5bca30, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:40:47.414594 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81c13eb2-6d1e-4b30-97dc-2411e8555265 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Subnet': ['ID=56e878a5-ca09-40a2-9a11-b6ea0d07443b,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:47.437461 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-81c13eb2-6d1e-4b30-97dc-2411e8555265 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Network 1cfafc03-a00a-4988-b227-f3b31e5bca30 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:40:47.457328 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-81c13eb2-6d1e-4b30-97dc-2411e8555265 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 1cfafc03-a00a-4988-b227-f3b31e5bca30) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:47.463679 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-81c13eb2-6d1e-4b30-97dc-2411e8555265 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:47.464365 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-81c13eb2-6d1e-4b30-97dc-2411e8555265 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:47.471260 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d7baa09-321b-48ce-a7b3-f9e99359fa2b None None] Network 1cfafc03-a00a-4988-b227-f3b31e5bca30 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:47.488313 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-81c13eb2-6d1e-4b30-97dc-2411e8555265 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 0.7483230 Dec 09 21:40:47.490346 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60712) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:47.598972 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f7cf5b7-f6a7-4960-adb2-8119fb48958a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-1cfafc03-a00a-4988-b227-f3b31e5bca30', 'network_id': '1cfafc03-a00a-4988-b227-f3b31e5bca30', 'project_id': '8d03fcad771c485fa5e2c1775828f3a7', 'fixed_ips': [{'subnet_id': '56e878a5-ca09-40a2-9a11-b6ea0d07443b'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:40:47.603158 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5f7cf5b7-f6a7-4960-adb2-8119fb48958a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:47.641374 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-077390a3-90de-4c07-8e96-2e787a2a6b57 req-bb6f893d-d1ad-4b8e-b1fa-ef8fefff3340 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:47.649953 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-077390a3-90de-4c07-8e96-2e787a2a6b57 req-bb6f893d-d1ad-4b8e-b1fa-ef8fefff3340 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.0663333 Dec 09 21:40:47.661031 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:47.711598 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-077390a3-90de-4c07-8e96-2e787a2a6b57 req-be3e448e-620c-490c-b8aa-777fb5f18701 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0588734 Dec 09 21:40:47.779381 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:47.819655 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44543b92-fbe8-422a-adf8-ba29434947c5 req-914f08a5-98e9-418f-b16f-f2967d80673b tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0327909 Dec 09 21:40:47.856722 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-5f7cf5b7-f6a7-4960-adb2-8119fb48958a None None] Allocated IP 172.20.0.1 (1cfafc03-a00a-4988-b227-f3b31e5bca30/56e878a5-ca09-40a2-9a11-b6ea0d07443b/fa9af5b5-e2fd-49ea-95f6-3cae183f34fc) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:40:48.036600 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5f7cf5b7-f6a7-4960-adb2-8119fb48958a None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:48.042346 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5f7cf5b7-f6a7-4960-adb2-8119fb48958a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:48.064909 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:48.087758 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f7cf5b7-f6a7-4960-adb2-8119fb48958a None None] Network 1cfafc03-a00a-4988-b227-f3b31e5bca30 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:40:48.095450 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-5f7cf5b7-f6a7-4960-adb2-8119fb48958a None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:48.098103 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f7cf5b7-f6a7-4960-adb2-8119fb48958a None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:40:48.111891 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Subnet': ['ID=56e878a5-ca09-40a2-9a11-b6ea0d07443b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:48.127869 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f7cf5b7-f6a7-4960-adb2-8119fb48958a None None] Pushing event updated for resources: {'Port': ['ID=fa9af5b5-e2fd-49ea-95f6-3cae183f34fc,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:48.184535 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-89d1686e-5477-41ae-a069-b1493542085e tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:48.194349 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-89d1686e-5477-41ae-a069-b1493542085e tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/networks?id=ba3aee78-4661-4c71-9b18-af1e6a07faff HTTP/1.1" status: 200 len: 805 time: 0.1577053 Dec 09 21:40:48.213193 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-6bc9ac2f-3400-4ef2-adc1-94bee2dcb925 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/quotas/0569bc74c98b4ae2980de7af929e97eb HTTP/1.1" status: 200 len: 375 time: 0.0176554 Dec 09 21:40:48.239463 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-5f7cf5b7-f6a7-4960-adb2-8119fb48958a None None] Attempting to bind port fa9af5b5-e2fd-49ea-95f6-3cae183f34fc on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:48.240068 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-5f7cf5b7-f6a7-4960-adb2-8119fb48958a None None] Attempting to bind port fa9af5b5-e2fd-49ea-95f6-3cae183f34fc by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '73ca31ef-c8d7-4480-be3c-27e193593628', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '1cfafc03-a00a-4988-b227-f3b31e5bca30'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:48.240209 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f7cf5b7-f6a7-4960-adb2-8119fb48958a None None] Attempting to bind port fa9af5b5-e2fd-49ea-95f6-3cae183f34fc on network 1cfafc03-a00a-4988-b227-f3b31e5bca30 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:48.245647 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f7cf5b7-f6a7-4960-adb2-8119fb48958a None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 40, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:40:48.246018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f7cf5b7-f6a7-4960-adb2-8119fb48958a None None] Checking segment: {'id': '73ca31ef-c8d7-4480-be3c-27e193593628', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '1cfafc03-a00a-4988-b227-f3b31e5bca30'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:40:48.246418 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5f7cf5b7-f6a7-4960-adb2-8119fb48958a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:48.246803 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f7cf5b7-f6a7-4960-adb2-8119fb48958a None None] Bound using segment: {'id': '73ca31ef-c8d7-4480-be3c-27e193593628', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '1cfafc03-a00a-4988-b227-f3b31e5bca30'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:40:48.247263 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-5f7cf5b7-f6a7-4960-adb2-8119fb48958a None None] Bound port: fa9af5b5-e2fd-49ea-95f6-3cae183f34fc, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '73ca31ef-c8d7-4480-be3c-27e193593628', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '1cfafc03-a00a-4988-b227-f3b31e5bca30'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:40:48.247663 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5f7cf5b7-f6a7-4960-adb2-8119fb48958a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:48.279961 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:48.284228 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-e0e47f6b-279e-43f1-ac0d-c0191127c598 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=0569bc74c98b4ae2980de7af929e97eb&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0697646 Dec 09 21:40:48.303129 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1cfafc03-a00a-4988-b227-f3b31e5bca30']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:48.313657 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '73ca31ef-c8d7-4480-be3c-27e193593628') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:48.313984 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '73ca31ef-c8d7-4480-be3c-27e193593628') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:48.337562 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:48.347700 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-5f7cf5b7-f6a7-4960-adb2-8119fb48958a None None] For port fa9af5b5-e2fd-49ea-95f6-3cae183f34fc, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:40:48.351724 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-5f7cf5b7-f6a7-4960-adb2-8119fb48958a None None] For port fa9af5b5-e2fd-49ea-95f6-3cae183f34fc, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=fa9af5b5-e2fd-49ea-95f6-3cae183f34fc,segment=NetworkSegment(73ca31ef-c8d7-4480-be3c-27e193593628),segment_id=73ca31ef-c8d7-4480-be3c-27e193593628)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:40:48.361306 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:48.361773 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5f7cf5b7-f6a7-4960-adb2-8119fb48958a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:48.373962 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Releasing vlan 141 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:40:48.374405 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:40:48.378642 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:40:48.457210 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-95fbe6eb-2746-488d-9862-e84ac76e78ea service neutron] 10.222.0.13 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1719766 Dec 09 21:40:48.492042 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0ffb5162-6a20-4583-a60a-99897183536f None None] Network 1cfafc03-a00a-4988-b227-f3b31e5bca30 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:48.551044 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.db.api [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 09 21:40:48.551044 n-d-713301-27 neutron-server[103437]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 09 21:40:48.551044 n-d-713301-27 neutron-server[103437]: [parameters: {'id': '1cfafc03-a00a-4988-b227-f3b31e5bca30'}] Dec 09 21:40:48.551044 n-d-713301-27 neutron-server[103437]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103437) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:40:48.551614 n-d-713301-27 neutron-server[103437]: DEBUG oslo_db.api [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:40:48.592227 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-022cb351-f12e-4cb2-b04b-cf87961b9471 service neutron] 10.222.0.13 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1336000 Dec 09 21:40:48.598038 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f7cf5b7-f6a7-4960-adb2-8119fb48958a None None] Pushing event updated for resources: {'Port': ['ID=fa9af5b5-e2fd-49ea-95f6-3cae183f34fc,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:48.627908 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9c639f97-e313-4cba-a992-44c143af8e4a req-146771ee-90e5-45f1-a077-0270ca4660c7 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=0569bc74c98b4ae2980de7af929e97eb&device_id=ae24945c-a683-4d83-ab3e-52a7a8e3becd HTTP/1.1" status: 200 len: 210 time: 0.0473931 Dec 09 21:40:48.794859 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba881e32-b402-4e24-863a-cc675328b016 None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 21:40:48.865086 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-64e5275b-edf7-4ce0-845f-578b540d5aae req-ee2976bf-be6b-4842-bb48-664c2b0093ef tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4f31caf3-99fc-49ed-905b-5274e085b84c HTTP/1.1" status: 200 len: 210 time: 0.0846295 Dec 09 21:40:48.937996 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba881e32-b402-4e24-863a-cc675328b016 None None] Resources bound (agent type, host, resource id): {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 09 21:40:48.973385 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c639f97-e313-4cba-a992-44c143af8e4a req-3a9bbfc7-d23c-4eab-95f2-d6db8551420c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:48.974829 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9c639f97-e313-4cba-a992-44c143af8e4a req-3a9bbfc7-d23c-4eab-95f2-d6db8551420c service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=0569bc74c98b4ae2980de7af929e97eb&shared=False HTTP/1.1" status: 200 len: 906 time: 0.3394790 Dec 09 21:40:48.990113 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f66964da-1c8d-4135-b56f-d23b22380d3c req-07e5d9e9-b83c-4298-ae36-d4f9dad6ed94 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:49.000171 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f66964da-1c8d-4135-b56f-d23b22380d3c req-07e5d9e9-b83c-4298-ae36-d4f9dad6ed94 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.0681047 Dec 09 21:40:49.081505 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f66964da-1c8d-4135-b56f-d23b22380d3c req-505e269a-e057-4e98-bdf6-090aba5252b5 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0800867 Dec 09 21:40:49.158983 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:49.300899 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-411b208c-105f-4b72-b885-f9e8a2406a23 req-e66345a4-10c4-4c6e-9f65-2785b56170ad tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0479667 Dec 09 21:40:49.816754 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60790) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:49.857117 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c639f97-e313-4cba-a992-44c143af8e4a req-d37ce86e-ddbf-4a38-8c3c-59b663ba1b34 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:49.859587 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9c639f97-e313-4cba-a992-44c143af8e4a req-d37ce86e-ddbf-4a38-8c3c-59b663ba1b34 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.8761957 Dec 09 21:40:49.930003 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9c639f97-e313-4cba-a992-44c143af8e4a req-436ecae1-1da0-4c6b-b04b-ac42eeb09233 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.10 "GET /v2.0/ports?device_id=ae24945c-a683-4d83-ab3e-52a7a8e3becd HTTP/1.1" status: 200 len: 210 time: 0.0323048 Dec 09 21:40:49.948706 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Deleting port fa9af5b5-e2fd-49ea-95f6-3cae183f34fc {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:40:49.949147 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:50.002876 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-90247e3b-0724-4db8-9c76-e5a0fe31c990 req-31e5d871-3682-4e30-8c9a-672206e5f6e9 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4f31caf3-99fc-49ed-905b-5274e085b84c HTTP/1.1" status: 200 len: 210 time: 0.0443294 Dec 09 21:40:50.023830 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e50747ac-08ea-47f2-b1f0-367d38a92813 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:50.060677 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] For port fa9af5b5-e2fd-49ea-95f6-3cae183f34fc, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=fa9af5b5-e2fd-49ea-95f6-3cae183f34fc,segment=NetworkSegment(73ca31ef-c8d7-4480-be3c-27e193593628),segment_id=73ca31ef-c8d7-4480-be3c-27e193593628)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:50.061345 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:50.095206 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Calling delete_port for fa9af5b5-e2fd-49ea-95f6-3cae183f34fc owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:40:50.190293 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e50747ac-08ea-47f2-b1f0-367d38a92813 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:50.241635 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e50747ac-08ea-47f2-b1f0-367d38a92813 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:50.265140 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:50.315467 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No DVR routers for this DVR port fa9af5b5-e2fd-49ea-95f6-3cae183f34fc on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:40:50.326387 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Port': ['ID=fa9af5b5-e2fd-49ea-95f6-3cae183f34fc,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:50.368150 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddd98136-4409-485d-98a8-bd21f20ff29b req-b0f19d2c-9b0c-49b0-91bb-ed8adeae20c0 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:50.372913 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ddd98136-4409-485d-98a8-bd21f20ff29b req-b0f19d2c-9b0c-49b0-91bb-ed8adeae20c0 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.1576052 Dec 09 21:40:50.381906 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e50747ac-08ea-47f2-b1f0-367d38a92813 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b6e167d3-f18b-4696-bbbe-170f1fc4cc11,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:50.393913 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e50747ac-08ea-47f2-b1f0-367d38a92813 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=948f773c6fa449029e767712952cf2b4&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5753872 Dec 09 21:40:50.401002 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60800) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:50.425150 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:50.459906 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1cfafc03-a00a-4988-b227-f3b31e5bca30']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:50.470816 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '73ca31ef-c8d7-4480-be3c-27e193593628') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:50.471294 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '73ca31ef-c8d7-4480-be3c-27e193593628') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:50.472795 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ddd98136-4409-485d-98a8-bd21f20ff29b req-74c9c05b-943b-4577-b554-d4c3f4df044b tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0860097 Dec 09 21:40:50.501902 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:50.526051 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-5a6168c0-9959-4307-9cc7-48c737d1cbba tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:50.529277 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-5a6168c0-9959-4307-9cc7-48c737d1cbba tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "GET /v2.0/networks?id=ba3aee78-4661-4c71-9b18-af1e6a07faff HTTP/1.1" status: 200 len: 805 time: 0.3282759 Dec 09 21:40:50.538158 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:50.543079 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-f225f941-59e2-4e32-9fd6-ba47c8b5e03b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Request body: {'port': {'device_id': '4f31caf3-99fc-49ed-905b-5274e085b84c', 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff', 'admin_state_up': True, 'tenant_id': '0569bc74c98b4ae2980de7af929e97eb'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:50.556513 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Releasing vlan 141 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:40:50.556835 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:50.602195 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bcf7d400-3816-4c6c-bfc2-ba72ff8de705 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:50.631826 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ef1e0d7-2674-4e6d-bf99-7d680b1326c2 req-ecf86e81-f1da-460b-b6a5-494420c894af tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0414453 Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:40:50.632683 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:40:50.637977 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:50.648181 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:50.660252 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/networks/1cfafc03-a00a-4988-b227-f3b31e5bca30 HTTP/1.1" status: 204 len: 168 time: 3.1593375 Dec 09 21:40:50.677334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60804) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:50.682768 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-8b1732f8-3950-46ca-8d1f-195e8bd3d560 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-715127179'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:50.686906 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16b62036-6557-4dcc-9498-2f6787bedbbb tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Network': ['ID=1cfafc03-a00a-4988-b227-f3b31e5bca30,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:50.735648 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bcf7d400-3816-4c6c-bfc2-ba72ff8de705 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:50.754931 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8b1732f8-3950-46ca-8d1f-195e8bd3d560 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Made reservation on behalf of 8d03fcad771c485fa5e2c1775828f3a7 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:50.758436 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8b1732f8-3950-46ca-8d1f-195e8bd3d560 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:50.820412 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8b1732f8-3950-46ca-8d1f-195e8bd3d560 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] vlan segment allocate from pool success with {'vlan_id': 138, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:40:50.835283 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-f225f941-59e2-4e32-9fd6-ba47c8b5e03b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Made reservation on behalf of 0569bc74c98b4ae2980de7af929e97eb for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:50.840195 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-f225f941-59e2-4e32-9fd6-ba47c8b5e03b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:50.860030 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8b1732f8-3950-46ca-8d1f-195e8bd3d560 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:50.860392 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-8b1732f8-3950-46ca-8d1f-195e8bd3d560 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Added segment 3cea3439-08cb-47bf-9e79-3b6606c099ab of type vlan for network d0a9c0a3-348f-41dc-b938-0b6edb8ab271 Dec 09 21:40:50.861624 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bcf7d400-3816-4c6c-bfc2-ba72ff8de705 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:50.864285 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bcf7d400-3816-4c6c-bfc2-ba72ff8de705 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:50.865454 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bcf7d400-3816-4c6c-bfc2-ba72ff8de705 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/b6e167d3-f18b-4696-bbbe-170f1fc4cc11 HTTP/1.1" status: 204 len: 168 time: 0.4632003 Dec 09 21:40:50.916094 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcf7d400-3816-4c6c-bfc2-ba72ff8de705 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b6e167d3-f18b-4696-bbbe-170f1fc4cc11,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:50.977919 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8b1732f8-3950-46ca-8d1f-195e8bd3d560 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:51.066620 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8b1732f8-3950-46ca-8d1f-195e8bd3d560 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:51.073454 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8b1732f8-3950-46ca-8d1f-195e8bd3d560 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:51.074206 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8b1732f8-3950-46ca-8d1f-195e8bd3d560 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:51.139686 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8b1732f8-3950-46ca-8d1f-195e8bd3d560 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.4608991 Dec 09 21:40:51.142945 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60812) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:51.148678 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-93e9c54d-01f0-4d6e-9e17-a1851427b6ec tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'subnet': {'network_id': 'd0a9c0a3-348f-41dc-b938-0b6edb8ab271', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:51.205534 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85be1ab0-2d86-4cf8-857f-89882a4cab54 req-8bf50bee-9bfc-4a6c-abba-9526197a1b56 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4f31caf3-99fc-49ed-905b-5274e085b84c HTTP/1.1" status: 200 len: 210 time: 0.0996325 Dec 09 21:40:51.207864 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-f225f941-59e2-4e32-9fd6-ba47c8b5e03b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Allocated IP 172.20.0.14 (ba3aee78-4661-4c71-9b18-af1e6a07faff/b61ac70f-1e8d-40a8-9031-bab15f73fa0a/606dbd6b-3506-4b46-a9d0-f89c7843bf4c) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:40:51.213860 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b1732f8-3950-46ca-8d1f-195e8bd3d560 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Network': ['ID=d0a9c0a3-348f-41dc-b938-0b6edb8ab271,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:51.230916 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network d0a9c0a3-348f-41dc-b938-0b6edb8ab271 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:40:51.303163 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-93e9c54d-01f0-4d6e-9e17-a1851427b6ec tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Made reservation on behalf of 8d03fcad771c485fa5e2c1775828f3a7 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:51.316474 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93e9c54d-01f0-4d6e-9e17-a1851427b6ec tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:51.318085 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60814) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:51.353776 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ac05bbe-1c44-4c70-9b12-fa747318d46d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:51.602776 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93e9c54d-01f0-4d6e-9e17-a1851427b6ec tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:51.674137 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93e9c54d-01f0-4d6e-9e17-a1851427b6ec tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Subnet': ['ID=d15de741-dbcd-4ce6-b85a-4ea8263ad71e,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:51.684852 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-93e9c54d-01f0-4d6e-9e17-a1851427b6ec tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Checking segment: {'id': '3cea3439-08cb-47bf-9e79-3b6606c099ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'd0a9c0a3-348f-41dc-b938-0b6edb8ab271'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:40:51.685224 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-93e9c54d-01f0-4d6e-9e17-a1851427b6ec tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Network hostable DHCP agents. Network: d0a9c0a3-348f-41dc-b938-0b6edb8ab271, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:40:51.704681 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-93e9c54d-01f0-4d6e-9e17-a1851427b6ec tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Network d0a9c0a3-348f-41dc-b938-0b6edb8ab271 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:40:51.714705 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-93e9c54d-01f0-4d6e-9e17-a1851427b6ec tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, d0a9c0a3-348f-41dc-b938-0b6edb8ab271) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:51.724221 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e796f92f-fd9e-4933-bba6-f767564e7ba9 None None] Network d0a9c0a3-348f-41dc-b938-0b6edb8ab271 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:51.727181 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-93e9c54d-01f0-4d6e-9e17-a1851427b6ec tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:51.727923 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93e9c54d-01f0-4d6e-9e17-a1851427b6ec tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:51.755685 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-93e9c54d-01f0-4d6e-9e17-a1851427b6ec tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.6113982 Dec 09 21:40:51.756430 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60822) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:51.872997 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b81db8cd-698d-48a6-bcff-e4d0761bfb48 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:51.876960 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5e959ca-f0d3-4ea4-b7d5-02152a32d3ad None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-d0a9c0a3-348f-41dc-b938-0b6edb8ab271', 'network_id': 'd0a9c0a3-348f-41dc-b938-0b6edb8ab271', 'project_id': '8d03fcad771c485fa5e2c1775828f3a7', 'fixed_ips': [{'subnet_id': 'd15de741-dbcd-4ce6-b85a-4ea8263ad71e'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:40:51.878599 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c5e959ca-f0d3-4ea4-b7d5-02152a32d3ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:51.910714 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ac05bbe-1c44-4c70-9b12-fa747318d46d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:51.933479 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b81db8cd-698d-48a6-bcff-e4d0761bfb48 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:51.938970 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-f225f941-59e2-4e32-9fd6-ba47c8b5e03b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:51.940342 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ac05bbe-1c44-4c70-9b12-fa747318d46d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:51.974654 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ac05bbe-1c44-4c70-9b12-fa747318d46d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d1171fd5-fe64-41d5-9400-7af81d498cd9,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:52.007822 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b81db8cd-698d-48a6-bcff-e4d0761bfb48 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server [None req-c5e959ca-f0d3-4ea4-b7d5-02152a32d3ad None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet d15de741-dbcd-4ce6-b85a-4ea8263ad71e: This subnet is being modified by another concurrent operation. Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 306, in create_dhcp_port Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1485, in create_port Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1450, in _create_port_db Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1460, in create_port_db Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnet.lock_register( Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise exception Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet d15de741-dbcd-4ce6-b85a-4ea8263ad71e: This subnet is being modified by another concurrent operation. Dec 09 21:40:52.027991 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Dec 09 21:40:52.034498 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5ac05bbe-1c44-4c70-9b12-fa747318d46d admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=2087f7c0729d4afdb900d2206f82f42a&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7053814 Dec 09 21:40:52.034498 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60824) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:52.039159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b81db8cd-698d-48a6-bcff-e4d0761bfb48 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Subnet': ['ID=d15de741-dbcd-4ce6-b85a-4ea8263ad71e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:52.047153 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c5a8b98-4eb6-4c3f-8cb2-403b5f3d304f req-2d89e8b0-8fc5-40b0-a6ac-3665ca95c0ed tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:52.054564 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c5a8b98-4eb6-4c3f-8cb2-403b5f3d304f req-2d89e8b0-8fc5-40b0-a6ac-3665ca95c0ed tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.1608145 Dec 09 21:40:52.083041 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07d179bd-b829-42d6-b795-6508017866d0 None None] Network d0a9c0a3-348f-41dc-b938-0b6edb8ab271 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:52.113903 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-f225f941-59e2-4e32-9fd6-ba47c8b5e03b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:52.119296 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b81db8cd-698d-48a6-bcff-e4d0761bfb48 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:52.142675 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-b81db8cd-698d-48a6-bcff-e4d0761bfb48 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d0a9c0a3-348f-41dc-b938-0b6edb8ab271']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:52.153042 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-b81db8cd-698d-48a6-bcff-e4d0761bfb48 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3cea3439-08cb-47bf-9e79-3b6606c099ab') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:52.153344 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-b81db8cd-698d-48a6-bcff-e4d0761bfb48 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3cea3439-08cb-47bf-9e79-3b6606c099ab') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:52.164336 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['5df02334-3682-4a91-b22d-133fa1bcb473'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:40:52.166871 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b81db8cd-698d-48a6-bcff-e4d0761bfb48 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:52.175961 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c5a8b98-4eb6-4c3f-8cb2-403b5f3d304f req-48d1e25f-787a-4264-9965-c9ca29cee5b8 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1203837 Dec 09 21:40:52.186818 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b81db8cd-698d-48a6-bcff-e4d0761bfb48 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:52.207477 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b81db8cd-698d-48a6-bcff-e4d0761bfb48 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Releasing vlan 138 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:40:52.208054 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b81db8cd-698d-48a6-bcff-e4d0761bfb48 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:40:52.212090 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:40:52.222245 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f225f941-59e2-4e32-9fd6-ba47c8b5e03b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Pushing event updated for resources: {'Port': ['ID=606dbd6b-3506-4b46-a9d0-f89c7843bf4c,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:52.247008 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-f225f941-59e2-4e32-9fd6-ba47c8b5e03b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Network ba3aee78-4661-4c71-9b18-af1e6a07faff is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:40:52.283484 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-f225f941-59e2-4e32-9fd6-ba47c8b5e03b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:52.288143 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4fa0d768-3b58-4843-83e4-bc56e0b83ace admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:52.292294 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-f225f941-59e2-4e32-9fd6-ba47c8b5e03b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:40:52.300899 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b81db8cd-698d-48a6-bcff-e4d0761bfb48 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:52.310747 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-adceaa8b-8a52-4ff1-b049-78c987d3c3f1 None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 21:40:52.314978 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b81db8cd-698d-48a6-bcff-e4d0761bfb48 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:52.334584 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b81db8cd-698d-48a6-bcff-e4d0761bfb48 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/networks/d0a9c0a3-348f-41dc-b938-0b6edb8ab271 HTTP/1.1" status: 204 len: 168 time: 0.5735381 Dec 09 21:40:52.340511 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60828) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:52.347126 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-01706474-eaa7-46a2-9764-f8616fa672e5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1967864536'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:52.349521 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b81db8cd-698d-48a6-bcff-e4d0761bfb48 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Network': ['ID=d0a9c0a3-348f-41dc-b938-0b6edb8ab271,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:52.366077 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27867a39-0429-442b-b696-4409d67abc96 req-08bd4574-dd71-4590-866f-8c2d98a7e40e tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0787816 Dec 09 21:40:52.380675 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-01706474-eaa7-46a2-9764-f8616fa672e5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Made reservation on behalf of 8d03fcad771c485fa5e2c1775828f3a7 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:52.385343 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01706474-eaa7-46a2-9764-f8616fa672e5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:52.416161 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4fa0d768-3b58-4843-83e4-bc56e0b83ace admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:52.418560 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-01706474-eaa7-46a2-9764-f8616fa672e5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] vlan segment allocate from pool success with {'vlan_id': 112, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:40:52.431342 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01706474-eaa7-46a2-9764-f8616fa672e5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:52.431780 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-01706474-eaa7-46a2-9764-f8616fa672e5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Added segment 0c209c92-cb37-4226-b089-ea6e8b8f2791 of type vlan for network ed0707dd-685f-47b2-a0b6-f9fccdf89e1f Dec 09 21:40:52.458338 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-f225f941-59e2-4e32-9fd6-ba47c8b5e03b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:52.459350 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-f225f941-59e2-4e32-9fd6-ba47c8b5e03b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:52.520524 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01706474-eaa7-46a2-9764-f8616fa672e5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:52.531098 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-f225f941-59e2-4e32-9fd6-ba47c8b5e03b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.9926913 Dec 09 21:40:52.550126 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-069c1d6a-a20b-43a8-9816-b83f7c9c4db3 service neutron] Request body: {'port': {'device_id': '4f31caf3-99fc-49ed-905b-5274e085b84c', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:52.560793 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-adceaa8b-8a52-4ff1-b049-78c987d3c3f1 None None] Resources bound (agent type, host, resource id): {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 09 21:40:52.566996 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01706474-eaa7-46a2-9764-f8616fa672e5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:52.576613 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01706474-eaa7-46a2-9764-f8616fa672e5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:52.577302 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01706474-eaa7-46a2-9764-f8616fa672e5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:52.585380 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41637fa9-9c68-498d-bd17-a03ac0a6946a req-b6d7e466-9db1-41ec-a3d1-2ef523483bac tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:52.593667 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-41637fa9-9c68-498d-bd17-a03ac0a6946a req-b6d7e466-9db1-41ec-a3d1-2ef523483bac tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4f31caf3-99fc-49ed-905b-5274e085b84c HTTP/1.1" status: 200 len: 932 time: 0.1161695 Dec 09 21:40:52.651533 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f9d478ab-7bf9-40c7-8460-9a4e44076378 req-46cb5194-851c-4dd3-9721-4309f0225524 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0661697 Dec 09 21:40:52.656636 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4fa0d768-3b58-4843-83e4-bc56e0b83ace admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:52.659358 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4fa0d768-3b58-4843-83e4-bc56e0b83ace admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:52.663033 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-01706474-eaa7-46a2-9764-f8616fa672e5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.3209326 Dec 09 21:40:52.663327 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4fa0d768-3b58-4843-83e4-bc56e0b83ace admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/d1171fd5-fe64-41d5-9400-7af81d498cd9 HTTP/1.1" status: 204 len: 168 time: 0.6304746 Dec 09 21:40:52.666063 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60834) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:52.672578 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-aa599acd-81b8-4fe6-8113-582aa0807dc7 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'subnet': {'network_id': 'ed0707dd-685f-47b2-a0b6-f9fccdf89e1f', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:52.683236 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-069c1d6a-a20b-43a8-9816-b83f7c9c4db3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:52.702552 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fa0d768-3b58-4843-83e4-bc56e0b83ace admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d1171fd5-fe64-41d5-9400-7af81d498cd9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:52.733743 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01706474-eaa7-46a2-9764-f8616fa672e5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Network': ['ID=ed0707dd-685f-47b2-a0b6-f9fccdf89e1f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:52.737050 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-41637fa9-9c68-498d-bd17-a03ac0a6946a req-bca02e7b-6e91-491c-ba7f-94756991ed9d tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1420555 Dec 09 21:40:52.764877 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network ed0707dd-685f-47b2-a0b6-f9fccdf89e1f details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:40:52.851747 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aa599acd-81b8-4fe6-8113-582aa0807dc7 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Made reservation on behalf of 8d03fcad771c485fa5e2c1775828f3a7 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:52.855223 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa599acd-81b8-4fe6-8113-582aa0807dc7 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:52.929077 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.ipam_backend_mixin [None req-aa599acd-81b8-4fe6-8113-582aa0807dc7 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Performing IP validity checks on allocation pools {{(pid=103437) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Dec 09 21:40:52.930043 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.ipam_backend_mixin [None req-aa599acd-81b8-4fe6-8113-582aa0807dc7 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Checking for overlaps among allocation pools and gateway ip {{(pid=103437) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Dec 09 21:40:53.050295 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-069c1d6a-a20b-43a8-9816-b83f7c9c4db3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 606dbd6b-3506-4b46-a9d0-f89c7843bf4c {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:40:53.065248 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-069c1d6a-a20b-43a8-9816-b83f7c9c4db3 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:53.084532 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-069c1d6a-a20b-43a8-9816-b83f7c9c4db3 service neutron] Transition to ACTIVE for port object 606dbd6b-3506-4b46-a9d0-f89c7843bf4c will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:40:53.091745 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-069c1d6a-a20b-43a8-9816-b83f7c9c4db3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:53.111651 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa599acd-81b8-4fe6-8113-582aa0807dc7 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:53.170610 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d79a4351-160e-454b-b667-3f757d4b986e None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:40:53.208394 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa599acd-81b8-4fe6-8113-582aa0807dc7 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Subnet': ['ID=906bd6a0-1e59-4689-90d6-2d09dbdb9070,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:53.216593 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b5eb3f7b-6174-41ea-bb7b-3f264c1a01ae None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:40:53.236235 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-069c1d6a-a20b-43a8-9816-b83f7c9c4db3 service neutron] Pushing event updated for resources: {'Port': ['ID=606dbd6b-3506-4b46-a9d0-f89c7843bf4c,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:53.240228 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa599acd-81b8-4fe6-8113-582aa0807dc7 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Checking segment: {'id': '0c209c92-cb37-4226-b089-ea6e8b8f2791', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'ed0707dd-685f-47b2-a0b6-f9fccdf89e1f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:40:53.240607 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa599acd-81b8-4fe6-8113-582aa0807dc7 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Network hostable DHCP agents. Network: ed0707dd-685f-47b2-a0b6-f9fccdf89e1f, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:40:53.272037 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa599acd-81b8-4fe6-8113-582aa0807dc7 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Network ed0707dd-685f-47b2-a0b6-f9fccdf89e1f is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:40:53.287394 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-aa599acd-81b8-4fe6-8113-582aa0807dc7 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, ed0707dd-685f-47b2-a0b6-f9fccdf89e1f) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:53.293246 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa599acd-81b8-4fe6-8113-582aa0807dc7 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:53.293939 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa599acd-81b8-4fe6-8113-582aa0807dc7 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:53.299175 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d1c4abf-2aa6-47e9-ac45-520e89f8befb None None] Network ed0707dd-685f-47b2-a0b6-f9fccdf89e1f requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:53.317070 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-aa599acd-81b8-4fe6-8113-582aa0807dc7 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 800 time: 0.6496327 Dec 09 21:40:53.319763 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60840) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:53.373625 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-069c1d6a-a20b-43a8-9816-b83f7c9c4db3 service neutron] Attempting to bind port 606dbd6b-3506-4b46-a9d0-f89c7843bf4c on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:53.374378 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-069c1d6a-a20b-43a8-9816-b83f7c9c4db3 service neutron] Attempting to bind port 606dbd6b-3506-4b46-a9d0-f89c7843bf4c by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:53.374526 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-069c1d6a-a20b-43a8-9816-b83f7c9c4db3 service neutron] Attempting to bind port 606dbd6b-3506-4b46-a9d0-f89c7843bf4c on network ba3aee78-4661-4c71-9b18-af1e6a07faff {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:53.383213 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-069c1d6a-a20b-43a8-9816-b83f7c9c4db3 service neutron] Port 606dbd6b-3506-4b46-a9d0-f89c7843bf4c on network ba3aee78-4661-4c71-9b18-af1e6a07faff not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:40:53.383588 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-069c1d6a-a20b-43a8-9816-b83f7c9c4db3 service neutron] Attempting to bind port 606dbd6b-3506-4b46-a9d0-f89c7843bf4c on network ba3aee78-4661-4c71-9b18-af1e6a07faff {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:53.403589 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60844) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:53.405368 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ffa1a11-15d5-4ed2-be30-a661f9a6a908 req-644b2005-6902-4cbd-97e1-7b9188205baa tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:53.407573 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ffa1a11-15d5-4ed2-be30-a661f9a6a908 req-644b2005-6902-4cbd-97e1-7b9188205baa tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.0937696 Dec 09 21:40:53.408520 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-069c1d6a-a20b-43a8-9816-b83f7c9c4db3 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 40, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:40:53.408868 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-069c1d6a-a20b-43a8-9816-b83f7c9c4db3 service neutron] Checking segment: {'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:40:53.409323 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-069c1d6a-a20b-43a8-9816-b83f7c9c4db3 service neutron] Bound using segment: {'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:40:53.409783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-069c1d6a-a20b-43a8-9816-b83f7c9c4db3 service neutron] Bound port: 606dbd6b-3506-4b46-a9d0-f89c7843bf4c, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:40:53.410353 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-069c1d6a-a20b-43a8-9816-b83f7c9c4db3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:53.430770 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b4f0a605-50ee-41b7-88a7-81040df3241e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:53.441167 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-98e937ba-ecd1-4f81-b9d7-e478836da1e1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-ed0707dd-685f-47b2-a0b6-f9fccdf89e1f', 'network_id': 'ed0707dd-685f-47b2-a0b6-f9fccdf89e1f', 'project_id': '8d03fcad771c485fa5e2c1775828f3a7', 'fixed_ips': [{'subnet_id': '906bd6a0-1e59-4689-90d6-2d09dbdb9070'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:40:53.442215 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-98e937ba-ecd1-4f81-b9d7-e478836da1e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:53.478126 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:53.578436 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:53.601914 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ffa1a11-15d5-4ed2-be30-a661f9a6a908 req-c4bd8af1-2df1-42c3-8ee3-511d3363b0d3 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1754713 Dec 09 21:40:53.603141 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-069c1d6a-a20b-43a8-9816-b83f7c9c4db3 service neutron] For port 606dbd6b-3506-4b46-a9d0-f89c7843bf4c, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:40:53.608198 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b4f0a605-50ee-41b7-88a7-81040df3241e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:53.612422 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-98e937ba-ecd1-4f81-b9d7-e478836da1e1 None None] Allocated IP 172.20.0.3 (ed0707dd-685f-47b2-a0b6-f9fccdf89e1f/906bd6a0-1e59-4689-90d6-2d09dbdb9070/9dc1f853-af01-4caa-a86d-507ef471fb8d) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:40:53.619244 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b4f0a605-50ee-41b7-88a7-81040df3241e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:53.625110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-069c1d6a-a20b-43a8-9816-b83f7c9c4db3 service neutron] For port 606dbd6b-3506-4b46-a9d0-f89c7843bf4c, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=606dbd6b-3506-4b46-a9d0-f89c7843bf4c,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:40:53.641992 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-069c1d6a-a20b-43a8-9816-b83f7c9c4db3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:53.697868 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b4f0a605-50ee-41b7-88a7-81040df3241e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=78d77dcde07a41caa69b18d6dcab626e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2925873 Dec 09 21:40:53.698453 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4f0a605-50ee-41b7-88a7-81040df3241e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5cfa85e6-7662-44dd-a1d9-869c5d24a0ce,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:53.700839 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60848) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:53.766682 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-069c1d6a-a20b-43a8-9816-b83f7c9c4db3 service neutron] Pushing event updated for resources: {'Port': ['ID=606dbd6b-3506-4b46-a9d0-f89c7843bf4c,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:53.774169 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7f91a5ad-a520-4ad8-a461-60b23f3f18cf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:53.802116 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7f91a5ad-a520-4ad8-a461-60b23f3f18cf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:53.810369 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-069c1d6a-a20b-43a8-9816-b83f7c9c4db3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:53.812504 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-069c1d6a-a20b-43a8-9816-b83f7c9c4db3 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:53.815606 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad0a2359-7c2e-48e6-b9fd-9f7fc832e221 None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:40:53.816172 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-069c1d6a-a20b-43a8-9816-b83f7c9c4db3 service neutron] 10.222.0.31 "PUT /v2.0/ports/606dbd6b-3506-4b46-a9d0-f89c7843bf4c HTTP/1.1" status: 200 len: 1093 time: 1.2727783 Dec 09 21:40:53.816891 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4f31caf3-99fc-49ed-905b-5274e085b84c', 'tag': '606dbd6b-3506-4b46-a9d0-f89c7843bf4c'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:40:53.853598 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-def628e5-581f-4130-b2de-d45aeaec4be2" -d '{"events": [{"name": "network-changed", "server_uuid": "4f31caf3-99fc-49ed-905b-5274e085b84c", "tag": "606dbd6b-3506-4b46-a9d0-f89c7843bf4c"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:40:53.873717 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7f91a5ad-a520-4ad8-a461-60b23f3f18cf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:53.876910 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7f91a5ad-a520-4ad8-a461-60b23f3f18cf admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:53.878093 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7f91a5ad-a520-4ad8-a461-60b23f3f18cf admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/5cfa85e6-7662-44dd-a1d9-869c5d24a0ce HTTP/1.1" status: 204 len: 168 time: 0.1762617 Dec 09 21:40:53.893018 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-98e937ba-ecd1-4f81-b9d7-e478836da1e1 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:53.900407 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f91a5ad-a520-4ad8-a461-60b23f3f18cf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5cfa85e6-7662-44dd-a1d9-869c5d24a0ce,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:53.914312 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-98e937ba-ecd1-4f81-b9d7-e478836da1e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:53.922322 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aaf828cc-c909-4056-94dc-fa8e4ed071cc req-0ee6591b-5cf4-444f-9ba8-bcc3286844ae tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.1473761 Dec 09 21:40:53.932843 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:53.977436 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-98e937ba-ecd1-4f81-b9d7-e478836da1e1 None None] Network ed0707dd-685f-47b2-a0b6-f9fccdf89e1f is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:40:53.981325 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-98e937ba-ecd1-4f81-b9d7-e478836da1e1 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:53.984950 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98e937ba-ecd1-4f81-b9d7-e478836da1e1 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:40:54.006239 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-7f456a6c-53f7-429b-b4e0-d19cf0b5f1a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:54.007867 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-7f456a6c-53f7-429b-b4e0-d19cf0b5f1a1 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0569bc74c98b4ae2980de7af929e97eb&device_id=4f31caf3-99fc-49ed-905b-5274e085b84c HTTP/1.1" status: 200 len: 1096 time: 0.0824516 Dec 09 21:40:54.009834 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Subnet': ['ID=906bd6a0-1e59-4689-90d6-2d09dbdb9070,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:54.026763 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98e937ba-ecd1-4f81-b9d7-e478836da1e1 None None] Pushing event updated for resources: {'Port': ['ID=9dc1f853-af01-4caa-a86d-507ef471fb8d,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:54.058394 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-98e937ba-ecd1-4f81-b9d7-e478836da1e1 None None] Attempting to bind port 9dc1f853-af01-4caa-a86d-507ef471fb8d on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:54.058929 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-98e937ba-ecd1-4f81-b9d7-e478836da1e1 None None] Attempting to bind port 9dc1f853-af01-4caa-a86d-507ef471fb8d by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '0c209c92-cb37-4226-b089-ea6e8b8f2791', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'ed0707dd-685f-47b2-a0b6-f9fccdf89e1f'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:54.059304 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-98e937ba-ecd1-4f81-b9d7-e478836da1e1 None None] Attempting to bind port 9dc1f853-af01-4caa-a86d-507ef471fb8d on network ed0707dd-685f-47b2-a0b6-f9fccdf89e1f {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:54.065624 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-98e937ba-ecd1-4f81-b9d7-e478836da1e1 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 40, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:40:54.066003 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-98e937ba-ecd1-4f81-b9d7-e478836da1e1 None None] Checking segment: {'id': '0c209c92-cb37-4226-b089-ea6e8b8f2791', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'ed0707dd-685f-47b2-a0b6-f9fccdf89e1f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:40:54.066534 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-98e937ba-ecd1-4f81-b9d7-e478836da1e1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:54.066935 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-98e937ba-ecd1-4f81-b9d7-e478836da1e1 None None] Bound using segment: {'id': '0c209c92-cb37-4226-b089-ea6e8b8f2791', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'ed0707dd-685f-47b2-a0b6-f9fccdf89e1f'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:40:54.067408 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-98e937ba-ecd1-4f81-b9d7-e478836da1e1 None None] Bound port: 9dc1f853-af01-4caa-a86d-507ef471fb8d, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0c209c92-cb37-4226-b089-ea6e8b8f2791', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'ed0707dd-685f-47b2-a0b6-f9fccdf89e1f'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:40:54.067832 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-98e937ba-ecd1-4f81-b9d7-e478836da1e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:54.135551 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:54.142650 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-98e937ba-ecd1-4f81-b9d7-e478836da1e1 None None] For port 9dc1f853-af01-4caa-a86d-507ef471fb8d, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:40:54.147470 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-98e937ba-ecd1-4f81-b9d7-e478836da1e1 None None] For port 9dc1f853-af01-4caa-a86d-507ef471fb8d, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9dc1f853-af01-4caa-a86d-507ef471fb8d,segment=NetworkSegment(0c209c92-cb37-4226-b089-ea6e8b8f2791),segment_id=0c209c92-cb37-4226-b089-ea6e8b8f2791)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:40:54.153192 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-557db9ac-c949-47a0-a886-ad61c57798ed service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=606dbd6b-3506-4b46-a9d0-f89c7843bf4c HTTP/1.1" status: 200 len: 217 time: 0.1252270 Dec 09 21:40:54.157116 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-98e937ba-ecd1-4f81-b9d7-e478836da1e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:54.184672 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ed0707dd-685f-47b2-a0b6-f9fccdf89e1f']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:54.215179 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0c209c92-cb37-4226-b089-ea6e8b8f2791') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:54.215851 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0c209c92-cb37-4226-b089-ea6e8b8f2791') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:54.232897 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:54.253174 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:54.264249 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Releasing vlan 112 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:40:54.265271 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:54.269797 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98e937ba-ecd1-4f81-b9d7-e478836da1e1 None None] Pushing event updated for resources: {'Port': ['ID=9dc1f853-af01-4caa-a86d-507ef471fb8d,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:40:54.271151 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:40:54.284913 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e77831dc-ec4f-4dc0-8c0e-4abddf2f331a None None] Network ed0707dd-685f-47b2-a0b6-f9fccdf89e1f requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:54.301414 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba0cc08f-b5e4-4a3e-bd39-dac77ae306d4 req-f89bd769-f63c-48a6-9abb-578da8524375 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:54.303733 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba0cc08f-b5e4-4a3e-bd39-dac77ae306d4 req-f89bd769-f63c-48a6-9abb-578da8524375 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4f31caf3-99fc-49ed-905b-5274e085b84c HTTP/1.1" status: 200 len: 944 time: 0.1976750 Dec 09 21:40:54.347042 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-56609b9d-d743-470d-a305-5fd55524fb6a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:54.356749 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-56609b9d-d743-470d-a305-5fd55524fb6a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=b61ac70f-1e8d-40a8-9031-bab15f73fa0a HTTP/1.1" status: 200 len: 845 time: 0.1871393 Dec 09 21:40:54.380947 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.db.api [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 09 21:40:54.380947 n-d-713301-27 neutron-server[103437]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 09 21:40:54.380947 n-d-713301-27 neutron-server[103437]: [parameters: {'id': 'ed0707dd-685f-47b2-a0b6-f9fccdf89e1f'}] Dec 09 21:40:54.380947 n-d-713301-27 neutron-server[103437]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103437) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:40:54.382017 n-d-713301-27 neutron-server[103437]: DEBUG oslo_db.api [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:40:54.404812 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5c5d93cf-4c12-44ca-973d-4cf46bf7d8c3 None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 21:40:54.405972 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-87269cf5-7fa7-4ef1-8274-c17c24b44075 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ba3aee78-4661-4c71-9b18-af1e6a07faff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0356548 Dec 09 21:40:54.430208 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba0cc08f-b5e4-4a3e-bd39-dac77ae306d4 req-52da1a27-7d44-4096-9204-9ace0a42d061 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1172578 Dec 09 21:40:54.498698 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5c5d93cf-4c12-44ca-973d-4cf46bf7d8c3 None None] Resources bound (agent type, host, resource id): {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 09 21:40:54.530528 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:40:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-299156cf-0c6f-481f-8716-140f4ada0637 x-openstack-request-id: req-299156cf-0c6f-481f-8716-140f4ada0637 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:40:54.530822 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4f31caf3-99fc-49ed-905b-5274e085b84c", "tag": "606dbd6b-3506-4b46-a9d0-f89c7843bf4c", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:40:54.531077 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-299156cf-0c6f-481f-8716-140f4ada0637 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:40:54.531502 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4f31caf3-99fc-49ed-905b-5274e085b84c', 'tag': '606dbd6b-3506-4b46-a9d0-f89c7843bf4c', 'status': 'completed', 'code': 200} Dec 09 21:40:54.537257 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-2a005787-b7d7-4bdd-bd4a-f8987619c301 service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1193981 Dec 09 21:40:54.665430 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8050583-c6d2-4d16-ab31-53d2e8165588 req-2b5b1c6f-adb2-4fe5-85a1-b75ceb2dcf1c service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1210029 Dec 09 21:40:54.829520 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeb6d0e9-c8d9-4521-8a94-53b9e6735754 req-95ca98bf-5b7d-4c4e-9206-1a7fcf4d07c2 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:54.831118 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aeb6d0e9-c8d9-4521-8a94-53b9e6735754 req-95ca98bf-5b7d-4c4e-9206-1a7fcf4d07c2 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.1255431 Dec 09 21:40:54.836208 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-def628e5-581f-4130-b2de-d45aeaec4be2 req-065e126b-0a08-46bb-97e2-15cd590bfc86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:54.837696 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-def628e5-581f-4130-b2de-d45aeaec4be2 req-065e126b-0a08-46bb-97e2-15cd590bfc86 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0569bc74c98b4ae2980de7af929e97eb&device_id=4f31caf3-99fc-49ed-905b-5274e085b84c HTTP/1.1" status: 200 len: 1096 time: 0.0871828 Dec 09 21:40:54.883066 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:54.932156 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aeb6d0e9-c8d9-4521-8a94-53b9e6735754 req-aaed9db9-9b5a-4dea-aa00-3b48da2d5886 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0882223 Dec 09 21:40:54.983365 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Deleting port 9dc1f853-af01-4caa-a86d-507ef471fb8d {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:40:54.983801 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:55.030935 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-def628e5-581f-4130-b2de-d45aeaec4be2 req-ea57dec1-18a8-4b9c-84d9-58a47671a75b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:55.032879 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-def628e5-581f-4130-b2de-d45aeaec4be2 req-ea57dec1-18a8-4b9c-84d9-58a47671a75b service neutron] 10.222.0.31 "GET /v2.0/networks?id=ba3aee78-4661-4c71-9b18-af1e6a07faff HTTP/1.1" status: 200 len: 906 time: 0.1873405 Dec 09 21:40:55.079172 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] For port 9dc1f853-af01-4caa-a86d-507ef471fb8d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9dc1f853-af01-4caa-a86d-507ef471fb8d,segment=NetworkSegment(0c209c92-cb37-4226-b089-ea6e8b8f2791),segment_id=0c209c92-cb37-4226-b089-ea6e8b8f2791)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:55.079597 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:55.104117 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Calling delete_port for 9dc1f853-af01-4caa-a86d-507ef471fb8d owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:40:55.113367 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-def628e5-581f-4130-b2de-d45aeaec4be2 req-cde938d0-b734-4763-a8fc-92e3da859d07 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=606dbd6b-3506-4b46-a9d0-f89c7843bf4c HTTP/1.1" status: 200 len: 217 time: 0.0715179 Dec 09 21:40:55.133685 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f945fab5-cfb3-4e99-ad8b-abcd6270653b req-e7f5195b-d90a-49e5-9138-5758333ec5e3 tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0321372 Dec 09 21:40:55.179431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-def628e5-581f-4130-b2de-d45aeaec4be2 req-94b24cee-f688-46fd-8e87-8a87119d87f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:55.180958 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-def628e5-581f-4130-b2de-d45aeaec4be2 req-94b24cee-f688-46fd-8e87-8a87119d87f7 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=b61ac70f-1e8d-40a8-9031-bab15f73fa0a HTTP/1.1" status: 200 len: 845 time: 0.0500841 Dec 09 21:40:55.225790 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-def628e5-581f-4130-b2de-d45aeaec4be2 req-dd977622-7ffd-4d64-9839-9e897abe4086 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ba3aee78-4661-4c71-9b18-af1e6a07faff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0353563 Dec 09 21:40:55.251068 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:55.284404 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Port': ['ID=9dc1f853-af01-4caa-a86d-507ef471fb8d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:55.302308 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No DVR routers for this DVR port 9dc1f853-af01-4caa-a86d-507ef471fb8d on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:40:55.409225 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-def628e5-581f-4130-b2de-d45aeaec4be2 req-56f21a61-dd12-45d3-b89e-5dddcf88b9e0 service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1739724 Dec 09 21:40:55.420202 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:55.463968 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ed0707dd-685f-47b2-a0b6-f9fccdf89e1f']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:55.486512 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0c209c92-cb37-4226-b089-ea6e8b8f2791') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:55.487465 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0c209c92-cb37-4226-b089-ea6e8b8f2791') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:55.503238 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:55.526585 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:55.534586 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Releasing vlan 112 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:40:55.534991 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:40:55.543745 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:40:55.550485 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-def628e5-581f-4130-b2de-d45aeaec4be2 req-75682cd6-df17-464d-a77e-3be058b28f69 service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1340311 Dec 09 21:40:55.619385 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d50fc67c-5767-432a-b4fb-534daf831bda req-0cb4d6c5-c01a-4357-bc08-449b0c9c406c tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb&device_id=fb4b94af-3092-4329-b88b-a06c713c5b7c HTTP/1.1" status: 200 len: 210 time: 0.0356820 Dec 09 21:40:55.636335 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:55.654721 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:55.658165 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/networks/ed0707dd-685f-47b2-a0b6-f9fccdf89e1f HTTP/1.1" status: 204 len: 168 time: 2.3371477 Dec 09 21:40:55.659489 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-860090fb-87ae-4d66-9ac9-8696cf6ca4c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Network': ['ID=ed0707dd-685f-47b2-a0b6-f9fccdf89e1f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:55.661645 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60898) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:55.666556 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-7ca55959-9c0c-414c-a5b5-dda1e43ed5d6 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-368638876'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:55.691837 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7ca55959-9c0c-414c-a5b5-dda1e43ed5d6 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Made reservation on behalf of 8d03fcad771c485fa5e2c1775828f3a7 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:55.696146 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ca55959-9c0c-414c-a5b5-dda1e43ed5d6 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:55.727109 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7ca55959-9c0c-414c-a5b5-dda1e43ed5d6 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] vlan segment allocate from pool success with {'vlan_id': 109, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:40:55.740852 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ca55959-9c0c-414c-a5b5-dda1e43ed5d6 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:55.741318 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-7ca55959-9c0c-414c-a5b5-dda1e43ed5d6 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Added segment c72dfbf9-4f6b-41cc-b753-136aa4177af4 of type vlan for network 667ea4bb-728a-4975-98aa-c60333b2231d Dec 09 21:40:55.799087 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ca55959-9c0c-414c-a5b5-dda1e43ed5d6 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:55.833454 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a61da3b3-6e5d-45c7-b34f-4f49c44f6d54 req-7639fb39-e513-4d74-a140-f47f06a03d46 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:55.835116 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a61da3b3-6e5d-45c7-b34f-4f49c44f6d54 req-7639fb39-e513-4d74-a140-f47f06a03d46 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4f31caf3-99fc-49ed-905b-5274e085b84c HTTP/1.1" status: 200 len: 944 time: 0.1054077 Dec 09 21:40:55.837149 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ca55959-9c0c-414c-a5b5-dda1e43ed5d6 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:55.842855 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ca55959-9c0c-414c-a5b5-dda1e43ed5d6 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:55.843832 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ca55959-9c0c-414c-a5b5-dda1e43ed5d6 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:55.883519 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7ca55959-9c0c-414c-a5b5-dda1e43ed5d6 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.2208016 Dec 09 21:40:55.887168 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60904) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:55.912582 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a61da3b3-6e5d-45c7-b34f-4f49c44f6d54 req-7463d694-3fb2-4046-9bb6-7680bc551c18 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0696526 Dec 09 21:40:55.919045 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-f334f3db-492d-49e2-b6ff-880d7d268809 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'subnet': {'network_id': '667ea4bb-728a-4975-98aa-c60333b2231d', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None, 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:55.937018 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ca55959-9c0c-414c-a5b5-dda1e43ed5d6 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Network': ['ID=667ea4bb-728a-4975-98aa-c60333b2231d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:55.948456 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 667ea4bb-728a-4975-98aa-c60333b2231d details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:40:56.056712 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f334f3db-492d-49e2-b6ff-880d7d268809 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Made reservation on behalf of 8d03fcad771c485fa5e2c1775828f3a7 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:56.064672 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f334f3db-492d-49e2-b6ff-880d7d268809 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:56.251759 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-78a6184e-f5b1-447d-b5cc-8b8a29d3e416 req-16dc03f6-dd4c-4b7a-82d8-928af8d2c1d4 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=46cc52272a6f4269af0142f9b3345dac&device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0380292 Dec 09 21:40:56.297672 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d24845c0-ffe3-4260-b9e6-e35e241162a2 req-e319162b-cad4-448e-9a17-2595edb31aa0 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:56.308909 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d24845c0-ffe3-4260-b9e6-e35e241162a2 req-e319162b-cad4-448e-9a17-2595edb31aa0 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.0871403 Dec 09 21:40:56.350173 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-78a6184e-f5b1-447d-b5cc-8b8a29d3e416 req-4aa2314e-9bfb-4cbc-bb21-a7a45b484725 service neutron] 10.222.0.10 "GET /v2.0/networks?tenant_id=46cc52272a6f4269af0142f9b3345dac&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0887203 Dec 09 21:40:56.353949 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f334f3db-492d-49e2-b6ff-880d7d268809 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:56.363221 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d24845c0-ffe3-4260-b9e6-e35e241162a2 req-b46baffa-6a62-44f6-8cd3-4f4837fb32e9 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0532506 Dec 09 21:40:56.447650 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7726d99e-c7d4-4fa4-be1f-cfc147d3a83b req-a6ae6015-23d5-4dae-bf0c-4ae876d9cc3c tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0290742 Dec 09 21:40:56.508119 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f334f3db-492d-49e2-b6ff-880d7d268809 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Subnet': ['ID=3049fffa-9600-49dc-ad94-798088a7d98e,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:56.531809 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f334f3db-492d-49e2-b6ff-880d7d268809 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Checking segment: {'id': 'c72dfbf9-4f6b-41cc-b753-136aa4177af4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '667ea4bb-728a-4975-98aa-c60333b2231d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:40:56.532593 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f334f3db-492d-49e2-b6ff-880d7d268809 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Network hostable DHCP agents. Network: 667ea4bb-728a-4975-98aa-c60333b2231d, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:40:56.541060 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78a6184e-f5b1-447d-b5cc-8b8a29d3e416 req-d35fdd70-ca3f-4d54-b7ac-acb17c340365 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:56.542573 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-78a6184e-f5b1-447d-b5cc-8b8a29d3e416 req-d35fdd70-ca3f-4d54-b7ac-acb17c340365 service neutron] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1850078 Dec 09 21:40:56.562003 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f334f3db-492d-49e2-b6ff-880d7d268809 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Network 667ea4bb-728a-4975-98aa-c60333b2231d is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:40:56.580691 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-f334f3db-492d-49e2-b6ff-880d7d268809 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 667ea4bb-728a-4975-98aa-c60333b2231d) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:56.585437 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f334f3db-492d-49e2-b6ff-880d7d268809 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:56.586062 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f334f3db-492d-49e2-b6ff-880d7d268809 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:56.594171 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-077578c3-c7c2-4aa0-99f0-d481f4a25856 None None] Network 667ea4bb-728a-4975-98aa-c60333b2231d requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:56.605100 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f334f3db-492d-49e2-b6ff-880d7d268809 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 865 time: 0.7175019 Dec 09 21:40:56.608629 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60932) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:56.730167 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:56.751760 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-333ebb8c-f728-4c4c-b341-219faa13c38c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-667ea4bb-728a-4975-98aa-c60333b2231d', 'network_id': '667ea4bb-728a-4975-98aa-c60333b2231d', 'project_id': '8d03fcad771c485fa5e2c1775828f3a7', 'fixed_ips': [{'subnet_id': '3049fffa-9600-49dc-ad94-798088a7d98e'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:40:56.753148 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-333ebb8c-f728-4c4c-b341-219faa13c38c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:56.818318 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:56.902795 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-333ebb8c-f728-4c4c-b341-219faa13c38c None None] Allocated IP 172.20.0.1 (667ea4bb-728a-4975-98aa-c60333b2231d/3049fffa-9600-49dc-ad94-798088a7d98e/aa7129b1-caf4-4582-971d-95fc0c01f589) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:40:57.036541 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c94aaa01-d427-4ff9-a3ed-980e17c1337c req-ba13a603-7cd2-4ef9-a9a9-bae2cdf09346 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:57.038345 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c94aaa01-d427-4ff9-a3ed-980e17c1337c req-ba13a603-7cd2-4ef9-a9a9-bae2cdf09346 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4f31caf3-99fc-49ed-905b-5274e085b84c HTTP/1.1" status: 200 len: 944 time: 0.0652008 Dec 09 21:40:57.053358 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 606dbd6b-3506-4b46-a9d0-f89c7843bf4c details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:40:57.074055 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-333ebb8c-f728-4c4c-b341-219faa13c38c None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:57.088284 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-333ebb8c-f728-4c4c-b341-219faa13c38c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:57.090408 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60948) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:57.096374 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c94aaa01-d427-4ff9-a3ed-980e17c1337c req-90ee98b6-1c8f-4c8d-86d6-5569cca81cf2 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517163 Dec 09 21:40:57.111776 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:57.167927 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Subnet': ['ID=3049fffa-9600-49dc-ad94-798088a7d98e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:57.191221 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-333ebb8c-f728-4c4c-b341-219faa13c38c None None] Network 667ea4bb-728a-4975-98aa-c60333b2231d is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:40:57.198750 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-333ebb8c-f728-4c4c-b341-219faa13c38c None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:57.210198 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:57.210507 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-333ebb8c-f728-4c4c-b341-219faa13c38c None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:40:57.215827 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-333ebb8c-f728-4c4c-b341-219faa13c38c None None] Pushing event updated for resources: {'Port': ['ID=aa7129b1-caf4-4582-971d-95fc0c01f589,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:57.221397 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-468d013f-99e0-49a8-aad0-3b7f48775666 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:57.234538 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['667ea4bb-728a-4975-98aa-c60333b2231d']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:57.246889 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c72dfbf9-4f6b-41cc-b753-136aa4177af4') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:57.247215 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c72dfbf9-4f6b-41cc-b753-136aa4177af4') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:57.259271 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:57.276892 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:57.279109 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:57.286265 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Releasing vlan 109 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:40:57.286808 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:40:57.291907 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:40:57.310217 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-468d013f-99e0-49a8-aad0-3b7f48775666 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:57.314269 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-468d013f-99e0-49a8-aad0-3b7f48775666 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:57.319732 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 606dbd6b-3506-4b46-a9d0-f89c7843bf4c, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=606dbd6b-3506-4b46-a9d0-f89c7843bf4c,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:57.333113 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:57.335191 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-333ebb8c-f728-4c4c-b341-219faa13c38c None None] Attempting to bind port aa7129b1-caf4-4582-971d-95fc0c01f589 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:40:57.335590 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-333ebb8c-f728-4c4c-b341-219faa13c38c None None] Attempting to bind port aa7129b1-caf4-4582-971d-95fc0c01f589 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'c72dfbf9-4f6b-41cc-b753-136aa4177af4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '667ea4bb-728a-4975-98aa-c60333b2231d'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:40:57.335957 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-333ebb8c-f728-4c4c-b341-219faa13c38c None None] Attempting to bind port aa7129b1-caf4-4582-971d-95fc0c01f589 on network 667ea4bb-728a-4975-98aa-c60333b2231d {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:40:57.339087 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '606dbd6b-3506-4b46-a9d0-f89c7843bf4c', 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff', 'port_id': '606dbd6b-3506-4b46-a9d0-f89c7843bf4c', 'mac_address': 'fa:16:3e:fc:10:0d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b61ac70f-1e8d-40a8-9031-bab15f73fa0a', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:40:57.344187 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-333ebb8c-f728-4c4c-b341-219faa13c38c None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 40, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:40:57.344565 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-333ebb8c-f728-4c4c-b341-219faa13c38c None None] Checking segment: {'id': 'c72dfbf9-4f6b-41cc-b753-136aa4177af4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '667ea4bb-728a-4975-98aa-c60333b2231d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:40:57.345526 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-333ebb8c-f728-4c4c-b341-219faa13c38c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:57.345526 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-333ebb8c-f728-4c4c-b341-219faa13c38c None None] Bound using segment: {'id': 'c72dfbf9-4f6b-41cc-b753-136aa4177af4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '667ea4bb-728a-4975-98aa-c60333b2231d'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:40:57.345829 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-333ebb8c-f728-4c4c-b341-219faa13c38c None None] Bound port: aa7129b1-caf4-4582-971d-95fc0c01f589, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c72dfbf9-4f6b-41cc-b753-136aa4177af4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': '667ea4bb-728a-4975-98aa-c60333b2231d'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:40:57.346210 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-333ebb8c-f728-4c4c-b341-219faa13c38c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:57.355540 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.db.api [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 09 21:40:57.355540 n-d-713301-27 neutron-server[103438]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 09 21:40:57.355540 n-d-713301-27 neutron-server[103438]: [parameters: {'id': '667ea4bb-728a-4975-98aa-c60333b2231d'}] Dec 09 21:40:57.355540 n-d-713301-27 neutron-server[103438]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103438) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:40:57.356389 n-d-713301-27 neutron-server[103438]: DEBUG oslo_db.api [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:40:57.358021 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-468d013f-99e0-49a8-aad0-3b7f48775666 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=137173f0453b44b9a25ce199cdcdbf14&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2663860 Dec 09 21:40:57.359103 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-468d013f-99e0-49a8-aad0-3b7f48775666 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f7d7114f-3bf5-4ee0-9589-3aaef904e6a1,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:57.360910 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60952) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:57.411561 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:57.418642 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b1573e13-d540-4f31-bf96-50bb79e72095 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:57.438421 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 606dbd6b-3506-4b46-a9d0-f89c7843bf4c {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:40:57.468063 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b1573e13-d540-4f31-bf96-50bb79e72095 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:57.517435 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-447fe108-fba6-48a8-93b6-10343928bb10 req-1c59a869-4692-4096-b7db-559ccbd3485b tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:57.519990 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-447fe108-fba6-48a8-93b6-10343928bb10 req-1c59a869-4692-4096-b7db-559ccbd3485b tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.0914388 Dec 09 21:40:57.555838 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b1573e13-d540-4f31-bf96-50bb79e72095 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:57.558531 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b1573e13-d540-4f31-bf96-50bb79e72095 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:57.560579 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b1573e13-d540-4f31-bf96-50bb79e72095 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/f7d7114f-3bf5-4ee0-9589-3aaef904e6a1 HTTP/1.1" status: 204 len: 168 time: 0.1969059 Dec 09 21:40:57.578127 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1573e13-d540-4f31-bf96-50bb79e72095 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f7d7114f-3bf5-4ee0-9589-3aaef904e6a1,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:57.593789 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-447fe108-fba6-48a8-93b6-10343928bb10 req-bb9973d0-e4e1-40bb-9535-7850d8f058f4 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0660796 Dec 09 21:40:57.664209 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 606dbd6b-3506-4b46-a9d0-f89c7843bf4c, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=606dbd6b-3506-4b46-a9d0-f89c7843bf4c,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:57.665573 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-333ebb8c-f728-4c4c-b341-219faa13c38c None None] For port aa7129b1-caf4-4582-971d-95fc0c01f589, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:40:57.676050 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:57.686811 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2f542aa4-5363-438c-9d70-db980177163c req-d218af73-4f14-4a41-97b1-2272d14585bb tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0293589 Dec 09 21:40:57.702042 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-333ebb8c-f728-4c4c-b341-219faa13c38c None None] For port aa7129b1-caf4-4582-971d-95fc0c01f589, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=aa7129b1-caf4-4582-971d-95fc0c01f589,segment=NetworkSegment(c72dfbf9-4f6b-41cc-b753-136aa4177af4),segment_id=c72dfbf9-4f6b-41cc-b753-136aa4177af4)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:40:57.718428 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-333ebb8c-f728-4c4c-b341-219faa13c38c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:57.735176 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=606dbd6b-3506-4b46-a9d0-f89c7843bf4c,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:57.761112 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-78a6184e-f5b1-447d-b5cc-8b8a29d3e416 req-1292a28c-d578-499f-b491-d97f6e044003 tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.10 "GET /v2.0/ports?device_id=571416e5-b1ba-4d5a-8a9e-03a3622ac8cb HTTP/1.1" status: 200 len: 210 time: 0.0357518 Dec 09 21:40:57.829671 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-333ebb8c-f728-4c4c-b341-219faa13c38c None None] Pushing event updated for resources: {'Port': ['ID=aa7129b1-caf4-4582-971d-95fc0c01f589,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:57.843968 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0883278c-9639-4810-81c6-2efc77aec416 None None] Network 667ea4bb-728a-4975-98aa-c60333b2231d requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:57.857693 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:57.933206 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['606dbd6b-3506-4b46-a9d0-f89c7843bf4c'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:40:57.954295 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60966) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:57.977144 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd71148d-dc08-4117-92d5-88b4cc2c77b6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:57.978906 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Deleting port aa7129b1-caf4-4582-971d-95fc0c01f589 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:40:57.979550 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:58.062006 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] For port aa7129b1-caf4-4582-971d-95fc0c01f589, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=aa7129b1-caf4-4582-971d-95fc0c01f589,segment=NetworkSegment(c72dfbf9-4f6b-41cc-b753-136aa4177af4),segment_id=c72dfbf9-4f6b-41cc-b753-136aa4177af4)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:58.062677 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:58.067474 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0701199c-62e9-432a-ab7a-fc4d56d8c65a req-437eccab-33b7-458c-9b1e-bb3a5e998bda service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:58.068039 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0c74d787-56ae-417a-bc31-e85dc34f7bdc None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 21:40:58.069029 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0701199c-62e9-432a-ab7a-fc4d56d8c65a req-437eccab-33b7-458c-9b1e-bb3a5e998bda service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 1097 time: 0.0619624 Dec 09 21:40:58.089691 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Calling delete_port for aa7129b1-caf4-4582-971d-95fc0c01f589 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:40:58.154625 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c74d787-56ae-417a-bc31-e85dc34f7bdc None None] Resources bound (agent type, host, resource id): {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 09 21:40:58.208300 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd71148d-dc08-4117-92d5-88b4cc2c77b6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:58.222571 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd71148d-dc08-4117-92d5-88b4cc2c77b6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:58.238667 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:58.271251 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fd71148d-dc08-4117-92d5-88b4cc2c77b6 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=63dcdf02f53a4461ab5c28d99f4dd0e4&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3157132 Dec 09 21:40:58.277774 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60986) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:58.304304 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Port': ['ID=aa7129b1-caf4-4582-971d-95fc0c01f589,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:58.313690 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0701199c-62e9-432a-ab7a-fc4d56d8c65a req-b648801e-13d5-46fd-88bc-07db8eef1d01 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1366804 Dec 09 21:40:58.322321 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No DVR routers for this DVR port aa7129b1-caf4-4582-971d-95fc0c01f589 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:40:58.352484 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd71148d-dc08-4117-92d5-88b4cc2c77b6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9ae45958-14b3-4a28-ab31-b73a058131c9,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:58.429852 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:58.449477 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ef401800-570e-4bd0-8425-2810ffef98e9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:58.452294 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['667ea4bb-728a-4975-98aa-c60333b2231d']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:58.462880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c72dfbf9-4f6b-41cc-b753-136aa4177af4') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:58.463093 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c72dfbf9-4f6b-41cc-b753-136aa4177af4') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:40:58.473617 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:58.476992 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ef401800-570e-4bd0-8425-2810ffef98e9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:58.490349 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:58.511823 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-329e5904-f61d-4ed9-b3f7-4f839492aa85 req-b99e9aa8-faa4-4725-86b9-3c2b79b1409d tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:58.513682 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-329e5904-f61d-4ed9-b3f7-4f839492aa85 req-b99e9aa8-faa4-4725-86b9-3c2b79b1409d tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4f31caf3-99fc-49ed-905b-5274e085b84c HTTP/1.1" status: 200 len: 945 time: 0.2069035 Dec 09 21:40:58.515038 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Releasing vlan 109 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:40:58.515791 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:40:58.519599 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:40:58.555074 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ef401800-570e-4bd0-8425-2810ffef98e9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:58.560290 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ef401800-570e-4bd0-8425-2810ffef98e9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:58.561557 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ef401800-570e-4bd0-8425-2810ffef98e9 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/9ae45958-14b3-4a28-ab31-b73a058131c9 HTTP/1.1" status: 204 len: 168 time: 0.2826931 Dec 09 21:40:58.588800 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef401800-570e-4bd0-8425-2810ffef98e9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9ae45958-14b3-4a28-ab31-b73a058131c9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:58.616409 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:58.630658 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:58.635221 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/networks/667ea4bb-728a-4975-98aa-c60333b2231d HTTP/1.1" status: 204 len: 168 time: 2.0251887 Dec 09 21:40:58.638842 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32796) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:58.645721 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-365e486d-4a7e-4211-9cf9-8ea0be0fd1ea tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-1006290643'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:58.666767 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46248e30-4419-4a5e-a277-a06681082ed3 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Network': ['ID=667ea4bb-728a-4975-98aa-c60333b2231d,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:58.675375 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-329e5904-f61d-4ed9-b3f7-4f839492aa85 req-d1300172-ff3c-4975-abea-2a389a179005 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1403790 Dec 09 21:40:58.676058 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-365e486d-4a7e-4211-9cf9-8ea0be0fd1ea tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Made reservation on behalf of 8d03fcad771c485fa5e2c1775828f3a7 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:58.682157 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-365e486d-4a7e-4211-9cf9-8ea0be0fd1ea tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:58.728101 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-365e486d-4a7e-4211-9cf9-8ea0be0fd1ea tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] vlan segment allocate from pool success with {'vlan_id': 107, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:40:58.744704 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-365e486d-4a7e-4211-9cf9-8ea0be0fd1ea tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:58.745187 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-365e486d-4a7e-4211-9cf9-8ea0be0fd1ea tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Added segment 58e1124c-2b84-46a4-8a54-05ae4cb8e61c of type vlan for network a865adfb-a17f-4de7-9350-96f432f3545c Dec 09 21:40:58.800827 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-365e486d-4a7e-4211-9cf9-8ea0be0fd1ea tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:58.824014 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71d63c82-fefb-4ffe-a920-4dd931601a33 req-95d4075c-471d-48a6-ac8e-13840f7be3b7 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:58.825598 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71d63c82-fefb-4ffe-a920-4dd931601a33 req-95d4075c-471d-48a6-ac8e-13840f7be3b7 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.0782137 Dec 09 21:40:58.836044 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-365e486d-4a7e-4211-9cf9-8ea0be0fd1ea tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:58.842050 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-365e486d-4a7e-4211-9cf9-8ea0be0fd1ea tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:58.842843 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-365e486d-4a7e-4211-9cf9-8ea0be0fd1ea tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:58.887083 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71d63c82-fefb-4ffe-a920-4dd931601a33 req-bd0de37a-1f94-49c4-9338-93fe8f927352 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0536792 Dec 09 21:40:58.917812 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-365e486d-4a7e-4211-9cf9-8ea0be0fd1ea tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Network': ['ID=a865adfb-a17f-4de7-9350-96f432f3545c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:58.933758 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network a865adfb-a17f-4de7-9350-96f432f3545c details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:40:58.937329 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-365e486d-4a7e-4211-9cf9-8ea0be0fd1ea tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 780 time: 0.2972307 Dec 09 21:40:58.939919 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32832) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:58.959146 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'subnet': {'network_id': 'a865adfb-a17f-4de7-9350-96f432f3545c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': None}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:40:59.067294 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 606dbd6b-3506-4b46-a9d0-f89c7843bf4c up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:40:59.093084 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Made reservation on behalf of 8d03fcad771c485fa5e2c1775828f3a7 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:40:59.098057 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:59.188830 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 606dbd6b-3506-4b46-a9d0-f89c7843bf4c completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:40:59.198985 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 606dbd6b-3506-4b46-a9d0-f89c7843bf4c triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:40:59.199634 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:59.286397 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-00ed8624-995b-4fd9-aac6-04cd2abc7125 req-80c5b139-709c-4eba-94e6-bea4d8d5cbd0 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=46cc52272a6f4269af0142f9b3345dac&device_id=fb4b94af-3092-4329-b88b-a06c713c5b7c HTTP/1.1" status: 200 len: 210 time: 0.0520623 Dec 09 21:40:59.339382 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-00ed8624-995b-4fd9-aac6-04cd2abc7125 req-7097802f-9fc1-427c-8ce1-1c5fe61a8c93 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=46cc52272a6f4269af0142f9b3345dac&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0407596 Dec 09 21:40:59.361820 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:59.405998 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4f31caf3-99fc-49ed-905b-5274e085b84c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '606dbd6b-3506-4b46-a9d0-f89c7843bf4c'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:40:59.409234 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5f9a8d14-0558-478a-a40e-00a86f5900bf" -d '{"events": [{"server_uuid": "4f31caf3-99fc-49ed-905b-5274e085b84c", "name": "network-vif-plugged", "status": "completed", "tag": "606dbd6b-3506-4b46-a9d0-f89c7843bf4c"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:40:59.430412 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd90e3a9-eda0-4f8a-bcd8-5e6e302c42a0 req-d438bc53-0734-474e-aace-b1b90f0d5faf tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb4b94af-3092-4329-b88b-a06c713c5b7c HTTP/1.1" status: 200 len: 210 time: 0.0861869 Dec 09 21:40:59.440733 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 606dbd6b-3506-4b46-a9d0-f89c7843bf4c, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=606dbd6b-3506-4b46-a9d0-f89c7843bf4c,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:40:59.470356 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:59.532360 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:40:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-90b56ac9-adc7-4cdb-a725-863e51221c57 x-openstack-request-id: req-90b56ac9-adc7-4cdb-a725-863e51221c57 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:40:59.532651 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4f31caf3-99fc-49ed-905b-5274e085b84c", "name": "network-vif-plugged", "status": "completed", "tag": "606dbd6b-3506-4b46-a9d0-f89c7843bf4c", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:40:59.533406 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-90b56ac9-adc7-4cdb-a725-863e51221c57 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:40:59.534023 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4f31caf3-99fc-49ed-905b-5274e085b84c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '606dbd6b-3506-4b46-a9d0-f89c7843bf4c', 'code': 200} Dec 09 21:40:59.559364 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:59.564857 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00ed8624-995b-4fd9-aac6-04cd2abc7125 req-2d7b2259-ee85-4ed9-b7b9-d92738c5d95e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:59.581455 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-00ed8624-995b-4fd9-aac6-04cd2abc7125 req-2d7b2259-ee85-4ed9-b7b9-d92738c5d95e service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2110393 Dec 09 21:40:59.585772 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=606dbd6b-3506-4b46-a9d0-f89c7843bf4c,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:59.677369 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Subnet': ['ID=d01a308a-9d09-4975-b761-8c3621819157,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:40:59.698731 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:59.699081 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:59.699421 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:59.699778 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:59.700109 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:59.700434 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:59.700757 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:59.701080 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:59.701528 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:59.702155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:59.702484 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:59.702804 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:59.703121 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:40:59.709086 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1857ac5e-efad-41f2-9ae6-833a51f4b3ca req-989f09f2-eed2-4b05-b3f5-369346c70cc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:59.710568 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1857ac5e-efad-41f2-9ae6-833a51f4b3ca req-989f09f2-eed2-4b05-b3f5-369346c70cc3 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=4f31caf3-99fc-49ed-905b-5274e085b84c HTTP/1.1" status: 200 len: 1098 time: 0.1094916 Dec 09 21:40:59.717366 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Checking segment: {'id': '58e1124c-2b84-46a4-8a54-05ae4cb8e61c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': 'a865adfb-a17f-4de7-9350-96f432f3545c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:40:59.718405 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Network hostable DHCP agents. Network: a865adfb-a17f-4de7-9350-96f432f3545c, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:40:59.771898 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Network a865adfb-a17f-4de7-9350-96f432f3545c is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:40:59.789060 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1857ac5e-efad-41f2-9ae6-833a51f4b3ca req-d7f325e9-de75-4e66-8d87-b61882ed94cf service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0678120 Dec 09 21:40:59.801042 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, a865adfb-a17f-4de7-9350-96f432f3545c) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:40:59.806115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:40:59.806919 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:59.815028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4932e5d-a0d0-43ba-b6b2-31739004b409 None None] Network a865adfb-a17f-4de7-9350-96f432f3545c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:40:59.842771 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 32944) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:40:59.843541 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9075e73d-b1bf-4ac7-9eb7-98fa4ae26050 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 793 time: 0.9017923 Dec 09 21:40:59.958334 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c1e94ff-484f-48c3-ad1e-d3822d93a7b0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-a865adfb-a17f-4de7-9350-96f432f3545c', 'network_id': 'a865adfb-a17f-4de7-9350-96f432f3545c', 'project_id': '8d03fcad771c485fa5e2c1775828f3a7', 'fixed_ips': [{'subnet_id': 'd01a308a-9d09-4975-b761-8c3621819157'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:40:59.959324 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7c1e94ff-484f-48c3-ad1e-d3822d93a7b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:40:59.998464 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10a67cea-9e12-40fc-92b8-ad64ad02bbf4 req-b2c44df3-41b1-47f1-85a1-5708cce65cbe tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:00.001994 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-10a67cea-9e12-40fc-92b8-ad64ad02bbf4 req-b2c44df3-41b1-47f1-85a1-5708cce65cbe tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4f31caf3-99fc-49ed-905b-5274e085b84c HTTP/1.1" status: 200 len: 946 time: 0.2436883 Dec 09 21:41:00.064899 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:00.109902 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-10a67cea-9e12-40fc-92b8-ad64ad02bbf4 req-f4e5b99c-21bd-4d7a-b13d-748e88ed845b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0993302 Dec 09 21:41:00.151469 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-7c1e94ff-484f-48c3-ad1e-d3822d93a7b0 None None] Allocated IP 172.20.0.1 (a865adfb-a17f-4de7-9350-96f432f3545c/d01a308a-9d09-4975-b761-8c3621819157/8e71a72f-9fea-483b-9e48-7365aa738038) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:41:00.179804 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:00.310974 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-516f9ac3-16cd-466d-80ea-9a5adbdaa7aa req-ea0a31b6-ae09-4b6d-9c40-469a41fec3a9 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:00.320250 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-516f9ac3-16cd-466d-80ea-9a5adbdaa7aa req-ea0a31b6-ae09-4b6d-9c40-469a41fec3a9 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.1139276 Dec 09 21:41:00.368021 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-516f9ac3-16cd-466d-80ea-9a5adbdaa7aa req-e5d0fc8e-b2c9-44a8-b985-318916f1779c tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468111 Dec 09 21:41:00.375891 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7c1e94ff-484f-48c3-ad1e-d3822d93a7b0 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:00.393514 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7c1e94ff-484f-48c3-ad1e-d3822d93a7b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:00.414371 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:00.466947 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Subnet': ['ID=d01a308a-9d09-4975-b761-8c3621819157,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:00.491510 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7c1e94ff-484f-48c3-ad1e-d3822d93a7b0 None None] Network a865adfb-a17f-4de7-9350-96f432f3545c is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:41:00.494307 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-7c1e94ff-484f-48c3-ad1e-d3822d93a7b0 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:41:00.496471 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c1e94ff-484f-48c3-ad1e-d3822d93a7b0 None None] Pushing event updated for resources: {'Port': ['ID=8e71a72f-9fea-483b-9e48-7365aa738038,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:00.498859 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c1e94ff-484f-48c3-ad1e-d3822d93a7b0 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:41:00.559975 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-7c1e94ff-484f-48c3-ad1e-d3822d93a7b0 None None] Attempting to bind port 8e71a72f-9fea-483b-9e48-7365aa738038 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:41:00.560358 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-7c1e94ff-484f-48c3-ad1e-d3822d93a7b0 None None] Attempting to bind port 8e71a72f-9fea-483b-9e48-7365aa738038 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '58e1124c-2b84-46a4-8a54-05ae4cb8e61c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': 'a865adfb-a17f-4de7-9350-96f432f3545c'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:41:00.560721 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c1e94ff-484f-48c3-ad1e-d3822d93a7b0 None None] Attempting to bind port 8e71a72f-9fea-483b-9e48-7365aa738038 on network a865adfb-a17f-4de7-9350-96f432f3545c {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:41:00.567428 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c1e94ff-484f-48c3-ad1e-d3822d93a7b0 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 40, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:41:00.567829 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c1e94ff-484f-48c3-ad1e-d3822d93a7b0 None None] Checking segment: {'id': '58e1124c-2b84-46a4-8a54-05ae4cb8e61c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': 'a865adfb-a17f-4de7-9350-96f432f3545c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:41:00.568232 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7c1e94ff-484f-48c3-ad1e-d3822d93a7b0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:00.568622 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7c1e94ff-484f-48c3-ad1e-d3822d93a7b0 None None] Bound using segment: {'id': '58e1124c-2b84-46a4-8a54-05ae4cb8e61c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': 'a865adfb-a17f-4de7-9350-96f432f3545c'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:41:00.569142 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-7c1e94ff-484f-48c3-ad1e-d3822d93a7b0 None None] Bound port: 8e71a72f-9fea-483b-9e48-7365aa738038, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '58e1124c-2b84-46a4-8a54-05ae4cb8e61c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': 'a865adfb-a17f-4de7-9350-96f432f3545c'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:41:00.569579 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7c1e94ff-484f-48c3-ad1e-d3822d93a7b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:00.593512 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:00.620241 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30b5b6b9-b384-4854-a435-5f33319f1713 req-28d90d44-cbfe-42c1-91c8-0b095a45695b tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:00.621933 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-30b5b6b9-b384-4854-a435-5f33319f1713 req-28d90d44-cbfe-42c1-91c8-0b095a45695b tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1566348 Dec 09 21:41:00.631610 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a865adfb-a17f-4de7-9350-96f432f3545c']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:41:00.654228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-7c1e94ff-484f-48c3-ad1e-d3822d93a7b0 None None] For port 8e71a72f-9fea-483b-9e48-7365aa738038, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:41:00.658101 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '58e1124c-2b84-46a4-8a54-05ae4cb8e61c') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:41:00.658417 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-7c1e94ff-484f-48c3-ad1e-d3822d93a7b0 None None] For port 8e71a72f-9fea-483b-9e48-7365aa738038, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=8e71a72f-9fea-483b-9e48-7365aa738038,segment=NetworkSegment(58e1124c-2b84-46a4-8a54-05ae4cb8e61c),segment_id=58e1124c-2b84-46a4-8a54-05ae4cb8e61c)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:41:00.658579 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '58e1124c-2b84-46a4-8a54-05ae4cb8e61c') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:41:00.666106 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7c1e94ff-484f-48c3-ad1e-d3822d93a7b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:00.674765 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:00.704885 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:00.740093 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-30b5b6b9-b384-4854-a435-5f33319f1713 req-4ae3b3b1-6343-43f6-8048-1aadfd255fc8 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0942826 Dec 09 21:41:00.743713 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Releasing vlan 107 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:41:00.744404 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:41:00.750172 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:41:00.773854 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c1e94ff-484f-48c3-ad1e-d3822d93a7b0 None None] Pushing event updated for resources: {'Port': ['ID=8e71a72f-9fea-483b-9e48-7365aa738038,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:00.806716 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e510f6fc-d6a2-46ab-805e-da1393fd56f5 None None] Network a865adfb-a17f-4de7-9350-96f432f3545c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:41:00.874231 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f9676dde-8167-48fd-8cd7-e5eb23bc08e4 req-d07a8690-cf43-4d68-b90a-86dc0d9c0688 tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb4b94af-3092-4329-b88b-a06c713c5b7c HTTP/1.1" status: 200 len: 210 time: 0.0328484 Dec 09 21:41:00.875037 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.db.api [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 09 21:41:00.875037 n-d-713301-27 neutron-server[103438]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 09 21:41:00.875037 n-d-713301-27 neutron-server[103438]: [parameters: {'id': 'a865adfb-a17f-4de7-9350-96f432f3545c'}] Dec 09 21:41:00.875037 n-d-713301-27 neutron-server[103438]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103438) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:41:00.875465 n-d-713301-27 neutron-server[103438]: DEBUG oslo_db.api [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:41:00.939911 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d2b3e501-2e42-444d-9c11-a4554fba3200 None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 21:41:01.054168 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d2b3e501-2e42-444d-9c11-a4554fba3200 None None] Resources bound (agent type, host, resource id): {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 09 21:41:01.242713 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeb54fef-5f58-4d46-99ce-3e4b36aa86e9 req-8a8f8128-d84b-4c3c-ad43-120bb6434bb0 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:01.244511 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eeb54fef-5f58-4d46-99ce-3e4b36aa86e9 req-8a8f8128-d84b-4c3c-ad43-120bb6434bb0 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.0934274 Dec 09 21:41:01.319042 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eeb54fef-5f58-4d46-99ce-3e4b36aa86e9 req-3ca37f7a-d5b2-4fe8-a20a-833ea4c5ce8a tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524533 Dec 09 21:41:01.376817 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:01.464696 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-00ed8624-995b-4fd9-aac6-04cd2abc7125 req-961778a1-f8ca-4604-b2a2-b87d4e94482d tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.31 "GET /v2.0/ports?device_id=fb4b94af-3092-4329-b88b-a06c713c5b7c HTTP/1.1" status: 200 len: 210 time: 0.0292687 Dec 09 21:41:01.513741 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeec2367-a6c6-4f73-a1aa-f5efb51c1d52 req-84ae4b20-72f0-4c2b-aef6-3d7256b2822b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:01.515564 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aeec2367-a6c6-4f73-a1aa-f5efb51c1d52 req-84ae4b20-72f0-4c2b-aef6-3d7256b2822b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4f31caf3-99fc-49ed-905b-5274e085b84c HTTP/1.1" status: 200 len: 946 time: 0.0913720 Dec 09 21:41:01.526723 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Deleting port 8e71a72f-9fea-483b-9e48-7365aa738038 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:41:01.527071 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:01.602476 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aeec2367-a6c6-4f73-a1aa-f5efb51c1d52 req-7d69df01-27ea-4715-b4de-5312bffddb95 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0772643 Dec 09 21:41:01.700843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] For port 8e71a72f-9fea-483b-9e48-7365aa738038, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=8e71a72f-9fea-483b-9e48-7365aa738038,segment=NetworkSegment(58e1124c-2b84-46a4-8a54-05ae4cb8e61c),segment_id=58e1124c-2b84-46a4-8a54-05ae4cb8e61c)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:41:01.701212 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:01.726835 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Calling delete_port for 8e71a72f-9fea-483b-9e48-7365aa738038 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:41:01.812591 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fcdc8c6-af96-4675-91d9-be5bbb5f3ca9 req-1d85ebaa-35a5-4400-8a9c-c5804d8f6c29 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:01.814161 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7fcdc8c6-af96-4675-91d9-be5bbb5f3ca9 req-1d85ebaa-35a5-4400-8a9c-c5804d8f6c29 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4f31caf3-99fc-49ed-905b-5274e085b84c HTTP/1.1" status: 200 len: 946 time: 0.1036124 Dec 09 21:41:01.907825 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7fcdc8c6-af96-4675-91d9-be5bbb5f3ca9 req-fe80de7f-5990-4748-94aa-76e58305d562 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0825472 Dec 09 21:41:01.909102 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:01.939275 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Port': ['ID=8e71a72f-9fea-483b-9e48-7365aa738038,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:01.943155 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No DVR routers for this DVR port 8e71a72f-9fea-483b-9e48-7365aa738038 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:41:02.058408 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:02.110325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a865adfb-a17f-4de7-9350-96f432f3545c']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:41:02.134270 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99aab231-621d-4ac8-bbe8-8dcf7af1e89f req-1e0eb3c1-5e81-4434-97ae-5de919521c9b tempest-ServerShowV247Test-2111089850 tempest-ServerShowV247Test-2111089850-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb4b94af-3092-4329-b88b-a06c713c5b7c HTTP/1.1" status: 200 len: 210 time: 0.0378497 Dec 09 21:41:02.135960 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '58e1124c-2b84-46a4-8a54-05ae4cb8e61c') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:41:02.136297 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '58e1124c-2b84-46a4-8a54-05ae4cb8e61c') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:41:02.157051 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:02.162042 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:02.171118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Releasing vlan 107 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:41:02.171892 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:41:02.177446 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:41:02.252834 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:02.259078 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:02.263685 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/networks/a865adfb-a17f-4de7-9350-96f432f3545c HTTP/1.1" status: 204 len: 168 time: 2.4185212 Dec 09 21:41:02.267048 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33238) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:02.275587 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-e3dd72c2-5e3b-43c8-82d9-821b1b9e7a83 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-342033869'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:02.284665 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8b1c4e9-3256-4067-ac44-fd7f40b1d35d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Network': ['ID=a865adfb-a17f-4de7-9350-96f432f3545c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:02.310866 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e3dd72c2-5e3b-43c8-82d9-821b1b9e7a83 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Made reservation on behalf of 8d03fcad771c485fa5e2c1775828f3a7 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:41:02.315467 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3dd72c2-5e3b-43c8-82d9-821b1b9e7a83 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:02.354258 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e3dd72c2-5e3b-43c8-82d9-821b1b9e7a83 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] vlan segment allocate from pool success with {'vlan_id': 111, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:41:02.372369 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3dd72c2-5e3b-43c8-82d9-821b1b9e7a83 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:02.372898 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-e3dd72c2-5e3b-43c8-82d9-821b1b9e7a83 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Added segment e06b8af7-6e05-4f70-8d46-4caddb7d6a35 of type vlan for network 4676bda5-e890-4e7b-acd7-17850cfdee02 Dec 09 21:41:02.444375 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3dd72c2-5e3b-43c8-82d9-821b1b9e7a83 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:02.485920 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3dd72c2-5e3b-43c8-82d9-821b1b9e7a83 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:02.494704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3dd72c2-5e3b-43c8-82d9-821b1b9e7a83 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:02.495353 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3dd72c2-5e3b-43c8-82d9-821b1b9e7a83 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:02.496354 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22ad808b-1710-45b8-9f16-362fc1694749 req-1a4c32e0-e19c-44aa-91b9-7a14e01a39e3 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:02.504902 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22ad808b-1710-45b8-9f16-362fc1694749 req-1a4c32e0-e19c-44aa-91b9-7a14e01a39e3 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.0676031 Dec 09 21:41:02.572387 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22ad808b-1710-45b8-9f16-362fc1694749 req-bbc064b1-0498-4f13-abae-d2806d6cf5ca tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0663645 Dec 09 21:41:02.578568 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3dd72c2-5e3b-43c8-82d9-821b1b9e7a83 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Network': ['ID=4676bda5-e890-4e7b-acd7-17850cfdee02,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:02.590220 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 4676bda5-e890-4e7b-acd7-17850cfdee02 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:41:02.639987 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e3dd72c2-5e3b-43c8-82d9-821b1b9e7a83 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.3703957 Dec 09 21:41:02.644248 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33276) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:02.654847 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-0acb7f08-6519-4364-8574-dceebb5dd566 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'network': {'name': 'New_network'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:02.681899 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e0ca802-e98b-4a50-8d5f-b1870d6f548d req-7d45abd8-2beb-4e3b-a5fa-db18c1d3d21e tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:02.683397 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8e0ca802-e98b-4a50-8d5f-b1870d6f548d req-7d45abd8-2beb-4e3b-a5fa-db18c1d3d21e tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4f31caf3-99fc-49ed-905b-5274e085b84c HTTP/1.1" status: 200 len: 946 time: 0.0523467 Dec 09 21:41:02.734358 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8e0ca802-e98b-4a50-8d5f-b1870d6f548d req-6936c799-daac-43a6-95d9-07a882198e9d tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440764 Dec 09 21:41:02.825822 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0acb7f08-6519-4364-8574-dceebb5dd566 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:02.841913 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0acb7f08-6519-4364-8574-dceebb5dd566 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:02.851948 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-0acb7f08-6519-4364-8574-dceebb5dd566 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Network 4676bda5-e890-4e7b-acd7-17850cfdee02 is not hosted by any dhcp agent {{(pid=103437) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 09 21:41:02.857276 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0acb7f08-6519-4364-8574-dceebb5dd566 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:02.857870 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0acb7f08-6519-4364-8574-dceebb5dd566 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:02.862509 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0acb7f08-6519-4364-8574-dceebb5dd566 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "PUT /v2.0/networks/4676bda5-e890-4e7b-acd7-17850cfdee02 HTTP/1.1" status: 200 len: 723 time: 0.2118495 Dec 09 21:41:02.863020 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33280) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:02.868901 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-2e19d753-5e87-450d-afb6-4e38aef00a9e tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'subnet': {'network_id': '4676bda5-e890-4e7b-acd7-17850cfdee02', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:02.930868 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0acb7f08-6519-4364-8574-dceebb5dd566 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Network': ['ID=4676bda5-e890-4e7b-acd7-17850cfdee02,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:02.947693 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 4676bda5-e890-4e7b-acd7-17850cfdee02 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:41:02.984978 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1feb47ec-7b78-4cb8-8818-4ebacb326f40 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:03.008609 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e19d753-5e87-450d-afb6-4e38aef00a9e tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Made reservation on behalf of 8d03fcad771c485fa5e2c1775828f3a7 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:41:03.012767 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e19d753-5e87-450d-afb6-4e38aef00a9e tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:03.025760 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a2ef088-d192-4c52-bfce-fc0f99546e01 req-96b5c600-c235-4e39-807e-a0f53112aaa6 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:03.027266 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a2ef088-d192-4c52-bfce-fc0f99546e01 req-96b5c600-c235-4e39-807e-a0f53112aaa6 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.0801818 Dec 09 21:41:03.135663 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a2ef088-d192-4c52-bfce-fc0f99546e01 req-ed3d7962-d277-40cb-b691-123bfb54b444 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0965269 Dec 09 21:41:03.244939 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e19d753-5e87-450d-afb6-4e38aef00a9e tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:03.312168 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e19d753-5e87-450d-afb6-4e38aef00a9e tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Subnet': ['ID=9e721d49-cbda-432b-b209-a88f69b564b5,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:03.322454 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e19d753-5e87-450d-afb6-4e38aef00a9e tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Checking segment: {'id': 'e06b8af7-6e05-4f70-8d46-4caddb7d6a35', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '4676bda5-e890-4e7b-acd7-17850cfdee02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:41:03.322817 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e19d753-5e87-450d-afb6-4e38aef00a9e tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Network hostable DHCP agents. Network: 4676bda5-e890-4e7b-acd7-17850cfdee02, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:41:03.344124 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e19d753-5e87-450d-afb6-4e38aef00a9e tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Network 4676bda5-e890-4e7b-acd7-17850cfdee02 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:41:03.356092 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-2e19d753-5e87-450d-afb6-4e38aef00a9e tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 4676bda5-e890-4e7b-acd7-17850cfdee02) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:41:03.364759 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e19d753-5e87-450d-afb6-4e38aef00a9e tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:03.365357 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e19d753-5e87-450d-afb6-4e38aef00a9e tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:03.369550 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-302cd1f8-1657-4842-8e1b-9716b0ffc927 None None] Network 4676bda5-e890-4e7b-acd7-17850cfdee02 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:41:03.390563 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2e19d753-5e87-450d-afb6-4e38aef00a9e tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.5237899 Dec 09 21:41:03.390990 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33292) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:03.398563 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-3a0452f1-c7af-4588-bb0d-704becabb3b5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'subnet': {'name': 'New_subnet'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:03.508377 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33298) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:03.539205 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1bf3d3dc-7860-4e79-ad1f-89c742c1527c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-4676bda5-e890-4e7b-acd7-17850cfdee02', 'network_id': '4676bda5-e890-4e7b-acd7-17850cfdee02', 'project_id': '8d03fcad771c485fa5e2c1775828f3a7', 'fixed_ips': [{'subnet_id': '9e721d49-cbda-432b-b209-a88f69b564b5'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:41:03.540335 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1bf3d3dc-7860-4e79-ad1f-89c742c1527c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:03.549580 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3a0452f1-c7af-4588-bb0d-704becabb3b5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-8592471'] for subnet, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:03.659149 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-09f4b7e1-d76f-460b-b4f3-d2c8e6766b80 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:03.733235 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3a0452f1-c7af-4588-bb0d-704becabb3b5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8731650215464', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-8812010'] for subnet, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:03.796925 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-1bf3d3dc-7860-4e79-ad1f-89c742c1527c None None] Allocated IP 172.20.0.2 (4676bda5-e890-4e7b-acd7-17850cfdee02/9e721d49-cbda-432b-b209-a88f69b564b5/e361202a-57ae-4912-a37f-a9421b1684fe) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:41:03.850343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a0452f1-c7af-4588-bb0d-704becabb3b5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:03.850941 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3a0452f1-c7af-4588-bb0d-704becabb3b5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:03.856354 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3a0452f1-c7af-4588-bb0d-704becabb3b5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "PUT /v2.0/subnets/9e721d49-cbda-432b-b209-a88f69b564b5 HTTP/1.1" status: 200 len: 806 time: 0.4640815 Dec 09 21:41:03.866170 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33308) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:03.881115 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-09f4b7e1-d76f-460b-b4f3-d2c8e6766b80 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:03.900376 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-09f4b7e1-d76f-460b-b4f3-d2c8e6766b80 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:03.925577 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64fb6925-40be-4793-866d-41495495f2f4 req-1db210c3-11f0-4e49-b9c8-ee28e5fa8be8 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:03.927404 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-64fb6925-40be-4793-866d-41495495f2f4 req-1db210c3-11f0-4e49-b9c8-ee28e5fa8be8 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "GET /v2.0/ports?device_id=4f31caf3-99fc-49ed-905b-5274e085b84c HTTP/1.1" status: 200 len: 946 time: 0.1073487 Dec 09 21:41:04.057803 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1bf3d3dc-7860-4e79-ad1f-89c742c1527c None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:04.072217 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1bf3d3dc-7860-4e79-ad1f-89c742c1527c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:04.093227 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-09f4b7e1-d76f-460b-b4f3-d2c8e6766b80 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=46cc52272a6f4269af0142f9b3345dac&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5831091 Dec 09 21:41:04.094353 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09f4b7e1-d76f-460b-b4f3-d2c8e6766b80 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=26317281-cfa4-44bb-b7c9-645b2cc13fa7,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:04.098755 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33312) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:04.140108 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bf3d3dc-7860-4e79-ad1f-89c742c1527c None None] Pushing event updated for resources: {'Port': ['ID=e361202a-57ae-4912-a37f-a9421b1684fe,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:04.159638 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1bf3d3dc-7860-4e79-ad1f-89c742c1527c None None] Network 4676bda5-e890-4e7b-acd7-17850cfdee02 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:41:04.163536 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-1bf3d3dc-7860-4e79-ad1f-89c742c1527c None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:41:04.168805 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1bf3d3dc-7860-4e79-ad1f-89c742c1527c None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:41:04.189539 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-64fb6925-40be-4793-866d-41495495f2f4 req-d8e3db7d-8dab-4303-b424-26cbf92dc1e8 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Deleting port 606dbd6b-3506-4b46-a9d0-f89c7843bf4c {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:41:04.189899 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-64fb6925-40be-4793-866d-41495495f2f4 req-d8e3db7d-8dab-4303-b424-26cbf92dc1e8 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:04.251529 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-1bf3d3dc-7860-4e79-ad1f-89c742c1527c None None] Attempting to bind port e361202a-57ae-4912-a37f-a9421b1684fe on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:41:04.252063 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-1bf3d3dc-7860-4e79-ad1f-89c742c1527c None None] Attempting to bind port e361202a-57ae-4912-a37f-a9421b1684fe by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'e06b8af7-6e05-4f70-8d46-4caddb7d6a35', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '4676bda5-e890-4e7b-acd7-17850cfdee02'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:41:04.252819 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bf3d3dc-7860-4e79-ad1f-89c742c1527c None None] Attempting to bind port e361202a-57ae-4912-a37f-a9421b1684fe on network 4676bda5-e890-4e7b-acd7-17850cfdee02 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:41:04.261281 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bf3d3dc-7860-4e79-ad1f-89c742c1527c None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 40, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:41:04.261666 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bf3d3dc-7860-4e79-ad1f-89c742c1527c None None] Checking segment: {'id': 'e06b8af7-6e05-4f70-8d46-4caddb7d6a35', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '4676bda5-e890-4e7b-acd7-17850cfdee02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:41:04.263719 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1bf3d3dc-7860-4e79-ad1f-89c742c1527c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:04.264309 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bf3d3dc-7860-4e79-ad1f-89c742c1527c None None] Bound using segment: {'id': 'e06b8af7-6e05-4f70-8d46-4caddb7d6a35', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '4676bda5-e890-4e7b-acd7-17850cfdee02'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:41:04.264930 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-1bf3d3dc-7860-4e79-ad1f-89c742c1527c None None] Bound port: e361202a-57ae-4912-a37f-a9421b1684fe, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e06b8af7-6e05-4f70-8d46-4caddb7d6a35', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '4676bda5-e890-4e7b-acd7-17850cfdee02'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:41:04.265423 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1bf3d3dc-7860-4e79-ad1f-89c742c1527c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:04.321875 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-64fb6925-40be-4793-866d-41495495f2f4 req-d8e3db7d-8dab-4303-b424-26cbf92dc1e8 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] For port 606dbd6b-3506-4b46-a9d0-f89c7843bf4c, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=606dbd6b-3506-4b46-a9d0-f89c7843bf4c,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:41:04.322251 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-64fb6925-40be-4793-866d-41495495f2f4 req-d8e3db7d-8dab-4303-b424-26cbf92dc1e8 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:04.337174 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-64fb6925-40be-4793-866d-41495495f2f4 req-d8e3db7d-8dab-4303-b424-26cbf92dc1e8 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Calling delete_port for 606dbd6b-3506-4b46-a9d0-f89c7843bf4c owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:41:04.386412 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-1bf3d3dc-7860-4e79-ad1f-89c742c1527c None None] For port e361202a-57ae-4912-a37f-a9421b1684fe, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:41:04.387567 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-938be856-bee0-4aef-b2c3-71de4559038c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:04.392603 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-1bf3d3dc-7860-4e79-ad1f-89c742c1527c None None] For port e361202a-57ae-4912-a37f-a9421b1684fe, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e361202a-57ae-4912-a37f-a9421b1684fe,segment=NetworkSegment(e06b8af7-6e05-4f70-8d46-4caddb7d6a35),segment_id=e06b8af7-6e05-4f70-8d46-4caddb7d6a35)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:41:04.403043 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1bf3d3dc-7860-4e79-ad1f-89c742c1527c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:04.444689 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a0452f1-c7af-4588-bb0d-704becabb3b5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Subnet': ['ID=9e721d49-cbda-432b-b209-a88f69b564b5,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:04.480680 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bf3d3dc-7860-4e79-ad1f-89c742c1527c None None] Pushing event updated for resources: {'Port': ['ID=e361202a-57ae-4912-a37f-a9421b1684fe,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:04.503187 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a0452f1-c7af-4588-bb0d-704becabb3b5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:04.507467 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a0452f1-c7af-4588-bb0d-704becabb3b5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:04.508044 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a0452f1-c7af-4588-bb0d-704becabb3b5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:04.508568 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a0452f1-c7af-4588-bb0d-704becabb3b5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:04.509371 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a0452f1-c7af-4588-bb0d-704becabb3b5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:04.512322 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a0452f1-c7af-4588-bb0d-704becabb3b5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:04.512450 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-938be856-bee0-4aef-b2c3-71de4559038c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:04.513359 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a0452f1-c7af-4588-bb0d-704becabb3b5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:04.513905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a0452f1-c7af-4588-bb0d-704becabb3b5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:04.514697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a0452f1-c7af-4588-bb0d-704becabb3b5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:04.515299 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a0452f1-c7af-4588-bb0d-704becabb3b5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:04.518707 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a0452f1-c7af-4588-bb0d-704becabb3b5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:04.519699 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a0452f1-c7af-4588-bb0d-704becabb3b5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:04.520241 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a0452f1-c7af-4588-bb0d-704becabb3b5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:04.554224 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-64fb6925-40be-4793-866d-41495495f2f4 req-d8e3db7d-8dab-4303-b424-26cbf92dc1e8 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:04.567025 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['5df02334-3682-4a91-b22d-133fa1bcb473', '606dbd6b-3506-4b46-a9d0-f89c7843bf4c'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:41:04.597729 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fbea60e-20dc-4512-8f81-27e49b15049d req-eeb1b4fa-f019-40b9-828d-9cf38fd305c4 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:04.611719 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7fbea60e-20dc-4512-8f81-27e49b15049d req-eeb1b4fa-f019-40b9-828d-9cf38fd305c4 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4f31caf3-99fc-49ed-905b-5274e085b84c HTTP/1.1" status: 200 len: 867 time: 0.7514212 Dec 09 21:41:04.638473 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8e3db7d-8dab-4303-b424-26cbf92dc1e8 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Pushing event deleted for resources: {'Port': ['ID=606dbd6b-3506-4b46-a9d0-f89c7843bf4c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:04.665244 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-604da599-a766-4de5-b73d-1a1209d2cf21 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:04.676038 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-108faaf9-907d-4256-bfa0-049609257e18 None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:41:04.677513 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-64fb6925-40be-4793-866d-41495495f2f4 req-d8e3db7d-8dab-4303-b424-26cbf92dc1e8 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] No DVR routers for this DVR port 606dbd6b-3506-4b46-a9d0-f89c7843bf4c on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:41:04.681648 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-64fb6925-40be-4793-866d-41495495f2f4 req-d8e3db7d-8dab-4303-b424-26cbf92dc1e8 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:04.688101 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-64fb6925-40be-4793-866d-41495495f2f4 req-d8e3db7d-8dab-4303-b424-26cbf92dc1e8 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "DELETE /v2.0/ports/606dbd6b-3506-4b46-a9d0-f89c7843bf4c HTTP/1.1" status: 204 len: 173 time: 0.7476573 Dec 09 21:41:04.689788 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4f31caf3-99fc-49ed-905b-5274e085b84c', 'name': 'network-vif-deleted', 'tag': '606dbd6b-3506-4b46-a9d0-f89c7843bf4c'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:41:04.693305 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ad10e197-92d1-4dc2-bb8f-3af02eae6b1e" -d '{"events": [{"server_uuid": "4f31caf3-99fc-49ed-905b-5274e085b84c", "name": "network-vif-deleted", "tag": "606dbd6b-3506-4b46-a9d0-f89c7843bf4c"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:41:04.713973 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-938be856-bee0-4aef-b2c3-71de4559038c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:04.716927 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-938be856-bee0-4aef-b2c3-71de4559038c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:04.722782 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-938be856-bee0-4aef-b2c3-71de4559038c admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/26317281-cfa4-44bb-b7c9-645b2cc13fa7 HTTP/1.1" status: 204 len: 168 time: 0.6207283 Dec 09 21:41:04.727271 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7fbea60e-20dc-4512-8f81-27e49b15049d req-c78da00b-1ba8-41fb-accf-797e1e54b929 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1144509 Dec 09 21:41:04.751955 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-938be856-bee0-4aef-b2c3-71de4559038c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=26317281-cfa4-44bb-b7c9-645b2cc13fa7,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:04.866250 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-604da599-a766-4de5-b73d-1a1209d2cf21 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Deleting port e361202a-57ae-4912-a37f-a9421b1684fe {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:41:04.869552 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-604da599-a766-4de5-b73d-1a1209d2cf21 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:05.209059 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-604da599-a766-4de5-b73d-1a1209d2cf21 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] For port e361202a-57ae-4912-a37f-a9421b1684fe, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e361202a-57ae-4912-a37f-a9421b1684fe,segment=NetworkSegment(e06b8af7-6e05-4f70-8d46-4caddb7d6a35),segment_id=e06b8af7-6e05-4f70-8d46-4caddb7d6a35)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:41:05.212500 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-604da599-a766-4de5-b73d-1a1209d2cf21 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:05.224413 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20734df0-4fb2-4eea-9004-2e92f9e5582b req-f2488d01-1b1b-48d6-8e17-8a9bd05ab658 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:05.232532 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20734df0-4fb2-4eea-9004-2e92f9e5582b req-f2488d01-1b1b-48d6-8e17-8a9bd05ab658 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.3584411 Dec 09 21:41:05.261110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-604da599-a766-4de5-b73d-1a1209d2cf21 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Calling delete_port for e361202a-57ae-4912-a37f-a9421b1684fe owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:41:05.397086 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20734df0-4fb2-4eea-9004-2e92f9e5582b req-97ed490f-7e9b-4fe4-afa0-0f2658f00a34 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1538494 Dec 09 21:41:05.452182 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:41:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-64acf85a-30ff-4858-b1b2-35b8bce73466 x-openstack-request-id: req-64acf85a-30ff-4858-b1b2-35b8bce73466 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:41:05.452488 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4f31caf3-99fc-49ed-905b-5274e085b84c", "name": "network-vif-deleted", "tag": "606dbd6b-3506-4b46-a9d0-f89c7843bf4c", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:41:05.452844 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-64acf85a-30ff-4858-b1b2-35b8bce73466 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:41:05.453442 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4f31caf3-99fc-49ed-905b-5274e085b84c', 'name': 'network-vif-deleted', 'tag': '606dbd6b-3506-4b46-a9d0-f89c7843bf4c', 'status': 'completed', 'code': 200} Dec 09 21:41:05.529238 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-604da599-a766-4de5-b73d-1a1209d2cf21 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:05.552422 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bcbc49b8-c091-4d3c-98ee-65f007f1d8fd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:05.584616 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-604da599-a766-4de5-b73d-1a1209d2cf21 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Port': ['ID=e361202a-57ae-4912-a37f-a9421b1684fe,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:05.647929 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-604da599-a766-4de5-b73d-1a1209d2cf21 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No DVR routers for this DVR port e361202a-57ae-4912-a37f-a9421b1684fe on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:41:05.703314 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-604da599-a766-4de5-b73d-1a1209d2cf21 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:05.805417 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-604da599-a766-4de5-b73d-1a1209d2cf21 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:05.902461 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-604da599-a766-4de5-b73d-1a1209d2cf21 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Subnet': ['ID=9e721d49-cbda-432b-b209-a88f69b564b5,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:05.998643 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-604da599-a766-4de5-b73d-1a1209d2cf21 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:06.037297 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-604da599-a766-4de5-b73d-1a1209d2cf21 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4676bda5-e890-4e7b-acd7-17850cfdee02']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:41:06.058264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-604da599-a766-4de5-b73d-1a1209d2cf21 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e06b8af7-6e05-4f70-8d46-4caddb7d6a35') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:41:06.058715 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-604da599-a766-4de5-b73d-1a1209d2cf21 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e06b8af7-6e05-4f70-8d46-4caddb7d6a35') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:41:06.070267 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-604da599-a766-4de5-b73d-1a1209d2cf21 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:06.088424 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-604da599-a766-4de5-b73d-1a1209d2cf21 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:06.095262 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-604da599-a766-4de5-b73d-1a1209d2cf21 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Releasing vlan 111 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:41:06.096870 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-604da599-a766-4de5-b73d-1a1209d2cf21 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:41:06.160550 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:41:06.168213 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-604da599-a766-4de5-b73d-1a1209d2cf21 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:06.178581 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-604da599-a766-4de5-b73d-1a1209d2cf21 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:06.185800 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33352) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:06.186439 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-604da599-a766-4de5-b73d-1a1209d2cf21 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/networks/4676bda5-e890-4e7b-acd7-17850cfdee02 HTTP/1.1" status: 204 len: 168 time: 2.3186119 Dec 09 21:41:06.199372 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-604da599-a766-4de5-b73d-1a1209d2cf21 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Network': ['ID=4676bda5-e890-4e7b-acd7-17850cfdee02,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:06.222357 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-991dfaa3-37d8-41b6-8520-f1d24ff0cfda tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] DELETE failed (client error): The resource could not be found. Dec 09 21:41:06.224046 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-991dfaa3-37d8-41b6-8520-f1d24ff0cfda tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:41:06.238251 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33354) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:06.243894 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-b9f9f268-8d84-4a39-b04a-def9c08e607c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-354413868', 'description': 'd1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:06.245230 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-991dfaa3-37d8-41b6-8520-f1d24ff0cfda tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/networks/4676bda5-e890-4e7b-acd7-17850cfdee02 HTTP/1.1" status: 404 len: 339 time: 0.0518494 Dec 09 21:41:06.276394 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b9f9f268-8d84-4a39-b04a-def9c08e607c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Made reservation on behalf of 8d03fcad771c485fa5e2c1775828f3a7 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:41:06.280985 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b9f9f268-8d84-4a39-b04a-def9c08e607c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:06.296142 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7db2fe4-a002-486d-8111-a5e8f7770a38 None None] DHCP port deletion for 4676bda5-e890-4e7b-acd7-17850cfdee02 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:41:06.310578 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-18b7ed6a-3ae1-417c-879f-4cb15c426c74 None None] Could not find standard attr ID for object e361202a-57ae-4912-a37f-a9421b1684fe. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:41:06.314567 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d460537b-5c8f-47c3-90a6-106fca7fb507 None None] Network 4676bda5-e890-4e7b-acd7-17850cfdee02 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:41:06.344061 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d460537b-5c8f-47c3-90a6-106fca7fb507 None None] Network 4676bda5-e890-4e7b-acd7-17850cfdee02 could not be found, it might have been deleted concurrently. {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:224}} Dec 09 21:41:06.349815 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b9f9f268-8d84-4a39-b04a-def9c08e607c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] vlan segment allocate from pool success with {'vlan_id': 131, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:41:06.352442 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d56b08d-00a4-4c74-8d24-7bf3581f33c4 None None] Network 4676bda5-e890-4e7b-acd7-17850cfdee02 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:41:06.361449 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b9f9f268-8d84-4a39-b04a-def9c08e607c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:06.362197 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-b9f9f268-8d84-4a39-b04a-def9c08e607c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Added segment 40514f38-fb79-4bd9-9f26-71f2676048cd of type vlan for network 767a99b1-a304-41bf-99fc-0f3917285cdd Dec 09 21:41:06.391483 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d56b08d-00a4-4c74-8d24-7bf3581f33c4 None None] Network 4676bda5-e890-4e7b-acd7-17850cfdee02 could not be found, it might have been deleted concurrently. {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:224}} Dec 09 21:41:06.432365 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b9f9f268-8d84-4a39-b04a-def9c08e607c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:06.480567 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b9f9f268-8d84-4a39-b04a-def9c08e607c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:06.487692 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b9f9f268-8d84-4a39-b04a-def9c08e607c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:06.488517 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b9f9f268-8d84-4a39-b04a-def9c08e607c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:06.549407 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b9f9f268-8d84-4a39-b04a-def9c08e607c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 781 time: 0.3099134 Dec 09 21:41:06.552162 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33362) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:06.594809 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4f713a5-6105-479e-9a0e-e4b55df18d69 req-84e92851-4082-4e97-9f87-1d962cffb5b6 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:06.597277 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4f713a5-6105-479e-9a0e-e4b55df18d69 req-84e92851-4082-4e97-9f87-1d962cffb5b6 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1326323 Dec 09 21:41:06.601777 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9f9f268-8d84-4a39-b04a-def9c08e607c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Network': ['ID=767a99b1-a304-41bf-99fc-0f3917285cdd,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:06.627391 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 767a99b1-a304-41bf-99fc-0f3917285cdd details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:41:06.674210 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4f713a5-6105-479e-9a0e-e4b55df18d69 req-2108b8e5-44a6-4d4d-9d3f-dcf328e7f814 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0679708 Dec 09 21:41:06.745170 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:07.096634 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 606dbd6b-3506-4b46-a9d0-f89c7843bf4c no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:41:07.117257 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-920c2006-3102-41d1-abea-673855287906 req-dfd81d25-1d9b-4663-ac95-a36932d0abd5 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:07.126726 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-920c2006-3102-41d1-abea-673855287906 req-dfd81d25-1d9b-4663-ac95-a36932d0abd5 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/networks?id=ba3aee78-4661-4c71-9b18-af1e6a07faff HTTP/1.1" status: 200 len: 805 time: 0.1800799 Dec 09 21:41:07.148192 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-920c2006-3102-41d1-abea-673855287906 req-7e7e44b1-f25d-4f71-87c9-5556cd9847de tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/quotas/0569bc74c98b4ae2980de7af929e97eb HTTP/1.1" status: 200 len: 375 time: 0.0198438 Dec 09 21:41:07.158236 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 606dbd6b-3506-4b46-a9d0-f89c7843bf4c {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:41:07.158583 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 606dbd6b-3506-4b46-a9d0-f89c7843bf4c not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:41:07.212096 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-608c7a7b-0c0e-458d-930b-55186484c55f tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:07.218158 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-608c7a7b-0c0e-458d-930b-55186484c55f tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "GET /v2.0/networks?id=767a99b1-a304-41bf-99fc-0f3917285cdd HTTP/1.1" status: 200 len: 760 time: 0.6647599 Dec 09 21:41:07.218333 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-920c2006-3102-41d1-abea-673855287906 req-b5828a31-b38b-4403-a784-0bb97d881374 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=0569bc74c98b4ae2980de7af929e97eb&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0687199 Dec 09 21:41:07.220828 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33388) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:07.226851 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-9f598b33-02f5-4dc3-8d3d-91d8af3b6d9e tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'network': {'description': 'd2'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:07.307532 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33390) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:07.383819 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-920c2006-3102-41d1-abea-673855287906 req-7006fbc9-4ff0-4da4-92f4-f851bbbfe937 service neutron] 10.222.0.13 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1621518 Dec 09 21:41:07.419177 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9f598b33-02f5-4dc3-8d3d-91d8af3b6d9e tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:07.440751 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9f598b33-02f5-4dc3-8d3d-91d8af3b6d9e tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:07.482265 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-9f598b33-02f5-4dc3-8d3d-91d8af3b6d9e tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Network 767a99b1-a304-41bf-99fc-0f3917285cdd is not hosted by any dhcp agent {{(pid=103437) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 09 21:41:07.494646 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f598b33-02f5-4dc3-8d3d-91d8af3b6d9e tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:07.497509 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9f598b33-02f5-4dc3-8d3d-91d8af3b6d9e tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:07.499006 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9f598b33-02f5-4dc3-8d3d-91d8af3b6d9e tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "PUT /v2.0/networks/767a99b1-a304-41bf-99fc-0f3917285cdd HTTP/1.1" status: 200 len: 757 time: 0.2770543 Dec 09 21:41:07.508260 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33394) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:07.547655 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e712781b-5f70-45b9-9a8d-116e23fb9ead admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:07.593899 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-920c2006-3102-41d1-abea-673855287906 req-621cc21a-34e0-44fd-a3a5-ccd0910dfdaa service neutron] 10.222.0.13 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2084026 Dec 09 21:41:07.607582 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43c25f54-7089-4aa4-bed5-624035bc3922 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:07.609876 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-43c25f54-7089-4aa4-bed5-624035bc3922 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "GET /v2.0/networks?id=767a99b1-a304-41bf-99fc-0f3917285cdd HTTP/1.1" status: 200 len: 760 time: 0.0995729 Dec 09 21:41:07.614987 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33396) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:07.622356 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a2e21fb6-f3f8-4981-b8c5-071e56e15265 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-579752075'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:07.667198 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f598b33-02f5-4dc3-8d3d-91d8af3b6d9e tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Network': ['ID=767a99b1-a304-41bf-99fc-0f3917285cdd,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:07.680533 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a2e21fb6-f3f8-4981-b8c5-071e56e15265 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Made reservation on behalf of 8d03fcad771c485fa5e2c1775828f3a7 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:41:07.683256 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 767a99b1-a304-41bf-99fc-0f3917285cdd details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:41:07.685082 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a2e21fb6-f3f8-4981-b8c5-071e56e15265 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:07.714538 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e712781b-5f70-45b9-9a8d-116e23fb9ead admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:07.728514 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e712781b-5f70-45b9-9a8d-116e23fb9ead admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:07.744084 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a2e21fb6-f3f8-4981-b8c5-071e56e15265 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] vlan segment allocate from pool success with {'vlan_id': 125, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:41:07.797478 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a2e21fb6-f3f8-4981-b8c5-071e56e15265 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:07.797478 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-a2e21fb6-f3f8-4981-b8c5-071e56e15265 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Added segment 8dbb599f-36d6-4766-93bb-a4d62c2aa32c of type vlan for network fcb89980-b226-43fe-840b-071838388b4c Dec 09 21:41:07.807689 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e712781b-5f70-45b9-9a8d-116e23fb9ead admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=0d482881815d4651b7e9cf8ca5014246&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4968953 Dec 09 21:41:07.808385 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33400) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:07.824131 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e712781b-5f70-45b9-9a8d-116e23fb9ead admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c92bce24-d450-4359-b9d5-4e38fc211465,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:07.918066 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7000ddba-52c8-430f-962c-d72d672dc9e3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:07.921350 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a2e21fb6-f3f8-4981-b8c5-071e56e15265 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:07.980114 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7000ddba-52c8-430f-962c-d72d672dc9e3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:07.996278 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:08.001188 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a2e21fb6-f3f8-4981-b8c5-071e56e15265 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:08.007850 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2e21fb6-f3f8-4981-b8c5-071e56e15265 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:08.008578 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a2e21fb6-f3f8-4981-b8c5-071e56e15265 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:08.060707 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a2e21fb6-f3f8-4981-b8c5-071e56e15265 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.4440937 Dec 09 21:41:08.063714 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33410) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:08.075730 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-857f48dc-c238-4298-96fc-cf2ba2b24cdc tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'subnet': {'network_id': 'fcb89980-b226-43fe-840b-071838388b4c', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:08.216817 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e361202a-57ae-4912-a37f-a9421b1684fe no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:41:08.238435 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7000ddba-52c8-430f-962c-d72d672dc9e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:08.241913 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7000ddba-52c8-430f-962c-d72d672dc9e3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:08.243534 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7000ddba-52c8-430f-962c-d72d672dc9e3 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/c92bce24-d450-4359-b9d5-4e38fc211465 HTTP/1.1" status: 204 len: 168 time: 0.4341803 Dec 09 21:41:08.275296 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e21fb6-f3f8-4981-b8c5-071e56e15265 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Network': ['ID=fcb89980-b226-43fe-840b-071838388b4c,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:08.292724 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7000ddba-52c8-430f-962c-d72d672dc9e3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c92bce24-d450-4359-b9d5-4e38fc211465,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:08.329315 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network fcb89980-b226-43fe-840b-071838388b4c details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:41:08.347038 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-857f48dc-c238-4298-96fc-cf2ba2b24cdc tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Made reservation on behalf of 8d03fcad771c485fa5e2c1775828f3a7 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:41:08.353302 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-857f48dc-c238-4298-96fc-cf2ba2b24cdc tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:08.381030 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58501d80-5444-42f0-a665-f29f2b9b0644 req-05b52b8d-e747-432f-9407-a56f14c06fc1 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:08.388694 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-58501d80-5444-42f0-a665-f29f2b9b0644 req-05b52b8d-e747-432f-9407-a56f14c06fc1 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.3524408 Dec 09 21:41:08.455048 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: e361202a-57ae-4912-a37f-a9421b1684fe {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:41:08.455486 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e361202a-57ae-4912-a37f-a9421b1684fe not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:41:08.471270 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-58501d80-5444-42f0-a665-f29f2b9b0644 req-3fa7da41-2dee-4013-914a-2da1df2556df tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0763927 Dec 09 21:41:08.609610 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-23c9a57f-9486-4ab6-af75-871e0ab6162f req-3342a3cd-1bd3-4791-b4c1-93a755ebf19c tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1af02f9f-8258-4145-b364-35ab02015e65 HTTP/1.1" status: 200 len: 210 time: 0.0498559 Dec 09 21:41:08.769994 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-857f48dc-c238-4298-96fc-cf2ba2b24cdc tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:08.859548 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-857f48dc-c238-4298-96fc-cf2ba2b24cdc tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Subnet': ['ID=3f8b3ef9-80fe-4461-8ca6-64ccfd4e6542,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:08.871513 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-857f48dc-c238-4298-96fc-cf2ba2b24cdc tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Checking segment: {'id': '8dbb599f-36d6-4766-93bb-a4d62c2aa32c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'fcb89980-b226-43fe-840b-071838388b4c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:41:08.871990 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-857f48dc-c238-4298-96fc-cf2ba2b24cdc tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Network hostable DHCP agents. Network: fcb89980-b226-43fe-840b-071838388b4c, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:41:08.893045 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-857f48dc-c238-4298-96fc-cf2ba2b24cdc tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Network fcb89980-b226-43fe-840b-071838388b4c is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:41:08.929995 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-857f48dc-c238-4298-96fc-cf2ba2b24cdc tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, fcb89980-b226-43fe-840b-071838388b4c) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:41:08.940871 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a9448c2-ff17-4ed0-957b-838ba79b7a85 None None] Network fcb89980-b226-43fe-840b-071838388b4c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:41:08.957950 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-857f48dc-c238-4298-96fc-cf2ba2b24cdc tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:08.958467 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-857f48dc-c238-4298-96fc-cf2ba2b24cdc tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:08.990781 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-857f48dc-c238-4298-96fc-cf2ba2b24cdc tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.9255998 Dec 09 21:41:08.993336 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33436) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:09.093650 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-77348bb1-ccca-4766-99ed-0f1785bdb7cd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-fcb89980-b226-43fe-840b-071838388b4c', 'network_id': 'fcb89980-b226-43fe-840b-071838388b4c', 'project_id': '8d03fcad771c485fa5e2c1775828f3a7', 'fixed_ips': [{'subnet_id': '3f8b3ef9-80fe-4461-8ca6-64ccfd4e6542'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:41:09.094982 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-77348bb1-ccca-4766-99ed-0f1785bdb7cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:09.206926 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-147698df-3202-4d44-8bd1-6eb6c428b166 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:09.336982 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-147698df-3202-4d44-8bd1-6eb6c428b166 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:09.447331 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33448) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:09.471215 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-147698df-3202-4d44-8bd1-6eb6c428b166 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server [None req-77348bb1-ccca-4766-99ed-0f1785bdb7cd None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 3f8b3ef9-80fe-4461-8ca6-64ccfd4e6542: This subnet is being modified by another concurrent operation. Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 306, in create_dhcp_port Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1485, in create_port Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1450, in _create_port_db Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1460, in create_port_db Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnet.lock_register( Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise exception Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 3f8b3ef9-80fe-4461-8ca6-64ccfd4e6542: This subnet is being modified by another concurrent operation. Dec 09 21:41:09.590376 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Dec 09 21:41:09.603191 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-147698df-3202-4d44-8bd1-6eb6c428b166 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Subnet': ['ID=3f8b3ef9-80fe-4461-8ca6-64ccfd4e6542,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:09.618838 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-241b06f9-043c-4186-afab-a10ae12361a7 None None] Network fcb89980-b226-43fe-840b-071838388b4c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:41:09.711835 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-147698df-3202-4d44-8bd1-6eb6c428b166 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:09.740146 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-804648a3-50fa-4c97-a60b-143e27466417 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:09.823922 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cc746e5-a608-43e4-9510-0b101d5a1801 req-32ec5d59-a68c-433c-a754-0d51ba853584 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:09.836551 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6cc746e5-a608-43e4-9510-0b101d5a1801 req-32ec5d59-a68c-433c-a754-0d51ba853584 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1842372 Dec 09 21:41:09.861067 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:09.927225 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-934b99ea-f620-4634-ae88-8be3c1489cb8 None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 21:41:09.940709 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-147698df-3202-4d44-8bd1-6eb6c428b166 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fcb89980-b226-43fe-840b-071838388b4c']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:41:09.990219 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-147698df-3202-4d44-8bd1-6eb6c428b166 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8dbb599f-36d6-4766-93bb-a4d62c2aa32c') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:41:09.995613 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-147698df-3202-4d44-8bd1-6eb6c428b166 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8dbb599f-36d6-4766-93bb-a4d62c2aa32c') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:41:10.029005 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-147698df-3202-4d44-8bd1-6eb6c428b166 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:10.036065 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-804648a3-50fa-4c97-a60b-143e27466417 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:10.050268 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-804648a3-50fa-4c97-a60b-143e27466417 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:10.095364 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-147698df-3202-4d44-8bd1-6eb6c428b166 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:10.107336 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-804648a3-50fa-4c97-a60b-143e27466417 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=034f106f-b64e-4b8e-be0a-04dc12af10d9,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:10.131457 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-920c2006-3102-41d1-abea-673855287906 req-fece3253-963d-4282-b39f-068ac2dd2b7a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:10.133046 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-920c2006-3102-41d1-abea-673855287906 req-fece3253-963d-4282-b39f-068ac2dd2b7a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "GET /v2.0/networks?id=ba3aee78-4661-4c71-9b18-af1e6a07faff HTTP/1.1" status: 200 len: 805 time: 0.4844997 Dec 09 21:41:10.134239 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-147698df-3202-4d44-8bd1-6eb6c428b166 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Releasing vlan 125 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:41:10.142303 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-147698df-3202-4d44-8bd1-6eb6c428b166 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:41:10.146524 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:41:10.157224 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-934b99ea-f620-4634-ae88-8be3c1489cb8 None None] Resources bound (agent type, host, resource id): {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 09 21:41:10.168838 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6cc746e5-a608-43e4-9510-0b101d5a1801 req-68275e8f-8197-4793-a638-55b8c4d1340e tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3263135 Dec 09 21:41:10.175606 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-804648a3-50fa-4c97-a60b-143e27466417 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=768eb4b754244fc2b7d9fabc6ce0792b&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7268705 Dec 09 21:41:10.182118 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33460) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:10.202839 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-920c2006-3102-41d1-abea-673855287906 req-6e1642e9-4728-4e3d-82da-7bfac75d80fa tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Request body: {'port': {'device_id': '1af02f9f-8258-4145-b364-35ab02015e65', 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff', 'admin_state_up': True, 'tenant_id': '0569bc74c98b4ae2980de7af929e97eb'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:10.414087 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-147698df-3202-4d44-8bd1-6eb6c428b166 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:10.441804 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-147698df-3202-4d44-8bd1-6eb6c428b166 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:10.450189 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-147698df-3202-4d44-8bd1-6eb6c428b166 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/networks/fcb89980-b226-43fe-840b-071838388b4c HTTP/1.1" status: 204 len: 168 time: 1.4557416 Dec 09 21:41:10.460824 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33468) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:10.475765 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8470b576-5757-4fc0-979a-1ad8e06eec3c req-86db73da-b243-4cfd-a1e6-48997ad039ce tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1af02f9f-8258-4145-b364-35ab02015e65 HTTP/1.1" status: 200 len: 210 time: 0.0793524 Dec 09 21:41:10.491195 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-147698df-3202-4d44-8bd1-6eb6c428b166 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Network': ['ID=fcb89980-b226-43fe-840b-071838388b4c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:10.544595 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-465781ce-bf6c-4360-8561-7dbc3d67aec7 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] GET failed (client error): The resource could not be found. Dec 09 21:41:10.546597 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-465781ce-bf6c-4360-8561-7dbc3d67aec7 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "GET /v2.0/subnets/3f8b3ef9-80fe-4461-8ca6-64ccfd4e6542 HTTP/1.1" status: 404 len: 337 time: 0.0702934 Dec 09 21:41:10.550256 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33474) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:10.591133 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-6f895483-26a6-4252-ba46-c5f27c7df087 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] DELETE failed (client error): The resource could not be found. Dec 09 21:41:10.591991 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6f895483-26a6-4252-ba46-c5f27c7df087 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:41:10.600273 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6f895483-26a6-4252-ba46-c5f27c7df087 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/networks/fcb89980-b226-43fe-840b-071838388b4c HTTP/1.1" status: 404 len: 339 time: 0.0469697 Dec 09 21:41:10.601888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33476) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:10.649360 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a9f003bc-f4ce-4ee7-8ff4-ea44fe9d8a87 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:10.703164 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-920c2006-3102-41d1-abea-673855287906 req-6e1642e9-4728-4e3d-82da-7bfac75d80fa tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Made reservation on behalf of 0569bc74c98b4ae2980de7af929e97eb for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:41:10.738279 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-920c2006-3102-41d1-abea-673855287906 req-6e1642e9-4728-4e3d-82da-7bfac75d80fa tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:10.792801 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a9f003bc-f4ce-4ee7-8ff4-ea44fe9d8a87 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:11.032192 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25a77ff4-4b6b-4173-a0fc-4cd14294e938 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:11.037352 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-25a77ff4-4b6b-4173-a0fc-4cd14294e938 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 782 time: 0.4340873 Dec 09 21:41:11.038106 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33490) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:11.070195 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-920c2006-3102-41d1-abea-673855287906 req-6e1642e9-4728-4e3d-82da-7bfac75d80fa tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Allocated IP 172.20.0.14 (ba3aee78-4661-4c71-9b18-af1e6a07faff/b61ac70f-1e8d-40a8-9031-bab15f73fa0a/bc80e20d-ce6c-46ea-9b97-f2f29d502b95) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:41:11.083556 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b07b5b39-70f7-48ca-9445-07d5302efa61 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "GET /v2.0/subnets?network_id=97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 207 time: 0.0429647 Dec 09 21:41:11.086121 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33492) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:11.271428 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd1fdc49-4519-429d-8e53-fa0e0dcfb04a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:11.281012 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd1fdc49-4519-429d-8e53-fa0e0dcfb04a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:11.289928 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd1fdc49-4519-429d-8e53-fa0e0dcfb04a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:11.296665 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd1fdc49-4519-429d-8e53-fa0e0dcfb04a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:11.298633 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fd1fdc49-4519-429d-8e53-fa0e0dcfb04a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "GET /v2.0/networks HTTP/1.1" status: 200 len: 2486 time: 0.2114699 Dec 09 21:41:11.302544 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33500) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:11.317036 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a9f003bc-f4ce-4ee7-8ff4-ea44fe9d8a87 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:11.323184 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a9f003bc-f4ce-4ee7-8ff4-ea44fe9d8a87 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:11.329185 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a9f003bc-f4ce-4ee7-8ff4-ea44fe9d8a87 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/034f106f-b64e-4b8e-be0a-04dc12af10d9 HTTP/1.1" status: 204 len: 168 time: 1.1400073 Dec 09 21:41:11.385453 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9f003bc-f4ce-4ee7-8ff4-ea44fe9d8a87 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=034f106f-b64e-4b8e-be0a-04dc12af10d9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:11.463572 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-920c2006-3102-41d1-abea-673855287906 req-6e1642e9-4728-4e3d-82da-7bfac75d80fa tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:11.538829 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-920c2006-3102-41d1-abea-673855287906 req-6e1642e9-4728-4e3d-82da-7bfac75d80fa tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:11.557008 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['5df02334-3682-4a91-b22d-133fa1bcb473'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:41:11.571185 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ebd4badc-bafe-40ec-9164-db03080bad52 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "GET /v2.0/networks?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 575 time: 0.2671373 Dec 09 21:41:11.578279 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33508) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:11.638178 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-920c2006-3102-41d1-abea-673855287906 req-6e1642e9-4728-4e3d-82da-7bfac75d80fa tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Network ba3aee78-4661-4c71-9b18-af1e6a07faff is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:41:11.645337 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-920c2006-3102-41d1-abea-673855287906 req-6e1642e9-4728-4e3d-82da-7bfac75d80fa tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:41:11.657645 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e1642e9-4728-4e3d-82da-7bfac75d80fa tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Pushing event updated for resources: {'Port': ['ID=bc80e20d-ce6c-46ea-9b97-f2f29d502b95,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:11.661082 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-920c2006-3102-41d1-abea-673855287906 req-6e1642e9-4728-4e3d-82da-7bfac75d80fa tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:41:11.687172 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f01aa47a-2646-44da-89c3-8bbcb59b69b2 None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:41:11.734909 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-920c2006-3102-41d1-abea-673855287906 req-6e1642e9-4728-4e3d-82da-7bfac75d80fa tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:11.735621 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-920c2006-3102-41d1-abea-673855287906 req-6e1642e9-4728-4e3d-82da-7bfac75d80fa tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:11.758083 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-920c2006-3102-41d1-abea-673855287906 req-6e1642e9-4728-4e3d-82da-7bfac75d80fa tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.5768900 Dec 09 21:41:11.773333 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-920c2006-3102-41d1-abea-673855287906 req-9e8f6c7d-11ee-4779-b3df-32f503d7f71e service neutron] Request body: {'port': {'device_id': '1af02f9f-8258-4145-b364-35ab02015e65', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:11.786263 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e98ba83-907e-4219-a013-e2338897b7ef tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:11.795284 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e98ba83-907e-4219-a013-e2338897b7ef tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:11.813074 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8e98ba83-907e-4219-a013-e2338897b7ef tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1446 time: 0.2324669 Dec 09 21:41:11.813291 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33512) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:11.834769 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-47fc71a3-1723-42af-94d8-0f3cc16e9458 None None] Provisioning complete for port bc80e20d-ce6c-46ea-9b97-f2f29d502b95 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:41:11.835538 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-47fc71a3-1723-42af-94d8-0f3cc16e9458 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:11.838021 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b47ce27-04b1-420f-99d5-bd74f87648c7 req-6fe982a0-abe8-41f4-8d0e-204fdde4fd6d tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:11.852141 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b47ce27-04b1-420f-99d5-bd74f87648c7 req-6fe982a0-abe8-41f4-8d0e-204fdde4fd6d tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1af02f9f-8258-4145-b364-35ab02015e65 HTTP/1.1" status: 200 len: 932 time: 0.1875582 Dec 09 21:41:11.938182 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b47ce27-04b1-420f-99d5-bd74f87648c7 req-ddd997d6-0ece-467e-9cfc-6ae26cf8273c tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0847783 Dec 09 21:41:11.953446 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-47fc71a3-1723-42af-94d8-0f3cc16e9458 None None] Port bc80e20d-ce6c-46ea-9b97-f2f29d502b95 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:41:12.093982 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7dc773e8-824e-4d04-bb7e-89dfbfc2fe37 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['shared'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:12.096492 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7dc773e8-824e-4d04-bb7e-89dfbfc2fe37 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['shared'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:12.098470 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7dc773e8-824e-4d04-bb7e-89dfbfc2fe37 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "GET /v2.0/subnets?fields=id&fields=network_id HTTP/1.1" status: 200 len: 403 time: 0.2843709 Dec 09 21:41:12.100110 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-920c2006-3102-41d1-abea-673855287906 req-9e8f6c7d-11ee-4779-b3df-32f503d7f71e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:12.104065 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33524) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:12.345732 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5a63171-623a-4ea4-8e0b-5c8d86e7beea tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:12.346547 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f5a63171-623a-4ea4-8e0b-5c8d86e7beea tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "GET /v2.0/networks/5fa22bcb-aab0-4d2e-acc0-554514c04095 HTTP/1.1" status: 200 len: 800 time: 0.2414591 Dec 09 21:41:12.353883 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33532) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:12.514878 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5b6aeb22-c32a-4d75-bc59-6e8c9e69c205 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "GET /v2.0/networks/5fa22bcb-aab0-4d2e-acc0-554514c04095?fields=id&fields=name&fields=mtu HTTP/1.1" status: 200 len: 316 time: 0.1562026 Dec 09 21:41:12.518478 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33540) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:12.609239 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-920c2006-3102-41d1-abea-673855287906 req-9e8f6c7d-11ee-4779-b3df-32f503d7f71e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bc80e20d-ce6c-46ea-9b97-f2f29d502b95 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:41:12.619067 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-920c2006-3102-41d1-abea-673855287906 req-9e8f6c7d-11ee-4779-b3df-32f503d7f71e service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:12.626841 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-67c6ce92-f10b-4b1c-92b2-bda739e51358 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:12.628601 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-67c6ce92-f10b-4b1c-92b2-bda739e51358 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "GET /v2.0/subnets/24c8e276-4190-4038-8903-43f80ae0e34a HTTP/1.1" status: 200 len: 811 time: 0.1080759 Dec 09 21:41:12.632879 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33544) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:12.637186 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-920c2006-3102-41d1-abea-673855287906 req-9e8f6c7d-11ee-4779-b3df-32f503d7f71e service neutron] Transition to ACTIVE for port object bc80e20d-ce6c-46ea-9b97-f2f29d502b95 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:41:12.644768 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-920c2006-3102-41d1-abea-673855287906 req-9e8f6c7d-11ee-4779-b3df-32f503d7f71e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:12.719695 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5dcd026a-adf6-4095-82f2-740f02485725 None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:41:12.724515 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e97c63ed-5eea-464b-83f4-5ccd88c36bd1 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['shared'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:12.726255 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e97c63ed-5eea-464b-83f4-5ccd88c36bd1 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "GET /v2.0/subnets/24c8e276-4190-4038-8903-43f80ae0e34a?fields=id&fields=network_id HTTP/1.1" status: 200 len: 302 time: 0.0923903 Dec 09 21:41:12.730906 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33550) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:12.752940 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-d88d08a8-fdff-4029-8fab-b58798b01e4c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'network': {'name': 'tempest-NetworksTest-test-network-584063108'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:12.810599 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e8f6c7d-11ee-4779-b3df-32f503d7f71e service neutron] Pushing event updated for resources: {'Port': ['ID=bc80e20d-ce6c-46ea-9b97-f2f29d502b95,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:12.877394 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d88d08a8-fdff-4029-8fab-b58798b01e4c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Made reservation on behalf of 8d03fcad771c485fa5e2c1775828f3a7 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:41:12.881158 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d88d08a8-fdff-4029-8fab-b58798b01e4c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:12.922364 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d88d08a8-fdff-4029-8fab-b58798b01e4c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] vlan segment allocate from pool success with {'vlan_id': 108, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:41:12.939366 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-920c2006-3102-41d1-abea-673855287906 req-9e8f6c7d-11ee-4779-b3df-32f503d7f71e service neutron] Attempting to bind port bc80e20d-ce6c-46ea-9b97-f2f29d502b95 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:41:12.941109 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-920c2006-3102-41d1-abea-673855287906 req-9e8f6c7d-11ee-4779-b3df-32f503d7f71e service neutron] Attempting to bind port bc80e20d-ce6c-46ea-9b97-f2f29d502b95 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:41:12.941534 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-920c2006-3102-41d1-abea-673855287906 req-9e8f6c7d-11ee-4779-b3df-32f503d7f71e service neutron] Attempting to bind port bc80e20d-ce6c-46ea-9b97-f2f29d502b95 on network ba3aee78-4661-4c71-9b18-af1e6a07faff {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:41:12.949753 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d88d08a8-fdff-4029-8fab-b58798b01e4c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:12.949753 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-d88d08a8-fdff-4029-8fab-b58798b01e4c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Added segment d74f8b97-a5f4-4a67-bcba-f811c7357740 of type vlan for network 43b151ca-a0e7-448d-8939-2c8a14a8d9ad Dec 09 21:41:12.957991 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-920c2006-3102-41d1-abea-673855287906 req-9e8f6c7d-11ee-4779-b3df-32f503d7f71e service neutron] Port bc80e20d-ce6c-46ea-9b97-f2f29d502b95 on network ba3aee78-4661-4c71-9b18-af1e6a07faff not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:41:12.958330 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-920c2006-3102-41d1-abea-673855287906 req-9e8f6c7d-11ee-4779-b3df-32f503d7f71e service neutron] Attempting to bind port bc80e20d-ce6c-46ea-9b97-f2f29d502b95 on network ba3aee78-4661-4c71-9b18-af1e6a07faff {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:41:12.983093 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-920c2006-3102-41d1-abea-673855287906 req-9e8f6c7d-11ee-4779-b3df-32f503d7f71e service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 40, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:41:12.983484 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-920c2006-3102-41d1-abea-673855287906 req-9e8f6c7d-11ee-4779-b3df-32f503d7f71e service neutron] Checking segment: {'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:41:12.983909 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-920c2006-3102-41d1-abea-673855287906 req-9e8f6c7d-11ee-4779-b3df-32f503d7f71e service neutron] Bound using segment: {'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:41:12.984369 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-920c2006-3102-41d1-abea-673855287906 req-9e8f6c7d-11ee-4779-b3df-32f503d7f71e service neutron] Bound port: bc80e20d-ce6c-46ea-9b97-f2f29d502b95, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:41:12.984739 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-920c2006-3102-41d1-abea-673855287906 req-9e8f6c7d-11ee-4779-b3df-32f503d7f71e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:13.014212 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d88d08a8-fdff-4029-8fab-b58798b01e4c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:13.094654 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d88d08a8-fdff-4029-8fab-b58798b01e4c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:13.100856 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d88d08a8-fdff-4029-8fab-b58798b01e4c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:13.101542 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d88d08a8-fdff-4029-8fab-b58798b01e4c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:13.122654 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-920c2006-3102-41d1-abea-673855287906 req-9e8f6c7d-11ee-4779-b3df-32f503d7f71e service neutron] For port bc80e20d-ce6c-46ea-9b97-f2f29d502b95, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:41:13.145433 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d88d08a8-fdff-4029-8fab-b58798b01e4c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.4010391 Dec 09 21:41:13.152611 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33564) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:13.156037 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-920c2006-3102-41d1-abea-673855287906 req-9e8f6c7d-11ee-4779-b3df-32f503d7f71e service neutron] For port bc80e20d-ce6c-46ea-9b97-f2f29d502b95, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=bc80e20d-ce6c-46ea-9b97-f2f29d502b95,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:41:13.161917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33566) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:13.166127 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-8ca46401-459b-49bb-a3f2-c00da8f1e62c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'subnet': {'network_id': '43b151ca-a0e7-448d-8939-2c8a14a8d9ad', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.1'}], 'dns_nameservers': ['8.8.4.4', '8.8.8.8'], 'allocation_pools': [{'start': '172.20.0.3', 'end': '172.20.0.7'}]}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:13.198016 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-920c2006-3102-41d1-abea-673855287906 req-9e8f6c7d-11ee-4779-b3df-32f503d7f71e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:13.203318 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d88d08a8-fdff-4029-8fab-b58798b01e4c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Network': ['ID=43b151ca-a0e7-448d-8939-2c8a14a8d9ad,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:13.219342 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 43b151ca-a0e7-448d-8939-2c8a14a8d9ad details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:41:13.242176 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-920c2006-3102-41d1-abea-673855287906 req-9e8f6c7d-11ee-4779-b3df-32f503d7f71e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:13.243018 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-920c2006-3102-41d1-abea-673855287906 req-9e8f6c7d-11ee-4779-b3df-32f503d7f71e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:13.244876 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-920c2006-3102-41d1-abea-673855287906 req-9e8f6c7d-11ee-4779-b3df-32f503d7f71e service neutron] 10.222.0.31 "PUT /v2.0/ports/bc80e20d-ce6c-46ea-9b97-f2f29d502b95 HTTP/1.1" status: 200 len: 1093 time: 1.4764729 Dec 09 21:41:13.245417 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1af02f9f-8258-4145-b364-35ab02015e65', 'tag': 'bc80e20d-ce6c-46ea-9b97-f2f29d502b95'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:41:13.248121 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a0aaf9cf-07ce-4da2-a8eb-8ccaa2aec0b6" -d '{"events": [{"name": "network-changed", "server_uuid": "1af02f9f-8258-4145-b364-35ab02015e65", "tag": "bc80e20d-ce6c-46ea-9b97-f2f29d502b95"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:41:13.273173 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e8f6c7d-11ee-4779-b3df-32f503d7f71e service neutron] Pushing event updated for resources: {'Port': ['ID=bc80e20d-ce6c-46ea-9b97-f2f29d502b95,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:13.305307 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-76f50d0b-68f4-4dbb-b98f-9936fbc4caa8 None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:41:13.337050 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bb59fe4-2178-441b-82ea-f6d83507fa1f req-9c59a85c-a303-4bc9-92f5-ebc47ce71160 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:13.346118 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3bb59fe4-2178-441b-82ea-f6d83507fa1f req-9c59a85c-a303-4bc9-92f5-ebc47ce71160 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1af02f9f-8258-4145-b364-35ab02015e65 HTTP/1.1" status: 200 len: 944 time: 0.2678883 Dec 09 21:41:13.356905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8ca46401-459b-49bb-a3f2-c00da8f1e62c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Made reservation on behalf of 8d03fcad771c485fa5e2c1775828f3a7 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:41:13.361153 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8ca46401-459b-49bb-a3f2-c00da8f1e62c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:13.429608 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-920c2006-3102-41d1-abea-673855287906 req-06e6cb42-c326-402a-9b02-7902f88d3c80 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:13.433486 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-920c2006-3102-41d1-abea-673855287906 req-06e6cb42-c326-402a-9b02-7902f88d3c80 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0569bc74c98b4ae2980de7af929e97eb&device_id=1af02f9f-8258-4145-b364-35ab02015e65 HTTP/1.1" status: 200 len: 1096 time: 0.1247380 Dec 09 21:41:13.456224 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-876cc53d-ccb0-440b-be11-969e175e497e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:13.463234 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.ipam_backend_mixin [None req-8ca46401-459b-49bb-a3f2-c00da8f1e62c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Performing IP validity checks on allocation pools {{(pid=103438) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Dec 09 21:41:13.463945 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.ipam_backend_mixin [None req-8ca46401-459b-49bb-a3f2-c00da8f1e62c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Checking for overlaps among allocation pools and gateway ip {{(pid=103438) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Dec 09 21:41:13.481459 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3bb59fe4-2178-441b-82ea-f6d83507fa1f req-a779d9c6-afd1-47bd-aad1-928ccf65e436 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1295948 Dec 09 21:41:13.496165 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-920c2006-3102-41d1-abea-673855287906 req-eab526e0-beab-42f6-9c2c-010af1bc3fc8 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=bc80e20d-ce6c-46ea-9b97-f2f29d502b95 HTTP/1.1" status: 200 len: 217 time: 0.0478108 Dec 09 21:41:13.582442 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-920c2006-3102-41d1-abea-673855287906 req-00f89d43-0239-4a5b-844d-0eff0246476a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:13.584135 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-920c2006-3102-41d1-abea-673855287906 req-00f89d43-0239-4a5b-844d-0eff0246476a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=b61ac70f-1e8d-40a8-9031-bab15f73fa0a HTTP/1.1" status: 200 len: 845 time: 0.0789731 Dec 09 21:41:13.657963 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-920c2006-3102-41d1-abea-673855287906 req-0852576b-2c40-4375-828f-1ced3ee409b6 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ba3aee78-4661-4c71-9b18-af1e6a07faff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0637555 Dec 09 21:41:13.719826 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-876cc53d-ccb0-440b-be11-969e175e497e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:13.732022 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8ca46401-459b-49bb-a3f2-c00da8f1e62c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:13.761529 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:41:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-baff8b8c-1cda-416b-8654-05afa7fd8250 x-openstack-request-id: req-baff8b8c-1cda-416b-8654-05afa7fd8250 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:41:13.761824 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1af02f9f-8258-4145-b364-35ab02015e65", "tag": "bc80e20d-ce6c-46ea-9b97-f2f29d502b95", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:41:13.762079 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-baff8b8c-1cda-416b-8654-05afa7fd8250 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:41:13.762485 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1af02f9f-8258-4145-b364-35ab02015e65', 'tag': 'bc80e20d-ce6c-46ea-9b97-f2f29d502b95', 'status': 'completed', 'code': 200} Dec 09 21:41:13.765611 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-876cc53d-ccb0-440b-be11-969e175e497e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:13.848652 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-876cc53d-ccb0-440b-be11-969e175e497e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3aa3a3c9-0a20-42d6-9258-9644b848410b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:13.871507 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-876cc53d-ccb0-440b-be11-969e175e497e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ae6c6057584147dc8938a12c53267859&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7055993 Dec 09 21:41:13.873457 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33592) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:13.874166 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ca46401-459b-49bb-a3f2-c00da8f1e62c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Subnet': ['ID=b8086acf-29ea-4929-92cc-c7fbea767ad5,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:13.877161 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-920c2006-3102-41d1-abea-673855287906 req-0705d6a7-385f-4a31-bfbc-a8c173e6a69a service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2036154 Dec 09 21:41:13.926621 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b1d69f9-73f2-41a0-bff4-1534cc9ef473 req-7d104631-842d-4a05-b5b2-2bccc2777460 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:13.928254 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b1d69f9-73f2-41a0-bff4-1534cc9ef473 req-7d104631-842d-4a05-b5b2-2bccc2777460 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=69d79e96ec1c418aa6c619846f0fe02e&device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 1098 time: 0.1531897 Dec 09 21:41:14.000682 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-920c2006-3102-41d1-abea-673855287906 req-8996ae6a-ee93-48d9-b4db-0dbf6e1c2c40 service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1190274 Dec 09 21:41:14.052092 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8ca46401-459b-49bb-a3f2-c00da8f1e62c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Checking segment: {'id': 'd74f8b97-a5f4-4a67-bcba-f811c7357740', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': '43b151ca-a0e7-448d-8939-2c8a14a8d9ad'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:41:14.052456 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8ca46401-459b-49bb-a3f2-c00da8f1e62c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Network hostable DHCP agents. Network: 43b151ca-a0e7-448d-8939-2c8a14a8d9ad, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:41:14.080947 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e71c1e4-cbef-4fcb-91f6-2b62bc08df95 req-5e4fa21c-7a07-4d2e-9a93-2ae9077a0711 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:14.082508 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e71c1e4-cbef-4fcb-91f6-2b62bc08df95 req-5e4fa21c-7a07-4d2e-9a93-2ae9077a0711 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.2380419 Dec 09 21:41:14.108858 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0aaf9cf-07ce-4da2-a8eb-8ccaa2aec0b6 req-78477b07-5f04-4d67-b9e0-aac10dd1f6fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:14.110566 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a0aaf9cf-07ce-4da2-a8eb-8ccaa2aec0b6 req-78477b07-5f04-4d67-b9e0-aac10dd1f6fa service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0569bc74c98b4ae2980de7af929e97eb&device_id=1af02f9f-8258-4145-b364-35ab02015e65 HTTP/1.1" status: 200 len: 1096 time: 0.0455256 Dec 09 21:41:14.115619 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b1d69f9-73f2-41a0-bff4-1534cc9ef473 req-e852a26f-2d5d-4ed7-b90e-00ffffcf3475 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:14.117174 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b1d69f9-73f2-41a0-bff4-1534cc9ef473 req-e852a26f-2d5d-4ed7-b90e-00ffffcf3475 service neutron] 10.222.0.31 "GET /v2.0/networks?id=71038cd4-0600-4b06-91f9-ae7f4f4807f9 HTTP/1.1" status: 200 len: 920 time: 0.1803498 Dec 09 21:41:14.141572 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e6958b60-4e92-484d-b737-aa030185bddc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:14.185193 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8ca46401-459b-49bb-a3f2-c00da8f1e62c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Network 43b151ca-a0e7-448d-8939-2c8a14a8d9ad is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:41:14.188770 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b1d69f9-73f2-41a0-bff4-1534cc9ef473 req-3cf352be-efd5-4809-a2f5-d8af66f01f03 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=be95aa8d-fc0e-4d77-a861-33c1637e4f3e HTTP/1.1" status: 200 len: 217 time: 0.0587649 Dec 09 21:41:14.235376 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0aaf9cf-07ce-4da2-a8eb-8ccaa2aec0b6 req-7cee092e-f253-4863-8685-069eb3ce7425 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:14.237199 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a0aaf9cf-07ce-4da2-a8eb-8ccaa2aec0b6 req-7cee092e-f253-4863-8685-069eb3ce7425 service neutron] 10.222.0.31 "GET /v2.0/networks?id=ba3aee78-4661-4c71-9b18-af1e6a07faff HTTP/1.1" status: 200 len: 906 time: 0.1192081 Dec 09 21:41:14.263210 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e6958b60-4e92-484d-b737-aa030185bddc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:14.265648 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-8ca46401-459b-49bb-a3f2-c00da8f1e62c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 43b151ca-a0e7-448d-8939-2c8a14a8d9ad) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:41:14.276191 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-43b19654-4e27-4a89-8aac-82ddc921a8a9 None None] Network 43b151ca-a0e7-448d-8939-2c8a14a8d9ad requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:41:14.281275 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e71c1e4-cbef-4fcb-91f6-2b62bc08df95 req-b122e8af-14ac-43b8-a476-ae60946bc1cf tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1901479 Dec 09 21:41:14.286835 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8ca46401-459b-49bb-a3f2-c00da8f1e62c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:14.287759 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8ca46401-459b-49bb-a3f2-c00da8f1e62c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:14.297779 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a0aaf9cf-07ce-4da2-a8eb-8ccaa2aec0b6 req-f89ea895-76f0-4344-92f2-d0464b64feda service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=bc80e20d-ce6c-46ea-9b97-f2f29d502b95 HTTP/1.1" status: 200 len: 217 time: 0.0517528 Dec 09 21:41:14.318668 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b1d69f9-73f2-41a0-bff4-1534cc9ef473 req-719db28f-d786-457f-b655-c4257bef40fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:14.320434 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b1d69f9-73f2-41a0-bff4-1534cc9ef473 req-719db28f-d786-457f-b655-c4257bef40fa service neutron] 10.222.0.31 "GET /v2.0/subnets?id=12d97cfc-9264-49cb-8e47-fd225cb6d30b HTTP/1.1" status: 200 len: 859 time: 0.1185524 Dec 09 21:41:14.346336 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8ca46401-459b-49bb-a3f2-c00da8f1e62c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 872 time: 1.1821575 Dec 09 21:41:14.346680 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33646) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:14.352175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-125f2bb7-83dd-404b-89d4-f99463991bb5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Request body: {'subnet': {'name': 'New_subnet', 'host_routes': [{'destination': '10.20.0.0/32', 'nexthop': '10.100.1.2'}], 'dns_nameservers': ['7.8.8.8', '7.8.4.4'], 'gateway_ip': '172.20.0.2', 'enable_dhcp': True}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:14.373562 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b1d69f9-73f2-41a0-bff4-1534cc9ef473 req-33484728-a12d-4269-b54c-a2b8b58db983 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=71038cd4-0600-4b06-91f9-ae7f4f4807f9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0431573 Dec 09 21:41:14.378452 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0aaf9cf-07ce-4da2-a8eb-8ccaa2aec0b6 req-8aec40e2-1ef3-42d3-a016-d7e06eb6431e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:14.379850 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a0aaf9cf-07ce-4da2-a8eb-8ccaa2aec0b6 req-8aec40e2-1ef3-42d3-a016-d7e06eb6431e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=b61ac70f-1e8d-40a8-9031-bab15f73fa0a HTTP/1.1" status: 200 len: 845 time: 0.0738819 Dec 09 21:41:14.435700 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a0aaf9cf-07ce-4da2-a8eb-8ccaa2aec0b6 req-cc483195-ea89-406e-83ad-18294e4c14f7 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ba3aee78-4661-4c71-9b18-af1e6a07faff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0470283 Dec 09 21:41:14.443911 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e762009c-c831-4cbb-8e9a-d6193b6c40ff None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-43b151ca-a0e7-448d-8939-2c8a14a8d9ad', 'network_id': '43b151ca-a0e7-448d-8939-2c8a14a8d9ad', 'project_id': '8d03fcad771c485fa5e2c1775828f3a7', 'fixed_ips': [{'subnet_id': 'b8086acf-29ea-4929-92cc-c7fbea767ad5'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:41:14.444842 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e762009c-c831-4cbb-8e9a-d6193b6c40ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:14.446878 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e6958b60-4e92-484d-b737-aa030185bddc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:14.449756 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e6958b60-4e92-484d-b737-aa030185bddc admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:14.453540 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e6958b60-4e92-484d-b737-aa030185bddc admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/3aa3a3c9-0a20-42d6-9258-9644b848410b HTTP/1.1" status: 204 len: 168 time: 0.5740435 Dec 09 21:41:14.505486 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6958b60-4e92-484d-b737-aa030185bddc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3aa3a3c9-0a20-42d6-9258-9644b848410b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:14.567318 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-125f2bb7-83dd-404b-89d4-f99463991bb5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_update-8592471'] for subnet, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:14.570456 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b1d69f9-73f2-41a0-bff4-1534cc9ef473 req-2941296c-b0a7-428f-90b7-abbc277bafd9 service neutron] 10.222.0.31 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1757119 Dec 09 21:41:14.594909 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a0aaf9cf-07ce-4da2-a8eb-8ccaa2aec0b6 req-a0162baf-9d74-40c9-8a97-a6cfaed84521 service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1430879 Dec 09 21:41:14.757267 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-e762009c-c831-4cbb-8e9a-d6193b6c40ff None None] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Dec 09 21:41:14.757267 n-d-713301-27 neutron-server[103439]: [SQL: UPDATE subnets SET in_use=%(in_use)s WHERE subnets.id = %(id_1)s] Dec 09 21:41:14.757267 n-d-713301-27 neutron-server[103439]: [parameters: {'in_use': 1, 'id_1': 'b8086acf-29ea-4929-92cc-c7fbea767ad5'}] Dec 09 21:41:14.757267 n-d-713301-27 neutron-server[103439]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:41:14.757881 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-e762009c-c831-4cbb-8e9a-d6193b6c40ff None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.create_port {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:41:14.763779 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a0aaf9cf-07ce-4da2-a8eb-8ccaa2aec0b6 req-e8ec20ab-9263-4472-9e06-62623631d7c3 service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1599231 Dec 09 21:41:14.821797 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40931bbb-de00-4a62-b825-d63f5e6039fc req-203f8d83-57ab-4eab-a816-86cd9d712fac tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:14.823370 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-40931bbb-de00-4a62-b825-d63f5e6039fc req-203f8d83-57ab-4eab-a816-86cd9d712fac tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1af02f9f-8258-4145-b364-35ab02015e65 HTTP/1.1" status: 200 len: 944 time: 0.1689031 Dec 09 21:41:14.828580 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b1d69f9-73f2-41a0-bff4-1534cc9ef473 req-c0839b6a-1dca-4fde-b1f5-bb3877449bf5 service neutron] 10.222.0.31 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2493279 Dec 09 21:41:14.959667 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-40931bbb-de00-4a62-b825-d63f5e6039fc req-9a7346e3-cb14-46f5-848e-c1cd0bce60ff tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1139128 Dec 09 21:41:14.973391 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-125f2bb7-83dd-404b-89d4-f99463991bb5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8731650215464', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_updated-8812010'] for subnet, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:15.016322 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-125f2bb7-83dd-404b-89d4-f99463991bb5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:15.016926 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-125f2bb7-83dd-404b-89d4-f99463991bb5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:15.017264 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33720) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:15.019072 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-125f2bb7-83dd-404b-89d4-f99463991bb5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "PUT /v2.0/subnets/b8086acf-29ea-4929-92cc-c7fbea767ad5 HTTP/1.1" status: 200 len: 877 time: 0.6710885 Dec 09 21:41:15.021779 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33722) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:15.040037 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df147008-2c0c-4a4c-82f7-050c2d285063 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:15.070909 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-125f2bb7-83dd-404b-89d4-f99463991bb5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event updated for resources: {'Subnet': ['ID=b8086acf-29ea-4929-92cc-c7fbea767ad5,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:15.147748 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df147008-2c0c-4a4c-82f7-050c2d285063 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:15.152657 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4f4d1a6b-d278-4c0c-96bf-978616479db4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:15.155284 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df147008-2c0c-4a4c-82f7-050c2d285063 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:15.161609 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device bc80e20d-ce6c-46ea-9b97-f2f29d502b95 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:41:15.166184 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33726) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:15.215035 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-df147008-2c0c-4a4c-82f7-050c2d285063 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=8b80d55c0b2c49bbbdfc576b6e8db253&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1901221 Dec 09 21:41:15.215035 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df147008-2c0c-4a4c-82f7-050c2d285063 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7a1b10e5-f260-4a94-bf4e-93d0d054893e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:15.216164 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33730) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:15.266524 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-40580d52-5f56-4831-8f94-20702c9019ea admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:15.283815 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e762009c-c831-4cbb-8e9a-d6193b6c40ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:15.288901 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4f4d1a6b-d278-4c0c-96bf-978616479db4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:15.295359 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-40580d52-5f56-4831-8f94-20702c9019ea admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:15.360441 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a898c8ac-7c1e-408f-a048-65c3bc2f2d82 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:15.394399 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-40580d52-5f56-4831-8f94-20702c9019ea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:15.397425 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-40580d52-5f56-4831-8f94-20702c9019ea admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:15.401038 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-40580d52-5f56-4831-8f94-20702c9019ea admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/7a1b10e5-f260-4a94-bf4e-93d0d054893e HTTP/1.1" status: 204 len: 168 time: 0.1815147 Dec 09 21:41:15.418629 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40580d52-5f56-4831-8f94-20702c9019ea admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7a1b10e5-f260-4a94-bf4e-93d0d054893e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:15.419483 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port bc80e20d-ce6c-46ea-9b97-f2f29d502b95, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=bc80e20d-ce6c-46ea-9b97-f2f29d502b95,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:41:15.472131 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163fe7db-0287-4900-a17f-2a0204c1e65d req-86327e14-aa4a-43fd-be0a-cdc7fb0fe2bf tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:15.473722 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-163fe7db-0287-4900-a17f-2a0204c1e65d req-86327e14-aa4a-43fd-be0a-cdc7fb0fe2bf tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.0923009 Dec 09 21:41:15.476641 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4f4d1a6b-d278-4c0c-96bf-978616479db4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:15.486037 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'bc80e20d-ce6c-46ea-9b97-f2f29d502b95', 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff', 'port_id': 'bc80e20d-ce6c-46ea-9b97-f2f29d502b95', 'mac_address': 'fa:16:3e:78:89:e7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b61ac70f-1e8d-40a8-9031-bab15f73fa0a', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server [None req-e762009c-c831-4cbb-8e9a-d6193b6c40ff None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet b8086acf-29ea-4929-92cc-c7fbea767ad5: This subnet is being modified by another concurrent operation. Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 306, in create_dhcp_port Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1485, in create_port Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1450, in _create_port_db Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1460, in create_port_db Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnet.lock_register( Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise exception Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet b8086acf-29ea-4929-92cc-c7fbea767ad5: This subnet is being modified by another concurrent operation. Dec 09 21:41:15.491421 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Dec 09 21:41:15.529005 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f4d1a6b-d278-4c0c-96bf-978616479db4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Subnet': ['ID=b8086acf-29ea-4929-92cc-c7fbea767ad5,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:15.547236 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1be1ef3c-fbcd-4260-aff6-45d8ebaca453 None None] Network 43b151ca-a0e7-448d-8939-2c8a14a8d9ad requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:41:15.590853 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a898c8ac-7c1e-408f-a048-65c3bc2f2d82 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:15.595609 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:15.647215 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bc80e20d-ce6c-46ea-9b97-f2f29d502b95 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:41:15.708972 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port bc80e20d-ce6c-46ea-9b97-f2f29d502b95, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=bc80e20d-ce6c-46ea-9b97-f2f29d502b95,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:41:15.716651 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-acc5a68e-95e2-427e-bda4-91406f65f977 None None] Network 43b151ca-a0e7-448d-8939-2c8a14a8d9ad requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:41:15.734988 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:15.850312 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=bc80e20d-ce6c-46ea-9b97-f2f29d502b95,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:15.859264 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3cb28146-089d-43d0-a6b8-6583ae92d030 None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 21:41:15.940010 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3cb28146-089d-43d0-a6b8-6583ae92d030 None None] Resources bound (agent type, host, resource id): {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 09 21:41:16.025478 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['bc80e20d-ce6c-46ea-9b97-f2f29d502b95'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:41:16.046777 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a898c8ac-7c1e-408f-a048-65c3bc2f2d82 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:16.052867 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4f4d1a6b-d278-4c0c-96bf-978616479db4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:16.123727 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-163fe7db-0287-4900-a17f-2a0204c1e65d req-da93018a-4567-461d-8f8e-7d0832d092ba tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6311834 Dec 09 21:41:16.125945 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-4f4d1a6b-d278-4c0c-96bf-978616479db4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['43b151ca-a0e7-448d-8939-2c8a14a8d9ad']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:41:16.148924 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a898c8ac-7c1e-408f-a048-65c3bc2f2d82 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ad0d84325b6f4557ab6b0afe58ba24f4&name=default HTTP/1.1" status: 200 len: 3000 time: 0.9816012 Dec 09 21:41:16.151960 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33762) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:16.155374 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-4f4d1a6b-d278-4c0c-96bf-978616479db4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd74f8b97-a5f4-4a67-bcba-f811c7357740') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:41:16.155717 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-4f4d1a6b-d278-4c0c-96bf-978616479db4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd74f8b97-a5f4-4a67-bcba-f811c7357740') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:41:16.157616 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a898c8ac-7c1e-408f-a048-65c3bc2f2d82 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2fa34cb6-302d-4a46-822c-02139af8b3d8,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:16.168221 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4f4d1a6b-d278-4c0c-96bf-978616479db4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:16.193083 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4f4d1a6b-d278-4c0c-96bf-978616479db4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:16.209352 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4f4d1a6b-d278-4c0c-96bf-978616479db4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Releasing vlan 108 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:41:16.210616 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4f4d1a6b-d278-4c0c-96bf-978616479db4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:41:16.215341 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:41:16.253398 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aba7baeb-a48e-4975-a786-bff9b3a0c092 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:16.285895 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aba7baeb-a48e-4975-a786-bff9b3a0c092 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:16.343344 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4f4d1a6b-d278-4c0c-96bf-978616479db4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:16.372924 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4f4d1a6b-d278-4c0c-96bf-978616479db4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:16.383786 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4f4d1a6b-d278-4c0c-96bf-978616479db4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/networks/43b151ca-a0e7-448d-8939-2c8a14a8d9ad HTTP/1.1" status: 204 len: 168 time: 1.3568268 Dec 09 21:41:16.385261 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33776) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:16.395620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f4d1a6b-d278-4c0c-96bf-978616479db4 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Network': ['ID=43b151ca-a0e7-448d-8939-2c8a14a8d9ad,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:16.417345 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afd92020-6397-4594-aa37-1acdfb7554a4 req-3df7ed40-0884-4130-abb3-a5d1f7ff38b3 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:16.418927 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-afd92020-6397-4594-aa37-1acdfb7554a4 req-3df7ed40-0884-4130-abb3-a5d1f7ff38b3 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1af02f9f-8258-4145-b364-35ab02015e65 HTTP/1.1" status: 200 len: 945 time: 0.1262360 Dec 09 21:41:16.437152 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aba7baeb-a48e-4975-a786-bff9b3a0c092 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:16.440306 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aba7baeb-a48e-4975-a786-bff9b3a0c092 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:16.441668 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-aba7baeb-a48e-4975-a786-bff9b3a0c092 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/2fa34cb6-302d-4a46-822c-02139af8b3d8 HTTP/1.1" status: 204 len: 168 time: 0.2885895 Dec 09 21:41:16.442969 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-21d6a750-b1b5-4105-848d-933630ea68e6 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] DELETE failed (client error): The resource could not be found. Dec 09 21:41:16.443706 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-21d6a750-b1b5-4105-848d-933630ea68e6 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:41:16.447850 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-21d6a750-b1b5-4105-848d-933630ea68e6 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/subnets/b8086acf-29ea-4929-92cc-c7fbea767ad5 HTTP/1.1" status: 404 len: 337 time: 0.0463574 Dec 09 21:41:16.450760 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33780) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:16.457693 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aba7baeb-a48e-4975-a786-bff9b3a0c092 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2fa34cb6-302d-4a46-822c-02139af8b3d8,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:16.495274 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-0142876d-57e6-4a0e-9e6e-c778da1780c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] DELETE failed (client error): The resource could not be found. Dec 09 21:41:16.495854 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0142876d-57e6-4a0e-9e6e-c778da1780c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:41:16.499250 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0142876d-57e6-4a0e-9e6e-c778da1780c2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/networks/43b151ca-a0e7-448d-8939-2c8a14a8d9ad HTTP/1.1" status: 404 len: 339 time: 0.0428877 Dec 09 21:41:16.502264 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33786) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:16.505355 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-afd92020-6397-4594-aa37-1acdfb7554a4 req-974c2f7b-ae42-4e63-8c29-26a6da3a910c tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0790200 Dec 09 21:41:16.539585 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-60b1ce48-67e5-423b-a09c-1f5553f5220a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] DELETE failed (client error): The resource could not be found. Dec 09 21:41:16.540136 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-60b1ce48-67e5-423b-a09c-1f5553f5220a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:41:16.544087 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-60b1ce48-67e5-423b-a09c-1f5553f5220a tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/subnets/3f8b3ef9-80fe-4461-8ca6-64ccfd4e6542 HTTP/1.1" status: 404 len: 337 time: 0.0407925 Dec 09 21:41:16.546748 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33788) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:16.566414 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-94800868-e0c9-46e4-aea8-be1cc17a3828 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] DELETE failed (client error): The resource could not be found. Dec 09 21:41:16.567132 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-94800868-e0c9-46e4-aea8-be1cc17a3828 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:41:16.570359 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-94800868-e0c9-46e4-aea8-be1cc17a3828 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/networks/fcb89980-b226-43fe-840b-071838388b4c HTTP/1.1" status: 404 len: 339 time: 0.0220644 Dec 09 21:41:16.572860 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33790) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:16.701432 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bc51164e-fb42-47d9-baa1-3472fbe0716f tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:16.807410 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bc51164e-fb42-47d9-baa1-3472fbe0716f tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:16.832924 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-bc51164e-fb42-47d9-baa1-3472fbe0716f tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['767a99b1-a304-41bf-99fc-0f3917285cdd']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:41:16.849089 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-bc51164e-fb42-47d9-baa1-3472fbe0716f tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '40514f38-fb79-4bd9-9f26-71f2676048cd') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:41:16.849367 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-bc51164e-fb42-47d9-baa1-3472fbe0716f tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '40514f38-fb79-4bd9-9f26-71f2676048cd') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:41:16.860851 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bc51164e-fb42-47d9-baa1-3472fbe0716f tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:16.877869 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bc51164e-fb42-47d9-baa1-3472fbe0716f tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:16.886482 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bc51164e-fb42-47d9-baa1-3472fbe0716f tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Releasing vlan 131 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:41:16.887140 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bc51164e-fb42-47d9-baa1-3472fbe0716f tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:41:16.891830 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:41:16.938801 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33810) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:16.961679 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af2e3e72-4869-4350-ab76-2656c8ab422f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:16.983907 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bc51164e-fb42-47d9-baa1-3472fbe0716f tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:16.997208 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bc51164e-fb42-47d9-baa1-3472fbe0716f tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:17.005033 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bc51164e-fb42-47d9-baa1-3472fbe0716f tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/networks/767a99b1-a304-41bf-99fc-0f3917285cdd HTTP/1.1" status: 204 len: 168 time: 0.4296622 Dec 09 21:41:17.005504 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33814) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:17.021609 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc51164e-fb42-47d9-baa1-3472fbe0716f tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Network': ['ID=767a99b1-a304-41bf-99fc-0f3917285cdd,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:17.048655 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-ab9e196e-557c-425c-9733-69fb5b941eb8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] DELETE failed (client error): The resource could not be found. Dec 09 21:41:17.049131 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ab9e196e-557c-425c-9733-69fb5b941eb8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:41:17.055059 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ab9e196e-557c-425c-9733-69fb5b941eb8 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/subnets/9e721d49-cbda-432b-b209-a88f69b564b5 HTTP/1.1" status: 404 len: 337 time: 0.0489800 Dec 09 21:41:17.055241 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33816) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:17.082768 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:41:17.087207 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-4c9f03f0-aaa1-43fa-91fe-b38c029bf8ae tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] DELETE failed (client error): The resource could not be found. Dec 09 21:41:17.087769 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4c9f03f0-aaa1-43fa-91fe-b38c029bf8ae tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:41:17.093490 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4c9f03f0-aaa1-43fa-91fe-b38c029bf8ae tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/networks/4676bda5-e890-4e7b-acd7-17850cfdee02 HTTP/1.1" status: 404 len: 339 time: 0.0343513 Dec 09 21:41:17.094687 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33818) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:17.118151 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af2e3e72-4869-4350-ab76-2656c8ab422f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:17.122991 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af2e3e72-4869-4350-ab76-2656c8ab422f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:17.136228 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-ac4b120d-ab3d-4cf5-85da-2f111d6a694d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] DELETE failed (client error): The resource could not be found. Dec 09 21:41:17.136683 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ac4b120d-ab3d-4cf5-85da-2f111d6a694d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:41:17.140770 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ac4b120d-ab3d-4cf5-85da-2f111d6a694d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/subnets/d01a308a-9d09-4975-b761-8c3621819157 HTTP/1.1" status: 404 len: 337 time: 0.0443170 Dec 09 21:41:17.142710 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33824) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:17.163817 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-de9119ec-a72b-4d54-825d-ef6455aaac1d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] DELETE failed (client error): The resource could not be found. Dec 09 21:41:17.164558 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-de9119ec-a72b-4d54-825d-ef6455aaac1d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:41:17.167802 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-de9119ec-a72b-4d54-825d-ef6455aaac1d tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/networks/a865adfb-a17f-4de7-9350-96f432f3545c HTTP/1.1" status: 404 len: 339 time: 0.0234525 Dec 09 21:41:17.170261 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33826) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:17.177027 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device bc80e20d-ce6c-46ea-9b97-f2f29d502b95 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:41:17.197817 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af2e3e72-4869-4350-ab76-2656c8ab422f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c02492a2-1576-4265-ae8a-4cd0c83c56ed,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:17.243135 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-5d7f7ea7-e482-45e8-b794-1547df393399 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] DELETE failed (client error): The resource could not be found. Dec 09 21:41:17.243626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5d7f7ea7-e482-45e8-b794-1547df393399 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:41:17.246504 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-af2e3e72-4869-4350-ab76-2656c8ab422f admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e567d6878f534d058236a1482d8c879d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3060815 Dec 09 21:41:17.249278 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5d7f7ea7-e482-45e8-b794-1547df393399 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/subnets/3049fffa-9600-49dc-ad94-798088a7d98e HTTP/1.1" status: 404 len: 337 time: 0.0592673 Dec 09 21:41:17.249613 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33832) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:17.252098 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33834) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:17.281030 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port bc80e20d-ce6c-46ea-9b97-f2f29d502b95 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:41:17.285035 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port bc80e20d-ce6c-46ea-9b97-f2f29d502b95 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:41:17.285404 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:17.300120 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-427c38e7-cb23-46e0-8e88-bfd40f5d7e8c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] DELETE failed (client error): The resource could not be found. Dec 09 21:41:17.300680 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-427c38e7-cb23-46e0-8e88-bfd40f5d7e8c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:41:17.303898 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-427c38e7-cb23-46e0-8e88-bfd40f5d7e8c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/networks/667ea4bb-728a-4975-98aa-c60333b2231d HTTP/1.1" status: 404 len: 339 time: 0.0487638 Dec 09 21:41:17.307098 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33838) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:17.344154 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83fa990f-7188-48e1-9b2b-d8fd0a73328b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:17.347232 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-22f0ec6c-6823-456f-9d13-df3ae628cad5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] DELETE failed (client error): The resource could not be found. Dec 09 21:41:17.347915 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-22f0ec6c-6823-456f-9d13-df3ae628cad5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:41:17.354155 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-22f0ec6c-6823-456f-9d13-df3ae628cad5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/subnets/906bd6a0-1e59-4689-90d6-2d09dbdb9070 HTTP/1.1" status: 404 len: 337 time: 0.0457363 Dec 09 21:41:17.358461 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33842) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:17.390134 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-bdbd1658-ee7c-42d3-826c-ccc846050ce2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] DELETE failed (client error): The resource could not be found. Dec 09 21:41:17.391192 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-bdbd1658-ee7c-42d3-826c-ccc846050ce2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:41:17.395412 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bdbd1658-ee7c-42d3-826c-ccc846050ce2 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/networks/ed0707dd-685f-47b2-a0b6-f9fccdf89e1f HTTP/1.1" status: 404 len: 339 time: 0.0295668 Dec 09 21:41:17.399696 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33844) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:17.402618 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d5c76f3-654b-4d85-a5df-060c21a5698f req-196dd653-31a1-4acd-a682-230bdc49bed4 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:17.413528 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d5c76f3-654b-4d85-a5df-060c21a5698f req-196dd653-31a1-4acd-a682-230bdc49bed4 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1594286 Dec 09 21:41:17.433215 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:17.436963 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83fa990f-7188-48e1-9b2b-d8fd0a73328b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:17.439182 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-642672bd-97d6-4957-b93f-484827ef5349 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] DELETE failed (client error): The resource could not be found. Dec 09 21:41:17.439670 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-642672bd-97d6-4957-b93f-484827ef5349 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:41:17.442741 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-642672bd-97d6-4957-b93f-484827ef5349 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/subnets/d15de741-dbcd-4ce6-b85a-4ea8263ad71e HTTP/1.1" status: 404 len: 337 time: 0.0419521 Dec 09 21:41:17.448883 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33848) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:17.469250 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-0e66a9a2-914f-4f0e-8303-886c071e4545 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] DELETE failed (client error): The resource could not be found. Dec 09 21:41:17.469665 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0e66a9a2-914f-4f0e-8303-886c071e4545 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:41:17.475405 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0e66a9a2-914f-4f0e-8303-886c071e4545 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/networks/d0a9c0a3-348f-41dc-b938-0b6edb8ab271 HTTP/1.1" status: 404 len: 339 time: 0.0240369 Dec 09 21:41:17.476164 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33850) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:17.478901 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1af02f9f-8258-4145-b364-35ab02015e65', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bc80e20d-ce6c-46ea-9b97-f2f29d502b95'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:41:17.482314 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-00f6b9d1-71d6-4d8c-b1f0-099c9f7a2a0b" -d '{"events": [{"server_uuid": "1af02f9f-8258-4145-b364-35ab02015e65", "name": "network-vif-plugged", "status": "completed", "tag": "bc80e20d-ce6c-46ea-9b97-f2f29d502b95"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:41:17.495959 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port bc80e20d-ce6c-46ea-9b97-f2f29d502b95, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=bc80e20d-ce6c-46ea-9b97-f2f29d502b95,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:41:17.504286 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:17.526592 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d5c76f3-654b-4d85-a5df-060c21a5698f req-cd66ee48-bd04-4e2a-ae0b-949f218875f1 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1120067 Dec 09 21:41:17.548915 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-d237e6b6-67b6-4ac0-aa6d-979d9d50f212 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] DELETE failed (client error): The resource could not be found. Dec 09 21:41:17.548915 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d237e6b6-67b6-4ac0-aa6d-979d9d50f212 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:41:17.548915 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d237e6b6-67b6-4ac0-aa6d-979d9d50f212 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/subnets/56e878a5-ca09-40a2-9a11-b6ea0d07443b HTTP/1.1" status: 404 len: 337 time: 0.0665133 Dec 09 21:41:17.548915 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33858) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:17.575066 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-44487f5e-d6e1-407c-960c-5b7dc662de50 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] DELETE failed (client error): The resource could not be found. Dec 09 21:41:17.576096 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-44487f5e-d6e1-407c-960c-5b7dc662de50 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:41:17.579816 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-44487f5e-d6e1-407c-960c-5b7dc662de50 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/networks/1cfafc03-a00a-4988-b227-f3b31e5bca30 HTTP/1.1" status: 404 len: 339 time: 0.0311794 Dec 09 21:41:17.582391 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33860) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:17.614708 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:41:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a89ca14c-2055-4462-b591-f4316faa0108 x-openstack-request-id: req-a89ca14c-2055-4462-b591-f4316faa0108 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:41:17.617858 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1af02f9f-8258-4145-b364-35ab02015e65", "name": "network-vif-plugged", "status": "completed", "tag": "bc80e20d-ce6c-46ea-9b97-f2f29d502b95", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:41:17.618128 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a89ca14c-2055-4462-b591-f4316faa0108 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:41:17.618868 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1af02f9f-8258-4145-b364-35ab02015e65', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bc80e20d-ce6c-46ea-9b97-f2f29d502b95', 'code': 200} Dec 09 21:41:17.625536 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=bc80e20d-ce6c-46ea-9b97-f2f29d502b95,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:17.632603 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-443a3545-8ce8-4a07-94c4-70a3340a00e7 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] DELETE failed (client error): The resource could not be found. Dec 09 21:41:17.633079 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-443a3545-8ce8-4a07-94c4-70a3340a00e7 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:41:17.637409 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-443a3545-8ce8-4a07-94c4-70a3340a00e7 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/subnets/509dccb9-131a-4307-8b51-6e6460c1c10a HTTP/1.1" status: 404 len: 337 time: 0.0535519 Dec 09 21:41:17.638956 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83fa990f-7188-48e1-9b2b-d8fd0a73328b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:17.641009 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33866) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:17.642049 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83fa990f-7188-48e1-9b2b-d8fd0a73328b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:17.644037 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-83fa990f-7188-48e1-9b2b-d8fd0a73328b admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/c02492a2-1576-4265-ae8a-4cd0c83c56ed HTTP/1.1" status: 204 len: 168 time: 0.3927820 Dec 09 21:41:17.653524 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83fa990f-7188-48e1-9b2b-d8fd0a73328b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c02492a2-1576-4265-ae8a-4cd0c83c56ed,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:17.705804 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-5dee5da9-888a-4ff3-8372-70d862a5ac28 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] DELETE failed (client error): The resource could not be found. Dec 09 21:41:17.706458 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5dee5da9-888a-4ff3-8372-70d862a5ac28 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:41:17.711203 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5dee5da9-888a-4ff3-8372-70d862a5ac28 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/networks/d215b568-30c6-4d22-8443-503f2b0c1fb5 HTTP/1.1" status: 404 len: 339 time: 0.0689607 Dec 09 21:41:17.714662 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33872) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:17.781380 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-50469d77-e8a7-4495-8b48-7d5c672cd414 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] DELETE failed (client error): The resource could not be found. Dec 09 21:41:17.781850 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-50469d77-e8a7-4495-8b48-7d5c672cd414 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:41:17.785629 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-50469d77-e8a7-4495-8b48-7d5c672cd414 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/subnets/3b92e14d-ae1e-4c04-b429-1f3b54ff410a HTTP/1.1" status: 404 len: 337 time: 0.0691917 Dec 09 21:41:17.787707 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33876) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:17.813614 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-eea26d9c-d8f9-41d6-a25a-77fa6f1505e5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] DELETE failed (client error): The resource could not be found. Dec 09 21:41:17.814241 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-eea26d9c-d8f9-41d6-a25a-77fa6f1505e5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:41:17.818547 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-eea26d9c-d8f9-41d6-a25a-77fa6f1505e5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/networks/682fa031-32a5-4912-90b9-b7b4ae53eab1 HTTP/1.1" status: 404 len: 339 time: 0.0292275 Dec 09 21:41:17.821272 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33878) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:17.869194 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7753432d-6b9a-4f09-902f-47ca543b6a10 req-787d856c-9195-4271-9c59-326617aea412 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:17.873792 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7753432d-6b9a-4f09-902f-47ca543b6a10 req-787d856c-9195-4271-9c59-326617aea412 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=1af02f9f-8258-4145-b364-35ab02015e65 HTTP/1.1" status: 200 len: 1098 time: 0.1399755 Dec 09 21:41:17.903163 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-255d7c04-8017-427f-99c1-d320b048ca5c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Deleting subnet 24c8e276-4190-4038-8903-43f80ae0e34a {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:41:17.907564 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fdd0566-58fa-4244-91b1-8438990b7354 req-f15ec14f-16ac-4758-9e73-4190e3e0c57d tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:17.908807 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-255d7c04-8017-427f-99c1-d320b048ca5c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:17.909989 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6fdd0566-58fa-4244-91b1-8438990b7354 req-f15ec14f-16ac-4758-9e73-4190e3e0c57d tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1af02f9f-8258-4145-b364-35ab02015e65 HTTP/1.1" status: 200 len: 946 time: 0.1600235 Dec 09 21:41:17.985056 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7753432d-6b9a-4f09-902f-47ca543b6a10 req-42154578-9ccb-4965-b5f7-2794eb1c6ba0 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1014817 Dec 09 21:41:18.010188 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-255d7c04-8017-427f-99c1-d320b048ca5c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:18.048144 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6fdd0566-58fa-4244-91b1-8438990b7354 req-2cb7c425-6456-4624-82c9-cc1d74998fc4 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1264398 Dec 09 21:41:18.157913 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-255d7c04-8017-427f-99c1-d320b048ca5c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:18.236346 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-255d7c04-8017-427f-99c1-d320b048ca5c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:18.284308 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-255d7c04-8017-427f-99c1-d320b048ca5c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:18.293017 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33890) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:18.294743 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-969c3c86-1157-4ef0-92a8-c66899ba4bcb None None] Network 5fa22bcb-aab0-4d2e-acc0-554514c04095 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:41:18.306234 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-255d7c04-8017-427f-99c1-d320b048ca5c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/subnets/24c8e276-4190-4038-8903-43f80ae0e34a HTTP/1.1" status: 204 len: 168 time: 0.4836445 Dec 09 21:41:18.307556 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-255d7c04-8017-427f-99c1-d320b048ca5c tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Subnet': ['ID=24c8e276-4190-4038-8903-43f80ae0e34a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:18.432141 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-27e24622-734d-4d2d-a115-d250709fb9d5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:18.491886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-27e24622-734d-4d2d-a115-d250709fb9d5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Deleting port cf84fc46-3581-4fe7-a325-790de85d63a8 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:41:18.493558 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-27e24622-734d-4d2d-a115-d250709fb9d5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:18.527183 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cfe10e0b-1df9-4bc5-a313-6e73744fe181 None None] DHCP port deletion for 5fa22bcb-aab0-4d2e-acc0-554514c04095 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:41:18.592132 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-27e24622-734d-4d2d-a115-d250709fb9d5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] For port cf84fc46-3581-4fe7-a325-790de85d63a8, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=cf84fc46-3581-4fe7-a325-790de85d63a8,segment=NetworkSegment(e3897138-5662-4ad4-be68-fd266660ce00),segment_id=e3897138-5662-4ad4-be68-fd266660ce00)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:41:18.592540 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-27e24622-734d-4d2d-a115-d250709fb9d5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:18.614787 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-27e24622-734d-4d2d-a115-d250709fb9d5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Calling delete_port for cf84fc46-3581-4fe7-a325-790de85d63a8 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:41:18.641992 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-cfe10e0b-1df9-4bc5-a313-6e73744fe181 None None] Deleting port cf84fc46-3581-4fe7-a325-790de85d63a8 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:41:18.642379 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cfe10e0b-1df9-4bc5-a313-6e73744fe181 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:18.721405 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6b1fe87-414a-45e1-98fa-740e2d0e3d3b req-e46ad348-7ffe-4857-ac83-15af1ed23d3c tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:18.722962 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d6b1fe87-414a-45e1-98fa-740e2d0e3d3b req-e46ad348-7ffe-4857-ac83-15af1ed23d3c tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.0965841 Dec 09 21:41:18.728124 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-cfe10e0b-1df9-4bc5-a313-6e73744fe181 None None] For port cf84fc46-3581-4fe7-a325-790de85d63a8, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=cf84fc46-3581-4fe7-a325-790de85d63a8,segment=NetworkSegment(e3897138-5662-4ad4-be68-fd266660ce00),segment_id=e3897138-5662-4ad4-be68-fd266660ce00)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:41:18.728712 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cfe10e0b-1df9-4bc5-a313-6e73744fe181 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:18.747787 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-cfe10e0b-1df9-4bc5-a313-6e73744fe181 None None] Calling delete_port for cf84fc46-3581-4fe7-a325-790de85d63a8 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:41:18.764955 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-27e24622-734d-4d2d-a115-d250709fb9d5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:18.808341 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27e24622-734d-4d2d-a115-d250709fb9d5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Port': ['ID=cf84fc46-3581-4fe7-a325-790de85d63a8,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:18.810386 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27e24622-734d-4d2d-a115-d250709fb9d5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] No DVR routers for this DVR port cf84fc46-3581-4fe7-a325-790de85d63a8 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:41:18.829060 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d6b1fe87-414a-45e1-98fa-740e2d0e3d3b req-7a0281d8-c47a-4e0b-af74-8fdb3d74a94a tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0944180 Dec 09 21:41:18.889437 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cfe10e0b-1df9-4bc5-a313-6e73744fe181 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:18.905329 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cfe10e0b-1df9-4bc5-a313-6e73744fe181 None None] No DVR routers for this DVR port cf84fc46-3581-4fe7-a325-790de85d63a8 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:41:18.932797 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-27e24622-734d-4d2d-a115-d250709fb9d5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:18.953288 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfe10e0b-1df9-4bc5-a313-6e73744fe181 None None] Pushing event deleted for resources: {'Port': ['ID=cf84fc46-3581-4fe7-a325-790de85d63a8,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:18.971068 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-27e24622-734d-4d2d-a115-d250709fb9d5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5fa22bcb-aab0-4d2e-acc0-554514c04095']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:41:18.981807 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-27e24622-734d-4d2d-a115-d250709fb9d5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e3897138-5662-4ad4-be68-fd266660ce00') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:41:18.982109 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-27e24622-734d-4d2d-a115-d250709fb9d5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e3897138-5662-4ad4-be68-fd266660ce00') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:41:19.001790 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-27e24622-734d-4d2d-a115-d250709fb9d5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:19.022119 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-27e24622-734d-4d2d-a115-d250709fb9d5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:19.031197 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-27e24622-734d-4d2d-a115-d250709fb9d5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Releasing vlan 129 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:41:19.031768 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-27e24622-734d-4d2d-a115-d250709fb9d5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:41:19.035223 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:41:19.124860 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-27e24622-734d-4d2d-a115-d250709fb9d5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:19.133711 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-27e24622-734d-4d2d-a115-d250709fb9d5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:19.140229 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-27e24622-734d-4d2d-a115-d250709fb9d5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] 10.222.0.13 "DELETE /v2.0/networks/5fa22bcb-aab0-4d2e-acc0-554514c04095 HTTP/1.1" status: 204 len: 168 time: 0.8422155 Dec 09 21:41:19.167817 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27e24622-734d-4d2d-a115-d250709fb9d5 tempest-NetworksTest-713326982 tempest-NetworksTest-713326982-project] Pushing event deleted for resources: {'Network': ['ID=5fa22bcb-aab0-4d2e-acc0-554514c04095,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:19.214022 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-521b7c10-eb99-46ff-aa21-fcb055c9785d req-ce9bd104-698e-487b-a600-33964d9e9de8 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:19.215682 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-521b7c10-eb99-46ff-aa21-fcb055c9785d req-ce9bd104-698e-487b-a600-33964d9e9de8 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1af02f9f-8258-4145-b364-35ab02015e65 HTTP/1.1" status: 200 len: 946 time: 0.0578637 Dec 09 21:41:19.231626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33922) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:19.284519 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-521b7c10-eb99-46ff-aa21-fcb055c9785d req-7f0732e2-3a7c-4f86-a330-b013716a087a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0617251 Dec 09 21:41:19.374949 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bfac0d48-24ff-43ce-a2dc-65aac1d5f7e3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:19.465407 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bfac0d48-24ff-43ce-a2dc-65aac1d5f7e3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:19.475957 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bfac0d48-24ff-43ce-a2dc-65aac1d5f7e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:19.499780 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33932) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:19.530624 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfac0d48-24ff-43ce-a2dc-65aac1d5f7e3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2d450f24-900a-4575-a445-78638b10d052,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:19.535265 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bfac0d48-24ff-43ce-a2dc-65aac1d5f7e3 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=7a1d68cc5baa492f8785148148099a5f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3023779 Dec 09 21:41:19.538683 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33936) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:19.598560 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd2d83e0-cb8c-4c8f-92e9-9d8d22775c74 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:19.630422 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd2d83e0-cb8c-4c8f-92e9-9d8d22775c74 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:19.694790 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8731f956-8415-4a85-914a-3925c2ba4e53 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=8d03fcad771c485fa5e2c1775828f3a7&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1931098 Dec 09 21:41:19.697941 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33944) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:19.719591 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd2d83e0-cb8c-4c8f-92e9-9d8d22775c74 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:19.722206 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd2d83e0-cb8c-4c8f-92e9-9d8d22775c74 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:19.725770 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fd2d83e0-cb8c-4c8f-92e9-9d8d22775c74 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/2d450f24-900a-4575-a445-78638b10d052 HTTP/1.1" status: 204 len: 168 time: 0.1839349 Dec 09 21:41:19.732161 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd2d83e0-cb8c-4c8f-92e9-9d8d22775c74 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2d450f24-900a-4575-a445-78638b10d052,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:19.765427 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f5abdfb-81eb-4541-850b-074593dd2937 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:19.789380 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f5abdfb-81eb-4541-850b-074593dd2937 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:19.851113 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f5abdfb-81eb-4541-850b-074593dd2937 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:19.854884 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f5abdfb-81eb-4541-850b-074593dd2937 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:19.860491 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7f5abdfb-81eb-4541-850b-074593dd2937 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/8eb97a37-262f-4b7a-a32a-bc5fc1baeb93 HTTP/1.1" status: 204 len: 168 time: 0.1605392 Dec 09 21:41:19.887692 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f5abdfb-81eb-4541-850b-074593dd2937 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8eb97a37-262f-4b7a-a32a-bc5fc1baeb93,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:19.986420 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05130d13-8a32-43cb-a112-8da05b212e6d req-046956d9-f362-48d7-9d57-34ba3d42f5fc tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:19.988178 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-05130d13-8a32-43cb-a112-8da05b212e6d req-046956d9-f362-48d7-9d57-34ba3d42f5fc tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.0674510 Dec 09 21:41:20.052983 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-05130d13-8a32-43cb-a112-8da05b212e6d req-c6ff223f-546d-4fd2-a6e9-3aae51339820 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0581989 Dec 09 21:41:20.108910 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33960) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:20.122464 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4664fba3-5ceb-4566-86f4-3e8119e48198 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:20.207422 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4664fba3-5ceb-4566-86f4-3e8119e48198 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:20.213104 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4664fba3-5ceb-4566-86f4-3e8119e48198 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:20.268037 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4664fba3-5ceb-4566-86f4-3e8119e48198 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=28b4b4e39bad4eea965cbc6c1ab1067e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1577737 Dec 09 21:41:20.271324 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33970) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:20.272307 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4664fba3-5ceb-4566-86f4-3e8119e48198 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b89d0483-edfc-45a5-a847-8eecbcac6ef8,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:20.297615 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device cf84fc46-3581-4fe7-a325-790de85d63a8 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:41:20.323787 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: cf84fc46-3581-4fe7-a325-790de85d63a8 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:41:20.323787 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device cf84fc46-3581-4fe7-a325-790de85d63a8 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:41:20.352694 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1308a2e1-342a-4882-bcfe-4e904a7d6891 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:20.380025 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1308a2e1-342a-4882-bcfe-4e904a7d6891 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:20.433200 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6388bb97-e32f-4f06-913e-80fba702177b req-0ab0cadb-18ee-463f-8212-7116c4245bef tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:20.435736 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6388bb97-e32f-4f06-913e-80fba702177b req-0ab0cadb-18ee-463f-8212-7116c4245bef tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1af02f9f-8258-4145-b364-35ab02015e65 HTTP/1.1" status: 200 len: 946 time: 0.0650749 Dec 09 21:41:20.454013 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1308a2e1-342a-4882-bcfe-4e904a7d6891 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:20.459892 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1308a2e1-342a-4882-bcfe-4e904a7d6891 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:20.461275 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1308a2e1-342a-4882-bcfe-4e904a7d6891 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/b89d0483-edfc-45a5-a847-8eecbcac6ef8 HTTP/1.1" status: 204 len: 168 time: 0.1888528 Dec 09 21:41:20.470821 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1308a2e1-342a-4882-bcfe-4e904a7d6891 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b89d0483-edfc-45a5-a847-8eecbcac6ef8,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:20.512334 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6388bb97-e32f-4f06-913e-80fba702177b req-228f7272-bb30-4f52-9713-5b4ddeee174b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0651834 Dec 09 21:41:20.664044 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2666740-4994-49b9-bbcd-3566cf3af305 req-a9723557-8a70-4ce9-86b2-f5f8e343735a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:20.665658 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b2666740-4994-49b9-bbcd-3566cf3af305 req-a9723557-8a70-4ce9-86b2-f5f8e343735a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1af02f9f-8258-4145-b364-35ab02015e65 HTTP/1.1" status: 200 len: 946 time: 0.0635359 Dec 09 21:41:20.739532 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b2666740-4994-49b9-bbcd-3566cf3af305 req-788b6aca-7c1e-4953-b56d-7e6924eb2886 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0637798 Dec 09 21:41:20.925640 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4aade5d1-cc2d-485d-8e99-308de352ae8d req-91237a4e-19c0-4d13-8e08-9ac47217d5c1 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0774016 Dec 09 21:41:21.056178 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aade5d1-cc2d-485d-8e99-308de352ae8d req-fc18ff71-766f-4b14-9bdc-bb65d1f64d08 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:21.057694 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4aade5d1-cc2d-485d-8e99-308de352ae8d req-fc18ff71-766f-4b14-9bdc-bb65d1f64d08 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=69d79e96ec1c418aa6c619846f0fe02e&device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 1097 time: 0.0689912 Dec 09 21:41:21.183686 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-239cff40-7556-4d16-93ef-d4271763617d req-a2a03701-44f5-4286-b854-daa8074b7f9a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:21.185958 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-239cff40-7556-4d16-93ef-d4271763617d req-a2a03701-44f5-4286-b854-daa8074b7f9a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1af02f9f-8258-4145-b364-35ab02015e65 HTTP/1.1" status: 200 len: 946 time: 0.1004429 Dec 09 21:41:21.244450 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aade5d1-cc2d-485d-8e99-308de352ae8d req-f266d4d1-5c18-4502-a85a-bbfac23f9799 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:21.245969 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4aade5d1-cc2d-485d-8e99-308de352ae8d req-f266d4d1-5c18-4502-a85a-bbfac23f9799 service neutron] 10.222.0.10 "GET /v2.0/networks?id=71038cd4-0600-4b06-91f9-ae7f4f4807f9 HTTP/1.1" status: 200 len: 920 time: 0.1523988 Dec 09 21:41:21.265944 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-239cff40-7556-4d16-93ef-d4271763617d req-3f470e48-3c45-4309-b7f2-b8c47ae1ce6c tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0717273 Dec 09 21:41:21.333724 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4aade5d1-cc2d-485d-8e99-308de352ae8d req-a93a0c0b-b2a1-4dce-8f0a-dd0f03a6bb9e service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=10ac5a10-4f73-4f89-b652-3c81390af0aa HTTP/1.1" status: 200 len: 217 time: 0.0795307 Dec 09 21:41:21.390934 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aade5d1-cc2d-485d-8e99-308de352ae8d req-dcecdd77-3dc4-405a-b9dc-87844dda6c38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:21.392659 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4aade5d1-cc2d-485d-8e99-308de352ae8d req-dcecdd77-3dc4-405a-b9dc-87844dda6c38 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=12d97cfc-9264-49cb-8e47-fd225cb6d30b HTTP/1.1" status: 200 len: 859 time: 0.0500674 Dec 09 21:41:21.414930 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71a0081c-e42f-4e3e-8867-c7de1196c506 req-0807d8a4-9218-4d73-a69a-dfa6158a1c29 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:21.424521 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71a0081c-e42f-4e3e-8867-c7de1196c506 req-0807d8a4-9218-4d73-a69a-dfa6158a1c29 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.0984426 Dec 09 21:41:21.452698 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4aade5d1-cc2d-485d-8e99-308de352ae8d req-163e7d4b-24fb-481b-8bdf-c64c9713f153 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=71038cd4-0600-4b06-91f9-ae7f4f4807f9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0519304 Dec 09 21:41:21.483950 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71a0081c-e42f-4e3e-8867-c7de1196c506 req-30e04967-c5d6-44ab-a53a-ef1122ca081d tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0579321 Dec 09 21:41:21.562495 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4aade5d1-cc2d-485d-8e99-308de352ae8d req-d82ef4f0-5a13-4bf8-97c8-89b63c0c8e78 service neutron] 10.222.0.10 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1023259 Dec 09 21:41:22.045404 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4aade5d1-cc2d-485d-8e99-308de352ae8d req-9f6caf15-cf80-4769-9330-55b90c2d0287 service neutron] 10.222.0.10 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4749010 Dec 09 21:41:22.210324 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34066) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:22.391936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f8fbb53-bcb3-4a39-b77e-81206dbd5248 req-c135597f-d3b7-4fea-98bd-1bf4ac498dd9 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:22.394050 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f8fbb53-bcb3-4a39-b77e-81206dbd5248 req-c135597f-d3b7-4fea-98bd-1bf4ac498dd9 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1af02f9f-8258-4145-b364-35ab02015e65 HTTP/1.1" status: 200 len: 946 time: 0.0533569 Dec 09 21:41:22.464824 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e297b59-4b73-456b-ad9a-dc4399a73e58 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:22.467980 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2861f1d-314c-40d2-bded-31b4363f231f req-f340bbd5-81ab-4f76-8e4a-41566c8f5db3 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:22.469520 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2861f1d-314c-40d2-bded-31b4363f231f req-f340bbd5-81ab-4f76-8e4a-41566c8f5db3 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "GET /v2.0/ports?device_id=1af02f9f-8258-4145-b364-35ab02015e65 HTTP/1.1" status: 200 len: 946 time: 0.0745711 Dec 09 21:41:22.489900 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f8fbb53-bcb3-4a39-b77e-81206dbd5248 req-5cfd79fe-6d56-45b5-b343-14c820e96895 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0862284 Dec 09 21:41:22.596651 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e297b59-4b73-456b-ad9a-dc4399a73e58 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:22.604120 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e297b59-4b73-456b-ad9a-dc4399a73e58 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:22.651547 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-a2861f1d-314c-40d2-bded-31b4363f231f req-7532f0c7-0d97-4786-9e10-cee51aa684fc tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Deleting port bc80e20d-ce6c-46ea-9b97-f2f29d502b95 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:41:22.651913 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a2861f1d-314c-40d2-bded-31b4363f231f req-7532f0c7-0d97-4786-9e10-cee51aa684fc tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:22.669069 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9e297b59-4b73-456b-ad9a-dc4399a73e58 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=d8eab235c219448fa08739f4945b09de&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4572749 Dec 09 21:41:22.669703 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34096) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:22.690139 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e297b59-4b73-456b-ad9a-dc4399a73e58 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=33383206-1c48-428e-9866-ea3751886258,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:22.740537 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d3e23895-e97a-466c-91f6-2412229c1cbc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:22.752329 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-a2861f1d-314c-40d2-bded-31b4363f231f req-7532f0c7-0d97-4786-9e10-cee51aa684fc tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] For port bc80e20d-ce6c-46ea-9b97-f2f29d502b95, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=bc80e20d-ce6c-46ea-9b97-f2f29d502b95,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:41:22.752791 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a2861f1d-314c-40d2-bded-31b4363f231f req-7532f0c7-0d97-4786-9e10-cee51aa684fc tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:22.765845 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-a2861f1d-314c-40d2-bded-31b4363f231f req-7532f0c7-0d97-4786-9e10-cee51aa684fc tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Calling delete_port for bc80e20d-ce6c-46ea-9b97-f2f29d502b95 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:41:22.766505 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d3e23895-e97a-466c-91f6-2412229c1cbc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:22.841604 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d3e23895-e97a-466c-91f6-2412229c1cbc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:22.845046 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d3e23895-e97a-466c-91f6-2412229c1cbc admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:22.846407 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d3e23895-e97a-466c-91f6-2412229c1cbc admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/33383206-1c48-428e-9866-ea3751886258 HTTP/1.1" status: 204 len: 168 time: 0.1728408 Dec 09 21:41:22.853761 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13049762-55c0-4edc-b8c0-5fd76d696ba2 req-3da496da-5044-4a6f-a48f-a10c223c570e tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:22.855350 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3e23895-e97a-466c-91f6-2412229c1cbc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=33383206-1c48-428e-9866-ea3751886258,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:22.855500 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-13049762-55c0-4edc-b8c0-5fd76d696ba2 req-3da496da-5044-4a6f-a48f-a10c223c570e tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.2541938 Dec 09 21:41:22.946775 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-13049762-55c0-4edc-b8c0-5fd76d696ba2 req-33b97443-28e0-4e35-9827-6982f698caa7 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0835388 Dec 09 21:41:22.975186 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a2861f1d-314c-40d2-bded-31b4363f231f req-7532f0c7-0d97-4786-9e10-cee51aa684fc tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:22.981535 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['5df02334-3682-4a91-b22d-133fa1bcb473', 'bc80e20d-ce6c-46ea-9b97-f2f29d502b95'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:41:22.997906 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7532f0c7-0d97-4786-9e10-cee51aa684fc tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Pushing event deleted for resources: {'Port': ['ID=bc80e20d-ce6c-46ea-9b97-f2f29d502b95,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:23.053535 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9b1f3064-f628-4c20-a00c-40fff1f2d289 None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:41:23.068347 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-a2861f1d-314c-40d2-bded-31b4363f231f req-7532f0c7-0d97-4786-9e10-cee51aa684fc tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] No DVR routers for this DVR port bc80e20d-ce6c-46ea-9b97-f2f29d502b95 on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:41:23.071201 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-a2861f1d-314c-40d2-bded-31b4363f231f req-7532f0c7-0d97-4786-9e10-cee51aa684fc tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:23.078125 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2861f1d-314c-40d2-bded-31b4363f231f req-7532f0c7-0d97-4786-9e10-cee51aa684fc tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "DELETE /v2.0/ports/bc80e20d-ce6c-46ea-9b97-f2f29d502b95 HTTP/1.1" status: 204 len: 173 time: 0.5983357 Dec 09 21:41:23.079224 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1af02f9f-8258-4145-b364-35ab02015e65', 'name': 'network-vif-deleted', 'tag': 'bc80e20d-ce6c-46ea-9b97-f2f29d502b95'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:41:23.099475 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-11a5973f-c324-4e76-aa94-d88c9693f91f" -d '{"events": [{"server_uuid": "1af02f9f-8258-4145-b364-35ab02015e65", "name": "network-vif-deleted", "tag": "bc80e20d-ce6c-46ea-9b97-f2f29d502b95"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:41:23.174347 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:41:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-effa168c-b39d-4ca5-acc7-4e9a50f3e50f x-openstack-request-id: req-effa168c-b39d-4ca5-acc7-4e9a50f3e50f {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:41:23.174860 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1af02f9f-8258-4145-b364-35ab02015e65", "name": "network-vif-deleted", "tag": "bc80e20d-ce6c-46ea-9b97-f2f29d502b95", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:41:23.175386 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-effa168c-b39d-4ca5-acc7-4e9a50f3e50f {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:41:23.175907 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1af02f9f-8258-4145-b364-35ab02015e65', 'name': 'network-vif-deleted', 'tag': 'bc80e20d-ce6c-46ea-9b97-f2f29d502b95', 'status': 'completed', 'code': 200} Dec 09 21:41:23.430980 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34124) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:23.446257 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b9ead728-8cce-4126-8055-d140b93b087e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:23.588585 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b9ead728-8cce-4126-8055-d140b93b087e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:23.595752 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b9ead728-8cce-4126-8055-d140b93b087e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:23.649763 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b9ead728-8cce-4126-8055-d140b93b087e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=3d4d4a0b4649425c944dd6c970910069&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2143593 Dec 09 21:41:23.651257 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34134) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:23.658157 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09aa50e8-47c0-407c-b619-20b936f3f5af req-06ff9265-4873-4266-969a-b5cf43af9fbb tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1af02f9f-8258-4145-b364-35ab02015e65 HTTP/1.1" status: 200 len: 210 time: 0.0463188 Dec 09 21:41:23.692899 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9ead728-8cce-4126-8055-d140b93b087e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=291c8460-910e-4f26-b2af-62cf3528d8a0,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:23.738495 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-441ff92f-c2dd-4254-939d-f22966683d69 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:23.761342 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-441ff92f-c2dd-4254-939d-f22966683d69 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:23.837089 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-441ff92f-c2dd-4254-939d-f22966683d69 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:23.840030 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-441ff92f-c2dd-4254-939d-f22966683d69 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:23.841227 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-441ff92f-c2dd-4254-939d-f22966683d69 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/291c8460-910e-4f26-b2af-62cf3528d8a0 HTTP/1.1" status: 204 len: 168 time: 0.1888611 Dec 09 21:41:23.852887 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-441ff92f-c2dd-4254-939d-f22966683d69 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=291c8460-910e-4f26-b2af-62cf3528d8a0,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:24.082477 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e60b0e3-a509-4054-a6fc-f3ff2a14d786 req-f41d02da-52b7-4ef8-8703-462e626ba1cf tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:24.090274 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e60b0e3-a509-4054-a6fc-f3ff2a14d786 req-f41d02da-52b7-4ef8-8703-462e626ba1cf tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.0587726 Dec 09 21:41:24.142988 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e60b0e3-a509-4054-a6fc-f3ff2a14d786 req-8612fe35-7539-4ee1-9b7b-0aac277b70da tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517640 Dec 09 21:41:25.108796 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-c43d59e3-7cce-49b6-8bf8-b384d20246b8 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:25.111300 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-c43d59e3-7cce-49b6-8bf8-b384d20246b8 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/networks?id=ba3aee78-4661-4c71-9b18-af1e6a07faff HTTP/1.1" status: 200 len: 805 time: 0.1327994 Dec 09 21:41:25.134206 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-bb21d76b-09a7-43bd-9d95-56d70b1bd2af tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/quotas/0569bc74c98b4ae2980de7af929e97eb HTTP/1.1" status: 200 len: 375 time: 0.0156488 Dec 09 21:41:25.176834 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device bc80e20d-ce6c-46ea-9b97-f2f29d502b95 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:41:25.196388 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-fef09517-1a27-4a70-8af8-9122daf1af20 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=0569bc74c98b4ae2980de7af929e97eb&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0608432 Dec 09 21:41:25.220109 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: bc80e20d-ce6c-46ea-9b97-f2f29d502b95 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:41:25.221025 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device bc80e20d-ce6c-46ea-9b97-f2f29d502b95 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:41:25.335885 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-36dae189-9888-4f61-98a4-344f3925e47f service neutron] 10.222.0.13 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1330402 Dec 09 21:41:25.454683 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-4f6a74e7-206b-43e7-a1aa-eb909fe03f06 service neutron] 10.222.0.13 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1092939 Dec 09 21:41:25.719479 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbee035b-1103-408c-a431-97dc5befb381 req-d39e63ef-533b-401f-bdcb-efd9a6998d48 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:25.722391 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bbee035b-1103-408c-a431-97dc5befb381 req-d39e63ef-533b-401f-bdcb-efd9a6998d48 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1040542 Dec 09 21:41:25.798482 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bbee035b-1103-408c-a431-97dc5befb381 req-71462aa6-8a11-4f3a-a614-a48308ebbb1d tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0605192 Dec 09 21:41:25.888271 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f731a1be-0abf-481f-b77d-ad98531d0aee req-8cf60baf-0dbb-4ac0-b2b9-fc09442ed833 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a HTTP/1.1" status: 200 len: 210 time: 0.0313721 Dec 09 21:41:27.052116 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50b45f2d-33c8-41b1-a148-590bb6c4fedf req-d5017de2-2f48-400d-b0dc-25105b67ceba tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:27.062154 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50b45f2d-33c8-41b1-a148-590bb6c4fedf req-d5017de2-2f48-400d-b0dc-25105b67ceba tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1953480 Dec 09 21:41:27.094363 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-e453a439-6136-4328-bda8-7d4ed865b5cf tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:27.096074 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-e453a439-6136-4328-bda8-7d4ed865b5cf tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "GET /v2.0/networks?id=ba3aee78-4661-4c71-9b18-af1e6a07faff HTTP/1.1" status: 200 len: 805 time: 0.1942692 Dec 09 21:41:27.109988 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-52a86400-3f34-4f4b-8735-c3e9fe2b763a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Request body: {'port': {'device_id': '378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a', 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff', 'admin_state_up': True, 'tenant_id': '0569bc74c98b4ae2980de7af929e97eb'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:27.234606 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50b45f2d-33c8-41b1-a148-590bb6c4fedf req-b52eaf18-7e88-4d5d-9757-56cfcf488bd1 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1658864 Dec 09 21:41:27.297761 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:27.305901 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:27.331095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-52a86400-3f34-4f4b-8735-c3e9fe2b763a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Made reservation on behalf of 0569bc74c98b4ae2980de7af929e97eb for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:41:27.336529 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-52a86400-3f34-4f4b-8735-c3e9fe2b763a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:27.396676 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-afd618db-9efd-43ae-aed5-11e1e2595a12 req-ad605d04-7802-44d0-ae34-3b7ddefc00b7 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a HTTP/1.1" status: 200 len: 210 time: 0.0816479 Dec 09 21:41:27.528542 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6ce42f3-b590-47f2-8b25-69c608074949 req-67138abd-dd4c-47c6-a749-3918dcaa47a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:27.530375 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d6ce42f3-b590-47f2-8b25-69c608074949 req-67138abd-dd4c-47c6-a749-3918dcaa47a1 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=69d79e96ec1c418aa6c619846f0fe02e&device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 1098 time: 0.0647151 Dec 09 21:41:27.617674 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-52a86400-3f34-4f4b-8735-c3e9fe2b763a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Allocated IP 172.20.0.4 (ba3aee78-4661-4c71-9b18-af1e6a07faff/b61ac70f-1e8d-40a8-9031-bab15f73fa0a/de990eaf-2240-4c12-a088-f35dc0caa498) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:41:27.684665 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6ce42f3-b590-47f2-8b25-69c608074949 req-161a1862-2b59-4142-81be-ab95b5fccd80 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:27.687160 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d6ce42f3-b590-47f2-8b25-69c608074949 req-161a1862-2b59-4142-81be-ab95b5fccd80 service neutron] 10.222.0.31 "GET /v2.0/networks?id=71038cd4-0600-4b06-91f9-ae7f4f4807f9 HTTP/1.1" status: 200 len: 920 time: 0.1359138 Dec 09 21:41:27.736955 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d6ce42f3-b590-47f2-8b25-69c608074949 req-8bf2f29c-283c-45e9-85c6-1670837f95ce service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=be95aa8d-fc0e-4d77-a861-33c1637e4f3e HTTP/1.1" status: 200 len: 217 time: 0.0421538 Dec 09 21:41:27.849141 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6ce42f3-b590-47f2-8b25-69c608074949 req-3de16c01-b4ef-4591-9eff-6524766cf826 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:27.850646 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d6ce42f3-b590-47f2-8b25-69c608074949 req-3de16c01-b4ef-4591-9eff-6524766cf826 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=12d97cfc-9264-49cb-8e47-fd225cb6d30b HTTP/1.1" status: 200 len: 859 time: 0.1067972 Dec 09 21:41:27.909873 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-52a86400-3f34-4f4b-8735-c3e9fe2b763a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:27.920902 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d6ce42f3-b590-47f2-8b25-69c608074949 req-44a202f0-4de7-4193-8722-a1fad3a6c200 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=71038cd4-0600-4b06-91f9-ae7f4f4807f9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0619965 Dec 09 21:41:27.994423 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-52a86400-3f34-4f4b-8735-c3e9fe2b763a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:28.008118 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['5df02334-3682-4a91-b22d-133fa1bcb473'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:41:28.043089 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-52a86400-3f34-4f4b-8735-c3e9fe2b763a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Network ba3aee78-4661-4c71-9b18-af1e6a07faff is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:41:28.048984 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-52a86400-3f34-4f4b-8735-c3e9fe2b763a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:41:28.054467 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-52a86400-3f34-4f4b-8735-c3e9fe2b763a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:41:28.077406 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7d089ec2-c847-4d5a-90dc-7f55e7d93e15 None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:41:28.103157 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52a86400-3f34-4f4b-8735-c3e9fe2b763a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Pushing event updated for resources: {'Port': ['ID=de990eaf-2240-4c12-a088-f35dc0caa498,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:28.125624 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-52a86400-3f34-4f4b-8735-c3e9fe2b763a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:28.126359 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-52a86400-3f34-4f4b-8735-c3e9fe2b763a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:28.137498 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d6ce42f3-b590-47f2-8b25-69c608074949 req-3b90a3f4-6ab1-49fe-a810-396c23a9e59d service neutron] 10.222.0.31 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2094414 Dec 09 21:41:28.145799 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-52a86400-3f34-4f4b-8735-c3e9fe2b763a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0400839 Dec 09 21:41:28.168732 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-7fec622d-09ab-46db-a974-6450ecfdad13 service neutron] Request body: {'port': {'device_id': '378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:28.230869 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-fbc7b6fc-7260-4139-9f58-373ede340a97 None None] Provisioning complete for port de990eaf-2240-4c12-a088-f35dc0caa498 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:41:28.231254 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fbc7b6fc-7260-4139-9f58-373ede340a97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:28.279650 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d6ce42f3-b590-47f2-8b25-69c608074949 req-08763a94-c50d-45bb-a3da-66c410a57d10 service neutron] 10.222.0.31 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1343811 Dec 09 21:41:28.293293 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-7fec622d-09ab-46db-a974-6450ecfdad13 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:28.310729 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-fbc7b6fc-7260-4139-9f58-373ede340a97 None None] Port de990eaf-2240-4c12-a088-f35dc0caa498 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:41:28.448361 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-673b2f56-a922-433f-bee2-c8dbbf83411c req-ee58f961-d4db-418b-8df0-c918d2f76ec2 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:28.449884 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-673b2f56-a922-433f-bee2-c8dbbf83411c req-ee58f961-d4db-418b-8df0-c918d2f76ec2 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1386843 Dec 09 21:41:28.555043 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-673b2f56-a922-433f-bee2-c8dbbf83411c req-0b24452e-e216-46dd-8c62-dfd47533f487 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0979407 Dec 09 21:41:28.695744 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-7fec622d-09ab-46db-a974-6450ecfdad13 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id de990eaf-2240-4c12-a088-f35dc0caa498 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:41:28.706049 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-7fec622d-09ab-46db-a974-6450ecfdad13 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:28.728865 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d5ab322-042a-4fee-9d60-6bcd978b8f1f req-4500d5da-c2c5-47d9-91a3-4dbc85a073cd tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:28.730438 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d5ab322-042a-4fee-9d60-6bcd978b8f1f req-4500d5da-c2c5-47d9-91a3-4dbc85a073cd tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a HTTP/1.1" status: 200 len: 931 time: 0.0983632 Dec 09 21:41:28.733549 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-7fec622d-09ab-46db-a974-6450ecfdad13 service neutron] Transition to ACTIVE for port object de990eaf-2240-4c12-a088-f35dc0caa498 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:41:28.738136 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-7fec622d-09ab-46db-a974-6450ecfdad13 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:28.784814 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb22387e-046f-4e6f-ad7b-551179592376 None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:41:28.892522 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fec622d-09ab-46db-a974-6450ecfdad13 service neutron] Pushing event updated for resources: {'Port': ['ID=de990eaf-2240-4c12-a088-f35dc0caa498,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:28.916592 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d5ab322-042a-4fee-9d60-6bcd978b8f1f req-b30602a2-7356-4c23-a35b-5fd914bd2ede tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1508610 Dec 09 21:41:28.952880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-7fec622d-09ab-46db-a974-6450ecfdad13 service neutron] Attempting to bind port de990eaf-2240-4c12-a088-f35dc0caa498 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:41:28.953611 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-7fec622d-09ab-46db-a974-6450ecfdad13 service neutron] Attempting to bind port de990eaf-2240-4c12-a088-f35dc0caa498 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:41:28.954063 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-7fec622d-09ab-46db-a974-6450ecfdad13 service neutron] Attempting to bind port de990eaf-2240-4c12-a088-f35dc0caa498 on network ba3aee78-4661-4c71-9b18-af1e6a07faff {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:41:28.959533 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-7fec622d-09ab-46db-a974-6450ecfdad13 service neutron] Port de990eaf-2240-4c12-a088-f35dc0caa498 on network ba3aee78-4661-4c71-9b18-af1e6a07faff not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:41:28.959989 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-7fec622d-09ab-46db-a974-6450ecfdad13 service neutron] Attempting to bind port de990eaf-2240-4c12-a088-f35dc0caa498 on network ba3aee78-4661-4c71-9b18-af1e6a07faff {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:41:28.965768 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-7fec622d-09ab-46db-a974-6450ecfdad13 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 41, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:41:28.966657 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-7fec622d-09ab-46db-a974-6450ecfdad13 service neutron] Checking segment: {'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:41:28.967613 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-7fec622d-09ab-46db-a974-6450ecfdad13 service neutron] Bound using segment: {'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:41:28.968169 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-7fec622d-09ab-46db-a974-6450ecfdad13 service neutron] Bound port: de990eaf-2240-4c12-a088-f35dc0caa498, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:41:28.968625 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-7fec622d-09ab-46db-a974-6450ecfdad13 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:29.080076 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-7fec622d-09ab-46db-a974-6450ecfdad13 service neutron] For port de990eaf-2240-4c12-a088-f35dc0caa498, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:41:29.084506 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-7fec622d-09ab-46db-a974-6450ecfdad13 service neutron] For port de990eaf-2240-4c12-a088-f35dc0caa498, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=de990eaf-2240-4c12-a088-f35dc0caa498,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:41:29.094596 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-7fec622d-09ab-46db-a974-6450ecfdad13 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:29.134740 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-7fec622d-09ab-46db-a974-6450ecfdad13 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:29.135940 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-7fec622d-09ab-46db-a974-6450ecfdad13 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:29.139269 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-7fec622d-09ab-46db-a974-6450ecfdad13 service neutron] 10.222.0.31 "PUT /v2.0/ports/de990eaf-2240-4c12-a088-f35dc0caa498 HTTP/1.1" status: 200 len: 1092 time: 0.9740355 Dec 09 21:41:29.141797 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a', 'tag': 'de990eaf-2240-4c12-a088-f35dc0caa498'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:41:29.146428 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1c67cfe4-e1f0-41e2-a6f2-5d887f19c5ee" -d '{"events": [{"name": "network-changed", "server_uuid": "378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a", "tag": "de990eaf-2240-4c12-a088-f35dc0caa498"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:41:29.225314 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5fbbfc8f-c7c2-488e-a7ab-7c2d0801ffed None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:41:29.262034 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:41:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0be3c2df-ee5e-4d52-a441-10c1fd95b864 x-openstack-request-id: req-0be3c2df-ee5e-4d52-a441-10c1fd95b864 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:41:29.262324 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a", "tag": "de990eaf-2240-4c12-a088-f35dc0caa498", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:41:29.262576 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0be3c2df-ee5e-4d52-a441-10c1fd95b864 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:41:29.263423 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a', 'tag': 'de990eaf-2240-4c12-a088-f35dc0caa498', 'status': 'completed', 'code': 200} Dec 09 21:41:29.282335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fec622d-09ab-46db-a974-6450ecfdad13 service neutron] Pushing event updated for resources: {'Port': ['ID=de990eaf-2240-4c12-a088-f35dc0caa498,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:29.297505 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-de46fcc6-b2eb-4307-a76f-8b762e1957cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:29.299459 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-de46fcc6-b2eb-4307-a76f-8b762e1957cf service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0569bc74c98b4ae2980de7af929e97eb&device_id=378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a HTTP/1.1" status: 200 len: 1095 time: 0.0955207 Dec 09 21:41:29.353487 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-b51b4d68-aafb-4f1d-aea9-4eb5d8d500d1 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=de990eaf-2240-4c12-a088-f35dc0caa498 HTTP/1.1" status: 200 len: 217 time: 0.0459452 Dec 09 21:41:29.417608 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-5b7fde82-43f2-4714-a52a-c252272ca132 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:29.419749 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-5b7fde82-43f2-4714-a52a-c252272ca132 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=b61ac70f-1e8d-40a8-9031-bab15f73fa0a HTTP/1.1" status: 200 len: 845 time: 0.0589516 Dec 09 21:41:29.453397 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-88dd764a-9e8e-4f72-b485-dadf8bf72493 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ba3aee78-4661-4c71-9b18-af1e6a07faff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0267856 Dec 09 21:41:29.554261 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-58e852e0-ac7e-43dd-8875-d18d78960ef4 service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0925963 Dec 09 21:41:29.661946 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fcd1c77-0a18-4016-bac8-26a023f4b182 req-4cb40bbf-ddbe-4949-b6b1-61c2fed765d8 service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0994468 Dec 09 21:41:29.770574 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5147bfc3-abdb-4abc-9676-022adc28cb24 req-1209ce1f-136f-4885-83ed-683f37842c23 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:29.772346 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5147bfc3-abdb-4abc-9676-022adc28cb24 req-1209ce1f-136f-4885-83ed-683f37842c23 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.0963581 Dec 09 21:41:29.780463 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c67cfe4-e1f0-41e2-a6f2-5d887f19c5ee req-d057aada-d8bb-4ebc-90a2-56433c7f8768 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:29.782601 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1c67cfe4-e1f0-41e2-a6f2-5d887f19c5ee req-d057aada-d8bb-4ebc-90a2-56433c7f8768 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0569bc74c98b4ae2980de7af929e97eb&device_id=378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a HTTP/1.1" status: 200 len: 1095 time: 0.0637746 Dec 09 21:41:29.928533 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5147bfc3-abdb-4abc-9676-022adc28cb24 req-93529819-fdee-409e-8b63-555999d1c293 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1447892 Dec 09 21:41:29.953839 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c67cfe4-e1f0-41e2-a6f2-5d887f19c5ee req-d53e2607-5b8e-45cb-b1c6-59509ac94c01 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:29.955339 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1c67cfe4-e1f0-41e2-a6f2-5d887f19c5ee req-d53e2607-5b8e-45cb-b1c6-59509ac94c01 service neutron] 10.222.0.31 "GET /v2.0/networks?id=ba3aee78-4661-4c71-9b18-af1e6a07faff HTTP/1.1" status: 200 len: 906 time: 0.1486413 Dec 09 21:41:30.030386 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1c67cfe4-e1f0-41e2-a6f2-5d887f19c5ee req-9b8aac8b-f034-4c45-bb10-0543f2987237 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=de990eaf-2240-4c12-a088-f35dc0caa498 HTTP/1.1" status: 200 len: 217 time: 0.0664732 Dec 09 21:41:30.116704 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d6cd2f6-7133-4065-9f22-8e5f68fa8633 req-2a95d702-fcb3-49ef-804a-f400395f1897 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:30.118232 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7d6cd2f6-7133-4065-9f22-8e5f68fa8633 req-2a95d702-fcb3-49ef-804a-f400395f1897 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a HTTP/1.1" status: 200 len: 943 time: 0.0905247 Dec 09 21:41:30.120202 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c67cfe4-e1f0-41e2-a6f2-5d887f19c5ee req-f965ecec-0f9a-433b-adf3-5adb111cdae0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:30.121500 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1c67cfe4-e1f0-41e2-a6f2-5d887f19c5ee req-f965ecec-0f9a-433b-adf3-5adb111cdae0 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=b61ac70f-1e8d-40a8-9031-bab15f73fa0a HTTP/1.1" status: 200 len: 845 time: 0.0812426 Dec 09 21:41:30.167005 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1c67cfe4-e1f0-41e2-a6f2-5d887f19c5ee req-bae552ce-1717-458a-a573-c18663740b6d service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ba3aee78-4661-4c71-9b18-af1e6a07faff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0344653 Dec 09 21:41:30.259880 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7d6cd2f6-7133-4065-9f22-8e5f68fa8633 req-e6c922f7-7c9c-445f-9086-3e7896588dc4 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1335633 Dec 09 21:41:30.336837 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1c67cfe4-e1f0-41e2-a6f2-5d887f19c5ee req-2d86dc7b-f26a-4e3c-a274-4a6d26fdcae1 service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1542563 Dec 09 21:41:30.448412 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1c67cfe4-e1f0-41e2-a6f2-5d887f19c5ee req-52ce56e5-686e-44fc-8391-6a168bc968f9 service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1012769 Dec 09 21:41:31.078010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-becdf86b-d321-4649-992a-c36b34b7e687 req-d90edd90-dfee-4606-8b9c-ec6ab5aca2f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:31.079550 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-becdf86b-d321-4649-992a-c36b34b7e687 req-d90edd90-dfee-4606-8b9c-ec6ab5aca2f6 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 1098 time: 0.1108897 Dec 09 21:41:31.131807 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e3dcfb0-281b-4841-a633-18a00d0efc8d req-61abfb85-12d2-4b58-9c08-5016bc15ff6c tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:31.134252 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0e3dcfb0-281b-4841-a633-18a00d0efc8d req-61abfb85-12d2-4b58-9c08-5016bc15ff6c tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1107428 Dec 09 21:41:31.156270 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-becdf86b-d321-4649-992a-c36b34b7e687 req-927c573d-8f0c-48fd-98c5-14a6ea2d9230 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0676785 Dec 09 21:41:31.178474 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device de990eaf-2240-4c12-a088-f35dc0caa498 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:41:31.191623 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0e3dcfb0-281b-4841-a633-18a00d0efc8d req-c07dd022-378a-4f91-bcff-6a8e695a91e6 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473835 Dec 09 21:41:31.315191 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port de990eaf-2240-4c12-a088-f35dc0caa498, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=de990eaf-2240-4c12-a088-f35dc0caa498,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:41:31.330623 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'de990eaf-2240-4c12-a088-f35dc0caa498', 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff', 'port_id': 'de990eaf-2240-4c12-a088-f35dc0caa498', 'mac_address': 'fa:16:3e:38:3b:42', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b61ac70f-1e8d-40a8-9031-bab15f73fa0a', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:41:31.374245 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:31.392666 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id de990eaf-2240-4c12-a088-f35dc0caa498 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:41:31.416964 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port de990eaf-2240-4c12-a088-f35dc0caa498, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=de990eaf-2240-4c12-a088-f35dc0caa498,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:41:31.436124 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:31.438795 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-a0313f1b-759c-4082-b05e-5f5fa987ad30 req-4d37718a-0642-4ace-b8ee-6a47c30e1038 tempest-MultipleCreateTestJSON-1588920911 tempest-MultipleCreateTestJSON-1588920911-project] (103437) timed out ('10.222.0.31', 57386) {{(pid=103437) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 09 21:41:31.454576 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bbb3987-4b26-4284-8d5f-059cff85d279 req-c9dcc53c-b724-4ea1-ba4c-353c97cba855 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:31.456656 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3bbb3987-4b26-4284-8d5f-059cff85d279 req-c9dcc53c-b724-4ea1-ba4c-353c97cba855 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a HTTP/1.1" status: 200 len: 943 time: 0.0651727 Dec 09 21:41:31.527000 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3bbb3987-4b26-4284-8d5f-059cff85d279 req-7370cd2b-60eb-4906-8f7b-cdf9f604f6eb tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0645905 Dec 09 21:41:31.537109 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=de990eaf-2240-4c12-a088-f35dc0caa498,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:31.546898 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:31.547557 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:31.547853 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:31.548188 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:31.548514 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:31.548840 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:31.549161 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:31.549482 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:31.549800 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:31.550118 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:31.557132 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:31.560648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:31.561185 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:41:31.664102 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-2c972c87-1713-43b5-8d57-58fe5b7d99cf req-6f03bcd6-c863-4913-9f2d-3054254895bb service neutron] (103437) timed out ('10.222.0.31', 57441) {{(pid=103437) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 09 21:41:31.729454 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['de990eaf-2240-4c12-a088-f35dc0caa498'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:41:32.357128 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f2b97aa-e153-4cc6-9645-7d5fa81e008d req-a01746d7-a492-4c51-be21-2005129aee57 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:32.359078 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2f2b97aa-e153-4cc6-9645-7d5fa81e008d req-a01746d7-a492-4c51-be21-2005129aee57 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.0625083 Dec 09 21:41:32.419165 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2f2b97aa-e153-4cc6-9645-7d5fa81e008d req-70e9b1ad-1d6a-47e4-8617-9b25516dd90d tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0539317 Dec 09 21:41:32.754229 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc2baf78-9c8b-4a05-ba35-4048d0b8161b req-2ab4fe09-637d-4bbd-9b6f-760131395a54 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:32.755998 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fc2baf78-9c8b-4a05-ba35-4048d0b8161b req-2ab4fe09-637d-4bbd-9b6f-760131395a54 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=69d79e96ec1c418aa6c619846f0fe02e&device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 1098 time: 0.0896771 Dec 09 21:41:32.763876 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1f21743-b6eb-4378-8a5d-caab15edf80e req-fbbce535-dfbb-4da1-b7f9-16ea607bf2ae tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:32.765598 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e1f21743-b6eb-4378-8a5d-caab15edf80e req-fbbce535-dfbb-4da1-b7f9-16ea607bf2ae tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a HTTP/1.1" status: 200 len: 944 time: 0.0648937 Dec 09 21:41:32.934012 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc2baf78-9c8b-4a05-ba35-4048d0b8161b req-9f429296-0aa7-474e-b513-8b4d275e17d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:32.935820 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fc2baf78-9c8b-4a05-ba35-4048d0b8161b req-9f429296-0aa7-474e-b513-8b4d275e17d1 service neutron] 10.222.0.31 "GET /v2.0/networks?id=71038cd4-0600-4b06-91f9-ae7f4f4807f9 HTTP/1.1" status: 200 len: 920 time: 0.1691136 Dec 09 21:41:32.964939 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6cfad13c-9a1e-4ecd-9089-7f7559e19fa1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:33.018815 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e1f21743-b6eb-4378-8a5d-caab15edf80e req-653f2444-f8fa-41f9-8324-3e3739bc3b00 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2042499 Dec 09 21:41:33.024998 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fc2baf78-9c8b-4a05-ba35-4048d0b8161b req-2eef0782-bd06-4e99-9cf8-020484a16f9e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=be95aa8d-fc0e-4d77-a861-33c1637e4f3e HTTP/1.1" status: 200 len: 217 time: 0.0799160 Dec 09 21:41:33.102396 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc2baf78-9c8b-4a05-ba35-4048d0b8161b req-81975216-128e-42c4-92e3-bbec1b7a806b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:33.103919 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fc2baf78-9c8b-4a05-ba35-4048d0b8161b req-81975216-128e-42c4-92e3-bbec1b7a806b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=12d97cfc-9264-49cb-8e47-fd225cb6d30b HTTP/1.1" status: 200 len: 859 time: 0.0704410 Dec 09 21:41:33.172204 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fc2baf78-9c8b-4a05-ba35-4048d0b8161b req-d12aa845-e213-4d36-8d22-4b001a37f645 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=71038cd4-0600-4b06-91f9-ae7f4f4807f9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0605428 Dec 09 21:41:33.195015 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device de990eaf-2240-4c12-a088-f35dc0caa498 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:41:33.254287 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e3382a4-7430-440d-a8b8-6fe56a524dc1 req-2c6c6498-4f92-40a6-b10f-c22f08d0f5c3 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:33.256051 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e3382a4-7430-440d-a8b8-6fe56a524dc1 req-2c6c6498-4f92-40a6-b10f-c22f08d0f5c3 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1326025 Dec 09 21:41:33.319637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port de990eaf-2240-4c12-a088-f35dc0caa498 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:41:33.325406 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port de990eaf-2240-4c12-a088-f35dc0caa498 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:41:33.327044 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:33.459674 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:33.503774 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port de990eaf-2240-4c12-a088-f35dc0caa498, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=de990eaf-2240-4c12-a088-f35dc0caa498,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:41:33.504931 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'de990eaf-2240-4c12-a088-f35dc0caa498'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:41:33.507729 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-62d6717f-0109-48b7-aa2e-805444e6f122" -d '{"events": [{"server_uuid": "378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a", "name": "network-vif-plugged", "status": "completed", "tag": "de990eaf-2240-4c12-a088-f35dc0caa498"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:41:33.524721 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:33.601683 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=de990eaf-2240-4c12-a088-f35dc0caa498,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:33.722696 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e3382a4-7430-440d-a8b8-6fe56a524dc1 req-cc6ae1a3-a042-4f84-b524-4e78f71b3b43 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0532532 Dec 09 21:41:33.747757 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fc2baf78-9c8b-4a05-ba35-4048d0b8161b req-e7731969-f0f8-4a49-a8ce-7c5accb44ca4 service neutron] 10.222.0.31 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5675948 Dec 09 21:41:33.779416 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:41:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9822f16a-1209-4f80-a91e-b510e84d2d56 x-openstack-request-id: req-9822f16a-1209-4f80-a91e-b510e84d2d56 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:41:33.780033 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a", "name": "network-vif-plugged", "status": "completed", "tag": "de990eaf-2240-4c12-a088-f35dc0caa498", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:41:33.780353 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-9822f16a-1209-4f80-a91e-b510e84d2d56 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:41:33.780814 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'de990eaf-2240-4c12-a088-f35dc0caa498', 'code': 200} Dec 09 21:41:33.884472 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fc2baf78-9c8b-4a05-ba35-4048d0b8161b req-7a4cc9a3-8cb1-48ed-b4f7-ee858fb61dd3 service neutron] 10.222.0.31 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1296132 Dec 09 21:41:33.916103 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39de8c26-e0fe-4a30-bc79-61aad7c5707e req-8c19a905-562e-4734-bd02-77005791f54f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:33.918448 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-39de8c26-e0fe-4a30-bc79-61aad7c5707e req-8c19a905-562e-4734-bd02-77005791f54f service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a HTTP/1.1" status: 200 len: 1097 time: 0.0806680 Dec 09 21:41:33.983880 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-39de8c26-e0fe-4a30-bc79-61aad7c5707e req-555a505d-7ed2-4016-9ea9-87dd83b1334e service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0583034 Dec 09 21:41:34.151752 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-290f8fe7-8634-4efc-a002-ae9653120c32 req-88f319a1-56b7-4609-a0d1-ffa7c8620d49 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:34.153773 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-290f8fe7-8634-4efc-a002-ae9653120c32 req-88f319a1-56b7-4609-a0d1-ffa7c8620d49 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a HTTP/1.1" status: 200 len: 945 time: 0.0573890 Dec 09 21:41:34.228280 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-290f8fe7-8634-4efc-a002-ae9653120c32 req-03485de4-b83d-4ac8-920f-461777579858 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0663652 Dec 09 21:41:34.863125 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a19ccee8-9bf0-4de7-8e99-554f297e8b4a req-fcb01e99-025b-486f-be1f-617adb8791be tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:34.871517 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a19ccee8-9bf0-4de7-8e99-554f297e8b4a req-fcb01e99-025b-486f-be1f-617adb8791be tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.0675387 Dec 09 21:41:34.936717 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a19ccee8-9bf0-4de7-8e99-554f297e8b4a req-b2b72bcb-377e-44ed-ac20-4d2acfa6c465 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0639503 Dec 09 21:41:35.335659 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34646) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:35.371017 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b639775-0c12-40c8-bb4c-413cba944cab req-a44849de-0514-4154-b010-02f4a8ad162a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:35.379895 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b639775-0c12-40c8-bb4c-413cba944cab req-a44849de-0514-4154-b010-02f4a8ad162a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a HTTP/1.1" status: 200 len: 945 time: 0.0757785 Dec 09 21:41:35.438323 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b639775-0c12-40c8-bb4c-413cba944cab req-9d87ad5d-4ba0-40a8-b54f-eb9068a69795 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0572119 Dec 09 21:41:35.550906 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-97b96c61-5eec-4ef4-af98-b6bcdc1274bb admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:35.554172 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0a1b37e6-ad94-4da2-bacf-0bbeb2995635 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:35.665726 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-97b96c61-5eec-4ef4-af98-b6bcdc1274bb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:35.673318 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-97b96c61-5eec-4ef4-af98-b6bcdc1274bb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:35.724577 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-97b96c61-5eec-4ef4-af98-b6bcdc1274bb admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=9dc8799922b847aca459fc371a67efd2&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3877296 Dec 09 21:41:35.727255 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97b96c61-5eec-4ef4-af98-b6bcdc1274bb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f611c674-c8ff-4dbf-9018-c2c567df755d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:35.729125 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34666) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:35.849494 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f78705e7-658a-4673-ae92-dedccd49c4c5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:35.874242 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-06e47c03-fdf7-485b-8e91-f355f5f84d86 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:35.875915 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-06e47c03-fdf7-485b-8e91-f355f5f84d86 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/networks?id=ba3aee78-4661-4c71-9b18-af1e6a07faff HTTP/1.1" status: 200 len: 805 time: 0.1769772 Dec 09 21:41:35.903829 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-ddf74ba6-3aba-4ed6-81d8-ac16bd601d9a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/quotas/0569bc74c98b4ae2980de7af929e97eb HTTP/1.1" status: 200 len: 375 time: 0.0207300 Dec 09 21:41:35.905660 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f78705e7-658a-4673-ae92-dedccd49c4c5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:35.979682 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-005ef67a-0bd6-4664-9e7c-d9541da93b0b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=0569bc74c98b4ae2980de7af929e97eb&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0667858 Dec 09 21:41:36.021950 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f78705e7-658a-4673-ae92-dedccd49c4c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:36.024931 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f78705e7-658a-4673-ae92-dedccd49c4c5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:36.026315 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f78705e7-658a-4673-ae92-dedccd49c4c5 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/f611c674-c8ff-4dbf-9018-c2c567df755d HTTP/1.1" status: 204 len: 168 time: 0.2960131 Dec 09 21:41:36.074145 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f78705e7-658a-4673-ae92-dedccd49c4c5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f611c674-c8ff-4dbf-9018-c2c567df755d,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:36.124036 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-958bf8d2-4d25-40d0-b5ec-5a3374a34b7c service neutron] 10.222.0.13 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1353416 Dec 09 21:41:36.271660 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-292726be-96d5-4e4d-aafe-224babdaffcf service neutron] 10.222.0.13 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1390386 Dec 09 21:41:36.420745 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34692) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:36.437028 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2009d6a8-0a73-4b55-88a8-17f395b1a70e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:36.525581 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d7f55b9-5b3b-4c45-8c5b-16a7933aabcc req-5a0c0693-888b-4b46-8d8a-f52b9ce16bbc tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:36.527076 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d7f55b9-5b3b-4c45-8c5b-16a7933aabcc req-5a0c0693-888b-4b46-8d8a-f52b9ce16bbc tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.0760937 Dec 09 21:41:36.606456 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d7f55b9-5b3b-4c45-8c5b-16a7933aabcc req-d0ce1911-82a5-4c9d-9106-d1a440f8066a tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0649357 Dec 09 21:41:36.651261 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:36.696291 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2009d6a8-0a73-4b55-88a8-17f395b1a70e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:36.714218 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2009d6a8-0a73-4b55-88a8-17f395b1a70e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:36.778818 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2009d6a8-0a73-4b55-88a8-17f395b1a70e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=24b600ef912c40da9198911f5ac8ac9d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3543942 Dec 09 21:41:36.779323 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34706) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:36.786240 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4a6ab082-e16f-42e2-a3ab-80c900fa9d99 req-a44ac5d4-b26b-4656-9f8c-5790b19da74c tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf1ed273-af7e-47a5-ad93-c79b5a374096 HTTP/1.1" status: 200 len: 210 time: 0.0884309 Dec 09 21:41:36.815486 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2009d6a8-0a73-4b55-88a8-17f395b1a70e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1f7c2acf-7bba-41bc-89a0-c054389d4ec6,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:36.895197 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4b48c088-bb57-4247-b175-47ff4e592f63 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:36.921065 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4b48c088-bb57-4247-b175-47ff4e592f63 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:36.994538 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4b48c088-bb57-4247-b175-47ff4e592f63 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:37.002581 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4b48c088-bb57-4247-b175-47ff4e592f63 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:37.003969 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4b48c088-bb57-4247-b175-47ff4e592f63 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/1f7c2acf-7bba-41bc-89a0-c054389d4ec6 HTTP/1.1" status: 204 len: 168 time: 0.2231812 Dec 09 21:41:37.021789 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b48c088-bb57-4247-b175-47ff4e592f63 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1f7c2acf-7bba-41bc-89a0-c054389d4ec6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:37.970890 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34748) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:37.986941 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:37.987958 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e140e4a-d0db-4029-a204-012981e940c9 req-586f2b67-9876-4836-a9ff-ca933a70617a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf1ed273-af7e-47a5-ad93-c79b5a374096 HTTP/1.1" status: 200 len: 210 time: 0.0651498 Dec 09 21:41:38.040622 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-f2af5b73-5003-47fb-9d9f-6cf9043dd5c0 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:38.043661 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-f2af5b73-5003-47fb-9d9f-6cf9043dd5c0 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "GET /v2.0/networks?id=ba3aee78-4661-4c71-9b18-af1e6a07faff HTTP/1.1" status: 200 len: 805 time: 0.3311174 Dec 09 21:41:38.061452 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-efa52d00-2d8f-4e6a-b5b0-e724fd312c4b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Request body: {'port': {'device_id': 'bf1ed273-af7e-47a5-ad93-c79b5a374096', 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff', 'admin_state_up': True, 'tenant_id': '0569bc74c98b4ae2980de7af929e97eb'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:38.322980 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6cad01b1-2151-426f-a387-8237f868d690 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:38.331415 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-efa52d00-2d8f-4e6a-b5b0-e724fd312c4b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Made reservation on behalf of 0569bc74c98b4ae2980de7af929e97eb for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:41:38.335964 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-efa52d00-2d8f-4e6a-b5b0-e724fd312c4b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:38.496369 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6cad01b1-2151-426f-a387-8237f868d690 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:38.503284 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6cad01b1-2151-426f-a387-8237f868d690 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:38.543550 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cad01b1-2151-426f-a387-8237f868d690 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a8b0e870-aed0-4569-9b2a-456e5be8fb1a,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:38.558721 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-efa52d00-2d8f-4e6a-b5b0-e724fd312c4b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Allocated IP 172.20.0.11 (ba3aee78-4661-4c71-9b18-af1e6a07faff/b61ac70f-1e8d-40a8-9031-bab15f73fa0a/c06185e2-0b83-4874-8227-34bea6194c4f) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:41:38.578550 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6cad01b1-2151-426f-a387-8237f868d690 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e298a11bf17c411891f8403d8d85d6b1&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5853488 Dec 09 21:41:38.578768 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34772) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:38.645678 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6e563f1-915b-444f-a10b-8d8bf3690b19 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:38.673470 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6e563f1-915b-444f-a10b-8d8bf3690b19 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:38.730740 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6e563f1-915b-444f-a10b-8d8bf3690b19 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:38.733570 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6e563f1-915b-444f-a10b-8d8bf3690b19 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:38.737184 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a6e563f1-915b-444f-a10b-8d8bf3690b19 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/a8b0e870-aed0-4569-9b2a-456e5be8fb1a HTTP/1.1" status: 204 len: 168 time: 0.1551216 Dec 09 21:41:38.747420 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6e563f1-915b-444f-a10b-8d8bf3690b19 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a8b0e870-aed0-4569-9b2a-456e5be8fb1a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:38.763376 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-efa52d00-2d8f-4e6a-b5b0-e724fd312c4b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:38.826494 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-efa52d00-2d8f-4e6a-b5b0-e724fd312c4b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:38.847333 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['5df02334-3682-4a91-b22d-133fa1bcb473', 'de990eaf-2240-4c12-a088-f35dc0caa498'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:41:38.922823 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efa52d00-2d8f-4e6a-b5b0-e724fd312c4b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Pushing event updated for resources: {'Port': ['ID=c06185e2-0b83-4874-8227-34bea6194c4f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:38.939947 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-efa52d00-2d8f-4e6a-b5b0-e724fd312c4b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Network ba3aee78-4661-4c71-9b18-af1e6a07faff is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:41:38.942080 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-efa52d00-2d8f-4e6a-b5b0-e724fd312c4b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:41:38.963493 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-efa52d00-2d8f-4e6a-b5b0-e724fd312c4b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:41:38.982827 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b16d3e5a-8074-463c-afda-39939edbf8be None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:41:39.074321 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-efa52d00-2d8f-4e6a-b5b0-e724fd312c4b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:39.074968 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-efa52d00-2d8f-4e6a-b5b0-e724fd312c4b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:39.115704 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-efa52d00-2d8f-4e6a-b5b0-e724fd312c4b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0588481 Dec 09 21:41:39.116271 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d57efd61-c875-4082-b2be-e6a93fe210cd None None] Provisioning complete for port c06185e2-0b83-4874-8227-34bea6194c4f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:41:39.117194 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d57efd61-c875-4082-b2be-e6a93fe210cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:39.130047 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-d8383b94-8396-4cad-aac4-8611b1a9cdaf service neutron] Request body: {'port': {'device_id': 'bf1ed273-af7e-47a5-ad93-c79b5a374096', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:39.166724 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0706bbb7-5c90-4e80-9c19-4388ec7f85f4 req-1459fb78-d225-49c7-96dd-1b50825c8092 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:39.176309 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0706bbb7-5c90-4e80-9c19-4388ec7f85f4 req-1459fb78-d225-49c7-96dd-1b50825c8092 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf1ed273-af7e-47a5-ad93-c79b5a374096 HTTP/1.1" status: 200 len: 932 time: 0.0809646 Dec 09 21:41:39.210690 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-d8383b94-8396-4cad-aac4-8611b1a9cdaf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:39.238525 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d57efd61-c875-4082-b2be-e6a93fe210cd None None] Port c06185e2-0b83-4874-8227-34bea6194c4f cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:41:39.253972 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0706bbb7-5c90-4e80-9c19-4388ec7f85f4 req-3b65ac9e-66fb-48a5-804f-22a09c18c6fc tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0722752 Dec 09 21:41:39.434562 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9498848c-06ef-4e6d-9d9e-8ace32de5ed9 req-24831273-8759-46bc-9d5f-aabb57c43ab5 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:39.436925 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9498848c-06ef-4e6d-9d9e-8ace32de5ed9 req-24831273-8759-46bc-9d5f-aabb57c43ab5 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.0723295 Dec 09 21:41:39.455713 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34806) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:39.501549 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-457e07dc-5c44-498a-9eb7-14f188ad1c72 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:39.516963 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9498848c-06ef-4e6d-9d9e-8ace32de5ed9 req-001de35d-03e8-45b4-aee4-61da3ab49807 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0714633 Dec 09 21:41:39.679105 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:39.728500 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-457e07dc-5c44-498a-9eb7-14f188ad1c72 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:39.730839 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-d8383b94-8396-4cad-aac4-8611b1a9cdaf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c06185e2-0b83-4874-8227-34bea6194c4f {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:41:39.737996 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-457e07dc-5c44-498a-9eb7-14f188ad1c72 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:39.741523 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-d8383b94-8396-4cad-aac4-8611b1a9cdaf service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:39.790365 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-d8383b94-8396-4cad-aac4-8611b1a9cdaf service neutron] Transition to ACTIVE for port object c06185e2-0b83-4874-8227-34bea6194c4f will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:41:39.802248 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-457e07dc-5c44-498a-9eb7-14f188ad1c72 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6ad6f4be-ddde-4a6c-8add-3dac12cddb43,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:39.809212 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-457e07dc-5c44-498a-9eb7-14f188ad1c72 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=a0d6290b1ecb45898f0fea507fe67458&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3518922 Dec 09 21:41:39.812829 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34828) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:39.816522 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-d8383b94-8396-4cad-aac4-8611b1a9cdaf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:39.876486 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-45101057-3d12-4d35-99d1-b937fd73e688 None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:41:39.917969 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8383b94-8396-4cad-aac4-8611b1a9cdaf service neutron] Pushing event updated for resources: {'Port': ['ID=c06185e2-0b83-4874-8227-34bea6194c4f,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:39.969874 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-71ed982b-45a7-44da-8591-0da215f0b523 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:40.035883 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-71ed982b-45a7-44da-8591-0da215f0b523 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:40.087065 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-d8383b94-8396-4cad-aac4-8611b1a9cdaf service neutron] Attempting to bind port c06185e2-0b83-4874-8227-34bea6194c4f on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:41:40.087723 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-d8383b94-8396-4cad-aac4-8611b1a9cdaf service neutron] Attempting to bind port c06185e2-0b83-4874-8227-34bea6194c4f by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:41:40.087897 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-d8383b94-8396-4cad-aac4-8611b1a9cdaf service neutron] Attempting to bind port c06185e2-0b83-4874-8227-34bea6194c4f on network ba3aee78-4661-4c71-9b18-af1e6a07faff {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:41:40.091947 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-71ed982b-45a7-44da-8591-0da215f0b523 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:40.093595 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-d8383b94-8396-4cad-aac4-8611b1a9cdaf service neutron] Port c06185e2-0b83-4874-8227-34bea6194c4f on network ba3aee78-4661-4c71-9b18-af1e6a07faff not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:41:40.093722 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-d8383b94-8396-4cad-aac4-8611b1a9cdaf service neutron] Attempting to bind port c06185e2-0b83-4874-8227-34bea6194c4f on network ba3aee78-4661-4c71-9b18-af1e6a07faff {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:41:40.095258 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-71ed982b-45a7-44da-8591-0da215f0b523 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:40.097470 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-71ed982b-45a7-44da-8591-0da215f0b523 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/6ad6f4be-ddde-4a6c-8add-3dac12cddb43 HTTP/1.1" status: 204 len: 168 time: 0.2828784 Dec 09 21:41:40.100083 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-d8383b94-8396-4cad-aac4-8611b1a9cdaf service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 41, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:41:40.100440 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-d8383b94-8396-4cad-aac4-8611b1a9cdaf service neutron] Checking segment: {'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:41:40.100821 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-d8383b94-8396-4cad-aac4-8611b1a9cdaf service neutron] Bound using segment: {'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:41:40.101395 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-d8383b94-8396-4cad-aac4-8611b1a9cdaf service neutron] Bound port: c06185e2-0b83-4874-8227-34bea6194c4f, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:41:40.101765 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-d8383b94-8396-4cad-aac4-8611b1a9cdaf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:40.140368 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71ed982b-45a7-44da-8591-0da215f0b523 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ad6f4be-ddde-4a6c-8add-3dac12cddb43,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:40.251461 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-d8383b94-8396-4cad-aac4-8611b1a9cdaf service neutron] For port c06185e2-0b83-4874-8227-34bea6194c4f, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:41:40.255824 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-d8383b94-8396-4cad-aac4-8611b1a9cdaf service neutron] For port c06185e2-0b83-4874-8227-34bea6194c4f, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=c06185e2-0b83-4874-8227-34bea6194c4f,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:41:40.262403 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-d8383b94-8396-4cad-aac4-8611b1a9cdaf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:40.329827 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e6cc0d5-57e6-44c7-ab3b-0e98f654bfc1 None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:41:40.355270 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-d8383b94-8396-4cad-aac4-8611b1a9cdaf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:40.356313 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-d8383b94-8396-4cad-aac4-8611b1a9cdaf service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:40.359111 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-d8383b94-8396-4cad-aac4-8611b1a9cdaf service neutron] 10.222.0.31 "PUT /v2.0/ports/c06185e2-0b83-4874-8227-34bea6194c4f HTTP/1.1" status: 200 len: 1093 time: 1.2351236 Dec 09 21:41:40.366428 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bf1ed273-af7e-47a5-ad93-c79b5a374096', 'tag': 'c06185e2-0b83-4874-8227-34bea6194c4f'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:41:40.377825 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e3f95bcf-9d15-4fd5-8d42-269af7fd1468" -d '{"events": [{"name": "network-changed", "server_uuid": "bf1ed273-af7e-47a5-ad93-c79b5a374096", "tag": "c06185e2-0b83-4874-8227-34bea6194c4f"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:41:40.469587 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1106a71b-35d4-4413-8e04-3625de72dff2 req-5f7191e4-3b7d-445f-b1dc-4d71cb6520c3 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:40.478342 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1106a71b-35d4-4413-8e04-3625de72dff2 req-5f7191e4-3b7d-445f-b1dc-4d71cb6520c3 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf1ed273-af7e-47a5-ad93-c79b5a374096 HTTP/1.1" status: 200 len: 944 time: 0.0936155 Dec 09 21:41:40.483816 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8383b94-8396-4cad-aac4-8611b1a9cdaf service neutron] Pushing event updated for resources: {'Port': ['ID=c06185e2-0b83-4874-8227-34bea6194c4f,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:40.580021 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1106a71b-35d4-4413-8e04-3625de72dff2 req-4ad8c831-95ff-4940-b315-c12264b0477b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1003358 Dec 09 21:41:40.590784 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-fc869047-533f-4a84-8987-7cf57f25d835 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:40.594605 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-fc869047-533f-4a84-8987-7cf57f25d835 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0569bc74c98b4ae2980de7af929e97eb&device_id=bf1ed273-af7e-47a5-ad93-c79b5a374096 HTTP/1.1" status: 200 len: 1096 time: 0.1371355 Dec 09 21:41:40.683727 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:41:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9cf6ceea-953d-48fd-a5a9-df60274691f6 x-openstack-request-id: req-9cf6ceea-953d-48fd-a5a9-df60274691f6 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:41:40.684239 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bf1ed273-af7e-47a5-ad93-c79b5a374096", "tag": "c06185e2-0b83-4874-8227-34bea6194c4f", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:41:40.684861 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-9cf6ceea-953d-48fd-a5a9-df60274691f6 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:41:40.685667 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bf1ed273-af7e-47a5-ad93-c79b5a374096', 'tag': 'c06185e2-0b83-4874-8227-34bea6194c4f', 'status': 'completed', 'code': 200} Dec 09 21:41:40.688724 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-12aa2df5-18a8-4ebe-bde7-d0c03f60eeca service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=c06185e2-0b83-4874-8227-34bea6194c4f HTTP/1.1" status: 200 len: 217 time: 0.0798843 Dec 09 21:41:40.770435 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-d6c8e078-8552-4474-8f12-9403c2b66dc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:40.772927 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-d6c8e078-8552-4474-8f12-9403c2b66dc6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=b61ac70f-1e8d-40a8-9031-bab15f73fa0a HTTP/1.1" status: 200 len: 845 time: 0.0762763 Dec 09 21:41:40.814991 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-c518150f-7d39-4e79-8800-f0fbce7c10b0 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ba3aee78-4661-4c71-9b18-af1e6a07faff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0351989 Dec 09 21:41:40.885889 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34902) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:40.955696 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-70c8686e-43db-4adb-bb13-0b0682cf79d7 service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1335611 Dec 09 21:41:41.044837 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-582b0996-0353-418b-ba60-e756ab1f631d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:41.132957 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c1b19eeb-4fe1-459d-8414-b5852c3f7745 req-71432780-74e8-474d-acb5-c8076593bf5a service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1703320 Dec 09 21:41:41.151191 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-582b0996-0353-418b-ba60-e756ab1f631d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:41.161331 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-582b0996-0353-418b-ba60-e756ab1f631d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:41.224094 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-582b0996-0353-418b-ba60-e756ab1f631d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3d706c91-b44b-4d1f-95f7-1f89881b0230,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:41.239609 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3f95bcf-9d15-4fd5-8d42-269af7fd1468 req-640b84da-5c66-4351-97eb-50a575e52389 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:41.241422 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e3f95bcf-9d15-4fd5-8d42-269af7fd1468 req-640b84da-5c66-4351-97eb-50a575e52389 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0569bc74c98b4ae2980de7af929e97eb&device_id=bf1ed273-af7e-47a5-ad93-c79b5a374096 HTTP/1.1" status: 200 len: 1096 time: 0.0592391 Dec 09 21:41:41.246413 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34918) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:41.246722 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-582b0996-0353-418b-ba60-e756ab1f631d admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=c47a2c17bd5144af8cf0c38f2526095e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3594947 Dec 09 21:41:41.404707 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dd91056b-170b-4234-ac73-1fd3c31ca661 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:41.437207 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dd91056b-170b-4234-ac73-1fd3c31ca661 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:41.465287 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3f95bcf-9d15-4fd5-8d42-269af7fd1468 req-9509552a-5597-4124-a8ca-ddf1e163a06e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:41.467248 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e3f95bcf-9d15-4fd5-8d42-269af7fd1468 req-9509552a-5597-4124-a8ca-ddf1e163a06e service neutron] 10.222.0.31 "GET /v2.0/networks?id=ba3aee78-4661-4c71-9b18-af1e6a07faff HTTP/1.1" status: 200 len: 906 time: 0.2126856 Dec 09 21:41:41.523182 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e3f95bcf-9d15-4fd5-8d42-269af7fd1468 req-28217876-2c5a-4483-af97-a4e5e59d4c2a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=c06185e2-0b83-4874-8227-34bea6194c4f HTTP/1.1" status: 200 len: 217 time: 0.0466127 Dec 09 21:41:41.593091 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3f95bcf-9d15-4fd5-8d42-269af7fd1468 req-db0326d2-653d-4d12-b0fa-f878eb132ded service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:41.596085 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e3f95bcf-9d15-4fd5-8d42-269af7fd1468 req-db0326d2-653d-4d12-b0fa-f878eb132ded service neutron] 10.222.0.31 "GET /v2.0/subnets?id=b61ac70f-1e8d-40a8-9031-bab15f73fa0a HTTP/1.1" status: 200 len: 845 time: 0.0610106 Dec 09 21:41:41.654008 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dd91056b-170b-4234-ac73-1fd3c31ca661 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:41.654008 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dd91056b-170b-4234-ac73-1fd3c31ca661 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:41.654008 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-dd91056b-170b-4234-ac73-1fd3c31ca661 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/3d706c91-b44b-4d1f-95f7-1f89881b0230 HTTP/1.1" status: 204 len: 168 time: 0.3927958 Dec 09 21:41:41.654008 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd91056b-170b-4234-ac73-1fd3c31ca661 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3d706c91-b44b-4d1f-95f7-1f89881b0230,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:41.687266 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e3f95bcf-9d15-4fd5-8d42-269af7fd1468 req-fd474810-77be-4bcc-8b67-7d33a7ff9c18 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ba3aee78-4661-4c71-9b18-af1e6a07faff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0685539 Dec 09 21:41:41.879046 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b03a6c67-adfb-497a-ad21-06d166236598 req-ecf9706d-cade-428c-96c3-9248029f5a21 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:41.884733 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e3f95bcf-9d15-4fd5-8d42-269af7fd1468 req-08560dce-1cca-40c8-8614-551e21fa590f service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1878104 Dec 09 21:41:41.887487 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b03a6c67-adfb-497a-ad21-06d166236598 req-ecf9706d-cade-428c-96c3-9248029f5a21 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf1ed273-af7e-47a5-ad93-c79b5a374096 HTTP/1.1" status: 200 len: 944 time: 0.1237917 Dec 09 21:41:41.952380 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34946) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:41.988526 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b03a6c67-adfb-497a-ad21-06d166236598 req-5ff03903-6889-48c1-8779-177f51022d0c tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0928845 Dec 09 21:41:42.080852 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e3f95bcf-9d15-4fd5-8d42-269af7fd1468 req-6dd135e3-00b8-4957-bfac-097df6ceafc7 service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1778514 Dec 09 21:41:42.108955 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34952) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:42.131716 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-02e71163-2e98-461c-877c-e960414d89f2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:42.248832 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-02e71163-2e98-461c-877c-e960414d89f2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:42.255412 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-02e71163-2e98-461c-877c-e960414d89f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:42.310172 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-02e71163-2e98-461c-877c-e960414d89f2 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=d5b4e69896f24090b73334f165f56ae9&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1989799 Dec 09 21:41:42.311988 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02e71163-2e98-461c-877c-e960414d89f2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d2b68f4e-9340-4673-b47d-f9267c446920,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:42.312441 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34958) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:42.346795 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dbdf9b6b-cd0e-4a1c-842f-ece43ac4c40f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:42.389992 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c91fdd6-4f93-49cd-8575-9610572017bd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:42.418165 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c91fdd6-4f93-49cd-8575-9610572017bd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:42.464545 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dbdf9b6b-cd0e-4a1c-842f-ece43ac4c40f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:42.471717 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dbdf9b6b-cd0e-4a1c-842f-ece43ac4c40f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:42.476084 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c91fdd6-4f93-49cd-8575-9610572017bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:42.478777 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c91fdd6-4f93-49cd-8575-9610572017bd admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:42.482659 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4c91fdd6-4f93-49cd-8575-9610572017bd admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/d2b68f4e-9340-4673-b47d-f9267c446920 HTTP/1.1" status: 204 len: 168 time: 0.1661341 Dec 09 21:41:42.493491 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c91fdd6-4f93-49cd-8575-9610572017bd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d2b68f4e-9340-4673-b47d-f9267c446920,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:42.551397 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbdf9b6b-cd0e-4a1c-842f-ece43ac4c40f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5daea0f9-bee1-4ba2-8ded-200c413b305e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:42.564669 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-dbdf9b6b-cd0e-4a1c-842f-ece43ac4c40f admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=c2fbec2afd9f4661b0be8d974dc71d9f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6093190 Dec 09 21:41:42.567202 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34964) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:42.632299 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-af34e361-130a-4e16-9f49-58d6931500d2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:42.687813 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-af34e361-130a-4e16-9f49-58d6931500d2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:42.756121 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-af34e361-130a-4e16-9f49-58d6931500d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:42.780799 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-af34e361-130a-4e16-9f49-58d6931500d2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:42.783627 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-af34e361-130a-4e16-9f49-58d6931500d2 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/5daea0f9-bee1-4ba2-8ded-200c413b305e HTTP/1.1" status: 204 len: 168 time: 0.2132773 Dec 09 21:41:42.801761 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af34e361-130a-4e16-9f49-58d6931500d2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5daea0f9-bee1-4ba2-8ded-200c413b305e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:43.211070 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12601030-ca7b-492b-b5b7-7c6398b4b8d5 req-946dcd29-d53b-4dde-b243-23e0b06be618 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:43.212725 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-12601030-ca7b-492b-b5b7-7c6398b4b8d5 req-946dcd29-d53b-4dde-b243-23e0b06be618 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf1ed273-af7e-47a5-ad93-c79b5a374096 HTTP/1.1" status: 200 len: 944 time: 0.1076853 Dec 09 21:41:43.352730 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-12601030-ca7b-492b-b5b7-7c6398b4b8d5 req-04cdb365-ea0b-4bf0-aab9-f0fbd2ab36b1 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1199558 Dec 09 21:41:44.332596 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35090) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:44.492212 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ba25048c-9818-416a-b23f-b84ff49ebd05 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:44.539950 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ba25048c-9818-416a-b23f-b84ff49ebd05 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Publish callbacks [] for floatingip, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:44.560152 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebc5d2a2-e19f-40cf-bccd-0b71ce507ca3 req-0807cf33-4734-4541-801f-e869a61f0828 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:44.579666 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ebc5d2a2-e19f-40cf-bccd-0b71ce507ca3 req-0807cf33-4734-4541-801f-e869a61f0828 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf1ed273-af7e-47a5-ad93-c79b5a374096 HTTP/1.1" status: 200 len: 944 time: 0.1179068 Dec 09 21:41:44.661155 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ebc5d2a2-e19f-40cf-bccd-0b71ce507ca3 req-8d127f9b-d408-4a96-b1c6-c006530e1f61 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0801311 Dec 09 21:41:44.733207 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ba25048c-9818-416a-b23f-b84ff49ebd05 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:44.893943 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-ba25048c-9818-416a-b23f-b84ff49ebd05 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Allocated IP 172.25.3.153 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/6caecca7-c14f-4e8b-a2de-61fe94ef43ed) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:41:45.051914 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ba25048c-9818-416a-b23f-b84ff49ebd05 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:45.096243 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ba25048c-9818-416a-b23f-b84ff49ebd05 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:45.145246 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba25048c-9818-416a-b23f-b84ff49ebd05 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Pushing event updated for resources: {'Port': ['ID=6caecca7-c14f-4e8b-a2de-61fe94ef43ed,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:45.156339 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba25048c-9818-416a-b23f-b84ff49ebd05 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:41:45.158563 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-ba25048c-9818-416a-b23f-b84ff49ebd05 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:41:45.160956 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba25048c-9818-416a-b23f-b84ff49ebd05 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:41:45.204175 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device c06185e2-0b83-4874-8227-34bea6194c4f details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:41:45.291406 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ba25048c-9818-416a-b23f-b84ff49ebd05 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Publish callbacks [] for floatingip, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:45.344358 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port c06185e2-0b83-4874-8227-34bea6194c4f, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=c06185e2-0b83-4874-8227-34bea6194c4f,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:41:45.358067 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'c06185e2-0b83-4874-8227-34bea6194c4f', 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff', 'port_id': 'c06185e2-0b83-4874-8227-34bea6194c4f', 'mac_address': 'fa:16:3e:37:8b:3f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b61ac70f-1e8d-40a8-9031-bab15f73fa0a', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:41:45.358925 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ba25048c-9818-416a-b23f-b84ff49ebd05 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:45.406331 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:45.427218 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c06185e2-0b83-4874-8227-34bea6194c4f {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:41:45.455234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port c06185e2-0b83-4874-8227-34bea6194c4f, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=c06185e2-0b83-4874-8227-34bea6194c4f,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:41:45.462970 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:45.536128 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=c06185e2-0b83-4874-8227-34bea6194c4f,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:45.650865 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ba25048c-9818-416a-b23f-b84ff49ebd05 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:45.660333 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ba25048c-9818-416a-b23f-b84ff49ebd05 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:45.746258 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['c06185e2-0b83-4874-8227-34bea6194c4f'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:41:45.794738 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba25048c-9818-416a-b23f-b84ff49ebd05 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Pushing event updated for resources: {'Port': ['ID=6caecca7-c14f-4e8b-a2de-61fe94ef43ed,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:45.819350 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ba25048c-9818-416a-b23f-b84ff49ebd05 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:45.851599 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ba25048c-9818-416a-b23f-b84ff49ebd05 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:45.855022 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ba25048c-9818-416a-b23f-b84ff49ebd05 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.5202951 Dec 09 21:41:45.858568 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35156) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:45.864699 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-92f52b4a-2ebc-40a4-98bf-4934d371de50 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Request body: {'port': {'name': 'tempest-ExternalNetworksAdminNegativeTestJSON-807607704', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'fixed_ips': [{'ip_address': '172.25.3.153'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:45.892015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7758b9dc-94b5-4f40-a193-e3ff165a8d49 req-5c907fcc-1b31-44db-88ce-55026219a060 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:45.925515 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-92f52b4a-2ebc-40a4-98bf-4934d371de50 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Made reservation on behalf of 852d05af53264b19957cb83debda4fe0 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:41:45.928048 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92f52b4a-2ebc-40a4-98bf-4934d371de50 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:45.935074 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7758b9dc-94b5-4f40-a193-e3ff165a8d49 req-5c907fcc-1b31-44db-88ce-55026219a060 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf1ed273-af7e-47a5-ad93-c79b5a374096 HTTP/1.1" status: 200 len: 945 time: 0.1328604 Dec 09 21:41:45.940448 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92f52b4a-2ebc-40a4-98bf-4934d371de50 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:46.067544 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7758b9dc-94b5-4f40-a193-e3ff165a8d49 req-3d9e4b69-363b-4cec-acda-e025167c85d4 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1242335 Dec 09 21:41:46.112164 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92f52b4a-2ebc-40a4-98bf-4934d371de50 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:46.117477 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-92f52b4a-2ebc-40a4-98bf-4934d371de50 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:46.124033 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-92f52b4a-2ebc-40a4-98bf-4934d371de50 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] device_id is not set on port 08e3a769-bde8-4147-9a40-226c41ac151f yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:41:46.237856 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92f52b4a-2ebc-40a4-98bf-4934d371de50 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4f9a405a-ae94-4bcd-ad0e-90bdfbaff825,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:46.372784 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-92f52b4a-2ebc-40a4-98bf-4934d371de50 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] POST failed (client error): There was a conflict when trying to complete your request. Dec 09 21:41:46.373610 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-92f52b4a-2ebc-40a4-98bf-4934d371de50 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] No notification will be sent due to unsuccessful status code: 409 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:41:46.392577 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-92f52b4a-2ebc-40a4-98bf-4934d371de50 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 409 len: 372 time: 0.5325072 Dec 09 21:41:46.395712 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35166) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:46.536215 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-7ae54f6f-e478-4ab1-a326-5878e4fd5dc7 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Deleting port 6caecca7-c14f-4e8b-a2de-61fe94ef43ed {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:41:46.536549 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ae54f6f-e478-4ab1-a326-5878e4fd5dc7 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:46.632491 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ae54f6f-e478-4ab1-a326-5878e4fd5dc7 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:46.632820 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ae54f6f-e478-4ab1-a326-5878e4fd5dc7 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:46.649445 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-7ae54f6f-e478-4ab1-a326-5878e4fd5dc7 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Calling delete_port for 6caecca7-c14f-4e8b-a2de-61fe94ef43ed owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:41:46.824728 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ae54f6f-e478-4ab1-a326-5878e4fd5dc7 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:46.878283 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ae54f6f-e478-4ab1-a326-5878e4fd5dc7 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Pushing event deleted for resources: {'Port': ['ID=6caecca7-c14f-4e8b-a2de-61fe94ef43ed,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:46.948914 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ae54f6f-e478-4ab1-a326-5878e4fd5dc7 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:46.951856 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ae54f6f-e478-4ab1-a326-5878e4fd5dc7 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:46.956750 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7ae54f6f-e478-4ab1-a326-5878e4fd5dc7 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033 tempest-ExternalNetworksAdminNegativeTestJSON-1844802033-project-admin] 10.222.0.13 "DELETE /v2.0/floatingips/425f1519-1800-43e0-98d3-d6b9091e839d HTTP/1.1" status: 204 len: 168 time: 0.5564773 Dec 09 21:41:47.198766 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device c06185e2-0b83-4874-8227-34bea6194c4f up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:41:47.255476 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9710f87d-c082-47ed-b9b7-2f2fa191200e req-6da0dfd3-a2b9-4aef-a039-437fe89982c1 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:47.257722 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9710f87d-c082-47ed-b9b7-2f2fa191200e req-6da0dfd3-a2b9-4aef-a039-437fe89982c1 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf1ed273-af7e-47a5-ad93-c79b5a374096 HTTP/1.1" status: 200 len: 945 time: 0.0903218 Dec 09 21:41:47.263430 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port c06185e2-0b83-4874-8227-34bea6194c4f completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:41:47.267710 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port c06185e2-0b83-4874-8227-34bea6194c4f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:41:47.268762 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:47.343061 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35192) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:47.343313 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9710f87d-c082-47ed-b9b7-2f2fa191200e req-b7827f37-2f8c-4846-b264-467587e18361 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0785313 Dec 09 21:41:47.378455 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:47.425667 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bf1ed273-af7e-47a5-ad93-c79b5a374096', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c06185e2-0b83-4874-8227-34bea6194c4f'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:41:47.428107 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bdad2d18-25fb-4a6d-93c9-c95261ed2a3c" -d '{"events": [{"server_uuid": "bf1ed273-af7e-47a5-ad93-c79b5a374096", "name": "network-vif-plugged", "status": "completed", "tag": "c06185e2-0b83-4874-8227-34bea6194c4f"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:41:47.442466 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port c06185e2-0b83-4874-8227-34bea6194c4f, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=c06185e2-0b83-4874-8227-34bea6194c4f,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:41:47.450427 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:47.489751 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:41:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-667dcc39-dcf8-4f1f-960b-d1753652fb41 x-openstack-request-id: req-667dcc39-dcf8-4f1f-960b-d1753652fb41 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:41:47.490190 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bf1ed273-af7e-47a5-ad93-c79b5a374096", "name": "network-vif-plugged", "status": "completed", "tag": "c06185e2-0b83-4874-8227-34bea6194c4f", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:41:47.490459 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-667dcc39-dcf8-4f1f-960b-d1753652fb41 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:41:47.490921 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bf1ed273-af7e-47a5-ad93-c79b5a374096', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c06185e2-0b83-4874-8227-34bea6194c4f', 'code': 200} Dec 09 21:41:47.508710 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9746e848-9c98-4bc6-8c9a-f278939de442 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:47.543214 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=c06185e2-0b83-4874-8227-34bea6194c4f,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:47.639282 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-132232a6-520b-4d10-87d0-11af15914fe3 req-52818c8c-9b00-489f-bafa-e62c41726895 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:47.640902 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-132232a6-520b-4d10-87d0-11af15914fe3 req-52818c8c-9b00-489f-bafa-e62c41726895 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=bf1ed273-af7e-47a5-ad93-c79b5a374096 HTTP/1.1" status: 200 len: 1098 time: 0.0666926 Dec 09 21:41:47.642722 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9746e848-9c98-4bc6-8c9a-f278939de442 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:47.648084 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9746e848-9c98-4bc6-8c9a-f278939de442 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:47.708707 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35202) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:47.708952 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9746e848-9c98-4bc6-8c9a-f278939de442 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e7426b8c8bbd480297169b6d11daa5cb&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3636651 Dec 09 21:41:47.712213 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9746e848-9c98-4bc6-8c9a-f278939de442 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=da6030a6-6ac0-4e71-a529-0420b6907faa,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:47.750985 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-132232a6-520b-4d10-87d0-11af15914fe3 req-1c2b9a61-91b9-4a2b-bf1c-e77cd749ffd7 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1000361 Dec 09 21:41:47.790283 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4d87ee1f-b495-448a-8d28-76aa89b49a9c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:47.832734 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4d87ee1f-b495-448a-8d28-76aa89b49a9c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:47.895899 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4d87ee1f-b495-448a-8d28-76aa89b49a9c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:47.899406 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4d87ee1f-b495-448a-8d28-76aa89b49a9c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:47.900748 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4d87ee1f-b495-448a-8d28-76aa89b49a9c admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/da6030a6-6ac0-4e71-a529-0420b6907faa HTTP/1.1" status: 204 len: 168 time: 0.1910496 Dec 09 21:41:47.911105 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d87ee1f-b495-448a-8d28-76aa89b49a9c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=da6030a6-6ac0-4e71-a529-0420b6907faa,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:48.269127 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35222) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:48.313141 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ed31b3da-2e0d-495a-84b9-9f0f30a75efe admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=852d05af53264b19957cb83debda4fe0&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0427938 Dec 09 21:41:48.316912 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35224) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:48.369220 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-41fb5d2d-12d2-43d8-adee-028f1cb7e800 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:48.394509 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-41fb5d2d-12d2-43d8-adee-028f1cb7e800 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:48.455150 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-41fb5d2d-12d2-43d8-adee-028f1cb7e800 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:48.457685 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-41fb5d2d-12d2-43d8-adee-028f1cb7e800 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:48.459911 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-41fb5d2d-12d2-43d8-adee-028f1cb7e800 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/4f9a405a-ae94-4bcd-ad0e-90bdfbaff825 HTTP/1.1" status: 204 len: 168 time: 0.1392841 Dec 09 21:41:48.470980 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41fb5d2d-12d2-43d8-adee-028f1cb7e800 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4f9a405a-ae94-4bcd-ad0e-90bdfbaff825,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:48.478071 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-101cbc51-f27d-43b1-acb8-f889bc5db68d req-9f39cbeb-5e6a-4510-b203-c8452e7dbea6 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:48.483310 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-101cbc51-f27d-43b1-acb8-f889bc5db68d req-9f39cbeb-5e6a-4510-b203-c8452e7dbea6 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf1ed273-af7e-47a5-ad93-c79b5a374096 HTTP/1.1" status: 200 len: 946 time: 0.0692217 Dec 09 21:41:48.560092 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-101cbc51-f27d-43b1-acb8-f889bc5db68d req-f8eefcbe-1e13-42fb-8939-772e6649b4a3 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0706227 Dec 09 21:41:49.385577 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35266) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:49.491863 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-59fbd874-4549-493a-adcb-d7c145912c05 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'network': {'name': 'tempest-NetworksTestDHCPv6-test-network-965695383'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:49.534321 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-59fbd874-4549-493a-adcb-d7c145912c05 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:41:49.538168 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59fbd874-4549-493a-adcb-d7c145912c05 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:49.555748 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59fbd874-4549-493a-adcb-d7c145912c05 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:49.664811 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59fbd874-4549-493a-adcb-d7c145912c05 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:49.670866 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59fbd874-4549-493a-adcb-d7c145912c05 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:49.689667 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d775ea95-f18a-49ec-a3c6-c08236eeaa1b req-20b5d9be-3a8b-4fe0-9052-c96b0a2faa73 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:49.692079 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d775ea95-f18a-49ec-a3c6-c08236eeaa1b req-20b5d9be-3a8b-4fe0-9052-c96b0a2faa73 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf1ed273-af7e-47a5-ad93-c79b5a374096 HTTP/1.1" status: 200 len: 946 time: 0.0617712 Dec 09 21:41:49.711159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-59fbd874-4549-493a-adcb-d7c145912c05 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] vlan segment allocate from pool success with {'vlan_id': 127, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:41:49.718608 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59fbd874-4549-493a-adcb-d7c145912c05 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'SecurityGroup': ['ID=26615c33-7048-445b-bf7c-2e2f29ffde7b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:49.727109 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59fbd874-4549-493a-adcb-d7c145912c05 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:49.727477 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-59fbd874-4549-493a-adcb-d7c145912c05 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Added segment 56db00b1-67f7-405d-a5c3-b33daa0250c6 of type vlan for network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee Dec 09 21:41:49.750424 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d775ea95-f18a-49ec-a3c6-c08236eeaa1b req-a1cffc04-27b1-459a-a928-00ebe568e552 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517199 Dec 09 21:41:49.781011 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59fbd874-4549-493a-adcb-d7c145912c05 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:49.812438 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59fbd874-4549-493a-adcb-d7c145912c05 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:49.820367 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-59fbd874-4549-493a-adcb-d7c145912c05 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:49.821015 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59fbd874-4549-493a-adcb-d7c145912c05 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:49.870360 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-59fbd874-4549-493a-adcb-d7c145912c05 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 785 time: 0.4801955 Dec 09 21:41:49.870614 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35282) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:49.914487 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d45dc752-589d-49e4-88d9-dbcb08f17e99 req-ae633937-95ad-4f9e-8ac0-f78afa6d9f23 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:49.926361 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d45dc752-589d-49e4-88d9-dbcb08f17e99 req-ae633937-95ad-4f9e-8ac0-f78afa6d9f23 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a HTTP/1.1" status: 200 len: 945 time: 0.0798516 Dec 09 21:41:49.955898 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-eeb3622b-1106-4859-a3a0-a855f7598f81 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:49.976157 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59fbd874-4549-493a-adcb-d7c145912c05 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Network': ['ID=77d1c069-bca4-4157-a30b-fb10cbd9d9ee,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:49.995021 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:41:50.037783 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d45dc752-589d-49e4-88d9-dbcb08f17e99 req-1c58ca49-c3c4-4127-a6b1-437feee49bbd tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1104956 Dec 09 21:41:50.127041 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eeb3622b-1106-4859-a3a0-a855f7598f81 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:41:50.131792 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eeb3622b-1106-4859-a3a0-a855f7598f81 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:50.187565 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8682af-e4a4-4f0a-a68a-aaa67e706f66 req-3c276f95-8494-4b48-b28c-da87731e4cd6 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:50.189566 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4a8682af-e4a4-4f0a-a68a-aaa67e706f66 req-3c276f95-8494-4b48-b28c-da87731e4cd6 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf1ed273-af7e-47a5-ad93-c79b5a374096 HTTP/1.1" status: 200 len: 946 time: 0.0673945 Dec 09 21:41:50.252974 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4a8682af-e4a4-4f0a-a68a-aaa67e706f66 req-91b3c368-a743-4847-ba74-7943ab18404c tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0563064 Dec 09 21:41:50.368937 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eeb3622b-1106-4859-a3a0-a855f7598f81 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:50.459744 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eeb3622b-1106-4859-a3a0-a855f7598f81 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=9c6b9851-a504-42e3-880c-30bff70c1a84,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:50.461931 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eeb3622b-1106-4859-a3a0-a855f7598f81 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Checking segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:41:50.462376 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eeb3622b-1106-4859-a3a0-a855f7598f81 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network hostable DHCP agents. Network: 77d1c069-bca4-4157-a30b-fb10cbd9d9ee, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:41:50.500629 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eeb3622b-1106-4859-a3a0-a855f7598f81 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:41:50.514558 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-eeb3622b-1106-4859-a3a0-a855f7598f81 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 77d1c069-bca4-4157-a30b-fb10cbd9d9ee) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:41:50.520055 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eeb3622b-1106-4859-a3a0-a855f7598f81 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:50.520864 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eeb3622b-1106-4859-a3a0-a855f7598f81 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:50.524746 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60889e35-5af2-485c-848c-4fde08e65161 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:41:50.550199 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-eeb3622b-1106-4859-a3a0-a855f7598f81 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.6785374 Dec 09 21:41:50.553071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35304) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:50.565941 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-79ff914b-7a5e-4b51-8096-bf9202fa7761 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'name': 'tempest-NetworksTestDHCPv6-715240233'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:50.625404 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bcbad46-48e4-4aa3-abe5-05a973dc62f7 req-685502d0-250b-4bf0-952a-b2d17b69c2b7 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:50.635726 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5bcbad46-48e4-4aa3-abe5-05a973dc62f7 req-685502d0-250b-4bf0-952a-b2d17b69c2b7 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf1ed273-af7e-47a5-ad93-c79b5a374096 HTTP/1.1" status: 200 len: 946 time: 0.0865741 Dec 09 21:41:50.657643 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b75fa62-8475-4e4a-adc0-32e46c8b903e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'fixed_ips': [{'subnet_id': '9c6b9851-a504-42e3-880c-30bff70c1a84'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:41:50.658962 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0b75fa62-8475-4e4a-adc0-32e46c8b903e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:50.746600 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5bcbad46-48e4-4aa3-abe5-05a973dc62f7 req-2b16e59b-32ea-448f-873f-67c4dd8bca63 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1024885 Dec 09 21:41:50.769252 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-79ff914b-7a5e-4b51-8096-bf9202fa7761 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:41:50.774465 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-79ff914b-7a5e-4b51-8096-bf9202fa7761 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:50.799525 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-79ff914b-7a5e-4b51-8096-bf9202fa7761 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] device_id is not set on port 6dd857e0-5db3-4836-a88d-270b5a47ecc7 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:41:50.852228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-0b75fa62-8475-4e4a-adc0-32e46c8b903e None None] Allocated IP 2001:db8::2 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/9c6b9851-a504-42e3-880c-30bff70c1a84/f9c19806-ccbd-44fc-806f-94c01ac8ac9d) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:41:51.027810 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0b75fa62-8475-4e4a-adc0-32e46c8b903e None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:51.036172 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0b75fa62-8475-4e4a-adc0-32e46c8b903e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:51.084214 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b75fa62-8475-4e4a-adc0-32e46c8b903e None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:41:51.089032 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-0b75fa62-8475-4e4a-adc0-32e46c8b903e None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:41:51.097104 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b75fa62-8475-4e4a-adc0-32e46c8b903e None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:41:51.103982 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b75fa62-8475-4e4a-adc0-32e46c8b903e None None] Pushing event updated for resources: {'Port': ['ID=f9c19806-ccbd-44fc-806f-94c01ac8ac9d,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:51.127664 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-79ff914b-7a5e-4b51-8096-bf9202fa7761 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8::1d6 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/9c6b9851-a504-42e3-880c-30bff70c1a84/6dd857e0-5db3-4836-a88d-270b5a47ecc7) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:41:51.168052 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0b75fa62-8475-4e4a-adc0-32e46c8b903e None None] Attempting to bind port f9c19806-ccbd-44fc-806f-94c01ac8ac9d on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:41:51.168425 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0b75fa62-8475-4e4a-adc0-32e46c8b903e None None] Attempting to bind port f9c19806-ccbd-44fc-806f-94c01ac8ac9d by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:41:51.169157 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b75fa62-8475-4e4a-adc0-32e46c8b903e None None] Attempting to bind port f9c19806-ccbd-44fc-806f-94c01ac8ac9d on network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:41:51.178629 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b75fa62-8475-4e4a-adc0-32e46c8b903e None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 41, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:41:51.178900 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b75fa62-8475-4e4a-adc0-32e46c8b903e None None] Checking segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:41:51.179085 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0b75fa62-8475-4e4a-adc0-32e46c8b903e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:51.179770 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b75fa62-8475-4e4a-adc0-32e46c8b903e None None] Bound using segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:41:51.180497 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0b75fa62-8475-4e4a-adc0-32e46c8b903e None None] Bound port: f9c19806-ccbd-44fc-806f-94c01ac8ac9d, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:41:51.180892 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0b75fa62-8475-4e4a-adc0-32e46c8b903e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:51.259816 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0b75fa62-8475-4e4a-adc0-32e46c8b903e None None] For port f9c19806-ccbd-44fc-806f-94c01ac8ac9d, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:41:51.264161 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0b75fa62-8475-4e4a-adc0-32e46c8b903e None None] For port f9c19806-ccbd-44fc-806f-94c01ac8ac9d, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f9c19806-ccbd-44fc-806f-94c01ac8ac9d,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:41:51.270096 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0b75fa62-8475-4e4a-adc0-32e46c8b903e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:51.328254 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-79ff914b-7a5e-4b51-8096-bf9202fa7761 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:51.353655 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b75fa62-8475-4e4a-adc0-32e46c8b903e None None] Pushing event updated for resources: {'Port': ['ID=f9c19806-ccbd-44fc-806f-94c01ac8ac9d,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:51.386111 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-79ff914b-7a5e-4b51-8096-bf9202fa7761 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:51.438489 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-79ff914b-7a5e-4b51-8096-bf9202fa7761 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:41:51.441619 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-79ff914b-7a5e-4b51-8096-bf9202fa7761 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:41:51.448254 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79ff914b-7a5e-4b51-8096-bf9202fa7761 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:41:51.454824 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-79ff914b-7a5e-4b51-8096-bf9202fa7761 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:51.455518 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-79ff914b-7a5e-4b51-8096-bf9202fa7761 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:51.462395 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79ff914b-7a5e-4b51-8096-bf9202fa7761 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=6dd857e0-5db3-4836-a88d-270b5a47ecc7,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:51.483098 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-79ff914b-7a5e-4b51-8096-bf9202fa7761 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 0.9288127 Dec 09 21:41:51.483875 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35324) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:51.538827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e71f95d7-ddcc-4d3d-af92-150f329547fc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:51.561749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e71f95d7-ddcc-4d3d-af92-150f329547fc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:51.567134 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35326) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:51.581175 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e71f95d7-ddcc-4d3d-af92-150f329547fc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1668 time: 0.0949681 Dec 09 21:41:51.700993 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-4d8c19ec-edf2-4672-b020-40fd57ccf077 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting port 6dd857e0-5db3-4836-a88d-270b5a47ecc7 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:41:51.701685 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d8c19ec-edf2-4672-b020-40fd57ccf077 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:51.855276 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d8c19ec-edf2-4672-b020-40fd57ccf077 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:51.871557 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-4d8c19ec-edf2-4672-b020-40fd57ccf077 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Calling delete_port for 6dd857e0-5db3-4836-a88d-270b5a47ecc7 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:41:51.924591 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4921590-8746-4e18-9990-a22270082c38 req-569404a6-c766-4f5f-9136-3ae81b1adc8d tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:51.926353 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4921590-8746-4e18-9990-a22270082c38 req-569404a6-c766-4f5f-9136-3ae81b1adc8d tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf1ed273-af7e-47a5-ad93-c79b5a374096 HTTP/1.1" status: 200 len: 946 time: 0.0939136 Dec 09 21:41:51.983999 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4921590-8746-4e18-9990-a22270082c38 req-ed401cc5-1de2-42c6-a1bd-6890cd4e0c56 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503838 Dec 09 21:41:52.072278 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d8c19ec-edf2-4672-b020-40fd57ccf077 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:52.082164 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-034f8a4f-4a24-46f5-8e54-d06caebd8f90 req-a6706dd3-643e-4840-a47d-4d012e1a4f8d tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:52.088807 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-034f8a4f-4a24-46f5-8e54-d06caebd8f90 req-a6706dd3-643e-4840-a47d-4d012e1a4f8d tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "GET /v2.0/ports?device_id=bf1ed273-af7e-47a5-ad93-c79b5a374096 HTTP/1.1" status: 200 len: 946 time: 0.0890353 Dec 09 21:41:52.197589 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d8c19ec-edf2-4672-b020-40fd57ccf077 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Port': ['ID=6dd857e0-5db3-4836-a88d-270b5a47ecc7,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:52.236011 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d8c19ec-edf2-4672-b020-40fd57ccf077 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:52.239592 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4d8c19ec-edf2-4672-b020-40fd57ccf077 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/6dd857e0-5db3-4836-a88d-270b5a47ecc7 HTTP/1.1" status: 204 len: 168 time: 0.6713021 Dec 09 21:41:52.242282 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35336) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:52.261321 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-034f8a4f-4a24-46f5-8e54-d06caebd8f90 req-aa69531d-adb9-45a1-908b-efa93b5b3191 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Deleting port c06185e2-0b83-4874-8227-34bea6194c4f {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:41:52.261730 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-034f8a4f-4a24-46f5-8e54-d06caebd8f90 req-aa69531d-adb9-45a1-908b-efa93b5b3191 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:52.395589 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ff128da-9f84-4ef9-9f4a-2d45d48c9de6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:52.397119 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ff128da-9f84-4ef9-9f4a-2d45d48c9de6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:52.404652 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35338) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:52.412033 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6ff128da-9f84-4ef9-9f4a-2d45d48c9de6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.1682906 Dec 09 21:41:52.484416 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f9c19806-ccbd-44fc-806f-94c01ac8ac9d up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:41:52.611717 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f9c19806-ccbd-44fc-806f-94c01ac8ac9d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:41:52.612187 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:52.742563 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b2c21af-d32c-474f-95f2-42c725d3b9f4 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:41:52.775609 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:52.891939 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-034f8a4f-4a24-46f5-8e54-d06caebd8f90 req-aa69531d-adb9-45a1-908b-efa93b5b3191 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] For port c06185e2-0b83-4874-8227-34bea6194c4f, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=c06185e2-0b83-4874-8227-34bea6194c4f,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:41:52.892697 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-034f8a4f-4a24-46f5-8e54-d06caebd8f90 req-aa69531d-adb9-45a1-908b-efa93b5b3191 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:52.909513 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port f9c19806-ccbd-44fc-806f-94c01ac8ac9d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f9c19806-ccbd-44fc-806f-94c01ac8ac9d,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:41:52.911405 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e09c8d88-f090-480b-8c35-2a49c1cb88a0 None None] Provisioning complete for port f9c19806-ccbd-44fc-806f-94c01ac8ac9d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:41:52.911822 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e09c8d88-f090-480b-8c35-2a49c1cb88a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:52.916655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-ea3d0690-e817-4ce3-bab9-466dc631539a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet 9c6b9851-a504-42e3-880c-30bff70c1a84 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:41:52.920266 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-034f8a4f-4a24-46f5-8e54-d06caebd8f90 req-aa69531d-adb9-45a1-908b-efa93b5b3191 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Calling delete_port for c06185e2-0b83-4874-8227-34bea6194c4f owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:41:52.922079 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea3d0690-e817-4ce3-bab9-466dc631539a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:52.980453 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:53.006256 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea3d0690-e817-4ce3-bab9-466dc631539a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:53.058674 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=f9c19806-ccbd-44fc-806f-94c01ac8ac9d,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:53.170996 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea3d0690-e817-4ce3-bab9-466dc631539a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:53.238142 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef561157-dcc9-4f12-aa20-2625722ddd3b req-bd864c36-e79f-498c-9ff2-dc38d3481c42 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:53.244193 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef561157-dcc9-4f12-aa20-2625722ddd3b req-bd864c36-e79f-498c-9ff2-dc38d3481c42 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf1ed273-af7e-47a5-ad93-c79b5a374096 HTTP/1.1" status: 200 len: 946 time: 0.1145542 Dec 09 21:41:53.289837 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-034f8a4f-4a24-46f5-8e54-d06caebd8f90 req-aa69531d-adb9-45a1-908b-efa93b5b3191 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:53.310877 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['5df02334-3682-4a91-b22d-133fa1bcb473', 'de990eaf-2240-4c12-a088-f35dc0caa498', 'c06185e2-0b83-4874-8227-34bea6194c4f'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:41:53.348672 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa69531d-adb9-45a1-908b-efa93b5b3191 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Pushing event deleted for resources: {'Port': ['ID=c06185e2-0b83-4874-8227-34bea6194c4f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:53.355343 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea3d0690-e817-4ce3-bab9-466dc631539a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:53.377417 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef561157-dcc9-4f12-aa20-2625722ddd3b req-39888387-f218-477a-8f88-9e3985fcaaee tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1300538 Dec 09 21:41:53.416215 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea3d0690-e817-4ce3-bab9-466dc631539a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=9c6b9851-a504-42e3-880c-30bff70c1a84,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:53.474626 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea3d0690-e817-4ce3-bab9-466dc631539a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:53.481803 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ea3d0690-e817-4ce3-bab9-466dc631539a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/9c6b9851-a504-42e3-880c-30bff70c1a84 HTTP/1.1" status: 204 len: 168 time: 1.0760562 Dec 09 21:41:53.486387 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35352) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:53.501397 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa9c4dad-3504-409c-8aec-0fafa2f2ad7d None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:41:53.527914 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-034f8a4f-4a24-46f5-8e54-d06caebd8f90 req-aa69531d-adb9-45a1-908b-efa93b5b3191 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] No DVR routers for this DVR port c06185e2-0b83-4874-8227-34bea6194c4f on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:41:53.537272 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-034f8a4f-4a24-46f5-8e54-d06caebd8f90 req-aa69531d-adb9-45a1-908b-efa93b5b3191 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:53.541604 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-034f8a4f-4a24-46f5-8e54-d06caebd8f90 req-aa69531d-adb9-45a1-908b-efa93b5b3191 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "DELETE /v2.0/ports/c06185e2-0b83-4874-8227-34bea6194c4f HTTP/1.1" status: 204 len: 173 time: 1.4413722 Dec 09 21:41:53.547291 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bf1ed273-af7e-47a5-ad93-c79b5a374096', 'name': 'network-vif-deleted', 'tag': 'c06185e2-0b83-4874-8227-34bea6194c4f'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:41:53.555001 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bcc45ea0-d678-43c1-b50f-5bef7d8dcbb1" -d '{"events": [{"server_uuid": "bf1ed273-af7e-47a5-ad93-c79b5a374096", "name": "network-vif-deleted", "tag": "c06185e2-0b83-4874-8227-34bea6194c4f"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:41:53.569883 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e5649eb4-f207-4598-b9a2-ad92e687da10 None None] Provisioning complete for port f9c19806-ccbd-44fc-806f-94c01ac8ac9d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:41:53.574643 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e5649eb4-f207-4598-b9a2-ad92e687da10 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:53.624248 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35358) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:53.630062 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-0c3e48ca-754e-416c-9baa-b980641bfd7a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:53.632150 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-07e47b3f-d305-4be5-8090-2b6b308718ca tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1444812 Dec 09 21:41:53.863168 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0c3e48ca-754e-416c-9baa-b980641bfd7a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:41:53.873120 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0c3e48ca-754e-416c-9baa-b980641bfd7a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:53.904157 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c7729b8-df40-4f7d-bc1a-510c436b1e59 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:41:53.908581 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:41:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5b775e17-19a3-41bc-bb7c-83df20a8df59 x-openstack-request-id: req-5b775e17-19a3-41bc-bb7c-83df20a8df59 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:41:53.910483 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bf1ed273-af7e-47a5-ad93-c79b5a374096", "name": "network-vif-deleted", "tag": "c06185e2-0b83-4874-8227-34bea6194c4f", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:41:53.911211 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-5b775e17-19a3-41bc-bb7c-83df20a8df59 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:41:53.912007 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bf1ed273-af7e-47a5-ad93-c79b5a374096', 'name': 'network-vif-deleted', 'tag': 'c06185e2-0b83-4874-8227-34bea6194c4f', 'status': 'completed', 'code': 200} Dec 09 21:41:54.020296 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a14fd884-abd9-4952-85e4-4e7bf87274f4 req-045e0535-a0d8-46d6-93e7-996e5708be32 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:54.028906 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a14fd884-abd9-4952-85e4-4e7bf87274f4 req-045e0535-a0d8-46d6-93e7-996e5708be32 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.0889342 Dec 09 21:41:54.094280 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:41:54.101599 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a14fd884-abd9-4952-85e4-4e7bf87274f4 req-fb98c838-a1e3-4f87-9b4e-8a321fec9aa1 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0715358 Dec 09 21:41:54.145662 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bee32b9-487e-458f-a801-ef20e86e8800 req-4a57ef38-ab22-4f28-bc2c-52eb76fb8089 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:54.147538 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9bee32b9-487e-458f-a801-ef20e86e8800 req-4a57ef38-ab22-4f28-bc2c-52eb76fb8089 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=69d79e96ec1c418aa6c619846f0fe02e&device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 1098 time: 0.2685890 Dec 09 21:41:54.282514 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bee32b9-487e-458f-a801-ef20e86e8800 req-61b23497-4438-42ea-b1b4-779c37017bfd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:54.284336 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9bee32b9-487e-458f-a801-ef20e86e8800 req-61b23497-4438-42ea-b1b4-779c37017bfd service neutron] 10.222.0.31 "GET /v2.0/networks?id=71038cd4-0600-4b06-91f9-ae7f4f4807f9 HTTP/1.1" status: 200 len: 920 time: 0.1190999 Dec 09 21:41:54.414609 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9bee32b9-487e-458f-a801-ef20e86e8800 req-8528f01f-5dad-467f-849f-75801b6ddc3d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=be95aa8d-fc0e-4d77-a861-33c1637e4f3e HTTP/1.1" status: 200 len: 217 time: 0.1204758 Dec 09 21:41:54.418889 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f9c19806-ccbd-44fc-806f-94c01ac8ac9d up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:41:54.452753 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8e5260b2-ae39-4db1-92b2-3259b49a031c None None] Could not find standard attr ID for object 6dd857e0-5db3-4836-a88d-270b5a47ecc7. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:41:54.501117 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f9c19806-ccbd-44fc-806f-94c01ac8ac9d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:41:54.501501 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:54.525606 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bee32b9-487e-458f-a801-ef20e86e8800 req-39309715-e78d-4129-9094-a62652b0aa8d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:54.527152 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9bee32b9-487e-458f-a801-ef20e86e8800 req-39309715-e78d-4129-9094-a62652b0aa8d service neutron] 10.222.0.31 "GET /v2.0/subnets?id=12d97cfc-9264-49cb-8e47-fd225cb6d30b HTTP/1.1" status: 200 len: 859 time: 0.1032257 Dec 09 21:41:54.561040 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd2ffd19-d3d6-4be4-aaaf-5bf170c1b102 None None] DHCP port deletion for 77d1c069-bca4-4157-a30b-fb10cbd9d9ee request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:41:54.570729 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9bee32b9-487e-458f-a801-ef20e86e8800 req-8a0f509a-b4ef-47af-8279-7960ba95f499 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=71038cd4-0600-4b06-91f9-ae7f4f4807f9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0315981 Dec 09 21:41:54.697173 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9bee32b9-487e-458f-a801-ef20e86e8800 req-3feb8802-326c-4eb9-b1b8-92a966a3df70 service neutron] 10.222.0.31 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1171353 Dec 09 21:41:54.698733 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0c3e48ca-754e-416c-9baa-b980641bfd7a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:54.726554 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-cd2ffd19-d3d6-4be4-aaaf-5bf170c1b102 None None] Deleting port f9c19806-ccbd-44fc-806f-94c01ac8ac9d {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:41:54.727111 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cd2ffd19-d3d6-4be4-aaaf-5bf170c1b102 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:54.788310 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c3e48ca-754e-416c-9baa-b980641bfd7a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:41:54.807839 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-0c3e48ca-754e-416c-9baa-b980641bfd7a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:41:54.843843 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-cd2ffd19-d3d6-4be4-aaaf-5bf170c1b102 None None] For port f9c19806-ccbd-44fc-806f-94c01ac8ac9d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f9c19806-ccbd-44fc-806f-94c01ac8ac9d,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:41:54.844302 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cd2ffd19-d3d6-4be4-aaaf-5bf170c1b102 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:54.861691 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c3e48ca-754e-416c-9baa-b980641bfd7a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:54.862441 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0c3e48ca-754e-416c-9baa-b980641bfd7a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:54.864846 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c3e48ca-754e-416c-9baa-b980641bfd7a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=482c803e-3749-42ec-a24f-323ef4987430,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:54.867028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-cd2ffd19-d3d6-4be4-aaaf-5bf170c1b102 None None] Calling delete_port for f9c19806-ccbd-44fc-806f-94c01ac8ac9d owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:41:54.897839 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35372) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:54.898449 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0c3e48ca-754e-416c-9baa-b980641bfd7a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.2726653 Dec 09 21:41:54.907512 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-f79c6383-cfe7-4568-a99e-fd68af58f26c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'name': 'tempest-NetworksTestDHCPv6-892206090'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:54.923547 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9bee32b9-487e-458f-a801-ef20e86e8800 req-08c0780c-4bee-47a5-9616-f1fad5962549 service neutron] 10.222.0.31 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1897876 Dec 09 21:41:54.953936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e531bb-fb0d-4b89-afb4-e854243c5cc6 req-b9b749b0-3954-4d81-89f6-5af05dce7d3c tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:54.955783 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25e531bb-fb0d-4b89-afb4-e854243c5cc6 req-b9b749b0-3954-4d81-89f6-5af05dce7d3c tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a HTTP/1.1" status: 200 len: 945 time: 0.1305928 Dec 09 21:41:54.988000 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cd2ffd19-d3d6-4be4-aaaf-5bf170c1b102 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:55.032838 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd2ffd19-d3d6-4be4-aaaf-5bf170c1b102 None None] Pushing event deleted for resources: {'Port': ['ID=f9c19806-ccbd-44fc-806f-94c01ac8ac9d,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:55.038227 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd2ffd19-d3d6-4be4-aaaf-5bf170c1b102 None None] No DVR routers for this DVR port f9c19806-ccbd-44fc-806f-94c01ac8ac9d on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:41:55.056790 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42a4abbe-57b5-4c92-8136-793e6d9dbd43 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:41:55.078330 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25e531bb-fb0d-4b89-afb4-e854243c5cc6 req-c78460c6-1257-4f01-a0e1-91ef3bb597f3 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1133826 Dec 09 21:41:55.116988 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f79c6383-cfe7-4568-a99e-fd68af58f26c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:41:55.122430 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f79c6383-cfe7-4568-a99e-fd68af58f26c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:55.156623 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-f79c6383-cfe7-4568-a99e-fd68af58f26c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] device_id is not set on port a4b3fa66-2883-4cbe-966c-c264b7f19f7e yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:41:55.218019 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42372243-943d-455e-abef-c4a59a2a2e73 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'fixed_ips': [{'subnet_id': '482c803e-3749-42ec-a24f-323ef4987430'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:41:55.219531 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-42372243-943d-455e-abef-c4a59a2a2e73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:55.318065 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39f13832-7612-4591-b3d8-ee90bac1d890 req-90c6b4db-463d-4cb3-8222-d12ac66dd8de tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:55.319657 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-39f13832-7612-4591-b3d8-ee90bac1d890 req-90c6b4db-463d-4cb3-8222-d12ac66dd8de tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.0943739 Dec 09 21:41:55.355887 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-f79c6383-cfe7-4568-a99e-fd68af58f26c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8::1de (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/482c803e-3749-42ec-a24f-323ef4987430/a4b3fa66-2883-4cbe-966c-c264b7f19f7e) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:41:55.391247 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-39f13832-7612-4591-b3d8-ee90bac1d890 req-fd69e10a-231a-4bbe-9452-7b0b09237386 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0637584 Dec 09 21:41:55.543501 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f79c6383-cfe7-4568-a99e-fd68af58f26c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:55.585121 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f79c6383-cfe7-4568-a99e-fd68af58f26c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:55.630956 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f79c6383-cfe7-4568-a99e-fd68af58f26c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:41:55.634714 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-f79c6383-cfe7-4568-a99e-fd68af58f26c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:41:55.642397 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f79c6383-cfe7-4568-a99e-fd68af58f26c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:41:55.648774 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f79c6383-cfe7-4568-a99e-fd68af58f26c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:55.649845 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f79c6383-cfe7-4568-a99e-fd68af58f26c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:55.662574 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-42372243-943d-455e-abef-c4a59a2a2e73 None None] Allocated IP 2001:db8::2 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/482c803e-3749-42ec-a24f-323ef4987430/02756432-d86f-4584-bd6c-80998470427a) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:41:55.671624 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f79c6383-cfe7-4568-a99e-fd68af58f26c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=a4b3fa66-2883-4cbe-966c-c264b7f19f7e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:55.685349 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35384) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:55.696070 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f79c6383-cfe7-4568-a99e-fd68af58f26c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 0.7961752 Dec 09 21:41:55.753438 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83de1ada-b907-44e6-ba91-4f46c0e4f534 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:55.757779 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-83de1ada-b907-44e6-ba91-4f46c0e4f534 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 929 time: 0.0686917 Dec 09 21:41:55.758162 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35386) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:55.876580 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-ca0cdb36-4654-44a2-92f9-45c6105486ab tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting port a4b3fa66-2883-4cbe-966c-c264b7f19f7e {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:41:55.876954 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ca0cdb36-4654-44a2-92f9-45c6105486ab tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:55.877108 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-42372243-943d-455e-abef-c4a59a2a2e73 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:55.886432 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-42372243-943d-455e-abef-c4a59a2a2e73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:55.950127 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-42372243-943d-455e-abef-c4a59a2a2e73 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:41:55.959503 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-42372243-943d-455e-abef-c4a59a2a2e73 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:41:55.966478 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-42372243-943d-455e-abef-c4a59a2a2e73 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:41:55.970335 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42372243-943d-455e-abef-c4a59a2a2e73 None None] Pushing event updated for resources: {'Port': ['ID=02756432-d86f-4584-bd6c-80998470427a,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:55.986569 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ca0cdb36-4654-44a2-92f9-45c6105486ab tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:55.999686 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-ca0cdb36-4654-44a2-92f9-45c6105486ab tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Calling delete_port for a4b3fa66-2883-4cbe-966c-c264b7f19f7e owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:41:56.034675 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-42372243-943d-455e-abef-c4a59a2a2e73 None None] Attempting to bind port 02756432-d86f-4584-bd6c-80998470427a on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:41:56.035220 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-42372243-943d-455e-abef-c4a59a2a2e73 None None] Attempting to bind port 02756432-d86f-4584-bd6c-80998470427a by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:41:56.035725 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42372243-943d-455e-abef-c4a59a2a2e73 None None] Attempting to bind port 02756432-d86f-4584-bd6c-80998470427a on network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:41:56.042208 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42372243-943d-455e-abef-c4a59a2a2e73 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 41, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:41:56.042691 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42372243-943d-455e-abef-c4a59a2a2e73 None None] Checking segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:41:56.043206 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-42372243-943d-455e-abef-c4a59a2a2e73 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:56.044435 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42372243-943d-455e-abef-c4a59a2a2e73 None None] Bound using segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:41:56.045578 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-42372243-943d-455e-abef-c4a59a2a2e73 None None] Bound port: 02756432-d86f-4584-bd6c-80998470427a, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:41:56.046268 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-42372243-943d-455e-abef-c4a59a2a2e73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:56.129652 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-42372243-943d-455e-abef-c4a59a2a2e73 None None] For port 02756432-d86f-4584-bd6c-80998470427a, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:41:56.149370 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-42372243-943d-455e-abef-c4a59a2a2e73 None None] For port 02756432-d86f-4584-bd6c-80998470427a, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=02756432-d86f-4584-bd6c-80998470427a,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:41:56.158335 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-42372243-943d-455e-abef-c4a59a2a2e73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:56.173761 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ca0cdb36-4654-44a2-92f9-45c6105486ab tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:56.253197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd49d389-777a-4cd2-80be-340785dca6a1 req-6b94f365-4076-4c96-8321-1370cc65f632 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:56.254835 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dd49d389-777a-4cd2-80be-340785dca6a1 req-6b94f365-4076-4c96-8321-1370cc65f632 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "GET /v2.0/ports?device_id=378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a HTTP/1.1" status: 200 len: 945 time: 0.1295767 Dec 09 21:41:56.267623 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca0cdb36-4654-44a2-92f9-45c6105486ab tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Port': ['ID=a4b3fa66-2883-4cbe-966c-c264b7f19f7e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:56.297620 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ca0cdb36-4654-44a2-92f9-45c6105486ab tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:56.303468 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ca0cdb36-4654-44a2-92f9-45c6105486ab tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/a4b3fa66-2883-4cbe-966c-c264b7f19f7e HTTP/1.1" status: 204 len: 168 time: 0.5417228 Dec 09 21:41:56.304009 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35392) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:56.327112 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3379357-ddd6-43c9-b0c8-dec486179625 req-81981ce2-8bba-4775-9faf-25ae51f4d422 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:56.328936 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a3379357-ddd6-43c9-b0c8-dec486179625 req-81981ce2-8bba-4775-9faf-25ae51f4d422 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a HTTP/1.1" status: 200 len: 945 time: 0.1114552 Dec 09 21:41:56.336242 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42372243-943d-455e-abef-c4a59a2a2e73 None None] Pushing event updated for resources: {'Port': ['ID=02756432-d86f-4584-bd6c-80998470427a,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:56.352454 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f9c19806-ccbd-44fc-806f-94c01ac8ac9d no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:41:56.395714 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: f9c19806-ccbd-44fc-806f-94c01ac8ac9d {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:41:56.396055 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f9c19806-ccbd-44fc-806f-94c01ac8ac9d not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:41:56.468262 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee7ecc74-0513-4524-bef2-655cbaee8ffd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:56.474129 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee7ecc74-0513-4524-bef2-655cbaee8ffd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:56.481103 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-dd49d389-777a-4cd2-80be-340785dca6a1 req-78c6fbf9-a33e-45c2-bb7f-73027e98bd86 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Deleting port de990eaf-2240-4c12-a088-f35dc0caa498 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:41:56.483626 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-dd49d389-777a-4cd2-80be-340785dca6a1 req-78c6fbf9-a33e-45c2-bb7f-73027e98bd86 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:56.487610 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ee7ecc74-0513-4524-bef2-655cbaee8ffd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.1827703 Dec 09 21:41:56.492621 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35398) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:56.597928 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-33ced845-21be-44aa-8f0e-de3966818234 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet 482c803e-3749-42ec-a24f-323ef4987430 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:41:56.620324 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a3379357-ddd6-43c9-b0c8-dec486179625 req-339968da-6099-4d58-9bd6-898bb029e46a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2632904 Dec 09 21:41:56.622849 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-33ced845-21be-44aa-8f0e-de3966818234 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:56.697114 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-dd49d389-777a-4cd2-80be-340785dca6a1 req-78c6fbf9-a33e-45c2-bb7f-73027e98bd86 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] For port de990eaf-2240-4c12-a088-f35dc0caa498, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=de990eaf-2240-4c12-a088-f35dc0caa498,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:41:56.697635 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-dd49d389-777a-4cd2-80be-340785dca6a1 req-78c6fbf9-a33e-45c2-bb7f-73027e98bd86 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:56.717866 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-dd49d389-777a-4cd2-80be-340785dca6a1 req-78c6fbf9-a33e-45c2-bb7f-73027e98bd86 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Calling delete_port for de990eaf-2240-4c12-a088-f35dc0caa498 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:41:56.725065 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-33ced845-21be-44aa-8f0e-de3966818234 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:56.851181 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163db369-d494-4c12-be7c-18b2fd1db400 req-3540faa1-6375-4cc9-8fbc-e17c60ceb13a tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:56.860307 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-163db369-d494-4c12-be7c-18b2fd1db400 req-3540faa1-6375-4cc9-8fbc-e17c60ceb13a tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1319656 Dec 09 21:41:56.953235 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-dd49d389-777a-4cd2-80be-340785dca6a1 req-78c6fbf9-a33e-45c2-bb7f-73027e98bd86 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:56.964043 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-163db369-d494-4c12-be7c-18b2fd1db400 req-4fb2e9dc-cadb-4900-be7b-0acf02e9104f tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1026926 Dec 09 21:41:56.967086 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['5df02334-3682-4a91-b22d-133fa1bcb473', 'de990eaf-2240-4c12-a088-f35dc0caa498'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:41:56.967718 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-33ced845-21be-44aa-8f0e-de3966818234 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:57.007512 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78c6fbf9-a33e-45c2-bb7f-73027e98bd86 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Pushing event deleted for resources: {'Port': ['ID=de990eaf-2240-4c12-a088-f35dc0caa498,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:57.026103 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3959238f-8c29-4e0d-a43c-b87695472a9d None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:41:57.055309 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-33ced845-21be-44aa-8f0e-de3966818234 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:57.087103 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-dd49d389-777a-4cd2-80be-340785dca6a1 req-78c6fbf9-a33e-45c2-bb7f-73027e98bd86 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] No DVR routers for this DVR port de990eaf-2240-4c12-a088-f35dc0caa498 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:41:57.092861 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-dd49d389-777a-4cd2-80be-340785dca6a1 req-78c6fbf9-a33e-45c2-bb7f-73027e98bd86 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:57.102082 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33ced845-21be-44aa-8f0e-de3966818234 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=482c803e-3749-42ec-a24f-323ef4987430,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:57.102469 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dd49d389-777a-4cd2-80be-340785dca6a1 req-78c6fbf9-a33e-45c2-bb7f-73027e98bd86 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "DELETE /v2.0/ports/de990eaf-2240-4c12-a088-f35dc0caa498 HTTP/1.1" status: 204 len: 173 time: 0.8370957 Dec 09 21:41:57.103474 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a', 'name': 'network-vif-deleted', 'tag': 'de990eaf-2240-4c12-a088-f35dc0caa498'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:41:57.104036 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-33ced845-21be-44aa-8f0e-de3966818234 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:57.111091 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-33ced845-21be-44aa-8f0e-de3966818234 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/482c803e-3749-42ec-a24f-323ef4987430 HTTP/1.1" status: 204 len: 168 time: 0.6146753 Dec 09 21:41:57.111786 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35400) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:57.111976 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9ce91195-1549-4b04-9968-a55104c5132a" -d '{"events": [{"server_uuid": "378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a", "name": "network-vif-deleted", "tag": "de990eaf-2240-4c12-a088-f35dc0caa498"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:41:57.163785 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d32dfe5c-adaa-4b28-81be-eeb7a5d5b97e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0479147 Dec 09 21:41:57.163785 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35404) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:57.169361 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-affa364b-54f1-4976-a844-74939da7c90f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:57.186375 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:41:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7809d7ee-cbad-4c8f-9612-b5231f3615f0 x-openstack-request-id: req-7809d7ee-cbad-4c8f-9612-b5231f3615f0 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:41:57.186880 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a", "name": "network-vif-deleted", "tag": "de990eaf-2240-4c12-a088-f35dc0caa498", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:41:57.187293 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-7809d7ee-cbad-4c8f-9612-b5231f3615f0 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:41:57.187880 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a', 'name': 'network-vif-deleted', 'tag': 'de990eaf-2240-4c12-a088-f35dc0caa498', 'status': 'completed', 'code': 200} Dec 09 21:41:57.214114 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device c06185e2-0b83-4874-8227-34bea6194c4f no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:41:57.270339 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: c06185e2-0b83-4874-8227-34bea6194c4f {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:41:57.270916 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device c06185e2-0b83-4874-8227-34bea6194c4f not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:41:57.313231 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:57.328877 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:57.329134 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-affa364b-54f1-4976-a844-74939da7c90f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:41:57.333281 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-affa364b-54f1-4976-a844-74939da7c90f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:57.611156 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-affa364b-54f1-4976-a844-74939da7c90f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:57.724508 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-affa364b-54f1-4976-a844-74939da7c90f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:41:57.728046 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-affa364b-54f1-4976-a844-74939da7c90f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:41:57.735462 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-affa364b-54f1-4976-a844-74939da7c90f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:57.736096 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-affa364b-54f1-4976-a844-74939da7c90f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:57.746383 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f7e9b97-07a9-497b-af31-05e54c93a61d None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:41:57.770164 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-affa364b-54f1-4976-a844-74939da7c90f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.6052310 Dec 09 21:41:57.773155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35412) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:57.773982 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-affa364b-54f1-4976-a844-74939da7c90f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=5cd91336-7a75-4036-82f1-7fb521ce3a45,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:57.779541 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-1b8d8e52-9014-4829-a3c5-1570e334af68 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'name': 'tempest-NetworksTestDHCPv6-890207191'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:41:57.860298 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a4d9f30-6b7b-47cc-9764-77f889245f33 req-dabcfe62-2816-48a2-a4cf-09307e16faf8 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=378e8e2b-fb3b-4f85-a173-04ab2bd8fa5a HTTP/1.1" status: 200 len: 210 time: 0.0421917 Dec 09 21:41:57.885608 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f337f0da-7bf4-4a78-9aad-a82d8622e6a7 None None] Provisioning complete for port 02756432-d86f-4584-bd6c-80998470427a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:41:57.886099 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f337f0da-7bf4-4a78-9aad-a82d8622e6a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:58.014900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1b8d8e52-9014-4829-a3c5-1570e334af68 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:41:58.026896 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b8d8e52-9014-4829-a3c5-1570e334af68 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:58.053089 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f337f0da-7bf4-4a78-9aad-a82d8622e6a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:58.077542 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-1b8d8e52-9014-4829-a3c5-1570e334af68 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] device_id is not set on port 52594e2d-3478-4e93-8878-6b6cd71493c0 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:41:58.107198 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f337f0da-7bf4-4a78-9aad-a82d8622e6a7 None None] For port 02756432-d86f-4584-bd6c-80998470427a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=02756432-d86f-4584-bd6c-80998470427a,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:41:58.118120 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f337f0da-7bf4-4a78-9aad-a82d8622e6a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:58.161010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-222892fe-875f-4eea-8b8e-9076a060d305 req-a99aae71-3e74-491e-8f76-698054d7a6b9 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:58.173293 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-222892fe-875f-4eea-8b8e-9076a060d305 req-a99aae71-3e74-491e-8f76-698054d7a6b9 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1154304 Dec 09 21:41:58.206168 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f337f0da-7bf4-4a78-9aad-a82d8622e6a7 None None] Pushing event updated for resources: {'Port': ['ID=02756432-d86f-4584-bd6c-80998470427a,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:58.273831 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-222892fe-875f-4eea-8b8e-9076a060d305 req-fc4e99f8-3114-48d3-b4e6-11b96b35b7d8 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0984190 Dec 09 21:41:58.353090 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-1b8d8e52-9014-4829-a3c5-1570e334af68 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8::33e (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/5cd91336-7a75-4036-82f1-7fb521ce3a45/52594e2d-3478-4e93-8878-6b6cd71493c0) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:41:58.371702 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6675fa23-e04e-49ef-8d0d-9e259c8d2d19 None None] Provisioning complete for port 02756432-d86f-4584-bd6c-80998470427a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:41:58.372534 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6675fa23-e04e-49ef-8d0d-9e259c8d2d19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:58.426646 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 02756432-d86f-4584-bd6c-80998470427a up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:41:58.546617 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 02756432-d86f-4584-bd6c-80998470427a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:41:58.546992 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:58.587859 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b8d8e52-9014-4829-a3c5-1570e334af68 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:58.651880 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b8d8e52-9014-4829-a3c5-1570e334af68 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:58.712672 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1b8d8e52-9014-4829-a3c5-1570e334af68 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:41:58.717527 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-1b8d8e52-9014-4829-a3c5-1570e334af68 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:41:58.719572 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b8d8e52-9014-4829-a3c5-1570e334af68 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=52594e2d-3478-4e93-8878-6b6cd71493c0,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:58.721699 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b8d8e52-9014-4829-a3c5-1570e334af68 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:41:58.728313 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1b8d8e52-9014-4829-a3c5-1570e334af68 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:58.729025 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b8d8e52-9014-4829-a3c5-1570e334af68 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:58.729766 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e76b53a8-99a1-425a-997a-d266e3a4de85 None None] Could not find standard attr ID for object a4b3fa66-2883-4cbe-966c-c264b7f19f7e. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:41:58.754162 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1b8d8e52-9014-4829-a3c5-1570e334af68 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 0.9768291 Dec 09 21:41:58.754162 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35420) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:58.812384 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-517c5fda-68f5-485c-9e7e-71c8bba2d99d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:58.818657 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-517c5fda-68f5-485c-9e7e-71c8bba2d99d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:58.820387 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-517c5fda-68f5-485c-9e7e-71c8bba2d99d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1591 time: 0.0651858 Dec 09 21:41:58.823308 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35422) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:58.950345 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-3d78a0b9-cba5-466f-9b62-294f97b722f7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting port 52594e2d-3478-4e93-8878-6b6cd71493c0 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:41:58.951031 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d78a0b9-cba5-466f-9b62-294f97b722f7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:59.063818 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d78a0b9-cba5-466f-9b62-294f97b722f7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:59.086481 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-3d78a0b9-cba5-466f-9b62-294f97b722f7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Calling delete_port for 52594e2d-3478-4e93-8878-6b6cd71493c0 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:41:59.161196 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-adaa1ab5-6d4e-48fb-a4a4-1b06f1169871 None None] Provisioning complete for port 52594e2d-3478-4e93-8878-6b6cd71493c0 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:41:59.161798 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-adaa1ab5-6d4e-48fb-a4a4-1b06f1169871 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:59.199789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-adaa1ab5-6d4e-48fb-a4a4-1b06f1169871 None None] Port 52594e2d-3478-4e93-8878-6b6cd71493c0 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:41:59.283653 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-df6e5fce-397a-4951-9b2d-67c54590c846 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:59.285186 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-df6e5fce-397a-4951-9b2d-67c54590c846 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/networks?id=ba3aee78-4661-4c71-9b18-af1e6a07faff HTTP/1.1" status: 200 len: 805 time: 0.1346066 Dec 09 21:41:59.319788 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-07388434-3bd6-4772-905d-1164ed8c0d19 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/quotas/0569bc74c98b4ae2980de7af929e97eb HTTP/1.1" status: 200 len: 375 time: 0.0150466 Dec 09 21:41:59.364394 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d78a0b9-cba5-466f-9b62-294f97b722f7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:59.400517 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d78a0b9-cba5-466f-9b62-294f97b722f7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Port': ['ID=52594e2d-3478-4e93-8878-6b6cd71493c0,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:59.414864 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-d32df4e6-fe19-4fa3-b1da-4409a4edf285 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=0569bc74c98b4ae2980de7af929e97eb&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0860963 Dec 09 21:41:59.443426 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d78a0b9-cba5-466f-9b62-294f97b722f7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:59.448862 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3d78a0b9-cba5-466f-9b62-294f97b722f7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/52594e2d-3478-4e93-8878-6b6cd71493c0 HTTP/1.1" status: 204 len: 168 time: 0.6221781 Dec 09 21:41:59.449542 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35448) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:59.537959 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-a1c8847e-9b8e-483d-8d67-b3858d968173 service neutron] 10.222.0.13 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1041825 Dec 09 21:41:59.584182 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80be99c8-cf29-47db-a0c7-6d31465d4caa tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:59.585740 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80be99c8-cf29-47db-a0c7-6d31465d4caa tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:41:59.587329 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-80be99c8-cf29-47db-a0c7-6d31465d4caa tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.1363022 Dec 09 21:41:59.591507 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35450) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:41:59.664604 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-112d0496-9f88-4561-b5fe-a824e8b6d221 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet 5cd91336-7a75-4036-82f1-7fb521ce3a45 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:41:59.673043 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-112d0496-9f88-4561-b5fe-a824e8b6d221 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:59.683084 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-8f96b07b-1548-4cab-b9fb-d6ae7c43d3ec service neutron] 10.222.0.13 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1383259 Dec 09 21:41:59.728718 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-112d0496-9f88-4561-b5fe-a824e8b6d221 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:59.803037 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-112d0496-9f88-4561-b5fe-a824e8b6d221 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:59.917270 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-112d0496-9f88-4561-b5fe-a824e8b6d221 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:59.953733 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-112d0496-9f88-4561-b5fe-a824e8b6d221 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=5cd91336-7a75-4036-82f1-7fb521ce3a45,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:41:59.957487 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-112d0496-9f88-4561-b5fe-a824e8b6d221 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:41:59.962948 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-112d0496-9f88-4561-b5fe-a824e8b6d221 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/5cd91336-7a75-4036-82f1-7fb521ce3a45 HTTP/1.1" status: 204 len: 168 time: 0.3703003 Dec 09 21:41:59.963521 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0aca9131-fb1c-4005-9aa7-e1b77eed2194 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:41:59.964900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35464) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:00.024129 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bb4a861-155a-4f8e-9a31-6c1fea9e4b64 req-c504041b-a6e0-4b23-9a59-d5d0690140df tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:00.033487 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9bb4a861-155a-4f8e-9a31-6c1fea9e4b64 req-c504041b-a6e0-4b23-9a59-d5d0690140df tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.0847342 Dec 09 21:42:00.039407 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3ebe6007-f81d-4868-ba93-a49577ece719 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0728781 Dec 09 21:42:00.041931 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35466) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:00.094987 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-112d0496-9f88-4561-b5fe-a824e8b6d221 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:00.095348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-112d0496-9f88-4561-b5fe-a824e8b6d221 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:00.095735 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-112d0496-9f88-4561-b5fe-a824e8b6d221 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:00.096081 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-112d0496-9f88-4561-b5fe-a824e8b6d221 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:00.096424 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-112d0496-9f88-4561-b5fe-a824e8b6d221 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:00.096776 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-112d0496-9f88-4561-b5fe-a824e8b6d221 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:00.097112 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-112d0496-9f88-4561-b5fe-a824e8b6d221 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:00.097513 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-112d0496-9f88-4561-b5fe-a824e8b6d221 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:00.097855 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-112d0496-9f88-4561-b5fe-a824e8b6d221 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:00.098186 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-112d0496-9f88-4561-b5fe-a824e8b6d221 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:00.098798 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-112d0496-9f88-4561-b5fe-a824e8b6d221 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:00.099186 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-112d0496-9f88-4561-b5fe-a824e8b6d221 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:00.099551 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-112d0496-9f88-4561-b5fe-a824e8b6d221 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:00.104790 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9bb4a861-155a-4f8e-9a31-6c1fea9e4b64 req-9090215d-d146-48c6-8e63-7cd73f7927f8 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0690513 Dec 09 21:42:00.137765 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14d832c2-57eb-4293-929e-64d90d60c0a2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:00.140267 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-14d832c2-57eb-4293-929e-64d90d60c0a2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.0972061 Dec 09 21:42:00.144117 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35472) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:00.189195 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7a17089c-33ac-4ffa-9767-97ce825ab409 None None] DHCP port deletion for 77d1c069-bca4-4157-a30b-fb10cbd9d9ee request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:42:00.207836 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2f9da8df-b768-4705-acd6-4f5ebc4330c6 req-a51794d5-3d4d-43b7-821c-95e742a25cea tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4a7956b4-088b-4bdd-8b57-4f6a070901c3 HTTP/1.1" status: 200 len: 210 time: 0.0412295 Dec 09 21:42:00.244340 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c5d3c8c-e1fc-4d7c-940a-e634a13ee61b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:00.250248 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0c5d3c8c-e1fc-4d7c-940a-e634a13ee61b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0994616 Dec 09 21:42:00.253534 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35474) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:00.270305 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-7a17089c-33ac-4ffa-9767-97ce825ab409 None None] Deleting port 02756432-d86f-4584-bd6c-80998470427a {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:42:00.270930 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7a17089c-33ac-4ffa-9767-97ce825ab409 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:00.332704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35478) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:00.334215 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9c8587b0-0038-48e4-86b9-6e2feccc8164 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0793369 Dec 09 21:42:00.338799 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-d8c93f9c-af3c-4989-be90-62482e65dbb6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:00.357319 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 02756432-d86f-4584-bd6c-80998470427a no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:42:00.394793 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-7a17089c-33ac-4ffa-9767-97ce825ab409 None None] For port 02756432-d86f-4584-bd6c-80998470427a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=02756432-d86f-4584-bd6c-80998470427a,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:00.395192 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7a17089c-33ac-4ffa-9767-97ce825ab409 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:00.432010 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-7a17089c-33ac-4ffa-9767-97ce825ab409 None None] Calling delete_port for 02756432-d86f-4584-bd6c-80998470427a owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:42:00.437924 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d8c93f9c-af3c-4989-be90-62482e65dbb6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:00.442366 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d8c93f9c-af3c-4989-be90-62482e65dbb6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:00.536298 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:00.585082 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 02756432-d86f-4584-bd6c-80998470427a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=02756432-d86f-4584-bd6c-80998470427a,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:00.593977 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:00.638310 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7a17089c-33ac-4ffa-9767-97ce825ab409 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:00.667685 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=02756432-d86f-4584-bd6c-80998470427a,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:00.671276 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7a17089c-33ac-4ffa-9767-97ce825ab409 None None] No DVR routers for this DVR port 02756432-d86f-4584-bd6c-80998470427a on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:42:00.695253 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d8c93f9c-af3c-4989-be90-62482e65dbb6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:00.698846 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a17089c-33ac-4ffa-9767-97ce825ab409 None None] Pushing event deleted for resources: {'Port': ['ID=02756432-d86f-4584-bd6c-80998470427a,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:00.756275 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8c93f9c-af3c-4989-be90-62482e65dbb6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:00.760510 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-d8c93f9c-af3c-4989-be90-62482e65dbb6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:00.766418 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8c93f9c-af3c-4989-be90-62482e65dbb6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:00.766418 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d8c93f9c-af3c-4989-be90-62482e65dbb6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:00.773511 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8c93f9c-af3c-4989-be90-62482e65dbb6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=2f775747-194c-4d27-ac16-9ecb6b957e79,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:00.783730 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b7f093e5-ef2f-4b9c-9c71-ac0d9a03818f None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:42:00.827222 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d8c93f9c-af3c-4989-be90-62482e65dbb6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.4904940 Dec 09 21:42:00.827546 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35486) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:00.834238 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-87d4f55c-cd03-4a4a-9c1f-a966068d5542 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'fixed_ips': [{'subnet_id': '2f775747-194c-4d27-ac16-9ecb6b957e79', 'ip_address': '2001:db8::fd4:3d22:4102:f83a'}], 'name': 'tempest-NetworksTestDHCPv6-809584871'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:00.899909 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a69511f2-025c-4f55-b5b7-4f0b4daf8355 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'fixed_ips': [{'subnet_id': '2f775747-194c-4d27-ac16-9ecb6b957e79'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:42:00.900856 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a69511f2-025c-4f55-b5b7-4f0b4daf8355 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:00.984126 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-87d4f55c-cd03-4a4a-9c1f-a966068d5542 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:01.063698 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-a69511f2-025c-4f55-b5b7-4f0b4daf8355 None None] Allocated IP 2001:db8::2 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/2f775747-194c-4d27-ac16-9ecb6b957e79/578d8817-ea10-4744-8366-9c94d3db728c) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:01.104082 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-87d4f55c-cd03-4a4a-9c1f-a966068d5542 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:01.137710 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-87d4f55c-cd03-4a4a-9c1f-a966068d5542 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] device_id is not set on port 23c57144-274d-43f7-bae1-c0fff8f4365b yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:42:01.237761 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device de990eaf-2240-4c12-a088-f35dc0caa498 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:42:01.319425 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: de990eaf-2240-4c12-a088-f35dc0caa498 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:42:01.320120 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device de990eaf-2240-4c12-a088-f35dc0caa498 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:42:01.323608 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-9037d336-d079-4cba-9aba-510ef12f218c tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:01.325483 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-9037d336-d079-4cba-9aba-510ef12f218c tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "GET /v2.0/networks?id=ba3aee78-4661-4c71-9b18-af1e6a07faff HTTP/1.1" status: 200 len: 805 time: 0.1565368 Dec 09 21:42:01.343742 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-89cb6d7f-789f-429b-8e35-a9f641a1f344 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Request body: {'port': {'device_id': '4a7956b4-088b-4bdd-8b57-4f6a070901c3', 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff', 'admin_state_up': True, 'tenant_id': '0569bc74c98b4ae2980de7af929e97eb'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:01.391541 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88d1e914-5c3d-481c-b993-e3d52314a2b4 req-32e504b2-2076-4877-9571-23d512c0f61a tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:01.400345 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-88d1e914-5c3d-481c-b993-e3d52314a2b4 req-32e504b2-2076-4877-9571-23d512c0f61a tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.0840974 Dec 09 21:42:01.436776 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a69511f2-025c-4f55-b5b7-4f0b4daf8355 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:01.453600 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a69511f2-025c-4f55-b5b7-4f0b4daf8355 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:01.486161 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-89cb6d7f-789f-429b-8e35-a9f641a1f344 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Made reservation on behalf of 0569bc74c98b4ae2980de7af929e97eb for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:01.486758 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-88d1e914-5c3d-481c-b993-e3d52314a2b4 req-f4f3461a-d906-4baf-8888-b7cb28f2c3ab tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0821002 Dec 09 21:42:01.490514 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-89cb6d7f-789f-429b-8e35-a9f641a1f344 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:01.539863 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a69511f2-025c-4f55-b5b7-4f0b4daf8355 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:01.543079 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-a69511f2-025c-4f55-b5b7-4f0b4daf8355 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:01.552157 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a69511f2-025c-4f55-b5b7-4f0b4daf8355 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:42:01.572218 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a69511f2-025c-4f55-b5b7-4f0b4daf8355 None None] Pushing event updated for resources: {'Port': ['ID=578d8817-ea10-4744-8366-9c94d3db728c,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:01.588502 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-87d4f55c-cd03-4a4a-9c1f-a966068d5542 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8::fd4:3d22:4102:f83a (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/2f775747-194c-4d27-ac16-9ecb6b957e79/23c57144-274d-43f7-bae1-c0fff8f4365b) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:01.638565 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cec1b749-1066-4c26-b4b6-b634e939ee4e req-07f8a25e-304b-425a-b564-47362c751311 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4a7956b4-088b-4bdd-8b57-4f6a070901c3 HTTP/1.1" status: 200 len: 210 time: 0.0370657 Dec 09 21:42:01.641510 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a69511f2-025c-4f55-b5b7-4f0b4daf8355 None None] Attempting to bind port 578d8817-ea10-4744-8366-9c94d3db728c on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:42:01.642362 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a69511f2-025c-4f55-b5b7-4f0b4daf8355 None None] Attempting to bind port 578d8817-ea10-4744-8366-9c94d3db728c by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:42:01.642362 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a69511f2-025c-4f55-b5b7-4f0b4daf8355 None None] Attempting to bind port 578d8817-ea10-4744-8366-9c94d3db728c on network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:42:01.648509 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a69511f2-025c-4f55-b5b7-4f0b4daf8355 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 41, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:42:01.648893 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a69511f2-025c-4f55-b5b7-4f0b4daf8355 None None] Checking segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:42:01.649303 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a69511f2-025c-4f55-b5b7-4f0b4daf8355 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:01.649748 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a69511f2-025c-4f55-b5b7-4f0b4daf8355 None None] Bound using segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:42:01.650428 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a69511f2-025c-4f55-b5b7-4f0b4daf8355 None None] Bound port: 578d8817-ea10-4744-8366-9c94d3db728c, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:42:01.650643 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a69511f2-025c-4f55-b5b7-4f0b4daf8355 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:01.667735 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-89cb6d7f-789f-429b-8e35-a9f641a1f344 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Allocated IP 172.20.0.4 (ba3aee78-4661-4c71-9b18-af1e6a07faff/b61ac70f-1e8d-40a8-9031-bab15f73fa0a/dd3f47ad-2e3f-427c-b0e3-e358bb20c496) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:01.729903 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a69511f2-025c-4f55-b5b7-4f0b4daf8355 None None] For port 578d8817-ea10-4744-8366-9c94d3db728c, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:42:01.734620 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a69511f2-025c-4f55-b5b7-4f0b4daf8355 None None] For port 578d8817-ea10-4744-8366-9c94d3db728c, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=578d8817-ea10-4744-8366-9c94d3db728c,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:42:01.741400 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a69511f2-025c-4f55-b5b7-4f0b4daf8355 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:01.833081 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a69511f2-025c-4f55-b5b7-4f0b4daf8355 None None] Pushing event updated for resources: {'Port': ['ID=578d8817-ea10-4744-8366-9c94d3db728c,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:01.940225 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-89cb6d7f-789f-429b-8e35-a9f641a1f344 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:01.989846 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-89cb6d7f-789f-429b-8e35-a9f641a1f344 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:02.003770 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['5df02334-3682-4a91-b22d-133fa1bcb473'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:42:02.051935 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-89cb6d7f-789f-429b-8e35-a9f641a1f344 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Network ba3aee78-4661-4c71-9b18-af1e6a07faff is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:02.056200 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-89cb6d7f-789f-429b-8e35-a9f641a1f344 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:02.077158 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-89cb6d7f-789f-429b-8e35-a9f641a1f344 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:42:02.122365 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-579f0d2b-8898-4bbc-a90a-a1df16cbd328 None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:42:02.133084 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89cb6d7f-789f-429b-8e35-a9f641a1f344 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Pushing event updated for resources: {'Port': ['ID=dd3f47ad-2e3f-427c-b0e3-e358bb20c496,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:02.229605 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-89cb6d7f-789f-429b-8e35-a9f641a1f344 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:02.230947 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-89cb6d7f-789f-429b-8e35-a9f641a1f344 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:02.269283 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-89cb6d7f-789f-429b-8e35-a9f641a1f344 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9339728 Dec 09 21:42:02.285730 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-a5a18f3b-44dc-479e-b7df-25fb2d8d9412 service neutron] Request body: {'port': {'device_id': '4a7956b4-088b-4bdd-8b57-4f6a070901c3', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:02.371015 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-87d4f55c-cd03-4a4a-9c1f-a966068d5542 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:02.396061 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-a5a18f3b-44dc-479e-b7df-25fb2d8d9412 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:02.457423 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 578d8817-ea10-4744-8366-9c94d3db728c up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:42:02.461121 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-87d4f55c-cd03-4a4a-9c1f-a966068d5542 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:02.537990 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87d4f55c-cd03-4a4a-9c1f-a966068d5542 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=23c57144-274d-43f7-bae1-c0fff8f4365b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:02.566391 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-87d4f55c-cd03-4a4a-9c1f-a966068d5542 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:02.573399 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-87d4f55c-cd03-4a4a-9c1f-a966068d5542 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:02.579212 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87d4f55c-cd03-4a4a-9c1f-a966068d5542 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:42:02.595657 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-87d4f55c-cd03-4a4a-9c1f-a966068d5542 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:02.596337 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-87d4f55c-cd03-4a4a-9c1f-a966068d5542 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:02.597061 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8529a86d-9c55-4d84-8e04-b1ca462d4cb0 None None] Provisioning complete for port dd3f47ad-2e3f-427c-b0e3-e358bb20c496 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:02.597624 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8529a86d-9c55-4d84-8e04-b1ca462d4cb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:02.660901 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-8529a86d-9c55-4d84-8e04-b1ca462d4cb0 None None] Port dd3f47ad-2e3f-427c-b0e3-e358bb20c496 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:42:02.673883 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-87d4f55c-cd03-4a4a-9c1f-a966068d5542 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 946 time: 1.8452055 Dec 09 21:42:02.683048 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 578d8817-ea10-4744-8366-9c94d3db728c triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:02.683425 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:02.689667 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35520) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:02.743483 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf5cece0-0068-4824-8068-838689694267 req-59a3a9a3-d9f7-4488-8b98-55763ef204fa tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:02.744992 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf5cece0-0068-4824-8068-838689694267 req-59a3a9a3-d9f7-4488-8b98-55763ef204fa tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1109259 Dec 09 21:42:02.815502 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:02.829789 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf5cece0-0068-4824-8068-838689694267 req-58c8c937-7aa5-4b4c-98d2-cb7dce888c68 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0732222 Dec 09 21:42:02.861268 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a9cf91b9-0f64-473a-ad9e-42c3bd8ede6a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:02.865633 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 578d8817-ea10-4744-8366-9c94d3db728c, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=578d8817-ea10-4744-8366-9c94d3db728c,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:02.867348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a9cf91b9-0f64-473a-ad9e-42c3bd8ede6a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:02.872990 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a9cf91b9-0f64-473a-ad9e-42c3bd8ede6a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1683 time: 0.1783371 Dec 09 21:42:02.873800 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35522) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:02.880038 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:03.055780 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6caf0d38-ea7a-46c1-911c-0d77abdb9b65 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:03.084735 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=578d8817-ea10-4744-8366-9c94d3db728c,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:03.103158 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d1b87cc-17cf-4c4b-8101-21f7e3b62cb8 req-9002a330-2f1e-4ad8-87f4-4db99d9a13eb tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:03.104818 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5d1b87cc-17cf-4c4b-8101-21f7e3b62cb8 req-9002a330-2f1e-4ad8-87f4-4db99d9a13eb tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4a7956b4-088b-4bdd-8b57-4f6a070901c3 HTTP/1.1" status: 200 len: 931 time: 0.1160445 Dec 09 21:42:03.118714 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-a5a18f3b-44dc-479e-b7df-25fb2d8d9412 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id dd3f47ad-2e3f-427c-b0e3-e358bb20c496 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:42:03.128642 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-a5a18f3b-44dc-479e-b7df-25fb2d8d9412 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:03.144464 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-a5a18f3b-44dc-479e-b7df-25fb2d8d9412 service neutron] Transition to ACTIVE for port object dd3f47ad-2e3f-427c-b0e3-e358bb20c496 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:42:03.154151 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-a5a18f3b-44dc-479e-b7df-25fb2d8d9412 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:03.163105 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-70cbc4ad-ce6a-4bb1-a354-d95c8c631ddc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting port 23c57144-274d-43f7-bae1-c0fff8f4365b {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:42:03.164153 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70cbc4ad-ce6a-4bb1-a354-d95c8c631ddc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:03.243898 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6cc81ec5-95b5-4ad9-8ca0-d6e693ed69d1 None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:42:03.261535 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5a18f3b-44dc-479e-b7df-25fb2d8d9412 service neutron] Pushing event updated for resources: {'Port': ['ID=dd3f47ad-2e3f-427c-b0e3-e358bb20c496,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:03.279560 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70cbc4ad-ce6a-4bb1-a354-d95c8c631ddc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:03.296054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-70cbc4ad-ce6a-4bb1-a354-d95c8c631ddc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Calling delete_port for 23c57144-274d-43f7-bae1-c0fff8f4365b owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:42:03.368009 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-a5a18f3b-44dc-479e-b7df-25fb2d8d9412 service neutron] Attempting to bind port dd3f47ad-2e3f-427c-b0e3-e358bb20c496 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:42:03.368351 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-a5a18f3b-44dc-479e-b7df-25fb2d8d9412 service neutron] Attempting to bind port dd3f47ad-2e3f-427c-b0e3-e358bb20c496 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:42:03.368819 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-a5a18f3b-44dc-479e-b7df-25fb2d8d9412 service neutron] Attempting to bind port dd3f47ad-2e3f-427c-b0e3-e358bb20c496 on network ba3aee78-4661-4c71-9b18-af1e6a07faff {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:42:03.374423 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-a5a18f3b-44dc-479e-b7df-25fb2d8d9412 service neutron] Port dd3f47ad-2e3f-427c-b0e3-e358bb20c496 on network ba3aee78-4661-4c71-9b18-af1e6a07faff not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:42:03.375179 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-a5a18f3b-44dc-479e-b7df-25fb2d8d9412 service neutron] Attempting to bind port dd3f47ad-2e3f-427c-b0e3-e358bb20c496 on network ba3aee78-4661-4c71-9b18-af1e6a07faff {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:42:03.375343 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5d1b87cc-17cf-4c4b-8101-21f7e3b62cb8 req-0225ca9c-27b2-41e1-84d9-3a6b31aa35d2 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2598450 Dec 09 21:42:03.380672 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-a5a18f3b-44dc-479e-b7df-25fb2d8d9412 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 41, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:42:03.381023 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-a5a18f3b-44dc-479e-b7df-25fb2d8d9412 service neutron] Checking segment: {'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:42:03.381410 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-a5a18f3b-44dc-479e-b7df-25fb2d8d9412 service neutron] Bound using segment: {'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:42:03.381838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-a5a18f3b-44dc-479e-b7df-25fb2d8d9412 service neutron] Bound port: dd3f47ad-2e3f-427c-b0e3-e358bb20c496, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:42:03.391326 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-a5a18f3b-44dc-479e-b7df-25fb2d8d9412 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:03.488617 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-a5a18f3b-44dc-479e-b7df-25fb2d8d9412 service neutron] For port dd3f47ad-2e3f-427c-b0e3-e358bb20c496, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:42:03.494018 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-a5a18f3b-44dc-479e-b7df-25fb2d8d9412 service neutron] For port dd3f47ad-2e3f-427c-b0e3-e358bb20c496, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=dd3f47ad-2e3f-427c-b0e3-e358bb20c496,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:42:03.499606 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70cbc4ad-ce6a-4bb1-a354-d95c8c631ddc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:03.501614 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-a5a18f3b-44dc-479e-b7df-25fb2d8d9412 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:03.547056 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-a5a18f3b-44dc-479e-b7df-25fb2d8d9412 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:03.547715 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-a5a18f3b-44dc-479e-b7df-25fb2d8d9412 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:03.549154 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-a5a18f3b-44dc-479e-b7df-25fb2d8d9412 service neutron] 10.222.0.31 "PUT /v2.0/ports/dd3f47ad-2e3f-427c-b0e3-e358bb20c496 HTTP/1.1" status: 200 len: 1092 time: 1.2716327 Dec 09 21:42:03.551670 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4a7956b4-088b-4bdd-8b57-4f6a070901c3', 'tag': 'dd3f47ad-2e3f-427c-b0e3-e358bb20c496'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:42:03.563201 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0071715b-a8dc-4780-a119-1be6b4646ccf" -d '{"events": [{"name": "network-changed", "server_uuid": "4a7956b4-088b-4bdd-8b57-4f6a070901c3", "tag": "dd3f47ad-2e3f-427c-b0e3-e358bb20c496"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:42:03.563366 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70cbc4ad-ce6a-4bb1-a354-d95c8c631ddc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:03.586019 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5a18f3b-44dc-479e-b7df-25fb2d8d9412 service neutron] Pushing event updated for resources: {'Port': ['ID=dd3f47ad-2e3f-427c-b0e3-e358bb20c496,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:03.590076 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35530) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:03.593657 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc1b254e-9db6-4bb3-8fd9-22fe1cc0d474 None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:42:03.595586 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-70cbc4ad-ce6a-4bb1-a354-d95c8c631ddc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/23c57144-274d-43f7-bae1-c0fff8f4365b HTTP/1.1" status: 204 len: 168 time: 0.7149661 Dec 09 21:42:03.597536 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70cbc4ad-ce6a-4bb1-a354-d95c8c631ddc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Port': ['ID=23c57144-274d-43f7-bae1-c0fff8f4365b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:03.636116 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:42:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-361cf991-d14c-4a75-94ec-125b17459d41 x-openstack-request-id: req-361cf991-d14c-4a75-94ec-125b17459d41 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:42:03.636410 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4a7956b4-088b-4bdd-8b57-4f6a070901c3", "tag": "dd3f47ad-2e3f-427c-b0e3-e358bb20c496", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:42:03.636660 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-361cf991-d14c-4a75-94ec-125b17459d41 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:42:03.637202 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4a7956b4-088b-4bdd-8b57-4f6a070901c3', 'tag': 'dd3f47ad-2e3f-427c-b0e3-e358bb20c496', 'status': 'completed', 'code': 200} Dec 09 21:42:03.654363 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4d981e3d-d102-4242-8357-ac4571223014 None None] Provisioning complete for port 578d8817-ea10-4744-8366-9c94d3db728c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:03.654853 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4d981e3d-d102-4242-8357-ac4571223014 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:03.690900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2d64c9aa-7505-483d-b60a-b1dad8418539 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:03.692980 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2d64c9aa-7505-483d-b60a-b1dad8418539 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:03.697091 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2d64c9aa-7505-483d-b60a-b1dad8418539 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.1035538 Dec 09 21:42:03.697091 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-10b43fed-23e4-4f40-8cad-1c6970311d84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:03.697668 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35532) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:03.697958 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-10b43fed-23e4-4f40-8cad-1c6970311d84 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0569bc74c98b4ae2980de7af929e97eb&device_id=4a7956b4-088b-4bdd-8b57-4f6a070901c3 HTTP/1.1" status: 200 len: 1095 time: 0.0748496 Dec 09 21:42:03.792356 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-2600174a-8472-4a52-84d4-a87ac68967f0 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=dd3f47ad-2e3f-427c-b0e3-e358bb20c496 HTTP/1.1" status: 200 len: 217 time: 0.0817857 Dec 09 21:42:03.801279 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-50183a94-5fdc-4fa9-90c6-3cd9e2e09ab0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet 2f775747-194c-4d27-ac16-9ecb6b957e79 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:42:03.807732 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-50183a94-5fdc-4fa9-90c6-3cd9e2e09ab0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:03.886575 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-50183a94-5fdc-4fa9-90c6-3cd9e2e09ab0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:03.897084 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-3f856f44-8ea7-4171-af3c-a7877b148119 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:03.903220 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-3f856f44-8ea7-4171-af3c-a7877b148119 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=b61ac70f-1e8d-40a8-9031-bab15f73fa0a HTTP/1.1" status: 200 len: 845 time: 0.1007144 Dec 09 21:42:03.945030 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-66516d15-0d5e-4a41-ae1d-7ccb14faa647 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ba3aee78-4661-4c71-9b18-af1e6a07faff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0334837 Dec 09 21:42:04.039245 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-fdf0f5d2-d02f-4a83-9e4a-95a337bd27cb None None] Could not find standard attr ID for object 23c57144-274d-43f7-bae1-c0fff8f4365b. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:42:04.074835 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-d2f3fd33-6d23-4c56-8b2f-e06baad4a539 service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1206489 Dec 09 21:42:04.117875 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20a8a243-a766-49ae-b088-06499f1ab45d req-4ac19709-2a13-4e2a-aa84-da27155382c4 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:04.119651 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20a8a243-a766-49ae-b088-06499f1ab45d req-4ac19709-2a13-4e2a-aa84-da27155382c4 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1538088 Dec 09 21:42:04.126111 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-50183a94-5fdc-4fa9-90c6-3cd9e2e09ab0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:04.254733 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-001361fc-47e4-4f79-b6c2-3f89829298e1 req-21b49f57-6a72-4303-a936-60f864797304 service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1704144 Dec 09 21:42:04.271501 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20a8a243-a766-49ae-b088-06499f1ab45d req-0a02d7ce-d940-4a55-a3f7-04c225d845e6 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0936546 Dec 09 21:42:04.283860 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-50183a94-5fdc-4fa9-90c6-3cd9e2e09ab0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:04.327755 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50183a94-5fdc-4fa9-90c6-3cd9e2e09ab0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=2f775747-194c-4d27-ac16-9ecb6b957e79,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:04.329798 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-50183a94-5fdc-4fa9-90c6-3cd9e2e09ab0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:04.335703 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-50183a94-5fdc-4fa9-90c6-3cd9e2e09ab0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/2f775747-194c-4d27-ac16-9ecb6b957e79 HTTP/1.1" status: 204 len: 168 time: 0.6350117 Dec 09 21:42:04.336636 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35546) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:04.358448 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 578d8817-ea10-4744-8366-9c94d3db728c up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:42:04.384293 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0071715b-a8dc-4780-a119-1be6b4646ccf req-f366f6a3-3386-4f57-aefb-579fffd84f3d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:04.385952 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0071715b-a8dc-4780-a119-1be6b4646ccf req-f366f6a3-3386-4f57-aefb-579fffd84f3d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0569bc74c98b4ae2980de7af929e97eb&device_id=4a7956b4-088b-4bdd-8b57-4f6a070901c3 HTTP/1.1" status: 200 len: 1095 time: 0.0722079 Dec 09 21:42:04.394600 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f063d140-7279-452b-aeac-8200cf35881f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0539632 Dec 09 21:42:04.401684 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35550) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:04.426925 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6272f61-9098-4da7-8698-f43f5e74bf7e None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:42:04.427350 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2e15d7ba-8518-4fea-89d2-4a4e23f70ccd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:04.520573 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 578d8817-ea10-4744-8366-9c94d3db728c triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:04.521218 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:04.661928 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0071715b-a8dc-4780-a119-1be6b4646ccf req-6ade7cb3-2733-4a4b-a738-2b2dd78631f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:04.663993 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0071715b-a8dc-4780-a119-1be6b4646ccf req-6ade7cb3-2733-4a4b-a738-2b2dd78631f5 service neutron] 10.222.0.31 "GET /v2.0/networks?id=ba3aee78-4661-4c71-9b18-af1e6a07faff HTTP/1.1" status: 200 len: 906 time: 0.2702711 Dec 09 21:42:04.682362 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e15d7ba-8518-4fea-89d2-4a4e23f70ccd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:04.691691 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2e15d7ba-8518-4fea-89d2-4a4e23f70ccd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:04.706684 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-276cb100-b323-4b16-9aaa-b4435545f2da None None] DHCP port deletion for 77d1c069-bca4-4157-a30b-fb10cbd9d9ee request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:42:04.806049 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-276cb100-b323-4b16-9aaa-b4435545f2da None None] Deleting port 578d8817-ea10-4744-8366-9c94d3db728c {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:42:04.806804 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-276cb100-b323-4b16-9aaa-b4435545f2da None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:04.847000 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0071715b-a8dc-4780-a119-1be6b4646ccf req-43ce5622-e030-4019-bfbc-57aef49cfe6a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=dd3f47ad-2e3f-427c-b0e3-e358bb20c496 HTTP/1.1" status: 200 len: 217 time: 0.1751609 Dec 09 21:42:04.901713 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-276cb100-b323-4b16-9aaa-b4435545f2da None None] For port 578d8817-ea10-4744-8366-9c94d3db728c, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=578d8817-ea10-4744-8366-9c94d3db728c,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:04.902117 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-276cb100-b323-4b16-9aaa-b4435545f2da None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:04.914183 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dbec31e-9ce7-415a-b102-ba03759040c1 req-a5594b46-94a9-4f53-8d05-e02ef180596d tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:04.915852 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6dbec31e-9ce7-415a-b102-ba03759040c1 req-a5594b46-94a9-4f53-8d05-e02ef180596d tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4a7956b4-088b-4bdd-8b57-4f6a070901c3 HTTP/1.1" status: 200 len: 943 time: 0.0541577 Dec 09 21:42:04.918693 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-276cb100-b323-4b16-9aaa-b4435545f2da None None] Calling delete_port for 578d8817-ea10-4744-8366-9c94d3db728c owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:42:04.986497 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6dbec31e-9ce7-415a-b102-ba03759040c1 req-370b1c68-4d31-42c5-a373-acd103b5b2d3 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0619254 Dec 09 21:42:05.030456 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0071715b-a8dc-4780-a119-1be6b4646ccf req-b0e75a23-ae4a-460a-9a9a-b5ad42a6c780 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:05.032534 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0071715b-a8dc-4780-a119-1be6b4646ccf req-b0e75a23-ae4a-460a-9a9a-b5ad42a6c780 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=b61ac70f-1e8d-40a8-9031-bab15f73fa0a HTTP/1.1" status: 200 len: 845 time: 0.1346693 Dec 09 21:42:05.049822 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-276cb100-b323-4b16-9aaa-b4435545f2da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:05.069239 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-276cb100-b323-4b16-9aaa-b4435545f2da None None] No DVR routers for this DVR port 578d8817-ea10-4744-8366-9c94d3db728c on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:42:05.079883 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0071715b-a8dc-4780-a119-1be6b4646ccf req-05c4659f-6d52-41fc-b3f3-db65db1d0ba1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ba3aee78-4661-4c71-9b18-af1e6a07faff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0355732 Dec 09 21:42:05.109346 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-276cb100-b323-4b16-9aaa-b4435545f2da None None] Pushing event deleted for resources: {'Port': ['ID=578d8817-ea10-4744-8366-9c94d3db728c,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:05.259258 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0071715b-a8dc-4780-a119-1be6b4646ccf req-2f8de2b0-ac37-4255-9953-8b5349a73287 service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1565564 Dec 09 21:42:05.260880 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2e15d7ba-8518-4fea-89d2-4a4e23f70ccd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:05.412787 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c3bdb11-4d40-44ea-9c9c-3e8f457d60c5 req-cd0ad20b-5ff4-4f92-8184-2e61db34c960 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:05.422599 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c3bdb11-4d40-44ea-9c9c-3e8f457d60c5 req-cd0ad20b-5ff4-4f92-8184-2e61db34c960 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.0692947 Dec 09 21:42:05.487297 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c3bdb11-4d40-44ea-9c9c-3e8f457d60c5 req-ad2a7b34-6f23-4025-818f-6f430afd9b2d tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0632510 Dec 09 21:42:05.558770 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e9c3379b-f2ca-450b-bb6d-d62e90423a5d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:05.744116 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e15d7ba-8518-4fea-89d2-4a4e23f70ccd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:05.750805 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-2e15d7ba-8518-4fea-89d2-4a4e23f70ccd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:05.756600 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e15d7ba-8518-4fea-89d2-4a4e23f70ccd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:05.757223 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2e15d7ba-8518-4fea-89d2-4a4e23f70ccd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:05.760185 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b8c35c6-d965-48e7-8320-edf2aebc661f None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:42:05.798714 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e15d7ba-8518-4fea-89d2-4a4e23f70ccd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=9c770ccc-e62f-4a9b-bbeb-75ee4c0a2658,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:05.834683 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0071715b-a8dc-4780-a119-1be6b4646ccf req-bab5c52b-f55b-4a27-8f55-746bb2baabdc service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5639017 Dec 09 21:42:05.841792 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2e15d7ba-8518-4fea-89d2-4a4e23f70ccd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.4232051 Dec 09 21:42:05.842562 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35560) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:05.849067 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-58f8e9ae-947a-4efd-af06-dfb11f66d549 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'fixed_ips': [{'subnet_id': '9c770ccc-e62f-4a9b-bbeb-75ee4c0a2658', 'ip_address': '2001:db8::83c6:9688:d0ba:486b'}], 'name': 'tempest-NetworksTestDHCPv6-1497729273'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:05.905951 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-59b3d7ac-c8ce-4141-93e0-9d172d78a899 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'fixed_ips': [{'subnet_id': '9c770ccc-e62f-4a9b-bbeb-75ee4c0a2658'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:42:05.906970 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-59b3d7ac-c8ce-4141-93e0-9d172d78a899 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:05.969894 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-58f8e9ae-947a-4efd-af06-dfb11f66d549 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:06.076901 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-59b3d7ac-c8ce-4141-93e0-9d172d78a899 None None] Allocated IP 2001:db8::2 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/9c770ccc-e62f-4a9b-bbeb-75ee4c0a2658/7053200c-0a19-4316-9975-8e2c457fb0a2) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:06.128348 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58f8e9ae-947a-4efd-af06-dfb11f66d549 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:06.147795 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-58f8e9ae-947a-4efd-af06-dfb11f66d549 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] device_id is not set on port 9fc79883-32b4-46bf-b1d0-42710db68f81 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:42:06.213332 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39eb3964-afac-4a5c-9df5-89318e11c320 req-2bdba2e6-39d7-46d1-894a-3c3910ab34e8 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:06.222198 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-39eb3964-afac-4a5c-9df5-89318e11c320 req-2bdba2e6-39d7-46d1-894a-3c3910ab34e8 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4a7956b4-088b-4bdd-8b57-4f6a070901c3 HTTP/1.1" status: 200 len: 943 time: 0.1141498 Dec 09 21:42:06.327609 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-39eb3964-afac-4a5c-9df5-89318e11c320 req-b4f2c256-0887-480d-b452-e70a39372832 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0886042 Dec 09 21:42:06.328413 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 578d8817-ea10-4744-8366-9c94d3db728c no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:42:06.365688 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 578d8817-ea10-4744-8366-9c94d3db728c {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:42:06.366318 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 578d8817-ea10-4744-8366-9c94d3db728c not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:42:06.393138 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-59b3d7ac-c8ce-4141-93e0-9d172d78a899 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:06.400602 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-59b3d7ac-c8ce-4141-93e0-9d172d78a899 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:06.451890 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59b3d7ac-c8ce-4141-93e0-9d172d78a899 None None] Pushing event updated for resources: {'Port': ['ID=7053200c-0a19-4316-9975-8e2c457fb0a2,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:06.462519 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-59b3d7ac-c8ce-4141-93e0-9d172d78a899 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:06.462725 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-58f8e9ae-947a-4efd-af06-dfb11f66d549 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8::83c6:9688:d0ba:486b (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/9c770ccc-e62f-4a9b-bbeb-75ee4c0a2658/9fc79883-32b4-46bf-b1d0-42710db68f81) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:06.464307 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-59b3d7ac-c8ce-4141-93e0-9d172d78a899 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:06.466855 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59b3d7ac-c8ce-4141-93e0-9d172d78a899 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:42:06.529874 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-59b3d7ac-c8ce-4141-93e0-9d172d78a899 None None] Attempting to bind port 7053200c-0a19-4316-9975-8e2c457fb0a2 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:42:06.530379 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-59b3d7ac-c8ce-4141-93e0-9d172d78a899 None None] Attempting to bind port 7053200c-0a19-4316-9975-8e2c457fb0a2 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:42:06.530839 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59b3d7ac-c8ce-4141-93e0-9d172d78a899 None None] Attempting to bind port 7053200c-0a19-4316-9975-8e2c457fb0a2 on network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:42:06.536588 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59b3d7ac-c8ce-4141-93e0-9d172d78a899 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 41, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:42:06.537251 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59b3d7ac-c8ce-4141-93e0-9d172d78a899 None None] Checking segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:42:06.537775 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-59b3d7ac-c8ce-4141-93e0-9d172d78a899 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:06.538238 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59b3d7ac-c8ce-4141-93e0-9d172d78a899 None None] Bound using segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:42:06.538943 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-59b3d7ac-c8ce-4141-93e0-9d172d78a899 None None] Bound port: 7053200c-0a19-4316-9975-8e2c457fb0a2, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:42:06.539454 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-59b3d7ac-c8ce-4141-93e0-9d172d78a899 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:06.623417 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b038187-d2d6-491a-976b-b2fe6904783b req-598f280f-cfa3-424d-97b5-a83a124a23e4 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:06.632532 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b038187-d2d6-491a-976b-b2fe6904783b req-598f280f-cfa3-424d-97b5-a83a124a23e4 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.0703576 Dec 09 21:42:06.670440 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:06.682611 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58f8e9ae-947a-4efd-af06-dfb11f66d549 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:06.695315 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-59b3d7ac-c8ce-4141-93e0-9d172d78a899 None None] For port 7053200c-0a19-4316-9975-8e2c457fb0a2, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:42:06.703259 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-59b3d7ac-c8ce-4141-93e0-9d172d78a899 None None] For port 7053200c-0a19-4316-9975-8e2c457fb0a2, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7053200c-0a19-4316-9975-8e2c457fb0a2,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:42:06.715828 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b038187-d2d6-491a-976b-b2fe6904783b req-ddf40ed6-141b-42ed-b445-6657b9e6db85 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0778382 Dec 09 21:42:06.716690 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-59b3d7ac-c8ce-4141-93e0-9d172d78a899 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:06.770357 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58f8e9ae-947a-4efd-af06-dfb11f66d549 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:06.836257 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-58f8e9ae-947a-4efd-af06-dfb11f66d549 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:06.841363 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-58f8e9ae-947a-4efd-af06-dfb11f66d549 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:06.848151 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58f8e9ae-947a-4efd-af06-dfb11f66d549 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=9fc79883-32b4-46bf-b1d0-42710db68f81,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:06.851471 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58f8e9ae-947a-4efd-af06-dfb11f66d549 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:42:06.853494 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59b3d7ac-c8ce-4141-93e0-9d172d78a899 None None] Pushing event updated for resources: {'Port': ['ID=7053200c-0a19-4316-9975-8e2c457fb0a2,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:06.859247 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-58f8e9ae-947a-4efd-af06-dfb11f66d549 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:06.859997 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58f8e9ae-947a-4efd-af06-dfb11f66d549 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:06.897519 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-58f8e9ae-947a-4efd-af06-dfb11f66d549 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 948 time: 1.0537732 Dec 09 21:42:06.899915 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35570) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:06.968908 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f47d53b5-dee1-4431-acab-a8a645d76589 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:06.976463 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f47d53b5-dee1-4431-acab-a8a645d76589 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:06.979894 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f47d53b5-dee1-4431-acab-a8a645d76589 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1685 time: 0.0777884 Dec 09 21:42:06.981822 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35572) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:07.169759 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-31092bac-712b-498d-a283-c8f787a8318f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting port 9fc79883-32b4-46bf-b1d0-42710db68f81 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:42:07.170121 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31092bac-712b-498d-a283-c8f787a8318f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:07.242339 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device dd3f47ad-2e3f-427c-b0e3-e358bb20c496 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:42:07.320596 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31092bac-712b-498d-a283-c8f787a8318f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:07.344035 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-31092bac-712b-498d-a283-c8f787a8318f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Calling delete_port for 9fc79883-32b4-46bf-b1d0-42710db68f81 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:42:07.533194 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0217a4ab-0595-42d5-88b3-14b9b063d139 req-1ecbf764-9b16-4eea-9c15-6c73d8f0233f tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:07.534018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port dd3f47ad-2e3f-427c-b0e3-e358bb20c496, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=dd3f47ad-2e3f-427c-b0e3-e358bb20c496,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:07.546066 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0217a4ab-0595-42d5-88b3-14b9b063d139 req-1ecbf764-9b16-4eea-9c15-6c73d8f0233f tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4a7956b4-088b-4bdd-8b57-4f6a070901c3 HTTP/1.1" status: 200 len: 943 time: 0.0947580 Dec 09 21:42:07.570970 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'dd3f47ad-2e3f-427c-b0e3-e358bb20c496', 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff', 'port_id': 'dd3f47ad-2e3f-427c-b0e3-e358bb20c496', 'mac_address': 'fa:16:3e:f8:b6:6c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b61ac70f-1e8d-40a8-9031-bab15f73fa0a', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:42:07.647060 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:07.659139 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31092bac-712b-498d-a283-c8f787a8318f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:07.686358 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id dd3f47ad-2e3f-427c-b0e3-e358bb20c496 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:42:07.732316 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0217a4ab-0595-42d5-88b3-14b9b063d139 req-28c1a35d-d935-4020-8a89-b10a094b28e2 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1812818 Dec 09 21:42:07.764700 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port dd3f47ad-2e3f-427c-b0e3-e358bb20c496, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=dd3f47ad-2e3f-427c-b0e3-e358bb20c496,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:07.768122 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31092bac-712b-498d-a283-c8f787a8318f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Port': ['ID=9fc79883-32b4-46bf-b1d0-42710db68f81,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:07.776224 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:07.802973 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-31092bac-712b-498d-a283-c8f787a8318f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:07.810173 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-31092bac-712b-498d-a283-c8f787a8318f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/9fc79883-32b4-46bf-b1d0-42710db68f81 HTTP/1.1" status: 204 len: 168 time: 0.8245699 Dec 09 21:42:07.810516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35582) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:07.921823 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=dd3f47ad-2e3f-427c-b0e3-e358bb20c496,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:07.982051 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9386853-6244-4856-810b-03f55486eb49 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:07.984600 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9386853-6244-4856-810b-03f55486eb49 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:07.985650 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:08.000063 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f9386853-6244-4856-810b-03f55486eb49 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.1882744 Dec 09 21:42:08.000713 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35586) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:08.036725 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['dd3f47ad-2e3f-427c-b0e3-e358bb20c496'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:42:08.061145 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51a065a7-870d-4a1f-b999-f53b0813cc1a req-bb973aa1-0dcc-46eb-8ad8-317168dfc936 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:08.067380 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51a065a7-870d-4a1f-b999-f53b0813cc1a req-bb973aa1-0dcc-46eb-8ad8-317168dfc936 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1076660 Dec 09 21:42:08.137162 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-a6c6903f-f973-4604-affd-dd8351dc33ca tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet 9c770ccc-e62f-4a9b-bbeb-75ee4c0a2658 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:42:08.146385 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a6c6903f-f973-4604-affd-dd8351dc33ca tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:08.191877 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51a065a7-870d-4a1f-b999-f53b0813cc1a req-9d7a8345-9ed0-41a8-890f-98eccdc200aa tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1138852 Dec 09 21:42:08.216633 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a6c6903f-f973-4604-affd-dd8351dc33ca tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:08.376933 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a6c6903f-f973-4604-affd-dd8351dc33ca tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:08.418728 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7053200c-0a19-4316-9975-8e2c457fb0a2 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:42:08.537268 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a6c6903f-f973-4604-affd-dd8351dc33ca tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:08.554824 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5bf4fca0-786c-484d-b45c-7e3c4e3a0b32 None None] Provisioning complete for port 7053200c-0a19-4316-9975-8e2c457fb0a2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:08.555766 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5bf4fca0-786c-484d-b45c-7e3c4e3a0b32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:08.586676 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a6c6903f-f973-4604-affd-dd8351dc33ca tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:08.599705 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 7053200c-0a19-4316-9975-8e2c457fb0a2 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:08.599952 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35590) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:08.600570 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:08.600724 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a6c6903f-f973-4604-affd-dd8351dc33ca tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/9c770ccc-e62f-4a9b-bbeb-75ee4c0a2658 HTTP/1.1" status: 204 len: 168 time: 0.5989106 Dec 09 21:42:08.601900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6c6903f-f973-4604-affd-dd8351dc33ca tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=9c770ccc-e62f-4a9b-bbeb-75ee4c0a2658,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:08.697730 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d7036b27-9ede-4c1c-b2ab-10ba7152aa97 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0957198 Dec 09 21:42:08.700400 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35594) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:08.706876 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-b469e23e-bda3-411f-9b09-ed304af28a7e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:08.737899 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5bf4fca0-786c-484d-b45c-7e3c4e3a0b32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:08.836600 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:08.863536 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-5bf4fca0-786c-484d-b45c-7e3c4e3a0b32 None None] For port 7053200c-0a19-4316-9975-8e2c457fb0a2, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7053200c-0a19-4316-9975-8e2c457fb0a2,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:08.920900 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:42:08.921501 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:42:08.922340 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5bf4fca0-786c-484d-b45c-7e3c4e3a0b32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:08.925568 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24553bde-ed98-4af7-903e-0b78bfd38187 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:42:08.930776 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b469e23e-bda3-411f-9b09-ed304af28a7e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:08.936127 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b469e23e-bda3-411f-9b09-ed304af28a7e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:08.996377 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f9c2e93-216b-435c-9e68-f161d33d86ae req-974ceb03-ad8e-4bd2-a38c-67b380e4a72d tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:08.998046 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0f9c2e93-216b-435c-9e68-f161d33d86ae req-974ceb03-ad8e-4bd2-a38c-67b380e4a72d tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4a7956b4-088b-4bdd-8b57-4f6a070901c3 HTTP/1.1" status: 200 len: 944 time: 0.1311080 Dec 09 21:42:09.059423 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-436e6c54-056b-4a4a-886b-adc581bd3c69 None None] Could not find standard attr ID for object 9fc79883-32b4-46bf-b1d0-42710db68f81. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:42:09.062654 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bf4fca0-786c-484d-b45c-7e3c4e3a0b32 None None] Pushing event updated for resources: {'Port': ['ID=7053200c-0a19-4316-9975-8e2c457fb0a2,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:09.167865 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-39fe4007-a085-4646-8338-c5926df96864 None None] DHCP port deletion for 77d1c069-bca4-4157-a30b-fb10cbd9d9ee request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:42:09.172256 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0f9c2e93-216b-435c-9e68-f161d33d86ae req-1c7ec1be-6978-4e54-8acc-d19ff4f3a18a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1433635 Dec 09 21:42:09.242610 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device dd3f47ad-2e3f-427c-b0e3-e358bb20c496 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:42:09.301377 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-39fe4007-a085-4646-8338-c5926df96864 None None] Deleting port 7053200c-0a19-4316-9975-8e2c457fb0a2 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:42:09.301776 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-39fe4007-a085-4646-8338-c5926df96864 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:09.367344 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b469e23e-bda3-411f-9b09-ed304af28a7e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:09.391959 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-39fe4007-a085-4646-8338-c5926df96864 None None] For port 7053200c-0a19-4316-9975-8e2c457fb0a2, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7053200c-0a19-4316-9975-8e2c457fb0a2,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:09.392505 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-39fe4007-a085-4646-8338-c5926df96864 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:09.395538 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port dd3f47ad-2e3f-427c-b0e3-e358bb20c496 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:42:09.409943 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port dd3f47ad-2e3f-427c-b0e3-e358bb20c496 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:09.410155 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:09.415360 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-39fe4007-a085-4646-8338-c5926df96864 None None] Calling delete_port for 7053200c-0a19-4316-9975-8e2c457fb0a2 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:42:09.431756 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b469e23e-bda3-411f-9b09-ed304af28a7e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:09.436079 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-b469e23e-bda3-411f-9b09-ed304af28a7e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:09.438977 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b469e23e-bda3-411f-9b09-ed304af28a7e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:09.439613 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b469e23e-bda3-411f-9b09-ed304af28a7e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:09.441987 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b469e23e-bda3-411f-9b09-ed304af28a7e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=fe6329f5-6459-4b8f-8b65-5a229901a546,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:09.462038 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd80fff1-93ac-4d6d-b784-9cca4aeb9752 req-6b4b819e-720a-4eb0-a212-95444e3f6801 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:09.463796 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd80fff1-93ac-4d6d-b784-9cca4aeb9752 req-6b4b819e-720a-4eb0-a212-95444e3f6801 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1394143 Dec 09 21:42:09.468492 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b469e23e-bda3-411f-9b09-ed304af28a7e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:09.468838 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b469e23e-bda3-411f-9b09-ed304af28a7e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:09.469396 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b469e23e-bda3-411f-9b09-ed304af28a7e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:09.469548 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b469e23e-bda3-411f-9b09-ed304af28a7e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:09.469823 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b469e23e-bda3-411f-9b09-ed304af28a7e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:09.470218 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b469e23e-bda3-411f-9b09-ed304af28a7e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:09.470462 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b469e23e-bda3-411f-9b09-ed304af28a7e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:09.470788 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b469e23e-bda3-411f-9b09-ed304af28a7e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:09.471108 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b469e23e-bda3-411f-9b09-ed304af28a7e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:09.471473 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b469e23e-bda3-411f-9b09-ed304af28a7e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:09.471881 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b469e23e-bda3-411f-9b09-ed304af28a7e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:09.472082 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b469e23e-bda3-411f-9b09-ed304af28a7e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:09.472399 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b469e23e-bda3-411f-9b09-ed304af28a7e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:09.501257 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b469e23e-bda3-411f-9b09-ed304af28a7e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.7972145 Dec 09 21:42:09.501841 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35600) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:09.506743 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-8f2d15db-0d13-4e4c-a68d-437ea970aa59 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'fixed_ips': [{'subnet_id': 'fe6329f5-6459-4b8f-8b65-5a229901a546', 'ip_address': '2001:db8::a15b:c18c:d186:27dd'}], 'name': 'tempest-NetworksTestDHCPv6-1015942310'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:09.540805 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd80fff1-93ac-4d6d-b784-9cca4aeb9752 req-e98c8a0a-9ba0-46b8-9bbb-3769b9e65372 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0632801 Dec 09 21:42:09.649367 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:09.680208 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8f2d15db-0d13-4e4c-a68d-437ea970aa59 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:09.687651 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8f2d15db-0d13-4e4c-a68d-437ea970aa59 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:09.688721 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:09.691944 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-39fe4007-a085-4646-8338-c5926df96864 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:09.699878 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4a7956b4-088b-4bdd-8b57-4f6a070901c3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dd3f47ad-2e3f-427c-b0e3-e358bb20c496'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:42:09.702682 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-82dc318a-f539-4b36-9253-0f5e2605662a" -d '{"events": [{"server_uuid": "4a7956b4-088b-4bdd-8b57-4f6a070901c3", "name": "network-vif-plugged", "status": "completed", "tag": "dd3f47ad-2e3f-427c-b0e3-e358bb20c496"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:42:09.743619 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-8f2d15db-0d13-4e4c-a68d-437ea970aa59 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] device_id is not set on port 6edd0105-a7bf-411e-94ba-83a832adadce yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:42:09.748071 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port dd3f47ad-2e3f-427c-b0e3-e358bb20c496, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=dd3f47ad-2e3f-427c-b0e3-e358bb20c496,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:09.755017 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:42:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-992a5a0e-24d2-461f-9a33-6be418505b56 x-openstack-request-id: req-992a5a0e-24d2-461f-9a33-6be418505b56 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:42:09.755634 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4a7956b4-088b-4bdd-8b57-4f6a070901c3", "name": "network-vif-plugged", "status": "completed", "tag": "dd3f47ad-2e3f-427c-b0e3-e358bb20c496", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:42:09.756044 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-992a5a0e-24d2-461f-9a33-6be418505b56 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:42:09.756592 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4a7956b4-088b-4bdd-8b57-4f6a070901c3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dd3f47ad-2e3f-427c-b0e3-e358bb20c496', 'code': 200} Dec 09 21:42:09.757584 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39fe4007-a085-4646-8338-c5926df96864 None None] Pushing event deleted for resources: {'Port': ['ID=7053200c-0a19-4316-9975-8e2c457fb0a2,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:09.759892 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39fe4007-a085-4646-8338-c5926df96864 None None] No DVR routers for this DVR port 7053200c-0a19-4316-9975-8e2c457fb0a2 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:42:09.763499 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:09.865357 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12572865-f998-46ff-ac59-8d7d05995030 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:42:09.867848 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=dd3f47ad-2e3f-427c-b0e3-e358bb20c496,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:09.979678 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0f8535d-c536-4355-bba9-3d6d81db96cc req-d7447a3f-12d2-46f3-af89-b3fc58998ed3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:09.992584 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f0f8535d-c536-4355-bba9-3d6d81db96cc req-d7447a3f-12d2-46f3-af89-b3fc58998ed3 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=4a7956b4-088b-4bdd-8b57-4f6a070901c3 HTTP/1.1" status: 200 len: 1097 time: 0.1001797 Dec 09 21:42:10.020528 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1280f149-051d-4b03-ada7-8f6e77842d55 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'fixed_ips': [{'subnet_id': 'fe6329f5-6459-4b8f-8b65-5a229901a546'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:42:10.021814 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1280f149-051d-4b03-ada7-8f6e77842d55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:10.022268 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-8f2d15db-0d13-4e4c-a68d-437ea970aa59 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8::a15b:c18c:d186:27dd (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/fe6329f5-6459-4b8f-8b65-5a229901a546/6edd0105-a7bf-411e-94ba-83a832adadce) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:10.104770 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f0f8535d-c536-4355-bba9-3d6d81db96cc req-032f0caf-9c43-492c-8a0a-f893c020ca7b service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0983150 Dec 09 21:42:10.288968 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8f2d15db-0d13-4e4c-a68d-437ea970aa59 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:10.362073 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8f2d15db-0d13-4e4c-a68d-437ea970aa59 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:10.415591 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e932008-16ac-40a4-9f7a-e2d67507f76d req-fd908ea0-2daf-4c11-b7f4-cb8591e744ad tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:10.431621 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0e932008-16ac-40a4-9f7a-e2d67507f76d req-fd908ea0-2daf-4c11-b7f4-cb8591e744ad tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4a7956b4-088b-4bdd-8b57-4f6a070901c3 HTTP/1.1" status: 200 len: 945 time: 0.1143413 Dec 09 21:42:10.441764 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-1280f149-051d-4b03-ada7-8f6e77842d55 None None] Allocated IP 2001:db8::2 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/fe6329f5-6459-4b8f-8b65-5a229901a546/50be8f30-927f-42f8-bdcc-f44e4d2ddb22) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:10.453128 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8f2d15db-0d13-4e4c-a68d-437ea970aa59 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:10.467386 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-8f2d15db-0d13-4e4c-a68d-437ea970aa59 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:10.473916 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f2d15db-0d13-4e4c-a68d-437ea970aa59 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:42:10.487966 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f2d15db-0d13-4e4c-a68d-437ea970aa59 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:10.488687 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8f2d15db-0d13-4e4c-a68d-437ea970aa59 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:10.499850 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f2d15db-0d13-4e4c-a68d-437ea970aa59 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=6edd0105-a7bf-411e-94ba-83a832adadce,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:10.540878 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8f2d15db-0d13-4e4c-a68d-437ea970aa59 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 948 time: 1.0381312 Dec 09 21:42:10.543533 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35622) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:10.627031 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0e932008-16ac-40a4-9f7a-e2d67507f76d req-b7d34c43-f8e9-4df4-bbb8-ce6255c9af23 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1891232 Dec 09 21:42:10.662447 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7053200c-0a19-4316-9975-8e2c457fb0a2 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:42:10.662933 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-19f7f013-5d15-40a1-8582-1b18daa49db2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:10.687887 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-19f7f013-5d15-40a1-8582-1b18daa49db2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 946 time: 0.1430755 Dec 09 21:42:10.689823 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35626) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:10.699884 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 7053200c-0a19-4316-9975-8e2c457fb0a2 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:42:10.700387 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7053200c-0a19-4316-9975-8e2c457fb0a2 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:42:10.702468 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1280f149-051d-4b03-ada7-8f6e77842d55 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:10.716017 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1280f149-051d-4b03-ada7-8f6e77842d55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:10.787460 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1280f149-051d-4b03-ada7-8f6e77842d55 None None] Pushing event updated for resources: {'Port': ['ID=50be8f30-927f-42f8-bdcc-f44e4d2ddb22,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:10.819693 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1280f149-051d-4b03-ada7-8f6e77842d55 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:10.824226 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-1280f149-051d-4b03-ada7-8f6e77842d55 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:10.831564 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1280f149-051d-4b03-ada7-8f6e77842d55 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:42:10.935990 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55b79b31-f4b0-484d-be57-ae115a047af4 req-0da992f9-25e1-4241-9b57-875553c54fc4 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:10.944630 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-55b79b31-f4b0-484d-be57-ae115a047af4 req-0da992f9-25e1-4241-9b57-875553c54fc4 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.2095613 Dec 09 21:42:10.960805 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-1280f149-051d-4b03-ada7-8f6e77842d55 None None] Attempting to bind port 50be8f30-927f-42f8-bdcc-f44e4d2ddb22 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:42:10.961467 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-1280f149-051d-4b03-ada7-8f6e77842d55 None None] Attempting to bind port 50be8f30-927f-42f8-bdcc-f44e4d2ddb22 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:42:10.963003 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1280f149-051d-4b03-ada7-8f6e77842d55 None None] Attempting to bind port 50be8f30-927f-42f8-bdcc-f44e4d2ddb22 on network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:42:10.971307 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1280f149-051d-4b03-ada7-8f6e77842d55 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 42, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:42:10.972259 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1280f149-051d-4b03-ada7-8f6e77842d55 None None] Checking segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:42:10.973091 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1280f149-051d-4b03-ada7-8f6e77842d55 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:10.974111 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1280f149-051d-4b03-ada7-8f6e77842d55 None None] Bound using segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:42:10.974827 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-1280f149-051d-4b03-ada7-8f6e77842d55 None None] Bound port: 50be8f30-927f-42f8-bdcc-f44e4d2ddb22, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:42:10.976992 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1280f149-051d-4b03-ada7-8f6e77842d55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:11.014598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-38d25604-1d00-4a67-b42c-1e93531d0dce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting port 6edd0105-a7bf-411e-94ba-83a832adadce {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:42:11.015503 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-38d25604-1d00-4a67-b42c-1e93531d0dce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:11.025205 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-55b79b31-f4b0-484d-be57-ae115a047af4 req-71fa57d2-e6ae-4367-bdd2-52f76994d79d tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0789268 Dec 09 21:42:11.104389 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-1280f149-051d-4b03-ada7-8f6e77842d55 None None] For port 50be8f30-927f-42f8-bdcc-f44e4d2ddb22, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:42:11.108751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-1280f149-051d-4b03-ada7-8f6e77842d55 None None] For port 50be8f30-927f-42f8-bdcc-f44e4d2ddb22, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=50be8f30-927f-42f8-bdcc-f44e4d2ddb22,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:42:11.118875 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1280f149-051d-4b03-ada7-8f6e77842d55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:11.199224 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-38d25604-1d00-4a67-b42c-1e93531d0dce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:11.212074 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-38d25604-1d00-4a67-b42c-1e93531d0dce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Calling delete_port for 6edd0105-a7bf-411e-94ba-83a832adadce owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:42:11.224383 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1280f149-051d-4b03-ada7-8f6e77842d55 None None] Pushing event updated for resources: {'Port': ['ID=50be8f30-927f-42f8-bdcc-f44e4d2ddb22,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:11.429174 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-38d25604-1d00-4a67-b42c-1e93531d0dce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:11.498780 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38d25604-1d00-4a67-b42c-1e93531d0dce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Port': ['ID=6edd0105-a7bf-411e-94ba-83a832adadce,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:11.539477 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-38d25604-1d00-4a67-b42c-1e93531d0dce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:11.547385 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-38d25604-1d00-4a67-b42c-1e93531d0dce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/6edd0105-a7bf-411e-94ba-83a832adadce HTTP/1.1" status: 204 len: 168 time: 0.8550348 Dec 09 21:42:11.548989 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35634) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:11.611288 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-883b2c34-28b5-47cb-ba4a-cd6d5d5fe00c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:11.612853 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-883b2c34-28b5-47cb-ba4a-cd6d5d5fe00c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:11.614388 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-883b2c34-28b5-47cb-ba4a-cd6d5d5fe00c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.0637698 Dec 09 21:42:11.617134 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35636) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:11.669639 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-80a463f6-3cbe-4603-90ae-2addcd34e8ed tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet fe6329f5-6459-4b8f-8b65-5a229901a546 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:42:11.673565 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-80a463f6-3cbe-4603-90ae-2addcd34e8ed tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:11.718218 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-80a463f6-3cbe-4603-90ae-2addcd34e8ed tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:11.755628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80e3b727-ecfe-438d-851c-deba3f3d7732 req-97ce1077-d6eb-4fce-a923-4e18faa2b5ab tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:11.757616 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-80e3b727-ecfe-438d-851c-deba3f3d7732 req-97ce1077-d6eb-4fce-a923-4e18faa2b5ab tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4a7956b4-088b-4bdd-8b57-4f6a070901c3 HTTP/1.1" status: 200 len: 945 time: 0.0604737 Dec 09 21:42:11.816620 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-80a463f6-3cbe-4603-90ae-2addcd34e8ed tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:11.823466 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-80e3b727-ecfe-438d-851c-deba3f3d7732 req-d32bcd2a-612f-4999-a455-747bcdbfd5f2 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0542402 Dec 09 21:42:11.891345 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-80a463f6-3cbe-4603-90ae-2addcd34e8ed tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:11.918115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80a463f6-3cbe-4603-90ae-2addcd34e8ed tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=fe6329f5-6459-4b8f-8b65-5a229901a546,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:11.924278 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-80a463f6-3cbe-4603-90ae-2addcd34e8ed tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:11.927492 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-80a463f6-3cbe-4603-90ae-2addcd34e8ed tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/fe6329f5-6459-4b8f-8b65-5a229901a546 HTTP/1.1" status: 204 len: 168 time: 0.3093708 Dec 09 21:42:11.929901 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35644) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:11.972504 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-28dae104-2d50-430a-a848-01239a212532 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0414844 Dec 09 21:42:11.974941 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35648) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:12.041941 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e16115b4-99f1-47a4-98b9-f5f452957f64 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:12.046563 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35650) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:12.046708 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e16115b4-99f1-47a4-98b9-f5f452957f64 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 864 time: 0.0707262 Dec 09 21:42:12.094084 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-951f24cc-35e3-4bb4-a23a-03e77566016d req-8908043b-da18-485f-8307-969784bf21ba tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:12.095716 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-951f24cc-35e3-4bb4-a23a-03e77566016d req-8908043b-da18-485f-8307-969784bf21ba tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4a7956b4-088b-4bdd-8b57-4f6a070901c3 HTTP/1.1" status: 200 len: 945 time: 0.0917234 Dec 09 21:42:12.128562 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ce335a36-e089-46ee-b70f-1ff93bb5c9d4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:12.132350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ce335a36-e089-46ee-b70f-1ff93bb5c9d4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0822718 Dec 09 21:42:12.133289 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35654) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:12.185471 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-951f24cc-35e3-4bb4-a23a-03e77566016d req-9ff84123-2c1a-4e2b-9226-3dbe691dd8d0 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0770886 Dec 09 21:42:12.224695 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35660) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:12.229772 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-db23933c-86d5-47d6-92c0-45007effacd9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:12.236422 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6b9b8154-e9ec-4412-98f6-d101a3cfe7fe tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1009839 Dec 09 21:42:12.404205 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 50be8f30-927f-42f8-bdcc-f44e4d2ddb22 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:42:12.462304 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-640205d8-2e56-4f2c-bd9f-ca4d61180616 req-6a5ee009-e74b-47bf-b5f8-eb9ee1f3f887 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:12.468208 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 50be8f30-927f-42f8-bdcc-f44e4d2ddb22 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:12.468208 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:12.480089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-640205d8-2e56-4f2c-bd9f-ca4d61180616 req-6a5ee009-e74b-47bf-b5f8-eb9ee1f3f887 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1659553 Dec 09 21:42:12.497985 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b8f3053-3672-49e3-8b97-f7f102a04ff9 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:42:12.500596 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-db23933c-86d5-47d6-92c0-45007effacd9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:12.504350 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-db23933c-86d5-47d6-92c0-45007effacd9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:12.609217 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3cb0c8f5-30be-4f8a-ba73-c237e359b7e7 None None] Provisioning complete for port 50be8f30-927f-42f8-bdcc-f44e4d2ddb22 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:12.609582 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3cb0c8f5-30be-4f8a-ba73-c237e359b7e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:12.686689 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-640205d8-2e56-4f2c-bd9f-ca4d61180616 req-7b26da49-89af-42c7-98da-c695777b577e tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2056332 Dec 09 21:42:12.738637 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:12.779398 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-db23933c-86d5-47d6-92c0-45007effacd9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:12.799083 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 50be8f30-927f-42f8-bdcc-f44e4d2ddb22, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=50be8f30-927f-42f8-bdcc-f44e4d2ddb22,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:12.813940 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:12.873757 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3cb0c8f5-30be-4f8a-ba73-c237e359b7e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:12.879159 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=50be8f30-927f-42f8-bdcc-f44e4d2ddb22,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:12.880659 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e707c540-59ec-4ad2-bb69-7efb6990e585 None None] DHCP port deletion for 77d1c069-bca4-4157-a30b-fb10cbd9d9ee request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:42:12.902394 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db23933c-86d5-47d6-92c0-45007effacd9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:12.908624 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-db23933c-86d5-47d6-92c0-45007effacd9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:12.916266 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db23933c-86d5-47d6-92c0-45007effacd9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:12.917069 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-db23933c-86d5-47d6-92c0-45007effacd9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:12.931946 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db23933c-86d5-47d6-92c0-45007effacd9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=1e55679a-96d0-4762-b6c7-f3d17e4c148a,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:12.955694 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a81de9ba-e16e-4dfa-a27d-845c97aa4977 req-f9472239-b043-4f41-90a1-70c3287b4862 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:13.066155 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a81de9ba-e16e-4dfa-a27d-845c97aa4977 req-f9472239-b043-4f41-90a1-70c3287b4862 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4a7956b4-088b-4bdd-8b57-4f6a070901c3 HTTP/1.1" status: 200 len: 945 time: 0.0991077 Dec 09 21:42:13.066155 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-db23933c-86d5-47d6-92c0-45007effacd9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.7479086 Dec 09 21:42:13.171385 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35668) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:13.171385 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-99980a05-079e-4fe9-aeb0-a8103018fb0e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'fixed_ips': [{'subnet_id': '1e55679a-96d0-4762-b6c7-f3d17e4c148a', 'ip_address': '2001:db8::1a93:38df:1c95:2f26'}], 'name': 'tempest-NetworksTestDHCPv6-488818977'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:13.173836 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a81de9ba-e16e-4dfa-a27d-845c97aa4977 req-d73800a7-96d7-4365-992b-056c80945b74 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0554361 Dec 09 21:42:13.174559 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-3cb0c8f5-30be-4f8a-ba73-c237e359b7e7 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:42:13.174559 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-3cb0c8f5-30be-4f8a-ba73-c237e359b7e7 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:42:13.174559 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e707c540-59ec-4ad2-bb69-7efb6990e585 None None] Deleting port 50be8f30-927f-42f8-bdcc-f44e4d2ddb22 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:42:13.174559 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e707c540-59ec-4ad2-bb69-7efb6990e585 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:13.335624 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-99980a05-079e-4fe9-aeb0-a8103018fb0e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:13.374069 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5083297-9274-4524-80ff-a9cdc7db22fb req-1516f131-98a5-498d-a1a2-dea9c668b6b7 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:13.376957 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5083297-9274-4524-80ff-a9cdc7db22fb req-1516f131-98a5-498d-a1a2-dea9c668b6b7 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4a7956b4-088b-4bdd-8b57-4f6a070901c3 HTTP/1.1" status: 200 len: 945 time: 0.0911736 Dec 09 21:42:13.395376 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e707c540-59ec-4ad2-bb69-7efb6990e585 None None] For port 50be8f30-927f-42f8-bdcc-f44e4d2ddb22, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=50be8f30-927f-42f8-bdcc-f44e4d2ddb22,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:13.395792 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e707c540-59ec-4ad2-bb69-7efb6990e585 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:13.408336 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e707c540-59ec-4ad2-bb69-7efb6990e585 None None] Calling delete_port for 50be8f30-927f-42f8-bdcc-f44e4d2ddb22 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:42:13.493664 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5083297-9274-4524-80ff-a9cdc7db22fb req-0a69d785-ed17-4c4b-ac7d-00319d253b58 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1097007 Dec 09 21:42:13.508093 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e707c540-59ec-4ad2-bb69-7efb6990e585 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:13.535622 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99980a05-079e-4fe9-aeb0-a8103018fb0e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:13.540992 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e707c540-59ec-4ad2-bb69-7efb6990e585 None None] Pushing event deleted for resources: {'Port': ['ID=50be8f30-927f-42f8-bdcc-f44e4d2ddb22,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:13.545815 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e707c540-59ec-4ad2-bb69-7efb6990e585 None None] No DVR routers for this DVR port 50be8f30-927f-42f8-bdcc-f44e4d2ddb22 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:42:13.579626 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-99980a05-079e-4fe9-aeb0-a8103018fb0e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] device_id is not set on port 12246c3f-f387-4fc3-9028-c99451141e52 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:42:13.582258 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a44a06e1-f0d2-4b3e-b1a3-a74ad383183c None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:42:13.584838 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-3cb0c8f5-30be-4f8a-ba73-c237e359b7e7 None None] Port 50be8f30-927f-42f8-bdcc-f44e4d2ddb22 update to ACTIVE by agent not found {{(pid=103439) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2167}} Dec 09 21:42:13.785368 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35696) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:13.791989 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-56ae488f-3ca6-415c-b4e5-d9b99f3ff67a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'fixed_ips': [{'subnet_id': '1e55679a-96d0-4762-b6c7-f3d17e4c148a'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:42:13.793099 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-56ae488f-3ca6-415c-b4e5-d9b99f3ff67a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:13.883758 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d58efd0b-6ea8-4456-8bc3-43962fa701b6 req-8e54661c-76d8-45db-bb79-72da6219b384 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:13.893125 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d58efd0b-6ea8-4456-8bc3-43962fa701b6 req-8e54661c-76d8-45db-bb79-72da6219b384 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.0791798 Dec 09 21:42:13.900411 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-99980a05-079e-4fe9-aeb0-a8103018fb0e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8::1a93:38df:1c95:2f26 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/1e55679a-96d0-4762-b6c7-f3d17e4c148a/12246c3f-f387-4fc3-9028-c99451141e52) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:13.955924 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d58efd0b-6ea8-4456-8bc3-43962fa701b6 req-eeb4aaaf-f51e-4694-8a75-fabd9802b71f tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0611856 Dec 09 21:42:14.022503 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-765cb7b8-801f-4c8a-a34c-0909362c288b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:14.126702 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-765cb7b8-801f-4c8a-a34c-0909362c288b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:14.138226 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-765cb7b8-801f-4c8a-a34c-0909362c288b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:14.174468 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-765cb7b8-801f-4c8a-a34c-0909362c288b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2c12380c-fcb6-444e-92e8-7de00c868332,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:14.192518 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-765cb7b8-801f-4c8a-a34c-0909362c288b admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=31c1c209adbc4ee8a8ac3d5d7f310888&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4060185 Dec 09 21:42:14.195011 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35710) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:14.205438 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99980a05-079e-4fe9-aeb0-a8103018fb0e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:14.270741 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99980a05-079e-4fe9-aeb0-a8103018fb0e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:14.288806 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-36f8272c-8176-400b-bb8a-46bed19da0df admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:14.324166 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-36f8272c-8176-400b-bb8a-46bed19da0df admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:14.332449 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99980a05-079e-4fe9-aeb0-a8103018fb0e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=12246c3f-f387-4fc3-9028-c99451141e52,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:14.355551 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 50be8f30-927f-42f8-bdcc-f44e4d2ddb22 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:42:14.364696 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99980a05-079e-4fe9-aeb0-a8103018fb0e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:14.366918 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-99980a05-079e-4fe9-aeb0-a8103018fb0e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:14.372617 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99980a05-079e-4fe9-aeb0-a8103018fb0e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:42:14.383827 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99980a05-079e-4fe9-aeb0-a8103018fb0e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:14.384540 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-99980a05-079e-4fe9-aeb0-a8103018fb0e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:14.389190 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-36f8272c-8176-400b-bb8a-46bed19da0df admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:14.404408 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-36f8272c-8176-400b-bb8a-46bed19da0df admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:14.406303 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-36f8272c-8176-400b-bb8a-46bed19da0df admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/2c12380c-fcb6-444e-92e8-7de00c868332 HTTP/1.1" status: 204 len: 168 time: 0.2099004 Dec 09 21:42:14.417670 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-56ae488f-3ca6-415c-b4e5-d9b99f3ff67a None None] Allocated IP 2001:db8::2 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/1e55679a-96d0-4762-b6c7-f3d17e4c148a/94451796-da24-48a2-8d15-c935cebee7da) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:14.425429 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-99980a05-079e-4fe9-aeb0-a8103018fb0e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 1.4476442 Dec 09 21:42:14.428268 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35716) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:14.437911 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b6a45f52-476e-43b7-be81-669573283aeb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'fixed_ips': [{'subnet_id': '1e55679a-96d0-4762-b6c7-f3d17e4c148a', 'ip_address': '2001:db8::1a93:38df:1c95:2f26'}], 'name': 'tempest-NetworksTestDHCPv6-825756283'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:14.441999 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36f8272c-8176-400b-bb8a-46bed19da0df admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2c12380c-fcb6-444e-92e8-7de00c868332,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:14.442807 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 50be8f30-927f-42f8-bdcc-f44e4d2ddb22 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:42:14.443158 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 50be8f30-927f-42f8-bdcc-f44e4d2ddb22 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:42:14.710696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cde7b999-3705-4382-93a2-1f8e33cfc855 req-81cc5567-dc62-4be2-ac65-8ac07897633b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:14.713872 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cde7b999-3705-4382-93a2-1f8e33cfc855 req-81cc5567-dc62-4be2-ac65-8ac07897633b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4a7956b4-088b-4bdd-8b57-4f6a070901c3 HTTP/1.1" status: 200 len: 945 time: 0.0916438 Dec 09 21:42:14.733853 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-651e3442-8e34-4128-a3c6-cf63c1ac0bd5 req-0b40f9d5-2916-448e-8e17-35322ebb7fb6 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:14.735614 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-651e3442-8e34-4128-a3c6-cf63c1ac0bd5 req-0b40f9d5-2916-448e-8e17-35322ebb7fb6 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "GET /v2.0/ports?device_id=4a7956b4-088b-4bdd-8b57-4f6a070901c3 HTTP/1.1" status: 200 len: 945 time: 0.1517289 Dec 09 21:42:14.763831 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b6a45f52-476e-43b7-be81-669573283aeb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:14.767956 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b6a45f52-476e-43b7-be81-669573283aeb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:14.774630 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-56ae488f-3ca6-415c-b4e5-d9b99f3ff67a None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:14.783670 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-56ae488f-3ca6-415c-b4e5-d9b99f3ff67a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:14.793061 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cde7b999-3705-4382-93a2-1f8e33cfc855 req-24f2c0ad-7050-4096-a1b4-7825df69c6cc tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0583625 Dec 09 21:42:14.844038 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56ae488f-3ca6-415c-b4e5-d9b99f3ff67a None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:14.847359 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-56ae488f-3ca6-415c-b4e5-d9b99f3ff67a None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:14.852662 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-56ae488f-3ca6-415c-b4e5-d9b99f3ff67a None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:42:14.856401 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-b6a45f52-476e-43b7-be81-669573283aeb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] device_id is not set on port 4d550e53-a40d-478f-bd07-3939813f0102 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:42:14.887817 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56ae488f-3ca6-415c-b4e5-d9b99f3ff67a None None] Pushing event updated for resources: {'Port': ['ID=94451796-da24-48a2-8d15-c935cebee7da,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:14.997472 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-56ae488f-3ca6-415c-b4e5-d9b99f3ff67a None None] Attempting to bind port 94451796-da24-48a2-8d15-c935cebee7da on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:42:14.998047 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-56ae488f-3ca6-415c-b4e5-d9b99f3ff67a None None] Attempting to bind port 94451796-da24-48a2-8d15-c935cebee7da by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:42:14.998557 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-56ae488f-3ca6-415c-b4e5-d9b99f3ff67a None None] Attempting to bind port 94451796-da24-48a2-8d15-c935cebee7da on network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:42:15.007103 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-56ae488f-3ca6-415c-b4e5-d9b99f3ff67a None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 42, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:42:15.007520 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-56ae488f-3ca6-415c-b4e5-d9b99f3ff67a None None] Checking segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:42:15.008050 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-56ae488f-3ca6-415c-b4e5-d9b99f3ff67a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:15.008412 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-56ae488f-3ca6-415c-b4e5-d9b99f3ff67a None None] Bound using segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:42:15.008886 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-56ae488f-3ca6-415c-b4e5-d9b99f3ff67a None None] Bound port: 94451796-da24-48a2-8d15-c935cebee7da, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:42:15.009438 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-56ae488f-3ca6-415c-b4e5-d9b99f3ff67a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:15.082086 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-651e3442-8e34-4128-a3c6-cf63c1ac0bd5 req-b62bdf7f-c241-4095-9ca2-36e6c1b6134a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Deleting port dd3f47ad-2e3f-427c-b0e3-e358bb20c496 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:42:15.082440 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-651e3442-8e34-4128-a3c6-cf63c1ac0bd5 req-b62bdf7f-c241-4095-9ca2-36e6c1b6134a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:15.116253 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-56ae488f-3ca6-415c-b4e5-d9b99f3ff67a None None] For port 94451796-da24-48a2-8d15-c935cebee7da, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:42:15.120184 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-56ae488f-3ca6-415c-b4e5-d9b99f3ff67a None None] For port 94451796-da24-48a2-8d15-c935cebee7da, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=94451796-da24-48a2-8d15-c935cebee7da,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:42:15.130395 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-56ae488f-3ca6-415c-b4e5-d9b99f3ff67a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:15.223130 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cfac6e2-3ba3-402e-9468-2cbfc3338417 req-1de11fa9-5fc3-4edb-9b0c-e0b94b3ea864 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:15.233526 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4cfac6e2-3ba3-402e-9468-2cbfc3338417 req-1de11fa9-5fc3-4edb-9b0c-e0b94b3ea864 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1454890 Dec 09 21:42:15.273179 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56ae488f-3ca6-415c-b4e5-d9b99f3ff67a None None] Pushing event updated for resources: {'Port': ['ID=94451796-da24-48a2-8d15-c935cebee7da,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:15.303997 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4cfac6e2-3ba3-402e-9468-2cbfc3338417 req-df1fb4ed-62ae-4609-8173-02045ad847e6 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0650480 Dec 09 21:42:15.308688 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-b6a45f52-476e-43b7-be81-669573283aeb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] POST failed (client error): There was a conflict when trying to complete your request. Dec 09 21:42:15.309864 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b6a45f52-476e-43b7-be81-669573283aeb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:42:15.351034 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-651e3442-8e34-4128-a3c6-cf63c1ac0bd5 req-b62bdf7f-c241-4095-9ca2-36e6c1b6134a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] For port dd3f47ad-2e3f-427c-b0e3-e358bb20c496, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=dd3f47ad-2e3f-427c-b0e3-e358bb20c496,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:15.351631 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-651e3442-8e34-4128-a3c6-cf63c1ac0bd5 req-b62bdf7f-c241-4095-9ca2-36e6c1b6134a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:15.381899 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-651e3442-8e34-4128-a3c6-cf63c1ac0bd5 req-b62bdf7f-c241-4095-9ca2-36e6c1b6134a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Calling delete_port for dd3f47ad-2e3f-427c-b0e3-e358bb20c496 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:42:15.391023 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b6a45f52-476e-43b7-be81-669573283aeb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 409 len: 389 time: 0.9610307 Dec 09 21:42:15.394941 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35754) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:15.489057 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e6a3ca5-4155-42b1-b1b3-da999c932f85 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:15.496356 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e6a3ca5-4155-42b1-b1b3-da999c932f85 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:15.498767 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8e6a3ca5-4155-42b1-b1b3-da999c932f85 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1684 time: 0.1028075 Dec 09 21:42:15.501763 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35760) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:15.660592 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-651e3442-8e34-4128-a3c6-cf63c1ac0bd5 req-b62bdf7f-c241-4095-9ca2-36e6c1b6134a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:15.673941 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['5df02334-3682-4a91-b22d-133fa1bcb473', 'dd3f47ad-2e3f-427c-b0e3-e358bb20c496'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:42:15.678939 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-59b3656a-6b5a-49ed-badf-7ec1b85f6e16 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting port 12246c3f-f387-4fc3-9028-c99451141e52 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:42:15.679291 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-59b3656a-6b5a-49ed-badf-7ec1b85f6e16 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:15.696596 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b62bdf7f-c241-4095-9ca2-36e6c1b6134a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Pushing event deleted for resources: {'Port': ['ID=dd3f47ad-2e3f-427c-b0e3-e358bb20c496,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:15.742117 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10021461-4fab-4203-888e-446e3036b923 None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:42:15.790326 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-651e3442-8e34-4128-a3c6-cf63c1ac0bd5 req-b62bdf7f-c241-4095-9ca2-36e6c1b6134a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] No DVR routers for this DVR port dd3f47ad-2e3f-427c-b0e3-e358bb20c496 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:42:15.799068 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-651e3442-8e34-4128-a3c6-cf63c1ac0bd5 req-b62bdf7f-c241-4095-9ca2-36e6c1b6134a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:15.803065 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-651e3442-8e34-4128-a3c6-cf63c1ac0bd5 req-b62bdf7f-c241-4095-9ca2-36e6c1b6134a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "DELETE /v2.0/ports/dd3f47ad-2e3f-427c-b0e3-e358bb20c496 HTTP/1.1" status: 204 len: 173 time: 1.0590358 Dec 09 21:42:15.803577 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4a7956b4-088b-4bdd-8b57-4f6a070901c3', 'name': 'network-vif-deleted', 'tag': 'dd3f47ad-2e3f-427c-b0e3-e358bb20c496'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:42:15.812050 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ee23d785-1fab-4b6a-bf6b-9889da8fea44" -d '{"events": [{"server_uuid": "4a7956b4-088b-4bdd-8b57-4f6a070901c3", "name": "network-vif-deleted", "tag": "dd3f47ad-2e3f-427c-b0e3-e358bb20c496"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:42:15.879926 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-59b3656a-6b5a-49ed-badf-7ec1b85f6e16 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:15.894629 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-59b3656a-6b5a-49ed-badf-7ec1b85f6e16 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Calling delete_port for 12246c3f-f387-4fc3-9028-c99451141e52 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:42:15.920723 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:42:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fdae31ff-7735-4f3f-a20b-ea059ee60a06 x-openstack-request-id: req-fdae31ff-7735-4f3f-a20b-ea059ee60a06 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:42:15.921025 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4a7956b4-088b-4bdd-8b57-4f6a070901c3", "name": "network-vif-deleted", "tag": "dd3f47ad-2e3f-427c-b0e3-e358bb20c496", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:42:15.921284 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-fdae31ff-7735-4f3f-a20b-ea059ee60a06 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:42:15.921695 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4a7956b4-088b-4bdd-8b57-4f6a070901c3', 'name': 'network-vif-deleted', 'tag': 'dd3f47ad-2e3f-427c-b0e3-e358bb20c496', 'status': 'completed', 'code': 200} Dec 09 21:42:16.110076 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4cab78db-ed39-4bdd-8e36-23292430c120 req-4f87a5d4-f83e-4066-aebd-b3f999f23501 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=4a7956b4-088b-4bdd-8b57-4f6a070901c3 HTTP/1.1" status: 200 len: 210 time: 0.0355937 Dec 09 21:42:16.145237 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-59b3656a-6b5a-49ed-badf-7ec1b85f6e16 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:16.168381 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96bbf362-bb68-4891-bde2-b0eb2d3525a7 req-124b6334-ceee-404e-9e54-aa3bc0e69f01 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:16.170024 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-96bbf362-bb68-4891-bde2-b0eb2d3525a7 req-124b6334-ceee-404e-9e54-aa3bc0e69f01 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 1098 time: 0.0665743 Dec 09 21:42:16.185701 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59b3656a-6b5a-49ed-badf-7ec1b85f6e16 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Port': ['ID=12246c3f-f387-4fc3-9028-c99451141e52,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:16.236827 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-59b3656a-6b5a-49ed-badf-7ec1b85f6e16 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:16.242779 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-59b3656a-6b5a-49ed-badf-7ec1b85f6e16 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/12246c3f-f387-4fc3-9028-c99451141e52 HTTP/1.1" status: 204 len: 168 time: 0.7346225 Dec 09 21:42:16.262998 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35782) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:16.262998 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-96bbf362-bb68-4891-bde2-b0eb2d3525a7 req-176b79ba-ad51-4488-a344-56c95379da90 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0790117 Dec 09 21:42:16.396129 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0ad5a2e-2a89-4fab-aa78-921bb70ded17 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:16.399502 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0ad5a2e-2a89-4fab-aa78-921bb70ded17 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:16.408571 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c0ad5a2e-2a89-4fab-aa78-921bb70ded17 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.1567810 Dec 09 21:42:16.411192 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35790) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:16.429066 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 94451796-da24-48a2-8d15-c935cebee7da up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:42:16.551674 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 94451796-da24-48a2-8d15-c935cebee7da triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:16.552901 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:16.611338 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-89f1c2c0-9573-49c9-bbeb-c96d95359ef7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet 1e55679a-96d0-4762-b6c7-f3d17e4c148a {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:42:16.617115 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-89f1c2c0-9573-49c9-bbeb-c96d95359ef7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:16.706699 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c63c710-b0e4-43e4-aed2-843559a5416e req-c94cdcb5-0faa-4437-909b-50782fd1bb7d tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:16.708571 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c63c710-b0e4-43e4-aed2-843559a5416e req-c94cdcb5-0faa-4437-909b-50782fd1bb7d tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.2165024 Dec 09 21:42:16.747230 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:16.753888 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-89f1c2c0-9573-49c9-bbeb-c96d95359ef7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:16.816333 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 94451796-da24-48a2-8d15-c935cebee7da, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=94451796-da24-48a2-8d15-c935cebee7da,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:16.829988 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:16.890461 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=94451796-da24-48a2-8d15-c935cebee7da,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:16.917971 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c63c710-b0e4-43e4-aed2-843559a5416e req-5fdad023-b50a-4606-be39-1efa4d7beeb7 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2014835 Dec 09 21:42:17.014353 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-89f1c2c0-9573-49c9-bbeb-c96d95359ef7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:17.050561 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-974caeec-e45e-4882-b699-ce061aab6376 None None] Provisioning complete for port 94451796-da24-48a2-8d15-c935cebee7da triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:17.051025 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-974caeec-e45e-4882-b699-ce061aab6376 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:17.092067 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-89f1c2c0-9573-49c9-bbeb-c96d95359ef7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:17.171129 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89f1c2c0-9573-49c9-bbeb-c96d95359ef7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=1e55679a-96d0-4762-b6c7-f3d17e4c148a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:17.173734 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-89f1c2c0-9573-49c9-bbeb-c96d95359ef7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:17.183588 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-89f1c2c0-9573-49c9-bbeb-c96d95359ef7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/1e55679a-96d0-4762-b6c7-f3d17e4c148a HTTP/1.1" status: 204 len: 168 time: 0.7710128 Dec 09 21:42:17.186162 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35812) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:17.267032 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0268be16-b782-40b3-ac7a-5601f1c58d3d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0795059 Dec 09 21:42:17.273172 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35816) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:17.282690 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-7b6e91c7-1b5a-4da0-a55e-96e6b73c18e1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:17.352621 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00446270-4844-4968-9148-cb59c9be2812 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:42:17.385241 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-913e2489-7ccf-4b04-a905-47ec5c4bd042 None None] Could not find standard attr ID for object 6edd0105-a7bf-411e-94ba-83a832adadce. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:42:17.454622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7b6e91c7-1b5a-4da0-a55e-96e6b73c18e1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:17.461351 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7b6e91c7-1b5a-4da0-a55e-96e6b73c18e1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:17.576996 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a76fca5e-8796-4745-a3c4-b6400ca54f75 None None] DHCP port deletion for 77d1c069-bca4-4157-a30b-fb10cbd9d9ee request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:42:17.666157 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a76fca5e-8796-4745-a3c4-b6400ca54f75 None None] Deleting port 94451796-da24-48a2-8d15-c935cebee7da {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:42:17.666499 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a76fca5e-8796-4745-a3c4-b6400ca54f75 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:17.733503 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-9ee5adf4-2f8b-4c77-93a7-13e4c4d2df60 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:17.735157 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-9ee5adf4-2f8b-4c77-93a7-13e4c4d2df60 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/networks?id=ba3aee78-4661-4c71-9b18-af1e6a07faff HTTP/1.1" status: 200 len: 805 time: 0.2681236 Dec 09 21:42:17.750306 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a76fca5e-8796-4745-a3c4-b6400ca54f75 None None] For port 94451796-da24-48a2-8d15-c935cebee7da, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=94451796-da24-48a2-8d15-c935cebee7da,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:17.750946 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a76fca5e-8796-4745-a3c4-b6400ca54f75 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:17.763588 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a76fca5e-8796-4745-a3c4-b6400ca54f75 None None] Calling delete_port for 94451796-da24-48a2-8d15-c935cebee7da owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:42:17.764282 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-a513fce6-d274-4e0f-ae7f-45c2799667a9 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/quotas/0569bc74c98b4ae2980de7af929e97eb HTTP/1.1" status: 200 len: 375 time: 0.0207589 Dec 09 21:42:17.865118 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a76fca5e-8796-4745-a3c4-b6400ca54f75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:17.899967 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a76fca5e-8796-4745-a3c4-b6400ca54f75 None None] Pushing event deleted for resources: {'Port': ['ID=94451796-da24-48a2-8d15-c935cebee7da,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:17.903908 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a76fca5e-8796-4745-a3c4-b6400ca54f75 None None] No DVR routers for this DVR port 94451796-da24-48a2-8d15-c935cebee7da on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:42:17.924374 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-71957432-5ad7-4ed6-9686-38f94c5772f4 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=0569bc74c98b4ae2980de7af929e97eb&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1519363 Dec 09 21:42:17.952702 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7b6e91c7-1b5a-4da0-a55e-96e6b73c18e1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:18.038841 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7b6e91c7-1b5a-4da0-a55e-96e6b73c18e1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:18.047677 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-7b6e91c7-1b5a-4da0-a55e-96e6b73c18e1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:18.055279 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b6e91c7-1b5a-4da0-a55e-96e6b73c18e1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:18.055961 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7b6e91c7-1b5a-4da0-a55e-96e6b73c18e1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:18.056625 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4fb999d6-15c7-4b71-b2d5-ed4e88d9d7ae None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:42:18.070105 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b6e91c7-1b5a-4da0-a55e-96e6b73c18e1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=440ae7b3-9372-4b83-8987-1d70dc7ef3d1,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:18.107032 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-e0c9e11c-4b9f-4b40-890f-3af5fd0d9343 service neutron] 10.222.0.13 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1816785 Dec 09 21:42:18.119519 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7b6e91c7-1b5a-4da0-a55e-96e6b73c18e1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.8451521 Dec 09 21:42:18.122467 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35848) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:18.142052 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-d31550a7-88a5-4be2-9922-dddfb2646b0a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'fixed_ips': [{'subnet_id': '440ae7b3-9372-4b83-8987-1d70dc7ef3d1', 'ip_address': '2001:db8:0:1::1'}], 'name': 'tempest-NetworksTestDHCPv6-1292377237'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:18.180056 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bef22b0f-eadd-4542-ad0d-67e07f7f6b04 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'fixed_ips': [{'subnet_id': '440ae7b3-9372-4b83-8987-1d70dc7ef3d1'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:42:18.181009 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bef22b0f-eadd-4542-ad0d-67e07f7f6b04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:18.299842 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-b18ee3a2-99ed-488e-97f0-c6d61937133f service neutron] 10.222.0.13 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1917493 Dec 09 21:42:18.344070 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-bef22b0f-eadd-4542-ad0d-67e07f7f6b04 None None] Allocated IP 2001:db8::2 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/440ae7b3-9372-4b83-8987-1d70dc7ef3d1/3f3ff2a2-e554-4f4b-8b40-da4e580626d8) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:18.368114 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 94451796-da24-48a2-8d15-c935cebee7da no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:42:18.372000 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d31550a7-88a5-4be2-9922-dddfb2646b0a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:18.410791 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 94451796-da24-48a2-8d15-c935cebee7da {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:42:18.411164 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 94451796-da24-48a2-8d15-c935cebee7da not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:42:18.575132 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d31550a7-88a5-4be2-9922-dddfb2646b0a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:18.593567 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bef22b0f-eadd-4542-ad0d-67e07f7f6b04 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:18.598537 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f50ef64d-d84a-4674-9525-1e52cfe5c4dd req-08f85d5d-bba7-4ce0-813d-2b5512768076 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:18.602715 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bef22b0f-eadd-4542-ad0d-67e07f7f6b04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:18.608676 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f50ef64d-d84a-4674-9525-1e52cfe5c4dd req-08f85d5d-bba7-4ce0-813d-2b5512768076 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1013060 Dec 09 21:42:18.651786 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-d31550a7-88a5-4be2-9922-dddfb2646b0a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] device_id is not set on port d56ba949-273e-4c2e-811f-58fd4b0f013e yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:42:18.678918 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bef22b0f-eadd-4542-ad0d-67e07f7f6b04 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:18.685193 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f50ef64d-d84a-4674-9525-1e52cfe5c4dd req-5b4dc920-2913-4f60-bf97-1d989202d8a3 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0754786 Dec 09 21:42:18.700114 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-bef22b0f-eadd-4542-ad0d-67e07f7f6b04 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:18.707284 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bef22b0f-eadd-4542-ad0d-67e07f7f6b04 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:42:18.737865 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bef22b0f-eadd-4542-ad0d-67e07f7f6b04 None None] Pushing event updated for resources: {'Port': ['ID=3f3ff2a2-e554-4f4b-8b40-da4e580626d8,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:18.803815 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-bef22b0f-eadd-4542-ad0d-67e07f7f6b04 None None] Attempting to bind port 3f3ff2a2-e554-4f4b-8b40-da4e580626d8 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:42:18.804453 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-bef22b0f-eadd-4542-ad0d-67e07f7f6b04 None None] Attempting to bind port 3f3ff2a2-e554-4f4b-8b40-da4e580626d8 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:42:18.804453 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bef22b0f-eadd-4542-ad0d-67e07f7f6b04 None None] Attempting to bind port 3f3ff2a2-e554-4f4b-8b40-da4e580626d8 on network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:42:18.810122 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bef22b0f-eadd-4542-ad0d-67e07f7f6b04 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 42, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:42:18.810588 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bef22b0f-eadd-4542-ad0d-67e07f7f6b04 None None] Checking segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:42:18.811004 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bef22b0f-eadd-4542-ad0d-67e07f7f6b04 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:18.811398 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bef22b0f-eadd-4542-ad0d-67e07f7f6b04 None None] Bound using segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:42:18.812074 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-bef22b0f-eadd-4542-ad0d-67e07f7f6b04 None None] Bound port: 3f3ff2a2-e554-4f4b-8b40-da4e580626d8, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:42:18.812610 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bef22b0f-eadd-4542-ad0d-67e07f7f6b04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:18.837965 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-335b33d3-e9f4-4067-b979-6a102b8b2e2e req-41b9526e-f747-4340-a642-68a5ee23f109 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 210 time: 0.0506110 Dec 09 21:42:18.942255 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-d31550a7-88a5-4be2-9922-dddfb2646b0a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:42:18.942946 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d31550a7-88a5-4be2-9922-dddfb2646b0a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:42:18.959326 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-bef22b0f-eadd-4542-ad0d-67e07f7f6b04 None None] For port 3f3ff2a2-e554-4f4b-8b40-da4e580626d8, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:42:18.964745 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-bef22b0f-eadd-4542-ad0d-67e07f7f6b04 None None] For port 3f3ff2a2-e554-4f4b-8b40-da4e580626d8, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=3f3ff2a2-e554-4f4b-8b40-da4e580626d8,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:42:18.975878 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bef22b0f-eadd-4542-ad0d-67e07f7f6b04 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:18.979803 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d31550a7-88a5-4be2-9922-dddfb2646b0a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 400 len: 350 time: 0.8536377 Dec 09 21:42:18.980393 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35880) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:19.115331 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bef22b0f-eadd-4542-ad0d-67e07f7f6b04 None None] Pushing event updated for resources: {'Port': ['ID=3f3ff2a2-e554-4f4b-8b40-da4e580626d8,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:19.180432 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4cdbe797-07ca-4a46-8b01-24b57a004640 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:19.183506 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4cdbe797-07ca-4a46-8b01-24b57a004640 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 943 time: 0.2004709 Dec 09 21:42:19.185403 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35892) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:19.303810 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device dd3f47ad-2e3f-427c-b0e3-e358bb20c496 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:42:19.304312 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-754daf1f-3a9e-43bb-a8f8-0035d5d85040 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:19.306200 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-754daf1f-3a9e-43bb-a8f8-0035d5d85040 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:19.326303 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-754daf1f-3a9e-43bb-a8f8-0035d5d85040 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.1380434 Dec 09 21:42:19.328406 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35898) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:19.390631 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: dd3f47ad-2e3f-427c-b0e3-e358bb20c496 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:42:19.391011 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device dd3f47ad-2e3f-427c-b0e3-e358bb20c496 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:42:19.523710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-815087f2-4b7f-46d4-8693-6dab1f5fe85e req-d5ca2342-c107-4d61-a6b0-867c00e163e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:19.526989 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-815087f2-4b7f-46d4-8693-6dab1f5fe85e req-d5ca2342-c107-4d61-a6b0-867c00e163e8 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=69d79e96ec1c418aa6c619846f0fe02e&device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 1098 time: 0.1159937 Dec 09 21:42:19.534996 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-a70e8a35-ec76-47c1-a8c6-128f3f4387c4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet 440ae7b3-9372-4b83-8987-1d70dc7ef3d1 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:42:19.543756 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a70e8a35-ec76-47c1-a8c6-128f3f4387c4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:19.622013 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d92eda-f34c-4377-b409-db473ec06316 req-9df5ca6e-5c93-4026-b2c7-b43c557d9c66 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:19.633810 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9d92eda-f34c-4377-b409-db473ec06316 req-9df5ca6e-5c93-4026-b2c7-b43c557d9c66 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1934545 Dec 09 21:42:19.732012 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9d92eda-f34c-4377-b409-db473ec06316 req-ce796610-948d-40a2-a787-d0fd9e3c4415 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0971012 Dec 09 21:42:19.742140 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a70e8a35-ec76-47c1-a8c6-128f3f4387c4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:19.774846 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-815087f2-4b7f-46d4-8693-6dab1f5fe85e req-6e706038-d4d8-4fc1-9208-73a83515d136 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:19.781965 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-815087f2-4b7f-46d4-8693-6dab1f5fe85e req-6e706038-d4d8-4fc1-9208-73a83515d136 service neutron] 10.222.0.31 "GET /v2.0/networks?id=71038cd4-0600-4b06-91f9-ae7f4f4807f9 HTTP/1.1" status: 200 len: 920 time: 0.2458239 Dec 09 21:42:19.856486 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-815087f2-4b7f-46d4-8693-6dab1f5fe85e req-8c270072-5bde-48b3-a86e-e0fdddbea178 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=be95aa8d-fc0e-4d77-a861-33c1637e4f3e HTTP/1.1" status: 200 len: 217 time: 0.0665760 Dec 09 21:42:19.933913 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a70e8a35-ec76-47c1-a8c6-128f3f4387c4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:19.977596 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-815087f2-4b7f-46d4-8693-6dab1f5fe85e req-54f11599-e672-4529-a1be-7631643e962d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:19.979092 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-815087f2-4b7f-46d4-8693-6dab1f5fe85e req-54f11599-e672-4529-a1be-7631643e962d service neutron] 10.222.0.31 "GET /v2.0/subnets?id=12d97cfc-9264-49cb-8e47-fd225cb6d30b HTTP/1.1" status: 200 len: 859 time: 0.1090128 Dec 09 21:42:20.031837 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-815087f2-4b7f-46d4-8693-6dab1f5fe85e req-47a6f2eb-a69c-4a49-8134-7cf1f1270fd3 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=71038cd4-0600-4b06-91f9-ae7f4f4807f9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0452385 Dec 09 21:42:20.036965 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5e578c5-07cb-40b1-b80c-c3ea8fc28325 req-706fa00a-20f5-4276-89ed-06ddff58db32 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 210 time: 0.0402458 Dec 09 21:42:20.112154 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-2f4cf4a0-0984-4480-9d72-e3bf7ecef286 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:20.113676 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-2f4cf4a0-0984-4480-9d72-e3bf7ecef286 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "GET /v2.0/networks?id=ba3aee78-4661-4c71-9b18-af1e6a07faff HTTP/1.1" status: 200 len: 805 time: 0.2420182 Dec 09 21:42:20.134187 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-54032042-76c8-4227-baaa-b0808fb054ff tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Request body: {'port': {'device_id': '303a8da5-b50c-4ba9-bac7-8facea49c694', 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff', 'admin_state_up': True, 'tenant_id': '0569bc74c98b4ae2980de7af929e97eb'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:20.166572 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a70e8a35-ec76-47c1-a8c6-128f3f4387c4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:20.187530 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-815087f2-4b7f-46d4-8693-6dab1f5fe85e req-4e5f88e5-e37f-4b70-8735-31693112e000 service neutron] 10.222.0.31 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1191754 Dec 09 21:42:20.235424 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a70e8a35-ec76-47c1-a8c6-128f3f4387c4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=440ae7b3-9372-4b83-8987-1d70dc7ef3d1,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:20.418758 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a70e8a35-ec76-47c1-a8c6-128f3f4387c4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:20.419001 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 3f3ff2a2-e554-4f4b-8b40-da4e580626d8 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:42:20.433294 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a70e8a35-ec76-47c1-a8c6-128f3f4387c4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/440ae7b3-9372-4b83-8987-1d70dc7ef3d1 HTTP/1.1" status: 204 len: 168 time: 1.1027639 Dec 09 21:42:20.439522 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-815087f2-4b7f-46d4-8693-6dab1f5fe85e req-951e7c75-3c94-4b5b-878f-c453f1c2f0a6 service neutron] 10.222.0.31 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2326984 Dec 09 21:42:20.443834 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35918) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:20.447339 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-54032042-76c8-4227-baaa-b0808fb054ff tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Made reservation on behalf of 0569bc74c98b4ae2980de7af929e97eb for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:20.468433 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-54032042-76c8-4227-baaa-b0808fb054ff tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:20.538923 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 3f3ff2a2-e554-4f4b-8b40-da4e580626d8 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:20.560566 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e50a9e02-02f9-4aee-bb6f-b80d57cdd902 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1112580 Dec 09 21:42:20.561563 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:20.561927 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35922) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:20.567698 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-51b3cc00-667a-4bdf-86e1-0ab35fd15602 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:20.701886 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:20.747632 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-51b3cc00-667a-4bdf-86e1-0ab35fd15602 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:20.768557 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-51b3cc00-667a-4bdf-86e1-0ab35fd15602 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:20.776471 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-54032042-76c8-4227-baaa-b0808fb054ff tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Allocated IP 172.20.0.12 (ba3aee78-4661-4c71-9b18-af1e6a07faff/b61ac70f-1e8d-40a8-9031-bab15f73fa0a/56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:20.833503 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 3f3ff2a2-e554-4f4b-8b40-da4e580626d8, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=3f3ff2a2-e554-4f4b-8b40-da4e580626d8,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:20.841076 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:20.928846 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7006a034-2e86-4d98-aeca-84fefc44ae08 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:42:20.962845 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=3f3ff2a2-e554-4f4b-8b40-da4e580626d8,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:21.067820 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-0858075d-f383-4215-9d9d-bce231f23158 None None] Provisioning complete for port 3f3ff2a2-e554-4f4b-8b40-da4e580626d8 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:21.068457 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0858075d-f383-4215-9d9d-bce231f23158 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:21.087928 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d32fce5-ee9b-4e93-8fcd-82f82539e454 req-3021e297-510b-4bdc-89ed-6fcf0caf6690 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:21.109660 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d32fce5-ee9b-4e93-8fcd-82f82539e454 req-3021e297-510b-4bdc-89ed-6fcf0caf6690 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1635022 Dec 09 21:42:21.160293 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-54032042-76c8-4227-baaa-b0808fb054ff tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:21.307649 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-51b3cc00-667a-4bdf-86e1-0ab35fd15602 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:21.347103 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-869a1e06-888d-4a27-90cf-adf6d2053eb9 None None] DHCP port deletion for 77d1c069-bca4-4157-a30b-fb10cbd9d9ee request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:42:21.361445 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d32fce5-ee9b-4e93-8fcd-82f82539e454 req-44ef62ce-3931-4885-af98-99a79bb97215 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2504964 Dec 09 21:42:21.408898 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-51b3cc00-667a-4bdf-86e1-0ab35fd15602 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:21.410303 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-54032042-76c8-4227-baaa-b0808fb054ff tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:21.415055 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-51b3cc00-667a-4bdf-86e1-0ab35fd15602 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:21.426454 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['5df02334-3682-4a91-b22d-133fa1bcb473'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:42:21.430545 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-51b3cc00-667a-4bdf-86e1-0ab35fd15602 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:21.431656 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-51b3cc00-667a-4bdf-86e1-0ab35fd15602 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:21.436371 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51b3cc00-667a-4bdf-86e1-0ab35fd15602 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=3c4d6d4a-986e-4e4b-bbf9-a7245aae93ca,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:21.452873 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-869a1e06-888d-4a27-90cf-adf6d2053eb9 None None] Deleting port 3f3ff2a2-e554-4f4b-8b40-da4e580626d8 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:42:21.453430 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-869a1e06-888d-4a27-90cf-adf6d2053eb9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:21.478181 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-51b3cc00-667a-4bdf-86e1-0ab35fd15602 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.9076347 Dec 09 21:42:21.479144 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35942) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:21.490709 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-85c9c32f-b432-41b6-84c1-1086b41da246 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'router': {'name': 'tempest-NetworksTestDHCPv6-router-53921361', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:21.534423 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-85c9c32f-b432-41b6-84c1-1086b41da246 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:21.535829 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-85c9c32f-b432-41b6-84c1-1086b41da246 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:21.549244 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-54032042-76c8-4227-baaa-b0808fb054ff tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Network ba3aee78-4661-4c71-9b18-af1e6a07faff is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:21.569587 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-54032042-76c8-4227-baaa-b0808fb054ff tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:21.583935 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-54032042-76c8-4227-baaa-b0808fb054ff tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:42:21.588086 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54032042-76c8-4227-baaa-b0808fb054ff tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Pushing event updated for resources: {'Port': ['ID=56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:21.637599 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-85c9c32f-b432-41b6-84c1-1086b41da246 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:21.644590 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-85c9c32f-b432-41b6-84c1-1086b41da246 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:21.670531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6e812a8-f686-4e6d-a583-d95dcc8f1d55 req-363922b7-d0b4-4fe2-b5d8-1f670b9c94b6 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:21.672177 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d6e812a8-f686-4e6d-a583-d95dcc8f1d55 req-363922b7-d0b4-4fe2-b5d8-1f670b9c94b6 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 932 time: 0.1829405 Dec 09 21:42:21.680104 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-85c9c32f-b432-41b6-84c1-1086b41da246 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:21.682907 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-85c9c32f-b432-41b6-84c1-1086b41da246 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 704 time: 0.2018473 Dec 09 21:42:21.686599 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35948) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:21.780822 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c93eb4a8-3de8-4cfb-a1f4-5914a56abb6a None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:42:21.840071 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d6e812a8-f686-4e6d-a583-d95dcc8f1d55 req-23e01b7d-7f53-4585-9713-ab1904ebd06b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1329827 Dec 09 21:42:21.843236 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-869a1e06-888d-4a27-90cf-adf6d2053eb9 None None] For port 3f3ff2a2-e554-4f4b-8b40-da4e580626d8, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=3f3ff2a2-e554-4f4b-8b40-da4e580626d8,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:21.843616 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-869a1e06-888d-4a27-90cf-adf6d2053eb9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:21.850344 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-54032042-76c8-4227-baaa-b0808fb054ff tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:21.851348 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-54032042-76c8-4227-baaa-b0808fb054ff tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:21.864835 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-869a1e06-888d-4a27-90cf-adf6d2053eb9 None None] Calling delete_port for 3f3ff2a2-e554-4f4b-8b40-da4e580626d8 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:42:21.873041 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-54032042-76c8-4227-baaa-b0808fb054ff tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.7482176 Dec 09 21:42:21.890385 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-a6ddaa83-964d-4b92-861d-a7392549a041 service neutron] Request body: {'port': {'device_id': '303a8da5-b50c-4ba9-bac7-8facea49c694', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:21.916655 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e7390bc8-3d9b-44eb-8fe8-1e37542e2538 None None] Provisioning complete for port 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:21.917926 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e7390bc8-3d9b-44eb-8fe8-1e37542e2538 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:22.065612 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-869a1e06-888d-4a27-90cf-adf6d2053eb9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:22.114364 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-869a1e06-888d-4a27-90cf-adf6d2053eb9 None None] Pushing event deleted for resources: {'Port': ['ID=3f3ff2a2-e554-4f4b-8b40-da4e580626d8,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:22.126839 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-869a1e06-888d-4a27-90cf-adf6d2053eb9 None None] No DVR routers for this DVR port 3f3ff2a2-e554-4f4b-8b40-da4e580626d8 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:42:22.141217 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e7390bc8-3d9b-44eb-8fe8-1e37542e2538 None None] Port 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:42:22.164121 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0e8a5243-daaa-474e-b97b-7afae6abf4fd None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:42:22.164854 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e9bfb03d-bb71-498a-bee3-dfe17c1ad657 req-7c466cc0-de69-440b-89e6-fb7459ff30a7 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.2806516 Dec 09 21:42:22.167578 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac9c08d5-5768-4c8c-9234-eba2675174f6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:22.341029 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e1d3777c-ae92-47dc-b158-2320101df125 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'fixed_ips': [{'subnet_id': '3c4d6d4a-986e-4e4b-bbf9-a7245aae93ca'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:42:22.355629 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e1d3777c-ae92-47dc-b158-2320101df125 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:22.397230 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 3f3ff2a2-e554-4f4b-8b40-da4e580626d8 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:42:22.423397 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 3f3ff2a2-e554-4f4b-8b40-da4e580626d8 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:42:22.423780 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 3f3ff2a2-e554-4f4b-8b40-da4e580626d8 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:42:22.523167 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9bfb03d-bb71-498a-bee3-dfe17c1ad657 req-98026c41-ecff-4dbd-8ef2-e70013a811d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:22.525096 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e9bfb03d-bb71-498a-bee3-dfe17c1ad657 req-98026c41-ecff-4dbd-8ef2-e70013a811d6 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=69d79e96ec1c418aa6c619846f0fe02e&device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 1097 time: 0.2224805 Dec 09 21:42:22.647424 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-a6ddaa83-964d-4b92-861d-a7392549a041 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:22.667102 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44047c72-19bc-40cf-9505-dd66121eb236 req-85f862c9-b32f-4d8b-8005-57f9a166c4c2 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:22.668325 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44047c72-19bc-40cf-9505-dd66121eb236 req-85f862c9-b32f-4d8b-8005-57f9a166c4c2 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.0953262 Dec 09 21:42:22.696294 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-e1d3777c-ae92-47dc-b158-2320101df125 None None] Allocated IP 2001:db8::2 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/3c4d6d4a-986e-4e4b-bbf9-a7245aae93ca/90ab54da-749c-4a33-8b0f-ee1269974ab3) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:22.744306 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9bfb03d-bb71-498a-bee3-dfe17c1ad657 req-261dc2a3-7906-417d-b083-760eeafe9fd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:22.746097 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e9bfb03d-bb71-498a-bee3-dfe17c1ad657 req-261dc2a3-7906-417d-b083-760eeafe9fd2 service neutron] 10.222.0.10 "GET /v2.0/networks?id=71038cd4-0600-4b06-91f9-ae7f4f4807f9 HTTP/1.1" status: 200 len: 920 time: 0.1852028 Dec 09 21:42:22.840643 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44047c72-19bc-40cf-9505-dd66121eb236 req-767c0de5-02d5-4706-afd7-3856a2d01e32 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1437809 Dec 09 21:42:23.074940 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e1d3777c-ae92-47dc-b158-2320101df125 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:23.088094 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e1d3777c-ae92-47dc-b158-2320101df125 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:23.145630 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10ac512a-94d8-4718-85f0-3938a718a80b req-46579b02-657e-47e8-be3f-ec3d06de6eb6 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:23.152368 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-10ac512a-94d8-4718-85f0-3938a718a80b req-46579b02-657e-47e8-be3f-ec3d06de6eb6 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 932 time: 0.1398916 Dec 09 21:42:23.187980 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1d3777c-ae92-47dc-b158-2320101df125 None None] Pushing event updated for resources: {'Port': ['ID=90ab54da-749c-4a33-8b0f-ee1269974ab3,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:23.199336 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e1d3777c-ae92-47dc-b158-2320101df125 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:23.200938 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-e1d3777c-ae92-47dc-b158-2320101df125 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:23.204932 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1d3777c-ae92-47dc-b158-2320101df125 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:42:23.308230 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e9bfb03d-bb71-498a-bee3-dfe17c1ad657 req-ed4e5171-42e1-4f15-9065-75ee0c47b0b4 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=10ac5a10-4f73-4f89-b652-3c81390af0aa HTTP/1.1" status: 200 len: 217 time: 0.5532207 Dec 09 21:42:23.348768 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e1d3777c-ae92-47dc-b158-2320101df125 None None] Attempting to bind port 90ab54da-749c-4a33-8b0f-ee1269974ab3 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:42:23.349430 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e1d3777c-ae92-47dc-b158-2320101df125 None None] Attempting to bind port 90ab54da-749c-4a33-8b0f-ee1269974ab3 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:42:23.349915 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1d3777c-ae92-47dc-b158-2320101df125 None None] Attempting to bind port 90ab54da-749c-4a33-8b0f-ee1269974ab3 on network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:42:23.358628 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-10ac512a-94d8-4718-85f0-3938a718a80b req-5a1bd6b3-aeb0-42b5-9b0f-b15986735653 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1811283 Dec 09 21:42:23.363018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1d3777c-ae92-47dc-b158-2320101df125 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 42, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:42:23.363600 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1d3777c-ae92-47dc-b158-2320101df125 None None] Checking segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:42:23.364032 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e1d3777c-ae92-47dc-b158-2320101df125 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:23.364434 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1d3777c-ae92-47dc-b158-2320101df125 None None] Bound using segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:42:23.366708 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-a6ddaa83-964d-4b92-861d-a7392549a041 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:42:23.368651 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e1d3777c-ae92-47dc-b158-2320101df125 None None] Bound port: 90ab54da-749c-4a33-8b0f-ee1269974ab3, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:42:23.369775 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e1d3777c-ae92-47dc-b158-2320101df125 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:23.403110 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-a6ddaa83-964d-4b92-861d-a7392549a041 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:23.425552 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-ac9c08d5-5768-4c8c-9234-eba2675174f6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8::1 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/3c4d6d4a-986e-4e4b-bbf9-a7245aae93ca/45035d1a-8bf6-4a36-90d6-c42e46114d9b) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:23.435024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9bfb03d-bb71-498a-bee3-dfe17c1ad657 req-008c48e0-d131-4374-8b59-b00921b40ab3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:23.437297 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e9bfb03d-bb71-498a-bee3-dfe17c1ad657 req-008c48e0-d131-4374-8b59-b00921b40ab3 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=12d97cfc-9264-49cb-8e47-fd225cb6d30b HTTP/1.1" status: 200 len: 859 time: 0.0973988 Dec 09 21:42:23.448680 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-a6ddaa83-964d-4b92-861d-a7392549a041 service neutron] Transition to ACTIVE for port object 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:42:23.458174 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-a6ddaa83-964d-4b92-861d-a7392549a041 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:23.483741 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e9bfb03d-bb71-498a-bee3-dfe17c1ad657 req-48617c22-a942-436e-a896-3361b6e41184 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=71038cd4-0600-4b06-91f9-ae7f4f4807f9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0382895 Dec 09 21:42:23.490815 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e1d3777c-ae92-47dc-b158-2320101df125 None None] For port 90ab54da-749c-4a33-8b0f-ee1269974ab3, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:42:23.494430 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e1d3777c-ae92-47dc-b158-2320101df125 None None] For port 90ab54da-749c-4a33-8b0f-ee1269974ab3, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=90ab54da-749c-4a33-8b0f-ee1269974ab3,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:42:23.504714 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e1d3777c-ae92-47dc-b158-2320101df125 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:23.582110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6ddaa83-964d-4b92-861d-a7392549a041 service neutron] Pushing event updated for resources: {'Port': ['ID=56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:23.599003 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1d3777c-ae92-47dc-b158-2320101df125 None None] Pushing event updated for resources: {'Port': ['ID=90ab54da-749c-4a33-8b0f-ee1269974ab3,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:23.602354 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a70d9a87-34bc-4e69-9086-ffebbda945f3 None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:42:23.697869 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-a6ddaa83-964d-4b92-861d-a7392549a041 service neutron] Attempting to bind port 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:42:23.699251 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-a6ddaa83-964d-4b92-861d-a7392549a041 service neutron] Attempting to bind port 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:42:23.700560 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-a6ddaa83-964d-4b92-861d-a7392549a041 service neutron] Attempting to bind port 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902 on network ba3aee78-4661-4c71-9b18-af1e6a07faff {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:42:23.707171 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e9bfb03d-bb71-498a-bee3-dfe17c1ad657 req-03f85d9f-07f4-4d40-8bce-140d874779fa service neutron] 10.222.0.10 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2104714 Dec 09 21:42:23.728217 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-a6ddaa83-964d-4b92-861d-a7392549a041 service neutron] Port 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902 on network ba3aee78-4661-4c71-9b18-af1e6a07faff not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:42:23.729081 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-a6ddaa83-964d-4b92-861d-a7392549a041 service neutron] Attempting to bind port 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902 on network ba3aee78-4661-4c71-9b18-af1e6a07faff {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:42:23.753977 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-a6ddaa83-964d-4b92-861d-a7392549a041 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 41, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:42:23.754353 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-a6ddaa83-964d-4b92-861d-a7392549a041 service neutron] Checking segment: {'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:42:23.754752 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-a6ddaa83-964d-4b92-861d-a7392549a041 service neutron] Bound using segment: {'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:42:23.755220 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-a6ddaa83-964d-4b92-861d-a7392549a041 service neutron] Bound port: 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fbdfbe70-d844-485b-ae9b-b09d060fd481', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:42:23.755621 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-a6ddaa83-964d-4b92-861d-a7392549a041 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:23.870132 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-a6ddaa83-964d-4b92-861d-a7392549a041 service neutron] For port 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:42:23.890088 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-a6ddaa83-964d-4b92-861d-a7392549a041 service neutron] For port 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:42:23.911119 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-a6ddaa83-964d-4b92-861d-a7392549a041 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:24.053580 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6ddaa83-964d-4b92-861d-a7392549a041 service neutron] Pushing event updated for resources: {'Port': ['ID=56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:24.055479 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e9ca6e4a-43dd-422e-bac1-b413dd5a25f0 None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:42:24.068342 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-a6ddaa83-964d-4b92-861d-a7392549a041 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:24.069468 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-a6ddaa83-964d-4b92-861d-a7392549a041 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:24.072261 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-a6ddaa83-964d-4b92-861d-a7392549a041 service neutron] 10.222.0.31 "PUT /v2.0/ports/56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902 HTTP/1.1" status: 200 len: 1093 time: 2.1885171 Dec 09 21:42:24.075522 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '303a8da5-b50c-4ba9-bac7-8facea49c694', 'tag': '56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:42:24.078942 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3e221362-17c2-4652-b596-d5bb55d64e0a" -d '{"events": [{"name": "network-changed", "server_uuid": "303a8da5-b50c-4ba9-bac7-8facea49c694", "tag": "56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:42:24.094856 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac9c08d5-5768-4c8c-9234-eba2675174f6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:24.110830 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e9bfb03d-bb71-498a-bee3-dfe17c1ad657 req-94a68a7b-d78d-4aaf-a18a-dcbf339b45e6 service neutron] 10.222.0.10 "GET /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3529050 Dec 09 21:42:24.179753 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac9c08d5-5768-4c8c-9234-eba2675174f6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:24.187067 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:42:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eb7e2a56-468b-4480-a817-cdcfd5f93760 x-openstack-request-id: req-eb7e2a56-468b-4480-a817-cdcfd5f93760 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:42:24.187363 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "303a8da5-b50c-4ba9-bac7-8facea49c694", "tag": "56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:42:24.187819 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-eb7e2a56-468b-4480-a817-cdcfd5f93760 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:42:24.188399 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '303a8da5-b50c-4ba9-bac7-8facea49c694', 'tag': '56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902', 'status': 'completed', 'code': 200} Dec 09 21:42:24.230714 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-b8cfa4b3-475c-480b-a258-1ed2648eb0fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:24.232400 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-b8cfa4b3-475c-480b-a258-1ed2648eb0fd service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0569bc74c98b4ae2980de7af929e97eb&device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 1096 time: 0.1172996 Dec 09 21:42:24.277683 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ac9c08d5-5768-4c8c-9234-eba2675174f6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:24.285261 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-ac9c08d5-5768-4c8c-9234-eba2675174f6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:24.302094 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac9c08d5-5768-4c8c-9234-eba2675174f6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:42:24.302662 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac9c08d5-5768-4c8c-9234-eba2675174f6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:24.322678 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac9c08d5-5768-4c8c-9234-eba2675174f6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=45035d1a-8bf6-4a36-90d6-c42e46114d9b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:24.326231 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-23d113dc-fd24-4451-9056-5b91f708dc92 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902 HTTP/1.1" status: 200 len: 217 time: 0.0847874 Dec 09 21:42:24.414545 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-12dde838-3d9a-4113-83ab-905cb6e9150e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:24.427155 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-12dde838-3d9a-4113-83ab-905cb6e9150e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=b61ac70f-1e8d-40a8-9031-bab15f73fa0a HTTP/1.1" status: 200 len: 845 time: 0.0927072 Dec 09 21:42:24.476658 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-ee2c1ed2-2bd0-41cc-ab87-51c9d5744ff2 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ba3aee78-4661-4c71-9b18-af1e6a07faff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0421593 Dec 09 21:42:24.497951 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 90ab54da-749c-4a33-8b0f-ee1269974ab3 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:42:24.570135 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac9c08d5-5768-4c8c-9234-eba2675174f6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:24.625818 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 90ab54da-749c-4a33-8b0f-ee1269974ab3 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:24.625818 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:24.731609 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:24.750024 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-6bcadabb-8bba-4b15-ae50-89d38e0cca2a service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2664473 Dec 09 21:42:24.769394 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 90ab54da-749c-4a33-8b0f-ee1269974ab3, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=90ab54da-749c-4a33-8b0f-ee1269974ab3,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:24.774567 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:24.863168 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63c335d4-ff22-4e4f-b85d-57ae3faf37dc req-d68e360c-03c7-42ea-a9f1-d639d10972ca tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:24.868786 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63c335d4-ff22-4e4f-b85d-57ae3faf37dc req-d68e360c-03c7-42ea-a9f1-d639d10972ca tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 944 time: 0.3258953 Dec 09 21:42:24.881420 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=90ab54da-749c-4a33-8b0f-ee1269974ab3,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:25.047926 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02a7950c-9ee0-41cf-805e-c41019a2c708 req-602978b1-7c66-4551-986f-ed77c2f899fd service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2854273 Dec 09 21:42:25.100047 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63c335d4-ff22-4e4f-b85d-57ae3faf37dc req-2829e857-117f-491e-9352-904ba0b9a1ea tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2223394 Dec 09 21:42:25.158043 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac9c08d5-5768-4c8c-9234-eba2675174f6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:25.167980 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac9c08d5-5768-4c8c-9234-eba2675174f6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:25.169080 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac9c08d5-5768-4c8c-9234-eba2675174f6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:25.237705 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e221362-17c2-4652-b596-d5bb55d64e0a req-f458ee3f-9fea-4725-bafd-37959d6b8272 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:25.245446 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e221362-17c2-4652-b596-d5bb55d64e0a req-f458ee3f-9fea-4725-bafd-37959d6b8272 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0569bc74c98b4ae2980de7af929e97eb&device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 1096 time: 0.1242337 Dec 09 21:42:25.281739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac9c08d5-5768-4c8c-9234-eba2675174f6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=45035d1a-8bf6-4a36-90d6-c42e46114d9b,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:25.393290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ac9c08d5-5768-4c8c-9234-eba2675174f6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:25.395920 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-ac9c08d5-5768-4c8c-9234-eba2675174f6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:25.435240 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e221362-17c2-4652-b596-d5bb55d64e0a req-bf5e7d86-f745-461d-95f9-704218c650a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:25.437120 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e221362-17c2-4652-b596-d5bb55d64e0a req-bf5e7d86-f745-461d-95f9-704218c650a4 service neutron] 10.222.0.31 "GET /v2.0/networks?id=ba3aee78-4661-4c71-9b18-af1e6a07faff HTTP/1.1" status: 200 len: 906 time: 0.1852410 Dec 09 21:42:25.520703 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-394d53d4-ffda-41f3-9076-b18838fca025 None None] Provisioning complete for port 90ab54da-749c-4a33-8b0f-ee1269974ab3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:25.521976 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-394d53d4-ffda-41f3-9076-b18838fca025 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:25.562655 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e221362-17c2-4652-b596-d5bb55d64e0a req-0d4a4628-24aa-4a15-b042-f869eca5fbed service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902 HTTP/1.1" status: 200 len: 217 time: 0.1161377 Dec 09 21:42:25.671808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e221362-17c2-4652-b596-d5bb55d64e0a req-421b400c-d351-4f3f-a3e4-66000384a84e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:25.673722 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e221362-17c2-4652-b596-d5bb55d64e0a req-421b400c-d351-4f3f-a3e4-66000384a84e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=b61ac70f-1e8d-40a8-9031-bab15f73fa0a HTTP/1.1" status: 200 len: 845 time: 0.1030271 Dec 09 21:42:25.689286 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ac9c08d5-5768-4c8c-9234-eba2675174f6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Router 885c0d08-7475-4e53-b324-dd6eee46bff3 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:42:25.755824 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e221362-17c2-4652-b596-d5bb55d64e0a req-3589dddd-af93-4b7b-ba1d-b9b93f064361 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ba3aee78-4661-4c71-9b18-af1e6a07faff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0709689 Dec 09 21:42:25.915140 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ac9c08d5-5768-4c8c-9234-eba2675174f6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:42:25.922529 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-84ca882b-a7ef-4fca-be2c-aaf1e59870cf None None] Provisioning complete for port 45035d1a-8bf6-4a36-90d6-c42e46114d9b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:25.923169 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-84ca882b-a7ef-4fca-be2c-aaf1e59870cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:25.928868 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ac9c08d5-5768-4c8c-9234-eba2675174f6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "PUT /v2.0/routers/885c0d08-7475-4e53-b324-dd6eee46bff3/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.2405841 Dec 09 21:42:25.931733 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36064) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:25.934976 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] Sync routers for ids ['885c0d08-7475-4e53-b324-dd6eee46bff3'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:42:25.954195 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] Routers {'885c0d08-7475-4e53-b324-dd6eee46bff3'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:42:25.957818 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:42:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['885c0d08-7475-4e53-b324-dd6eee46bff3'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:42:25.989419 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e221362-17c2-4652-b596-d5bb55d64e0a req-3d2b49dc-870c-4bab-ac6c-945ea09f7845 service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2248986 Dec 09 21:42:26.014406 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-84ca882b-a7ef-4fca-be2c-aaf1e59870cf None None] Port 45035d1a-8bf6-4a36-90d6-c42e46114d9b cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:42:26.031996 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba01f985-4db2-4e59-8dbc-5689d013ca61 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:26.033669 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ba01f985-4db2-4e59-8dbc-5689d013ca61 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports/45035d1a-8bf6-4a36-90d6-c42e46114d9b HTTP/1.1" status: 200 len: 911 time: 0.1012080 Dec 09 21:42:26.036551 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36066) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:26.153043 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d0eaa1c-6233-48a9-a00b-3fc823142163 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:26.159514 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d0eaa1c-6233-48a9-a00b-3fc823142163 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:26.162332 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4d0eaa1c-6233-48a9-a00b-3fc823142163 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1655 time: 0.1215961 Dec 09 21:42:26.165227 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36072) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:26.220807 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] Set router 885c0d08-7475-4e53-b324-dd6eee46bff3 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:42:26.313442 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e221362-17c2-4652-b596-d5bb55d64e0a req-69fb2020-fc07-4c04-bf2b-2c32fc3d935f service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3149920 Dec 09 21:42:26.356977 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-73c7db3e-534d-45d2-83d1-177d3aba4da4 None None] Provisioning complete for port 45035d1a-8bf6-4a36-90d6-c42e46114d9b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:26.356977 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-73c7db3e-534d-45d2-83d1-177d3aba4da4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:26.382156 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-060fc8f7-e1ec-4edc-b90a-2a35f567898f req-409017d5-4564-4947-bc27-b6ffc031ab44 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:26.413282 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-060fc8f7-e1ec-4edc-b90a-2a35f567898f req-409017d5-4564-4947-bc27-b6ffc031ab44 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 944 time: 0.1699719 Dec 09 21:42:26.426407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-73c7db3e-534d-45d2-83d1-177d3aba4da4 None None] Port 45035d1a-8bf6-4a36-90d6-c42e46114d9b cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:42:26.428882 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 90ab54da-749c-4a33-8b0f-ee1269974ab3 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:42:26.481348 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 90ab54da-749c-4a33-8b0f-ee1269974ab3 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:26.481720 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:26.529077 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-060fc8f7-e1ec-4edc-b90a-2a35f567898f req-694c820b-9ae1-42cd-90c0-d73e5a706603 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1145387 Dec 09 21:42:26.710797 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '885c0d08-7475-4e53-b324-dd6eee46bff3', 'name': 'tempest-NetworksTestDHCPv6-router-53921361', 'tenant_id': '91d65fdee4d24f0fb98cc03c485255f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:42:21Z', 'updated_at': '2021-12-09T21:42:24Z', 'revision_number': 2, 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'gw_port_host': None, '_interfaces': [{'id': '45035d1a-8bf6-4a36-90d6-c42e46114d9b', 'name': '', 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'tenant_id': '91d65fdee4d24f0fb98cc03c485255f6', 'mac_address': 'fa:16:3e:db:2d:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '885c0d08-7475-4e53-b324-dd6eee46bff3', 'device_owner': 'network:router_interface', 'standard_attr_id': 2763, 'fixed_ips': [{'subnet_id': '3c4d6d4a-986e-4e4b-bbf9-a7245aae93ca', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:42:22Z', 'updated_at': '2021-12-09T21:42:24Z', 'revision_number': 2, 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'subnets': [{'id': '3c4d6d4a-986e-4e4b-bbf9-a7245aae93ca', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:42:26.740245 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] Checking router: 885c0d08-7475-4e53-b324-dd6eee46bff3 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:42:26.740607 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] Updating router 885c0d08-7475-4e53-b324-dd6eee46bff3 port 45035d1a-8bf6-4a36-90d6-c42e46114d9b binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:42:26.797772 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:26.914658 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e5d5eff6-c709-44f5-8821-9845d558214b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:27.281406 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:27.297022 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-e5d5eff6-c709-44f5-8821-9845d558214b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting port 45035d1a-8bf6-4a36-90d6-c42e46114d9b {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:42:27.297549 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e5d5eff6-c709-44f5-8821-9845d558214b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:27.302203 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:27.306390 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:27.313597 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:27.369304 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15c853fe-2180-4514-91f3-dee3ab4a098d None None] Pushing event updated for resources: {'Port': ['ID=45035d1a-8bf6-4a36-90d6-c42e46114d9b,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:27.381025 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15c853fe-2180-4514-91f3-dee3ab4a098d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:27.381424 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15c853fe-2180-4514-91f3-dee3ab4a098d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:27.381769 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15c853fe-2180-4514-91f3-dee3ab4a098d None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:27.382106 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15c853fe-2180-4514-91f3-dee3ab4a098d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:27.382440 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15c853fe-2180-4514-91f3-dee3ab4a098d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:27.383063 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15c853fe-2180-4514-91f3-dee3ab4a098d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:27.383401 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15c853fe-2180-4514-91f3-dee3ab4a098d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:27.383743 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15c853fe-2180-4514-91f3-dee3ab4a098d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:27.384077 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15c853fe-2180-4514-91f3-dee3ab4a098d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:27.384391 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15c853fe-2180-4514-91f3-dee3ab4a098d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:27.384998 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15c853fe-2180-4514-91f3-dee3ab4a098d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:27.385325 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15c853fe-2180-4514-91f3-dee3ab4a098d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:27.385644 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-15c853fe-2180-4514-91f3-dee3ab4a098d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:27.453631 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e5d5eff6-c709-44f5-8821-9845d558214b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:27.495505 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-e5d5eff6-c709-44f5-8821-9845d558214b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Calling delete_port for 45035d1a-8bf6-4a36-90d6-c42e46114d9b owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:42:27.509553 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] Attempting to bind port 45035d1a-8bf6-4a36-90d6-c42e46114d9b on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:42:27.510645 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] Attempting to bind port 45035d1a-8bf6-4a36-90d6-c42e46114d9b by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:42:27.511288 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] Attempting to bind port 45035d1a-8bf6-4a36-90d6-c42e46114d9b on network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:42:27.520316 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 42, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:42:27.520982 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] Checking segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:42:27.521576 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:27.522125 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] Bound using segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:42:27.523473 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] Bound port: 45035d1a-8bf6-4a36-90d6-c42e46114d9b, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:42:27.524041 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:27.678341 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] For port 45035d1a-8bf6-4a36-90d6-c42e46114d9b, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:42:27.688161 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] For port 45035d1a-8bf6-4a36-90d6-c42e46114d9b, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=45035d1a-8bf6-4a36-90d6-c42e46114d9b,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:42:27.698093 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:27.764859 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fc582fe-8713-49b7-a0d5-17d151561087 req-5e846540-aacd-433a-94be-fe3b4ad0a0c0 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:27.770613 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3fc582fe-8713-49b7-a0d5-17d151561087 req-5e846540-aacd-433a-94be-fe3b4ad0a0c0 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 944 time: 0.1102896 Dec 09 21:42:27.888570 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e5d5eff6-c709-44f5-8821-9845d558214b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:27.916537 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3fc582fe-8713-49b7-a0d5-17d151561087 req-10c5dd0e-4367-49b8-b12e-2633292fc8a5 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1346729 Dec 09 21:42:27.965898 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c6929d7f-511e-45ac-8380-df1d61dba3dc None None] Could not find standard attr ID for object 45035d1a-8bf6-4a36-90d6-c42e46114d9b. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:42:28.047057 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5d5eff6-c709-44f5-8821-9845d558214b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Port': ['ID=45035d1a-8bf6-4a36-90d6-c42e46114d9b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:28.214148 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e5d5eff6-c709-44f5-8821-9845d558214b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:28.222259 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] Routers {'885c0d08-7475-4e53-b324-dd6eee46bff3'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:42:28.223222 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:42:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['885c0d08-7475-4e53-b324-dd6eee46bff3'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:42:28.235868 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15c853fe-2180-4514-91f3-dee3ab4a098d None None] Pushing event updated for resources: {'Port': ['ID=45035d1a-8bf6-4a36-90d6-c42e46114d9b,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:28.339854 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] Set router 885c0d08-7475-4e53-b324-dd6eee46bff3 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:42:28.423111 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '885c0d08-7475-4e53-b324-dd6eee46bff3', 'name': 'tempest-NetworksTestDHCPv6-router-53921361', 'tenant_id': '91d65fdee4d24f0fb98cc03c485255f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:42:21Z', 'updated_at': '2021-12-09T21:42:27Z', 'revision_number': 3, 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:42:28.473581 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fca895fa-ed4a-4011-893f-c9c644ec9b9e None None] The sync data for ids ['885c0d08-7475-4e53-b324-dd6eee46bff3'] in n-d-713301-27 is: [{'id': '885c0d08-7475-4e53-b324-dd6eee46bff3', 'name': 'tempest-NetworksTestDHCPv6-router-53921361', 'tenant_id': '91d65fdee4d24f0fb98cc03c485255f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:42:21Z', 'updated_at': '2021-12-09T21:42:27Z', 'revision_number': 3, 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'gw_port_host': None}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:42:28.510908 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e5d5eff6-c709-44f5-8821-9845d558214b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Router 885c0d08-7475-4e53-b324-dd6eee46bff3 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:42:28.642303 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e5d5eff6-c709-44f5-8821-9845d558214b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:42:28.654913 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e5d5eff6-c709-44f5-8821-9845d558214b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "PUT /v2.0/routers/885c0d08-7475-4e53-b324-dd6eee46bff3/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4882402 Dec 09 21:42:28.658418 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36126) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:28.726395 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-462bf64d-ff06-4598-a61d-4bc6057f91c8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:28.728084 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-462bf64d-ff06-4598-a61d-4bc6057f91c8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:28.732550 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36130) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:28.733008 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-462bf64d-ff06-4598-a61d-4bc6057f91c8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1477 time: 0.0724719 Dec 09 21:42:28.840557 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-68ddcb86-c0fb-4c9f-b02a-c89d03bb02d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet 3c4d6d4a-986e-4e4b-bbf9-a7245aae93ca {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:42:28.846489 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68ddcb86-c0fb-4c9f-b02a-c89d03bb02d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:28.916349 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68ddcb86-c0fb-4c9f-b02a-c89d03bb02d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:29.130785 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68ddcb86-c0fb-4c9f-b02a-c89d03bb02d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:29.157110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d96e1d3-9f43-4660-805a-546d24ec3440 req-1fff85db-ef5d-4ad3-9496-a88862b50042 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:29.167470 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4d96e1d3-9f43-4660-805a-546d24ec3440 req-1fff85db-ef5d-4ad3-9496-a88862b50042 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 944 time: 0.1184838 Dec 09 21:42:29.264679 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4d96e1d3-9f43-4660-805a-546d24ec3440 req-927823a1-3e3e-4310-8b7e-441500e39efb tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0957153 Dec 09 21:42:29.310469 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68ddcb86-c0fb-4c9f-b02a-c89d03bb02d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:29.334802 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68ddcb86-c0fb-4c9f-b02a-c89d03bb02d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:29.346043 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c9ab29e0-7ddf-47a7-9e20-bad8d7cea5b7 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:42:29.364929 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36144) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:29.372528 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-68ddcb86-c0fb-4c9f-b02a-c89d03bb02d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/3c4d6d4a-986e-4e4b-bbf9-a7245aae93ca HTTP/1.1" status: 204 len: 168 time: 0.6380944 Dec 09 21:42:29.415573 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:42:29.473278 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68ddcb86-c0fb-4c9f-b02a-c89d03bb02d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=3c4d6d4a-986e-4e4b-bbf9-a7245aae93ca,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:29.588157 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c4c21e6-6e50-49d4-8706-0ae5f3d4bf37 req-bd07862d-d2bc-4412-a2c3-50cc8a9187d7 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=1faa187b-0441-47d3-8d37-6489d51928bb&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1361341 Dec 09 21:42:29.653796 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36148) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:29.654995 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c150eaa4-f5de-47b6-9266-c1eac8233966 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 708 time: 0.2884507 Dec 09 21:42:29.721874 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:29.754636 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902', 'network_id': 'ba3aee78-4661-4c71-9b18-af1e6a07faff', 'port_id': '56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902', 'mac_address': 'fa:16:3e:a8:18:46', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b61ac70f-1e8d-40a8-9031-bab15f73fa0a', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:42:29.786029 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f6f544ea-a6dd-4420-98cc-ca9487501818 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:29.831173 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:29.858628 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc0302d8-e743-4aef-828d-f62d03b6f23b None None] DHCP port deletion for 77d1c069-bca4-4157-a30b-fb10cbd9d9ee request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:42:29.890270 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c4c21e6-6e50-49d4-8706-0ae5f3d4bf37 req-6bccfb00-bc83-463f-9cc2-975bad04c15f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:29.891836 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c4c21e6-6e50-49d4-8706-0ae5f3d4bf37 req-6bccfb00-bc83-463f-9cc2-975bad04c15f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=0569bc74c98b4ae2980de7af929e97eb&device_id=1faa187b-0441-47d3-8d37-6489d51928bb HTTP/1.1" status: 200 len: 1097 time: 0.2788641 Dec 09 21:42:29.927741 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:42:29.979485 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba30a1d8-381d-4e4b-8696-d8fa746d0937 None None] Sync routers for ids ['885c0d08-7475-4e53-b324-dd6eee46bff3'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:42:29.993204 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:30.017277 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:30.038246 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f6f544ea-a6dd-4420-98cc-ca9487501818 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:30.041925 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f6f544ea-a6dd-4420-98cc-ca9487501818 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:30.134307 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba30a1d8-381d-4e4b-8696-d8fa746d0937 None None] Routers {'885c0d08-7475-4e53-b324-dd6eee46bff3'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:42:30.140562 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-ba30a1d8-381d-4e4b-8696-d8fa746d0937 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:42:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['885c0d08-7475-4e53-b324-dd6eee46bff3'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:42:30.184718 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f6f544ea-a6dd-4420-98cc-ca9487501818 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:30.185218 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f6f544ea-a6dd-4420-98cc-ca9487501818 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Fanout notify agent at l3_agent the message router_deleted on router 885c0d08-7475-4e53-b324-dd6eee46bff3 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:42:30.215550 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f6f544ea-a6dd-4420-98cc-ca9487501818 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:30.219711 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f6f544ea-a6dd-4420-98cc-ca9487501818 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/routers/885c0d08-7475-4e53-b324-dd6eee46bff3 HTTP/1.1" status: 204 len: 168 time: 0.5503135 Dec 09 21:42:30.222044 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36154) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:30.227710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ec46d64e-0462-4633-b6fe-37e22b7a7d53 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:30.282204 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-bc0302d8-e743-4aef-828d-f62d03b6f23b None None] Deleting port 90ab54da-749c-4a33-8b0f-ee1269974ab3 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:42:30.283540 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bc0302d8-e743-4aef-828d-f62d03b6f23b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:30.287180 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:30.296304 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c4c21e6-6e50-49d4-8706-0ae5f3d4bf37 req-fa5832e7-f9ba-49ce-8afd-bb042ce730e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:30.307569 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c4c21e6-6e50-49d4-8706-0ae5f3d4bf37 req-fa5832e7-f9ba-49ce-8afd-bb042ce730e9 service neutron] 10.222.0.31 "GET /v2.0/networks?id=ba3aee78-4661-4c71-9b18-af1e6a07faff HTTP/1.1" status: 200 len: 906 time: 0.3819716 Dec 09 21:42:30.418638 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c4c21e6-6e50-49d4-8706-0ae5f3d4bf37 req-92e50eba-9e33-4b83-9b0d-71bb675dfb49 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=5df02334-3682-4a91-b22d-133fa1bcb473 HTTP/1.1" status: 200 len: 217 time: 0.1060150 Dec 09 21:42:30.423646 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-bc0302d8-e743-4aef-828d-f62d03b6f23b None None] For port 90ab54da-749c-4a33-8b0f-ee1269974ab3, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=90ab54da-749c-4a33-8b0f-ee1269974ab3,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:30.424415 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bc0302d8-e743-4aef-828d-f62d03b6f23b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:30.443023 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-bc0302d8-e743-4aef-828d-f62d03b6f23b None None] Calling delete_port for 90ab54da-749c-4a33-8b0f-ee1269974ab3 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:42:30.482019 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ec46d64e-0462-4633-b6fe-37e22b7a7d53 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:30.485915 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ec46d64e-0462-4633-b6fe-37e22b7a7d53 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:30.517686 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36164) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:30.608435 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c4c21e6-6e50-49d4-8706-0ae5f3d4bf37 req-0010ecc1-7d7f-4d03-aaaf-dcf2a14dd915 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:30.609942 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c4c21e6-6e50-49d4-8706-0ae5f3d4bf37 req-0010ecc1-7d7f-4d03-aaaf-dcf2a14dd915 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=b61ac70f-1e8d-40a8-9031-bab15f73fa0a HTTP/1.1" status: 200 len: 845 time: 0.1736267 Dec 09 21:42:30.632892 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3517fb4-f956-47d2-9685-7b081b90eff8 req-57148a20-df49-4089-a933-ec7149f48c38 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:30.634458 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-ba30a1d8-381d-4e4b-8696-d8fa746d0937 None None] Set router 885c0d08-7475-4e53-b324-dd6eee46bff3 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:42:30.639098 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c3517fb4-f956-47d2-9685-7b081b90eff8 req-57148a20-df49-4089-a933-ec7149f48c38 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 945 time: 0.2210672 Dec 09 21:42:30.719591 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-ba30a1d8-381d-4e4b-8696-d8fa746d0937 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '885c0d08-7475-4e53-b324-dd6eee46bff3', 'name': 'tempest-NetworksTestDHCPv6-router-53921361', 'tenant_id': '91d65fdee4d24f0fb98cc03c485255f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:42:21Z', 'updated_at': '2021-12-09T21:42:27Z', 'revision_number': 3, 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:42:30.730154 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c4c21e6-6e50-49d4-8706-0ae5f3d4bf37 req-8d54a519-ffb5-4343-9cbd-8de519ebd39d service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=ba3aee78-4661-4c71-9b18-af1e6a07faff&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0899289 Dec 09 21:42:30.778164 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9898ea8a-6432-49c7-8964-efb34eb94714 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:30.796781 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:42:30.824094 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c3517fb4-f956-47d2-9685-7b081b90eff8 req-6e3e5091-6e0d-4de9-be6f-3e6e3c0ae774 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1601334 Dec 09 21:42:30.844941 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 90ab54da-749c-4a33-8b0f-ee1269974ab3 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:42:30.848037 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba30a1d8-381d-4e4b-8696-d8fa746d0937 None None] Checking router: 885c0d08-7475-4e53-b324-dd6eee46bff3 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:42:30.853777 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bc0302d8-e743-4aef-828d-f62d03b6f23b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:30.921399 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 90ab54da-749c-4a33-8b0f-ee1269974ab3 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:42:30.921399 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 90ab54da-749c-4a33-8b0f-ee1269974ab3 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:42:30.933858 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba30a1d8-381d-4e4b-8696-d8fa746d0937 None None] Routers set() bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:42:30.934302 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba30a1d8-381d-4e4b-8696-d8fa746d0937 None None] Router IDs set() for agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Dec 09 21:42:30.935010 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_agentschedulers_db [None req-ba30a1d8-381d-4e4b-8696-d8fa746d0937 None None] Agent requested router IDs not scheduled to it. Scheduled: []. Unscheduled: {'885c0d08-7475-4e53-b324-dd6eee46bff3'}. Agent: Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:42:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent'). {{(pid=103439) list_active_sync_routers_on_active_l3_agent /opt/stack/neutron/neutron/db/l3_agentschedulers_db.py:353}} Dec 09 21:42:30.935509 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ba30a1d8-381d-4e4b-8696-d8fa746d0937 None None] The sync data for ids ['885c0d08-7475-4e53-b324-dd6eee46bff3'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:42:30.937657 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc0302d8-e743-4aef-828d-f62d03b6f23b None None] Pushing event deleted for resources: {'Port': ['ID=90ab54da-749c-4a33-8b0f-ee1269974ab3,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:30.947777 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc0302d8-e743-4aef-828d-f62d03b6f23b None None] No DVR routers for this DVR port 90ab54da-749c-4a33-8b0f-ee1269974ab3 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:42:31.025118 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c4c21e6-6e50-49d4-8706-0ae5f3d4bf37 req-53ed242a-3fd6-4875-bfbe-0b087075cc5b service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2845752 Dec 09 21:42:31.084051 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:42:31.106775 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9898ea8a-6432-49c7-8964-efb34eb94714 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:31.114498 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ec46d64e-0462-4633-b6fe-37e22b7a7d53 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:31.156011 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9898ea8a-6432-49c7-8964-efb34eb94714 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:31.219879 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c4c21e6-6e50-49d4-8706-0ae5f3d4bf37 req-9c8ea43a-8977-44ce-9e6a-4b8afe5c7c20 service neutron] 10.222.0.31 "GET /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1823256 Dec 09 21:42:31.236470 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec46d64e-0462-4633-b6fe-37e22b7a7d53 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:31.261348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-ec46d64e-0462-4633-b6fe-37e22b7a7d53 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:31.263567 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9898ea8a-6432-49c7-8964-efb34eb94714 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=649ba92f-43ea-4ca8-a06f-2ff67121e50b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:31.276250 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-165ad005-5c16-4909-bdcf-c8df6ef8e926 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:42:31.285606 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec46d64e-0462-4633-b6fe-37e22b7a7d53 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:31.286272 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ec46d64e-0462-4633-b6fe-37e22b7a7d53 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:31.306511 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36170) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:31.313735 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9898ea8a-6432-49c7-8964-efb34eb94714 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=9fac690bbead4c59a8199f3cdace2445&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7948444 Dec 09 21:42:31.330806 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ec46d64e-0462-4633-b6fe-37e22b7a7d53 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 1.1050427 Dec 09 21:42:31.334639 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36172) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:31.342473 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec46d64e-0462-4633-b6fe-37e22b7a7d53 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=caf33ffe-93e3-4d65-9e26-d679faa4a1c7,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:31.343727 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-0e9f2d6b-e078-4154-95ba-80bf0ff1bfa8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'router': {'name': 'tempest-NetworksTestDHCPv6-router-2001699166', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:31.428844 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e9f2d6b-e078-4154-95ba-80bf0ff1bfa8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:31.430589 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e9f2d6b-e078-4154-95ba-80bf0ff1bfa8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:31.438537 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a852cbae-ff07-41c3-8b97-aad8219bc779 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:31.470934 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'fixed_ips': [{'subnet_id': 'caf33ffe-93e3-4d65-9e26-d679faa4a1c7'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:42:31.472760 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:31.484101 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a852cbae-ff07-41c3-8b97-aad8219bc779 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:31.528315 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e9f2d6b-e078-4154-95ba-80bf0ff1bfa8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:31.542945 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e9f2d6b-e078-4154-95ba-80bf0ff1bfa8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:31.608235 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e9f2d6b-e078-4154-95ba-80bf0ff1bfa8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:31.612150 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0e9f2d6b-e078-4154-95ba-80bf0ff1bfa8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 706 time: 0.2761564 Dec 09 21:42:31.615191 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36174) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:31.635494 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a852cbae-ff07-41c3-8b97-aad8219bc779 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:31.639447 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a852cbae-ff07-41c3-8b97-aad8219bc779 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:31.643374 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a852cbae-ff07-41c3-8b97-aad8219bc779 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/649ba92f-43ea-4ca8-a06f-2ff67121e50b HTTP/1.1" status: 204 len: 168 time: 0.3320487 Dec 09 21:42:31.655075 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a852cbae-ff07-41c3-8b97-aad8219bc779 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=649ba92f-43ea-4ca8-a06f-2ff67121e50b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:31.736001 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Allocated IP 2001:db8::2 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/caf33ffe-93e3-4d65-9e26-d679faa4a1c7/c2f90000-f7fd-4263-9445-46bb6b1e0b86) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:32.055642 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9358cd80-4d8d-441c-b351-dbf45b8189bb req-b893acdd-32c5-44c6-a031-4b0ff37fd078 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:32.058034 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9358cd80-4d8d-441c-b351-dbf45b8189bb req-b893acdd-32c5-44c6-a031-4b0ff37fd078 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 945 time: 0.1170571 Dec 09 21:42:32.134668 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9358cd80-4d8d-441c-b351-dbf45b8189bb req-96e235f7-5cd1-4b4e-b31c-98557d3056cb tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0701773 Dec 09 21:42:32.202821 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:32.213078 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:32.273791 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Pushing event updated for resources: {'Port': ['ID=c2f90000-f7fd-4263-9445-46bb6b1e0b86,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:32.286008 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:32.286352 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:32.286695 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:32.287029 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:32.287511 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:32.287723 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:32.288046 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:32.288369 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:32.288691 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:32.289011 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:32.289328 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:32.289733 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:32.289956 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:42:32.323937 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:32.325880 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:32.332115 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:42:32.401718 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Attempting to bind port c2f90000-f7fd-4263-9445-46bb6b1e0b86 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:42:32.402329 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Attempting to bind port c2f90000-f7fd-4263-9445-46bb6b1e0b86 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:42:32.402866 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Attempting to bind port c2f90000-f7fd-4263-9445-46bb6b1e0b86 on network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:42:32.409875 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 42, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:42:32.410456 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Checking segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:42:32.411013 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:32.411815 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Bound using segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:42:32.412457 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Bound port: c2f90000-f7fd-4263-9445-46bb6b1e0b86, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:42:32.413008 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:32.519969 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d9b302e0-9c94-4951-8b44-fcb81f8cf5a8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:32.525228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] For port c2f90000-f7fd-4263-9445-46bb6b1e0b86, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:42:32.533771 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] For port c2f90000-f7fd-4263-9445-46bb6b1e0b86, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c2f90000-f7fd-4263-9445-46bb6b1e0b86,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:42:32.541734 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:32.647716 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2da94b6e-64c4-4210-937f-5185e4a1521d None None] Pushing event updated for resources: {'Port': ['ID=c2f90000-f7fd-4263-9445-46bb6b1e0b86,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:32.854730 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-d9b302e0-9c94-4951-8b44-fcb81f8cf5a8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8::1 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/caf33ffe-93e3-4d65-9e26-d679faa4a1c7/f5da94d7-5100-4910-b718-bb2d8cc92ef1) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:32.965486 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-51ed8620-6b9f-4312-9a6d-256ec8ab3f88 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:33.031976 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d9b302e0-9c94-4951-8b44-fcb81f8cf5a8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:33.084124 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d9b302e0-9c94-4951-8b44-fcb81f8cf5a8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:33.126611 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d9b302e0-9c94-4951-8b44-fcb81f8cf5a8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:33.132098 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-d9b302e0-9c94-4951-8b44-fcb81f8cf5a8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:33.139530 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9b302e0-9c94-4951-8b44-fcb81f8cf5a8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:42:33.140154 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d9b302e0-9c94-4951-8b44-fcb81f8cf5a8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:33.229884 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9b302e0-9c94-4951-8b44-fcb81f8cf5a8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=f5da94d7-5100-4910-b718-bb2d8cc92ef1,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:33.277820 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d9b302e0-9c94-4951-8b44-fcb81f8cf5a8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:33.336200 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5cc7774-1ca9-4cf1-9f67-1ffec5848113 req-b1a4246e-87c1-4730-80ca-9a2fe912624c tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:33.338682 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b5cc7774-1ca9-4cf1-9f67-1ffec5848113 req-b1a4246e-87c1-4730-80ca-9a2fe912624c tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 945 time: 0.0803359 Dec 09 21:42:33.383258 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:42:33.404535 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b5cc7774-1ca9-4cf1-9f67-1ffec5848113 req-e3b91863-52b6-4f0e-b635-728cacdc6b46 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0543764 Dec 09 21:42:33.472709 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:42:33.478790 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:33.479177 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:33.621453 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:33.623654 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d9b302e0-9c94-4951-8b44-fcb81f8cf5a8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:33.632342 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d9b302e0-9c94-4951-8b44-fcb81f8cf5a8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:33.633776 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d9b302e0-9c94-4951-8b44-fcb81f8cf5a8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:33.676647 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '303a8da5-b50c-4ba9-bac7-8facea49c694', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:42:33.678947 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ad79579a-d0a2-4310-a0c8-77b37d0b9156" -d '{"events": [{"server_uuid": "303a8da5-b50c-4ba9-bac7-8facea49c694", "name": "network-vif-plugged", "status": "completed", "tag": "56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:42:33.692545 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:33.704425 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:33.804892 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9b302e0-9c94-4951-8b44-fcb81f8cf5a8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=f5da94d7-5100-4910-b718-bb2d8cc92ef1,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:33.805722 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:42:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-80f24722-ae4e-412b-a222-74311b641fdd x-openstack-request-id: req-80f24722-ae4e-412b-a222-74311b641fdd {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:42:33.826605 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d9b302e0-9c94-4951-8b44-fcb81f8cf5a8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:33.828945 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-d9b302e0-9c94-4951-8b44-fcb81f8cf5a8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:33.832472 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "303a8da5-b50c-4ba9-bac7-8facea49c694", "name": "network-vif-plugged", "status": "completed", "tag": "56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:42:33.832732 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-80f24722-ae4e-412b-a222-74311b641fdd {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:42:33.833159 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '303a8da5-b50c-4ba9-bac7-8facea49c694', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902', 'code': 200} Dec 09 21:42:33.846495 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:33.928142 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87216ecf-9422-4d0d-880b-a4eec226491b req-dcc5fb60-1bb8-401d-a2c6-eb725c6947f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:33.930029 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-87216ecf-9422-4d0d-880b-a4eec226491b req-dcc5fb60-1bb8-401d-a2c6-eb725c6947f1 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 1098 time: 0.0535092 Dec 09 21:42:34.042218 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-87216ecf-9422-4d0d-880b-a4eec226491b req-95c4ccd8-12f2-4deb-a521-b576b6d65f6e service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1016760 Dec 09 21:42:34.070612 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d9b302e0-9c94-4951-8b44-fcb81f8cf5a8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Router efae9893-a48b-41c5-9ef7-2e80fb913c85 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:42:34.150966 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5547963d-8efb-4e97-99fc-5b8bc078b301 None None] Provisioning complete for port c2f90000-f7fd-4263-9445-46bb6b1e0b86 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:34.152942 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5547963d-8efb-4e97-99fc-5b8bc078b301 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:34.176673 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d9b302e0-9c94-4951-8b44-fcb81f8cf5a8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:42:34.182074 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d9b302e0-9c94-4951-8b44-fcb81f8cf5a8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "PUT /v2.0/routers/efae9893-a48b-41c5-9ef7-2e80fb913c85/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5655048 Dec 09 21:42:34.184693 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36234) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:34.189289 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] Sync routers for ids ['efae9893-a48b-41c5-9ef7-2e80fb913c85'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:42:34.205395 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] Routers {'efae9893-a48b-41c5-9ef7-2e80fb913c85'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:42:34.206386 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:42:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['efae9893-a48b-41c5-9ef7-2e80fb913c85'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:42:34.344157 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df4a7940-2779-4fac-a1e4-ae15a5a9b06c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:34.348382 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-df4a7940-2779-4fac-a1e4-ae15a5a9b06c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports/f5da94d7-5100-4910-b718-bb2d8cc92ef1 HTTP/1.1" status: 200 len: 911 time: 0.1601102 Dec 09 21:42:34.349036 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36238) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:34.368650 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5547963d-8efb-4e97-99fc-5b8bc078b301 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:34.436599 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-5547963d-8efb-4e97-99fc-5b8bc078b301 None None] For port c2f90000-f7fd-4263-9445-46bb6b1e0b86, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c2f90000-f7fd-4263-9445-46bb6b1e0b86,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:34.442225 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] Set router efae9893-a48b-41c5-9ef7-2e80fb913c85 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:42:34.442735 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5547963d-8efb-4e97-99fc-5b8bc078b301 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:34.449725 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-69daca91-0e14-47bb-b729-9f843f8904d7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:34.468262 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-69daca91-0e14-47bb-b729-9f843f8904d7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:34.471921 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-69daca91-0e14-47bb-b729-9f843f8904d7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1653 time: 0.1222756 Dec 09 21:42:34.474937 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36242) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:34.498161 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c2f90000-f7fd-4263-9445-46bb6b1e0b86 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:42:34.629956 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f82d97cf-ff1b-4ae0-887b-6c76902ca986 req-c8309311-3936-40b2-8a55-300a9f9b3ea3 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:34.638466 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f82d97cf-ff1b-4ae0-887b-6c76902ca986 req-c8309311-3936-40b2-8a55-300a9f9b3ea3 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.0944231 Dec 09 21:42:34.649125 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5547963d-8efb-4e97-99fc-5b8bc078b301 None None] Pushing event updated for resources: {'Port': ['ID=c2f90000-f7fd-4263-9445-46bb6b1e0b86,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:34.668555 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port c2f90000-f7fd-4263-9445-46bb6b1e0b86 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:34.669932 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:34.726372 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b45e9c74-317c-46ee-a4d5-40611a32db8f None None] Provisioning complete for port f5da94d7-5100-4910-b718-bb2d8cc92ef1 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:34.726928 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b45e9c74-317c-46ee-a4d5-40611a32db8f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:34.743181 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'efae9893-a48b-41c5-9ef7-2e80fb913c85', 'name': 'tempest-NetworksTestDHCPv6-router-2001699166', 'tenant_id': '91d65fdee4d24f0fb98cc03c485255f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:42:31Z', 'updated_at': '2021-12-09T21:42:33Z', 'revision_number': 2, 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'gw_port_host': None, '_interfaces': [{'id': 'f5da94d7-5100-4910-b718-bb2d8cc92ef1', 'name': '', 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'tenant_id': '91d65fdee4d24f0fb98cc03c485255f6', 'mac_address': 'fa:16:3e:e7:d5:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'efae9893-a48b-41c5-9ef7-2e80fb913c85', 'device_owner': 'network:router_interface', 'standard_attr_id': 2773, 'fixed_ips': [{'subnet_id': 'caf33ffe-93e3-4d65-9e26-d679faa4a1c7', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:42:32Z', 'updated_at': '2021-12-09T21:42:33Z', 'revision_number': 2, 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'subnets': [{'id': 'caf33ffe-93e3-4d65-9e26-d679faa4a1c7', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:42:34.777555 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f82d97cf-ff1b-4ae0-887b-6c76902ca986 req-7149ccdf-3e40-40e8-8e4e-637bb7679a59 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1252444 Dec 09 21:42:34.815341 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] Checking router: efae9893-a48b-41c5-9ef7-2e80fb913c85 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:42:34.815970 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] Updating router efae9893-a48b-41c5-9ef7-2e80fb913c85 port f5da94d7-5100-4910-b718-bb2d8cc92ef1 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:42:34.817199 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-b45e9c74-317c-46ee-a4d5-40611a32db8f None None] Port f5da94d7-5100-4910-b718-bb2d8cc92ef1 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:42:34.857273 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:35.043972 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2d164057-fff2-4b39-819f-da0059818377 None None] Provisioning complete for port f5da94d7-5100-4910-b718-bb2d8cc92ef1 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:35.044339 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2d164057-fff2-4b39-819f-da0059818377 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:35.080282 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-129f23ab-5ce7-4877-a935-d93787cfcee8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:35.091636 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-2d164057-fff2-4b39-819f-da0059818377 None None] Port f5da94d7-5100-4910-b718-bb2d8cc92ef1 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:42:35.147886 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:35.157338 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:35.220226 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1786dee-8f3f-467a-9bc5-82e3849872b2 None None] Pushing event updated for resources: {'Port': ['ID=f5da94d7-5100-4910-b718-bb2d8cc92ef1,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:35.325049 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] Attempting to bind port f5da94d7-5100-4910-b718-bb2d8cc92ef1 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:42:35.326685 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] Attempting to bind port f5da94d7-5100-4910-b718-bb2d8cc92ef1 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:42:35.327396 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] Attempting to bind port f5da94d7-5100-4910-b718-bb2d8cc92ef1 on network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:42:35.333546 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 42, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:42:35.334234 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] Checking segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:42:35.334827 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:35.335391 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] Bound using segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:42:35.336074 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] Bound port: f5da94d7-5100-4910-b718-bb2d8cc92ef1, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:42:35.336864 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:35.362196 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-129f23ab-5ce7-4877-a935-d93787cfcee8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting port f5da94d7-5100-4910-b718-bb2d8cc92ef1 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:42:35.363703 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-129f23ab-5ce7-4877-a935-d93787cfcee8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:35.442161 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] For port f5da94d7-5100-4910-b718-bb2d8cc92ef1, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:42:35.445542 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] For port f5da94d7-5100-4910-b718-bb2d8cc92ef1, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f5da94d7-5100-4910-b718-bb2d8cc92ef1,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:42:35.461415 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:35.514858 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-129f23ab-5ce7-4877-a935-d93787cfcee8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] For port f5da94d7-5100-4910-b718-bb2d8cc92ef1, host n-d-713301-27, got binding levels [] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:35.515376 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-129f23ab-5ce7-4877-a935-d93787cfcee8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:35.549450 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-129f23ab-5ce7-4877-a935-d93787cfcee8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Calling delete_port for f5da94d7-5100-4910-b718-bb2d8cc92ef1 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:42:35.555825 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] Routers {'efae9893-a48b-41c5-9ef7-2e80fb913c85'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:42:35.556686 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:42:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['efae9893-a48b-41c5-9ef7-2e80fb913c85'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:42:35.564597 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f6556161-8950-4f69-8690-a7d53af328c5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:35.621518 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b00247ac-c91d-4a73-b0f0-20279f3de50a None None] Provisioning complete for port f5da94d7-5100-4910-b718-bb2d8cc92ef1 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:35.621518 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b00247ac-c91d-4a73-b0f0-20279f3de50a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:35.650396 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1786dee-8f3f-467a-9bc5-82e3849872b2 None None] Pushing event updated for resources: {'Port': ['ID=f5da94d7-5100-4910-b718-bb2d8cc92ef1,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:35.792793 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] Set router efae9893-a48b-41c5-9ef7-2e80fb913c85 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:42:35.793624 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b00247ac-c91d-4a73-b0f0-20279f3de50a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:36.014754 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-129f23ab-5ce7-4877-a935-d93787cfcee8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:36.069890 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-129f23ab-5ce7-4877-a935-d93787cfcee8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Port': ['ID=f5da94d7-5100-4910-b718-bb2d8cc92ef1,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:36.177718 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e621d3d6-9d69-4f20-b882-3ae73e100832 None None] Could not find standard attr ID for object f5da94d7-5100-4910-b718-bb2d8cc92ef1. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:42:36.217911 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-129f23ab-5ce7-4877-a935-d93787cfcee8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:36.309075 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1254c59-9749-43e3-b139-b0d5fcd57cf1 req-dfd99111-eb2f-4036-8de9-648ae40b4ada tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:36.328301 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c1254c59-9749-43e3-b139-b0d5fcd57cf1 req-dfd99111-eb2f-4036-8de9-648ae40b4ada tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.4019685 Dec 09 21:42:36.375210 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'efae9893-a48b-41c5-9ef7-2e80fb913c85', 'name': 'tempest-NetworksTestDHCPv6-router-2001699166', 'tenant_id': '91d65fdee4d24f0fb98cc03c485255f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:42:31Z', 'updated_at': '2021-12-09T21:42:33Z', 'revision_number': 2, 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'gw_port_host': None, '_interfaces': [{'id': 'f5da94d7-5100-4910-b718-bb2d8cc92ef1', 'name': '', 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'tenant_id': '91d65fdee4d24f0fb98cc03c485255f6', 'mac_address': 'fa:16:3e:e7:d5:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'efae9893-a48b-41c5-9ef7-2e80fb913c85', 'device_owner': 'network:router_interface', 'standard_attr_id': 2773, 'fixed_ips': [{'subnet_id': 'caf33ffe-93e3-4d65-9e26-d679faa4a1c7', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:42:32Z', 'updated_at': '2021-12-09T21:42:35Z', 'revision_number': 4, 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'subnets': [{'id': 'caf33ffe-93e3-4d65-9e26-d679faa4a1c7', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:42:36.393095 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c2f90000-f7fd-4263-9445-46bb6b1e0b86 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:42:36.426800 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a041545-1c1e-496e-bef0-a579fb4e71b9 None None] The sync data for ids ['efae9893-a48b-41c5-9ef7-2e80fb913c85'] in n-d-713301-27 is: [{'id': 'efae9893-a48b-41c5-9ef7-2e80fb913c85', 'name': 'tempest-NetworksTestDHCPv6-router-2001699166', 'tenant_id': '91d65fdee4d24f0fb98cc03c485255f6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:42:31Z', 'updated_at': '2021-12-09T21:42:33Z', 'revision_number': 2, 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'gw_port_host': None, '_interfaces': [{'id': 'f5da94d7-5100-4910-b718-bb2d8cc92ef1', 'name': '', 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'tenant_id': '91d65fdee4d24f0fb98cc03c485255f6', 'mac_address': 'fa:16:3e:e7:d5:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'efae9893-a48b-41c5-9ef7-2e80fb913c85', 'device_owner': 'network:router_interface', 'standard_attr_id': 2773, 'fixed_ips': [{'subnet_id': 'caf33ffe-93e3-4d65-9e26-d679faa4a1c7', 'ip_address': '2001:db8::1', 'prefixlen': 64}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:42:32Z', 'updated_at': '2021-12-09T21:42:35Z', 'revision_number': 4, 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'subnets': [{'id': 'caf33ffe-93e3-4d65-9e26-d679faa4a1c7', 'cidr': '2001:db8::/64', 'gateway_ip': '2001:db8::1', 'dns_nameservers': [], 'ipv6_ra_mode': 'dhcpv6-stateful', 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:42:36.462102 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c1254c59-9749-43e3-b139-b0d5fcd57cf1 req-b85bdef8-5bbd-4b2e-98b7-2612e63cbe35 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1315417 Dec 09 21:42:36.541403 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port c2f90000-f7fd-4263-9445-46bb6b1e0b86 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:36.543486 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:36.669640 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-129f23ab-5ce7-4877-a935-d93787cfcee8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Router efae9893-a48b-41c5-9ef7-2e80fb913c85 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:42:36.679280 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:36.867557 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-129f23ab-5ce7-4877-a935-d93787cfcee8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:42:36.901588 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-129f23ab-5ce7-4877-a935-d93787cfcee8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "PUT /v2.0/routers/efae9893-a48b-41c5-9ef7-2e80fb913c85/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4229839 Dec 09 21:42:36.903076 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-277e2314-32dd-43bb-9d94-c4c2f1ec32eb req-e48ae7d6-b52c-4ed6-88de-a67ba9fd8904 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:36.903930 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36268) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:36.912967 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-277e2314-32dd-43bb-9d94-c4c2f1ec32eb req-e48ae7d6-b52c-4ed6-88de-a67ba9fd8904 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.1514099 Dec 09 21:42:37.051266 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-277e2314-32dd-43bb-9d94-c4c2f1ec32eb req-8389b7e5-32bc-4288-b376-3e17da09674d tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1289811 Dec 09 21:42:37.065287 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e52481f3-0f35-4cea-94dc-08346785c2fb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:37.069710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e52481f3-0f35-4cea-94dc-08346785c2fb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:37.083790 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e52481f3-0f35-4cea-94dc-08346785c2fb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1464 time: 0.1702714 Dec 09 21:42:37.084321 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36274) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:37.149821 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-305fe3b3-9fe6-48d1-a227-770f3a26fd57 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet caf33ffe-93e3-4d65-9e26-d679faa4a1c7 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:42:37.153585 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-305fe3b3-9fe6-48d1-a227-770f3a26fd57 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:37.221036 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-305fe3b3-9fe6-48d1-a227-770f3a26fd57 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:37.314024 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-305fe3b3-9fe6-48d1-a227-770f3a26fd57 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:37.408580 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-305fe3b3-9fe6-48d1-a227-770f3a26fd57 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:37.444225 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-305fe3b3-9fe6-48d1-a227-770f3a26fd57 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=caf33ffe-93e3-4d65-9e26-d679faa4a1c7,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:37.456975 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-305fe3b3-9fe6-48d1-a227-770f3a26fd57 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:37.464112 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36278) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:37.464542 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-305fe3b3-9fe6-48d1-a227-770f3a26fd57 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/caf33ffe-93e3-4d65-9e26-d679faa4a1c7 HTTP/1.1" status: 204 len: 168 time: 0.3845830 Dec 09 21:42:37.468978 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc7e02bc-a986-4d00-a1bc-0ca9cf6f5dc5 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:42:37.477682 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c4da44-44fb-41d9-aed4-730d1f0ad18a req-d640d5f5-70c5-419a-a68c-ab4de4a2fca0 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:37.487120 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c4c4da44-44fb-41d9-aed4-730d1f0ad18a req-d640d5f5-70c5-419a-a68c-ab4de4a2fca0 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.1141627 Dec 09 21:42:37.550300 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c4c4da44-44fb-41d9-aed4-730d1f0ad18a req-ebef1f29-c1b9-44d2-b003-6a9d153485c9 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0565329 Dec 09 21:42:37.683922 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fd30dc58-0154-4683-b479-4217652630ae tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 710 time: 0.2167814 Dec 09 21:42:37.684763 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36282) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:37.785801 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37f2aef1-8fab-4084-8eaf-215fa23722fc None None] DHCP port deletion for 77d1c069-bca4-4157-a30b-fb10cbd9d9ee request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:42:37.891545 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24269c7c-5fa4-48e6-a602-bbaa3e23e5d2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:37.905202 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-37f2aef1-8fab-4084-8eaf-215fa23722fc None None] Deleting port c2f90000-f7fd-4263-9445-46bb6b1e0b86 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:42:37.905202 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-37f2aef1-8fab-4084-8eaf-215fa23722fc None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:38.059635 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-37f2aef1-8fab-4084-8eaf-215fa23722fc None None] For port c2f90000-f7fd-4263-9445-46bb6b1e0b86, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c2f90000-f7fd-4263-9445-46bb6b1e0b86,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:38.060250 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-37f2aef1-8fab-4084-8eaf-215fa23722fc None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:38.062813 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:38.084552 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-37f2aef1-8fab-4084-8eaf-215fa23722fc None None] Calling delete_port for c2f90000-f7fd-4263-9445-46bb6b1e0b86 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:42:38.222006 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24269c7c-5fa4-48e6-a602-bbaa3e23e5d2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:38.235818 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24269c7c-5fa4-48e6-a602-bbaa3e23e5d2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:38.246939 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-37f2aef1-8fab-4084-8eaf-215fa23722fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:38.296793 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68683ad1-2421-4aaf-973b-3291310f0f1e req-94ede628-9546-4088-8b8c-5fc9e4b0cc62 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:38.312651 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-68683ad1-2421-4aaf-973b-3291310f0f1e req-94ede628-9546-4088-8b8c-5fc9e4b0cc62 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.2755642 Dec 09 21:42:38.406495 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37f2aef1-8fab-4084-8eaf-215fa23722fc None None] Pushing event deleted for resources: {'Port': ['ID=c2f90000-f7fd-4263-9445-46bb6b1e0b86,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:38.419218 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37f2aef1-8fab-4084-8eaf-215fa23722fc None None] No DVR routers for this DVR port c2f90000-f7fd-4263-9445-46bb6b1e0b86 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:42:38.438985 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c2f90000-f7fd-4263-9445-46bb6b1e0b86 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:42:38.488591 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: c2f90000-f7fd-4263-9445-46bb6b1e0b86 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:42:38.489225 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c2f90000-f7fd-4263-9445-46bb6b1e0b86 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:42:38.505432 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24269c7c-5fa4-48e6-a602-bbaa3e23e5d2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:38.507621 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-24269c7c-5fa4-48e6-a602-bbaa3e23e5d2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Fanout notify agent at l3_agent the message router_deleted on router efae9893-a48b-41c5-9ef7-2e80fb913c85 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:42:38.521744 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24269c7c-5fa4-48e6-a602-bbaa3e23e5d2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:38.522928 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-24269c7c-5fa4-48e6-a602-bbaa3e23e5d2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/routers/efae9893-a48b-41c5-9ef7-2e80fb913c85 HTTP/1.1" status: 204 len: 168 time: 0.8368852 Dec 09 21:42:38.525722 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36292) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:38.537264 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-68683ad1-2421-4aaf-973b-3291310f0f1e req-ca2cc0c2-104d-4af6-a935-491294ce2120 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2223454 Dec 09 21:42:38.580707 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36294) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:38.583850 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4e5e2f9e-d86c-4c81-b39f-904451558733 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0509825 Dec 09 21:42:38.592828 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ef41cce-a9b9-465f-9d03-43f26a23279e None None] Sync routers for ids ['efae9893-a48b-41c5-9ef7-2e80fb913c85'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:42:38.611597 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ef41cce-a9b9-465f-9d03-43f26a23279e None None] Routers set() bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:42:38.611978 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ef41cce-a9b9-465f-9d03-43f26a23279e None None] Router IDs set() for agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Dec 09 21:42:38.612722 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_agentschedulers_db [None req-9ef41cce-a9b9-465f-9d03-43f26a23279e None None] Agent requested router IDs not scheduled to it. Scheduled: []. Unscheduled: {'efae9893-a48b-41c5-9ef7-2e80fb913c85'}. Agent: Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:42:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent'). {{(pid=103439) list_active_sync_routers_on_active_l3_agent /opt/stack/neutron/neutron/db/l3_agentschedulers_db.py:353}} Dec 09 21:42:38.624319 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ef41cce-a9b9-465f-9d03-43f26a23279e None None] Routers set() bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:42:38.624791 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ef41cce-a9b9-465f-9d03-43f26a23279e None None] Router IDs set() for agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Dec 09 21:42:38.625423 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_agentschedulers_db [None req-9ef41cce-a9b9-465f-9d03-43f26a23279e None None] Agent requested router IDs not scheduled to it. Scheduled: []. Unscheduled: {'efae9893-a48b-41c5-9ef7-2e80fb913c85'}. Agent: Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:42:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent'). {{(pid=103439) list_active_sync_routers_on_active_l3_agent /opt/stack/neutron/neutron/db/l3_agentschedulers_db.py:353}} Dec 09 21:42:38.626010 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ef41cce-a9b9-465f-9d03-43f26a23279e None None] The sync data for ids ['efae9893-a48b-41c5-9ef7-2e80fb913c85'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:42:38.657902 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3bf2a9e0-7513-4cee-9f80-ad1ba0a1a325 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:38.659373 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3bf2a9e0-7513-4cee-9f80-ad1ba0a1a325 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0775242 Dec 09 21:42:38.662197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36296) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:38.706105 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-23217e5b-b1b1-48c5-984d-de134fb3ab9a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0418923 Dec 09 21:42:38.710261 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36298) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:38.716573 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-10dcfdbf-db35-45c2-8c11-3d9d3fe2c141 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:38.816202 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-10dcfdbf-db35-45c2-8c11-3d9d3fe2c141 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:38.821048 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-10dcfdbf-db35-45c2-8c11-3d9d3fe2c141 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:39.178696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.objects.ports [None req-10dcfdbf-db35-45c2-8c11-3d9d3fe2c141 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103438) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 09 21:42:39.180474 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-10dcfdbf-db35-45c2-8c11-3d9d3fe2c141 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:39.225045 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10dcfdbf-db35-45c2-8c11-3d9d3fe2c141 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:39.230099 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-10dcfdbf-db35-45c2-8c11-3d9d3fe2c141 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:39.250991 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-10dcfdbf-db35-45c2-8c11-3d9d3fe2c141 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:39.251560 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-10dcfdbf-db35-45c2-8c11-3d9d3fe2c141 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:39.255827 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8366fbda-060d-4c56-98ab-090f368bc976 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:42:39.291901 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10dcfdbf-db35-45c2-8c11-3d9d3fe2c141 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=99532a47-37fc-4d70-8614-e1ecf98d6198,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:39.319413 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-10dcfdbf-db35-45c2-8c11-3d9d3fe2c141 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 0.6064725 Dec 09 21:42:39.320854 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36312) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:39.329406 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-6b6d7b9a-0831-4c3f-9a7d-1139c40a6fd5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:39.422216 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a8a0813a-3e50-4228-87b2-73dbdeb4e255 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'fixed_ips': [{'subnet_id': '99532a47-37fc-4d70-8614-e1ecf98d6198'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:42:39.423135 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a8a0813a-3e50-4228-87b2-73dbdeb4e255 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:39.508806 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6b6d7b9a-0831-4c3f-9a7d-1139c40a6fd5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:39.525775 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6b6d7b9a-0831-4c3f-9a7d-1139c40a6fd5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:39.618663 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-a8a0813a-3e50-4228-87b2-73dbdeb4e255 None None] Allocated IP 2001:db8::f816:3eff:feaf:31bc (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/99532a47-37fc-4d70-8614-e1ecf98d6198/b3a71631-081c-47a1-b626-28b8c8aaf314) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:39.764439 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1304ce26-ed57-461f-abb7-21a2e10cacdd req-d1def8ed-62cc-43f3-9485-a59b5c481019 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:39.766071 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1304ce26-ed57-461f-abb7-21a2e10cacdd req-d1def8ed-62cc-43f3-9485-a59b5c481019 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.0920248 Dec 09 21:42:39.862463 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:39.869703 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1304ce26-ed57-461f-abb7-21a2e10cacdd req-6032dd74-97dc-4291-ac61-2cb0c3d66523 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0964334 Dec 09 21:42:39.914693 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a8a0813a-3e50-4228-87b2-73dbdeb4e255 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:39.933876 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a8a0813a-3e50-4228-87b2-73dbdeb4e255 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:39.987737 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8a0813a-3e50-4228-87b2-73dbdeb4e255 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:39.991473 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-a8a0813a-3e50-4228-87b2-73dbdeb4e255 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:39.998228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8a0813a-3e50-4228-87b2-73dbdeb4e255 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:42:40.004345 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8a0813a-3e50-4228-87b2-73dbdeb4e255 None None] Pushing event updated for resources: {'Port': ['ID=b3a71631-081c-47a1-b626-28b8c8aaf314,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:40.072417 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a8a0813a-3e50-4228-87b2-73dbdeb4e255 None None] Attempting to bind port b3a71631-081c-47a1-b626-28b8c8aaf314 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:42:40.072947 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a8a0813a-3e50-4228-87b2-73dbdeb4e255 None None] Attempting to bind port b3a71631-081c-47a1-b626-28b8c8aaf314 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:42:40.073441 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8a0813a-3e50-4228-87b2-73dbdeb4e255 None None] Attempting to bind port b3a71631-081c-47a1-b626-28b8c8aaf314 on network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:42:40.079705 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8a0813a-3e50-4228-87b2-73dbdeb4e255 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 42, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:42:40.080241 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8a0813a-3e50-4228-87b2-73dbdeb4e255 None None] Checking segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:42:40.080756 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a8a0813a-3e50-4228-87b2-73dbdeb4e255 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:40.081247 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8a0813a-3e50-4228-87b2-73dbdeb4e255 None None] Bound using segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:42:40.081825 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a8a0813a-3e50-4228-87b2-73dbdeb4e255 None None] Bound port: b3a71631-081c-47a1-b626-28b8c8aaf314, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:42:40.082348 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a8a0813a-3e50-4228-87b2-73dbdeb4e255 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:40.191649 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a8a0813a-3e50-4228-87b2-73dbdeb4e255 None None] For port b3a71631-081c-47a1-b626-28b8c8aaf314, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:42:40.195555 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a8a0813a-3e50-4228-87b2-73dbdeb4e255 None None] For port b3a71631-081c-47a1-b626-28b8c8aaf314, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b3a71631-081c-47a1-b626-28b8c8aaf314,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:42:40.204566 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a8a0813a-3e50-4228-87b2-73dbdeb4e255 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:40.314571 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f5da94d7-5100-4910-b718-bb2d8cc92ef1 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:42:40.379918 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: f5da94d7-5100-4910-b718-bb2d8cc92ef1 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:42:40.380448 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f5da94d7-5100-4910-b718-bb2d8cc92ef1 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:42:40.391971 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8a0813a-3e50-4228-87b2-73dbdeb4e255 None None] Pushing event updated for resources: {'Port': ['ID=b3a71631-081c-47a1-b626-28b8c8aaf314,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:40.431866 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6b6d7b9a-0831-4c3f-9a7d-1139c40a6fd5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:40.536132 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b6d7b9a-0831-4c3f-9a7d-1139c40a6fd5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:40.545246 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-6b6d7b9a-0831-4c3f-9a7d-1139c40a6fd5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:40.570186 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b6d7b9a-0831-4c3f-9a7d-1139c40a6fd5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=f03cde81-60a5-48bf-84fc-0178577c2431,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:40.580979 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b6d7b9a-0831-4c3f-9a7d-1139c40a6fd5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:40.583310 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6b6d7b9a-0831-4c3f-9a7d-1139c40a6fd5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:40.610658 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6b6d7b9a-0831-4c3f-9a7d-1139c40a6fd5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.2883973 Dec 09 21:42:40.617199 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36342) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:40.653280 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-ac95d7a3-9730-41fc-a617-573c91327967 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'mac_address': 'fa:16:3e:15:09:15', 'name': 'tempest-NetworksTestDHCPv6-1679028269'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:40.903173 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ac95d7a3-9730-41fc-a617-573c91327967 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:41.454095 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ac95d7a3-9730-41fc-a617-573c91327967 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:41.465793 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13be5a43-e064-449e-9102-83dec24d5060 req-3d49ed10-d327-4d76-8606-8c85e57a3a13 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:41.467475 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-13be5a43-e064-449e-9102-83dec24d5060 req-3d49ed10-d327-4d76-8606-8c85e57a3a13 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.0856977 Dec 09 21:42:41.544287 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-13be5a43-e064-449e-9102-83dec24d5060 req-13ce32e4-37af-446f-b91d-97ea2a2dd454 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0698910 Dec 09 21:42:41.562438 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-ac95d7a3-9730-41fc-a617-573c91327967 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] device_id is not set on port 4d683c07-5ddd-4f16-8df5-cbd28f9517f3 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:42:41.886643 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-ac95d7a3-9730-41fc-a617-573c91327967 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 172.20.0.8 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/f03cde81-60a5-48bf-84fc-0178577c2431/4d683c07-5ddd-4f16-8df5-cbd28f9517f3) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:41.946471 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-ac95d7a3-9730-41fc-a617-573c91327967 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8::f816:3eff:fe15:915 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/99532a47-37fc-4d70-8614-e1ecf98d6198/4d683c07-5ddd-4f16-8df5-cbd28f9517f3) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:42.200853 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ac95d7a3-9730-41fc-a617-573c91327967 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:42.245733 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42e5018e-58ff-4f8f-bd87-3efe69b33e4f None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:42:42.257589 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ac95d7a3-9730-41fc-a617-573c91327967 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:42.320585 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7f8286c5-6de5-4e14-b3e1-b4974c012f0e None None] Provisioning complete for port b3a71631-081c-47a1-b626-28b8c8aaf314 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:42.321767 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7f8286c5-6de5-4e14-b3e1-b4974c012f0e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:42.454661 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ac95d7a3-9730-41fc-a617-573c91327967 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:42.459720 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-ac95d7a3-9730-41fc-a617-573c91327967 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:42.475307 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac95d7a3-9730-41fc-a617-573c91327967 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:42:42.483639 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac95d7a3-9730-41fc-a617-573c91327967 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=4d683c07-5ddd-4f16-8df5-cbd28f9517f3,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:42.506466 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7f8286c5-6de5-4e14-b3e1-b4974c012f0e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:42.561028 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ac95d7a3-9730-41fc-a617-573c91327967 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:42.561687 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ac95d7a3-9730-41fc-a617-573c91327967 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:42.565290 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b3a71631-081c-47a1-b626-28b8c8aaf314 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:42:42.606693 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ac95d7a3-9730-41fc-a617-573c91327967 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1026 time: 1.9874697 Dec 09 21:42:42.608753 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36434) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:42.784297 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-719ad554-fe2d-4c12-9a60-bbcaaca1ece1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:42.805953 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-719ad554-fe2d-4c12-9a60-bbcaaca1ece1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:42.813963 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-719ad554-fe2d-4c12-9a60-bbcaaca1ece1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1781 time: 0.2033842 Dec 09 21:42:42.816179 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36460) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:42.834553 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-7f8286c5-6de5-4e14-b3e1-b4974c012f0e None None] For port b3a71631-081c-47a1-b626-28b8c8aaf314, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b3a71631-081c-47a1-b626-28b8c8aaf314,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:42.836642 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-812ef2ad-6514-49ed-acbe-4fdf513ea9e3 None None] Update dhcp port {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'fixed_ips': [{'subnet_id': '99532a47-37fc-4d70-8614-e1ecf98d6198', 'ip_address': '2001:db8::f816:3eff:feaf:31bc'}, {'subnet_id': 'f03cde81-60a5-48bf-84fc-0178577c2431'}], 'binding:host_id': 'n-d-713301-27'}, 'id': 'b3a71631-081c-47a1-b626-28b8c8aaf314'} from n-d-713301-27. {{(pid=103439) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 09 21:42:42.848415 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e0e33a2-eed2-4753-8bf0-dfefa592b921 req-a91ccce3-7282-4215-9800-ffd796d68f58 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:42.858738 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9e0e33a2-eed2-4753-8bf0-dfefa592b921 req-a91ccce3-7282-4215-9800-ffd796d68f58 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.1459408 Dec 09 21:42:42.870149 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7f8286c5-6de5-4e14-b3e1-b4974c012f0e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:42.909225 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port b3a71631-081c-47a1-b626-28b8c8aaf314 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:42.909628 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:42.934127 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9e0e33a2-eed2-4753-8bf0-dfefa592b921 req-0eafe503-9977-419c-8096-b9cdf16e1b88 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0740962 Dec 09 21:42:42.958560 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-812ef2ad-6514-49ed-acbe-4fdf513ea9e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:43.010429 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-a474d432-91d1-4f72-bab0-b2f205671045 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting port 4d683c07-5ddd-4f16-8df5-cbd28f9517f3 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:42:43.010799 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a474d432-91d1-4f72-bab0-b2f205671045 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:43.090451 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f8286c5-6de5-4e14-b3e1-b4974c012f0e None None] Pushing event updated for resources: {'Port': ['ID=b3a71631-081c-47a1-b626-28b8c8aaf314,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:43.151689 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a474d432-91d1-4f72-bab0-b2f205671045 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:43.170944 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-a474d432-91d1-4f72-bab0-b2f205671045 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Calling delete_port for 4d683c07-5ddd-4f16-8df5-cbd28f9517f3 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:42:43.424258 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-812ef2ad-6514-49ed-acbe-4fdf513ea9e3 None None] Allocated IP 172.20.0.2 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/f03cde81-60a5-48bf-84fc-0178577c2431/b3a71631-081c-47a1-b626-28b8c8aaf314) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:43.579335 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a474d432-91d1-4f72-bab0-b2f205671045 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:43.614682 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-812ef2ad-6514-49ed-acbe-4fdf513ea9e3 None None] For port b3a71631-081c-47a1-b626-28b8c8aaf314, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b3a71631-081c-47a1-b626-28b8c8aaf314,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:43.656625 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a474d432-91d1-4f72-bab0-b2f205671045 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Port': ['ID=4d683c07-5ddd-4f16-8df5-cbd28f9517f3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:43.687691 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-812ef2ad-6514-49ed-acbe-4fdf513ea9e3 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:43.694944 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-812ef2ad-6514-49ed-acbe-4fdf513ea9e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:43.823092 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a474d432-91d1-4f72-bab0-b2f205671045 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:43.826552 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a474d432-91d1-4f72-bab0-b2f205671045 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/4d683c07-5ddd-4f16-8df5-cbd28f9517f3 HTTP/1.1" status: 204 len: 168 time: 1.0089405 Dec 09 21:42:43.829224 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36560) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:43.908199 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-812ef2ad-6514-49ed-acbe-4fdf513ea9e3 None None] Pushing event updated for resources: {'Port': ['ID=b3a71631-081c-47a1-b626-28b8c8aaf314,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:43.911374 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df62f82c-1198-4209-b91d-fc6a35c79cce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:43.912445 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df62f82c-1198-4209-b91d-fc6a35c79cce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:43.913960 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df62f82c-1198-4209-b91d-fc6a35c79cce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:43.919245 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36568) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:43.921705 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-df62f82c-1198-4209-b91d-fc6a35c79cce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2049 time: 0.0846555 Dec 09 21:42:44.066537 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-16c4a18c-aaa1-4625-b4f3-00c8168355fc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet 99532a47-37fc-4d70-8614-e1ecf98d6198 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:42:44.080375 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-16c4a18c-aaa1-4625-b4f3-00c8168355fc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:44.206244 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-16c4a18c-aaa1-4625-b4f3-00c8168355fc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:44.388981 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b3a71631-081c-47a1-b626-28b8c8aaf314 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:42:44.459146 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-16c4a18c-aaa1-4625-b4f3-00c8168355fc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:44.514803 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port b3a71631-081c-47a1-b626-28b8c8aaf314 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:44.515887 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:44.529917 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1216d9e7-43f6-4971-bcc9-33ab4ba3716e req-120fd60e-0679-4955-bfeb-322a4ea8b5bb tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:44.535495 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1216d9e7-43f6-4971-bcc9-33ab4ba3716e req-120fd60e-0679-4955-bfeb-322a4ea8b5bb tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.3656969 Dec 09 21:42:44.696493 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1216d9e7-43f6-4971-bcc9-33ab4ba3716e req-777aa8cd-f5a3-4dd6-b17d-8b73f0dbd4ee tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1516736 Dec 09 21:42:44.735626 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-16c4a18c-aaa1-4625-b4f3-00c8168355fc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:44.882545 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16c4a18c-aaa1-4625-b4f3-00c8168355fc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=99532a47-37fc-4d70-8614-e1ecf98d6198,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:44.904463 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-16c4a18c-aaa1-4625-b4f3-00c8168355fc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:44.910109 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-16c4a18c-aaa1-4625-b4f3-00c8168355fc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/99532a47-37fc-4d70-8614-e1ecf98d6198 HTTP/1.1" status: 204 len: 168 time: 0.9875028 Dec 09 21:42:44.912021 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36658) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:44.973424 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbd6de5e-4e8f-4842-aaa8-73af7a2231ef req-c79d7eb7-367d-4081-88c2-d2f845e14a6a tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:44.992089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fbd6de5e-4e8f-4842-aaa8-73af7a2231ef req-c79d7eb7-367d-4081-88c2-d2f845e14a6a tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.1223402 Dec 09 21:42:45.010690 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-a4b75b6c-3307-401a-a403-706252dc0749 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet f03cde81-60a5-48bf-84fc-0178577c2431 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:42:45.028049 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a4b75b6c-3307-401a-a403-706252dc0749 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:45.095203 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fbd6de5e-4e8f-4842-aaa8-73af7a2231ef req-a3fea244-abb0-4bd0-9258-ee09009655b5 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1020787 Dec 09 21:42:45.167732 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a4b75b6c-3307-401a-a403-706252dc0749 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:45.218926 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ef1220c2-0c1f-44d8-ad4e-3b1585739ee6 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:42:45.310208 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a4b75b6c-3307-401a-a403-706252dc0749 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:45.372271 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c0a7c984-3684-4ead-b1be-35d347babfd2 None None] Provisioning complete for port b3a71631-081c-47a1-b626-28b8c8aaf314 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:45.372953 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c0a7c984-3684-4ead-b1be-35d347babfd2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:45.397357 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a4b75b6c-3307-401a-a403-706252dc0749 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:45.476677 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a4b75b6c-3307-401a-a403-706252dc0749 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:45.491919 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a4b75b6c-3307-401a-a403-706252dc0749 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/f03cde81-60a5-48bf-84fc-0178577c2431 HTTP/1.1" status: 204 len: 168 time: 0.5787857 Dec 09 21:42:45.493629 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4b75b6c-3307-401a-a403-706252dc0749 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=f03cde81-60a5-48bf-84fc-0178577c2431,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:45.500251 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36708) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:45.576941 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-674d6c98-5044-40b9-9a40-f7368ca07f9a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0751050 Dec 09 21:42:45.579957 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36718) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:45.585938 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-faa8bc05-3e5b-4cde-be3d-8409e3a7d912 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:45.602096 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c0a7c984-3684-4ead-b1be-35d347babfd2 None None] Could not find standard attr ID for object 4d683c07-5ddd-4f16-8df5-cbd28f9517f3. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:42:45.729568 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6800f7e3-82bf-420f-beb9-d76862edcb9d None None] Update dhcp port {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'fixed_ips': [{'subnet_id': 'f03cde81-60a5-48bf-84fc-0178577c2431'}], 'binding:host_id': 'n-d-713301-27'}, 'id': 'b3a71631-081c-47a1-b626-28b8c8aaf314'} from n-d-713301-27. {{(pid=103439) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 09 21:42:45.762792 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6800f7e3-82bf-420f-beb9-d76862edcb9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:45.775931 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-faa8bc05-3e5b-4cde-be3d-8409e3a7d912 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:45.786383 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-faa8bc05-3e5b-4cde-be3d-8409e3a7d912 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:45.926658 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fa6e544-b256-4995-b96e-a200d22f9597 req-3a8d0095-8c62-4c14-8d1d-2c378a77949b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:45.951125 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8fa6e544-b256-4995-b96e-a200d22f9597 req-3a8d0095-8c62-4c14-8d1d-2c378a77949b tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.1385701 Dec 09 21:42:46.068735 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8fa6e544-b256-4995-b96e-a200d22f9597 req-aac818c4-ba3e-4240-ab27-33cb5630e013 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1151624 Dec 09 21:42:46.140615 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-75de5c07-8a51-42b2-921a-8985bbb1dd51 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:42:46.269613 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc62a687-bfea-49d9-942f-8ac433add562 req-227f9089-79ce-4940-aa61-5da273daf961 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:46.276830 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fc62a687-bfea-49d9-942f-8ac433add562 req-227f9089-79ce-4940-aa61-5da273daf961 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.0923772 Dec 09 21:42:46.389697 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fc62a687-bfea-49d9-942f-8ac433add562 req-42052f5f-9f91-4c12-a5c9-f95f9da6a5cf tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1054776 Dec 09 21:42:46.399369 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-75d12817-cd35-4adc-ae84-ccdf7c19dcc6 None None] Provisioning complete for port b3a71631-081c-47a1-b626-28b8c8aaf314 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:46.399746 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-75d12817-cd35-4adc-ae84-ccdf7c19dcc6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:46.402382 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b3a71631-081c-47a1-b626-28b8c8aaf314 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:42:46.409357 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1bc0f9d-8770-4a2a-867c-c69c192b6fb2 req-29a1a896-5e59-417b-b903-7ce69618cafd tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:46.411973 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c1bc0f9d-8770-4a2a-867c-c69c192b6fb2 req-29a1a896-5e59-417b-b903-7ce69618cafd tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.10 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 945 time: 0.2824321 Dec 09 21:42:46.593866 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-040e8f8a-42ae-4ec9-87f8-1e006c63a728 None None] DHCP port deletion for 77d1c069-bca4-4157-a30b-fb10cbd9d9ee request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:42:46.664112 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-c1bc0f9d-8770-4a2a-867c-c69c192b6fb2 req-b6823579-c0be-4f9d-a8d7-1600dc7f25e3 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Deleting port 10ac5a10-4f73-4f89-b652-3c81390af0aa {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:42:46.664561 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c1bc0f9d-8770-4a2a-867c-c69c192b6fb2 req-b6823579-c0be-4f9d-a8d7-1600dc7f25e3 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:46.671854 n-d-713301-27 neutron-server[103437]: DEBUG neutron.objects.ports [None req-faa8bc05-3e5b-4cde-be3d-8409e3a7d912 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=103437) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 09 21:42:46.745209 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-040e8f8a-42ae-4ec9-87f8-1e006c63a728 None None] Deleting port b3a71631-081c-47a1-b626-28b8c8aaf314 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:42:46.745753 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-040e8f8a-42ae-4ec9-87f8-1e006c63a728 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:46.768234 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:46.861974 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port b3a71631-081c-47a1-b626-28b8c8aaf314, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b3a71631-081c-47a1-b626-28b8c8aaf314,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:46.870590 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:46.953107 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-040e8f8a-42ae-4ec9-87f8-1e006c63a728 None None] For port b3a71631-081c-47a1-b626-28b8c8aaf314, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b3a71631-081c-47a1-b626-28b8c8aaf314,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:46.953518 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-040e8f8a-42ae-4ec9-87f8-1e006c63a728 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:46.980449 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=b3a71631-081c-47a1-b626-28b8c8aaf314,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:46.989827 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-040e8f8a-42ae-4ec9-87f8-1e006c63a728 None None] Calling delete_port for b3a71631-081c-47a1-b626-28b8c8aaf314 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:42:47.015638 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-c1bc0f9d-8770-4a2a-867c-c69c192b6fb2 req-b6823579-c0be-4f9d-a8d7-1600dc7f25e3 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] For port 10ac5a10-4f73-4f89-b652-3c81390af0aa, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=10ac5a10-4f73-4f89-b652-3c81390af0aa,segment=NetworkSegment(387b2307-6c4a-4b56-8fe0-5bcb0370db1c),segment_id=387b2307-6c4a-4b56-8fe0-5bcb0370db1c)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:47.016481 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c1bc0f9d-8770-4a2a-867c-c69c192b6fb2 req-b6823579-c0be-4f9d-a8d7-1600dc7f25e3 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:47.039242 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-c1bc0f9d-8770-4a2a-867c-c69c192b6fb2 req-b6823579-c0be-4f9d-a8d7-1600dc7f25e3 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Calling delete_port for 10ac5a10-4f73-4f89-b652-3c81390af0aa owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:42:47.139553 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-040e8f8a-42ae-4ec9-87f8-1e006c63a728 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:47.163892 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-faa8bc05-3e5b-4cde-be3d-8409e3a7d912 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:47.216944 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-040e8f8a-42ae-4ec9-87f8-1e006c63a728 None None] Pushing event deleted for resources: {'Port': ['ID=b3a71631-081c-47a1-b626-28b8c8aaf314,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:47.223155 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-040e8f8a-42ae-4ec9-87f8-1e006c63a728 None None] No DVR routers for this DVR port b3a71631-081c-47a1-b626-28b8c8aaf314 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:42:47.242251 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-faa8bc05-3e5b-4cde-be3d-8409e3a7d912 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Port b3a71631-081c-47a1-b626-28b8c8aaf314 concurrently deleted while adding address for new subnet {'id': '835c8869-c3a9-4fda-8618-cdd79b5eb526', 'name': '', 'tenant_id': '91d65fdee4d24f0fb98cc03c485255f6', 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'ip_version': 6, 'subnetpool_id': None, 'enable_dhcp': True, 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless', 'standard_attr_id': 2778, 'gateway_ip': '2001:db8::1', 'cidr': '2001:db8::/64', 'allocation_pools': [{'start': '2001:db8::2', 'end': '2001:db8::ffff:ffff:ffff:ffff'}], 'host_routes': [], 'dns_nameservers': [], 'shared': False, 'description': '', 'service_types': [], 'tags': [], 'created_at': '2021-12-09T21:42:46Z', 'updated_at': '2021-12-09T21:42:46Z', 'revision_number': 0, 'segment_id': None, 'project_id': '91d65fdee4d24f0fb98cc03c485255f6'}. {{(pid=103437) _create_subnet_postcommit /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:773}} Dec 09 21:42:47.242976 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-faa8bc05-3e5b-4cde-be3d-8409e3a7d912 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:47.330110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96836de0-154b-445e-9f73-4f92497edc42 req-5929180c-3ee3-4def-b17f-82cad05c22f8 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:47.331767 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96836de0-154b-445e-9f73-4f92497edc42 req-5929180c-3ee3-4def-b17f-82cad05c22f8 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.1494839 Dec 09 21:42:47.353969 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-faa8bc05-3e5b-4cde-be3d-8409e3a7d912 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:47.355070 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faa8bc05-3e5b-4cde-be3d-8409e3a7d912 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=835c8869-c3a9-4fda-8618-cdd79b5eb526,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:47.362286 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-faa8bc05-3e5b-4cde-be3d-8409e3a7d912 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:47.382115 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3e4eb8f-55d3-4639-a295-869c5615d49b None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:42:47.420942 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-faa8bc05-3e5b-4cde-be3d-8409e3a7d912 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:47.422674 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-faa8bc05-3e5b-4cde-be3d-8409e3a7d912 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:47.424602 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96836de0-154b-445e-9f73-4f92497edc42 req-3c75af8d-1edb-4993-8d28-8ce4060b21d4 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0854201 Dec 09 21:42:47.435188 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c1bc0f9d-8770-4a2a-867c-c69c192b6fb2 req-b6823579-c0be-4f9d-a8d7-1600dc7f25e3 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:47.467015 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['be95aa8d-fc0e-4d77-a861-33c1637e4f3e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:42:47.477237 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6823579-c0be-4f9d-a8d7-1600dc7f25e3 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Pushing event deleted for resources: {'Port': ['ID=10ac5a10-4f73-4f89-b652-3c81390af0aa,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:47.499638 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-faa8bc05-3e5b-4cde-be3d-8409e3a7d912 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.9183409 Dec 09 21:42:47.502284 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36852) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:47.507365 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-bdb0ed3d-3adc-4c98-8545-ce754a75e715 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:47.543645 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-577ab08f-2729-4201-8bf6-8b309df90e8f None None] DHCP port deletion for 71038cd4-0600-4b06-91f9-ae7f4f4807f9 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:42:47.588588 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-c1bc0f9d-8770-4a2a-867c-c69c192b6fb2 req-b6823579-c0be-4f9d-a8d7-1600dc7f25e3 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] No DVR routers for this DVR port 10ac5a10-4f73-4f89-b652-3c81390af0aa on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:42:47.596617 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c1bc0f9d-8770-4a2a-867c-c69c192b6fb2 req-b6823579-c0be-4f9d-a8d7-1600dc7f25e3 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:47.600396 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c1bc0f9d-8770-4a2a-867c-c69c192b6fb2 req-b6823579-c0be-4f9d-a8d7-1600dc7f25e3 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.10 "DELETE /v2.0/ports/10ac5a10-4f73-4f89-b652-3c81390af0aa HTTP/1.1" status: 204 len: 173 time: 1.1804004 Dec 09 21:42:47.606029 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b2888c0f-bfde-4e70-90c2-123c413557f5', 'name': 'network-vif-deleted', 'tag': '10ac5a10-4f73-4f89-b652-3c81390af0aa'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:42:47.608776 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b43de2a4-c51d-404e-b563-a8268752674b" -d '{"events": [{"server_uuid": "b2888c0f-bfde-4e70-90c2-123c413557f5", "name": "network-vif-deleted", "tag": "10ac5a10-4f73-4f89-b652-3c81390af0aa"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:42:47.683082 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6fd3fdd9-80fa-4679-9ef7-fad7e9bef824 req-d019564b-cad1-4281-8376-a11f4f547ffa tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=b2888c0f-bfde-4e70-90c2-123c413557f5 HTTP/1.1" status: 200 len: 210 time: 0.0605967 Dec 09 21:42:47.709150 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5faf2bd8-bba9-4617-9183-ea6dc5c485a5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'fixed_ips': [{'subnet_id': '835c8869-c3a9-4fda-8618-cdd79b5eb526'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:42:47.710181 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5faf2bd8-bba9-4617-9183-ea6dc5c485a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:47.780830 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:42:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b7645276-8675-42e3-bcc0-e139be01995a x-openstack-request-id: req-b7645276-8675-42e3-bcc0-e139be01995a {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:42:47.781507 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b2888c0f-bfde-4e70-90c2-123c413557f5", "name": "network-vif-deleted", "tag": "10ac5a10-4f73-4f89-b652-3c81390af0aa", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:42:47.782088 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-b7645276-8675-42e3-bcc0-e139be01995a {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:42:47.782465 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b2888c0f-bfde-4e70-90c2-123c413557f5', 'name': 'network-vif-deleted', 'tag': '10ac5a10-4f73-4f89-b652-3c81390af0aa', 'status': 'completed', 'code': 200} Dec 09 21:42:47.803009 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bdb0ed3d-3adc-4c98-8545-ce754a75e715 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:47.810792 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bdb0ed3d-3adc-4c98-8545-ce754a75e715 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:47.973136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-5faf2bd8-bba9-4617-9183-ea6dc5c485a5 None None] Allocated IP 2001:db8::f816:3eff:fe4d:d0cf (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/835c8869-c3a9-4fda-8618-cdd79b5eb526/98530057-2363-4d3f-bdf8-f937c9594023) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:48.205173 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bdb0ed3d-3adc-4c98-8545-ce754a75e715 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:48.297091 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5faf2bd8-bba9-4617-9183-ea6dc5c485a5 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:48.302351 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdb0ed3d-3adc-4c98-8545-ce754a75e715 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=681075f3-1962-4351-9180-2f7e011e19c9,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:48.309645 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5faf2bd8-bba9-4617-9183-ea6dc5c485a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:48.311291 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bdb0ed3d-3adc-4c98-8545-ce754a75e715 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:48.313231 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-bdb0ed3d-3adc-4c98-8545-ce754a75e715 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:48.316276 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bdb0ed3d-3adc-4c98-8545-ce754a75e715 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:48.317205 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bdb0ed3d-3adc-4c98-8545-ce754a75e715 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:48.361413 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bdb0ed3d-3adc-4c98-8545-ce754a75e715 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.8553293 Dec 09 21:42:48.362065 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5faf2bd8-bba9-4617-9183-ea6dc5c485a5 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:48.362161 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36858) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:48.366007 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-5faf2bd8-bba9-4617-9183-ea6dc5c485a5 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:48.369525 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5faf2bd8-bba9-4617-9183-ea6dc5c485a5 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:42:48.369796 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-00f3e6cc-d73b-44f2-b900-09d10bffb07f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'mac_address': 'fa:16:3e:a9:ef:56', 'name': 'tempest-NetworksTestDHCPv6-181394437'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:48.389082 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5faf2bd8-bba9-4617-9183-ea6dc5c485a5 None None] Pushing event updated for resources: {'Port': ['ID=98530057-2363-4d3f-bdf8-f937c9594023,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:48.442005 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-5faf2bd8-bba9-4617-9183-ea6dc5c485a5 None None] Attempting to bind port 98530057-2363-4d3f-bdf8-f937c9594023 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:42:48.442388 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-5faf2bd8-bba9-4617-9183-ea6dc5c485a5 None None] Attempting to bind port 98530057-2363-4d3f-bdf8-f937c9594023 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:42:48.442751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5faf2bd8-bba9-4617-9183-ea6dc5c485a5 None None] Attempting to bind port 98530057-2363-4d3f-bdf8-f937c9594023 on network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:42:48.450016 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5faf2bd8-bba9-4617-9183-ea6dc5c485a5 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 42, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:42:48.450394 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5faf2bd8-bba9-4617-9183-ea6dc5c485a5 None None] Checking segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:42:48.450810 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5faf2bd8-bba9-4617-9183-ea6dc5c485a5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:48.451209 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5faf2bd8-bba9-4617-9183-ea6dc5c485a5 None None] Bound using segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:42:48.451745 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-5faf2bd8-bba9-4617-9183-ea6dc5c485a5 None None] Bound port: 98530057-2363-4d3f-bdf8-f937c9594023, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:42:48.452133 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5faf2bd8-bba9-4617-9183-ea6dc5c485a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:48.551371 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-5faf2bd8-bba9-4617-9183-ea6dc5c485a5 None None] For port 98530057-2363-4d3f-bdf8-f937c9594023, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:42:48.555721 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-5faf2bd8-bba9-4617-9183-ea6dc5c485a5 None None] For port 98530057-2363-4d3f-bdf8-f937c9594023, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=98530057-2363-4d3f-bdf8-f937c9594023,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:42:48.562450 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5faf2bd8-bba9-4617-9183-ea6dc5c485a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:48.584272 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-00f3e6cc-d73b-44f2-b900-09d10bffb07f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:48.639493 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5faf2bd8-bba9-4617-9183-ea6dc5c485a5 None None] Pushing event updated for resources: {'Port': ['ID=98530057-2363-4d3f-bdf8-f937c9594023,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:48.713554 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3124ca8-47cb-4129-b315-682f40258a49 req-30114917-d68c-4f92-959e-4433c95e5836 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:48.715278 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3124ca8-47cb-4129-b315-682f40258a49 req-30114917-d68c-4f92-959e-4433c95e5836 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.1698439 Dec 09 21:42:48.762803 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-00f3e6cc-d73b-44f2-b900-09d10bffb07f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:48.801573 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3124ca8-47cb-4129-b315-682f40258a49 req-5cdfaf5a-8a78-4d53-9b45-6a7d01826323 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0755475 Dec 09 21:42:48.802717 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-00f3e6cc-d73b-44f2-b900-09d10bffb07f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] device_id is not set on port c0c846eb-bad6-49a3-bd52-3510ab2cd39f yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:42:49.046616 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-00f3e6cc-d73b-44f2-b900-09d10bffb07f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 172.20.0.7 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/681075f3-1962-4351-9180-2f7e011e19c9/c0c846eb-bad6-49a3-bd52-3510ab2cd39f) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:49.055042 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-00f3e6cc-d73b-44f2-b900-09d10bffb07f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8::f816:3eff:fea9:ef56 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/835c8869-c3a9-4fda-8618-cdd79b5eb526/c0c846eb-bad6-49a3-bd52-3510ab2cd39f) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:49.223294 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-589c8501-b25f-4943-8533-0d1f3a849586 req-074b10bb-07c4-4cb0-ae11-600d04382e35 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:49.224810 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-589c8501-b25f-4943-8533-0d1f3a849586 req-074b10bb-07c4-4cb0-ae11-600d04382e35 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1023829 Dec 09 21:42:49.258938 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-00f3e6cc-d73b-44f2-b900-09d10bffb07f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:49.304186 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-589c8501-b25f-4943-8533-0d1f3a849586 req-e54336b1-ceaf-4c78-a7ad-6d04bf5d8197 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0718553 Dec 09 21:42:49.317362 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 10ac5a10-4f73-4f89-b652-3c81390af0aa no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:42:49.333083 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-00f3e6cc-d73b-44f2-b900-09d10bffb07f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:49.341585 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 10ac5a10-4f73-4f89-b652-3c81390af0aa {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:42:49.342210 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 10ac5a10-4f73-4f89-b652-3c81390af0aa not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:42:49.380105 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00f3e6cc-d73b-44f2-b900-09d10bffb07f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:49.383294 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-00f3e6cc-d73b-44f2-b900-09d10bffb07f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:49.390070 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00f3e6cc-d73b-44f2-b900-09d10bffb07f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:42:49.397643 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00f3e6cc-d73b-44f2-b900-09d10bffb07f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=c0c846eb-bad6-49a3-bd52-3510ab2cd39f,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:49.462490 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00f3e6cc-d73b-44f2-b900-09d10bffb07f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:49.463354 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-00f3e6cc-d73b-44f2-b900-09d10bffb07f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:49.488424 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-00f3e6cc-d73b-44f2-b900-09d10bffb07f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1026 time: 1.1256733 Dec 09 21:42:49.491135 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36876) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:49.582444 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1a9db39-6a1a-4792-a238-6b2e392aba49 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:49.596848 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1a9db39-6a1a-4792-a238-6b2e392aba49 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:49.598857 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c1a9db39-6a1a-4792-a238-6b2e392aba49 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1781 time: 0.1066115 Dec 09 21:42:49.601904 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36880) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:49.726454 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-5f72ecb0-567f-4fbc-92c4-24e5ac192ce7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting port c0c846eb-bad6-49a3-bd52-3510ab2cd39f {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:42:49.727063 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5f72ecb0-567f-4fbc-92c4-24e5ac192ce7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:49.842786 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5f72ecb0-567f-4fbc-92c4-24e5ac192ce7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:49.872228 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-5f72ecb0-567f-4fbc-92c4-24e5ac192ce7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Calling delete_port for c0c846eb-bad6-49a3-bd52-3510ab2cd39f owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:42:49.913104 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-75a6e50f-17d7-4e16-85bd-c9e72be9824b None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:42:49.964072 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7836042-cf7b-4233-a185-fa9633230060 req-2a924fef-eb7c-427b-babb-bee58befa231 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:49.965362 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c7836042-cf7b-4233-a185-fa9633230060 req-2a924fef-eb7c-427b-babb-bee58befa231 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.0777452 Dec 09 21:42:50.034727 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c7836042-cf7b-4233-a185-fa9633230060 req-ff4f5427-75e8-4b34-a655-b8ce560359f7 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0631382 Dec 09 21:42:50.068198 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-0ec42244-18f5-447c-8a2b-a5f7e95dfe0c None None] Provisioning complete for port 98530057-2363-4d3f-bdf8-f937c9594023 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:50.068850 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0ec42244-18f5-447c-8a2b-a5f7e95dfe0c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:50.127590 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5f72ecb0-567f-4fbc-92c4-24e5ac192ce7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:50.172727 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f72ecb0-567f-4fbc-92c4-24e5ac192ce7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Port': ['ID=c0c846eb-bad6-49a3-bd52-3510ab2cd39f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:50.284687 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5f72ecb0-567f-4fbc-92c4-24e5ac192ce7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:50.288776 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5f72ecb0-567f-4fbc-92c4-24e5ac192ce7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/c0c846eb-bad6-49a3-bd52-3510ab2cd39f HTTP/1.1" status: 204 len: 168 time: 0.6855593 Dec 09 21:42:50.291158 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36884) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:50.301508 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0ec42244-18f5-447c-8a2b-a5f7e95dfe0c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:50.352388 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4b82f89-ce23-4369-8bd5-27f4e7701e7c None None] Update dhcp port {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'fixed_ips': [{'subnet_id': '835c8869-c3a9-4fda-8618-cdd79b5eb526', 'ip_address': '2001:db8::f816:3eff:fe4d:d0cf'}, {'subnet_id': '681075f3-1962-4351-9180-2f7e011e19c9'}], 'binding:host_id': 'n-d-713301-27'}, 'id': '98530057-2363-4d3f-bdf8-f937c9594023'} from n-d-713301-27. {{(pid=103439) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 09 21:42:50.356443 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-880869d3-a841-47af-88f1-f7954b59f0e5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:50.357967 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-880869d3-a841-47af-88f1-f7954b59f0e5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:50.359589 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-880869d3-a841-47af-88f1-f7954b59f0e5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:50.361274 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-880869d3-a841-47af-88f1-f7954b59f0e5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2071 time: 0.0681260 Dec 09 21:42:50.364124 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36888) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:50.412616 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f4b82f89-ce23-4369-8bd5-27f4e7701e7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:50.443261 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0ec42244-18f5-447c-8a2b-a5f7e95dfe0c None None] For port 98530057-2363-4d3f-bdf8-f937c9594023, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=98530057-2363-4d3f-bdf8-f937c9594023,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:50.472343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-56596ce5-d6c5-412d-bcf3-9e45b992e9ae tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet 681075f3-1962-4351-9180-2f7e011e19c9 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:42:50.476844 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-56596ce5-d6c5-412d-bcf3-9e45b992e9ae tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:50.494575 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 98530057-2363-4d3f-bdf8-f937c9594023 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:42:50.502266 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0ec42244-18f5-447c-8a2b-a5f7e95dfe0c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:50.552408 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-56596ce5-d6c5-412d-bcf3-9e45b992e9ae tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:50.626719 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4042150-3a8a-4309-948c-7c3986487810 req-e0556ccd-a540-4f8d-b61b-280020aa98a1 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:50.634861 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4042150-3a8a-4309-948c-7c3986487810 req-e0556ccd-a540-4f8d-b61b-280020aa98a1 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1588295 Dec 09 21:42:50.683063 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-56596ce5-d6c5-412d-bcf3-9e45b992e9ae tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:50.730793 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4042150-3a8a-4309-948c-7c3986487810 req-64196863-9a5e-42de-928c-edada1ef1390 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0940504 Dec 09 21:42:50.765555 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-56596ce5-d6c5-412d-bcf3-9e45b992e9ae tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:50.805996 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56596ce5-d6c5-412d-bcf3-9e45b992e9ae tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=681075f3-1962-4351-9180-2f7e011e19c9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:50.830479 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-56596ce5-d6c5-412d-bcf3-9e45b992e9ae tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:50.834204 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-56596ce5-d6c5-412d-bcf3-9e45b992e9ae tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/681075f3-1962-4351-9180-2f7e011e19c9 HTTP/1.1" status: 204 len: 168 time: 0.4687786 Dec 09 21:42:50.836995 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36894) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:50.893951 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-297d8276-ef10-41c3-a2ad-4c1adc7fcedb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet 835c8869-c3a9-4fda-8618-cdd79b5eb526 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:42:50.898374 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-297d8276-ef10-41c3-a2ad-4c1adc7fcedb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server [None req-f4b82f89-ce23-4369-8bd5-27f4e7701e7c None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 681075f3-1962-4351-9180-2f7e011e19c9: This subnet is being modified by another concurrent operation. Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 343, in update_dhcp_port Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'update_port') Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 118, in _port_action Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return plugin.update_port(context, port['id'], port) Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1744, in update_port Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server updated_port = super(Ml2Plugin, self).update_port(context, id, Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1515, in update_port Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.ipam.update_port( Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 737, in update_port Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server changes = self.update_port_with_ips(context, Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 427, in update_port_with_ips Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server changes = self._update_ips_for_port(context, Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 351, in _update_ips_for_port Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnet.lock_register( Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise exception Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 681075f3-1962-4351-9180-2f7e011e19c9: This subnet is being modified by another concurrent operation. Dec 09 21:42:50.923480 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Dec 09 21:42:50.943070 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ec42244-18f5-447c-8a2b-a5f7e95dfe0c None None] Pushing event updated for resources: {'Port': ['ID=98530057-2363-4d3f-bdf8-f937c9594023,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:50.962844 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-297d8276-ef10-41c3-a2ad-4c1adc7fcedb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:50.965903 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 98530057-2363-4d3f-bdf8-f937c9594023 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:50.966281 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:51.038873 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-11c1cd87-18e9-4fed-bae4-208a3ea54dc4 None None] Provisioning complete for port 98530057-2363-4d3f-bdf8-f937c9594023 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:51.039262 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-11c1cd87-18e9-4fed-bae4-208a3ea54dc4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:51.058426 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-297d8276-ef10-41c3-a2ad-4c1adc7fcedb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:51.132219 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-297d8276-ef10-41c3-a2ad-4c1adc7fcedb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:51.165110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-297d8276-ef10-41c3-a2ad-4c1adc7fcedb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=835c8869-c3a9-4fda-8618-cdd79b5eb526,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:51.177104 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-297d8276-ef10-41c3-a2ad-4c1adc7fcedb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:51.180920 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-297d8276-ef10-41c3-a2ad-4c1adc7fcedb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/835c8869-c3a9-4fda-8618-cdd79b5eb526 HTTP/1.1" status: 204 len: 168 time: 0.3428006 Dec 09 21:42:51.183706 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36898) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:51.225595 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd4fea7d-dacb-45b1-8cd0-1937fdca448f req-9abe354f-c159-4233-8392-91ed192c1a62 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:51.227412 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd4fea7d-dacb-45b1-8cd0-1937fdca448f req-9abe354f-c159-4233-8392-91ed192c1a62 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.0647657 Dec 09 21:42:51.268822 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-11c1cd87-18e9-4fed-bae4-208a3ea54dc4 None None] Could not find standard attr ID for object c0c846eb-bad6-49a3-bd52-3510ab2cd39f. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:42:51.283662 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a5af6f7c-d988-4a4b-9593-c368d3ef6985 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:42:51.297865 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-57aeb1fa-c427-4b60-81d5-c3a29fb3283d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1129727 Dec 09 21:42:51.301114 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36900) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:51.312832 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-2ce9108a-78ed-4993-bbd2-bb3cae157aaa tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:51.337943 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd4fea7d-dacb-45b1-8cd0-1937fdca448f req-82504b49-3c2e-497d-89e6-7668ec90969f tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1005783 Dec 09 21:42:51.407554 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b536284b-97b5-4a34-9cd8-b88776471fdf None None] Could not find standard attr ID for object c0c846eb-bad6-49a3-bd52-3510ab2cd39f. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:42:51.447257 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2ce9108a-78ed-4993-bbd2-bb3cae157aaa tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:51.453329 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2ce9108a-78ed-4993-bbd2-bb3cae157aaa tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:51.492364 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53c62961-56f9-4dda-b231-9b5d4cfbff33 None None] DHCP port deletion for 77d1c069-bca4-4157-a30b-fb10cbd9d9ee request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:42:51.562067 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-53c62961-56f9-4dda-b231-9b5d4cfbff33 None None] Deleting port 98530057-2363-4d3f-bdf8-f937c9594023 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:42:51.562429 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-53c62961-56f9-4dda-b231-9b5d4cfbff33 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:51.659925 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-53c62961-56f9-4dda-b231-9b5d4cfbff33 None None] For port 98530057-2363-4d3f-bdf8-f937c9594023, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=98530057-2363-4d3f-bdf8-f937c9594023,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:51.660639 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-53c62961-56f9-4dda-b231-9b5d4cfbff33 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:51.688702 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2ce9108a-78ed-4993-bbd2-bb3cae157aaa tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:51.691309 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-53c62961-56f9-4dda-b231-9b5d4cfbff33 None None] Calling delete_port for 98530057-2363-4d3f-bdf8-f937c9594023 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:42:51.789703 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ce9108a-78ed-4993-bbd2-bb3cae157aaa tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=7d49836b-aa7e-47b1-8cf8-83bdbee7d7ee,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:51.810012 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ce9108a-78ed-4993-bbd2-bb3cae157aaa tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:51.810012 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-2ce9108a-78ed-4993-bbd2-bb3cae157aaa tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:51.817218 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ce9108a-78ed-4993-bbd2-bb3cae157aaa tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:51.817811 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2ce9108a-78ed-4993-bbd2-bb3cae157aaa tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:51.844785 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2ce9108a-78ed-4993-bbd2-bb3cae157aaa tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.5423563 Dec 09 21:42:51.847897 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36914) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:51.855531 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-5b53d761-57d9-47d9-91e4-325b01893248 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:51.859682 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-53c62961-56f9-4dda-b231-9b5d4cfbff33 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:51.919429 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53c62961-56f9-4dda-b231-9b5d4cfbff33 None None] Pushing event deleted for resources: {'Port': ['ID=98530057-2363-4d3f-bdf8-f937c9594023,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:51.926137 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53c62961-56f9-4dda-b231-9b5d4cfbff33 None None] No DVR routers for this DVR port 98530057-2363-4d3f-bdf8-f937c9594023 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:42:51.944957 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af1d3918-740b-41f8-bc8a-663c8d50b91d None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:42:51.957085 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f24676f-45a4-403a-b0f9-449b908ff939 req-604eaf20-921f-4dc2-ac3a-1f4928892d3b tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:51.965486 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0f24676f-45a4-403a-b0f9-449b908ff939 req-604eaf20-921f-4dc2-ac3a-1f4928892d3b tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1194258 Dec 09 21:42:52.037582 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5b53d761-57d9-47d9-91e4-325b01893248 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:52.043795 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b53d761-57d9-47d9-91e4-325b01893248 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:52.054549 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0f24676f-45a4-403a-b0f9-449b908ff939 req-f44a8b83-23c0-45ef-b19e-ca1c53e61eb5 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0847497 Dec 09 21:42:52.132568 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dcc9d72c-07ca-427f-93c4-2e746614952b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'fixed_ips': [{'subnet_id': '7d49836b-aa7e-47b1-8cf8-83bdbee7d7ee'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:42:52.134019 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dcc9d72c-07ca-427f-93c4-2e746614952b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:52.402539 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 98530057-2363-4d3f-bdf8-f937c9594023 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:42:52.427711 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 98530057-2363-4d3f-bdf8-f937c9594023 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:42:52.428365 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 98530057-2363-4d3f-bdf8-f937c9594023 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:42:52.466220 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-dcc9d72c-07ca-427f-93c4-2e746614952b None None] Allocated IP 172.20.0.2 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/7d49836b-aa7e-47b1-8cf8-83bdbee7d7ee/c74db2be-1cc2-4035-9036-4976d880fa60) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:52.636435 n-d-713301-27 neutron-server[103437]: DEBUG neutron.objects.ports [None req-5b53d761-57d9-47d9-91e4-325b01893248 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103437) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 09 21:42:52.645743 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b53d761-57d9-47d9-91e4-325b01893248 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:52.670076 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dcc9d72c-07ca-427f-93c4-2e746614952b None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:52.679278 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dcc9d72c-07ca-427f-93c4-2e746614952b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:52.698993 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7069696-51a1-4dd4-a5d3-726097655ea4 req-93fac69b-2bbe-4b75-b95e-ffc7e7a1d4f1 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:52.706974 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d7069696-51a1-4dd4-a5d3-726097655ea4 req-93fac69b-2bbe-4b75-b95e-ffc7e7a1d4f1 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.1934969 Dec 09 21:42:52.712777 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b53d761-57d9-47d9-91e4-325b01893248 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:52.720726 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-5b53d761-57d9-47d9-91e4-325b01893248 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:52.727104 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b53d761-57d9-47d9-91e4-325b01893248 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:52.728878 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b53d761-57d9-47d9-91e4-325b01893248 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:52.742162 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b53d761-57d9-47d9-91e4-325b01893248 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=7650c46a-3650-47a3-9a84-03c121606262,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:52.761084 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5b53d761-57d9-47d9-91e4-325b01893248 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 0.9114604 Dec 09 21:42:52.762992 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36926) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:52.776087 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-c496cce9-b664-42aa-82d1-dcc94b714c8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'mac_address': 'fa:16:3e:e3:ee:29', 'name': 'tempest-NetworksTestDHCPv6-1732692160'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:52.797648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dcc9d72c-07ca-427f-93c4-2e746614952b None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:52.810505 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-dcc9d72c-07ca-427f-93c4-2e746614952b None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:52.818690 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dcc9d72c-07ca-427f-93c4-2e746614952b None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:42:52.844677 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d7069696-51a1-4dd4-a5d3-726097655ea4 req-4b005b2f-0794-4339-980b-fd75848e7f54 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1323166 Dec 09 21:42:52.901554 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcc9d72c-07ca-427f-93c4-2e746614952b None None] Pushing event updated for resources: {'Port': ['ID=c74db2be-1cc2-4035-9036-4976d880fa60,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:52.929434 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-dcc9d72c-07ca-427f-93c4-2e746614952b None None] Attempting to bind port c74db2be-1cc2-4035-9036-4976d880fa60 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:42:52.931341 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-dcc9d72c-07ca-427f-93c4-2e746614952b None None] Attempting to bind port c74db2be-1cc2-4035-9036-4976d880fa60 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:42:52.932228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dcc9d72c-07ca-427f-93c4-2e746614952b None None] Attempting to bind port c74db2be-1cc2-4035-9036-4976d880fa60 on network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:42:52.939160 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dcc9d72c-07ca-427f-93c4-2e746614952b None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 42, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:42:52.939988 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dcc9d72c-07ca-427f-93c4-2e746614952b None None] Checking segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:42:52.940707 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dcc9d72c-07ca-427f-93c4-2e746614952b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:52.941602 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dcc9d72c-07ca-427f-93c4-2e746614952b None None] Bound using segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:42:52.942514 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-dcc9d72c-07ca-427f-93c4-2e746614952b None None] Bound port: c74db2be-1cc2-4035-9036-4976d880fa60, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:42:52.943129 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dcc9d72c-07ca-427f-93c4-2e746614952b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:52.997858 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c496cce9-b664-42aa-82d1-dcc94b714c8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:53.026671 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-dcc9d72c-07ca-427f-93c4-2e746614952b None None] For port c74db2be-1cc2-4035-9036-4976d880fa60, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:42:53.031298 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-dcc9d72c-07ca-427f-93c4-2e746614952b None None] For port c74db2be-1cc2-4035-9036-4976d880fa60, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c74db2be-1cc2-4035-9036-4976d880fa60,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:42:53.040090 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dcc9d72c-07ca-427f-93c4-2e746614952b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:53.101057 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c496cce9-b664-42aa-82d1-dcc94b714c8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:53.133218 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcc9d72c-07ca-427f-93c4-2e746614952b None None] Pushing event updated for resources: {'Port': ['ID=c74db2be-1cc2-4035-9036-4976d880fa60,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:53.146231 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-c496cce9-b664-42aa-82d1-dcc94b714c8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] device_id is not set on port 9745fac0-f778-44f1-8420-22a3be4d2478 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:42:53.236276 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e76dcaa-3c00-48d7-b549-84f15ad41232 req-53526fda-db70-4c8f-b87c-d2e039757b86 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:53.248174 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e76dcaa-3c00-48d7-b549-84f15ad41232 req-53526fda-db70-4c8f-b87c-d2e039757b86 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.0775034 Dec 09 21:42:53.311974 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e76dcaa-3c00-48d7-b549-84f15ad41232 req-fb08fd38-b106-4db0-847c-7a41f788cecb tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0599997 Dec 09 21:42:53.393770 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-c496cce9-b664-42aa-82d1-dcc94b714c8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 172.20.0.9 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/7d49836b-aa7e-47b1-8cf8-83bdbee7d7ee/9745fac0-f778-44f1-8420-22a3be4d2478) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:53.406345 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-c496cce9-b664-42aa-82d1-dcc94b714c8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8::f816:3eff:fee3:ee29 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/7650c46a-3650-47a3-9a84-03c121606262/9745fac0-f778-44f1-8420-22a3be4d2478) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:53.614886 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c496cce9-b664-42aa-82d1-dcc94b714c8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:53.669839 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c496cce9-b664-42aa-82d1-dcc94b714c8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:53.717566 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c496cce9-b664-42aa-82d1-dcc94b714c8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:53.723107 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-c496cce9-b664-42aa-82d1-dcc94b714c8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:53.728133 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c496cce9-b664-42aa-82d1-dcc94b714c8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:42:53.732571 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c496cce9-b664-42aa-82d1-dcc94b714c8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=9745fac0-f778-44f1-8420-22a3be4d2478,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:53.788821 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c496cce9-b664-42aa-82d1-dcc94b714c8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:53.789507 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c496cce9-b664-42aa-82d1-dcc94b714c8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:53.814535 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c496cce9-b664-42aa-82d1-dcc94b714c8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1027 time: 1.0501304 Dec 09 21:42:53.816862 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36934) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:53.869414 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-169b8950-07aa-4110-beea-b44659858de1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:53.876024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-169b8950-07aa-4110-beea-b44659858de1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:53.878314 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-169b8950-07aa-4110-beea-b44659858de1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1763 time: 0.0601187 Dec 09 21:42:53.881038 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36938) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:54.004816 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9acfbdb-3dfd-42a2-bd4c-154d6987f97a req-9614c463-5fff-47bd-ad4a-e8abd6f2f300 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:54.009174 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9acfbdb-3dfd-42a2-bd4c-154d6987f97a req-9614c463-5fff-47bd-ad4a-e8abd6f2f300 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.0914087 Dec 09 21:42:54.050281 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-baab475e-854e-42fc-947e-e2a37471d870 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting port 9745fac0-f778-44f1-8420-22a3be4d2478 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:42:54.050715 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-baab475e-854e-42fc-947e-e2a37471d870 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:54.089151 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9acfbdb-3dfd-42a2-bd4c-154d6987f97a req-f4bf1b8e-a639-42d0-a36c-d0e3181f4a47 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0740898 Dec 09 21:42:54.165463 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-baab475e-854e-42fc-947e-e2a37471d870 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:54.179261 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-baab475e-854e-42fc-947e-e2a37471d870 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Calling delete_port for 9745fac0-f778-44f1-8420-22a3be4d2478 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:42:54.319990 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dbe05b43-5299-4b31-96f7-b5da5945c873 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:42:54.428296 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-baab475e-854e-42fc-947e-e2a37471d870 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:54.470513 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c74db2be-1cc2-4035-9036-4976d880fa60 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:42:54.510231 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-12372b5f-07ea-4740-b190-de74928c78dd None None] Provisioning complete for port c74db2be-1cc2-4035-9036-4976d880fa60 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:54.513101 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-12372b5f-07ea-4740-b190-de74928c78dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:54.547914 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baab475e-854e-42fc-947e-e2a37471d870 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Port': ['ID=9745fac0-f778-44f1-8420-22a3be4d2478,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:54.599371 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port c74db2be-1cc2-4035-9036-4976d880fa60 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:54.599887 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:54.637760 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37439ec8-2a92-4a54-a153-f70d8695cc2e req-64c25cab-8899-4d29-a0bd-a6d16150d4ed tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:54.639530 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-37439ec8-2a92-4a54-a153-f70d8695cc2e req-64c25cab-8899-4d29-a0bd-a6d16150d4ed tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1660817 Dec 09 21:42:54.677941 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-baab475e-854e-42fc-947e-e2a37471d870 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:54.682356 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-baab475e-854e-42fc-947e-e2a37471d870 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/9745fac0-f778-44f1-8420-22a3be4d2478 HTTP/1.1" status: 204 len: 168 time: 0.8002582 Dec 09 21:42:54.693451 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36946) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:54.698284 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8188b740-0dd4-4244-8340-41fa40925646 req-83d44ac2-19d4-4b24-ad74-ed32f9b0812d tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:54.700208 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8188b740-0dd4-4244-8340-41fa40925646 req-83d44ac2-19d4-4b24-ad74-ed32f9b0812d tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.31 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 946 time: 0.1457844 Dec 09 21:42:54.763910 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-491fe181-0cd9-40e4-95e9-98cc243514e9 None None] Update dhcp port {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'fixed_ips': [{'subnet_id': '7d49836b-aa7e-47b1-8cf8-83bdbee7d7ee', 'ip_address': '172.20.0.2'}, {'subnet_id': '7650c46a-3650-47a3-9a84-03c121606262'}], 'binding:host_id': 'n-d-713301-27'}, 'id': 'c74db2be-1cc2-4035-9036-4976d880fa60'} from n-d-713301-27. {{(pid=103439) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 09 21:42:54.766758 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ec65dfd-60e5-4e73-b9fb-f35ace2b69f1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:54.768877 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ec65dfd-60e5-4e73-b9fb-f35ace2b69f1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:54.770898 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0ec65dfd-60e5-4e73-b9fb-f35ace2b69f1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:54.776804 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0ec65dfd-60e5-4e73-b9fb-f35ace2b69f1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2049 time: 0.0819612 Dec 09 21:42:54.777256 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36950) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:54.815119 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-37439ec8-2a92-4a54-a153-f70d8695cc2e req-86caeb38-bce6-40ac-bf29-849cd17ef086 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/security-groups?id=8d4a008f-197d-4501-abd1-093027cfd51b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1547716 Dec 09 21:42:54.871755 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-8188b740-0dd4-4244-8340-41fa40925646 req-b108fb52-90da-4edd-bead-1bbf55f28d5c tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Deleting port be95aa8d-fc0e-4d77-a861-33c1637e4f3e {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:42:54.872104 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8188b740-0dd4-4244-8340-41fa40925646 req-b108fb52-90da-4edd-bead-1bbf55f28d5c tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:54.873903 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-0bed21f4-9259-4b08-86f1-5d8926475c45 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet 7650c46a-3650-47a3-9a84-03c121606262 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:42:54.878827 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0bed21f4-9259-4b08-86f1-5d8926475c45 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:54.885172 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-12372b5f-07ea-4740-b190-de74928c78dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:54.901860 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-491fe181-0cd9-40e4-95e9-98cc243514e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:54.936156 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0bed21f4-9259-4b08-86f1-5d8926475c45 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:54.988890 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0bed21f4-9259-4b08-86f1-5d8926475c45 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:55.043850 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:55.063828 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-8188b740-0dd4-4244-8340-41fa40925646 req-b108fb52-90da-4edd-bead-1bbf55f28d5c tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] For port be95aa8d-fc0e-4d77-a861-33c1637e4f3e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=be95aa8d-fc0e-4d77-a861-33c1637e4f3e,segment=NetworkSegment(387b2307-6c4a-4b56-8fe0-5bcb0370db1c),segment_id=387b2307-6c4a-4b56-8fe0-5bcb0370db1c)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:55.064396 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8188b740-0dd4-4244-8340-41fa40925646 req-b108fb52-90da-4edd-bead-1bbf55f28d5c tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:55.069811 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0bed21f4-9259-4b08-86f1-5d8926475c45 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:55.079381 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-8188b740-0dd4-4244-8340-41fa40925646 req-b108fb52-90da-4edd-bead-1bbf55f28d5c tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Calling delete_port for be95aa8d-fc0e-4d77-a861-33c1637e4f3e owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:42:55.086814 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-12372b5f-07ea-4740-b190-de74928c78dd None None] For port c74db2be-1cc2-4035-9036-4976d880fa60, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c74db2be-1cc2-4035-9036-4976d880fa60,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:55.100634 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-12372b5f-07ea-4740-b190-de74928c78dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:55.161896 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bed21f4-9259-4b08-86f1-5d8926475c45 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=7650c46a-3650-47a3-9a84-03c121606262,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:55.178388 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0bed21f4-9259-4b08-86f1-5d8926475c45 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:55.190771 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0bed21f4-9259-4b08-86f1-5d8926475c45 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/7650c46a-3650-47a3-9a84-03c121606262 HTTP/1.1" status: 204 len: 168 time: 0.4112034 Dec 09 21:42:55.194300 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36956) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:55.260306 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12372b5f-07ea-4740-b190-de74928c78dd None None] Pushing event updated for resources: {'Port': ['ID=c74db2be-1cc2-4035-9036-4976d880fa60,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:55.263524 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:42:55.264091 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server [None req-491fe181-0cd9-40e4-95e9-98cc243514e9 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 7650c46a-3650-47a3-9a84-03c121606262: This subnet is being modified by another concurrent operation. Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 343, in update_dhcp_port Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'update_port') Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 118, in _port_action Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return plugin.update_port(context, port['id'], port) Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1744, in update_port Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server updated_port = super(Ml2Plugin, self).update_port(context, id, Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1515, in update_port Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.ipam.update_port( Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 737, in update_port Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server changes = self.update_port_with_ips(context, Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 427, in update_port_with_ips Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server changes = self._update_ips_for_port(context, Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 351, in _update_ips_for_port Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnet.lock_register( Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise exception Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 7650c46a-3650-47a3-9a84-03c121606262: This subnet is being modified by another concurrent operation. Dec 09 21:42:55.286374 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Dec 09 21:42:55.295849 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-38f4e2a9-82b0-468e-827f-af397fb3e96a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet 7d49836b-aa7e-47b1-8cf8-83bdbee7d7ee {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:42:55.300440 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-38f4e2a9-82b0-468e-827f-af397fb3e96a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:55.357256 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-38f4e2a9-82b0-468e-827f-af397fb3e96a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:55.390087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7161c42d-ee1f-4d79-8f60-7d5ca7031157 req-00686ba6-46b1-4dfe-9ceb-5838a4e79794 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:55.391764 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7161c42d-ee1f-4d79-8f60-7d5ca7031157 req-00686ba6-46b1-4dfe-9ceb-5838a4e79794 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.1155100 Dec 09 21:42:55.425170 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e13990a5-074f-479d-8689-01be69d4fc5b None None] Provisioning complete for port c74db2be-1cc2-4035-9036-4976d880fa60 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:55.425730 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e13990a5-074f-479d-8689-01be69d4fc5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:55.429694 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8188b740-0dd4-4244-8340-41fa40925646 req-b108fb52-90da-4edd-bead-1bbf55f28d5c tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:55.484590 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b108fb52-90da-4edd-bead-1bbf55f28d5c tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Pushing event deleted for resources: {'Port': ['ID=be95aa8d-fc0e-4d77-a861-33c1637e4f3e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:55.494447 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['be95aa8d-fc0e-4d77-a861-33c1637e4f3e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:42:55.541019 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-38f4e2a9-82b0-468e-827f-af397fb3e96a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:55.543298 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-45e20014-8079-4a91-9a89-e0b5da491988 None None] DHCP port deletion for 71038cd4-0600-4b06-91f9-ae7f4f4807f9 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:42:55.553089 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-8188b740-0dd4-4244-8340-41fa40925646 req-b108fb52-90da-4edd-bead-1bbf55f28d5c tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] No DVR routers for this DVR port be95aa8d-fc0e-4d77-a861-33c1637e4f3e on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:42:55.559096 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8188b740-0dd4-4244-8340-41fa40925646 req-b108fb52-90da-4edd-bead-1bbf55f28d5c tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:55.567742 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8188b740-0dd4-4244-8340-41fa40925646 req-b108fb52-90da-4edd-bead-1bbf55f28d5c tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.31 "DELETE /v2.0/ports/be95aa8d-fc0e-4d77-a861-33c1637e4f3e HTTP/1.1" status: 204 len: 173 time: 0.8549616 Dec 09 21:42:55.568247 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f875c61b-474a-40dc-aa86-15edf61f643d', 'name': 'network-vif-deleted', 'tag': 'be95aa8d-fc0e-4d77-a861-33c1637e4f3e'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:42:55.570912 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7c247f17-572d-4c44-9e49-e9df1eac9a35" -d '{"events": [{"server_uuid": "f875c61b-474a-40dc-aa86-15edf61f643d", "name": "network-vif-deleted", "tag": "be95aa8d-fc0e-4d77-a861-33c1637e4f3e"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:42:55.597917 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7161c42d-ee1f-4d79-8f60-7d5ca7031157 req-8b368066-2ad3-4f41-8e8e-ba5f1ee35708 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1850421 Dec 09 21:42:55.644459 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-378bf205-14cd-4b01-be3b-fc37109134cb None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 21:42:55.715004 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:42:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-46d077c5-1985-4548-a68f-47274be80f29 x-openstack-request-id: req-46d077c5-1985-4548-a68f-47274be80f29 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:42:55.715299 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f875c61b-474a-40dc-aa86-15edf61f643d", "name": "network-vif-deleted", "tag": "be95aa8d-fc0e-4d77-a861-33c1637e4f3e", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:42:55.715577 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-46d077c5-1985-4548-a68f-47274be80f29 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:42:55.715993 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f875c61b-474a-40dc-aa86-15edf61f643d', 'name': 'network-vif-deleted', 'tag': 'be95aa8d-fc0e-4d77-a861-33c1637e4f3e', 'status': 'completed', 'code': 200} Dec 09 21:42:55.716849 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-38f4e2a9-82b0-468e-827f-af397fb3e96a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:55.764659 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38f4e2a9-82b0-468e-827f-af397fb3e96a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=7d49836b-aa7e-47b1-8cf8-83bdbee7d7ee,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:55.775039 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-38f4e2a9-82b0-468e-827f-af397fb3e96a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:55.779907 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-38f4e2a9-82b0-468e-827f-af397fb3e96a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/7d49836b-aa7e-47b1-8cf8-83bdbee7d7ee HTTP/1.1" status: 204 len: 168 time: 0.5844035 Dec 09 21:42:55.782353 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36962) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:55.818384 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d834b532-8c8b-436b-b40e-d2214ed22a70 None None] Could not find standard attr ID for object 9745fac0-f778-44f1-8420-22a3be4d2478. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:42:55.832038 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-378bf205-14cd-4b01-be3b-fc37109134cb None None] Resources bound (agent type, host, resource id): {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 09 21:42:55.845115 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0c7291e7-a39f-470c-af8f-82b98505cd1b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0598073 Dec 09 21:42:55.846071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36968) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:55.851237 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2e6aec38-bc1b-4115-b5a3-d4f192bc5db6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:55.986107 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-74875ef9-a4ca-4023-9765-a0eb2f5ab826 req-34bbb648-2069-4ff4-9281-dc469c6afe52 tempest-ServerRescueNegativeTestJSON-1266646057 tempest-ServerRescueNegativeTestJSON-1266646057-project] 10.222.0.13 "GET /v2.0/ports?device_id=f875c61b-474a-40dc-aa86-15edf61f643d HTTP/1.1" status: 200 len: 210 time: 0.0466876 Dec 09 21:42:56.008088 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e6aec38-bc1b-4115-b5a3-d4f192bc5db6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:56.013552 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2e6aec38-bc1b-4115-b5a3-d4f192bc5db6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:56.214227 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e717c0df-6300-4785-acd5-fdd91faef8c3 None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 21:42:56.281035 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2e6aec38-bc1b-4115-b5a3-d4f192bc5db6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:56.284789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-17e8a4fc-9ea1-4256-9c74-380df67d440d None None] Provisioning complete for port c74db2be-1cc2-4035-9036-4976d880fa60 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:56.285165 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-17e8a4fc-9ea1-4256-9c74-380df67d440d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:56.325332 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e717c0df-6300-4785-acd5-fdd91faef8c3 None None] Resources bound (agent type, host, resource id): {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 09 21:42:56.342353 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e6aec38-bc1b-4115-b5a3-d4f192bc5db6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=7ecd0290-8cac-4b5e-8f40-e79e7dbc96da,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:56.351405 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e6aec38-bc1b-4115-b5a3-d4f192bc5db6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:56.353217 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-2e6aec38-bc1b-4115-b5a3-d4f192bc5db6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:56.356793 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e6aec38-bc1b-4115-b5a3-d4f192bc5db6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:56.357401 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2e6aec38-bc1b-4115-b5a3-d4f192bc5db6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:56.383386 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c74db2be-1cc2-4035-9036-4976d880fa60 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:42:56.384706 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2e6aec38-bc1b-4115-b5a3-d4f192bc5db6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.5374634 Dec 09 21:42:56.387654 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36970) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:56.393055 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a24dd980-6718-4bf8-98f5-84314fe29e6c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:56.530331 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a24dd980-6718-4bf8-98f5-84314fe29e6c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:56.536784 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a24dd980-6718-4bf8-98f5-84314fe29e6c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:56.734402 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:56.797164 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port c74db2be-1cc2-4035-9036-4976d880fa60, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c74db2be-1cc2-4035-9036-4976d880fa60,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:56.811391 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:56.864526 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d01936f-aeab-4e3e-a86b-aa5ae6ad4ff7 req-3ea93a42-c24e-42ed-afba-662c78df315f tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:56.867036 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3d01936f-aeab-4e3e-a86b-aa5ae6ad4ff7 req-3ea93a42-c24e-42ed-afba-662c78df315f tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.1336236 Dec 09 21:42:56.910908 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=c74db2be-1cc2-4035-9036-4976d880fa60,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:56.976964 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3d01936f-aeab-4e3e-a86b-aa5ae6ad4ff7 req-45d7aef6-7887-4ae6-aabd-c5bee27727d6 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1020670 Dec 09 21:42:57.002578 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4994f84-2b2c-45bd-8727-42fcda894108 None None] Update dhcp port {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'fixed_ips': [{'subnet_id': '7ecd0290-8cac-4b5e-8f40-e79e7dbc96da'}], 'binding:host_id': 'n-d-713301-27'}, 'id': 'c74db2be-1cc2-4035-9036-4976d880fa60'} from n-d-713301-27. {{(pid=103439) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 09 21:42:57.026405 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b4994f84-2b2c-45bd-8727-42fcda894108 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:57.067874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36984) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:57.114235 n-d-713301-27 neutron-server[103438]: DEBUG neutron.objects.ports [None req-a24dd980-6718-4bf8-98f5-84314fe29e6c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=103438) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 09 21:42:57.248590 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-b4994f84-2b2c-45bd-8727-42fcda894108 None None] Allocated IP 172.20.0.2 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/7ecd0290-8cac-4b5e-8f40-e79e7dbc96da/c74db2be-1cc2-4035-9036-4976d880fa60) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:57.265389 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-b4994f84-2b2c-45bd-8727-42fcda894108 None None] Allocated IP 2001:db8::f816:3eff:fe96:578f (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/79132eaa-0a21-4aa0-a2d9-fcd65fcdbcd9/c74db2be-1cc2-4035-9036-4976d880fa60) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:42:57.455471 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:57.462480 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-720e1f89-044f-4926-a063-23851e344205 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:57.478044 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:57.536214 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-b4994f84-2b2c-45bd-8727-42fcda894108 None None] For port c74db2be-1cc2-4035-9036-4976d880fa60, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c74db2be-1cc2-4035-9036-4976d880fa60,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:57.568555 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b4994f84-2b2c-45bd-8727-42fcda894108 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:57.574275 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b4994f84-2b2c-45bd-8727-42fcda894108 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:57.575501 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.db.api [None req-a24dd980-6718-4bf8-98f5-84314fe29e6c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Retry wrapper got retriable exception: Failed to create a duplicate IpamAllocation: for attribute(s) ['ipamallocations.PRIMARY'] with value(s) 2001:db8::f816:3eff:fe96:578f-7a9277cd-0276-4fc7-80f6-faaa738fdd {{(pid=103438) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:42:57.576464 n-d-713301-27 neutron-server[103438]: DEBUG oslo_db.api [None req-a24dd980-6718-4bf8-98f5-84314fe29e6c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2._create_subnet_postcommit {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:42:57.662638 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4994f84-2b2c-45bd-8727-42fcda894108 None None] Pushing event updated for resources: {'Port': ['ID=c74db2be-1cc2-4035-9036-4976d880fa60,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:57.716463 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-720e1f89-044f-4926-a063-23851e344205 admin admin] Deleting port c147a416-ff0a-4bae-9503-ebf0727fc69d {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:42:57.716912 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-720e1f89-044f-4926-a063-23851e344205 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:57.815729 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-720e1f89-044f-4926-a063-23851e344205 admin admin] For port c147a416-ff0a-4bae-9503-ebf0727fc69d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c147a416-ff0a-4bae-9503-ebf0727fc69d,segment=NetworkSegment(387b2307-6c4a-4b56-8fe0-5bcb0370db1c),segment_id=387b2307-6c4a-4b56-8fe0-5bcb0370db1c)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:57.816099 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-720e1f89-044f-4926-a063-23851e344205 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:57.837050 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-720e1f89-044f-4926-a063-23851e344205 admin admin] Calling delete_port for c147a416-ff0a-4bae-9503-ebf0727fc69d owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:42:58.114189 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-720e1f89-044f-4926-a063-23851e344205 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:58.155631 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-720e1f89-044f-4926-a063-23851e344205 admin admin] Pushing event deleted for resources: {'Port': ['ID=c147a416-ff0a-4bae-9503-ebf0727fc69d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:58.452501 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-720e1f89-044f-4926-a063-23851e344205 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:58.578789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c74db2be-1cc2-4035-9036-4976d880fa60 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:42:58.693466 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port c74db2be-1cc2-4035-9036-4976d880fa60 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:58.694176 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:58.788389 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22dba6af-9ece-471f-84e9-79cb24eda3dd req-090a0bb4-511b-4f26-9f60-35616f78bd8e tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:58.789957 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22dba6af-9ece-471f-84e9-79cb24eda3dd req-090a0bb4-511b-4f26-9f60-35616f78bd8e tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.7098756 Dec 09 21:42:58.892293 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f0ba3f5-d565-4d21-94de-0bea12da5b94 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:42:58.901018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2be667fa-b767-47f4-8723-30b9bf9eb686 None None] DHCP port deletion for 71038cd4-0600-4b06-91f9-ae7f4f4807f9 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:42:59.018965 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22dba6af-9ece-471f-84e9-79cb24eda3dd req-24f80e50-7a1b-4d17-a32e-d8c8c16c890a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2093420 Dec 09 21:42:59.034118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.objects.ports [None req-a24dd980-6718-4bf8-98f5-84314fe29e6c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=103438) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 09 21:42:59.108658 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:59.116429 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d2e367d5-c065-4187-bac3-b7229f8409d3 None None] Provisioning complete for port c74db2be-1cc2-4035-9036-4976d880fa60 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:42:59.117113 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d2e367d5-c065-4187-bac3-b7229f8409d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:59.155914 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.ipam_pluggable_backend [None req-a24dd980-6718-4bf8-98f5-84314fe29e6c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Port c74db2be-1cc2-4035-9036-4976d880fa60 got IPv6 auto-address in a concurrent create or update port request. Ignoring. {{(pid=103438) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:584}} Dec 09 21:42:59.156455 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a24dd980-6718-4bf8-98f5-84314fe29e6c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:59.208790 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a24dd980-6718-4bf8-98f5-84314fe29e6c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:42:59.212524 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-a24dd980-6718-4bf8-98f5-84314fe29e6c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:42:59.217540 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a24dd980-6718-4bf8-98f5-84314fe29e6c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:42:59.218431 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a24dd980-6718-4bf8-98f5-84314fe29e6c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:59.241662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a24dd980-6718-4bf8-98f5-84314fe29e6c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=79132eaa-0a21-4aa0-a2d9-fcd65fcdbcd9,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:59.251232 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-720e1f89-044f-4926-a063-23851e344205 admin admin] Router 9c4c11de-65ec-4b4c-b697-aa53f60d18e2 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:42:59.256400 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port c74db2be-1cc2-4035-9036-4976d880fa60, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c74db2be-1cc2-4035-9036-4976d880fa60,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:42:59.264568 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a24dd980-6718-4bf8-98f5-84314fe29e6c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 2.8751786 Dec 09 21:42:59.266205 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37016) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:59.268672 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:59.273628 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'mac_address': 'fa:16:3e:57:92:cb', 'name': 'tempest-NetworksTestDHCPv6-1469132860'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:42:59.274228 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d2e367d5-c065-4187-bac3-b7229f8409d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:59.417092 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=c74db2be-1cc2-4035-9036-4976d880fa60,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:42:59.438478 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-d2e367d5-c065-4187-bac3-b7229f8409d3 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:42:59.438844 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-d2e367d5-c065-4187-bac3-b7229f8409d3 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:42:59.523565 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device be95aa8d-fc0e-4d77-a861-33c1637e4f3e no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:42:59.543219 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:42:59.556500 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: be95aa8d-fc0e-4d77-a861-33c1637e4f3e {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:42:59.556973 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device be95aa8d-fc0e-4d77-a861-33c1637e4f3e not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:42:59.566138 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-720e1f89-044f-4926-a063-23851e344205 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:42:59.572785 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-720e1f89-044f-4926-a063-23851e344205 admin admin] 10.222.0.13 "PUT /v2.0/routers/9c4c11de-65ec-4b4c-b697-aa53f60d18e2/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5036955 Dec 09 21:42:59.575621 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37024) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:42:59.578625 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd8165ef-573b-4dc8-8377-d72561ab3409 None None] Sync routers for ids ['9c4c11de-65ec-4b4c-b697-aa53f60d18e2'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:42:59.593269 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd8165ef-573b-4dc8-8377-d72561ab3409 None None] Routers {'9c4c11de-65ec-4b4c-b697-aa53f60d18e2'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:42:59.593917 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-fd8165ef-573b-4dc8-8377-d72561ab3409 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:42:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9c4c11de-65ec-4b4c-b697-aa53f60d18e2'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:42:59.696083 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:59.729413 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] device_id is not set on port ce3d0753-3ee3-4e46-bd4f-bebf44a753f3 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:42:59.799833 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4848bc05-a2ef-43f1-bfc4-050a9fdd6857 admin admin] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:42:59.845391 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-fd8165ef-573b-4dc8-8377-d72561ab3409 None None] Set router 9c4c11de-65ec-4b4c-b697-aa53f60d18e2 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:43:00.000987 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4848bc05-a2ef-43f1-bfc4-050a9fdd6857 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:00.096540 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 172.20.0.9 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/7ecd0290-8cac-4b5e-8f40-e79e7dbc96da/ce3d0753-3ee3-4e46-bd4f-bebf44a753f3) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:00.109129 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8::f816:3eff:fe57:92cb (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/79132eaa-0a21-4aa0-a2d9-fcd65fcdbcd9/ce3d0753-3ee3-4e46-bd4f-bebf44a753f3) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:00.121174 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-4848bc05-a2ef-43f1-bfc4-050a9fdd6857 admin admin] Deleting port 4d6d5feb-4ea8-48a8-a767-e7322d78726b {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:43:00.121516 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4848bc05-a2ef-43f1-bfc4-050a9fdd6857 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:00.191724 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-fd8165ef-573b-4dc8-8377-d72561ab3409 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c4c11de-65ec-4b4c-b697-aa53f60d18e2', 'name': 'tempest-ServerRescueNegativeTestJSON-2013763698-router', 'tenant_id': '69d79e96ec1c418aa6c619846f0fe02e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.51'}], 'enable_snat': True}, 'gw_port_id': '4d6d5feb-4ea8-48a8-a767-e7322d78726b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:40:00Z', 'updated_at': '2021-12-09T21:42:58Z', 'revision_number': 5, 'project_id': '69d79e96ec1c418aa6c619846f0fe02e', 'gw_port': {'id': '4d6d5feb-4ea8-48a8-a767-e7322d78726b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:82:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c4c11de-65ec-4b4c-b697-aa53f60d18e2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2459, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.51', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:40:01Z', 'updated_at': '2021-12-09T21:40:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:43:00.230561 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd8165ef-573b-4dc8-8377-d72561ab3409 None None] Checking router: 9c4c11de-65ec-4b4c-b697-aa53f60d18e2 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:43:00.250126 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd8165ef-573b-4dc8-8377-d72561ab3409 None None] Routers {'9c4c11de-65ec-4b4c-b697-aa53f60d18e2'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:43:00.251964 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-fd8165ef-573b-4dc8-8377-d72561ab3409 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:42:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9c4c11de-65ec-4b4c-b697-aa53f60d18e2'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:43:00.286848 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccad0791-4b79-4321-bf14-6f3e3d34191d req-e0cdc995-3042-491c-bf8e-8b508f355535 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:00.288887 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ccad0791-4b79-4321-bf14-6f3e3d34191d req-e0cdc995-3042-491c-bf8e-8b508f355535 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.1432743 Dec 09 21:43:00.318036 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-4848bc05-a2ef-43f1-bfc4-050a9fdd6857 admin admin] For port 4d6d5feb-4ea8-48a8-a767-e7322d78726b, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=4d6d5feb-4ea8-48a8-a767-e7322d78726b,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:00.318399 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4848bc05-a2ef-43f1-bfc4-050a9fdd6857 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:00.348793 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2725cb43-5c79-4450-8f03-07f08c227012 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:00.355353 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-4848bc05-a2ef-43f1-bfc4-050a9fdd6857 admin admin] Calling delete_port for 4d6d5feb-4ea8-48a8-a767-e7322d78726b owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:43:00.424230 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-fd8165ef-573b-4dc8-8377-d72561ab3409 None None] Set router 9c4c11de-65ec-4b4c-b697-aa53f60d18e2 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:43:00.427181 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ccad0791-4b79-4321-bf14-6f3e3d34191d req-21556bff-6de9-4db0-b1c1-8500da15fdc3 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1272430 Dec 09 21:43:00.484377 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c74db2be-1cc2-4035-9036-4976d880fa60 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:43:00.489544 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:00.532310 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-fd8165ef-573b-4dc8-8377-d72561ab3409 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c4c11de-65ec-4b4c-b697-aa53f60d18e2', 'name': 'tempest-ServerRescueNegativeTestJSON-2013763698-router', 'tenant_id': '69d79e96ec1c418aa6c619846f0fe02e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:40:00Z', 'updated_at': '2021-12-09T21:43:00Z', 'revision_number': 6, 'project_id': '69d79e96ec1c418aa6c619846f0fe02e', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:43:00.561764 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:00.595155 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd8165ef-573b-4dc8-8377-d72561ab3409 None None] The sync data for ids ['9c4c11de-65ec-4b4c-b697-aa53f60d18e2'] in n-d-713301-27 is: [{'id': '9c4c11de-65ec-4b4c-b697-aa53f60d18e2', 'name': 'tempest-ServerRescueNegativeTestJSON-2013763698-router', 'tenant_id': '69d79e96ec1c418aa6c619846f0fe02e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:40:00Z', 'updated_at': '2021-12-09T21:43:00Z', 'revision_number': 6, 'project_id': '69d79e96ec1c418aa6c619846f0fe02e', 'gw_port_host': None}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:43:00.618387 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f0e97b86-2471-4cba-a412-27859933cdd8 None None] Provisioning complete for port c74db2be-1cc2-4035-9036-4976d880fa60 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:00.619083 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f0e97b86-2471-4cba-a412-27859933cdd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:00.642834 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=ce3d0753-3ee3-4e46-bd4f-bebf44a753f3,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:00.660011 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port c74db2be-1cc2-4035-9036-4976d880fa60 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:00.660387 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:00.682710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:00.682710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:00.683789 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:00.685199 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:00.687912 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:00.687912 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:00.687912 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:00.687912 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:00.687912 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:00.687912 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:00.687912 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:00.687912 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:00.703374 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:00.713979 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4848bc05-a2ef-43f1-bfc4-050a9fdd6857 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:00.737604 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:00.743201 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:00.748243 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:43:00.771540 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f913312-e0d6-4c84-b511-45a23edc8ba6 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:43:00.804556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4848bc05-a2ef-43f1-bfc4-050a9fdd6857 admin admin] Pushing event deleted for resources: {'Port': ['ID=4d6d5feb-4ea8-48a8-a767-e7322d78726b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:00.863954 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:00.864692 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:00.895701 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6537547f-c3c6-4f2a-9386-fee56bdc1474 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1027 time: 1.6267667 Dec 09 21:43:00.899090 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37040) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:00.929615 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4848bc05-a2ef-43f1-bfc4-050a9fdd6857 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:01.057286 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4848bc05-a2ef-43f1-bfc4-050a9fdd6857 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:01.062294 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4848bc05-a2ef-43f1-bfc4-050a9fdd6857 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:01.144510 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-95b61745-2dff-4606-882c-79ea10f24dd9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:01.151749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-95b61745-2dff-4606-882c-79ea10f24dd9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:01.156578 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-95b61745-2dff-4606-882c-79ea10f24dd9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1863 time: 0.2563832 Dec 09 21:43:01.156716 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37048) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:01.158291 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4848bc05-a2ef-43f1-bfc4-050a9fdd6857 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:01.159656 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4848bc05-a2ef-43f1-bfc4-050a9fdd6857 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 9c4c11de-65ec-4b4c-b697-aa53f60d18e2 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:43:01.164544 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4848bc05-a2ef-43f1-bfc4-050a9fdd6857 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:01.167960 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4848bc05-a2ef-43f1-bfc4-050a9fdd6857 admin admin] 10.222.0.13 "DELETE /v2.0/routers/9c4c11de-65ec-4b4c-b697-aa53f60d18e2 HTTP/1.1" status: 204 len: 168 time: 1.5910764 Dec 09 21:43:01.175181 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37050) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:01.255181 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6b22b909-a512-4562-857f-2ee243e48c2a None None] Provisioning complete for port ce3d0753-3ee3-4e46-bd4f-bebf44a753f3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:01.255574 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6b22b909-a512-4562-857f-2ee243e48c2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:01.325383 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-6b22b909-a512-4562-857f-2ee243e48c2a None None] Port ce3d0753-3ee3-4e46-bd4f-bebf44a753f3 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:43:01.344284 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6b22b909-a512-4562-857f-2ee243e48c2a None None] Provisioning complete for port c74db2be-1cc2-4035-9036-4976d880fa60 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:01.345003 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6b22b909-a512-4562-857f-2ee243e48c2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:01.349874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-b85c1314-f6b4-412c-9b00-2bc70b6a2ba6 admin admin] Deleting subnet 12d97cfc-9264-49cb-8e47-fd225cb6d30b {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:43:01.353256 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b85c1314-f6b4-412c-9b00-2bc70b6a2ba6 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:01.396703 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b85c1314-f6b4-412c-9b00-2bc70b6a2ba6 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:01.499224 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b85c1314-f6b4-412c-9b00-2bc70b6a2ba6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:01.570896 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-a76d158d-6fbc-45f6-aa20-7c61acb3c29b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting port ce3d0753-3ee3-4e46-bd4f-bebf44a753f3 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:43:01.571509 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a76d158d-6fbc-45f6-aa20-7c61acb3c29b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:01.647635 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87fc5d43-fa11-46ef-be3b-741edf7be67b req-5675081a-efd8-4825-898c-63b22d19b168 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:01.650829 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-87fc5d43-fa11-46ef-be3b-741edf7be67b req-5675081a-efd8-4825-898c-63b22d19b168 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.0823052 Dec 09 21:43:01.687640 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b85c1314-f6b4-412c-9b00-2bc70b6a2ba6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:01.725076 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-bc757d45-ffd9-4154-a69a-041399d9208a None None] Provisioning complete for port ce3d0753-3ee3-4e46-bd4f-bebf44a753f3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:01.725644 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bc757d45-ffd9-4154-a69a-041399d9208a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:01.735009 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b85c1314-f6b4-412c-9b00-2bc70b6a2ba6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=12d97cfc-9264-49cb-8e47-fd225cb6d30b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:01.760307 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b85c1314-f6b4-412c-9b00-2bc70b6a2ba6 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:01.764396 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b85c1314-f6b4-412c-9b00-2bc70b6a2ba6 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/12d97cfc-9264-49cb-8e47-fd225cb6d30b HTTP/1.1" status: 204 len: 168 time: 0.5569580 Dec 09 21:43:01.774289 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-87fc5d43-fa11-46ef-be3b-741edf7be67b req-13405a39-9f8a-473c-b221-61256f5221b9 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1146085 Dec 09 21:43:01.774508 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37064) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:01.803847 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5794ed4a-580d-4f80-9cd0-b999d958cfb1 None None] Network 71038cd4-0600-4b06-91f9-ae7f4f4807f9 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:01.815531 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a76d158d-6fbc-45f6-aa20-7c61acb3c29b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:01.848623 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-a76d158d-6fbc-45f6-aa20-7c61acb3c29b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Calling delete_port for ce3d0753-3ee3-4e46-bd4f-bebf44a753f3 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:43:01.865692 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-bc757d45-ffd9-4154-a69a-041399d9208a None None] Port ce3d0753-3ee3-4e46-bd4f-bebf44a753f3 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:43:01.911912 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a2d4f284-c49b-4f1e-8b7b-2110ffe4fce4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:01.947527 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-377d727e-d635-4763-9725-d5301ab6f51c None None] DHCP port deletion for 71038cd4-0600-4b06-91f9-ae7f4f4807f9 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:43:02.032311 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a2d4f284-c49b-4f1e-8b7b-2110ffe4fce4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:02.065730 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-a2d4f284-c49b-4f1e-8b7b-2110ffe4fce4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['71038cd4-0600-4b06-91f9-ae7f4f4807f9']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:43:02.077751 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-a2d4f284-c49b-4f1e-8b7b-2110ffe4fce4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '387b2307-6c4a-4b56-8fe0-5bcb0370db1c') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:43:02.079021 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-a2d4f284-c49b-4f1e-8b7b-2110ffe4fce4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '387b2307-6c4a-4b56-8fe0-5bcb0370db1c') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:43:02.105650 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a2d4f284-c49b-4f1e-8b7b-2110ffe4fce4 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:02.121166 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a76d158d-6fbc-45f6-aa20-7c61acb3c29b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:02.149459 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a2d4f284-c49b-4f1e-8b7b-2110ffe4fce4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:02.175596 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a2d4f284-c49b-4f1e-8b7b-2110ffe4fce4 admin admin] Releasing vlan 123 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:43:02.176238 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a2d4f284-c49b-4f1e-8b7b-2110ffe4fce4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:43:02.178341 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:43:02.234504 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a76d158d-6fbc-45f6-aa20-7c61acb3c29b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Port': ['ID=ce3d0753-3ee3-4e46-bd4f-bebf44a753f3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:02.308966 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a2d4f284-c49b-4f1e-8b7b-2110ffe4fce4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:02.322469 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a2d4f284-c49b-4f1e-8b7b-2110ffe4fce4 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:02.327748 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a2d4f284-c49b-4f1e-8b7b-2110ffe4fce4 admin admin] 10.222.0.13 "DELETE /v2.0/networks/71038cd4-0600-4b06-91f9-ae7f4f4807f9 HTTP/1.1" status: 204 len: 168 time: 0.5520732 Dec 09 21:43:02.363951 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2d4f284-c49b-4f1e-8b7b-2110ffe4fce4 admin admin] Pushing event deleted for resources: {'Network': ['ID=71038cd4-0600-4b06-91f9-ae7f4f4807f9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:02.375817 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a76d158d-6fbc-45f6-aa20-7c61acb3c29b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:02.379987 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a76d158d-6fbc-45f6-aa20-7c61acb3c29b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/ce3d0753-3ee3-4e46-bd4f-bebf44a753f3 HTTP/1.1" status: 204 len: 168 time: 1.2223074 Dec 09 21:43:02.382888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37074) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:02.404617 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c147a416-ff0a-4bae-9503-ebf0727fc69d no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:43:02.444536 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-182665de-1a66-4ab0-837f-342987ddfb49 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:02.446909 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-182665de-1a66-4ab0-837f-342987ddfb49 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:02.449157 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-182665de-1a66-4ab0-837f-342987ddfb49 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:02.451276 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-182665de-1a66-4ab0-837f-342987ddfb49 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2071 time: 0.0655861 Dec 09 21:43:02.454075 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37076) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:02.472549 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: c147a416-ff0a-4bae-9503-ebf0727fc69d {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:43:02.472900 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c147a416-ff0a-4bae-9503-ebf0727fc69d not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:43:02.473319 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 4d6d5feb-4ea8-48a8-a767-e7322d78726b no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:43:02.519129 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 4d6d5feb-4ea8-48a8-a767-e7322d78726b {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:43:02.519503 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 4d6d5feb-4ea8-48a8-a767-e7322d78726b not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:43:02.519863 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-22f3f937-81dc-4046-9b71-95327895b4ec tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet 79132eaa-0a21-4aa0-a2d9-fcd65fcdbcd9 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:43:02.524549 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-22f3f937-81dc-4046-9b71-95327895b4ec tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:02.602808 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-22f3f937-81dc-4046-9b71-95327895b4ec tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:02.712352 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37084) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:02.731371 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-22f3f937-81dc-4046-9b71-95327895b4ec tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:02.772657 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6e50bdbc-fd2a-490b-b77c-e4e851b97235 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=69d79e96ec1c418aa6c619846f0fe02e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0545657 Dec 09 21:43:02.774362 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37086) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:02.817654 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-22f3f937-81dc-4046-9b71-95327895b4ec tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:02.861596 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22f3f937-81dc-4046-9b71-95327895b4ec tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=79132eaa-0a21-4aa0-a2d9-fcd65fcdbcd9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:02.878105 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-22f3f937-81dc-4046-9b71-95327895b4ec tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:02.878734 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51c704f1-2ef9-462f-8f5a-8df30e71b6ef None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:02.884009 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-22f3f937-81dc-4046-9b71-95327895b4ec tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/79132eaa-0a21-4aa0-a2d9-fcd65fcdbcd9 HTTP/1.1" status: 204 len: 168 time: 0.4274437 Dec 09 21:43:02.885730 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37090) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:02.951559 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-acaee043-9046-42b8-84e9-5bf6338a86a9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:02.972488 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-2a35870e-71b8-499a-9e82-776207bdd9da tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet 7ecd0290-8cac-4b5e-8f40-e79e7dbc96da {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:43:02.977107 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a35870e-71b8-499a-9e82-776207bdd9da tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:02.978820 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-acaee043-9046-42b8-84e9-5bf6338a86a9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:02.997849 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2c905623-4c33-4754-bf6d-02252f373f95 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:03.043458 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-acaee043-9046-42b8-84e9-5bf6338a86a9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:03.046861 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-acaee043-9046-42b8-84e9-5bf6338a86a9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:03.053885 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-acaee043-9046-42b8-84e9-5bf6338a86a9 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/8d4a008f-197d-4501-abd1-093027cfd51b HTTP/1.1" status: 204 len: 168 time: 0.2722785 Dec 09 21:43:03.067158 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eac3c123-448d-45ec-aea4-41fd5ffbe240 req-8a898def-b877-48ac-8e7e-b0a149a128b4 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:03.067493 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eac3c123-448d-45ec-aea4-41fd5ffbe240 req-8a898def-b877-48ac-8e7e-b0a149a128b4 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.1946840 Dec 09 21:43:03.074128 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acaee043-9046-42b8-84e9-5bf6338a86a9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d4a008f-197d-4501-abd1-093027cfd51b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:03.125794 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a35870e-71b8-499a-9e82-776207bdd9da tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:03.156605 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eac3c123-448d-45ec-aea4-41fd5ffbe240 req-23195cb8-5bd2-4181-9d47-cbb001e12fb5 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0797765 Dec 09 21:43:03.290376 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a35870e-71b8-499a-9e82-776207bdd9da tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:03.365682 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a35870e-71b8-499a-9e82-776207bdd9da tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:03.410577 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a35870e-71b8-499a-9e82-776207bdd9da tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=7ecd0290-8cac-4b5e-8f40-e79e7dbc96da,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:03.422788 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a35870e-71b8-499a-9e82-776207bdd9da tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:03.426614 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2a35870e-71b8-499a-9e82-776207bdd9da tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/7ecd0290-8cac-4b5e-8f40-e79e7dbc96da HTTP/1.1" status: 204 len: 168 time: 0.5398877 Dec 09 21:43:03.432543 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37102) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:03.484617 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-172c169f-da9c-4a60-aa29-078e692ba52c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0503273 Dec 09 21:43:03.487336 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37104) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:03.595985 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e76fa1d9-0d98-4efe-be7d-bee047c095ca tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:03.597579 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e76fa1d9-0d98-4efe-be7d-bee047c095ca tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.1091321 Dec 09 21:43:03.602086 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37112) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:03.671911 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-269e1834-152d-4d09-b34e-a74643c3c93c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:03.676443 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37116) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:03.676816 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-269e1834-152d-4d09-b34e-a74643c3c93c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0735250 Dec 09 21:43:03.767607 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bd41d872-f8cb-417f-85b2-aec8aa797464 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0891092 Dec 09 21:43:03.772351 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37122) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:03.778087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-5d60bdb4-9dea-4802-afb5-e5c89ed6d032 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:04.024242 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5d60bdb4-9dea-4802-afb5-e5c89ed6d032 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:04.029687 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5d60bdb4-9dea-4802-afb5-e5c89ed6d032 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:04.032398 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-5d60bdb4-9dea-4802-afb5-e5c89ed6d032 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:43:04.032849 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5d60bdb4-9dea-4802-afb5-e5c89ed6d032 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:04.062555 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5d60bdb4-9dea-4802-afb5-e5c89ed6d032 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 460 time: 0.2890432 Dec 09 21:43:04.066938 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37132) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:04.072719 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-42407615-73be-4c86-ae8c-b21407fe3975 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'slaac'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:04.101756 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-93b68228-73e5-4c4c-8607-19ef422cdc78 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:04.248077 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3270e53d-4718-4156-9b31-fd378eaf27f4 None None] Provisioning complete for port c74db2be-1cc2-4035-9036-4976d880fa60 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:04.248452 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3270e53d-4718-4156-9b31-fd378eaf27f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:04.314337 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-42407615-73be-4c86-ae8c-b21407fe3975 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:04.325704 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42407615-73be-4c86-ae8c-b21407fe3975 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:04.327251 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-42407615-73be-4c86-ae8c-b21407fe3975 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:43:04.327730 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-42407615-73be-4c86-ae8c-b21407fe3975 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:04.360376 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-42407615-73be-4c86-ae8c-b21407fe3975 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 450 time: 0.2919731 Dec 09 21:43:04.363395 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37144) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:04.372091 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-e4d407d7-df2e-486f-b32f-9679262c7571 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:04.419102 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af9215b1-5461-49b2-9180-e277ddaac934 req-c07d3110-99df-4d0c-b15c-9f6ae6c994a1 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:04.439496 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af9215b1-5461-49b2-9180-e277ddaac934 req-c07d3110-99df-4d0c-b15c-9f6ae6c994a1 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.1618140 Dec 09 21:43:04.462910 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-16d8d46a-c1ee-4385-8a56-9054c090fed5 None None] DHCP port deletion for 77d1c069-bca4-4157-a30b-fb10cbd9d9ee request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:43:04.486812 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37150) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:04.536881 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e4d407d7-df2e-486f-b32f-9679262c7571 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:04.536881 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e4d407d7-df2e-486f-b32f-9679262c7571 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:04.537322 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-e4d407d7-df2e-486f-b32f-9679262c7571 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:43:04.537802 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e4d407d7-df2e-486f-b32f-9679262c7571 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:04.581407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-16d8d46a-c1ee-4385-8a56-9054c090fed5 None None] Deleting port c74db2be-1cc2-4035-9036-4976d880fa60 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:43:04.582111 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-16d8d46a-c1ee-4385-8a56-9054c090fed5 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:04.615779 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af9215b1-5461-49b2-9180-e277ddaac934 req-6a98bfac-490a-4d6b-b980-f3f25254ab41 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1711805 Dec 09 21:43:04.631340 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e4d407d7-df2e-486f-b32f-9679262c7571 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 449 time: 0.2635942 Dec 09 21:43:04.633814 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37156) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:04.647232 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ee66590c-b55f-4e8a-be01-e0c7cdc3cb97 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:04.676422 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-16d8d46a-c1ee-4385-8a56-9054c090fed5 None None] For port c74db2be-1cc2-4035-9036-4976d880fa60, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c74db2be-1cc2-4035-9036-4976d880fa60,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:04.676836 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-16d8d46a-c1ee-4385-8a56-9054c090fed5 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:04.711986 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-16d8d46a-c1ee-4385-8a56-9054c090fed5 None None] Calling delete_port for c74db2be-1cc2-4035-9036-4976d880fa60 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:43:04.808023 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-7823bdf4-c128-4515-8274-18400c020ada admin admin] Request body: {'network': {'name': 'tempest-ServerTagsTestJSON-330942944-network', 'tenant_id': 'f832d472c11f4b9090837d07f510849a'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:04.884034 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.db.api [None req-7823bdf4-c128-4515-8274-18400c020ada admin admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Dec 09 21:43:04.884034 n-d-713301-27 neutron-server[103437]: [SQL: INSERT INTO reservations (project_id, id, expiration) VALUES (%(project_id)s, %(id)s, %(expiration)s)] Dec 09 21:43:04.884034 n-d-713301-27 neutron-server[103437]: [parameters: {'project_id': 'f832d472c11f4b9090837d07f510849a', 'id': '11df7b2e-64fe-4873-b183-e092489afc49', 'expiration': datetime.datetime(2021, 12, 9, 21, 45, 4, 829799)}] Dec 09 21:43:04.884034 n-d-713301-27 neutron-server[103437]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=103437) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:43:04.884546 n-d-713301-27 neutron-server[103437]: DEBUG oslo_db.api [None req-7823bdf4-c128-4515-8274-18400c020ada admin admin] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:43:04.895693 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-16d8d46a-c1ee-4385-8a56-9054c090fed5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:04.899580 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ee66590c-b55f-4e8a-be01-e0c7cdc3cb97 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:04.905564 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee66590c-b55f-4e8a-be01-e0c7cdc3cb97 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:04.910714 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16d8d46a-c1ee-4385-8a56-9054c090fed5 None None] No DVR routers for this DVR port c74db2be-1cc2-4035-9036-4976d880fa60 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:43:04.911388 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-ee66590c-b55f-4e8a-be01-e0c7cdc3cb97 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:43:04.911917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ee66590c-b55f-4e8a-be01-e0c7cdc3cb97 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:04.930941 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48f7008e-78e3-48bf-9b8d-89880eeae86e req-b9c117b0-977f-4dee-980e-1a13aa5d408f tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:04.938496 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ee66590c-b55f-4e8a-be01-e0c7cdc3cb97 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 460 time: 0.3034663 Dec 09 21:43:04.941633 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-48f7008e-78e3-48bf-9b8d-89880eeae86e req-b9c117b0-977f-4dee-980e-1a13aa5d408f tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.1021602 Dec 09 21:43:04.942151 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37164) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:04.948652 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2565ddc5-7b13-423f-b0d9-5f050e3116d7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'slaac'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:04.962378 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16d8d46a-c1ee-4385-8a56-9054c090fed5 None None] Pushing event deleted for resources: {'Port': ['ID=c74db2be-1cc2-4035-9036-4976d880fa60,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:05.011966 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-48f7008e-78e3-48bf-9b8d-89880eeae86e req-721f1c19-bd76-4837-86e7-d36c82567d3d tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0693524 Dec 09 21:43:05.098958 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2565ddc5-7b13-423f-b0d9-5f050e3116d7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:05.102952 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2565ddc5-7b13-423f-b0d9-5f050e3116d7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:05.104873 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-2565ddc5-7b13-423f-b0d9-5f050e3116d7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:43:05.105316 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2565ddc5-7b13-423f-b0d9-5f050e3116d7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:05.124258 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2565ddc5-7b13-423f-b0d9-5f050e3116d7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 449 time: 0.1807017 Dec 09 21:43:05.127123 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37170) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:05.132582 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-5bd5b8a0-f491-409a-a922-2bce234983e2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:05.201700 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c8ab155-c332-4c11-82c7-0843788881a0 req-86cf028c-94aa-43ea-bdc3-1b94b09542b6 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:05.203357 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c8ab155-c332-4c11-82c7-0843788881a0 req-86cf028c-94aa-43ea-bdc3-1b94b09542b6 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.0973427 Dec 09 21:43:05.273308 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5bd5b8a0-f491-409a-a922-2bce234983e2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:05.281293 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5bd5b8a0-f491-409a-a922-2bce234983e2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:05.282866 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-5bd5b8a0-f491-409a-a922-2bce234983e2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:43:05.283214 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5bd5b8a0-f491-409a-a922-2bce234983e2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:05.298193 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c8ab155-c332-4c11-82c7-0843788881a0 req-f4cc106f-8c4e-44e5-8512-f4cae245e841 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0879998 Dec 09 21:43:05.310253 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5bd5b8a0-f491-409a-a922-2bce234983e2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 450 time: 0.1812079 Dec 09 21:43:05.312417 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37178) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:05.353844 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-74c3382d-bfa2-4859-b9ef-4166147e377d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 205 time: 0.0401325 Dec 09 21:43:05.356184 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37182) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:05.425820 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a9ddccbd-234c-4ce0-b14e-fd938936f7eb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:05.429717 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a9ddccbd-234c-4ce0-b14e-fd938936f7eb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0701187 Dec 09 21:43:05.430111 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37184) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:05.475780 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7823bdf4-c128-4515-8274-18400c020ada admin admin] Made reservation on behalf of f832d472c11f4b9090837d07f510849a for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:05.479865 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7823bdf4-c128-4515-8274-18400c020ada admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:05.493863 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7fb48ed1-28c0-4eb9-9e65-8ac9e5cb6e05 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0614822 Dec 09 21:43:05.497453 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7823bdf4-c128-4515-8274-18400c020ada admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:05.498047 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37186) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:05.503649 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-cd03dab2-7360-492e-b432-1a50a1c7ac89 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:05.581148 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ea0ed11e-2d08-40d7-9f55-62786bf49fb5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:05.671911 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cd03dab2-7360-492e-b432-1a50a1c7ac89 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:05.679136 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cd03dab2-7360-492e-b432-1a50a1c7ac89 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:05.697699 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7823bdf4-c128-4515-8274-18400c020ada admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:05.703185 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7823bdf4-c128-4515-8274-18400c020ada admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:05.737398 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7823bdf4-c128-4515-8274-18400c020ada admin admin] vlan segment allocate from pool success with {'vlan_id': 126, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:43:05.747315 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7823bdf4-c128-4515-8274-18400c020ada admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f7ac2409-fc2d-46c4-9c5c-d8bca8738561,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:05.758690 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7823bdf4-c128-4515-8274-18400c020ada admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:05.759178 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-7823bdf4-c128-4515-8274-18400c020ada admin admin] Added segment d82da970-cb23-48b1-8606-d6809e0c864c of type vlan for network 7104ce0f-c225-47d9-9c49-c01b517dbac9 Dec 09 21:43:05.828582 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98aef81a-98bb-467c-b688-d6042f6d32ee req-83ef78c9-efbe-40c5-a6e3-b165fbae57ed tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:05.829148 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7823bdf4-c128-4515-8274-18400c020ada admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:05.830293 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98aef81a-98bb-467c-b688-d6042f6d32ee req-83ef78c9-efbe-40c5-a6e3-b165fbae57ed tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.1178241 Dec 09 21:43:05.862650 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7823bdf4-c128-4515-8274-18400c020ada admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:05.866404 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7823bdf4-c128-4515-8274-18400c020ada admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:05.870527 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7823bdf4-c128-4515-8274-18400c020ada admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:05.921758 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98aef81a-98bb-467c-b688-d6042f6d32ee req-7269d231-61c7-4be3-a27d-0d287833da2a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0790365 Dec 09 21:43:05.939710 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7823bdf4-c128-4515-8274-18400c020ada admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 1.4451790 Dec 09 21:43:05.939710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37196) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:05.940714 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-5c0b0d5b-bc8c-4050-925e-bda6ea8e3acf admin admin] Request body: {'subnet': {'network_id': '7104ce0f-c225-47d9-9c49-c01b517dbac9', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerTagsTestJSON-330942944-subnet', 'tenant_id': 'f832d472c11f4b9090837d07f510849a', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:06.008792 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7823bdf4-c128-4515-8274-18400c020ada admin admin] Pushing event updated for resources: {'Network': ['ID=7104ce0f-c225-47d9-9c49-c01b517dbac9,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:06.024195 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 7104ce0f-c225-47d9-9c49-c01b517dbac9 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:43:06.055254 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5c0b0d5b-bc8c-4050-925e-bda6ea8e3acf admin admin] Made reservation on behalf of f832d472c11f4b9090837d07f510849a for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:06.059289 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c0b0d5b-bc8c-4050-925e-bda6ea8e3acf admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:06.206890 n-d-713301-27 neutron-server[103438]: DEBUG neutron.objects.ports [None req-cd03dab2-7360-492e-b432-1a50a1c7ac89 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103438) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 09 21:43:06.208412 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cd03dab2-7360-492e-b432-1a50a1c7ac89 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:06.258393 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd03dab2-7360-492e-b432-1a50a1c7ac89 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=86ed7d54-5dd3-4691-9996-5c7271fa131a,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:06.271794 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cd03dab2-7360-492e-b432-1a50a1c7ac89 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:06.273377 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-cd03dab2-7360-492e-b432-1a50a1c7ac89 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:06.276405 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cd03dab2-7360-492e-b432-1a50a1c7ac89 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:06.277008 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cd03dab2-7360-492e-b432-1a50a1c7ac89 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:06.285450 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e2b0392-2e8f-47fb-b337-576d4d8dbf9f None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:06.301802 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cd03dab2-7360-492e-b432-1a50a1c7ac89 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 0.8020568 Dec 09 21:43:06.302711 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37204) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:06.326671 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-179afa67-7980-413e-89cb-c75624f875d9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'mac_address': 'fa:16:3e:00:b8:76', 'name': 'tempest-NetworksTestDHCPv6-337843432'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:06.377591 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c0b0d5b-bc8c-4050-925e-bda6ea8e3acf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:06.410715 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c74db2be-1cc2-4035-9036-4976d880fa60 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:43:06.438187 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: c74db2be-1cc2-4035-9036-4976d880fa60 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:43:06.438875 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c74db2be-1cc2-4035-9036-4976d880fa60 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:43:06.483399 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c0b0d5b-bc8c-4050-925e-bda6ea8e3acf admin admin] Pushing event updated for resources: {'Subnet': ['ID=f1d3a5cf-34a0-4be7-b1d4-5dfaca5a6107,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:06.545412 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-179afa67-7980-413e-89cb-c75624f875d9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:06.562027 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c0b0d5b-bc8c-4050-925e-bda6ea8e3acf admin admin] Checking segment: {'id': 'd82da970-cb23-48b1-8606-d6809e0c864c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '7104ce0f-c225-47d9-9c49-c01b517dbac9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:43:06.564069 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5c0b0d5b-bc8c-4050-925e-bda6ea8e3acf admin admin] Network hostable DHCP agents. Network: 7104ce0f-c225-47d9-9c49-c01b517dbac9, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:43:06.594988 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5c0b0d5b-bc8c-4050-925e-bda6ea8e3acf admin admin] Network 7104ce0f-c225-47d9-9c49-c01b517dbac9 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:43:06.621078 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-5c0b0d5b-bc8c-4050-925e-bda6ea8e3acf admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 7104ce0f-c225-47d9-9c49-c01b517dbac9) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:06.647869 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c0b0d5b-bc8c-4050-925e-bda6ea8e3acf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:06.648472 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c0b0d5b-bc8c-4050-925e-bda6ea8e3acf admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:06.670144 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-01ea1c1a-d2a1-4b40-9366-6d3b626d3523 None None] Network 7104ce0f-c225-47d9-9c49-c01b517dbac9 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:06.702531 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5c0b0d5b-bc8c-4050-925e-bda6ea8e3acf admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.7660294 Dec 09 21:43:06.703665 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c32d0c93-56e1-4678-82ed-684a42447d52 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'fixed_ips': [{'subnet_id': '86ed7d54-5dd3-4691-9996-5c7271fa131a'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:43:06.704895 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c32d0c93-56e1-4678-82ed-684a42447d52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:06.723974 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:06.726766 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-179afa67-7980-413e-89cb-c75624f875d9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:06.867194 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-179afa67-7980-413e-89cb-c75624f875d9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] device_id is not set on port 61b3ff76-539a-47f8-9015-eb71fc4cc015 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:43:06.888314 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b6878de-12a8-4114-a0fa-d6d065a725e6 req-a60c29ff-b321-4f46-ac5e-ee5f68318971 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:06.889808 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b6878de-12a8-4114-a0fa-d6d065a725e6 req-a60c29ff-b321-4f46-ac5e-ee5f68318971 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.1155574 Dec 09 21:43:07.158421 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99133b84-5f76-4548-80e8-471cc7036f23 req-fe554a9e-ef75-426f-b305-59c235e9babe tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:07.166265 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99133b84-5f76-4548-80e8-471cc7036f23 req-fe554a9e-ef75-426f-b305-59c235e9babe tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=303a8da5-b50c-4ba9-bac7-8facea49c694 HTTP/1.1" status: 200 len: 946 time: 0.1141031 Dec 09 21:43:07.205348 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-6b6878de-12a8-4114-a0fa-d6d065a725e6 req-ade1c8ac-082c-4f40-8cfa-216610c60fa6 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Deleting port 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:43:07.205969 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6b6878de-12a8-4114-a0fa-d6d065a725e6 req-ade1c8ac-082c-4f40-8cfa-216610c60fa6 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:07.254902 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99133b84-5f76-4548-80e8-471cc7036f23 req-6d815df8-eebd-4360-9943-0e7e58386505 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0869589 Dec 09 21:43:07.279036 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-c32d0c93-56e1-4678-82ed-684a42447d52 None None] Allocated IP 2001:db8::f816:3eff:fe8d:200d (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/86ed7d54-5dd3-4691-9996-5c7271fa131a/688ce079-dce9-4219-88a6-3ce46124a63f) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:07.454647 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c32d0c93-56e1-4678-82ed-684a42447d52 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:07.468248 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-6b6878de-12a8-4114-a0fa-d6d065a725e6 req-ade1c8ac-082c-4f40-8cfa-216610c60fa6 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] For port 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:07.468510 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6b6878de-12a8-4114-a0fa-d6d065a725e6 req-ade1c8ac-082c-4f40-8cfa-216610c60fa6 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:07.470567 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c32d0c93-56e1-4678-82ed-684a42447d52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:07.519432 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-6b6878de-12a8-4114-a0fa-d6d065a725e6 req-ade1c8ac-082c-4f40-8cfa-216610c60fa6 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Calling delete_port for 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:43:07.547190 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e1b6a8f-d36b-4bbb-97e1-5953fa75ca6d None None] Network 7104ce0f-c225-47d9-9c49-c01b517dbac9 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:07.574384 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c32d0c93-56e1-4678-82ed-684a42447d52 None None] Pushing event updated for resources: {'Port': ['ID=688ce079-dce9-4219-88a6-3ce46124a63f,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:07.612378 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c32d0c93-56e1-4678-82ed-684a42447d52 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:07.618115 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-c32d0c93-56e1-4678-82ed-684a42447d52 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:07.623708 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c32d0c93-56e1-4678-82ed-684a42447d52 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:43:07.770861 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-c32d0c93-56e1-4678-82ed-684a42447d52 None None] Attempting to bind port 688ce079-dce9-4219-88a6-3ce46124a63f on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:43:07.772046 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-c32d0c93-56e1-4678-82ed-684a42447d52 None None] Attempting to bind port 688ce079-dce9-4219-88a6-3ce46124a63f by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:43:07.772885 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c32d0c93-56e1-4678-82ed-684a42447d52 None None] Attempting to bind port 688ce079-dce9-4219-88a6-3ce46124a63f on network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:43:07.779977 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c32d0c93-56e1-4678-82ed-684a42447d52 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 42, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:43:07.781328 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c32d0c93-56e1-4678-82ed-684a42447d52 None None] Checking segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:43:07.782061 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c32d0c93-56e1-4678-82ed-684a42447d52 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:07.782628 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c32d0c93-56e1-4678-82ed-684a42447d52 None None] Bound using segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:43:07.783395 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-c32d0c93-56e1-4678-82ed-684a42447d52 None None] Bound port: 688ce079-dce9-4219-88a6-3ce46124a63f, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:43:07.783962 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c32d0c93-56e1-4678-82ed-684a42447d52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:07.865597 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c32d0c93-56e1-4678-82ed-684a42447d52 None None] For port 688ce079-dce9-4219-88a6-3ce46124a63f, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:43:07.869434 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c32d0c93-56e1-4678-82ed-684a42447d52 None None] For port 688ce079-dce9-4219-88a6-3ce46124a63f, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=688ce079-dce9-4219-88a6-3ce46124a63f,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:43:07.871027 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-179afa67-7980-413e-89cb-c75624f875d9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8::f816:3eff:fe00:b876 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/86ed7d54-5dd3-4691-9996-5c7271fa131a/61b3ff76-539a-47f8-9015-eb71fc4cc015) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:07.878479 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6b6878de-12a8-4114-a0fa-d6d065a725e6 req-ade1c8ac-082c-4f40-8cfa-216610c60fa6 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:07.880829 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c32d0c93-56e1-4678-82ed-684a42447d52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:07.917043 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['5df02334-3682-4a91-b22d-133fa1bcb473', '56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:43:07.930501 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ade1c8ac-082c-4f40-8cfa-216610c60fa6 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Pushing event deleted for resources: {'Port': ['ID=56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:08.001640 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-f5ea779d-3eec-419a-bddb-82cfbc4f0135 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:08.009029 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-f5ea779d-3eec-419a-bddb-82cfbc4f0135 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/networks?id=7104ce0f-c225-47d9-9c49-c01b517dbac9 HTTP/1.1" status: 200 len: 808 time: 0.2697363 Dec 09 21:43:08.089248 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:43:08.089856 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-6b6878de-12a8-4114-a0fa-d6d065a725e6 req-ade1c8ac-082c-4f40-8cfa-216610c60fa6 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] No DVR routers for this DVR port 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902 on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:43:08.101747 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6b6878de-12a8-4114-a0fa-d6d065a725e6 req-ade1c8ac-082c-4f40-8cfa-216610c60fa6 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:08.110534 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b6878de-12a8-4114-a0fa-d6d065a725e6 req-ade1c8ac-082c-4f40-8cfa-216610c60fa6 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "DELETE /v2.0/ports/56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902 HTTP/1.1" status: 204 len: 173 time: 1.1845655 Dec 09 21:43:08.121956 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '303a8da5-b50c-4ba9-bac7-8facea49c694', 'name': 'network-vif-deleted', 'tag': '56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:43:08.125015 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6b7a4515-d393-42c8-90b5-a29190ec7e17" -d '{"events": [{"server_uuid": "303a8da5-b50c-4ba9-bac7-8facea49c694", "name": "network-vif-deleted", "tag": "56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:43:08.135901 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-74ded78a-7c1e-42b7-8091-84a0d4589e79 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/quotas/f832d472c11f4b9090837d07f510849a HTTP/1.1" status: 200 len: 375 time: 0.1256816 Dec 09 21:43:08.173211 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bd2982b7-96ff-4e52-930c-ae1d30a5eaa7 None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:43:08.235402 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c32d0c93-56e1-4678-82ed-684a42447d52 None None] Pushing event updated for resources: {'Port': ['ID=688ce079-dce9-4219-88a6-3ce46124a63f,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:08.241779 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-6756bbb9-2e5c-40c1-a5d9-f739d896702d tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=f832d472c11f4b9090837d07f510849a&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0866039 Dec 09 21:43:08.256527 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:08.708681 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-381dc67d-6340-419d-a312-513e69fa795e service neutron] 10.222.0.13 "GET /v2.0/networks/7104ce0f-c225-47d9-9c49-c01b517dbac9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4562259 Dec 09 21:43:08.756698 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-179afa67-7980-413e-89cb-c75624f875d9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:08.835064 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-179afa67-7980-413e-89cb-c75624f875d9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:08.977461 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-179afa67-7980-413e-89cb-c75624f875d9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:08.980436 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-179afa67-7980-413e-89cb-c75624f875d9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=61b3ff76-539a-47f8-9015-eb71fc4cc015,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:08.992756 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-179afa67-7980-413e-89cb-c75624f875d9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:08.997979 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-179afa67-7980-413e-89cb-c75624f875d9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:43:09.005436 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-179afa67-7980-413e-89cb-c75624f875d9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:09.006444 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-179afa67-7980-413e-89cb-c75624f875d9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:09.037613 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-384f0aee-a5f9-44a0-8269-e54f8c31b52d service neutron] 10.222.0.13 "GET /v2.0/networks/7104ce0f-c225-47d9-9c49-c01b517dbac9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3148515 Dec 09 21:43:09.044394 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-179afa67-7980-413e-89cb-c75624f875d9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 2.7370155 Dec 09 21:43:09.047461 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37256) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:09.124859 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-353d3211-c5de-4070-b100-d8c7331ff63b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:09.134174 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-353d3211-c5de-4070-b100-d8c7331ff63b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:09.136376 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-353d3211-c5de-4070-b100-d8c7331ff63b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1702 time: 0.0865688 Dec 09 21:43:09.139037 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37258) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:09.265866 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-4f3cf725-ccf1-41a7-abb4-2e3e541a78d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting port 61b3ff76-539a-47f8-9015-eb71fc4cc015 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:43:09.266452 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4f3cf725-ccf1-41a7-abb4-2e3e541a78d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:09.293552 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:43:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-74e81e47-1913-4302-851a-4fc1f5d812d4 x-openstack-request-id: req-74e81e47-1913-4302-851a-4fc1f5d812d4 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:43:09.294264 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "303a8da5-b50c-4ba9-bac7-8facea49c694", "name": "network-vif-deleted", "tag": "56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:43:09.294608 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-74e81e47-1913-4302-851a-4fc1f5d812d4 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:43:09.295166 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '303a8da5-b50c-4ba9-bac7-8facea49c694', 'name': 'network-vif-deleted', 'tag': '56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902', 'status': 'completed', 'code': 200} Dec 09 21:43:09.438832 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4f3cf725-ccf1-41a7-abb4-2e3e541a78d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:09.514798 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1f3bb39c-d472-40a4-ad40-8ee242eeade2 req-b605f8f4-367f-49dc-82dd-3bd4c588efa0 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/ports?device_id=6817b8ca-c51a-46d0-8c87-3cf63d444459 HTTP/1.1" status: 200 len: 210 time: 0.0696442 Dec 09 21:43:09.515669 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-4f3cf725-ccf1-41a7-abb4-2e3e541a78d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Calling delete_port for 61b3ff76-539a-47f8-9015-eb71fc4cc015 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:43:09.703088 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:09.804080 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4f3cf725-ccf1-41a7-abb4-2e3e541a78d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:09.905895 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f3cf725-ccf1-41a7-abb4-2e3e541a78d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Port': ['ID=61b3ff76-539a-47f8-9015-eb71fc4cc015,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:09.955650 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4f3cf725-ccf1-41a7-abb4-2e3e541a78d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:09.963854 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4f3cf725-ccf1-41a7-abb4-2e3e541a78d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/61b3ff76-539a-47f8-9015-eb71fc4cc015 HTTP/1.1" status: 204 len: 168 time: 0.8214755 Dec 09 21:43:09.963854 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f3cf725-ccf1-41a7-abb4-2e3e541a78d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:09.964364 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f3cf725-ccf1-41a7-abb4-2e3e541a78d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:09.964711 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37294) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:09.965185 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f3cf725-ccf1-41a7-abb4-2e3e541a78d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:09.965297 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f3cf725-ccf1-41a7-abb4-2e3e541a78d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:09.965601 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f3cf725-ccf1-41a7-abb4-2e3e541a78d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:09.965987 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f3cf725-ccf1-41a7-abb4-2e3e541a78d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:09.966328 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f3cf725-ccf1-41a7-abb4-2e3e541a78d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:09.966653 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f3cf725-ccf1-41a7-abb4-2e3e541a78d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:09.966967 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f3cf725-ccf1-41a7-abb4-2e3e541a78d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:09.967426 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f3cf725-ccf1-41a7-abb4-2e3e541a78d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:09.967766 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f3cf725-ccf1-41a7-abb4-2e3e541a78d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:09.968101 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f3cf725-ccf1-41a7-abb4-2e3e541a78d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:09.968410 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4f3cf725-ccf1-41a7-abb4-2e3e541a78d6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:10.072971 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-49c1053f-2ac4-4f8a-b7a6-fc03cb92d2fa tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:10.077727 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-49c1053f-2ac4-4f8a-b7a6-fc03cb92d2fa tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:10.079639 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-49c1053f-2ac4-4f8a-b7a6-fc03cb92d2fa tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1457 time: 0.1136351 Dec 09 21:43:10.082651 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37300) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:10.135824 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2602671c-b356-4adc-b57e-1a329430405a None None] Provisioning complete for port 688ce079-dce9-4219-88a6-3ce46124a63f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:10.137186 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2602671c-b356-4adc-b57e-1a329430405a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:10.343945 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2602671c-b356-4adc-b57e-1a329430405a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:10.476498 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2602671c-b356-4adc-b57e-1a329430405a None None] For port 688ce079-dce9-4219-88a6-3ce46124a63f, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=688ce079-dce9-4219-88a6-3ce46124a63f,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:10.488104 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2602671c-b356-4adc-b57e-1a329430405a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:10.601662 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 688ce079-dce9-4219-88a6-3ce46124a63f up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:43:10.673366 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-97efddad-71d6-465c-886e-1bf78a2f7e7b None None] Could not find standard attr ID for object 61b3ff76-539a-47f8-9015-eb71fc4cc015. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:43:10.726406 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2602671c-b356-4adc-b57e-1a329430405a None None] Pushing event updated for resources: {'Port': ['ID=688ce079-dce9-4219-88a6-3ce46124a63f,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:10.744083 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 688ce079-dce9-4219-88a6-3ce46124a63f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:10.744748 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:10.975956 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b65ff02-aa5a-481a-893e-2f08c0c83cc4 req-a00be180-5722-44a0-b628-66f92d5f9890 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/ports?device_id=6817b8ca-c51a-46d0-8c87-3cf63d444459 HTTP/1.1" status: 200 len: 210 time: 0.0473089 Dec 09 21:43:10.991926 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-c5d8abe7-68d3-49e4-91ce-292e736eb1dc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet 86ed7d54-5dd3-4691-9996-5c7271fa131a {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:43:11.078435 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c5d8abe7-68d3-49e4-91ce-292e736eb1dc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:11.131957 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c5d8abe7-68d3-49e4-91ce-292e736eb1dc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:11.343888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-b23d38f3-4e43-4231-8063-705c4a01adf3 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:11.346383 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-b23d38f3-4e43-4231-8063-705c4a01adf3 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.31 "GET /v2.0/networks?id=7104ce0f-c225-47d9-9c49-c01b517dbac9 HTTP/1.1" status: 200 len: 808 time: 0.3510096 Dec 09 21:43:11.356134 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c5d8abe7-68d3-49e4-91ce-292e736eb1dc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:11.390874 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-ba6ebf46-20e0-4269-a831-826bde4dcc53 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Request body: {'port': {'device_id': '6817b8ca-c51a-46d0-8c87-3cf63d444459', 'network_id': '7104ce0f-c225-47d9-9c49-c01b517dbac9', 'admin_state_up': True, 'tenant_id': 'f832d472c11f4b9090837d07f510849a'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:11.524820 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4de7f7ff-e573-4b1c-89f0-f93eb48ddad6 req-e859fc48-51e4-427b-8fde-d7c46292bf3a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:11.526536 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4de7f7ff-e573-4b1c-89f0-f93eb48ddad6 req-e859fc48-51e4-427b-8fde-d7c46292bf3a tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1faa187b-0441-47d3-8d37-6489d51928bb HTTP/1.1" status: 200 len: 945 time: 0.1743734 Dec 09 21:43:11.530257 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c5d8abe7-68d3-49e4-91ce-292e736eb1dc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:11.549224 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:43:11.578871 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:43:11.579676 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 56a5a8f2-a8e7-4690-a20c-7bd9c0ab3902 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:43:11.581056 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5d8abe7-68d3-49e4-91ce-292e736eb1dc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=86ed7d54-5dd3-4691-9996-5c7271fa131a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:11.593853 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c5d8abe7-68d3-49e4-91ce-292e736eb1dc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:11.597217 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-882dfd9e-dfbe-46a2-92c1-8daa0fb747f1 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:11.597440 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c5d8abe7-68d3-49e4-91ce-292e736eb1dc tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/86ed7d54-5dd3-4691-9996-5c7271fa131a HTTP/1.1" status: 204 len: 168 time: 1.5137885 Dec 09 21:43:11.600573 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37344) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:11.664817 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-91cae38a-a11d-4c84-8963-c993b2cdbcdd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0624518 Dec 09 21:43:11.668628 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37348) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:11.675383 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-0b6fe971-f9a3-45af-9c44-9aaa752c37e0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:11.690159 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4de7f7ff-e573-4b1c-89f0-f93eb48ddad6 req-c5e7b956-0617-4a6d-87ed-4afa904e2043 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1479602 Dec 09 21:43:11.716279 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-ba6ebf46-20e0-4269-a831-826bde4dcc53 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Made reservation on behalf of f832d472c11f4b9090837d07f510849a for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:11.720926 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-ba6ebf46-20e0-4269-a831-826bde4dcc53 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:11.818647 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aae82353-4ee1-4abe-b048-2d515b6a0b93 None None] DHCP port deletion for 77d1c069-bca4-4157-a30b-fb10cbd9d9ee request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:43:11.839413 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0b6fe971-f9a3-45af-9c44-9aaa752c37e0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:11.845007 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0b6fe971-f9a3-45af-9c44-9aaa752c37e0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:11.886517 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-aae82353-4ee1-4abe-b048-2d515b6a0b93 None None] Deleting port 688ce079-dce9-4219-88a6-3ce46124a63f {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:43:11.887847 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aae82353-4ee1-4abe-b048-2d515b6a0b93 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:11.944638 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-ba6ebf46-20e0-4269-a831-826bde4dcc53 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Allocated IP 172.20.0.14 (7104ce0f-c225-47d9-9c49-c01b517dbac9/f1d3a5cf-34a0-4be7-b1d4-5dfaca5a6107/6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:11.974839 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-aae82353-4ee1-4abe-b048-2d515b6a0b93 None None] For port 688ce079-dce9-4219-88a6-3ce46124a63f, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=688ce079-dce9-4219-88a6-3ce46124a63f,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:11.975334 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aae82353-4ee1-4abe-b048-2d515b6a0b93 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:11.988454 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-aae82353-4ee1-4abe-b048-2d515b6a0b93 None None] Calling delete_port for 688ce079-dce9-4219-88a6-3ce46124a63f owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:43:12.116408 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aae82353-4ee1-4abe-b048-2d515b6a0b93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:12.165874 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aae82353-4ee1-4abe-b048-2d515b6a0b93 None None] Pushing event deleted for resources: {'Port': ['ID=688ce079-dce9-4219-88a6-3ce46124a63f,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:12.166479 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c7e0af3e-94a6-4b5f-bcbf-fae782036afa req-e666a73f-08eb-4d32-b437-09c168d1a852 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/ports?device_id=6817b8ca-c51a-46d0-8c87-3cf63d444459 HTTP/1.1" status: 200 len: 210 time: 0.0574307 Dec 09 21:43:12.169844 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aae82353-4ee1-4abe-b048-2d515b6a0b93 None None] No DVR routers for this DVR port 688ce079-dce9-4219-88a6-3ce46124a63f on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:43:12.228658 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-ba6ebf46-20e0-4269-a831-826bde4dcc53 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:12.296769 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-ba6ebf46-20e0-4269-a831-826bde4dcc53 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:12.334958 n-d-713301-27 neutron-server[103437]: DEBUG neutron.objects.ports [None req-0b6fe971-f9a3-45af-9c44-9aaa752c37e0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103437) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 09 21:43:12.336790 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0b6fe971-f9a3-45af-9c44-9aaa752c37e0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:12.362140 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b6fe971-f9a3-45af-9c44-9aaa752c37e0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:12.362513 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-ba6ebf46-20e0-4269-a831-826bde4dcc53 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Network 7104ce0f-c225-47d9-9c49-c01b517dbac9 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:12.369862 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-ba6ebf46-20e0-4269-a831-826bde4dcc53 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:12.380662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-ba6ebf46-20e0-4269-a831-826bde4dcc53 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:43:12.386492 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-0b6fe971-f9a3-45af-9c44-9aaa752c37e0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:12.390137 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b6fe971-f9a3-45af-9c44-9aaa752c37e0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:12.390810 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0b6fe971-f9a3-45af-9c44-9aaa752c37e0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:12.395977 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ee2a9e99-5041-4e18-aaa1-17eb58139c05 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:12.439637 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0b6fe971-f9a3-45af-9c44-9aaa752c37e0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.7694905 Dec 09 21:43:12.442931 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37364) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:12.444583 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-ba6ebf46-20e0-4269-a831-826bde4dcc53 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:12.445673 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-ba6ebf46-20e0-4269-a831-826bde4dcc53 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:12.449914 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba6ebf46-20e0-4269-a831-826bde4dcc53 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Pushing event updated for resources: {'Port': ['ID=6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:12.457075 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-45b98c3c-21b7-409b-9e9d-101e0c41f91b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'mac_address': 'fa:16:3e:d6:46:64', 'name': 'tempest-NetworksTestDHCPv6-1906557168'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:12.467365 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b6fe971-f9a3-45af-9c44-9aaa752c37e0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=cb982511-19f0-492e-9b00-ffe000f9f935,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:12.472431 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-ba6ebf46-20e0-4269-a831-826bde4dcc53 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.1114941 Dec 09 21:43:12.496786 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-c462c2dd-6367-4b0e-9eec-35d356de784c service neutron] Request body: {'port': {'device_id': '6817b8ca-c51a-46d0-8c87-3cf63d444459', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:12.506764 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 688ce079-dce9-4219-88a6-3ce46124a63f no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:43:12.579155 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 688ce079-dce9-4219-88a6-3ce46124a63f {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:43:12.591136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 688ce079-dce9-4219-88a6-3ce46124a63f not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:43:12.594285 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dbaf90e9-3869-4588-8f58-a708cded345f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'fixed_ips': [{'subnet_id': 'cb982511-19f0-492e-9b00-ffe000f9f935'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:43:12.595340 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dbaf90e9-3869-4588-8f58-a708cded345f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:12.618678 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-c462c2dd-6367-4b0e-9eec-35d356de784c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:12.727714 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40651571-c780-424b-817b-25fc844b26fe req-95045b01-3359-42b1-8c09-1f00ac759c46 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:12.730415 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-40651571-c780-424b-817b-25fc844b26fe req-95045b01-3359-42b1-8c09-1f00ac759c46 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "GET /v2.0/ports?device_id=1faa187b-0441-47d3-8d37-6489d51928bb HTTP/1.1" status: 200 len: 945 time: 0.1095464 Dec 09 21:43:12.780120 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-dbaf90e9-3869-4588-8f58-a708cded345f None None] Allocated IP 2001:db8::f816:3eff:fe57:4b8a (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/cb982511-19f0-492e-9b00-ffe000f9f935/7b3387a1-3493-4893-9e2c-5b05817a191a) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:12.837231 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-45b98c3c-21b7-409b-9e9d-101e0c41f91b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:12.959137 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7a6e48a-5712-430f-acf4-50880944aeeb req-9f1fd256-c7dc-409d-9474-48e39b4410ff tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:12.968027 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7a6e48a-5712-430f-acf4-50880944aeeb req-9f1fd256-c7dc-409d-9474-48e39b4410ff tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1faa187b-0441-47d3-8d37-6489d51928bb HTTP/1.1" status: 200 len: 945 time: 0.1495459 Dec 09 21:43:13.023016 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dbaf90e9-3869-4588-8f58-a708cded345f None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:13.057189 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dbaf90e9-3869-4588-8f58-a708cded345f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:13.093381 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-45b98c3c-21b7-409b-9e9d-101e0c41f91b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:13.108115 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dbaf90e9-3869-4588-8f58-a708cded345f None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:13.111409 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-dbaf90e9-3869-4588-8f58-a708cded345f None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:13.115562 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dbaf90e9-3869-4588-8f58-a708cded345f None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:43:13.128933 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-40651571-c780-424b-817b-25fc844b26fe req-7c29af58-80b3-401d-8857-57b4805ef377 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Deleting port 5df02334-3682-4a91-b22d-133fa1bcb473 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:43:13.129311 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-40651571-c780-424b-817b-25fc844b26fe req-7c29af58-80b3-401d-8857-57b4805ef377 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:13.130182 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbaf90e9-3869-4588-8f58-a708cded345f None None] Pushing event updated for resources: {'Port': ['ID=7b3387a1-3493-4893-9e2c-5b05817a191a,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:13.146138 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7a6e48a-5712-430f-acf4-50880944aeeb req-a279ed3c-1f72-4b98-9da9-e15174af29a8 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/security-groups?id=aa1e3507-1069-4293-bda7-11f629ade927&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1772308 Dec 09 21:43:13.166602 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-45b98c3c-21b7-409b-9e9d-101e0c41f91b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] device_id is not set on port c1635861-d959-441d-b18e-57c3159ba99f yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:43:13.212927 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-dbaf90e9-3869-4588-8f58-a708cded345f None None] Attempting to bind port 7b3387a1-3493-4893-9e2c-5b05817a191a on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:43:13.213452 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-dbaf90e9-3869-4588-8f58-a708cded345f None None] Attempting to bind port 7b3387a1-3493-4893-9e2c-5b05817a191a by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:43:13.213906 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbaf90e9-3869-4588-8f58-a708cded345f None None] Attempting to bind port 7b3387a1-3493-4893-9e2c-5b05817a191a on network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:43:13.220628 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbaf90e9-3869-4588-8f58-a708cded345f None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 43, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:43:13.221624 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbaf90e9-3869-4588-8f58-a708cded345f None None] Checking segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:43:13.221624 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dbaf90e9-3869-4588-8f58-a708cded345f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:13.222211 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dbaf90e9-3869-4588-8f58-a708cded345f None None] Bound using segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:43:13.222773 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-dbaf90e9-3869-4588-8f58-a708cded345f None None] Bound port: 7b3387a1-3493-4893-9e2c-5b05817a191a, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:43:13.223261 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dbaf90e9-3869-4588-8f58-a708cded345f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:13.346595 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-c462c2dd-6367-4b0e-9eec-35d356de784c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:43:13.354566 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-dbaf90e9-3869-4588-8f58-a708cded345f None None] For port 7b3387a1-3493-4893-9e2c-5b05817a191a, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:43:13.365714 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-c462c2dd-6367-4b0e-9eec-35d356de784c service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:13.369082 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-dbaf90e9-3869-4588-8f58-a708cded345f None None] For port 7b3387a1-3493-4893-9e2c-5b05817a191a, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7b3387a1-3493-4893-9e2c-5b05817a191a,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:43:13.377996 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dbaf90e9-3869-4588-8f58-a708cded345f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:13.393620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c1f2a06-a991-46a3-a3bd-13ad444202ea req-779856d2-bea2-4193-92ed-116885b65998 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:13.401541 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c1f2a06-a991-46a3-a3bd-13ad444202ea req-779856d2-bea2-4193-92ed-116885b65998 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/ports?device_id=6817b8ca-c51a-46d0-8c87-3cf63d444459 HTTP/1.1" status: 200 len: 932 time: 0.1087174 Dec 09 21:43:13.404429 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-c462c2dd-6367-4b0e-9eec-35d356de784c service neutron] Transition to ACTIVE for port object 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:43:13.436749 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-c462c2dd-6367-4b0e-9eec-35d356de784c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:13.485195 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbaf90e9-3869-4588-8f58-a708cded345f None None] Pushing event updated for resources: {'Port': ['ID=7b3387a1-3493-4893-9e2c-5b05817a191a,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:13.514229 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-45b98c3c-21b7-409b-9e9d-101e0c41f91b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8::f816:3eff:fed6:4664 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/cb982511-19f0-492e-9b00-ffe000f9f935/c1635861-d959-441d-b18e-57c3159ba99f) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:13.549814 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c1f2a06-a991-46a3-a3bd-13ad444202ea req-d1bb8776-10ca-47a4-bd1e-890e63e7cd85 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/security-groups?id=f7ac2409-fc2d-46c4-9c5c-d8bca8738561&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1473825 Dec 09 21:43:13.590400 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-40651571-c780-424b-817b-25fc844b26fe req-7c29af58-80b3-401d-8857-57b4805ef377 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] For port 5df02334-3682-4a91-b22d-133fa1bcb473, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=5df02334-3682-4a91-b22d-133fa1bcb473,segment=NetworkSegment(fbdfbe70-d844-485b-ae9b-b09d060fd481),segment_id=fbdfbe70-d844-485b-ae9b-b09d060fd481)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:13.590769 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-40651571-c780-424b-817b-25fc844b26fe req-7c29af58-80b3-401d-8857-57b4805ef377 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:13.611670 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-40651571-c780-424b-817b-25fc844b26fe req-7c29af58-80b3-401d-8857-57b4805ef377 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Calling delete_port for 5df02334-3682-4a91-b22d-133fa1bcb473 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:43:13.620547 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c462c2dd-6367-4b0e-9eec-35d356de784c service neutron] Pushing event updated for resources: {'Port': ['ID=6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:13.745378 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-c462c2dd-6367-4b0e-9eec-35d356de784c service neutron] Attempting to bind port 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:43:13.745378 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-c462c2dd-6367-4b0e-9eec-35d356de784c service neutron] Attempting to bind port 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'd82da970-cb23-48b1-8606-d6809e0c864c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '7104ce0f-c225-47d9-9c49-c01b517dbac9'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:43:13.745378 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-c462c2dd-6367-4b0e-9eec-35d356de784c service neutron] Attempting to bind port 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60 on network 7104ce0f-c225-47d9-9c49-c01b517dbac9 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:43:13.782104 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-c462c2dd-6367-4b0e-9eec-35d356de784c service neutron] Port 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60 on network 7104ce0f-c225-47d9-9c49-c01b517dbac9 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:43:13.782954 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-c462c2dd-6367-4b0e-9eec-35d356de784c service neutron] Attempting to bind port 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60 on network 7104ce0f-c225-47d9-9c49-c01b517dbac9 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:43:13.798895 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-c462c2dd-6367-4b0e-9eec-35d356de784c service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 42, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:43:13.814431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-c462c2dd-6367-4b0e-9eec-35d356de784c service neutron] Checking segment: {'id': 'd82da970-cb23-48b1-8606-d6809e0c864c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '7104ce0f-c225-47d9-9c49-c01b517dbac9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:43:13.814431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-c462c2dd-6367-4b0e-9eec-35d356de784c service neutron] Bound using segment: {'id': 'd82da970-cb23-48b1-8606-d6809e0c864c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '7104ce0f-c225-47d9-9c49-c01b517dbac9'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:43:13.814431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-c462c2dd-6367-4b0e-9eec-35d356de784c service neutron] Bound port: 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd82da970-cb23-48b1-8606-d6809e0c864c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '7104ce0f-c225-47d9-9c49-c01b517dbac9'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:43:13.814431 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-c462c2dd-6367-4b0e-9eec-35d356de784c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:13.960387 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-45b98c3c-21b7-409b-9e9d-101e0c41f91b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:13.961204 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-c462c2dd-6367-4b0e-9eec-35d356de784c service neutron] For port 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:43:13.983811 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-c462c2dd-6367-4b0e-9eec-35d356de784c service neutron] For port 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60,segment=NetworkSegment(d82da970-cb23-48b1-8606-d6809e0c864c),segment_id=d82da970-cb23-48b1-8606-d6809e0c864c)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:43:13.994848 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-c462c2dd-6367-4b0e-9eec-35d356de784c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:14.030953 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-40651571-c780-424b-817b-25fc844b26fe req-7c29af58-80b3-401d-8857-57b4805ef377 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:14.043075 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-c462c2dd-6367-4b0e-9eec-35d356de784c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:14.044136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['5df02334-3682-4a91-b22d-133fa1bcb473'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:43:14.044701 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-c462c2dd-6367-4b0e-9eec-35d356de784c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:14.046276 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-c462c2dd-6367-4b0e-9eec-35d356de784c service neutron] 10.222.0.31 "PUT /v2.0/ports/6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60 HTTP/1.1" status: 200 len: 1093 time: 1.5610538 Dec 09 21:43:14.046898 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6817b8ca-c51a-46d0-8c87-3cf63d444459', 'tag': '6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:43:14.049953 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9a1c5e9d-aa58-4abf-8e24-48f3bf96636c" -d '{"events": [{"name": "network-changed", "server_uuid": "6817b8ca-c51a-46d0-8c87-3cf63d444459", "tag": "6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:43:14.077661 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-45b98c3c-21b7-409b-9e9d-101e0c41f91b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:14.084595 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c29af58-80b3-401d-8857-57b4805ef377 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Pushing event deleted for resources: {'Port': ['ID=5df02334-3682-4a91-b22d-133fa1bcb473,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:14.088725 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c462c2dd-6367-4b0e-9eec-35d356de784c service neutron] Pushing event updated for resources: {'Port': ['ID=6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:14.135073 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:43:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cdda89fb-38ca-40c0-9111-c8562ff552bb x-openstack-request-id: req-cdda89fb-38ca-40c0-9111-c8562ff552bb {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:43:14.135987 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6817b8ca-c51a-46d0-8c87-3cf63d444459", "tag": "6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:43:14.136235 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-cdda89fb-38ca-40c0-9111-c8562ff552bb {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:43:14.136642 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6817b8ca-c51a-46d0-8c87-3cf63d444459', 'tag': '6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60', 'status': 'completed', 'code': 200} Dec 09 21:43:14.138612 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9bb6d9a5-0698-4209-9d57-308c049e2b01 None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:43:14.151461 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-be456eb0-8fa1-414f-9632-8fb3ada88913 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:14.153118 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-be456eb0-8fa1-414f-9632-8fb3ada88913 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=f832d472c11f4b9090837d07f510849a&device_id=6817b8ca-c51a-46d0-8c87-3cf63d444459 HTTP/1.1" status: 200 len: 1096 time: 0.0607624 Dec 09 21:43:14.219153 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-45b98c3c-21b7-409b-9e9d-101e0c41f91b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:14.221295 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-40651571-c780-424b-817b-25fc844b26fe req-7c29af58-80b3-401d-8857-57b4805ef377 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] No DVR routers for this DVR port 5df02334-3682-4a91-b22d-133fa1bcb473 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:43:14.224095 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-fa4d21ed-70e1-41f2-9c24-dbab9f6408cc service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60 HTTP/1.1" status: 200 len: 217 time: 0.0594404 Dec 09 21:43:14.224409 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-40651571-c780-424b-817b-25fc844b26fe req-7c29af58-80b3-401d-8857-57b4805ef377 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:14.228357 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-40651571-c780-424b-817b-25fc844b26fe req-7c29af58-80b3-401d-8857-57b4805ef377 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.31 "DELETE /v2.0/ports/5df02334-3682-4a91-b22d-133fa1bcb473 HTTP/1.1" status: 204 len: 173 time: 1.4894712 Dec 09 21:43:14.232161 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-45b98c3c-21b7-409b-9e9d-101e0c41f91b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:14.235283 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45b98c3c-21b7-409b-9e9d-101e0c41f91b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:43:14.241147 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-45b98c3c-21b7-409b-9e9d-101e0c41f91b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:14.241777 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-45b98c3c-21b7-409b-9e9d-101e0c41f91b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:14.253945 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1faa187b-0441-47d3-8d37-6489d51928bb', 'name': 'network-vif-deleted', 'tag': '5df02334-3682-4a91-b22d-133fa1bcb473'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:43:14.256732 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-87169ba2-978a-4907-81c3-d6e984a24b15" -d '{"events": [{"server_uuid": "1faa187b-0441-47d3-8d37-6489d51928bb", "name": "network-vif-deleted", "tag": "5df02334-3682-4a91-b22d-133fa1bcb473"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:43:14.263219 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45b98c3c-21b7-409b-9e9d-101e0c41f91b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=c1635861-d959-441d-b18e-57c3159ba99f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:14.276045 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-45b98c3c-21b7-409b-9e9d-101e0c41f91b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 948 time: 1.8283348 Dec 09 21:43:14.280176 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37404) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:14.354897 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-332ee0fa-0275-4c0a-9b63-c574029c9ada req-568294c0-c2dd-40c6-a22c-2da08e9a6d16 tempest-ServersTestJSON-1081323119 tempest-ServersTestJSON-1081323119-project] 10.222.0.13 "GET /v2.0/ports?device_id=1faa187b-0441-47d3-8d37-6489d51928bb HTTP/1.1" status: 200 len: 210 time: 0.0895104 Dec 09 21:43:14.399868 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17ed6038-3bcb-4dc0-a954-4aa275c228cf tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:14.402962 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-a01e7e34-f0cb-433a-bd19-6955e3e7716c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:14.404664 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-a01e7e34-f0cb-433a-bd19-6955e3e7716c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=f1d3a5cf-34a0-4be7-b1d4-5dfaca5a6107 HTTP/1.1" status: 200 len: 848 time: 0.1545529 Dec 09 21:43:14.409613 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17ed6038-3bcb-4dc0-a954-4aa275c228cf tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:14.414021 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37406) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:14.418358 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-17ed6038-3bcb-4dc0-a954-4aa275c228cf tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1703 time: 0.1365407 Dec 09 21:43:14.490373 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7b3387a1-3493-4893-9e2c-5b05817a191a up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:43:14.613086 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-c9cabd66-5a2d-48a5-9194-40ce885f5e5b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=7104ce0f-c225-47d9-9c49-c01b517dbac9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1697736 Dec 09 21:43:14.631532 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:43:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5990b8ea-f25e-48b9-9583-c48828d5cef1 x-openstack-request-id: req-5990b8ea-f25e-48b9-9583-c48828d5cef1 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:43:14.631900 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1faa187b-0441-47d3-8d37-6489d51928bb", "name": "network-vif-deleted", "tag": "5df02334-3682-4a91-b22d-133fa1bcb473", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:43:14.632191 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-5990b8ea-f25e-48b9-9583-c48828d5cef1 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:43:14.633759 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1faa187b-0441-47d3-8d37-6489d51928bb', 'name': 'network-vif-deleted', 'tag': '5df02334-3682-4a91-b22d-133fa1bcb473', 'status': 'completed', 'code': 200} Dec 09 21:43:14.693727 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 7b3387a1-3493-4893-9e2c-5b05817a191a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:14.694088 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:14.825033 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-168be9a1-0153-463f-9037-17f3b98a7d7b service neutron] 10.222.0.31 "GET /v2.0/networks/7104ce0f-c225-47d9-9c49-c01b517dbac9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2010422 Dec 09 21:43:14.839036 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:14.892584 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 7b3387a1-3493-4893-9e2c-5b05817a191a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7b3387a1-3493-4893-9e2c-5b05817a191a,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:14.901984 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:14.952636 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-08eb855a-217a-4e3a-8f5e-ede71008ebaa tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting port c1635861-d959-441d-b18e-57c3159ba99f {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:43:14.953081 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-08eb855a-217a-4e3a-8f5e-ede71008ebaa tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:14.986204 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=7b3387a1-3493-4893-9e2c-5b05817a191a,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:14.992293 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce278bb-c1a7-43fb-a4ea-947b2c915190 req-5d7ac8f2-1410-434d-a62f-74338833492f tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:14.993949 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ce278bb-c1a7-43fb-a4ea-947b2c915190 req-5d7ac8f2-1410-434d-a62f-74338833492f tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/ports?device_id=6817b8ca-c51a-46d0-8c87-3cf63d444459 HTTP/1.1" status: 200 len: 944 time: 0.2131793 Dec 09 21:43:15.108639 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b4da2ce-4164-49fa-bd73-0450d31ffbd8 req-0f9c2713-0e11-424a-b013-217ba7192590 service neutron] 10.222.0.31 "GET /v2.0/networks/7104ce0f-c225-47d9-9c49-c01b517dbac9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2614329 Dec 09 21:43:15.134048 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ce278bb-c1a7-43fb-a4ea-947b2c915190 req-4757568f-6083-4ff8-82d7-4019ec3d9131 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/security-groups?id=f7ac2409-fc2d-46c4-9c5c-d8bca8738561&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1251066 Dec 09 21:43:15.142891 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-08eb855a-217a-4e3a-8f5e-ede71008ebaa tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:15.172728 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-08eb855a-217a-4e3a-8f5e-ede71008ebaa tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Calling delete_port for c1635861-d959-441d-b18e-57c3159ba99f owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:43:15.196261 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c4ed38a3-4211-4d72-8787-28c08b3ef41f None None] Provisioning complete for port 7b3387a1-3493-4893-9e2c-5b05817a191a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:15.196802 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c4ed38a3-4211-4d72-8787-28c08b3ef41f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:15.347627 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a1c5e9d-aa58-4abf-8e24-48f3bf96636c req-725fe9ed-4c96-4367-838b-6f020790a5ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:15.349411 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a1c5e9d-aa58-4abf-8e24-48f3bf96636c req-725fe9ed-4c96-4367-838b-6f020790a5ef service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=f832d472c11f4b9090837d07f510849a&device_id=6817b8ca-c51a-46d0-8c87-3cf63d444459 HTTP/1.1" status: 200 len: 1096 time: 0.1518624 Dec 09 21:43:15.458900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37428) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:15.491060 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-08eb855a-217a-4e3a-8f5e-ede71008ebaa tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:15.534760 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a1c5e9d-aa58-4abf-8e24-48f3bf96636c req-9f8dbe4a-1cf2-491b-8fed-cb2296f0dbbe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:15.536493 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a1c5e9d-aa58-4abf-8e24-48f3bf96636c req-9f8dbe4a-1cf2-491b-8fed-cb2296f0dbbe service neutron] 10.222.0.31 "GET /v2.0/networks?id=7104ce0f-c225-47d9-9c49-c01b517dbac9 HTTP/1.1" status: 200 len: 909 time: 0.1794610 Dec 09 21:43:15.537618 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08eb855a-217a-4e3a-8f5e-ede71008ebaa tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Port': ['ID=c1635861-d959-441d-b18e-57c3159ba99f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:15.575503 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8935ffd9-0fce-474e-aa4c-2dc7e1057130 None None] Could not find standard attr ID for object c1635861-d959-441d-b18e-57c3159ba99f. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:43:15.576172 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-64fbff4d-ed43-4643-98a5-931d37cf6ac3 admin admin] Deleting subnet b61ac70f-1e8d-40a8-9031-bab15f73fa0a {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:43:15.595021 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-64fbff4d-ed43-4643-98a5-931d37cf6ac3 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:15.606408 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a1c5e9d-aa58-4abf-8e24-48f3bf96636c req-0394af93-db17-469e-805e-a8f13e4213f9 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60 HTTP/1.1" status: 200 len: 217 time: 0.0616302 Dec 09 21:43:15.609468 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-08eb855a-217a-4e3a-8f5e-ede71008ebaa tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:15.612962 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-08eb855a-217a-4e3a-8f5e-ede71008ebaa tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/c1635861-d959-441d-b18e-57c3159ba99f HTTP/1.1" status: 204 len: 168 time: 1.1976736 Dec 09 21:43:15.620685 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37432) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:15.668589 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a1c5e9d-aa58-4abf-8e24-48f3bf96636c req-476abb8f-f916-4ef0-865a-98917b41629c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:15.670415 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a1c5e9d-aa58-4abf-8e24-48f3bf96636c req-476abb8f-f916-4ef0-865a-98917b41629c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=f1d3a5cf-34a0-4be7-b1d4-5dfaca5a6107 HTTP/1.1" status: 200 len: 848 time: 0.0559144 Dec 09 21:43:15.693781 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-64fbff4d-ed43-4643-98a5-931d37cf6ac3 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:15.710223 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a1c5e9d-aa58-4abf-8e24-48f3bf96636c req-453b95b2-0a87-4364-a2ce-b3d7151f959f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=7104ce0f-c225-47d9-9c49-c01b517dbac9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0310252 Dec 09 21:43:15.732687 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d6e6beb8-2473-4f3e-a23e-d8c47ced4c18 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:15.734461 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d6e6beb8-2473-4f3e-a23e-d8c47ced4c18 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:15.736403 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d6e6beb8-2473-4f3e-a23e-d8c47ced4c18 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1144993 Dec 09 21:43:15.738923 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37436) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:15.799840 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-64fbff4d-ed43-4643-98a5-931d37cf6ac3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:15.857968 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-6de86c8a-2660-4cec-b1ed-2f91d64ff76e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet cb982511-19f0-492e-9b00-ffe000f9f935 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:43:15.865262 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6de86c8a-2660-4cec-b1ed-2f91d64ff76e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:15.890031 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a1c5e9d-aa58-4abf-8e24-48f3bf96636c req-97dcfe50-11dc-4a6a-9d73-fa5c476cc069 service neutron] 10.222.0.31 "GET /v2.0/networks/7104ce0f-c225-47d9-9c49-c01b517dbac9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1705079 Dec 09 21:43:15.927333 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6de86c8a-2660-4cec-b1ed-2f91d64ff76e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:15.997766 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a1c5e9d-aa58-4abf-8e24-48f3bf96636c req-e6cf7aea-8e95-415e-85aa-2c1949672325 service neutron] 10.222.0.31 "GET /v2.0/networks/7104ce0f-c225-47d9-9c49-c01b517dbac9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0991452 Dec 09 21:43:16.024125 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-64fbff4d-ed43-4643-98a5-931d37cf6ac3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:16.062132 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64fbff4d-ed43-4643-98a5-931d37cf6ac3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b61ac70f-1e8d-40a8-9031-bab15f73fa0a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:16.066910 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-64fbff4d-ed43-4643-98a5-931d37cf6ac3 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:16.069943 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-64fbff4d-ed43-4643-98a5-931d37cf6ac3 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/b61ac70f-1e8d-40a8-9031-bab15f73fa0a HTTP/1.1" status: 204 len: 168 time: 0.6091857 Dec 09 21:43:16.071313 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fdb4a7c1-a9f9-40a2-a0f5-24ab6af43510 None None] Network ba3aee78-4661-4c71-9b18-af1e6a07faff requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:16.074569 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37442) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:16.081966 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6de86c8a-2660-4cec-b1ed-2f91d64ff76e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:16.202092 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6db9932a-18bb-433e-89c0-713f1c87aaf7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:16.210457 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e81172a-545d-4004-a9a7-36d9dc52310b None None] DHCP port deletion for ba3aee78-4661-4c71-9b18-af1e6a07faff request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:43:16.242774 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6de86c8a-2660-4cec-b1ed-2f91d64ff76e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:16.285629 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6de86c8a-2660-4cec-b1ed-2f91d64ff76e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=cb982511-19f0-492e-9b00-ffe000f9f935,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:16.299519 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6de86c8a-2660-4cec-b1ed-2f91d64ff76e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:16.305121 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6de86c8a-2660-4cec-b1ed-2f91d64ff76e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/cb982511-19f0-492e-9b00-ffe000f9f935 HTTP/1.1" status: 204 len: 168 time: 0.5629976 Dec 09 21:43:16.305575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37454) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:16.309037 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49ea9ad5-be08-42af-8fd2-2de60f947847 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:16.335682 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6db9932a-18bb-433e-89c0-713f1c87aaf7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:16.397458 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-6db9932a-18bb-433e-89c0-713f1c87aaf7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ba3aee78-4661-4c71-9b18-af1e6a07faff']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:43:16.426453 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-6db9932a-18bb-433e-89c0-713f1c87aaf7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fbdfbe70-d844-485b-ae9b-b09d060fd481') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:43:16.427315 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-6db9932a-18bb-433e-89c0-713f1c87aaf7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fbdfbe70-d844-485b-ae9b-b09d060fd481') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:43:16.432880 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-66b3f37c-f823-466a-b6de-9ac59ca68ef4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.1238079 Dec 09 21:43:16.433829 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37456) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:16.445134 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6db9932a-18bb-433e-89c0-713f1c87aaf7 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:16.452589 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7b3387a1-3493-4893-9e2c-5b05817a191a up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:43:16.474303 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6db9932a-18bb-433e-89c0-713f1c87aaf7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:16.484512 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6db9932a-18bb-433e-89c0-713f1c87aaf7 admin admin] Releasing vlan 124 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:43:16.484921 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6db9932a-18bb-433e-89c0-713f1c87aaf7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/neutron_lib/db/model_query.py:331: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: items = [ Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:43:16.504705 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:43:16.515607 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d4be95b-c2ca-4c56-bcc4-39dea8849521 req-8dff72ca-a218-4019-9dde-38bdc7face3b tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:16.517625 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1d4be95b-c2ca-4c56-bcc4-39dea8849521 req-8dff72ca-a218-4019-9dde-38bdc7face3b tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/ports?device_id=6817b8ca-c51a-46d0-8c87-3cf63d444459 HTTP/1.1" status: 200 len: 944 time: 0.0857093 Dec 09 21:43:16.526674 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1a8f3328-6313-4197-b8de-d5c42647e396 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:16.533204 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1a8f3328-6313-4197-b8de-d5c42647e396 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.0915458 Dec 09 21:43:16.537262 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37460) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:16.556032 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 7b3387a1-3493-4893-9e2c-5b05817a191a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:16.556699 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:16.630066 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6db9932a-18bb-433e-89c0-713f1c87aaf7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:16.642901 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f565a806-b4aa-44eb-a6bc-65750cb7dd4a None None] DHCP port deletion for 77d1c069-bca4-4157-a30b-fb10cbd9d9ee request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:43:16.663095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bd29f057-083b-4bc3-8793-a77e52b76715 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:16.664808 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bd29f057-083b-4bc3-8793-a77e52b76715 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.1173370 Dec 09 21:43:16.667977 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37464) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:16.680333 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1d4be95b-c2ca-4c56-bcc4-39dea8849521 req-15f010f3-8c65-4c79-ae9c-91d13a20a506 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/security-groups?id=f7ac2409-fc2d-46c4-9c5c-d8bca8738561&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1443367 Dec 09 21:43:16.682713 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6db9932a-18bb-433e-89c0-713f1c87aaf7 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:16.703670 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6db9932a-18bb-433e-89c0-713f1c87aaf7 admin admin] 10.222.0.13 "DELETE /v2.0/networks/ba3aee78-4661-4c71-9b18-af1e6a07faff HTTP/1.1" status: 204 len: 168 time: 0.6279445 Dec 09 21:43:16.706118 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6db9932a-18bb-433e-89c0-713f1c87aaf7 admin admin] Pushing event deleted for resources: {'Network': ['ID=ba3aee78-4661-4c71-9b18-af1e6a07faff,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:16.718746 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-51dd821b-61db-4acd-85a5-059d7aa42e0b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0495765 Dec 09 21:43:16.723759 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37470) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:16.734667 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-17b7774c-eaff-4746-8cc7-012646627b8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'slaac'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:16.921714 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-17b7774c-eaff-4746-8cc7-012646627b8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:16.926594 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-17b7774c-eaff-4746-8cc7-012646627b8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:16.945457 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37476) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:17.017636 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-54b4d592-1660-40b4-8946-2ad84613c415 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=0569bc74c98b4ae2980de7af929e97eb&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0711358 Dec 09 21:43:17.021055 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37478) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:17.091530 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a6376c9b-421a-474d-8124-68f36ebe2728 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:17.094101 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f565a806-b4aa-44eb-a6bc-65750cb7dd4a None None] Deleting port 7b3387a1-3493-4893-9e2c-5b05817a191a {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:43:17.094291 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f565a806-b4aa-44eb-a6bc-65750cb7dd4a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:17.117667 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a6376c9b-421a-474d-8124-68f36ebe2728 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:17.178178 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f565a806-b4aa-44eb-a6bc-65750cb7dd4a None None] For port 7b3387a1-3493-4893-9e2c-5b05817a191a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7b3387a1-3493-4893-9e2c-5b05817a191a,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:17.178683 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f565a806-b4aa-44eb-a6bc-65750cb7dd4a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:17.179980 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a6376c9b-421a-474d-8124-68f36ebe2728 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:17.183358 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a6376c9b-421a-474d-8124-68f36ebe2728 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:17.184810 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a6376c9b-421a-474d-8124-68f36ebe2728 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/aa1e3507-1069-4293-bda7-11f629ade927 HTTP/1.1" status: 204 len: 168 time: 0.1620507 Dec 09 21:43:17.198294 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6376c9b-421a-474d-8124-68f36ebe2728 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa1e3507-1069-4293-bda7-11f629ade927,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:17.213567 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f565a806-b4aa-44eb-a6bc-65750cb7dd4a None None] Calling delete_port for 7b3387a1-3493-4893-9e2c-5b05817a191a owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:43:17.333595 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f565a806-b4aa-44eb-a6bc-65750cb7dd4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:17.354894 n-d-713301-27 neutron-server[103438]: DEBUG neutron.objects.ports [None req-17b7774c-eaff-4746-8cc7-012646627b8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=103438) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 09 21:43:17.399187 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f565a806-b4aa-44eb-a6bc-65750cb7dd4a None None] Pushing event deleted for resources: {'Port': ['ID=7b3387a1-3493-4893-9e2c-5b05817a191a,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:17.401224 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f565a806-b4aa-44eb-a6bc-65750cb7dd4a None None] No DVR routers for this DVR port 7b3387a1-3493-4893-9e2c-5b05817a191a on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:43:17.539408 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:43:17.543206 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 5df02334-3682-4a91-b22d-133fa1bcb473 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:43:17.561194 n-d-713301-27 neutron-server[103438]: WARNING neutron.services.revisions.revision_plugin [None req-17b7774c-eaff-4746-8cc7-012646627b8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Could not find related port for resource to bump revision. Dec 09 21:43:17.575517 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 5df02334-3682-4a91-b22d-133fa1bcb473 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:43:17.575868 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 5df02334-3682-4a91-b22d-133fa1bcb473 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:43:17.576023 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.ipam_pluggable_backend [None req-17b7774c-eaff-4746-8cc7-012646627b8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Port 7b3387a1-3493-4893-9e2c-5b05817a191a was deleted while updating it with an IPv6 auto-address. Ignoring. {{(pid=103438) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:573}} Dec 09 21:43:17.577337 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.ipam_pluggable_backend [None req-17b7774c-eaff-4746-8cc7-012646627b8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Reverting IP allocation for 2001:db8::f816:3eff:fe57:4b8a {{(pid=103438) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:575}} Dec 09 21:43:17.586277 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.ipam_pluggable_backend [None req-17b7774c-eaff-4746-8cc7-012646627b8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Reverting IP allocation failed for 2001:db8::f816:3eff:fe57:4b8a {{(pid=103438) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:581}} Dec 09 21:43:17.589037 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-17b7774c-eaff-4746-8cc7-012646627b8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:17.636455 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-17b7774c-eaff-4746-8cc7-012646627b8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:17.688205 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17b7774c-eaff-4746-8cc7-012646627b8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=df5c3238-287e-4140-b9e2-7176b28a25de,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:17.691126 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-17b7774c-eaff-4746-8cc7-012646627b8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:17.694566 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17b7774c-eaff-4746-8cc7-012646627b8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:17.695744 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-17b7774c-eaff-4746-8cc7-012646627b8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:17.747997 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-17b7774c-eaff-4746-8cc7-012646627b8a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 824 time: 1.0222044 Dec 09 21:43:17.749778 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37510) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:17.755969 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-0f44d821-88f4-4cc4-95a6-72bfb26b74c5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'mac_address': 'fa:16:3e:cf:57:a9', 'name': 'tempest-NetworksTestDHCPv6-273734208'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:17.814000 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53ec37c2-c6c7-4a2a-84fd-ab022bdbdd7a None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:17.923774 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-678f3fa4-197e-4cd8-af22-6e691adcd25e req-eda88cdb-a147-4ce0-84bf-b08f1327d26e tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:17.934343 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-678f3fa4-197e-4cd8-af22-6e691adcd25e req-eda88cdb-a147-4ce0-84bf-b08f1327d26e tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/ports?device_id=6817b8ca-c51a-46d0-8c87-3cf63d444459 HTTP/1.1" status: 200 len: 944 time: 0.0878026 Dec 09 21:43:17.993834 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60,segment=NetworkSegment(d82da970-cb23-48b1-8606-d6809e0c864c),segment_id=d82da970-cb23-48b1-8606-d6809e0c864c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:18.024279 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-678f3fa4-197e-4cd8-af22-6e691adcd25e req-c666db1e-067a-4c1a-a27e-653779d37caf tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/security-groups?id=f7ac2409-fc2d-46c4-9c5c-d8bca8738561&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0885520 Dec 09 21:43:18.048641 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60', 'network_id': '7104ce0f-c225-47d9-9c49-c01b517dbac9', 'port_id': '6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60', 'mac_address': 'fa:16:3e:55:5e:60', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 126, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f1d3a5cf-34a0-4be7-b1d4-5dfaca5a6107', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:43:18.064844 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0f44d821-88f4-4cc4-95a6-72bfb26b74c5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:18.069838 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0f44d821-88f4-4cc4-95a6-72bfb26b74c5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:18.098766 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3dcf329e-4ef0-47d0-a03e-4ee646520670 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'fixed_ips': [{'subnet_id': 'df5c3238-287e-4140-b9e2-7176b28a25de'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:43:18.099677 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3dcf329e-4ef0-47d0-a03e-4ee646520670 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:18.124741 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-0f44d821-88f4-4cc4-95a6-72bfb26b74c5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] device_id is not set on port c3b5994c-2c6a-43c3-97d9-b4aa49cbf7ff yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:43:18.294339 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-0f44d821-88f4-4cc4-95a6-72bfb26b74c5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8::f816:3eff:fecf:57a9 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/df5c3238-287e-4140-b9e2-7176b28a25de/c3b5994c-2c6a-43c3-97d9-b4aa49cbf7ff) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:18.370571 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:18.397076 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:43:18.448158 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60,segment=NetworkSegment(d82da970-cb23-48b1-8606-d6809e0c864c),segment_id=d82da970-cb23-48b1-8606-d6809e0c864c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:18.452225 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7b3387a1-3493-4893-9e2c-5b05817a191a no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:43:18.458867 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:18.559146 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:18.561955 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 7b3387a1-3493-4893-9e2c-5b05817a191a {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:43:18.562325 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7b3387a1-3493-4893-9e2c-5b05817a191a not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:43:18.646571 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0f44d821-88f4-4cc4-95a6-72bfb26b74c5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:18.667640 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37532) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:18.692818 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:43:18.700977 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0f44d821-88f4-4cc4-95a6-72bfb26b74c5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:18.753926 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f44d821-88f4-4cc4-95a6-72bfb26b74c5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:18.765305 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-0f44d821-88f4-4cc4-95a6-72bfb26b74c5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:18.769067 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f44d821-88f4-4cc4-95a6-72bfb26b74c5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:43:18.780859 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f44d821-88f4-4cc4-95a6-72bfb26b74c5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:18.783619 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0f44d821-88f4-4cc4-95a6-72bfb26b74c5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:18.817116 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f44d821-88f4-4cc4-95a6-72bfb26b74c5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=c3b5994c-2c6a-43c3-97d9-b4aa49cbf7ff,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:18.848050 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0f44d821-88f4-4cc4-95a6-72bfb26b74c5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 1.0962920 Dec 09 21:43:18.850662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37540) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:18.865486 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-009929fb-2619-40ae-9480-21446aecd7d0 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-993120407-network', 'tenant_id': '6f2bd57ebcdc4c748e719519e3961b70'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:18.875268 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-3dcf329e-4ef0-47d0-a03e-4ee646520670 None None] Allocated IP 2001:db8::f816:3eff:fe5e:fb71 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/df5c3238-287e-4140-b9e2-7176b28a25de/d461bdfb-fc62-4353-be77-8a3bfc4b9ed3) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:18.933796 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-009929fb-2619-40ae-9480-21446aecd7d0 admin admin] Made reservation on behalf of 6f2bd57ebcdc4c748e719519e3961b70 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:18.936418 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-009929fb-2619-40ae-9480-21446aecd7d0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:18.948388 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-009929fb-2619-40ae-9480-21446aecd7d0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:18.961197 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dfddce19-f333-4813-a826-464f56e222b3 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:18.963060 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-dfddce19-f333-4813-a826-464f56e222b3 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 945 time: 0.1114802 Dec 09 21:43:18.965828 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37542) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:19.098790 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-41136d58-b47c-45fd-be50-71c71ef66f54 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting port c3b5994c-2c6a-43c3-97d9-b4aa49cbf7ff {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:43:19.099189 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-41136d58-b47c-45fd-be50-71c71ef66f54 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:19.106162 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3dcf329e-4ef0-47d0-a03e-4ee646520670 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:19.121294 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3dcf329e-4ef0-47d0-a03e-4ee646520670 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:19.185712 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-009929fb-2619-40ae-9480-21446aecd7d0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:19.197648 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-009929fb-2619-40ae-9480-21446aecd7d0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:19.212650 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3dcf329e-4ef0-47d0-a03e-4ee646520670 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:19.217316 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-3dcf329e-4ef0-47d0-a03e-4ee646520670 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:19.229252 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3dcf329e-4ef0-47d0-a03e-4ee646520670 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:43:19.244175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-009929fb-2619-40ae-9480-21446aecd7d0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=14413c7b-f8bd-4bb0-a866-2528c928f8fa,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:19.260474 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-009929fb-2619-40ae-9480-21446aecd7d0 admin admin] vlan segment allocate from pool success with {'vlan_id': 125, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:43:19.279194 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-009929fb-2619-40ae-9480-21446aecd7d0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:19.279716 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-009929fb-2619-40ae-9480-21446aecd7d0 admin admin] Added segment 0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5 of type vlan for network eda4cb39-afde-43d7-a13b-5227cc6862dd Dec 09 21:43:19.304466 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dcf329e-4ef0-47d0-a03e-4ee646520670 None None] Pushing event updated for resources: {'Port': ['ID=d461bdfb-fc62-4353-be77-8a3bfc4b9ed3,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:19.305311 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f151859-314d-435a-932f-095f5ba408e5 req-2e5654c1-e3d5-4d71-b9da-794f730b776b tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:19.307227 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0f151859-314d-435a-932f-095f5ba408e5 req-2e5654c1-e3d5-4d71-b9da-794f730b776b tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/ports?device_id=6817b8ca-c51a-46d0-8c87-3cf63d444459 HTTP/1.1" status: 200 len: 945 time: 0.1392899 Dec 09 21:43:19.319661 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-41136d58-b47c-45fd-be50-71c71ef66f54 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:19.333978 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-3dcf329e-4ef0-47d0-a03e-4ee646520670 None None] Attempting to bind port d461bdfb-fc62-4353-be77-8a3bfc4b9ed3 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:43:19.334353 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-3dcf329e-4ef0-47d0-a03e-4ee646520670 None None] Attempting to bind port d461bdfb-fc62-4353-be77-8a3bfc4b9ed3 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:43:19.335402 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3dcf329e-4ef0-47d0-a03e-4ee646520670 None None] Attempting to bind port d461bdfb-fc62-4353-be77-8a3bfc4b9ed3 on network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:43:19.344593 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3dcf329e-4ef0-47d0-a03e-4ee646520670 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 43, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:43:19.347959 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3dcf329e-4ef0-47d0-a03e-4ee646520670 None None] Checking segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:43:19.348393 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3dcf329e-4ef0-47d0-a03e-4ee646520670 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:19.348797 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3dcf329e-4ef0-47d0-a03e-4ee646520670 None None] Bound using segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:43:19.349286 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-3dcf329e-4ef0-47d0-a03e-4ee646520670 None None] Bound port: d461bdfb-fc62-4353-be77-8a3bfc4b9ed3, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:43:19.349819 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3dcf329e-4ef0-47d0-a03e-4ee646520670 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:19.351947 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-41136d58-b47c-45fd-be50-71c71ef66f54 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Calling delete_port for c3b5994c-2c6a-43c3-97d9-b4aa49cbf7ff owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:43:19.430371 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-3dcf329e-4ef0-47d0-a03e-4ee646520670 None None] For port d461bdfb-fc62-4353-be77-8a3bfc4b9ed3, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:43:19.432744 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-009929fb-2619-40ae-9480-21446aecd7d0 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:19.434507 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-3dcf329e-4ef0-47d0-a03e-4ee646520670 None None] For port d461bdfb-fc62-4353-be77-8a3bfc4b9ed3, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d461bdfb-fc62-4353-be77-8a3bfc4b9ed3,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:43:19.450968 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3dcf329e-4ef0-47d0-a03e-4ee646520670 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:19.488757 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0f151859-314d-435a-932f-095f5ba408e5 req-251ac932-0050-400d-aed0-74b54339ab3b tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/security-groups?id=f7ac2409-fc2d-46c4-9c5c-d8bca8738561&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1320121 Dec 09 21:43:19.531504 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-009929fb-2619-40ae-9480-21446aecd7d0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:19.532720 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-009929fb-2619-40ae-9480-21446aecd7d0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:19.533865 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-009929fb-2619-40ae-9480-21446aecd7d0 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:19.570114 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dcf329e-4ef0-47d0-a03e-4ee646520670 None None] Pushing event updated for resources: {'Port': ['ID=d461bdfb-fc62-4353-be77-8a3bfc4b9ed3,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:19.599959 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-41136d58-b47c-45fd-be50-71c71ef66f54 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:19.634341 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-009929fb-2619-40ae-9480-21446aecd7d0 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.9639199 Dec 09 21:43:19.635704 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-009929fb-2619-40ae-9480-21446aecd7d0 admin admin] Pushing event updated for resources: {'Network': ['ID=eda4cb39-afde-43d7-a13b-5227cc6862dd,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:19.638258 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37554) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:19.645525 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-4eba8849-b72c-4efd-9f64-7c4d90d7f77d admin admin] Request body: {'subnet': {'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-993120407-subnet', 'tenant_id': '6f2bd57ebcdc4c748e719519e3961b70', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:19.649665 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network eda4cb39-afde-43d7-a13b-5227cc6862dd details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:43:19.652446 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41136d58-b47c-45fd-be50-71c71ef66f54 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Port': ['ID=c3b5994c-2c6a-43c3-97d9-b4aa49cbf7ff,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:19.676125 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4eba8849-b72c-4efd-9f64-7c4d90d7f77d admin admin] Made reservation on behalf of 6f2bd57ebcdc4c748e719519e3961b70 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:19.679992 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4eba8849-b72c-4efd-9f64-7c4d90d7f77d admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:19.712928 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-41136d58-b47c-45fd-be50-71c71ef66f54 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:19.716390 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-41136d58-b47c-45fd-be50-71c71ef66f54 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/c3b5994c-2c6a-43c3-97d9-b4aa49cbf7ff HTTP/1.1" status: 204 len: 168 time: 0.7495239 Dec 09 21:43:19.731680 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37556) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:19.997613 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4eba8849-b72c-4efd-9f64-7c4d90d7f77d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:20.090173 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eba8849-b72c-4efd-9f64-7c4d90d7f77d admin admin] Pushing event updated for resources: {'Subnet': ['ID=24afae0e-0a38-484d-a023-a2fb471bdb33,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:20.138357 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4eba8849-b72c-4efd-9f64-7c4d90d7f77d admin admin] Checking segment: {'id': '0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:43:20.138944 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4eba8849-b72c-4efd-9f64-7c4d90d7f77d admin admin] Network hostable DHCP agents. Network: eda4cb39-afde-43d7-a13b-5227cc6862dd, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:43:20.161601 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4eba8849-b72c-4efd-9f64-7c4d90d7f77d admin admin] Network eda4cb39-afde-43d7-a13b-5227cc6862dd is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:43:20.179117 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-4eba8849-b72c-4efd-9f64-7c4d90d7f77d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, eda4cb39-afde-43d7-a13b-5227cc6862dd) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:20.187910 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c4683d1-fd7b-438a-8a73-2a897bd96a54 None None] Network eda4cb39-afde-43d7-a13b-5227cc6862dd requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:20.202616 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4eba8849-b72c-4efd-9f64-7c4d90d7f77d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:20.203706 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4eba8849-b72c-4efd-9f64-7c4d90d7f77d admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:20.235975 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4eba8849-b72c-4efd-9f64-7c4d90d7f77d admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.5966215 Dec 09 21:43:20.334669 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2c5bfcd4-c4ce-4ad1-94dd-346a146d9461 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:20.338353 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2c5bfcd4-c4ce-4ad1-94dd-346a146d9461 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:20.340199 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2c5bfcd4-c4ce-4ad1-94dd-346a146d9461 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1454 time: 0.6074650 Dec 09 21:43:20.343998 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37572) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:20.379316 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9c91c3e2-7516-46f0-8d04-ab72c42ed971 None None] Network eda4cb39-afde-43d7-a13b-5227cc6862dd requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:20.421601 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-20812d4f-5536-4eca-8474-7225ff4e66d5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet df5c3238-287e-4140-b9e2-7176b28a25de {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:43:20.433136 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-20812d4f-5536-4eca-8474-7225ff4e66d5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:20.541773 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-20812d4f-5536-4eca-8474-7225ff4e66d5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:20.553362 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d461bdfb-fc62-4353-be77-8a3bfc4b9ed3 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:43:20.677979 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port d461bdfb-fc62-4353-be77-8a3bfc4b9ed3 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:20.678413 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:20.736334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3973536-332c-4354-9c4a-498ee15a5483 req-32b509e8-ed78-4f35-8592-0c55903d6d06 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:20.749751 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3973536-332c-4354-9c4a-498ee15a5483 req-32b509e8-ed78-4f35-8592-0c55903d6d06 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/ports?device_id=6817b8ca-c51a-46d0-8c87-3cf63d444459 HTTP/1.1" status: 200 len: 945 time: 0.1338489 Dec 09 21:43:20.752432 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-20812d4f-5536-4eca-8474-7225ff4e66d5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:20.787177 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:20.862956 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3973536-332c-4354-9c4a-498ee15a5483 req-35308039-d750-48d2-871f-743ad76802b0 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/security-groups?id=f7ac2409-fc2d-46c4-9c5c-d8bca8738561&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1122932 Dec 09 21:43:20.890123 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-20812d4f-5536-4eca-8474-7225ff4e66d5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:20.965337 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-20812d4f-5536-4eca-8474-7225ff4e66d5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:20.972404 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37588) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:20.973633 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-20812d4f-5536-4eca-8474-7225ff4e66d5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/df5c3238-287e-4140-b9e2-7176b28a25de HTTP/1.1" status: 204 len: 168 time: 0.6290607 Dec 09 21:43:20.974729 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20812d4f-5536-4eca-8474-7225ff4e66d5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=df5c3238-287e-4140-b9e2-7176b28a25de,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:21.004614 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:43:21.007804 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:43:21.050401 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37594) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:21.056081 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-02783e70-46f8-4ec1-ba41-0e43ba97e8e2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:21.062034 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a2c43216-ff33-4fdb-b76a-d7c6613dc860 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0871692 Dec 09 21:43:21.225509 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-02783e70-46f8-4ec1-ba41-0e43ba97e8e2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:21.244783 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-02783e70-46f8-4ec1-ba41-0e43ba97e8e2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:21.372802 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df443aa8-ee66-4df1-9547-cc5540edbcfd None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:21.481146 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9a377e4f-8c5c-42e2-9eb0-25646701a3da None None] Provisioning complete for port d461bdfb-fc62-4353-be77-8a3bfc4b9ed3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:21.481581 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9a377e4f-8c5c-42e2-9eb0-25646701a3da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:21.575002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:43:21.619329 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37624) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:21.650398 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:21.700241 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9a377e4f-8c5c-42e2-9eb0-25646701a3da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:21.743558 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d6722b60-afac-4ef0-869e-ab7c8d0dc68e None None] DHCP port deletion for 77d1c069-bca4-4157-a30b-fb10cbd9d9ee request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:43:21.748879 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port d461bdfb-fc62-4353-be77-8a3bfc4b9ed3, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d461bdfb-fc62-4353-be77-8a3bfc4b9ed3,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:21.752423 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:43:21.759371 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:21.759802 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:21.768397 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:21.858884 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a82acf95-f3f1-4a6f-85fc-0d2ef05e4ab3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:21.920082 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-9a377e4f-8c5c-42e2-9eb0-25646701a3da None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:43:21.920383 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-9a377e4f-8c5c-42e2-9eb0-25646701a3da None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:43:21.946457 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=d461bdfb-fc62-4353-be77-8a3bfc4b9ed3,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:21.956164 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d6722b60-afac-4ef0-869e-ab7c8d0dc68e None None] Deleting port d461bdfb-fc62-4353-be77-8a3bfc4b9ed3 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:43:21.956544 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d6722b60-afac-4ef0-869e-ab7c8d0dc68e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:21.959790 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a82acf95-f3f1-4a6f-85fc-0d2ef05e4ab3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:21.970056 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a82acf95-f3f1-4a6f-85fc-0d2ef05e4ab3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:22.061315 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-d6722b60-afac-4ef0-869e-ab7c8d0dc68e None None] For port d461bdfb-fc62-4353-be77-8a3bfc4b9ed3, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d461bdfb-fc62-4353-be77-8a3bfc4b9ed3,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:22.061736 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d6722b60-afac-4ef0-869e-ab7c8d0dc68e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:22.064471 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a82acf95-f3f1-4a6f-85fc-0d2ef05e4ab3 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=017a0f620a7246eba77632d0d35e2a87&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4441164 Dec 09 21:43:22.068422 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37636) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:22.074153 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:22.094161 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-9f27d36b-3cda-49ff-895c-424451c76ba5 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:22.099613 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d6722b60-afac-4ef0-869e-ab7c8d0dc68e None None] Calling delete_port for d461bdfb-fc62-4353-be77-8a3bfc4b9ed3 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:43:22.100256 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-9f27d36b-3cda-49ff-895c-424451c76ba5 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/networks?id=eda4cb39-afde-43d7-a13b-5227cc6862dd HTTP/1.1" status: 200 len: 814 time: 0.8855114 Dec 09 21:43:22.106515 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a82acf95-f3f1-4a6f-85fc-0d2ef05e4ab3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=df9ee106-efa9-4b47-808d-ebff7ef6f10d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:22.126596 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6817b8ca-c51a-46d0-8c87-3cf63d444459', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:43:22.129660 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-36a5caea-211a-45d6-bd22-2b3159b4213a" -d '{"events": [{"server_uuid": "6817b8ca-c51a-46d0-8c87-3cf63d444459", "name": "network-vif-plugged", "status": "completed", "tag": "6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:43:22.150755 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60,segment=NetworkSegment(d82da970-cb23-48b1-8606-d6809e0c864c),segment_id=d82da970-cb23-48b1-8606-d6809e0c864c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:22.168062 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-f019dc02-eac2-40c1-a314-b465f88f4955 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/quotas/6f2bd57ebcdc4c748e719519e3961b70 HTTP/1.1" status: 200 len: 375 time: 0.0223036 Dec 09 21:43:22.171273 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dcb1e2c5-2d94-4e06-99ae-c98091de700c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:22.192810 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:22.208370 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dcb1e2c5-2d94-4e06-99ae-c98091de700c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:22.248324 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-6ee133c5-3ea8-436f-958e-d2a6969dbb63 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=6f2bd57ebcdc4c748e719519e3961b70&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0630569 Dec 09 21:43:22.278198 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:22.293277 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d6722b60-afac-4ef0-869e-ab7c8d0dc68e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:22.295188 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dcb1e2c5-2d94-4e06-99ae-c98091de700c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:22.298368 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dcb1e2c5-2d94-4e06-99ae-c98091de700c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:22.300035 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-dcb1e2c5-2d94-4e06-99ae-c98091de700c admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/df9ee106-efa9-4b47-808d-ebff7ef6f10d HTTP/1.1" status: 204 len: 168 time: 0.2304635 Dec 09 21:43:22.326400 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcb1e2c5-2d94-4e06-99ae-c98091de700c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=df9ee106-efa9-4b47-808d-ebff7ef6f10d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:22.386531 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6722b60-afac-4ef0-869e-ab7c8d0dc68e None None] Pushing event deleted for resources: {'Port': ['ID=d461bdfb-fc62-4353-be77-8a3bfc4b9ed3,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:22.398973 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6722b60-afac-4ef0-869e-ab7c8d0dc68e None None] No DVR routers for this DVR port d461bdfb-fc62-4353-be77-8a3bfc4b9ed3 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:43:22.452100 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9a377e4f-8c5c-42e2-9eb0-25646701a3da None None] Port d461bdfb-fc62-4353-be77-8a3bfc4b9ed3 update to ACTIVE by agent not found {{(pid=103439) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2167}} Dec 09 21:43:22.453903 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d461bdfb-fc62-4353-be77-8a3bfc4b9ed3 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:43:22.463797 n-d-713301-27 neutron-server[103438]: DEBUG neutron.objects.ports [None req-02783e70-46f8-4ec1-ba41-0e43ba97e8e2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=103438) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 09 21:43:22.479429 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: d461bdfb-fc62-4353-be77-8a3bfc4b9ed3 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:43:22.480421 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d461bdfb-fc62-4353-be77-8a3bfc4b9ed3 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:43:22.574539 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-4765a469-c6e9-4e99-bec0-439e4c90fe01 service neutron] 10.222.0.13 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2712035 Dec 09 21:43:22.599806 n-d-713301-27 neutron-server[103438]: WARNING neutron.services.revisions.revision_plugin [None req-02783e70-46f8-4ec1-ba41-0e43ba97e8e2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Could not find related port for resource to bump revision. Dec 09 21:43:22.632151 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.ipam_pluggable_backend [None req-02783e70-46f8-4ec1-ba41-0e43ba97e8e2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Port d461bdfb-fc62-4353-be77-8a3bfc4b9ed3 was deleted while updating it with an IPv6 auto-address. Ignoring. {{(pid=103438) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:573}} Dec 09 21:43:22.632731 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.ipam_pluggable_backend [None req-02783e70-46f8-4ec1-ba41-0e43ba97e8e2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Reverting IP allocation for 2001:db8::f816:3eff:fe5e:fb71 {{(pid=103438) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:575}} Dec 09 21:43:22.662926 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.ipam_pluggable_backend [None req-02783e70-46f8-4ec1-ba41-0e43ba97e8e2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Reverting IP allocation failed for 2001:db8::f816:3eff:fe5e:fb71 {{(pid=103438) add_auto_addrs_on_network_ports /opt/stack/neutron/neutron/db/ipam_pluggable_backend.py:581}} Dec 09 21:43:22.668865 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-02783e70-46f8-4ec1-ba41-0e43ba97e8e2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:22.721828 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-02783e70-46f8-4ec1-ba41-0e43ba97e8e2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:22.733005 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-02783e70-46f8-4ec1-ba41-0e43ba97e8e2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:22.739565 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-02783e70-46f8-4ec1-ba41-0e43ba97e8e2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:22.739733 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-02783e70-46f8-4ec1-ba41-0e43ba97e8e2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:22.745670 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2bf377cb-483f-4c22-ae34-9fbedd47584f None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:22.756964 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-5a6965b3-25a4-4cdb-9fba-921a764988ef service neutron] 10.222.0.13 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1549683 Dec 09 21:43:22.758376 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02783e70-46f8-4ec1-ba41-0e43ba97e8e2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=46b93c9f-f77a-43e0-a8ed-98f34d70d52c,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:22.769740 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-02783e70-46f8-4ec1-ba41-0e43ba97e8e2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 835 time: 1.7182279 Dec 09 21:43:22.772708 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37654) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:22.778272 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-97cfa8d5-2908-4ff0-b5e8-fb77a5b8ad4c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'mac_address': 'fa:16:3e:15:67:fc', 'name': 'tempest-NetworksTestDHCPv6-800080669'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:23.019477 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-97cfa8d5-2908-4ff0-b5e8-fb77a5b8ad4c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:23.029512 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18456628-569c-4348-9505-a89ab8b2b06e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'fixed_ips': [{'subnet_id': '46b93c9f-f77a-43e0-a8ed-98f34d70d52c'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:43:23.030729 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-18456628-569c-4348-9505-a89ab8b2b06e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:23.143851 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-598abe94-ae39-4942-8260-a3b8b7b1d5e2 req-76a9fe53-7e93-4d1a-8df5-8ffb0ce38e1c tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:23.145526 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-598abe94-ae39-4942-8260-a3b8b7b1d5e2 req-76a9fe53-7e93-4d1a-8df5-8ffb0ce38e1c tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/ports?device_id=6817b8ca-c51a-46d0-8c87-3cf63d444459 HTTP/1.1" status: 200 len: 946 time: 0.1243489 Dec 09 21:43:23.189636 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-97cfa8d5-2908-4ff0-b5e8-fb77a5b8ad4c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:23.215743 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-97cfa8d5-2908-4ff0-b5e8-fb77a5b8ad4c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] device_id is not set on port 6808b887-f205-4ae1-8a73-17f585ec4b31 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:43:23.266179 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-598abe94-ae39-4942-8260-a3b8b7b1d5e2 req-9ad18f91-bcfb-460d-9153-5d8e4bc67d3c tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/security-groups?id=f7ac2409-fc2d-46c4-9c5c-d8bca8738561&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1109705 Dec 09 21:43:23.406477 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:43:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1f8150d0-38fe-4387-9a04-00e59d2ab24c x-openstack-request-id: req-1f8150d0-38fe-4387-9a04-00e59d2ab24c {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:43:23.406477 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6817b8ca-c51a-46d0-8c87-3cf63d444459", "name": "network-vif-plugged", "status": "completed", "tag": "6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:43:23.407078 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-1f8150d0-38fe-4387-9a04-00e59d2ab24c {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:43:23.407490 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6817b8ca-c51a-46d0-8c87-3cf63d444459', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60', 'code': 200} Dec 09 21:43:23.453203 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5bc668fc-9696-4937-8928-890c7d339a47 req-caf590cd-0998-4aba-8e71-e01f108d715a tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ae35dc07-1896-4a17-978c-12bd32bd62a8 HTTP/1.1" status: 200 len: 210 time: 0.0679481 Dec 09 21:43:23.485649 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-97cfa8d5-2908-4ff0-b5e8-fb77a5b8ad4c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8::f816:3eff:fe15:67fc (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/46b93c9f-f77a-43e0-a8ed-98f34d70d52c/6808b887-f205-4ae1-8a73-17f585ec4b31) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:23.688163 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-97cfa8d5-2908-4ff0-b5e8-fb77a5b8ad4c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:23.730082 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-97cfa8d5-2908-4ff0-b5e8-fb77a5b8ad4c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:23.736692 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1082c0a7-67d1-406f-9524-efb30e9aaad9 req-bcbb2cb5-1f1f-404d-892e-9fe79d1abdcd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:23.738547 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1082c0a7-67d1-406f-9524-efb30e9aaad9 req-bcbb2cb5-1f1f-404d-892e-9fe79d1abdcd service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=6817b8ca-c51a-46d0-8c87-3cf63d444459 HTTP/1.1" status: 200 len: 1098 time: 0.2813008 Dec 09 21:43:23.833214 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-18456628-569c-4348-9505-a89ab8b2b06e None None] Allocated IP 2001:db8::f816:3eff:fe67:6af0 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/46b93c9f-f77a-43e0-a8ed-98f34d70d52c/ca9e286d-93af-4003-876d-25896dc48ef2) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:23.834140 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-97cfa8d5-2908-4ff0-b5e8-fb77a5b8ad4c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:23.841663 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-97cfa8d5-2908-4ff0-b5e8-fb77a5b8ad4c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:23.848448 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97cfa8d5-2908-4ff0-b5e8-fb77a5b8ad4c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:43:23.854995 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-97cfa8d5-2908-4ff0-b5e8-fb77a5b8ad4c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:23.856595 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-97cfa8d5-2908-4ff0-b5e8-fb77a5b8ad4c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:23.860698 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97cfa8d5-2908-4ff0-b5e8-fb77a5b8ad4c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=6808b887-f205-4ae1-8a73-17f585ec4b31,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:23.879961 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1082c0a7-67d1-406f-9524-efb30e9aaad9 req-4e4ecf31-5641-41f3-a0ac-d73a6682416c service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=f7ac2409-fc2d-46c4-9c5c-d8bca8738561&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1340957 Dec 09 21:43:23.881060 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-97cfa8d5-2908-4ff0-b5e8-fb77a5b8ad4c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 947 time: 1.1071291 Dec 09 21:43:23.883853 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37696) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:23.940154 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2c14916a-ad80-4ef6-b31d-6669aa4c984c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:23.942148 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2c14916a-ad80-4ef6-b31d-6669aa4c984c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 945 time: 0.0571122 Dec 09 21:43:23.945050 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37698) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:24.040368 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-18456628-569c-4348-9505-a89ab8b2b06e None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:24.052999 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-18456628-569c-4348-9505-a89ab8b2b06e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:24.093915 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18456628-569c-4348-9505-a89ab8b2b06e None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:24.097367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-18456628-569c-4348-9505-a89ab8b2b06e None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:24.102385 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18456628-569c-4348-9505-a89ab8b2b06e None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:43:24.104127 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-ee086375-522b-4d48-acb1-ca1b4469ff68 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting port 6808b887-f205-4ae1-8a73-17f585ec4b31 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:43:24.104483 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee086375-522b-4d48-acb1-ca1b4469ff68 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:24.152556 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18456628-569c-4348-9505-a89ab8b2b06e None None] Pushing event updated for resources: {'Port': ['ID=ca9e286d-93af-4003-876d-25896dc48ef2,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:24.197606 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-18456628-569c-4348-9505-a89ab8b2b06e None None] Attempting to bind port ca9e286d-93af-4003-876d-25896dc48ef2 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:43:24.198233 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-18456628-569c-4348-9505-a89ab8b2b06e None None] Attempting to bind port ca9e286d-93af-4003-876d-25896dc48ef2 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:43:24.198924 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18456628-569c-4348-9505-a89ab8b2b06e None None] Attempting to bind port ca9e286d-93af-4003-876d-25896dc48ef2 on network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:43:24.204658 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18456628-569c-4348-9505-a89ab8b2b06e None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 43, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:43:24.205344 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18456628-569c-4348-9505-a89ab8b2b06e None None] Checking segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:43:24.205949 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-18456628-569c-4348-9505-a89ab8b2b06e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:24.206555 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18456628-569c-4348-9505-a89ab8b2b06e None None] Bound using segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:43:24.207221 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-18456628-569c-4348-9505-a89ab8b2b06e None None] Bound port: ca9e286d-93af-4003-876d-25896dc48ef2, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:43:24.207830 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-18456628-569c-4348-9505-a89ab8b2b06e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:24.235583 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee086375-522b-4d48-acb1-ca1b4469ff68 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:24.270065 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-ee086375-522b-4d48-acb1-ca1b4469ff68 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Calling delete_port for 6808b887-f205-4ae1-8a73-17f585ec4b31 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:43:24.283691 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-18456628-569c-4348-9505-a89ab8b2b06e None None] For port ca9e286d-93af-4003-876d-25896dc48ef2, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:43:24.289012 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-18456628-569c-4348-9505-a89ab8b2b06e None None] For port ca9e286d-93af-4003-876d-25896dc48ef2, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=ca9e286d-93af-4003-876d-25896dc48ef2,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:43:24.297722 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-18456628-569c-4348-9505-a89ab8b2b06e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:24.380099 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18456628-569c-4348-9505-a89ab8b2b06e None None] Pushing event updated for resources: {'Port': ['ID=ca9e286d-93af-4003-876d-25896dc48ef2,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:24.453885 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07c10c55-088e-40e2-9390-1b8905a7e0a0 req-af8ad2d2-4970-475b-88b7-68bd822f5fd5 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:24.456284 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07c10c55-088e-40e2-9390-1b8905a7e0a0 req-af8ad2d2-4970-475b-88b7-68bd822f5fd5 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/ports?device_id=6817b8ca-c51a-46d0-8c87-3cf63d444459 HTTP/1.1" status: 200 len: 946 time: 0.0689878 Dec 09 21:43:24.491369 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee086375-522b-4d48-acb1-ca1b4469ff68 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:24.543944 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee086375-522b-4d48-acb1-ca1b4469ff68 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Port': ['ID=6808b887-f205-4ae1-8a73-17f585ec4b31,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:24.562312 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07c10c55-088e-40e2-9390-1b8905a7e0a0 req-2623d056-2c5d-429c-981d-6eaca9ef335c tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/security-groups?id=f7ac2409-fc2d-46c4-9c5c-d8bca8738561&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0961082 Dec 09 21:43:24.580456 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee086375-522b-4d48-acb1-ca1b4469ff68 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:24.586520 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ee086375-522b-4d48-acb1-ca1b4469ff68 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/6808b887-f205-4ae1-8a73-17f585ec4b31 HTTP/1.1" status: 204 len: 168 time: 0.6380982 Dec 09 21:43:24.588186 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37724) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:24.722317 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70e7e9da-3bf3-4c98-a4c0-8f5b99801f30 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:24.724371 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-70e7e9da-3bf3-4c98-a4c0-8f5b99801f30 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:24.726251 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-70e7e9da-3bf3-4c98-a4c0-8f5b99801f30 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1465 time: 0.1369390 Dec 09 21:43:24.729805 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37726) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:24.811410 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-8c1c74aa-3bc0-4346-a3fe-f0d6b48a1ea5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet 46b93c9f-f77a-43e0-a8ed-98f34d70d52c {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:43:24.815184 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8c1c74aa-3bc0-4346-a3fe-f0d6b48a1ea5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:24.876361 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8c1c74aa-3bc0-4346-a3fe-f0d6b48a1ea5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:24.897719 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bb1cd5e4-550c-4da2-8b37-375c0a9c970a req-54e78a3d-e0e0-4127-a7d9-46f2b7630405 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ae35dc07-1896-4a17-978c-12bd32bd62a8 HTTP/1.1" status: 200 len: 210 time: 0.1024086 Dec 09 21:43:24.964457 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-69567fcb-36d1-4ab0-8645-68996b1cdfbf tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:24.966038 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-69567fcb-36d1-4ab0-8645-68996b1cdfbf tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.31 "GET /v2.0/networks?id=eda4cb39-afde-43d7-a13b-5227cc6862dd HTTP/1.1" status: 200 len: 814 time: 0.3697276 Dec 09 21:43:24.990146 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-f650b2b0-ac3a-4ea0-a34a-e6a70c3037c1 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Request body: {'port': {'device_id': 'ae35dc07-1896-4a17-978c-12bd32bd62a8', 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd', 'admin_state_up': True, 'tenant_id': '6f2bd57ebcdc4c748e719519e3961b70'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:25.003516 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8c1c74aa-3bc0-4346-a3fe-f0d6b48a1ea5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:25.090465 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8c1c74aa-3bc0-4346-a3fe-f0d6b48a1ea5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:25.133136 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c1c74aa-3bc0-4346-a3fe-f0d6b48a1ea5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=46b93c9f-f77a-43e0-a8ed-98f34d70d52c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:25.146194 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8c1c74aa-3bc0-4346-a3fe-f0d6b48a1ea5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:25.150191 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8c1c74aa-3bc0-4346-a3fe-f0d6b48a1ea5 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/46b93c9f-f77a-43e0-a8ed-98f34d70d52c HTTP/1.1" status: 204 len: 168 time: 0.4191341 Dec 09 21:43:25.152873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37742) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:25.171155 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-f650b2b0-ac3a-4ea0-a34a-e6a70c3037c1 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Made reservation on behalf of 6f2bd57ebcdc4c748e719519e3961b70 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:25.175245 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-f650b2b0-ac3a-4ea0-a34a-e6a70c3037c1 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:25.199599 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c2ac8f27-505f-43b2-b39f-4a50b0d6c438 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0455525 Dec 09 21:43:25.201901 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37744) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:25.256755 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e078a8f-9ad5-48ec-a31e-2d836d0f2f74 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:25.258352 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1e078a8f-9ad5-48ec-a31e-2d836d0f2f74 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 864 time: 0.0553946 Dec 09 21:43:25.261628 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37746) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:25.322676 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-18bd0820-d983-4c29-83b6-074495057585 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:25.324580 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-18bd0820-d983-4c29-83b6-074495057585 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0617747 Dec 09 21:43:25.327482 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37750) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:25.356314 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-f650b2b0-ac3a-4ea0-a34a-e6a70c3037c1 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Allocated IP 172.20.0.13 (eda4cb39-afde-43d7-a13b-5227cc6862dd/24afae0e-0a38-484d-a023-a2fb471bdb33/33cf4605-a408-4847-9394-fe8acf994c40) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:25.405634 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-dd9e3385-b797-42e7-b685-f6cb9f517bae tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0773830 Dec 09 21:43:25.406545 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37756) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:25.411908 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-c3fc89fc-74a4-4236-a35f-5bdd1b9f93ce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:25.573710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c3fc89fc-74a4-4236-a35f-5bdd1b9f93ce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:25.578935 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c3fc89fc-74a4-4236-a35f-5bdd1b9f93ce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:25.631078 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-f650b2b0-ac3a-4ea0-a34a-e6a70c3037c1 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:25.749886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbc3a93f-6bb8-4f3f-aeef-631a8e819f4f req-955e6d93-5ebe-4461-a04b-689da07dfb52 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:25.751622 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bbc3a93f-6bb8-4f3f-aeef-631a8e819f4f req-955e6d93-5ebe-4461-a04b-689da07dfb52 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/ports?device_id=6817b8ca-c51a-46d0-8c87-3cf63d444459 HTTP/1.1" status: 200 len: 946 time: 0.0881639 Dec 09 21:43:25.753487 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-f650b2b0-ac3a-4ea0-a34a-e6a70c3037c1 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:25.780826 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-f650b2b0-ac3a-4ea0-a34a-e6a70c3037c1 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Network eda4cb39-afde-43d7-a13b-5227cc6862dd is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:25.785227 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-f650b2b0-ac3a-4ea0-a34a-e6a70c3037c1 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:25.882563 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-f650b2b0-ac3a-4ea0-a34a-e6a70c3037c1 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:43:25.927841 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c3fc89fc-74a4-4236-a35f-5bdd1b9f93ce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:25.968671 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bbc3a93f-6bb8-4f3f-aeef-631a8e819f4f req-cffd5b3e-765a-4764-bbad-80262321007c tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/security-groups?id=f7ac2409-fc2d-46c4-9c5c-d8bca8738561&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1958957 Dec 09 21:43:25.988437 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f650b2b0-ac3a-4ea0-a34a-e6a70c3037c1 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Pushing event updated for resources: {'Port': ['ID=33cf4605-a408-4847-9394-fe8acf994c40,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:26.007496 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-f650b2b0-ac3a-4ea0-a34a-e6a70c3037c1 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:26.008497 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-f650b2b0-ac3a-4ea0-a34a-e6a70c3037c1 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:26.024040 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c3fc89fc-74a4-4236-a35f-5bdd1b9f93ce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:26.036818 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-f650b2b0-ac3a-4ea0-a34a-e6a70c3037c1 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0566599 Dec 09 21:43:26.042218 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3fc89fc-74a4-4236-a35f-5bdd1b9f93ce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=08bd9291-cbaf-4c9b-8485-424bf7fc3e93,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:26.047892 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a7c5a259-f031-4dd7-91dc-796dd3b8d0bd None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:26.050835 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-dc06330f-de76-40d4-881b-27dbbfc8a81c service neutron] Request body: {'port': {'device_id': 'ae35dc07-1896-4a17-978c-12bd32bd62a8', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:26.054953 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-c3fc89fc-74a4-4236-a35f-5bdd1b9f93ce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:26.062863 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c3fc89fc-74a4-4236-a35f-5bdd1b9f93ce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:26.063574 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c3fc89fc-74a4-4236-a35f-5bdd1b9f93ce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:26.105157 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37776) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:26.120652 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c3fc89fc-74a4-4236-a35f-5bdd1b9f93ce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.7059429 Dec 09 21:43:26.128494 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-3d141acd-d80a-42ea-8b74-7a52ae6294f4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'mac_address': 'fa:16:3e:53:56:95', 'name': 'tempest-NetworksTestDHCPv6-1598427312'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:26.180881 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8cb38571-c022-46d5-94b2-e7697a9ec1a4 None None] Provisioning complete for port ca9e286d-93af-4003-876d-25896dc48ef2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:26.181292 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8cb38571-c022-46d5-94b2-e7697a9ec1a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:26.200374 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-dc06330f-de76-40d4-881b-27dbbfc8a81c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:26.327786 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8cb38571-c022-46d5-94b2-e7697a9ec1a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:26.398213 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-8cb38571-c022-46d5-94b2-e7697a9ec1a4 None None] For port ca9e286d-93af-4003-876d-25896dc48ef2, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=ca9e286d-93af-4003-876d-25896dc48ef2,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:26.404568 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8cb38571-c022-46d5-94b2-e7697a9ec1a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:26.484429 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device ca9e286d-93af-4003-876d-25896dc48ef2 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:43:26.487045 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cb38571-c022-46d5-94b2-e7697a9ec1a4 None None] Pushing event updated for resources: {'Port': ['ID=ca9e286d-93af-4003-876d-25896dc48ef2,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:26.517843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fb52cb8-31f2-48d3-ad9e-2de6a04efa9f req-d428ce46-0cdc-4af2-9be1-07917597ca98 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:26.526648 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fb52cb8-31f2-48d3-ad9e-2de6a04efa9f req-d428ce46-0cdc-4af2-9be1-07917597ca98 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ae35dc07-1896-4a17-978c-12bd32bd62a8 HTTP/1.1" status: 200 len: 932 time: 0.3763149 Dec 09 21:43:26.550498 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3d141acd-d80a-42ea-8b74-7a52ae6294f4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:26.559630 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port ca9e286d-93af-4003-876d-25896dc48ef2 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:26.560180 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:26.714738 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dae64614-c435-43c8-9f54-16b1a044de78 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:26.728449 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fb52cb8-31f2-48d3-ad9e-2de6a04efa9f req-3e6ae132-09ac-4276-b217-b6f5c8c88c98 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2006578 Dec 09 21:43:26.815111 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d141acd-d80a-42ea-8b74-7a52ae6294f4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:26.839009 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-301cfaf4-03f9-45a3-b697-6226cb253809 None None] Provisioning complete for port ca9e286d-93af-4003-876d-25896dc48ef2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:26.839484 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-301cfaf4-03f9-45a3-b697-6226cb253809 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:26.883360 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-3d141acd-d80a-42ea-8b74-7a52ae6294f4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] device_id is not set on port bd69991d-aa8a-4d4f-8a60-4acad1444bf1 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:43:27.221296 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-dc06330f-de76-40d4-881b-27dbbfc8a81c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 33cf4605-a408-4847-9394-fe8acf994c40 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:43:27.240415 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-dc06330f-de76-40d4-881b-27dbbfc8a81c service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:27.253292 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:27.263544 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-3d141acd-d80a-42ea-8b74-7a52ae6294f4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8::113 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/08bd9291-cbaf-4c9b-8485-424bf7fc3e93/bd69991d-aa8a-4d4f-8a60-4acad1444bf1) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:27.297601 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-dc06330f-de76-40d4-881b-27dbbfc8a81c service neutron] Transition to ACTIVE for port object 33cf4605-a408-4847-9394-fe8acf994c40 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:43:27.330830 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:27.390947 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-93d80743-8542-4389-a49a-4cfdacb6bdb6 None None] Provisioning complete for port ca9e286d-93af-4003-876d-25896dc48ef2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:27.405973 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-93d80743-8542-4389-a49a-4cfdacb6bdb6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:27.553553 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d141acd-d80a-42ea-8b74-7a52ae6294f4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:27.590488 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-dc06330f-de76-40d4-881b-27dbbfc8a81c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:27.601640 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d141acd-d80a-42ea-8b74-7a52ae6294f4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:27.692238 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d141acd-d80a-42ea-8b74-7a52ae6294f4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:27.717018 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-3d141acd-d80a-42ea-8b74-7a52ae6294f4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:27.720292 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d141acd-d80a-42ea-8b74-7a52ae6294f4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:43:27.726696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d141acd-d80a-42ea-8b74-7a52ae6294f4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:27.727895 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d141acd-d80a-42ea-8b74-7a52ae6294f4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:27.731063 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc06330f-de76-40d4-881b-27dbbfc8a81c service neutron] Pushing event updated for resources: {'Port': ['ID=33cf4605-a408-4847-9394-fe8acf994c40,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:27.757769 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f3ac66c0-b14a-4da7-88ad-d858414104d7 None None] Could not find standard attr ID for object 6808b887-f205-4ae1-8a73-17f585ec4b31. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:43:27.810394 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3d141acd-d80a-42ea-8b74-7a52ae6294f4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 932 time: 1.7030721 Dec 09 21:43:27.813254 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37828) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:27.830254 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d141acd-d80a-42ea-8b74-7a52ae6294f4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=bd69991d-aa8a-4d4f-8a60-4acad1444bf1,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:27.853471 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-dc06330f-de76-40d4-881b-27dbbfc8a81c service neutron] Attempting to bind port 33cf4605-a408-4847-9394-fe8acf994c40 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:43:27.853858 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-dc06330f-de76-40d4-881b-27dbbfc8a81c service neutron] Attempting to bind port 33cf4605-a408-4847-9394-fe8acf994c40 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:43:27.856480 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-dc06330f-de76-40d4-881b-27dbbfc8a81c service neutron] Attempting to bind port 33cf4605-a408-4847-9394-fe8acf994c40 on network eda4cb39-afde-43d7-a13b-5227cc6862dd {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:43:27.862425 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-dc06330f-de76-40d4-881b-27dbbfc8a81c service neutron] Port 33cf4605-a408-4847-9394-fe8acf994c40 on network eda4cb39-afde-43d7-a13b-5227cc6862dd not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:43:27.863226 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-dc06330f-de76-40d4-881b-27dbbfc8a81c service neutron] Attempting to bind port 33cf4605-a408-4847-9394-fe8acf994c40 on network eda4cb39-afde-43d7-a13b-5227cc6862dd {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:43:27.873612 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-dc06330f-de76-40d4-881b-27dbbfc8a81c service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 43, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:43:27.873959 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-dc06330f-de76-40d4-881b-27dbbfc8a81c service neutron] Checking segment: {'id': '0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:43:27.874343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-dc06330f-de76-40d4-881b-27dbbfc8a81c service neutron] Bound using segment: {'id': '0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:43:27.874783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-dc06330f-de76-40d4-881b-27dbbfc8a81c service neutron] Bound port: 33cf4605-a408-4847-9394-fe8acf994c40, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:43:27.875145 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-dc06330f-de76-40d4-881b-27dbbfc8a81c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:27.912720 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-307b8caf-64a9-4417-a1fc-fd4d6da63e4a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:27.920261 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-307b8caf-64a9-4417-a1fc-fd4d6da63e4a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:27.922263 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-307b8caf-64a9-4417-a1fc-fd4d6da63e4a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1592 time: 0.1080003 Dec 09 21:43:27.925380 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37830) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:28.042888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a38648a-2ba9-4665-a422-29f36fdbaf37 req-8df3176c-2980-4940-b4b9-4633b951b5da tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:28.044517 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a38648a-2ba9-4665-a422-29f36fdbaf37 req-8df3176c-2980-4940-b4b9-4633b951b5da tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ae35dc07-1896-4a17-978c-12bd32bd62a8 HTTP/1.1" status: 200 len: 944 time: 0.0952997 Dec 09 21:43:28.064750 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-dc06330f-de76-40d4-881b-27dbbfc8a81c service neutron] For port 33cf4605-a408-4847-9394-fe8acf994c40, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:43:28.066953 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1a5148fd-571a-461a-a3f6-288306a9a25b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting port bd69991d-aa8a-4d4f-8a60-4acad1444bf1 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:43:28.067501 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a5148fd-571a-461a-a3f6-288306a9a25b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:28.105016 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-dc06330f-de76-40d4-881b-27dbbfc8a81c service neutron] For port 33cf4605-a408-4847-9394-fe8acf994c40, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=33cf4605-a408-4847-9394-fe8acf994c40,segment=NetworkSegment(0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5),segment_id=0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:43:28.118507 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-dc06330f-de76-40d4-881b-27dbbfc8a81c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:28.138123 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-dc06330f-de76-40d4-881b-27dbbfc8a81c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:28.138711 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-dc06330f-de76-40d4-881b-27dbbfc8a81c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:28.141007 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-dc06330f-de76-40d4-881b-27dbbfc8a81c service neutron] 10.222.0.31 "PUT /v2.0/ports/33cf4605-a408-4847-9394-fe8acf994c40 HTTP/1.1" status: 200 len: 1093 time: 2.0952973 Dec 09 21:43:28.160486 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ae35dc07-1896-4a17-978c-12bd32bd62a8', 'tag': '33cf4605-a408-4847-9394-fe8acf994c40'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:43:28.163391 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9adf8b16-c984-4ef1-b808-6253a8473852" -d '{"events": [{"name": "network-changed", "server_uuid": "ae35dc07-1896-4a17-978c-12bd32bd62a8", "tag": "33cf4605-a408-4847-9394-fe8acf994c40"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:43:28.222524 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a38648a-2ba9-4665-a422-29f36fdbaf37 req-cb142ee1-4585-452d-a0a8-612db2bea9ef tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1700802 Dec 09 21:43:28.241849 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a5148fd-571a-461a-a3f6-288306a9a25b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:28.261939 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1a5148fd-571a-461a-a3f6-288306a9a25b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Calling delete_port for bd69991d-aa8a-4d4f-8a60-4acad1444bf1 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:43:28.277180 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc06330f-de76-40d4-881b-27dbbfc8a81c service neutron] Pushing event updated for resources: {'Port': ['ID=33cf4605-a408-4847-9394-fe8acf994c40,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:28.300312 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-cb8cd86e-dd68-4691-bb57-9b5b227f0fa7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:28.302107 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-cb8cd86e-dd68-4691-bb57-9b5b227f0fa7 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6f2bd57ebcdc4c748e719519e3961b70&device_id=ae35dc07-1896-4a17-978c-12bd32bd62a8 HTTP/1.1" status: 200 len: 1096 time: 0.1055045 Dec 09 21:43:28.385854 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-c26d3343-e0b9-4a00-aee9-d24e9f0c5b68 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=33cf4605-a408-4847-9394-fe8acf994c40 HTTP/1.1" status: 200 len: 217 time: 0.0736463 Dec 09 21:43:28.437258 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device ca9e286d-93af-4003-876d-25896dc48ef2 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:43:28.452994 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a5148fd-571a-461a-a3f6-288306a9a25b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:28.455866 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-7fb1466c-f4e6-458d-b55c-98c39e5b26b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:28.457803 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-7fb1466c-f4e6-458d-b55c-98c39e5b26b5 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=24afae0e-0a38-484d-a023-a2fb471bdb33 HTTP/1.1" status: 200 len: 854 time: 0.0643814 Dec 09 21:43:28.497825 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-6a67827f-5ee2-4b68-8123-62637a08e4e5 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eda4cb39-afde-43d7-a13b-5227cc6862dd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0317416 Dec 09 21:43:28.505104 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7d990d69-7a12-42d2-9d57-9c2ced20aceb None None] Could not find standard attr ID for object bd69991d-aa8a-4d4f-8a60-4acad1444bf1. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:43:28.515033 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a5148fd-571a-461a-a3f6-288306a9a25b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Port': ['ID=bd69991d-aa8a-4d4f-8a60-4acad1444bf1,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:28.536966 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:43:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3c381d7c-26f1-4dff-b76f-8dadecbc09df x-openstack-request-id: req-3c381d7c-26f1-4dff-b76f-8dadecbc09df {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:43:28.537255 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ae35dc07-1896-4a17-978c-12bd32bd62a8", "tag": "33cf4605-a408-4847-9394-fe8acf994c40", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:43:28.537501 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-3c381d7c-26f1-4dff-b76f-8dadecbc09df {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:43:28.537895 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ae35dc07-1896-4a17-978c-12bd32bd62a8', 'tag': '33cf4605-a408-4847-9394-fe8acf994c40', 'status': 'completed', 'code': 200} Dec 09 21:43:28.556401 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1a5148fd-571a-461a-a3f6-288306a9a25b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:28.556401 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1a5148fd-571a-461a-a3f6-288306a9a25b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/bd69991d-aa8a-4d4f-8a60-4acad1444bf1 HTTP/1.1" status: 204 len: 168 time: 0.6280560 Dec 09 21:43:28.567260 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37848) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:28.589720 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port ca9e286d-93af-4003-876d-25896dc48ef2 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:28.590324 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:28.707707 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-73a82586-dd3a-4df5-9196-cd913f6f5b5a service neutron] 10.222.0.31 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2028065 Dec 09 21:43:28.709098 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-150ed75a-eeff-47d7-a82a-c7494a63e07b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:28.710828 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-150ed75a-eeff-47d7-a82a-c7494a63e07b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:28.718861 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-150ed75a-eeff-47d7-a82a-c7494a63e07b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1451 time: 0.1439655 Dec 09 21:43:28.721443 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37854) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:28.842702 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-89d02592-d286-4c03-8730-b7e5115395b0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet 08bd9291-cbaf-4c9b-8485-424bf7fc3e93 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:43:28.846344 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-89d02592-d286-4c03-8730-b7e5115395b0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:28.909142 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-89d02592-d286-4c03-8730-b7e5115395b0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:28.923378 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36919763-16b3-4423-8b35-9bbefb4c3c8d req-8fb558a1-83d5-4a5e-9542-ed2898b33217 service neutron] 10.222.0.31 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1988933 Dec 09 21:43:28.971553 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-89d02592-d286-4c03-8730-b7e5115395b0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:29.063315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9adf8b16-c984-4ef1-b808-6253a8473852 req-cc7024ed-e083-435a-8fa2-4432f2edc53c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:29.064984 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9adf8b16-c984-4ef1-b808-6253a8473852 req-cc7024ed-e083-435a-8fa2-4432f2edc53c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6f2bd57ebcdc4c748e719519e3961b70&device_id=ae35dc07-1896-4a17-978c-12bd32bd62a8 HTTP/1.1" status: 200 len: 1096 time: 0.0666912 Dec 09 21:43:29.066307 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-89d02592-d286-4c03-8730-b7e5115395b0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:29.101240 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89d02592-d286-4c03-8730-b7e5115395b0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=08bd9291-cbaf-4c9b-8485-424bf7fc3e93,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:29.107325 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-89d02592-d286-4c03-8730-b7e5115395b0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:29.114689 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37876) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:29.118744 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4c6c726-2da6-424e-8a82-0649ee76fae5 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:29.128298 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-89d02592-d286-4c03-8730-b7e5115395b0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/08bd9291-cbaf-4c9b-8485-424bf7fc3e93 HTTP/1.1" status: 204 len: 168 time: 0.4001780 Dec 09 21:43:29.188156 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9a834deb-1aae-4287-833d-8af20305eb93 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0720642 Dec 09 21:43:29.191355 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37878) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:29.272652 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38ec0bf0-8db4-44e9-b447-115f4a05dee8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:29.277671 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-38ec0bf0-8db4-44e9-b447-115f4a05dee8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.0821989 Dec 09 21:43:29.278071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37884) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:29.296567 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9adf8b16-c984-4ef1-b808-6253a8473852 req-12ad9a8d-191b-4a71-b7dd-e41e7c87ae0d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:29.298418 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9adf8b16-c984-4ef1-b808-6253a8473852 req-12ad9a8d-191b-4a71-b7dd-e41e7c87ae0d service neutron] 10.222.0.31 "GET /v2.0/networks?id=eda4cb39-afde-43d7-a13b-5227cc6862dd HTTP/1.1" status: 200 len: 915 time: 0.2254908 Dec 09 21:43:29.363418 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ffa4342b-90c5-4871-9993-437cc43dc63e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:29.365185 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ffa4342b-90c5-4871-9993-437cc43dc63e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0861237 Dec 09 21:43:29.367803 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37888) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:29.407566 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-480deb4c-49d0-4396-96ff-fb7aba1d3576 None None] DHCP port deletion for 77d1c069-bca4-4157-a30b-fb10cbd9d9ee request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:43:29.428232 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-aa329bdc-a882-4a13-a2c8-44a27df245bf tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0590763 Dec 09 21:43:29.432334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37890) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:29.454953 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-21348a20-87ce-47b0-b387-3b8bab0991b1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:29.460792 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9adf8b16-c984-4ef1-b808-6253a8473852 req-f56fd844-0c95-4d07-a6c4-20e202620089 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=33cf4605-a408-4847-9394-fe8acf994c40 HTTP/1.1" status: 200 len: 217 time: 0.1534240 Dec 09 21:43:29.493263 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-af66afda-5a1d-4dc6-aa53-9f884169233e req-a2871ce1-8727-4b85-bf4c-ead73c16e3c8 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=6817b8ca-c51a-46d0-8c87-3cf63d444459&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0674307 Dec 09 21:43:29.496799 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-480deb4c-49d0-4396-96ff-fb7aba1d3576 None None] Deleting port ca9e286d-93af-4003-876d-25896dc48ef2 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:43:29.497355 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-480deb4c-49d0-4396-96ff-fb7aba1d3576 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:29.614036 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cb8f317-9277-4f99-b467-214c2bf3dbc9 req-fcef9812-76bd-4ecb-bda4-dec1bfd8d0ff tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:29.615621 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5cb8f317-9277-4f99-b467-214c2bf3dbc9 req-fcef9812-76bd-4ecb-bda4-dec1bfd8d0ff tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ae35dc07-1896-4a17-978c-12bd32bd62a8 HTTP/1.1" status: 200 len: 944 time: 0.1884236 Dec 09 21:43:29.620213 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-480deb4c-49d0-4396-96ff-fb7aba1d3576 None None] For port ca9e286d-93af-4003-876d-25896dc48ef2, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=ca9e286d-93af-4003-876d-25896dc48ef2,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:29.620884 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-480deb4c-49d0-4396-96ff-fb7aba1d3576 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:29.629073 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9adf8b16-c984-4ef1-b808-6253a8473852 req-9cc1037b-cc03-41f2-95e9-0810f5e72cb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:29.630533 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9adf8b16-c984-4ef1-b808-6253a8473852 req-9cc1037b-cc03-41f2-95e9-0810f5e72cb0 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=24afae0e-0a38-484d-a023-a2fb471bdb33 HTTP/1.1" status: 200 len: 854 time: 0.1408076 Dec 09 21:43:29.630908 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af66afda-5a1d-4dc6-aa53-9f884169233e req-44b48496-16ed-4861-9fa2-81aa77979d10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:29.633133 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-af66afda-5a1d-4dc6-aa53-9f884169233e req-44b48496-16ed-4861-9fa2-81aa77979d10 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=f832d472c11f4b9090837d07f510849a&device_id=6817b8ca-c51a-46d0-8c87-3cf63d444459 HTTP/1.1" status: 200 len: 1098 time: 0.0862496 Dec 09 21:43:29.636635 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-480deb4c-49d0-4396-96ff-fb7aba1d3576 None None] Calling delete_port for ca9e286d-93af-4003-876d-25896dc48ef2 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:43:29.683411 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9adf8b16-c984-4ef1-b808-6253a8473852 req-cd78212b-6478-4b1c-a475-85ee52c2fe6f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eda4cb39-afde-43d7-a13b-5227cc6862dd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0421741 Dec 09 21:43:29.707191 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-21348a20-87ce-47b0-b387-3b8bab0991b1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:29.710943 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-21348a20-87ce-47b0-b387-3b8bab0991b1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:29.746653 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-480deb4c-49d0-4396-96ff-fb7aba1d3576 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:29.796720 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-480deb4c-49d0-4396-96ff-fb7aba1d3576 None None] Pushing event deleted for resources: {'Port': ['ID=ca9e286d-93af-4003-876d-25896dc48ef2,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:29.799767 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-480deb4c-49d0-4396-96ff-fb7aba1d3576 None None] No DVR routers for this DVR port ca9e286d-93af-4003-876d-25896dc48ef2 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:43:29.814225 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5cb8f317-9277-4f99-b467-214c2bf3dbc9 req-b4d4396a-ed9f-41c5-b887-dfb6cdf3e700 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1863139 Dec 09 21:43:29.822425 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af66afda-5a1d-4dc6-aa53-9f884169233e req-5d2ba226-032d-47e8-b356-9e80a0602a31 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:29.824323 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-af66afda-5a1d-4dc6-aa53-9f884169233e req-5d2ba226-032d-47e8-b356-9e80a0602a31 service neutron] 10.222.0.31 "GET /v2.0/networks?id=7104ce0f-c225-47d9-9c49-c01b517dbac9 HTTP/1.1" status: 200 len: 909 time: 0.1633718 Dec 09 21:43:29.930891 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9adf8b16-c984-4ef1-b808-6253a8473852 req-6d197cce-2da2-4c93-a19d-800e28904014 service neutron] 10.222.0.31 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2342834 Dec 09 21:43:29.931579 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-af66afda-5a1d-4dc6-aa53-9f884169233e req-58db6d56-8a59-4aaf-b6e4-6c8c841a8fdf service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60 HTTP/1.1" status: 200 len: 217 time: 0.0848644 Dec 09 21:43:29.997424 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af66afda-5a1d-4dc6-aa53-9f884169233e req-824a97a3-df9c-422e-840a-5448a089b5fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:29.999104 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-af66afda-5a1d-4dc6-aa53-9f884169233e req-824a97a3-df9c-422e-840a-5448a089b5fb service neutron] 10.222.0.31 "GET /v2.0/subnets?id=f1d3a5cf-34a0-4be7-b1d4-5dfaca5a6107 HTTP/1.1" status: 200 len: 848 time: 0.0555112 Dec 09 21:43:30.073269 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-af66afda-5a1d-4dc6-aa53-9f884169233e req-9df34391-2ec8-419b-8b90-922aa9d2512f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=7104ce0f-c225-47d9-9c49-c01b517dbac9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0652750 Dec 09 21:43:30.285871 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-af66afda-5a1d-4dc6-aa53-9f884169233e req-552d35c5-b5b1-4b90-85e0-0d3bba28500b service neutron] 10.222.0.31 "GET /v2.0/networks/7104ce0f-c225-47d9-9c49-c01b517dbac9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2050529 Dec 09 21:43:30.451638 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device ca9e286d-93af-4003-876d-25896dc48ef2 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:43:30.473293 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-af66afda-5a1d-4dc6-aa53-9f884169233e req-dd6dd106-04e8-4064-84a8-bc4308508510 service neutron] 10.222.0.31 "GET /v2.0/networks/7104ce0f-c225-47d9-9c49-c01b517dbac9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1806705 Dec 09 21:43:30.488719 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: ca9e286d-93af-4003-876d-25896dc48ef2 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:43:30.489409 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device ca9e286d-93af-4003-876d-25896dc48ef2 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:43:30.744303 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9adf8b16-c984-4ef1-b808-6253a8473852 req-93ba025d-92c3-4417-af71-6d234597e1a3 service neutron] 10.222.0.31 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7940409 Dec 09 21:43:30.819292 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-189ac605-f0e2-4a18-982f-1853031adb1f req-488fd414-9dc8-453a-901d-c93638f1fb76 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:30.820988 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-189ac605-f0e2-4a18-982f-1853031adb1f req-488fd414-9dc8-453a-901d-c93638f1fb76 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/ports?device_id=6817b8ca-c51a-46d0-8c87-3cf63d444459 HTTP/1.1" status: 200 len: 946 time: 0.0911679 Dec 09 21:43:30.867323 n-d-713301-27 neutron-server[103438]: DEBUG neutron.objects.ports [None req-21348a20-87ce-47b0-b387-3b8bab0991b1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103438) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 09 21:43:30.875664 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-21348a20-87ce-47b0-b387-3b8bab0991b1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:30.943642 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21348a20-87ce-47b0-b387-3b8bab0991b1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:30.951418 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-21348a20-87ce-47b0-b387-3b8bab0991b1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:30.956649 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21348a20-87ce-47b0-b387-3b8bab0991b1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:30.957256 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-21348a20-87ce-47b0-b387-3b8bab0991b1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:30.965264 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4d6be25-faec-447e-bbeb-8813f6f35f1e None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:30.975678 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-189ac605-f0e2-4a18-982f-1853031adb1f req-d1ae0942-e20f-40a9-9a9a-fda89565b8d3 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/security-groups?id=f7ac2409-fc2d-46c4-9c5c-d8bca8738561&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1397538 Dec 09 21:43:30.983336 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21348a20-87ce-47b0-b387-3b8bab0991b1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=22c16818-b1e6-4e92-a265-c46a955bc6b1,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:31.029244 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-21348a20-87ce-47b0-b387-3b8bab0991b1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 1.5946543 Dec 09 21:43:31.034977 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37940) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:31.041418 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-7bc4b167-f2e2-45e9-a511-3e596c60b320 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:31.119030 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cc04aecb-787a-4aa4-af91-b5923497d0d0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'fixed_ips': [{'subnet_id': '22c16818-b1e6-4e92-a265-c46a955bc6b1'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:43:31.120280 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cc04aecb-787a-4aa4-af91-b5923497d0d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:31.183166 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6561ef79-d7c3-4f0b-96a0-682937e529ee req-9ea16846-56b6-4bab-8aaa-50fbab848bce tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:31.191588 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6561ef79-d7c3-4f0b-96a0-682937e529ee req-9ea16846-56b6-4bab-8aaa-50fbab848bce tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ae35dc07-1896-4a17-978c-12bd32bd62a8 HTTP/1.1" status: 200 len: 944 time: 0.1208103 Dec 09 21:43:31.304128 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7bc4b167-f2e2-45e9-a511-3e596c60b320 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:31.310648 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7bc4b167-f2e2-45e9-a511-3e596c60b320 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:31.331899 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6561ef79-d7c3-4f0b-96a0-682937e529ee req-8a04f507-8296-4737-a45d-0ffcfcfbd4e0 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1393042 Dec 09 21:43:31.359184 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-cc04aecb-787a-4aa4-af91-b5923497d0d0 None None] Allocated IP 2001:db8::f816:3eff:fed8:de1b (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/22c16818-b1e6-4e92-a265-c46a955bc6b1/396b59d3-7246-4e52-9a74-80587e445e7a) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:31.437450 n-d-713301-27 neutron-server[103438]: INFO neutron.db.ipam_backend_mixin [None req-7bc4b167-f2e2-45e9-a511-3e596c60b320 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 22c16818-b1e6-4e92-a265-c46a955bc6b1 (CIDR: 2001:db8::/64) Dec 09 21:43:31.441967 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-7bc4b167-f2e2-45e9-a511-3e596c60b320 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:43:31.442699 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7bc4b167-f2e2-45e9-a511-3e596c60b320 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:31.468310 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7bc4b167-f2e2-45e9-a511-3e596c60b320 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.4318607 Dec 09 21:43:31.470694 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37950) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:31.478408 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-3996ee3d-33e7-49f6-942a-3eafe67f03de tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:31.544515 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cc04aecb-787a-4aa4-af91-b5923497d0d0 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:31.552297 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cc04aecb-787a-4aa4-af91-b5923497d0d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:31.629830 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3996ee3d-33e7-49f6-942a-3eafe67f03de tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:31.632105 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc04aecb-787a-4aa4-af91-b5923497d0d0 None None] Pushing event updated for resources: {'Port': ['ID=396b59d3-7246-4e52-9a74-80587e445e7a,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:31.633715 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3996ee3d-33e7-49f6-942a-3eafe67f03de tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:31.644646 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc04aecb-787a-4aa4-af91-b5923497d0d0 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:31.646684 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 33cf4605-a408-4847-9394-fe8acf994c40 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:43:31.650505 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-cc04aecb-787a-4aa4-af91-b5923497d0d0 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:31.657804 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc04aecb-787a-4aa4-af91-b5923497d0d0 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:43:31.740511 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-cc04aecb-787a-4aa4-af91-b5923497d0d0 None None] Attempting to bind port 396b59d3-7246-4e52-9a74-80587e445e7a on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:43:31.740790 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-cc04aecb-787a-4aa4-af91-b5923497d0d0 None None] Attempting to bind port 396b59d3-7246-4e52-9a74-80587e445e7a by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:43:31.741153 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc04aecb-787a-4aa4-af91-b5923497d0d0 None None] Attempting to bind port 396b59d3-7246-4e52-9a74-80587e445e7a on network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:43:31.794436 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc04aecb-787a-4aa4-af91-b5923497d0d0 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 43, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:43:31.795190 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc04aecb-787a-4aa4-af91-b5923497d0d0 None None] Checking segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:43:31.796009 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cc04aecb-787a-4aa4-af91-b5923497d0d0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:31.796938 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc04aecb-787a-4aa4-af91-b5923497d0d0 None None] Bound using segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:43:31.797356 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-cc04aecb-787a-4aa4-af91-b5923497d0d0 None None] Bound port: 396b59d3-7246-4e52-9a74-80587e445e7a, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:43:31.797836 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cc04aecb-787a-4aa4-af91-b5923497d0d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:31.884061 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 33cf4605-a408-4847-9394-fe8acf994c40, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=33cf4605-a408-4847-9394-fe8acf994c40,segment=NetworkSegment(0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5),segment_id=0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:31.902242 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-cc04aecb-787a-4aa4-af91-b5923497d0d0 None None] For port 396b59d3-7246-4e52-9a74-80587e445e7a, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:43:31.905976 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-cc04aecb-787a-4aa4-af91-b5923497d0d0 None None] For port 396b59d3-7246-4e52-9a74-80587e445e7a, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=396b59d3-7246-4e52-9a74-80587e445e7a,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:43:31.907402 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '33cf4605-a408-4847-9394-fe8acf994c40', 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd', 'port_id': '33cf4605-a408-4847-9394-fe8acf994c40', 'mac_address': 'fa:16:3e:42:02:0d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '24afae0e-0a38-484d-a023-a2fb471bdb33', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:43:31.909695 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3996ee3d-33e7-49f6-942a-3eafe67f03de tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:31.931001 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3996ee3d-33e7-49f6-942a-3eafe67f03de tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:31.933819 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-3996ee3d-33e7-49f6-942a-3eafe67f03de tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:31.955729 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:31.959212 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cc04aecb-787a-4aa4-af91-b5923497d0d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:31.971752 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3996ee3d-33e7-49f6-942a-3eafe67f03de tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:31.972953 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3996ee3d-33e7-49f6-942a-3eafe67f03de tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:32.022690 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc04aecb-787a-4aa4-af91-b5923497d0d0 None None] Pushing event updated for resources: {'Port': ['ID=396b59d3-7246-4e52-9a74-80587e445e7a,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:32.039753 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 33cf4605-a408-4847-9394-fe8acf994c40 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:43:32.062677 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3996ee3d-33e7-49f6-942a-3eafe67f03de tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.5894787 Dec 09 21:43:32.066396 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 37962) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:32.073009 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-4d0c6627-3587-4690-9f22-ad08b3ef46f0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'mac_address': 'fa:16:3e:8c:d4:a8', 'name': 'tempest-NetworksTestDHCPv6-833700788'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:32.099192 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c01a2fbb-28cc-472b-89fb-1d01779f9c42 req-9aa021cc-000a-4894-8a85-f487b8f274bc tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:32.106744 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c01a2fbb-28cc-472b-89fb-1d01779f9c42 req-9aa021cc-000a-4894-8a85-f487b8f274bc tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.31 "GET /v2.0/ports?device_id=6817b8ca-c51a-46d0-8c87-3cf63d444459 HTTP/1.1" status: 200 len: 946 time: 0.1316848 Dec 09 21:43:32.113080 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 33cf4605-a408-4847-9394-fe8acf994c40, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=33cf4605-a408-4847-9394-fe8acf994c40,segment=NetworkSegment(0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5),segment_id=0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:32.127707 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:32.136992 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3996ee3d-33e7-49f6-942a-3eafe67f03de tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=9284a734-40f1-479e-af24-a7e6c6853033,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:32.229965 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=33cf4605-a408-4847-9394-fe8acf994c40,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:32.259001 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8fff480-83cd-4683-8a60-46df6c9cb652 req-89181f52-55c7-4a7e-bc1c-e0d1d6e27bc0 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:32.267389 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8fff480-83cd-4683-8a60-46df6c9cb652 req-89181f52-55c7-4a7e-bc1c-e0d1d6e27bc0 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/ports?device_id=6817b8ca-c51a-46d0-8c87-3cf63d444459 HTTP/1.1" status: 200 len: 946 time: 0.1568146 Dec 09 21:43:32.309791 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4d0c6627-3587-4690-9f22-ad08b3ef46f0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:32.347428 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['33cf4605-a408-4847-9394-fe8acf994c40'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:43:32.375996 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8fff480-83cd-4683-8a60-46df6c9cb652 req-2fe70938-fca4-47d2-9f6b-c2adf91bdab8 tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/security-groups?id=f7ac2409-fc2d-46c4-9c5c-d8bca8738561&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1072376 Dec 09 21:43:32.461892 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-c01a2fbb-28cc-472b-89fb-1d01779f9c42 req-29e4f095-652d-40ae-9dec-8bcb8eac39fb tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Deleting port 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:43:32.461892 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c01a2fbb-28cc-472b-89fb-1d01779f9c42 req-29e4f095-652d-40ae-9dec-8bcb8eac39fb tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:32.577046 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d0c6627-3587-4690-9f22-ad08b3ef46f0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:32.630508 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-4d0c6627-3587-4690-9f22-ad08b3ef46f0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] device_id is not set on port 5a7fd0aa-e618-4a78-855c-4654d39fd1b7 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:43:32.666601 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-926a989a-da9e-4b47-a969-2e425af55eff req-58ee3b9f-f646-4c86-872a-21fb37a2ee85 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:32.668073 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-926a989a-da9e-4b47-a969-2e425af55eff req-58ee3b9f-f646-4c86-872a-21fb37a2ee85 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ae35dc07-1896-4a17-978c-12bd32bd62a8 HTTP/1.1" status: 200 len: 945 time: 0.1290524 Dec 09 21:43:32.674845 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-c01a2fbb-28cc-472b-89fb-1d01779f9c42 req-29e4f095-652d-40ae-9dec-8bcb8eac39fb tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] For port 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60,segment=NetworkSegment(d82da970-cb23-48b1-8606-d6809e0c864c),segment_id=d82da970-cb23-48b1-8606-d6809e0c864c)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:32.675011 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c01a2fbb-28cc-472b-89fb-1d01779f9c42 req-29e4f095-652d-40ae-9dec-8bcb8eac39fb tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:32.705098 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-c01a2fbb-28cc-472b-89fb-1d01779f9c42 req-29e4f095-652d-40ae-9dec-8bcb8eac39fb tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Calling delete_port for 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:43:32.755488 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-926a989a-da9e-4b47-a969-2e425af55eff req-00265ec9-68a1-4c89-8866-c337b7cf35b3 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0661621 Dec 09 21:43:32.940139 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c01a2fbb-28cc-472b-89fb-1d01779f9c42 req-29e4f095-652d-40ae-9dec-8bcb8eac39fb tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:32.949741 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-4d0c6627-3587-4690-9f22-ad08b3ef46f0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8:0:1::1be (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/9284a734-40f1-479e-af24-a7e6c6853033/5a7fd0aa-e618-4a78-855c-4654d39fd1b7) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:32.958261 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-91ec0515-4e43-4f4f-bf9f-a8ad7ad40a9b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:32.963255 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-4d0c6627-3587-4690-9f22-ad08b3ef46f0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8::f816:3eff:fe8c:d4a8 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/22c16818-b1e6-4e92-a265-c46a955bc6b1/5a7fd0aa-e618-4a78-855c-4654d39fd1b7) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:32.977833 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29e4f095-652d-40ae-9dec-8bcb8eac39fb tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Pushing event deleted for resources: {'Port': ['ID=6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:33.036932 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-c01a2fbb-28cc-472b-89fb-1d01779f9c42 req-29e4f095-652d-40ae-9dec-8bcb8eac39fb tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] No DVR routers for this DVR port 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60 on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:43:33.039683 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c01a2fbb-28cc-472b-89fb-1d01779f9c42 req-29e4f095-652d-40ae-9dec-8bcb8eac39fb tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:33.043693 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c01a2fbb-28cc-472b-89fb-1d01779f9c42 req-29e4f095-652d-40ae-9dec-8bcb8eac39fb tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.31 "DELETE /v2.0/ports/6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60 HTTP/1.1" status: 204 len: 173 time: 0.9313107 Dec 09 21:43:33.044170 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6817b8ca-c51a-46d0-8c87-3cf63d444459', 'name': 'network-vif-deleted', 'tag': '6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:43:33.046541 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-620e3d3c-5e4f-4484-a94a-9f222400d8fc" -d '{"events": [{"server_uuid": "6817b8ca-c51a-46d0-8c87-3cf63d444459", "name": "network-vif-deleted", "tag": "6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:43:33.125968 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:43:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-93f48a00-6bdf-4673-95e1-daa448daea56 x-openstack-request-id: req-93f48a00-6bdf-4673-95e1-daa448daea56 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:43:33.126248 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6817b8ca-c51a-46d0-8c87-3cf63d444459", "name": "network-vif-deleted", "tag": "6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:43:33.126529 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-93f48a00-6bdf-4673-95e1-daa448daea56 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:43:33.126968 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6817b8ca-c51a-46d0-8c87-3cf63d444459', 'name': 'network-vif-deleted', 'tag': '6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60', 'status': 'completed', 'code': 200} Dec 09 21:43:33.174489 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d0c6627-3587-4690-9f22-ad08b3ef46f0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:33.230050 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d0c6627-3587-4690-9f22-ad08b3ef46f0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:33.282511 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d0c6627-3587-4690-9f22-ad08b3ef46f0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:33.285779 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-4d0c6627-3587-4690-9f22-ad08b3ef46f0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:33.288917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d0c6627-3587-4690-9f22-ad08b3ef46f0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:43:33.294924 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d0c6627-3587-4690-9f22-ad08b3ef46f0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:33.299779 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d0c6627-3587-4690-9f22-ad08b3ef46f0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:33.314157 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d0c6627-3587-4690-9f22-ad08b3ef46f0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=5a7fd0aa-e618-4a78-855c-4654d39fd1b7,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:33.332131 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 37984) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:33.332422 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4d0c6627-3587-4690-9f22-ad08b3ef46f0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1033 time: 1.2636204 Dec 09 21:43:33.505746 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-8487c2d2-c707-4ca9-9300-4f381177400f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting port 5a7fd0aa-e618-4a78-855c-4654d39fd1b7 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:43:33.506094 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8487c2d2-c707-4ca9-9300-4f381177400f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:33.670737 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 33cf4605-a408-4847-9394-fe8acf994c40 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:43:33.707888 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3ad5b246-9821-4631-9a07-be4c4ce212d8 req-608f3fed-8f53-4522-a90f-fed30f47f7ae tempest-ServerTagsTestJSON-1932568610 tempest-ServerTagsTestJSON-1932568610-project] 10.222.0.13 "GET /v2.0/ports?device_id=6817b8ca-c51a-46d0-8c87-3cf63d444459 HTTP/1.1" status: 200 len: 210 time: 0.1664402 Dec 09 21:43:33.766652 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a6e6b4c9-5c58-4536-8098-0ea8a40f618a None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:33.830762 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8487c2d2-c707-4ca9-9300-4f381177400f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:33.846817 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-8487c2d2-c707-4ca9-9300-4f381177400f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Calling delete_port for 5a7fd0aa-e618-4a78-855c-4654d39fd1b7 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:43:33.946681 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 33cf4605-a408-4847-9394-fe8acf994c40 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:43:33.953359 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-691c03d8-fd1e-42b0-b478-31b9665062a7 None None] Provisioning complete for port 396b59d3-7246-4e52-9a74-80587e445e7a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:33.953792 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-691c03d8-fd1e-42b0-b478-31b9665062a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:33.972059 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 33cf4605-a408-4847-9394-fe8acf994c40 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:33.972594 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:33.993415 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d5d1ca6-40eb-47b0-94cc-0071a22f2ba6 req-cd7cbc01-3c67-4f29-bdb5-94fe463a6e54 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:33.995546 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5d5d1ca6-40eb-47b0-94cc-0071a22f2ba6 req-cd7cbc01-3c67-4f29-bdb5-94fe463a6e54 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ae35dc07-1896-4a17-978c-12bd32bd62a8 HTTP/1.1" status: 200 len: 945 time: 0.0847137 Dec 09 21:43:34.124920 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5d5d1ca6-40eb-47b0-94cc-0071a22f2ba6 req-9e09be72-5fa2-43f6-9048-e2f3256d5f9a tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1181307 Dec 09 21:43:34.213780 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8487c2d2-c707-4ca9-9300-4f381177400f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:34.278287 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8487c2d2-c707-4ca9-9300-4f381177400f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Port': ['ID=5a7fd0aa-e618-4a78-855c-4654d39fd1b7,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:34.338483 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8487c2d2-c707-4ca9-9300-4f381177400f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:34.342259 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8487c2d2-c707-4ca9-9300-4f381177400f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/5a7fd0aa-e618-4a78-855c-4654d39fd1b7 HTTP/1.1" status: 204 len: 168 time: 1.0090570 Dec 09 21:43:34.344789 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38010) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:34.357056 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51d444f7-0893-430c-8f3d-9c665b8a8b3b None None] Update dhcp port {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'fixed_ips': [{'subnet_id': '22c16818-b1e6-4e92-a265-c46a955bc6b1', 'ip_address': '2001:db8::f816:3eff:fed8:de1b'}, {'subnet_id': '9284a734-40f1-479e-af24-a7e6c6853033'}], 'binding:host_id': 'n-d-713301-27'}, 'id': '396b59d3-7246-4e52-9a74-80587e445e7a'} from n-d-713301-27. {{(pid=103439) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 09 21:43:34.364220 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-691c03d8-fd1e-42b0-b478-31b9665062a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:34.433032 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:34.486771 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a178e563-8ab9-4221-835a-01968ce59f68 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:34.491099 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a178e563-8ab9-4221-835a-01968ce59f68 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 961 time: 0.1452572 Dec 09 21:43:34.494050 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38018) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:34.503855 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-691c03d8-fd1e-42b0-b478-31b9665062a7 None None] For port 396b59d3-7246-4e52-9a74-80587e445e7a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=396b59d3-7246-4e52-9a74-80587e445e7a,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:34.508363 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-51d444f7-0893-430c-8f3d-9c665b8a8b3b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:34.529605 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 396b59d3-7246-4e52-9a74-80587e445e7a up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:43:34.534837 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-691c03d8-fd1e-42b0-b478-31b9665062a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:34.583193 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-580e2d46-9d02-4a60-b8f5-8861db24e554 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:34.584437 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-580e2d46-9d02-4a60-b8f5-8861db24e554 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 961 time: 0.0894151 Dec 09 21:43:34.587271 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38020) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:34.648069 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ae35dc07-1896-4a17-978c-12bd32bd62a8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '33cf4605-a408-4847-9394-fe8acf994c40'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:43:34.650657 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d005a997-3aa7-418c-a042-f841dd6cdbb7" -d '{"events": [{"server_uuid": "ae35dc07-1896-4a17-978c-12bd32bd62a8", "name": "network-vif-plugged", "status": "completed", "tag": "33cf4605-a408-4847-9394-fe8acf994c40"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:43:34.671500 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-184a181c-e08e-4fc9-95f1-13f6d27dabf8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:34.675148 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-184a181c-e08e-4fc9-95f1-13f6d27dabf8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:34.676870 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-184a181c-e08e-4fc9-95f1-13f6d27dabf8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:34.681676 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38024) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:34.681893 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-184a181c-e08e-4fc9-95f1-13f6d27dabf8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2097 time: 0.0933218 Dec 09 21:43:34.765763 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-b0af14d8-e2d4-4541-aadb-ae40461be417 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet 22c16818-b1e6-4e92-a265-c46a955bc6b1 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:43:34.770064 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b0af14d8-e2d4-4541-aadb-ae40461be417 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:34.799752 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38028) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:34.907219 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b0af14d8-e2d4-4541-aadb-ae40461be417 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:34.967555 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-3f18793a-2bd6-4feb-8a53-a56c707ec753 admin admin] Deleting subnet f1d3a5cf-34a0-4be7-b1d4-5dfaca5a6107 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:43:34.975306 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f18793a-2bd6-4feb-8a53-a56c707ec753 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:34.984826 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 33cf4605-a408-4847-9394-fe8acf994c40, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=33cf4605-a408-4847-9394-fe8acf994c40,segment=NetworkSegment(0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5),segment_id=0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:35.042367 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:35.043171 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:43:35.058395 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f18793a-2bd6-4feb-8a53-a56c707ec753 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:35.108991 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f18793a-2bd6-4feb-8a53-a56c707ec753 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:35.124803 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b0af14d8-e2d4-4541-aadb-ae40461be417 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:35.182364 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f18793a-2bd6-4feb-8a53-a56c707ec753 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:35.188082 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:43:35.189244 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6fb6ec0c-5264-4d4d-a8fa-d8a8345e8c60 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:43:35.198798 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-691c03d8-fd1e-42b0-b478-31b9665062a7 None None] Pushing event updated for resources: {'Port': ['ID=396b59d3-7246-4e52-9a74-80587e445e7a,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:35.216386 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b0af14d8-e2d4-4541-aadb-ae40461be417 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:35.220671 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-691c03d8-fd1e-42b0-b478-31b9665062a7 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:35.221004 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-691c03d8-fd1e-42b0-b478-31b9665062a7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:35.221338 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-691c03d8-fd1e-42b0-b478-31b9665062a7 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:35.221676 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-691c03d8-fd1e-42b0-b478-31b9665062a7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:35.222011 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-691c03d8-fd1e-42b0-b478-31b9665062a7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:35.222338 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-691c03d8-fd1e-42b0-b478-31b9665062a7 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:35.222667 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-691c03d8-fd1e-42b0-b478-31b9665062a7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:35.222991 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-691c03d8-fd1e-42b0-b478-31b9665062a7 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:35.223314 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-691c03d8-fd1e-42b0-b478-31b9665062a7 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:35.223662 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-691c03d8-fd1e-42b0-b478-31b9665062a7 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:35.223982 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-691c03d8-fd1e-42b0-b478-31b9665062a7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:35.224313 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-691c03d8-fd1e-42b0-b478-31b9665062a7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:35.224631 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-691c03d8-fd1e-42b0-b478-31b9665062a7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server [None req-51d444f7-0893-430c-8f3d-9c665b8a8b3b None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 22c16818-b1e6-4e92-a265-c46a955bc6b1: This subnet is being modified by another concurrent operation. Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 343, in update_dhcp_port Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'update_port') Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 118, in _port_action Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return plugin.update_port(context, port['id'], port) Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1744, in update_port Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server updated_port = super(Ml2Plugin, self).update_port(context, id, Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1515, in update_port Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.ipam.update_port( Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 737, in update_port Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server changes = self.update_port_with_ips(context, Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 427, in update_port_with_ips Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server changes = self._update_ips_for_port(context, Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 351, in _update_ips_for_port Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnet.lock_register( Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise exception Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 22c16818-b1e6-4e92-a265-c46a955bc6b1: This subnet is being modified by another concurrent operation. Dec 09 21:43:35.233973 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Dec 09 21:43:35.254463 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f18793a-2bd6-4feb-8a53-a56c707ec753 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f1d3a5cf-34a0-4be7-b1d4-5dfaca5a6107,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:35.258639 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f18793a-2bd6-4feb-8a53-a56c707ec753 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:35.262930 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3f18793a-2bd6-4feb-8a53-a56c707ec753 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/f1d3a5cf-34a0-4be7-b1d4-5dfaca5a6107 HTTP/1.1" status: 204 len: 168 time: 0.4614837 Dec 09 21:43:35.265512 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38042) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:35.294702 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 396b59d3-7246-4e52-9a74-80587e445e7a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:35.295002 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:35.334859 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:43:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b721245c-beb9-4ac0-8bdb-b2500adf1ae1 x-openstack-request-id: req-b721245c-beb9-4ac0-8bdb-b2500adf1ae1 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:43:35.335146 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ae35dc07-1896-4a17-978c-12bd32bd62a8", "name": "network-vif-plugged", "status": "completed", "tag": "33cf4605-a408-4847-9394-fe8acf994c40", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:43:35.335566 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-b721245c-beb9-4ac0-8bdb-b2500adf1ae1 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:43:35.335978 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ae35dc07-1896-4a17-978c-12bd32bd62a8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '33cf4605-a408-4847-9394-fe8acf994c40', 'code': 200} Dec 09 21:43:35.341924 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0af14d8-e2d4-4541-aadb-ae40461be417 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=22c16818-b1e6-4e92-a265-c46a955bc6b1,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:35.364916 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b0af14d8-e2d4-4541-aadb-ae40461be417 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:35.377261 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=33cf4605-a408-4847-9394-fe8acf994c40,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:35.385595 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38046) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:35.389018 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b0af14d8-e2d4-4541-aadb-ae40461be417 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/22c16818-b1e6-4e92-a265-c46a955bc6b1 HTTP/1.1" status: 204 len: 168 time: 0.7057948 Dec 09 21:43:35.390030 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6ec9bfc2-0726-4fee-a115-78e87d402c2e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:35.408416 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-bb42bf44-e7eb-44ca-8a90-b0e7b8413075 None None] Provisioning complete for port 396b59d3-7246-4e52-9a74-80587e445e7a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:35.408855 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bb42bf44-e7eb-44ca-8a90-b0e7b8413075 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:35.505254 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e525c640-a4a1-4ec3-b016-e5b6f4178d90 req-1047b29e-aad3-40e9-83e0-95ad3c49a4e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:35.506861 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e525c640-a4a1-4ec3-b016-e5b6f4178d90 req-1047b29e-aad3-40e9-83e0-95ad3c49a4e6 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=ae35dc07-1896-4a17-978c-12bd32bd62a8 HTTP/1.1" status: 200 len: 1098 time: 0.1163373 Dec 09 21:43:35.510856 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b838a87-4518-45dc-97a9-0bfc2ad64db4 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:35.541145 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6ec9bfc2-0726-4fee-a115-78e87d402c2e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:35.543164 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8c0403b-2207-49da-a398-2238909749fe req-ca61d8a9-3527-4a96-be11-d0ccc2e25747 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:35.551774 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8c0403b-2207-49da-a398-2238909749fe req-ca61d8a9-3527-4a96-be11-d0ccc2e25747 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ae35dc07-1896-4a17-978c-12bd32bd62a8 HTTP/1.1" status: 200 len: 946 time: 0.0988133 Dec 09 21:43:35.563888 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-6ec9bfc2-0726-4fee-a115-78e87d402c2e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7104ce0f-c225-47d9-9c49-c01b517dbac9']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:43:35.575838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-6ec9bfc2-0726-4fee-a115-78e87d402c2e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd82da970-cb23-48b1-8606-d6809e0c864c') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:43:35.576120 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-6ec9bfc2-0726-4fee-a115-78e87d402c2e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd82da970-cb23-48b1-8606-d6809e0c864c') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:43:35.592059 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6ec9bfc2-0726-4fee-a115-78e87d402c2e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:35.606953 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6ec9bfc2-0726-4fee-a115-78e87d402c2e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:35.607972 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e525c640-a4a1-4ec3-b016-e5b6f4178d90 req-888e8e2c-6266-4dc0-a89e-2959df8750cc service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0905828 Dec 09 21:43:35.613405 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6ec9bfc2-0726-4fee-a115-78e87d402c2e admin admin] Releasing vlan 126 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:43:35.613828 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6ec9bfc2-0726-4fee-a115-78e87d402c2e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:35.635585 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8c0403b-2207-49da-a398-2238909749fe req-737a763c-5fa8-4382-8938-9c1bac811095 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0828187 Dec 09 21:43:35.653559 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6f00c17d-bd51-4eff-9ef4-a4a2b7fcf5e3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:43:35.671980 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:43:35.685370 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-beabdc21-1cc6-4c50-b253-5cceb1ed31a6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet 9284a734-40f1-479e-af24-a7e6c6853033 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:43:35.691781 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-beabdc21-1cc6-4c50-b253-5cceb1ed31a6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:35.713556 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6ec9bfc2-0726-4fee-a115-78e87d402c2e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:35.725469 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6ec9bfc2-0726-4fee-a115-78e87d402c2e admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:35.728832 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6ec9bfc2-0726-4fee-a115-78e87d402c2e admin admin] 10.222.0.13 "DELETE /v2.0/networks/7104ce0f-c225-47d9-9c49-c01b517dbac9 HTTP/1.1" status: 204 len: 168 time: 0.4619546 Dec 09 21:43:35.749046 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ec9bfc2-0726-4fee-a115-78e87d402c2e admin admin] Pushing event deleted for resources: {'Network': ['ID=7104ce0f-c225-47d9-9c49-c01b517dbac9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:35.759799 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-beabdc21-1cc6-4c50-b253-5cceb1ed31a6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:35.772735 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-bb42bf44-e7eb-44ca-8a90-b0e7b8413075 None None] Could not find standard attr ID for object 5a7fd0aa-e618-4a78-855c-4654d39fd1b7. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:43:35.841966 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-beabdc21-1cc6-4c50-b253-5cceb1ed31a6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:35.864528 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bec1a8e6-2087-438e-90d5-43ddb889103f None None] Update dhcp port {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'fixed_ips': [{'subnet_id': '9284a734-40f1-479e-af24-a7e6c6853033'}], 'binding:host_id': 'n-d-713301-27'}, 'id': '396b59d3-7246-4e52-9a74-80587e445e7a'} from n-d-713301-27. {{(pid=103439) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 09 21:43:35.896111 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-aa291707-de9c-4b8e-b00d-1d03e7fd33e2 None None] Could not find standard attr ID for object 5a7fd0aa-e618-4a78-855c-4654d39fd1b7. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:43:35.898173 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bec1a8e6-2087-438e-90d5-43ddb889103f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:35.953809 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-beabdc21-1cc6-4c50-b253-5cceb1ed31a6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:35.980008 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38060) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:36.017035 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-beabdc21-1cc6-4c50-b253-5cceb1ed31a6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=9284a734-40f1-479e-af24-a7e6c6853033,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:36.019199 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-beabdc21-1cc6-4c50-b253-5cceb1ed31a6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:36.036205 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-beabdc21-1cc6-4c50-b253-5cceb1ed31a6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/9284a734-40f1-479e-af24-a7e6c6853033 HTTP/1.1" status: 204 len: 168 time: 0.6387033 Dec 09 21:43:36.040544 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38066) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:36.042071 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-17896dc2-7c1e-47a5-be81-25b12e0f9145 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=f832d472c11f4b9090837d07f510849a&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0601974 Dec 09 21:43:36.043010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38068) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server [None req-bec1a8e6-2087-438e-90d5-43ddb889103f None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 9284a734-40f1-479e-af24-a7e6c6853033: This subnet is being modified by another concurrent operation. Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 343, in update_dhcp_port Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'update_port') Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 118, in _port_action Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return plugin.update_port(context, port['id'], port) Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1744, in update_port Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server updated_port = super(Ml2Plugin, self).update_port(context, id, Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1515, in update_port Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.ipam.update_port( Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 737, in update_port Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server changes = self.update_port_with_ips(context, Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 427, in update_port_with_ips Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server changes = self._update_ips_for_port(context, Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 351, in _update_ips_for_port Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnet.lock_register( Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise exception Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 9284a734-40f1-479e-af24-a7e6c6853033: This subnet is being modified by another concurrent operation. Dec 09 21:43:36.051729 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Dec 09 21:43:36.119908 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5242ecfb-48b6-4de9-bda4-b163ad346e60 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:36.132564 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b7c08d9b-5d11-4e28-a452-729a76390a0d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0898333 Dec 09 21:43:36.133891 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38072) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:36.137691 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c8a98fe5-99ca-4889-926a-2eb62fe00a51 None None] Provisioning complete for port 396b59d3-7246-4e52-9a74-80587e445e7a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:36.138191 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c8a98fe5-99ca-4889-926a-2eb62fe00a51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:36.147590 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-07249589-2097-4766-be33-d288d944efbb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:36.177138 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5242ecfb-48b6-4de9-bda4-b163ad346e60 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:36.249522 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-40e4b044-4ec1-4185-80d5-600582b9b160 None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 21:43:36.263865 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5242ecfb-48b6-4de9-bda4-b163ad346e60 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:36.267795 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5242ecfb-48b6-4de9-bda4-b163ad346e60 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:36.271882 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5242ecfb-48b6-4de9-bda4-b163ad346e60 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/f7ac2409-fc2d-46c4-9c5c-d8bca8738561 HTTP/1.1" status: 204 len: 168 time: 0.2274647 Dec 09 21:43:36.286203 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5242ecfb-48b6-4de9-bda4-b163ad346e60 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f7ac2409-fc2d-46c4-9c5c-d8bca8738561,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:36.336179 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-40e4b044-4ec1-4185-80d5-600582b9b160 None None] Resources bound (agent type, host, resource id): {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 09 21:43:36.382325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-07249589-2097-4766-be33-d288d944efbb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:36.396919 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-07249589-2097-4766-be33-d288d944efbb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:36.414357 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 396b59d3-7246-4e52-9a74-80587e445e7a no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:43:36.654707 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:36.679487 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:36.777214 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 396b59d3-7246-4e52-9a74-80587e445e7a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=396b59d3-7246-4e52-9a74-80587e445e7a,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:36.785995 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:36.880076 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=396b59d3-7246-4e52-9a74-80587e445e7a,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:36.905362 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ede5e66c-34e6-47b0-93e6-393a5f2e309c req-fd6f03ac-14b2-49ae-b024-8ce063ec5f8e tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:36.908483 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-553cdc08-8f07-4697-a36d-f759885c5ab5 None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 21:43:36.908839 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ede5e66c-34e6-47b0-93e6-393a5f2e309c req-fd6f03ac-14b2-49ae-b024-8ce063ec5f8e tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ae35dc07-1896-4a17-978c-12bd32bd62a8 HTTP/1.1" status: 200 len: 946 time: 0.1195455 Dec 09 21:43:36.995842 n-d-713301-27 neutron-server[103438]: DEBUG neutron.objects.ports [None req-07249589-2097-4766-be33-d288d944efbb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=103438) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 09 21:43:37.011859 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d380c4ad-83f0-46da-aa01-28e270a60b73 None None] Provisioning complete for port 396b59d3-7246-4e52-9a74-80587e445e7a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:37.014837 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d380c4ad-83f0-46da-aa01-28e270a60b73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:37.082690 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-553cdc08-8f07-4697-a36d-f759885c5ab5 None None] Resources bound (agent type, host, resource id): {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 09 21:43:37.169969 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ede5e66c-34e6-47b0-93e6-393a5f2e309c req-dfd8dddc-52cd-44bb-ade7-e682bee541e9 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2248440 Dec 09 21:43:37.242128 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-07249589-2097-4766-be33-d288d944efbb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:37.295666 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d380c4ad-83f0-46da-aa01-28e270a60b73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:37.340743 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-d380c4ad-83f0-46da-aa01-28e270a60b73 None None] For port 396b59d3-7246-4e52-9a74-80587e445e7a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=396b59d3-7246-4e52-9a74-80587e445e7a,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:37.374561 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.db.api [None req-07249589-2097-4766-be33-d288d944efbb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103438) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:43:37.375666 n-d-713301-27 neutron-server[103438]: DEBUG oslo_db.api [None req-07249589-2097-4766-be33-d288d944efbb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:43:37.429101 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d380c4ad-83f0-46da-aa01-28e270a60b73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:37.473670 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d380c4ad-83f0-46da-aa01-28e270a60b73 None None] Provisioning complete for port 33cf4605-a408-4847-9394-fe8acf994c40 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:37.474137 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d380c4ad-83f0-46da-aa01-28e270a60b73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:37.523107 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d380c4ad-83f0-46da-aa01-28e270a60b73 None None] Pushing event updated for resources: {'Port': ['ID=396b59d3-7246-4e52-9a74-80587e445e7a,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:37.930179 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-07249589-2097-4766-be33-d288d944efbb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:37.977787 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:38.129298 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-07249589-2097-4766-be33-d288d944efbb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] For port 396b59d3-7246-4e52-9a74-80587e445e7a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=396b59d3-7246-4e52-9a74-80587e445e7a,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:38.166396 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-07249589-2097-4766-be33-d288d944efbb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:38.172801 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-07249589-2097-4766-be33-d288d944efbb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:38.173663 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-07249589-2097-4766-be33-d288d944efbb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:38.230783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07249589-2097-4766-be33-d288d944efbb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=3b606100-c19b-4b3a-b167-4499ca484986,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:38.276418 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07249589-2097-4766-be33-d288d944efbb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:38.279613 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-07249589-2097-4766-be33-d288d944efbb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:38.287659 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-07249589-2097-4766-be33-d288d944efbb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:38.288257 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-07249589-2097-4766-be33-d288d944efbb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:38.310765 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07249589-2097-4766-be33-d288d944efbb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=396b59d3-7246-4e52-9a74-80587e445e7a,revision_number=8']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:38.334994 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-07249589-2097-4766-be33-d288d944efbb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 2.1973133 Dec 09 21:43:38.336052 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38156) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:38.342210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-f8a89715-9ccc-48d6-8853-cf6f721bdc69 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:38.510219 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf6c6b7a-69d6-4eaa-a52d-6ca355f7cf48 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:38.563179 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe9c0eea-493c-4101-aa01-ed8ab903c3d3 req-f8285065-4bf4-4d62-882c-5c10244552af tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:38.579175 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe9c0eea-493c-4101-aa01-ed8ab903c3d3 req-f8285065-4bf4-4d62-882c-5c10244552af tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ae35dc07-1896-4a17-978c-12bd32bd62a8 HTTP/1.1" status: 200 len: 946 time: 0.0890462 Dec 09 21:43:38.595010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f8a89715-9ccc-48d6-8853-cf6f721bdc69 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:38.598752 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f8a89715-9ccc-48d6-8853-cf6f721bdc69 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:38.626797 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 396b59d3-7246-4e52-9a74-80587e445e7a up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:43:38.724407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-02209e66-e381-4093-8d9f-9f1b52d8c65d None None] Provisioning complete for port 396b59d3-7246-4e52-9a74-80587e445e7a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:38.725087 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-02209e66-e381-4093-8d9f-9f1b52d8c65d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:38.830847 n-d-713301-27 neutron-server[103438]: INFO neutron.db.ipam_backend_mixin [None req-f8a89715-9ccc-48d6-8853-cf6f721bdc69 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 3b606100-c19b-4b3a-b167-4499ca484986 (CIDR: 2001:db8::/64) Dec 09 21:43:38.836491 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe9c0eea-493c-4101-aa01-ed8ab903c3d3 req-d6efe865-3dc9-4870-8baf-e95bd2a544e1 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2525170 Dec 09 21:43:38.838928 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-f8a89715-9ccc-48d6-8853-cf6f721bdc69 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:43:38.839558 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f8a89715-9ccc-48d6-8853-cf6f721bdc69 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:38.858225 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 396b59d3-7246-4e52-9a74-80587e445e7a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:38.859265 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:38.879548 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f8a89715-9ccc-48d6-8853-cf6f721bdc69 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.5419245 Dec 09 21:43:38.882791 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38174) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:38.888134 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c1b44879-a9b4-42ff-ba91-4b9063d8c669 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:39.062994 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6d15ac8-5386-47b0-9694-b1d2aa95546f req-ebde1c8c-e36b-4046-aaef-69fea18a4f87 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0459750 Dec 09 21:43:39.176586 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c1b44879-a9b4-42ff-ba91-4b9063d8c669 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:39.180908 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c1b44879-a9b4-42ff-ba91-4b9063d8c669 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:39.560847 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a22ed799-2dfb-44c5-b73d-7dcb42ce8a9d None None] Provisioning complete for port 396b59d3-7246-4e52-9a74-80587e445e7a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:39.563550 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a22ed799-2dfb-44c5-b73d-7dcb42ce8a9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:39.608370 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c1b44879-a9b4-42ff-ba91-4b9063d8c669 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:39.680356 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1b44879-a9b4-42ff-ba91-4b9063d8c669 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:39.683679 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-c1b44879-a9b4-42ff-ba91-4b9063d8c669 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:39.688471 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1b44879-a9b4-42ff-ba91-4b9063d8c669 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:39.689002 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c1b44879-a9b4-42ff-ba91-4b9063d8c669 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:39.698020 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:39.699615 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-086d14a1-dd26-44ef-81e5-cfafff4e0db0 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:39.714436 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1b44879-a9b4-42ff-ba91-4b9063d8c669 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=e2abab01-e703-4662-bdf2-e41f69bbb92d,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:39.746879 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c1b44879-a9b4-42ff-ba91-4b9063d8c669 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.8628120 Dec 09 21:43:39.750341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38196) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:39.756475 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-141e35ae-3774-4dc1-9270-3a88c797debb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'mac_address': 'fa:16:3e:c8:c6:e4', 'name': 'tempest-NetworksTestDHCPv6-1315401307'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:39.977643 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-96b67fac-d2cf-41e1-8e0d-3461158747dd None None] Update dhcp port {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'fixed_ips': [{'subnet_id': '3b606100-c19b-4b3a-b167-4499ca484986', 'ip_address': '2001:db8::f816:3eff:fed8:de1b'}, {'subnet_id': 'e2abab01-e703-4662-bdf2-e41f69bbb92d'}], 'binding:host_id': 'n-d-713301-27'}, 'id': '396b59d3-7246-4e52-9a74-80587e445e7a'} from n-d-713301-27. {{(pid=103439) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 09 21:43:39.999116 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-141e35ae-3774-4dc1-9270-3a88c797debb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:40.032423 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-96b67fac-d2cf-41e1-8e0d-3461158747dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:40.202451 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-141e35ae-3774-4dc1-9270-3a88c797debb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:40.225871 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-141e35ae-3774-4dc1-9270-3a88c797debb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] device_id is not set on port 151a4891-932d-4e6d-bcaf-0358aa0d59cf yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:43:40.276064 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ebf7f020-32f0-405c-9f24-b71f3c2e6f27 req-34593365-0261-4c30-95a8-0ccd974bd6c9 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0464158 Dec 09 21:43:40.302098 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-96b67fac-d2cf-41e1-8e0d-3461158747dd None None] Allocated IP 2001:db8:0:1::2 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/e2abab01-e703-4662-bdf2-e41f69bbb92d/396b59d3-7246-4e52-9a74-80587e445e7a) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:40.436490 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-96b67fac-d2cf-41e1-8e0d-3461158747dd None None] For port 396b59d3-7246-4e52-9a74-80587e445e7a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=396b59d3-7246-4e52-9a74-80587e445e7a,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:40.481495 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-96b67fac-d2cf-41e1-8e0d-3461158747dd None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:40.492801 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-96b67fac-d2cf-41e1-8e0d-3461158747dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:40.584592 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96b67fac-d2cf-41e1-8e0d-3461158747dd None None] Pushing event updated for resources: {'Port': ['ID=396b59d3-7246-4e52-9a74-80587e445e7a,revision_number=9']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:40.778421 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-141e35ae-3774-4dc1-9270-3a88c797debb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8:0:1::394 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/e2abab01-e703-4662-bdf2-e41f69bbb92d/151a4891-932d-4e6d-bcaf-0358aa0d59cf) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:40.786797 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-141e35ae-3774-4dc1-9270-3a88c797debb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8::f816:3eff:fec8:c6e4 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/3b606100-c19b-4b3a-b167-4499ca484986/151a4891-932d-4e6d-bcaf-0358aa0d59cf) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:41.045662 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-141e35ae-3774-4dc1-9270-3a88c797debb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:41.058225 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8b2ba02-74ec-4467-8f68-3035d080b770 req-faf3c8b6-2e49-4218-a9c1-098741cdf320 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0435841 Dec 09 21:43:41.098779 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-141e35ae-3774-4dc1-9270-3a88c797debb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:41.195797 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-141e35ae-3774-4dc1-9270-3a88c797debb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:41.200615 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-141e35ae-3774-4dc1-9270-3a88c797debb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:41.203191 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-141e35ae-3774-4dc1-9270-3a88c797debb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=151a4891-932d-4e6d-bcaf-0358aa0d59cf,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:41.205801 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-141e35ae-3774-4dc1-9270-3a88c797debb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:43:41.212681 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-141e35ae-3774-4dc1-9270-3a88c797debb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:41.213369 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-141e35ae-3774-4dc1-9270-3a88c797debb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:41.242637 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-141e35ae-3774-4dc1-9270-3a88c797debb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1034 time: 1.4903018 Dec 09 21:43:41.245578 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38234) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:41.393651 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-558ff598-eeee-43b3-a47d-86846e75c124 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting port 151a4891-932d-4e6d-bcaf-0358aa0d59cf {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:43:41.394191 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-558ff598-eeee-43b3-a47d-86846e75c124 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:41.460556 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-77720bc6-cedc-471d-91e5-a371dcb74566 req-2b16f461-6592-469d-b22a-5576a0187da9 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0344512 Dec 09 21:43:41.525457 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38248) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:41.553643 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-558ff598-eeee-43b3-a47d-86846e75c124 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:41.557763 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c162b940-faa3-4166-9138-6207a15a5384 None None] Provisioning complete for port 396b59d3-7246-4e52-9a74-80587e445e7a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:41.559753 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c162b940-faa3-4166-9138-6207a15a5384 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:41.588950 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-558ff598-eeee-43b3-a47d-86846e75c124 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Calling delete_port for 151a4891-932d-4e6d-bcaf-0358aa0d59cf owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:43:41.707189 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8ed06a62-13e0-4b66-aaef-2cebfab77718 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:41.843646 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8ed06a62-13e0-4b66-aaef-2cebfab77718 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:41.860581 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8ed06a62-13e0-4b66-aaef-2cebfab77718 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:41.904604 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d21bf49f-bb39-442d-8415-f4c4fd193305 None None] Provisioning complete for port 151a4891-932d-4e6d-bcaf-0358aa0d59cf triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:41.905876 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d21bf49f-bb39-442d-8415-f4c4fd193305 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:41.919429 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8ed06a62-13e0-4b66-aaef-2cebfab77718 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e66db70ca8e445268db00e96ddea3089&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3927100 Dec 09 21:43:41.922886 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38260) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:41.933407 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ed06a62-13e0-4b66-aaef-2cebfab77718 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=519b5756-0e95-44d7-8e4d-3c5fb254ed2b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:42.000920 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d21bf49f-bb39-442d-8415-f4c4fd193305 None None] Port 151a4891-932d-4e6d-bcaf-0358aa0d59cf cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:43:42.033509 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-558ff598-eeee-43b3-a47d-86846e75c124 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:42.055417 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d8b59cd-a684-4298-9c66-3c8f94ed29c8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:42.077220 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-558ff598-eeee-43b3-a47d-86846e75c124 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Port': ['ID=151a4891-932d-4e6d-bcaf-0358aa0d59cf,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:42.142314 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d8b59cd-a684-4298-9c66-3c8f94ed29c8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:42.144780 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-558ff598-eeee-43b3-a47d-86846e75c124 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:42.150390 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-558ff598-eeee-43b3-a47d-86846e75c124 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/151a4891-932d-4e6d-bcaf-0358aa0d59cf HTTP/1.1" status: 204 len: 168 time: 0.9011791 Dec 09 21:43:42.151209 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38266) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:42.211989 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b769247f-0021-44f4-84c8-a958c1c5fd0d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:42.213955 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b769247f-0021-44f4-84c8-a958c1c5fd0d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.0620890 Dec 09 21:43:42.218538 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38270) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:42.261289 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d8b59cd-a684-4298-9c66-3c8f94ed29c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:42.264750 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4d8b59cd-a684-4298-9c66-3c8f94ed29c8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:42.268246 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4d8b59cd-a684-4298-9c66-3c8f94ed29c8 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/519b5756-0e95-44d7-8e4d-3c5fb254ed2b HTTP/1.1" status: 204 len: 168 time: 0.3422832 Dec 09 21:43:42.282829 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d8b59cd-a684-4298-9c66-3c8f94ed29c8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=519b5756-0e95-44d7-8e4d-3c5fb254ed2b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:42.325207 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6356bd3d-14da-45ae-a315-fe4fc36bb992 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:42.327309 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6356bd3d-14da-45ae-a315-fe4fc36bb992 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.1077108 Dec 09 21:43:42.329859 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38274) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:42.441846 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fe4bdfb3-d4fc-4e88-b75e-aa1235ab4d4d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:42.443371 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fe4bdfb3-d4fc-4e88-b75e-aa1235ab4d4d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:42.444897 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fe4bdfb3-d4fc-4e88-b75e-aa1235ab4d4d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:42.449966 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fe4bdfb3-d4fc-4e88-b75e-aa1235ab4d4d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2119 time: 0.1164014 Dec 09 21:43:42.449966 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38276) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:42.473144 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 396b59d3-7246-4e52-9a74-80587e445e7a up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:43:42.538209 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-24e3f4d4-882a-4b0b-ad29-349cf6a7959c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet 3b606100-c19b-4b3a-b167-4499ca484986 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:43:42.546072 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24e3f4d4-882a-4b0b-ad29-349cf6a7959c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:42.564381 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 396b59d3-7246-4e52-9a74-80587e445e7a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:42.564756 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:42.643455 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24e3f4d4-882a-4b0b-ad29-349cf6a7959c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:42.648014 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43de6463-3da3-4881-acd6-257158da7b88 req-15d30f4c-a4fa-4937-b300-72e9aa497dfb tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0395696 Dec 09 21:43:42.802141 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24e3f4d4-882a-4b0b-ad29-349cf6a7959c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:42.834684 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38292) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:42.864377 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-693b6c53-d2d0-4db2-a21c-d4267fb58974 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:42.901111 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24e3f4d4-882a-4b0b-ad29-349cf6a7959c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:42.948575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24e3f4d4-882a-4b0b-ad29-349cf6a7959c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=3b606100-c19b-4b3a-b167-4499ca484986,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:42.954855 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24e3f4d4-882a-4b0b-ad29-349cf6a7959c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:42.959514 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-24e3f4d4-882a-4b0b-ad29-349cf6a7959c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/3b606100-c19b-4b3a-b167-4499ca484986 HTTP/1.1" status: 204 len: 168 time: 0.5085783 Dec 09 21:43:42.962362 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38296) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:42.972004 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b1f9f45-a1c0-4ad9-bae3-45dd9d3214bb None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:43.052937 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-693b6c53-d2d0-4db2-a21c-d4267fb58974 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:43.061858 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-693b6c53-d2d0-4db2-a21c-d4267fb58974 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:43.100422 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-87b2a070-f780-496b-a4c5-7a6bef55e70f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet e2abab01-e703-4662-bdf2-e41f69bbb92d {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:43:43.122261 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-87b2a070-f780-496b-a4c5-7a6bef55e70f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:43.188078 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-693b6c53-d2d0-4db2-a21c-d4267fb58974 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0fb3da1f-f24e-45d9-a316-a84b5767734a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:43.202297 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-693b6c53-d2d0-4db2-a21c-d4267fb58974 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=aad1df6631ab464b8ae60d258008aa72&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3664255 Dec 09 21:43:43.206124 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38304) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:43.226109 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-87b2a070-f780-496b-a4c5-7a6bef55e70f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:43.353300 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-10e32ec5-e86d-4975-92a9-b3fa1f7d4a03 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:43.376506 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a59a0ddc-1d83-43b7-92fa-f740cc29f64f req-72eab0e8-e390-4963-ba61-d2285cfd3fe2 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0349758 Dec 09 21:43:43.410298 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-10e32ec5-e86d-4975-92a9-b3fa1f7d4a03 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:43.412602 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-87b2a070-f780-496b-a4c5-7a6bef55e70f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:43.530808 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-10e32ec5-e86d-4975-92a9-b3fa1f7d4a03 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:43.533665 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-10e32ec5-e86d-4975-92a9-b3fa1f7d4a03 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:43.535263 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-10e32ec5-e86d-4975-92a9-b3fa1f7d4a03 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/0fb3da1f-f24e-45d9-a316-a84b5767734a HTTP/1.1" status: 204 len: 168 time: 0.3281386 Dec 09 21:43:43.545595 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10e32ec5-e86d-4975-92a9-b3fa1f7d4a03 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0fb3da1f-f24e-45d9-a316-a84b5767734a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:43.569315 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-87b2a070-f780-496b-a4c5-7a6bef55e70f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:43.611951 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87b2a070-f780-496b-a4c5-7a6bef55e70f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=e2abab01-e703-4662-bdf2-e41f69bbb92d,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:43.619891 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-87b2a070-f780-496b-a4c5-7a6bef55e70f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:43.624057 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-87b2a070-f780-496b-a4c5-7a6bef55e70f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/e2abab01-e703-4662-bdf2-e41f69bbb92d HTTP/1.1" status: 204 len: 168 time: 0.6601355 Dec 09 21:43:43.626336 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38310) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:43.674982 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-781f55ba-823f-4c7a-9604-6ceb7a6fa3f2 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0446575 Dec 09 21:43:43.675468 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38312) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:43.682533 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b92e292c-b90f-4790-9cd2-6f1b64413aa3 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:43.800083 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b92e292c-b90f-4790-9cd2-6f1b64413aa3 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:43.804471 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b92e292c-b90f-4790-9cd2-6f1b64413aa3 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:44.027997 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b92e292c-b90f-4790-9cd2-6f1b64413aa3 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:44.042339 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a8da4748-5ceb-491d-934e-f024bf7cac27 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:44.060415 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38318) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:44.079694 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f4172b00-f2d4-424f-832f-52e4ac075d8f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:44.118740 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-33a12736-37a6-425c-b05f-4754437fa728 None None] Provisioning complete for port 396b59d3-7246-4e52-9a74-80587e445e7a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:44.119270 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-33a12736-37a6-425c-b05f-4754437fa728 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:44.193017 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f4172b00-f2d4-424f-832f-52e4ac075d8f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:44.199539 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f4172b00-f2d4-424f-832f-52e4ac075d8f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:44.257142 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f4172b00-f2d4-424f-832f-52e4ac075d8f admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=a5ca66776b734c99b3cc0b91a1991866&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1929166 Dec 09 21:43:44.258010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4172b00-f2d4-424f-832f-52e4ac075d8f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5e1e745c-2da0-4e4d-8081-1ea541e3362f,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:44.261983 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38320) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:44.329447 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3e68cf59-a89b-4af0-890a-efcdb1ab2a6f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:44.342895 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-61f217a1-8bf9-49bf-aaa1-0eb19fbd870e None None] Update dhcp port {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'fixed_ips': [{'subnet_id': 'eed0374e-5f18-4c51-955a-aef63c01f904'}], 'binding:host_id': 'n-d-713301-27'}, 'id': '396b59d3-7246-4e52-9a74-80587e445e7a'} from n-d-713301-27. {{(pid=103439) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 09 21:43:44.358099 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3e68cf59-a89b-4af0-890a-efcdb1ab2a6f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:44.387632 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-61f217a1-8bf9-49bf-aaa1-0eb19fbd870e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:44.419907 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3e68cf59-a89b-4af0-890a-efcdb1ab2a6f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:44.423122 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3e68cf59-a89b-4af0-890a-efcdb1ab2a6f admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:44.424445 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3e68cf59-a89b-4af0-890a-efcdb1ab2a6f admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/5e1e745c-2da0-4e4d-8081-1ea541e3362f HTTP/1.1" status: 204 len: 168 time: 0.1612363 Dec 09 21:43:44.457271 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e68cf59-a89b-4af0-890a-efcdb1ab2a6f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5e1e745c-2da0-4e4d-8081-1ea541e3362f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:44.538245 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b92e292c-b90f-4790-9cd2-6f1b64413aa3 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:44.543978 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-b92e292c-b90f-4790-9cd2-6f1b64413aa3 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:44.548380 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b92e292c-b90f-4790-9cd2-6f1b64413aa3 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:44.549020 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b92e292c-b90f-4790-9cd2-6f1b64413aa3 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:44.568051 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b92e292c-b90f-4790-9cd2-6f1b64413aa3 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=eed0374e-5f18-4c51-955a-aef63c01f904,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:44.576977 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b92e292c-b90f-4790-9cd2-6f1b64413aa3 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.9002514 Dec 09 21:43:44.579501 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38328) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:44.585262 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-28480b1a-6f4d-4dac-bfe5-c52abaeea83c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:44.598595 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ff6be07-307e-44f8-ab2c-b1862013fa84 req-47d90153-12ff-4e45-9afe-93309e95c3e6 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0673623 Dec 09 21:43:44.703090 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-61f217a1-8bf9-49bf-aaa1-0eb19fbd870e None None] Allocated IP 2001:db8::2 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/eed0374e-5f18-4c51-955a-aef63c01f904/396b59d3-7246-4e52-9a74-80587e445e7a) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:44.742305 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-28480b1a-6f4d-4dac-bfe5-c52abaeea83c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:44.745991 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-28480b1a-6f4d-4dac-bfe5-c52abaeea83c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:44.834665 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-61f217a1-8bf9-49bf-aaa1-0eb19fbd870e None None] For port 396b59d3-7246-4e52-9a74-80587e445e7a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=396b59d3-7246-4e52-9a74-80587e445e7a,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:44.871650 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-61f217a1-8bf9-49bf-aaa1-0eb19fbd870e None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:44.875395 n-d-713301-27 neutron-server[103437]: INFO neutron.db.ipam_backend_mixin [None req-28480b1a-6f4d-4dac-bfe5-c52abaeea83c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet eed0374e-5f18-4c51-955a-aef63c01f904 (CIDR: 2001:db8::/64) Dec 09 21:43:44.877085 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-61f217a1-8bf9-49bf-aaa1-0eb19fbd870e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:44.880652 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-28480b1a-6f4d-4dac-bfe5-c52abaeea83c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:43:44.881347 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-28480b1a-6f4d-4dac-bfe5-c52abaeea83c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:44.914964 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-28480b1a-6f4d-4dac-bfe5-c52abaeea83c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.3314426 Dec 09 21:43:44.916870 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38336) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:44.927158 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-7522ac66-640a-42e8-aaf8-dc5a1842df99 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:44.960033 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61f217a1-8bf9-49bf-aaa1-0eb19fbd870e None None] Pushing event updated for resources: {'Port': ['ID=396b59d3-7246-4e52-9a74-80587e445e7a,revision_number=12']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:45.087773 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7522ac66-640a-42e8-aaf8-dc5a1842df99 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:45.088560 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:43:45.092753 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7522ac66-640a-42e8-aaf8-dc5a1842df99 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:45.489072 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38354) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:45.626050 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-c995630e-884d-44bd-ab4d-5a4e829c41ec admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1937260205-network', 'tenant_id': '94c88405417a4eea84491e86df14a0b0'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:45.664157 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c995630e-884d-44bd-ab4d-5a4e829c41ec admin admin] Made reservation on behalf of 94c88405417a4eea84491e86df14a0b0 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:45.668222 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c995630e-884d-44bd-ab4d-5a4e829c41ec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:45.695643 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c995630e-884d-44bd-ab4d-5a4e829c41ec admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:45.731110 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb0b4c8d-52a5-4c8b-8105-07cca1ec05b0 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:45.759834 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5ce0ce11-f32b-4aee-b57e-e56104402540 req-b9531a65-cdc1-41a8-a4b3-df78638fd320 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0351727 Dec 09 21:43:45.820711 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c995630e-884d-44bd-ab4d-5a4e829c41ec admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:45.830554 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c995630e-884d-44bd-ab4d-5a4e829c41ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:45.850764 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b9563fdc-0a10-49d0-81f3-1227be590ce0 None None] Provisioning complete for port 396b59d3-7246-4e52-9a74-80587e445e7a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:45.851337 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b9563fdc-0a10-49d0-81f3-1227be590ce0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:45.872858 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c995630e-884d-44bd-ab4d-5a4e829c41ec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=96f2cc1f-4e18-4f36-93f9-bc168eb8b378,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:45.879893 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c995630e-884d-44bd-ab4d-5a4e829c41ec admin admin] vlan segment allocate from pool success with {'vlan_id': 108, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:43:45.894955 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c995630e-884d-44bd-ab4d-5a4e829c41ec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:45.895693 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-c995630e-884d-44bd-ab4d-5a4e829c41ec admin admin] Added segment f69cd9ac-0fbe-4c49-8321-6c397e7fefa4 of type vlan for network f57a042a-7e03-40f8-ab65-0cce91b75390 Dec 09 21:43:45.945072 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c995630e-884d-44bd-ab4d-5a4e829c41ec admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:45.982331 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c995630e-884d-44bd-ab4d-5a4e829c41ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:45.983822 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c995630e-884d-44bd-ab4d-5a4e829c41ec admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:45.984541 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c995630e-884d-44bd-ab4d-5a4e829c41ec admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:46.039952 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c995630e-884d-44bd-ab4d-5a4e829c41ec admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.5488148 Dec 09 21:43:46.040648 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38362) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:46.050557 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-fd1ed2c1-99a6-42ec-b620-e5e4b5f63806 admin admin] Request body: {'subnet': {'network_id': 'f57a042a-7e03-40f8-ab65-0cce91b75390', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1937260205-subnet', 'tenant_id': '94c88405417a4eea84491e86df14a0b0', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:46.073481 n-d-713301-27 neutron-server[103438]: DEBUG neutron.objects.ports [None req-7522ac66-640a-42e8-aaf8-dc5a1842df99 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Time-cost: Fetching 1 ports in 0 security groups {{(pid=103438) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 09 21:43:46.086625 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c995630e-884d-44bd-ab4d-5a4e829c41ec admin admin] Pushing event updated for resources: {'Network': ['ID=f57a042a-7e03-40f8-ab65-0cce91b75390,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:46.098854 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network f57a042a-7e03-40f8-ab65-0cce91b75390 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:43:46.103739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fd1ed2c1-99a6-42ec-b620-e5e4b5f63806 admin admin] Made reservation on behalf of 94c88405417a4eea84491e86df14a0b0 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:46.106968 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd1ed2c1-99a6-42ec-b620-e5e4b5f63806 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:46.265790 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1bb2b3df-730e-4c43-8713-c7ac49f4dd50 None None] Provisioning complete for port 396b59d3-7246-4e52-9a74-80587e445e7a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:46.266910 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1bb2b3df-730e-4c43-8713-c7ac49f4dd50 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:46.295004 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7522ac66-640a-42e8-aaf8-dc5a1842df99 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:46.356589 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd1ed2c1-99a6-42ec-b620-e5e4b5f63806 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:46.432160 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 396b59d3-7246-4e52-9a74-80587e445e7a up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:43:46.432429 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd1ed2c1-99a6-42ec-b620-e5e4b5f63806 admin admin] Pushing event updated for resources: {'Subnet': ['ID=0a3f1058-1106-4429-ab0b-99e5b6e6629d,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:46.444812 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fd1ed2c1-99a6-42ec-b620-e5e4b5f63806 admin admin] Checking segment: {'id': 'f69cd9ac-0fbe-4c49-8321-6c397e7fefa4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'f57a042a-7e03-40f8-ab65-0cce91b75390'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:43:46.445155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd1ed2c1-99a6-42ec-b620-e5e4b5f63806 admin admin] Network hostable DHCP agents. Network: f57a042a-7e03-40f8-ab65-0cce91b75390, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:43:46.464854 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fd1ed2c1-99a6-42ec-b620-e5e4b5f63806 admin admin] Network f57a042a-7e03-40f8-ab65-0cce91b75390 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:43:46.481013 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-7522ac66-640a-42e8-aaf8-dc5a1842df99 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] For port 396b59d3-7246-4e52-9a74-80587e445e7a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=396b59d3-7246-4e52-9a74-80587e445e7a,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:46.481284 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-fd1ed2c1-99a6-42ec-b620-e5e4b5f63806 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, f57a042a-7e03-40f8-ab65-0cce91b75390) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:46.493689 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd1ed2c1-99a6-42ec-b620-e5e4b5f63806 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:46.494226 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-566a728b-bea4-4ed0-aa82-a9b5fa837ee1 None None] Network f57a042a-7e03-40f8-ab65-0cce91b75390 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:46.494415 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd1ed2c1-99a6-42ec-b620-e5e4b5f63806 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:46.513284 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7522ac66-640a-42e8-aaf8-dc5a1842df99 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:46.518315 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fd1ed2c1-99a6-42ec-b620-e5e4b5f63806 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.4738407 Dec 09 21:43:46.538480 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7522ac66-640a-42e8-aaf8-dc5a1842df99 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:46.539128 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7522ac66-640a-42e8-aaf8-dc5a1842df99 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:46.576295 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 396b59d3-7246-4e52-9a74-80587e445e7a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:46.576682 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:46.643321 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7522ac66-640a-42e8-aaf8-dc5a1842df99 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:46.655912 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-7522ac66-640a-42e8-aaf8-dc5a1842df99 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:46.656307 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6ee1285-9efe-40f8-a4c9-7d802c9ab918 None None] Network f57a042a-7e03-40f8-ab65-0cce91b75390 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:46.665581 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7522ac66-640a-42e8-aaf8-dc5a1842df99 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:46.666181 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7522ac66-640a-42e8-aaf8-dc5a1842df99 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:46.677176 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7522ac66-640a-42e8-aaf8-dc5a1842df99 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=e73379ea-a4cd-44a6-85ff-2db7373239af,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:46.692833 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ee98c4f3-d893-45fe-9436-dedd0f5dc0a3 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:46.693168 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7522ac66-640a-42e8-aaf8-dc5a1842df99 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=396b59d3-7246-4e52-9a74-80587e445e7a,revision_number=14']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:46.710088 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7522ac66-640a-42e8-aaf8-dc5a1842df99 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 842 time: 1.7888708 Dec 09 21:43:46.713076 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38372) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:46.720086 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-850f120d-53de-41dd-b6de-453eceefb412 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'mac_address': 'fa:16:3e:c2:2c:76', 'name': 'tempest-NetworksTestDHCPv6-1402920726'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:46.861209 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-850f120d-53de-41dd-b6de-453eceefb412 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:46.956004 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4c25d6bc-51fc-4188-a3ef-0eac00fd22f9 req-5b956b7e-591a-4e4e-b146-3844cc99f949 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0477595 Dec 09 21:43:46.991553 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-850f120d-53de-41dd-b6de-453eceefb412 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:47.012591 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-850f120d-53de-41dd-b6de-453eceefb412 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] device_id is not set on port ef37aee7-4d28-4415-8089-43bddc982b11 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:43:47.222319 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-850f120d-53de-41dd-b6de-453eceefb412 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8::7b (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/eed0374e-5f18-4c51-955a-aef63c01f904/ef37aee7-4d28-4415-8089-43bddc982b11) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:47.235965 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-850f120d-53de-41dd-b6de-453eceefb412 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8:0:1:f816:3eff:fec2:2c76 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/e73379ea-a4cd-44a6-85ff-2db7373239af/ef37aee7-4d28-4415-8089-43bddc982b11) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:47.430872 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-850f120d-53de-41dd-b6de-453eceefb412 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:47.467561 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-850f120d-53de-41dd-b6de-453eceefb412 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:47.519731 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-850f120d-53de-41dd-b6de-453eceefb412 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:47.522971 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-850f120d-53de-41dd-b6de-453eceefb412 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:47.529646 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-850f120d-53de-41dd-b6de-453eceefb412 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:43:47.535663 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-850f120d-53de-41dd-b6de-453eceefb412 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:47.536428 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-850f120d-53de-41dd-b6de-453eceefb412 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:47.544016 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-850f120d-53de-41dd-b6de-453eceefb412 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=ef37aee7-4d28-4415-8089-43bddc982b11,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:47.574421 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38384) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:47.576044 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-850f120d-53de-41dd-b6de-453eceefb412 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1032 time: 0.8609099 Dec 09 21:43:47.734865 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-cf6915c8-2de2-4aed-9e42-d13c2b811cba tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting port ef37aee7-4d28-4415-8089-43bddc982b11 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:43:47.735218 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cf6915c8-2de2-4aed-9e42-d13c2b811cba tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:47.845788 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cf6915c8-2de2-4aed-9e42-d13c2b811cba tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:47.859613 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-cf6915c8-2de2-4aed-9e42-d13c2b811cba tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Calling delete_port for ef37aee7-4d28-4415-8089-43bddc982b11 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:43:47.943582 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-55f47e00-8350-4a79-a981-69b1847e8121 None None] Provisioning complete for port 396b59d3-7246-4e52-9a74-80587e445e7a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:47.944168 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-55f47e00-8350-4a79-a981-69b1847e8121 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:48.142519 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5ce192b7-1f02-4201-9e70-72ba0e361a91 req-073035d2-3392-40bc-bd24-cdce0b5a9de9 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0514767 Dec 09 21:43:48.162262 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cf6915c8-2de2-4aed-9e42-d13c2b811cba tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:48.214187 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf6915c8-2de2-4aed-9e42-d13c2b811cba tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Port': ['ID=ef37aee7-4d28-4415-8089-43bddc982b11,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:48.282801 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cf6915c8-2de2-4aed-9e42-d13c2b811cba tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:48.291830 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cf6915c8-2de2-4aed-9e42-d13c2b811cba tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/ef37aee7-4d28-4415-8089-43bddc982b11 HTTP/1.1" status: 204 len: 168 time: 0.7162330 Dec 09 21:43:48.295065 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38394) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:48.313185 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-aadfdd60-cf73-4934-b756-961f5ec34621 None None] Could not find standard attr ID for object ef37aee7-4d28-4415-8089-43bddc982b11. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:43:48.376787 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2b5b930c-6b55-4872-998d-fd289e23a25b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:48.382177 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38396) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:48.392419 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2b5b930c-6b55-4872-998d-fd289e23a25b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.0958908 Dec 09 21:43:48.447039 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 396b59d3-7246-4e52-9a74-80587e445e7a up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:43:48.448368 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb01032b-c10e-4c01-bf74-bff8b85671c0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:48.454486 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cb01032b-c10e-4c01-bf74-bff8b85671c0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1047 time: 0.0689850 Dec 09 21:43:48.454883 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38398) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:48.503361 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 396b59d3-7246-4e52-9a74-80587e445e7a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:48.503928 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:48.521612 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e8bb7a2-770a-40a2-ab98-4257e49f084d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:48.523040 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e8bb7a2-770a-40a2-ab98-4257e49f084d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:48.524930 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e8bb7a2-770a-40a2-ab98-4257e49f084d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:48.526684 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7e8bb7a2-770a-40a2-ab98-4257e49f084d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2097 time: 0.0707519 Dec 09 21:43:48.529732 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38400) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:48.586831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-34cf1c23-c276-4516-93e1-91d21f877457 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet e73379ea-a4cd-44a6-85ff-2db7373239af {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:43:48.590087 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-34cf1c23-c276-4516-93e1-91d21f877457 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:48.634992 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-34cf1c23-c276-4516-93e1-91d21f877457 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:48.714163 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-34cf1c23-c276-4516-93e1-91d21f877457 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:48.780937 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-34cf1c23-c276-4516-93e1-91d21f877457 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:48.810937 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34cf1c23-c276-4516-93e1-91d21f877457 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=e73379ea-a4cd-44a6-85ff-2db7373239af,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:48.812931 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-34cf1c23-c276-4516-93e1-91d21f877457 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:48.818034 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00c32b25-ea96-4152-b7b4-75de271623f4 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:48.825190 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38404) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:48.830470 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-34cf1c23-c276-4516-93e1-91d21f877457 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/e73379ea-a4cd-44a6-85ff-2db7373239af HTTP/1.1" status: 204 len: 168 time: 0.2854214 Dec 09 21:43:48.879144 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-86b51be7-f30f-42df-b427-6a47486eaf9a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet eed0374e-5f18-4c51-955a-aef63c01f904 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:43:48.882317 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86b51be7-f30f-42df-b427-6a47486eaf9a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:48.929246 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86b51be7-f30f-42df-b427-6a47486eaf9a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:49.016584 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86b51be7-f30f-42df-b427-6a47486eaf9a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:49.085024 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86b51be7-f30f-42df-b427-6a47486eaf9a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:49.117133 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86b51be7-f30f-42df-b427-6a47486eaf9a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=eed0374e-5f18-4c51-955a-aef63c01f904,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:49.122844 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86b51be7-f30f-42df-b427-6a47486eaf9a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:49.126124 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-86b51be7-f30f-42df-b427-6a47486eaf9a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/eed0374e-5f18-4c51-955a-aef63c01f904 HTTP/1.1" status: 204 len: 168 time: 0.2999141 Dec 09 21:43:49.128628 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38406) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:49.166847 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e342076c-3b10-44a2-b9df-2938d3f84653 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0370800 Dec 09 21:43:49.169999 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38408) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:49.175584 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-1be8e31f-324b-429d-a671-5b38da34cd91 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:49.288586 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-937e3d7f-683a-455a-b82a-944cd9d54a66 req-28264abe-fc49-4894-83b7-e848bcfca623 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0347896 Dec 09 21:43:49.324920 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1be8e31f-324b-429d-a671-5b38da34cd91 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:49.324920 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1be8e31f-324b-429d-a671-5b38da34cd91 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:49.540545 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e326e87-fa32-4a47-a9fc-8e5e60378d5e None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:49.598907 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1be8e31f-324b-429d-a671-5b38da34cd91 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:49.635931 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5a39dfca-7ef3-4781-a699-f0796dd28e9c None None] Provisioning complete for port 396b59d3-7246-4e52-9a74-80587e445e7a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:49.636619 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5a39dfca-7ef3-4781-a699-f0796dd28e9c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:49.681580 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1be8e31f-324b-429d-a671-5b38da34cd91 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:49.690188 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-1be8e31f-324b-429d-a671-5b38da34cd91 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:49.699098 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1be8e31f-324b-429d-a671-5b38da34cd91 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:49.699839 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1be8e31f-324b-429d-a671-5b38da34cd91 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:49.709052 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1be8e31f-324b-429d-a671-5b38da34cd91 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=d6a5004d-aef5-4972-9cbd-5f1b91924f75,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:49.734387 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-a5490aad-bb01-4d52-ae01-090d093c6507 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:49.736157 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-a5490aad-bb01-4d52-ae01-090d093c6507 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/networks?id=f57a042a-7e03-40f8-ab65-0cce91b75390 HTTP/1.1" status: 200 len: 809 time: 0.1880884 Dec 09 21:43:49.740534 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1be8e31f-324b-429d-a671-5b38da34cd91 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 834 time: 0.5694699 Dec 09 21:43:49.744396 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38428) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:49.754576 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-1b6ee6bf-5e1a-4503-97a9-a757aa1fe8f0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:49.755229 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-39a71e87-ac43-4b5a-b06c-8a40bd1b0a3b tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/quotas/94c88405417a4eea84491e86df14a0b0 HTTP/1.1" status: 200 len: 375 time: 0.0115814 Dec 09 21:43:49.786822 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dfd7174f-3b4f-401f-ad43-85c898d4f383 None None] DHCP port deletion for 77d1c069-bca4-4157-a30b-fb10cbd9d9ee request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:43:49.805592 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-6c24ed01-538f-42a4-83e7-b75be59da39b tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=94c88405417a4eea84491e86df14a0b0&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0417731 Dec 09 21:43:49.860514 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-dfd7174f-3b4f-401f-ad43-85c898d4f383 None None] Deleting port 396b59d3-7246-4e52-9a74-80587e445e7a {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:43:49.860878 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dfd7174f-3b4f-401f-ad43-85c898d4f383 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:49.911677 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1b6ee6bf-5e1a-4503-97a9-a757aa1fe8f0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:49.916604 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1b6ee6bf-5e1a-4503-97a9-a757aa1fe8f0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:49.918352 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-4315dcc9-f85e-46e7-a3f6-9e89d51c055d service neutron] 10.222.0.13 "GET /v2.0/networks/f57a042a-7e03-40f8-ab65-0cce91b75390?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1039996 Dec 09 21:43:49.952987 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-dfd7174f-3b4f-401f-ad43-85c898d4f383 None None] For port 396b59d3-7246-4e52-9a74-80587e445e7a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=396b59d3-7246-4e52-9a74-80587e445e7a,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:49.954220 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dfd7174f-3b4f-401f-ad43-85c898d4f383 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:49.968419 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-dfd7174f-3b4f-401f-ad43-85c898d4f383 None None] Calling delete_port for 396b59d3-7246-4e52-9a74-80587e445e7a owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:43:50.021249 n-d-713301-27 neutron-server[103437]: INFO neutron.db.ipam_backend_mixin [None req-1b6ee6bf-5e1a-4503-97a9-a757aa1fe8f0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet d6a5004d-aef5-4972-9cbd-5f1b91924f75 (CIDR: 2001:db8::/64) Dec 09 21:43:50.026310 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-1b6ee6bf-5e1a-4503-97a9-a757aa1fe8f0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:43:50.026919 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1b6ee6bf-5e1a-4503-97a9-a757aa1fe8f0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:50.036871 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-eadd73fe-c96e-4aef-9cf1-c2f592fbf1d6 service neutron] 10.222.0.13 "GET /v2.0/networks/f57a042a-7e03-40f8-ab65-0cce91b75390?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1110647 Dec 09 21:43:50.051000 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1b6ee6bf-5e1a-4503-97a9-a757aa1fe8f0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.3054531 Dec 09 21:43:50.054041 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38432) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:50.060186 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-6af42457-5c7d-4de0-9fe4-a4d55288f0fb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'subnet': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:50.073537 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dfd7174f-3b4f-401f-ad43-85c898d4f383 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:50.103683 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfd7174f-3b4f-401f-ad43-85c898d4f383 None None] Pushing event deleted for resources: {'Port': ['ID=396b59d3-7246-4e52-9a74-80587e445e7a,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:50.105715 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfd7174f-3b4f-401f-ad43-85c898d4f383 None None] No DVR routers for this DVR port 396b59d3-7246-4e52-9a74-80587e445e7a on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:43:50.125789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f0d827e-a07f-44ed-af1a-3bd261cd7626 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:50.242517 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6af42457-5c7d-4de0-9fe4-a4d55288f0fb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:50.248002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9ed217ed-cfd9-4b8a-ba95-10d021c8637d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'project_id': '91d65fdee4d24f0fb98cc03c485255f6', 'fixed_ips': [{'subnet_id': 'd6a5004d-aef5-4972-9cbd-5f1b91924f75'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:43:50.249445 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9ed217ed-cfd9-4b8a-ba95-10d021c8637d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:50.251912 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6af42457-5c7d-4de0-9fe4-a4d55288f0fb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:50.294046 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-162352fd-c334-4fac-a81f-2989005f9485 req-0289aaaf-2d73-4246-86a6-4860e34e24a2 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?device_id=b9aa302c-e89a-45cb-8c54-e52687b0927e HTTP/1.1" status: 200 len: 210 time: 0.0621800 Dec 09 21:43:50.461493 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 396b59d3-7246-4e52-9a74-80587e445e7a no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:43:50.491523 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 396b59d3-7246-4e52-9a74-80587e445e7a {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:43:50.491812 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 396b59d3-7246-4e52-9a74-80587e445e7a not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:43:50.513286 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52c8e3ce-82c6-4b82-902e-ed51149ce061 req-06d534fa-a443-47f5-95f5-409f07fb7603 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0685947 Dec 09 21:43:50.513466 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-9ed217ed-cfd9-4b8a-ba95-10d021c8637d None None] Allocated IP 2001:db8::2 (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/d6a5004d-aef5-4972-9cbd-5f1b91924f75/d1e9486a-6984-412d-bec9-99bfe8360991) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:50.705127 n-d-713301-27 neutron-server[103438]: DEBUG neutron.objects.ports [None req-6af42457-5c7d-4de0-9fe4-a4d55288f0fb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103438) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 09 21:43:50.706685 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6af42457-5c7d-4de0-9fe4-a4d55288f0fb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:50.715284 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9ed217ed-cfd9-4b8a-ba95-10d021c8637d None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:50.723928 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9ed217ed-cfd9-4b8a-ba95-10d021c8637d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:50.756989 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6af42457-5c7d-4de0-9fe4-a4d55288f0fb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:50.762679 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-6af42457-5c7d-4de0-9fe4-a4d55288f0fb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:50.766785 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ed217ed-cfd9-4b8a-ba95-10d021c8637d None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:50.767184 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6af42457-5c7d-4de0-9fe4-a4d55288f0fb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:50.767766 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6af42457-5c7d-4de0-9fe4-a4d55288f0fb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:50.772368 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-9ed217ed-cfd9-4b8a-ba95-10d021c8637d None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:50.779588 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ed217ed-cfd9-4b8a-ba95-10d021c8637d None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:43:50.783935 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6af42457-5c7d-4de0-9fe4-a4d55288f0fb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Subnet': ['ID=d244e55c-c98a-417a-a5e0-c83e8663f7a4,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:50.792744 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38448) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:50.793571 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6af42457-5c7d-4de0-9fe4-a4d55288f0fb tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 864 time: 0.7381635 Dec 09 21:43:50.797913 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-e88274a6-f10d-44a3-bee8-84f0b0bc37cd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Request body: {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'mac_address': 'fa:16:3e:1f:c9:df', 'name': 'tempest-NetworksTestDHCPv6-2134970240'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:50.815347 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ed217ed-cfd9-4b8a-ba95-10d021c8637d None None] Pushing event updated for resources: {'Port': ['ID=d1e9486a-6984-412d-bec9-99bfe8360991,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:50.853658 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-9ed217ed-cfd9-4b8a-ba95-10d021c8637d None None] Attempting to bind port d1e9486a-6984-412d-bec9-99bfe8360991 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:43:50.854164 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-9ed217ed-cfd9-4b8a-ba95-10d021c8637d None None] Attempting to bind port d1e9486a-6984-412d-bec9-99bfe8360991 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:43:50.855266 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ed217ed-cfd9-4b8a-ba95-10d021c8637d None None] Attempting to bind port d1e9486a-6984-412d-bec9-99bfe8360991 on network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:43:50.862475 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ed217ed-cfd9-4b8a-ba95-10d021c8637d None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 43, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:43:50.862856 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ed217ed-cfd9-4b8a-ba95-10d021c8637d None None] Checking segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:43:50.863262 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9ed217ed-cfd9-4b8a-ba95-10d021c8637d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:50.863802 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ed217ed-cfd9-4b8a-ba95-10d021c8637d None None] Bound using segment: {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:43:50.864447 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-9ed217ed-cfd9-4b8a-ba95-10d021c8637d None None] Bound port: d1e9486a-6984-412d-bec9-99bfe8360991, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56db00b1-67f7-405d-a5c3-b33daa0250c6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 127, 'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:43:50.864829 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9ed217ed-cfd9-4b8a-ba95-10d021c8637d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:50.948532 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-9ed217ed-cfd9-4b8a-ba95-10d021c8637d None None] For port d1e9486a-6984-412d-bec9-99bfe8360991, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:43:50.953751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-9ed217ed-cfd9-4b8a-ba95-10d021c8637d None None] For port d1e9486a-6984-412d-bec9-99bfe8360991, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d1e9486a-6984-412d-bec9-99bfe8360991,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:43:50.958124 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9ed217ed-cfd9-4b8a-ba95-10d021c8637d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:50.996723 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e88274a6-f10d-44a3-bee8-84f0b0bc37cd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Made reservation on behalf of 91d65fdee4d24f0fb98cc03c485255f6 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:51.002994 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e88274a6-f10d-44a3-bee8-84f0b0bc37cd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:51.039924 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ed217ed-cfd9-4b8a-ba95-10d021c8637d None None] Pushing event updated for resources: {'Port': ['ID=d1e9486a-6984-412d-bec9-99bfe8360991,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:51.041634 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-e88274a6-f10d-44a3-bee8-84f0b0bc37cd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] device_id is not set on port a475e72c-8c52-46b5-af16-610a1011e864 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:43:51.244716 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-e88274a6-f10d-44a3-bee8-84f0b0bc37cd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8::19e (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/d6a5004d-aef5-4972-9cbd-5f1b91924f75/a475e72c-8c52-46b5-af16-610a1011e864) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:51.252302 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-e88274a6-f10d-44a3-bee8-84f0b0bc37cd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Allocated IP 2001:db8:0:1:f816:3eff:fe1f:c9df (77d1c069-bca4-4157-a30b-fb10cbd9d9ee/d244e55c-c98a-417a-a5e0-c83e8663f7a4/a475e72c-8c52-46b5-af16-610a1011e864) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:51.448820 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7e9b409-37c2-4044-bc9c-f89889d96b14 req-fb80adb9-cd49-404e-b290-a2e24d7c1e50 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?device_id=b9aa302c-e89a-45cb-8c54-e52687b0927e HTTP/1.1" status: 200 len: 210 time: 0.0328870 Dec 09 21:43:51.462990 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e88274a6-f10d-44a3-bee8-84f0b0bc37cd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:51.505403 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e88274a6-f10d-44a3-bee8-84f0b0bc37cd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:51.586100 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-c15295c1-e4a9-46fa-b3a8-2e9710e37925 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:51.588269 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-c15295c1-e4a9-46fa-b3a8-2e9710e37925 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.31 "GET /v2.0/networks?id=f57a042a-7e03-40f8-ab65-0cce91b75390 HTTP/1.1" status: 200 len: 809 time: 0.1290603 Dec 09 21:43:51.603774 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-529fb2c4-f377-4b46-b586-9f26a0b9b5e2 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Request body: {'port': {'device_id': 'b9aa302c-e89a-45cb-8c54-e52687b0927e', 'network_id': 'f57a042a-7e03-40f8-ab65-0cce91b75390', 'admin_state_up': True, 'tenant_id': '94c88405417a4eea84491e86df14a0b0'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:51.608055 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e88274a6-f10d-44a3-bee8-84f0b0bc37cd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:51.627741 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-e88274a6-f10d-44a3-bee8-84f0b0bc37cd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:51.630066 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e88274a6-f10d-44a3-bee8-84f0b0bc37cd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event updated for resources: {'Port': ['ID=a475e72c-8c52-46b5-af16-610a1011e864,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:51.638909 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e88274a6-f10d-44a3-bee8-84f0b0bc37cd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:43:51.654147 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e88274a6-f10d-44a3-bee8-84f0b0bc37cd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:51.655019 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e88274a6-f10d-44a3-bee8-84f0b0bc37cd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:51.679521 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e88274a6-f10d-44a3-bee8-84f0b0bc37cd tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1033 time: 0.8855011 Dec 09 21:43:51.682454 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38458) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:51.690642 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51456403-254d-4c55-9206-f77d0f19df19 req-695b59f5-c001-4dea-b60e-c76442f2f407 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0439472 Dec 09 21:43:51.797917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1c640aef-fe65-41d9-bd55-869403f10196 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting port a475e72c-8c52-46b5-af16-610a1011e864 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:43:51.798582 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1c640aef-fe65-41d9-bd55-869403f10196 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:51.801073 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-529fb2c4-f377-4b46-b586-9f26a0b9b5e2 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Made reservation on behalf of 94c88405417a4eea84491e86df14a0b0 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:51.804909 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-529fb2c4-f377-4b46-b586-9f26a0b9b5e2 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:51.936014 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1c640aef-fe65-41d9-bd55-869403f10196 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:51.951124 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1c640aef-fe65-41d9-bd55-869403f10196 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Calling delete_port for a475e72c-8c52-46b5-af16-610a1011e864 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:43:51.995524 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-529fb2c4-f377-4b46-b586-9f26a0b9b5e2 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Allocated IP 172.20.0.2 (f57a042a-7e03-40f8-ab65-0cce91b75390/0a3f1058-1106-4429-ab0b-99e5b6e6629d/ed9ae1ad-3844-40e9-aead-14aa239ad517) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:43:52.170455 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1c640aef-fe65-41d9-bd55-869403f10196 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:52.203963 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c640aef-fe65-41d9-bd55-869403f10196 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Port': ['ID=a475e72c-8c52-46b5-af16-610a1011e864,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:52.248735 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-82cb7454-8952-424a-bfa8-8bdbfc796e6f None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:52.270930 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1c640aef-fe65-41d9-bd55-869403f10196 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:52.278986 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38462) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:52.279361 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1c640aef-fe65-41d9-bd55-869403f10196 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/a475e72c-8c52-46b5-af16-610a1011e864 HTTP/1.1" status: 204 len: 168 time: 0.5955741 Dec 09 21:43:52.320718 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-529fb2c4-f377-4b46-b586-9f26a0b9b5e2 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:52.334229 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-772dae52-b857-4ac2-b167-6d632b482404 None None] Provisioning complete for port d1e9486a-6984-412d-bec9-99bfe8360991 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:52.334834 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-772dae52-b857-4ac2-b167-6d632b482404 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:52.349435 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8fcc6f4-4fea-4ae7-b274-6957cbcb54d8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:52.354517 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c8fcc6f4-4fea-4ae7-b274-6957cbcb54d8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 943 time: 0.0709045 Dec 09 21:43:52.355488 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38464) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:52.424856 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-529fb2c4-f377-4b46-b586-9f26a0b9b5e2 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:52.470970 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c97715ac-9a0b-4f20-9b95-deedf4c93e27 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:52.475567 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38470) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:52.487041 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c97715ac-9a0b-4f20-9b95-deedf4c93e27 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 943 time: 0.1303887 Dec 09 21:43:52.530407 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-772dae52-b857-4ac2-b167-6d632b482404 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:52.546778 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-529fb2c4-f377-4b46-b586-9f26a0b9b5e2 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Network f57a042a-7e03-40f8-ab65-0cce91b75390 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:43:52.552806 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d1e9486a-6984-412d-bec9-99bfe8360991 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:43:52.556896 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-529fb2c4-f377-4b46-b586-9f26a0b9b5e2 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:52.565309 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-529fb2c4-f377-4b46-b586-9f26a0b9b5e2 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:43:52.610043 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-97478566-d08f-4e11-b0a1-be162e5ca6b6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:52.611350 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-97478566-d08f-4e11-b0a1-be162e5ca6b6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:52.616899 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-97478566-d08f-4e11-b0a1-be162e5ca6b6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:52.619114 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-97478566-d08f-4e11-b0a1-be162e5ca6b6 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 2119 time: 0.1424398 Dec 09 21:43:52.622721 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38478) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:52.674698 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-529fb2c4-f377-4b46-b586-9f26a0b9b5e2 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:52.675564 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-529fb2c4-f377-4b46-b586-9f26a0b9b5e2 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:52.693305 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-772dae52-b857-4ac2-b167-6d632b482404 None None] For port d1e9486a-6984-412d-bec9-99bfe8360991, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d1e9486a-6984-412d-bec9-99bfe8360991,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:52.695148 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-16e04fda-8769-4b87-9969-38359b4937b1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet d244e55c-c98a-417a-a5e0-c83e8663f7a4 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:43:52.702079 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16e04fda-8769-4b87-9969-38359b4937b1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:52.706344 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df119441-86fe-4a95-9b07-6af28de459d2 None None] Update dhcp port {'port': {'network_id': '77d1c069-bca4-4157-a30b-fb10cbd9d9ee', 'fixed_ips': [{'subnet_id': 'd6a5004d-aef5-4972-9cbd-5f1b91924f75', 'ip_address': '2001:db8::2'}, {'subnet_id': 'd244e55c-c98a-417a-a5e0-c83e8663f7a4'}], 'binding:host_id': 'n-d-713301-27'}, 'id': 'd1e9486a-6984-412d-bec9-99bfe8360991'} from n-d-713301-27. {{(pid=103439) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 09 21:43:52.754721 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-df119441-86fe-4a95-9b07-6af28de459d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:52.757423 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-772dae52-b857-4ac2-b167-6d632b482404 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:52.759243 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-529fb2c4-f377-4b46-b586-9f26a0b9b5e2 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Pushing event updated for resources: {'Port': ['ID=ed9ae1ad-3844-40e9-aead-14aa239ad517,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:52.761455 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port d1e9486a-6984-412d-bec9-99bfe8360991 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:52.761752 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:52.769530 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-529fb2c4-f377-4b46-b586-9f26a0b9b5e2 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1707985 Dec 09 21:43:52.781537 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16e04fda-8769-4b87-9969-38359b4937b1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:52.785905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-76b10cf7-b13f-4eda-851f-d26a25cfccb5 service neutron] Request body: {'port': {'device_id': 'b9aa302c-e89a-45cb-8c54-e52687b0927e', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:52.842676 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16e04fda-8769-4b87-9969-38359b4937b1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:52.852837 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-444b59d1-ebd8-480a-aaed-7cd14f4c54ed req-e24ca9d7-d0e1-45b9-98b2-e668f0b8145b tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:52.854420 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-444b59d1-ebd8-480a-aaed-7cd14f4c54ed req-e24ca9d7-d0e1-45b9-98b2-e668f0b8145b tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?device_id=b9aa302c-e89a-45cb-8c54-e52687b0927e HTTP/1.1" status: 200 len: 931 time: 0.1761198 Dec 09 21:43:52.940247 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-444b59d1-ebd8-480a-aaed-7cd14f4c54ed req-b0cf017b-5b18-4902-8a2c-1027f292d650 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/security-groups?id=96f2cc1f-4e18-4f36-93f9-bc168eb8b378&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0705905 Dec 09 21:43:52.940949 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-772dae52-b857-4ac2-b167-6d632b482404 None None] Pushing event updated for resources: {'Port': ['ID=d1e9486a-6984-412d-bec9-99bfe8360991,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:52.958977 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16e04fda-8769-4b87-9969-38359b4937b1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:53.010164 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16e04fda-8769-4b87-9969-38359b4937b1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=d244e55c-c98a-417a-a5e0-c83e8663f7a4,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:53.016362 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16e04fda-8769-4b87-9969-38359b4937b1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:53.029394 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-76b10cf7-b13f-4eda-851f-d26a25cfccb5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:53.033439 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-16e04fda-8769-4b87-9969-38359b4937b1 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/d244e55c-c98a-417a-a5e0-c83e8663f7a4 HTTP/1.1" status: 204 len: 168 time: 0.4091082 Dec 09 21:43:53.035830 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38514) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:53.132995 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-67bb561a-feed-449b-8ce1-f77cfcd98308 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Deleting subnet d6a5004d-aef5-4972-9cbd-5f1b91924f75 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server [None req-df119441-86fe-4a95-9b07-6af28de459d2 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet d244e55c-c98a-417a-a5e0-c83e8663f7a4: This subnet is being modified by another concurrent operation. Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 343, in update_dhcp_port Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'update_port') Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 118, in _port_action Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return plugin.update_port(context, port['id'], port) Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1744, in update_port Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server updated_port = super(Ml2Plugin, self).update_port(context, id, Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1515, in update_port Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.ipam.update_port( Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 737, in update_port Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server changes = self.update_port_with_ips(context, Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 427, in update_port_with_ips Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server changes = self._update_ips_for_port(context, Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 351, in _update_ips_for_port Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnet.lock_register( Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise exception Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet d244e55c-c98a-417a-a5e0-c83e8663f7a4: This subnet is being modified by another concurrent operation. Dec 09 21:43:53.135410 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Dec 09 21:43:53.142914 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-67bb561a-feed-449b-8ce1-f77cfcd98308 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:53.181108 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bb343a4f-6fe1-4c06-9533-7ea54a969902 req-d641b764-9ca1-4a08-95fc-186b3c1bd7a2 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.1200535 Dec 09 21:43:53.205079 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-67bb561a-feed-449b-8ce1-f77cfcd98308 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:53.296972 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e471b07f-3b76-4f79-a277-e480020884b4 None None] Provisioning complete for port d1e9486a-6984-412d-bec9-99bfe8360991 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:53.297455 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e471b07f-3b76-4f79-a277-e480020884b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:53.346430 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-67bb561a-feed-449b-8ce1-f77cfcd98308 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:53.443410 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-67bb561a-feed-449b-8ce1-f77cfcd98308 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:53.463760 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-84cff621-45a0-4da7-82bd-c1e5bbe529d8 None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 21:43:53.519014 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67bb561a-feed-449b-8ce1-f77cfcd98308 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Subnet': ['ID=d6a5004d-aef5-4972-9cbd-5f1b91924f75,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:53.522757 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-67bb561a-feed-449b-8ce1-f77cfcd98308 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:53.526132 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-67bb561a-feed-449b-8ce1-f77cfcd98308 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/d6a5004d-aef5-4972-9cbd-5f1b91924f75 HTTP/1.1" status: 204 len: 168 time: 0.4889245 Dec 09 21:43:53.528890 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38554) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:53.560388 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84cff621-45a0-4da7-82bd-c1e5bbe529d8 None None] Resources bound (agent type, host, resource id): {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 09 21:43:53.575685 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-957c59b7-81c4-45b7-8d1f-1e5b3e0a9a3a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0454583 Dec 09 21:43:53.578408 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38562) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:53.636233 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-36668e52-b885-4d3c-b243-01822f335c9a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:53.638544 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-36668e52-b885-4d3c-b243-01822f335c9a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 866 time: 0.0588536 Dec 09 21:43:53.641796 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38568) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:53.691310 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e807a76e-978e-41f4-b943-0658d67a4700 None None] Could not find standard attr ID for object a475e72c-8c52-46b5-af16-610a1011e864. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:43:53.735303 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57bfd6ac-6342-4fe9-b863-4fbc961b949d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:53.737094 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-57bfd6ac-6342-4fe9-b863-4fbc961b949d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 838 time: 0.0938704 Dec 09 21:43:53.739782 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38580) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:53.792937 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-76b10cf7-b13f-4eda-851f-d26a25cfccb5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ed9ae1ad-3844-40e9-aead-14aa239ad517 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:43:53.799158 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bf0db4ba-b3f3-4bec-94d4-80174123e028 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 208 time: 0.0580912 Dec 09 21:43:53.803838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38590) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:53.804187 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-76b10cf7-b13f-4eda-851f-d26a25cfccb5 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:53.819533 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-76b10cf7-b13f-4eda-851f-d26a25cfccb5 service neutron] Transition to ACTIVE for port object ed9ae1ad-3844-40e9-aead-14aa239ad517 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:43:53.828841 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-76b10cf7-b13f-4eda-851f-d26a25cfccb5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:53.844310 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-ac497c81-7cc5-409b-bd06-e80d7ebb13a9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:53.844926 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ac497c81-7cc5-409b-bd06-e80d7ebb13a9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:53.852155 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ac497c81-7cc5-409b-bd06-e80d7ebb13a9 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/a475e72c-8c52-46b5-af16-610a1011e864 HTTP/1.1" status: 404 len: 333 time: 0.0469127 Dec 09 21:43:53.852900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38596) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:53.892125 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-4416ef83-2b56-42a7-9071-849a68d6ed49 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:53.892590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4416ef83-2b56-42a7-9071-849a68d6ed49 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:53.894454 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76b10cf7-b13f-4eda-851f-d26a25cfccb5 service neutron] Pushing event updated for resources: {'Port': ['ID=ed9ae1ad-3844-40e9-aead-14aa239ad517,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:53.900191 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4416ef83-2b56-42a7-9071-849a68d6ed49 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/d244e55c-c98a-417a-a5e0-c83e8663f7a4 HTTP/1.1" status: 404 len: 337 time: 0.0461013 Dec 09 21:43:53.902690 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38602) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:53.932255 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a8ee4612-0496-4fb6-94b6-be27fd88da5b None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 21:43:53.947589 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-641fd8de-a087-4671-9dc7-42eba229985f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:53.948845 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-641fd8de-a087-4671-9dc7-42eba229985f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:53.953355 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-641fd8de-a087-4671-9dc7-42eba229985f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/d6a5004d-aef5-4972-9cbd-5f1b91924f75 HTTP/1.1" status: 404 len: 337 time: 0.0515771 Dec 09 21:43:53.956255 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38610) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:54.008211 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-76b10cf7-b13f-4eda-851f-d26a25cfccb5 service neutron] Attempting to bind port ed9ae1ad-3844-40e9-aead-14aa239ad517 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:43:54.008930 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-76b10cf7-b13f-4eda-851f-d26a25cfccb5 service neutron] Attempting to bind port ed9ae1ad-3844-40e9-aead-14aa239ad517 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'f69cd9ac-0fbe-4c49-8321-6c397e7fefa4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'f57a042a-7e03-40f8-ab65-0cce91b75390'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:43:54.009933 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-76b10cf7-b13f-4eda-851f-d26a25cfccb5 service neutron] Attempting to bind port ed9ae1ad-3844-40e9-aead-14aa239ad517 on network f57a042a-7e03-40f8-ab65-0cce91b75390 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:43:54.014934 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-63d27099-ad1d-443c-956f-f5fcf02f5e10 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:54.015600 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-76b10cf7-b13f-4eda-851f-d26a25cfccb5 service neutron] Port ed9ae1ad-3844-40e9-aead-14aa239ad517 on network f57a042a-7e03-40f8-ab65-0cce91b75390 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:43:54.015724 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-63d27099-ad1d-443c-956f-f5fcf02f5e10 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:54.016499 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-76b10cf7-b13f-4eda-851f-d26a25cfccb5 service neutron] Attempting to bind port ed9ae1ad-3844-40e9-aead-14aa239ad517 on network f57a042a-7e03-40f8-ab65-0cce91b75390 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:43:54.021525 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-63d27099-ad1d-443c-956f-f5fcf02f5e10 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/ef37aee7-4d28-4415-8089-43bddc982b11 HTTP/1.1" status: 404 len: 333 time: 0.0639753 Dec 09 21:43:54.025067 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-76b10cf7-b13f-4eda-851f-d26a25cfccb5 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 43, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:43:54.025425 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-76b10cf7-b13f-4eda-851f-d26a25cfccb5 service neutron] Checking segment: {'id': 'f69cd9ac-0fbe-4c49-8321-6c397e7fefa4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'f57a042a-7e03-40f8-ab65-0cce91b75390'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:43:54.025620 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38620) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:54.025909 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-76b10cf7-b13f-4eda-851f-d26a25cfccb5 service neutron] Bound using segment: {'id': 'f69cd9ac-0fbe-4c49-8321-6c397e7fefa4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'f57a042a-7e03-40f8-ab65-0cce91b75390'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:43:54.031648 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-76b10cf7-b13f-4eda-851f-d26a25cfccb5 service neutron] Bound port: ed9ae1ad-3844-40e9-aead-14aa239ad517, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f69cd9ac-0fbe-4c49-8321-6c397e7fefa4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'f57a042a-7e03-40f8-ab65-0cce91b75390'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:43:54.032672 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-76b10cf7-b13f-4eda-851f-d26a25cfccb5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:54.063350 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8ee4612-0496-4fb6-94b6-be27fd88da5b None None] Resources bound (agent type, host, resource id): {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 09 21:43:54.070280 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4c6a0f67-f66e-4074-97a4-fc2d1453ed89 None None] Provisioning complete for port d1e9486a-6984-412d-bec9-99bfe8360991 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:54.070921 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4c6a0f67-f66e-4074-97a4-fc2d1453ed89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:54.084094 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-2f4825e5-6962-4437-8e43-754cba699870 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:54.085249 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2f4825e5-6962-4437-8e43-754cba699870 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:54.088727 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2f4825e5-6962-4437-8e43-754cba699870 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/e73379ea-a4cd-44a6-85ff-2db7373239af HTTP/1.1" status: 404 len: 337 time: 0.0621042 Dec 09 21:43:54.091262 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38630) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:54.128068 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-7f985192-67ca-42fd-b35a-fdd682a17cd0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:54.128443 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7f985192-67ca-42fd-b35a-fdd682a17cd0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:54.132720 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7f985192-67ca-42fd-b35a-fdd682a17cd0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/eed0374e-5f18-4c51-955a-aef63c01f904 HTTP/1.1" status: 404 len: 337 time: 0.0402019 Dec 09 21:43:54.135364 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38636) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:54.174354 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-fda77dc0-3230-4d3b-9ad2-12a8972f6e5e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:54.175707 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fda77dc0-3230-4d3b-9ad2-12a8972f6e5e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:54.179194 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fda77dc0-3230-4d3b-9ad2-12a8972f6e5e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/151a4891-932d-4e6d-bcaf-0358aa0d59cf HTTP/1.1" status: 404 len: 333 time: 0.0425806 Dec 09 21:43:54.182016 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38642) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:54.183044 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c039fe4-e74e-409e-8587-6ac21390b60c req-2cb686ec-e96a-4cdc-aaae-d9f0b9758dde tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:54.188550 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c039fe4-e74e-409e-8587-6ac21390b60c req-2cb686ec-e96a-4cdc-aaae-d9f0b9758dde tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?device_id=b9aa302c-e89a-45cb-8c54-e52687b0927e HTTP/1.1" status: 200 len: 943 time: 0.0937729 Dec 09 21:43:54.191968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-76b10cf7-b13f-4eda-851f-d26a25cfccb5 service neutron] For port ed9ae1ad-3844-40e9-aead-14aa239ad517, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:43:54.198438 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-76b10cf7-b13f-4eda-851f-d26a25cfccb5 service neutron] For port ed9ae1ad-3844-40e9-aead-14aa239ad517, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ed9ae1ad-3844-40e9-aead-14aa239ad517,segment=NetworkSegment(f69cd9ac-0fbe-4c49-8321-6c397e7fefa4),segment_id=f69cd9ac-0fbe-4c49-8321-6c397e7fefa4)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:43:54.217169 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-76b10cf7-b13f-4eda-851f-d26a25cfccb5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:54.275862 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-76b10cf7-b13f-4eda-851f-d26a25cfccb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:54.276493 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-76b10cf7-b13f-4eda-851f-d26a25cfccb5 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:54.277909 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-76b10cf7-b13f-4eda-851f-d26a25cfccb5 service neutron] 10.222.0.31 "PUT /v2.0/ports/ed9ae1ad-3844-40e9-aead-14aa239ad517 HTTP/1.1" status: 200 len: 1092 time: 1.4974263 Dec 09 21:43:54.278483 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b9aa302c-e89a-45cb-8c54-e52687b0927e', 'tag': 'ed9ae1ad-3844-40e9-aead-14aa239ad517'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:43:54.280954 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ac49334a-167b-4c86-aca4-9079e575019e" -d '{"events": [{"name": "network-changed", "server_uuid": "b9aa302c-e89a-45cb-8c54-e52687b0927e", "tag": "ed9ae1ad-3844-40e9-aead-14aa239ad517"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:43:54.289540 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-570cb200-8966-4999-a917-b7e8e9085e9e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:54.290794 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-570cb200-8966-4999-a917-b7e8e9085e9e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:54.297569 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38656) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:54.298552 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-570cb200-8966-4999-a917-b7e8e9085e9e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/e2abab01-e703-4662-bdf2-e41f69bbb92d HTTP/1.1" status: 404 len: 337 time: 0.1152420 Dec 09 21:43:54.331545 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76b10cf7-b13f-4eda-851f-d26a25cfccb5 service neutron] Pushing event updated for resources: {'Port': ['ID=ed9ae1ad-3844-40e9-aead-14aa239ad517,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:54.353693 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c039fe4-e74e-409e-8587-6ac21390b60c req-a3e1df0b-5724-426f-b7f0-d2304b81f3b7 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/security-groups?id=96f2cc1f-4e18-4f36-93f9-bc168eb8b378&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1492152 Dec 09 21:43:54.401535 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-3bd809c2-daf6-40f7-95c9-2ecd36cd6e84 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:54.402366 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3bd809c2-daf6-40f7-95c9-2ecd36cd6e84 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:54.405889 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3bd809c2-daf6-40f7-95c9-2ecd36cd6e84 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/3b606100-c19b-4b3a-b167-4499ca484986 HTTP/1.1" status: 404 len: 337 time: 0.1043303 Dec 09 21:43:54.408515 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38668) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:54.465656 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-6ad2b4d6-6b53-474e-86ac-192c9df7f0f7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:54.466231 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6ad2b4d6-6b53-474e-86ac-192c9df7f0f7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:54.469433 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6ad2b4d6-6b53-474e-86ac-192c9df7f0f7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/5a7fd0aa-e618-4a78-855c-4654d39fd1b7 HTTP/1.1" status: 404 len: 333 time: 0.0598662 Dec 09 21:43:54.472176 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38674) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:54.506526 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-316c9d26-f7fb-43ab-92fb-84ab4b8eaca7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:54.507072 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-316c9d26-f7fb-43ab-92fb-84ab4b8eaca7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:54.510353 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-316c9d26-f7fb-43ab-92fb-84ab4b8eaca7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/9284a734-40f1-479e-af24-a7e6c6853033 HTTP/1.1" status: 404 len: 337 time: 0.0371239 Dec 09 21:43:54.512008 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-18f6621e-00f8-4633-83df-3528e9adc890 req-69b059e8-94f6-4679-8095-20f9df38b99c tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0507636 Dec 09 21:43:54.513035 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38680) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:54.551677 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-0b19ecf6-3443-4520-8c61-f09f259d08bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:54.553198 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-0b19ecf6-3443-4520-8c61-f09f259d08bc service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=94c88405417a4eea84491e86df14a0b0&device_id=b9aa302c-e89a-45cb-8c54-e52687b0927e HTTP/1.1" status: 200 len: 1095 time: 0.1648090 Dec 09 21:43:54.570221 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-6425f4ca-9b60-4911-a0d9-ae6a05976df4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:54.570675 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6425f4ca-9b60-4911-a0d9-ae6a05976df4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:54.582907 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6425f4ca-9b60-4911-a0d9-ae6a05976df4 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/22c16818-b1e6-4e92-a265-c46a955bc6b1 HTTP/1.1" status: 404 len: 337 time: 0.0688150 Dec 09 21:43:54.585340 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38692) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:54.604324 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d1e9486a-6984-412d-bec9-99bfe8360991 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:43:54.614479 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-bcaf86c4-9e2d-4b18-805a-0a72c646b651 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=ed9ae1ad-3844-40e9-aead-14aa239ad517 HTTP/1.1" status: 200 len: 217 time: 0.0528171 Dec 09 21:43:54.622300 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-f4fa6534-b98e-4fef-8bab-5240fabae537 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:54.623213 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f4fa6534-b98e-4fef-8bab-5240fabae537 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:54.629859 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f4fa6534-b98e-4fef-8bab-5240fabae537 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/bd69991d-aa8a-4d4f-8a60-4acad1444bf1 HTTP/1.1" status: 404 len: 333 time: 0.0434215 Dec 09 21:43:54.630567 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38698) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:54.662312 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-911af29c-9aec-427d-872e-bba9a24f2685 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:54.663041 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-911af29c-9aec-427d-872e-bba9a24f2685 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:54.669362 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-911af29c-9aec-427d-872e-bba9a24f2685 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/08bd9291-cbaf-4c9b-8485-424bf7fc3e93 HTTP/1.1" status: 404 len: 337 time: 0.0375607 Dec 09 21:43:54.670365 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38704) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:54.698181 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-642a5698-299f-4163-aa15-54b231497701 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:54.699396 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-642a5698-299f-4163-aa15-54b231497701 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:54.707463 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-642a5698-299f-4163-aa15-54b231497701 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/6808b887-f205-4ae1-8a73-17f585ec4b31 HTTP/1.1" status: 404 len: 333 time: 0.0352829 Dec 09 21:43:54.708138 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38710) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:54.738670 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-5c8c46f4-795f-49a2-aa7b-7a051a580087 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:54.739243 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5c8c46f4-795f-49a2-aa7b-7a051a580087 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:54.744240 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f223e6a-e5c3-43c1-ad80-5791099ef156 None None] Network 77d1c069-bca4-4157-a30b-fb10cbd9d9ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:54.745923 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5c8c46f4-795f-49a2-aa7b-7a051a580087 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/46b93c9f-f77a-43e0-a8ed-98f34d70d52c HTTP/1.1" status: 404 len: 337 time: 0.0360646 Dec 09 21:43:54.746510 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38714) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:54.754984 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a0a0ddc2-8032-4377-a886-61a5a79804db None None] DHCP port deletion for f57a042a-7e03-40f8-ab65-0cce91b75390 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:43:54.758272 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-25ee2e92-39f3-44f7-a0bb-8726d32a4a91 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:54.760873 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-25ee2e92-39f3-44f7-a0bb-8726d32a4a91 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=0a3f1058-1106-4429-ab0b-99e5b6e6629d HTTP/1.1" status: 200 len: 849 time: 0.1350899 Dec 09 21:43:54.794339 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-ced50111-c455-43aa-a583-b7c1618a04ed tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:54.795154 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ced50111-c455-43aa-a583-b7c1618a04ed tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:54.803032 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ced50111-c455-43aa-a583-b7c1618a04ed tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/c3b5994c-2c6a-43c3-97d9-b4aa49cbf7ff HTTP/1.1" status: 404 len: 333 time: 0.0533941 Dec 09 21:43:54.804289 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:54.806234 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38722) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:54.832247 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:43:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-27b0159a-141e-491f-af35-92a7c0445109 x-openstack-request-id: req-27b0159a-141e-491f-af35-92a7c0445109 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:43:54.832597 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b9aa302c-e89a-45cb-8c54-e52687b0927e", "tag": "ed9ae1ad-3844-40e9-aead-14aa239ad517", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:43:54.832901 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-27b0159a-141e-491f-af35-92a7c0445109 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:43:54.833317 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b9aa302c-e89a-45cb-8c54-e52687b0927e', 'tag': 'ed9ae1ad-3844-40e9-aead-14aa239ad517', 'status': 'completed', 'code': 200} Dec 09 21:43:54.842948 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5771195c-72bf-42ca-a9de-382763cded6d None None] Provisioning complete for port d1e9486a-6984-412d-bec9-99bfe8360991 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:54.843064 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5771195c-72bf-42ca-a9de-382763cded6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:54.848242 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7ed898b0-55d4-4636-ae98-294a1654c530 None None] DHCP port deletion for f57a042a-7e03-40f8-ab65-0cce91b75390 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:43:54.867694 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-cbb60a11-c956-414a-a09d-8f3fc7907751 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=f57a042a-7e03-40f8-ab65-0cce91b75390&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0846713 Dec 09 21:43:54.869284 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-134fc2d2-14e6-4404-b337-6f472ced9e3d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:54.869813 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-134fc2d2-14e6-4404-b337-6f472ced9e3d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:54.873182 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-134fc2d2-14e6-4404-b337-6f472ced9e3d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/df5c3238-287e-4140-b9e2-7176b28a25de HTTP/1.1" status: 404 len: 337 time: 0.0657873 Dec 09 21:43:54.876704 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38734) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:54.924723 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-2b3fcc8a-3025-493e-8a7a-ebaf0aab0a4d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:54.925328 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2b3fcc8a-3025-493e-8a7a-ebaf0aab0a4d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:54.928797 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2b3fcc8a-3025-493e-8a7a-ebaf0aab0a4d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/c1635861-d959-441d-b18e-57c3159ba99f HTTP/1.1" status: 404 len: 333 time: 0.0512085 Dec 09 21:43:54.931403 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port d1e9486a-6984-412d-bec9-99bfe8360991, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d1e9486a-6984-412d-bec9-99bfe8360991,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:54.931617 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38742) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:54.942880 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:54.978388 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-5321a0c0-7f46-4eb7-acc5-a50d8a6a5085 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:54.979030 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5321a0c0-7f46-4eb7-acc5-a50d8a6a5085 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:54.985320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38750) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:54.988694 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5321a0c0-7f46-4eb7-acc5-a50d8a6a5085 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/cb982511-19f0-492e-9b00-ffe000f9f935 HTTP/1.1" status: 404 len: 337 time: 0.0553229 Dec 09 21:43:55.007188 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=d1e9486a-6984-412d-bec9-99bfe8360991,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:55.028034 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-62864bc2-6606-4755-b24e-c64cce6d615b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:55.029345 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-62864bc2-6606-4755-b24e-c64cce6d615b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:55.035737 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38756) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:55.037011 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-62864bc2-6606-4755-b24e-c64cce6d615b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/61b3ff76-539a-47f8-9015-eb71fc4cc015 HTTP/1.1" status: 404 len: 333 time: 0.0505755 Dec 09 21:43:55.050224 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5771195c-72bf-42ca-a9de-382763cded6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:55.052508 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90a32ee6-7a66-403f-b01f-1f7c93fcf87e None None] DHCP port deletion for 77d1c069-bca4-4157-a30b-fb10cbd9d9ee request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:43:55.077786 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-66c9a110-cd3f-420c-b904-1bfc4b41b83b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:55.078440 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-66c9a110-cd3f-420c-b904-1bfc4b41b83b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:55.081689 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-66c9a110-cd3f-420c-b904-1bfc4b41b83b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/86ed7d54-5dd3-4691-9996-5c7271fa131a HTTP/1.1" status: 404 len: 337 time: 0.0448327 Dec 09 21:43:55.084088 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38766) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:55.120327 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-5771195c-72bf-42ca-a9de-382763cded6d None None] For port d1e9486a-6984-412d-bec9-99bfe8360991, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d1e9486a-6984-412d-bec9-99bfe8360991,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:55.126004 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-e9bfd05c-dff9-4992-9f84-6e4af8b5b8b8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:55.126587 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e9bfd05c-dff9-4992-9f84-6e4af8b5b8b8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:55.129747 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e9bfd05c-dff9-4992-9f84-6e4af8b5b8b8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/ce3d0753-3ee3-4e46-bd4f-bebf44a753f3 HTTP/1.1" status: 404 len: 333 time: 0.0447745 Dec 09 21:43:55.129872 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5771195c-72bf-42ca-a9de-382763cded6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:55.132407 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38772) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:55.162451 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-5e2f222b-340b-4037-80f5-4d61569ed896 service neutron] 10.222.0.31 "GET /v2.0/networks/f57a042a-7e03-40f8-ab65-0cce91b75390?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2870057 Dec 09 21:43:55.163940 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-d1e366c0-e8bf-47f1-81e3-bf2edef8013b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:55.165056 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d1e366c0-e8bf-47f1-81e3-bf2edef8013b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:55.168112 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d1e366c0-e8bf-47f1-81e3-bf2edef8013b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/79132eaa-0a21-4aa0-a2d9-fcd65fcdbcd9 HTTP/1.1" status: 404 len: 337 time: 0.0341287 Dec 09 21:43:55.169598 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-90a32ee6-7a66-403f-b01f-1f7c93fcf87e None None] Deleting port d1e9486a-6984-412d-bec9-99bfe8360991 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:43:55.169974 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-90a32ee6-7a66-403f-b01f-1f7c93fcf87e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:55.170584 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38778) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:55.209106 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5771195c-72bf-42ca-a9de-382763cded6d None None] Pushing event updated for resources: {'Port': ['ID=d1e9486a-6984-412d-bec9-99bfe8360991,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:55.216695 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-44267615-edc5-417d-bcfb-77026ee41bce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:55.217162 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-44267615-edc5-417d-bcfb-77026ee41bce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:55.220357 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-44267615-edc5-417d-bcfb-77026ee41bce tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/7ecd0290-8cac-4b5e-8f40-e79e7dbc96da HTTP/1.1" status: 404 len: 337 time: 0.0487828 Dec 09 21:43:55.223055 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38788) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:55.263151 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-cda9d4c2-2cbb-427d-90b5-c4472edbb30d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:55.264419 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-cda9d4c2-2cbb-427d-90b5-c4472edbb30d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:55.269541 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cda9d4c2-2cbb-427d-90b5-c4472edbb30d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/9745fac0-f778-44f1-8420-22a3be4d2478 HTTP/1.1" status: 404 len: 333 time: 0.0453277 Dec 09 21:43:55.272096 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38794) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:55.280377 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-90a32ee6-7a66-403f-b01f-1f7c93fcf87e None None] For port d1e9486a-6984-412d-bec9-99bfe8360991, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d1e9486a-6984-412d-bec9-99bfe8360991,segment=NetworkSegment(56db00b1-67f7-405d-a5c3-b33daa0250c6),segment_id=56db00b1-67f7-405d-a5c3-b33daa0250c6)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:55.280756 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-90a32ee6-7a66-403f-b01f-1f7c93fcf87e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:55.297447 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-90a32ee6-7a66-403f-b01f-1f7c93fcf87e None None] Calling delete_port for d1e9486a-6984-412d-bec9-99bfe8360991 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:43:55.338523 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-5fb31105-6f5c-4614-9c01-7224a3c36b8e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:55.339109 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5fb31105-6f5c-4614-9c01-7224a3c36b8e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:55.342302 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5fb31105-6f5c-4614-9c01-7224a3c36b8e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/7650c46a-3650-47a3-9a84-03c121606262 HTTP/1.1" status: 404 len: 337 time: 0.0692770 Dec 09 21:43:55.344943 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38806) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:55.377685 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-8cbbd631-52a9-4c32-a386-bf15dc7fbef7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:55.378206 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8cbbd631-52a9-4c32-a386-bf15dc7fbef7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:55.383946 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8cbbd631-52a9-4c32-a386-bf15dc7fbef7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/7d49836b-aa7e-47b1-8cf8-83bdbee7d7ee HTTP/1.1" status: 404 len: 337 time: 0.0354638 Dec 09 21:43:55.384252 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38814) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:55.403160 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8eb604eb-92af-40b9-9b4e-08a2cbec1184 req-135b09ab-fcfc-44e2-93a8-3a06c05876b8 service neutron] 10.222.0.31 "GET /v2.0/networks/f57a042a-7e03-40f8-ab65-0cce91b75390?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2303064 Dec 09 21:43:55.413862 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-90a32ee6-7a66-403f-b01f-1f7c93fcf87e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:55.428977 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-ad3977ee-1e07-41f4-b6fa-e8527915595d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:55.429806 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ad3977ee-1e07-41f4-b6fa-e8527915595d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:55.437153 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ad3977ee-1e07-41f4-b6fa-e8527915595d tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/c0c846eb-bad6-49a3-bd52-3510ab2cd39f HTTP/1.1" status: 404 len: 333 time: 0.0519311 Dec 09 21:43:55.440447 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38822) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:55.453163 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90a32ee6-7a66-403f-b01f-1f7c93fcf87e None None] Pushing event deleted for resources: {'Port': ['ID=d1e9486a-6984-412d-bec9-99bfe8360991,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:55.459413 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90a32ee6-7a66-403f-b01f-1f7c93fcf87e None None] No DVR routers for this DVR port d1e9486a-6984-412d-bec9-99bfe8360991 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:43:55.481143 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-64bf928d-7fd3-4a41-81e0-766349147d9a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:55.481857 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-64bf928d-7fd3-4a41-81e0-766349147d9a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:55.485236 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-64bf928d-7fd3-4a41-81e0-766349147d9a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/681075f3-1962-4351-9180-2f7e011e19c9 HTTP/1.1" status: 404 len: 337 time: 0.0436106 Dec 09 21:43:55.487716 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38826) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:55.514285 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-874931ad-9382-405e-93d6-fafd431a6e25 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:55.514748 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-874931ad-9382-405e-93d6-fafd431a6e25 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:55.518246 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-874931ad-9382-405e-93d6-fafd431a6e25 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/835c8869-c3a9-4fda-8618-cdd79b5eb526 HTTP/1.1" status: 404 len: 337 time: 0.0296140 Dec 09 21:43:55.520806 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38832) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:55.544603 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-8193a4ea-b258-455e-92e9-2f8aa25700e0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:55.545176 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8193a4ea-b258-455e-92e9-2f8aa25700e0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:55.548688 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8193a4ea-b258-455e-92e9-2f8aa25700e0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/4d683c07-5ddd-4f16-8df5-cbd28f9517f3 HTTP/1.1" status: 404 len: 333 time: 0.0267451 Dec 09 21:43:55.551000 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38840) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:55.572777 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a98e9175-2d28-49c1-a2f9-947e01e0211f req-7bd1b5e5-b6aa-4d79-b4b2-584967899453 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:55.574338 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a98e9175-2d28-49c1-a2f9-947e01e0211f req-7bd1b5e5-b6aa-4d79-b4b2-584967899453 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?device_id=b9aa302c-e89a-45cb-8c54-e52687b0927e HTTP/1.1" status: 200 len: 943 time: 0.1074317 Dec 09 21:43:55.577214 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac49334a-167b-4c86-aca4-9079e575019e req-d6df6229-b226-438a-ac7c-e777be2bd400 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:55.578586 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac49334a-167b-4c86-aca4-9079e575019e req-d6df6229-b226-438a-ac7c-e777be2bd400 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=94c88405417a4eea84491e86df14a0b0&device_id=b9aa302c-e89a-45cb-8c54-e52687b0927e HTTP/1.1" status: 200 len: 1095 time: 0.0939746 Dec 09 21:43:55.579111 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-065dfb83-53ef-4917-a69e-8e7f879c5ae3 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:55.579607 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-065dfb83-53ef-4917-a69e-8e7f879c5ae3 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:55.583480 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-065dfb83-53ef-4917-a69e-8e7f879c5ae3 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/f03cde81-60a5-48bf-84fc-0178577c2431 HTTP/1.1" status: 404 len: 337 time: 0.0305741 Dec 09 21:43:55.585578 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38846) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:55.615499 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-075cbd1a-8726-4ba0-ae05-3821ea71a11c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:55.615964 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-075cbd1a-8726-4ba0-ae05-3821ea71a11c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:55.620276 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-075cbd1a-8726-4ba0-ae05-3821ea71a11c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/99532a47-37fc-4d70-8614-e1ecf98d6198 HTTP/1.1" status: 404 len: 337 time: 0.0337536 Dec 09 21:43:55.622913 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38852) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:55.653091 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e32e1412-9906-4cb4-a6b3-4e060d7c668c tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports?device_id=efae9893-a48b-41c5-9ef7-2e80fb913c85 HTTP/1.1" status: 200 len: 205 time: 0.0287526 Dec 09 21:43:55.655926 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38858) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:55.686937 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a98e9175-2d28-49c1-a2f9-947e01e0211f req-7ac435c1-da92-45bf-a8d3-608ef870e970 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/security-groups?id=96f2cc1f-4e18-4f36-93f9-bc168eb8b378&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1062732 Dec 09 21:43:55.693895 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-548a7180-cc53-43c7-bfa0-c88a54e26236 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] delete failed (client error): The resource could not be found. Dec 09 21:43:55.695238 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-548a7180-cc53-43c7-bfa0-c88a54e26236 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/routers/efae9893-a48b-41c5-9ef7-2e80fb913c85 HTTP/1.1" status: 404 len: 336 time: 0.0380819 Dec 09 21:43:55.697745 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38866) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:55.706464 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac49334a-167b-4c86-aca4-9079e575019e req-7375e330-cade-4a9a-a45b-4225637dabd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:55.708238 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac49334a-167b-4c86-aca4-9079e575019e req-7375e330-cade-4a9a-a45b-4225637dabd4 service neutron] 10.222.0.31 "GET /v2.0/networks?id=f57a042a-7e03-40f8-ab65-0cce91b75390 HTTP/1.1" status: 200 len: 910 time: 0.1203148 Dec 09 21:43:55.733097 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-de53f719-b0d3-40a3-be29-b897ae2470be tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:55.733556 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-de53f719-b0d3-40a3-be29-b897ae2470be tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:55.736722 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-de53f719-b0d3-40a3-be29-b897ae2470be tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/caf33ffe-93e3-4d65-9e26-d679faa4a1c7 HTTP/1.1" status: 404 len: 337 time: 0.0380545 Dec 09 21:43:55.739878 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38874) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:55.770840 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac49334a-167b-4c86-aca4-9079e575019e req-5515e063-80fa-435b-8c0c-d4cf2fba03d0 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=ed9ae1ad-3844-40e9-aead-14aa239ad517 HTTP/1.1" status: 200 len: 217 time: 0.0543332 Dec 09 21:43:55.787402 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7f5afa12-b881-4493-bf33-5cf070fbb8e7 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "GET /v2.0/ports?device_id=885c0d08-7475-4e53-b324-dd6eee46bff3 HTTP/1.1" status: 200 len: 205 time: 0.0461526 Dec 09 21:43:55.789892 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38880) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:55.809668 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3c50d54b-8309-4247-89b1-23ceff9ee1df req-ce8302ec-87e3-46a4-b53b-2ccb6dd20c2d tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0375962 Dec 09 21:43:55.829016 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-77303966-fc2b-4326-90a2-4fa78e50081f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] delete failed (client error): The resource could not be found. Dec 09 21:43:55.832404 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-77303966-fc2b-4326-90a2-4fa78e50081f tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/routers/885c0d08-7475-4e53-b324-dd6eee46bff3 HTTP/1.1" status: 404 len: 336 time: 0.0392616 Dec 09 21:43:55.832643 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38886) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:55.859419 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-8f63a908-1541-47b7-8608-aae28abe3483 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:55.859907 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8f63a908-1541-47b7-8608-aae28abe3483 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:55.865241 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8f63a908-1541-47b7-8608-aae28abe3483 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/3c4d6d4a-986e-4e4b-bbf9-a7245aae93ca HTTP/1.1" status: 404 len: 337 time: 0.0294952 Dec 09 21:43:55.865744 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac49334a-167b-4c86-aca4-9079e575019e req-6075fe4f-2f2b-4d63-a3cb-35afc9a84149 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:55.866041 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38892) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:55.868325 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac49334a-167b-4c86-aca4-9079e575019e req-6075fe4f-2f2b-4d63-a3cb-35afc9a84149 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=0a3f1058-1106-4429-ab0b-99e5b6e6629d HTTP/1.1" status: 200 len: 849 time: 0.0842161 Dec 09 21:43:55.894803 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-391a2f31-63fb-488b-b4c2-b3f2f7ff1dd0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:55.895204 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-391a2f31-63fb-488b-b4c2-b3f2f7ff1dd0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:55.898634 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-391a2f31-63fb-488b-b4c2-b3f2f7ff1dd0 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/440ae7b3-9372-4b83-8987-1d70dc7ef3d1 HTTP/1.1" status: 404 len: 337 time: 0.0319443 Dec 09 21:43:55.900917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38900) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:55.903861 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac49334a-167b-4c86-aca4-9079e575019e req-222fa97d-e3e9-49fa-a4d2-fd100fa48662 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=f57a042a-7e03-40f8-ab65-0cce91b75390&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0278771 Dec 09 21:43:55.925471 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-a2ca03df-a87c-4691-a6dc-247064e2947a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:55.926023 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a2ca03df-a87c-4691-a6dc-247064e2947a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:55.929078 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a2ca03df-a87c-4691-a6dc-247064e2947a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/12246c3f-f387-4fc3-9028-c99451141e52 HTTP/1.1" status: 404 len: 333 time: 0.0266473 Dec 09 21:43:55.931675 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38906) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:55.963602 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-1320075a-f838-4e3f-acbf-df65a0c6b026 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:55.964068 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-1320075a-f838-4e3f-acbf-df65a0c6b026 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:55.967113 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1320075a-f838-4e3f-acbf-df65a0c6b026 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/1e55679a-96d0-4762-b6c7-f3d17e4c148a HTTP/1.1" status: 404 len: 337 time: 0.0332313 Dec 09 21:43:55.969987 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38914) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:55.992586 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-60035a79-7d1e-43af-92b0-7848ced4291a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:55.993574 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-60035a79-7d1e-43af-92b0-7848ced4291a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:55.997465 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-60035a79-7d1e-43af-92b0-7848ced4291a tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/6edd0105-a7bf-411e-94ba-83a832adadce HTTP/1.1" status: 404 len: 333 time: 0.0263414 Dec 09 21:43:55.999770 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38918) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:56.011487 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac49334a-167b-4c86-aca4-9079e575019e req-44467bbd-d694-4bfd-86da-a43605e42639 service neutron] 10.222.0.31 "GET /v2.0/networks/f57a042a-7e03-40f8-ab65-0cce91b75390?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0995293 Dec 09 21:43:56.026456 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-9df12f41-6fc2-4f5e-8f8a-908e69c5db22 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:56.027096 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9df12f41-6fc2-4f5e-8f8a-908e69c5db22 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:56.030492 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9df12f41-6fc2-4f5e-8f8a-908e69c5db22 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/fe6329f5-6459-4b8f-8b65-5a229901a546 HTTP/1.1" status: 404 len: 337 time: 0.0297678 Dec 09 21:43:56.033005 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38926) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:56.058351 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-5c7d74f8-f70a-4990-aa4c-5fe929ab5309 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:56.059126 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5c7d74f8-f70a-4990-aa4c-5fe929ab5309 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:56.062200 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5c7d74f8-f70a-4990-aa4c-5fe929ab5309 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/9fc79883-32b4-46bf-b1d0-42710db68f81 HTTP/1.1" status: 404 len: 333 time: 0.0282831 Dec 09 21:43:56.064798 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38932) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:56.093495 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-68d5d530-a109-4efa-b48f-afe41e94bb8e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:56.094053 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-68d5d530-a109-4efa-b48f-afe41e94bb8e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:56.097799 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-68d5d530-a109-4efa-b48f-afe41e94bb8e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/9c770ccc-e62f-4a9b-bbeb-75ee4c0a2658 HTTP/1.1" status: 404 len: 337 time: 0.0320342 Dec 09 21:43:56.101544 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38938) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:56.137468 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac49334a-167b-4c86-aca4-9079e575019e req-6b5a15c2-3415-4e2b-afd5-4546fbb6fa4d service neutron] 10.222.0.31 "GET /v2.0/networks/f57a042a-7e03-40f8-ab65-0cce91b75390?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1176562 Dec 09 21:43:56.138439 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-fad12635-4e59-40b4-bbfd-ade7ac0c8024 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:56.138978 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fad12635-4e59-40b4-bbfd-ade7ac0c8024 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:56.145941 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fad12635-4e59-40b4-bbfd-ade7ac0c8024 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/23c57144-274d-43f7-bae1-c0fff8f4365b HTTP/1.1" status: 404 len: 333 time: 0.0397065 Dec 09 21:43:56.146111 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38946) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:56.174163 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-fd96412f-f39e-4616-834c-63cc66c1801b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:56.174621 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-fd96412f-f39e-4616-834c-63cc66c1801b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:56.177908 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fd96412f-f39e-4616-834c-63cc66c1801b tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/2f775747-194c-4d27-ac16-9ecb6b957e79 HTTP/1.1" status: 404 len: 337 time: 0.0309134 Dec 09 21:43:56.180795 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38952) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:56.203769 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-3e3073b5-4516-41f9-9054-7309c3617b55 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:56.204317 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3e3073b5-4516-41f9-9054-7309c3617b55 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:56.207559 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3e3073b5-4516-41f9-9054-7309c3617b55 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/52594e2d-3478-4e93-8878-6b6cd71493c0 HTTP/1.1" status: 404 len: 333 time: 0.0256259 Dec 09 21:43:56.209855 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38958) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:56.235913 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-62941cad-a701-49b7-ab38-926ebcfbd415 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:56.236366 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-62941cad-a701-49b7-ab38-926ebcfbd415 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:56.239453 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-62941cad-a701-49b7-ab38-926ebcfbd415 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/5cd91336-7a75-4036-82f1-7fb521ce3a45 HTTP/1.1" status: 404 len: 337 time: 0.0286372 Dec 09 21:43:56.242201 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38966) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:56.265533 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-234e185c-09d3-446b-82a6-98512da502c8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:56.266432 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-234e185c-09d3-446b-82a6-98512da502c8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:56.269523 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-234e185c-09d3-446b-82a6-98512da502c8 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/a4b3fa66-2883-4cbe-966c-c264b7f19f7e HTTP/1.1" status: 404 len: 333 time: 0.0261283 Dec 09 21:43:56.272353 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38972) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:56.311282 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-66e80d1a-6591-4208-9613-3584afe6597e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:56.311760 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-66e80d1a-6591-4208-9613-3584afe6597e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:56.314816 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-66e80d1a-6591-4208-9613-3584afe6597e tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/482c803e-3749-42ec-a24f-323ef4987430 HTTP/1.1" status: 404 len: 337 time: 0.0414753 Dec 09 21:43:56.317239 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38982) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:56.342350 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-d3eb4888-8621-45ce-bd00-f7b11665f186 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:56.342912 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d3eb4888-8621-45ce-bd00-f7b11665f186 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:56.348986 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d3eb4888-8621-45ce-bd00-f7b11665f186 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/ports/6dd857e0-5db3-4836-a88d-270b5a47ecc7 HTTP/1.1" status: 404 len: 333 time: 0.0269518 Dec 09 21:43:56.348986 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 38988) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:56.385154 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-83d6a0a0-7b9f-449d-829b-6b626d236c75 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] DELETE failed (client error): The resource could not be found. Dec 09 21:43:56.385606 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-83d6a0a0-7b9f-449d-829b-6b626d236c75 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:43:56.389028 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-83d6a0a0-7b9f-449d-829b-6b626d236c75 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/subnets/9c6b9851-a504-42e3-880c-30bff70c1a84 HTTP/1.1" status: 404 len: 337 time: 0.0323353 Dec 09 21:43:56.392133 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 38998) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:56.475107 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2b31c3bf-6448-4487-8fb0-e5209113b321 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:56.564936 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2b31c3bf-6448-4487-8fb0-e5209113b321 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:56.590805 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-2b31c3bf-6448-4487-8fb0-e5209113b321 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['77d1c069-bca4-4157-a30b-fb10cbd9d9ee']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:43:56.602497 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-2b31c3bf-6448-4487-8fb0-e5209113b321 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '56db00b1-67f7-405d-a5c3-b33daa0250c6') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:43:56.602929 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-2b31c3bf-6448-4487-8fb0-e5209113b321 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '56db00b1-67f7-405d-a5c3-b33daa0250c6') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:43:56.612162 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2b31c3bf-6448-4487-8fb0-e5209113b321 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:56.625350 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2b31c3bf-6448-4487-8fb0-e5209113b321 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:56.631739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2b31c3bf-6448-4487-8fb0-e5209113b321 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Releasing vlan 127 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:43:56.632129 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2b31c3bf-6448-4487-8fb0-e5209113b321 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:43:56.635652 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:43:56.697320 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2b31c3bf-6448-4487-8fb0-e5209113b321 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:56.703109 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2b31c3bf-6448-4487-8fb0-e5209113b321 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:56.709034 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2b31c3bf-6448-4487-8fb0-e5209113b321 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] 10.222.0.13 "DELETE /v2.0/networks/77d1c069-bca4-4157-a30b-fb10cbd9d9ee HTTP/1.1" status: 204 len: 168 time: 0.3159852 Dec 09 21:43:56.728701 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b31c3bf-6448-4487-8fb0-e5209113b321 tempest-NetworksTestDHCPv6-1704121822 tempest-NetworksTestDHCPv6-1704121822-project] Pushing event deleted for resources: {'Network': ['ID=77d1c069-bca4-4157-a30b-fb10cbd9d9ee,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:56.840122 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8af80aa-6e75-4410-ac93-213f5da9a287 req-32b32f61-cbc2-49be-8d42-0742cd2b9615 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:56.842017 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8af80aa-6e75-4410-ac93-213f5da9a287 req-32b32f61-cbc2-49be-8d42-0742cd2b9615 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?device_id=b9aa302c-e89a-45cb-8c54-e52687b0927e HTTP/1.1" status: 200 len: 943 time: 0.0608373 Dec 09 21:43:56.900149 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8af80aa-6e75-4410-ac93-213f5da9a287 req-6cb1131c-0865-4544-94f8-7f2b34dab971 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/security-groups?id=96f2cc1f-4e18-4f36-93f9-bc168eb8b378&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517662 Dec 09 21:43:56.969808 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39074) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:57.001118 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae6951cb-d93d-4d1d-95f4-8c3bc4a15bd8 req-97c3a484-3bb8-44bb-95b3-f04222f26aab tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0379133 Dec 09 21:43:57.135157 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8c37f3c0-ecdd-4c6a-8b03-92aeafd9aa97 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=91d65fdee4d24f0fb98cc03c485255f6&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1639504 Dec 09 21:43:57.138015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39082) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:57.192325 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1c069200-c3f1-493e-9383-779d96f72ffe admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:57.214836 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1c069200-c3f1-493e-9383-779d96f72ffe admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:57.268069 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1c069200-c3f1-493e-9383-779d96f72ffe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:57.270693 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1c069200-c3f1-493e-9383-779d96f72ffe admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:57.271880 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1c069200-c3f1-493e-9383-779d96f72ffe admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/26615c33-7048-445b-bf7c-2e2f29ffde7b HTTP/1.1" status: 204 len: 168 time: 0.1327837 Dec 09 21:43:57.274336 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:57.280524 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c069200-c3f1-493e-9383-779d96f72ffe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=26615c33-7048-445b-bf7c-2e2f29ffde7b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:57.315393 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:57.810741 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device ed9ae1ad-3844-40e9-aead-14aa239ad517 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:43:57.919564 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port ed9ae1ad-3844-40e9-aead-14aa239ad517, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ed9ae1ad-3844-40e9-aead-14aa239ad517,segment=NetworkSegment(f69cd9ac-0fbe-4c49-8321-6c397e7fefa4),segment_id=f69cd9ac-0fbe-4c49-8321-6c397e7fefa4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:57.932102 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'ed9ae1ad-3844-40e9-aead-14aa239ad517', 'network_id': 'f57a042a-7e03-40f8-ab65-0cce91b75390', 'port_id': 'ed9ae1ad-3844-40e9-aead-14aa239ad517', 'mac_address': 'fa:16:3e:cb:2c:c0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0a3f1058-1106-4429-ab0b-99e5b6e6629d', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:43:57.986776 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39108) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:57.987320 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:58.001490 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ed9ae1ad-3844-40e9-aead-14aa239ad517 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:43:58.034911 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce76fb43-f188-4949-9709-f2d96fa30229 req-1845e4d1-5f9a-44c1-9ce8-3a786aeca403 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:58.037689 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port ed9ae1ad-3844-40e9-aead-14aa239ad517, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ed9ae1ad-3844-40e9-aead-14aa239ad517,segment=NetworkSegment(f69cd9ac-0fbe-4c49-8321-6c397e7fefa4),segment_id=f69cd9ac-0fbe-4c49-8321-6c397e7fefa4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:43:58.043745 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:58.045306 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ce76fb43-f188-4949-9709-f2d96fa30229 req-1845e4d1-5f9a-44c1-9ce8-3a786aeca403 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?device_id=b9aa302c-e89a-45cb-8c54-e52687b0927e HTTP/1.1" status: 200 len: 943 time: 0.0695362 Dec 09 21:43:58.106484 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=ed9ae1ad-3844-40e9-aead-14aa239ad517,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:58.110095 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ce76fb43-f188-4949-9709-f2d96fa30229 req-bdde09bf-982a-4604-8027-b0afeec1e15e tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/security-groups?id=96f2cc1f-4e18-4f36-93f9-bc168eb8b378&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0621519 Dec 09 21:43:58.165748 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a851ce0c-67a3-4e5a-8605-a8e85cb94730 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Request body: {'network': {'name': 'tempest-FloatingIPTestJSON-test-network-1520137360'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:58.206578 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ec2d453-d28c-46e6-894a-e1b78c7d42a9 req-a52c10c8-dec8-4474-8747-33643f7b1ca8 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0341823 Dec 09 21:43:58.213504 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a851ce0c-67a3-4e5a-8605-a8e85cb94730 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Made reservation on behalf of 1752f69b83904328a79fb89f35377bcf for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:58.217361 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a851ce0c-67a3-4e5a-8605-a8e85cb94730 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:58.233460 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a851ce0c-67a3-4e5a-8605-a8e85cb94730 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:58.310637 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a851ce0c-67a3-4e5a-8605-a8e85cb94730 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:58.311598 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['ed9ae1ad-3844-40e9-aead-14aa239ad517'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:43:58.317486 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a851ce0c-67a3-4e5a-8605-a8e85cb94730 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:58.345291 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a851ce0c-67a3-4e5a-8605-a8e85cb94730 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] vlan segment allocate from pool success with {'vlan_id': 148, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:43:58.361308 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a851ce0c-67a3-4e5a-8605-a8e85cb94730 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6d0f0193-455f-4bec-9a89-2c209aef5053,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:58.364386 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a851ce0c-67a3-4e5a-8605-a8e85cb94730 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:58.364724 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-a851ce0c-67a3-4e5a-8605-a8e85cb94730 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Added segment bc677cbd-f272-4e6f-8e55-00e4343b9571 of type vlan for network 74a4e90b-0273-461a-8432-d442c0560885 Dec 09 21:43:58.409526 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a851ce0c-67a3-4e5a-8605-a8e85cb94730 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:58.439734 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a851ce0c-67a3-4e5a-8605-a8e85cb94730 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:58.446684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a851ce0c-67a3-4e5a-8605-a8e85cb94730 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:58.447332 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a851ce0c-67a3-4e5a-8605-a8e85cb94730 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:58.493537 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a851ce0c-67a3-4e5a-8605-a8e85cb94730 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 786 time: 0.5045094 Dec 09 21:43:58.496658 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39118) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:58.501247 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-99f52223-80bd-42c4-8745-02c0c823bb93 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Request body: {'subnet': {'network_id': '74a4e90b-0273-461a-8432-d442c0560885', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1', 'enable_dhcp': False}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:58.550733 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a851ce0c-67a3-4e5a-8605-a8e85cb94730 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Network': ['ID=74a4e90b-0273-461a-8432-d442c0560885,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:58.561295 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 74a4e90b-0273-461a-8432-d442c0560885 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:43:58.629679 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-99f52223-80bd-42c4-8745-02c0c823bb93 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Made reservation on behalf of 1752f69b83904328a79fb89f35377bcf for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:43:58.634034 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99f52223-80bd-42c4-8745-02c0c823bb93 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:58.813076 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99f52223-80bd-42c4-8745-02c0c823bb93 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:58.879901 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99f52223-80bd-42c4-8745-02c0c823bb93 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Subnet': ['ID=29523c9c-ae97-471c-a637-67d7fdefc076,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:43:58.890299 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-99f52223-80bd-42c4-8745-02c0c823bb93 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Checking segment: {'id': 'bc677cbd-f272-4e6f-8e55-00e4343b9571', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '74a4e90b-0273-461a-8432-d442c0560885'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:43:58.891009 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99f52223-80bd-42c4-8745-02c0c823bb93 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Network hostable DHCP agents. Network: 74a4e90b-0273-461a-8432-d442c0560885, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:43:58.908558 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99f52223-80bd-42c4-8745-02c0c823bb93 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Network 74a4e90b-0273-461a-8432-d442c0560885 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:43:58.917689 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-99f52223-80bd-42c4-8745-02c0c823bb93 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 74a4e90b-0273-461a-8432-d442c0560885) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:43:58.922846 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99f52223-80bd-42c4-8745-02c0c823bb93 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:58.923523 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99f52223-80bd-42c4-8745-02c0c823bb93 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:58.928138 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bd168739-1b2a-4636-8c26-89155650c8c8 None None] Network 74a4e90b-0273-461a-8432-d442c0560885 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:58.947239 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-99f52223-80bd-42c4-8745-02c0c823bb93 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 802 time: 0.4497795 Dec 09 21:43:58.950022 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39120) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:43:58.954620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-83909755-6df1-4088-9b01-f7f7e9b3d4f7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Request body: {'router': {'name': 'tempest-FloatingIPTestJSON-router-1910833650', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}, 'admin_state_up': False}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:43:58.978322 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83909755-6df1-4088-9b01-f7f7e9b3d4f7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:58.979330 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83909755-6df1-4088-9b01-f7f7e9b3d4f7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:59.036630 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb12cc31-31f1-453e-a070-c9bf31664a7a None None] Network 74a4e90b-0273-461a-8432-d442c0560885 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:43:59.416816 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83909755-6df1-4088-9b01-f7f7e9b3d4f7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:59.465492 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45044c32-d89c-4db4-bf17-997f18e89d35 req-0ad6f017-1920-4251-9a3f-74e3c46b2bf6 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:43:59.466981 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-45044c32-d89c-4db4-bf17-997f18e89d35 req-0ad6f017-1920-4251-9a3f-74e3c46b2bf6 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?device_id=b9aa302c-e89a-45cb-8c54-e52687b0927e HTTP/1.1" status: 200 len: 944 time: 0.1205335 Dec 09 21:43:59.587213 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83909755-6df1-4088-9b01-f7f7e9b3d4f7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:59.609751 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-45044c32-d89c-4db4-bf17-997f18e89d35 req-11f393b0-2f63-414a-9a5e-0f95c59d0389 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/security-groups?id=96f2cc1f-4e18-4f36-93f9-bc168eb8b378&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1145728 Dec 09 21:43:59.710571 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bbfecfc5-4064-4129-9955-85db8aaccd61 req-412405d5-d192-463e-a9b5-961b36234648 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0316122 Dec 09 21:43:59.826791 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device ed9ae1ad-3844-40e9-aead-14aa239ad517 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:43:59.828803 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83909755-6df1-4088-9b01-f7f7e9b3d4f7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:59.852165 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83909755-6df1-4088-9b01-f7f7e9b3d4f7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:59.896718 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port ed9ae1ad-3844-40e9-aead-14aa239ad517 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:43:59.901637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port ed9ae1ad-3844-40e9-aead-14aa239ad517 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:43:59.902287 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:43:59.990073 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-83909755-6df1-4088-9b01-f7f7e9b3d4f7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Allocated IP 172.25.3.226 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/e568253b-d29a-41a6-8c0a-0c57f6cd0063) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:44:00.005397 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:00.033460 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b9aa302c-e89a-45cb-8c54-e52687b0927e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ed9ae1ad-3844-40e9-aead-14aa239ad517'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:44:00.035941 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0430641d-aa93-4550-923f-2196c72f6a58" -d '{"events": [{"server_uuid": "b9aa302c-e89a-45cb-8c54-e52687b0927e", "name": "network-vif-plugged", "status": "completed", "tag": "ed9ae1ad-3844-40e9-aead-14aa239ad517"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:44:00.049227 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port ed9ae1ad-3844-40e9-aead-14aa239ad517, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ed9ae1ad-3844-40e9-aead-14aa239ad517,segment=NetworkSegment(f69cd9ac-0fbe-4c49-8321-6c397e7fefa4),segment_id=f69cd9ac-0fbe-4c49-8321-6c397e7fefa4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:44:00.056439 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:00.089927 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:44:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-397cf6e9-bfec-403d-bca4-6fcd8efd972d x-openstack-request-id: req-397cf6e9-bfec-403d-bca4-6fcd8efd972d {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:44:00.090208 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b9aa302c-e89a-45cb-8c54-e52687b0927e", "name": "network-vif-plugged", "status": "completed", "tag": "ed9ae1ad-3844-40e9-aead-14aa239ad517", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:44:00.090470 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-397cf6e9-bfec-403d-bca4-6fcd8efd972d {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:44:00.090868 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b9aa302c-e89a-45cb-8c54-e52687b0927e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ed9ae1ad-3844-40e9-aead-14aa239ad517', 'code': 200} Dec 09 21:44:00.114146 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83909755-6df1-4088-9b01-f7f7e9b3d4f7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:00.128371 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=ed9ae1ad-3844-40e9-aead-14aa239ad517,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:00.159479 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83909755-6df1-4088-9b01-f7f7e9b3d4f7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:00.232047 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83909755-6df1-4088-9b01-f7f7e9b3d4f7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:44:00.238204 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-83909755-6df1-4088-9b01-f7f7e9b3d4f7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:44:00.242006 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83909755-6df1-4088-9b01-f7f7e9b3d4f7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Port': ['ID=e568253b-d29a-41a6-8c0a-0c57f6cd0063,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:00.244382 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83909755-6df1-4088-9b01-f7f7e9b3d4f7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:44:00.251039 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00769ef3-7f27-4e71-b7ca-f07de23d483c req-4c25efae-e6c8-493f-bc9f-8b35a9e47238 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:00.252751 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-00769ef3-7f27-4e71-b7ca-f07de23d483c req-4c25efae-e6c8-493f-bc9f-8b35a9e47238 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=b9aa302c-e89a-45cb-8c54-e52687b0927e HTTP/1.1" status: 200 len: 1097 time: 0.1033399 Dec 09 21:44:00.285727 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2767bb6c-a645-40e0-8602-940239430030 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:44:00.358422 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-00769ef3-7f27-4e71-b7ca-f07de23d483c req-c23f8bfb-7d7b-4885-bd9a-bea8ef712130 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=96f2cc1f-4e18-4f36-93f9-bc168eb8b378&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0863864 Dec 09 21:44:00.419086 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b500cad8-4c92-4a48-98b8-5ae1587f3d23 None None] Provisioning complete for port e568253b-d29a-41a6-8c0a-0c57f6cd0063 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:44:00.419812 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b500cad8-4c92-4a48-98b8-5ae1587f3d23 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:00.467502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-b500cad8-4c92-4a48-98b8-5ae1587f3d23 None None] Port e568253b-d29a-41a6-8c0a-0c57f6cd0063 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:44:00.577047 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83909755-6df1-4088-9b01-f7f7e9b3d4f7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:00.802878 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c74beffe-c9ab-4998-ac94-488558a15dd8 req-9db0d0df-e727-4342-b3e3-75e55e0e827b tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:00.808434 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c74beffe-c9ab-4998-ac94-488558a15dd8 req-9db0d0df-e727-4342-b3e3-75e55e0e827b tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?device_id=b9aa302c-e89a-45cb-8c54-e52687b0927e HTTP/1.1" status: 200 len: 945 time: 0.0992990 Dec 09 21:44:00.915087 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83909755-6df1-4088-9b01-f7f7e9b3d4f7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:00.937587 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c74beffe-c9ab-4998-ac94-488558a15dd8 req-a149cdfe-acd4-48e8-af12-ad96a5e46053 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/security-groups?id=96f2cc1f-4e18-4f36-93f9-bc168eb8b378&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1159363 Dec 09 21:44:01.070359 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-62905111-cdb6-45c8-a78e-774a11d5fe62 req-8644f171-fd3e-4326-81ff-08f2f090efc5 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0321512 Dec 09 21:44:01.114918 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-83909755-6df1-4088-9b01-f7f7e9b3d4f7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Router 3054de87-ea87-42d0-ac7b-818bc1f8e2c8 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:44:01.320022 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-83909755-6df1-4088-9b01-f7f7e9b3d4f7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:44:01.332137 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-701cadf0-3484-4ffa-8116-6d669e8ab1a4 None None] Sync routers for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:44:01.341211 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07356419-64fa-47c1-877d-b8075711c1d8 req-5ef0f90c-d539-4a11-8ea5-475ff3b7f01d tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:01.344448 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07356419-64fa-47c1-877d-b8075711c1d8 req-5ef0f90c-d539-4a11-8ea5-475ff3b7f01d tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/networks?id=eda4cb39-afde-43d7-a13b-5227cc6862dd HTTP/1.1" status: 200 len: 814 time: 0.1770105 Dec 09 21:44:01.353792 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-701cadf0-3484-4ffa-8116-6d669e8ab1a4 None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:01.354541 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-701cadf0-3484-4ffa-8116-6d669e8ab1a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:43:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:01.369820 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83909755-6df1-4088-9b01-f7f7e9b3d4f7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:01.373587 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-83909755-6df1-4088-9b01-f7f7e9b3d4f7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 887 time: 2.4199111 Dec 09 21:44:01.374663 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39160) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:01.410045 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-701cadf0-3484-4ffa-8116-6d669e8ab1a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:01.412330 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07356419-64fa-47c1-877d-b8075711c1d8 req-8d3c4f5b-738a-48a8-93e0-c259233667c0 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/quotas/6f2bd57ebcdc4c748e719519e3961b70 HTTP/1.1" status: 200 len: 375 time: 0.0594764 Dec 09 21:44:01.428465 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-701cadf0-3484-4ffa-8116-6d669e8ab1a4 None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:01.429930 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-701cadf0-3484-4ffa-8116-6d669e8ab1a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:43:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:01.465450 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-701cadf0-3484-4ffa-8116-6d669e8ab1a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:01.465689 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-701cadf0-3484-4ffa-8116-6d669e8ab1a4 None None] The sync data for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:44:01.484010 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07356419-64fa-47c1-877d-b8075711c1d8 req-7d8bcb5f-1a8e-44ca-9872-f9ae27fbac57 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=6f2bd57ebcdc4c748e719519e3961b70&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0702941 Dec 09 21:44:01.604426 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07356419-64fa-47c1-877d-b8075711c1d8 req-e797514f-dd32-4a85-a58a-f874ff8759b8 service neutron] 10.222.0.13 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1169672 Dec 09 21:44:01.702371 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07356419-64fa-47c1-877d-b8075711c1d8 req-20bb8fee-9c97-4594-863f-1c1b0d2f5b95 service neutron] 10.222.0.13 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0922601 Dec 09 21:44:01.894338 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4a74d53a-f7d3-4eb6-a5bb-e29ccb92a4b3 req-f264e1e6-be61-4b22-8690-65cea287dc9e tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=19f2fc87-2a43-4349-a873-6d310f0c574e HTTP/1.1" status: 200 len: 210 time: 0.0366161 Dec 09 21:44:01.936250 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:02.074451 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3a0c078-a994-4d71-b769-72a4beca3f60 req-0dd6d5c7-bc4f-4e53-b958-3bc373001113 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:02.076606 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c3a0c078-a994-4d71-b769-72a4beca3f60 req-0dd6d5c7-bc4f-4e53-b958-3bc373001113 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?device_id=b9aa302c-e89a-45cb-8c54-e52687b0927e HTTP/1.1" status: 200 len: 945 time: 0.0617530 Dec 09 21:44:02.128742 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c3a0c078-a994-4d71-b769-72a4beca3f60 req-7ac60f41-62e4-4f97-9298-d8f803124a67 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/security-groups?id=96f2cc1f-4e18-4f36-93f9-bc168eb8b378&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448813 Dec 09 21:44:02.262567 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86a36ce6-8a54-405a-8918-1411a484b930 req-63c1505c-889e-41a1-ae66-5ae1c89fa9af tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0410492 Dec 09 21:44:02.266756 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Allocated IP 172.20.0.1 (74a4e90b-0273-461a-8432-d442c0560885/29523c9c-ae97-471c-a637-67d7fdefc076/6ab6a8b4-297b-433f-ba21-6244428423a9) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:44:02.397887 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:02.443314 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:02.468155 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-732d7328-ff0e-4433-b3f4-a7c911541f38 req-1b131ae1-b032-404a-a5f3-b1ea6aff6b2e tempest-ServerRescueTestJSON-1996162304 tempest-ServerRescueTestJSON-1996162304-project] (103438) timed out ('10.222.0.10', 63576) {{(pid=103438) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 09 21:44:02.487870 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Network 74a4e90b-0273-461a-8432-d442c0560885 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:44:02.491586 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:44:02.498674 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:44:02.543102 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Port': ['ID=6ab6a8b4-297b-433f-ba21-6244428423a9,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:02.555236 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:02.555618 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:02.556116 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:02.556708 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:02.557291 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:02.557897 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:02.558489 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:02.559051 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:02.559412 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:02.559833 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:02.560094 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:02.560425 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:02.560760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:02.587683 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:02.744267 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:02.966982 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd969cb5-bd28-4d9b-800b-62d7f0d1a88c req-c6b8a697-137d-4439-b108-329680d8a2b4 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:02.969502 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd969cb5-bd28-4d9b-800b-62d7f0d1a88c req-c6b8a697-137d-4439-b108-329680d8a2b4 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?device_id=b9aa302c-e89a-45cb-8c54-e52687b0927e HTTP/1.1" status: 200 len: 945 time: 0.0608866 Dec 09 21:44:02.977179 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c657c69f-af40-4501-a061-faba452a7ef5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:03.060842 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd969cb5-bd28-4d9b-800b-62d7f0d1a88c req-e191219b-bd53-477a-b722-c61fc0d51417 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/security-groups?id=96f2cc1f-4e18-4f36-93f9-bc168eb8b378&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0819018 Dec 09 21:44:03.142209 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:03.150756 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:03.181625 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-573b6208-8820-43b0-8cef-f8e2047a14f8 req-d61c2ace-0759-4e03-9e35-5c5162603fe6 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=19f2fc87-2a43-4349-a873-6d310f0c574e HTTP/1.1" status: 200 len: 210 time: 0.0351069 Dec 09 21:44:03.225967 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07356419-64fa-47c1-877d-b8075711c1d8 req-c1cae3ad-9430-4ed4-ba91-87ad358f13a9 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:03.227677 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07356419-64fa-47c1-877d-b8075711c1d8 req-c1cae3ad-9430-4ed4-ba91-87ad358f13a9 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.31 "GET /v2.0/networks?id=eda4cb39-afde-43d7-a13b-5227cc6862dd HTTP/1.1" status: 200 len: 814 time: 0.1651182 Dec 09 21:44:03.243031 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-07356419-64fa-47c1-877d-b8075711c1d8 req-4d0c1860-1033-47e8-8876-a05966ae1f4f tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Request body: {'port': {'device_id': '19f2fc87-2a43-4349-a873-6d310f0c574e', 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd', 'admin_state_up': True, 'tenant_id': '6f2bd57ebcdc4c748e719519e3961b70'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:03.248401 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:03.257843 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Port': ['ID=6ab6a8b4-297b-433f-ba21-6244428423a9,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:03.374511 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-65bd2c3e-17e6-42ff-8ab7-77a0d98d6fa7 req-d497da63-7c81-4b27-a1cc-cecf5c8412a4 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0365710 Dec 09 21:44:03.376521 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Network 74a4e90b-0273-461a-8432-d442c0560885 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:44:03.377964 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:44:03.411083 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-07356419-64fa-47c1-877d-b8075711c1d8 req-4d0c1860-1033-47e8-8876-a05966ae1f4f tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Made reservation on behalf of 6f2bd57ebcdc4c748e719519e3961b70 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:44:03.414871 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-07356419-64fa-47c1-877d-b8075711c1d8 req-4d0c1860-1033-47e8-8876-a05966ae1f4f tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:03.509669 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Router 3054de87-ea87-42d0-ac7b-818bc1f8e2c8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:44:03.568980 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-07356419-64fa-47c1-877d-b8075711c1d8 req-4d0c1860-1033-47e8-8876-a05966ae1f4f tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Allocated IP 172.20.0.11 (eda4cb39-afde-43d7-a13b-5227cc6862dd/24afae0e-0a38-484d-a023-a2fb471bdb33/bd9c1c28-304b-4656-bd19-43407d1b6dc2) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:44:03.663472 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:44:03.673065 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f27e3896-1d2f-46fc-a2bb-71cc30bed056 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "PUT /v2.0/routers/3054de87-ea87-42d0-ac7b-818bc1f8e2c8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2963114 Dec 09 21:44:03.674057 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12b5339e-7277-4edd-b72a-fc2989fe313a None None] Sync routers for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:44:03.675496 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39198) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:03.680931 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-0e2f4d91-43bd-490d-ad0e-f04c58fe697d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Request body: {'port': {'network_id': '74a4e90b-0273-461a-8432-d442c0560885', 'name': 'tempest-FloatingIPTestJSON-1916783716'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:03.687357 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12b5339e-7277-4edd-b72a-fc2989fe313a None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:03.688008 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-12b5339e-7277-4edd-b72a-fc2989fe313a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:43:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:03.722397 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-12b5339e-7277-4edd-b72a-fc2989fe313a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:03.732441 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12b5339e-7277-4edd-b72a-fc2989fe313a None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:03.733291 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-12b5339e-7277-4edd-b72a-fc2989fe313a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:43:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:03.772448 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-12b5339e-7277-4edd-b72a-fc2989fe313a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:03.773704 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12b5339e-7277-4edd-b72a-fc2989fe313a None None] The sync data for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:44:03.826704 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-07356419-64fa-47c1-877d-b8075711c1d8 req-4d0c1860-1033-47e8-8876-a05966ae1f4f tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:03.835787 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0e2f4d91-43bd-490d-ad0e-f04c58fe697d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Made reservation on behalf of 1752f69b83904328a79fb89f35377bcf for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:44:03.840047 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0e2f4d91-43bd-490d-ad0e-f04c58fe697d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:03.859705 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-0e2f4d91-43bd-490d-ad0e-f04c58fe697d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] device_id is not set on port f1f87d04-b570-4a83-818c-4ddc61a5c148 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:44:03.881578 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-07356419-64fa-47c1-877d-b8075711c1d8 req-4d0c1860-1033-47e8-8876-a05966ae1f4f tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:03.896723 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['33cf4605-a408-4847-9394-fe8acf994c40'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:44:03.957318 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39202) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:03.963888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-07356419-64fa-47c1-877d-b8075711c1d8 req-4d0c1860-1033-47e8-8876-a05966ae1f4f tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Network eda4cb39-afde-43d7-a13b-5227cc6862dd is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:44:03.969423 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-07356419-64fa-47c1-877d-b8075711c1d8 req-4d0c1860-1033-47e8-8876-a05966ae1f4f tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:44:03.975098 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-07356419-64fa-47c1-877d-b8075711c1d8 req-4d0c1860-1033-47e8-8876-a05966ae1f4f tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:44:03.993646 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03f48f22-45b8-4698-930e-6aa67e9ed651 None None] DHCP port deletion for eda4cb39-afde-43d7-a13b-5227cc6862dd request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:44:04.023544 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d0c1860-1033-47e8-8876-a05966ae1f4f tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Pushing event updated for resources: {'Port': ['ID=bd9c1c28-304b-4656-bd19-43407d1b6dc2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:04.061105 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07356419-64fa-47c1-877d-b8075711c1d8 req-4d0c1860-1033-47e8-8876-a05966ae1f4f tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:04.061506 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-07356419-64fa-47c1-877d-b8075711c1d8 req-4d0c1860-1033-47e8-8876-a05966ae1f4f tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:04.076942 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-0e2f4d91-43bd-490d-ad0e-f04c58fe697d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Allocated IP 172.20.0.2 (74a4e90b-0273-461a-8432-d442c0560885/29523c9c-ae97-471c-a637-67d7fdefc076/f1f87d04-b570-4a83-818c-4ddc61a5c148) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:44:04.086612 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07356419-64fa-47c1-877d-b8075711c1d8 req-4d0c1860-1033-47e8-8876-a05966ae1f4f tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8474903 Dec 09 21:44:04.113063 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-07356419-64fa-47c1-877d-b8075711c1d8 req-ae68d5a4-d48a-4d3a-b16b-234c9241dcd3 service neutron] Request body: {'port': {'device_id': '19f2fc87-2a43-4349-a873-6d310f0c574e', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:04.119333 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d8fb9ab1-20ba-48d9-bc6d-0d641a3bd9c6 None None] Provisioning complete for port bd9c1c28-304b-4656-bd19-43407d1b6dc2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:44:04.120037 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d8fb9ab1-20ba-48d9-bc6d-0d641a3bd9c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:04.158048 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d8fb9ab1-20ba-48d9-bc6d-0d641a3bd9c6 None None] Port bd9c1c28-304b-4656-bd19-43407d1b6dc2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:44:04.190320 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bfcd47a8-2987-46c1-a552-5a915520c6c6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:04.218527 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-07356419-64fa-47c1-877d-b8075711c1d8 req-ae68d5a4-d48a-4d3a-b16b-234c9241dcd3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:04.228184 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d57a0403-5d01-4d82-b79b-421f6ff9d389 req-bbb2a7b9-11b2-4a41-958f-f658a36c4fd4 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:04.229888 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d57a0403-5d01-4d82-b79b-421f6ff9d389 req-bbb2a7b9-11b2-4a41-958f-f658a36c4fd4 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?device_id=b9aa302c-e89a-45cb-8c54-e52687b0927e HTTP/1.1" status: 200 len: 945 time: 0.0898695 Dec 09 21:44:04.348030 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0e2f4d91-43bd-490d-ad0e-f04c58fe697d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:04.383789 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bfcd47a8-2987-46c1-a552-5a915520c6c6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:04.409118 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bfcd47a8-2987-46c1-a552-5a915520c6c6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:04.422484 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0e2f4d91-43bd-490d-ad0e-f04c58fe697d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:04.450394 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d57a0403-5d01-4d82-b79b-421f6ff9d389 req-3676a1b5-336d-4f6d-be19-dee4ef5d838c tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/security-groups?id=96f2cc1f-4e18-4f36-93f9-bc168eb8b378&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2050264 Dec 09 21:44:04.515233 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bfcd47a8-2987-46c1-a552-5a915520c6c6 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=946e65cef39242ad8bd58619c3837db2&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5566621 Dec 09 21:44:04.516523 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfcd47a8-2987-46c1-a552-5a915520c6c6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cb65d0af-9fa5-4845-8ea3-5861d463672a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:04.518269 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39212) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:04.524232 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e2f4d91-43bd-490d-ad0e-f04c58fe697d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Network 74a4e90b-0273-461a-8432-d442c0560885 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:44:04.550922 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-0e2f4d91-43bd-490d-ad0e-f04c58fe697d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:44:04.554441 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e2f4d91-43bd-490d-ad0e-f04c58fe697d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:44:04.579627 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e2f4d91-43bd-490d-ad0e-f04c58fe697d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Port': ['ID=f1f87d04-b570-4a83-818c-4ddc61a5c148,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:04.621133 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ff54571-80df-4f24-ba07-6f13281dda42 req-442b132a-3fa6-4083-ba34-6bf7f50c5f13 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:04.622591 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6ff54571-80df-4f24-ba07-6f13281dda42 req-442b132a-3fa6-4083-ba34-6bf7f50c5f13 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.31 "GET /v2.0/ports?device_id=b9aa302c-e89a-45cb-8c54-e52687b0927e HTTP/1.1" status: 200 len: 945 time: 0.1271100 Dec 09 21:44:04.639317 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0e2f4d91-43bd-490d-ad0e-f04c58fe697d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:04.639901 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0e2f4d91-43bd-490d-ad0e-f04c58fe697d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:04.653292 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-07356419-64fa-47c1-877d-b8075711c1d8 req-ae68d5a4-d48a-4d3a-b16b-234c9241dcd3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bd9c1c28-304b-4656-bd19-43407d1b6dc2 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:44:04.664104 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-07356419-64fa-47c1-877d-b8075711c1d8 req-ae68d5a4-d48a-4d3a-b16b-234c9241dcd3 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:04.673786 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-61891425-8b2a-4138-adc3-48a5a383db25 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:04.683069 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d26cdd9-d000-49b3-8db5-1613c34d0c00 req-0e796901-a1ca-4c2e-b2ab-6896d82432a0 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:04.690280 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0e2f4d91-43bd-490d-ad0e-f04c58fe697d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.0110853 Dec 09 21:44:04.693882 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d26cdd9-d000-49b3-8db5-1613c34d0c00 req-0e796901-a1ca-4c2e-b2ab-6896d82432a0 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=19f2fc87-2a43-4349-a873-6d310f0c574e HTTP/1.1" status: 200 len: 932 time: 0.1249802 Dec 09 21:44:04.696408 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39214) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:04.720794 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-16316198-c6ca-4887-856e-1b3523aaa79a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Request body: {'port': {'network_id': '74a4e90b-0273-461a-8432-d442c0560885', 'name': 'tempest-FloatingIPTestJSON-837871273'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:04.729575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-07356419-64fa-47c1-877d-b8075711c1d8 req-ae68d5a4-d48a-4d3a-b16b-234c9241dcd3 service neutron] Transition to ACTIVE for port object bd9c1c28-304b-4656-bd19-43407d1b6dc2 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:44:04.742808 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-07356419-64fa-47c1-877d-b8075711c1d8 req-ae68d5a4-d48a-4d3a-b16b-234c9241dcd3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:04.747633 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-61891425-8b2a-4138-adc3-48a5a383db25 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:04.818641 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a5812b35-1fd0-47b4-8bf1-b860de2e8a1d None None] DHCP port deletion for eda4cb39-afde-43d7-a13b-5227cc6862dd request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:44:04.854993 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d26cdd9-d000-49b3-8db5-1613c34d0c00 req-bf8fb519-f2fe-4e63-9240-8b73c4cfb53a tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1601903 Dec 09 21:44:04.855697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae68d5a4-d48a-4d3a-b16b-234c9241dcd3 service neutron] Pushing event updated for resources: {'Port': ['ID=bd9c1c28-304b-4656-bd19-43407d1b6dc2,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:04.962571 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-07356419-64fa-47c1-877d-b8075711c1d8 req-ae68d5a4-d48a-4d3a-b16b-234c9241dcd3 service neutron] Attempting to bind port bd9c1c28-304b-4656-bd19-43407d1b6dc2 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:44:04.962930 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-07356419-64fa-47c1-877d-b8075711c1d8 req-ae68d5a4-d48a-4d3a-b16b-234c9241dcd3 service neutron] Attempting to bind port bd9c1c28-304b-4656-bd19-43407d1b6dc2 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:44:04.963277 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07356419-64fa-47c1-877d-b8075711c1d8 req-ae68d5a4-d48a-4d3a-b16b-234c9241dcd3 service neutron] Attempting to bind port bd9c1c28-304b-4656-bd19-43407d1b6dc2 on network eda4cb39-afde-43d7-a13b-5227cc6862dd {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:44:04.970285 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07356419-64fa-47c1-877d-b8075711c1d8 req-ae68d5a4-d48a-4d3a-b16b-234c9241dcd3 service neutron] Port bd9c1c28-304b-4656-bd19-43407d1b6dc2 on network eda4cb39-afde-43d7-a13b-5227cc6862dd not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:44:04.971024 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07356419-64fa-47c1-877d-b8075711c1d8 req-ae68d5a4-d48a-4d3a-b16b-234c9241dcd3 service neutron] Attempting to bind port bd9c1c28-304b-4656-bd19-43407d1b6dc2 on network eda4cb39-afde-43d7-a13b-5227cc6862dd {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:44:04.976822 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-61891425-8b2a-4138-adc3-48a5a383db25 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:04.979853 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-61891425-8b2a-4138-adc3-48a5a383db25 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:04.981057 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-61891425-8b2a-4138-adc3-48a5a383db25 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/cb65d0af-9fa5-4845-8ea3-5861d463672a HTTP/1.1" status: 204 len: 168 time: 0.4618299 Dec 09 21:44:04.987246 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07356419-64fa-47c1-877d-b8075711c1d8 req-ae68d5a4-d48a-4d3a-b16b-234c9241dcd3 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 43, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:44:04.987771 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07356419-64fa-47c1-877d-b8075711c1d8 req-ae68d5a4-d48a-4d3a-b16b-234c9241dcd3 service neutron] Checking segment: {'id': '0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:44:04.988163 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-07356419-64fa-47c1-877d-b8075711c1d8 req-ae68d5a4-d48a-4d3a-b16b-234c9241dcd3 service neutron] Bound using segment: {'id': '0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:44:04.988620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-07356419-64fa-47c1-877d-b8075711c1d8 req-ae68d5a4-d48a-4d3a-b16b-234c9241dcd3 service neutron] Bound port: bd9c1c28-304b-4656-bd19-43407d1b6dc2, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:44:04.988986 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-07356419-64fa-47c1-877d-b8075711c1d8 req-ae68d5a4-d48a-4d3a-b16b-234c9241dcd3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:05.017762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61891425-8b2a-4138-adc3-48a5a383db25 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cb65d0af-9fa5-4845-8ea3-5861d463672a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:05.037019 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-81f2736b-2beb-48aa-a156-f484988d2330 req-321a9748-3b71-4cb2-a91f-62e585157f32 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0439608 Dec 09 21:44:05.103566 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-07356419-64fa-47c1-877d-b8075711c1d8 req-ae68d5a4-d48a-4d3a-b16b-234c9241dcd3 service neutron] For port bd9c1c28-304b-4656-bd19-43407d1b6dc2, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:44:05.107404 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-07356419-64fa-47c1-877d-b8075711c1d8 req-ae68d5a4-d48a-4d3a-b16b-234c9241dcd3 service neutron] For port bd9c1c28-304b-4656-bd19-43407d1b6dc2, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=bd9c1c28-304b-4656-bd19-43407d1b6dc2,segment=NetworkSegment(0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5),segment_id=0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:44:05.112960 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-07356419-64fa-47c1-877d-b8075711c1d8 req-ae68d5a4-d48a-4d3a-b16b-234c9241dcd3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:05.141025 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e8c5f9c3-e9f8-463e-b80b-030f94e393b2 None None] DHCP port deletion for eda4cb39-afde-43d7-a13b-5227cc6862dd request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:44:05.146266 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07356419-64fa-47c1-877d-b8075711c1d8 req-ae68d5a4-d48a-4d3a-b16b-234c9241dcd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:05.147178 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-07356419-64fa-47c1-877d-b8075711c1d8 req-ae68d5a4-d48a-4d3a-b16b-234c9241dcd3 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:05.148554 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07356419-64fa-47c1-877d-b8075711c1d8 req-ae68d5a4-d48a-4d3a-b16b-234c9241dcd3 service neutron] 10.222.0.31 "PUT /v2.0/ports/bd9c1c28-304b-4656-bd19-43407d1b6dc2 HTTP/1.1" status: 200 len: 1093 time: 1.0506032 Dec 09 21:44:05.149033 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '19f2fc87-2a43-4349-a873-6d310f0c574e', 'tag': 'bd9c1c28-304b-4656-bd19-43407d1b6dc2'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:44:05.152290 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f57800b1-780a-4f3f-ab37-cbfddcf7cce7" -d '{"events": [{"name": "network-changed", "server_uuid": "19f2fc87-2a43-4349-a873-6d310f0c574e", "tag": "bd9c1c28-304b-4656-bd19-43407d1b6dc2"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:44:05.230099 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:44:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-47d01f70-d19e-456f-a838-d2548c2d9096 x-openstack-request-id: req-47d01f70-d19e-456f-a838-d2548c2d9096 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:44:05.230759 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "19f2fc87-2a43-4349-a873-6d310f0c574e", "tag": "bd9c1c28-304b-4656-bd19-43407d1b6dc2", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:44:05.231093 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-47d01f70-d19e-456f-a838-d2548c2d9096 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:44:05.231598 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '19f2fc87-2a43-4349-a873-6d310f0c574e', 'tag': 'bd9c1c28-304b-4656-bd19-43407d1b6dc2', 'status': 'completed', 'code': 200} Dec 09 21:44:05.244900 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae68d5a4-d48a-4d3a-b16b-234c9241dcd3 service neutron] Pushing event updated for resources: {'Port': ['ID=bd9c1c28-304b-4656-bd19-43407d1b6dc2,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:05.259648 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07356419-64fa-47c1-877d-b8075711c1d8 req-77895657-684d-40b5-b50f-ed9387ade8d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:05.261428 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07356419-64fa-47c1-877d-b8075711c1d8 req-77895657-684d-40b5-b50f-ed9387ade8d2 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6f2bd57ebcdc4c748e719519e3961b70&device_id=19f2fc87-2a43-4349-a873-6d310f0c574e HTTP/1.1" status: 200 len: 1096 time: 0.0663140 Dec 09 21:44:05.272064 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-6ff54571-80df-4f24-ba07-6f13281dda42 req-82ea1269-ee5e-4e8a-8ff5-c165935a9a54 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Deleting port ed9ae1ad-3844-40e9-aead-14aa239ad517 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:44:05.272442 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6ff54571-80df-4f24-ba07-6f13281dda42 req-82ea1269-ee5e-4e8a-8ff5-c165935a9a54 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:05.320445 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07356419-64fa-47c1-877d-b8075711c1d8 req-f5fc5c9f-c05b-4c85-ada9-997845e5753e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=bd9c1c28-304b-4656-bd19-43407d1b6dc2 HTTP/1.1" status: 200 len: 217 time: 0.0483520 Dec 09 21:44:05.337122 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39222) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:05.362218 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-16316198-c6ca-4887-856e-1b3523aaa79a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Made reservation on behalf of 1752f69b83904328a79fb89f35377bcf for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:44:05.365885 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16316198-c6ca-4887-856e-1b3523aaa79a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:05.380681 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fdbe0df-84e6-4161-a22d-c60c57aba74b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:05.397326 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-16316198-c6ca-4887-856e-1b3523aaa79a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] device_id is not set on port 97adad29-d668-4e98-9fb3-f98121e998ee yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:44:05.403936 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-6ff54571-80df-4f24-ba07-6f13281dda42 req-82ea1269-ee5e-4e8a-8ff5-c165935a9a54 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] For port ed9ae1ad-3844-40e9-aead-14aa239ad517, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ed9ae1ad-3844-40e9-aead-14aa239ad517,segment=NetworkSegment(f69cd9ac-0fbe-4c49-8321-6c397e7fefa4),segment_id=f69cd9ac-0fbe-4c49-8321-6c397e7fefa4)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:44:05.404312 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6ff54571-80df-4f24-ba07-6f13281dda42 req-82ea1269-ee5e-4e8a-8ff5-c165935a9a54 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:05.406843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07356419-64fa-47c1-877d-b8075711c1d8 req-b796684f-4367-4478-a3b9-ab937d281ba6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:05.408361 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07356419-64fa-47c1-877d-b8075711c1d8 req-b796684f-4367-4478-a3b9-ab937d281ba6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=24afae0e-0a38-484d-a023-a2fb471bdb33 HTTP/1.1" status: 200 len: 854 time: 0.0806689 Dec 09 21:44:05.449949 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-6ff54571-80df-4f24-ba07-6f13281dda42 req-82ea1269-ee5e-4e8a-8ff5-c165935a9a54 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Calling delete_port for ed9ae1ad-3844-40e9-aead-14aa239ad517 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:44:05.453278 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07356419-64fa-47c1-877d-b8075711c1d8 req-9aef9c1d-171a-4c70-ac0b-3ab1633c5e08 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eda4cb39-afde-43d7-a13b-5227cc6862dd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0373445 Dec 09 21:44:05.546676 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-09849b6c-5a4d-4359-9736-7fe2a994188b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:05.590842 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fdbe0df-84e6-4161-a22d-c60c57aba74b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:05.592110 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-16316198-c6ca-4887-856e-1b3523aaa79a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Allocated IP 172.20.0.5 (74a4e90b-0273-461a-8432-d442c0560885/29523c9c-ae97-471c-a637-67d7fdefc076/97adad29-d668-4e98-9fb3-f98121e998ee) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:44:05.601320 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fdbe0df-84e6-4161-a22d-c60c57aba74b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:05.639286 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07356419-64fa-47c1-877d-b8075711c1d8 req-ac281d01-931d-46b6-917c-630ddc2a5783 service neutron] 10.222.0.31 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1748962 Dec 09 21:44:05.667325 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8fdbe0df-84e6-4161-a22d-c60c57aba74b admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=0395d1f9f40f42299f361911935ed25b&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3265300 Dec 09 21:44:05.669258 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39226) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:05.672101 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd29fc6e-01c1-4134-88f0-1ada7369be80 req-55aecc1f-7936-4ecc-8576-c0f38fb43322 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:05.673614 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dd29fc6e-01c1-4134-88f0-1ada7369be80 req-55aecc1f-7936-4ecc-8576-c0f38fb43322 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?device_id=b9aa302c-e89a-45cb-8c54-e52687b0927e HTTP/1.1" status: 200 len: 945 time: 0.1320283 Dec 09 21:44:05.692412 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fdbe0df-84e6-4161-a22d-c60c57aba74b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bb186320-7f5e-4c43-a4b4-04a447662e3e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:05.742325 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6ff54571-80df-4f24-ba07-6f13281dda42 req-82ea1269-ee5e-4e8a-8ff5-c165935a9a54 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:05.756306 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['ed9ae1ad-3844-40e9-aead-14aa239ad517'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:44:05.775697 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dd29fc6e-01c1-4134-88f0-1ada7369be80 req-672a4ccf-da95-42ad-9355-0723cd589bdc tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/security-groups?id=96f2cc1f-4e18-4f36-93f9-bc168eb8b378&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0867779 Dec 09 21:44:05.800547 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07356419-64fa-47c1-877d-b8075711c1d8 req-7689a8cc-86fb-435f-ad89-c0bf1b3dd241 service neutron] 10.222.0.31 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1396136 Dec 09 21:44:05.816676 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82ea1269-ee5e-4e8a-8ff5-c165935a9a54 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Pushing event deleted for resources: {'Port': ['ID=ed9ae1ad-3844-40e9-aead-14aa239ad517,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:05.846115 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1fe306d3-8d62-4a00-a0d0-e2b8fac4ab78 None None] DHCP port deletion for f57a042a-7e03-40f8-ab65-0cce91b75390 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:44:05.866223 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e0bf3745-f258-44fa-bf52-6018492b96bc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:05.895111 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-6ff54571-80df-4f24-ba07-6f13281dda42 req-82ea1269-ee5e-4e8a-8ff5-c165935a9a54 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] No DVR routers for this DVR port ed9ae1ad-3844-40e9-aead-14aa239ad517 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:44:05.899006 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f57800b1-780a-4f3f-ab37-cbfddcf7cce7 req-bd3ba6a2-cfb8-4361-8dc8-1102683cf844 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:05.901206 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f57800b1-780a-4f3f-ab37-cbfddcf7cce7 req-bd3ba6a2-cfb8-4361-8dc8-1102683cf844 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6f2bd57ebcdc4c748e719519e3961b70&device_id=19f2fc87-2a43-4349-a873-6d310f0c574e HTTP/1.1" status: 200 len: 1096 time: 0.0463078 Dec 09 21:44:05.901369 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6ff54571-80df-4f24-ba07-6f13281dda42 req-82ea1269-ee5e-4e8a-8ff5-c165935a9a54 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:05.904689 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6ff54571-80df-4f24-ba07-6f13281dda42 req-82ea1269-ee5e-4e8a-8ff5-c165935a9a54 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.31 "DELETE /v2.0/ports/ed9ae1ad-3844-40e9-aead-14aa239ad517 HTTP/1.1" status: 204 len: 173 time: 1.2728753 Dec 09 21:44:05.907573 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b9aa302c-e89a-45cb-8c54-e52687b0927e', 'name': 'network-vif-deleted', 'tag': 'ed9ae1ad-3844-40e9-aead-14aa239ad517'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:44:05.910012 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-781bc5bd-9b4d-4154-89bb-69ed0a2a6488" -d '{"events": [{"server_uuid": "b9aa302c-e89a-45cb-8c54-e52687b0927e", "name": "network-vif-deleted", "tag": "ed9ae1ad-3844-40e9-aead-14aa239ad517"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:44:05.932363 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16316198-c6ca-4887-856e-1b3523aaa79a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:05.935114 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e0bf3745-f258-44fa-bf52-6018492b96bc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:06.010413 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16316198-c6ca-4887-856e-1b3523aaa79a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:06.026046 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e0bf3745-f258-44fa-bf52-6018492b96bc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:06.029556 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e0bf3745-f258-44fa-bf52-6018492b96bc admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:06.030722 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e0bf3745-f258-44fa-bf52-6018492b96bc admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/bb186320-7f5e-4c43-a4b4-04a447662e3e HTTP/1.1" status: 204 len: 168 time: 0.3587563 Dec 09 21:44:06.059687 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8147b85d-c79c-484d-95c7-33f666c71c63 req-329a92e2-9cfc-4631-b847-a92fcd0d4a62 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:06.061242 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8147b85d-c79c-484d-95c7-33f666c71c63 req-329a92e2-9cfc-4631-b847-a92fcd0d4a62 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=19f2fc87-2a43-4349-a873-6d310f0c574e HTTP/1.1" status: 200 len: 944 time: 0.0759408 Dec 09 21:44:06.062284 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f57800b1-780a-4f3f-ab37-cbfddcf7cce7 req-e84e7fcd-dcca-48f3-80b5-605adce24088 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:06.063645 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f57800b1-780a-4f3f-ab37-cbfddcf7cce7 req-e84e7fcd-dcca-48f3-80b5-605adce24088 service neutron] 10.222.0.31 "GET /v2.0/networks?id=eda4cb39-afde-43d7-a13b-5227cc6862dd HTTP/1.1" status: 200 len: 915 time: 0.1535327 Dec 09 21:44:06.101815 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-16316198-c6ca-4887-856e-1b3523aaa79a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Network 74a4e90b-0273-461a-8432-d442c0560885 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:44:06.102728 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0bf3745-f258-44fa-bf52-6018492b96bc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bb186320-7f5e-4c43-a4b4-04a447662e3e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:06.107350 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-16316198-c6ca-4887-856e-1b3523aaa79a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:44:06.114426 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16316198-c6ca-4887-856e-1b3523aaa79a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:44:06.173422 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16316198-c6ca-4887-856e-1b3523aaa79a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:06.174126 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16316198-c6ca-4887-856e-1b3523aaa79a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:06.177878 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16316198-c6ca-4887-856e-1b3523aaa79a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Port': ['ID=97adad29-d668-4e98-9fb3-f98121e998ee,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:06.199911 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-16316198-c6ca-4887-856e-1b3523aaa79a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 928 time: 1.5020590 Dec 09 21:44:06.200936 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39236) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:06.206331 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-127dab95-6080-49b0-b92f-87837fe2a139 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': '97adad29-d668-4e98-9fb3-f98121e998ee', 'fixed_ip_address': '172.20.0.5'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:06.234659 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-127dab95-6080-49b0-b92f-87837fe2a139 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:06.348178 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-127dab95-6080-49b0-b92f-87837fe2a139 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:06.475504 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-127dab95-6080-49b0-b92f-87837fe2a139 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Allocated IP 172.25.3.139 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/ca57586d-9741-4c5d-8b92-4538dc995607) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:44:06.508664 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f57800b1-780a-4f3f-ab37-cbfddcf7cce7 req-530c9934-bf73-4a93-9beb-32f2a11fe766 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=bd9c1c28-304b-4656-bd19-43407d1b6dc2 HTTP/1.1" status: 200 len: 217 time: 0.4341457 Dec 09 21:44:06.555692 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8147b85d-c79c-484d-95c7-33f666c71c63 req-65b5bb0d-36f5-43a4-95e3-976bec09e9d0 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4843466 Dec 09 21:44:06.601864 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:44:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0e18d0b9-690b-46d8-ac15-8f18c4720a79 x-openstack-request-id: req-0e18d0b9-690b-46d8-ac15-8f18c4720a79 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:44:06.602399 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b9aa302c-e89a-45cb-8c54-e52687b0927e", "name": "network-vif-deleted", "tag": "ed9ae1ad-3844-40e9-aead-14aa239ad517", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:44:06.602399 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0e18d0b9-690b-46d8-ac15-8f18c4720a79 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:44:06.602799 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b9aa302c-e89a-45cb-8c54-e52687b0927e', 'name': 'network-vif-deleted', 'tag': 'ed9ae1ad-3844-40e9-aead-14aa239ad517', 'status': 'completed', 'code': 200} Dec 09 21:44:06.604104 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f57800b1-780a-4f3f-ab37-cbfddcf7cce7 req-2ad44a3c-7d90-4deb-b82c-655acdb5c290 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:06.606109 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f57800b1-780a-4f3f-ab37-cbfddcf7cce7 req-2ad44a3c-7d90-4deb-b82c-655acdb5c290 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=24afae0e-0a38-484d-a023-a2fb471bdb33 HTTP/1.1" status: 200 len: 854 time: 0.0753591 Dec 09 21:44:06.616545 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-127dab95-6080-49b0-b92f-87837fe2a139 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:06.639511 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:06.657587 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f57800b1-780a-4f3f-ab37-cbfddcf7cce7 req-12528dc7-5067-4ce0-9d9d-df9d6434d602 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eda4cb39-afde-43d7-a13b-5227cc6862dd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0359628 Dec 09 21:44:06.674323 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-127dab95-6080-49b0-b92f-87837fe2a139 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:06.699050 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d06bb67c-6b12-4db7-8ab8-f25e952f9063 req-06044602-3922-4808-a245-dcc667766fbe tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0386634 Dec 09 21:44:06.721820 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-127dab95-6080-49b0-b92f-87837fe2a139 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:44:06.724976 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-127dab95-6080-49b0-b92f-87837fe2a139 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:44:06.729655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-127dab95-6080-49b0-b92f-87837fe2a139 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:44:06.764447 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-127dab95-6080-49b0-b92f-87837fe2a139 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Port': ['ID=ca57586d-9741-4c5d-8b92-4538dc995607,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:06.799854 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f57800b1-780a-4f3f-ab37-cbfddcf7cce7 req-f3d9c595-4868-4cef-b9a8-1701e7ce5f21 service neutron] 10.222.0.31 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1243899 Dec 09 21:44:06.946563 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f57800b1-780a-4f3f-ab37-cbfddcf7cce7 req-d27d4a76-6abf-417c-9b42-dbe70504b5c3 service neutron] 10.222.0.31 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1338274 Dec 09 21:44:07.220738 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-4490e96a-3f96-4993-861e-0b5621eaea05 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:07.222333 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-4490e96a-3f96-4993-861e-0b5621eaea05 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/networks?id=f57a042a-7e03-40f8-ab65-0cce91b75390 HTTP/1.1" status: 200 len: 809 time: 0.1330516 Dec 09 21:44:07.243570 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-17f3f717-6555-47d5-801f-dc25bad86783 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/quotas/94c88405417a4eea84491e86df14a0b0 HTTP/1.1" status: 200 len: 375 time: 0.0152559 Dec 09 21:44:07.270927 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-127dab95-6080-49b0-b92f-87837fe2a139 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:07.278213 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-95ad7d38-a9df-4235-9646-cea20cfd4485 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=94c88405417a4eea84491e86df14a0b0&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0289950 Dec 09 21:44:07.348069 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-127dab95-6080-49b0-b92f-87837fe2a139 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:07.400750 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-94f5ac39-99a4-4183-9c3d-e110253ad724 service neutron] 10.222.0.13 "GET /v2.0/networks/f57a042a-7e03-40f8-ab65-0cce91b75390?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1152287 Dec 09 21:44:07.514735 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-8d14ddc1-761e-4445-bde5-7e97f8f9ec81 service neutron] 10.222.0.13 "GET /v2.0/networks/f57a042a-7e03-40f8-ab65-0cce91b75390?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1055019 Dec 09 21:44:07.546345 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-127dab95-6080-49b0-b92f-87837fe2a139 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:07.557319 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-127dab95-6080-49b0-b92f-87837fe2a139 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:07.646830 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-127dab95-6080-49b0-b92f-87837fe2a139 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Port': ['ID=ca57586d-9741-4c5d-8b92-4538dc995607,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:07.671832 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-127dab95-6080-49b0-b92f-87837fe2a139 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:07.769645 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfd7d32d-bd44-4c0a-8f7a-851c5483f752 req-9ce3e036-1a7d-440f-98a7-bde60aa562db tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:07.796034 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dfd7d32d-bd44-4c0a-8f7a-851c5483f752 req-9ce3e036-1a7d-440f-98a7-bde60aa562db tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=19f2fc87-2a43-4349-a873-6d310f0c574e HTTP/1.1" status: 200 len: 944 time: 0.0881181 Dec 09 21:44:07.836147 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-127dab95-6080-49b0-b92f-87837fe2a139 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Floating IP 66ef6d73-a1ce-4aa6-93ef-0873451bc628 associated. External IP: 172.25.3.139, port: 97adad29-d668-4e98-9fb3-f98121e998ee. Dec 09 21:44:07.889113 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dfd7d32d-bd44-4c0a-8f7a-851c5483f752 req-a3fb64c6-1478-412d-aa07-466ce8f743b9 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0921841 Dec 09 21:44:07.982697 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:08.011328 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2dee023-4d77-4489-a6da-58ed341e14ce req-7821ed88-eef5-469b-8723-c5a0eed88273 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?device_id=36817331-72d9-48da-9467-bb52b05e52ff HTTP/1.1" status: 200 len: 210 time: 0.0591769 Dec 09 21:44:08.141009 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44c3dc4b-cf18-491b-867d-da5e43d227fa req-c43454d3-4318-4e2d-8298-e7ced8cdc4b6 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0576577 Dec 09 21:44:08.172666 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-127dab95-6080-49b0-b92f-87837fe2a139 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Router 3054de87-ea87-42d0-ac7b-818bc1f8e2c8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:44:08.291098 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-127dab95-6080-49b0-b92f-87837fe2a139 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:44:08.303733 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ccedd410-6d0f-46cf-acff-ddcf39913831 None None] Sync routers for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:44:08.314989 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ccedd410-6d0f-46cf-acff-ddcf39913831 None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:08.315753 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-ccedd410-6d0f-46cf-acff-ddcf39913831 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:08.322871 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-127dab95-6080-49b0-b92f-87837fe2a139 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:08.355053 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-127dab95-6080-49b0-b92f-87837fe2a139 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 982 time: 2.1527960 Dec 09 21:44:08.355278 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-ccedd410-6d0f-46cf-acff-ddcf39913831 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:08.357940 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39304) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:08.365537 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ccedd410-6d0f-46cf-acff-ddcf39913831 None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:08.366172 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-ccedd410-6d0f-46cf-acff-ddcf39913831 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:08.367420 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-452eebd4-75c7-44f1-bdc6-13fe1ebb15fb tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Request body: {'floatingip': {'port_id': None}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:08.407238 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-ccedd410-6d0f-46cf-acff-ddcf39913831 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:08.408017 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ccedd410-6d0f-46cf-acff-ddcf39913831 None None] The sync data for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:44:08.438871 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-452eebd4-75c7-44f1-bdc6-13fe1ebb15fb tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:08.610373 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-452eebd4-75c7-44f1-bdc6-13fe1ebb15fb tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:08.615240 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-452eebd4-75c7-44f1-bdc6-13fe1ebb15fb tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:08.615602 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-452eebd4-75c7-44f1-bdc6-13fe1ebb15fb tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Floating IP 66ef6d73-a1ce-4aa6-93ef-0873451bc628 disassociated. External IP: 172.25.3.139, port: 97adad29-d668-4e98-9fb3-f98121e998ee. Dec 09 21:44:08.845942 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-452eebd4-75c7-44f1-bdc6-13fe1ebb15fb tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Router 3054de87-ea87-42d0-ac7b-818bc1f8e2c8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:44:08.974768 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-f03c4f4e-cb80-4c38-a8df-4415655639a4 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:08.977320 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-f03c4f4e-cb80-4c38-a8df-4415655639a4 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.31 "GET /v2.0/networks?id=f57a042a-7e03-40f8-ab65-0cce91b75390 HTTP/1.1" status: 200 len: 809 time: 0.1370564 Dec 09 21:44:09.009075 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-452eebd4-75c7-44f1-bdc6-13fe1ebb15fb tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:44:09.009394 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-d256be3f-1b51-4bbe-83e7-e5ac32e7617c tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Request body: {'port': {'device_id': '36817331-72d9-48da-9467-bb52b05e52ff', 'network_id': 'f57a042a-7e03-40f8-ab65-0cce91b75390', 'admin_state_up': True, 'tenant_id': '94c88405417a4eea84491e86df14a0b0'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:09.014204 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-452eebd4-75c7-44f1-bdc6-13fe1ebb15fb tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:09.022043 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-296aa81a-fa69-4e5a-bfc1-c92ce52ad667 None None] Sync routers for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:44:09.039006 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-296aa81a-fa69-4e5a-bfc1-c92ce52ad667 None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:09.039809 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-296aa81a-fa69-4e5a-bfc1-c92ce52ad667 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:09.052997 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-452eebd4-75c7-44f1-bdc6-13fe1ebb15fb tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "PUT /v2.0/floatingips/66ef6d73-a1ce-4aa6-93ef-0873451bc628 HTTP/1.1" status: 200 len: 688 time: 0.6911020 Dec 09 21:44:09.053411 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39316) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:09.092120 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-296aa81a-fa69-4e5a-bfc1-c92ce52ad667 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:09.103540 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-296aa81a-fa69-4e5a-bfc1-c92ce52ad667 None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:09.105077 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-296aa81a-fa69-4e5a-bfc1-c92ce52ad667 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:09.116350 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-359625b4-1404-48f0-89c7-f20a506cb140 req-d08070b0-4d24-4965-a31c-db38b3621fba tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:09.118540 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-359625b4-1404-48f0-89c7-f20a506cb140 req-d08070b0-4d24-4965-a31c-db38b3621fba tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=19f2fc87-2a43-4349-a873-6d310f0c574e HTTP/1.1" status: 200 len: 944 time: 0.1288924 Dec 09 21:44:09.148074 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-296aa81a-fa69-4e5a-bfc1-c92ce52ad667 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:09.149886 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-296aa81a-fa69-4e5a-bfc1-c92ce52ad667 None None] The sync data for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:44:09.198281 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-a28fbb8b-1da6-4997-975f-4e2fc7881867 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Deleting port ca57586d-9741-4c5d-8b92-4538dc995607 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:44:09.198976 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a28fbb8b-1da6-4997-975f-4e2fc7881867 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:09.199403 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-359625b4-1404-48f0-89c7-f20a506cb140 req-4d731ccc-44bd-4165-8014-563687844676 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0734246 Dec 09 21:44:09.215064 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-d256be3f-1b51-4bbe-83e7-e5ac32e7617c tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Made reservation on behalf of 94c88405417a4eea84491e86df14a0b0 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:44:09.219064 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-d256be3f-1b51-4bbe-83e7-e5ac32e7617c tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:09.293377 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a28fbb8b-1da6-4997-975f-4e2fc7881867 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:09.293709 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a28fbb8b-1da6-4997-975f-4e2fc7881867 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:09.318774 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-a28fbb8b-1da6-4997-975f-4e2fc7881867 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Calling delete_port for ca57586d-9741-4c5d-8b92-4538dc995607 owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:44:09.337880 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8d1c1fe1-0afb-44aa-ade6-48ed5e6c9beb req-a1e3d4eb-85d9-4391-9dc6-d9acab3de5f2 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?device_id=36817331-72d9-48da-9467-bb52b05e52ff HTTP/1.1" status: 200 len: 210 time: 0.0409644 Dec 09 21:44:09.406500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-d256be3f-1b51-4bbe-83e7-e5ac32e7617c tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Allocated IP 172.20.0.14 (f57a042a-7e03-40f8-ab65-0cce91b75390/0a3f1058-1106-4429-ab0b-99e5b6e6629d/bea182c6-213a-4404-9a6f-5935c2221de2) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:44:09.472827 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf1ed915-d9f5-48d0-ac2b-8d7dfabdf735 req-e0ab11ce-37ba-4a2d-a9d6-9f8918e53ef5 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0334094 Dec 09 21:44:09.488159 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a28fbb8b-1da6-4997-975f-4e2fc7881867 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:09.517903 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a28fbb8b-1da6-4997-975f-4e2fc7881867 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event deleted for resources: {'Port': ['ID=ca57586d-9741-4c5d-8b92-4538dc995607,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:09.578584 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a28fbb8b-1da6-4997-975f-4e2fc7881867 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:09.581274 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a28fbb8b-1da6-4997-975f-4e2fc7881867 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:09.583892 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a28fbb8b-1da6-4997-975f-4e2fc7881867 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "DELETE /v2.0/floatingips/66ef6d73-a1ce-4aa6-93ef-0873451bc628 HTTP/1.1" status: 204 len: 168 time: 0.5294859 Dec 09 21:44:09.585820 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39324) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:09.590602 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-1ecf2980-38fb-4640-94ee-bfc3899680f6 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': 'f1f87d04-b570-4a83-818c-4ddc61a5c148'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:09.616440 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ecf2980-38fb-4640-94ee-bfc3899680f6 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:09.646194 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-d256be3f-1b51-4bbe-83e7-e5ac32e7617c tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:09.658034 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:09.683742 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-d256be3f-1b51-4bbe-83e7-e5ac32e7617c tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:09.731135 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-d256be3f-1b51-4bbe-83e7-e5ac32e7617c tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Network f57a042a-7e03-40f8-ab65-0cce91b75390 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:44:09.734828 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-d256be3f-1b51-4bbe-83e7-e5ac32e7617c tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:44:09.740150 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-d256be3f-1b51-4bbe-83e7-e5ac32e7617c tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:44:09.753387 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ecf2980-38fb-4640-94ee-bfc3899680f6 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:09.758410 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e7775645-4114-463c-a2fc-b89163279f9c None None] DHCP port deletion for f57a042a-7e03-40f8-ab65-0cce91b75390 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:44:09.768484 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d256be3f-1b51-4bbe-83e7-e5ac32e7617c tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Pushing event updated for resources: {'Port': ['ID=bea182c6-213a-4404-9a6f-5935c2221de2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:09.809744 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-d256be3f-1b51-4bbe-83e7-e5ac32e7617c tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:09.810087 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-d256be3f-1b51-4bbe-83e7-e5ac32e7617c tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:09.820997 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b295f83b-c99e-4955-b14d-a2d7f9fe7eac None None] Provisioning complete for port bea182c6-213a-4404-9a6f-5935c2221de2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:44:09.821369 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b295f83b-c99e-4955-b14d-a2d7f9fe7eac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:09.834783 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-d256be3f-1b51-4bbe-83e7-e5ac32e7617c tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8320620 Dec 09 21:44:09.846475 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device bd9c1c28-304b-4656-bd19-43407d1b6dc2 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:44:09.849134 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device ed9ae1ad-3844-40e9-aead-14aa239ad517 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:44:09.850209 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Request body: {'port': {'device_id': '36817331-72d9-48da-9467-bb52b05e52ff', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:09.875182 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: ed9ae1ad-3844-40e9-aead-14aa239ad517 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:44:09.875784 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device ed9ae1ad-3844-40e9-aead-14aa239ad517 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:44:09.899877 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-b295f83b-c99e-4955-b14d-a2d7f9fe7eac None None] Port bea182c6-213a-4404-9a6f-5935c2221de2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:44:09.905299 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-1ecf2980-38fb-4640-94ee-bfc3899680f6 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Allocated IP 172.25.3.32 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/e28879b1-a7df-4d35-96c1-2c1b742f57e3) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:44:09.911758 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:10.064843 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port bd9c1c28-304b-4656-bd19-43407d1b6dc2, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=bd9c1c28-304b-4656-bd19-43407d1b6dc2,segment=NetworkSegment(0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5),segment_id=0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:44:10.066816 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ecf2980-38fb-4640-94ee-bfc3899680f6 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:10.089591 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'bd9c1c28-304b-4656-bd19-43407d1b6dc2', 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd', 'port_id': 'bd9c1c28-304b-4656-bd19-43407d1b6dc2', 'mac_address': 'fa:16:3e:35:82:8e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '24afae0e-0a38-484d-a023-a2fb471bdb33', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:44:10.112547 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ecf2980-38fb-4640-94ee-bfc3899680f6 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:10.143522 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:10.163620 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bd9c1c28-304b-4656-bd19-43407d1b6dc2 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:44:10.184279 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ecf2980-38fb-4640-94ee-bfc3899680f6 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:44:10.188249 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-1ecf2980-38fb-4640-94ee-bfc3899680f6 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:44:10.188929 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port bd9c1c28-304b-4656-bd19-43407d1b6dc2, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=bd9c1c28-304b-4656-bd19-43407d1b6dc2,segment=NetworkSegment(0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5),segment_id=0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:44:10.195144 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ecf2980-38fb-4640-94ee-bfc3899680f6 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:44:10.197118 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:10.248138 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bea182c6-213a-4404-9a6f-5935c2221de2 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:44:10.257200 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:10.285811 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=bd9c1c28-304b-4656-bd19-43407d1b6dc2,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:10.287114 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Transition to ACTIVE for port object bea182c6-213a-4404-9a6f-5935c2221de2 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:44:10.297078 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:10.299250 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ecf2980-38fb-4640-94ee-bfc3899680f6 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Port': ['ID=e28879b1-a7df-4d35-96c1-2c1b742f57e3,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:10.369568 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0fd68993-b5f8-4fe6-ac5e-f101e22bbc32 None None] DHCP port deletion for f57a042a-7e03-40f8-ab65-0cce91b75390 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:44:10.392048 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Pushing event updated for resources: {'Port': ['ID=bea182c6-213a-4404-9a6f-5935c2221de2,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:10.407027 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:10.407332 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:10.408197 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:10.408197 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:10.408413 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:10.408701 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:10.409036 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:10.409369 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:10.409695 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:10.410417 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:10.410417 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:10.410704 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:10.411008 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:10.414059 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['bd9c1c28-304b-4656-bd19-43407d1b6dc2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:44:10.470069 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9d1a9c4-28aa-47fe-9328-ba43d6b53e2e req-2b141faa-a320-466d-a5c4-a6332c116d9b tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:10.471550 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e9d1a9c4-28aa-47fe-9328-ba43d6b53e2e req-2b141faa-a320-466d-a5c4-a6332c116d9b tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=19f2fc87-2a43-4349-a873-6d310f0c574e HTTP/1.1" status: 200 len: 945 time: 0.1285365 Dec 09 21:44:10.582486 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Attempting to bind port bea182c6-213a-4404-9a6f-5935c2221de2 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:44:10.584289 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Attempting to bind port bea182c6-213a-4404-9a6f-5935c2221de2 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'f69cd9ac-0fbe-4c49-8321-6c397e7fefa4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'f57a042a-7e03-40f8-ab65-0cce91b75390'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:44:10.585058 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Attempting to bind port bea182c6-213a-4404-9a6f-5935c2221de2 on network f57a042a-7e03-40f8-ab65-0cce91b75390 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:44:10.596498 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e9d1a9c4-28aa-47fe-9328-ba43d6b53e2e req-3b81bf71-88d4-409c-bde7-9d18c4eb1cff tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1097968 Dec 09 21:44:10.602250 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Port bea182c6-213a-4404-9a6f-5935c2221de2 on network f57a042a-7e03-40f8-ab65-0cce91b75390 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:44:10.602913 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Attempting to bind port bea182c6-213a-4404-9a6f-5935c2221de2 on network f57a042a-7e03-40f8-ab65-0cce91b75390 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:44:10.611934 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 43, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:44:10.612523 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Checking segment: {'id': 'f69cd9ac-0fbe-4c49-8321-6c397e7fefa4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'f57a042a-7e03-40f8-ab65-0cce91b75390'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:44:10.613184 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Bound using segment: {'id': 'f69cd9ac-0fbe-4c49-8321-6c397e7fefa4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'f57a042a-7e03-40f8-ab65-0cce91b75390'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:44:10.614520 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Bound port: bea182c6-213a-4404-9a6f-5935c2221de2, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f69cd9ac-0fbe-4c49-8321-6c397e7fefa4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 108, 'network_id': 'f57a042a-7e03-40f8-ab65-0cce91b75390'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:44:10.615117 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:10.722619 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] For port bea182c6-213a-4404-9a6f-5935c2221de2, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:44:10.726993 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] For port bea182c6-213a-4404-9a6f-5935c2221de2, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=bea182c6-213a-4404-9a6f-5935c2221de2,segment=NetworkSegment(f69cd9ac-0fbe-4c49-8321-6c397e7fefa4),segment_id=f69cd9ac-0fbe-4c49-8321-6c397e7fefa4)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:44:10.738768 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46e46e27-0931-4be4-b3d8-c250a87fda65 req-a41b7b07-1814-4f61-b47b-af1bf94b68a0 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:10.741018 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46e46e27-0931-4be4-b3d8-c250a87fda65 req-a41b7b07-1814-4f61-b47b-af1bf94b68a0 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?device_id=36817331-72d9-48da-9467-bb52b05e52ff HTTP/1.1" status: 200 len: 944 time: 0.0758152 Dec 09 21:44:10.742706 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:10.798734 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:10.799362 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:10.799984 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33741190-86b7-4df1-b141-c5dcff84d484 None None] DHCP port deletion for f57a042a-7e03-40f8-ab65-0cce91b75390 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:44:10.803028 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] 10.222.0.31 "PUT /v2.0/ports/bea182c6-213a-4404-9a6f-5935c2221de2 HTTP/1.1" status: 200 len: 1093 time: 0.9574783 Dec 09 21:44:10.803499 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '36817331-72d9-48da-9467-bb52b05e52ff', 'tag': 'bea182c6-213a-4404-9a6f-5935c2221de2'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:44:10.805959 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-64050586-7666-4c85-8aef-e1f384497b50" -d '{"events": [{"name": "network-changed", "server_uuid": "36817331-72d9-48da-9467-bb52b05e52ff", "tag": "bea182c6-213a-4404-9a6f-5935c2221de2"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:44:10.922041 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6d7625a-707a-46dd-b65d-a9a3097118d4 service neutron] Pushing event updated for resources: {'Port': ['ID=bea182c6-213a-4404-9a6f-5935c2221de2,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:10.935345 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46e46e27-0931-4be4-b3d8-c250a87fda65 req-fb50cb65-94f9-4f44-8077-7ba40823f82c tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/security-groups?id=96f2cc1f-4e18-4f36-93f9-bc168eb8b378&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1840780 Dec 09 21:44:10.977221 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-619d4e3d-132f-4ddb-9f29-8b3cb24f5f77 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:10.978730 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-619d4e3d-132f-4ddb-9f29-8b3cb24f5f77 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=94c88405417a4eea84491e86df14a0b0&device_id=36817331-72d9-48da-9467-bb52b05e52ff HTTP/1.1" status: 200 len: 1096 time: 0.1194742 Dec 09 21:44:11.026800 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-16239abd-76dc-4f2d-94f9-9b81f03c37a8 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=bea182c6-213a-4404-9a6f-5935c2221de2 HTTP/1.1" status: 200 len: 217 time: 0.0380218 Dec 09 21:44:11.094153 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8bc1ba70-10d0-454f-9584-9b26f3e1bd11 req-a5dac60b-cbc9-4caa-a1f8-45a961e5f9b8 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0614347 Dec 09 21:44:11.096188 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ecf2980-38fb-4640-94ee-bfc3899680f6 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:11.111926 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-c02047cc-a1d8-4adf-8bcd-5c1294d328a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:11.113408 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-c02047cc-a1d8-4adf-8bcd-5c1294d328a8 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=0a3f1058-1106-4429-ab0b-99e5b6e6629d HTTP/1.1" status: 200 len: 849 time: 0.0726418 Dec 09 21:44:11.150606 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-1581a5d2-fcdf-4437-8ed9-a972b331e42b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=f57a042a-7e03-40f8-ab65-0cce91b75390&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0284030 Dec 09 21:44:11.152150 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:44:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aee79a3e-00d5-4511-90c1-05f7ef286809 x-openstack-request-id: req-aee79a3e-00d5-4511-90c1-05f7ef286809 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:44:11.152438 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "36817331-72d9-48da-9467-bb52b05e52ff", "tag": "bea182c6-213a-4404-9a6f-5935c2221de2", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:44:11.152687 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-aee79a3e-00d5-4511-90c1-05f7ef286809 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:44:11.153078 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '36817331-72d9-48da-9467-bb52b05e52ff', 'tag': 'bea182c6-213a-4404-9a6f-5935c2221de2', 'status': 'completed', 'code': 200} Dec 09 21:44:11.166766 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ecf2980-38fb-4640-94ee-bfc3899680f6 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:11.246329 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-e34fc5ef-d50d-4f76-88e4-73d2c5019834 service neutron] 10.222.0.31 "GET /v2.0/networks/f57a042a-7e03-40f8-ab65-0cce91b75390?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0861149 Dec 09 21:44:11.317238 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ecf2980-38fb-4640-94ee-bfc3899680f6 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:11.322590 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ecf2980-38fb-4640-94ee-bfc3899680f6 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:11.341957 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-773a0d8a-1c13-48f9-b190-8968920ce681 req-796b3fee-8dfc-468a-b501-31f792ce77e0 service neutron] 10.222.0.31 "GET /v2.0/networks/f57a042a-7e03-40f8-ab65-0cce91b75390?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0853434 Dec 09 21:44:11.395999 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ecf2980-38fb-4640-94ee-bfc3899680f6 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Port': ['ID=e28879b1-a7df-4d35-96c1-2c1b742f57e3,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:11.406973 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ecf2980-38fb-4640-94ee-bfc3899680f6 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:11.428719 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64050586-7666-4c85-8aef-e1f384497b50 req-052a8c14-d6d0-467a-ad17-73e664b1248a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:11.430345 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-64050586-7666-4c85-8aef-e1f384497b50 req-052a8c14-d6d0-467a-ad17-73e664b1248a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=94c88405417a4eea84491e86df14a0b0&device_id=36817331-72d9-48da-9467-bb52b05e52ff HTTP/1.1" status: 200 len: 1096 time: 0.0423141 Dec 09 21:44:11.519732 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-1ecf2980-38fb-4640-94ee-bfc3899680f6 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Floating IP 6d98f1f2-0048-4180-b0ae-0411a35215a1 associated. External IP: 172.25.3.32, port: f1f87d04-b570-4a83-818c-4ddc61a5c148. Dec 09 21:44:11.535620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64050586-7666-4c85-8aef-e1f384497b50 req-f45bb751-092d-4401-bf00-58b163f8798e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:11.537161 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-64050586-7666-4c85-8aef-e1f384497b50 req-f45bb751-092d-4401-bf00-58b163f8798e service neutron] 10.222.0.31 "GET /v2.0/networks?id=f57a042a-7e03-40f8-ab65-0cce91b75390 HTTP/1.1" status: 200 len: 910 time: 0.0980856 Dec 09 21:44:11.583686 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-64050586-7666-4c85-8aef-e1f384497b50 req-82f1142e-147d-48c2-a244-b2e50292ba4a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=bea182c6-213a-4404-9a6f-5935c2221de2 HTTP/1.1" status: 200 len: 217 time: 0.0375249 Dec 09 21:44:11.645059 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64050586-7666-4c85-8aef-e1f384497b50 req-6c19f697-5d8a-45b9-8b2e-4b7999406b8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:11.646577 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-64050586-7666-4c85-8aef-e1f384497b50 req-6c19f697-5d8a-45b9-8b2e-4b7999406b8e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=0a3f1058-1106-4429-ab0b-99e5b6e6629d HTTP/1.1" status: 200 len: 849 time: 0.0539157 Dec 09 21:44:11.682520 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-64050586-7666-4c85-8aef-e1f384497b50 req-41013378-0dab-4cae-abf3-58d06d32b619 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=f57a042a-7e03-40f8-ab65-0cce91b75390&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0275805 Dec 09 21:44:11.768559 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1ecf2980-38fb-4640-94ee-bfc3899680f6 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Router 3054de87-ea87-42d0-ac7b-818bc1f8e2c8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:44:11.789360 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-874f5119-3399-48a8-84b3-8ac115a63b85 req-a44a4ca6-6d74-4729-ab32-39ad72ae4e8c tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:11.791730 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-874f5119-3399-48a8-84b3-8ac115a63b85 req-a44a4ca6-6d74-4729-ab32-39ad72ae4e8c tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=19f2fc87-2a43-4349-a873-6d310f0c574e HTTP/1.1" status: 200 len: 945 time: 0.1114185 Dec 09 21:44:11.839511 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-64050586-7666-4c85-8aef-e1f384497b50 req-6308897b-56ce-41ab-b8ce-9a1da325b284 service neutron] 10.222.0.31 "GET /v2.0/networks/f57a042a-7e03-40f8-ab65-0cce91b75390?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1486456 Dec 09 21:44:11.858666 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device bd9c1c28-304b-4656-bd19-43407d1b6dc2 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:44:11.885587 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-874f5119-3399-48a8-84b3-8ac115a63b85 req-1ce7ce4f-9502-4ad2-a27a-2915316b7b61 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0835674 Dec 09 21:44:11.887737 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1ecf2980-38fb-4640-94ee-bfc3899680f6 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:44:11.902407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32494bc4-444a-4f8b-a569-5411b25261fa None None] Sync routers for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:44:11.920282 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32494bc4-444a-4f8b-a569-5411b25261fa None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:11.920906 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-32494bc4-444a-4f8b-a569-5411b25261fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:11.923917 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ecf2980-38fb-4640-94ee-bfc3899680f6 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:11.953301 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1ecf2980-38fb-4640-94ee-bfc3899680f6 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 982 time: 2.3662624 Dec 09 21:44:11.954326 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-64050586-7666-4c85-8aef-e1f384497b50 req-320b8121-ad6e-49ca-9911-22c0630054c9 service neutron] 10.222.0.31 "GET /v2.0/networks/f57a042a-7e03-40f8-ab65-0cce91b75390?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1045210 Dec 09 21:44:11.955876 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39346) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:11.961493 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-32494bc4-444a-4f8b-a569-5411b25261fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:11.972579 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32494bc4-444a-4f8b-a569-5411b25261fa None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:11.973348 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-32494bc4-444a-4f8b-a569-5411b25261fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:11.978419 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port bd9c1c28-304b-4656-bd19-43407d1b6dc2 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:44:12.010646 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port bd9c1c28-304b-4656-bd19-43407d1b6dc2 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:44:12.010981 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:12.012617 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-32494bc4-444a-4f8b-a569-5411b25261fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:12.013211 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32494bc4-444a-4f8b-a569-5411b25261fa None None] The sync data for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:44:12.029960 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-803d543f-7ee8-46fd-8b98-359053ca2163 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "GET /v2.0/floatingips/6d98f1f2-0048-4180-b0ae-0411a35215a1 HTTP/1.1" status: 200 len: 977 time: 0.0727260 Dec 09 21:44:12.033009 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39350) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:12.094737 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:12.128408 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '19f2fc87-2a43-4349-a873-6d310f0c574e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bd9c1c28-304b-4656-bd19-43407d1b6dc2'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:44:12.130691 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dd0addb2-8004-467b-a825-464cb17b9fbc" -d '{"events": [{"server_uuid": "19f2fc87-2a43-4349-a873-6d310f0c574e", "name": "network-vif-plugged", "status": "completed", "tag": "bd9c1c28-304b-4656-bd19-43407d1b6dc2"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:44:12.145613 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port bd9c1c28-304b-4656-bd19-43407d1b6dc2, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=bd9c1c28-304b-4656-bd19-43407d1b6dc2,segment=NetworkSegment(0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5),segment_id=0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:44:12.150912 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:12.178241 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a63f3db9-e62d-4216-a2fa-aad943578132 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "GET /v2.0/floatingips HTTP/1.1" status: 200 len: 980 time: 0.1371474 Dec 09 21:44:12.184376 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39360) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:12.185375 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-44c6da0b-642f-484a-906c-63bf3a217db1 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Request body: {'floatingip': {'port_id': '97adad29-d668-4e98-9fb3-f98121e998ee'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:12.196649 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f7c56ec-7365-43de-a1d0-612e2ea2cf8f req-70a19725-fb78-41f3-8295-4399b789db77 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:12.198199 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7f7c56ec-7365-43de-a1d0-612e2ea2cf8f req-70a19725-fb78-41f3-8295-4399b789db77 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?device_id=36817331-72d9-48da-9467-bb52b05e52ff HTTP/1.1" status: 200 len: 944 time: 0.1703234 Dec 09 21:44:12.214426 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=bd9c1c28-304b-4656-bd19-43407d1b6dc2,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:12.271223 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-44c6da0b-642f-484a-906c-63bf3a217db1 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:12.322735 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7f7c56ec-7365-43de-a1d0-612e2ea2cf8f req-f05e22d3-9e3c-43a4-8eb6-ef14fb760df6 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/security-groups?id=96f2cc1f-4e18-4f36-93f9-bc168eb8b378&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0970993 Dec 09 21:44:12.449232 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-689e23c4-3a71-4f58-97c4-cee9aa34c8f8 req-ecb37f78-2179-4a43-bc49-e62af30d3310 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0484645 Dec 09 21:44:12.502084 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:44:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7824157b-6513-461d-8264-2d059df1f277 x-openstack-request-id: req-7824157b-6513-461d-8264-2d059df1f277 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:44:12.502690 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "19f2fc87-2a43-4349-a873-6d310f0c574e", "name": "network-vif-plugged", "status": "completed", "tag": "bd9c1c28-304b-4656-bd19-43407d1b6dc2", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:44:12.503223 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-7824157b-6513-461d-8264-2d059df1f277 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:44:12.503869 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '19f2fc87-2a43-4349-a873-6d310f0c574e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bd9c1c28-304b-4656-bd19-43407d1b6dc2', 'code': 200} Dec 09 21:44:12.669881 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-855f9b96-0a83-4605-bc84-f5dd98ac73a9 req-90cacd20-c3cf-48b9-ad57-87c583148ee2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:12.671617 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-855f9b96-0a83-4605-bc84-f5dd98ac73a9 req-90cacd20-c3cf-48b9-ad57-87c583148ee2 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=19f2fc87-2a43-4349-a873-6d310f0c574e HTTP/1.1" status: 200 len: 1098 time: 0.0983062 Dec 09 21:44:12.863574 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-855f9b96-0a83-4605-bc84-f5dd98ac73a9 req-0c335d7f-e499-494c-9fb3-db4c82731e90 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1832538 Dec 09 21:44:13.451610 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.db.resource_extend [None req-44c6da0b-642f-484a-906c-63bf3a217db1 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] It took 0.48 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 09 21:44:13.509959 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12c01133-90fb-4d0b-87ab-d26d7aecdf77 req-89ada73f-e770-4aed-9f57-57504b96644f tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:13.511506 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-12c01133-90fb-4d0b-87ab-d26d7aecdf77 req-89ada73f-e770-4aed-9f57-57504b96644f tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=19f2fc87-2a43-4349-a873-6d310f0c574e HTTP/1.1" status: 200 len: 946 time: 0.5295813 Dec 09 21:44:13.523597 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-44c6da0b-642f-484a-906c-63bf3a217db1 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:13.530509 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-44c6da0b-642f-484a-906c-63bf3a217db1 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:13.610075 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-12c01133-90fb-4d0b-87ab-d26d7aecdf77 req-7f932982-9d80-45b8-a6fc-d8b28d32f77a tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0908411 Dec 09 21:44:13.656475 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-44c6da0b-642f-484a-906c-63bf3a217db1 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Floating IP 6d98f1f2-0048-4180-b0ae-0411a35215a1 associated. External IP: 172.25.3.32, port: f1f87d04-b570-4a83-818c-4ddc61a5c148. Dec 09 21:44:13.788280 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e55c709-5ba9-465f-b45f-c0ac3734351d req-4b359e14-75f1-48f8-b775-7adde402dd2f tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:13.789882 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e55c709-5ba9-465f-b45f-c0ac3734351d req-4b359e14-75f1-48f8-b775-7adde402dd2f tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?device_id=36817331-72d9-48da-9467-bb52b05e52ff HTTP/1.1" status: 200 len: 944 time: 0.0979443 Dec 09 21:44:13.870432 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device bea182c6-213a-4404-9a6f-5935c2221de2 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:44:13.931727 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e55c709-5ba9-465f-b45f-c0ac3734351d req-111f4ce1-cd5a-4f5c-8fda-ea84e93488a8 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/security-groups?id=96f2cc1f-4e18-4f36-93f9-bc168eb8b378&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1148345 Dec 09 21:44:14.073441 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f508de3-7f42-4311-ab8c-54e0baa96e91 req-19bb02e5-deb8-4278-8eb9-a136b04da2c5 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0730109 Dec 09 21:44:14.082020 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-44c6da0b-642f-484a-906c-63bf3a217db1 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Router 3054de87-ea87-42d0-ac7b-818bc1f8e2c8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:44:14.187191 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port bea182c6-213a-4404-9a6f-5935c2221de2, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=bea182c6-213a-4404-9a6f-5935c2221de2,segment=NetworkSegment(f69cd9ac-0fbe-4c49-8321-6c397e7fefa4),segment_id=f69cd9ac-0fbe-4c49-8321-6c397e7fefa4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:44:14.200475 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'bea182c6-213a-4404-9a6f-5935c2221de2', 'network_id': 'f57a042a-7e03-40f8-ab65-0cce91b75390', 'port_id': 'bea182c6-213a-4404-9a6f-5935c2221de2', 'mac_address': 'fa:16:3e:ab:bb:e7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 108, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0a3f1058-1106-4429-ab0b-99e5b6e6629d', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:44:14.205460 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-44c6da0b-642f-484a-906c-63bf3a217db1 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:44:14.219674 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09797470-9dab-4143-8f7d-ec957514e373 None None] Sync routers for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:44:14.230838 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09797470-9dab-4143-8f7d-ec957514e373 None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:14.231739 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-09797470-9dab-4143-8f7d-ec957514e373 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:14.258832 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:14.268362 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-09797470-9dab-4143-8f7d-ec957514e373 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:14.277830 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bea182c6-213a-4404-9a6f-5935c2221de2 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:44:14.278496 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-09797470-9dab-4143-8f7d-ec957514e373 None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:14.279267 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-09797470-9dab-4143-8f7d-ec957514e373 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:14.305022 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port bea182c6-213a-4404-9a6f-5935c2221de2, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=bea182c6-213a-4404-9a6f-5935c2221de2,segment=NetworkSegment(f69cd9ac-0fbe-4c49-8321-6c397e7fefa4),segment_id=f69cd9ac-0fbe-4c49-8321-6c397e7fefa4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:44:14.312669 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:14.315941 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-09797470-9dab-4143-8f7d-ec957514e373 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:14.317093 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-09797470-9dab-4143-8f7d-ec957514e373 None None] The sync data for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:44:14.369605 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=bea182c6-213a-4404-9a6f-5935c2221de2,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:14.437568 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-44c6da0b-642f-484a-906c-63bf3a217db1 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Router 3054de87-ea87-42d0-ac7b-818bc1f8e2c8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:44:14.546584 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-44c6da0b-642f-484a-906c-63bf3a217db1 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:44:14.550982 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-44c6da0b-642f-484a-906c-63bf3a217db1 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:14.557142 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['bea182c6-213a-4404-9a6f-5935c2221de2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:44:14.561361 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f0cb9e06-7010-4b70-b1e6-b406f9accb43 None None] Sync routers for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:44:14.607334 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-44c6da0b-642f-484a-906c-63bf3a217db1 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "PUT /v2.0/floatingips/6d98f1f2-0048-4180-b0ae-0411a35215a1 HTTP/1.1" status: 200 len: 976 time: 2.4252343 Dec 09 21:44:14.608726 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0cb9e06-7010-4b70-b1e6-b406f9accb43 None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:14.609483 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-f0cb9e06-7010-4b70-b1e6-b406f9accb43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:14.610128 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39390) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:14.614873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-021b3fee-0b2b-475f-85d8-cb2b7294f69a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Request body: {'floatingip': {'port_id': None}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:14.651395 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-f0cb9e06-7010-4b70-b1e6-b406f9accb43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:14.679208 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-021b3fee-0b2b-475f-85d8-cb2b7294f69a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:14.685440 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0cb9e06-7010-4b70-b1e6-b406f9accb43 None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:14.687783 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-f0cb9e06-7010-4b70-b1e6-b406f9accb43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:14.729834 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-f0cb9e06-7010-4b70-b1e6-b406f9accb43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:14.730490 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f0cb9e06-7010-4b70-b1e6-b406f9accb43 None None] The sync data for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:44:14.753087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52f08692-af4a-4935-8d93-7a43daadffb5 req-8c8aa9a8-a6a8-40e2-baf7-2d8d12a71bf9 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:14.758950 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52f08692-af4a-4935-8d93-7a43daadffb5 req-8c8aa9a8-a6a8-40e2-baf7-2d8d12a71bf9 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=19f2fc87-2a43-4349-a873-6d310f0c574e HTTP/1.1" status: 200 len: 946 time: 0.0706620 Dec 09 21:44:14.826080 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52f08692-af4a-4935-8d93-7a43daadffb5 req-85af3c10-2cbc-4fc5-b41c-3b52c14f31b2 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0628824 Dec 09 21:44:14.915587 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-021b3fee-0b2b-475f-85d8-cb2b7294f69a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:14.930358 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-021b3fee-0b2b-475f-85d8-cb2b7294f69a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:14.931185 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-021b3fee-0b2b-475f-85d8-cb2b7294f69a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Floating IP 6d98f1f2-0048-4180-b0ae-0411a35215a1 disassociated. External IP: 172.25.3.32, port: 97adad29-d668-4e98-9fb3-f98121e998ee. Dec 09 21:44:15.096244 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bc6134d-1368-4a27-86f1-8d6a88ed1989 req-6814b138-528a-4c7e-ab8f-b6446c85d6ae tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:15.098074 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1bc6134d-1368-4a27-86f1-8d6a88ed1989 req-6814b138-528a-4c7e-ab8f-b6446c85d6ae tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?device_id=36817331-72d9-48da-9467-bb52b05e52ff HTTP/1.1" status: 200 len: 945 time: 0.0547414 Dec 09 21:44:15.154843 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1bc6134d-1368-4a27-86f1-8d6a88ed1989 req-9eb31414-5d1a-4a51-b17e-ad418926fa3e tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/security-groups?id=96f2cc1f-4e18-4f36-93f9-bc168eb8b378&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496716 Dec 09 21:44:15.189087 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-021b3fee-0b2b-475f-85d8-cb2b7294f69a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Router 3054de87-ea87-42d0-ac7b-818bc1f8e2c8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:44:15.340872 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-021b3fee-0b2b-475f-85d8-cb2b7294f69a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:44:15.346572 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-021b3fee-0b2b-475f-85d8-cb2b7294f69a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:15.358154 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2767f4e4-c235-4d1b-9bc6-4845e43a9a53 None None] Sync routers for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:44:15.368031 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2767f4e4-c235-4d1b-9bc6-4845e43a9a53 None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:15.369592 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2767f4e4-c235-4d1b-9bc6-4845e43a9a53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:15.383224 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39420) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:15.383407 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-021b3fee-0b2b-475f-85d8-cb2b7294f69a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "PUT /v2.0/floatingips/6d98f1f2-0048-4180-b0ae-0411a35215a1 HTTP/1.1" status: 200 len: 687 time: 0.7720578 Dec 09 21:44:15.435864 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2767f4e4-c235-4d1b-9bc6-4845e43a9a53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:15.448255 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2767f4e4-c235-4d1b-9bc6-4845e43a9a53 None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:15.449172 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2767f4e4-c235-4d1b-9bc6-4845e43a9a53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:15.533062 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2767f4e4-c235-4d1b-9bc6-4845e43a9a53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:15.535785 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2767f4e4-c235-4d1b-9bc6-4845e43a9a53 None None] The sync data for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:44:15.571174 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-00cd220f-a711-42fa-8969-dd010b800ddc req-50122afe-9031-4f26-9ccf-3c44dee73177 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0342290 Dec 09 21:44:15.576631 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-39d59e64-00ca-4ea4-8d83-052070a01bc0 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Deleting port e28879b1-a7df-4d35-96c1-2c1b742f57e3 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:44:15.577036 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-39d59e64-00ca-4ea4-8d83-052070a01bc0 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:15.657544 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-39d59e64-00ca-4ea4-8d83-052070a01bc0 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:15.658489 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-39d59e64-00ca-4ea4-8d83-052070a01bc0 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:15.671992 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-39d59e64-00ca-4ea4-8d83-052070a01bc0 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Calling delete_port for e28879b1-a7df-4d35-96c1-2c1b742f57e3 owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:44:15.817141 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-39d59e64-00ca-4ea4-8d83-052070a01bc0 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:15.871490 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39d59e64-00ca-4ea4-8d83-052070a01bc0 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event deleted for resources: {'Port': ['ID=e28879b1-a7df-4d35-96c1-2c1b742f57e3,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:15.874103 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device bea182c6-213a-4404-9a6f-5935c2221de2 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:44:15.913817 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-39d59e64-00ca-4ea4-8d83-052070a01bc0 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:15.916691 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-39d59e64-00ca-4ea4-8d83-052070a01bc0 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:15.918688 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-39d59e64-00ca-4ea4-8d83-052070a01bc0 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "DELETE /v2.0/floatingips/6d98f1f2-0048-4180-b0ae-0411a35215a1 HTTP/1.1" status: 204 len: 168 time: 0.5340145 Dec 09 21:44:15.921427 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39424) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:15.930879 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port bea182c6-213a-4404-9a6f-5935c2221de2 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:44:15.938057 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port bea182c6-213a-4404-9a6f-5935c2221de2 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:44:15.938693 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:15.962378 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-7c4d328c-5d83-49cf-a898-2899fce4ae40 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] delete failed (client error): The resource could not be found. Dec 09 21:44:15.964815 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7c4d328c-5d83-49cf-a898-2899fce4ae40 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "DELETE /v2.0/floatingips/6d98f1f2-0048-4180-b0ae-0411a35215a1 HTTP/1.1" status: 404 len: 345 time: 0.0416012 Dec 09 21:44:15.968094 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39426) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:16.049612 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:16.089150 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port bea182c6-213a-4404-9a6f-5935c2221de2, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=bea182c6-213a-4404-9a6f-5935c2221de2,segment=NetworkSegment(f69cd9ac-0fbe-4c49-8321-6c397e7fefa4),segment_id=f69cd9ac-0fbe-4c49-8321-6c397e7fefa4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:44:16.090368 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '36817331-72d9-48da-9467-bb52b05e52ff', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bea182c6-213a-4404-9a6f-5935c2221de2'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:44:16.092743 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-00d86c97-7fbb-4db9-a261-bb1605640b29" -d '{"events": [{"server_uuid": "36817331-72d9-48da-9467-bb52b05e52ff", "name": "network-vif-plugged", "status": "completed", "tag": "bea182c6-213a-4404-9a6f-5935c2221de2"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:44:16.096495 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:16.108405 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-08e91b53-17f8-41de-b55d-31330ffdb450 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:16.114860 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-08e91b53-17f8-41de-b55d-31330ffdb450 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:16.121553 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-08e91b53-17f8-41de-b55d-31330ffdb450 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:16.123990 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-08e91b53-17f8-41de-b55d-31330ffdb450 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "GET /v2.0/ports?network_id=74a4e90b-0273-461a-8432-d442c0560885 HTTP/1.1" status: 200 len: 2357 time: 0.1537557 Dec 09 21:44:16.126146 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39430) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:16.184193 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:44:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3e368929-34e6-4185-9413-490241c6ed1e x-openstack-request-id: req-3e368929-34e6-4185-9413-490241c6ed1e {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:44:16.184724 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "36817331-72d9-48da-9467-bb52b05e52ff", "name": "network-vif-plugged", "status": "completed", "tag": "bea182c6-213a-4404-9a6f-5935c2221de2", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:44:16.187504 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-3e368929-34e6-4185-9413-490241c6ed1e {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:44:16.188031 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '36817331-72d9-48da-9467-bb52b05e52ff', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bea182c6-213a-4404-9a6f-5935c2221de2', 'code': 200} Dec 09 21:44:16.203527 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=bea182c6-213a-4404-9a6f-5935c2221de2,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:16.230228 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3d3f3599-08ad-402b-a3d8-b32c22700bd6 req-0751f651-31f7-4657-84ca-673825d45f70 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0886564 Dec 09 21:44:16.251116 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ce19828-12e4-42c2-8da3-da3400b9ab26 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:16.252767 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7ce19828-12e4-42c2-8da3-da3400b9ab26 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "GET /v2.0/subnets/29523c9c-ae97-471c-a637-67d7fdefc076 HTTP/1.1" status: 200 len: 797 time: 0.1254930 Dec 09 21:44:16.257556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39434) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:16.262851 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-febb57a0-8749-4fda-a388-7728364f6747 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Request body: {'port': {'network_id': '74a4e90b-0273-461a-8432-d442c0560885', 'name': 'tempest-FloatingIPTestJSON-815330394', 'fixed_ips': [{'ip_address': '172.20.0.14'}, {'ip_address': '172.20.0.13'}]}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:16.445849 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-febb57a0-8749-4fda-a388-7728364f6747 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Made reservation on behalf of 1752f69b83904328a79fb89f35377bcf for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:44:16.478390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05ae3951-66cf-497a-af15-f88800fa03a6 req-1cf5d3e0-fd70-4971-85d9-6a9229a3bc95 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:16.480646 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-05ae3951-66cf-497a-af15-f88800fa03a6 req-1cf5d3e0-fd70-4971-85d9-6a9229a3bc95 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?device_id=36817331-72d9-48da-9467-bb52b05e52ff HTTP/1.1" status: 200 len: 946 time: 0.1119211 Dec 09 21:44:16.513047 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b9ec11d-640a-42cc-abbc-48c70e26a752 req-b81366d8-cfd7-448e-92a9-c7fa011b7737 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:16.514544 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2b9ec11d-640a-42cc-abbc-48c70e26a752 req-b81366d8-cfd7-448e-92a9-c7fa011b7737 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=36817331-72d9-48da-9467-bb52b05e52ff HTTP/1.1" status: 200 len: 1098 time: 0.0922227 Dec 09 21:44:16.570262 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-05ae3951-66cf-497a-af15-f88800fa03a6 req-09374d2c-c1eb-4ad2-8720-a6b1b8960c94 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/security-groups?id=96f2cc1f-4e18-4f36-93f9-bc168eb8b378&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0811577 Dec 09 21:44:16.601380 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-febb57a0-8749-4fda-a388-7728364f6747 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:16.604377 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2b9ec11d-640a-42cc-abbc-48c70e26a752 req-6d126089-dacd-48b5-ad60-754cf2cca296 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=96f2cc1f-4e18-4f36-93f9-bc168eb8b378&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0788743 Dec 09 21:44:16.624497 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-febb57a0-8749-4fda-a388-7728364f6747 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] device_id is not set on port 99dec73b-a5c3-417b-8b8c-f1c2b4ced742 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:44:16.747195 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-70d8e553-09a0-4e36-9123-c3d70805c509 req-0202a55a-9070-4935-9e07-67db6407ebc5 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0538661 Dec 09 21:44:16.973717 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-febb57a0-8749-4fda-a388-7728364f6747 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Allocated IP 172.20.0.14 (74a4e90b-0273-461a-8432-d442c0560885/29523c9c-ae97-471c-a637-67d7fdefc076/99dec73b-a5c3-417b-8b8c-f1c2b4ced742) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:44:16.980926 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-febb57a0-8749-4fda-a388-7728364f6747 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Allocated IP 172.20.0.13 (74a4e90b-0273-461a-8432-d442c0560885/29523c9c-ae97-471c-a637-67d7fdefc076/99dec73b-a5c3-417b-8b8c-f1c2b4ced742) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:44:17.163369 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-febb57a0-8749-4fda-a388-7728364f6747 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:17.209459 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-febb57a0-8749-4fda-a388-7728364f6747 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:17.262905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-febb57a0-8749-4fda-a388-7728364f6747 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Network 74a4e90b-0273-461a-8432-d442c0560885 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:44:17.267085 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-febb57a0-8749-4fda-a388-7728364f6747 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:44:17.281257 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-febb57a0-8749-4fda-a388-7728364f6747 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:44:17.289692 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-febb57a0-8749-4fda-a388-7728364f6747 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Port': ['ID=99dec73b-a5c3-417b-8b8c-f1c2b4ced742,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:17.356918 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-febb57a0-8749-4fda-a388-7728364f6747 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:17.358082 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-febb57a0-8749-4fda-a388-7728364f6747 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:17.381543 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-febb57a0-8749-4fda-a388-7728364f6747 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1009 time: 1.1225338 Dec 09 21:44:17.384280 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39442) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:17.389496 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-1992a4b8-9834-4390-8a68-5016aa2e52f3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': '99dec73b-a5c3-417b-8b8c-f1c2b4ced742', 'fixed_ip_address': '172.20.0.14'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:17.436616 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1992a4b8-9834-4390-8a68-5016aa2e52f3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:17.577424 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1992a4b8-9834-4390-8a68-5016aa2e52f3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:17.741982 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-1992a4b8-9834-4390-8a68-5016aa2e52f3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Allocated IP 172.25.3.9 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/d7160cb9-aa14-4289-ba99-d1f22ce71f7c) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:44:17.812001 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61900b01-62c7-4ce5-a16f-af9003efeece req-97f9c4c8-430a-4cd1-94e6-ce3c64b0631f tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:17.824001 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-61900b01-62c7-4ce5-a16f-af9003efeece req-97f9c4c8-430a-4cd1-94e6-ce3c64b0631f tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?device_id=36817331-72d9-48da-9467-bb52b05e52ff HTTP/1.1" status: 200 len: 946 time: 0.1093588 Dec 09 21:44:17.904870 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-61900b01-62c7-4ce5-a16f-af9003efeece req-d3e45fe4-64bf-48c7-861b-a770e5df5a35 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/security-groups?id=96f2cc1f-4e18-4f36-93f9-bc168eb8b378&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0796669 Dec 09 21:44:17.908768 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1992a4b8-9834-4390-8a68-5016aa2e52f3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:17.966825 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1992a4b8-9834-4390-8a68-5016aa2e52f3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:18.011505 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1992a4b8-9834-4390-8a68-5016aa2e52f3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:44:18.014408 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-1992a4b8-9834-4390-8a68-5016aa2e52f3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:44:18.017518 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1992a4b8-9834-4390-8a68-5016aa2e52f3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:44:18.031044 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de7d4a17-29f7-438a-8ebb-3c99f96d20df req-a717fb9e-d6f2-4ce6-bdab-b7cecbc79613 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0374756 Dec 09 21:44:18.064019 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1992a4b8-9834-4390-8a68-5016aa2e52f3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Port': ['ID=d7160cb9-aa14-4289-ba99-d1f22ce71f7c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:18.389038 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bcc963c9-38a2-45d4-830b-3a68345dbf78 req-2aaa31b8-9d7b-4947-8003-af22d393e70a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=207ec1d66b3e45cab887d0bb42db9fca&device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0320246 Dec 09 21:44:18.436611 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-14b0193e-fd6c-4908-8205-e8a7f451225c req-e6e7dff2-b9ac-4614-a5d7-f9bcaf88df4e tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0353224 Dec 09 21:44:18.466159 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bcc963c9-38a2-45d4-830b-3a68345dbf78 req-ca7ba68b-5a01-4b01-995c-3738f51f5742 service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=207ec1d66b3e45cab887d0bb42db9fca&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0663161 Dec 09 21:44:18.733387 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1992a4b8-9834-4390-8a68-5016aa2e52f3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:18.817582 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1992a4b8-9834-4390-8a68-5016aa2e52f3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:18.838011 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcc963c9-38a2-45d4-830b-3a68345dbf78 req-7751b804-7d98-4328-8785-483f1f3e3ad6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:18.839762 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bcc963c9-38a2-45d4-830b-3a68345dbf78 req-7751b804-7d98-4328-8785-483f1f3e3ad6 service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3481846 Dec 09 21:44:19.099858 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36d21fd0-1217-4a41-bba2-7c7d1867f892 req-cf85deb6-32f1-4e8f-accb-20fb4ff31930 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:19.115663 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36d21fd0-1217-4a41-bba2-7c7d1867f892 req-cf85deb6-32f1-4e8f-accb-20fb4ff31930 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?device_id=36817331-72d9-48da-9467-bb52b05e52ff HTTP/1.1" status: 200 len: 946 time: 0.1090987 Dec 09 21:44:19.125008 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1992a4b8-9834-4390-8a68-5016aa2e52f3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:19.140137 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1992a4b8-9834-4390-8a68-5016aa2e52f3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:19.236089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36d21fd0-1217-4a41-bba2-7c7d1867f892 req-1045fde4-508e-4f20-81c7-e94e8dcb466d tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/security-groups?id=96f2cc1f-4e18-4f36-93f9-bc168eb8b378&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1168835 Dec 09 21:44:19.358581 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1992a4b8-9834-4390-8a68-5016aa2e52f3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Port': ['ID=d7160cb9-aa14-4289-ba99-d1f22ce71f7c,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:19.370137 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1992a4b8-9834-4390-8a68-5016aa2e52f3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:19.542217 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-1992a4b8-9834-4390-8a68-5016aa2e52f3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Floating IP e0af9596-57b3-435c-bb18-6f868d50c010 associated. External IP: 172.25.3.9, port: 99dec73b-a5c3-417b-8b8c-f1c2b4ced742. Dec 09 21:44:19.606260 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3d71ce4d-08e9-48aa-a87c-5b097c450545 req-fbd4e2e4-7536-428f-a8a6-4d5b46755765 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0493147 Dec 09 21:44:20.219540 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bcc963c9-38a2-45d4-830b-3a68345dbf78 req-16d1c5e9-fc1a-41f9-a703-79cc142fdf57 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.31 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0356989 Dec 09 21:44:20.356808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c81e7ee1-f096-4889-a30a-62ca306b0909 req-dd9ac300-d9ca-4168-b211-5fe6e2dabb5e tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:20.359326 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c81e7ee1-f096-4889-a30a-62ca306b0909 req-dd9ac300-d9ca-4168-b211-5fe6e2dabb5e tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?device_id=36817331-72d9-48da-9467-bb52b05e52ff HTTP/1.1" status: 200 len: 946 time: 0.0937901 Dec 09 21:44:20.424392 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c81e7ee1-f096-4889-a30a-62ca306b0909 req-66c0cdc2-a8fd-4090-9073-8dfd10c479c5 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/security-groups?id=96f2cc1f-4e18-4f36-93f9-bc168eb8b378&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0560467 Dec 09 21:44:20.484974 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1992a4b8-9834-4390-8a68-5016aa2e52f3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Router 3054de87-ea87-42d0-ac7b-818bc1f8e2c8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:44:20.602960 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1992a4b8-9834-4390-8a68-5016aa2e52f3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:44:20.619727 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8c622e9-c8fe-483b-92dc-f50254cb0d29 None None] Sync routers for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:44:20.627821 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1992a4b8-9834-4390-8a68-5016aa2e52f3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:20.642349 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8c622e9-c8fe-483b-92dc-f50254cb0d29 None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:20.649732 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b8c622e9-c8fe-483b-92dc-f50254cb0d29 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:20.673511 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1992a4b8-9834-4390-8a68-5016aa2e52f3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 981 time: 3.2873836 Dec 09 21:44:20.676874 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39490) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:20.683301 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-7bd39413-e709-4691-96ff-22847e125b85 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Request body: {'floatingip': {'port_id': '99dec73b-a5c3-417b-8b8c-f1c2b4ced742', 'fixed_ip_address': '172.20.0.13'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:20.703501 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b8c622e9-c8fe-483b-92dc-f50254cb0d29 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:20.716422 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8c622e9-c8fe-483b-92dc-f50254cb0d29 None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:20.717339 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b8c622e9-c8fe-483b-92dc-f50254cb0d29 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:20.752551 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b8c622e9-c8fe-483b-92dc-f50254cb0d29 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:20.753513 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8c622e9-c8fe-483b-92dc-f50254cb0d29 None None] The sync data for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:44:20.766821 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7bd39413-e709-4691-96ff-22847e125b85 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:20.804539 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fed7f67e-11db-48d4-8533-9a0c5697beba req-6de25731-5259-43e5-b647-61465abbadc2 tempest-ServerShowV257Test-5317953 tempest-ServerShowV257Test-5317953-project] 10.222.0.13 "GET /v2.0/ports?device_id=1a98601b-3b6e-4398-b3c0-a528d40f85e9 HTTP/1.1" status: 200 len: 210 time: 0.0517547 Dec 09 21:44:21.603458 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-247d18f7-e66c-4f8a-bf66-ae0809c8ccce req-1024d41b-51ef-444b-9511-8b46efdd0755 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:21.605772 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-247d18f7-e66c-4f8a-bf66-ae0809c8ccce req-1024d41b-51ef-444b-9511-8b46efdd0755 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/ports?device_id=36817331-72d9-48da-9467-bb52b05e52ff HTTP/1.1" status: 200 len: 946 time: 0.1009018 Dec 09 21:44:21.616372 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2030672-78d6-48af-aacd-a694478f0b34 req-3d643ea8-3e22-477c-8e0e-ccb68b889077 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:21.618093 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c2030672-78d6-48af-aacd-a694478f0b34 req-3d643ea8-3e22-477c-8e0e-ccb68b889077 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.31 "GET /v2.0/ports?device_id=36817331-72d9-48da-9467-bb52b05e52ff HTTP/1.1" status: 200 len: 946 time: 0.0552866 Dec 09 21:44:21.721083 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7bd39413-e709-4691-96ff-22847e125b85 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:21.726987 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-247d18f7-e66c-4f8a-bf66-ae0809c8ccce req-9e88fced-c19b-464b-a491-2a5fa3778483 tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.13 "GET /v2.0/security-groups?id=96f2cc1f-4e18-4f36-93f9-bc168eb8b378&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1094437 Dec 09 21:44:21.728546 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7bd39413-e709-4691-96ff-22847e125b85 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:21.731202 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-c2030672-78d6-48af-aacd-a694478f0b34 req-fbe0ca9c-e818-4d99-bc97-de0bb3af655d tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Deleting port bea182c6-213a-4404-9a6f-5935c2221de2 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:44:21.731755 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c2030672-78d6-48af-aacd-a694478f0b34 req-fbe0ca9c-e818-4d99-bc97-de0bb3af655d tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:21.842466 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-c2030672-78d6-48af-aacd-a694478f0b34 req-fbe0ca9c-e818-4d99-bc97-de0bb3af655d tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] For port bea182c6-213a-4404-9a6f-5935c2221de2, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=bea182c6-213a-4404-9a6f-5935c2221de2,segment=NetworkSegment(f69cd9ac-0fbe-4c49-8321-6c397e7fefa4),segment_id=f69cd9ac-0fbe-4c49-8321-6c397e7fefa4)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:44:21.842843 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c2030672-78d6-48af-aacd-a694478f0b34 req-fbe0ca9c-e818-4d99-bc97-de0bb3af655d tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:21.863964 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-c2030672-78d6-48af-aacd-a694478f0b34 req-fbe0ca9c-e818-4d99-bc97-de0bb3af655d tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Calling delete_port for bea182c6-213a-4404-9a6f-5935c2221de2 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:44:22.027714 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c2030672-78d6-48af-aacd-a694478f0b34 req-fbe0ca9c-e818-4d99-bc97-de0bb3af655d tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:22.040709 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['bea182c6-213a-4404-9a6f-5935c2221de2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:44:22.074506 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17114c4d-29c7-427e-b5b0-967a5ac018aa None None] DHCP port deletion for f57a042a-7e03-40f8-ab65-0cce91b75390 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:44:22.089634 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:44:22.110626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7bd39413-e709-4691-96ff-22847e125b85 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Router 3054de87-ea87-42d0-ac7b-818bc1f8e2c8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:44:22.127392 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbe0ca9c-e818-4d99-bc97-de0bb3af655d tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Pushing event deleted for resources: {'Port': ['ID=bea182c6-213a-4404-9a6f-5935c2221de2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:22.148626 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-c2030672-78d6-48af-aacd-a694478f0b34 req-fbe0ca9c-e818-4d99-bc97-de0bb3af655d tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] No DVR routers for this DVR port bea182c6-213a-4404-9a6f-5935c2221de2 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:44:22.157223 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c2030672-78d6-48af-aacd-a694478f0b34 req-fbe0ca9c-e818-4d99-bc97-de0bb3af655d tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:22.161412 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c2030672-78d6-48af-aacd-a694478f0b34 req-fbe0ca9c-e818-4d99-bc97-de0bb3af655d tempest-VolumesActionsTest-1230090055 tempest-VolumesActionsTest-1230090055-project] 10.222.0.31 "DELETE /v2.0/ports/bea182c6-213a-4404-9a6f-5935c2221de2 HTTP/1.1" status: 204 len: 173 time: 0.5364144 Dec 09 21:44:22.162310 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '36817331-72d9-48da-9467-bb52b05e52ff', 'name': 'network-vif-deleted', 'tag': 'bea182c6-213a-4404-9a6f-5935c2221de2'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:44:22.166345 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ce1ac678-895d-4f3d-9079-9a6c31194c70" -d '{"events": [{"server_uuid": "36817331-72d9-48da-9467-bb52b05e52ff", "name": "network-vif-deleted", "tag": "bea182c6-213a-4404-9a6f-5935c2221de2"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:44:22.232517 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:44:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-69953f3b-99c5-4f7a-9b8d-c69ecba30a4a x-openstack-request-id: req-69953f3b-99c5-4f7a-9b8d-c69ecba30a4a {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:44:22.233025 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "36817331-72d9-48da-9467-bb52b05e52ff", "name": "network-vif-deleted", "tag": "bea182c6-213a-4404-9a6f-5935c2221de2", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:44:22.233443 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-69953f3b-99c5-4f7a-9b8d-c69ecba30a4a {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:44:22.235050 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '36817331-72d9-48da-9467-bb52b05e52ff', 'name': 'network-vif-deleted', 'tag': 'bea182c6-213a-4404-9a6f-5935c2221de2', 'status': 'completed', 'code': 200} Dec 09 21:44:22.367252 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7bd39413-e709-4691-96ff-22847e125b85 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:44:22.372616 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7bd39413-e709-4691-96ff-22847e125b85 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:22.380920 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03e0cf3b-f4a5-4499-83d1-d1491fd12c1c None None] Sync routers for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:44:22.393325 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39512) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:22.397472 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03e0cf3b-f4a5-4499-83d1-d1491fd12c1c None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:22.401380 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-03e0cf3b-f4a5-4499-83d1-d1491fd12c1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:22.484321 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-03e0cf3b-f4a5-4499-83d1-d1491fd12c1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:22.498827 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7bd39413-e709-4691-96ff-22847e125b85 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "PUT /v2.0/floatingips/e0af9596-57b3-435c-bb18-6f868d50c010 HTTP/1.1" status: 200 len: 976 time: 1.8203647 Dec 09 21:44:22.501029 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39516) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:22.509670 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03e0cf3b-f4a5-4499-83d1-d1491fd12c1c None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:22.511412 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-03e0cf3b-f4a5-4499-83d1-d1491fd12c1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:22.576583 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-03e0cf3b-f4a5-4499-83d1-d1491fd12c1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:22.577783 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03e0cf3b-f4a5-4499-83d1-d1491fd12c1c None None] The sync data for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:44:22.612009 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dd58720f-009c-46ea-9ce7-847a6a9044a9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:22.732297 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dd58720f-009c-46ea-9ce7-847a6a9044a9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:22.743102 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dd58720f-009c-46ea-9ce7-847a6a9044a9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:22.836459 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-dd58720f-009c-46ea-9ce7-847a6a9044a9 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=207ec1d66b3e45cab887d0bb42db9fca&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4392736 Dec 09 21:44:22.836459 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd58720f-009c-46ea-9ce7-847a6a9044a9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=39944156-391b-44bf-b34a-26b502f9f1c6,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:22.839071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39522) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:22.865015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-3ee3220e-8727-4488-8325-9f09d75ac77f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Deleting port d7160cb9-aa14-4289-ba99-d1f22ce71f7c {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:44:22.865581 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3ee3220e-8727-4488-8325-9f09d75ac77f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:22.909599 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a0d7b467-287e-4096-acc7-350a65ea34dc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:22.940547 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a0d7b467-287e-4096-acc7-350a65ea34dc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:23.007888 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a0d7b467-287e-4096-acc7-350a65ea34dc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:23.013183 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a0d7b467-287e-4096-acc7-350a65ea34dc admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:23.017417 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a0d7b467-287e-4096-acc7-350a65ea34dc admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/39944156-391b-44bf-b34a-26b502f9f1c6 HTTP/1.1" status: 204 len: 168 time: 0.1746762 Dec 09 21:44:23.026639 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0d7b467-287e-4096-acc7-350a65ea34dc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=39944156-391b-44bf-b34a-26b502f9f1c6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:23.123200 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3ee3220e-8727-4488-8325-9f09d75ac77f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:23.123713 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3ee3220e-8727-4488-8325-9f09d75ac77f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:23.145950 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-3ee3220e-8727-4488-8325-9f09d75ac77f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Calling delete_port for d7160cb9-aa14-4289-ba99-d1f22ce71f7c owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:44:23.584967 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-03fd72c6-d15c-4659-948c-90e0095bbca0 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:23.587895 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-03fd72c6-d15c-4659-948c-90e0095bbca0 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/networks?id=eda4cb39-afde-43d7-a13b-5227cc6862dd HTTP/1.1" status: 200 len: 814 time: 0.1620903 Dec 09 21:44:23.637224 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-34b57e48-6c75-40cb-916e-5e91e4c8e1d6 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/quotas/6f2bd57ebcdc4c748e719519e3961b70 HTTP/1.1" status: 200 len: 375 time: 0.0247874 Dec 09 21:44:23.714765 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3ee3220e-8727-4488-8325-9f09d75ac77f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:23.774060 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-5dcf93bd-ece8-4738-95b4-3ca3400edab7 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=6f2bd57ebcdc4c748e719519e3961b70&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1354542 Dec 09 21:44:23.781824 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ee3220e-8727-4488-8325-9f09d75ac77f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event deleted for resources: {'Port': ['ID=d7160cb9-aa14-4289-ba99-d1f22ce71f7c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:23.869641 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3ee3220e-8727-4488-8325-9f09d75ac77f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:23.870290 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-3ee3220e-8727-4488-8325-9f09d75ac77f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Floating IP e0af9596-57b3-435c-bb18-6f868d50c010 disassociated (deleted). External IP: 172.25.3.9, port: 99dec73b-a5c3-417b-8b8c-f1c2b4ced742. Dec 09 21:44:24.088654 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39604) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:24.149862 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-2abdabde-73b0-492a-91c5-940940d248e9 service neutron] 10.222.0.13 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3750720 Dec 09 21:44:24.207794 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-46824f19-0430-4edb-87dc-684c599531cc admin admin] Request body: {'network': {'name': 'tempest-ServersNegativeTestMultiTenantJSON-1276034045-network', 'tenant_id': '3f88fb9ec7754b72af333e0e54226607'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:24.235333 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-46824f19-0430-4edb-87dc-684c599531cc admin admin] Made reservation on behalf of 3f88fb9ec7754b72af333e0e54226607 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:44:24.240410 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-46824f19-0430-4edb-87dc-684c599531cc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:24.253867 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-46824f19-0430-4edb-87dc-684c599531cc admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:24.259624 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3ee3220e-8727-4488-8325-9f09d75ac77f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Router 3054de87-ea87-42d0-ac7b-818bc1f8e2c8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:44:24.262774 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-442fb2c8-d0ca-49e4-ba6d-f6a8a3057d3f service neutron] 10.222.0.13 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1058176 Dec 09 21:44:24.423050 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-46824f19-0430-4edb-87dc-684c599531cc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:24.429239 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-46824f19-0430-4edb-87dc-684c599531cc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:24.446651 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-46824f19-0430-4edb-87dc-684c599531cc admin admin] vlan segment allocate from pool success with {'vlan_id': 100, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:44:24.458783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3ee3220e-8727-4488-8325-9f09d75ac77f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:44:24.474639 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3ee3220e-8727-4488-8325-9f09d75ac77f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:24.477409 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7992294-067d-473b-bce2-73f1d8ef3114 None None] Sync routers for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:44:24.497473 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-46824f19-0430-4edb-87dc-684c599531cc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:24.497473 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-46824f19-0430-4edb-87dc-684c599531cc admin admin] Added segment d364ec9b-6967-4182-93f8-71f7fcca6cba of type vlan for network d38aa8a0-2dbc-451b-aa05-cb6c6c804975 Dec 09 21:44:24.509260 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7992294-067d-473b-bce2-73f1d8ef3114 None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:24.512019 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-e7992294-067d-473b-bce2-73f1d8ef3114 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:24.559488 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3ee3220e-8727-4488-8325-9f09d75ac77f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "DELETE /v2.0/floatingips/e0af9596-57b3-435c-bb18-6f868d50c010 HTTP/1.1" status: 204 len: 168 time: 2.0492699 Dec 09 21:44:24.561865 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39616) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:24.608710 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-e7992294-067d-473b-bce2-73f1d8ef3114 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:24.619002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7992294-067d-473b-bce2-73f1d8ef3114 None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:24.620169 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-e7992294-067d-473b-bce2-73f1d8ef3114 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:24.637168 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-46824f19-0430-4edb-87dc-684c599531cc admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:24.670540 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-e7992294-067d-473b-bce2-73f1d8ef3114 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:24.671694 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7992294-067d-473b-bce2-73f1d8ef3114 None None] The sync data for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:44:24.700201 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5d64638f-f55a-4c06-b6cc-a9381da6fa6d req-8715d353-0f55-49b2-88d4-e10304497b34 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9a04051-952f-4c6e-b436-24b66478b4a1 HTTP/1.1" status: 200 len: 210 time: 0.1092772 Dec 09 21:44:24.703354 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46824f19-0430-4edb-87dc-684c599531cc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=74572e25-d24b-4907-912e-b2d64df84fab,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:24.740523 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-46824f19-0430-4edb-87dc-684c599531cc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:24.746806 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46824f19-0430-4edb-87dc-684c599531cc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:24.749394 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-46824f19-0430-4edb-87dc-684c599531cc admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:24.853475 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46824f19-0430-4edb-87dc-684c599531cc admin admin] Pushing event updated for resources: {'Network': ['ID=d38aa8a0-2dbc-451b-aa05-cb6c6c804975,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:24.861952 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-37ef265f-f6db-49f8-a8f2-03ea02f370e0 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Deleting port 99dec73b-a5c3-417b-8b8c-f1c2b4ced742 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:44:24.863062 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-37ef265f-f6db-49f8-a8f2-03ea02f370e0 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:24.865986 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network d38aa8a0-2dbc-451b-aa05-cb6c6c804975 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:44:24.870272 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-46824f19-0430-4edb-87dc-684c599531cc admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.7788928 Dec 09 21:44:24.874556 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39622) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:24.882814 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-21a58648-487e-474d-8042-33693d3fa072 admin admin] Request body: {'subnet': {'network_id': 'd38aa8a0-2dbc-451b-aa05-cb6c6c804975', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersNegativeTestMultiTenantJSON-1276034045-subnet', 'tenant_id': '3f88fb9ec7754b72af333e0e54226607', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:24.926399 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-21a58648-487e-474d-8042-33693d3fa072 admin admin] Made reservation on behalf of 3f88fb9ec7754b72af333e0e54226607 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:44:24.932947 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-21a58648-487e-474d-8042-33693d3fa072 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:25.034166 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-37ef265f-f6db-49f8-a8f2-03ea02f370e0 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:25.067007 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-37ef265f-f6db-49f8-a8f2-03ea02f370e0 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Calling delete_port for 99dec73b-a5c3-417b-8b8c-f1c2b4ced742 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:44:25.275585 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-21a58648-487e-474d-8042-33693d3fa072 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:25.339618 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21a58648-487e-474d-8042-33693d3fa072 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b8ac0081-5147-4cda-bfb1-7a949d33002a,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:25.378933 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21a58648-487e-474d-8042-33693d3fa072 admin admin] Checking segment: {'id': 'd364ec9b-6967-4182-93f8-71f7fcca6cba', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'd38aa8a0-2dbc-451b-aa05-cb6c6c804975'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:44:25.379404 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21a58648-487e-474d-8042-33693d3fa072 admin admin] Network hostable DHCP agents. Network: d38aa8a0-2dbc-451b-aa05-cb6c6c804975, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:44:25.381740 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-37ef265f-f6db-49f8-a8f2-03ea02f370e0 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:25.407760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21a58648-487e-474d-8042-33693d3fa072 admin admin] Network d38aa8a0-2dbc-451b-aa05-cb6c6c804975 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:44:25.423258 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-21a58648-487e-474d-8042-33693d3fa072 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, d38aa8a0-2dbc-451b-aa05-cb6c6c804975) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:44:25.432377 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21a58648-487e-474d-8042-33693d3fa072 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:25.433547 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-21a58648-487e-474d-8042-33693d3fa072 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:25.440651 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37ef265f-f6db-49f8-a8f2-03ea02f370e0 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event deleted for resources: {'Port': ['ID=99dec73b-a5c3-417b-8b8c-f1c2b4ced742,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:25.453783 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c2180d9-3f50-4903-ba9c-c777a20ed57d None None] Network d38aa8a0-2dbc-451b-aa05-cb6c6c804975 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:44:25.467738 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-21a58648-487e-474d-8042-33693d3fa072 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.5903652 Dec 09 21:44:25.700867 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-862d11c7-c83b-447d-a4a5-8df8be3df157 None None] Network d38aa8a0-2dbc-451b-aa05-cb6c6c804975 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:44:25.764545 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-37ef265f-f6db-49f8-a8f2-03ea02f370e0 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:25.777840 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-37ef265f-f6db-49f8-a8f2-03ea02f370e0 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "DELETE /v2.0/ports/99dec73b-a5c3-417b-8b8c-f1c2b4ced742 HTTP/1.1" status: 204 len: 168 time: 1.2126839 Dec 09 21:44:25.781972 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39660) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:25.795181 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c5276af0-d576-4555-bc58-b8bffebe7793 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:25.929888 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device bea182c6-213a-4404-9a6f-5935c2221de2 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:44:25.972430 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c23cffb2-8b43-43de-8e40-326262209e1e req-72eaa4a4-b869-4c8b-8923-837b4cb42ed2 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9a04051-952f-4c6e-b436-24b66478b4a1 HTTP/1.1" status: 200 len: 210 time: 0.0927553 Dec 09 21:44:25.972983 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: bea182c6-213a-4404-9a6f-5935c2221de2 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:44:25.973649 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device bea182c6-213a-4404-9a6f-5935c2221de2 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:44:25.991689 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c5276af0-d576-4555-bc58-b8bffebe7793 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:26.120515 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39670) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:26.355055 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c5276af0-d576-4555-bc58-b8bffebe7793 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:26.494923 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-60c676ff-27d1-4106-ad89-b5d21a9de45a tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:26.498284 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-60c676ff-27d1-4106-ad89-b5d21a9de45a tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.31 "GET /v2.0/networks?id=eda4cb39-afde-43d7-a13b-5227cc6862dd HTTP/1.1" status: 200 len: 814 time: 0.3095527 Dec 09 21:44:26.520706 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-c5276af0-d576-4555-bc58-b8bffebe7793 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Allocated IP 172.25.3.216 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/63095733-b09f-494e-a23e-c3df4a453c5b) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:44:26.523682 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-c8851bad-f9ea-4feb-8f0b-23ced0284071 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Request body: {'port': {'device_id': 'f9a04051-952f-4c6e-b436-24b66478b4a1', 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd', 'admin_state_up': True, 'tenant_id': '6f2bd57ebcdc4c748e719519e3961b70'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:26.572104 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39680) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:26.579740 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-f38718d4-68d5-46d5-a7bc-bd58545d7c49 admin admin] Request body: {'network': {'name': 'tempest-ServersNegativeTestMultiTenantJSON-1468680163-network', 'tenant_id': '94c37a1d669e4c92bdb0ac14b477c8eb'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:26.591586 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4f89b8f6-6fb7-42b8-8bea-2a3b75e181dd admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:26.650728 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f38718d4-68d5-46d5-a7bc-bd58545d7c49 admin admin] Made reservation on behalf of 94c37a1d669e4c92bdb0ac14b477c8eb for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:44:26.653222 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f38718d4-68d5-46d5-a7bc-bd58545d7c49 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:26.666296 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f38718d4-68d5-46d5-a7bc-bd58545d7c49 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:26.704750 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c5276af0-d576-4555-bc58-b8bffebe7793 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:26.725840 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4f89b8f6-6fb7-42b8-8bea-2a3b75e181dd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:26.735082 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4f89b8f6-6fb7-42b8-8bea-2a3b75e181dd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:26.777027 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c5276af0-d576-4555-bc58-b8bffebe7793 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:26.795858 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4f89b8f6-6fb7-42b8-8bea-2a3b75e181dd admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=0b4ba686d5b84d9fbfdc8d7255f0081c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6745522 Dec 09 21:44:26.800770 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f89b8f6-6fb7-42b8-8bea-2a3b75e181dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a33ccb5e-cdef-4193-8a9f-1585cc716e44,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:26.807115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39682) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:26.861539 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5276af0-d576-4555-bc58-b8bffebe7793 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Port': ['ID=63095733-b09f-494e-a23e-c3df4a453c5b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:26.882799 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a75aa71a-a544-4267-af3b-bdf23a5dd4fb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:26.887706 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5276af0-d576-4555-bc58-b8bffebe7793 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:44:26.893912 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-c5276af0-d576-4555-bc58-b8bffebe7793 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:44:26.899732 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5276af0-d576-4555-bc58-b8bffebe7793 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:44:26.910181 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a75aa71a-a544-4267-af3b-bdf23a5dd4fb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:26.976853 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-c8851bad-f9ea-4feb-8f0b-23ced0284071 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Made reservation on behalf of 6f2bd57ebcdc4c748e719519e3961b70 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:44:26.982355 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-c8851bad-f9ea-4feb-8f0b-23ced0284071 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:26.982724 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f38718d4-68d5-46d5-a7bc-bd58545d7c49 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:27.005964 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f38718d4-68d5-46d5-a7bc-bd58545d7c49 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:27.036578 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a75aa71a-a544-4267-af3b-bdf23a5dd4fb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:27.047612 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a75aa71a-a544-4267-af3b-bdf23a5dd4fb admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:27.051203 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a75aa71a-a544-4267-af3b-bdf23a5dd4fb admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/a33ccb5e-cdef-4193-8a9f-1585cc716e44 HTTP/1.1" status: 204 len: 168 time: 0.2434661 Dec 09 21:44:27.062318 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f38718d4-68d5-46d5-a7bc-bd58545d7c49 admin admin] vlan segment allocate from pool success with {'vlan_id': 106, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:44:27.098822 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f38718d4-68d5-46d5-a7bc-bd58545d7c49 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:27.100036 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-f38718d4-68d5-46d5-a7bc-bd58545d7c49 admin admin] Added segment 1b86fbea-536a-478d-9fc0-c1b05f08f17b of type vlan for network beba28bb-7226-441d-89aa-c9e26ebecdb5 Dec 09 21:44:27.253750 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-c8851bad-f9ea-4feb-8f0b-23ced0284071 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Allocated IP 172.20.0.6 (eda4cb39-afde-43d7-a13b-5227cc6862dd/24afae0e-0a38-484d-a023-a2fb471bdb33/25f69b99-160f-4f73-bc4c-738b6fa17cbd) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:44:27.295814 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:27.380460 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:27.476267 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a75aa71a-a544-4267-af3b-bdf23a5dd4fb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a33ccb5e-cdef-4193-8a9f-1585cc716e44,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:27.548340 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-c8851bad-f9ea-4feb-8f0b-23ced0284071 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:27.597325 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-c8851bad-f9ea-4feb-8f0b-23ced0284071 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:27.609188 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['33cf4605-a408-4847-9394-fe8acf994c40', 'bd9c1c28-304b-4656-bd19-43407d1b6dc2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:44:27.683125 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-c8851bad-f9ea-4feb-8f0b-23ced0284071 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Network eda4cb39-afde-43d7-a13b-5227cc6862dd is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:44:27.696777 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-c8851bad-f9ea-4feb-8f0b-23ced0284071 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:44:27.700788 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39694) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:27.702040 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-c8851bad-f9ea-4feb-8f0b-23ced0284071 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:44:27.727484 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cff106a9-f48f-41c2-9ffa-4c4769daa588 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:27.740340 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0e3a8537-e089-469c-811f-7515d7dec534 req-718b55f6-c0f0-4b86-93e3-8d2c0d801477 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9a04051-952f-4c6e-b436-24b66478b4a1 HTTP/1.1" status: 200 len: 210 time: 0.5390661 Dec 09 21:44:27.750185 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f5872830-bc47-4539-b69f-11dbae51f54d None None] DHCP port deletion for eda4cb39-afde-43d7-a13b-5227cc6862dd request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:44:27.773367 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f38718d4-68d5-46d5-a7bc-bd58545d7c49 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:27.780543 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f38718d4-68d5-46d5-a7bc-bd58545d7c49 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=adcf2b3a-9f2f-407e-a54b-94ae10d4d39a,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:27.804099 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c5276af0-d576-4555-bc58-b8bffebe7793 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:27.815854 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8851bad-f9ea-4feb-8f0b-23ced0284071 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Pushing event updated for resources: {'Port': ['ID=25f69b99-160f-4f73-bc4c-738b6fa17cbd,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:27.828620 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f38718d4-68d5-46d5-a7bc-bd58545d7c49 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:27.829706 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f38718d4-68d5-46d5-a7bc-bd58545d7c49 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:27.830711 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f38718d4-68d5-46d5-a7bc-bd58545d7c49 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:27.837205 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-c8851bad-f9ea-4feb-8f0b-23ced0284071 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:27.837920 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-c8851bad-f9ea-4feb-8f0b-23ced0284071 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:27.883122 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f38718d4-68d5-46d5-a7bc-bd58545d7c49 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 1.3070464 Dec 09 21:44:27.883358 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-c8851bad-f9ea-4feb-8f0b-23ced0284071 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3684311 Dec 09 21:44:27.883771 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4c4f5fda-e0c4-40cc-ba51-ab17d7bafc34 None None] Provisioning complete for port 25f69b99-160f-4f73-bc4c-738b6fa17cbd triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:44:27.884345 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39696) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:27.884718 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4c4f5fda-e0c4-40cc-ba51-ab17d7bafc34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:27.889568 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2e8c86bf-1582-4718-a0a6-2d6771f088d4 admin admin] Request body: {'subnet': {'network_id': 'beba28bb-7226-441d-89aa-c9e26ebecdb5', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersNegativeTestMultiTenantJSON-1468680163-subnet', 'tenant_id': '94c37a1d669e4c92bdb0ac14b477c8eb', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:27.912573 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c5276af0-d576-4555-bc58-b8bffebe7793 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:27.914532 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-18a81167-efca-4792-9c89-d57c2ffce258 service neutron] Request body: {'port': {'device_id': 'f9a04051-952f-4c6e-b436-24b66478b4a1', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:27.955835 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-4c4f5fda-e0c4-40cc-ba51-ab17d7bafc34 None None] Port 25f69b99-160f-4f73-bc4c-738b6fa17cbd cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:44:28.006697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f38718d4-68d5-46d5-a7bc-bd58545d7c49 admin admin] Pushing event updated for resources: {'Network': ['ID=beba28bb-7226-441d-89aa-c9e26ebecdb5,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:28.027999 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network beba28bb-7226-441d-89aa-c9e26ebecdb5 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:44:28.032694 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cff106a9-f48f-41c2-9ffa-4c4769daa588 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:28.073702 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cff106a9-f48f-41c2-9ffa-4c4769daa588 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:28.078464 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e8c86bf-1582-4718-a0a6-2d6771f088d4 admin admin] Made reservation on behalf of 94c37a1d669e4c92bdb0ac14b477c8eb for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:44:28.082362 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2e8c86bf-1582-4718-a0a6-2d6771f088d4 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:28.133181 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-18a81167-efca-4792-9c89-d57c2ffce258 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:28.185693 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cff106a9-f48f-41c2-9ffa-4c4769daa588 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=200b0a615ed3424899ebb0391651c340&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4735892 Dec 09 21:44:28.191625 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39698) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:28.226659 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cff106a9-f48f-41c2-9ffa-4c4769daa588 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dcfc5c07-79e0-4d15-9f2f-8e084c7e668d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:28.247397 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c5276af0-d576-4555-bc58-b8bffebe7793 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:28.260979 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c5276af0-d576-4555-bc58-b8bffebe7793 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:28.389810 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5276af0-d576-4555-bc58-b8bffebe7793 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Port': ['ID=63095733-b09f-494e-a23e-c3df4a453c5b,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:28.420290 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-61d4758a-a285-468e-ab38-7ae0ae0e0bb7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:28.448498 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-61d4758a-a285-468e-ab38-7ae0ae0e0bb7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:28.469028 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c5276af0-d576-4555-bc58-b8bffebe7793 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:28.503528 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c5276af0-d576-4555-bc58-b8bffebe7793 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:28.508404 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c5276af0-d576-4555-bc58-b8bffebe7793 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 2.7232864 Dec 09 21:44:28.508611 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39704) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:28.519083 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b12a3c23-97a9-4e0d-b389-9fb679e23c5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Request body: {'port': {'network_id': '74a4e90b-0273-461a-8432-d442c0560885', 'name': 'tempest-FloatingIPTestJSON-95365498'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:28.534731 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-61d4758a-a285-468e-ab38-7ae0ae0e0bb7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:28.538007 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-61d4758a-a285-468e-ab38-7ae0ae0e0bb7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:28.542104 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-61d4758a-a285-468e-ab38-7ae0ae0e0bb7 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/dcfc5c07-79e0-4d15-9f2f-8e084c7e668d HTTP/1.1" status: 204 len: 168 time: 0.3469522 Dec 09 21:44:28.569068 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61d4758a-a285-468e-ab38-7ae0ae0e0bb7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dcfc5c07-79e0-4d15-9f2f-8e084c7e668d,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:28.645968 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2e8c86bf-1582-4718-a0a6-2d6771f088d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:28.720020 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b12a3c23-97a9-4e0d-b389-9fb679e23c5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Made reservation on behalf of 1752f69b83904328a79fb89f35377bcf for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:44:28.723653 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b12a3c23-97a9-4e0d-b389-9fb679e23c5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:28.786255 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-b12a3c23-97a9-4e0d-b389-9fb679e23c5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] device_id is not set on port 6c528b7b-1304-4fbd-a6e4-6cae44f025ec yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:44:28.817490 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e8c86bf-1582-4718-a0a6-2d6771f088d4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5818223e-c44a-497d-807e-7ef3225ef071,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:28.904746 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-18a81167-efca-4792-9c89-d57c2ffce258 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 25f69b99-160f-4f73-bc4c-738b6fa17cbd {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:44:28.909125 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e8c86bf-1582-4718-a0a6-2d6771f088d4 admin admin] Checking segment: {'id': '1b86fbea-536a-478d-9fc0-c1b05f08f17b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'beba28bb-7226-441d-89aa-c9e26ebecdb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:44:28.909500 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e8c86bf-1582-4718-a0a6-2d6771f088d4 admin admin] Network hostable DHCP agents. Network: beba28bb-7226-441d-89aa-c9e26ebecdb5, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:44:28.930590 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-18a81167-efca-4792-9c89-d57c2ffce258 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:28.994413 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-18a81167-efca-4792-9c89-d57c2ffce258 service neutron] Transition to ACTIVE for port object 25f69b99-160f-4f73-bc4c-738b6fa17cbd will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:44:28.995783 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e8c86bf-1582-4718-a0a6-2d6771f088d4 admin admin] Network beba28bb-7226-441d-89aa-c9e26ebecdb5 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:44:29.003261 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-18a81167-efca-4792-9c89-d57c2ffce258 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:29.028930 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccd4bc2e-4280-4cc2-9a4b-f81920c191d1 req-75a13807-4f4f-495b-9283-4ca8bb31eb0a tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:29.034166 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ccd4bc2e-4280-4cc2-9a4b-f81920c191d1 req-75a13807-4f4f-495b-9283-4ca8bb31eb0a tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9a04051-952f-4c6e-b436-24b66478b4a1 HTTP/1.1" status: 200 len: 931 time: 0.1836126 Dec 09 21:44:29.058249 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-b12a3c23-97a9-4e0d-b389-9fb679e23c5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Allocated IP 172.20.0.11 (74a4e90b-0273-461a-8432-d442c0560885/29523c9c-ae97-471c-a637-67d7fdefc076/6c528b7b-1304-4fbd-a6e4-6cae44f025ec) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:44:29.060294 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-2e8c86bf-1582-4718-a0a6-2d6771f088d4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, beba28bb-7226-441d-89aa-c9e26ebecdb5) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:44:29.074647 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e8c86bf-1582-4718-a0a6-2d6771f088d4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:29.075257 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2e8c86bf-1582-4718-a0a6-2d6771f088d4 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:29.090126 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9aba2492-f3fe-4f1d-8a6b-0218eac87471 None None] Network beba28bb-7226-441d-89aa-c9e26ebecdb5 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:44:29.126060 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a81167-efca-4792-9c89-d57c2ffce258 service neutron] Pushing event updated for resources: {'Port': ['ID=25f69b99-160f-4f73-bc4c-738b6fa17cbd,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:29.136882 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7ff2268e-29d4-4028-8334-e3ca6e9171b1 None None] DHCP port deletion for eda4cb39-afde-43d7-a13b-5227cc6862dd request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:44:29.143682 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2e8c86bf-1582-4718-a0a6-2d6771f088d4 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 1.2578895 Dec 09 21:44:29.147573 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ccd4bc2e-4280-4cc2-9a4b-f81920c191d1 req-05fa8e82-48de-439c-8623-7518e6c22632 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1064363 Dec 09 21:44:29.350236 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3e227f2a-e55e-4dcf-baed-b5fe4bd64649 None None] Network beba28bb-7226-441d-89aa-c9e26ebecdb5 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:44:29.392224 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-18a81167-efca-4792-9c89-d57c2ffce258 service neutron] Attempting to bind port 25f69b99-160f-4f73-bc4c-738b6fa17cbd on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:44:29.393057 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-18a81167-efca-4792-9c89-d57c2ffce258 service neutron] Attempting to bind port 25f69b99-160f-4f73-bc4c-738b6fa17cbd by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:44:29.394159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-18a81167-efca-4792-9c89-d57c2ffce258 service neutron] Attempting to bind port 25f69b99-160f-4f73-bc4c-738b6fa17cbd on network eda4cb39-afde-43d7-a13b-5227cc6862dd {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:44:29.411124 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-18a81167-efca-4792-9c89-d57c2ffce258 service neutron] Port 25f69b99-160f-4f73-bc4c-738b6fa17cbd on network eda4cb39-afde-43d7-a13b-5227cc6862dd not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:44:29.411124 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-18a81167-efca-4792-9c89-d57c2ffce258 service neutron] Attempting to bind port 25f69b99-160f-4f73-bc4c-738b6fa17cbd on network eda4cb39-afde-43d7-a13b-5227cc6862dd {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:44:29.449656 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-18a81167-efca-4792-9c89-d57c2ffce258 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 44, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:44:29.449980 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-18a81167-efca-4792-9c89-d57c2ffce258 service neutron] Checking segment: {'id': '0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:44:29.450461 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-18a81167-efca-4792-9c89-d57c2ffce258 service neutron] Bound using segment: {'id': '0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:44:29.450810 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-18a81167-efca-4792-9c89-d57c2ffce258 service neutron] Bound port: 25f69b99-160f-4f73-bc4c-738b6fa17cbd, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:44:29.451180 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-18a81167-efca-4792-9c89-d57c2ffce258 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:29.687478 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b12a3c23-97a9-4e0d-b389-9fb679e23c5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:29.739967 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-18a81167-efca-4792-9c89-d57c2ffce258 service neutron] For port 25f69b99-160f-4f73-bc4c-738b6fa17cbd, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:44:29.745525 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-18a81167-efca-4792-9c89-d57c2ffce258 service neutron] For port 25f69b99-160f-4f73-bc4c-738b6fa17cbd, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=25f69b99-160f-4f73-bc4c-738b6fa17cbd,segment=NetworkSegment(0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5),segment_id=0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:44:29.764875 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-18a81167-efca-4792-9c89-d57c2ffce258 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:29.779268 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a434a6fb-3968-45e0-92c5-66d5ceb14925 req-dfd89391-c927-46ae-aa09-84fadc123a4c service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=ae35dc07-1896-4a17-978c-12bd32bd62a8&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0804162 Dec 09 21:44:29.815626 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b12a3c23-97a9-4e0d-b389-9fb679e23c5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:29.822998 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-18a81167-efca-4792-9c89-d57c2ffce258 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:29.823720 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-18a81167-efca-4792-9c89-d57c2ffce258 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:29.825456 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-18a81167-efca-4792-9c89-d57c2ffce258 service neutron] 10.222.0.31 "PUT /v2.0/ports/25f69b99-160f-4f73-bc4c-738b6fa17cbd HTTP/1.1" status: 200 len: 1092 time: 1.9181733 Dec 09 21:44:29.825894 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f9a04051-952f-4c6e-b436-24b66478b4a1', 'tag': '25f69b99-160f-4f73-bc4c-738b6fa17cbd'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:44:29.828525 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2dd35c07-47b6-49ad-850d-a04b0c26b583" -d '{"events": [{"name": "network-changed", "server_uuid": "f9a04051-952f-4c6e-b436-24b66478b4a1", "tag": "25f69b99-160f-4f73-bc4c-738b6fa17cbd"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:44:29.834815 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1daeed7e-3729-4f23-9895-72dab42a850d None None] DHCP port deletion for eda4cb39-afde-43d7-a13b-5227cc6862dd request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:44:29.851218 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a81167-efca-4792-9c89-d57c2ffce258 service neutron] Pushing event updated for resources: {'Port': ['ID=25f69b99-160f-4f73-bc4c-738b6fa17cbd,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:29.930046 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b12a3c23-97a9-4e0d-b389-9fb679e23c5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Port': ['ID=6c528b7b-1304-4fbd-a6e4-6cae44f025ec,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:29.931164 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a434a6fb-3968-45e0-92c5-66d5ceb14925 req-01204e61-cd19-4a18-9a0d-4c31bbf92f7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:29.937344 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a434a6fb-3968-45e0-92c5-66d5ceb14925 req-01204e61-cd19-4a18-9a0d-4c31bbf92f7a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6f2bd57ebcdc4c748e719519e3961b70&device_id=ae35dc07-1896-4a17-978c-12bd32bd62a8 HTTP/1.1" status: 200 len: 1098 time: 0.1001811 Dec 09 21:44:29.965236 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b12a3c23-97a9-4e0d-b389-9fb679e23c5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Network 74a4e90b-0273-461a-8432-d442c0560885 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:44:29.968998 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-b12a3c23-97a9-4e0d-b389-9fb679e23c5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:44:29.972020 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b12a3c23-97a9-4e0d-b389-9fb679e23c5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:44:30.017167 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-b254b190-382a-4eca-9ed3-1b6ad655be5c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:30.018766 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-b254b190-382a-4eca-9ed3-1b6ad655be5c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6f2bd57ebcdc4c748e719519e3961b70&device_id=f9a04051-952f-4c6e-b436-24b66478b4a1 HTTP/1.1" status: 200 len: 1095 time: 0.0860913 Dec 09 21:44:30.041683 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b12a3c23-97a9-4e0d-b389-9fb679e23c5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:30.041854 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b12a3c23-97a9-4e0d-b389-9fb679e23c5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:30.081924 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a434a6fb-3968-45e0-92c5-66d5ceb14925 req-2634d286-59db-47c6-bf08-cb6277134a2f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:30.083456 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a434a6fb-3968-45e0-92c5-66d5ceb14925 req-2634d286-59db-47c6-bf08-cb6277134a2f service neutron] 10.222.0.31 "GET /v2.0/networks?id=eda4cb39-afde-43d7-a13b-5227cc6862dd HTTP/1.1" status: 200 len: 915 time: 0.1222465 Dec 09 21:44:30.120412 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-0d0d7b67-7eff-4265-a016-67c85cc30819 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=25f69b99-160f-4f73-bc4c-738b6fa17cbd HTTP/1.1" status: 200 len: 217 time: 0.0925436 Dec 09 21:44:30.170931 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a434a6fb-3968-45e0-92c5-66d5ceb14925 req-bebbdcae-2d63-490c-9356-31963c950d4b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=33cf4605-a408-4847-9394-fe8acf994c40 HTTP/1.1" status: 200 len: 217 time: 0.0798714 Dec 09 21:44:30.223406 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-04550da8-7eaa-452b-ab27-c888a1b0d90f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:30.225026 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-04550da8-7eaa-452b-ab27-c888a1b0d90f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=24afae0e-0a38-484d-a023-a2fb471bdb33 HTTP/1.1" status: 200 len: 854 time: 0.0972321 Dec 09 21:44:30.228380 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b12a3c23-97a9-4e0d-b389-9fb679e23c5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 928 time: 1.7175491 Dec 09 21:44:30.237326 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39748) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:30.262693 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-42bbecba-7449-4b2e-8c3b-9c3917d53cb5 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Request body: {'floatingip': {'port_id': '6c528b7b-1304-4fbd-a6e4-6cae44f025ec'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:30.277381 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a434a6fb-3968-45e0-92c5-66d5ceb14925 req-2515715c-a356-4027-9269-8053ad74062b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:30.279020 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a434a6fb-3968-45e0-92c5-66d5ceb14925 req-2515715c-a356-4027-9269-8053ad74062b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=24afae0e-0a38-484d-a023-a2fb471bdb33 HTTP/1.1" status: 200 len: 854 time: 0.1013699 Dec 09 21:44:30.334610 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a434a6fb-3968-45e0-92c5-66d5ceb14925 req-01c377de-bc39-4237-bee2-fface9eb60ec service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eda4cb39-afde-43d7-a13b-5227cc6862dd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0481777 Dec 09 21:44:30.358122 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-d3413fbb-4d9a-4110-aba9-2a5e2c5be47b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eda4cb39-afde-43d7-a13b-5227cc6862dd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1194725 Dec 09 21:44:30.376583 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42bbecba-7449-4b2e-8c3b-9c3917d53cb5 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:30.518051 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f02ab45f-db94-4234-bd53-306f80eded65 req-30a02a10-7f57-483f-b3fa-15285f883b15 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:30.519625 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f02ab45f-db94-4234-bd53-306f80eded65 req-30a02a10-7f57-483f-b3fa-15285f883b15 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/networks?id=d38aa8a0-2dbc-451b-aa05-cb6c6c804975 HTTP/1.1" status: 200 len: 825 time: 0.1505113 Dec 09 21:44:30.547198 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f02ab45f-db94-4234-bd53-306f80eded65 req-7d0e5d59-d3a1-45f5-9c90-7e14f30e64df tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/quotas/3f88fb9ec7754b72af333e0e54226607 HTTP/1.1" status: 200 len: 375 time: 0.0174105 Dec 09 21:44:30.558747 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a434a6fb-3968-45e0-92c5-66d5ceb14925 req-75fdd209-470a-4ccb-bcea-9724491136c8 service neutron] 10.222.0.31 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2166495 Dec 09 21:44:30.565582 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-e4a51417-2593-4f33-9992-321f4c298edd service neutron] 10.222.0.31 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1991990 Dec 09 21:44:30.613656 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f02ab45f-db94-4234-bd53-306f80eded65 req-6b3378bd-f9df-4f45-93f0-5be44f46a5d8 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=3f88fb9ec7754b72af333e0e54226607&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0533214 Dec 09 21:44:30.842421 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a434a6fb-3968-45e0-92c5-66d5ceb14925 req-11e242d6-9853-415b-8995-5c6df45e0793 service neutron] 10.222.0.31 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2616446 Dec 09 21:44:30.904909 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fe7723e6-3a6b-4ae0-9ed4-463e2bcb572d req-5e22c235-5782-4246-ae17-9230f9caaca4 service neutron] 10.222.0.31 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3017540 Dec 09 21:44:30.926474 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f02ab45f-db94-4234-bd53-306f80eded65 req-42b8086d-3abf-4914-ba7b-be78636054e8 service neutron] 10.222.0.13 "GET /v2.0/networks/d38aa8a0-2dbc-451b-aa05-cb6c6c804975?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3001535 Dec 09 21:44:31.068850 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f02ab45f-db94-4234-bd53-306f80eded65 req-73c127b9-2884-4df1-ad65-b30135864eca service neutron] 10.222.0.13 "GET /v2.0/networks/d38aa8a0-2dbc-451b-aa05-cb6c6c804975?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1344161 Dec 09 21:44:31.458992 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:44:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5b603312-a990-470e-a2ec-e945a0725f25 x-openstack-request-id: req-5b603312-a990-470e-a2ec-e945a0725f25 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:44:31.459290 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f9a04051-952f-4c6e-b436-24b66478b4a1", "tag": "25f69b99-160f-4f73-bc4c-738b6fa17cbd", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:44:31.460019 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-5b603312-a990-470e-a2ec-e945a0725f25 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:44:31.460169 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f9a04051-952f-4c6e-b436-24b66478b4a1', 'tag': '25f69b99-160f-4f73-bc4c-738b6fa17cbd', 'status': 'completed', 'code': 200} Dec 09 21:44:31.527475 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8b5ef84-f4ac-46c6-875a-e2f6838371eb req-3e8221fb-0e92-4ca7-8971-fb416c1e7d11 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:31.541177 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8b5ef84-f4ac-46c6-875a-e2f6838371eb req-3e8221fb-0e92-4ca7-8971-fb416c1e7d11 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9a04051-952f-4c6e-b436-24b66478b4a1 HTTP/1.1" status: 200 len: 943 time: 0.0758245 Dec 09 21:44:31.576082 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dd35c07-47b6-49ad-850d-a04b0c26b583 req-5a185784-cd74-4424-b834-356b05051598 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:31.577601 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2dd35c07-47b6-49ad-850d-a04b0c26b583 req-5a185784-cd74-4424-b834-356b05051598 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6f2bd57ebcdc4c748e719519e3961b70&device_id=f9a04051-952f-4c6e-b436-24b66478b4a1 HTTP/1.1" status: 200 len: 1095 time: 0.1167419 Dec 09 21:44:31.607468 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8b5ef84-f4ac-46c6-875a-e2f6838371eb req-542a785d-7aff-4c6f-aec1-90cabc9b7e45 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0652468 Dec 09 21:44:31.731048 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72028cbc-932c-492a-9008-510428b38cbb req-3bf9d9b6-1e6b-4632-bc86-e9f855dea607 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/ports?device_id=abcb80c2-2def-4ce8-97ee-9085b69cbc24 HTTP/1.1" status: 200 len: 210 time: 0.0516160 Dec 09 21:44:31.841101 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42bbecba-7449-4b2e-8c3b-9c3917d53cb5 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:31.848525 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dd35c07-47b6-49ad-850d-a04b0c26b583 req-51f5a200-b183-430a-9539-f72440f39f03 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:31.850480 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2dd35c07-47b6-49ad-850d-a04b0c26b583 req-51f5a200-b183-430a-9539-f72440f39f03 service neutron] 10.222.0.31 "GET /v2.0/networks?id=eda4cb39-afde-43d7-a13b-5227cc6862dd HTTP/1.1" status: 200 len: 915 time: 0.2643003 Dec 09 21:44:31.852542 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42bbecba-7449-4b2e-8c3b-9c3917d53cb5 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:32.037852 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2dd35c07-47b6-49ad-850d-a04b0c26b583 req-e5c33ce2-f2ca-4e3b-a7f3-f107233138ac service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=25f69b99-160f-4f73-bc4c-738b6fa17cbd HTTP/1.1" status: 200 len: 217 time: 0.0908456 Dec 09 21:44:32.160089 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-42bbecba-7449-4b2e-8c3b-9c3917d53cb5 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Floating IP 0cbf6e9e-448a-4fb4-9a7a-25b24fd05181 associated. External IP: 172.25.3.216, port: 6c528b7b-1304-4fbd-a6e4-6cae44f025ec. Dec 09 21:44:32.165189 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dd35c07-47b6-49ad-850d-a04b0c26b583 req-823d0fc9-a786-4591-bd66-9379c95f9a3d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:32.166788 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2dd35c07-47b6-49ad-850d-a04b0c26b583 req-823d0fc9-a786-4591-bd66-9379c95f9a3d service neutron] 10.222.0.31 "GET /v2.0/subnets?id=24afae0e-0a38-484d-a023-a2fb471bdb33 HTTP/1.1" status: 200 len: 854 time: 0.1067412 Dec 09 21:44:32.230017 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2dd35c07-47b6-49ad-850d-a04b0c26b583 req-97f8bc3c-9771-49dd-a26b-ee59e23088be service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eda4cb39-afde-43d7-a13b-5227cc6862dd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0331020 Dec 09 21:44:32.415329 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2dd35c07-47b6-49ad-850d-a04b0c26b583 req-c62f7229-f694-4734-9c6f-e91b6f3e009a service neutron] 10.222.0.31 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1768315 Dec 09 21:44:32.550173 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-42bbecba-7449-4b2e-8c3b-9c3917d53cb5 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Router 3054de87-ea87-42d0-ac7b-818bc1f8e2c8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:44:32.579086 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2dd35c07-47b6-49ad-850d-a04b0c26b583 req-d453e567-57a7-4f2e-8f8e-3b4103ccfa4d service neutron] 10.222.0.31 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1516759 Dec 09 21:44:32.724559 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-42bbecba-7449-4b2e-8c3b-9c3917d53cb5 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:44:32.739802 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb30022c-18ac-463d-93ee-a68903a19d1e None None] Sync routers for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:44:32.750220 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-42bbecba-7449-4b2e-8c3b-9c3917d53cb5 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:32.763799 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb30022c-18ac-463d-93ee-a68903a19d1e None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:32.764433 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-eb30022c-18ac-463d-93ee-a68903a19d1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:32.786870 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-42bbecba-7449-4b2e-8c3b-9c3917d53cb5 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "PUT /v2.0/floatingips/0cbf6e9e-448a-4fb4-9a7a-25b24fd05181 HTTP/1.1" status: 200 len: 977 time: 2.5448949 Dec 09 21:44:32.788614 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39800) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:32.809139 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25b495e3-ee79-4796-aa9e-5b9f59bb925a req-bf483243-827d-4335-9cc9-07108d05afc6 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:32.825837 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25b495e3-ee79-4796-aa9e-5b9f59bb925a req-bf483243-827d-4335-9cc9-07108d05afc6 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9a04051-952f-4c6e-b436-24b66478b4a1 HTTP/1.1" status: 200 len: 943 time: 0.0940764 Dec 09 21:44:32.839966 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-eb30022c-18ac-463d-93ee-a68903a19d1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:32.866566 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb30022c-18ac-463d-93ee-a68903a19d1e None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:32.867254 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-eb30022c-18ac-463d-93ee-a68903a19d1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:32.906565 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25b495e3-ee79-4796-aa9e-5b9f59bb925a req-b10da8e3-30a9-40f5-8c9f-332caf8841fe tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0794804 Dec 09 21:44:32.918926 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-eb30022c-18ac-463d-93ee-a68903a19d1e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:32.919669 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb30022c-18ac-463d-93ee-a68903a19d1e None None] The sync data for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:44:32.980274 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-65bba782-5935-4068-bc9e-fb996c72ce41 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:33.100476 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f17ee699-6871-4d11-93b2-c90c6c60224c req-cb0727e6-aa88-470d-bf35-c87212731c35 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/ports?device_id=abcb80c2-2def-4ce8-97ee-9085b69cbc24 HTTP/1.1" status: 200 len: 210 time: 0.0566452 Dec 09 21:44:33.127504 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-56acd1ce-dc26-49f5-b2cb-6252b2495a8b tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Deleting port 6c528b7b-1304-4fbd-a6e4-6cae44f025ec {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:44:33.128101 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56acd1ce-dc26-49f5-b2cb-6252b2495a8b tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:33.214308 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f02ab45f-db94-4234-bd53-306f80eded65 req-185734cc-ef5f-49ad-b742-11bf7bcfa98d tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:33.215937 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f02ab45f-db94-4234-bd53-306f80eded65 req-185734cc-ef5f-49ad-b742-11bf7bcfa98d tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.31 "GET /v2.0/networks?id=d38aa8a0-2dbc-451b-aa05-cb6c6c804975 HTTP/1.1" status: 200 len: 825 time: 0.4161954 Dec 09 21:44:33.230896 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-f02ab45f-db94-4234-bd53-306f80eded65 req-b8a0bf34-c4b9-49ab-92e9-81a3242ee170 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Request body: {'port': {'device_id': 'abcb80c2-2def-4ce8-97ee-9085b69cbc24', 'network_id': 'd38aa8a0-2dbc-451b-aa05-cb6c6c804975', 'admin_state_up': True, 'tenant_id': '3f88fb9ec7754b72af333e0e54226607'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:33.284740 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56acd1ce-dc26-49f5-b2cb-6252b2495a8b tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:33.511016 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f02ab45f-db94-4234-bd53-306f80eded65 req-b8a0bf34-c4b9-49ab-92e9-81a3242ee170 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Made reservation on behalf of 3f88fb9ec7754b72af333e0e54226607 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:44:33.517029 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f02ab45f-db94-4234-bd53-306f80eded65 req-b8a0bf34-c4b9-49ab-92e9-81a3242ee170 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:33.684293 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56acd1ce-dc26-49f5-b2cb-6252b2495a8b tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:33.684894 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56acd1ce-dc26-49f5-b2cb-6252b2495a8b tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:33.685424 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-56acd1ce-dc26-49f5-b2cb-6252b2495a8b tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Floating IP 0cbf6e9e-448a-4fb4-9a7a-25b24fd05181 disassociated. External IP: 172.25.3.216, port: 6c528b7b-1304-4fbd-a6e4-6cae44f025ec. Dec 09 21:44:33.685804 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-56acd1ce-dc26-49f5-b2cb-6252b2495a8b tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Calling delete_port for 6c528b7b-1304-4fbd-a6e4-6cae44f025ec owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:44:33.788704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-f02ab45f-db94-4234-bd53-306f80eded65 req-b8a0bf34-c4b9-49ab-92e9-81a3242ee170 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Allocated IP 172.20.0.9 (d38aa8a0-2dbc-451b-aa05-cb6c6c804975/b8ac0081-5147-4cda-bfb1-7a949d33002a/7c83f4b4-781d-4644-9143-55354af5127f) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:44:33.907449 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56acd1ce-dc26-49f5-b2cb-6252b2495a8b tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:33.919599 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 25f69b99-160f-4f73-bc4c-738b6fa17cbd details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:44:33.960684 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56acd1ce-dc26-49f5-b2cb-6252b2495a8b tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event deleted for resources: {'Port': ['ID=6c528b7b-1304-4fbd-a6e4-6cae44f025ec,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:34.098687 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 25f69b99-160f-4f73-bc4c-738b6fa17cbd, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=25f69b99-160f-4f73-bc4c-738b6fa17cbd,segment=NetworkSegment(0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5),segment_id=0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:44:34.119414 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '25f69b99-160f-4f73-bc4c-738b6fa17cbd', 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd', 'port_id': '25f69b99-160f-4f73-bc4c-738b6fa17cbd', 'mac_address': 'fa:16:3e:c7:61:14', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '24afae0e-0a38-484d-a023-a2fb471bdb33', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:44:34.161935 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f02ab45f-db94-4234-bd53-306f80eded65 req-b8a0bf34-c4b9-49ab-92e9-81a3242ee170 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:34.189007 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:34.195167 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa74066d-4493-45c1-b9b1-d7a3ac5182bf req-67c275ca-03a2-48f5-a54d-fc5d03eb158e tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:34.196842 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fa74066d-4493-45c1-b9b1-d7a3ac5182bf req-67c275ca-03a2-48f5-a54d-fc5d03eb158e tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9a04051-952f-4c6e-b436-24b66478b4a1 HTTP/1.1" status: 200 len: 943 time: 0.1215909 Dec 09 21:44:34.210385 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 25f69b99-160f-4f73-bc4c-738b6fa17cbd {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:44:34.235632 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-56acd1ce-dc26-49f5-b2cb-6252b2495a8b tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Router 3054de87-ea87-42d0-ac7b-818bc1f8e2c8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:44:34.239585 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 25f69b99-160f-4f73-bc4c-738b6fa17cbd, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=25f69b99-160f-4f73-bc4c-738b6fa17cbd,segment=NetworkSegment(0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5),segment_id=0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:44:34.256525 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:34.332479 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=25f69b99-160f-4f73-bc4c-738b6fa17cbd,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:34.347053 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fa74066d-4493-45c1-b9b1-d7a3ac5182bf req-caa3ac9c-817f-4442-82ae-8dc1472eab64 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1430085 Dec 09 21:44:34.350688 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f02ab45f-db94-4234-bd53-306f80eded65 req-b8a0bf34-c4b9-49ab-92e9-81a3242ee170 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:34.452048 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f02ab45f-db94-4234-bd53-306f80eded65 req-b8a0bf34-c4b9-49ab-92e9-81a3242ee170 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Network d38aa8a0-2dbc-451b-aa05-cb6c6c804975 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:44:34.469650 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-f02ab45f-db94-4234-bd53-306f80eded65 req-b8a0bf34-c4b9-49ab-92e9-81a3242ee170 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:44:34.485487 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-f02ab45f-db94-4234-bd53-306f80eded65 req-b8a0bf34-c4b9-49ab-92e9-81a3242ee170 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:44:34.491554 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a0bf34-c4b9-49ab-92e9-81a3242ee170 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Pushing event updated for resources: {'Port': ['ID=7c83f4b4-781d-4644-9143-55354af5127f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:34.507812 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['25f69b99-160f-4f73-bc4c-738b6fa17cbd'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:44:34.553143 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-56acd1ce-dc26-49f5-b2cb-6252b2495a8b tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:44:34.555596 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3357e315-b7cd-4b7e-af27-40bd67c83428 req-d273bcdc-bfbd-4243-aeb0-7e990b7f098f tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:34.564563 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3357e315-b7cd-4b7e-af27-40bd67c83428 req-d273bcdc-bfbd-4243-aeb0-7e990b7f098f tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/ports?device_id=abcb80c2-2def-4ce8-97ee-9085b69cbc24 HTTP/1.1" status: 200 len: 931 time: 0.0750897 Dec 09 21:44:34.569637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aea30061-84da-4486-b267-a34176728bd2 None None] Sync routers for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:44:34.622436 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aea30061-84da-4486-b267-a34176728bd2 None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:34.623102 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-aea30061-84da-4486-b267-a34176728bd2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:34.631968 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3357e315-b7cd-4b7e-af27-40bd67c83428 req-54987d43-a23c-4045-b79a-c18d13d41c02 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/security-groups?id=74572e25-d24b-4907-912e-b2d64df84fab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0663931 Dec 09 21:44:34.708212 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f02ab45f-db94-4234-bd53-306f80eded65 req-b8a0bf34-c4b9-49ab-92e9-81a3242ee170 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:34.708890 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f02ab45f-db94-4234-bd53-306f80eded65 req-b8a0bf34-c4b9-49ab-92e9-81a3242ee170 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:34.709414 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-aea30061-84da-4486-b267-a34176728bd2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:34.728396 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56acd1ce-dc26-49f5-b2cb-6252b2495a8b tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:34.731970 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-56acd1ce-dc26-49f5-b2cb-6252b2495a8b tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "DELETE /v2.0/ports/6c528b7b-1304-4fbd-a6e4-6cae44f025ec HTTP/1.1" status: 204 len: 168 time: 1.9423690 Dec 09 21:44:34.735027 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39828) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:34.736393 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f02ab45f-db94-4234-bd53-306f80eded65 req-b8a0bf34-c4b9-49ab-92e9-81a3242ee170 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5100846 Dec 09 21:44:34.751202 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-f02ab45f-db94-4234-bd53-306f80eded65 req-bd845ab0-24c4-4bb9-a743-14fbfa953798 service neutron] Request body: {'port': {'device_id': 'abcb80c2-2def-4ce8-97ee-9085b69cbc24', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:34.811994 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aea30061-84da-4486-b267-a34176728bd2 None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:34.812273 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f02ab45f-db94-4234-bd53-306f80eded65 req-bd845ab0-24c4-4bb9-a743-14fbfa953798 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:34.812402 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-aea30061-84da-4486-b267-a34176728bd2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:34.840246 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3ce822d0-c1fc-4a9e-9ee0-66192a3c17f6 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "GET /v2.0/floatingips/0cbf6e9e-448a-4fb4-9a7a-25b24fd05181 HTTP/1.1" status: 200 len: 688 time: 0.1036103 Dec 09 21:44:34.847889 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39830) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:34.905970 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-aea30061-84da-4486-b267-a34176728bd2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:34.906839 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aea30061-84da-4486-b267-a34176728bd2 None None] The sync data for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:44:35.098023 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-b840dcfa-06cd-415c-a175-b3d6eab3933e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Deleting port 63095733-b09f-494e-a23e-c3df4a453c5b {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:44:35.098642 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b840dcfa-06cd-415c-a175-b3d6eab3933e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:35.219156 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b840dcfa-06cd-415c-a175-b3d6eab3933e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:35.219922 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b840dcfa-06cd-415c-a175-b3d6eab3933e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:35.233077 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-b840dcfa-06cd-415c-a175-b3d6eab3933e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Calling delete_port for 63095733-b09f-494e-a23e-c3df4a453c5b owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:44:35.257576 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-f02ab45f-db94-4234-bd53-306f80eded65 req-bd845ab0-24c4-4bb9-a743-14fbfa953798 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7c83f4b4-781d-4644-9143-55354af5127f {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:44:35.270191 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f02ab45f-db94-4234-bd53-306f80eded65 req-bd845ab0-24c4-4bb9-a743-14fbfa953798 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:35.310412 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-f02ab45f-db94-4234-bd53-306f80eded65 req-bd845ab0-24c4-4bb9-a743-14fbfa953798 service neutron] Transition to ACTIVE for port object 7c83f4b4-781d-4644-9143-55354af5127f will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:44:35.316734 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f02ab45f-db94-4234-bd53-306f80eded65 req-bd845ab0-24c4-4bb9-a743-14fbfa953798 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:35.398997 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd845ab0-24c4-4bb9-a743-14fbfa953798 service neutron] Pushing event updated for resources: {'Port': ['ID=7c83f4b4-781d-4644-9143-55354af5127f,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:35.455687 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-f02ab45f-db94-4234-bd53-306f80eded65 req-bd845ab0-24c4-4bb9-a743-14fbfa953798 service neutron] Attempting to bind port 7c83f4b4-781d-4644-9143-55354af5127f on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:44:35.456120 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-f02ab45f-db94-4234-bd53-306f80eded65 req-bd845ab0-24c4-4bb9-a743-14fbfa953798 service neutron] Attempting to bind port 7c83f4b4-781d-4644-9143-55354af5127f by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'd364ec9b-6967-4182-93f8-71f7fcca6cba', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'd38aa8a0-2dbc-451b-aa05-cb6c6c804975'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:44:35.456522 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f02ab45f-db94-4234-bd53-306f80eded65 req-bd845ab0-24c4-4bb9-a743-14fbfa953798 service neutron] Attempting to bind port 7c83f4b4-781d-4644-9143-55354af5127f on network d38aa8a0-2dbc-451b-aa05-cb6c6c804975 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:44:35.463383 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f02ab45f-db94-4234-bd53-306f80eded65 req-bd845ab0-24c4-4bb9-a743-14fbfa953798 service neutron] Port 7c83f4b4-781d-4644-9143-55354af5127f on network d38aa8a0-2dbc-451b-aa05-cb6c6c804975 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:44:35.463894 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f02ab45f-db94-4234-bd53-306f80eded65 req-bd845ab0-24c4-4bb9-a743-14fbfa953798 service neutron] Attempting to bind port 7c83f4b4-781d-4644-9143-55354af5127f on network d38aa8a0-2dbc-451b-aa05-cb6c6c804975 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:44:35.469760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f02ab45f-db94-4234-bd53-306f80eded65 req-bd845ab0-24c4-4bb9-a743-14fbfa953798 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 44, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:44:35.470175 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f02ab45f-db94-4234-bd53-306f80eded65 req-bd845ab0-24c4-4bb9-a743-14fbfa953798 service neutron] Checking segment: {'id': 'd364ec9b-6967-4182-93f8-71f7fcca6cba', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'd38aa8a0-2dbc-451b-aa05-cb6c6c804975'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:44:35.470628 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f02ab45f-db94-4234-bd53-306f80eded65 req-bd845ab0-24c4-4bb9-a743-14fbfa953798 service neutron] Bound using segment: {'id': 'd364ec9b-6967-4182-93f8-71f7fcca6cba', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'd38aa8a0-2dbc-451b-aa05-cb6c6c804975'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:44:35.471126 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-f02ab45f-db94-4234-bd53-306f80eded65 req-bd845ab0-24c4-4bb9-a743-14fbfa953798 service neutron] Bound port: 7c83f4b4-781d-4644-9143-55354af5127f, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd364ec9b-6967-4182-93f8-71f7fcca6cba', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'd38aa8a0-2dbc-451b-aa05-cb6c6c804975'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:44:35.471697 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f02ab45f-db94-4234-bd53-306f80eded65 req-bd845ab0-24c4-4bb9-a743-14fbfa953798 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:35.472682 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b840dcfa-06cd-415c-a175-b3d6eab3933e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:35.544785 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b840dcfa-06cd-415c-a175-b3d6eab3933e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event deleted for resources: {'Port': ['ID=63095733-b09f-494e-a23e-c3df4a453c5b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:35.545321 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-f02ab45f-db94-4234-bd53-306f80eded65 req-bd845ab0-24c4-4bb9-a743-14fbfa953798 service neutron] For port 7c83f4b4-781d-4644-9143-55354af5127f, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:44:35.548738 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-f02ab45f-db94-4234-bd53-306f80eded65 req-bd845ab0-24c4-4bb9-a743-14fbfa953798 service neutron] For port 7c83f4b4-781d-4644-9143-55354af5127f, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=7c83f4b4-781d-4644-9143-55354af5127f,segment=NetworkSegment(d364ec9b-6967-4182-93f8-71f7fcca6cba),segment_id=d364ec9b-6967-4182-93f8-71f7fcca6cba)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:44:35.557469 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c7728d56-577c-4918-b62f-d5c86200ef0a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:35.558345 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f02ab45f-db94-4234-bd53-306f80eded65 req-bd845ab0-24c4-4bb9-a743-14fbfa953798 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:35.612699 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f02ab45f-db94-4234-bd53-306f80eded65 req-bd845ab0-24c4-4bb9-a743-14fbfa953798 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:35.613863 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f02ab45f-db94-4234-bd53-306f80eded65 req-bd845ab0-24c4-4bb9-a743-14fbfa953798 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:35.616541 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f02ab45f-db94-4234-bd53-306f80eded65 req-bd845ab0-24c4-4bb9-a743-14fbfa953798 service neutron] 10.222.0.31 "PUT /v2.0/ports/7c83f4b4-781d-4644-9143-55354af5127f HTTP/1.1" status: 200 len: 1092 time: 0.8700786 Dec 09 21:44:35.617323 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'abcb80c2-2def-4ce8-97ee-9085b69cbc24', 'tag': '7c83f4b4-781d-4644-9143-55354af5127f'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:44:35.620432 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a33e8ec8-3303-4b6b-9b28-d45c4816a586" -d '{"events": [{"name": "network-changed", "server_uuid": "abcb80c2-2def-4ce8-97ee-9085b69cbc24", "tag": "7c83f4b4-781d-4644-9143-55354af5127f"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:44:35.650651 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd845ab0-24c4-4bb9-a743-14fbfa953798 service neutron] Pushing event updated for resources: {'Port': ['ID=7c83f4b4-781d-4644-9143-55354af5127f,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:35.666782 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0badaf34-bcfa-4dc6-ae13-d63542700d60 req-b6060f16-1513-4355-b6a8-b61a1735f93e tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:35.677441 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0badaf34-bcfa-4dc6-ae13-d63542700d60 req-b6060f16-1513-4355-b6a8-b61a1735f93e tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9a04051-952f-4c6e-b436-24b66478b4a1 HTTP/1.1" status: 200 len: 944 time: 0.1785240 Dec 09 21:44:35.708506 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b840dcfa-06cd-415c-a175-b3d6eab3933e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:35.711419 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b840dcfa-06cd-415c-a175-b3d6eab3933e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:35.716113 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b840dcfa-06cd-415c-a175-b3d6eab3933e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "DELETE /v2.0/floatingips/0cbf6e9e-448a-4fb4-9a7a-25b24fd05181 HTTP/1.1" status: 204 len: 168 time: 0.8636961 Dec 09 21:44:35.720787 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39844) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:35.733952 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-3f451100-3806-4529-8227-4c93f0bd573e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': '97adad29-d668-4e98-9fb3-f98121e998ee'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:35.750367 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0badaf34-bcfa-4dc6-ae13-d63542700d60 req-6bdb8a2d-e133-47fe-97d6-5ee6d60b0249 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0713663 Dec 09 21:44:35.761896 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f02ab45f-db94-4234-bd53-306f80eded65 req-ba57be5d-a357-49ad-a743-db6fd340731c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:35.763562 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f02ab45f-db94-4234-bd53-306f80eded65 req-ba57be5d-a357-49ad-a743-db6fd340731c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3f88fb9ec7754b72af333e0e54226607&device_id=abcb80c2-2def-4ce8-97ee-9085b69cbc24 HTTP/1.1" status: 200 len: 1095 time: 0.0833528 Dec 09 21:44:35.829728 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:44:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8f32e1f2-85f9-46cb-8919-94bf52367500 x-openstack-request-id: req-8f32e1f2-85f9-46cb-8919-94bf52367500 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:44:35.830315 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "abcb80c2-2def-4ce8-97ee-9085b69cbc24", "tag": "7c83f4b4-781d-4644-9143-55354af5127f", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:44:35.830670 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8f32e1f2-85f9-46cb-8919-94bf52367500 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:44:35.831788 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'abcb80c2-2def-4ce8-97ee-9085b69cbc24', 'tag': '7c83f4b4-781d-4644-9143-55354af5127f', 'status': 'completed', 'code': 200} Dec 09 21:44:35.832648 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f451100-3806-4529-8227-4c93f0bd573e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:35.843655 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f02ab45f-db94-4234-bd53-306f80eded65 req-cad9854e-867d-4ad7-899e-b35623ac8f2f service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=7c83f4b4-781d-4644-9143-55354af5127f HTTP/1.1" status: 200 len: 217 time: 0.0647571 Dec 09 21:44:35.926397 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f02ab45f-db94-4234-bd53-306f80eded65 req-a076279d-d6d2-40b1-8f44-f9628b44550e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:35.930035 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f02ab45f-db94-4234-bd53-306f80eded65 req-a076279d-d6d2-40b1-8f44-f9628b44550e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=b8ac0081-5147-4cda-bfb1-7a949d33002a HTTP/1.1" status: 200 len: 865 time: 0.0807583 Dec 09 21:44:35.941906 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 25f69b99-160f-4f73-bc4c-738b6fa17cbd up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:44:35.958854 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f8b703a-b167-40fa-b7a6-60406cf6f1d3 req-fd3c8717-6221-4b2d-a76f-828a14beaace tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:35.961567 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f8b703a-b167-40fa-b7a6-60406cf6f1d3 req-fd3c8717-6221-4b2d-a76f-828a14beaace tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/ports?device_id=abcb80c2-2def-4ce8-97ee-9085b69cbc24 HTTP/1.1" status: 200 len: 943 time: 0.0722268 Dec 09 21:44:35.982209 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f02ab45f-db94-4234-bd53-306f80eded65 req-00b542e1-2ec9-4cda-9379-d5f5d21ee9bb service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d38aa8a0-2dbc-451b-aa05-cb6c6c804975&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0374572 Dec 09 21:44:36.036985 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f8b703a-b167-40fa-b7a6-60406cf6f1d3 req-c268624f-a4d7-498c-81b2-1f5334772c3d tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/security-groups?id=74572e25-d24b-4907-912e-b2d64df84fab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0653503 Dec 09 21:44:36.122338 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 25f69b99-160f-4f73-bc4c-738b6fa17cbd completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:44:36.133118 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 25f69b99-160f-4f73-bc4c-738b6fa17cbd triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:44:36.133463 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:36.290351 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f451100-3806-4529-8227-4c93f0bd573e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:36.295788 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f02ab45f-db94-4234-bd53-306f80eded65 req-cf5848c3-8108-48e7-9081-a273345fa4b8 service neutron] 10.222.0.31 "GET /v2.0/networks/d38aa8a0-2dbc-451b-aa05-cb6c6c804975?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2839854 Dec 09 21:44:36.330708 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:36.421247 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f9a04051-952f-4c6e-b436-24b66478b4a1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '25f69b99-160f-4f73-bc4c-738b6fa17cbd'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:44:36.430199 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ac4f606f-aad8-475b-aff4-0a996e619d07" -d '{"events": [{"server_uuid": "f9a04051-952f-4c6e-b436-24b66478b4a1", "name": "network-vif-plugged", "status": "completed", "tag": "25f69b99-160f-4f73-bc4c-738b6fa17cbd"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:44:36.475753 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f02ab45f-db94-4234-bd53-306f80eded65 req-25b68ca8-3909-47bd-9521-640569e95f4e service neutron] 10.222.0.31 "GET /v2.0/networks/d38aa8a0-2dbc-451b-aa05-cb6c6c804975?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1553142 Dec 09 21:44:36.480892 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 25f69b99-160f-4f73-bc4c-738b6fa17cbd, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=25f69b99-160f-4f73-bc4c-738b6fa17cbd,segment=NetworkSegment(0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5),segment_id=0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:44:36.510243 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:36.534912 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:44:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d57ba510-5928-4324-9ade-a6b90d9055d6 x-openstack-request-id: req-d57ba510-5928-4324-9ade-a6b90d9055d6 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:44:36.547699 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f9a04051-952f-4c6e-b436-24b66478b4a1", "name": "network-vif-plugged", "status": "completed", "tag": "25f69b99-160f-4f73-bc4c-738b6fa17cbd", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:44:36.548645 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-d57ba510-5928-4324-9ade-a6b90d9055d6 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:44:36.549583 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f9a04051-952f-4c6e-b436-24b66478b4a1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '25f69b99-160f-4f73-bc4c-738b6fa17cbd', 'code': 200} Dec 09 21:44:36.652237 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a33e8ec8-3303-4b6b-9b28-d45c4816a586 req-d35dda2b-07c7-4139-ba68-9a82f97db976 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:36.652237 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a33e8ec8-3303-4b6b-9b28-d45c4816a586 req-d35dda2b-07c7-4139-ba68-9a82f97db976 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=3f88fb9ec7754b72af333e0e54226607&device_id=abcb80c2-2def-4ce8-97ee-9085b69cbc24 HTTP/1.1" status: 200 len: 1095 time: 0.1033850 Dec 09 21:44:36.659022 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=25f69b99-160f-4f73-bc4c-738b6fa17cbd,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:36.670658 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:36.672564 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:36.672968 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:36.673368 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:36.673768 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:36.674201 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:36.674621 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:36.675133 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:36.675630 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:36.675982 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:36.676377 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:36.676809 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:36.677192 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:36.677876 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:44:36.695642 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-425696c1-2c03-4d36-a4e2-537ab68bf84d req-903d9c07-0b4b-49ff-8b9b-cd2d85850698 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:36.697892 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-425696c1-2c03-4d36-a4e2-537ab68bf84d req-903d9c07-0b4b-49ff-8b9b-cd2d85850698 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=f9a04051-952f-4c6e-b436-24b66478b4a1 HTTP/1.1" status: 200 len: 1097 time: 0.1028795 Dec 09 21:44:36.705513 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-3f451100-3806-4529-8227-4c93f0bd573e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Allocated IP 172.25.3.121 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/b60aaf5b-ad43-4a72-949a-4dfe0de62bc9) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:44:36.784273 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-425696c1-2c03-4d36-a4e2-537ab68bf84d req-f6e13b36-aa02-4937-9b96-d21762b8ebc0 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0725286 Dec 09 21:44:36.953010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a8955be-eb88-4b35-845d-cbf5075aa708 req-f1de6ed7-3120-4e53-9da8-122fc0dd36e2 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:36.961417 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a8955be-eb88-4b35-845d-cbf5075aa708 req-f1de6ed7-3120-4e53-9da8-122fc0dd36e2 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9a04051-952f-4c6e-b436-24b66478b4a1 HTTP/1.1" status: 200 len: 945 time: 0.0829372 Dec 09 21:44:37.029238 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a8955be-eb88-4b35-845d-cbf5075aa708 req-347b6092-cb9a-4be4-94c9-7f18c8a896c1 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0654924 Dec 09 21:44:37.344559 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a33e8ec8-3303-4b6b-9b28-d45c4816a586 req-5e57ed57-642d-4fc9-9ea5-5cd5779cd843 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:37.345952 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a33e8ec8-3303-4b6b-9b28-d45c4816a586 req-5e57ed57-642d-4fc9-9ea5-5cd5779cd843 service neutron] 10.222.0.31 "GET /v2.0/networks?id=d38aa8a0-2dbc-451b-aa05-cb6c6c804975 HTTP/1.1" status: 200 len: 926 time: 0.6869633 Dec 09 21:44:37.373869 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db1f90cd-563c-4d66-a1ff-de6342d1bc1b req-88b4bf6b-f793-4551-9ece-aa83a5d78580 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:37.382213 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db1f90cd-563c-4d66-a1ff-de6342d1bc1b req-88b4bf6b-f793-4551-9ece-aa83a5d78580 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/ports?device_id=abcb80c2-2def-4ce8-97ee-9085b69cbc24 HTTP/1.1" status: 200 len: 943 time: 0.1747930 Dec 09 21:44:37.461769 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a33e8ec8-3303-4b6b-9b28-d45c4816a586 req-1e53b791-5124-42de-aa16-ff7575046a8a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=7c83f4b4-781d-4644-9143-55354af5127f HTTP/1.1" status: 200 len: 217 time: 0.1013424 Dec 09 21:44:37.501251 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db1f90cd-563c-4d66-a1ff-de6342d1bc1b req-e6496dbd-1a69-4be7-8e5c-e2e1ab119863 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/security-groups?id=74572e25-d24b-4907-912e-b2d64df84fab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1179895 Dec 09 21:44:37.569597 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f451100-3806-4529-8227-4c93f0bd573e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:37.595815 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a33e8ec8-3303-4b6b-9b28-d45c4816a586 req-5eb8f6ee-b083-4fcb-a795-acdc86043368 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:37.597353 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a33e8ec8-3303-4b6b-9b28-d45c4816a586 req-5eb8f6ee-b083-4fcb-a795-acdc86043368 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=b8ac0081-5147-4cda-bfb1-7a949d33002a HTTP/1.1" status: 200 len: 865 time: 0.1215746 Dec 09 21:44:37.642271 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a33e8ec8-3303-4b6b-9b28-d45c4816a586 req-4925ebb7-bd23-4ef0-95cd-dc7aa5e26b0f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d38aa8a0-2dbc-451b-aa05-cb6c6c804975&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0336912 Dec 09 21:44:37.660834 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f451100-3806-4529-8227-4c93f0bd573e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:37.725891 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3f451100-3806-4529-8227-4c93f0bd573e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:44:37.755005 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-3f451100-3806-4529-8227-4c93f0bd573e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:44:37.773217 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f451100-3806-4529-8227-4c93f0bd573e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Port': ['ID=b60aaf5b-ad43-4a72-949a-4dfe0de62bc9,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:37.801355 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a33e8ec8-3303-4b6b-9b28-d45c4816a586 req-6f55cdea-c108-4a96-bb0c-d8c6d442d348 service neutron] 10.222.0.31 "GET /v2.0/networks/d38aa8a0-2dbc-451b-aa05-cb6c6c804975?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1499527 Dec 09 21:44:37.816852 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f451100-3806-4529-8227-4c93f0bd573e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:44:37.974534 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:38.002430 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a33e8ec8-3303-4b6b-9b28-d45c4816a586 req-9f436743-65af-4fb9-b87e-549bf7356c9c service neutron] 10.222.0.31 "GET /v2.0/networks/d38aa8a0-2dbc-451b-aa05-cb6c6c804975?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1846507 Dec 09 21:44:38.176519 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6f1ff5c-fba3-440c-a960-8b7e67c39c6e req-941e95de-6372-454b-a2e1-b116ec101ec4 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:38.179167 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a6f1ff5c-fba3-440c-a960-8b7e67c39c6e req-941e95de-6372-454b-a2e1-b116ec101ec4 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9a04051-952f-4c6e-b436-24b66478b4a1 HTTP/1.1" status: 200 len: 945 time: 0.0673485 Dec 09 21:44:38.256551 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a6f1ff5c-fba3-440c-a960-8b7e67c39c6e req-fd781e38-7f4e-4bca-be3b-9e699c650e61 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0664456 Dec 09 21:44:38.478773 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f451100-3806-4529-8227-4c93f0bd573e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:38.602116 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f451100-3806-4529-8227-4c93f0bd573e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:38.804660 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a10fd5f-2756-4d71-ae79-da40231f41a1 req-55a36cf6-5387-44e2-ae07-8f95bd7cda40 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:38.809043 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a10fd5f-2756-4d71-ae79-da40231f41a1 req-55a36cf6-5387-44e2-ae07-8f95bd7cda40 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/ports?device_id=abcb80c2-2def-4ce8-97ee-9085b69cbc24 HTTP/1.1" status: 200 len: 943 time: 0.1373858 Dec 09 21:44:38.932200 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a10fd5f-2756-4d71-ae79-da40231f41a1 req-4b326343-0b33-474a-add6-9e78ec570143 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/security-groups?id=74572e25-d24b-4907-912e-b2d64df84fab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1161230 Dec 09 21:44:38.950536 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f451100-3806-4529-8227-4c93f0bd573e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:38.960781 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f451100-3806-4529-8227-4c93f0bd573e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:39.047007 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f451100-3806-4529-8227-4c93f0bd573e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Port': ['ID=b60aaf5b-ad43-4a72-949a-4dfe0de62bc9,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:39.074608 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f451100-3806-4529-8227-4c93f0bd573e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:39.243983 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-3f451100-3806-4529-8227-4c93f0bd573e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Floating IP 5c477e5d-9f23-49d8-8d90-531e60407f0a associated. External IP: 172.25.3.121, port: 97adad29-d668-4e98-9fb3-f98121e998ee. Dec 09 21:44:39.539590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3f451100-3806-4529-8227-4c93f0bd573e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Router 3054de87-ea87-42d0-ac7b-818bc1f8e2c8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:44:39.692453 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:39.764766 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3f451100-3806-4529-8227-4c93f0bd573e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:44:39.778592 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-266a7902-406b-4b77-8095-6b1b308fadbd None None] Sync routers for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:44:39.804826 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f451100-3806-4529-8227-4c93f0bd573e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:39.829745 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-266a7902-406b-4b77-8095-6b1b308fadbd None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:39.831131 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-266a7902-406b-4b77-8095-6b1b308fadbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:39.842931 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39916) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:39.844020 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3f451100-3806-4529-8227-4c93f0bd573e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 982 time: 4.1219735 Dec 09 21:44:39.848128 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-24be5505-2144-4a5d-87fe-22d4dea3a5ab tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Request body: {'network': {'name': 'tempest-FloatingIPTestJSON-325673797'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:39.887757 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-24be5505-2144-4a5d-87fe-22d4dea3a5ab tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Made reservation on behalf of 1752f69b83904328a79fb89f35377bcf for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:44:39.895867 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24be5505-2144-4a5d-87fe-22d4dea3a5ab tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:39.926708 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-266a7902-406b-4b77-8095-6b1b308fadbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:39.936721 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-24be5505-2144-4a5d-87fe-22d4dea3a5ab tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] vlan segment allocate from pool success with {'vlan_id': 141, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:44:39.949523 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24be5505-2144-4a5d-87fe-22d4dea3a5ab tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:39.950419 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-24be5505-2144-4a5d-87fe-22d4dea3a5ab tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Added segment 521a017d-c38d-41ad-9074-205124569e58 of type vlan for network 010dee5f-117a-4994-8632-abedb5cbcd51 Dec 09 21:44:39.953351 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-266a7902-406b-4b77-8095-6b1b308fadbd None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:39.956701 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-266a7902-406b-4b77-8095-6b1b308fadbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:40.004848 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 7c83f4b4-781d-4644-9143-55354af5127f details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:44:40.028906 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-266a7902-406b-4b77-8095-6b1b308fadbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:40.029977 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-266a7902-406b-4b77-8095-6b1b308fadbd None None] The sync data for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:44:40.048446 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24be5505-2144-4a5d-87fe-22d4dea3a5ab tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:40.106456 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24be5505-2144-4a5d-87fe-22d4dea3a5ab tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:40.113286 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-24be5505-2144-4a5d-87fe-22d4dea3a5ab tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:40.114543 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24be5505-2144-4a5d-87fe-22d4dea3a5ab tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:40.126237 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-414ef63c-10f0-4f46-b8b4-b8ed894749ad req-bbc35fbc-3a5c-4629-a10d-6bf8a4c25e7f tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:40.128588 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-414ef63c-10f0-4f46-b8b4-b8ed894749ad req-bbc35fbc-3a5c-4629-a10d-6bf8a4c25e7f tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/ports?device_id=abcb80c2-2def-4ce8-97ee-9085b69cbc24 HTTP/1.1" status: 200 len: 943 time: 0.1096890 Dec 09 21:44:40.190760 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-24be5505-2144-4a5d-87fe-22d4dea3a5ab tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.3466520 Dec 09 21:44:40.193991 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 39924) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:40.201929 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-9d563b91-9d84-4272-938b-20f9c6916127 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Request body: {'subnet': {'network_id': '010dee5f-117a-4994-8632-abedb5cbcd51', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:40.210477 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 7c83f4b4-781d-4644-9143-55354af5127f, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=7c83f4b4-781d-4644-9143-55354af5127f,segment=NetworkSegment(d364ec9b-6967-4182-93f8-71f7fcca6cba),segment_id=d364ec9b-6967-4182-93f8-71f7fcca6cba)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:44:40.227228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '7c83f4b4-781d-4644-9143-55354af5127f', 'network_id': 'd38aa8a0-2dbc-451b-aa05-cb6c6c804975', 'port_id': '7c83f4b4-781d-4644-9143-55354af5127f', 'mac_address': 'fa:16:3e:e8:50:b0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 100, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b8ac0081-5147-4cda-bfb1-7a949d33002a', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:44:40.331939 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:40.349087 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-414ef63c-10f0-4f46-b8b4-b8ed894749ad req-2106c2c6-68be-45eb-829c-56d62345dfcc tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/security-groups?id=74572e25-d24b-4907-912e-b2d64df84fab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2124169 Dec 09 21:44:40.350360 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24be5505-2144-4a5d-87fe-22d4dea3a5ab tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Network': ['ID=010dee5f-117a-4994-8632-abedb5cbcd51,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:40.380697 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 010dee5f-117a-4994-8632-abedb5cbcd51 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:44:40.385336 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9d563b91-9d84-4272-938b-20f9c6916127 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Made reservation on behalf of 1752f69b83904328a79fb89f35377bcf for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:44:40.388995 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d563b91-9d84-4272-938b-20f9c6916127 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:40.398771 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7c83f4b4-781d-4644-9143-55354af5127f {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:44:40.472711 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 7c83f4b4-781d-4644-9143-55354af5127f, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=7c83f4b4-781d-4644-9143-55354af5127f,segment=NetworkSegment(d364ec9b-6967-4182-93f8-71f7fcca6cba),segment_id=d364ec9b-6967-4182-93f8-71f7fcca6cba)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:44:40.484547 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:40.589835 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=7c83f4b4-781d-4644-9143-55354af5127f,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:40.727412 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d563b91-9d84-4272-938b-20f9c6916127 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:40.767675 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['7c83f4b4-781d-4644-9143-55354af5127f'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:44:40.909311 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d563b91-9d84-4272-938b-20f9c6916127 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Subnet': ['ID=5f69fcfb-0c7f-4494-a05b-6986fda3fe04,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:40.986592 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d563b91-9d84-4272-938b-20f9c6916127 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Checking segment: {'id': '521a017d-c38d-41ad-9074-205124569e58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '010dee5f-117a-4994-8632-abedb5cbcd51'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:44:40.986592 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d563b91-9d84-4272-938b-20f9c6916127 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Network hostable DHCP agents. Network: 010dee5f-117a-4994-8632-abedb5cbcd51, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:44:41.031986 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d563b91-9d84-4272-938b-20f9c6916127 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Network 010dee5f-117a-4994-8632-abedb5cbcd51 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:44:41.056712 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-9d563b91-9d84-4272-938b-20f9c6916127 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 010dee5f-117a-4994-8632-abedb5cbcd51) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:44:41.066863 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-068a4934-1393-427a-90c3-2138f6bc2ddd None None] Network 010dee5f-117a-4994-8632-abedb5cbcd51 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:44:41.073597 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9d563b91-9d84-4272-938b-20f9c6916127 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:41.074213 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d563b91-9d84-4272-938b-20f9c6916127 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:41.098076 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 39948) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:41.109246 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-359e3e38-d2db-4e2f-a6fd-6e7da6fdf79d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Request body: {'router': {'name': 'tempest-FloatingIPTestJSON-router-1724630496', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}, 'admin_state_up': False}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:41.119832 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9d563b91-9d84-4272-938b-20f9c6916127 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.9107716 Dec 09 21:44:41.181734 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-359e3e38-d2db-4e2f-a6fd-6e7da6fdf79d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:41.183149 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-359e3e38-d2db-4e2f-a6fd-6e7da6fdf79d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:41.277039 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-359e3e38-d2db-4e2f-a6fd-6e7da6fdf79d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:41.564655 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7a872134-ad24-4ff8-97a8-745171e84ebc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-010dee5f-117a-4994-8632-abedb5cbcd51', 'network_id': '010dee5f-117a-4994-8632-abedb5cbcd51', 'project_id': '1752f69b83904328a79fb89f35377bcf', 'fixed_ips': [{'subnet_id': '5f69fcfb-0c7f-4494-a05b-6986fda3fe04'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:44:41.565551 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7a872134-ad24-4ff8-97a8-745171e84ebc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:41.637229 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-359e3e38-d2db-4e2f-a6fd-6e7da6fdf79d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:41.747914 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff03c9f5-b48a-46fd-8ea6-b1a37edeb6a1 req-c467233c-b935-4f6f-b027-72d62da014ab tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:41.756045 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ff03c9f5-b48a-46fd-8ea6-b1a37edeb6a1 req-c467233c-b935-4f6f-b027-72d62da014ab tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/ports?device_id=abcb80c2-2def-4ce8-97ee-9085b69cbc24 HTTP/1.1" status: 200 len: 944 time: 0.1078036 Dec 09 21:44:41.798350 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-7a872134-ad24-4ff8-97a8-745171e84ebc None None] Allocated IP 172.20.0.2 (010dee5f-117a-4994-8632-abedb5cbcd51/5f69fcfb-0c7f-4494-a05b-6986fda3fe04/1a71d833-9202-4bda-97f0-24289244be12) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:44:41.922532 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ff03c9f5-b48a-46fd-8ea6-b1a37edeb6a1 req-0d8d249d-dbad-47f0-b146-c11dd81bb421 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/security-groups?id=74572e25-d24b-4907-912e-b2d64df84fab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1655195 Dec 09 21:44:42.031038 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 7c83f4b4-781d-4644-9143-55354af5127f up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:44:42.173536 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7a872134-ad24-4ff8-97a8-745171e84ebc None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:42.189491 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7a872134-ad24-4ff8-97a8-745171e84ebc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:42.201854 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 7c83f4b4-781d-4644-9143-55354af5127f completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:44:42.236264 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 7c83f4b4-781d-4644-9143-55354af5127f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:44:42.236908 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:42.279278 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a872134-ad24-4ff8-97a8-745171e84ebc None None] Network 010dee5f-117a-4994-8632-abedb5cbcd51 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:44:42.292700 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-7a872134-ad24-4ff8-97a8-745171e84ebc None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:44:42.297697 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7a872134-ad24-4ff8-97a8-745171e84ebc None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:44:42.303104 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a872134-ad24-4ff8-97a8-745171e84ebc None None] Pushing event updated for resources: {'Port': ['ID=1a71d833-9202-4bda-97f0-24289244be12,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:42.399236 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-7a872134-ad24-4ff8-97a8-745171e84ebc None None] Attempting to bind port 1a71d833-9202-4bda-97f0-24289244be12 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:44:42.400104 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-7a872134-ad24-4ff8-97a8-745171e84ebc None None] Attempting to bind port 1a71d833-9202-4bda-97f0-24289244be12 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '521a017d-c38d-41ad-9074-205124569e58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '010dee5f-117a-4994-8632-abedb5cbcd51'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:44:42.400656 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a872134-ad24-4ff8-97a8-745171e84ebc None None] Attempting to bind port 1a71d833-9202-4bda-97f0-24289244be12 on network 010dee5f-117a-4994-8632-abedb5cbcd51 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:44:42.410746 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a872134-ad24-4ff8-97a8-745171e84ebc None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 44, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:44:42.411519 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a872134-ad24-4ff8-97a8-745171e84ebc None None] Checking segment: {'id': '521a017d-c38d-41ad-9074-205124569e58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '010dee5f-117a-4994-8632-abedb5cbcd51'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:44:42.412917 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7a872134-ad24-4ff8-97a8-745171e84ebc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:42.413495 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a872134-ad24-4ff8-97a8-745171e84ebc None None] Bound using segment: {'id': '521a017d-c38d-41ad-9074-205124569e58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '010dee5f-117a-4994-8632-abedb5cbcd51'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:44:42.414155 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-7a872134-ad24-4ff8-97a8-745171e84ebc None None] Bound port: 1a71d833-9202-4bda-97f0-24289244be12, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '521a017d-c38d-41ad-9074-205124569e58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 141, 'network_id': '010dee5f-117a-4994-8632-abedb5cbcd51'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:44:42.414844 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7a872134-ad24-4ff8-97a8-745171e84ebc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:42.505078 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-7a872134-ad24-4ff8-97a8-745171e84ebc None None] For port 1a71d833-9202-4bda-97f0-24289244be12, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:44:42.509627 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-7a872134-ad24-4ff8-97a8-745171e84ebc None None] For port 1a71d833-9202-4bda-97f0-24289244be12, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=1a71d833-9202-4bda-97f0-24289244be12,segment=NetworkSegment(521a017d-c38d-41ad-9074-205124569e58),segment_id=521a017d-c38d-41ad-9074-205124569e58)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:44:42.560014 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:42.562960 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7a872134-ad24-4ff8-97a8-745171e84ebc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:42.640360 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'abcb80c2-2def-4ce8-97ee-9085b69cbc24', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7c83f4b4-781d-4644-9143-55354af5127f'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:44:42.643214 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6ddf0781-b452-4808-bf63-42c3ed0525e6" -d '{"events": [{"server_uuid": "abcb80c2-2def-4ce8-97ee-9085b69cbc24", "name": "network-vif-plugged", "status": "completed", "tag": "7c83f4b4-781d-4644-9143-55354af5127f"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:44:42.727714 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-359e3e38-d2db-4e2f-a6fd-6e7da6fdf79d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:42.729619 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 7c83f4b4-781d-4644-9143-55354af5127f, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=7c83f4b4-781d-4644-9143-55354af5127f,segment=NetworkSegment(d364ec9b-6967-4182-93f8-71f7fcca6cba),segment_id=d364ec9b-6967-4182-93f8-71f7fcca6cba)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:44:42.755709 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-359e3e38-d2db-4e2f-a6fd-6e7da6fdf79d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:42.757537 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:42.762576 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:44:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eaba8876-bc88-429d-96a1-dc51ad5d0e67 x-openstack-request-id: req-eaba8876-bc88-429d-96a1-dc51ad5d0e67 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:44:42.763223 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "abcb80c2-2def-4ce8-97ee-9085b69cbc24", "name": "network-vif-plugged", "status": "completed", "tag": "7c83f4b4-781d-4644-9143-55354af5127f", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:44:42.763796 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-eaba8876-bc88-429d-96a1-dc51ad5d0e67 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:44:42.764413 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'abcb80c2-2def-4ce8-97ee-9085b69cbc24', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7c83f4b4-781d-4644-9143-55354af5127f', 'code': 200} Dec 09 21:44:42.768762 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a872134-ad24-4ff8-97a8-745171e84ebc None None] Pushing event updated for resources: {'Port': ['ID=1a71d833-9202-4bda-97f0-24289244be12,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:42.879033 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=7c83f4b4-781d-4644-9143-55354af5127f,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:42.934470 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be5bf8ca-a1f6-447b-9b28-69909ea0344a req-11309102-753e-4aa5-9064-fb496c5dfc52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:42.936810 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-be5bf8ca-a1f6-447b-9b28-69909ea0344a req-11309102-753e-4aa5-9064-fb496c5dfc52 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=abcb80c2-2def-4ce8-97ee-9085b69cbc24 HTTP/1.1" status: 200 len: 1097 time: 0.0942295 Dec 09 21:44:43.019600 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-359e3e38-d2db-4e2f-a6fd-6e7da6fdf79d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Allocated IP 172.25.3.176 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/59124e2a-9cdf-4ab6-8434-595c9e52edcb) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:44:43.168921 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-be5bf8ca-a1f6-447b-9b28-69909ea0344a req-5338f5d0-3627-411c-93e0-d5bfc6be0ab3 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=74572e25-d24b-4907-912e-b2d64df84fab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2230794 Dec 09 21:44:43.275628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6eb982a-4453-48d7-8fe0-4cea337d56d1 req-9fabddf2-6f94-470e-9cd4-7d054dab411b tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:43.283620 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6eb982a-4453-48d7-8fe0-4cea337d56d1 req-9fabddf2-6f94-470e-9cd4-7d054dab411b tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/ports?device_id=abcb80c2-2def-4ce8-97ee-9085b69cbc24 HTTP/1.1" status: 200 len: 945 time: 0.1789174 Dec 09 21:44:43.402031 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-359e3e38-d2db-4e2f-a6fd-6e7da6fdf79d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:43.416190 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6eb982a-4453-48d7-8fe0-4cea337d56d1 req-9994d96b-781d-4d03-9b5a-0a36f0c37030 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/security-groups?id=74572e25-d24b-4907-912e-b2d64df84fab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1316168 Dec 09 21:44:43.465491 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-359e3e38-d2db-4e2f-a6fd-6e7da6fdf79d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:43.542697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-359e3e38-d2db-4e2f-a6fd-6e7da6fdf79d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:44:43.545908 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-359e3e38-d2db-4e2f-a6fd-6e7da6fdf79d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:44:43.549608 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-359e3e38-d2db-4e2f-a6fd-6e7da6fdf79d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:44:43.561493 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de383c40-be07-4162-88e6-6fc18990d340 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:44:43.583604 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-359e3e38-d2db-4e2f-a6fd-6e7da6fdf79d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Port': ['ID=59124e2a-9cdf-4ab6-8434-595c9e52edcb,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:43.651371 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7cc4dc09-3fae-42e6-abc3-f76273204de0 None None] Provisioning complete for port 59124e2a-9cdf-4ab6-8434-595c9e52edcb triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:44:43.652366 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7cc4dc09-3fae-42e6-abc3-f76273204de0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:43.706444 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-7cc4dc09-3fae-42e6-abc3-f76273204de0 None None] Port 59124e2a-9cdf-4ab6-8434-595c9e52edcb cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:44:44.172288 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-359e3e38-d2db-4e2f-a6fd-6e7da6fdf79d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:44.575589 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a95307da-2f51-4334-945c-9d034870ff37 None None] Network 010dee5f-117a-4994-8632-abedb5cbcd51 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:44:44.703962 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-28587e8d-9986-4890-8e07-9fa38589b89a None None] Provisioning complete for port 1a71d833-9202-4bda-97f0-24289244be12 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:44:44.704629 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-28587e8d-9986-4890-8e07-9fa38589b89a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:44.709070 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 1a71d833-9202-4bda-97f0-24289244be12 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:44:44.715984 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-359e3e38-d2db-4e2f-a6fd-6e7da6fdf79d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:44.845476 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6396331-64cc-4c0c-a430-ae1c38a71954 req-5181c3c0-3b0e-4de6-bfd2-5c9feccdba96 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:44.853916 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6396331-64cc-4c0c-a430-ae1c38a71954 req-5181c3c0-3b0e-4de6-bfd2-5c9feccdba96 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/ports?device_id=abcb80c2-2def-4ce8-97ee-9085b69cbc24 HTTP/1.1" status: 200 len: 945 time: 0.2464650 Dec 09 21:44:44.915285 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 1a71d833-9202-4bda-97f0-24289244be12 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:44:44.915985 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:44.998119 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6396331-64cc-4c0c-a430-ae1c38a71954 req-230e49f5-6196-44f4-a39c-feac4a3a60b8 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/security-groups?id=74572e25-d24b-4907-912e-b2d64df84fab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1417489 Dec 09 21:44:45.070305 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-28587e8d-9986-4890-8e07-9fa38589b89a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:45.176797 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:45.203583 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-28587e8d-9986-4890-8e07-9fa38589b89a None None] For port 1a71d833-9202-4bda-97f0-24289244be12, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=1a71d833-9202-4bda-97f0-24289244be12,segment=NetworkSegment(521a017d-c38d-41ad-9074-205124569e58),segment_id=521a017d-c38d-41ad-9074-205124569e58)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:44:45.214653 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-28587e8d-9986-4890-8e07-9fa38589b89a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:45.243918 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3f669d8-8eb6-4a2a-8831-b588cf003ee6 req-158e1f3e-3722-48d3-9f11-c25594925882 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:45.256782 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:44:45.257284 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:44:45.268931 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3f669d8-8eb6-4a2a-8831-b588cf003ee6 req-158e1f3e-3722-48d3-9f11-c25594925882 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/ports?device_id=abcb80c2-2def-4ce8-97ee-9085b69cbc24 HTTP/1.1" status: 200 len: 945 time: 0.1109607 Dec 09 21:44:45.357464 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28587e8d-9986-4890-8e07-9fa38589b89a None None] Pushing event updated for resources: {'Port': ['ID=1a71d833-9202-4bda-97f0-24289244be12,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:45.459507 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3f669d8-8eb6-4a2a-8831-b588cf003ee6 req-03308991-626f-4672-92b0-1d8251493bc6 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/security-groups?id=74572e25-d24b-4907-912e-b2d64df84fab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1835389 Dec 09 21:44:45.466039 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-359e3e38-d2db-4e2f-a6fd-6e7da6fdf79d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Router 772b6758-54fa-4b9c-ba3a-7a3e806f18e0 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:44:45.548021 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-69b9af9b-f81d-450a-bab0-64a2a1350252 None None] Provisioning complete for port 1a71d833-9202-4bda-97f0-24289244be12 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:44:45.548391 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-69b9af9b-f81d-450a-bab0-64a2a1350252 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:45.753691 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-359e3e38-d2db-4e2f-a6fd-6e7da6fdf79d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:44:45.827031 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-359e3e38-d2db-4e2f-a6fd-6e7da6fdf79d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:45.828392 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-359e3e38-d2db-4e2f-a6fd-6e7da6fdf79d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 887 time: 4.7272897 Dec 09 21:44:45.831589 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40032) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:45.837103 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4cc65de3-74db-4dc4-af46-84c1cd240f53 None None] Sync routers for ids ['772b6758-54fa-4b9c-ba3a-7a3e806f18e0'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:44:45.899308 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4cc65de3-74db-4dc4-af46-84c1cd240f53 None None] Routers {'772b6758-54fa-4b9c-ba3a-7a3e806f18e0'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:45.900784 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-4cc65de3-74db-4dc4-af46-84c1cd240f53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['772b6758-54fa-4b9c-ba3a-7a3e806f18e0'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:45.950032 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-4cc65de3-74db-4dc4-af46-84c1cd240f53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:45.971296 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4cc65de3-74db-4dc4-af46-84c1cd240f53 None None] Routers {'772b6758-54fa-4b9c-ba3a-7a3e806f18e0'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:45.971989 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-4cc65de3-74db-4dc4-af46-84c1cd240f53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['772b6758-54fa-4b9c-ba3a-7a3e806f18e0'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:46.014373 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-4cc65de3-74db-4dc4-af46-84c1cd240f53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:46.015477 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4cc65de3-74db-4dc4-af46-84c1cd240f53 None None] The sync data for ids ['772b6758-54fa-4b9c-ba3a-7a3e806f18e0'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:44:46.126577 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad322b0f-5b32-4fcd-930d-ad49d0533d3a req-b1c0eeec-5e38-4d62-bb71-9a5167ab58b6 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:46.127815 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ad322b0f-5b32-4fcd-930d-ad49d0533d3a req-b1c0eeec-5e38-4d62-bb71-9a5167ab58b6 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/ports?device_id=abcb80c2-2def-4ce8-97ee-9085b69cbc24 HTTP/1.1" status: 200 len: 945 time: 0.2146366 Dec 09 21:44:46.242152 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ad322b0f-5b32-4fcd-930d-ad49d0533d3a req-a042ae55-a941-410d-b066-ea36dbc6f2db tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/security-groups?id=74572e25-d24b-4907-912e-b2d64df84fab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0675933 Dec 09 21:44:46.652883 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 1a71d833-9202-4bda-97f0-24289244be12 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:44:46.782927 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 1a71d833-9202-4bda-97f0-24289244be12 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:44:46.783478 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:47.108970 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d38c7c17-f09d-4df1-b749-ec45e5273d3a req-8b29303f-5d48-483f-857e-832c04db877a tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:47.121945 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d38c7c17-f09d-4df1-b749-ec45e5273d3a req-8b29303f-5d48-483f-857e-832c04db877a tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/ports?device_id=abcb80c2-2def-4ce8-97ee-9085b69cbc24 HTTP/1.1" status: 200 len: 945 time: 0.2071776 Dec 09 21:44:47.151343 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f36998cf-e161-4d54-a162-7c4520a6146f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:47.281607 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d38c7c17-f09d-4df1-b749-ec45e5273d3a req-97faf864-6624-47d7-8422-04773ec8d915 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/security-groups?id=74572e25-d24b-4907-912e-b2d64df84fab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1385586 Dec 09 21:44:47.671395 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-f36998cf-e161-4d54-a162-7c4520a6146f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Allocated IP 172.20.0.1 (010dee5f-117a-4994-8632-abedb5cbcd51/5f69fcfb-0c7f-4494-a05b-6986fda3fe04/705339a4-cd88-43b9-b36f-f5d81b802171) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:44:47.878341 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f36998cf-e161-4d54-a162-7c4520a6146f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:47.984974 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f36998cf-e161-4d54-a162-7c4520a6146f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:48.106285 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f36998cf-e161-4d54-a162-7c4520a6146f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Port': ['ID=705339a4-cd88-43b9-b36f-f5d81b802171,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:48.117738 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f36998cf-e161-4d54-a162-7c4520a6146f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Network 010dee5f-117a-4994-8632-abedb5cbcd51 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:44:48.120495 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-f36998cf-e161-4d54-a162-7c4520a6146f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:44:48.123213 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f36998cf-e161-4d54-a162-7c4520a6146f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:44:48.152267 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33d232ce-2669-4b5e-ae8c-8277129f959c req-e87aa85f-6393-4fc4-9d8e-356b3da42f3a tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:48.158258 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33d232ce-2669-4b5e-ae8c-8277129f959c req-e87aa85f-6393-4fc4-9d8e-356b3da42f3a tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.31 "GET /v2.0/ports?device_id=abcb80c2-2def-4ce8-97ee-9085b69cbc24 HTTP/1.1" status: 200 len: 945 time: 0.1017673 Dec 09 21:44:48.224569 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f36998cf-e161-4d54-a162-7c4520a6146f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:48.395357 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-33d232ce-2669-4b5e-ae8c-8277129f959c req-5ad144ca-328a-4c83-807e-72d290b524bd tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Deleting port 7c83f4b4-781d-4644-9143-55354af5127f {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:44:48.396564 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-33d232ce-2669-4b5e-ae8c-8277129f959c req-5ad144ca-328a-4c83-807e-72d290b524bd tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:48.604315 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-944ef746-8fcf-4f89-8bef-24ab80badc1b None None] Provisioning complete for port 705339a4-cd88-43b9-b36f-f5d81b802171 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:44:48.611962 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-944ef746-8fcf-4f89-8bef-24ab80badc1b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:48.690079 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-33d232ce-2669-4b5e-ae8c-8277129f959c req-5ad144ca-328a-4c83-807e-72d290b524bd tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] For port 7c83f4b4-781d-4644-9143-55354af5127f, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=7c83f4b4-781d-4644-9143-55354af5127f,segment=NetworkSegment(d364ec9b-6967-4182-93f8-71f7fcca6cba),segment_id=d364ec9b-6967-4182-93f8-71f7fcca6cba)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:44:48.690768 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-33d232ce-2669-4b5e-ae8c-8277129f959c req-5ad144ca-328a-4c83-807e-72d290b524bd tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:48.737234 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-33d232ce-2669-4b5e-ae8c-8277129f959c req-5ad144ca-328a-4c83-807e-72d290b524bd tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Calling delete_port for 7c83f4b4-781d-4644-9143-55354af5127f owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:44:48.758530 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-944ef746-8fcf-4f89-8bef-24ab80badc1b None None] Port 705339a4-cd88-43b9-b36f-f5d81b802171 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:44:48.857073 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5ce2782-aaf9-43ef-b035-cfbdb4a58c09 req-2114f5f6-3938-471d-abe5-2d5d2427fc7f tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:48.866136 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5ce2782-aaf9-43ef-b035-cfbdb4a58c09 req-2114f5f6-3938-471d-abe5-2d5d2427fc7f tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/ports?device_id=abcb80c2-2def-4ce8-97ee-9085b69cbc24 HTTP/1.1" status: 200 len: 945 time: 0.3948300 Dec 09 21:44:49.048008 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-33d232ce-2669-4b5e-ae8c-8277129f959c req-5ad144ca-328a-4c83-807e-72d290b524bd tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:49.062861 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['7c83f4b4-781d-4644-9143-55354af5127f'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:44:49.101405 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ad144ca-328a-4c83-807e-72d290b524bd tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Pushing event deleted for resources: {'Port': ['ID=7c83f4b4-781d-4644-9143-55354af5127f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:49.230777 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-33d232ce-2669-4b5e-ae8c-8277129f959c req-5ad144ca-328a-4c83-807e-72d290b524bd tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] No DVR routers for this DVR port 7c83f4b4-781d-4644-9143-55354af5127f on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:44:49.237894 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-33d232ce-2669-4b5e-ae8c-8277129f959c req-5ad144ca-328a-4c83-807e-72d290b524bd tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:49.242174 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33d232ce-2669-4b5e-ae8c-8277129f959c req-5ad144ca-328a-4c83-807e-72d290b524bd tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.31 "DELETE /v2.0/ports/7c83f4b4-781d-4644-9143-55354af5127f HTTP/1.1" status: 204 len: 173 time: 1.0736656 Dec 09 21:44:49.242780 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'abcb80c2-2def-4ce8-97ee-9085b69cbc24', 'name': 'network-vif-deleted', 'tag': '7c83f4b4-781d-4644-9143-55354af5127f'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:44:49.246153 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b670a962-ca5c-4d05-88d2-f35d37e1398b" -d '{"events": [{"server_uuid": "abcb80c2-2def-4ce8-97ee-9085b69cbc24", "name": "network-vif-deleted", "tag": "7c83f4b4-781d-4644-9143-55354af5127f"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:44:49.970137 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5ce2782-aaf9-43ef-b035-cfbdb4a58c09 req-876dd607-ec6f-4b54-9a48-f057f5465ff1 tempest-ServersNegativeTestMultiTenantJSON-56259274 tempest-ServersNegativeTestMultiTenantJSON-56259274-project] 10.222.0.13 "GET /v2.0/security-groups?id=74572e25-d24b-4907-912e-b2d64df84fab&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.1030083 Dec 09 21:44:49.972069 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f36998cf-e161-4d54-a162-7c4520a6146f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:50.104937 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:44:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-838a6a98-c9ec-4637-a9d3-af91f9273105 x-openstack-request-id: req-838a6a98-c9ec-4637-a9d3-af91f9273105 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:44:50.105434 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "abcb80c2-2def-4ce8-97ee-9085b69cbc24", "name": "network-vif-deleted", "tag": "7c83f4b4-781d-4644-9143-55354af5127f", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:44:50.106575 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-838a6a98-c9ec-4637-a9d3-af91f9273105 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:44:50.107630 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'abcb80c2-2def-4ce8-97ee-9085b69cbc24', 'name': 'network-vif-deleted', 'tag': '7c83f4b4-781d-4644-9143-55354af5127f', 'status': 'completed', 'code': 200} Dec 09 21:44:50.431348 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f36998cf-e161-4d54-a162-7c4520a6146f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:50.469641 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f36998cf-e161-4d54-a162-7c4520a6146f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:50.611338 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f36998cf-e161-4d54-a162-7c4520a6146f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Port': ['ID=705339a4-cd88-43b9-b36f-f5d81b802171,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:50.643735 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f36998cf-e161-4d54-a162-7c4520a6146f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:50.835959 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f36998cf-e161-4d54-a162-7c4520a6146f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Network 010dee5f-117a-4994-8632-abedb5cbcd51 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:44:50.837539 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-f36998cf-e161-4d54-a162-7c4520a6146f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:44:51.036729 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f36998cf-e161-4d54-a162-7c4520a6146f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Router 772b6758-54fa-4b9c-ba3a-7a3e806f18e0 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:44:51.092840 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40090) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:51.201735 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-4885ecbe-c9b5-4af8-a927-7e457eb21cc9 admin admin] Deleting subnet b8ac0081-5147-4cda-bfb1-7a949d33002a {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:44:51.206719 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4885ecbe-c9b5-4af8-a927-7e457eb21cc9 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:51.298764 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4885ecbe-c9b5-4af8-a927-7e457eb21cc9 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:51.308351 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9eac2622-3acc-44aa-8ba5-d3ffcaef3b4a None None] Provisioning complete for port 705339a4-cd88-43b9-b36f-f5d81b802171 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:44:51.312380 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9eac2622-3acc-44aa-8ba5-d3ffcaef3b4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:51.317058 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f36998cf-e161-4d54-a162-7c4520a6146f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:44:51.323286 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f36998cf-e161-4d54-a162-7c4520a6146f tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "PUT /v2.0/routers/772b6758-54fa-4b9c-ba3a-7a3e806f18e0/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.4887516 Dec 09 21:44:51.325904 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40096) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:51.333985 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9c83e30-edc8-46ba-bd79-5494195aa5df None None] Sync routers for ids ['772b6758-54fa-4b9c-ba3a-7a3e806f18e0'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:44:51.343701 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-4ee875b0-7515-43c1-9cd4-299af6965fa3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Request body: {'port': {'network_id': '010dee5f-117a-4994-8632-abedb5cbcd51', 'name': 'tempest-FloatingIPTestJSON-1568476883'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:51.351463 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9c83e30-edc8-46ba-bd79-5494195aa5df None None] Routers {'772b6758-54fa-4b9c-ba3a-7a3e806f18e0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:51.353561 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d9c83e30-edc8-46ba-bd79-5494195aa5df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['772b6758-54fa-4b9c-ba3a-7a3e806f18e0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:51.376100 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9eac2622-3acc-44aa-8ba5-d3ffcaef3b4a None None] Port 705339a4-cd88-43b9-b36f-f5d81b802171 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:44:51.393292 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4885ecbe-c9b5-4af8-a927-7e457eb21cc9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:51.466034 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d9c83e30-edc8-46ba-bd79-5494195aa5df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:51.476704 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9c83e30-edc8-46ba-bd79-5494195aa5df None None] Routers {'772b6758-54fa-4b9c-ba3a-7a3e806f18e0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:51.477584 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d9c83e30-edc8-46ba-bd79-5494195aa5df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['772b6758-54fa-4b9c-ba3a-7a3e806f18e0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:51.514422 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d9c83e30-edc8-46ba-bd79-5494195aa5df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:51.515696 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9c83e30-edc8-46ba-bd79-5494195aa5df None None] The sync data for ids ['772b6758-54fa-4b9c-ba3a-7a3e806f18e0'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:44:51.538858 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4885ecbe-c9b5-4af8-a927-7e457eb21cc9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:51.599558 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4885ecbe-c9b5-4af8-a927-7e457eb21cc9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b8ac0081-5147-4cda-bfb1-7a949d33002a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:51.612591 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4885ecbe-c9b5-4af8-a927-7e457eb21cc9 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:51.616331 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4885ecbe-c9b5-4af8-a927-7e457eb21cc9 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/b8ac0081-5147-4cda-bfb1-7a949d33002a HTTP/1.1" status: 204 len: 168 time: 0.5216808 Dec 09 21:44:51.619159 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40102) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:51.656395 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4ee875b0-7515-43c1-9cd4-299af6965fa3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Made reservation on behalf of 1752f69b83904328a79fb89f35377bcf for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:44:51.660537 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4ee875b0-7515-43c1-9cd4-299af6965fa3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:51.733802 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-4ee875b0-7515-43c1-9cd4-299af6965fa3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] device_id is not set on port 48373db5-a424-4404-b2ae-8b7d1f5e5823 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:44:51.751319 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3113bc8c-d519-4e25-bc0e-83f21b24d479 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:51.947557 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3113bc8c-d519-4e25-bc0e-83f21b24d479 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:51.984146 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-3113bc8c-d519-4e25-bc0e-83f21b24d479 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d38aa8a0-2dbc-451b-aa05-cb6c6c804975']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:51.994235 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-4ee875b0-7515-43c1-9cd4-299af6965fa3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Allocated IP 172.20.0.3 (010dee5f-117a-4994-8632-abedb5cbcd51/5f69fcfb-0c7f-4494-a05b-6986fda3fe04/48373db5-a424-4404-b2ae-8b7d1f5e5823) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:44:52.003139 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-3113bc8c-d519-4e25-bc0e-83f21b24d479 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd364ec9b-6967-4182-93f8-71f7fcca6cba') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:52.003615 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-3113bc8c-d519-4e25-bc0e-83f21b24d479 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd364ec9b-6967-4182-93f8-71f7fcca6cba') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:52.020450 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3113bc8c-d519-4e25-bc0e-83f21b24d479 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:52.047671 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3113bc8c-d519-4e25-bc0e-83f21b24d479 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:52.063931 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3113bc8c-d519-4e25-bc0e-83f21b24d479 admin admin] Releasing vlan 100 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:44:52.064456 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3113bc8c-d519-4e25-bc0e-83f21b24d479 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:44:52.066469 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:44:52.081750 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 7c83f4b4-781d-4644-9143-55354af5127f no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:44:52.128434 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 7c83f4b4-781d-4644-9143-55354af5127f {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:44:52.129049 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 7c83f4b4-781d-4644-9143-55354af5127f not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:44:52.210775 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3113bc8c-d519-4e25-bc0e-83f21b24d479 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:52.255542 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3113bc8c-d519-4e25-bc0e-83f21b24d479 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:52.259849 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3113bc8c-d519-4e25-bc0e-83f21b24d479 admin admin] 10.222.0.13 "DELETE /v2.0/networks/d38aa8a0-2dbc-451b-aa05-cb6c6c804975 HTTP/1.1" status: 204 len: 168 time: 0.6395392 Dec 09 21:44:52.262563 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40112) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:52.279335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3113bc8c-d519-4e25-bc0e-83f21b24d479 admin admin] Pushing event deleted for resources: {'Network': ['ID=d38aa8a0-2dbc-451b-aa05-cb6c6c804975,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:52.394828 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-35ce91e3-6200-46f4-bac3-c72fca85b4ef admin admin] Deleting subnet 5818223e-c44a-497d-807e-7ef3225ef071 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:44:52.408152 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4ee875b0-7515-43c1-9cd4-299af6965fa3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:52.409981 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-35ce91e3-6200-46f4-bac3-c72fca85b4ef admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:52.491194 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-35ce91e3-6200-46f4-bac3-c72fca85b4ef admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:52.491781 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4ee875b0-7515-43c1-9cd4-299af6965fa3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:52.573186 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4ee875b0-7515-43c1-9cd4-299af6965fa3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Network 010dee5f-117a-4994-8632-abedb5cbcd51 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:44:52.586297 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-4ee875b0-7515-43c1-9cd4-299af6965fa3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:44:52.597812 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ee875b0-7515-43c1-9cd4-299af6965fa3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:44:52.622235 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-35ce91e3-6200-46f4-bac3-c72fca85b4ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:52.702331 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ee875b0-7515-43c1-9cd4-299af6965fa3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event updated for resources: {'Port': ['ID=48373db5-a424-4404-b2ae-8b7d1f5e5823,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:52.752159 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4ee875b0-7515-43c1-9cd4-299af6965fa3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:44:52.753059 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4ee875b0-7515-43c1-9cd4-299af6965fa3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:52.766706 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-35ce91e3-6200-46f4-bac3-c72fca85b4ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:52.794988 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4ee875b0-7515-43c1-9cd4-299af6965fa3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.4679160 Dec 09 21:44:52.797652 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40118) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:52.802766 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-563dfc67-8223-4e73-b1e3-eda1371b0a06 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Request body: {'floatingip': {'port_id': '48373db5-a424-4404-b2ae-8b7d1f5e5823'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:44:52.898756 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-35ce91e3-6200-46f4-bac3-c72fca85b4ef admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:52.916923 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-35ce91e3-6200-46f4-bac3-c72fca85b4ef admin admin] 10.222.0.13 "DELETE /v2.0/subnets/5818223e-c44a-497d-807e-7ef3225ef071 HTTP/1.1" status: 204 len: 168 time: 0.6531317 Dec 09 21:44:52.922023 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40122) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:52.926555 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35ce91e3-6200-46f4-bac3-c72fca85b4ef admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5818223e-c44a-497d-807e-7ef3225ef071,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:52.942252 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-563dfc67-8223-4e73-b1e3-eda1371b0a06 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:53.062071 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e911193-d1da-4dc6-b90c-98d601af0b18 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:53.147510 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-99aecad0-8c98-4346-8e59-4d9a0baeae6a None None] Provisioning complete for port 48373db5-a424-4404-b2ae-8b7d1f5e5823 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:44:53.148827 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-99aecad0-8c98-4346-8e59-4d9a0baeae6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:53.167488 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e911193-d1da-4dc6-b90c-98d601af0b18 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:53.194316 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-1e911193-d1da-4dc6-b90c-98d601af0b18 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['beba28bb-7226-441d-89aa-c9e26ebecdb5']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:53.210018 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-1e911193-d1da-4dc6-b90c-98d601af0b18 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1b86fbea-536a-478d-9fc0-c1b05f08f17b') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:53.210420 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-1e911193-d1da-4dc6-b90c-98d601af0b18 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1b86fbea-536a-478d-9fc0-c1b05f08f17b') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:53.223028 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e911193-d1da-4dc6-b90c-98d601af0b18 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:53.238806 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e911193-d1da-4dc6-b90c-98d601af0b18 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:53.248523 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1e911193-d1da-4dc6-b90c-98d601af0b18 admin admin] Releasing vlan 106 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:44:53.249081 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e911193-d1da-4dc6-b90c-98d601af0b18 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:53.269989 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-99aecad0-8c98-4346-8e59-4d9a0baeae6a None None] Port 48373db5-a424-4404-b2ae-8b7d1f5e5823 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:44:53.343906 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:44:53.352622 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e911193-d1da-4dc6-b90c-98d601af0b18 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:53.386611 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e911193-d1da-4dc6-b90c-98d601af0b18 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:53.399110 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1e911193-d1da-4dc6-b90c-98d601af0b18 admin admin] 10.222.0.13 "DELETE /v2.0/networks/beba28bb-7226-441d-89aa-c9e26ebecdb5 HTTP/1.1" status: 204 len: 168 time: 0.4757497 Dec 09 21:44:53.401580 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e911193-d1da-4dc6-b90c-98d601af0b18 admin admin] Pushing event deleted for resources: {'Network': ['ID=beba28bb-7226-441d-89aa-c9e26ebecdb5,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:53.681024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40132) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:53.760799 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-396077a8-50ca-4e68-9e7f-08c8965f1fe6 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=3f88fb9ec7754b72af333e0e54226607&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0782688 Dec 09 21:44:53.763076 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40134) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:53.991899 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-563dfc67-8223-4e73-b1e3-eda1371b0a06 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:54.020161 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-563dfc67-8223-4e73-b1e3-eda1371b0a06 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:54.121912 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-649ce46a-5bf9-48ed-90fd-f5f5144f224c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:54.275545 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-649ce46a-5bf9-48ed-90fd-f5f5144f224c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:54.288300 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-563dfc67-8223-4e73-b1e3-eda1371b0a06 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Floating IP 5c477e5d-9f23-49d8-8d90-531e60407f0a associated. External IP: 172.25.3.121, port: 97adad29-d668-4e98-9fb3-f98121e998ee. Dec 09 21:44:54.573262 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-649ce46a-5bf9-48ed-90fd-f5f5144f224c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:54.575997 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-649ce46a-5bf9-48ed-90fd-f5f5144f224c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:54.577346 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-649ce46a-5bf9-48ed-90fd-f5f5144f224c admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/74572e25-d24b-4907-912e-b2d64df84fab HTTP/1.1" status: 204 len: 168 time: 0.8132694 Dec 09 21:44:54.592682 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-649ce46a-5bf9-48ed-90fd-f5f5144f224c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=74572e25-d24b-4907-912e-b2d64df84fab,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:54.773698 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-4b1b857e-d575-4fde-bb63-02faf9d7ceb8 req-2e692b47-3760-4370-9a1a-d4a62ee7473a service neutron] (103437) timed out ('10.222.0.31', 57399) {{(pid=103437) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 09 21:44:55.065527 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-563dfc67-8223-4e73-b1e3-eda1371b0a06 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Router 3054de87-ea87-42d0-ac7b-818bc1f8e2c8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:44:55.194087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-563dfc67-8223-4e73-b1e3-eda1371b0a06 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:44:55.206542 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b089eea0-24ee-448e-bc54-a745d61e9008 None None] Sync routers for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:44:55.222312 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b089eea0-24ee-448e-bc54-a745d61e9008 None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:55.222749 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b089eea0-24ee-448e-bc54-a745d61e9008 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:55.258807 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b089eea0-24ee-448e-bc54-a745d61e9008 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:55.269974 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b089eea0-24ee-448e-bc54-a745d61e9008 None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:55.271041 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b089eea0-24ee-448e-bc54-a745d61e9008 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:55.338020 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40150) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:55.422706 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b089eea0-24ee-448e-bc54-a745d61e9008 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:55.424716 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b089eea0-24ee-448e-bc54-a745d61e9008 None None] The sync data for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:44:55.476457 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8a6876b1-d965-40f8-af2e-b315c8100261 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=94c37a1d669e4c92bdb0ac14b477c8eb&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1472483 Dec 09 21:44:55.489932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40158) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:55.591111 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-563dfc67-8223-4e73-b1e3-eda1371b0a06 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Router 772b6758-54fa-4b9c-ba3a-7a3e806f18e0 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:44:55.591791 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d83d4cf6-f313-4718-9227-361414437ba2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:55.644694 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d83d4cf6-f313-4718-9227-361414437ba2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:55.732445 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d83d4cf6-f313-4718-9227-361414437ba2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:55.739080 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d83d4cf6-f313-4718-9227-361414437ba2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:55.743135 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d83d4cf6-f313-4718-9227-361414437ba2 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/adcf2b3a-9f2f-407e-a54b-94ae10d4d39a HTTP/1.1" status: 204 len: 168 time: 0.2518654 Dec 09 21:44:55.764155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d83d4cf6-f313-4718-9227-361414437ba2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=adcf2b3a-9f2f-407e-a54b-94ae10d4d39a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:55.781437 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-563dfc67-8223-4e73-b1e3-eda1371b0a06 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:44:55.811960 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fcd66ad6-ad4d-4e21-8cd3-15fff788703e None None] Sync routers for ids ['772b6758-54fa-4b9c-ba3a-7a3e806f18e0'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:44:55.813461 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-563dfc67-8223-4e73-b1e3-eda1371b0a06 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:55.841769 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fcd66ad6-ad4d-4e21-8cd3-15fff788703e None None] Routers {'772b6758-54fa-4b9c-ba3a-7a3e806f18e0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:55.844406 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-fcd66ad6-ad4d-4e21-8cd3-15fff788703e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['772b6758-54fa-4b9c-ba3a-7a3e806f18e0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:55.909962 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-563dfc67-8223-4e73-b1e3-eda1371b0a06 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "PUT /v2.0/floatingips/5c477e5d-9f23-49d8-8d90-531e60407f0a HTTP/1.1" status: 200 len: 978 time: 3.1086304 Dec 09 21:44:55.910509 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40162) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:55.945164 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-fcd66ad6-ad4d-4e21-8cd3-15fff788703e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:55.981831 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fcd66ad6-ad4d-4e21-8cd3-15fff788703e None None] Routers {'772b6758-54fa-4b9c-ba3a-7a3e806f18e0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:55.984504 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-fcd66ad6-ad4d-4e21-8cd3-15fff788703e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['772b6758-54fa-4b9c-ba3a-7a3e806f18e0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:56.084557 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-fcd66ad6-ad4d-4e21-8cd3-15fff788703e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:56.085466 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fcd66ad6-ad4d-4e21-8cd3-15fff788703e None None] The sync data for ids ['772b6758-54fa-4b9c-ba3a-7a3e806f18e0'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:44:56.118323 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c86fb76a-6ca6-42b2-9aca-f89f2c2dff56 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Deleting port 48373db5-a424-4404-b2ae-8b7d1f5e5823 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:44:56.118990 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c86fb76a-6ca6-42b2-9aca-f89f2c2dff56 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:56.285041 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c86fb76a-6ca6-42b2-9aca-f89f2c2dff56 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:56.688145 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c86fb76a-6ca6-42b2-9aca-f89f2c2dff56 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:56.688610 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c86fb76a-6ca6-42b2-9aca-f89f2c2dff56 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:56.688940 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-c86fb76a-6ca6-42b2-9aca-f89f2c2dff56 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Floating IP 5c477e5d-9f23-49d8-8d90-531e60407f0a disassociated. External IP: 172.25.3.121, port: 48373db5-a424-4404-b2ae-8b7d1f5e5823. Dec 09 21:44:56.689294 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c86fb76a-6ca6-42b2-9aca-f89f2c2dff56 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Calling delete_port for 48373db5-a424-4404-b2ae-8b7d1f5e5823 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:44:57.015967 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c86fb76a-6ca6-42b2-9aca-f89f2c2dff56 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:57.105251 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c86fb76a-6ca6-42b2-9aca-f89f2c2dff56 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event deleted for resources: {'Port': ['ID=48373db5-a424-4404-b2ae-8b7d1f5e5823,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:57.128169 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40194) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:57.284887 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:57.378333 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:57.484390 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c86fb76a-6ca6-42b2-9aca-f89f2c2dff56 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Router 772b6758-54fa-4b9c-ba3a-7a3e806f18e0 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:44:57.539173 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-637bb1fc-4c96-4749-b768-30bde62b077d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:57.737782 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c86fb76a-6ca6-42b2-9aca-f89f2c2dff56 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:44:57.749400 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b91d0b2-f5db-4b0f-89d1-28c5b6bd7d96 None None] Sync routers for ids ['772b6758-54fa-4b9c-ba3a-7a3e806f18e0'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:44:57.770996 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-637bb1fc-4c96-4749-b768-30bde62b077d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:57.781879 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-637bb1fc-4c96-4749-b768-30bde62b077d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:57.789414 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b91d0b2-f5db-4b0f-89d1-28c5b6bd7d96 None None] Routers {'772b6758-54fa-4b9c-ba3a-7a3e806f18e0'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:57.798012 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6b91d0b2-f5db-4b0f-89d1-28c5b6bd7d96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['772b6758-54fa-4b9c-ba3a-7a3e806f18e0'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:57.866146 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-637bb1fc-4c96-4749-b768-30bde62b077d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aa379777-f5ee-4d42-a376-3b0a2d97163f,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:57.883960 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c86fb76a-6ca6-42b2-9aca-f89f2c2dff56 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:57.895596 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c86fb76a-6ca6-42b2-9aca-f89f2c2dff56 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "DELETE /v2.0/ports/48373db5-a424-4404-b2ae-8b7d1f5e5823 HTTP/1.1" status: 204 len: 168 time: 1.9832027 Dec 09 21:44:57.896600 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40232) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:57.933598 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6b91d0b2-f5db-4b0f-89d1-28c5b6bd7d96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:57.976511 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-637bb1fc-4c96-4749-b768-30bde62b077d admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=bbb98e55df464151841f4b9860684ae9&name=default HTTP/1.1" status: 200 len: 3000 time: 0.8367312 Dec 09 21:44:57.980839 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40234) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:44:57.992978 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b91d0b2-f5db-4b0f-89d1-28c5b6bd7d96 None None] Routers {'772b6758-54fa-4b9c-ba3a-7a3e806f18e0'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:44:58.010418 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6b91d0b2-f5db-4b0f-89d1-28c5b6bd7d96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['772b6758-54fa-4b9c-ba3a-7a3e806f18e0'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:58.108250 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6b91d0b2-f5db-4b0f-89d1-28c5b6bd7d96 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:44:58.111640 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b91d0b2-f5db-4b0f-89d1-28c5b6bd7d96 None None] The sync data for ids ['772b6758-54fa-4b9c-ba3a-7a3e806f18e0'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:44:58.125791 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fcb3801e-2669-4371-bca4-2b76ebb81a3e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:58.152583 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fcb3801e-2669-4371-bca4-2b76ebb81a3e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:58.222418 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fcb3801e-2669-4371-bca4-2b76ebb81a3e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:58.225869 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fcb3801e-2669-4371-bca4-2b76ebb81a3e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:58.228742 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fcb3801e-2669-4371-bca4-2b76ebb81a3e admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/aa379777-f5ee-4d42-a376-3b0a2d97163f HTTP/1.1" status: 204 len: 168 time: 0.2404304 Dec 09 21:44:58.247591 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcb3801e-2669-4371-bca4-2b76ebb81a3e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa379777-f5ee-4d42-a376-3b0a2d97163f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:44:58.517008 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa5002b8-43da-4525-96b5-699fdaa5186e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:58.915209 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-aa5002b8-43da-4525-96b5-699fdaa5186e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Deleting port 705339a4-cd88-43b9-b36f-f5d81b802171 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:44:58.916963 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa5002b8-43da-4525-96b5-699fdaa5186e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:59.089461 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:44:59.104398 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa5002b8-43da-4525-96b5-699fdaa5186e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:59.125449 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-aa5002b8-43da-4525-96b5-699fdaa5186e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Calling delete_port for 705339a4-cd88-43b9-b36f-f5d81b802171 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:44:59.352589 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa5002b8-43da-4525-96b5-699fdaa5186e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:44:59.397639 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa5002b8-43da-4525-96b5-699fdaa5186e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event deleted for resources: {'Port': ['ID=705339a4-cd88-43b9-b36f-f5d81b802171,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:00.215887 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa5002b8-43da-4525-96b5-699fdaa5186e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:00.350005 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40340) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:00.486049 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aa5002b8-43da-4525-96b5-699fdaa5186e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Router 772b6758-54fa-4b9c-ba3a-7a3e806f18e0 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:45:00.608302 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aa5002b8-43da-4525-96b5-699fdaa5186e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:45:00.614908 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-aa5002b8-43da-4525-96b5-699fdaa5186e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "PUT /v2.0/routers/772b6758-54fa-4b9c-ba3a-7a3e806f18e0/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7159879 Dec 09 21:45:00.617504 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40354) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:00.623657 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94048d9c-0f1d-4fef-a5a0-471c26e35e72 None None] Sync routers for ids ['772b6758-54fa-4b9c-ba3a-7a3e806f18e0'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:45:00.640789 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94048d9c-0f1d-4fef-a5a0-471c26e35e72 None None] Routers {'772b6758-54fa-4b9c-ba3a-7a3e806f18e0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:45:00.641722 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-94048d9c-0f1d-4fef-a5a0-471c26e35e72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['772b6758-54fa-4b9c-ba3a-7a3e806f18e0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:00.694144 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-94048d9c-0f1d-4fef-a5a0-471c26e35e72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:00.707411 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94048d9c-0f1d-4fef-a5a0-471c26e35e72 None None] Routers {'772b6758-54fa-4b9c-ba3a-7a3e806f18e0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:45:00.708455 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-94048d9c-0f1d-4fef-a5a0-471c26e35e72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:44:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['772b6758-54fa-4b9c-ba3a-7a3e806f18e0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:00.758420 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-94048d9c-0f1d-4fef-a5a0-471c26e35e72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:00.759355 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94048d9c-0f1d-4fef-a5a0-471c26e35e72 None None] The sync data for ids ['772b6758-54fa-4b9c-ba3a-7a3e806f18e0'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:45:00.770151 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5b4e6c2a-1cd8-43a2-bd6f-3b74e2c62ae8 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:00.898924 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5b4e6c2a-1cd8-43a2-bd6f-3b74e2c62ae8 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:00.903634 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5aef75fe-b94b-4ca0-b8fd-909ed086df0a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:01.033869 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-5b4e6c2a-1cd8-43a2-bd6f-3b74e2c62ae8 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Deleting port 59124e2a-9cdf-4ab6-8434-595c9e52edcb {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:45:01.034243 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5b4e6c2a-1cd8-43a2-bd6f-3b74e2c62ae8 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:01.114586 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5aef75fe-b94b-4ca0-b8fd-909ed086df0a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:01.128477 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5aef75fe-b94b-4ca0-b8fd-909ed086df0a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:01.167399 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5b4e6c2a-1cd8-43a2-bd6f-3b74e2c62ae8 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:01.202150 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-5b4e6c2a-1cd8-43a2-bd6f-3b74e2c62ae8 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Calling delete_port for 59124e2a-9cdf-4ab6-8434-595c9e52edcb owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:45:01.209455 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5aef75fe-b94b-4ca0-b8fd-909ed086df0a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=67521661bf4c46e999fd5cd1d62773c2&name=default HTTP/1.1" status: 200 len: 3000 time: 0.8574672 Dec 09 21:45:01.212799 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40378) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:01.218718 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5aef75fe-b94b-4ca0-b8fd-909ed086df0a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a2b47446-d400-4596-ad8c-f17e80fc85e5,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:01.319105 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-40284f65-0a18-4d4b-853f-4cb998145af3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:01.369959 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-40284f65-0a18-4d4b-853f-4cb998145af3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:01.444335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40404) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:01.450824 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-95dd70ab-02f5-492b-ba32-e00849ad766b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-816323364', 'description': 'tempest-secgroup-smoke-816323364 description', 'project_id': 'dce7594ac2a74901912a2f19de04bf79'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:01.477425 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-40284f65-0a18-4d4b-853f-4cb998145af3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:01.479041 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5b4e6c2a-1cd8-43a2-bd6f-3b74e2c62ae8 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:01.480475 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-40284f65-0a18-4d4b-853f-4cb998145af3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:01.484154 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-40284f65-0a18-4d4b-853f-4cb998145af3 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/a2b47446-d400-4596-ad8c-f17e80fc85e5 HTTP/1.1" status: 204 len: 168 time: 0.2675867 Dec 09 21:45:01.510882 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-95dd70ab-02f5-492b-ba32-e00849ad766b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:01.518006 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40284f65-0a18-4d4b-853f-4cb998145af3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a2b47446-d400-4596-ad8c-f17e80fc85e5,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:01.521617 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b4e6c2a-1cd8-43a2-bd6f-3b74e2c62ae8 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event deleted for resources: {'Port': ['ID=59124e2a-9cdf-4ab6-8434-595c9e52edcb,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:01.526141 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-95dd70ab-02f5-492b-ba32-e00849ad766b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:01.537769 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b4b64f2-3aad-455b-b354-4d7e29330b93 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:45:01.687814 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5b4e6c2a-1cd8-43a2-bd6f-3b74e2c62ae8 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:01.813980 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5b4e6c2a-1cd8-43a2-bd6f-3b74e2c62ae8 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:01.817266 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5b4e6c2a-1cd8-43a2-bd6f-3b74e2c62ae8 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:01.890753 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-95dd70ab-02f5-492b-ba32-e00849ad766b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:01.893168 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5b4e6c2a-1cd8-43a2-bd6f-3b74e2c62ae8 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:01.893889 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5b4e6c2a-1cd8-43a2-bd6f-3b74e2c62ae8 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Fanout notify agent at l3_agent the message router_deleted on router 772b6758-54fa-4b9c-ba3a-7a3e806f18e0 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:45:01.902797 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5b4e6c2a-1cd8-43a2-bd6f-3b74e2c62ae8 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:01.907003 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5b4e6c2a-1cd8-43a2-bd6f-3b74e2c62ae8 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "DELETE /v2.0/routers/772b6758-54fa-4b9c-ba3a-7a3e806f18e0 HTTP/1.1" status: 204 len: 168 time: 1.2846897 Dec 09 21:45:01.907286 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40420) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:01.916829 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-95dd70ab-02f5-492b-ba32-e00849ad766b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:01.925114 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40422) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:01.964820 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-12773703-b95b-40d9-9cca-74b2318fc527 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:01.978411 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-5bde38fa-a8f4-491a-b21d-f3d1986d872e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Deleting subnet 5f69fcfb-0c7f-4494-a05b-6986fda3fe04 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:45:01.983758 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5bde38fa-a8f4-491a-b21d-f3d1986d872e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.038853 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5bde38fa-a8f4-491a-b21d-f3d1986d872e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.045995 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95dd70ab-02f5-492b-ba32-e00849ad766b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0637a134-8109-472c-a5e7-d4a5a860b96c,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:02.067327 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-12773703-b95b-40d9-9cca-74b2318fc527 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.078246 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-12773703-b95b-40d9-9cca-74b2318fc527 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.135913 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-95dd70ab-02f5-492b-ba32-e00849ad766b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.143145 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-12773703-b95b-40d9-9cca-74b2318fc527 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=a415ba8eca7e49fc946aa48bdc8c3e19&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2143626 Dec 09 21:45:02.144176 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12773703-b95b-40d9-9cca-74b2318fc527 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8d3da5a8-3f52-466f-92f6-7d3a71f216c3,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:02.146930 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40424) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:02.155110 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-95dd70ab-02f5-492b-ba32-e00849ad766b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.183343 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5bde38fa-a8f4-491a-b21d-f3d1986d872e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.190344 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95dd70ab-02f5-492b-ba32-e00849ad766b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f44a1e28-df99-474a-b80e-b3989956be0c,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:02.217966 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-95dd70ab-02f5-492b-ba32-e00849ad766b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.219366 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-95dd70ab-02f5-492b-ba32-e00849ad766b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.7739670 Dec 09 21:45:02.222327 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40426) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:02.229210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-ac031577-b46e-4333-bc6c-a67f3798e8af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group_rule': {'security_group_id': 'f44a1e28-df99-474a-b80e-b3989956be0c', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:02.262990 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-54f80b44-d219-411b-a06c-5f1bbd5e5ba6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.281826 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5bde38fa-a8f4-491a-b21d-f3d1986d872e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.302653 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ac031577-b46e-4333-bc6c-a67f3798e8af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.317159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bde38fa-a8f4-491a-b21d-f3d1986d872e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event deleted for resources: {'Subnet': ['ID=5f69fcfb-0c7f-4494-a05b-6986fda3fe04,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:02.335235 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e0105c9-59b9-4395-bc29-a56124ddb028 None None] Network 010dee5f-117a-4994-8632-abedb5cbcd51 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:45:02.335497 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5bde38fa-a8f4-491a-b21d-f3d1986d872e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.341495 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5bde38fa-a8f4-491a-b21d-f3d1986d872e tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "DELETE /v2.0/subnets/5f69fcfb-0c7f-4494-a05b-6986fda3fe04 HTTP/1.1" status: 204 len: 168 time: 0.4307683 Dec 09 21:45:02.341655 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-54f80b44-d219-411b-a06c-5f1bbd5e5ba6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.342226 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40428) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:02.386221 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ac031577-b46e-4333-bc6c-a67f3798e8af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.397715 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ac031577-b46e-4333-bc6c-a67f3798e8af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.432804 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac031577-b46e-4333-bc6c-a67f3798e8af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d596008d-2198-4d10-aaf5-6393fe38220c,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:02.453809 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ac031577-b46e-4333-bc6c-a67f3798e8af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.454738 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5dda506f-c397-4fa5-aabf-c5f1e9889413 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.459553 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ac031577-b46e-4333-bc6c-a67f3798e8af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2360401 Dec 09 21:45:02.460513 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40430) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:02.468106 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-989a6d7f-f531-4178-9d2e-832b4c25e688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group_rule': {'security_group_id': 'f44a1e28-df99-474a-b80e-b3989956be0c', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:02.469550 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-54f80b44-d219-411b-a06c-5f1bbd5e5ba6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.472372 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-54f80b44-d219-411b-a06c-5f1bbd5e5ba6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.475865 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-54f80b44-d219-411b-a06c-5f1bbd5e5ba6 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/8d3da5a8-3f52-466f-92f6-7d3a71f216c3 HTTP/1.1" status: 204 len: 168 time: 0.3257310 Dec 09 21:45:02.486413 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54f80b44-d219-411b-a06c-5f1bbd5e5ba6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d3da5a8-3f52-466f-92f6-7d3a71f216c3,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:02.554584 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-989a6d7f-f531-4178-9d2e-832b4c25e688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.587489 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-5dda506f-c397-4fa5-aabf-c5f1e9889413 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Deleting port 1a71d833-9202-4bda-97f0-24289244be12 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:45:02.588294 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5dda506f-c397-4fa5-aabf-c5f1e9889413 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.677897 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-5dda506f-c397-4fa5-aabf-c5f1e9889413 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] For port 1a71d833-9202-4bda-97f0-24289244be12, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=1a71d833-9202-4bda-97f0-24289244be12,segment=NetworkSegment(521a017d-c38d-41ad-9074-205124569e58),segment_id=521a017d-c38d-41ad-9074-205124569e58)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:02.679866 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5dda506f-c397-4fa5-aabf-c5f1e9889413 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.708228 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-5dda506f-c397-4fa5-aabf-c5f1e9889413 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Calling delete_port for 1a71d833-9202-4bda-97f0-24289244be12 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:45:02.742595 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-989a6d7f-f531-4178-9d2e-832b4c25e688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.773983 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-989a6d7f-f531-4178-9d2e-832b4c25e688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.807805 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-989a6d7f-f531-4178-9d2e-832b4c25e688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=91541924-4b68-498c-9c48-df8bb64e6478,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:02.826189 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-989a6d7f-f531-4178-9d2e-832b4c25e688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.827448 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-989a6d7f-f531-4178-9d2e-832b4c25e688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3632102 Dec 09 21:45:02.830476 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989a6d7f-f531-4178-9d2e-832b4c25e688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:02.831070 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989a6d7f-f531-4178-9d2e-832b4c25e688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:02.831451 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989a6d7f-f531-4178-9d2e-832b4c25e688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:02.831823 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989a6d7f-f531-4178-9d2e-832b4c25e688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:02.832169 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989a6d7f-f531-4178-9d2e-832b4c25e688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:02.832512 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989a6d7f-f531-4178-9d2e-832b4c25e688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:02.832976 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989a6d7f-f531-4178-9d2e-832b4c25e688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:02.833527 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989a6d7f-f531-4178-9d2e-832b4c25e688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:02.834046 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989a6d7f-f531-4178-9d2e-832b4c25e688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:02.834700 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989a6d7f-f531-4178-9d2e-832b4c25e688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:02.835220 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989a6d7f-f531-4178-9d2e-832b4c25e688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:02.835766 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989a6d7f-f531-4178-9d2e-832b4c25e688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:02.836613 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989a6d7f-f531-4178-9d2e-832b4c25e688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:02.839080 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40438) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:02.852872 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-388715af-a814-486c-a308-4c153ef979b6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group_rule': {'security_group_id': 'f44a1e28-df99-474a-b80e-b3989956be0c', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:02.870129 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5dda506f-c397-4fa5-aabf-c5f1e9889413 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.899335 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-388715af-a814-486c-a308-4c153ef979b6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:02.931238 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5dda506f-c397-4fa5-aabf-c5f1e9889413 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] No DVR routers for this DVR port 1a71d833-9202-4bda-97f0-24289244be12 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:45:02.936264 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dda506f-c397-4fa5-aabf-c5f1e9889413 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event deleted for resources: {'Port': ['ID=1a71d833-9202-4bda-97f0-24289244be12,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:02.981842 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-144292d7-b54d-4678-ae54-8b51c5aa3826 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.001444 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d333c40-1dfc-4b41-a8c9-30e7bf360155 None None] DHCP port deletion for 010dee5f-117a-4994-8632-abedb5cbcd51 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:45:03.029045 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-388715af-a814-486c-a308-4c153ef979b6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.037498 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-388715af-a814-486c-a308-4c153ef979b6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.067629 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-388715af-a814-486c-a308-4c153ef979b6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dfc3c58f-25f9-44be-bfde-9c88f5ce52b6,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:03.101685 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-388715af-a814-486c-a308-4c153ef979b6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.105877 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-388715af-a814-486c-a308-4c153ef979b6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2657282 Dec 09 21:45:03.106517 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40446) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:03.110852 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-df44f960-715e-4a8e-9a8f-a893fc2b7f51 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group_rule': {'security_group_id': 'f44a1e28-df99-474a-b80e-b3989956be0c', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:03.158904 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5dda506f-c397-4fa5-aabf-c5f1e9889413 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.162519 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-df44f960-715e-4a8e-9a8f-a893fc2b7f51 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.203720 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-5dda506f-c397-4fa5-aabf-c5f1e9889413 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['010dee5f-117a-4994-8632-abedb5cbcd51']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:03.223358 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-5dda506f-c397-4fa5-aabf-c5f1e9889413 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '521a017d-c38d-41ad-9074-205124569e58') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:03.223797 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-5dda506f-c397-4fa5-aabf-c5f1e9889413 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '521a017d-c38d-41ad-9074-205124569e58') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:03.237477 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5dda506f-c397-4fa5-aabf-c5f1e9889413 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.250408 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-df44f960-715e-4a8e-9a8f-a893fc2b7f51 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.257260 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5dda506f-c397-4fa5-aabf-c5f1e9889413 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.257533 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-df44f960-715e-4a8e-9a8f-a893fc2b7f51 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.267431 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5dda506f-c397-4fa5-aabf-c5f1e9889413 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Releasing vlan 141 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:45:03.268064 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5dda506f-c397-4fa5-aabf-c5f1e9889413 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:45:03.273053 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:45:03.277321 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df44f960-715e-4a8e-9a8f-a893fc2b7f51 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=712c01d1-ad15-4c74-a264-2c02945834e2,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:03.306722 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-df44f960-715e-4a8e-9a8f-a893fc2b7f51 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.308562 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-df44f960-715e-4a8e-9a8f-a893fc2b7f51 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2010989 Dec 09 21:45:03.311413 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40452) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:03.317347 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-265045ce-1129-4083-87f9-5b754f1bf8fc tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group_rule': {'security_group_id': 'f44a1e28-df99-474a-b80e-b3989956be0c', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:03.353386 n-d-713301-27 neutron-server[103438]: INFO neutron.db.securitygroups_db [None req-265045ce-1129-4083-87f9-5b754f1bf8fc tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Project dce7594ac2a74901912a2f19de04bf79 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 21:45:03.359979 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5dda506f-c397-4fa5-aabf-c5f1e9889413 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.367483 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-265045ce-1129-4083-87f9-5b754f1bf8fc tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.373649 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5dda506f-c397-4fa5-aabf-c5f1e9889413 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.377634 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5dda506f-c397-4fa5-aabf-c5f1e9889413 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "DELETE /v2.0/networks/010dee5f-117a-4994-8632-abedb5cbcd51 HTTP/1.1" status: 204 len: 168 time: 1.0342197 Dec 09 21:45:03.388291 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40456) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:03.399205 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dda506f-c397-4fa5-aabf-c5f1e9889413 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event deleted for resources: {'Network': ['ID=010dee5f-117a-4994-8632-abedb5cbcd51,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:03.451987 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-265045ce-1129-4083-87f9-5b754f1bf8fc tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.459200 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-265045ce-1129-4083-87f9-5b754f1bf8fc tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.483039 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-265045ce-1129-4083-87f9-5b754f1bf8fc tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=aa0afb34-1be6-4f40-a3d5-fb5b777f913c,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:03.497708 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-265045ce-1129-4083-87f9-5b754f1bf8fc tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.499768 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-265045ce-1129-4083-87f9-5b754f1bf8fc tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1872423 Dec 09 21:45:03.502812 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40462) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:03.511538 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-36449cae-fe11-44fb-b190-8c3768ac0902 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group_rule': {'security_group_id': 'f44a1e28-df99-474a-b80e-b3989956be0c', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:03.539965 n-d-713301-27 neutron-server[103438]: INFO neutron.db.securitygroups_db [None req-36449cae-fe11-44fb-b190-8c3768ac0902 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Project dce7594ac2a74901912a2f19de04bf79 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 21:45:03.551142 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-36449cae-fe11-44fb-b190-8c3768ac0902 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.589805 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-52a6f34a-79b4-4720-9451-d1164eaabb87 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Deleting port b60aaf5b-ad43-4a72-949a-4dfe0de62bc9 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:45:03.590457 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-52a6f34a-79b4-4720-9451-d1164eaabb87 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.626560 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-36449cae-fe11-44fb-b190-8c3768ac0902 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.635798 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-36449cae-fe11-44fb-b190-8c3768ac0902 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.659732 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36449cae-fe11-44fb-b190-8c3768ac0902 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6ffbdda7-7002-44a8-9f2f-3662b4c7de8e,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:03.676341 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-36449cae-fe11-44fb-b190-8c3768ac0902 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.683494 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-36449cae-fe11-44fb-b190-8c3768ac0902 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1736336 Dec 09 21:45:03.692129 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40468) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:03.702305 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-3f0ccd10-b6eb-4754-b808-3a1693fbc267 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'network': {'name': 'tempest-network-smoke--1376263338', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'port_security_enabled': True}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:03.750780 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-52a6f34a-79b4-4720-9451-d1164eaabb87 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.751005 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-52a6f34a-79b4-4720-9451-d1164eaabb87 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.756230 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3f0ccd10-b6eb-4754-b808-3a1693fbc267 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Made reservation on behalf of dce7594ac2a74901912a2f19de04bf79 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:03.761517 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f0ccd10-b6eb-4754-b808-3a1693fbc267 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.766194 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-52a6f34a-79b4-4720-9451-d1164eaabb87 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Calling delete_port for b60aaf5b-ad43-4a72-949a-4dfe0de62bc9 owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:45:03.799571 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3f0ccd10-b6eb-4754-b808-3a1693fbc267 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] vlan segment allocate from pool success with {'vlan_id': 140, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:45:03.813872 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f0ccd10-b6eb-4754-b808-3a1693fbc267 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.814216 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-3f0ccd10-b6eb-4754-b808-3a1693fbc267 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Added segment 2316fee1-a288-4d09-bf17-e0a19e0adf8d of type vlan for network 4fbe35af-30ff-45b2-b84a-21fea4abf9aa Dec 09 21:45:03.886376 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f0ccd10-b6eb-4754-b808-3a1693fbc267 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.929795 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f0ccd10-b6eb-4754-b808-3a1693fbc267 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.936315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f0ccd10-b6eb-4754-b808-3a1693fbc267 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:03.937067 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f0ccd10-b6eb-4754-b808-3a1693fbc267 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.948466 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-52a6f34a-79b4-4720-9451-d1164eaabb87 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:03.982965 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3f0ccd10-b6eb-4754-b808-3a1693fbc267 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.2895958 Dec 09 21:45:03.986698 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40476) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:03.991373 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-d3ca9dd5-e0fa-4270-81c5-f349d760e86b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-446132443', 'admin_state_up': True, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:04.032676 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f0ccd10-b6eb-4754-b808-3a1693fbc267 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Network': ['ID=4fbe35af-30ff-45b2-b84a-21fea4abf9aa,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:04.044745 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 4fbe35af-30ff-45b2-b84a-21fea4abf9aa details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:45:04.063492 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3ca9dd5-e0fa-4270-81c5-f349d760e86b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:04.065199 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3ca9dd5-e0fa-4270-81c5-f349d760e86b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:04.072059 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52a6f34a-79b4-4720-9451-d1164eaabb87 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event deleted for resources: {'Port': ['ID=b60aaf5b-ad43-4a72-949a-4dfe0de62bc9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:04.156101 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-52a6f34a-79b4-4720-9451-d1164eaabb87 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:04.158926 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-52a6f34a-79b4-4720-9451-d1164eaabb87 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:04.160149 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-52a6f34a-79b4-4720-9451-d1164eaabb87 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "DELETE /v2.0/floatingips/5c477e5d-9f23-49d8-8d90-531e60407f0a HTTP/1.1" status: 204 len: 168 time: 0.7699103 Dec 09 21:45:04.166252 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40482) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:04.195721 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-4d63bd67-363e-46f7-95d9-92ecd06c9896 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] DELETE failed (client error): The resource could not be found. Dec 09 21:45:04.196403 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4d63bd67-363e-46f7-95d9-92ecd06c9896 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:45:04.197059 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3ca9dd5-e0fa-4270-81c5-f349d760e86b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:04.199410 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4d63bd67-363e-46f7-95d9-92ecd06c9896 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "DELETE /v2.0/ports/48373db5-a424-4404-b2ae-8b7d1f5e5823 HTTP/1.1" status: 404 len: 333 time: 0.0320613 Dec 09 21:45:04.202127 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40484) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:04.239272 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-225ccf74-ec86-4fcd-9825-1e4cae26d4fd tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "GET /v2.0/ports?device_id=772b6758-54fa-4b9c-ba3a-7a3e806f18e0 HTTP/1.1" status: 200 len: 205 time: 0.0359528 Dec 09 21:45:04.252128 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40488) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:04.330584 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-c71767d1-4032-4f93-adef-626b85e67f5d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] delete failed (client error): The resource could not be found. Dec 09 21:45:04.331700 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c71767d1-4032-4f93-adef-626b85e67f5d tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "DELETE /v2.0/routers/772b6758-54fa-4b9c-ba3a-7a3e806f18e0 HTTP/1.1" status: 404 len: 336 time: 0.0785532 Dec 09 21:45:04.339914 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40492) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:04.383599 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3ca9dd5-e0fa-4270-81c5-f349d760e86b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:04.386674 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-e55f246a-91de-421d-ae72-dc2f326ffda9 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] DELETE failed (client error): The resource could not be found. Dec 09 21:45:04.387244 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e55f246a-91de-421d-ae72-dc2f326ffda9 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:45:04.394781 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e55f246a-91de-421d-ae72-dc2f326ffda9 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "DELETE /v2.0/subnets/5f69fcfb-0c7f-4494-a05b-6986fda3fe04 HTTP/1.1" status: 404 len: 337 time: 0.0537968 Dec 09 21:45:04.398435 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40496) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:04.606490 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 1a71d833-9202-4bda-97f0-24289244be12 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:45:04.610208 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-458b87de-dbac-411d-b644-d613fc89fca7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Deleting port 97adad29-d668-4e98-9fb3-f98121e998ee {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:45:04.610780 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-458b87de-dbac-411d-b644-d613fc89fca7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:04.630765 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 1a71d833-9202-4bda-97f0-24289244be12 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:45:04.631123 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 1a71d833-9202-4bda-97f0-24289244be12 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:45:04.818295 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3ca9dd5-e0fa-4270-81c5-f349d760e86b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:04.855552 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3ca9dd5-e0fa-4270-81c5-f349d760e86b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:04.936726 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-458b87de-dbac-411d-b644-d613fc89fca7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:04.946474 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40516) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:04.965518 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-458b87de-dbac-411d-b644-d613fc89fca7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Calling delete_port for 97adad29-d668-4e98-9fb3-f98121e998ee owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:45:05.041675 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-658c5f41-3c98-481b-af23-3678c4d162c7 admin admin] Deleting subnet 0a3f1058-1106-4429-ab0b-99e5b6e6629d {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:45:05.046511 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-658c5f41-3c98-481b-af23-3678c4d162c7 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:05.077364 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-d3ca9dd5-e0fa-4270-81c5-f349d760e86b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Allocated IP 172.25.3.53 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/8d6065cf-1cdc-4069-87fe-4730f83e3cd7) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:45:05.103744 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-658c5f41-3c98-481b-af23-3678c4d162c7 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:05.170504 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-658c5f41-3c98-481b-af23-3678c4d162c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:05.228597 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-458b87de-dbac-411d-b644-d613fc89fca7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:05.259385 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-658c5f41-3c98-481b-af23-3678c4d162c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:05.275485 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3ca9dd5-e0fa-4270-81c5-f349d760e86b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:05.295736 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-658c5f41-3c98-481b-af23-3678c4d162c7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0a3f1058-1106-4429-ab0b-99e5b6e6629d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:05.302676 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-658c5f41-3c98-481b-af23-3678c4d162c7 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:05.310157 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-658c5f41-3c98-481b-af23-3678c4d162c7 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/0a3f1058-1106-4429-ab0b-99e5b6e6629d HTTP/1.1" status: 204 len: 168 time: 0.3622971 Dec 09 21:45:05.310832 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40522) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:05.318570 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-babf26e7-5bba-46ff-8c8e-cbed01861e92 None None] Network f57a042a-7e03-40f8-ab65-0cce91b75390 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:45:05.357601 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-458b87de-dbac-411d-b644-d613fc89fca7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:05.363795 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-458b87de-dbac-411d-b644-d613fc89fca7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "DELETE /v2.0/ports/97adad29-d668-4e98-9fb3-f98121e998ee HTTP/1.1" status: 204 len: 168 time: 0.9617894 Dec 09 21:45:05.363795 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-458b87de-dbac-411d-b644-d613fc89fca7 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event deleted for resources: {'Port': ['ID=97adad29-d668-4e98-9fb3-f98121e998ee,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:05.365623 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40524) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:05.397605 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee63e932-a7ef-4453-b481-6ec91118d096 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:05.430986 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5ede4a72-7e27-4b56-b3ba-2abe03b633cd None None] DHCP port deletion for f57a042a-7e03-40f8-ab65-0cce91b75390 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:45:05.486576 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3ca9dd5-e0fa-4270-81c5-f349d760e86b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:05.499476 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-e82929bb-558e-45d8-9238-c7682aa8d183 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Deleting port f1f87d04-b570-4a83-818c-4ddc61a5c148 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:45:05.499839 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e82929bb-558e-45d8-9238-c7682aa8d183 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:05.499958 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee63e932-a7ef-4453-b481-6ec91118d096 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:05.523072 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-ee63e932-a7ef-4453-b481-6ec91118d096 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f57a042a-7e03-40f8-ab65-0cce91b75390']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:05.536252 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-ee63e932-a7ef-4453-b481-6ec91118d096 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f69cd9ac-0fbe-4c49-8321-6c397e7fefa4') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:05.536554 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-ee63e932-a7ef-4453-b481-6ec91118d096 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f69cd9ac-0fbe-4c49-8321-6c397e7fefa4') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:05.548535 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee63e932-a7ef-4453-b481-6ec91118d096 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:05.558262 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a281fa60-522f-42b8-ad89-eba8f0d4e750 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:05.569115 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee63e932-a7ef-4453-b481-6ec91118d096 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:05.580648 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ee63e932-a7ef-4453-b481-6ec91118d096 admin admin] Releasing vlan 108 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:45:05.581443 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee63e932-a7ef-4453-b481-6ec91118d096 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:45:05.584025 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:45:05.608897 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d3ca9dd5-e0fa-4270-81c5-f349d760e86b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:45:05.613784 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-d3ca9dd5-e0fa-4270-81c5-f349d760e86b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:05.616880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3ca9dd5-e0fa-4270-81c5-f349d760e86b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:45:05.629796 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d9a943bb-2ce8-46b9-b5ab-31dcbea02456 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:45:05.655943 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee63e932-a7ef-4453-b481-6ec91118d096 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:05.669049 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee63e932-a7ef-4453-b481-6ec91118d096 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:05.678603 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3ca9dd5-e0fa-4270-81c5-f349d760e86b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Port': ['ID=8d6065cf-1cdc-4069-87fe-4730f83e3cd7,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:05.679295 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ee63e932-a7ef-4453-b481-6ec91118d096 admin admin] 10.222.0.13 "DELETE /v2.0/networks/f57a042a-7e03-40f8-ab65-0cce91b75390 HTTP/1.1" status: 204 len: 168 time: 0.3660331 Dec 09 21:45:05.687285 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e82929bb-558e-45d8-9238-c7682aa8d183 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:05.729525 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c4e4dc4c-4efa-41b7-955d-db58552de6e7 None None] Provisioning complete for port 8d6065cf-1cdc-4069-87fe-4730f83e3cd7 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:05.730009 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c4e4dc4c-4efa-41b7-955d-db58552de6e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:05.731883 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee63e932-a7ef-4453-b481-6ec91118d096 admin admin] Pushing event deleted for resources: {'Network': ['ID=f57a042a-7e03-40f8-ab65-0cce91b75390,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:05.818031 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-c4e4dc4c-4efa-41b7-955d-db58552de6e7 None None] Port 8d6065cf-1cdc-4069-87fe-4730f83e3cd7 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:45:05.830531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-e82929bb-558e-45d8-9238-c7682aa8d183 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Calling delete_port for f1f87d04-b570-4a83-818c-4ddc61a5c148 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:45:05.858274 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40530) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:05.950530 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3ca9dd5-e0fa-4270-81c5-f349d760e86b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:06.015819 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40538) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:06.112996 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-60249e47-4fff-4467-b0e3-47f6fcaa69a8 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=94c88405417a4eea84491e86df14a0b0&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0959399 Dec 09 21:45:06.117108 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40542) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:06.123165 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7801c919-6647-4ec5-90a3-4ce078559b99 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:06.207596 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7801c919-6647-4ec5-90a3-4ce078559b99 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:06.217627 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7801c919-6647-4ec5-90a3-4ce078559b99 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:06.253167 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7801c919-6647-4ec5-90a3-4ce078559b99 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=586fb0031137408eaed527a381aebe9f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3910406 Dec 09 21:45:06.254540 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40554) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:06.306186 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7801c919-6647-4ec5-90a3-4ce078559b99 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2cbb0bea-768a-4059-b5ee-b2934ad89a76,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:06.327517 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f3fce8ae-9f53-4c1d-9e30-235ca068c4c5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:06.350636 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f3fce8ae-9f53-4c1d-9e30-235ca068c4c5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:06.406119 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f3fce8ae-9f53-4c1d-9e30-235ca068c4c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:06.409112 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f3fce8ae-9f53-4c1d-9e30-235ca068c4c5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:06.410302 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f3fce8ae-9f53-4c1d-9e30-235ca068c4c5 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/2cbb0bea-768a-4059-b5ee-b2934ad89a76 HTTP/1.1" status: 204 len: 168 time: 0.1551626 Dec 09 21:45:06.419147 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3fce8ae-9f53-4c1d-9e30-235ca068c4c5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2cbb0bea-768a-4059-b5ee-b2934ad89a76,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:06.594703 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9dc5805f-9ffd-47a1-a3c6-571de4c42b19 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:06.630845 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:06.675263 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e82929bb-558e-45d8-9238-c7682aa8d183 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:06.692843 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9dc5805f-9ffd-47a1-a3c6-571de4c42b19 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:06.768911 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40560) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:06.772994 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3ca9dd5-e0fa-4270-81c5-f349d760e86b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:06.780365 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e82929bb-558e-45d8-9238-c7682aa8d183 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event deleted for resources: {'Port': ['ID=f1f87d04-b570-4a83-818c-4ddc61a5c148,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:06.789285 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ef4fb55b-9af4-432b-9f3c-5fc8e8b561f0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:06.887449 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ef4fb55b-9af4-432b-9f3c-5fc8e8b561f0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:06.892187 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ef4fb55b-9af4-432b-9f3c-5fc8e8b561f0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:06.928531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5975557a-de58-47c7-9a46-81e402c191c4 req-4a5cba90-f106-4329-a70c-fad20e7ff0f6 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:06.930034 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5975557a-de58-47c7-9a46-81e402c191c4 req-4a5cba90-f106-4329-a70c-fad20e7ff0f6 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/networks?id=eda4cb39-afde-43d7-a13b-5227cc6862dd HTTP/1.1" status: 200 len: 814 time: 0.3641739 Dec 09 21:45:06.930514 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef4fb55b-9af4-432b-9f3c-5fc8e8b561f0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6b2c2971-f201-485c-b93b-29ab013cef48,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:06.935132 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ef4fb55b-9af4-432b-9f3c-5fc8e8b561f0 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=cf7af55a17bf4abead995880ec96c412&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1651733 Dec 09 21:45:06.937713 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40562) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:07.001484 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5975557a-de58-47c7-9a46-81e402c191c4 req-e94b6ece-4626-4964-9472-9061bf9b3518 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/quotas/6f2bd57ebcdc4c748e719519e3961b70 HTTP/1.1" status: 200 len: 375 time: 0.0530427 Dec 09 21:45:07.004043 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e82929bb-558e-45d8-9238-c7682aa8d183 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:07.009485 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d3e272e3-0d7a-433f-88fe-fbe2ae0c17a1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:07.010144 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e82929bb-558e-45d8-9238-c7682aa8d183 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "DELETE /v2.0/ports/f1f87d04-b570-4a83-818c-4ddc61a5c148 HTTP/1.1" status: 204 len: 168 time: 1.6416328 Dec 09 21:45:07.012363 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40564) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:07.047386 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9dc5805f-9ffd-47a1-a3c6-571de4c42b19 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:07.050539 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9dc5805f-9ffd-47a1-a3c6-571de4c42b19 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:07.054498 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9dc5805f-9ffd-47a1-a3c6-571de4c42b19 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/96f2cc1f-4e18-4f36-93f9-bc168eb8b378 HTTP/1.1" status: 204 len: 168 time: 0.9352181 Dec 09 21:45:07.065467 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d3e272e3-0d7a-433f-88fe-fbe2ae0c17a1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:07.068500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dc5805f-9ffd-47a1-a3c6-571de4c42b19 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=96f2cc1f-4e18-4f36-93f9-bc168eb8b378,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:07.102598 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5975557a-de58-47c7-9a46-81e402c191c4 req-6c53a6af-ca23-422c-a134-cc050642871e tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=6f2bd57ebcdc4c748e719519e3961b70&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0912478 Dec 09 21:45:07.128024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b98d5250-a257-4b0d-98f5-37f0ad9aa743 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:07.129280 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d3ca9dd5-e0fa-4270-81c5-f349d760e86b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Router 71037eba-17b6-499e-8ba6-3a08aa3db0b5 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:45:07.130009 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b98d5250-a257-4b0d-98f5-37f0ad9aa743 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "GET /v2.0/ports?device_id=3054de87-ea87-42d0-ac7b-818bc1f8e2c8 HTTP/1.1" status: 200 len: 913 time: 0.1163554 Dec 09 21:45:07.134882 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40568) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:07.247980 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d3e272e3-0d7a-433f-88fe-fbe2ae0c17a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:07.250624 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d3e272e3-0d7a-433f-88fe-fbe2ae0c17a1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:07.254634 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d3e272e3-0d7a-433f-88fe-fbe2ae0c17a1 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/6b2c2971-f201-485c-b93b-29ab013cef48 HTTP/1.1" status: 204 len: 168 time: 0.3158772 Dec 09 21:45:07.266878 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3e272e3-0d7a-433f-88fe-fbe2ae0c17a1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6b2c2971-f201-485c-b93b-29ab013cef48,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:07.425352 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5975557a-de58-47c7-9a46-81e402c191c4 req-2a0e265c-f61a-477b-b1fe-d0238d11905a service neutron] 10.222.0.13 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3067648 Dec 09 21:45:07.512447 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d3ca9dd5-e0fa-4270-81c5-f349d760e86b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:45:07.524442 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] Sync routers for ids ['71037eba-17b6-499e-8ba6-3a08aa3db0b5'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:45:07.540980 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] Routers {'71037eba-17b6-499e-8ba6-3a08aa3db0b5'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:45:07.541630 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:45:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['71037eba-17b6-499e-8ba6-3a08aa3db0b5'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:07.572735 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d77acf0f-9aa8-4f28-b6df-242372a29bec tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:07.624351 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3ca9dd5-e0fa-4270-81c5-f349d760e86b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:07.625576 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d3ca9dd5-e0fa-4270-81c5-f349d760e86b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 894 time: 3.6381454 Dec 09 21:45:07.636294 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40582) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:07.666257 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5975557a-de58-47c7-9a46-81e402c191c4 req-8a4b5b59-55a9-4fca-aad3-cdceb370ee19 service neutron] 10.222.0.13 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2398002 Dec 09 21:45:07.773075 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] Set router 71037eba-17b6-499e-8ba6-3a08aa3db0b5 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:45:08.008763 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:08.019862 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'name': 'tempest-TestNetworkAdvancedServerOps-router-446132443', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53'}], 'enable_snat': True}, 'gw_port_id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:05Z', 'revision_number': 3, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2d:78', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2974, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:05Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:08.031515 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b505974f-8e88-4cc8-bf50-ec43f323e873 req-7e34faac-4beb-483b-ae5c-83dc12e81d67 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ccb431db-4fc5-4654-a429-b211aed4747e HTTP/1.1" status: 200 len: 210 time: 0.0733433 Dec 09 21:45:08.066793 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-d77acf0f-9aa8-4f28-b6df-242372a29bec tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Deleting port 6ab6a8b4-297b-433f-ba21-6244428423a9 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:45:08.068420 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d77acf0f-9aa8-4f28-b6df-242372a29bec tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:08.068857 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] Checking router: 71037eba-17b6-499e-8ba6-3a08aa3db0b5 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:45:08.069242 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] Updating router 71037eba-17b6-499e-8ba6-3a08aa3db0b5 port 8d6065cf-1cdc-4069-87fe-4730f83e3cd7 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:45:08.103641 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:08.188998 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d77acf0f-9aa8-4f28-b6df-242372a29bec tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:08.212318 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-d77acf0f-9aa8-4f28-b6df-242372a29bec tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Calling delete_port for 6ab6a8b4-297b-433f-ba21-6244428423a9 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:45:08.225606 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5c00bd43-8714-49b2-b7d6-e6c03a35e190 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/subnets?project_id=dce7594ac2a74901912a2f19de04bf79&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.5613129 Dec 09 21:45:08.226135 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40604) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:08.501511 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:08.513680 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:08.580761 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-852c99d1-f653-49f5-beee-46e5bf24cb99 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:08.585350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-852c99d1-f653-49f5-beee-46e5bf24cb99 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.3554041 Dec 09 21:45:08.585667 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40620) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:08.596888 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a420c77-3e3c-430e-a767-904e7bc7fff1 None None] Pushing event updated for resources: {'Port': ['ID=8d6065cf-1cdc-4069-87fe-4730f83e3cd7,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:08.616989 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48762773-e79d-416a-92c4-e7a6ab145c9f None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:45:08.628818 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8322ce29-a690-4db7-8f00-683aaaf284a9 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/subnets?network_id=97925a19-460a-4476-8208-41db134b6c83&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0414369 Dec 09 21:45:08.631629 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40622) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:08.638196 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-7a20544a-3354-451c-826c-95fbeee9b32d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1012687454', 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:08.647143 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] Attempting to bind port 8d6065cf-1cdc-4069-87fe-4730f83e3cd7 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:45:08.647759 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] Attempting to bind port 8d6065cf-1cdc-4069-87fe-4730f83e3cd7 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:45:08.648490 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] Attempting to bind port 8d6065cf-1cdc-4069-87fe-4730f83e3cd7 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:45:08.655353 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 44, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:45:08.656127 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:45:08.657387 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:08.658002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:45:08.658697 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] Bound port: 8d6065cf-1cdc-4069-87fe-4730f83e3cd7, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:45:08.659292 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:08.700281 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d77acf0f-9aa8-4f28-b6df-242372a29bec tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:08.726204 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] For port 8d6065cf-1cdc-4069-87fe-4730f83e3cd7, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:45:08.729969 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] For port 8d6065cf-1cdc-4069-87fe-4730f83e3cd7, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=8d6065cf-1cdc-4069-87fe-4730f83e3cd7,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:45:08.742110 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:08.758218 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7a20544a-3354-451c-826c-95fbeee9b32d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Made reservation on behalf of dce7594ac2a74901912a2f19de04bf79 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:08.763046 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7a20544a-3354-451c-826c-95fbeee9b32d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:08.785727 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d77acf0f-9aa8-4f28-b6df-242372a29bec tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event deleted for resources: {'Port': ['ID=6ab6a8b4-297b-433f-ba21-6244428423a9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:08.832627 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a420c77-3e3c-430e-a767-904e7bc7fff1 None None] Pushing event updated for resources: {'Port': ['ID=8d6065cf-1cdc-4069-87fe-4730f83e3cd7,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:08.835282 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-cbcac64b-75b8-48d4-8d16-2dbe93f72e1b None None] Provisioning complete for port 8d6065cf-1cdc-4069-87fe-4730f83e3cd7 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:08.835689 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cbcac64b-75b8-48d4-8d16-2dbe93f72e1b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:08.898080 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5e6731b-c4f3-4ab9-8a41-5bcc83a79769 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:45:08.933754 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] Routers {'71037eba-17b6-499e-8ba6-3a08aa3db0b5'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:45:08.934512 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:45:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['71037eba-17b6-499e-8ba6-3a08aa3db0b5'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:09.101004 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cbcac64b-75b8-48d4-8d16-2dbe93f72e1b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:09.160089 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-cbcac64b-75b8-48d4-8d16-2dbe93f72e1b None None] For port 8d6065cf-1cdc-4069-87fe-4730f83e3cd7, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=8d6065cf-1cdc-4069-87fe-4730f83e3cd7,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:09.161880 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7a20544a-3354-451c-826c-95fbeee9b32d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:09.181421 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cbcac64b-75b8-48d4-8d16-2dbe93f72e1b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:09.206077 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] Set router 71037eba-17b6-499e-8ba6-3a08aa3db0b5 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:45:09.221059 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d77acf0f-9aa8-4f28-b6df-242372a29bec tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:09.291184 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-06b92a16-5f4e-436a-b2bd-6efa0136fa92 req-284e5e57-c8b5-4a86-8b17-b2ac8c3070d1 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ccb431db-4fc5-4654-a429-b211aed4747e HTTP/1.1" status: 200 len: 210 time: 0.0539780 Dec 09 21:45:09.312379 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a20544a-3354-451c-826c-95fbeee9b32d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Subnet': ['ID=017fde5b-ddc1-4da5-8c6b-2b98296748e5,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:09.363490 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a20544a-3354-451c-826c-95fbeee9b32d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Checking segment: {'id': '2316fee1-a288-4d09-bf17-e0a19e0adf8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:45:09.363892 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a20544a-3354-451c-826c-95fbeee9b32d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network hostable DHCP agents. Network: 4fbe35af-30ff-45b2-b84a-21fea4abf9aa, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:45:09.403746 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a20544a-3354-451c-826c-95fbeee9b32d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network 4fbe35af-30ff-45b2-b84a-21fea4abf9aa is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:45:09.416658 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-7a20544a-3354-451c-826c-95fbeee9b32d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 4fbe35af-30ff-45b2-b84a-21fea4abf9aa) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:09.421756 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7a20544a-3354-451c-826c-95fbeee9b32d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:09.422607 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7a20544a-3354-451c-826c-95fbeee9b32d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:09.441901 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cac52522-7dc5-4614-88c3-059d4bea36af None None] Network 4fbe35af-30ff-45b2-b84a-21fea4abf9aa requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:45:09.452409 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7a20544a-3354-451c-826c-95fbeee9b32d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.8191135 Dec 09 21:45:09.453193 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40642) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:09.491265 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a2a29229-aa54-4487-a75d-93a58bca8b18 None None] Provisioning complete for port 8d6065cf-1cdc-4069-87fe-4730f83e3cd7 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:09.495985 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a2a29229-aa54-4487-a75d-93a58bca8b18 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:09.501587 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbcac64b-75b8-48d4-8d16-2dbe93f72e1b None None] Pushing event updated for resources: {'Port': ['ID=8d6065cf-1cdc-4069-87fe-4730f83e3cd7,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:09.767201 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:09.910107 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3b12ebce-5ee7-4a77-9f47-5e5097a1b0e4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-4fbe35af-30ff-45b2-b84a-21fea4abf9aa', 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'fixed_ips': [{'subnet_id': '017fde5b-ddc1-4da5-8c6b-2b98296748e5'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:45:09.912870 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3b12ebce-5ee7-4a77-9f47-5e5097a1b0e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:10.077131 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-3b12ebce-5ee7-4a77-9f47-5e5097a1b0e4 None None] Allocated IP 172.20.0.2 (4fbe35af-30ff-45b2-b84a-21fea4abf9aa/017fde5b-ddc1-4da5-8c6b-2b98296748e5/f466ec8c-c7fd-4a9a-beb5-e4041b079f89) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:45:10.240936 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3b12ebce-5ee7-4a77-9f47-5e5097a1b0e4 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:10.255004 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3b12ebce-5ee7-4a77-9f47-5e5097a1b0e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:10.296816 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:10.359837 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d77acf0f-9aa8-4f28-b6df-242372a29bec tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Router 3054de87-ea87-42d0-ac7b-818bc1f8e2c8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:45:10.372073 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5975557a-de58-47c7-9a46-81e402c191c4 req-ecc90eff-169e-4a6f-aa7d-776895c55880 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:10.374102 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5975557a-de58-47c7-9a46-81e402c191c4 req-ecc90eff-169e-4a6f-aa7d-776895c55880 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.31 "GET /v2.0/networks?id=eda4cb39-afde-43d7-a13b-5227cc6862dd HTTP/1.1" status: 200 len: 814 time: 0.2530787 Dec 09 21:45:10.393813 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-5975557a-de58-47c7-9a46-81e402c191c4 req-60ebf141-31c6-4167-b3ed-ef81a5206079 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Request body: {'port': {'device_id': 'ccb431db-4fc5-4654-a429-b211aed4747e', 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd', 'admin_state_up': True, 'tenant_id': '6f2bd57ebcdc4c748e719519e3961b70'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:10.443031 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bbdd1473-18cf-4222-837a-6c3f3b954c1d req-40c6b6e5-3186-41e8-b135-3d4a0e43b7a4 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ccb431db-4fc5-4654-a429-b211aed4747e HTTP/1.1" status: 200 len: 210 time: 0.0636883 Dec 09 21:45:10.595719 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3b12ebce-5ee7-4a77-9f47-5e5097a1b0e4 None None] Network 4fbe35af-30ff-45b2-b84a-21fea4abf9aa is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:45:10.604329 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-3b12ebce-5ee7-4a77-9f47-5e5097a1b0e4 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:10.610130 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'name': 'tempest-TestNetworkAdvancedServerOps-router-446132443', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53'}], 'enable_snat': True}, 'gw_port_id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:05Z', 'revision_number': 3, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2d:78', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2974, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:10.612219 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b12ebce-5ee7-4a77-9f47-5e5097a1b0e4 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:45:10.674524 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b12ebce-5ee7-4a77-9f47-5e5097a1b0e4 None None] Pushing event updated for resources: {'Port': ['ID=f466ec8c-c7fd-4a9a-beb5-e4041b079f89,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:10.685678 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7bb61a2-ac5e-4fdf-a1d7-25b8d0808092 None None] The sync data for ids ['71037eba-17b6-499e-8ba6-3a08aa3db0b5'] in n-d-713301-27 is: [{'id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'name': 'tempest-TestNetworkAdvancedServerOps-router-446132443', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53'}], 'enable_snat': True}, 'gw_port_id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:05Z', 'revision_number': 3, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2d:78', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2974, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:08Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:45:10.749388 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5975557a-de58-47c7-9a46-81e402c191c4 req-60ebf141-31c6-4167-b3ed-ef81a5206079 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Made reservation on behalf of 6f2bd57ebcdc4c748e719519e3961b70 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:10.753276 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5975557a-de58-47c7-9a46-81e402c191c4 req-60ebf141-31c6-4167-b3ed-ef81a5206079 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:10.785299 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-3b12ebce-5ee7-4a77-9f47-5e5097a1b0e4 None None] Attempting to bind port f466ec8c-c7fd-4a9a-beb5-e4041b079f89 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:45:10.786149 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-3b12ebce-5ee7-4a77-9f47-5e5097a1b0e4 None None] Attempting to bind port f466ec8c-c7fd-4a9a-beb5-e4041b079f89 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '2316fee1-a288-4d09-bf17-e0a19e0adf8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:45:10.786771 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b12ebce-5ee7-4a77-9f47-5e5097a1b0e4 None None] Attempting to bind port f466ec8c-c7fd-4a9a-beb5-e4041b079f89 on network 4fbe35af-30ff-45b2-b84a-21fea4abf9aa {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:45:10.807063 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b12ebce-5ee7-4a77-9f47-5e5097a1b0e4 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 45, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:45:10.807063 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b12ebce-5ee7-4a77-9f47-5e5097a1b0e4 None None] Checking segment: {'id': '2316fee1-a288-4d09-bf17-e0a19e0adf8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:45:10.807592 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3b12ebce-5ee7-4a77-9f47-5e5097a1b0e4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:10.807717 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3b12ebce-5ee7-4a77-9f47-5e5097a1b0e4 None None] Bound using segment: {'id': '2316fee1-a288-4d09-bf17-e0a19e0adf8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:45:10.808140 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-3b12ebce-5ee7-4a77-9f47-5e5097a1b0e4 None None] Bound port: f466ec8c-c7fd-4a9a-beb5-e4041b079f89, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2316fee1-a288-4d09-bf17-e0a19e0adf8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:45:10.808531 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3b12ebce-5ee7-4a77-9f47-5e5097a1b0e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:10.818650 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d77acf0f-9aa8-4f28-b6df-242372a29bec tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:45:10.835781 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2648ce60-d3fb-411f-8a0a-3159644226d1 None None] Sync routers for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:45:10.840698 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d77acf0f-9aa8-4f28-b6df-242372a29bec tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "PUT /v2.0/routers/3054de87-ea87-42d0-ac7b-818bc1f8e2c8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.7025826 Dec 09 21:45:10.844821 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40668) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:10.864824 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Allocated IP 172.20.0.1 (4fbe35af-30ff-45b2-b84a-21fea4abf9aa/017fde5b-ddc1-4da5-8c6b-2b98296748e5/e6e780bc-5481-46c0-b1d4-140a4d417a11) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:45:10.870867 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2648ce60-d3fb-411f-8a0a-3159644226d1 None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:45:10.872447 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2648ce60-d3fb-411f-8a0a-3159644226d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:45:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:10.958973 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-3b12ebce-5ee7-4a77-9f47-5e5097a1b0e4 None None] For port f466ec8c-c7fd-4a9a-beb5-e4041b079f89, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:45:10.968670 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2648ce60-d3fb-411f-8a0a-3159644226d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:10.977161 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-3b12ebce-5ee7-4a77-9f47-5e5097a1b0e4 None None] For port f466ec8c-c7fd-4a9a-beb5-e4041b079f89, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f466ec8c-c7fd-4a9a-beb5-e4041b079f89,segment=NetworkSegment(2316fee1-a288-4d09-bf17-e0a19e0adf8d),segment_id=2316fee1-a288-4d09-bf17-e0a19e0adf8d)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:45:10.988158 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3b12ebce-5ee7-4a77-9f47-5e5097a1b0e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:10.996298 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2648ce60-d3fb-411f-8a0a-3159644226d1 None None] Routers {'3054de87-ea87-42d0-ac7b-818bc1f8e2c8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:45:10.998095 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2648ce60-d3fb-411f-8a0a-3159644226d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:45:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:11.084158 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b12ebce-5ee7-4a77-9f47-5e5097a1b0e4 None None] Pushing event updated for resources: {'Port': ['ID=f466ec8c-c7fd-4a9a-beb5-e4041b079f89,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:11.101010 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2648ce60-d3fb-411f-8a0a-3159644226d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:11.103083 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2648ce60-d3fb-411f-8a0a-3159644226d1 None None] The sync data for ids ['3054de87-ea87-42d0-ac7b-818bc1f8e2c8'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:45:11.166760 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7f6d94b1-3649-4ff0-8661-561ef3528b5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:11.170897 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:11.182692 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-5975557a-de58-47c7-9a46-81e402c191c4 req-60ebf141-31c6-4167-b3ed-ef81a5206079 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Allocated IP 172.20.0.4 (eda4cb39-afde-43d7-a13b-5227cc6862dd/24afae0e-0a38-484d-a023-a2fb471bdb33/31ee9adf-4bac-4e32-9223-f4e594f0639e) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:45:11.241205 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:11.318665 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network 4fbe35af-30ff-45b2-b84a-21fea4abf9aa is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:45:11.336812 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:11.342503 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:45:11.369032 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40672) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:11.398719 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Port': ['ID=e6e780bc-5481-46c0-b1d4-140a4d417a11,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:11.412103 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:11.413952 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:11.413952 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:11.415448 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:11.415770 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:11.416116 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:11.416631 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:11.416981 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:11.417350 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:11.417682 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:11.418010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:11.418337 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:11.418658 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:11.455652 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:11.480717 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7f6d94b1-3649-4ff0-8661-561ef3528b5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:11.656331 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f12472c3-0272-47ae-9911-38cb0dfde7c9 req-ce41ff24-98af-4df7-8cfd-07df6d9cd100 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ccb431db-4fc5-4654-a429-b211aed4747e HTTP/1.1" status: 200 len: 210 time: 0.0567274 Dec 09 21:45:11.658731 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d43b4842-8bbf-47c5-b921-2e6dd0d00ad4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:11.697671 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5975557a-de58-47c7-9a46-81e402c191c4 req-60ebf141-31c6-4167-b3ed-ef81a5206079 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:11.841805 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5975557a-de58-47c7-9a46-81e402c191c4 req-60ebf141-31c6-4167-b3ed-ef81a5206079 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:11.850147 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-7f6d94b1-3649-4ff0-8661-561ef3528b5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Deleting port e568253b-d29a-41a6-8c0a-0c57f6cd0063 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:45:11.850501 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7f6d94b1-3649-4ff0-8661-561ef3528b5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:11.858442 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['33cf4605-a408-4847-9394-fe8acf994c40', 'bd9c1c28-304b-4656-bd19-43407d1b6dc2', '25f69b99-160f-4f73-bc4c-738b6fa17cbd'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:45:11.867054 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d43b4842-8bbf-47c5-b921-2e6dd0d00ad4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:11.884183 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5975557a-de58-47c7-9a46-81e402c191c4 req-60ebf141-31c6-4167-b3ed-ef81a5206079 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Network eda4cb39-afde-43d7-a13b-5227cc6862dd is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:45:11.888317 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-5975557a-de58-47c7-9a46-81e402c191c4 req-60ebf141-31c6-4167-b3ed-ef81a5206079 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:11.920443 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f87942b-bbb1-4d81-94aa-dd2e5bd4b5e8 None None] DHCP port deletion for eda4cb39-afde-43d7-a13b-5227cc6862dd request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:45:11.958983 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d43b4842-8bbf-47c5-b921-2e6dd0d00ad4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:11.961615 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60ebf141-31c6-4167-b3ed-ef81a5206079 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Pushing event updated for resources: {'Port': ['ID=31ee9adf-4bac-4e32-9223-f4e594f0639e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:11.978479 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-5975557a-de58-47c7-9a46-81e402c191c4 req-60ebf141-31c6-4167-b3ed-ef81a5206079 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:45:12.116283 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d3216d48-18d7-4626-b5db-b482349d9a7f None None] Provisioning complete for port 31ee9adf-4bac-4e32-9223-f4e594f0639e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:12.116870 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d3216d48-18d7-4626-b5db-b482349d9a7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:12.120806 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d43b4842-8bbf-47c5-b921-2e6dd0d00ad4 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=6436c83af21e49fe8f5e86dae4bfb228&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7513480 Dec 09 21:45:12.121507 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40692) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:12.141056 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d43b4842-8bbf-47c5-b921-2e6dd0d00ad4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=11abbeae-73a1-4456-a687-fe8736fd4eaa,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:12.188608 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5975557a-de58-47c7-9a46-81e402c191c4 req-60ebf141-31c6-4167-b3ed-ef81a5206079 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:12.189908 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5975557a-de58-47c7-9a46-81e402c191c4 req-60ebf141-31c6-4167-b3ed-ef81a5206079 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:12.210430 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d3216d48-18d7-4626-b5db-b482349d9a7f None None] Port 31ee9adf-4bac-4e32-9223-f4e594f0639e cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:45:12.237736 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7f6d94b1-3649-4ff0-8661-561ef3528b5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:12.260718 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-3715b56c-3c1f-491d-9fdc-1f82ac31221e tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=289b15efb1cc4b5fbaefca8970d43a70&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0860784 Dec 09 21:45:12.271751 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5975557a-de58-47c7-9a46-81e402c191c4 req-60ebf141-31c6-4167-b3ed-ef81a5206079 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.8824871 Dec 09 21:45:12.273303 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-7f6d94b1-3649-4ff0-8661-561ef3528b5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Calling delete_port for e568253b-d29a-41a6-8c0a-0c57f6cd0063 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:45:12.309434 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-5975557a-de58-47c7-9a46-81e402c191c4 req-4401a4a1-7d96-4f67-95f2-06afeb1f3b65 service neutron] Request body: {'port': {'device_id': 'ccb431db-4fc5-4654-a429-b211aed4747e', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:12.314618 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bf829bb4-25dd-4de1-b705-402589923fa0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:12.332354 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:12.431808 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bf829bb4-25dd-4de1-b705-402589923fa0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:12.505233 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5975557a-de58-47c7-9a46-81e402c191c4 req-4401a4a1-7d96-4f67-95f2-06afeb1f3b65 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:12.631198 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bf829bb4-25dd-4de1-b705-402589923fa0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:12.634086 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bf829bb4-25dd-4de1-b705-402589923fa0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:12.637983 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bf829bb4-25dd-4de1-b705-402589923fa0 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/11abbeae-73a1-4456-a687-fe8736fd4eaa HTTP/1.1" status: 204 len: 168 time: 0.5075207 Dec 09 21:45:12.657893 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-1d53e065-4aed-4e3b-8483-c40b2b143f2c tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:12.660154 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-1d53e065-4aed-4e3b-8483-c40b2b143f2c tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3989427 Dec 09 21:45:12.693249 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2fde6b29-597b-458a-8c2f-cf149fe05ee1 None None] Network 4fbe35af-30ff-45b2-b84a-21fea4abf9aa requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:45:12.700177 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-a0a066bf-5353-4d38-87bb-e7f23a7b48b1 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/quotas/289b15efb1cc4b5fbaefca8970d43a70 HTTP/1.1" status: 200 len: 375 time: 0.0333853 Dec 09 21:45:12.710354 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf829bb4-25dd-4de1-b705-402589923fa0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=11abbeae-73a1-4456-a687-fe8736fd4eaa,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:12.802405 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 8d6065cf-1cdc-4069-87fe-4730f83e3cd7 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:45:12.813716 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-37e71e3f-54e0-4c5b-99ec-717ad65ca815 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=289b15efb1cc4b5fbaefca8970d43a70&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0516706 Dec 09 21:45:12.888572 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-91a0c90d-3a91-4176-8d03-3f82834a15f3 None None] Provisioning complete for port f466ec8c-c7fd-4a9a-beb5-e4041b079f89 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:12.888902 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-91a0c90d-3a91-4176-8d03-3f82834a15f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:12.919183 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 8d6065cf-1cdc-4069-87fe-4730f83e3cd7 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:12.919825 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:12.974912 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7f6d94b1-3649-4ff0-8661-561ef3528b5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:13.046955 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b471d0d-92c7-40c3-beaa-6a663ad7eff2 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:45:13.061333 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:13.073466 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f6d94b1-3649-4ff0-8661-561ef3528b5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event deleted for resources: {'Port': ['ID=e568253b-d29a-41a6-8c0a-0c57f6cd0063,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:13.074350 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:13.160996 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-5975557a-de58-47c7-9a46-81e402c191c4 req-4401a4a1-7d96-4f67-95f2-06afeb1f3b65 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 31ee9adf-4bac-4e32-9223-f4e594f0639e {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:45:13.174626 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7f6d94b1-3649-4ff0-8661-561ef3528b5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:13.211335 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:13.221846 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40704) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:13.231014 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5975557a-de58-47c7-9a46-81e402c191c4 req-4401a4a1-7d96-4f67-95f2-06afeb1f3b65 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:13.236187 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Port': ['ID=e6e780bc-5481-46c0-b1d4-140a4d417a11,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:13.330514 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f466ec8c-c7fd-4a9a-beb5-e4041b079f89 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:45:13.336518 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-91a0c90d-3a91-4176-8d03-3f82834a15f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:13.339231 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7f6d94b1-3649-4ff0-8661-561ef3528b5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:13.341570 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-5975557a-de58-47c7-9a46-81e402c191c4 req-4401a4a1-7d96-4f67-95f2-06afeb1f3b65 service neutron] Transition to ACTIVE for port object 31ee9adf-4bac-4e32-9223-f4e594f0639e will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:45:13.342926 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7f6d94b1-3649-4ff0-8661-561ef3528b5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:13.348728 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1ed17e9d-cc68-4094-8b4b-99d37d8ad762 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:13.396829 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-91a0c90d-3a91-4176-8d03-3f82834a15f3 None None] For port f466ec8c-c7fd-4a9a-beb5-e4041b079f89, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f466ec8c-c7fd-4a9a-beb5-e4041b079f89,segment=NetworkSegment(2316fee1-a288-4d09-bf17-e0a19e0adf8d),segment_id=2316fee1-a288-4d09-bf17-e0a19e0adf8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:13.408109 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-91a0c90d-3a91-4176-8d03-3f82834a15f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:13.446796 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5975557a-de58-47c7-9a46-81e402c191c4 req-4401a4a1-7d96-4f67-95f2-06afeb1f3b65 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:13.455536 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73e6bc2b-06c2-4d21-b122-792d822cf29a req-6ae7355c-a72f-4e58-ba14-64c0a40e7729 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:13.457310 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-73e6bc2b-06c2-4d21-b122-792d822cf29a req-6ae7355c-a72f-4e58-ba14-64c0a40e7729 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ccb431db-4fc5-4654-a429-b211aed4747e HTTP/1.1" status: 200 len: 931 time: 0.2575645 Dec 09 21:45:13.473455 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f466ec8c-c7fd-4a9a-beb5-e4041b079f89 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:13.474288 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:13.477018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91a0c90d-3a91-4176-8d03-3f82834a15f3 None None] Pushing event updated for resources: {'Port': ['ID=f466ec8c-c7fd-4a9a-beb5-e4041b079f89,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:13.510716 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7f6d94b1-3649-4ff0-8661-561ef3528b5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:13.511308 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7f6d94b1-3649-4ff0-8661-561ef3528b5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Fanout notify agent at l3_agent the message router_deleted on router 3054de87-ea87-42d0-ac7b-818bc1f8e2c8 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:45:13.534429 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7f6d94b1-3649-4ff0-8661-561ef3528b5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:13.543584 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40710) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:13.545775 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f5cff7e-3891-4a39-8aea-1affe37f5962 None None] DHCP port deletion for eda4cb39-afde-43d7-a13b-5227cc6862dd request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:45:13.548079 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7f6d94b1-3649-4ff0-8661-561ef3528b5a tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "DELETE /v2.0/routers/3054de87-ea87-42d0-ac7b-818bc1f8e2c8 HTTP/1.1" status: 204 len: 168 time: 2.7019928 Dec 09 21:45:13.574483 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network 4fbe35af-30ff-45b2-b84a-21fea4abf9aa is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:45:13.588876 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4401a4a1-7d96-4f67-95f2-06afeb1f3b65 service neutron] Pushing event updated for resources: {'Port': ['ID=31ee9adf-4bac-4e32-9223-f4e594f0639e,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:13.603347 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:13.686690 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c84ff1cc-8a5d-4e5b-a266-0df33f43cfc2 None None] Provisioning complete for port e6e780bc-5481-46c0-b1d4-140a4d417a11 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:13.686967 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c84ff1cc-8a5d-4e5b-a266-0df33f43cfc2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:13.702348 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1ed17e9d-cc68-4094-8b4b-99d37d8ad762 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:13.711774 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-1b952d16-6d7e-43c4-83c9-9931ec2db0c3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Deleting subnet 29523c9c-ae97-471c-a637-67d7fdefc076 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:45:13.718394 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1b952d16-6d7e-43c4-83c9-9931ec2db0c3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:13.727942 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-c84ff1cc-8a5d-4e5b-a266-0df33f43cfc2 None None] Port e6e780bc-5481-46c0-b1d4-140a4d417a11 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:45:13.739324 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c84ff1cc-8a5d-4e5b-a266-0df33f43cfc2 None None] Provisioning complete for port f466ec8c-c7fd-4a9a-beb5-e4041b079f89 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:13.740779 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c84ff1cc-8a5d-4e5b-a266-0df33f43cfc2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:13.750311 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-5975557a-de58-47c7-9a46-81e402c191c4 req-4401a4a1-7d96-4f67-95f2-06afeb1f3b65 service neutron] Attempting to bind port 31ee9adf-4bac-4e32-9223-f4e594f0639e on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:45:13.750662 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-5975557a-de58-47c7-9a46-81e402c191c4 req-4401a4a1-7d96-4f67-95f2-06afeb1f3b65 service neutron] Attempting to bind port 31ee9adf-4bac-4e32-9223-f4e594f0639e by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:45:13.750980 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5975557a-de58-47c7-9a46-81e402c191c4 req-4401a4a1-7d96-4f67-95f2-06afeb1f3b65 service neutron] Attempting to bind port 31ee9adf-4bac-4e32-9223-f4e594f0639e on network eda4cb39-afde-43d7-a13b-5227cc6862dd {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:45:13.762521 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5975557a-de58-47c7-9a46-81e402c191c4 req-4401a4a1-7d96-4f67-95f2-06afeb1f3b65 service neutron] Port 31ee9adf-4bac-4e32-9223-f4e594f0639e on network eda4cb39-afde-43d7-a13b-5227cc6862dd not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:45:13.762894 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5975557a-de58-47c7-9a46-81e402c191c4 req-4401a4a1-7d96-4f67-95f2-06afeb1f3b65 service neutron] Attempting to bind port 31ee9adf-4bac-4e32-9223-f4e594f0639e on network eda4cb39-afde-43d7-a13b-5227cc6862dd {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:45:13.777482 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-73e6bc2b-06c2-4d21-b122-792d822cf29a req-59a47feb-c342-49a3-aee8-b4c8af0e785a tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3003247 Dec 09 21:45:13.789526 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5975557a-de58-47c7-9a46-81e402c191c4 req-4401a4a1-7d96-4f67-95f2-06afeb1f3b65 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 44, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:45:13.799907 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5975557a-de58-47c7-9a46-81e402c191c4 req-4401a4a1-7d96-4f67-95f2-06afeb1f3b65 service neutron] Checking segment: {'id': '0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:45:13.799907 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5975557a-de58-47c7-9a46-81e402c191c4 req-4401a4a1-7d96-4f67-95f2-06afeb1f3b65 service neutron] Bound using segment: {'id': '0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:45:13.799907 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-5975557a-de58-47c7-9a46-81e402c191c4 req-4401a4a1-7d96-4f67-95f2-06afeb1f3b65 service neutron] Bound port: 31ee9adf-4bac-4e32-9223-f4e594f0639e, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:45:13.799907 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5975557a-de58-47c7-9a46-81e402c191c4 req-4401a4a1-7d96-4f67-95f2-06afeb1f3b65 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:13.818283 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1ed17e9d-cc68-4094-8b4b-99d37d8ad762 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:13.892338 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1ed17e9d-cc68-4094-8b4b-99d37d8ad762 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=37aadfda6cd547b3a2b597da939d4435&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6663566 Dec 09 21:45:13.901451 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40714) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:13.906295 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ed17e9d-cc68-4094-8b4b-99d37d8ad762 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=456a6769-843d-43ac-bd59-c543e532f957,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:13.974515 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-077c3bee-a4fd-45d1-8afe-583229b04226 req-6270c034-7671-4b7d-b5bc-57a950be84d4 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/ports?device_id=3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f HTTP/1.1" status: 200 len: 210 time: 0.0776997 Dec 09 21:45:13.991198 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1b952d16-6d7e-43c4-83c9-9931ec2db0c3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:13.997737 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-5975557a-de58-47c7-9a46-81e402c191c4 req-4401a4a1-7d96-4f67-95f2-06afeb1f3b65 service neutron] For port 31ee9adf-4bac-4e32-9223-f4e594f0639e, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:45:14.001960 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-5975557a-de58-47c7-9a46-81e402c191c4 req-4401a4a1-7d96-4f67-95f2-06afeb1f3b65 service neutron] For port 31ee9adf-4bac-4e32-9223-f4e594f0639e, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=31ee9adf-4bac-4e32-9223-f4e594f0639e,segment=NetworkSegment(0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5),segment_id=0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:45:14.033310 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-92f3e8c3-51fa-4941-8cdf-93ee00757ae3 None None] Provisioning complete for port e6e780bc-5481-46c0-b1d4-140a4d417a11 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:14.036495 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5975557a-de58-47c7-9a46-81e402c191c4 req-4401a4a1-7d96-4f67-95f2-06afeb1f3b65 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:14.036927 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-92f3e8c3-51fa-4941-8cdf-93ee00757ae3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:14.079628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Router 71037eba-17b6-499e-8ba6-3a08aa3db0b5 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:45:14.109305 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1b952d16-6d7e-43c4-83c9-9931ec2db0c3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:14.109618 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9be12553-adb1-4792-a1f0-5b72cb60cce0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:14.131231 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5975557a-de58-47c7-9a46-81e402c191c4 req-4401a4a1-7d96-4f67-95f2-06afeb1f3b65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:14.131940 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-5975557a-de58-47c7-9a46-81e402c191c4 req-4401a4a1-7d96-4f67-95f2-06afeb1f3b65 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:14.133481 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5975557a-de58-47c7-9a46-81e402c191c4 req-4401a4a1-7d96-4f67-95f2-06afeb1f3b65 service neutron] 10.222.0.31 "PUT /v2.0/ports/31ee9adf-4bac-4e32-9223-f4e594f0639e HTTP/1.1" status: 200 len: 1092 time: 1.8515956 Dec 09 21:45:14.133623 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7668213b-ac6d-43c5-b46f-b2efe3d5ee47 None None] DHCP port deletion for eda4cb39-afde-43d7-a13b-5227cc6862dd request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:45:14.134144 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ccb431db-4fc5-4654-a429-b211aed4747e', 'tag': '31ee9adf-4bac-4e32-9223-f4e594f0639e'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:45:14.136576 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d6f82b3f-eeae-4afe-ab70-50f80bc3d2a5" -d '{"events": [{"name": "network-changed", "server_uuid": "ccb431db-4fc5-4654-a429-b211aed4747e", "tag": "31ee9adf-4bac-4e32-9223-f4e594f0639e"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:45:14.142697 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-92f3e8c3-51fa-4941-8cdf-93ee00757ae3 None None] Port e6e780bc-5481-46c0-b1d4-140a4d417a11 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:45:14.209426 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4401a4a1-7d96-4f67-95f2-06afeb1f3b65 service neutron] Pushing event updated for resources: {'Port': ['ID=31ee9adf-4bac-4e32-9223-f4e594f0639e,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:14.221237 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:45:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8c3d2a38-b2fc-4c8a-879d-f7fb60702256 x-openstack-request-id: req-8c3d2a38-b2fc-4c8a-879d-f7fb60702256 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:45:14.221649 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ccb431db-4fc5-4654-a429-b211aed4747e", "tag": "31ee9adf-4bac-4e32-9223-f4e594f0639e", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:45:14.222106 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8c3d2a38-b2fc-4c8a-879d-f7fb60702256 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:45:14.222655 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ccb431db-4fc5-4654-a429-b211aed4747e', 'tag': '31ee9adf-4bac-4e32-9223-f4e594f0639e', 'status': 'completed', 'code': 200} Dec 09 21:45:14.225165 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9be12553-adb1-4792-a1f0-5b72cb60cce0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:14.288052 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-256ecac9-d845-4f23-ad8a-ac671ce14188 None None] Provisioning complete for port e6e780bc-5481-46c0-b1d4-140a4d417a11 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:14.288959 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-256ecac9-d845-4f23-ad8a-ac671ce14188 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:14.290064 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:45:14.299505 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6f82b3f-eeae-4afe-ab70-50f80bc3d2a5 req-85047520-1279-4003-b024-e74a279d3066 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:14.301278 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d6f82b3f-eeae-4afe-ab70-50f80bc3d2a5 req-85047520-1279-4003-b024-e74a279d3066 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6f2bd57ebcdc4c748e719519e3961b70&device_id=ccb431db-4fc5-4654-a429-b211aed4747e HTTP/1.1" status: 200 len: 1095 time: 0.0738456 Dec 09 21:45:14.304584 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d8ffb2e7-4329-414b-9814-fa88538e7b97 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "PUT /v2.0/routers/71037eba-17b6-499e-8ba6-3a08aa3db0b5/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.8485811 Dec 09 21:45:14.329253 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] Sync routers for ids ['71037eba-17b6-499e-8ba6-3a08aa3db0b5'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:45:14.331221 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1b952d16-6d7e-43c4-83c9-9931ec2db0c3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:14.336745 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9be12553-adb1-4792-a1f0-5b72cb60cce0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:14.339548 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9be12553-adb1-4792-a1f0-5b72cb60cce0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:14.340809 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9be12553-adb1-4792-a1f0-5b72cb60cce0 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/456a6769-843d-43ac-bd59-c543e532f957 HTTP/1.1" status: 204 len: 168 time: 0.4376676 Dec 09 21:45:14.362673 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9be12553-adb1-4792-a1f0-5b72cb60cce0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=456a6769-843d-43ac-bd59-c543e532f957,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:14.382070 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1b952d16-6d7e-43c4-83c9-9931ec2db0c3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:14.385602 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1b952d16-6d7e-43c4-83c9-9931ec2db0c3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "DELETE /v2.0/subnets/29523c9c-ae97-471c-a637-67d7fdefc076 HTTP/1.1" status: 204 len: 168 time: 0.8398540 Dec 09 21:45:14.386693 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b952d16-6d7e-43c4-83c9-9931ec2db0c3 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event deleted for resources: {'Subnet': ['ID=29523c9c-ae97-471c-a637-67d7fdefc076,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:14.390001 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40722) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:14.413935 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] Routers {'71037eba-17b6-499e-8ba6-3a08aa3db0b5'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:45:14.414604 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:45:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['71037eba-17b6-499e-8ba6-3a08aa3db0b5'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:14.438254 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-256ecac9-d845-4f23-ad8a-ac671ce14188 None None] Port e6e780bc-5481-46c0-b1d4-140a4d417a11 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:45:14.466252 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6f82b3f-eeae-4afe-ab70-50f80bc3d2a5 req-7a66dd4f-8ebe-452f-b390-fe7a43c2ebfb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:14.468606 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d6f82b3f-eeae-4afe-ab70-50f80bc3d2a5 req-7a66dd4f-8ebe-452f-b390-fe7a43c2ebfb service neutron] 10.222.0.31 "GET /v2.0/networks?tenant_id=6f2bd57ebcdc4c748e719519e3961b70&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1574788 Dec 09 21:45:14.507710 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c1b89103-f323-4121-9aba-a4ecf1834693 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:14.647350 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f466ec8c-c7fd-4a9a-beb5-e4041b079f89 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:45:14.715814 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6f82b3f-eeae-4afe-ab70-50f80bc3d2a5 req-c924c585-5d08-4980-a6b2-58a68f9d966d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:14.717763 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d6f82b3f-eeae-4afe-ab70-50f80bc3d2a5 req-c924c585-5d08-4980-a6b2-58a68f9d966d service neutron] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2357321 Dec 09 21:45:14.720391 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c1b89103-f323-4121-9aba-a4ecf1834693 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:14.724597 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] Set router 71037eba-17b6-499e-8ba6-3a08aa3db0b5 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:45:14.762708 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-8002256b-8956-4ad1-b323-13ab958fc2ac tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=289b15efb1cc4b5fbaefca8970d43a70&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0649755 Dec 09 21:45:14.782550 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f466ec8c-c7fd-4a9a-beb5-e4041b079f89 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:14.783037 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:14.783372 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-c1b89103-f323-4121-9aba-a4ecf1834693 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['74a4e90b-0273-461a-8432-d442c0560885']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:14.805364 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-86246e11-f32f-4fb4-a626-3427c4b3ac69 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-816323364&fields=id&tenant_id=dce7594ac2a74901912a2f19de04bf79 HTTP/1.1" status: 200 len: 267 time: 0.2581046 Dec 09 21:45:14.835782 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-c1b89103-f323-4121-9aba-a4ecf1834693 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bc677cbd-f272-4e6f-8e55-00e4343b9571') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:14.836347 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-c1b89103-f323-4121-9aba-a4ecf1834693 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bc677cbd-f272-4e6f-8e55-00e4343b9571') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:14.847700 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5975557a-de58-47c7-9a46-81e402c191c4 req-6aeae29f-d82d-4bcc-8156-5515708a9890 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:14.849763 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5975557a-de58-47c7-9a46-81e402c191c4 req-6aeae29f-d82d-4bcc-8156-5515708a9890 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6f2bd57ebcdc4c748e719519e3961b70&device_id=ccb431db-4fc5-4654-a429-b211aed4747e HTTP/1.1" status: 200 len: 1095 time: 0.0625770 Dec 09 21:45:14.897780 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c1b89103-f323-4121-9aba-a4ecf1834693 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:14.917192 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5975557a-de58-47c7-9a46-81e402c191c4 req-5a260e0a-0445-4279-81b7-978afcd555ff service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=31ee9adf-4bac-4e32-9223-f4e594f0639e HTTP/1.1" status: 200 len: 217 time: 0.0588620 Dec 09 21:45:14.987590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5975557a-de58-47c7-9a46-81e402c191c4 req-246b3c9d-2eb6-43a0-8300-afe461160ecb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:14.990167 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5975557a-de58-47c7-9a46-81e402c191c4 req-246b3c9d-2eb6-43a0-8300-afe461160ecb service neutron] 10.222.0.31 "GET /v2.0/subnets?id=24afae0e-0a38-484d-a023-a2fb471bdb33 HTTP/1.1" status: 200 len: 854 time: 0.0651894 Dec 09 21:45:14.998283 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c1b89103-f323-4121-9aba-a4ecf1834693 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:15.052020 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c1b89103-f323-4121-9aba-a4ecf1834693 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Releasing vlan 148 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:45:15.052540 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c1b89103-f323-4121-9aba-a4ecf1834693 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:15.052687 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5975557a-de58-47c7-9a46-81e402c191c4 req-3f91ea5d-a5d6-4539-81a0-272a87d2d94f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eda4cb39-afde-43d7-a13b-5227cc6862dd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0537984 Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:45:15.056871 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:45:15.115281 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'name': 'tempest-TestNetworkAdvancedServerOps-router-446132443', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53'}], 'enable_snat': True}, 'gw_port_id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:11Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2d:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2974, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'e6e780bc-5481-46c0-b1d4-140a4d417a11', 'name': '', 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:f9:a2:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'device_owner': 'network:router_interface', 'standard_attr_id': 2987, 'fixed_ips': [{'subnet_id': '017fde5b-ddc1-4da5-8c6b-2b98296748e5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:45:10Z', 'updated_at': '2021-12-09T21:45:12Z', 'revision_number': 2, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '017fde5b-ddc1-4da5-8c6b-2b98296748e5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:15.149632 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] Checking router: 71037eba-17b6-499e-8ba6-3a08aa3db0b5 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:45:15.150117 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] Updating router 71037eba-17b6-499e-8ba6-3a08aa3db0b5 port e6e780bc-5481-46c0-b1d4-140a4d417a11 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:45:15.155847 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-36d0f882-4e45-4aec-b96e-1b239bfa3bee tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:15.164318 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-36d0f882-4e45-4aec-b96e-1b239bfa3bee tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/networks?id=4fbe35af-30ff-45b2-b84a-21fea4abf9aa HTTP/1.1" status: 200 len: 797 time: 0.3443170 Dec 09 21:45:15.168691 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5975557a-de58-47c7-9a46-81e402c191c4 req-b64ac433-0030-483f-88fc-ae34a362028a service neutron] 10.222.0.31 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1072891 Dec 09 21:45:15.186859 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:15.198785 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-8e8f83f1-a4a4-4fd0-92c9-27a057cbc00d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/quotas/dce7594ac2a74901912a2f19de04bf79 HTTP/1.1" status: 200 len: 375 time: 0.0334778 Dec 09 21:45:15.209076 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-2a146aa4-ed28-4a42-bf49-5635734855ca tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:15.210645 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-2a146aa4-ed28-4a42-bf49-5635734855ca tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4017322 Dec 09 21:45:15.224360 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-8dfa3f6c-02f8-4d6c-bc8c-8bb780793731 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Request body: {'port': {'device_id': '3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '289b15efb1cc4b5fbaefca8970d43a70'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:15.228588 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c1b89103-f323-4121-9aba-a4ecf1834693 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:15.267179 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c1b89103-f323-4121-9aba-a4ecf1834693 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:15.270739 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c1b89103-f323-4121-9aba-a4ecf1834693 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] 10.222.0.13 "DELETE /v2.0/networks/74a4e90b-0273-461a-8432-d442c0560885 HTTP/1.1" status: 204 len: 168 time: 0.8796859 Dec 09 21:45:15.292886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1b89103-f323-4121-9aba-a4ecf1834693 tempest-FloatingIPTestJSON-705600385 tempest-FloatingIPTestJSON-705600385-project] Pushing event deleted for resources: {'Network': ['ID=74a4e90b-0273-461a-8432-d442c0560885,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:15.309341 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5975557a-de58-47c7-9a46-81e402c191c4 req-c293c6e1-f7b8-41a1-92de-92d7b38a8b3a service neutron] 10.222.0.31 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1328583 Dec 09 21:45:15.639066 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40762) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:15.644953 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:15.654463 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:15.681591 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-53471730-7a79-4371-bd96-1b135a1503bb tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&fields=id HTTP/1.1" status: 200 len: 302 time: 0.4819016 Dec 09 21:45:15.735119 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b9de2c0-0bc7-466a-ab86-75684854114d None None] Pushing event updated for resources: {'Port': ['ID=e6e780bc-5481-46c0-b1d4-140a4d417a11,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:15.845387 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-8dfa3f6c-02f8-4d6c-bc8c-8bb780793731 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Made reservation on behalf of 289b15efb1cc4b5fbaefca8970d43a70 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:15.847661 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f00272f4-f908-4795-ac0e-878221bdb7fa admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=1752f69b83904328a79fb89f35377bcf&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2069452 Dec 09 21:45:15.849608 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-8dfa3f6c-02f8-4d6c-bc8c-8bb780793731 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:15.850332 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40776) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:15.861276 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] Attempting to bind port e6e780bc-5481-46c0-b1d4-140a4d417a11 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:45:15.861649 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] Attempting to bind port e6e780bc-5481-46c0-b1d4-140a4d417a11 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '2316fee1-a288-4d09-bf17-e0a19e0adf8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:45:15.862011 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] Attempting to bind port e6e780bc-5481-46c0-b1d4-140a4d417a11 on network 4fbe35af-30ff-45b2-b84a-21fea4abf9aa {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:45:15.877074 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 45, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:45:15.878172 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] Checking segment: {'id': '2316fee1-a288-4d09-bf17-e0a19e0adf8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:45:15.879146 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:15.879967 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] Bound using segment: {'id': '2316fee1-a288-4d09-bf17-e0a19e0adf8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:45:15.880955 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] Bound port: e6e780bc-5481-46c0-b1d4-140a4d417a11, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2316fee1-a288-4d09-bf17-e0a19e0adf8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:45:15.881554 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-8dfa3f6c-02f8-4d6c-bc8c-8bb780793731 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:15.881924 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:15.918790 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-aba490cb-c9bd-47ba-b727-4a3ce74ae160 service neutron] 10.222.0.13 "GET /v2.0/networks/4fbe35af-30ff-45b2-b84a-21fea4abf9aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2152884 Dec 09 21:45:15.925343 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d6d15272-d8c6-42be-bc25-ff9a42144874 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:15.958291 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d6d15272-d8c6-42be-bc25-ff9a42144874 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:16.013105 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] For port e6e780bc-5481-46c0-b1d4-140a4d417a11, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:45:16.018289 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] For port e6e780bc-5481-46c0-b1d4-140a4d417a11, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e6e780bc-5481-46c0-b1d4-140a4d417a11,segment=NetworkSegment(2316fee1-a288-4d09-bf17-e0a19e0adf8d),segment_id=2316fee1-a288-4d09-bf17-e0a19e0adf8d)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:45:16.023801 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d6d15272-d8c6-42be-bc25-ff9a42144874 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:16.027312 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d6d15272-d8c6-42be-bc25-ff9a42144874 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:16.027666 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:16.028937 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d6d15272-d8c6-42be-bc25-ff9a42144874 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/6d0f0193-455f-4bec-9a89-2c209aef5053 HTTP/1.1" status: 204 len: 168 time: 0.1769533 Dec 09 21:45:16.059650 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-bb7994fe-b84e-44c3-a4db-01960c069063 service neutron] 10.222.0.13 "GET /v2.0/networks/4fbe35af-30ff-45b2-b84a-21fea4abf9aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1324639 Dec 09 21:45:16.060198 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6d15272-d8c6-42be-bc25-ff9a42144874 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6d0f0193-455f-4bec-9a89-2c209aef5053,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:16.142035 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-8dfa3f6c-02f8-4d6c-bc8c-8bb780793731 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:16.142403 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] Routers {'71037eba-17b6-499e-8ba6-3a08aa3db0b5'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:45:16.144379 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:45:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['71037eba-17b6-499e-8ba6-3a08aa3db0b5'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:16.147270 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-8dfa3f6c-02f8-4d6c-bc8c-8bb780793731 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:16.220606 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dfa3f6c-02f8-4d6c-bc8c-8bb780793731 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Pushing event updated for resources: {'SecurityGroup': ['ID=70b6e8f6-3793-4fd9-91c8-b7d3cb7e3581,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:16.289324 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40782) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:16.324192 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] Set router 71037eba-17b6-499e-8ba6-3a08aa3db0b5 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:45:16.340605 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6b7e9c44-8b3a-4654-b26a-e8062ae23d7f None None] Provisioning complete for port e6e780bc-5481-46c0-b1d4-140a4d417a11 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:16.341023 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6b7e9c44-8b3a-4654-b26a-e8062ae23d7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:16.420676 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b9de2c0-0bc7-466a-ab86-75684854114d None None] Pushing event updated for resources: {'Port': ['ID=e6e780bc-5481-46c0-b1d4-140a4d417a11,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:16.521474 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-8dfa3f6c-02f8-4d6c-bc8c-8bb780793731 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Allocated IP 192.168.233.132 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/cfd5c800-4c6d-4766-9675-137da0da42a4) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:45:16.534957 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcb43f33-1e65-40c1-947a-0fe52165dc6c req-23dfc5a4-2cc7-47a0-9709-4238c539b72a tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:16.536795 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fcb43f33-1e65-40c1-947a-0fe52165dc6c req-23dfc5a4-2cc7-47a0-9709-4238c539b72a tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ccb431db-4fc5-4654-a429-b211aed4747e HTTP/1.1" status: 200 len: 943 time: 0.1392572 Dec 09 21:45:16.649639 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fcb43f33-1e65-40c1-947a-0fe52165dc6c req-7765d447-6e75-45be-b4b5-8d3ae04895bf tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1040134 Dec 09 21:45:16.666476 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6b7e9c44-8b3a-4654-b26a-e8062ae23d7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:16.668214 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8f5c601-b8c7-4aeb-85c2-2078ac08e4c1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:16.788089 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6b7e9c44-8b3a-4654-b26a-e8062ae23d7f None None] For port e6e780bc-5481-46c0-b1d4-140a4d417a11, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e6e780bc-5481-46c0-b1d4-140a4d417a11,segment=NetworkSegment(2316fee1-a288-4d09-bf17-e0a19e0adf8d),segment_id=2316fee1-a288-4d09-bf17-e0a19e0adf8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:16.801483 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6b7e9c44-8b3a-4654-b26a-e8062ae23d7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:16.812706 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8f5c601-b8c7-4aeb-85c2-2078ac08e4c1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:16.820013 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8f5c601-b8c7-4aeb-85c2-2078ac08e4c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:16.869977 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8f5c601-b8c7-4aeb-85c2-2078ac08e4c1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=743fdb83-f3c4-40c4-80fc-3d3def62423b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:16.886619 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-566db2f4-93c8-45f4-ae44-40403268d130 req-979d1361-b077-4924-bce0-c096d9506d68 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/ports?device_id=3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f HTTP/1.1" status: 200 len: 210 time: 0.0791874 Dec 09 21:45:16.895930 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c8f5c601-b8c7-4aeb-85c2-2078ac08e4c1 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=bba2fe6ea9c147fca18072a45d9d1f79&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6024160 Dec 09 21:45:16.896668 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40806) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:16.951377 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-8dfa3f6c-02f8-4d6c-bc8c-8bb780793731 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:17.007100 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c57352b4-ed6e-453d-8d24-0e1c3cee43cb req-9976f741-9959-47c2-a7c3-743c46938999 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 210 time: 0.0352790 Dec 09 21:45:17.041229 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-58336679-4750-490b-a8c2-7657a3e2700a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:17.059296 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-8dfa3f6c-02f8-4d6c-bc8c-8bb780793731 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:17.082531 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'name': 'tempest-TestNetworkAdvancedServerOps-router-446132443', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53'}], 'enable_snat': True}, 'gw_port_id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:11Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2d:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2974, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'e6e780bc-5481-46c0-b1d4-140a4d417a11', 'name': '', 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:f9:a2:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'device_owner': 'network:router_interface', 'standard_attr_id': 2987, 'fixed_ips': [{'subnet_id': '017fde5b-ddc1-4da5-8c6b-2b98296748e5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:45:10Z', 'updated_at': '2021-12-09T21:45:16Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '017fde5b-ddc1-4da5-8c6b-2b98296748e5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:17.093981 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-58336679-4750-490b-a8c2-7657a3e2700a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:17.118613 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3bac79ea-e232-4a96-b843-13b3bc393b25 None None] The sync data for ids ['71037eba-17b6-499e-8ba6-3a08aa3db0b5'] in n-d-713301-27 is: [{'id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'name': 'tempest-TestNetworkAdvancedServerOps-router-446132443', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53'}], 'enable_snat': True}, 'gw_port_id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:11Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2d:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2974, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'e6e780bc-5481-46c0-b1d4-140a4d417a11', 'name': '', 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:f9:a2:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'device_owner': 'network:router_interface', 'standard_attr_id': 2987, 'fixed_ips': [{'subnet_id': '017fde5b-ddc1-4da5-8c6b-2b98296748e5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:45:10Z', 'updated_at': '2021-12-09T21:45:16Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '017fde5b-ddc1-4da5-8c6b-2b98296748e5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:45:17.126594 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6abc6f81-214b-40f7-9f4d-556ce3318566 None None] Provisioning complete for port e6e780bc-5481-46c0-b1d4-140a4d417a11 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:17.126969 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6abc6f81-214b-40f7-9f4d-556ce3318566 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:17.130332 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b7e9c44-8b3a-4654-b26a-e8062ae23d7f None None] Pushing event updated for resources: {'Port': ['ID=e6e780bc-5481-46c0-b1d4-140a4d417a11,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:17.171852 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-8dfa3f6c-02f8-4d6c-bc8c-8bb780793731 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:45:17.175521 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-8dfa3f6c-02f8-4d6c-bc8c-8bb780793731 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:17.183905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-8dfa3f6c-02f8-4d6c-bc8c-8bb780793731 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:45:17.258762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dfa3f6c-02f8-4d6c-bc8c-8bb780793731 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Pushing event updated for resources: {'Port': ['ID=cfd5c800-4c6d-4766-9675-137da0da42a4,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:17.280663 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-58336679-4750-490b-a8c2-7657a3e2700a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:17.287788 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-58336679-4750-490b-a8c2-7657a3e2700a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:17.289100 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-58336679-4750-490b-a8c2-7657a3e2700a admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/743fdb83-f3c4-40c4-80fc-3d3def62423b HTTP/1.1" status: 204 len: 168 time: 0.3915517 Dec 09 21:45:17.315257 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-8dfa3f6c-02f8-4d6c-bc8c-8bb780793731 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:17.316024 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-8dfa3f6c-02f8-4d6c-bc8c-8bb780793731 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:17.319715 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58336679-4750-490b-a8c2-7657a3e2700a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=743fdb83-f3c4-40c4-80fc-3d3def62423b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:17.347238 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-8dfa3f6c-02f8-4d6c-bc8c-8bb780793731 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 2.1279562 Dec 09 21:45:17.362760 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-72fa43f8-0729-4a89-8cb1-bb23815cc8ca service neutron] Request body: {'port': {'device_id': '3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:17.472369 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-72fa43f8-0729-4a89-8cb1-bb23815cc8ca service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:17.592885 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-87455cab-3577-4ff2-97ca-42b1d90cf1c8 None None] Provisioning complete for port cfd5c800-4c6d-4766-9675-137da0da42a4 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:17.593249 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-87455cab-3577-4ff2-97ca-42b1d90cf1c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:17.604796 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40822) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:17.664981 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-87455cab-3577-4ff2-97ca-42b1d90cf1c8 None None] Port cfd5c800-4c6d-4766-9675-137da0da42a4 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:45:17.829089 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b47c1586-ca85-4494-b213-f0a01c736fde tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] Request body: {'port': {'network_id': '28e6cf27-7027-427e-b496-c9c48098517e', 'name': 'tempest-NetworksNegativeTestJSON-736120092'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:17.853994 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deb861fc-680b-423e-9ec0-623f1a69ef14 req-f4f6684c-a0d4-4609-9e73-a4f572c1d90e tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:17.855563 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-b47c1586-ca85-4494-b213-f0a01c736fde tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] POST failed (client error): The resource could not be found. Dec 09 21:45:17.856196 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b47c1586-ca85-4494-b213-f0a01c736fde tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:45:17.857449 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b47c1586-ca85-4494-b213-f0a01c736fde tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 404 len: 339 time: 0.2515051 Dec 09 21:45:17.864552 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40832) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:17.864803 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-deb861fc-680b-423e-9ec0-623f1a69ef14 req-f4f6684c-a0d4-4609-9e73-a4f572c1d90e tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ccb431db-4fc5-4654-a429-b211aed4747e HTTP/1.1" status: 200 len: 943 time: 0.1341388 Dec 09 21:45:17.898702 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-9b706186-86d4-4874-91b7-69b4f93ba993 tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] DELETE failed (client error): The resource could not be found. Dec 09 21:45:17.899348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9b706186-86d4-4874-91b7-69b4f93ba993 tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:45:17.907667 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9b706186-86d4-4874-91b7-69b4f93ba993 tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] 10.222.0.13 "DELETE /v2.0/networks/54b4b957-1a08-4f2d-a12f-1b22351cf1a3 HTTP/1.1" status: 404 len: 339 time: 0.0407128 Dec 09 21:45:17.908359 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40834) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:17.948357 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-9d39fbad-d36c-450b-be95-9f55258424e7 tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] DELETE failed (client error): The resource could not be found. Dec 09 21:45:17.949222 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9d39fbad-d36c-450b-be95-9f55258424e7 tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:45:17.957309 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40840) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:17.958148 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9d39fbad-d36c-450b-be95-9f55258424e7 tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] 10.222.0.13 "DELETE /v2.0/ports/a40cf3e8-72da-4c52-850d-2954d055a319 HTTP/1.1" status: 404 len: 333 time: 0.0481064 Dec 09 21:45:18.018708 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-deb861fc-680b-423e-9ec0-623f1a69ef14 req-9fa065e4-d8ee-4fd7-bcc7-791c17998d87 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1415112 Dec 09 21:45:18.054838 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-d2020da0-e8a7-434f-b0dc-724663bf0bfd tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] DELETE failed (client error): The resource could not be found. Dec 09 21:45:18.055204 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-d2020da0-e8a7-434f-b0dc-724663bf0bfd tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:45:18.064284 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40846) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:18.075952 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d2020da0-e8a7-434f-b0dc-724663bf0bfd tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] 10.222.0.13 "DELETE /v2.0/subnets/44c07d4f-d7cf-4e97-8671-951991552d57 HTTP/1.1" status: 404 len: 337 time: 0.1154387 Dec 09 21:45:18.090538 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-6135dd13-95a3-4fb1-90df-81667ddf946f tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] GET failed (client error): The resource could not be found. Dec 09 21:45:18.097009 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6135dd13-95a3-4fb1-90df-81667ddf946f tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] 10.222.0.13 "GET /v2.0/networks/d13fb7bb-b745-48c6-afc0-e4b2703bb12d HTTP/1.1" status: 404 len: 339 time: 0.0304132 Dec 09 21:45:18.097655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40848) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:18.107543 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-72fa43f8-0729-4a89-8cb1-bb23815cc8ca service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cfd5c800-4c6d-4766-9675-137da0da42a4 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:45:18.117153 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-72fa43f8-0729-4a89-8cb1-bb23815cc8ca service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:18.132268 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-32f2ad38-73f1-4bab-aa27-2b6a92c87058 tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] GET failed (client error): The resource could not be found. Dec 09 21:45:18.133805 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-32f2ad38-73f1-4bab-aa27-2b6a92c87058 tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] 10.222.0.13 "GET /v2.0/ports/e45ecfd9-ddae-4c68-9bba-224a19a1716a HTTP/1.1" status: 404 len: 333 time: 0.0349035 Dec 09 21:45:18.137272 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 31ee9adf-4bac-4e32-9223-f4e594f0639e details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:45:18.137790 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40850) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:18.173812 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-2cff7ef7-71f8-4202-a000-3be9192ba407 tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] GET failed (client error): The resource could not be found. Dec 09 21:45:18.175119 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2cff7ef7-71f8-4202-a000-3be9192ba407 tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] 10.222.0.13 "GET /v2.0/subnets/f9f083c4-2ea2-4c56-ac62-72733ff32459 HTTP/1.1" status: 404 len: 337 time: 0.0367453 Dec 09 21:45:18.179063 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40854) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:18.184327 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ec1aaa18-d7d7-4fe1-b230-b37d6fc48486 tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] Request body: {'network': {'name': 'new_name'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:18.190240 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-72fa43f8-0729-4a89-8cb1-bb23815cc8ca service neutron] Transition to ACTIVE for port object cfd5c800-4c6d-4766-9675-137da0da42a4 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:45:18.202841 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-72fa43f8-0729-4a89-8cb1-bb23815cc8ca service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:18.205844 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-ec1aaa18-d7d7-4fe1-b230-b37d6fc48486 tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] PUT failed (client error): The resource could not be found. Dec 09 21:45:18.206364 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ec1aaa18-d7d7-4fe1-b230-b37d6fc48486 tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:45:18.207845 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ec1aaa18-d7d7-4fe1-b230-b37d6fc48486 tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] 10.222.0.13 "PUT /v2.0/networks/78ce7728-c1c6-4ddc-a933-c873830f583e HTTP/1.1" status: 404 len: 339 time: 0.0276334 Dec 09 21:45:18.214532 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40856) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:18.220554 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-268f98f3-3cf8-44c4-831a-20880a2fa2aa tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] Request body: {'port': {'name': 'new_name'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:18.243655 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-268f98f3-3cf8-44c4-831a-20880a2fa2aa tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] PUT failed (client error): The resource could not be found. Dec 09 21:45:18.244289 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-268f98f3-3cf8-44c4-831a-20880a2fa2aa tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:45:18.246561 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-268f98f3-3cf8-44c4-831a-20880a2fa2aa tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] 10.222.0.13 "PUT /v2.0/ports/76a10826-65ac-43ea-9931-6834c41cbf08 HTTP/1.1" status: 404 len: 333 time: 0.0303576 Dec 09 21:45:18.252348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40860) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:18.260184 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b31a46a4-9660-4f1d-94f9-94a60396ecc2 tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] Request body: {'subnet': {'name': 'new_name'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:18.289973 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-b31a46a4-9660-4f1d-94f9-94a60396ecc2 tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] PUT failed (client error): The resource could not be found. Dec 09 21:45:18.290746 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b31a46a4-9660-4f1d-94f9-94a60396ecc2 tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:45:18.292027 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b31a46a4-9660-4f1d-94f9-94a60396ecc2 tempest-NetworksNegativeTestJSON-1486662450 tempest-NetworksNegativeTestJSON-1486662450-project] 10.222.0.13 "PUT /v2.0/subnets/f812e4e7-8edb-45be-8096-9735dcb2cb9e HTTP/1.1" status: 404 len: 337 time: 0.0384924 Dec 09 21:45:18.380227 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 31ee9adf-4bac-4e32-9223-f4e594f0639e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=31ee9adf-4bac-4e32-9223-f4e594f0639e,segment=NetworkSegment(0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5),segment_id=0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:18.403701 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '31ee9adf-4bac-4e32-9223-f4e594f0639e', 'network_id': 'eda4cb39-afde-43d7-a13b-5227cc6862dd', 'port_id': '31ee9adf-4bac-4e32-9223-f4e594f0639e', 'mac_address': 'fa:16:3e:74:89:86', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '24afae0e-0a38-484d-a023-a2fb471bdb33', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:45:18.512148 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:18.525498 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61ee6b50-cca9-4bb6-b0cb-bc46b03752c3 req-9f7837fe-9915-4044-b513-bf3503ce2be4 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:18.533443 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-61ee6b50-cca9-4bb6-b0cb-bc46b03752c3 req-9f7837fe-9915-4044-b513-bf3503ce2be4 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/ports?device_id=3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f HTTP/1.1" status: 200 len: 936 time: 0.4132664 Dec 09 21:45:18.546757 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72fa43f8-0729-4a89-8cb1-bb23815cc8ca service neutron] Pushing event updated for resources: {'Port': ['ID=cfd5c800-4c6d-4766-9675-137da0da42a4,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:18.576554 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-72fa43f8-0729-4a89-8cb1-bb23815cc8ca service neutron] Attempting to bind port cfd5c800-4c6d-4766-9675-137da0da42a4 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:45:18.577277 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-72fa43f8-0729-4a89-8cb1-bb23815cc8ca service neutron] Attempting to bind port cfd5c800-4c6d-4766-9675-137da0da42a4 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:45:18.578167 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-72fa43f8-0729-4a89-8cb1-bb23815cc8ca service neutron] Attempting to bind port cfd5c800-4c6d-4766-9675-137da0da42a4 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:45:18.581279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 31ee9adf-4bac-4e32-9223-f4e594f0639e {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:45:18.593908 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-72fa43f8-0729-4a89-8cb1-bb23815cc8ca service neutron] Port cfd5c800-4c6d-4766-9675-137da0da42a4 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:45:18.594234 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-72fa43f8-0729-4a89-8cb1-bb23815cc8ca service neutron] Attempting to bind port cfd5c800-4c6d-4766-9675-137da0da42a4 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:45:18.620041 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 31ee9adf-4bac-4e32-9223-f4e594f0639e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=31ee9adf-4bac-4e32-9223-f4e594f0639e,segment=NetworkSegment(0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5),segment_id=0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:18.630916 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:18.658063 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-8b54a673-5c1f-4b21-a1bf-2db1f58ae446 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:18.662408 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-8b54a673-5c1f-4b21-a1bf-2db1f58ae446 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.31 "GET /v2.0/networks?id=4fbe35af-30ff-45b2-b84a-21fea4abf9aa HTTP/1.1" status: 200 len: 797 time: 0.2873116 Dec 09 21:45:18.684993 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-61ee6b50-cca9-4bb6-b0cb-bc46b03752c3 req-e792f2c8-270c-40f1-9131-678a737a0e43 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/security-groups?id=70b6e8f6-3793-4fd9-91c8-b7d3cb7e3581&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1455162 Dec 09 21:45:18.701054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-72fa43f8-0729-4a89-8cb1-bb23815cc8ca service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 44, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:45:18.701396 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-72fa43f8-0729-4a89-8cb1-bb23815cc8ca service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:45:18.701988 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-72fa43f8-0729-4a89-8cb1-bb23815cc8ca service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:45:18.704651 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-72fa43f8-0729-4a89-8cb1-bb23815cc8ca service neutron] Bound port: cfd5c800-4c6d-4766-9675-137da0da42a4, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:45:18.706761 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-72fa43f8-0729-4a89-8cb1-bb23815cc8ca service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:18.804864 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=31ee9adf-4bac-4e32-9223-f4e594f0639e,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:18.829204 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e6e780bc-5481-46c0-b1d4-140a4d417a11 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:45:18.851213 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-cd928cfb-0c68-46bd-af20-405233ec6cfe tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=dce7594ac2a74901912a2f19de04bf79 HTTP/1.1" status: 200 len: 379 time: 0.1619806 Dec 09 21:45:18.857478 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-a32cb15f-9a84-496a-b262-80abe12cb14e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'port': {'device_id': '9c9545e3-43c2-403d-a699-e38d4f4c2a1b', 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa', 'admin_state_up': True, 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'security_groups': ['f44a1e28-df99-474a-b80e-b3989956be0c']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:18.869775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40872) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:18.876806 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-72fa43f8-0729-4a89-8cb1-bb23815cc8ca service neutron] For port cfd5c800-4c6d-4766-9675-137da0da42a4, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:45:18.880820 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-72fa43f8-0729-4a89-8cb1-bb23815cc8ca service neutron] For port cfd5c800-4c6d-4766-9675-137da0da42a4, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=cfd5c800-4c6d-4766-9675-137da0da42a4,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:45:18.902177 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-72fa43f8-0729-4a89-8cb1-bb23815cc8ca service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:18.906371 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['31ee9adf-4bac-4e32-9223-f4e594f0639e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:45:18.945191 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f7af9ff-48a5-4c22-9bf4-a3060c743414 req-55400731-559d-4054-889d-db69551d026c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 210 time: 0.0579093 Dec 09 21:45:18.988359 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-72fa43f8-0729-4a89-8cb1-bb23815cc8ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:18.991896 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-72fa43f8-0729-4a89-8cb1-bb23815cc8ca service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:18.993733 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-72fa43f8-0729-4a89-8cb1-bb23815cc8ca service neutron] 10.222.0.31 "PUT /v2.0/ports/cfd5c800-4c6d-4766-9675-137da0da42a4 HTTP/1.1" status: 200 len: 1097 time: 1.6383882 Dec 09 21:45:18.998327 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f', 'tag': 'cfd5c800-4c6d-4766-9675-137da0da42a4'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:45:19.001437 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b1e943fb-1056-44c5-9964-519f1cd22445" -d '{"events": [{"name": "network-changed", "server_uuid": "3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f", "tag": "cfd5c800-4c6d-4766-9675-137da0da42a4"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:45:19.105021 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port e6e780bc-5481-46c0-b1d4-140a4d417a11 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:19.105400 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:19.135566 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:45:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1b28e7d9-07be-421a-8c72-07103de149a6 x-openstack-request-id: req-1b28e7d9-07be-421a-8c72-07103de149a6 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:45:19.135848 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f", "tag": "cfd5c800-4c6d-4766-9675-137da0da42a4", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:45:19.135955 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-1b28e7d9-07be-421a-8c72-07103de149a6 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:45:19.136356 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f', 'tag': 'cfd5c800-4c6d-4766-9675-137da0da42a4', 'status': 'completed', 'code': 200} Dec 09 21:45:19.170544 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72fa43f8-0729-4a89-8cb1-bb23815cc8ca service neutron] Pushing event updated for resources: {'Port': ['ID=cfd5c800-4c6d-4766-9675-137da0da42a4,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:19.205802 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-800fb6fd-251b-4f77-b799-9d3a72213437 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:19.207392 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-800fb6fd-251b-4f77-b799-9d3a72213437 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=289b15efb1cc4b5fbaefca8970d43a70&device_id=3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f HTTP/1.1" status: 200 len: 1100 time: 0.1416757 Dec 09 21:45:19.209105 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-a32cb15f-9a84-496a-b262-80abe12cb14e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Made reservation on behalf of dce7594ac2a74901912a2f19de04bf79 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:19.218293 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-a32cb15f-9a84-496a-b262-80abe12cb14e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:19.323177 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-a9f6f073-e9dd-40b3-a0c2-7e85f5794c96 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.132&port_id=cfd5c800-4c6d-4766-9675-137da0da42a4 HTTP/1.1" status: 200 len: 217 time: 0.1013997 Dec 09 21:45:19.379048 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ed688b73-d751-4332-9b46-19745e5e3d55 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:19.385710 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-edd5b846-897e-4b28-8ba7-87e1eb2577c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:19.387199 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-edd5b846-897e-4b28-8ba7-87e1eb2577c4 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0530357 Dec 09 21:45:19.402874 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74a89507-b0cc-4b53-9918-0c40dd92601e req-7c29ac5e-1003-4ffc-ae2f-669c735723f4 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:19.413315 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-74a89507-b0cc-4b53-9918-0c40dd92601e req-7c29ac5e-1003-4ffc-ae2f-669c735723f4 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ccb431db-4fc5-4654-a429-b211aed4747e HTTP/1.1" status: 200 len: 944 time: 0.1747389 Dec 09 21:45:19.483480 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-a32cb15f-9a84-496a-b262-80abe12cb14e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Allocated IP 172.20.0.12 (4fbe35af-30ff-45b2-b84a-21fea4abf9aa/017fde5b-ddc1-4da5-8c6b-2b98296748e5/201bc3ab-e2ab-4e46-9cc3-b13f3373442f) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:45:19.511990 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-8389e0ad-b4b3-4fc7-908a-1a0ca25d0dec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:19.514504 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-8389e0ad-b4b3-4fc7-908a-1a0ca25d0dec service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0923362 Dec 09 21:45:19.547754 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ed688b73-d751-4332-9b46-19745e5e3d55 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:19.554741 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ed688b73-d751-4332-9b46-19745e5e3d55 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:19.556444 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-74a89507-b0cc-4b53-9918-0c40dd92601e req-f7cb80f5-d0fd-4ff8-a8d9-a80059d77e50 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1421676 Dec 09 21:45:19.646119 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-484108a8-d3ac-400d-9c97-710b11b7dcb6 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1235905 Dec 09 21:45:19.650647 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed688b73-d751-4332-9b46-19745e5e3d55 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=52028abd-27aa-4501-81cf-0e8c1279e083,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:19.655950 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ed688b73-d751-4332-9b46-19745e5e3d55 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=5aa2b73e83794a9496aceb7c13caf8e0&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7826743 Dec 09 21:45:19.661264 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40892) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:19.745177 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-a32cb15f-9a84-496a-b262-80abe12cb14e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:19.763290 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5e086ba9-f9c9-47b5-811c-6eaefd744d29 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:19.793572 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f3709e9-7632-4e29-b481-8e1afe449324 req-41c63ed3-7915-4e63-972f-eaa13e0c1613 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1386867 Dec 09 21:45:19.807551 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5e086ba9-f9c9-47b5-811c-6eaefd744d29 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:19.835423 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-229ae2b6-79dd-4746-9f8b-6404679f6695 req-0f2ffcdc-558d-492b-ac28-18bf23e3f8b6 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:19.839004 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-a32cb15f-9a84-496a-b262-80abe12cb14e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:19.843899 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-229ae2b6-79dd-4746-9f8b-6404679f6695 req-0f2ffcdc-558d-492b-ac28-18bf23e3f8b6 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/ports?device_id=3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f HTTP/1.1" status: 200 len: 948 time: 0.0923381 Dec 09 21:45:19.894935 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-a32cb15f-9a84-496a-b262-80abe12cb14e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network 4fbe35af-30ff-45b2-b84a-21fea4abf9aa is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:45:19.903466 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-a32cb15f-9a84-496a-b262-80abe12cb14e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:19.913350 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-a32cb15f-9a84-496a-b262-80abe12cb14e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:45:19.923857 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5e086ba9-f9c9-47b5-811c-6eaefd744d29 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:19.927044 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5e086ba9-f9c9-47b5-811c-6eaefd744d29 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:19.927694 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1e943fb-1056-44c5-9964-519f1cd22445 req-23c4b0f7-5dd6-459e-b4f7-933ca3980fab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:19.929216 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1e943fb-1056-44c5-9964-519f1cd22445 req-23c4b0f7-5dd6-459e-b4f7-933ca3980fab service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=289b15efb1cc4b5fbaefca8970d43a70&device_id=3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f HTTP/1.1" status: 200 len: 1100 time: 0.0693176 Dec 09 21:45:19.933205 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5e086ba9-f9c9-47b5-811c-6eaefd744d29 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/52028abd-27aa-4501-81cf-0e8c1279e083 HTTP/1.1" status: 204 len: 168 time: 0.2714372 Dec 09 21:45:19.935502 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-229ae2b6-79dd-4746-9f8b-6404679f6695 req-01ba8fff-c55d-42b6-a702-a35614bc542f tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/security-groups?id=70b6e8f6-3793-4fd9-91c8-b7d3cb7e3581&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0907564 Dec 09 21:45:19.962381 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40904) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:19.972671 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a32cb15f-9a84-496a-b262-80abe12cb14e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Port': ['ID=201bc3ab-e2ab-4e46-9cc3-b13f3373442f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:20.001442 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e086ba9-f9c9-47b5-811c-6eaefd744d29 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=52028abd-27aa-4501-81cf-0e8c1279e083,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:20.045368 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-a32cb15f-9a84-496a-b262-80abe12cb14e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:20.046989 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-a32cb15f-9a84-496a-b262-80abe12cb14e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:20.083675 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-a32cb15f-9a84-496a-b262-80abe12cb14e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.2300031 Dec 09 21:45:20.087646 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1e943fb-1056-44c5-9964-519f1cd22445 req-2cd12476-233d-4bc2-8dc3-8ee398fa1b8f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:20.089423 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1e943fb-1056-44c5-9964-519f1cd22445 req-2cd12476-233d-4bc2-8dc3-8ee398fa1b8f service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.1530192 Dec 09 21:45:20.096683 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-5a6516c0-f1be-49c9-8cd8-5cef60c4839a service neutron] Request body: {'port': {'device_id': '9c9545e3-43c2-403d-a699-e38d4f4c2a1b', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:20.148029 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-7bba5415-ad3f-4510-97c6-523746ba3cc3 tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] Request body: {'quota': {'network': 0, 'port': 0}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:20.149740 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 31ee9adf-4bac-4e32-9223-f4e594f0639e up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:45:20.167287 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-5a6516c0-f1be-49c9-8cd8-5cef60c4839a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:20.217597 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1e943fb-1056-44c5-9964-519f1cd22445 req-095672d5-0791-415a-ad32-72b1db3fa363 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.132&port_id=cfd5c800-4c6d-4766-9675-137da0da42a4 HTTP/1.1" status: 200 len: 217 time: 0.1159396 Dec 09 21:45:20.253142 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 31ee9adf-4bac-4e32-9223-f4e594f0639e completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:45:20.260557 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 31ee9adf-4bac-4e32-9223-f4e594f0639e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:20.260818 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:20.293126 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a4ba4604-83e5-475b-af3e-ff3784c3f007 None None] Provisioning complete for port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:20.293715 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4ba4604-83e5-475b-af3e-ff3784c3f007 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:20.301036 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7283461-d3be-4f36-8186-1115e725b028 req-4b9829ce-a040-49c0-9c7a-101e522204b5 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:20.303536 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d7283461-d3be-4f36-8186-1115e725b028 req-4b9829ce-a040-49c0-9c7a-101e522204b5 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 932 time: 0.2028441 Dec 09 21:45:20.319953 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1e943fb-1056-44c5-9964-519f1cd22445 req-03aeee61-9996-4b44-b061-7030235e2434 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:20.321618 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1e943fb-1056-44c5-9964-519f1cd22445 req-03aeee61-9996-4b44-b061-7030235e2434 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0946784 Dec 09 21:45:20.354508 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a4ba4604-83e5-475b-af3e-ff3784c3f007 None None] Port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:45:20.366833 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7bba5415-ad3f-4510-97c6-523746ba3cc3 tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] 10.222.0.13 "PUT /v2.0/quotas/1b3d1dd09025402c8fa08f3a7eba9749 HTTP/1.1" status: 200 len: 366 time: 0.4010184 Dec 09 21:45:20.377481 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40914) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:20.407046 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e7a994f8-4a39-45d3-be03-15619430482a tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] 10.222.0.13 "GET /v2.0/quotas HTTP/1.1" status: 200 len: 732 time: 0.0272837 Dec 09 21:45:20.414396 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40918) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:20.416110 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:20.439554 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1e943fb-1056-44c5-9964-519f1cd22445 req-df71cc4a-f682-424a-95e2-ca157bab0926 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:20.441644 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1e943fb-1056-44c5-9964-519f1cd22445 req-df71cc4a-f682-424a-95e2-ca157bab0926 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1087980 Dec 09 21:45:20.441957 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ccb431db-4fc5-4654-a429-b211aed4747e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '31ee9adf-4bac-4e32-9223-f4e594f0639e'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:45:20.444421 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4817ba65-c6b2-459f-8e1c-61c8523306d5" -d '{"events": [{"server_uuid": "ccb431db-4fc5-4654-a429-b211aed4747e", "name": "network-vif-plugged", "status": "completed", "tag": "31ee9adf-4bac-4e32-9223-f4e594f0639e"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:45:20.445780 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d7283461-d3be-4f36-8186-1115e725b028 req-ed1b6ad4-a204-4b6a-af50-4563f8990260 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1349518 Dec 09 21:45:20.447634 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2502c9f3-5c0e-46fa-8c35-d11acd5b574d tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] 10.222.0.13 "GET /v2.0/quotas/1b3d1dd09025402c8fa08f3a7eba9749 HTTP/1.1" status: 200 len: 366 time: 0.0262439 Dec 09 21:45:20.456984 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40922) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:20.485988 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 31ee9adf-4bac-4e32-9223-f4e594f0639e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=31ee9adf-4bac-4e32-9223-f4e594f0639e,segment=NetworkSegment(0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5),segment_id=0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:20.493880 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:20.520241 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a4e53c9d-a13d-4da7-ae01-88656f450f5b tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] 10.222.0.13 "DELETE /v2.0/quotas/1b3d1dd09025402c8fa08f3a7eba9749 HTTP/1.1" status: 204 len: 168 time: 0.0611439 Dec 09 21:45:20.522789 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40928) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:20.542581 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:45:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e1866649-68de-473c-8d43-0352d0d501b7 x-openstack-request-id: req-e1866649-68de-473c-8d43-0352d0d501b7 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:45:20.543195 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ccb431db-4fc5-4654-a429-b211aed4747e", "name": "network-vif-plugged", "status": "completed", "tag": "31ee9adf-4bac-4e32-9223-f4e594f0639e", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:45:20.543848 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e1866649-68de-473c-8d43-0352d0d501b7 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:45:20.544448 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ccb431db-4fc5-4654-a429-b211aed4747e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '31ee9adf-4bac-4e32-9223-f4e594f0639e', 'code': 200} Dec 09 21:45:20.555679 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f067cf13-4bb2-4c33-b4bb-f6dfe6434f77 tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] 10.222.0.13 "GET /v2.0/quotas HTTP/1.1" status: 200 len: 470 time: 0.0213826 Dec 09 21:45:20.557414 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40930) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:20.586437 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-5a6516c0-f1be-49c9-8cd8-5cef60c4839a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 201bc3ab-e2ab-4e46-9cc3-b13f3373442f {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:45:20.589198 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=31ee9adf-4bac-4e32-9223-f4e594f0639e,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:20.594653 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-5a6516c0-f1be-49c9-8cd8-5cef60c4839a service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:20.608089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-75f66822-f885-45b7-ad5e-18e915cfd8bc tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] 10.222.0.13 "GET /v2.0/quotas/1b3d1dd09025402c8fa08f3a7eba9749 HTTP/1.1" status: 200 len: 370 time: 0.0401726 Dec 09 21:45:20.609404 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-5a6516c0-f1be-49c9-8cd8-5cef60c4839a service neutron] Transition to ACTIVE for port object 201bc3ab-e2ab-4e46-9cc3-b13f3373442f will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:45:20.610226 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40936) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:20.616230 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-5a6516c0-f1be-49c9-8cd8-5cef60c4839a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:20.631971 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ee5aa867-c1fc-4e3b-8aae-5a4f58ef1f37 tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] 10.222.0.13 "GET /v2.0/quotas/1b3d1dd09025402c8fa08f3a7eba9749/default HTTP/1.1" status: 200 len: 370 time: 0.0075486 Dec 09 21:45:20.632772 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.31', 57929) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:20.645173 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40938) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:20.655147 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1e943fb-1056-44c5-9964-519f1cd22445 req-3e731e2b-9a83-4381-ae66-e1d5a177ff23 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2060690 Dec 09 21:45:20.657834 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-7c699a77-d880-4a5e-a905-62954adaa6de tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] delete failed (client error): The resource could not be found. Dec 09 21:45:20.658367 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7c699a77-d880-4a5e-a905-62954adaa6de tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] 10.222.0.13 "DELETE /v2.0/quotas/1b3d1dd09025402c8fa08f3a7eba9749 HTTP/1.1" status: 404 len: 348 time: 0.0121922 Dec 09 21:45:20.807280 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c97c603c-5fd2-4f61-aa8e-f939f39e0fbd req-fb9c95ce-7ae7-4855-9334-efedaeb953ad tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:20.808950 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c97c603c-5fd2-4f61-aa8e-f939f39e0fbd req-fb9c95ce-7ae7-4855-9334-efedaeb953ad tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ccb431db-4fc5-4654-a429-b211aed4747e HTTP/1.1" status: 200 len: 945 time: 0.1479220 Dec 09 21:45:20.829638 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a6516c0-f1be-49c9-8cd8-5cef60c4839a service neutron] Pushing event updated for resources: {'Port': ['ID=201bc3ab-e2ab-4e46-9cc3-b13f3373442f,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:20.840594 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48423ceb-2f24-4b68-a749-4746df5664c2 req-f511e151-2ee6-4dbd-8bb0-72c3337bb858 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:20.842149 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-48423ceb-2f24-4b68-a749-4746df5664c2 req-f511e151-2ee6-4dbd-8bb0-72c3337bb858 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=ccb431db-4fc5-4654-a429-b211aed4747e HTTP/1.1" status: 200 len: 1097 time: 0.1690340 Dec 09 21:45:20.868260 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b1e943fb-1056-44c5-9964-519f1cd22445 req-49818b34-02d8-4c8b-b89d-3f6ee93b0fb6 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2044587 Dec 09 21:45:20.905292 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c97c603c-5fd2-4f61-aa8e-f939f39e0fbd req-da155e27-8788-4535-97af-49299bcf2197 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0649467 Dec 09 21:45:20.933965 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-48423ceb-2f24-4b68-a749-4746df5664c2 req-414c4eed-3988-47ed-9743-ba1811fd0734 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0824299 Dec 09 21:45:20.938387 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-5a6516c0-f1be-49c9-8cd8-5cef60c4839a service neutron] Attempting to bind port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:45:20.938727 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-5a6516c0-f1be-49c9-8cd8-5cef60c4839a service neutron] Attempting to bind port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '2316fee1-a288-4d09-bf17-e0a19e0adf8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:45:20.939064 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-5a6516c0-f1be-49c9-8cd8-5cef60c4839a service neutron] Attempting to bind port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f on network 4fbe35af-30ff-45b2-b84a-21fea4abf9aa {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:45:20.944025 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-5a6516c0-f1be-49c9-8cd8-5cef60c4839a service neutron] Port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f on network 4fbe35af-30ff-45b2-b84a-21fea4abf9aa not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:45:20.944570 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-5a6516c0-f1be-49c9-8cd8-5cef60c4839a service neutron] Attempting to bind port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f on network 4fbe35af-30ff-45b2-b84a-21fea4abf9aa {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:45:20.950125 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-5a6516c0-f1be-49c9-8cd8-5cef60c4839a service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 44, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:45:20.950654 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-5a6516c0-f1be-49c9-8cd8-5cef60c4839a service neutron] Checking segment: {'id': '2316fee1-a288-4d09-bf17-e0a19e0adf8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:45:20.951241 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-5a6516c0-f1be-49c9-8cd8-5cef60c4839a service neutron] Bound using segment: {'id': '2316fee1-a288-4d09-bf17-e0a19e0adf8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:45:20.952751 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-5a6516c0-f1be-49c9-8cd8-5cef60c4839a service neutron] Bound port: 201bc3ab-e2ab-4e46-9cc3-b13f3373442f, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2316fee1-a288-4d09-bf17-e0a19e0adf8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:45:20.953482 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-5a6516c0-f1be-49c9-8cd8-5cef60c4839a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:20.960549 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40948) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:21.038677 n-d-713301-27 neutron-server[103437]: DEBUG neutron.quota.resource [None req-521a89ea-f2b3-44a4-96ce-b9e936b7d731 tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] Usage tracker for resource:network and project:609a953ad0c74d6bbb674c970cf990c7 is out of sync, need to count used quota {{(pid=103437) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Dec 09 21:45:21.043663 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-5a6516c0-f1be-49c9-8cd8-5cef60c4839a service neutron] For port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:45:21.048041 n-d-713301-27 neutron-server[103437]: DEBUG neutron.quota.resource [None req-521a89ea-f2b3-44a4-96ce-b9e936b7d731 tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] Quota usage for network was recalculated. Used quota:0. {{(pid=103437) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Dec 09 21:45:21.059752 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-5a6516c0-f1be-49c9-8cd8-5cef60c4839a service neutron] For port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=201bc3ab-e2ab-4e46-9cc3-b13f3373442f,segment=NetworkSegment(2316fee1-a288-4d09-bf17-e0a19e0adf8d),segment_id=2316fee1-a288-4d09-bf17-e0a19e0adf8d)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:45:21.063806 n-d-713301-27 neutron-server[103437]: DEBUG neutron.quota.resource [None req-521a89ea-f2b3-44a4-96ce-b9e936b7d731 tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] Usage tracker for resource:subnet and project:609a953ad0c74d6bbb674c970cf990c7 is out of sync, need to count used quota {{(pid=103437) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Dec 09 21:45:21.067897 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-5a6516c0-f1be-49c9-8cd8-5cef60c4839a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:21.071195 n-d-713301-27 neutron-server[103437]: DEBUG neutron.quota.resource [None req-521a89ea-f2b3-44a4-96ce-b9e936b7d731 tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=103437) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Dec 09 21:45:21.115591 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-5a6516c0-f1be-49c9-8cd8-5cef60c4839a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:21.116242 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-5a6516c0-f1be-49c9-8cd8-5cef60c4839a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:21.117697 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-5a6516c0-f1be-49c9-8cd8-5cef60c4839a service neutron] 10.222.0.31 "PUT /v2.0/ports/201bc3ab-e2ab-4e46-9cc3-b13f3373442f HTTP/1.1" status: 200 len: 1093 time: 1.0255849 Dec 09 21:45:21.119899 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9c9545e3-43c2-403d-a699-e38d4f4c2a1b', 'tag': '201bc3ab-e2ab-4e46-9cc3-b13f3373442f'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:45:21.122278 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a7c92818-b880-41de-9606-1d515b850143" -d '{"events": [{"name": "network-changed", "server_uuid": "9c9545e3-43c2-403d-a699-e38d4f4c2a1b", "tag": "201bc3ab-e2ab-4e46-9cc3-b13f3373442f"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:45:21.124882 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91b837e9-be2b-4c2b-b822-2460e1acc0fd req-dc246dc5-84f9-431d-b2c3-bc80b5e34007 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:21.126457 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-91b837e9-be2b-4c2b-b822-2460e1acc0fd req-dc246dc5-84f9-431d-b2c3-bc80b5e34007 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/ports?device_id=3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f HTTP/1.1" status: 200 len: 948 time: 0.0852954 Dec 09 21:45:21.133008 n-d-713301-27 neutron-server[103437]: DEBUG neutron.quota.resource [None req-521a89ea-f2b3-44a4-96ce-b9e936b7d731 tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] Usage tracker for resource:subnetpool and project:609a953ad0c74d6bbb674c970cf990c7 is out of sync, need to count used quota {{(pid=103437) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Dec 09 21:45:21.148257 n-d-713301-27 neutron-server[103437]: DEBUG neutron.quota.resource [None req-521a89ea-f2b3-44a4-96ce-b9e936b7d731 tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] Quota usage for subnetpool was recalculated. Used quota:0. {{(pid=103437) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Dec 09 21:45:21.151855 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a6516c0-f1be-49c9-8cd8-5cef60c4839a service neutron] Pushing event updated for resources: {'Port': ['ID=201bc3ab-e2ab-4e46-9cc3-b13f3373442f,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:21.158588 n-d-713301-27 neutron-server[103437]: DEBUG neutron.quota.resource [None req-521a89ea-f2b3-44a4-96ce-b9e936b7d731 tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] Usage tracker for resource:port and project:609a953ad0c74d6bbb674c970cf990c7 is out of sync, need to count used quota {{(pid=103437) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Dec 09 21:45:21.162195 n-d-713301-27 neutron-server[103437]: DEBUG neutron.quota.resource [None req-521a89ea-f2b3-44a4-96ce-b9e936b7d731 tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] Quota usage for port was recalculated. Used quota:0. {{(pid=103437) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Dec 09 21:45:21.196505 n-d-713301-27 neutron-server[103437]: DEBUG neutron.quota.resource [None req-521a89ea-f2b3-44a4-96ce-b9e936b7d731 tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] Usage tracker for resource:router and project:609a953ad0c74d6bbb674c970cf990c7 is out of sync, need to count used quota {{(pid=103437) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Dec 09 21:45:21.202690 n-d-713301-27 neutron-server[103437]: DEBUG neutron.quota.resource [None req-521a89ea-f2b3-44a4-96ce-b9e936b7d731 tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] Quota usage for router was recalculated. Used quota:0. {{(pid=103437) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Dec 09 21:45:21.213694 n-d-713301-27 neutron-server[103437]: DEBUG neutron.quota.resource [None req-521a89ea-f2b3-44a4-96ce-b9e936b7d731 tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] Usage tracker for resource:floatingip and project:609a953ad0c74d6bbb674c970cf990c7 is out of sync, need to count used quota {{(pid=103437) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Dec 09 21:45:21.218862 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40956) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:21.220028 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-91b837e9-be2b-4c2b-b822-2460e1acc0fd req-9df8f1c3-f1da-4f9c-8064-6f444b596d89 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/security-groups?id=70b6e8f6-3793-4fd9-91c8-b7d3cb7e3581&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0840046 Dec 09 21:45:21.225877 n-d-713301-27 neutron-server[103437]: DEBUG neutron.quota.resource [None req-521a89ea-f2b3-44a4-96ce-b9e936b7d731 tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=103437) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Dec 09 21:45:21.231592 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-b2664b15-bd6d-43c3-afca-878128496e5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:21.233136 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-b2664b15-bd6d-43c3-afca-878128496e5e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 1096 time: 0.0684133 Dec 09 21:45:21.283535 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:45:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b4a85d8b-32aa-4ae2-9ba4-da216c1f3741 x-openstack-request-id: req-b4a85d8b-32aa-4ae2-9ba4-da216c1f3741 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:45:21.283833 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9c9545e3-43c2-403d-a699-e38d4f4c2a1b", "tag": "201bc3ab-e2ab-4e46-9cc3-b13f3373442f", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:45:21.284088 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-b4a85d8b-32aa-4ae2-9ba4-da216c1f3741 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:45:21.284501 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9c9545e3-43c2-403d-a699-e38d4f4c2a1b', 'tag': '201bc3ab-e2ab-4e46-9cc3-b13f3373442f', 'status': 'completed', 'code': 200} Dec 09 21:45:21.313621 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-43e1e51d-4543-4240-95aa-14bc58ff6b41 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=201bc3ab-e2ab-4e46-9cc3-b13f3373442f HTTP/1.1" status: 200 len: 217 time: 0.0707040 Dec 09 21:45:21.574806 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-756793a2-6188-44c2-99be-71d4d71fff8d req-b89b6a36-0eed-4003-8d66-1623680116d5 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:21.576289 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-756793a2-6188-44c2-99be-71d4d71fff8d req-b89b6a36-0eed-4003-8d66-1623680116d5 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 944 time: 0.0526118 Dec 09 21:45:21.632842 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-756793a2-6188-44c2-99be-71d4d71fff8d req-10af20f6-47ac-42d4-96be-f731d91d8589 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0494950 Dec 09 21:45:21.684269 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-81d1b758-bc98-4940-b2f6-b94dc1861103 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Request body: {'security_group': {'name': 'tempest-secgroup--1665791814'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:21.736485 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-36a9235e-e094-4276-9652-4a6e4c6ec79a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:21.737967 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-36a9235e-e094-4276-9652-4a6e4c6ec79a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=017fde5b-ddc1-4da5-8c6b-2b98296748e5 HTTP/1.1" status: 200 len: 835 time: 0.4150238 Dec 09 21:45:21.740455 n-d-713301-27 neutron-server[103437]: DEBUG neutron.quota.resource [None req-521a89ea-f2b3-44a4-96ce-b9e936b7d731 tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] Usage tracker for resource:security_group and project:609a953ad0c74d6bbb674c970cf990c7 is out of sync, need to count used quota {{(pid=103437) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Dec 09 21:45:21.744815 n-d-713301-27 neutron-server[103437]: DEBUG neutron.quota.resource [None req-521a89ea-f2b3-44a4-96ce-b9e936b7d731 tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] Quota usage for security_group was recalculated. Used quota:0. {{(pid=103437) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Dec 09 21:45:21.757416 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-81d1b758-bc98-4940-b2f6-b94dc1861103 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:21.784447 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-81d1b758-bc98-4940-b2f6-b94dc1861103 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:21.794192 n-d-713301-27 neutron-server[103437]: DEBUG neutron.quota.resource [None req-521a89ea-f2b3-44a4-96ce-b9e936b7d731 tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] Usage tracker for resource:security_group_rule and project:609a953ad0c74d6bbb674c970cf990c7 is out of sync, need to count used quota {{(pid=103437) count_used /opt/stack/neutron/neutron/quota/resource.py:291}} Dec 09 21:45:21.806455 n-d-713301-27 neutron-server[103437]: DEBUG neutron.quota.resource [None req-521a89ea-f2b3-44a4-96ce-b9e936b7d731 tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103437) count_used /opt/stack/neutron/neutron/quota/resource.py:312}} Dec 09 21:45:21.824164 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-521a89ea-f2b3-44a4-96ce-b9e936b7d731 tempest-QuotasTest-1282988845 tempest-QuotasTest-1282988845-project-admin] 10.222.0.13 "GET /v2.0/quotas/609a953ad0c74d6bbb674c970cf990c7/details.json HTTP/1.1" status: 200 len: 703 time: 0.8625221 Dec 09 21:45:21.833839 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-fc69db74-f2e6-4e2a-87a9-9883aaab3c3a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:21.835381 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-fc69db74-f2e6-4e2a-87a9-9883aaab3c3a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=4fbe35af-30ff-45b2-b84a-21fea4abf9aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0881226 Dec 09 21:45:21.959717 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-81d1b758-bc98-4940-b2f6-b94dc1861103 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:21.963935 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-1458a58b-413e-4a7b-9cf5-44ddad7cb3d7 service neutron] 10.222.0.31 "GET /v2.0/networks/4fbe35af-30ff-45b2-b84a-21fea4abf9aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1193466 Dec 09 21:45:21.966469 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-81d1b758-bc98-4940-b2f6-b94dc1861103 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:22.049823 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81d1b758-bc98-4940-b2f6-b94dc1861103 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event updated for resources: {'SecurityGroup': ['ID=85744495-8736-45bb-8233-9c0baeb7353d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:22.089320 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3f4f196-2167-46a6-9116-abd8a85b47f1 req-9f00fa7a-2ef9-4d9e-99fe-afc51cbbed04 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:22.096454 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c3f4f196-2167-46a6-9116-abd8a85b47f1 req-9f00fa7a-2ef9-4d9e-99fe-afc51cbbed04 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ccb431db-4fc5-4654-a429-b211aed4747e HTTP/1.1" status: 200 len: 945 time: 0.0830648 Dec 09 21:45:22.128576 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-81d1b758-bc98-4940-b2f6-b94dc1861103 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:22.134183 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-81d1b758-bc98-4940-b2f6-b94dc1861103 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:22.141712 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0c6d41fc-b48c-446b-ab7d-98b0d24a2486 req-9a55de02-bde8-4a6d-8861-68ae92e4042d service neutron] 10.222.0.31 "GET /v2.0/networks/4fbe35af-30ff-45b2-b84a-21fea4abf9aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1667755 Dec 09 21:45:22.153514 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c3f4f196-2167-46a6-9116-abd8a85b47f1 req-e5c87830-89cf-43ec-847c-a4f24ab54bde tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0535083 Dec 09 21:45:22.162584 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40968) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:22.164783 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device cfd5c800-4c6d-4766-9675-137da0da42a4 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:45:22.174979 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-81d1b758-bc98-4940-b2f6-b94dc1861103 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:22.176517 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-81d1b758-bc98-4940-b2f6-b94dc1861103 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.9566522 Dec 09 21:45:22.180008 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40972) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:22.186594 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81d1b758-bc98-4940-b2f6-b94dc1861103 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7dcaf55b-8388-4973-b56e-03e40b86c3f6,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:22.275586 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7c92818-b880-41de-9606-1d515b850143 req-f3aeb32d-1ef4-4a95-8084-6607be065c54 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:22.277119 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a7c92818-b880-41de-9606-1d515b850143 req-f3aeb32d-1ef4-4a95-8084-6607be065c54 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 1096 time: 0.0800555 Dec 09 21:45:22.286882 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6ca6155c-d1ee-4c5d-b94a-4b91cebfa6e8 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4545 time: 0.1057315 Dec 09 21:45:22.290493 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40976) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:22.296036 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-faef3fee-0683-4e16-9ec7-d989a0c27700 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Request body: {'security_group': {'name': 'tempest-security--1311362325', 'description': 'tempest-security-description-155766395'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:22.309491 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port cfd5c800-4c6d-4766-9675-137da0da42a4, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=cfd5c800-4c6d-4766-9675-137da0da42a4,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:22.322484 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'cfd5c800-4c6d-4766-9675-137da0da42a4', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': 'cfd5c800-4c6d-4766-9675-137da0da42a4', 'mac_address': 'fa:16:3e:1f:cf:83', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.132'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:45:22.325660 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d301cdd7-121d-48f6-8802-ee48dfa76b3a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:22.362388 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-faef3fee-0683-4e16-9ec7-d989a0c27700 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:22.370967 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:22.380638 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dbfedb2-4590-4a04-aaf8-e5de7c5e6b80 req-6493b094-ca07-4a77-988f-d643d55ff1a0 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:22.382192 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8dbfedb2-4590-4a04-aaf8-e5de7c5e6b80 req-6493b094-ca07-4a77-988f-d643d55ff1a0 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/ports?device_id=3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f HTTP/1.1" status: 200 len: 948 time: 0.0746186 Dec 09 21:45:22.391489 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cfd5c800-4c6d-4766-9675-137da0da42a4 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:45:22.413936 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port cfd5c800-4c6d-4766-9675-137da0da42a4, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=cfd5c800-4c6d-4766-9675-137da0da42a4,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:22.419682 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:22.430402 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7c92818-b880-41de-9606-1d515b850143 req-36b80f42-b138-49c4-a751-a2298a5f6bc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:22.432002 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a7c92818-b880-41de-9606-1d515b850143 req-36b80f42-b138-49c4-a751-a2298a5f6bc3 service neutron] 10.222.0.31 "GET /v2.0/networks?id=4fbe35af-30ff-45b2-b84a-21fea4abf9aa HTTP/1.1" status: 200 len: 898 time: 0.1440470 Dec 09 21:45:22.451096 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-faef3fee-0683-4e16-9ec7-d989a0c27700 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:22.459346 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-faef3fee-0683-4e16-9ec7-d989a0c27700 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:22.462093 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-faef3fee-0683-4e16-9ec7-d989a0c27700 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:22.463482 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-faef3fee-0683-4e16-9ec7-d989a0c27700 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "PUT /v2.0/security-groups/7dcaf55b-8388-4973-b56e-03e40b86c3f6 HTTP/1.1" status: 200 len: 1796 time: 0.1717763 Dec 09 21:45:22.467596 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40978) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:22.479201 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=cfd5c800-4c6d-4766-9675-137da0da42a4,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:22.484281 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a7c92818-b880-41de-9606-1d515b850143 req-08142418-c022-4955-8d4d-a478310c21b7 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=201bc3ab-e2ab-4e46-9cc3-b13f3373442f HTTP/1.1" status: 200 len: 217 time: 0.0435135 Dec 09 21:45:22.488612 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8dbfedb2-4590-4a04-aaf8-e5de7c5e6b80 req-75f0ba22-8744-4e39-abed-e340283e2cd0 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/security-groups?id=70b6e8f6-3793-4fd9-91c8-b7d3cb7e3581&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0957160 Dec 09 21:45:22.518244 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faef3fee-0683-4e16-9ec7-d989a0c27700 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7dcaf55b-8388-4973-b56e-03e40b86c3f6,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:22.528422 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d301cdd7-121d-48f6-8802-ee48dfa76b3a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:22.536928 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d301cdd7-121d-48f6-8802-ee48dfa76b3a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:22.538019 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1f75914d-bb21-4878-be8e-e47be55f12dd tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-groups/7dcaf55b-8388-4973-b56e-03e40b86c3f6 HTTP/1.1" status: 200 len: 1796 time: 0.0680218 Dec 09 21:45:22.540646 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40980) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:22.567048 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7c92818-b880-41de-9606-1d515b850143 req-08dd82dd-3cec-4b3a-9227-a62cef986e48 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:22.568562 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a7c92818-b880-41de-9606-1d515b850143 req-08dd82dd-3cec-4b3a-9227-a62cef986e48 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=017fde5b-ddc1-4da5-8c6b-2b98296748e5 HTTP/1.1" status: 200 len: 835 time: 0.0734563 Dec 09 21:45:22.594100 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d301cdd7-121d-48f6-8802-ee48dfa76b3a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=54c992bd-0f8a-4a48-b2be-b76b2ab570b9,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:22.597363 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-91076537-c04d-496e-b211-206a142349bb tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:22.598718 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d301cdd7-121d-48f6-8802-ee48dfa76b3a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=be651c5d4b8341ecb91b74387ffcce42&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4350379 Dec 09 21:45:22.602659 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40982) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:22.631873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7c92818-b880-41de-9606-1d515b850143 req-2b4638f3-e67f-4b82-bf91-e8a9e0aa3ff6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:22.633352 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a7c92818-b880-41de-9606-1d515b850143 req-2b4638f3-e67f-4b82-bf91-e8a9e0aa3ff6 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=4fbe35af-30ff-45b2-b84a-21fea4abf9aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0503442 Dec 09 21:45:22.633744 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-91076537-c04d-496e-b211-206a142349bb tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:22.668357 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['cfd5c800-4c6d-4766-9675-137da0da42a4'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:45:22.693630 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bd1ec0b8-ce4e-46f7-9caa-1a3cf421a732 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:22.708211 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-91076537-c04d-496e-b211-206a142349bb tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:22.711098 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-91076537-c04d-496e-b211-206a142349bb tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:22.712546 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-91076537-c04d-496e-b211-206a142349bb tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "DELETE /v2.0/security-groups/7dcaf55b-8388-4973-b56e-03e40b86c3f6 HTTP/1.1" status: 204 len: 168 time: 0.1705282 Dec 09 21:45:22.720373 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40986) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:22.727808 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bd1ec0b8-ce4e-46f7-9caa-1a3cf421a732 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:22.750100 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a7c92818-b880-41de-9606-1d515b850143 req-ee6449b8-382d-491f-b9a2-1010ce59e1ab service neutron] 10.222.0.31 "GET /v2.0/networks/4fbe35af-30ff-45b2-b84a-21fea4abf9aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1077044 Dec 09 21:45:22.758904 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91076537-c04d-496e-b211-206a142349bb tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7dcaf55b-8388-4973-b56e-03e40b86c3f6,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:22.852253 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-139104ec-d067-4b3a-9f7e-14eb31fd3726 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1265883 Dec 09 21:45:22.854906 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40988) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:22.859960 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-717e8db9-189d-49ae-abc8-118e8863b171 req-5dacb47c-598b-4b8f-b8e4-1439ce02485f tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:22.861465 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-717e8db9-189d-49ae-abc8-118e8863b171 req-5dacb47c-598b-4b8f-b8e4-1439ce02485f tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 944 time: 0.1317730 Dec 09 21:45:22.878712 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bd1ec0b8-ce4e-46f7-9caa-1a3cf421a732 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:22.879891 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-c61957f4-cdfe-4624-8658-5f244d76c05b tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] delete failed (client error): The resource could not be found. Dec 09 21:45:22.881021 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c61957f4-cdfe-4624-8658-5f244d76c05b tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "DELETE /v2.0/security-groups/7dcaf55b-8388-4973-b56e-03e40b86c3f6 HTTP/1.1" status: 404 len: 347 time: 0.0250275 Dec 09 21:45:22.881550 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bd1ec0b8-ce4e-46f7-9caa-1a3cf421a732 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:22.884983 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bd1ec0b8-ce4e-46f7-9caa-1a3cf421a732 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/54c992bd-0f8a-4a48-b2be-b76b2ab570b9 HTTP/1.1" status: 204 len: 168 time: 0.2790449 Dec 09 21:45:22.887384 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40990) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:22.893667 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-63d5893f-6716-47e6-a5b1-da970b4d53d0 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Request body: {'security_group': {'name': 'tempest-secgroup--2025985600'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:22.903217 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a7c92818-b880-41de-9606-1d515b850143 req-e38c08ad-d2e0-4acc-bbeb-5364a419256f service neutron] 10.222.0.31 "GET /v2.0/networks/4fbe35af-30ff-45b2-b84a-21fea4abf9aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1453960 Dec 09 21:45:22.910267 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd1ec0b8-ce4e-46f7-9caa-1a3cf421a732 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=54c992bd-0f8a-4a48-b2be-b76b2ab570b9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:22.927879 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-63d5893f-6716-47e6-a5b1-da970b4d53d0 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:22.955890 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-717e8db9-189d-49ae-abc8-118e8863b171 req-111b3ff3-a9f3-4219-8b3f-d129b3243fde tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0877481 Dec 09 21:45:23.007113 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-63d5893f-6716-47e6-a5b1-da970b4d53d0 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.011941 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-63d5893f-6716-47e6-a5b1-da970b4d53d0 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.044946 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-63d5893f-6716-47e6-a5b1-da970b4d53d0 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.048450 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-63d5893f-6716-47e6-a5b1-da970b4d53d0 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.1599908 Dec 09 21:45:23.050158 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 40996) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:23.055461 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-c0be513b-cf3f-4c6c-8e29-806e2f2382ee tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Request body: {'security_group_rule': {'security_group_id': '9f670169-db92-4cf6-9482-3c6ae8feeae3', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 77, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:23.059654 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63d5893f-6716-47e6-a5b1-da970b4d53d0 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9f670169-db92-4cf6-9482-3c6ae8feeae3,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:23.091529 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c0be513b-cf3f-4c6c-8e29-806e2f2382ee tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.154448 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c0be513b-cf3f-4c6c-8e29-806e2f2382ee tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.158512 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c0be513b-cf3f-4c6c-8e29-806e2f2382ee tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.174184 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0be513b-cf3f-4c6c-8e29-806e2f2382ee tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4be58069-2b8f-49bf-81d0-aa9e13eb0f35,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:23.174812 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 40998) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:23.185901 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c0be513b-cf3f-4c6c-8e29-806e2f2382ee tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.187121 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c0be513b-cf3f-4c6c-8e29-806e2f2382ee tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1354043 Dec 09 21:45:23.190130 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41000) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:23.194001 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a27df4b-b340-4077-bd81-e140becc0d98 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.223833 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c42f7aee-40d8-44cb-8e85-f83d36d406b5 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.231894 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c42f7aee-40d8-44cb-8e85-f83d36d406b5 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.261487 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c42f7aee-40d8-44cb-8e85-f83d36d406b5 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.267341 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c42f7aee-40d8-44cb-8e85-f83d36d406b5 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.268662 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c42f7aee-40d8-44cb-8e85-f83d36d406b5 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "DELETE /v2.0/security-group-rules/4be58069-2b8f-49bf-81d0-aa9e13eb0f35 HTTP/1.1" status: 204 len: 168 time: 0.0774691 Dec 09 21:45:23.271603 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41004) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:23.283069 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c42f7aee-40d8-44cb-8e85-f83d36d406b5 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=4be58069-2b8f-49bf-81d0-aa9e13eb0f35,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:23.320109 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a27df4b-b340-4077-bd81-e140becc0d98 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.324050 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c979dd45-42c4-4311-8383-227f3b99e126 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0502112 Dec 09 21:45:23.326726 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41006) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:23.328631 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a27df4b-b340-4077-bd81-e140becc0d98 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.347133 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-586aec9e-481e-4630-92c0-1f18c78e7f1c req-4e8ee5eb-c97d-490e-a54d-f8c107a6d3eb tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:23.348688 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-586aec9e-481e-4630-92c0-1f18c78e7f1c req-4e8ee5eb-c97d-490e-a54d-f8c107a6d3eb tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ccb431db-4fc5-4654-a429-b211aed4747e HTTP/1.1" status: 200 len: 945 time: 0.0822272 Dec 09 21:45:23.379887 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3477ce4-2476-46b5-9523-e66e9ef116f5 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.392782 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8a27df4b-b340-4077-bd81-e140becc0d98 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=609a953ad0c74d6bbb674c970cf990c7&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2166207 Dec 09 21:45:23.395646 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41008) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:23.397971 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a27df4b-b340-4077-bd81-e140becc0d98 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=03a08eb5-8570-442b-b15d-be4b52d524c8,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:23.414681 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3477ce4-2476-46b5-9523-e66e9ef116f5 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.425536 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-586aec9e-481e-4630-92c0-1f18c78e7f1c req-d657fd6e-1ff4-4281-88c5-7d90e40149d8 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0667212 Dec 09 21:45:23.476520 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5335539e-97a7-4fb2-b667-26b6e4408e61 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.480021 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3477ce4-2476-46b5-9523-e66e9ef116f5 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.482944 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3477ce4-2476-46b5-9523-e66e9ef116f5 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.484143 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e3477ce4-2476-46b5-9523-e66e9ef116f5 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "DELETE /v2.0/security-groups/9f670169-db92-4cf6-9482-3c6ae8feeae3 HTTP/1.1" status: 204 len: 168 time: 0.1565409 Dec 09 21:45:23.486902 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41012) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:23.509091 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3477ce4-2476-46b5-9523-e66e9ef116f5 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9f670169-db92-4cf6-9482-3c6ae8feeae3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:23.524533 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5335539e-97a7-4fb2-b667-26b6e4408e61 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.531010 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ef7f4a9b-19a2-4606-a32a-c6d559f10225 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0429184 Dec 09 21:45:23.537490 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41016) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:23.542196 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-ccb89e3c-873a-43f0-8eda-e69792c8714c tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Request body: {'security_group': {'name': 'tempest-secgroup--278916057'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:23.568195 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ccb89e3c-873a-43f0-8eda-e69792c8714c tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.596119 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5335539e-97a7-4fb2-b667-26b6e4408e61 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.599598 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5335539e-97a7-4fb2-b667-26b6e4408e61 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.600844 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5335539e-97a7-4fb2-b667-26b6e4408e61 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/03a08eb5-8570-442b-b15d-be4b52d524c8 HTTP/1.1" status: 204 len: 168 time: 0.2041543 Dec 09 21:45:23.609759 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5335539e-97a7-4fb2-b667-26b6e4408e61 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=03a08eb5-8570-442b-b15d-be4b52d524c8,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:23.666253 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f665819-ef95-40a9-87b8-2eebfeb2109f req-2898f59d-a188-4760-82ee-31d89526adef tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:23.667855 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f665819-ef95-40a9-87b8-2eebfeb2109f req-2898f59d-a188-4760-82ee-31d89526adef tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/ports?device_id=3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f HTTP/1.1" status: 200 len: 949 time: 0.0830309 Dec 09 21:45:23.706203 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ccb89e3c-873a-43f0-8eda-e69792c8714c tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.736906 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ccb89e3c-873a-43f0-8eda-e69792c8714c tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.777294 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccb89e3c-873a-43f0-8eda-e69792c8714c tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0c43a554-d38e-4c61-beca-8bb5e1b354f3,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:23.796376 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f665819-ef95-40a9-87b8-2eebfeb2109f req-98923d7e-0d98-4e88-92ac-3ec91e446a08 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/security-groups?id=70b6e8f6-3793-4fd9-91c8-b7d3cb7e3581&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1183631 Dec 09 21:45:23.799765 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ccb89e3c-873a-43f0-8eda-e69792c8714c tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.804070 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41024) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:23.804270 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ccb89e3c-873a-43f0-8eda-e69792c8714c tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.2655623 Dec 09 21:45:23.808881 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-68ef93f2-5b09-4fdc-9b5e-fc4dc14fda46 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Request body: {'security_group_rule': {'security_group_id': '0c43a554-d38e-4c61-beca-8bb5e1b354f3', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 3, 'port_range_max': 2, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:23.848687 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-68ef93f2-5b09-4fdc-9b5e-fc4dc14fda46 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.901870 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-68ef93f2-5b09-4fdc-9b5e-fc4dc14fda46 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.907149 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-68ef93f2-5b09-4fdc-9b5e-fc4dc14fda46 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.928204 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68ef93f2-5b09-4fdc-9b5e-fc4dc14fda46 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a1befc84-e3aa-4585-bda3-52d4392798d9,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:23.934886 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-68ef93f2-5b09-4fdc-9b5e-fc4dc14fda46 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:23.936295 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-68ef93f2-5b09-4fdc-9b5e-fc4dc14fda46 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1312068 Dec 09 21:45:23.939217 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41030) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:23.945538 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-f7a3bdaa-99b2-4fe0-9118-54e7ba9d6cd7 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Request body: {'security_group_rule': {'security_group_id': '0c43a554-d38e-4c61-beca-8bb5e1b354f3', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 3, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:23.974247 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f7a3bdaa-99b2-4fe0-9118-54e7ba9d6cd7 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.044273 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f7a3bdaa-99b2-4fe0-9118-54e7ba9d6cd7 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.055069 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f7a3bdaa-99b2-4fe0-9118-54e7ba9d6cd7 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.111950 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7a3bdaa-99b2-4fe0-9118-54e7ba9d6cd7 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2d2e4873-461f-4cab-a07d-33eb82acbb81,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:24.120496 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f7a3bdaa-99b2-4fe0-9118-54e7ba9d6cd7 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.123576 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f7a3bdaa-99b2-4fe0-9118-54e7ba9d6cd7 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1798031 Dec 09 21:45:24.125122 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41042) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:24.133894 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-0900f9f6-595b-4a79-8288-cf0adade108a tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Request body: {'security_group_rule': {'security_group_id': '0c43a554-d38e-4c61-beca-8bb5e1b354f3', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 8, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:24.146205 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2124f338-6201-463c-871f-200ff25d83b0 req-9f091612-27b8-4dbf-8080-a1006179a91c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:24.148126 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2124f338-6201-463c-871f-200ff25d83b0 req-9f091612-27b8-4dbf-8080-a1006179a91c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 944 time: 0.0828354 Dec 09 21:45:24.176758 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0900f9f6-595b-4a79-8288-cf0adade108a tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.182898 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device cfd5c800-4c6d-4766-9675-137da0da42a4 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:45:24.229013 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2124f338-6201-463c-871f-200ff25d83b0 req-d3488ae7-c6ea-4ec0-bac6-99a7b482e412 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0733249 Dec 09 21:45:24.261193 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0900f9f6-595b-4a79-8288-cf0adade108a tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.266919 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0900f9f6-595b-4a79-8288-cf0adade108a tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.275764 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port cfd5c800-4c6d-4766-9675-137da0da42a4 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:45:24.281144 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port cfd5c800-4c6d-4766-9675-137da0da42a4 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:24.282131 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.285367 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0900f9f6-595b-4a79-8288-cf0adade108a tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2f499007-6cbe-494c-a6ef-0649c0c45e29,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:24.302858 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0900f9f6-595b-4a79-8288-cf0adade108a tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.304605 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0900f9f6-595b-4a79-8288-cf0adade108a tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1782627 Dec 09 21:45:24.307324 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41046) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:24.312023 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-edf1448c-091a-4de5-9de6-3e28e00d8698 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Request body: {'security_group_rule': {'security_group_id': '0c43a554-d38e-4c61-beca-8bb5e1b354f3', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 0, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:24.346308 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-edf1448c-091a-4de5-9de6-3e28e00d8698 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.414155 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.423091 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-edf1448c-091a-4de5-9de6-3e28e00d8698 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.432027 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-edf1448c-091a-4de5-9de6-3e28e00d8698 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.446374 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cfd5c800-4c6d-4766-9675-137da0da42a4'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:45:24.449775 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-49ba71d0-51cc-441f-81ae-0e058c5ffec7" -d '{"events": [{"server_uuid": "3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f", "name": "network-vif-plugged", "status": "completed", "tag": "cfd5c800-4c6d-4766-9675-137da0da42a4"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:45:24.457560 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edf1448c-091a-4de5-9de6-3e28e00d8698 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=68d1ddf8-f25c-4b57-a460-0f8a5ef311a0,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:24.466387 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-edf1448c-091a-4de5-9de6-3e28e00d8698 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.468013 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-edf1448c-091a-4de5-9de6-3e28e00d8698 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1595573 Dec 09 21:45:24.470608 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41054) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:24.482372 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port cfd5c800-4c6d-4766-9675-137da0da42a4, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=cfd5c800-4c6d-4766-9675-137da0da42a4,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:24.484856 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-3c84da82-d07a-409c-bbb8-7a7c74996362 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Request body: {'security_group_rule': {'security_group_id': '0c43a554-d38e-4c61-beca-8bb5e1b354f3', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'icmp', 'port_range_min': 11, 'port_range_max': None, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:24.489690 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.536031 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:45:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-565d2285-45d3-49f9-b1b7-5dd7cba29e43 x-openstack-request-id: req-565d2285-45d3-49f9-b1b7-5dd7cba29e43 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:45:24.536314 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f", "name": "network-vif-plugged", "status": "completed", "tag": "cfd5c800-4c6d-4766-9675-137da0da42a4", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:45:24.536748 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-565d2285-45d3-49f9-b1b7-5dd7cba29e43 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:45:24.537328 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cfd5c800-4c6d-4766-9675-137da0da42a4', 'code': 200} Dec 09 21:45:24.545896 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3c84da82-d07a-409c-bbb8-7a7c74996362 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.590856 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=cfd5c800-4c6d-4766-9675-137da0da42a4,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:24.616086 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3c84da82-d07a-409c-bbb8-7a7c74996362 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.623429 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3c84da82-d07a-409c-bbb8-7a7c74996362 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.643423 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24494111-0202-4661-a54d-c29d4e6c2985 req-0ebd2a56-d0a3-43c9-9ebf-bda9ae8565d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:24.646888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c84da82-d07a-409c-bbb8-7a7c74996362 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b7649e2f-302a-401a-aafb-dfe617fef830,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:24.648100 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-24494111-0202-4661-a54d-c29d4e6c2985 req-0ebd2a56-d0a3-43c9-9ebf-bda9ae8565d9 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f HTTP/1.1" status: 200 len: 1102 time: 0.0733047 Dec 09 21:45:24.656425 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3c84da82-d07a-409c-bbb8-7a7c74996362 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.657959 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3c84da82-d07a-409c-bbb8-7a7c74996362 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 767 time: 0.1857471 Dec 09 21:45:24.661054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41058) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:24.704363 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-42891e62-df2c-436c-8fb2-c25f1dc5f79c tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.716022 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-42891e62-df2c-436c-8fb2-c25f1dc5f79c tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.729809 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-24494111-0202-4661-a54d-c29d4e6c2985 req-f56eb647-b7ea-481b-9a78-03b871b8b968 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=70b6e8f6-3793-4fd9-91c8-b7d3cb7e3581&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0725338 Dec 09 21:45:24.748469 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-42891e62-df2c-436c-8fb2-c25f1dc5f79c tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.755084 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-42891e62-df2c-436c-8fb2-c25f1dc5f79c tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.756383 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-42891e62-df2c-436c-8fb2-c25f1dc5f79c tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "DELETE /v2.0/security-group-rules/b7649e2f-302a-401a-aafb-dfe617fef830 HTTP/1.1" status: 204 len: 168 time: 0.0937970 Dec 09 21:45:24.759483 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41062) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:24.762562 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42891e62-df2c-436c-8fb2-c25f1dc5f79c tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=b7649e2f-302a-401a-aafb-dfe617fef830,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:24.815252 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-38e4962e-65ce-45f6-9098-758c8b5c8c8c tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5731 time: 0.0514069 Dec 09 21:45:24.818173 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41070) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:24.852732 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2481e342-9de6-48a3-b85e-dfc845a41360 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.863152 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2481e342-9de6-48a3-b85e-dfc845a41360 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.893358 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2481e342-9de6-48a3-b85e-dfc845a41360 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.899279 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2481e342-9de6-48a3-b85e-dfc845a41360 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:24.900896 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2481e342-9de6-48a3-b85e-dfc845a41360 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "DELETE /v2.0/security-group-rules/68d1ddf8-f25c-4b57-a460-0f8a5ef311a0 HTTP/1.1" status: 204 len: 168 time: 0.0815842 Dec 09 21:45:24.903899 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41074) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:24.924141 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2481e342-9de6-48a3-b85e-dfc845a41360 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=68d1ddf8-f25c-4b57-a460-0f8a5ef311a0,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:24.935229 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-645d4e28-78fb-41a4-a425-16055358706c req-1a9ce423-6ad3-49a8-be50-c973ef3d9f25 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:24.936840 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-645d4e28-78fb-41a4-a425-16055358706c req-1a9ce423-6ad3-49a8-be50-c973ef3d9f25 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/ports?device_id=3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f HTTP/1.1" status: 200 len: 950 time: 0.0573430 Dec 09 21:45:24.969045 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-537e4e63-514c-4855-835f-199b67c22845 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5190 time: 0.0615444 Dec 09 21:45:24.969436 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41078) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:24.986729 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-645d4e28-78fb-41a4-a425-16055358706c req-3e58dffc-b002-4483-ae88-cc632b55c968 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/security-groups?id=70b6e8f6-3793-4fd9-91c8-b7d3cb7e3581&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436378 Dec 09 21:45:25.003527 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56d82931-b478-4b18-81ad-fc480b8f9f44 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:25.008838 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56d82931-b478-4b18-81ad-fc480b8f9f44 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:25.037565 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56d82931-b478-4b18-81ad-fc480b8f9f44 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:25.045199 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56d82931-b478-4b18-81ad-fc480b8f9f44 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:25.048005 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-56d82931-b478-4b18-81ad-fc480b8f9f44 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "DELETE /v2.0/security-group-rules/2f499007-6cbe-494c-a6ef-0649c0c45e29 HTTP/1.1" status: 204 len: 168 time: 0.0775046 Dec 09 21:45:25.049279 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41084) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:25.056069 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56d82931-b478-4b18-81ad-fc480b8f9f44 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=2f499007-6cbe-494c-a6ef-0649c0c45e29,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:25.105256 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ce463615-8cda-4b3d-8eee-1d6b7238977e tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4649 time: 0.0547287 Dec 09 21:45:25.108069 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41088) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:25.136508 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-06ecc74b-98f4-47ec-ab6a-46687133b1dd tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:25.145322 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-06ecc74b-98f4-47ec-ab6a-46687133b1dd tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:25.173104 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-06ecc74b-98f4-47ec-ab6a-46687133b1dd tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:25.180691 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-06ecc74b-98f4-47ec-ab6a-46687133b1dd tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:25.183664 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-06ecc74b-98f4-47ec-ab6a-46687133b1dd tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "DELETE /v2.0/security-group-rules/2d2e4873-461f-4cab-a07d-33eb82acbb81 HTTP/1.1" status: 204 len: 168 time: 0.0708735 Dec 09 21:45:25.184715 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41092) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:25.186449 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06ecc74b-98f4-47ec-ab6a-46687133b1dd tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=2d2e4873-461f-4cab-a07d-33eb82acbb81,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:25.236896 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-54542d2b-f633-430a-b073-05078e922a69 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4108 time: 0.0507786 Dec 09 21:45:25.239963 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41100) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:25.270014 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8d8bfca8-b439-473b-8414-05b1491828ef tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:25.278091 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8d8bfca8-b439-473b-8414-05b1491828ef tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:25.320489 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8d8bfca8-b439-473b-8414-05b1491828ef tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:25.330464 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8d8bfca8-b439-473b-8414-05b1491828ef tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:25.333240 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8d8bfca8-b439-473b-8414-05b1491828ef tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "DELETE /v2.0/security-group-rules/a1befc84-e3aa-4585-bda3-52d4392798d9 HTTP/1.1" status: 204 len: 168 time: 0.0914638 Dec 09 21:45:25.335573 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41106) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:25.342106 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d8bfca8-b439-473b-8414-05b1491828ef tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=a1befc84-e3aa-4585-bda3-52d4392798d9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:25.365290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41108) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:25.409400 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c59c3323-25a7-40c1-88a9-a4b353cdd610 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0696526 Dec 09 21:45:25.409633 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41112) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:25.447911 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-623aaebd-2741-4f83-a06c-732b77146460 req-ebb4f872-23aa-4f9e-9517-20a0a2ca4269 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:25.450493 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-623aaebd-2741-4f83-a06c-732b77146460 req-ebb4f872-23aa-4f9e-9517-20a0a2ca4269 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 944 time: 0.0759909 Dec 09 21:45:25.483550 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e7b9ec7f-145a-4451-9f1f-cbb2d6693b46 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:25.514811 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-f433c503-2cc4-4520-90c3-161e37abe411 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Request body: {'port': {'name': 'tempest-RoutersAdminNegativeTest-1964147953', 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:25.518748 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e7b9ec7f-145a-4451-9f1f-cbb2d6693b46 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:25.519995 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-623aaebd-2741-4f83-a06c-732b77146460 req-faa55825-436b-454e-955f-4576c7cfc7a7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0607259 Dec 09 21:45:25.564763 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f433c503-2cc4-4520-90c3-161e37abe411 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Made reservation on behalf of b909ba7eb72d4a608f7beb3dd84f3d6b for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:25.567365 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f433c503-2cc4-4520-90c3-161e37abe411 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:25.577329 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f433c503-2cc4-4520-90c3-161e37abe411 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:25.584864 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e7b9ec7f-145a-4451-9f1f-cbb2d6693b46 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:25.587413 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e7b9ec7f-145a-4451-9f1f-cbb2d6693b46 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:25.588581 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e7b9ec7f-145a-4451-9f1f-cbb2d6693b46 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "DELETE /v2.0/security-groups/0c43a554-d38e-4c61-beca-8bb5e1b354f3 HTTP/1.1" status: 204 len: 168 time: 0.1779189 Dec 09 21:45:25.591728 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41114) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:25.598052 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7b9ec7f-145a-4451-9f1f-cbb2d6693b46 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c43a554-d38e-4c61-beca-8bb5e1b354f3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:25.638489 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-934ca95b-dc90-46b5-954f-7115a119942a tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0453632 Dec 09 21:45:25.645130 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41116) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:25.648312 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-30bf15a1-d9a7-46d7-a9eb-c76c8ed01f07 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Request body: {'security_group': {'name': 'tempest-secgroup--122406578'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:25.688309 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30bf15a1-d9a7-46d7-a9eb-c76c8ed01f07 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:25.726432 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f433c503-2cc4-4520-90c3-161e37abe411 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:25.732736 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f433c503-2cc4-4520-90c3-161e37abe411 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:25.742628 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-f433c503-2cc4-4520-90c3-161e37abe411 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] device_id is not set on port 9b097a73-ba79-4ec0-b17c-530ca4fb9c28 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:45:25.845704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f433c503-2cc4-4520-90c3-161e37abe411 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=751475c2-fe5f-41c2-a0cf-036d32a0b19c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:25.900797 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30bf15a1-d9a7-46d7-a9eb-c76c8ed01f07 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:25.921161 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30bf15a1-d9a7-46d7-a9eb-c76c8ed01f07 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:25.964262 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30bf15a1-d9a7-46d7-a9eb-c76c8ed01f07 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:25.965499 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-30bf15a1-d9a7-46d7-a9eb-c76c8ed01f07 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.3211346 Dec 09 21:45:25.969027 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41118) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:25.974030 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30bf15a1-d9a7-46d7-a9eb-c76c8ed01f07 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c30a4576-66b4-4623-8def-3200a9b9bdc8,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:25.974955 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a4d4a3b1-4804-469e-97ea-e95e01b315b1 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Request body: {'security_group_rule': {'security_group_id': 'c30a4576-66b4-4623-8def-3200a9b9bdc8', 'direction': 'ingress', 'protocol': 17}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:25.976728 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-f433c503-2cc4-4520-90c3-161e37abe411 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Allocated IP 172.25.3.64 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/9b097a73-ba79-4ec0-b17c-530ca4fb9c28) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:45:26.012567 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a4d4a3b1-4804-469e-97ea-e95e01b315b1 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.079764 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a4d4a3b1-4804-469e-97ea-e95e01b315b1 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.084359 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a4d4a3b1-4804-469e-97ea-e95e01b315b1 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.112510 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4d4a3b1-4804-469e-97ea-e95e01b315b1 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bc4e0269-b47d-4035-8a8a-80461f2b5d60,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:26.140620 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a4d4a3b1-4804-469e-97ea-e95e01b315b1 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.142016 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a4d4a3b1-4804-469e-97ea-e95e01b315b1 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 767 time: 0.1718073 Dec 09 21:45:26.144919 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41122) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:26.161345 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f433c503-2cc4-4520-90c3-161e37abe411 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.183103 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 201bc3ab-e2ab-4e46-9cc3-b13f3373442f details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:45:26.201539 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e8917b8-a2a5-480b-b6bc-5fd83dd874e0 req-e4c17e96-a7ee-4033-bf6d-3449e4338f16 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:26.203162 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e8917b8-a2a5-480b-b6bc-5fd83dd874e0 req-e4c17e96-a7ee-4033-bf6d-3449e4338f16 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/ports?device_id=3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f HTTP/1.1" status: 200 len: 950 time: 0.1122856 Dec 09 21:45:26.209706 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f433c503-2cc4-4520-90c3-161e37abe411 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.240380 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9e2945a2-ede6-409f-a0c6-2272e4253c0f tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.265685 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f433c503-2cc4-4520-90c3-161e37abe411 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:45:26.269497 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-f433c503-2cc4-4520-90c3-161e37abe411 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:26.280977 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9e2945a2-ede6-409f-a0c6-2272e4253c0f tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.287172 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e8917b8-a2a5-480b-b6bc-5fd83dd874e0 req-07635f84-a19c-4345-8d51-9d7a9faa5b69 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/security-groups?id=70b6e8f6-3793-4fd9-91c8-b7d3cb7e3581&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0762010 Dec 09 21:45:26.294114 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f433c503-2cc4-4520-90c3-161e37abe411 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:45:26.298842 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2db18e28-c20b-4309-8057-b598d2dbfb43 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:45:26.336711 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9e2945a2-ede6-409f-a0c6-2272e4253c0f tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.339377 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9e2945a2-ede6-409f-a0c6-2272e4253c0f tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.340555 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9e2945a2-ede6-409f-a0c6-2272e4253c0f tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "DELETE /v2.0/security-groups/c30a4576-66b4-4623-8def-3200a9b9bdc8 HTTP/1.1" status: 204 len: 168 time: 0.1946719 Dec 09 21:45:26.343869 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41126) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:26.347019 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=201bc3ab-e2ab-4e46-9cc3-b13f3373442f,segment=NetworkSegment(2316fee1-a288-4d09-bf17-e0a19e0adf8d),segment_id=2316fee1-a288-4d09-bf17-e0a19e0adf8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:26.361870 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e2945a2-ede6-409f-a0c6-2272e4253c0f tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c30a4576-66b4-4623-8def-3200a9b9bdc8,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:26.367049 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f433c503-2cc4-4520-90c3-161e37abe411 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Pushing event updated for resources: {'Port': ['ID=9b097a73-ba79-4ec0-b17c-530ca4fb9c28,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:26.390559 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f433c503-2cc4-4520-90c3-161e37abe411 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:26.391383 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f433c503-2cc4-4520-90c3-161e37abe411 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.394299 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-66cdb72f-df07-4f4d-9a07-3f7b454a16d8 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0491946 Dec 09 21:45:26.398847 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41128) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:26.399311 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '201bc3ab-e2ab-4e46-9cc3-b13f3373442f', 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa', 'port_id': '201bc3ab-e2ab-4e46-9cc3-b13f3373442f', 'mac_address': 'fa:16:3e:96:e3:30', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 140, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '017fde5b-ddc1-4da5-8c6b-2b98296748e5', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:45:26.404453 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-da9871ee-8b91-4b6a-b16e-97cc47d21675 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Request body: {'security_group': {'name': 'tempest-secgroup--981846980'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:26.430919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-581f5c70-9c9f-46a3-9972-198096d510fe None None] Provisioning complete for port 9b097a73-ba79-4ec0-b17c-530ca4fb9c28 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:26.431303 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-581f5c70-9c9f-46a3-9972-198096d510fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.443904 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da9871ee-8b91-4b6a-b16e-97cc47d21675 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.459396 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f433c503-2cc4-4520-90c3-161e37abe411 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1032 time: 1.0880606 Dec 09 21:45:26.459396 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41134) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:26.463601 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-24dbe310-0d53-468c-8dbb-3268f26c31da tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Request body: {'router': {'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.64'}]}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:26.510360 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24dbe310-0d53-468c-8dbb-3268f26c31da tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.511361 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24dbe310-0d53-468c-8dbb-3268f26c31da tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.547406 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.571660 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-581f5c70-9c9f-46a3-9972-198096d510fe None None] Port 9b097a73-ba79-4ec0-b17c-530ca4fb9c28 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:45:26.581399 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 201bc3ab-e2ab-4e46-9cc3-b13f3373442f {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:45:26.591005 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da9871ee-8b91-4b6a-b16e-97cc47d21675 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.602244 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da9871ee-8b91-4b6a-b16e-97cc47d21675 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.633810 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da9871ee-8b91-4b6a-b16e-97cc47d21675 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.635228 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-da9871ee-8b91-4b6a-b16e-97cc47d21675 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.2353644 Dec 09 21:45:26.636172 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=201bc3ab-e2ab-4e46-9cc3-b13f3373442f,segment=NetworkSegment(2316fee1-a288-4d09-bf17-e0a19e0adf8d),segment_id=2316fee1-a288-4d09-bf17-e0a19e0adf8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:26.641549 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41142) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:26.646052 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.650060 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-911bf899-6130-45b5-b181-30ce82671a0b tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Request body: {'security_group': {'name': 'tempest-secgroup--100920593'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:26.660520 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da9871ee-8b91-4b6a-b16e-97cc47d21675 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fa72ca82-e0fc-41f6-8a9a-093acc83f248,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:26.661137 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24dbe310-0d53-468c-8dbb-3268f26c31da tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.684994 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-911bf899-6130-45b5-b181-30ce82671a0b tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.734412 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=201bc3ab-e2ab-4e46-9cc3-b13f3373442f,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:26.846847 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-911bf899-6130-45b5-b181-30ce82671a0b tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.891359 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-911bf899-6130-45b5-b181-30ce82671a0b tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.896615 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['201bc3ab-e2ab-4e46-9cc3-b13f3373442f'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:45:26.929099 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24dbe310-0d53-468c-8dbb-3268f26c31da tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.934442 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-911bf899-6130-45b5-b181-30ce82671a0b tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:26.935980 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-911bf899-6130-45b5-b181-30ce82671a0b tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.2931392 Dec 09 21:45:26.938656 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-911bf899-6130-45b5-b181-30ce82671a0b tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c4b5d3ed-0353-43e9-8236-c17c81fa5683,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:26.939307 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41146) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:26.946534 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-4c035d33-3755-4fc0-8f87-2fa1c1081556 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Request body: {'security_group_rule': {'security_group_id': 'fa72ca82-e0fc-41f6-8a9a-093acc83f248', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'udp', 'port_range_min': 50, 'port_range_max': 55, 'remote_group_id': 'c4b5d3ed-0353-43e9-8236-c17c81fa5683', 'remote_ip_prefix': None}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:26.956172 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ea9e1fb-81a5-4884-af2c-0df6e064b04a req-33f30cc5-a234-4002-967d-f6d287a43d25 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:26.963668 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ea9e1fb-81a5-4884-af2c-0df6e064b04a req-33f30cc5-a234-4002-967d-f6d287a43d25 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 945 time: 0.1066768 Dec 09 21:45:27.024695 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ea9e1fb-81a5-4884-af2c-0df6e064b04a req-9e494ef7-6bed-4199-b101-d4dfc8c74143 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0601368 Dec 09 21:45:27.076077 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c035d33-3755-4fc0-8f87-2fa1c1081556 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:27.168030 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c035d33-3755-4fc0-8f87-2fa1c1081556 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:27.212757 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c035d33-3755-4fc0-8f87-2fa1c1081556 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:27.261069 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c035d33-3755-4fc0-8f87-2fa1c1081556 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=50c0598f-3b55-46bb-a9ab-98e393fc2e85,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:27.283395 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:27.291765 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c035d33-3755-4fc0-8f87-2fa1c1081556 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:27.295629 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4c035d33-3755-4fc0-8f87-2fa1c1081556 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 798 time: 0.3526046 Dec 09 21:45:27.296435 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41148) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:27.333412 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24dbe310-0d53-468c-8dbb-3268f26c31da tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:27.357643 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-064af831-991f-4b45-afed-9ca56aaa0e03 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:27.362007 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:27.373538 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-064af831-991f-4b45-afed-9ca56aaa0e03 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:27.377537 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24dbe310-0d53-468c-8dbb-3268f26c31da tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:27.417119 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-064af831-991f-4b45-afed-9ca56aaa0e03 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:27.423774 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-064af831-991f-4b45-afed-9ca56aaa0e03 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:27.429018 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-064af831-991f-4b45-afed-9ca56aaa0e03 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "DELETE /v2.0/security-group-rules/50c0598f-3b55-46bb-a9ab-98e393fc2e85 HTTP/1.1" status: 204 len: 168 time: 0.1306002 Dec 09 21:45:27.430279 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41150) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:27.466751 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-064af831-991f-4b45-afed-9ca56aaa0e03 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=50c0598f-3b55-46bb-a9ab-98e393fc2e85,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:27.498410 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41152) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:27.499915 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5d7500ca-515e-4bcf-8f80-d32aa68d1fe8 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4659 time: 0.0566833 Dec 09 21:45:27.881822 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-face059f-4fa1-4139-a35f-e500220167ea tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:27.914254 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24dbe310-0d53-468c-8dbb-3268f26c31da tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:27.916710 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-face059f-4fa1-4139-a35f-e500220167ea tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:28.125440 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24dbe310-0d53-468c-8dbb-3268f26c31da tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:28.131823 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24dbe310-0d53-468c-8dbb-3268f26c31da tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:28.140351 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-face059f-4fa1-4139-a35f-e500220167ea tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:28.143212 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-face059f-4fa1-4139-a35f-e500220167ea tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:28.145266 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-face059f-4fa1-4139-a35f-e500220167ea tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "DELETE /v2.0/security-groups/c4b5d3ed-0353-43e9-8236-c17c81fa5683 HTTP/1.1" status: 204 len: 168 time: 0.6455646 Dec 09 21:45:28.147659 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41160) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:28.187651 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-face059f-4fa1-4139-a35f-e500220167ea tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c4b5d3ed-0353-43e9-8236-c17c81fa5683,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:28.197199 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a49e97e4-1ad9-41f4-8483-12ce3be3f890 req-b72ee02d-3323-4add-8dd1-6f3a0bf5a4dd tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:28.199214 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a49e97e4-1ad9-41f4-8483-12ce3be3f890 req-b72ee02d-3323-4add-8dd1-6f3a0bf5a4dd tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 945 time: 0.0996683 Dec 09 21:45:28.201771 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 201bc3ab-e2ab-4e46-9cc3-b13f3373442f up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:45:28.206226 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24dbe310-0d53-468c-8dbb-3268f26c31da tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:28.206880 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-24dbe310-0d53-468c-8dbb-3268f26c31da tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Fanout notify agent at l3_agent the message router_deleted on router 52eb47c1-305d-4d73-9a95-51bdbcce7c13 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:45:28.231650 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-24dbe310-0d53-468c-8dbb-3268f26c31da tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] create failed (client error): There was a conflict when trying to complete your request. Dec 09 21:45:28.232889 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-24dbe310-0d53-468c-8dbb-3268f26c31da tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 409 len: 371 time: 1.7738125 Dec 09 21:45:28.236563 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41162) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:28.258475 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8e023b5f-8c58-420e-b2a7-4bca616ae3d0 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4544 time: 0.1092806 Dec 09 21:45:28.269156 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41164) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:28.278070 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:45:28.282173 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:28.282571 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:28.301516 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a49e97e4-1ad9-41f4-8483-12ce3be3f890 req-3207c0a3-f7ce-485d-ba0d-4b1b3482a365 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0918906 Dec 09 21:45:28.367792 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:28.387941 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ca99b741-09f5-4fce-870b-9552b8910dd5 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:28.398381 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9c9545e3-43c2-403d-a699-e38d4f4c2a1b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '201bc3ab-e2ab-4e46-9cc3-b13f3373442f'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:45:28.401395 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d117725e-3b7b-4111-872d-08e6e09fb493" -d '{"events": [{"server_uuid": "9c9545e3-43c2-403d-a699-e38d4f4c2a1b", "name": "network-vif-plugged", "status": "completed", "tag": "201bc3ab-e2ab-4e46-9cc3-b13f3373442f"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:45:28.416414 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=201bc3ab-e2ab-4e46-9cc3-b13f3373442f,segment=NetworkSegment(2316fee1-a288-4d09-bf17-e0a19e0adf8d),segment_id=2316fee1-a288-4d09-bf17-e0a19e0adf8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:28.422388 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:28.423571 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ca99b741-09f5-4fce-870b-9552b8910dd5 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:28.454655 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:45:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-79a03710-445e-4206-a9b4-ff303fb11c9e x-openstack-request-id: req-79a03710-445e-4206-a9b4-ff303fb11c9e {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:45:28.455029 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9c9545e3-43c2-403d-a699-e38d4f4c2a1b", "name": "network-vif-plugged", "status": "completed", "tag": "201bc3ab-e2ab-4e46-9cc3-b13f3373442f", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:45:28.455218 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-79a03710-445e-4206-a9b4-ff303fb11c9e {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:45:28.455629 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9c9545e3-43c2-403d-a699-e38d4f4c2a1b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '201bc3ab-e2ab-4e46-9cc3-b13f3373442f', 'code': 200} Dec 09 21:45:28.468420 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-159e8638-200f-4c04-9659-9a9c5ad6c169 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Deleting port 9b097a73-ba79-4ec0-b17c-530ca4fb9c28 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:45:28.468706 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-159e8638-200f-4c04-9659-9a9c5ad6c169 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:28.480862 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ca99b741-09f5-4fce-870b-9552b8910dd5 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:28.483804 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ca99b741-09f5-4fce-870b-9552b8910dd5 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:28.487105 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ca99b741-09f5-4fce-870b-9552b8910dd5 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "DELETE /v2.0/security-groups/fa72ca82-e0fc-41f6-8a9a-093acc83f248 HTTP/1.1" status: 204 len: 168 time: 0.2144732 Dec 09 21:45:28.488146 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41168) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:28.500720 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=201bc3ab-e2ab-4e46-9cc3-b13f3373442f,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:28.507799 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca99b741-09f5-4fce-870b-9552b8910dd5 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fa72ca82-e0fc-41f6-8a9a-093acc83f248,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:28.573513 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-50fa35a8-e8ec-407e-8399-35a3c17da9b8 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0836520 Dec 09 21:45:28.573779 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41170) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:28.580116 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-819172b5-b9f6-420b-af8b-d221342508ff tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Request body: {'security_group': {'name': 'tempest-secgroup--875787279'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:28.614969 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-159e8638-200f-4c04-9659-9a9c5ad6c169 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:28.635524 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-159e8638-200f-4c04-9659-9a9c5ad6c169 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Calling delete_port for 9b097a73-ba79-4ec0-b17c-530ca4fb9c28 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:45:28.638723 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06701b51-ed40-45b9-b44e-747ee4b88ddc req-2dd647d7-3e9d-4044-8c3a-d1e8490eed94 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:28.640750 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-06701b51-ed40-45b9-b44e-747ee4b88ddc req-2dd647d7-3e9d-4044-8c3a-d1e8490eed94 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 1098 time: 0.1055546 Dec 09 21:45:28.643971 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-819172b5-b9f6-420b-af8b-d221342508ff tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:28.764648 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-06701b51-ed40-45b9-b44e-747ee4b88ddc req-3e081664-6170-4fab-9dab-6bc4feff7c5d service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1131122 Dec 09 21:45:28.835808 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-819172b5-b9f6-420b-af8b-d221342508ff tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:28.842490 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-819172b5-b9f6-420b-af8b-d221342508ff tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:28.878845 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-159e8638-200f-4c04-9659-9a9c5ad6c169 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:28.893182 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-819172b5-b9f6-420b-af8b-d221342508ff tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:28.894472 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-819172b5-b9f6-420b-af8b-d221342508ff tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.3195837 Dec 09 21:45:28.897714 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41172) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:28.897915 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-819172b5-b9f6-420b-af8b-d221342508ff tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0fc0543e-0238-46e0-8b12-e2894cdf1c83,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:28.903032 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-4c51f388-41aa-4412-b33a-f353cffdf3f6 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Request body: {'security_group_rule': {'security_group_id': '0fc0543e-0238-46e0-8b12-e2894cdf1c83', 'direction': 'ingress', 'ethertype': 'IPv4', 'protocol': 'tcp', 'port_range_min': 76, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': '172.20.0.0/16'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:28.923057 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-159e8638-200f-4c04-9659-9a9c5ad6c169 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Pushing event deleted for resources: {'Port': ['ID=9b097a73-ba79-4ec0-b17c-530ca4fb9c28,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:28.935333 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e2151f8b-1cbc-4165-8688-f5434c8ae745 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:45:28.945374 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4c51f388-41aa-4412-b33a-f353cffdf3f6 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:28.986193 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-159e8638-200f-4c04-9659-9a9c5ad6c169 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:28.996758 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-159e8638-200f-4c04-9659-9a9c5ad6c169 tempest-RoutersAdminNegativeTest-1617063890 tempest-RoutersAdminNegativeTest-1617063890-project-admin] 10.222.0.13 "DELETE /v2.0/ports/9b097a73-ba79-4ec0-b17c-530ca4fb9c28 HTTP/1.1" status: 204 len: 168 time: 0.7592723 Dec 09 21:45:29.015043 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4c51f388-41aa-4412-b33a-f353cffdf3f6 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.019760 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4c51f388-41aa-4412-b33a-f353cffdf3f6 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.044063 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4c51f388-41aa-4412-b33a-f353cffdf3f6 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.048630 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4c51f388-41aa-4412-b33a-f353cffdf3f6 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 0.1467273 Dec 09 21:45:29.048630 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c51f388-41aa-4412-b33a-f353cffdf3f6 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=75c1c56d-7e73-440d-989c-888eaae5ff47,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:29.048630 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41176) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:29.077565 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-30954d1d-9003-4c12-8b47-07e3f2c4f5ca tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.086659 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-30954d1d-9003-4c12-8b47-07e3f2c4f5ca tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.118220 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-30954d1d-9003-4c12-8b47-07e3f2c4f5ca tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.125929 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-30954d1d-9003-4c12-8b47-07e3f2c4f5ca tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.127160 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-30954d1d-9003-4c12-8b47-07e3f2c4f5ca tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "DELETE /v2.0/security-group-rules/75c1c56d-7e73-440d-989c-888eaae5ff47 HTTP/1.1" status: 204 len: 168 time: 0.0774498 Dec 09 21:45:29.130674 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41178) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:29.134766 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30954d1d-9003-4c12-8b47-07e3f2c4f5ca tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=75c1c56d-7e73-440d-989c-888eaae5ff47,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:29.176201 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-72443f59-7376-4be2-8552-a74cb0068fc7 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0442336 Dec 09 21:45:29.178417 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41180) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:29.239278 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e95f243c-e866-47ee-9275-9fe9e614b263 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.266456 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e95f243c-e866-47ee-9275-9fe9e614b263 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.291722 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41184) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:29.313385 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e95f243c-e866-47ee-9275-9fe9e614b263 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.316731 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e95f243c-e866-47ee-9275-9fe9e614b263 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.320420 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e95f243c-e866-47ee-9275-9fe9e614b263 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "DELETE /v2.0/security-groups/0fc0543e-0238-46e0-8b12-e2894cdf1c83 HTTP/1.1" status: 204 len: 168 time: 0.1384492 Dec 09 21:45:29.321197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41188) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:29.339823 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e95f243c-e866-47ee-9275-9fe9e614b263 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0fc0543e-0238-46e0-8b12-e2894cdf1c83,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:29.380531 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c41442b6-5729-48b6-a9f5-1d9624a3619d tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0577090 Dec 09 21:45:29.384563 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41192) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:29.389836 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-618795fe-5a8d-41c6-8b7e-487537215430 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Request body: {'security_group': {'name': 'tempest-secgroup--1508328065'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:29.437691 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-17f1fd9d-cd59-4129-b832-57b134cc3bc2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.439752 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-618795fe-5a8d-41c6-8b7e-487537215430 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.465458 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d82de12a-bb29-403d-be00-2b30a453a0fe req-0545c426-2b1a-4464-a1e0-895d74fcfa0d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:29.466965 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d82de12a-bb29-403d-be00-2b30a453a0fe req-0545c426-2b1a-4464-a1e0-895d74fcfa0d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.0717878 Dec 09 21:45:29.544654 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d82de12a-bb29-403d-be00-2b30a453a0fe req-ad953161-104b-45c7-9385-0ce714aef6fb tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0660572 Dec 09 21:45:29.545115 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-17f1fd9d-cd59-4129-b832-57b134cc3bc2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.551310 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-17f1fd9d-cd59-4129-b832-57b134cc3bc2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.568197 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-618795fe-5a8d-41c6-8b7e-487537215430 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.568197 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-618795fe-5a8d-41c6-8b7e-487537215430 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.599990 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-618795fe-5a8d-41c6-8b7e-487537215430 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.604096 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-618795fe-5a8d-41c6-8b7e-487537215430 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.2157571 Dec 09 21:45:29.604096 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41194) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:29.604367 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-17f1fd9d-cd59-4129-b832-57b134cc3bc2 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=571a0267f0cb49359451af6789359dbf&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3101947 Dec 09 21:45:29.604367 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17f1fd9d-cd59-4129-b832-57b134cc3bc2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d1f11e3f-d300-4e64-a565-4b502eb62e3b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:29.604773 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41196) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:29.608890 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-154a965b-6ac7-47d0-9ef0-56f019fd44de tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Request body: {'security_group_rule': {'security_group_id': '691d6c46-7269-4d28-8bf9-507114e3bb9e', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:29.617846 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-618795fe-5a8d-41c6-8b7e-487537215430 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event updated for resources: {'SecurityGroup': ['ID=691d6c46-7269-4d28-8bf9-507114e3bb9e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:29.664818 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-154a965b-6ac7-47d0-9ef0-56f019fd44de tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.696461 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-344eeb5c-1618-4601-8951-3fc5506cea65 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.728692 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-344eeb5c-1618-4601-8951-3fc5506cea65 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.742320 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-154a965b-6ac7-47d0-9ef0-56f019fd44de tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.750900 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-154a965b-6ac7-47d0-9ef0-56f019fd44de tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.783421 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-154a965b-6ac7-47d0-9ef0-56f019fd44de tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=04ffd204-b343-4c10-862f-9ac915dd9456,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:29.794646 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-154a965b-6ac7-47d0-9ef0-56f019fd44de tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.795971 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-154a965b-6ac7-47d0-9ef0-56f019fd44de tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1903694 Dec 09 21:45:29.798886 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41198) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:29.809236 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-344eeb5c-1618-4601-8951-3fc5506cea65 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.812635 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-344eeb5c-1618-4601-8951-3fc5506cea65 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.816556 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-344eeb5c-1618-4601-8951-3fc5506cea65 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/d1f11e3f-d300-4e64-a565-4b502eb62e3b HTTP/1.1" status: 204 len: 168 time: 0.2097640 Dec 09 21:45:29.823286 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-84cec4d2-0df5-484b-a006-69ee4dab251a tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-group-rules/04ffd204-b343-4c10-862f-9ac915dd9456 HTTP/1.1" status: 200 len: 763 time: 0.0208652 Dec 09 21:45:29.823523 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41202) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:29.831335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-344eeb5c-1618-4601-8951-3fc5506cea65 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d1f11e3f-d300-4e64-a565-4b502eb62e3b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:29.869352 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0e1ba187-32ee-4a5c-94a8-d7af76eedf07 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0443041 Dec 09 21:45:29.872494 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41204) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:29.898878 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7af56aea-ecb6-4adf-8b14-68dc3120cd06 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.906993 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7af56aea-ecb6-4adf-8b14-68dc3120cd06 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.946310 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7af56aea-ecb6-4adf-8b14-68dc3120cd06 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.951760 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7af56aea-ecb6-4adf-8b14-68dc3120cd06 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:29.952927 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7af56aea-ecb6-4adf-8b14-68dc3120cd06 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "DELETE /v2.0/security-group-rules/04ffd204-b343-4c10-862f-9ac915dd9456 HTTP/1.1" status: 204 len: 168 time: 0.0795789 Dec 09 21:45:29.955632 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41206) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:29.981019 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7af56aea-ecb6-4adf-8b14-68dc3120cd06 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=04ffd204-b343-4c10-862f-9ac915dd9456,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:30.010949 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9ca54b62-8967-437d-907e-db95e434a4ec tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0467796 Dec 09 21:45:30.013396 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41210) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:30.019102 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-8b8b6544-5645-4a29-9ec6-24bab0dcd435 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Request body: {'security_group_rule': {'security_group_id': '691d6c46-7269-4d28-8bf9-507114e3bb9e', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:30.064593 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8b8b6544-5645-4a29-9ec6-24bab0dcd435 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:30.139212 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8b8b6544-5645-4a29-9ec6-24bab0dcd435 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:30.143715 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8b8b6544-5645-4a29-9ec6-24bab0dcd435 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:30.162623 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b8b6544-5645-4a29-9ec6-24bab0dcd435 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2ae7a5fc-e7e3-4839-af7a-919201f227b5,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:30.172129 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8b8b6544-5645-4a29-9ec6-24bab0dcd435 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:30.175480 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8b8b6544-5645-4a29-9ec6-24bab0dcd435 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1584008 Dec 09 21:45:30.176166 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41212) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:30.195574 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ff1a3f5e-c5d7-4085-a113-b5c3a5d30431 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-group-rules/2ae7a5fc-e7e3-4839-af7a-919201f227b5 HTTP/1.1" status: 200 len: 763 time: 0.0158074 Dec 09 21:45:30.195853 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41214) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:30.215630 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41216) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:30.245612 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-dc297a0b-66f2-4a61-9797-95cf5d71c360 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0461965 Dec 09 21:45:30.246025 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41218) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:30.268385 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a5850ff3-46b7-4b37-a4a8-e212ec6af988 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=b909ba7eb72d4a608f7beb3dd84f3d6b&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0513825 Dec 09 21:45:30.270957 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41220) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:30.280359 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-244152d9-be11-4365-ae89-c3359baa835e tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:30.289165 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-244152d9-be11-4365-ae89-c3359baa835e tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:30.322849 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-244152d9-be11-4365-ae89-c3359baa835e tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:30.329276 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-244152d9-be11-4365-ae89-c3359baa835e tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:30.332857 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-244152d9-be11-4365-ae89-c3359baa835e tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "DELETE /v2.0/security-group-rules/2ae7a5fc-e7e3-4839-af7a-919201f227b5 HTTP/1.1" status: 204 len: 168 time: 0.0833273 Dec 09 21:45:30.333467 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41222) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:30.336203 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-244152d9-be11-4365-ae89-c3359baa835e tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=2ae7a5fc-e7e3-4839-af7a-919201f227b5,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:30.345312 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1fd92f8f-b910-41a1-8270-417055bc7ecb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:30.378059 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1fd92f8f-b910-41a1-8270-417055bc7ecb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:30.404005 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e9143076-24cb-483a-9897-d24a265edd00 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0691347 Dec 09 21:45:30.406744 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41224) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:30.412400 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-aecb6bd5-f82d-4a6a-8dfe-9bf2ecfebe5c tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Request body: {'security_group_rule': {'security_group_id': '691d6c46-7269-4d28-8bf9-507114e3bb9e', 'protocol': 'icmp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:30.444004 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-aecb6bd5-f82d-4a6a-8dfe-9bf2ecfebe5c tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:30.446776 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1fd92f8f-b910-41a1-8270-417055bc7ecb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:30.449565 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1fd92f8f-b910-41a1-8270-417055bc7ecb admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:30.453258 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1fd92f8f-b910-41a1-8270-417055bc7ecb admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/751475c2-fe5f-41c2-a0cf-036d32a0b19c HTTP/1.1" status: 204 len: 168 time: 0.1788874 Dec 09 21:45:30.459366 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fd92f8f-b910-41a1-8270-417055bc7ecb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=751475c2-fe5f-41c2-a0cf-036d32a0b19c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:30.498390 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-aecb6bd5-f82d-4a6a-8dfe-9bf2ecfebe5c tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:30.504107 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-aecb6bd5-f82d-4a6a-8dfe-9bf2ecfebe5c tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:30.526390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aecb6bd5-f82d-4a6a-8dfe-9bf2ecfebe5c tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5493257a-73b6-4c4c-80e3-f266d540a813,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:30.532386 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-aecb6bd5-f82d-4a6a-8dfe-9bf2ecfebe5c tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:30.533759 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-aecb6bd5-f82d-4a6a-8dfe-9bf2ecfebe5c tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1259813 Dec 09 21:45:30.536757 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41228) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:30.558496 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-774e1279-db7e-4814-8ecc-effb7f4885a0 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-group-rules/5493257a-73b6-4c4c-80e3-f266d540a813 HTTP/1.1" status: 200 len: 764 time: 0.0180779 Dec 09 21:45:30.558799 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41230) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:30.611575 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-90a9b643-18b6-4f82-9830-03a505f42e07 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4114 time: 0.0517278 Dec 09 21:45:30.611927 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41234) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:30.656663 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c9c3b0c-3d54-4a06-9661-0690b4825385 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:30.682454 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c9c3b0c-3d54-4a06-9661-0690b4825385 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:30.729290 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e9952e8-02a3-4ab7-a9b5-6726b9fd091d req-bdfaf31d-b7c2-4ee6-9d75-dd7b3112ec6f tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:30.738288 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e9952e8-02a3-4ab7-a9b5-6726b9fd091d req-bdfaf31d-b7c2-4ee6-9d75-dd7b3112ec6f tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.0954700 Dec 09 21:45:30.758809 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c9c3b0c-3d54-4a06-9661-0690b4825385 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:30.760870 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5413c977-d7d5-431b-9cbd-b3d4283f62e6 req-f88c0635-4551-4c80-b155-a5d4aa3fb301 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=19f2fc87-2a43-4349-a873-6d310f0c574e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0589995 Dec 09 21:45:30.768154 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c9c3b0c-3d54-4a06-9661-0690b4825385 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:30.772046 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7c9c3b0c-3d54-4a06-9661-0690b4825385 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "DELETE /v2.0/security-group-rules/5493257a-73b6-4c4c-80e3-f266d540a813 HTTP/1.1" status: 204 len: 168 time: 0.1567700 Dec 09 21:45:30.777081 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41238) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:30.780668 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c9c3b0c-3d54-4a06-9661-0690b4825385 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=5493257a-73b6-4c4c-80e3-f266d540a813,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:30.836488 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e9952e8-02a3-4ab7-a9b5-6726b9fd091d req-debe4afa-8f07-49bb-ac8b-c1080e72c063 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0972023 Dec 09 21:45:30.879984 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f3313280-6e69-4da3-800e-f22134cf470e tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1012373 Dec 09 21:45:30.882781 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41246) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:30.893322 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5413c977-d7d5-431b-9cbd-b3d4283f62e6 req-005cb11a-292b-4737-809d-d818ab70713d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:30.898125 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5413c977-d7d5-431b-9cbd-b3d4283f62e6 req-005cb11a-292b-4737-809d-d818ab70713d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=6f2bd57ebcdc4c748e719519e3961b70&device_id=19f2fc87-2a43-4349-a873-6d310f0c574e HTTP/1.1" status: 200 len: 1098 time: 0.1044061 Dec 09 21:45:31.010023 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-88c87282-612d-4ff8-9a45-f3f6870b5249 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:31.033872 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5413c977-d7d5-431b-9cbd-b3d4283f62e6 req-3cb62a68-c59a-4bca-a7bd-ae3482890c42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:31.036196 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5413c977-d7d5-431b-9cbd-b3d4283f62e6 req-3cb62a68-c59a-4bca-a7bd-ae3482890c42 service neutron] 10.222.0.31 "GET /v2.0/networks?id=eda4cb39-afde-43d7-a13b-5227cc6862dd HTTP/1.1" status: 200 len: 915 time: 0.1157978 Dec 09 21:45:31.039466 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cb0133c-b577-4c95-a6b6-c18d0437a217 req-54054057-64bc-45f5-98d7-44722d8b94a0 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:31.041057 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8cb0133c-b577-4c95-a6b6-c18d0437a217 req-54054057-64bc-45f5-98d7-44722d8b94a0 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.1224489 Dec 09 21:45:31.067928 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-88c87282-612d-4ff8-9a45-f3f6870b5249 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:31.093187 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5413c977-d7d5-431b-9cbd-b3d4283f62e6 req-21ed9965-052b-42f3-88b7-9e6bcdd58264 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=bd9c1c28-304b-4656-bd19-43407d1b6dc2 HTTP/1.1" status: 200 len: 217 time: 0.0447297 Dec 09 21:45:31.141744 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8cb0133c-b577-4c95-a6b6-c18d0437a217 req-195bb97c-851c-4644-ac6d-77951a3f2c7e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0922794 Dec 09 21:45:31.158761 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-88c87282-612d-4ff8-9a45-f3f6870b5249 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:31.170161 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5413c977-d7d5-431b-9cbd-b3d4283f62e6 req-62d3ab80-fede-465e-884b-d12e5b671644 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:31.170892 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5413c977-d7d5-431b-9cbd-b3d4283f62e6 req-62d3ab80-fede-465e-884b-d12e5b671644 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=24afae0e-0a38-484d-a023-a2fb471bdb33 HTTP/1.1" status: 200 len: 854 time: 0.0706944 Dec 09 21:45:31.172948 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-88c87282-612d-4ff8-9a45-f3f6870b5249 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:31.174146 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-88c87282-612d-4ff8-9a45-f3f6870b5249 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "DELETE /v2.0/security-groups/691d6c46-7269-4d28-8bf9-507114e3bb9e HTTP/1.1" status: 204 len: 168 time: 0.2890828 Dec 09 21:45:31.174627 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41256) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:31.176684 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41258) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:31.186583 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88c87282-612d-4ff8-9a45-f3f6870b5249 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=691d6c46-7269-4d28-8bf9-507114e3bb9e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:31.246995 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5413c977-d7d5-431b-9cbd-b3d4283f62e6 req-542b1c62-b71d-4b08-85ed-e12c97ef6149 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eda4cb39-afde-43d7-a13b-5227cc6862dd&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0543962 Dec 09 21:45:31.296943 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6a4fd706-3e5c-4fc4-889b-9da935426bdc tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1122169 Dec 09 21:45:31.303249 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41264) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:31.307554 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-8a51aef7-fcdf-43af-98ed-8fcb29f3f9af tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Request body: {'security_group': {'name': 'tempest-secgroup--118093561'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:31.314637 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc7665d9-95e7-468e-9203-79e32894558a tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:31.319297 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-dc7665d9-95e7-468e-9203-79e32894558a tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 1093 time: 0.1407654 Dec 09 21:45:31.320315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41266) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:31.327331 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-5f8deee3-8cb0-4549-af81-48624bc2418e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': '201bc3ab-e2ab-4e46-9cc3-b13f3373442f', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'fixed_ip_address': '172.20.0.12'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:31.368903 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.db.api [None req-8a51aef7-fcdf-43af-98ed-8fcb29f3f9af tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Dec 09 21:45:31.368903 n-d-713301-27 neutron-server[103437]: [SQL: INSERT INTO reservations (project_id, id, expiration) VALUES (%(project_id)s, %(id)s, %(expiration)s)] Dec 09 21:45:31.368903 n-d-713301-27 neutron-server[103437]: [parameters: {'project_id': '85428bdd33ff43a48840d49fb704d115', 'id': '4456a59a-f037-4300-a927-84d53acc9226', 'expiration': datetime.datetime(2021, 12, 9, 21, 47, 31, 359431)}] Dec 09 21:45:31.368903 n-d-713301-27 neutron-server[103437]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=103437) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:45:31.369898 n-d-713301-27 neutron-server[103437]: DEBUG oslo_db.api [None req-8a51aef7-fcdf-43af-98ed-8fcb29f3f9af tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:45:31.379485 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5f8deee3-8cb0-4549-af81-48624bc2418e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:31.395639 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5413c977-d7d5-431b-9cbd-b3d4283f62e6 req-32397686-4047-4c9c-954f-6c6777c3d62b service neutron] 10.222.0.31 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1371522 Dec 09 21:45:31.419659 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41268) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:31.505614 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5413c977-d7d5-431b-9cbd-b3d4283f62e6 req-b0872da2-d072-4cea-91bb-f186b8f3b6ac service neutron] 10.222.0.31 "GET /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1032999 Dec 09 21:45:31.515875 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5f8deee3-8cb0-4549-af81-48624bc2418e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:31.895718 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-84b047de-db97-4daa-a5a6-4c8a4e966e8a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-232572315'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:31.906952 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a51aef7-fcdf-43af-98ed-8fcb29f3f9af tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:31.955663 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-84b047de-db97-4daa-a5a6-4c8a4e966e8a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Made reservation on behalf of d082983dfcfa477f893f6dc13670fdc5 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:31.960465 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84b047de-db97-4daa-a5a6-4c8a4e966e8a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:31.974483 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84b047de-db97-4daa-a5a6-4c8a4e966e8a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:32.012253 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-5f8deee3-8cb0-4549-af81-48624bc2418e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Allocated IP 172.25.3.157 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/ccec756b-58d9-42ec-aedd-629423cfcece) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:45:32.023471 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a51aef7-fcdf-43af-98ed-8fcb29f3f9af tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:32.031114 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a51aef7-fcdf-43af-98ed-8fcb29f3f9af tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:32.079504 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a51aef7-fcdf-43af-98ed-8fcb29f3f9af tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:32.081051 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8a51aef7-fcdf-43af-98ed-8fcb29f3f9af tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.7769721 Dec 09 21:45:32.084355 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a51aef7-fcdf-43af-98ed-8fcb29f3f9af tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e3499d69-96b3-4b56-b3f9-11988ced0bc7,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:32.087303 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41272) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:32.095143 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a8830f56-4c28-470b-9331-d12594b1ff40 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Request body: {'security_group_rule': {'security_group_id': 'e3499d69-96b3-4b56-b3f9-11988ced0bc7', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:32.137642 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8830f56-4c28-470b-9331-d12594b1ff40 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:32.164754 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84b047de-db97-4daa-a5a6-4c8a4e966e8a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:32.178737 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84b047de-db97-4daa-a5a6-4c8a4e966e8a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:32.184479 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5f8deee3-8cb0-4549-af81-48624bc2418e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:32.200271 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8830f56-4c28-470b-9331-d12594b1ff40 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:32.208778 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8830f56-4c28-470b-9331-d12594b1ff40 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:32.214244 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-84b047de-db97-4daa-a5a6-4c8a4e966e8a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] vlan segment allocate from pool success with {'vlan_id': 146, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:45:32.243413 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84b047de-db97-4daa-a5a6-4c8a4e966e8a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:32.243736 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-84b047de-db97-4daa-a5a6-4c8a4e966e8a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Added segment 904c4230-ee6a-43f8-be8a-b7c2d1532fb2 of type vlan for network 86b722dc-adb8-4599-bf9e-8a4aaf4ba7f0 Dec 09 21:45:32.245223 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84b047de-db97-4daa-a5a6-4c8a4e966e8a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event updated for resources: {'SecurityGroup': ['ID=58fa29d4-9073-4ce8-9613-f9a1038ed5c0,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:32.245893 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8830f56-4c28-470b-9331-d12594b1ff40 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:32.249609 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a8830f56-4c28-470b-9331-d12594b1ff40 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1586280 Dec 09 21:45:32.258648 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41274) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:32.264275 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8830f56-4c28-470b-9331-d12594b1ff40 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=98da59f3-ba0b-4a2b-8a02-a1b292a154e6,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:32.319656 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84b047de-db97-4daa-a5a6-4c8a4e966e8a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:32.324535 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5f8deee3-8cb0-4549-af81-48624bc2418e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:32.395704 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f8deee3-8cb0-4549-af81-48624bc2418e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:45:32.405428 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-5f8deee3-8cb0-4549-af81-48624bc2418e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:32.414186 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f8deee3-8cb0-4549-af81-48624bc2418e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:45:32.427567 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84b047de-db97-4daa-a5a6-4c8a4e966e8a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:32.433039 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84b047de-db97-4daa-a5a6-4c8a4e966e8a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:32.433617 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84b047de-db97-4daa-a5a6-4c8a4e966e8a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:32.457388 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f8deee3-8cb0-4549-af81-48624bc2418e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Port': ['ID=ccec756b-58d9-42ec-aedd-629423cfcece,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:32.476492 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e8190320-6e18-4f04-aa1b-e370d05b548a tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:32.548085 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-84b047de-db97-4daa-a5a6-4c8a4e966e8a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 1.1265056 Dec 09 21:45:32.560358 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84b047de-db97-4daa-a5a6-4c8a4e966e8a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event updated for resources: {'Network': ['ID=86b722dc-adb8-4599-bf9e-8a4aaf4ba7f0,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:32.569019 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e8190320-6e18-4f04-aa1b-e370d05b548a tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:32.584015 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 86b722dc-adb8-4599-bf9e-8a4aaf4ba7f0 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:45:32.715924 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e8190320-6e18-4f04-aa1b-e370d05b548a tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:32.719034 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e8190320-6e18-4f04-aa1b-e370d05b548a tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:32.722846 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e8190320-6e18-4f04-aa1b-e370d05b548a tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "DELETE /v2.0/security-groups/e3499d69-96b3-4b56-b3f9-11988ced0bc7 HTTP/1.1" status: 204 len: 168 time: 0.4608526 Dec 09 21:45:32.723708 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41276) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:32.736225 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8190320-6e18-4f04-aa1b-e370d05b548a tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e3499d69-96b3-4b56-b3f9-11988ced0bc7,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:32.820774 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0fcd57ce-9a1c-4e6a-be88-a676bb1c7e14 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0940118 Dec 09 21:45:32.827478 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41278) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:32.930742 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d4edb6ec-9618-4ecc-89d6-b7e42f3852e1 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 2475 time: 0.1056809 Dec 09 21:45:32.933680 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41280) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:32.954424 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-901f991b-11b9-4d8c-8355-157f59b5d4d2 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] delete failed (client error): The resource could not be found. Dec 09 21:45:32.955487 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-901f991b-11b9-4d8c-8355-157f59b5d4d2 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "DELETE /v2.0/security-groups/e3499d69-96b3-4b56-b3f9-11988ced0bc7 HTTP/1.1" status: 404 len: 347 time: 0.0210772 Dec 09 21:45:32.959611 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41282) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:32.969594 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c7b8fb16-baf7-4a00-a666-3f2a33766c63 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:33.053489 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5f8deee3-8cb0-4549-af81-48624bc2418e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:33.061841 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fbdd9286-7ded-4449-a7d5-deb60efff0c1 tempest-SecGroupTest-815509324 tempest-SecGroupTest-815509324-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0981719 Dec 09 21:45:33.141224 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5f8deee3-8cb0-4549-af81-48624bc2418e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:33.338645 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5f8deee3-8cb0-4549-af81-48624bc2418e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:33.354467 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5f8deee3-8cb0-4549-af81-48624bc2418e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:33.437243 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f8deee3-8cb0-4549-af81-48624bc2418e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Port': ['ID=ccec756b-58d9-42ec-aedd-629423cfcece,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:33.542978 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5f8deee3-8cb0-4549-af81-48624bc2418e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:33.546705 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41290) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:33.687265 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-5f8deee3-8cb0-4549-af81-48624bc2418e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Floating IP 8586a0ac-8d71-46f3-ae0a-75565c281860 associated. External IP: 172.25.3.157, port: 201bc3ab-e2ab-4e46-9cc3-b13f3373442f. Dec 09 21:45:33.782762 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b30cece0-5fec-47dc-8de3-94ec95d8935c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=85428bdd33ff43a48840d49fb704d115&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2346311 Dec 09 21:45:33.785370 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41294) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:33.920635 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fe929ef-3a9b-4965-91f9-ebf4f22dcd5f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:33.982454 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fe929ef-3a9b-4965-91f9-ebf4f22dcd5f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:34.033063 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5f8deee3-8cb0-4549-af81-48624bc2418e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Router 71037eba-17b6-499e-8ba6-3a08aa3db0b5 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:45:34.087895 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fe929ef-3a9b-4965-91f9-ebf4f22dcd5f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:34.091125 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fe929ef-3a9b-4965-91f9-ebf4f22dcd5f admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:34.095322 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8fe929ef-3a9b-4965-91f9-ebf4f22dcd5f admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/85744495-8736-45bb-8233-9c0baeb7353d HTTP/1.1" status: 204 len: 168 time: 0.3088593 Dec 09 21:45:34.115483 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fe929ef-3a9b-4965-91f9-ebf4f22dcd5f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=85744495-8736-45bb-8233-9c0baeb7353d,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:34.184060 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5f8deee3-8cb0-4549-af81-48624bc2418e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:45:34.195608 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f65112a-340e-444e-910a-30e94076e6be None None] Sync routers for ids ['71037eba-17b6-499e-8ba6-3a08aa3db0b5'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:45:34.208961 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5f8deee3-8cb0-4549-af81-48624bc2418e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:34.219122 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f65112a-340e-444e-910a-30e94076e6be None None] Routers {'71037eba-17b6-499e-8ba6-3a08aa3db0b5'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:45:34.226534 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-8f65112a-340e-444e-910a-30e94076e6be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:45:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['71037eba-17b6-499e-8ba6-3a08aa3db0b5'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:34.244084 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5f8deee3-8cb0-4549-af81-48624bc2418e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.9220710 Dec 09 21:45:34.245445 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9c9545e3-43c2-403d-a699-e38d4f4c2a1b', 'tag': '201bc3ab-e2ab-4e46-9cc3-b13f3373442f'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:45:34.248369 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ea7d2873-1441-4dc4-b8f4-c699c46b42dc" -d '{"events": [{"name": "network-changed", "server_uuid": "9c9545e3-43c2-403d-a699-e38d4f4c2a1b", "tag": "201bc3ab-e2ab-4e46-9cc3-b13f3373442f"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:45:34.455502 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b7ce289-3ed0-43d1-b7dc-b5db0f35bb9d req-e8743c59-f547-4ddd-b7f8-72339899a2c4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:34.471940 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b7ce289-3ed0-43d1-b7dc-b5db0f35bb9d req-e8743c59-f547-4ddd-b7f8-72339899a2c4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.1204631 Dec 09 21:45:34.518224 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-8f65112a-340e-444e-910a-30e94076e6be None None] Set router 71037eba-17b6-499e-8ba6-3a08aa3db0b5 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:45:34.579478 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b7ce289-3ed0-43d1-b7dc-b5db0f35bb9d req-eb6fb0a8-07b5-457c-a5dc-e2edebf3c1cb tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1024568 Dec 09 21:45:34.588884 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41308) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:34.687040 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:45:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-380f600e-e9b8-4326-bebf-f60eae97bb1a x-openstack-request-id: req-380f600e-e9b8-4326-bebf-f60eae97bb1a {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:45:34.687617 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9c9545e3-43c2-403d-a699-e38d4f4c2a1b", "tag": "201bc3ab-e2ab-4e46-9cc3-b13f3373442f", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:45:34.688054 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-380f600e-e9b8-4326-bebf-f60eae97bb1a {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:45:34.688617 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9c9545e3-43c2-403d-a699-e38d4f4c2a1b', 'tag': '201bc3ab-e2ab-4e46-9cc3-b13f3373442f', 'status': 'completed', 'code': 200} Dec 09 21:45:34.722220 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cac8a9c7-cf44-4506-86b8-d04d6dca4680 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/floatingips/8586a0ac-8d71-46f3-ae0a-75565c281860 HTTP/1.1" status: 200 len: 992 time: 0.1254570 Dec 09 21:45:34.766864 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea7d2873-1441-4dc4-b8f4-c699c46b42dc req-d2553a13-c888-4165-ae7b-12e9bf3ab481 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:34.769492 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ea7d2873-1441-4dc4-b8f4-c699c46b42dc req-d2553a13-c888-4165-ae7b-12e9bf3ab481 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 1098 time: 0.0654922 Dec 09 21:45:34.891009 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea7d2873-1441-4dc4-b8f4-c699c46b42dc req-4916ae05-aa80-4082-b98c-c38ec59cb36a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:34.892553 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ea7d2873-1441-4dc4-b8f4-c699c46b42dc req-4916ae05-aa80-4082-b98c-c38ec59cb36a service neutron] 10.222.0.31 "GET /v2.0/networks?id=4fbe35af-30ff-45b2-b84a-21fea4abf9aa HTTP/1.1" status: 200 len: 898 time: 0.1140549 Dec 09 21:45:35.070522 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-8f65112a-340e-444e-910a-30e94076e6be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'name': 'tempest-TestNetworkAdvancedServerOps-router-446132443', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53'}], 'enable_snat': True}, 'gw_port_id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:11Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2d:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2974, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '8586a0ac-8d71-46f3-ae0a-75565c281860', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'floating_ip_address': '172.25.3.157', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'port_id': '201bc3ab-e2ab-4e46-9cc3-b13f3373442f', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 3092, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa', 'mac_address': 'fa:16:3e:96:e3:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9545e3-43c2-403d-a699-e38d4f4c2a1b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:45:32Z', 'updated_at': '2021-12-09T21:45:32Z', 'revision_number': 0, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e6e780bc-5481-46c0-b1d4-140a4d417a11', 'name': '', 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:f9:a2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'device_owner': 'network:router_interface', 'standard_attr_id': 2987, 'fixed_ips': [{'subnet_id': '017fde5b-ddc1-4da5-8c6b-2b98296748e5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:45:10Z', 'updated_at': '2021-12-09T21:45:16Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '017fde5b-ddc1-4da5-8c6b-2b98296748e5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:35.100795 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ea7d2873-1441-4dc4-b8f4-c699c46b42dc req-0ead28cb-9f34-46c7-90a7-aa16ad7b86d2 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=201bc3ab-e2ab-4e46-9cc3-b13f3373442f HTTP/1.1" status: 200 len: 1000 time: 0.1991940 Dec 09 21:45:35.122094 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f65112a-340e-444e-910a-30e94076e6be None None] Checking router: 71037eba-17b6-499e-8ba6-3a08aa3db0b5 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:45:35.132527 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f65112a-340e-444e-910a-30e94076e6be None None] Routers {'71037eba-17b6-499e-8ba6-3a08aa3db0b5'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:45:35.133575 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-8f65112a-340e-444e-910a-30e94076e6be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:45:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['71037eba-17b6-499e-8ba6-3a08aa3db0b5'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:35.209592 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea7d2873-1441-4dc4-b8f4-c699c46b42dc req-4edf0eb1-a52f-4db7-abe5-0314eaca9e90 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:35.213044 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ea7d2873-1441-4dc4-b8f4-c699c46b42dc req-4edf0eb1-a52f-4db7-abe5-0314eaca9e90 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=017fde5b-ddc1-4da5-8c6b-2b98296748e5 HTTP/1.1" status: 200 len: 835 time: 0.1021354 Dec 09 21:45:35.249008 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41322) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:35.271874 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-8f65112a-340e-444e-910a-30e94076e6be None None] Set router 71037eba-17b6-499e-8ba6-3a08aa3db0b5 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:45:35.304066 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea7d2873-1441-4dc4-b8f4-c699c46b42dc req-f3bc3cef-6fde-4266-8e52-3225e437ab37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:35.306379 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ea7d2873-1441-4dc4-b8f4-c699c46b42dc req-f3bc3cef-6fde-4266-8e52-3225e437ab37 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=4fbe35af-30ff-45b2-b84a-21fea4abf9aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0753334 Dec 09 21:45:35.475534 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ea7d2873-1441-4dc4-b8f4-c699c46b42dc req-88ed9a17-dba0-4ff0-bc9b-7fcb85d3c623 service neutron] 10.222.0.31 "GET /v2.0/networks/4fbe35af-30ff-45b2-b84a-21fea4abf9aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1581657 Dec 09 21:45:35.478570 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-f315c443-f662-49c4-ad18-f208c28e50b3 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group': {'name': 'default'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:35.479705 n-d-713301-27 neutron-server[103438]: WARNING neutron.api.v2.base [None req-f315c443-f662-49c4-ad18-f208c28e50b3 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Dec 09 21:45:35.480408 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-f315c443-f662-49c4-ad18-f208c28e50b3 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] create failed (client error): There was a conflict when trying to complete your request. Dec 09 21:45:35.482354 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f315c443-f662-49c4-ad18-f208c28e50b3 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 409 len: 330 time: 0.2322304 Dec 09 21:45:35.486773 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41330) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:35.494605 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-d3f5f015-c9f5-4028-81b3-8ca67e271062 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group': {'name': 'tempest-secgroup--1672737040'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:35.563579 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9f90d093-df04-47f3-b5b0-6f7c3818dc70 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:35.568313 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3f5f015-c9f5-4028-81b3-8ca67e271062 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:35.596948 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3f5f015-c9f5-4028-81b3-8ca67e271062 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:35.655767 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ea7d2873-1441-4dc4-b8f4-c699c46b42dc req-094f49d4-dd68-4a48-8824-ac673c04a55e service neutron] 10.222.0.31 "GET /v2.0/networks/4fbe35af-30ff-45b2-b84a-21fea4abf9aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1714840 Dec 09 21:45:35.721445 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-8f65112a-340e-444e-910a-30e94076e6be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'name': 'tempest-TestNetworkAdvancedServerOps-router-446132443', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53'}], 'enable_snat': True}, 'gw_port_id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:11Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2d:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2974, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '8586a0ac-8d71-46f3-ae0a-75565c281860', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'floating_ip_address': '172.25.3.157', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'port_id': '201bc3ab-e2ab-4e46-9cc3-b13f3373442f', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 3092, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa', 'mac_address': 'fa:16:3e:96:e3:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9545e3-43c2-403d-a699-e38d4f4c2a1b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:45:32Z', 'updated_at': '2021-12-09T21:45:32Z', 'revision_number': 0, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e6e780bc-5481-46c0-b1d4-140a4d417a11', 'name': '', 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:f9:a2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'device_owner': 'network:router_interface', 'standard_attr_id': 2987, 'fixed_ips': [{'subnet_id': '017fde5b-ddc1-4da5-8c6b-2b98296748e5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:45:10Z', 'updated_at': '2021-12-09T21:45:16Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '017fde5b-ddc1-4da5-8c6b-2b98296748e5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:35.725233 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41332) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:35.729868 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3f5f015-c9f5-4028-81b3-8ca67e271062 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:35.742273 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3f5f015-c9f5-4028-81b3-8ca67e271062 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:35.778966 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3f5f015-c9f5-4028-81b3-8ca67e271062 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4b1fc7cc-9be9-4cfc-9754-1854aa829efe,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:35.780008 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f65112a-340e-444e-910a-30e94076e6be None None] The sync data for ids ['71037eba-17b6-499e-8ba6-3a08aa3db0b5'] in n-d-713301-27 is: [{'id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'name': 'tempest-TestNetworkAdvancedServerOps-router-446132443', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53'}], 'enable_snat': True}, 'gw_port_id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:11Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2d:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2974, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '8586a0ac-8d71-46f3-ae0a-75565c281860', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'floating_ip_address': '172.25.3.157', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'port_id': '201bc3ab-e2ab-4e46-9cc3-b13f3373442f', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 3092, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa', 'mac_address': 'fa:16:3e:96:e3:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c9545e3-43c2-403d-a699-e38d4f4c2a1b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:45:32Z', 'updated_at': '2021-12-09T21:45:32Z', 'revision_number': 0, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e6e780bc-5481-46c0-b1d4-140a4d417a11', 'name': '', 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:f9:a2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'device_owner': 'network:router_interface', 'standard_attr_id': 2987, 'fixed_ips': [{'subnet_id': '017fde5b-ddc1-4da5-8c6b-2b98296748e5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:45:10Z', 'updated_at': '2021-12-09T21:45:16Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '017fde5b-ddc1-4da5-8c6b-2b98296748e5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:45:35.855974 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3f5f015-c9f5-4028-81b3-8ca67e271062 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:35.861141 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3f5f015-c9f5-4028-81b3-8ca67e271062 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:35.868039 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-eca6b9ed-bc28-4db9-bde0-6f1f0305471f tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/floatingips/8586a0ac-8d71-46f3-ae0a-75565c281860 HTTP/1.1" status: 200 len: 992 time: 0.1412129 Dec 09 21:45:35.888390 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d3f5f015-c9f5-4028-81b3-8ca67e271062 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:35.893194 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41334) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:35.893327 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d3f5f015-c9f5-4028-81b3-8ca67e271062 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.4049549 Dec 09 21:45:35.898725 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-c5fb83af-ef94-4902-b270-6241d4002065 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group_rule': {'security_group_id': '09c31304-4f29-43a4-8619-2d7dd1438512', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:35.910068 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3f5f015-c9f5-4028-81b3-8ca67e271062 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Pushing event updated for resources: {'SecurityGroup': ['ID=09c31304-4f29-43a4-8619-2d7dd1438512,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:35.935665 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c5fb83af-ef94-4902-b270-6241d4002065 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:35.944014 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41336) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:35.950925 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-3735c8f7-aeb7-4c85-abc5-5e1c1da095d2 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Request body: {'subnet': {'network_id': '86b722dc-adb8-4599-bf9e-8a4aaf4ba7f0', 'cidr': '2001:db8:0:ffff::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:ffff::1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:36.009450 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c5fb83af-ef94-4902-b270-6241d4002065 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.015638 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c5fb83af-ef94-4902-b270-6241d4002065 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.036793 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5fb83af-ef94-4902-b270-6241d4002065 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b8110f2d-5bc2-4429-8af0-d4203c067f08,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:36.049744 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c5fb83af-ef94-4902-b270-6241d4002065 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.055076 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c5fb83af-ef94-4902-b270-6241d4002065 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1601639 Dec 09 21:45:36.055880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41338) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:36.063186 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-dd208013-b256-443e-af50-ff5e076561a2 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group_rule': {'security_group_id': '09c31304-4f29-43a4-8619-2d7dd1438512', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'port_range_min': 66, 'port_range_max': 67}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:36.084734 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3735c8f7-aeb7-4c85-abc5-5e1c1da095d2 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Made reservation on behalf of d082983dfcfa477f893f6dc13670fdc5 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:36.088701 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3735c8f7-aeb7-4c85-abc5-5e1c1da095d2 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.090355 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:45:36.121030 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2c43084f-af81-4826-8ce5-df8925e566fc None None] New status for floating IP 8586a0ac-8d71-46f3-ae0a-75565c281860: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:45:36.166360 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dd208013-b256-443e-af50-ff5e076561a2 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.244602 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-dd208013-b256-443e-af50-ff5e076561a2 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] create failed (client error): There was a conflict when trying to complete your request. Dec 09 21:45:36.248795 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-dd208013-b256-443e-af50-ff5e076561a2 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 409 len: 366 time: 0.1888001 Dec 09 21:45:36.249196 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41340) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:36.328981 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-37998f85-2449-4d26-af1f-86e6aa2c8f7b tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.356880 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-37998f85-2449-4d26-af1f-86e6aa2c8f7b tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.360000 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3735c8f7-aeb7-4c85-abc5-5e1c1da095d2 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.409371 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-37998f85-2449-4d26-af1f-86e6aa2c8f7b tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.412808 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-37998f85-2449-4d26-af1f-86e6aa2c8f7b tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.414238 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-37998f85-2449-4d26-af1f-86e6aa2c8f7b tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "DELETE /v2.0/security-groups/09c31304-4f29-43a4-8619-2d7dd1438512 HTTP/1.1" status: 204 len: 168 time: 0.1640196 Dec 09 21:45:36.417339 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41342) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:36.424637 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37998f85-2449-4d26-af1f-86e6aa2c8f7b tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=09c31304-4f29-43a4-8619-2d7dd1438512,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:36.451359 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3735c8f7-aeb7-4c85-abc5-5e1c1da095d2 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event updated for resources: {'Subnet': ['ID=958df35e-02bf-42ce-80e8-a06458132386,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:36.476829 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3735c8f7-aeb7-4c85-abc5-5e1c1da095d2 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Checking segment: {'id': '904c4230-ee6a-43f8-be8a-b7c2d1532fb2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '86b722dc-adb8-4599-bf9e-8a4aaf4ba7f0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:45:36.477400 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3735c8f7-aeb7-4c85-abc5-5e1c1da095d2 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Network hostable DHCP agents. Network: 86b722dc-adb8-4599-bf9e-8a4aaf4ba7f0, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:45:36.495855 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ebaf49fb-cd90-4ea6-9d88-1ca3556a0717 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0773804 Dec 09 21:45:36.499646 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41346) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:36.504830 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ae266bb7-3a88-4ea0-94d1-af96bbf5fddf tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group': {'name': 'tempest-secgroup--197739820'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:36.517702 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3735c8f7-aeb7-4c85-abc5-5e1c1da095d2 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Network 86b722dc-adb8-4599-bf9e-8a4aaf4ba7f0 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:45:36.527978 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-3735c8f7-aeb7-4c85-abc5-5e1c1da095d2 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 86b722dc-adb8-4599-bf9e-8a4aaf4ba7f0) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:36.530662 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae266bb7-3a88-4ea0-94d1-af96bbf5fddf tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.533264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3735c8f7-aeb7-4c85-abc5-5e1c1da095d2 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:36.533919 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3735c8f7-aeb7-4c85-abc5-5e1c1da095d2 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.538983 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a445cc5-bdfd-4ede-94cb-15e4caf7e129 None None] Network 86b722dc-adb8-4599-bf9e-8a4aaf4ba7f0 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:45:36.553569 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3735c8f7-aeb7-4c85-abc5-5e1c1da095d2 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.6079504 Dec 09 21:45:36.557476 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41348) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:36.563266 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-7b2bef23-f6f6-4207-adb3-7b0d226a26f1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-59872111'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:36.587116 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7b2bef23-f6f6-4207-adb3-7b0d226a26f1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Made reservation on behalf of d082983dfcfa477f893f6dc13670fdc5 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:36.592014 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7b2bef23-f6f6-4207-adb3-7b0d226a26f1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.618151 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7b2bef23-f6f6-4207-adb3-7b0d226a26f1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] vlan segment allocate from pool success with {'vlan_id': 101, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:45:36.627823 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7b2bef23-f6f6-4207-adb3-7b0d226a26f1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.628336 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-7b2bef23-f6f6-4207-adb3-7b0d226a26f1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Added segment 1cbf9de2-c8d5-4f8f-8498-d76d485fc406 of type vlan for network 8ee32184-191c-4d61-8a45-fe1df399820b Dec 09 21:45:36.635157 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae266bb7-3a88-4ea0-94d1-af96bbf5fddf tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.641434 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae266bb7-3a88-4ea0-94d1-af96bbf5fddf tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.646875 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.669160 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7b2bef23-f6f6-4207-adb3-7b0d226a26f1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.673442 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae266bb7-3a88-4ea0-94d1-af96bbf5fddf tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e0828c13-b182-40d5-88c7-b22ba44a6d3e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:36.682462 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-86b722dc-adb8-4599-bf9e-8a4aaf4ba7f0', 'network_id': '86b722dc-adb8-4599-bf9e-8a4aaf4ba7f0', 'project_id': 'd082983dfcfa477f893f6dc13670fdc5', 'fixed_ips': [{'subnet_id': '958df35e-02bf-42ce-80e8-a06458132386'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:45:36.683922 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.688939 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae266bb7-3a88-4ea0-94d1-af96bbf5fddf tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.690199 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ae266bb7-3a88-4ea0-94d1-af96bbf5fddf tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.1895330 Dec 09 21:45:36.694682 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41352) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:36.701121 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-b85b3eec-2571-4abe-ba7d-e15986917032 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group_rule': {'security_group_id': 'e0828c13-b182-40d5-88c7-b22ba44a6d3e', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'bad_ethertype'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:36.702035 n-d-713301-27 neutron-server[103438]: WARNING neutron.api.v2.base [None req-b85b3eec-2571-4abe-ba7d-e15986917032 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] An exception happened while processing the request body. The exception message is [Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6'].].: securitygroup.SecurityGroupRuleInvalidEtherType: Security group rule for ethertype 'bad_ethertype' not supported. Allowed values are ['IPv4', 'IPv6']. Dec 09 21:45:36.702541 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-b85b3eec-2571-4abe-ba7d-e15986917032 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:45:36.703521 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b85b3eec-2571-4abe-ba7d-e15986917032 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 396 time: 0.0077395 Dec 09 21:45:36.706480 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41354) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:36.715994 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7b2bef23-f6f6-4207-adb3-7b0d226a26f1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.721434 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b2bef23-f6f6-4207-adb3-7b0d226a26f1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:36.722051 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7b2bef23-f6f6-4207-adb3-7b0d226a26f1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.776207 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7b2bef23-f6f6-4207-adb3-7b0d226a26f1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 787 time: 0.2174878 Dec 09 21:45:36.779473 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41356) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:36.785913 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-56f8910d-e13e-4d99-831b-53b96561581a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Request body: {'subnet': {'network_id': '8ee32184-191c-4d61-8a45-fe1df399820b', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:36.825770 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b2bef23-f6f6-4207-adb3-7b0d226a26f1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event updated for resources: {'Network': ['ID=8ee32184-191c-4d61-8a45-fe1df399820b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:36.838595 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Allocated IP 2001:db8:0:ffff::2 (86b722dc-adb8-4599-bf9e-8a4aaf4ba7f0/958df35e-02bf-42ce-80e8-a06458132386/c7cf7d9f-b73c-46c9-9607-cc7b44849cef) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:45:36.838788 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ccdc65af-256f-4b2e-bfbf-44159f622c80 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.842279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 8ee32184-191c-4d61-8a45-fe1df399820b details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:45:36.863914 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ccdc65af-256f-4b2e-bfbf-44159f622c80 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.871315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41358) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:36.901434 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-56f8910d-e13e-4d99-831b-53b96561581a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Made reservation on behalf of d082983dfcfa477f893f6dc13670fdc5 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:36.905913 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56f8910d-e13e-4d99-831b-53b96561581a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.948882 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-41545802-2c14-4796-83ba-087673fc4a35 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/floatingips/8586a0ac-8d71-46f3-ae0a-75565c281860 HTTP/1.1" status: 200 len: 994 time: 0.0764890 Dec 09 21:45:36.957793 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ccdc65af-256f-4b2e-bfbf-44159f622c80 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.960672 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ccdc65af-256f-4b2e-bfbf-44159f622c80 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:36.964651 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ccdc65af-256f-4b2e-bfbf-44159f622c80 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "DELETE /v2.0/security-groups/e0828c13-b182-40d5-88c7-b22ba44a6d3e HTTP/1.1" status: 204 len: 168 time: 0.2542400 Dec 09 21:45:36.966092 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41360) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:36.985750 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccdc65af-256f-4b2e-bfbf-44159f622c80 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e0828c13-b182-40d5-88c7-b22ba44a6d3e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:37.029155 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-998a9858-a1ce-43d0-9de8-09dd3865b7c5 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0619025 Dec 09 21:45:37.033504 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41362) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:37.039097 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-3f976a45-8acc-4878-9e40-cdf9c2179002 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group': {'name': 'tempest-secgroup--1816902932'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:37.064973 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f976a45-8acc-4878-9e40-cdf9c2179002 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.090559 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.097219 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.136781 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Network 86b722dc-adb8-4599-bf9e-8a4aaf4ba7f0 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:45:37.142209 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f976a45-8acc-4878-9e40-cdf9c2179002 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.144093 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:37.148717 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:45:37.149502 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f976a45-8acc-4878-9e40-cdf9c2179002 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.156537 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Pushing event updated for resources: {'Port': ['ID=c7cf7d9f-b73c-46c9-9607-cc7b44849cef,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:37.181254 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:37.181896 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:37.182423 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:37.182978 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:37.183318 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:37.183687 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:37.184008 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:37.184327 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:37.184645 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:37.184960 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:37.185280 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:37.185592 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:37.185910 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:45:37.188185 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f976a45-8acc-4878-9e40-cdf9c2179002 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.192414 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3f976a45-8acc-4878-9e40-cdf9c2179002 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.1578891 Dec 09 21:45:37.193484 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f976a45-8acc-4878-9e40-cdf9c2179002 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f349036e-af19-4aa5-8663-94fd8f0e3dc9,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:37.195297 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41364) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:37.200712 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ba28a4cc-28e5-425b-8b3c-966846c643b7 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group_rule': {'security_group_id': 'f349036e-af19-4aa5-8663-94fd8f0e3dc9', 'protocol': 'bad_protocol_name', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:37.201206 n-d-713301-27 neutron-server[103437]: WARNING neutron.api.v2.base [None req-ba28a4cc-28e5-425b-8b3c-966846c643b7 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] An exception happened while processing the request body. The exception message is [Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported.].: securitygroup.SecurityGroupRuleInvalidProtocol: Security group rule protocol bad_protocol_name not supported. Only protocol values [None, 'ah', 'dccp', 'egp', 'esp', 'gre', 'hopopt', 'icmp', 'igmp', 'ip', 'ipip', 'ipv6-encap', 'ipv6-frag', 'ipv6-icmp', 'icmpv6', 'ipv6-nonxt', 'ipv6-opts', 'ipv6-route', 'ospf', 'pgm', 'rsvp', 'sctp', 'tcp', 'udp', 'udplite', 'vrrp'] and integer representations [0 to 255] are supported. Dec 09 21:45:37.201703 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-ba28a4cc-28e5-425b-8b3c-966846c643b7 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:45:37.205581 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ba28a4cc-28e5-425b-8b3c-966846c643b7 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 667 time: 0.0061417 Dec 09 21:45:37.205887 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41366) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:37.220114 n-d-713301-27 neutron-server[103437]: DEBUG neutron.objects.ports [None req-56f8910d-e13e-4d99-831b-53b96561581a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103437) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 09 21:45:37.221690 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56f8910d-e13e-4d99-831b-53b96561581a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.233055 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Attempting to bind port c7cf7d9f-b73c-46c9-9607-cc7b44849cef on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:45:37.233430 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Attempting to bind port c7cf7d9f-b73c-46c9-9607-cc7b44849cef by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '904c4230-ee6a-43f8-be8a-b7c2d1532fb2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '86b722dc-adb8-4599-bf9e-8a4aaf4ba7f0'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:45:37.234006 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Attempting to bind port c7cf7d9f-b73c-46c9-9607-cc7b44849cef on network 86b722dc-adb8-4599-bf9e-8a4aaf4ba7f0 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:45:37.239771 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 45, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:45:37.240143 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Checking segment: {'id': '904c4230-ee6a-43f8-be8a-b7c2d1532fb2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '86b722dc-adb8-4599-bf9e-8a4aaf4ba7f0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:45:37.240759 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.241160 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Bound using segment: {'id': '904c4230-ee6a-43f8-be8a-b7c2d1532fb2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '86b722dc-adb8-4599-bf9e-8a4aaf4ba7f0'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:45:37.241636 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Bound port: c7cf7d9f-b73c-46c9-9607-cc7b44849cef, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '904c4230-ee6a-43f8-be8a-b7c2d1532fb2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '86b722dc-adb8-4599-bf9e-8a4aaf4ba7f0'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:45:37.242022 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.259882 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4e9b406b-1922-4b73-995f-18aa02ba48e5 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.282614 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4e9b406b-1922-4b73-995f-18aa02ba48e5 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.290889 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56f8910d-e13e-4d99-831b-53b96561581a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event updated for resources: {'Subnet': ['ID=a09f08f6-5e24-4ccc-9482-c7b6ff0d88ae,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:37.302292 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-56f8910d-e13e-4d99-831b-53b96561581a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Checking segment: {'id': '1cbf9de2-c8d5-4f8f-8498-d76d485fc406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '8ee32184-191c-4d61-8a45-fe1df399820b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:45:37.302517 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56f8910d-e13e-4d99-831b-53b96561581a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Network hostable DHCP agents. Network: 8ee32184-191c-4d61-8a45-fe1df399820b, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:45:37.318855 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] For port c7cf7d9f-b73c-46c9-9607-cc7b44849cef, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:45:37.321676 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56f8910d-e13e-4d99-831b-53b96561581a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Network 8ee32184-191c-4d61-8a45-fe1df399820b is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:45:37.324007 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] For port c7cf7d9f-b73c-46c9-9607-cc7b44849cef, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c7cf7d9f-b73c-46c9-9607-cc7b44849cef,segment=NetworkSegment(904c4230-ee6a-43f8-be8a-b7c2d1532fb2),segment_id=904c4230-ee6a-43f8-be8a-b7c2d1532fb2)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:45:37.328067 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4e9b406b-1922-4b73-995f-18aa02ba48e5 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.329733 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.330761 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4e9b406b-1922-4b73-995f-18aa02ba48e5 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.334958 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-56f8910d-e13e-4d99-831b-53b96561581a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 8ee32184-191c-4d61-8a45-fe1df399820b) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:37.335144 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4e9b406b-1922-4b73-995f-18aa02ba48e5 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "DELETE /v2.0/security-groups/f349036e-af19-4aa5-8663-94fd8f0e3dc9 HTTP/1.1" status: 204 len: 168 time: 0.1254249 Dec 09 21:45:37.335292 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41368) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:37.343526 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e9b406b-1922-4b73-995f-18aa02ba48e5 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f349036e-af19-4aa5-8663-94fd8f0e3dc9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:37.347803 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56f8910d-e13e-4d99-831b-53b96561581a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:37.348644 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56f8910d-e13e-4d99-831b-53b96561581a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.364263 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b9f7ee7-5609-47f4-8c0c-3cc321a12d12 None None] Network 8ee32184-191c-4d61-8a45-fe1df399820b requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:45:37.378264 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-56f8910d-e13e-4d99-831b-53b96561581a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 827 time: 0.5972767 Dec 09 21:45:37.381549 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41370) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:37.387081 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-b95e6b61-493d-416a-9953-f94c9490447a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Request body: {'port': {'network_id': '8ee32184-191c-4d61-8a45-fe1df399820b', 'name': 'tempest-NetworksIpV6TestAttrs-451674851'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:37.400845 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7ce78652-3ac0-4d69-99f5-63f7b562dae3 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0608654 Dec 09 21:45:37.400845 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41372) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:37.405283 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-610e6e77-2b38-4d48-a44b-378b69ab8701 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group': {'name': 'tempest-secgroup--769761497'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:37.433650 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-610e6e77-2b38-4d48-a44b-378b69ab8701 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.472808 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05586d00-000b-44e8-b641-1eab58639da8 None None] Pushing event updated for resources: {'Port': ['ID=c7cf7d9f-b73c-46c9-9607-cc7b44849cef,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:37.526126 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8985f5fe-cbb8-42a6-906f-83a044465dbc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-8ee32184-191c-4d61-8a45-fe1df399820b', 'network_id': '8ee32184-191c-4d61-8a45-fe1df399820b', 'project_id': 'd082983dfcfa477f893f6dc13670fdc5', 'fixed_ips': [{'subnet_id': 'a09f08f6-5e24-4ccc-9482-c7b6ff0d88ae'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:45:37.527101 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8985f5fe-cbb8-42a6-906f-83a044465dbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.536114 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-610e6e77-2b38-4d48-a44b-378b69ab8701 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.542379 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-610e6e77-2b38-4d48-a44b-378b69ab8701 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.584272 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b95e6b61-493d-416a-9953-f94c9490447a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Made reservation on behalf of d082983dfcfa477f893f6dc13670fdc5 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:37.585428 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-610e6e77-2b38-4d48-a44b-378b69ab8701 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Pushing event updated for resources: {'SecurityGroup': ['ID=87801025-bbd6-4302-8ab9-fbb30fb5b31b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:37.587935 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b95e6b61-493d-416a-9953-f94c9490447a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.605874 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-610e6e77-2b38-4d48-a44b-378b69ab8701 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.609662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-b95e6b61-493d-416a-9953-f94c9490447a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] device_id is not set on port f453470a-9612-4ee9-b8eb-2d13bb04d3d7 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:45:37.612842 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-610e6e77-2b38-4d48-a44b-378b69ab8701 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.2109983 Dec 09 21:45:37.613675 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41376) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:37.657264 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-05ea49cf-8b4f-4766-8315-a846508850a3 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group_rule': {'security_group_id': '87801025-bbd6-4302-8ab9-fbb30fb5b31b', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '192.168.1./24'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:37.658568 n-d-713301-27 neutron-server[103437]: WARNING neutron.api.v2.base [None req-05ea49cf-8b4f-4766-8315-a846508850a3 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1./24 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1./24 given as IP prefix. Dec 09 21:45:37.659092 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-05ea49cf-8b4f-4766-8315-a846508850a3 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:45:37.663655 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-05ea49cf-8b4f-4766-8315-a846508850a3 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0462151 Dec 09 21:45:37.664273 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41380) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:37.671225 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-17113d0c-5d06-4893-87f1-916de4da01f9 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group_rule': {'security_group_id': '87801025-bbd6-4302-8ab9-fbb30fb5b31b', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '192.168.1.1/33'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:37.672984 n-d-713301-27 neutron-server[103437]: WARNING neutron.api.v2.base [None req-17113d0c-5d06-4893-87f1-916de4da01f9 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 192.168.1.1/33 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 192.168.1.1/33 given as IP prefix. Dec 09 21:45:37.673682 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-17113d0c-5d06-4893-87f1-916de4da01f9 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:45:37.674680 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-17113d0c-5d06-4893-87f1-916de4da01f9 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 320 time: 0.0094793 Dec 09 21:45:37.679628 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41382) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:37.685271 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-3b871fd8-7022-4ac7-801a-8aa23723793c tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group_rule': {'security_group_id': '87801025-bbd6-4302-8ab9-fbb30fb5b31b', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': 'bad_prefix'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:37.686242 n-d-713301-27 neutron-server[103437]: WARNING neutron.api.v2.base [None req-3b871fd8-7022-4ac7-801a-8aa23723793c tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] An exception happened while processing the request body. The exception message is [Invalid CIDR bad_prefix given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR bad_prefix given as IP prefix. Dec 09 21:45:37.686753 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-3b871fd8-7022-4ac7-801a-8aa23723793c tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:45:37.687725 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3b871fd8-7022-4ac7-801a-8aa23723793c tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0070915 Dec 09 21:45:37.690883 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41384) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:37.695778 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-002b6aa7-0573-4388-bd9f-42c5665668b5 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group_rule': {'security_group_id': '87801025-bbd6-4302-8ab9-fbb30fb5b31b', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '256'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:37.696672 n-d-713301-27 neutron-server[103437]: WARNING neutron.api.v2.base [None req-002b6aa7-0573-4388-bd9f-42c5665668b5 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] An exception happened while processing the request body. The exception message is [Invalid CIDR 256 given as IP prefix.].: neutron_lib.exceptions.InvalidCIDR: Invalid CIDR 256 given as IP prefix. Dec 09 21:45:37.697158 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-002b6aa7-0573-4388-bd9f-42c5665668b5 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:45:37.701182 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-002b6aa7-0573-4388-bd9f-42c5665668b5 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 309 time: 0.0089366 Dec 09 21:45:37.702131 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41386) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:37.778308 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3c1904e3-327b-4fa6-9b1e-4659c104cae7 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.810937 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3c1904e3-327b-4fa6-9b1e-4659c104cae7 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.865019 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3c1904e3-327b-4fa6-9b1e-4659c104cae7 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.867838 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3c1904e3-327b-4fa6-9b1e-4659c104cae7 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:37.869244 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3c1904e3-327b-4fa6-9b1e-4659c104cae7 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "DELETE /v2.0/security-groups/87801025-bbd6-4302-8ab9-fbb30fb5b31b HTTP/1.1" status: 204 len: 168 time: 0.1660686 Dec 09 21:45:37.872016 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41388) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:37.879073 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c1904e3-327b-4fa6-9b1e-4659c104cae7 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=87801025-bbd6-4302-8ab9-fbb30fb5b31b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:37.922618 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-8985f5fe-cbb8-42a6-906f-83a044465dbc None None] Allocated IP 2001:db8::f816:3eff:fe1e:eafc (8ee32184-191c-4d61-8a45-fe1df399820b/a09f08f6-5e24-4ccc-9482-c7b6ff0d88ae/35d856af-8b66-47f3-8317-30530ead5c6c) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:45:37.925848 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-27b3892f-0335-419f-b88f-aa0902893ddb tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0520842 Dec 09 21:45:37.929752 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41390) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:37.934507 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-e5e30ab6-4ffb-4490-9ca7-9a698d3966ec tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group': {'name': 'tempest-secgroup--442122068'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:37.958692 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e5e30ab6-4ffb-4490-9ca7-9a698d3966ec tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.014308 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.033318 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e5e30ab6-4ffb-4490-9ca7-9a698d3966ec tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.037522 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e5e30ab6-4ffb-4490-9ca7-9a698d3966ec tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.066977 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e5e30ab6-4ffb-4490-9ca7-9a698d3966ec tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.068255 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e5e30ab6-4ffb-4490-9ca7-9a698d3966ec tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.1374357 Dec 09 21:45:38.071272 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41392) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:38.072651 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5e30ab6-4ffb-4490-9ca7-9a698d3966ec tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Pushing event updated for resources: {'SecurityGroup': ['ID=00b53f82-0210-436e-b962-5de4ee903746,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:38.075809 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-d9f8e46a-77d8-44c7-b060-c3679c016256 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group_rule': {'security_group_id': '00b53f82-0210-436e-b962-5de4ee903746', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 80, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:38.076298 n-d-713301-27 neutron-server[103438]: WARNING neutron.api.v2.base [None req-d9f8e46a-77d8-44c7-b060-c3679c016256 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Dec 09 21:45:38.076784 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-d9f8e46a-77d8-44c7-b060-c3679c016256 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:45:38.077730 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d9f8e46a-77d8-44c7-b060-c3679c016256 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0054383 Dec 09 21:45:38.080424 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41394) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:38.085408 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-25f63c6b-3bb0-4977-b8e7-5f82b5c4762e tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group_rule': {'security_group_id': '00b53f82-0210-436e-b962-5de4ee903746', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 79, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:38.100751 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8985f5fe-cbb8-42a6-906f-83a044465dbc None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.107561 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8985f5fe-cbb8-42a6-906f-83a044465dbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.122386 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-25f63c6b-3bb0-4977-b8e7-5f82b5c4762e tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:45:38.123805 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-25f63c6b-3bb0-4977-b8e7-5f82b5c4762e tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.0423303 Dec 09 21:45:38.127098 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41396) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:38.132458 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-1690b018-53dd-489a-81d2-804e807a62d7 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group_rule': {'security_group_id': '00b53f82-0210-436e-b962-5de4ee903746', 'protocol': 'tcp', 'port_range_min': 80, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:38.135034 n-d-713301-27 neutron-server[103437]: WARNING neutron.api.v2.base [None req-1690b018-53dd-489a-81d2-804e807a62d7 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] An exception happened while processing the request body. The exception message is [Invalid value for port 65536].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port 65536 Dec 09 21:45:38.136861 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-1690b018-53dd-489a-81d2-804e807a62d7 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:45:38.138102 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1690b018-53dd-489a-81d2-804e807a62d7 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 319 time: 0.0099318 Dec 09 21:45:38.141204 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41398) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:38.145757 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-01bf84de-ff22-473a-a721-268fd438c6c9 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group_rule': {'security_group_id': '00b53f82-0210-436e-b962-5de4ee903746', 'protocol': 'tcp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:38.162040 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8985f5fe-cbb8-42a6-906f-83a044465dbc None None] Pushing event updated for resources: {'Port': ['ID=35d856af-8b66-47f3-8317-30530ead5c6c,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:38.167117 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8985f5fe-cbb8-42a6-906f-83a044465dbc None None] Network 8ee32184-191c-4d61-8a45-fe1df399820b is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:45:38.169508 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-8985f5fe-cbb8-42a6-906f-83a044465dbc None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:38.172568 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8985f5fe-cbb8-42a6-906f-83a044465dbc None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:45:38.174060 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-b95e6b61-493d-416a-9953-f94c9490447a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Allocated IP 2001:db8::f816:3eff:fe4b:f90a (8ee32184-191c-4d61-8a45-fe1df399820b/a09f08f6-5e24-4ccc-9482-c7b6ff0d88ae/f453470a-9612-4ee9-b8eb-2d13bb04d3d7) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:45:38.198537 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-01bf84de-ff22-473a-a721-268fd438c6c9 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:45:38.202864 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41400) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:38.203639 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-01bf84de-ff22-473a-a721-268fd438c6c9 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 354 time: 0.0610788 Dec 09 21:45:38.211494 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-0988fbcb-d526-4bbb-a009-d2fafa511e42 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group_rule': {'security_group_id': '00b53f82-0210-436e-b962-5de4ee903746', 'protocol': 'tcp', 'port_range_min': -16, 'port_range_max': 65536, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:38.212282 n-d-713301-27 neutron-server[103438]: WARNING neutron.api.v2.base [None req-0988fbcb-d526-4bbb-a009-d2fafa511e42 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] An exception happened while processing the request body. The exception message is [Invalid value for port -16].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -16 Dec 09 21:45:38.212936 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-0988fbcb-d526-4bbb-a009-d2fafa511e42 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:45:38.214109 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0988fbcb-d526-4bbb-a009-d2fafa511e42 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 317 time: 0.0095210 Dec 09 21:45:38.218381 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41402) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:38.225213 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-70829032-7b01-4912-9db9-d8b20a2fcbad tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group_rule': {'security_group_id': '00b53f82-0210-436e-b962-5de4ee903746', 'protocol': 'icmp', 'port_range_min': 1, 'port_range_max': 256, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:38.240617 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-8985f5fe-cbb8-42a6-906f-83a044465dbc None None] Attempting to bind port 35d856af-8b66-47f3-8317-30530ead5c6c on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:45:38.241304 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-8985f5fe-cbb8-42a6-906f-83a044465dbc None None] Attempting to bind port 35d856af-8b66-47f3-8317-30530ead5c6c by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '1cbf9de2-c8d5-4f8f-8498-d76d485fc406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '8ee32184-191c-4d61-8a45-fe1df399820b'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:45:38.241920 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8985f5fe-cbb8-42a6-906f-83a044465dbc None None] Attempting to bind port 35d856af-8b66-47f3-8317-30530ead5c6c on network 8ee32184-191c-4d61-8a45-fe1df399820b {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:45:38.249072 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8985f5fe-cbb8-42a6-906f-83a044465dbc None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 45, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:45:38.250088 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8985f5fe-cbb8-42a6-906f-83a044465dbc None None] Checking segment: {'id': '1cbf9de2-c8d5-4f8f-8498-d76d485fc406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '8ee32184-191c-4d61-8a45-fe1df399820b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:45:38.250715 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8985f5fe-cbb8-42a6-906f-83a044465dbc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.251299 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8985f5fe-cbb8-42a6-906f-83a044465dbc None None] Bound using segment: {'id': '1cbf9de2-c8d5-4f8f-8498-d76d485fc406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '8ee32184-191c-4d61-8a45-fe1df399820b'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:45:38.251869 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-8985f5fe-cbb8-42a6-906f-83a044465dbc None None] Bound port: 35d856af-8b66-47f3-8317-30530ead5c6c, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1cbf9de2-c8d5-4f8f-8498-d76d485fc406', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '8ee32184-191c-4d61-8a45-fe1df399820b'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:45:38.252289 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8985f5fe-cbb8-42a6-906f-83a044465dbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.258653 n-d-713301-27 neutron-server[103437]: INFO neutron.db.securitygroups_db [None req-70829032-7b01-4912-9db9-d8b20a2fcbad tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Project 18256bae2c58443b8d98f4578c58e9c4 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 21:45:38.279968 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-70829032-7b01-4912-9db9-d8b20a2fcbad tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:45:38.281667 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-70829032-7b01-4912-9db9-d8b20a2fcbad tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.0622106 Dec 09 21:45:38.284848 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41404) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:38.289848 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-3374727b-92ae-439e-8eea-3a4ca9f497d3 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group_rule': {'security_group_id': '00b53f82-0210-436e-b962-5de4ee903746', 'protocol': 'icmp', 'port_range_min': -1, 'port_range_max': 25, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:38.290383 n-d-713301-27 neutron-server[103437]: WARNING neutron.api.v2.base [None req-3374727b-92ae-439e-8eea-3a4ca9f497d3 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] An exception happened while processing the request body. The exception message is [Invalid value for port -1].: securitygroup.SecurityGroupInvalidPortValue: Invalid value for port -1 Dec 09 21:45:38.291009 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-3374727b-92ae-439e-8eea-3a4ca9f497d3 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:45:38.294755 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3374727b-92ae-439e-8eea-3a4ca9f497d3 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 316 time: 0.0063522 Dec 09 21:45:38.294926 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41406) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:38.299655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-95728a47-5c02-4ae5-8ef8-5769bfbb778f tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group_rule': {'security_group_id': '00b53f82-0210-436e-b962-5de4ee903746', 'protocol': 'icmp', 'port_range_min': None, 'port_range_max': 6, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:38.331771 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-8985f5fe-cbb8-42a6-906f-83a044465dbc None None] For port 35d856af-8b66-47f3-8317-30530ead5c6c, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:45:38.335358 n-d-713301-27 neutron-server[103437]: INFO neutron.db.securitygroups_db [None req-95728a47-5c02-4ae5-8ef8-5769bfbb778f tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Project 18256bae2c58443b8d98f4578c58e9c4 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 21:45:38.337544 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-8985f5fe-cbb8-42a6-906f-83a044465dbc None None] For port 35d856af-8b66-47f3-8317-30530ead5c6c, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=35d856af-8b66-47f3-8317-30530ead5c6c,segment=NetworkSegment(1cbf9de2-c8d5-4f8f-8498-d76d485fc406),segment_id=1cbf9de2-c8d5-4f8f-8498-d76d485fc406)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:45:38.345789 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8985f5fe-cbb8-42a6-906f-83a044465dbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.361796 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-95728a47-5c02-4ae5-8ef8-5769bfbb778f tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:45:38.366747 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-95728a47-5c02-4ae5-8ef8-5769bfbb778f tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 373 time: 0.0681043 Dec 09 21:45:38.366973 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41408) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:38.372667 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b27dfd8a-9c6b-4341-8a98-969b051574c3 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group_rule': {'security_group_id': '00b53f82-0210-436e-b962-5de4ee903746', 'protocol': 'icmp', 'port_range_min': 300, 'port_range_max': 1, 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:38.384178 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b95e6b61-493d-416a-9953-f94c9490447a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.401866 n-d-713301-27 neutron-server[103437]: INFO neutron.db.securitygroups_db [None req-b27dfd8a-9c6b-4341-8a98-969b051574c3 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Project 18256bae2c58443b8d98f4578c58e9c4 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 21:45:38.422827 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8985f5fe-cbb8-42a6-906f-83a044465dbc None None] Pushing event updated for resources: {'Port': ['ID=35d856af-8b66-47f3-8317-30530ead5c6c,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:38.427249 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-b27dfd8a-9c6b-4341-8a98-969b051574c3 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:45:38.429385 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b27dfd8a-9c6b-4341-8a98-969b051574c3 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 361 time: 0.0607600 Dec 09 21:45:38.433277 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41410) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:38.453311 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b95e6b61-493d-416a-9953-f94c9490447a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.508959 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1f12fe8a-ba7b-4aa4-b7f9-cd0c67be0d3d tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.511229 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b95e6b61-493d-416a-9953-f94c9490447a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Network 8ee32184-191c-4d61-8a45-fe1df399820b is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:45:38.514761 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-b95e6b61-493d-416a-9953-f94c9490447a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:38.522220 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b95e6b61-493d-416a-9953-f94c9490447a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:45:38.528366 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b95e6b61-493d-416a-9953-f94c9490447a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:38.529008 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b95e6b61-493d-416a-9953-f94c9490447a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.536690 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b95e6b61-493d-416a-9953-f94c9490447a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event updated for resources: {'Port': ['ID=f453470a-9612-4ee9-b8eb-2d13bb04d3d7,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:38.543670 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1f12fe8a-ba7b-4aa4-b7f9-cd0c67be0d3d tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.555366 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b95e6b61-493d-416a-9953-f94c9490447a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 950 time: 1.1725297 Dec 09 21:45:38.558622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41412) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:38.596661 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1f12fe8a-ba7b-4aa4-b7f9-cd0c67be0d3d tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.599695 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1f12fe8a-ba7b-4aa4-b7f9-cd0c67be0d3d tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.603784 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1f12fe8a-ba7b-4aa4-b7f9-cd0c67be0d3d tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "DELETE /v2.0/security-groups/00b53f82-0210-436e-b962-5de4ee903746 HTTP/1.1" status: 204 len: 168 time: 0.1694145 Dec 09 21:45:38.609050 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41416) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:38.632419 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f12fe8a-ba7b-4aa4-b7f9-cd0c67be0d3d tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=00b53f82-0210-436e-b962-5de4ee903746,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:38.697019 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cc289465-8333-4f1d-b4ae-5b1532b2a113 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0816357 Dec 09 21:45:38.697606 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41418) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:38.702789 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-e7272b7b-3bac-4df9-b414-74ba156a06ff tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Deleting subnet a09f08f6-5e24-4ccc-9482-c7b6ff0d88ae {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:45:38.708131 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e7272b7b-3bac-4df9-b414-74ba156a06ff tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.708750 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-514b2486-bded-4e3b-ba28-a95739989206 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group': {'name': 'tempest-secgroup--220647180'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:38.729325 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-535b4353-e9f2-43b8-bb1c-19534f2996ff None None] Network 86b722dc-adb8-4599-bf9e-8a4aaf4ba7f0 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:45:38.768034 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-514b2486-bded-4e3b-ba28-a95739989206 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.772456 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c7cf7d9f-b73c-46c9-9607-cc7b44849cef up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:45:38.782964 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e7272b7b-3bac-4df9-b414-74ba156a06ff tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.871639 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-514b2486-bded-4e3b-ba28-a95739989206 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.876709 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-514b2486-bded-4e3b-ba28-a95739989206 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.916934 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-514b2486-bded-4e3b-ba28-a95739989206 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Pushing event updated for resources: {'SecurityGroup': ['ID=889d0057-4cfa-4907-8c16-bc8bb2b5d6ec,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:38.928396 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-bf3af6e8-1a8e-4a71-aaeb-722ea49b202a None None] Provisioning complete for port c7cf7d9f-b73c-46c9-9607-cc7b44849cef triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:38.928834 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bf3af6e8-1a8e-4a71-aaeb-722ea49b202a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.932883 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-514b2486-bded-4e3b-ba28-a95739989206 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.937847 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-514b2486-bded-4e3b-ba28-a95739989206 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.2389929 Dec 09 21:45:38.938055 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41422) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:38.942776 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-1dbb3e94-9b2f-4c5f-b9bb-ad360acbbf49 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group_rule': {'security_group_id': '889d0057-4cfa-4907-8c16-bc8bb2b5d6ec', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_group_id': 'bad_group_id'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:38.972127 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e7272b7b-3bac-4df9-b414-74ba156a06ff tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:38.987579 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port c7cf7d9f-b73c-46c9-9607-cc7b44849cef triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:38.987860 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:39.038289 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-1dbb3e94-9b2f-4c5f-b9bb-ad360acbbf49 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] create failed (client error): The resource could not be found. Dec 09 21:45:39.039426 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1dbb3e94-9b2f-4c5f-b9bb-ad360acbbf49 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 323 time: 0.1005878 Dec 09 21:45:39.042679 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41424) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:39.052070 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-0c6d29f2-b1e8-4f3e-9d5a-60efe71056bd tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group_rule': {'security_group_id': '889d0057-4cfa-4907-8c16-bc8bb2b5d6ec', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_group_id': 'c64c057e-0f18-449c-a971-f09d023e545e'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:39.053328 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e7272b7b-3bac-4df9-b414-74ba156a06ff tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:39.071973 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bf3af6e8-1a8e-4a71-aaeb-722ea49b202a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:39.097731 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7272b7b-3bac-4df9-b414-74ba156a06ff tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event deleted for resources: {'Subnet': ['ID=a09f08f6-5e24-4ccc-9482-c7b6ff0d88ae,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:39.100187 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e7272b7b-3bac-4df9-b414-74ba156a06ff tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:39.104256 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e7272b7b-3bac-4df9-b414-74ba156a06ff tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "DELETE /v2.0/subnets/a09f08f6-5e24-4ccc-9482-c7b6ff0d88ae HTTP/1.1" status: 204 len: 168 time: 0.5294106 Dec 09 21:45:39.106278 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41426) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:39.146852 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-0c6d29f2-b1e8-4f3e-9d5a-60efe71056bd tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] create failed (client error): The resource could not be found. Dec 09 21:45:39.150880 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0c6d29f2-b1e8-4f3e-9d5a-60efe71056bd tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.1041298 Dec 09 21:45:39.151278 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-bf3af6e8-1a8e-4a71-aaeb-722ea49b202a None None] For port c7cf7d9f-b73c-46c9-9607-cc7b44849cef, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c7cf7d9f-b73c-46c9-9607-cc7b44849cef,segment=NetworkSegment(904c4230-ee6a-43f8-be8a-b7c2d1532fb2),segment_id=904c4230-ee6a-43f8-be8a-b7c2d1532fb2)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:39.151278 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:39.151602 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41428) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:39.160964 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bf3af6e8-1a8e-4a71-aaeb-722ea49b202a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:39.181706 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03545442-eafb-4748-9279-58e38f039d90 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:39.183253 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03545442-eafb-4748-9279-58e38f039d90 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:39.184853 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-03545442-eafb-4748-9279-58e38f039d90 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1478 time: 0.0772512 Dec 09 21:45:39.188475 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41430) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:39.259933 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf3af6e8-1a8e-4a71-aaeb-722ea49b202a None None] Pushing event updated for resources: {'Port': ['ID=c7cf7d9f-b73c-46c9-9607-cc7b44849cef,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:39.271193 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:45:39.271598 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:45:39.285260 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-172a5912-21f6-4ac0-ae00-9ad258ff61ae None None] Provisioning complete for port c7cf7d9f-b73c-46c9-9607-cc7b44849cef triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:39.285636 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-172a5912-21f6-4ac0-ae00-9ad258ff61ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:39.300560 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-905cf07a-bb2a-405a-94f5-b4e9d763d42a tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:39.325282 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-85ac75b5-4279-47fd-a99e-fd2da71b7261 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:39.339830 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-905cf07a-bb2a-405a-94f5-b4e9d763d42a tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:39.349417 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-85ac75b5-4279-47fd-a99e-fd2da71b7261 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] DELETE failed (client error): There was a conflict when trying to complete your request. Dec 09 21:45:39.349927 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-85ac75b5-4279-47fd-a99e-fd2da71b7261 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:45:39.353491 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-85ac75b5-4279-47fd-a99e-fd2da71b7261 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "DELETE /v2.0/networks/8ee32184-191c-4d61-8a45-fe1df399820b HTTP/1.1" status: 409 len: 405 time: 0.1640332 Dec 09 21:45:39.357867 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41432) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:39.362701 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2843b14a-6775-49c5-93e1-d3c7014a705a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-1792286769'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:39.400356 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2843b14a-6775-49c5-93e1-d3c7014a705a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Made reservation on behalf of d082983dfcfa477f893f6dc13670fdc5 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:39.405993 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2843b14a-6775-49c5-93e1-d3c7014a705a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:39.440066 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-905cf07a-bb2a-405a-94f5-b4e9d763d42a tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:39.442818 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-905cf07a-bb2a-405a-94f5-b4e9d763d42a tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:39.444058 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-905cf07a-bb2a-405a-94f5-b4e9d763d42a tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "DELETE /v2.0/security-groups/889d0057-4cfa-4907-8c16-bc8bb2b5d6ec HTTP/1.1" status: 204 len: 168 time: 0.2915850 Dec 09 21:45:39.446862 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41434) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:39.450562 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2843b14a-6775-49c5-93e1-d3c7014a705a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] vlan segment allocate from pool success with {'vlan_id': 113, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:45:39.464486 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-905cf07a-bb2a-405a-94f5-b4e9d763d42a tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=889d0057-4cfa-4907-8c16-bc8bb2b5d6ec,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:39.470739 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2843b14a-6775-49c5-93e1-d3c7014a705a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:39.471024 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-2843b14a-6775-49c5-93e1-d3c7014a705a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Added segment c427fdc2-fea7-4eae-b97f-26210fbea2f1 of type vlan for network 4dc01507-bbc2-4a6a-a304-6a037829f30d Dec 09 21:45:39.495113 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c0bde2aa-ff9b-4dfb-98e8-38e5aef28cf5 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0468962 Dec 09 21:45:39.498954 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41436) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:39.504002 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-87c039b1-ba11-46f6-809a-c6c32d847bce tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group_rule': {'security_group_id': '0127f2ed-2da0-4735-9afd-96cc100ed493', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:39.528320 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2843b14a-6775-49c5-93e1-d3c7014a705a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:39.550970 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-87c039b1-ba11-46f6-809a-c6c32d847bce tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] create failed (client error): The resource could not be found. Dec 09 21:45:39.552383 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-87c039b1-ba11-46f6-809a-c6c32d847bce tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 404 len: 347 time: 0.0520375 Dec 09 21:45:39.556092 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41438) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:39.560566 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-222cb0e8-798b-4312-97bc-27c0c4c98a2c tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group': {'name': 'tempest-secgroup--1270897195'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:39.568917 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2843b14a-6775-49c5-93e1-d3c7014a705a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:39.575376 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2843b14a-6775-49c5-93e1-d3c7014a705a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:39.575711 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2843b14a-6775-49c5-93e1-d3c7014a705a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:39.586803 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-222cb0e8-798b-4312-97bc-27c0c4c98a2c tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:39.638120 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2843b14a-6775-49c5-93e1-d3c7014a705a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 0.2796307 Dec 09 21:45:39.642577 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41440) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:39.655928 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-cabef7d1-c059-454a-9e5e-0f5adc80a3dc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Request body: {'subnet': {'network_id': '4dc01507-bbc2-4a6a-a304-6a037829f30d', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:39.659426 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:39.717596 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9fefd376-56f9-4a2b-911d-54dce3ccf3e4 None None] Network 8ee32184-191c-4d61-8a45-fe1df399820b requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:45:39.733714 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2843b14a-6775-49c5-93e1-d3c7014a705a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event updated for resources: {'Network': ['ID=4dc01507-bbc2-4a6a-a304-6a037829f30d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:39.745461 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-222cb0e8-798b-4312-97bc-27c0c4c98a2c tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:39.762501 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 4dc01507-bbc2-4a6a-a304-6a037829f30d details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:45:39.762981 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-222cb0e8-798b-4312-97bc-27c0c4c98a2c tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:39.802540 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cabef7d1-c059-454a-9e5e-0f5adc80a3dc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Made reservation on behalf of d082983dfcfa477f893f6dc13670fdc5 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:39.806158 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cabef7d1-c059-454a-9e5e-0f5adc80a3dc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:39.838651 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-222cb0e8-798b-4312-97bc-27c0c4c98a2c tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Pushing event updated for resources: {'SecurityGroup': ['ID=abe631bf-d135-4231-8802-da12997d21aa,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:39.859557 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-222cb0e8-798b-4312-97bc-27c0c4c98a2c tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:39.865909 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-222cb0e8-798b-4312-97bc-27c0c4c98a2c tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3037803 Dec 09 21:45:39.866714 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41446) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:39.872113 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-fe3af896-b7f6-4fbd-b920-2d2e9b74729e tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group': {'name': 'tempest-secgroup--998490786'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:39.900586 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fe3af896-b7f6-4fbd-b920-2d2e9b74729e tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:39.999201 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fe3af896-b7f6-4fbd-b920-2d2e9b74729e tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:40.006682 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fe3af896-b7f6-4fbd-b920-2d2e9b74729e tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:40.055583 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fe3af896-b7f6-4fbd-b920-2d2e9b74729e tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:40.060185 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fe3af896-b7f6-4fbd-b920-2d2e9b74729e tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.1889956 Dec 09 21:45:40.060388 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-452e6aa1-4a04-450b-b969-2ae733ef077e None None] Provisioning complete for port 35d856af-8b66-47f3-8317-30530ead5c6c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:40.060388 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-452e6aa1-4a04-450b-b969-2ae733ef077e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:40.063960 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41448) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:40.071214 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-3029237f-404d-45ba-9504-afcb77153471 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group_rule': {'security_group_id': 'abe631bf-d135-4231-8802-da12997d21aa', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '2001:db8::/48', 'remote_group_id': '1928348e-28b1-4403-9ce8-01e22ac8f75b'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:40.076708 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe3af896-b7f6-4fbd-b920-2d2e9b74729e tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1928348e-28b1-4403-9ce8-01e22ac8f75b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:40.129074 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-3029237f-404d-45ba-9504-afcb77153471 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:45:40.132926 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3029237f-404d-45ba-9504-afcb77153471 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 387 time: 0.0646269 Dec 09 21:45:40.133236 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41450) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:40.186711 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-452e6aa1-4a04-450b-b969-2ae733ef077e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:40.199578 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d80f49f-3a72-4ff5-9d7b-89a1d8203654 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:40.226657 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d80f49f-3a72-4ff5-9d7b-89a1d8203654 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:40.227708 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3dc94434-2927-4d93-b291-19560b11e7c1 None None] DHCP port deletion for 8ee32184-191c-4d61-8a45-fe1df399820b request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:45:40.243285 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-452e6aa1-4a04-450b-b969-2ae733ef077e None None] For port 35d856af-8b66-47f3-8317-30530ead5c6c, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=35d856af-8b66-47f3-8317-30530ead5c6c,segment=NetworkSegment(1cbf9de2-c8d5-4f8f-8498-d76d485fc406),segment_id=1cbf9de2-c8d5-4f8f-8498-d76d485fc406)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:40.252427 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-452e6aa1-4a04-450b-b969-2ae733ef077e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:40.280113 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d80f49f-3a72-4ff5-9d7b-89a1d8203654 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:40.283455 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d80f49f-3a72-4ff5-9d7b-89a1d8203654 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:40.287681 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2d80f49f-3a72-4ff5-9d7b-89a1d8203654 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "DELETE /v2.0/security-groups/1928348e-28b1-4403-9ce8-01e22ac8f75b HTTP/1.1" status: 204 len: 168 time: 0.1508682 Dec 09 21:45:40.289097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41452) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:40.311402 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d80f49f-3a72-4ff5-9d7b-89a1d8203654 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1928348e-28b1-4403-9ce8-01e22ac8f75b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:40.338048 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-452e6aa1-4a04-450b-b969-2ae733ef077e None None] Pushing event updated for resources: {'Port': ['ID=35d856af-8b66-47f3-8317-30530ead5c6c,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:40.364562 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-3dc94434-2927-4d93-b291-19560b11e7c1 None None] Deleting port 35d856af-8b66-47f3-8317-30530ead5c6c {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:45:40.364932 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3dc94434-2927-4d93-b291-19560b11e7c1 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:40.389133 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1a77a394-a47b-40a0-a72c-892eaeb2b5b7 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4545 time: 0.0953598 Dec 09 21:45:40.389448 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41454) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:40.432736 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-3dc94434-2927-4d93-b291-19560b11e7c1 None None] For port 35d856af-8b66-47f3-8317-30530ead5c6c, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=35d856af-8b66-47f3-8317-30530ead5c6c,segment=NetworkSegment(1cbf9de2-c8d5-4f8f-8498-d76d485fc406),segment_id=1cbf9de2-c8d5-4f8f-8498-d76d485fc406)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:40.433138 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3dc94434-2927-4d93-b291-19560b11e7c1 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:40.447498 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-3dc94434-2927-4d93-b291-19560b11e7c1 None None] Calling delete_port for 35d856af-8b66-47f3-8317-30530ead5c6c owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:45:40.501725 n-d-713301-27 neutron-server[103438]: DEBUG neutron.objects.ports [None req-cabef7d1-c059-454a-9e5e-0f5adc80a3dc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103438) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 09 21:45:40.503415 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cabef7d1-c059-454a-9e5e-0f5adc80a3dc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:40.539384 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3dc94434-2927-4d93-b291-19560b11e7c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:40.573423 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dc94434-2927-4d93-b291-19560b11e7c1 None None] Pushing event deleted for resources: {'Port': ['ID=35d856af-8b66-47f3-8317-30530ead5c6c,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:40.575468 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3dc94434-2927-4d93-b291-19560b11e7c1 None None] No DVR routers for this DVR port 35d856af-8b66-47f3-8317-30530ead5c6c on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:45:40.590075 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cabef7d1-c059-454a-9e5e-0f5adc80a3dc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event updated for resources: {'Subnet': ['ID=309167aa-739a-455e-a791-96b75e8ab77b,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:40.593810 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cabef7d1-c059-454a-9e5e-0f5adc80a3dc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Checking segment: {'id': 'c427fdc2-fea7-4eae-b97f-26210fbea2f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '4dc01507-bbc2-4a6a-a304-6a037829f30d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:45:40.594181 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cabef7d1-c059-454a-9e5e-0f5adc80a3dc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Network hostable DHCP agents. Network: 4dc01507-bbc2-4a6a-a304-6a037829f30d, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:45:40.625989 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cabef7d1-c059-454a-9e5e-0f5adc80a3dc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Network 4dc01507-bbc2-4a6a-a304-6a037829f30d is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:45:40.640698 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-cabef7d1-c059-454a-9e5e-0f5adc80a3dc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 4dc01507-bbc2-4a6a-a304-6a037829f30d) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:40.645511 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cabef7d1-c059-454a-9e5e-0f5adc80a3dc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:40.646328 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cabef7d1-c059-454a-9e5e-0f5adc80a3dc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:40.653394 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72c5bbff-d123-462f-9c7f-344588e73f6c None None] Network 4dc01507-bbc2-4a6a-a304-6a037829f30d requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:45:40.667739 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cabef7d1-c059-454a-9e5e-0f5adc80a3dc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.0180953 Dec 09 21:45:40.668525 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41456) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:40.671822 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c7cf7d9f-b73c-46c9-9607-cc7b44849cef up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:45:40.674531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a594429d-cb2b-4166-8ab4-3d8af90e5f99 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Request body: {'port': {'network_id': '4dc01507-bbc2-4a6a-a304-6a037829f30d', 'name': 'tempest-NetworksIpV6TestAttrs-105028279'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:40.748864 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-823103eb-a3af-4c38-a4ab-87af123eecfc tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:40.775278 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port c7cf7d9f-b73c-46c9-9607-cc7b44849cef triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:40.775869 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:40.778477 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-823103eb-a3af-4c38-a4ab-87af123eecfc tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:40.842314 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-718b4584-7225-4220-9217-5e2da3dab27e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-4dc01507-bbc2-4a6a-a304-6a037829f30d', 'network_id': '4dc01507-bbc2-4a6a-a304-6a037829f30d', 'project_id': 'd082983dfcfa477f893f6dc13670fdc5', 'fixed_ips': [{'subnet_id': '309167aa-739a-455e-a791-96b75e8ab77b'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:45:40.843188 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-718b4584-7225-4220-9217-5e2da3dab27e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:40.843370 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-823103eb-a3af-4c38-a4ab-87af123eecfc tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:40.849202 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-823103eb-a3af-4c38-a4ab-87af123eecfc tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:40.850943 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-823103eb-a3af-4c38-a4ab-87af123eecfc tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "DELETE /v2.0/security-groups/abe631bf-d135-4231-8802-da12997d21aa HTTP/1.1" status: 204 len: 168 time: 0.4596059 Dec 09 21:45:40.851945 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a594429d-cb2b-4166-8ab4-3d8af90e5f99 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Made reservation on behalf of d082983dfcfa477f893f6dc13670fdc5 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:40.854782 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41462) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:40.869572 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a594429d-cb2b-4166-8ab4-3d8af90e5f99 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:40.874959 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-823103eb-a3af-4c38-a4ab-87af123eecfc tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=abe631bf-d135-4231-8802-da12997d21aa,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:40.895863 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-a594429d-cb2b-4166-8ab4-3d8af90e5f99 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] device_id is not set on port 9ef68f8a-a9ba-47e3-a864-1228c3872594 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:45:40.910786 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d68af018-6ff2-44d1-8065-64f491f18f83 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0536239 Dec 09 21:45:40.915077 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41466) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:40.919662 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-c320e7e6-5040-4b4c-87a7-ef73d1ae3502 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group': {'name': 'tempest-secgroup--977392948'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:40.949198 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c320e7e6-5040-4b4c-87a7-ef73d1ae3502 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.063620 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c320e7e6-5040-4b4c-87a7-ef73d1ae3502 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.069012 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c320e7e6-5040-4b4c-87a7-ef73d1ae3502 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.078441 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-718b4584-7225-4220-9217-5e2da3dab27e None None] Allocated IP 2001:db8::f816:3eff:fe7b:748c (4dc01507-bbc2-4a6a-a304-6a037829f30d/309167aa-739a-455e-a791-96b75e8ab77b/bbeccba6-5340-4360-b19b-34872225b54b) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:45:41.102511 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c320e7e6-5040-4b4c-87a7-ef73d1ae3502 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.103940 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c320e7e6-5040-4b4c-87a7-ef73d1ae3502 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.1878715 Dec 09 21:45:41.105899 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c320e7e6-5040-4b4c-87a7-ef73d1ae3502 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7ee0e425-793a-4b28-82db-4cdad71d867c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:41.107112 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41476) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:41.111946 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-f14dbce6-f79c-4dc1-ab32-59d470b93075 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group_rule': {'security_group_id': '7ee0e425-793a-4b28-82db-4cdad71d867c', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6', 'remote_ip_prefix': '172.20.0.0/16'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:41.151759 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-f14dbce6-f79c-4dc1-ab32-59d470b93075 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:45:41.155426 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f14dbce6-f79c-4dc1-ab32-59d470b93075 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 351 time: 0.0447781 Dec 09 21:45:41.155673 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41480) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:41.160497 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-ea14e6e4-279d-4cac-bbd0-af7345c67d01 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group_rule': {'security_group_id': '7ee0e425-793a-4b28-82db-4cdad71d867c', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv4', 'remote_ip_prefix': '2001:db8::/48'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:41.202430 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-ea14e6e4-279d-4cac-bbd0-af7345c67d01 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] create failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:45:41.207030 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ea14e6e4-279d-4cac-bbd0-af7345c67d01 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 400 len: 351 time: 0.0499938 Dec 09 21:45:41.207629 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41482) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:41.268053 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-718b4584-7225-4220-9217-5e2da3dab27e None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.277793 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-718b4584-7225-4220-9217-5e2da3dab27e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.283904 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1dd7df38-8031-42a6-9691-349460912f0c tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.308926 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1dd7df38-8031-42a6-9691-349460912f0c tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.327072 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-718b4584-7225-4220-9217-5e2da3dab27e None None] Network 4dc01507-bbc2-4a6a-a304-6a037829f30d is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:45:41.331977 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-718b4584-7225-4220-9217-5e2da3dab27e None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:41.336800 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-718b4584-7225-4220-9217-5e2da3dab27e None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:45:41.340245 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-718b4584-7225-4220-9217-5e2da3dab27e None None] Pushing event updated for resources: {'Port': ['ID=bbeccba6-5340-4360-b19b-34872225b54b,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:41.354221 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-a594429d-cb2b-4166-8ab4-3d8af90e5f99 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Allocated IP 2001:db8::f816:3eff:feb3:c8b4 (4dc01507-bbc2-4a6a-a304-6a037829f30d/309167aa-739a-455e-a791-96b75e8ab77b/9ef68f8a-a9ba-47e3-a864-1228c3872594) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:45:41.368830 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1dd7df38-8031-42a6-9691-349460912f0c tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.371456 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1dd7df38-8031-42a6-9691-349460912f0c tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.373152 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1dd7df38-8031-42a6-9691-349460912f0c tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "DELETE /v2.0/security-groups/7ee0e425-793a-4b28-82db-4cdad71d867c HTTP/1.1" status: 204 len: 168 time: 0.1642830 Dec 09 21:45:41.378887 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41486) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:41.384565 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dd7df38-8031-42a6-9691-349460912f0c tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7ee0e425-793a-4b28-82db-4cdad71d867c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:41.416044 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-718b4584-7225-4220-9217-5e2da3dab27e None None] Attempting to bind port bbeccba6-5340-4360-b19b-34872225b54b on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:45:41.416420 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-718b4584-7225-4220-9217-5e2da3dab27e None None] Attempting to bind port bbeccba6-5340-4360-b19b-34872225b54b by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'c427fdc2-fea7-4eae-b97f-26210fbea2f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '4dc01507-bbc2-4a6a-a304-6a037829f30d'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:45:41.416793 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-718b4584-7225-4220-9217-5e2da3dab27e None None] Attempting to bind port bbeccba6-5340-4360-b19b-34872225b54b on network 4dc01507-bbc2-4a6a-a304-6a037829f30d {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:45:41.422085 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-718b4584-7225-4220-9217-5e2da3dab27e None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 45, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:45:41.422465 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-718b4584-7225-4220-9217-5e2da3dab27e None None] Checking segment: {'id': 'c427fdc2-fea7-4eae-b97f-26210fbea2f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '4dc01507-bbc2-4a6a-a304-6a037829f30d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:45:41.422871 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-718b4584-7225-4220-9217-5e2da3dab27e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.423261 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-718b4584-7225-4220-9217-5e2da3dab27e None None] Bound using segment: {'id': 'c427fdc2-fea7-4eae-b97f-26210fbea2f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '4dc01507-bbc2-4a6a-a304-6a037829f30d'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:45:41.423753 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-718b4584-7225-4220-9217-5e2da3dab27e None None] Bound port: bbeccba6-5340-4360-b19b-34872225b54b, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c427fdc2-fea7-4eae-b97f-26210fbea2f1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '4dc01507-bbc2-4a6a-a304-6a037829f30d'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:45:41.424156 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-718b4584-7225-4220-9217-5e2da3dab27e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.460425 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b58f1fdb-1e89-4f39-885d-ad9e6b1ac57d tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0802581 Dec 09 21:45:41.464693 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41488) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:41.469228 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-07e8c327-027c-4571-9c5d-c7e34901a0fb tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group': {'name': 'tempest-secgroup--1033257350'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:41.490586 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-718b4584-7225-4220-9217-5e2da3dab27e None None] For port bbeccba6-5340-4360-b19b-34872225b54b, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:45:41.493666 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-07e8c327-027c-4571-9c5d-c7e34901a0fb tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.493904 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-718b4584-7225-4220-9217-5e2da3dab27e None None] For port bbeccba6-5340-4360-b19b-34872225b54b, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=bbeccba6-5340-4360-b19b-34872225b54b,segment=NetworkSegment(c427fdc2-fea7-4eae-b97f-26210fbea2f1),segment_id=c427fdc2-fea7-4eae-b97f-26210fbea2f1)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:45:41.499672 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-718b4584-7225-4220-9217-5e2da3dab27e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.561233 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a594429d-cb2b-4166-8ab4-3d8af90e5f99 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.564935 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-718b4584-7225-4220-9217-5e2da3dab27e None None] Pushing event updated for resources: {'Port': ['ID=bbeccba6-5340-4360-b19b-34872225b54b,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:41.578320 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-07e8c327-027c-4571-9c5d-c7e34901a0fb tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.583867 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-07e8c327-027c-4571-9c5d-c7e34901a0fb tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.604534 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a594429d-cb2b-4166-8ab4-3d8af90e5f99 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.615251 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-07e8c327-027c-4571-9c5d-c7e34901a0fb tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.619244 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-07e8c327-027c-4571-9c5d-c7e34901a0fb tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.1508098 Dec 09 21:45:41.619244 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07e8c327-027c-4571-9c5d-c7e34901a0fb tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3b2eda76-7bf8-4d2f-8737-5897238b6d4f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:41.620810 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41490) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:41.625581 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-1973bb72-2ffc-449d-895d-fddd131cdeaf tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Request body: {'security_group': {'name': 'default'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:41.626010 n-d-713301-27 neutron-server[103437]: WARNING neutron.api.v2.base [None req-1973bb72-2ffc-449d-895d-fddd131cdeaf tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] An exception happened while processing the request body. The exception message is [Default security group already exists.].: neutron.extensions.securitygroup.SecurityGroupDefaultAlreadyExists: Default security group already exists. Dec 09 21:45:41.626637 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-1973bb72-2ffc-449d-895d-fddd131cdeaf tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] update failed (client error): There was a conflict when trying to complete your request. Dec 09 21:45:41.631491 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1973bb72-2ffc-449d-895d-fddd131cdeaf tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "PUT /v2.0/security-groups/3b2eda76-7bf8-4d2f-8737-5897238b6d4f HTTP/1.1" status: 409 len: 330 time: 0.0061166 Dec 09 21:45:41.631777 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41492) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:41.656824 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a594429d-cb2b-4166-8ab4-3d8af90e5f99 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Network 4dc01507-bbc2-4a6a-a304-6a037829f30d is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:45:41.663101 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-a594429d-cb2b-4166-8ab4-3d8af90e5f99 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:41.671714 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a594429d-cb2b-4166-8ab4-3d8af90e5f99 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:45:41.678720 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a594429d-cb2b-4166-8ab4-3d8af90e5f99 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:41.679891 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a594429d-cb2b-4166-8ab4-3d8af90e5f99 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.691007 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a594429d-cb2b-4166-8ab4-3d8af90e5f99 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event updated for resources: {'Port': ['ID=9ef68f8a-a9ba-47e3-a864-1228c3872594,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:41.692702 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-78e29102-7b13-45a3-b3a0-9d4ba877de60 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.704779 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a594429d-cb2b-4166-8ab4-3d8af90e5f99 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 950 time: 1.0327637 Dec 09 21:45:41.705176 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41494) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:41.719499 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-78e29102-7b13-45a3-b3a0-9d4ba877de60 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.784713 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-b7727f9f-d3ff-4b8b-82a8-4b90f4152d4a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Deleting subnet 309167aa-739a-455e-a791-96b75e8ab77b {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:45:41.788736 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7727f9f-d3ff-4b8b-82a8-4b90f4152d4a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.794138 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-78e29102-7b13-45a3-b3a0-9d4ba877de60 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.797013 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-78e29102-7b13-45a3-b3a0-9d4ba877de60 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.798175 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-78e29102-7b13-45a3-b3a0-9d4ba877de60 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "DELETE /v2.0/security-groups/3b2eda76-7bf8-4d2f-8737-5897238b6d4f HTTP/1.1" status: 204 len: 168 time: 0.1653836 Dec 09 21:45:41.801534 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41496) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:41.826947 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78e29102-7b13-45a3-b3a0-9d4ba877de60 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b2eda76-7bf8-4d2f-8737-5897238b6d4f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:41.842975 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7727f9f-d3ff-4b8b-82a8-4b90f4152d4a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:41.882172 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cce37d73-c6f9-42d5-9885-950869c7cc6c tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0753472 Dec 09 21:45:41.882618 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41498) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:41.897523 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-d976ecad-1941-40cc-abea-d07cea35b056 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] delete failed (client error): The resource could not be found. Dec 09 21:45:41.898559 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d976ecad-1941-40cc-abea-d07cea35b056 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "DELETE /v2.0/security-groups/040cf596-310d-4529-b128-e3851d6c927c HTTP/1.1" status: 404 len: 347 time: 0.0149832 Dec 09 21:45:41.902318 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41500) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:41.917051 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-dd18b594-aa8e-4f99-8a91-d75ff59133c8 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] show failed (client error): The resource could not be found. Dec 09 21:45:41.918068 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-dd18b594-aa8e-4f99-8a91-d75ff59133c8 tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "GET /v2.0/security-groups/d12b9001-1ffb-4a11-a086-37c2b09273b5 HTTP/1.1" status: 404 len: 347 time: 0.0148089 Dec 09 21:45:41.922068 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41502) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:41.936959 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-37487a13-f643-4273-be16-ef14f6d6428e tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] show failed (client error): The resource could not be found. Dec 09 21:45:41.937805 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-37487a13-f643-4273-be16-ef14f6d6428e tempest-NegativeSecGroupIPv6Test-291978229 tempest-NegativeSecGroupIPv6Test-291978229-project] 10.222.0.13 "GET /v2.0/security-group-rules/b3eed365-30b8-480a-b7f6-561fcd7c39d2 HTTP/1.1" status: 404 len: 356 time: 0.0147614 Dec 09 21:45:42.015587 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7727f9f-d3ff-4b8b-82a8-4b90f4152d4a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:42.108653 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7727f9f-d3ff-4b8b-82a8-4b90f4152d4a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:42.144790 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7727f9f-d3ff-4b8b-82a8-4b90f4152d4a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event deleted for resources: {'Subnet': ['ID=309167aa-739a-455e-a791-96b75e8ab77b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:42.156005 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7727f9f-d3ff-4b8b-82a8-4b90f4152d4a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:42.161084 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b7727f9f-d3ff-4b8b-82a8-4b90f4152d4a tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "DELETE /v2.0/subnets/309167aa-739a-455e-a791-96b75e8ab77b HTTP/1.1" status: 204 len: 168 time: 0.4547122 Dec 09 21:45:42.163810 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41508) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:42.285003 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-550a3c6c-7f2e-42a0-a0eb-d5ee7958b26e tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:42.287311 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-550a3c6c-7f2e-42a0-a0eb-d5ee7958b26e tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:42.292149 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41514) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:42.293065 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-550a3c6c-7f2e-42a0-a0eb-d5ee7958b26e tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1478 time: 0.1279747 Dec 09 21:45:42.301015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41516) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:42.392247 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3f3b5cdf-a766-44e2-8dc8-f81df9cf19c2 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:42.402161 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-3f3b5cdf-a766-44e2-8dc8-f81df9cf19c2 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] DELETE failed (client error): There was a conflict when trying to complete your request. Dec 09 21:45:42.402770 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-3f3b5cdf-a766-44e2-8dc8-f81df9cf19c2 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] No notification will be sent due to unsuccessful status code: 409 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:45:42.410341 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3f3b5cdf-a766-44e2-8dc8-f81df9cf19c2 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "DELETE /v2.0/networks/4dc01507-bbc2-4a6a-a304-6a037829f30d HTTP/1.1" status: 409 len: 405 time: 0.1170442 Dec 09 21:45:42.410556 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41520) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:42.417322 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-678fa196-d139-4817-8cb2-e38c2460f3d8 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-366150042'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:42.448506 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-678fa196-d139-4817-8cb2-e38c2460f3d8 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Made reservation on behalf of d082983dfcfa477f893f6dc13670fdc5 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:42.452154 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-678fa196-d139-4817-8cb2-e38c2460f3d8 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:42.488778 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d1af941f-be90-4de5-9a0c-1cc33091ee61 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=18256bae2c58443b8d98f4578c58e9c4&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1860106 Dec 09 21:45:42.490766 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41522) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:42.493372 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-678fa196-d139-4817-8cb2-e38c2460f3d8 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] vlan segment allocate from pool success with {'vlan_id': 104, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:45:42.527116 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-678fa196-d139-4817-8cb2-e38c2460f3d8 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:42.527516 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-678fa196-d139-4817-8cb2-e38c2460f3d8 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Added segment 4642cc27-6f12-4ead-b515-e81bf1acf0ea of type vlan for network f3ee7f4b-1328-4e31-a564-e7632dca2d8b Dec 09 21:45:42.588826 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-678fa196-d139-4817-8cb2-e38c2460f3d8 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:42.611174 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4e48e60c-d3e9-47e4-8caa-86fe2760a271 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:42.648618 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-678fa196-d139-4817-8cb2-e38c2460f3d8 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:42.654329 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-678fa196-d139-4817-8cb2-e38c2460f3d8 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:42.654946 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-678fa196-d139-4817-8cb2-e38c2460f3d8 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:42.658755 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4e48e60c-d3e9-47e4-8caa-86fe2760a271 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:42.711672 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device bbeccba6-5340-4360-b19b-34872225b54b up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:45:42.724952 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-678fa196-d139-4817-8cb2-e38c2460f3d8 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 0.3125339 Dec 09 21:45:42.727926 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41524) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:42.735263 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-0c1cfa62-69c8-4330-920f-32110f9d8849 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Request body: {'subnet': {'network_id': 'f3ee7f4b-1328-4e31-a564-e7632dca2d8b', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'ipv6_ra_mode': 'slaac', 'ipv6_address_mode': 'slaac'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:42.763925 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-678fa196-d139-4817-8cb2-e38c2460f3d8 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event updated for resources: {'Network': ['ID=f3ee7f4b-1328-4e31-a564-e7632dca2d8b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:42.815866 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4e48e60c-d3e9-47e4-8caa-86fe2760a271 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:42.827272 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4e48e60c-d3e9-47e4-8caa-86fe2760a271 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:42.832496 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4e48e60c-d3e9-47e4-8caa-86fe2760a271 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/4b1fc7cc-9be9-4cfc-9754-1854aa829efe HTTP/1.1" status: 204 len: 168 time: 0.3380101 Dec 09 21:45:42.841214 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e48e60c-d3e9-47e4-8caa-86fe2760a271 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4b1fc7cc-9be9-4cfc-9754-1854aa829efe,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:42.895918 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0c1cfa62-69c8-4330-920f-32110f9d8849 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Made reservation on behalf of d082983dfcfa477f893f6dc13670fdc5 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:42.901081 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0c1cfa62-69c8-4330-920f-32110f9d8849 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:43.018248 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network f3ee7f4b-1328-4e31-a564-e7632dca2d8b details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:45:43.022349 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2384d3a-c405-4f16-8fa6-6faec54536be None None] Network 4dc01507-bbc2-4a6a-a304-6a037829f30d requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:45:43.214106 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-56f8e7fc-e961-4a0d-ae93-aa9350af5862 None None] Provisioning complete for port bbeccba6-5340-4360-b19b-34872225b54b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:43.215376 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-56f8e7fc-e961-4a0d-ae93-aa9350af5862 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:43.295005 n-d-713301-27 neutron-server[103438]: DEBUG neutron.objects.ports [None req-0c1cfa62-69c8-4330-920f-32110f9d8849 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103438) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 09 21:45:43.297295 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0c1cfa62-69c8-4330-920f-32110f9d8849 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:43.332068 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port bbeccba6-5340-4360-b19b-34872225b54b triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:43.332781 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:43.357034 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c1cfa62-69c8-4330-920f-32110f9d8849 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event updated for resources: {'Subnet': ['ID=25d4ba64-29e5-4fb2-af6e-cf3e5352309e,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:43.509737 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-56f8e7fc-e961-4a0d-ae93-aa9350af5862 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:43.510236 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c1cfa62-69c8-4330-920f-32110f9d8849 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Checking segment: {'id': '4642cc27-6f12-4ead-b515-e81bf1acf0ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': 'f3ee7f4b-1328-4e31-a564-e7632dca2d8b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:45:43.510236 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c1cfa62-69c8-4330-920f-32110f9d8849 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Network hostable DHCP agents. Network: f3ee7f4b-1328-4e31-a564-e7632dca2d8b, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:45:43.540925 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3265c15c-6f0e-4456-bce0-51d88deb35d6 None None] DHCP port deletion for 4dc01507-bbc2-4a6a-a304-6a037829f30d request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:45:43.556073 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c1cfa62-69c8-4330-920f-32110f9d8849 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Network f3ee7f4b-1328-4e31-a564-e7632dca2d8b is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:45:43.575189 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-0c1cfa62-69c8-4330-920f-32110f9d8849 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, f3ee7f4b-1328-4e31-a564-e7632dca2d8b) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:43.580393 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c1cfa62-69c8-4330-920f-32110f9d8849 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:43.581928 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0c1cfa62-69c8-4330-920f-32110f9d8849 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:43.608416 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-56f8e7fc-e961-4a0d-ae93-aa9350af5862 None None] For port bbeccba6-5340-4360-b19b-34872225b54b, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=bbeccba6-5340-4360-b19b-34872225b54b,segment=NetworkSegment(c427fdc2-fea7-4eae-b97f-26210fbea2f1),segment_id=c427fdc2-fea7-4eae-b97f-26210fbea2f1)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:43.613856 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ea44035-d686-4125-a856-7aa0a40e48f2 None None] Network f3ee7f4b-1328-4e31-a564-e7632dca2d8b requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:45:43.620615 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0c1cfa62-69c8-4330-920f-32110f9d8849 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 818 time: 0.8913474 Dec 09 21:45:43.623284 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41548) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:43.657675 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-56f8e7fc-e961-4a0d-ae93-aa9350af5862 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:43.666389 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:43.811634 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b988f059-fc87-4354-94fd-a3bed4dd7336 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:43.885946 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56f8e7fc-e961-4a0d-ae93-aa9350af5862 None None] Pushing event updated for resources: {'Port': ['ID=bbeccba6-5340-4360-b19b-34872225b54b,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:43.917058 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b988f059-fc87-4354-94fd-a3bed4dd7336 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:43.917784 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-3265c15c-6f0e-4456-bce0-51d88deb35d6 None None] Deleting port bbeccba6-5340-4360-b19b-34872225b54b {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:45:43.918392 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3265c15c-6f0e-4456-bce0-51d88deb35d6 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:43.967182 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:45:43.968095 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:45:43.980300 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a269fc80-f397-4b76-bd14-b8f645607ed2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-f3ee7f4b-1328-4e31-a564-e7632dca2d8b', 'network_id': 'f3ee7f4b-1328-4e31-a564-e7632dca2d8b', 'project_id': 'd082983dfcfa477f893f6dc13670fdc5', 'fixed_ips': [{'subnet_id': '25d4ba64-29e5-4fb2-af6e-cf3e5352309e'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:45:43.981998 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a269fc80-f397-4b76-bd14-b8f645607ed2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:43.983555 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41556) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:44.009256 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b988f059-fc87-4354-94fd-a3bed4dd7336 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:44.049485 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-3265c15c-6f0e-4456-bce0-51d88deb35d6 None None] For port bbeccba6-5340-4360-b19b-34872225b54b, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=bbeccba6-5340-4360-b19b-34872225b54b,segment=NetworkSegment(c427fdc2-fea7-4eae-b97f-26210fbea2f1),segment_id=c427fdc2-fea7-4eae-b97f-26210fbea2f1)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:44.050181 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3265c15c-6f0e-4456-bce0-51d88deb35d6 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:44.052023 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b988f059-fc87-4354-94fd-a3bed4dd7336 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event deleted for resources: {'Subnet': ['ID=25d4ba64-29e5-4fb2-af6e-cf3e5352309e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:44.130303 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-3265c15c-6f0e-4456-bce0-51d88deb35d6 None None] Calling delete_port for bbeccba6-5340-4360-b19b-34872225b54b owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:45:44.135635 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b988f059-fc87-4354-94fd-a3bed4dd7336 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:44.160390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-b988f059-fc87-4354-94fd-a3bed4dd7336 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f3ee7f4b-1328-4e31-a564-e7632dca2d8b']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:44.164998 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2246b90f-7d08-44c5-9756-3d4c6cab5575 None None] Network f3ee7f4b-1328-4e31-a564-e7632dca2d8b requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:45:44.173063 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-b988f059-fc87-4354-94fd-a3bed4dd7336 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4642cc27-6f12-4ead-b515-e81bf1acf0ea') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:44.173385 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-b988f059-fc87-4354-94fd-a3bed4dd7336 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4642cc27-6f12-4ead-b515-e81bf1acf0ea') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:44.186853 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b988f059-fc87-4354-94fd-a3bed4dd7336 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:44.202354 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b988f059-fc87-4354-94fd-a3bed4dd7336 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:44.209390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b988f059-fc87-4354-94fd-a3bed4dd7336 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Releasing vlan 104 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:45:44.209802 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b988f059-fc87-4354-94fd-a3bed4dd7336 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:45:44.278538 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:45:44.284798 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-3dde3db3-7f8b-4888-b1f8-e52216852f0d tempest-SubnetPoolsTestJSON-1624827047 tempest-SubnetPoolsTestJSON-1624827047-project] Request body: {'subnetpool': {'name': 'tempest-subnetpools-1904891725', 'prefixes': ['172.20.0.0/16']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:44.292122 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b988f059-fc87-4354-94fd-a3bed4dd7336 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:44.313793 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b988f059-fc87-4354-94fd-a3bed4dd7336 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:44.317289 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b988f059-fc87-4354-94fd-a3bed4dd7336 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "DELETE /v2.0/networks/f3ee7f4b-1328-4e31-a564-e7632dca2d8b HTTP/1.1" status: 204 len: 168 time: 0.6926112 Dec 09 21:45:44.318388 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b988f059-fc87-4354-94fd-a3bed4dd7336 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event deleted for resources: {'Network': ['ID=f3ee7f4b-1328-4e31-a564-e7632dca2d8b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:44.320934 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41560) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:44.337988 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-8133459a-59bd-45c1-bc3f-f83aa1c2cb82 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-441080542'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:44.349236 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3265c15c-6f0e-4456-bce0-51d88deb35d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:44.374155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8133459a-59bd-45c1-bc3f-f83aa1c2cb82 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Made reservation on behalf of d082983dfcfa477f893f6dc13670fdc5 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:44.379914 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8133459a-59bd-45c1-bc3f-f83aa1c2cb82 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:44.391377 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3265c15c-6f0e-4456-bce0-51d88deb35d6 None None] No DVR routers for this DVR port bbeccba6-5340-4360-b19b-34872225b54b on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:45:44.393639 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3265c15c-6f0e-4456-bce0-51d88deb35d6 None None] Pushing event deleted for resources: {'Port': ['ID=bbeccba6-5340-4360-b19b-34872225b54b,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:44.415676 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3dde3db3-7f8b-4888-b1f8-e52216852f0d tempest-SubnetPoolsTestJSON-1624827047 tempest-SubnetPoolsTestJSON-1624827047-project] Publish callbacks [] for subnetpool, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:44.417084 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8133459a-59bd-45c1-bc3f-f83aa1c2cb82 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] vlan segment allocate from pool success with {'vlan_id': 149, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:45:44.419185 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3dde3db3-7f8b-4888-b1f8-e52216852f0d tempest-SubnetPoolsTestJSON-1624827047 tempest-SubnetPoolsTestJSON-1624827047-project] 10.222.0.13 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 737 time: 0.4326866 Dec 09 21:45:44.420437 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41562) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:44.427885 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8133459a-59bd-45c1-bc3f-f83aa1c2cb82 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:44.428240 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-8133459a-59bd-45c1-bc3f-f83aa1c2cb82 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Added segment 90d527ed-f58a-4fb9-9ee0-9ce5bdd7363e of type vlan for network cf3e945b-44f7-4169-ab37-e051cf797ef4 Dec 09 21:45:44.469736 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8a0ea71d-2c53-4cc3-b642-924c1a7192a6 tempest-SubnetPoolsTestJSON-1624827047 tempest-SubnetPoolsTestJSON-1624827047-project] 10.222.0.13 "GET /v2.0/subnetpools/2c6ee98c-0849-4745-b312-8da910d69c16 HTTP/1.1" status: 200 len: 732 time: 0.0480196 Dec 09 21:45:44.475612 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41564) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:44.481304 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-af0a83cf-8ce7-4847-a5f2-0569b9afcf0d tempest-SubnetPoolsTestJSON-1624827047 tempest-SubnetPoolsTestJSON-1624827047-project] Request body: {'subnetpool': {'name': 'tempest-subnetpools_update-313785382'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:44.488038 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8133459a-59bd-45c1-bc3f-f83aa1c2cb82 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:44.490127 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Port bbeccba6-5340-4360-b19b-34872225b54b update to ACTIVE by agent not found {{(pid=103439) update_port_statuses /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2167}} Dec 09 21:45:44.619384 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8133459a-59bd-45c1-bc3f-f83aa1c2cb82 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:44.627600 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8133459a-59bd-45c1-bc3f-f83aa1c2cb82 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:44.628562 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8133459a-59bd-45c1-bc3f-f83aa1c2cb82 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:44.672203 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device bbeccba6-5340-4360-b19b-34872225b54b no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:45:44.686730 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41570) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:44.687464 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8133459a-59bd-45c1-bc3f-f83aa1c2cb82 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 788 time: 0.3645728 Dec 09 21:45:44.692159 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c051f1c4-0f2e-4d02-8c4a-23e7f1b32be3 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Request body: {'subnet': {'network_id': 'cf3e945b-44f7-4169-ab37-e051cf797ef4', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'ipv6_ra_mode': 'dhcpv6-stateful', 'ipv6_address_mode': 'dhcpv6-stateful'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:44.694856 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: bbeccba6-5340-4360-b19b-34872225b54b {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:45:44.695478 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device bbeccba6-5340-4360-b19b-34872225b54b not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:45:44.701094 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af0a83cf-8ce7-4847-a5f2-0569b9afcf0d tempest-SubnetPoolsTestJSON-1624827047 tempest-SubnetPoolsTestJSON-1624827047-project] Publish callbacks [] for subnetpool, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:44.704717 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-af0a83cf-8ce7-4847-a5f2-0569b9afcf0d tempest-SubnetPoolsTestJSON-1624827047 tempest-SubnetPoolsTestJSON-1624827047-project] 10.222.0.13 "PUT /v2.0/subnetpools/2c6ee98c-0849-4745-b312-8da910d69c16 HTTP/1.1" status: 200 len: 683 time: 0.2256787 Dec 09 21:45:44.705651 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41572) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:44.759269 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8133459a-59bd-45c1-bc3f-f83aa1c2cb82 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event updated for resources: {'Network': ['ID=cf3e945b-44f7-4169-ab37-e051cf797ef4,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:44.772803 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network cf3e945b-44f7-4169-ab37-e051cf797ef4 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:45:44.819548 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c051f1c4-0f2e-4d02-8c4a-23e7f1b32be3 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Made reservation on behalf of d082983dfcfa477f893f6dc13670fdc5 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:44.827799 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c051f1c4-0f2e-4d02-8c4a-23e7f1b32be3 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:44.831223 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6a8b0167-54ff-4d42-ae5b-c22730ef1d47 tempest-SubnetPoolsTestJSON-1624827047 tempest-SubnetPoolsTestJSON-1624827047-project] Publish callbacks [] for subnetpool, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:44.834975 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6a8b0167-54ff-4d42-ae5b-c22730ef1d47 tempest-SubnetPoolsTestJSON-1624827047 tempest-SubnetPoolsTestJSON-1624827047-project] 10.222.0.13 "DELETE /v2.0/subnetpools/2c6ee98c-0849-4745-b312-8da910d69c16 HTTP/1.1" status: 204 len: 168 time: 0.1261828 Dec 09 21:45:44.835930 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41574) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:44.856904 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-2ce28af0-1baa-42e2-8a19-30a68c92c98a tempest-SubnetPoolsTestJSON-1624827047 tempest-SubnetPoolsTestJSON-1624827047-project] show failed (client error): The resource could not be found. Dec 09 21:45:44.862495 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2ce28af0-1baa-42e2-8a19-30a68c92c98a tempest-SubnetPoolsTestJSON-1624827047 tempest-SubnetPoolsTestJSON-1624827047-project] 10.222.0.13 "GET /v2.0/subnetpools/2c6ee98c-0849-4745-b312-8da910d69c16 HTTP/1.1" status: 404 len: 346 time: 0.0241153 Dec 09 21:45:44.863539 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41576) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:44.880569 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-779bc456-b9c2-4b94-8d4f-6a33b12ef0b6 tempest-SubnetPoolsTestJSON-1624827047 tempest-SubnetPoolsTestJSON-1624827047-project] delete failed (client error): The resource could not be found. Dec 09 21:45:44.889145 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-779bc456-b9c2-4b94-8d4f-6a33b12ef0b6 tempest-SubnetPoolsTestJSON-1624827047 tempest-SubnetPoolsTestJSON-1624827047-project] 10.222.0.13 "DELETE /v2.0/subnetpools/2c6ee98c-0849-4745-b312-8da910d69c16 HTTP/1.1" status: 404 len: 346 time: 0.0238376 Dec 09 21:45:45.067036 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c051f1c4-0f2e-4d02-8c4a-23e7f1b32be3 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:45.158395 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c051f1c4-0f2e-4d02-8c4a-23e7f1b32be3 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Checking segment: {'id': '90d527ed-f58a-4fb9-9ee0-9ce5bdd7363e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'cf3e945b-44f7-4169-ab37-e051cf797ef4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:45:45.158890 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c051f1c4-0f2e-4d02-8c4a-23e7f1b32be3 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Network hostable DHCP agents. Network: cf3e945b-44f7-4169-ab37-e051cf797ef4, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:45:45.176978 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c051f1c4-0f2e-4d02-8c4a-23e7f1b32be3 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event updated for resources: {'Subnet': ['ID=5560197f-9629-45ad-8b53-363996720994,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:45.198468 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c051f1c4-0f2e-4d02-8c4a-23e7f1b32be3 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Network cf3e945b-44f7-4169-ab37-e051cf797ef4 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:45:45.213935 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-c051f1c4-0f2e-4d02-8c4a-23e7f1b32be3 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, cf3e945b-44f7-4169-ab37-e051cf797ef4) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:45.226954 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e6d6291a-ba62-42bb-b427-8f2d928004f4 None None] Network cf3e945b-44f7-4169-ab37-e051cf797ef4 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:45:45.227466 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c051f1c4-0f2e-4d02-8c4a-23e7f1b32be3 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:45.227466 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c051f1c4-0f2e-4d02-8c4a-23e7f1b32be3 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:45.228489 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41582) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:45.247962 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41586) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:45.248221 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c051f1c4-0f2e-4d02-8c4a-23e7f1b32be3 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.5599451 Dec 09 21:45:45.369326 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d629f165-d53c-4435-b3e6-6d0fc7534737 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-cf3e945b-44f7-4169-ab37-e051cf797ef4', 'network_id': 'cf3e945b-44f7-4169-ab37-e051cf797ef4', 'project_id': 'd082983dfcfa477f893f6dc13670fdc5', 'fixed_ips': [{'subnet_id': '5560197f-9629-45ad-8b53-363996720994'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:45:45.371671 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d629f165-d53c-4435-b3e6-6d0fc7534737 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:45.408502 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:45.428877 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26439256-b5c5-4f0e-a75c-de0af55ba015 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:45.540673 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-d629f165-d53c-4435-b3e6-6d0fc7534737 None None] Allocated IP 2001:db8::2 (cf3e945b-44f7-4169-ab37-e051cf797ef4/5560197f-9629-45ad-8b53-363996720994/62c8a9eb-a773-4376-9152-b95d7d6b0e68) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:45:45.557821 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:45.760785 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26439256-b5c5-4f0e-a75c-de0af55ba015 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:45.767301 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-26439256-b5c5-4f0e-a75c-de0af55ba015 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:45.816947 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26439256-b5c5-4f0e-a75c-de0af55ba015 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dc91e299-ccce-4438-98f9-457c94cb3e03,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:45.833246 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-26439256-b5c5-4f0e-a75c-de0af55ba015 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=a3275c333c074a41996880de5b26ffd0&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6002560 Dec 09 21:45:45.833769 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41592) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:45.849063 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d629f165-d53c-4435-b3e6-6d0fc7534737 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:45.856706 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d629f165-d53c-4435-b3e6-6d0fc7534737 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:45.876182 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:45.903305 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cd1d9a93-6ec9-48a8-a231-08b8cc53b277 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:45.914016 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d629f165-d53c-4435-b3e6-6d0fc7534737 None None] Network cf3e945b-44f7-4169-ab37-e051cf797ef4 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:45:45.917894 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-d629f165-d53c-4435-b3e6-6d0fc7534737 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:45.927691 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d629f165-d53c-4435-b3e6-6d0fc7534737 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:45:45.927949 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cd1d9a93-6ec9-48a8-a231-08b8cc53b277 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:45.935590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event deleted for resources: {'Subnet': ['ID=5560197f-9629-45ad-8b53-363996720994,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:45.999208 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d629f165-d53c-4435-b3e6-6d0fc7534737 None None] Pushing event updated for resources: {'Port': ['ID=62c8a9eb-a773-4376-9152-b95d7d6b0e68,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:46.002084 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cd1d9a93-6ec9-48a8-a231-08b8cc53b277 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:46.005608 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cd1d9a93-6ec9-48a8-a231-08b8cc53b277 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:46.010356 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cd1d9a93-6ec9-48a8-a231-08b8cc53b277 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/dc91e299-ccce-4438-98f9-457c94cb3e03 HTTP/1.1" status: 204 len: 168 time: 0.1729488 Dec 09 21:45:46.015260 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-d629f165-d53c-4435-b3e6-6d0fc7534737 None None] Attempting to bind port 62c8a9eb-a773-4376-9152-b95d7d6b0e68 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:45:46.015877 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-d629f165-d53c-4435-b3e6-6d0fc7534737 None None] Attempting to bind port 62c8a9eb-a773-4376-9152-b95d7d6b0e68 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '90d527ed-f58a-4fb9-9ee0-9ce5bdd7363e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'cf3e945b-44f7-4169-ab37-e051cf797ef4'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:45:46.016410 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d629f165-d53c-4435-b3e6-6d0fc7534737 None None] Attempting to bind port 62c8a9eb-a773-4376-9152-b95d7d6b0e68 on network cf3e945b-44f7-4169-ab37-e051cf797ef4 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:45:46.022050 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d629f165-d53c-4435-b3e6-6d0fc7534737 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 45, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:45:46.022710 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d629f165-d53c-4435-b3e6-6d0fc7534737 None None] Checking segment: {'id': '90d527ed-f58a-4fb9-9ee0-9ce5bdd7363e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'cf3e945b-44f7-4169-ab37-e051cf797ef4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:45:46.023283 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d629f165-d53c-4435-b3e6-6d0fc7534737 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:46.023641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd1d9a93-6ec9-48a8-a231-08b8cc53b277 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dc91e299-ccce-4438-98f9-457c94cb3e03,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:46.024062 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d629f165-d53c-4435-b3e6-6d0fc7534737 None None] Bound using segment: {'id': '90d527ed-f58a-4fb9-9ee0-9ce5bdd7363e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'cf3e945b-44f7-4169-ab37-e051cf797ef4'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:45:46.024700 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-d629f165-d53c-4435-b3e6-6d0fc7534737 None None] Bound port: 62c8a9eb-a773-4376-9152-b95d7d6b0e68, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '90d527ed-f58a-4fb9-9ee0-9ce5bdd7363e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'cf3e945b-44f7-4169-ab37-e051cf797ef4'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:45:46.025274 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d629f165-d53c-4435-b3e6-6d0fc7534737 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:46.027197 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:46.057157 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cf3e945b-44f7-4169-ab37-e051cf797ef4']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:46.072055 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '90d527ed-f58a-4fb9-9ee0-9ce5bdd7363e') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:46.072526 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '90d527ed-f58a-4fb9-9ee0-9ce5bdd7363e') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:46.084593 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:46.100286 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:46.108407 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Releasing vlan 149 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:45:46.109184 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:46.114147 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-d629f165-d53c-4435-b3e6-6d0fc7534737 None None] For port 62c8a9eb-a773-4376-9152-b95d7d6b0e68, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:45:46.176901 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:45:46.181664 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.db.api [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 09 21:45:46.181664 n-d-713301-27 neutron-server[103437]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 09 21:45:46.181664 n-d-713301-27 neutron-server[103437]: [parameters: {'id': 'cf3e945b-44f7-4169-ab37-e051cf797ef4'}] Dec 09 21:45:46.181664 n-d-713301-27 neutron-server[103437]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103437) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:45:46.182275 n-d-713301-27 neutron-server[103437]: DEBUG oslo_db.api [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:45:46.194166 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-d629f165-d53c-4435-b3e6-6d0fc7534737 None None] For port 62c8a9eb-a773-4376-9152-b95d7d6b0e68, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=62c8a9eb-a773-4376-9152-b95d7d6b0e68,segment=NetworkSegment(90d527ed-f58a-4fb9-9ee0-9ce5bdd7363e),segment_id=90d527ed-f58a-4fb9-9ee0-9ce5bdd7363e)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:45:46.201691 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d629f165-d53c-4435-b3e6-6d0fc7534737 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:46.323380 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d629f165-d53c-4435-b3e6-6d0fc7534737 None None] Pushing event updated for resources: {'Port': ['ID=62c8a9eb-a773-4376-9152-b95d7d6b0e68,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:46.338155 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf254566-9279-471a-b3bd-4f1079cc7be9 None None] Network cf3e945b-44f7-4169-ab37-e051cf797ef4 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:45:46.443902 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-288b1cda-ad1b-4cec-8d7d-cd2dfe0b1ca3 None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 21:45:46.683793 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:46.764846 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-288b1cda-ad1b-4cec-8d7d-cd2dfe0b1ca3 None None] Resources bound (agent type, host, resource id): {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 09 21:45:46.805677 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Deleting port 62c8a9eb-a773-4376-9152-b95d7d6b0e68 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:45:46.807512 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:46.972895 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41618) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:46.974710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] For port 62c8a9eb-a773-4376-9152-b95d7d6b0e68, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=62c8a9eb-a773-4376-9152-b95d7d6b0e68,segment=NetworkSegment(90d527ed-f58a-4fb9-9ee0-9ce5bdd7363e),segment_id=90d527ed-f58a-4fb9-9ee0-9ce5bdd7363e)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:46.975338 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:46.990574 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Calling delete_port for 62c8a9eb-a773-4376-9152-b95d7d6b0e68 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:45:47.099875 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:47.139743 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event deleted for resources: {'Port': ['ID=62c8a9eb-a773-4376-9152-b95d7d6b0e68,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:47.150421 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a4a0e738-5563-4538-8d35-07b036aa7eff tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Request body: {'network': {'name': 'tempest-TagsExtTest-test-network-1175775903'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:47.154196 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] No DVR routers for this DVR port 62c8a9eb-a773-4376-9152-b95d7d6b0e68 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:45:47.178151 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a4a0e738-5563-4538-8d35-07b036aa7eff tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Made reservation on behalf of 6c6a677d6f254ab5a77a8358ab37ab45 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:47.182508 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a4a0e738-5563-4538-8d35-07b036aa7eff tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:47.193901 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a4a0e738-5563-4538-8d35-07b036aa7eff tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:47.267309 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:47.288331 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a4a0e738-5563-4538-8d35-07b036aa7eff tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:47.294435 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a4a0e738-5563-4538-8d35-07b036aa7eff tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:47.299372 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cf3e945b-44f7-4169-ab37-e051cf797ef4']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:47.308165 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a4a0e738-5563-4538-8d35-07b036aa7eff tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] vlan segment allocate from pool success with {'vlan_id': 142, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:45:47.311691 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '90d527ed-f58a-4fb9-9ee0-9ce5bdd7363e') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:47.312249 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '90d527ed-f58a-4fb9-9ee0-9ce5bdd7363e') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:47.323523 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:47.337845 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:47.343358 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4a0e738-5563-4538-8d35-07b036aa7eff tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Pushing event updated for resources: {'SecurityGroup': ['ID=527aec6b-bc21-4e37-b0f2-1d0f6969e722,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:47.344048 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Releasing vlan 149 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:45:47.344438 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:45:47.348351 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:45:47.415225 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:47.418746 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a4a0e738-5563-4538-8d35-07b036aa7eff tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:47.419105 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-a4a0e738-5563-4538-8d35-07b036aa7eff tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Added segment f6eb7049-4269-46e5-b25e-f984e46ce81b of type vlan for network d106428f-76a7-4c86-a11f-c78b209d6ebb Dec 09 21:45:47.424348 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:47.428172 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "DELETE /v2.0/networks/cf3e945b-44f7-4169-ab37-e051cf797ef4 HTTP/1.1" status: 204 len: 168 time: 2.1789489 Dec 09 21:45:47.435105 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41622) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:47.440762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-b5669372-6645-435f-9055-72db53bb90fc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Request body: {'network': {'name': 'tempest-NetworksIpV6TestAttrs-test-network-1437269450'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:47.444276 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77f48006-a6d2-45ae-8bdf-3ebbbb492138 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event deleted for resources: {'Network': ['ID=cf3e945b-44f7-4169-ab37-e051cf797ef4,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:47.494419 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a4a0e738-5563-4538-8d35-07b036aa7eff tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:47.502392 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b5669372-6645-435f-9055-72db53bb90fc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Made reservation on behalf of d082983dfcfa477f893f6dc13670fdc5 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:47.506023 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b5669372-6645-435f-9055-72db53bb90fc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:47.540021 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a4a0e738-5563-4538-8d35-07b036aa7eff tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:47.545482 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a4a0e738-5563-4538-8d35-07b036aa7eff tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:47.546056 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a4a0e738-5563-4538-8d35-07b036aa7eff tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:47.553961 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b5669372-6645-435f-9055-72db53bb90fc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] vlan segment allocate from pool success with {'vlan_id': 137, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:45:47.593598 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b5669372-6645-435f-9055-72db53bb90fc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:47.593945 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-b5669372-6645-435f-9055-72db53bb90fc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Added segment 1890281f-8836-465f-9d8d-dd209e9b9fcf of type vlan for network a81206fa-c68b-4c06-a3d7-51eb9171c151 Dec 09 21:45:47.608855 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a4a0e738-5563-4538-8d35-07b036aa7eff tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 779 time: 0.6341739 Dec 09 21:45:47.611958 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41624) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:47.617278 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a010464d-bbca-4fd3-9a46-5bc4befabbab tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Request body: {'subnet': {'network_id': 'd106428f-76a7-4c86-a11f-c78b209d6ebb', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:47.702022 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b5669372-6645-435f-9055-72db53bb90fc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:47.721308 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4a0e738-5563-4538-8d35-07b036aa7eff tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Pushing event updated for resources: {'Network': ['ID=d106428f-76a7-4c86-a11f-c78b209d6ebb,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:47.734703 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network d106428f-76a7-4c86-a11f-c78b209d6ebb details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:45:47.736777 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b5669372-6645-435f-9055-72db53bb90fc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:47.742710 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b5669372-6645-435f-9055-72db53bb90fc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:47.743333 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b5669372-6645-435f-9055-72db53bb90fc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:47.756401 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a010464d-bbca-4fd3-9a46-5bc4befabbab tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Made reservation on behalf of 6c6a677d6f254ab5a77a8358ab37ab45 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:47.761616 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a010464d-bbca-4fd3-9a46-5bc4befabbab tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:47.784792 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b5669372-6645-435f-9055-72db53bb90fc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 789 time: 0.3474019 Dec 09 21:45:47.788824 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41628) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:47.794759 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-34f1d4b6-a0db-49ba-8b18-5b56efc1c2d1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Request body: {'subnet': {'network_id': 'a81206fa-c68b-4c06-a3d7-51eb9171c151', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'ipv6_ra_mode': 'dhcpv6-stateless', 'ipv6_address_mode': 'dhcpv6-stateless'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:47.849718 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5669372-6645-435f-9055-72db53bb90fc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event updated for resources: {'Network': ['ID=a81206fa-c68b-4c06-a3d7-51eb9171c151,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:47.864058 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network a81206fa-c68b-4c06-a3d7-51eb9171c151 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:45:47.988490 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-34f1d4b6-a0db-49ba-8b18-5b56efc1c2d1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Made reservation on behalf of d082983dfcfa477f893f6dc13670fdc5 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:47.992503 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-34f1d4b6-a0db-49ba-8b18-5b56efc1c2d1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:48.157616 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a010464d-bbca-4fd3-9a46-5bc4befabbab tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:48.263917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a010464d-bbca-4fd3-9a46-5bc4befabbab tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Pushing event updated for resources: {'Subnet': ['ID=0f02725a-b828-4d3a-8d7c-533730ba8790,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:48.310320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a010464d-bbca-4fd3-9a46-5bc4befabbab tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Checking segment: {'id': 'f6eb7049-4269-46e5-b25e-f984e46ce81b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'd106428f-76a7-4c86-a11f-c78b209d6ebb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:45:48.310772 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a010464d-bbca-4fd3-9a46-5bc4befabbab tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Network hostable DHCP agents. Network: d106428f-76a7-4c86-a11f-c78b209d6ebb, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:45:48.353829 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a010464d-bbca-4fd3-9a46-5bc4befabbab tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Network d106428f-76a7-4c86-a11f-c78b209d6ebb is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:45:48.390205 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-a010464d-bbca-4fd3-9a46-5bc4befabbab tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, d106428f-76a7-4c86-a11f-c78b209d6ebb) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:48.402554 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a010464d-bbca-4fd3-9a46-5bc4befabbab tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:48.403294 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a010464d-bbca-4fd3-9a46-5bc4befabbab tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:48.406040 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb4d572d-3f0f-4e6b-aa05-86fa79ca5f1d None None] Network d106428f-76a7-4c86-a11f-c78b209d6ebb requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:45:48.448293 n-d-713301-27 neutron-server[103437]: DEBUG neutron.objects.ports [None req-34f1d4b6-a0db-49ba-8b18-5b56efc1c2d1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103437) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 09 21:45:48.452159 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-34f1d4b6-a0db-49ba-8b18-5b56efc1c2d1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:48.462775 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41640) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:48.464104 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a010464d-bbca-4fd3-9a46-5bc4befabbab tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.8509738 Dec 09 21:45:48.469801 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-787bc9f9-7fbf-4828-b5f7-f184772dee95 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Request body: {'port': {'network_id': 'd106428f-76a7-4c86-a11f-c78b209d6ebb', 'name': 'tempest-TagsExtTest-1621819665'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:48.530260 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0bbf19c0-1732-4943-82b3-763a84801ffc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-d106428f-76a7-4c86-a11f-c78b209d6ebb', 'network_id': 'd106428f-76a7-4c86-a11f-c78b209d6ebb', 'project_id': '6c6a677d6f254ab5a77a8358ab37ab45', 'fixed_ips': [{'subnet_id': '0f02725a-b828-4d3a-8d7c-533730ba8790'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:45:48.531412 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0bbf19c0-1732-4943-82b3-763a84801ffc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:48.622269 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34f1d4b6-a0db-49ba-8b18-5b56efc1c2d1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Checking segment: {'id': '1890281f-8836-465f-9d8d-dd209e9b9fcf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'a81206fa-c68b-4c06-a3d7-51eb9171c151'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:45:48.622897 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34f1d4b6-a0db-49ba-8b18-5b56efc1c2d1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Network hostable DHCP agents. Network: a81206fa-c68b-4c06-a3d7-51eb9171c151, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:45:48.626825 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34f1d4b6-a0db-49ba-8b18-5b56efc1c2d1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event updated for resources: {'Subnet': ['ID=8591cb50-17ac-4b1d-9e7b-0029b786897c,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:48.671416 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34f1d4b6-a0db-49ba-8b18-5b56efc1c2d1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Network a81206fa-c68b-4c06-a3d7-51eb9171c151 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:45:48.687184 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-34f1d4b6-a0db-49ba-8b18-5b56efc1c2d1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, a81206fa-c68b-4c06-a3d7-51eb9171c151) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:48.697913 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-073bc9b1-9448-422d-b32f-9f909e2e8460 None None] Network a81206fa-c68b-4c06-a3d7-51eb9171c151 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:45:48.704969 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-0bbf19c0-1732-4943-82b3-763a84801ffc None None] Allocated IP 172.20.0.2 (d106428f-76a7-4c86-a11f-c78b209d6ebb/0f02725a-b828-4d3a-8d7c-533730ba8790/5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:45:48.706129 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-34f1d4b6-a0db-49ba-8b18-5b56efc1c2d1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:48.708919 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-34f1d4b6-a0db-49ba-8b18-5b56efc1c2d1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:48.725828 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-787bc9f9-7fbf-4828-b5f7-f184772dee95 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Made reservation on behalf of 6c6a677d6f254ab5a77a8358ab37ab45 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:48.730830 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-787bc9f9-7fbf-4828-b5f7-f184772dee95 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:48.740648 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-34f1d4b6-a0db-49ba-8b18-5b56efc1c2d1 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 840 time: 0.9503384 Dec 09 21:45:48.743585 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41644) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:48.758212 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-787bc9f9-7fbf-4828-b5f7-f184772dee95 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] device_id is not set on port b0d2998b-ab57-46de-85f9-5eb58bc92caf yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:45:48.907661 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9106b023-4f08-4c68-b6f8-f1578a0294c4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-a81206fa-c68b-4c06-a3d7-51eb9171c151', 'network_id': 'a81206fa-c68b-4c06-a3d7-51eb9171c151', 'project_id': 'd082983dfcfa477f893f6dc13670fdc5', 'fixed_ips': [{'subnet_id': '8591cb50-17ac-4b1d-9e7b-0029b786897c'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:45:48.909440 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9106b023-4f08-4c68-b6f8-f1578a0294c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:48.946062 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:49.004752 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:49.113983 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0bbf19c0-1732-4943-82b3-763a84801ffc None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:49.127046 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0bbf19c0-1732-4943-82b3-763a84801ffc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:49.131550 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-9106b023-4f08-4c68-b6f8-f1578a0294c4 None None] Allocated IP 2001:db8::f816:3eff:fe42:2378 (a81206fa-c68b-4c06-a3d7-51eb9171c151/8591cb50-17ac-4b1d-9e7b-0029b786897c/598dabb8-a70f-482e-9381-7c5b1ffac5bf) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:45:49.178819 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0bbf19c0-1732-4943-82b3-763a84801ffc None None] Network d106428f-76a7-4c86-a11f-c78b209d6ebb is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:45:49.182969 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-0bbf19c0-1732-4943-82b3-763a84801ffc None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:49.189266 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0bbf19c0-1732-4943-82b3-763a84801ffc None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:45:49.224738 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-787bc9f9-7fbf-4828-b5f7-f184772dee95 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Allocated IP 172.20.0.4 (d106428f-76a7-4c86-a11f-c78b209d6ebb/0f02725a-b828-4d3a-8d7c-533730ba8790/b0d2998b-ab57-46de-85f9-5eb58bc92caf) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:45:49.265490 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bbf19c0-1732-4943-82b3-763a84801ffc None None] Pushing event updated for resources: {'Port': ['ID=5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:49.324406 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0bbf19c0-1732-4943-82b3-763a84801ffc None None] Attempting to bind port 5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:45:49.324947 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0bbf19c0-1732-4943-82b3-763a84801ffc None None] Attempting to bind port 5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f6eb7049-4269-46e5-b25e-f984e46ce81b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'd106428f-76a7-4c86-a11f-c78b209d6ebb'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:45:49.325407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bbf19c0-1732-4943-82b3-763a84801ffc None None] Attempting to bind port 5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c on network d106428f-76a7-4c86-a11f-c78b209d6ebb {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:45:49.334933 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bbf19c0-1732-4943-82b3-763a84801ffc None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 45, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:45:49.335476 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bbf19c0-1732-4943-82b3-763a84801ffc None None] Checking segment: {'id': 'f6eb7049-4269-46e5-b25e-f984e46ce81b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'd106428f-76a7-4c86-a11f-c78b209d6ebb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:45:49.335969 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0bbf19c0-1732-4943-82b3-763a84801ffc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:49.336473 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bbf19c0-1732-4943-82b3-763a84801ffc None None] Bound using segment: {'id': 'f6eb7049-4269-46e5-b25e-f984e46ce81b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'd106428f-76a7-4c86-a11f-c78b209d6ebb'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:45:49.337044 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0bbf19c0-1732-4943-82b3-763a84801ffc None None] Bound port: 5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f6eb7049-4269-46e5-b25e-f984e46ce81b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'd106428f-76a7-4c86-a11f-c78b209d6ebb'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:45:49.337520 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0bbf19c0-1732-4943-82b3-763a84801ffc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:49.413367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0bbf19c0-1732-4943-82b3-763a84801ffc None None] For port 5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:45:49.415869 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-787bc9f9-7fbf-4828-b5f7-f184772dee95 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:49.417153 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0bbf19c0-1732-4943-82b3-763a84801ffc None None] For port 5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c,segment=NetworkSegment(f6eb7049-4269-46e5-b25e-f984e46ce81b),segment_id=f6eb7049-4269-46e5-b25e-f984e46ce81b)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:45:49.430010 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0bbf19c0-1732-4943-82b3-763a84801ffc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:49.475336 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-787bc9f9-7fbf-4828-b5f7-f184772dee95 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:49.539454 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9106b023-4f08-4c68-b6f8-f1578a0294c4 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:49.544224 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bbf19c0-1732-4943-82b3-763a84801ffc None None] Pushing event updated for resources: {'Port': ['ID=5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:49.559470 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9106b023-4f08-4c68-b6f8-f1578a0294c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:49.561588 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-787bc9f9-7fbf-4828-b5f7-f184772dee95 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Network d106428f-76a7-4c86-a11f-c78b209d6ebb is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:45:49.571257 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-787bc9f9-7fbf-4828-b5f7-f184772dee95 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:49.575097 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:49.596254 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-787bc9f9-7fbf-4828-b5f7-f184772dee95 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:45:49.629315 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9106b023-4f08-4c68-b6f8-f1578a0294c4 None None] Network a81206fa-c68b-4c06-a3d7-51eb9171c151 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:45:49.646500 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event deleted for resources: {'Subnet': ['ID=8591cb50-17ac-4b1d-9e7b-0029b786897c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:49.652304 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-9106b023-4f08-4c68-b6f8-f1578a0294c4 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:49.658021 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9106b023-4f08-4c68-b6f8-f1578a0294c4 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:45:49.665521 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9106b023-4f08-4c68-b6f8-f1578a0294c4 None None] Pushing event updated for resources: {'Port': ['ID=598dabb8-a70f-482e-9381-7c5b1ffac5bf,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:49.690758 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-787bc9f9-7fbf-4828-b5f7-f184772dee95 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:49.692146 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-787bc9f9-7fbf-4828-b5f7-f184772dee95 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:49.708769 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-787bc9f9-7fbf-4828-b5f7-f184772dee95 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Pushing event updated for resources: {'Port': ['ID=b0d2998b-ab57-46de-85f9-5eb58bc92caf,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:49.737092 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-787bc9f9-7fbf-4828-b5f7-f184772dee95 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 922 time: 1.2718642 Dec 09 21:45:49.744737 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41650) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:49.765624 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-04ddeab5-5b85-4583-bfe2-af223cd5346e tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Request body: {'router': {'name': 'tempest-TagsExtTest-router-707154108', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:49.842202 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-04ddeab5-5b85-4583-bfe2-af223cd5346e tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:49.843145 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-04ddeab5-5b85-4583-bfe2-af223cd5346e tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:49.854145 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-9106b023-4f08-4c68-b6f8-f1578a0294c4 None None] Attempting to bind port 598dabb8-a70f-482e-9381-7c5b1ffac5bf on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:45:49.856421 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-9106b023-4f08-4c68-b6f8-f1578a0294c4 None None] Attempting to bind port 598dabb8-a70f-482e-9381-7c5b1ffac5bf by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '1890281f-8836-465f-9d8d-dd209e9b9fcf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'a81206fa-c68b-4c06-a3d7-51eb9171c151'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:45:49.858401 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9106b023-4f08-4c68-b6f8-f1578a0294c4 None None] Attempting to bind port 598dabb8-a70f-482e-9381-7c5b1ffac5bf on network a81206fa-c68b-4c06-a3d7-51eb9171c151 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:45:49.874532 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9106b023-4f08-4c68-b6f8-f1578a0294c4 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 45, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:45:49.876045 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:49.878210 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9106b023-4f08-4c68-b6f8-f1578a0294c4 None None] Checking segment: {'id': '1890281f-8836-465f-9d8d-dd209e9b9fcf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'a81206fa-c68b-4c06-a3d7-51eb9171c151'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:45:49.878658 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9106b023-4f08-4c68-b6f8-f1578a0294c4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:49.879091 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9106b023-4f08-4c68-b6f8-f1578a0294c4 None None] Bound using segment: {'id': '1890281f-8836-465f-9d8d-dd209e9b9fcf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'a81206fa-c68b-4c06-a3d7-51eb9171c151'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:45:49.879615 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-9106b023-4f08-4c68-b6f8-f1578a0294c4 None None] Bound port: 598dabb8-a70f-482e-9381-7c5b1ffac5bf, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1890281f-8836-465f-9d8d-dd209e9b9fcf', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': 'a81206fa-c68b-4c06-a3d7-51eb9171c151'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:45:49.880052 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9106b023-4f08-4c68-b6f8-f1578a0294c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:49.913131 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a81206fa-c68b-4c06-a3d7-51eb9171c151']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:49.923472 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1890281f-8836-465f-9d8d-dd209e9b9fcf') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:49.927866 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1890281f-8836-465f-9d8d-dd209e9b9fcf') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:49.946847 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:49.964597 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-04ddeab5-5b85-4583-bfe2-af223cd5346e tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:49.966354 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:49.970224 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-04ddeab5-5b85-4583-bfe2-af223cd5346e tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:49.993362 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Releasing vlan 137 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:45:49.994468 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:45:50.004043 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:45:50.057775 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-04ddeab5-5b85-4583-bfe2-af223cd5346e tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:50.065180 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-04ddeab5-5b85-4583-bfe2-af223cd5346e tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.3186023 Dec 09 21:45:50.066134 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41652) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:50.071701 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-4d96cdd2-7406-4329-8a8e-a1c1c3f33e5e tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Request body: {'subnetpool': {'name': 'tempest-TagsExtTest-Subnetpool-2057972674', 'prefixes': ['172.20.0.0/16']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:50.083093 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-9106b023-4f08-4c68-b6f8-f1578a0294c4 None None] For port 598dabb8-a70f-482e-9381-7c5b1ffac5bf, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:45:50.129944 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-9106b023-4f08-4c68-b6f8-f1578a0294c4 None None] For port 598dabb8-a70f-482e-9381-7c5b1ffac5bf, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=598dabb8-a70f-482e-9381-7c5b1ffac5bf,segment=NetworkSegment(1890281f-8836-465f-9d8d-dd209e9b9fcf),segment_id=1890281f-8836-465f-9d8d-dd209e9b9fcf)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:45:50.139184 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9106b023-4f08-4c68-b6f8-f1578a0294c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:50.145511 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.db.api [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1451, 'Cannot delete or update a parent row: a foreign key constraint fails (`neutron`.`ports`, CONSTRAINT `ports_ibfk_1` FOREIGN KEY (`network_id`) REFERENCES `networks` (`id`))') Dec 09 21:45:50.145511 n-d-713301-27 neutron-server[103437]: [SQL: DELETE FROM networks WHERE networks.id = %(id)s] Dec 09 21:45:50.145511 n-d-713301-27 neutron-server[103437]: [parameters: {'id': 'a81206fa-c68b-4c06-a3d7-51eb9171c151'}] Dec 09 21:45:50.145511 n-d-713301-27 neutron-server[103437]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=103437) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:45:50.146002 n-d-713301-27 neutron-server[103437]: DEBUG oslo_db.api [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Performing DB retry for function neutron.db.db_base_plugin_v2.NeutronDbPluginV2.delete_network {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:45:50.187024 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4d96cdd2-7406-4329-8a8e-a1c1c3f33e5e tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks [] for subnetpool, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:50.192713 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41654) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:50.197494 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-55ff40dd-aa87-4682-8b3a-f81b6ad8765f tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnets', '0f02725a-b828-4d3a-8d7c-533730ba8790', 'tempest-TagsExtTest-Tag-92837965') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:50.198716 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4d96cdd2-7406-4329-8a8e-a1c1c3f33e5e tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 748 time: 0.1320298 Dec 09 21:45:50.308308 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9106b023-4f08-4c68-b6f8-f1578a0294c4 None None] Pushing event updated for resources: {'Port': ['ID=598dabb8-a70f-482e-9381-7c5b1ffac5bf,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:50.328541 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f3099baf-f031-4b38-98d5-7f71a28390a9 None None] Network a81206fa-c68b-4c06-a3d7-51eb9171c151 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:45:50.391670 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-55ff40dd-aa87-4682-8b3a-f81b6ad8765f tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "PUT /v2.0/subnets/0f02725a-b828-4d3a-8d7c-533730ba8790/tags/tempest-TagsExtTest-Tag-92837965 HTTP/1.1" status: 201 len: 201 time: 0.1977386 Dec 09 21:45:50.396338 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41658) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:50.411008 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-6b2ea6da-ba1e-4989-8ea0-7cfa6dd4dcb3 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'ports', 'b0d2998b-ab57-46de-85f9-5eb58bc92caf', 'tempest-TagsExtTest-Tag-1570475113') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:50.554296 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6b2ea6da-ba1e-4989-8ea0-7cfa6dd4dcb3 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "PUT /v2.0/ports/b0d2998b-ab57-46de-85f9-5eb58bc92caf/tags/tempest-TagsExtTest-Tag-1570475113 HTTP/1.1" status: 201 len: 201 time: 0.1563039 Dec 09 21:45:50.557254 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41660) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:50.569440 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-aecb2688-42a4-4c6b-bbc1-a5641244dc9f tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'routers', '8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6', 'tempest-TagsExtTest-Tag-1808323300') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:50.671753 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:50.755851 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-aecb2688-42a4-4c6b-bbc1-a5641244dc9f tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "PUT /v2.0/routers/8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6/tags/tempest-TagsExtTest-Tag-1808323300 HTTP/1.1" status: 201 len: 201 time: 0.1962416 Dec 09 21:45:50.761698 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41664) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:50.775880 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:45:50.782573 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-fc30f4c9-b832-469a-a5b4-885eec841699 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnetpools', '22578a16-55fa-4512-a84e-a661819b909f', 'tempest-TagsExtTest-Tag-439408675') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:50.842971 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Deleting port 598dabb8-a70f-482e-9381-7c5b1ffac5bf {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:45:50.843503 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:50.929334 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:50.929749 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:50.939118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41666) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:50.944282 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-fad43a36-03f6-4b12-a253-98249f3b7214 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnets', '0f02725a-b828-4d3a-8d7c-533730ba8790') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:50.948606 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fc30f4c9-b832-469a-a5b4-885eec841699 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "PUT /v2.0/subnetpools/22578a16-55fa-4512-a84e-a661819b909f/tags/tempest-TagsExtTest-Tag-439408675 HTTP/1.1" status: 201 len: 201 time: 0.1809006 Dec 09 21:45:50.986671 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-736fb856-b856-4c59-8c93-91ce3f1e3ad0 None None] Network d106428f-76a7-4c86-a11f-c78b209d6ebb requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:45:50.995821 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] For port 598dabb8-a70f-482e-9381-7c5b1ffac5bf, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=598dabb8-a70f-482e-9381-7c5b1ffac5bf,segment=NetworkSegment(1890281f-8836-465f-9d8d-dd209e9b9fcf),segment_id=1890281f-8836-465f-9d8d-dd209e9b9fcf)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:50.996219 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:51.028225 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Calling delete_port for 598dabb8-a70f-482e-9381-7c5b1ffac5bf owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:45:51.115964 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fad43a36-03f6-4b12-a253-98249f3b7214 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/subnets/0f02725a-b828-4d3a-8d7c-533730ba8790/tags HTTP/1.1" status: 200 len: 239 time: 0.1745048 Dec 09 21:45:51.117628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41668) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:51.129964 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-74137ac9-5d38-40e4-9151-07c1fe8bae9a tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '0f02725a-b828-4d3a-8d7c-533730ba8790', 'tempest-TagsExtTest-Tag-92837965') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:51.149045 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:51.162815 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a61b287f-1c54-41de-9d6e-6294a1779ecc None None] Provisioning complete for port 5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:51.163848 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a61b287f-1c54-41de-9d6e-6294a1779ecc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:51.176105 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:51.211127 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event deleted for resources: {'Port': ['ID=598dabb8-a70f-482e-9381-7c5b1ffac5bf,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:51.213197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] No DVR routers for this DVR port 598dabb8-a70f-482e-9381-7c5b1ffac5bf on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:45:51.238353 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c,segment=NetworkSegment(f6eb7049-4269-46e5-b25e-f984e46ce81b),segment_id=f6eb7049-4269-46e5-b25e-f984e46ce81b)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:51.249969 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:51.288663 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-74137ac9-5d38-40e4-9151-07c1fe8bae9a tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/subnets/0f02725a-b828-4d3a-8d7c-533730ba8790/tags/tempest-TagsExtTest-Tag-92837965 HTTP/1.1" status: 204 len: 168 time: 0.1697540 Dec 09 21:45:51.305124 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:51.310486 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41670) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:51.329243 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a81206fa-c68b-4c06-a3d7-51eb9171c151']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:51.339858 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-9571d940-c8dc-4d20-8c12-58fff28d1851 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'subnets', '0f02725a-b828-4d3a-8d7c-533730ba8790', 'tempest-TagsExtTest-Tag-92837965') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:51.342060 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:51.353429 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1890281f-8836-465f-9d8d-dd209e9b9fcf') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:51.355426 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1890281f-8836-465f-9d8d-dd209e9b9fcf') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:51.379126 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:51.396616 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:51.405726 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Releasing vlan 137 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:45:51.406469 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:45:51.410027 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:45:51.489776 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:51.501742 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:51.512083 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "DELETE /v2.0/networks/a81206fa-c68b-4c06-a3d7-51eb9171c151 HTTP/1.1" status: 204 len: 168 time: 2.7632711 Dec 09 21:45:51.512336 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41674) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:51.533127 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-911fdb9c-9d58-43ac-a50f-2a0c54e19c75 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event deleted for resources: {'Network': ['ID=a81206fa-c68b-4c06-a3d7-51eb9171c151,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:51.582890 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-c7c6aefb-6d83-4e8f-ae26-189eccd1c71f tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] DELETE failed (client error): The resource could not be found. Dec 09 21:45:51.583667 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c7c6aefb-6d83-4e8f-ae26-189eccd1c71f tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:45:51.589254 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c7c6aefb-6d83-4e8f-ae26-189eccd1c71f tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "DELETE /v2.0/subnets/8591cb50-17ac-4b1d-9e7b-0029b786897c HTTP/1.1" status: 404 len: 337 time: 0.0736523 Dec 09 21:45:51.589743 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41676) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:51.602234 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9571d940-c8dc-4d20-8c12-58fff28d1851 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "DELETE /v2.0/subnets/0f02725a-b828-4d3a-8d7c-533730ba8790/tags/tempest-TagsExtTest-Tag-92837965 HTTP/1.1" status: 204 len: 168 time: 0.2776258 Dec 09 21:45:51.604379 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41678) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:51.615058 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-a0c28c1d-b5ea-4492-8c00-885c19cbd351 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnets', '0f02725a-b828-4d3a-8d7c-533730ba8790') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:51.626592 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-60c85d1c-c237-409f-a0c6-a3c84636e13b tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] DELETE failed (client error): The resource could not be found. Dec 09 21:45:51.627245 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-60c85d1c-c237-409f-a0c6-a3c84636e13b tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:45:51.649649 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41680) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:51.651598 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-60c85d1c-c237-409f-a0c6-a3c84636e13b tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "DELETE /v2.0/networks/a81206fa-c68b-4c06-a3d7-51eb9171c151 HTTP/1.1" status: 404 len: 339 time: 0.0527725 Dec 09 21:45:51.690967 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-56fe130e-295e-40e5-843c-cc0bd494811c tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] DELETE failed (client error): The resource could not be found. Dec 09 21:45:51.691541 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-56fe130e-295e-40e5-843c-cc0bd494811c tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:45:51.697066 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-56fe130e-295e-40e5-843c-cc0bd494811c tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "DELETE /v2.0/subnets/5560197f-9629-45ad-8b53-363996720994 HTTP/1.1" status: 404 len: 337 time: 0.0423970 Dec 09 21:45:51.697869 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41682) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:51.719376 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2c532363-16b2-47f3-9241-69f4823d0d5e None None] Provisioning complete for port 5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:51.720055 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2c532363-16b2-47f3-9241-69f4823d0d5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:51.747889 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-59a1c32d-5d3a-42b3-a524-6af98e9c82b9 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] DELETE failed (client error): The resource could not be found. Dec 09 21:45:51.752371 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-59a1c32d-5d3a-42b3-a524-6af98e9c82b9 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:45:51.758154 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-59a1c32d-5d3a-42b3-a524-6af98e9c82b9 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "DELETE /v2.0/networks/cf3e945b-44f7-4169-ab37-e051cf797ef4 HTTP/1.1" status: 404 len: 339 time: 0.0570755 Dec 09 21:45:51.758850 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41684) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:51.810905 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-9faefcb0-a38a-4968-ad93-1b0902ecb0a4 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] DELETE failed (client error): The resource could not be found. Dec 09 21:45:51.811369 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-9faefcb0-a38a-4968-ad93-1b0902ecb0a4 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:45:51.817884 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9faefcb0-a38a-4968-ad93-1b0902ecb0a4 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "DELETE /v2.0/subnets/25d4ba64-29e5-4fb2-af6e-cf3e5352309e HTTP/1.1" status: 404 len: 337 time: 0.0546417 Dec 09 21:45:51.827464 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41688) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:51.827783 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a0c28c1d-b5ea-4492-8c00-885c19cbd351 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/subnets/0f02725a-b828-4d3a-8d7c-533730ba8790/tags HTTP/1.1" status: 200 len: 205 time: 0.2186813 Dec 09 21:45:51.833348 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41690) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:51.845612 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-e529aafa-7356-467e-b751-e5d2d6b0b844 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'ports', 'b0d2998b-ab57-46de-85f9-5eb58bc92caf') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:51.894398 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2c532363-16b2-47f3-9241-69f4823d0d5e None None] Provisioning complete for port b0d2998b-ab57-46de-85f9-5eb58bc92caf triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:51.895338 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2c532363-16b2-47f3-9241-69f4823d0d5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:52.076646 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e529aafa-7356-467e-b751-e5d2d6b0b844 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/ports/b0d2998b-ab57-46de-85f9-5eb58bc92caf/tags HTTP/1.1" status: 200 len: 241 time: 0.2421341 Dec 09 21:45:52.082818 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41692) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:52.095632 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-64b0ae7c-844f-41e4-b304-cdb59876a6ea tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', 'b0d2998b-ab57-46de-85f9-5eb58bc92caf', 'tempest-TagsExtTest-Tag-1570475113') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:52.147483 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-56d7eae2-67b4-4d75-89a6-ebdf0a6c695f None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 21:45:52.166495 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-2c532363-16b2-47f3-9241-69f4823d0d5e None None] Port b0d2998b-ab57-46de-85f9-5eb58bc92caf cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:45:52.198648 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-64b0ae7c-844f-41e4-b304-cdb59876a6ea tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/ports/b0d2998b-ab57-46de-85f9-5eb58bc92caf/tags/tempest-TagsExtTest-Tag-1570475113 HTTP/1.1" status: 204 len: 168 time: 0.1079209 Dec 09 21:45:52.202178 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41694) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:52.215214 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-935945f8-13a2-4121-9c41-cb3d677caba0 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'ports', 'b0d2998b-ab57-46de-85f9-5eb58bc92caf', 'tempest-TagsExtTest-Tag-1570475113') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:52.276154 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-18623947-cf45-4230-875b-b7769899ab68 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] DELETE failed (client error): The resource could not be found. Dec 09 21:45:52.276789 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-18623947-cf45-4230-875b-b7769899ab68 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:45:52.281222 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-18623947-cf45-4230-875b-b7769899ab68 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "DELETE /v2.0/networks/f3ee7f4b-1328-4e31-a564-e7632dca2d8b HTTP/1.1" status: 404 len: 339 time: 0.4582477 Dec 09 21:45:52.284350 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41696) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:52.302371 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56d7eae2-67b4-4d75-89a6-ebdf0a6c695f None None] Resources bound (agent type, host, resource id): {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 09 21:45:52.306185 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-0bb47cd3-a84a-45d6-b2ba-580aee318ac5 None None] Provisioning complete for port b0d2998b-ab57-46de-85f9-5eb58bc92caf triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:52.306556 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0bb47cd3-a84a-45d6-b2ba-580aee318ac5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:52.421149 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-935945f8-13a2-4121-9c41-cb3d677caba0 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "DELETE /v2.0/ports/b0d2998b-ab57-46de-85f9-5eb58bc92caf/tags/tempest-TagsExtTest-Tag-1570475113 HTTP/1.1" status: 204 len: 168 time: 0.2176480 Dec 09 21:45:52.421305 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41700) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:52.427340 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-be620022-0c04-4261-b0e1-6513d7b8de32 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'ports', 'b0d2998b-ab57-46de-85f9-5eb58bc92caf') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:52.442271 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-0bb47cd3-a84a-45d6-b2ba-580aee318ac5 None None] Port b0d2998b-ab57-46de-85f9-5eb58bc92caf cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:45:52.483623 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-fa8f210d-f5b6-47c8-b584-815678ef5d1e tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Deleting port 9ef68f8a-a9ba-47e3-a864-1228c3872594 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:45:52.484247 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fa8f210d-f5b6-47c8-b584-815678ef5d1e tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:52.562376 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-be620022-0c04-4261-b0e1-6513d7b8de32 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/ports/b0d2998b-ab57-46de-85f9-5eb58bc92caf/tags HTTP/1.1" status: 200 len: 205 time: 0.1375422 Dec 09 21:45:52.566486 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41704) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:52.585754 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-052f40ae-53cd-46ed-9e19-a3d596a1fd34 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'routers', '8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:52.752934 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fa8f210d-f5b6-47c8-b584-815678ef5d1e tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:52.762378 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:45:52.787191 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-fa8f210d-f5b6-47c8-b584-815678ef5d1e tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Calling delete_port for 9ef68f8a-a9ba-47e3-a864-1228c3872594 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:45:52.852154 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-052f40ae-53cd-46ed-9e19-a3d596a1fd34 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/routers/8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6/tags HTTP/1.1" status: 200 len: 241 time: 0.2809331 Dec 09 21:45:52.856516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41712) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:52.877601 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-3ad89e31-6344-4fa0-a9eb-8ffee1b88c47 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', '8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6', 'tempest-TagsExtTest-Tag-1808323300') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:52.914910 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:45:52.917153 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:52.940397 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a3f7583-859f-4865-b73d-fcb7e63cc9a3 req-c3b54adc-abb8-4e77-92e2-61f682358454 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:52.948342 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a3f7583-859f-4865-b73d-fcb7e63cc9a3 req-c3b54adc-abb8-4e77-92e2-61f682358454 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ccb431db-4fc5-4654-a429-b211aed4747e HTTP/1.1" status: 200 len: 945 time: 0.1286249 Dec 09 21:45:53.059106 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a3f7583-859f-4865-b73d-fcb7e63cc9a3 req-c9fd742d-eef5-4097-8742-b7ab3a9176e1 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1097689 Dec 09 21:45:53.088706 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fa8f210d-f5b6-47c8-b584-815678ef5d1e tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:53.116373 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3ad89e31-6344-4fa0-a9eb-8ffee1b88c47 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/routers/8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6/tags/tempest-TagsExtTest-Tag-1808323300 HTTP/1.1" status: 204 len: 168 time: 0.2503746 Dec 09 21:45:53.116754 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41714) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:53.121669 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-766a8d87-72ee-4d5b-b743-81796079cd19 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'routers', '8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6', 'tempest-TagsExtTest-Tag-1808323300') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:53.131125 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa8f210d-f5b6-47c8-b584-815678ef5d1e tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event deleted for resources: {'Port': ['ID=9ef68f8a-a9ba-47e3-a864-1228c3872594,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:53.138999 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fa8f210d-f5b6-47c8-b584-815678ef5d1e tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:53.146421 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fa8f210d-f5b6-47c8-b584-815678ef5d1e tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "DELETE /v2.0/ports/9ef68f8a-a9ba-47e3-a864-1228c3872594 HTTP/1.1" status: 204 len: 168 time: 0.8587496 Dec 09 21:45:53.147190 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41716) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:53.178948 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-28931c0d-f156-4910-a689-904ce2dbbeca tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] DELETE failed (client error): The resource could not be found. Dec 09 21:45:53.179604 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-28931c0d-f156-4910-a689-904ce2dbbeca tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:45:53.183019 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-28931c0d-f156-4910-a689-904ce2dbbeca tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "DELETE /v2.0/subnets/309167aa-739a-455e-a791-96b75e8ab77b HTTP/1.1" status: 404 len: 337 time: 0.0352507 Dec 09 21:45:53.186119 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41718) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:53.251480 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-766a8d87-72ee-4d5b-b743-81796079cd19 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "DELETE /v2.0/routers/8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6/tags/tempest-TagsExtTest-Tag-1808323300 HTTP/1.1" status: 204 len: 168 time: 0.1307504 Dec 09 21:45:53.251763 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41720) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:53.258206 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-a0198bdc-79f9-4af6-b42b-ea0ca88bb2f2 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'routers', '8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:53.297857 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-19d2c5fc-f42b-46cb-a218-960d17dbed36 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:53.365584 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a0198bdc-79f9-4af6-b42b-ea0ca88bb2f2 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/routers/8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6/tags HTTP/1.1" status: 200 len: 205 time: 0.1121423 Dec 09 21:45:53.368040 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41722) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:53.371866 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-49e529ba-665c-43c3-8cfa-4b39b62c7a2c tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnetpools', '22578a16-55fa-4512-a84e-a661819b909f') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:53.408750 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-49e529ba-665c-43c3-8cfa-4b39b62c7a2c tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/subnetpools/22578a16-55fa-4512-a84e-a661819b909f/tags HTTP/1.1" status: 200 len: 240 time: 0.0399981 Dec 09 21:45:53.411205 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41724) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:53.415699 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-1075135b-c1a9-4619-8391-11a905bb2661 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '22578a16-55fa-4512-a84e-a661819b909f', 'tempest-TagsExtTest-Tag-439408675') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:53.432098 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-19d2c5fc-f42b-46cb-a218-960d17dbed36 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:53.459882 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1075135b-c1a9-4619-8391-11a905bb2661 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/subnetpools/22578a16-55fa-4512-a84e-a661819b909f/tags/tempest-TagsExtTest-Tag-439408675 HTTP/1.1" status: 204 len: 168 time: 0.0475595 Dec 09 21:45:53.462341 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41726) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:53.467306 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-e8b84684-b37a-48d2-bf0a-0c7e47a90030 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tag called with arguments (, 'subnetpools', '22578a16-55fa-4512-a84e-a661819b909f', 'tempest-TagsExtTest-Tag-439408675') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:53.470503 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-19d2c5fc-f42b-46cb-a218-960d17dbed36 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4dc01507-bbc2-4a6a-a304-6a037829f30d']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:53.497123 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-19d2c5fc-f42b-46cb-a218-960d17dbed36 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c427fdc2-fea7-4eae-b97f-26210fbea2f1') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:53.498110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-19d2c5fc-f42b-46cb-a218-960d17dbed36 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c427fdc2-fea7-4eae-b97f-26210fbea2f1') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:53.516299 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-19d2c5fc-f42b-46cb-a218-960d17dbed36 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:53.548749 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e8b84684-b37a-48d2-bf0a-0c7e47a90030 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "DELETE /v2.0/subnetpools/22578a16-55fa-4512-a84e-a661819b909f/tags/tempest-TagsExtTest-Tag-439408675 HTTP/1.1" status: 204 len: 168 time: 0.0851753 Dec 09 21:45:53.549695 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-19d2c5fc-f42b-46cb-a218-960d17dbed36 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:53.555181 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41728) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:53.561035 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-19d2c5fc-f42b-46cb-a218-960d17dbed36 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Releasing vlan 113 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:45:53.561507 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-19d2c5fc-f42b-46cb-a218-960d17dbed36 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:45:53.565859 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:45:53.584610 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-e451b003-3584-4c7e-979f-a85105085ce7 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method get_tags called with arguments (, 'subnetpools', '22578a16-55fa-4512-a84e-a661819b909f') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:53.638737 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e451b003-3584-4c7e-979f-a85105085ce7 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/subnetpools/22578a16-55fa-4512-a84e-a661819b909f/tags HTTP/1.1" status: 200 len: 205 time: 0.0739169 Dec 09 21:45:53.641553 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41730) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:53.647183 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-19d2c5fc-f42b-46cb-a218-960d17dbed36 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:53.652685 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-f63a0820-24d8-45b2-b45c-e651a7cddf97 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', '22578a16-55fa-4512-a84e-a661819b909f') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:53.655334 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-19d2c5fc-f42b-46cb-a218-960d17dbed36 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:53.662162 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-19d2c5fc-f42b-46cb-a218-960d17dbed36 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "DELETE /v2.0/networks/4dc01507-bbc2-4a6a-a304-6a037829f30d HTTP/1.1" status: 204 len: 168 time: 0.4747915 Dec 09 21:45:53.664083 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41732) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:53.684762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19d2c5fc-f42b-46cb-a218-960d17dbed36 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event deleted for resources: {'Network': ['ID=4dc01507-bbc2-4a6a-a304-6a037829f30d,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:53.708775 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f63a0820-24d8-45b2-b45c-e651a7cddf97 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "DELETE /v2.0/subnetpools/22578a16-55fa-4512-a84e-a661819b909f/tags HTTP/1.1" status: 204 len: 168 time: 0.0654495 Dec 09 21:45:53.710715 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41734) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:53.717366 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-f954ba1c-4473-4bd3-a49a-7007faab8e03 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', '8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:53.840567 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f954ba1c-4473-4bd3-a49a-7007faab8e03 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "DELETE /v2.0/routers/8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6/tags HTTP/1.1" status: 204 len: 168 time: 0.1286302 Dec 09 21:45:53.842857 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41736) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:53.847215 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-cbced23c-1395-44aa-a3cf-edacd5f4d087 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', 'b0d2998b-ab57-46de-85f9-5eb58bc92caf') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:53.892593 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-d0bac924-4ea1-4014-863b-bef7f56fa7fc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Deleting port f453470a-9612-4ee9-b8eb-2d13bb04d3d7 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:45:53.892966 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d0bac924-4ea1-4014-863b-bef7f56fa7fc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:53.965763 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d0bac924-4ea1-4014-863b-bef7f56fa7fc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:53.982336 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-d0bac924-4ea1-4014-863b-bef7f56fa7fc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Calling delete_port for f453470a-9612-4ee9-b8eb-2d13bb04d3d7 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:45:53.986096 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cbced23c-1395-44aa-a3cf-edacd5f4d087 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "DELETE /v2.0/ports/b0d2998b-ab57-46de-85f9-5eb58bc92caf/tags HTTP/1.1" status: 204 len: 168 time: 0.1422861 Dec 09 21:45:53.989086 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41740) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:53.993472 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-f8275ccb-2441-4006-8a24-df20343abdd1 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', '0f02725a-b828-4d3a-8d7c-533730ba8790') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:54.156064 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f8275ccb-2441-4006-8a24-df20343abdd1 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "DELETE /v2.0/subnets/0f02725a-b828-4d3a-8d7c-533730ba8790/tags HTTP/1.1" status: 204 len: 168 time: 0.1658404 Dec 09 21:45:54.158084 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41744) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:54.164743 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-7231dad2-d797-447c-8716-76eea0e4c50f tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnets', '0f02725a-b828-4d3a-8d7c-533730ba8790', 'tempest-TagsExtTest-Tag-1241836456') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:54.172046 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d0bac924-4ea1-4014-863b-bef7f56fa7fc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:54.204039 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0bac924-4ea1-4014-863b-bef7f56fa7fc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event deleted for resources: {'Port': ['ID=f453470a-9612-4ee9-b8eb-2d13bb04d3d7,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:54.212767 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d0bac924-4ea1-4014-863b-bef7f56fa7fc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:54.216049 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d0bac924-4ea1-4014-863b-bef7f56fa7fc tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "DELETE /v2.0/ports/f453470a-9612-4ee9-b8eb-2d13bb04d3d7 HTTP/1.1" status: 204 len: 168 time: 0.5508614 Dec 09 21:45:54.218843 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41746) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:54.229083 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47c07367-1c1a-48c0-9c7a-22fbc379023c req-badb826e-54f7-4608-b4fc-712d449f1dd0 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:54.230584 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-47c07367-1c1a-48c0-9c7a-22fbc379023c req-badb826e-54f7-4608-b4fc-712d449f1dd0 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ccb431db-4fc5-4654-a429-b211aed4747e HTTP/1.1" status: 200 len: 945 time: 0.0899248 Dec 09 21:45:54.275961 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-4a2afe4f-c016-49dc-a3ba-911b6c35497d tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] DELETE failed (client error): The resource could not be found. Dec 09 21:45:54.276709 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4a2afe4f-c016-49dc-a3ba-911b6c35497d tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:45:54.280043 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4a2afe4f-c016-49dc-a3ba-911b6c35497d tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "DELETE /v2.0/subnets/a09f08f6-5e24-4ccc-9482-c7b6ff0d88ae HTTP/1.1" status: 404 len: 337 time: 0.0599604 Dec 09 21:45:54.282907 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41748) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:54.292208 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-47c07367-1c1a-48c0-9c7a-22fbc379023c req-a6a4da59-6131-4a76-a20e-3c4afb8014a1 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0552506 Dec 09 21:45:54.323561 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7231dad2-d797-447c-8716-76eea0e4c50f tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "PUT /v2.0/subnets/0f02725a-b828-4d3a-8d7c-533730ba8790/tags/tempest-TagsExtTest-Tag-1241836456 HTTP/1.1" status: 201 len: 201 time: 0.1616635 Dec 09 21:45:54.323944 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41750) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:54.328831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-63c37f0a-3d04-475b-8e2b-e1f9100c8af8 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'ports', 'b0d2998b-ab57-46de-85f9-5eb58bc92caf', 'tempest-TagsExtTest-Tag-700013475') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:54.401780 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-51a6140f-5584-439a-93d0-916dc3e10f88 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:54.408260 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-63c37f0a-3d04-475b-8e2b-e1f9100c8af8 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "PUT /v2.0/ports/b0d2998b-ab57-46de-85f9-5eb58bc92caf/tags/tempest-TagsExtTest-Tag-700013475 HTTP/1.1" status: 201 len: 201 time: 0.0829363 Dec 09 21:45:54.410795 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41752) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:54.417072 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-f3edc4d6-eb71-43b0-9db2-4d2c623004c6 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'routers', '8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6', 'tempest-TagsExtTest-Tag-1850657243') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:54.590690 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-51a6140f-5584-439a-93d0-916dc3e10f88 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:54.629147 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaad05e9-77d2-4f5c-a254-7669b16134a1 req-68019964-0d62-43a3-90a2-d11a62b7e764 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:54.630638 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aaad05e9-77d2-4f5c-a254-7669b16134a1 req-68019964-0d62-43a3-90a2-d11a62b7e764 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.31 "GET /v2.0/ports?device_id=ccb431db-4fc5-4654-a429-b211aed4747e HTTP/1.1" status: 200 len: 945 time: 0.1793063 Dec 09 21:45:54.633143 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-51a6140f-5584-439a-93d0-916dc3e10f88 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8ee32184-191c-4d61-8a45-fe1df399820b']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:54.644277 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f3edc4d6-eb71-43b0-9db2-4d2c623004c6 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "PUT /v2.0/routers/8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6/tags/tempest-TagsExtTest-Tag-1850657243 HTTP/1.1" status: 201 len: 201 time: 0.2289526 Dec 09 21:45:54.645172 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41754) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:54.650516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-2b03ba48-b479-4c88-8d75-8340ae4f3f31 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method update_tag called with arguments (, 'subnetpools', '22578a16-55fa-4512-a84e-a661819b909f', 'tempest-TagsExtTest-Tag-1143877313') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:54.661066 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-51a6140f-5584-439a-93d0-916dc3e10f88 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1cbf9de2-c8d5-4f8f-8498-d76d485fc406') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:54.661066 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-51a6140f-5584-439a-93d0-916dc3e10f88 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1cbf9de2-c8d5-4f8f-8498-d76d485fc406') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:54.697403 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-51a6140f-5584-439a-93d0-916dc3e10f88 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:54.739677 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-51a6140f-5584-439a-93d0-916dc3e10f88 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:54.751299 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-51a6140f-5584-439a-93d0-916dc3e10f88 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Releasing vlan 101 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:45:54.751724 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-51a6140f-5584-439a-93d0-916dc3e10f88 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:45:54.755369 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:45:54.823460 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2b03ba48-b479-4c88-8d75-8340ae4f3f31 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "PUT /v2.0/subnetpools/22578a16-55fa-4512-a84e-a661819b909f/tags/tempest-TagsExtTest-Tag-1143877313 HTTP/1.1" status: 201 len: 201 time: 0.1755869 Dec 09 21:45:54.825130 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41758) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:54.829997 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-8978433d-fe4f-47f8-88ff-3e9d27616a58 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'subnets', '0f02725a-b828-4d3a-8d7c-533730ba8790', {'tags': ['tempest-TagsExtTest-Tag-386757239', 'tempest-TagsExtTest-Tag-1098531046', 'tempest-TagsExtTest-Tag-1072028070']}) {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:54.842070 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-51a6140f-5584-439a-93d0-916dc3e10f88 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:54.852455 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-51a6140f-5584-439a-93d0-916dc3e10f88 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:54.856330 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-51a6140f-5584-439a-93d0-916dc3e10f88 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "DELETE /v2.0/networks/8ee32184-191c-4d61-8a45-fe1df399820b HTTP/1.1" status: 204 len: 168 time: 0.5721760 Dec 09 21:45:54.860172 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41760) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:54.870401 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51a6140f-5584-439a-93d0-916dc3e10f88 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event deleted for resources: {'Network': ['ID=8ee32184-191c-4d61-8a45-fe1df399820b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:54.880821 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-aaad05e9-77d2-4f5c-a254-7669b16134a1 req-59ac30f4-787e-4dd3-9116-4c81409e2cd9 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Deleting port 31ee9adf-4bac-4e32-9223-f4e594f0639e {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:45:54.881178 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-aaad05e9-77d2-4f5c-a254-7669b16134a1 req-59ac30f4-787e-4dd3-9116-4c81409e2cd9 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:54.943297 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-840364d2-5d46-49cd-b583-a73551310b39 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Deleting subnet 958df35e-02bf-42ce-80e8-a06458132386 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:45:54.949784 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-840364d2-5d46-49cd-b583-a73551310b39 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:54.975520 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8978433d-fe4f-47f8-88ff-3e9d27616a58 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "PUT /v2.0/subnets/0f02725a-b828-4d3a-8d7c-533730ba8790/tags HTTP/1.1" status: 200 len: 317 time: 0.1491463 Dec 09 21:45:54.979708 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41764) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:54.991632 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-1e6da9fa-b69a-48f5-82c4-852817a16137 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', '0f02725a-b828-4d3a-8d7c-533730ba8790') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:55.025308 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-aaad05e9-77d2-4f5c-a254-7669b16134a1 req-59ac30f4-787e-4dd3-9116-4c81409e2cd9 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] For port 31ee9adf-4bac-4e32-9223-f4e594f0639e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=31ee9adf-4bac-4e32-9223-f4e594f0639e,segment=NetworkSegment(0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5),segment_id=0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:55.025805 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-aaad05e9-77d2-4f5c-a254-7669b16134a1 req-59ac30f4-787e-4dd3-9116-4c81409e2cd9 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:55.048476 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-aaad05e9-77d2-4f5c-a254-7669b16134a1 req-59ac30f4-787e-4dd3-9116-4c81409e2cd9 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Calling delete_port for 31ee9adf-4bac-4e32-9223-f4e594f0639e owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:45:55.206161 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-aaad05e9-77d2-4f5c-a254-7669b16134a1 req-59ac30f4-787e-4dd3-9116-4c81409e2cd9 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:55.243401 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['33cf4605-a408-4847-9394-fe8acf994c40', 'bd9c1c28-304b-4656-bd19-43407d1b6dc2', '25f69b99-160f-4f73-bc4c-738b6fa17cbd', '31ee9adf-4bac-4e32-9223-f4e594f0639e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:45:55.245422 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59ac30f4-787e-4dd3-9116-4c81409e2cd9 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Pushing event deleted for resources: {'Port': ['ID=31ee9adf-4bac-4e32-9223-f4e594f0639e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:55.299288 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-aaad05e9-77d2-4f5c-a254-7669b16134a1 req-59ac30f4-787e-4dd3-9116-4c81409e2cd9 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] No DVR routers for this DVR port 31ee9adf-4bac-4e32-9223-f4e594f0639e on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:45:55.302261 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-aaad05e9-77d2-4f5c-a254-7669b16134a1 req-59ac30f4-787e-4dd3-9116-4c81409e2cd9 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:55.306155 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-aaad05e9-77d2-4f5c-a254-7669b16134a1 req-59ac30f4-787e-4dd3-9116-4c81409e2cd9 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.31 "DELETE /v2.0/ports/31ee9adf-4bac-4e32-9223-f4e594f0639e HTTP/1.1" status: 204 len: 173 time: 0.6617525 Dec 09 21:45:55.306813 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ccb431db-4fc5-4654-a429-b211aed4747e', 'name': 'network-vif-deleted', 'tag': '31ee9adf-4bac-4e32-9223-f4e594f0639e'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:45:55.309896 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-baab4ce5-98e6-4c77-81df-a1b6626b80d3" -d '{"events": [{"server_uuid": "ccb431db-4fc5-4654-a429-b211aed4747e", "name": "network-vif-deleted", "tag": "31ee9adf-4bac-4e32-9223-f4e594f0639e"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:45:55.317503 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-60c06ac8-64d7-4e1a-8236-768ea5f5f9d4 None None] DHCP port deletion for eda4cb39-afde-43d7-a13b-5227cc6862dd request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:45:55.386341 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:45:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-152b29ea-4f50-4685-85f6-0c892dc8bfd3 x-openstack-request-id: req-152b29ea-4f50-4685-85f6-0c892dc8bfd3 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:45:55.386713 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ccb431db-4fc5-4654-a429-b211aed4747e", "name": "network-vif-deleted", "tag": "31ee9adf-4bac-4e32-9223-f4e594f0639e", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:45:55.387058 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-152b29ea-4f50-4685-85f6-0c892dc8bfd3 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:45:55.388171 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ccb431db-4fc5-4654-a429-b211aed4747e', 'name': 'network-vif-deleted', 'tag': '31ee9adf-4bac-4e32-9223-f4e594f0639e', 'status': 'completed', 'code': 200} Dec 09 21:45:55.390979 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-840364d2-5d46-49cd-b583-a73551310b39 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:55.525287 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a0916d5-8d2f-4ae7-8023-686d16bc58c1 req-15e88558-70cf-4799-b2da-01873a8c647a tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ccb431db-4fc5-4654-a429-b211aed4747e HTTP/1.1" status: 200 len: 210 time: 0.0429714 Dec 09 21:45:55.544424 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-840364d2-5d46-49cd-b583-a73551310b39 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:55.590569 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1e6da9fa-b69a-48f5-82c4-852817a16137 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "DELETE /v2.0/subnets/0f02725a-b828-4d3a-8d7c-533730ba8790/tags HTTP/1.1" status: 204 len: 168 time: 0.6097050 Dec 09 21:45:55.593573 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41770) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:55.601134 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-aeb2392a-288f-429d-8d72-476b8f530b40 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '0f02725a-b828-4d3a-8d7c-533730ba8790', 'tempest-TagsExtTest-Tag-386757239') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:55.645352 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-840364d2-5d46-49cd-b583-a73551310b39 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:55.678646 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-840364d2-5d46-49cd-b583-a73551310b39 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event deleted for resources: {'Subnet': ['ID=958df35e-02bf-42ce-80e8-a06458132386,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:55.683403 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-840364d2-5d46-49cd-b583-a73551310b39 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:55.686644 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-840364d2-5d46-49cd-b583-a73551310b39 tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "DELETE /v2.0/subnets/958df35e-02bf-42ce-80e8-a06458132386 HTTP/1.1" status: 204 len: 168 time: 0.8255041 Dec 09 21:45:55.689100 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41772) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:55.696404 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c4a21ca-e659-453e-ae4d-368493d7fae9 None None] Network 86b722dc-adb8-4599-bf9e-8a4aaf4ba7f0 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:45:55.722615 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-aeb2392a-288f-429d-8d72-476b8f530b40 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] show failed (client error): The resource could not be found. Dec 09 21:45:55.723712 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-aeb2392a-288f-429d-8d72-476b8f530b40 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/subnets/0f02725a-b828-4d3a-8d7c-533730ba8790/tags/tempest-TagsExtTest-Tag-386757239 HTTP/1.1" status: 404 len: 328 time: 0.1295037 Dec 09 21:45:55.729808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41774) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:55.734186 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-5df1282b-dc24-49cb-9907-fcf8c53975d0 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '0f02725a-b828-4d3a-8d7c-533730ba8790', 'tempest-TagsExtTest-Tag-1098531046') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:55.814090 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf8f5ed8-e924-492a-a7d2-9f2e7bc9aede tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:55.867957 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-5df1282b-dc24-49cb-9907-fcf8c53975d0 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] show failed (client error): The resource could not be found. Dec 09 21:45:55.871313 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5df1282b-dc24-49cb-9907-fcf8c53975d0 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/subnets/0f02725a-b828-4d3a-8d7c-533730ba8790/tags/tempest-TagsExtTest-Tag-1098531046 HTTP/1.1" status: 404 len: 329 time: 0.1379311 Dec 09 21:45:55.872052 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41776) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:55.876958 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-1ae4d1a5-8273-429f-b4a0-4bf0c3e92356 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnets', '0f02725a-b828-4d3a-8d7c-533730ba8790', 'tempest-TagsExtTest-Tag-1072028070') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:55.935294 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-bf8f5ed8-e924-492a-a7d2-9f2e7bc9aede tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Deleting port c7cf7d9f-b73c-46c9-9607-cc7b44849cef {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:45:55.935657 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf8f5ed8-e924-492a-a7d2-9f2e7bc9aede tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:55.952204 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b99dce12-37a9-4d2a-af76-c36c1145ae15 None None] DHCP port deletion for 86b722dc-adb8-4599-bf9e-8a4aaf4ba7f0 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:45:55.967311 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-1ae4d1a5-8273-429f-b4a0-4bf0c3e92356 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] show failed (client error): The resource could not be found. Dec 09 21:45:55.967948 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1ae4d1a5-8273-429f-b4a0-4bf0c3e92356 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/subnets/0f02725a-b828-4d3a-8d7c-533730ba8790/tags/tempest-TagsExtTest-Tag-1072028070 HTTP/1.1" status: 404 len: 329 time: 0.0949235 Dec 09 21:45:55.970862 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41780) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:55.978228 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-5a3d694d-36c4-47de-b855-43ee1929c149 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'ports', 'b0d2998b-ab57-46de-85f9-5eb58bc92caf', {'tags': ['tempest-TagsExtTest-Tag-1527846492', 'tempest-TagsExtTest-Tag-244870765', 'tempest-TagsExtTest-Tag-434260219']}) {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:56.040431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-bf8f5ed8-e924-492a-a7d2-9f2e7bc9aede tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] For port c7cf7d9f-b73c-46c9-9607-cc7b44849cef, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c7cf7d9f-b73c-46c9-9607-cc7b44849cef,segment=NetworkSegment(904c4230-ee6a-43f8-be8a-b7c2d1532fb2),segment_id=904c4230-ee6a-43f8-be8a-b7c2d1532fb2)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:56.040982 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf8f5ed8-e924-492a-a7d2-9f2e7bc9aede tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:56.062288 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-b99dce12-37a9-4d2a-af76-c36c1145ae15 None None] Deleting port c7cf7d9f-b73c-46c9-9607-cc7b44849cef {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:45:56.064416 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b99dce12-37a9-4d2a-af76-c36c1145ae15 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:56.072795 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5a3d694d-36c4-47de-b855-43ee1929c149 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "PUT /v2.0/ports/b0d2998b-ab57-46de-85f9-5eb58bc92caf/tags HTTP/1.1" status: 200 len: 316 time: 0.0993748 Dec 09 21:45:56.075206 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41782) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:56.083935 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-f8b759c5-c935-4291-92b0-80ebeb386193 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', 'b0d2998b-ab57-46de-85f9-5eb58bc92caf') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:56.086911 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-bf8f5ed8-e924-492a-a7d2-9f2e7bc9aede tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Calling delete_port for c7cf7d9f-b73c-46c9-9607-cc7b44849cef owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:45:56.150968 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-b99dce12-37a9-4d2a-af76-c36c1145ae15 None None] For port c7cf7d9f-b73c-46c9-9607-cc7b44849cef, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c7cf7d9f-b73c-46c9-9607-cc7b44849cef,segment=NetworkSegment(904c4230-ee6a-43f8-be8a-b7c2d1532fb2),segment_id=904c4230-ee6a-43f8-be8a-b7c2d1532fb2)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:56.151272 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b99dce12-37a9-4d2a-af76-c36c1145ae15 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:56.165873 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-b99dce12-37a9-4d2a-af76-c36c1145ae15 None None] Calling delete_port for c7cf7d9f-b73c-46c9-9607-cc7b44849cef owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:45:56.172539 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f8b759c5-c935-4291-92b0-80ebeb386193 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "DELETE /v2.0/ports/b0d2998b-ab57-46de-85f9-5eb58bc92caf/tags HTTP/1.1" status: 204 len: 168 time: 0.0960376 Dec 09 21:45:56.175738 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41784) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:56.180105 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-7f1686e0-fc44-419e-9752-ef1971c19f19 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', 'b0d2998b-ab57-46de-85f9-5eb58bc92caf', 'tempest-TagsExtTest-Tag-1527846492') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:56.200087 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf8f5ed8-e924-492a-a7d2-9f2e7bc9aede tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:56.229525 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf8f5ed8-e924-492a-a7d2-9f2e7bc9aede tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event deleted for resources: {'Port': ['ID=c7cf7d9f-b73c-46c9-9607-cc7b44849cef,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:56.237339 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf8f5ed8-e924-492a-a7d2-9f2e7bc9aede tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] No DVR routers for this DVR port c7cf7d9f-b73c-46c9-9607-cc7b44849cef on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:45:56.244455 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b99dce12-37a9-4d2a-af76-c36c1145ae15 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:56.259786 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-7f1686e0-fc44-419e-9752-ef1971c19f19 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] show failed (client error): The resource could not be found. Dec 09 21:45:56.261293 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7f1686e0-fc44-419e-9752-ef1971c19f19 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/ports/b0d2998b-ab57-46de-85f9-5eb58bc92caf/tags/tempest-TagsExtTest-Tag-1527846492 HTTP/1.1" status: 404 len: 329 time: 0.0845633 Dec 09 21:45:56.265334 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41786) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:56.276371 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-8d0be228-59db-4977-a263-4bd3f3732665 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', 'b0d2998b-ab57-46de-85f9-5eb58bc92caf', 'tempest-TagsExtTest-Tag-244870765') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:56.277970 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b99dce12-37a9-4d2a-af76-c36c1145ae15 None None] Pushing event deleted for resources: {'Port': ['ID=c7cf7d9f-b73c-46c9-9607-cc7b44849cef,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:56.279976 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b99dce12-37a9-4d2a-af76-c36c1145ae15 None None] No DVR routers for this DVR port c7cf7d9f-b73c-46c9-9607-cc7b44849cef on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:45:56.342244 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-8d0be228-59db-4977-a263-4bd3f3732665 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] show failed (client error): The resource could not be found. Dec 09 21:45:56.344256 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8d0be228-59db-4977-a263-4bd3f3732665 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/ports/b0d2998b-ab57-46de-85f9-5eb58bc92caf/tags/tempest-TagsExtTest-Tag-244870765 HTTP/1.1" status: 404 len: 328 time: 0.0760136 Dec 09 21:45:56.344817 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf8f5ed8-e924-492a-a7d2-9f2e7bc9aede tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:56.347745 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41788) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:56.352761 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-65282cab-1d2f-402b-98ef-d76d645911d1 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'ports', 'b0d2998b-ab57-46de-85f9-5eb58bc92caf', 'tempest-TagsExtTest-Tag-434260219') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:56.366042 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-bf8f5ed8-e924-492a-a7d2-9f2e7bc9aede tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['86b722dc-adb8-4599-bf9e-8a4aaf4ba7f0']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:56.375633 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-bf8f5ed8-e924-492a-a7d2-9f2e7bc9aede tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '904c4230-ee6a-43f8-be8a-b7c2d1532fb2') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:56.375927 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-bf8f5ed8-e924-492a-a7d2-9f2e7bc9aede tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '904c4230-ee6a-43f8-be8a-b7c2d1532fb2') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:56.385570 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf8f5ed8-e924-492a-a7d2-9f2e7bc9aede tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:56.404313 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-65282cab-1d2f-402b-98ef-d76d645911d1 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] show failed (client error): The resource could not be found. Dec 09 21:45:56.407499 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-65282cab-1d2f-402b-98ef-d76d645911d1 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/ports/b0d2998b-ab57-46de-85f9-5eb58bc92caf/tags/tempest-TagsExtTest-Tag-434260219 HTTP/1.1" status: 404 len: 328 time: 0.0566940 Dec 09 21:45:56.408418 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf8f5ed8-e924-492a-a7d2-9f2e7bc9aede tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:56.410546 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41790) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:56.417625 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-50afa2dc-04c3-4284-9ddb-83d05a4bc3f5 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'routers', '8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6', {'tags': ['tempest-TagsExtTest-Tag-1165833378', 'tempest-TagsExtTest-Tag-1418241675', 'tempest-TagsExtTest-Tag-850140407']}) {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:56.451061 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bf8f5ed8-e924-492a-a7d2-9f2e7bc9aede tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Releasing vlan 146 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:45:56.451474 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf8f5ed8-e924-492a-a7d2-9f2e7bc9aede tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:45:56.454476 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:45:56.553188 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf8f5ed8-e924-492a-a7d2-9f2e7bc9aede tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:56.560834 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf8f5ed8-e924-492a-a7d2-9f2e7bc9aede tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:56.563887 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bf8f5ed8-e924-492a-a7d2-9f2e7bc9aede tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] 10.222.0.13 "DELETE /v2.0/networks/86b722dc-adb8-4599-bf9e-8a4aaf4ba7f0 HTTP/1.1" status: 204 len: 168 time: 0.8738389 Dec 09 21:45:56.569468 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-50afa2dc-04c3-4284-9ddb-83d05a4bc3f5 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "PUT /v2.0/routers/8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6/tags HTTP/1.1" status: 200 len: 317 time: 0.1554825 Dec 09 21:45:56.572514 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41796) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:56.579091 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-a4eacf48-626c-4fe3-9227-f5dd62287036 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', '8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:56.581813 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf8f5ed8-e924-492a-a7d2-9f2e7bc9aede tempest-NetworksIpV6TestAttrs-1529424721 tempest-NetworksIpV6TestAttrs-1529424721-project] Pushing event deleted for resources: {'Network': ['ID=86b722dc-adb8-4599-bf9e-8a4aaf4ba7f0,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:56.710206 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c7cf7d9f-b73c-46c9-9607-cc7b44849cef no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:45:56.747850 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a4eacf48-626c-4fe3-9227-f5dd62287036 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "DELETE /v2.0/routers/8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6/tags HTTP/1.1" status: 204 len: 168 time: 0.1720488 Dec 09 21:45:56.749061 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41802) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:56.757691 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: c7cf7d9f-b73c-46c9-9607-cc7b44849cef {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:45:56.758234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c7cf7d9f-b73c-46c9-9607-cc7b44849cef not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:45:56.762176 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-93813389-e067-400c-a1e2-af6bd4c38aed tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', '8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6', 'tempest-TagsExtTest-Tag-1165833378') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:56.870617 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-93813389-e067-400c-a1e2-af6bd4c38aed tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] show failed (client error): The resource could not be found. Dec 09 21:45:56.874425 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-93813389-e067-400c-a1e2-af6bd4c38aed tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/routers/8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6/tags/tempest-TagsExtTest-Tag-1165833378 HTTP/1.1" status: 404 len: 329 time: 0.1216731 Dec 09 21:45:56.874839 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41806) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:56.879991 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-dcbd1047-1c1e-4172-8370-7d11a7c0a43e tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', '8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6', 'tempest-TagsExtTest-Tag-1418241675') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:56.992051 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-dcbd1047-1c1e-4172-8370-7d11a7c0a43e tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] show failed (client error): The resource could not be found. Dec 09 21:45:56.993214 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-dcbd1047-1c1e-4172-8370-7d11a7c0a43e tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/routers/8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6/tags/tempest-TagsExtTest-Tag-1418241675 HTTP/1.1" status: 404 len: 329 time: 0.1172755 Dec 09 21:45:56.996730 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41808) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:57.003341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-a6bd3407-8519-4989-9985-e5f6a8edf3d6 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'routers', '8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6', 'tempest-TagsExtTest-Tag-850140407') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:57.020330 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41812) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:57.114263 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-a6bd3407-8519-4989-9985-e5f6a8edf3d6 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] show failed (client error): The resource could not be found. Dec 09 21:45:57.118099 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a6bd3407-8519-4989-9985-e5f6a8edf3d6 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/routers/8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6/tags/tempest-TagsExtTest-Tag-850140407 HTTP/1.1" status: 404 len: 328 time: 0.1176884 Dec 09 21:45:57.118397 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41816) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:57.123200 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-14cb9e65-b924-4181-bae8-3983ffcd2d8a tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method update_tags called with arguments (, 'subnetpools', '22578a16-55fa-4512-a84e-a661819b909f', {'tags': ['tempest-TagsExtTest-Tag-1040578290', 'tempest-TagsExtTest-Tag-1428546982', 'tempest-TagsExtTest-Tag-674934630']}) {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:57.195683 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-14cb9e65-b924-4181-bae8-3983ffcd2d8a tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "PUT /v2.0/subnetpools/22578a16-55fa-4512-a84e-a661819b909f/tags HTTP/1.1" status: 200 len: 317 time: 0.0761075 Dec 09 21:45:57.198560 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41818) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:57.203114 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-5c62e35c-583a-4026-9940-e030bf07f204 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', '22578a16-55fa-4512-a84e-a661819b909f') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:57.208590 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b2368308-10de-4ca9-97ca-ff16c2d9fdf2 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=d082983dfcfa477f893f6dc13670fdc5&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1871619 Dec 09 21:45:57.211572 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41820) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:57.255493 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5c62e35c-583a-4026-9940-e030bf07f204 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "DELETE /v2.0/subnetpools/22578a16-55fa-4512-a84e-a661819b909f/tags HTTP/1.1" status: 204 len: 168 time: 0.0537472 Dec 09 21:45:57.256800 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41822) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:57.270033 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-d563fc0c-4af9-4c0f-a4be-3981681001a3 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '22578a16-55fa-4512-a84e-a661819b909f', 'tempest-TagsExtTest-Tag-1040578290') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:57.287038 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:57.290591 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0a3ebf13-3377-4ce6-8ab3-4d97a305d4f1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:57.300033 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-d563fc0c-4af9-4c0f-a4be-3981681001a3 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] show failed (client error): The resource could not be found. Dec 09 21:45:57.301264 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d563fc0c-4af9-4c0f-a4be-3981681001a3 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/subnetpools/22578a16-55fa-4512-a84e-a661819b909f/tags/tempest-TagsExtTest-Tag-1040578290 HTTP/1.1" status: 404 len: 329 time: 0.0432346 Dec 09 21:45:57.304768 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41824) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:57.310988 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-2bef94eb-0e8f-4527-b351-95e468743260 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '22578a16-55fa-4512-a84e-a661819b909f', 'tempest-TagsExtTest-Tag-1428546982') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:57.326157 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0a3ebf13-3377-4ce6-8ab3-4d97a305d4f1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:57.338860 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-2bef94eb-0e8f-4527-b351-95e468743260 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] show failed (client error): The resource could not be found. Dec 09 21:45:57.343028 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2bef94eb-0e8f-4527-b351-95e468743260 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/subnetpools/22578a16-55fa-4512-a84e-a661819b909f/tags/tempest-TagsExtTest-Tag-1428546982 HTTP/1.1" status: 404 len: 329 time: 0.0345116 Dec 09 21:45:57.343187 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41826) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:57.344300 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:57.348939 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-cb9bb1f8-ed17-484a-965d-e5e71bc498d9 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method get_tag called with arguments (, 'subnetpools', '22578a16-55fa-4512-a84e-a661819b909f', 'tempest-TagsExtTest-Tag-674934630') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:57.371168 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-cb9bb1f8-ed17-484a-965d-e5e71bc498d9 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] show failed (client error): The resource could not be found. Dec 09 21:45:57.374729 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cb9bb1f8-ed17-484a-965d-e5e71bc498d9 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/subnetpools/22578a16-55fa-4512-a84e-a661819b909f/tags/tempest-TagsExtTest-Tag-674934630 HTTP/1.1" status: 404 len: 328 time: 0.0281978 Dec 09 21:45:57.374951 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41828) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:57.380344 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-0c4985e0-fbe9-4009-aada-c4edf62a8d77 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnetpools', '22578a16-55fa-4512-a84e-a661819b909f') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:57.403115 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0a3ebf13-3377-4ce6-8ab3-4d97a305d4f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:57.406533 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0a3ebf13-3377-4ce6-8ab3-4d97a305d4f1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:57.413871 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0c4985e0-fbe9-4009-aada-c4edf62a8d77 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "DELETE /v2.0/subnetpools/22578a16-55fa-4512-a84e-a661819b909f/tags HTTP/1.1" status: 204 len: 168 time: 0.0329432 Dec 09 21:45:57.414570 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41832) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:57.415714 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0a3ebf13-3377-4ce6-8ab3-4d97a305d4f1 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/58fa29d4-9073-4ce8-9613-f9a1038ed5c0 HTTP/1.1" status: 204 len: 168 time: 0.2023976 Dec 09 21:45:57.425545 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a3ebf13-3377-4ce6-8ab3-4d97a305d4f1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=58fa29d4-9073-4ce8-9613-f9a1038ed5c0,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:57.433618 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.tag.tag_plugin [None req-05c930d2-1527-4d9b-b4c8-ff82d50ef869 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'routers', '8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:57.543846 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41834) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:57.544368 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-05c930d2-1527-4d9b-b4c8-ff82d50ef869 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "DELETE /v2.0/routers/8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6/tags HTTP/1.1" status: 204 len: 168 time: 0.1290236 Dec 09 21:45:57.550034 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-10722006-4f45-4950-898e-59e778935441 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'ports', 'b0d2998b-ab57-46de-85f9-5eb58bc92caf') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:57.620138 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-10722006-4f45-4950-898e-59e778935441 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "DELETE /v2.0/ports/b0d2998b-ab57-46de-85f9-5eb58bc92caf/tags HTTP/1.1" status: 204 len: 168 time: 0.0737307 Dec 09 21:45:57.620865 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41838) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:57.625210 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.tag.tag_plugin [None req-1f288b4c-e53d-4ce1-8ddf-a4be0e2d999b tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.tag.tag_plugin.TagPlugin method delete_tags called with arguments (, 'subnets', '0f02725a-b828-4d3a-8d7c-533730ba8790') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:45:57.690843 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1f288b4c-e53d-4ce1-8ddf-a4be0e2d999b tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "DELETE /v2.0/subnets/0f02725a-b828-4d3a-8d7c-533730ba8790/tags HTTP/1.1" status: 204 len: 168 time: 0.0673120 Dec 09 21:45:57.693714 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41842) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:57.802318 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da85c527-5dba-4662-98bd-33c65157fe98 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks [] for subnetpool, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:57.804053 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-da85c527-5dba-4662-98bd-33c65157fe98 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "DELETE /v2.0/subnetpools/22578a16-55fa-4512-a84e-a661819b909f HTTP/1.1" status: 204 len: 168 time: 0.1090074 Dec 09 21:45:57.806770 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41848) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:57.845517 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c1a5c8c6-cf63-4149-bc1a-d3603d9ae368 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "GET /v2.0/ports?device_id=8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6 HTTP/1.1" status: 200 len: 205 time: 0.0370009 Dec 09 21:45:57.847774 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41852) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:57.951408 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b008ad9d-0067-405e-81ee-35b2b476441a tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:58.218687 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b008ad9d-0067-405e-81ee-35b2b476441a tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:58.222909 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b008ad9d-0067-405e-81ee-35b2b476441a tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:58.279027 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b008ad9d-0067-405e-81ee-35b2b476441a tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:58.280154 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b008ad9d-0067-405e-81ee-35b2b476441a tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Fanout notify agent at l3_agent the message router_deleted on router 8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:45:58.290618 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 31ee9adf-4bac-4e32-9223-f4e594f0639e no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:45:58.301111 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b008ad9d-0067-405e-81ee-35b2b476441a tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:58.302835 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b008ad9d-0067-405e-81ee-35b2b476441a tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "DELETE /v2.0/routers/8ec3143e-cbfe-4afa-8dd0-3b8909d8e8a6 HTTP/1.1" status: 204 len: 168 time: 0.4539797 Dec 09 21:45:58.305790 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41866) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:58.355722 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 31ee9adf-4bac-4e32-9223-f4e594f0639e {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:45:58.356084 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 31ee9adf-4bac-4e32-9223-f4e594f0639e not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:45:58.393742 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41868) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:58.410710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-9d09025d-9ea0-470f-a0dd-450b8e99f717 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Deleting port b0d2998b-ab57-46de-85f9-5eb58bc92caf {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:45:58.411177 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d09025d-9ea0-470f-a0dd-450b8e99f717 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:58.523308 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d09025d-9ea0-470f-a0dd-450b8e99f717 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:58.537890 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c018ced7-290d-4d53-95d3-dd7694a56d4e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-test-network-732399640'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:58.541302 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-9d09025d-9ea0-470f-a0dd-450b8e99f717 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Calling delete_port for b0d2998b-ab57-46de-85f9-5eb58bc92caf owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:45:58.590373 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c018ced7-290d-4d53-95d3-dd7694a56d4e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:58.598184 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c018ced7-290d-4d53-95d3-dd7694a56d4e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:58.617037 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c018ced7-290d-4d53-95d3-dd7694a56d4e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:58.690507 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d09025d-9ea0-470f-a0dd-450b8e99f717 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:58.722002 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d09025d-9ea0-470f-a0dd-450b8e99f717 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Pushing event deleted for resources: {'Port': ['ID=b0d2998b-ab57-46de-85f9-5eb58bc92caf,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:58.779811 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c018ced7-290d-4d53-95d3-dd7694a56d4e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:58.787649 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c018ced7-290d-4d53-95d3-dd7694a56d4e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:58.812571 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d09025d-9ea0-470f-a0dd-450b8e99f717 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:58.828356 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9d09025d-9ea0-470f-a0dd-450b8e99f717 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "DELETE /v2.0/ports/b0d2998b-ab57-46de-85f9-5eb58bc92caf HTTP/1.1" status: 204 len: 168 time: 0.5184462 Dec 09 21:45:58.829408 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41872) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:58.876329 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c018ced7-290d-4d53-95d3-dd7694a56d4e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'SecurityGroup': ['ID=bb5edddb-522c-489c-9d37-df34fe67ba48,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:58.911936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c018ced7-290d-4d53-95d3-dd7694a56d4e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] vlan segment allocate from pool success with {'vlan_id': 133, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:45:58.926210 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-2f991db1-7484-40fc-acda-bedde0d776f1 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Deleting subnet 0f02725a-b828-4d3a-8d7c-533730ba8790 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:45:58.931004 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f991db1-7484-40fc-acda-bedde0d776f1 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:58.932241 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c018ced7-290d-4d53-95d3-dd7694a56d4e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:58.932637 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-c018ced7-290d-4d53-95d3-dd7694a56d4e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Added segment 90ddd048-63c0-4062-82f8-78fcca8ae490 of type vlan for network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 Dec 09 21:45:59.033179 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c018ced7-290d-4d53-95d3-dd7694a56d4e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:59.105360 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c018ced7-290d-4d53-95d3-dd7694a56d4e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:59.113299 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c018ced7-290d-4d53-95d3-dd7694a56d4e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:59.113980 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c018ced7-290d-4d53-95d3-dd7694a56d4e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:59.164929 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c018ced7-290d-4d53-95d3-dd7694a56d4e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.7676270 Dec 09 21:45:59.166365 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41878) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:59.175273 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-bd7af0dd-2612-49a8-86fe-3a562adde553 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'port': {'network_id': '6150e6df-2b72-4f1d-912c-2256eb16e2b3', 'name': 'tempest-PortsIpV6TestJSON-1967342188'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:59.293886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c018ced7-290d-4d53-95d3-dd7694a56d4e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Network': ['ID=6150e6df-2b72-4f1d-912c-2256eb16e2b3,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:59.304471 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:45:59.323605 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bd7af0dd-2612-49a8-86fe-3a562adde553 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:45:59.331898 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bd7af0dd-2612-49a8-86fe-3a562adde553 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:59.347330 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f991db1-7484-40fc-acda-bedde0d776f1 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:59.354734 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-bd7af0dd-2612-49a8-86fe-3a562adde553 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] device_id is not set on port 925975a6-f699-4323-8c8c-4f06e77fe8b2 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:45:59.461282 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f991db1-7484-40fc-acda-bedde0d776f1 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:59.535069 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f991db1-7484-40fc-acda-bedde0d776f1 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:59.558403 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bd7af0dd-2612-49a8-86fe-3a562adde553 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:59.566017 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f991db1-7484-40fc-acda-bedde0d776f1 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:59.571483 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2f991db1-7484-40fc-acda-bedde0d776f1 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "DELETE /v2.0/subnets/0f02725a-b828-4d3a-8d7c-533730ba8790 HTTP/1.1" status: 204 len: 168 time: 0.7358038 Dec 09 21:45:59.572793 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41880) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:59.574281 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c1c9f955-cee4-4cef-92fe-218362886747 None None] Network d106428f-76a7-4c86-a11f-c78b209d6ebb requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:45:59.577440 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f991db1-7484-40fc-acda-bedde0d776f1 tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Pushing event deleted for resources: {'Subnet': ['ID=0f02725a-b828-4d3a-8d7c-533730ba8790,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:59.667470 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bd7af0dd-2612-49a8-86fe-3a562adde553 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:59.674258 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f1290f6d-2f80-42b8-9b98-5eb57f9755fc tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:59.767078 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06d6e852-aa31-4524-9aac-03acc70f568b None None] DHCP port deletion for d106428f-76a7-4c86-a11f-c78b209d6ebb request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:45:59.785124 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd7af0dd-2612-49a8-86fe-3a562adde553 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Port': ['ID=925975a6-f699-4323-8c8c-4f06e77fe8b2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:45:59.807379 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd7af0dd-2612-49a8-86fe-3a562adde553 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Checking segment: {'id': '90ddd048-63c0-4062-82f8-78fcca8ae490', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '6150e6df-2b72-4f1d-912c-2256eb16e2b3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:45:59.807789 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bd7af0dd-2612-49a8-86fe-3a562adde553 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network hostable DHCP agents. Network: 6150e6df-2b72-4f1d-912c-2256eb16e2b3, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:45:59.844922 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-06d6e852-aa31-4524-9aac-03acc70f568b None None] Deleting port 5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:45:59.845291 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-06d6e852-aa31-4524-9aac-03acc70f568b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:59.854002 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bd7af0dd-2612-49a8-86fe-3a562adde553 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:45:59.857974 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-f1290f6d-2f80-42b8-9b98-5eb57f9755fc tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Deleting port 5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:45:59.858314 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f1290f6d-2f80-42b8-9b98-5eb57f9755fc tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:59.890412 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-bd7af0dd-2612-49a8-86fe-3a562adde553 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 6150e6df-2b72-4f1d-912c-2256eb16e2b3) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:45:59.902391 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-59b8988e-35a8-494d-bd51-a7b8b0a8ab5f None None] Network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:45:59.904874 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd7af0dd-2612-49a8-86fe-3a562adde553 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:45:59.912141 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bd7af0dd-2612-49a8-86fe-3a562adde553 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:45:59.912811 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bd7af0dd-2612-49a8-86fe-3a562adde553 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:45:59.963559 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bd7af0dd-2612-49a8-86fe-3a562adde553 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 850 time: 0.7965424 Dec 09 21:45:59.968134 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41884) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:45:59.981334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-14c9ae6f-0874-474a-9081-e89970addd7a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1151166765'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:45:59.997220 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-06d6e852-aa31-4524-9aac-03acc70f568b None None] For port 5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c,segment=NetworkSegment(f6eb7049-4269-46e5-b25e-f984e46ce81b),segment_id=f6eb7049-4269-46e5-b25e-f984e46ce81b)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:45:59.998059 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-06d6e852-aa31-4524-9aac-03acc70f568b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:00.013707 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-f1290f6d-2f80-42b8-9b98-5eb57f9755fc tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] For port 5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c,segment=NetworkSegment(f6eb7049-4269-46e5-b25e-f984e46ce81b),segment_id=f6eb7049-4269-46e5-b25e-f984e46ce81b)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:00.014096 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f1290f6d-2f80-42b8-9b98-5eb57f9755fc tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:00.016740 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-06d6e852-aa31-4524-9aac-03acc70f568b None None] Calling delete_port for 5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:00.020699 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-14c9ae6f-0874-474a-9081-e89970addd7a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:00.028830 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-14c9ae6f-0874-474a-9081-e89970addd7a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:00.076149 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-f1290f6d-2f80-42b8-9b98-5eb57f9755fc tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Calling delete_port for 5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:00.103465 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-14c9ae6f-0874-474a-9081-e89970addd7a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] vlan segment allocate from pool success with {'vlan_id': 120, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:46:00.128712 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-06d6e852-aa31-4524-9aac-03acc70f568b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:00.157372 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-14c9ae6f-0874-474a-9081-e89970addd7a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:00.157771 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-14c9ae6f-0874-474a-9081-e89970addd7a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Added segment 48c1d555-19d7-4bda-b389-ac69dfbd33fd of type vlan for network acee3476-8726-49c2-962d-a0caeb14abe5 Dec 09 21:46:00.165608 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06d6e852-aa31-4524-9aac-03acc70f568b None None] Pushing event deleted for resources: {'Port': ['ID=5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:00.168929 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06d6e852-aa31-4524-9aac-03acc70f568b None None] No DVR routers for this DVR port 5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:46:00.222458 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-14c9ae6f-0874-474a-9081-e89970addd7a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:00.251681 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f1290f6d-2f80-42b8-9b98-5eb57f9755fc tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:00.279635 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1290f6d-2f80-42b8-9b98-5eb57f9755fc tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Pushing event deleted for resources: {'Port': ['ID=5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:00.281851 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-14c9ae6f-0874-474a-9081-e89970addd7a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:00.287770 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14c9ae6f-0874-474a-9081-e89970addd7a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:00.288371 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-14c9ae6f-0874-474a-9081-e89970addd7a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:00.299298 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1290f6d-2f80-42b8-9b98-5eb57f9755fc tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] No DVR routers for this DVR port 5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:46:00.358876 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-14c9ae6f-0874-474a-9081-e89970addd7a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.3891485 Dec 09 21:46:00.361627 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41888) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:00.367283 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'ports': [{'network_id': '6150e6df-2b72-4f1d-912c-2256eb16e2b3'}, {'network_id': 'acee3476-8726-49c2-962d-a0caeb14abe5'}]} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:00.367997 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'port': {'network_id': '6150e6df-2b72-4f1d-912c-2256eb16e2b3'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:00.368499 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'port': {'network_id': 'acee3476-8726-49c2-962d-a0caeb14abe5'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:00.416652 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14c9ae6f-0874-474a-9081-e89970addd7a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Network': ['ID=acee3476-8726-49c2-962d-a0caeb14abe5,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:00.430152 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network acee3476-8726-49c2-962d-a0caeb14abe5 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:46:00.482616 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f1290f6d-2f80-42b8-9b98-5eb57f9755fc tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:00.509284 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-f1290f6d-2f80-42b8-9b98-5eb57f9755fc tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d106428f-76a7-4c86-a11f-c78b209d6ebb']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:00.521130 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-f1290f6d-2f80-42b8-9b98-5eb57f9755fc tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f6eb7049-4269-46e5-b25e-f984e46ce81b') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:00.521622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-f1290f6d-2f80-42b8-9b98-5eb57f9755fc tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f6eb7049-4269-46e5-b25e-f984e46ce81b') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:00.543604 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f1290f6d-2f80-42b8-9b98-5eb57f9755fc tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:00.557867 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'port': 2} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:00.564376 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:00.573012 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f1290f6d-2f80-42b8-9b98-5eb57f9755fc tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:00.580427 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:00.587598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f1290f6d-2f80-42b8-9b98-5eb57f9755fc tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Releasing vlan 142 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:46:00.590340 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f1290f6d-2f80-42b8-9b98-5eb57f9755fc tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:46:00.593705 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:46:00.669000 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:46:00.693048 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] device_id is not set on port 760f677d-0f5a-4adf-9873-ce8a423092fd yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:46:00.710165 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:46:00.711178 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5c7950d9-c96d-4e1a-8a5f-fc44a5a49d7c not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:46:00.712490 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f1290f6d-2f80-42b8-9b98-5eb57f9755fc tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:00.727539 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f1290f6d-2f80-42b8-9b98-5eb57f9755fc tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:00.733118 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f1290f6d-2f80-42b8-9b98-5eb57f9755fc tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] 10.222.0.13 "DELETE /v2.0/networks/d106428f-76a7-4c86-a11f-c78b209d6ebb HTTP/1.1" status: 204 len: 168 time: 1.1592391 Dec 09 21:46:00.746773 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1290f6d-2f80-42b8-9b98-5eb57f9755fc tempest-TagsExtTest-1017424902 tempest-TagsExtTest-1017424902-project] Pushing event deleted for resources: {'Network': ['ID=d106428f-76a7-4c86-a11f-c78b209d6ebb,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:00.875939 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:00.975867 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] device_id is not set on port f3d196c8-e547-4c96-a0a4-49a82e2b8307 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:46:01.075589 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41896) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:01.137015 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:01.180657 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:01.243793 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Port': ['ID=760f677d-0f5a-4adf-9873-ce8a423092fd,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:01.272677 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:46:01.274375 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:01.277401 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:46:01.278292 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:01.332396 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d09563ac-0b1c-4ba3-8d6a-34fa399edfd6 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=6c6a677d6f254ab5a77a8358ab37ab45&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2552645 Dec 09 21:46:01.333116 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41908) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:01.363543 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Checking segment: {'id': '48c1d555-19d7-4bda-b389-ac69dfbd33fd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': 'acee3476-8726-49c2-962d-a0caeb14abe5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:46:01.364224 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network hostable DHCP agents. Network: acee3476-8726-49c2-962d-a0caeb14abe5, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:46:01.367154 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Port': ['ID=f3d196c8-e547-4c96-a0a4-49a82e2b8307,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:01.391993 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network acee3476-8726-49c2-962d-a0caeb14abe5 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:46:01.408866 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, acee3476-8726-49c2-962d-a0caeb14abe5) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:01.416717 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:46:01.417998 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-52a592f5-5807-4aee-852d-e9bf9705b980 None None] Network acee3476-8726-49c2-962d-a0caeb14abe5 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:46:01.425272 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:01.430458 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-444ce9fb-c111-4d19-8583-e4d2b1fbdd56 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:01.457821 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-444ce9fb-c111-4d19-8583-e4d2b1fbdd56 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:01.471014 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:host_id', 'binding:profile', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:01.474055 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:01.512642 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-200a9451-68ba-41ce-811b-d0a0dc03eced tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1425 time: 1.1495841 Dec 09 21:46:01.515680 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41912) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:01.521094 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-444ce9fb-c111-4d19-8583-e4d2b1fbdd56 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:01.524360 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-444ce9fb-c111-4d19-8583-e4d2b1fbdd56 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:01.528032 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-444ce9fb-c111-4d19-8583-e4d2b1fbdd56 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/527aec6b-bc21-4e37-b0f2-1d0f6969e722 HTTP/1.1" status: 204 len: 168 time: 0.1916349 Dec 09 21:46:01.561518 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-444ce9fb-c111-4d19-8583-e4d2b1fbdd56 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=527aec6b-bc21-4e37-b0f2-1d0f6969e722,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:01.658639 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-f4388fc5-3829-4dfa-aa71-b8e407646c4e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting port f3d196c8-e547-4c96-a0a4-49a82e2b8307 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:01.659379 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f4388fc5-3829-4dfa-aa71-b8e407646c4e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:01.676966 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-097ff271-b148-4df0-bce1-6fd06e9b4e9a req-bfd8aea8-f8ce-4cef-bf21-d297a8a06885 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:01.684469 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-097ff271-b148-4df0-bce1-6fd06e9b4e9a req-bfd8aea8-f8ce-4cef-bf21-d297a8a06885 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9a04051-952f-4c6e-b436-24b66478b4a1 HTTP/1.1" status: 200 len: 945 time: 0.1042645 Dec 09 21:46:01.768178 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f4388fc5-3829-4dfa-aa71-b8e407646c4e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:01.779958 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-097ff271-b148-4df0-bce1-6fd06e9b4e9a req-34e10beb-8c9d-46a1-8836-4e5121131d83 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0904639 Dec 09 21:46:01.804628 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-f4388fc5-3829-4dfa-aa71-b8e407646c4e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Calling delete_port for f3d196c8-e547-4c96-a0a4-49a82e2b8307 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:01.916300 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f4388fc5-3829-4dfa-aa71-b8e407646c4e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:01.937168 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f4388fc5-3829-4dfa-aa71-b8e407646c4e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:01.941965 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f4388fc5-3829-4dfa-aa71-b8e407646c4e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/ports/f3d196c8-e547-4c96-a0a4-49a82e2b8307 HTTP/1.1" status: 204 len: 168 time: 0.4250042 Dec 09 21:46:01.944744 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41922) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:01.983399 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4388fc5-3829-4dfa-aa71-b8e407646c4e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Port': ['ID=f3d196c8-e547-4c96-a0a4-49a82e2b8307,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:02.022226 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fef7f2fe-8315-4bec-8842-28a1dba27970 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:02.029396 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fef7f2fe-8315-4bec-8842-28a1dba27970 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:02.034054 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fef7f2fe-8315-4bec-8842-28a1dba27970 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 1456 time: 0.0854733 Dec 09 21:46:02.034668 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41926) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:02.151626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-a5989bd3-4e2f-48cf-aa54-f907cee811f4 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting port 760f677d-0f5a-4adf-9873-ce8a423092fd {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:02.151973 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a5989bd3-4e2f-48cf-aa54-f907cee811f4 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:02.235002 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a5989bd3-4e2f-48cf-aa54-f907cee811f4 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:02.249898 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-a5989bd3-4e2f-48cf-aa54-f907cee811f4 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Calling delete_port for 760f677d-0f5a-4adf-9873-ce8a423092fd owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:02.365944 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a5989bd3-4e2f-48cf-aa54-f907cee811f4 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:02.400066 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5989bd3-4e2f-48cf-aa54-f907cee811f4 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Port': ['ID=760f677d-0f5a-4adf-9873-ce8a423092fd,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:02.404565 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a5989bd3-4e2f-48cf-aa54-f907cee811f4 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:02.409183 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a5989bd3-4e2f-48cf-aa54-f907cee811f4 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/ports/760f677d-0f5a-4adf-9873-ce8a423092fd HTTP/1.1" status: 204 len: 168 time: 0.3732402 Dec 09 21:46:02.411657 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41940) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:02.459556 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41942) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:02.465286 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [-] 10.222.0.13 "GET / HTTP/1.1" status: 200 len: 248 time: 0.0032132 Dec 09 21:46:02.470193 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b00e09d2-ac4e-4883-ab37-be885d213dc3 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:02.470995 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41944) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:02.472958 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b00e09d2-ac4e-4883-ab37-be885d213dc3 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 848 time: 0.0603433 Dec 09 21:46:02.475036 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41946) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:02.500467 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-ca17764a-bfd2-46c0-924e-16b1c3d02fce tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] GET failed (client error): The resource could not be found. Dec 09 21:46:02.502000 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ca17764a-bfd2-46c0-924e-16b1c3d02fce tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports/f3d196c8-e547-4c96-a0a4-49a82e2b8307 HTTP/1.1" status: 404 len: 333 time: 0.0259047 Dec 09 21:46:02.505139 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41950) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:02.544469 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-554586b3-6782-4387-83f8-e369bdf1b05f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] GET failed (client error): The resource could not be found. Dec 09 21:46:02.551052 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-554586b3-6782-4387-83f8-e369bdf1b05f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports/760f677d-0f5a-4adf-9873-ce8a423092fd HTTP/1.1" status: 404 len: 333 time: 0.0446455 Dec 09 21:46:02.554551 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41952) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:02.628861 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-515b8ffd-61da-4f3d-9a89-e61f88890c19 tempest-NetworksApiDiscovery-1028936046 tempest-NetworksApiDiscovery-1028936046-project] 10.222.0.13 "GET /v2.0/ HTTP/1.1" status: 200 len: 702 time: 0.1564357 Dec 09 21:46:02.666013 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-900136e6-b3a2-4adb-9382-0ab4b3a0ac0f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:02.756771 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-900136e6-b3a2-4adb-9382-0ab4b3a0ac0f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:02.777595 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-900136e6-b3a2-4adb-9382-0ab4b3a0ac0f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['acee3476-8726-49c2-962d-a0caeb14abe5']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:02.787325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-900136e6-b3a2-4adb-9382-0ab4b3a0ac0f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '48c1d555-19d7-4bda-b389-ac69dfbd33fd') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:02.787654 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-900136e6-b3a2-4adb-9382-0ab4b3a0ac0f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '48c1d555-19d7-4bda-b389-ac69dfbd33fd') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:02.797226 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-900136e6-b3a2-4adb-9382-0ab4b3a0ac0f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:02.810762 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-900136e6-b3a2-4adb-9382-0ab4b3a0ac0f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:02.819458 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-900136e6-b3a2-4adb-9382-0ab4b3a0ac0f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Releasing vlan 120 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:46:02.819902 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-900136e6-b3a2-4adb-9382-0ab4b3a0ac0f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:46:02.823885 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:46:02.916830 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-900136e6-b3a2-4adb-9382-0ab4b3a0ac0f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:02.952599 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-900136e6-b3a2-4adb-9382-0ab4b3a0ac0f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:02.958382 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41960) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:02.965188 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-900136e6-b3a2-4adb-9382-0ab4b3a0ac0f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/networks/acee3476-8726-49c2-962d-a0caeb14abe5 HTTP/1.1" status: 204 len: 168 time: 0.4035690 Dec 09 21:46:02.965188 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-900136e6-b3a2-4adb-9382-0ab4b3a0ac0f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Network': ['ID=acee3476-8726-49c2-962d-a0caeb14abe5,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:02.965504 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41964) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:02.968861 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f9301a5a-a2cb-4cb8-927c-d117d8510b6a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:02.970954 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-3a05c39c-26c0-4a89-ac11-44c4bf634115 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-349759948'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:02.998377 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3a05c39c-26c0-4a89-ac11-44c4bf634115 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:03.002312 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3a05c39c-26c0-4a89-ac11-44c4bf634115 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:03.025761 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63632377-efa3-4f7a-afc9-7d59ad121ce2 req-aa010328-6c81-4fb5-9be1-0bbc9c4d7d9c tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:03.031987 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63632377-efa3-4f7a-afc9-7d59ad121ce2 req-aa010328-6c81-4fb5-9be1-0bbc9c4d7d9c tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9a04051-952f-4c6e-b436-24b66478b4a1 HTTP/1.1" status: 200 len: 945 time: 0.1350117 Dec 09 21:46:03.064712 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3a05c39c-26c0-4a89-ac11-44c4bf634115 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] vlan segment allocate from pool success with {'vlan_id': 119, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:46:03.087266 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3a05c39c-26c0-4a89-ac11-44c4bf634115 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:03.087676 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-3a05c39c-26c0-4a89-ac11-44c4bf634115 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Added segment 4f3726c1-716b-4f0e-adf7-5214cc8950ef of type vlan for network 82d7c06a-099a-4252-898c-7cb41864db84 Dec 09 21:46:03.108224 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df510e7d-bf52-47e1-9c61-1c779ab1d902 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:03.133747 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63632377-efa3-4f7a-afc9-7d59ad121ce2 req-605a0756-b909-4f6a-bcc7-abb909bf9e59 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0973811 Dec 09 21:46:03.148013 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3a05c39c-26c0-4a89-ac11-44c4bf634115 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:03.183112 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3a05c39c-26c0-4a89-ac11-44c4bf634115 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:03.193761 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a05c39c-26c0-4a89-ac11-44c4bf634115 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:03.194543 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3a05c39c-26c0-4a89-ac11-44c4bf634115 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:03.196760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4a08a2b-0a69-4b8d-96ac-3d41d03fc228 req-157d3788-0fd2-4720-84c2-209d43102461 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:03.198284 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4a08a2b-0a69-4b8d-96ac-3d41d03fc228 req-157d3788-0fd2-4720-84c2-209d43102461 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.31 "GET /v2.0/ports?device_id=f9a04051-952f-4c6e-b436-24b66478b4a1 HTTP/1.1" status: 200 len: 945 time: 0.0767534 Dec 09 21:46:03.261909 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3a05c39c-26c0-4a89-ac11-44c4bf634115 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.2925580 Dec 09 21:46:03.263650 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 41970) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:03.302691 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-f7f603fe-ef46-42cf-b212-928757cb723d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'subnet': {'network_id': '82d7c06a-099a-4252-898c-7cb41864db84', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'allocation_pools': [{'start': '2001:db8::2', 'end': '2001:db8::ffff:ffff:ffff:fffe'}]}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:03.312290 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df510e7d-bf52-47e1-9c61-1c779ab1d902 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:03.338744 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a05c39c-26c0-4a89-ac11-44c4bf634115 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Network': ['ID=82d7c06a-099a-4252-898c-7cb41864db84,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:03.359619 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df510e7d-bf52-47e1-9c61-1c779ab1d902 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:03.397247 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-a4a08a2b-0a69-4b8d-96ac-3d41d03fc228 req-9d5b6abc-c102-453a-bf25-229349ec0868 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Deleting port 25f69b99-160f-4f73-bc4c-738b6fa17cbd {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:03.397642 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a4a08a2b-0a69-4b8d-96ac-3d41d03fc228 req-9d5b6abc-c102-453a-bf25-229349ec0868 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:03.402857 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-df510e7d-bf52-47e1-9c61-1c779ab1d902 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=d730864a6af241c38e2dcad553d0db0c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4433303 Dec 09 21:46:03.406731 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41972) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:03.427905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f7f603fe-ef46-42cf-b212-928757cb723d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:03.431682 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f7f603fe-ef46-42cf-b212-928757cb723d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:03.441531 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 82d7c06a-099a-4252-898c-7cb41864db84 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:46:03.467115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df510e7d-bf52-47e1-9c61-1c779ab1d902 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fa769d25-f55e-43fa-9833-de60c29393c6,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:03.495077 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.ipam_backend_mixin [None req-f7f603fe-ef46-42cf-b212-928757cb723d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Performing IP validity checks on allocation pools {{(pid=103438) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Dec 09 21:46:03.498531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.ipam_backend_mixin [None req-f7f603fe-ef46-42cf-b212-928757cb723d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Checking for overlaps among allocation pools and gateway ip {{(pid=103438) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Dec 09 21:46:03.515661 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df510e7d-bf52-47e1-9c61-1c779ab1d902 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:03.516018 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df510e7d-bf52-47e1-9c61-1c779ab1d902 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:03.516364 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df510e7d-bf52-47e1-9c61-1c779ab1d902 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:03.516764 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df510e7d-bf52-47e1-9c61-1c779ab1d902 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:03.517045 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df510e7d-bf52-47e1-9c61-1c779ab1d902 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:03.517380 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df510e7d-bf52-47e1-9c61-1c779ab1d902 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:03.517841 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df510e7d-bf52-47e1-9c61-1c779ab1d902 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:03.518279 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df510e7d-bf52-47e1-9c61-1c779ab1d902 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:03.518804 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df510e7d-bf52-47e1-9c61-1c779ab1d902 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:03.519140 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df510e7d-bf52-47e1-9c61-1c779ab1d902 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:03.519520 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df510e7d-bf52-47e1-9c61-1c779ab1d902 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:03.519874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df510e7d-bf52-47e1-9c61-1c779ab1d902 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:03.520299 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df510e7d-bf52-47e1-9c61-1c779ab1d902 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:03.563207 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-a4a08a2b-0a69-4b8d-96ac-3d41d03fc228 req-9d5b6abc-c102-453a-bf25-229349ec0868 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] For port 25f69b99-160f-4f73-bc4c-738b6fa17cbd, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=25f69b99-160f-4f73-bc4c-738b6fa17cbd,segment=NetworkSegment(0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5),segment_id=0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:03.563627 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a4a08a2b-0a69-4b8d-96ac-3d41d03fc228 req-9d5b6abc-c102-453a-bf25-229349ec0868 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:03.572725 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ca069bb-aefd-4269-8b17-fe7d722ecbae admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:03.581222 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-a4a08a2b-0a69-4b8d-96ac-3d41d03fc228 req-9d5b6abc-c102-453a-bf25-229349ec0868 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Calling delete_port for 25f69b99-160f-4f73-bc4c-738b6fa17cbd owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:03.607645 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ca069bb-aefd-4269-8b17-fe7d722ecbae admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:03.632210 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f7f603fe-ef46-42cf-b212-928757cb723d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:03.694622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7f603fe-ef46-42cf-b212-928757cb723d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Subnet': ['ID=87d49a3f-16b8-4ea7-ae3f-24b99c39a002,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:03.705167 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7f603fe-ef46-42cf-b212-928757cb723d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Checking segment: {'id': '4f3726c1-716b-4f0e-adf7-5214cc8950ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '82d7c06a-099a-4252-898c-7cb41864db84'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:46:03.706332 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7f603fe-ef46-42cf-b212-928757cb723d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network hostable DHCP agents. Network: 82d7c06a-099a-4252-898c-7cb41864db84, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:46:03.714451 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ca069bb-aefd-4269-8b17-fe7d722ecbae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:03.717069 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1ca069bb-aefd-4269-8b17-fe7d722ecbae admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:03.720752 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1ca069bb-aefd-4269-8b17-fe7d722ecbae admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/fa769d25-f55e-43fa-9833-de60c29393c6 HTTP/1.1" status: 204 len: 168 time: 0.2966244 Dec 09 21:46:03.728405 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7f603fe-ef46-42cf-b212-928757cb723d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network 82d7c06a-099a-4252-898c-7cb41864db84 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:46:03.742661 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-f7f603fe-ef46-42cf-b212-928757cb723d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 82d7c06a-099a-4252-898c-7cb41864db84) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:03.747816 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7f603fe-ef46-42cf-b212-928757cb723d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:03.748535 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f7f603fe-ef46-42cf-b212-928757cb723d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:03.751993 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ca069bb-aefd-4269-8b17-fe7d722ecbae admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fa769d25-f55e-43fa-9833-de60c29393c6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:03.763061 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ebdde1a2-8979-45b9-8dd5-74b93472ce18 None None] Network 82d7c06a-099a-4252-898c-7cb41864db84 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:46:03.772833 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 41976) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:03.773683 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f7f603fe-ef46-42cf-b212-928757cb723d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.5090411 Dec 09 21:46:03.778615 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-276f6b63-f1d0-48f3-9985-e1df101b85f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'port': {'network_id': '82d7c06a-099a-4252-898c-7cb41864db84', 'name': 'tempest-PortsIpV6TestJSON-1164046342'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:03.783876 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a4a08a2b-0a69-4b8d-96ac-3d41d03fc228 req-9d5b6abc-c102-453a-bf25-229349ec0868 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:03.805317 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['33cf4605-a408-4847-9394-fe8acf994c40', 'bd9c1c28-304b-4656-bd19-43407d1b6dc2', '25f69b99-160f-4f73-bc4c-738b6fa17cbd'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:46:03.850816 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d5b6abc-c102-453a-bf25-229349ec0868 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Pushing event deleted for resources: {'Port': ['ID=25f69b99-160f-4f73-bc4c-738b6fa17cbd,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:03.875976 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-16c1a8a1-3166-4450-a48a-33fb15bc2a9b None None] DHCP port deletion for eda4cb39-afde-43d7-a13b-5227cc6862dd request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:46:03.937709 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-a4a08a2b-0a69-4b8d-96ac-3d41d03fc228 req-9d5b6abc-c102-453a-bf25-229349ec0868 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] No DVR routers for this DVR port 25f69b99-160f-4f73-bc4c-738b6fa17cbd on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:46:03.941721 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a4a08a2b-0a69-4b8d-96ac-3d41d03fc228 req-9d5b6abc-c102-453a-bf25-229349ec0868 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:03.945410 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a4a08a2b-0a69-4b8d-96ac-3d41d03fc228 req-9d5b6abc-c102-453a-bf25-229349ec0868 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.31 "DELETE /v2.0/ports/25f69b99-160f-4f73-bc4c-738b6fa17cbd HTTP/1.1" status: 204 len: 173 time: 0.7391810 Dec 09 21:46:03.948350 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f9a04051-952f-4c6e-b436-24b66478b4a1', 'name': 'network-vif-deleted', 'tag': '25f69b99-160f-4f73-bc4c-738b6fa17cbd'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:46:03.955601 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cdedc7ce-35d2-47da-b93d-1b27af17eb93 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-82d7c06a-099a-4252-898c-7cb41864db84', 'network_id': '82d7c06a-099a-4252-898c-7cb41864db84', 'project_id': '9560c66e717c47918bfe698e159759c5', 'fixed_ips': [{'subnet_id': '87d49a3f-16b8-4ea7-ae3f-24b99c39a002'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:46:03.956602 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cdedc7ce-35d2-47da-b93d-1b27af17eb93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:03.958319 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bbc9c4c9-7428-46df-a1a0-b3154acd8fd5" -d '{"events": [{"server_uuid": "f9a04051-952f-4c6e-b436-24b66478b4a1", "name": "network-vif-deleted", "tag": "25f69b99-160f-4f73-bc4c-738b6fa17cbd"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:46:04.014678 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-276f6b63-f1d0-48f3-9985-e1df101b85f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:04.018460 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-276f6b63-f1d0-48f3-9985-e1df101b85f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:04.038703 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:46:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-751e1394-789c-4aae-b868-4539169bacba x-openstack-request-id: req-751e1394-789c-4aae-b868-4539169bacba {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:46:04.039007 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f9a04051-952f-4c6e-b436-24b66478b4a1", "name": "network-vif-deleted", "tag": "25f69b99-160f-4f73-bc4c-738b6fa17cbd", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:46:04.039266 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-751e1394-789c-4aae-b868-4539169bacba {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:46:04.039705 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f9a04051-952f-4c6e-b436-24b66478b4a1', 'name': 'network-vif-deleted', 'tag': '25f69b99-160f-4f73-bc4c-738b6fa17cbd', 'status': 'completed', 'code': 200} Dec 09 21:46:04.041464 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-276f6b63-f1d0-48f3-9985-e1df101b85f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] device_id is not set on port 897f281c-d900-4034-abae-e5afc51224cd yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:46:04.162811 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-cdedc7ce-35d2-47da-b93d-1b27af17eb93 None None] Allocated IP 2001:db8::2 (82d7c06a-099a-4252-898c-7cb41864db84/87d49a3f-16b8-4ea7-ae3f-24b99c39a002/7a51dfd9-a294-4d40-adbc-975dd338c072) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:46:04.277658 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27903743-db4a-4eb5-a949-c508792de53a req-9f3d5a46-f892-4675-bd5f-bf31ea6fa46a tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=f9a04051-952f-4c6e-b436-24b66478b4a1 HTTP/1.1" status: 200 len: 210 time: 0.0302479 Dec 09 21:46:04.391071 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cdedc7ce-35d2-47da-b93d-1b27af17eb93 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:04.398628 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cdedc7ce-35d2-47da-b93d-1b27af17eb93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:04.443403 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cdedc7ce-35d2-47da-b93d-1b27af17eb93 None None] Network 82d7c06a-099a-4252-898c-7cb41864db84 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:46:04.446561 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-cdedc7ce-35d2-47da-b93d-1b27af17eb93 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:04.450225 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cdedc7ce-35d2-47da-b93d-1b27af17eb93 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:46:04.468337 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-276f6b63-f1d0-48f3-9985-e1df101b85f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Allocated IP 2001:db8::167 (82d7c06a-099a-4252-898c-7cb41864db84/87d49a3f-16b8-4ea7-ae3f-24b99c39a002/897f281c-d900-4034-abae-e5afc51224cd) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:46:04.723472 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdedc7ce-35d2-47da-b93d-1b27af17eb93 None None] Pushing event updated for resources: {'Port': ['ID=7a51dfd9-a294-4d40-adbc-975dd338c072,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:04.754095 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-cdedc7ce-35d2-47da-b93d-1b27af17eb93 None None] Attempting to bind port 7a51dfd9-a294-4d40-adbc-975dd338c072 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:46:04.754781 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-cdedc7ce-35d2-47da-b93d-1b27af17eb93 None None] Attempting to bind port 7a51dfd9-a294-4d40-adbc-975dd338c072 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '4f3726c1-716b-4f0e-adf7-5214cc8950ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '82d7c06a-099a-4252-898c-7cb41864db84'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:46:04.755522 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cdedc7ce-35d2-47da-b93d-1b27af17eb93 None None] Attempting to bind port 7a51dfd9-a294-4d40-adbc-975dd338c072 on network 82d7c06a-099a-4252-898c-7cb41864db84 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:46:04.761831 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cdedc7ce-35d2-47da-b93d-1b27af17eb93 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 45, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:46:04.762543 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cdedc7ce-35d2-47da-b93d-1b27af17eb93 None None] Checking segment: {'id': '4f3726c1-716b-4f0e-adf7-5214cc8950ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '82d7c06a-099a-4252-898c-7cb41864db84'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:46:04.763525 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cdedc7ce-35d2-47da-b93d-1b27af17eb93 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:04.764110 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cdedc7ce-35d2-47da-b93d-1b27af17eb93 None None] Bound using segment: {'id': '4f3726c1-716b-4f0e-adf7-5214cc8950ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '82d7c06a-099a-4252-898c-7cb41864db84'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:46:04.764773 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-cdedc7ce-35d2-47da-b93d-1b27af17eb93 None None] Bound port: 7a51dfd9-a294-4d40-adbc-975dd338c072, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4f3726c1-716b-4f0e-adf7-5214cc8950ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '82d7c06a-099a-4252-898c-7cb41864db84'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:46:04.765336 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cdedc7ce-35d2-47da-b93d-1b27af17eb93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:04.801653 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-276f6b63-f1d0-48f3-9985-e1df101b85f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:04.848801 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-276f6b63-f1d0-48f3-9985-e1df101b85f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:04.856065 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-cdedc7ce-35d2-47da-b93d-1b27af17eb93 None None] For port 7a51dfd9-a294-4d40-adbc-975dd338c072, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:46:04.860009 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-cdedc7ce-35d2-47da-b93d-1b27af17eb93 None None] For port 7a51dfd9-a294-4d40-adbc-975dd338c072, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7a51dfd9-a294-4d40-adbc-975dd338c072,segment=NetworkSegment(4f3726c1-716b-4f0e-adf7-5214cc8950ef),segment_id=4f3726c1-716b-4f0e-adf7-5214cc8950ef)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:46:04.867831 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cdedc7ce-35d2-47da-b93d-1b27af17eb93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:04.918122 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-276f6b63-f1d0-48f3-9985-e1df101b85f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network 82d7c06a-099a-4252-898c-7cb41864db84 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:46:04.921475 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-276f6b63-f1d0-48f3-9985-e1df101b85f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Port': ['ID=897f281c-d900-4034-abae-e5afc51224cd,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:04.925700 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-276f6b63-f1d0-48f3-9985-e1df101b85f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:04.928247 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-276f6b63-f1d0-48f3-9985-e1df101b85f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:46:04.934334 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-276f6b63-f1d0-48f3-9985-e1df101b85f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:04.934946 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-276f6b63-f1d0-48f3-9985-e1df101b85f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:04.959220 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdedc7ce-35d2-47da-b93d-1b27af17eb93 None None] Pushing event updated for resources: {'Port': ['ID=7a51dfd9-a294-4d40-adbc-975dd338c072,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:04.969465 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-276f6b63-f1d0-48f3-9985-e1df101b85f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 1.1929812 Dec 09 21:46:04.969710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42016) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:05.096852 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c9ff3452-030a-4712-96d5-c36607eb9683 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting port 897f281c-d900-4034-abae-e5afc51224cd {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:05.097845 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c9ff3452-030a-4712-96d5-c36607eb9683 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:05.245026 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c9ff3452-030a-4712-96d5-c36607eb9683 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:05.289671 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c9ff3452-030a-4712-96d5-c36607eb9683 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Calling delete_port for 897f281c-d900-4034-abae-e5afc51224cd owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:05.484878 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c9ff3452-030a-4712-96d5-c36607eb9683 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:05.522159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9ff3452-030a-4712-96d5-c36607eb9683 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Port': ['ID=897f281c-d900-4034-abae-e5afc51224cd,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:05.561659 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c9ff3452-030a-4712-96d5-c36607eb9683 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:05.566944 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c9ff3452-030a-4712-96d5-c36607eb9683 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/ports/897f281c-d900-4034-abae-e5afc51224cd HTTP/1.1" status: 204 len: 168 time: 0.5961473 Dec 09 21:46:05.567418 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ac13b2e9-9001-4fba-a4ef-1b9d7874f9b6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:05.569547 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42048) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:05.596219 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-8a2692e2-c863-4f5c-8a3c-b72105b97141 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] DELETE failed (client error): The resource could not be found. Dec 09 21:46:05.597066 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8a2692e2-c863-4f5c-8a3c-b72105b97141 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:46:05.600185 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8a2692e2-c863-4f5c-8a3c-b72105b97141 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/ports/897f281c-d900-4034-abae-e5afc51224cd HTTP/1.1" status: 404 len: 333 time: 0.0294735 Dec 09 21:46:05.603078 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42054) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:05.632920 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-aac4ba36-254f-4f1f-95c5-1b1da398e177 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] GET failed (client error): The resource could not be found. Dec 09 21:46:05.634658 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-aac4ba36-254f-4f1f-95c5-1b1da398e177 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports/897f281c-d900-4034-abae-e5afc51224cd HTTP/1.1" status: 404 len: 333 time: 0.0305479 Dec 09 21:46:05.637711 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42058) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:05.747769 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a4e54ed-ff6d-47aa-8099-d15b7d98e33a req-87ebf5d3-aaf5-44b3-b7c0-9322ef1e58ab tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:05.749686 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2a4e54ed-ff6d-47aa-8099-d15b7d98e33a req-87ebf5d3-aaf5-44b3-b7c0-9322ef1e58ab tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=19f2fc87-2a43-4349-a873-6d310f0c574e HTTP/1.1" status: 200 len: 946 time: 0.1260104 Dec 09 21:46:05.754535 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-70834b59-ba82-43f3-929e-d4bd14e48170 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting subnet 87d49a3f-16b8-4ea7-ae3f-24b99c39a002 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:46:05.759840 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70834b59-ba82-43f3-929e-d4bd14e48170 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:05.871466 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70834b59-ba82-43f3-929e-d4bd14e48170 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:05.879689 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2a4e54ed-ff6d-47aa-8099-d15b7d98e33a req-2ba4fea5-01d3-4066-8ca9-5b3f2c308d89 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1214757 Dec 09 21:46:06.208077 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6def84d3-3e6d-4d29-b355-9770ce791d4e None None] Network 82d7c06a-099a-4252-898c-7cb41864db84 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:46:06.214642 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42080) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:06.290199 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d7e967cf-37ed-4b8a-bb61-f659b7d734bd None None] Provisioning complete for port 7a51dfd9-a294-4d40-adbc-975dd338c072 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:06.290672 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d7e967cf-37ed-4b8a-bb61-f659b7d734bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:06.324927 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 25f69b99-160f-4f73-bc4c-738b6fa17cbd no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:46:06.378702 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70834b59-ba82-43f3-929e-d4bd14e48170 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:06.389718 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aaa2141e-cc4e-4018-9ad9-631160bfc476 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:06.417163 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 25f69b99-160f-4f73-bc4c-738b6fa17cbd {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:46:06.417544 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 25f69b99-160f-4f73-bc4c-738b6fa17cbd not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:46:06.443748 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70834b59-ba82-43f3-929e-d4bd14e48170 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:06.477121 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d7e967cf-37ed-4b8a-bb61-f659b7d734bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:06.478869 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70834b59-ba82-43f3-929e-d4bd14e48170 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Subnet': ['ID=87d49a3f-16b8-4ea7-ae3f-24b99c39a002,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:06.481089 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-70834b59-ba82-43f3-929e-d4bd14e48170 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:06.485493 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-70834b59-ba82-43f3-929e-d4bd14e48170 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/subnets/87d49a3f-16b8-4ea7-ae3f-24b99c39a002 HTTP/1.1" status: 204 len: 168 time: 0.8462319 Dec 09 21:46:06.488536 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42088) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:06.551236 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aaa2141e-cc4e-4018-9ad9-631160bfc476 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:06.557547 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aaa2141e-cc4e-4018-9ad9-631160bfc476 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:06.575991 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-d7e967cf-37ed-4b8a-bb61-f659b7d734bd None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:46:06.577964 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-d7e967cf-37ed-4b8a-bb61-f659b7d734bd None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:46:06.611345 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9f8d4863-fcee-4af3-beb0-80cdb9c618fe tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:06.645531 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:06.651037 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-aaa2141e-cc4e-4018-9ad9-631160bfc476 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=fdfd8d07dc00456ba79e09b49014cf04&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4349239 Dec 09 21:46:06.652290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaa2141e-cc4e-4018-9ad9-631160bfc476 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b45ee7d9-b6f2-4125-9183-0c3036595e71,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:06.653816 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42094) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:06.737184 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7a51dfd9-a294-4d40-adbc-975dd338c072 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:46:06.748623 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0fa0cb01-fb41-4120-868d-27a1a17d53da admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:06.788916 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-9f8d4863-fcee-4af3-beb0-80cdb9c618fe tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting port 7a51dfd9-a294-4d40-adbc-975dd338c072 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:06.789263 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9f8d4863-fcee-4af3-beb0-80cdb9c618fe tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:06.827949 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da507337-ec37-40a3-bca1-d45a6a0ad8e5 None None] Network 82d7c06a-099a-4252-898c-7cb41864db84 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:46:06.863262 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0fa0cb01-fb41-4120-868d-27a1a17d53da admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:06.878160 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-9f8d4863-fcee-4af3-beb0-80cdb9c618fe tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] For port 7a51dfd9-a294-4d40-adbc-975dd338c072, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7a51dfd9-a294-4d40-adbc-975dd338c072,segment=NetworkSegment(4f3726c1-716b-4f0e-adf7-5214cc8950ef),segment_id=4f3726c1-716b-4f0e-adf7-5214cc8950ef)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:06.878533 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9f8d4863-fcee-4af3-beb0-80cdb9c618fe tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:06.903174 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-9f8d4863-fcee-4af3-beb0-80cdb9c618fe tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Calling delete_port for 7a51dfd9-a294-4d40-adbc-975dd338c072 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:06.974606 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 7a51dfd9-a294-4d40-adbc-975dd338c072 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:06.975156 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:06.999884 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0fa0cb01-fb41-4120-868d-27a1a17d53da admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:07.002742 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0fa0cb01-fb41-4120-868d-27a1a17d53da admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:07.006428 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0fa0cb01-fb41-4120-868d-27a1a17d53da admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/b45ee7d9-b6f2-4125-9183-0c3036595e71 HTTP/1.1" status: 204 len: 168 time: 0.3490140 Dec 09 21:46:07.093809 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fa0cb01-fb41-4120-868d-27a1a17d53da admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b45ee7d9-b6f2-4125-9183-0c3036595e71,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:07.147380 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3808801b-c9d9-4968-b0e0-5572ab7d1241 req-d9a8c49a-e205-4491-8f17-4424604961d8 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:07.154852 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3808801b-c9d9-4968-b0e0-5572ab7d1241 req-d9a8c49a-e205-4491-8f17-4424604961d8 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=19f2fc87-2a43-4349-a873-6d310f0c574e HTTP/1.1" status: 200 len: 946 time: 0.1582510 Dec 09 21:46:07.158129 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-61363cbc-40ea-4df8-96be-81b2dee1302d None None] DHCP port deletion for 82d7c06a-099a-4252-898c-7cb41864db84 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:46:07.163130 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9f8d4863-fcee-4af3-beb0-80cdb9c618fe tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:07.193679 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1109746e-2223-47a9-a898-4ea0c180686b req-c507d21b-0e46-4264-a5e2-e2d3dbd8c4b3 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:07.206090 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f8d4863-fcee-4af3-beb0-80cdb9c618fe tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Port': ['ID=7a51dfd9-a294-4d40-adbc-975dd338c072,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:07.206335 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1109746e-2223-47a9-a898-4ea0c180686b req-c507d21b-0e46-4264-a5e2-e2d3dbd8c4b3 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.31 "GET /v2.0/ports?device_id=19f2fc87-2a43-4349-a873-6d310f0c574e HTTP/1.1" status: 200 len: 946 time: 0.1417062 Dec 09 21:46:07.209927 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f8d4863-fcee-4af3-beb0-80cdb9c618fe tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] No DVR routers for this DVR port 7a51dfd9-a294-4d40-adbc-975dd338c072 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:46:07.214431 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:07.231294 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d7e967cf-37ed-4b8a-bb61-f659b7d734bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:07.300428 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3808801b-c9d9-4968-b0e0-5572ab7d1241 req-0c74597e-242f-4a14-839b-52f5bd8b299d tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1393671 Dec 09 21:46:07.353335 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9f8d4863-fcee-4af3-beb0-80cdb9c618fe tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:07.396225 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-9f8d4863-fcee-4af3-beb0-80cdb9c618fe tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['82d7c06a-099a-4252-898c-7cb41864db84']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:07.423004 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-9f8d4863-fcee-4af3-beb0-80cdb9c618fe tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4f3726c1-716b-4f0e-adf7-5214cc8950ef') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:07.425021 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-9f8d4863-fcee-4af3-beb0-80cdb9c618fe tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4f3726c1-716b-4f0e-adf7-5214cc8950ef') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:07.442315 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9f8d4863-fcee-4af3-beb0-80cdb9c618fe tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:07.457917 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-98f58b47-ffdb-4173-a431-6a8a308f17b8 None None] Could not find standard attr ID for object 7a51dfd9-a294-4d40-adbc-975dd338c072. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:46:07.460378 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-1109746e-2223-47a9-a898-4ea0c180686b req-0fcc60ac-9d54-4e67-ac9a-7af264d77612 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Deleting port bd9c1c28-304b-4656-bd19-43407d1b6dc2 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:07.460727 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1109746e-2223-47a9-a898-4ea0c180686b req-0fcc60ac-9d54-4e67-ac9a-7af264d77612 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:07.470787 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9f8d4863-fcee-4af3-beb0-80cdb9c618fe tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:07.484626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9f8d4863-fcee-4af3-beb0-80cdb9c618fe tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Releasing vlan 119 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:46:07.484626 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9f8d4863-fcee-4af3-beb0-80cdb9c618fe tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:46:07.495474 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:46:07.571176 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9f8d4863-fcee-4af3-beb0-80cdb9c618fe tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:07.590432 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-1109746e-2223-47a9-a898-4ea0c180686b req-0fcc60ac-9d54-4e67-ac9a-7af264d77612 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] For port bd9c1c28-304b-4656-bd19-43407d1b6dc2, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=bd9c1c28-304b-4656-bd19-43407d1b6dc2,segment=NetworkSegment(0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5),segment_id=0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:07.591764 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1109746e-2223-47a9-a898-4ea0c180686b req-0fcc60ac-9d54-4e67-ac9a-7af264d77612 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:07.591935 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9f8d4863-fcee-4af3-beb0-80cdb9c618fe tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:07.599368 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9f8d4863-fcee-4af3-beb0-80cdb9c618fe tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/networks/82d7c06a-099a-4252-898c-7cb41864db84 HTTP/1.1" status: 204 len: 168 time: 1.1096509 Dec 09 21:46:07.600856 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f8d4863-fcee-4af3-beb0-80cdb9c618fe tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Network': ['ID=82d7c06a-099a-4252-898c-7cb41864db84,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:07.603169 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42114) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:07.609257 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-605b5e2b-613c-4451-b0a5-24ce49263a6d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-109974828'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:07.612534 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-1109746e-2223-47a9-a898-4ea0c180686b req-0fcc60ac-9d54-4e67-ac9a-7af264d77612 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Calling delete_port for bd9c1c28-304b-4656-bd19-43407d1b6dc2 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:07.638863 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42116) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:07.653677 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-605b5e2b-613c-4451-b0a5-24ce49263a6d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:07.657555 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-605b5e2b-613c-4451-b0a5-24ce49263a6d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:07.686524 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a4322aa4-5f24-436b-b8d2-229226234090 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:07.712818 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-605b5e2b-613c-4451-b0a5-24ce49263a6d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] vlan segment allocate from pool success with {'vlan_id': 149, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:46:07.729925 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-605b5e2b-613c-4451-b0a5-24ce49263a6d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:07.730461 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-605b5e2b-613c-4451-b0a5-24ce49263a6d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Added segment 95960946-0813-425a-8551-522b2b781aa3 of type vlan for network de2512c0-48b1-4c46-bb53-024a5daec24e Dec 09 21:46:07.784942 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1109746e-2223-47a9-a898-4ea0c180686b req-0fcc60ac-9d54-4e67-ac9a-7af264d77612 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:07.796403 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-605b5e2b-613c-4451-b0a5-24ce49263a6d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:07.796961 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['33cf4605-a408-4847-9394-fe8acf994c40', 'bd9c1c28-304b-4656-bd19-43407d1b6dc2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:46:07.836891 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fcc60ac-9d54-4e67-ac9a-7af264d77612 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Pushing event deleted for resources: {'Port': ['ID=bd9c1c28-304b-4656-bd19-43407d1b6dc2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:07.897396 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-08cc6839-0d9b-48f3-b39b-d3ca06d762c6 None None] DHCP port deletion for eda4cb39-afde-43d7-a13b-5227cc6862dd request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:46:07.904273 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-1109746e-2223-47a9-a898-4ea0c180686b req-0fcc60ac-9d54-4e67-ac9a-7af264d77612 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] No DVR routers for this DVR port bd9c1c28-304b-4656-bd19-43407d1b6dc2 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:46:07.908027 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1109746e-2223-47a9-a898-4ea0c180686b req-0fcc60ac-9d54-4e67-ac9a-7af264d77612 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:07.911263 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a4322aa4-5f24-436b-b8d2-229226234090 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:07.912581 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-605b5e2b-613c-4451-b0a5-24ce49263a6d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:07.913596 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1109746e-2223-47a9-a898-4ea0c180686b req-0fcc60ac-9d54-4e67-ac9a-7af264d77612 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.31 "DELETE /v2.0/ports/bd9c1c28-304b-4656-bd19-43407d1b6dc2 HTTP/1.1" status: 204 len: 173 time: 0.6966157 Dec 09 21:46:07.914240 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '19f2fc87-2a43-4349-a873-6d310f0c574e', 'name': 'network-vif-deleted', 'tag': 'bd9c1c28-304b-4656-bd19-43407d1b6dc2'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:46:07.918432 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-734d880e-2b9f-457e-af88-e28a71c0dc99" -d '{"events": [{"server_uuid": "19f2fc87-2a43-4349-a873-6d310f0c574e", "name": "network-vif-deleted", "tag": "bd9c1c28-304b-4656-bd19-43407d1b6dc2"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:46:07.937883 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-605b5e2b-613c-4451-b0a5-24ce49263a6d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:07.938615 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-605b5e2b-613c-4451-b0a5-24ce49263a6d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:07.982896 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a4322aa4-5f24-436b-b8d2-229226234090 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:07.992497 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:46:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b55a0005-bf0f-45db-b708-c75e660dcc3e x-openstack-request-id: req-b55a0005-bf0f-45db-b708-c75e660dcc3e {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:46:07.993047 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "19f2fc87-2a43-4349-a873-6d310f0c574e", "name": "network-vif-deleted", "tag": "bd9c1c28-304b-4656-bd19-43407d1b6dc2", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:46:07.993471 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-b55a0005-bf0f-45db-b708-c75e660dcc3e {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:46:07.994305 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '19f2fc87-2a43-4349-a873-6d310f0c574e', 'name': 'network-vif-deleted', 'tag': 'bd9c1c28-304b-4656-bd19-43407d1b6dc2', 'status': 'completed', 'code': 200} Dec 09 21:46:08.016037 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-605b5e2b-613c-4451-b0a5-24ce49263a6d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.4115324 Dec 09 21:46:08.019065 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42124) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:08.024296 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2a2259be-0f3f-41f6-b0bc-fbd9b40e2b9f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'subnet': {'network_id': 'de2512c0-48b1-4c46-bb53-024a5daec24e', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:08.134389 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:08.182198 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a4322aa4-5f24-436b-b8d2-229226234090 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=65953f78b8654c3c98a919ed81e55146&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5397890 Dec 09 21:46:08.182198 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4322aa4-5f24-436b-b8d2-229226234090 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6fe41922-4406-4154-bf75-815a46de214c,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:08.182569 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42130) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:08.185050 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-605b5e2b-613c-4451-b0a5-24ce49263a6d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Network': ['ID=de2512c0-48b1-4c46-bb53-024a5daec24e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:08.207008 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network de2512c0-48b1-4c46-bb53-024a5daec24e details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:46:08.290970 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2a2259be-0f3f-41f6-b0bc-fbd9b40e2b9f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:08.294528 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a2259be-0f3f-41f6-b0bc-fbd9b40e2b9f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:08.314893 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-97ad15e8-9253-4ce6-8ccc-6e85765955da admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:08.386124 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-97ad15e8-9253-4ce6-8ccc-6e85765955da admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:08.456376 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae04d445-51f3-4638-a638-d345a89c32f1 req-288a9226-2001-4abe-9b97-f9cc1f3109af tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=19f2fc87-2a43-4349-a873-6d310f0c574e HTTP/1.1" status: 200 len: 210 time: 0.0666742 Dec 09 21:46:08.520510 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-97ad15e8-9253-4ce6-8ccc-6e85765955da admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:08.524278 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-97ad15e8-9253-4ce6-8ccc-6e85765955da admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:08.525767 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-97ad15e8-9253-4ce6-8ccc-6e85765955da admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/6fe41922-4406-4154-bf75-815a46de214c HTTP/1.1" status: 204 len: 168 time: 0.3422022 Dec 09 21:46:08.550864 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97ad15e8-9253-4ce6-8ccc-6e85765955da admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6fe41922-4406-4154-bf75-815a46de214c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:08.604500 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a2259be-0f3f-41f6-b0bc-fbd9b40e2b9f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:08.698009 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7a51dfd9-a294-4d40-adbc-975dd338c072 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:46:08.711002 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a2259be-0f3f-41f6-b0bc-fbd9b40e2b9f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Subnet': ['ID=51badf76-fa18-44d6-82f5-fdafd2823781,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:08.719068 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2a2259be-0f3f-41f6-b0bc-fbd9b40e2b9f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Checking segment: {'id': '95960946-0813-425a-8551-522b2b781aa3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'de2512c0-48b1-4c46-bb53-024a5daec24e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:46:08.719981 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 7a51dfd9-a294-4d40-adbc-975dd338c072 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:46:08.720465 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7a51dfd9-a294-4d40-adbc-975dd338c072 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:46:08.721590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a2259be-0f3f-41f6-b0bc-fbd9b40e2b9f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network hostable DHCP agents. Network: de2512c0-48b1-4c46-bb53-024a5daec24e, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:46:08.740807 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a2259be-0f3f-41f6-b0bc-fbd9b40e2b9f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network de2512c0-48b1-4c46-bb53-024a5daec24e is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:46:08.752657 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-2a2259be-0f3f-41f6-b0bc-fbd9b40e2b9f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, de2512c0-48b1-4c46-bb53-024a5daec24e) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:08.757605 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a2259be-0f3f-41f6-b0bc-fbd9b40e2b9f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:08.758340 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a2259be-0f3f-41f6-b0bc-fbd9b40e2b9f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:08.763730 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b5a06d34-fb5a-474a-b2bf-3ed39a79c317 None None] Network de2512c0-48b1-4c46-bb53-024a5daec24e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:46:08.782406 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42142) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:08.783419 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2a2259be-0f3f-41f6-b0bc-fbd9b40e2b9f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.7629771 Dec 09 21:46:08.789867 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-b2c674d5-2b5e-4844-99e5-02e12db45ea5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'port': {'network_id': 'de2512c0-48b1-4c46-bb53-024a5daec24e', 'security_groups': [], 'name': 'tempest-PortsIpV6TestJSON-1998308770'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:08.926318 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b2c674d5-2b5e-4844-99e5-02e12db45ea5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:08.927151 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bcc0b7da-9a99-445c-b012-97388cd9289f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-de2512c0-48b1-4c46-bb53-024a5daec24e', 'network_id': 'de2512c0-48b1-4c46-bb53-024a5daec24e', 'project_id': '9560c66e717c47918bfe698e159759c5', 'fixed_ips': [{'subnet_id': '51badf76-fa18-44d6-82f5-fdafd2823781'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:46:08.928173 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bcc0b7da-9a99-445c-b012-97388cd9289f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:08.933229 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b2c674d5-2b5e-4844-99e5-02e12db45ea5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:08.971908 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-b2c674d5-2b5e-4844-99e5-02e12db45ea5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] device_id is not set on port ff69fa5b-f790-477e-b859-3b61e0d4084d yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:46:09.089161 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-bcc0b7da-9a99-445c-b012-97388cd9289f None None] Allocated IP 2001:db8::2 (de2512c0-48b1-4c46-bb53-024a5daec24e/51badf76-fa18-44d6-82f5-fdafd2823781/c523c369-7c6d-478e-84cb-10e85f20f9d2) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:46:09.249408 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bcc0b7da-9a99-445c-b012-97388cd9289f None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:09.256500 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bcc0b7da-9a99-445c-b012-97388cd9289f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:09.307359 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bcc0b7da-9a99-445c-b012-97388cd9289f None None] Network de2512c0-48b1-4c46-bb53-024a5daec24e is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:46:09.310942 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-bcc0b7da-9a99-445c-b012-97388cd9289f None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:09.318463 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bcc0b7da-9a99-445c-b012-97388cd9289f None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:46:09.326482 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcc0b7da-9a99-445c-b012-97388cd9289f None None] Pushing event updated for resources: {'Port': ['ID=c523c369-7c6d-478e-84cb-10e85f20f9d2,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:09.343772 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.db.api [None req-b2c674d5-2b5e-4844-99e5-02e12db45ea5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Retry wrapper got retriable exception: Failed to create a duplicate IpamAllocation: for attribute(s) ['ipamallocations.PRIMARY'] with value(s) 2001:db8::2-8eb69b6f-152c-46c2-954c-340345b2cdfa {{(pid=103438) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:46:09.344093 n-d-713301-27 neutron-server[103438]: DEBUG oslo_db.api [None req-b2c674d5-2b5e-4844-99e5-02e12db45ea5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.create_port {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:46:09.387737 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-bcc0b7da-9a99-445c-b012-97388cd9289f None None] Attempting to bind port c523c369-7c6d-478e-84cb-10e85f20f9d2 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:46:09.388470 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-bcc0b7da-9a99-445c-b012-97388cd9289f None None] Attempting to bind port c523c369-7c6d-478e-84cb-10e85f20f9d2 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '95960946-0813-425a-8551-522b2b781aa3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'de2512c0-48b1-4c46-bb53-024a5daec24e'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:46:09.388838 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcc0b7da-9a99-445c-b012-97388cd9289f None None] Attempting to bind port c523c369-7c6d-478e-84cb-10e85f20f9d2 on network de2512c0-48b1-4c46-bb53-024a5daec24e {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:46:09.394102 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcc0b7da-9a99-445c-b012-97388cd9289f None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 45, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:46:09.394468 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcc0b7da-9a99-445c-b012-97388cd9289f None None] Checking segment: {'id': '95960946-0813-425a-8551-522b2b781aa3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'de2512c0-48b1-4c46-bb53-024a5daec24e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:46:09.394867 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bcc0b7da-9a99-445c-b012-97388cd9289f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:09.395261 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcc0b7da-9a99-445c-b012-97388cd9289f None None] Bound using segment: {'id': '95960946-0813-425a-8551-522b2b781aa3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'de2512c0-48b1-4c46-bb53-024a5daec24e'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:46:09.395747 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-bcc0b7da-9a99-445c-b012-97388cd9289f None None] Bound port: c523c369-7c6d-478e-84cb-10e85f20f9d2, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '95960946-0813-425a-8551-522b2b781aa3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': 'de2512c0-48b1-4c46-bb53-024a5daec24e'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:46:09.396124 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bcc0b7da-9a99-445c-b012-97388cd9289f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:09.462871 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-bcc0b7da-9a99-445c-b012-97388cd9289f None None] For port c523c369-7c6d-478e-84cb-10e85f20f9d2, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:46:09.467131 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-bcc0b7da-9a99-445c-b012-97388cd9289f None None] For port c523c369-7c6d-478e-84cb-10e85f20f9d2, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c523c369-7c6d-478e-84cb-10e85f20f9d2,segment=NetworkSegment(95960946-0813-425a-8551-522b2b781aa3),segment_id=95960946-0813-425a-8551-522b2b781aa3)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:46:09.473340 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bcc0b7da-9a99-445c-b012-97388cd9289f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:09.540839 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcc0b7da-9a99-445c-b012-97388cd9289f None None] Pushing event updated for resources: {'Port': ['ID=c523c369-7c6d-478e-84cb-10e85f20f9d2,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:09.677072 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:09.849724 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b2c674d5-2b5e-4844-99e5-02e12db45ea5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:09.872598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-b2c674d5-2b5e-4844-99e5-02e12db45ea5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] device_id is not set on port f92ac21c-4d11-4f0f-aba9-154665b598e2 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:46:10.029197 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-b2c674d5-2b5e-4844-99e5-02e12db45ea5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Allocated IP 2001:db8::7b (de2512c0-48b1-4c46-bb53-024a5daec24e/51badf76-fa18-44d6-82f5-fdafd2823781/f92ac21c-4d11-4f0f-aba9-154665b598e2) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:46:10.221317 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b2c674d5-2b5e-4844-99e5-02e12db45ea5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:10.257528 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b2c674d5-2b5e-4844-99e5-02e12db45ea5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:10.302897 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2c674d5-2b5e-4844-99e5-02e12db45ea5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network de2512c0-48b1-4c46-bb53-024a5daec24e is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:46:10.304592 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-b2c674d5-2b5e-4844-99e5-02e12db45ea5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:10.308195 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device bd9c1c28-304b-4656-bd19-43407d1b6dc2 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:46:10.308705 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2c674d5-2b5e-4844-99e5-02e12db45ea5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:46:10.314121 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2c674d5-2b5e-4844-99e5-02e12db45ea5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:10.315011 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b2c674d5-2b5e-4844-99e5-02e12db45ea5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:10.338552 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2c674d5-2b5e-4844-99e5-02e12db45ea5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Port': ['ID=f92ac21c-4d11-4f0f-aba9-154665b598e2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:10.351756 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b2c674d5-2b5e-4844-99e5-02e12db45ea5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 892 time: 1.5676079 Dec 09 21:46:10.354685 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42204) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:10.359967 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: bd9c1c28-304b-4656-bd19-43407d1b6dc2 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:46:10.361368 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device bd9c1c28-304b-4656-bd19-43407d1b6dc2 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:46:10.529203 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-ace7b8ca-4401-4d2e-9857-0cdc6574f084 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting port f92ac21c-4d11-4f0f-aba9-154665b598e2 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:10.529837 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ace7b8ca-4401-4d2e-9857-0cdc6574f084 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:10.716796 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ace7b8ca-4401-4d2e-9857-0cdc6574f084 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:10.756665 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-ace7b8ca-4401-4d2e-9857-0cdc6574f084 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Calling delete_port for f92ac21c-4d11-4f0f-aba9-154665b598e2 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:10.796861 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c523c369-7c6d-478e-84cb-10e85f20f9d2 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:46:10.896254 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port c523c369-7c6d-478e-84cb-10e85f20f9d2 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:10.896934 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:11.014532 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ace7b8ca-4401-4d2e-9857-0cdc6574f084 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:11.068973 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:11.080860 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2644f715-34af-4f66-abc3-b6a7401e3d82 None None] Network de2512c0-48b1-4c46-bb53-024a5daec24e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:46:11.088413 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ace7b8ca-4401-4d2e-9857-0cdc6574f084 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Port': ['ID=f92ac21c-4d11-4f0f-aba9-154665b598e2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:11.114678 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ace7b8ca-4401-4d2e-9857-0cdc6574f084 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:11.118239 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ace7b8ca-4401-4d2e-9857-0cdc6574f084 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/ports/f92ac21c-4d11-4f0f-aba9-154665b598e2 HTTP/1.1" status: 204 len: 168 time: 0.7623394 Dec 09 21:46:11.121142 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42222) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:11.150672 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-8c838a4f-bfa3-4939-99ee-e03c9864f9b2 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] GET failed (client error): The resource could not be found. Dec 09 21:46:11.152665 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8c838a4f-bfa3-4939-99ee-e03c9864f9b2 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports/f92ac21c-4d11-4f0f-aba9-154665b598e2 HTTP/1.1" status: 404 len: 333 time: 0.0298676 Dec 09 21:46:11.155641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42224) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:11.221882 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-4638b4f9-3b4e-4993-ac04-b3d73747cd40 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting subnet 51badf76-fa18-44d6-82f5-fdafd2823781 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:46:11.226641 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4638b4f9-3b4e-4993-ac04-b3d73747cd40 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:11.287497 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4638b4f9-3b4e-4993-ac04-b3d73747cd40 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:11.372920 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port c523c369-7c6d-478e-84cb-10e85f20f9d2, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c523c369-7c6d-478e-84cb-10e85f20f9d2,segment=NetworkSegment(95960946-0813-425a-8551-522b2b781aa3),segment_id=95960946-0813-425a-8551-522b2b781aa3)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:11.382241 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-fcde1ea3-3b2e-4386-8ef9-3696c94b0c02 None None] Provisioning complete for port c523c369-7c6d-478e-84cb-10e85f20f9d2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:11.382841 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fcde1ea3-3b2e-4386-8ef9-3696c94b0c02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:11.398064 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:11.407667 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4638b4f9-3b4e-4993-ac04-b3d73747cd40 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:11.508215 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4638b4f9-3b4e-4993-ac04-b3d73747cd40 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:11.518658 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=c523c369-7c6d-478e-84cb-10e85f20f9d2,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:11.550353 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4638b4f9-3b4e-4993-ac04-b3d73747cd40 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Subnet': ['ID=51badf76-fa18-44d6-82f5-fdafd2823781,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:11.570582 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4638b4f9-3b4e-4993-ac04-b3d73747cd40 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:11.582903 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4638b4f9-3b4e-4993-ac04-b3d73747cd40 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/subnets/51badf76-fa18-44d6-82f5-fdafd2823781 HTTP/1.1" status: 204 len: 168 time: 0.4252348 Dec 09 21:46:11.586065 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42238) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:11.587783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4638b4f9-3b4e-4993-ac04-b3d73747cd40 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:11.588140 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4638b4f9-3b4e-4993-ac04-b3d73747cd40 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:11.588487 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4638b4f9-3b4e-4993-ac04-b3d73747cd40 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:11.588824 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4638b4f9-3b4e-4993-ac04-b3d73747cd40 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:11.589166 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4638b4f9-3b4e-4993-ac04-b3d73747cd40 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:11.589502 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4638b4f9-3b4e-4993-ac04-b3d73747cd40 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:11.589837 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4638b4f9-3b4e-4993-ac04-b3d73747cd40 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:11.590168 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4638b4f9-3b4e-4993-ac04-b3d73747cd40 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:11.597649 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4638b4f9-3b4e-4993-ac04-b3d73747cd40 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:11.598015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4638b4f9-3b4e-4993-ac04-b3d73747cd40 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:11.598356 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4638b4f9-3b4e-4993-ac04-b3d73747cd40 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:11.598823 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4638b4f9-3b4e-4993-ac04-b3d73747cd40 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:11.599069 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4638b4f9-3b4e-4993-ac04-b3d73747cd40 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:11.689669 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01c14db6-9d35-4b94-a42f-0479b2bf9a63 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:11.723308 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e7fa05d-6819-41a0-bf19-c4c5490b2c45 None None] Network de2512c0-48b1-4c46-bb53-024a5daec24e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:46:11.771531 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-01c14db6-9d35-4b94-a42f-0479b2bf9a63 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting port c523c369-7c6d-478e-84cb-10e85f20f9d2 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:11.771995 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01c14db6-9d35-4b94-a42f-0479b2bf9a63 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:11.882282 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-01c14db6-9d35-4b94-a42f-0479b2bf9a63 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] For port c523c369-7c6d-478e-84cb-10e85f20f9d2, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c523c369-7c6d-478e-84cb-10e85f20f9d2,segment=NetworkSegment(95960946-0813-425a-8551-522b2b781aa3),segment_id=95960946-0813-425a-8551-522b2b781aa3)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:11.883003 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01c14db6-9d35-4b94-a42f-0479b2bf9a63 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:11.897425 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-01c14db6-9d35-4b94-a42f-0479b2bf9a63 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Calling delete_port for c523c369-7c6d-478e-84cb-10e85f20f9d2 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:11.907686 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-48d89f3f-4c38-4a85-a168-d30f3a2dad0c None None] Provisioning complete for port c523c369-7c6d-478e-84cb-10e85f20f9d2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:11.908266 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-48d89f3f-4c38-4a85-a168-d30f3a2dad0c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:12.005464 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01c14db6-9d35-4b94-a42f-0479b2bf9a63 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:12.067491 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01c14db6-9d35-4b94-a42f-0479b2bf9a63 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] No DVR routers for this DVR port c523c369-7c6d-478e-84cb-10e85f20f9d2 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:46:12.069706 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-47ad31d9-be68-4a6e-a87b-1d3fcdb9ac58 None None] DHCP port deletion for de2512c0-48b1-4c46-bb53-024a5daec24e request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:46:12.069916 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01c14db6-9d35-4b94-a42f-0479b2bf9a63 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Port': ['ID=c523c369-7c6d-478e-84cb-10e85f20f9d2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:12.180156 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01c14db6-9d35-4b94-a42f-0479b2bf9a63 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:12.214922 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-01c14db6-9d35-4b94-a42f-0479b2bf9a63 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['de2512c0-48b1-4c46-bb53-024a5daec24e']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:12.226280 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-01c14db6-9d35-4b94-a42f-0479b2bf9a63 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '95960946-0813-425a-8551-522b2b781aa3') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:12.226559 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-01c14db6-9d35-4b94-a42f-0479b2bf9a63 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '95960946-0813-425a-8551-522b2b781aa3') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:12.237835 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01c14db6-9d35-4b94-a42f-0479b2bf9a63 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:12.251306 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01c14db6-9d35-4b94-a42f-0479b2bf9a63 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:12.257918 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-01c14db6-9d35-4b94-a42f-0479b2bf9a63 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Releasing vlan 149 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:46:12.258439 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01c14db6-9d35-4b94-a42f-0479b2bf9a63 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:46:12.261718 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:46:12.345100 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01c14db6-9d35-4b94-a42f-0479b2bf9a63 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:12.366038 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-01c14db6-9d35-4b94-a42f-0479b2bf9a63 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:12.377710 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-01c14db6-9d35-4b94-a42f-0479b2bf9a63 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/networks/de2512c0-48b1-4c46-bb53-024a5daec24e HTTP/1.1" status: 204 len: 168 time: 0.7904294 Dec 09 21:46:12.378601 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42256) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:12.392799 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-d61fc47c-f28b-4fc7-9e27-81b90b9e37e1 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'port': {'network_id': '6150e6df-2b72-4f1d-912c-2256eb16e2b3', 'name': 'tempest-PortsIpV6TestJSON-2054412272'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:12.403534 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01c14db6-9d35-4b94-a42f-0479b2bf9a63 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Network': ['ID=de2512c0-48b1-4c46-bb53-024a5daec24e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:12.539692 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c07a9713-f58c-47be-9a5a-922d9efde520 req-ae832d73-8839-442c-94a1-7129fd49b16b tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:12.547220 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c07a9713-f58c-47be-9a5a-922d9efde520 req-ae832d73-8839-442c-94a1-7129fd49b16b tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 1098 time: 0.1128054 Dec 09 21:46:12.567783 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c07a9713-f58c-47be-9a5a-922d9efde520 req-0c8f2d31-d54f-4d8f-b91f-3b31ada8d9e0 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:12.642495 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d61fc47c-f28b-4fc7-9e27-81b90b9e37e1 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:12.646505 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d61fc47c-f28b-4fc7-9e27-81b90b9e37e1 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:12.705252 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-d61fc47c-f28b-4fc7-9e27-81b90b9e37e1 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] device_id is not set on port f2a16096-70de-4df0-837c-90e99263af19 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:46:12.755119 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c523c369-7c6d-478e-84cb-10e85f20f9d2 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:46:12.783514 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: c523c369-7c6d-478e-84cb-10e85f20f9d2 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:46:12.784234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c523c369-7c6d-478e-84cb-10e85f20f9d2 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:46:12.912893 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c07a9713-f58c-47be-9a5a-922d9efde520 req-0c8f2d31-d54f-4d8f-b91f-3b31ada8d9e0 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:12.924671 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d61fc47c-f28b-4fc7-9e27-81b90b9e37e1 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:12.929035 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c07a9713-f58c-47be-9a5a-922d9efde520 req-0c8f2d31-d54f-4d8f-b91f-3b31ada8d9e0 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:12.958818 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c07a9713-f58c-47be-9a5a-922d9efde520 req-0c8f2d31-d54f-4d8f-b91f-3b31ada8d9e0 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.4107556 Dec 09 21:46:12.985496 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c8f2d31-d54f-4d8f-b91f-3b31ada8d9e0 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2b662a7b-61cc-471a-b834-dfeada7ed11a,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:13.012229 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d61fc47c-f28b-4fc7-9e27-81b90b9e37e1 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:13.063911 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d61fc47c-f28b-4fc7-9e27-81b90b9e37e1 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:46:13.068169 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-d61fc47c-f28b-4fc7-9e27-81b90b9e37e1 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:13.071888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d61fc47c-f28b-4fc7-9e27-81b90b9e37e1 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:46:13.078263 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d61fc47c-f28b-4fc7-9e27-81b90b9e37e1 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:13.078893 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d61fc47c-f28b-4fc7-9e27-81b90b9e37e1 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:13.092919 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:46:13.103494 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d61fc47c-f28b-4fc7-9e27-81b90b9e37e1 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Port': ['ID=f2a16096-70de-4df0-837c-90e99263af19,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:13.134398 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d61fc47c-f28b-4fc7-9e27-81b90b9e37e1 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 850 time: 0.7516396 Dec 09 21:46:13.136049 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42272) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:13.154944 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0372d52a-1c85-458e-8c26-e99b9cf44243 req-ad48038f-2212-4c0d-91b0-d85c76ee4b4e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:13.162791 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0372d52a-1c85-458e-8c26-e99b9cf44243 req-ad48038f-2212-4c0d-91b0-d85c76ee4b4e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.0757339 Dec 09 21:46:13.221865 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0372d52a-1c85-458e-8c26-e99b9cf44243 req-41580dee-4c66-4f7f-a6c7-8cf5262b1550 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0559270 Dec 09 21:46:13.236660 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42278) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:13.264119 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-0397f52d-8985-4aa7-b8d1-fbf08536212e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting port f2a16096-70de-4df0-837c-90e99263af19 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:13.264470 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0397f52d-8985-4aa7-b8d1-fbf08536212e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:13.327102 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e8b603e2-0bf2-4738-a2cc-57a4744e12e9 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/floatingips/8586a0ac-8d71-46f3-ae0a-75565c281860 HTTP/1.1" status: 200 len: 994 time: 0.0864968 Dec 09 21:46:13.351745 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0397f52d-8985-4aa7-b8d1-fbf08536212e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:13.366478 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-0397f52d-8985-4aa7-b8d1-fbf08536212e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Calling delete_port for f2a16096-70de-4df0-837c-90e99263af19 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:13.478330 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0397f52d-8985-4aa7-b8d1-fbf08536212e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:13.506654 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0397f52d-8985-4aa7-b8d1-fbf08536212e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Port': ['ID=f2a16096-70de-4df0-837c-90e99263af19,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:13.527426 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0397f52d-8985-4aa7-b8d1-fbf08536212e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:13.539594 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0397f52d-8985-4aa7-b8d1-fbf08536212e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/ports/f2a16096-70de-4df0-837c-90e99263af19 HTTP/1.1" status: 204 len: 168 time: 0.4016321 Dec 09 21:46:13.540072 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42292) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:13.545219 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-7f9c1f9f-fd79-40e4-9668-acf8e91536d4 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'port': {'network_id': '6150e6df-2b72-4f1d-912c-2256eb16e2b3', 'mac_address': 'fa:16:3e:d5:f3:5f', 'name': 'tempest-PortsIpV6TestJSON-27281814'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:13.682039 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7f9c1f9f-fd79-40e4-9668-acf8e91536d4 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:13.716438 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-da6a5cf2-3f2d-4c00-ae6f-32890c40d928 req-689b426f-7bc2-4ecf-9ccb-1120067cdff9 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:46:13.717645 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da6a5cf2-3f2d-4c00-ae6f-32890c40d928 req-689b426f-7bc2-4ecf-9ccb-1120067cdff9 service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0081770 Dec 09 21:46:13.788311 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f9c1f9f-fd79-40e4-9668-acf8e91536d4 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:13.812389 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-7f9c1f9f-fd79-40e4-9668-acf8e91536d4 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] device_id is not set on port a2c0a1c5-43b7-43fb-ac94-e4b7f7889282 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:46:14.094869 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f9c1f9f-fd79-40e4-9668-acf8e91536d4 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:14.158887 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f9c1f9f-fd79-40e4-9668-acf8e91536d4 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:14.269807 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7f9c1f9f-fd79-40e4-9668-acf8e91536d4 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:46:14.283825 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-7f9c1f9f-fd79-40e4-9668-acf8e91536d4 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:14.299233 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f9c1f9f-fd79-40e4-9668-acf8e91536d4 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:46:14.304880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f9c1f9f-fd79-40e4-9668-acf8e91536d4 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:14.305493 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f9c1f9f-fd79-40e4-9668-acf8e91536d4 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:14.337553 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f9c1f9f-fd79-40e4-9668-acf8e91536d4 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Port': ['ID=a2c0a1c5-43b7-43fb-ac94-e4b7f7889282,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:14.361221 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42322) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:14.372089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7f9c1f9f-fd79-40e4-9668-acf8e91536d4 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 848 time: 0.8187129 Dec 09 21:46:14.430802 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3734e8ff-1f1b-4c1d-ba89-ba466781917b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:14.432519 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3734e8ff-1f1b-4c1d-ba89-ba466781917b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports/a2c0a1c5-43b7-43fb-ac94-e4b7f7889282 HTTP/1.1" status: 200 len: 843 time: 0.0705006 Dec 09 21:46:14.435347 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42326) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:14.517487 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-4a6cf9e7-2d61-483b-b0fa-8d357eb3fa42 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.3101702 Dec 09 21:46:14.526730 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-56028f8c-7abf-4f84-83c3-c8cc3ce9a7bb service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:46:14.528060 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-56028f8c-7abf-4f84-83c3-c8cc3ce9a7bb service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0056436 Dec 09 21:46:14.607425 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-865bcdfd-a25d-451d-8d3f-ded3531b4f30 req-81a1cf55-c7db-447d-a019-fc6f5f7c7026 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:14.609024 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-865bcdfd-a25d-451d-8d3f-ded3531b4f30 req-81a1cf55-c7db-447d-a019-fc6f5f7c7026 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.1234035 Dec 09 21:46:14.672868 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-3cbc0758-cb5e-4879-9f1b-7f4edf2ec3f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting port a2c0a1c5-43b7-43fb-ac94-e4b7f7889282 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:14.673219 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3cbc0758-cb5e-4879-9f1b-7f4edf2ec3f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:14.745585 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-865bcdfd-a25d-451d-8d3f-ded3531b4f30 req-bb1b462e-495b-40f4-a94c-643eeb30b8d3 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1262474 Dec 09 21:46:14.874632 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3cbc0758-cb5e-4879-9f1b-7f4edf2ec3f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:14.906231 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-3cbc0758-cb5e-4879-9f1b-7f4edf2ec3f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Calling delete_port for a2c0a1c5-43b7-43fb-ac94-e4b7f7889282 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:15.044069 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a4b3733-4364-476f-8812-dc4f60707a87 req-5b007366-9453-4129-973d-c7817b49d15e tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:15.046029 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a4b3733-4364-476f-8812-dc4f60707a87 req-5b007366-9453-4129-973d-c7817b49d15e tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ae35dc07-1896-4a17-978c-12bd32bd62a8 HTTP/1.1" status: 200 len: 946 time: 0.1241477 Dec 09 21:46:15.121542 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a4b3733-4364-476f-8812-dc4f60707a87 req-e150f91b-3f8e-450a-9f80-90d03f5f2999 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0671751 Dec 09 21:46:15.122521 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3cbc0758-cb5e-4879-9f1b-7f4edf2ec3f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:15.163046 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cbc0758-cb5e-4879-9f1b-7f4edf2ec3f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Port': ['ID=a2c0a1c5-43b7-43fb-ac94-e4b7f7889282,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:15.172997 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3cbc0758-cb5e-4879-9f1b-7f4edf2ec3f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:15.176983 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3cbc0758-cb5e-4879-9f1b-7f4edf2ec3f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/ports/a2c0a1c5-43b7-43fb-ac94-e4b7f7889282 HTTP/1.1" status: 204 len: 168 time: 0.7400198 Dec 09 21:46:15.179352 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42358) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:15.230302 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-47bc52fb-1c57-44c1-9883-2b2e891b21d0 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] GET failed (client error): The resource could not be found. Dec 09 21:46:15.238082 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-47bc52fb-1c57-44c1-9883-2b2e891b21d0 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports/a2c0a1c5-43b7-43fb-ac94-e4b7f7889282 HTTP/1.1" status: 404 len: 333 time: 0.0575953 Dec 09 21:46:15.243742 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42360) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:15.252550 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-770c9d4c-0e6a-49f1-95d8-dc46db639281 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'port': {'network_id': '6150e6df-2b72-4f1d-912c-2256eb16e2b3', 'name': 'tempest-PortsIpV6TestJSON-1907591291'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:15.400709 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-770c9d4c-0e6a-49f1-95d8-dc46db639281 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:15.404595 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-770c9d4c-0e6a-49f1-95d8-dc46db639281 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:15.442601 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-770c9d4c-0e6a-49f1-95d8-dc46db639281 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] device_id is not set on port a6fd4107-4151-4919-a7d4-d45028fef887 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:46:15.634690 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-770c9d4c-0e6a-49f1-95d8-dc46db639281 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:15.674902 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-770c9d4c-0e6a-49f1-95d8-dc46db639281 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:15.882854 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-770c9d4c-0e6a-49f1-95d8-dc46db639281 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:46:15.889240 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-770c9d4c-0e6a-49f1-95d8-dc46db639281 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:15.909022 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-770c9d4c-0e6a-49f1-95d8-dc46db639281 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:46:15.928094 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-770c9d4c-0e6a-49f1-95d8-dc46db639281 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:15.929449 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-770c9d4c-0e6a-49f1-95d8-dc46db639281 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:15.959638 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-770c9d4c-0e6a-49f1-95d8-dc46db639281 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Port': ['ID=a6fd4107-4151-4919-a7d4-d45028fef887,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:15.989952 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-770c9d4c-0e6a-49f1-95d8-dc46db639281 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 850 time: 0.7440748 Dec 09 21:46:15.992851 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42380) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:15.999069 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-fdbaeba8-a78e-4f2e-9cff-d02eea81a29f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'port': {'name': 'New_Port', 'admin_state_up': False}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:16.009552 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e330646f-b3fd-49f6-ab36-7435f8b59a64 req-b97bed41-6ee1-43b6-80d6-1794aa7a7cc9 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:16.018486 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e330646f-b3fd-49f6-ab36-7435f8b59a64 req-b97bed41-6ee1-43b6-80d6-1794aa7a7cc9 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.1152370 Dec 09 21:46:16.089711 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e330646f-b3fd-49f6-ab36-7435f8b59a64 req-c9378e7a-faf3-44d9-90e3-ec3233b89031 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0653427 Dec 09 21:46:16.144567 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fdbaeba8-a78e-4f2e-9cff-d02eea81a29f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:16.224575 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e164bd-780f-472d-85da-00b672a525a9 req-aa0449e3-5f0c-4baf-912d-50be8ed1441d tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:16.225750 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f8e164bd-780f-472d-85da-00b672a525a9 req-aa0449e3-5f0c-4baf-912d-50be8ed1441d tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.31 "GET /v2.0/ports?device_id=ae35dc07-1896-4a17-978c-12bd32bd62a8 HTTP/1.1" status: 200 len: 946 time: 0.1225848 Dec 09 21:46:16.253012 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a13ced15-bfff-4c44-9206-5857f8ca3404 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:16.254882 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a13ced15-bfff-4c44-9206-5857f8ca3404 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 1098 time: 0.1221838 Dec 09 21:46:16.270849 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26b7cbce-da4d-415f-8b52-2822005ae724 req-2ed4a662-0df7-432d-a60d-496d2f5edbaa tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:16.272499 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-26b7cbce-da4d-415f-8b52-2822005ae724 req-2ed4a662-0df7-432d-a60d-496d2f5edbaa tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ae35dc07-1896-4a17-978c-12bd32bd62a8 HTTP/1.1" status: 200 len: 946 time: 0.0683908 Dec 09 21:46:16.324681 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-26b7cbce-da4d-415f-8b52-2822005ae724 req-4c120c13-b184-474c-9889-f64f3696ca6c tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/security-groups?id=14413c7b-f8bd-4bb0-a866-2528c928f8fa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454776 Dec 09 21:46:16.825043 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-faccb5de-833c-48bb-9d21-92aacb7a7e84 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:16.826679 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-faccb5de-833c-48bb-9d21-92aacb7a7e84 service neutron] 10.222.0.31 "GET /v2.0/networks?id=4fbe35af-30ff-45b2-b84a-21fea4abf9aa HTTP/1.1" status: 200 len: 898 time: 0.5636013 Dec 09 21:46:16.833283 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fdbaeba8-a78e-4f2e-9cff-d02eea81a29f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:16.877522 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fdbaeba8-a78e-4f2e-9cff-d02eea81a29f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:16.934319 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-f8e164bd-780f-472d-85da-00b672a525a9 req-9382711a-d4e2-4cbe-be27-d0de59de23cd tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Deleting port 33cf4605-a408-4847-9394-fe8acf994c40 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:16.934627 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f8e164bd-780f-472d-85da-00b672a525a9 req-9382711a-d4e2-4cbe-be27-d0de59de23cd tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:16.973823 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-fdbaeba8-a78e-4f2e-9cff-d02eea81a29f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] In _notify_port_updated(), no bound segment for port a6fd4107-4151-4919-a7d4-d45028fef887 on network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 {{(pid=103437) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:46:16.985990 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fdbaeba8-a78e-4f2e-9cff-d02eea81a29f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:16.987019 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fdbaeba8-a78e-4f2e-9cff-d02eea81a29f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:16.988454 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fdbaeba8-a78e-4f2e-9cff-d02eea81a29f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "PUT /v2.0/ports/a6fd4107-4151-4919-a7d4-d45028fef887 HTTP/1.1" status: 200 len: 818 time: 0.9936571 Dec 09 21:46:16.992470 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42408) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:17.028987 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-9f1dfefb-a238-4520-825a-919d05a5a6dc service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=201bc3ab-e2ab-4e46-9cc3-b13f3373442f HTTP/1.1" status: 200 len: 1002 time: 0.1915674 Dec 09 21:46:17.078872 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdbaeba8-a78e-4f2e-9cff-d02eea81a29f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Port': ['ID=a6fd4107-4151-4919-a7d4-d45028fef887,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:17.177675 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-143aa36d-d26b-410e-94a8-b3c847088f11 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:17.178390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-826ab062-f249-46b1-ab65-30721084f8e2 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting port a6fd4107-4151-4919-a7d4-d45028fef887 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:17.178931 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-826ab062-f249-46b1-ab65-30721084f8e2 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:17.179209 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-143aa36d-d26b-410e-94a8-b3c847088f11 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=017fde5b-ddc1-4da5-8c6b-2b98296748e5 HTTP/1.1" status: 200 len: 835 time: 0.1429701 Dec 09 21:46:17.181128 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-f8e164bd-780f-472d-85da-00b672a525a9 req-9382711a-d4e2-4cbe-be27-d0de59de23cd tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] For port 33cf4605-a408-4847-9394-fe8acf994c40, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=33cf4605-a408-4847-9394-fe8acf994c40,segment=NetworkSegment(0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5),segment_id=0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:17.181498 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f8e164bd-780f-472d-85da-00b672a525a9 req-9382711a-d4e2-4cbe-be27-d0de59de23cd tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:17.233964 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-f8e164bd-780f-472d-85da-00b672a525a9 req-9382711a-d4e2-4cbe-be27-d0de59de23cd tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Calling delete_port for 33cf4605-a408-4847-9394-fe8acf994c40 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:17.263231 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-826ab062-f249-46b1-ab65-30721084f8e2 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:17.308213 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-69554932-8e42-4c0a-a4f3-44679e3d5ca1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:17.309921 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-69554932-8e42-4c0a-a4f3-44679e3d5ca1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=4fbe35af-30ff-45b2-b84a-21fea4abf9aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1183076 Dec 09 21:46:17.311023 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-826ab062-f249-46b1-ab65-30721084f8e2 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Calling delete_port for a6fd4107-4151-4919-a7d4-d45028fef887 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:17.376918 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-461bb0a8-323b-4501-a96d-156cad465790 req-04681721-4116-4c7d-b5f4-12a96321139f tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:17.378680 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-461bb0a8-323b-4501-a96d-156cad465790 req-04681721-4116-4c7d-b5f4-12a96321139f tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.1188500 Dec 09 21:46:17.453124 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-826ab062-f249-46b1-ab65-30721084f8e2 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:17.458911 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-461bb0a8-323b-4501-a96d-156cad465790 req-ece11cc3-959a-428f-b90b-c00670985955 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0690286 Dec 09 21:46:17.488777 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-826ab062-f249-46b1-ab65-30721084f8e2 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Port': ['ID=a6fd4107-4151-4919-a7d4-d45028fef887,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:17.492519 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-c62871d6-8013-4a9c-a29d-fcc3bac8801e service neutron] 10.222.0.31 "GET /v2.0/networks/4fbe35af-30ff-45b2-b84a-21fea4abf9aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1711602 Dec 09 21:46:17.495833 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-826ab062-f249-46b1-ab65-30721084f8e2 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:17.499680 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-826ab062-f249-46b1-ab65-30721084f8e2 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/ports/a6fd4107-4151-4919-a7d4-d45028fef887 HTTP/1.1" status: 204 len: 168 time: 0.5047653 Dec 09 21:46:17.502379 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42420) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:17.528212 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f8e164bd-780f-472d-85da-00b672a525a9 req-9382711a-d4e2-4cbe-be27-d0de59de23cd tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:17.539935 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['33cf4605-a408-4847-9394-fe8acf994c40'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:46:17.569141 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3870ef7a-06c4-4b11-935c-758f2d73f977 req-8adab446-15c8-44a4-88fb-c272042d5c94 tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.13 "GET /v2.0/ports?device_id=ae35dc07-1896-4a17-978c-12bd32bd62a8 HTTP/1.1" status: 200 len: 210 time: 0.0311041 Dec 09 21:46:17.577054 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9382711a-d4e2-4cbe-be27-d0de59de23cd tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Pushing event deleted for resources: {'Port': ['ID=33cf4605-a408-4847-9394-fe8acf994c40,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:17.586707 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db3068e8-ce44-4202-b46a-aa180b52261f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:17.588789 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-db3068e8-ce44-4202-b46a-aa180b52261f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 848 time: 0.0851068 Dec 09 21:46:17.604210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42422) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:17.609851 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc838bb2-62b4-4800-b678-bcd5424750c4 None None] DHCP port deletion for eda4cb39-afde-43d7-a13b-5227cc6862dd request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:46:17.642192 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-76404a24-8000-4bee-9ac6-f7a95a704737 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] GET failed (client error): The resource could not be found. Dec 09 21:46:17.644020 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-76404a24-8000-4bee-9ac6-f7a95a704737 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports/a6fd4107-4151-4919-a7d4-d45028fef887 HTTP/1.1" status: 404 len: 333 time: 0.0384109 Dec 09 21:46:17.648045 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42424) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:17.650993 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-f8e164bd-780f-472d-85da-00b672a525a9 req-9382711a-d4e2-4cbe-be27-d0de59de23cd tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] No DVR routers for this DVR port 33cf4605-a408-4847-9394-fe8acf994c40 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:46:17.654508 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f8e164bd-780f-472d-85da-00b672a525a9 req-9382711a-d4e2-4cbe-be27-d0de59de23cd tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:17.654678 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-6c4be28d-2102-43a1-8bdd-db67b5716995 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-731761027'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:17.658065 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f8e164bd-780f-472d-85da-00b672a525a9 req-9382711a-d4e2-4cbe-be27-d0de59de23cd tempest-AttachVolumeNegativeTest-79547017 tempest-AttachVolumeNegativeTest-79547017-project] 10.222.0.31 "DELETE /v2.0/ports/33cf4605-a408-4847-9394-fe8acf994c40 HTTP/1.1" status: 204 len: 173 time: 1.4229617 Dec 09 21:46:17.658732 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ae35dc07-1896-4a17-978c-12bd32bd62a8', 'name': 'network-vif-deleted', 'tag': '33cf4605-a408-4847-9394-fe8acf994c40'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:46:17.661097 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-619702ba-45ad-4147-a9a2-58d867e53c9d" -d '{"events": [{"server_uuid": "ae35dc07-1896-4a17-978c-12bd32bd62a8", "name": "network-vif-deleted", "tag": "33cf4605-a408-4847-9394-fe8acf994c40"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:46:17.697653 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-ebaf6612-06fd-4a81-a2cc-e541657b5f38 service neutron] 10.222.0.31 "GET /v2.0/networks/4fbe35af-30ff-45b2-b84a-21fea4abf9aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1914036 Dec 09 21:46:17.711090 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6c4be28d-2102-43a1-8bdd-db67b5716995 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:17.713639 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:46:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-40639424-cf7b-40eb-b2ff-4da12218da03 x-openstack-request-id: req-40639424-cf7b-40eb-b2ff-4da12218da03 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:46:17.713946 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ae35dc07-1896-4a17-978c-12bd32bd62a8", "name": "network-vif-deleted", "tag": "33cf4605-a408-4847-9394-fe8acf994c40", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:46:17.714204 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-40639424-cf7b-40eb-b2ff-4da12218da03 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:46:17.714978 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ae35dc07-1896-4a17-978c-12bd32bd62a8', 'name': 'network-vif-deleted', 'tag': '33cf4605-a408-4847-9394-fe8acf994c40', 'status': 'completed', 'code': 200} Dec 09 21:46:17.722997 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6c4be28d-2102-43a1-8bdd-db67b5716995 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:17.752829 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6c4be28d-2102-43a1-8bdd-db67b5716995 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] vlan segment allocate from pool success with {'vlan_id': 111, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:46:17.764120 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6c4be28d-2102-43a1-8bdd-db67b5716995 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:17.764473 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-6c4be28d-2102-43a1-8bdd-db67b5716995 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Added segment 6b5c8060-3be1-4fa2-aaad-4a1919e0e8ac of type vlan for network e34dc734-0a9d-4565-af0c-e0ef0498b7a2 Dec 09 21:46:17.810639 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6c4be28d-2102-43a1-8bdd-db67b5716995 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:17.846632 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6c4be28d-2102-43a1-8bdd-db67b5716995 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:17.854634 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c4be28d-2102-43a1-8bdd-db67b5716995 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:17.855266 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6c4be28d-2102-43a1-8bdd-db67b5716995 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:17.935171 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6c4be28d-2102-43a1-8bdd-db67b5716995 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.2859643 Dec 09 21:46:17.938709 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42434) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:17.939524 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c4be28d-2102-43a1-8bdd-db67b5716995 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Network': ['ID=e34dc734-0a9d-4565-af0c-e0ef0498b7a2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:17.944832 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a10d1805-6344-4ca4-98f9-277f38deb25a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'subnet': {'network_id': 'e34dc734-0a9d-4565-af0c-e0ef0498b7a2', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:17.954147 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network e34dc734-0a9d-4565-af0c-e0ef0498b7a2 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:46:18.046335 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a10d1805-6344-4ca4-98f9-277f38deb25a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:18.050087 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a10d1805-6344-4ca4-98f9-277f38deb25a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:18.274946 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a10d1805-6344-4ca4-98f9-277f38deb25a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:18.350434 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a10d1805-6344-4ca4-98f9-277f38deb25a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Subnet': ['ID=737542c6-b952-4ac7-a7d2-a0af01ac011c,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:18.356386 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a10d1805-6344-4ca4-98f9-277f38deb25a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Checking segment: {'id': '6b5c8060-3be1-4fa2-aaad-4a1919e0e8ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'e34dc734-0a9d-4565-af0c-e0ef0498b7a2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:46:18.356770 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a10d1805-6344-4ca4-98f9-277f38deb25a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network hostable DHCP agents. Network: e34dc734-0a9d-4565-af0c-e0ef0498b7a2, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:46:18.382267 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a10d1805-6344-4ca4-98f9-277f38deb25a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network e34dc734-0a9d-4565-af0c-e0ef0498b7a2 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:46:18.397106 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-a10d1805-6344-4ca4-98f9-277f38deb25a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, e34dc734-0a9d-4565-af0c-e0ef0498b7a2) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:18.402156 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a10d1805-6344-4ca4-98f9-277f38deb25a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:18.402511 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a10d1805-6344-4ca4-98f9-277f38deb25a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:18.408728 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c370388-d381-4171-b18c-6f7f101e4433 None None] Network e34dc734-0a9d-4565-af0c-e0ef0498b7a2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:46:18.431936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42450) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:18.432444 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a10d1805-6344-4ca4-98f9-277f38deb25a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4916871 Dec 09 21:46:18.439488 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-068e9888-b5aa-44a7-bc6a-119e85b519c9 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'subnet': {'network_id': 'e34dc734-0a9d-4565-af0c-e0ef0498b7a2', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:18.593987 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc7bb64d-fcb9-49cd-96c2-97786d55af06 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-e34dc734-0a9d-4565-af0c-e0ef0498b7a2', 'network_id': 'e34dc734-0a9d-4565-af0c-e0ef0498b7a2', 'project_id': '9560c66e717c47918bfe698e159759c5', 'fixed_ips': [{'subnet_id': '737542c6-b952-4ac7-a7d2-a0af01ac011c'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:46:18.596571 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fc7bb64d-fcb9-49cd-96c2-97786d55af06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:18.644037 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2377fe4a-d8fe-438f-9b02-359be2041d8a req-db1a8376-ac67-4887-ab6d-afa8cc9dd52b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:18.648008 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2377fe4a-d8fe-438f-9b02-359be2041d8a req-db1a8376-ac67-4887-ab6d-afa8cc9dd52b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.0717273 Dec 09 21:46:18.649316 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-068e9888-b5aa-44a7-bc6a-119e85b519c9 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:18.656455 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-068e9888-b5aa-44a7-bc6a-119e85b519c9 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:18.761620 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-fc7bb64d-fcb9-49cd-96c2-97786d55af06 None None] Allocated IP 2001:db8::2 (e34dc734-0a9d-4565-af0c-e0ef0498b7a2/737542c6-b952-4ac7-a7d2-a0af01ac011c/71859fd5-5726-4f9a-814e-617f3b99f3b6) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:46:18.778162 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2377fe4a-d8fe-438f-9b02-359be2041d8a req-63032aa4-8d51-4e5b-8a6f-24a319b74336 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0991466 Dec 09 21:46:18.793253 n-d-713301-27 neutron-server[103438]: INFO neutron.db.ipam_backend_mixin [None req-068e9888-b5aa-44a7-bc6a-119e85b519c9 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 737542c6-b952-4ac7-a7d2-a0af01ac011c (CIDR: 2001:db8::/64) Dec 09 21:46:18.802002 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-068e9888-b5aa-44a7-bc6a-119e85b519c9 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:46:18.802470 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-068e9888-b5aa-44a7-bc6a-119e85b519c9 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:46:18.822232 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-068e9888-b5aa-44a7-bc6a-119e85b519c9 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.3891516 Dec 09 21:46:18.824933 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42462) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:18.833755 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-549ebf66-964a-48f7-9793-289ce7ea459b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'subnet': {'network_id': 'e34dc734-0a9d-4565-af0c-e0ef0498b7a2', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:18.859903 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42464) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:18.925410 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-3e1d15f3-c5af-42e8-8f79-00f0297c221c admin admin] Deleting subnet 24afae0e-0a38-484d-a023-a2fb471bdb33 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:46:18.929161 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e1d15f3-c5af-42e8-8f79-00f0297c221c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:18.976285 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e1d15f3-c5af-42e8-8f79-00f0297c221c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:19.005806 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-549ebf66-964a-48f7-9793-289ce7ea459b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:19.010751 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-549ebf66-964a-48f7-9793-289ce7ea459b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:19.025631 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fc7bb64d-fcb9-49cd-96c2-97786d55af06 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:19.030366 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e1d15f3-c5af-42e8-8f79-00f0297c221c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:19.033864 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fc7bb64d-fcb9-49cd-96c2-97786d55af06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:19.084716 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc7bb64d-fcb9-49cd-96c2-97786d55af06 None None] Pushing event updated for resources: {'Port': ['ID=71859fd5-5726-4f9a-814e-617f3b99f3b6,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:19.097634 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e1d15f3-c5af-42e8-8f79-00f0297c221c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:19.103859 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc7bb64d-fcb9-49cd-96c2-97786d55af06 None None] Network e34dc734-0a9d-4565-af0c-e0ef0498b7a2 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:46:19.105348 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-fc7bb64d-fcb9-49cd-96c2-97786d55af06 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:19.109103 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc7bb64d-fcb9-49cd-96c2-97786d55af06 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:46:19.128906 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e1d15f3-c5af-42e8-8f79-00f0297c221c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=24afae0e-0a38-484d-a023-a2fb471bdb33,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:19.133513 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e1d15f3-c5af-42e8-8f79-00f0297c221c admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:19.137709 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3e1d15f3-c5af-42e8-8f79-00f0297c221c admin admin] 10.222.0.13 "DELETE /v2.0/subnets/24afae0e-0a38-484d-a023-a2fb471bdb33 HTTP/1.1" status: 204 len: 168 time: 0.2761769 Dec 09 21:46:19.140477 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42468) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:19.155275 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8115c460-8f97-4568-8b42-3e1093cdef3a None None] Network eda4cb39-afde-43d7-a13b-5227cc6862dd requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:46:19.259999 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-44a4a49d-5ea4-4b33-b656-7160f6a6933b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:19.347247 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-549ebf66-964a-48f7-9793-289ce7ea459b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:19.405264 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-44a4a49d-5ea4-4b33-b656-7160f6a6933b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:19.406735 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-549ebf66-964a-48f7-9793-289ce7ea459b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network e34dc734-0a9d-4565-af0c-e0ef0498b7a2 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:46:19.410349 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-fc7bb64d-fcb9-49cd-96c2-97786d55af06 None None] Attempting to bind port 71859fd5-5726-4f9a-814e-617f3b99f3b6 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:46:19.410721 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-fc7bb64d-fcb9-49cd-96c2-97786d55af06 None None] Attempting to bind port 71859fd5-5726-4f9a-814e-617f3b99f3b6 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '6b5c8060-3be1-4fa2-aaad-4a1919e0e8ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'e34dc734-0a9d-4565-af0c-e0ef0498b7a2'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:46:19.411093 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc7bb64d-fcb9-49cd-96c2-97786d55af06 None None] Attempting to bind port 71859fd5-5726-4f9a-814e-617f3b99f3b6 on network e34dc734-0a9d-4565-af0c-e0ef0498b7a2 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:46:19.413255 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-549ebf66-964a-48f7-9793-289ce7ea459b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:19.419578 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-549ebf66-964a-48f7-9793-289ce7ea459b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:19.420268 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-549ebf66-964a-48f7-9793-289ce7ea459b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:19.423543 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-549ebf66-964a-48f7-9793-289ce7ea459b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Subnet': ['ID=847b3c93-b11e-46af-823b-8d3b7e224fdc,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:19.447693 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-549ebf66-964a-48f7-9793-289ce7ea459b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 0.6213386 Dec 09 21:46:19.449968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42476) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:19.457486 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a5b59514-dbe3-474a-af25-1cb1826dca5a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'port': {'network_id': 'e34dc734-0a9d-4565-af0c-e0ef0498b7a2', 'fixed_ips': [{'subnet_id': '737542c6-b952-4ac7-a7d2-a0af01ac011c'}, {'subnet_id': '847b3c93-b11e-46af-823b-8d3b7e224fdc'}], 'name': 'tempest-PortsIpV6TestJSON-1198574025'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:19.487319 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc7bb64d-fcb9-49cd-96c2-97786d55af06 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 46, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:46:19.487807 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc7bb64d-fcb9-49cd-96c2-97786d55af06 None None] Checking segment: {'id': '6b5c8060-3be1-4fa2-aaad-4a1919e0e8ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'e34dc734-0a9d-4565-af0c-e0ef0498b7a2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:46:19.488128 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fc7bb64d-fcb9-49cd-96c2-97786d55af06 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:19.488522 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc7bb64d-fcb9-49cd-96c2-97786d55af06 None None] Bound using segment: {'id': '6b5c8060-3be1-4fa2-aaad-4a1919e0e8ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'e34dc734-0a9d-4565-af0c-e0ef0498b7a2'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:46:19.489001 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-fc7bb64d-fcb9-49cd-96c2-97786d55af06 None None] Bound port: 71859fd5-5726-4f9a-814e-617f3b99f3b6, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6b5c8060-3be1-4fa2-aaad-4a1919e0e8ac', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': 'e34dc734-0a9d-4565-af0c-e0ef0498b7a2'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:46:19.489384 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fc7bb64d-fcb9-49cd-96c2-97786d55af06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:19.489941 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-44a4a49d-5ea4-4b33-b656-7160f6a6933b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['eda4cb39-afde-43d7-a13b-5227cc6862dd']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:19.514181 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-44a4a49d-5ea4-4b33-b656-7160f6a6933b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:19.514895 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-44a4a49d-5ea4-4b33-b656-7160f6a6933b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0ba0da85-1efd-43e2-ad9e-212e8b2e7bd5') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:19.531614 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-44a4a49d-5ea4-4b33-b656-7160f6a6933b admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:19.551104 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-44a4a49d-5ea4-4b33-b656-7160f6a6933b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:19.558724 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-44a4a49d-5ea4-4b33-b656-7160f6a6933b admin admin] Releasing vlan 125 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:46:19.559134 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-44a4a49d-5ea4-4b33-b656-7160f6a6933b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:19.561263 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-842a0613-a9b7-4a70-b930-df9d9ccb0efd None None] DHCP port deletion for eda4cb39-afde-43d7-a13b-5227cc6862dd request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:46:19.619933 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a5b59514-dbe3-474a-af25-1cb1826dca5a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:46:19.629454 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:46:19.670153 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-44a4a49d-5ea4-4b33-b656-7160f6a6933b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:19.673946 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-fc7bb64d-fcb9-49cd-96c2-97786d55af06 None None] For port 71859fd5-5726-4f9a-814e-617f3b99f3b6, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:46:19.678208 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-fc7bb64d-fcb9-49cd-96c2-97786d55af06 None None] For port 71859fd5-5726-4f9a-814e-617f3b99f3b6, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=71859fd5-5726-4f9a-814e-617f3b99f3b6,segment=NetworkSegment(6b5c8060-3be1-4fa2-aaad-4a1919e0e8ac),segment_id=6b5c8060-3be1-4fa2-aaad-4a1919e0e8ac)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:46:19.684270 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fc7bb64d-fcb9-49cd-96c2-97786d55af06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:19.685387 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-44a4a49d-5ea4-4b33-b656-7160f6a6933b admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:19.691287 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-44a4a49d-5ea4-4b33-b656-7160f6a6933b admin admin] 10.222.0.13 "DELETE /v2.0/networks/eda4cb39-afde-43d7-a13b-5227cc6862dd HTTP/1.1" status: 204 len: 168 time: 0.5469401 Dec 09 21:46:19.720050 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44a4a49d-5ea4-4b33-b656-7160f6a6933b admin admin] Pushing event deleted for resources: {'Network': ['ID=eda4cb39-afde-43d7-a13b-5227cc6862dd,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:19.752444 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a5b59514-dbe3-474a-af25-1cb1826dca5a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:19.775081 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-a5b59514-dbe3-474a-af25-1cb1826dca5a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] device_id is not set on port cc5a3659-d23d-4374-8336-6a87669cd379 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:46:19.821539 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc7bb64d-fcb9-49cd-96c2-97786d55af06 None None] Pushing event updated for resources: {'Port': ['ID=71859fd5-5726-4f9a-814e-617f3b99f3b6,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:20.063622 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42492) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:20.122650 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a687e24c-2278-402a-b894-5344833139ec req-5dd89632-4889-4a1e-a5cd-5df14e8d1162 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:20.128007 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a687e24c-2278-402a-b894-5344833139ec req-5dd89632-4889-4a1e-a5cd-5df14e8d1162 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.2108059 Dec 09 21:46:20.173468 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-273d2e9a-3307-4102-a6e4-0bc3f08b9ff4 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=6f2bd57ebcdc4c748e719519e3961b70&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1080408 Dec 09 21:46:20.176246 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42494) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:20.232455 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a687e24c-2278-402a-b894-5344833139ec req-12edabf0-eb7d-462c-b881-1a6463cc68d8 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0975838 Dec 09 21:46:20.260101 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7901daaf-c7ac-4b84-b254-1a918ce79ae5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:20.294117 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7901daaf-c7ac-4b84-b254-1a918ce79ae5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:20.319003 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 33cf4605-a408-4847-9394-fe8acf994c40 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:46:20.326596 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-a5b59514-dbe3-474a-af25-1cb1826dca5a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Allocated IP 2001:db8::132 (e34dc734-0a9d-4565-af0c-e0ef0498b7a2/737542c6-b952-4ac7-a7d2-a0af01ac011c/cc5a3659-d23d-4374-8336-6a87669cd379) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:46:20.335894 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-a5b59514-dbe3-474a-af25-1cb1826dca5a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Allocated IP 2001:db8:0:1::2 (e34dc734-0a9d-4565-af0c-e0ef0498b7a2/847b3c93-b11e-46af-823b-8d3b7e224fdc/cc5a3659-d23d-4374-8336-6a87669cd379) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:46:20.378843 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 33cf4605-a408-4847-9394-fe8acf994c40 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:46:20.381679 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 33cf4605-a408-4847-9394-fe8acf994c40 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:46:20.388205 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7901daaf-c7ac-4b84-b254-1a918ce79ae5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:20.390929 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7901daaf-c7ac-4b84-b254-1a918ce79ae5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:20.395230 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7901daaf-c7ac-4b84-b254-1a918ce79ae5 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/14413c7b-f8bd-4bb0-a866-2528c928f8fa HTTP/1.1" status: 204 len: 168 time: 0.2149508 Dec 09 21:46:20.406979 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7901daaf-c7ac-4b84-b254-1a918ce79ae5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=14413c7b-f8bd-4bb0-a866-2528c928f8fa,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:20.576970 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a5b59514-dbe3-474a-af25-1cb1826dca5a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:20.636161 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a5b59514-dbe3-474a-af25-1cb1826dca5a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:20.688354 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5b59514-dbe3-474a-af25-1cb1826dca5a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network e34dc734-0a9d-4565-af0c-e0ef0498b7a2 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:46:20.695201 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-a5b59514-dbe3-474a-af25-1cb1826dca5a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:20.700753 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5b59514-dbe3-474a-af25-1cb1826dca5a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:46:20.707459 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a5b59514-dbe3-474a-af25-1cb1826dca5a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:20.708510 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a5b59514-dbe3-474a-af25-1cb1826dca5a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:20.749962 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a5b59514-dbe3-474a-af25-1cb1826dca5a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1015 time: 1.2986834 Dec 09 21:46:20.752779 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42510) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:20.761945 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-fb90234b-e1ad-4bb3-a21d-8f47c0e47779 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '737542c6-b952-4ac7-a7d2-a0af01ac011c'}]}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:20.817045 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 71859fd5-5726-4f9a-814e-617f3b99f3b6 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:46:20.846726 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5b59514-dbe3-474a-af25-1cb1826dca5a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Port': ['ID=cc5a3659-d23d-4374-8336-6a87669cd379,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:20.915541 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fb90234b-e1ad-4bb3-a21d-8f47c0e47779 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:21.001576 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 71859fd5-5726-4f9a-814e-617f3b99f3b6 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:21.001863 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:21.155503 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:21.209879 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 71859fd5-5726-4f9a-814e-617f3b99f3b6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=71859fd5-5726-4f9a-814e-617f3b99f3b6,segment=NetworkSegment(6b5c8060-3be1-4fa2-aaad-4a1919e0e8ac),segment_id=6b5c8060-3be1-4fa2-aaad-4a1919e0e8ac)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:21.224524 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:21.295029 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=71859fd5-5726-4f9a-814e-617f3b99f3b6,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:21.375764 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ac299708-2f4d-4c7c-aeee-cd9e03ba5cd5 None None] Network e34dc734-0a9d-4565-af0c-e0ef0498b7a2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:46:21.393608 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-fb90234b-e1ad-4bb3-a21d-8f47c0e47779 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Delete allocated IP 2001:db8:0:1::2 (e34dc734-0a9d-4565-af0c-e0ef0498b7a2/847b3c93-b11e-46af-823b-8d3b7e224fdc) {{(pid=103438) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Dec 09 21:46:21.535035 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9dc912be-9b41-45f1-83a8-ab7b68cf604d None None] Provisioning complete for port 71859fd5-5726-4f9a-814e-617f3b99f3b6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:21.535532 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9dc912be-9b41-45f1-83a8-ab7b68cf604d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:21.832661 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d0765367-b586-4a6f-96ab-ac5fb94b1c70 None None] Update dhcp port {'port': {'network_id': 'e34dc734-0a9d-4565-af0c-e0ef0498b7a2', 'fixed_ips': [{'subnet_id': '737542c6-b952-4ac7-a7d2-a0af01ac011c', 'ip_address': '2001:db8::2'}, {'subnet_id': '847b3c93-b11e-46af-823b-8d3b7e224fdc'}], 'binding:host_id': 'n-d-713301-27'}, 'id': '71859fd5-5726-4f9a-814e-617f3b99f3b6'} from n-d-713301-27. {{(pid=103439) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 09 21:46:21.888548 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d0765367-b586-4a6f-96ab-ac5fb94b1c70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:21.921226 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c444498-90e8-4396-bb0f-93a8302cf5c8 req-62af7d16-f6d6-4d78-950e-7ee4fc8a8579 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:21.929463 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c444498-90e8-4396-bb0f-93a8302cf5c8 req-62af7d16-f6d6-4d78-950e-7ee4fc8a8579 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.5559404 Dec 09 21:46:22.030499 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c444498-90e8-4396-bb0f-93a8302cf5c8 req-7f8fa176-2850-4731-be76-f1c40d80e1df tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1001372 Dec 09 21:46:22.051978 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fb90234b-e1ad-4bb3-a21d-8f47c0e47779 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:22.059972 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fb90234b-e1ad-4bb3-a21d-8f47c0e47779 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:22.125860 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-fb90234b-e1ad-4bb3-a21d-8f47c0e47779 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] In _notify_port_updated(), no bound segment for port cc5a3659-d23d-4374-8336-6a87669cd379 on network e34dc734-0a9d-4565-af0c-e0ef0498b7a2 {{(pid=103438) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:46:22.131641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb90234b-e1ad-4bb3-a21d-8f47c0e47779 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:22.132264 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fb90234b-e1ad-4bb3-a21d-8f47c0e47779 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:22.136687 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42556) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:22.142517 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a722b29c-f5c0-49ef-936f-752129f15224 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '737542c6-b952-4ac7-a7d2-a0af01ac011c'}, {'subnet_id': '847b3c93-b11e-46af-823b-8d3b7e224fdc'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:22.146974 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fb90234b-e1ad-4bb3-a21d-8f47c0e47779 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "PUT /v2.0/ports/cc5a3659-d23d-4374-8336-6a87669cd379 HTTP/1.1" status: 200 len: 926 time: 1.3930061 Dec 09 21:46:22.225092 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-d0765367-b586-4a6f-96ab-ac5fb94b1c70 None None] Allocated IP 2001:db8:0:1::3 (e34dc734-0a9d-4565-af0c-e0ef0498b7a2/847b3c93-b11e-46af-823b-8d3b7e224fdc/71859fd5-5726-4f9a-814e-617f3b99f3b6) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:46:22.225357 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb90234b-e1ad-4bb3-a21d-8f47c0e47779 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Port': ['ID=cc5a3659-d23d-4374-8336-6a87669cd379,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:22.359418 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-d0765367-b586-4a6f-96ab-ac5fb94b1c70 None None] For port 71859fd5-5726-4f9a-814e-617f3b99f3b6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=71859fd5-5726-4f9a-814e-617f3b99f3b6,segment=NetworkSegment(6b5c8060-3be1-4fa2-aaad-4a1919e0e8ac),segment_id=6b5c8060-3be1-4fa2-aaad-4a1919e0e8ac)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:22.380075 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a722b29c-f5c0-49ef-936f-752129f15224 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:22.392569 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d0765367-b586-4a6f-96ab-ac5fb94b1c70 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:22.400048 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d0765367-b586-4a6f-96ab-ac5fb94b1c70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:22.538070 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0765367-b586-4a6f-96ab-ac5fb94b1c70 None None] Pushing event updated for resources: {'Port': ['ID=71859fd5-5726-4f9a-814e-617f3b99f3b6,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:22.706470 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 71859fd5-5726-4f9a-814e-617f3b99f3b6 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:46:22.824833 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 71859fd5-5726-4f9a-814e-617f3b99f3b6 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:22.825616 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:23.073154 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-a722b29c-f5c0-49ef-936f-752129f15224 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Allocated IP 2001:db8:0:1::23a (e34dc734-0a9d-4565-af0c-e0ef0498b7a2/847b3c93-b11e-46af-823b-8d3b7e224fdc/cc5a3659-d23d-4374-8336-6a87669cd379) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:46:23.288012 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3583278a-5167-412b-95a5-451e975d7e90 req-29a085e3-43d2-4a6c-adf2-a3bae6af356d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:23.296845 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3583278a-5167-412b-95a5-451e975d7e90 req-29a085e3-43d2-4a6c-adf2-a3bae6af356d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.1413238 Dec 09 21:46:23.362720 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a722b29c-f5c0-49ef-936f-752129f15224 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:23.380280 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a722b29c-f5c0-49ef-936f-752129f15224 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:23.420219 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3583278a-5167-412b-95a5-451e975d7e90 req-1f24fb4f-cca9-46c9-a365-1afb717264ea tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1140704 Dec 09 21:46:23.524753 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-a722b29c-f5c0-49ef-936f-752129f15224 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] In _notify_port_updated(), no bound segment for port cc5a3659-d23d-4374-8336-6a87669cd379 on network e34dc734-0a9d-4565-af0c-e0ef0498b7a2 {{(pid=103437) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:46:23.532162 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a722b29c-f5c0-49ef-936f-752129f15224 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:23.533259 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a722b29c-f5c0-49ef-936f-752129f15224 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:23.534904 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a722b29c-f5c0-49ef-936f-752129f15224 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "PUT /v2.0/ports/cc5a3659-d23d-4374-8336-6a87669cd379 HTTP/1.1" status: 200 len: 1012 time: 1.3971789 Dec 09 21:46:23.540753 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42592) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:23.555636 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a722b29c-f5c0-49ef-936f-752129f15224 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Port': ['ID=cc5a3659-d23d-4374-8336-6a87669cd379,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:23.586570 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-41e54977-72c0-4c91-be25-8990a8d07453 None None] Network e34dc734-0a9d-4565-af0c-e0ef0498b7a2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:46:23.696151 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-835e4713-06fa-4d1b-b7b7-f4f4dc4b169a None None] Provisioning complete for port 71859fd5-5726-4f9a-814e-617f3b99f3b6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:23.696520 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-835e4713-06fa-4d1b-b7b7-f4f4dc4b169a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:23.719336 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-db3eaafc-ad4a-416c-8ca9-e697e5147347 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting port cc5a3659-d23d-4374-8336-6a87669cd379 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:23.719831 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-db3eaafc-ad4a-416c-8ca9-e697e5147347 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:23.861343 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-835e4713-06fa-4d1b-b7b7-f4f4dc4b169a None None] Provisioning complete for port cc5a3659-d23d-4374-8336-6a87669cd379 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:23.861715 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-835e4713-06fa-4d1b-b7b7-f4f4dc4b169a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:23.877211 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-db3eaafc-ad4a-416c-8ca9-e697e5147347 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:23.895885 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-db3eaafc-ad4a-416c-8ca9-e697e5147347 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Calling delete_port for cc5a3659-d23d-4374-8336-6a87669cd379 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:23.918997 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-835e4713-06fa-4d1b-b7b7-f4f4dc4b169a None None] Port cc5a3659-d23d-4374-8336-6a87669cd379 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:46:24.116360 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-db3eaafc-ad4a-416c-8ca9-e697e5147347 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:24.159689 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-974b93ab-9587-4ff7-81fa-b4c4e415ac7b None None] Provisioning complete for port 71859fd5-5726-4f9a-814e-617f3b99f3b6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:24.160062 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-974b93ab-9587-4ff7-81fa-b4c4e415ac7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:24.170786 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db3eaafc-ad4a-416c-8ca9-e697e5147347 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Port': ['ID=cc5a3659-d23d-4374-8336-6a87669cd379,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:24.226243 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-db3eaafc-ad4a-416c-8ca9-e697e5147347 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:24.233411 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-db3eaafc-ad4a-416c-8ca9-e697e5147347 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/ports/cc5a3659-d23d-4374-8336-6a87669cd379 HTTP/1.1" status: 204 len: 168 time: 0.6908243 Dec 09 21:46:24.236194 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42612) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:24.263113 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-e0e8523d-72e3-4a89-9ee7-a92e569796a6 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] GET failed (client error): The resource could not be found. Dec 09 21:46:24.267339 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e0e8523d-72e3-4a89-9ee7-a92e569796a6 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports/cc5a3659-d23d-4374-8336-6a87669cd379 HTTP/1.1" status: 404 len: 333 time: 0.0274498 Dec 09 21:46:24.268141 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42614) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:24.304828 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-974b93ab-9587-4ff7-81fa-b4c4e415ac7b None None] Could not find standard attr ID for object cc5a3659-d23d-4374-8336-6a87669cd379. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:46:24.328025 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-5a9d4237-d6e4-49b7-b037-fbf2db3a92f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting subnet 847b3c93-b11e-46af-823b-8d3b7e224fdc {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:46:24.331997 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a9d4237-d6e4-49b7-b037-fbf2db3a92f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:24.392157 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a9d4237-d6e4-49b7-b037-fbf2db3a92f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:24.429038 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-25574e74-6337-4249-9534-e153117a1c3a None None] Could not find standard attr ID for object cc5a3659-d23d-4374-8336-6a87669cd379. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:46:24.505502 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a9d4237-d6e4-49b7-b037-fbf2db3a92f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:24.608980 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a9d4237-d6e4-49b7-b037-fbf2db3a92f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:24.617526 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-275bde5a-786a-4dc4-b5d7-a01477b228e3 req-da59fe0e-3456-493b-b5ac-c6253f3eb9d8 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:24.619273 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-275bde5a-786a-4dc4-b5d7-a01477b228e3 req-da59fe0e-3456-493b-b5ac-c6253f3eb9d8 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.0740685 Dec 09 21:46:24.635569 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a9d4237-d6e4-49b7-b037-fbf2db3a92f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Subnet': ['ID=847b3c93-b11e-46af-823b-8d3b7e224fdc,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:24.642427 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a9d4237-d6e4-49b7-b037-fbf2db3a92f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:24.646045 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5a9d4237-d6e4-49b7-b037-fbf2db3a92f8 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/subnets/847b3c93-b11e-46af-823b-8d3b7e224fdc HTTP/1.1" status: 204 len: 168 time: 0.3767529 Dec 09 21:46:24.648671 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42626) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:24.715885 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-275bde5a-786a-4dc4-b5d7-a01477b228e3 req-0b3d3a3e-f3eb-4f03-b77d-645f26bd86a4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0895646 Dec 09 21:46:24.771335 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-a86edabd-034f-48f9-8527-f5d40d257fcb tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting subnet 737542c6-b952-4ac7-a7d2-a0af01ac011c {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:46:24.775346 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a86edabd-034f-48f9-8527-f5d40d257fcb tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:24.777497 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7626971d-0ad6-4848-b22d-a09b6fa6d09f None None] Network e34dc734-0a9d-4565-af0c-e0ef0498b7a2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:46:24.821031 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-641b793b-b5cf-4769-b085-fe6400d6013d None None] Could not find standard attr ID for object cc5a3659-d23d-4374-8336-6a87669cd379. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:46:24.830823 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a86edabd-034f-48f9-8527-f5d40d257fcb tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:24.998007 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a86edabd-034f-48f9-8527-f5d40d257fcb tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:25.087186 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a86edabd-034f-48f9-8527-f5d40d257fcb tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:25.154244 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a86edabd-034f-48f9-8527-f5d40d257fcb tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Subnet': ['ID=737542c6-b952-4ac7-a7d2-a0af01ac011c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:25.161414 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a86edabd-034f-48f9-8527-f5d40d257fcb tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:25.166260 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a86edabd-034f-48f9-8527-f5d40d257fcb tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/subnets/737542c6-b952-4ac7-a7d2-a0af01ac011c HTTP/1.1" status: 204 len: 168 time: 0.5164011 Dec 09 21:46:25.168987 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42650) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:25.310249 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d0531a7d-3ae0-4c15-b025-6d6fee780b01 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:25.406779 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-d0531a7d-3ae0-4c15-b025-6d6fee780b01 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting port 71859fd5-5726-4f9a-814e-617f3b99f3b6 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:25.407256 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d0531a7d-3ae0-4c15-b025-6d6fee780b01 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:25.491512 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-d0531a7d-3ae0-4c15-b025-6d6fee780b01 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] For port 71859fd5-5726-4f9a-814e-617f3b99f3b6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=71859fd5-5726-4f9a-814e-617f3b99f3b6,segment=NetworkSegment(6b5c8060-3be1-4fa2-aaad-4a1919e0e8ac),segment_id=6b5c8060-3be1-4fa2-aaad-4a1919e0e8ac)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:25.492480 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d0531a7d-3ae0-4c15-b025-6d6fee780b01 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:25.517631 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-d0531a7d-3ae0-4c15-b025-6d6fee780b01 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Calling delete_port for 71859fd5-5726-4f9a-814e-617f3b99f3b6 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:25.649392 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d0531a7d-3ae0-4c15-b025-6d6fee780b01 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:25.693910 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0531a7d-3ae0-4c15-b025-6d6fee780b01 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Port': ['ID=71859fd5-5726-4f9a-814e-617f3b99f3b6,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:25.698979 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0531a7d-3ae0-4c15-b025-6d6fee780b01 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] No DVR routers for this DVR port 71859fd5-5726-4f9a-814e-617f3b99f3b6 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:46:25.832598 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d0531a7d-3ae0-4c15-b025-6d6fee780b01 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:25.857350 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad748f82-629f-44ab-88b6-f7b9eb4ba599 None None] Network e34dc734-0a9d-4565-af0c-e0ef0498b7a2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:46:25.857888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-d0531a7d-3ae0-4c15-b025-6d6fee780b01 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e34dc734-0a9d-4565-af0c-e0ef0498b7a2']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:25.868769 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-d0531a7d-3ae0-4c15-b025-6d6fee780b01 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6b5c8060-3be1-4fa2-aaad-4a1919e0e8ac') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:25.869338 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-d0531a7d-3ae0-4c15-b025-6d6fee780b01 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6b5c8060-3be1-4fa2-aaad-4a1919e0e8ac') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:25.880894 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d0531a7d-3ae0-4c15-b025-6d6fee780b01 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:25.896265 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d0531a7d-3ae0-4c15-b025-6d6fee780b01 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:25.917228 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d0531a7d-3ae0-4c15-b025-6d6fee780b01 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Releasing vlan 111 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:46:25.917778 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d0531a7d-3ae0-4c15-b025-6d6fee780b01 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:46:25.923935 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:46:25.979643 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e3fe165a-1e8e-4326-b980-0cef2219d129 None None] Could not find standard attr ID for object 71859fd5-5726-4f9a-814e-617f3b99f3b6. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:46:26.099769 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b60a9b3-a2d0-46a3-b06a-834b35a39615 req-d942ed1f-4ae5-48c5-83dd-35f690bf5455 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:26.101389 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b60a9b3-a2d0-46a3-b06a-834b35a39615 req-d942ed1f-4ae5-48c5-83dd-35f690bf5455 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.1990719 Dec 09 21:46:26.102615 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d0531a7d-3ae0-4c15-b025-6d6fee780b01 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:26.109728 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d0531a7d-3ae0-4c15-b025-6d6fee780b01 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:26.116340 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d0531a7d-3ae0-4c15-b025-6d6fee780b01 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/networks/e34dc734-0a9d-4565-af0c-e0ef0498b7a2 HTTP/1.1" status: 204 len: 168 time: 0.9429491 Dec 09 21:46:26.117582 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42678) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:26.135565 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1ad7625-8498-4b97-8e4a-5ea05064d654 None None] DHCP port deletion for e34dc734-0a9d-4565-af0c-e0ef0498b7a2 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:46:26.203085 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0531a7d-3ae0-4c15-b025-6d6fee780b01 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Network': ['ID=e34dc734-0a9d-4565-af0c-e0ef0498b7a2,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:26.267311 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-529a8ffd-408b-4538-b366-872f9aa80d95 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:26.272497 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-529a8ffd-408b-4538-b366-872f9aa80d95 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports HTTP/1.1" status: 200 len: 848 time: 0.1520162 Dec 09 21:46:26.272729 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b60a9b3-a2d0-46a3-b06a-834b35a39615 req-342b531c-6d75-462d-b8a4-80f50fce84cc tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1576383 Dec 09 21:46:26.272851 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42684) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:26.327714 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4ad83c2a-05d7-4065-b8b1-ee3545641ea3 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 284 time: 0.0538185 Dec 09 21:46:26.333530 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42688) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:26.338665 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-26bf5d4e-2abe-4191-9704-f11b6e10cf1c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-1429356370'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:26.386768 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-26bf5d4e-2abe-4191-9704-f11b6e10cf1c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:26.395093 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-26bf5d4e-2abe-4191-9704-f11b6e10cf1c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:26.439374 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-26bf5d4e-2abe-4191-9704-f11b6e10cf1c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] vlan segment allocate from pool success with {'vlan_id': 144, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:46:26.451351 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-26bf5d4e-2abe-4191-9704-f11b6e10cf1c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:26.452165 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-26bf5d4e-2abe-4191-9704-f11b6e10cf1c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Added segment 53165fdf-1191-415a-93ee-d62f64e584de of type vlan for network 980ffcba-7010-4a1b-98fa-0f7d5172fced Dec 09 21:46:26.518539 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-26bf5d4e-2abe-4191-9704-f11b6e10cf1c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:26.555056 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-26bf5d4e-2abe-4191-9704-f11b6e10cf1c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:26.561684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26bf5d4e-2abe-4191-9704-f11b6e10cf1c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:26.562528 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-26bf5d4e-2abe-4191-9704-f11b6e10cf1c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:26.613082 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-26bf5d4e-2abe-4191-9704-f11b6e10cf1c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 772 time: 0.2783587 Dec 09 21:46:26.617779 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42694) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:26.622802 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a66e93a4-2c04-4a70-9398-492a921e332c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'subnet': {'network_id': '980ffcba-7010-4a1b-98fa-0f7d5172fced', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:26.666895 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26bf5d4e-2abe-4191-9704-f11b6e10cf1c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Network': ['ID=980ffcba-7010-4a1b-98fa-0f7d5172fced,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:26.684423 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 980ffcba-7010-4a1b-98fa-0f7d5172fced details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:46:26.745985 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 71859fd5-5726-4f9a-814e-617f3b99f3b6 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:46:26.782555 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 71859fd5-5726-4f9a-814e-617f3b99f3b6 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:46:26.783263 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 71859fd5-5726-4f9a-814e-617f3b99f3b6 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:46:26.889048 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a66e93a4-2c04-4a70-9398-492a921e332c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:26.892847 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a66e93a4-2c04-4a70-9398-492a921e332c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:27.142353 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a66e93a4-2c04-4a70-9398-492a921e332c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:27.228811 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a66e93a4-2c04-4a70-9398-492a921e332c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Subnet': ['ID=1fd20785-9486-417b-848f-c34ff54e52c2,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:27.263020 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a66e93a4-2c04-4a70-9398-492a921e332c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Checking segment: {'id': '53165fdf-1191-415a-93ee-d62f64e584de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '980ffcba-7010-4a1b-98fa-0f7d5172fced'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:46:27.263260 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a66e93a4-2c04-4a70-9398-492a921e332c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network hostable DHCP agents. Network: 980ffcba-7010-4a1b-98fa-0f7d5172fced, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:46:27.287516 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:27.305048 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a66e93a4-2c04-4a70-9398-492a921e332c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network 980ffcba-7010-4a1b-98fa-0f7d5172fced is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:46:27.324320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-a66e93a4-2c04-4a70-9398-492a921e332c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 980ffcba-7010-4a1b-98fa-0f7d5172fced) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:27.332006 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a66e93a4-2c04-4a70-9398-492a921e332c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:27.333864 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a66e93a4-2c04-4a70-9398-492a921e332c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:27.353408 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ca55e8d-358c-41e8-8f2c-03eef58e2a41 None None] Network 980ffcba-7010-4a1b-98fa-0f7d5172fced requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:46:27.382026 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a66e93a4-2c04-4a70-9398-492a921e332c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.7627559 Dec 09 21:46:27.384332 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42738) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:27.390398 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-aeaf8e49-4247-417d-87dc-b04e87b169a6 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'port': {'network_id': '980ffcba-7010-4a1b-98fa-0f7d5172fced', 'name': 'tempest-PortsIpV6TestJSON-1850203550'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:27.484872 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:27.486494 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b787ac87-4634-499a-b97e-3cf2df241c14 req-cee8557b-b322-4b25-b9b7-f7cf691ec3ad tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:27.488327 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b787ac87-4634-499a-b97e-3cf2df241c14 req-cee8557b-b322-4b25-b9b7-f7cf691ec3ad tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.0967383 Dec 09 21:46:27.504002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-98a076a4-868a-4406-849e-f5cbe4c3473c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-980ffcba-7010-4a1b-98fa-0f7d5172fced', 'network_id': '980ffcba-7010-4a1b-98fa-0f7d5172fced', 'project_id': '9560c66e717c47918bfe698e159759c5', 'fixed_ips': [{'subnet_id': '1fd20785-9486-417b-848f-c34ff54e52c2'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:46:27.504887 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-98a076a4-868a-4406-849e-f5cbe4c3473c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:27.549683 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b787ac87-4634-499a-b97e-3cf2df241c14 req-1cdc94e8-5757-4f9d-8494-930794a5ebb7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0552959 Dec 09 21:46:27.661612 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aeaf8e49-4247-417d-87dc-b04e87b169a6 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:27.674438 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aeaf8e49-4247-417d-87dc-b04e87b169a6 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:27.724610 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-aeaf8e49-4247-417d-87dc-b04e87b169a6 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] device_id is not set on port b6341453-864b-4c4f-9b8a-a8b1fbc3e1d4 yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:46:27.746770 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-98a076a4-868a-4406-849e-f5cbe4c3473c None None] Allocated IP 2001:db8::2 (980ffcba-7010-4a1b-98fa-0f7d5172fced/1fd20785-9486-417b-848f-c34ff54e52c2/5921c25a-c2b1-4bdf-8c0f-a066962fb832) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:46:27.961795 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-98a076a4-868a-4406-849e-f5cbe4c3473c None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:27.970961 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-98a076a4-868a-4406-849e-f5cbe4c3473c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:28.054087 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98a076a4-868a-4406-849e-f5cbe4c3473c None None] Pushing event updated for resources: {'Port': ['ID=5921c25a-c2b1-4bdf-8c0f-a066962fb832,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:28.066872 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-98a076a4-868a-4406-849e-f5cbe4c3473c None None] Network 980ffcba-7010-4a1b-98fa-0f7d5172fced is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:46:28.067944 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-98a076a4-868a-4406-849e-f5cbe4c3473c None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:28.070502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98a076a4-868a-4406-849e-f5cbe4c3473c None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:46:28.093528 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-aeaf8e49-4247-417d-87dc-b04e87b169a6 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Allocated IP 2001:db8::1d5 (980ffcba-7010-4a1b-98fa-0f7d5172fced/1fd20785-9486-417b-848f-c34ff54e52c2/b6341453-864b-4c4f-9b8a-a8b1fbc3e1d4) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:46:28.145796 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-98a076a4-868a-4406-849e-f5cbe4c3473c None None] Attempting to bind port 5921c25a-c2b1-4bdf-8c0f-a066962fb832 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:46:28.147791 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-98a076a4-868a-4406-849e-f5cbe4c3473c None None] Attempting to bind port 5921c25a-c2b1-4bdf-8c0f-a066962fb832 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '53165fdf-1191-415a-93ee-d62f64e584de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '980ffcba-7010-4a1b-98fa-0f7d5172fced'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:46:28.148902 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-98a076a4-868a-4406-849e-f5cbe4c3473c None None] Attempting to bind port 5921c25a-c2b1-4bdf-8c0f-a066962fb832 on network 980ffcba-7010-4a1b-98fa-0f7d5172fced {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:46:28.161857 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-98a076a4-868a-4406-849e-f5cbe4c3473c None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 46, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:46:28.162787 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-98a076a4-868a-4406-849e-f5cbe4c3473c None None] Checking segment: {'id': '53165fdf-1191-415a-93ee-d62f64e584de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '980ffcba-7010-4a1b-98fa-0f7d5172fced'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:46:28.164708 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-98a076a4-868a-4406-849e-f5cbe4c3473c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:28.166441 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-98a076a4-868a-4406-849e-f5cbe4c3473c None None] Bound using segment: {'id': '53165fdf-1191-415a-93ee-d62f64e584de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '980ffcba-7010-4a1b-98fa-0f7d5172fced'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:46:28.167721 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-98a076a4-868a-4406-849e-f5cbe4c3473c None None] Bound port: 5921c25a-c2b1-4bdf-8c0f-a066962fb832, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '53165fdf-1191-415a-93ee-d62f64e584de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '980ffcba-7010-4a1b-98fa-0f7d5172fced'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:46:28.169067 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-98a076a4-868a-4406-849e-f5cbe4c3473c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:28.293905 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-98a076a4-868a-4406-849e-f5cbe4c3473c None None] For port 5921c25a-c2b1-4bdf-8c0f-a066962fb832, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:46:28.300208 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-98a076a4-868a-4406-849e-f5cbe4c3473c None None] For port 5921c25a-c2b1-4bdf-8c0f-a066962fb832, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5921c25a-c2b1-4bdf-8c0f-a066962fb832,segment=NetworkSegment(53165fdf-1191-415a-93ee-d62f64e584de),segment_id=53165fdf-1191-415a-93ee-d62f64e584de)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:46:28.310978 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-98a076a4-868a-4406-849e-f5cbe4c3473c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:28.410382 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aeaf8e49-4247-417d-87dc-b04e87b169a6 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:28.416769 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98a076a4-868a-4406-849e-f5cbe4c3473c None None] Pushing event updated for resources: {'Port': ['ID=5921c25a-c2b1-4bdf-8c0f-a066962fb832,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:28.489363 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aeaf8e49-4247-417d-87dc-b04e87b169a6 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:28.558846 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aeaf8e49-4247-417d-87dc-b04e87b169a6 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network 980ffcba-7010-4a1b-98fa-0f7d5172fced is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:46:28.562645 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-aeaf8e49-4247-417d-87dc-b04e87b169a6 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:28.570589 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aeaf8e49-4247-417d-87dc-b04e87b169a6 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:46:28.580219 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aeaf8e49-4247-417d-87dc-b04e87b169a6 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:28.580970 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aeaf8e49-4247-417d-87dc-b04e87b169a6 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:28.588858 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeaf8e49-4247-417d-87dc-b04e87b169a6 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Port': ['ID=b6341453-864b-4c4f-9b8a-a8b1fbc3e1d4,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:28.636845 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-aeaf8e49-4247-417d-87dc-b04e87b169a6 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 1.2513108 Dec 09 21:46:28.640195 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42766) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:28.655243 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-12a53e1a-8f03-435e-b833-2313ef7789ea tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'port': {'network_id': '980ffcba-7010-4a1b-98fa-0f7d5172fced', 'name': 'tempest-PortsIpV6TestJSON-292511163'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:28.833561 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56b50039-8bf2-4d70-93e7-4bbb351c9564 req-c8d67f2a-9cbe-41c4-94b8-bbd45b0fab80 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:28.837377 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56b50039-8bf2-4d70-93e7-4bbb351c9564 req-c8d67f2a-9cbe-41c4-94b8-bbd45b0fab80 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.1148653 Dec 09 21:46:28.863788 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-12a53e1a-8f03-435e-b833-2313ef7789ea tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:28.868104 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-12a53e1a-8f03-435e-b833-2313ef7789ea tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:28.896999 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-12a53e1a-8f03-435e-b833-2313ef7789ea tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] device_id is not set on port 27561cbe-4cb0-43bd-83a2-9113f580f54a yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:46:28.923148 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56b50039-8bf2-4d70-93e7-4bbb351c9564 req-4ed8e3b1-c3c8-4554-9762-955a4b57c3b9 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0714703 Dec 09 21:46:29.056054 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-12a53e1a-8f03-435e-b833-2313ef7789ea tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Allocated IP 2001:db8::1b3 (980ffcba-7010-4a1b-98fa-0f7d5172fced/1fd20785-9486-417b-848f-c34ff54e52c2/27561cbe-4cb0-43bd-83a2-9113f580f54a) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:46:29.303877 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-12a53e1a-8f03-435e-b833-2313ef7789ea tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:29.354141 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-12a53e1a-8f03-435e-b833-2313ef7789ea tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:29.456644 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12a53e1a-8f03-435e-b833-2313ef7789ea tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network 980ffcba-7010-4a1b-98fa-0f7d5172fced is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:46:29.458728 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12a53e1a-8f03-435e-b833-2313ef7789ea tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Port': ['ID=27561cbe-4cb0-43bd-83a2-9113f580f54a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:29.472174 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-12a53e1a-8f03-435e-b833-2313ef7789ea tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:29.476743 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12a53e1a-8f03-435e-b833-2313ef7789ea tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:46:29.484049 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12a53e1a-8f03-435e-b833-2313ef7789ea tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:29.484712 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-12a53e1a-8f03-435e-b833-2313ef7789ea tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:29.511343 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-12a53e1a-8f03-435e-b833-2313ef7789ea tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 930 time: 0.8696878 Dec 09 21:46:29.514023 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42784) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:29.644730 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5d4f9577-ec6b-4606-98ab-08400a1873e4 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:29.646727 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5d4f9577-ec6b-4606-98ab-08400a1873e4 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports?fixed_ips=ip_address%3D2001%3Adb8%3A%3A1d5 HTTP/1.1" status: 200 len: 929 time: 0.1310875 Dec 09 21:46:29.655088 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42792) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:29.719744 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42794) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:29.773601 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-42338c63-f4d1-435f-9232-f4b22e3c9382 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting port 27561cbe-4cb0-43bd-83a2-9113f580f54a {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:29.774245 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-42338c63-f4d1-435f-9232-f4b22e3c9382 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:29.808831 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-567c730b-47b6-4063-ae73-dacbef4e73dc None None] Network 980ffcba-7010-4a1b-98fa-0f7d5172fced requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:46:29.908462 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d27cf447-2cf4-4a91-9b76-03c8184784c0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:29.914684 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-42338c63-f4d1-435f-9232-f4b22e3c9382 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:29.929379 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-42338c63-f4d1-435f-9232-f4b22e3c9382 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Calling delete_port for 27561cbe-4cb0-43bd-83a2-9113f580f54a owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:29.940452 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1f1142d9-e1a4-4f38-af0a-c59fe2f58950 None None] Provisioning complete for port 5921c25a-c2b1-4bdf-8c0f-a066962fb832 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:29.941119 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1f1142d9-e1a4-4f38-af0a-c59fe2f58950 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:30.109527 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d27cf447-2cf4-4a91-9b76-03c8184784c0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:30.117452 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d27cf447-2cf4-4a91-9b76-03c8184784c0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:30.129632 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1f1142d9-e1a4-4f38-af0a-c59fe2f58950 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:30.179649 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d27cf447-2cf4-4a91-9b76-03c8184784c0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=77aac31d-e825-412b-bb5b-de47bd530263,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:30.192845 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-1f1142d9-e1a4-4f38-af0a-c59fe2f58950 None None] For port 5921c25a-c2b1-4bdf-8c0f-a066962fb832, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5921c25a-c2b1-4bdf-8c0f-a066962fb832,segment=NetworkSegment(53165fdf-1191-415a-93ee-d62f64e584de),segment_id=53165fdf-1191-415a-93ee-d62f64e584de)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:30.200197 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d27cf447-2cf4-4a91-9b76-03c8184784c0 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=5da1e87d81b54e12aaf069341dd33b9d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4788864 Dec 09 21:46:30.203612 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1f1142d9-e1a4-4f38-af0a-c59fe2f58950 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:30.209289 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42804) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:30.219927 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea41a045-6687-49be-b998-0257361fb017 req-f4abb9ed-06e3-410b-94d3-13f2609218b2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:30.221809 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea41a045-6687-49be-b998-0257361fb017 req-f4abb9ed-06e3-410b-94d3-13f2609218b2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.1881349 Dec 09 21:46:30.229057 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-42338c63-f4d1-435f-9232-f4b22e3c9382 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:30.360379 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42338c63-f4d1-435f-9232-f4b22e3c9382 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Port': ['ID=27561cbe-4cb0-43bd-83a2-9113f580f54a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:30.401643 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-801a456c-cbe9-4b90-ab61-e21f99c4ab09 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:30.557061 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-42338c63-f4d1-435f-9232-f4b22e3c9382 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:30.566374 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-42338c63-f4d1-435f-9232-f4b22e3c9382 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/ports/27561cbe-4cb0-43bd-83a2-9113f580f54a HTTP/1.1" status: 204 len: 168 time: 0.9052966 Dec 09 21:46:30.569166 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42816) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:30.587198 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-801a456c-cbe9-4b90-ab61-e21f99c4ab09 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:30.604876 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea41a045-6687-49be-b998-0257361fb017 req-7babe1e9-d00f-4ab0-a231-a306e1beac9b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3738503 Dec 09 21:46:30.622473 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f1142d9-e1a4-4f38-af0a-c59fe2f58950 None None] Pushing event updated for resources: {'Port': ['ID=5921c25a-c2b1-4bdf-8c0f-a066962fb832,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:30.669145 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-321bd71e-0f54-43d0-b014-073fc21ded0b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] GET failed (client error): The resource could not be found. Dec 09 21:46:30.687149 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-321bd71e-0f54-43d0-b014-073fc21ded0b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports/27561cbe-4cb0-43bd-83a2-9113f580f54a HTTP/1.1" status: 404 len: 333 time: 0.1166902 Dec 09 21:46:30.687603 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-801a456c-cbe9-4b90-ab61-e21f99c4ab09 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:30.691077 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e6a1fdd8-5d3d-4de8-a6f4-7c62e6eb280a None None] Provisioning complete for port b6341453-864b-4c4f-9b8a-a8b1fbc3e1d4 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:30.691251 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42820) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:30.691473 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e6a1fdd8-5d3d-4de8-a6f4-7c62e6eb280a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:30.695905 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-801a456c-cbe9-4b90-ab61-e21f99c4ab09 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:30.703057 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-801a456c-cbe9-4b90-ab61-e21f99c4ab09 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/77aac31d-e825-412b-bb5b-de47bd530263 HTTP/1.1" status: 204 len: 168 time: 0.4798930 Dec 09 21:46:30.730918 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-801a456c-cbe9-4b90-ab61-e21f99c4ab09 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=77aac31d-e825-412b-bb5b-de47bd530263,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:30.798504 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e6a1fdd8-5d3d-4de8-a6f4-7c62e6eb280a None None] Port b6341453-864b-4c4f-9b8a-a8b1fbc3e1d4 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:46:30.803191 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e6a1fdd8-5d3d-4de8-a6f4-7c62e6eb280a None None] Could not find standard attr ID for object 27561cbe-4cb0-43bd-83a2-9113f580f54a. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:46:30.823423 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e6a1fdd8-5d3d-4de8-a6f4-7c62e6eb280a None None] Provisioning complete for port 5921c25a-c2b1-4bdf-8c0f-a066962fb832 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:30.825594 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e6a1fdd8-5d3d-4de8-a6f4-7c62e6eb280a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:30.898460 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5921c25a-c2b1-4bdf-8c0f-a066962fb832 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:46:30.909402 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42828) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:31.171019 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 5921c25a-c2b1-4bdf-8c0f-a066962fb832 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:31.183976 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:31.357821 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-35aeea1b-16f0-4f66-969c-4a8ec29c35cd admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:31.388695 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4ba8cf5e-893b-420c-a3d9-604a3def55af None None] Provisioning complete for port b6341453-864b-4c4f-9b8a-a8b1fbc3e1d4 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:31.389308 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4ba8cf5e-893b-420c-a3d9-604a3def55af None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:31.439097 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-4ba8cf5e-893b-420c-a3d9-604a3def55af None None] Port b6341453-864b-4c4f-9b8a-a8b1fbc3e1d4 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:46:31.445800 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42840) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:31.489001 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a9be865-0648-41bb-a5b0-a58af23fdd8f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:31.541813 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-35aeea1b-16f0-4f66-969c-4a8ec29c35cd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:31.553302 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-35aeea1b-16f0-4f66-969c-4a8ec29c35cd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:31.556087 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5b564d7c-18a8-4e8a-b110-87a6a80cdca8 None None] Could not find standard attr ID for object 27561cbe-4cb0-43bd-83a2-9113f580f54a. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:46:31.625749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35aeea1b-16f0-4f66-969c-4a8ec29c35cd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2645be87-6f0a-42e3-adb5-86644673f2e3,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:31.645815 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-35aeea1b-16f0-4f66-969c-4a8ec29c35cd admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=7550d6d4036542abb8fbb6794e0f99ab&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7349305 Dec 09 21:46:31.647914 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42844) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:31.690121 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a9be865-0648-41bb-a5b0-a58af23fdd8f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:31.700716 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5a9be865-0648-41bb-a5b0-a58af23fdd8f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:31.717114 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d1e7068d-4de0-47f2-b803-478dec96350d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:31.740812 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d1e7068d-4de0-47f2-b803-478dec96350d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:31.767253 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5a9be865-0648-41bb-a5b0-a58af23fdd8f admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=def7b48315164cb3ad300b6440b6a178&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3139415 Dec 09 21:46:31.768532 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a9be865-0648-41bb-a5b0-a58af23fdd8f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=246eb23f-d2a1-4b75-9b8c-bf409a3c2048,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:31.773303 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-726d5378-1f36-4e9b-be87-2809ddcc7623 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting port b6341453-864b-4c4f-9b8a-a8b1fbc3e1d4 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:31.773931 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-726d5378-1f36-4e9b-be87-2809ddcc7623 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:31.778323 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42850) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:31.831048 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d1e7068d-4de0-47f2-b803-478dec96350d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:31.834701 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d1e7068d-4de0-47f2-b803-478dec96350d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:31.838341 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d1e7068d-4de0-47f2-b803-478dec96350d admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/2645be87-6f0a-42e3-adb5-86644673f2e3 HTTP/1.1" status: 204 len: 168 time: 0.1870911 Dec 09 21:46:31.865956 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1e7068d-4de0-47f2-b803-478dec96350d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2645be87-6f0a-42e3-adb5-86644673f2e3,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:31.928254 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b4beeb2a-750f-47a3-9da0-116a292427b6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:31.955285 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6758503d-c56c-4e20-b172-842643f41d27 req-39b88835-ae09-4106-aaed-915378ced787 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:31.962787 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6758503d-c56c-4e20-b172-842643f41d27 req-39b88835-ae09-4106-aaed-915378ced787 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.2149963 Dec 09 21:46:31.963912 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-726d5378-1f36-4e9b-be87-2809ddcc7623 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:31.975056 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b4beeb2a-750f-47a3-9da0-116a292427b6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:32.006331 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-726d5378-1f36-4e9b-be87-2809ddcc7623 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Calling delete_port for b6341453-864b-4c4f-9b8a-a8b1fbc3e1d4 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:32.048467 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6758503d-c56c-4e20-b172-842643f41d27 req-4c055053-9438-4c04-89b2-0c8c0cca9340 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0841196 Dec 09 21:46:32.119594 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b4beeb2a-750f-47a3-9da0-116a292427b6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:32.122087 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b4beeb2a-750f-47a3-9da0-116a292427b6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:32.126295 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b4beeb2a-750f-47a3-9da0-116a292427b6 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/246eb23f-d2a1-4b75-9b8c-bf409a3c2048 HTTP/1.1" status: 204 len: 168 time: 0.3437924 Dec 09 21:46:32.142917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4beeb2a-750f-47a3-9da0-116a292427b6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=246eb23f-d2a1-4b75-9b8c-bf409a3c2048,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:32.270086 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-726d5378-1f36-4e9b-be87-2809ddcc7623 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:32.305509 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-726d5378-1f36-4e9b-be87-2809ddcc7623 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Port': ['ID=b6341453-864b-4c4f-9b8a-a8b1fbc3e1d4,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:32.346535 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-726d5378-1f36-4e9b-be87-2809ddcc7623 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:32.351590 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-726d5378-1f36-4e9b-be87-2809ddcc7623 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/ports/b6341453-864b-4c4f-9b8a-a8b1fbc3e1d4 HTTP/1.1" status: 204 len: 168 time: 1.6587780 Dec 09 21:46:32.354243 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42862) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:32.375293 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42864) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:32.384669 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-e5ccd72a-e8da-46fa-8a07-afabd974a09a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] GET failed (client error): The resource could not be found. Dec 09 21:46:32.387305 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e5ccd72a-e8da-46fa-8a07-afabd974a09a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports/b6341453-864b-4c4f-9b8a-a8b1fbc3e1d4 HTTP/1.1" status: 404 len: 333 time: 0.0311675 Dec 09 21:46:32.389622 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42866) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:32.397006 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-676fe73c-fc1b-47e1-aa88-9cb115a8a8de admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:32.498597 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-9889593f-da14-41ae-9a29-226f93405147 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting subnet 1fd20785-9486-417b-848f-c34ff54e52c2 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:46:32.504122 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9889593f-da14-41ae-9a29-226f93405147 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:32.523142 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-676fe73c-fc1b-47e1-aa88-9cb115a8a8de admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:32.529700 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-676fe73c-fc1b-47e1-aa88-9cb115a8a8de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:32.580796 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-676fe73c-fc1b-47e1-aa88-9cb115a8a8de admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=7d4384bf868e407bafd8998f7b5cd354&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2040725 Dec 09 21:46:32.585129 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42878) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:32.591355 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-676fe73c-fc1b-47e1-aa88-9cb115a8a8de admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2b4a4eb2-b6c4-402b-bcc6-6dd65f11a8b5,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:32.600898 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9889593f-da14-41ae-9a29-226f93405147 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:32.720961 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9889593f-da14-41ae-9a29-226f93405147 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:32.734771 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5921c25a-c2b1-4bdf-8c0f-a066962fb832 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:46:32.802750 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 5921c25a-c2b1-4bdf-8c0f-a066962fb832 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:32.803214 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:32.812298 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eafbf234-a42d-4a55-8d1f-addc5a4014a5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:32.841498 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9889593f-da14-41ae-9a29-226f93405147 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:32.845034 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eafbf234-a42d-4a55-8d1f-addc5a4014a5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:32.916584 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9889593f-da14-41ae-9a29-226f93405147 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Subnet': ['ID=1fd20785-9486-417b-848f-c34ff54e52c2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:32.922116 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9889593f-da14-41ae-9a29-226f93405147 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:32.929414 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42894) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:32.931496 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b915bfd1-ea0a-4684-8f42-8ae4fe54e75f None None] Network 980ffcba-7010-4a1b-98fa-0f7d5172fced requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:46:32.934697 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9889593f-da14-41ae-9a29-226f93405147 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/subnets/1fd20785-9486-417b-848f-c34ff54e52c2 HTTP/1.1" status: 204 len: 168 time: 0.5384166 Dec 09 21:46:32.964836 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eafbf234-a42d-4a55-8d1f-addc5a4014a5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:32.967485 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eafbf234-a42d-4a55-8d1f-addc5a4014a5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:32.968703 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-eafbf234-a42d-4a55-8d1f-addc5a4014a5 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/2b4a4eb2-b6c4-402b-bcc6-6dd65f11a8b5 HTTP/1.1" status: 204 len: 168 time: 0.3796957 Dec 09 21:46:32.985510 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eafbf234-a42d-4a55-8d1f-addc5a4014a5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2b4a4eb2-b6c4-402b-bcc6-6dd65f11a8b5,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:33.070249 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-062c44b2-f33f-44a2-9e24-5d76be0334fb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:33.091865 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fd174b7f-1591-4e40-a6fa-08ce8b8e8c37 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:33.187506 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5c460df-8173-4b3a-9186-ccb46a682fa7 None None] DHCP port deletion for 980ffcba-7010-4a1b-98fa-0f7d5172fced request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:46:33.219760 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-453477dd-36e4-4d1e-97c2-d45f0948818a req-813cacd3-cd2b-485d-b538-4bcbecb88ea5 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:33.221537 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-453477dd-36e4-4d1e-97c2-d45f0948818a req-813cacd3-cd2b-485d-b538-4bcbecb88ea5 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.0727208 Dec 09 21:46:33.284678 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-fd174b7f-1591-4e40-a6fa-08ce8b8e8c37 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting port 5921c25a-c2b1-4bdf-8c0f-a066962fb832 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:33.285021 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fd174b7f-1591-4e40-a6fa-08ce8b8e8c37 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:33.291809 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-c5c460df-8173-4b3a-9186-ccb46a682fa7 None None] Deleting port 5921c25a-c2b1-4bdf-8c0f-a066962fb832 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:33.292546 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c5c460df-8173-4b3a-9186-ccb46a682fa7 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:33.307827 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-453477dd-36e4-4d1e-97c2-d45f0948818a req-0035f87f-e6e4-4303-8c18-4d6be988fdee tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0780699 Dec 09 21:46:33.398108 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c5c460df-8173-4b3a-9186-ccb46a682fa7 None None] For port 5921c25a-c2b1-4bdf-8c0f-a066962fb832, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5921c25a-c2b1-4bdf-8c0f-a066962fb832,segment=NetworkSegment(53165fdf-1191-415a-93ee-d62f64e584de),segment_id=53165fdf-1191-415a-93ee-d62f64e584de)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:33.398765 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c5c460df-8173-4b3a-9186-ccb46a682fa7 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:33.415337 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-c5c460df-8173-4b3a-9186-ccb46a682fa7 None None] Calling delete_port for 5921c25a-c2b1-4bdf-8c0f-a066962fb832 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:33.450734 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-fd174b7f-1591-4e40-a6fa-08ce8b8e8c37 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] For port 5921c25a-c2b1-4bdf-8c0f-a066962fb832, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5921c25a-c2b1-4bdf-8c0f-a066962fb832,segment=NetworkSegment(53165fdf-1191-415a-93ee-d62f64e584de),segment_id=53165fdf-1191-415a-93ee-d62f64e584de)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:33.451312 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fd174b7f-1591-4e40-a6fa-08ce8b8e8c37 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:33.486871 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d4c0f972-5873-4aa8-9dcd-b3d68f263bf2 req-c4e78a4e-3695-4551-b12d-103a6d8829c8 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0978184 Dec 09 21:46:33.487108 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-fd174b7f-1591-4e40-a6fa-08ce8b8e8c37 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Calling delete_port for 5921c25a-c2b1-4bdf-8c0f-a066962fb832 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:33.546961 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c5c460df-8173-4b3a-9186-ccb46a682fa7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:33.599818 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5c460df-8173-4b3a-9186-ccb46a682fa7 None None] Pushing event deleted for resources: {'Port': ['ID=5921c25a-c2b1-4bdf-8c0f-a066962fb832,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:33.608435 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5c460df-8173-4b3a-9186-ccb46a682fa7 None None] No DVR routers for this DVR port 5921c25a-c2b1-4bdf-8c0f-a066962fb832 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:46:33.622215 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c0f972-5873-4aa8-9dcd-b3d68f263bf2 req-a17f6bec-8120-4fd0-9bf8-2cb61fee5591 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:33.623811 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d4c0f972-5873-4aa8-9dcd-b3d68f263bf2 req-a17f6bec-8120-4fd0-9bf8-2cb61fee5591 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=289b15efb1cc4b5fbaefca8970d43a70&device_id=3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f HTTP/1.1" status: 200 len: 1102 time: 0.0702720 Dec 09 21:46:33.667017 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fd174b7f-1591-4e40-a6fa-08ce8b8e8c37 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:33.714680 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd174b7f-1591-4e40-a6fa-08ce8b8e8c37 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Port': ['ID=5921c25a-c2b1-4bdf-8c0f-a066962fb832,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:33.719572 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd174b7f-1591-4e40-a6fa-08ce8b8e8c37 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] No DVR routers for this DVR port 5921c25a-c2b1-4bdf-8c0f-a066962fb832 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:46:33.835134 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fd174b7f-1591-4e40-a6fa-08ce8b8e8c37 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:33.845417 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c0f972-5873-4aa8-9dcd-b3d68f263bf2 req-48c4c90d-ad50-48d8-919f-bdeea4899011 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:33.848648 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d4c0f972-5873-4aa8-9dcd-b3d68f263bf2 req-48c4c90d-ad50-48d8-919f-bdeea4899011 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.1995697 Dec 09 21:46:33.859856 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-fd174b7f-1591-4e40-a6fa-08ce8b8e8c37 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['980ffcba-7010-4a1b-98fa-0f7d5172fced']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:33.874583 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-fd174b7f-1591-4e40-a6fa-08ce8b8e8c37 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '53165fdf-1191-415a-93ee-d62f64e584de') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:33.875092 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-fd174b7f-1591-4e40-a6fa-08ce8b8e8c37 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '53165fdf-1191-415a-93ee-d62f64e584de') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:33.887155 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fd174b7f-1591-4e40-a6fa-08ce8b8e8c37 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:33.903483 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d4c0f972-5873-4aa8-9dcd-b3d68f263bf2 req-99e852c8-e022-44aa-b117-a427d0988d0b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.132&port_id=cfd5c800-4c6d-4766-9675-137da0da42a4 HTTP/1.1" status: 200 len: 217 time: 0.0463159 Dec 09 21:46:33.904046 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fd174b7f-1591-4e40-a6fa-08ce8b8e8c37 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:33.911656 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fd174b7f-1591-4e40-a6fa-08ce8b8e8c37 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Releasing vlan 144 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:46:33.913201 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fd174b7f-1591-4e40-a6fa-08ce8b8e8c37 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:46:33.918408 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:46:34.002734 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fd174b7f-1591-4e40-a6fa-08ce8b8e8c37 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:34.018035 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c0f972-5873-4aa8-9dcd-b3d68f263bf2 req-7eca6e2a-8001-4529-94bb-ee6c9cf8379e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:34.020165 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d4c0f972-5873-4aa8-9dcd-b3d68f263bf2 req-7eca6e2a-8001-4529-94bb-ee6c9cf8379e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1085935 Dec 09 21:46:34.026645 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fd174b7f-1591-4e40-a6fa-08ce8b8e8c37 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:34.033578 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fd174b7f-1591-4e40-a6fa-08ce8b8e8c37 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/networks/980ffcba-7010-4a1b-98fa-0f7d5172fced HTTP/1.1" status: 204 len: 168 time: 1.1030464 Dec 09 21:46:34.037214 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd174b7f-1591-4e40-a6fa-08ce8b8e8c37 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Network': ['ID=980ffcba-7010-4a1b-98fa-0f7d5172fced,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:34.039606 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 42942) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:34.046152 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-32e2296a-cbec-40ad-87a4-c570406956b5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-604855118'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:34.146526 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-32e2296a-cbec-40ad-87a4-c570406956b5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:34.152424 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-32e2296a-cbec-40ad-87a4-c570406956b5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:34.195296 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c0f972-5873-4aa8-9dcd-b3d68f263bf2 req-98f4233b-640f-4106-a7b7-00eeb1f66240 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:34.197130 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d4c0f972-5873-4aa8-9dcd-b3d68f263bf2 req-98f4233b-640f-4106-a7b7-00eeb1f66240 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1676831 Dec 09 21:46:34.223914 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-32e2296a-cbec-40ad-87a4-c570406956b5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] vlan segment allocate from pool success with {'vlan_id': 135, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:46:34.258109 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-32e2296a-cbec-40ad-87a4-c570406956b5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:34.258477 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-32e2296a-cbec-40ad-87a4-c570406956b5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Added segment c2a46b48-55da-4918-a4b5-d1ee57465515 of type vlan for network fb7e4c82-3ef1-4473-96be-92dff676e8f7 Dec 09 21:46:34.349629 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-32e2296a-cbec-40ad-87a4-c570406956b5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:34.385690 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d4c0f972-5873-4aa8-9dcd-b3d68f263bf2 req-ae8dde58-f2fb-4d33-9999-0d9d060fb818 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1753199 Dec 09 21:46:34.415670 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-32e2296a-cbec-40ad-87a4-c570406956b5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:34.427398 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32e2296a-cbec-40ad-87a4-c570406956b5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:34.428604 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-32e2296a-cbec-40ad-87a4-c570406956b5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:34.490735 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fba6c8ed-d8b2-429f-b1da-000879e6b295 req-87875b63-943f-49ad-8b4f-2ae29d93178f tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:34.492424 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fba6c8ed-d8b2-429f-b1da-000879e6b295 req-87875b63-943f-49ad-8b4f-2ae29d93178f tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.0699365 Dec 09 21:46:34.602007 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fba6c8ed-d8b2-429f-b1da-000879e6b295 req-7111a6b0-4bf4-4afa-831c-907131a7c993 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0982838 Dec 09 21:46:34.606207 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-32e2296a-cbec-40ad-87a4-c570406956b5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.5620680 Dec 09 21:46:34.608214 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42970) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:34.616835 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-064dad9e-b7cb-4424-ace1-a92deb42f6a9 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'subnet': {'network_id': 'fb7e4c82-3ef1-4473-96be-92dff676e8f7', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:34.623830 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32e2296a-cbec-40ad-87a4-c570406956b5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Network': ['ID=fb7e4c82-3ef1-4473-96be-92dff676e8f7,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:34.664301 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network fb7e4c82-3ef1-4473-96be-92dff676e8f7 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:46:34.712679 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d4c0f972-5873-4aa8-9dcd-b3d68f263bf2 req-a7fe2118-ef01-45d4-bff5-0b3f0e9da9b6 service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3149328 Dec 09 21:46:34.728401 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-064dad9e-b7cb-4424-ace1-a92deb42f6a9 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:34.733348 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-064dad9e-b7cb-4424-ace1-a92deb42f6a9 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:34.740172 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-e7689683-b92f-47f6-a2b0-f0bd04afa7f0 service neutron] show failed (client error): The resource could not be found. Dec 09 21:46:34.742732 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-e7689683-b92f-47f6-a2b0-f0bd04afa7f0 service neutron] 10.222.0.31 "GET /v2.0/ports/201bc3ab-e2ab-4e46-9cc3-b13f3373442f/bindings/n-h2-713301-27 HTTP/1.1" status: 404 len: 381 time: 0.1373365 Dec 09 21:46:34.832814 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5921c25a-c2b1-4bdf-8c0f-a066962fb832 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:46:34.891609 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 5921c25a-c2b1-4bdf-8c0f-a066962fb832 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:46:34.897574 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5921c25a-c2b1-4bdf-8c0f-a066962fb832 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:46:35.074457 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-064dad9e-b7cb-4424-ace1-a92deb42f6a9 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:35.151493 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-064dad9e-b7cb-4424-ace1-a92deb42f6a9 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Subnet': ['ID=c2cefd92-d863-4837-a455-bfc0adf031b5,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:35.166556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-064dad9e-b7cb-4424-ace1-a92deb42f6a9 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Checking segment: {'id': 'c2a46b48-55da-4918-a4b5-d1ee57465515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'fb7e4c82-3ef1-4473-96be-92dff676e8f7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:46:35.166946 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-064dad9e-b7cb-4424-ace1-a92deb42f6a9 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network hostable DHCP agents. Network: fb7e4c82-3ef1-4473-96be-92dff676e8f7, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:46:35.191335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-064dad9e-b7cb-4424-ace1-a92deb42f6a9 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network fb7e4c82-3ef1-4473-96be-92dff676e8f7 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:46:35.206309 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-064dad9e-b7cb-4424-ace1-a92deb42f6a9 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, fb7e4c82-3ef1-4473-96be-92dff676e8f7) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:35.212160 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-064dad9e-b7cb-4424-ace1-a92deb42f6a9 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:35.215398 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-064dad9e-b7cb-4424-ace1-a92deb42f6a9 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:35.218027 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b429d09c-39e2-4603-9a19-4ab6cae0308d None None] Network fb7e4c82-3ef1-4473-96be-92dff676e8f7 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:46:35.241711 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-064dad9e-b7cb-4424-ace1-a92deb42f6a9 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.6321123 Dec 09 21:46:35.244813 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 42994) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:35.252094 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-5eea4692-bef0-46e8-8aa7-815805c8ad59 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'port': {'network_id': 'fb7e4c82-3ef1-4473-96be-92dff676e8f7', 'name': 'tempest-PortsIpV6TestJSON-132800777', 'fixed_ips': [{'subnet_id': 'c2cefd92-d863-4837-a455-bfc0adf031b5', 'ip_address': '2001:db8::10'}]}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:35.342933 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-0480a25a-6741-4589-a613-ae1064096a0c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:35.346460 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-0480a25a-6741-4589-a613-ae1064096a0c service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b&tenant_id=dce7594ac2a74901912a2f19de04bf79 HTTP/1.1" status: 200 len: 1098 time: 0.3290689 Dec 09 21:46:35.377844 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] Request body: {'port': {'binding:host_id': 'n-h2-713301-27', 'device_owner': 'compute:nova'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:35.423095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5eea4692-bef0-46e8-8aa7-815805c8ad59 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:35.425659 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a419b570-03f9-4a61-94f7-7823edba8312 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-fb7e4c82-3ef1-4473-96be-92dff676e8f7', 'network_id': 'fb7e4c82-3ef1-4473-96be-92dff676e8f7', 'project_id': '9560c66e717c47918bfe698e159759c5', 'fixed_ips': [{'subnet_id': 'c2cefd92-d863-4837-a455-bfc0adf031b5'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:46:35.427246 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a419b570-03f9-4a61-94f7-7823edba8312 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:35.483641 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:35.524032 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5eea4692-bef0-46e8-8aa7-815805c8ad59 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:35.555912 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-5eea4692-bef0-46e8-8aa7-815805c8ad59 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] device_id is not set on port 4d8ef747-95ff-4165-9a81-1ad5316cc44d yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:46:35.731259 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-a419b570-03f9-4a61-94f7-7823edba8312 None None] Allocated IP 2001:db8::2 (fb7e4c82-3ef1-4473-96be-92dff676e8f7/c2cefd92-d863-4837-a455-bfc0adf031b5/50c5e515-b485-4209-94f7-425cf1c94c59) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:46:35.782877 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] For port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=201bc3ab-e2ab-4e46-9cc3-b13f3373442f,segment=NetworkSegment(2316fee1-a288-4d09-bf17-e0a19e0adf8d),segment_id=2316fee1-a288-4d09-bf17-e0a19e0adf8d)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:35.818839 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] For port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:46:35.846359 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69f2f70a-f407-4f63-99ea-4e5408cf1400 req-942621c7-de87-49db-958b-4b569efa77b2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:35.854816 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69f2f70a-f407-4f63-99ea-4e5408cf1400 req-942621c7-de87-49db-958b-4b569efa77b2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.0857289 Dec 09 21:46:35.878615 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9c9545e3-43c2-403d-a699-e38d4f4c2a1b', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '201bc3ab-e2ab-4e46-9cc3-b13f3373442f'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:46:35.881031 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f289b6a6-2ec5-4b2d-845d-a2c889d52964" -d '{"events": [{"server_uuid": "9c9545e3-43c2-403d-a699-e38d4f4c2a1b", "name": "network-vif-unplugged", "status": "completed", "tag": "201bc3ab-e2ab-4e46-9cc3-b13f3373442f"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:46:35.885052 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:35.921633 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] Transition to ACTIVE for port object 201bc3ab-e2ab-4e46-9cc3-b13f3373442f will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:46:35.929776 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:35.969371 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69f2f70a-f407-4f63-99ea-4e5408cf1400 req-ccbc7b41-e5a7-4fb7-9cbb-023f56f2766d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1040380 Dec 09 21:46:35.985869 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] Pushing event updated for resources: {'Port': ['ID=201bc3ab-e2ab-4e46-9cc3-b13f3373442f,revision_number=6']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:36.025059 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a419b570-03f9-4a61-94f7-7823edba8312 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:36.044010 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a419b570-03f9-4a61-94f7-7823edba8312 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:36.074043 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a419b570-03f9-4a61-94f7-7823edba8312 None None] Network fb7e4c82-3ef1-4473-96be-92dff676e8f7 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:46:36.078626 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-a419b570-03f9-4a61-94f7-7823edba8312 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:36.103409 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a419b570-03f9-4a61-94f7-7823edba8312 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:46:36.108943 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-75c328a8-c8a9-4cc9-ae08-c608a455efd6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:36.139938 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:46:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d417f121-01e2-41fe-86fd-0a852552840d x-openstack-request-id: req-d417f121-01e2-41fe-86fd-0a852552840d {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:46:36.143688 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9c9545e3-43c2-403d-a699-e38d4f4c2a1b", "name": "network-vif-unplugged", "status": "completed", "tag": "201bc3ab-e2ab-4e46-9cc3-b13f3373442f", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:46:36.144094 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-d417f121-01e2-41fe-86fd-0a852552840d {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:46:36.144631 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9c9545e3-43c2-403d-a699-e38d4f4c2a1b', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '201bc3ab-e2ab-4e46-9cc3-b13f3373442f', 'code': 200} Dec 09 21:46:36.194752 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a419b570-03f9-4a61-94f7-7823edba8312 None None] Pushing event updated for resources: {'Port': ['ID=50c5e515-b485-4209-94f7-425cf1c94c59,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:36.212515 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-5eea4692-bef0-46e8-8aa7-815805c8ad59 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Allocated IP 2001:db8::10 (fb7e4c82-3ef1-4473-96be-92dff676e8f7/c2cefd92-d863-4837-a455-bfc0adf031b5/4d8ef747-95ff-4165-9a81-1ad5316cc44d) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:46:36.241428 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a419b570-03f9-4a61-94f7-7823edba8312 None None] Attempting to bind port 50c5e515-b485-4209-94f7-425cf1c94c59 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:46:36.242958 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a419b570-03f9-4a61-94f7-7823edba8312 None None] Attempting to bind port 50c5e515-b485-4209-94f7-425cf1c94c59 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'c2a46b48-55da-4918-a4b5-d1ee57465515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'fb7e4c82-3ef1-4473-96be-92dff676e8f7'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:46:36.243363 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a419b570-03f9-4a61-94f7-7823edba8312 None None] Attempting to bind port 50c5e515-b485-4209-94f7-425cf1c94c59 on network fb7e4c82-3ef1-4473-96be-92dff676e8f7 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:46:36.261958 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a419b570-03f9-4a61-94f7-7823edba8312 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 46, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:46:36.263152 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a419b570-03f9-4a61-94f7-7823edba8312 None None] Checking segment: {'id': 'c2a46b48-55da-4918-a4b5-d1ee57465515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'fb7e4c82-3ef1-4473-96be-92dff676e8f7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:46:36.264435 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a419b570-03f9-4a61-94f7-7823edba8312 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:36.265008 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a419b570-03f9-4a61-94f7-7823edba8312 None None] Bound using segment: {'id': 'c2a46b48-55da-4918-a4b5-d1ee57465515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'fb7e4c82-3ef1-4473-96be-92dff676e8f7'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:46:36.267894 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a419b570-03f9-4a61-94f7-7823edba8312 None None] Bound port: 50c5e515-b485-4209-94f7-425cf1c94c59, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c2a46b48-55da-4918-a4b5-d1ee57465515', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': 'fb7e4c82-3ef1-4473-96be-92dff676e8f7'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:46:36.268522 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a419b570-03f9-4a61-94f7-7823edba8312 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:36.280171 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] No DVR routers for this DVR port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:46:36.370804 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a419b570-03f9-4a61-94f7-7823edba8312 None None] For port 50c5e515-b485-4209-94f7-425cf1c94c59, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:46:36.374550 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a419b570-03f9-4a61-94f7-7823edba8312 None None] For port 50c5e515-b485-4209-94f7-425cf1c94c59, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=50c5e515-b485-4209-94f7-425cf1c94c59,segment=NetworkSegment(c2a46b48-55da-4918-a4b5-d1ee57465515),segment_id=c2a46b48-55da-4918-a4b5-d1ee57465515)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:46:36.384015 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a419b570-03f9-4a61-94f7-7823edba8312 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:36.461644 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a419b570-03f9-4a61-94f7-7823edba8312 None None] Pushing event updated for resources: {'Port': ['ID=50c5e515-b485-4209-94f7-425cf1c94c59,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:36.561926 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] Attempting to bind port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:46:36.562897 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] Attempting to bind port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '2316fee1-a288-4d09-bf17-e0a19e0adf8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:46:36.563859 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] Attempting to bind port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f on network 4fbe35af-30ff-45b2-b84a-21fea4abf9aa {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:46:36.569869 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] Port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f on network 4fbe35af-30ff-45b2-b84a-21fea4abf9aa not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:46:36.570874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] Attempting to bind port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f on network 4fbe35af-30ff-45b2-b84a-21fea4abf9aa {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:46:36.607215 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 46, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:46:36.609084 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] Checking segment: {'id': '2316fee1-a288-4d09-bf17-e0a19e0adf8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:46:36.609612 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] Bound using segment: {'id': '2316fee1-a288-4d09-bf17-e0a19e0adf8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:46:36.610181 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] Bound port: 201bc3ab-e2ab-4e46-9cc3-b13f3373442f, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2316fee1-a288-4d09-bf17-e0a19e0adf8d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:46:36.612649 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:36.618547 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5eea4692-bef0-46e8-8aa7-815805c8ad59 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:36.650478 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:36.691073 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5eea4692-bef0-46e8-8aa7-815805c8ad59 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:36.734124 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] For port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:46:36.739298 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] For port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=201bc3ab-e2ab-4e46-9cc3-b13f3373442f,segment=NetworkSegment(2316fee1-a288-4d09-bf17-e0a19e0adf8d),segment_id=2316fee1-a288-4d09-bf17-e0a19e0adf8d)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:46:36.745882 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:36.789321 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5eea4692-bef0-46e8-8aa7-815805c8ad59 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network fb7e4c82-3ef1-4473-96be-92dff676e8f7 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:46:36.814956 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5eea4692-bef0-46e8-8aa7-815805c8ad59 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Port': ['ID=4d8ef747-95ff-4165-9a81-1ad5316cc44d,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:36.828974 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] Pushing event updated for resources: {'Port': ['ID=201bc3ab-e2ab-4e46-9cc3-b13f3373442f,revision_number=7']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:36.834206 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-5eea4692-bef0-46e8-8aa7-815805c8ad59 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:36.834743 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:36.835384 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:36.837291 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-a6b6df06-39dc-4784-997d-ea5b2aebe8e2 service neutron] 10.222.0.10 "PUT /v2.0/ports/201bc3ab-e2ab-4e46-9cc3-b13f3373442f HTTP/1.1" status: 200 len: 1093 time: 1.4664619 Dec 09 21:46:36.876098 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5eea4692-bef0-46e8-8aa7-815805c8ad59 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:46:36.895279 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5eea4692-bef0-46e8-8aa7-815805c8ad59 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:36.898886 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5eea4692-bef0-46e8-8aa7-815805c8ad59 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:36.955975 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5eea4692-bef0-46e8-8aa7-815805c8ad59 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.7099543 Dec 09 21:46:36.958546 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43044) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:36.976549 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-0d516957-95ed-41d9-b984-d6a7f3c9ecc0 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'port': {'network_id': 'fb7e4c82-3ef1-4473-96be-92dff676e8f7', 'name': 'tempest-PortsIpV6TestJSON-1329021354', 'fixed_ips': [{'subnet_id': 'c2cefd92-d863-4837-a455-bfc0adf031b5', 'ip_address': '2001:db8::f'}]}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:36.994247 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-84611a38-9b71-4c3e-9312-83d14ce44e89 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:36.995855 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-84611a38-9b71-4c3e-9312-83d14ce44e89 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 1096 time: 0.1249900 Dec 09 21:46:37.198409 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-45c185fb-9b11-4e60-90e3-828f32b4b2cd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:37.199958 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-45c185fb-9b11-4e60-90e3-828f32b4b2cd service neutron] 10.222.0.10 "GET /v2.0/networks?id=4fbe35af-30ff-45b2-b84a-21fea4abf9aa HTTP/1.1" status: 200 len: 898 time: 0.1971211 Dec 09 21:46:37.300648 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-82501f85-9061-49c1-a460-6d6bde36479d service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=201bc3ab-e2ab-4e46-9cc3-b13f3373442f HTTP/1.1" status: 200 len: 1000 time: 0.0807676 Dec 09 21:46:37.312006 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec696f69-0e04-4dbd-82d6-22b20ab73f5d req-7d6149a1-d767-4202-9aa4-205062f6e789 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:37.319776 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec696f69-0e04-4dbd-82d6-22b20ab73f5d req-7d6149a1-d767-4202-9aa4-205062f6e789 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 944 time: 0.1962540 Dec 09 21:46:37.322350 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0d516957-95ed-41d9-b984-d6a7f3c9ecc0 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:37.327695 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d516957-95ed-41d9-b984-d6a7f3c9ecc0 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:37.365340 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-0d516957-95ed-41d9-b984-d6a7f3c9ecc0 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] device_id is not set on port 0b8ab79f-45de-4a4b-adfd-b7dbb411ed28 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:46:37.366517 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-936396b7-a679-4f05-8f3a-b1e6e1180c6a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:37.368079 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-936396b7-a679-4f05-8f3a-b1e6e1180c6a service neutron] 10.222.0.10 "GET /v2.0/subnets?id=017fde5b-ddc1-4da5-8c6b-2b98296748e5 HTTP/1.1" status: 200 len: 835 time: 0.0596521 Dec 09 21:46:37.443100 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec696f69-0e04-4dbd-82d6-22b20ab73f5d req-56c53840-0647-451c-8cbe-51cecd1f3a4a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1224244 Dec 09 21:46:37.472132 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-82c8aee6-231c-4fa0-8fb2-dbc736c8dde4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:37.473694 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-82c8aee6-231c-4fa0-8fb2-dbc736c8dde4 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=4fbe35af-30ff-45b2-b84a-21fea4abf9aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0983534 Dec 09 21:46:37.608691 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-0d516957-95ed-41d9-b984-d6a7f3c9ecc0 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Allocated IP 2001:db8::f (fb7e4c82-3ef1-4473-96be-92dff676e8f7/c2cefd92-d863-4837-a455-bfc0adf031b5/0b8ab79f-45de-4a4b-adfd-b7dbb411ed28) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:46:37.625387 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-686923bf-1458-4459-99c5-ee1b1b133698 service neutron] 10.222.0.10 "GET /v2.0/networks/4fbe35af-30ff-45b2-b84a-21fea4abf9aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1421301 Dec 09 21:46:37.850641 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e07cf06c-d3d6-4bae-b4c8-03c0d959e843 req-8e43ec06-b581-4c22-9a4b-255e643e11a6 service neutron] 10.222.0.10 "GET /v2.0/networks/4fbe35af-30ff-45b2-b84a-21fea4abf9aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2200098 Dec 09 21:46:37.895469 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d516957-95ed-41d9-b984-d6a7f3c9ecc0 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:37.989037 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d516957-95ed-41d9-b984-d6a7f3c9ecc0 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:37.998388 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:38.065393 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d516957-95ed-41d9-b984-d6a7f3c9ecc0 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network fb7e4c82-3ef1-4473-96be-92dff676e8f7 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:46:38.070898 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-0d516957-95ed-41d9-b984-d6a7f3c9ecc0 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:38.077445 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d516957-95ed-41d9-b984-d6a7f3c9ecc0 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:46:38.083151 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d516957-95ed-41d9-b984-d6a7f3c9ecc0 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:38.088654 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d516957-95ed-41d9-b984-d6a7f3c9ecc0 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:38.110311 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d516957-95ed-41d9-b984-d6a7f3c9ecc0 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Port': ['ID=0b8ab79f-45de-4a4b-adfd-b7dbb411ed28,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:38.110448 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43074) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:38.134942 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43078) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:38.150095 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0d516957-95ed-41d9-b984-d6a7f3c9ecc0 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.1901765 Dec 09 21:46:38.191614 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9c9545e3-43c2-403d-a699-e38d4f4c2a1b', 'tag': '201bc3ab-e2ab-4e46-9cc3-b13f3373442f'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:46:38.191614 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-02674a43-d7e4-422d-aa1b-62794e48d7d4" -d '{"events": [{"name": "network-changed", "server_uuid": "9c9545e3-43c2-403d-a699-e38d4f4c2a1b", "tag": "201bc3ab-e2ab-4e46-9cc3-b13f3373442f"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:46:38.265456 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec801515-120b-4ae5-bc24-cf8375d9c7ff tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:38.272143 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ec801515-120b-4ae5-bc24-cf8375d9c7ff tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D2001%3Adb8%3A%3A1 HTTP/1.1" status: 200 len: 927 time: 0.1326816 Dec 09 21:46:38.272494 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43090) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:38.307683 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:46:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-25ac74f0-0615-449c-8bb6-a51d8e5608d0 x-openstack-request-id: req-25ac74f0-0615-449c-8bb6-a51d8e5608d0 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:46:38.307978 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9c9545e3-43c2-403d-a699-e38d4f4c2a1b", "tag": "201bc3ab-e2ab-4e46-9cc3-b13f3373442f", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:46:38.308229 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-25ac74f0-0615-449c-8bb6-a51d8e5608d0 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:46:38.308697 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9c9545e3-43c2-403d-a699-e38d4f4c2a1b', 'tag': '201bc3ab-e2ab-4e46-9cc3-b13f3373442f', 'status': 'completed', 'code': 200} Dec 09 21:46:38.310101 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4396bb0-3f05-4dba-8b17-311a7f84e17a None None] Network fb7e4c82-3ef1-4473-96be-92dff676e8f7 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:46:38.359582 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 201bc3ab-e2ab-4e46-9cc3-b13f3373442f no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:46:38.388818 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df9261c9-5551-4f0c-8fa6-746188bf30a1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:38.455156 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02674a43-d7e4-422d-aa1b-62794e48d7d4 req-7a3cb906-157b-48ef-9797-7521ef16d887 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:38.457250 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-02674a43-d7e4-422d-aa1b-62794e48d7d4 req-7a3cb906-157b-48ef-9797-7521ef16d887 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 1096 time: 0.1190927 Dec 09 21:46:38.466665 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1c6e945-92ec-4c97-b17f-49655d495a7d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:38.470513 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02674a43-d7e4-422d-aa1b-62794e48d7d4 req-fc0c6289-bed5-457e-9aaf-587be97dbcac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:38.471585 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a0d74f98-b7af-4243-ab51-aa62e506654c None None] Provisioning complete for port 50c5e515-b485-4209-94f7-425cf1c94c59 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:38.472083 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-02674a43-d7e4-422d-aa1b-62794e48d7d4 req-fc0c6289-bed5-457e-9aaf-587be97dbcac service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 1096 time: 0.1369138 Dec 09 21:46:38.473335 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a0d74f98-b7af-4243-ab51-aa62e506654c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:38.489683 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1c6e945-92ec-4c97-b17f-49655d495a7d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:38.507563 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1c6e945-92ec-4c97-b17f-49655d495a7d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:38.509406 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a1c6e945-92ec-4c97-b17f-49655d495a7d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports?fixed_ips=ip_address_substr%3D2001%3Adb8%3A%3A HTTP/1.1" status: 200 len: 2388 time: 0.2357898 Dec 09 21:46:38.515643 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43098) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:38.661628 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 201bc3ab-e2ab-4e46-9cc3-b13f3373442f not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:46:38.706081 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02674a43-d7e4-422d-aa1b-62794e48d7d4 req-539db8bd-a6bf-450b-b58a-3d89ec10cf08 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:38.708763 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-02674a43-d7e4-422d-aa1b-62794e48d7d4 req-539db8bd-a6bf-450b-b58a-3d89ec10cf08 service neutron] 10.222.0.10 "GET /v2.0/networks?id=4fbe35af-30ff-45b2-b84a-21fea4abf9aa HTTP/1.1" status: 200 len: 898 time: 0.2352035 Dec 09 21:46:38.710174 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a0d74f98-b7af-4243-ab51-aa62e506654c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:38.729789 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02674a43-d7e4-422d-aa1b-62794e48d7d4 req-f58b8341-69fd-49f6-aef6-98faeab692f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:38.731341 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-02674a43-d7e4-422d-aa1b-62794e48d7d4 req-f58b8341-69fd-49f6-aef6-98faeab692f1 service neutron] 10.222.0.31 "GET /v2.0/networks?id=4fbe35af-30ff-45b2-b84a-21fea4abf9aa HTTP/1.1" status: 200 len: 898 time: 0.2458870 Dec 09 21:46:38.825372 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df9261c9-5551-4f0c-8fa6-746188bf30a1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:38.837239 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a0d74f98-b7af-4243-ab51-aa62e506654c None None] For port 50c5e515-b485-4209-94f7-425cf1c94c59, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=50c5e515-b485-4209-94f7-425cf1c94c59,segment=NetworkSegment(c2a46b48-55da-4918-a4b5-d1ee57465515),segment_id=c2a46b48-55da-4918-a4b5-d1ee57465515)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:38.841306 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df9261c9-5551-4f0c-8fa6-746188bf30a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:38.847795 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a0d74f98-b7af-4243-ab51-aa62e506654c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:38.883218 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96e691c8-c8ae-44ff-8709-5848843bc513 req-dc12a652-abf2-4328-9920-d33c973fad24 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:38.884845 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96e691c8-c8ae-44ff-8709-5848843bc513 req-dc12a652-abf2-4328-9920-d33c973fad24 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 944 time: 0.2848485 Dec 09 21:46:38.970193 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 50c5e515-b485-4209-94f7-425cf1c94c59 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:46:39.034642 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-7ebdb193-84ad-4e5e-a14b-7d8b2956853b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting port 0b8ab79f-45de-4a4b-adfd-b7dbb411ed28 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:39.035307 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7ebdb193-84ad-4e5e-a14b-7d8b2956853b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:39.094538 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0d74f98-b7af-4243-ab51-aa62e506654c None None] Pushing event updated for resources: {'Port': ['ID=50c5e515-b485-4209-94f7-425cf1c94c59,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:39.104329 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 50c5e515-b485-4209-94f7-425cf1c94c59 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:39.105036 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:39.117081 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0d74f98-b7af-4243-ab51-aa62e506654c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:39.118010 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0d74f98-b7af-4243-ab51-aa62e506654c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:39.118552 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0d74f98-b7af-4243-ab51-aa62e506654c None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:39.119071 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0d74f98-b7af-4243-ab51-aa62e506654c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:39.119617 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0d74f98-b7af-4243-ab51-aa62e506654c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:39.120538 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0d74f98-b7af-4243-ab51-aa62e506654c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:39.121064 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0d74f98-b7af-4243-ab51-aa62e506654c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:39.121811 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0d74f98-b7af-4243-ab51-aa62e506654c None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:39.122328 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0d74f98-b7af-4243-ab51-aa62e506654c None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:39.122838 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0d74f98-b7af-4243-ab51-aa62e506654c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:39.123348 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0d74f98-b7af-4243-ab51-aa62e506654c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:39.124163 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0d74f98-b7af-4243-ab51-aa62e506654c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:39.124846 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a0d74f98-b7af-4243-ab51-aa62e506654c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:46:39.155656 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96e691c8-c8ae-44ff-8709-5848843bc513 req-10a919bb-a483-4c98-b0e3-808bf81cf097 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2524455 Dec 09 21:46:39.347535 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7ebdb193-84ad-4e5e-a14b-7d8b2956853b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:39.361192 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-02674a43-d7e4-422d-aa1b-62794e48d7d4 req-5c1c52f9-9616-493e-9c9a-5683554545d7 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=201bc3ab-e2ab-4e46-9cc3-b13f3373442f HTTP/1.1" status: 200 len: 1000 time: 0.5880380 Dec 09 21:46:39.388362 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-02674a43-d7e4-422d-aa1b-62794e48d7d4 req-f33d57f3-0adb-40dc-ad5b-a2808d9dd3f5 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=201bc3ab-e2ab-4e46-9cc3-b13f3373442f HTTP/1.1" status: 200 len: 1000 time: 0.6685579 Dec 09 21:46:39.393658 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-df9261c9-5551-4f0c-8fa6-746188bf30a1 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ccbac850fd0a49a4a352239d77fef57b&name=default HTTP/1.1" status: 200 len: 3000 time: 1.2821803 Dec 09 21:46:39.402074 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-201a9d0e-dcb3-45e9-87e4-98ecea58dd62 None None] Provisioning complete for port 4d8ef747-95ff-4165-9a81-1ad5316cc44d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:39.402445 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-201a9d0e-dcb3-45e9-87e4-98ecea58dd62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:39.408346 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43120) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:39.426884 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-7ebdb193-84ad-4e5e-a14b-7d8b2956853b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Calling delete_port for 0b8ab79f-45de-4a4b-adfd-b7dbb411ed28 owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:39.488597 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-201a9d0e-dcb3-45e9-87e4-98ecea58dd62 None None] Port 4d8ef747-95ff-4165-9a81-1ad5316cc44d cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:46:39.520352 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-201a9d0e-dcb3-45e9-87e4-98ecea58dd62 None None] Provisioning complete for port 0b8ab79f-45de-4a4b-adfd-b7dbb411ed28 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:39.520352 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-201a9d0e-dcb3-45e9-87e4-98ecea58dd62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:39.616957 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-201a9d0e-dcb3-45e9-87e4-98ecea58dd62 None None] Port 0b8ab79f-45de-4a4b-adfd-b7dbb411ed28 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:46:39.697953 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df9261c9-5551-4f0c-8fa6-746188bf30a1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=20d02230-bfdf-4e4f-9f41-702904a4981b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:39.700214 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-201a9d0e-dcb3-45e9-87e4-98ecea58dd62 None None] Provisioning complete for port 50c5e515-b485-4209-94f7-425cf1c94c59 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:39.700593 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-201a9d0e-dcb3-45e9-87e4-98ecea58dd62 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:39.705908 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02674a43-d7e4-422d-aa1b-62794e48d7d4 req-def73af9-fe83-4105-84b7-4d3884f1488b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:39.708206 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-02674a43-d7e4-422d-aa1b-62794e48d7d4 req-def73af9-fe83-4105-84b7-4d3884f1488b service neutron] 10.222.0.10 "GET /v2.0/subnets?id=017fde5b-ddc1-4da5-8c6b-2b98296748e5 HTTP/1.1" status: 200 len: 835 time: 0.2381990 Dec 09 21:46:39.746838 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:39.850902 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02674a43-d7e4-422d-aa1b-62794e48d7d4 req-68fa388a-55e3-41e2-8817-eeb66756717e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:39.852685 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-02674a43-d7e4-422d-aa1b-62794e48d7d4 req-68fa388a-55e3-41e2-8817-eeb66756717e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=017fde5b-ddc1-4da5-8c6b-2b98296748e5 HTTP/1.1" status: 200 len: 835 time: 0.4674449 Dec 09 21:46:39.902373 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0ae6c4aa-d9c2-4d8d-809f-c6e835b10899 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:39.953847 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0ae6c4aa-d9c2-4d8d-809f-c6e835b10899 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:40.075572 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02674a43-d7e4-422d-aa1b-62794e48d7d4 req-219e5708-a364-436d-ad17-7358d7e9eee3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:40.077097 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-02674a43-d7e4-422d-aa1b-62794e48d7d4 req-219e5708-a364-436d-ad17-7358d7e9eee3 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=4fbe35af-30ff-45b2-b84a-21fea4abf9aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.2131112 Dec 09 21:46:40.087704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02674a43-d7e4-422d-aa1b-62794e48d7d4 req-4f5d56d7-a5db-4301-9d8a-6d3a37599186 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:40.089177 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-02674a43-d7e4-422d-aa1b-62794e48d7d4 req-4f5d56d7-a5db-4301-9d8a-6d3a37599186 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=4fbe35af-30ff-45b2-b84a-21fea4abf9aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.3702908 Dec 09 21:46:40.117848 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2c72c2e1-8c9f-42d3-8459-dac610b4a1b4 None None] Provisioning complete for port 4d8ef747-95ff-4165-9a81-1ad5316cc44d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:40.118508 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2c72c2e1-8c9f-42d3-8459-dac610b4a1b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:40.156585 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7ebdb193-84ad-4e5e-a14b-7d8b2956853b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:40.217910 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-2c72c2e1-8c9f-42d3-8459-dac610b4a1b4 None None] Port 4d8ef747-95ff-4165-9a81-1ad5316cc44d cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:46:40.220987 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 201bc3ab-e2ab-4e46-9cc3-b13f3373442f details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:46:40.229555 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ebdb193-84ad-4e5e-a14b-7d8b2956853b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Port': ['ID=0b8ab79f-45de-4a4b-adfd-b7dbb411ed28,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:40.322641 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7ebdb193-84ad-4e5e-a14b-7d8b2956853b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:40.330542 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7ebdb193-84ad-4e5e-a14b-7d8b2956853b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/ports/0b8ab79f-45de-4a4b-adfd-b7dbb411ed28 HTTP/1.1" status: 204 len: 168 time: 1.8135078 Dec 09 21:46:40.332288 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43140) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:40.388098 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0ae6c4aa-d9c2-4d8d-809f-c6e835b10899 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:40.391424 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0ae6c4aa-d9c2-4d8d-809f-c6e835b10899 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:40.395000 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0ae6c4aa-d9c2-4d8d-809f-c6e835b10899 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/20d02230-bfdf-4e4f-9f41-702904a4981b HTTP/1.1" status: 204 len: 168 time: 0.9864833 Dec 09 21:46:40.397540 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-02674a43-d7e4-422d-aa1b-62794e48d7d4 req-53517926-26aa-4984-ac09-6567fa58c437 service neutron] 10.222.0.31 "GET /v2.0/networks/4fbe35af-30ff-45b2-b84a-21fea4abf9aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3121846 Dec 09 21:46:40.400678 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-b3634fb6-c3d8-4691-b5b2-9ad2eac82ba6 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] GET failed (client error): The resource could not be found. Dec 09 21:46:40.402507 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b3634fb6-c3d8-4691-b5b2-9ad2eac82ba6 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports/0b8ab79f-45de-4a4b-adfd-b7dbb411ed28 HTTP/1.1" status: 404 len: 333 time: 0.0655487 Dec 09 21:46:40.410099 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43144) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:40.426446 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ae6c4aa-d9c2-4d8d-809f-c6e835b10899 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=20d02230-bfdf-4e4f-9f41-702904a4981b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:40.473776 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-478dfd98-c3a5-4721-8254-3a28877a3bfd None None] Could not find standard attr ID for object 0b8ab79f-45de-4a4b-adfd-b7dbb411ed28. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:46:40.539088 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=201bc3ab-e2ab-4e46-9cc3-b13f3373442f,segment=NetworkSegment(2316fee1-a288-4d09-bf17-e0a19e0adf8d),segment_id=2316fee1-a288-4d09-bf17-e0a19e0adf8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:40.554758 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '201bc3ab-e2ab-4e46-9cc3-b13f3373442f', 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa', 'port_id': '201bc3ab-e2ab-4e46-9cc3-b13f3373442f', 'mac_address': 'fa:16:3e:96:e3:30', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 140, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '017fde5b-ddc1-4da5-8c6b-2b98296748e5', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:46:40.606242 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3552682-ddbf-4748-98e1-74e93524be7b req-2c14abb8-bfad-4437-8bc4-76b872a418be tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:40.622601 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:40.624529 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c3552682-ddbf-4748-98e1-74e93524be7b req-2c14abb8-bfad-4437-8bc4-76b872a418be tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 944 time: 0.2783213 Dec 09 21:46:40.657850 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-02674a43-d7e4-422d-aa1b-62794e48d7d4 req-12a6401d-7453-4084-8582-6e4f7c60bcaf service neutron] 10.222.0.10 "GET /v2.0/networks/4fbe35af-30ff-45b2-b84a-21fea4abf9aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5601845 Dec 09 21:46:40.668482 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 201bc3ab-e2ab-4e46-9cc3-b13f3373442f {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:46:40.698094 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=201bc3ab-e2ab-4e46-9cc3-b13f3373442f,segment=NetworkSegment(2316fee1-a288-4d09-bf17-e0a19e0adf8d),segment_id=2316fee1-a288-4d09-bf17-e0a19e0adf8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:40.710487 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:40.787941 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c3552682-ddbf-4748-98e1-74e93524be7b req-edc9954e-c24e-4e9e-ba96-2fe6cee5b1e6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1623383 Dec 09 21:46:40.842418 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-c2a076ed-d29d-4d86-a89f-ccccf988eec1 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting port 4d8ef747-95ff-4165-9a81-1ad5316cc44d {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:40.842418 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c2a076ed-d29d-4d86-a89f-ccccf988eec1 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:40.850658 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-02674a43-d7e4-422d-aa1b-62794e48d7d4 req-0246acac-54ce-4e8e-b111-53939bb2ac6c service neutron] 10.222.0.31 "GET /v2.0/networks/4fbe35af-30ff-45b2-b84a-21fea4abf9aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4391901 Dec 09 21:46:40.888143 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 50c5e515-b485-4209-94f7-425cf1c94c59 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:46:40.936724 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-02674a43-d7e4-422d-aa1b-62794e48d7d4 req-d0711566-8c66-42e5-90f0-f57e5b71c4de service neutron] 10.222.0.10 "GET /v2.0/networks/4fbe35af-30ff-45b2-b84a-21fea4abf9aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2650270 Dec 09 21:46:41.076091 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c2a076ed-d29d-4d86-a89f-ccccf988eec1 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:41.102266 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-c2a076ed-d29d-4d86-a89f-ccccf988eec1 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Calling delete_port for 4d8ef747-95ff-4165-9a81-1ad5316cc44d owned by {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:41.112894 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['201bc3ab-e2ab-4e46-9cc3-b13f3373442f'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:46:41.249615 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64d74001-90ce-4bc7-b9af-20ae0ecfaa27 req-3cd0f270-6481-48ee-ab1c-1b41b8f62969 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:41.251944 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-64d74001-90ce-4bc7-b9af-20ae0ecfaa27 req-3cd0f270-6481-48ee-ab1c-1b41b8f62969 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 945 time: 0.0760803 Dec 09 21:46:41.290076 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=201bc3ab-e2ab-4e46-9cc3-b13f3373442f,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:41.317774 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70b087a7-9364-4801-a489-13d7b3f5ef29 req-30b56bf9-b0c9-4039-8a61-61dca0ae0f19 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:41.319575 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70b087a7-9364-4801-a489-13d7b3f5ef29 req-30b56bf9-b0c9-4039-8a61-61dca0ae0f19 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.31 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b&tenant_id=dce7594ac2a74901912a2f19de04bf79&binding%3Ahost_id=n-h2-713301-27 HTTP/1.1" status: 200 len: 945 time: 0.1944163 Dec 09 21:46:41.321661 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 50c5e515-b485-4209-94f7-425cf1c94c59 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:41.325112 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:41.393228 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43164) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:41.411676 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3619bb74-81c5-4196-9481-2f9e66111f7c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:41.459960 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [req-70b087a7-9364-4801-a489-13d7b3f5ef29 req-1711f2af-f4a9-4a44-8b24-f55e99080884 service neutron] delete failed (client error): The resource could not be found. Dec 09 21:46:41.461475 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70b087a7-9364-4801-a489-13d7b3f5ef29 req-1711f2af-f4a9-4a44-8b24-f55e99080884 service neutron] 10.222.0.31 "DELETE /v2.0/ports/201bc3ab-e2ab-4e46-9cc3-b13f3373442f/bindings/n-h1-713301-27 HTTP/1.1" status: 404 len: 381 time: 0.1158526 Dec 09 21:46:41.472108 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-64d74001-90ce-4bc7-b9af-20ae0ecfaa27 req-457d8573-b043-42c6-b1b2-3043375e2fc6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2116158 Dec 09 21:46:41.535543 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c2a076ed-d29d-4d86-a89f-ccccf988eec1 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:41.646482 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c2a076ed-d29d-4d86-a89f-ccccf988eec1 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:41.654741 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c2a076ed-d29d-4d86-a89f-ccccf988eec1 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/ports/4d8ef747-95ff-4165-9a81-1ad5316cc44d HTTP/1.1" status: 204 len: 168 time: 1.2300069 Dec 09 21:46:41.656275 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2a076ed-d29d-4d86-a89f-ccccf988eec1 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Port': ['ID=4d8ef747-95ff-4165-9a81-1ad5316cc44d,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:41.660331 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43166) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:41.673978 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3619bb74-81c5-4196-9481-2f9e66111f7c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:41.705533 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3619bb74-81c5-4196-9481-2f9e66111f7c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:41.718751 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-4aa4b240-b40c-459e-a23b-bae710657edb tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] GET failed (client error): The resource could not be found. Dec 09 21:46:41.725491 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4aa4b240-b40c-459e-a23b-bae710657edb tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports/4d8ef747-95ff-4165-9a81-1ad5316cc44d HTTP/1.1" status: 404 len: 333 time: 0.0617146 Dec 09 21:46:41.726140 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43168) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:41.808377 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3619bb74-81c5-4196-9481-2f9e66111f7c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=fcc1a64cd6284684b034232cee5dd19b&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4122355 Dec 09 21:46:41.810892 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43174) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:41.820742 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3619bb74-81c5-4196-9481-2f9e66111f7c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7b85dea5-42b8-474b-9bd7-43ee36e27de5,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:41.848328 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70b087a7-9364-4801-a489-13d7b3f5ef29 req-649140d6-0854-4242-bbd6-839a9f85b9bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:41.850652 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70b087a7-9364-4801-a489-13d7b3f5ef29 req-649140d6-0854-4242-bbd6-839a9f85b9bf service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 1097 time: 0.1698904 Dec 09 21:46:41.865702 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-0e7c7028-7060-4357-b88a-471347f5654d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting subnet c2cefd92-d863-4837-a455-bfc0adf031b5 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:46:41.874672 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e7c7028-7060-4357-b88a-471347f5654d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:41.931569 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-482c1075-0e11-4dc8-a887-0925a1c3318c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:41.940605 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e7c7028-7060-4357-b88a-471347f5654d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:41.977876 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70b087a7-9364-4801-a489-13d7b3f5ef29 req-c4b5dbc2-4cda-41ca-8816-4abd7fd6e760 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:41.979528 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70b087a7-9364-4801-a489-13d7b3f5ef29 req-c4b5dbc2-4cda-41ca-8816-4abd7fd6e760 service neutron] 10.222.0.31 "GET /v2.0/networks?id=4fbe35af-30ff-45b2-b84a-21fea4abf9aa HTTP/1.1" status: 200 len: 898 time: 0.1213307 Dec 09 21:46:41.993330 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-482c1075-0e11-4dc8-a887-0925a1c3318c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:42.061264 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70b087a7-9364-4801-a489-13d7b3f5ef29 req-e8eb685b-befc-44cd-9a5a-77d5994f6ef9 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=201bc3ab-e2ab-4e46-9cc3-b13f3373442f HTTP/1.1" status: 200 len: 1001 time: 0.0740106 Dec 09 21:46:42.081537 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e7c7028-7060-4357-b88a-471347f5654d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:42.087485 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-482c1075-0e11-4dc8-a887-0925a1c3318c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:42.090422 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-482c1075-0e11-4dc8-a887-0925a1c3318c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:42.091676 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-482c1075-0e11-4dc8-a887-0925a1c3318c admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/7b85dea5-42b8-474b-9bd7-43ee36e27de5 HTTP/1.1" status: 204 len: 168 time: 0.2793622 Dec 09 21:46:42.127136 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-482c1075-0e11-4dc8-a887-0925a1c3318c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7b85dea5-42b8-474b-9bd7-43ee36e27de5,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:42.157150 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70b087a7-9364-4801-a489-13d7b3f5ef29 req-9fd30b33-2275-4aec-8da5-cf3d9f010139 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:42.158980 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70b087a7-9364-4801-a489-13d7b3f5ef29 req-9fd30b33-2275-4aec-8da5-cf3d9f010139 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=017fde5b-ddc1-4da5-8c6b-2b98296748e5 HTTP/1.1" status: 200 len: 835 time: 0.0908782 Dec 09 21:46:42.181230 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e7c7028-7060-4357-b88a-471347f5654d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:42.208052 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e7c7028-7060-4357-b88a-471347f5654d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:42.211518 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0e7c7028-7060-4357-b88a-471347f5654d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/subnets/c2cefd92-d863-4837-a455-bfc0adf031b5 HTTP/1.1" status: 204 len: 168 time: 0.4842148 Dec 09 21:46:42.215881 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43188) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:42.221371 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0370c42c-074b-4d38-89b6-aee7b35876a6 None None] Network fb7e4c82-3ef1-4473-96be-92dff676e8f7 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:46:42.224566 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 201bc3ab-e2ab-4e46-9cc3-b13f3373442f up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:46:42.235771 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e7c7028-7060-4357-b88a-471347f5654d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Subnet': ['ID=c2cefd92-d863-4837-a455-bfc0adf031b5,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:42.305025 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70b087a7-9364-4801-a489-13d7b3f5ef29 req-acc8e23c-15f4-4e32-a9df-89934a5013ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:42.306493 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70b087a7-9364-4801-a489-13d7b3f5ef29 req-acc8e23c-15f4-4e32-a9df-89934a5013ab service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=4fbe35af-30ff-45b2-b84a-21fea4abf9aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1406052 Dec 09 21:46:42.311097 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d147c8aa-8cac-49b0-8d5d-065ea0783c92 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:42.429470 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70b087a7-9364-4801-a489-13d7b3f5ef29 req-8d771b3e-0ff1-4c9d-bcdd-94c12905a0df service neutron] 10.222.0.31 "GET /v2.0/networks/4fbe35af-30ff-45b2-b84a-21fea4abf9aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1143577 Dec 09 21:46:42.517847 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:46:42.525992 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:42.527975 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:42.612383 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-930e9681-a7b1-4f83-9488-72753b342d0f None None] DHCP port deletion for fb7e4c82-3ef1-4473-96be-92dff676e8f7 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:46:42.694808 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-d147c8aa-8cac-49b0-8d5d-065ea0783c92 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting port 50c5e515-b485-4209-94f7-425cf1c94c59 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:42.695542 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d147c8aa-8cac-49b0-8d5d-065ea0783c92 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:42.700456 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70b087a7-9364-4801-a489-13d7b3f5ef29 req-4215fc06-3f9c-4df3-ac85-6bbf98a7144b service neutron] 10.222.0.31 "GET /v2.0/networks/4fbe35af-30ff-45b2-b84a-21fea4abf9aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2534881 Dec 09 21:46:42.763840 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e7741ad-0412-4785-8d66-2b802024e5a6 req-14f09132-16f5-4b0e-bee0-b82bcdd5edd1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:42.766149 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e7741ad-0412-4785-8d66-2b802024e5a6 req-14f09132-16f5-4b0e-bee0-b82bcdd5edd1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 945 time: 0.1173773 Dec 09 21:46:42.825157 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:42.885824 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-d147c8aa-8cac-49b0-8d5d-065ea0783c92 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] For port 50c5e515-b485-4209-94f7-425cf1c94c59, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=50c5e515-b485-4209-94f7-425cf1c94c59,segment=NetworkSegment(c2a46b48-55da-4918-a4b5-d1ee57465515),segment_id=c2a46b48-55da-4918-a4b5-d1ee57465515)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:42.886269 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d147c8aa-8cac-49b0-8d5d-065ea0783c92 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:42.903073 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-d147c8aa-8cac-49b0-8d5d-065ea0783c92 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Calling delete_port for 50c5e515-b485-4209-94f7-425cf1c94c59 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:42.956819 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e7741ad-0412-4785-8d66-2b802024e5a6 req-625154e5-95ed-462a-a41b-cf84a2e4a217 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1756711 Dec 09 21:46:43.049923 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d147c8aa-8cac-49b0-8d5d-065ea0783c92 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:43.079388 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d147c8aa-8cac-49b0-8d5d-065ea0783c92 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Port': ['ID=50c5e515-b485-4209-94f7-425cf1c94c59,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:43.100807 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d147c8aa-8cac-49b0-8d5d-065ea0783c92 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] No DVR routers for this DVR port 50c5e515-b485-4209-94f7-425cf1c94c59 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:46:43.108632 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 50c5e515-b485-4209-94f7-425cf1c94c59 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:46:43.153440 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 50c5e515-b485-4209-94f7-425cf1c94c59 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:46:43.153658 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 50c5e515-b485-4209-94f7-425cf1c94c59 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:46:43.194250 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-930e9681-a7b1-4f83-9488-72753b342d0f None None] Deleting port 50c5e515-b485-4209-94f7-425cf1c94c59 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:43.194250 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-930e9681-a7b1-4f83-9488-72753b342d0f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:43.222783 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9c9545e3-43c2-403d-a699-e38d4f4c2a1b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '201bc3ab-e2ab-4e46-9cc3-b13f3373442f'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:46:43.225090 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-87785b61-603a-4927-889b-afb3a1edc2dc" -d '{"events": [{"server_uuid": "9c9545e3-43c2-403d-a699-e38d4f4c2a1b", "name": "network-vif-plugged", "status": "completed", "tag": "201bc3ab-e2ab-4e46-9cc3-b13f3373442f"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:46:43.293534 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=201bc3ab-e2ab-4e46-9cc3-b13f3373442f,segment=NetworkSegment(2316fee1-a288-4d09-bf17-e0a19e0adf8d),segment_id=2316fee1-a288-4d09-bf17-e0a19e0adf8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:43.352479 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d147c8aa-8cac-49b0-8d5d-065ea0783c92 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:43.376075 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-d147c8aa-8cac-49b0-8d5d-065ea0783c92 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fb7e4c82-3ef1-4473-96be-92dff676e8f7']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:43.382152 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-930e9681-a7b1-4f83-9488-72753b342d0f None None] For port 50c5e515-b485-4209-94f7-425cf1c94c59, host n-d-713301-27, got binding levels [] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:43.382563 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-930e9681-a7b1-4f83-9488-72753b342d0f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:43.387192 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-d147c8aa-8cac-49b0-8d5d-065ea0783c92 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c2a46b48-55da-4918-a4b5-d1ee57465515') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:43.387912 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-d147c8aa-8cac-49b0-8d5d-065ea0783c92 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c2a46b48-55da-4918-a4b5-d1ee57465515') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:43.399912 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d147c8aa-8cac-49b0-8d5d-065ea0783c92 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:43.401364 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-930e9681-a7b1-4f83-9488-72753b342d0f None None] Calling delete_port for 50c5e515-b485-4209-94f7-425cf1c94c59 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:43.404226 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.ipam_backend_mixin [None req-930e9681-a7b1-4f83-9488-72753b342d0f None None] Port 50c5e515-b485-4209-94f7-425cf1c94c59 was not found and therefore no delete operation was performed {{(pid=103439) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 09 21:46:43.406218 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-930e9681-a7b1-4f83-9488-72753b342d0f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:43.415768 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:46:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-323e4dcc-6ce2-407a-b737-cb9cdc87669f x-openstack-request-id: req-323e4dcc-6ce2-407a-b737-cb9cdc87669f {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:46:43.416069 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9c9545e3-43c2-403d-a699-e38d4f4c2a1b", "name": "network-vif-plugged", "status": "completed", "tag": "201bc3ab-e2ab-4e46-9cc3-b13f3373442f", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:46:43.416331 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-323e4dcc-6ce2-407a-b737-cb9cdc87669f {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:46:43.416731 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9c9545e3-43c2-403d-a699-e38d4f4c2a1b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '201bc3ab-e2ab-4e46-9cc3-b13f3373442f', 'code': 200} Dec 09 21:46:43.417488 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d147c8aa-8cac-49b0-8d5d-065ea0783c92 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:43.421276 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:43.423365 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-930e9681-a7b1-4f83-9488-72753b342d0f None None] No DVR routers for this DVR port 50c5e515-b485-4209-94f7-425cf1c94c59 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:46:43.436491 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d147c8aa-8cac-49b0-8d5d-065ea0783c92 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Releasing vlan 135 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:46:43.437134 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d147c8aa-8cac-49b0-8d5d-065ea0783c92 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:46:43.442129 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:46:43.445227 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-930e9681-a7b1-4f83-9488-72753b342d0f None None] Pushing event deleted for resources: {'Port': ['ID=50c5e515-b485-4209-94f7-425cf1c94c59,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:43.548327 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=201bc3ab-e2ab-4e46-9cc3-b13f3373442f,revision_number=9']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:43.561261 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d147c8aa-8cac-49b0-8d5d-065ea0783c92 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:43.587872 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d147c8aa-8cac-49b0-8d5d-065ea0783c92 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:43.615142 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43232) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:43.621831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-609dbdf0-df93-4298-9b33-c3f436dfd320 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'network': {'name': 'tempest-PortsIpV6TestJSON-251893216'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:43.624335 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d147c8aa-8cac-49b0-8d5d-065ea0783c92 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/networks/fb7e4c82-3ef1-4473-96be-92dff676e8f7 HTTP/1.1" status: 204 len: 168 time: 1.4070189 Dec 09 21:46:43.625713 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d147c8aa-8cac-49b0-8d5d-065ea0783c92 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Network': ['ID=fb7e4c82-3ef1-4473-96be-92dff676e8f7,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:43.662402 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-609dbdf0-df93-4298-9b33-c3f436dfd320 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:43.666538 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-609dbdf0-df93-4298-9b33-c3f436dfd320 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:43.697562 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-609dbdf0-df93-4298-9b33-c3f436dfd320 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] vlan segment allocate from pool success with {'vlan_id': 138, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:46:43.710706 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-609dbdf0-df93-4298-9b33-c3f436dfd320 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:43.711088 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-609dbdf0-df93-4298-9b33-c3f436dfd320 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Added segment 52148f89-913e-446f-a694-5ac253ddea58 of type vlan for network fc0a6178-5e0f-41ad-a9da-95a5698bebc1 Dec 09 21:46:43.756153 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-609dbdf0-df93-4298-9b33-c3f436dfd320 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:43.788435 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-609dbdf0-df93-4298-9b33-c3f436dfd320 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:43.803328 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-609dbdf0-df93-4298-9b33-c3f436dfd320 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:43.804053 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-609dbdf0-df93-4298-9b33-c3f436dfd320 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:43.835224 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-609dbdf0-df93-4298-9b33-c3f436dfd320 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 771 time: 0.2188206 Dec 09 21:46:43.838391 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43242) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:43.843933 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-44cfed3e-daa6-4430-8b75-2885f4c0519d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'subnet': {'network_id': 'fc0a6178-5e0f-41ad-a9da-95a5698bebc1', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:43.908266 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-609dbdf0-df93-4298-9b33-c3f436dfd320 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Network': ['ID=fc0a6178-5e0f-41ad-a9da-95a5698bebc1,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:43.926221 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network fc0a6178-5e0f-41ad-a9da-95a5698bebc1 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:46:44.004805 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-44cfed3e-daa6-4430-8b75-2885f4c0519d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:44.009681 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-44cfed3e-daa6-4430-8b75-2885f4c0519d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:44.139801 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44c48f07-e2b8-47ef-923f-a11f7e47b8d1 req-fae78d90-547f-4709-a508-5522f7afddb8 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:44.143032 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44c48f07-e2b8-47ef-923f-a11f7e47b8d1 req-fae78d90-547f-4709-a508-5522f7afddb8 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.0737150 Dec 09 21:46:44.235260 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44c48f07-e2b8-47ef-923f-a11f7e47b8d1 req-a320d97d-3630-4d9c-a004-69c1c8be882d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0840664 Dec 09 21:46:44.253234 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43260) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:44.256853 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-44cfed3e-daa6-4430-8b75-2885f4c0519d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:44.356065 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44cfed3e-daa6-4430-8b75-2885f4c0519d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Subnet': ['ID=87930927-d6e3-4d98-8aa9-af986c45aa6e,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:44.367489 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cfc7b65f-476e-48a6-8d24-608ada070b3b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/floatingips/8586a0ac-8d71-46f3-ae0a-75565c281860 HTTP/1.1" status: 200 len: 994 time: 0.1108887 Dec 09 21:46:44.390127 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44cfed3e-daa6-4430-8b75-2885f4c0519d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Checking segment: {'id': '52148f89-913e-446f-a694-5ac253ddea58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'fc0a6178-5e0f-41ad-a9da-95a5698bebc1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:46:44.390539 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44cfed3e-daa6-4430-8b75-2885f4c0519d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network hostable DHCP agents. Network: fc0a6178-5e0f-41ad-a9da-95a5698bebc1, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:46:44.409822 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44cfed3e-daa6-4430-8b75-2885f4c0519d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network fc0a6178-5e0f-41ad-a9da-95a5698bebc1 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:46:44.432923 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-44cfed3e-daa6-4430-8b75-2885f4c0519d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, fc0a6178-5e0f-41ad-a9da-95a5698bebc1) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:44.441692 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-76378f7f-6bbc-4a84-a83a-de955ef3f077 None None] Network fc0a6178-5e0f-41ad-a9da-95a5698bebc1 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:46:44.450623 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44cfed3e-daa6-4430-8b75-2885f4c0519d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:44.451547 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-44cfed3e-daa6-4430-8b75-2885f4c0519d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:44.477105 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-44cfed3e-daa6-4430-8b75-2885f4c0519d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.6373558 Dec 09 21:46:44.480429 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43266) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:44.486116 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-2476e67e-e483-4f3b-bb8c-181d23809588 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'router': {'name': 'tempest-PortsIpV6TestJSON-router-553694791', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:44.521773 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2476e67e-e483-4f3b-bb8c-181d23809588 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:44.523240 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2476e67e-e483-4f3b-bb8c-181d23809588 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:44.569459 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0e28d539-4dff-485a-9256-c925fc7e4cbe None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-fc0a6178-5e0f-41ad-a9da-95a5698bebc1', 'network_id': 'fc0a6178-5e0f-41ad-a9da-95a5698bebc1', 'project_id': '9560c66e717c47918bfe698e159759c5', 'fixed_ips': [{'subnet_id': '87930927-d6e3-4d98-8aa9-af986c45aa6e'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:46:44.570870 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0e28d539-4dff-485a-9256-c925fc7e4cbe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:44.605415 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2476e67e-e483-4f3b-bb8c-181d23809588 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:44.612704 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2476e67e-e483-4f3b-bb8c-181d23809588 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:44.688761 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2476e67e-e483-4f3b-bb8c-181d23809588 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:44.690952 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2476e67e-e483-4f3b-bb8c-181d23809588 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 705 time: 0.2093980 Dec 09 21:46:44.693801 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43280) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:44.699091 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-b7699cd0-cb6a-430d-a2e0-48815bb925af tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'port': {'network_id': 'fc0a6178-5e0f-41ad-a9da-95a5698bebc1', 'name': 'tempest-PortsIpV6TestJSON-2081506030'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:44.848455 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-0e28d539-4dff-485a-9256-c925fc7e4cbe None None] Allocated IP 2001:db8::2 (fc0a6178-5e0f-41ad-a9da-95a5698bebc1/87930927-d6e3-4d98-8aa9-af986c45aa6e/9f56b7f5-aba7-4fd2-9c84-4375772769bc) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:46:44.897965 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b7699cd0-cb6a-430d-a2e0-48815bb925af tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:44.904467 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7699cd0-cb6a-430d-a2e0-48815bb925af tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:44.939191 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-b7699cd0-cb6a-430d-a2e0-48815bb925af tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] device_id is not set on port d9ed8cc3-7615-40f2-8af6-c149b31e9e42 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:46:45.099390 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0e28d539-4dff-485a-9256-c925fc7e4cbe None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:45.111676 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0e28d539-4dff-485a-9256-c925fc7e4cbe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:45.159420 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e28d539-4dff-485a-9256-c925fc7e4cbe None None] Network fc0a6178-5e0f-41ad-a9da-95a5698bebc1 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:46:45.162762 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-0e28d539-4dff-485a-9256-c925fc7e4cbe None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:45.165457 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e28d539-4dff-485a-9256-c925fc7e4cbe None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:46:45.191890 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e28d539-4dff-485a-9256-c925fc7e4cbe None None] Pushing event updated for resources: {'Port': ['ID=9f56b7f5-aba7-4fd2-9c84-4375772769bc,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:45.228398 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-b7699cd0-cb6a-430d-a2e0-48815bb925af tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Allocated IP 2001:db8::2a8 (fc0a6178-5e0f-41ad-a9da-95a5698bebc1/87930927-d6e3-4d98-8aa9-af986c45aa6e/d9ed8cc3-7615-40f2-8af6-c149b31e9e42) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:46:45.283617 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0e28d539-4dff-485a-9256-c925fc7e4cbe None None] Attempting to bind port 9f56b7f5-aba7-4fd2-9c84-4375772769bc on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:46:45.283989 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0e28d539-4dff-485a-9256-c925fc7e4cbe None None] Attempting to bind port 9f56b7f5-aba7-4fd2-9c84-4375772769bc by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '52148f89-913e-446f-a694-5ac253ddea58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'fc0a6178-5e0f-41ad-a9da-95a5698bebc1'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:46:45.284520 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e28d539-4dff-485a-9256-c925fc7e4cbe None None] Attempting to bind port 9f56b7f5-aba7-4fd2-9c84-4375772769bc on network fc0a6178-5e0f-41ad-a9da-95a5698bebc1 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:46:45.292635 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e28d539-4dff-485a-9256-c925fc7e4cbe None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 46, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:46:45.293013 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e28d539-4dff-485a-9256-c925fc7e4cbe None None] Checking segment: {'id': '52148f89-913e-446f-a694-5ac253ddea58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'fc0a6178-5e0f-41ad-a9da-95a5698bebc1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:46:45.293492 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0e28d539-4dff-485a-9256-c925fc7e4cbe None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:45.294034 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0e28d539-4dff-485a-9256-c925fc7e4cbe None None] Bound using segment: {'id': '52148f89-913e-446f-a694-5ac253ddea58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'fc0a6178-5e0f-41ad-a9da-95a5698bebc1'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:46:45.294583 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0e28d539-4dff-485a-9256-c925fc7e4cbe None None] Bound port: 9f56b7f5-aba7-4fd2-9c84-4375772769bc, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '52148f89-913e-446f-a694-5ac253ddea58', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'fc0a6178-5e0f-41ad-a9da-95a5698bebc1'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:46:45.295019 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0e28d539-4dff-485a-9256-c925fc7e4cbe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:45.431637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0e28d539-4dff-485a-9256-c925fc7e4cbe None None] For port 9f56b7f5-aba7-4fd2-9c84-4375772769bc, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:46:45.440121 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0e28d539-4dff-485a-9256-c925fc7e4cbe None None] For port 9f56b7f5-aba7-4fd2-9c84-4375772769bc, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9f56b7f5-aba7-4fd2-9c84-4375772769bc,segment=NetworkSegment(52148f89-913e-446f-a694-5ac253ddea58),segment_id=52148f89-913e-446f-a694-5ac253ddea58)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:46:45.453040 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0e28d539-4dff-485a-9256-c925fc7e4cbe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:45.499900 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7699cd0-cb6a-430d-a2e0-48815bb925af tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:45.556236 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7699cd0-cb6a-430d-a2e0-48815bb925af tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:45.609172 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7699cd0-cb6a-430d-a2e0-48815bb925af tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network fc0a6178-5e0f-41ad-a9da-95a5698bebc1 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:46:45.614273 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-b7699cd0-cb6a-430d-a2e0-48815bb925af tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:45.618780 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7699cd0-cb6a-430d-a2e0-48815bb925af tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:46:45.625608 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b7699cd0-cb6a-430d-a2e0-48815bb925af tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:45.626541 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7699cd0-cb6a-430d-a2e0-48815bb925af tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:45.647223 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7699cd0-cb6a-430d-a2e0-48815bb925af tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Port': ['ID=d9ed8cc3-7615-40f2-8af6-c149b31e9e42,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:45.659696 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e28d539-4dff-485a-9256-c925fc7e4cbe None None] Pushing event updated for resources: {'Port': ['ID=9f56b7f5-aba7-4fd2-9c84-4375772769bc,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:45.665072 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b7699cd0-cb6a-430d-a2e0-48815bb925af tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 0.9698956 Dec 09 21:46:45.668012 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43326) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:46.306928 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-07f77619-44cb-4d69-ae34-0d0298c45146 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:46.474188 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43350) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:46.659509 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-07f77619-44cb-4d69-ae34-0d0298c45146 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:46.679802 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-07f77619-44cb-4d69-ae34-0d0298c45146 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:46.708566 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-84611e45-ba0e-4547-8fa7-08358dd09bed admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:46.797259 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07f77619-44cb-4d69-ae34-0d0298c45146 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Port': ['ID=d9ed8cc3-7615-40f2-8af6-c149b31e9e42,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:46.804457 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9f56b7f5-aba7-4fd2-9c84-4375772769bc up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:46:46.916396 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 9f56b7f5-aba7-4fd2-9c84-4375772769bc triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:46.916707 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:46.921596 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-84611e45-ba0e-4547-8fa7-08358dd09bed admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:46.928062 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-84611e45-ba0e-4547-8fa7-08358dd09bed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:46.978451 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-07f77619-44cb-4d69-ae34-0d0298c45146 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:46.984301 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-84611e45-ba0e-4547-8fa7-08358dd09bed admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=0f01620edb234ea5991c43736ee65089&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5089560 Dec 09 21:46:46.985977 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43354) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:47.032069 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84611e45-ba0e-4547-8fa7-08358dd09bed admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0cb540f1-a617-4cbd-ae10-dd7fbdb09bbf,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:47.089151 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:47.168932 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 9f56b7f5-aba7-4fd2-9c84-4375772769bc, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9f56b7f5-aba7-4fd2-9c84-4375772769bc,segment=NetworkSegment(52148f89-913e-446f-a694-5ac253ddea58),segment_id=52148f89-913e-446f-a694-5ac253ddea58)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:47.177769 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-07f77619-44cb-4d69-ae34-0d0298c45146 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:47.180772 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb00eeb6-c312-456b-bdf5-db535f654c64 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:47.188648 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:47.236692 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb00eeb6-c312-456b-bdf5-db535f654c64 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:47.259136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=9f56b7f5-aba7-4fd2-9c84-4375772769bc,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:47.261895 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d37750b-23cd-4080-9965-4f4cd0753ebe None None] Network fc0a6178-5e0f-41ad-a9da-95a5698bebc1 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:46:47.376210 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb00eeb6-c312-456b-bdf5-db535f654c64 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:47.379109 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb00eeb6-c312-456b-bdf5-db535f654c64 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:47.380476 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-eb00eeb6-c312-456b-bdf5-db535f654c64 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/0cb540f1-a617-4cbd-ae10-dd7fbdb09bbf HTTP/1.1" status: 204 len: 168 time: 0.3506315 Dec 09 21:46:47.400306 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb00eeb6-c312-456b-bdf5-db535f654c64 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0cb540f1-a617-4cbd-ae10-dd7fbdb09bbf,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:47.463697 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5299e828-4d55-465d-b999-61d6b1c53adc None None] Provisioning complete for port 9f56b7f5-aba7-4fd2-9c84-4375772769bc triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:47.465768 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5299e828-4d55-465d-b999-61d6b1c53adc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:47.778796 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-07f77619-44cb-4d69-ae34-0d0298c45146 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:47.786951 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-07f77619-44cb-4d69-ae34-0d0298c45146 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:47.789348 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-07f77619-44cb-4d69-ae34-0d0298c45146 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:47.867942 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43364) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:47.886810 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07f77619-44cb-4d69-ae34-0d0298c45146 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Port': ['ID=d9ed8cc3-7615-40f2-8af6-c149b31e9e42,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:47.896931 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58d64a8e-ff83-4579-8396-91caf88055f7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:47.985580 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07f77619-44cb-4d69-ae34-0d0298c45146 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network fc0a6178-5e0f-41ad-a9da-95a5698bebc1 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:46:48.000634 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-07f77619-44cb-4d69-ae34-0d0298c45146 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:48.032607 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58d64a8e-ff83-4579-8396-91caf88055f7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:48.040209 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58d64a8e-ff83-4579-8396-91caf88055f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:48.087407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ce9e26f5-b587-4372-ad82-ddafd99f9740 None None] Provisioning complete for port 9f56b7f5-aba7-4fd2-9c84-4375772769bc triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:48.089838 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ce9e26f5-b587-4372-ad82-ddafd99f9740 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:48.101760 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-58d64a8e-ff83-4579-8396-91caf88055f7 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=5723f50fea324a5e91cb6bf2beb5e3c0&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2326427 Dec 09 21:46:48.104341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43366) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:48.112815 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58d64a8e-ff83-4579-8396-91caf88055f7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f4339dd6-0c66-45d6-89dd-b9491fe0954a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:48.190797 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-07f77619-44cb-4d69-ae34-0d0298c45146 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Router 9ef1a7ca-960f-4dd6-97ec-471295ef47a4 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:46:48.225870 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8bc256c1-e305-4879-a6b6-d6d25c340c90 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:48.259022 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8bc256c1-e305-4879-a6b6-d6d25c340c90 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:48.294864 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ce9e26f5-b587-4372-ad82-ddafd99f9740 None None] Provisioning complete for port d9ed8cc3-7615-40f2-8af6-c149b31e9e42 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:48.295820 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ce9e26f5-b587-4372-ad82-ddafd99f9740 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:48.326369 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-07f77619-44cb-4d69-ae34-0d0298c45146 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:46:48.332254 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8bc256c1-e305-4879-a6b6-d6d25c340c90 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:48.338320 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8bc256c1-e305-4879-a6b6-d6d25c340c90 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:48.343235 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8bc256c1-e305-4879-a6b6-d6d25c340c90 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/f4339dd6-0c66-45d6-89dd-b9491fe0954a HTTP/1.1" status: 204 len: 168 time: 0.2375855 Dec 09 21:46:48.345681 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ce9e26f5-b587-4372-ad82-ddafd99f9740 None None] Port d9ed8cc3-7615-40f2-8af6-c149b31e9e42 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:46:48.350587 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-807a29dc-59c3-4201-82ae-941e802a845c None None] Sync routers for ids ['9ef1a7ca-960f-4dd6-97ec-471295ef47a4'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:46:48.354156 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-07f77619-44cb-4d69-ae34-0d0298c45146 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "PUT /v2.0/routers/9ef1a7ca-960f-4dd6-97ec-471295ef47a4/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6827104 Dec 09 21:46:48.355223 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43372) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:48.355965 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bc256c1-e305-4879-a6b6-d6d25c340c90 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f4339dd6-0c66-45d6-89dd-b9491fe0954a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:48.378472 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-807a29dc-59c3-4201-82ae-941e802a845c None None] Routers {'9ef1a7ca-960f-4dd6-97ec-471295ef47a4'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:46:48.380584 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-807a29dc-59c3-4201-82ae-941e802a845c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:46:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9ef1a7ca-960f-4dd6-97ec-471295ef47a4'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:48.427080 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab8c17cc-ec53-4dcb-9d7f-879ce691eacb tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:48.429398 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ab8c17cc-ec53-4dcb-9d7f-879ce691eacb tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports?device_id=9ef1a7ca-960f-4dd6-97ec-471295ef47a4 HTTP/1.1" status: 200 len: 989 time: 0.0702515 Dec 09 21:46:48.432549 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43376) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:48.456990 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-807a29dc-59c3-4201-82ae-941e802a845c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:48.466171 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-807a29dc-59c3-4201-82ae-941e802a845c None None] Routers {'9ef1a7ca-960f-4dd6-97ec-471295ef47a4'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:46:48.466785 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-807a29dc-59c3-4201-82ae-941e802a845c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:46:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9ef1a7ca-960f-4dd6-97ec-471295ef47a4'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:48.487585 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-aaa490a2-f731-4270-9ed2-1fe80f47eac8 None None] Provisioning complete for port d9ed8cc3-7615-40f2-8af6-c149b31e9e42 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:48.488273 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aaa490a2-f731-4270-9ed2-1fe80f47eac8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:48.504659 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-807a29dc-59c3-4201-82ae-941e802a845c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:48.505174 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-807a29dc-59c3-4201-82ae-941e802a845c None None] The sync data for ids ['9ef1a7ca-960f-4dd6-97ec-471295ef47a4'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:46:48.568966 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-aaa490a2-f731-4270-9ed2-1fe80f47eac8 None None] Port d9ed8cc3-7615-40f2-8af6-c149b31e9e42 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:46:48.721462 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9f56b7f5-aba7-4fd2-9c84-4375772769bc up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:46:48.843373 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 9f56b7f5-aba7-4fd2-9c84-4375772769bc triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:48.843829 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:48.950693 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f0a5e4d5-6aab-46aa-8861-d43f0f971699 None None] Provisioning complete for port d9ed8cc3-7615-40f2-8af6-c149b31e9e42 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:48.951042 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f0a5e4d5-6aab-46aa-8861-d43f0f971699 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:49.026808 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f0a5e4d5-6aab-46aa-8861-d43f0f971699 None None] Port d9ed8cc3-7615-40f2-8af6-c149b31e9e42 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:46:49.263386 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b0eb0c25-f2f6-430d-abcb-932b62b7100f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:49.355590 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6d967053-d648-4ce2-ab61-96d0bbe05b2a None None] Provisioning complete for port d9ed8cc3-7615-40f2-8af6-c149b31e9e42 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:49.356131 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6d967053-d648-4ce2-ab61-96d0bbe05b2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:49.400209 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-6d967053-d648-4ce2-ab61-96d0bbe05b2a None None] Port d9ed8cc3-7615-40f2-8af6-c149b31e9e42 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:46:49.974816 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-b0eb0c25-f2f6-430d-abcb-932b62b7100f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting port d9ed8cc3-7615-40f2-8af6-c149b31e9e42 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:49.975679 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b0eb0c25-f2f6-430d-abcb-932b62b7100f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:50.098017 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:46:50.121456 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b0eb0c25-f2f6-430d-abcb-932b62b7100f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:50.136689 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-b0eb0c25-f2f6-430d-abcb-932b62b7100f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Calling delete_port for d9ed8cc3-7615-40f2-8af6-c149b31e9e42 owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:50.371092 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b0eb0c25-f2f6-430d-abcb-932b62b7100f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:50.405177 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0eb0c25-f2f6-430d-abcb-932b62b7100f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Port': ['ID=d9ed8cc3-7615-40f2-8af6-c149b31e9e42,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:50.572760 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b0eb0c25-f2f6-430d-abcb-932b62b7100f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:50.795349 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b0eb0c25-f2f6-430d-abcb-932b62b7100f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Router 9ef1a7ca-960f-4dd6-97ec-471295ef47a4 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:46:50.913039 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b0eb0c25-f2f6-430d-abcb-932b62b7100f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:46:50.921919 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b0eb0c25-f2f6-430d-abcb-932b62b7100f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "PUT /v2.0/routers/9ef1a7ca-960f-4dd6-97ec-471295ef47a4/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4879427 Dec 09 21:46:50.922183 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43448) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:50.925148 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63644cd5-3798-4dde-af59-82d89875841b None None] Sync routers for ids ['9ef1a7ca-960f-4dd6-97ec-471295ef47a4'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:46:50.935937 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63644cd5-3798-4dde-af59-82d89875841b None None] Routers {'9ef1a7ca-960f-4dd6-97ec-471295ef47a4'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:46:50.937162 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-63644cd5-3798-4dde-af59-82d89875841b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:46:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9ef1a7ca-960f-4dd6-97ec-471295ef47a4'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:50.978882 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-dec7c4fc-12a3-4d39-aae5-5d164cdd944a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] GET failed (client error): The resource could not be found. Dec 09 21:46:50.979218 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-63644cd5-3798-4dde-af59-82d89875841b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:50.981122 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-dec7c4fc-12a3-4d39-aae5-5d164cdd944a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports/d9ed8cc3-7615-40f2-8af6-c149b31e9e42 HTTP/1.1" status: 404 len: 333 time: 0.0582418 Dec 09 21:46:50.984016 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43454) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:50.991383 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63644cd5-3798-4dde-af59-82d89875841b None None] Routers {'9ef1a7ca-960f-4dd6-97ec-471295ef47a4'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:46:50.992217 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-63644cd5-3798-4dde-af59-82d89875841b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:46:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9ef1a7ca-960f-4dd6-97ec-471295ef47a4'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:51.029330 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-63644cd5-3798-4dde-af59-82d89875841b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:51.030363 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63644cd5-3798-4dde-af59-82d89875841b None None] The sync data for ids ['9ef1a7ca-960f-4dd6-97ec-471295ef47a4'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:46:51.113992 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f3a85cb-7333-4e5f-a215-f36678f89175 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:51.329914 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f3a85cb-7333-4e5f-a215-f36678f89175 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:51.332681 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f3a85cb-7333-4e5f-a215-f36678f89175 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:51.397369 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f3a85cb-7333-4e5f-a215-f36678f89175 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:51.398267 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6f3a85cb-7333-4e5f-a215-f36678f89175 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Fanout notify agent at l3_agent the message router_deleted on router 9ef1a7ca-960f-4dd6-97ec-471295ef47a4 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:46:51.410120 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f3a85cb-7333-4e5f-a215-f36678f89175 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:51.411374 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6f3a85cb-7333-4e5f-a215-f36678f89175 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/routers/9ef1a7ca-960f-4dd6-97ec-471295ef47a4 HTTP/1.1" status: 204 len: 168 time: 0.4262807 Dec 09 21:46:51.413834 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43478) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:51.471760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-edea0589-2c28-4b14-9a39-00af190115bd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting subnet 87930927-d6e3-4d98-8aa9-af986c45aa6e {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:46:51.475260 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-edea0589-2c28-4b14-9a39-00af190115bd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:51.522559 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-edea0589-2c28-4b14-9a39-00af190115bd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:51.626276 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-edea0589-2c28-4b14-9a39-00af190115bd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:51.692945 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-edea0589-2c28-4b14-9a39-00af190115bd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:51.728020 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-edea0589-2c28-4b14-9a39-00af190115bd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:51.731405 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-edea0589-2c28-4b14-9a39-00af190115bd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/subnets/87930927-d6e3-4d98-8aa9-af986c45aa6e HTTP/1.1" status: 204 len: 168 time: 0.3163433 Dec 09 21:46:51.732619 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edea0589-2c28-4b14-9a39-00af190115bd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Subnet': ['ID=87930927-d6e3-4d98-8aa9-af986c45aa6e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:51.734863 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43490) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:51.736963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bd7f6775-4429-4987-837b-40514ec1d59f None None] Network fc0a6178-5e0f-41ad-a9da-95a5698bebc1 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:46:51.852523 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6ebb837c-e375-4337-bcb6-e87cae3cbb57 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:51.914659 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-6ebb837c-e375-4337-bcb6-e87cae3cbb57 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting port 9f56b7f5-aba7-4fd2-9c84-4375772769bc {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:51.915098 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6ebb837c-e375-4337-bcb6-e87cae3cbb57 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:51.989052 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10ad5710-d2ca-4c8d-a62f-f9aeb653bc0f None None] DHCP port deletion for fc0a6178-5e0f-41ad-a9da-95a5698bebc1 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:46:52.009062 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-6ebb837c-e375-4337-bcb6-e87cae3cbb57 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] For port 9f56b7f5-aba7-4fd2-9c84-4375772769bc, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9f56b7f5-aba7-4fd2-9c84-4375772769bc,segment=NetworkSegment(52148f89-913e-446f-a694-5ac253ddea58),segment_id=52148f89-913e-446f-a694-5ac253ddea58)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:52.009569 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6ebb837c-e375-4337-bcb6-e87cae3cbb57 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:52.036899 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-6ebb837c-e375-4337-bcb6-e87cae3cbb57 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Calling delete_port for 9f56b7f5-aba7-4fd2-9c84-4375772769bc owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:52.066911 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-10ad5710-d2ca-4c8d-a62f-f9aeb653bc0f None None] Deleting port 9f56b7f5-aba7-4fd2-9c84-4375772769bc {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:52.068197 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-10ad5710-d2ca-4c8d-a62f-f9aeb653bc0f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:52.176034 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-10ad5710-d2ca-4c8d-a62f-f9aeb653bc0f None None] For port 9f56b7f5-aba7-4fd2-9c84-4375772769bc, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9f56b7f5-aba7-4fd2-9c84-4375772769bc,segment=NetworkSegment(52148f89-913e-446f-a694-5ac253ddea58),segment_id=52148f89-913e-446f-a694-5ac253ddea58)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:52.176430 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-10ad5710-d2ca-4c8d-a62f-f9aeb653bc0f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:52.202315 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-10ad5710-d2ca-4c8d-a62f-f9aeb653bc0f None None] Calling delete_port for 9f56b7f5-aba7-4fd2-9c84-4375772769bc owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:52.210790 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6ebb837c-e375-4337-bcb6-e87cae3cbb57 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:52.264392 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ebb837c-e375-4337-bcb6-e87cae3cbb57 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] No DVR routers for this DVR port 9f56b7f5-aba7-4fd2-9c84-4375772769bc on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:46:52.274585 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ebb837c-e375-4337-bcb6-e87cae3cbb57 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Port': ['ID=9f56b7f5-aba7-4fd2-9c84-4375772769bc,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:46:52.317635 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 21:46:52.323644 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-10ad5710-d2ca-4c8d-a62f-f9aeb653bc0f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:52.354427 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10ad5710-d2ca-4c8d-a62f-f9aeb653bc0f None None] Pushing event deleted for resources: {'Port': ['ID=9f56b7f5-aba7-4fd2-9c84-4375772769bc,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:52.364056 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10ad5710-d2ca-4c8d-a62f-f9aeb653bc0f None None] No DVR routers for this DVR port 9f56b7f5-aba7-4fd2-9c84-4375772769bc on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:46:52.403397 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6ebb837c-e375-4337-bcb6-e87cae3cbb57 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:52.435079 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-6ebb837c-e375-4337-bcb6-e87cae3cbb57 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fc0a6178-5e0f-41ad-a9da-95a5698bebc1']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:52.448084 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-6ebb837c-e375-4337-bcb6-e87cae3cbb57 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '52148f89-913e-446f-a694-5ac253ddea58') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:52.448519 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-6ebb837c-e375-4337-bcb6-e87cae3cbb57 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '52148f89-913e-446f-a694-5ac253ddea58') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:46:52.460337 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6ebb837c-e375-4337-bcb6-e87cae3cbb57 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:52.500993 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6ebb837c-e375-4337-bcb6-e87cae3cbb57 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:52.510638 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6ebb837c-e375-4337-bcb6-e87cae3cbb57 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Releasing vlan 138 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:46:52.511360 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6ebb837c-e375-4337-bcb6-e87cae3cbb57 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:46:52.516368 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:46:52.596591 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6ebb837c-e375-4337-bcb6-e87cae3cbb57 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:52.606198 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6ebb837c-e375-4337-bcb6-e87cae3cbb57 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:52.616810 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43514) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:52.617417 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6ebb837c-e375-4337-bcb6-e87cae3cbb57 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/networks/fc0a6178-5e0f-41ad-a9da-95a5698bebc1 HTTP/1.1" status: 204 len: 168 time: 0.8809669 Dec 09 21:46:52.636838 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ebb837c-e375-4337-bcb6-e87cae3cbb57 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Network': ['ID=fc0a6178-5e0f-41ad-a9da-95a5698bebc1,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:52.705505 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a5d24f45-dd16-4ae0-b193-426427dd9554 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:52.706158 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9f56b7f5-aba7-4fd2-9c84-4375772769bc no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:46:52.706976 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a5d24f45-dd16-4ae0-b193-426427dd9554 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports/925975a6-f699-4323-8c8c-4f06e77fe8b2 HTTP/1.1" status: 200 len: 845 time: 0.0888543 Dec 09 21:46:52.711629 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43518) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:52.751627 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 9f56b7f5-aba7-4fd2-9c84-4375772769bc {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:46:52.751986 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9f56b7f5-aba7-4fd2-9c84-4375772769bc not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:46:52.764954 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43520) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:52.766724 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-69021d09-1278-49ba-a66d-221791763d65 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports/925975a6-f699-4323-8c8c-4f06e77fe8b2?fields=id&fields=mac_address HTTP/1.1" status: 200 len: 281 time: 0.0524311 Dec 09 21:46:52.771018 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-0053a5f7-201f-41fd-8080-be86fc4c45b3 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'subnet': {'network_id': '6150e6df-2b72-4f1d-912c-2256eb16e2b3', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:52.908327 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0053a5f7-201f-41fd-8080-be86fc4c45b3 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:52.915576 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0053a5f7-201f-41fd-8080-be86fc4c45b3 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:53.148742 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0053a5f7-201f-41fd-8080-be86fc4c45b3 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:53.187559 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0053a5f7-201f-41fd-8080-be86fc4c45b3 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:46:53.199058 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-0053a5f7-201f-41fd-8080-be86fc4c45b3 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:53.204540 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0053a5f7-201f-41fd-8080-be86fc4c45b3 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:53.205293 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0053a5f7-201f-41fd-8080-be86fc4c45b3 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:53.212341 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24963de9-e273-4f06-a0ce-00b5e8250fa0 None None] Network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:46:53.251430 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0053a5f7-201f-41fd-8080-be86fc4c45b3 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Subnet': ['ID=56586736-60cb-4ca8-9537-386161633267,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:53.257732 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43532) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:53.260630 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0053a5f7-201f-41fd-8080-be86fc4c45b3 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4947114 Dec 09 21:46:53.265132 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43534) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:53.279488 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-09b30196-9a87-4018-832e-1804c871ee2b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'security_group': {'name': 'tempest-secgroup-2040089648'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:53.335807 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-09b30196-9a87-4018-832e-1804c871ee2b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:53.453501 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f912dd0d-5ef5-4261-af55-918d4f9b0f22 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-6150e6df-2b72-4f1d-912c-2256eb16e2b3', 'network_id': '6150e6df-2b72-4f1d-912c-2256eb16e2b3', 'project_id': '9560c66e717c47918bfe698e159759c5', 'fixed_ips': [{'subnet_id': '56586736-60cb-4ca8-9537-386161633267'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:46:53.454501 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f912dd0d-5ef5-4261-af55-918d4f9b0f22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:53.515964 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-09b30196-9a87-4018-832e-1804c871ee2b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:53.523862 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-09b30196-9a87-4018-832e-1804c871ee2b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:53.554573 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f888f29c-d1d0-480a-89ac-4553b75ba189 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:53.629678 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-09b30196-9a87-4018-832e-1804c871ee2b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:53.652204 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-09b30196-9a87-4018-832e-1804c871ee2b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.3841228 Dec 09 21:46:53.652697 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43558) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:53.674343 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-06d7fa83-6202-4aa1-9d8c-d30e452f3ed3 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'security_group': {'name': 'tempest-secgroup-2122537001'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:53.691650 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09b30196-9a87-4018-832e-1804c871ee2b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fd4885f3-8098-4b4b-8e3a-df68e8b4c35b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:53.734280 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-06d7fa83-6202-4aa1-9d8c-d30e452f3ed3 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:53.766109 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f888f29c-d1d0-480a-89ac-4553b75ba189 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:53.775974 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f888f29c-d1d0-480a-89ac-4553b75ba189 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:53.820331 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-f912dd0d-5ef5-4261-af55-918d4f9b0f22 None None] Allocated IP 2001:db8::2 (6150e6df-2b72-4f1d-912c-2256eb16e2b3/56586736-60cb-4ca8-9537-386161633267/c1842a9b-5a72-429c-b0ed-b302e6222f49) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:46:53.847475 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f888f29c-d1d0-480a-89ac-4553b75ba189 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9b31dc0b-38f4-4077-8af2-0585ced4e91c,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:53.898088 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-06d7fa83-6202-4aa1-9d8c-d30e452f3ed3 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:53.901312 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f888f29c-d1d0-480a-89ac-4553b75ba189 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=1e8509095a4a4a7c9ac1271d3bebfc2c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6422360 Dec 09 21:46:53.904059 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43582) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:53.907772 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-06d7fa83-6202-4aa1-9d8c-d30e452f3ed3 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:54.004685 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06d7fa83-6202-4aa1-9d8c-d30e452f3ed3 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d974e2ea-acc5-4a94-8373-fd3f35aa0dc8,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:54.090192 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bd7c6b50-aa71-4799-a133-5c0ca231b728 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:54.118563 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bd7c6b50-aa71-4799-a133-5c0ca231b728 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:54.155895 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f912dd0d-5ef5-4261-af55-918d4f9b0f22 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:54.170296 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f912dd0d-5ef5-4261-af55-918d4f9b0f22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:54.236944 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-06d7fa83-6202-4aa1-9d8c-d30e452f3ed3 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:54.243011 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-06d7fa83-6202-4aa1-9d8c-d30e452f3ed3 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.5841959 Dec 09 21:46:54.243011 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bd7c6b50-aa71-4799-a133-5c0ca231b728 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:54.243816 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43622) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:54.247138 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bd7c6b50-aa71-4799-a133-5c0ca231b728 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:54.249197 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bd7c6b50-aa71-4799-a133-5c0ca231b728 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/9b31dc0b-38f4-4077-8af2-0585ced4e91c HTTP/1.1" status: 204 len: 168 time: 0.3425105 Dec 09 21:46:54.249953 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f912dd0d-5ef5-4261-af55-918d4f9b0f22 None None] Network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:46:54.250673 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-4bcfb4c5-f769-46ed-8259-eef28f896c99 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-606546626', 'security_groups': ['d974e2ea-acc5-4a94-8373-fd3f35aa0dc8'], 'network_id': '6150e6df-2b72-4f1d-912c-2256eb16e2b3', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': '56586736-60cb-4ca8-9537-386161633267'}]}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:54.255379 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-f912dd0d-5ef5-4261-af55-918d4f9b0f22 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:54.263988 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f912dd0d-5ef5-4261-af55-918d4f9b0f22 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:46:54.277011 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd7c6b50-aa71-4799-a133-5c0ca231b728 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9b31dc0b-38f4-4077-8af2-0585ced4e91c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:54.301399 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f912dd0d-5ef5-4261-af55-918d4f9b0f22 None None] Pushing event updated for resources: {'Port': ['ID=c1842a9b-5a72-429c-b0ed-b302e6222f49,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:54.357141 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-f912dd0d-5ef5-4261-af55-918d4f9b0f22 None None] Attempting to bind port c1842a9b-5a72-429c-b0ed-b302e6222f49 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:46:54.357971 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-f912dd0d-5ef5-4261-af55-918d4f9b0f22 None None] Attempting to bind port c1842a9b-5a72-429c-b0ed-b302e6222f49 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '90ddd048-63c0-4062-82f8-78fcca8ae490', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '6150e6df-2b72-4f1d-912c-2256eb16e2b3'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:46:54.358619 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f912dd0d-5ef5-4261-af55-918d4f9b0f22 None None] Attempting to bind port c1842a9b-5a72-429c-b0ed-b302e6222f49 on network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:46:54.368065 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f912dd0d-5ef5-4261-af55-918d4f9b0f22 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 46, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:46:54.368597 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f912dd0d-5ef5-4261-af55-918d4f9b0f22 None None] Checking segment: {'id': '90ddd048-63c0-4062-82f8-78fcca8ae490', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '6150e6df-2b72-4f1d-912c-2256eb16e2b3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:46:54.369100 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f912dd0d-5ef5-4261-af55-918d4f9b0f22 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:54.369612 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f912dd0d-5ef5-4261-af55-918d4f9b0f22 None None] Bound using segment: {'id': '90ddd048-63c0-4062-82f8-78fcca8ae490', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '6150e6df-2b72-4f1d-912c-2256eb16e2b3'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:46:54.370350 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-f912dd0d-5ef5-4261-af55-918d4f9b0f22 None None] Bound port: c1842a9b-5a72-429c-b0ed-b302e6222f49, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '90ddd048-63c0-4062-82f8-78fcca8ae490', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '6150e6df-2b72-4f1d-912c-2256eb16e2b3'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:46:54.371982 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f912dd0d-5ef5-4261-af55-918d4f9b0f22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:54.556197 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4bcfb4c5-f769-46ed-8259-eef28f896c99 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:54.575787 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f912dd0d-5ef5-4261-af55-918d4f9b0f22 None None] For port c1842a9b-5a72-429c-b0ed-b302e6222f49, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:46:54.585082 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f912dd0d-5ef5-4261-af55-918d4f9b0f22 None None] For port c1842a9b-5a72-429c-b0ed-b302e6222f49, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c1842a9b-5a72-429c-b0ed-b302e6222f49,segment=NetworkSegment(90ddd048-63c0-4062-82f8-78fcca8ae490),segment_id=90ddd048-63c0-4062-82f8-78fcca8ae490)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:46:54.594753 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f912dd0d-5ef5-4261-af55-918d4f9b0f22 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:54.626027 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43666) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:54.708358 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f912dd0d-5ef5-4261-af55-918d4f9b0f22 None None] Pushing event updated for resources: {'Port': ['ID=c1842a9b-5a72-429c-b0ed-b302e6222f49,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:54.767676 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4bcfb4c5-f769-46ed-8259-eef28f896c99 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:54.833152 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-4bcfb4c5-f769-46ed-8259-eef28f896c99 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] device_id is not set on port a071fc1a-f633-42d3-9a2c-a720be4443e7 yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:46:54.860436 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-43061e5e-13ff-4d29-a09c-851e130d964a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:54.939310 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43698) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:54.970371 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-db26482d-4cd3-4bc4-ad93-8d4f9f93134e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:55.094906 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-4bcfb4c5-f769-46ed-8259-eef28f896c99 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Allocated IP 2001:db8::ab (6150e6df-2b72-4f1d-912c-2256eb16e2b3/56586736-60cb-4ca8-9537-386161633267/a071fc1a-f633-42d3-9a2c-a720be4443e7) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:46:55.096548 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-db26482d-4cd3-4bc4-ad93-8d4f9f93134e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:55.109229 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-db26482d-4cd3-4bc4-ad93-8d4f9f93134e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:55.180471 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-db26482d-4cd3-4bc4-ad93-8d4f9f93134e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=c4dc9188da7d426dbe4f8b08222c3c51&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2400212 Dec 09 21:46:55.184717 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-43061e5e-13ff-4d29-a09c-851e130d964a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:55.186528 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43718) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:55.217279 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db26482d-4cd3-4bc4-ad93-8d4f9f93134e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7f8df746-ddda-4c70-8701-f3af021626e1,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:55.222797 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-43061e5e-13ff-4d29-a09c-851e130d964a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:55.296651 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4bcfb4c5-f769-46ed-8259-eef28f896c99 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:55.308467 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-43061e5e-13ff-4d29-a09c-851e130d964a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=d76b680450224282a588451d2107cd68&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6784644 Dec 09 21:46:55.308467 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43061e5e-13ff-4d29-a09c-851e130d964a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=00cebf4a-4625-4527-9bb5-83bb7321edcc,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:55.312701 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43730) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:55.342255 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4bcfb4c5-f769-46ed-8259-eef28f896c99 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:55.407090 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d586fb21-e9fd-4de9-864b-1005bb523ac5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:55.412431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4bcfb4c5-f769-46ed-8259-eef28f896c99 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:46:55.413646 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bcfb4c5-f769-46ed-8259-eef28f896c99 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Port': ['ID=a071fc1a-f633-42d3-9a2c-a720be4443e7,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:55.416470 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-4bcfb4c5-f769-46ed-8259-eef28f896c99 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:55.418928 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4bcfb4c5-f769-46ed-8259-eef28f896c99 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:46:55.426191 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4bcfb4c5-f769-46ed-8259-eef28f896c99 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:55.427353 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4bcfb4c5-f769-46ed-8259-eef28f896c99 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:55.445163 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d586fb21-e9fd-4de9-864b-1005bb523ac5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:55.456882 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4bcfb4c5-f769-46ed-8259-eef28f896c99 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 929 time: 1.2114770 Dec 09 21:46:55.457589 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43746) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:55.470048 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-18748bbc-987c-43e0-8013-ee758097cd74 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'subnet': {'network_id': '6150e6df-2b72-4f1d-912c-2256eb16e2b3', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:55.470548 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a240ea46-4d0c-45a2-910b-f4b688be04d3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:55.505888 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a240ea46-4d0c-45a2-910b-f4b688be04d3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:55.540695 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d586fb21-e9fd-4de9-864b-1005bb523ac5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:55.543385 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d586fb21-e9fd-4de9-864b-1005bb523ac5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:55.544704 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d586fb21-e9fd-4de9-864b-1005bb523ac5 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/7f8df746-ddda-4c70-8701-f3af021626e1 HTTP/1.1" status: 204 len: 168 time: 0.3568745 Dec 09 21:46:55.585076 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d586fb21-e9fd-4de9-864b-1005bb523ac5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7f8df746-ddda-4c70-8701-f3af021626e1,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:55.629306 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a240ea46-4d0c-45a2-910b-f4b688be04d3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:55.632002 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a240ea46-4d0c-45a2-910b-f4b688be04d3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:55.633550 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a240ea46-4d0c-45a2-910b-f4b688be04d3 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/00cebf4a-4625-4527-9bb5-83bb7321edcc HTTP/1.1" status: 204 len: 168 time: 0.3183725 Dec 09 21:46:55.648582 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a240ea46-4d0c-45a2-910b-f4b688be04d3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=00cebf4a-4625-4527-9bb5-83bb7321edcc,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:55.686891 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-18748bbc-987c-43e0-8013-ee758097cd74 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:55.696630 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-18748bbc-987c-43e0-8013-ee758097cd74 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:55.944387 n-d-713301-27 neutron-server[103438]: INFO neutron.db.ipam_backend_mixin [None req-18748bbc-987c-43e0-8013-ee758097cd74 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet 56586736-60cb-4ca8-9537-386161633267 (CIDR: 2001:db8::/64) Dec 09 21:46:55.949282 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-18748bbc-987c-43e0-8013-ee758097cd74 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:46:55.949867 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-18748bbc-987c-43e0-8013-ee758097cd74 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:46:55.989906 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-18748bbc-987c-43e0-8013-ee758097cd74 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.5308998 Dec 09 21:46:55.993189 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43810) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:56.002317 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b3b5d6e7-a4c2-40a2-b7c7-0161e2ced298 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'subnet': {'network_id': '6150e6df-2b72-4f1d-912c-2256eb16e2b3', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:56.164774 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b3b5d6e7-a4c2-40a2-b7c7-0161e2ced298 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:46:56.174502 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b3b5d6e7-a4c2-40a2-b7c7-0161e2ced298 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:56.444479 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43872) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:56.471830 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6e7e03e0-7f34-42ac-88d9-2df0bc66f722 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:56.523178 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-fa8f49ea-8eb2-425d-9517-23e6161ee600 None None] Provisioning complete for port c1842a9b-5a72-429c-b0ed-b302e6222f49 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:56.524864 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fa8f49ea-8eb2-425d-9517-23e6161ee600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:56.683229 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fa8f49ea-8eb2-425d-9517-23e6161ee600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:56.686156 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6e7e03e0-7f34-42ac-88d9-2df0bc66f722 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:56.705646 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6e7e03e0-7f34-42ac-88d9-2df0bc66f722 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:56.742627 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-fa8f49ea-8eb2-425d-9517-23e6161ee600 None None] For port c1842a9b-5a72-429c-b0ed-b302e6222f49, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c1842a9b-5a72-429c-b0ed-b302e6222f49,segment=NetworkSegment(90ddd048-63c0-4062-82f8-78fcca8ae490),segment_id=90ddd048-63c0-4062-82f8-78fcca8ae490)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:56.753468 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fa8f49ea-8eb2-425d-9517-23e6161ee600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:56.794087 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b3b5d6e7-a4c2-40a2-b7c7-0161e2ced298 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:56.828083 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e7e03e0-7f34-42ac-88d9-2df0bc66f722 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7994b0a5-f27d-4fb8-a469-b1202d060f66,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:56.841984 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6e7e03e0-7f34-42ac-88d9-2df0bc66f722 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=1982abff110f454ebfd215d12ed802c3&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3963006 Dec 09 21:46:56.845724 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 43912) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:56.851376 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b3b5d6e7-a4c2-40a2-b7c7-0161e2ced298 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:46:56.888363 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-b3b5d6e7-a4c2-40a2-b7c7-0161e2ced298 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:46:56.898750 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b3b5d6e7-a4c2-40a2-b7c7-0161e2ced298 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:56.899640 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b3b5d6e7-a4c2-40a2-b7c7-0161e2ced298 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:56.979648 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b3b5d6e7-a4c2-40a2-b7c7-0161e2ced298 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 0.9822876 Dec 09 21:46:56.983265 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 43928) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:56.994080 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-65772415-3d94-464c-97b4-cb4a467fb78d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-357059566', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': 'aa8d5942-a972-4fe2-aee5-51f0e0c4748f'}], 'security_groups': ['fd4885f3-8098-4b4b-8e3a-df68e8b4c35b']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:46:57.001501 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-69dd06f3-44d8-4ae4-a789-cb8515cc1db4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:57.006562 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3b5d6e7-a4c2-40a2-b7c7-0161e2ced298 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Subnet': ['ID=aa8d5942-a972-4fe2-aee5-51f0e0c4748f,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:57.069749 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-69dd06f3-44d8-4ae4-a789-cb8515cc1db4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:57.157916 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c1842a9b-5a72-429c-b0ed-b302e6222f49 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:46:57.160416 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-69dd06f3-44d8-4ae4-a789-cb8515cc1db4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:57.161016 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-035fd2d8-0d30-4347-a6be-6ef90805886f None None] Network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:46:57.163093 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-69dd06f3-44d8-4ae4-a789-cb8515cc1db4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:57.164365 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-69dd06f3-44d8-4ae4-a789-cb8515cc1db4 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/7994b0a5-f27d-4fb8-a469-b1202d060f66 HTTP/1.1" status: 204 len: 168 time: 0.3174329 Dec 09 21:46:57.178300 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69dd06f3-44d8-4ae4-a789-cb8515cc1db4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7994b0a5-f27d-4fb8-a469-b1202d060f66,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:57.274320 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-65772415-3d94-464c-97b4-cb4a467fb78d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:57.323151 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-fa8f49ea-8eb2-425d-9517-23e6161ee600 None None] Provisioning complete for port 925975a6-f699-4323-8c8c-4f06e77fe8b2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:57.323566 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fa8f49ea-8eb2-425d-9517-23e6161ee600 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:57.377156 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:57.406562 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa8f49ea-8eb2-425d-9517-23e6161ee600 None None] Pushing event updated for resources: {'Port': ['ID=c1842a9b-5a72-429c-b0ed-b302e6222f49,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:57.432252 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:57.467067 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-fa8f49ea-8eb2-425d-9517-23e6161ee600 None None] Port 925975a6-f699-4323-8c8c-4f06e77fe8b2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:46:57.477960 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port c1842a9b-5a72-429c-b0ed-b302e6222f49 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:57.478367 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:57.752495 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49c337b6-c261-47fa-8c0a-d5a91de6ed88 None None] Update dhcp port {'port': {'network_id': '6150e6df-2b72-4f1d-912c-2256eb16e2b3', 'fixed_ips': [{'subnet_id': '56586736-60cb-4ca8-9537-386161633267', 'ip_address': '2001:db8::2'}, {'subnet_id': 'aa8d5942-a972-4fe2-aee5-51f0e0c4748f'}], 'binding:host_id': 'n-d-713301-27'}, 'id': 'c1842a9b-5a72-429c-b0ed-b302e6222f49'} from n-d-713301-27. {{(pid=103439) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 09 21:46:57.755205 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-dae4baaa-e8ed-409c-be76-3335ce5a877f None None] Provisioning complete for port a071fc1a-f633-42d3-9a2c-a720be4443e7 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:57.755840 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dae4baaa-e8ed-409c-be76-3335ce5a877f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:57.859661 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-49c337b6-c261-47fa-8c0a-d5a91de6ed88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:57.874282 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-dae4baaa-e8ed-409c-be76-3335ce5a877f None None] Port a071fc1a-f633-42d3-9a2c-a720be4443e7 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:46:57.925386 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44038) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:57.941312 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6b247089-5d78-49ab-a8bb-c06b7f6a9d09 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:58.060774 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-65772415-3d94-464c-97b4-cb4a467fb78d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Delete allocated IP 2001:db8::ab (6150e6df-2b72-4f1d-912c-2256eb16e2b3/56586736-60cb-4ca8-9537-386161633267) {{(pid=103437) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Dec 09 21:46:58.072255 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-65772415-3d94-464c-97b4-cb4a467fb78d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Allocated IP 2001:db8:0:1::3ce (6150e6df-2b72-4f1d-912c-2256eb16e2b3/aa8d5942-a972-4fe2-aee5-51f0e0c4748f/a071fc1a-f633-42d3-9a2c-a720be4443e7) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:46:58.123245 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6b247089-5d78-49ab-a8bb-c06b7f6a9d09 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:58.132107 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6b247089-5d78-49ab-a8bb-c06b7f6a9d09 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:58.187694 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b247089-5d78-49ab-a8bb-c06b7f6a9d09 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2dc1b292-4bea-4de2-980b-c65ad65b83a0,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:58.218959 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6b247089-5d78-49ab-a8bb-c06b7f6a9d09 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=d53802908b7242f8a12151b326880f8f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2923136 Dec 09 21:46:58.219428 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44068) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:58.331904 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dcb24019-c151-4b70-9f8c-0ca5c1931ab4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:58.359297 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-65772415-3d94-464c-97b4-cb4a467fb78d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:58.369808 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dcb24019-c151-4b70-9f8c-0ca5c1931ab4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:58.371064 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-65772415-3d94-464c-97b4-cb4a467fb78d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:58.419626 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-49c337b6-c261-47fa-8c0a-d5a91de6ed88 None None] Allocated IP 2001:db8:0:1::2 (6150e6df-2b72-4f1d-912c-2256eb16e2b3/aa8d5942-a972-4fe2-aee5-51f0e0c4748f/c1842a9b-5a72-429c-b0ed-b302e6222f49) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:46:58.464836 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-65772415-3d94-464c-97b4-cb4a467fb78d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] In _notify_port_updated(), no bound segment for port a071fc1a-f633-42d3-9a2c-a720be4443e7 on network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 {{(pid=103437) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:46:58.470754 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-65772415-3d94-464c-97b4-cb4a467fb78d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:46:58.471283 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-65772415-3d94-464c-97b4-cb4a467fb78d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:58.472662 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-65772415-3d94-464c-97b4-cb4a467fb78d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "PUT /v2.0/ports/a071fc1a-f633-42d3-9a2c-a720be4443e7 HTTP/1.1" status: 200 len: 930 time: 1.4853473 Dec 09 21:46:58.476434 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44076) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:58.478831 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65772415-3d94-464c-97b4-cb4a467fb78d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Port': ['ID=a071fc1a-f633-42d3-9a2c-a720be4443e7,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:58.525965 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dcb24019-c151-4b70-9f8c-0ca5c1931ab4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:58.528603 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dcb24019-c151-4b70-9f8c-0ca5c1931ab4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:58.529757 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-dcb24019-c151-4b70-9f8c-0ca5c1931ab4 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/2dc1b292-4bea-4de2-980b-c65ad65b83a0 HTTP/1.1" status: 204 len: 168 time: 0.3076811 Dec 09 21:46:58.559222 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-49c337b6-c261-47fa-8c0a-d5a91de6ed88 None None] For port c1842a9b-5a72-429c-b0ed-b302e6222f49, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c1842a9b-5a72-429c-b0ed-b302e6222f49,segment=NetworkSegment(90ddd048-63c0-4062-82f8-78fcca8ae490),segment_id=90ddd048-63c0-4062-82f8-78fcca8ae490)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:46:58.562188 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcb24019-c151-4b70-9f8c-0ca5c1931ab4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2dc1b292-4bea-4de2-980b-c65ad65b83a0,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:58.594579 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-350dbfd0-3c66-4573-8387-200352173922 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting port a071fc1a-f633-42d3-9a2c-a720be4443e7 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:46:58.594869 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-350dbfd0-3c66-4573-8387-200352173922 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:58.647912 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-49c337b6-c261-47fa-8c0a-d5a91de6ed88 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:58.655415 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-49c337b6-c261-47fa-8c0a-d5a91de6ed88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:58.731235 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c1842a9b-5a72-429c-b0ed-b302e6222f49 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:46:58.776139 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-350dbfd0-3c66-4573-8387-200352173922 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:58.798662 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-350dbfd0-3c66-4573-8387-200352173922 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Calling delete_port for a071fc1a-f633-42d3-9a2c-a720be4443e7 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:46:58.804615 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49c337b6-c261-47fa-8c0a-d5a91de6ed88 None None] Pushing event updated for resources: {'Port': ['ID=c1842a9b-5a72-429c-b0ed-b302e6222f49,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:58.847946 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port c1842a9b-5a72-429c-b0ed-b302e6222f49 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:58.848323 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:59.002594 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44096) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:59.057251 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-350dbfd0-3c66-4573-8387-200352173922 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:59.137411 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-350dbfd0-3c66-4573-8387-200352173922 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Port': ['ID=a071fc1a-f633-42d3-9a2c-a720be4443e7,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:59.160969 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-350dbfd0-3c66-4573-8387-200352173922 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:59.169134 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-350dbfd0-3c66-4573-8387-200352173922 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/ports/a071fc1a-f633-42d3-9a2c-a720be4443e7 HTTP/1.1" status: 204 len: 168 time: 0.6892853 Dec 09 21:46:59.169955 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44106) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:59.199466 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-3b59b2d2-141a-4ab8-bbdb-1dfe6d11dfe2 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] GET failed (client error): The resource could not be found. Dec 09 21:46:59.201463 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3b59b2d2-141a-4ab8-bbdb-1dfe6d11dfe2 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports/a071fc1a-f633-42d3-9a2c-a720be4443e7 HTTP/1.1" status: 404 len: 333 time: 0.0303161 Dec 09 21:46:59.204791 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44108) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:59.212763 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04319c64-1455-4c0e-bfbe-6894a32c36a6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:59.272942 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1e58702c-c5f0-44b8-89f1-37879f2f274d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:59.313656 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1e58702c-c5f0-44b8-89f1-37879f2f274d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:59.322661 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04319c64-1455-4c0e-bfbe-6894a32c36a6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:59.329368 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04319c64-1455-4c0e-bfbe-6894a32c36a6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:59.381930 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04319c64-1455-4c0e-bfbe-6894a32c36a6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b5947571-d2cf-4d0b-b787-ffe67f8aac6d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:59.383401 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1e58702c-c5f0-44b8-89f1-37879f2f274d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:59.387267 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1e58702c-c5f0-44b8-89f1-37879f2f274d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:59.388913 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1e58702c-c5f0-44b8-89f1-37879f2f274d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/security-groups/d974e2ea-acc5-4a94-8373-fd3f35aa0dc8 HTTP/1.1" status: 204 len: 168 time: 0.1829138 Dec 09 21:46:59.393187 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-04319c64-1455-4c0e-bfbe-6894a32c36a6 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=048fb058a9e34d138cdb0c93f6c1bac9&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3894653 Dec 09 21:46:59.393867 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44114) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:59.394200 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44116) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:59.404864 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e58702c-c5f0-44b8-89f1-37879f2f274d tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d974e2ea-acc5-4a94-8373-fd3f35aa0dc8,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:46:59.718186 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-abe60daa-4a1d-4246-944d-a2841222616d None None] Provisioning complete for port c1842a9b-5a72-429c-b0ed-b302e6222f49 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:59.718693 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-abe60daa-4a1d-4246-944d-a2841222616d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:59.837584 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93ef7994-5a8b-4173-ac48-af5a81a1ede6 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:59.873181 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-abe60daa-4a1d-4246-944d-a2841222616d None None] Could not find standard attr ID for object a071fc1a-f633-42d3-9a2c-a720be4443e7. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:46:59.877883 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93ef7994-5a8b-4173-ac48-af5a81a1ede6 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:59.885350 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-abe60daa-4a1d-4246-944d-a2841222616d None None] Provisioning complete for port 925975a6-f699-4323-8c8c-4f06e77fe8b2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:46:59.886040 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-abe60daa-4a1d-4246-944d-a2841222616d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:59.909154 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e7c6dde-f240-4196-ad75-c7fc4777af11 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:59.936269 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-abe60daa-4a1d-4246-944d-a2841222616d None None] Port 925975a6-f699-4323-8c8c-4f06e77fe8b2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:46:59.955822 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e7c6dde-f240-4196-ad75-c7fc4777af11 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:59.963363 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93ef7994-5a8b-4173-ac48-af5a81a1ede6 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:59.966003 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93ef7994-5a8b-4173-ac48-af5a81a1ede6 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:46:59.970840 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44128) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:46:59.971084 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-93ef7994-5a8b-4173-ac48-af5a81a1ede6 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/security-groups/fd4885f3-8098-4b4b-8e3a-df68e8b4c35b HTTP/1.1" status: 204 len: 168 time: 0.5753493 Dec 09 21:46:59.990606 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93ef7994-5a8b-4173-ac48-af5a81a1ede6 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fd4885f3-8098-4b4b-8e3a-df68e8b4c35b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:00.038881 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e7c6dde-f240-4196-ad75-c7fc4777af11 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:00.043315 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e7c6dde-f240-4196-ad75-c7fc4777af11 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:00.051260 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3e7c6dde-f240-4196-ad75-c7fc4777af11 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/b5947571-d2cf-4d0b-b787-ffe67f8aac6d HTTP/1.1" status: 204 len: 168 time: 0.6540985 Dec 09 21:47:00.061880 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e7c6dde-f240-4196-ad75-c7fc4777af11 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b5947571-d2cf-4d0b-b787-ffe67f8aac6d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:00.062508 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3c3ff87c-2572-4517-ab36-c89b661c8897 None None] Could not find standard attr ID for object a071fc1a-f633-42d3-9a2c-a720be4443e7. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:47:00.074735 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-9c822daa-fbf6-41d4-880e-67fa0ba2e1db tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting subnet 56586736-60cb-4ca8-9537-386161633267 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:47:00.086202 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9c822daa-fbf6-41d4-880e-67fa0ba2e1db tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:00.144143 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9c822daa-fbf6-41d4-880e-67fa0ba2e1db tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:00.273774 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9c822daa-fbf6-41d4-880e-67fa0ba2e1db tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:00.345596 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9c822daa-fbf6-41d4-880e-67fa0ba2e1db tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:00.362213 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9c822daa-fbf6-41d4-880e-67fa0ba2e1db tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:00.366377 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9c822daa-fbf6-41d4-880e-67fa0ba2e1db tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/subnets/56586736-60cb-4ca8-9537-386161633267 HTTP/1.1" status: 204 len: 168 time: 0.3935425 Dec 09 21:47:00.372499 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e8fc3591-843b-4a57-962e-fe1be9fca370 None None] Network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:47:00.373372 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44142) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:00.380507 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-d4d74d40-efcb-49c5-ba8a-f0068f4fd6db tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'subnet': {'network_id': '6150e6df-2b72-4f1d-912c-2256eb16e2b3', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:00.403087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c822daa-fbf6-41d4-880e-67fa0ba2e1db tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Subnet': ['ID=56586736-60cb-4ca8-9537-386161633267,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:00.603533 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d4d74d40-efcb-49c5-ba8a-f0068f4fd6db tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:47:00.607462 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d4d74d40-efcb-49c5-ba8a-f0068f4fd6db tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:00.751473 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c1842a9b-5a72-429c-b0ed-b302e6222f49 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:47:00.832216 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port c1842a9b-5a72-429c-b0ed-b302e6222f49 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:00.832935 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:01.048592 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d4d74d40-efcb-49c5-ba8a-f0068f4fd6db tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:01.108831 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d4d74d40-efcb-49c5-ba8a-f0068f4fd6db tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:47:01.115477 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-d4d74d40-efcb-49c5-ba8a-f0068f4fd6db tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:01.119271 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d4d74d40-efcb-49c5-ba8a-f0068f4fd6db tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:01.120422 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d4d74d40-efcb-49c5-ba8a-f0068f4fd6db tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:01.145364 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4d74d40-efcb-49c5-ba8a-f0068f4fd6db tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Subnet': ['ID=e62590de-6d95-4243-9280-9d21a4de72ba,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:01.157026 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d4d74d40-efcb-49c5-ba8a-f0068f4fd6db tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.7785709 Dec 09 21:47:01.157130 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44168) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:01.162962 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-163a48bd-6238-4119-a7ed-a39bce3ec931 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'security_group': {'name': 'tempest-secgroup-1510907332'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:01.199153 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-163a48bd-6238-4119-a7ed-a39bce3ec931 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:01.333934 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-163a48bd-6238-4119-a7ed-a39bce3ec931 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:01.342336 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-163a48bd-6238-4119-a7ed-a39bce3ec931 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:01.386684 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-163a48bd-6238-4119-a7ed-a39bce3ec931 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:01.389007 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-163a48bd-6238-4119-a7ed-a39bce3ec931 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.2310836 Dec 09 21:47:01.392107 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44180) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:01.393210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-163a48bd-6238-4119-a7ed-a39bce3ec931 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'SecurityGroup': ['ID=18113485-f185-4473-a82e-f002661a46e5,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:01.402707 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-71738312-ea4f-46ce-90f6-3d492dd2dd49 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'security_group': {'name': 'tempest-secgroup-558498779'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:01.442254 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71738312-ea4f-46ce-90f6-3d492dd2dd49 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:01.493802 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-493e6abc-518f-4b25-bcfe-3b673b05c0f0 None None] Network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:47:01.572841 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5088323b-f353-4e02-85af-181f058fe276 None None] Provisioning complete for port c1842a9b-5a72-429c-b0ed-b302e6222f49 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:01.573460 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5088323b-f353-4e02-85af-181f058fe276 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:01.590441 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71738312-ea4f-46ce-90f6-3d492dd2dd49 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:01.598273 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71738312-ea4f-46ce-90f6-3d492dd2dd49 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:01.640606 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71738312-ea4f-46ce-90f6-3d492dd2dd49 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:01.642145 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-71738312-ea4f-46ce-90f6-3d492dd2dd49 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1761 time: 0.2489960 Dec 09 21:47:01.643641 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71738312-ea4f-46ce-90f6-3d492dd2dd49 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c7673565-1683-4c76-8324-f77ae0df5ec9,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:01.645588 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44192) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:01.657563 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-8a453150-1cb3-4ba2-be26-46412eb1a833 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'security_group': {'name': 'tempest-secgroup-2041257701'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:01.695465 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a453150-1cb3-4ba2-be26-46412eb1a833 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:01.773850 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5088323b-f353-4e02-85af-181f058fe276 None None] Provisioning complete for port 925975a6-f699-4323-8c8c-4f06e77fe8b2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:01.774245 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5088323b-f353-4e02-85af-181f058fe276 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:01.811058 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c678c740-f158-4cf7-a999-7034ebd79749 None None] Update dhcp port {'port': {'network_id': '6150e6df-2b72-4f1d-912c-2256eb16e2b3', 'fixed_ips': [{'subnet_id': 'aa8d5942-a972-4fe2-aee5-51f0e0c4748f', 'ip_address': '2001:db8:0:1::2'}, {'subnet_id': 'e62590de-6d95-4243-9280-9d21a4de72ba'}], 'binding:host_id': 'n-d-713301-27'}, 'id': 'c1842a9b-5a72-429c-b0ed-b302e6222f49'} from n-d-713301-27. {{(pid=103439) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 09 21:47:01.827791 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a453150-1cb3-4ba2-be26-46412eb1a833 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:01.838019 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a453150-1cb3-4ba2-be26-46412eb1a833 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:01.844368 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-5088323b-f353-4e02-85af-181f058fe276 None None] Port 925975a6-f699-4323-8c8c-4f06e77fe8b2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:47:01.846578 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c678c740-f158-4cf7-a999-7034ebd79749 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:01.898231 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a453150-1cb3-4ba2-be26-46412eb1a833 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d25919f6-6085-4fae-972f-5da56f7b210f,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:01.912646 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a453150-1cb3-4ba2-be26-46412eb1a833 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:01.914024 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8a453150-1cb3-4ba2-be26-46412eb1a833 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.2624891 Dec 09 21:47:01.916969 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44202) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:01.926046 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-cc44387c-eae8-48fd-a5c4-17394b96a291 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-1623383538', 'security_groups': ['d25919f6-6085-4fae-972f-5da56f7b210f'], 'network_id': '6150e6df-2b72-4f1d-912c-2256eb16e2b3', 'admin_state_up': True, 'fixed_ips': [{'subnet_id': 'e62590de-6d95-4243-9280-9d21a4de72ba'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:02.082371 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cc44387c-eae8-48fd-a5c4-17394b96a291 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:47:02.091396 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cc44387c-eae8-48fd-a5c4-17394b96a291 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:02.098457 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-c678c740-f158-4cf7-a999-7034ebd79749 None None] Allocated IP 2001:db8::2 (6150e6df-2b72-4f1d-912c-2256eb16e2b3/e62590de-6d95-4243-9280-9d21a4de72ba/c1842a9b-5a72-429c-b0ed-b302e6222f49) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:47:02.119724 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [None req-cc44387c-eae8-48fd-a5c4-17394b96a291 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] device_id is not set on port d7f087f7-3884-412f-a4e6-bad076382a4d yet. {{(pid=103437) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:47:02.236209 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c678c740-f158-4cf7-a999-7034ebd79749 None None] For port c1842a9b-5a72-429c-b0ed-b302e6222f49, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c1842a9b-5a72-429c-b0ed-b302e6222f49,segment=NetworkSegment(90ddd048-63c0-4062-82f8-78fcca8ae490),segment_id=90ddd048-63c0-4062-82f8-78fcca8ae490)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:02.274629 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c678c740-f158-4cf7-a999-7034ebd79749 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:02.280476 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c678c740-f158-4cf7-a999-7034ebd79749 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:02.353588 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-cc44387c-eae8-48fd-a5c4-17394b96a291 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Allocated IP 2001:db8::191 (6150e6df-2b72-4f1d-912c-2256eb16e2b3/e62590de-6d95-4243-9280-9d21a4de72ba/d7f087f7-3884-412f-a4e6-bad076382a4d) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:47:02.390828 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c678c740-f158-4cf7-a999-7034ebd79749 None None] Pushing event updated for resources: {'Port': ['ID=c1842a9b-5a72-429c-b0ed-b302e6222f49,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:02.486141 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44232) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:02.591798 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cc44387c-eae8-48fd-a5c4-17394b96a291 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:02.645511 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cc44387c-eae8-48fd-a5c4-17394b96a291 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:02.687106 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6cf1c58-dddc-4224-af44-e60fc2918f03 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:02.720903 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc44387c-eae8-48fd-a5c4-17394b96a291 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:47:02.726516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-cc44387c-eae8-48fd-a5c4-17394b96a291 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:02.730608 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc44387c-eae8-48fd-a5c4-17394b96a291 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:47:02.734191 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c1842a9b-5a72-429c-b0ed-b302e6222f49 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:47:02.737080 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc44387c-eae8-48fd-a5c4-17394b96a291 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:02.738870 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cc44387c-eae8-48fd-a5c4-17394b96a291 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:02.764083 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc44387c-eae8-48fd-a5c4-17394b96a291 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Port': ['ID=d7f087f7-3884-412f-a4e6-bad076382a4d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:02.774993 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cc44387c-eae8-48fd-a5c4-17394b96a291 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 931 time: 0.8568499 Dec 09 21:47:02.775638 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44246) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:02.786560 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a8342870-08d6-4472-a526-c6e8c93d41dc tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'subnet': {'network_id': '6150e6df-2b72-4f1d-912c-2256eb16e2b3', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:02.846961 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6cf1c58-dddc-4224-af44-e60fc2918f03 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:02.859351 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6cf1c58-dddc-4224-af44-e60fc2918f03 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:02.878659 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port c1842a9b-5a72-429c-b0ed-b302e6222f49 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:02.880828 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:02.947894 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6cf1c58-dddc-4224-af44-e60fc2918f03 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=368637b0-e5c9-40ce-aac0-463f3a7e77af,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:02.952904 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d6cf1c58-dddc-4224-af44-e60fc2918f03 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=f4f14f05bcab4ace87cc96ca89491f66&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4641213 Dec 09 21:47:02.955290 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44260) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:03.010322 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-39a6f578-8158-411d-b126-c5851225f7d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:03.011013 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a8342870-08d6-4472-a526-c6e8c93d41dc tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:47:03.016605 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8342870-08d6-4472-a526-c6e8c93d41dc tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:03.016978 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0551bf9b-5db6-4e38-90f7-634a3ae063b0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:03.063263 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0551bf9b-5db6-4e38-90f7-634a3ae063b0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:03.155381 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0551bf9b-5db6-4e38-90f7-634a3ae063b0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:03.156076 n-d-713301-27 neutron-server[103437]: INFO neutron.db.ipam_backend_mixin [None req-a8342870-08d6-4472-a526-c6e8c93d41dc tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Validation for CIDR: 2001:db8::/64 failed - overlaps with subnet e62590de-6d95-4243-9280-9d21a4de72ba (CIDR: 2001:db8::/64) Dec 09 21:47:03.159665 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0551bf9b-5db6-4e38-90f7-634a3ae063b0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:03.161487 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0551bf9b-5db6-4e38-90f7-634a3ae063b0 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/368637b0-e5c9-40ce-aac0-463f3a7e77af HTTP/1.1" status: 204 len: 168 time: 0.2046192 Dec 09 21:47:03.165576 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-a8342870-08d6-4472-a526-c6e8c93d41dc tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:47:03.166141 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a8342870-08d6-4472-a526-c6e8c93d41dc tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:47:03.171115 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0551bf9b-5db6-4e38-90f7-634a3ae063b0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=368637b0-e5c9-40ce-aac0-463f3a7e77af,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:03.193014 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a8342870-08d6-4472-a526-c6e8c93d41dc tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 424 time: 0.4154589 Dec 09 21:47:03.193647 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44272) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:03.199071 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-6ceb9e4f-afd8-4a7c-bf5b-5c1621d1409a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'subnet': {'network_id': '6150e6df-2b72-4f1d-912c-2256eb16e2b3', 'cidr': '2001:db8:0:1::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:1::1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:03.361364 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6ceb9e4f-afd8-4a7c-bf5b-5c1621d1409a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:47:03.366556 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6ceb9e4f-afd8-4a7c-bf5b-5c1621d1409a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:03.503120 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44282) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:03.516859 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-09a6dec1-f0c9-4a31-9504-70fcd106e593 None None] Provisioning complete for port c1842a9b-5a72-429c-b0ed-b302e6222f49 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:03.517239 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-09a6dec1-f0c9-4a31-9504-70fcd106e593 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:03.558568 n-d-713301-27 neutron-server[103438]: INFO neutron.db.ipam_backend_mixin [None req-6ceb9e4f-afd8-4a7c-bf5b-5c1621d1409a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Validation for CIDR: 2001:db8:0:1::/64 failed - overlaps with subnet aa8d5942-a972-4fe2-aee5-51f0e0c4748f (CIDR: 2001:db8:0:1::/64) Dec 09 21:47:03.565376 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-6ceb9e4f-afd8-4a7c-bf5b-5c1621d1409a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] POST failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 21:47:03.565838 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-6ceb9e4f-afd8-4a7c-bf5b-5c1621d1409a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] No notification will be sent due to unsuccessful status code: 400 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:47:03.600090 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44286) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:03.600537 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6ceb9e4f-afd8-4a7c-bf5b-5c1621d1409a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 400 len: 428 time: 0.4053352 Dec 09 21:47:03.607327 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2f06b9ff-17e7-451b-95ca-9486f0d5cf6b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'subnet': {'network_id': '6150e6df-2b72-4f1d-912c-2256eb16e2b3', 'cidr': '2001:db8:0:2::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:2::1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:03.659216 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44288) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:03.679788 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e1cb0af-a380-4874-b84c-a1f4797dbf55 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:03.721291 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-09a6dec1-f0c9-4a31-9504-70fcd106e593 None None] Provisioning complete for port 925975a6-f699-4323-8c8c-4f06e77fe8b2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:03.722243 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-09a6dec1-f0c9-4a31-9504-70fcd106e593 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:03.768341 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83b35b9a-3849-47fa-b7fa-3c3b7fe292f9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:03.803957 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-09a6dec1-f0c9-4a31-9504-70fcd106e593 None None] Port 925975a6-f699-4323-8c8c-4f06e77fe8b2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:47:03.816228 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e1cb0af-a380-4874-b84c-a1f4797dbf55 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:03.829086 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e1cb0af-a380-4874-b84c-a1f4797dbf55 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:03.857591 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e1cb0af-a380-4874-b84c-a1f4797dbf55 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bc96ab42-9816-43c0-89ea-000f71d25abc,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:03.884153 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83b35b9a-3849-47fa-b7fa-3c3b7fe292f9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:03.889856 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83b35b9a-3849-47fa-b7fa-3c3b7fe292f9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:03.893631 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2e1cb0af-a380-4874-b84c-a1f4797dbf55 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=699aedf68236410f8d5cd280ac5ebe94&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2319398 Dec 09 21:47:03.896152 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44290) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:03.902199 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2f06b9ff-17e7-451b-95ca-9486f0d5cf6b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Made reservation on behalf of 9560c66e717c47918bfe698e159759c5 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:47:03.907048 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f06b9ff-17e7-451b-95ca-9486f0d5cf6b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:03.928161 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ea7d2d19-e629-4c9f-a276-6459fe9f5bac None None] Provisioning complete for port d7f087f7-3884-412f-a4e6-bad076382a4d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:03.928671 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ea7d2d19-e629-4c9f-a276-6459fe9f5bac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:03.959833 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78098953-f8fa-4534-acde-771dd77dc55e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:03.970748 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-83b35b9a-3849-47fa-b7fa-3c3b7fe292f9 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=f55c68606b0843dd80e4a35890d81a9d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4664114 Dec 09 21:47:03.973570 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44292) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:03.978038 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ea7d2d19-e629-4c9f-a276-6459fe9f5bac None None] Port d7f087f7-3884-412f-a4e6-bad076382a4d cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:47:03.983390 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83b35b9a-3849-47fa-b7fa-3c3b7fe292f9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9aa32d00-5b77-4a77-8364-992b96b7152a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:03.992617 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78098953-f8fa-4534-acde-771dd77dc55e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:04.028369 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83b35b9a-3849-47fa-b7fa-3c3b7fe292f9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:04.028369 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83b35b9a-3849-47fa-b7fa-3c3b7fe292f9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:04.028369 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83b35b9a-3849-47fa-b7fa-3c3b7fe292f9 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:04.028369 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83b35b9a-3849-47fa-b7fa-3c3b7fe292f9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:04.028737 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83b35b9a-3849-47fa-b7fa-3c3b7fe292f9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:04.028910 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83b35b9a-3849-47fa-b7fa-3c3b7fe292f9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:04.029220 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83b35b9a-3849-47fa-b7fa-3c3b7fe292f9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:04.029546 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83b35b9a-3849-47fa-b7fa-3c3b7fe292f9 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:04.029872 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83b35b9a-3849-47fa-b7fa-3c3b7fe292f9 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:04.030199 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83b35b9a-3849-47fa-b7fa-3c3b7fe292f9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:04.030553 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83b35b9a-3849-47fa-b7fa-3c3b7fe292f9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:04.030914 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83b35b9a-3849-47fa-b7fa-3c3b7fe292f9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:04.031316 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-83b35b9a-3849-47fa-b7fa-3c3b7fe292f9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:04.049033 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78098953-f8fa-4534-acde-771dd77dc55e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:04.053858 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78098953-f8fa-4534-acde-771dd77dc55e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:04.055085 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-78098953-f8fa-4534-acde-771dd77dc55e admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/bc96ab42-9816-43c0-89ea-000f71d25abc HTTP/1.1" status: 204 len: 168 time: 0.1579478 Dec 09 21:47:04.064250 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78098953-f8fa-4534-acde-771dd77dc55e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bc96ab42-9816-43c0-89ea-000f71d25abc,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:04.108060 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-17f90005-8aef-467d-82fa-e2bc0f638312 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:04.138788 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-17f90005-8aef-467d-82fa-e2bc0f638312 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:04.258764 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-17f90005-8aef-467d-82fa-e2bc0f638312 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:04.261358 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-17f90005-8aef-467d-82fa-e2bc0f638312 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:04.262904 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-17f90005-8aef-467d-82fa-e2bc0f638312 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/9aa32d00-5b77-4a77-8364-992b96b7152a HTTP/1.1" status: 204 len: 168 time: 0.2885714 Dec 09 21:47:04.274637 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17f90005-8aef-467d-82fa-e2bc0f638312 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9aa32d00-5b77-4a77-8364-992b96b7152a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:04.321248 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f06b9ff-17e7-451b-95ca-9486f0d5cf6b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:04.364557 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f06b9ff-17e7-451b-95ca-9486f0d5cf6b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:47:04.367929 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-2f06b9ff-17e7-451b-95ca-9486f0d5cf6b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:04.372783 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f06b9ff-17e7-451b-95ca-9486f0d5cf6b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:04.373386 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f06b9ff-17e7-451b-95ca-9486f0d5cf6b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:04.382425 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3a1c1a6-8d0e-4a2b-ac4d-f03efea223ce None None] Network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:47:04.393377 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f06b9ff-17e7-451b-95ca-9486f0d5cf6b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Subnet': ['ID=3eaf632c-23bd-49b6-acc2-149fec09dca8,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:04.411581 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44302) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:04.411774 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2f06b9ff-17e7-451b-95ca-9486f0d5cf6b tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 836 time: 0.8103743 Dec 09 21:47:04.417392 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-ecdabc87-eaa0-4370-b661-38f4c77f8368 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Request body: {'port': {'name': 'tempest-PortsIpV6TestJSON-1173985441', 'admin_state_up': False, 'fixed_ips': [{'subnet_id': '3eaf632c-23bd-49b6-acc2-149fec09dca8'}], 'security_groups': ['18113485-f185-4473-a82e-f002661a46e5', 'c7673565-1683-4c76-8324-f77ae0df5ec9']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:04.650017 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ecdabc87-eaa0-4370-b661-38f4c77f8368 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:04.671066 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46dce850-e991-42ce-a300-efefcfd77b98 None None] Update dhcp port {'port': {'network_id': '6150e6df-2b72-4f1d-912c-2256eb16e2b3', 'fixed_ips': [{'subnet_id': 'aa8d5942-a972-4fe2-aee5-51f0e0c4748f', 'ip_address': '2001:db8:0:1::2'}, {'subnet_id': 'e62590de-6d95-4243-9280-9d21a4de72ba', 'ip_address': '2001:db8::2'}, {'subnet_id': '3eaf632c-23bd-49b6-acc2-149fec09dca8'}], 'binding:host_id': 'n-d-713301-27'}, 'id': 'c1842a9b-5a72-429c-b0ed-b302e6222f49'} from n-d-713301-27. {{(pid=103439) update_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:339}} Dec 09 21:47:04.729879 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-46dce850-e991-42ce-a300-efefcfd77b98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:04.909109 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44320) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:04.932876 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d0c47140-63c4-4540-a6ca-61c5cd90482b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:04.990360 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-46dce850-e991-42ce-a300-efefcfd77b98 None None] Allocated IP 2001:db8:0:2::2 (6150e6df-2b72-4f1d-912c-2256eb16e2b3/3eaf632c-23bd-49b6-acc2-149fec09dca8/c1842a9b-5a72-429c-b0ed-b302e6222f49) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:47:05.058041 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d0c47140-63c4-4540-a6ca-61c5cd90482b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:05.064153 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d0c47140-63c4-4540-a6ca-61c5cd90482b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:05.107815 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d0c47140-63c4-4540-a6ca-61c5cd90482b admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=589f140be82945d481f6d21dac571a34&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1953278 Dec 09 21:47:05.110855 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44326) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:05.134461 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-46dce850-e991-42ce-a300-efefcfd77b98 None None] For port c1842a9b-5a72-429c-b0ed-b302e6222f49, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c1842a9b-5a72-429c-b0ed-b302e6222f49,segment=NetworkSegment(90ddd048-63c0-4062-82f8-78fcca8ae490),segment_id=90ddd048-63c0-4062-82f8-78fcca8ae490)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:05.157462 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0c47140-63c4-4540-a6ca-61c5cd90482b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eea8dbfc-9c76-40e8-8393-03b26c1e64fa,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:05.202844 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8b07eb6-65d7-4e03-be1c-b7506dc6f915 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:05.227787 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8b07eb6-65d7-4e03-be1c-b7506dc6f915 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:05.286416 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8b07eb6-65d7-4e03-be1c-b7506dc6f915 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:05.289298 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8b07eb6-65d7-4e03-be1c-b7506dc6f915 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:05.291528 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d8b07eb6-65d7-4e03-be1c-b7506dc6f915 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/eea8dbfc-9c76-40e8-8393-03b26c1e64fa HTTP/1.1" status: 204 len: 168 time: 0.1783586 Dec 09 21:47:05.303978 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8b07eb6-65d7-4e03-be1c-b7506dc6f915 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eea8dbfc-9c76-40e8-8393-03b26c1e64fa,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:05.389799 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-46dce850-e991-42ce-a300-efefcfd77b98 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:05.397249 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-46dce850-e991-42ce-a300-efefcfd77b98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:05.537696 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46dce850-e991-42ce-a300-efefcfd77b98 None None] Pushing event updated for resources: {'Port': ['ID=c1842a9b-5a72-429c-b0ed-b302e6222f49,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:05.582995 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9f5b8760-e992-4ca2-9220-6710dbbcf6b0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:05.635998 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-ecdabc87-eaa0-4370-b661-38f4c77f8368 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Delete allocated IP 2001:db8::191 (6150e6df-2b72-4f1d-912c-2256eb16e2b3/e62590de-6d95-4243-9280-9d21a4de72ba) {{(pid=103438) _delete_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:118}} Dec 09 21:47:05.652942 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-ecdabc87-eaa0-4370-b661-38f4c77f8368 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Allocated IP 2001:db8:0:2::2b9 (6150e6df-2b72-4f1d-912c-2256eb16e2b3/3eaf632c-23bd-49b6-acc2-149fec09dca8/d7f087f7-3884-412f-a4e6-bad076382a4d) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:47:05.938794 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ecdabc87-eaa0-4370-b661-38f4c77f8368 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:05.945943 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ecdabc87-eaa0-4370-b661-38f4c77f8368 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:06.033406 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-ecdabc87-eaa0-4370-b661-38f4c77f8368 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] In _notify_port_updated(), no bound segment for port d7f087f7-3884-412f-a4e6-bad076382a4d on network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 {{(pid=103438) _notify_port_updated /opt/stack/neutron/neutron/plugins/ml2/plugin.py:877}} Dec 09 21:47:06.039841 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ecdabc87-eaa0-4370-b661-38f4c77f8368 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:06.040582 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ecdabc87-eaa0-4370-b661-38f4c77f8368 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:06.042149 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ecdabc87-eaa0-4370-b661-38f4c77f8368 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "PUT /v2.0/ports/d7f087f7-3884-412f-a4e6-bad076382a4d HTTP/1.1" status: 200 len: 970 time: 1.6293633 Dec 09 21:47:06.044908 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44354) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:06.073165 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecdabc87-eaa0-4370-b661-38f4c77f8368 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event updated for resources: {'Port': ['ID=d7f087f7-3884-412f-a4e6-bad076382a4d,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:06.169477 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-759ba29d-a125-49f4-86aa-0aee1544011c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting port d7f087f7-3884-412f-a4e6-bad076382a4d {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:47:06.169831 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-759ba29d-a125-49f4-86aa-0aee1544011c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:06.285305 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-759ba29d-a125-49f4-86aa-0aee1544011c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:06.303048 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-759ba29d-a125-49f4-86aa-0aee1544011c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Calling delete_port for d7f087f7-3884-412f-a4e6-bad076382a4d owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:47:06.433050 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5cdc4358-25b6-47b0-8de3-b2cddad904fb None None] Provisioning complete for port d7f087f7-3884-412f-a4e6-bad076382a4d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:06.433502 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5cdc4358-25b6-47b0-8de3-b2cddad904fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:06.475648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-5cdc4358-25b6-47b0-8de3-b2cddad904fb None None] Port d7f087f7-3884-412f-a4e6-bad076382a4d cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:47:06.483937 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-759ba29d-a125-49f4-86aa-0aee1544011c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:06.497812 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5cdc4358-25b6-47b0-8de3-b2cddad904fb None None] Provisioning complete for port c1842a9b-5a72-429c-b0ed-b302e6222f49 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:06.498586 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5cdc4358-25b6-47b0-8de3-b2cddad904fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:06.527338 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-759ba29d-a125-49f4-86aa-0aee1544011c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Port': ['ID=d7f087f7-3884-412f-a4e6-bad076382a4d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:06.569497 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-759ba29d-a125-49f4-86aa-0aee1544011c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:06.578451 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-759ba29d-a125-49f4-86aa-0aee1544011c tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/ports/d7f087f7-3884-412f-a4e6-bad076382a4d HTTP/1.1" status: 204 len: 168 time: 0.5296412 Dec 09 21:47:06.578872 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44374) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:06.638158 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-977b7423-ecbe-4fa5-b7c4-f9fa85a7d6fd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] GET failed (client error): The resource could not be found. Dec 09 21:47:06.642995 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44382) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:06.658706 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-977b7423-ecbe-4fa5-b7c4-f9fa85a7d6fd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports/d7f087f7-3884-412f-a4e6-bad076382a4d HTTP/1.1" status: 404 len: 333 time: 0.0597374 Dec 09 21:47:06.693085 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:06.700198 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5cdc4358-25b6-47b0-8de3-b2cddad904fb None None] Provisioning complete for port 925975a6-f699-4323-8c8c-4f06e77fe8b2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:06.700769 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5cdc4358-25b6-47b0-8de3-b2cddad904fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:06.757083 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-5cdc4358-25b6-47b0-8de3-b2cddad904fb None None] Port 925975a6-f699-4323-8c8c-4f06e77fe8b2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:47:06.792776 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c1842a9b-5a72-429c-b0ed-b302e6222f49 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:47:06.796544 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae0b6bfb-6680-4718-be3f-940ffd11a1ea tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:06.865008 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae0b6bfb-6680-4718-be3f-940ffd11a1ea tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:06.883679 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-96565834-8094-4dce-9bbb-fb7c2ac31727 None None] Could not find standard attr ID for object d7f087f7-3884-412f-a4e6-bad076382a4d. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:47:06.914942 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port c1842a9b-5a72-429c-b0ed-b302e6222f49 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:06.915312 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:07.073795 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae0b6bfb-6680-4718-be3f-940ffd11a1ea tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:07.080869 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae0b6bfb-6680-4718-be3f-940ffd11a1ea tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:07.091321 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44410) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:07.092633 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ae0b6bfb-6680-4718-be3f-940ffd11a1ea tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/security-groups/d25919f6-6085-4fae-972f-5da56f7b210f HTTP/1.1" status: 204 len: 168 time: 0.4444273 Dec 09 21:47:07.121392 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae0b6bfb-6680-4718-be3f-940ffd11a1ea tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d25919f6-6085-4fae-972f-5da56f7b210f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:07.231267 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fc2ed092-17b7-44b1-af19-29b3bcaca2cd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:07.272332 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fc2ed092-17b7-44b1-af19-29b3bcaca2cd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:07.348967 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fc2ed092-17b7-44b1-af19-29b3bcaca2cd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:07.352331 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fc2ed092-17b7-44b1-af19-29b3bcaca2cd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:07.356651 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44426) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:07.363153 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fc2ed092-17b7-44b1-af19-29b3bcaca2cd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/security-groups/c7673565-1683-4c76-8324-f77ae0df5ec9 HTTP/1.1" status: 204 len: 168 time: 0.2702923 Dec 09 21:47:07.422225 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-33a98d92-4cff-4e7f-ab2f-450b4cf15699 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:07.446972 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-33a98d92-4cff-4e7f-ab2f-450b4cf15699 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:07.477553 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc2ed092-17b7-44b1-af19-29b3bcaca2cd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c7673565-1683-4c76-8324-f77ae0df5ec9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:07.521405 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-33a98d92-4cff-4e7f-ab2f-450b4cf15699 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:07.522108 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35750582-4f04-449f-998b-0c6c1c3f5e93 req-1a451c9e-7967-4f37-b95e-687c36efc28b tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:07.523770 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35750582-4f04-449f-998b-0c6c1c3f5e93 req-1a451c9e-7967-4f37-b95e-687c36efc28b tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/ports?device_id=3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f HTTP/1.1" status: 200 len: 950 time: 0.1554143 Dec 09 21:47:07.525955 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-33a98d92-4cff-4e7f-ab2f-450b4cf15699 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:07.527451 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-33a98d92-4cff-4e7f-ab2f-450b4cf15699 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/security-groups/18113485-f185-4473-a82e-f002661a46e5 HTTP/1.1" status: 204 len: 168 time: 0.1695836 Dec 09 21:47:07.530190 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44434) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:07.544278 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33a98d92-4cff-4e7f-ab2f-450b4cf15699 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=18113485-f185-4473-a82e-f002661a46e5,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:07.546341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44436) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:07.634902 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-dda5bc34-6028-4de2-97b9-2a953d9b1b66 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting subnet e62590de-6d95-4243-9280-9d21a4de72ba {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:47:07.643987 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dda5bc34-6028-4de2-97b9-2a953d9b1b66 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:07.694404 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35750582-4f04-449f-998b-0c6c1c3f5e93 req-42581ea0-238b-434c-b637-d0b433bf03a5 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/security-groups?id=70b6e8f6-3793-4fd9-91c8-b7d3cb7e3581&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1553771 Dec 09 21:47:07.702444 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dda5bc34-6028-4de2-97b9-2a953d9b1b66 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:07.803785 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-180c3441-6e0b-485a-8e95-6f40f027b9c5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:07.813351 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dda5bc34-6028-4de2-97b9-2a953d9b1b66 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:07.893798 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dda5bc34-6028-4de2-97b9-2a953d9b1b66 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:07.908576 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-180c3441-6e0b-485a-8e95-6f40f027b9c5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:07.912515 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dda5bc34-6028-4de2-97b9-2a953d9b1b66 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:07.916300 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-dda5bc34-6028-4de2-97b9-2a953d9b1b66 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/subnets/e62590de-6d95-4243-9280-9d21a4de72ba HTTP/1.1" status: 204 len: 168 time: 0.3850546 Dec 09 21:47:07.921910 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15cfe82c-bc67-474d-8ffa-470db823067e None None] Network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:47:07.923071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44450) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:07.931915 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-180c3441-6e0b-485a-8e95-6f40f027b9c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:07.962817 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dda5bc34-6028-4de2-97b9-2a953d9b1b66 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Subnet': ['ID=e62590de-6d95-4243-9280-9d21a4de72ba,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:08.022150 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44456) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:08.022349 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-180c3441-6e0b-485a-8e95-6f40f027b9c5 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=0ceb5418f5784e34aca2bd7cb14d3c88&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4744902 Dec 09 21:47:08.025312 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-180c3441-6e0b-485a-8e95-6f40f027b9c5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c8aabf98-fa6a-4043-9211-ee7d1fbd3063,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:08.035337 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-f8b4a86a-4da6-43ac-8da4-091349a72cdd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting subnet 3eaf632c-23bd-49b6-acc2-149fec09dca8 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:47:08.038927 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8b4a86a-4da6-43ac-8da4-091349a72cdd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:08.103652 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:08.107144 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8b4a86a-4da6-43ac-8da4-091349a72cdd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:08.118290 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e1da7f2-21c5-4d0c-ad64-43d5794b4c12 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:08.149646 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e1da7f2-21c5-4d0c-ad64-43d5794b4c12 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:08.220448 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e1da7f2-21c5-4d0c-ad64-43d5794b4c12 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:08.223887 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e1da7f2-21c5-4d0c-ad64-43d5794b4c12 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:08.230108 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2e1da7f2-21c5-4d0c-ad64-43d5794b4c12 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/c8aabf98-fa6a-4043-9211-ee7d1fbd3063 HTTP/1.1" status: 204 len: 168 time: 0.2060037 Dec 09 21:47:08.248415 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e1da7f2-21c5-4d0c-ad64-43d5794b4c12 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c8aabf98-fa6a-4043-9211-ee7d1fbd3063,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:08.263501 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8b4a86a-4da6-43ac-8da4-091349a72cdd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:08.380550 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8b4a86a-4da6-43ac-8da4-091349a72cdd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:08.424588 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8b4a86a-4da6-43ac-8da4-091349a72cdd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Subnet': ['ID=3eaf632c-23bd-49b6-acc2-149fec09dca8,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:08.432925 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8b4a86a-4da6-43ac-8da4-091349a72cdd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:08.439030 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f8b4a86a-4da6-43ac-8da4-091349a72cdd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/subnets/3eaf632c-23bd-49b6-acc2-149fec09dca8 HTTP/1.1" status: 204 len: 168 time: 0.5147128 Dec 09 21:47:08.440801 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44462) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:08.472614 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-b246184c-7f07-49b5-8f16-718e6c800b1f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] DELETE failed (client error): The resource could not be found. Dec 09 21:47:08.473106 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b246184c-7f07-49b5-8f16-718e6c800b1f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:47:08.476546 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b246184c-7f07-49b5-8f16-718e6c800b1f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/subnets/e62590de-6d95-4243-9280-9d21a4de72ba HTTP/1.1" status: 404 len: 337 time: 0.0347393 Dec 09 21:47:08.479137 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44468) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:08.546830 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-a1069468-bf58-4967-8f4c-fe6a7a1c8af5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting subnet aa8d5942-a972-4fe2-aee5-51f0e0c4748f {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:47:08.551967 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a1069468-bf58-4967-8f4c-fe6a7a1c8af5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:08.623072 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a1069468-bf58-4967-8f4c-fe6a7a1c8af5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:08.661210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44482) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:08.678924 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6af65d3b-5fc3-4a08-89f7-775f7690d578 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:08.751051 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a1069468-bf58-4967-8f4c-fe6a7a1c8af5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:08.844841 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04c83411-f920-46a0-a574-13468df64448 req-c0487928-f1c5-4a3c-bc0f-10ebe1a57918 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:08.846622 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-04c83411-f920-46a0-a574-13468df64448 req-c0487928-f1c5-4a3c-bc0f-10ebe1a57918 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.31 "GET /v2.0/ports?device_id=3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f HTTP/1.1" status: 200 len: 950 time: 0.1096663 Dec 09 21:47:08.851868 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6af65d3b-5fc3-4a08-89f7-775f7690d578 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:08.862554 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6af65d3b-5fc3-4a08-89f7-775f7690d578 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:08.892730 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a1069468-bf58-4967-8f4c-fe6a7a1c8af5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:08.921410 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-727766a5-e0fb-4547-9d28-be3efdf8817d req-5e512c8b-dd68-4023-bd56-8fb64a16f5be tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:08.923261 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-727766a5-e0fb-4547-9d28-be3efdf8817d req-5e512c8b-dd68-4023-bd56-8fb64a16f5be tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/ports?device_id=3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f HTTP/1.1" status: 200 len: 950 time: 0.1046395 Dec 09 21:47:08.929617 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6af65d3b-5fc3-4a08-89f7-775f7690d578 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=547e905997dc47f7b7a10f8c1b1a3f27&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2648041 Dec 09 21:47:08.929617 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6af65d3b-5fc3-4a08-89f7-775f7690d578 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=945ff76d-0cad-40eb-b2c8-5896e0caa965,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:08.929896 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1069468-bf58-4967-8f4c-fe6a7a1c8af5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Subnet': ['ID=aa8d5942-a972-4fe2-aee5-51f0e0c4748f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:08.931077 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44492) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:08.947890 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a1069468-bf58-4967-8f4c-fe6a7a1c8af5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:08.953248 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a1069468-bf58-4967-8f4c-fe6a7a1c8af5 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/subnets/aa8d5942-a972-4fe2-aee5-51f0e0c4748f HTTP/1.1" status: 204 len: 168 time: 0.4730220 Dec 09 21:47:08.953902 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44494) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:09.000145 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-5aeb52fd-c066-4028-acc6-f7d975a596d1 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] DELETE failed (client error): The resource could not be found. Dec 09 21:47:09.000663 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5aeb52fd-c066-4028-acc6-f7d975a596d1 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:47:09.006391 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5aeb52fd-c066-4028-acc6-f7d975a596d1 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/subnets/56586736-60cb-4ca8-9537-386161633267 HTTP/1.1" status: 404 len: 337 time: 0.0343978 Dec 09 21:47:09.009004 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44498) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:09.032446 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-727766a5-e0fb-4547-9d28-be3efdf8817d req-d462e5c1-2ad1-49cc-a928-47d719471936 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/security-groups?id=70b6e8f6-3793-4fd9-91c8-b7d3cb7e3581&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0719378 Dec 09 21:47:09.043548 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d976417f-b220-4abc-b197-57e0f5afb6cd tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "GET /v2.0/ports?device_id=9ef1a7ca-960f-4dd6-97ec-471295ef47a4 HTTP/1.1" status: 200 len: 205 time: 0.0336649 Dec 09 21:47:09.044009 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44500) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:09.064501 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-04c83411-f920-46a0-a574-13468df64448 req-f065574e-bd16-4117-b2a1-84d4d92ca6b6 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Deleting port cfd5c800-4c6d-4766-9675-137da0da42a4 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:47:09.064854 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-04c83411-f920-46a0-a574-13468df64448 req-f065574e-bd16-4117-b2a1-84d4d92ca6b6 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:09.091484 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-fef746dd-24d5-4b53-8e13-d0805568839a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] delete failed (client error): The resource could not be found. Dec 09 21:47:09.092647 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fef746dd-24d5-4b53-8e13-d0805568839a tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/routers/9ef1a7ca-960f-4dd6-97ec-471295ef47a4 HTTP/1.1" status: 404 len: 336 time: 0.0476053 Dec 09 21:47:09.093548 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c4d46ad8-f9d7-47e5-8216-3ebbc12ac589 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:09.095303 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44502) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:09.106743 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a59808cc-af77-4c10-ae19-4f586769f59f None None] Network 6150e6df-2b72-4f1d-912c-2256eb16e2b3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:47:09.132648 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44504) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:09.142006 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-a6e65f9f-4182-4a5d-9e90-945adc469d02 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] DELETE failed (client error): The resource could not be found. Dec 09 21:47:09.142593 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a6e65f9f-4182-4a5d-9e90-945adc469d02 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:47:09.147837 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a6e65f9f-4182-4a5d-9e90-945adc469d02 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/subnets/87930927-d6e3-4d98-8aa9-af986c45aa6e HTTP/1.1" status: 404 len: 337 time: 0.0483482 Dec 09 21:47:09.150481 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44508) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:09.162108 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c4d46ad8-f9d7-47e5-8216-3ebbc12ac589 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:09.183315 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-04c83411-f920-46a0-a574-13468df64448 req-f065574e-bd16-4117-b2a1-84d4d92ca6b6 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] For port cfd5c800-4c6d-4766-9675-137da0da42a4, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=cfd5c800-4c6d-4766-9675-137da0da42a4,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:09.183916 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-04c83411-f920-46a0-a574-13468df64448 req-f065574e-bd16-4117-b2a1-84d4d92ca6b6 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:09.192985 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-e319d059-9b04-461f-afa6-ac2e23078682 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] DELETE failed (client error): The resource could not be found. Dec 09 21:47:09.193449 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e319d059-9b04-461f-afa6-ac2e23078682 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:47:09.196792 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e319d059-9b04-461f-afa6-ac2e23078682 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/subnets/c2cefd92-d863-4837-a455-bfc0adf031b5 HTTP/1.1" status: 404 len: 337 time: 0.0451770 Dec 09 21:47:09.197622 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-04c83411-f920-46a0-a574-13468df64448 req-f065574e-bd16-4117-b2a1-84d4d92ca6b6 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Calling delete_port for cfd5c800-4c6d-4766-9675-137da0da42a4 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:47:09.199162 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44510) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:09.233124 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-c2c3d511-3ceb-43b4-9e04-38b2ed13b191 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] DELETE failed (client error): The resource could not be found. Dec 09 21:47:09.233753 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d61ae68f-bf34-4945-889a-09ee8f46262c None None] Provisioning complete for port c1842a9b-5a72-429c-b0ed-b302e6222f49 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:09.233920 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c2c3d511-3ceb-43b4-9e04-38b2ed13b191 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:47:09.234124 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d61ae68f-bf34-4945-889a-09ee8f46262c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:09.237575 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c2c3d511-3ceb-43b4-9e04-38b2ed13b191 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/subnets/1fd20785-9486-417b-848f-c34ff54e52c2 HTTP/1.1" status: 404 len: 337 time: 0.0369742 Dec 09 21:47:09.240395 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44512) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:09.273327 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-7ed3a5dc-5c50-4432-88b6-8d36d3ce653e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] DELETE failed (client error): The resource could not be found. Dec 09 21:47:09.274228 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7ed3a5dc-5c50-4432-88b6-8d36d3ce653e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:47:09.278975 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7ed3a5dc-5c50-4432-88b6-8d36d3ce653e tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/ports/cc5a3659-d23d-4374-8336-6a87669cd379 HTTP/1.1" status: 404 len: 333 time: 0.0365558 Dec 09 21:47:09.281528 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44514) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:09.320159 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c4d46ad8-f9d7-47e5-8216-3ebbc12ac589 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:09.322808 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c4d46ad8-f9d7-47e5-8216-3ebbc12ac589 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:09.327239 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c4d46ad8-f9d7-47e5-8216-3ebbc12ac589 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/945ff76d-0cad-40eb-b2c8-5896e0caa965 HTTP/1.1" status: 204 len: 168 time: 0.3837841 Dec 09 21:47:09.328548 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-74a31ac8-3845-4ee8-9a2d-3a0723030005 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] DELETE failed (client error): The resource could not be found. Dec 09 21:47:09.328982 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-74a31ac8-3845-4ee8-9a2d-3a0723030005 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:47:09.335300 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-74a31ac8-3845-4ee8-9a2d-3a0723030005 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/subnets/847b3c93-b11e-46af-823b-8d3b7e224fdc HTTP/1.1" status: 404 len: 337 time: 0.0495851 Dec 09 21:47:09.335556 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44518) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:09.352304 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4d46ad8-f9d7-47e5-8216-3ebbc12ac589 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=945ff76d-0cad-40eb-b2c8-5896e0caa965,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:09.355827 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e5cbf8f3-e018-4a43-bb5d-8aa5e8d89fc2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:09.370388 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-64d6b7a3-72ed-47aa-a332-0668aab57e60 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] DELETE failed (client error): The resource could not be found. Dec 09 21:47:09.371147 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-64d6b7a3-72ed-47aa-a332-0668aab57e60 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:47:09.374839 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-64d6b7a3-72ed-47aa-a332-0668aab57e60 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/subnets/737542c6-b952-4ac7-a7d2-a0af01ac011c HTTP/1.1" status: 404 len: 337 time: 0.0387130 Dec 09 21:47:09.377313 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44520) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:09.378094 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c79b3f15-b017-47ee-8f39-11d66f032e26 None None] DHCP port deletion for 6150e6df-2b72-4f1d-912c-2256eb16e2b3 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:47:09.384363 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d61ae68f-bf34-4945-889a-09ee8f46262c None None] Provisioning complete for port 925975a6-f699-4323-8c8c-4f06e77fe8b2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:09.384827 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d61ae68f-bf34-4945-889a-09ee8f46262c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:09.406912 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-02a3f0bf-504e-4483-bf94-789e19535d4f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] DELETE failed (client error): The resource could not be found. Dec 09 21:47:09.407139 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-02a3f0bf-504e-4483-bf94-789e19535d4f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:47:09.411492 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-02a3f0bf-504e-4483-bf94-789e19535d4f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/ports/f92ac21c-4d11-4f0f-aba9-154665b598e2 HTTP/1.1" status: 404 len: 333 time: 0.0316169 Dec 09 21:47:09.413857 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44522) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:09.448129 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d61ae68f-bf34-4945-889a-09ee8f46262c None None] Port 925975a6-f699-4323-8c8c-4f06e77fe8b2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:47:09.452667 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-602c489d-7d79-4b6d-b9a9-76ffd16daba3 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] DELETE failed (client error): The resource could not be found. Dec 09 21:47:09.453216 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-602c489d-7d79-4b6d-b9a9-76ffd16daba3 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:47:09.456499 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-602c489d-7d79-4b6d-b9a9-76ffd16daba3 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/subnets/51badf76-fa18-44d6-82f5-fdafd2823781 HTTP/1.1" status: 404 len: 337 time: 0.0413530 Dec 09 21:47:09.459238 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44524) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:09.474096 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-c79b3f15-b017-47ee-8f39-11d66f032e26 None None] Deleting port c1842a9b-5a72-429c-b0ed-b302e6222f49 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:47:09.474523 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c79b3f15-b017-47ee-8f39-11d66f032e26 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:09.503256 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-7d39e751-a5d0-4f1e-805b-e0326039c072 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] DELETE failed (client error): The resource could not be found. Dec 09 21:47:09.503751 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-7d39e751-a5d0-4f1e-805b-e0326039c072 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:47:09.507161 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7d39e751-a5d0-4f1e-805b-e0326039c072 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/subnets/87d49a3f-16b8-4ea7-ae3f-24b99c39a002 HTTP/1.1" status: 404 len: 337 time: 0.0460725 Dec 09 21:47:09.509813 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44526) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:09.517805 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e5cbf8f3-e018-4a43-bb5d-8aa5e8d89fc2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:09.521805 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-04c83411-f920-46a0-a574-13468df64448 req-f065574e-bd16-4117-b2a1-84d4d92ca6b6 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:09.523635 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e5cbf8f3-e018-4a43-bb5d-8aa5e8d89fc2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:09.538501 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['cfd5c800-4c6d-4766-9675-137da0da42a4'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:47:09.576094 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e5cbf8f3-e018-4a43-bb5d-8aa5e8d89fc2 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=388ec93600fc42fa97273ce3c649c0ac&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4423256 Dec 09 21:47:09.577330 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5cbf8f3-e018-4a43-bb5d-8aa5e8d89fc2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ba9c026c-edc8-47e1-9094-b667f26e969a,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:09.580850 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44530) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:09.583980 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c79b3f15-b017-47ee-8f39-11d66f032e26 None None] For port c1842a9b-5a72-429c-b0ed-b302e6222f49, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c1842a9b-5a72-429c-b0ed-b302e6222f49,segment=NetworkSegment(90ddd048-63c0-4062-82f8-78fcca8ae490),segment_id=90ddd048-63c0-4062-82f8-78fcca8ae490)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:09.584568 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c79b3f15-b017-47ee-8f39-11d66f032e26 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:09.586160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f065574e-bd16-4117-b2a1-84d4d92ca6b6 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Pushing event deleted for resources: {'Port': ['ID=cfd5c800-4c6d-4766-9675-137da0da42a4,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:09.604499 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-c79b3f15-b017-47ee-8f39-11d66f032e26 None None] Calling delete_port for c1842a9b-5a72-429c-b0ed-b302e6222f49 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:47:09.643803 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fa56ac2b-751f-4de8-9319-25901c9f7e7d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:09.645695 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-04c83411-f920-46a0-a574-13468df64448 req-f065574e-bd16-4117-b2a1-84d4d92ca6b6 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] No DVR routers for this DVR port cfd5c800-4c6d-4766-9675-137da0da42a4 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:47:09.647667 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-04c83411-f920-46a0-a574-13468df64448 req-f065574e-bd16-4117-b2a1-84d4d92ca6b6 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:09.651903 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-04c83411-f920-46a0-a574-13468df64448 req-f065574e-bd16-4117-b2a1-84d4d92ca6b6 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.31 "DELETE /v2.0/ports/cfd5c800-4c6d-4766-9675-137da0da42a4 HTTP/1.1" status: 204 len: 173 time: 0.7979598 Dec 09 21:47:09.668102 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fa56ac2b-751f-4de8-9319-25901c9f7e7d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:09.689104 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f', 'name': 'network-vif-deleted', 'tag': 'cfd5c800-4c6d-4766-9675-137da0da42a4'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:47:09.691817 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2512c6f6-133c-48e5-ae41-32cec96f4d01" -d '{"events": [{"server_uuid": "3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f", "name": "network-vif-deleted", "tag": "cfd5c800-4c6d-4766-9675-137da0da42a4"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:47:09.705091 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:09.751273 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c79b3f15-b017-47ee-8f39-11d66f032e26 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:09.766627 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:47:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a49fd3b0-31e5-4a6e-8570-9d1565374de2 x-openstack-request-id: req-a49fd3b0-31e5-4a6e-8570-9d1565374de2 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:47:09.766913 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f", "name": "network-vif-deleted", "tag": "cfd5c800-4c6d-4766-9675-137da0da42a4", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:47:09.767172 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a49fd3b0-31e5-4a6e-8570-9d1565374de2 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:47:09.767600 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f', 'name': 'network-vif-deleted', 'tag': 'cfd5c800-4c6d-4766-9675-137da0da42a4', 'status': 'completed', 'code': 200} Dec 09 21:47:09.769382 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c04fc966-dc14-4e10-9ac2-3bd7768e6979 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Deleting port 925975a6-f699-4323-8c8c-4f06e77fe8b2 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:47:09.769727 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c04fc966-dc14-4e10-9ac2-3bd7768e6979 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:09.789861 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c79b3f15-b017-47ee-8f39-11d66f032e26 None None] No DVR routers for this DVR port c1842a9b-5a72-429c-b0ed-b302e6222f49 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:47:09.792926 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fa56ac2b-751f-4de8-9319-25901c9f7e7d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:09.798735 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fa56ac2b-751f-4de8-9319-25901c9f7e7d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:09.810803 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fa56ac2b-751f-4de8-9319-25901c9f7e7d admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/ba9c026c-edc8-47e1-9094-b667f26e969a HTTP/1.1" status: 204 len: 168 time: 0.2186525 Dec 09 21:47:09.818343 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c79b3f15-b017-47ee-8f39-11d66f032e26 None None] Pushing event deleted for resources: {'Port': ['ID=c1842a9b-5a72-429c-b0ed-b302e6222f49,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:09.831295 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa56ac2b-751f-4de8-9319-25901c9f7e7d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ba9c026c-edc8-47e1-9094-b667f26e969a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:09.901740 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c04fc966-dc14-4e10-9ac2-3bd7768e6979 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:09.916395 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c04fc966-dc14-4e10-9ac2-3bd7768e6979 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Calling delete_port for 925975a6-f699-4323-8c8c-4f06e77fe8b2 owned by {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:47:10.029434 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c04fc966-dc14-4e10-9ac2-3bd7768e6979 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:10.092269 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c04fc966-dc14-4e10-9ac2-3bd7768e6979 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Port': ['ID=925975a6-f699-4323-8c8c-4f06e77fe8b2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:10.101011 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c04fc966-dc14-4e10-9ac2-3bd7768e6979 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:10.105383 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c04fc966-dc14-4e10-9ac2-3bd7768e6979 tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/ports/925975a6-f699-4323-8c8c-4f06e77fe8b2 HTTP/1.1" status: 204 len: 168 time: 0.5942211 Dec 09 21:47:10.107734 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44552) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:10.259736 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8fb0a495-fd28-4a00-96f2-1e3eb13b2fc5 req-784669d2-ea6c-4261-a086-845a6582de24 tempest-VolumesBackupsTest-1978798811 tempest-VolumesBackupsTest-1978798811-project] 10.222.0.13 "GET /v2.0/ports?device_id=3abe24e0-f4a2-4f94-b41b-de6d0eba5e5f HTTP/1.1" status: 200 len: 210 time: 0.0651383 Dec 09 21:47:10.260171 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4b1397aa-473e-4965-b1b5-9e7c3022274f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:10.281463 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44558) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:10.295531 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-207b0711-49e9-4c54-aba1-965434d624b0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:10.349198 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44560) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:10.373391 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4b1397aa-473e-4965-b1b5-9e7c3022274f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:10.395789 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-4b1397aa-473e-4965-b1b5-9e7c3022274f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6150e6df-2b72-4f1d-912c-2256eb16e2b3']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:10.400671 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-207b0711-49e9-4c54-aba1-965434d624b0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:10.405980 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-4b1397aa-473e-4965-b1b5-9e7c3022274f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '90ddd048-63c0-4062-82f8-78fcca8ae490') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:10.406269 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-4b1397aa-473e-4965-b1b5-9e7c3022274f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '90ddd048-63c0-4062-82f8-78fcca8ae490') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:10.406715 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-207b0711-49e9-4c54-aba1-965434d624b0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:10.416630 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4b1397aa-473e-4965-b1b5-9e7c3022274f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:10.431116 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4b1397aa-473e-4965-b1b5-9e7c3022274f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:10.438495 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4b1397aa-473e-4965-b1b5-9e7c3022274f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Releasing vlan 133 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:47:10.438903 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4b1397aa-473e-4965-b1b5-9e7c3022274f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:10.440342 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-207b0711-49e9-4c54-aba1-965434d624b0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7bb238d6-e6b9-4f82-944d-42b785b821ec,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:47:10.442721 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:47:10.458683 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-207b0711-49e9-4c54-aba1-965434d624b0 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=220c691faf974b539f9d0febe49bf9c4&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1762366 Dec 09 21:47:10.461306 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44564) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:10.512324 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4b1397aa-473e-4965-b1b5-9e7c3022274f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:10.512805 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-58d553ca-634d-4b87-b584-6f543a364db6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:10.524748 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4b1397aa-473e-4965-b1b5-9e7c3022274f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:10.527992 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4b1397aa-473e-4965-b1b5-9e7c3022274f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] 10.222.0.13 "DELETE /v2.0/networks/6150e6df-2b72-4f1d-912c-2256eb16e2b3 HTTP/1.1" status: 204 len: 168 time: 0.4187424 Dec 09 21:47:10.540100 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b1397aa-473e-4965-b1b5-9e7c3022274f tempest-PortsIpV6TestJSON-1635740382 tempest-PortsIpV6TestJSON-1635740382-project] Pushing event deleted for resources: {'Network': ['ID=6150e6df-2b72-4f1d-912c-2256eb16e2b3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:10.541011 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-58d553ca-634d-4b87-b584-6f543a364db6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:10.555343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-f07750c0-6cdf-44a8-9e53-4aa171722acb admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1104733935-network', 'tenant_id': '2be7af74c5cc43908a744820a98fc9c0'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:10.597575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f07750c0-6cdf-44a8-9e53-4aa171722acb admin admin] Made reservation on behalf of 2be7af74c5cc43908a744820a98fc9c0 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:47:10.599959 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f07750c0-6cdf-44a8-9e53-4aa171722acb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:10.609667 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f07750c0-6cdf-44a8-9e53-4aa171722acb admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:10.623660 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-58d553ca-634d-4b87-b584-6f543a364db6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:10.626811 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-58d553ca-634d-4b87-b584-6f543a364db6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:10.630649 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-58d553ca-634d-4b87-b584-6f543a364db6 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/7bb238d6-e6b9-4f82-944d-42b785b821ec HTTP/1.1" status: 204 len: 168 time: 0.1656883 Dec 09 21:47:10.644193 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58d553ca-634d-4b87-b584-6f543a364db6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7bb238d6-e6b9-4f82-944d-42b785b821ec,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:10.716540 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c1842a9b-5a72-429c-b0ed-b302e6222f49 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:47:10.741792 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: c1842a9b-5a72-429c-b0ed-b302e6222f49 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:47:10.742245 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c1842a9b-5a72-429c-b0ed-b302e6222f49 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:47:10.771479 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f07750c0-6cdf-44a8-9e53-4aa171722acb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:10.776443 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f07750c0-6cdf-44a8-9e53-4aa171722acb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:10.795725 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44574) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:10.803968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f07750c0-6cdf-44a8-9e53-4aa171722acb admin admin] vlan segment allocate from pool success with {'vlan_id': 125, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:47:10.821759 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f07750c0-6cdf-44a8-9e53-4aa171722acb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6236a31a-7414-45a5-80b0-e5c8c72b2bb7,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:10.830794 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f07750c0-6cdf-44a8-9e53-4aa171722acb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:10.831195 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-f07750c0-6cdf-44a8-9e53-4aa171722acb admin admin] Added segment f4832b4c-9721-4fb3-b34b-0781180d5872 of type vlan for network 1f6c6308-b8f8-453f-b9f3-49b33791e0ee Dec 09 21:47:10.876258 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f07750c0-6cdf-44a8-9e53-4aa171722acb admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:10.907722 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f07750c0-6cdf-44a8-9e53-4aa171722acb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:10.908993 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f07750c0-6cdf-44a8-9e53-4aa171722acb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:10.909780 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f07750c0-6cdf-44a8-9e53-4aa171722acb admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:10.944897 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f07750c0-6cdf-44a8-9e53-4aa171722acb admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.5944965 Dec 09 21:47:10.947806 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44582) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:10.979958 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-abc23c48-0310-429d-bfda-11bd45f2bd52 admin admin] Request body: {'subnet': {'network_id': '1f6c6308-b8f8-453f-b9f3-49b33791e0ee', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1104733935-subnet', 'tenant_id': '2be7af74c5cc43908a744820a98fc9c0', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:10.995867 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f07750c0-6cdf-44a8-9e53-4aa171722acb admin admin] Pushing event updated for resources: {'Network': ['ID=1f6c6308-b8f8-453f-b9f3-49b33791e0ee,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:11.007169 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 1f6c6308-b8f8-453f-b9f3-49b33791e0ee details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:47:11.037185 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-abc23c48-0310-429d-bfda-11bd45f2bd52 admin admin] Made reservation on behalf of 2be7af74c5cc43908a744820a98fc9c0 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:47:11.039545 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-abc23c48-0310-429d-bfda-11bd45f2bd52 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:11.055327 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ee3f9ef4-40b0-46d9-94cf-6b00a9915f5f admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=9560c66e717c47918bfe698e159759c5&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2559166 Dec 09 21:47:11.058202 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44590) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:11.212581 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-abfcee3f-165c-4da5-b9fb-817ba77957ab admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:11.256815 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b13106aa-e191-4c73-b9ad-526a95ceea3b req-d646b276-31fd-48d8-a34c-12e1c978b737 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:11.258385 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b13106aa-e191-4c73-b9ad-526a95ceea3b req-d646b276-31fd-48d8-a34c-12e1c978b737 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 1098 time: 0.1071532 Dec 09 21:47:11.286072 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-abfcee3f-165c-4da5-b9fb-817ba77957ab admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:11.384806 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b13106aa-e191-4c73-b9ad-526a95ceea3b req-2b559917-e559-4f8c-81d8-42cb663b9b3c tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1127992 Dec 09 21:47:11.387392 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-abc23c48-0310-429d-bfda-11bd45f2bd52 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:11.411898 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44610) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:11.443967 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-abfcee3f-165c-4da5-b9fb-817ba77957ab admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:11.446521 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-abfcee3f-165c-4da5-b9fb-817ba77957ab admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:11.447875 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-abfcee3f-165c-4da5-b9fb-817ba77957ab admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/bb5edddb-522c-489c-9d37-df34fe67ba48 HTTP/1.1" status: 204 len: 168 time: 0.3883765 Dec 09 21:47:11.457635 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abc23c48-0310-429d-bfda-11bd45f2bd52 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1f76b74e-fb7e-4b78-bd58-a21de3f810b9,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:11.468288 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abfcee3f-165c-4da5-b9fb-817ba77957ab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bb5edddb-522c-489c-9d37-df34fe67ba48,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:11.479876 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-abc23c48-0310-429d-bfda-11bd45f2bd52 admin admin] Checking segment: {'id': 'f4832b4c-9721-4fb3-b34b-0781180d5872', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '1f6c6308-b8f8-453f-b9f3-49b33791e0ee'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:47:11.480242 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-abc23c48-0310-429d-bfda-11bd45f2bd52 admin admin] Network hostable DHCP agents. Network: 1f6c6308-b8f8-453f-b9f3-49b33791e0ee, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:47:11.517305 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-abc23c48-0310-429d-bfda-11bd45f2bd52 admin admin] Network 1f6c6308-b8f8-453f-b9f3-49b33791e0ee is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:47:11.538283 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-abc23c48-0310-429d-bfda-11bd45f2bd52 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 1f6c6308-b8f8-453f-b9f3-49b33791e0ee) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:11.547164 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-abc23c48-0310-429d-bfda-11bd45f2bd52 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:11.547800 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-abc23c48-0310-429d-bfda-11bd45f2bd52 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:11.548660 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-84e944d6-f46a-471a-91d8-d1a6287c609a None None] Network 1f6c6308-b8f8-453f-b9f3-49b33791e0ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:47:11.585031 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-abc23c48-0310-429d-bfda-11bd45f2bd52 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.6362243 Dec 09 21:47:11.772761 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c8c84ad4-bdc7-46a5-aaab-16edb38da06a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Deleting port ccec756b-58d9-42ec-aedd-629423cfcece {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:47:11.773115 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8c84ad4-bdc7-46a5-aaab-16edb38da06a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:11.776396 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4cf62053-4b79-40d2-8cf1-fa7155d45450 None None] Network 1f6c6308-b8f8-453f-b9f3-49b33791e0ee requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:47:11.916582 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8c84ad4-bdc7-46a5-aaab-16edb38da06a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:11.917107 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8c84ad4-bdc7-46a5-aaab-16edb38da06a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:11.937397 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c8c84ad4-bdc7-46a5-aaab-16edb38da06a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Calling delete_port for ccec756b-58d9-42ec-aedd-629423cfcece owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:47:12.128115 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44670) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:12.170493 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8c84ad4-bdc7-46a5-aaab-16edb38da06a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:12.217428 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8c84ad4-bdc7-46a5-aaab-16edb38da06a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'Port': ['ID=ccec756b-58d9-42ec-aedd-629423cfcece,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:12.287016 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8c84ad4-bdc7-46a5-aaab-16edb38da06a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:12.287617 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-c8c84ad4-bdc7-46a5-aaab-16edb38da06a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Floating IP 8586a0ac-8d71-46f3-ae0a-75565c281860 disassociated (deleted). External IP: 172.25.3.157, port: 201bc3ab-e2ab-4e46-9cc3-b13f3373442f. Dec 09 21:47:12.452542 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2701f222-3051-4a4c-8464-25d2f6346b51 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:12.494627 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device cfd5c800-4c6d-4766-9675-137da0da42a4 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:47:12.550194 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: cfd5c800-4c6d-4766-9675-137da0da42a4 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:47:12.551859 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device cfd5c800-4c6d-4766-9675-137da0da42a4 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:47:12.597155 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44690) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:12.607375 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a1aac40a-477a-43b2-aeae-195d7c941dff admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-750801009-network', 'tenant_id': '415299c407d24d04828310b7b5123d8e'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:12.637594 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a1aac40a-477a-43b2-aeae-195d7c941dff admin admin] Made reservation on behalf of 415299c407d24d04828310b7b5123d8e for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:47:12.640642 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a1aac40a-477a-43b2-aeae-195d7c941dff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:12.650527 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c8c84ad4-bdc7-46a5-aaab-16edb38da06a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Router 71037eba-17b6-499e-8ba6-3a08aa3db0b5 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:47:12.659663 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a1aac40a-477a-43b2-aeae-195d7c941dff admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:12.669787 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2701f222-3051-4a4c-8464-25d2f6346b51 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:12.680355 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2701f222-3051-4a4c-8464-25d2f6346b51 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:12.713354 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2701f222-3051-4a4c-8464-25d2f6346b51 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f5fa9c21-81e9-4114-a661-f941567d9f4e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:12.731861 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2701f222-3051-4a4c-8464-25d2f6346b51 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:12.732212 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2701f222-3051-4a4c-8464-25d2f6346b51 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:12.732565 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2701f222-3051-4a4c-8464-25d2f6346b51 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:12.732905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2701f222-3051-4a4c-8464-25d2f6346b51 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:12.733336 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2701f222-3051-4a4c-8464-25d2f6346b51 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:12.733681 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2701f222-3051-4a4c-8464-25d2f6346b51 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:12.734425 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2701f222-3051-4a4c-8464-25d2f6346b51 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:12.734425 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2701f222-3051-4a4c-8464-25d2f6346b51 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:12.734970 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2701f222-3051-4a4c-8464-25d2f6346b51 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:12.735368 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2701f222-3051-4a4c-8464-25d2f6346b51 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:12.735712 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2701f222-3051-4a4c-8464-25d2f6346b51 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:12.736038 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2701f222-3051-4a4c-8464-25d2f6346b51 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:12.736364 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2701f222-3051-4a4c-8464-25d2f6346b51 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:12.768518 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2701f222-3051-4a4c-8464-25d2f6346b51 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ae81e76b96604e63b19a219976ce9e9c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6363561 Dec 09 21:47:12.770130 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44696) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:12.811701 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c8c84ad4-bdc7-46a5-aaab-16edb38da06a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:47:12.829248 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8c84ad4-bdc7-46a5-aaab-16edb38da06a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:12.834979 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5637586e-7fa2-4b07-9da5-09c8c16a4372 None None] Sync routers for ids ['71037eba-17b6-499e-8ba6-3a08aa3db0b5'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:47:12.858970 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5637586e-7fa2-4b07-9da5-09c8c16a4372 None None] Routers {'71037eba-17b6-499e-8ba6-3a08aa3db0b5'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:47:12.859920 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5637586e-7fa2-4b07-9da5-09c8c16a4372 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['71037eba-17b6-499e-8ba6-3a08aa3db0b5'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:12.864314 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c8c84ad4-bdc7-46a5-aaab-16edb38da06a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "DELETE /v2.0/floatingips/8586a0ac-8d71-46f3-ae0a-75565c281860 HTTP/1.1" status: 204 len: 168 time: 1.4507246 Dec 09 21:47:12.864907 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9c9545e3-43c2-403d-a699-e38d4f4c2a1b', 'tag': '201bc3ab-e2ab-4e46-9cc3-b13f3373442f'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:47:12.867237 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c2cccf47-4dc8-414d-9a05-d3b884c37528" -d '{"events": [{"name": "network-changed", "server_uuid": "9c9545e3-43c2-403d-a699-e38d4f4c2a1b", "tag": "201bc3ab-e2ab-4e46-9cc3-b13f3373442f"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:47:12.906385 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a1aac40a-477a-43b2-aeae-195d7c941dff admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:12.918787 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a1aac40a-477a-43b2-aeae-195d7c941dff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:12.942729 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1647d1ae-4925-488d-9cd4-c42a23bf7171 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:12.967320 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1647d1ae-4925-488d-9cd4-c42a23bf7171 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:13.000815 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44704) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:13.031979 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a1aac40a-477a-43b2-aeae-195d7c941dff admin admin] vlan segment allocate from pool success with {'vlan_id': 134, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:47:13.047169 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1647d1ae-4925-488d-9cd4-c42a23bf7171 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:13.049814 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1647d1ae-4925-488d-9cd4-c42a23bf7171 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:13.051566 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1647d1ae-4925-488d-9cd4-c42a23bf7171 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/f5fa9c21-81e9-4114-a661-f941567d9f4e HTTP/1.1" status: 204 len: 168 time: 0.2803345 Dec 09 21:47:13.056375 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1aac40a-477a-43b2-aeae-195d7c941dff admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c3aa8252-d7e2-4a7a-9601-432947e1db0d,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:13.060534 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a1aac40a-477a-43b2-aeae-195d7c941dff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:13.061050 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-a1aac40a-477a-43b2-aeae-195d7c941dff admin admin] Added segment 0da9d582-4eab-489e-b7ba-4b0f37f9f554 of type vlan for network b73f65be-f154-49a5-9107-5a71ab99f874 Dec 09 21:47:13.083741 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1647d1ae-4925-488d-9cd4-c42a23bf7171 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f5fa9c21-81e9-4114-a661-f941567d9f4e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:13.185774 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-5637586e-7fa2-4b07-9da5-09c8c16a4372 None None] Set router 71037eba-17b6-499e-8ba6-3a08aa3db0b5 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:47:13.203331 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a1aac40a-477a-43b2-aeae-195d7c941dff admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:13.297288 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a1aac40a-477a-43b2-aeae-195d7c941dff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:13.298473 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a1aac40a-477a-43b2-aeae-195d7c941dff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:13.299480 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a1aac40a-477a-43b2-aeae-195d7c941dff admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:13.316801 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:47:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-85fd657e-cadf-4ab3-81f0-ccb21975bffb x-openstack-request-id: req-85fd657e-cadf-4ab3-81f0-ccb21975bffb {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:47:13.317248 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9c9545e3-43c2-403d-a699-e38d4f4c2a1b", "tag": "201bc3ab-e2ab-4e46-9cc3-b13f3373442f", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:47:13.317498 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-85fd657e-cadf-4ab3-81f0-ccb21975bffb {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:47:13.317971 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9c9545e3-43c2-403d-a699-e38d4f4c2a1b', 'tag': '201bc3ab-e2ab-4e46-9cc3-b13f3373442f', 'status': 'completed', 'code': 200} Dec 09 21:47:13.327839 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-edf7d0e9-d40c-4985-bec7-764c2fe310bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'network': {'name': 'tempest-RoutersTest-41467856'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:13.338577 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a1aac40a-477a-43b2-aeae-195d7c941dff admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.7393184 Dec 09 21:47:13.341439 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44712) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:13.362254 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-69f39cf3-06a7-47f0-ac46-9c2417e79da4 admin admin] Request body: {'subnet': {'network_id': 'b73f65be-f154-49a5-9107-5a71ab99f874', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-750801009-subnet', 'tenant_id': '415299c407d24d04828310b7b5123d8e', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:13.423315 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-edf7d0e9-d40c-4985-bec7-764c2fe310bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Made reservation on behalf of 99ff5f79d7574ab091d0707b5e01465a for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:47:13.431660 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-edf7d0e9-d40c-4985-bec7-764c2fe310bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:13.443839 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-69f39cf3-06a7-47f0-ac46-9c2417e79da4 admin admin] Made reservation on behalf of 415299c407d24d04828310b7b5123d8e for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:47:13.448980 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-69f39cf3-06a7-47f0-ac46-9c2417e79da4 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:13.496026 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1aac40a-477a-43b2-aeae-195d7c941dff admin admin] Pushing event updated for resources: {'Network': ['ID=b73f65be-f154-49a5-9107-5a71ab99f874,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:13.515066 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network b73f65be-f154-49a5-9107-5a71ab99f874 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:47:13.522560 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-edf7d0e9-d40c-4985-bec7-764c2fe310bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:13.549399 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65e10b27-45c7-4ab8-bf85-f241c0ff9e9c req-bfe47ea7-aa97-479f-8ce4-7b27ac53cdbf tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:13.551543 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-65e10b27-45c7-4ab8-bf85-f241c0ff9e9c req-bfe47ea7-aa97-479f-8ce4-7b27ac53cdbf tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.0943384 Dec 09 21:47:13.646543 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5637586e-7fa2-4b07-9da5-09c8c16a4372 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'name': 'tempest-TestNetworkAdvancedServerOps-router-446132443', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53'}], 'enable_snat': True}, 'gw_port_id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:11Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2d:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2974, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'e6e780bc-5481-46c0-b1d4-140a4d417a11', 'name': '', 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:f9:a2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'device_owner': 'network:router_interface', 'standard_attr_id': 2987, 'fixed_ips': [{'subnet_id': '017fde5b-ddc1-4da5-8c6b-2b98296748e5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:45:10Z', 'updated_at': '2021-12-09T21:45:16Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '017fde5b-ddc1-4da5-8c6b-2b98296748e5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:13.654413 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-65e10b27-45c7-4ab8-bf85-f241c0ff9e9c req-8b8a0ef2-dff2-4cf1-8654-f2a78fb76939 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0920684 Dec 09 21:47:13.681605 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5637586e-7fa2-4b07-9da5-09c8c16a4372 None None] Checking router: 71037eba-17b6-499e-8ba6-3a08aa3db0b5 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:47:13.693578 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5637586e-7fa2-4b07-9da5-09c8c16a4372 None None] Routers {'71037eba-17b6-499e-8ba6-3a08aa3db0b5'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:47:13.694452 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5637586e-7fa2-4b07-9da5-09c8c16a4372 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['71037eba-17b6-499e-8ba6-3a08aa3db0b5'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:13.833794 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-5637586e-7fa2-4b07-9da5-09c8c16a4372 None None] Set router 71037eba-17b6-499e-8ba6-3a08aa3db0b5 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:47:14.074322 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5637586e-7fa2-4b07-9da5-09c8c16a4372 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'name': 'tempest-TestNetworkAdvancedServerOps-router-446132443', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53'}], 'enable_snat': True}, 'gw_port_id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:11Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2d:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2974, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'e6e780bc-5481-46c0-b1d4-140a4d417a11', 'name': '', 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:f9:a2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'device_owner': 'network:router_interface', 'standard_attr_id': 2987, 'fixed_ips': [{'subnet_id': '017fde5b-ddc1-4da5-8c6b-2b98296748e5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:45:10Z', 'updated_at': '2021-12-09T21:45:16Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '017fde5b-ddc1-4da5-8c6b-2b98296748e5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:14.078682 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2cccf47-4dc8-414d-9a05-d3b884c37528 req-41eb75ee-654a-4e8e-a595-faff08dc95fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:14.080391 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c2cccf47-4dc8-414d-9a05-d3b884c37528 req-41eb75ee-654a-4e8e-a595-faff08dc95fd service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 1098 time: 0.6397042 Dec 09 21:47:14.120164 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5637586e-7fa2-4b07-9da5-09c8c16a4372 None None] The sync data for ids ['71037eba-17b6-499e-8ba6-3a08aa3db0b5'] in n-d-713301-27 is: [{'id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'name': 'tempest-TestNetworkAdvancedServerOps-router-446132443', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53'}], 'enable_snat': True}, 'gw_port_id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:11Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2d:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2974, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'e6e780bc-5481-46c0-b1d4-140a4d417a11', 'name': '', 'network_id': '4fbe35af-30ff-45b2-b84a-21fea4abf9aa', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:f9:a2:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'device_owner': 'network:router_interface', 'standard_attr_id': 2987, 'fixed_ips': [{'subnet_id': '017fde5b-ddc1-4da5-8c6b-2b98296748e5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:45:10Z', 'updated_at': '2021-12-09T21:45:16Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '017fde5b-ddc1-4da5-8c6b-2b98296748e5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:47:14.125572 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-edf7d0e9-d40c-4985-bec7-764c2fe310bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:14.145466 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-edf7d0e9-d40c-4985-bec7-764c2fe310bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:14.243620 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-edf7d0e9-d40c-4985-bec7-764c2fe310bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] vlan segment allocate from pool success with {'vlan_id': 126, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:47:14.268902 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edf7d0e9-d40c-4985-bec7-764c2fe310bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'SecurityGroup': ['ID=005c3f30-2191-496b-9f44-5309c170d02a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:14.279776 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2cccf47-4dc8-414d-9a05-d3b884c37528 req-31d0edcf-2947-439e-9dd6-991ff7595aef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:14.281337 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c2cccf47-4dc8-414d-9a05-d3b884c37528 req-31d0edcf-2947-439e-9dd6-991ff7595aef service neutron] 10.222.0.10 "GET /v2.0/networks?id=4fbe35af-30ff-45b2-b84a-21fea4abf9aa HTTP/1.1" status: 200 len: 898 time: 0.1856661 Dec 09 21:47:14.282475 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-edf7d0e9-d40c-4985-bec7-764c2fe310bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:14.282700 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-edf7d0e9-d40c-4985-bec7-764c2fe310bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Added segment 96ebe272-33cc-4e4e-a26a-639d4cbc5b6c of type vlan for network 940cad56-2f35-40f8-9ed5-25a1c83dbeda Dec 09 21:47:14.371098 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44734) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:14.383523 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c2cccf47-4dc8-414d-9a05-d3b884c37528 req-d7e5e91a-3a37-4fbc-8119-26bb6bcd0e4a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=201bc3ab-e2ab-4e46-9cc3-b13f3373442f HTTP/1.1" status: 200 len: 217 time: 0.0901170 Dec 09 21:47:14.417799 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-edf7d0e9-d40c-4985-bec7-764c2fe310bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:14.450013 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-69f39cf3-06a7-47f0-ac46-9c2417e79da4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:14.507538 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d17b7111-97c0-4f11-909b-045856706d7b req-4097d588-69a1-4278-ac07-4c9f597c817b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:14.510361 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2cccf47-4dc8-414d-9a05-d3b884c37528 req-9e93d02f-faac-47bd-a3c7-bce153aff028 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:14.512103 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d17b7111-97c0-4f11-909b-045856706d7b req-4097d588-69a1-4278-ac07-4c9f597c817b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.10 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.0700145 Dec 09 21:47:14.512836 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c2cccf47-4dc8-414d-9a05-d3b884c37528 req-9e93d02f-faac-47bd-a3c7-bce153aff028 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=017fde5b-ddc1-4da5-8c6b-2b98296748e5 HTTP/1.1" status: 200 len: 835 time: 0.1176593 Dec 09 21:47:14.521414 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-77b87fa8-fd54-4409-88a8-54ad79066cbf tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Request body: {'security_group': {'name': 'tempest-secgroup--158620494'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:14.523014 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-edf7d0e9-d40c-4985-bec7-764c2fe310bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:14.528546 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edf7d0e9-d40c-4985-bec7-764c2fe310bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:14.529139 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-edf7d0e9-d40c-4985-bec7-764c2fe310bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:14.540964 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef6ac78e-b857-4379-a16c-66492a8a9621 None None] New status for floating IP 8586a0ac-8d71-46f3-ae0a-75565c281860: DOWN {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:47:14.595560 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69f39cf3-06a7-47f0-ac46-9c2417e79da4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=0f388987-bd56-44d8-88ba-8acd5faeb1d2,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:14.600096 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-77b87fa8-fd54-4409-88a8-54ad79066cbf tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:14.622167 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-77b87fa8-fd54-4409-88a8-54ad79066cbf tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:14.670520 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69f39cf3-06a7-47f0-ac46-9c2417e79da4 admin admin] Checking segment: {'id': '0da9d582-4eab-489e-b7ba-4b0f37f9f554', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 134, 'network_id': 'b73f65be-f154-49a5-9107-5a71ab99f874'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:47:14.671068 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-69f39cf3-06a7-47f0-ac46-9c2417e79da4 admin admin] Network hostable DHCP agents. Network: b73f65be-f154-49a5-9107-5a71ab99f874, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:47:14.679035 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-edf7d0e9-d40c-4985-bec7-764c2fe310bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 764 time: 1.6770775 Dec 09 21:47:14.682150 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44740) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:14.686753 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edf7d0e9-d40c-4985-bec7-764c2fe310bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Network': ['ID=940cad56-2f35-40f8-9ed5-25a1c83dbeda,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:14.698633 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 940cad56-2f35-40f8-9ed5-25a1c83dbeda details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:47:14.704181 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2cccf47-4dc8-414d-9a05-d3b884c37528 req-9b90c792-0bfd-42cc-a8ee-6aa6b195f8e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:14.705879 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c2cccf47-4dc8-414d-9a05-d3b884c37528 req-9b90c792-0bfd-42cc-a8ee-6aa6b195f8e8 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=4fbe35af-30ff-45b2-b84a-21fea4abf9aa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1740079 Dec 09 21:47:14.709806 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c07919bd-58f1-4da2-81bd-1c4a1c8faedc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'network': {'name': 'tempest-RoutersTest-2130879879'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:14.740115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-69f39cf3-06a7-47f0-ac46-9c2417e79da4 admin admin] Network b73f65be-f154-49a5-9107-5a71ab99f874 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:47:14.793828 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-69f39cf3-06a7-47f0-ac46-9c2417e79da4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, b73f65be-f154-49a5-9107-5a71ab99f874) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:14.804593 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-69f39cf3-06a7-47f0-ac46-9c2417e79da4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:14.805319 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-69f39cf3-06a7-47f0-ac46-9c2417e79da4 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:14.821814 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a535f1c8-5e19-43eb-b5e1-4029ec6790c4 None None] Network b73f65be-f154-49a5-9107-5a71ab99f874 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:47:14.843718 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-77b87fa8-fd54-4409-88a8-54ad79066cbf tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:14.849194 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c2cccf47-4dc8-414d-9a05-d3b884c37528 req-a86b69be-7ad6-4b3b-b55e-10a3d4841485 service neutron] 10.222.0.10 "GET /v2.0/networks/4fbe35af-30ff-45b2-b84a-21fea4abf9aa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1344321 Dec 09 21:47:14.876037 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-77b87fa8-fd54-4409-88a8-54ad79066cbf tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:14.911756 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-d17b7111-97c0-4f11-909b-045856706d7b req-a93a192c-d98e-4286-afb7-700c129b1826 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Deleting port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:47:14.912120 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d17b7111-97c0-4f11-909b-045856706d7b req-a93a192c-d98e-4286-afb7-700c129b1826 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:14.924796 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c07919bd-58f1-4da2-81bd-1c4a1c8faedc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Made reservation on behalf of 99ff5f79d7574ab091d0707b5e01465a for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:47:14.933154 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c07919bd-58f1-4da2-81bd-1c4a1c8faedc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:14.965111 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-69f39cf3-06a7-47f0-ac46-9c2417e79da4 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 1.6124525 Dec 09 21:47:14.972195 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e8502c3d-c050-434f-aeee-c2ad040c8f13 None None] Network b73f65be-f154-49a5-9107-5a71ab99f874 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:47:15.074934 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c2cccf47-4dc8-414d-9a05-d3b884c37528 req-49142f10-751c-4534-bc5a-ff7ca1efc0e9 service neutron] 10.222.0.10 "GET /v2.0/networks/4fbe35af-30ff-45b2-b84a-21fea4abf9aa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2066333 Dec 09 21:47:15.447144 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26a509fc-2efe-4f86-be73-460adc0a8a9a req-11100a0b-0fc3-46c6-a2b9-27d974d85797 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:15.448646 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-26a509fc-2efe-4f86-be73-460adc0a8a9a req-11100a0b-0fc3-46c6-a2b9-27d974d85797 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=9c9545e3-43c2-403d-a699-e38d4f4c2a1b HTTP/1.1" status: 200 len: 946 time: 0.6798270 Dec 09 21:47:15.456691 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77b87fa8-fd54-4409-88a8-54ad79066cbf tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5e047d1c-7f99-49e5-acc4-b98a035025ff,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:15.465020 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c07919bd-58f1-4da2-81bd-1c4a1c8faedc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] vlan segment allocate from pool success with {'vlan_id': 113, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:47:15.513264 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c07919bd-58f1-4da2-81bd-1c4a1c8faedc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:15.514025 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-c07919bd-58f1-4da2-81bd-1c4a1c8faedc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Added segment cb645b8a-5d02-4c72-9e6f-dda9f5c57a07 of type vlan for network 0e9cae05-4caf-4321-8322-e071c54fdaec Dec 09 21:47:15.516532 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-d17b7111-97c0-4f11-909b-045856706d7b req-a93a192c-d98e-4286-afb7-700c129b1826 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] For port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=201bc3ab-e2ab-4e46-9cc3-b13f3373442f,segment=NetworkSegment(2316fee1-a288-4d09-bf17-e0a19e0adf8d),segment_id=2316fee1-a288-4d09-bf17-e0a19e0adf8d)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:15.517206 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d17b7111-97c0-4f11-909b-045856706d7b req-a93a192c-d98e-4286-afb7-700c129b1826 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:15.558486 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-d17b7111-97c0-4f11-909b-045856706d7b req-a93a192c-d98e-4286-afb7-700c129b1826 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Calling delete_port for 201bc3ab-e2ab-4e46-9cc3-b13f3373442f owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:47:15.600906 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-77b87fa8-fd54-4409-88a8-54ad79066cbf tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:15.616726 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-77b87fa8-fd54-4409-88a8-54ad79066cbf tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:15.628787 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-26a509fc-2efe-4f86-be73-460adc0a8a9a req-c4016066-b3cf-4a88-ab81-65ebab1309d3 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=f44a1e28-df99-474a-b80e-b3989956be0c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1682990 Dec 09 21:47:15.635052 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c07919bd-58f1-4da2-81bd-1c4a1c8faedc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:15.696483 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-77b87fa8-fd54-4409-88a8-54ad79066cbf tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:15.697735 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-77b87fa8-fd54-4409-88a8-54ad79066cbf tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 1.3252854 Dec 09 21:47:15.701194 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44752) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:15.714382 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77b87fa8-fd54-4409-88a8-54ad79066cbf tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event updated for resources: {'SecurityGroup': ['ID=964e10c0-a55b-43fd-80ab-a83434d36fdc,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:15.742491 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c07919bd-58f1-4da2-81bd-1c4a1c8faedc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:15.749570 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c07919bd-58f1-4da2-81bd-1c4a1c8faedc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:15.749857 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c07919bd-58f1-4da2-81bd-1c4a1c8faedc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:15.784837 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-42072a3e-8895-49af-9c72-456ecb63b1dc tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4544 time: 0.0776095 Dec 09 21:47:15.784837 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44754) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:15.789165 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-8d1bbeeb-0918-4ca4-bb88-1a261de8ef5b tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Request body: {'security_group': {'name': 'tempest-security--1633542709', 'description': 'tempest-security-description-890232142'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:15.807595 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c07919bd-58f1-4da2-81bd-1c4a1c8faedc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 1.1168332 Dec 09 21:47:15.812705 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44756) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:15.819622 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-89f55562-2ec6-436e-a102-a1de5fc3284f tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'subnet': {'network_id': '940cad56-2f35-40f8-9ed5-25a1c83dbeda', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:15.879640 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c07919bd-58f1-4da2-81bd-1c4a1c8faedc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Network': ['ID=0e9cae05-4caf-4321-8322-e071c54fdaec,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:15.891506 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 0e9cae05-4caf-4321-8322-e071c54fdaec details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:47:15.916462 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d17b7111-97c0-4f11-909b-045856706d7b req-a93a192c-d98e-4286-afb7-700c129b1826 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:15.918436 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8d1bbeeb-0918-4ca4-bb88-1a261de8ef5b tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:15.961201 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a93a192c-d98e-4286-afb7-700c129b1826 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'Port': ['ID=201bc3ab-e2ab-4e46-9cc3-b13f3373442f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:16.000187 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8d1bbeeb-0918-4ca4-bb88-1a261de8ef5b tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:16.009180 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8d1bbeeb-0918-4ca4-bb88-1a261de8ef5b tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:16.013949 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8d1bbeeb-0918-4ca4-bb88-1a261de8ef5b tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:16.018651 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8d1bbeeb-0918-4ca4-bb88-1a261de8ef5b tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "PUT /v2.0/security-groups/964e10c0-a55b-43fd-80ab-a83434d36fdc HTTP/1.1" status: 200 len: 1796 time: 0.2324228 Dec 09 21:47:16.021355 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44772) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:16.026700 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-89f55562-2ec6-436e-a102-a1de5fc3284f tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Made reservation on behalf of 99ff5f79d7574ab091d0707b5e01465a for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:47:16.029090 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-89f55562-2ec6-436e-a102-a1de5fc3284f tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:16.055295 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-d17b7111-97c0-4f11-909b-045856706d7b req-a93a192c-d98e-4286-afb7-700c129b1826 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] No DVR routers for this DVR port 201bc3ab-e2ab-4e46-9cc3-b13f3373442f on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:47:16.060268 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d17b7111-97c0-4f11-909b-045856706d7b req-a93a192c-d98e-4286-afb7-700c129b1826 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:16.065501 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d17b7111-97c0-4f11-909b-045856706d7b req-a93a192c-d98e-4286-afb7-700c129b1826 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.10 "DELETE /v2.0/ports/201bc3ab-e2ab-4e46-9cc3-b13f3373442f HTTP/1.1" status: 204 len: 173 time: 1.5382185 Dec 09 21:47:16.066004 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9c9545e3-43c2-403d-a699-e38d4f4c2a1b', 'name': 'network-vif-deleted', 'tag': '201bc3ab-e2ab-4e46-9cc3-b13f3373442f'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:47:16.068568 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1a5e53ef-4e52-4fed-80ee-1087303fa84f" -d '{"events": [{"server_uuid": "9c9545e3-43c2-403d-a699-e38d4f4c2a1b", "name": "network-vif-deleted", "tag": "201bc3ab-e2ab-4e46-9cc3-b13f3373442f"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:47:16.149467 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-50525b28-4623-4784-9261-007132e961ff tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:16.151167 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-50525b28-4623-4784-9261-007132e961ff tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/networks?id=1f6c6308-b8f8-453f-b9f3-49b33791e0ee HTTP/1.1" status: 200 len: 809 time: 0.1943915 Dec 09 21:47:16.180364 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-37070e32-1502-4ca0-b289-0fddba7f2970 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/quotas/2be7af74c5cc43908a744820a98fc9c0 HTTP/1.1" status: 200 len: 375 time: 0.0129552 Dec 09 21:47:16.204393 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c832238f-4d5d-4f88-a883-b5a2d8f7a0b2 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-groups/964e10c0-a55b-43fd-80ab-a83434d36fdc HTTP/1.1" status: 200 len: 1796 time: 0.1708179 Dec 09 21:47:16.205066 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44802) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:16.218900 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-b088c3f8-c1b5-495d-ae66-89fe78a1fd09 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=2be7af74c5cc43908a744820a98fc9c0&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0369191 Dec 09 21:47:16.224204 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d1bbeeb-0918-4ca4-bb88-1a261de8ef5b tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event updated for resources: {'SecurityGroup': ['ID=964e10c0-a55b-43fd-80ab-a83434d36fdc,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:16.361332 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-07971684-a90a-47a0-92f0-1a00f1e921ac tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:16.428133 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-07971684-a90a-47a0-92f0-1a00f1e921ac tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:16.435699 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-f5c858bb-84e8-4fdb-bc22-8c1ccd9b2aed service neutron] 10.222.0.13 "GET /v2.0/networks/1f6c6308-b8f8-453f-b9f3-49b33791e0ee?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2043478 Dec 09 21:47:16.533004 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-89f55562-2ec6-436e-a102-a1de5fc3284f tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:16.589168 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-4582f284-2d75-49c1-89d4-94c2be18c1d9 service neutron] 10.222.0.13 "GET /v2.0/networks/1f6c6308-b8f8-453f-b9f3-49b33791e0ee?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1523509 Dec 09 21:47:16.598630 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89f55562-2ec6-436e-a102-a1de5fc3284f tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Subnet': ['ID=3f2e4b28-1001-407c-b523-5ee42432aa45,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:16.623903 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-07971684-a90a-47a0-92f0-1a00f1e921ac tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:16.626880 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-07971684-a90a-47a0-92f0-1a00f1e921ac tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:16.630803 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44812) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:16.630965 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-07971684-a90a-47a0-92f0-1a00f1e921ac tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "DELETE /v2.0/security-groups/964e10c0-a55b-43fd-80ab-a83434d36fdc HTTP/1.1" status: 204 len: 168 time: 0.4205699 Dec 09 21:47:16.646709 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07971684-a90a-47a0-92f0-1a00f1e921ac tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=964e10c0-a55b-43fd-80ab-a83434d36fdc,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:16.685089 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-89f55562-2ec6-436e-a102-a1de5fc3284f tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Checking segment: {'id': '96ebe272-33cc-4e4e-a26a-639d4cbc5b6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '940cad56-2f35-40f8-9ed5-25a1c83dbeda'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:47:16.685530 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89f55562-2ec6-436e-a102-a1de5fc3284f tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network hostable DHCP agents. Network: 940cad56-2f35-40f8-9ed5-25a1c83dbeda, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:47:16.728848 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-59c2652f-b313-4e4b-9de7-abc2236480b8 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0953352 Dec 09 21:47:16.731765 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44818) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:16.737689 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89f55562-2ec6-436e-a102-a1de5fc3284f tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network 940cad56-2f35-40f8-9ed5-25a1c83dbeda is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:47:16.753087 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-33d8d9f3-e8ff-4a74-8b8f-c0617bcd7ab0 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] delete failed (client error): The resource could not be found. Dec 09 21:47:16.755402 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-33d8d9f3-e8ff-4a74-8b8f-c0617bcd7ab0 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "DELETE /v2.0/security-groups/964e10c0-a55b-43fd-80ab-a83434d36fdc HTTP/1.1" status: 404 len: 347 time: 0.0225437 Dec 09 21:47:16.759573 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44820) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:16.763193 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-89f55562-2ec6-436e-a102-a1de5fc3284f tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 940cad56-2f35-40f8-9ed5-25a1c83dbeda) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:16.769920 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89f55562-2ec6-436e-a102-a1de5fc3284f tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:16.771862 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-89f55562-2ec6-436e-a102-a1de5fc3284f tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:16.777677 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00d6419f-e27c-4bc4-93d9-810abdcdd5d8 None None] Network 940cad56-2f35-40f8-9ed5-25a1c83dbeda requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:47:16.779470 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-b034717f-a44c-452b-b27f-e6488ffb5401 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Request body: {'security_group': {'name': 'tempest-secgroup--1968250408'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:16.821478 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b034717f-a44c-452b-b27f-e6488ffb5401 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:16.845021 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-89f55562-2ec6-436e-a102-a1de5fc3284f tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.0260024 Dec 09 21:47:16.845787 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44824) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:16.851780 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-9c786d49-e619-41e5-a3ae-2d1e415122b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'subnet': {'network_id': '0e9cae05-4caf-4321-8322-e071c54fdaec', 'cidr': '172.21.0.0/28', 'ip_version': 4, 'gateway_ip': '172.21.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:16.949253 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c45e25b-d83e-4644-a714-50021a72897a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-940cad56-2f35-40f8-9ed5-25a1c83dbeda', 'network_id': '940cad56-2f35-40f8-9ed5-25a1c83dbeda', 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'fixed_ips': [{'subnet_id': '3f2e4b28-1001-407c-b523-5ee42432aa45'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:47:16.952595 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:47:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bfc51bf9-38aa-4e4d-ab01-5b6ddaf2891f x-openstack-request-id: req-bfc51bf9-38aa-4e4d-ab01-5b6ddaf2891f {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:47:16.952707 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4c45e25b-d83e-4644-a714-50021a72897a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:16.954281 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9c9545e3-43c2-403d-a699-e38d4f4c2a1b", "name": "network-vif-deleted", "tag": "201bc3ab-e2ab-4e46-9cc3-b13f3373442f", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:47:16.954633 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-bfc51bf9-38aa-4e4d-ab01-5b6ddaf2891f {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:47:16.954986 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9c9545e3-43c2-403d-a699-e38d4f4c2a1b', 'name': 'network-vif-deleted', 'tag': '201bc3ab-e2ab-4e46-9cc3-b13f3373442f', 'status': 'completed', 'code': 200} Dec 09 21:47:17.002675 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9c786d49-e619-41e5-a3ae-2d1e415122b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Made reservation on behalf of 99ff5f79d7574ab091d0707b5e01465a for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:47:17.008035 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9c786d49-e619-41e5-a3ae-2d1e415122b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:17.027939 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44832) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:17.034065 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b034717f-a44c-452b-b27f-e6488ffb5401 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:17.044653 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b034717f-a44c-452b-b27f-e6488ffb5401 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:17.114010 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e163f69-998c-4490-a726-ffe1d741fb2c req-4642dd3b-50f4-4de4-ae3c-898d1cd32ba1 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/ports?device_id=adfb178e-8542-42ce-9636-b14306116737 HTTP/1.1" status: 200 len: 210 time: 0.0476232 Dec 09 21:47:17.117772 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b034717f-a44c-452b-b27f-e6488ffb5401 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:17.121868 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b034717f-a44c-452b-b27f-e6488ffb5401 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.3580978 Dec 09 21:47:17.121868 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b034717f-a44c-452b-b27f-e6488ffb5401 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b3bd906e-4933-479b-a649-efc664fc389f,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:17.122185 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44840) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:17.136233 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-b3ee42c6-3cc6-41df-97b6-5e6da2856f38 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Request body: {'security_group_rule': {'security_group_id': 'b3bd906e-4933-479b-a649-efc664fc389f', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 77, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:17.184064 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b3ee42c6-3cc6-41df-97b6-5e6da2856f38 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:17.195250 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-4c45e25b-d83e-4644-a714-50021a72897a None None] Allocated IP 172.20.0.2 (940cad56-2f35-40f8-9ed5-25a1c83dbeda/3f2e4b28-1001-407c-b523-5ee42432aa45/a41b2012-50f6-4ed6-a81b-1d858c64e6f6) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:47:17.283520 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b3ee42c6-3cc6-41df-97b6-5e6da2856f38 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:17.291263 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b3ee42c6-3cc6-41df-97b6-5e6da2856f38 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:17.310649 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3ee42c6-3cc6-41df-97b6-5e6da2856f38 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9feed68b-7672-49c4-a49b-5cbd5ca6f175,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:17.325256 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b3ee42c6-3cc6-41df-97b6-5e6da2856f38 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:17.327033 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b3ee42c6-3cc6-41df-97b6-5e6da2856f38 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1953528 Dec 09 21:47:17.329972 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44866) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:17.369176 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-42eb6174-2275-4305-adcd-941b2087d8dd tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:17.380440 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-42eb6174-2275-4305-adcd-941b2087d8dd tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:17.386964 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4c45e25b-d83e-4644-a714-50021a72897a None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:17.400952 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4c45e25b-d83e-4644-a714-50021a72897a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:17.415856 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-42eb6174-2275-4305-adcd-941b2087d8dd tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:17.424042 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-42eb6174-2275-4305-adcd-941b2087d8dd tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:17.426195 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-42eb6174-2275-4305-adcd-941b2087d8dd tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "DELETE /v2.0/security-group-rules/9feed68b-7672-49c4-a49b-5cbd5ca6f175 HTTP/1.1" status: 204 len: 168 time: 0.0948205 Dec 09 21:47:17.428638 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44868) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:17.435090 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42eb6174-2275-4305-adcd-941b2087d8dd tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=9feed68b-7672-49c4-a49b-5cbd5ca6f175,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:17.456881 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c45e25b-d83e-4644-a714-50021a72897a None None] Network 940cad56-2f35-40f8-9ed5-25a1c83dbeda is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:47:17.462115 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-4c45e25b-d83e-4644-a714-50021a72897a None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:17.467632 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c45e25b-d83e-4644-a714-50021a72897a None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:47:17.470821 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c45e25b-d83e-4644-a714-50021a72897a None None] Pushing event updated for resources: {'Port': ['ID=a41b2012-50f6-4ed6-a81b-1d858c64e6f6,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:17.525669 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-4c45e25b-d83e-4644-a714-50021a72897a None None] Attempting to bind port a41b2012-50f6-4ed6-a81b-1d858c64e6f6 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:47:17.526042 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-4c45e25b-d83e-4644-a714-50021a72897a None None] Attempting to bind port a41b2012-50f6-4ed6-a81b-1d858c64e6f6 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '96ebe272-33cc-4e4e-a26a-639d4cbc5b6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '940cad56-2f35-40f8-9ed5-25a1c83dbeda'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:47:17.526408 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c45e25b-d83e-4644-a714-50021a72897a None None] Attempting to bind port a41b2012-50f6-4ed6-a81b-1d858c64e6f6 on network 940cad56-2f35-40f8-9ed5-25a1c83dbeda {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:47:17.533054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c45e25b-d83e-4644-a714-50021a72897a None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 47, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:47:17.533054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c45e25b-d83e-4644-a714-50021a72897a None None] Checking segment: {'id': '96ebe272-33cc-4e4e-a26a-639d4cbc5b6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '940cad56-2f35-40f8-9ed5-25a1c83dbeda'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:47:17.533054 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4c45e25b-d83e-4644-a714-50021a72897a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:17.533479 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c45e25b-d83e-4644-a714-50021a72897a None None] Bound using segment: {'id': '96ebe272-33cc-4e4e-a26a-639d4cbc5b6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '940cad56-2f35-40f8-9ed5-25a1c83dbeda'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:47:17.533748 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-4c45e25b-d83e-4644-a714-50021a72897a None None] Bound port: a41b2012-50f6-4ed6-a81b-1d858c64e6f6, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '96ebe272-33cc-4e4e-a26a-639d4cbc5b6c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '940cad56-2f35-40f8-9ed5-25a1c83dbeda'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:47:17.533979 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4c45e25b-d83e-4644-a714-50021a72897a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:17.578099 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c2450bf8-21eb-4bad-95b9-7eeb6b0c380c tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1457102 Dec 09 21:47:17.580497 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44870) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:17.616642 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-4c45e25b-d83e-4644-a714-50021a72897a None None] For port a41b2012-50f6-4ed6-a81b-1d858c64e6f6, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:47:17.617126 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9c786d49-e619-41e5-a3ae-2d1e415122b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:17.620048 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-4c45e25b-d83e-4644-a714-50021a72897a None None] For port a41b2012-50f6-4ed6-a81b-1d858c64e6f6, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a41b2012-50f6-4ed6-a81b-1d858c64e6f6,segment=NetworkSegment(96ebe272-33cc-4e4e-a26a-639d4cbc5b6c),segment_id=96ebe272-33cc-4e4e-a26a-639d4cbc5b6c)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:47:17.629987 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4c45e25b-d83e-4644-a714-50021a72897a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:17.657121 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-82fc2190-5f73-4016-b9a8-22b57f89dd1a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:17.700234 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-82fc2190-5f73-4016-b9a8-22b57f89dd1a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:17.710343 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c45e25b-d83e-4644-a714-50021a72897a None None] Pushing event updated for resources: {'Port': ['ID=a41b2012-50f6-4ed6-a81b-1d858c64e6f6,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:17.730525 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c786d49-e619-41e5-a3ae-2d1e415122b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Subnet': ['ID=33b2b834-2f8a-441d-b1ed-4bc255441ae9,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:17.757590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c786d49-e619-41e5-a3ae-2d1e415122b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Checking segment: {'id': 'cb645b8a-5d02-4c72-9e6f-dda9f5c57a07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '0e9cae05-4caf-4321-8322-e071c54fdaec'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:47:17.758272 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c786d49-e619-41e5-a3ae-2d1e415122b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network hostable DHCP agents. Network: 0e9cae05-4caf-4321-8322-e071c54fdaec, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:47:17.774508 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-82fc2190-5f73-4016-b9a8-22b57f89dd1a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:17.779228 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-82fc2190-5f73-4016-b9a8-22b57f89dd1a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:17.782886 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-82fc2190-5f73-4016-b9a8-22b57f89dd1a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "DELETE /v2.0/security-groups/b3bd906e-4933-479b-a649-efc664fc389f HTTP/1.1" status: 204 len: 168 time: 0.1991467 Dec 09 21:47:17.783470 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44872) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:17.798889 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82fc2190-5f73-4016-b9a8-22b57f89dd1a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b3bd906e-4933-479b-a649-efc664fc389f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:17.814449 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c786d49-e619-41e5-a3ae-2d1e415122b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network 0e9cae05-4caf-4321-8322-e071c54fdaec is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:47:17.855727 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-9c786d49-e619-41e5-a3ae-2d1e415122b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 0e9cae05-4caf-4321-8322-e071c54fdaec) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:17.865252 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-606e5837-767f-48a5-b5fb-9cb71ca0c13a None None] Network 0e9cae05-4caf-4321-8322-e071c54fdaec requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:47:17.888966 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44876) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:17.890254 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-86fa324d-9f06-4cd8-9da4-a7138691e8cd tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0992229 Dec 09 21:47:17.892050 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9c786d49-e619-41e5-a3ae-2d1e415122b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:17.893858 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9c786d49-e619-41e5-a3ae-2d1e415122b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:17.893996 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-47a441da-0b23-470d-b00f-878a696f4f64 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Request body: {'security_group': {'name': 'tempest-secgroup--991213002'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:17.923715 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9c786d49-e619-41e5-a3ae-2d1e415122b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.0767150 Dec 09 21:47:17.926298 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44878) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:17.931268 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-c9741f91-c452-4c64-9670-af8376cd4c56 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1124079314', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:17.954684 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-47a441da-0b23-470d-b00f-878a696f4f64 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.012432 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-39980456-9691-4455-8bcb-8e5d9fc6eca2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.021898 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c9741f91-c452-4c64-9670-af8376cd4c56 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.023020 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c9741f91-c452-4c64-9670-af8376cd4c56 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.027833 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-96448384-d7bb-4382-a4b2-b98d5aa02ce3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-0e9cae05-4caf-4321-8322-e071c54fdaec', 'network_id': '0e9cae05-4caf-4321-8322-e071c54fdaec', 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'fixed_ips': [{'subnet_id': '33b2b834-2f8a-441d-b1ed-4bc255441ae9'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:47:18.028733 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-96448384-d7bb-4382-a4b2-b98d5aa02ce3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.105102 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-47a441da-0b23-470d-b00f-878a696f4f64 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.111683 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-47a441da-0b23-470d-b00f-878a696f4f64 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.147896 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47a441da-0b23-470d-b00f-878a696f4f64 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ba9a2782-7ce7-4b6a-98cb-4d01620d7b58,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:18.163851 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-47a441da-0b23-470d-b00f-878a696f4f64 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.166331 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-47a441da-0b23-470d-b00f-878a696f4f64 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.2762461 Dec 09 21:47:18.169373 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44882) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:18.179353 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-4a6eb501-3b81-41fa-875f-4f6421af898b tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Request body: {'security_group_rule': {'security_group_id': 'ba9a2782-7ce7-4b6a-98cb-4d01620d7b58', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 3, 'port_range_max': 2, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:18.220006 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c9741f91-c452-4c64-9670-af8376cd4c56 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.230544 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c9741f91-c452-4c64-9670-af8376cd4c56 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.232392 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4a6eb501-3b81-41fa-875f-4f6421af898b tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.252274 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-96448384-d7bb-4382-a4b2-b98d5aa02ce3 None None] Allocated IP 172.21.0.2 (0e9cae05-4caf-4321-8322-e071c54fdaec/33b2b834-2f8a-441d-b1ed-4bc255441ae9/5fc45fe1-02ba-4838-81d4-d93a9372db56) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:47:18.309541 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c9741f91-c452-4c64-9670-af8376cd4c56 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.316837 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c9741f91-c452-4c64-9670-af8376cd4c56 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 0.3831458 Dec 09 21:47:18.318930 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44890) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:18.360091 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fd8f858d-24ef-4767-a1b5-269039a1bfde req-5fc08c0c-cc07-4a91-868e-52225f308de5 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/ports?device_id=adfb178e-8542-42ce-9636-b14306116737 HTTP/1.1" status: 200 len: 210 time: 0.0690584 Dec 09 21:47:18.380622 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4a6eb501-3b81-41fa-875f-4f6421af898b tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.384475 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 201bc3ab-e2ab-4e46-9cc3-b13f3373442f no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:47:18.389714 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4a6eb501-3b81-41fa-875f-4f6421af898b tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.409445 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 201bc3ab-e2ab-4e46-9cc3-b13f3373442f {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:47:18.409995 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 201bc3ab-e2ab-4e46-9cc3-b13f3373442f not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:47:18.418917 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a6eb501-3b81-41fa-875f-4f6421af898b tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=532434a6-3558-448e-b8a0-01559afd4042,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:18.423098 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4a6eb501-3b81-41fa-875f-4f6421af898b tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.426951 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4a6eb501-3b81-41fa-875f-4f6421af898b tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2537394 Dec 09 21:47:18.427175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44892) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:18.431651 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a0908874-5ffc-4f26-bd81-272ddc931afe tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Request body: {'security_group_rule': {'security_group_id': 'ba9a2782-7ce7-4b6a-98cb-4d01620d7b58', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 3, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:18.474312 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-96448384-d7bb-4382-a4b2-b98d5aa02ce3 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.474444 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a0908874-5ffc-4f26-bd81-272ddc931afe tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.482890 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-96448384-d7bb-4382-a4b2-b98d5aa02ce3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.553379 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a0908874-5ffc-4f26-bd81-272ddc931afe tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.562516 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a0908874-5ffc-4f26-bd81-272ddc931afe tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.595477 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0908874-5ffc-4f26-bd81-272ddc931afe tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=10237836-4336-4d53-9754-88c3b36c8bae,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:18.616656 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a0908874-5ffc-4f26-bd81-272ddc931afe tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.618378 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a0908874-5ffc-4f26-bd81-272ddc931afe tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1901231 Dec 09 21:47:18.622357 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44894) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:18.628189 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-5e66915b-d2d5-4b54-ae1f-21d82a0c0ac3 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Request body: {'security_group_rule': {'security_group_id': 'ba9a2782-7ce7-4b6a-98cb-4d01620d7b58', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 8, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:18.739599 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e66915b-d2d5-4b54-ae1f-21d82a0c0ac3 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.763381 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-96448384-d7bb-4382-a4b2-b98d5aa02ce3 None None] Network 0e9cae05-4caf-4321-8322-e071c54fdaec is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:47:18.767255 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-96448384-d7bb-4382-a4b2-b98d5aa02ce3 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:18.771500 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-96448384-d7bb-4382-a4b2-b98d5aa02ce3 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:47:18.823741 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6b4e8fa0-057d-4d03-90cc-eb7347c13b8b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.837278 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a41b2012-50f6-4ed6-a81b-1d858c64e6f6 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:47:18.853907 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96448384-d7bb-4382-a4b2-b98d5aa02ce3 None None] Pushing event updated for resources: {'Port': ['ID=5fc45fe1-02ba-4838-81d4-d93a9372db56,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:18.880293 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e66915b-d2d5-4b54-ae1f-21d82a0c0ac3 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.898712 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e66915b-d2d5-4b54-ae1f-21d82a0c0ac3 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.928689 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e66915b-d2d5-4b54-ae1f-21d82a0c0ac3 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=43ebd2bd-09cf-4eab-bcb3-004576da462e,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:18.943348 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e66915b-d2d5-4b54-ae1f-21d82a0c0ac3 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:18.945032 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5e66915b-d2d5-4b54-ae1f-21d82a0c0ac3 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3210843 Dec 09 21:47:18.945735 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44898) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:18.951484 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-b80de9df-1216-4819-97ee-9d70f9cf4c47 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Request body: {'security_group_rule': {'security_group_id': 'ba9a2782-7ce7-4b6a-98cb-4d01620d7b58', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 0, 'port_range_max': 0, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:18.989088 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-96448384-d7bb-4382-a4b2-b98d5aa02ce3 None None] Attempting to bind port 5fc45fe1-02ba-4838-81d4-d93a9372db56 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:47:18.989757 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-96448384-d7bb-4382-a4b2-b98d5aa02ce3 None None] Attempting to bind port 5fc45fe1-02ba-4838-81d4-d93a9372db56 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'cb645b8a-5d02-4c72-9e6f-dda9f5c57a07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '0e9cae05-4caf-4321-8322-e071c54fdaec'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:47:18.990300 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96448384-d7bb-4382-a4b2-b98d5aa02ce3 None None] Attempting to bind port 5fc45fe1-02ba-4838-81d4-d93a9372db56 on network 0e9cae05-4caf-4321-8322-e071c54fdaec {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:47:19.001535 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96448384-d7bb-4382-a4b2-b98d5aa02ce3 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 47, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:47:19.001924 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96448384-d7bb-4382-a4b2-b98d5aa02ce3 None None] Checking segment: {'id': 'cb645b8a-5d02-4c72-9e6f-dda9f5c57a07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '0e9cae05-4caf-4321-8322-e071c54fdaec'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:47:19.002313 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-96448384-d7bb-4382-a4b2-b98d5aa02ce3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.002712 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-96448384-d7bb-4382-a4b2-b98d5aa02ce3 None None] Bound using segment: {'id': 'cb645b8a-5d02-4c72-9e6f-dda9f5c57a07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '0e9cae05-4caf-4321-8322-e071c54fdaec'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:47:19.003206 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-96448384-d7bb-4382-a4b2-b98d5aa02ce3 None None] Bound port: 5fc45fe1-02ba-4838-81d4-d93a9372db56, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cb645b8a-5d02-4c72-9e6f-dda9f5c57a07', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 113, 'network_id': '0e9cae05-4caf-4321-8322-e071c54fdaec'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:47:19.005024 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b80de9df-1216-4819-97ee-9d70f9cf4c47 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.007646 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-96448384-d7bb-4382-a4b2-b98d5aa02ce3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.010265 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-39980456-9691-4455-8bcb-8e5d9fc6eca2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Deleting port e6e780bc-5481-46c0-b1d4-140a4d417a11 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:47:19.010618 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-39980456-9691-4455-8bcb-8e5d9fc6eca2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.076520 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port a41b2012-50f6-4ed6-a81b-1d858c64e6f6 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:19.077262 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.099039 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b80de9df-1216-4819-97ee-9d70f9cf4c47 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.103886 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b80de9df-1216-4819-97ee-9d70f9cf4c47 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.126285 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b80de9df-1216-4819-97ee-9d70f9cf4c47 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cb135ec1-fdd4-457d-b854-fac7c84797c4,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:19.146099 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b80de9df-1216-4819-97ee-9d70f9cf4c47 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.155361 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b80de9df-1216-4819-97ee-9d70f9cf4c47 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2058842 Dec 09 21:47:19.155361 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44900) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:19.159607 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-0d5894b3-04a0-4dee-9359-c283b43f5a43 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Request body: {'security_group_rule': {'security_group_id': 'ba9a2782-7ce7-4b6a-98cb-4d01620d7b58', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'ipv6-icmp', 'port_range_min': 11, 'port_range_max': None, 'remote_group_id': None, 'remote_ip_prefix': None}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:19.202050 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d5894b3-04a0-4dee-9359-c283b43f5a43 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.275145 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.289411 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d5894b3-04a0-4dee-9359-c283b43f5a43 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.303798 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d5894b3-04a0-4dee-9359-c283b43f5a43 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.307800 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-96448384-d7bb-4382-a4b2-b98d5aa02ce3 None None] For port 5fc45fe1-02ba-4838-81d4-d93a9372db56, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:47:19.325689 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d5894b3-04a0-4dee-9359-c283b43f5a43 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c61e9c33-371a-4ebd-b9d3-e36c69fd6cc5,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:19.338865 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port a41b2012-50f6-4ed6-a81b-1d858c64e6f6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a41b2012-50f6-4ed6-a81b-1d858c64e6f6,segment=NetworkSegment(96ebe272-33cc-4e4e-a26a-639d4cbc5b6c),segment_id=96ebe272-33cc-4e4e-a26a-639d4cbc5b6c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:19.341614 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-96448384-d7bb-4382-a4b2-b98d5aa02ce3 None None] For port 5fc45fe1-02ba-4838-81d4-d93a9372db56, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5fc45fe1-02ba-4838-81d4-d93a9372db56,segment=NetworkSegment(cb645b8a-5d02-4c72-9e6f-dda9f5c57a07),segment_id=cb645b8a-5d02-4c72-9e6f-dda9f5c57a07)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:47:19.345040 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.352255 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d5894b3-04a0-4dee-9359-c283b43f5a43 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.357302 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0d5894b3-04a0-4dee-9359-c283b43f5a43 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 772 time: 0.2025824 Dec 09 21:47:19.357987 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44902) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:19.382931 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bcd0b363-ad30-4752-ba5a-56236d29c3d6 None None] Network 940cad56-2f35-40f8-9ed5-25a1c83dbeda requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:47:19.390717 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-96448384-d7bb-4382-a4b2-b98d5aa02ce3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.395477 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-739a1889-988a-4bf9-8e96-c93aa3480ea4 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.405752 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-739a1889-988a-4bf9-8e96-c93aa3480ea4 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.468881 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-39980456-9691-4455-8bcb-8e5d9fc6eca2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] For port e6e780bc-5481-46c0-b1d4-140a4d417a11, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e6e780bc-5481-46c0-b1d4-140a4d417a11,segment=NetworkSegment(2316fee1-a288-4d09-bf17-e0a19e0adf8d),segment_id=2316fee1-a288-4d09-bf17-e0a19e0adf8d)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:19.469239 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-39980456-9691-4455-8bcb-8e5d9fc6eca2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.491910 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3fa1adc-cbd4-4571-97fb-3d121b91ec89 req-b0bac124-6182-49e1-9c2a-ae167c76de9a tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/ports?device_id=adfb178e-8542-42ce-9636-b14306116737 HTTP/1.1" status: 200 len: 210 time: 0.0517306 Dec 09 21:47:19.498621 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-739a1889-988a-4bf9-8e96-c93aa3480ea4 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.505868 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-739a1889-988a-4bf9-8e96-c93aa3480ea4 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.510744 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-39980456-9691-4455-8bcb-8e5d9fc6eca2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Calling delete_port for e6e780bc-5481-46c0-b1d4-140a4d417a11 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:47:19.511260 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-739a1889-988a-4bf9-8e96-c93aa3480ea4 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "DELETE /v2.0/security-group-rules/c61e9c33-371a-4ebd-b9d3-e36c69fd6cc5 HTTP/1.1" status: 204 len: 168 time: 0.1513019 Dec 09 21:47:19.512460 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44906) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:19.559123 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-739a1889-988a-4bf9-8e96-c93aa3480ea4 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=c61e9c33-371a-4ebd-b9d3-e36c69fd6cc5,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:19.568678 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=a41b2012-50f6-4ed6-a81b-1d858c64e6f6,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:19.580662 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6700fbc0-429f-4fa7-89ed-5b6c435707fa None None] Provisioning complete for port a41b2012-50f6-4ed6-a81b-1d858c64e6f6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:19.581137 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6700fbc0-429f-4fa7-89ed-5b6c435707fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.598537 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c00530ad-1550-4b1a-b39d-7445f5f3ff66 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5751 time: 0.0710917 Dec 09 21:47:19.599362 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44910) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:19.628611 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9294c67c-595f-49c8-b9ac-e48a6b29e9ae tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.640875 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9294c67c-595f-49c8-b9ac-e48a6b29e9ae tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.679750 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9294c67c-595f-49c8-b9ac-e48a6b29e9ae tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.686690 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9294c67c-595f-49c8-b9ac-e48a6b29e9ae tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.691184 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9294c67c-595f-49c8-b9ac-e48a6b29e9ae tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "DELETE /v2.0/security-group-rules/cb135ec1-fdd4-457d-b854-fac7c84797c4 HTTP/1.1" status: 204 len: 168 time: 0.0906785 Dec 09 21:47:19.702953 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44914) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:19.703221 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9294c67c-595f-49c8-b9ac-e48a6b29e9ae tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=cb135ec1-fdd4-457d-b854-fac7c84797c4,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:19.768529 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96448384-d7bb-4382-a4b2-b98d5aa02ce3 None None] Pushing event updated for resources: {'Port': ['ID=5fc45fe1-02ba-4838-81d4-d93a9372db56,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:19.779609 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f7a8dcb3-e5c4-452d-8216-961b4efb6e06 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 5205 time: 0.0687783 Dec 09 21:47:19.779609 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44916) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:19.811663 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-03e1e354-2f11-4155-a070-f8ddefb73bfd tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.822581 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-03e1e354-2f11-4155-a070-f8ddefb73bfd tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.884759 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-6b4e8fa0-057d-4d03-90cc-eb7347c13b8b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Allocated IP 172.20.0.1 (940cad56-2f35-40f8-9ed5-25a1c83dbeda/3f2e4b28-1001-407c-b523-5ee42432aa45/ee8705ae-e058-46c9-92c5-3079cbeb1485) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:47:19.894409 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-03e1e354-2f11-4155-a070-f8ddefb73bfd tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.910488 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-03e1e354-2f11-4155-a070-f8ddefb73bfd tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:19.914811 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-03e1e354-2f11-4155-a070-f8ddefb73bfd tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "DELETE /v2.0/security-group-rules/43ebd2bd-09cf-4eab-bcb3-004576da462e HTTP/1.1" status: 204 len: 168 time: 0.1363223 Dec 09 21:47:19.915626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44918) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:19.979850 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03e1e354-2f11-4155-a070-f8ddefb73bfd tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=43ebd2bd-09cf-4eab-bcb3-004576da462e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:19.998144 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-15d78583-9913-4ce8-8bb8-119477c7efc6 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4659 time: 0.0754392 Dec 09 21:47:19.998995 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44922) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:20.029692 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da0647cc-4121-4379-a564-66ca4bd701c2 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:20.048965 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da0647cc-4121-4379-a564-66ca4bd701c2 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:20.096041 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da0647cc-4121-4379-a564-66ca4bd701c2 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:20.104552 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da0647cc-4121-4379-a564-66ca4bd701c2 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:20.105827 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-da0647cc-4121-4379-a564-66ca4bd701c2 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "DELETE /v2.0/security-group-rules/10237836-4336-4d53-9754-88c3b36c8bae HTTP/1.1" status: 204 len: 168 time: 0.1057498 Dec 09 21:47:20.112423 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44924) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:20.133583 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da0647cc-4121-4379-a564-66ca4bd701c2 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=10237836-4336-4d53-9754-88c3b36c8bae,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:20.170277 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0d90acf1-e99d-481f-bf6a-978456ccc769 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0531998 Dec 09 21:47:20.170277 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44926) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:20.204691 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee820794-a60e-4aa6-be55-ed13b253d682 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:20.216959 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee820794-a60e-4aa6-be55-ed13b253d682 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:20.262582 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee820794-a60e-4aa6-be55-ed13b253d682 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:20.280219 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee820794-a60e-4aa6-be55-ed13b253d682 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:20.283902 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ee820794-a60e-4aa6-be55-ed13b253d682 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "DELETE /v2.0/security-group-rules/532434a6-3558-448e-b8a0-01559afd4042 HTTP/1.1" status: 204 len: 168 time: 0.1107907 Dec 09 21:47:20.286043 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44928) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:20.305574 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee820794-a60e-4aa6-be55-ed13b253d682 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=532434a6-3558-448e-b8a0-01559afd4042,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:20.329382 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-86bb8add-9e8e-48aa-b781-ce9444a53093 None None] Provisioning complete for port a41b2012-50f6-4ed6-a81b-1d858c64e6f6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:20.329992 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-86bb8add-9e8e-48aa-b781-ce9444a53093 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:20.362091 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5a38aff6-f486-4d0d-972d-9e6b7e4532c9 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0719001 Dec 09 21:47:20.362332 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44930) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:20.436605 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-36e7f564-ffb3-46bb-a24a-ecd25c305077 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:20.469824 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-36e7f564-ffb3-46bb-a24a-ecd25c305077 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:20.532039 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-36e7f564-ffb3-46bb-a24a-ecd25c305077 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:20.538828 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-36e7f564-ffb3-46bb-a24a-ecd25c305077 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:20.540803 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-36e7f564-ffb3-46bb-a24a-ecd25c305077 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "DELETE /v2.0/security-groups/ba9a2782-7ce7-4b6a-98cb-4d01620d7b58 HTTP/1.1" status: 204 len: 168 time: 0.1754320 Dec 09 21:47:20.551373 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44934) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:20.578875 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36e7f564-ffb3-46bb-a24a-ecd25c305077 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ba9a2782-7ce7-4b6a-98cb-4d01620d7b58,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:20.722726 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d0ddd54b-b97f-48d4-a538-40a609b5038f tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1701078 Dec 09 21:47:20.729135 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44936) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:20.738131 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-39980456-9691-4455-8bcb-8e5d9fc6eca2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:20.769875 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-ad023b6e-dfdf-4673-a465-cc0ca30ce21e tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Request body: {'security_group': {'name': 'tempest-secgroup--1996203661'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:20.782554 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6b4e8fa0-057d-4d03-90cc-eb7347c13b8b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:20.790920 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3d29e66b-3808-4acf-b298-65d5077ba321 req-ae5a4fcd-735d-4c6f-8f97-d8c76b18cb4a tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/ports?device_id=adfb178e-8542-42ce-9636-b14306116737 HTTP/1.1" status: 200 len: 210 time: 0.1150246 Dec 09 21:47:20.807746 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39980456-9691-4455-8bcb-8e5d9fc6eca2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'Port': ['ID=e6e780bc-5481-46c0-b1d4-140a4d417a11,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:20.883409 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ad023b6e-dfdf-4673-a465-cc0ca30ce21e tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:20.980985 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5fc45fe1-02ba-4838-81d4-d93a9372db56 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:47:20.994971 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-5a5f0d84-5978-4d5b-ab5a-85f050f5be7e tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:20.999031 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-5a5f0d84-5978-4d5b-ab5a-85f050f5be7e tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.31 "GET /v2.0/networks?id=1f6c6308-b8f8-453f-b9f3-49b33791e0ee HTTP/1.1" status: 200 len: 809 time: 0.3284895 Dec 09 21:47:21.081195 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 5fc45fe1-02ba-4838-81d4-d93a9372db56 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:21.082110 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:21.161833 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-39980456-9691-4455-8bcb-8e5d9fc6eca2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:21.167837 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-c15aff97-8da7-40cd-a6f7-26abd44452f6 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Request body: {'port': {'device_id': 'adfb178e-8542-42ce-9636-b14306116737', 'network_id': '1f6c6308-b8f8-453f-b9f3-49b33791e0ee', 'admin_state_up': True, 'tenant_id': '2be7af74c5cc43908a744820a98fc9c0'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:21.173774 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6b4e8fa0-057d-4d03-90cc-eb7347c13b8b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:21.178316 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ad023b6e-dfdf-4673-a465-cc0ca30ce21e tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:21.197148 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:21.208701 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ad023b6e-dfdf-4673-a465-cc0ca30ce21e tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:21.257864 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 5fc45fe1-02ba-4838-81d4-d93a9372db56, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5fc45fe1-02ba-4838-81d4-d93a9372db56,segment=NetworkSegment(cb645b8a-5d02-4c72-9e6f-dda9f5c57a07),segment_id=cb645b8a-5d02-4c72-9e6f-dda9f5c57a07)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:21.265793 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:21.266788 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a41b2012-50f6-4ed6-a81b-1d858c64e6f6 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:47:21.268079 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ad023b6e-dfdf-4673-a465-cc0ca30ce21e tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:21.272351 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ad023b6e-dfdf-4673-a465-cc0ca30ce21e tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.5068469 Dec 09 21:47:21.283069 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44940) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:21.293229 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-eb70a6ab-da28-4331-b795-97fb1fcaafef tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Request body: {'security_group_rule': {'security_group_id': 'c254d844-07e2-4355-bbb2-9f5e1bc7c4f0', 'direction': 'ingress', 'protocol': 17}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:21.315721 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad023b6e-dfdf-4673-a465-cc0ca30ce21e tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c254d844-07e2-4355-bbb2-9f5e1bc7c4f0,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:21.338846 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b4e8fa0-057d-4d03-90cc-eb7347c13b8b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Port': ['ID=ee8705ae-e058-46c9-92c5-3079cbeb1485,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:21.350129 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b4e8fa0-057d-4d03-90cc-eb7347c13b8b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network 940cad56-2f35-40f8-9ed5-25a1c83dbeda is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:47:21.356024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-6b4e8fa0-057d-4d03-90cc-eb7347c13b8b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:21.359512 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eb70a6ab-da28-4331-b795-97fb1fcaafef tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:21.363286 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b4e8fa0-057d-4d03-90cc-eb7347c13b8b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:47:21.375082 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1d3ccb3-5ddc-42c8-b40e-88fd5acee5f1 None None] Network 0e9cae05-4caf-4321-8322-e071c54fdaec requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:47:21.431365 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=5fc45fe1-02ba-4838-81d4-d93a9372db56,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:21.453800 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eb70a6ab-da28-4331-b795-97fb1fcaafef tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:21.461361 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eb70a6ab-da28-4331-b795-97fb1fcaafef tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:21.482463 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3ec006dc-a2f2-4803-b9f0-cd6131230b66 None None] Provisioning complete for port 5fc45fe1-02ba-4838-81d4-d93a9372db56 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:21.483270 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3ec006dc-a2f2-4803-b9f0-cd6131230b66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:21.519796 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eb70a6ab-da28-4331-b795-97fb1fcaafef tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:21.521022 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-eb70a6ab-da28-4331-b795-97fb1fcaafef tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 767 time: 0.2328560 Dec 09 21:47:21.522307 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb70a6ab-da28-4331-b795-97fb1fcaafef tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3839a934-212b-44f2-b27d-63a4475b3df0,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:21.537512 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44942) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:21.555216 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port a41b2012-50f6-4ed6-a81b-1d858c64e6f6 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:21.556031 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:21.585057 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6b4e8fa0-057d-4d03-90cc-eb7347c13b8b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:21.647202 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8d751777-536b-4036-a8d3-63730ab74be6 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:21.689402 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8d751777-536b-4036-a8d3-63730ab74be6 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:21.773659 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8d751777-536b-4036-a8d3-63730ab74be6 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:21.776790 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8d751777-536b-4036-a8d3-63730ab74be6 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:21.778131 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8d751777-536b-4036-a8d3-63730ab74be6 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "DELETE /v2.0/security-groups/c254d844-07e2-4355-bbb2-9f5e1bc7c4f0 HTTP/1.1" status: 204 len: 168 time: 0.2402549 Dec 09 21:47:21.784013 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-c15aff97-8da7-40cd-a6f7-26abd44452f6 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Made reservation on behalf of 2be7af74c5cc43908a744820a98fc9c0 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:47:21.789192 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-c15aff97-8da7-40cd-a6f7-26abd44452f6 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:21.802678 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44944) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:21.813920 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d751777-536b-4036-a8d3-63730ab74be6 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c254d844-07e2-4355-bbb2-9f5e1bc7c4f0,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:21.868538 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1e2ab482-2cf9-45cd-b799-6cd882cc16d1 None None] Provisioning complete for port ee8705ae-e058-46c9-92c5-3079cbeb1485 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:21.869167 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1e2ab482-2cf9-45cd-b799-6cd882cc16d1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:21.937032 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-1e2ab482-2cf9-45cd-b799-6cd882cc16d1 None None] Port ee8705ae-e058-46c9-92c5-3079cbeb1485 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:47:21.952868 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a6d9cbe2-3963-40e5-ab06-1a7fc55e2aad req-81fa8503-752f-4ebe-be49-6039c3264ddb tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/ports?device_id=adfb178e-8542-42ce-9636-b14306116737 HTTP/1.1" status: 200 len: 210 time: 0.0336957 Dec 09 21:47:22.043599 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6b4e8fa0-057d-4d03-90cc-eb7347c13b8b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.055203 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b63fc5eb-eee2-447d-b45e-b9dd0cdb59cc None None] Provisioning complete for port 5fc45fe1-02ba-4838-81d4-d93a9372db56 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:22.055531 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b63fc5eb-eee2-447d-b45e-b9dd0cdb59cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.062047 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a92c6746-db63-4ab6-9cb4-8a9a3980b601 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.2547927 Dec 09 21:47:22.062840 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44948) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:22.071002 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a1e1ce3a-2b6e-4214-97c3-b171bddaf95a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Request body: {'security_group': {'name': 'tempest-secgroup--407136245'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:22.099639 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a1e1ce3a-2b6e-4214-97c3-b171bddaf95a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.127229 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-39980456-9691-4455-8bcb-8e5d9fc6eca2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Router 71037eba-17b6-499e-8ba6-3a08aa3db0b5 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:47:22.193117 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a1e1ce3a-2b6e-4214-97c3-b171bddaf95a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.198551 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a1e1ce3a-2b6e-4214-97c3-b171bddaf95a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.230531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1e1ce3a-2b6e-4214-97c3-b171bddaf95a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event updated for resources: {'SecurityGroup': ['ID=36e4d553-51a0-4a26-9719-1967f105a1ad,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:22.240291 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a1e1ce3a-2b6e-4214-97c3-b171bddaf95a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.244266 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a1e1ce3a-2b6e-4214-97c3-b171bddaf95a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.1772764 Dec 09 21:47:22.244852 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44950) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:22.250937 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-027c34cb-794e-4552-88eb-dc73b3a9ef5a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Request body: {'security_group': {'name': 'tempest-secgroup--1078892069'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:22.252522 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-c15aff97-8da7-40cd-a6f7-26abd44452f6 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Allocated IP 172.20.0.8 (1f6c6308-b8f8-453f-b9f3-49b33791e0ee/1f76b74e-fb7e-4b78-bd58-a21de3f810b9/fb9f4126-c8f9-4d33-b0f7-3a9218c6e391) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:47:22.279829 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-027c34cb-794e-4552-88eb-dc73b3a9ef5a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.369253 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-027c34cb-794e-4552-88eb-dc73b3a9ef5a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.374690 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-027c34cb-794e-4552-88eb-dc73b3a9ef5a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.412974 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-027c34cb-794e-4552-88eb-dc73b3a9ef5a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.414534 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-027c34cb-794e-4552-88eb-dc73b3a9ef5a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.1691587 Dec 09 21:47:22.418474 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44954) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:22.425062 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-d704c3a7-40fa-45a8-9f97-62c0893139b4 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Request body: {'security_group_rule': {'security_group_id': '36e4d553-51a0-4a26-9719-1967f105a1ad', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'udp', 'port_range_min': 50, 'port_range_max': 55, 'remote_group_id': 'e0b59664-68cc-4ff5-809a-a4e2aceb0908', 'remote_ip_prefix': None}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:22.430646 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-027c34cb-794e-4552-88eb-dc73b3a9ef5a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e0b59664-68cc-4ff5-809a-a4e2aceb0908,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:22.460883 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d704c3a7-40fa-45a8-9f97-62c0893139b4 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.508745 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-39980456-9691-4455-8bcb-8e5d9fc6eca2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:47:22.522081 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-39980456-9691-4455-8bcb-8e5d9fc6eca2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "PUT /v2.0/routers/71037eba-17b6-499e-8ba6-3a08aa3db0b5/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 5.4905369 Dec 09 21:47:22.528366 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e8f1cf6-a172-4004-ac81-12a8ae900631 None None] Sync routers for ids ['71037eba-17b6-499e-8ba6-3a08aa3db0b5'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:47:22.528953 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44956) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:22.539751 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e8f1cf6-a172-4004-ac81-12a8ae900631 None None] Routers {'71037eba-17b6-499e-8ba6-3a08aa3db0b5'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:47:22.541030 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-1e8f1cf6-a172-4004-ac81-12a8ae900631 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['71037eba-17b6-499e-8ba6-3a08aa3db0b5'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:22.549917 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d704c3a7-40fa-45a8-9f97-62c0893139b4 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.557100 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d704c3a7-40fa-45a8-9f97-62c0893139b4 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.577416 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d704c3a7-40fa-45a8-9f97-62c0893139b4 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a8344efa-3bd3-4abf-a61b-36786689b2c9,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:22.595077 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d704c3a7-40fa-45a8-9f97-62c0893139b4 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.596842 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d704c3a7-40fa-45a8-9f97-62c0893139b4 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 798 time: 0.1774087 Dec 09 21:47:22.599598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44958) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:22.631530 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-737828d9-07b2-4e62-82d6-f0fd4e9bbc37 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.643939 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-737828d9-07b2-4e62-82d6-f0fd4e9bbc37 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.676442 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-1e8f1cf6-a172-4004-ac81-12a8ae900631 None None] Set router 71037eba-17b6-499e-8ba6-3a08aa3db0b5 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:47:22.682434 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-737828d9-07b2-4e62-82d6-f0fd4e9bbc37 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.698942 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-737828d9-07b2-4e62-82d6-f0fd4e9bbc37 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.702911 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-737828d9-07b2-4e62-82d6-f0fd4e9bbc37 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "DELETE /v2.0/security-group-rules/a8344efa-3bd3-4abf-a61b-36786689b2c9 HTTP/1.1" status: 204 len: 168 time: 0.0997171 Dec 09 21:47:22.702911 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-737828d9-07b2-4e62-82d6-f0fd4e9bbc37 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=a8344efa-3bd3-4abf-a61b-36786689b2c9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:22.703830 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44960) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:22.708897 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-852fa241-dbd9-484e-afc4-e7efdeef5f55 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Deleting subnet 017fde5b-ddc1-4da5-8c6b-2b98296748e5 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:47:22.716214 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-852fa241-dbd9-484e-afc4-e7efdeef5f55 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.758088 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6b4e8fa0-057d-4d03-90cc-eb7347c13b8b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.759462 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-aec55fd3-cb2d-4eb9-a14b-c2e9eeac2b86 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4659 time: 0.0546215 Dec 09 21:47:22.762312 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44962) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:22.781846 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6b4e8fa0-057d-4d03-90cc-eb7347c13b8b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.799898 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-c15aff97-8da7-40cd-a6f7-26abd44452f6 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.863479 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-852fa241-dbd9-484e-afc4-e7efdeef5f55 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.880249 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1171ff31-907b-4aaf-ba00-480ec4968516 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.919498 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5fc45fe1-02ba-4838-81d4-d93a9372db56 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:47:22.930082 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1171ff31-907b-4aaf-ba00-480ec4968516 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.936906 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b4e8fa0-057d-4d03-90cc-eb7347c13b8b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Port': ['ID=ee8705ae-e058-46c9-92c5-3079cbeb1485,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:22.945154 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6b4e8fa0-057d-4d03-90cc-eb7347c13b8b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:22.961226 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-1e8f1cf6-a172-4004-ac81-12a8ae900631 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'name': 'tempest-TestNetworkAdvancedServerOps-router-446132443', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53'}], 'enable_snat': True}, 'gw_port_id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:47:20Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2d:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2974, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:22.999850 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1171ff31-907b-4aaf-ba00-480ec4968516 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:23.008496 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e8f1cf6-a172-4004-ac81-12a8ae900631 None None] Checking router: 71037eba-17b6-499e-8ba6-3a08aa3db0b5 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:47:23.008881 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1171ff31-907b-4aaf-ba00-480ec4968516 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:23.010091 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1171ff31-907b-4aaf-ba00-480ec4968516 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "DELETE /v2.0/security-groups/e0b59664-68cc-4ff5-809a-a4e2aceb0908 HTTP/1.1" status: 204 len: 168 time: 0.2431042 Dec 09 21:47:23.018132 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44966) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:23.023751 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e8f1cf6-a172-4004-ac81-12a8ae900631 None None] Routers {'71037eba-17b6-499e-8ba6-3a08aa3db0b5'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:47:23.025194 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-1e8f1cf6-a172-4004-ac81-12a8ae900631 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['71037eba-17b6-499e-8ba6-3a08aa3db0b5'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:23.033657 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-c15aff97-8da7-40cd-a6f7-26abd44452f6 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:23.056035 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 5fc45fe1-02ba-4838-81d4-d93a9372db56 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:23.056645 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:23.063878 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1171ff31-907b-4aaf-ba00-480ec4968516 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e0b59664-68cc-4ff5-809a-a4e2aceb0908,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:23.149736 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-852fa241-dbd9-484e-afc4-e7efdeef5f55 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:23.166295 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-1e8f1cf6-a172-4004-ac81-12a8ae900631 None None] Set router 71037eba-17b6-499e-8ba6-3a08aa3db0b5 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:47:23.201043 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbcc7d81-9b0d-4262-b247-f70368fdd4a9 req-09cb29a2-67f6-4963-8c3a-a79fe2439b90 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:23.203023 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dbcc7d81-9b0d-4262-b247-f70368fdd4a9 req-09cb29a2-67f6-4963-8c3a-a79fe2439b90 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/ports?device_id=adfb178e-8542-42ce-9636-b14306116737 HTTP/1.1" status: 200 len: 931 time: 0.1296568 Dec 09 21:47:23.215905 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-c15aff97-8da7-40cd-a6f7-26abd44452f6 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Network 1f6c6308-b8f8-453f-b9f3-49b33791e0ee is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:47:23.219837 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-50173c50-0a50-432c-939c-490eb9a49e60 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 4544 time: 0.1971030 Dec 09 21:47:23.220660 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44968) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:23.233751 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-c15aff97-8da7-40cd-a6f7-26abd44452f6 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:23.241686 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-c15aff97-8da7-40cd-a6f7-26abd44452f6 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:47:23.249883 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c15aff97-8da7-40cd-a6f7-26abd44452f6 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Pushing event updated for resources: {'Port': ['ID=fb9f4126-c8f9-4d33-b0f7-3a9218c6e391,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:23.294165 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b4e8fa0-057d-4d03-90cc-eb7347c13b8b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network 940cad56-2f35-40f8-9ed5-25a1c83dbeda is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:47:23.306170 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-6b4e8fa0-057d-4d03-90cc-eb7347c13b8b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:23.329137 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dbcc7d81-9b0d-4262-b247-f70368fdd4a9 req-1426cbed-7467-41fc-a6b2-acf5dc802619 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/security-groups?id=6236a31a-7414-45a5-80b0-e5c8c72b2bb7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1065364 Dec 09 21:47:23.359970 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9effc167-ad08-476d-8957-d0c37fc361c7 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:23.393744 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9effc167-ad08-476d-8957-d0c37fc361c7 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:23.467062 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9effc167-ad08-476d-8957-d0c37fc361c7 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:23.472798 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9effc167-ad08-476d-8957-d0c37fc361c7 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:23.476740 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9effc167-ad08-476d-8957-d0c37fc361c7 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "DELETE /v2.0/security-groups/36e4d553-51a0-4a26-9719-1967f105a1ad HTTP/1.1" status: 204 len: 168 time: 0.2506850 Dec 09 21:47:23.478721 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44974) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:23.523851 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9effc167-ad08-476d-8957-d0c37fc361c7 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=36e4d553-51a0-4a26-9719-1967f105a1ad,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:23.568511 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-778fa913-a067-4443-9928-4c71bdc0461d tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.0845208 Dec 09 21:47:23.569688 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44976) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:23.575219 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-4138a89c-fe75-4645-8d8e-fe340c8fa34a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Request body: {'security_group': {'name': 'tempest-secgroup--2134931967'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:23.613312 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4138a89c-fe75-4645-8d8e-fe340c8fa34a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:23.685528 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-1e8f1cf6-a172-4004-ac81-12a8ae900631 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'name': 'tempest-TestNetworkAdvancedServerOps-router-446132443', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53'}], 'enable_snat': True}, 'gw_port_id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:47:20Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2d:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2974, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:23.704143 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-923dfb88-60cd-471c-8218-3dcafb397653 None None] Provisioning complete for port ee8705ae-e058-46c9-92c5-3079cbeb1485 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:23.705494 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-923dfb88-60cd-471c-8218-3dcafb397653 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:23.722655 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e8f1cf6-a172-4004-ac81-12a8ae900631 None None] The sync data for ids ['71037eba-17b6-499e-8ba6-3a08aa3db0b5'] in n-d-713301-27 is: [{'id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'name': 'tempest-TestNetworkAdvancedServerOps-router-446132443', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53'}], 'enable_snat': True}, 'gw_port_id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:47:20Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '8d6065cf-1cdc-4069-87fe-4730f83e3cd7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:2d:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71037eba-17b6-499e-8ba6-3a08aa3db0b5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 2974, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.53', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:45:04Z', 'updated_at': '2021-12-09T21:45:09Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:47:23.740492 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4138a89c-fe75-4645-8d8e-fe340c8fa34a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:23.749835 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4138a89c-fe75-4645-8d8e-fe340c8fa34a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:23.752166 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-923dfb88-60cd-471c-8218-3dcafb397653 None None] Port ee8705ae-e058-46c9-92c5-3079cbeb1485 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:47:23.802451 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4138a89c-fe75-4645-8d8e-fe340c8fa34a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:23.803779 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4138a89c-fe75-4645-8d8e-fe340c8fa34a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1763 time: 0.2330287 Dec 09 21:47:23.806579 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44978) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:23.811843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c84d5735-390f-4023-8e5a-104633730edb tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Request body: {'security_group_rule': {'security_group_id': '252f51a2-78e8-45b1-97ae-c3eed7233561', 'direction': 'ingress', 'ethertype': 'IPv6', 'protocol': 'tcp', 'port_range_min': 76, 'port_range_max': 77, 'remote_group_id': None, 'remote_ip_prefix': '2001:db8::/48'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:23.817273 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4138a89c-fe75-4645-8d8e-fe340c8fa34a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event updated for resources: {'SecurityGroup': ['ID=252f51a2-78e8-45b1-97ae-c3eed7233561,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:23.827636 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-c15aff97-8da7-40cd-a6f7-26abd44452f6 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:23.828190 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-c15aff97-8da7-40cd-a6f7-26abd44452f6 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:23.857860 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c84d5735-390f-4023-8e5a-104633730edb tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:23.871698 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-852fa241-dbd9-484e-afc4-e7efdeef5f55 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:23.908339 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-c15aff97-8da7-40cd-a6f7-26abd44452f6 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.7474771 Dec 09 21:47:23.913213 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-852fa241-dbd9-484e-afc4-e7efdeef5f55 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'Subnet': ['ID=017fde5b-ddc1-4da5-8c6b-2b98296748e5,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:23.920036 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-852fa241-dbd9-484e-afc4-e7efdeef5f55 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:23.926023 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-852fa241-dbd9-484e-afc4-e7efdeef5f55 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "DELETE /v2.0/subnets/017fde5b-ddc1-4da5-8c6b-2b98296748e5 HTTP/1.1" status: 204 len: 168 time: 1.3927295 Dec 09 21:47:23.926176 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0bf3530a-9113-4a08-9296-c516471222a7 None None] Network 4fbe35af-30ff-45b2-b84a-21fea4abf9aa requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:47:23.927311 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-4a1fec07-c63f-4509-ba7e-791777c59ac3 service neutron] Request body: {'port': {'device_id': 'adfb178e-8542-42ce-9636-b14306116737', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:23.935857 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44980) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:23.996360 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c84d5735-390f-4023-8e5a-104633730edb tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:24.008771 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-4a1fec07-c63f-4509-ba7e-791777c59ac3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:24.054525 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6b4e8fa0-057d-4d03-90cc-eb7347c13b8b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Router 4d8df6d4-f96f-4643-8663-28df67a09dd9 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:47:24.088682 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d4c56b8b-f41d-4d61-8250-19ac44df3658 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:24.092983 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c84d5735-390f-4023-8e5a-104633730edb tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:24.121212 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4bbaf4dd-e104-4740-a744-329ec9b97e5b None None] DHCP port deletion for 4fbe35af-30ff-45b2-b84a-21fea4abf9aa request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:47:24.199700 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-4bbaf4dd-e104-4740-a744-329ec9b97e5b None None] Deleting port f466ec8c-c7fd-4a9a-beb5-e4041b079f89 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:47:24.200309 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4bbaf4dd-e104-4740-a744-329ec9b97e5b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:24.253649 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c84d5735-390f-4023-8e5a-104633730edb tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d3107df7-ba07-426d-9e84-232270f6c6d1,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:24.259253 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c84d5735-390f-4023-8e5a-104633730edb tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:24.260606 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c84d5735-390f-4023-8e5a-104633730edb tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 786 time: 0.4529517 Dec 09 21:47:24.263858 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44982) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:24.280855 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-4bbaf4dd-e104-4740-a744-329ec9b97e5b None None] For port f466ec8c-c7fd-4a9a-beb5-e4041b079f89, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f466ec8c-c7fd-4a9a-beb5-e4041b079f89,segment=NetworkSegment(2316fee1-a288-4d09-bf17-e0a19e0adf8d),segment_id=2316fee1-a288-4d09-bf17-e0a19e0adf8d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:24.281301 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4bbaf4dd-e104-4740-a744-329ec9b97e5b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:24.301298 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6b4e8fa0-057d-4d03-90cc-eb7347c13b8b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:47:24.304214 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-4bbaf4dd-e104-4740-a744-329ec9b97e5b None None] Calling delete_port for f466ec8c-c7fd-4a9a-beb5-e4041b079f89 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:47:24.306041 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-65f6ee04-5e04-4460-9986-fe496c2087b4 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:24.310279 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6b4e8fa0-057d-4d03-90cc-eb7347c13b8b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/routers/4d8df6d4-f96f-4643-8663-28df67a09dd9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.9865873 Dec 09 21:47:24.313884 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44984) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:24.314404 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-65f6ee04-5e04-4460-9986-fe496c2087b4 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:24.322222 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff64e924-da7a-4b2a-8c6e-d7a06105e5e7 None None] Sync routers for ids ['4d8df6d4-f96f-4643-8663-28df67a09dd9'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:47:24.351905 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-65f6ee04-5e04-4460-9986-fe496c2087b4 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:24.371634 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-65f6ee04-5e04-4460-9986-fe496c2087b4 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:24.375616 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-65f6ee04-5e04-4460-9986-fe496c2087b4 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "DELETE /v2.0/security-group-rules/d3107df7-ba07-426d-9e84-232270f6c6d1 HTTP/1.1" status: 204 len: 168 time: 0.1081827 Dec 09 21:47:24.379768 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 44988) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:24.396657 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-20850ba4-c328-41a3-8d3a-c3905d216fb1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:24.398125 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-20850ba4-c328-41a3-8d3a-c3905d216fb1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/ports/ee8705ae-e058-46c9-92c5-3079cbeb1485 HTTP/1.1" status: 200 len: 910 time: 0.0832884 Dec 09 21:47:24.399619 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff64e924-da7a-4b2a-8c6e-d7a06105e5e7 None None] Routers {'4d8df6d4-f96f-4643-8663-28df67a09dd9'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:47:24.400578 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-ff64e924-da7a-4b2a-8c6e-d7a06105e5e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4d8df6d4-f96f-4643-8663-28df67a09dd9'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:24.401094 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44990) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:24.405511 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65f6ee04-5e04-4460-9986-fe496c2087b4 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=d3107df7-ba07-426d-9e84-232270f6c6d1,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:24.408302 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d4c56b8b-f41d-4d61-8250-19ac44df3658 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:24.454282 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-ff64e924-da7a-4b2a-8c6e-d7a06105e5e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:24.480910 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2f21793a-bbc8-43b9-a1c4-b0249fa86a27 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0903084 Dec 09 21:47:24.488852 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff64e924-da7a-4b2a-8c6e-d7a06105e5e7 None None] Routers {'4d8df6d4-f96f-4643-8663-28df67a09dd9'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:47:24.489555 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-ff64e924-da7a-4b2a-8c6e-d7a06105e5e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4d8df6d4-f96f-4643-8663-28df67a09dd9'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:24.499543 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44994) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:24.551320 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-ff64e924-da7a-4b2a-8c6e-d7a06105e5e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:24.552122 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff64e924-da7a-4b2a-8c6e-d7a06105e5e7 None None] The sync data for ids ['4d8df6d4-f96f-4643-8663-28df67a09dd9'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:47:24.568773 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4bbaf4dd-e104-4740-a744-329ec9b97e5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:24.604556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-d4c56b8b-f41d-4d61-8250-19ac44df3658 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Deleting port 8d6065cf-1cdc-4069-87fe-4730f83e3cd7 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:47:24.604777 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bbaf4dd-e104-4740-a744-329ec9b97e5b None None] Pushing event deleted for resources: {'Port': ['ID=f466ec8c-c7fd-4a9a-beb5-e4041b079f89,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:24.605255 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d4c56b8b-f41d-4d61-8250-19ac44df3658 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:24.611084 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4bbaf4dd-e104-4740-a744-329ec9b97e5b None None] No DVR routers for this DVR port f466ec8c-c7fd-4a9a-beb5-e4041b079f89 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:47:24.654987 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3994515d-d98c-43c9-85f7-89bd36069bc7 req-363528c2-67cb-4a78-b349-5a476c1ed549 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:24.657453 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3994515d-d98c-43c9-85f7-89bd36069bc7 req-363528c2-67cb-4a78-b349-5a476c1ed549 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/ports?device_id=adfb178e-8542-42ce-9636-b14306116737 HTTP/1.1" status: 200 len: 931 time: 0.1164982 Dec 09 21:47:24.723585 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-4a1fec07-c63f-4509-ba7e-791777c59ac3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fb9f4126-c8f9-4d33-b0f7-3a9218c6e391 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:47:24.731732 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-150a98b5-c7d8-4b4a-ae9d-ce4bd6e36ede tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:24.735860 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-4a1fec07-c63f-4509-ba7e-791777c59ac3 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:24.750586 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-d4c56b8b-f41d-4d61-8250-19ac44df3658 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] For port 8d6065cf-1cdc-4069-87fe-4730f83e3cd7, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=8d6065cf-1cdc-4069-87fe-4730f83e3cd7,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:24.751024 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d4c56b8b-f41d-4d61-8250-19ac44df3658 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:24.761747 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e6e780bc-5481-46c0-b1d4-140a4d417a11 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:47:24.763586 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3994515d-d98c-43c9-85f7-89bd36069bc7 req-79052cb4-265d-4b6a-96fa-7c1fe44c178d tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/security-groups?id=6236a31a-7414-45a5-80b0-e5c8c72b2bb7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0782356 Dec 09 21:47:24.770214 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-d4c56b8b-f41d-4d61-8250-19ac44df3658 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Calling delete_port for 8d6065cf-1cdc-4069-87fe-4730f83e3cd7 owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:47:24.805452 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: e6e780bc-5481-46c0-b1d4-140a4d417a11 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:47:24.805452 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e6e780bc-5481-46c0-b1d4-140a4d417a11 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:47:24.805452 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f466ec8c-c7fd-4a9a-beb5-e4041b079f89 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:47:24.829759 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-150a98b5-c7d8-4b4a-ae9d-ce4bd6e36ede tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:24.830609 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: f466ec8c-c7fd-4a9a-beb5-e4041b079f89 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:47:24.831066 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f466ec8c-c7fd-4a9a-beb5-e4041b079f89 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:47:24.854032 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-4a1fec07-c63f-4509-ba7e-791777c59ac3 service neutron] Transition to ACTIVE for port object fb9f4126-c8f9-4d33-b0f7-3a9218c6e391 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:47:24.887479 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-4a1fec07-c63f-4509-ba7e-791777c59ac3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:24.956764 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d4c56b8b-f41d-4d61-8250-19ac44df3658 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:24.997134 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a1fec07-c63f-4509-ba7e-791777c59ac3 service neutron] Pushing event updated for resources: {'Port': ['ID=fb9f4126-c8f9-4d33-b0f7-3a9218c6e391,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:24.999181 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4c56b8b-f41d-4d61-8250-19ac44df3658 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'Port': ['ID=8d6065cf-1cdc-4069-87fe-4730f83e3cd7,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:25.013620 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb70fe44-6062-4166-ae79-b6b77ee75843 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:47:25.026854 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-150a98b5-c7d8-4b4a-ae9d-ce4bd6e36ede tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.029312 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-150a98b5-c7d8-4b4a-ae9d-ce4bd6e36ede tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.033263 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-150a98b5-c7d8-4b4a-ae9d-ce4bd6e36ede tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "DELETE /v2.0/security-groups/252f51a2-78e8-45b1-97ae-c3eed7233561 HTTP/1.1" status: 204 len: 168 time: 0.5298340 Dec 09 21:47:25.040030 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44996) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:25.074356 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d4c56b8b-f41d-4d61-8250-19ac44df3658 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.093078 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-150a98b5-c7d8-4b4a-ae9d-ce4bd6e36ede tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=252f51a2-78e8-45b1-97ae-c3eed7233561,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:25.171946 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d4c56b8b-f41d-4d61-8250-19ac44df3658 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.174224 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d4c56b8b-f41d-4d61-8250-19ac44df3658 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.178562 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-4a1fec07-c63f-4509-ba7e-791777c59ac3 service neutron] Attempting to bind port fb9f4126-c8f9-4d33-b0f7-3a9218c6e391 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:47:25.178907 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-4a1fec07-c63f-4509-ba7e-791777c59ac3 service neutron] Attempting to bind port fb9f4126-c8f9-4d33-b0f7-3a9218c6e391 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'f4832b4c-9721-4fb3-b34b-0781180d5872', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '1f6c6308-b8f8-453f-b9f3-49b33791e0ee'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:47:25.179250 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-4a1fec07-c63f-4509-ba7e-791777c59ac3 service neutron] Attempting to bind port fb9f4126-c8f9-4d33-b0f7-3a9218c6e391 on network 1f6c6308-b8f8-453f-b9f3-49b33791e0ee {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:47:25.189132 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-91bd956c-c5d5-442f-9397-8aa966ff1bb2 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1461396 Dec 09 21:47:25.193080 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 44998) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:25.197040 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-afb7de43-2be1-46c7-a0fc-13d3586cfa70 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Request body: {'security_group': {'name': 'tempest-secgroup--211377887'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:25.203108 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-4a1fec07-c63f-4509-ba7e-791777c59ac3 service neutron] Port fb9f4126-c8f9-4d33-b0f7-3a9218c6e391 on network 1f6c6308-b8f8-453f-b9f3-49b33791e0ee not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:47:25.203475 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-4a1fec07-c63f-4509-ba7e-791777c59ac3 service neutron] Attempting to bind port fb9f4126-c8f9-4d33-b0f7-3a9218c6e391 on network 1f6c6308-b8f8-453f-b9f3-49b33791e0ee {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:47:25.206354 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30e46094-0d04-4af8-951f-646e5268cea9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.221911 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d4c56b8b-f41d-4d61-8250-19ac44df3658 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.224255 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d4c56b8b-f41d-4d61-8250-19ac44df3658 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Fanout notify agent at l3_agent the message router_deleted on router 71037eba-17b6-499e-8ba6-3a08aa3db0b5 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:47:25.232078 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-4a1fec07-c63f-4509-ba7e-791777c59ac3 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 46, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:47:25.232239 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d4c56b8b-f41d-4d61-8250-19ac44df3658 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.232427 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-4a1fec07-c63f-4509-ba7e-791777c59ac3 service neutron] Checking segment: {'id': 'f4832b4c-9721-4fb3-b34b-0781180d5872', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '1f6c6308-b8f8-453f-b9f3-49b33791e0ee'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:47:25.232850 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-4a1fec07-c63f-4509-ba7e-791777c59ac3 service neutron] Bound using segment: {'id': 'f4832b4c-9721-4fb3-b34b-0781180d5872', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '1f6c6308-b8f8-453f-b9f3-49b33791e0ee'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:47:25.233338 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-4a1fec07-c63f-4509-ba7e-791777c59ac3 service neutron] Bound port: fb9f4126-c8f9-4d33-b0f7-3a9218c6e391, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f4832b4c-9721-4fb3-b34b-0781180d5872', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 125, 'network_id': '1f6c6308-b8f8-453f-b9f3-49b33791e0ee'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:47:25.233648 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-4a1fec07-c63f-4509-ba7e-791777c59ac3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.233879 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d4c56b8b-f41d-4d61-8250-19ac44df3658 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "DELETE /v2.0/routers/71037eba-17b6-499e-8ba6-3a08aa3db0b5 HTTP/1.1" status: 204 len: 168 time: 1.2909706 Dec 09 21:47:25.240354 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45000) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:25.335318 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-54ac26fa-70ea-4aad-9fda-19337347b5d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.337800 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-afb7de43-2be1-46c7-a0fc-13d3586cfa70 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.434798 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-54ac26fa-70ea-4aad-9fda-19337347b5d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.458951 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-54ac26fa-70ea-4aad-9fda-19337347b5d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4fbe35af-30ff-45b2-b84a-21fea4abf9aa']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:25.468946 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-54ac26fa-70ea-4aad-9fda-19337347b5d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2316fee1-a288-4d09-bf17-e0a19e0adf8d') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:25.469556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-54ac26fa-70ea-4aad-9fda-19337347b5d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2316fee1-a288-4d09-bf17-e0a19e0adf8d') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:25.484337 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-54ac26fa-70ea-4aad-9fda-19337347b5d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.498701 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-54ac26fa-70ea-4aad-9fda-19337347b5d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.505286 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-54ac26fa-70ea-4aad-9fda-19337347b5d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Releasing vlan 140 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:47:25.506034 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-54ac26fa-70ea-4aad-9fda-19337347b5d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:47:25.509023 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:47:25.532684 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-4a1fec07-c63f-4509-ba7e-791777c59ac3 service neutron] For port fb9f4126-c8f9-4d33-b0f7-3a9218c6e391, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:47:25.538186 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-4a1fec07-c63f-4509-ba7e-791777c59ac3 service neutron] For port fb9f4126-c8f9-4d33-b0f7-3a9218c6e391, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=fb9f4126-c8f9-4d33-b0f7-3a9218c6e391,segment=NetworkSegment(f4832b4c-9721-4fb3-b34b-0781180d5872),segment_id=f4832b4c-9721-4fb3-b34b-0781180d5872)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:47:25.572239 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-4a1fec07-c63f-4509-ba7e-791777c59ac3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.574495 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-54ac26fa-70ea-4aad-9fda-19337347b5d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.591428 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-54ac26fa-70ea-4aad-9fda-19337347b5d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.599564 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-54ac26fa-70ea-4aad-9fda-19337347b5d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "DELETE /v2.0/networks/4fbe35af-30ff-45b2-b84a-21fea4abf9aa HTTP/1.1" status: 204 len: 168 time: 0.3575583 Dec 09 21:47:25.600222 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45004) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:25.620119 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54ac26fa-70ea-4aad-9fda-19337347b5d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'Network': ['ID=4fbe35af-30ff-45b2-b84a-21fea4abf9aa,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:25.629997 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-4a1fec07-c63f-4509-ba7e-791777c59ac3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:25.630405 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-4a1fec07-c63f-4509-ba7e-791777c59ac3 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.632300 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-4a1fec07-c63f-4509-ba7e-791777c59ac3 service neutron] 10.222.0.31 "PUT /v2.0/ports/fb9f4126-c8f9-4d33-b0f7-3a9218c6e391 HTTP/1.1" status: 200 len: 1092 time: 1.7136457 Dec 09 21:47:25.640514 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'adfb178e-8542-42ce-9636-b14306116737', 'tag': 'fb9f4126-c8f9-4d33-b0f7-3a9218c6e391'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:47:25.643020 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-edfb7909-842a-4935-913a-316f23920aa3" -d '{"events": [{"name": "network-changed", "server_uuid": "adfb178e-8542-42ce-9636-b14306116737", "tag": "fb9f4126-c8f9-4d33-b0f7-3a9218c6e391"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:47:25.671143 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-afb7de43-2be1-46c7-a0fc-13d3586cfa70 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.695671 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-afb7de43-2be1-46c7-a0fc-13d3586cfa70 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.696496 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0603e461-fcd8-4cff-b45f-5c34f4c73d80 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.710535 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:47:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e46e0db2-8538-489a-9f38-31bee070b708 x-openstack-request-id: req-e46e0db2-8538-489a-9f38-31bee070b708 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:47:25.710738 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "adfb178e-8542-42ce-9636-b14306116737", "tag": "fb9f4126-c8f9-4d33-b0f7-3a9218c6e391", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:47:25.711000 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e46e0db2-8538-489a-9f38-31bee070b708 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:47:25.711397 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'adfb178e-8542-42ce-9636-b14306116737', 'tag': 'fb9f4126-c8f9-4d33-b0f7-3a9218c6e391', 'status': 'completed', 'code': 200} Dec 09 21:47:25.726434 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0603e461-fcd8-4cff-b45f-5c34f4c73d80 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.796614 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a1fec07-c63f-4509-ba7e-791777c59ac3 service neutron] Pushing event updated for resources: {'Port': ['ID=fb9f4126-c8f9-4d33-b0f7-3a9218c6e391,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:25.817252 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0603e461-fcd8-4cff-b45f-5c34f4c73d80 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.820864 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0603e461-fcd8-4cff-b45f-5c34f4c73d80 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.822405 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0603e461-fcd8-4cff-b45f-5c34f4c73d80 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "DELETE /v2.0/security-groups/f44a1e28-df99-474a-b80e-b3989956be0c HTTP/1.1" status: 204 len: 168 time: 0.2101338 Dec 09 21:47:25.838734 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-afb7de43-2be1-46c7-a0fc-13d3586cfa70 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.840095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0603e461-fcd8-4cff-b45f-5c34f4c73d80 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f44a1e28-df99-474a-b80e-b3989956be0c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:25.842991 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-afb7de43-2be1-46c7-a0fc-13d3586cfa70 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.6492798 Dec 09 21:47:25.847951 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45012) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:25.853027 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-232f7351-4620-4d7d-acd2-636bb18a51f7 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Request body: {'security_group_rule': {'security_group_id': '5c3b1b6e-712e-4726-9c8c-e1d2692b54d6', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:25.872879 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afb7de43-2be1-46c7-a0fc-13d3586cfa70 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5c3b1b6e-712e-4726-9c8c-e1d2692b54d6,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:25.884940 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-30e46094-0d04-4af8-951f-646e5268cea9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Allocated IP 172.21.0.1 (0e9cae05-4caf-4321-8322-e071c54fdaec/33b2b834-2f8a-441d-b1ed-4bc255441ae9/9ccf9f45-61c3-45fd-be22-c0e550c5c38d) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:47:25.897613 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-c49534f0-3363-4049-aaae-010a7e00f182 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:25.899489 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-c49534f0-3363-4049-aaae-010a7e00f182 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2be7af74c5cc43908a744820a98fc9c0&device_id=adfb178e-8542-42ce-9636-b14306116737 HTTP/1.1" status: 200 len: 1095 time: 0.2049885 Dec 09 21:47:25.905271 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-232f7351-4620-4d7d-acd2-636bb18a51f7 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:25.959047 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-262dd982-6316-410e-8d3c-1fd37d1b0c5d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=fb9f4126-c8f9-4d33-b0f7-3a9218c6e391 HTTP/1.1" status: 200 len: 217 time: 0.0484023 Dec 09 21:47:25.985448 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f3bfac6-71fe-4184-9c4b-341576b273d5 req-b5b69266-e31a-4014-89b5-29519e879d04 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:25.987123 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0f3bfac6-71fe-4184-9c4b-341576b273d5 req-b5b69266-e31a-4014-89b5-29519e879d04 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/ports?device_id=adfb178e-8542-42ce-9636-b14306116737 HTTP/1.1" status: 200 len: 943 time: 0.0977011 Dec 09 21:47:26.030900 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-232f7351-4620-4d7d-acd2-636bb18a51f7 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:26.041524 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-232f7351-4620-4d7d-acd2-636bb18a51f7 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:26.058662 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0f3bfac6-71fe-4184-9c4b-341576b273d5 req-1dd91de3-b8cd-4df6-8413-64d92d52ddbf tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/security-groups?id=6236a31a-7414-45a5-80b0-e5c8c72b2bb7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0625737 Dec 09 21:47:26.068967 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-232f7351-4620-4d7d-acd2-636bb18a51f7 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e8cea733-a5d0-4970-9c3e-695b0fe066df,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:26.082227 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-f6ca8d81-b209-4ff7-83ea-064c001561fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:26.083014 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-232f7351-4620-4d7d-acd2-636bb18a51f7 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:26.086303 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-232f7351-4620-4d7d-acd2-636bb18a51f7 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2369628 Dec 09 21:47:26.090254 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-f6ca8d81-b209-4ff7-83ea-064c001561fa service neutron] 10.222.0.31 "GET /v2.0/subnets?id=1f76b74e-fb7e-4b78-bd58-a21de3f810b9 HTTP/1.1" status: 200 len: 849 time: 0.1202621 Dec 09 21:47:26.094798 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45014) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:26.120271 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4b851742-aa80-4524-aa6e-e37e9c1ac5ec tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-group-rules/e8cea733-a5d0-4970-9c3e-695b0fe066df HTTP/1.1" status: 200 len: 763 time: 0.0220411 Dec 09 21:47:26.127906 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45016) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:26.141263 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-85e13b0b-6314-4fa9-95c6-ccbfb7aaab64 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1f6c6308-b8f8-453f-b9f3-49b33791e0ee&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0429261 Dec 09 21:47:26.168399 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30e46094-0d04-4af8-951f-646e5268cea9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:26.184828 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f820e8a2-c9b8-4bce-a934-72e38bf0b2a2 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.0556774 Dec 09 21:47:26.187416 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45020) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:26.270729 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e1b183fd-b5b5-47c6-8126-04cf7cf27417 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:26.286156 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e1b183fd-b5b5-47c6-8126-04cf7cf27417 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:26.309277 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30e46094-0d04-4af8-951f-646e5268cea9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:26.341055 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-479a0a2f-fe8b-494d-9495-1f6753ff8f8e service neutron] 10.222.0.31 "GET /v2.0/networks/1f6c6308-b8f8-453f-b9f3-49b33791e0ee?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1875117 Dec 09 21:47:26.366594 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30e46094-0d04-4af8-951f-646e5268cea9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network 0e9cae05-4caf-4321-8322-e071c54fdaec is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:47:26.372617 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-30e46094-0d04-4af8-951f-646e5268cea9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:26.374849 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e1b183fd-b5b5-47c6-8126-04cf7cf27417 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:26.387583 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30e46094-0d04-4af8-951f-646e5268cea9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:47:26.394211 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e1b183fd-b5b5-47c6-8126-04cf7cf27417 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:26.395305 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e1b183fd-b5b5-47c6-8126-04cf7cf27417 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "DELETE /v2.0/security-group-rules/e8cea733-a5d0-4970-9c3e-695b0fe066df HTTP/1.1" status: 204 len: 168 time: 0.2069070 Dec 09 21:47:26.397989 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45022) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:26.441392 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30e46094-0d04-4af8-951f-646e5268cea9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Port': ['ID=9ccf9f45-61c3-45fd-be22-c0e550c5c38d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:26.446320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1b183fd-b5b5-47c6-8126-04cf7cf27417 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=e8cea733-a5d0-4970-9c3e-695b0fe066df,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:26.467856 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8fc83418-c93a-47c6-87ea-b24b1e7a06d8 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.0657051 Dec 09 21:47:26.470809 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45024) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:26.477460 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-7a0a0d90-9dc3-492e-8c94-dffba644d967 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Request body: {'security_group_rule': {'security_group_id': '5c3b1b6e-712e-4726-9c8c-e1d2692b54d6', 'protocol': 'udp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:26.493364 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30e46094-0d04-4af8-951f-646e5268cea9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:26.536092 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7a0a0d90-9dc3-492e-8c94-dffba644d967 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:26.612132 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fb36bd19-499d-4c59-af60-38352e6486b2 req-c249de62-2606-4c72-8719-cee21fd38e66 service neutron] 10.222.0.31 "GET /v2.0/networks/1f6c6308-b8f8-453f-b9f3-49b33791e0ee?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2611308 Dec 09 21:47:26.624705 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45028) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:26.633219 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-e105806c-f0e5-4151-b95d-4cbd8aa05e67 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-273679796', 'description': 'tempest-secgroup-smoke-273679796 description', 'project_id': 'dce7594ac2a74901912a2f19de04bf79'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:26.666614 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7a0a0d90-9dc3-492e-8c94-dffba644d967 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:26.676400 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7a0a0d90-9dc3-492e-8c94-dffba644d967 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:26.701809 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e105806c-f0e5-4151-b95d-4cbd8aa05e67 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:26.728627 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a0a0d90-9dc3-492e-8c94-dffba644d967 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ff88861d-4708-4032-9d97-6e3d025a7b76,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:26.754663 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7a0a0d90-9dc3-492e-8c94-dffba644d967 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:26.758996 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7a0a0d90-9dc3-492e-8c94-dffba644d967 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2847052 Dec 09 21:47:26.760890 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45030) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:26.766646 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 8d6065cf-1cdc-4069-87fe-4730f83e3cd7 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:47:26.800405 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30e46094-0d04-4af8-951f-646e5268cea9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:26.806639 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 8d6065cf-1cdc-4069-87fe-4730f83e3cd7 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:47:26.807221 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 8d6065cf-1cdc-4069-87fe-4730f83e3cd7 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:47:26.818409 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-507c63c6-942b-4689-a003-7c677d1a64e5 None None] Provisioning complete for port 9ccf9f45-61c3-45fd-be22-c0e550c5c38d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:26.818996 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-507c63c6-942b-4689-a003-7c677d1a64e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:26.836034 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e105806c-f0e5-4151-b95d-4cbd8aa05e67 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:26.845005 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7e6f3218-a05d-4f15-9304-634274846852 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-group-rules/ff88861d-4708-4032-9d97-6e3d025a7b76 HTTP/1.1" status: 200 len: 763 time: 0.0825613 Dec 09 21:47:26.846083 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45032) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:26.854640 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e105806c-f0e5-4151-b95d-4cbd8aa05e67 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:26.860817 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-507c63c6-942b-4689-a003-7c677d1a64e5 None None] Port 9ccf9f45-61c3-45fd-be22-c0e550c5c38d cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:47:26.892909 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e105806c-f0e5-4151-b95d-4cbd8aa05e67 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:26.897655 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e105806c-f0e5-4151-b95d-4cbd8aa05e67 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.2673309 Dec 09 21:47:26.906271 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45034) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:26.913515 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-1022dd24-2f0f-4249-86e8-0b63daa8f36e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group_rule': {'security_group_id': '7e73dc80-43d2-4833-9cd1-5d1a5f84f967', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:26.930690 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e105806c-f0e5-4151-b95d-4cbd8aa05e67 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7e73dc80-43d2-4833-9cd1-5d1a5f84f967,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:26.966483 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1ebf8227-b9d9-4252-a78b-ebcd211d777b tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4113 time: 0.1190994 Dec 09 21:47:26.969871 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45036) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:27.002668 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1022dd24-2f0f-4249-86e8-0b63daa8f36e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.007405 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6776dbea-1185-47d8-be1e-2ce38ec3256f tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.021728 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6776dbea-1185-47d8-be1e-2ce38ec3256f tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.077721 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6776dbea-1185-47d8-be1e-2ce38ec3256f tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.085586 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6776dbea-1185-47d8-be1e-2ce38ec3256f tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.089193 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6776dbea-1185-47d8-be1e-2ce38ec3256f tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "DELETE /v2.0/security-group-rules/ff88861d-4708-4032-9d97-6e3d025a7b76 HTTP/1.1" status: 204 len: 168 time: 0.1159220 Dec 09 21:47:27.090902 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45038) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:27.099038 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:47:27.114021 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1022dd24-2f0f-4249-86e8-0b63daa8f36e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.124721 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6776dbea-1185-47d8-be1e-2ce38ec3256f tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=ff88861d-4708-4032-9d97-6e3d025a7b76,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:27.128802 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1022dd24-2f0f-4249-86e8-0b63daa8f36e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.153209 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1022dd24-2f0f-4249-86e8-0b63daa8f36e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3ecf1387-dd95-4d94-87bd-19a7cc932859,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:27.183096 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1022dd24-2f0f-4249-86e8-0b63daa8f36e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.183096 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1022dd24-2f0f-4249-86e8-0b63daa8f36e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2729769 Dec 09 21:47:27.196076 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45042) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:27.201662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-6e3db246-abdc-44a0-a120-574d23e41a29 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group_rule': {'security_group_id': '7e73dc80-43d2-4833-9cd1-5d1a5f84f967', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:27.221400 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-93df01bf-354e-4464-9d30-198494ef5426 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.1210876 Dec 09 21:47:27.224267 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45044) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:27.231413 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c5a3f04e-b650-424c-baf2-60ac8adef159 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Request body: {'security_group_rule': {'security_group_id': '5c3b1b6e-712e-4726-9c8c-e1d2692b54d6', 'protocol': 'icmp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:27.256195 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.db.api [None req-c5a3f04e-b650-424c-baf2-60ac8adef159 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Dec 09 21:47:27.256195 n-d-713301-27 neutron-server[103438]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Dec 09 21:47:27.256195 n-d-713301-27 neutron-server[103438]: [parameters: {'project_id_1': '2d62f454e1e149dc826523d671e92f84', 'expiration_1': datetime.datetime(2021, 12, 9, 21, 47, 7, 239533)}] Dec 09 21:47:27.256195 n-d-713301-27 neutron-server[103438]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=103438) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:47:27.256668 n-d-713301-27 neutron-server[103438]: DEBUG oslo_db.api [None req-c5a3f04e-b650-424c-baf2-60ac8adef159 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:47:27.271638 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d55b43c3-2b8f-4723-823b-8db65f18cbab req-fe019403-87eb-4c02-9daa-40f0c38c4843 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:27.272162 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d55b43c3-2b8f-4723-823b-8db65f18cbab req-fe019403-87eb-4c02-9daa-40f0c38c4843 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/ports?device_id=adfb178e-8542-42ce-9636-b14306116737 HTTP/1.1" status: 200 len: 943 time: 0.1120031 Dec 09 21:47:27.280367 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6e3db246-abdc-44a0-a120-574d23e41a29 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.314402 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.322141 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edfb7909-842a-4935-913a-316f23920aa3 req-b600615b-0ffb-4823-a283-ce281cc0d281 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:27.323688 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-edfb7909-842a-4935-913a-316f23920aa3 req-b600615b-0ffb-4823-a283-ce281cc0d281 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2be7af74c5cc43908a744820a98fc9c0&device_id=adfb178e-8542-42ce-9636-b14306116737 HTTP/1.1" status: 200 len: 1095 time: 0.6306143 Dec 09 21:47:27.350860 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.367043 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d55b43c3-2b8f-4723-823b-8db65f18cbab req-8df5c61e-5d88-4f9c-ac18-9082a911107a tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/security-groups?id=6236a31a-7414-45a5-80b0-e5c8c72b2bb7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0880454 Dec 09 21:47:27.387095 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6e3db246-abdc-44a0-a120-574d23e41a29 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.391718 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6e3db246-abdc-44a0-a120-574d23e41a29 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.412907 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e3db246-abdc-44a0-a120-574d23e41a29 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9011bdb1-d71b-4897-910b-90874ea246d9,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:27.430168 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6e3db246-abdc-44a0-a120-574d23e41a29 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.431398 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6e3db246-abdc-44a0-a120-574d23e41a29 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2334678 Dec 09 21:47:27.434143 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45046) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:27.439243 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-77993058-75cb-4c6e-bb01-5c9ba45c7560 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group_rule': {'security_group_id': '7e73dc80-43d2-4833-9cd1-5d1a5f84f967', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:27.471081 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-77993058-75cb-4c6e-bb01-5c9ba45c7560 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.515985 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edfb7909-842a-4935-913a-316f23920aa3 req-363f704a-669b-46ab-aa01-b1f426e58421 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:27.517765 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-edfb7909-842a-4935-913a-316f23920aa3 req-363f704a-669b-46ab-aa01-b1f426e58421 service neutron] 10.222.0.31 "GET /v2.0/networks?id=1f6c6308-b8f8-453f-b9f3-49b33791e0ee HTTP/1.1" status: 200 len: 910 time: 0.1863339 Dec 09 21:47:27.542700 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-77993058-75cb-4c6e-bb01-5c9ba45c7560 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.547741 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-77993058-75cb-4c6e-bb01-5c9ba45c7560 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.571916 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77993058-75cb-4c6e-bb01-5c9ba45c7560 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e3013ff1-5d2a-4390-be92-02a7b525872d,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:27.576305 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-edfb7909-842a-4935-913a-316f23920aa3 req-1f85bc7f-db80-44b2-8071-193e80a54ab8 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=fb9f4126-c8f9-4d33-b0f7-3a9218c6e391 HTTP/1.1" status: 200 len: 217 time: 0.0507042 Dec 09 21:47:27.579545 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-77993058-75cb-4c6e-bb01-5c9ba45c7560 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.583293 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-77993058-75cb-4c6e-bb01-5c9ba45c7560 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1456234 Dec 09 21:47:27.583537 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45048) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:27.589361 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-9b457386-64c5-413c-aad1-145d13e13530 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group_rule': {'security_group_id': '7e73dc80-43d2-4833-9cd1-5d1a5f84f967', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:27.621477 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9b457386-64c5-413c-aad1-145d13e13530 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.647873 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30e46094-0d04-4af8-951f-646e5268cea9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.651935 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edfb7909-842a-4935-913a-316f23920aa3 req-571dfb2e-e13e-4f03-a988-27096ddf88c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:27.653609 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-edfb7909-842a-4935-913a-316f23920aa3 req-571dfb2e-e13e-4f03-a988-27096ddf88c4 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=1f76b74e-fb7e-4b78-bd58-a21de3f810b9 HTTP/1.1" status: 200 len: 849 time: 0.0710847 Dec 09 21:47:27.655524 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30e46094-0d04-4af8-951f-646e5268cea9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.697307 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9b457386-64c5-413c-aad1-145d13e13530 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.702048 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9b457386-64c5-413c-aad1-145d13e13530 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.723604 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b457386-64c5-413c-aad1-145d13e13530 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=37a5db86-5bd8-4bfd-8421-dad374df72ca,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:27.737030 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9b457386-64c5-413c-aad1-145d13e13530 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.739636 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9b457386-64c5-413c-aad1-145d13e13530 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1537979 Dec 09 21:47:27.739743 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-edfb7909-842a-4935-913a-316f23920aa3 req-dbd2ecb1-e8e9-42d6-a7fd-a8443158eb72 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=1f6c6308-b8f8-453f-b9f3-49b33791e0ee&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0750444 Dec 09 21:47:27.741532 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45052) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:27.748450 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-e613dd61-07ea-40c9-8526-c8b943e42f91 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group_rule': {'security_group_id': '7e73dc80-43d2-4833-9cd1-5d1a5f84f967', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:27.798430 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30e46094-0d04-4af8-951f-646e5268cea9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Port': ['ID=9ccf9f45-61c3-45fd-be22-c0e550c5c38d,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:27.803605 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30e46094-0d04-4af8-951f-646e5268cea9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.806235 n-d-713301-27 neutron-server[103438]: INFO neutron.db.securitygroups_db [None req-e613dd61-07ea-40c9-8526-c8b943e42f91 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Project dce7594ac2a74901912a2f19de04bf79 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 21:47:27.817804 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e613dd61-07ea-40c9-8526-c8b943e42f91 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.852383 n-d-713301-27 neutron-server[103438]: INFO neutron.db.securitygroups_db [None req-c5a3f04e-b650-424c-baf2-60ac8adef159 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Project 2d62f454e1e149dc826523d671e92f84 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 21:47:27.866730 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c5a3f04e-b650-424c-baf2-60ac8adef159 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.921505 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-edfb7909-842a-4935-913a-316f23920aa3 req-feea2b61-16c6-48ca-a2c6-29ed4da34f7d service neutron] 10.222.0.31 "GET /v2.0/networks/1f6c6308-b8f8-453f-b9f3-49b33791e0ee?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1750882 Dec 09 21:47:27.929886 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e613dd61-07ea-40c9-8526-c8b943e42f91 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.938260 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e613dd61-07ea-40c9-8526-c8b943e42f91 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.964894 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e613dd61-07ea-40c9-8526-c8b943e42f91 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=624abe57-4e68-4c43-8d34-ca12300c5f7f,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:27.970104 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c5a3f04e-b650-424c-baf2-60ac8adef159 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.978027 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c5a3f04e-b650-424c-baf2-60ac8adef159 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.985954 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e613dd61-07ea-40c9-8526-c8b943e42f91 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:27.990865 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e613dd61-07ea-40c9-8526-c8b943e42f91 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2448292 Dec 09 21:47:27.997907 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45054) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:28.012271 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-59a6d838-4e0f-4445-86c4-37fed4112f9b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group_rule': {'security_group_id': '7e73dc80-43d2-4833-9cd1-5d1a5f84f967', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:28.021433 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30e46094-0d04-4af8-951f-646e5268cea9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network 0e9cae05-4caf-4321-8322-e071c54fdaec is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:47:28.026017 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-30e46094-0d04-4af8-951f-646e5268cea9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:28.027331 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5a3f04e-b650-424c-baf2-60ac8adef159 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=26f704cb-9503-48ea-9855-ec1871ee22f0,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:28.055579 n-d-713301-27 neutron-server[103438]: INFO neutron.db.securitygroups_db [None req-59a6d838-4e0f-4445-86c4-37fed4112f9b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Project dce7594ac2a74901912a2f19de04bf79 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 21:47:28.064626 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-59a6d838-4e0f-4445-86c4-37fed4112f9b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:28.072003 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c5a3f04e-b650-424c-baf2-60ac8adef159 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:28.073556 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c5a3f04e-b650-424c-baf2-60ac8adef159 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.8467009 Dec 09 21:47:28.080348 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45056) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:28.117188 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-64e7a061-51a5-4ef4-8fb5-a8b93d6b5748 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-group-rules/26f704cb-9503-48ea-9855-ec1871ee22f0 HTTP/1.1" status: 200 len: 769 time: 0.0336123 Dec 09 21:47:28.120110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45058) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:28.170307 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-30e46094-0d04-4af8-951f-646e5268cea9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Router 4d8df6d4-f96f-4643-8663-28df67a09dd9 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:47:28.174831 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-edfb7909-842a-4935-913a-316f23920aa3 req-5124a6e8-c954-46d1-8bb4-295267c9ef49 service neutron] 10.222.0.31 "GET /v2.0/networks/1f6c6308-b8f8-453f-b9f3-49b33791e0ee?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2451963 Dec 09 21:47:28.176521 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-59a6d838-4e0f-4445-86c4-37fed4112f9b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:28.188069 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ec154903-ae47-4393-93fc-d666b2a5d9db tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 4119 time: 0.0669925 Dec 09 21:47:28.189640 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-59a6d838-4e0f-4445-86c4-37fed4112f9b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:28.190650 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45060) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:28.210406 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59a6d838-4e0f-4445-86c4-37fed4112f9b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1580b510-c379-4b9a-91ed-f879843da49a,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:28.222560 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-59a6d838-4e0f-4445-86c4-37fed4112f9b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:28.227394 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-59a6d838-4e0f-4445-86c4-37fed4112f9b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2245526 Dec 09 21:47:28.228045 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45062) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:28.233126 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-553cc58e-ef40-481b-9c12-7e80ce6cecad tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'network': {'name': 'tempest-network-smoke--815668229', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'port_security_enabled': True}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:28.262474 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-553cc58e-ef40-481b-9c12-7e80ce6cecad tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Made reservation on behalf of dce7594ac2a74901912a2f19de04bf79 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:47:28.269519 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-553cc58e-ef40-481b-9c12-7e80ce6cecad tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:28.299647 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e88b1670-2253-4c11-9837-10da7579de12 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:28.306913 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-553cc58e-ef40-481b-9c12-7e80ce6cecad tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] vlan segment allocate from pool success with {'vlan_id': 107, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:47:28.312058 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e88b1670-2253-4c11-9837-10da7579de12 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:28.319551 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-553cc58e-ef40-481b-9c12-7e80ce6cecad tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:28.319989 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-553cc58e-ef40-481b-9c12-7e80ce6cecad tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Added segment 0189efa9-02eb-4071-ae6f-aee6c867d035 of type vlan for network 92500df7-83c8-4757-9b24-3ee4dfba2da3 Dec 09 21:47:28.343586 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-30e46094-0d04-4af8-951f-646e5268cea9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:47:28.352754 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-30e46094-0d04-4af8-951f-646e5268cea9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/routers/4d8df6d4-f96f-4643-8663-28df67a09dd9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.9496782 Dec 09 21:47:28.353615 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45064) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:28.354603 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c38befc-2ff5-44da-9328-5d6eb2dc23e7 None None] Sync routers for ids ['4d8df6d4-f96f-4643-8663-28df67a09dd9'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:47:28.368270 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c38befc-2ff5-44da-9328-5d6eb2dc23e7 None None] Routers {'4d8df6d4-f96f-4643-8663-28df67a09dd9'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:47:28.368657 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e88b1670-2253-4c11-9837-10da7579de12 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:28.369485 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-3c38befc-2ff5-44da-9328-5d6eb2dc23e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4d8df6d4-f96f-4643-8663-28df67a09dd9'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:28.390722 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-553cc58e-ef40-481b-9c12-7e80ce6cecad tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:28.410189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a714bb5a-8612-42ea-8ae3-bce52daf872a None None] Provisioning complete for port 9ccf9f45-61c3-45fd-be22-c0e550c5c38d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:28.410786 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a714bb5a-8612-42ea-8ae3-bce52daf872a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:28.416700 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e88b1670-2253-4c11-9837-10da7579de12 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:28.426089 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45068) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:28.426265 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e88b1670-2253-4c11-9837-10da7579de12 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "DELETE /v2.0/security-group-rules/26f704cb-9503-48ea-9855-ec1871ee22f0 HTTP/1.1" status: 204 len: 168 time: 0.2316294 Dec 09 21:47:28.442370 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e88b1670-2253-4c11-9837-10da7579de12 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event deleted for resources: {'SecurityGroupRule': ['ID=26f704cb-9503-48ea-9855-ec1871ee22f0,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:28.455748 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83e8d1ea-af58-40a0-85e0-a426dcf68791 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:28.459873 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-83e8d1ea-af58-40a0-85e0-a426dcf68791 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/ports/9ccf9f45-61c3-45fd-be22-c0e550c5c38d HTTP/1.1" status: 200 len: 910 time: 0.1012547 Dec 09 21:47:28.463724 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45070) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:28.464530 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-3c38befc-2ff5-44da-9328-5d6eb2dc23e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:28.464659 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-553cc58e-ef40-481b-9c12-7e80ce6cecad tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:28.470885 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-553cc58e-ef40-481b-9c12-7e80ce6cecad tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:28.471532 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-553cc58e-ef40-481b-9c12-7e80ce6cecad tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:28.486514 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3c38befc-2ff5-44da-9328-5d6eb2dc23e7 None None] Routers {'4d8df6d4-f96f-4643-8663-28df67a09dd9'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:47:28.488289 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-3c38befc-2ff5-44da-9328-5d6eb2dc23e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4d8df6d4-f96f-4643-8663-28df67a09dd9'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:28.494725 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a714bb5a-8612-42ea-8ae3-bce52daf872a None None] Port 9ccf9f45-61c3-45fd-be22-c0e550c5c38d cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:47:28.509397 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-553cc58e-ef40-481b-9c12-7e80ce6cecad tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.2802792 Dec 09 21:47:28.512520 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45072) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:28.519385 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ea2aa197-b890-457d-a6af-5231b7412313 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-161742691', 'admin_state_up': True, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:28.531557 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-3c38befc-2ff5-44da-9328-5d6eb2dc23e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:28.532208 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3c38befc-2ff5-44da-9328-5d6eb2dc23e7 None None] The sync data for ids ['4d8df6d4-f96f-4643-8663-28df67a09dd9'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:47:28.537222 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device fb9f4126-c8f9-4d33-b0f7-3a9218c6e391 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:47:28.560521 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea2aa197-b890-457d-a6af-5231b7412313 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:28.561983 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea2aa197-b890-457d-a6af-5231b7412313 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:28.632467 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea2aa197-b890-457d-a6af-5231b7412313 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:28.654594 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port fb9f4126-c8f9-4d33-b0f7-3a9218c6e391, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=fb9f4126-c8f9-4d33-b0f7-3a9218c6e391,segment=NetworkSegment(f4832b4c-9721-4fb3-b34b-0781180d5872),segment_id=f4832b4c-9721-4fb3-b34b-0781180d5872)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:28.668969 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'fb9f4126-c8f9-4d33-b0f7-3a9218c6e391', 'network_id': '1f6c6308-b8f8-453f-b9f3-49b33791e0ee', 'port_id': 'fb9f4126-c8f9-4d33-b0f7-3a9218c6e391', 'mac_address': 'fa:16:3e:2a:09:f1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 125, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1f76b74e-fb7e-4b78-bd58-a21de3f810b9', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:47:28.703081 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-00449a96-7c11-4494-828e-d1453d8cf8aa tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 3567 time: 0.2723157 Dec 09 21:47:28.704676 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45074) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:28.710145 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-553cc58e-ef40-481b-9c12-7e80ce6cecad tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Network': ['ID=92500df7-83c8-4757-9b24-3ee4dfba2da3,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:28.722322 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-774e8228-929f-437e-94e7-35c17442b67f req-df169b66-0b80-4422-b283-09642ea2b4c2 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:28.723908 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-774e8228-929f-437e-94e7-35c17442b67f req-df169b66-0b80-4422-b283-09642ea2b4c2 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/ports?device_id=adfb178e-8542-42ce-9636-b14306116737 HTTP/1.1" status: 200 len: 943 time: 0.2188101 Dec 09 21:47:28.735156 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 92500df7-83c8-4757-9b24-3ee4dfba2da3 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:47:28.755226 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:28.841779 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fb9f4126-c8f9-4d33-b0f7-3a9218c6e391 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:47:28.871143 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port fb9f4126-c8f9-4d33-b0f7-3a9218c6e391, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=fb9f4126-c8f9-4d33-b0f7-3a9218c6e391,segment=NetworkSegment(f4832b4c-9721-4fb3-b34b-0781180d5872),segment_id=f4832b4c-9721-4fb3-b34b-0781180d5872)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:28.884018 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:28.902243 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea2aa197-b890-457d-a6af-5231b7412313 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:28.959046 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=fb9f4126-c8f9-4d33-b0f7-3a9218c6e391,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:28.990050 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1fece544-20c7-4dde-935b-c79a0e18d288 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:29.024054 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1fece544-20c7-4dde-935b-c79a0e18d288 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:29.113882 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1fece544-20c7-4dde-935b-c79a0e18d288 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:29.117201 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1fece544-20c7-4dde-935b-c79a0e18d288 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:29.120889 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1fece544-20c7-4dde-935b-c79a0e18d288 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "DELETE /v2.0/security-groups/5c3b1b6e-712e-4726-9c8c-e1d2692b54d6 HTTP/1.1" status: 204 len: 168 time: 0.4151683 Dec 09 21:47:29.121522 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45078) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:29.129476 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['fb9f4126-c8f9-4d33-b0f7-3a9218c6e391'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:47:29.149079 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fece544-20c7-4dde-935b-c79a0e18d288 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c3b1b6e-712e-4726-9c8c-e1d2692b54d6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:29.246797 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-774e8228-929f-437e-94e7-35c17442b67f req-47dab1d2-db56-4baf-b86f-f082a00c8441 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/security-groups?id=6236a31a-7414-45a5-80b0-e5c8c72b2bb7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5147171 Dec 09 21:47:29.294173 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4e873008-c018-4235-aa7f-0c83d8d19c0c tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1675446 Dec 09 21:47:29.294778 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45080) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:29.300996 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-9eb5bd47-1b4b-4cd2-81d1-ab615ef32231 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Request body: {'security_group': {'name': 'tempest-secgroup--219983165'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:29.334695 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea2aa197-b890-457d-a6af-5231b7412313 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:29.360564 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea2aa197-b890-457d-a6af-5231b7412313 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:29.370305 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9eb5bd47-1b4b-4cd2-81d1-ab615ef32231 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:29.496942 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-41e972b6-46d6-425e-831c-b3079f951484 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:29.514955 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-ea2aa197-b890-457d-a6af-5231b7412313 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Allocated IP 172.25.3.57 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/835940d0-c170-49f1-810e-9c4a5bea622c) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:47:29.535595 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9eb5bd47-1b4b-4cd2-81d1-ab615ef32231 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:29.543958 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9eb5bd47-1b4b-4cd2-81d1-ab615ef32231 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:29.623410 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9eb5bd47-1b4b-4cd2-81d1-ab615ef32231 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:29.624798 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9eb5bd47-1b4b-4cd2-81d1-ab615ef32231 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1762 time: 0.3273833 Dec 09 21:47:29.627837 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45082) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:29.630904 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9eb5bd47-1b4b-4cd2-81d1-ab615ef32231 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7c24206b-6a7a-4434-9f13-09aa64c67672,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:29.632450 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-41ef971b-e333-40a6-b3b4-ee9edf55b80a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Request body: {'security_group_rule': {'security_group_id': '7c24206b-6a7a-4434-9f13-09aa64c67672', 'protocol': 'tcp', 'direction': 'ingress', 'ethertype': 'IPv6'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:29.677260 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea2aa197-b890-457d-a6af-5231b7412313 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:29.715694 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-41ef971b-e333-40a6-b3b4-ee9edf55b80a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:29.719222 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea2aa197-b890-457d-a6af-5231b7412313 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:29.759098 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea2aa197-b890-457d-a6af-5231b7412313 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:47:29.762308 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-ea2aa197-b890-457d-a6af-5231b7412313 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:29.774454 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea2aa197-b890-457d-a6af-5231b7412313 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:47:29.797166 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-89b8ea11-a5f5-4b87-a144-1a6c854e3ae3 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:47:29.800900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea2aa197-b890-457d-a6af-5231b7412313 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Port': ['ID=835940d0-c170-49f1-810e-9c4a5bea622c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:29.844439 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-41ef971b-e333-40a6-b3b4-ee9edf55b80a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:29.854119 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-41ef971b-e333-40a6-b3b4-ee9edf55b80a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:29.875042 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41ef971b-e333-40a6-b3b4-ee9edf55b80a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=652c133f-d4fd-47e5-862a-5ccf140a63fd,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:29.900761 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-41ef971b-e333-40a6-b3b4-ee9edf55b80a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:29.902387 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-41ef971b-e333-40a6-b3b4-ee9edf55b80a tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2732573 Dec 09 21:47:29.905360 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45084) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:29.905736 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-41e972b6-46d6-425e-831c-b3079f951484 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting port 9ccf9f45-61c3-45fd-be22-c0e550c5c38d {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:47:29.906223 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-41e972b6-46d6-425e-831c-b3079f951484 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:29.948993 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-cd7adc69-d578-423f-89a3-16bd81638a51 None None] Provisioning complete for port 835940d0-c170-49f1-810e-9c4a5bea622c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:29.949668 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cd7adc69-d578-423f-89a3-16bd81638a51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:30.008795 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-cd7adc69-d578-423f-89a3-16bd81638a51 None None] Port 835940d0-c170-49f1-810e-9c4a5bea622c cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:47:30.017273 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-41e972b6-46d6-425e-831c-b3079f951484 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:30.036643 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-41e972b6-46d6-425e-831c-b3079f951484 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Calling delete_port for 9ccf9f45-61c3-45fd-be22-c0e550c5c38d owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:47:30.091995 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee462f8c-be38-4dc4-8387-3caaec5784ad tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:30.149592 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee462f8c-be38-4dc4-8387-3caaec5784ad tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:30.193174 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea2aa197-b890-457d-a6af-5231b7412313 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:30.248359 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-41e972b6-46d6-425e-831c-b3079f951484 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:30.251010 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee462f8c-be38-4dc4-8387-3caaec5784ad tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:30.256151 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ee462f8c-be38-4dc4-8387-3caaec5784ad tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:30.259780 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ee462f8c-be38-4dc4-8387-3caaec5784ad tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "DELETE /v2.0/security-groups/7c24206b-6a7a-4434-9f13-09aa64c67672 HTTP/1.1" status: 204 len: 168 time: 0.3508482 Dec 09 21:47:30.262738 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45088) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:30.290709 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41e972b6-46d6-425e-831c-b3079f951484 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Port': ['ID=9ccf9f45-61c3-45fd-be22-c0e550c5c38d,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:30.301511 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee462f8c-be38-4dc4-8387-3caaec5784ad tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7c24206b-6a7a-4434-9f13-09aa64c67672,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:30.433902 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-32fb9a51-c84d-456e-a866-880026ee0514 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1704032 Dec 09 21:47:30.437965 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45092) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:30.472649 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84b95c6a-5d49-4b49-a549-45df513fc59c req-6de2bc09-396d-4444-a7f9-d34cf940bc85 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:30.474502 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84b95c6a-5d49-4b49-a549-45df513fc59c req-6de2bc09-396d-4444-a7f9-d34cf940bc85 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/ports?device_id=adfb178e-8542-42ce-9636-b14306116737 HTTP/1.1" status: 200 len: 944 time: 0.1414602 Dec 09 21:47:30.486152 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea2aa197-b890-457d-a6af-5231b7412313 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:30.565476 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device fb9f4126-c8f9-4d33-b0f7-3a9218c6e391 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:47:30.586517 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f23aa15d-81a2-45dd-b326-3a6452d64e63 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-group-rules HTTP/1.1" status: 200 len: 2475 time: 0.1450262 Dec 09 21:47:30.593378 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45094) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:30.626108 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port fb9f4126-c8f9-4d33-b0f7-3a9218c6e391 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:47:30.632171 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port fb9f4126-c8f9-4d33-b0f7-3a9218c6e391 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:30.632919 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:30.644925 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-21b19393-72a9-4082-bd85-789f9351aec3 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] delete failed (client error): The resource could not be found. Dec 09 21:47:30.649051 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-21b19393-72a9-4082-bd85-789f9351aec3 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "DELETE /v2.0/security-groups/7c24206b-6a7a-4434-9f13-09aa64c67672 HTTP/1.1" status: 404 len: 347 time: 0.0502882 Dec 09 21:47:30.649523 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45096) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:30.656552 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-41e972b6-46d6-425e-831c-b3079f951484 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:30.662571 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84b95c6a-5d49-4b49-a549-45df513fc59c req-39318a48-e310-479a-9093-e1e3dfe2b083 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/security-groups?id=6236a31a-7414-45a5-80b0-e5c8c72b2bb7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1466968 Dec 09 21:47:30.742287 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ea2aa197-b890-457d-a6af-5231b7412313 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Router 7521af04-4c9d-4f02-9889-0ff6f5545ff7 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:47:30.768073 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8b646ae3-519a-4e61-8d63-4059efd26795 tempest-SecGroupIPv6Test-1080880503 tempest-SecGroupIPv6Test-1080880503-project] 10.222.0.13 "GET /v2.0/security-groups HTTP/1.1" status: 200 len: 3000 time: 0.1174471 Dec 09 21:47:30.906594 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ea2aa197-b890-457d-a6af-5231b7412313 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:47:30.935380 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea2aa197-b890-457d-a6af-5231b7412313 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:30.937017 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ea2aa197-b890-457d-a6af-5231b7412313 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 894 time: 2.4230263 Dec 09 21:47:30.940580 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45100) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:30.946493 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] Sync routers for ids ['7521af04-4c9d-4f02-9889-0ff6f5545ff7'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:47:30.950781 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:30.969840 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] Routers {'7521af04-4c9d-4f02-9889-0ff6f5545ff7'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:47:30.970935 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7521af04-4c9d-4f02-9889-0ff6f5545ff7'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:30.990231 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-aa4445c6-a4f8-4cdc-899a-40196b869d40 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/subnets?project_id=dce7594ac2a74901912a2f19de04bf79&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0481088 Dec 09 21:47:30.992970 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45102) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:31.017277 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-41e972b6-46d6-425e-831c-b3079f951484 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Router 4d8df6d4-f96f-4643-8663-28df67a09dd9 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:47:31.123388 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] Set router 7521af04-4c9d-4f02-9889-0ff6f5545ff7 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:47:31.224351 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port fb9f4126-c8f9-4d33-b0f7-3a9218c6e391, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=fb9f4126-c8f9-4d33-b0f7-3a9218c6e391,segment=NetworkSegment(f4832b4c-9721-4fb3-b34b-0781180d5872),segment_id=f4832b4c-9721-4fb3-b34b-0781180d5872)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:31.258682 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'adfb178e-8542-42ce-9636-b14306116737', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fb9f4126-c8f9-4d33-b0f7-3a9218c6e391'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:47:31.262729 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45108) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:31.263089 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-abd2ed3d-4ed0-479e-acc1-4bf36e956a0c" -d '{"events": [{"server_uuid": "adfb178e-8542-42ce-9636-b14306116737", "name": "network-vif-plugged", "status": "completed", "tag": "fb9f4126-c8f9-4d33-b0f7-3a9218c6e391"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:47:31.273930 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:31.281390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-41e972b6-46d6-425e-831c-b3079f951484 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:47:31.290250 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-41e972b6-46d6-425e-831c-b3079f951484 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/routers/4d8df6d4-f96f-4643-8663-28df67a09dd9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8040771 Dec 09 21:47:31.290343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45114) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:31.291302 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6edfff5-5235-4d35-b1ea-8dae96b9b7f0 None None] Sync routers for ids ['4d8df6d4-f96f-4643-8663-28df67a09dd9'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:47:31.326417 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6edfff5-5235-4d35-b1ea-8dae96b9b7f0 None None] Routers {'4d8df6d4-f96f-4643-8663-28df67a09dd9'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:47:31.328088 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d6edfff5-5235-4d35-b1ea-8dae96b9b7f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4d8df6d4-f96f-4643-8663-28df67a09dd9'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:31.376295 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-288c5dc1-fd6d-4278-b74f-0645fb7070a9 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:31.385609 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-288c5dc1-fd6d-4278-b74f-0645fb7070a9 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.3915055 Dec 09 21:47:31.385938 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45116) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:31.393594 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=fb9f4126-c8f9-4d33-b0f7-3a9218c6e391,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:31.430386 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f8301c4d-5037-433d-949a-b234658f9284 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/subnets?network_id=97925a19-460a-4476-8208-41db134b6c83&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0428238 Dec 09 21:47:31.433102 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45118) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:31.439451 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-5731a6f6-81a9-4a8f-b011-b1ea61ffc107 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-2043254445', 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:31.466266 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:47:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c6d7f595-b322-435c-b575-b64cedabdf20 x-openstack-request-id: req-c6d7f595-b322-435c-b575-b64cedabdf20 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:47:31.466266 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "adfb178e-8542-42ce-9636-b14306116737", "name": "network-vif-plugged", "status": "completed", "tag": "fb9f4126-c8f9-4d33-b0f7-3a9218c6e391", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:47:31.466266 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c6d7f595-b322-435c-b575-b64cedabdf20 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:47:31.466266 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'adfb178e-8542-42ce-9636-b14306116737', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fb9f4126-c8f9-4d33-b0f7-3a9218c6e391', 'code': 200} Dec 09 21:47:31.476810 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d6edfff5-5235-4d35-b1ea-8dae96b9b7f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:31.491081 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6edfff5-5235-4d35-b1ea-8dae96b9b7f0 None None] Routers {'4d8df6d4-f96f-4643-8663-28df67a09dd9'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:47:31.492033 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d6edfff5-5235-4d35-b1ea-8dae96b9b7f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4d8df6d4-f96f-4643-8663-28df67a09dd9'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:31.530913 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d6edfff5-5235-4d35-b1ea-8dae96b9b7f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:31.533203 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d6edfff5-5235-4d35-b1ea-8dae96b9b7f0 None None] The sync data for ids ['4d8df6d4-f96f-4643-8663-28df67a09dd9'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:47:31.537137 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-161742691', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57'}], 'enable_snat': True}, 'gw_port_id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:47:28Z', 'updated_at': '2021-12-09T21:47:30Z', 'revision_number': 3, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:01:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3464, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:47:29Z', 'updated_at': '2021-12-09T21:47:29Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:31.566862 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] Checking router: 7521af04-4c9d-4f02-9889-0ff6f5545ff7 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:47:31.567214 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] Updating router 7521af04-4c9d-4f02-9889-0ff6f5545ff7 port 835940d0-c170-49f1-810e-9c4a5bea622c binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:47:31.595233 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:31.644689 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e0810f4f-74e4-406e-ac26-1c56570186ee admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=2d62f454e1e149dc826523d671e92f84&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3807545 Dec 09 21:47:31.646809 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45120) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:31.648997 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d1f3c6d-45ed-4028-8e28-0dae7e587dd5 req-b062c0de-d2dc-4390-98ee-2041627cb21d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:31.650733 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6d1f3c6d-45ed-4028-8e28-0dae7e587dd5 req-b062c0de-d2dc-4390-98ee-2041627cb21d service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=adfb178e-8542-42ce-9636-b14306116737 HTTP/1.1" status: 200 len: 1097 time: 0.1724961 Dec 09 21:47:31.712992 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5731a6f6-81a9-4a8f-b011-b1ea61ffc107 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Made reservation on behalf of dce7594ac2a74901912a2f19de04bf79 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:47:31.717681 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5731a6f6-81a9-4a8f-b011-b1ea61ffc107 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:31.769125 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b542bf82-da60-4648-878b-79c48cf97a38 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:31.783528 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7286c1c6-4695-4c29-9729-e10c164b6009 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:31.859771 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7286c1c6-4695-4c29-9729-e10c164b6009 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:31.863572 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6d1f3c6d-45ed-4028-8e28-0dae7e587dd5 req-b8263c33-c12c-4844-abf5-a73483613333 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=6236a31a-7414-45a5-80b0-e5c8c72b2bb7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1671214 Dec 09 21:47:31.932879 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc17a241-ceef-4e49-be61-c16a6664a28a req-6b2d165b-5e0f-438c-8593-69d77c50b1f9 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:31.934393 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc17a241-ceef-4e49-be61-c16a6664a28a req-6b2d165b-5e0f-438c-8593-69d77c50b1f9 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/ports?device_id=adfb178e-8542-42ce-9636-b14306116737 HTTP/1.1" status: 200 len: 945 time: 0.0812619 Dec 09 21:47:31.982026 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:31.992313 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:32.053645 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-73647a4c-53c2-45d3-b041-2c090429bb73 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:47:32.061542 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc17a241-ceef-4e49-be61-c16a6664a28a req-afc4ac90-247f-4a57-823e-abe3811e5c17 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/security-groups?id=6236a31a-7414-45a5-80b0-e5c8c72b2bb7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0921774 Dec 09 21:47:32.098702 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f568b82-5d18-4835-a3a0-3d7895e3943e None None] Pushing event updated for resources: {'Port': ['ID=835940d0-c170-49f1-810e-9c4a5bea622c,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:32.101713 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] Attempting to bind port 835940d0-c170-49f1-810e-9c4a5bea622c on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:47:32.102165 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] Attempting to bind port 835940d0-c170-49f1-810e-9c4a5bea622c by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:47:32.102735 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] Attempting to bind port 835940d0-c170-49f1-810e-9c4a5bea622c on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:47:32.109915 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 47, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:47:32.110420 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:47:32.110924 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:32.111632 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:47:32.112213 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] Bound port: 835940d0-c170-49f1-810e-9c4a5bea622c, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:47:32.112889 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:32.164967 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b1d0833e-b2ba-478a-aff3-3a24644c09c3 None None] Provisioning complete for port 835940d0-c170-49f1-810e-9c4a5bea622c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:32.165467 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b1d0833e-b2ba-478a-aff3-3a24644c09c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:32.205845 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-b542bf82-da60-4648-878b-79c48cf97a38 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting port ee8705ae-e058-46c9-92c5-3079cbeb1485 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:47:32.206186 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b542bf82-da60-4648-878b-79c48cf97a38 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:32.228346 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] For port 835940d0-c170-49f1-810e-9c4a5bea622c, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:47:32.236434 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] For port 835940d0-c170-49f1-810e-9c4a5bea622c, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=835940d0-c170-49f1-810e-9c4a5bea622c,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:47:32.240197 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-b1d0833e-b2ba-478a-aff3-3a24644c09c3 None None] Port 835940d0-c170-49f1-810e-9c4a5bea622c cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:47:32.245610 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:32.301770 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-36cb4d05-adf3-4e49-ac22-0aca17d0ac4e None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:47:32.310972 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] Routers {'7521af04-4c9d-4f02-9889-0ff6f5545ff7'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:47:32.311474 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7521af04-4c9d-4f02-9889-0ff6f5545ff7'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:32.328428 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b542bf82-da60-4648-878b-79c48cf97a38 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:32.344926 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-b542bf82-da60-4648-878b-79c48cf97a38 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Calling delete_port for ee8705ae-e058-46c9-92c5-3079cbeb1485 owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:47:32.356589 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f568b82-5d18-4835-a3a0-3d7895e3943e None None] Pushing event updated for resources: {'Port': ['ID=835940d0-c170-49f1-810e-9c4a5bea622c,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:32.385179 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7286c1c6-4695-4c29-9729-e10c164b6009 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:32.389034 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7286c1c6-4695-4c29-9729-e10c164b6009 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:32.392607 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7286c1c6-4695-4c29-9729-e10c164b6009 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/5e047d1c-7f99-49e5-acc4-b98a035025ff HTTP/1.1" status: 204 len: 168 time: 0.7386181 Dec 09 21:47:32.407732 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7286c1c6-4695-4c29-9729-e10c164b6009 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5e047d1c-7f99-49e5-acc4-b98a035025ff,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:32.477417 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5731a6f6-81a9-4a8f-b011-b1ea61ffc107 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:32.500648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] Set router 7521af04-4c9d-4f02-9889-0ff6f5545ff7 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:47:32.502558 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-19008495-9f96-46ad-8414-947b5e8942b4 None None] Provisioning complete for port 835940d0-c170-49f1-810e-9c4a5bea622c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:32.502928 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-19008495-9f96-46ad-8414-947b5e8942b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:32.585356 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5731a6f6-81a9-4a8f-b011-b1ea61ffc107 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Checking segment: {'id': '0189efa9-02eb-4071-ae6f-aee6c867d035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:47:32.592160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5731a6f6-81a9-4a8f-b011-b1ea61ffc107 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network hostable DHCP agents. Network: 92500df7-83c8-4757-9b24-3ee4dfba2da3, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:47:32.595253 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5731a6f6-81a9-4a8f-b011-b1ea61ffc107 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Subnet': ['ID=13dde2f9-0dfd-4600-912c-44b7903e3595,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:32.615725 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b542bf82-da60-4648-878b-79c48cf97a38 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:32.626341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5731a6f6-81a9-4a8f-b011-b1ea61ffc107 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network 92500df7-83c8-4757-9b24-3ee4dfba2da3 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:47:32.643777 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-5731a6f6-81a9-4a8f-b011-b1ea61ffc107 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 92500df7-83c8-4757-9b24-3ee4dfba2da3) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:32.657208 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b542bf82-da60-4648-878b-79c48cf97a38 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Port': ['ID=ee8705ae-e058-46c9-92c5-3079cbeb1485,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:32.658348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5731a6f6-81a9-4a8f-b011-b1ea61ffc107 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:32.664561 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5731a6f6-81a9-4a8f-b011-b1ea61ffc107 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:32.680466 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b79c74af-81e8-4c5e-97e8-83670ed589ae None None] Network 92500df7-83c8-4757-9b24-3ee4dfba2da3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:47:32.689208 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5731a6f6-81a9-4a8f-b011-b1ea61ffc107 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 1.2545333 Dec 09 21:47:32.691833 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45130) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:32.863123 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-538dc2d2-5fbb-4843-860b-3f4313bb26f7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-92500df7-83c8-4757-9b24-3ee4dfba2da3', 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'fixed_ips': [{'subnet_id': '13dde2f9-0dfd-4600-912c-44b7903e3595'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:47:32.864786 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-538dc2d2-5fbb-4843-860b-3f4313bb26f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:32.925866 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b542bf82-da60-4648-878b-79c48cf97a38 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:33.026279 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-19008495-9f96-46ad-8414-947b5e8942b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:33.053605 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-19008495-9f96-46ad-8414-947b5e8942b4 None None] For port 835940d0-c170-49f1-810e-9c4a5bea622c, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=835940d0-c170-49f1-810e-9c4a5bea622c,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:33.196116 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b542bf82-da60-4648-878b-79c48cf97a38 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Router 4d8df6d4-f96f-4643-8663-28df67a09dd9 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:47:33.213537 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-19008495-9f96-46ad-8414-947b5e8942b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:33.263140 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-852faaa1-eaaa-4056-a8a4-3defd4c21b47 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:33.317544 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19008495-9f96-46ad-8414-947b5e8942b4 None None] Pushing event updated for resources: {'Port': ['ID=835940d0-c170-49f1-810e-9c4a5bea622c,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:33.372913 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b542bf82-da60-4648-878b-79c48cf97a38 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:47:33.378926 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b542bf82-da60-4648-878b-79c48cf97a38 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/routers/4d8df6d4-f96f-4643-8663-28df67a09dd9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0876281 Dec 09 21:47:33.387893 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f646be79-4a94-45d9-8a10-31f505d8f07e req-b3407111-4956-4b84-9aeb-5bfbc863a3fb tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:33.390811 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fe0d37c-8aae-48b4-b7c2-f12ccbf1c27b None None] Sync routers for ids ['4d8df6d4-f96f-4643-8663-28df67a09dd9'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:47:33.394960 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45148) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:33.396615 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f646be79-4a94-45d9-8a10-31f505d8f07e req-b3407111-4956-4b84-9aeb-5bfbc863a3fb tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/ports?device_id=adfb178e-8542-42ce-9636-b14306116737 HTTP/1.1" status: 200 len: 945 time: 0.1954865 Dec 09 21:47:33.422048 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0fe0d37c-8aae-48b4-b7c2-f12ccbf1c27b None None] Routers {'4d8df6d4-f96f-4643-8663-28df67a09dd9'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:47:33.422952 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-0fe0d37c-8aae-48b4-b7c2-f12ccbf1c27b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4d8df6d4-f96f-4643-8663-28df67a09dd9'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:33.459105 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f646be79-4a94-45d9-8a10-31f505d8f07e req-5f70bfb7-927c-4234-810e-8356a7b4bfc9 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/security-groups?id=6236a31a-7414-45a5-80b0-e5c8c72b2bb7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0617585 Dec 09 21:47:33.473139 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-0fe0d37c-8aae-48b4-b7c2-f12ccbf1c27b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:33.494636 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-538dc2d2-5fbb-4843-860b-3f4313bb26f7 None None] Allocated IP 172.20.0.2 (92500df7-83c8-4757-9b24-3ee4dfba2da3/13dde2f9-0dfd-4600-912c-44b7903e3595/67f1e511-4f0d-42c9-951b-d0bf389bd643) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:47:33.499029 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-161742691', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57'}], 'enable_snat': True}, 'gw_port_id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:47:28Z', 'updated_at': '2021-12-09T21:47:30Z', 'revision_number': 3, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:01:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3464, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:47:29Z', 'updated_at': '2021-12-09T21:47:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:33.502794 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f4fcc0f5-8dee-4f36-9ac4-d68d512c6729 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/ports?device_id=4d8df6d4-f96f-4643-8663-28df67a09dd9 HTTP/1.1" status: 200 len: 205 time: 0.1088901 Dec 09 21:47:33.505279 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45154) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:33.510441 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0fe0d37c-8aae-48b4-b7c2-f12ccbf1c27b None None] Routers {'4d8df6d4-f96f-4643-8663-28df67a09dd9'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:47:33.511986 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-0fe0d37c-8aae-48b4-b7c2-f12ccbf1c27b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4d8df6d4-f96f-4643-8663-28df67a09dd9'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:33.578226 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-0fe0d37c-8aae-48b4-b7c2-f12ccbf1c27b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:33.583826 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fe0d37c-8aae-48b4-b7c2-f12ccbf1c27b None None] The sync data for ids ['4d8df6d4-f96f-4643-8663-28df67a09dd9'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:47:33.611645 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-95010817-6cb4-4dfa-86be-6c02aff11f86 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:33.621615 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-738c77df-22a9-4925-8c72-fcb551dddb4b None None] The sync data for ids ['7521af04-4c9d-4f02-9889-0ff6f5545ff7'] in n-d-713301-27 is: [{'id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-161742691', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57'}], 'enable_snat': True}, 'gw_port_id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:47:28Z', 'updated_at': '2021-12-09T21:47:30Z', 'revision_number': 3, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:01:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3464, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:47:29Z', 'updated_at': '2021-12-09T21:47:32Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:47:33.862140 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-95010817-6cb4-4dfa-86be-6c02aff11f86 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:33.872139 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-95010817-6cb4-4dfa-86be-6c02aff11f86 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:33.992538 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-95010817-6cb4-4dfa-86be-6c02aff11f86 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:33.993016 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-95010817-6cb4-4dfa-86be-6c02aff11f86 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Fanout notify agent at l3_agent the message router_deleted on router 4d8df6d4-f96f-4643-8663-28df67a09dd9 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:47:34.052592 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-95010817-6cb4-4dfa-86be-6c02aff11f86 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:34.058368 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-95010817-6cb4-4dfa-86be-6c02aff11f86 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/routers/4d8df6d4-f96f-4643-8663-28df67a09dd9 HTTP/1.1" status: 204 len: 168 time: 0.5497224 Dec 09 21:47:34.058368 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30e2fa8d-ac7d-4b97-b2d6-a16a82867b75 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:34.060048 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45174) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:34.209204 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-e0475717-33b1-4c97-832c-8b1e1c10d0eb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting subnet 33b2b834-2f8a-441d-b1ed-4bc255441ae9 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:47:34.233736 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0475717-33b1-4c97-832c-8b1e1c10d0eb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:34.324670 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-538dc2d2-5fbb-4843-860b-3f4313bb26f7 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:34.342986 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-538dc2d2-5fbb-4843-860b-3f4313bb26f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:34.384017 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0475717-33b1-4c97-832c-8b1e1c10d0eb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:34.401307 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-538dc2d2-5fbb-4843-860b-3f4313bb26f7 None None] Network 92500df7-83c8-4757-9b24-3ee4dfba2da3 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:47:34.404907 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-538dc2d2-5fbb-4843-860b-3f4313bb26f7 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:34.419623 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-538dc2d2-5fbb-4843-860b-3f4313bb26f7 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:47:34.515024 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-538dc2d2-5fbb-4843-860b-3f4313bb26f7 None None] Attempting to bind port 67f1e511-4f0d-42c9-951b-d0bf389bd643 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:47:34.515711 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-538dc2d2-5fbb-4843-860b-3f4313bb26f7 None None] Attempting to bind port 67f1e511-4f0d-42c9-951b-d0bf389bd643 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '0189efa9-02eb-4071-ae6f-aee6c867d035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:47:34.516174 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-538dc2d2-5fbb-4843-860b-3f4313bb26f7 None None] Attempting to bind port 67f1e511-4f0d-42c9-951b-d0bf389bd643 on network 92500df7-83c8-4757-9b24-3ee4dfba2da3 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:47:34.522703 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-538dc2d2-5fbb-4843-860b-3f4313bb26f7 None None] Pushing event updated for resources: {'Port': ['ID=67f1e511-4f0d-42c9-951b-d0bf389bd643,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:34.527641 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-538dc2d2-5fbb-4843-860b-3f4313bb26f7 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 47, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:47:34.528078 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-538dc2d2-5fbb-4843-860b-3f4313bb26f7 None None] Checking segment: {'id': '0189efa9-02eb-4071-ae6f-aee6c867d035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:47:34.528578 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-538dc2d2-5fbb-4843-860b-3f4313bb26f7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:34.529062 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-538dc2d2-5fbb-4843-860b-3f4313bb26f7 None None] Bound using segment: {'id': '0189efa9-02eb-4071-ae6f-aee6c867d035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:47:34.529719 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-538dc2d2-5fbb-4843-860b-3f4313bb26f7 None None] Bound port: 67f1e511-4f0d-42c9-951b-d0bf389bd643, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0189efa9-02eb-4071-ae6f-aee6c867d035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:47:34.530682 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-538dc2d2-5fbb-4843-860b-3f4313bb26f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:34.593607 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0475717-33b1-4c97-832c-8b1e1c10d0eb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:34.642315 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-538dc2d2-5fbb-4843-860b-3f4313bb26f7 None None] For port 67f1e511-4f0d-42c9-951b-d0bf389bd643, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:47:34.653226 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-538dc2d2-5fbb-4843-860b-3f4313bb26f7 None None] For port 67f1e511-4f0d-42c9-951b-d0bf389bd643, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=67f1e511-4f0d-42c9-951b-d0bf389bd643,segment=NetworkSegment(0189efa9-02eb-4071-ae6f-aee6c867d035),segment_id=0189efa9-02eb-4071-ae6f-aee6c867d035)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:47:34.667326 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-538dc2d2-5fbb-4843-860b-3f4313bb26f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:34.730698 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-30e2fa8d-ac7d-4b97-b2d6-a16a82867b75 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Allocated IP 172.20.0.1 (92500df7-83c8-4757-9b24-3ee4dfba2da3/13dde2f9-0dfd-4600-912c-44b7903e3595/d478d292-7b6e-4f28-b6f2-bbf3ba7d2069) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:47:34.771931 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0475717-33b1-4c97-832c-8b1e1c10d0eb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:34.808877 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0475717-33b1-4c97-832c-8b1e1c10d0eb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Subnet': ['ID=33b2b834-2f8a-441d-b1ed-4bc255441ae9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:34.820247 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0475717-33b1-4c97-832c-8b1e1c10d0eb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:34.825325 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e0475717-33b1-4c97-832c-8b1e1c10d0eb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/subnets/33b2b834-2f8a-441d-b1ed-4bc255441ae9 HTTP/1.1" status: 204 len: 168 time: 0.7638662 Dec 09 21:47:34.828454 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45190) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:34.852166 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-538dc2d2-5fbb-4843-860b-3f4313bb26f7 None None] Pushing event updated for resources: {'Port': ['ID=67f1e511-4f0d-42c9-951b-d0bf389bd643,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:34.867487 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bcc4f9d0-df54-474f-8488-38306cc483e8 None None] Network 0e9cae05-4caf-4321-8322-e071c54fdaec requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:47:34.926377 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 835940d0-c170-49f1-810e-9c4a5bea622c up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:47:35.019221 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30e2fa8d-ac7d-4b97-b2d6-a16a82867b75 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:35.045069 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-90ab25c1-0af9-476a-a264-1aae123ab7a6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting subnet 3f2e4b28-1001-407c-b523-5ee42432aa45 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:47:35.058041 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-90ab25c1-0af9-476a-a264-1aae123ab7a6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:35.097495 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30e2fa8d-ac7d-4b97-b2d6-a16a82867b75 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:35.246795 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 835940d0-c170-49f1-810e-9c4a5bea622c triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:35.247287 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:35.323071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30e2fa8d-ac7d-4b97-b2d6-a16a82867b75 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network 92500df7-83c8-4757-9b24-3ee4dfba2da3 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:47:35.329980 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30e2fa8d-ac7d-4b97-b2d6-a16a82867b75 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Port': ['ID=d478d292-7b6e-4f28-b6f2-bbf3ba7d2069,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:35.334944 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-30e2fa8d-ac7d-4b97-b2d6-a16a82867b75 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:35.346544 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30e2fa8d-ac7d-4b97-b2d6-a16a82867b75 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:47:35.444850 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e42e930f-b145-46ef-ab94-4900b2502eb3 None None] DHCP port deletion for 0e9cae05-4caf-4321-8322-e071c54fdaec request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:47:35.475667 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30e2fa8d-ac7d-4b97-b2d6-a16a82867b75 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:35.581580 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e42e930f-b145-46ef-ab94-4900b2502eb3 None None] Deleting port 5fc45fe1-02ba-4838-81d4-d93a9372db56 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:47:35.583363 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e42e930f-b145-46ef-ab94-4900b2502eb3 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:35.712913 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e42e930f-b145-46ef-ab94-4900b2502eb3 None None] For port 5fc45fe1-02ba-4838-81d4-d93a9372db56, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5fc45fe1-02ba-4838-81d4-d93a9372db56,segment=NetworkSegment(cb645b8a-5d02-4c72-9e6f-dda9f5c57a07),segment_id=cb645b8a-5d02-4c72-9e6f-dda9f5c57a07)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:35.713572 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e42e930f-b145-46ef-ab94-4900b2502eb3 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:35.739498 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e42e930f-b145-46ef-ab94-4900b2502eb3 None None] Calling delete_port for 5fc45fe1-02ba-4838-81d4-d93a9372db56 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:47:35.805722 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c9b205fe-03dd-479b-bbca-9b701e0ceef8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:35.867953 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30e2fa8d-ac7d-4b97-b2d6-a16a82867b75 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:35.934290 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e42e930f-b145-46ef-ab94-4900b2502eb3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:35.980466 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-90ab25c1-0af9-476a-a264-1aae123ab7a6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:36.044796 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e42e930f-b145-46ef-ab94-4900b2502eb3 None None] Pushing event deleted for resources: {'Port': ['ID=5fc45fe1-02ba-4838-81d4-d93a9372db56,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:36.050202 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e42e930f-b145-46ef-ab94-4900b2502eb3 None None] No DVR routers for this DVR port 5fc45fe1-02ba-4838-81d4-d93a9372db56 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:47:36.117727 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-90ab25c1-0af9-476a-a264-1aae123ab7a6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:36.196199 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45218) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:36.208735 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-90ab25c1-0af9-476a-a264-1aae123ab7a6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:36.247289 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90ab25c1-0af9-476a-a264-1aae123ab7a6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Subnet': ['ID=3f2e4b28-1001-407c-b523-5ee42432aa45,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:36.258203 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-90ab25c1-0af9-476a-a264-1aae123ab7a6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:36.266451 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45222) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:36.267640 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6bfcdb63-4713-41ee-83e3-0081f75e8b58 None None] Network 940cad56-2f35-40f8-9ed5-25a1c83dbeda requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:47:36.267849 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-90ab25c1-0af9-476a-a264-1aae123ab7a6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/subnets/3f2e4b28-1001-407c-b523-5ee42432aa45 HTTP/1.1" status: 204 len: 168 time: 1.4273167 Dec 09 21:47:36.477124 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ea6f47db-681b-4925-a85b-76b02fb65c4e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:36.501841 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb6f4fb7-85f7-49fa-b7b6-cd3c9ddf08a1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:36.592175 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d177604-c4cd-4d41-a83a-7324136faa3f None None] Network 92500df7-83c8-4757-9b24-3ee4dfba2da3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:47:36.642126 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ea6f47db-681b-4925-a85b-76b02fb65c4e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:36.652470 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ea6f47db-681b-4925-a85b-76b02fb65c4e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:36.735084 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ea6f47db-681b-4925-a85b-76b02fb65c4e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=101c40b80c7a4a8084f8e5bb2f237bde&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5374489 Dec 09 21:47:36.736227 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea6f47db-681b-4925-a85b-76b02fb65c4e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6f310032-abed-48e5-b7e9-9df71d1612ec,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:36.739715 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45232) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:36.769405 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb6f4fb7-85f7-49fa-b7b6-cd3c9ddf08a1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:36.806688 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-195d503a-ca8b-4b56-822e-d5cd4c75a665 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:36.814547 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-eb6f4fb7-85f7-49fa-b7b6-cd3c9ddf08a1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0e9cae05-4caf-4321-8322-e071c54fdaec']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:36.837976 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9fb10be4-28e3-4c24-8860-b957f5ecc761 None None] DHCP port deletion for 940cad56-2f35-40f8-9ed5-25a1c83dbeda request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:47:36.840618 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-195d503a-ca8b-4b56-822e-d5cd4c75a665 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:36.840942 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30e2fa8d-ac7d-4b97-b2d6-a16a82867b75 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:36.853481 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-eb6f4fb7-85f7-49fa-b7b6-cd3c9ddf08a1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cb645b8a-5d02-4c72-9e6f-dda9f5c57a07') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:36.854225 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-eb6f4fb7-85f7-49fa-b7b6-cd3c9ddf08a1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cb645b8a-5d02-4c72-9e6f-dda9f5c57a07') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:36.901483 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30e2fa8d-ac7d-4b97-b2d6-a16a82867b75 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:36.913166 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb6f4fb7-85f7-49fa-b7b6-cd3c9ddf08a1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:36.931462 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:36.931462 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f18b5414-5906-480c-8bf0-ab7bf83907bd None None] Provisioning complete for port 67f1e511-4f0d-42c9-951b-d0bf389bd643 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:36.931462 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f18b5414-5906-480c-8bf0-ab7bf83907bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:36.955250 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-195d503a-ca8b-4b56-822e-d5cd4c75a665 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:36.964034 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-195d503a-ca8b-4b56-822e-d5cd4c75a665 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:36.966395 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-195d503a-ca8b-4b56-822e-d5cd4c75a665 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/6f310032-abed-48e5-b7e9-9df71d1612ec HTTP/1.1" status: 204 len: 168 time: 0.2256119 Dec 09 21:47:37.013732 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-195d503a-ca8b-4b56-822e-d5cd4c75a665 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6f310032-abed-48e5-b7e9-9df71d1612ec,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:37.017747 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9fb10be4-28e3-4c24-8860-b957f5ecc761 None None] Deleting port a41b2012-50f6-4ed6-a81b-1d858c64e6f6 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:47:37.018127 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9fb10be4-28e3-4c24-8860-b957f5ecc761 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:37.023127 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 67f1e511-4f0d-42c9-951b-d0bf389bd643 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:47:37.114434 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30e2fa8d-ac7d-4b97-b2d6-a16a82867b75 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Port': ['ID=d478d292-7b6e-4f28-b6f2-bbf3ba7d2069,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:37.164081 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb6f4fb7-85f7-49fa-b7b6-cd3c9ddf08a1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:37.200150 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-eb6f4fb7-85f7-49fa-b7b6-cd3c9ddf08a1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Releasing vlan 113 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:47:37.200872 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb6f4fb7-85f7-49fa-b7b6-cd3c9ddf08a1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:47:37.208471 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:47:37.247331 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30e2fa8d-ac7d-4b97-b2d6-a16a82867b75 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:37.304025 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f18b5414-5906-480c-8bf0-ab7bf83907bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:37.314808 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-9fb10be4-28e3-4c24-8860-b957f5ecc761 None None] For port a41b2012-50f6-4ed6-a81b-1d858c64e6f6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a41b2012-50f6-4ed6-a81b-1d858c64e6f6,segment=NetworkSegment(96ebe272-33cc-4e4e-a26a-639d4cbc5b6c),segment_id=96ebe272-33cc-4e4e-a26a-639d4cbc5b6c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:37.315277 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9fb10be4-28e3-4c24-8860-b957f5ecc761 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:37.377965 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9fb10be4-28e3-4c24-8860-b957f5ecc761 None None] Calling delete_port for a41b2012-50f6-4ed6-a81b-1d858c64e6f6 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:47:37.434524 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb6f4fb7-85f7-49fa-b7b6-cd3c9ddf08a1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:37.437823 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f18b5414-5906-480c-8bf0-ab7bf83907bd None None] For port 67f1e511-4f0d-42c9-951b-d0bf389bd643, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=67f1e511-4f0d-42c9-951b-d0bf389bd643,segment=NetworkSegment(0189efa9-02eb-4071-ae6f-aee6c867d035),segment_id=0189efa9-02eb-4071-ae6f-aee6c867d035)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:37.455416 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eb6f4fb7-85f7-49fa-b7b6-cd3c9ddf08a1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:37.459407 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f18b5414-5906-480c-8bf0-ab7bf83907bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:37.469936 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-eb6f4fb7-85f7-49fa-b7b6-cd3c9ddf08a1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/networks/0e9cae05-4caf-4321-8322-e071c54fdaec HTTP/1.1" status: 204 len: 168 time: 1.2022772 Dec 09 21:47:37.472694 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45246) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:37.562551 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb6f4fb7-85f7-49fa-b7b6-cd3c9ddf08a1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Network': ['ID=0e9cae05-4caf-4321-8322-e071c54fdaec,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:37.617526 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45250) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:37.640924 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 67f1e511-4f0d-42c9-951b-d0bf389bd643 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:37.641505 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:37.649808 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3b758d6e-66c4-4ae7-a24f-782357974962 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:37.678903 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78236296-4f91-4a19-9278-9539642d9649 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:37.709494 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30e2fa8d-ac7d-4b97-b2d6-a16a82867b75 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network 92500df7-83c8-4757-9b24-3ee4dfba2da3 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:47:37.715155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-30e2fa8d-ac7d-4b97-b2d6-a16a82867b75 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:37.757866 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a3d20ed6-cc2a-4e4c-a74f-560ac749732c None None] Provisioning complete for port 67f1e511-4f0d-42c9-951b-d0bf389bd643 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:37.758403 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a3d20ed6-cc2a-4e4c-a74f-560ac749732c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:37.799562 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f18b5414-5906-480c-8bf0-ab7bf83907bd None None] Pushing event updated for resources: {'Port': ['ID=67f1e511-4f0d-42c9-951b-d0bf389bd643,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:37.805568 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-78236296-4f91-4a19-9278-9539642d9649 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting port a41b2012-50f6-4ed6-a81b-1d858c64e6f6 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:47:37.805863 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78236296-4f91-4a19-9278-9539642d9649 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:37.884805 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9fb10be4-28e3-4c24-8860-b957f5ecc761 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:37.925195 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3b758d6e-66c4-4ae7-a24f-782357974962 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:37.942502 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3b758d6e-66c4-4ae7-a24f-782357974962 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:37.971860 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fb10be4-28e3-4c24-8860-b957f5ecc761 None None] Pushing event deleted for resources: {'Port': ['ID=a41b2012-50f6-4ed6-a81b-1d858c64e6f6,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:37.977807 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-78236296-4f91-4a19-9278-9539642d9649 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] For port a41b2012-50f6-4ed6-a81b-1d858c64e6f6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a41b2012-50f6-4ed6-a81b-1d858c64e6f6,segment=NetworkSegment(96ebe272-33cc-4e4e-a26a-639d4cbc5b6c),segment_id=96ebe272-33cc-4e4e-a26a-639d4cbc5b6c)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:37.978384 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78236296-4f91-4a19-9278-9539642d9649 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:37.979722 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9fb10be4-28e3-4c24-8860-b957f5ecc761 None None] No DVR routers for this DVR port a41b2012-50f6-4ed6-a81b-1d858c64e6f6 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:47:38.003757 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-78236296-4f91-4a19-9278-9539642d9649 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Calling delete_port for a41b2012-50f6-4ed6-a81b-1d858c64e6f6 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:47:38.057505 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:38.058440 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a3d20ed6-cc2a-4e4c-a74f-560ac749732c None None] Provisioning complete for port d478d292-7b6e-4f28-b6f2-bbf3ba7d2069 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:38.058851 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a3d20ed6-cc2a-4e4c-a74f-560ac749732c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:38.105607 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a3d20ed6-cc2a-4e4c-a74f-560ac749732c None None] Port d478d292-7b6e-4f28-b6f2-bbf3ba7d2069 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:47:38.153218 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-30e2fa8d-ac7d-4b97-b2d6-a16a82867b75 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Router 7521af04-4c9d-4f02-9889-0ff6f5545ff7 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:47:38.167136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5fc45fe1-02ba-4838-81d4-d93a9372db56 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:47:38.187243 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3b758d6e-66c4-4ae7-a24f-782357974962 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=52bf2d30be6e458e98fa1cdb3c2a63c5&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5589161 Dec 09 21:47:38.188728 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b758d6e-66c4-4ae7-a24f-782357974962 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=460364d4-c5f2-46dc-b9eb-8b90c86277b9,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:38.194105 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45260) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:38.207636 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78236296-4f91-4a19-9278-9539642d9649 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:38.238543 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 5fc45fe1-02ba-4838-81d4-d93a9372db56 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:47:38.238895 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5fc45fe1-02ba-4838-81d4-d93a9372db56 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:47:38.239765 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a41b2012-50f6-4ed6-a81b-1d858c64e6f6 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:47:38.302749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78236296-4f91-4a19-9278-9539642d9649 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Port': ['ID=a41b2012-50f6-4ed6-a81b-1d858c64e6f6,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:38.315011 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: a41b2012-50f6-4ed6-a81b-1d858c64e6f6 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:47:38.315355 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a41b2012-50f6-4ed6-a81b-1d858c64e6f6 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:47:38.327571 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e4d2996e-99c3-450a-9de6-f284a5217f93 None None] Provisioning complete for port d478d292-7b6e-4f28-b6f2-bbf3ba7d2069 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:38.331252 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-78236296-4f91-4a19-9278-9539642d9649 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] No DVR routers for this DVR port a41b2012-50f6-4ed6-a81b-1d858c64e6f6 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:47:38.331604 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e4d2996e-99c3-450a-9de6-f284a5217f93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:38.377592 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e4d2996e-99c3-450a-9de6-f284a5217f93 None None] Port d478d292-7b6e-4f28-b6f2-bbf3ba7d2069 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:47:38.380749 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-30e2fa8d-ac7d-4b97-b2d6-a16a82867b75 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:47:38.387346 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-30e2fa8d-ac7d-4b97-b2d6-a16a82867b75 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "PUT /v2.0/routers/7521af04-4c9d-4f02-9889-0ff6f5545ff7/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.6944358 Dec 09 21:47:38.392129 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] Sync routers for ids ['7521af04-4c9d-4f02-9889-0ff6f5545ff7'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:47:38.421994 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] Routers {'7521af04-4c9d-4f02-9889-0ff6f5545ff7'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:47:38.423069 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7521af04-4c9d-4f02-9889-0ff6f5545ff7'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:38.510876 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-982716b3-0b84-4f5e-bbe4-41c380b57ed1 None None] Provisioning complete for port d478d292-7b6e-4f28-b6f2-bbf3ba7d2069 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:38.511640 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-982716b3-0b84-4f5e-bbe4-41c380b57ed1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:38.512557 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78236296-4f91-4a19-9278-9539642d9649 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:38.543753 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-78236296-4f91-4a19-9278-9539642d9649 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['940cad56-2f35-40f8-9ed5-25a1c83dbeda']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:38.555508 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-78236296-4f91-4a19-9278-9539642d9649 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '96ebe272-33cc-4e4e-a26a-639d4cbc5b6c') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:38.555741 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-78236296-4f91-4a19-9278-9539642d9649 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '96ebe272-33cc-4e4e-a26a-639d4cbc5b6c') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:38.567110 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78236296-4f91-4a19-9278-9539642d9649 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:38.577333 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] Set router 7521af04-4c9d-4f02-9889-0ff6f5545ff7 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:47:38.595801 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78236296-4f91-4a19-9278-9539642d9649 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:38.605563 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-982716b3-0b84-4f5e-bbe4-41c380b57ed1 None None] Port d478d292-7b6e-4f28-b6f2-bbf3ba7d2069 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:47:38.612440 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-78236296-4f91-4a19-9278-9539642d9649 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Releasing vlan 126 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:47:38.612918 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78236296-4f91-4a19-9278-9539642d9649 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:47:38.616721 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:47:38.631034 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-88b726d9-4fdd-4202-a829-6e4a2938d345 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:38.694620 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-88b726d9-4fdd-4202-a829-6e4a2938d345 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:38.731282 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78236296-4f91-4a19-9278-9539642d9649 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:38.740268 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-78236296-4f91-4a19-9278-9539642d9649 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:38.747066 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-78236296-4f91-4a19-9278-9539642d9649 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/networks/940cad56-2f35-40f8-9ed5-25a1c83dbeda HTTP/1.1" status: 204 len: 168 time: 1.2700140 Dec 09 21:47:38.751275 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45282) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:38.757639 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-77982db8-56ad-4a34-b003-af53fe52dd28 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'network': {'name': 'tempest-RoutersTest-26277594'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:38.783760 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 67f1e511-4f0d-42c9-951b-d0bf389bd643 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:47:38.784456 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78236296-4f91-4a19-9278-9539642d9649 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Network': ['ID=940cad56-2f35-40f8-9ed5-25a1c83dbeda,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:38.812895 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-77982db8-56ad-4a34-b003-af53fe52dd28 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Made reservation on behalf of 99ff5f79d7574ab091d0707b5e01465a for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:47:38.816949 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77982db8-56ad-4a34-b003-af53fe52dd28 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:38.871009 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-88b726d9-4fdd-4202-a829-6e4a2938d345 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:38.876503 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-88b726d9-4fdd-4202-a829-6e4a2938d345 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:38.882480 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-88b726d9-4fdd-4202-a829-6e4a2938d345 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/460364d4-c5f2-46dc-b9eb-8b90c86277b9 HTTP/1.1" status: 204 len: 168 time: 0.6867440 Dec 09 21:47:38.893047 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-77982db8-56ad-4a34-b003-af53fe52dd28 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] vlan segment allocate from pool success with {'vlan_id': 139, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:47:38.906633 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88b726d9-4fdd-4202-a829-6e4a2938d345 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=460364d4-c5f2-46dc-b9eb-8b90c86277b9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:38.919763 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77982db8-56ad-4a34-b003-af53fe52dd28 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:38.920401 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-77982db8-56ad-4a34-b003-af53fe52dd28 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Added segment 52ff56a0-a273-4d7b-a28f-26f4a7f3d30e of type vlan for network b177be74-2a80-4331-9382-830a8dba4bac Dec 09 21:47:38.980170 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77982db8-56ad-4a34-b003-af53fe52dd28 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:38.994487 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 67f1e511-4f0d-42c9-951b-d0bf389bd643 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:38.994866 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:39.013323 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-161742691', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57'}], 'enable_snat': True}, 'gw_port_id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:47:28Z', 'updated_at': '2021-12-09T21:47:35Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:01:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3464, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:47:29Z', 'updated_at': '2021-12-09T21:47:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'd478d292-7b6e-4f28-b6f2-bbf3ba7d2069', 'name': '', 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:99:1a:9d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'device_owner': 'network:router_interface', 'standard_attr_id': 3471, 'fixed_ips': [{'subnet_id': '13dde2f9-0dfd-4600-912c-44b7903e3595', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:47:34Z', 'updated_at': '2021-12-09T21:47:36Z', 'revision_number': 2, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '13dde2f9-0dfd-4600-912c-44b7903e3595', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:39.042052 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] Checking router: 7521af04-4c9d-4f02-9889-0ff6f5545ff7 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:47:39.042415 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] Updating router 7521af04-4c9d-4f02-9889-0ff6f5545ff7 port d478d292-7b6e-4f28-b6f2-bbf3ba7d2069 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:47:39.046478 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77982db8-56ad-4a34-b003-af53fe52dd28 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:39.056987 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-77982db8-56ad-4a34-b003-af53fe52dd28 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:39.059351 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-77982db8-56ad-4a34-b003-af53fe52dd28 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:39.088181 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:39.099840 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c368b74f-86fe-4fb0-804a-39a6b6f24f9f req-4a074d2b-850b-4728-bb9d-34985235ebeb tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:39.111888 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c368b74f-86fe-4fb0-804a-39a6b6f24f9f req-4a074d2b-850b-4728-bb9d-34985235ebeb tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/ports?device_id=adfb178e-8542-42ce-9636-b14306116737 HTTP/1.1" status: 200 len: 945 time: 0.5376480 Dec 09 21:47:39.122317 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-77982db8-56ad-4a34-b003-af53fe52dd28 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 764 time: 0.3654044 Dec 09 21:47:39.130693 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45288) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:39.139662 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-6180f368-c9ad-4a0f-96d8-0ba99a349ac5 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'subnet': {'network_id': 'b177be74-2a80-4331-9382-830a8dba4bac', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:39.216379 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c368b74f-86fe-4fb0-804a-39a6b6f24f9f req-195e2c5d-1515-4b6d-b09d-ccd188cf5855 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/security-groups?id=6236a31a-7414-45a5-80b0-e5c8c72b2bb7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1020494 Dec 09 21:47:39.218672 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77982db8-56ad-4a34-b003-af53fe52dd28 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Network': ['ID=b177be74-2a80-4331-9382-830a8dba4bac,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:39.230805 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network b177be74-2a80-4331-9382-830a8dba4bac details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:47:39.386481 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6180f368-c9ad-4a0f-96d8-0ba99a349ac5 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Made reservation on behalf of 99ff5f79d7574ab091d0707b5e01465a for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:47:39.397657 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6180f368-c9ad-4a0f-96d8-0ba99a349ac5 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:39.409449 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-755ff3a2-ff51-482e-94c0-e22c12650d92 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-273679796&fields=id&tenant_id=dce7594ac2a74901912a2f19de04bf79 HTTP/1.1" status: 200 len: 267 time: 0.1022830 Dec 09 21:47:39.547680 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:39.556662 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:39.627756 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-21f4e294-e9e7-4043-af3a-c53664502c8d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:39.637356 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-21f4e294-e9e7-4043-af3a-c53664502c8d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/networks?id=92500df7-83c8-4757-9b24-3ee4dfba2da3 HTTP/1.1" status: 200 len: 796 time: 0.2203784 Dec 09 21:47:39.679623 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:39.680794 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-9f40119a-3ae2-473a-a1e3-ae55e5a49c3c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/quotas/dce7594ac2a74901912a2f19de04bf79 HTTP/1.1" status: 200 len: 375 time: 0.0313632 Dec 09 21:47:39.689425 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbe002f0-9fbe-4d66-b47f-19197f24e8a7 None None] Pushing event updated for resources: {'Port': ['ID=d478d292-7b6e-4f28-b6f2-bbf3ba7d2069,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:39.713818 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6180f368-c9ad-4a0f-96d8-0ba99a349ac5 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:39.714358 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbe002f0-9fbe-4d66-b47f-19197f24e8a7 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:39.714923 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbe002f0-9fbe-4d66-b47f-19197f24e8a7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:39.715712 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbe002f0-9fbe-4d66-b47f-19197f24e8a7 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:39.716391 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbe002f0-9fbe-4d66-b47f-19197f24e8a7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:39.717030 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbe002f0-9fbe-4d66-b47f-19197f24e8a7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:39.717811 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbe002f0-9fbe-4d66-b47f-19197f24e8a7 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:39.718357 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbe002f0-9fbe-4d66-b47f-19197f24e8a7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:39.718891 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbe002f0-9fbe-4d66-b47f-19197f24e8a7 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:39.719422 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbe002f0-9fbe-4d66-b47f-19197f24e8a7 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:39.720118 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbe002f0-9fbe-4d66-b47f-19197f24e8a7 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:39.720649 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbe002f0-9fbe-4d66-b47f-19197f24e8a7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:39.721190 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbe002f0-9fbe-4d66-b47f-19197f24e8a7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:39.721708 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbe002f0-9fbe-4d66-b47f-19197f24e8a7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:39.743489 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] Attempting to bind port d478d292-7b6e-4f28-b6f2-bbf3ba7d2069 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:47:39.743957 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] Attempting to bind port d478d292-7b6e-4f28-b6f2-bbf3ba7d2069 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '0189efa9-02eb-4071-ae6f-aee6c867d035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:47:39.744482 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] Attempting to bind port d478d292-7b6e-4f28-b6f2-bbf3ba7d2069 on network 92500df7-83c8-4757-9b24-3ee4dfba2da3 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:47:39.751755 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 47, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:47:39.752387 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] Checking segment: {'id': '0189efa9-02eb-4071-ae6f-aee6c867d035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:47:39.753102 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:39.753597 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] Bound using segment: {'id': '0189efa9-02eb-4071-ae6f-aee6c867d035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:47:39.754184 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] Bound port: d478d292-7b6e-4f28-b6f2-bbf3ba7d2069, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0189efa9-02eb-4071-ae6f-aee6c867d035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:47:39.754671 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:39.814359 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-63bed600-ea73-4d89-b72f-20bbb3eaf2ff tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1287453 Dec 09 21:47:39.817611 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6180f368-c9ad-4a0f-96d8-0ba99a349ac5 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Subnet': ['ID=8f2a71ca-4303-4584-a6d9-06cfdaf294d4,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:39.879556 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] For port d478d292-7b6e-4f28-b6f2-bbf3ba7d2069, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:47:39.883871 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] For port d478d292-7b6e-4f28-b6f2-bbf3ba7d2069, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d478d292-7b6e-4f28-b6f2-bbf3ba7d2069,segment=NetworkSegment(0189efa9-02eb-4071-ae6f-aee6c867d035),segment_id=0189efa9-02eb-4071-ae6f-aee6c867d035)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:47:39.889738 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6180f368-c9ad-4a0f-96d8-0ba99a349ac5 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Checking segment: {'id': '52ff56a0-a273-4d7b-a28f-26f4a7f3d30e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'b177be74-2a80-4331-9382-830a8dba4bac'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:47:39.890114 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6180f368-c9ad-4a0f-96d8-0ba99a349ac5 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network hostable DHCP agents. Network: b177be74-2a80-4331-9382-830a8dba4bac, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:47:39.891258 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:39.940647 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0399fbe9-c22b-4624-bbbb-200d42f16f31 req-7e74e4be-ca3d-44af-ac9a-af980a1900a1 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:39.942582 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0399fbe9-c22b-4624-bbbb-200d42f16f31 req-7e74e4be-ca3d-44af-ac9a-af980a1900a1 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.31 "GET /v2.0/ports?device_id=adfb178e-8542-42ce-9636-b14306116737 HTTP/1.1" status: 200 len: 945 time: 0.1170681 Dec 09 21:47:39.944048 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6180f368-c9ad-4a0f-96d8-0ba99a349ac5 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network b177be74-2a80-4331-9382-830a8dba4bac is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:47:39.961201 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-6180f368-c9ad-4a0f-96d8-0ba99a349ac5 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, b177be74-2a80-4331-9382-830a8dba4bac) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:39.980470 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6180f368-c9ad-4a0f-96d8-0ba99a349ac5 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:39.981058 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6180f368-c9ad-4a0f-96d8-0ba99a349ac5 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:39.982014 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d8e130c9-3e17-4e4e-8982-dea5f2da69a4 None None] Network b177be74-2a80-4331-9382-830a8dba4bac requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:47:39.983205 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] Routers {'7521af04-4c9d-4f02-9889-0ff6f5545ff7'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:47:39.983814 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7521af04-4c9d-4f02-9889-0ff6f5545ff7'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:40.040454 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6180f368-c9ad-4a0f-96d8-0ba99a349ac5 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.9078293 Dec 09 21:47:40.043552 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45312) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:40.049452 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-45359310-be8e-4918-9b66-a0e3f290c989 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1267805423', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:40.095363 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-45359310-be8e-4918-9b66-a0e3f290c989 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:40.096939 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-45359310-be8e-4918-9b66-a0e3f290c989 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:40.122915 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-2eccb137-1664-4d16-843b-9a88ca48ef04 service neutron] 10.222.0.13 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3023312 Dec 09 21:47:40.175376 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-0399fbe9-c22b-4624-bbbb-200d42f16f31 req-0e88e90f-4f2f-4dfd-a71a-792225bb1d6a tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Deleting port fb9f4126-c8f9-4d33-b0f7-3a9218c6e391 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:47:40.175750 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0399fbe9-c22b-4624-bbbb-200d42f16f31 req-0e88e90f-4f2f-4dfd-a71a-792225bb1d6a tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:40.250520 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4de1c720-a610-4889-a4c1-5249b4b55185 None None] Provisioning complete for port d478d292-7b6e-4f28-b6f2-bbf3ba7d2069 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:40.250866 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4de1c720-a610-4889-a4c1-5249b4b55185 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:40.265668 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] Set router 7521af04-4c9d-4f02-9889-0ff6f5545ff7 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:47:40.307612 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-45359310-be8e-4918-9b66-a0e3f290c989 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:40.312290 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf9768ec-3910-4649-8a42-c9cbe8ad904e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-b177be74-2a80-4331-9382-830a8dba4bac', 'network_id': 'b177be74-2a80-4331-9382-830a8dba4bac', 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'fixed_ips': [{'subnet_id': '8f2a71ca-4303-4584-a6d9-06cfdaf294d4'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:47:40.313290 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cf9768ec-3910-4649-8a42-c9cbe8ad904e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:40.336680 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-45359310-be8e-4918-9b66-a0e3f290c989 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:40.349099 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-644b67b1-f328-4947-9ca5-5191afc1eb0c service neutron] 10.222.0.13 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2124321 Dec 09 21:47:40.361946 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbe002f0-9fbe-4d66-b47f-19197f24e8a7 None None] Pushing event updated for resources: {'Port': ['ID=d478d292-7b6e-4f28-b6f2-bbf3ba7d2069,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:40.432421 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-45359310-be8e-4918-9b66-a0e3f290c989 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:40.433804 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-45359310-be8e-4918-9b66-a0e3f290c989 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 0.3888490 Dec 09 21:47:40.436863 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45322) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:40.445560 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-8d4f8c93-5b7e-4a2c-b92e-f25aa723e7c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'port': {'network_id': 'b177be74-2a80-4331-9382-830a8dba4bac', 'name': 'tempest-RoutersTest-202946162'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:40.462637 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-0399fbe9-c22b-4624-bbbb-200d42f16f31 req-0e88e90f-4f2f-4dfd-a71a-792225bb1d6a tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] For port fb9f4126-c8f9-4d33-b0f7-3a9218c6e391, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=fb9f4126-c8f9-4d33-b0f7-3a9218c6e391,segment=NetworkSegment(f4832b4c-9721-4fb3-b34b-0781180d5872),segment_id=f4832b4c-9721-4fb3-b34b-0781180d5872)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:40.462951 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0399fbe9-c22b-4624-bbbb-200d42f16f31 req-0e88e90f-4f2f-4dfd-a71a-792225bb1d6a tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:40.481936 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-0399fbe9-c22b-4624-bbbb-200d42f16f31 req-0e88e90f-4f2f-4dfd-a71a-792225bb1d6a tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Calling delete_port for fb9f4126-c8f9-4d33-b0f7-3a9218c6e391 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:47:40.605893 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4de1c720-a610-4889-a4c1-5249b4b55185 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:40.732837 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8d4f8c93-5b7e-4a2c-b92e-f25aa723e7c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Made reservation on behalf of 99ff5f79d7574ab091d0707b5e01465a for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:47:40.734881 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-cf9768ec-3910-4649-8a42-c9cbe8ad904e None None] Allocated IP 172.20.0.2 (b177be74-2a80-4331-9382-830a8dba4bac/8f2a71ca-4303-4584-a6d9-06cfdaf294d4/5262d190-941b-4b4e-aa6b-735e4f4b6dc5) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:47:40.737067 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8d4f8c93-5b7e-4a2c-b92e-f25aa723e7c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:40.743423 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-4de1c720-a610-4889-a4c1-5249b4b55185 None None] For port d478d292-7b6e-4f28-b6f2-bbf3ba7d2069, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d478d292-7b6e-4f28-b6f2-bbf3ba7d2069,segment=NetworkSegment(0189efa9-02eb-4071-ae6f-aee6c867d035),segment_id=0189efa9-02eb-4071-ae6f-aee6c867d035)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:40.765442 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4de1c720-a610-4889-a4c1-5249b4b55185 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:40.815355 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [None req-8d4f8c93-5b7e-4a2c-b92e-f25aa723e7c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] device_id is not set on port 498d3e9d-a098-4d2d-9175-fcdcded1960b yet. {{(pid=103438) _can_notify /opt/stack/neutron/neutron/notifiers/nova.py:190}} Dec 09 21:47:40.819638 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0399fbe9-c22b-4624-bbbb-200d42f16f31 req-0e88e90f-4f2f-4dfd-a71a-792225bb1d6a tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:40.854036 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-161742691', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57'}], 'enable_snat': True}, 'gw_port_id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:47:28Z', 'updated_at': '2021-12-09T21:47:35Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:01:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3464, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:47:29Z', 'updated_at': '2021-12-09T21:47:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'd478d292-7b6e-4f28-b6f2-bbf3ba7d2069', 'name': '', 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:99:1a:9d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'device_owner': 'network:router_interface', 'standard_attr_id': 3471, 'fixed_ips': [{'subnet_id': '13dde2f9-0dfd-4600-912c-44b7903e3595', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:47:34Z', 'updated_at': '2021-12-09T21:47:39Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '13dde2f9-0dfd-4600-912c-44b7903e3595', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:40.905886 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['fb9f4126-c8f9-4d33-b0f7-3a9218c6e391'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:47:40.938467 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50e3dc44-afa7-4fec-9bcb-914965845faa req-003f07d0-9d16-4ec6-97a5-e107232fede9 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:40.949994 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50e3dc44-afa7-4fec-9bcb-914965845faa req-003f07d0-9d16-4ec6-97a5-e107232fede9 tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/ports?device_id=adfb178e-8542-42ce-9636-b14306116737 HTTP/1.1" status: 200 len: 867 time: 0.1809518 Dec 09 21:47:40.972611 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e88e90f-4f2f-4dfd-a71a-792225bb1d6a tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Pushing event deleted for resources: {'Port': ['ID=fb9f4126-c8f9-4d33-b0f7-3a9218c6e391,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:41.015122 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-0399fbe9-c22b-4624-bbbb-200d42f16f31 req-0e88e90f-4f2f-4dfd-a71a-792225bb1d6a tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] No DVR routers for this DVR port fb9f4126-c8f9-4d33-b0f7-3a9218c6e391 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:47:41.020954 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0399fbe9-c22b-4624-bbbb-200d42f16f31 req-0e88e90f-4f2f-4dfd-a71a-792225bb1d6a tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:41.030940 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0399fbe9-c22b-4624-bbbb-200d42f16f31 req-0e88e90f-4f2f-4dfd-a71a-792225bb1d6a tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.31 "DELETE /v2.0/ports/fb9f4126-c8f9-4d33-b0f7-3a9218c6e391 HTTP/1.1" status: 204 len: 173 time: 1.0791595 Dec 09 21:47:41.071042 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'adfb178e-8542-42ce-9636-b14306116737', 'name': 'network-vif-deleted', 'tag': 'fb9f4126-c8f9-4d33-b0f7-3a9218c6e391'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:47:41.081735 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50e3dc44-afa7-4fec-9bcb-914965845faa req-e970c536-8177-4cfe-929c-5a458d9558fc tempest-VolumesActionsTest-1257777428 tempest-VolumesActionsTest-1257777428-project] 10.222.0.13 "GET /v2.0/security-groups?id=6236a31a-7414-45a5-80b0-e5c8c72b2bb7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1272855 Dec 09 21:47:41.085740 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6a5e51f3-e910-4d1e-adb1-3edbc2577816" -d '{"events": [{"server_uuid": "adfb178e-8542-42ce-9636-b14306116737", "name": "network-vif-deleted", "tag": "fb9f4126-c8f9-4d33-b0f7-3a9218c6e391"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:47:41.122610 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1f6a66d1-9f70-4fef-bb58-84464deeffa5 None None] Provisioning complete for port d478d292-7b6e-4f28-b6f2-bbf3ba7d2069 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:41.123424 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1f6a66d1-9f70-4fef-bb58-84464deeffa5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:41.126242 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4de1c720-a610-4889-a4c1-5249b4b55185 None None] Pushing event updated for resources: {'Port': ['ID=d478d292-7b6e-4f28-b6f2-bbf3ba7d2069,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:41.214965 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-adba6dce-c082-4c5b-9a3d-3b9896011c48 req-682ec1e6-28a4-4368-8b58-39efe595625c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 210 time: 0.0403781 Dec 09 21:47:41.220449 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4de1c720-a610-4889-a4c1-5249b4b55185 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:41.220953 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4de1c720-a610-4889-a4c1-5249b4b55185 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:41.221596 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4de1c720-a610-4889-a4c1-5249b4b55185 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:41.222091 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4de1c720-a610-4889-a4c1-5249b4b55185 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:41.224120 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4de1c720-a610-4889-a4c1-5249b4b55185 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:41.224651 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4de1c720-a610-4889-a4c1-5249b4b55185 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:41.225245 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4de1c720-a610-4889-a4c1-5249b4b55185 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:41.225716 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4de1c720-a610-4889-a4c1-5249b4b55185 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:41.226877 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4de1c720-a610-4889-a4c1-5249b4b55185 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:41.227483 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4de1c720-a610-4889-a4c1-5249b4b55185 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:41.227959 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4de1c720-a610-4889-a4c1-5249b4b55185 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:41.229456 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4de1c720-a610-4889-a4c1-5249b4b55185 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:41.230568 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4de1c720-a610-4889-a4c1-5249b4b55185 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:47:41.277964 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11e4e9fb-176f-4d1d-8454-9a513567ae9e None None] The sync data for ids ['7521af04-4c9d-4f02-9889-0ff6f5545ff7'] in n-d-713301-27 is: [{'id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-161742691', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57'}], 'enable_snat': True}, 'gw_port_id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:47:28Z', 'updated_at': '2021-12-09T21:47:35Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:01:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3464, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:47:29Z', 'updated_at': '2021-12-09T21:47:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'd478d292-7b6e-4f28-b6f2-bbf3ba7d2069', 'name': '', 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:99:1a:9d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'device_owner': 'network:router_interface', 'standard_attr_id': 3471, 'fixed_ips': [{'subnet_id': '13dde2f9-0dfd-4600-912c-44b7903e3595', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:47:34Z', 'updated_at': '2021-12-09T21:47:39Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '13dde2f9-0dfd-4600-912c-44b7903e3595', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:47:41.301028 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:47:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c296555a-cd27-459e-9395-a96987fcaa90 x-openstack-request-id: req-c296555a-cd27-459e-9395-a96987fcaa90 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:47:41.301332 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "adfb178e-8542-42ce-9636-b14306116737", "name": "network-vif-deleted", "tag": "fb9f4126-c8f9-4d33-b0f7-3a9218c6e391", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:47:41.301579 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c296555a-cd27-459e-9395-a96987fcaa90 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:47:41.301990 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'adfb178e-8542-42ce-9636-b14306116737', 'name': 'network-vif-deleted', 'tag': 'fb9f4126-c8f9-4d33-b0f7-3a9218c6e391', 'status': 'completed', 'code': 200} Dec 09 21:47:41.680294 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cf9768ec-3910-4649-8a42-c9cbe8ad904e None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:41.711457 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cf9768ec-3910-4649-8a42-c9cbe8ad904e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:41.760088 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf9768ec-3910-4649-8a42-c9cbe8ad904e None None] Network b177be74-2a80-4331-9382-830a8dba4bac is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:47:41.764404 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-cf9768ec-3910-4649-8a42-c9cbe8ad904e None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:41.774209 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf9768ec-3910-4649-8a42-c9cbe8ad904e None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:47:41.794309 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf9768ec-3910-4649-8a42-c9cbe8ad904e None None] Pushing event updated for resources: {'Port': ['ID=5262d190-941b-4b4e-aa6b-735e4f4b6dc5,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:41.801003 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-8d4f8c93-5b7e-4a2c-b92e-f25aa723e7c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Allocated IP 172.20.0.4 (b177be74-2a80-4331-9382-830a8dba4bac/8f2a71ca-4303-4584-a6d9-06cfdaf294d4/498d3e9d-a098-4d2d-9175-fcdcded1960b) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:47:41.934732 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-cf9768ec-3910-4649-8a42-c9cbe8ad904e None None] Attempting to bind port 5262d190-941b-4b4e-aa6b-735e4f4b6dc5 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:47:41.940018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-cf9768ec-3910-4649-8a42-c9cbe8ad904e None None] Attempting to bind port 5262d190-941b-4b4e-aa6b-735e4f4b6dc5 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '52ff56a0-a273-4d7b-a28f-26f4a7f3d30e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'b177be74-2a80-4331-9382-830a8dba4bac'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:47:41.940502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf9768ec-3910-4649-8a42-c9cbe8ad904e None None] Attempting to bind port 5262d190-941b-4b4e-aa6b-735e4f4b6dc5 on network b177be74-2a80-4331-9382-830a8dba4bac {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:47:41.953840 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf9768ec-3910-4649-8a42-c9cbe8ad904e None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 47, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:47:41.954409 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf9768ec-3910-4649-8a42-c9cbe8ad904e None None] Checking segment: {'id': '52ff56a0-a273-4d7b-a28f-26f4a7f3d30e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'b177be74-2a80-4331-9382-830a8dba4bac'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:47:41.955022 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cf9768ec-3910-4649-8a42-c9cbe8ad904e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:41.956068 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf9768ec-3910-4649-8a42-c9cbe8ad904e None None] Bound using segment: {'id': '52ff56a0-a273-4d7b-a28f-26f4a7f3d30e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'b177be74-2a80-4331-9382-830a8dba4bac'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:47:41.960182 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-cf9768ec-3910-4649-8a42-c9cbe8ad904e None None] Bound port: 5262d190-941b-4b4e-aa6b-735e4f4b6dc5, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '52ff56a0-a273-4d7b-a28f-26f4a7f3d30e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'b177be74-2a80-4331-9382-830a8dba4bac'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:47:41.961075 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cf9768ec-3910-4649-8a42-c9cbe8ad904e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:42.090605 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8d4f8c93-5b7e-4a2c-b92e-f25aa723e7c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:42.092948 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-cf9768ec-3910-4649-8a42-c9cbe8ad904e None None] For port 5262d190-941b-4b4e-aa6b-735e4f4b6dc5, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:47:42.097658 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-cf9768ec-3910-4649-8a42-c9cbe8ad904e None None] For port 5262d190-941b-4b4e-aa6b-735e4f4b6dc5, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5262d190-941b-4b4e-aa6b-735e4f4b6dc5,segment=NetworkSegment(52ff56a0-a273-4d7b-a28f-26f4a7f3d30e),segment_id=52ff56a0-a273-4d7b-a28f-26f4a7f3d30e)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:47:42.107657 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cf9768ec-3910-4649-8a42-c9cbe8ad904e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:42.190129 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8d4f8c93-5b7e-4a2c-b92e-f25aa723e7c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:42.252911 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf9768ec-3910-4649-8a42-c9cbe8ad904e None None] Pushing event updated for resources: {'Port': ['ID=5262d190-941b-4b4e-aa6b-735e4f4b6dc5,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:42.289910 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8d4f8c93-5b7e-4a2c-b92e-f25aa723e7c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network b177be74-2a80-4331-9382-830a8dba4bac is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:47:42.297715 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-8d4f8c93-5b7e-4a2c-b92e-f25aa723e7c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:42.307792 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d4f8c93-5b7e-4a2c-b92e-f25aa723e7c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:47:42.564111 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d4f8c93-5b7e-4a2c-b92e-f25aa723e7c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Port': ['ID=498d3e9d-a098-4d2d-9175-fcdcded1960b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:42.668533 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b4d4aaa6-4493-40b6-8b9c-8008795509f1 req-5028a483-a254-4533-8902-3a2138a5a2b1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 210 time: 0.2550795 Dec 09 21:47:42.706141 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8d4f8c93-5b7e-4a2c-b92e-f25aa723e7c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:42.711670 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8d4f8c93-5b7e-4a2c-b92e-f25aa723e7c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:42.834137 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8d4f8c93-5b7e-4a2c-b92e-f25aa723e7c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 921 time: 2.3945429 Dec 09 21:47:42.834855 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45372) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:42.977946 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-452c94cb-598b-4836-83fe-2f372749e58f tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:42.980792 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-452c94cb-598b-4836-83fe-2f372749e58f tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.31 "GET /v2.0/networks?id=92500df7-83c8-4757-9b24-3ee4dfba2da3 HTTP/1.1" status: 200 len: 796 time: 0.5194993 Dec 09 21:47:42.994582 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5262d190-941b-4b4e-aa6b-735e4f4b6dc5 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:47:43.117177 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-9c2446fc-f632-4d46-93c9-104d7ff6221f tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=dce7594ac2a74901912a2f19de04bf79 HTTP/1.1" status: 200 len: 379 time: 0.1268167 Dec 09 21:47:43.132276 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-0cae2a51-b591-4125-a79c-2f978317479c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'port': {'device_id': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3', 'admin_state_up': True, 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'security_groups': ['7e73dc80-43d2-4833-9cd1-5d1a5f84f967']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:43.144312 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 5262d190-941b-4b4e-aa6b-735e4f4b6dc5 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:43.144752 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:43.312946 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:43.403215 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 5262d190-941b-4b4e-aa6b-735e4f4b6dc5, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5262d190-941b-4b4e-aa6b-735e4f4b6dc5,segment=NetworkSegment(52ff56a0-a273-4d7b-a28f-26f4a7f3d30e),segment_id=52ff56a0-a273-4d7b-a28f-26f4a7f3d30e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:43.405694 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-0cae2a51-b591-4125-a79c-2f978317479c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Made reservation on behalf of dce7594ac2a74901912a2f19de04bf79 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:47:43.412211 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-0cae2a51-b591-4125-a79c-2f978317479c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:43.413818 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:43.414918 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d478d292-7b6e-4f28-b6f2-bbf3ba7d2069 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:47:43.462776 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1de86f2d-aa68-4dec-afbc-566eead99339 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:43.592353 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=5262d190-941b-4b4e-aa6b-735e4f4b6dc5,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:43.640142 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port d478d292-7b6e-4f28-b6f2-bbf3ba7d2069 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:43.641117 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:43.709059 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-0cae2a51-b591-4125-a79c-2f978317479c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Allocated IP 172.20.0.5 (92500df7-83c8-4757-9b24-3ee4dfba2da3/13dde2f9-0dfd-4600-912c-44b7903e3595/165bd568-9d49-4f11-b8e1-eb1d0dc675b3) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:47:43.984384 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d281f1db-9a06-4ece-84ad-5a90622f68a4 req-de3207f6-5de6-4972-9a89-3e211f19fc16 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 210 time: 0.1337264 Dec 09 21:47:44.029392 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-0cae2a51-b591-4125-a79c-2f978317479c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:44.095692 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-0cae2a51-b591-4125-a79c-2f978317479c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:44.155080 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da952d6c-2174-4f5d-aad0-864df2c2040d None None] Network b177be74-2a80-4331-9382-830a8dba4bac requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:47:44.157255 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1de86f2d-aa68-4dec-afbc-566eead99339 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:44.168199 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-0cae2a51-b591-4125-a79c-2f978317479c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network 92500df7-83c8-4757-9b24-3ee4dfba2da3 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:47:44.168863 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1de86f2d-aa68-4dec-afbc-566eead99339 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:44.171919 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-0cae2a51-b591-4125-a79c-2f978317479c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:44.177200 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-0cae2a51-b591-4125-a79c-2f978317479c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:47:44.230642 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cae2a51-b591-4125-a79c-2f978317479c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Port': ['ID=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:44.282954 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-0cae2a51-b591-4125-a79c-2f978317479c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:44.283720 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-0cae2a51-b591-4125-a79c-2f978317479c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:44.318240 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-0cae2a51-b591-4125-a79c-2f978317479c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1925306 Dec 09 21:47:44.333462 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-9f76b5de-053a-49fc-a9c5-a2cd42e89fa8 service neutron] Request body: {'port': {'device_id': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:44.360267 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-bc3018dd-3431-4054-9b02-635bb660e249 None None] Provisioning complete for port 5262d190-941b-4b4e-aa6b-735e4f4b6dc5 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:44.360832 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bc3018dd-3431-4054-9b02-635bb660e249 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:44.404806 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1de86f2d-aa68-4dec-afbc-566eead99339 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Port': ['ID=498d3e9d-a098-4d2d-9175-fcdcded1960b,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:44.465933 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-9f76b5de-053a-49fc-a9c5-a2cd42e89fa8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:44.612369 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device fb9f4126-c8f9-4d33-b0f7-3a9218c6e391 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:47:44.661921 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: fb9f4126-c8f9-4d33-b0f7-3a9218c6e391 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:47:44.662287 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device fb9f4126-c8f9-4d33-b0f7-3a9218c6e391 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:47:44.742388 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-fa240646-e186-46a2-b530-2fcfa09ee611 None None] Provisioning complete for port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:44.743424 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fa240646-e186-46a2-b530-2fcfa09ee611 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:44.842707 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5262d190-941b-4b4e-aa6b-735e4f4b6dc5 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:47:44.915922 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1de86f2d-aa68-4dec-afbc-566eead99339 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:45.018532 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-fa240646-e186-46a2-b530-2fcfa09ee611 None None] Port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:47:45.104871 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 5262d190-941b-4b4e-aa6b-735e4f4b6dc5 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:45.105245 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:45.163895 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-04292348-a3e8-4789-828d-6996e7870ee9 None None] Provisioning complete for port 5262d190-941b-4b4e-aa6b-735e4f4b6dc5 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:45.164291 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-04292348-a3e8-4789-828d-6996e7870ee9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:45.243396 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5c36eb7-f29a-4107-960e-baf2ac7f2454 req-5b30f12e-6047-4241-81fb-e1c5e9f40ae3 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:45.253455 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b5c36eb7-f29a-4107-960e-baf2ac7f2454 req-5b30f12e-6047-4241-81fb-e1c5e9f40ae3 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 931 time: 0.1196334 Dec 09 21:47:45.321805 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-9f76b5de-053a-49fc-a9c5-a2cd42e89fa8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:47:45.323660 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1de86f2d-aa68-4dec-afbc-566eead99339 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:45.341142 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-9f76b5de-053a-49fc-a9c5-a2cd42e89fa8 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:45.387032 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-9f76b5de-053a-49fc-a9c5-a2cd42e89fa8 service neutron] Transition to ACTIVE for port object 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:47:45.392065 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b5c36eb7-f29a-4107-960e-baf2ac7f2454 req-df972fd5-d011-493e-836d-c7d8c2597625 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1340454 Dec 09 21:47:45.395192 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-9f76b5de-053a-49fc-a9c5-a2cd42e89fa8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:45.400919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-04292348-a3e8-4789-828d-6996e7870ee9 None None] Provisioning complete for port 498d3e9d-a098-4d2d-9175-fcdcded1960b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:45.401425 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-04292348-a3e8-4789-828d-6996e7870ee9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:45.486252 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f76b5de-053a-49fc-a9c5-a2cd42e89fa8 service neutron] Pushing event updated for resources: {'Port': ['ID=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:45.498626 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-04292348-a3e8-4789-828d-6996e7870ee9 None None] Port 498d3e9d-a098-4d2d-9175-fcdcded1960b cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:47:45.653199 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-9f76b5de-053a-49fc-a9c5-a2cd42e89fa8 service neutron] Attempting to bind port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:47:45.654462 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-9f76b5de-053a-49fc-a9c5-a2cd42e89fa8 service neutron] Attempting to bind port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '0189efa9-02eb-4071-ae6f-aee6c867d035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:47:45.655217 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-9f76b5de-053a-49fc-a9c5-a2cd42e89fa8 service neutron] Attempting to bind port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 on network 92500df7-83c8-4757-9b24-3ee4dfba2da3 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:47:45.658416 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-cd789c20-e845-4d18-98e6-0080c10cb9bd None None] Provisioning complete for port 498d3e9d-a098-4d2d-9175-fcdcded1960b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:45.658796 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cd789c20-e845-4d18-98e6-0080c10cb9bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:45.668165 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-9f76b5de-053a-49fc-a9c5-a2cd42e89fa8 service neutron] Port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 on network 92500df7-83c8-4757-9b24-3ee4dfba2da3 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:47:45.670823 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-9f76b5de-053a-49fc-a9c5-a2cd42e89fa8 service neutron] Attempting to bind port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 on network 92500df7-83c8-4757-9b24-3ee4dfba2da3 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:47:45.682170 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-9f76b5de-053a-49fc-a9c5-a2cd42e89fa8 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 47, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:47:45.683931 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-9f76b5de-053a-49fc-a9c5-a2cd42e89fa8 service neutron] Checking segment: {'id': '0189efa9-02eb-4071-ae6f-aee6c867d035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:47:45.685800 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-9f76b5de-053a-49fc-a9c5-a2cd42e89fa8 service neutron] Bound using segment: {'id': '0189efa9-02eb-4071-ae6f-aee6c867d035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:47:45.686440 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-9f76b5de-053a-49fc-a9c5-a2cd42e89fa8 service neutron] Bound port: 165bd568-9d49-4f11-b8e1-eb1d0dc675b3, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0189efa9-02eb-4071-ae6f-aee6c867d035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:47:45.686978 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-9f76b5de-053a-49fc-a9c5-a2cd42e89fa8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:45.750065 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-cd789c20-e845-4d18-98e6-0080c10cb9bd None None] Port 498d3e9d-a098-4d2d-9175-fcdcded1960b cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:47:45.867413 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1de86f2d-aa68-4dec-afbc-566eead99339 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:45.876154 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e492e862-7a8e-46ca-b5bb-638650e429e1 None None] Provisioning complete for port 498d3e9d-a098-4d2d-9175-fcdcded1960b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:45.876638 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e492e862-7a8e-46ca-b5bb-638650e429e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:45.878269 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-9f76b5de-053a-49fc-a9c5-a2cd42e89fa8 service neutron] For port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:47:45.881539 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-9f76b5de-053a-49fc-a9c5-a2cd42e89fa8 service neutron] For port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,segment=NetworkSegment(0189efa9-02eb-4071-ae6f-aee6c867d035),segment_id=0189efa9-02eb-4071-ae6f-aee6c867d035)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:47:45.882419 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1de86f2d-aa68-4dec-afbc-566eead99339 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:45.888064 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-9f76b5de-053a-49fc-a9c5-a2cd42e89fa8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:45.933292 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e492e862-7a8e-46ca-b5bb-638650e429e1 None None] Port 498d3e9d-a098-4d2d-9175-fcdcded1960b cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:47:45.959563 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-9f76b5de-053a-49fc-a9c5-a2cd42e89fa8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:45.960526 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-9f76b5de-053a-49fc-a9c5-a2cd42e89fa8 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:45.962309 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-9f76b5de-053a-49fc-a9c5-a2cd42e89fa8 service neutron] 10.222.0.31 "PUT /v2.0/ports/165bd568-9d49-4f11-b8e1-eb1d0dc675b3 HTTP/1.1" status: 200 len: 1092 time: 1.6335080 Dec 09 21:47:45.962924 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'tag': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:47:45.965846 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7416fe65-3f0a-4c6c-8f5c-c5afbc56cf2a" -d '{"events": [{"name": "network-changed", "server_uuid": "c9630177-3a8d-4c3a-8c62-dd93288c7232", "tag": "165bd568-9d49-4f11-b8e1-eb1d0dc675b3"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:47:46.001437 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f76b5de-053a-49fc-a9c5-a2cd42e89fa8 service neutron] Pushing event updated for resources: {'Port': ['ID=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:46.062749 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:47:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fc0cc25e-f8af-4643-8984-661a9d2bd172 x-openstack-request-id: req-fc0cc25e-f8af-4643-8984-661a9d2bd172 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:47:46.063149 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c9630177-3a8d-4c3a-8c62-dd93288c7232", "tag": "165bd568-9d49-4f11-b8e1-eb1d0dc675b3", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:47:46.063508 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-fc0cc25e-f8af-4643-8984-661a9d2bd172 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:47:46.065373 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'tag': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3', 'status': 'completed', 'code': 200} Dec 09 21:47:46.073671 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1de86f2d-aa68-4dec-afbc-566eead99339 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Port': ['ID=498d3e9d-a098-4d2d-9175-fcdcded1960b,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:46.080890 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1de86f2d-aa68-4dec-afbc-566eead99339 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:46.111231 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-cd04f3de-a57f-463b-af88-024db30d8e5f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:46.113553 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-cd04f3de-a57f-463b-af88-024db30d8e5f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 1095 time: 0.0973139 Dec 09 21:47:46.218910 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-eff597a1-1b60-44c5-8bdc-9e63162c4f97 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3 HTTP/1.1" status: 200 len: 217 time: 0.0967631 Dec 09 21:47:46.260090 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1de86f2d-aa68-4dec-afbc-566eead99339 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network b177be74-2a80-4331-9382-830a8dba4bac is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:47:46.276149 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-1de86f2d-aa68-4dec-afbc-566eead99339 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:46.325722 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-31e9a17b-0129-4394-96d9-b52467f0583a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:46.328431 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-31e9a17b-0129-4394-96d9-b52467f0583a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=13dde2f9-0dfd-4600-912c-44b7903e3595 HTTP/1.1" status: 200 len: 835 time: 0.1029692 Dec 09 21:47:46.437445 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-cc8c1161-4fab-47ed-9513-c181b420509d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:46.439106 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-cc8c1161-4fab-47ed-9513-c181b420509d service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=92500df7-83c8-4757-9b24-3ee4dfba2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1038909 Dec 09 21:47:46.584524 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1de86f2d-aa68-4dec-afbc-566eead99339 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Router 5d54d1c5-f7c6-4971-8e7f-ccd51e1a9d11 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:47:46.637943 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-545751de-2cf0-423a-8a31-d26c982549d5 service neutron] 10.222.0.31 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1911366 Dec 09 21:47:46.664308 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c399b327-f64b-4e4d-8090-4e351104ca09 req-60189eef-b9ed-4c55-8961-d5f69bf3cb8c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:46.666123 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c399b327-f64b-4e4d-8090-4e351104ca09 req-60189eef-b9ed-4c55-8961-d5f69bf3cb8c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 943 time: 0.1146781 Dec 09 21:47:46.748579 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-35620b02-9854-455b-a15c-633ca90293d3 None None] Provisioning complete for port 498d3e9d-a098-4d2d-9175-fcdcded1960b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:46.749640 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-35620b02-9854-455b-a15c-633ca90293d3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:46.781925 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1de86f2d-aa68-4dec-afbc-566eead99339 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:47:46.791551 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1de86f2d-aa68-4dec-afbc-566eead99339 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/routers/5d54d1c5-f7c6-4971-8e7f-ccd51e1a9d11/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.9554794 Dec 09 21:47:46.793975 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45432) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:46.816252 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c399b327-f64b-4e4d-8090-4e351104ca09 req-f5171910-6718-48b3-bd0a-5ac07836924f tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0933070 Dec 09 21:47:46.838549 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6ab2901-9818-4f8e-b39e-f3a6fccd364f None None] Sync routers for ids ['5d54d1c5-f7c6-4971-8e7f-ccd51e1a9d11'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:47:46.868876 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6ab2901-9818-4f8e-b39e-f3a6fccd364f None None] Routers {'5d54d1c5-f7c6-4971-8e7f-ccd51e1a9d11'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:47:46.869936 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-e6ab2901-9818-4f8e-b39e-f3a6fccd364f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['5d54d1c5-f7c6-4971-8e7f-ccd51e1a9d11'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:46.874176 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-35620b02-9854-455b-a15c-633ca90293d3 None None] Port 498d3e9d-a098-4d2d-9175-fcdcded1960b cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:47:46.902272 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73698b97-262f-4df7-9953-0de36fb3688d tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:46.906980 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-73698b97-262f-4df7-9953-0de36fb3688d tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/ports/498d3e9d-a098-4d2d-9175-fcdcded1960b HTTP/1.1" status: 200 len: 976 time: 0.1119189 Dec 09 21:47:46.910706 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45434) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:46.916342 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-e6ab2901-9818-4f8e-b39e-f3a6fccd364f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:46.934139 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6ab2901-9818-4f8e-b39e-f3a6fccd364f None None] Routers {'5d54d1c5-f7c6-4971-8e7f-ccd51e1a9d11'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:47:46.934769 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-e6ab2901-9818-4f8e-b39e-f3a6fccd364f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['5d54d1c5-f7c6-4971-8e7f-ccd51e1a9d11'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:46.999219 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-e6ab2901-9818-4f8e-b39e-f3a6fccd364f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:47.000224 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e6ab2901-9818-4f8e-b39e-f3a6fccd364f None None] The sync data for ids ['5d54d1c5-f7c6-4971-8e7f-ccd51e1a9d11'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:47:47.308133 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-edb4ca37-e86e-45dd-b60d-35988bab3aae req-752f9cc2-66ad-46b7-a225-4c11ec1a4326 service neutron] 10.222.0.31 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6615109 Dec 09 21:47:47.345801 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e8ac9c55-6b86-4a82-b77b-1db924b25fb0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:47.419138 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7416fe65-3f0a-4c6c-8f5c-c5afbc56cf2a req-8ed599c5-1873-4a76-95f0-d883a7fa0123 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:47.421256 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7416fe65-3f0a-4c6c-8f5c-c5afbc56cf2a req-8ed599c5-1873-4a76-95f0-d883a7fa0123 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 1095 time: 0.0593882 Dec 09 21:47:47.570681 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7416fe65-3f0a-4c6c-8f5c-c5afbc56cf2a req-4200dc4f-b8da-47dc-a7a4-445ecbe15f65 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:47.572218 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7416fe65-3f0a-4c6c-8f5c-c5afbc56cf2a req-4200dc4f-b8da-47dc-a7a4-445ecbe15f65 service neutron] 10.222.0.31 "GET /v2.0/networks?id=92500df7-83c8-4757-9b24-3ee4dfba2da3 HTTP/1.1" status: 200 len: 897 time: 0.1336768 Dec 09 21:47:47.626345 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7416fe65-3f0a-4c6c-8f5c-c5afbc56cf2a req-79ce91ea-53cc-4544-a28c-24f869007423 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3 HTTP/1.1" status: 200 len: 217 time: 0.0458577 Dec 09 21:47:47.696254 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7416fe65-3f0a-4c6c-8f5c-c5afbc56cf2a req-5da7bdeb-2c29-4fb7-875f-25bb930c837b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:47.697870 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7416fe65-3f0a-4c6c-8f5c-c5afbc56cf2a req-5da7bdeb-2c29-4fb7-875f-25bb930c837b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=13dde2f9-0dfd-4600-912c-44b7903e3595 HTTP/1.1" status: 200 len: 835 time: 0.0644736 Dec 09 21:47:47.703805 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-e8ac9c55-6b86-4a82-b77b-1db924b25fb0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting port 498d3e9d-a098-4d2d-9175-fcdcded1960b {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:47:47.704143 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e8ac9c55-6b86-4a82-b77b-1db924b25fb0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:47.754026 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7416fe65-3f0a-4c6c-8f5c-c5afbc56cf2a req-e4a63926-0055-46fd-b15d-77fc7d17b1a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:47.756706 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7416fe65-3f0a-4c6c-8f5c-c5afbc56cf2a req-e4a63926-0055-46fd-b15d-77fc7d17b1a3 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=92500df7-83c8-4757-9b24-3ee4dfba2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0494926 Dec 09 21:47:47.851178 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e8ac9c55-6b86-4a82-b77b-1db924b25fb0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:47.866578 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-e8ac9c55-6b86-4a82-b77b-1db924b25fb0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Calling delete_port for 498d3e9d-a098-4d2d-9175-fcdcded1960b owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:47:47.887497 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7416fe65-3f0a-4c6c-8f5c-c5afbc56cf2a req-83f99088-2584-4fc5-b2f6-1dafe8af1f1d service neutron] 10.222.0.31 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1214566 Dec 09 21:47:48.107005 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7416fe65-3f0a-4c6c-8f5c-c5afbc56cf2a req-fce80127-dfa1-495b-9e9c-5c75d7a28186 service neutron] 10.222.0.31 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2081814 Dec 09 21:47:48.467486 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e8ac9c55-6b86-4a82-b77b-1db924b25fb0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:48.531950 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8ac9c55-6b86-4a82-b77b-1db924b25fb0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Port': ['ID=498d3e9d-a098-4d2d-9175-fcdcded1960b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:48.659124 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e8ac9c55-6b86-4a82-b77b-1db924b25fb0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:48.785467 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb09e9f6-990f-456d-8238-8df2a563344b req-c48b6386-f804-4b4f-b43e-142bdf0a5091 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:48.797692 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb09e9f6-990f-456d-8238-8df2a563344b req-c48b6386-f804-4b4f-b43e-142bdf0a5091 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 943 time: 0.3587115 Dec 09 21:47:48.990416 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb09e9f6-990f-456d-8238-8df2a563344b req-1b204c78-c0fc-4918-9016-05b81abd301b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1918993 Dec 09 21:47:49.007476 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e8ac9c55-6b86-4a82-b77b-1db924b25fb0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Router 5d54d1c5-f7c6-4971-8e7f-ccd51e1a9d11 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:47:49.087879 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e8ac9c55-6b86-4a82-b77b-1db924b25fb0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:47:49.093345 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e8ac9c55-6b86-4a82-b77b-1db924b25fb0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/routers/5d54d1c5-f7c6-4971-8e7f-ccd51e1a9d11/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1812561 Dec 09 21:47:49.096215 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45458) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:49.103348 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3cf32d9e-d45a-4016-8cdb-7be207cc5508 None None] Sync routers for ids ['5d54d1c5-f7c6-4971-8e7f-ccd51e1a9d11'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:47:49.114906 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3cf32d9e-d45a-4016-8cdb-7be207cc5508 None None] Routers {'5d54d1c5-f7c6-4971-8e7f-ccd51e1a9d11'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:47:49.115573 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-3cf32d9e-d45a-4016-8cdb-7be207cc5508 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['5d54d1c5-f7c6-4971-8e7f-ccd51e1a9d11'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:49.147932 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-3cf32d9e-d45a-4016-8cdb-7be207cc5508 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:49.193182 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3cf32d9e-d45a-4016-8cdb-7be207cc5508 None None] Routers {'5d54d1c5-f7c6-4971-8e7f-ccd51e1a9d11'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:47:49.211486 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-3cf32d9e-d45a-4016-8cdb-7be207cc5508 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['5d54d1c5-f7c6-4971-8e7f-ccd51e1a9d11'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:49.255853 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-3cf32d9e-d45a-4016-8cdb-7be207cc5508 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:49.256726 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3cf32d9e-d45a-4016-8cdb-7be207cc5508 None None] The sync data for ids ['5d54d1c5-f7c6-4971-8e7f-ccd51e1a9d11'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:47:49.379474 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-1e638097-c635-439c-aa18-fefcccd28875 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] remove_router_interface failed (client error): The resource could not be found. Dec 09 21:47:49.385597 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1e638097-c635-439c-aa18-fefcccd28875 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/routers/5d54d1c5-f7c6-4971-8e7f-ccd51e1a9d11/remove_router_interface HTTP/1.1" status: 404 len: 398 time: 0.2860892 Dec 09 21:47:49.385597 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45460) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:49.415260 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e688c0e2-83cf-4184-aeed-61cc5778f0db tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/ports?device_id=5d54d1c5-f7c6-4971-8e7f-ccd51e1a9d11 HTTP/1.1" status: 200 len: 205 time: 0.0285003 Dec 09 21:47:49.417780 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45462) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:49.502592 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b8a3f88a-4e25-4eff-b2b9-1a4b4ad0ad91 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:49.678688 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b8a3f88a-4e25-4eff-b2b9-1a4b4ad0ad91 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:49.680979 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b8a3f88a-4e25-4eff-b2b9-1a4b4ad0ad91 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:49.728312 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b8a3f88a-4e25-4eff-b2b9-1a4b4ad0ad91 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:49.728998 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b8a3f88a-4e25-4eff-b2b9-1a4b4ad0ad91 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Fanout notify agent at l3_agent the message router_deleted on router 5d54d1c5-f7c6-4971-8e7f-ccd51e1a9d11 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:47:49.738188 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b8a3f88a-4e25-4eff-b2b9-1a4b4ad0ad91 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:49.739956 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b8a3f88a-4e25-4eff-b2b9-1a4b4ad0ad91 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/routers/5d54d1c5-f7c6-4971-8e7f-ccd51e1a9d11 HTTP/1.1" status: 204 len: 168 time: 0.3210287 Dec 09 21:47:49.742553 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45474) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:49.810230 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-875fbb24-6411-46d1-af0d-b9f60b47a9d9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting subnet 8f2a71ca-4303-4584-a6d9-06cfdaf294d4 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:47:49.813858 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-875fbb24-6411-46d1-af0d-b9f60b47a9d9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:49.876628 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-875fbb24-6411-46d1-af0d-b9f60b47a9d9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:50.064056 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-875fbb24-6411-46d1-af0d-b9f60b47a9d9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:50.152082 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b486fb7-41ff-4abf-ae5f-b7b60a10899f req-912f9db4-b20d-409a-a13f-c008e7d3fd4c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:50.159907 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b486fb7-41ff-4abf-ae5f-b7b60a10899f req-912f9db4-b20d-409a-a13f-c008e7d3fd4c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 943 time: 0.0903988 Dec 09 21:47:50.226299 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b486fb7-41ff-4abf-ae5f-b7b60a10899f req-671d0db7-e4ef-41f1-b25f-3913ae9c32a4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0651000 Dec 09 21:47:50.244498 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-875fbb24-6411-46d1-af0d-b9f60b47a9d9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:50.309915 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-875fbb24-6411-46d1-af0d-b9f60b47a9d9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Subnet': ['ID=8f2a71ca-4303-4584-a6d9-06cfdaf294d4,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:50.326783 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-875fbb24-6411-46d1-af0d-b9f60b47a9d9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:50.333968 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5be30928-3635-4a2b-8537-3f21d6f87b59 None None] Network b177be74-2a80-4331-9382-830a8dba4bac requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:47:50.345929 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-875fbb24-6411-46d1-af0d-b9f60b47a9d9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/subnets/8f2a71ca-4303-4584-a6d9-06cfdaf294d4 HTTP/1.1" status: 204 len: 168 time: 0.6019244 Dec 09 21:47:50.348261 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45488) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:50.477416 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fbd25b39-b02d-4374-82af-9e258dcb22f4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:50.558533 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-796e9f21-1d90-4044-89bd-e17e2a595855 None None] DHCP port deletion for b177be74-2a80-4331-9382-830a8dba4bac request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:47:50.581540 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-fbd25b39-b02d-4374-82af-9e258dcb22f4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting port 5262d190-941b-4b4e-aa6b-735e4f4b6dc5 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:47:50.582243 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fbd25b39-b02d-4374-82af-9e258dcb22f4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:50.633176 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:47:50.712201 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-fbd25b39-b02d-4374-82af-9e258dcb22f4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] For port 5262d190-941b-4b4e-aa6b-735e4f4b6dc5, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5262d190-941b-4b4e-aa6b-735e4f4b6dc5,segment=NetworkSegment(52ff56a0-a273-4d7b-a28f-26f4a7f3d30e),segment_id=52ff56a0-a273-4d7b-a28f-26f4a7f3d30e)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:50.712861 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fbd25b39-b02d-4374-82af-9e258dcb22f4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:50.750262 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-fbd25b39-b02d-4374-82af-9e258dcb22f4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Calling delete_port for 5262d190-941b-4b4e-aa6b-735e4f4b6dc5 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:47:50.860614 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,segment=NetworkSegment(0189efa9-02eb-4071-ae6f-aee6c867d035),segment_id=0189efa9-02eb-4071-ae6f-aee6c867d035)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:50.873774 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fbd25b39-b02d-4374-82af-9e258dcb22f4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:50.891730 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3', 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3', 'port_id': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3', 'mac_address': 'fa:16:3e:9d:7e:d5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 107, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '13dde2f9-0dfd-4600-912c-44b7903e3595', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:47:50.898101 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5262d190-941b-4b4e-aa6b-735e4f4b6dc5 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:47:50.928727 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbd25b39-b02d-4374-82af-9e258dcb22f4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Port': ['ID=5262d190-941b-4b4e-aa6b-735e4f4b6dc5,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:50.949470 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fbd25b39-b02d-4374-82af-9e258dcb22f4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] No DVR routers for this DVR port 5262d190-941b-4b4e-aa6b-735e4f4b6dc5 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:47:50.957048 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 5262d190-941b-4b4e-aa6b-735e4f4b6dc5 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:47:50.957394 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5262d190-941b-4b4e-aa6b-735e4f4b6dc5 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:47:50.962835 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-796e9f21-1d90-4044-89bd-e17e2a595855 None None] Deleting port 5262d190-941b-4b4e-aa6b-735e4f4b6dc5 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:47:50.963238 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-796e9f21-1d90-4044-89bd-e17e2a595855 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:50.998707 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:51.040253 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:47:51.077726 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-796e9f21-1d90-4044-89bd-e17e2a595855 None None] For port 5262d190-941b-4b4e-aa6b-735e4f4b6dc5, host n-d-713301-27, got binding levels [] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:51.078378 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-796e9f21-1d90-4044-89bd-e17e2a595855 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:51.100793 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,segment=NetworkSegment(0189efa9-02eb-4071-ae6f-aee6c867d035),segment_id=0189efa9-02eb-4071-ae6f-aee6c867d035)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:51.102325 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-796e9f21-1d90-4044-89bd-e17e2a595855 None None] Calling delete_port for 5262d190-941b-4b4e-aa6b-735e4f4b6dc5 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:47:51.105826 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.ipam_backend_mixin [None req-796e9f21-1d90-4044-89bd-e17e2a595855 None None] Port 5262d190-941b-4b4e-aa6b-735e4f4b6dc5 was not found and therefore no delete operation was performed {{(pid=103439) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 09 21:47:51.107553 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-796e9f21-1d90-4044-89bd-e17e2a595855 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:51.116508 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:51.138989 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-796e9f21-1d90-4044-89bd-e17e2a595855 None None] Pushing event deleted for resources: {'Port': ['ID=5262d190-941b-4b4e-aa6b-735e4f4b6dc5,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:51.163769 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-796e9f21-1d90-4044-89bd-e17e2a595855 None None] No DVR routers for this DVR port 5262d190-941b-4b4e-aa6b-735e4f4b6dc5 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:47:51.168972 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fbd25b39-b02d-4374-82af-9e258dcb22f4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:51.205183 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-fbd25b39-b02d-4374-82af-9e258dcb22f4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b177be74-2a80-4331-9382-830a8dba4bac']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:51.217407 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-fbd25b39-b02d-4374-82af-9e258dcb22f4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '52ff56a0-a273-4d7b-a28f-26f4a7f3d30e') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:51.217707 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-fbd25b39-b02d-4374-82af-9e258dcb22f4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '52ff56a0-a273-4d7b-a28f-26f4a7f3d30e') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:51.221720 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:51.230869 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fbd25b39-b02d-4374-82af-9e258dcb22f4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:51.254166 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fbd25b39-b02d-4374-82af-9e258dcb22f4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:51.263658 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fbd25b39-b02d-4374-82af-9e258dcb22f4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Releasing vlan 139 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:47:51.264133 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fbd25b39-b02d-4374-82af-9e258dcb22f4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:51.343360 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['165bd568-9d49-4f11-b8e1-eb1d0dc675b3'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:47:51.415824 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:47:51.439529 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fbd25b39-b02d-4374-82af-9e258dcb22f4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:51.505322 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fbd25b39-b02d-4374-82af-9e258dcb22f4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:51.517389 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45506) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:51.519117 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fbd25b39-b02d-4374-82af-9e258dcb22f4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/networks/b177be74-2a80-4331-9382-830a8dba4bac HTTP/1.1" status: 204 len: 168 time: 1.1641128 Dec 09 21:47:51.523785 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-c8b0c43c-73d1-4929-94b8-510361575aaf tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'network': {'name': 'tempest-RoutersTest-351110555'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:51.571251 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbd25b39-b02d-4374-82af-9e258dcb22f4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Network': ['ID=b177be74-2a80-4331-9382-830a8dba4bac,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:51.577157 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c8b0c43c-73d1-4929-94b8-510361575aaf tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Made reservation on behalf of 99ff5f79d7574ab091d0707b5e01465a for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:47:51.586867 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8b0c43c-73d1-4929-94b8-510361575aaf tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:51.611063 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21728fb2-b152-4e0d-aefc-b02040aa0fe9 req-5db7b75d-c191-4575-884a-2a788a41df53 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:51.618846 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-21728fb2-b152-4e0d-aefc-b02040aa0fe9 req-5db7b75d-c191-4575-884a-2a788a41df53 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 944 time: 0.2019451 Dec 09 21:47:51.649231 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c8b0c43c-73d1-4929-94b8-510361575aaf tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] vlan segment allocate from pool success with {'vlan_id': 123, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:47:51.662381 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8b0c43c-73d1-4929-94b8-510361575aaf tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:51.663562 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-c8b0c43c-73d1-4929-94b8-510361575aaf tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Added segment b8f75b56-669c-47cd-8c0b-e7c5994fa19a of type vlan for network f1924004-31ef-434c-9741-a8c26b4419a1 Dec 09 21:47:51.715968 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-21728fb2-b152-4e0d-aefc-b02040aa0fe9 req-697fa9dc-e2ef-499a-8bdb-90f4afefb29d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0958588 Dec 09 21:47:51.743329 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8b0c43c-73d1-4929-94b8-510361575aaf tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:51.801136 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8b0c43c-73d1-4929-94b8-510361575aaf tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:51.812061 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8b0c43c-73d1-4929-94b8-510361575aaf tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:51.820160 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8b0c43c-73d1-4929-94b8-510361575aaf tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:51.921358 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c8b0c43c-73d1-4929-94b8-510361575aaf tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 0.4020076 Dec 09 21:47:51.924352 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45514) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:51.930947 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-d6e5a349-9b4a-4323-95b2-66997cac9350 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'subnet': {'network_id': 'f1924004-31ef-434c-9741-a8c26b4419a1', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:51.983946 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8b0c43c-73d1-4929-94b8-510361575aaf tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Network': ['ID=f1924004-31ef-434c-9741-a8c26b4419a1,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:51.996206 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network f1924004-31ef-434c-9741-a8c26b4419a1 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:47:52.089788 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d6e5a349-9b4a-4323-95b2-66997cac9350 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Made reservation on behalf of 99ff5f79d7574ab091d0707b5e01465a for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:47:52.094051 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6e5a349-9b4a-4323-95b2-66997cac9350 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:52.295375 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6e5a349-9b4a-4323-95b2-66997cac9350 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:52.357912 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6e5a349-9b4a-4323-95b2-66997cac9350 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Subnet': ['ID=78564a9f-be31-44e5-88cf-6b24abdc75c9,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:52.365403 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d6e5a349-9b4a-4323-95b2-66997cac9350 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Checking segment: {'id': 'b8f75b56-669c-47cd-8c0b-e7c5994fa19a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'f1924004-31ef-434c-9741-a8c26b4419a1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:47:52.365786 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d6e5a349-9b4a-4323-95b2-66997cac9350 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network hostable DHCP agents. Network: f1924004-31ef-434c-9741-a8c26b4419a1, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:47:52.385371 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d6e5a349-9b4a-4323-95b2-66997cac9350 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network f1924004-31ef-434c-9741-a8c26b4419a1 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:47:52.397356 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-d6e5a349-9b4a-4323-95b2-66997cac9350 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, f1924004-31ef-434c-9741-a8c26b4419a1) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:52.402655 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d6e5a349-9b4a-4323-95b2-66997cac9350 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:52.403330 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6e5a349-9b4a-4323-95b2-66997cac9350 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:52.410997 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46bc62d7-7350-418f-ab04-1e5690f75ae9 None None] Network f1924004-31ef-434c-9741-a8c26b4419a1 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:47:52.429917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45518) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:52.434747 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-9b7eb7f6-beb1-4f20-8a88-3822f6a3b5f8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-844982506', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:52.442591 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d6e5a349-9b4a-4323-95b2-66997cac9350 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.5057740 Dec 09 21:47:52.477315 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9b7eb7f6-beb1-4f20-8a88-3822f6a3b5f8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:52.478687 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9b7eb7f6-beb1-4f20-8a88-3822f6a3b5f8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:52.567478 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9b7eb7f6-beb1-4f20-8a88-3822f6a3b5f8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:52.576748 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5352e009-eb83-4bc0-9420-003349fbea9f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-f1924004-31ef-434c-9741-a8c26b4419a1', 'network_id': 'f1924004-31ef-434c-9741-a8c26b4419a1', 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'fixed_ips': [{'subnet_id': '78564a9f-be31-44e5-88cf-6b24abdc75c9'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:47:52.577686 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5352e009-eb83-4bc0-9420-003349fbea9f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:52.581940 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9b7eb7f6-beb1-4f20-8a88-3822f6a3b5f8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:52.628864 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9b7eb7f6-beb1-4f20-8a88-3822f6a3b5f8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:52.633398 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45524) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:52.642089 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9b7eb7f6-beb1-4f20-8a88-3822f6a3b5f8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.2108500 Dec 09 21:47:52.651389 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:47:52.866512 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:47:52.922427 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:52.922836 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:53.016553 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-5352e009-eb83-4bc0-9420-003349fbea9f None None] Allocated IP 172.20.0.2 (f1924004-31ef-434c-9741-a8c26b4419a1/78564a9f-be31-44e5-88cf-6b24abdc75c9/f11f1db4-60fc-4d9a-8fb8-96138fc86fe6) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:47:53.047820 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68a60791-0a59-4436-a92e-927c63b4bde0 req-53bc7ff6-46a5-4b5c-987e-dee4735f14d7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:53.056343 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-68a60791-0a59-4436-a92e-927c63b4bde0 req-53bc7ff6-46a5-4b5c-987e-dee4735f14d7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 944 time: 0.1842678 Dec 09 21:47:53.163883 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-68a60791-0a59-4436-a92e-927c63b4bde0 req-be32cab8-9534-4ebd-b397-08c576480133 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1063201 Dec 09 21:47:53.203770 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84acae12-304e-41dc-a1a9-218df5cd8376 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:53.489902 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:53.531495 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:47:53.533816 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-16252f33-99df-41fc-adcf-994f2f74e278" -d '{"events": [{"server_uuid": "c9630177-3a8d-4c3a-8c62-dd93288c7232", "name": "network-vif-plugged", "status": "completed", "tag": "165bd568-9d49-4f11-b8e1-eb1d0dc675b3"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:47:53.575398 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,segment=NetworkSegment(0189efa9-02eb-4071-ae6f-aee6c867d035),segment_id=0189efa9-02eb-4071-ae6f-aee6c867d035)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:53.583581 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:53.616138 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:47:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-19903502-7154-4532-b164-a75f24f4dc32 x-openstack-request-id: req-19903502-7154-4532-b164-a75f24f4dc32 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:47:53.616504 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c9630177-3a8d-4c3a-8c62-dd93288c7232", "name": "network-vif-plugged", "status": "completed", "tag": "165bd568-9d49-4f11-b8e1-eb1d0dc675b3", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:47:53.616865 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-19903502-7154-4532-b164-a75f24f4dc32 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:47:53.617370 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3', 'code': 200} Dec 09 21:47:53.649576 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5352e009-eb83-4bc0-9420-003349fbea9f None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:53.669751 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5352e009-eb83-4bc0-9420-003349fbea9f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:53.677692 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:53.714859 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5352e009-eb83-4bc0-9420-003349fbea9f None None] Network f1924004-31ef-434c-9741-a8c26b4419a1 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:47:53.718147 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-5352e009-eb83-4bc0-9420-003349fbea9f None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:53.721966 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5352e009-eb83-4bc0-9420-003349fbea9f None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:47:53.737226 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5352e009-eb83-4bc0-9420-003349fbea9f None None] Pushing event updated for resources: {'Port': ['ID=f11f1db4-60fc-4d9a-8fb8-96138fc86fe6,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:53.743323 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-84acae12-304e-41dc-a1a9-218df5cd8376 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Allocated IP 172.20.0.1 (f1924004-31ef-434c-9741-a8c26b4419a1/78564a9f-be31-44e5-88cf-6b24abdc75c9/7752b027-40f1-4899-abc3-a3d6f8f3df31) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:47:53.787722 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47b55e90-8072-41e5-9b23-1d9947c1bbd5 req-179dd827-7071-4e87-9ac2-dd5d6202b58a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:53.792186 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-47b55e90-8072-41e5-9b23-1d9947c1bbd5 req-179dd827-7071-4e87-9ac2-dd5d6202b58a service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 1097 time: 0.1329725 Dec 09 21:47:53.838051 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-5352e009-eb83-4bc0-9420-003349fbea9f None None] Attempting to bind port f11f1db4-60fc-4d9a-8fb8-96138fc86fe6 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:47:53.838428 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-5352e009-eb83-4bc0-9420-003349fbea9f None None] Attempting to bind port f11f1db4-60fc-4d9a-8fb8-96138fc86fe6 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'b8f75b56-669c-47cd-8c0b-e7c5994fa19a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'f1924004-31ef-434c-9741-a8c26b4419a1'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:47:53.838795 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5352e009-eb83-4bc0-9420-003349fbea9f None None] Attempting to bind port f11f1db4-60fc-4d9a-8fb8-96138fc86fe6 on network f1924004-31ef-434c-9741-a8c26b4419a1 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:47:53.854198 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5352e009-eb83-4bc0-9420-003349fbea9f None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 47, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:47:53.854687 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5352e009-eb83-4bc0-9420-003349fbea9f None None] Checking segment: {'id': 'b8f75b56-669c-47cd-8c0b-e7c5994fa19a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'f1924004-31ef-434c-9741-a8c26b4419a1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:47:53.855015 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5352e009-eb83-4bc0-9420-003349fbea9f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:53.855413 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5352e009-eb83-4bc0-9420-003349fbea9f None None] Bound using segment: {'id': 'b8f75b56-669c-47cd-8c0b-e7c5994fa19a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'f1924004-31ef-434c-9741-a8c26b4419a1'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:47:53.855931 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-5352e009-eb83-4bc0-9420-003349fbea9f None None] Bound port: f11f1db4-60fc-4d9a-8fb8-96138fc86fe6, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b8f75b56-669c-47cd-8c0b-e7c5994fa19a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'f1924004-31ef-434c-9741-a8c26b4419a1'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:47:53.856324 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5352e009-eb83-4bc0-9420-003349fbea9f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:53.914205 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-47b55e90-8072-41e5-9b23-1d9947c1bbd5 req-e05ab9a9-5037-481e-aa94-af1b16387dba service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1128542 Dec 09 21:47:53.969250 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84acae12-304e-41dc-a1a9-218df5cd8376 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:53.976704 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-5352e009-eb83-4bc0-9420-003349fbea9f None None] For port f11f1db4-60fc-4d9a-8fb8-96138fc86fe6, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:47:53.981331 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-5352e009-eb83-4bc0-9420-003349fbea9f None None] For port f11f1db4-60fc-4d9a-8fb8-96138fc86fe6, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f11f1db4-60fc-4d9a-8fb8-96138fc86fe6,segment=NetworkSegment(b8f75b56-669c-47cd-8c0b-e7c5994fa19a),segment_id=b8f75b56-669c-47cd-8c0b-e7c5994fa19a)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:47:53.988168 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5352e009-eb83-4bc0-9420-003349fbea9f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:54.035917 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84acae12-304e-41dc-a1a9-218df5cd8376 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:54.096558 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84acae12-304e-41dc-a1a9-218df5cd8376 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network f1924004-31ef-434c-9741-a8c26b4419a1 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:47:54.106105 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5352e009-eb83-4bc0-9420-003349fbea9f None None] Pushing event updated for resources: {'Port': ['ID=f11f1db4-60fc-4d9a-8fb8-96138fc86fe6,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:54.127899 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84acae12-304e-41dc-a1a9-218df5cd8376 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Port': ['ID=7752b027-40f1-4899-abc3-a3d6f8f3df31,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:54.131617 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-84acae12-304e-41dc-a1a9-218df5cd8376 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:54.134549 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84acae12-304e-41dc-a1a9-218df5cd8376 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:47:54.209850 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84acae12-304e-41dc-a1a9-218df5cd8376 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:54.416749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb168e5e-89d6-4ce1-979f-0d6fa958afe3 req-84e86178-2a48-4b37-8742-61b2696e4908 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:54.419477 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eb168e5e-89d6-4ce1-979f-0d6fa958afe3 req-84e86178-2a48-4b37-8742-61b2696e4908 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 945 time: 0.1483471 Dec 09 21:47:54.533974 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eb168e5e-89d6-4ce1-979f-0d6fa958afe3 req-d7a922df-5e61-40ac-b3ab-2969276f4e43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1071901 Dec 09 21:47:54.553641 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84acae12-304e-41dc-a1a9-218df5cd8376 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:54.808959 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f11f1db4-60fc-4d9a-8fb8-96138fc86fe6 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:47:54.917280 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f11f1db4-60fc-4d9a-8fb8-96138fc86fe6 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:54.917660 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:55.026747 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84acae12-304e-41dc-a1a9-218df5cd8376 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:55.033994 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84acae12-304e-41dc-a1a9-218df5cd8376 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:55.212148 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84acae12-304e-41dc-a1a9-218df5cd8376 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:55.215137 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84acae12-304e-41dc-a1a9-218df5cd8376 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Port': ['ID=7752b027-40f1-4899-abc3-a3d6f8f3df31,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:55.305949 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:55.366468 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port f11f1db4-60fc-4d9a-8fb8-96138fc86fe6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f11f1db4-60fc-4d9a-8fb8-96138fc86fe6,segment=NetworkSegment(b8f75b56-669c-47cd-8c0b-e7c5994fa19a),segment_id=b8f75b56-669c-47cd-8c0b-e7c5994fa19a)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:47:55.377548 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:55.447800 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84acae12-304e-41dc-a1a9-218df5cd8376 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network f1924004-31ef-434c-9741-a8c26b4419a1 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:47:55.449694 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-84acae12-304e-41dc-a1a9-218df5cd8376 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:55.524529 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=f11f1db4-60fc-4d9a-8fb8-96138fc86fe6,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:55.595395 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-84acae12-304e-41dc-a1a9-218df5cd8376 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Router 2b0d6cbd-63cc-4c01-b04b-85ffaca65add is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:47:55.764850 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f7236a4f-011a-461a-a38a-b392cdb784e2 None None] Network f1924004-31ef-434c-9741-a8c26b4419a1 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:47:55.765493 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-84acae12-304e-41dc-a1a9-218df5cd8376 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:47:55.775124 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-84acae12-304e-41dc-a1a9-218df5cd8376 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/routers/2b0d6cbd-63cc-4c01-b04b-85ffaca65add/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1381431 Dec 09 21:47:55.775976 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45562) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:55.784595 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02b31291-8363-4eb8-ad80-032d5a00f2a6 None None] Sync routers for ids ['2b0d6cbd-63cc-4c01-b04b-85ffaca65add'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:47:55.802743 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fd23dbf-6873-438d-8421-214d745a8eaf req-c88c64b7-ef33-4454-b0d5-8a8bf0c4ee5f tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:55.804420 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fd23dbf-6873-438d-8421-214d745a8eaf req-c88c64b7-ef33-4454-b0d5-8a8bf0c4ee5f tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 945 time: 0.1316841 Dec 09 21:47:55.830150 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02b31291-8363-4eb8-ad80-032d5a00f2a6 None None] Routers {'2b0d6cbd-63cc-4c01-b04b-85ffaca65add'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:47:55.831353 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-02b31291-8363-4eb8-ad80-032d5a00f2a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['2b0d6cbd-63cc-4c01-b04b-85ffaca65add'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:55.873443 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f8c5850-a9b7-464b-8d72-49b0f7c1fcbf tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:55.874907 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8f8c5850-a9b7-464b-8d72-49b0f7c1fcbf tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/ports/7752b027-40f1-4899-abc3-a3d6f8f3df31 HTTP/1.1" status: 200 len: 910 time: 0.0986192 Dec 09 21:47:55.878061 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45564) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:55.901671 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b7801a94-95bc-4393-8406-cfca5263c9f1 None None] Provisioning complete for port f11f1db4-60fc-4d9a-8fb8-96138fc86fe6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:55.907604 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b7801a94-95bc-4393-8406-cfca5263c9f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:55.940700 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fd23dbf-6873-438d-8421-214d745a8eaf req-f7e55768-2453-4320-a73d-d5f02aacb03c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1031940 Dec 09 21:47:55.964326 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-02b31291-8363-4eb8-ad80-032d5a00f2a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:56.004098 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02b31291-8363-4eb8-ad80-032d5a00f2a6 None None] Routers {'2b0d6cbd-63cc-4c01-b04b-85ffaca65add'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:47:56.004760 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-02b31291-8363-4eb8-ad80-032d5a00f2a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['2b0d6cbd-63cc-4c01-b04b-85ffaca65add'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:56.167010 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-02b31291-8363-4eb8-ad80-032d5a00f2a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:56.167801 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02b31291-8363-4eb8-ad80-032d5a00f2a6 None None] The sync data for ids ['2b0d6cbd-63cc-4c01-b04b-85ffaca65add'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:47:56.226837 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01f540a8-36d3-43e5-92f4-d260a4cba361 req-c9737d77-517e-419f-b138-01a5fa18edd2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:56.236598 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-01f540a8-36d3-43e5-92f4-d260a4cba361 req-c9737d77-517e-419f-b138-01a5fa18edd2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 945 time: 0.1463890 Dec 09 21:47:56.318763 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-01f540a8-36d3-43e5-92f4-d260a4cba361 req-9540e140-69df-4d05-b9c0-14f44d75a9ab tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0808671 Dec 09 21:47:56.340190 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45574) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:56.440501 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-400cee52-ce43-4631-9e15-885015e602a6 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:47:56.450446 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-400cee52-ce43-4631-9e15-885015e602a6 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 1092 time: 0.1048584 Dec 09 21:47:56.451128 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45580) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:56.465203 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-6cf81703-cfdd-4399-8c75-f8c9d36d2fe1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'fixed_ip_address': '172.20.0.5'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:47:56.546643 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6cf81703-cfdd-4399-8c75-f8c9d36d2fe1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:56.715315 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ec5ebe0b-483f-45df-842f-2bed89701190 None None] Provisioning complete for port 7752b027-40f1-4899-abc3-a3d6f8f3df31 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:56.716166 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ec5ebe0b-483f-45df-842f-2bed89701190 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:56.860259 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa1bcc57-f1a2-4c62-8e2c-720a86989a04 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:56.873574 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f11f1db4-60fc-4d9a-8fb8-96138fc86fe6 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:47:56.909183 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ec5ebe0b-483f-45df-842f-2bed89701190 None None] Port 7752b027-40f1-4899-abc3-a3d6f8f3df31 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:47:56.914803 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6cf81703-cfdd-4399-8c75-f8c9d36d2fe1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:57.016212 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ec5ebe0b-483f-45df-842f-2bed89701190 None None] Provisioning complete for port f11f1db4-60fc-4d9a-8fb8-96138fc86fe6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:57.016587 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ec5ebe0b-483f-45df-842f-2bed89701190 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:57.222842 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f11f1db4-60fc-4d9a-8fb8-96138fc86fe6 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:57.223476 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:57.286633 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-6cf81703-cfdd-4399-8c75-f8c9d36d2fe1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Allocated IP 172.25.3.216 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/ca3fd0a1-24f4-48b1-81ac-bc3cc6f3266a) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:47:57.430253 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:57.456415 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-aa1bcc57-f1a2-4c62-8e2c-720a86989a04 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting port 7752b027-40f1-4899-abc3-a3d6f8f3df31 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:47:57.458636 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa1bcc57-f1a2-4c62-8e2c-720a86989a04 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:57.540699 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:57.557866 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6cf81703-cfdd-4399-8c75-f8c9d36d2fe1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:57.637224 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6cf81703-cfdd-4399-8c75-f8c9d36d2fe1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:57.716993 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c17d0c76-afe4-4091-83d2-349a526a92d9 None None] Provisioning complete for port 7752b027-40f1-4899-abc3-a3d6f8f3df31 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:47:57.736153 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c17d0c76-afe4-4091-83d2-349a526a92d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:57.744124 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa1bcc57-f1a2-4c62-8e2c-720a86989a04 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:57.744868 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6cf81703-cfdd-4399-8c75-f8c9d36d2fe1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:47:57.750898 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cf81703-cfdd-4399-8c75-f8c9d36d2fe1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Port': ['ID=ca3fd0a1-24f4-48b1-81ac-bc3cc6f3266a,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:57.758185 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-6cf81703-cfdd-4399-8c75-f8c9d36d2fe1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:47:57.761113 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6cf81703-cfdd-4399-8c75-f8c9d36d2fe1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:47:57.781098 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-aa1bcc57-f1a2-4c62-8e2c-720a86989a04 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Calling delete_port for 7752b027-40f1-4899-abc3-a3d6f8f3df31 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:47:57.783636 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-c17d0c76-afe4-4091-83d2-349a526a92d9 None None] Port 7752b027-40f1-4899-abc3-a3d6f8f3df31 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:47:58.124037 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa1bcc57-f1a2-4c62-8e2c-720a86989a04 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:58.194422 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa1bcc57-f1a2-4c62-8e2c-720a86989a04 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Port': ['ID=7752b027-40f1-4899-abc3-a3d6f8f3df31,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:58.582027 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa1bcc57-f1a2-4c62-8e2c-720a86989a04 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:58.664859 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6cf81703-cfdd-4399-8c75-f8c9d36d2fe1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:59.067546 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aa1bcc57-f1a2-4c62-8e2c-720a86989a04 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Router 2b0d6cbd-63cc-4c01-b04b-85ffaca65add has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:47:59.246145 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aa1bcc57-f1a2-4c62-8e2c-720a86989a04 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:47:59.269755 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0afb0e17-52bf-4001-a852-4b4c6211586d None None] Sync routers for ids ['2b0d6cbd-63cc-4c01-b04b-85ffaca65add'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:47:59.281821 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-aa1bcc57-f1a2-4c62-8e2c-720a86989a04 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/routers/2b0d6cbd-63cc-4c01-b04b-85ffaca65add/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3999014 Dec 09 21:47:59.283824 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0afb0e17-52bf-4001-a852-4b4c6211586d None None] Routers {'2b0d6cbd-63cc-4c01-b04b-85ffaca65add'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:47:59.284381 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45630) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:59.287147 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-0afb0e17-52bf-4001-a852-4b4c6211586d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['2b0d6cbd-63cc-4c01-b04b-85ffaca65add'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:59.338589 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d911d614-0f63-49d3-ae24-4b9a9d0864ba tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/ports?device_id=2b0d6cbd-63cc-4c01-b04b-85ffaca65add HTTP/1.1" status: 200 len: 205 time: 0.0528405 Dec 09 21:47:59.342392 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45632) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:47:59.363404 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-0afb0e17-52bf-4001-a852-4b4c6211586d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:59.383207 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0afb0e17-52bf-4001-a852-4b4c6211586d None None] Routers {'2b0d6cbd-63cc-4c01-b04b-85ffaca65add'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:47:59.384795 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-0afb0e17-52bf-4001-a852-4b4c6211586d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['2b0d6cbd-63cc-4c01-b04b-85ffaca65add'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:59.466882 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6cf81703-cfdd-4399-8c75-f8c9d36d2fe1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:59.479338 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-0afb0e17-52bf-4001-a852-4b4c6211586d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:47:59.481864 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0afb0e17-52bf-4001-a852-4b4c6211586d None None] The sync data for ids ['2b0d6cbd-63cc-4c01-b04b-85ffaca65add'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:47:59.564588 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d67e1f8-18b0-4a3b-8732-3c7def775fda tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:59.808298 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6cf81703-cfdd-4399-8c75-f8c9d36d2fe1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:59.815755 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6cf81703-cfdd-4399-8c75-f8c9d36d2fe1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:59.874211 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cf81703-cfdd-4399-8c75-f8c9d36d2fe1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Port': ['ID=ca3fd0a1-24f4-48b1-81ac-bc3cc6f3266a,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:47:59.875773 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d67e1f8-18b0-4a3b-8732-3c7def775fda tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:59.888101 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d67e1f8-18b0-4a3b-8732-3c7def775fda tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:59.991096 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d67e1f8-18b0-4a3b-8732-3c7def775fda tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:47:59.992835 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9d67e1f8-18b0-4a3b-8732-3c7def775fda tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Fanout notify agent at l3_agent the message router_deleted on router 2b0d6cbd-63cc-4c01-b04b-85ffaca65add {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:48:00.009629 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d67e1f8-18b0-4a3b-8732-3c7def775fda tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:00.012272 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9d67e1f8-18b0-4a3b-8732-3c7def775fda tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/routers/2b0d6cbd-63cc-4c01-b04b-85ffaca65add HTTP/1.1" status: 204 len: 168 time: 0.6671700 Dec 09 21:48:00.014952 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6cf81703-cfdd-4399-8c75-f8c9d36d2fe1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:00.015234 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45644) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:00.153224 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-8aded0ca-9c58-4ca9-bc04-2ca95a62efe0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting subnet 78564a9f-be31-44e5-88cf-6b24abdc75c9 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:48:00.157210 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8aded0ca-9c58-4ca9-bc04-2ca95a62efe0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:00.170234 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-6cf81703-cfdd-4399-8c75-f8c9d36d2fe1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Floating IP 3a029f47-0fde-479e-a9de-26b4149b4355 associated. External IP: 172.25.3.216, port: 165bd568-9d49-4f11-b8e1-eb1d0dc675b3. Dec 09 21:48:00.218102 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8aded0ca-9c58-4ca9-bc04-2ca95a62efe0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:00.370450 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8aded0ca-9c58-4ca9-bc04-2ca95a62efe0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:00.494512 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8aded0ca-9c58-4ca9-bc04-2ca95a62efe0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:00.501809 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6cf81703-cfdd-4399-8c75-f8c9d36d2fe1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Router 7521af04-4c9d-4f02-9889-0ff6f5545ff7 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:48:00.541374 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8aded0ca-9c58-4ca9-bc04-2ca95a62efe0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Subnet': ['ID=78564a9f-be31-44e5-88cf-6b24abdc75c9,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:00.556586 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8aded0ca-9c58-4ca9-bc04-2ca95a62efe0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:00.564293 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ef04af4b-dcda-4d5b-993b-8825d9e7f3c6 None None] Network f1924004-31ef-434c-9741-a8c26b4419a1 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:48:00.568379 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8aded0ca-9c58-4ca9-bc04-2ca95a62efe0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/subnets/78564a9f-be31-44e5-88cf-6b24abdc75c9 HTTP/1.1" status: 204 len: 168 time: 0.5496581 Dec 09 21:48:00.568721 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45648) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:00.716475 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cc1c1a1-391a-4830-a416-cb73a09d91a8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:00.769994 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6cf81703-cfdd-4399-8c75-f8c9d36d2fe1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:48:00.785460 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dca4d850-a929-4a79-ab27-0b5414faa422 None None] Sync routers for ids ['7521af04-4c9d-4f02-9889-0ff6f5545ff7'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:48:00.821408 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dca4d850-a929-4a79-ab27-0b5414faa422 None None] Routers {'7521af04-4c9d-4f02-9889-0ff6f5545ff7'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:00.825462 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-dca4d850-a929-4a79-ab27-0b5414faa422 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7521af04-4c9d-4f02-9889-0ff6f5545ff7'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:00.826802 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6cf81703-cfdd-4399-8c75-f8c9d36d2fe1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:00.865425 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-9cc1c1a1-391a-4830-a416-cb73a09d91a8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting port f11f1db4-60fc-4d9a-8fb8-96138fc86fe6 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:48:00.865919 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cc1c1a1-391a-4830-a416-cb73a09d91a8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:00.894577 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6cf81703-cfdd-4399-8c75-f8c9d36d2fe1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 4.4422748 Dec 09 21:48:00.895304 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'tag': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:48:00.901594 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dd589560-5044-45b4-b9ae-9ff73472396f" -d '{"events": [{"name": "network-changed", "server_uuid": "c9630177-3a8d-4c3a-8c62-dd93288c7232", "tag": "165bd568-9d49-4f11-b8e1-eb1d0dc675b3"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:48:00.963286 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-9cc1c1a1-391a-4830-a416-cb73a09d91a8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] For port f11f1db4-60fc-4d9a-8fb8-96138fc86fe6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f11f1db4-60fc-4d9a-8fb8-96138fc86fe6,segment=NetworkSegment(b8f75b56-669c-47cd-8c0b-e7c5994fa19a),segment_id=b8f75b56-669c-47cd-8c0b-e7c5994fa19a)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:00.964342 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cc1c1a1-391a-4830-a416-cb73a09d91a8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:00.977297 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-9cc1c1a1-391a-4830-a416-cb73a09d91a8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Calling delete_port for f11f1db4-60fc-4d9a-8fb8-96138fc86fe6 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:48:01.019854 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7b70f18-fbd7-4626-8a55-82f229e323e0 None None] DHCP port deletion for f1924004-31ef-434c-9741-a8c26b4419a1 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:48:01.068817 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cc1c1a1-391a-4830-a416-cb73a09d91a8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:01.159228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-c7b70f18-fbd7-4626-8a55-82f229e323e0 None None] The port 'f11f1db4-60fc-4d9a-8fb8-96138fc86fe6' was deleted {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1958}} Dec 09 21:48:01.187705 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cc1c1a1-391a-4830-a416-cb73a09d91a8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Port': ['ID=f11f1db4-60fc-4d9a-8fb8-96138fc86fe6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:01.192204 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9cc1c1a1-391a-4830-a416-cb73a09d91a8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] No DVR routers for this DVR port f11f1db4-60fc-4d9a-8fb8-96138fc86fe6 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:48:01.247472 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd5c5bc5-7af1-4bca-b383-09821192bcca req-35ef55dd-ab14-4ff9-bf9d-24e4a32460c1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:01.249425 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd5c5bc5-7af1-4bca-b383-09821192bcca req-35ef55dd-ab14-4ff9-bf9d-24e4a32460c1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 945 time: 0.0946944 Dec 09 21:48:01.272872 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-dca4d850-a929-4a79-ab27-0b5414faa422 None None] Set router 7521af04-4c9d-4f02-9889-0ff6f5545ff7 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:48:01.413181 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd5c5bc5-7af1-4bca-b383-09821192bcca req-2a2392aa-424c-4729-974d-d47f2d3ceb96 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1548696 Dec 09 21:48:01.422182 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cc1c1a1-391a-4830-a416-cb73a09d91a8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:01.433205 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45666) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:01.478798 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-9cc1c1a1-391a-4830-a416-cb73a09d91a8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f1924004-31ef-434c-9741-a8c26b4419a1']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:01.491360 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-9cc1c1a1-391a-4830-a416-cb73a09d91a8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b8f75b56-669c-47cd-8c0b-e7c5994fa19a') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:01.492096 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-9cc1c1a1-391a-4830-a416-cb73a09d91a8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b8f75b56-669c-47cd-8c0b-e7c5994fa19a') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:01.513348 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cc1c1a1-391a-4830-a416-cb73a09d91a8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:01.580768 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cc1c1a1-391a-4830-a416-cb73a09d91a8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:01.649919 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9cc1c1a1-391a-4830-a416-cb73a09d91a8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Releasing vlan 123 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:48:01.650325 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cc1c1a1-391a-4830-a416-cb73a09d91a8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:01.658323 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:48:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3993ff5d-f405-4a67-91b6-4fb7a47107d0 x-openstack-request-id: req-3993ff5d-f405-4a67-91b6-4fb7a47107d0 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:48:01.658930 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c9630177-3a8d-4c3a-8c62-dd93288c7232", "tag": "165bd568-9d49-4f11-b8e1-eb1d0dc675b3", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:48:01.659387 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-3993ff5d-f405-4a67-91b6-4fb7a47107d0 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:48:01.660070 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'tag': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3', 'status': 'completed', 'code': 200} Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:48:01.661597 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:48:01.682419 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-58e41467-cb86-4e05-826d-f336dae0982c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/floatingips/3a029f47-0fde-479e-a9de-26b4149b4355 HTTP/1.1" status: 200 len: 991 time: 0.2479222 Dec 09 21:48:01.831150 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cc1c1a1-391a-4830-a416-cb73a09d91a8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:01.834788 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd589560-5044-45b4-b9ae-9ff73472396f req-621b269b-4f58-4fbe-b818-c6aa5bccb775 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:01.837051 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dd589560-5044-45b4-b9ae-9ff73472396f req-621b269b-4f58-4fbe-b818-c6aa5bccb775 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 1097 time: 0.2890892 Dec 09 21:48:01.860756 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9cc1c1a1-391a-4830-a416-cb73a09d91a8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:01.867367 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9cc1c1a1-391a-4830-a416-cb73a09d91a8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/networks/f1924004-31ef-434c-9741-a8c26b4419a1 HTTP/1.1" status: 204 len: 168 time: 1.2941704 Dec 09 21:48:01.867367 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cc1c1a1-391a-4830-a416-cb73a09d91a8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Network': ['ID=f1924004-31ef-434c-9741-a8c26b4419a1,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:01.868707 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45670) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:01.872550 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1130544393', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}, 'admin_state_up': False}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:48:01.986510 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-dca4d850-a929-4a79-ab27-0b5414faa422 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-161742691', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57'}], 'enable_snat': True}, 'gw_port_id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:47:28Z', 'updated_at': '2021-12-09T21:47:35Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:01:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3464, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:47:29Z', 'updated_at': '2021-12-09T21:47:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3a029f47-0fde-479e-a9de-26b4149b4355', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'floating_ip_address': '172.25.3.216', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'port_id': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 3496, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3', 'mac_address': 'fa:16:3e:9d:7e:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:47:58Z', 'updated_at': '2021-12-09T21:47:58Z', 'revision_number': 0, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd478d292-7b6e-4f28-b6f2-bbf3ba7d2069', 'name': '', 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:99:1a:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'device_owner': 'network:router_interface', 'standard_attr_id': 3471, 'fixed_ips': [{'subnet_id': '13dde2f9-0dfd-4600-912c-44b7903e3595', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:47:34Z', 'updated_at': '2021-12-09T21:47:40Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '13dde2f9-0dfd-4600-912c-44b7903e3595', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:02.023531 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dca4d850-a929-4a79-ab27-0b5414faa422 None None] Checking router: 7521af04-4c9d-4f02-9889-0ff6f5545ff7 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:48:02.033214 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dca4d850-a929-4a79-ab27-0b5414faa422 None None] Routers {'7521af04-4c9d-4f02-9889-0ff6f5545ff7'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:02.033893 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-dca4d850-a929-4a79-ab27-0b5414faa422 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7521af04-4c9d-4f02-9889-0ff6f5545ff7'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:02.053284 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:02.055936 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:02.153408 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:02.183250 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-dca4d850-a929-4a79-ab27-0b5414faa422 None None] Set router 7521af04-4c9d-4f02-9889-0ff6f5545ff7 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:48:02.434985 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd589560-5044-45b4-b9ae-9ff73472396f req-d5a6785c-5a85-45bf-862e-4ee7e87fa264 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:02.436715 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dd589560-5044-45b4-b9ae-9ff73472396f req-d5a6785c-5a85-45bf-862e-4ee7e87fa264 service neutron] 10.222.0.31 "GET /v2.0/networks?id=92500df7-83c8-4757-9b24-3ee4dfba2da3 HTTP/1.1" status: 200 len: 897 time: 0.5836470 Dec 09 21:48:02.441638 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:02.487999 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-dca4d850-a929-4a79-ab27-0b5414faa422 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-161742691', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57'}], 'enable_snat': True}, 'gw_port_id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:47:28Z', 'updated_at': '2021-12-09T21:47:35Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:01:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3464, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:47:29Z', 'updated_at': '2021-12-09T21:47:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3a029f47-0fde-479e-a9de-26b4149b4355', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'floating_ip_address': '172.25.3.216', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'port_id': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 3496, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3', 'mac_address': 'fa:16:3e:9d:7e:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:47:58Z', 'updated_at': '2021-12-09T21:47:58Z', 'revision_number': 0, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd478d292-7b6e-4f28-b6f2-bbf3ba7d2069', 'name': '', 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:99:1a:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'device_owner': 'network:router_interface', 'standard_attr_id': 3471, 'fixed_ips': [{'subnet_id': '13dde2f9-0dfd-4600-912c-44b7903e3595', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:47:34Z', 'updated_at': '2021-12-09T21:47:40Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '13dde2f9-0dfd-4600-912c-44b7903e3595', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:02.530260 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dca4d850-a929-4a79-ab27-0b5414faa422 None None] The sync data for ids ['7521af04-4c9d-4f02-9889-0ff6f5545ff7'] in n-d-713301-27 is: [{'id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-161742691', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57'}], 'enable_snat': True}, 'gw_port_id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:47:28Z', 'updated_at': '2021-12-09T21:47:35Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:01:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3464, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:47:29Z', 'updated_at': '2021-12-09T21:47:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3a029f47-0fde-479e-a9de-26b4149b4355', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'floating_ip_address': '172.25.3.216', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'port_id': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 3496, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3', 'mac_address': 'fa:16:3e:9d:7e:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:47:58Z', 'updated_at': '2021-12-09T21:47:58Z', 'revision_number': 0, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd478d292-7b6e-4f28-b6f2-bbf3ba7d2069', 'name': '', 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:99:1a:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'device_owner': 'network:router_interface', 'standard_attr_id': 3471, 'fixed_ips': [{'subnet_id': '13dde2f9-0dfd-4600-912c-44b7903e3595', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:47:34Z', 'updated_at': '2021-12-09T21:47:40Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '13dde2f9-0dfd-4600-912c-44b7903e3595', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:48:02.556061 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dd589560-5044-45b4-b9ae-9ff73472396f req-1c5cfe72-0374-4f45-a465-7a5bfd20fe94 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3 HTTP/1.1" status: 200 len: 999 time: 0.1109812 Dec 09 21:48:02.642798 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd589560-5044-45b4-b9ae-9ff73472396f req-17059c70-2010-4075-a9c1-f5b95cb6dd0b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:02.644623 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dd589560-5044-45b4-b9ae-9ff73472396f req-17059c70-2010-4075-a9c1-f5b95cb6dd0b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=13dde2f9-0dfd-4600-912c-44b7903e3595 HTTP/1.1" status: 200 len: 835 time: 0.0810530 Dec 09 21:48:02.685412 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45692) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:02.789605 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd589560-5044-45b4-b9ae-9ff73472396f req-aed26f14-005e-4a0c-b1a1-906af8aba387 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:02.803398 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dd589560-5044-45b4-b9ae-9ff73472396f req-aed26f14-005e-4a0c-b1a1-906af8aba387 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=92500df7-83c8-4757-9b24-3ee4dfba2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1137919 Dec 09 21:48:02.812237 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f11f1db4-60fc-4d9a-8fb8-96138fc86fe6 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:48:02.868681 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: f11f1db4-60fc-4d9a-8fb8-96138fc86fe6 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:48:02.869035 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f11f1db4-60fc-4d9a-8fb8-96138fc86fe6 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:48:02.903793 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a5e02d3c-f909-4148-906f-1d982efea36d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/floatingips/3a029f47-0fde-479e-a9de-26b4149b4355 HTTP/1.1" status: 200 len: 991 time: 0.2170136 Dec 09 21:48:02.953928 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69bc1049-f929-4aee-bb57-6773f05d22b0 None None] New status for floating IP 3a029f47-0fde-479e-a9de-26b4149b4355: ACTIVE {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:48:02.969791 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c0da910f-aac0-4edd-b4c7-ac749172676f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:03.593682 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dd589560-5044-45b4-b9ae-9ff73472396f req-2ada6fc1-cf84-49a6-a066-4faddba8e14e service neutron] 10.222.0.31 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7549572 Dec 09 21:48:03.694286 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:03.719741 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:03.905434 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45720) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:03.948660 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dd589560-5044-45b4-b9ae-9ff73472396f req-7e96b1e6-cdaa-4f2f-bc65-b951d6d32d27 service neutron] 10.222.0.31 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3036795 Dec 09 21:48:03.986379 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Allocated IP 172.25.3.62 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/b2240ff4-0ff2-4e39-8b0e-2913c5fa59c6) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:48:04.071626 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-47302a66-cefe-401e-9e0a-4153aa6dbdc4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/floatingips/3a029f47-0fde-479e-a9de-26b4149b4355 HTTP/1.1" status: 200 len: 993 time: 0.1649034 Dec 09 21:48:04.099916 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:48:04.105281 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:04.144197 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:04.192364 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:48:04.197534 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:48:04.206267 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:48:04.210922 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7ca08b46-2cd5-4258-8955-2f7f84536321 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:48:04.212392 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Port': ['ID=b2240ff4-0ff2-4e39-8b0e-2913c5fa59c6,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:04.254668 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:04.255117 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:04.255541 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:04.255889 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:04.264958 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:04.265997 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:04.266607 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:04.267390 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:04.267881 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:04.268365 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:04.268846 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:04.269322 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:04.269906 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:04.298032 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6abb123f-3e42-43d9-b702-8f6dbb8db464 None None] Provisioning complete for port b2240ff4-0ff2-4e39-8b0e-2913c5fa59c6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:04.298406 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6abb123f-3e42-43d9-b702-8f6dbb8db464 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:04.364875 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-6abb123f-3e42-43d9-b702-8f6dbb8db464 None None] Port b2240ff4-0ff2-4e39-8b0e-2913c5fa59c6 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:48:04.677966 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:04.900924 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:05.038776 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Router f73e5df1-ece2-410e-963e-6fac076e97ba is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:48:05.150078 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:48:05.161147 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3b542c8-fcc2-41b5-adc7-7666b12289f3 None None] Sync routers for ids ['f73e5df1-ece2-410e-963e-6fac076e97ba'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:48:05.173226 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3b542c8-fcc2-41b5-adc7-7666b12289f3 None None] Routers {'f73e5df1-ece2-410e-963e-6fac076e97ba'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:05.174733 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b3b542c8-fcc2-41b5-adc7-7666b12289f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f73e5df1-ece2-410e-963e-6fac076e97ba'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:05.180928 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:05.185199 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45740) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:05.185760 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-df073491-3fc6-4764-8207-9a435d0ce2bb tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 879 time: 3.3161781 Dec 09 21:48:05.224670 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b3b542c8-fcc2-41b5-adc7-7666b12289f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:05.234823 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3b542c8-fcc2-41b5-adc7-7666b12289f3 None None] Routers {'f73e5df1-ece2-410e-963e-6fac076e97ba'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:05.235550 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b3b542c8-fcc2-41b5-adc7-7666b12289f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:47:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f73e5df1-ece2-410e-963e-6fac076e97ba'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:05.276038 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b3b542c8-fcc2-41b5-adc7-7666b12289f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:05.276762 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3b542c8-fcc2-41b5-adc7-7666b12289f3 None None] The sync data for ids ['f73e5df1-ece2-410e-963e-6fac076e97ba'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:48:05.339866 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-575cce91-5172-443b-9a4d-c266c07591c7 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/routers/f73e5df1-ece2-410e-963e-6fac076e97ba HTTP/1.1" status: 200 len: 880 time: 0.1526210 Dec 09 21:48:05.342498 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45746) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:05.592498 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3a6a3b9c-66cf-404f-8a67-05c16f254201 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:05.622618 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45758) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:05.627711 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a8bcb28e-13bd-4530-a9e8-e240739110ad tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'router': {'name': 'updatedtempest-RoutersTest-router-1130544393'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:48:05.631306 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-68b89c68-5ebf-4bce-a21f-266555f20a0a tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 883 time: 0.2876086 Dec 09 21:48:06.004072 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8bcb28e-13bd-4530-a9e8-e240739110ad tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:06.020102 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8bcb28e-13bd-4530-a9e8-e240739110ad tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-640457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-640448', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-635166'] for router, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:06.186211 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a8bcb28e-13bd-4530-a9e8-e240739110ad tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Router f73e5df1-ece2-410e-963e-6fac076e97ba has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:48:06.379281 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a8bcb28e-13bd-4530-a9e8-e240739110ad tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:48:06.390645 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83219897-a745-4238-be12-89afdbe70ed3 None None] Sync routers for ids ['f73e5df1-ece2-410e-963e-6fac076e97ba'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:48:06.393038 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8bcb28e-13bd-4530-a9e8-e240739110ad tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:06.395612 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a8bcb28e-13bd-4530-a9e8-e240739110ad tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/routers/f73e5df1-ece2-410e-963e-6fac076e97ba HTTP/1.1" status: 200 len: 887 time: 0.7708924 Dec 09 21:48:06.397886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45786) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:06.419873 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83219897-a745-4238-be12-89afdbe70ed3 None None] Routers {'f73e5df1-ece2-410e-963e-6fac076e97ba'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:06.420720 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-83219897-a745-4238-be12-89afdbe70ed3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f73e5df1-ece2-410e-963e-6fac076e97ba'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:06.508496 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-83219897-a745-4238-be12-89afdbe70ed3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:06.521845 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83219897-a745-4238-be12-89afdbe70ed3 None None] Routers {'f73e5df1-ece2-410e-963e-6fac076e97ba'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:06.522761 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-83219897-a745-4238-be12-89afdbe70ed3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f73e5df1-ece2-410e-963e-6fac076e97ba'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:06.573861 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45792) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:06.574188 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1c50ac2a-b5e1-4987-b07f-ac2cf41a1c6f tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/routers/f73e5df1-ece2-410e-963e-6fac076e97ba HTTP/1.1" status: 200 len: 887 time: 0.1750522 Dec 09 21:48:06.580669 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-83219897-a745-4238-be12-89afdbe70ed3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:06.581331 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-83219897-a745-4238-be12-89afdbe70ed3 None None] The sync data for ids ['f73e5df1-ece2-410e-963e-6fac076e97ba'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:48:06.606160 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-849ad93d-aa80-4a31-887b-c3199a323d0c tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/ports?device_id=f73e5df1-ece2-410e-963e-6fac076e97ba HTTP/1.1" status: 200 len: 205 time: 0.0310378 Dec 09 21:48:06.609049 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45794) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:06.655667 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:06.850279 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-634476ef-0efa-4ed8-bd88-4ddddc185592 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:07.066018 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-634476ef-0efa-4ed8-bd88-4ddddc185592 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:07.164704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-634476ef-0efa-4ed8-bd88-4ddddc185592 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting port b2240ff4-0ff2-4e39-8b0e-2913c5fa59c6 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:48:07.165085 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-634476ef-0efa-4ed8-bd88-4ddddc185592 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:07.319909 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-634476ef-0efa-4ed8-bd88-4ddddc185592 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:07.333153 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-634476ef-0efa-4ed8-bd88-4ddddc185592 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Calling delete_port for b2240ff4-0ff2-4e39-8b0e-2913c5fa59c6 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:48:07.583288 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-634476ef-0efa-4ed8-bd88-4ddddc185592 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:07.612097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-634476ef-0efa-4ed8-bd88-4ddddc185592 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Port': ['ID=b2240ff4-0ff2-4e39-8b0e-2913c5fa59c6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:07.642195 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9cb0c016-6802-4e3c-880a-9b537fa1f00b None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:48:07.696007 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-634476ef-0efa-4ed8-bd88-4ddddc185592 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:07.808125 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-634476ef-0efa-4ed8-bd88-4ddddc185592 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:07.811328 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-634476ef-0efa-4ed8-bd88-4ddddc185592 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:07.863649 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-634476ef-0efa-4ed8-bd88-4ddddc185592 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:07.864221 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-634476ef-0efa-4ed8-bd88-4ddddc185592 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Fanout notify agent at l3_agent the message router_deleted on router f73e5df1-ece2-410e-963e-6fac076e97ba {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:48:07.872810 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-634476ef-0efa-4ed8-bd88-4ddddc185592 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:07.873995 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-634476ef-0efa-4ed8-bd88-4ddddc185592 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/routers/f73e5df1-ece2-410e-963e-6fac076e97ba HTTP/1.1" status: 204 len: 168 time: 1.2639241 Dec 09 21:48:07.877882 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45802) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:07.883219 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-83748b45-c11d-46ff-8bff-e8524be2cf42 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'network': {'name': 'tempest-RoutersTest-350251853'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:48:07.919313 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-83748b45-c11d-46ff-8bff-e8524be2cf42 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Made reservation on behalf of 99ff5f79d7574ab091d0707b5e01465a for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:48:07.923221 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83748b45-c11d-46ff-8bff-e8524be2cf42 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:07.963513 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-83748b45-c11d-46ff-8bff-e8524be2cf42 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] vlan segment allocate from pool success with {'vlan_id': 137, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:48:07.975050 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83748b45-c11d-46ff-8bff-e8524be2cf42 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:07.975746 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-83748b45-c11d-46ff-8bff-e8524be2cf42 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Added segment 8d48f362-9a47-4527-b18d-da4e9f4491b2 of type vlan for network 9b9fd439-4145-4110-abf8-a212dd981129 Dec 09 21:48:08.037887 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:08.065444 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83748b45-c11d-46ff-8bff-e8524be2cf42 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:08.127047 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83748b45-c11d-46ff-8bff-e8524be2cf42 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:08.133429 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83748b45-c11d-46ff-8bff-e8524be2cf42 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:08.134051 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-83748b45-c11d-46ff-8bff-e8524be2cf42 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:08.174558 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-83748b45-c11d-46ff-8bff-e8524be2cf42 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 765 time: 0.2953370 Dec 09 21:48:08.177219 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45806) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:08.183430 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-3524fd50-dcbf-4147-8b80-386c45cf8362 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'subnet': {'network_id': '9b9fd439-4145-4110-abf8-a212dd981129', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:48:08.282305 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83748b45-c11d-46ff-8bff-e8524be2cf42 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Network': ['ID=9b9fd439-4145-4110-abf8-a212dd981129,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:08.295168 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 9b9fd439-4145-4110-abf8-a212dd981129 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:48:08.365459 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3524fd50-dcbf-4147-8b80-386c45cf8362 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Made reservation on behalf of 99ff5f79d7574ab091d0707b5e01465a for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:48:08.378343 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3524fd50-dcbf-4147-8b80-386c45cf8362 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:08.675023 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3524fd50-dcbf-4147-8b80-386c45cf8362 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:08.781448 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3524fd50-dcbf-4147-8b80-386c45cf8362 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Checking segment: {'id': '8d48f362-9a47-4527-b18d-da4e9f4491b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '9b9fd439-4145-4110-abf8-a212dd981129'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:48:08.781840 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3524fd50-dcbf-4147-8b80-386c45cf8362 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network hostable DHCP agents. Network: 9b9fd439-4145-4110-abf8-a212dd981129, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:48:08.795611 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3524fd50-dcbf-4147-8b80-386c45cf8362 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Subnet': ['ID=7a6c28be-88ad-4e2e-bae9-7fb8005e7b8e,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:08.804260 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3524fd50-dcbf-4147-8b80-386c45cf8362 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network 9b9fd439-4145-4110-abf8-a212dd981129 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:48:08.814773 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-3524fd50-dcbf-4147-8b80-386c45cf8362 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 9b9fd439-4145-4110-abf8-a212dd981129) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:48:08.821870 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3524fd50-dcbf-4147-8b80-386c45cf8362 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:08.821870 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3524fd50-dcbf-4147-8b80-386c45cf8362 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:08.837365 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-59fba15a-9705-41ec-9bfc-6a3b51baf28f None None] Network 9b9fd439-4145-4110-abf8-a212dd981129 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:48:08.844348 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3524fd50-dcbf-4147-8b80-386c45cf8362 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.6628206 Dec 09 21:48:08.844530 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45816) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:08.850049 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-52d0b88c-a063-45fd-aa6c-1c0455dee2f3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-1788805645', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:48:08.878526 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-52d0b88c-a063-45fd-aa6c-1c0455dee2f3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:08.879986 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-52d0b88c-a063-45fd-aa6c-1c0455dee2f3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:08.939932 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-52d0b88c-a063-45fd-aa6c-1c0455dee2f3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:08.947345 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-52d0b88c-a063-45fd-aa6c-1c0455dee2f3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:08.960780 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b5bd7097-4115-444a-9d92-f2070206dc97 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-9b9fd439-4145-4110-abf8-a212dd981129', 'network_id': '9b9fd439-4145-4110-abf8-a212dd981129', 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'fixed_ips': [{'subnet_id': '7a6c28be-88ad-4e2e-bae9-7fb8005e7b8e'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:48:08.961776 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b5bd7097-4115-444a-9d92-f2070206dc97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:08.985048 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-52d0b88c-a063-45fd-aa6c-1c0455dee2f3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:08.991251 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45818) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:09.001370 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-52d0b88c-a063-45fd-aa6c-1c0455dee2f3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 700 time: 0.1544349 Dec 09 21:48:09.102422 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-b5bd7097-4115-444a-9d92-f2070206dc97 None None] Allocated IP 172.20.0.2 (9b9fd439-4145-4110-abf8-a212dd981129/7a6c28be-88ad-4e2e-bae9-7fb8005e7b8e/9b5b769c-de66-465a-8223-df503221d90e) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:48:09.455766 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-11efb789-4151-4f04-87c4-a9375a00c2db tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:09.486518 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b5bd7097-4115-444a-9d92-f2070206dc97 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:09.497630 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b5bd7097-4115-444a-9d92-f2070206dc97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:09.578413 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5bd7097-4115-444a-9d92-f2070206dc97 None None] Network 9b9fd439-4145-4110-abf8-a212dd981129 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:48:09.593595 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-b5bd7097-4115-444a-9d92-f2070206dc97 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:48:09.608240 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5bd7097-4115-444a-9d92-f2070206dc97 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:48:09.688528 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bd7097-4115-444a-9d92-f2070206dc97 None None] Pushing event updated for resources: {'Port': ['ID=9b5b769c-de66-465a-8223-df503221d90e,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:09.746547 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-b5bd7097-4115-444a-9d92-f2070206dc97 None None] Attempting to bind port 9b5b769c-de66-465a-8223-df503221d90e on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:48:09.748019 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-b5bd7097-4115-444a-9d92-f2070206dc97 None None] Attempting to bind port 9b5b769c-de66-465a-8223-df503221d90e by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '8d48f362-9a47-4527-b18d-da4e9f4491b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '9b9fd439-4145-4110-abf8-a212dd981129'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:48:09.748496 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5bd7097-4115-444a-9d92-f2070206dc97 None None] Attempting to bind port 9b5b769c-de66-465a-8223-df503221d90e on network 9b9fd439-4145-4110-abf8-a212dd981129 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:48:09.757010 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5bd7097-4115-444a-9d92-f2070206dc97 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 48, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:48:09.757711 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5bd7097-4115-444a-9d92-f2070206dc97 None None] Checking segment: {'id': '8d48f362-9a47-4527-b18d-da4e9f4491b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '9b9fd439-4145-4110-abf8-a212dd981129'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:48:09.758657 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b5bd7097-4115-444a-9d92-f2070206dc97 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:09.759212 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5bd7097-4115-444a-9d92-f2070206dc97 None None] Bound using segment: {'id': '8d48f362-9a47-4527-b18d-da4e9f4491b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '9b9fd439-4145-4110-abf8-a212dd981129'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:48:09.759899 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-b5bd7097-4115-444a-9d92-f2070206dc97 None None] Bound port: 9b5b769c-de66-465a-8223-df503221d90e, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8d48f362-9a47-4527-b18d-da4e9f4491b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '9b9fd439-4145-4110-abf8-a212dd981129'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:48:09.761239 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b5bd7097-4115-444a-9d92-f2070206dc97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:09.764850 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:09.819061 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-11efb789-4151-4f04-87c4-a9375a00c2db tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Allocated IP 172.20.0.1 (9b9fd439-4145-4110-abf8-a212dd981129/7a6c28be-88ad-4e2e-bae9-7fb8005e7b8e/9d75d29b-51f8-4c30-a908-dbc94fa91450) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:48:09.852271 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-b5bd7097-4115-444a-9d92-f2070206dc97 None None] For port 9b5b769c-de66-465a-8223-df503221d90e, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:48:09.856353 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-b5bd7097-4115-444a-9d92-f2070206dc97 None None] For port 9b5b769c-de66-465a-8223-df503221d90e, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9b5b769c-de66-465a-8223-df503221d90e,segment=NetworkSegment(8d48f362-9a47-4527-b18d-da4e9f4491b2),segment_id=8d48f362-9a47-4527-b18d-da4e9f4491b2)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:48:09.868138 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b5bd7097-4115-444a-9d92-f2070206dc97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:09.986558 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bd7097-4115-444a-9d92-f2070206dc97 None None] Pushing event updated for resources: {'Port': ['ID=9b5b769c-de66-465a-8223-df503221d90e,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:10.023019 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-11efb789-4151-4f04-87c4-a9375a00c2db tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:10.120609 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-11efb789-4151-4f04-87c4-a9375a00c2db tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:10.171453 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11efb789-4151-4f04-87c4-a9375a00c2db tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network 9b9fd439-4145-4110-abf8-a212dd981129 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:48:10.175805 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-11efb789-4151-4f04-87c4-a9375a00c2db tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:48:10.178964 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11efb789-4151-4f04-87c4-a9375a00c2db tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:48:10.259425 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-11efb789-4151-4f04-87c4-a9375a00c2db tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:10.273094 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11efb789-4151-4f04-87c4-a9375a00c2db tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Port': ['ID=9d75d29b-51f8-4c30-a908-dbc94fa91450,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:10.509376 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-11efb789-4151-4f04-87c4-a9375a00c2db tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:10.919081 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9b5b769c-de66-465a-8223-df503221d90e up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:48:11.063611 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 9b5b769c-de66-465a-8223-df503221d90e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:11.064393 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:11.089550 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-11efb789-4151-4f04-87c4-a9375a00c2db tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:11.098795 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-11efb789-4151-4f04-87c4-a9375a00c2db tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:11.245215 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-11efb789-4151-4f04-87c4-a9375a00c2db tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:11.255151 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:11.273778 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11efb789-4151-4f04-87c4-a9375a00c2db tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Port': ['ID=9d75d29b-51f8-4c30-a908-dbc94fa91450,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:11.299768 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 9b5b769c-de66-465a-8223-df503221d90e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9b5b769c-de66-465a-8223-df503221d90e,segment=NetworkSegment(8d48f362-9a47-4527-b18d-da4e9f4491b2),segment_id=8d48f362-9a47-4527-b18d-da4e9f4491b2)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:11.305788 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:11.394432 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=9b5b769c-de66-465a-8223-df503221d90e,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:11.434705 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11efb789-4151-4f04-87c4-a9375a00c2db tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network 9b9fd439-4145-4110-abf8-a212dd981129 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:48:11.436610 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-11efb789-4151-4f04-87c4-a9375a00c2db tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:48:11.521584 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c28cebb-bbb4-42e6-bbc6-a528df60fac4 None None] Network 9b9fd439-4145-4110-abf8-a212dd981129 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:48:11.585229 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-11efb789-4151-4f04-87c4-a9375a00c2db tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Router d0b43639-53d9-4f82-aa3d-a2765e1623ed is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:48:11.632161 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f01ff2cf-d5ee-410f-83cf-6deacadf5387 None None] Provisioning complete for port 9b5b769c-de66-465a-8223-df503221d90e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:11.632565 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f01ff2cf-d5ee-410f-83cf-6deacadf5387 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:12.070314 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5e0a9441-46ea-4a92-9965-d7e205ef8983 None None] Provisioning complete for port 9d75d29b-51f8-4c30-a908-dbc94fa91450 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:12.071010 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5e0a9441-46ea-4a92-9965-d7e205ef8983 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:12.149852 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-5e0a9441-46ea-4a92-9965-d7e205ef8983 None None] Port 9d75d29b-51f8-4c30-a908-dbc94fa91450 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:48:12.176145 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5e0a9441-46ea-4a92-9965-d7e205ef8983 None None] Provisioning complete for port 9b5b769c-de66-465a-8223-df503221d90e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:12.177458 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5e0a9441-46ea-4a92-9965-d7e205ef8983 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:12.183910 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-11efb789-4151-4f04-87c4-a9375a00c2db tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:48:12.189187 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-11efb789-4151-4f04-87c4-a9375a00c2db tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/routers/d0b43639-53d9-4f82-aa3d-a2765e1623ed/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1946437 Dec 09 21:48:12.192027 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45874) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:12.231777 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35531ff4-41a8-4154-920c-f7a236bc0fa2 None None] Sync routers for ids ['d0b43639-53d9-4f82-aa3d-a2765e1623ed'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:48:12.272727 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35531ff4-41a8-4154-920c-f7a236bc0fa2 None None] Routers {'d0b43639-53d9-4f82-aa3d-a2765e1623ed'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:12.273727 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-35531ff4-41a8-4154-920c-f7a236bc0fa2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['d0b43639-53d9-4f82-aa3d-a2765e1623ed'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:12.304910 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c3a9f2b-2745-4386-a367-ab7851bdfa57 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:12.307720 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6c3a9f2b-2745-4386-a367-ab7851bdfa57 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/ports/9d75d29b-51f8-4c30-a908-dbc94fa91450 HTTP/1.1" status: 200 len: 910 time: 0.1141088 Dec 09 21:48:12.311119 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45884) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:12.319166 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-3d69f9d8-afd1-4a3c-bb51-4c9f3fe417ef tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'port': {'fixed_ips': [{'subnet_id': '7a6c28be-88ad-4e2e-bae9-7fb8005e7b8e'}]}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:48:12.346840 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-35531ff4-41a8-4154-920c-f7a236bc0fa2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:12.362215 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-35531ff4-41a8-4154-920c-f7a236bc0fa2 None None] Routers {'d0b43639-53d9-4f82-aa3d-a2765e1623ed'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:12.363005 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-35531ff4-41a8-4154-920c-f7a236bc0fa2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['d0b43639-53d9-4f82-aa3d-a2765e1623ed'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:12.403097 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-35531ff4-41a8-4154-920c-f7a236bc0fa2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:12.403954 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-35531ff4-41a8-4154-920c-f7a236bc0fa2 None None] The sync data for ids ['d0b43639-53d9-4f82-aa3d-a2765e1623ed'] in n-d-713301-27 is: [] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:48:12.553685 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d69f9d8-afd1-4a3c-bb51-4c9f3fe417ef tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:12.638266 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e55b05ff-359c-4ebf-8f14-eef81c3445ce None None] Provisioning complete for port 9d75d29b-51f8-4c30-a908-dbc94fa91450 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:12.639310 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e55b05ff-359c-4ebf-8f14-eef81c3445ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:12.706885 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e55b05ff-359c-4ebf-8f14-eef81c3445ce None None] Port 9d75d29b-51f8-4c30-a908-dbc94fa91450 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:48:12.786844 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9b5b769c-de66-465a-8223-df503221d90e up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:48:12.902009 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-136c1e2b-5482-4181-b175-cd4d38cd1a1b None None] Provisioning complete for port 9d75d29b-51f8-4c30-a908-dbc94fa91450 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:12.902375 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-136c1e2b-5482-4181-b175-cd4d38cd1a1b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:12.946892 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-136c1e2b-5482-4181-b175-cd4d38cd1a1b None None] Port 9d75d29b-51f8-4c30-a908-dbc94fa91450 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:48:12.958882 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 9b5b769c-de66-465a-8223-df503221d90e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:12.959073 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:13.149520 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d69f9d8-afd1-4a3c-bb51-4c9f3fe417ef tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:13.161219 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d69f9d8-afd1-4a3c-bb51-4c9f3fe417ef tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:13.227762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d69f9d8-afd1-4a3c-bb51-4c9f3fe417ef tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Port': ['ID=9d75d29b-51f8-4c30-a908-dbc94fa91450,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:13.251498 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d69f9d8-afd1-4a3c-bb51-4c9f3fe417ef tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:13.251851 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d69f9d8-afd1-4a3c-bb51-4c9f3fe417ef tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:13.252298 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d69f9d8-afd1-4a3c-bb51-4c9f3fe417ef tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:13.252746 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d69f9d8-afd1-4a3c-bb51-4c9f3fe417ef tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:13.253062 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d69f9d8-afd1-4a3c-bb51-4c9f3fe417ef tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:13.253393 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d69f9d8-afd1-4a3c-bb51-4c9f3fe417ef tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:13.253718 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d69f9d8-afd1-4a3c-bb51-4c9f3fe417ef tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:13.254133 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d69f9d8-afd1-4a3c-bb51-4c9f3fe417ef tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:13.254460 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d69f9d8-afd1-4a3c-bb51-4c9f3fe417ef tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:13.254783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d69f9d8-afd1-4a3c-bb51-4c9f3fe417ef tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:13.255100 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d69f9d8-afd1-4a3c-bb51-4c9f3fe417ef tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:13.255421 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d69f9d8-afd1-4a3c-bb51-4c9f3fe417ef tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:13.255877 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d69f9d8-afd1-4a3c-bb51-4c9f3fe417ef tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:13.276798 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d69f9d8-afd1-4a3c-bb51-4c9f3fe417ef tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:13.277424 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d69f9d8-afd1-4a3c-bb51-4c9f3fe417ef tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:13.281603 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3d69f9d8-afd1-4a3c-bb51-4c9f3fe417ef tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/ports/9d75d29b-51f8-4c30-a908-dbc94fa91450 HTTP/1.1" status: 200 len: 910 time: 0.9666405 Dec 09 21:48:13.281813 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45900) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:13.801052 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-720c9c46-dde9-4463-950d-27263e7937bc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:14.212477 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-720c9c46-dde9-4463-950d-27263e7937bc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting port 9d75d29b-51f8-4c30-a908-dbc94fa91450 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:48:14.212966 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-720c9c46-dde9-4463-950d-27263e7937bc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:14.317863 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-720c9c46-dde9-4463-950d-27263e7937bc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:14.331708 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-720c9c46-dde9-4463-950d-27263e7937bc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Calling delete_port for 9d75d29b-51f8-4c30-a908-dbc94fa91450 owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:48:14.521793 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-720c9c46-dde9-4463-950d-27263e7937bc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:14.550932 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-720c9c46-dde9-4463-950d-27263e7937bc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Port': ['ID=9d75d29b-51f8-4c30-a908-dbc94fa91450,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:14.739842 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-720c9c46-dde9-4463-950d-27263e7937bc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:14.985363 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-720c9c46-dde9-4463-950d-27263e7937bc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Router d0b43639-53d9-4f82-aa3d-a2765e1623ed has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:48:15.078267 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-720c9c46-dde9-4463-950d-27263e7937bc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:48:15.088664 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-720c9c46-dde9-4463-950d-27263e7937bc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/routers/d0b43639-53d9-4f82-aa3d-a2765e1623ed/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8054810 Dec 09 21:48:15.091343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45936) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:15.099803 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47529d9a-a2b1-4ba0-b26e-f016ecb50a08 None None] Sync routers for ids ['d0b43639-53d9-4f82-aa3d-a2765e1623ed'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:48:15.123121 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47529d9a-a2b1-4ba0-b26e-f016ecb50a08 None None] Routers {'d0b43639-53d9-4f82-aa3d-a2765e1623ed'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:15.124184 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-47529d9a-a2b1-4ba0-b26e-f016ecb50a08 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['d0b43639-53d9-4f82-aa3d-a2765e1623ed'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:15.147829 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-03c76a6e-4338-4efa-b440-d15d476c45bd tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/ports?device_id=d0b43639-53d9-4f82-aa3d-a2765e1623ed HTTP/1.1" status: 200 len: 205 time: 0.0542705 Dec 09 21:48:15.149507 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45938) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:15.193681 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-47529d9a-a2b1-4ba0-b26e-f016ecb50a08 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:15.226086 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47529d9a-a2b1-4ba0-b26e-f016ecb50a08 None None] Routers {'d0b43639-53d9-4f82-aa3d-a2765e1623ed'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:15.227124 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-47529d9a-a2b1-4ba0-b26e-f016ecb50a08 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['d0b43639-53d9-4f82-aa3d-a2765e1623ed'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:15.237167 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8cc54888-d740-45c0-a7df-e43ba1749605 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:15.276587 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-47529d9a-a2b1-4ba0-b26e-f016ecb50a08 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:15.277610 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47529d9a-a2b1-4ba0-b26e-f016ecb50a08 None None] The sync data for ids ['d0b43639-53d9-4f82-aa3d-a2765e1623ed'] in n-d-713301-27 is: [] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:48:15.456822 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8cc54888-d740-45c0-a7df-e43ba1749605 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:15.459347 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8cc54888-d740-45c0-a7df-e43ba1749605 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:15.507050 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8cc54888-d740-45c0-a7df-e43ba1749605 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:15.507586 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8cc54888-d740-45c0-a7df-e43ba1749605 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Fanout notify agent at l3_agent the message router_deleted on router d0b43639-53d9-4f82-aa3d-a2765e1623ed {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:48:15.517462 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8cc54888-d740-45c0-a7df-e43ba1749605 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:15.518686 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8cc54888-d740-45c0-a7df-e43ba1749605 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/routers/d0b43639-53d9-4f82-aa3d-a2765e1623ed HTTP/1.1" status: 204 len: 168 time: 0.3677878 Dec 09 21:48:15.521452 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45950) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:15.587291 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-63943a9e-df1b-4b47-8f73-952a872f3df7 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting subnet 7a6c28be-88ad-4e2e-bae9-7fb8005e7b8e {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:48:15.591630 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-63943a9e-df1b-4b47-8f73-952a872f3df7 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:15.642130 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-63943a9e-df1b-4b47-8f73-952a872f3df7 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:15.750979 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-63943a9e-df1b-4b47-8f73-952a872f3df7 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:15.863113 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-63943a9e-df1b-4b47-8f73-952a872f3df7 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:15.898604 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63943a9e-df1b-4b47-8f73-952a872f3df7 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Subnet': ['ID=7a6c28be-88ad-4e2e-bae9-7fb8005e7b8e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:15.906151 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-63943a9e-df1b-4b47-8f73-952a872f3df7 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:15.908458 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2ddabd33-08aa-4d7d-a677-fcc4124a714b None None] Network 9b9fd439-4145-4110-abf8-a212dd981129 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:48:15.918742 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-63943a9e-df1b-4b47-8f73-952a872f3df7 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/subnets/7a6c28be-88ad-4e2e-bae9-7fb8005e7b8e HTTP/1.1" status: 204 len: 168 time: 0.3936405 Dec 09 21:48:15.919739 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45956) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:16.055867 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f05bdedd-af1f-409f-bb80-3221fb0b1472 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:16.192673 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b9daf5d9-632c-489c-ae3b-8bd032e6b14e None None] DHCP port deletion for 9b9fd439-4145-4110-abf8-a212dd981129 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:48:16.196750 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-f05bdedd-af1f-409f-bb80-3221fb0b1472 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting port 9b5b769c-de66-465a-8223-df503221d90e {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:48:16.197513 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f05bdedd-af1f-409f-bb80-3221fb0b1472 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:16.305365 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-b9daf5d9-632c-489c-ae3b-8bd032e6b14e None None] Deleting port 9b5b769c-de66-465a-8223-df503221d90e {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:48:16.306262 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b9daf5d9-632c-489c-ae3b-8bd032e6b14e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:16.364831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-f05bdedd-af1f-409f-bb80-3221fb0b1472 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] For port 9b5b769c-de66-465a-8223-df503221d90e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9b5b769c-de66-465a-8223-df503221d90e,segment=NetworkSegment(8d48f362-9a47-4527-b18d-da4e9f4491b2),segment_id=8d48f362-9a47-4527-b18d-da4e9f4491b2)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:16.365205 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f05bdedd-af1f-409f-bb80-3221fb0b1472 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:16.400930 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-f05bdedd-af1f-409f-bb80-3221fb0b1472 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Calling delete_port for 9b5b769c-de66-465a-8223-df503221d90e owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:48:16.464676 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-b9daf5d9-632c-489c-ae3b-8bd032e6b14e None None] For port 9b5b769c-de66-465a-8223-df503221d90e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9b5b769c-de66-465a-8223-df503221d90e,segment=NetworkSegment(8d48f362-9a47-4527-b18d-da4e9f4491b2),segment_id=8d48f362-9a47-4527-b18d-da4e9f4491b2)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:16.465155 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b9daf5d9-632c-489c-ae3b-8bd032e6b14e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:16.492532 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-b9daf5d9-632c-489c-ae3b-8bd032e6b14e None None] Calling delete_port for 9b5b769c-de66-465a-8223-df503221d90e owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:48:16.528348 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f05bdedd-af1f-409f-bb80-3221fb0b1472 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:16.542106 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f05bdedd-af1f-409f-bb80-3221fb0b1472 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] No DVR routers for this DVR port 9b5b769c-de66-465a-8223-df503221d90e on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:48:16.593536 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f05bdedd-af1f-409f-bb80-3221fb0b1472 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Port': ['ID=9b5b769c-de66-465a-8223-df503221d90e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:16.608047 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b9daf5d9-632c-489c-ae3b-8bd032e6b14e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:16.636955 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9daf5d9-632c-489c-ae3b-8bd032e6b14e None None] Pushing event deleted for resources: {'Port': ['ID=9b5b769c-de66-465a-8223-df503221d90e,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:16.646094 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9daf5d9-632c-489c-ae3b-8bd032e6b14e None None] No DVR routers for this DVR port 9b5b769c-de66-465a-8223-df503221d90e on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:48:16.672573 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f05bdedd-af1f-409f-bb80-3221fb0b1472 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:16.712477 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-f05bdedd-af1f-409f-bb80-3221fb0b1472 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9b9fd439-4145-4110-abf8-a212dd981129']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:16.741829 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-f05bdedd-af1f-409f-bb80-3221fb0b1472 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8d48f362-9a47-4527-b18d-da4e9f4491b2') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:16.742228 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-f05bdedd-af1f-409f-bb80-3221fb0b1472 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8d48f362-9a47-4527-b18d-da4e9f4491b2') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:16.754183 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9b5b769c-de66-465a-8223-df503221d90e no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:48:16.756270 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f05bdedd-af1f-409f-bb80-3221fb0b1472 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:16.773903 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f05bdedd-af1f-409f-bb80-3221fb0b1472 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:16.784675 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f05bdedd-af1f-409f-bb80-3221fb0b1472 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Releasing vlan 137 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:48:16.785251 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f05bdedd-af1f-409f-bb80-3221fb0b1472 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:48:16.788791 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:48:16.839393 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 9b5b769c-de66-465a-8223-df503221d90e {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:48:16.839764 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9b5b769c-de66-465a-8223-df503221d90e not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:48:16.895057 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f05bdedd-af1f-409f-bb80-3221fb0b1472 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:16.904669 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f05bdedd-af1f-409f-bb80-3221fb0b1472 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:16.915220 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45984) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:16.921135 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-621f8334-57c9-48bd-b330-7cf8717aece3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-254666938', 'external_gateway_info': {}, 'admin_state_up': True}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:48:16.925784 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f05bdedd-af1f-409f-bb80-3221fb0b1472 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/networks/9b9fd439-4145-4110-abf8-a212dd981129 HTTP/1.1" status: 204 len: 168 time: 1.0048923 Dec 09 21:48:16.954319 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f05bdedd-af1f-409f-bb80-3221fb0b1472 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Network': ['ID=9b9fd439-4145-4110-abf8-a212dd981129,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:16.967310 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-621f8334-57c9-48bd-b330-7cf8717aece3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:16.968783 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-621f8334-57c9-48bd-b330-7cf8717aece3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:17.058620 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-621f8334-57c9-48bd-b330-7cf8717aece3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:17.068002 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-621f8334-57c9-48bd-b330-7cf8717aece3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:17.090672 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-621f8334-57c9-48bd-b330-7cf8717aece3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:17.095868 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 45988) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:17.101955 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-41c2410c-35c9-4bf9-9663-7631777466b2 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'network': {'name': 'tempest-RoutersTest-1213758983'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:48:17.106821 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-621f8334-57c9-48bd-b330-7cf8717aece3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 698 time: 0.1882200 Dec 09 21:48:17.129704 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-41c2410c-35c9-4bf9-9663-7631777466b2 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Made reservation on behalf of 99ff5f79d7574ab091d0707b5e01465a for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:48:17.136109 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-41c2410c-35c9-4bf9-9663-7631777466b2 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:17.166075 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-41c2410c-35c9-4bf9-9663-7631777466b2 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] vlan segment allocate from pool success with {'vlan_id': 149, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:48:17.179946 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-41c2410c-35c9-4bf9-9663-7631777466b2 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:17.180517 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-41c2410c-35c9-4bf9-9663-7631777466b2 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Added segment 9a21fac6-4e36-462c-a440-34e82f541369 of type vlan for network 4805df6a-c2c1-4270-aaf7-c9ee10b973d2 Dec 09 21:48:17.235985 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-41c2410c-35c9-4bf9-9663-7631777466b2 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:17.263938 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-41c2410c-35c9-4bf9-9663-7631777466b2 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:17.269870 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-41c2410c-35c9-4bf9-9663-7631777466b2 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:17.270637 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-41c2410c-35c9-4bf9-9663-7631777466b2 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:17.317762 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-41c2410c-35c9-4bf9-9663-7631777466b2 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.2201991 Dec 09 21:48:17.320730 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 45990) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:17.326172 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2faea672-2ff3-4011-91b4-db2d38cf0877 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'subnet': {'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:48:17.352035 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41c2410c-35c9-4bf9-9663-7631777466b2 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Network': ['ID=4805df6a-c2c1-4270-aaf7-c9ee10b973d2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:17.366567 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 4805df6a-c2c1-4270-aaf7-c9ee10b973d2 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:48:17.521908 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2faea672-2ff3-4011-91b4-db2d38cf0877 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Made reservation on behalf of 99ff5f79d7574ab091d0707b5e01465a for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:48:17.526243 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2faea672-2ff3-4011-91b4-db2d38cf0877 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:17.744827 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2faea672-2ff3-4011-91b4-db2d38cf0877 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:17.828454 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2faea672-2ff3-4011-91b4-db2d38cf0877 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Subnet': ['ID=ad5e915f-e2d0-4254-b7f3-de1864bf4bcf,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:17.831271 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2faea672-2ff3-4011-91b4-db2d38cf0877 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Checking segment: {'id': '9a21fac6-4e36-462c-a440-34e82f541369', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:48:17.832069 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2faea672-2ff3-4011-91b4-db2d38cf0877 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network hostable DHCP agents. Network: 4805df6a-c2c1-4270-aaf7-c9ee10b973d2, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:48:17.853105 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2faea672-2ff3-4011-91b4-db2d38cf0877 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network 4805df6a-c2c1-4270-aaf7-c9ee10b973d2 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:48:17.874129 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-2faea672-2ff3-4011-91b4-db2d38cf0877 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 4805df6a-c2c1-4270-aaf7-c9ee10b973d2) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:48:17.880693 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2faea672-2ff3-4011-91b4-db2d38cf0877 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:17.881432 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2faea672-2ff3-4011-91b4-db2d38cf0877 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:17.890273 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-736b08fc-f3fa-4a5d-96f2-3526ecbfbd3d None None] Network 4805df6a-c2c1-4270-aaf7-c9ee10b973d2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:48:17.923770 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2faea672-2ff3-4011-91b4-db2d38cf0877 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.5992062 Dec 09 21:48:17.924314 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46008) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:18.099355 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-95da56ce-15ac-411a-ac74-136d9e5165d0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:48:18.100316 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-95da56ce-15ac-411a-ac74-136d9e5165d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:18.318325 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-95da56ce-15ac-411a-ac74-136d9e5165d0 None None] Allocated IP 172.20.0.2 (4805df6a-c2c1-4270-aaf7-c9ee10b973d2/ad5e915f-e2d0-4254-b7f3-de1864bf4bcf/fc8c9273-f803-40e8-897e-6873cf824150) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:48:18.550523 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-95da56ce-15ac-411a-ac74-136d9e5165d0 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:18.561476 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-95da56ce-15ac-411a-ac74-136d9e5165d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:18.606316 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-95da56ce-15ac-411a-ac74-136d9e5165d0 None None] Network 4805df6a-c2c1-4270-aaf7-c9ee10b973d2 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:48:18.620136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-95da56ce-15ac-411a-ac74-136d9e5165d0 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:48:18.628781 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95da56ce-15ac-411a-ac74-136d9e5165d0 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:48:18.758729 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95da56ce-15ac-411a-ac74-136d9e5165d0 None None] Pushing event updated for resources: {'Port': ['ID=fc8c9273-f803-40e8-897e-6873cf824150,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:18.799813 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-95da56ce-15ac-411a-ac74-136d9e5165d0 None None] Attempting to bind port fc8c9273-f803-40e8-897e-6873cf824150 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:48:18.800121 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-95da56ce-15ac-411a-ac74-136d9e5165d0 None None] Attempting to bind port fc8c9273-f803-40e8-897e-6873cf824150 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '9a21fac6-4e36-462c-a440-34e82f541369', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:48:18.800452 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95da56ce-15ac-411a-ac74-136d9e5165d0 None None] Attempting to bind port fc8c9273-f803-40e8-897e-6873cf824150 on network 4805df6a-c2c1-4270-aaf7-c9ee10b973d2 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:48:18.814504 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95da56ce-15ac-411a-ac74-136d9e5165d0 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 48, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:48:18.823480 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95da56ce-15ac-411a-ac74-136d9e5165d0 None None] Checking segment: {'id': '9a21fac6-4e36-462c-a440-34e82f541369', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:48:18.823480 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-95da56ce-15ac-411a-ac74-136d9e5165d0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:18.823480 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95da56ce-15ac-411a-ac74-136d9e5165d0 None None] Bound using segment: {'id': '9a21fac6-4e36-462c-a440-34e82f541369', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:48:18.823480 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-95da56ce-15ac-411a-ac74-136d9e5165d0 None None] Bound port: fc8c9273-f803-40e8-897e-6873cf824150, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9a21fac6-4e36-462c-a440-34e82f541369', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:48:18.823480 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-95da56ce-15ac-411a-ac74-136d9e5165d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:18.871718 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-65ec8a0d-0a88-4429-ad23-fe1076e927e6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:18.913141 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-95da56ce-15ac-411a-ac74-136d9e5165d0 None None] For port fc8c9273-f803-40e8-897e-6873cf824150, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:48:18.916534 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-95da56ce-15ac-411a-ac74-136d9e5165d0 None None] For port fc8c9273-f803-40e8-897e-6873cf824150, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=fc8c9273-f803-40e8-897e-6873cf824150,segment=NetworkSegment(9a21fac6-4e36-462c-a440-34e82f541369),segment_id=9a21fac6-4e36-462c-a440-34e82f541369)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:48:18.922353 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-95da56ce-15ac-411a-ac74-136d9e5165d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:19.021126 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95da56ce-15ac-411a-ac74-136d9e5165d0 None None] Pushing event updated for resources: {'Port': ['ID=fc8c9273-f803-40e8-897e-6873cf824150,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:19.368849 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-65ec8a0d-0a88-4429-ad23-fe1076e927e6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Allocated IP 172.20.0.1 (4805df6a-c2c1-4270-aaf7-c9ee10b973d2/ad5e915f-e2d0-4254-b7f3-de1864bf4bcf/73e149a2-b26b-481c-8db9-513f7c9378ca) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:48:19.551357 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-65ec8a0d-0a88-4429-ad23-fe1076e927e6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:19.590027 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-65ec8a0d-0a88-4429-ad23-fe1076e927e6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:19.637259 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-65ec8a0d-0a88-4429-ad23-fe1076e927e6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network 4805df6a-c2c1-4270-aaf7-c9ee10b973d2 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:48:19.640418 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-65ec8a0d-0a88-4429-ad23-fe1076e927e6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:48:19.642968 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65ec8a0d-0a88-4429-ad23-fe1076e927e6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:48:19.647391 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46034) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:19.696748 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-65ec8a0d-0a88-4429-ad23-fe1076e927e6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:19.713577 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-2e43e7c4-4c85-49cd-8990-9cd05fcd9ae2 admin admin] Deleting subnet 1f76b74e-fb7e-4b78-bd58-a21de3f810b9 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:48:19.721631 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e43e7c4-4c85-49cd-8990-9cd05fcd9ae2 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:19.734277 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65ec8a0d-0a88-4429-ad23-fe1076e927e6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Port': ['ID=73e149a2-b26b-481c-8db9-513f7c9378ca,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:19.781755 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e43e7c4-4c85-49cd-8990-9cd05fcd9ae2 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:19.832185 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e43e7c4-4c85-49cd-8990-9cd05fcd9ae2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:19.882590 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-65ec8a0d-0a88-4429-ad23-fe1076e927e6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:19.898660 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e43e7c4-4c85-49cd-8990-9cd05fcd9ae2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:19.920613 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e43e7c4-4c85-49cd-8990-9cd05fcd9ae2 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:19.924438 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2e43e7c4-4c85-49cd-8990-9cd05fcd9ae2 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/1f76b74e-fb7e-4b78-bd58-a21de3f810b9 HTTP/1.1" status: 204 len: 168 time: 0.2754550 Dec 09 21:48:19.940508 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46036) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:19.948415 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e43e7c4-4c85-49cd-8990-9cd05fcd9ae2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1f76b74e-fb7e-4b78-bd58-a21de3f810b9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:20.108768 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4698275b-4410-4ceb-91ad-50b21010484c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:20.349375 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-65ec8a0d-0a88-4429-ad23-fe1076e927e6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:20.376485 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-65ec8a0d-0a88-4429-ad23-fe1076e927e6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:20.529922 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-daa49dac-2178-48e8-9a64-3860f0f96099 None None] Network 4805df6a-c2c1-4270-aaf7-c9ee10b973d2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:48:20.543002 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4698275b-4410-4ceb-91ad-50b21010484c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:20.547827 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65ec8a0d-0a88-4429-ad23-fe1076e927e6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Port': ['ID=73e149a2-b26b-481c-8db9-513f7c9378ca,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:20.578316 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-65ec8a0d-0a88-4429-ad23-fe1076e927e6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:20.583688 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-4698275b-4410-4ceb-91ad-50b21010484c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1f6c6308-b8f8-453f-b9f3-49b33791e0ee']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:20.600125 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-4698275b-4410-4ceb-91ad-50b21010484c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f4832b4c-9721-4fb3-b34b-0781180d5872') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:20.600687 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-4698275b-4410-4ceb-91ad-50b21010484c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f4832b4c-9721-4fb3-b34b-0781180d5872') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:20.664240 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5df6eb9b-c9f2-4a09-bdac-721527eeb618 None None] Provisioning complete for port fc8c9273-f803-40e8-897e-6873cf824150 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:20.664736 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5df6eb9b-c9f2-4a09-bdac-721527eeb618 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:20.746085 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4698275b-4410-4ceb-91ad-50b21010484c admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:20.759385 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-65ec8a0d-0a88-4429-ad23-fe1076e927e6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network 4805df6a-c2c1-4270-aaf7-c9ee10b973d2 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:48:20.776556 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-65ec8a0d-0a88-4429-ad23-fe1076e927e6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:48:20.789987 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4698275b-4410-4ceb-91ad-50b21010484c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:20.833192 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5df6eb9b-c9f2-4a09-bdac-721527eeb618 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:20.836016 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4698275b-4410-4ceb-91ad-50b21010484c admin admin] Releasing vlan 125 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:48:20.836427 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4698275b-4410-4ceb-91ad-50b21010484c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:48:20.852497 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:48:20.908230 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-5df6eb9b-c9f2-4a09-bdac-721527eeb618 None None] For port fc8c9273-f803-40e8-897e-6873cf824150, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=fc8c9273-f803-40e8-897e-6873cf824150,segment=NetworkSegment(9a21fac6-4e36-462c-a440-34e82f541369),segment_id=9a21fac6-4e36-462c-a440-34e82f541369)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:20.913605 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device fc8c9273-f803-40e8-897e-6873cf824150 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:48:20.917668 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5df6eb9b-c9f2-4a09-bdac-721527eeb618 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:20.980776 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4698275b-4410-4ceb-91ad-50b21010484c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:20.986965 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4698275b-4410-4ceb-91ad-50b21010484c admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:20.990891 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4698275b-4410-4ceb-91ad-50b21010484c admin admin] 10.222.0.13 "DELETE /v2.0/networks/1f6c6308-b8f8-453f-b9f3-49b33791e0ee HTTP/1.1" status: 204 len: 168 time: 1.0491140 Dec 09 21:48:20.993895 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46056) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:21.019228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5df6eb9b-c9f2-4a09-bdac-721527eeb618 None None] Pushing event updated for resources: {'Port': ['ID=fc8c9273-f803-40e8-897e-6873cf824150,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:21.027275 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port fc8c9273-f803-40e8-897e-6873cf824150 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:21.028384 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:21.045982 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4698275b-4410-4ceb-91ad-50b21010484c admin admin] Pushing event deleted for resources: {'Network': ['ID=1f6c6308-b8f8-453f-b9f3-49b33791e0ee,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:21.089441 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-faa0de49-423b-44f2-8acf-0e1e18f3e0eb admin admin] Deleting subnet 0f388987-bd56-44d8-88ba-8acd5faeb1d2 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:48:21.096780 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-65ec8a0d-0a88-4429-ad23-fe1076e927e6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Router 7e71b09c-215a-48ae-a557-15294dbfaea8 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:48:21.097553 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-faa0de49-423b-44f2-8acf-0e1e18f3e0eb admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:21.161457 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-faa0de49-423b-44f2-8acf-0e1e18f3e0eb admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:21.186280 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-147a8475-8322-4b38-853f-58c34cb4d891 None None] Provisioning complete for port fc8c9273-f803-40e8-897e-6873cf824150 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:21.186699 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-147a8475-8322-4b38-853f-58c34cb4d891 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:21.236928 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-faa0de49-423b-44f2-8acf-0e1e18f3e0eb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:21.249620 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-65ec8a0d-0a88-4429-ad23-fe1076e927e6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:48:21.258346 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-65ec8a0d-0a88-4429-ad23-fe1076e927e6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/routers/7e71b09c-215a-48ae-a557-15294dbfaea8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3327072 Dec 09 21:48:21.261310 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46060) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:21.263726 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] Sync routers for ids ['7e71b09c-215a-48ae-a557-15294dbfaea8'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:48:21.272477 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-5c42c881-c4a9-4cce-974a-e471c40b46ff tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'network': {'name': 'tempest-RoutersTest-1505859727'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:48:21.320699 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] Routers {'7e71b09c-215a-48ae-a557-15294dbfaea8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:21.321218 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5c42c881-c4a9-4cce-974a-e471c40b46ff tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Made reservation on behalf of 99ff5f79d7574ab091d0707b5e01465a for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:48:21.321608 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e71b09c-215a-48ae-a557-15294dbfaea8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:21.325586 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c42c881-c4a9-4cce-974a-e471c40b46ff tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:21.332443 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-faa0de49-423b-44f2-8acf-0e1e18f3e0eb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:21.357385 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5c42c881-c4a9-4cce-974a-e471c40b46ff tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] vlan segment allocate from pool success with {'vlan_id': 133, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:48:21.392425 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c42c881-c4a9-4cce-974a-e471c40b46ff tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:21.392976 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-5c42c881-c4a9-4cce-974a-e471c40b46ff tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Added segment d0a107fe-5f46-4b57-b092-aa8b3c02eed4 of type vlan for network 7157a402-a8c8-4a68-89c3-6a746b91f0b8 Dec 09 21:48:21.393770 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faa0de49-423b-44f2-8acf-0e1e18f3e0eb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0f388987-bd56-44d8-88ba-8acd5faeb1d2,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:21.409070 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-faa0de49-423b-44f2-8acf-0e1e18f3e0eb admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:21.416107 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-faa0de49-423b-44f2-8acf-0e1e18f3e0eb admin admin] 10.222.0.13 "DELETE /v2.0/subnets/0f388987-bd56-44d8-88ba-8acd5faeb1d2 HTTP/1.1" status: 204 len: 168 time: 0.4209650 Dec 09 21:48:21.419234 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46064) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:21.503545 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c42c881-c4a9-4cce-974a-e471c40b46ff tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:21.566275 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d2dd816f-d5e9-4dcb-87d1-d2d387f98453 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:21.595892 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c42c881-c4a9-4cce-974a-e471c40b46ff tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:21.610635 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c42c881-c4a9-4cce-974a-e471c40b46ff tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:21.613406 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c42c881-c4a9-4cce-974a-e471c40b46ff tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:21.701038 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5c42c881-c4a9-4cce-974a-e471c40b46ff tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.4343410 Dec 09 21:48:21.703824 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46074) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:21.709187 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-4efdfe91-e109-4bf8-a7b8-df99be1d9671 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'subnet': {'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8', 'cidr': '172.21.0.0/28', 'ip_version': 4, 'gateway_ip': '172.21.0.1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:48:21.742354 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] Set router 7e71b09c-215a-48ae-a557-15294dbfaea8 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:48:21.791599 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d2dd816f-d5e9-4dcb-87d1-d2d387f98453 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:21.817006 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-d2dd816f-d5e9-4dcb-87d1-d2d387f98453 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b73f65be-f154-49a5-9107-5a71ab99f874']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:21.828575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4efdfe91-e109-4bf8-a7b8-df99be1d9671 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Made reservation on behalf of 99ff5f79d7574ab091d0707b5e01465a for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:48:21.831245 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-d2dd816f-d5e9-4dcb-87d1-d2d387f98453 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0da9d582-4eab-489e-b7ba-4b0f37f9f554') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:21.831569 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-d2dd816f-d5e9-4dcb-87d1-d2d387f98453 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0da9d582-4eab-489e-b7ba-4b0f37f9f554') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:21.833496 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4efdfe91-e109-4bf8-a7b8-df99be1d9671 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:21.851829 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d2dd816f-d5e9-4dcb-87d1-d2d387f98453 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:21.865345 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c42c881-c4a9-4cce-974a-e471c40b46ff tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Network': ['ID=7157a402-a8c8-4a68-89c3-6a746b91f0b8,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:21.877853 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d2dd816f-d5e9-4dcb-87d1-d2d387f98453 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:21.886794 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d2dd816f-d5e9-4dcb-87d1-d2d387f98453 admin admin] Releasing vlan 134 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:48:21.887161 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d2dd816f-d5e9-4dcb-87d1-d2d387f98453 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:48:21.889228 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:48:21.913018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 7157a402-a8c8-4a68-89c3-6a746b91f0b8 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:48:21.942322 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-147a8475-8322-4b38-853f-58c34cb4d891 None None] Provisioning complete for port 73e149a2-b26b-481c-8db9-513f7c9378ca triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:21.942999 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-147a8475-8322-4b38-853f-58c34cb4d891 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:21.954008 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d2dd816f-d5e9-4dcb-87d1-d2d387f98453 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:21.964771 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d2dd816f-d5e9-4dcb-87d1-d2d387f98453 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:21.971210 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d2dd816f-d5e9-4dcb-87d1-d2d387f98453 admin admin] 10.222.0.13 "DELETE /v2.0/networks/b73f65be-f154-49a5-9107-5a71ab99f874 HTTP/1.1" status: 204 len: 168 time: 0.5485840 Dec 09 21:48:21.983959 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2dd816f-d5e9-4dcb-87d1-d2d387f98453 admin admin] Pushing event deleted for resources: {'Network': ['ID=b73f65be-f154-49a5-9107-5a71ab99f874,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:22.051187 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-147a8475-8322-4b38-853f-58c34cb4d891 None None] Port 73e149a2-b26b-481c-8db9-513f7c9378ca cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:48:22.095792 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4efdfe91-e109-4bf8-a7b8-df99be1d9671 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:22.140295 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:19Z', 'revision_number': 2, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:20Z', 'revision_number': 2, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:22.176123 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4efdfe91-e109-4bf8-a7b8-df99be1d9671 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Checking segment: {'id': 'd0a107fe-5f46-4b57-b092-aa8b3c02eed4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:48:22.176770 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4efdfe91-e109-4bf8-a7b8-df99be1d9671 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network hostable DHCP agents. Network: 7157a402-a8c8-4a68-89c3-6a746b91f0b8, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:48:22.181982 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] Checking router: 7e71b09c-215a-48ae-a557-15294dbfaea8 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:48:22.182342 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] Updating router 7e71b09c-215a-48ae-a557-15294dbfaea8 port 73e149a2-b26b-481c-8db9-513f7c9378ca binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:48:22.183735 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4efdfe91-e109-4bf8-a7b8-df99be1d9671 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Subnet': ['ID=e0712e86-903f-45d7-9973-f305f804bb68,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:22.202384 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4efdfe91-e109-4bf8-a7b8-df99be1d9671 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network 7157a402-a8c8-4a68-89c3-6a746b91f0b8 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:48:22.223505 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-4efdfe91-e109-4bf8-a7b8-df99be1d9671 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 7157a402-a8c8-4a68-89c3-6a746b91f0b8) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:48:22.228428 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4efdfe91-e109-4bf8-a7b8-df99be1d9671 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:22.229034 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4efdfe91-e109-4bf8-a7b8-df99be1d9671 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:22.239428 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3a36c78e-1027-4e8e-bbbd-e97e5b1587bc None None] Network 7157a402-a8c8-4a68-89c3-6a746b91f0b8 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:48:22.264046 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4efdfe91-e109-4bf8-a7b8-df99be1d9671 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.5583963 Dec 09 21:48:22.266360 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46080) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:22.269392 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:22.271205 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6759c3a2-25dc-4e50-8396-33d6150aafd2 None None] Provisioning complete for port 73e149a2-b26b-481c-8db9-513f7c9378ca triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:22.271579 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6759c3a2-25dc-4e50-8396-33d6150aafd2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:22.308230 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46082) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:22.366189 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-029ea071-a738-46e3-86e0-11f30ff95139 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=2be7af74c5cc43908a744820a98fc9c0&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0558126 Dec 09 21:48:22.366703 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46088) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:22.393594 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-6759c3a2-25dc-4e50-8396-33d6150aafd2 None None] Port 73e149a2-b26b-481c-8db9-513f7c9378ca cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:48:22.435134 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d7f5bda-88fc-454c-b8ab-78a1c36d730a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:22.443287 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-828d8086-cc42-4e85-b793-7c1c1c6800ed None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-7157a402-a8c8-4a68-89c3-6a746b91f0b8', 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8', 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'fixed_ips': [{'subnet_id': 'e0712e86-903f-45d7-9973-f305f804bb68'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:48:22.444710 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-828d8086-cc42-4e85-b793-7c1c1c6800ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:22.472439 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d7f5bda-88fc-454c-b8ab-78a1c36d730a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:22.530971 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d7f5bda-88fc-454c-b8ab-78a1c36d730a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:22.534762 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0d7f5bda-88fc-454c-b8ab-78a1c36d730a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:22.538430 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0d7f5bda-88fc-454c-b8ab-78a1c36d730a admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/6236a31a-7414-45a5-80b0-e5c8c72b2bb7 HTTP/1.1" status: 204 len: 168 time: 0.1696284 Dec 09 21:48:22.547563 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d7f5bda-88fc-454c-b8ab-78a1c36d730a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6236a31a-7414-45a5-80b0-e5c8c72b2bb7,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:22.764276 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-828d8086-cc42-4e85-b793-7c1c1c6800ed None None] Allocated IP 172.21.0.2 (7157a402-a8c8-4a68-89c3-6a746b91f0b8/e0712e86-903f-45d7-9973-f305f804bb68/9d964cdf-f61b-4ec8-bfff-05262402bab6) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:48:22.767929 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4525a6a4-a881-41fd-a15e-1f0ead028efc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:23.019618 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:23.032465 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device fc8c9273-f803-40e8-897e-6873cf824150 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:48:23.057629 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:23.123328 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46102) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:23.194316 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a361c7c8-1a9e-4134-88ba-595fc8a024ef admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=415299c407d24d04828310b7b5123d8e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0697694 Dec 09 21:48:23.197219 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46104) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:23.214257 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1210024-d898-4240-a1ae-2042d67375e5 None None] Pushing event updated for resources: {'Port': ['ID=73e149a2-b26b-481c-8db9-513f7c9378ca,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:23.268746 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port fc8c9273-f803-40e8-897e-6873cf824150 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:23.269123 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:23.287651 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e0060e4f-4791-4e17-a2b1-6a3ced5dc851 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:23.317859 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-828d8086-cc42-4e85-b793-7c1c1c6800ed None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:23.321317 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e0060e4f-4791-4e17-a2b1-6a3ced5dc851 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:23.334641 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] Attempting to bind port 73e149a2-b26b-481c-8db9-513f7c9378ca on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:48:23.335016 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] Attempting to bind port 73e149a2-b26b-481c-8db9-513f7c9378ca by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '9a21fac6-4e36-462c-a440-34e82f541369', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:48:23.335379 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] Attempting to bind port 73e149a2-b26b-481c-8db9-513f7c9378ca on network 4805df6a-c2c1-4270-aaf7-c9ee10b973d2 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:48:23.345549 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-828d8086-cc42-4e85-b793-7c1c1c6800ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:23.382006 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 48, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:48:23.382379 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] Checking segment: {'id': '9a21fac6-4e36-462c-a440-34e82f541369', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:48:23.382769 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:23.383168 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] Bound using segment: {'id': '9a21fac6-4e36-462c-a440-34e82f541369', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:48:23.383686 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] Bound port: 73e149a2-b26b-481c-8db9-513f7c9378ca, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '9a21fac6-4e36-462c-a440-34e82f541369', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:48:23.384064 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:23.415736 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-4525a6a4-a881-41fd-a15e-1f0ead028efc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Allocated IP 172.21.0.1 (7157a402-a8c8-4a68-89c3-6a746b91f0b8/e0712e86-903f-45d7-9973-f305f804bb68/11bdc2b0-5f2a-4359-a587-0f9370ce7b5a) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:48:23.430378 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-828d8086-cc42-4e85-b793-7c1c1c6800ed None None] Network 7157a402-a8c8-4a68-89c3-6a746b91f0b8 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:48:23.441695 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-828d8086-cc42-4e85-b793-7c1c1c6800ed None None] Pushing event updated for resources: {'Port': ['ID=9d964cdf-f61b-4ec8-bfff-05262402bab6,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:23.444333 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-828d8086-cc42-4e85-b793-7c1c1c6800ed None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:48:23.454254 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-828d8086-cc42-4e85-b793-7c1c1c6800ed None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:48:23.483842 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e0060e4f-4791-4e17-a2b1-6a3ced5dc851 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:23.486681 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e0060e4f-4791-4e17-a2b1-6a3ced5dc851 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:23.487885 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e0060e4f-4791-4e17-a2b1-6a3ced5dc851 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/c3aa8252-d7e2-4a7a-9601-432947e1db0d HTTP/1.1" status: 204 len: 168 time: 0.2895956 Dec 09 21:48:23.503775 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-bf6571d9-38fb-4d9c-a198-15e25919d341 None None] Provisioning complete for port 73e149a2-b26b-481c-8db9-513f7c9378ca triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:23.504153 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bf6571d9-38fb-4d9c-a198-15e25919d341 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:23.531702 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0060e4f-4791-4e17-a2b1-6a3ced5dc851 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c3aa8252-d7e2-4a7a-9601-432947e1db0d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:23.613564 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4525a6a4-a881-41fd-a15e-1f0ead028efc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:23.645241 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] For port 73e149a2-b26b-481c-8db9-513f7c9378ca, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:48:23.647220 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-bf6571d9-38fb-4d9c-a198-15e25919d341 None None] Port 73e149a2-b26b-481c-8db9-513f7c9378ca cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:48:23.660726 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-828d8086-cc42-4e85-b793-7c1c1c6800ed None None] Attempting to bind port 9d964cdf-f61b-4ec8-bfff-05262402bab6 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:48:23.661101 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-828d8086-cc42-4e85-b793-7c1c1c6800ed None None] Attempting to bind port 9d964cdf-f61b-4ec8-bfff-05262402bab6 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'd0a107fe-5f46-4b57-b092-aa8b3c02eed4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:48:23.661490 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-828d8086-cc42-4e85-b793-7c1c1c6800ed None None] Attempting to bind port 9d964cdf-f61b-4ec8-bfff-05262402bab6 on network 7157a402-a8c8-4a68-89c3-6a746b91f0b8 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:48:23.668391 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] For port 73e149a2-b26b-481c-8db9-513f7c9378ca, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=73e149a2-b26b-481c-8db9-513f7c9378ca,segment=NetworkSegment(9a21fac6-4e36-462c-a440-34e82f541369),segment_id=9a21fac6-4e36-462c-a440-34e82f541369)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:48:23.669974 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-828d8086-cc42-4e85-b793-7c1c1c6800ed None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 48, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:48:23.670351 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-828d8086-cc42-4e85-b793-7c1c1c6800ed None None] Checking segment: {'id': 'd0a107fe-5f46-4b57-b092-aa8b3c02eed4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:48:23.670794 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-828d8086-cc42-4e85-b793-7c1c1c6800ed None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:23.671206 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-828d8086-cc42-4e85-b793-7c1c1c6800ed None None] Bound using segment: {'id': 'd0a107fe-5f46-4b57-b092-aa8b3c02eed4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:48:23.671851 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-828d8086-cc42-4e85-b793-7c1c1c6800ed None None] Bound port: 9d964cdf-f61b-4ec8-bfff-05262402bab6, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd0a107fe-5f46-4b57-b092-aa8b3c02eed4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:48:23.672168 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-828d8086-cc42-4e85-b793-7c1c1c6800ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:23.684395 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:23.696811 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4525a6a4-a881-41fd-a15e-1f0ead028efc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:23.751550 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4525a6a4-a881-41fd-a15e-1f0ead028efc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network 7157a402-a8c8-4a68-89c3-6a746b91f0b8 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:48:23.754655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-4525a6a4-a881-41fd-a15e-1f0ead028efc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:48:23.757444 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4525a6a4-a881-41fd-a15e-1f0ead028efc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:48:23.800002 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4525a6a4-a881-41fd-a15e-1f0ead028efc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Port': ['ID=11bdc2b0-5f2a-4359-a587-0f9370ce7b5a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:23.801897 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] Routers {'7e71b09c-215a-48ae-a557-15294dbfaea8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:23.803052 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e71b09c-215a-48ae-a557-15294dbfaea8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:23.841115 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4525a6a4-a881-41fd-a15e-1f0ead028efc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:23.851995 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1210024-d898-4240-a1ae-2042d67375e5 None None] Pushing event updated for resources: {'Port': ['ID=73e149a2-b26b-481c-8db9-513f7c9378ca,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:23.921886 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-828d8086-cc42-4e85-b793-7c1c1c6800ed None None] For port 9d964cdf-f61b-4ec8-bfff-05262402bab6, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:48:23.927166 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-828d8086-cc42-4e85-b793-7c1c1c6800ed None None] For port 9d964cdf-f61b-4ec8-bfff-05262402bab6, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9d964cdf-f61b-4ec8-bfff-05262402bab6,segment=NetworkSegment(d0a107fe-5f46-4b57-b092-aa8b3c02eed4),segment_id=d0a107fe-5f46-4b57-b092-aa8b3c02eed4)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:48:23.943037 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-828d8086-cc42-4e85-b793-7c1c1c6800ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:24.056998 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4525a6a4-a881-41fd-a15e-1f0ead028efc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:24.287810 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-828d8086-cc42-4e85-b793-7c1c1c6800ed None None] Pushing event updated for resources: {'Port': ['ID=9d964cdf-f61b-4ec8-bfff-05262402bab6,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:24.297209 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] Set router 7e71b09c-215a-48ae-a557-15294dbfaea8 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:48:24.358049 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f037fbfb-1dba-410a-b673-ba2f4afd473a None None] Provisioning complete for port 73e149a2-b26b-481c-8db9-513f7c9378ca triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:24.358658 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f037fbfb-1dba-410a-b673-ba2f4afd473a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:24.369484 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4525a6a4-a881-41fd-a15e-1f0ead028efc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:24.381054 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4525a6a4-a881-41fd-a15e-1f0ead028efc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:24.486415 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4525a6a4-a881-41fd-a15e-1f0ead028efc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:24.499426 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4525a6a4-a881-41fd-a15e-1f0ead028efc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Port': ['ID=11bdc2b0-5f2a-4359-a587-0f9370ce7b5a,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:24.608720 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f037fbfb-1dba-410a-b673-ba2f4afd473a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:24.651576 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f037fbfb-1dba-410a-b673-ba2f4afd473a None None] For port 73e149a2-b26b-481c-8db9-513f7c9378ca, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=73e149a2-b26b-481c-8db9-513f7c9378ca,segment=NetworkSegment(9a21fac6-4e36-462c-a440-34e82f541369),segment_id=9a21fac6-4e36-462c-a440-34e82f541369)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:24.661489 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f037fbfb-1dba-410a-b673-ba2f4afd473a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:24.682348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4525a6a4-a881-41fd-a15e-1f0ead028efc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network 7157a402-a8c8-4a68-89c3-6a746b91f0b8 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:48:24.683983 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-4525a6a4-a881-41fd-a15e-1f0ead028efc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:48:24.705657 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:19Z', 'revision_number': 2, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:23Z', 'revision_number': 4, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:24.743876 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c4b5b06-3076-425e-9b33-4dd6a9af33e1 None None] The sync data for ids ['7e71b09c-215a-48ae-a557-15294dbfaea8'] in n-d-713301-27 is: [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:19Z', 'revision_number': 2, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:23Z', 'revision_number': 4, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:48:24.764841 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f037fbfb-1dba-410a-b673-ba2f4afd473a None None] Pushing event updated for resources: {'Port': ['ID=73e149a2-b26b-481c-8db9-513f7c9378ca,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:24.875344 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4525a6a4-a881-41fd-a15e-1f0ead028efc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Router 7e71b09c-215a-48ae-a557-15294dbfaea8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:48:24.998999 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4525a6a4-a881-41fd-a15e-1f0ead028efc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:48:25.009385 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4525a6a4-a881-41fd-a15e-1f0ead028efc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/routers/7e71b09c-215a-48ae-a557-15294dbfaea8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7416399 Dec 09 21:48:25.012885 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46148) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:25.018159 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-432322a9-76c6-49d7-a13f-63fd07efebed tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'network': {'name': 'tempest-RoutersTest-2028708582'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:48:25.050652 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-432322a9-76c6-49d7-a13f-63fd07efebed tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Made reservation on behalf of 99ff5f79d7574ab091d0707b5e01465a for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:48:25.059848 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-432322a9-76c6-49d7-a13f-63fd07efebed tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:25.118456 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-432322a9-76c6-49d7-a13f-63fd07efebed tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] vlan segment allocate from pool success with {'vlan_id': 139, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:48:25.128703 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-432322a9-76c6-49d7-a13f-63fd07efebed tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:25.129365 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-432322a9-76c6-49d7-a13f-63fd07efebed tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Added segment 2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec of type vlan for network 93df27df-5f0b-491b-9541-baba0f2a31ef Dec 09 21:48:25.210056 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-432322a9-76c6-49d7-a13f-63fd07efebed tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:25.259283 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-432322a9-76c6-49d7-a13f-63fd07efebed tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:25.268053 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-432322a9-76c6-49d7-a13f-63fd07efebed tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:25.268750 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-432322a9-76c6-49d7-a13f-63fd07efebed tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:25.327691 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-432322a9-76c6-49d7-a13f-63fd07efebed tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.3120055 Dec 09 21:48:25.329616 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46162) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:25.340327 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-25c483f6-f46a-4ad4-96e7-00206d7a19f3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'subnet': {'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef', 'cidr': '172.22.0.0/28', 'ip_version': 4, 'gateway_ip': '172.22.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:48:25.422373 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-432322a9-76c6-49d7-a13f-63fd07efebed tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Network': ['ID=93df27df-5f0b-491b-9541-baba0f2a31ef,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:25.451195 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 93df27df-5f0b-491b-9541-baba0f2a31ef details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:48:25.495068 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-25c483f6-f46a-4ad4-96e7-00206d7a19f3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Made reservation on behalf of 99ff5f79d7574ab091d0707b5e01465a for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:48:25.503806 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25c483f6-f46a-4ad4-96e7-00206d7a19f3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:26.064347 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e08c833b-bd06-4762-8c5e-9418c48bd83f None None] Network 7157a402-a8c8-4a68-89c3-6a746b91f0b8 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:48:26.193774 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-94100bb5-e741-4a47-9dc7-5e5da58ac2ce None None] Provisioning complete for port 9d964cdf-f61b-4ec8-bfff-05262402bab6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:26.194657 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-94100bb5-e741-4a47-9dc7-5e5da58ac2ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:26.323019 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25c483f6-f46a-4ad4-96e7-00206d7a19f3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:26.344892 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-94100bb5-e741-4a47-9dc7-5e5da58ac2ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:26.388596 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-94100bb5-e741-4a47-9dc7-5e5da58ac2ce None None] For port 9d964cdf-f61b-4ec8-bfff-05262402bab6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9d964cdf-f61b-4ec8-bfff-05262402bab6,segment=NetworkSegment(d0a107fe-5f46-4b57-b092-aa8b3c02eed4),segment_id=d0a107fe-5f46-4b57-b092-aa8b3c02eed4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:26.394107 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-94100bb5-e741-4a47-9dc7-5e5da58ac2ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:26.427840 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25c483f6-f46a-4ad4-96e7-00206d7a19f3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Subnet': ['ID=6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:26.436374 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-25c483f6-f46a-4ad4-96e7-00206d7a19f3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Checking segment: {'id': '2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:48:26.436867 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25c483f6-f46a-4ad4-96e7-00206d7a19f3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network hostable DHCP agents. Network: 93df27df-5f0b-491b-9541-baba0f2a31ef, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:48:26.471723 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-25c483f6-f46a-4ad4-96e7-00206d7a19f3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network 93df27df-5f0b-491b-9541-baba0f2a31ef is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:48:26.501479 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-25c483f6-f46a-4ad4-96e7-00206d7a19f3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 93df27df-5f0b-491b-9541-baba0f2a31ef) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:48:26.506001 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25c483f6-f46a-4ad4-96e7-00206d7a19f3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:26.506610 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25c483f6-f46a-4ad4-96e7-00206d7a19f3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:26.523943 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b0e4286-5abb-4ead-bd8f-9f3c4081a52e None None] Network 93df27df-5f0b-491b-9541-baba0f2a31ef requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:48:26.538424 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-25c483f6-f46a-4ad4-96e7-00206d7a19f3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.2071950 Dec 09 21:48:26.541195 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46192) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:26.586326 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94100bb5-e741-4a47-9dc7-5e5da58ac2ce None None] Pushing event updated for resources: {'Port': ['ID=9d964cdf-f61b-4ec8-bfff-05262402bab6,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:26.781605 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-005c17f6-c359-4331-a62d-b8bc01d62e66 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-93df27df-5f0b-491b-9541-baba0f2a31ef', 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef', 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'fixed_ips': [{'subnet_id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:48:26.783604 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-005c17f6-c359-4331-a62d-b8bc01d62e66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:26.932880 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-375acf40-8b3e-451b-aef6-6bc4dd0a81aa None None] Provisioning complete for port 9d964cdf-f61b-4ec8-bfff-05262402bab6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:26.933141 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-375acf40-8b3e-451b-aef6-6bc4dd0a81aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:27.041628 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 73e149a2-b26b-481c-8db9-513f7c9378ca up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:48:27.090738 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] Sync routers for ids ['7e71b09c-215a-48ae-a557-15294dbfaea8'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:48:27.110641 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] Routers {'7e71b09c-215a-48ae-a557-15294dbfaea8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:27.111284 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e71b09c-215a-48ae-a557-15294dbfaea8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:27.250400 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b1e4223e-11d8-45ba-99d2-9c204b086fe4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:27.367303 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-005c17f6-c359-4331-a62d-b8bc01d62e66 None None] Allocated IP 172.22.0.2 (93df27df-5f0b-491b-9541-baba0f2a31ef/6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2/9fe5af1d-8664-46a3-bbfc-9c1db8e1395d) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:48:27.382221 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] Set router 7e71b09c-215a-48ae-a557-15294dbfaea8 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:48:27.393032 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 73e149a2-b26b-481c-8db9-513f7c9378ca triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:27.393550 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:27.530984 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:27.541252 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:27.608535 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-375acf40-8b3e-451b-aef6-6bc4dd0a81aa None None] Provisioning complete for port 11bdc2b0-5f2a-4359-a587-0f9370ce7b5a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:27.610616 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-375acf40-8b3e-451b-aef6-6bc4dd0a81aa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:27.658866 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-375acf40-8b3e-451b-aef6-6bc4dd0a81aa None None] Port 11bdc2b0-5f2a-4359-a587-0f9370ce7b5a cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:48:27.733458 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 3, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '11bdc2b0-5f2a-4359-a587-0f9370ce7b5a', 'name': '', 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:d2:6c:3c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3515, 'fixed_ips': [{'subnet_id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:22Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 2, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:27.801810 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] Checking router: 7e71b09c-215a-48ae-a557-15294dbfaea8 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:48:27.802515 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] Updating router 7e71b09c-215a-48ae-a557-15294dbfaea8 port 11bdc2b0-5f2a-4359-a587-0f9370ce7b5a binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:48:27.815992 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9d964cdf-f61b-4ec8-bfff-05262402bab6 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:48:27.825090 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-de40a27e-cc1a-4fde-9e52-c3ed18e6a0ef None None] Provisioning complete for port 11bdc2b0-5f2a-4359-a587-0f9370ce7b5a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:27.825625 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-de40a27e-cc1a-4fde-9e52-c3ed18e6a0ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:27.866624 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:28.002712 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-de40a27e-cc1a-4fde-9e52-c3ed18e6a0ef None None] Port 11bdc2b0-5f2a-4359-a587-0f9370ce7b5a cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:48:28.006714 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-005c17f6-c359-4331-a62d-b8bc01d62e66 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:28.023744 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-005c17f6-c359-4331-a62d-b8bc01d62e66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:28.117533 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 9d964cdf-f61b-4ec8-bfff-05262402bab6 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:28.118067 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:28.123831 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-005c17f6-c359-4331-a62d-b8bc01d62e66 None None] Network 93df27df-5f0b-491b-9541-baba0f2a31ef is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:48:28.134153 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-005c17f6-c359-4331-a62d-b8bc01d62e66 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:48:28.137432 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-005c17f6-c359-4331-a62d-b8bc01d62e66 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:48:28.166048 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-b1e4223e-11d8-45ba-99d2-9c204b086fe4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Allocated IP 172.22.0.1 (93df27df-5f0b-491b-9541-baba0f2a31ef/6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2/ed19393b-280e-474a-862d-d457b64c10aa) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:48:28.178192 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-005c17f6-c359-4331-a62d-b8bc01d62e66 None None] Pushing event updated for resources: {'Port': ['ID=9fe5af1d-8664-46a3-bbfc-9c1db8e1395d,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:28.395184 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-005c17f6-c359-4331-a62d-b8bc01d62e66 None None] Attempting to bind port 9fe5af1d-8664-46a3-bbfc-9c1db8e1395d on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:48:28.396039 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-005c17f6-c359-4331-a62d-b8bc01d62e66 None None] Attempting to bind port 9fe5af1d-8664-46a3-bbfc-9c1db8e1395d by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:48:28.396628 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-005c17f6-c359-4331-a62d-b8bc01d62e66 None None] Attempting to bind port 9fe5af1d-8664-46a3-bbfc-9c1db8e1395d on network 93df27df-5f0b-491b-9541-baba0f2a31ef {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:48:28.425829 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-005c17f6-c359-4331-a62d-b8bc01d62e66 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 48, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:48:28.427328 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-005c17f6-c359-4331-a62d-b8bc01d62e66 None None] Checking segment: {'id': '2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:48:28.427995 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-005c17f6-c359-4331-a62d-b8bc01d62e66 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:28.431310 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-005c17f6-c359-4331-a62d-b8bc01d62e66 None None] Bound using segment: {'id': '2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:48:28.432096 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-005c17f6-c359-4331-a62d-b8bc01d62e66 None None] Bound port: 9fe5af1d-8664-46a3-bbfc-9c1db8e1395d, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:48:28.432728 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-005c17f6-c359-4331-a62d-b8bc01d62e66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:28.480917 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b1e4223e-11d8-45ba-99d2-9c204b086fe4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:28.574953 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b1e4223e-11d8-45ba-99d2-9c204b086fe4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:28.600866 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:28.608351 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:28.642999 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1e4223e-11d8-45ba-99d2-9c204b086fe4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Port': ['ID=ed19393b-280e-474a-862d-d457b64c10aa,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:28.653588 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1e4223e-11d8-45ba-99d2-9c204b086fe4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network 93df27df-5f0b-491b-9541-baba0f2a31ef is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:48:28.655454 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-b1e4223e-11d8-45ba-99d2-9c204b086fe4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:48:28.658276 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1e4223e-11d8-45ba-99d2-9c204b086fe4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:48:28.683634 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-909fa84f-0c9a-4a32-8566-a07e87804379 None None] Pushing event updated for resources: {'Port': ['ID=11bdc2b0-5f2a-4359-a587-0f9370ce7b5a,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:28.712983 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-005c17f6-c359-4331-a62d-b8bc01d62e66 None None] For port 9fe5af1d-8664-46a3-bbfc-9c1db8e1395d, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:48:28.726132 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-005c17f6-c359-4331-a62d-b8bc01d62e66 None None] For port 9fe5af1d-8664-46a3-bbfc-9c1db8e1395d, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9fe5af1d-8664-46a3-bbfc-9c1db8e1395d,segment=NetworkSegment(2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec),segment_id=2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:48:28.743799 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-005c17f6-c359-4331-a62d-b8bc01d62e66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:28.771268 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b1e4223e-11d8-45ba-99d2-9c204b086fe4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:28.850202 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] Attempting to bind port 11bdc2b0-5f2a-4359-a587-0f9370ce7b5a on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:48:28.851603 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] Attempting to bind port 11bdc2b0-5f2a-4359-a587-0f9370ce7b5a by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'd0a107fe-5f46-4b57-b092-aa8b3c02eed4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:48:28.852192 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] Attempting to bind port 11bdc2b0-5f2a-4359-a587-0f9370ce7b5a on network 7157a402-a8c8-4a68-89c3-6a746b91f0b8 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:48:28.860174 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 48, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:48:28.860980 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] Checking segment: {'id': 'd0a107fe-5f46-4b57-b092-aa8b3c02eed4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:48:28.861602 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:28.862213 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] Bound using segment: {'id': 'd0a107fe-5f46-4b57-b092-aa8b3c02eed4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:48:28.862909 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] Bound port: 11bdc2b0-5f2a-4359-a587-0f9370ce7b5a, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd0a107fe-5f46-4b57-b092-aa8b3c02eed4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 133, 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:48:28.863548 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:28.924159 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-005c17f6-c359-4331-a62d-b8bc01d62e66 None None] Pushing event updated for resources: {'Port': ['ID=9fe5af1d-8664-46a3-bbfc-9c1db8e1395d,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:29.004814 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] For port 11bdc2b0-5f2a-4359-a587-0f9370ce7b5a, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:48:29.013486 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] For port 11bdc2b0-5f2a-4359-a587-0f9370ce7b5a, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=11bdc2b0-5f2a-4359-a587-0f9370ce7b5a,segment=NetworkSegment(d0a107fe-5f46-4b57-b092-aa8b3c02eed4),segment_id=d0a107fe-5f46-4b57-b092-aa8b3c02eed4)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:48:29.022159 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:29.059617 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b1e4223e-11d8-45ba-99d2-9c204b086fe4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:29.112021 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-909fa84f-0c9a-4a32-8566-a07e87804379 None None] Pushing event updated for resources: {'Port': ['ID=11bdc2b0-5f2a-4359-a587-0f9370ce7b5a,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:29.144021 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] Routers {'7e71b09c-215a-48ae-a557-15294dbfaea8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:29.145020 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e71b09c-215a-48ae-a557-15294dbfaea8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:29.260893 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-760cc441-e447-4980-9ace-26efad8833fe None None] Provisioning complete for port 11bdc2b0-5f2a-4359-a587-0f9370ce7b5a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:29.261409 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-760cc441-e447-4980-9ace-26efad8833fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:29.506313 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-760cc441-e447-4980-9ace-26efad8833fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:29.561544 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b1e4223e-11d8-45ba-99d2-9c204b086fe4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:29.566683 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] Set router 7e71b09c-215a-48ae-a557-15294dbfaea8 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:48:29.576727 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b1e4223e-11d8-45ba-99d2-9c204b086fe4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:29.595983 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-760cc441-e447-4980-9ace-26efad8833fe None None] For port 11bdc2b0-5f2a-4359-a587-0f9370ce7b5a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=11bdc2b0-5f2a-4359-a587-0f9370ce7b5a,segment=NetworkSegment(d0a107fe-5f46-4b57-b092-aa8b3c02eed4),segment_id=d0a107fe-5f46-4b57-b092-aa8b3c02eed4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:29.606729 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-760cc441-e447-4980-9ace-26efad8833fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:29.678733 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b1e4223e-11d8-45ba-99d2-9c204b086fe4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:29.694261 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1e4223e-11d8-45ba-99d2-9c204b086fe4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Port': ['ID=ed19393b-280e-474a-862d-d457b64c10aa,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:29.721335 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-760cc441-e447-4980-9ace-26efad8833fe None None] Pushing event updated for resources: {'Port': ['ID=11bdc2b0-5f2a-4359-a587-0f9370ce7b5a,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:29.754417 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9737d460-ceaa-42b2-a293-d3119d32e7fd None None] Provisioning complete for port 11bdc2b0-5f2a-4359-a587-0f9370ce7b5a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:29.754792 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9737d460-ceaa-42b2-a293-d3119d32e7fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:29.822051 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1e4223e-11d8-45ba-99d2-9c204b086fe4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network 93df27df-5f0b-491b-9541-baba0f2a31ef is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:48:29.827472 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-b1e4223e-11d8-45ba-99d2-9c204b086fe4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:48:29.950268 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:28Z', 'revision_number': 4, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '11bdc2b0-5f2a-4359-a587-0f9370ce7b5a', 'name': '', 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:d2:6c:3c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3515, 'fixed_ips': [{'subnet_id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:22Z', 'updated_at': '2021-12-09T21:48:28Z', 'revision_number': 4, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed19393b-280e-474a-862d-d457b64c10aa', 'name': '', 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:b7:7c:10', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3520, 'fixed_ips': [{'subnet_id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:27Z', 'updated_at': '2021-12-09T21:48:28Z', 'revision_number': 1, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:29.966124 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b1e4223e-11d8-45ba-99d2-9c204b086fe4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Router 7e71b09c-215a-48ae-a557-15294dbfaea8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:48:30.061624 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff5a53d4-1553-4933-ae0a-14e9a7f2d893 None None] The sync data for ids ['7e71b09c-215a-48ae-a557-15294dbfaea8'] in n-d-713301-27 is: [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:28Z', 'revision_number': 4, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '11bdc2b0-5f2a-4359-a587-0f9370ce7b5a', 'name': '', 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:d2:6c:3c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3515, 'fixed_ips': [{'subnet_id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:22Z', 'updated_at': '2021-12-09T21:48:28Z', 'revision_number': 4, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed19393b-280e-474a-862d-d457b64c10aa', 'name': '', 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:b7:7c:10', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3520, 'fixed_ips': [{'subnet_id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:27Z', 'updated_at': '2021-12-09T21:48:28Z', 'revision_number': 1, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:48:30.145117 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b1e4223e-11d8-45ba-99d2-9c204b086fe4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:48:30.151730 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b1e4223e-11d8-45ba-99d2-9c204b086fe4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/routers/7e71b09c-215a-48ae-a557-15294dbfaea8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.6093454 Dec 09 21:48:30.154160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46232) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:30.160013 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-d411580c-2e9a-4506-a140-ddda88983ab1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'network': {'name': 'tempest-RoutersTest-1782472388'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:48:30.204911 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d411580c-2e9a-4506-a140-ddda88983ab1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Made reservation on behalf of 99ff5f79d7574ab091d0707b5e01465a for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:48:30.209497 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d411580c-2e9a-4506-a140-ddda88983ab1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:30.243975 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d411580c-2e9a-4506-a140-ddda88983ab1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] vlan segment allocate from pool success with {'vlan_id': 138, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:48:30.269615 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d411580c-2e9a-4506-a140-ddda88983ab1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:30.270022 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-d411580c-2e9a-4506-a140-ddda88983ab1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Added segment 2a82c2b3-5b40-4f6f-bf9b-ecc927595e10 of type vlan for network a609248b-3e8d-444f-b44a-50355066f72d Dec 09 21:48:30.337427 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d411580c-2e9a-4506-a140-ddda88983ab1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:30.423675 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d411580c-2e9a-4506-a140-ddda88983ab1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:30.433234 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d411580c-2e9a-4506-a140-ddda88983ab1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:30.434198 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d411580c-2e9a-4506-a140-ddda88983ab1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:30.554838 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d411580c-2e9a-4506-a140-ddda88983ab1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.3995612 Dec 09 21:48:30.559416 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46250) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:30.566357 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-d8b8829a-0457-4f5b-bc42-61a9f92d0fb3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'subnet': {'network_id': 'a609248b-3e8d-444f-b44a-50355066f72d', 'cidr': '172.23.0.0/28', 'ip_version': 4, 'gateway_ip': '172.23.0.1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:48:30.568079 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d411580c-2e9a-4506-a140-ddda88983ab1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Network': ['ID=a609248b-3e8d-444f-b44a-50355066f72d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:30.611233 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network a609248b-3e8d-444f-b44a-50355066f72d details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:48:30.765860 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2821331b-7251-415f-a129-71f7301232a3 None None] Network 93df27df-5f0b-491b-9541-baba0f2a31ef requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:48:30.814212 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d8b8829a-0457-4f5b-bc42-61a9f92d0fb3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Made reservation on behalf of 99ff5f79d7574ab091d0707b5e01465a for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:48:30.820571 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8b8829a-0457-4f5b-bc42-61a9f92d0fb3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:30.947775 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-05c147fb-2e4e-4b06-ab20-0e1b8186ed79 None None] Provisioning complete for port 9fe5af1d-8664-46a3-bbfc-9c1db8e1395d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:30.948528 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-05c147fb-2e4e-4b06-ab20-0e1b8186ed79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:31.168909 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 11bdc2b0-5f2a-4359-a587-0f9370ce7b5a up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:48:31.462234 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8b8829a-0457-4f5b-bc42-61a9f92d0fb3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:31.498780 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-05c147fb-2e4e-4b06-ab20-0e1b8186ed79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:31.544889 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3536e62c-df69-4c7f-9511-8b1a856ac0f9 req-3b181201-01a1-4e41-9345-c80b09b9920a tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:31.553153 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3536e62c-df69-4c7f-9511-8b1a856ac0f9 req-3b181201-01a1-4e41-9345-c80b09b9920a tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 1097 time: 0.1990039 Dec 09 21:48:31.576469 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 11bdc2b0-5f2a-4359-a587-0f9370ce7b5a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:31.576938 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:31.659007 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-05c147fb-2e4e-4b06-ab20-0e1b8186ed79 None None] For port 9fe5af1d-8664-46a3-bbfc-9c1db8e1395d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9fe5af1d-8664-46a3-bbfc-9c1db8e1395d,segment=NetworkSegment(2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec),segment_id=2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:31.671688 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-05c147fb-2e4e-4b06-ab20-0e1b8186ed79 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:31.701595 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3536e62c-df69-4c7f-9511-8b1a856ac0f9 req-17a9d2b2-529b-47b0-b550-875fb44095fe tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1403263 Dec 09 21:48:31.702343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8b8829a-0457-4f5b-bc42-61a9f92d0fb3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Subnet': ['ID=30fe26e6-a2ba-464c-a03f-3ae3a45b2df9,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:31.720050 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8b8829a-0457-4f5b-bc42-61a9f92d0fb3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Checking segment: {'id': '2a82c2b3-5b40-4f6f-bf9b-ecc927595e10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'a609248b-3e8d-444f-b44a-50355066f72d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:48:31.720419 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8b8829a-0457-4f5b-bc42-61a9f92d0fb3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network hostable DHCP agents. Network: a609248b-3e8d-444f-b44a-50355066f72d, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:48:31.754078 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8b8829a-0457-4f5b-bc42-61a9f92d0fb3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network a609248b-3e8d-444f-b44a-50355066f72d is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:48:31.786407 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-d8b8829a-0457-4f5b-bc42-61a9f92d0fb3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, a609248b-3e8d-444f-b44a-50355066f72d) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:48:31.786407 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8b8829a-0457-4f5b-bc42-61a9f92d0fb3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:31.786407 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8b8829a-0457-4f5b-bc42-61a9f92d0fb3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:31.790764 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-84debef3-37a8-4769-85e0-968e0eb71543 None None] Network a609248b-3e8d-444f-b44a-50355066f72d requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:48:31.860583 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d8b8829a-0457-4f5b-bc42-61a9f92d0fb3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 1.2996111 Dec 09 21:48:31.863534 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46268) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:31.870424 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05c147fb-2e4e-4b06-ab20-0e1b8186ed79 None None] Pushing event updated for resources: {'Port': ['ID=9fe5af1d-8664-46a3-bbfc-9c1db8e1395d,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:31.918398 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-709e74d8-0d91-400d-a6e2-e290351804f2 req-70e2a574-a2cd-49f5-a339-2042bd634e05 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:31.929429 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-709e74d8-0d91-400d-a6e2-e290351804f2 req-70e2a574-a2cd-49f5-a339-2042bd634e05 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 945 time: 0.1254056 Dec 09 21:48:31.987642 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9fe5af1d-8664-46a3-bbfc-9c1db8e1395d up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:48:32.070579 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-73271340-4078-4f38-8c5b-463abcca61e4 None None] Provisioning complete for port ed19393b-280e-474a-862d-d457b64c10aa triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:32.070958 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-73271340-4078-4f38-8c5b-463abcca61e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:32.071464 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-709e74d8-0d91-400d-a6e2-e290351804f2 req-37892dac-3279-456f-89ff-f2bda2fdcb1a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1404886 Dec 09 21:48:32.087487 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46276) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:32.299550 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bbfb2830-c9f7-4ba1-abfe-0ef485a1bf09 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/floatingips/3a029f47-0fde-479e-a9de-26b4149b4355 HTTP/1.1" status: 200 len: 993 time: 0.2014420 Dec 09 21:48:32.441197 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-73271340-4078-4f38-8c5b-463abcca61e4 None None] Port ed19393b-280e-474a-862d-d457b64c10aa cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:48:32.459185 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] Sync routers for ids ['7e71b09c-215a-48ae-a557-15294dbfaea8'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:48:32.482987 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] Routers {'7e71b09c-215a-48ae-a557-15294dbfaea8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:32.483703 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e71b09c-215a-48ae-a557-15294dbfaea8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:32.719878 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-73271340-4078-4f38-8c5b-463abcca61e4 None None] Provisioning complete for port 9fe5af1d-8664-46a3-bbfc-9c1db8e1395d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:32.719878 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-73271340-4078-4f38-8c5b-463abcca61e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:32.873578 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] Set router 7e71b09c-215a-48ae-a557-15294dbfaea8 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:48:32.910162 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a25d4b7-e1e7-4417-93aa-c0dcc8643cab tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:33.144855 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3677392-2f0d-49b5-b0e8-611e76aa42de None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-a609248b-3e8d-444f-b44a-50355066f72d', 'network_id': 'a609248b-3e8d-444f-b44a-50355066f72d', 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'fixed_ips': [{'subnet_id': '30fe26e6-a2ba-464c-a03f-3ae3a45b2df9'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:48:33.145858 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c3677392-2f0d-49b5-b0e8-611e76aa42de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:33.194961 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c17ce354-3b19-4de4-9af7-034d1ba78d89 req-d6048b65-6a3f-4cac-a936-3e12c636f46a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:33.197310 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c17ce354-3b19-4de4-9af7-034d1ba78d89 req-d6048b65-6a3f-4cac-a936-3e12c636f46a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 945 time: 0.1054645 Dec 09 21:48:33.269546 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c17ce354-3b19-4de4-9af7-034d1ba78d89 req-352cee6c-6464-4829-a980-6e0b85382cc4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0636680 Dec 09 21:48:33.301269 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7d07e02e-ff83-48ed-b5df-6643ce8a2a37 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:33.306318 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 9fe5af1d-8664-46a3-bbfc-9c1db8e1395d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:33.306838 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:33.462116 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-6ccc8cef-6fb2-4b00-bdce-7257172fed57 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.3025489 Dec 09 21:48:33.468634 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-8a25d4b7-e1e7-4417-93aa-c0dcc8643cab tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Allocated IP 172.23.0.1 (a609248b-3e8d-444f-b44a-50355066f72d/30fe26e6-a2ba-464c-a03f-3ae3a45b2df9/2a0584df-f1fb-4d50-9c7b-f61ed3b80a23) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:48:33.481417 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-902886fb-aae9-451e-9791-9f07b63dd2e7 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:48:33.482431 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-902886fb-aae9-451e-9791-9f07b63dd2e7 service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0115342 Dec 09 21:48:33.565019 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:28Z', 'revision_number': 4, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '11bdc2b0-5f2a-4359-a587-0f9370ce7b5a', 'name': '', 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:d2:6c:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3515, 'fixed_ips': [{'subnet_id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:22Z', 'updated_at': '2021-12-09T21:48:29Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed19393b-280e-474a-862d-d457b64c10aa', 'name': '', 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:b7:7c:10', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3520, 'fixed_ips': [{'subnet_id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:27Z', 'updated_at': '2021-12-09T21:48:29Z', 'revision_number': 2, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:33.605448 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] Checking router: 7e71b09c-215a-48ae-a557-15294dbfaea8 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:48:33.606038 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] Updating router 7e71b09c-215a-48ae-a557-15294dbfaea8 port ed19393b-280e-474a-862d-d457b64c10aa binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:48:33.665514 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:33.672611 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-cb330e84-31d0-4b7d-bf42-504bffe0157b None None] Provisioning complete for port ed19393b-280e-474a-862d-d457b64c10aa triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:33.673073 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cb330e84-31d0-4b7d-bf42-504bffe0157b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:33.728271 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a25d4b7-e1e7-4417-93aa-c0dcc8643cab tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:33.749123 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-cb330e84-31d0-4b7d-bf42-504bffe0157b None None] Port ed19393b-280e-474a-862d-d457b64c10aa cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:48:33.810140 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a25d4b7-e1e7-4417-93aa-c0dcc8643cab tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:33.899582 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a25d4b7-e1e7-4417-93aa-c0dcc8643cab tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network a609248b-3e8d-444f-b44a-50355066f72d is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:48:33.906552 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-8a25d4b7-e1e7-4417-93aa-c0dcc8643cab tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:48:33.910744 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8a25d4b7-e1e7-4417-93aa-c0dcc8643cab tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:48:33.951708 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-c3677392-2f0d-49b5-b0e8-611e76aa42de None None] Allocated IP 172.23.0.2 (a609248b-3e8d-444f-b44a-50355066f72d/30fe26e6-a2ba-464c-a03f-3ae3a45b2df9/2097cec5-5fee-4127-80ac-a97af581262d) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:48:33.953918 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a25d4b7-e1e7-4417-93aa-c0dcc8643cab tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Port': ['ID=2a0584df-f1fb-4d50-9c7b-f61ed3b80a23,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:34.005011 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a25d4b7-e1e7-4417-93aa-c0dcc8643cab tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:34.104926 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c3677392-2f0d-49b5-b0e8-611e76aa42de None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:34.107581 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9fe5af1d-8664-46a3-bbfc-9c1db8e1395d up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:48:34.160358 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c3677392-2f0d-49b5-b0e8-611e76aa42de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:34.235980 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c3677392-2f0d-49b5-b0e8-611e76aa42de None None] Network a609248b-3e8d-444f-b44a-50355066f72d is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:48:34.261553 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-c3677392-2f0d-49b5-b0e8-611e76aa42de None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:48:34.287836 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3677392-2f0d-49b5-b0e8-611e76aa42de None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:48:34.325373 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a25d4b7-e1e7-4417-93aa-c0dcc8643cab tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:34.482367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3677392-2f0d-49b5-b0e8-611e76aa42de None None] Pushing event updated for resources: {'Port': ['ID=2097cec5-5fee-4127-80ac-a97af581262d,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:34.487323 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-c3677392-2f0d-49b5-b0e8-611e76aa42de None None] Attempting to bind port 2097cec5-5fee-4127-80ac-a97af581262d on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:48:34.487714 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-c3677392-2f0d-49b5-b0e8-611e76aa42de None None] Attempting to bind port 2097cec5-5fee-4127-80ac-a97af581262d by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '2a82c2b3-5b40-4f6f-bf9b-ecc927595e10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'a609248b-3e8d-444f-b44a-50355066f72d'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:48:34.488074 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3677392-2f0d-49b5-b0e8-611e76aa42de None None] Attempting to bind port 2097cec5-5fee-4127-80ac-a97af581262d on network a609248b-3e8d-444f-b44a-50355066f72d {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:48:34.525090 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6ff27f1-aaf5-4963-88b4-f4b7510832ca req-c1426327-ff26-4746-8729-c270a246bbb2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:34.540371 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a6ff27f1-aaf5-4963-88b4-f4b7510832ca req-c1426327-ff26-4746-8729-c270a246bbb2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 945 time: 0.1368270 Dec 09 21:48:34.585306 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3677392-2f0d-49b5-b0e8-611e76aa42de None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 48, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:48:34.585755 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3677392-2f0d-49b5-b0e8-611e76aa42de None None] Checking segment: {'id': '2a82c2b3-5b40-4f6f-bf9b-ecc927595e10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'a609248b-3e8d-444f-b44a-50355066f72d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:48:34.586156 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c3677392-2f0d-49b5-b0e8-611e76aa42de None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:34.586551 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3677392-2f0d-49b5-b0e8-611e76aa42de None None] Bound using segment: {'id': '2a82c2b3-5b40-4f6f-bf9b-ecc927595e10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'a609248b-3e8d-444f-b44a-50355066f72d'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:48:34.587174 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-c3677392-2f0d-49b5-b0e8-611e76aa42de None None] Bound port: 2097cec5-5fee-4127-80ac-a97af581262d, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2a82c2b3-5b40-4f6f-bf9b-ecc927595e10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'a609248b-3e8d-444f-b44a-50355066f72d'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:48:34.587599 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c3677392-2f0d-49b5-b0e8-611e76aa42de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:34.613939 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a6ff27f1-aaf5-4963-88b4-f4b7510832ca req-7cc98530-e509-4c12-8f0c-12d9935f7a4c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0666833 Dec 09 21:48:34.624622 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 9fe5af1d-8664-46a3-bbfc-9c1db8e1395d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:34.624986 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:34.693184 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c3677392-2f0d-49b5-b0e8-611e76aa42de None None] For port 2097cec5-5fee-4127-80ac-a97af581262d, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:48:34.696537 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c3677392-2f0d-49b5-b0e8-611e76aa42de None None] For port 2097cec5-5fee-4127-80ac-a97af581262d, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2097cec5-5fee-4127-80ac-a97af581262d,segment=NetworkSegment(2a82c2b3-5b40-4f6f-bf9b-ecc927595e10),segment_id=2a82c2b3-5b40-4f6f-bf9b-ecc927595e10)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:48:34.723600 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c3677392-2f0d-49b5-b0e8-611e76aa42de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:34.789765 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3677392-2f0d-49b5-b0e8-611e76aa42de None None] Pushing event updated for resources: {'Port': ['ID=2097cec5-5fee-4127-80ac-a97af581262d,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:34.956514 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:34.969785 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:35.039336 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-095d9735-9e93-478d-be0b-9aac5fb129b7 None None] Pushing event updated for resources: {'Port': ['ID=ed19393b-280e-474a-862d-d457b64c10aa,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:35.179769 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] Attempting to bind port ed19393b-280e-474a-862d-d457b64c10aa on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:48:35.180180 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] Attempting to bind port ed19393b-280e-474a-862d-d457b64c10aa by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:48:35.181835 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] Attempting to bind port ed19393b-280e-474a-862d-d457b64c10aa on network 93df27df-5f0b-491b-9541-baba0f2a31ef {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:48:35.196958 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 48, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:48:35.197605 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] Checking segment: {'id': '2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:48:35.198209 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:35.199090 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] Bound using segment: {'id': '2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:48:35.199986 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] Bound port: ed19393b-280e-474a-862d-d457b64c10aa, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:48:35.200566 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:35.389537 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] For port ed19393b-280e-474a-862d-d457b64c10aa, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:48:35.393056 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] For port ed19393b-280e-474a-862d-d457b64c10aa, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=ed19393b-280e-474a-862d-d457b64c10aa,segment=NetworkSegment(2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec),segment_id=2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:48:35.403787 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:35.500529 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] Routers {'7e71b09c-215a-48ae-a557-15294dbfaea8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:35.501166 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e71b09c-215a-48ae-a557-15294dbfaea8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:35.684274 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-095d9735-9e93-478d-be0b-9aac5fb129b7 None None] Pushing event updated for resources: {'Port': ['ID=ed19393b-280e-474a-862d-d457b64c10aa,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:35.845731 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] Set router 7e71b09c-215a-48ae-a557-15294dbfaea8 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:48:35.984788 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-37a2e33d-6254-4021-b7ff-e256b7f7e93d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:35.988297 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-37a2e33d-6254-4021-b7ff-e256b7f7e93d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 1097 time: 0.2941074 Dec 09 21:48:36.023967 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65861969-d01b-4f5e-aaff-5676def82d15 req-c9d8646c-dbb9-4aa8-b047-511716f8a95f tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:36.039125 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-65861969-d01b-4f5e-aaff-5676def82d15 req-c9d8646c-dbb9-4aa8-b047-511716f8a95f tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 945 time: 0.1827803 Dec 09 21:48:36.041988 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2097cec5-5fee-4127-80ac-a97af581262d up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:48:36.044408 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca59f4cc-5562-4846-8bdd-6110cfb30384 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:36.064947 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a25d4b7-e1e7-4417-93aa-c0dcc8643cab tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:36.085927 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a25d4b7-e1e7-4417-93aa-c0dcc8643cab tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:36.116136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ea79874c-c0fd-4ce6-b3d6-5618fe3929e6 None None] Provisioning complete for port ed19393b-280e-474a-862d-d457b64c10aa triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:36.116492 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ea79874c-c0fd-4ce6-b3d6-5618fe3929e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:36.177007 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-65861969-d01b-4f5e-aaff-5676def82d15 req-8932f187-9add-4be1-8615-30eb63111e1f tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1366284 Dec 09 21:48:36.309469 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a25d4b7-e1e7-4417-93aa-c0dcc8643cab tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event updated for resources: {'Port': ['ID=2a0584df-f1fb-4d50-9c7b-f61ed3b80a23,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:36.381554 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8a25d4b7-e1e7-4417-93aa-c0dcc8643cab tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:36.415779 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-695ee8b2-de3a-4678-8233-723aa8010de1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:36.418458 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-695ee8b2-de3a-4678-8233-723aa8010de1 service neutron] 10.222.0.31 "GET /v2.0/networks?id=92500df7-83c8-4757-9b24-3ee4dfba2da3 HTTP/1.1" status: 200 len: 897 time: 0.4198008 Dec 09 21:48:36.653036 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-a150cc00-2e58-4f99-91bd-6bee88e4bc2c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3 HTTP/1.1" status: 200 len: 1001 time: 0.2092257 Dec 09 21:48:36.696716 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 2097cec5-5fee-4127-80ac-a97af581262d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:36.697094 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:36.744759 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8a25d4b7-e1e7-4417-93aa-c0dcc8643cab tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Network a609248b-3e8d-444f-b44a-50355066f72d is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:48:36.751914 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-8a25d4b7-e1e7-4417-93aa-c0dcc8643cab tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:48:36.769814 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-4700253c-9456-4a0b-9010-1930e9d262dd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:36.771608 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-4700253c-9456-4a0b-9010-1930e9d262dd service neutron] 10.222.0.31 "GET /v2.0/subnets?id=13dde2f9-0dfd-4600-912c-44b7903e3595 HTTP/1.1" status: 200 len: 835 time: 0.1104910 Dec 09 21:48:36.824310 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c32f15c0-0f7e-4e33-a632-d245a10e0fbf None None] Network a609248b-3e8d-444f-b44a-50355066f72d requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:48:36.931140 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-f0c872ba-052d-4517-9eca-144646d3500c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:36.936742 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:36.937921 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-f0c872ba-052d-4517-9eca-144646d3500c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=92500df7-83c8-4757-9b24-3ee4dfba2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1255744 Dec 09 21:48:36.951651 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-be5f18bb-5e56-4daf-bb5a-21265d517a51 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:48:36.959727 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-be5f18bb-5e56-4daf-bb5a-21265d517a51 service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0123968 Dec 09 21:48:36.980643 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ea79874c-c0fd-4ce6-b3d6-5618fe3929e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:37.017964 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8a25d4b7-e1e7-4417-93aa-c0dcc8643cab tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Router 7e71b09c-215a-48ae-a557-15294dbfaea8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:48:37.066206 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:37.084933 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:34Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '11bdc2b0-5f2a-4359-a587-0f9370ce7b5a', 'name': '', 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:d2:6c:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3515, 'fixed_ips': [{'subnet_id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:22Z', 'updated_at': '2021-12-09T21:48:29Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '2a0584df-f1fb-4d50-9c7b-f61ed3b80a23', 'name': '', 'network_id': 'a609248b-3e8d-444f-b44a-50355066f72d', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:23:96:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3524, 'fixed_ips': [{'subnet_id': '30fe26e6-a2ba-464c-a03f-3ae3a45b2df9', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:33Z', 'updated_at': '2021-12-09T21:48:33Z', 'revision_number': 1, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '30fe26e6-a2ba-464c-a03f-3ae3a45b2df9', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed19393b-280e-474a-862d-d457b64c10aa', 'name': '', 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:b7:7c:10', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3520, 'fixed_ips': [{'subnet_id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:27Z', 'updated_at': '2021-12-09T21:48:35Z', 'revision_number': 4, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:37.139856 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-682b5fa0-a18b-4e81-a189-2a701a6e0cd8 None None] The sync data for ids ['7e71b09c-215a-48ae-a557-15294dbfaea8'] in n-d-713301-27 is: [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:34Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '11bdc2b0-5f2a-4359-a587-0f9370ce7b5a', 'name': '', 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:d2:6c:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3515, 'fixed_ips': [{'subnet_id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:22Z', 'updated_at': '2021-12-09T21:48:29Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '2a0584df-f1fb-4d50-9c7b-f61ed3b80a23', 'name': '', 'network_id': 'a609248b-3e8d-444f-b44a-50355066f72d', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:23:96:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3524, 'fixed_ips': [{'subnet_id': '30fe26e6-a2ba-464c-a03f-3ae3a45b2df9', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:33Z', 'updated_at': '2021-12-09T21:48:33Z', 'revision_number': 1, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '30fe26e6-a2ba-464c-a03f-3ae3a45b2df9', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed19393b-280e-474a-862d-d457b64c10aa', 'name': '', 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:b7:7c:10', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3520, 'fixed_ips': [{'subnet_id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:27Z', 'updated_at': '2021-12-09T21:48:35Z', 'revision_number': 4, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:48:37.151273 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ea79874c-c0fd-4ce6-b3d6-5618fe3929e6 None None] For port ed19393b-280e-474a-862d-d457b64c10aa, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=ed19393b-280e-474a-862d-d457b64c10aa,segment=NetworkSegment(2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec),segment_id=2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:37.165677 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ea79874c-c0fd-4ce6-b3d6-5618fe3929e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:37.266270 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea79874c-c0fd-4ce6-b3d6-5618fe3929e6 None None] Pushing event updated for resources: {'Port': ['ID=ed19393b-280e-474a-862d-d457b64c10aa,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:37.271553 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 2097cec5-5fee-4127-80ac-a97af581262d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2097cec5-5fee-4127-80ac-a97af581262d,segment=NetworkSegment(2a82c2b3-5b40-4f6f-bf9b-ecc927595e10),segment_id=2a82c2b3-5b40-4f6f-bf9b-ecc927595e10)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:37.277120 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:37.353987 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ab13ac32-679a-4304-940e-c221837edc88 None None] Provisioning complete for port ed19393b-280e-474a-862d-d457b64c10aa triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:37.354810 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ab13ac32-679a-4304-940e-c221837edc88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:37.359955 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=2097cec5-5fee-4127-80ac-a97af581262d,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:37.406810 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfc5329c-4fec-4f81-85d8-ddd64e7fb734 req-b687e4b7-e7ac-4252-bcbc-093a1278f6e1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:37.415057 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfc5329c-4fec-4f81-85d8-ddd64e7fb734 req-b687e4b7-e7ac-4252-bcbc-093a1278f6e1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 945 time: 0.0972750 Dec 09 21:48:37.468050 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8a25d4b7-e1e7-4417-93aa-c0dcc8643cab tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:48:37.486305 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8a25d4b7-e1e7-4417-93aa-c0dcc8643cab tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/routers/7e71b09c-215a-48ae-a557-15294dbfaea8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.6215966 Dec 09 21:48:37.491196 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46380) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:37.503374 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ab5730e2-e413-4507-b14c-155c2509c77a tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'router': {'routes': [{'nexthop': '172.20.0.2', 'destination': '172.20.0.0/28'}, {'nexthop': '172.21.0.2', 'destination': '172.21.0.0/28'}, {'nexthop': '172.22.0.2', 'destination': '172.22.0.0/28'}, {'nexthop': '172.23.0.2', 'destination': '172.23.0.0/28'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:48:37.529241 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ab13ac32-679a-4304-940e-c221837edc88 None None] Provisioning complete for port 2097cec5-5fee-4127-80ac-a97af581262d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:37.529768 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ab13ac32-679a-4304-940e-c221837edc88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:37.544165 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfc5329c-4fec-4f81-85d8-ddd64e7fb734 req-3d8f72da-0338-4d58-a8f7-18fb320c68bd tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1280801 Dec 09 21:48:37.858984 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-93ed982f-b8b9-4ea3-ad0f-c6aaffb8cf7f None None] Provisioning complete for port 2a0584df-f1fb-4d50-9c7b-f61ed3b80a23 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:37.859376 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-93ed982f-b8b9-4ea3-ad0f-c6aaffb8cf7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:37.938488 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-205e20c9-abbc-42f1-85bf-55c7c39137ea service neutron] 10.222.0.31 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9710498 Dec 09 21:48:37.940554 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device ed19393b-280e-474a-862d-d457b64c10aa up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:48:38.043616 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-93ed982f-b8b9-4ea3-ad0f-c6aaffb8cf7f None None] Port 2a0584df-f1fb-4d50-9c7b-f61ed3b80a23 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:48:38.073088 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:38.116124 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-93ed982f-b8b9-4ea3-ad0f-c6aaffb8cf7f None None] Provisioning complete for port 2097cec5-5fee-4127-80ac-a97af581262d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:38.116786 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-93ed982f-b8b9-4ea3-ad0f-c6aaffb8cf7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:38.205788 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port ed19393b-280e-474a-862d-d457b64c10aa triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:38.206166 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:38.518197 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2097cec5-5fee-4127-80ac-a97af581262d up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:48:38.630906 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d4b934ce-cd5e-419c-ac9f-f66bbae5b892 None None] Provisioning complete for port 2a0584df-f1fb-4d50-9c7b-f61ed3b80a23 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:38.631281 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d4b934ce-cd5e-419c-ac9f-f66bbae5b892 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:38.634503 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 2097cec5-5fee-4127-80ac-a97af581262d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:38.635236 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:38.678501 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.extraroute_db [None req-ab5730e2-e413-4507-b14c-155c2509c77a tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Added routes are [{'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}] {{(pid=103437) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Dec 09 21:48:38.703609 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] Sync routers for ids ['7e71b09c-215a-48ae-a557-15294dbfaea8'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:48:38.716270 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.extraroute_db [None req-ab5730e2-e413-4507-b14c-155c2509c77a tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Removed routes are [] {{(pid=103437) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Dec 09 21:48:38.716998 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ab5730e2-e413-4507-b14c-155c2509c77a tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:38.722750 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] Routers {'7e71b09c-215a-48ae-a557-15294dbfaea8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:38.723418 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e71b09c-215a-48ae-a557-15294dbfaea8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:38.741542 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d4b934ce-cd5e-419c-ac9f-f66bbae5b892 None None] Port 2a0584df-f1fb-4d50-9c7b-f61ed3b80a23 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:48:38.760460 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b74f0f13-3dcb-4cb1-87c4-204689ec4405 req-12a99081-535f-4d92-a798-d1a695f8aea5 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:38.771779 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b74f0f13-3dcb-4cb1-87c4-204689ec4405 req-12a99081-535f-4d92-a798-d1a695f8aea5 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 945 time: 0.1206949 Dec 09 21:48:38.885962 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-7d823c1f-e37a-476b-a514-4913e59799b6 service neutron] 10.222.0.31 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.9376633 Dec 09 21:48:38.905487 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b74f0f13-3dcb-4cb1-87c4-204689ec4405 req-540f9ae3-f5c0-444f-a7e9-ea07f28ec4bc tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1294901 Dec 09 21:48:39.044630 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] Set router 7e71b09c-215a-48ae-a557-15294dbfaea8 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:48:39.178065 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ab5730e2-e413-4507-b14c-155c2509c77a tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:39.181983 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ab5730e2-e413-4507-b14c-155c2509c77a tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-640457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-640448', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-635166'] for router, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:39.303874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9df1a2c-8c47-4422-b32a-ebefdad4c295 req-1b917244-2cc2-4dcf-9492-b44c6ec160a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:39.305746 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a9df1a2c-8c47-4422-b32a-ebefdad4c295 req-1b917244-2cc2-4dcf-9492-b44c6ec160a5 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 1097 time: 0.1199846 Dec 09 21:48:39.488522 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ab5730e2-e413-4507-b14c-155c2509c77a tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Router 7e71b09c-215a-48ae-a557-15294dbfaea8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:48:39.563984 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:38Z', 'revision_number': 6, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '11bdc2b0-5f2a-4359-a587-0f9370ce7b5a', 'name': '', 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:d2:6c:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3515, 'fixed_ips': [{'subnet_id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:22Z', 'updated_at': '2021-12-09T21:48:29Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '2a0584df-f1fb-4d50-9c7b-f61ed3b80a23', 'name': '', 'network_id': 'a609248b-3e8d-444f-b44a-50355066f72d', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:23:96:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3524, 'fixed_ips': [{'subnet_id': '30fe26e6-a2ba-464c-a03f-3ae3a45b2df9', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:33Z', 'updated_at': '2021-12-09T21:48:34Z', 'revision_number': 2, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '30fe26e6-a2ba-464c-a03f-3ae3a45b2df9', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed19393b-280e-474a-862d-d457b64c10aa', 'name': '', 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:b7:7c:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3520, 'fixed_ips': [{'subnet_id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:27Z', 'updated_at': '2021-12-09T21:48:37Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:39.612461 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] Checking router: 7e71b09c-215a-48ae-a557-15294dbfaea8 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:48:39.613105 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] Updating router 7e71b09c-215a-48ae-a557-15294dbfaea8 port 2a0584df-f1fb-4d50-9c7b-f61ed3b80a23 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:48:39.646433 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9df1a2c-8c47-4422-b32a-ebefdad4c295 req-41471262-2913-43ce-90d0-da274bc3be22 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:39.649152 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a9df1a2c-8c47-4422-b32a-ebefdad4c295 req-41471262-2913-43ce-90d0-da274bc3be22 service neutron] 10.222.0.31 "GET /v2.0/networks?id=92500df7-83c8-4757-9b24-3ee4dfba2da3 HTTP/1.1" status: 200 len: 897 time: 0.2911413 Dec 09 21:48:39.658678 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:39.659605 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:39.724501 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ab5730e2-e413-4507-b14c-155c2509c77a tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:48:39.753230 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ab5730e2-e413-4507-b14c-155c2509c77a tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:39.754524 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ab5730e2-e413-4507-b14c-155c2509c77a tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/routers/7e71b09c-215a-48ae-a557-15294dbfaea8 HTTP/1.1" status: 200 len: 933 time: 2.2582927 Dec 09 21:48:39.757202 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46414) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:39.758069 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a9df1a2c-8c47-4422-b32a-ebefdad4c295 req-6f17fb20-dd01-42dc-8b5a-69e6b073b2d4 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3 HTTP/1.1" status: 200 len: 1001 time: 0.1010525 Dec 09 21:48:39.856069 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9df1a2c-8c47-4422-b32a-ebefdad4c295 req-ccab1270-ad63-4698-b3e0-43fe64ebb543 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:39.858320 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a9df1a2c-8c47-4422-b32a-ebefdad4c295 req-ccab1270-ad63-4698-b3e0-43fe64ebb543 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=13dde2f9-0dfd-4600-912c-44b7903e3595 HTTP/1.1" status: 200 len: 835 time: 0.0826323 Dec 09 21:48:39.977777 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9df1a2c-8c47-4422-b32a-ebefdad4c295 req-4cdc07d5-6f79-49ea-ba70-571c56b2340b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:39.980375 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a9df1a2c-8c47-4422-b32a-ebefdad4c295 req-4cdc07d5-6f79-49ea-ba70-571c56b2340b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=92500df7-83c8-4757-9b24-3ee4dfba2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1106980 Dec 09 21:48:40.089617 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:40.097987 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a9df1a2c-8c47-4422-b32a-ebefdad4c295 req-304d2f38-e216-429e-a867-e41c0e2249cf service neutron] 10.222.0.31 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1063411 Dec 09 21:48:40.100113 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:40.237123 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] Attempting to bind port 2a0584df-f1fb-4d50-9c7b-f61ed3b80a23 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:48:40.237409 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] Attempting to bind port 2a0584df-f1fb-4d50-9c7b-f61ed3b80a23 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '2a82c2b3-5b40-4f6f-bf9b-ecc927595e10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'a609248b-3e8d-444f-b44a-50355066f72d'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:48:40.237777 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] Attempting to bind port 2a0584df-f1fb-4d50-9c7b-f61ed3b80a23 on network a609248b-3e8d-444f-b44a-50355066f72d {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:48:40.250090 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed73cf55-9997-4b14-8914-0944da4f681d None None] Pushing event updated for resources: {'Port': ['ID=2a0584df-f1fb-4d50-9c7b-f61ed3b80a23,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:40.267220 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed73cf55-9997-4b14-8914-0944da4f681d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:40.267623 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed73cf55-9997-4b14-8914-0944da4f681d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:40.267961 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed73cf55-9997-4b14-8914-0944da4f681d None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:40.268291 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed73cf55-9997-4b14-8914-0944da4f681d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:40.268618 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed73cf55-9997-4b14-8914-0944da4f681d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:40.270297 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed73cf55-9997-4b14-8914-0944da4f681d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:40.270636 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed73cf55-9997-4b14-8914-0944da4f681d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:40.270962 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed73cf55-9997-4b14-8914-0944da4f681d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:40.271284 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed73cf55-9997-4b14-8914-0944da4f681d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:40.271632 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed73cf55-9997-4b14-8914-0944da4f681d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:40.271952 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed73cf55-9997-4b14-8914-0944da4f681d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:40.272272 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed73cf55-9997-4b14-8914-0944da4f681d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:40.272586 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed73cf55-9997-4b14-8914-0944da4f681d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:40.279013 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 48, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:48:40.279584 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] Checking segment: {'id': '2a82c2b3-5b40-4f6f-bf9b-ecc927595e10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'a609248b-3e8d-444f-b44a-50355066f72d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:48:40.280570 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:40.280955 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] Bound using segment: {'id': '2a82c2b3-5b40-4f6f-bf9b-ecc927595e10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'a609248b-3e8d-444f-b44a-50355066f72d'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:48:40.281442 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] Bound port: 2a0584df-f1fb-4d50-9c7b-f61ed3b80a23, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2a82c2b3-5b40-4f6f-bf9b-ecc927595e10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'a609248b-3e8d-444f-b44a-50355066f72d'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:48:40.281822 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:40.297464 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a9df1a2c-8c47-4422-b32a-ebefdad4c295 req-034ea828-5bea-4509-bbca-2160f6319ad8 service neutron] 10.222.0.31 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1862695 Dec 09 21:48:40.400840 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] For port 2a0584df-f1fb-4d50-9c7b-f61ed3b80a23, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:48:40.406768 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] For port 2a0584df-f1fb-4d50-9c7b-f61ed3b80a23, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2a0584df-f1fb-4d50-9c7b-f61ed3b80a23,segment=NetworkSegment(2a82c2b3-5b40-4f6f-bf9b-ecc927595e10),segment_id=2a82c2b3-5b40-4f6f-bf9b-ecc927595e10)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:48:40.421090 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:40.477702 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b5a04232-9d10-407d-ae09-9a95daadefd1 None None] Provisioning complete for port 2a0584df-f1fb-4d50-9c7b-f61ed3b80a23 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:40.478324 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b5a04232-9d10-407d-ae09-9a95daadefd1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:40.553798 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] Routers {'7e71b09c-215a-48ae-a557-15294dbfaea8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:40.554475 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e71b09c-215a-48ae-a557-15294dbfaea8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:40.575156 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6490c71-30c8-4e61-9df9-0a1566534bc1 req-f1adaf4b-3c7c-4c0f-b38e-3d95d1f89c80 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:40.577331 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6490c71-30c8-4e61-9df9-0a1566534bc1 req-f1adaf4b-3c7c-4c0f-b38e-3d95d1f89c80 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 945 time: 0.1326559 Dec 09 21:48:40.654021 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b5a04232-9d10-407d-ae09-9a95daadefd1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:40.667589 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6490c71-30c8-4e61-9df9-0a1566534bc1 req-bb57d3b5-5f08-4240-bf03-ba7ec9220b0b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0807974 Dec 09 21:48:40.682807 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46440) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:40.687671 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-03f18162-102d-43f9-842d-4895678f7aa5 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'router': {'routes': None}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:48:40.720794 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-371f9814-6ff3-480e-8e27-455be87f66d0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/routers/7e71b09c-215a-48ae-a557-15294dbfaea8 HTTP/1.1" status: 200 len: 933 time: 0.9615092 Dec 09 21:48:40.775121 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-b5a04232-9d10-407d-ae09-9a95daadefd1 None None] For port 2a0584df-f1fb-4d50-9c7b-f61ed3b80a23, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2a0584df-f1fb-4d50-9c7b-f61ed3b80a23,segment=NetworkSegment(2a82c2b3-5b40-4f6f-bf9b-ecc927595e10),segment_id=2a82c2b3-5b40-4f6f-bf9b-ecc927595e10)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:40.785919 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b5a04232-9d10-407d-ae09-9a95daadefd1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:40.849802 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed73cf55-9997-4b14-8914-0944da4f681d None None] Pushing event updated for resources: {'Port': ['ID=2a0584df-f1fb-4d50-9c7b-f61ed3b80a23,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:40.892548 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] Set router 7e71b09c-215a-48ae-a557-15294dbfaea8 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:48:40.944389 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a7ec24ad-8c75-45fe-9723-b30e474ca06a None None] Provisioning complete for port 2a0584df-f1fb-4d50-9c7b-f61ed3b80a23 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:40.944389 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a7ec24ad-8c75-45fe-9723-b30e474ca06a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:40.944389 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5a04232-9d10-407d-ae09-9a95daadefd1 None None] Pushing event updated for resources: {'Port': ['ID=2a0584df-f1fb-4d50-9c7b-f61ed3b80a23,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:41.159872 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:48:41.321206 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:38Z', 'revision_number': 6, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '11bdc2b0-5f2a-4359-a587-0f9370ce7b5a', 'name': '', 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:d2:6c:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3515, 'fixed_ips': [{'subnet_id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:22Z', 'updated_at': '2021-12-09T21:48:29Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '2a0584df-f1fb-4d50-9c7b-f61ed3b80a23', 'name': '', 'network_id': 'a609248b-3e8d-444f-b44a-50355066f72d', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:23:96:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3524, 'fixed_ips': [{'subnet_id': '30fe26e6-a2ba-464c-a03f-3ae3a45b2df9', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:33Z', 'updated_at': '2021-12-09T21:48:40Z', 'revision_number': 4, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '30fe26e6-a2ba-464c-a03f-3ae3a45b2df9', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed19393b-280e-474a-862d-d457b64c10aa', 'name': '', 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:b7:7c:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3520, 'fixed_ips': [{'subnet_id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:27Z', 'updated_at': '2021-12-09T21:48:37Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:41.378541 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3dd92fa-7a3f-4cae-a2e8-0333db70fd0e None None] The sync data for ids ['7e71b09c-215a-48ae-a557-15294dbfaea8'] in n-d-713301-27 is: [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [{'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:38Z', 'revision_number': 6, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '11bdc2b0-5f2a-4359-a587-0f9370ce7b5a', 'name': '', 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:d2:6c:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3515, 'fixed_ips': [{'subnet_id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:22Z', 'updated_at': '2021-12-09T21:48:29Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '2a0584df-f1fb-4d50-9c7b-f61ed3b80a23', 'name': '', 'network_id': 'a609248b-3e8d-444f-b44a-50355066f72d', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:23:96:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3524, 'fixed_ips': [{'subnet_id': '30fe26e6-a2ba-464c-a03f-3ae3a45b2df9', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:33Z', 'updated_at': '2021-12-09T21:48:40Z', 'revision_number': 4, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '30fe26e6-a2ba-464c-a03f-3ae3a45b2df9', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed19393b-280e-474a-862d-d457b64c10aa', 'name': '', 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:b7:7c:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3520, 'fixed_ips': [{'subnet_id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:27Z', 'updated_at': '2021-12-09T21:48:37Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:48:41.505068 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.extraroute_db [None req-03f18162-102d-43f9-842d-4895678f7aa5 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Added routes are [] {{(pid=103437) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Dec 09 21:48:41.506259 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.extraroute_db [None req-03f18162-102d-43f9-842d-4895678f7aa5 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Removed routes are [{'destination': '172.22.0.0/28', 'nexthop': '172.22.0.2'}, {'destination': '172.21.0.0/28', 'nexthop': '172.21.0.2'}, {'destination': '172.20.0.0/28', 'nexthop': '172.20.0.2'}, {'destination': '172.23.0.0/28', 'nexthop': '172.23.0.2'}] {{(pid=103437) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Dec 09 21:48:41.551893 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03f18162-102d-43f9-842d-4895678f7aa5 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:41.777907 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f6e3510-002c-4ff4-91e8-e18435ebfa83 None None] Sync routers for ids ['7e71b09c-215a-48ae-a557-15294dbfaea8'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:48:41.797792 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f6e3510-002c-4ff4-91e8-e18435ebfa83 None None] Routers {'7e71b09c-215a-48ae-a557-15294dbfaea8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:41.806061 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6f6e3510-002c-4ff4-91e8-e18435ebfa83 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e71b09c-215a-48ae-a557-15294dbfaea8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:41.858719 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf6f1846-c7c9-4db3-b5d2-545574af3be7 req-37b4904a-92eb-4f87-98f2-b8edd475cc6e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:41.861067 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf6f1846-c7c9-4db3-b5d2-545574af3be7 req-37b4904a-92eb-4f87-98f2-b8edd475cc6e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 945 time: 0.0746474 Dec 09 21:48:41.903147 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2a0584df-f1fb-4d50-9c7b-f61ed3b80a23 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:48:41.965488 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bf6f1846-c7c9-4db3-b5d2-545574af3be7 req-c039fbb5-ac7e-4781-a627-9a36bd3ef1a8 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0961435 Dec 09 21:48:42.116368 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-6f6e3510-002c-4ff4-91e8-e18435ebfa83 None None] Set router 7e71b09c-215a-48ae-a557-15294dbfaea8 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:48:42.152945 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 2a0584df-f1fb-4d50-9c7b-f61ed3b80a23 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:42.153462 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:42.391789 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03f18162-102d-43f9-842d-4895678f7aa5 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:42.395967 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03f18162-102d-43f9-842d-4895678f7aa5 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-640457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-640448', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-635166'] for router, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:42.509524 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6f6e3510-002c-4ff4-91e8-e18435ebfa83 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:41Z', 'revision_number': 7, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '11bdc2b0-5f2a-4359-a587-0f9370ce7b5a', 'name': '', 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:d2:6c:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3515, 'fixed_ips': [{'subnet_id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:22Z', 'updated_at': '2021-12-09T21:48:29Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '2a0584df-f1fb-4d50-9c7b-f61ed3b80a23', 'name': '', 'network_id': 'a609248b-3e8d-444f-b44a-50355066f72d', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:23:96:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3524, 'fixed_ips': [{'subnet_id': '30fe26e6-a2ba-464c-a03f-3ae3a45b2df9', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:33Z', 'updated_at': '2021-12-09T21:48:40Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '30fe26e6-a2ba-464c-a03f-3ae3a45b2df9', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed19393b-280e-474a-862d-d457b64c10aa', 'name': '', 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:b7:7c:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3520, 'fixed_ips': [{'subnet_id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:27Z', 'updated_at': '2021-12-09T21:48:37Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:42.530810 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-03f18162-102d-43f9-842d-4895678f7aa5 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Router 7e71b09c-215a-48ae-a557-15294dbfaea8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:48:42.541852 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f6e3510-002c-4ff4-91e8-e18435ebfa83 None None] Checking router: 7e71b09c-215a-48ae-a557-15294dbfaea8 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:48:42.553016 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f6e3510-002c-4ff4-91e8-e18435ebfa83 None None] Routers {'7e71b09c-215a-48ae-a557-15294dbfaea8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:42.553633 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6f6e3510-002c-4ff4-91e8-e18435ebfa83 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e71b09c-215a-48ae-a557-15294dbfaea8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:42.678628 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-03f18162-102d-43f9-842d-4895678f7aa5 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:48:42.687632 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03f18162-102d-43f9-842d-4895678f7aa5 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:42.692064 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46482) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:42.698850 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-03f18162-102d-43f9-842d-4895678f7aa5 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/routers/7e71b09c-215a-48ae-a557-15294dbfaea8 HTTP/1.1" status: 200 len: 699 time: 2.0147667 Dec 09 21:48:42.833937 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46484) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:42.850460 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d7d3c4fe-fc09-40f5-bc80-8d8c0293c1d2 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/routers/7e71b09c-215a-48ae-a557-15294dbfaea8 HTTP/1.1" status: 200 len: 699 time: 0.1568909 Dec 09 21:48:42.909826 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-6f6e3510-002c-4ff4-91e8-e18435ebfa83 None None] Set router 7e71b09c-215a-48ae-a557-15294dbfaea8 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:48:43.202920 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b37846d-4e10-4f97-ba71-16f1b8227a55 req-d4c79900-853f-453f-9d00-0cd659364b8e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:43.211334 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b37846d-4e10-4f97-ba71-16f1b8227a55 req-d4c79900-853f-453f-9d00-0cd659364b8e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 945 time: 0.1454144 Dec 09 21:48:43.337111 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b37846d-4e10-4f97-ba71-16f1b8227a55 req-9495df04-8f1d-4fe8-a5b7-213ae64753df tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1144307 Dec 09 21:48:43.339352 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6f6e3510-002c-4ff4-91e8-e18435ebfa83 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:41Z', 'revision_number': 7, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '11bdc2b0-5f2a-4359-a587-0f9370ce7b5a', 'name': '', 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:d2:6c:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3515, 'fixed_ips': [{'subnet_id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:22Z', 'updated_at': '2021-12-09T21:48:29Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '2a0584df-f1fb-4d50-9c7b-f61ed3b80a23', 'name': '', 'network_id': 'a609248b-3e8d-444f-b44a-50355066f72d', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:23:96:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3524, 'fixed_ips': [{'subnet_id': '30fe26e6-a2ba-464c-a03f-3ae3a45b2df9', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:33Z', 'updated_at': '2021-12-09T21:48:40Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '30fe26e6-a2ba-464c-a03f-3ae3a45b2df9', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed19393b-280e-474a-862d-d457b64c10aa', 'name': '', 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:b7:7c:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3520, 'fixed_ips': [{'subnet_id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:27Z', 'updated_at': '2021-12-09T21:48:37Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:43.402165 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f6e3510-002c-4ff4-91e8-e18435ebfa83 None None] The sync data for ids ['7e71b09c-215a-48ae-a557-15294dbfaea8'] in n-d-713301-27 is: [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:41Z', 'revision_number': 7, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '11bdc2b0-5f2a-4359-a587-0f9370ce7b5a', 'name': '', 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:d2:6c:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3515, 'fixed_ips': [{'subnet_id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:22Z', 'updated_at': '2021-12-09T21:48:29Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '2a0584df-f1fb-4d50-9c7b-f61ed3b80a23', 'name': '', 'network_id': 'a609248b-3e8d-444f-b44a-50355066f72d', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:23:96:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3524, 'fixed_ips': [{'subnet_id': '30fe26e6-a2ba-464c-a03f-3ae3a45b2df9', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:33Z', 'updated_at': '2021-12-09T21:48:40Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '30fe26e6-a2ba-464c-a03f-3ae3a45b2df9', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed19393b-280e-474a-862d-d457b64c10aa', 'name': '', 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:b7:7c:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3520, 'fixed_ips': [{'subnet_id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:27Z', 'updated_at': '2021-12-09T21:48:37Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:48:43.501557 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ddeb709c-0ca1-46ef-ba5d-932ba14daf55 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:43.766071 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f00a7d20-2461-43a2-9c38-2f965dee8fe7 None None] Sync routers for ids ['7e71b09c-215a-48ae-a557-15294dbfaea8'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:48:43.788745 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f00a7d20-2461-43a2-9c38-2f965dee8fe7 None None] Routers {'7e71b09c-215a-48ae-a557-15294dbfaea8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:43.796694 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f00a7d20-2461-43a2-9c38-2f965dee8fe7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e71b09c-215a-48ae-a557-15294dbfaea8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:43.920019 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-ddeb709c-0ca1-46ef-ba5d-932ba14daf55 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting port 2a0584df-f1fb-4d50-9c7b-f61ed3b80a23 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:48:43.920563 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ddeb709c-0ca1-46ef-ba5d-932ba14daf55 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:44.055801 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-f00a7d20-2461-43a2-9c38-2f965dee8fe7 None None] Set router 7e71b09c-215a-48ae-a557-15294dbfaea8 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:48:44.092008 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-ddeb709c-0ca1-46ef-ba5d-932ba14daf55 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] For port 2a0584df-f1fb-4d50-9c7b-f61ed3b80a23, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2a0584df-f1fb-4d50-9c7b-f61ed3b80a23,segment=NetworkSegment(2a82c2b3-5b40-4f6f-bf9b-ecc927595e10),segment_id=2a82c2b3-5b40-4f6f-bf9b-ecc927595e10)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:44.093895 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ddeb709c-0ca1-46ef-ba5d-932ba14daf55 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:44.124354 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-ddeb709c-0ca1-46ef-ba5d-932ba14daf55 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Calling delete_port for 2a0584df-f1fb-4d50-9c7b-f61ed3b80a23 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:48:44.367836 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f00a7d20-2461-43a2-9c38-2f965dee8fe7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:41Z', 'revision_number': 7, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '11bdc2b0-5f2a-4359-a587-0f9370ce7b5a', 'name': '', 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:d2:6c:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3515, 'fixed_ips': [{'subnet_id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:22Z', 'updated_at': '2021-12-09T21:48:29Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '2a0584df-f1fb-4d50-9c7b-f61ed3b80a23', 'name': '', 'network_id': 'a609248b-3e8d-444f-b44a-50355066f72d', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:23:96:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3524, 'fixed_ips': [{'subnet_id': '30fe26e6-a2ba-464c-a03f-3ae3a45b2df9', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:33Z', 'updated_at': '2021-12-09T21:48:40Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '30fe26e6-a2ba-464c-a03f-3ae3a45b2df9', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed19393b-280e-474a-862d-d457b64c10aa', 'name': '', 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:b7:7c:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3520, 'fixed_ips': [{'subnet_id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:27Z', 'updated_at': '2021-12-09T21:48:37Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:44.402516 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f00a7d20-2461-43a2-9c38-2f965dee8fe7 None None] Checking router: 7e71b09c-215a-48ae-a557-15294dbfaea8 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:48:44.413668 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f00a7d20-2461-43a2-9c38-2f965dee8fe7 None None] Routers {'7e71b09c-215a-48ae-a557-15294dbfaea8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:44.414813 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f00a7d20-2461-43a2-9c38-2f965dee8fe7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e71b09c-215a-48ae-a557-15294dbfaea8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:44.487771 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ddeb709c-0ca1-46ef-ba5d-932ba14daf55 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:44.530940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f576541a-26f3-48c6-ac1b-946129625f5a req-4875203f-4a7e-4db2-9f68-d996f152cb29 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:44.552517 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f576541a-26f3-48c6-ac1b-946129625f5a req-4875203f-4a7e-4db2-9f68-d996f152cb29 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 945 time: 0.1046605 Dec 09 21:48:44.555549 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddeb709c-0ca1-46ef-ba5d-932ba14daf55 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Port': ['ID=2a0584df-f1fb-4d50-9c7b-f61ed3b80a23,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:44.617431 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-f00a7d20-2461-43a2-9c38-2f965dee8fe7 None None] Set router 7e71b09c-215a-48ae-a557-15294dbfaea8 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:48:44.682154 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f576541a-26f3-48c6-ac1b-946129625f5a req-829466fb-911b-49bf-be0c-5ac47da55b86 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1273599 Dec 09 21:48:44.950046 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ddeb709c-0ca1-46ef-ba5d-932ba14daf55 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:44.965014 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f00a7d20-2461-43a2-9c38-2f965dee8fe7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:41Z', 'revision_number': 7, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '11bdc2b0-5f2a-4359-a587-0f9370ce7b5a', 'name': '', 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:d2:6c:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3515, 'fixed_ips': [{'subnet_id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:22Z', 'updated_at': '2021-12-09T21:48:29Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '2a0584df-f1fb-4d50-9c7b-f61ed3b80a23', 'name': '', 'network_id': 'a609248b-3e8d-444f-b44a-50355066f72d', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:23:96:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3524, 'fixed_ips': [{'subnet_id': '30fe26e6-a2ba-464c-a03f-3ae3a45b2df9', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:33Z', 'updated_at': '2021-12-09T21:48:40Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '30fe26e6-a2ba-464c-a03f-3ae3a45b2df9', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed19393b-280e-474a-862d-d457b64c10aa', 'name': '', 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:b7:7c:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3520, 'fixed_ips': [{'subnet_id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:27Z', 'updated_at': '2021-12-09T21:48:37Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:45.001986 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f00a7d20-2461-43a2-9c38-2f965dee8fe7 None None] The sync data for ids ['7e71b09c-215a-48ae-a557-15294dbfaea8'] in n-d-713301-27 is: [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:41Z', 'revision_number': 7, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '11bdc2b0-5f2a-4359-a587-0f9370ce7b5a', 'name': '', 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:d2:6c:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3515, 'fixed_ips': [{'subnet_id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:22Z', 'updated_at': '2021-12-09T21:48:29Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '2a0584df-f1fb-4d50-9c7b-f61ed3b80a23', 'name': '', 'network_id': 'a609248b-3e8d-444f-b44a-50355066f72d', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:23:96:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3524, 'fixed_ips': [{'subnet_id': '30fe26e6-a2ba-464c-a03f-3ae3a45b2df9', 'ip_address': '172.23.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:33Z', 'updated_at': '2021-12-09T21:48:40Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '30fe26e6-a2ba-464c-a03f-3ae3a45b2df9', 'cidr': '172.23.0.0/28', 'gateway_ip': '172.23.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed19393b-280e-474a-862d-d457b64c10aa', 'name': '', 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:b7:7c:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3520, 'fixed_ips': [{'subnet_id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:27Z', 'updated_at': '2021-12-09T21:48:37Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:48:45.043306 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46522) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:45.280947 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8c461c6f-821e-4fc5-92f8-256ddc1764ff admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:45.351268 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ddeb709c-0ca1-46ef-ba5d-932ba14daf55 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Router 7e71b09c-215a-48ae-a557-15294dbfaea8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:48:45.430381 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8c461c6f-821e-4fc5-92f8-256ddc1764ff admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:45.441200 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8c461c6f-821e-4fc5-92f8-256ddc1764ff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:45.512329 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8c461c6f-821e-4fc5-92f8-256ddc1764ff admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=9bbf931cf2db41e9b85fab9be2e59ea5&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4669969 Dec 09 21:48:45.512550 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ddeb709c-0ca1-46ef-ba5d-932ba14daf55 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:48:45.514167 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46536) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:45.522801 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-38b2e3bc-5e8e-45b5-a48d-0fa1761aac59 None None] Sync routers for ids ['7e71b09c-215a-48ae-a557-15294dbfaea8'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:48:45.523856 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c461c6f-821e-4fc5-92f8-256ddc1764ff admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7ca5ebbd-b7ad-4ad8-9420-baa938d53884,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:45.530740 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ddeb709c-0ca1-46ef-ba5d-932ba14daf55 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/routers/7e71b09c-215a-48ae-a557-15294dbfaea8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6952651 Dec 09 21:48:45.533335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46538) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:45.552601 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38b2e3bc-5e8e-45b5-a48d-0fa1761aac59 None None] Routers {'7e71b09c-215a-48ae-a557-15294dbfaea8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:45.553505 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-38b2e3bc-5e8e-45b5-a48d-0fa1761aac59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e71b09c-215a-48ae-a557-15294dbfaea8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:45.597234 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b412096b-c3d7-4c9f-91d6-b9dec957345e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:45.600135 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-416e01d9-edc0-488e-a929-6be16e3c8499 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting subnet 30fe26e6-a2ba-464c-a03f-3ae3a45b2df9 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:48:45.603707 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-416e01d9-edc0-488e-a929-6be16e3c8499 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:45.626073 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b412096b-c3d7-4c9f-91d6-b9dec957345e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:45.655591 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-416e01d9-edc0-488e-a929-6be16e3c8499 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:45.698458 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-38b2e3bc-5e8e-45b5-a48d-0fa1761aac59 None None] Set router 7e71b09c-215a-48ae-a557-15294dbfaea8 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:48:45.710391 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b412096b-c3d7-4c9f-91d6-b9dec957345e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:45.713122 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b412096b-c3d7-4c9f-91d6-b9dec957345e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:45.715828 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b412096b-c3d7-4c9f-91d6-b9dec957345e admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/7ca5ebbd-b7ad-4ad8-9420-baa938d53884 HTTP/1.1" status: 204 len: 168 time: 0.1944749 Dec 09 21:48:45.745572 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b412096b-c3d7-4c9f-91d6-b9dec957345e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7ca5ebbd-b7ad-4ad8-9420-baa938d53884,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:45.802395 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-416e01d9-edc0-488e-a929-6be16e3c8499 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:45.928933 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-416e01d9-edc0-488e-a929-6be16e3c8499 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:46.030107 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-416e01d9-edc0-488e-a929-6be16e3c8499 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Subnet': ['ID=30fe26e6-a2ba-464c-a03f-3ae3a45b2df9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:46.053834 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-331132cc-b614-4d51-a3e6-5c463a6c3da9 req-6c1db70c-17f6-4781-95e6-7e2d26ecaefb tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:46.067829 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-331132cc-b614-4d51-a3e6-5c463a6c3da9 req-6c1db70c-17f6-4781-95e6-7e2d26ecaefb tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 945 time: 0.1979504 Dec 09 21:48:46.095895 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-416e01d9-edc0-488e-a929-6be16e3c8499 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:46.102298 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b26fb48-c48a-48e9-ae31-b25a9cc69893 None None] Network a609248b-3e8d-444f-b44a-50355066f72d requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:48:46.109950 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-416e01d9-edc0-488e-a929-6be16e3c8499 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/subnets/30fe26e6-a2ba-464c-a03f-3ae3a45b2df9 HTTP/1.1" status: 204 len: 168 time: 0.5754089 Dec 09 21:48:46.112787 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46546) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:46.236990 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-331132cc-b614-4d51-a3e6-5c463a6c3da9 req-f133e474-f285-4098-a34e-d0eabe94e7c5 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1658211 Dec 09 21:48:46.271007 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-38b2e3bc-5e8e-45b5-a48d-0fa1761aac59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:44Z', 'revision_number': 8, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '11bdc2b0-5f2a-4359-a587-0f9370ce7b5a', 'name': '', 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:d2:6c:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3515, 'fixed_ips': [{'subnet_id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:22Z', 'updated_at': '2021-12-09T21:48:29Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed19393b-280e-474a-862d-d457b64c10aa', 'name': '', 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:b7:7c:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3520, 'fixed_ips': [{'subnet_id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:27Z', 'updated_at': '2021-12-09T21:48:37Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:46.307786 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-38b2e3bc-5e8e-45b5-a48d-0fa1761aac59 None None] Checking router: 7e71b09c-215a-48ae-a557-15294dbfaea8 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:48:46.316876 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38b2e3bc-5e8e-45b5-a48d-0fa1761aac59 None None] Routers {'7e71b09c-215a-48ae-a557-15294dbfaea8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:46.317558 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-38b2e3bc-5e8e-45b5-a48d-0fa1761aac59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e71b09c-215a-48ae-a557-15294dbfaea8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:46.339587 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46550) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:46.345927 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86cb9e0f-1236-433c-b500-aa469dd108b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:46.362927 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c99f8e2a-8fd8-4329-951c-47bc12a283ac admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:46.368664 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f0e045a8-8b66-43c6-ab14-5f16aac9f320 None None] DHCP port deletion for a609248b-3e8d-444f-b44a-50355066f72d request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:48:46.473638 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-86cb9e0f-1236-433c-b500-aa469dd108b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting port 2097cec5-5fee-4127-80ac-a97af581262d {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:48:46.474067 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86cb9e0f-1236-433c-b500-aa469dd108b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:46.487457 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-38b2e3bc-5e8e-45b5-a48d-0fa1761aac59 None None] Set router 7e71b09c-215a-48ae-a557-15294dbfaea8 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:48:46.528638 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c99f8e2a-8fd8-4329-951c-47bc12a283ac admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:46.540306 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c99f8e2a-8fd8-4329-951c-47bc12a283ac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:46.633223 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c99f8e2a-8fd8-4329-951c-47bc12a283ac admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ae91a4352a16477cbc21542ba96c63ec&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2923088 Dec 09 21:48:46.641853 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46556) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:46.648302 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-86cb9e0f-1236-433c-b500-aa469dd108b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] For port 2097cec5-5fee-4127-80ac-a97af581262d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2097cec5-5fee-4127-80ac-a97af581262d,segment=NetworkSegment(2a82c2b3-5b40-4f6f-bf9b-ecc927595e10),segment_id=2a82c2b3-5b40-4f6f-bf9b-ecc927595e10)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:46.648512 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c99f8e2a-8fd8-4329-951c-47bc12a283ac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0482d971-cfc8-4d37-906e-4d9afd73cf24,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:46.649388 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86cb9e0f-1236-433c-b500-aa469dd108b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:46.680059 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-86cb9e0f-1236-433c-b500-aa469dd108b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Calling delete_port for 2097cec5-5fee-4127-80ac-a97af581262d owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:48:46.774112 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f077e575-2628-42c0-992d-79c21866d8c2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:46.781125 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f0e045a8-8b66-43c6-ab14-5f16aac9f320 None None] Deleting port 2097cec5-5fee-4127-80ac-a97af581262d {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:48:46.781820 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f0e045a8-8b66-43c6-ab14-5f16aac9f320 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:46.802557 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f077e575-2628-42c0-992d-79c21866d8c2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:46.824365 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-38b2e3bc-5e8e-45b5-a48d-0fa1761aac59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:44Z', 'revision_number': 8, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '11bdc2b0-5f2a-4359-a587-0f9370ce7b5a', 'name': '', 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:d2:6c:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3515, 'fixed_ips': [{'subnet_id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:22Z', 'updated_at': '2021-12-09T21:48:29Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed19393b-280e-474a-862d-d457b64c10aa', 'name': '', 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:b7:7c:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3520, 'fixed_ips': [{'subnet_id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:27Z', 'updated_at': '2021-12-09T21:48:37Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:46.890173 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-38b2e3bc-5e8e-45b5-a48d-0fa1761aac59 None None] The sync data for ids ['7e71b09c-215a-48ae-a557-15294dbfaea8'] in n-d-713301-27 is: [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:44Z', 'revision_number': 8, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '11bdc2b0-5f2a-4359-a587-0f9370ce7b5a', 'name': '', 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:d2:6c:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3515, 'fixed_ips': [{'subnet_id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:22Z', 'updated_at': '2021-12-09T21:48:29Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'ed19393b-280e-474a-862d-d457b64c10aa', 'name': '', 'network_id': '93df27df-5f0b-491b-9541-baba0f2a31ef', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:b7:7c:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3520, 'fixed_ips': [{'subnet_id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'ip_address': '172.22.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:27Z', 'updated_at': '2021-12-09T21:48:37Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': '6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2', 'cidr': '172.22.0.0/28', 'gateway_ip': '172.22.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:48:46.928569 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f0e045a8-8b66-43c6-ab14-5f16aac9f320 None None] For port 2097cec5-5fee-4127-80ac-a97af581262d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2097cec5-5fee-4127-80ac-a97af581262d,segment=NetworkSegment(2a82c2b3-5b40-4f6f-bf9b-ecc927595e10),segment_id=2a82c2b3-5b40-4f6f-bf9b-ecc927595e10)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:46.929018 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f0e045a8-8b66-43c6-ab14-5f16aac9f320 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:46.938592 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f077e575-2628-42c0-992d-79c21866d8c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:46.941879 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f077e575-2628-42c0-992d-79c21866d8c2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:46.945790 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f077e575-2628-42c0-992d-79c21866d8c2 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/0482d971-cfc8-4d37-906e-4d9afd73cf24 HTTP/1.1" status: 204 len: 168 time: 0.3004596 Dec 09 21:48:46.947699 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f0e045a8-8b66-43c6-ab14-5f16aac9f320 None None] Calling delete_port for 2097cec5-5fee-4127-80ac-a97af581262d owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:48:46.961105 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86cb9e0f-1236-433c-b500-aa469dd108b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:47.000479 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86cb9e0f-1236-433c-b500-aa469dd108b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Port': ['ID=2097cec5-5fee-4127-80ac-a97af581262d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:47.004508 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f077e575-2628-42c0-992d-79c21866d8c2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0482d971-cfc8-4d37-906e-4d9afd73cf24,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:47.009496 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86cb9e0f-1236-433c-b500-aa469dd108b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] No DVR routers for this DVR port 2097cec5-5fee-4127-80ac-a97af581262d on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:48:47.119355 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f0e045a8-8b66-43c6-ab14-5f16aac9f320 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:47.183154 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0e045a8-8b66-43c6-ab14-5f16aac9f320 None None] Pushing event deleted for resources: {'Port': ['ID=2097cec5-5fee-4127-80ac-a97af581262d,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:47.184184 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86cb9e0f-1236-433c-b500-aa469dd108b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:47.186764 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0e045a8-8b66-43c6-ab14-5f16aac9f320 None None] No DVR routers for this DVR port 2097cec5-5fee-4127-80ac-a97af581262d on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:48:47.211609 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0e045a8-8b66-43c6-ab14-5f16aac9f320 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:47.212570 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0e045a8-8b66-43c6-ab14-5f16aac9f320 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:47.213068 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0e045a8-8b66-43c6-ab14-5f16aac9f320 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:47.214032 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0e045a8-8b66-43c6-ab14-5f16aac9f320 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:47.214775 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0e045a8-8b66-43c6-ab14-5f16aac9f320 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:47.221028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0e045a8-8b66-43c6-ab14-5f16aac9f320 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:47.221435 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0e045a8-8b66-43c6-ab14-5f16aac9f320 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:47.221887 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-86cb9e0f-1236-433c-b500-aa469dd108b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a609248b-3e8d-444f-b44a-50355066f72d']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:47.222018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0e045a8-8b66-43c6-ab14-5f16aac9f320 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:47.222330 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0e045a8-8b66-43c6-ab14-5f16aac9f320 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:47.222671 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0e045a8-8b66-43c6-ab14-5f16aac9f320 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:47.223135 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0e045a8-8b66-43c6-ab14-5f16aac9f320 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:47.223488 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0e045a8-8b66-43c6-ab14-5f16aac9f320 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:47.223989 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0e045a8-8b66-43c6-ab14-5f16aac9f320 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:48:47.234468 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-86cb9e0f-1236-433c-b500-aa469dd108b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2a82c2b3-5b40-4f6f-bf9b-ecc927595e10') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:47.234777 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-86cb9e0f-1236-433c-b500-aa469dd108b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2a82c2b3-5b40-4f6f-bf9b-ecc927595e10') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:47.248322 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86cb9e0f-1236-433c-b500-aa469dd108b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:47.276160 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86cb9e0f-1236-433c-b500-aa469dd108b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:47.296558 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-86cb9e0f-1236-433c-b500-aa469dd108b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Releasing vlan 138 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:48:47.297864 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86cb9e0f-1236-433c-b500-aa469dd108b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:48:47.302931 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:48:47.416950 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86cb9e0f-1236-433c-b500-aa469dd108b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:47.438130 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86cb9e0f-1236-433c-b500-aa469dd108b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:47.454599 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-86cb9e0f-1236-433c-b500-aa469dd108b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/networks/a609248b-3e8d-444f-b44a-50355066f72d HTTP/1.1" status: 204 len: 168 time: 1.3404810 Dec 09 21:48:47.455951 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86cb9e0f-1236-433c-b500-aa469dd108b8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Network': ['ID=a609248b-3e8d-444f-b44a-50355066f72d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:47.458460 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46570) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:47.497146 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4630c079-c647-4222-8685-ef9442dd72a0 req-67420abb-5eda-4297-aede-0196cfb6cd8f tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:47.499290 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4630c079-c647-4222-8685-ef9442dd72a0 req-67420abb-5eda-4297-aede-0196cfb6cd8f tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 945 time: 0.1318944 Dec 09 21:48:47.528892 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46572) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:47.548783 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-428ddebf-fb42-4459-a4d5-510d6181a2d3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:47.725656 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-428ddebf-fb42-4459-a4d5-510d6181a2d3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:47.731158 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4630c079-c647-4222-8685-ef9442dd72a0 req-c508dfeb-490b-43a9-8656-376df8e38370 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2237477 Dec 09 21:48:47.736759 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-428ddebf-fb42-4459-a4d5-510d6181a2d3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:47.741185 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2097cec5-5fee-4127-80ac-a97af581262d no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:48:47.801411 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 2097cec5-5fee-4127-80ac-a97af581262d {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:48:47.802781 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-428ddebf-fb42-4459-a4d5-510d6181a2d3 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e266e338dc63422e8bab46ca4a615bfd&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2724886 Dec 09 21:48:47.803088 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2097cec5-5fee-4127-80ac-a97af581262d not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:48:47.804882 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46584) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:47.805010 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2a0584df-f1fb-4d50-9c7b-f61ed3b80a23 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:48:47.814974 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-428ddebf-fb42-4459-a4d5-510d6181a2d3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=279b8779-b21a-45cd-9f1a-ba01a20f243b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:47.863114 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 2a0584df-f1fb-4d50-9c7b-f61ed3b80a23 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:48:47.863338 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2a0584df-f1fb-4d50-9c7b-f61ed3b80a23 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:48:47.888667 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c6dba897-35ed-4962-8a24-0ed8c8f8a04d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:47.918124 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c6dba897-35ed-4962-8a24-0ed8c8f8a04d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:48.013292 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c6dba897-35ed-4962-8a24-0ed8c8f8a04d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:48.034190 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c6dba897-35ed-4962-8a24-0ed8c8f8a04d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:48.039362 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c6dba897-35ed-4962-8a24-0ed8c8f8a04d admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/279b8779-b21a-45cd-9f1a-ba01a20f243b HTTP/1.1" status: 204 len: 168 time: 0.2295163 Dec 09 21:48:48.071460 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6dba897-35ed-4962-8a24-0ed8c8f8a04d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=279b8779-b21a-45cd-9f1a-ba01a20f243b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:48.168293 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8bf77343-144b-4589-b0d9-c0624e1e76c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:48.451159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-8bf77343-144b-4589-b0d9-c0624e1e76c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting port ed19393b-280e-474a-862d-d457b64c10aa {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:48:48.452389 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8bf77343-144b-4589-b0d9-c0624e1e76c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:48.553775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-8bf77343-144b-4589-b0d9-c0624e1e76c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] For port ed19393b-280e-474a-862d-d457b64c10aa, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=ed19393b-280e-474a-862d-d457b64c10aa,segment=NetworkSegment(2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec),segment_id=2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:48.554136 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8bf77343-144b-4589-b0d9-c0624e1e76c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:48.568489 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-8bf77343-144b-4589-b0d9-c0624e1e76c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Calling delete_port for ed19393b-280e-474a-862d-d457b64c10aa owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:48:48.785413 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8bf77343-144b-4589-b0d9-c0624e1e76c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:48.818888 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bf77343-144b-4589-b0d9-c0624e1e76c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Port': ['ID=ed19393b-280e-474a-862d-d457b64c10aa,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:48.976633 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93b1028e-9943-4c08-a7d9-f0ad39eb8f19 req-6a83c48e-543d-4815-9ee9-0e20d7a4f6ab tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:48.979220 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-93b1028e-9943-4c08-a7d9-f0ad39eb8f19 req-6a83c48e-543d-4815-9ee9-0e20d7a4f6ab tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 945 time: 0.1012797 Dec 09 21:48:49.097001 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8bf77343-144b-4589-b0d9-c0624e1e76c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:49.097444 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-93b1028e-9943-4c08-a7d9-f0ad39eb8f19 req-508a196f-8546-4399-ba01-f39aa63b4acd tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1070738 Dec 09 21:48:49.388042 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8bf77343-144b-4589-b0d9-c0624e1e76c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Router 7e71b09c-215a-48ae-a557-15294dbfaea8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:48:49.491503 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8bf77343-144b-4589-b0d9-c0624e1e76c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:48:49.507377 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8bf77343-144b-4589-b0d9-c0624e1e76c6 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/routers/7e71b09c-215a-48ae-a557-15294dbfaea8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0472076 Dec 09 21:48:49.510818 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46636) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:49.514865 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51087396-0f02-4a7c-8f30-9e197a9c3c43 None None] Sync routers for ids ['7e71b09c-215a-48ae-a557-15294dbfaea8'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:48:49.564115 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51087396-0f02-4a7c-8f30-9e197a9c3c43 None None] Routers {'7e71b09c-215a-48ae-a557-15294dbfaea8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:49.564606 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-51087396-0f02-4a7c-8f30-9e197a9c3c43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e71b09c-215a-48ae-a557-15294dbfaea8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:49.606418 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-5ba8a1f3-8720-482a-9c6e-0f4efb5dd8e7 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting subnet 6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:48:49.617298 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ba8a1f3-8720-482a-9c6e-0f4efb5dd8e7 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:49.723797 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ba8a1f3-8720-482a-9c6e-0f4efb5dd8e7 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:49.761219 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-51087396-0f02-4a7c-8f30-9e197a9c3c43 None None] Set router 7e71b09c-215a-48ae-a557-15294dbfaea8 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:48:49.857329 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ba8a1f3-8720-482a-9c6e-0f4efb5dd8e7 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:49.937800 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ba8a1f3-8720-482a-9c6e-0f4efb5dd8e7 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:49.975690 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ba8a1f3-8720-482a-9c6e-0f4efb5dd8e7 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Subnet': ['ID=6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:49.978024 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ba8a1f3-8720-482a-9c6e-0f4efb5dd8e7 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:49.983180 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5ba8a1f3-8720-482a-9c6e-0f4efb5dd8e7 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/subnets/6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2 HTTP/1.1" status: 204 len: 168 time: 0.4703977 Dec 09 21:48:49.986265 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46658) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:49.988843 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ead8e7f-cea2-467c-905e-b133aec26bbc None None] Network 93df27df-5f0b-491b-9541-baba0f2a31ef requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:48:50.066795 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-51087396-0f02-4a7c-8f30-9e197a9c3c43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:48Z', 'revision_number': 9, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '11bdc2b0-5f2a-4359-a587-0f9370ce7b5a', 'name': '', 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:d2:6c:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3515, 'fixed_ips': [{'subnet_id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:22Z', 'updated_at': '2021-12-09T21:48:29Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:50.111689 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51087396-0f02-4a7c-8f30-9e197a9c3c43 None None] Checking router: 7e71b09c-215a-48ae-a557-15294dbfaea8 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:48:50.113614 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6b47aff-a9d8-41b3-9a44-93abc8d546d0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:50.127018 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51087396-0f02-4a7c-8f30-9e197a9c3c43 None None] Routers {'7e71b09c-215a-48ae-a557-15294dbfaea8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:50.127743 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-51087396-0f02-4a7c-8f30-9e197a9c3c43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e71b09c-215a-48ae-a557-15294dbfaea8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:50.181805 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c6b47aff-a9d8-41b3-9a44-93abc8d546d0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting port 9fe5af1d-8664-46a3-bbfc-9c1db8e1395d {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:48:50.182787 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6b47aff-a9d8-41b3-9a44-93abc8d546d0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:50.263538 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-51087396-0f02-4a7c-8f30-9e197a9c3c43 None None] Set router 7e71b09c-215a-48ae-a557-15294dbfaea8 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:48:50.300015 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-c6b47aff-a9d8-41b3-9a44-93abc8d546d0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] For port 9fe5af1d-8664-46a3-bbfc-9c1db8e1395d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9fe5af1d-8664-46a3-bbfc-9c1db8e1395d,segment=NetworkSegment(2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec),segment_id=2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:50.300292 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6b47aff-a9d8-41b3-9a44-93abc8d546d0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:50.335091 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-26caed74-eabd-4100-968a-c8ef81cd8e0c None None] DHCP port deletion for 93df27df-5f0b-491b-9541-baba0f2a31ef request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:48:50.339979 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c6b47aff-a9d8-41b3-9a44-93abc8d546d0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Calling delete_port for 9fe5af1d-8664-46a3-bbfc-9c1db8e1395d owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:48:50.411354 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddcb491a-9900-4faa-b0cf-8cc3e4c6524d req-845005ec-adb1-4307-adf5-8ac788e9cc9a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:50.413222 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ddcb491a-9900-4faa-b0cf-8cc3e4c6524d req-845005ec-adb1-4307-adf5-8ac788e9cc9a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 945 time: 0.1486986 Dec 09 21:48:50.436702 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-26caed74-eabd-4100-968a-c8ef81cd8e0c None None] Deleting port 9fe5af1d-8664-46a3-bbfc-9c1db8e1395d {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:48:50.437079 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-26caed74-eabd-4100-968a-c8ef81cd8e0c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:50.551681 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ddcb491a-9900-4faa-b0cf-8cc3e4c6524d req-ea7f18f0-e9c1-4480-82d9-4c522ca91152 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1262779 Dec 09 21:48:50.553346 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-51087396-0f02-4a7c-8f30-9e197a9c3c43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:48Z', 'revision_number': 9, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '11bdc2b0-5f2a-4359-a587-0f9370ce7b5a', 'name': '', 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:d2:6c:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3515, 'fixed_ips': [{'subnet_id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:22Z', 'updated_at': '2021-12-09T21:48:29Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:50.568586 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-26caed74-eabd-4100-968a-c8ef81cd8e0c None None] For port 9fe5af1d-8664-46a3-bbfc-9c1db8e1395d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9fe5af1d-8664-46a3-bbfc-9c1db8e1395d,segment=NetworkSegment(2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec),segment_id=2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:50.568974 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-26caed74-eabd-4100-968a-c8ef81cd8e0c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:50.604534 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-26caed74-eabd-4100-968a-c8ef81cd8e0c None None] Calling delete_port for 9fe5af1d-8664-46a3-bbfc-9c1db8e1395d owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:48:50.630013 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51087396-0f02-4a7c-8f30-9e197a9c3c43 None None] The sync data for ids ['7e71b09c-215a-48ae-a557-15294dbfaea8'] in n-d-713301-27 is: [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:48Z', 'revision_number': 9, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '11bdc2b0-5f2a-4359-a587-0f9370ce7b5a', 'name': '', 'network_id': '7157a402-a8c8-4a68-89c3-6a746b91f0b8', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:d2:6c:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3515, 'fixed_ips': [{'subnet_id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'ip_address': '172.21.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:22Z', 'updated_at': '2021-12-09T21:48:29Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'e0712e86-903f-45d7-9973-f305f804bb68', 'cidr': '172.21.0.0/28', 'gateway_ip': '172.21.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:48:50.849586 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-26caed74-eabd-4100-968a-c8ef81cd8e0c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:50.913514 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26caed74-eabd-4100-968a-c8ef81cd8e0c None None] No DVR routers for this DVR port 9fe5af1d-8664-46a3-bbfc-9c1db8e1395d on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:48:50.919901 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26caed74-eabd-4100-968a-c8ef81cd8e0c None None] Pushing event deleted for resources: {'Port': ['ID=9fe5af1d-8664-46a3-bbfc-9c1db8e1395d,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:51.235664 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-f66a26c5-20a9-45ff-a5cb-9ef3a2c518b1 service neutron] show failed (client error): The resource could not be found. Dec 09 21:48:51.236735 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-f66a26c5-20a9-45ff-a5cb-9ef3a2c518b1 service neutron] 10.222.0.31 "GET /v2.0/ports/165bd568-9d49-4f11-b8e1-eb1d0dc675b3/bindings/n-h2-713301-27 HTTP/1.1" status: 404 len: 381 time: 0.0937743 Dec 09 21:48:51.246332 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6b47aff-a9d8-41b3-9a44-93abc8d546d0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:51.280247 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6b47aff-a9d8-41b3-9a44-93abc8d546d0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Port': ['ID=9fe5af1d-8664-46a3-bbfc-9c1db8e1395d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:51.287480 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6b47aff-a9d8-41b3-9a44-93abc8d546d0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] No DVR routers for this DVR port 9fe5af1d-8664-46a3-bbfc-9c1db8e1395d on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:48:51.388436 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6b47aff-a9d8-41b3-9a44-93abc8d546d0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:51.409707 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-c6b47aff-a9d8-41b3-9a44-93abc8d546d0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['93df27df-5f0b-491b-9541-baba0f2a31ef']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:51.421221 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-c6b47aff-a9d8-41b3-9a44-93abc8d546d0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:51.421566 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-c6b47aff-a9d8-41b3-9a44-93abc8d546d0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2c93d1fb-4f7a-4dae-b58a-e8d86aa523ec') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:51.436245 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6b47aff-a9d8-41b3-9a44-93abc8d546d0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:51.450118 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6b47aff-a9d8-41b3-9a44-93abc8d546d0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:51.457764 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c6b47aff-a9d8-41b3-9a44-93abc8d546d0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Releasing vlan 139 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:48:51.458280 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6b47aff-a9d8-41b3-9a44-93abc8d546d0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: self.session.flush() Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: self.session.flush() Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: self.session.flush() Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: self.session.flush() Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:48:51.461532 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:48:51.524214 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-2a39cd9b-8885-49b9-8551-91b7af049c5d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:51.526838 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-2a39cd9b-8885-49b9-8551-91b7af049c5d service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232&tenant_id=dce7594ac2a74901912a2f19de04bf79 HTTP/1.1" status: 200 len: 1097 time: 0.0755086 Dec 09 21:48:51.528383 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6b47aff-a9d8-41b3-9a44-93abc8d546d0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:51.538691 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-83a97b92-dedd-4936-9b02-603c15da49a8 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:48:51.539677 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-83a97b92-dedd-4936-9b02-603c15da49a8 service neutron] 10.222.0.10 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0054536 Dec 09 21:48:51.546160 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6b47aff-a9d8-41b3-9a44-93abc8d546d0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:51.551999 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c6b47aff-a9d8-41b3-9a44-93abc8d546d0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/networks/93df27df-5f0b-491b-9541-baba0f2a31ef HTTP/1.1" status: 204 len: 168 time: 1.5619404 Dec 09 21:48:51.551999 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6b47aff-a9d8-41b3-9a44-93abc8d546d0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Network': ['ID=93df27df-5f0b-491b-9541-baba0f2a31ef,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:51.552239 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46674) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:51.553686 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] Request body: {'port': {'binding:host_id': 'n-h2-713301-27', 'device_owner': 'compute:nova'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:48:51.651695 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:51.727072 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device ed19393b-280e-474a-862d-d457b64c10aa no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:48:51.781925 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: ed19393b-280e-474a-862d-d457b64c10aa {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:48:51.782266 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device ed19393b-280e-474a-862d-d457b64c10aa not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:48:51.782676 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9fe5af1d-8664-46a3-bbfc-9c1db8e1395d no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:48:51.807532 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 9fe5af1d-8664-46a3-bbfc-9c1db8e1395d {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:48:51.807878 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9fe5af1d-8664-46a3-bbfc-9c1db8e1395d not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:48:51.850712 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43290a9d-802b-4c3b-b037-57352f97f533 req-e29d28c1-5334-448e-8380-a1712e3146d1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:51.852365 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43290a9d-802b-4c3b-b037-57352f97f533 req-e29d28c1-5334-448e-8380-a1712e3146d1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 945 time: 0.2148438 Dec 09 21:48:51.954665 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43290a9d-802b-4c3b-b037-57352f97f533 req-c1225773-5c7f-40fb-b070-76b4a1494d77 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0808735 Dec 09 21:48:52.016549 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-64a80dbb-b0bf-403b-be01-11c4f0dd4f25 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:52.077313 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] For port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,segment=NetworkSegment(0189efa9-02eb-4071-ae6f-aee6c867d035),segment_id=0189efa9-02eb-4071-ae6f-aee6c867d035)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:52.130243 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-57428bdf-02c0-4f0c-abfb-0ec5af0b6571 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=79cb26bbf252482b871bb8bb01655169&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0341759 Dec 09 21:48:52.179073 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] For port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:48:52.281211 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:48:52.283676 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-da6425b9-b82b-4686-83c1-af4c6405f2fd" -d '{"events": [{"server_uuid": "c9630177-3a8d-4c3a-8c62-dd93288c7232", "name": "network-vif-unplugged", "status": "completed", "tag": "165bd568-9d49-4f11-b8e1-eb1d0dc675b3"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:48:52.288137 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:52.318346 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] Transition to ACTIVE for port object 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:48:52.330630 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-84f8c9b6-329d-4b91-a4f8-92a4ace8e7b9 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:52.332433 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-84f8c9b6-329d-4b91-a4f8-92a4ace8e7b9 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1897707 Dec 09 21:48:52.333682 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:52.343057 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-64a80dbb-b0bf-403b-be01-11c4f0dd4f25 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting port 11bdc2b0-5f2a-4359-a587-0f9370ce7b5a {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:48:52.343998 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-64a80dbb-b0bf-403b-be01-11c4f0dd4f25 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:52.445995 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-04874ba9-89f7-4306-8445-50d6381df5fc tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/quotas/79cb26bbf252482b871bb8bb01655169 HTTP/1.1" status: 200 len: 375 time: 0.1034520 Dec 09 21:48:52.504275 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-64a80dbb-b0bf-403b-be01-11c4f0dd4f25 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] For port 11bdc2b0-5f2a-4359-a587-0f9370ce7b5a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=11bdc2b0-5f2a-4359-a587-0f9370ce7b5a,segment=NetworkSegment(d0a107fe-5f46-4b57-b092-aa8b3c02eed4),segment_id=d0a107fe-5f46-4b57-b092-aa8b3c02eed4)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:52.504567 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-64a80dbb-b0bf-403b-be01-11c4f0dd4f25 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:52.529860 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-64a80dbb-b0bf-403b-be01-11c4f0dd4f25 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Calling delete_port for 11bdc2b0-5f2a-4359-a587-0f9370ce7b5a owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:48:52.574326 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-4298f712-fe9a-4620-9127-f04e69e9e8f5 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=79cb26bbf252482b871bb8bb01655169&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0825064 Dec 09 21:48:52.590514 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] Pushing event updated for resources: {'Port': ['ID=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,revision_number=6']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:52.741632 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] No DVR routers for this DVR port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:48:52.874723 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-64a80dbb-b0bf-403b-be01-11c4f0dd4f25 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:52.919417 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a80dbb-b0bf-403b-be01-11c4f0dd4f25 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Port': ['ID=11bdc2b0-5f2a-4359-a587-0f9370ce7b5a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:52.999314 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:48:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2e9d5681-4eeb-4857-b303-9bfad59f9924 x-openstack-request-id: req-2e9d5681-4eeb-4857-b303-9bfad59f9924 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:48:52.999644 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c9630177-3a8d-4c3a-8c62-dd93288c7232", "name": "network-vif-unplugged", "status": "completed", "tag": "165bd568-9d49-4f11-b8e1-eb1d0dc675b3", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:48:53.000369 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-2e9d5681-4eeb-4857-b303-9bfad59f9924 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:48:53.000516 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3', 'code': 200} Dec 09 21:48:53.045095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] Attempting to bind port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:48:53.045546 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] Attempting to bind port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '0189efa9-02eb-4071-ae6f-aee6c867d035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:48:53.045878 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] Attempting to bind port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 on network 92500df7-83c8-4757-9b24-3ee4dfba2da3 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:48:53.053059 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] Port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 on network 92500df7-83c8-4757-9b24-3ee4dfba2da3 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:48:53.053375 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] Attempting to bind port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 on network 92500df7-83c8-4757-9b24-3ee4dfba2da3 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:48:53.059893 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 48, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:48:53.060231 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] Checking segment: {'id': '0189efa9-02eb-4071-ae6f-aee6c867d035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:48:53.060609 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] Bound using segment: {'id': '0189efa9-02eb-4071-ae6f-aee6c867d035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:48:53.061039 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] Bound port: 165bd568-9d49-4f11-b8e1-eb1d0dc675b3, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0189efa9-02eb-4071-ae6f-aee6c867d035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:48:53.061388 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:53.116548 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b3be85b0-6d2b-459c-a780-fcdfaeaf1a5c req-c4a4ebae-796c-42af-b1ec-3e7c3be5bea6 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/ports?device_id=c025d0be-fbd5-4014-9c13-3abc61aeda0f HTTP/1.1" status: 200 len: 210 time: 0.0650265 Dec 09 21:48:53.204893 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-64a80dbb-b0bf-403b-be01-11c4f0dd4f25 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:53.257716 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] For port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:48:53.263159 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] For port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,segment=NetworkSegment(0189efa9-02eb-4071-ae6f-aee6c867d035),segment_id=0189efa9-02eb-4071-ae6f-aee6c867d035)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:48:53.275172 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:53.360838 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:53.361469 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:53.362923 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] 10.222.0.10 "PUT /v2.0/ports/165bd568-9d49-4f11-b8e1-eb1d0dc675b3 HTTP/1.1" status: 200 len: 1092 time: 1.8136218 Dec 09 21:48:53.532399 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-64a80dbb-b0bf-403b-be01-11c4f0dd4f25 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Router 7e71b09c-215a-48ae-a557-15294dbfaea8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:48:53.660148 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-47759264-4933-4f3a-970f-d379e499fdf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:53.661666 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-47759264-4933-4f3a-970f-d379e499fdf3 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 1095 time: 0.2407944 Dec 09 21:48:53.662389 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28525168-c0fb-49af-a473-8b8dc6ad1aec service neutron] Pushing event updated for resources: {'Port': ['ID=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,revision_number=7']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:53.678486 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccd9960b-ec6c-4874-ba75-cf83fc3aad00 req-505aa1dc-e989-45df-b354-763973690a3b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:53.686481 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ccd9960b-ec6c-4874-ba75-cf83fc3aad00 req-505aa1dc-e989-45df-b354-763973690a3b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 943 time: 0.4135652 Dec 09 21:48:53.754124 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-64a80dbb-b0bf-403b-be01-11c4f0dd4f25 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:48:53.779964 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3747ff21-ab20-4eac-aa54-80df4d74f215 None None] Sync routers for ids ['7e71b09c-215a-48ae-a557-15294dbfaea8'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:48:53.784449 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-64a80dbb-b0bf-403b-be01-11c4f0dd4f25 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/routers/7e71b09c-215a-48ae-a557-15294dbfaea8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2291663 Dec 09 21:48:53.785424 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46736) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:53.836821 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3747ff21-ab20-4eac-aa54-80df4d74f215 None None] Routers {'7e71b09c-215a-48ae-a557-15294dbfaea8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:53.840813 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-3747ff21-ab20-4eac-aa54-80df4d74f215 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e71b09c-215a-48ae-a557-15294dbfaea8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:53.866849 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ccd9960b-ec6c-4874-ba75-cf83fc3aad00 req-7c702bc2-30ef-4f23-9b24-e4f468174944 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1639886 Dec 09 21:48:53.867005 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-bb128468-aaa4-4111-9420-53eb111eede1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting subnet e0712e86-903f-45d7-9973-f305f804bb68 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:48:53.867005 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bb128468-aaa4-4111-9420-53eb111eede1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:53.917992 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bb128468-aaa4-4111-9420-53eb111eede1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:54.025320 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-3747ff21-ab20-4eac-aa54-80df4d74f215 None None] Set router 7e71b09c-215a-48ae-a557-15294dbfaea8 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:48:54.043405 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bb128468-aaa4-4111-9420-53eb111eede1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:54.112751 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-4d041fda-03f8-4539-8aad-0263f288abed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:54.114929 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-4d041fda-03f8-4539-8aad-0263f288abed service neutron] 10.222.0.10 "GET /v2.0/networks?id=92500df7-83c8-4757-9b24-3ee4dfba2da3 HTTP/1.1" status: 200 len: 897 time: 0.4448659 Dec 09 21:48:54.120642 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bb128468-aaa4-4111-9420-53eb111eede1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:54.175395 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bb128468-aaa4-4111-9420-53eb111eede1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:54.181142 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bb128468-aaa4-4111-9420-53eb111eede1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/subnets/e0712e86-903f-45d7-9973-f305f804bb68 HTTP/1.1" status: 204 len: 168 time: 0.3945308 Dec 09 21:48:54.182622 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb128468-aaa4-4111-9420-53eb111eede1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Subnet': ['ID=e0712e86-903f-45d7-9973-f305f804bb68,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:54.184574 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46742) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:54.453206 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-784f72a3-082e-4cb1-855c-05a5d9c03c42 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3 HTTP/1.1" status: 200 len: 999 time: 0.3247654 Dec 09 21:48:54.468617 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24b5bbd7-8493-4cab-8fd1-cce35326a7aa tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:54.510776 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3231c537-9744-42e7-82c2-fb45ab60c44d None None] Network 7157a402-a8c8-4a68-89c3-6a746b91f0b8 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:48:54.559948 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7c2a2840-b640-48be-b38e-07195e6b13ca req-7a973324-d720-4731-8c34-15d6f8f2718b tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/ports?device_id=c025d0be-fbd5-4014-9c13-3abc61aeda0f HTTP/1.1" status: 200 len: 210 time: 0.0999429 Dec 09 21:48:54.573576 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-ac87bf8f-b363-48a8-ba3f-eb36d24ee455 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.31 "GET /v2.0/networks?tenant_id=79cb26bbf252482b871bb8bb01655169&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0804400 Dec 09 21:48:54.615636 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-20f3c3b1-fc77-4fad-8993-b2a7606de5ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:54.617276 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-20f3c3b1-fc77-4fad-8993-b2a7606de5ab service neutron] 10.222.0.10 "GET /v2.0/subnets?id=13dde2f9-0dfd-4600-912c-44b7903e3595 HTTP/1.1" status: 200 len: 835 time: 0.1601934 Dec 09 21:48:54.715407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-3747ff21-ab20-4eac-aa54-80df4d74f215 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:52Z', 'revision_number': 10, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:54.762047 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3747ff21-ab20-4eac-aa54-80df4d74f215 None None] Checking router: 7e71b09c-215a-48ae-a557-15294dbfaea8 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:48:54.778517 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3747ff21-ab20-4eac-aa54-80df4d74f215 None None] Routers {'7e71b09c-215a-48ae-a557-15294dbfaea8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:48:54.779650 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-3747ff21-ab20-4eac-aa54-80df4d74f215 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e71b09c-215a-48ae-a557-15294dbfaea8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:54.784712 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cc606231-227f-478f-b550-e0f345ba0c77 None None] DHCP port deletion for 7157a402-a8c8-4a68-89c3-6a746b91f0b8 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:48:54.804334 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-24b5bbd7-8493-4cab-8fd1-cce35326a7aa tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting port 9d964cdf-f61b-4ec8-bfff-05262402bab6 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:48:54.804676 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24b5bbd7-8493-4cab-8fd1-cce35326a7aa tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:54.812148 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-ee45902e-2291-4b5e-9556-79a15e6c3c0b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:54.814236 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-ee45902e-2291-4b5e-9556-79a15e6c3c0b service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=92500df7-83c8-4757-9b24-3ee4dfba2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1883049 Dec 09 21:48:54.901832 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-3747ff21-ab20-4eac-aa54-80df4d74f215 None None] Set router 7e71b09c-215a-48ae-a557-15294dbfaea8 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:48:54.944182 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-49741005-c95d-4a7c-aa6c-28ec122448ef tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:54.946263 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-49741005-c95d-4a7c-aa6c-28ec122448ef tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.31 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3725624 Dec 09 21:48:54.949956 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:48:54.964614 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-b17ed53e-6576-4e54-934c-7616f96c5331 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Request body: {'port': {'device_id': 'c025d0be-fbd5-4014-9c13-3abc61aeda0f', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '79cb26bbf252482b871bb8bb01655169'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:48:54.969556 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-24b5bbd7-8493-4cab-8fd1-cce35326a7aa tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] For port 9d964cdf-f61b-4ec8-bfff-05262402bab6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9d964cdf-f61b-4ec8-bfff-05262402bab6,segment=NetworkSegment(d0a107fe-5f46-4b57-b092-aa8b3c02eed4),segment_id=d0a107fe-5f46-4b57-b092-aa8b3c02eed4)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:54.969927 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24b5bbd7-8493-4cab-8fd1-cce35326a7aa tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:55.002362 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-a2a7dc84-8dad-45d4-9826-85a4fecb2b14 service neutron] 10.222.0.10 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1697443 Dec 09 21:48:55.004059 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-24b5bbd7-8493-4cab-8fd1-cce35326a7aa tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Calling delete_port for 9d964cdf-f61b-4ec8-bfff-05262402bab6 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:48:55.005014 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'tag': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:48:55.007732 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-effbaaa7-a2b2-4878-a675-60a046d37fdb" -d '{"events": [{"name": "network-changed", "server_uuid": "c9630177-3a8d-4c3a-8c62-dd93288c7232", "tag": "165bd568-9d49-4f11-b8e1-eb1d0dc675b3"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:48:55.067860 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4ac286c-2447-4231-867a-c3cb694e9986 req-fa6e0ac8-ba16-4812-b7ca-08408de3a202 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:55.069592 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4ac286c-2447-4231-867a-c3cb694e9986 req-fa6e0ac8-ba16-4812-b7ca-08408de3a202 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 943 time: 0.1180055 Dec 09 21:48:55.081570 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-cc606231-227f-478f-b550-e0f345ba0c77 None None] Deleting port 9d964cdf-f61b-4ec8-bfff-05262402bab6 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:48:55.082002 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cc606231-227f-478f-b550-e0f345ba0c77 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:55.144806 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4ac286c-2447-4231-867a-c3cb694e9986 req-17ad9b1c-0012-4820-bac2-dc6743537047 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0675695 Dec 09 21:48:55.154997 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-cc606231-227f-478f-b550-e0f345ba0c77 None None] For port 9d964cdf-f61b-4ec8-bfff-05262402bab6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9d964cdf-f61b-4ec8-bfff-05262402bab6,segment=NetworkSegment(d0a107fe-5f46-4b57-b092-aa8b3c02eed4),segment_id=d0a107fe-5f46-4b57-b092-aa8b3c02eed4)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:55.155552 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cc606231-227f-478f-b550-e0f345ba0c77 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:55.175879 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:48:55.182637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-cc606231-227f-478f-b550-e0f345ba0c77 None None] Calling delete_port for 9d964cdf-f61b-4ec8-bfff-05262402bab6 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:48:55.215268 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-c7a0a214-b387-4eb7-afe0-0445571e76cb service neutron] 10.222.0.10 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2031567 Dec 09 21:48:55.233649 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-b17ed53e-6576-4e54-934c-7616f96c5331 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Made reservation on behalf of 79cb26bbf252482b871bb8bb01655169 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:48:55.239011 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-b17ed53e-6576-4e54-934c-7616f96c5331 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:55.262040 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24b5bbd7-8493-4cab-8fd1-cce35326a7aa tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:55.326047 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24b5bbd7-8493-4cab-8fd1-cce35326a7aa tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Port': ['ID=9d964cdf-f61b-4ec8-bfff-05262402bab6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:55.332494 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-b17ed53e-6576-4e54-934c-7616f96c5331 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:55.372313 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24b5bbd7-8493-4cab-8fd1-cce35326a7aa tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] No DVR routers for this DVR port 9d964cdf-f61b-4ec8-bfff-05262402bab6 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:48:55.453199 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:48:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-22322cbd-9908-4fd6-bb5b-a473d88cb7a2 x-openstack-request-id: req-22322cbd-9908-4fd6-bb5b-a473d88cb7a2 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:48:55.453607 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c9630177-3a8d-4c3a-8c62-dd93288c7232", "tag": "165bd568-9d49-4f11-b8e1-eb1d0dc675b3", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:48:55.453884 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-22322cbd-9908-4fd6-bb5b-a473d88cb7a2 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:48:55.454344 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'tag': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3', 'status': 'completed', 'code': 200} Dec 09 21:48:55.487889 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cc606231-227f-478f-b550-e0f345ba0c77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:55.507245 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24b5bbd7-8493-4cab-8fd1-cce35326a7aa tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:55.559603 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc606231-227f-478f-b550-e0f345ba0c77 None None] Pushing event deleted for resources: {'Port': ['ID=9d964cdf-f61b-4ec8-bfff-05262402bab6,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:55.566613 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc606231-227f-478f-b550-e0f345ba0c77 None None] No DVR routers for this DVR port 9d964cdf-f61b-4ec8-bfff-05262402bab6 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:48:55.567768 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-24b5bbd7-8493-4cab-8fd1-cce35326a7aa tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7157a402-a8c8-4a68-89c3-6a746b91f0b8']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:55.571330 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-3747ff21-ab20-4eac-aa54-80df4d74f215 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:52Z', 'revision_number': 10, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:55.610185 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3747ff21-ab20-4eac-aa54-80df4d74f215 None None] The sync data for ids ['7e71b09c-215a-48ae-a557-15294dbfaea8'] in n-d-713301-27 is: [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:52Z', 'revision_number': 10, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None, '_interfaces': [{'id': '73e149a2-b26b-481c-8db9-513f7c9378ca', 'name': '', 'network_id': '4805df6a-c2c1-4270-aaf7-c9ee10b973d2', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'mac_address': 'fa:16:3e:ed:6e:36', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'device_owner': 'network:router_interface', 'standard_attr_id': 3510, 'fixed_ips': [{'subnet_id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:48:19Z', 'updated_at': '2021-12-09T21:48:24Z', 'revision_number': 5, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'subnets': [{'id': 'ad5e915f-e2d0-4254-b7f3-de1864bf4bcf', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:48:55.632129 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-24b5bbd7-8493-4cab-8fd1-cce35326a7aa tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd0a107fe-5f46-4b57-b092-aa8b3c02eed4') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:55.632738 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-24b5bbd7-8493-4cab-8fd1-cce35326a7aa tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd0a107fe-5f46-4b57-b092-aa8b3c02eed4') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:48:55.649165 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-effbaaa7-a2b2-4878-a675-60a046d37fdb req-c6f301bb-ead0-406b-9e20-1a9c46c39558 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:55.664311 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-effbaaa7-a2b2-4878-a675-60a046d37fdb req-c6f301bb-ead0-406b-9e20-1a9c46c39558 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 1095 time: 0.2122979 Dec 09 21:48:55.682384 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24b5bbd7-8493-4cab-8fd1-cce35326a7aa tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:55.713549 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-b17ed53e-6576-4e54-934c-7616f96c5331 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:55.755643 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-b17ed53e-6576-4e54-934c-7616f96c5331 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:55.760205 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24b5bbd7-8493-4cab-8fd1-cce35326a7aa tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:55.924035 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-24b5bbd7-8493-4cab-8fd1-cce35326a7aa tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Releasing vlan 133 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:48:55.924560 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24b5bbd7-8493-4cab-8fd1-cce35326a7aa tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:48:55.931155 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:48:55.990454 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b17ed53e-6576-4e54-934c-7616f96c5331 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Pushing event updated for resources: {'SecurityGroup': ['ID=21ff2230-c51e-41f4-a0d1-f064604ba09f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:56.061186 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9d964cdf-f61b-4ec8-bfff-05262402bab6 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:48:56.096145 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-effbaaa7-a2b2-4878-a675-60a046d37fdb req-6bde25ef-c7d3-4dfa-b326-9f6a3e08f16f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:56.097859 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-effbaaa7-a2b2-4878-a675-60a046d37fdb req-6bde25ef-c7d3-4dfa-b326-9f6a3e08f16f service neutron] 10.222.0.31 "GET /v2.0/networks?id=92500df7-83c8-4757-9b24-3ee4dfba2da3 HTTP/1.1" status: 200 len: 897 time: 0.4178653 Dec 09 21:48:56.100080 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 9d964cdf-f61b-4ec8-bfff-05262402bab6 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:48:56.101084 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9d964cdf-f61b-4ec8-bfff-05262402bab6 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:48:56.106527 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24b5bbd7-8493-4cab-8fd1-cce35326a7aa tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:56.164014 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24b5bbd7-8493-4cab-8fd1-cce35326a7aa tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:56.170355 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-24b5bbd7-8493-4cab-8fd1-cce35326a7aa tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/networks/7157a402-a8c8-4a68-89c3-6a746b91f0b8 HTTP/1.1" status: 204 len: 168 time: 1.9821293 Dec 09 21:48:56.218382 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46794) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:48:56.286843 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24b5bbd7-8493-4cab-8fd1-cce35326a7aa tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Network': ['ID=7157a402-a8c8-4a68-89c3-6a746b91f0b8,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:56.399453 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-effbaaa7-a2b2-4878-a675-60a046d37fdb req-78f5f235-d468-447e-bd62-41e861c25f98 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3 HTTP/1.1" status: 200 len: 999 time: 0.2941031 Dec 09 21:48:56.432543 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-68cadbc8-bcf0-4e13-821a-c828ef1f3978 req-e8d9add7-d1b8-40b5-b548-89b07ee5ba6d tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/ports?device_id=c025d0be-fbd5-4014-9c13-3abc61aeda0f HTTP/1.1" status: 200 len: 210 time: 0.7265124 Dec 09 21:48:56.448129 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-effbaaa7-a2b2-4878-a675-60a046d37fdb req-1c77f6d1-43a0-44d4-aa05-9c37a533e553 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:56.449651 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-effbaaa7-a2b2-4878-a675-60a046d37fdb req-1c77f6d1-43a0-44d4-aa05-9c37a533e553 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 1095 time: 0.8270967 Dec 09 21:48:56.548699 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-b17ed53e-6576-4e54-934c-7616f96c5331 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Allocated IP 192.168.233.162 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/6fdbe5af-7823-4627-8106-7511b033dbb4) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:48:56.551885 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-effbaaa7-a2b2-4878-a675-60a046d37fdb req-cb56b342-e3fb-42e5-884c-e19d1c858234 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:56.553483 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-effbaaa7-a2b2-4878-a675-60a046d37fdb req-cb56b342-e3fb-42e5-884c-e19d1c858234 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=13dde2f9-0dfd-4600-912c-44b7903e3595 HTTP/1.1" status: 200 len: 835 time: 0.1446345 Dec 09 21:48:56.603578 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ab8eea2-7690-4cfa-9806-f65c09568773 req-71c8c596-6c38-4638-b643-2fb7cab71b4c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:56.605459 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ab8eea2-7690-4cfa-9806-f65c09568773 req-71c8c596-6c38-4638-b643-2fb7cab71b4c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 943 time: 0.0751896 Dec 09 21:48:56.606844 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-effbaaa7-a2b2-4878-a675-60a046d37fdb req-3b4ba290-04f6-4ba5-995c-bf0630b7090d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:56.608251 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-effbaaa7-a2b2-4878-a675-60a046d37fdb req-3b4ba290-04f6-4ba5-995c-bf0630b7090d service neutron] 10.222.0.10 "GET /v2.0/networks?id=92500df7-83c8-4757-9b24-3ee4dfba2da3 HTTP/1.1" status: 200 len: 897 time: 0.1493745 Dec 09 21:48:56.688758 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-effbaaa7-a2b2-4878-a675-60a046d37fdb req-53fd79a9-cd90-4e8f-b58c-be04fd355a4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:56.692039 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-effbaaa7-a2b2-4878-a675-60a046d37fdb req-53fd79a9-cd90-4e8f-b58c-be04fd355a4b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=92500df7-83c8-4757-9b24-3ee4dfba2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1303389 Dec 09 21:48:56.724816 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-effbaaa7-a2b2-4878-a675-60a046d37fdb req-957b57a3-6430-4667-86ad-772ddd4ea536 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3 HTTP/1.1" status: 200 len: 999 time: 0.1064038 Dec 09 21:48:56.729088 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ab8eea2-7690-4cfa-9806-f65c09568773 req-770ddb07-b8d4-43f0-b8d5-80bf64872019 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1120672 Dec 09 21:48:56.800367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:48:56.807961 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-effbaaa7-a2b2-4878-a675-60a046d37fdb req-d966722f-8a76-4fc1-bf4c-83729b9db1ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:56.809732 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-effbaaa7-a2b2-4878-a675-60a046d37fdb req-d966722f-8a76-4fc1-bf4c-83729b9db1ce service neutron] 10.222.0.10 "GET /v2.0/subnets?id=13dde2f9-0dfd-4600-912c-44b7903e3595 HTTP/1.1" status: 200 len: 835 time: 0.0775275 Dec 09 21:48:56.917500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-effbaaa7-a2b2-4878-a675-60a046d37fdb req-f14f28fb-fc63-497c-a7c3-5e1c070cc616 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:56.919082 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-effbaaa7-a2b2-4878-a675-60a046d37fdb req-f14f28fb-fc63-497c-a7c3-5e1c070cc616 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=92500df7-83c8-4757-9b24-3ee4dfba2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1001911 Dec 09 21:48:56.950550 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,segment=NetworkSegment(0189efa9-02eb-4071-ae6f-aee6c867d035),segment_id=0189efa9-02eb-4071-ae6f-aee6c867d035)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:56.994325 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3', 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3', 'port_id': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3', 'mac_address': 'fa:16:3e:9d:7e:d5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 107, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '13dde2f9-0dfd-4600-912c-44b7903e3595', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:48:57.069090 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:57.094370 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:48:57.115556 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-effbaaa7-a2b2-4878-a675-60a046d37fdb req-715de8ff-ce89-48b9-a876-31516d17ec1d service neutron] 10.222.0.10 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1673441 Dec 09 21:48:57.151634 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,segment=NetworkSegment(0189efa9-02eb-4071-ae6f-aee6c867d035),segment_id=0189efa9-02eb-4071-ae6f-aee6c867d035)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:57.161829 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:57.218742 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:57.286275 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-effbaaa7-a2b2-4878-a675-60a046d37fdb req-ce612823-95dc-42b6-a0e0-a0d9da306ae2 service neutron] 10.222.0.10 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1632614 Dec 09 21:48:57.327861 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:57.407297 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:57.419416 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['165bd568-9d49-4f11-b8e1-eb1d0dc675b3'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:48:57.514966 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-effbaaa7-a2b2-4878-a675-60a046d37fdb req-45044a6e-ff9c-4f4e-a365-71d63b8beb32 service neutron] 10.222.0.31 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8044109 Dec 09 21:48:57.547883 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-b17ed53e-6576-4e54-934c-7616f96c5331 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:57.583505 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-927696f2-49b8-4d55-b924-e4eac45b700b req-cec347a4-0a78-4b2b-90b6-5e55bc676012 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/ports?device_id=c025d0be-fbd5-4014-9c13-3abc61aeda0f HTTP/1.1" status: 200 len: 210 time: 0.0579295 Dec 09 21:48:57.684830 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 11bdc2b0-5f2a-4359-a587-0f9370ce7b5a no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:48:57.739882 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 11bdc2b0-5f2a-4359-a587-0f9370ce7b5a {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:48:57.740072 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-b17ed53e-6576-4e54-934c-7616f96c5331 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:57.740547 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 11bdc2b0-5f2a-4359-a587-0f9370ce7b5a not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:48:57.758833 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-effbaaa7-a2b2-4878-a675-60a046d37fdb req-b1288f43-66da-4925-8f07-997b6d445ed0 service neutron] 10.222.0.31 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2317369 Dec 09 21:48:57.803186 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-b17ed53e-6576-4e54-934c-7616f96c5331 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:48:57.815925 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-b17ed53e-6576-4e54-934c-7616f96c5331 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:48:57.819874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-b17ed53e-6576-4e54-934c-7616f96c5331 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:48:57.829243 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-29dd6c15-c617-4775-8c99-2957a078d20b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:57.903883 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b17ed53e-6576-4e54-934c-7616f96c5331 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Pushing event updated for resources: {'Port': ['ID=6fdbe5af-7823-4627-8106-7511b033dbb4,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:57.958934 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eae94fc9-acda-4654-a8e6-7fbf7be7d2ab req-090b2f28-3326-4039-8198-906df0e23d38 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:57.960640 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eae94fc9-acda-4654-a8e6-7fbf7be7d2ab req-090b2f28-3326-4039-8198-906df0e23d38 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 944 time: 0.0874064 Dec 09 21:48:57.979125 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-b17ed53e-6576-4e54-934c-7616f96c5331 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:57.979824 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-b17ed53e-6576-4e54-934c-7616f96c5331 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:58.058604 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-b17ed53e-6576-4e54-934c-7616f96c5331 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 3.0993350 Dec 09 21:48:58.070008 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eae94fc9-acda-4654-a8e6-7fbf7be7d2ab req-7f169cc4-8b9c-4c2b-bc67-dc837103be93 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0925100 Dec 09 21:48:58.074881 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-7dec8668-217e-4861-968f-27448ccdac3a service neutron] Request body: {'port': {'device_id': 'c025d0be-fbd5-4014-9c13-3abc61aeda0f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:48:58.157674 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-7dec8668-217e-4861-968f-27448ccdac3a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:58.238978 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3098772b-f067-4df6-ae1c-ea8022cebb44 None None] Provisioning complete for port 6fdbe5af-7823-4627-8106-7511b033dbb4 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:58.239542 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3098772b-f067-4df6-ae1c-ea8022cebb44 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:58.294551 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-3098772b-f067-4df6-ae1c-ea8022cebb44 None None] Port 6fdbe5af-7823-4627-8106-7511b033dbb4 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:48:58.404224 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-29dd6c15-c617-4775-8c99-2957a078d20b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting port 73e149a2-b26b-481c-8db9-513f7c9378ca {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:48:58.404573 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-29dd6c15-c617-4775-8c99-2957a078d20b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:58.601447 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-29dd6c15-c617-4775-8c99-2957a078d20b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] For port 73e149a2-b26b-481c-8db9-513f7c9378ca, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=73e149a2-b26b-481c-8db9-513f7c9378ca,segment=NetworkSegment(9a21fac6-4e36-462c-a440-34e82f541369),segment_id=9a21fac6-4e36-462c-a440-34e82f541369)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:58.602110 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-29dd6c15-c617-4775-8c99-2957a078d20b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:58.607981 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a60d9b-458e-4b17-bec1-3447b1cbecaf req-0fc164ca-2f8e-4dae-aa14-781e53b08663 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:58.618118 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9a60d9b-458e-4b17-bec1-3447b1cbecaf req-0fc164ca-2f8e-4dae-aa14-781e53b08663 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 944 time: 0.1381016 Dec 09 21:48:58.625621 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-29dd6c15-c617-4775-8c99-2957a078d20b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Calling delete_port for 73e149a2-b26b-481c-8db9-513f7c9378ca owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:48:58.640364 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-fd60eca7-f35a-4876-9977-7b16f867f648 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:58.642437 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-fd60eca7-f35a-4876-9977-7b16f867f648 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.10 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232&tenant_id=dce7594ac2a74901912a2f19de04bf79&binding%3Ahost_id=n-h2-713301-27 HTTP/1.1" status: 200 len: 944 time: 0.2619925 Dec 09 21:48:58.744724 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-7dec8668-217e-4861-968f-27448ccdac3a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6fdbe5af-7823-4627-8106-7511b033dbb4 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:48:58.763861 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-7dec8668-217e-4861-968f-27448ccdac3a service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:58.784383 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-7dec8668-217e-4861-968f-27448ccdac3a service neutron] Transition to ACTIVE for port object 6fdbe5af-7823-4627-8106-7511b033dbb4 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:48:58.786060 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9a60d9b-458e-4b17-bec1-3447b1cbecaf req-52a1e5f1-0345-4508-a460-4a5241103007 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1665795 Dec 09 21:48:58.816448 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-4c1534d4-5dd5-45f4-a6ed-52fa0e458ac8 service neutron] 10.222.0.10 "GET /v2.0/ports/165bd568-9d49-4f11-b8e1-eb1d0dc675b3/bindings/n-h2-713301-27 HTTP/1.1" status: 200 len: 383 time: 0.1653838 Dec 09 21:48:58.829661 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:48:58.870776 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-7dec8668-217e-4861-968f-27448ccdac3a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:58.890479 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:48:58.895332 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:48:58.896771 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:58.962662 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dec8668-217e-4861-968f-27448ccdac3a service neutron] Pushing event updated for resources: {'Port': ['ID=6fdbe5af-7823-4627-8106-7511b033dbb4,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:59.024516 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-d3d089d8-722f-4771-a18e-5159d35fc9e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:59.026329 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-d3d089d8-722f-4771-a18e-5159d35fc9e2 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 1096 time: 0.1809177 Dec 09 21:48:59.076334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d6c6ac5-efbb-4ecf-89c0-7de019882686 req-ecaa2ff3-8c0a-4c76-b892-42ed7f3614ac tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:59.077903 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d6c6ac5-efbb-4ecf-89c0-7de019882686 req-ecaa2ff3-8c0a-4c76-b892-42ed7f3614ac tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/ports?device_id=c025d0be-fbd5-4014-9c13-3abc61aeda0f HTTP/1.1" status: 200 len: 948 time: 0.1700196 Dec 09 21:48:59.082186 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:59.123767 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:48:59.127512 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f7fcadca-3f4c-4b54-bb2e-a3aa4e61bc78" -d '{"events": [{"server_uuid": "c9630177-3a8d-4c3a-8c62-dd93288c7232", "name": "network-vif-plugged", "status": "completed", "tag": "165bd568-9d49-4f11-b8e1-eb1d0dc675b3"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:48:59.128989 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-7dec8668-217e-4861-968f-27448ccdac3a service neutron] Attempting to bind port 6fdbe5af-7823-4627-8106-7511b033dbb4 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:48:59.129339 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-7dec8668-217e-4861-968f-27448ccdac3a service neutron] Attempting to bind port 6fdbe5af-7823-4627-8106-7511b033dbb4 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:48:59.129676 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-7dec8668-217e-4861-968f-27448ccdac3a service neutron] Attempting to bind port 6fdbe5af-7823-4627-8106-7511b033dbb4 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:48:59.133307 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-29dd6c15-c617-4775-8c99-2957a078d20b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:59.150049 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-7dec8668-217e-4861-968f-27448ccdac3a service neutron] Port 6fdbe5af-7823-4627-8106-7511b033dbb4 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:48:59.150489 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-7dec8668-217e-4861-968f-27448ccdac3a service neutron] Attempting to bind port 6fdbe5af-7823-4627-8106-7511b033dbb4 on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:48:59.150859 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,segment=NetworkSegment(0189efa9-02eb-4071-ae6f-aee6c867d035),segment_id=0189efa9-02eb-4071-ae6f-aee6c867d035)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:48:59.159885 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:59.183155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29dd6c15-c617-4775-8c99-2957a078d20b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Port': ['ID=73e149a2-b26b-481c-8db9-513f7c9378ca,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:59.218352 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-7dec8668-217e-4861-968f-27448ccdac3a service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 48, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:48:59.219102 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-7dec8668-217e-4861-968f-27448ccdac3a service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:48:59.219685 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-7dec8668-217e-4861-968f-27448ccdac3a service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:48:59.220292 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-7dec8668-217e-4861-968f-27448ccdac3a service neutron] Bound port: 6fdbe5af-7823-4627-8106-7511b033dbb4, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:48:59.221609 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-7dec8668-217e-4861-968f-27448ccdac3a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:59.262433 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,revision_number=9']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:59.294190 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-fe584a95-802f-4d83-a80a-ad427e156d39 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:59.297283 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-fe584a95-802f-4d83-a80a-ad427e156d39 service neutron] 10.222.0.10 "GET /v2.0/networks?id=92500df7-83c8-4757-9b24-3ee4dfba2da3 HTTP/1.1" status: 200 len: 897 time: 0.2582054 Dec 09 21:48:59.316362 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2d6c6ac5-efbb-4ecf-89c0-7de019882686 req-3ec4fba2-fe2e-48bb-a5cb-88a32c9cd2af tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/security-groups?id=21ff2230-c51e-41f4-a0d1-f064604ba09f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2256651 Dec 09 21:48:59.469183 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-7dec8668-217e-4861-968f-27448ccdac3a service neutron] For port 6fdbe5af-7823-4627-8106-7511b033dbb4, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:48:59.482342 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-29dd6c15-c617-4775-8c99-2957a078d20b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:59.490634 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-bcef0055-f72b-4ed7-a8af-842240937b35 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3 HTTP/1.1" status: 200 len: 1001 time: 0.1701627 Dec 09 21:48:59.491105 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-7dec8668-217e-4861-968f-27448ccdac3a service neutron] For port 6fdbe5af-7823-4627-8106-7511b033dbb4, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6fdbe5af-7823-4627-8106-7511b033dbb4,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:48:59.604790 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-2003f873-1426-4de4-9447-796170cf413d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:59.606684 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-2003f873-1426-4de4-9447-796170cf413d service neutron] 10.222.0.10 "GET /v2.0/subnets?id=13dde2f9-0dfd-4600-912c-44b7903e3595 HTTP/1.1" status: 200 len: 835 time: 0.1067221 Dec 09 21:48:59.622226 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:48:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-77e24af6-ff56-453c-8a5f-ca1945e7e9aa x-openstack-request-id: req-77e24af6-ff56-453c-8a5f-ca1945e7e9aa {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:48:59.622696 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c9630177-3a8d-4c3a-8c62-dd93288c7232", "name": "network-vif-plugged", "status": "completed", "tag": "165bd568-9d49-4f11-b8e1-eb1d0dc675b3", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:48:59.622825 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-77e24af6-ff56-453c-8a5f-ca1945e7e9aa {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:48:59.623156 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3', 'code': 200} Dec 09 21:48:59.623835 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-7dec8668-217e-4861-968f-27448ccdac3a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:59.701569 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-eeee2edb-5689-4cb3-acb1-9ef3ad9aecec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:59.704264 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-eeee2edb-5689-4cb3-acb1-9ef3ad9aecec service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=92500df7-83c8-4757-9b24-3ee4dfba2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0903449 Dec 09 21:48:59.746597 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-7dec8668-217e-4861-968f-27448ccdac3a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:59.748150 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-7dec8668-217e-4861-968f-27448ccdac3a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:48:59.749823 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-7dec8668-217e-4861-968f-27448ccdac3a service neutron] 10.222.0.31 "PUT /v2.0/ports/6fdbe5af-7823-4627-8106-7511b033dbb4 HTTP/1.1" status: 200 len: 1097 time: 1.6813607 Dec 09 21:48:59.752020 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c025d0be-fbd5-4014-9c13-3abc61aeda0f', 'tag': '6fdbe5af-7823-4627-8106-7511b033dbb4'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:48:59.765083 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5ddd4932-9139-419b-a058-cef99e908ad3" -d '{"events": [{"name": "network-changed", "server_uuid": "c025d0be-fbd5-4014-9c13-3abc61aeda0f", "tag": "6fdbe5af-7823-4627-8106-7511b033dbb4"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:48:59.897125 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dec8668-217e-4861-968f-27448ccdac3a service neutron] Pushing event updated for resources: {'Port': ['ID=6fdbe5af-7823-4627-8106-7511b033dbb4,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:48:59.965834 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-d006ad5f-fa6f-423d-8a00-2c22dff93b90 service neutron] 10.222.0.10 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2531738 Dec 09 21:48:59.966061 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-29dd6c15-c617-4775-8c99-2957a078d20b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Router 7e71b09c-215a-48ae-a557-15294dbfaea8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:48:59.980773 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-117a54c7-d4a4-4e9a-a5f7-bd0dfeba9700 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:48:59.982328 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-117a54c7-d4a4-4e9a-a5f7-bd0dfeba9700 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=79cb26bbf252482b871bb8bb01655169&device_id=c025d0be-fbd5-4014-9c13-3abc61aeda0f HTTP/1.1" status: 200 len: 1100 time: 0.1068623 Dec 09 21:49:00.046924 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:48:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a6259af9-e9b9-40b0-9d01-870b01453e72 x-openstack-request-id: req-a6259af9-e9b9-40b0-9d01-870b01453e72 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:49:00.047224 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c025d0be-fbd5-4014-9c13-3abc61aeda0f", "tag": "6fdbe5af-7823-4627-8106-7511b033dbb4", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:49:00.047568 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a6259af9-e9b9-40b0-9d01-870b01453e72 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:49:00.049117 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c025d0be-fbd5-4014-9c13-3abc61aeda0f', 'tag': '6fdbe5af-7823-4627-8106-7511b033dbb4', 'status': 'completed', 'code': 200} Dec 09 21:49:00.051059 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-0aa06901-5395-4bf9-9528-fe5b08b91484 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.162&port_id=6fdbe5af-7823-4627-8106-7511b033dbb4 HTTP/1.1" status: 200 len: 217 time: 0.0578768 Dec 09 21:49:00.124656 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-26de0e5b-e048-42e1-af43-b10ae1ac2094 service neutron] 10.222.0.10 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1501558 Dec 09 21:49:00.175516 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-545d6277-0bfd-4503-801f-24a273e540f0 req-bebf4618-94e1-4299-8391-544dfaf0b4a8 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:00.177254 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-545d6277-0bfd-4503-801f-24a273e540f0 req-bebf4618-94e1-4299-8391-544dfaf0b4a8 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 945 time: 0.0679264 Dec 09 21:49:00.180097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-29dd6c15-c617-4775-8c99-2957a078d20b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:49:00.186606 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-29dd6c15-c617-4775-8c99-2957a078d20b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/routers/7e71b09c-215a-48ae-a557-15294dbfaea8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.9670496 Dec 09 21:49:00.190152 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46884) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:00.191387 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b06f1016-ed7a-4b1b-aba9-c189591e5ee5 None None] Sync routers for ids ['7e71b09c-215a-48ae-a557-15294dbfaea8'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:49:00.205626 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b06f1016-ed7a-4b1b-aba9-c189591e5ee5 None None] Routers {'7e71b09c-215a-48ae-a557-15294dbfaea8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:49:00.206503 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-b06f1016-ed7a-4b1b-aba9-c189591e5ee5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e71b09c-215a-48ae-a557-15294dbfaea8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:00.234118 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-163ba66f-0e57-4b21-b657-640b281f0308 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:00.235701 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-163ba66f-0e57-4b21-b657-640b281f0308 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.1444619 Dec 09 21:49:00.272879 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-545d6277-0bfd-4503-801f-24a273e540f0 req-e96bd891-e1f8-4d30-b9e3-888a21665fa9 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0763006 Dec 09 21:49:00.296482 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-f6173387-36b7-4a40-97d3-704da68e5846 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting subnet ad5e915f-e2d0-4254-b7f3-de1864bf4bcf {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:49:00.317252 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f6173387-36b7-4a40-97d3-704da68e5846 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:00.324008 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-b06f1016-ed7a-4b1b-aba9-c189591e5ee5 None None] Set router 7e71b09c-215a-48ae-a557-15294dbfaea8 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:49:00.361801 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f6173387-36b7-4a40-97d3-704da68e5846 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:00.392797 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-a5f7ff59-dfae-44f8-b847-1d9f42eb2b12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:00.394369 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-a5f7ff59-dfae-44f8-b847-1d9f42eb2b12 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.1459842 Dec 09 21:49:00.497101 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-b06f1016-ed7a-4b1b-aba9-c189591e5ee5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:58Z', 'revision_number': 11, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:00.523567 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71bc6732-6386-4986-994e-12140a5ae60f req-3d9de952-43a7-4beb-93a6-5a1d4d55fc56 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:00.536422 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71bc6732-6386-4986-994e-12140a5ae60f req-3d9de952-43a7-4beb-93a6-5a1d4d55fc56 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/ports?device_id=c025d0be-fbd5-4014-9c13-3abc61aeda0f HTTP/1.1" status: 200 len: 948 time: 0.0799687 Dec 09 21:49:00.564699 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b06f1016-ed7a-4b1b-aba9-c189591e5ee5 None None] Checking router: 7e71b09c-215a-48ae-a557-15294dbfaea8 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:49:00.569981 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f6173387-36b7-4a40-97d3-704da68e5846 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:00.580197 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b06f1016-ed7a-4b1b-aba9-c189591e5ee5 None None] Routers {'7e71b09c-215a-48ae-a557-15294dbfaea8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:49:00.581289 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-b06f1016-ed7a-4b1b-aba9-c189591e5ee5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e71b09c-215a-48ae-a557-15294dbfaea8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:00.600719 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-bba44156-44fb-41b1-aac4-c4505ba154dc service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1971071 Dec 09 21:49:00.608103 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71bc6732-6386-4986-994e-12140a5ae60f req-571f358f-f97b-473a-b421-0b49d12fbb50 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/security-groups?id=21ff2230-c51e-41f4-a0d1-f064604ba09f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0704925 Dec 09 21:49:00.706892 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-b06f1016-ed7a-4b1b-aba9-c189591e5ee5 None None] Set router 7e71b09c-215a-48ae-a557-15294dbfaea8 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:49:00.709932 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f6173387-36b7-4a40-97d3-704da68e5846 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:00.769132 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c06562d4-f1b0-45bb-9c9c-87a002192e4d None None] Network 4805df6a-c2c1-4270-aaf7-c9ee10b973d2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:49:00.770845 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8f308fdd-8638-4794-94f3-b1b754fa6f2e req-4c15613f-fd08-4aa8-a061-987ef19038ba service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1597524 Dec 09 21:49:00.773794 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f6173387-36b7-4a40-97d3-704da68e5846 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:00.778540 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f6173387-36b7-4a40-97d3-704da68e5846 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/subnets/ad5e915f-e2d0-4254-b7f3-de1864bf4bcf HTTP/1.1" status: 204 len: 168 time: 0.5873463 Dec 09 21:49:00.780314 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6173387-36b7-4a40-97d3-704da68e5846 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Subnet': ['ID=ad5e915f-e2d0-4254-b7f3-de1864bf4bcf,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:00.781065 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46896) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:00.849014 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-b06f1016-ed7a-4b1b-aba9-c189591e5ee5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:58Z', 'revision_number': 11, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:00.912093 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b06f1016-ed7a-4b1b-aba9-c189591e5ee5 None None] The sync data for ids ['7e71b09c-215a-48ae-a557-15294dbfaea8'] in n-d-713301-27 is: [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:58Z', 'revision_number': 11, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:49:00.932227 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ddd4932-9139-419b-a058-cef99e908ad3 req-923ee4ef-b6d4-477f-a7cf-063e142096bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:00.933967 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5ddd4932-9139-419b-a058-cef99e908ad3 req-923ee4ef-b6d4-477f-a7cf-063e142096bc service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=79cb26bbf252482b871bb8bb01655169&device_id=c025d0be-fbd5-4014-9c13-3abc61aeda0f HTTP/1.1" status: 200 len: 1100 time: 0.0622897 Dec 09 21:49:00.985168 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-91cf1ff4-60fd-48a1-a12c-3a392dcdf639 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:01.050571 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-91cf1ff4-60fd-48a1-a12c-3a392dcdf639 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Deleting port fc8c9273-f803-40e8-897e-6873cf824150 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:49:01.051315 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-91cf1ff4-60fd-48a1-a12c-3a392dcdf639 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:01.057113 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ddd4932-9139-419b-a058-cef99e908ad3 req-c611bf8d-4baf-4a76-b94c-000cdc34fc46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:01.059037 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5ddd4932-9139-419b-a058-cef99e908ad3 req-c611bf8d-4baf-4a76-b94c-000cdc34fc46 service neutron] 10.222.0.31 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.1175938 Dec 09 21:49:01.113255 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5ddd4932-9139-419b-a058-cef99e908ad3 req-143342ab-b6c3-4e23-a438-c91faed21e23 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.162&port_id=6fdbe5af-7823-4627-8106-7511b033dbb4 HTTP/1.1" status: 200 len: 217 time: 0.0463102 Dec 09 21:49:01.134622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-91cf1ff4-60fd-48a1-a12c-3a392dcdf639 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] For port fc8c9273-f803-40e8-897e-6873cf824150, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=fc8c9273-f803-40e8-897e-6873cf824150,segment=NetworkSegment(9a21fac6-4e36-462c-a440-34e82f541369),segment_id=9a21fac6-4e36-462c-a440-34e82f541369)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:49:01.135555 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-91cf1ff4-60fd-48a1-a12c-3a392dcdf639 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:01.152973 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-91cf1ff4-60fd-48a1-a12c-3a392dcdf639 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Calling delete_port for fc8c9273-f803-40e8-897e-6873cf824150 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:49:01.175904 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ddd4932-9139-419b-a058-cef99e908ad3 req-1caea736-8383-445c-8c79-8d25ed9db1a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:01.177407 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5ddd4932-9139-419b-a058-cef99e908ad3 req-1caea736-8383-445c-8c79-8d25ed9db1a1 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0546441 Dec 09 21:49:01.253690 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ddd4932-9139-419b-a058-cef99e908ad3 req-bcacf616-f0aa-47c6-82e9-cf2760f1a8bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:01.255809 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5ddd4932-9139-419b-a058-cef99e908ad3 req-bcacf616-f0aa-47c6-82e9-cf2760f1a8bf service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0700865 Dec 09 21:49:01.274312 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-91cf1ff4-60fd-48a1-a12c-3a392dcdf639 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:01.299489 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-38f784a2-d008-4d52-b274-8c54a1a36d65 None None] DHCP port deletion for 4805df6a-c2c1-4270-aaf7-c9ee10b973d2 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:49:01.357567 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91cf1ff4-60fd-48a1-a12c-3a392dcdf639 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Port': ['ID=fc8c9273-f803-40e8-897e-6873cf824150,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:01.371975 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91cf1ff4-60fd-48a1-a12c-3a392dcdf639 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] No DVR routers for this DVR port fc8c9273-f803-40e8-897e-6873cf824150 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:49:01.471825 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5ddd4932-9139-419b-a058-cef99e908ad3 req-fcbe4eda-9984-404c-be48-2cf7f2045f4a service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2068329 Dec 09 21:49:01.532503 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-91cf1ff4-60fd-48a1-a12c-3a392dcdf639 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:01.554096 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8b33267-6805-4338-bec2-77b966db49b3 req-ddf87a19-f232-4bb2-9ceb-6e519e66c4ef tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:01.566780 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8b33267-6805-4338-bec2-77b966db49b3 req-ddf87a19-f232-4bb2-9ceb-6e519e66c4ef tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 945 time: 0.1537454 Dec 09 21:49:01.581367 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-5ddd4932-9139-419b-a058-cef99e908ad3 req-8aec593a-5ac7-4a64-ad67-663a840d11ec service neutron] 10.222.0.31 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1020372 Dec 09 21:49:01.597402 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-91cf1ff4-60fd-48a1-a12c-3a392dcdf639 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4805df6a-c2c1-4270-aaf7-c9ee10b973d2']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:01.617559 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-91cf1ff4-60fd-48a1-a12c-3a392dcdf639 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9a21fac6-4e36-462c-a440-34e82f541369') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:01.617761 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-91cf1ff4-60fd-48a1-a12c-3a392dcdf639 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9a21fac6-4e36-462c-a440-34e82f541369') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:01.638796 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-91cf1ff4-60fd-48a1-a12c-3a392dcdf639 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:01.660336 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8b33267-6805-4338-bec2-77b966db49b3 req-cef435c8-c3ec-41ab-9589-2832d7778674 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0878394 Dec 09 21:49:01.676464 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-91cf1ff4-60fd-48a1-a12c-3a392dcdf639 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:01.685681 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-91cf1ff4-60fd-48a1-a12c-3a392dcdf639 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Releasing vlan 149 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:49:01.686274 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-91cf1ff4-60fd-48a1-a12c-3a392dcdf639 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:49:01.690455 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:49:01.820849 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-91cf1ff4-60fd-48a1-a12c-3a392dcdf639 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:01.831645 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-91cf1ff4-60fd-48a1-a12c-3a392dcdf639 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:01.838379 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46912) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:01.838929 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-91cf1ff4-60fd-48a1-a12c-3a392dcdf639 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/networks/4805df6a-c2c1-4270-aaf7-c9ee10b973d2 HTTP/1.1" status: 204 len: 168 time: 1.0562396 Dec 09 21:49:01.843586 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-f203f8a4-6a6e-4c78-ad04-59ced92a0643 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'router': {'routes': None}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:01.856361 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91cf1ff4-60fd-48a1-a12c-3a392dcdf639 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Pushing event deleted for resources: {'Network': ['ID=4805df6a-c2c1-4270-aaf7-c9ee10b973d2,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:01.872553 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 73e149a2-b26b-481c-8db9-513f7c9378ca no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:49:01.873555 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed90a501-e292-4436-b7a6-88f90064daa0 req-b35362e2-f535-43de-9117-5a0ad93e6e0f tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:01.882721 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ed90a501-e292-4436-b7a6-88f90064daa0 req-b35362e2-f535-43de-9117-5a0ad93e6e0f tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/ports?device_id=c025d0be-fbd5-4014-9c13-3abc61aeda0f HTTP/1.1" status: 200 len: 948 time: 0.1038530 Dec 09 21:49:01.919231 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 73e149a2-b26b-481c-8db9-513f7c9378ca {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:49:01.920002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 73e149a2-b26b-481c-8db9-513f7c9378ca not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:49:01.920789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device fc8c9273-f803-40e8-897e-6873cf824150 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:49:01.949953 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: fc8c9273-f803-40e8-897e-6873cf824150 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:49:01.950715 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device fc8c9273-f803-40e8-897e-6873cf824150 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:49:01.973803 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ed90a501-e292-4436-b7a6-88f90064daa0 req-4a7716f2-f6b4-475c-81c9-171bf00673e5 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/security-groups?id=21ff2230-c51e-41f4-a0d1-f064604ba09f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0901527 Dec 09 21:49:02.172105 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.extraroute_db [None req-f203f8a4-6a6e-4c78-ad04-59ced92a0643 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Added routes are [] {{(pid=103437) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:126}} Dec 09 21:49:02.172414 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.extraroute_db [None req-f203f8a4-6a6e-4c78-ad04-59ced92a0643 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Removed routes are [] {{(pid=103437) _update_extra_routes /opt/stack/neutron/neutron/db/extraroute_db.py:134}} Dec 09 21:49:02.174333 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f203f8a4-6a6e-4c78-ad04-59ced92a0643 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:02.769225 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46956) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:02.839481 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f203f8a4-6a6e-4c78-ad04-59ced92a0643 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:02.847231 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f203f8a4-6a6e-4c78-ad04-59ced92a0643 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-640457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-640448', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-635166'] for router, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:02.876400 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42274cb9-904e-4d8f-b3f2-9d8961fcf0f2 req-8f712698-4f80-4313-8afb-3ce6950e3a04 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:02.882188 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42274cb9-904e-4d8f-b3f2-9d8961fcf0f2 req-8f712698-4f80-4313-8afb-3ce6950e3a04 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 945 time: 0.0977798 Dec 09 21:49:02.938130 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6fdbe5af-7823-4627-8106-7511b033dbb4 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:49:02.941719 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-3c4ccb0c-a63f-472d-b972-5eee19c94271 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:02.943241 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-3c4ccb0c-a63f-472d-b972-5eee19c94271 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232&tenant_id=dce7594ac2a74901912a2f19de04bf79 HTTP/1.1" status: 200 len: 1097 time: 0.6166117 Dec 09 21:49:02.953091 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f203f8a4-6a6e-4c78-ad04-59ced92a0643 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Router 7e71b09c-215a-48ae-a557-15294dbfaea8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:49:02.957290 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e47c7e9-8871-4951-9cc5-86c4d01342e0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:02.959023 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Request body: {'port': {'binding:host_id': 'n-h1-713301-27', 'device_owner': 'compute:nova'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:02.986506 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42274cb9-904e-4d8f-b3f2-9d8961fcf0f2 req-b10bcd00-6b99-4a68-ad69-3ee3bc565746 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0970628 Dec 09 21:49:03.110436 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:03.114849 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ac0e2175-05a1-4a42-9260-355bc7196ab3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:03.115034 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f203f8a4-6a6e-4c78-ad04-59ced92a0643 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:49:03.127983 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f203f8a4-6a6e-4c78-ad04-59ced92a0643 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:03.131676 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f203f8a4-6a6e-4c78-ad04-59ced92a0643 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/routers/7e71b09c-215a-48ae-a557-15294dbfaea8 HTTP/1.1" status: 200 len: 700 time: 1.2896924 Dec 09 21:49:03.132092 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46966) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:03.152755 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1d56c83-fa6f-4882-8f68-1ef21f5f095b None None] Sync routers for ids ['7e71b09c-215a-48ae-a557-15294dbfaea8'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:49:03.178322 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e47c7e9-8871-4951-9cc5-86c4d01342e0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:03.187624 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1d56c83-fa6f-4882-8f68-1ef21f5f095b None None] Routers {'7e71b09c-215a-48ae-a557-15294dbfaea8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:49:03.188280 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a1d56c83-fa6f-4882-8f68-1ef21f5f095b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e71b09c-215a-48ae-a557-15294dbfaea8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:03.197405 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84572115-b746-4c62-8737-57f08b344f54 req-1bf107fc-513e-48fd-bcac-622066deba9f tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:03.199799 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84572115-b746-4c62-8737-57f08b344f54 req-1bf107fc-513e-48fd-bcac-622066deba9f tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/ports?device_id=c025d0be-fbd5-4014-9c13-3abc61aeda0f HTTP/1.1" status: 200 len: 948 time: 0.0774062 Dec 09 21:49:03.200457 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46970) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:03.203328 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-69b4b699-de77-4e24-9c32-fb96b9960cb3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/ports?device_id=7e71b09c-215a-48ae-a557-15294dbfaea8 HTTP/1.1" status: 200 len: 205 time: 0.0641477 Dec 09 21:49:03.207426 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e47c7e9-8871-4951-9cc5-86c4d01342e0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:03.283064 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-a1d56c83-fa6f-4882-8f68-1ef21f5f095b None None] Set router 7e71b09c-215a-48ae-a557-15294dbfaea8 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:49:03.286088 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6fdbe5af-7823-4627-8106-7511b033dbb4, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6fdbe5af-7823-4627-8106-7511b033dbb4,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:49:03.308511 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1d0aaef3-2e73-4b63-ae07-66369e444051 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:03.353034 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a1d56c83-fa6f-4882-8f68-1ef21f5f095b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:58Z', 'revision_number': 11, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:03.359205 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '6fdbe5af-7823-4627-8106-7511b033dbb4', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': '6fdbe5af-7823-4627-8106-7511b033dbb4', 'mac_address': 'fa:16:3e:26:c1:c7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.162'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:49:03.397387 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1d56c83-fa6f-4882-8f68-1ef21f5f095b None None] Checking router: 7e71b09c-215a-48ae-a557-15294dbfaea8 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:49:03.427124 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1d56c83-fa6f-4882-8f68-1ef21f5f095b None None] Routers {'7e71b09c-215a-48ae-a557-15294dbfaea8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:49:03.428081 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a1d56c83-fa6f-4882-8f68-1ef21f5f095b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e71b09c-215a-48ae-a557-15294dbfaea8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:03.440741 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84572115-b746-4c62-8737-57f08b344f54 req-bd6153a3-7802-4817-a7d8-17979678e5c4 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/security-groups?id=21ff2230-c51e-41f4-a0d1-f064604ba09f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2307944 Dec 09 21:49:03.447887 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] For port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,segment=NetworkSegment(0189efa9-02eb-4071-ae6f-aee6c867d035),segment_id=0189efa9-02eb-4071-ae6f-aee6c867d035)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:49:03.488791 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] For port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:49:03.550085 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:49:03.553251 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-41d030bf-61e7-479c-9a22-94d06b32a8ed" -d '{"events": [{"server_uuid": "c9630177-3a8d-4c3a-8c62-dd93288c7232", "name": "network-vif-unplugged", "status": "completed", "tag": "165bd568-9d49-4f11-b8e1-eb1d0dc675b3"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:49:03.557959 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:03.560292 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1d0aaef3-2e73-4b63-ae07-66369e444051 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:03.563007 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1d0aaef3-2e73-4b63-ae07-66369e444051 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:03.591263 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Transition to ACTIVE for port object 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:49:03.602366 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:03.637873 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2e47c7e9-8871-4951-9cc5-86c4d01342e0 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=389b8ad507354513b0fd20fe7d15a239&name=default HTTP/1.1" status: 200 len: 3000 time: 0.8674810 Dec 09 21:49:03.640990 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46978) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:03.656015 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1d0aaef3-2e73-4b63-ae07-66369e444051 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:03.656562 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1d0aaef3-2e73-4b63-ae07-66369e444051 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Fanout notify agent at l3_agent the message router_deleted on router 7e71b09c-215a-48ae-a557-15294dbfaea8 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:49:03.673319 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1d0aaef3-2e73-4b63-ae07-66369e444051 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:03.674546 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1d0aaef3-2e73-4b63-ae07-66369e444051 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/routers/7e71b09c-215a-48ae-a557-15294dbfaea8 HTTP/1.1" status: 204 len: 168 time: 0.4726233 Dec 09 21:49:03.684270 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46980) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:03.693419 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-0978089d-0a04-4ae7-acba-d3da87703bfc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'router': {'name': 'tempest-RoutersTest-router-499408718', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:03.713741 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-a1d56c83-fa6f-4882-8f68-1ef21f5f095b None None] Set router 7e71b09c-215a-48ae-a557-15294dbfaea8 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:49:03.716183 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:03.720712 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e47c7e9-8871-4951-9cc5-86c4d01342e0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f7ca0d6f-484e-4b98-988a-496e4105d72e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:03.749841 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0978089d-0a04-4ae7-acba-d3da87703bfc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:03.750923 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0978089d-0a04-4ae7-acba-d3da87703bfc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:03.751544 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:49:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-169de056-5c8b-46da-ae14-5c0009267e5c x-openstack-request-id: req-169de056-5c8b-46da-ae14-5c0009267e5c {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:49:03.751900 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c9630177-3a8d-4c3a-8c62-dd93288c7232", "name": "network-vif-unplugged", "status": "completed", "tag": "165bd568-9d49-4f11-b8e1-eb1d0dc675b3", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:49:03.752200 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-169de056-5c8b-46da-ae14-5c0009267e5c {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:49:03.752658 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3', 'code': 200} Dec 09 21:49:03.798110 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a1d56c83-fa6f-4882-8f68-1ef21f5f095b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:58Z', 'revision_number': 11, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:03.800777 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6fdbe5af-7823-4627-8106-7511b033dbb4 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:49:03.819892 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] No DVR routers for this DVR port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:49:03.869888 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1d56c83-fa6f-4882-8f68-1ef21f5f095b None None] The sync data for ids ['7e71b09c-215a-48ae-a557-15294dbfaea8'] in n-d-713301-27 is: [{'id': '7e71b09c-215a-48ae-a557-15294dbfaea8', 'name': 'tempest-RoutersTest-router-254666938', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:48:16Z', 'updated_at': '2021-12-09T21:48:58Z', 'revision_number': 11, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:49:03.881182 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6fdbe5af-7823-4627-8106-7511b033dbb4, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6fdbe5af-7823-4627-8106-7511b033dbb4,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:49:03.892735 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:03.913390 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Pushing event updated for resources: {'Port': ['ID=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,revision_number=10']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:03.993189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=6fdbe5af-7823-4627-8106-7511b033dbb4,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:04.060027 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Attempting to bind port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:49:04.060369 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Attempting to bind port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '0189efa9-02eb-4071-ae6f-aee6c867d035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:49:04.060707 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Attempting to bind port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 on network 92500df7-83c8-4757-9b24-3ee4dfba2da3 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:49:04.069589 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 on network 92500df7-83c8-4757-9b24-3ee4dfba2da3 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:49:04.069929 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Attempting to bind port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 on network 92500df7-83c8-4757-9b24-3ee4dfba2da3 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:49:04.077305 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 48, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:49:04.077643 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Checking segment: {'id': '0189efa9-02eb-4071-ae6f-aee6c867d035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:49:04.078050 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Bound using segment: {'id': '0189efa9-02eb-4071-ae6f-aee6c867d035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:49:04.078460 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Bound port: 165bd568-9d49-4f11-b8e1-eb1d0dc675b3, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0189efa9-02eb-4071-ae6f-aee6c867d035', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:49:04.078817 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:04.103360 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['6fdbe5af-7823-4627-8106-7511b033dbb4'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:49:04.160509 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] For port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:49:04.168818 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] For port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,segment=NetworkSegment(0189efa9-02eb-4071-ae6f-aee6c867d035),segment_id=0189efa9-02eb-4071-ae6f-aee6c867d035)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:49:04.180195 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:04.285946 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Pushing event updated for resources: {'Port': ['ID=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,revision_number=11']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:04.290853 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0978089d-0a04-4ae7-acba-d3da87703bfc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:04.304563 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:04.307253 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:04.311557 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] 10.222.0.31 "PUT /v2.0/ports/165bd568-9d49-4f11-b8e1-eb1d0dc675b3 HTTP/1.1" status: 200 len: 1093 time: 1.3567138 Dec 09 21:49:04.314349 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:04.314990 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:04.315590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:04.316150 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:04.317355 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:04.317966 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:04.318514 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:04.319065 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:04.319643 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:04.321261 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:04.321849 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:04.322668 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:04.323217 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62816af6-f38d-43fd-9e54-a8439d990f32 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:04.351817 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0978089d-0a04-4ae7-acba-d3da87703bfc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:04.385825 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6ff9e91-8b0d-4bf5-8bc1-38ba4e9f67e4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:04.391341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-0dae5bbc-ee55-4bc2-b545-15c6b2b5cbf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:04.393192 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-0dae5bbc-ee55-4bc2-b545-15c6b2b5cbf3 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 1096 time: 0.0511470 Dec 09 21:49:04.411193 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da79faa9-c48d-462b-8881-73e63c3175f9 req-69532ac4-66fa-40ac-9579-2cfbe552e264 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:04.420015 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da79faa9-c48d-462b-8881-73e63c3175f9 req-69532ac4-66fa-40ac-9579-2cfbe552e264 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 944 time: 0.1491582 Dec 09 21:49:04.431756 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0978089d-0a04-4ae7-acba-d3da87703bfc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:04.433333 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0978089d-0a04-4ae7-acba-d3da87703bfc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 699 time: 0.7436643 Dec 09 21:49:04.438964 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 46986) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:04.447954 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b8112f6f-13a5-4cdf-917b-cc2930e732f1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Request body: {'router': {'admin_state_up': True}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:04.461356 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6ff9e91-8b0d-4bf5-8bc1-38ba4e9f67e4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:04.527141 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da79faa9-c48d-462b-8881-73e63c3175f9 req-41530a6d-ae05-4faf-9cd3-66465d68aa6a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1061907 Dec 09 21:49:04.574912 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6ff9e91-8b0d-4bf5-8bc1-38ba4e9f67e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:04.581716 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6ff9e91-8b0d-4bf5-8bc1-38ba4e9f67e4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:04.586297 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a6ff9e91-8b0d-4bf5-8bc1-38ba4e9f67e4 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/f7ca0d6f-484e-4b98-988a-496e4105d72e HTTP/1.1" status: 204 len: 168 time: 0.9410489 Dec 09 21:49:04.606872 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6ff9e91-8b0d-4bf5-8bc1-38ba4e9f67e4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f7ca0d6f-484e-4b98-988a-496e4105d72e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:04.692301 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-503b5125-f3fb-47b0-89fb-230bf7ad065f req-80c5de27-ebca-4bb6-8f8e-4d09b9b27b17 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:04.694159 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-503b5125-f3fb-47b0-89fb-230bf7ad065f req-80c5de27-ebca-4bb6-8f8e-4d09b9b27b17 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/ports?device_id=c025d0be-fbd5-4014-9c13-3abc61aeda0f HTTP/1.1" status: 200 len: 949 time: 0.0566585 Dec 09 21:49:04.724169 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-4b0a7940-f105-4db1-8fa6-227ee6756388 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:04.726269 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-4b0a7940-f105-4db1-8fa6-227ee6756388 service neutron] 10.222.0.31 "GET /v2.0/networks?id=92500df7-83c8-4757-9b24-3ee4dfba2da3 HTTP/1.1" status: 200 len: 897 time: 0.3253498 Dec 09 21:49:04.771818 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-503b5125-f3fb-47b0-89fb-230bf7ad065f req-b4d32503-a944-498f-b78b-105865a381e2 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/security-groups?id=21ff2230-c51e-41f4-a0d1-f064604ba09f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0643165 Dec 09 21:49:04.781258 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b8112f6f-13a5-4cdf-917b-cc2930e732f1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-640466', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-635239', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-104297'] for router, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:04.824725 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b8112f6f-13a5-4cdf-917b-cc2930e732f1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-640457', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-640448', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-635166'] for router, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:04.911237 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-01be542e-ca8b-44b7-a879-f31e1834b56e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3 HTTP/1.1" status: 200 len: 999 time: 0.1493022 Dec 09 21:49:04.939543 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6fdbe5af-7823-4627-8106-7511b033dbb4 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:49:04.956431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 46998) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:04.970264 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fed993e-1a4f-4907-ac42-82d5b22d9fc3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:04.978385 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-8be3e4ae-3f70-4f9a-9f45-9f26beff009c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:04.980392 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-8be3e4ae-3f70-4f9a-9f45-9f26beff009c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=13dde2f9-0dfd-4600-912c-44b7903e3595 HTTP/1.1" status: 200 len: 835 time: 0.0602248 Dec 09 21:49:04.986010 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b8112f6f-13a5-4cdf-917b-cc2930e732f1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Router 290d803f-8e46-417d-b9dd-fd63a5fe98b0 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:49:04.999243 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 6fdbe5af-7823-4627-8106-7511b033dbb4 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:49:05.007234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 6fdbe5af-7823-4627-8106-7511b033dbb4 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:49:05.007643 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:05.069255 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fed993e-1a4f-4907-ac42-82d5b22d9fc3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:05.075940 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fed993e-1a4f-4907-ac42-82d5b22d9fc3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:05.084154 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-5ef4e06e-a41a-4120-a323-2558117346d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:05.085823 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-5ef4e06e-a41a-4120-a323-2558117346d1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=92500df7-83c8-4757-9b24-3ee4dfba2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0959370 Dec 09 21:49:05.108915 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:05.127403 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8fed993e-1a4f-4907-ac42-82d5b22d9fc3 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=9d3fe87a4f8b4d56b5a1fb740e1960a3&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1675026 Dec 09 21:49:05.127403 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fed993e-1a4f-4907-ac42-82d5b22d9fc3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c6c81ed4-c47a-4ee8-8a98-65e82e2a0b99,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:05.129049 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47000) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:05.151184 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c025d0be-fbd5-4014-9c13-3abc61aeda0f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6fdbe5af-7823-4627-8106-7511b033dbb4'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:49:05.155083 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ea62244d-49fc-434c-9f73-b366b8e0f591" -d '{"events": [{"server_uuid": "c025d0be-fbd5-4014-9c13-3abc61aeda0f", "name": "network-vif-plugged", "status": "completed", "tag": "6fdbe5af-7823-4627-8106-7511b033dbb4"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:49:05.187071 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-308d079a-89b0-4c15-8d93-15b50c8f78b8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:05.191385 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 6fdbe5af-7823-4627-8106-7511b033dbb4, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6fdbe5af-7823-4627-8106-7511b033dbb4,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:49:05.202686 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:05.215817 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-308d079a-89b0-4c15-8d93-15b50c8f78b8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:05.223113 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b8112f6f-13a5-4cdf-917b-cc2930e732f1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:49:05.227542 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-14cadb25-089c-4f07-bbc6-a2da49e767ac service neutron] 10.222.0.31 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1077511 Dec 09 21:49:05.235543 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65816816-2fb3-4808-8e98-472ef85a6a6d None None] Sync routers for ids ['290d803f-8e46-417d-b9dd-fd63a5fe98b0'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:49:05.252630 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b8112f6f-13a5-4cdf-917b-cc2930e732f1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:05.263090 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:49:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-385a21a0-7c8c-4508-bab2-9dee5446e067 x-openstack-request-id: req-385a21a0-7c8c-4508-bab2-9dee5446e067 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:49:05.263878 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c025d0be-fbd5-4014-9c13-3abc61aeda0f", "name": "network-vif-plugged", "status": "completed", "tag": "6fdbe5af-7823-4627-8106-7511b033dbb4", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:49:05.264405 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-385a21a0-7c8c-4508-bab2-9dee5446e067 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:49:05.264954 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c025d0be-fbd5-4014-9c13-3abc61aeda0f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6fdbe5af-7823-4627-8106-7511b033dbb4', 'code': 200} Dec 09 21:49:05.266365 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65816816-2fb3-4808-8e98-472ef85a6a6d None None] Routers {'290d803f-8e46-417d-b9dd-fd63a5fe98b0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:49:05.271804 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-65816816-2fb3-4808-8e98-472ef85a6a6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['290d803f-8e46-417d-b9dd-fd63a5fe98b0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:05.280622 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b8112f6f-13a5-4cdf-917b-cc2930e732f1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "PUT /v2.0/routers/290d803f-8e46-417d-b9dd-fd63a5fe98b0 HTTP/1.1" status: 200 len: 693 time: 0.8325219 Dec 09 21:49:05.281699 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47006) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:05.339754 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=6fdbe5af-7823-4627-8106-7511b033dbb4,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:05.387632 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-65816816-2fb3-4808-8e98-472ef85a6a6d None None] Set router 290d803f-8e46-417d-b9dd-fd63a5fe98b0 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:49:05.395325 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d982492a-8af4-4566-9467-e246aec88759 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/routers/290d803f-8e46-417d-b9dd-fd63a5fe98b0 HTTP/1.1" status: 200 len: 699 time: 0.1095679 Dec 09 21:49:05.395885 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47008) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:05.406740 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b59a17cf-1c2a-4e4a-b3a8-13ec9caf8300 req-c5271fce-a9f8-46ef-ab68-4192c32c60e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:05.408387 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b59a17cf-1c2a-4e4a-b3a8-13ec9caf8300 req-c5271fce-a9f8-46ef-ab68-4192c32c60e8 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=c025d0be-fbd5-4014-9c13-3abc61aeda0f HTTP/1.1" status: 200 len: 1102 time: 0.0989115 Dec 09 21:49:05.425897 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-56e4ef8d-d4d0-4998-97bf-cdc91611c6c7 req-271b8cd7-ad5b-4cd3-8faa-8db0bb13950c service neutron] 10.222.0.31 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1517832 Dec 09 21:49:05.434957 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-67c8579e-2e09-4830-9f60-97cb7fbeca04 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/ports?device_id=290d803f-8e46-417d-b9dd-fd63a5fe98b0 HTTP/1.1" status: 200 len: 205 time: 0.0375085 Dec 09 21:49:05.437186 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47010) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:05.453418 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-65816816-2fb3-4808-8e98-472ef85a6a6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '290d803f-8e46-417d-b9dd-fd63a5fe98b0', 'name': 'tempest-RoutersTest-router-499408718', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:03Z', 'updated_at': '2021-12-09T21:49:04Z', 'revision_number': 2, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:05.473328 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b59a17cf-1c2a-4e4a-b3a8-13ec9caf8300 req-e4ab8c2b-8b4d-42a7-8616-cfed29bc760d service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=21ff2230-c51e-41f4-a0d1-f064604ba09f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0568907 Dec 09 21:49:05.489301 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65816816-2fb3-4808-8e98-472ef85a6a6d None None] Checking router: 290d803f-8e46-417d-b9dd-fd63a5fe98b0 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:49:05.495321 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-308d079a-89b0-4c15-8d93-15b50c8f78b8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:05.498236 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65816816-2fb3-4808-8e98-472ef85a6a6d None None] Routers {'290d803f-8e46-417d-b9dd-fd63a5fe98b0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:49:05.498363 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-308d079a-89b0-4c15-8d93-15b50c8f78b8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:05.498835 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-65816816-2fb3-4808-8e98-472ef85a6a6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:48:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['290d803f-8e46-417d-b9dd-fd63a5fe98b0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:05.507773 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-308d079a-89b0-4c15-8d93-15b50c8f78b8 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/c6c81ed4-c47a-4ee8-8a98-65e82e2a0b99 HTTP/1.1" status: 204 len: 168 time: 0.3724382 Dec 09 21:49:05.571536 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a9f9bb05-8bdc-4568-a6e0-6cf974960d0a tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:05.579398 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-802d16df-e0a4-4ede-8492-eeae0359a390 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:05.622055 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-65816816-2fb3-4808-8e98-472ef85a6a6d None None] Set router 290d803f-8e46-417d-b9dd-fd63a5fe98b0 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:49:05.698156 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-65816816-2fb3-4808-8e98-472ef85a6a6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '290d803f-8e46-417d-b9dd-fd63a5fe98b0', 'name': 'tempest-RoutersTest-router-499408718', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:03Z', 'updated_at': '2021-12-09T21:49:04Z', 'revision_number': 2, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:05.728325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-308d079a-89b0-4c15-8d93-15b50c8f78b8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c6c81ed4-c47a-4ee8-8a98-65e82e2a0b99,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:05.737091 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65816816-2fb3-4808-8e98-472ef85a6a6d None None] The sync data for ids ['290d803f-8e46-417d-b9dd-fd63a5fe98b0'] in n-d-713301-27 is: [{'id': '290d803f-8e46-417d-b9dd-fd63a5fe98b0', 'name': 'tempest-RoutersTest-router-499408718', 'tenant_id': '99ff5f79d7574ab091d0707b5e01465a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:03Z', 'updated_at': '2021-12-09T21:49:04Z', 'revision_number': 2, 'project_id': '99ff5f79d7574ab091d0707b5e01465a', 'gw_port_host': None}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:49:05.754200 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'tag': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:49:05.756734 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-43fc576e-8e61-4dff-b111-5a4453b1a805" -d '{"events": [{"name": "network-changed", "server_uuid": "c9630177-3a8d-4c3a-8c62-dd93288c7232", "tag": "165bd568-9d49-4f11-b8e1-eb1d0dc675b3"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:49:05.819524 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a9f9bb05-8bdc-4568-a6e0-6cf974960d0a tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:05.832844 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c73ab041-fb56-4df1-9e18-db76eef5dc3e req-d25aa329-4911-45a7-a450-48e561e47873 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:05.834567 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c73ab041-fb56-4df1-9e18-db76eef5dc3e req-d25aa329-4911-45a7-a450-48e561e47873 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 944 time: 0.1817796 Dec 09 21:49:05.836007 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a9f9bb05-8bdc-4568-a6e0-6cf974960d0a tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:05.907478 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a9f9bb05-8bdc-4568-a6e0-6cf974960d0a tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:05.907991 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a9f9bb05-8bdc-4568-a6e0-6cf974960d0a tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Fanout notify agent at l3_agent the message router_deleted on router 290d803f-8e46-417d-b9dd-fd63a5fe98b0 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:49:05.921158 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a9f9bb05-8bdc-4568-a6e0-6cf974960d0a tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:05.926502 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a9f9bb05-8bdc-4568-a6e0-6cf974960d0a tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/routers/290d803f-8e46-417d-b9dd-fd63a5fe98b0 HTTP/1.1" status: 204 len: 168 time: 0.4839621 Dec 09 21:49:05.926900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47026) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:05.950634 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c73ab041-fb56-4df1-9e18-db76eef5dc3e req-e6b105e1-4304-4e0a-bfb0-6dfceeeb247f tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1078191 Dec 09 21:49:05.983660 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0d54e4f8-1f1b-49d1-9277-e4cfe372d194 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/ports?device_id=290d803f-8e46-417d-b9dd-fd63a5fe98b0 HTTP/1.1" status: 200 len: 205 time: 0.0554514 Dec 09 21:49:05.985999 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47032) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:06.036761 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:49:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3e8aff42-9c71-4cf2-8511-13c3a5f2a918 x-openstack-request-id: req-3e8aff42-9c71-4cf2-8511-13c3a5f2a918 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:49:06.037052 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c9630177-3a8d-4c3a-8c62-dd93288c7232", "tag": "165bd568-9d49-4f11-b8e1-eb1d0dc675b3", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:49:06.037372 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-3e8aff42-9c71-4cf2-8511-13c3a5f2a918 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:49:06.037897 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'tag': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3', 'status': 'completed', 'code': 200} Dec 09 21:49:06.057161 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-07939bbc-052d-412f-a8c4-b6339499a1dc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] delete failed (client error): The resource could not be found. Dec 09 21:49:06.060750 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-07939bbc-052d-412f-a8c4-b6339499a1dc tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/routers/290d803f-8e46-417d-b9dd-fd63a5fe98b0 HTTP/1.1" status: 404 len: 336 time: 0.0709879 Dec 09 21:49:06.061522 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47036) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:06.113323 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-c1e13c1f-78b3-4b79-8682-5418ed178b46 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] DELETE failed (client error): The resource could not be found. Dec 09 21:49:06.113783 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-c1e13c1f-78b3-4b79-8682-5418ed178b46 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:49:06.117078 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c1e13c1f-78b3-4b79-8682-5418ed178b46 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/subnets/30fe26e6-a2ba-464c-a03f-3ae3a45b2df9 HTTP/1.1" status: 404 len: 337 time: 0.0543330 Dec 09 21:49:06.119810 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47040) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:06.181186 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-a43ab558-7dd9-4df0-b145-bfad9ec1aeb3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] DELETE failed (client error): The resource could not be found. Dec 09 21:49:06.181793 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-a43ab558-7dd9-4df0-b145-bfad9ec1aeb3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:49:06.185337 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a43ab558-7dd9-4df0-b145-bfad9ec1aeb3 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/subnets/6e953a0f-c973-4d55-8ec2-c3bb4eee4fe2 HTTP/1.1" status: 404 len: 337 time: 0.0644488 Dec 09 21:49:06.187799 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47042) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:06.219726 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-0de8b5fa-b27b-41cf-a0fa-9be782fad6c2 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] DELETE failed (client error): The resource could not be found. Dec 09 21:49:06.220197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-0de8b5fa-b27b-41cf-a0fa-9be782fad6c2 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:49:06.223653 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0de8b5fa-b27b-41cf-a0fa-9be782fad6c2 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/subnets/e0712e86-903f-45d7-9973-f305f804bb68 HTTP/1.1" status: 404 len: 337 time: 0.0348792 Dec 09 21:49:06.226501 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47046) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:06.233479 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fc576e-8e61-4dff-b111-5a4453b1a805 req-e4b1c350-08b1-4368-b512-3c33b90f3988 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:06.235197 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43fc576e-8e61-4dff-b111-5a4453b1a805 req-e4b1c350-08b1-4368-b512-3c33b90f3988 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 1096 time: 0.1460929 Dec 09 21:49:06.249070 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05978532-347c-4dae-a1d6-a27f05f26296 req-f643fc0a-48fb-4f82-a4c5-4f2356627c12 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:06.260209 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-05978532-347c-4dae-a1d6-a27f05f26296 req-f643fc0a-48fb-4f82-a4c5-4f2356627c12 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/ports?device_id=c025d0be-fbd5-4014-9c13-3abc61aeda0f HTTP/1.1" status: 200 len: 950 time: 0.1049705 Dec 09 21:49:06.269317 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-66177945-fc48-40f0-b81a-ae4de594e2a2 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] DELETE failed (client error): The resource could not be found. Dec 09 21:49:06.270110 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-66177945-fc48-40f0-b81a-ae4de594e2a2 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:49:06.273829 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-66177945-fc48-40f0-b81a-ae4de594e2a2 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/subnets/ad5e915f-e2d0-4254-b7f3-de1864bf4bcf HTTP/1.1" status: 404 len: 337 time: 0.0462718 Dec 09 21:49:06.276504 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47050) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:06.288380 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fc576e-8e61-4dff-b111-5a4453b1a805 req-7f536a65-9407-4aab-b00b-59ad36288df2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:06.289675 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-43fc576e-8e61-4dff-b111-5a4453b1a805 req-7f536a65-9407-4aab-b00b-59ad36288df2 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 1096 time: 0.1849055 Dec 09 21:49:06.313438 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8b1036db-38de-49b0-a778-ee70879e9c4b tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/ports?device_id=7e71b09c-215a-48ae-a557-15294dbfaea8 HTTP/1.1" status: 200 len: 205 time: 0.0357707 Dec 09 21:49:06.315808 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47056) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:06.439303 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fc576e-8e61-4dff-b111-5a4453b1a805 req-cad148e5-491c-4bb3-9f36-49bd63407a93 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:06.441353 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-05978532-347c-4dae-a1d6-a27f05f26296 req-96e7f4b3-06c2-40cf-b7e5-03445d8dcc9b tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/security-groups?id=21ff2230-c51e-41f4-a0d1-f064604ba09f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1714716 Dec 09 21:49:06.441719 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-43fc576e-8e61-4dff-b111-5a4453b1a805 req-cad148e5-491c-4bb3-9f36-49bd63407a93 service neutron] 10.222.0.31 "GET /v2.0/networks?id=92500df7-83c8-4757-9b24-3ee4dfba2da3 HTTP/1.1" status: 200 len: 897 time: 0.1259656 Dec 09 21:49:06.478491 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fc576e-8e61-4dff-b111-5a4453b1a805 req-331f5389-acb5-4a62-9b76-94f0bb665294 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:06.480141 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43fc576e-8e61-4dff-b111-5a4453b1a805 req-331f5389-acb5-4a62-9b76-94f0bb665294 service neutron] 10.222.0.10 "GET /v2.0/networks?id=92500df7-83c8-4757-9b24-3ee4dfba2da3 HTTP/1.1" status: 200 len: 897 time: 0.2165260 Dec 09 21:49:06.494863 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-fd30bd92-07f8-4e4a-9f19-319e41f98348 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] delete failed (client error): The resource could not be found. Dec 09 21:49:06.498267 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fd30bd92-07f8-4e4a-9f19-319e41f98348 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/routers/7e71b09c-215a-48ae-a557-15294dbfaea8 HTTP/1.1" status: 404 len: 336 time: 0.1790538 Dec 09 21:49:06.524712 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47062) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:06.561924 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-42fcb3e8-5199-4d0c-9697-cc79f4f58157 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/ports?device_id=d0b43639-53d9-4f82-aa3d-a2765e1623ed HTTP/1.1" status: 200 len: 205 time: 0.0358601 Dec 09 21:49:06.564390 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47064) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:06.585135 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43fc576e-8e61-4dff-b111-5a4453b1a805 req-379c830f-299b-41ef-87d5-f1a2bfeac80d service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3 HTTP/1.1" status: 200 len: 999 time: 0.0976224 Dec 09 21:49:06.604517 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-15c76422-a391-41f8-8924-32ca249c6240 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] delete failed (client error): The resource could not be found. Dec 09 21:49:06.605860 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-15c76422-a391-41f8-8924-32ca249c6240 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/routers/d0b43639-53d9-4f82-aa3d-a2765e1623ed HTTP/1.1" status: 404 len: 336 time: 0.0405207 Dec 09 21:49:06.610915 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47066) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:06.629362 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-43fc576e-8e61-4dff-b111-5a4453b1a805 req-2c769261-7dc6-40b5-8ed4-2f46a5a13be5 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3 HTTP/1.1" status: 200 len: 999 time: 0.1801088 Dec 09 21:49:06.659262 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-21ce5808-8dab-4470-a4d9-f8af46bf31e9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] DELETE failed (client error): The resource could not be found. Dec 09 21:49:06.659751 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-21ce5808-8dab-4470-a4d9-f8af46bf31e9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:49:06.667327 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-21ce5808-8dab-4470-a4d9-f8af46bf31e9 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/subnets/7a6c28be-88ad-4e2e-bae9-7fb8005e7b8e HTTP/1.1" status: 404 len: 337 time: 0.0527704 Dec 09 21:49:06.669737 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:06.671616 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47072) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:06.710145 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fc576e-8e61-4dff-b111-5a4453b1a805 req-3f84a014-a98f-41a1-8f22-815b8a895d7f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:06.711846 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-43fc576e-8e61-4dff-b111-5a4453b1a805 req-3f84a014-a98f-41a1-8f22-815b8a895d7f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=13dde2f9-0dfd-4600-912c-44b7903e3595 HTTP/1.1" status: 200 len: 835 time: 0.0624998 Dec 09 21:49:06.720128 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-333973ed-0c6a-4561-a4b8-8edc81456581 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/ports?device_id=f73e5df1-ece2-410e-963e-6fac076e97ba HTTP/1.1" status: 200 len: 205 time: 0.0472376 Dec 09 21:49:06.722743 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47076) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:06.782741 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-55d4efeb-39da-474f-b2c9-c97622470031 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] delete failed (client error): The resource could not be found. Dec 09 21:49:06.786500 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-55d4efeb-39da-474f-b2c9-c97622470031 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/routers/f73e5df1-ece2-410e-963e-6fac076e97ba HTTP/1.1" status: 404 len: 336 time: 0.0601652 Dec 09 21:49:06.786918 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47078) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:06.803316 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fc576e-8e61-4dff-b111-5a4453b1a805 req-5823c992-2787-4929-a5bf-b910250aa449 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:06.805016 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-43fc576e-8e61-4dff-b111-5a4453b1a805 req-5823c992-2787-4929-a5bf-b910250aa449 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=92500df7-83c8-4757-9b24-3ee4dfba2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0814302 Dec 09 21:49:06.808945 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fc576e-8e61-4dff-b111-5a4453b1a805 req-de8ae915-10db-4a1f-b557-262d04e75e38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:06.810486 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43fc576e-8e61-4dff-b111-5a4453b1a805 req-de8ae915-10db-4a1f-b557-262d04e75e38 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=13dde2f9-0dfd-4600-912c-44b7903e3595 HTTP/1.1" status: 200 len: 835 time: 0.2181182 Dec 09 21:49:06.861868 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:49:06.887180 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47082) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:06.895160 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-93a64f9f-9ac6-4516-8426-5585e2e8aee4 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/ports?device_id=2b0d6cbd-63cc-4c01-b04b-85ffaca65add HTTP/1.1" status: 200 len: 205 time: 0.1048634 Dec 09 21:49:06.958788 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:49:06.989827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43fc576e-8e61-4dff-b111-5a4453b1a805 req-057605b2-6392-4b55-83b3-6bcf5ff9a921 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:06.991556 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43fc576e-8e61-4dff-b111-5a4453b1a805 req-057605b2-6392-4b55-83b3-6bcf5ff9a921 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=92500df7-83c8-4757-9b24-3ee4dfba2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1410568 Dec 09 21:49:07.085328 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-e66eda87-4b64-4e1a-b056-f50634f184ca tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] delete failed (client error): The resource could not be found. Dec 09 21:49:07.089737 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e66eda87-4b64-4e1a-b056-f50634f184ca tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/routers/2b0d6cbd-63cc-4c01-b04b-85ffaca65add HTTP/1.1" status: 404 len: 336 time: 0.1990848 Dec 09 21:49:07.101850 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47090) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:07.193053 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-f73a4968-a97e-40b6-bc81-edb79803c4e0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] DELETE failed (client error): The resource could not be found. Dec 09 21:49:07.194855 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f73a4968-a97e-40b6-bc81-edb79803c4e0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:49:07.204582 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f73a4968-a97e-40b6-bc81-edb79803c4e0 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/subnets/78564a9f-be31-44e5-88cf-6b24abdc75c9 HTTP/1.1" status: 404 len: 337 time: 0.0998516 Dec 09 21:49:07.205373 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,segment=NetworkSegment(0189efa9-02eb-4071-ae6f-aee6c867d035),segment_id=0189efa9-02eb-4071-ae6f-aee6c867d035)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:49:07.218842 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47096) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:07.220266 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a825cc-e3a6-4ee5-8da0-f958889a8a31 req-0d1fdd8c-8a03-4626-8822-a82500c6115b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:07.222000 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32a825cc-e3a6-4ee5-8da0-f958889a8a31 req-0d1fdd8c-8a03-4626-8822-a82500c6115b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 944 time: 0.1086438 Dec 09 21:49:07.239604 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3', 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3', 'port_id': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3', 'mac_address': 'fa:16:3e:9d:7e:d5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 107, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '13dde2f9-0dfd-4600-912c-44b7903e3595', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:49:07.254067 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43fc576e-8e61-4dff-b111-5a4453b1a805 req-88c6a33e-e239-418f-a41d-bbb6305185fa service neutron] 10.222.0.10 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2554827 Dec 09 21:49:07.380030 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b2be3f6e-2cd7-4e9c-b018-e5e44d8fe8b1 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/ports?device_id=5d54d1c5-f7c6-4971-8e7f-ccd51e1a9d11 HTTP/1.1" status: 200 len: 205 time: 0.1491568 Dec 09 21:49:07.380278 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47102) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:07.399775 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-43fc576e-8e61-4dff-b111-5a4453b1a805 req-aaceca2d-21dc-4656-81fb-19954e27d1ce service neutron] 10.222.0.31 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5833235 Dec 09 21:49:07.441258 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:07.456782 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43fc576e-8e61-4dff-b111-5a4453b1a805 req-6c4637a5-51f3-4fa6-b209-2fb0fc19d2b3 service neutron] 10.222.0.10 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1868482 Dec 09 21:49:07.473209 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:49:07.498128 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,segment=NetworkSegment(0189efa9-02eb-4071-ae6f-aee6c867d035),segment_id=0189efa9-02eb-4071-ae6f-aee6c867d035)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:49:07.500199 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:49:07.507058 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:07.533568 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-b5541cf4-0ab4-49a7-9a81-a8a727a8fafa tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] delete failed (client error): The resource could not be found. Dec 09 21:49:07.546796 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b5541cf4-0ab4-49a7-9a81-a8a727a8fafa tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/routers/5d54d1c5-f7c6-4971-8e7f-ccd51e1a9d11 HTTP/1.1" status: 404 len: 336 time: 0.1628475 Dec 09 21:49:07.547973 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-32a825cc-e3a6-4ee5-8da0-f958889a8a31 req-9635771a-efbd-4b00-a9e1-cb3b14707979 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3091009 Dec 09 21:49:07.551747 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47110) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:07.562775 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,revision_number=12']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:07.607180 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-f2677890-cf65-4e85-a1fe-075094b1f1a8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] DELETE failed (client error): The resource could not be found. Dec 09 21:49:07.624065 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-f2677890-cf65-4e85-a1fe-075094b1f1a8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:49:07.627451 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f2677890-cf65-4e85-a1fe-075094b1f1a8 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/subnets/8f2a71ca-4303-4584-a6d9-06cfdaf294d4 HTTP/1.1" status: 404 len: 337 time: 0.0746055 Dec 09 21:49:07.630129 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47112) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:07.682243 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d2a8fcbd-e18e-4974-bf66-538773aee300 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "GET /v2.0/ports?device_id=4d8df6d4-f96f-4643-8663-28df67a09dd9 HTTP/1.1" status: 200 len: 205 time: 0.0505013 Dec 09 21:49:07.695877 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47118) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:07.696312 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-43fc576e-8e61-4dff-b111-5a4453b1a805 req-16d48f32-50b1-45d3-ae7b-8c08a3d563ff service neutron] 10.222.0.31 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1808949 Dec 09 21:49:07.721331 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['165bd568-9d49-4f11-b8e1-eb1d0dc675b3'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:49:07.761198 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-5770dd85-c8fd-4de8-8617-82d5673f3b6f tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] delete failed (client error): The resource could not be found. Dec 09 21:49:07.762965 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5770dd85-c8fd-4de8-8617-82d5673f3b6f tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/routers/4d8df6d4-f96f-4643-8663-28df67a09dd9 HTTP/1.1" status: 404 len: 336 time: 0.0656016 Dec 09 21:49:07.767346 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47124) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:07.812912 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-b319b3b4-b361-4b45-999f-8255acbd6354 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] DELETE failed (client error): The resource could not be found. Dec 09 21:49:07.813450 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-b319b3b4-b361-4b45-999f-8255acbd6354 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:49:07.817495 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b319b3b4-b361-4b45-999f-8255acbd6354 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/subnets/33b2b834-2f8a-441d-b1ed-4bc255441ae9 HTTP/1.1" status: 404 len: 337 time: 0.0490601 Dec 09 21:49:07.820495 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47126) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:07.825082 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6a89e49-73ae-44dd-8cb0-9f10c810f090 req-d8b8779a-048d-48fb-96ad-d75574fefadc tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:07.830227 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c6a89e49-73ae-44dd-8cb0-9f10c810f090 req-d8b8779a-048d-48fb-96ad-d75574fefadc tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/ports?device_id=c025d0be-fbd5-4014-9c13-3abc61aeda0f HTTP/1.1" status: 200 len: 950 time: 0.1426215 Dec 09 21:49:07.870472 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-521a31b0-1ddb-4903-9cc6-0476e726fa80 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] DELETE failed (client error): The resource could not be found. Dec 09 21:49:07.870952 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-521a31b0-1ddb-4903-9cc6-0476e726fa80 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 21:49:07.874863 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-521a31b0-1ddb-4903-9cc6-0476e726fa80 tempest-RoutersTest-558983387 tempest-RoutersTest-558983387-project] 10.222.0.13 "DELETE /v2.0/subnets/3f2e4b28-1001-407c-b523-5ee42432aa45 HTTP/1.1" status: 404 len: 337 time: 0.0521302 Dec 09 21:49:07.942360 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c6a89e49-73ae-44dd-8cb0-9f10c810f090 req-18574839-e508-4e71-8b8e-6eb5210a84f8 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/security-groups?id=21ff2230-c51e-41f4-a0d1-f064604ba09f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1056507 Dec 09 21:49:08.064998 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:08.375999 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47148) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:08.447815 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-420566c7-bc86-49d7-ae9d-162c11691eed req-7d2e027a-d6f5-464c-b7a0-d42c2b765476 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:08.450294 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-420566c7-bc86-49d7-ae9d-162c11691eed req-7d2e027a-d6f5-464c-b7a0-d42c2b765476 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/ports?device_id=c025d0be-fbd5-4014-9c13-3abc61aeda0f HTTP/1.1" status: 200 len: 950 time: 0.1168592 Dec 09 21:49:08.545954 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-420566c7-bc86-49d7-ae9d-162c11691eed req-a895b194-9aa6-46ff-b997-77cff1d40205 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/security-groups?id=21ff2230-c51e-41f4-a0d1-f064604ba09f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0893192 Dec 09 21:49:08.610451 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-616749d9-692e-4570-b45d-1a832dd52445 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=99ff5f79d7574ab091d0707b5e01465a&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2324221 Dec 09 21:49:08.613187 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47160) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:08.677612 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-561fca22-13b4-42a3-bd73-2dcfef28cfd8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:08.701527 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-561fca22-13b4-42a3-bd73-2dcfef28cfd8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:08.783694 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96f09215-fe28-4cbb-ba09-869eceb98585 req-2faaaddc-614d-4edf-8626-8f4e0cd81d6c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:08.785278 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96f09215-fe28-4cbb-ba09-869eceb98585 req-2faaaddc-614d-4edf-8626-8f4e0cd81d6c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 945 time: 0.1088970 Dec 09 21:49:08.794065 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-561fca22-13b4-42a3-bd73-2dcfef28cfd8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:08.796717 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-561fca22-13b4-42a3-bd73-2dcfef28cfd8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:08.797842 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-561fca22-13b4-42a3-bd73-2dcfef28cfd8 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/005c3f30-2191-496b-9f44-5309c170d02a HTTP/1.1" status: 204 len: 168 time: 0.1836250 Dec 09 21:49:08.823508 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-561fca22-13b4-42a3-bd73-2dcfef28cfd8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=005c3f30-2191-496b-9f44-5309c170d02a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:08.887095 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47170) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:08.887341 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-96f09215-fe28-4cbb-ba09-869eceb98585 req-7b8bf8ab-f06d-4c3d-9534-c68b6ec790ef tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0940046 Dec 09 21:49:08.957838 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3357f5a0-128e-43e4-937c-6ce6a953e392 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/floatingips/3a029f47-0fde-479e-a9de-26b4149b4355 HTTP/1.1" status: 200 len: 992 time: 0.0691369 Dec 09 21:49:08.983342 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:49:09.040988 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:49:09.045357 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:49:09.045708 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:09.136487 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:09.162559 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:49:09.164853 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2c283a38-ef4e-47ac-9d01-5c4b43f20947" -d '{"events": [{"server_uuid": "c9630177-3a8d-4c3a-8c62-dd93288c7232", "name": "network-vif-plugged", "status": "completed", "tag": "165bd568-9d49-4f11-b8e1-eb1d0dc675b3"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:49:09.180026 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,segment=NetworkSegment(0189efa9-02eb-4071-ae6f-aee6c867d035),segment_id=0189efa9-02eb-4071-ae6f-aee6c867d035)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:49:09.186207 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:09.218608 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:49:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fc6e4b4f-75fc-4f95-ad6f-d6e0b45e34f2 x-openstack-request-id: req-fc6e4b4f-75fc-4f95-ad6f-d6e0b45e34f2 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:49:09.218897 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c9630177-3a8d-4c3a-8c62-dd93288c7232", "name": "network-vif-plugged", "status": "completed", "tag": "165bd568-9d49-4f11-b8e1-eb1d0dc675b3", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:49:09.219149 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-fc6e4b4f-75fc-4f95-ad6f-d6e0b45e34f2 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:49:09.219594 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3', 'code': 200} Dec 09 21:49:09.250212 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,revision_number=13']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:09.545588 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58d4f531-58d3-4dc5-9abf-25fca0064c42 req-0086a7aa-64c6-443c-8bec-f69c8abb96e8 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:09.547425 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-58d4f531-58d3-4dc5-9abf-25fca0064c42 req-0086a7aa-64c6-443c-8bec-f69c8abb96e8 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.31 "GET /v2.0/ports?device_id=c025d0be-fbd5-4014-9c13-3abc61aeda0f HTTP/1.1" status: 200 len: 950 time: 0.0543494 Dec 09 21:49:09.576311 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47206) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:09.686217 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:09.691271 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-58d4f531-58d3-4dc5-9abf-25fca0064c42 req-e45f487d-ad01-4366-bca0-57cdb85d309c tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Deleting port 6fdbe5af-7823-4627-8106-7511b033dbb4 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:49:09.691923 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-58d4f531-58d3-4dc5-9abf-25fca0064c42 req-e45f487d-ad01-4366-bca0-57cdb85d309c tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:09.736973 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-110d0362-7d5c-4834-adcb-df39446ddc3c req-e78922f7-bfd1-4050-9f7a-51b3108b2a38 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:09.741442 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-110d0362-7d5c-4834-adcb-df39446ddc3c req-e78922f7-bfd1-4050-9f7a-51b3108b2a38 tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/ports?device_id=c025d0be-fbd5-4014-9c13-3abc61aeda0f HTTP/1.1" status: 200 len: 950 time: 0.1090958 Dec 09 21:49:09.758862 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-21a602bc-de4c-48de-b57e-ed0b9a5ec205 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1543717761-network', 'tenant_id': '6460bcfe203241c38961ac26d142e5df'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:09.825126 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-58d4f531-58d3-4dc5-9abf-25fca0064c42 req-e45f487d-ad01-4366-bca0-57cdb85d309c tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] For port 6fdbe5af-7823-4627-8106-7511b033dbb4, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=6fdbe5af-7823-4627-8106-7511b033dbb4,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:49:09.825510 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-58d4f531-58d3-4dc5-9abf-25fca0064c42 req-e45f487d-ad01-4366-bca0-57cdb85d309c tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:09.835050 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-110d0362-7d5c-4834-adcb-df39446ddc3c req-29849711-140a-4298-ab23-863df1284c8e tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/security-groups?id=21ff2230-c51e-41f4-a0d1-f064604ba09f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712593 Dec 09 21:49:09.835737 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-21a602bc-de4c-48de-b57e-ed0b9a5ec205 admin admin] Made reservation on behalf of 6460bcfe203241c38961ac26d142e5df for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:49:09.838415 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-21a602bc-de4c-48de-b57e-ed0b9a5ec205 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:09.849435 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-58d4f531-58d3-4dc5-9abf-25fca0064c42 req-e45f487d-ad01-4366-bca0-57cdb85d309c tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Calling delete_port for 6fdbe5af-7823-4627-8106-7511b033dbb4 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:49:09.851391 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-21a602bc-de4c-48de-b57e-ed0b9a5ec205 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:09.989716 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-21a602bc-de4c-48de-b57e-ed0b9a5ec205 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:09.994424 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-21a602bc-de4c-48de-b57e-ed0b9a5ec205 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:10.037687 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21a602bc-de4c-48de-b57e-ed0b9a5ec205 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=64aea58d-c6fa-42d3-a019-c37990caa26f,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:10.051772 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-21a602bc-de4c-48de-b57e-ed0b9a5ec205 admin admin] vlan segment allocate from pool success with {'vlan_id': 120, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:49:10.064449 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-21a602bc-de4c-48de-b57e-ed0b9a5ec205 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:10.064914 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-21a602bc-de4c-48de-b57e-ed0b9a5ec205 admin admin] Added segment 076bf76d-a336-4425-b8cd-2e5157782068 of type vlan for network c8450559-f88a-4801-824b-9bee06516588 Dec 09 21:49:10.122049 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-21a602bc-de4c-48de-b57e-ed0b9a5ec205 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:10.169168 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-21a602bc-de4c-48de-b57e-ed0b9a5ec205 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:10.171504 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21a602bc-de4c-48de-b57e-ed0b9a5ec205 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:10.172206 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-21a602bc-de4c-48de-b57e-ed0b9a5ec205 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:10.249084 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-21a602bc-de4c-48de-b57e-ed0b9a5ec205 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.6713817 Dec 09 21:49:10.257301 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47230) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:10.292252 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-3d7e3514-e451-4306-9a27-033b69e0a1be admin admin] Request body: {'subnet': {'network_id': 'c8450559-f88a-4801-824b-9bee06516588', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1543717761-subnet', 'tenant_id': '6460bcfe203241c38961ac26d142e5df', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:10.347189 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21a602bc-de4c-48de-b57e-ed0b9a5ec205 admin admin] Pushing event updated for resources: {'Network': ['ID=c8450559-f88a-4801-824b-9bee06516588,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:10.358861 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network c8450559-f88a-4801-824b-9bee06516588 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:49:10.371052 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3d7e3514-e451-4306-9a27-033b69e0a1be admin admin] Made reservation on behalf of 6460bcfe203241c38961ac26d142e5df for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:49:10.374181 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d7e3514-e451-4306-9a27-033b69e0a1be admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:10.517964 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-58d4f531-58d3-4dc5-9abf-25fca0064c42 req-e45f487d-ad01-4366-bca0-57cdb85d309c tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:10.530597 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['6fdbe5af-7823-4627-8106-7511b033dbb4'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:49:10.555495 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e45f487d-ad01-4366-bca0-57cdb85d309c tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Pushing event deleted for resources: {'Port': ['ID=6fdbe5af-7823-4627-8106-7511b033dbb4,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:10.621231 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-58d4f531-58d3-4dc5-9abf-25fca0064c42 req-e45f487d-ad01-4366-bca0-57cdb85d309c tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] No DVR routers for this DVR port 6fdbe5af-7823-4627-8106-7511b033dbb4 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:49:10.624410 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-58d4f531-58d3-4dc5-9abf-25fca0064c42 req-e45f487d-ad01-4366-bca0-57cdb85d309c tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:10.639673 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-58d4f531-58d3-4dc5-9abf-25fca0064c42 req-e45f487d-ad01-4366-bca0-57cdb85d309c tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.31 "DELETE /v2.0/ports/6fdbe5af-7823-4627-8106-7511b033dbb4 HTTP/1.1" status: 204 len: 173 time: 1.0820751 Dec 09 21:49:10.640590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c025d0be-fbd5-4014-9c13-3abc61aeda0f', 'name': 'network-vif-deleted', 'tag': '6fdbe5af-7823-4627-8106-7511b033dbb4'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:49:10.643157 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-da2a70c9-5bcf-49f3-8b99-26af34053b07" -d '{"events": [{"server_uuid": "c025d0be-fbd5-4014-9c13-3abc61aeda0f", "name": "network-vif-deleted", "tag": "6fdbe5af-7823-4627-8106-7511b033dbb4"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:49:10.664541 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d7e3514-e451-4306-9a27-033b69e0a1be admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:10.738081 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:49:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-466ce1f1-d2b2-4260-b292-09fb5719a064 x-openstack-request-id: req-466ce1f1-d2b2-4260-b292-09fb5719a064 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:49:10.738383 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c025d0be-fbd5-4014-9c13-3abc61aeda0f", "name": "network-vif-deleted", "tag": "6fdbe5af-7823-4627-8106-7511b033dbb4", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:49:10.738635 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-466ce1f1-d2b2-4260-b292-09fb5719a064 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:49:10.740955 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c025d0be-fbd5-4014-9c13-3abc61aeda0f', 'name': 'network-vif-deleted', 'tag': '6fdbe5af-7823-4627-8106-7511b033dbb4', 'status': 'completed', 'code': 200} Dec 09 21:49:10.768170 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d7e3514-e451-4306-9a27-033b69e0a1be admin admin] Pushing event updated for resources: {'Subnet': ['ID=b41932b0-bdd2-41c2-a213-b31fbab4e4ff,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:10.770935 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3d7e3514-e451-4306-9a27-033b69e0a1be admin admin] Checking segment: {'id': '076bf76d-a336-4425-b8cd-2e5157782068', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': 'c8450559-f88a-4801-824b-9bee06516588'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:49:10.771542 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d7e3514-e451-4306-9a27-033b69e0a1be admin admin] Network hostable DHCP agents. Network: c8450559-f88a-4801-824b-9bee06516588, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:49:10.795703 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3d7e3514-e451-4306-9a27-033b69e0a1be admin admin] Network c8450559-f88a-4801-824b-9bee06516588 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:49:10.810505 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-3d7e3514-e451-4306-9a27-033b69e0a1be admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, c8450559-f88a-4801-824b-9bee06516588) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:49:10.818741 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d7e3514-e451-4306-9a27-033b69e0a1be admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:10.820198 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12e63661-44aa-4a67-a1da-dbe2ee02fada None None] Network c8450559-f88a-4801-824b-9bee06516588 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:49:10.825772 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3d7e3514-e451-4306-9a27-033b69e0a1be admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:10.918750 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3d7e3514-e451-4306-9a27-033b69e0a1be admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.6520898 Dec 09 21:49:11.078261 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-504afa58-551c-4445-b2dd-1d8d80445994 None None] Network c8450559-f88a-4801-824b-9bee06516588 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:49:11.129448 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-82843888-6967-4e2f-8dcf-c823403552be req-eb7f031f-1f21-427c-8164-6df453bcde0e tempest-VolumesNegativeTest-1442622489 tempest-VolumesNegativeTest-1442622489-project] 10.222.0.13 "GET /v2.0/ports?device_id=c025d0be-fbd5-4014-9c13-3abc61aeda0f HTTP/1.1" status: 200 len: 210 time: 0.0897105 Dec 09 21:49:11.644112 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47276) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:11.649430 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-28c0e12f-d7be-443a-adef-dae895b6cc90 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1373617473-network', 'tenant_id': '637e088b7826409e8b17bac9a9264975'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:11.671646 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-28c0e12f-d7be-443a-adef-dae895b6cc90 admin admin] Made reservation on behalf of 637e088b7826409e8b17bac9a9264975 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:49:11.674702 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-28c0e12f-d7be-443a-adef-dae895b6cc90 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:11.683836 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-28c0e12f-d7be-443a-adef-dae895b6cc90 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:11.770531 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-28c0e12f-d7be-443a-adef-dae895b6cc90 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:11.775720 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-28c0e12f-d7be-443a-adef-dae895b6cc90 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:11.804899 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-28c0e12f-d7be-443a-adef-dae895b6cc90 admin admin] vlan segment allocate from pool success with {'vlan_id': 119, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:49:11.811825 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28c0e12f-d7be-443a-adef-dae895b6cc90 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=546f4ec9-b3ee-4405-93e0-8ba65d1937cc,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:11.817865 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-28c0e12f-d7be-443a-adef-dae895b6cc90 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:11.818239 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-28c0e12f-d7be-443a-adef-dae895b6cc90 admin admin] Added segment fec980e4-5140-48d7-8bb8-f8cb2fa01825 of type vlan for network fd06cc00-8760-40a3-a8af-e57d4bc7d522 Dec 09 21:49:11.860046 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-28c0e12f-d7be-443a-adef-dae895b6cc90 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:11.886252 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-28c0e12f-d7be-443a-adef-dae895b6cc90 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:11.887219 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28c0e12f-d7be-443a-adef-dae895b6cc90 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:11.887818 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-28c0e12f-d7be-443a-adef-dae895b6cc90 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:11.931924 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-28c0e12f-d7be-443a-adef-dae895b6cc90 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.2863698 Dec 09 21:49:11.934850 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47284) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:11.941169 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-91dc489a-f06b-49e3-b1e7-9a0a2c4a021b admin admin] Request body: {'subnet': {'network_id': 'fd06cc00-8760-40a3-a8af-e57d4bc7d522', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1373617473-subnet', 'tenant_id': '637e088b7826409e8b17bac9a9264975', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:11.963586 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28c0e12f-d7be-443a-adef-dae895b6cc90 admin admin] Pushing event updated for resources: {'Network': ['ID=fd06cc00-8760-40a3-a8af-e57d4bc7d522,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:11.968734 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-91dc489a-f06b-49e3-b1e7-9a0a2c4a021b admin admin] Made reservation on behalf of 637e088b7826409e8b17bac9a9264975 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:49:11.971314 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-91dc489a-f06b-49e3-b1e7-9a0a2c4a021b admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:11.992002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network fd06cc00-8760-40a3-a8af-e57d4bc7d522 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:49:12.145726 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-91dc489a-f06b-49e3-b1e7-9a0a2c4a021b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:12.207554 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91dc489a-f06b-49e3-b1e7-9a0a2c4a021b admin admin] Pushing event updated for resources: {'Subnet': ['ID=df96e4a5-2679-47a5-8413-09e729591788,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:12.217761 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91dc489a-f06b-49e3-b1e7-9a0a2c4a021b admin admin] Checking segment: {'id': 'fec980e4-5140-48d7-8bb8-f8cb2fa01825', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': 'fd06cc00-8760-40a3-a8af-e57d4bc7d522'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:49:12.218126 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91dc489a-f06b-49e3-b1e7-9a0a2c4a021b admin admin] Network hostable DHCP agents. Network: fd06cc00-8760-40a3-a8af-e57d4bc7d522, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:49:12.242769 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91dc489a-f06b-49e3-b1e7-9a0a2c4a021b admin admin] Network fd06cc00-8760-40a3-a8af-e57d4bc7d522 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:49:12.253164 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-91dc489a-f06b-49e3-b1e7-9a0a2c4a021b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, fd06cc00-8760-40a3-a8af-e57d4bc7d522) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:49:12.270263 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cdccffd5-6927-4d14-ac05-8ef7ce7282b2 None None] Network fd06cc00-8760-40a3-a8af-e57d4bc7d522 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:49:12.284711 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91dc489a-f06b-49e3-b1e7-9a0a2c4a021b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:12.288148 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-91dc489a-f06b-49e3-b1e7-9a0a2c4a021b admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:12.315621 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-91dc489a-f06b-49e3-b1e7-9a0a2c4a021b admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.3786325 Dec 09 21:49:12.399475 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bd0697ab-6f9f-4e9f-8527-eefa77a295f5 None None] Network fd06cc00-8760-40a3-a8af-e57d4bc7d522 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:49:12.526758 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47314) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:12.662025 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-d5c263bc-8680-4721-89d8-57a7bc30b2db admin admin] Deleting subnet b41932b0-bdd2-41c2-a213-b31fbab4e4ff {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:49:12.668541 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5c263bc-8680-4721-89d8-57a7bc30b2db admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:12.715055 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5c263bc-8680-4721-89d8-57a7bc30b2db admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:12.767634 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5c263bc-8680-4721-89d8-57a7bc30b2db admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:12.857438 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5c263bc-8680-4721-89d8-57a7bc30b2db admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:12.893524 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5c263bc-8680-4721-89d8-57a7bc30b2db admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b41932b0-bdd2-41c2-a213-b31fbab4e4ff,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:12.899167 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5c263bc-8680-4721-89d8-57a7bc30b2db admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:12.903378 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d5c263bc-8680-4721-89d8-57a7bc30b2db admin admin] 10.222.0.13 "DELETE /v2.0/subnets/b41932b0-bdd2-41c2-a213-b31fbab4e4ff HTTP/1.1" status: 204 len: 168 time: 0.3751514 Dec 09 21:49:12.907579 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47338) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:13.015121 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6fdbe5af-7823-4627-8106-7511b033dbb4 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:49:13.015693 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:13.068410 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 6fdbe5af-7823-4627-8106-7511b033dbb4 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:49:13.069312 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 6fdbe5af-7823-4627-8106-7511b033dbb4 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:49:13.116693 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:13.140606 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c8450559-f88a-4801-824b-9bee06516588']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:13.156137 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '076bf76d-a336-4425-b8cd-2e5157782068') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:13.156515 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '076bf76d-a336-4425-b8cd-2e5157782068') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:13.170386 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:13.192962 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:13.201376 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] Releasing vlan 120 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:49:13.202314 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:49:13.204997 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:49:13.320720 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:13.355138 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:13.362134 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47398) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:13.367985 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] 10.222.0.13 "DELETE /v2.0/networks/c8450559-f88a-4801-824b-9bee06516588 HTTP/1.1" status: 204 len: 168 time: 0.4592602 Dec 09 21:49:13.370141 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] Pushing event deleted for resources: {'Network': ['ID=c8450559-f88a-4801-824b-9bee06516588,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:13.380097 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:13.380575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:13.381057 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:13.381491 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:13.381937 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:13.382393 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:13.382909 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:13.383344 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:13.383875 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:13.384751 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:13.385598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:13.386035 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:13.386455 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9615e9f9-ed97-4a5b-ad88-fb5cc4cd4654 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:13.415115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-b0b2d352-2a5a-49e6-b903-23e550f9e94a admin admin] Deleting subnet df96e4a5-2679-47a5-8413-09e729591788 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:49:13.419148 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b0b2d352-2a5a-49e6-b903-23e550f9e94a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:13.473240 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b0b2d352-2a5a-49e6-b903-23e550f9e94a admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:13.521325 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b0b2d352-2a5a-49e6-b903-23e550f9e94a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:13.621036 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b0b2d352-2a5a-49e6-b903-23e550f9e94a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:13.653670 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0b2d352-2a5a-49e6-b903-23e550f9e94a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=df96e4a5-2679-47a5-8413-09e729591788,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:13.662261 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b0b2d352-2a5a-49e6-b903-23e550f9e94a admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:13.666575 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b0b2d352-2a5a-49e6-b903-23e550f9e94a admin admin] 10.222.0.13 "DELETE /v2.0/subnets/df96e4a5-2679-47a5-8413-09e729591788 HTTP/1.1" status: 204 len: 168 time: 0.3033242 Dec 09 21:49:13.669072 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47424) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:13.784946 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d5a5dd1-6a8b-4fdd-974a-3e33f8649acd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:13.880083 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d5a5dd1-6a8b-4fdd-974a-3e33f8649acd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:13.917117 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-0d5a5dd1-6a8b-4fdd-974a-3e33f8649acd admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fd06cc00-8760-40a3-a8af-e57d4bc7d522']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:13.928345 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-0d5a5dd1-6a8b-4fdd-974a-3e33f8649acd admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fec980e4-5140-48d7-8bb8-f8cb2fa01825') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:13.928642 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-0d5a5dd1-6a8b-4fdd-974a-3e33f8649acd admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fec980e4-5140-48d7-8bb8-f8cb2fa01825') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:13.945755 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d5a5dd1-6a8b-4fdd-974a-3e33f8649acd admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:13.956708 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d5a5dd1-6a8b-4fdd-974a-3e33f8649acd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:13.964900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0d5a5dd1-6a8b-4fdd-974a-3e33f8649acd admin admin] Releasing vlan 119 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:49:13.965322 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d5a5dd1-6a8b-4fdd-974a-3e33f8649acd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:49:13.977005 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:49:14.029968 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d5a5dd1-6a8b-4fdd-974a-3e33f8649acd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:14.036477 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d5a5dd1-6a8b-4fdd-974a-3e33f8649acd admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:14.039921 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0d5a5dd1-6a8b-4fdd-974a-3e33f8649acd admin admin] 10.222.0.13 "DELETE /v2.0/networks/fd06cc00-8760-40a3-a8af-e57d4bc7d522 HTTP/1.1" status: 204 len: 168 time: 0.3694499 Dec 09 21:49:14.052408 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d5a5dd1-6a8b-4fdd-974a-3e33f8649acd admin admin] Pushing event deleted for resources: {'Network': ['ID=fd06cc00-8760-40a3-a8af-e57d4bc7d522,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:14.418467 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47484) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:14.502535 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9d4f824c-8989-445c-b01d-7bc86f35a766 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=6460bcfe203241c38961ac26d142e5df&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0817094 Dec 09 21:49:14.505389 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47502) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:14.566359 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8d4f13ea-b54f-499e-b220-cea7507902b3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:14.599560 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8d4f13ea-b54f-499e-b220-cea7507902b3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:14.663343 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8d4f13ea-b54f-499e-b220-cea7507902b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:14.665964 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8d4f13ea-b54f-499e-b220-cea7507902b3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:14.667699 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8d4f13ea-b54f-499e-b220-cea7507902b3 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/64aea58d-c6fa-42d3-a019-c37990caa26f HTTP/1.1" status: 204 len: 168 time: 0.1612332 Dec 09 21:49:14.694022 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d4f13ea-b54f-499e-b220-cea7507902b3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=64aea58d-c6fa-42d3-a019-c37990caa26f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:15.249843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47540) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:15.303246 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1d66ca22-613b-4c25-9a82-0aa943ad69c8 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=637e088b7826409e8b17bac9a9264975&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0521607 Dec 09 21:49:15.305588 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47544) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:15.366775 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6b8cd0f5-e886-48b4-820e-5918ea70cedf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:15.394328 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6b8cd0f5-e886-48b4-820e-5918ea70cedf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:15.477617 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6b8cd0f5-e886-48b4-820e-5918ea70cedf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:15.483191 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6b8cd0f5-e886-48b4-820e-5918ea70cedf admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:15.489586 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6b8cd0f5-e886-48b4-820e-5918ea70cedf admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/546f4ec9-b3ee-4405-93e0-8ba65d1937cc HTTP/1.1" status: 204 len: 168 time: 0.1827521 Dec 09 21:49:15.516378 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b8cd0f5-e886-48b4-820e-5918ea70cedf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=546f4ec9-b3ee-4405-93e0-8ba65d1937cc,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:18.105275 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:49:20.281064 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47776) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:20.641540 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47780) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:20.641981 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7f239931-e93c-471c-8716-17cf769fe848 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=79cb26bbf252482b871bb8bb01655169&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3590100 Dec 09 21:49:20.746527 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-326aa567-ef91-4998-bb05-71ce886e4d43 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:20.773447 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-326aa567-ef91-4998-bb05-71ce886e4d43 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:20.853336 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-326aa567-ef91-4998-bb05-71ce886e4d43 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:20.857201 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-326aa567-ef91-4998-bb05-71ce886e4d43 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:20.862985 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-326aa567-ef91-4998-bb05-71ce886e4d43 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/21ff2230-c51e-41f4-a0d1-f064604ba09f HTTP/1.1" status: 204 len: 168 time: 0.2202766 Dec 09 21:49:20.874187 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-326aa567-ef91-4998-bb05-71ce886e4d43 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=21ff2230-c51e-41f4-a0d1-f064604ba09f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:21.537125 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47812) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:21.777921 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7bab3fed-cf42-43be-a08f-5a0bb96fb0ec admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:21.933554 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7bab3fed-cf42-43be-a08f-5a0bb96fb0ec admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:21.941535 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7bab3fed-cf42-43be-a08f-5a0bb96fb0ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:22.034115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bab3fed-cf42-43be-a08f-5a0bb96fb0ec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1dc73a88-f77b-46f3-a864-ebceb7096dff,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:22.086362 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7bab3fed-cf42-43be-a08f-5a0bb96fb0ec admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=74c36f3637cd47ddaf8ade046152e3fd&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5484164 Dec 09 21:49:22.089343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47826) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:22.201185 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1ef57230-72f3-4a18-843b-2fda7852a7d4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:22.249192 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1ef57230-72f3-4a18-843b-2fda7852a7d4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:22.331456 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1ef57230-72f3-4a18-843b-2fda7852a7d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:22.334094 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1ef57230-72f3-4a18-843b-2fda7852a7d4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:22.335289 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1ef57230-72f3-4a18-843b-2fda7852a7d4 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/1dc73a88-f77b-46f3-a864-ebceb7096dff HTTP/1.1" status: 204 len: 168 time: 0.2439733 Dec 09 21:49:22.352329 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ef57230-72f3-4a18-843b-2fda7852a7d4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1dc73a88-f77b-46f3-a864-ebceb7096dff,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:22.868668 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47846) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:22.883131 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8226acba-5e74-4ed5-b8c8-9a0614d26af8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:22.973909 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8226acba-5e74-4ed5-b8c8-9a0614d26af8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:22.983398 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8226acba-5e74-4ed5-b8c8-9a0614d26af8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:23.026402 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47850) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:23.032769 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8226acba-5e74-4ed5-b8c8-9a0614d26af8 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=3c62b0411adc45f6a13b04da105a49d2&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1633942 Dec 09 21:49:23.061265 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8226acba-5e74-4ed5-b8c8-9a0614d26af8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=645c5f5d-ccbb-4536-aacc-04294ff860a2,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:23.089384 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cca6dcb5-f444-450c-8a3f-1d10f8dd9b52 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:23.119813 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cca6dcb5-f444-450c-8a3f-1d10f8dd9b52 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:23.180073 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cca6dcb5-f444-450c-8a3f-1d10f8dd9b52 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:23.184695 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cca6dcb5-f444-450c-8a3f-1d10f8dd9b52 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:23.189740 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cca6dcb5-f444-450c-8a3f-1d10f8dd9b52 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/645c5f5d-ccbb-4536-aacc-04294ff860a2 HTTP/1.1" status: 204 len: 168 time: 0.1620739 Dec 09 21:49:23.216922 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cca6dcb5-f444-450c-8a3f-1d10f8dd9b52 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=645c5f5d-ccbb-4536-aacc-04294ff860a2,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:23.313854 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47858) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:23.705529 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-4a7a19a3-3189-4d4c-b244-ad6bcdc8d9d5 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'network': {'name': 'tempest-network-smoke--18766381', 'project_id': 'e863bf78256945798e7c717c650258aa', 'port_security_enabled': True}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:23.734981 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4a7a19a3-3189-4d4c-b244-ad6bcdc8d9d5 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Made reservation on behalf of e863bf78256945798e7c717c650258aa for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:49:23.739209 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4a7a19a3-3189-4d4c-b244-ad6bcdc8d9d5 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:23.760355 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4a7a19a3-3189-4d4c-b244-ad6bcdc8d9d5 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:23.852338 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4a7a19a3-3189-4d4c-b244-ad6bcdc8d9d5 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:23.859343 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4a7a19a3-3189-4d4c-b244-ad6bcdc8d9d5 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:23.924289 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4a7a19a3-3189-4d4c-b244-ad6bcdc8d9d5 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] vlan segment allocate from pool success with {'vlan_id': 136, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:49:23.940074 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a7a19a3-3189-4d4c-b244-ad6bcdc8d9d5 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'SecurityGroup': ['ID=06ad4920-6b5b-46e0-a62a-a31f5c7b2075,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:23.943101 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4a7a19a3-3189-4d4c-b244-ad6bcdc8d9d5 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:23.943458 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-4a7a19a3-3189-4d4c-b244-ad6bcdc8d9d5 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Added segment 502907cd-3e3c-478f-b989-3f2602eebfc8 of type vlan for network 5ed1c0c9-0d1a-458b-9180-fe96edb96b56 Dec 09 21:49:24.000989 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4a7a19a3-3189-4d4c-b244-ad6bcdc8d9d5 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:24.057769 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4a7a19a3-3189-4d4c-b244-ad6bcdc8d9d5 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:24.067555 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a7a19a3-3189-4d4c-b244-ad6bcdc8d9d5 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:24.068174 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4a7a19a3-3189-4d4c-b244-ad6bcdc8d9d5 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:24.113406 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4a7a19a3-3189-4d4c-b244-ad6bcdc8d9d5 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.7978997 Dec 09 21:49:24.116757 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47884) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:24.123711 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-33438052-5d7f-455a-bdb7-9f2b93482508 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-792281405', 'admin_state_up': True, 'project_id': 'e863bf78256945798e7c717c650258aa', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:24.170728 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-33438052-5d7f-455a-bdb7-9f2b93482508 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:24.175584 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-33438052-5d7f-455a-bdb7-9f2b93482508 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:24.185687 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a7a19a3-3189-4d4c-b244-ad6bcdc8d9d5 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'Network': ['ID=5ed1c0c9-0d1a-458b-9180-fe96edb96b56,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:24.197992 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 5ed1c0c9-0d1a-458b-9180-fe96edb96b56 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:49:24.276765 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-33438052-5d7f-455a-bdb7-9f2b93482508 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:24.466141 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-33438052-5d7f-455a-bdb7-9f2b93482508 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:24.789596 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-33438052-5d7f-455a-bdb7-9f2b93482508 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:24.823726 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-33438052-5d7f-455a-bdb7-9f2b93482508 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:24.939942 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-33438052-5d7f-455a-bdb7-9f2b93482508 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Allocated IP 172.25.3.36 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:49:25.057983 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-33438052-5d7f-455a-bdb7-9f2b93482508 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:25.097209 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-33438052-5d7f-455a-bdb7-9f2b93482508 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:25.146871 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-33438052-5d7f-455a-bdb7-9f2b93482508 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:49:25.151908 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-33438052-5d7f-455a-bdb7-9f2b93482508 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:49:25.156139 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-33438052-5d7f-455a-bdb7-9f2b93482508 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:49:25.176100 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-94ed6307-199c-49b6-bdb8-2a5ac5629aa8 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:49:25.204187 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33438052-5d7f-455a-bdb7-9f2b93482508 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'Port': ['ID=4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:25.233568 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-cb6621ea-16a7-4575-8747-e8f636b760da None None] Provisioning complete for port 4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:49:25.234547 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cb6621ea-16a7-4575-8747-e8f636b760da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:25.274351 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-cb6621ea-16a7-4575-8747-e8f636b760da None None] Port 4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:49:25.495387 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-33438052-5d7f-455a-bdb7-9f2b93482508 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:25.730196 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-33438052-5d7f-455a-bdb7-9f2b93482508 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:25.892967 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-33438052-5d7f-455a-bdb7-9f2b93482508 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:49:26.002192 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-33438052-5d7f-455a-bdb7-9f2b93482508 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:49:26.013229 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] Sync routers for ids ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:49:26.025860 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-33438052-5d7f-455a-bdb7-9f2b93482508 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:26.030191 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] Routers {'6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:49:26.030331 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-33438052-5d7f-455a-bdb7-9f2b93482508 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 885 time: 1.9087152 Dec 09 21:49:26.030428 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:49:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:26.031905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47924) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:26.169052 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] Set router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:49:26.286978 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-75ad95bc-47e8-4a55-8563-fe8c1220b27a tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] 10.222.0.13 "GET /v2.0/subnets?project_id=e863bf78256945798e7c717c650258aa&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.2536964 Dec 09 21:49:26.290121 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47934) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:26.398174 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-72e62dc7-6bfb-4a11-87ee-84fb092adc21 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:26.401557 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-72e62dc7-6bfb-4a11-87ee-84fb092adc21 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1103323 Dec 09 21:49:26.405327 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47936) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:26.429341 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'name': 'tempest-TestNetworkBasicOps-router-792281405', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36'}], 'enable_snat': True}, 'gw_port_id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:25Z', 'revision_number': 3, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:2c:72', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3592, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:24Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:26.451933 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b56fb628-edd5-4eb1-9242-205b174e0d69 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] 10.222.0.13 "GET /v2.0/subnets?network_id=97925a19-460a-4476-8208-41db134b6c83&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0447316 Dec 09 21:49:26.454478 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 47938) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:26.459905 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-bf343d76-55f7-44ae-aa30-34e2c373e57b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1508850067', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'project_id': 'e863bf78256945798e7c717c650258aa', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:26.467607 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] Checking router: 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:49:26.468053 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] Updating router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b port 4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:49:26.494188 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:26.581357 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bf343d76-55f7-44ae-aa30-34e2c373e57b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Made reservation on behalf of e863bf78256945798e7c717c650258aa for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:49:26.585319 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bf343d76-55f7-44ae-aa30-34e2c373e57b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:26.768794 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:26.778431 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:26.814967 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eece9d1c-d9f3-4a5e-9a6a-917938fef62b None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:49:26.818118 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bf343d76-55f7-44ae-aa30-34e2c373e57b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:26.888822 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf343d76-55f7-44ae-aa30-34e2c373e57b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'Subnet': ['ID=01104ce9-312c-40a5-b51d-c30bc463bf2c,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:26.903215 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] Attempting to bind port 4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:49:26.903742 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] Attempting to bind port 4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:49:26.904287 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] Attempting to bind port 4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:49:26.919469 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bf343d76-55f7-44ae-aa30-34e2c373e57b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Checking segment: {'id': '502907cd-3e3c-478f-b989-3f2602eebfc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:49:26.920015 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf343d76-55f7-44ae-aa30-34e2c373e57b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Network hostable DHCP agents. Network: 5ed1c0c9-0d1a-458b-9180-fe96edb96b56, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:49:26.924502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 49, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:49:26.925161 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:49:26.925567 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:26.925959 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:49:26.926412 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] Bound port: 4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:49:26.926957 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:26.949462 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf343d76-55f7-44ae-aa30-34e2c373e57b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Network 5ed1c0c9-0d1a-458b-9180-fe96edb96b56 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:49:26.951758 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6c802b2-3554-489e-b520-1f04fbad7c49 None None] Pushing event updated for resources: {'Port': ['ID=4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:26.965256 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1ffe1d81-b074-4ee0-85b1-265f0879b5cc None None] Provisioning complete for port 4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:49:26.965903 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1ffe1d81-b074-4ee0-85b1-265f0879b5cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:26.967322 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-bf343d76-55f7-44ae-aa30-34e2c373e57b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 5ed1c0c9-0d1a-458b-9180-fe96edb96b56) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:49:26.974668 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf343d76-55f7-44ae-aa30-34e2c373e57b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:26.975371 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bf343d76-55f7-44ae-aa30-34e2c373e57b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:26.990470 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-470d5d47-6223-4478-b2a2-1eedf6bd7243 None None] Network 5ed1c0c9-0d1a-458b-9180-fe96edb96b56 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:49:26.997695 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bf343d76-55f7-44ae-aa30-34e2c373e57b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.5419059 Dec 09 21:49:27.000394 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 47960) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:27.052347 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-1ffe1d81-b074-4ee0-85b1-265f0879b5cc None None] Port 4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:49:27.101018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] For port 4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:49:27.124781 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] For port 4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:49:27.157121 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:27.187855 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6b1228c-4d34-4846-9d75-4e40f14c5560 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'project_id': 'e863bf78256945798e7c717c650258aa', 'fixed_ips': [{'subnet_id': '01104ce9-312c-40a5-b51d-c30bc463bf2c'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:49:27.188900 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6b1228c-4d34-4846-9d75-4e40f14c5560 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:27.228818 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-201bb435-1764-4b34-8b12-d998b21f7d32 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:49:27.260554 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] Routers {'6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:49:27.261208 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:49:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:27.733956 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6c802b2-3554-489e-b520-1f04fbad7c49 None None] Pushing event updated for resources: {'Port': ['ID=4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:27.753436 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f59ef2a5-8145-4b51-9b04-afe31cea9d09 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:27.754084 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] Set router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:49:27.921536 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:27.940318 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:27.980254 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1ac7a57a-8ca3-410c-94cf-6b77fbb53169 None None] Provisioning complete for port 4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:49:27.980521 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1ac7a57a-8ca3-410c-94cf-6b77fbb53169 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:28.110368 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-c6b1228c-4d34-4846-9d75-4e40f14c5560 None None] Allocated IP 172.20.0.2 (5ed1c0c9-0d1a-458b-9180-fe96edb96b56/01104ce9-312c-40a5-b51d-c30bc463bf2c/a9c0abd0-adfe-418f-b8d5-32d910b49066) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:49:28.222642 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1ac7a57a-8ca3-410c-94cf-6b77fbb53169 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:28.256407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'name': 'tempest-TestNetworkBasicOps-router-792281405', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36'}], 'enable_snat': True}, 'gw_port_id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:25Z', 'revision_number': 3, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:2c:72', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3592, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:28.267686 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-1ac7a57a-8ca3-410c-94cf-6b77fbb53169 None None] For port 4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:49:28.298625 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a886a3cf-d4fa-47a0-94c7-546fc9c70d1b None None] The sync data for ids ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'] in n-d-713301-27 is: [{'id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'name': 'tempest-TestNetworkBasicOps-router-792281405', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36'}], 'enable_snat': True}, 'gw_port_id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:25Z', 'revision_number': 3, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:2c:72', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3592, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:49:28.306843 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1ac7a57a-8ca3-410c-94cf-6b77fbb53169 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:28.401136 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6b1228c-4d34-4846-9d75-4e40f14c5560 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:28.405894 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ac7a57a-8ca3-410c-94cf-6b77fbb53169 None None] Pushing event updated for resources: {'Port': ['ID=4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:28.418955 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6b1228c-4d34-4846-9d75-4e40f14c5560 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:28.460442 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6b1228c-4d34-4846-9d75-4e40f14c5560 None None] Network 5ed1c0c9-0d1a-458b-9180-fe96edb96b56 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:49:28.465449 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-c6b1228c-4d34-4846-9d75-4e40f14c5560 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:49:28.469034 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6b1228c-4d34-4846-9d75-4e40f14c5560 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:49:28.470252 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-f59ef2a5-8145-4b51-9b04-afe31cea9d09 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Allocated IP 172.20.0.1 (5ed1c0c9-0d1a-458b-9180-fe96edb96b56/01104ce9-312c-40a5-b51d-c30bc463bf2c/efd747c8-9308-4be4-8445-86a9ce208bf3) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:49:28.480786 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6b1228c-4d34-4846-9d75-4e40f14c5560 None None] Pushing event updated for resources: {'Port': ['ID=a9c0abd0-adfe-418f-b8d5-32d910b49066,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:28.537379 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-c6b1228c-4d34-4846-9d75-4e40f14c5560 None None] Attempting to bind port a9c0abd0-adfe-418f-b8d5-32d910b49066 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:49:28.537763 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-c6b1228c-4d34-4846-9d75-4e40f14c5560 None None] Attempting to bind port a9c0abd0-adfe-418f-b8d5-32d910b49066 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '502907cd-3e3c-478f-b989-3f2602eebfc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:49:28.538123 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6b1228c-4d34-4846-9d75-4e40f14c5560 None None] Attempting to bind port a9c0abd0-adfe-418f-b8d5-32d910b49066 on network 5ed1c0c9-0d1a-458b-9180-fe96edb96b56 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:49:28.544782 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6b1228c-4d34-4846-9d75-4e40f14c5560 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 49, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:49:28.545167 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6b1228c-4d34-4846-9d75-4e40f14c5560 None None] Checking segment: {'id': '502907cd-3e3c-478f-b989-3f2602eebfc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:49:28.545576 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6b1228c-4d34-4846-9d75-4e40f14c5560 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:28.545972 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6b1228c-4d34-4846-9d75-4e40f14c5560 None None] Bound using segment: {'id': '502907cd-3e3c-478f-b989-3f2602eebfc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:49:28.546602 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-c6b1228c-4d34-4846-9d75-4e40f14c5560 None None] Bound port: a9c0abd0-adfe-418f-b8d5-32d910b49066, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '502907cd-3e3c-478f-b989-3f2602eebfc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:49:28.546999 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6b1228c-4d34-4846-9d75-4e40f14c5560 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:28.674350 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c6b1228c-4d34-4846-9d75-4e40f14c5560 None None] For port a9c0abd0-adfe-418f-b8d5-32d910b49066, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:49:28.682661 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c6b1228c-4d34-4846-9d75-4e40f14c5560 None None] For port a9c0abd0-adfe-418f-b8d5-32d910b49066, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a9c0abd0-adfe-418f-b8d5-32d910b49066,segment=NetworkSegment(502907cd-3e3c-478f-b989-3f2602eebfc8),segment_id=502907cd-3e3c-478f-b989-3f2602eebfc8)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:49:28.702397 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6b1228c-4d34-4846-9d75-4e40f14c5560 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:28.783968 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6b1228c-4d34-4846-9d75-4e40f14c5560 None None] Pushing event updated for resources: {'Port': ['ID=a9c0abd0-adfe-418f-b8d5-32d910b49066,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:29.101111 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f59ef2a5-8145-4b51-9b04-afe31cea9d09 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:29.187921 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f59ef2a5-8145-4b51-9b04-afe31cea9d09 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:29.280816 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f59ef2a5-8145-4b51-9b04-afe31cea9d09 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Network 5ed1c0c9-0d1a-458b-9180-fe96edb96b56 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:49:29.284830 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-f59ef2a5-8145-4b51-9b04-afe31cea9d09 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:49:29.301971 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f59ef2a5-8145-4b51-9b04-afe31cea9d09 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:49:29.378986 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f59ef2a5-8145-4b51-9b04-afe31cea9d09 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'Port': ['ID=efd747c8-9308-4be4-8445-86a9ce208bf3,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:29.414255 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f59ef2a5-8145-4b51-9b04-afe31cea9d09 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:29.623287 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f59ef2a5-8145-4b51-9b04-afe31cea9d09 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:29.894865 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:49:29.962960 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:49:29.963872 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:30.044550 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f59ef2a5-8145-4b51-9b04-afe31cea9d09 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:30.054944 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f59ef2a5-8145-4b51-9b04-afe31cea9d09 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:30.077800 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a9c0abd0-adfe-418f-b8d5-32d910b49066 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:49:30.094137 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48022) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:30.136739 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port a9c0abd0-adfe-418f-b8d5-32d910b49066 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:49:30.137112 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:30.175263 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f59ef2a5-8145-4b51-9b04-afe31cea9d09 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'Port': ['ID=efd747c8-9308-4be4-8445-86a9ce208bf3,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:30.204748 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f59ef2a5-8145-4b51-9b04-afe31cea9d09 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:30.287331 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-36547d76-b764-437d-8d8b-180e02f69105 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:30.294341 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:30.326468 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f59ef2a5-8145-4b51-9b04-afe31cea9d09 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Network 5ed1c0c9-0d1a-458b-9180-fe96edb96b56 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:49:30.328159 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-f59ef2a5-8145-4b51-9b04-afe31cea9d09 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:49:30.337728 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port a9c0abd0-adfe-418f-b8d5-32d910b49066, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a9c0abd0-adfe-418f-b8d5-32d910b49066,segment=NetworkSegment(502907cd-3e3c-478f-b989-3f2602eebfc8),segment_id=502907cd-3e3c-478f-b989-3f2602eebfc8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:49:30.344864 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:30.403544 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-36547d76-b764-437d-8d8b-180e02f69105 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:30.415533 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-36547d76-b764-437d-8d8b-180e02f69105 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:30.465751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=a9c0abd0-adfe-418f-b8d5-32d910b49066,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:30.478694 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-36547d76-b764-437d-8d8b-180e02f69105 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=fe2d2ac8630c4909866315c2374edfc4&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3831193 Dec 09 21:49:30.479708 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36547d76-b764-437d-8d8b-180e02f69105 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5d923e9a-9c3e-4e61-8615-c8535799290a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:30.484274 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48028) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:30.539614 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f59ef2a5-8145-4b51-9b04-afe31cea9d09 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:49:30.606936 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6df38355-f516-42e8-b910-b847c5cd49f1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:30.661662 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6df38355-f516-42e8-b910-b847c5cd49f1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:30.766024 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6df38355-f516-42e8-b910-b847c5cd49f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:30.769384 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6df38355-f516-42e8-b910-b847c5cd49f1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:30.770960 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6df38355-f516-42e8-b910-b847c5cd49f1 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/5d923e9a-9c3e-4e61-8615-c8535799290a HTTP/1.1" status: 204 len: 168 time: 0.2854805 Dec 09 21:49:30.795046 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6df38355-f516-42e8-b910-b847c5cd49f1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5d923e9a-9c3e-4e61-8615-c8535799290a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:30.816728 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f59ef2a5-8145-4b51-9b04-afe31cea9d09 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:49:30.823027 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f59ef2a5-8145-4b51-9b04-afe31cea9d09 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "PUT /v2.0/routers/6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.8214455 Dec 09 21:49:30.825808 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48044) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:31.039628 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] Sync routers for ids ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:49:31.054539 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] Routers {'6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:49:31.057726 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:49:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:31.142914 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8282a828-404c-4af1-873a-c0530669e3c6 None None] Network 5ed1c0c9-0d1a-458b-9180-fe96edb96b56 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:49:31.223940 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-afac7439-492d-4097-8f35-924f091d0ffa None None] Provisioning complete for port a9c0abd0-adfe-418f-b8d5-32d910b49066 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:49:31.224717 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-afac7439-492d-4097-8f35-924f091d0ffa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:31.274525 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] Set router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:49:31.348044 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48052) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:31.361887 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da1bc255-22a4-4ef0-9893-799ae666cfe2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:31.393590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc4778f3-aaeb-4ae1-a1b2-09900112c2a7 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:31.394918 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc4778f3-aaeb-4ae1-a1b2-09900112c2a7 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:31.395983 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc4778f3-aaeb-4ae1-a1b2-09900112c2a7 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:31.396602 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc4778f3-aaeb-4ae1-a1b2-09900112c2a7 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:31.397215 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc4778f3-aaeb-4ae1-a1b2-09900112c2a7 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:31.399556 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-dc4778f3-aaeb-4ae1-a1b2-09900112c2a7 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] 10.222.0.13 "GET /v2.0/networks HTTP/1.1" status: 200 len: 3568 time: 0.5724275 Dec 09 21:49:31.402455 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48054) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:31.540334 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da1bc255-22a4-4ef0-9893-799ae666cfe2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:31.557564 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da1bc255-22a4-4ef0-9893-799ae666cfe2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:31.604890 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a4ba95e-5749-4e37-be2b-ccdb1bd36523 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:31.609561 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a4ba95e-5749-4e37-be2b-ccdb1bd36523 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:31.610382 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a4ba95e-5749-4e37-be2b-ccdb1bd36523 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:31.611062 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a4ba95e-5749-4e37-be2b-ccdb1bd36523 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:31.611740 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a4ba95e-5749-4e37-be2b-ccdb1bd36523 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:31.621666 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9a4ba95e-5749-4e37-be2b-ccdb1bd36523 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 3351 time: 0.2163899 Dec 09 21:49:31.624215 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48056) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:31.638929 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da1bc255-22a4-4ef0-9893-799ae666cfe2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3dc6a635-6c86-46fa-9b28-79668f2cc0b2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:31.655243 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'name': 'tempest-TestNetworkBasicOps-router-792281405', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36'}], 'enable_snat': True}, 'gw_port_id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:29Z', 'revision_number': 4, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:2c:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3592, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'efd747c8-9308-4be4-8445-86a9ce208bf3', 'name': '', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:c1:e4:21', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:27Z', 'updated_at': '2021-12-09T21:49:29Z', 'revision_number': 2, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:31.685090 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-da1bc255-22a4-4ef0-9893-799ae666cfe2 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=960a7de2d2de4e36b3eb6d76b3cfddea&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3358011 Dec 09 21:49:31.686114 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48058) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:31.744914 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] Checking router: 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:49:31.745267 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] Updating router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b port efd747c8-9308-4be4-8445-86a9ce208bf3 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:49:31.831607 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a9c0abd0-adfe-418f-b8d5-32d910b49066 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:49:31.834402 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dd100c24-bb59-48c6-acd5-d2851bb8b492 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:31.896916 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dd100c24-bb59-48c6-acd5-d2851bb8b492 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:31.964308 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port a9c0abd0-adfe-418f-b8d5-32d910b49066 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:49:31.964745 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:32.015291 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dd100c24-bb59-48c6-acd5-d2851bb8b492 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:32.018526 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dd100c24-bb59-48c6-acd5-d2851bb8b492 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:32.041576 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-dd100c24-bb59-48c6-acd5-d2851bb8b492 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/3dc6a635-6c86-46fa-9b28-79668f2cc0b2 HTTP/1.1" status: 204 len: 168 time: 0.3542013 Dec 09 21:49:32.063201 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd100c24-bb59-48c6-acd5-d2851bb8b492 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3dc6a635-6c86-46fa-9b28-79668f2cc0b2,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:32.137222 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d3488773-1807-4fdb-bb04-4c1649d68ab4 None None] Provisioning complete for port efd747c8-9308-4be4-8445-86a9ce208bf3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:49:32.137603 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d3488773-1807-4fdb-bb04-4c1649d68ab4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:32.161683 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:32.191889 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d3488773-1807-4fdb-bb04-4c1649d68ab4 None None] Port efd747c8-9308-4be4-8445-86a9ce208bf3 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:49:32.218539 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d3488773-1807-4fdb-bb04-4c1649d68ab4 None None] Provisioning complete for port a9c0abd0-adfe-418f-b8d5-32d910b49066 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:49:32.219378 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d3488773-1807-4fdb-bb04-4c1649d68ab4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:32.569944 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7c1dc634-e3ef-42c6-b241-9c9a1b6966a1 None None] Provisioning complete for port efd747c8-9308-4be4-8445-86a9ce208bf3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:49:32.571733 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7c1dc634-e3ef-42c6-b241-9c9a1b6966a1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:32.667926 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-7c1dc634-e3ef-42c6-b241-9c9a1b6966a1 None None] Port efd747c8-9308-4be4-8445-86a9ce208bf3 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:49:32.752062 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:32.762071 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:32.874401 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a8c8caf-0dc7-41a3-b1d2-f8737045b9b1 None None] Pushing event updated for resources: {'Port': ['ID=efd747c8-9308-4be4-8445-86a9ce208bf3,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:33.030637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5e135c10-8fb4-49fa-b6bc-feb0b3e1c6ed None None] Provisioning complete for port efd747c8-9308-4be4-8445-86a9ce208bf3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:49:33.031562 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5e135c10-8fb4-49fa-b6bc-feb0b3e1c6ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:33.036877 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9b06b7e4-5641-4a31-8105-febe5b1783d1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:33.114345 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-5e135c10-8fb4-49fa-b6bc-feb0b3e1c6ed None None] Port efd747c8-9308-4be4-8445-86a9ce208bf3 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:49:33.141539 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] Attempting to bind port efd747c8-9308-4be4-8445-86a9ce208bf3 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:49:33.142538 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] Attempting to bind port efd747c8-9308-4be4-8445-86a9ce208bf3 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '502907cd-3e3c-478f-b989-3f2602eebfc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:49:33.145257 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] Attempting to bind port efd747c8-9308-4be4-8445-86a9ce208bf3 on network 5ed1c0c9-0d1a-458b-9180-fe96edb96b56 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:49:33.157082 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 49, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:49:33.159096 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] Checking segment: {'id': '502907cd-3e3c-478f-b989-3f2602eebfc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:49:33.162395 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:33.162996 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] Bound using segment: {'id': '502907cd-3e3c-478f-b989-3f2602eebfc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:49:33.163480 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] Bound port: efd747c8-9308-4be4-8445-86a9ce208bf3, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '502907cd-3e3c-478f-b989-3f2602eebfc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:49:33.163967 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:33.178014 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1e86fee4-38f6-4bf9-9d48-b6f11c168300 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 2332 time: 1.5524015 Dec 09 21:49:33.291087 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] For port efd747c8-9308-4be4-8445-86a9ce208bf3, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:49:33.299043 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] For port efd747c8-9308-4be4-8445-86a9ce208bf3, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=efd747c8-9308-4be4-8445-86a9ce208bf3,segment=NetworkSegment(502907cd-3e3c-478f-b989-3f2602eebfc8),segment_id=502907cd-3e3c-478f-b989-3f2602eebfc8)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:49:33.325156 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:33.402802 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] Routers {'6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:49:33.403275 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:49:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:33.450545 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-eac0a94f-0211-41ed-8439-1e2afa7b9c48 None None] Provisioning complete for port efd747c8-9308-4be4-8445-86a9ce208bf3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:49:33.451044 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eac0a94f-0211-41ed-8439-1e2afa7b9c48 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:33.613929 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] Set router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:49:33.662366 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eac0a94f-0211-41ed-8439-1e2afa7b9c48 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:33.737018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-eac0a94f-0211-41ed-8439-1e2afa7b9c48 None None] For port efd747c8-9308-4be4-8445-86a9ce208bf3, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=efd747c8-9308-4be4-8445-86a9ce208bf3,segment=NetworkSegment(502907cd-3e3c-478f-b989-3f2602eebfc8),segment_id=502907cd-3e3c-478f-b989-3f2602eebfc8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:49:33.747968 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eac0a94f-0211-41ed-8439-1e2afa7b9c48 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:33.832137 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eac0a94f-0211-41ed-8439-1e2afa7b9c48 None None] Pushing event updated for resources: {'Port': ['ID=efd747c8-9308-4be4-8445-86a9ce208bf3,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:33.890913 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ce67de7b-73a2-4494-a3bc-bc9ddc1e5062 None None] Provisioning complete for port efd747c8-9308-4be4-8445-86a9ce208bf3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:49:33.891587 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ce67de7b-73a2-4494-a3bc-bc9ddc1e5062 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:33.947862 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a8c8caf-0dc7-41a3-b1d2-f8737045b9b1 None None] Pushing event updated for resources: {'Port': ['ID=efd747c8-9308-4be4-8445-86a9ce208bf3,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:33.966498 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48104) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:33.971897 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-1044d835-3474-40a7-b016-8cd0c218a8de tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-2020331625', 'description': 'tempest-secgroup-smoke-2020331625 description', 'project_id': 'e863bf78256945798e7c717c650258aa'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:34.024753 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1044d835-3474-40a7-b016-8cd0c218a8de tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:34.025696 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'name': 'tempest-TestNetworkBasicOps-router-792281405', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36'}], 'enable_snat': True}, 'gw_port_id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:29Z', 'revision_number': 4, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:2c:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3592, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'efd747c8-9308-4be4-8445-86a9ce208bf3', 'name': '', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:c1:e4:21', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:27Z', 'updated_at': '2021-12-09T21:49:33Z', 'revision_number': 4, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:34.063796 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eba92972-6afd-468f-a051-eec00cebe705 None None] The sync data for ids ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'] in n-d-713301-27 is: [{'id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'name': 'tempest-TestNetworkBasicOps-router-792281405', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36'}], 'enable_snat': True}, 'gw_port_id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:29Z', 'revision_number': 4, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:2c:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3592, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'efd747c8-9308-4be4-8445-86a9ce208bf3', 'name': '', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:c1:e4:21', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:27Z', 'updated_at': '2021-12-09T21:49:33Z', 'revision_number': 4, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:49:34.129691 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1044d835-3474-40a7-b016-8cd0c218a8de tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:34.143671 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1044d835-3474-40a7-b016-8cd0c218a8de tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:34.185104 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1044d835-3474-40a7-b016-8cd0c218a8de tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d4fc7436-bf9a-45b0-ae03-980628053e8f,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:34.212459 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1044d835-3474-40a7-b016-8cd0c218a8de tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:34.214063 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1044d835-3474-40a7-b016-8cd0c218a8de tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.2459579 Dec 09 21:49:34.217115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48110) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:34.226552 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-6d99e759-05bf-4a0e-b199-e2d449ab5140 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'security_group_rule': {'security_group_id': 'd4fc7436-bf9a-45b0-ae03-980628053e8f', 'project_id': 'e863bf78256945798e7c717c650258aa', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:34.282152 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6d99e759-05bf-4a0e-b199-e2d449ab5140 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:34.362795 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6d99e759-05bf-4a0e-b199-e2d449ab5140 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:34.369178 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6d99e759-05bf-4a0e-b199-e2d449ab5140 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:34.392552 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d99e759-05bf-4a0e-b199-e2d449ab5140 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=50d6df0b-62c4-492d-bf28-bb74a8266871,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:34.405761 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6d99e759-05bf-4a0e-b199-e2d449ab5140 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:34.407749 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6d99e759-05bf-4a0e-b199-e2d449ab5140 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1888583 Dec 09 21:49:34.410616 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48114) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:34.417354 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-55fdb79f-e03b-4dfd-8dff-a5d0e20c2b67 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'security_group_rule': {'security_group_id': 'd4fc7436-bf9a-45b0-ae03-980628053e8f', 'project_id': 'e863bf78256945798e7c717c650258aa', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:34.467700 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-55fdb79f-e03b-4dfd-8dff-a5d0e20c2b67 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:34.646688 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-55fdb79f-e03b-4dfd-8dff-a5d0e20c2b67 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:34.658007 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-55fdb79f-e03b-4dfd-8dff-a5d0e20c2b67 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:34.683325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55fdb79f-e03b-4dfd-8dff-a5d0e20c2b67 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a082c17a-d54a-432d-a409-c8e3ce41cd6a,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:34.697119 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-55fdb79f-e03b-4dfd-8dff-a5d0e20c2b67 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:34.699032 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-55fdb79f-e03b-4dfd-8dff-a5d0e20c2b67 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2870085 Dec 09 21:49:34.702031 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48124) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:34.708882 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-c4851bab-e306-4995-928b-a016f5c5643f tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'security_group_rule': {'security_group_id': 'd4fc7436-bf9a-45b0-ae03-980628053e8f', 'project_id': 'e863bf78256945798e7c717c650258aa', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:34.763597 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c4851bab-e306-4995-928b-a016f5c5643f tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:34.856981 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c4851bab-e306-4995-928b-a016f5c5643f tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:34.863968 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c4851bab-e306-4995-928b-a016f5c5643f tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:34.895889 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4851bab-e306-4995-928b-a016f5c5643f tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1072e659-f37a-473a-a6bf-408208fd2e12,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:34.908703 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c4851bab-e306-4995-928b-a016f5c5643f tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:34.913527 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c4851bab-e306-4995-928b-a016f5c5643f tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2070549 Dec 09 21:49:34.914220 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48130) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:34.923959 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-554d35cf-614d-4b28-bbf1-b5600f063e16 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'security_group_rule': {'security_group_id': 'd4fc7436-bf9a-45b0-ae03-980628053e8f', 'project_id': 'e863bf78256945798e7c717c650258aa', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:34.961365 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-554d35cf-614d-4b28-bbf1-b5600f063e16 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:35.063479 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-554d35cf-614d-4b28-bbf1-b5600f063e16 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:35.077066 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-554d35cf-614d-4b28-bbf1-b5600f063e16 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:35.133286 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-554d35cf-614d-4b28-bbf1-b5600f063e16 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3b4c44cf-afcc-4774-8bda-db28239a1cf5,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:35.152218 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-554d35cf-614d-4b28-bbf1-b5600f063e16 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:35.154613 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-554d35cf-614d-4b28-bbf1-b5600f063e16 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2391846 Dec 09 21:49:35.157595 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48138) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:35.163518 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-9c4d09f0-d64b-40d0-9c02-9bb316ba3f4d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'security_group_rule': {'security_group_id': 'd4fc7436-bf9a-45b0-ae03-980628053e8f', 'project_id': 'e863bf78256945798e7c717c650258aa', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:35.213442 n-d-713301-27 neutron-server[103437]: INFO neutron.db.securitygroups_db [None req-9c4d09f0-d64b-40d0-9c02-9bb316ba3f4d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Project e863bf78256945798e7c717c650258aa added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 21:49:35.220972 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9c4d09f0-d64b-40d0-9c02-9bb316ba3f4d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:35.319607 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9c4d09f0-d64b-40d0-9c02-9bb316ba3f4d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:35.330702 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9c4d09f0-d64b-40d0-9c02-9bb316ba3f4d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:35.373872 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c4d09f0-d64b-40d0-9c02-9bb316ba3f4d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=61caee49-fc32-4cbd-bc15-b91d4489c152,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:35.390918 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9c4d09f0-d64b-40d0-9c02-9bb316ba3f4d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:35.393511 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9c4d09f0-d64b-40d0-9c02-9bb316ba3f4d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2343910 Dec 09 21:49:35.395361 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48140) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:35.400968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-f1a95b22-4654-4bad-bcba-a39543cb5947 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'security_group_rule': {'security_group_id': 'd4fc7436-bf9a-45b0-ae03-980628053e8f', 'project_id': 'e863bf78256945798e7c717c650258aa', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:35.447593 n-d-713301-27 neutron-server[103438]: INFO neutron.db.securitygroups_db [None req-f1a95b22-4654-4bad-bcba-a39543cb5947 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Project e863bf78256945798e7c717c650258aa added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 21:49:35.453260 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f1a95b22-4654-4bad-bcba-a39543cb5947 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:35.552682 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f1a95b22-4654-4bad-bcba-a39543cb5947 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:35.559326 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f1a95b22-4654-4bad-bcba-a39543cb5947 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:35.584264 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1974fe45-4000-4111-8260-2faff97b59da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:35.594453 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1a95b22-4654-4bad-bcba-a39543cb5947 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0f6effba-50db-4258-bc6c-3db1fd1967c0,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:35.610410 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f1a95b22-4654-4bad-bcba-a39543cb5947 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:35.615803 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f1a95b22-4654-4bad-bcba-a39543cb5947 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2150800 Dec 09 21:49:35.861389 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device efd747c8-9308-4be4-8445-86a9ce208bf3 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:49:35.920815 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port efd747c8-9308-4be4-8445-86a9ce208bf3 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:49:35.921740 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:36.123935 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-5c7ff779-5946-459f-be4f-c8071150e043 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2020331625&fields=id&tenant_id=e863bf78256945798e7c717c650258aa HTTP/1.1" status: 200 len: 267 time: 0.1341016 Dec 09 21:49:36.374329 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-553d9c22-2f30-4d9d-b052-358cfa43674f tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:36.382283 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-553d9c22-2f30-4d9d-b052-358cfa43674f tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/networks?id=5ed1c0c9-0d1a-458b-9180-fe96edb96b56 HTTP/1.1" status: 200 len: 795 time: 0.2538712 Dec 09 21:49:36.395949 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-18b8a714-cac0-458b-bc57-e221f354d13f tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/quotas/e863bf78256945798e7c717c650258aa HTTP/1.1" status: 200 len: 375 time: 0.0126517 Dec 09 21:49:36.408553 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48180) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:36.497453 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-7edd138a-11e4-41ed-979b-aa129b0e6221 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=e863bf78256945798e7c717c650258aa&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0953984 Dec 09 21:49:36.607287 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-74a9b574-b6dc-4182-97bc-4a7be6c472a1 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:49:36.615532 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-74a9b574-b6dc-4182-97bc-4a7be6c472a1 service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1050832 Dec 09 21:49:36.662281 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:36.698663 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9f59d21c-734e-4461-a5e7-7cab31f4b85c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:36.736119 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-cf6a40f7-c0cf-4ead-b677-5e81f77d6530 service neutron] 10.222.0.13 "GET /v2.0/networks/5ed1c0c9-0d1a-458b-9180-fe96edb96b56?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1193123 Dec 09 21:49:36.910467 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-281e203f-2f2d-4c90-a1a7-55bd27adc32d service neutron] 10.222.0.13 "GET /v2.0/networks/5ed1c0c9-0d1a-458b-9180-fe96edb96b56?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1601009 Dec 09 21:49:36.962701 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9f59d21c-734e-4461-a5e7-7cab31f4b85c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:36.969277 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9f59d21c-734e-4461-a5e7-7cab31f4b85c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:37.020760 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9f59d21c-734e-4461-a5e7-7cab31f4b85c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=6e1fca3513df4b0ab3d868af7e3e2b6a&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6111460 Dec 09 21:49:37.023624 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48188) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:37.052492 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f59d21c-734e-4461-a5e7-7cab31f4b85c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9ab05613-1025-436a-a506-55d85f41326d,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:37.127246 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-271a630c-0ec5-489e-881f-f91459f1a6cb req-1f5ec177-c282-42c0-a477-7db3596f8c90 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a HTTP/1.1" status: 200 len: 210 time: 0.0444601 Dec 09 21:49:37.152767 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-14a9a949-8e8e-47f9-b134-0e275598f4dc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:37.174589 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-14a9a949-8e8e-47f9-b134-0e275598f4dc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:37.222948 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-14a9a949-8e8e-47f9-b134-0e275598f4dc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:37.225900 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-14a9a949-8e8e-47f9-b134-0e275598f4dc admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:37.227282 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-14a9a949-8e8e-47f9-b134-0e275598f4dc admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/9ab05613-1025-436a-a506-55d85f41326d HTTP/1.1" status: 204 len: 168 time: 0.2024586 Dec 09 21:49:37.237138 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14a9a949-8e8e-47f9-b134-0e275598f4dc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9ab05613-1025-436a-a506-55d85f41326d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:37.539528 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48210) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:37.553437 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac7f032c-5fa6-46a4-9985-48110e8c2c1c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:37.631588 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac7f032c-5fa6-46a4-9985-48110e8c2c1c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:37.637343 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ac7f032c-5fa6-46a4-9985-48110e8c2c1c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:37.677702 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ac7f032c-5fa6-46a4-9985-48110e8c2c1c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=03ec623e4afb495088cf5e316e526f08&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1364450 Dec 09 21:49:37.680680 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48212) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:37.683708 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac7f032c-5fa6-46a4-9985-48110e8c2c1c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=25faa6ba-dcab-4cc8-b26b-7207fe840e42,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:37.736089 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-218740eb-14b8-4cff-8a5d-4ad3e73bb4bb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:37.761503 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-218740eb-14b8-4cff-8a5d-4ad3e73bb4bb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:37.830884 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-218740eb-14b8-4cff-8a5d-4ad3e73bb4bb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:37.833629 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-218740eb-14b8-4cff-8a5d-4ad3e73bb4bb admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:37.834805 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-218740eb-14b8-4cff-8a5d-4ad3e73bb4bb admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/25faa6ba-dcab-4cc8-b26b-7207fe840e42 HTTP/1.1" status: 204 len: 168 time: 0.1531000 Dec 09 21:49:37.844351 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-218740eb-14b8-4cff-8a5d-4ad3e73bb4bb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=25faa6ba-dcab-4cc8-b26b-7207fe840e42,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:38.000314 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:38.244817 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a10ad09-0e20-4a42-9958-f5df2310ce37 req-c6fc9369-9337-47ab-be5c-a9cc2f06ad8e tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a HTTP/1.1" status: 200 len: 210 time: 0.0293624 Dec 09 21:49:38.509979 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-112aad76-ea3b-4923-b37c-19bfb7e3739d req-bf4b613f-3aea-48fe-93d6-ce6bd1b3781d service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1525726 Dec 09 21:49:38.535107 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-29774d7f-498e-49f4-ad73-b23efabdf77f tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:38.536739 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-29774d7f-498e-49f4-ad73-b23efabdf77f tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.31 "GET /v2.0/networks?id=5ed1c0c9-0d1a-458b-9180-fe96edb96b56 HTTP/1.1" status: 200 len: 795 time: 0.2755494 Dec 09 21:49:38.657525 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-112aad76-ea3b-4923-b37c-19bfb7e3739d req-5a577fa0-c3bb-430c-b98c-d040518d328c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:38.659068 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-112aad76-ea3b-4923-b37c-19bfb7e3739d req-5a577fa0-c3bb-430c-b98c-d040518d328c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 1098 time: 0.1013572 Dec 09 21:49:38.665401 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-574d5c18-4c9d-429b-9fe7-93de813150a5 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=e863bf78256945798e7c717c650258aa HTTP/1.1" status: 200 len: 380 time: 0.1151607 Dec 09 21:49:38.676720 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-d03d6c8b-514d-4d91-8270-ec5fc035e937 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'port': {'device_id': '6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'admin_state_up': True, 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'security_groups': ['d4fc7436-bf9a-45b0-ae03-980628053e8f']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:38.852401 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-112aad76-ea3b-4923-b37c-19bfb7e3739d req-5b3d49ba-94ed-42a1-9bff-e37994740757 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:38.854011 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-112aad76-ea3b-4923-b37c-19bfb7e3739d req-5b3d49ba-94ed-42a1-9bff-e37994740757 service neutron] 10.222.0.31 "GET /v2.0/networks?id=92500df7-83c8-4757-9b24-3ee4dfba2da3 HTTP/1.1" status: 200 len: 897 time: 0.1731281 Dec 09 21:49:38.943844 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-112aad76-ea3b-4923-b37c-19bfb7e3739d req-64dd0ff8-568f-4cfb-8235-733b27c81a52 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3 HTTP/1.1" status: 200 len: 1001 time: 0.0816188 Dec 09 21:49:38.944510 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-d03d6c8b-514d-4d91-8270-ec5fc035e937 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Made reservation on behalf of e863bf78256945798e7c717c650258aa for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:49:38.948023 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-d03d6c8b-514d-4d91-8270-ec5fc035e937 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:39.048695 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-112aad76-ea3b-4923-b37c-19bfb7e3739d req-42f9f117-d40b-47ad-90fb-f5e8c9d583ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:39.050727 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-112aad76-ea3b-4923-b37c-19bfb7e3739d req-42f9f117-d40b-47ad-90fb-f5e8c9d583ed service neutron] 10.222.0.31 "GET /v2.0/subnets?id=13dde2f9-0dfd-4600-912c-44b7903e3595 HTTP/1.1" status: 200 len: 835 time: 0.0929575 Dec 09 21:49:39.191693 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-112aad76-ea3b-4923-b37c-19bfb7e3739d req-69d595aa-2e68-46d7-abaa-526fdc35b8ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:39.193229 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-112aad76-ea3b-4923-b37c-19bfb7e3739d req-69d595aa-2e68-46d7-abaa-526fdc35b8ef service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=92500df7-83c8-4757-9b24-3ee4dfba2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1088154 Dec 09 21:49:39.197593 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-d03d6c8b-514d-4d91-8270-ec5fc035e937 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Allocated IP 172.20.0.11 (5ed1c0c9-0d1a-458b-9180-fe96edb96b56/01104ce9-312c-40a5-b51d-c30bc463bf2c/7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:49:39.368259 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-112aad76-ea3b-4923-b37c-19bfb7e3739d req-46e35e82-7171-4060-87a9-7d0a3944b25d service neutron] 10.222.0.31 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1647923 Dec 09 21:49:39.421203 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-62bf1049-f361-4841-a4c6-9037803f365e req-d5e3c2cf-2046-45db-a6be-2d5adc797a36 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a HTTP/1.1" status: 200 len: 210 time: 0.0431948 Dec 09 21:49:39.525426 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-d03d6c8b-514d-4d91-8270-ec5fc035e937 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:39.544605 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-112aad76-ea3b-4923-b37c-19bfb7e3739d req-32349ec9-cf0d-4790-aeaf-8e6d6ab93e1b service neutron] 10.222.0.31 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1480711 Dec 09 21:49:39.581631 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-d03d6c8b-514d-4d91-8270-ec5fc035e937 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:39.629877 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-d03d6c8b-514d-4d91-8270-ec5fc035e937 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Network 5ed1c0c9-0d1a-458b-9180-fe96edb96b56 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:49:39.633664 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-d03d6c8b-514d-4d91-8270-ec5fc035e937 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:49:39.638180 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-d03d6c8b-514d-4d91-8270-ec5fc035e937 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:49:39.661364 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:39.694984 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-d03d6c8b-514d-4d91-8270-ec5fc035e937 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:39.695844 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-d03d6c8b-514d-4d91-8270-ec5fc035e937 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:39.715195 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d03d6c8b-514d-4d91-8270-ec5fc035e937 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'Port': ['ID=7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:39.726767 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-d03d6c8b-514d-4d91-8270-ec5fc035e937 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0548167 Dec 09 21:49:39.746575 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-6edb14e5-5009-468a-9ac4-96b44cdde965 service neutron] Request body: {'port': {'device_id': '6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:39.875359 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-6edb14e5-5009-468a-9ac4-96b44cdde965 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:40.101499 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4876404-0751-4c55-8ea8-6794524b6af7 req-429fe137-294c-42ab-9265-6934e7232b11 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:40.101499 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b4876404-0751-4c55-8ea8-6794524b6af7 req-429fe137-294c-42ab-9265-6934e7232b11 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 1098 time: 0.1335077 Dec 09 21:49:40.101499 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b4876404-0751-4c55-8ea8-6794524b6af7 req-b9355e3a-4880-468c-adee-c589d6e35472 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1410868 Dec 09 21:49:40.123030 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48298) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:40.143880 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-dec0fc88-2d13-464f-8a64-27d44c73bfab None None] Provisioning complete for port 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:49:40.144287 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dec0fc88-2d13-464f-8a64-27d44c73bfab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:40.185801 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-dec0fc88-2d13-464f-8a64-27d44c73bfab None None] Port 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:49:40.390797 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-55f82a72-1dd4-4e54-a4f4-c969c478c8c1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Deleting port ca3fd0a1-24f4-48b1-81ac-bc3cc6f3266a {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:49:40.394673 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-55f82a72-1dd4-4e54-a4f4-c969c478c8c1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:40.477351 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-6edb14e5-5009-468a-9ac4-96b44cdde965 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:49:40.488118 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-6edb14e5-5009-468a-9ac4-96b44cdde965 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:40.501984 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-6edb14e5-5009-468a-9ac4-96b44cdde965 service neutron] Transition to ACTIVE for port object 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:49:40.510348 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-6edb14e5-5009-468a-9ac4-96b44cdde965 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:40.625752 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-55f82a72-1dd4-4e54-a4f4-c969c478c8c1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:40.626847 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-55f82a72-1dd4-4e54-a4f4-c969c478c8c1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:40.634499 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6edb14e5-5009-468a-9ac4-96b44cdde965 service neutron] Pushing event updated for resources: {'Port': ['ID=7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:40.682006 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-55f82a72-1dd4-4e54-a4f4-c969c478c8c1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Calling delete_port for ca3fd0a1-24f4-48b1-81ac-bc3cc6f3266a owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:49:40.734980 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-6edb14e5-5009-468a-9ac4-96b44cdde965 service neutron] Attempting to bind port 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:49:40.735614 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-6edb14e5-5009-468a-9ac4-96b44cdde965 service neutron] Attempting to bind port 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '502907cd-3e3c-478f-b989-3f2602eebfc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:49:40.736647 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-6edb14e5-5009-468a-9ac4-96b44cdde965 service neutron] Attempting to bind port 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 on network 5ed1c0c9-0d1a-458b-9180-fe96edb96b56 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:49:40.741981 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-6edb14e5-5009-468a-9ac4-96b44cdde965 service neutron] Port 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 on network 5ed1c0c9-0d1a-458b-9180-fe96edb96b56 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:49:40.743001 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-6edb14e5-5009-468a-9ac4-96b44cdde965 service neutron] Attempting to bind port 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 on network 5ed1c0c9-0d1a-458b-9180-fe96edb96b56 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:49:40.749319 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-6edb14e5-5009-468a-9ac4-96b44cdde965 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 49, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:49:40.749888 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-6edb14e5-5009-468a-9ac4-96b44cdde965 service neutron] Checking segment: {'id': '502907cd-3e3c-478f-b989-3f2602eebfc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:49:40.750726 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-6edb14e5-5009-468a-9ac4-96b44cdde965 service neutron] Bound using segment: {'id': '502907cd-3e3c-478f-b989-3f2602eebfc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:49:40.751910 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-6edb14e5-5009-468a-9ac4-96b44cdde965 service neutron] Bound port: 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '502907cd-3e3c-478f-b989-3f2602eebfc8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:49:40.753337 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-6edb14e5-5009-468a-9ac4-96b44cdde965 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:40.858215 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-6edb14e5-5009-468a-9ac4-96b44cdde965 service neutron] For port 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:49:40.871869 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-6edb14e5-5009-468a-9ac4-96b44cdde965 service neutron] For port 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2,segment=NetworkSegment(502907cd-3e3c-478f-b989-3f2602eebfc8),segment_id=502907cd-3e3c-478f-b989-3f2602eebfc8)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:49:40.885822 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-6edb14e5-5009-468a-9ac4-96b44cdde965 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:40.956500 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6edb14e5-5009-468a-9ac4-96b44cdde965 service neutron] Pushing event updated for resources: {'Port': ['ID=7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:40.962047 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-6edb14e5-5009-468a-9ac4-96b44cdde965 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:40.962808 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-6edb14e5-5009-468a-9ac4-96b44cdde965 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:40.964985 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-6edb14e5-5009-468a-9ac4-96b44cdde965 service neutron] 10.222.0.31 "PUT /v2.0/ports/7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 HTTP/1.1" status: 200 len: 1093 time: 1.2254255 Dec 09 21:49:40.965457 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a', 'tag': '7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:49:40.968394 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-851a1d06-91f8-4b4a-809f-6ec9f08078c2" -d '{"events": [{"name": "network-changed", "server_uuid": "6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a", "tag": "7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:49:41.098856 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-1b291519-a81e-433b-bd94-bed6c002a8ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:41.101234 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-1b291519-a81e-433b-bd94-bed6c002a8ad service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e863bf78256945798e7c717c650258aa&device_id=6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a HTTP/1.1" status: 200 len: 1096 time: 0.0851347 Dec 09 21:49:41.192965 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-48004f15-8262-48a6-b1c9-83912950b966 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 HTTP/1.1" status: 200 len: 217 time: 0.0765874 Dec 09 21:49:41.254353 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-71c855ae-153e-4b73-abca-75c5a46ed12f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:41.256515 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-71c855ae-153e-4b73-abca-75c5a46ed12f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=01104ce9-312c-40a5-b51d-c30bc463bf2c HTTP/1.1" status: 200 len: 835 time: 0.0553813 Dec 09 21:49:41.268599 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-55f82a72-1dd4-4e54-a4f4-c969c478c8c1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:41.314392 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55f82a72-1dd4-4e54-a4f4-c969c478c8c1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'Port': ['ID=ca3fd0a1-24f4-48b1-81ac-bc3cc6f3266a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:41.343015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba48f9ca-3dae-4c20-9e4a-e021ee825881 req-04422633-929d-44d5-b06a-e048a588a140 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:41.344955 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba48f9ca-3dae-4c20-9e4a-e021ee825881 req-04422633-929d-44d5-b06a-e048a588a140 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a HTTP/1.1" status: 200 len: 944 time: 0.8113732 Dec 09 21:49:41.357913 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-bdc01782-f2a8-48f5-977f-c8615daef8da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:41.363735 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-bdc01782-f2a8-48f5-977f-c8615daef8da service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5ed1c0c9-0d1a-458b-9180-fe96edb96b56&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0992441 Dec 09 21:49:41.455534 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-55f82a72-1dd4-4e54-a4f4-c969c478c8c1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:41.456130 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-55f82a72-1dd4-4e54-a4f4-c969c478c8c1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Floating IP 3a029f47-0fde-479e-a9de-26b4149b4355 disassociated (deleted). External IP: 172.25.3.216, port: 165bd568-9d49-4f11-b8e1-eb1d0dc675b3. Dec 09 21:49:41.515557 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-84e4d5cc-7bb4-4012-8ab9-ea43bfd1bcdc service neutron] 10.222.0.31 "GET /v2.0/networks/5ed1c0c9-0d1a-458b-9180-fe96edb96b56?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1375248 Dec 09 21:49:41.516420 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba48f9ca-3dae-4c20-9e4a-e021ee825881 req-98139711-4fd3-49e5-abce-0f9e913803e9 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=d4fc7436-bf9a-45b0-ae03-980628053e8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1545064 Dec 09 21:49:41.630582 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:49:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fb581f73-4831-4d9f-885e-6197dc97f26e x-openstack-request-id: req-fb581f73-4831-4d9f-885e-6197dc97f26e {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:49:41.631146 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a", "tag": "7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:49:41.631590 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-fb581f73-4831-4d9f-885e-6197dc97f26e {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:49:41.632167 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a', 'tag': '7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2', 'status': 'completed', 'code': 200} Dec 09 21:49:41.687016 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a5f25e87-4f47-4add-9d25-edb357ad1efa req-e4aa645b-197d-43f8-b730-3dc95311f018 service neutron] 10.222.0.31 "GET /v2.0/networks/5ed1c0c9-0d1a-458b-9180-fe96edb96b56?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1637290 Dec 09 21:49:41.772516 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-55f82a72-1dd4-4e54-a4f4-c969c478c8c1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Router 7521af04-4c9d-4f02-9889-0ff6f5545ff7 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:49:41.817335 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-851a1d06-91f8-4b4a-809f-6ec9f08078c2 req-7d5cd311-265a-4060-9d26-f57b2e7196e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:41.826511 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-851a1d06-91f8-4b4a-809f-6ec9f08078c2 req-7d5cd311-265a-4060-9d26-f57b2e7196e4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e863bf78256945798e7c717c650258aa&device_id=6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a HTTP/1.1" status: 200 len: 1096 time: 0.0792971 Dec 09 21:49:41.960817 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-851a1d06-91f8-4b4a-809f-6ec9f08078c2 req-4041005a-ff86-4c84-bf84-881ab53e76a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:41.963037 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-851a1d06-91f8-4b4a-809f-6ec9f08078c2 req-4041005a-ff86-4c84-bf84-881ab53e76a9 service neutron] 10.222.0.31 "GET /v2.0/networks?id=5ed1c0c9-0d1a-458b-9180-fe96edb96b56 HTTP/1.1" status: 200 len: 896 time: 0.1286578 Dec 09 21:49:42.028083 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-851a1d06-91f8-4b4a-809f-6ec9f08078c2 req-a7b8e896-3272-4f1d-8a06-2b522f9951e7 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 HTTP/1.1" status: 200 len: 217 time: 0.0533326 Dec 09 21:49:42.103473 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-851a1d06-91f8-4b4a-809f-6ec9f08078c2 req-e2461bdd-cbde-457a-8d7c-bd15e9bf0974 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:42.105136 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-851a1d06-91f8-4b4a-809f-6ec9f08078c2 req-e2461bdd-cbde-457a-8d7c-bd15e9bf0974 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=01104ce9-312c-40a5-b51d-c30bc463bf2c HTTP/1.1" status: 200 len: 835 time: 0.0692258 Dec 09 21:49:42.200457 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-851a1d06-91f8-4b4a-809f-6ec9f08078c2 req-10d652e3-0cf1-4d46-8a63-ed8fca280a83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:42.202235 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-851a1d06-91f8-4b4a-809f-6ec9f08078c2 req-10d652e3-0cf1-4d46-8a63-ed8fca280a83 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5ed1c0c9-0d1a-458b-9180-fe96edb96b56&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0887704 Dec 09 21:49:42.303702 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-55f82a72-1dd4-4e54-a4f4-c969c478c8c1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:49:42.318640 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-55f82a72-1dd4-4e54-a4f4-c969c478c8c1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:42.318960 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7926cb31-5f2d-4d31-ab35-8050030fedd8 None None] Sync routers for ids ['7521af04-4c9d-4f02-9889-0ff6f5545ff7'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:49:42.340084 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7926cb31-5f2d-4d31-ab35-8050030fedd8 None None] Routers {'7521af04-4c9d-4f02-9889-0ff6f5545ff7'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:49:42.342364 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-7926cb31-5f2d-4d31-ab35-8050030fedd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:49:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7521af04-4c9d-4f02-9889-0ff6f5545ff7'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:42.403289 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-851a1d06-91f8-4b4a-809f-6ec9f08078c2 req-e0320c41-99d7-4073-96d2-374fca4082d2 service neutron] 10.222.0.31 "GET /v2.0/networks/5ed1c0c9-0d1a-458b-9180-fe96edb96b56?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1843233 Dec 09 21:49:42.446147 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-55f82a72-1dd4-4e54-a4f4-c969c478c8c1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "DELETE /v2.0/floatingips/3a029f47-0fde-479e-a9de-26b4149b4355 HTTP/1.1" status: 204 len: 168 time: 2.3181775 Dec 09 21:49:42.449285 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'tag': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:49:42.455272 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e66e831f-b958-4d6d-b8ac-b431a985223d" -d '{"events": [{"name": "network-changed", "server_uuid": "c9630177-3a8d-4c3a-8c62-dd93288c7232", "tag": "165bd568-9d49-4f11-b8e1-eb1d0dc675b3"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:49:42.597442 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-851a1d06-91f8-4b4a-809f-6ec9f08078c2 req-7ebdefae-f98e-496f-95aa-e62745911bef service neutron] 10.222.0.31 "GET /v2.0/networks/5ed1c0c9-0d1a-458b-9180-fe96edb96b56?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1855197 Dec 09 21:49:42.757369 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:49:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-16f4f21b-cb1b-4b50-92a7-26490f9546c6 x-openstack-request-id: req-16f4f21b-cb1b-4b50-92a7-26490f9546c6 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:49:42.758001 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c9630177-3a8d-4c3a-8c62-dd93288c7232", "tag": "165bd568-9d49-4f11-b8e1-eb1d0dc675b3", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:49:42.758868 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-16f4f21b-cb1b-4b50-92a7-26490f9546c6 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:49:42.759535 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'tag': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3', 'status': 'completed', 'code': 200} Dec 09 21:49:42.872744 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e66e831f-b958-4d6d-b8ac-b431a985223d req-09dc0ad8-a98a-453d-81de-60bfcc2b9139 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:42.878768 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e66e831f-b958-4d6d-b8ac-b431a985223d req-09dc0ad8-a98a-453d-81de-60bfcc2b9139 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 1098 time: 0.0876975 Dec 09 21:49:42.988193 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7282b52d-fa8f-469a-ac20-a6c0faf4cfa3 req-e48c3c65-20f3-4637-b349-9d2cc14586ce tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:42.989717 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7282b52d-fa8f-469a-ac20-a6c0faf4cfa3 req-e48c3c65-20f3-4637-b349-9d2cc14586ce tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a HTTP/1.1" status: 200 len: 944 time: 0.0846379 Dec 09 21:49:43.035309 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48376) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:43.099245 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7282b52d-fa8f-469a-ac20-a6c0faf4cfa3 req-e34ee671-9421-441e-be39-944307f911f6 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=d4fc7436-bf9a-45b0-ae03-980628053e8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0989008 Dec 09 21:49:43.125090 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:49:43.137591 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-7926cb31-5f2d-4d31-ab35-8050030fedd8 None None] Set router 7521af04-4c9d-4f02-9889-0ff6f5545ff7 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:49:43.143054 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e66e831f-b958-4d6d-b8ac-b431a985223d req-68df2932-9271-4663-bf10-a61ce1909401 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:43.143849 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e66e831f-b958-4d6d-b8ac-b431a985223d req-68df2932-9271-4663-bf10-a61ce1909401 service neutron] 10.222.0.31 "GET /v2.0/networks?id=92500df7-83c8-4757-9b24-3ee4dfba2da3 HTTP/1.1" status: 200 len: 897 time: 0.2566750 Dec 09 21:49:43.234959 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e66e831f-b958-4d6d-b8ac-b431a985223d req-81540e9a-a19c-4052-8b60-e72915935fa3 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3 HTTP/1.1" status: 200 len: 217 time: 0.0815039 Dec 09 21:49:43.329894 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-91ffeaf7-8934-4ed7-bba9-6b2e2030f3b1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:43.333393 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e66e831f-b958-4d6d-b8ac-b431a985223d req-3faefcce-e621-4ba4-8155-0f9a9371987e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:43.334754 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e66e831f-b958-4d6d-b8ac-b431a985223d req-3faefcce-e621-4ba4-8155-0f9a9371987e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=13dde2f9-0dfd-4600-912c-44b7903e3595 HTTP/1.1" status: 200 len: 835 time: 0.0919147 Dec 09 21:49:43.350848 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-631fd7b0-0e0b-4b1d-a8d9-2d781e58e43b req-f13b2a0b-e6c2-4aae-a6fa-570a34a54142 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:43.370810 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-631fd7b0-0e0b-4b1d-a8d9-2d781e58e43b req-f13b2a0b-e6c2-4aae-a6fa-570a34a54142 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 946 time: 0.1055744 Dec 09 21:49:43.430841 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e66e831f-b958-4d6d-b8ac-b431a985223d req-9db7afc5-a564-4b38-b4fc-b465183638a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:43.433094 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e66e831f-b958-4d6d-b8ac-b431a985223d req-9db7afc5-a564-4b38-b4fc-b465183638a3 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=92500df7-83c8-4757-9b24-3ee4dfba2da3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0889683 Dec 09 21:49:43.535829 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e66e831f-b958-4d6d-b8ac-b431a985223d req-4a6ad5cd-4f92-45e4-887d-7370706a15f2 service neutron] 10.222.0.31 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0943434 Dec 09 21:49:43.589231 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-91ffeaf7-8934-4ed7-bba9-6b2e2030f3b1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:43.610888 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-91ffeaf7-8934-4ed7-bba9-6b2e2030f3b1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:43.676502 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e66e831f-b958-4d6d-b8ac-b431a985223d req-a6fbb6da-d539-46e5-97bf-838d1e04988f service neutron] 10.222.0.31 "GET /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1323087 Dec 09 21:49:43.680607 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-631fd7b0-0e0b-4b1d-a8d9-2d781e58e43b req-2ee7bf59-5b38-4262-b3a3-c76a38af181d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3084109 Dec 09 21:49:43.706192 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91ffeaf7-8934-4ed7-bba9-6b2e2030f3b1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=978096bc-ea8a-46ea-b2ec-8bfbf18a44e1,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:43.714003 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-91ffeaf7-8934-4ed7-bba9-6b2e2030f3b1 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=1088c922f69a426a9982e1c9658d999f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.6773200 Dec 09 21:49:43.714921 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48386) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:43.764663 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2,segment=NetworkSegment(502907cd-3e3c-478f-b989-3f2602eebfc8),segment_id=502907cd-3e3c-478f-b989-3f2602eebfc8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:49:43.833845 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'port_id': '7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2', 'mac_address': 'fa:16:3e:10:cf:de', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 136, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:49:43.836844 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-65a3842f-9881-4bbb-8df7-cab04383b0af admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:43.904422 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-65a3842f-9881-4bbb-8df7-cab04383b0af admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:43.932280 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:43.950540 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:49:43.999611 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-65a3842f-9881-4bbb-8df7-cab04383b0af admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:44.003288 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-65a3842f-9881-4bbb-8df7-cab04383b0af admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:44.004825 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-65a3842f-9881-4bbb-8df7-cab04383b0af admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/978096bc-ea8a-46ea-b2ec-8bfbf18a44e1 HTTP/1.1" status: 204 len: 168 time: 0.2882588 Dec 09 21:49:44.007570 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2,segment=NetworkSegment(502907cd-3e3c-478f-b989-3f2602eebfc8),segment_id=502907cd-3e3c-478f-b989-3f2602eebfc8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:49:44.014083 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-7926cb31-5f2d-4d31-ab35-8050030fedd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-161742691', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57'}], 'enable_snat': True}, 'gw_port_id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:47:28Z', 'updated_at': '2021-12-09T21:47:35Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:01:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3464, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:47:29Z', 'updated_at': '2021-12-09T21:47:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'd478d292-7b6e-4f28-b6f2-bbf3ba7d2069', 'name': '', 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:99:1a:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'device_owner': 'network:router_interface', 'standard_attr_id': 3471, 'fixed_ips': [{'subnet_id': '13dde2f9-0dfd-4600-912c-44b7903e3595', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:47:34Z', 'updated_at': '2021-12-09T21:47:40Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '13dde2f9-0dfd-4600-912c-44b7903e3595', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:44.045188 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65a3842f-9881-4bbb-8df7-cab04383b0af admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=978096bc-ea8a-46ea-b2ec-8bfbf18a44e1,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:44.049637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7926cb31-5f2d-4d31-ab35-8050030fedd8 None None] Checking router: 7521af04-4c9d-4f02-9889-0ff6f5545ff7 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:49:44.056434 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:44.149349 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7926cb31-5f2d-4d31-ab35-8050030fedd8 None None] Routers {'7521af04-4c9d-4f02-9889-0ff6f5545ff7'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:49:44.161398 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-7926cb31-5f2d-4d31-ab35-8050030fedd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:49:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7521af04-4c9d-4f02-9889-0ff6f5545ff7'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:44.188968 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94f9dce9-5959-4bf4-a4e1-1ab32cabf5e0 req-aa468723-1198-434f-bc27-055316c21431 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:44.191318 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-94f9dce9-5959-4bf4-a4e1-1ab32cabf5e0 req-aa468723-1198-434f-bc27-055316c21431 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.31 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 946 time: 0.1598248 Dec 09 21:49:44.359715 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:49:44.416859 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8cd56c5-8938-4141-95d5-5188c0e1c1bc req-8e4f343e-666b-45b2-8a1a-e34cf47525ef tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:44.424783 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c8cd56c5-8938-4141-95d5-5188c0e1c1bc req-8e4f343e-666b-45b2-8a1a-e34cf47525ef tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a HTTP/1.1" status: 200 len: 945 time: 0.1364110 Dec 09 21:49:44.440184 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:44.491105 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-94f9dce9-5959-4bf4-a4e1-1ab32cabf5e0 req-dd519479-cd09-4357-a962-74346964bf67 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Deleting port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:49:44.493891 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-94f9dce9-5959-4bf4-a4e1-1ab32cabf5e0 req-dd519479-cd09-4357-a962-74346964bf67 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:44.511359 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c8cd56c5-8938-4141-95d5-5188c0e1c1bc req-716beb7b-b777-4a91-aa04-6459013424ab tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=d4fc7436-bf9a-45b0-ae03-980628053e8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0845454 Dec 09 21:49:44.624696 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-7926cb31-5f2d-4d31-ab35-8050030fedd8 None None] Set router 7521af04-4c9d-4f02-9889-0ff6f5545ff7 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:49:44.682677 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-94f9dce9-5959-4bf4-a4e1-1ab32cabf5e0 req-dd519479-cd09-4357-a962-74346964bf67 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] For port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,segment=NetworkSegment(0189efa9-02eb-4071-ae6f-aee6c867d035),segment_id=0189efa9-02eb-4071-ae6f-aee6c867d035)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:49:44.683540 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-94f9dce9-5959-4bf4-a4e1-1ab32cabf5e0 req-dd519479-cd09-4357-a962-74346964bf67 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:44.717447 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48412) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:44.725056 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-94f9dce9-5959-4bf4-a4e1-1ab32cabf5e0 req-dd519479-cd09-4357-a962-74346964bf67 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Calling delete_port for 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:49:44.738842 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-92e571db-0a2e-4bac-a1d6-120b7e47da01 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:44.902261 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-92e571db-0a2e-4bac-a1d6-120b7e47da01 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:44.954237 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-92e571db-0a2e-4bac-a1d6-120b7e47da01 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:45.027188 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-94f9dce9-5959-4bf4-a4e1-1ab32cabf5e0 req-dd519479-cd09-4357-a962-74346964bf67 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:45.063007 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd519479-cd09-4357-a962-74346964bf67 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'Port': ['ID=165bd568-9d49-4f11-b8e1-eb1d0dc675b3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:45.068148 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-028df4f2-55bb-4811-b12c-68c6c09ccd1d req-60ad9d87-42a4-4a3a-9fbe-7667827f2247 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:45.072694 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-028df4f2-55bb-4811-b12c-68c6c09ccd1d req-60ad9d87-42a4-4a3a-9fbe-7667827f2247 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=c9630177-3a8d-4c3a-8c62-dd93288c7232 HTTP/1.1" status: 200 len: 946 time: 0.1680086 Dec 09 21:49:45.073839 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92e571db-0a2e-4bac-a1d6-120b7e47da01 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=335d778a-42fd-4da5-bbd8-380b90c8d256,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:45.081666 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-92e571db-0a2e-4bac-a1d6-120b7e47da01 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=157f536c2cd645eeab6153fde49d6d8d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3600171 Dec 09 21:49:45.082913 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48420) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:45.177907 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-94f9dce9-5959-4bf4-a4e1-1ab32cabf5e0 req-dd519479-cd09-4357-a962-74346964bf67 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] No DVR routers for this DVR port 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:49:45.182332 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-94f9dce9-5959-4bf4-a4e1-1ab32cabf5e0 req-dd519479-cd09-4357-a962-74346964bf67 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:45.187752 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-94f9dce9-5959-4bf4-a4e1-1ab32cabf5e0 req-dd519479-cd09-4357-a962-74346964bf67 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.31 "DELETE /v2.0/ports/165bd568-9d49-4f11-b8e1-eb1d0dc675b3 HTTP/1.1" status: 204 len: 173 time: 0.9885094 Dec 09 21:49:45.188548 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'name': 'network-vif-deleted', 'tag': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:49:45.191597 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-90562065-4c51-48d7-8698-a6cf83aae5ce" -d '{"events": [{"server_uuid": "c9630177-3a8d-4c3a-8c62-dd93288c7232", "name": "network-vif-deleted", "tag": "165bd568-9d49-4f11-b8e1-eb1d0dc675b3"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:49:45.223428 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-7926cb31-5f2d-4d31-ab35-8050030fedd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-161742691', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57'}], 'enable_snat': True}, 'gw_port_id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:47:28Z', 'updated_at': '2021-12-09T21:47:35Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:01:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3464, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:47:29Z', 'updated_at': '2021-12-09T21:47:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'd478d292-7b6e-4f28-b6f2-bbf3ba7d2069', 'name': '', 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:99:1a:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'device_owner': 'network:router_interface', 'standard_attr_id': 3471, 'fixed_ips': [{'subnet_id': '13dde2f9-0dfd-4600-912c-44b7903e3595', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:47:34Z', 'updated_at': '2021-12-09T21:47:40Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '13dde2f9-0dfd-4600-912c-44b7903e3595', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:45.277429 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0ed6fb34-e40c-499f-b63f-5ef477564042 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:45.290898 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7926cb31-5f2d-4d31-ab35-8050030fedd8 None None] The sync data for ids ['7521af04-4c9d-4f02-9889-0ff6f5545ff7'] in n-d-713301-27 is: [{'id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-161742691', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57'}], 'enable_snat': True}, 'gw_port_id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:47:28Z', 'updated_at': '2021-12-09T21:47:35Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:01:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3464, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:47:29Z', 'updated_at': '2021-12-09T21:47:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'd478d292-7b6e-4f28-b6f2-bbf3ba7d2069', 'name': '', 'network_id': '92500df7-83c8-4757-9b24-3ee4dfba2da3', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:99:1a:9d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'device_owner': 'network:router_interface', 'standard_attr_id': 3471, 'fixed_ips': [{'subnet_id': '13dde2f9-0dfd-4600-912c-44b7903e3595', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:47:34Z', 'updated_at': '2021-12-09T21:47:40Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '13dde2f9-0dfd-4600-912c-44b7903e3595', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:49:45.319796 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-028df4f2-55bb-4811-b12c-68c6c09ccd1d req-f8c2d3db-02fd-4691-ab62-dd79eb8e86a6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=7e73dc80-43d2-4833-9cd1-5d1a5f84f967&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2388067 Dec 09 21:49:45.339224 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0ed6fb34-e40c-499f-b63f-5ef477564042 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:45.467791 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0ed6fb34-e40c-499f-b63f-5ef477564042 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:45.471161 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0ed6fb34-e40c-499f-b63f-5ef477564042 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:45.474291 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0ed6fb34-e40c-499f-b63f-5ef477564042 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/335d778a-42fd-4da5-bbd8-380b90c8d256 HTTP/1.1" status: 204 len: 168 time: 0.3896010 Dec 09 21:49:45.522519 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:49:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-188ede2b-04c0-483d-8869-f9e1f8eaafc7 x-openstack-request-id: req-188ede2b-04c0-483d-8869-f9e1f8eaafc7 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:49:45.522892 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c9630177-3a8d-4c3a-8c62-dd93288c7232", "name": "network-vif-deleted", "tag": "165bd568-9d49-4f11-b8e1-eb1d0dc675b3", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:49:45.523216 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-188ede2b-04c0-483d-8869-f9e1f8eaafc7 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:49:45.523755 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c9630177-3a8d-4c3a-8c62-dd93288c7232', 'name': 'network-vif-deleted', 'tag': '165bd568-9d49-4f11-b8e1-eb1d0dc675b3', 'status': 'completed', 'code': 200} Dec 09 21:49:45.542557 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ed6fb34-e40c-499f-b63f-5ef477564042 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=335d778a-42fd-4da5-bbd8-380b90c8d256,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:45.677921 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9512d631-a1cc-4606-962e-d12e6ee4c070 req-9ee496b5-69aa-46ea-ba90-44b74db020ba tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:45.687098 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9512d631-a1cc-4606-962e-d12e6ee4c070 req-9ee496b5-69aa-46ea-ba90-44b74db020ba tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a HTTP/1.1" status: 200 len: 945 time: 0.0797958 Dec 09 21:49:45.777193 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9512d631-a1cc-4606-962e-d12e6ee4c070 req-bb3a55d4-2a4c-4fc1-9515-240bef7724f7 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=d4fc7436-bf9a-45b0-ae03-980628053e8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0890181 Dec 09 21:49:45.968072 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f0746e09-8328-4eeb-b6fc-c56d350cd0b9 None None] New status for floating IP 3a029f47-0fde-479e-a9de-26b4149b4355: DOWN {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:49:46.402848 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48460) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:46.969531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56c6520b-42a5-442b-a28f-5ee1259b6719 req-4171205f-77b5-4437-99c8-bad98a7e6037 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:46.978744 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56c6520b-42a5-442b-a28f-5ee1259b6719 req-4171205f-77b5-4437-99c8-bad98a7e6037 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a HTTP/1.1" status: 200 len: 945 time: 0.0962677 Dec 09 21:49:47.054376 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56c6520b-42a5-442b-a28f-5ee1259b6719 req-b5e4e1fb-0778-4c9f-a71d-358754d32283 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=d4fc7436-bf9a-45b0-ae03-980628053e8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0745058 Dec 09 21:49:47.133552 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:49:47.252231 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:49:47.257290 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:49:47.257696 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:47.285517 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0778ac47-0973-449e-8e59-4dd1d5ba5a2b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:47.360369 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:47.388887 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:49:47.391329 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e9d2db36-404e-4227-b224-610690fa467f" -d '{"events": [{"server_uuid": "6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a", "name": "network-vif-plugged", "status": "completed", "tag": "7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:49:47.409824 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2,segment=NetworkSegment(502907cd-3e3c-478f-b989-3f2602eebfc8),segment_id=502907cd-3e3c-478f-b989-3f2602eebfc8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:49:47.417732 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:47.419157 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:49:47.469673 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:49:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-44ac3a9a-56d7-4207-9394-4c2b9142e32b x-openstack-request-id: req-44ac3a9a-56d7-4207-9394-4c2b9142e32b {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:49:47.470411 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a", "name": "network-vif-plugged", "status": "completed", "tag": "7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:49:47.470815 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-44ac3a9a-56d7-4207-9394-4c2b9142e32b {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:49:47.471356 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2', 'code': 200} Dec 09 21:49:47.518700 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:47.529916 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:47.530637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:47.531230 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:47.531811 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:47.532300 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:47.532788 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:47.533274 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:47.535718 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:47.536288 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:47.536803 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:47.537316 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:47.537829 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:47.538404 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:49:47.564667 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:49:47.565034 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 165bd568-9d49-4f11-b8e1-eb1d0dc675b3 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:49:47.602024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efec8982-3176-4051-9dee-de40687dad8e req-08fa88e1-4870-47d7-abf5-7131173e00e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:47.604513 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-efec8982-3176-4051-9dee-de40687dad8e req-08fa88e1-4870-47d7-abf5-7131173e00e9 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a HTTP/1.1" status: 200 len: 1098 time: 0.0602181 Dec 09 21:49:47.745850 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-efec8982-3176-4051-9dee-de40687dad8e req-5d454235-ee0d-4ae4-af4b-51333f2240ec service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=d4fc7436-bf9a-45b0-ae03-980628053e8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1111577 Dec 09 21:49:47.755386 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-0778ac47-0973-449e-8e59-4dd1d5ba5a2b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Deleting port d478d292-7b6e-4f28-b6f2-bbf3ba7d2069 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:49:47.755925 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0778ac47-0973-449e-8e59-4dd1d5ba5a2b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:47.925626 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-0778ac47-0973-449e-8e59-4dd1d5ba5a2b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] For port d478d292-7b6e-4f28-b6f2-bbf3ba7d2069, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d478d292-7b6e-4f28-b6f2-bbf3ba7d2069,segment=NetworkSegment(0189efa9-02eb-4071-ae6f-aee6c867d035),segment_id=0189efa9-02eb-4071-ae6f-aee6c867d035)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:49:47.926011 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0778ac47-0973-449e-8e59-4dd1d5ba5a2b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:47.948109 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-0778ac47-0973-449e-8e59-4dd1d5ba5a2b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Calling delete_port for d478d292-7b6e-4f28-b6f2-bbf3ba7d2069 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:49:48.261715 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-849d2615-bbf7-4409-983f-fcd540a04086 req-9ffd219b-77bb-4911-ba1e-42626d75dfed tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:48.273825 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-849d2615-bbf7-4409-983f-fcd540a04086 req-9ffd219b-77bb-4911-ba1e-42626d75dfed tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a HTTP/1.1" status: 200 len: 946 time: 0.1043754 Dec 09 21:49:48.303336 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0778ac47-0973-449e-8e59-4dd1d5ba5a2b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:48.368503 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0778ac47-0973-449e-8e59-4dd1d5ba5a2b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'Port': ['ID=d478d292-7b6e-4f28-b6f2-bbf3ba7d2069,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:48.390863 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-849d2615-bbf7-4409-983f-fcd540a04086 req-fa2fd337-6e4b-45bb-8bac-c0cece642c25 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=d4fc7436-bf9a-45b0-ae03-980628053e8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1143618 Dec 09 21:49:48.624609 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0778ac47-0973-449e-8e59-4dd1d5ba5a2b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:48.961748 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0778ac47-0973-449e-8e59-4dd1d5ba5a2b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Router 7521af04-4c9d-4f02-9889-0ff6f5545ff7 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:49:49.099704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0778ac47-0973-449e-8e59-4dd1d5ba5a2b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:49:49.114232 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48546) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:49.114611 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0778ac47-0973-449e-8e59-4dd1d5ba5a2b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "PUT /v2.0/routers/7521af04-4c9d-4f02-9889-0ff6f5545ff7/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7101412 Dec 09 21:49:49.120975 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69b05583-0d19-4a14-a659-f7f23223da2e None None] Sync routers for ids ['7521af04-4c9d-4f02-9889-0ff6f5545ff7'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:49:49.147139 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69b05583-0d19-4a14-a659-f7f23223da2e None None] Routers {'7521af04-4c9d-4f02-9889-0ff6f5545ff7'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:49:49.148080 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-69b05583-0d19-4a14-a659-f7f23223da2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:49:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7521af04-4c9d-4f02-9889-0ff6f5545ff7'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:49.209410 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-35e3082a-343c-4f86-977f-937855bebae2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Deleting subnet 13dde2f9-0dfd-4600-912c-44b7903e3595 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:49:49.214669 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-35e3082a-343c-4f86-977f-937855bebae2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:49.277230 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-35e3082a-343c-4f86-977f-937855bebae2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:49.319085 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-69b05583-0d19-4a14-a659-f7f23223da2e None None] Set router 7521af04-4c9d-4f02-9889-0ff6f5545ff7 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:49:49.542961 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-35e3082a-343c-4f86-977f-937855bebae2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:49.624606 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c87b8f-c132-4edd-b4f2-5707dbaa5826 req-4dfe4b2c-3fd2-410e-8529-90430ce8b7a5 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:49.626255 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-95c87b8f-c132-4edd-b4f2-5707dbaa5826 req-4dfe4b2c-3fd2-410e-8529-90430ce8b7a5 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a HTTP/1.1" status: 200 len: 946 time: 0.1616554 Dec 09 21:49:49.658311 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-69b05583-0d19-4a14-a659-f7f23223da2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-161742691', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57'}], 'enable_snat': True}, 'gw_port_id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:47:28Z', 'updated_at': '2021-12-09T21:49:48Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:01:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3464, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:47:29Z', 'updated_at': '2021-12-09T21:47:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:49.692254 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69b05583-0d19-4a14-a659-f7f23223da2e None None] Checking router: 7521af04-4c9d-4f02-9889-0ff6f5545ff7 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:49:49.703387 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-35e3082a-343c-4f86-977f-937855bebae2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:49.705400 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69b05583-0d19-4a14-a659-f7f23223da2e None None] Routers {'7521af04-4c9d-4f02-9889-0ff6f5545ff7'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:49:49.706287 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-69b05583-0d19-4a14-a659-f7f23223da2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:49:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7521af04-4c9d-4f02-9889-0ff6f5545ff7'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:49.717822 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-95c87b8f-c132-4edd-b4f2-5707dbaa5826 req-92a4623b-669b-4375-a796-bab055720af0 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=d4fc7436-bf9a-45b0-ae03-980628053e8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0804303 Dec 09 21:49:49.780756 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35e3082a-343c-4f86-977f-937855bebae2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'Subnet': ['ID=13dde2f9-0dfd-4600-912c-44b7903e3595,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:49.799170 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-35e3082a-343c-4f86-977f-937855bebae2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:49.802331 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-35e3082a-343c-4f86-977f-937855bebae2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "DELETE /v2.0/subnets/13dde2f9-0dfd-4600-912c-44b7903e3595 HTTP/1.1" status: 204 len: 168 time: 0.6863565 Dec 09 21:49:49.806109 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48562) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:49.809899 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-64fbf4cc-c23f-4884-a9cf-e6d794b4d019 None None] Network 92500df7-83c8-4757-9b24-3ee4dfba2da3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:49:49.932592 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7fc067f6-297b-4bd7-9b9c-3e09ded694ba tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:49.949500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeb5daca-3597-4c0e-953c-38ffd8673912 req-3fb2d9ad-75af-465e-b28f-a14f573c339c tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:49.951093 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aeb5daca-3597-4c0e-953c-38ffd8673912 req-3fb2d9ad-75af-465e-b28f-a14f573c339c tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a HTTP/1.1" status: 200 len: 946 time: 0.1199753 Dec 09 21:49:50.094744 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7fc067f6-297b-4bd7-9b9c-3e09ded694ba tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:50.110693 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aeb5daca-3597-4c0e-953c-38ffd8673912 req-65608c42-350c-4545-941b-b74817389a1a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=d4fc7436-bf9a-45b0-ae03-980628053e8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1519692 Dec 09 21:49:50.132311 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48570) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:50.185464 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-69b05583-0d19-4a14-a659-f7f23223da2e None None] Set router 7521af04-4c9d-4f02-9889-0ff6f5545ff7 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:49:50.192005 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-7fc067f6-297b-4bd7-9b9c-3e09ded694ba tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Deleting port 835940d0-c170-49f1-810e-9c4a5bea622c {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:49:50.192355 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7fc067f6-297b-4bd7-9b9c-3e09ded694ba tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:50.206890 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8dd3b7c2-dcd7-488e-aef7-926c308ab39a tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:50.208622 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8dd3b7c2-dcd7-488e-aef7-926c308ab39a tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a HTTP/1.1" status: 200 len: 1093 time: 0.0729442 Dec 09 21:49:50.213530 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48572) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:50.219824 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-7717880d-3a1e-4c40-a671-07857e54c222 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': '7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'fixed_ip_address': '172.20.0.11'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:50.278418 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7717880d-3a1e-4c40-a671-07857e54c222 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:50.311853 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-7fc067f6-297b-4bd7-9b9c-3e09ded694ba tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] For port 835940d0-c170-49f1-810e-9c4a5bea622c, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=835940d0-c170-49f1-810e-9c4a5bea622c,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:49:50.312233 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7fc067f6-297b-4bd7-9b9c-3e09ded694ba tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:50.396785 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-7fc067f6-297b-4bd7-9b9c-3e09ded694ba tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Calling delete_port for 835940d0-c170-49f1-810e-9c4a5bea622c owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:49:50.444980 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7717880d-3a1e-4c40-a671-07857e54c222 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:50.494440 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e62567a6-dce1-46d5-b35d-285cd0027b7a None None] DHCP port deletion for 92500df7-83c8-4757-9b24-3ee4dfba2da3 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:49:50.600068 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-69b05583-0d19-4a14-a659-f7f23223da2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-161742691', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57'}], 'enable_snat': True}, 'gw_port_id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:47:28Z', 'updated_at': '2021-12-09T21:49:48Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:01:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3464, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:47:29Z', 'updated_at': '2021-12-09T21:47:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:50.649347 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e62567a6-dce1-46d5-b35d-285cd0027b7a None None] Deleting port 67f1e511-4f0d-42c9-951b-d0bf389bd643 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:49:50.649728 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e62567a6-dce1-46d5-b35d-285cd0027b7a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:50.651612 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69b05583-0d19-4a14-a659-f7f23223da2e None None] The sync data for ids ['7521af04-4c9d-4f02-9889-0ff6f5545ff7'] in n-d-713301-27 is: [{'id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'name': 'tempest-TestNetworkAdvancedServerOps-router-161742691', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57'}], 'enable_snat': True}, 'gw_port_id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:47:28Z', 'updated_at': '2021-12-09T21:49:48Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '835940d0-c170-49f1-810e-9c4a5bea622c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:01:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7521af04-4c9d-4f02-9889-0ff6f5545ff7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3464, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.57', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:47:29Z', 'updated_at': '2021-12-09T21:47:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:49:50.745648 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7fc067f6-297b-4bd7-9b9c-3e09ded694ba tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:50.781649 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-7717880d-3a1e-4c40-a671-07857e54c222 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Allocated IP 172.25.3.251 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/5f2d17b1-c2fa-4f5a-88ac-a959f3404a74) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:49:50.795805 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eceb1df3-b035-4e41-b89c-012fc5e42f6e None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:49:50.825491 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fc067f6-297b-4bd7-9b9c-3e09ded694ba tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'Port': ['ID=835940d0-c170-49f1-810e-9c4a5bea622c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:50.834955 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e62567a6-dce1-46d5-b35d-285cd0027b7a None None] For port 67f1e511-4f0d-42c9-951b-d0bf389bd643, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=67f1e511-4f0d-42c9-951b-d0bf389bd643,segment=NetworkSegment(0189efa9-02eb-4071-ae6f-aee6c867d035),segment_id=0189efa9-02eb-4071-ae6f-aee6c867d035)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:49:50.835366 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e62567a6-dce1-46d5-b35d-285cd0027b7a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:50.877265 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e62567a6-dce1-46d5-b35d-285cd0027b7a None None] Calling delete_port for 67f1e511-4f0d-42c9-951b-d0bf389bd643 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:49:50.899037 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7fc067f6-297b-4bd7-9b9c-3e09ded694ba tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:50.998947 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e62567a6-dce1-46d5-b35d-285cd0027b7a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:51.026845 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e62567a6-dce1-46d5-b35d-285cd0027b7a None None] Pushing event deleted for resources: {'Port': ['ID=67f1e511-4f0d-42c9-951b-d0bf389bd643,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:51.033771 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e62567a6-dce1-46d5-b35d-285cd0027b7a None None] No DVR routers for this DVR port 67f1e511-4f0d-42c9-951b-d0bf389bd643 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:49:51.066243 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7717880d-3a1e-4c40-a671-07857e54c222 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:51.133941 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7fc067f6-297b-4bd7-9b9c-3e09ded694ba tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:51.145223 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7fc067f6-297b-4bd7-9b9c-3e09ded694ba tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:51.213411 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7717880d-3a1e-4c40-a671-07857e54c222 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:51.248442 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7fc067f6-297b-4bd7-9b9c-3e09ded694ba tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:51.249151 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7fc067f6-297b-4bd7-9b9c-3e09ded694ba tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Fanout notify agent at l3_agent the message router_deleted on router 7521af04-4c9d-4f02-9889-0ff6f5545ff7 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:49:51.260422 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7fc067f6-297b-4bd7-9b9c-3e09ded694ba tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:51.267213 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7fc067f6-297b-4bd7-9b9c-3e09ded694ba tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "DELETE /v2.0/routers/7521af04-4c9d-4f02-9889-0ff6f5545ff7 HTTP/1.1" status: 204 len: 168 time: 1.4568853 Dec 09 21:49:51.267958 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48598) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:51.341062 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7717880d-3a1e-4c40-a671-07857e54c222 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:49:51.348368 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-7717880d-3a1e-4c40-a671-07857e54c222 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:49:51.355677 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7717880d-3a1e-4c40-a671-07857e54c222 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:49:51.398277 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-097a858d-5a38-413b-b20a-0213a3b65608 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:51.407680 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7717880d-3a1e-4c40-a671-07857e54c222 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'Port': ['ID=5f2d17b1-c2fa-4f5a-88ac-a959f3404a74,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:51.521844 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-097a858d-5a38-413b-b20a-0213a3b65608 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:51.567003 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-097a858d-5a38-413b-b20a-0213a3b65608 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['92500df7-83c8-4757-9b24-3ee4dfba2da3']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:51.584249 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-097a858d-5a38-413b-b20a-0213a3b65608 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0189efa9-02eb-4071-ae6f-aee6c867d035') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:51.584612 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-097a858d-5a38-413b-b20a-0213a3b65608 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0189efa9-02eb-4071-ae6f-aee6c867d035') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:51.603068 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-097a858d-5a38-413b-b20a-0213a3b65608 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:51.625335 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-097a858d-5a38-413b-b20a-0213a3b65608 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:51.650374 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-097a858d-5a38-413b-b20a-0213a3b65608 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Releasing vlan 107 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:49:51.651314 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-097a858d-5a38-413b-b20a-0213a3b65608 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:49:52.087887 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:49:52.126712 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-097a858d-5a38-413b-b20a-0213a3b65608 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:52.135332 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-097a858d-5a38-413b-b20a-0213a3b65608 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:52.142778 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-097a858d-5a38-413b-b20a-0213a3b65608 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "DELETE /v2.0/networks/92500df7-83c8-4757-9b24-3ee4dfba2da3 HTTP/1.1" status: 204 len: 168 time: 0.8732953 Dec 09 21:49:52.146219 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48614) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:52.174139 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-097a858d-5a38-413b-b20a-0213a3b65608 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'Network': ['ID=92500df7-83c8-4757-9b24-3ee4dfba2da3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:52.219970 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 67f1e511-4f0d-42c9-951b-d0bf389bd643 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:49:52.272103 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 67f1e511-4f0d-42c9-951b-d0bf389bd643 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:49:52.274451 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 67f1e511-4f0d-42c9-951b-d0bf389bd643 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:49:52.276423 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d478d292-7b6e-4f28-b6f2-bbf3ba7d2069 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:49:52.307056 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f2d96ba6-2270-4d0a-8910-1518d1005d54 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:52.363993 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: d478d292-7b6e-4f28-b6f2-bbf3ba7d2069 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:49:52.365080 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d478d292-7b6e-4f28-b6f2-bbf3ba7d2069 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:49:52.388068 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f2d96ba6-2270-4d0a-8910-1518d1005d54 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:52.434295 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7717880d-3a1e-4c40-a671-07857e54c222 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:52.510360 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f2d96ba6-2270-4d0a-8910-1518d1005d54 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:52.516639 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f2d96ba6-2270-4d0a-8910-1518d1005d54 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:52.525795 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f2d96ba6-2270-4d0a-8910-1518d1005d54 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "DELETE /v2.0/security-groups/7e73dc80-43d2-4833-9cd1-5d1a5f84f967 HTTP/1.1" status: 204 len: 168 time: 0.3559031 Dec 09 21:49:52.544855 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2d96ba6-2270-4d0a-8910-1518d1005d54 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7e73dc80-43d2-4833-9cd1-5d1a5f84f967,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:52.681180 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7717880d-3a1e-4c40-a671-07857e54c222 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:52.898659 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7717880d-3a1e-4c40-a671-07857e54c222 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:52.916608 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7717880d-3a1e-4c40-a671-07857e54c222 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:52.952119 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48646) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:53.011245 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7717880d-3a1e-4c40-a671-07857e54c222 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'Port': ['ID=5f2d17b1-c2fa-4f5a-88ac-a959f3404a74,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:53.091645 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7717880d-3a1e-4c40-a671-07857e54c222 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:53.259883 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-386967ec-68f4-4e91-8e77-00c7e06faf17 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:53.292578 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-7717880d-3a1e-4c40-a671-07857e54c222 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Floating IP 4eb9c6ee-8df6-4019-8824-be233593b289 associated. External IP: 172.25.3.251, port: 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2. Dec 09 21:49:53.325599 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48654) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:53.336201 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-15561896-c899-4d5a-a2ff-943913198ecb tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1483736634', 'description': 'tempest-secgroup-smoke-1483736634 description', 'project_id': 'dce7594ac2a74901912a2f19de04bf79'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:53.408405 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15561896-c899-4d5a-a2ff-943913198ecb tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:53.458177 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-386967ec-68f4-4e91-8e77-00c7e06faf17 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:53.475211 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-386967ec-68f4-4e91-8e77-00c7e06faf17 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:53.531000 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-386967ec-68f4-4e91-8e77-00c7e06faf17 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e30a7103075d48f3bcbf8f29b43dc420&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5759733 Dec 09 21:49:53.531323 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48658) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:53.532082 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-386967ec-68f4-4e91-8e77-00c7e06faf17 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a03bae8a-3b47-40ac-9fcb-4332a8e397a6,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:53.638548 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15561896-c899-4d5a-a2ff-943913198ecb tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:53.650984 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15561896-c899-4d5a-a2ff-943913198ecb tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:53.714891 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c82ac0e9-28e8-4054-b520-3f607750d500 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:53.755581 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15561896-c899-4d5a-a2ff-943913198ecb tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:53.764624 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-15561896-c899-4d5a-a2ff-943913198ecb tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.4355657 Dec 09 21:49:53.770161 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c82ac0e9-28e8-4054-b520-3f607750d500 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:53.772170 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48668) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:53.783076 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 835940d0-c170-49f1-810e-9c4a5bea622c no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:49:53.805116 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15561896-c899-4d5a-a2ff-943913198ecb tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroup': ['ID=804c3895-61f7-4cc1-b0c5-503b9ff5fa56,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:53.823507 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 835940d0-c170-49f1-810e-9c4a5bea622c {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:49:53.827134 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 835940d0-c170-49f1-810e-9c4a5bea622c not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:49:53.829996 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-0543cf40-3ed7-416b-b842-bfba47e2f2d3 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group_rule': {'security_group_id': '804c3895-61f7-4cc1-b0c5-503b9ff5fa56', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:53.864049 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7717880d-3a1e-4c40-a671-07857e54c222 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:49:53.968981 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0543cf40-3ed7-416b-b842-bfba47e2f2d3 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:53.997029 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c82ac0e9-28e8-4054-b520-3f607750d500 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:53.999615 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c82ac0e9-28e8-4054-b520-3f607750d500 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:54.003201 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c82ac0e9-28e8-4054-b520-3f607750d500 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/a03bae8a-3b47-40ac-9fcb-4332a8e397a6 HTTP/1.1" status: 204 len: 168 time: 0.4677751 Dec 09 21:49:54.057432 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c82ac0e9-28e8-4054-b520-3f607750d500 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a03bae8a-3b47-40ac-9fcb-4332a8e397a6,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:54.098737 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7717880d-3a1e-4c40-a671-07857e54c222 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:49:54.108726 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0543cf40-3ed7-416b-b842-bfba47e2f2d3 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:54.114962 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32a68de6-0842-4386-8bf5-c4ae3f570c30 None None] Sync routers for ids ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:49:54.122504 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0543cf40-3ed7-416b-b842-bfba47e2f2d3 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:54.133794 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32a68de6-0842-4386-8bf5-c4ae3f570c30 None None] Routers {'6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:49:54.134518 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-32a68de6-0842-4386-8bf5-c4ae3f570c30 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:49:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:54.138162 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7717880d-3a1e-4c40-a671-07857e54c222 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:54.168933 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0543cf40-3ed7-416b-b842-bfba47e2f2d3 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f0a47f38-4596-4e56-b8c0-2db98542fbfb,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:54.181923 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48676) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:54.190409 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7717880d-3a1e-4c40-a671-07857e54c222 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 3.9756608 Dec 09 21:49:54.197427 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a', 'tag': '7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:49:54.199872 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-de6aad93-6cac-41d6-b05d-a06f13883e41" -d '{"events": [{"name": "network-changed", "server_uuid": "6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a", "tag": "7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:49:54.211473 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0543cf40-3ed7-416b-b842-bfba47e2f2d3 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:54.212734 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0543cf40-3ed7-416b-b842-bfba47e2f2d3 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4395134 Dec 09 21:49:54.216412 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48680) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:54.228885 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-eefc745e-ff2a-4016-aba1-191da9d24fad tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group_rule': {'security_group_id': '804c3895-61f7-4cc1-b0c5-503b9ff5fa56', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:54.292239 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b79d4d7b-e314-4c79-979c-6086c0f86d1b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/floatingips/4eb9c6ee-8df6-4019-8824-be233593b289 HTTP/1.1" status: 200 len: 992 time: 0.1087565 Dec 09 21:49:54.300215 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eefc745e-ff2a-4016-aba1-191da9d24fad tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:54.306367 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:49:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bfc272d8-a59a-4417-942f-bad142e423fe x-openstack-request-id: req-bfc272d8-a59a-4417-942f-bad142e423fe {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:49:54.306665 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a", "tag": "7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:49:54.306936 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-bfc272d8-a59a-4417-942f-bad142e423fe {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:49:54.307339 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a', 'tag': '7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2', 'status': 'completed', 'code': 200} Dec 09 21:49:54.352656 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-32a68de6-0842-4386-8bf5-c4ae3f570c30 None None] Set router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:49:54.423564 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de6aad93-6cac-41d6-b05d-a06f13883e41 req-a1df1d0e-f6e2-470d-9f31-90f4264494d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:54.425120 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-de6aad93-6cac-41d6-b05d-a06f13883e41 req-a1df1d0e-f6e2-470d-9f31-90f4264494d1 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e863bf78256945798e7c717c650258aa&device_id=6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a HTTP/1.1" status: 200 len: 1098 time: 0.0943751 Dec 09 21:49:54.442486 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eefc745e-ff2a-4016-aba1-191da9d24fad tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:54.450643 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eefc745e-ff2a-4016-aba1-191da9d24fad tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:54.485370 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eefc745e-ff2a-4016-aba1-191da9d24fad tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b70392a3-0b6f-4180-ab3c-116790626aea,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:54.512485 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eefc745e-ff2a-4016-aba1-191da9d24fad tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:54.516882 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48688) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:54.517031 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-eefc745e-ff2a-4016-aba1-191da9d24fad tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2961335 Dec 09 21:49:54.522024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-405f3fd1-b27e-4a0b-8c58-864a81716e5e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group_rule': {'security_group_id': '804c3895-61f7-4cc1-b0c5-503b9ff5fa56', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:54.561674 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de6aad93-6cac-41d6-b05d-a06f13883e41 req-c9d26c29-331e-414d-9c49-351cc47de01f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:54.563597 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-de6aad93-6cac-41d6-b05d-a06f13883e41 req-c9d26c29-331e-414d-9c49-351cc47de01f service neutron] 10.222.0.31 "GET /v2.0/networks?id=5ed1c0c9-0d1a-458b-9180-fe96edb96b56 HTTP/1.1" status: 200 len: 896 time: 0.1300023 Dec 09 21:49:54.601667 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48690) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:54.618345 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-452653b9-55d2-48ff-bb70-8c7cd7ccb748 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:54.655139 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-405f3fd1-b27e-4a0b-8c58-864a81716e5e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:54.736389 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-de6aad93-6cac-41d6-b05d-a06f13883e41 req-5ee3b6c9-e553-4df0-b64e-86da6200f213 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 HTTP/1.1" status: 200 len: 1000 time: 0.1586983 Dec 09 21:49:54.764991 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-452653b9-55d2-48ff-bb70-8c7cd7ccb748 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:54.787006 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-32a68de6-0842-4386-8bf5-c4ae3f570c30 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'name': 'tempest-TestNetworkBasicOps-router-792281405', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36'}], 'enable_snat': True}, 'gw_port_id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:29Z', 'revision_number': 4, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:2c:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3592, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '4eb9c6ee-8df6-4019-8824-be233593b289', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'floating_ip_address': '172.25.3.251', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'port_id': '7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 3637, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'mac_address': 'fa:16:3e:10:cf:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:49:51Z', 'updated_at': '2021-12-09T21:49:51Z', 'revision_number': 0, 'project_id': 'e863bf78256945798e7c717c650258aa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'efd747c8-9308-4be4-8445-86a9ce208bf3', 'name': '', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:c1:e4:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:27Z', 'updated_at': '2021-12-09T21:49:33Z', 'revision_number': 5, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:54.790647 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-452653b9-55d2-48ff-bb70-8c7cd7ccb748 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:54.807577 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-405f3fd1-b27e-4a0b-8c58-864a81716e5e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:54.814972 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de6aad93-6cac-41d6-b05d-a06f13883e41 req-33a8f072-cdaa-4a8a-8a4d-880eed90e5d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:54.816685 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-de6aad93-6cac-41d6-b05d-a06f13883e41 req-33a8f072-cdaa-4a8a-8a4d-880eed90e5d9 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=01104ce9-312c-40a5-b51d-c30bc463bf2c HTTP/1.1" status: 200 len: 835 time: 0.0718489 Dec 09 21:49:54.817879 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-405f3fd1-b27e-4a0b-8c58-864a81716e5e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:54.859751 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32a68de6-0842-4386-8bf5-c4ae3f570c30 None None] Checking router: 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:49:54.868778 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-452653b9-55d2-48ff-bb70-8c7cd7ccb748 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=b0b317dd511d4f10ae70201e98eac58a&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2656789 Dec 09 21:49:54.869611 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48700) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:54.871426 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-452653b9-55d2-48ff-bb70-8c7cd7ccb748 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eee2617d-3eb8-43e7-b8d4-0daeaf3e406e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:54.876090 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-405f3fd1-b27e-4a0b-8c58-864a81716e5e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=73f27d3a-a23e-4600-b7aa-d02b6fcac938,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:54.884254 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32a68de6-0842-4386-8bf5-c4ae3f570c30 None None] Routers {'6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:49:54.885008 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-32a68de6-0842-4386-8bf5-c4ae3f570c30 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:49:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:54.887285 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-405f3fd1-b27e-4a0b-8c58-864a81716e5e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:54.888497 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-405f3fd1-b27e-4a0b-8c58-864a81716e5e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3705802 Dec 09 21:49:54.891860 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48702) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:54.900546 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-dd7bf0e3-3801-4ede-87c6-d3ec52b905c7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group_rule': {'security_group_id': '804c3895-61f7-4cc1-b0c5-503b9ff5fa56', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:54.925694 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de6aad93-6cac-41d6-b05d-a06f13883e41 req-cd252cbe-f309-4993-8967-c89c2e1347ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:54.928881 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-de6aad93-6cac-41d6-b05d-a06f13883e41 req-cd252cbe-f309-4993-8967-c89c2e1347ba service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5ed1c0c9-0d1a-458b-9180-fe96edb96b56&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1027157 Dec 09 21:49:54.985050 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dd7bf0e3-3801-4ede-87c6-d3ec52b905c7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:54.997106 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fdf962c0-54a6-4487-9c4e-8dcfa60327d3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:55.022631 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fdf962c0-54a6-4487-9c4e-8dcfa60327d3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:55.033276 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-32a68de6-0842-4386-8bf5-c4ae3f570c30 None None] Set router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:49:55.050010 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dd7bf0e3-3801-4ede-87c6-d3ec52b905c7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:55.095682 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fdf962c0-54a6-4487-9c4e-8dcfa60327d3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:55.107294 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dd7bf0e3-3801-4ede-87c6-d3ec52b905c7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:55.116202 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-fdf962c0-54a6-4487-9c4e-8dcfa60327d3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:55.116945 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:49:55.137333 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fdf962c0-54a6-4487-9c4e-8dcfa60327d3 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/eee2617d-3eb8-43e7-b8d4-0daeaf3e406e HTTP/1.1" status: 204 len: 168 time: 0.2348318 Dec 09 21:49:55.149765 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdf962c0-54a6-4487-9c4e-8dcfa60327d3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eee2617d-3eb8-43e7-b8d4-0daeaf3e406e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:55.175425 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-dd7bf0e3-3801-4ede-87c6-d3ec52b905c7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:55.180740 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-dd7bf0e3-3801-4ede-87c6-d3ec52b905c7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2849343 Dec 09 21:49:55.180900 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48710) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:55.185692 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-5f05fd07-a4df-484a-8b7b-cba7eaf9c164 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group_rule': {'security_group_id': '804c3895-61f7-4cc1-b0c5-503b9ff5fa56', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:55.186858 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd7bf0e3-3801-4ede-87c6-d3ec52b905c7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a0fb6886-610f-4c0d-8e71-f1caccbddc3f,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:55.251809 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-de6aad93-6cac-41d6-b05d-a06f13883e41 req-81d1de5c-2e4c-43be-9f0a-23ef3e8401dd service neutron] 10.222.0.31 "GET /v2.0/networks/5ed1c0c9-0d1a-458b-9180-fe96edb96b56?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3139944 Dec 09 21:49:55.257149 n-d-713301-27 neutron-server[103438]: INFO neutron.db.securitygroups_db [None req-5f05fd07-a4df-484a-8b7b-cba7eaf9c164 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Project dce7594ac2a74901912a2f19de04bf79 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 21:49:55.273229 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5f05fd07-a4df-484a-8b7b-cba7eaf9c164 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:55.303011 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48714) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:55.441923 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a187c01d-0c19-4049-b0c1-46fa97df87f1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/floatingips/4eb9c6ee-8df6-4019-8824-be233593b289 HTTP/1.1" status: 200 len: 992 time: 0.1374927 Dec 09 21:49:55.478051 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-de6aad93-6cac-41d6-b05d-a06f13883e41 req-7c91afc0-538d-4444-be21-16460b8d6a33 service neutron] 10.222.0.31 "GET /v2.0/networks/5ed1c0c9-0d1a-458b-9180-fe96edb96b56?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2166908 Dec 09 21:49:55.517103 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5f05fd07-a4df-484a-8b7b-cba7eaf9c164 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:55.523894 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5f05fd07-a4df-484a-8b7b-cba7eaf9c164 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:55.553809 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f05fd07-a4df-484a-8b7b-cba7eaf9c164 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f9d5f92e-f59d-4cf9-af62-1996b3e1d18a,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:55.560532 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5f05fd07-a4df-484a-8b7b-cba7eaf9c164 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:55.564570 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5f05fd07-a4df-484a-8b7b-cba7eaf9c164 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3799193 Dec 09 21:49:55.566450 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48720) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:55.572808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-e52d4f61-b9fd-48eb-90b0-e7d8cc368c99 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group_rule': {'security_group_id': '804c3895-61f7-4cc1-b0c5-503b9ff5fa56', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:55.606653 n-d-713301-27 neutron-server[103438]: INFO neutron.db.securitygroups_db [None req-e52d4f61-b9fd-48eb-90b0-e7d8cc368c99 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Project dce7594ac2a74901912a2f19de04bf79 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 21:49:55.615289 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e52d4f61-b9fd-48eb-90b0-e7d8cc368c99 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:55.615738 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-32a68de6-0842-4386-8bf5-c4ae3f570c30 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'name': 'tempest-TestNetworkBasicOps-router-792281405', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36'}], 'enable_snat': True}, 'gw_port_id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:29Z', 'revision_number': 4, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:2c:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3592, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '4eb9c6ee-8df6-4019-8824-be233593b289', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'floating_ip_address': '172.25.3.251', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'port_id': '7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 3637, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'mac_address': 'fa:16:3e:10:cf:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:49:51Z', 'updated_at': '2021-12-09T21:49:51Z', 'revision_number': 0, 'project_id': 'e863bf78256945798e7c717c650258aa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'efd747c8-9308-4be4-8445-86a9ce208bf3', 'name': '', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:c1:e4:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:27Z', 'updated_at': '2021-12-09T21:49:33Z', 'revision_number': 5, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:55.676115 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32a68de6-0842-4386-8bf5-c4ae3f570c30 None None] The sync data for ids ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'] in n-d-713301-27 is: [{'id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'name': 'tempest-TestNetworkBasicOps-router-792281405', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36'}], 'enable_snat': True}, 'gw_port_id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:29Z', 'revision_number': 4, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:2c:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3592, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '4eb9c6ee-8df6-4019-8824-be233593b289', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'floating_ip_address': '172.25.3.251', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'port_id': '7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 3637, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'mac_address': 'fa:16:3e:10:cf:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:49:51Z', 'updated_at': '2021-12-09T21:49:51Z', 'revision_number': 0, 'project_id': 'e863bf78256945798e7c717c650258aa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'efd747c8-9308-4be4-8445-86a9ce208bf3', 'name': '', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:c1:e4:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:27Z', 'updated_at': '2021-12-09T21:49:33Z', 'revision_number': 5, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:49:55.731528 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e52d4f61-b9fd-48eb-90b0-e7d8cc368c99 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:55.742449 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e52d4f61-b9fd-48eb-90b0-e7d8cc368c99 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:55.762644 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e52d4f61-b9fd-48eb-90b0-e7d8cc368c99 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9ea64504-7020-4f62-a3ed-b023c1ffe8b8,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:55.787336 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e52d4f61-b9fd-48eb-90b0-e7d8cc368c99 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:55.789757 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e52d4f61-b9fd-48eb-90b0-e7d8cc368c99 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2216177 Dec 09 21:49:55.792171 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48732) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:55.797992 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-0fd44cb4-9959-41fd-9ae3-266ef89888c7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'network': {'name': 'tempest-network-smoke--786544372', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'port_security_enabled': True}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:55.854996 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0fd44cb4-9959-41fd-9ae3-266ef89888c7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Made reservation on behalf of dce7594ac2a74901912a2f19de04bf79 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:49:55.861825 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0fd44cb4-9959-41fd-9ae3-266ef89888c7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:55.897008 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0fd44cb4-9959-41fd-9ae3-266ef89888c7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] vlan segment allocate from pool success with {'vlan_id': 104, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:49:55.917413 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0fd44cb4-9959-41fd-9ae3-266ef89888c7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:55.918121 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-0fd44cb4-9959-41fd-9ae3-266ef89888c7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Added segment bb2623a0-5941-46ea-9e2a-adfecf120d3a of type vlan for network 69e4f0dc-5303-45fd-9842-f33d6a22b48d Dec 09 21:49:55.991570 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0fd44cb4-9959-41fd-9ae3-266ef89888c7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:56.036799 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0fd44cb4-9959-41fd-9ae3-266ef89888c7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:56.044584 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0fd44cb4-9959-41fd-9ae3-266ef89888c7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:56.045426 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0fd44cb4-9959-41fd-9ae3-266ef89888c7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:56.101012 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0fd44cb4-9959-41fd-9ae3-266ef89888c7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.3073442 Dec 09 21:49:56.105593 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48744) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:56.117357 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-24bec189-4552-440c-94ea-6de6438b3e73 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-1363834495', 'admin_state_up': True, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:56.171014 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fd44cb4-9959-41fd-9ae3-266ef89888c7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Network': ['ID=69e4f0dc-5303-45fd-9842-f33d6a22b48d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:56.172106 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24bec189-4552-440c-94ea-6de6438b3e73 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:56.174558 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24bec189-4552-440c-94ea-6de6438b3e73 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:56.186447 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 69e4f0dc-5303-45fd-9842-f33d6a22b48d details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:49:56.246254 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24bec189-4552-440c-94ea-6de6438b3e73 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:56.350918 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-543a8ef3-a054-457a-bf46-4b96b1e13ab2 None None] New status for floating IP 4eb9c6ee-8df6-4019-8824-be233593b289: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:49:56.445925 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48758) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:56.517480 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24bec189-4552-440c-94ea-6de6438b3e73 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:56.542710 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ca7f523c-0f60-45bb-8ac6-ecd44add1ef3 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/floatingips/4eb9c6ee-8df6-4019-8824-be233593b289 HTTP/1.1" status: 200 len: 992 time: 0.0951498 Dec 09 21:49:57.207162 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24bec189-4552-440c-94ea-6de6438b3e73 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:57.229048 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24bec189-4552-440c-94ea-6de6438b3e73 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:57.317955 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:57.467409 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-24bec189-4552-440c-94ea-6de6438b3e73 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Allocated IP 172.25.3.78 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/5acb1872-d950-4751-958f-af9bafe79bef) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:49:57.544317 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48806) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:57.545820 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:57.668651 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24bec189-4552-440c-94ea-6de6438b3e73 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:57.679735 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cc68d7f5-1e36-4984-95d4-2b633fd79bdb tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/floatingips/4eb9c6ee-8df6-4019-8824-be233593b289 HTTP/1.1" status: 200 len: 994 time: 0.1341794 Dec 09 21:49:57.764351 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24bec189-4552-440c-94ea-6de6438b3e73 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:57.789808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-24bec189-4552-440c-94ea-6de6438b3e73 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:49:57.795175 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48818) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:57.834659 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-24bec189-4552-440c-94ea-6de6438b3e73 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:49:57.844814 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24bec189-4552-440c-94ea-6de6438b3e73 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:49:57.870305 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-91b32e69-a25e-4ec9-b981-46a72603c51c None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:49:57.934294 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24bec189-4552-440c-94ea-6de6438b3e73 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Port': ['ID=5acb1872-d950-4751-958f-af9bafe79bef,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:57.995185 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5288f7a-6cd4-4bc7-ab23-1847ae90609b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:58.028936 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-904f34e1-ad98-46d0-a53e-33325a9240dc None None] Provisioning complete for port 5acb1872-d950-4751-958f-af9bafe79bef triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:49:58.031606 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-904f34e1-ad98-46d0-a53e-33325a9240dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:58.077746 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-904f34e1-ad98-46d0-a53e-33325a9240dc None None] Port 5acb1872-d950-4751-958f-af9bafe79bef cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:49:58.121275 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5288f7a-6cd4-4bc7-ab23-1847ae90609b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:58.127183 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5288f7a-6cd4-4bc7-ab23-1847ae90609b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:58.200915 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5288f7a-6cd4-4bc7-ab23-1847ae90609b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5d454ea7-ffae-4895-8db7-545465ae2811,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:58.207869 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d5288f7a-6cd4-4bc7-ab23-1847ae90609b admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ce95e6e0b1c449259d620f108310a0a2&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4109831 Dec 09 21:49:58.210681 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48838) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:58.267918 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24bec189-4552-440c-94ea-6de6438b3e73 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:58.329280 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b24ae217-8bab-41e4-9fbf-1336574a6863 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:58.394764 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b24ae217-8bab-41e4-9fbf-1336574a6863 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:58.529505 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b24ae217-8bab-41e4-9fbf-1336574a6863 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:58.532203 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b24ae217-8bab-41e4-9fbf-1336574a6863 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:58.535872 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b24ae217-8bab-41e4-9fbf-1336574a6863 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/5d454ea7-ffae-4895-8db7-545465ae2811 HTTP/1.1" status: 204 len: 168 time: 0.3214872 Dec 09 21:49:58.552918 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b24ae217-8bab-41e4-9fbf-1336574a6863 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5d454ea7-ffae-4895-8db7-545465ae2811,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:58.561655 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24bec189-4552-440c-94ea-6de6438b3e73 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:58.746859 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-24bec189-4552-440c-94ea-6de6438b3e73 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Router 115e1e9e-f059-4a58-90c3-f04312423cd9 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:49:58.914578 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-24bec189-4552-440c-94ea-6de6438b3e73 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:49:58.926302 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] Sync routers for ids ['115e1e9e-f059-4a58-90c3-f04312423cd9'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:49:58.942347 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] Routers {'115e1e9e-f059-4a58-90c3-f04312423cd9'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:49:58.943263 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:49:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['115e1e9e-f059-4a58-90c3-f04312423cd9'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:58.948963 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-24bec189-4552-440c-94ea-6de6438b3e73 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:58.950266 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-24bec189-4552-440c-94ea-6de6438b3e73 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 895 time: 2.8434699 Dec 09 21:49:58.953774 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48870) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:59.010248 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5e04e8f1-dc60-4868-8a39-6448246a1fd7 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/subnets?project_id=dce7594ac2a74901912a2f19de04bf79&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0549319 Dec 09 21:49:59.013057 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48872) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:59.039645 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48876) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:59.055270 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8dd0fd3-9e12-423e-89b9-ee71f09e5b5a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:59.165878 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8dd0fd3-9e12-423e-89b9-ee71f09e5b5a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:59.173128 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] Set router 115e1e9e-f059-4a58-90c3-f04312423cd9 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:49:59.184029 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8dd0fd3-9e12-423e-89b9-ee71f09e5b5a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:59.233797 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a8dd0fd3-9e12-423e-89b9-ee71f09e5b5a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=1faf27e12b3344f19f5bfd909e55ed00&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1923630 Dec 09 21:49:59.234047 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48882) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:59.234604 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8dd0fd3-9e12-423e-89b9-ee71f09e5b5a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a3af40a2-53ea-409a-9f9b-ce2bf84f3385,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:59.266442 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-410edbee-9291-480e-b642-c70ac96c492a tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:59.268085 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-410edbee-9291-480e-b642-c70ac96c492a tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.2540302 Dec 09 21:49:59.277019 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48886) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:59.327193 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48890) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:59.331241 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-59cbbfb1-e536-487d-98f2-27d25c8fbf25 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/subnets?network_id=97925a19-460a-4476-8208-41db134b6c83&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0515525 Dec 09 21:49:59.333155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-7d9f9594-d503-435b-8526-259fc002d281 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1900613074', 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:49:59.350851 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f5d0a191-eb56-42ba-bf41-0447aca4ef17 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:59.377387 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f5d0a191-eb56-42ba-bf41-0447aca4ef17 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:59.437816 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1363834495', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78'}], 'enable_snat': True}, 'gw_port_id': '5acb1872-d950-4751-958f-af9bafe79bef', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:56Z', 'updated_at': '2021-12-09T21:49:58Z', 'revision_number': 3, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '5acb1872-d950-4751-958f-af9bafe79bef', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:8d:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3660, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:57Z', 'updated_at': '2021-12-09T21:49:57Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:49:59.462710 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f5d0a191-eb56-42ba-bf41-0447aca4ef17 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:59.466008 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f5d0a191-eb56-42ba-bf41-0447aca4ef17 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:59.467284 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f5d0a191-eb56-42ba-bf41-0447aca4ef17 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/a3af40a2-53ea-409a-9f9b-ce2bf84f3385 HTTP/1.1" status: 204 len: 168 time: 0.2323029 Dec 09 21:49:59.470760 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] Checking router: 115e1e9e-f059-4a58-90c3-f04312423cd9 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:49:59.471544 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] Updating router 115e1e9e-f059-4a58-90c3-f04312423cd9 port 5acb1872-d950-4751-958f-af9bafe79bef binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:49:59.490773 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5d0a191-eb56-42ba-bf41-0447aca4ef17 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a3af40a2-53ea-409a-9f9b-ce2bf84f3385,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:59.502417 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:59.525872 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7d9f9594-d503-435b-8526-259fc002d281 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Made reservation on behalf of dce7594ac2a74901912a2f19de04bf79 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:49:59.531831 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7d9f9594-d503-435b-8526-259fc002d281 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:59.810371 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7d9f9594-d503-435b-8526-259fc002d281 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:59.827881 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48902) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:49:59.911207 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:59.915795 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d9f9594-d503-435b-8526-259fc002d281 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Checking segment: {'id': 'bb2623a0-5941-46ea-9e2a-adfecf120d3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:49:59.916161 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d9f9594-d503-435b-8526-259fc002d281 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network hostable DHCP agents. Network: 69e4f0dc-5303-45fd-9842-f33d6a22b48d, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:49:59.920352 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d9f9594-d503-435b-8526-259fc002d281 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Subnet': ['ID=1317305d-5040-4a27-9e95-c846c3faa444,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:49:59.922839 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:49:59.946969 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d9f9594-d503-435b-8526-259fc002d281 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network 69e4f0dc-5303-45fd-9842-f33d6a22b48d is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:49:59.965467 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-7d9f9594-d503-435b-8526-259fc002d281 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 69e4f0dc-5303-45fd-9842-f33d6a22b48d) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:49:59.974148 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71fa6c7f-34a8-4dd5-84e1-18005d9e7b65 None None] Network 69e4f0dc-5303-45fd-9842-f33d6a22b48d requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:49:59.977314 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7d9f9594-d503-435b-8526-259fc002d281 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:49:59.978804 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7d9f9594-d503-435b-8526-259fc002d281 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:00.013541 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7d9f9594-d503-435b-8526-259fc002d281 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.6851315 Dec 09 21:50:00.017444 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 48914) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:00.041862 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-25c4b4e6-cb3d-4a6d-931d-578e46676605 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:50:00.090409 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7082de0-061d-4a4c-895c-ad74053e6f82 None None] Pushing event updated for resources: {'Port': ['ID=5acb1872-d950-4751-958f-af9bafe79bef,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:00.103328 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5acbc530-d52e-4f19-a7bf-0f58b3a1ee56 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:00.115211 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7082de0-061d-4a4c-895c-ad74053e6f82 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:00.117882 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7082de0-061d-4a4c-895c-ad74053e6f82 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:00.119831 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7082de0-061d-4a4c-895c-ad74053e6f82 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:00.120421 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7082de0-061d-4a4c-895c-ad74053e6f82 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:00.123188 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7082de0-061d-4a4c-895c-ad74053e6f82 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:00.123869 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7082de0-061d-4a4c-895c-ad74053e6f82 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:00.124371 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7082de0-061d-4a4c-895c-ad74053e6f82 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:00.125029 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7082de0-061d-4a4c-895c-ad74053e6f82 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:00.125844 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7082de0-061d-4a4c-895c-ad74053e6f82 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:00.126442 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7082de0-061d-4a4c-895c-ad74053e6f82 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:00.127953 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7082de0-061d-4a4c-895c-ad74053e6f82 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:00.128482 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7082de0-061d-4a4c-895c-ad74053e6f82 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:00.129202 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7082de0-061d-4a4c-895c-ad74053e6f82 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:00.137689 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] Attempting to bind port 5acb1872-d950-4751-958f-af9bafe79bef on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:50:00.138510 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] Attempting to bind port 5acb1872-d950-4751-958f-af9bafe79bef by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:50:00.139189 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] Attempting to bind port 5acb1872-d950-4751-958f-af9bafe79bef on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:50:00.157299 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4be85e21-1811-4797-9656-b46ba1e9793a None None] Provisioning complete for port 5acb1872-d950-4751-958f-af9bafe79bef triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:00.158066 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4be85e21-1811-4797-9656-b46ba1e9793a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:00.162253 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 49, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:50:00.166921 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:50:00.167429 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:00.167853 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:50:00.168367 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] Bound port: 5acb1872-d950-4751-958f-af9bafe79bef, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:50:00.175077 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:00.197317 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-648453a7-0d3d-4602-af99-a5731071fac8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-69e4f0dc-5303-45fd-9842-f33d6a22b48d', 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'fixed_ips': [{'subnet_id': '1317305d-5040-4a27-9e95-c846c3faa444'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:50:00.198206 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-648453a7-0d3d-4602-af99-a5731071fac8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:00.224001 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-4be85e21-1811-4797-9656-b46ba1e9793a None None] Port 5acb1872-d950-4751-958f-af9bafe79bef cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:50:00.283559 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] For port 5acb1872-d950-4751-958f-af9bafe79bef, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:50:00.287328 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] For port 5acb1872-d950-4751-958f-af9bafe79bef, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5acb1872-d950-4751-958f-af9bafe79bef,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:50:00.296764 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:00.367702 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-648453a7-0d3d-4602-af99-a5731071fac8 None None] Allocated IP 172.20.0.2 (69e4f0dc-5303-45fd-9842-f33d6a22b48d/1317305d-5040-4a27-9e95-c846c3faa444/a196a712-e676-435b-80b5-de2dae28882d) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:50:00.385914 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] Routers {'115e1e9e-f059-4a58-90c3-f04312423cd9'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:50:00.386866 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:49:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['115e1e9e-f059-4a58-90c3-f04312423cd9'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:50:00.390684 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7082de0-061d-4a4c-895c-ad74053e6f82 None None] Pushing event updated for resources: {'Port': ['ID=5acb1872-d950-4751-958f-af9bafe79bef,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:00.442478 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5acbc530-d52e-4f19-a7bf-0f58b3a1ee56 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:00.493138 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5acbc530-d52e-4f19-a7bf-0f58b3a1ee56 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:00.521965 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-648453a7-0d3d-4602-af99-a5731071fac8 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:00.527060 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f5efbe44-9f35-4d06-8fe8-e056c1a0f336 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:50:00.535190 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-648453a7-0d3d-4602-af99-a5731071fac8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:00.587185 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] Set router 115e1e9e-f059-4a58-90c3-f04312423cd9 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:50:00.587321 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5acbc530-d52e-4f19-a7bf-0f58b3a1ee56 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ff971a97-8953-4b72-a851-2c9fe04568ad,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:00.591598 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-648453a7-0d3d-4602-af99-a5731071fac8 None None] Network 69e4f0dc-5303-45fd-9842-f33d6a22b48d is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:50:00.602599 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5acbc530-d52e-4f19-a7bf-0f58b3a1ee56 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=cea19795106b4c2591c5cc18c2b18d1e&name=default HTTP/1.1" status: 200 len: 3000 time: 0.7711997 Dec 09 21:50:00.603050 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48926) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:00.606694 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-648453a7-0d3d-4602-af99-a5731071fac8 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:50:00.608776 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-648453a7-0d3d-4602-af99-a5731071fac8 None None] Pushing event updated for resources: {'Port': ['ID=a196a712-e676-435b-80b5-de2dae28882d,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:00.611676 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-648453a7-0d3d-4602-af99-a5731071fac8 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:50:00.678588 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-be486497-8ec0-45c0-b7f5-a7808f6f9d2b None None] Provisioning complete for port 5acb1872-d950-4751-958f-af9bafe79bef triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:00.679316 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-be486497-8ec0-45c0-b7f5-a7808f6f9d2b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:00.722600 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-850412a4-2ce2-484d-a22f-46be0eba7fcf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:00.742462 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-648453a7-0d3d-4602-af99-a5731071fac8 None None] Attempting to bind port a196a712-e676-435b-80b5-de2dae28882d on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:50:00.743114 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-648453a7-0d3d-4602-af99-a5731071fac8 None None] Attempting to bind port a196a712-e676-435b-80b5-de2dae28882d by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'bb2623a0-5941-46ea-9e2a-adfecf120d3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:50:00.743696 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-648453a7-0d3d-4602-af99-a5731071fac8 None None] Attempting to bind port a196a712-e676-435b-80b5-de2dae28882d on network 69e4f0dc-5303-45fd-9842-f33d6a22b48d {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:50:00.752448 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-648453a7-0d3d-4602-af99-a5731071fac8 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 49, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:50:00.753205 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-648453a7-0d3d-4602-af99-a5731071fac8 None None] Checking segment: {'id': 'bb2623a0-5941-46ea-9e2a-adfecf120d3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:50:00.753776 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-648453a7-0d3d-4602-af99-a5731071fac8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:00.754775 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-648453a7-0d3d-4602-af99-a5731071fac8 None None] Bound using segment: {'id': 'bb2623a0-5941-46ea-9e2a-adfecf120d3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:50:00.755577 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-648453a7-0d3d-4602-af99-a5731071fac8 None None] Bound port: a196a712-e676-435b-80b5-de2dae28882d, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bb2623a0-5941-46ea-9e2a-adfecf120d3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:50:00.756149 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-648453a7-0d3d-4602-af99-a5731071fac8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:00.769407 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-850412a4-2ce2-484d-a22f-46be0eba7fcf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:00.816553 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-be486497-8ec0-45c0-b7f5-a7808f6f9d2b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:00.916175 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-850412a4-2ce2-484d-a22f-46be0eba7fcf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:00.920841 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-850412a4-2ce2-484d-a22f-46be0eba7fcf admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:00.924657 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-850412a4-2ce2-484d-a22f-46be0eba7fcf admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/ff971a97-8953-4b72-a851-2c9fe04568ad HTTP/1.1" status: 204 len: 168 time: 0.3181176 Dec 09 21:50:00.930930 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-850412a4-2ce2-484d-a22f-46be0eba7fcf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ff971a97-8953-4b72-a851-2c9fe04568ad,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:01.021970 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-be486497-8ec0-45c0-b7f5-a7808f6f9d2b None None] For port 5acb1872-d950-4751-958f-af9bafe79bef, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5acb1872-d950-4751-958f-af9bafe79bef,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:50:01.038345 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-be486497-8ec0-45c0-b7f5-a7808f6f9d2b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:01.048643 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-648453a7-0d3d-4602-af99-a5731071fac8 None None] For port a196a712-e676-435b-80b5-de2dae28882d, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:50:01.054783 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1363834495', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78'}], 'enable_snat': True}, 'gw_port_id': '5acb1872-d950-4751-958f-af9bafe79bef', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:56Z', 'updated_at': '2021-12-09T21:49:58Z', 'revision_number': 3, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '5acb1872-d950-4751-958f-af9bafe79bef', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:8d:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3660, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:57Z', 'updated_at': '2021-12-09T21:50:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:50:01.055955 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-648453a7-0d3d-4602-af99-a5731071fac8 None None] For port a196a712-e676-435b-80b5-de2dae28882d, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a196a712-e676-435b-80b5-de2dae28882d,segment=NetworkSegment(bb2623a0-5941-46ea-9e2a-adfecf120d3a),segment_id=bb2623a0-5941-46ea-9e2a-adfecf120d3a)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:50:01.115944 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-648453a7-0d3d-4602-af99-a5731071fac8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:01.117117 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-314c8559-1d54-4b3d-9375-18def9936067 None None] The sync data for ids ['115e1e9e-f059-4a58-90c3-f04312423cd9'] in n-d-713301-27 is: [{'id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1363834495', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78'}], 'enable_snat': True}, 'gw_port_id': '5acb1872-d950-4751-958f-af9bafe79bef', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:56Z', 'updated_at': '2021-12-09T21:49:58Z', 'revision_number': 3, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '5acb1872-d950-4751-958f-af9bafe79bef', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:8d:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3660, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:57Z', 'updated_at': '2021-12-09T21:50:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:50:01.143839 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6ea5ad11-d75d-40e4-9ce1-b19566f3500d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:01.228513 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be486497-8ec0-45c0-b7f5-a7808f6f9d2b None None] Pushing event updated for resources: {'Port': ['ID=5acb1872-d950-4751-958f-af9bafe79bef,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:01.343800 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-648453a7-0d3d-4602-af99-a5731071fac8 None None] Pushing event updated for resources: {'Port': ['ID=a196a712-e676-435b-80b5-de2dae28882d,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:01.533594 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48944) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:01.558002 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af5c7d5a-21ae-4889-906b-e5da0c10a9d3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:01.662387 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-6ea5ad11-d75d-40e4-9ce1-b19566f3500d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Allocated IP 172.20.0.1 (69e4f0dc-5303-45fd-9842-f33d6a22b48d/1317305d-5040-4a27-9e95-c846c3faa444/f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:50:01.735641 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af5c7d5a-21ae-4889-906b-e5da0c10a9d3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:01.753384 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af5c7d5a-21ae-4889-906b-e5da0c10a9d3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:01.817609 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af5c7d5a-21ae-4889-906b-e5da0c10a9d3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=04dfb200-f9fc-4599-8cf2-eb7ee5dd7fe4,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:01.824082 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-af5c7d5a-21ae-4889-906b-e5da0c10a9d3 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=b466ae1d309744daab1ade03f7ec4514&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2883959 Dec 09 21:50:01.826787 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 48946) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:01.928569 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-acb9e62d-30d4-4fa0-a340-be5a44eb3b52 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:01.988726 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-acb9e62d-30d4-4fa0-a340-be5a44eb3b52 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:02.008234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a196a712-e676-435b-80b5-de2dae28882d up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:50:02.013790 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6ea5ad11-d75d-40e4-9ce1-b19566f3500d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:02.070862 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6ea5ad11-d75d-40e4-9ce1-b19566f3500d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:02.116925 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-acb9e62d-30d4-4fa0-a340-be5a44eb3b52 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:02.120185 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-acb9e62d-30d4-4fa0-a340-be5a44eb3b52 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:02.124736 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-acb9e62d-30d4-4fa0-a340-be5a44eb3b52 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/04dfb200-f9fc-4599-8cf2-eb7ee5dd7fe4 HTTP/1.1" status: 204 len: 168 time: 0.2965946 Dec 09 21:50:02.127176 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ea5ad11-d75d-40e4-9ce1-b19566f3500d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network 69e4f0dc-5303-45fd-9842-f33d6a22b48d is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:50:02.137357 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-6ea5ad11-d75d-40e4-9ce1-b19566f3500d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:50:02.139844 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port a196a712-e676-435b-80b5-de2dae28882d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:02.141562 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:02.141809 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ea5ad11-d75d-40e4-9ce1-b19566f3500d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:50:02.167307 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acb9e62d-30d4-4fa0-a340-be5a44eb3b52 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=04dfb200-f9fc-4599-8cf2-eb7ee5dd7fe4,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:02.211998 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6ea5ad11-d75d-40e4-9ce1-b19566f3500d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:02.320658 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:02.404590 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port a196a712-e676-435b-80b5-de2dae28882d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a196a712-e676-435b-80b5-de2dae28882d,segment=NetworkSegment(bb2623a0-5941-46ea-9e2a-adfecf120d3a),segment_id=bb2623a0-5941-46ea-9e2a-adfecf120d3a)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:50:02.413067 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:02.414104 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5acb1872-d950-4751-958f-af9bafe79bef up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:50:02.607938 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=a196a712-e676-435b-80b5-de2dae28882d,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:02.633166 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 5acb1872-d950-4751-958f-af9bafe79bef triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:02.633572 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:02.870047 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f12c2757-a6c7-4e2c-a69a-0471a2382777 None None] Network 69e4f0dc-5303-45fd-9842-f33d6a22b48d requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:50:03.001031 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1cdbcceb-fc8f-47c2-a708-08eabccf8f76 None None] Provisioning complete for port a196a712-e676-435b-80b5-de2dae28882d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:03.001651 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1cdbcceb-fc8f-47c2-a708-08eabccf8f76 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:03.017619 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ea5ad11-d75d-40e4-9ce1-b19566f3500d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Port': ['ID=f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:03.030986 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6ea5ad11-d75d-40e4-9ce1-b19566f3500d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:03.095258 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-59aa7684-dcdf-435d-8ea0-0bd770bc80cb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:03.474345 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6ea5ad11-d75d-40e4-9ce1-b19566f3500d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:03.482162 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6ea5ad11-d75d-40e4-9ce1-b19566f3500d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:03.578952 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ea5ad11-d75d-40e4-9ce1-b19566f3500d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Port': ['ID=f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:03.590154 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6ea5ad11-d75d-40e4-9ce1-b19566f3500d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:03.641084 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f42329f7-ec7f-4df7-9f8a-a6299680fc6f None None] Provisioning complete for port a196a712-e676-435b-80b5-de2dae28882d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:03.642970 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f42329f7-ec7f-4df7-9f8a-a6299680fc6f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:03.835641 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a196a712-e676-435b-80b5-de2dae28882d up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:50:03.843227 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ea5ad11-d75d-40e4-9ce1-b19566f3500d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network 69e4f0dc-5303-45fd-9842-f33d6a22b48d is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:50:03.845729 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-6ea5ad11-d75d-40e4-9ce1-b19566f3500d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:50:04.028375 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6ea5ad11-d75d-40e4-9ce1-b19566f3500d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Router 115e1e9e-f059-4a58-90c3-f04312423cd9 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:50:04.069635 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port a196a712-e676-435b-80b5-de2dae28882d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:04.076909 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:04.182543 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f42329f7-ec7f-4df7-9f8a-a6299680fc6f None None] Provisioning complete for port f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:04.182936 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f42329f7-ec7f-4df7-9f8a-a6299680fc6f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:04.208554 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6ea5ad11-d75d-40e4-9ce1-b19566f3500d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:50:04.216239 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6ea5ad11-d75d-40e4-9ce1-b19566f3500d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "PUT /v2.0/routers/115e1e9e-f059-4a58-90c3-f04312423cd9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.1976945 Dec 09 21:50:04.249407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] Sync routers for ids ['115e1e9e-f059-4a58-90c3-f04312423cd9'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:50:04.286915 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] Routers {'115e1e9e-f059-4a58-90c3-f04312423cd9'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:50:04.287747 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:49:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['115e1e9e-f059-4a58-90c3-f04312423cd9'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:50:04.335716 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f42329f7-ec7f-4df7-9f8a-a6299680fc6f None None] Port f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:50:04.466767 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] Set router 115e1e9e-f059-4a58-90c3-f04312423cd9 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:50:04.859924 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-142ea988-4c03-4a2e-ad93-50b5d8adeb32 None None] Provisioning complete for port f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:04.861664 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-142ea988-4c03-4a2e-ad93-50b5d8adeb32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:04.911095 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-89463a90-2686-4398-bda3-46f4e1fffddc tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1483736634&fields=id&tenant_id=dce7594ac2a74901912a2f19de04bf79 HTTP/1.1" status: 200 len: 267 time: 0.0942793 Dec 09 21:50:04.998683 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-142ea988-4c03-4a2e-ad93-50b5d8adeb32 None None] Port f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:50:05.106087 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1363834495', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78'}], 'enable_snat': True}, 'gw_port_id': '5acb1872-d950-4751-958f-af9bafe79bef', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:56Z', 'updated_at': '2021-12-09T21:50:02Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '5acb1872-d950-4751-958f-af9bafe79bef', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:8d:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3660, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:57Z', 'updated_at': '2021-12-09T21:50:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc', 'name': '', 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:bd:e6:00', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 3678, 'fixed_ips': [{'subnet_id': '1317305d-5040-4a27-9e95-c846c3faa444', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:50:01Z', 'updated_at': '2021-12-09T21:50:03Z', 'revision_number': 2, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '1317305d-5040-4a27-9e95-c846c3faa444', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:50:05.134622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-32d069ba-2f1a-49f6-8fe4-2e666eff8a81 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:05.136935 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-32d069ba-2f1a-49f6-8fe4-2e666eff8a81 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/networks?id=69e4f0dc-5303-45fd-9842-f33d6a22b48d HTTP/1.1" status: 200 len: 796 time: 0.2249875 Dec 09 21:50:05.179223 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-f3e4bb82-d700-49d4-880a-590d8544ac4b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/quotas/dce7594ac2a74901912a2f19de04bf79 HTTP/1.1" status: 200 len: 375 time: 0.0309539 Dec 09 21:50:05.182008 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] Checking router: 115e1e9e-f059-4a58-90c3-f04312423cd9 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:50:05.182581 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] Updating router 115e1e9e-f059-4a58-90c3-f04312423cd9 port f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:50:05.215552 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:05.296863 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-978017d4-c9cd-49dc-9d60-8b3c29147967 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1082141 Dec 09 21:50:05.419150 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-5a02f304-4005-47c4-9cbb-f445bf61833f service neutron] 10.222.0.13 "GET /v2.0/networks/69e4f0dc-5303-45fd-9842-f33d6a22b48d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1166751 Dec 09 21:50:05.527982 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-d516cf02-972a-4f6f-9ff1-d3f29e623e8e service neutron] 10.222.0.13 "GET /v2.0/networks/69e4f0dc-5303-45fd-9842-f33d6a22b48d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1056507 Dec 09 21:50:05.564162 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:05.576239 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:05.635612 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-11ac6bea-2bf4-4705-a481-f012c5805c2d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:05.696502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b22c32e3-fb2b-4fe5-b653-bfe548fb4b08 None None] Pushing event updated for resources: {'Port': ['ID=f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:05.740395 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] Attempting to bind port f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:50:05.744295 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] Attempting to bind port f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'bb2623a0-5941-46ea-9e2a-adfecf120d3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:50:05.745998 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] Attempting to bind port f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc on network 69e4f0dc-5303-45fd-9842-f33d6a22b48d {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:50:05.758223 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 49, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:50:05.758828 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] Checking segment: {'id': 'bb2623a0-5941-46ea-9e2a-adfecf120d3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:50:05.759391 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:05.759962 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] Bound using segment: {'id': 'bb2623a0-5941-46ea-9e2a-adfecf120d3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:50:05.760615 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] Bound port: f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bb2623a0-5941-46ea-9e2a-adfecf120d3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:50:05.761181 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:05.802807 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20bcefbc-ed2e-4eeb-af9a-221802dd9345 req-f558d68b-687a-4c6f-8986-98c5345fe12f tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 210 time: 0.0393238 Dec 09 21:50:05.877737 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] For port f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:50:05.886751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] For port f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc,segment=NetworkSegment(bb2623a0-5941-46ea-9e2a-adfecf120d3a),segment_id=bb2623a0-5941-46ea-9e2a-adfecf120d3a)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:50:05.895607 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:05.965587 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] Routers {'115e1e9e-f059-4a58-90c3-f04312423cd9'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:50:05.966366 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:50:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['115e1e9e-f059-4a58-90c3-f04312423cd9'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:50:05.972539 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b22c32e3-fb2b-4fe5-b653-bfe548fb4b08 None None] Pushing event updated for resources: {'Port': ['ID=f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:06.053380 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4712146a-4d17-420a-ac2c-e0096e3a52bf None None] Provisioning complete for port f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:06.054277 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4712146a-4d17-420a-ac2c-e0096e3a52bf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:06.250360 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] Set router 115e1e9e-f059-4a58-90c3-f04312423cd9 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:50:06.357589 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4712146a-4d17-420a-ac2c-e0096e3a52bf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:06.466581 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-4712146a-4d17-420a-ac2c-e0096e3a52bf None None] For port f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc,segment=NetworkSegment(bb2623a0-5941-46ea-9e2a-adfecf120d3a),segment_id=bb2623a0-5941-46ea-9e2a-adfecf120d3a)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:50:06.495012 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4712146a-4d17-420a-ac2c-e0096e3a52bf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:06.595423 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4712146a-4d17-420a-ac2c-e0096e3a52bf None None] Pushing event updated for resources: {'Port': ['ID=f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:06.626953 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ddb340a0-68cf-41e9-8c74-f0e2d0e8a79b None None] Provisioning complete for port f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:06.627280 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ddb340a0-68cf-41e9-8c74-f0e2d0e8a79b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:06.687897 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1363834495', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78'}], 'enable_snat': True}, 'gw_port_id': '5acb1872-d950-4751-958f-af9bafe79bef', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:56Z', 'updated_at': '2021-12-09T21:50:02Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '5acb1872-d950-4751-958f-af9bafe79bef', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:8d:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3660, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:57Z', 'updated_at': '2021-12-09T21:50:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc', 'name': '', 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:bd:e6:00', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 3678, 'fixed_ips': [{'subnet_id': '1317305d-5040-4a27-9e95-c846c3faa444', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:50:01Z', 'updated_at': '2021-12-09T21:50:05Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '1317305d-5040-4a27-9e95-c846c3faa444', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:50:06.690125 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:06.726938 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6defa23d-8333-4a8a-87bb-145c0f74a9e0 None None] The sync data for ids ['115e1e9e-f059-4a58-90c3-f04312423cd9'] in n-d-713301-27 is: [{'id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1363834495', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78'}], 'enable_snat': True}, 'gw_port_id': '5acb1872-d950-4751-958f-af9bafe79bef', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:56Z', 'updated_at': '2021-12-09T21:50:02Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '5acb1872-d950-4751-958f-af9bafe79bef', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:8d:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3660, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:57Z', 'updated_at': '2021-12-09T21:50:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc', 'name': '', 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:bd:e6:00', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 3678, 'fixed_ips': [{'subnet_id': '1317305d-5040-4a27-9e95-c846c3faa444', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:50:01Z', 'updated_at': '2021-12-09T21:50:05Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '1317305d-5040-4a27-9e95-c846c3faa444', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:50:06.982101 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0d8e9cdb-5f8e-4e11-93ea-c6300e381503 req-02d75d60-730e-4385-858f-7396cd300344 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 210 time: 0.0548415 Dec 09 21:50:07.391564 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-f1296c4f-5076-471a-95c8-ec0d474bc61b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:07.398584 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-f1296c4f-5076-471a-95c8-ec0d474bc61b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.31 "GET /v2.0/networks?id=69e4f0dc-5303-45fd-9842-f33d6a22b48d HTTP/1.1" status: 200 len: 796 time: 0.2494295 Dec 09 21:50:07.517821 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-7b6a6785-f7ad-473c-9064-9696f4eaa0d3 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=dce7594ac2a74901912a2f19de04bf79 HTTP/1.1" status: 200 len: 380 time: 0.1081619 Dec 09 21:50:07.531178 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'port': {'device_id': '0f427011-3cff-493d-b6c5-8f2919ce99f7', 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d', 'admin_state_up': True, 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'security_groups': ['804c3895-61f7-4cc1-b0c5-503b9ff5fa56']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:50:07.781230 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Made reservation on behalf of dce7594ac2a74901912a2f19de04bf79 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:50:07.786379 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:07.878894 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:50:08.034094 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:08.052123 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:08.052553 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:08.119979 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Allocated IP 172.20.0.6 (69e4f0dc-5303-45fd-9842-f33d6a22b48d/1317305d-5040-4a27-9e95-c846c3faa444/e8a40d5d-aaf2-43a0-a210-7e4f0815b848) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:50:08.245737 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-edec7ec7-a5cb-46d5-aa85-97329a0b0311 req-f18f9fdd-468d-456b-a89a-320a6873b28b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 210 time: 0.1009719 Dec 09 21:50:08.465954 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:08.529328 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:08.598939 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network 69e4f0dc-5303-45fd-9842-f33d6a22b48d is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:50:08.602800 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:50:08.607286 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:50:08.692701 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Port': ['ID=e8a40d5d-aaf2-43a0-a210-7e4f0815b848,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:08.719424 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:08.719944 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:08.720297 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:08.720776 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:08.721117 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:08.721584 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:08.721929 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:08.722508 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:08.722846 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:08.723177 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:08.723558 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:08.723895 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:08.724224 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:08.759934 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:08.773051 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:08.799996 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-81ca2398-a784-4ed5-9744-5bc8afd1ad43 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2750492 Dec 09 21:50:08.817542 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-0eef3493-cd6b-4ead-bce9-6aee45950863 service neutron] Request body: {'port': {'device_id': '0f427011-3cff-493d-b6c5-8f2919ce99f7', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:50:08.911591 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-0eef3493-cd6b-4ead-bce9-6aee45950863 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:09.082750 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e418fa43-8ef3-41ab-82b5-8edeacffcc95 None None] Provisioning complete for port e8a40d5d-aaf2-43a0-a210-7e4f0815b848 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:09.087450 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e418fa43-8ef3-41ab-82b5-8edeacffcc95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:09.134764 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e418fa43-8ef3-41ab-82b5-8edeacffcc95 None None] Port e8a40d5d-aaf2-43a0-a210-7e4f0815b848 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:50:09.280917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-0eef3493-cd6b-4ead-bce9-6aee45950863 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e8a40d5d-aaf2-43a0-a210-7e4f0815b848 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:50:09.289691 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-0eef3493-cd6b-4ead-bce9-6aee45950863 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:09.302772 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-0eef3493-cd6b-4ead-bce9-6aee45950863 service neutron] Transition to ACTIVE for port object e8a40d5d-aaf2-43a0-a210-7e4f0815b848 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:50:09.309830 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-0eef3493-cd6b-4ead-bce9-6aee45950863 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:09.411089 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0eef3493-cd6b-4ead-bce9-6aee45950863 service neutron] Pushing event updated for resources: {'Port': ['ID=e8a40d5d-aaf2-43a0-a210-7e4f0815b848,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:09.453445 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14fafa94-30af-426b-97bf-07b475fcdacc req-c513ed88-50e7-4a50-9915-a093d62c9547 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:09.464793 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-14fafa94-30af-426b-97bf-07b475fcdacc req-c513ed88-50e7-4a50-9915-a093d62c9547 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 943 time: 0.1461563 Dec 09 21:50:09.472966 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-0eef3493-cd6b-4ead-bce9-6aee45950863 service neutron] Attempting to bind port e8a40d5d-aaf2-43a0-a210-7e4f0815b848 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:50:09.473544 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-0eef3493-cd6b-4ead-bce9-6aee45950863 service neutron] Attempting to bind port e8a40d5d-aaf2-43a0-a210-7e4f0815b848 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'bb2623a0-5941-46ea-9e2a-adfecf120d3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:50:09.473667 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-0eef3493-cd6b-4ead-bce9-6aee45950863 service neutron] Attempting to bind port e8a40d5d-aaf2-43a0-a210-7e4f0815b848 on network 69e4f0dc-5303-45fd-9842-f33d6a22b48d {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:50:09.482371 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-0eef3493-cd6b-4ead-bce9-6aee45950863 service neutron] Port e8a40d5d-aaf2-43a0-a210-7e4f0815b848 on network 69e4f0dc-5303-45fd-9842-f33d6a22b48d not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:50:09.482710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-0eef3493-cd6b-4ead-bce9-6aee45950863 service neutron] Attempting to bind port e8a40d5d-aaf2-43a0-a210-7e4f0815b848 on network 69e4f0dc-5303-45fd-9842-f33d6a22b48d {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:50:09.494514 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-0eef3493-cd6b-4ead-bce9-6aee45950863 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 49, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:50:09.494868 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-0eef3493-cd6b-4ead-bce9-6aee45950863 service neutron] Checking segment: {'id': 'bb2623a0-5941-46ea-9e2a-adfecf120d3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:50:09.495259 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-0eef3493-cd6b-4ead-bce9-6aee45950863 service neutron] Bound using segment: {'id': 'bb2623a0-5941-46ea-9e2a-adfecf120d3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:50:09.495728 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-0eef3493-cd6b-4ead-bce9-6aee45950863 service neutron] Bound port: e8a40d5d-aaf2-43a0-a210-7e4f0815b848, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bb2623a0-5941-46ea-9e2a-adfecf120d3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:50:09.496097 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-0eef3493-cd6b-4ead-bce9-6aee45950863 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:09.568573 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-0eef3493-cd6b-4ead-bce9-6aee45950863 service neutron] For port e8a40d5d-aaf2-43a0-a210-7e4f0815b848, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:50:09.572149 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-0eef3493-cd6b-4ead-bce9-6aee45950863 service neutron] For port e8a40d5d-aaf2-43a0-a210-7e4f0815b848, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e8a40d5d-aaf2-43a0-a210-7e4f0815b848,segment=NetworkSegment(bb2623a0-5941-46ea-9e2a-adfecf120d3a),segment_id=bb2623a0-5941-46ea-9e2a-adfecf120d3a)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:50:09.582092 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-0eef3493-cd6b-4ead-bce9-6aee45950863 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:09.613548 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-14fafa94-30af-426b-97bf-07b475fcdacc req-4343df39-a537-4d29-a9aa-b004ec138ef4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=804c3895-61f7-4cc1-b0c5-503b9ff5fa56&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1477757 Dec 09 21:50:09.662080 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-0eef3493-cd6b-4ead-bce9-6aee45950863 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:09.662610 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-0eef3493-cd6b-4ead-bce9-6aee45950863 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:09.664254 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-0eef3493-cd6b-4ead-bce9-6aee45950863 service neutron] 10.222.0.31 "PUT /v2.0/ports/e8a40d5d-aaf2-43a0-a210-7e4f0815b848 HTTP/1.1" status: 200 len: 1092 time: 0.8556721 Dec 09 21:50:09.664739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0f427011-3cff-493d-b6c5-8f2919ce99f7', 'tag': 'e8a40d5d-aaf2-43a0-a210-7e4f0815b848'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:50:09.671653 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7cabeedc-8661-4c09-bcb0-431971d04f32" -d '{"events": [{"name": "network-changed", "server_uuid": "0f427011-3cff-493d-b6c5-8f2919ce99f7", "tag": "e8a40d5d-aaf2-43a0-a210-7e4f0815b848"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:50:09.678088 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:09.820559 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:50:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6058221b-2395-4739-adc9-46831ecfac2b x-openstack-request-id: req-6058221b-2395-4739-adc9-46831ecfac2b {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:50:09.821149 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0f427011-3cff-493d-b6c5-8f2919ce99f7", "tag": "e8a40d5d-aaf2-43a0-a210-7e4f0815b848", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:50:09.821557 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-6058221b-2395-4739-adc9-46831ecfac2b {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:50:09.822143 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0f427011-3cff-493d-b6c5-8f2919ce99f7', 'tag': 'e8a40d5d-aaf2-43a0-a210-7e4f0815b848', 'status': 'completed', 'code': 200} Dec 09 21:50:09.856384 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0eef3493-cd6b-4ead-bce9-6aee45950863 service neutron] Pushing event updated for resources: {'Port': ['ID=e8a40d5d-aaf2-43a0-a210-7e4f0815b848,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:09.867858 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-2aaf0fc7-1fbc-432b-890e-888cb294d734 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:09.869739 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-2aaf0fc7-1fbc-432b-890e-888cb294d734 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 1095 time: 0.1427765 Dec 09 21:50:09.932787 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-001ecdd7-0e46-4596-8c9e-7653a9a8856d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e8a40d5d-aaf2-43a0-a210-7e4f0815b848 HTTP/1.1" status: 200 len: 217 time: 0.0520842 Dec 09 21:50:09.994680 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-254a3cd2-c362-48c0-bf60-ef105942c56b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:09.996715 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-254a3cd2-c362-48c0-bf60-ef105942c56b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=1317305d-5040-4a27-9e95-c846c3faa444 HTTP/1.1" status: 200 len: 835 time: 0.0566745 Dec 09 21:50:10.051817 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-2a308ff1-dca3-4a57-9942-e95edb69d506 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:10.053405 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-2a308ff1-dca3-4a57-9942-e95edb69d506 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=69e4f0dc-5303-45fd-9842-f33d6a22b48d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0476184 Dec 09 21:50:10.164442 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-02f7d28a-b708-43bd-8979-ecde3fc41016 service neutron] 10.222.0.31 "GET /v2.0/networks/69e4f0dc-5303-45fd-9842-f33d6a22b48d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1028314 Dec 09 21:50:10.288939 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8a1a5245-3aea-469b-9968-e4a1719dfe14 req-73631e1e-0dbc-401b-a623-5d450596b4e3 service neutron] 10.222.0.31 "GET /v2.0/networks/69e4f0dc-5303-45fd-9842-f33d6a22b48d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1156976 Dec 09 21:50:10.402484 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cabeedc-8661-4c09-bcb0-431971d04f32 req-d2b132ca-909f-472a-a3d1-bfa226f168a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:10.404138 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7cabeedc-8661-4c09-bcb0-431971d04f32 req-d2b132ca-909f-472a-a3d1-bfa226f168a2 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 1095 time: 0.0609627 Dec 09 21:50:10.528868 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cabeedc-8661-4c09-bcb0-431971d04f32 req-c95c1d13-ef4d-4c84-a876-dede46f2ec8d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:10.530434 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7cabeedc-8661-4c09-bcb0-431971d04f32 req-c95c1d13-ef4d-4c84-a876-dede46f2ec8d service neutron] 10.222.0.31 "GET /v2.0/networks?id=69e4f0dc-5303-45fd-9842-f33d6a22b48d HTTP/1.1" status: 200 len: 897 time: 0.1173615 Dec 09 21:50:10.587416 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7cabeedc-8661-4c09-bcb0-431971d04f32 req-8066f862-7b22-4f78-b734-45be40e79cdb service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e8a40d5d-aaf2-43a0-a210-7e4f0815b848 HTTP/1.1" status: 200 len: 217 time: 0.0491500 Dec 09 21:50:10.647579 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cabeedc-8661-4c09-bcb0-431971d04f32 req-b22e676e-4387-41b7-81bb-d11061d9cf01 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:10.648896 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7cabeedc-8661-4c09-bcb0-431971d04f32 req-b22e676e-4387-41b7-81bb-d11061d9cf01 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=1317305d-5040-4a27-9e95-c846c3faa444 HTTP/1.1" status: 200 len: 835 time: 0.0534089 Dec 09 21:50:10.719018 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cabeedc-8661-4c09-bcb0-431971d04f32 req-76b2db34-9a5e-4b11-9521-9b9f13df69fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:10.721511 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7cabeedc-8661-4c09-bcb0-431971d04f32 req-76b2db34-9a5e-4b11-9521-9b9f13df69fe service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=69e4f0dc-5303-45fd-9842-f33d6a22b48d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0639307 Dec 09 21:50:10.757303 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abfa439b-46df-4149-98b2-f7dde0b2b1a2 req-9eb1b371-db1f-4d9a-aeaa-4afc262f216e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:10.759489 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-abfa439b-46df-4149-98b2-f7dde0b2b1a2 req-9eb1b371-db1f-4d9a-aeaa-4afc262f216e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 943 time: 0.0795743 Dec 09 21:50:10.906295 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7cabeedc-8661-4c09-bcb0-431971d04f32 req-33433552-fbfe-4e16-827f-d07202437404 service neutron] 10.222.0.31 "GET /v2.0/networks/69e4f0dc-5303-45fd-9842-f33d6a22b48d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1763816 Dec 09 21:50:10.909688 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-abfa439b-46df-4149-98b2-f7dde0b2b1a2 req-cbbfea37-6477-4495-8e53-df68fd61135a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=804c3895-61f7-4cc1-b0c5-503b9ff5fa56&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1436346 Dec 09 21:50:11.018535 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7cabeedc-8661-4c09-bcb0-431971d04f32 req-ea7fdee2-6325-4b10-8fe0-329e54674b64 service neutron] 10.222.0.31 "GET /v2.0/networks/69e4f0dc-5303-45fd-9842-f33d6a22b48d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1027303 Dec 09 21:50:11.243429 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49166) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:11.385260 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bb6d0a8e-e952-43f7-954d-b1b74ccbe53c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:11.479213 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bb6d0a8e-e952-43f7-954d-b1b74ccbe53c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:11.486508 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bb6d0a8e-e952-43f7-954d-b1b74ccbe53c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:11.529896 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bb6d0a8e-e952-43f7-954d-b1b74ccbe53c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=2de166281a12416c92aec5ceb95c2ef7&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2827909 Dec 09 21:50:11.529896 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb6d0a8e-e952-43f7-954d-b1b74ccbe53c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0a6ce78c-8842-45ba-a45a-2c1514e5cb69,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:11.530517 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49170) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:11.611366 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-321db27e-f737-4e49-a08a-dc74de1b8a06 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:11.637020 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-321db27e-f737-4e49-a08a-dc74de1b8a06 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:11.692673 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-321db27e-f737-4e49-a08a-dc74de1b8a06 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:11.696820 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-321db27e-f737-4e49-a08a-dc74de1b8a06 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:11.698028 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-321db27e-f737-4e49-a08a-dc74de1b8a06 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/0a6ce78c-8842-45ba-a45a-2c1514e5cb69 HTTP/1.1" status: 204 len: 168 time: 0.1644275 Dec 09 21:50:11.706374 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-321db27e-f737-4e49-a08a-dc74de1b8a06 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0a6ce78c-8842-45ba-a45a-2c1514e5cb69,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:12.060027 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fc2b8a7-674b-4d6b-a032-d879d31dec1a req-e3897dab-4550-45b0-bf75-75ba666a5c51 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:12.060628 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49178) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:12.061859 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fc2b8a7-674b-4d6b-a032-d879d31dec1a req-e3897dab-4550-45b0-bf75-75ba666a5c51 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 943 time: 0.0702946 Dec 09 21:50:12.079583 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9fee9326-47a4-4570-8b34-287e367f2bcc admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:12.133669 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fc2b8a7-674b-4d6b-a032-d879d31dec1a req-7ab62e8b-16c1-4d2b-a81a-0f8a9e491940 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=804c3895-61f7-4cc1-b0c5-503b9ff5fa56&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0648601 Dec 09 21:50:12.192376 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9fee9326-47a4-4570-8b34-287e367f2bcc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:12.201193 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9fee9326-47a4-4570-8b34-287e367f2bcc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:12.264256 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9fee9326-47a4-4570-8b34-287e367f2bcc admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ef2a660b8fa043fa8507a02dc8d78627&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2025101 Dec 09 21:50:12.265131 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fee9326-47a4-4570-8b34-287e367f2bcc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=222c7a68-3e64-43ff-9c35-3903fcecdfeb,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:12.267093 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49184) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:12.330551 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c6d6d4fd-b36e-438e-aa00-1f41f2cbae49 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:12.355265 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c6d6d4fd-b36e-438e-aa00-1f41f2cbae49 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:12.407719 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c6d6d4fd-b36e-438e-aa00-1f41f2cbae49 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:12.410385 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c6d6d4fd-b36e-438e-aa00-1f41f2cbae49 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:12.411875 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c6d6d4fd-b36e-438e-aa00-1f41f2cbae49 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/222c7a68-3e64-43ff-9c35-3903fcecdfeb HTTP/1.1" status: 204 len: 168 time: 0.1432028 Dec 09 21:50:12.422704 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6d6d4fd-b36e-438e-aa00-1f41f2cbae49 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=222c7a68-3e64-43ff-9c35-3903fcecdfeb,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:13.282110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5748b976-bd11-4375-94c9-e86f2fcb4365 req-be414025-430f-447f-8c28-749b8e011b68 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:13.283797 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5748b976-bd11-4375-94c9-e86f2fcb4365 req-be414025-430f-447f-8c28-749b8e011b68 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 943 time: 0.0655868 Dec 09 21:50:13.293169 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e8a40d5d-aaf2-43a0-a210-7e4f0815b848 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:50:13.358160 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5748b976-bd11-4375-94c9-e86f2fcb4365 req-b006b327-8386-43de-bba7-3dc071b3fb39 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=804c3895-61f7-4cc1-b0c5-503b9ff5fa56&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0675864 Dec 09 21:50:13.449880 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port e8a40d5d-aaf2-43a0-a210-7e4f0815b848, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e8a40d5d-aaf2-43a0-a210-7e4f0815b848,segment=NetworkSegment(bb2623a0-5941-46ea-9e2a-adfecf120d3a),segment_id=bb2623a0-5941-46ea-9e2a-adfecf120d3a)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:50:13.471621 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'e8a40d5d-aaf2-43a0-a210-7e4f0815b848', 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d', 'port_id': 'e8a40d5d-aaf2-43a0-a210-7e4f0815b848', 'mac_address': 'fa:16:3e:af:97:f6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 104, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1317305d-5040-4a27-9e95-c846c3faa444', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:50:13.519431 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:13.534498 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e8a40d5d-aaf2-43a0-a210-7e4f0815b848 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:50:13.563161 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port e8a40d5d-aaf2-43a0-a210-7e4f0815b848, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e8a40d5d-aaf2-43a0-a210-7e4f0815b848,segment=NetworkSegment(bb2623a0-5941-46ea-9e2a-adfecf120d3a),segment_id=bb2623a0-5941-46ea-9e2a-adfecf120d3a)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:50:13.570122 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:13.633535 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=e8a40d5d-aaf2-43a0-a210-7e4f0815b848,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:13.805818 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['e8a40d5d-aaf2-43a0-a210-7e4f0815b848'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:50:13.868274 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49226) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:13.993668 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c2aa85be-545e-41b2-84af-fc9ae4becfc1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:14.086160 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c2aa85be-545e-41b2-84af-fc9ae4becfc1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:14.092457 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c2aa85be-545e-41b2-84af-fc9ae4becfc1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:14.139123 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c2aa85be-545e-41b2-84af-fc9ae4becfc1 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=378fd1ae7ea141b29ed04ed002c82210&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2696290 Dec 09 21:50:14.141928 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49232) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:14.154664 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2aa85be-545e-41b2-84af-fc9ae4becfc1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8d37b059-75ad-4d84-8917-f24d1787d8ac,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:14.164270 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2aa85be-545e-41b2-84af-fc9ae4becfc1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:14.164861 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2aa85be-545e-41b2-84af-fc9ae4becfc1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:14.165491 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2aa85be-545e-41b2-84af-fc9ae4becfc1 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:14.165987 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2aa85be-545e-41b2-84af-fc9ae4becfc1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:14.166469 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2aa85be-545e-41b2-84af-fc9ae4becfc1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:14.166970 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2aa85be-545e-41b2-84af-fc9ae4becfc1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:14.167767 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2aa85be-545e-41b2-84af-fc9ae4becfc1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:14.168246 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2aa85be-545e-41b2-84af-fc9ae4becfc1 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:14.168764 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2aa85be-545e-41b2-84af-fc9ae4becfc1 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:14.169264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2aa85be-545e-41b2-84af-fc9ae4becfc1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:14.169597 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2aa85be-545e-41b2-84af-fc9ae4becfc1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:14.169924 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2aa85be-545e-41b2-84af-fc9ae4becfc1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:14.170254 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c2aa85be-545e-41b2-84af-fc9ae4becfc1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:14.211512 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a187cff3-5591-4737-b277-146c322a38d1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:14.233617 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a187cff3-5591-4737-b277-146c322a38d1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:14.285605 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a187cff3-5591-4737-b277-146c322a38d1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:14.290019 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a187cff3-5591-4737-b277-146c322a38d1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:14.292058 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a187cff3-5591-4737-b277-146c322a38d1 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/8d37b059-75ad-4d84-8917-f24d1787d8ac HTTP/1.1" status: 204 len: 168 time: 0.1488495 Dec 09 21:50:14.302745 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a187cff3-5591-4737-b277-146c322a38d1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d37b059-75ad-4d84-8917-f24d1787d8ac,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:14.542492 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3cc58a6-0103-4b55-8166-ccc72c0a12a2 req-139bd030-984c-454c-9210-c36934861a71 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:14.549528 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3cc58a6-0103-4b55-8166-ccc72c0a12a2 req-139bd030-984c-454c-9210-c36934861a71 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 944 time: 0.0756872 Dec 09 21:50:14.674291 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3cc58a6-0103-4b55-8166-ccc72c0a12a2 req-e8dd3100-0500-4868-a791-dc866b07782e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=804c3895-61f7-4cc1-b0c5-503b9ff5fa56&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1079898 Dec 09 21:50:15.295231 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e8a40d5d-aaf2-43a0-a210-7e4f0815b848 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:50:15.358472 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port e8a40d5d-aaf2-43a0-a210-7e4f0815b848 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:50:15.364039 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port e8a40d5d-aaf2-43a0-a210-7e4f0815b848 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:15.365487 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:15.483415 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:15.533304 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port e8a40d5d-aaf2-43a0-a210-7e4f0815b848, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e8a40d5d-aaf2-43a0-a210-7e4f0815b848,segment=NetworkSegment(bb2623a0-5941-46ea-9e2a-adfecf120d3a),segment_id=bb2623a0-5941-46ea-9e2a-adfecf120d3a)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:50:15.534242 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0f427011-3cff-493d-b6c5-8f2919ce99f7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e8a40d5d-aaf2-43a0-a210-7e4f0815b848'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:50:15.539266 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-10a4130c-8ec4-42a8-8956-7f7d9952949e" -d '{"events": [{"server_uuid": "0f427011-3cff-493d-b6c5-8f2919ce99f7", "name": "network-vif-plugged", "status": "completed", "tag": "e8a40d5d-aaf2-43a0-a210-7e4f0815b848"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:50:15.544598 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:15.618992 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:50:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-10c4aa13-a3e5-4a16-b608-c5d248d38f06 x-openstack-request-id: req-10c4aa13-a3e5-4a16-b608-c5d248d38f06 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:50:15.619587 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0f427011-3cff-493d-b6c5-8f2919ce99f7", "name": "network-vif-plugged", "status": "completed", "tag": "e8a40d5d-aaf2-43a0-a210-7e4f0815b848", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:50:15.620021 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-10c4aa13-a3e5-4a16-b608-c5d248d38f06 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:50:15.620583 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0f427011-3cff-493d-b6c5-8f2919ce99f7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e8a40d5d-aaf2-43a0-a210-7e4f0815b848', 'code': 200} Dec 09 21:50:15.636913 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=e8a40d5d-aaf2-43a0-a210-7e4f0815b848,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:15.708891 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb130e88-ce05-429b-aaa3-71b032770b41 req-e22505a4-8670-45ff-8883-745aa91d3676 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:15.710522 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-eb130e88-ce05-429b-aaa3-71b032770b41 req-e22505a4-8670-45ff-8883-745aa91d3676 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 1097 time: 0.0496831 Dec 09 21:50:15.778648 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-eb130e88-ce05-429b-aaa3-71b032770b41 req-27b78616-845f-4707-8714-4b37e3eb2c9a service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=804c3895-61f7-4cc1-b0c5-503b9ff5fa56&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0599501 Dec 09 21:50:15.855480 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad75933d-5e79-4b51-a94d-fcca59c3384f req-77c27db7-5239-4e53-86ff-a64ec0ba2658 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:15.860001 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ad75933d-5e79-4b51-a94d-fcca59c3384f req-77c27db7-5239-4e53-86ff-a64ec0ba2658 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 945 time: 0.0644639 Dec 09 21:50:15.922668 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ad75933d-5e79-4b51-a94d-fcca59c3384f req-668f8abb-ac43-4cfd-b34b-fdebdc66d8f6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=804c3895-61f7-4cc1-b0c5-503b9ff5fa56&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0591924 Dec 09 21:50:17.066749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bd3869f-8ac4-4366-b528-9afeb763d8f6 req-35ae2440-840e-42c1-be58-4511329b4266 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:17.068978 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9bd3869f-8ac4-4366-b528-9afeb763d8f6 req-35ae2440-840e-42c1-be58-4511329b4266 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 945 time: 0.0617883 Dec 09 21:50:17.145442 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9bd3869f-8ac4-4366-b528-9afeb763d8f6 req-765514af-96aa-4cfe-a199-99bbfb5743ad tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=804c3895-61f7-4cc1-b0c5-503b9ff5fa56&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0685010 Dec 09 21:50:17.281338 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47b36de0-c827-44af-930f-383723783284 req-4dbf69c5-a1db-4927-936a-61125c204f0c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:17.282904 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-47b36de0-c827-44af-930f-383723783284 req-4dbf69c5-a1db-4927-936a-61125c204f0c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 945 time: 0.0635448 Dec 09 21:50:17.353769 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-47b36de0-c827-44af-930f-383723783284 req-8e0e894a-09b9-44ae-beb0-d39eb46cafac tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=804c3895-61f7-4cc1-b0c5-503b9ff5fa56&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0603499 Dec 09 21:50:17.376991 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49656) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:17.709723 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39182737-389c-4a0a-afe4-03c9f2a6d5b2 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:17.711764 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-39182737-389c-4a0a-afe4-03c9f2a6d5b2 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 1092 time: 0.3336859 Dec 09 21:50:17.715295 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49700) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:17.720858 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-34f788a0-6bde-4f10-a2d4-884634c0736e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': 'e8a40d5d-aaf2-43a0-a210-7e4f0815b848', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'fixed_ip_address': '172.20.0.6'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:50:17.753097 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-34f788a0-6bde-4f10-a2d4-884634c0736e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for floatingip, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:17.900501 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-34f788a0-6bde-4f10-a2d4-884634c0736e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:18.029637 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-34f788a0-6bde-4f10-a2d4-884634c0736e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Allocated IP 172.25.3.175 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/8ec8a3ac-328e-41f4-b33e-3626691e3b45) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:50:18.158099 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-34f788a0-6bde-4f10-a2d4-884634c0736e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:18.194077 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-34f788a0-6bde-4f10-a2d4-884634c0736e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:18.239225 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34f788a0-6bde-4f10-a2d4-884634c0736e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:50:18.247308 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-34f788a0-6bde-4f10-a2d4-884634c0736e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:50:18.249973 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34f788a0-6bde-4f10-a2d4-884634c0736e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:50:18.274520 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34f788a0-6bde-4f10-a2d4-884634c0736e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Port': ['ID=8ec8a3ac-328e-41f4-b33e-3626691e3b45,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:19.150938 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-34f788a0-6bde-4f10-a2d4-884634c0736e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:19.270248 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-34f788a0-6bde-4f10-a2d4-884634c0736e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:19.462818 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-34f788a0-6bde-4f10-a2d4-884634c0736e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:19.469583 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-34f788a0-6bde-4f10-a2d4-884634c0736e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:19.550470 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34f788a0-6bde-4f10-a2d4-884634c0736e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Port': ['ID=8ec8a3ac-328e-41f4-b33e-3626691e3b45,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:19.571134 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-34f788a0-6bde-4f10-a2d4-884634c0736e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:19.709631 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-34f788a0-6bde-4f10-a2d4-884634c0736e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Floating IP fb13a433-742b-49fd-a148-4074584186de associated. External IP: 172.25.3.175, port: e8a40d5d-aaf2-43a0-a210-7e4f0815b848. Dec 09 21:50:20.020388 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-34f788a0-6bde-4f10-a2d4-884634c0736e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Router 115e1e9e-f059-4a58-90c3-f04312423cd9 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:50:20.156255 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-34f788a0-6bde-4f10-a2d4-884634c0736e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:50:20.167088 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7a7deee-383d-4302-92ba-6f48e7d9890a None None] Sync routers for ids ['115e1e9e-f059-4a58-90c3-f04312423cd9'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:50:20.183184 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7a7deee-383d-4302-92ba-6f48e7d9890a None None] Routers {'115e1e9e-f059-4a58-90c3-f04312423cd9'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:50:20.184573 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e7a7deee-383d-4302-92ba-6f48e7d9890a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:50:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['115e1e9e-f059-4a58-90c3-f04312423cd9'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:50:20.187960 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-34f788a0-6bde-4f10-a2d4-884634c0736e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:20.243271 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-34f788a0-6bde-4f10-a2d4-884634c0736e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.5260530 Dec 09 21:50:20.244178 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0f427011-3cff-493d-b6c5-8f2919ce99f7', 'tag': 'e8a40d5d-aaf2-43a0-a210-7e4f0815b848'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:50:20.260187 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-679a7807-d301-4c01-8b85-15b952d873f5" -d '{"events": [{"name": "network-changed", "server_uuid": "0f427011-3cff-493d-b6c5-8f2919ce99f7", "tag": "e8a40d5d-aaf2-43a0-a210-7e4f0815b848"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:50:20.357088 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-e7a7deee-383d-4302-92ba-6f48e7d9890a None None] Set router 115e1e9e-f059-4a58-90c3-f04312423cd9 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:50:20.380046 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-398e1027-ca8a-41a3-a6fc-344f4f2f754e req-10c04e9d-1877-451c-a017-563bf46c5496 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:20.381972 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-398e1027-ca8a-41a3-a6fc-344f4f2f754e req-10c04e9d-1877-451c-a017-563bf46c5496 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 945 time: 0.0700426 Dec 09 21:50:20.450339 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-398e1027-ca8a-41a3-a6fc-344f4f2f754e req-1d5288e4-abc5-4aaf-9891-92aa0fc73e7d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=804c3895-61f7-4cc1-b0c5-503b9ff5fa56&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0614707 Dec 09 21:50:20.476732 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49778) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:20.530667 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:50:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-616ff855-2357-4d43-b935-8366da1181e2 x-openstack-request-id: req-616ff855-2357-4d43-b935-8366da1181e2 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:50:20.530959 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0f427011-3cff-493d-b6c5-8f2919ce99f7", "tag": "e8a40d5d-aaf2-43a0-a210-7e4f0815b848", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:50:20.532115 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-616ff855-2357-4d43-b935-8366da1181e2 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:50:20.532720 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0f427011-3cff-493d-b6c5-8f2919ce99f7', 'tag': 'e8a40d5d-aaf2-43a0-a210-7e4f0815b848', 'status': 'completed', 'code': 200} Dec 09 21:50:20.591148 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1e80ae7e-f429-4448-b450-53e094bf9944 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/floatingips/fb13a433-742b-49fd-a148-4074584186de HTTP/1.1" status: 200 len: 991 time: 0.1126516 Dec 09 21:50:20.610455 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-679a7807-d301-4c01-8b85-15b952d873f5 req-265e328c-f96f-4d76-a827-b1d1f3e367cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:20.612204 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-679a7807-d301-4c01-8b85-15b952d873f5 req-265e328c-f96f-4d76-a827-b1d1f3e367cc service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 1097 time: 0.0663817 Dec 09 21:50:20.738062 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-679a7807-d301-4c01-8b85-15b952d873f5 req-f4cc2a47-ad0b-47af-85f3-d153727558e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:20.740108 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-679a7807-d301-4c01-8b85-15b952d873f5 req-f4cc2a47-ad0b-47af-85f3-d153727558e4 service neutron] 10.222.0.31 "GET /v2.0/networks?id=69e4f0dc-5303-45fd-9842-f33d6a22b48d HTTP/1.1" status: 200 len: 897 time: 0.1196635 Dec 09 21:50:20.817127 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e7a7deee-383d-4302-92ba-6f48e7d9890a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1363834495', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78'}], 'enable_snat': True}, 'gw_port_id': '5acb1872-d950-4751-958f-af9bafe79bef', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:56Z', 'updated_at': '2021-12-09T21:50:02Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '5acb1872-d950-4751-958f-af9bafe79bef', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:8d:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3660, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:57Z', 'updated_at': '2021-12-09T21:50:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'fb13a433-742b-49fd-a148-4074584186de', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'floating_ip_address': '172.25.3.175', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'port_id': 'e8a40d5d-aaf2-43a0-a210-7e4f0815b848', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 3701, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d', 'mac_address': 'fa:16:3e:af:97:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f427011-3cff-493d-b6c5-8f2919ce99f7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:50:18Z', 'updated_at': '2021-12-09T21:50:18Z', 'revision_number': 0, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc', 'name': '', 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:bd:e6:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 3678, 'fixed_ips': [{'subnet_id': '1317305d-5040-4a27-9e95-c846c3faa444', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:50:01Z', 'updated_at': '2021-12-09T21:50:06Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '1317305d-5040-4a27-9e95-c846c3faa444', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:50:20.827364 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-679a7807-d301-4c01-8b85-15b952d873f5 req-93aedd53-1178-4b14-9090-ac226058bc3e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e8a40d5d-aaf2-43a0-a210-7e4f0815b848 HTTP/1.1" status: 200 len: 999 time: 0.0785954 Dec 09 21:50:20.858282 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7a7deee-383d-4302-92ba-6f48e7d9890a None None] Checking router: 115e1e9e-f059-4a58-90c3-f04312423cd9 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:50:20.868363 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7a7deee-383d-4302-92ba-6f48e7d9890a None None] Routers {'115e1e9e-f059-4a58-90c3-f04312423cd9'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:50:20.868977 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e7a7deee-383d-4302-92ba-6f48e7d9890a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:50:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['115e1e9e-f059-4a58-90c3-f04312423cd9'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:50:20.911200 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-679a7807-d301-4c01-8b85-15b952d873f5 req-bf205604-6228-4c72-8e82-aa15c16ae61c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:20.913706 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-679a7807-d301-4c01-8b85-15b952d873f5 req-bf205604-6228-4c72-8e82-aa15c16ae61c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=1317305d-5040-4a27-9e95-c846c3faa444 HTTP/1.1" status: 200 len: 835 time: 0.0790095 Dec 09 21:50:20.975455 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-679a7807-d301-4c01-8b85-15b952d873f5 req-18e6d1bb-014d-4883-8b58-8019a36048d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:20.978328 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-679a7807-d301-4c01-8b85-15b952d873f5 req-18e6d1bb-014d-4883-8b58-8019a36048d1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=69e4f0dc-5303-45fd-9842-f33d6a22b48d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0571678 Dec 09 21:50:21.000225 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-e7a7deee-383d-4302-92ba-6f48e7d9890a None None] Set router 115e1e9e-f059-4a58-90c3-f04312423cd9 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:50:21.096320 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-679a7807-d301-4c01-8b85-15b952d873f5 req-7f058e07-55dc-4dc5-8264-c705145dd594 service neutron] 10.222.0.31 "GET /v2.0/networks/69e4f0dc-5303-45fd-9842-f33d6a22b48d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1103160 Dec 09 21:50:21.216383 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-679a7807-d301-4c01-8b85-15b952d873f5 req-931ef987-6c7b-4b6b-8eff-9c0c68c74627 service neutron] 10.222.0.31 "GET /v2.0/networks/69e4f0dc-5303-45fd-9842-f33d6a22b48d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1121025 Dec 09 21:50:21.380347 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e7a7deee-383d-4302-92ba-6f48e7d9890a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1363834495', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78'}], 'enable_snat': True}, 'gw_port_id': '5acb1872-d950-4751-958f-af9bafe79bef', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:56Z', 'updated_at': '2021-12-09T21:50:02Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '5acb1872-d950-4751-958f-af9bafe79bef', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:8d:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3660, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:57Z', 'updated_at': '2021-12-09T21:50:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'fb13a433-742b-49fd-a148-4074584186de', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'floating_ip_address': '172.25.3.175', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'port_id': 'e8a40d5d-aaf2-43a0-a210-7e4f0815b848', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 3701, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d', 'mac_address': 'fa:16:3e:af:97:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f427011-3cff-493d-b6c5-8f2919ce99f7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:50:18Z', 'updated_at': '2021-12-09T21:50:18Z', 'revision_number': 0, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc', 'name': '', 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:bd:e6:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 3678, 'fixed_ips': [{'subnet_id': '1317305d-5040-4a27-9e95-c846c3faa444', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:50:01Z', 'updated_at': '2021-12-09T21:50:06Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '1317305d-5040-4a27-9e95-c846c3faa444', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:50:21.416389 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7a7deee-383d-4302-92ba-6f48e7d9890a None None] The sync data for ids ['115e1e9e-f059-4a58-90c3-f04312423cd9'] in n-d-713301-27 is: [{'id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1363834495', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78'}], 'enable_snat': True}, 'gw_port_id': '5acb1872-d950-4751-958f-af9bafe79bef', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:56Z', 'updated_at': '2021-12-09T21:50:02Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '5acb1872-d950-4751-958f-af9bafe79bef', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:8d:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3660, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:57Z', 'updated_at': '2021-12-09T21:50:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'fb13a433-742b-49fd-a148-4074584186de', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'floating_ip_address': '172.25.3.175', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'port_id': 'e8a40d5d-aaf2-43a0-a210-7e4f0815b848', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 3701, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d', 'mac_address': 'fa:16:3e:af:97:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0f427011-3cff-493d-b6c5-8f2919ce99f7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:50:18Z', 'updated_at': '2021-12-09T21:50:18Z', 'revision_number': 0, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc', 'name': '', 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:bd:e6:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 3678, 'fixed_ips': [{'subnet_id': '1317305d-5040-4a27-9e95-c846c3faa444', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:50:01Z', 'updated_at': '2021-12-09T21:50:06Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '1317305d-5040-4a27-9e95-c846c3faa444', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:50:21.595231 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49802) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:21.711393 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2349e5a3-c801-414d-91aa-98c2f581904a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/floatingips/fb13a433-742b-49fd-a148-4074584186de HTTP/1.1" status: 200 len: 991 time: 0.1144066 Dec 09 21:50:21.743776 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49804) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:21.822140 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72afa4b0-b1ba-4df1-81c2-f868d4732f2a None None] New status for floating IP fb13a433-742b-49fd-a148-4074584186de: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:50:21.951525 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4a695fa3-bb1d-4306-bbf9-024122d4cc40 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:22.042964 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4a695fa3-bb1d-4306-bbf9-024122d4cc40 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:22.051730 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4a695fa3-bb1d-4306-bbf9-024122d4cc40 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:22.105049 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4a695fa3-bb1d-4306-bbf9-024122d4cc40 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=da38ebde7eb54dd5acecf00718dd968f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3582003 Dec 09 21:50:22.106221 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a695fa3-bb1d-4306-bbf9-024122d4cc40 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=54e0c8f4-cdf0-4c5d-b445-340fb70ab6fc,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:22.108433 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49818) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:22.201628 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3cbb326c-2d81-45b4-a3f9-16aa64c3d667 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:22.223168 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3cbb326c-2d81-45b4-a3f9-16aa64c3d667 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:22.273805 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3cbb326c-2d81-45b4-a3f9-16aa64c3d667 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:22.276505 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3cbb326c-2d81-45b4-a3f9-16aa64c3d667 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:22.277869 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3cbb326c-2d81-45b4-a3f9-16aa64c3d667 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/54e0c8f4-cdf0-4c5d-b445-340fb70ab6fc HTTP/1.1" status: 204 len: 168 time: 0.1673656 Dec 09 21:50:22.286777 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cbb326c-2d81-45b4-a3f9-16aa64c3d667 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=54e0c8f4-cdf0-4c5d-b445-340fb70ab6fc,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:22.575905 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49826) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:22.590050 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-90f20155-7fc1-412a-8444-d878f53c7a6f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:22.681952 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-90f20155-7fc1-412a-8444-d878f53c7a6f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:22.687420 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-90f20155-7fc1-412a-8444-d878f53c7a6f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:22.715533 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49828) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:22.728861 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90f20155-7fc1-412a-8444-d878f53c7a6f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=67449f73-c41b-4c6e-9e6f-91433c9fdf0a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:22.733603 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-90f20155-7fc1-412a-8444-d878f53c7a6f admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=89d99cdd1f424dcb9fad2bfd1b98c2b9&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1565063 Dec 09 21:50:22.745326 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49830) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:22.806109 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fbbdcbce-fd84-4140-b506-d42f0245e81c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/floatingips/fb13a433-742b-49fd-a148-4074584186de HTTP/1.1" status: 200 len: 993 time: 0.0893428 Dec 09 21:50:22.822716 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04dec53e-2894-4ff9-b595-7d28dd1a74bf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:22.846265 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04dec53e-2894-4ff9-b595-7d28dd1a74bf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:22.900222 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04dec53e-2894-4ff9-b595-7d28dd1a74bf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:22.903032 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-04dec53e-2894-4ff9-b595-7d28dd1a74bf admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:22.906722 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-04dec53e-2894-4ff9-b595-7d28dd1a74bf admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/67449f73-c41b-4c6e-9e6f-91433c9fdf0a HTTP/1.1" status: 204 len: 168 time: 0.1580329 Dec 09 21:50:22.914662 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04dec53e-2894-4ff9-b595-7d28dd1a74bf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=67449f73-c41b-4c6e-9e6f-91433c9fdf0a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:24.807770 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49880) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:24.898685 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73db59f5-f20c-42c2-aa95-e5c7d5e11820 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:24.899561 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73db59f5-f20c-42c2-aa95-e5c7d5e11820 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:24.901254 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73db59f5-f20c-42c2-aa95-e5c7d5e11820 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:24.903955 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-73db59f5-f20c-42c2-aa95-e5c7d5e11820 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] 10.222.0.13 "GET /v2.0/ports?project_id=e863bf78256945798e7c717c650258aa&network_id=5ed1c0c9-0d1a-458b-9180-fe96edb96b56 HTTP/1.1" status: 200 len: 2973 time: 0.0938644 Dec 09 21:50:26.521848 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49910) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:26.649174 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7be554f-aa06-45d8-903b-cc82496c4436 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:26.651230 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e7be554f-aa06-45d8-903b-cc82496c4436 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] 10.222.0.13 "GET /v2.0/subnets?network_id=97925a19-460a-4476-8208-41db134b6c83 HTTP/1.1" status: 200 len: 814 time: 0.1271865 Dec 09 21:50:27.315064 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:27.324700 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49920) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:27.329955 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-12c3ae9d-4b1c-4f34-9a6f-c1194b17f65d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'network': {'name': 'tempest-network-smoke--1192942369', 'project_id': 'e863bf78256945798e7c717c650258aa', 'port_security_enabled': True}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:50:27.354367 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-12c3ae9d-4b1c-4f34-9a6f-c1194b17f65d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Made reservation on behalf of e863bf78256945798e7c717c650258aa for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:50:27.358892 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-12c3ae9d-4b1c-4f34-9a6f-c1194b17f65d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:27.385879 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-12c3ae9d-4b1c-4f34-9a6f-c1194b17f65d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] vlan segment allocate from pool success with {'vlan_id': 142, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:50:27.395110 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-12c3ae9d-4b1c-4f34-9a6f-c1194b17f65d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:27.395506 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-12c3ae9d-4b1c-4f34-9a6f-c1194b17f65d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Added segment efd94242-a7b2-491d-b555-cf8b471e00ae of type vlan for network f481e34c-08b7-4b81-995d-857e3c7f684d Dec 09 21:50:27.438960 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-12c3ae9d-4b1c-4f34-9a6f-c1194b17f65d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:27.472850 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-12c3ae9d-4b1c-4f34-9a6f-c1194b17f65d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:27.480525 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12c3ae9d-4b1c-4f34-9a6f-c1194b17f65d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:27.481124 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-12c3ae9d-4b1c-4f34-9a6f-c1194b17f65d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:27.519176 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-12c3ae9d-4b1c-4f34-9a6f-c1194b17f65d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.1932194 Dec 09 21:50:27.522285 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49926) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:27.551325 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:27.565725 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12c3ae9d-4b1c-4f34-9a6f-c1194b17f65d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'Network': ['ID=f481e34c-08b7-4b81-995d-857e3c7f684d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:27.576947 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network f481e34c-08b7-4b81-995d-857e3c7f684d details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:50:27.624001 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-913113ad-243a-43e5-a5b6-920b11c238a2 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:27.625522 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-913113ad-243a-43e5-a5b6-920b11c238a2 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] 10.222.0.13 "GET /v2.0/subnets?project_id=e863bf78256945798e7c717c650258aa&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 830 time: 0.1001430 Dec 09 21:50:27.628273 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49928) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:27.721064 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-312b0a53-75ce-453b-b59b-5687e5c7bc32 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:27.723493 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-312b0a53-75ce-453b-b59b-5687e5c7bc32 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0934577 Dec 09 21:50:27.725649 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49930) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:27.760812 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-12a50e4d-7c3e-4a99-b9b6-0a570139ccaf tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] 10.222.0.13 "GET /v2.0/subnets?network_id=97925a19-460a-4476-8208-41db134b6c83&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0339298 Dec 09 21:50:27.763407 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49932) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:27.798935 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f17a5e8b-6263-494a-b2c8-c3c588fdc7be tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] 10.222.0.13 "GET /v2.0/subnets?project_id=e863bf78256945798e7c717c650258aa&cidr=172.20.0.16%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0321391 Dec 09 21:50:27.799287 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49934) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:27.894784 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb6cfbf0-7d23-4f55-b79d-8b03774b8fb0 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:27.896447 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cb6cfbf0-7d23-4f55-b79d-8b03774b8fb0 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0961690 Dec 09 21:50:27.899891 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49936) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:27.928941 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-446ece24-e091-4e57-b51e-a8f1cf820af4 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] 10.222.0.13 "GET /v2.0/subnets?network_id=97925a19-460a-4476-8208-41db134b6c83&cidr=172.20.0.16%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0278645 Dec 09 21:50:27.931485 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49938) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:27.936224 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c6bbf601-4082-4d04-b3d4-29aa1a852732 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1710418855', 'network_id': 'f481e34c-08b7-4b81-995d-857e3c7f684d', 'project_id': 'e863bf78256945798e7c717c650258aa', 'ip_version': 4, 'cidr': '172.20.0.16/28'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:50:28.029771 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c6bbf601-4082-4d04-b3d4-29aa1a852732 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Made reservation on behalf of e863bf78256945798e7c717c650258aa for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:50:28.033519 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c6bbf601-4082-4d04-b3d4-29aa1a852732 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:28.221548 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c6bbf601-4082-4d04-b3d4-29aa1a852732 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:28.292996 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6bbf601-4082-4d04-b3d4-29aa1a852732 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'Subnet': ['ID=db260714-c8e4-49a8-961f-2d6c653a6d1a,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:28.307175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6bbf601-4082-4d04-b3d4-29aa1a852732 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Checking segment: {'id': 'efd94242-a7b2-491d-b555-cf8b471e00ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'f481e34c-08b7-4b81-995d-857e3c7f684d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:50:28.307175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6bbf601-4082-4d04-b3d4-29aa1a852732 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Network hostable DHCP agents. Network: f481e34c-08b7-4b81-995d-857e3c7f684d, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:50:28.325525 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6bbf601-4082-4d04-b3d4-29aa1a852732 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Network f481e34c-08b7-4b81-995d-857e3c7f684d is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:50:28.339798 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-c6bbf601-4082-4d04-b3d4-29aa1a852732 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, f481e34c-08b7-4b81-995d-857e3c7f684d) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:50:28.345032 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6bbf601-4082-4d04-b3d4-29aa1a852732 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:28.347317 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c6bbf601-4082-4d04-b3d4-29aa1a852732 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:28.353006 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f25b8992-a1e1-40f2-835c-6f489edbda8d None None] Network f481e34c-08b7-4b81-995d-857e3c7f684d requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:50:28.390494 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c6bbf601-4082-4d04-b3d4-29aa1a852732 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 835 time: 0.4579735 Dec 09 21:50:28.849219 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6419ef0a-a0c9-4b12-b4ba-e68677bb9ec7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-f481e34c-08b7-4b81-995d-857e3c7f684d', 'network_id': 'f481e34c-08b7-4b81-995d-857e3c7f684d', 'project_id': 'e863bf78256945798e7c717c650258aa', 'fixed_ips': [{'subnet_id': 'db260714-c8e4-49a8-961f-2d6c653a6d1a'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:50:28.851324 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6419ef0a-a0c9-4b12-b4ba-e68677bb9ec7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:28.924905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49966) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:28.929934 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-e95b01fb-08b5-4213-b43c-dd173dd10493 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1407047017', 'description': 'tempest-secgroup-smoke-1407047017 description', 'project_id': 'e863bf78256945798e7c717c650258aa'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:50:28.994770 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e95b01fb-08b5-4213-b43c-dd173dd10493 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.100414 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-6419ef0a-a0c9-4b12-b4ba-e68677bb9ec7 None None] Allocated IP 172.20.0.18 (f481e34c-08b7-4b81-995d-857e3c7f684d/db260714-c8e4-49a8-961f-2d6c653a6d1a/1e95cc67-64d4-43d0-a8d6-5e5ee08804fb) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:50:29.140394 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e95b01fb-08b5-4213-b43c-dd173dd10493 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.141638 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49972) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:29.149214 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e95b01fb-08b5-4213-b43c-dd173dd10493 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.218696 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e95b01fb-08b5-4213-b43c-dd173dd10493 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.226437 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49978) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:29.226894 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e95b01fb-08b5-4213-b43c-dd173dd10493 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.3005381 Dec 09 21:50:29.231739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2c489248-151d-46db-b039-dba1017acd9b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'security_group_rule': {'security_group_id': '84678483-baf9-4a9e-ba44-4d435fde916e', 'project_id': 'e863bf78256945798e7c717c650258aa', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:50:29.233031 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e95b01fb-08b5-4213-b43c-dd173dd10493 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'SecurityGroup': ['ID=84678483-baf9-4a9e-ba44-4d435fde916e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:29.312935 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-21f60663-944c-4054-86f0-3aaccb446f6e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.325106 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2c489248-151d-46db-b039-dba1017acd9b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.326468 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6419ef0a-a0c9-4b12-b4ba-e68677bb9ec7 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.335999 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6419ef0a-a0c9-4b12-b4ba-e68677bb9ec7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.393820 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6419ef0a-a0c9-4b12-b4ba-e68677bb9ec7 None None] Pushing event updated for resources: {'Port': ['ID=1e95cc67-64d4-43d0-a8d6-5e5ee08804fb,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:29.427270 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6419ef0a-a0c9-4b12-b4ba-e68677bb9ec7 None None] Network f481e34c-08b7-4b81-995d-857e3c7f684d is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:50:29.429408 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-6419ef0a-a0c9-4b12-b4ba-e68677bb9ec7 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:50:29.433696 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6419ef0a-a0c9-4b12-b4ba-e68677bb9ec7 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:50:29.449501 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-21f60663-944c-4054-86f0-3aaccb446f6e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.463916 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-21f60663-944c-4054-86f0-3aaccb446f6e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.498320 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6419ef0a-a0c9-4b12-b4ba-e68677bb9ec7 None None] Attempting to bind port 1e95cc67-64d4-43d0-a8d6-5e5ee08804fb on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:50:29.498952 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6419ef0a-a0c9-4b12-b4ba-e68677bb9ec7 None None] Attempting to bind port 1e95cc67-64d4-43d0-a8d6-5e5ee08804fb by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'efd94242-a7b2-491d-b555-cf8b471e00ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'f481e34c-08b7-4b81-995d-857e3c7f684d'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:50:29.499512 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6419ef0a-a0c9-4b12-b4ba-e68677bb9ec7 None None] Attempting to bind port 1e95cc67-64d4-43d0-a8d6-5e5ee08804fb on network f481e34c-08b7-4b81-995d-857e3c7f684d {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:50:29.506106 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6419ef0a-a0c9-4b12-b4ba-e68677bb9ec7 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 50, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:50:29.506805 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6419ef0a-a0c9-4b12-b4ba-e68677bb9ec7 None None] Checking segment: {'id': 'efd94242-a7b2-491d-b555-cf8b471e00ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'f481e34c-08b7-4b81-995d-857e3c7f684d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:50:29.507776 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6419ef0a-a0c9-4b12-b4ba-e68677bb9ec7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.508319 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6419ef0a-a0c9-4b12-b4ba-e68677bb9ec7 None None] Bound using segment: {'id': 'efd94242-a7b2-491d-b555-cf8b471e00ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'f481e34c-08b7-4b81-995d-857e3c7f684d'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:50:29.509012 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6419ef0a-a0c9-4b12-b4ba-e68677bb9ec7 None None] Bound port: 1e95cc67-64d4-43d0-a8d6-5e5ee08804fb, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'efd94242-a7b2-491d-b555-cf8b471e00ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'f481e34c-08b7-4b81-995d-857e3c7f684d'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:50:29.509548 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6419ef0a-a0c9-4b12-b4ba-e68677bb9ec7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.515976 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21f60663-944c-4054-86f0-3aaccb446f6e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5b17a167-d06f-4f80-9187-ae1d4f8c9c61,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:29.552582 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-21f60663-944c-4054-86f0-3aaccb446f6e admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=96c1f4bd670e47b18e798e5d984ba161&name=default HTTP/1.1" status: 200 len: 3000 time: 0.4096892 Dec 09 21:50:29.555536 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 49988) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:29.570793 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2c489248-151d-46db-b039-dba1017acd9b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.581619 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2c489248-151d-46db-b039-dba1017acd9b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.620197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c489248-151d-46db-b039-dba1017acd9b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=931a3ab9-40d3-4a29-aecb-f7ba2b2da1fc,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:29.631182 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2c489248-151d-46db-b039-dba1017acd9b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.633096 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2c489248-151d-46db-b039-dba1017acd9b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4049578 Dec 09 21:50:29.636241 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 49994) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:29.642636 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-9d3a1914-8a81-444f-9172-2382cfda70d6 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'security_group_rule': {'security_group_id': '84678483-baf9-4a9e-ba44-4d435fde916e', 'project_id': 'e863bf78256945798e7c717c650258aa', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:50:29.643067 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6419ef0a-a0c9-4b12-b4ba-e68677bb9ec7 None None] For port 1e95cc67-64d4-43d0-a8d6-5e5ee08804fb, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:50:29.643496 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7aa1832-0d2f-4a45-92c6-e2135d054c1b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.647755 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6419ef0a-a0c9-4b12-b4ba-e68677bb9ec7 None None] For port 1e95cc67-64d4-43d0-a8d6-5e5ee08804fb, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=1e95cc67-64d4-43d0-a8d6-5e5ee08804fb,segment=NetworkSegment(efd94242-a7b2-491d-b555-cf8b471e00ae),segment_id=efd94242-a7b2-491d-b555-cf8b471e00ae)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:50:29.667723 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6419ef0a-a0c9-4b12-b4ba-e68677bb9ec7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.676002 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7aa1832-0d2f-4a45-92c6-e2135d054c1b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.694840 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d3a1914-8a81-444f-9172-2382cfda70d6 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.759251 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6419ef0a-a0c9-4b12-b4ba-e68677bb9ec7 None None] Pushing event updated for resources: {'Port': ['ID=1e95cc67-64d4-43d0-a8d6-5e5ee08804fb,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:29.766016 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7aa1832-0d2f-4a45-92c6-e2135d054c1b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.769608 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7aa1832-0d2f-4a45-92c6-e2135d054c1b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.782596 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c7aa1832-0d2f-4a45-92c6-e2135d054c1b admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/5b17a167-d06f-4f80-9187-ae1d4f8c9c61 HTTP/1.1" status: 204 len: 168 time: 0.2152114 Dec 09 21:50:29.789881 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d3a1914-8a81-444f-9172-2382cfda70d6 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.795520 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d3a1914-8a81-444f-9172-2382cfda70d6 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.797626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7aa1832-0d2f-4a45-92c6-e2135d054c1b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5b17a167-d06f-4f80-9187-ae1d4f8c9c61,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:29.828918 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d3a1914-8a81-444f-9172-2382cfda70d6 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.832913 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9d3a1914-8a81-444f-9172-2382cfda70d6 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1928797 Dec 09 21:50:29.834084 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50000) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:29.839197 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-1ec9271a-ec3a-4b35-8404-8da9b9dd7548 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'security_group_rule': {'security_group_id': '84678483-baf9-4a9e-ba44-4d435fde916e', 'project_id': 'e863bf78256945798e7c717c650258aa', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:50:29.845204 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d3a1914-8a81-444f-9172-2382cfda70d6 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7d4301ff-6778-4732-b1c9-c572ecdbb4f2,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:29.896062 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1ec9271a-ec3a-4b35-8404-8da9b9dd7548 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.988787 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1ec9271a-ec3a-4b35-8404-8da9b9dd7548 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:29.997179 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1ec9271a-ec3a-4b35-8404-8da9b9dd7548 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:30.023503 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ec9271a-ec3a-4b35-8404-8da9b9dd7548 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ea3eac6a-0f33-44cb-b71e-13f867dd0fb9,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:30.034462 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1ec9271a-ec3a-4b35-8404-8da9b9dd7548 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:30.036196 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1ec9271a-ec3a-4b35-8404-8da9b9dd7548 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2015178 Dec 09 21:50:30.039011 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50006) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:30.044267 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-06211fff-9972-491c-a869-f6dac99e4013 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'security_group_rule': {'security_group_id': '84678483-baf9-4a9e-ba44-4d435fde916e', 'project_id': 'e863bf78256945798e7c717c650258aa', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:50:30.092677 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-06211fff-9972-491c-a869-f6dac99e4013 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:30.253225 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-06211fff-9972-491c-a869-f6dac99e4013 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:30.266558 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-06211fff-9972-491c-a869-f6dac99e4013 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:30.300043 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-06211fff-9972-491c-a869-f6dac99e4013 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:30.301577 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-06211fff-9972-491c-a869-f6dac99e4013 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2612965 Dec 09 21:50:30.305085 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50016) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:30.306135 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06211fff-9972-491c-a869-f6dac99e4013 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d9e145db-e519-454e-81c7-12efb1fd2f17,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:30.319398 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a5ecda2d-a225-42e4-87a0-989383aa793e tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'security_group_rule': {'security_group_id': '84678483-baf9-4a9e-ba44-4d435fde916e', 'project_id': 'e863bf78256945798e7c717c650258aa', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:50:30.367881 n-d-713301-27 neutron-server[103437]: INFO neutron.db.securitygroups_db [None req-a5ecda2d-a225-42e4-87a0-989383aa793e tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Project e863bf78256945798e7c717c650258aa added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 21:50:30.373888 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a5ecda2d-a225-42e4-87a0-989383aa793e tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:30.459069 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a5ecda2d-a225-42e4-87a0-989383aa793e tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:30.465825 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a5ecda2d-a225-42e4-87a0-989383aa793e tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:30.486780 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5ecda2d-a225-42e4-87a0-989383aa793e tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=24feb87f-1241-44e3-aa1c-56527c700ba7,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:30.508277 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a5ecda2d-a225-42e4-87a0-989383aa793e tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:30.509838 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a5ecda2d-a225-42e4-87a0-989383aa793e tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2029564 Dec 09 21:50:30.512772 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50026) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:30.517324 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-5dc9418f-9c7e-40d5-9bb6-214813b0f058 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'security_group_rule': {'security_group_id': '84678483-baf9-4a9e-ba44-4d435fde916e', 'project_id': 'e863bf78256945798e7c717c650258aa', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:50:30.562791 n-d-713301-27 neutron-server[103438]: INFO neutron.db.securitygroups_db [None req-5dc9418f-9c7e-40d5-9bb6-214813b0f058 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Project e863bf78256945798e7c717c650258aa added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 21:50:30.569251 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5dc9418f-9c7e-40d5-9bb6-214813b0f058 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:30.654221 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5dc9418f-9c7e-40d5-9bb6-214813b0f058 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:30.662130 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5dc9418f-9c7e-40d5-9bb6-214813b0f058 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:30.685133 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dc9418f-9c7e-40d5-9bb6-214813b0f058 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4f2c38fe-ed95-4828-81a1-7b4996c828fd,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:30.697390 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5dc9418f-9c7e-40d5-9bb6-214813b0f058 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:30.698664 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5dc9418f-9c7e-40d5-9bb6-214813b0f058 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1848707 Dec 09 21:50:31.215031 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-eaac8a89-69c1-449b-a4ad-05c26be62b83 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1407047017&fields=id&tenant_id=e863bf78256945798e7c717c650258aa HTTP/1.1" status: 200 len: 267 time: 0.1279521 Dec 09 21:50:31.433550 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-c7bda308-f3be-4d77-bc29-dacda508cd50 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:31.440495 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b402108-f2b7-459a-92f5-0125dc02ce2b None None] Network f481e34c-08b7-4b81-995d-857e3c7f684d requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:50:31.446473 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-c7bda308-f3be-4d77-bc29-dacda508cd50 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/networks?id=f481e34c-08b7-4b81-995d-857e3c7f684d HTTP/1.1" status: 200 len: 797 time: 0.2296972 Dec 09 21:50:31.469119 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-cb75da4f-6062-4483-a901-e8f67657fef3 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/quotas/e863bf78256945798e7c717c650258aa HTTP/1.1" status: 200 len: 375 time: 0.0206962 Dec 09 21:50:31.557297 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-d2223c66-f0ab-4f38-b3b2-89fcb35a72c8 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=e863bf78256945798e7c717c650258aa&fields=id HTTP/1.1" status: 200 len: 394 time: 0.0874898 Dec 09 21:50:31.647548 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50070) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:31.651242 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-58f908d9-4777-42d4-9cd6-fcadb2b4c949 None None] Provisioning complete for port 1e95cc67-64d4-43d0-a8d6-5e5ee08804fb triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:31.652291 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-58f908d9-4777-42d4-9cd6-fcadb2b4c949 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:31.742169 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-b3ed0377-62e7-4723-a0c7-69e8c3283699 service neutron] 10.222.0.13 "GET /v2.0/networks/f481e34c-08b7-4b81-995d-857e3c7f684d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1809773 Dec 09 21:50:31.836838 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-58f908d9-4777-42d4-9cd6-fcadb2b4c949 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:31.915862 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-11bdc970-73fd-482f-9a79-e1fb2b2ecc55 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:31.923090 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 1e95cc67-64d4-43d0-a8d6-5e5ee08804fb up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:50:31.925332 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-7e810dfd-7949-4e9e-aa1f-046c4e6007d7 service neutron] 10.222.0.13 "GET /v2.0/networks/f481e34c-08b7-4b81-995d-857e3c7f684d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1820254 Dec 09 21:50:31.930676 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-58f908d9-4777-42d4-9cd6-fcadb2b4c949 None None] For port 1e95cc67-64d4-43d0-a8d6-5e5ee08804fb, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=1e95cc67-64d4-43d0-a8d6-5e5ee08804fb,segment=NetworkSegment(efd94242-a7b2-491d-b555-cf8b471e00ae),segment_id=efd94242-a7b2-491d-b555-cf8b471e00ae)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:50:32.005565 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-58f908d9-4777-42d4-9cd6-fcadb2b4c949 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:32.096696 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58f908d9-4777-42d4-9cd6-fcadb2b4c949 None None] Pushing event updated for resources: {'Port': ['ID=1e95cc67-64d4-43d0-a8d6-5e5ee08804fb,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:32.098933 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-11bdc970-73fd-482f-9a79-e1fb2b2ecc55 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:32.109934 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-11bdc970-73fd-482f-9a79-e1fb2b2ecc55 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:32.119342 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:50:32.126876 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 1e95cc67-64d4-43d0-a8d6-5e5ee08804fb triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:32.127608 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:32.196595 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11bdc970-73fd-482f-9a79-e1fb2b2ecc55 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9c30084f-4408-4d81-9ebb-c7c467c1f72a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:32.204137 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50086) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:32.204371 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-11bdc970-73fd-482f-9a79-e1fb2b2ecc55 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=4e41aed8a71940ebb3886208fc1ebd70&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5547638 Dec 09 21:50:32.263412 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-643da3e5-b91e-4f24-94a5-d1e9dbbfc1db None None] Provisioning complete for port 1e95cc67-64d4-43d0-a8d6-5e5ee08804fb triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:32.263891 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-643da3e5-b91e-4f24-94a5-d1e9dbbfc1db None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:32.310334 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2cdeb890-cb59-498f-b7b9-ee00cabfb39e req-4dbfd062-e36c-4917-aa28-6c44e8de508d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=770cd4f6-d7e5-43f3-9b0c-380cc9271551 HTTP/1.1" status: 200 len: 210 time: 0.0960937 Dec 09 21:50:32.371712 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4c638f3b-62e7-4692-9438-1519a3909206 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:32.408854 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4c638f3b-62e7-4692-9438-1519a3909206 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:32.490548 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4c638f3b-62e7-4692-9438-1519a3909206 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:32.493461 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4c638f3b-62e7-4692-9438-1519a3909206 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:32.494758 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4c638f3b-62e7-4692-9438-1519a3909206 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/9c30084f-4408-4d81-9ebb-c7c467c1f72a HTTP/1.1" status: 204 len: 168 time: 0.2894001 Dec 09 21:50:32.519640 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c638f3b-62e7-4692-9438-1519a3909206 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9c30084f-4408-4d81-9ebb-c7c467c1f72a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:32.988233 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b5628eb5-3c85-44d8-aaca-6d5f06d3cff5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:33.391236 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50138) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:33.442750 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-828f2af1-358e-4efb-bdab-1c8e3e882a58 req-6ecbbd13-c29d-4ac3-b5ab-173235efabba tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=770cd4f6-d7e5-43f3-9b0c-380cc9271551 HTTP/1.1" status: 200 len: 210 time: 0.0282619 Dec 09 21:50:33.524859 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-d10546a7-6770-4eb0-a04f-2170deaf0986 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1638356502-network', 'tenant_id': '2671ed6f9fdf4c9cb0e0438099319f7d'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:50:33.550502 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d10546a7-6770-4eb0-a04f-2170deaf0986 admin admin] Made reservation on behalf of 2671ed6f9fdf4c9cb0e0438099319f7d for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:50:33.553158 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d10546a7-6770-4eb0-a04f-2170deaf0986 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:33.565230 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d10546a7-6770-4eb0-a04f-2170deaf0986 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:33.643164 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d10546a7-6770-4eb0-a04f-2170deaf0986 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:33.652382 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d10546a7-6770-4eb0-a04f-2170deaf0986 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:33.685873 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d10546a7-6770-4eb0-a04f-2170deaf0986 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ce5c7bc1-de04-4060-901f-bf2612c44351,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:33.689781 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d10546a7-6770-4eb0-a04f-2170deaf0986 admin admin] vlan segment allocate from pool success with {'vlan_id': 139, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:50:33.700226 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d10546a7-6770-4eb0-a04f-2170deaf0986 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:33.700573 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-d10546a7-6770-4eb0-a04f-2170deaf0986 admin admin] Added segment fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8 of type vlan for network eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a Dec 09 21:50:33.777607 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d10546a7-6770-4eb0-a04f-2170deaf0986 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:33.808266 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d10546a7-6770-4eb0-a04f-2170deaf0986 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:33.809719 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d10546a7-6770-4eb0-a04f-2170deaf0986 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:33.814035 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d10546a7-6770-4eb0-a04f-2170deaf0986 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:33.890523 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 1e95cc67-64d4-43d0-a8d6-5e5ee08804fb up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:50:33.890844 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d10546a7-6770-4eb0-a04f-2170deaf0986 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.4978898 Dec 09 21:50:33.893657 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50148) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:33.902101 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-1c2217d0-b29e-4f60-9ec4-65e7daaed851 admin admin] Request body: {'subnet': {'network_id': 'eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1638356502-subnet', 'tenant_id': '2671ed6f9fdf4c9cb0e0438099319f7d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:50:33.980502 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d10546a7-6770-4eb0-a04f-2170deaf0986 admin admin] Pushing event updated for resources: {'Network': ['ID=eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:33.996460 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 1e95cc67-64d4-43d0-a8d6-5e5ee08804fb triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:33.996933 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:34.046724 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1c2217d0-b29e-4f60-9ec4-65e7daaed851 admin admin] Made reservation on behalf of 2671ed6f9fdf4c9cb0e0438099319f7d for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:50:34.046961 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:50:34.049993 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1c2217d0-b29e-4f60-9ec4-65e7daaed851 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:34.517934 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-86615f09-d465-4643-a3a3-fc4ee279720d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:34.519804 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-86615f09-d465-4643-a3a3-fc4ee279720d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.31 "GET /v2.0/networks?id=f481e34c-08b7-4b81-995d-857e3c7f684d HTTP/1.1" status: 200 len: 797 time: 0.6077862 Dec 09 21:50:34.567612 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-651ed5a3-928f-4519-b20e-556b10ae4177 req-01511134-7292-4fbe-8660-457ec63a053d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=770cd4f6-d7e5-43f3-9b0c-380cc9271551 HTTP/1.1" status: 200 len: 210 time: 0.0450573 Dec 09 21:50:34.626822 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-2b94cba6-eb2c-435d-ba62-337b3948e02b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=e863bf78256945798e7c717c650258aa HTTP/1.1" status: 200 len: 473 time: 0.0966165 Dec 09 21:50:34.639076 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-bffabc5d-8a00-497b-8610-512542d8d346 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'port': {'device_id': '770cd4f6-d7e5-43f3-9b0c-380cc9271551', 'network_id': 'f481e34c-08b7-4b81-995d-857e3c7f684d', 'admin_state_up': True, 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'security_groups': ['84678483-baf9-4a9e-ba44-4d435fde916e']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:50:34.810610 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1c2217d0-b29e-4f60-9ec4-65e7daaed851 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:34.901496 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c2217d0-b29e-4f60-9ec4-65e7daaed851 admin admin] Pushing event updated for resources: {'Subnet': ['ID=938dec21-7b2e-4de4-a129-71c1f3ba1dd6,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:34.916505 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-bffabc5d-8a00-497b-8610-512542d8d346 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Made reservation on behalf of e863bf78256945798e7c717c650258aa for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:50:34.920077 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-bffabc5d-8a00-497b-8610-512542d8d346 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:34.934833 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c2217d0-b29e-4f60-9ec4-65e7daaed851 admin admin] Checking segment: {'id': 'fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:50:34.935416 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c2217d0-b29e-4f60-9ec4-65e7daaed851 admin admin] Network hostable DHCP agents. Network: eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:50:34.965632 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c2217d0-b29e-4f60-9ec4-65e7daaed851 admin admin] Network eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:50:35.010041 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-1c2217d0-b29e-4f60-9ec4-65e7daaed851 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:50:35.018206 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1c2217d0-b29e-4f60-9ec4-65e7daaed851 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:35.018725 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1c2217d0-b29e-4f60-9ec4-65e7daaed851 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:35.035668 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-47729fbe-1d15-49f1-82ee-6bdb8b52df40 None None] Network eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:50:35.136615 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1c2217d0-b29e-4f60-9ec4-65e7daaed851 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 1.2413132 Dec 09 21:50:35.140966 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-bffabc5d-8a00-497b-8610-512542d8d346 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Allocated IP 172.20.0.20 (f481e34c-08b7-4b81-995d-857e3c7f684d/db260714-c8e4-49a8-961f-2d6c653a6d1a/4035706f-a949-4d9b-9aa6-aa924a3b6167) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:50:35.182445 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04aa8e5b-7631-4fb7-bdfe-6109995851fc None None] Network eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:50:35.323967 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-bffabc5d-8a00-497b-8610-512542d8d346 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:35.372832 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-bffabc5d-8a00-497b-8610-512542d8d346 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:35.421558 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-bffabc5d-8a00-497b-8610-512542d8d346 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Network f481e34c-08b7-4b81-995d-857e3c7f684d is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:50:35.425278 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-bffabc5d-8a00-497b-8610-512542d8d346 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:50:35.431346 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-bffabc5d-8a00-497b-8610-512542d8d346 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:50:35.504094 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bffabc5d-8a00-497b-8610-512542d8d346 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'Port': ['ID=4035706f-a949-4d9b-9aa6-aa924a3b6167,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:35.534396 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-bffabc5d-8a00-497b-8610-512542d8d346 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:35.535274 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-bffabc5d-8a00-497b-8610-512542d8d346 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:35.574858 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-bffabc5d-8a00-497b-8610-512542d8d346 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9408984 Dec 09 21:50:35.599339 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-8feca571-837b-46eb-b568-a18ca58dd7e9 service neutron] Request body: {'port': {'device_id': '770cd4f6-d7e5-43f3-9b0c-380cc9271551', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:50:35.601989 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b03e1e31-e0ea-4569-8b99-ac13973453c1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:35.753275 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-8feca571-837b-46eb-b568-a18ca58dd7e9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:35.775973 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7737ef60-dee3-4780-ab28-f1a977a9fbb2 req-42b42574-f092-4250-bd41-386f6ce0255f tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:35.778750 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7737ef60-dee3-4780-ab28-f1a977a9fbb2 req-42b42574-f092-4250-bd41-386f6ce0255f tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=770cd4f6-d7e5-43f3-9b0c-380cc9271551 HTTP/1.1" status: 200 len: 932 time: 0.0821054 Dec 09 21:50:35.927196 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7737ef60-dee3-4780-ab28-f1a977a9fbb2 req-7f352783-8b95-4515-8339-a3309f6e9afc tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=84678483-baf9-4a9e-ba44-4d435fde916e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1336899 Dec 09 21:50:35.936641 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-12556fa2-f93d-407a-975b-a79e080e7030 None None] Provisioning complete for port 4035706f-a949-4d9b-9aa6-aa924a3b6167 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:35.937349 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-12556fa2-f93d-407a-975b-a79e080e7030 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:36.062150 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-12556fa2-f93d-407a-975b-a79e080e7030 None None] Port 4035706f-a949-4d9b-9aa6-aa924a3b6167 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:50:36.196351 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-8feca571-837b-46eb-b568-a18ca58dd7e9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4035706f-a949-4d9b-9aa6-aa924a3b6167 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:50:36.216505 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-8feca571-837b-46eb-b568-a18ca58dd7e9 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:36.242240 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-8feca571-837b-46eb-b568-a18ca58dd7e9 service neutron] Transition to ACTIVE for port object 4035706f-a949-4d9b-9aa6-aa924a3b6167 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:50:36.249781 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-8feca571-837b-46eb-b568-a18ca58dd7e9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:36.310575 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8feca571-837b-46eb-b568-a18ca58dd7e9 service neutron] Pushing event updated for resources: {'Port': ['ID=4035706f-a949-4d9b-9aa6-aa924a3b6167,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:36.451085 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-8feca571-837b-46eb-b568-a18ca58dd7e9 service neutron] Attempting to bind port 4035706f-a949-4d9b-9aa6-aa924a3b6167 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:50:36.451900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-8feca571-837b-46eb-b568-a18ca58dd7e9 service neutron] Attempting to bind port 4035706f-a949-4d9b-9aa6-aa924a3b6167 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'efd94242-a7b2-491d-b555-cf8b471e00ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'f481e34c-08b7-4b81-995d-857e3c7f684d'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:50:36.452448 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-8feca571-837b-46eb-b568-a18ca58dd7e9 service neutron] Attempting to bind port 4035706f-a949-4d9b-9aa6-aa924a3b6167 on network f481e34c-08b7-4b81-995d-857e3c7f684d {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:50:36.461963 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-8feca571-837b-46eb-b568-a18ca58dd7e9 service neutron] Port 4035706f-a949-4d9b-9aa6-aa924a3b6167 on network f481e34c-08b7-4b81-995d-857e3c7f684d not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:50:36.462691 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-8feca571-837b-46eb-b568-a18ca58dd7e9 service neutron] Attempting to bind port 4035706f-a949-4d9b-9aa6-aa924a3b6167 on network f481e34c-08b7-4b81-995d-857e3c7f684d {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:50:36.471349 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-8feca571-837b-46eb-b568-a18ca58dd7e9 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 50, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:50:36.472257 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-8feca571-837b-46eb-b568-a18ca58dd7e9 service neutron] Checking segment: {'id': 'efd94242-a7b2-491d-b555-cf8b471e00ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'f481e34c-08b7-4b81-995d-857e3c7f684d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:50:36.472908 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-8feca571-837b-46eb-b568-a18ca58dd7e9 service neutron] Bound using segment: {'id': 'efd94242-a7b2-491d-b555-cf8b471e00ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'f481e34c-08b7-4b81-995d-857e3c7f684d'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:50:36.473922 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-8feca571-837b-46eb-b568-a18ca58dd7e9 service neutron] Bound port: 4035706f-a949-4d9b-9aa6-aa924a3b6167, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'efd94242-a7b2-491d-b555-cf8b471e00ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'f481e34c-08b7-4b81-995d-857e3c7f684d'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:50:36.476870 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-8feca571-837b-46eb-b568-a18ca58dd7e9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:36.552869 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-8feca571-837b-46eb-b568-a18ca58dd7e9 service neutron] For port 4035706f-a949-4d9b-9aa6-aa924a3b6167, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:50:36.556718 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-8feca571-837b-46eb-b568-a18ca58dd7e9 service neutron] For port 4035706f-a949-4d9b-9aa6-aa924a3b6167, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=4035706f-a949-4d9b-9aa6-aa924a3b6167,segment=NetworkSegment(efd94242-a7b2-491d-b555-cf8b471e00ae),segment_id=efd94242-a7b2-491d-b555-cf8b471e00ae)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:50:36.563140 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-8feca571-837b-46eb-b568-a18ca58dd7e9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:36.603632 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-8feca571-837b-46eb-b568-a18ca58dd7e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:36.604405 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-8feca571-837b-46eb-b568-a18ca58dd7e9 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:36.605909 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-8feca571-837b-46eb-b568-a18ca58dd7e9 service neutron] 10.222.0.31 "PUT /v2.0/ports/4035706f-a949-4d9b-9aa6-aa924a3b6167 HTTP/1.1" status: 200 len: 1093 time: 1.0208523 Dec 09 21:50:36.606516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '770cd4f6-d7e5-43f3-9b0c-380cc9271551', 'tag': '4035706f-a949-4d9b-9aa6-aa924a3b6167'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:50:36.610161 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-04a7b9fd-0a82-473d-baa5-2096836962d9" -d '{"events": [{"name": "network-changed", "server_uuid": "770cd4f6-d7e5-43f3-9b0c-380cc9271551", "tag": "4035706f-a949-4d9b-9aa6-aa924a3b6167"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:50:36.697027 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:36.752574 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:50:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-754c2173-6ef0-4689-8b49-4901be4310d5 x-openstack-request-id: req-754c2173-6ef0-4689-8b49-4901be4310d5 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:50:36.752935 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "770cd4f6-d7e5-43f3-9b0c-380cc9271551", "tag": "4035706f-a949-4d9b-9aa6-aa924a3b6167", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:50:36.753291 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-754c2173-6ef0-4689-8b49-4901be4310d5 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:50:36.753765 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '770cd4f6-d7e5-43f3-9b0c-380cc9271551', 'tag': '4035706f-a949-4d9b-9aa6-aa924a3b6167', 'status': 'completed', 'code': 200} Dec 09 21:50:36.837557 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8feca571-837b-46eb-b568-a18ca58dd7e9 service neutron] Pushing event updated for resources: {'Port': ['ID=4035706f-a949-4d9b-9aa6-aa924a3b6167,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:36.880308 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-dcbbd2f8-4f8a-4931-b043-5a0315acb67e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:36.883506 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-dcbbd2f8-4f8a-4931-b043-5a0315acb67e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e863bf78256945798e7c717c650258aa&device_id=770cd4f6-d7e5-43f3-9b0c-380cc9271551 HTTP/1.1" status: 200 len: 1096 time: 0.2207353 Dec 09 21:50:36.980588 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-6befdd9d-4d59-4a05-81e6-04fd002ece34 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.20&port_id=4035706f-a949-4d9b-9aa6-aa924a3b6167 HTTP/1.1" status: 200 len: 217 time: 0.0880423 Dec 09 21:50:37.118363 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47d9d748-39e2-41b0-95b3-f7acd1ccc1bc req-d13bd871-33b7-496a-a170-b0ffba0e6ab9 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:37.124406 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-47d9d748-39e2-41b0-95b3-f7acd1ccc1bc req-d13bd871-33b7-496a-a170-b0ffba0e6ab9 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=770cd4f6-d7e5-43f3-9b0c-380cc9271551 HTTP/1.1" status: 200 len: 944 time: 0.0850737 Dec 09 21:50:37.147900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-64e8e6d3-c898-471b-9d0e-c4a8c992a4c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:37.150063 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-64e8e6d3-c898-471b-9d0e-c4a8c992a4c4 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=db260714-c8e4-49a8-961f-2d6c653a6d1a HTTP/1.1" status: 200 len: 838 time: 0.1612349 Dec 09 21:50:37.236392 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-47d9d748-39e2-41b0-95b3-f7acd1ccc1bc req-3b9007d7-91c1-4b37-a23b-6af3a90bad22 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=84678483-baf9-4a9e-ba44-4d435fde916e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0870302 Dec 09 21:50:37.245335 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-d52a6a4e-d0ac-40ce-a3eb-a6a918b33235 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:37.246997 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-d52a6a4e-d0ac-40ce-a3eb-a6a918b33235 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=f481e34c-08b7-4b81-995d-857e3c7f684d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1165 time: 0.0890906 Dec 09 21:50:37.454190 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-e3508a00-09a8-4da7-83d5-2ec4005aa924 service neutron] 10.222.0.31 "GET /v2.0/networks/f481e34c-08b7-4b81-995d-857e3c7f684d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1986809 Dec 09 21:50:37.633883 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-77e6bd40-1bf0-4046-951c-92dbf8e85a8e req-3fd7f771-c69f-4f1a-b5d6-43ad1420c20e service neutron] 10.222.0.31 "GET /v2.0/networks/f481e34c-08b7-4b81-995d-857e3c7f684d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1715498 Dec 09 21:50:37.778843 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04a7b9fd-0a82-473d-baa5-2096836962d9 req-8f8bce09-bba9-47f3-8a12-7ba240d26e4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:37.780687 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-04a7b9fd-0a82-473d-baa5-2096836962d9 req-8f8bce09-bba9-47f3-8a12-7ba240d26e4f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e863bf78256945798e7c717c650258aa&device_id=770cd4f6-d7e5-43f3-9b0c-380cc9271551 HTTP/1.1" status: 200 len: 1096 time: 0.0784669 Dec 09 21:50:37.959115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04a7b9fd-0a82-473d-baa5-2096836962d9 req-68572e6b-5efd-489b-b6e2-1a66660d1bf6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:37.960937 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-04a7b9fd-0a82-473d-baa5-2096836962d9 req-68572e6b-5efd-489b-b6e2-1a66660d1bf6 service neutron] 10.222.0.31 "GET /v2.0/networks?id=f481e34c-08b7-4b81-995d-857e3c7f684d HTTP/1.1" status: 200 len: 898 time: 0.1651256 Dec 09 21:50:38.012703 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:38.013465 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-04a7b9fd-0a82-473d-baa5-2096836962d9 req-ab382fdc-f962-4f6d-9aa5-1e69d9e1b057 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.20&port_id=4035706f-a949-4d9b-9aa6-aa924a3b6167 HTTP/1.1" status: 200 len: 217 time: 0.0443423 Dec 09 21:50:38.092286 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04a7b9fd-0a82-473d-baa5-2096836962d9 req-8fef79c2-8001-4176-9af7-8c712725e7f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:38.094818 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-04a7b9fd-0a82-473d-baa5-2096836962d9 req-8fef79c2-8001-4176-9af7-8c712725e7f6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=db260714-c8e4-49a8-961f-2d6c653a6d1a HTTP/1.1" status: 200 len: 838 time: 0.0742176 Dec 09 21:50:38.192597 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04a7b9fd-0a82-473d-baa5-2096836962d9 req-b4c7ea0b-2ef4-4bec-92f8-734c490ebcc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:38.194514 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-04a7b9fd-0a82-473d-baa5-2096836962d9 req-b4c7ea0b-2ef4-4bec-92f8-734c490ebcc1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=f481e34c-08b7-4b81-995d-857e3c7f684d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1165 time: 0.0855820 Dec 09 21:50:38.367081 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-04a7b9fd-0a82-473d-baa5-2096836962d9 req-dd0d46b0-9847-429a-8b2b-cb5f255d3307 service neutron] 10.222.0.31 "GET /v2.0/networks/f481e34c-08b7-4b81-995d-857e3c7f684d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1614816 Dec 09 21:50:38.447778 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6aa3853-8e35-46c9-a98a-3de33440109d req-e7245353-1e1f-49d1-b5ad-28f5e2c19c2b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:38.455636 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c6aa3853-8e35-46c9-a98a-3de33440109d req-e7245353-1e1f-49d1-b5ad-28f5e2c19c2b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=770cd4f6-d7e5-43f3-9b0c-380cc9271551 HTTP/1.1" status: 200 len: 944 time: 0.0826824 Dec 09 21:50:38.563371 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-04a7b9fd-0a82-473d-baa5-2096836962d9 req-381cf9bc-7e32-4136-9aed-1223121029d1 service neutron] 10.222.0.31 "GET /v2.0/networks/f481e34c-08b7-4b81-995d-857e3c7f684d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1797111 Dec 09 21:50:38.600026 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c6aa3853-8e35-46c9-a98a-3de33440109d req-4b058189-d659-4718-a637-4f3b39c4cf22 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=84678483-baf9-4a9e-ba44-4d435fde916e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1428649 Dec 09 21:50:38.799566 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-467c2bd7-e7e9-4ec2-80b3-74cac1e1667a req-d911b45b-8b24-46dd-9a54-6ac810e86af3 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0829628 Dec 09 21:50:38.957894 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-467c2bd7-e7e9-4ec2-80b3-74cac1e1667a req-9bd6cb88-c0b1-418c-ac32-ca33739b2419 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:38.960167 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-467c2bd7-e7e9-4ec2-80b3-74cac1e1667a req-9bd6cb88-c0b1-418c-ac32-ca33739b2419 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e863bf78256945798e7c717c650258aa&device_id=6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a HTTP/1.1" status: 200 len: 1098 time: 0.0520680 Dec 09 21:50:39.193446 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-467c2bd7-e7e9-4ec2-80b3-74cac1e1667a req-8021b2f7-0c7c-4a80-a22c-6fa481de2a9e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:39.195606 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-467c2bd7-e7e9-4ec2-80b3-74cac1e1667a req-8021b2f7-0c7c-4a80-a22c-6fa481de2a9e service neutron] 10.222.0.31 "GET /v2.0/networks?id=5ed1c0c9-0d1a-458b-9180-fe96edb96b56 HTTP/1.1" status: 200 len: 896 time: 0.2002912 Dec 09 21:50:39.303647 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-467c2bd7-e7e9-4ec2-80b3-74cac1e1667a req-be116b35-d297-4bf8-be28-ce9df81183c7 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 HTTP/1.1" status: 200 len: 1002 time: 0.0935695 Dec 09 21:50:39.411213 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-467c2bd7-e7e9-4ec2-80b3-74cac1e1667a req-5e7655b4-5076-46d8-8fe9-af3639123032 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:39.416480 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-467c2bd7-e7e9-4ec2-80b3-74cac1e1667a req-5e7655b4-5076-46d8-8fe9-af3639123032 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=01104ce9-312c-40a5-b51d-c30bc463bf2c HTTP/1.1" status: 200 len: 835 time: 0.1030493 Dec 09 21:50:39.419051 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 4035706f-a949-4d9b-9aa6-aa924a3b6167 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:50:39.518669 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-467c2bd7-e7e9-4ec2-80b3-74cac1e1667a req-ab0ee0fc-56f1-4dc6-a209-aa616fa011bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:39.520682 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-467c2bd7-e7e9-4ec2-80b3-74cac1e1667a req-ab0ee0fc-56f1-4dc6-a209-aa616fa011bf service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5ed1c0c9-0d1a-458b-9180-fe96edb96b56&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0952725 Dec 09 21:50:39.557282 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 4035706f-a949-4d9b-9aa6-aa924a3b6167, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=4035706f-a949-4d9b-9aa6-aa924a3b6167,segment=NetworkSegment(efd94242-a7b2-491d-b555-cf8b471e00ae),segment_id=efd94242-a7b2-491d-b555-cf8b471e00ae)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:50:39.576794 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '4035706f-a949-4d9b-9aa6-aa924a3b6167', 'network_id': 'f481e34c-08b7-4b81-995d-857e3c7f684d', 'port_id': '4035706f-a949-4d9b-9aa6-aa924a3b6167', 'mac_address': 'fa:16:3e:31:56:c5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 142, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'db260714-c8e4-49a8-961f-2d6c653a6d1a', 'ip_address': '172.20.0.20'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:50:39.634804 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:39.660000 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4035706f-a949-4d9b-9aa6-aa924a3b6167 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:50:39.701436 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:39.707832 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 4035706f-a949-4d9b-9aa6-aa924a3b6167, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=4035706f-a949-4d9b-9aa6-aa924a3b6167,segment=NetworkSegment(efd94242-a7b2-491d-b555-cf8b471e00ae),segment_id=efd94242-a7b2-491d-b555-cf8b471e00ae)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:50:39.721555 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:39.809606 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-467c2bd7-e7e9-4ec2-80b3-74cac1e1667a req-28891876-f152-4013-913e-df1b27e29248 service neutron] 10.222.0.31 "GET /v2.0/networks/5ed1c0c9-0d1a-458b-9180-fe96edb96b56?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2789729 Dec 09 21:50:39.856884 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-218ffbec-f3bb-4260-8f37-961b7c37cc86 req-b6e9dcb8-4cc6-4e3d-a760-38e6b93ef308 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:39.860084 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=4035706f-a949-4d9b-9aa6-aa924a3b6167,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:39.864658 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-218ffbec-f3bb-4260-8f37-961b7c37cc86 req-b6e9dcb8-4cc6-4e3d-a760-38e6b93ef308 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=770cd4f6-d7e5-43f3-9b0c-380cc9271551 HTTP/1.1" status: 200 len: 945 time: 0.1596260 Dec 09 21:50:39.962387 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['4035706f-a949-4d9b-9aa6-aa924a3b6167'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:50:39.983282 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-467c2bd7-e7e9-4ec2-80b3-74cac1e1667a req-7cd8ab38-4aa1-4b71-a127-8d3ee070063a service neutron] 10.222.0.31 "GET /v2.0/networks/5ed1c0c9-0d1a-458b-9180-fe96edb96b56?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1650803 Dec 09 21:50:40.034923 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-218ffbec-f3bb-4260-8f37-961b7c37cc86 req-ea462787-c1a6-4991-a15d-b060f07bfaff tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=84678483-baf9-4a9e-ba44-4d435fde916e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1447496 Dec 09 21:50:41.184684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95803052-dbcd-4032-87fd-5542b95dfee4 req-dac93b71-112a-49f4-a059-a0dccf7e347a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:41.188371 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-95803052-dbcd-4032-87fd-5542b95dfee4 req-dac93b71-112a-49f4-a059-a0dccf7e347a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=770cd4f6-d7e5-43f3-9b0c-380cc9271551 HTTP/1.1" status: 200 len: 945 time: 0.0738592 Dec 09 21:50:41.262264 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-95803052-dbcd-4032-87fd-5542b95dfee4 req-700710ed-1007-4b22-bfc2-3665a7ea9e2e tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=84678483-baf9-4a9e-ba44-4d435fde916e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0675335 Dec 09 21:50:41.417401 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 4035706f-a949-4d9b-9aa6-aa924a3b6167 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:50:41.499431 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 4035706f-a949-4d9b-9aa6-aa924a3b6167 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:50:41.503594 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 4035706f-a949-4d9b-9aa6-aa924a3b6167 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:41.503972 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:41.593137 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:41.617459 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '770cd4f6-d7e5-43f3-9b0c-380cc9271551', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4035706f-a949-4d9b-9aa6-aa924a3b6167'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:50:41.620064 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-42763c8e-5f27-422f-9fb1-83f6160f0665" -d '{"events": [{"server_uuid": "770cd4f6-d7e5-43f3-9b0c-380cc9271551", "name": "network-vif-plugged", "status": "completed", "tag": "4035706f-a949-4d9b-9aa6-aa924a3b6167"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:50:41.633527 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 4035706f-a949-4d9b-9aa6-aa924a3b6167, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=4035706f-a949-4d9b-9aa6-aa924a3b6167,segment=NetworkSegment(efd94242-a7b2-491d-b555-cf8b471e00ae),segment_id=efd94242-a7b2-491d-b555-cf8b471e00ae)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:50:41.638544 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:41.673466 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:50:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-80a7d77a-5a36-4097-a902-9679e18d85e8 x-openstack-request-id: req-80a7d77a-5a36-4097-a902-9679e18d85e8 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:50:41.673466 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "770cd4f6-d7e5-43f3-9b0c-380cc9271551", "name": "network-vif-plugged", "status": "completed", "tag": "4035706f-a949-4d9b-9aa6-aa924a3b6167", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:50:41.674310 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-80a7d77a-5a36-4097-a902-9679e18d85e8 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:50:41.674503 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '770cd4f6-d7e5-43f3-9b0c-380cc9271551', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4035706f-a949-4d9b-9aa6-aa924a3b6167', 'code': 200} Dec 09 21:50:41.716891 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=4035706f-a949-4d9b-9aa6-aa924a3b6167,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:41.863098 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc6d9d35-6731-493e-90a5-def23c646688 req-ef7d4336-ec24-4372-bc82-3d2bf287b1d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:41.868790 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dc6d9d35-6731-493e-90a5-def23c646688 req-ef7d4336-ec24-4372-bc82-3d2bf287b1d7 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=770cd4f6-d7e5-43f3-9b0c-380cc9271551 HTTP/1.1" status: 200 len: 1098 time: 0.0908666 Dec 09 21:50:41.955164 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dc6d9d35-6731-493e-90a5-def23c646688 req-60e88fae-ba7e-43d6-9d83-42bcb35ce07f service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=84678483-baf9-4a9e-ba44-4d435fde916e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0789940 Dec 09 21:50:42.456322 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed5533c-1054-47eb-bf71-e9717f1fa2a3 req-26887208-4417-4e6b-9e87-4462cbc149b8 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:42.457764 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aed5533c-1054-47eb-bf71-e9717f1fa2a3 req-26887208-4417-4e6b-9e87-4462cbc149b8 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=770cd4f6-d7e5-43f3-9b0c-380cc9271551 HTTP/1.1" status: 200 len: 946 time: 0.0806673 Dec 09 21:50:42.539248 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aed5533c-1054-47eb-bf71-e9717f1fa2a3 req-c9a0cc71-5420-483e-a10a-0ae3769ea46d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=84678483-baf9-4a9e-ba44-4d435fde916e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0669856 Dec 09 21:50:43.672596 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ede7a35-b549-4e51-81ac-0bb03bc4d572 req-8e005275-ea23-463a-a17f-42f912b48a07 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:43.675111 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ede7a35-b549-4e51-81ac-0bb03bc4d572 req-8e005275-ea23-463a-a17f-42f912b48a07 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=770cd4f6-d7e5-43f3-9b0c-380cc9271551 HTTP/1.1" status: 200 len: 946 time: 0.0573447 Dec 09 21:50:43.747996 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ede7a35-b549-4e51-81ac-0bb03bc4d572 req-d0949ae9-929d-476b-b402-ea31f02fbe39 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=84678483-baf9-4a9e-ba44-4d435fde916e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0664485 Dec 09 21:50:43.865601 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ded5c84-d05f-43c5-a208-d9a1c914cd73 req-bf16ea10-38d5-4112-9215-559e58d41877 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:43.868162 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3ded5c84-d05f-43c5-a208-d9a1c914cd73 req-bf16ea10-38d5-4112-9215-559e58d41877 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=770cd4f6-d7e5-43f3-9b0c-380cc9271551 HTTP/1.1" status: 200 len: 946 time: 0.0528853 Dec 09 21:50:43.925190 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3ded5c84-d05f-43c5-a208-d9a1c914cd73 req-8a160132-3b6f-45da-89c1-d38eb17b763a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=84678483-baf9-4a9e-ba44-4d435fde916e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0505724 Dec 09 21:50:45.423122 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 50404) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:46.168141 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cba2c80b-6b4f-47d9-8741-d0bb179ff2f1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:46.640552 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-cba2c80b-6b4f-47d9-8741-d0bb179ff2f1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Allocated IP 172.20.0.17 (f481e34c-08b7-4b81-995d-857e3c7f684d/db260714-c8e4-49a8-961f-2d6c653a6d1a/f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:50:46.824489 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cba2c80b-6b4f-47d9-8741-d0bb179ff2f1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:46.876888 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cba2c80b-6b4f-47d9-8741-d0bb179ff2f1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:46.903467 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cba2c80b-6b4f-47d9-8741-d0bb179ff2f1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Network f481e34c-08b7-4b81-995d-857e3c7f684d is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:50:46.906478 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-cba2c80b-6b4f-47d9-8741-d0bb179ff2f1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:50:46.933920 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cba2c80b-6b4f-47d9-8741-d0bb179ff2f1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:50:47.071345 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cba2c80b-6b4f-47d9-8741-d0bb179ff2f1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'Port': ['ID=f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:47.089552 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cba2c80b-6b4f-47d9-8741-d0bb179ff2f1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:47.322682 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f8480237-3ff8-4c26-ab0c-e6d1d464eda5 None None] Provisioning complete for port f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:47.323725 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f8480237-3ff8-4c26-ab0c-e6d1d464eda5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:47.393800 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f8480237-3ff8-4c26-ab0c-e6d1d464eda5 None None] Port f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:50:47.397051 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cba2c80b-6b4f-47d9-8741-d0bb179ff2f1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:47.900763 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cba2c80b-6b4f-47d9-8741-d0bb179ff2f1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:47.908943 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cba2c80b-6b4f-47d9-8741-d0bb179ff2f1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:47.980006 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cba2c80b-6b4f-47d9-8741-d0bb179ff2f1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:48.000606 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cba2c80b-6b4f-47d9-8741-d0bb179ff2f1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'Port': ['ID=f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:48.146979 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cba2c80b-6b4f-47d9-8741-d0bb179ff2f1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Network f481e34c-08b7-4b81-995d-857e3c7f684d is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:50:48.148435 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-cba2c80b-6b4f-47d9-8741-d0bb179ff2f1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:50:48.341437 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cba2c80b-6b4f-47d9-8741-d0bb179ff2f1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:50:48.482903 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-e3237769-de5a-4d17-b4a5-2a4a2971933e req-02b2c442-b216-4b25-83d9-f12034106b66 service neutron] (103438) timed out ('10.222.0.13', 51754) {{(pid=103438) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 09 21:50:48.676484 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d2186258-280d-4c2b-9559-959618759f75 None None] Provisioning complete for port f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:48.677571 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d2186258-280d-4c2b-9559-959618759f75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:48.720242 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d2186258-280d-4c2b-9559-959618759f75 None None] Port f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:50:48.947966 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cba2c80b-6b4f-47d9-8741-d0bb179ff2f1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:50:48.957675 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cba2c80b-6b4f-47d9-8741-d0bb179ff2f1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "PUT /v2.0/routers/6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.5333769 Dec 09 21:50:48.967235 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] Sync routers for ids ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:50:48.991723 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] Routers {'6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:50:48.994109 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:50:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:50:49.157875 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] Set router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:50:49.578863 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'name': 'tempest-TestNetworkBasicOps-router-792281405', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36'}], 'enable_snat': True}, 'gw_port_id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:50:47Z', 'revision_number': 5, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:2c:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3592, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '4eb9c6ee-8df6-4019-8824-be233593b289', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'floating_ip_address': '172.25.3.251', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'port_id': '7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 3637, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'mac_address': 'fa:16:3e:10:cf:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:49:51Z', 'updated_at': '2021-12-09T21:49:56Z', 'revision_number': 1, 'project_id': 'e863bf78256945798e7c717c650258aa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'efd747c8-9308-4be4-8445-86a9ce208bf3', 'name': '', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:c1:e4:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:27Z', 'updated_at': '2021-12-09T21:49:33Z', 'revision_number': 5, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f', 'name': '', 'network_id': 'f481e34c-08b7-4b81-995d-857e3c7f684d', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:c5:e7:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3744, 'fixed_ips': [{'subnet_id': 'db260714-c8e4-49a8-961f-2d6c653a6d1a', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:50:46Z', 'updated_at': '2021-12-09T21:50:47Z', 'revision_number': 2, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': 'db260714-c8e4-49a8-961f-2d6c653a6d1a', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:50:49.608992 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] Checking router: 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:50:49.609499 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] Updating router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b port f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:50:49.639561 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:50.110833 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:50.121027 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:50.180617 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fe7753b-9a18-4fe9-8644-fe7c0b16ec93 None None] Pushing event updated for resources: {'Port': ['ID=f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:50.254420 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] Attempting to bind port f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:50:50.255061 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] Attempting to bind port f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'efd94242-a7b2-491d-b555-cf8b471e00ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'f481e34c-08b7-4b81-995d-857e3c7f684d'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:50:50.255828 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] Attempting to bind port f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f on network f481e34c-08b7-4b81-995d-857e3c7f684d {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:50:50.265877 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 50, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:50:50.266570 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] Checking segment: {'id': 'efd94242-a7b2-491d-b555-cf8b471e00ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'f481e34c-08b7-4b81-995d-857e3c7f684d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:50:50.267120 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:50.267756 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] Bound using segment: {'id': 'efd94242-a7b2-491d-b555-cf8b471e00ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'f481e34c-08b7-4b81-995d-857e3c7f684d'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:50:50.268426 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] Bound port: f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'efd94242-a7b2-491d-b555-cf8b471e00ae', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': 'f481e34c-08b7-4b81-995d-857e3c7f684d'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:50:50.269015 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:50.424298 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] For port f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:50:50.438408 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] For port f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f,segment=NetworkSegment(efd94242-a7b2-491d-b555-cf8b471e00ae),segment_id=efd94242-a7b2-491d-b555-cf8b471e00ae)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:50:50.445207 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:50.534007 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] Routers {'6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:50:50.534706 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:50:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:50:50.627407 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fe7753b-9a18-4fe9-8644-fe7c0b16ec93 None None] Pushing event updated for resources: {'Port': ['ID=f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:50.696275 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4ada7a13-78fb-4641-9562-e9333e43c288 None None] Provisioning complete for port f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:50.701450 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4ada7a13-78fb-4641-9562-e9333e43c288 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:50.730708 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] Set router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:50:50.904306 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4ada7a13-78fb-4641-9562-e9333e43c288 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:50.939735 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-4ada7a13-78fb-4641-9562-e9333e43c288 None None] For port f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f,segment=NetworkSegment(efd94242-a7b2-491d-b555-cf8b471e00ae),segment_id=efd94242-a7b2-491d-b555-cf8b471e00ae)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:50:50.947741 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4ada7a13-78fb-4641-9562-e9333e43c288 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:51.055196 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ada7a13-78fb-4641-9562-e9333e43c288 None None] Pushing event updated for resources: {'Port': ['ID=f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:51.064514 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ada7a13-78fb-4641-9562-e9333e43c288 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:51.064874 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ada7a13-78fb-4641-9562-e9333e43c288 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:51.065221 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ada7a13-78fb-4641-9562-e9333e43c288 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:51.065562 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ada7a13-78fb-4641-9562-e9333e43c288 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:51.065908 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ada7a13-78fb-4641-9562-e9333e43c288 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:51.066239 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ada7a13-78fb-4641-9562-e9333e43c288 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:51.066573 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ada7a13-78fb-4641-9562-e9333e43c288 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:51.066905 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ada7a13-78fb-4641-9562-e9333e43c288 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:51.067270 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ada7a13-78fb-4641-9562-e9333e43c288 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:51.067637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ada7a13-78fb-4641-9562-e9333e43c288 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:51.067972 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ada7a13-78fb-4641-9562-e9333e43c288 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:51.068377 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ada7a13-78fb-4641-9562-e9333e43c288 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:51.068643 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4ada7a13-78fb-4641-9562-e9333e43c288 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:50:51.102675 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ac5fbec3-5d96-40eb-b042-d0131fa20577 None None] Provisioning complete for port f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:51.103051 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ac5fbec3-5d96-40eb-b042-d0131fa20577 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:51.195357 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'name': 'tempest-TestNetworkBasicOps-router-792281405', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36'}], 'enable_snat': True}, 'gw_port_id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:50:47Z', 'revision_number': 5, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:2c:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3592, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '4eb9c6ee-8df6-4019-8824-be233593b289', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'floating_ip_address': '172.25.3.251', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'port_id': '7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 3637, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'mac_address': 'fa:16:3e:10:cf:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:49:51Z', 'updated_at': '2021-12-09T21:49:56Z', 'revision_number': 1, 'project_id': 'e863bf78256945798e7c717c650258aa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'efd747c8-9308-4be4-8445-86a9ce208bf3', 'name': '', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:c1:e4:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:27Z', 'updated_at': '2021-12-09T21:49:33Z', 'revision_number': 5, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f', 'name': '', 'network_id': 'f481e34c-08b7-4b81-995d-857e3c7f684d', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:c5:e7:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3744, 'fixed_ips': [{'subnet_id': 'db260714-c8e4-49a8-961f-2d6c653a6d1a', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:50:46Z', 'updated_at': '2021-12-09T21:50:50Z', 'revision_number': 4, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': 'db260714-c8e4-49a8-961f-2d6c653a6d1a', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:50:51.228401 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59d1ec3b-0860-4f04-98d5-ae3e4759ba59 None None] The sync data for ids ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'] in n-d-713301-27 is: [{'id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'name': 'tempest-TestNetworkBasicOps-router-792281405', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36'}], 'enable_snat': True}, 'gw_port_id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:50:47Z', 'revision_number': 5, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:2c:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3592, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '4eb9c6ee-8df6-4019-8824-be233593b289', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'floating_ip_address': '172.25.3.251', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'port_id': '7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 3637, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'mac_address': 'fa:16:3e:10:cf:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:49:51Z', 'updated_at': '2021-12-09T21:49:56Z', 'revision_number': 1, 'project_id': 'e863bf78256945798e7c717c650258aa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'efd747c8-9308-4be4-8445-86a9ce208bf3', 'name': '', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:c1:e4:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:27Z', 'updated_at': '2021-12-09T21:49:33Z', 'revision_number': 5, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, {'id': 'f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f', 'name': '', 'network_id': 'f481e34c-08b7-4b81-995d-857e3c7f684d', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:c5:e7:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3744, 'fixed_ips': [{'subnet_id': 'db260714-c8e4-49a8-961f-2d6c653a6d1a', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:50:46Z', 'updated_at': '2021-12-09T21:50:50Z', 'revision_number': 4, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': 'db260714-c8e4-49a8-961f-2d6c653a6d1a', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:50:51.967005 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:50:52.051947 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:52.052413 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:54.058375 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74192fcd-8881-4653-b262-362a27e9e4e5 req-b765190f-f221-453c-82be-2c1724e5419a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:54.067536 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-74192fcd-8881-4653-b262-362a27e9e4e5 req-b765190f-f221-453c-82be-2c1724e5419a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 945 time: 0.0727935 Dec 09 21:50:54.133785 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-74192fcd-8881-4653-b262-362a27e9e4e5 req-a3cc5616-9483-4c20-bffc-3a0b15f8ad2b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=804c3895-61f7-4cc1-b0c5-503b9ff5fa56&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0650122 Dec 09 21:50:54.152767 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 50578) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:50:54.239387 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8b5cb549-5b75-4e09-8483-65cc12c604b1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/floatingips/fb13a433-742b-49fd-a148-4074584186de HTTP/1.1" status: 200 len: 993 time: 0.0825675 Dec 09 21:50:54.686310 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3e263f7-4354-41e1-babe-79ab2a8b7b96 req-c5419ced-c59f-4230-9e72-b2550de0f864 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:54.694120 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b3e263f7-4354-41e1-babe-79ab2a8b7b96 req-c5419ced-c59f-4230-9e72-b2550de0f864 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 1097 time: 0.0954258 Dec 09 21:50:54.772106 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b3e263f7-4354-41e1-babe-79ab2a8b7b96 req-74a976fe-65d5-4cbd-b15b-0d4aee5c4217 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=804c3895-61f7-4cc1-b0c5-503b9ff5fa56&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0767331 Dec 09 21:50:55.621150 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-aef451d5-bc80-419e-a6fd-13af2e3dfbce service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1064479 Dec 09 21:50:55.628765 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-c888bf5e-9be9-41a8-b25c-599aa13db392 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:50:55.637994 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-c888bf5e-9be9-41a8-b25c-599aa13db392 service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0113389 Dec 09 21:50:56.459144 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-cefd99f2-1fff-4647-9c13-b1b9ce4b2204 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:56.464737 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-cefd99f2-1fff-4647-9c13-b1b9ce4b2204 service neutron] 10.222.0.13 "GET /v2.0/ports/e8a40d5d-aaf2-43a0-a210-7e4f0815b848 HTTP/1.1" status: 200 len: 1094 time: 0.0490661 Dec 09 21:50:56.488402 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-347cb1d7-64ea-4d52-80be-066be240fa9e service neutron] Request body: {'binding': {'host': 'n-h2-713301-27', 'vnic_type': 'normal', 'profile': {}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:50:56.489058 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-347cb1d7-64ea-4d52-80be-066be240fa9e service neutron] Unknown quota resources ['binding']. {{(pid=103437) _create /opt/stack/neutron/neutron/api/v2/base.py:496}} Dec 09 21:50:56.705916 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-347cb1d7-64ea-4d52-80be-066be240fa9e service neutron] Attempting to bind port e8a40d5d-aaf2-43a0-a210-7e4f0815b848 on host n-h2-713301-27 for vnic_type normal with profile None {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:50:56.705916 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-347cb1d7-64ea-4d52-80be-066be240fa9e service neutron] Attempting to bind port e8a40d5d-aaf2-43a0-a210-7e4f0815b848 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'bb2623a0-5941-46ea-9e2a-adfecf120d3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:50:56.707319 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-347cb1d7-64ea-4d52-80be-066be240fa9e service neutron] Attempting to bind port e8a40d5d-aaf2-43a0-a210-7e4f0815b848 on network 69e4f0dc-5303-45fd-9842-f33d6a22b48d {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:50:56.726339 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-347cb1d7-64ea-4d52-80be-066be240fa9e service neutron] Port e8a40d5d-aaf2-43a0-a210-7e4f0815b848 on network 69e4f0dc-5303-45fd-9842-f33d6a22b48d not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:50:56.727162 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-347cb1d7-64ea-4d52-80be-066be240fa9e service neutron] Attempting to bind port e8a40d5d-aaf2-43a0-a210-7e4f0815b848 on network 69e4f0dc-5303-45fd-9842-f33d6a22b48d {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:50:56.734022 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-347cb1d7-64ea-4d52-80be-066be240fa9e service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 50, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:50:56.736018 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-347cb1d7-64ea-4d52-80be-066be240fa9e service neutron] Checking segment: {'id': 'bb2623a0-5941-46ea-9e2a-adfecf120d3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:50:56.738279 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-347cb1d7-64ea-4d52-80be-066be240fa9e service neutron] Bound using segment: {'id': 'bb2623a0-5941-46ea-9e2a-adfecf120d3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:50:56.738826 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-347cb1d7-64ea-4d52-80be-066be240fa9e service neutron] Bound port: e8a40d5d-aaf2-43a0-a210-7e4f0815b848, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bb2623a0-5941-46ea-9e2a-adfecf120d3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:50:56.965990 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-347cb1d7-64ea-4d52-80be-066be240fa9e service neutron] For port e8a40d5d-aaf2-43a0-a210-7e4f0815b848, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e8a40d5d-aaf2-43a0-a210-7e4f0815b848,segment=NetworkSegment(bb2623a0-5941-46ea-9e2a-adfecf120d3a),segment_id=bb2623a0-5941-46ea-9e2a-adfecf120d3a)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:50:56.974367 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-347cb1d7-64ea-4d52-80be-066be240fa9e service neutron] Publish callbacks [] for binding, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:56.978889 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-347cb1d7-64ea-4d52-80be-066be240fa9e service neutron] 10.222.0.13 "POST /v2.0/ports/e8a40d5d-aaf2-43a0-a210-7e4f0815b848/bindings HTTP/1.1" status: 201 len: 390 time: 0.5123906 Dec 09 21:50:57.318150 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9afc0fd5-70c6-414f-8dba-97f2ce8dca98 req-2c48531b-c5ec-416e-89f4-b511c0a39124 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:57.325910 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9afc0fd5-70c6-414f-8dba-97f2ce8dca98 req-2c48531b-c5ec-416e-89f4-b511c0a39124 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 945 time: 0.1488564 Dec 09 21:50:57.341077 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:57.347029 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-ff83f4a1-e12f-48ed-b8df-4ab9c3582b00 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:57.349190 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-ff83f4a1-e12f-48ed-b8df-4ab9c3582b00 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 1097 time: 0.0949898 Dec 09 21:50:57.453159 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9afc0fd5-70c6-414f-8dba-97f2ce8dca98 req-57ab0216-2acd-401e-926c-336ea062a88e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=804c3895-61f7-4cc1-b0c5-503b9ff5fa56&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1263599 Dec 09 21:50:57.473965 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-3f190a48-bc16-4d8b-99bf-dbf8ef9b0930 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:57.476017 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-3f190a48-bc16-4d8b-99bf-dbf8ef9b0930 service neutron] 10.222.0.10 "GET /v2.0/networks?id=69e4f0dc-5303-45fd-9842-f33d6a22b48d HTTP/1.1" status: 200 len: 897 time: 0.0954528 Dec 09 21:50:57.555015 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-8275db9c-4295-49d8-b336-5c116ee1048b service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e8a40d5d-aaf2-43a0-a210-7e4f0815b848 HTTP/1.1" status: 200 len: 1001 time: 0.0697954 Dec 09 21:50:57.555215 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:57.619453 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-a544e2c9-6d27-4afd-8fb0-19a9289fd09d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:57.621446 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-a544e2c9-6d27-4afd-8fb0-19a9289fd09d service neutron] 10.222.0.10 "GET /v2.0/subnets?id=1317305d-5040-4a27-9e95-c846c3faa444 HTTP/1.1" status: 200 len: 835 time: 0.0589905 Dec 09 21:50:57.693845 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-5289efe5-a7b0-4731-b83c-ef8860997439 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:57.697286 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-5289efe5-a7b0-4731-b83c-ef8860997439 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=69e4f0dc-5303-45fd-9842-f33d6a22b48d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0694487 Dec 09 21:50:57.835829 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-4ae0396d-1a43-4dd2-97fb-77f140102218 service neutron] 10.222.0.10 "GET /v2.0/networks/69e4f0dc-5303-45fd-9842-f33d6a22b48d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1311805 Dec 09 21:50:58.009113 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-8dac459f-1c3c-44c8-aa58-727fa110a039 service neutron] 10.222.0.10 "GET /v2.0/networks/69e4f0dc-5303-45fd-9842-f33d6a22b48d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1646969 Dec 09 21:50:58.184760 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-99983f7b-7f5b-422f-8399-beec5360c6d9 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:58.186558 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-99983f7b-7f5b-422f-8399-beec5360c6d9 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.10 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7&tenant_id=dce7594ac2a74901912a2f19de04bf79&binding%3Ahost_id=n-h1-713301-27 HTTP/1.1" status: 200 len: 1097 time: 0.1200986 Dec 09 21:50:58.209384 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-592e3b1d-874b-4d18-982b-05affc770179 service neutron] Request body: {'port': {'binding:profile': {'migrating_to': 'n-h2-713301-27'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:50:58.300247 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-592e3b1d-874b-4d18-982b-05affc770179 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:58.510956 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-592e3b1d-874b-4d18-982b-05affc770179 service neutron] For port e8a40d5d-aaf2-43a0-a210-7e4f0815b848, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e8a40d5d-aaf2-43a0-a210-7e4f0815b848,segment=NetworkSegment(bb2623a0-5941-46ea-9e2a-adfecf120d3a),segment_id=bb2623a0-5941-46ea-9e2a-adfecf120d3a)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:50:58.576399 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-592e3b1d-874b-4d18-982b-05affc770179 service neutron] For port e8a40d5d-aaf2-43a0-a210-7e4f0815b848, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:50:58.640489 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7c3630e-6905-4f03-b28b-5c743beb8cd9 req-f365a970-9deb-4fee-830a-165c24ded216 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:58.642056 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a7c3630e-6905-4f03-b28b-5c743beb8cd9 req-f365a970-9deb-4fee-830a-165c24ded216 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 945 time: 0.0972080 Dec 09 21:50:58.645277 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0f427011-3cff-493d-b6c5-8f2919ce99f7', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e8a40d5d-aaf2-43a0-a210-7e4f0815b848'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:50:58.647564 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bd822470-1ec0-46f3-a0f7-21eae6ea5b4d" -d '{"events": [{"server_uuid": "0f427011-3cff-493d-b6c5-8f2919ce99f7", "name": "network-vif-unplugged", "status": "completed", "tag": "e8a40d5d-aaf2-43a0-a210-7e4f0815b848"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:50:58.651926 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-592e3b1d-874b-4d18-982b-05affc770179 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:58.662413 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-592e3b1d-874b-4d18-982b-05affc770179 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:58.758272 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a7c3630e-6905-4f03-b28b-5c743beb8cd9 req-2e2b9fef-66d1-4674-a34b-bbbfb96d2c81 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=804c3895-61f7-4cc1-b0c5-503b9ff5fa56&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1040990 Dec 09 21:50:58.806724 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-592e3b1d-874b-4d18-982b-05affc770179 service neutron] Pushing event updated for resources: {'Port': ['ID=e8a40d5d-aaf2-43a0-a210-7e4f0815b848,revision_number=7']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:58.867109 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:50:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-97e3cb2a-ff8f-453e-ae9c-a19409fb5ba0 x-openstack-request-id: req-97e3cb2a-ff8f-453e-ae9c-a19409fb5ba0 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:50:58.867425 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0f427011-3cff-493d-b6c5-8f2919ce99f7", "name": "network-vif-unplugged", "status": "completed", "tag": "e8a40d5d-aaf2-43a0-a210-7e4f0815b848", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:50:58.867684 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-97e3cb2a-ff8f-453e-ae9c-a19409fb5ba0 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:50:58.868101 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0f427011-3cff-493d-b6c5-8f2919ce99f7', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e8a40d5d-aaf2-43a0-a210-7e4f0815b848', 'code': 200} Dec 09 21:50:58.882639 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-592e3b1d-874b-4d18-982b-05affc770179 service neutron] Attempting to bind port e8a40d5d-aaf2-43a0-a210-7e4f0815b848 on host n-h1-713301-27 for vnic_type normal with profile {"migrating_to": "n-h2-713301-27"} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:50:58.882944 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-592e3b1d-874b-4d18-982b-05affc770179 service neutron] Attempting to bind port e8a40d5d-aaf2-43a0-a210-7e4f0815b848 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'bb2623a0-5941-46ea-9e2a-adfecf120d3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:50:58.883207 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-592e3b1d-874b-4d18-982b-05affc770179 service neutron] Attempting to bind port e8a40d5d-aaf2-43a0-a210-7e4f0815b848 on network 69e4f0dc-5303-45fd-9842-f33d6a22b48d {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:50:58.888164 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-592e3b1d-874b-4d18-982b-05affc770179 service neutron] Port e8a40d5d-aaf2-43a0-a210-7e4f0815b848 on network 69e4f0dc-5303-45fd-9842-f33d6a22b48d not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:50:58.888480 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-592e3b1d-874b-4d18-982b-05affc770179 service neutron] Attempting to bind port e8a40d5d-aaf2-43a0-a210-7e4f0815b848 on network 69e4f0dc-5303-45fd-9842-f33d6a22b48d {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:50:58.893738 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-592e3b1d-874b-4d18-982b-05affc770179 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 50, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:50:58.894210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-592e3b1d-874b-4d18-982b-05affc770179 service neutron] Checking segment: {'id': 'bb2623a0-5941-46ea-9e2a-adfecf120d3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:50:58.894593 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-592e3b1d-874b-4d18-982b-05affc770179 service neutron] Bound using segment: {'id': 'bb2623a0-5941-46ea-9e2a-adfecf120d3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:50:58.895046 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-592e3b1d-874b-4d18-982b-05affc770179 service neutron] Bound port: e8a40d5d-aaf2-43a0-a210-7e4f0815b848, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bb2623a0-5941-46ea-9e2a-adfecf120d3a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 104, 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:50:58.895403 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-592e3b1d-874b-4d18-982b-05affc770179 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:58.982316 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-592e3b1d-874b-4d18-982b-05affc770179 service neutron] For port e8a40d5d-aaf2-43a0-a210-7e4f0815b848, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:50:58.985580 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-592e3b1d-874b-4d18-982b-05affc770179 service neutron] For port e8a40d5d-aaf2-43a0-a210-7e4f0815b848, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e8a40d5d-aaf2-43a0-a210-7e4f0815b848,segment=NetworkSegment(bb2623a0-5941-46ea-9e2a-adfecf120d3a),segment_id=bb2623a0-5941-46ea-9e2a-adfecf120d3a)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:50:58.992976 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-592e3b1d-874b-4d18-982b-05affc770179 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:59.068671 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-99484683-63fc-4622-be63-2469c9e15d8c None None] Provisioning complete for port e8a40d5d-aaf2-43a0-a210-7e4f0815b848 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:59.070242 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-99484683-63fc-4622-be63-2469c9e15d8c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:59.086397 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-592e3b1d-874b-4d18-982b-05affc770179 service neutron] Pushing event updated for resources: {'Port': ['ID=e8a40d5d-aaf2-43a0-a210-7e4f0815b848,revision_number=8']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:59.229646 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-99484683-63fc-4622-be63-2469c9e15d8c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:59.272228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-99484683-63fc-4622-be63-2469c9e15d8c None None] For port e8a40d5d-aaf2-43a0-a210-7e4f0815b848, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e8a40d5d-aaf2-43a0-a210-7e4f0815b848,segment=NetworkSegment(bb2623a0-5941-46ea-9e2a-adfecf120d3a),segment_id=bb2623a0-5941-46ea-9e2a-adfecf120d3a)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:50:59.274648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0f427011-3cff-493d-b6c5-8f2919ce99f7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e8a40d5d-aaf2-43a0-a210-7e4f0815b848'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:50:59.285695 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c5a3de1b-5442-4c67-b166-7c0f65233903" -d '{"events": [{"server_uuid": "0f427011-3cff-493d-b6c5-8f2919ce99f7", "name": "network-vif-plugged", "status": "completed", "tag": "e8a40d5d-aaf2-43a0-a210-7e4f0815b848"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:50:59.289964 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-99484683-63fc-4622-be63-2469c9e15d8c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:59.359092 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:50:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a3474e2e-148c-4f17-bf45-dc8fc7f44535 x-openstack-request-id: req-a3474e2e-148c-4f17-bf45-dc8fc7f44535 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:50:59.359530 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0f427011-3cff-493d-b6c5-8f2919ce99f7", "name": "network-vif-plugged", "status": "completed", "tag": "e8a40d5d-aaf2-43a0-a210-7e4f0815b848", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:50:59.359877 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a3474e2e-148c-4f17-bf45-dc8fc7f44535 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:50:59.360515 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0f427011-3cff-493d-b6c5-8f2919ce99f7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e8a40d5d-aaf2-43a0-a210-7e4f0815b848', 'code': 200} Dec 09 21:50:59.362948 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99484683-63fc-4622-be63-2469c9e15d8c None None] Pushing event updated for resources: {'Port': ['ID=e8a40d5d-aaf2-43a0-a210-7e4f0815b848,revision_number=9']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:50:59.633458 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-68189deb-3e33-470d-8f09-5420a01d7b46 None None] Provisioning complete for port e8a40d5d-aaf2-43a0-a210-7e4f0815b848 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:50:59.633892 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-68189deb-3e33-470d-8f09-5420a01d7b46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:59.652523 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-592e3b1d-874b-4d18-982b-05affc770179 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:59.653209 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-592e3b1d-874b-4d18-982b-05affc770179 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:50:59.654729 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-592e3b1d-874b-4d18-982b-05affc770179 service neutron] 10.222.0.10 "PUT /v2.0/ports/e8a40d5d-aaf2-43a0-a210-7e4f0815b848 HTTP/1.1" status: 200 len: 1123 time: 1.4591744 Dec 09 21:50:59.732763 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['e8a40d5d-aaf2-43a0-a210-7e4f0815b848'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:50:59.946879 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc97aca6-00b6-498b-b4a6-ebe72cb3e48e req-b86e2faf-2077-4e94-b359-4c358d481574 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:50:59.950064 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc97aca6-00b6-498b-b4a6-ebe72cb3e48e req-b86e2faf-2077-4e94-b359-4c358d481574 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 945 time: 0.0706971 Dec 09 21:51:00.071406 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc97aca6-00b6-498b-b4a6-ebe72cb3e48e req-2e270735-6799-44d5-b81a-4ea86e53d085 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=804c3895-61f7-4cc1-b0c5-503b9ff5fa56&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1149139 Dec 09 21:51:00.869385 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0f427011-3cff-493d-b6c5-8f2919ce99f7', 'tag': 'e8a40d5d-aaf2-43a0-a210-7e4f0815b848'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:51:00.873677 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d88c956d-d62c-4ca5-b0b8-9fb54912083d" -d '{"events": [{"name": "network-changed", "server_uuid": "0f427011-3cff-493d-b6c5-8f2919ce99f7", "tag": "e8a40d5d-aaf2-43a0-a210-7e4f0815b848"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:51:00.926356 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:51:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8cb36cc8-e1ef-4fba-8bb7-88933228b5e2 x-openstack-request-id: req-8cb36cc8-e1ef-4fba-8bb7-88933228b5e2 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:51:00.926766 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0f427011-3cff-493d-b6c5-8f2919ce99f7", "tag": "e8a40d5d-aaf2-43a0-a210-7e4f0815b848", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:51:00.927078 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8cb36cc8-e1ef-4fba-8bb7-88933228b5e2 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:51:00.927431 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0f427011-3cff-493d-b6c5-8f2919ce99f7', 'tag': 'e8a40d5d-aaf2-43a0-a210-7e4f0815b848', 'status': 'completed', 'code': 200} Dec 09 21:51:00.993282 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d88c956d-d62c-4ca5-b0b8-9fb54912083d req-32d30c28-9032-4e62-ae21-6443878b22a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:00.994855 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d88c956d-d62c-4ca5-b0b8-9fb54912083d req-32d30c28-9032-4e62-ae21-6443878b22a3 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 1128 time: 0.0484393 Dec 09 21:51:01.110697 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d88c956d-d62c-4ca5-b0b8-9fb54912083d req-b7efab63-254f-4276-a98a-43eaff876aa5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:01.112326 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d88c956d-d62c-4ca5-b0b8-9fb54912083d req-b7efab63-254f-4276-a98a-43eaff876aa5 service neutron] 10.222.0.31 "GET /v2.0/networks?id=69e4f0dc-5303-45fd-9842-f33d6a22b48d HTTP/1.1" status: 200 len: 897 time: 0.1100163 Dec 09 21:51:01.210892 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d88c956d-d62c-4ca5-b0b8-9fb54912083d req-7731e9ea-0289-43de-a430-83d308f1da1b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e8a40d5d-aaf2-43a0-a210-7e4f0815b848 HTTP/1.1" status: 200 len: 1001 time: 0.0899775 Dec 09 21:51:01.244956 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-715c7061-9785-4032-b35d-f8aa80492b0c req-634c8954-24db-459b-bb6a-95e3d238d8fc tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:01.247105 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-715c7061-9785-4032-b35d-f8aa80492b0c req-634c8954-24db-459b-bb6a-95e3d238d8fc tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 945 time: 0.0807068 Dec 09 21:51:01.282546 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d88c956d-d62c-4ca5-b0b8-9fb54912083d req-7922469f-dc5c-4fd9-b804-1d16327be2cf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:01.299586 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d88c956d-d62c-4ca5-b0b8-9fb54912083d req-7922469f-dc5c-4fd9-b804-1d16327be2cf service neutron] 10.222.0.31 "GET /v2.0/subnets?id=1317305d-5040-4a27-9e95-c846c3faa444 HTTP/1.1" status: 200 len: 835 time: 0.0815635 Dec 09 21:51:01.378826 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-715c7061-9785-4032-b35d-f8aa80492b0c req-7ac04ffb-17ca-42d5-b794-82f1ba989af2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=804c3895-61f7-4cc1-b0c5-503b9ff5fa56&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1156988 Dec 09 21:51:01.412720 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d88c956d-d62c-4ca5-b0b8-9fb54912083d req-1dd4d840-5d8b-496a-8d12-91745e711731 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:01.414246 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d88c956d-d62c-4ca5-b0b8-9fb54912083d req-1dd4d840-5d8b-496a-8d12-91745e711731 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=69e4f0dc-5303-45fd-9842-f33d6a22b48d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1067843 Dec 09 21:51:01.524317 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d88c956d-d62c-4ca5-b0b8-9fb54912083d req-42c02edd-d59d-4931-8bef-b707d11ef1bd service neutron] 10.222.0.31 "GET /v2.0/networks/69e4f0dc-5303-45fd-9842-f33d6a22b48d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0982242 Dec 09 21:51:01.646560 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d88c956d-d62c-4ca5-b0b8-9fb54912083d req-e7d11809-2ed3-4d09-a357-613c9def6b3e service neutron] 10.222.0.31 "GET /v2.0/networks/69e4f0dc-5303-45fd-9842-f33d6a22b48d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1145046 Dec 09 21:51:02.526884 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecabfe8a-3da7-46d0-9e29-f4d6388734ab req-1c0e4d37-ed95-4f31-83f0-606b06e48795 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:02.528420 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ecabfe8a-3da7-46d0-9e29-f4d6388734ab req-1c0e4d37-ed95-4f31-83f0-606b06e48795 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 945 time: 0.0626762 Dec 09 21:51:02.595699 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ecabfe8a-3da7-46d0-9e29-f4d6388734ab req-22b54f1a-55f1-48fd-b62e-81e80e80aa83 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=804c3895-61f7-4cc1-b0c5-503b9ff5fa56&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0609324 Dec 09 21:51:02.988894 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e28c48e1-3545-45b4-87c0-09f46deafdf9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:03.310359 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e8a40d5d-aaf2-43a0-a210-7e4f0815b848 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:51:03.650741 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port e8a40d5d-aaf2-43a0-a210-7e4f0815b848, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e8a40d5d-aaf2-43a0-a210-7e4f0815b848,segment=NetworkSegment(bb2623a0-5941-46ea-9e2a-adfecf120d3a),segment_id=bb2623a0-5941-46ea-9e2a-adfecf120d3a)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:03.664244 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e8a40d5d-aaf2-43a0-a210-7e4f0815b848 has no active binding in host n-h2-713301-27 {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:158}} Dec 09 21:51:03.749900 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d9088aa-13fa-4cac-9296-99c583a1bfc8 req-11c63127-1779-4a6a-8785-bef0a4c99aff tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:03.752765 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1d9088aa-13fa-4cac-9296-99c583a1bfc8 req-11c63127-1779-4a6a-8785-bef0a4c99aff tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 945 time: 0.0589628 Dec 09 21:51:03.833077 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1d9088aa-13fa-4cac-9296-99c583a1bfc8 req-d221a4eb-2074-4526-99cf-307e3d2fd3e0 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=804c3895-61f7-4cc1-b0c5-503b9ff5fa56&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0742741 Dec 09 21:51:04.777387 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-97c5cae3-18ed-4bfd-b9d5-7b9bd51829cf service neutron] 10.222.0.31 "GET /v2.0/ports/e8a40d5d-aaf2-43a0-a210-7e4f0815b848/bindings/n-h2-713301-27 HTTP/1.1" status: 200 len: 385 time: 0.1124978 Dec 09 21:51:05.040422 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-485b1c9c-08e7-4b91-88df-17b4927e2183 req-6ed41813-1945-4308-a201-8728e1623c08 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:05.054572 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-485b1c9c-08e7-4b91-88df-17b4927e2183 req-6ed41813-1945-4308-a201-8728e1623c08 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 945 time: 0.1216128 Dec 09 21:51:05.143014 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-485b1c9c-08e7-4b91-88df-17b4927e2183 req-edb2c5b9-621b-4c79-9e79-469a2a1d9443 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=804c3895-61f7-4cc1-b0c5-503b9ff5fa56&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0862875 Dec 09 21:51:05.195327 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-7d388bd8-f525-489d-bee9-fb44cf896c04 service neutron] For port e8a40d5d-aaf2-43a0-a210-7e4f0815b848, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e8a40d5d-aaf2-43a0-a210-7e4f0815b848,segment=NetworkSegment(bb2623a0-5941-46ea-9e2a-adfecf120d3a),segment_id=bb2623a0-5941-46ea-9e2a-adfecf120d3a)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:05.218852 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-7d388bd8-f525-489d-bee9-fb44cf896c04 service neutron] For port e8a40d5d-aaf2-43a0-a210-7e4f0815b848, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:51:05.270370 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0f427011-3cff-493d-b6c5-8f2919ce99f7', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e8a40d5d-aaf2-43a0-a210-7e4f0815b848'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:51:05.272711 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cc327c8e-9b33-4c11-bbd3-09b716cf7af5" -d '{"events": [{"server_uuid": "0f427011-3cff-493d-b6c5-8f2919ce99f7", "name": "network-vif-unplugged", "status": "completed", "tag": "e8a40d5d-aaf2-43a0-a210-7e4f0815b848"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:51:05.280872 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-7d388bd8-f525-489d-bee9-fb44cf896c04 service neutron] For port e8a40d5d-aaf2-43a0-a210-7e4f0815b848, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e8a40d5d-aaf2-43a0-a210-7e4f0815b848,segment=NetworkSegment(bb2623a0-5941-46ea-9e2a-adfecf120d3a),segment_id=bb2623a0-5941-46ea-9e2a-adfecf120d3a)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:05.298559 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-7d388bd8-f525-489d-bee9-fb44cf896c04 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:05.315588 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 21:51:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c71d7361-2c24-450a-8f6d-eac6e0ac6c56 x-openstack-request-id: req-c71d7361-2c24-450a-8f6d-eac6e0ac6c56 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:51:05.316091 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0f427011-3cff-493d-b6c5-8f2919ce99f7", "name": "network-vif-unplugged", "status": "completed", "tag": "e8a40d5d-aaf2-43a0-a210-7e4f0815b848", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:51:05.316347 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c71d7361-2c24-450a-8f6d-eac6e0ac6c56 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:51:05.316914 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0f427011-3cff-493d-b6c5-8f2919ce99f7', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e8a40d5d-aaf2-43a0-a210-7e4f0815b848', 'code': 200} Dec 09 21:51:05.382281 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-7d388bd8-f525-489d-bee9-fb44cf896c04 service neutron] Transition to ACTIVE for port object e8a40d5d-aaf2-43a0-a210-7e4f0815b848 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:51:05.387094 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-7d388bd8-f525-489d-bee9-fb44cf896c04 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:05.524778 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d388bd8-f525-489d-bee9-fb44cf896c04 service neutron] Pushing event updated for resources: {'Port': ['ID=e8a40d5d-aaf2-43a0-a210-7e4f0815b848,revision_number=11']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:05.586802 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e7a8b85d-7439-4bd9-941f-ec4517250b4d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:05.603135 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-7d388bd8-f525-489d-bee9-fb44cf896c04 service neutron] No DVR routers for this DVR port e8a40d5d-aaf2-43a0-a210-7e4f0815b848 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:51:05.807745 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-7d388bd8-f525-489d-bee9-fb44cf896c04 service neutron] 10.222.0.31 "PUT /v2.0/ports/e8a40d5d-aaf2-43a0-a210-7e4f0815b848/bindings/n-h2-713301-27/activate HTTP/1.1" status: 200 len: 370 time: 1.0179160 Dec 09 21:51:05.942045 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-5dfd0cd2-4495-4874-b954-c5c29c179014 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:05.943818 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-5dfd0cd2-4495-4874-b954-c5c29c179014 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.10 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7&tenant_id=dce7594ac2a74901912a2f19de04bf79&binding%3Ahost_id=n-h1-713301-27 HTTP/1.1" status: 200 len: 1096 time: 0.0543978 Dec 09 21:51:06.014931 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-512d3d87-09ec-43ec-b30e-6fce5f29c527 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:06.016851 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-512d3d87-09ec-43ec-b30e-6fce5f29c527 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7&tenant_id=dce7594ac2a74901912a2f19de04bf79 HTTP/1.1" status: 200 len: 1096 time: 0.0647376 Dec 09 21:51:06.090050 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-a9c091aa-67bd-4e43-a013-54624b32b780 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:06.091619 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-a9c091aa-67bd-4e43-a013-54624b32b780 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 1096 time: 0.0455608 Dec 09 21:51:06.211110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-95817530-a193-49ae-a104-c2eb956bb988 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:06.212661 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-95817530-a193-49ae-a104-c2eb956bb988 service neutron] 10.222.0.10 "GET /v2.0/networks?id=69e4f0dc-5303-45fd-9842-f33d6a22b48d HTTP/1.1" status: 200 len: 897 time: 0.1139228 Dec 09 21:51:06.326883 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-432c11c3-48ff-4e27-9962-f6535319eaa0 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e8a40d5d-aaf2-43a0-a210-7e4f0815b848 HTTP/1.1" status: 200 len: 999 time: 0.1063805 Dec 09 21:51:06.339705 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0be7f31-3a36-4355-8ca5-2196beeb656b req-f18af58d-ae36-42c8-a82b-9bbc8e1da384 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:06.341234 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0be7f31-3a36-4355-8ca5-2196beeb656b req-f18af58d-ae36-42c8-a82b-9bbc8e1da384 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 944 time: 0.1144361 Dec 09 21:51:06.394561 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-3d54c681-2d0a-441b-8593-ceba27b276aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:06.396827 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-3d54c681-2d0a-441b-8593-ceba27b276aa service neutron] 10.222.0.10 "GET /v2.0/subnets?id=1317305d-5040-4a27-9e95-c846c3faa444 HTTP/1.1" status: 200 len: 835 time: 0.0546618 Dec 09 21:51:06.484331 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0be7f31-3a36-4355-8ca5-2196beeb656b req-84f8c97a-c929-4ab5-bc5e-792af93241a8 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=804c3895-61f7-4cc1-b0c5-503b9ff5fa56&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1339121 Dec 09 21:51:06.487352 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-b9bed5cb-51e2-46ef-bf4c-0b6d333e2163 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:06.489010 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-b9bed5cb-51e2-46ef-bf4c-0b6d333e2163 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=69e4f0dc-5303-45fd-9842-f33d6a22b48d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0840311 Dec 09 21:51:06.603333 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-667936a4-75fd-440a-9844-4533197c00da service neutron] 10.222.0.10 "GET /v2.0/networks/69e4f0dc-5303-45fd-9842-f33d6a22b48d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1024911 Dec 09 21:51:06.683777 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:06.714795 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-d977bfc3-8276-4878-8a99-1944ea609bfc service neutron] 10.222.0.10 "GET /v2.0/networks/69e4f0dc-5303-45fd-9842-f33d6a22b48d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1043696 Dec 09 21:51:07.050066 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-5a2e056d-a767-4f5d-ac74-9c0fb491a572 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:07.052839 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-5a2e056d-a767-4f5d-ac74-9c0fb491a572 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.10 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7&tenant_id=dce7594ac2a74901912a2f19de04bf79&binding%3Ahost_id=n-h2-713301-27 HTTP/1.1" status: 200 len: 1096 time: 0.0887764 Dec 09 21:51:07.279242 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-fb6fe291-9016-4185-a73a-00a184c62245 service neutron] For port e8a40d5d-aaf2-43a0-a210-7e4f0815b848, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:51:07.287979 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-fb6fe291-9016-4185-a73a-00a184c62245 service neutron] Publish callbacks [] for binding, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:07.289566 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-fb6fe291-9016-4185-a73a-00a184c62245 service neutron] 10.222.0.10 "DELETE /v2.0/ports/e8a40d5d-aaf2-43a0-a210-7e4f0815b848/bindings/n-h1-713301-27 HTTP/1.1" status: 204 len: 173 time: 0.2287316 Dec 09 21:51:07.558146 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e8a40d5d-aaf2-43a0-a210-7e4f0815b848 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:51:07.652185 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e8a40d5d-aaf2-43a0-a210-7e4f0815b848 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:51:07.690701 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3164789f-faf0-49a2-a250-81c5e9d7fea5 req-74e612c3-529d-48b2-88f2-7a4894b8fd72 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:07.699910 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3164789f-faf0-49a2-a250-81c5e9d7fea5 req-74e612c3-529d-48b2-88f2-7a4894b8fd72 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 944 time: 0.1092350 Dec 09 21:51:07.784707 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3164789f-faf0-49a2-a250-81c5e9d7fea5 req-d7054305-751e-4a4f-9110-e05a5e20352e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=804c3895-61f7-4cc1-b0c5-503b9ff5fa56&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0789018 Dec 09 21:51:07.964347 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1c89569-91ac-44aa-89db-72254de4c3b0 req-2349f37a-756a-4c32-91ce-a3ab03683203 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:07.972985 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e1c89569-91ac-44aa-89db-72254de4c3b0 req-2349f37a-756a-4c32-91ce-a3ab03683203 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 1096 time: 0.0690660 Dec 09 21:51:08.023933 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:08.124381 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e1c89569-91ac-44aa-89db-72254de4c3b0 req-15051a7d-4abd-4f95-97ce-364727f749d4 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=804c3895-61f7-4cc1-b0c5-503b9ff5fa56&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1459882 Dec 09 21:51:08.349721 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecdbf074-ad26-4e1d-a158-da0e7fb9a53c req-e1a7cc88-506d-40f5-847f-a21746d27b60 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:08.357474 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ecdbf074-ad26-4e1d-a158-da0e7fb9a53c req-e1a7cc88-506d-40f5-847f-a21746d27b60 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 944 time: 0.1053140 Dec 09 21:51:08.415576 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ecdbf074-ad26-4e1d-a158-da0e7fb9a53c req-28252db8-2eae-4261-987d-fc5069988726 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=804c3895-61f7-4cc1-b0c5-503b9ff5fa56&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0566375 Dec 09 21:51:08.434915 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51006) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:08.573722 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a901a5eb-ad0b-477a-a291-94739daf4e6d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/floatingips/fb13a433-742b-49fd-a148-4074584186de HTTP/1.1" status: 200 len: 991 time: 0.1370461 Dec 09 21:51:09.112249 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:51:09.521893 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51028) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:09.659472 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:09.945977 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:10.356850 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Deleting port f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:51:10.357430 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:10.461746 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] For port f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f,segment=NetworkSegment(efd94242-a7b2-491d-b555-cf8b471e00ae),segment_id=efd94242-a7b2-491d-b555-cf8b471e00ae)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:10.462113 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:10.475425 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Calling delete_port for f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:51:10.753672 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:10.802643 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event deleted for resources: {'Port': ['ID=f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:10.830712 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:10.832008 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:10.833124 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:10.834003 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:10.834545 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:10.835063 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:10.835709 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:10.836208 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:10.836698 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:10.837209 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:10.837722 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:10.838212 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:10.838832 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:10.855629 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51056) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:11.101304 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:11.221678 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-485f7399-8110-42d2-908c-e54479df3e8a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Deleting port 8ec8a3ac-328e-41f4-b33e-3626691e3b45 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:51:11.224610 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-485f7399-8110-42d2-908c-e54479df3e8a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:11.332698 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-485f7399-8110-42d2-908c-e54479df3e8a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:11.333190 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-485f7399-8110-42d2-908c-e54479df3e8a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:11.354317 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-485f7399-8110-42d2-908c-e54479df3e8a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Calling delete_port for 8ec8a3ac-328e-41f4-b33e-3626691e3b45 owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:51:11.419932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:51:11.623897 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:51:11.636273 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fd1ab1a-364e-4f33-a77c-fd3593f4e106 None None] Sync routers for ids ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:51:11.641742 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-133b9ae1-126f-4bd2-a608-68b50ce3815d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "PUT /v2.0/routers/6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1162398 Dec 09 21:51:11.670921 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fd1ab1a-364e-4f33-a77c-fd3593f4e106 None None] Routers {'6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:51:11.674359 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5fd1ab1a-364e-4f33-a77c-fd3593f4e106 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:51:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:11.683166 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-485f7399-8110-42d2-908c-e54479df3e8a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:11.738770 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-485f7399-8110-42d2-908c-e54479df3e8a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'Port': ['ID=8ec8a3ac-328e-41f4-b33e-3626691e3b45,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:11.824937 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-485f7399-8110-42d2-908c-e54479df3e8a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:11.826761 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-485f7399-8110-42d2-908c-e54479df3e8a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Floating IP fb13a433-742b-49fd-a148-4074584186de disassociated (deleted). External IP: 172.25.3.175, port: e8a40d5d-aaf2-43a0-a210-7e4f0815b848. Dec 09 21:51:12.041274 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-5fd1ab1a-364e-4f33-a77c-fd3593f4e106 None None] Set router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:51:12.329411 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5fd1ab1a-364e-4f33-a77c-fd3593f4e106 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'name': 'tempest-TestNetworkBasicOps-router-792281405', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36'}], 'enable_snat': True}, 'gw_port_id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:51:10Z', 'revision_number': 6, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:2c:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3592, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '4eb9c6ee-8df6-4019-8824-be233593b289', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'floating_ip_address': '172.25.3.251', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'port_id': '7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 3637, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'mac_address': 'fa:16:3e:10:cf:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:49:51Z', 'updated_at': '2021-12-09T21:49:56Z', 'revision_number': 1, 'project_id': 'e863bf78256945798e7c717c650258aa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'efd747c8-9308-4be4-8445-86a9ce208bf3', 'name': '', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:c1:e4:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:27Z', 'updated_at': '2021-12-09T21:49:33Z', 'revision_number': 5, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:12.387487 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fd1ab1a-364e-4f33-a77c-fd3593f4e106 None None] Checking router: 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:51:12.393044 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-485f7399-8110-42d2-908c-e54479df3e8a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Router 115e1e9e-f059-4a58-90c3-f04312423cd9 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:51:12.398101 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5fd1ab1a-364e-4f33-a77c-fd3593f4e106 None None] Routers {'6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:51:12.399395 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5fd1ab1a-364e-4f33-a77c-fd3593f4e106 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:51:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:12.408885 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98cadf9c-6eeb-445b-8ebd-873f570424cf req-acb842b2-5aef-4fc6-8a27-3278ef194362 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:12.410783 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98cadf9c-6eeb-445b-8ebd-873f570424cf req-acb842b2-5aef-4fc6-8a27-3278ef194362 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=770cd4f6-d7e5-43f3-9b0c-380cc9271551 HTTP/1.1" status: 200 len: 946 time: 0.3398905 Dec 09 21:51:12.536488 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-5fd1ab1a-364e-4f33-a77c-fd3593f4e106 None None] Set router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:51:12.554272 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98cadf9c-6eeb-445b-8ebd-873f570424cf req-75a7b48a-2ff7-4076-baf3-7c3c8399e2c9 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=84678483-baf9-4a9e-ba44-4d435fde916e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0730698 Dec 09 21:51:12.627668 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-485f7399-8110-42d2-908c-e54479df3e8a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:51:12.633593 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-485f7399-8110-42d2-908c-e54479df3e8a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:12.641794 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abefd668-796b-4a2b-bbde-287ebec54f21 None None] Sync routers for ids ['115e1e9e-f059-4a58-90c3-f04312423cd9'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:51:12.663082 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-abefd668-796b-4a2b-bbde-287ebec54f21 None None] Routers {'115e1e9e-f059-4a58-90c3-f04312423cd9'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:51:12.664643 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-abefd668-796b-4a2b-bbde-287ebec54f21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:51:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['115e1e9e-f059-4a58-90c3-f04312423cd9'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:12.715958 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-485f7399-8110-42d2-908c-e54479df3e8a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "DELETE /v2.0/floatingips/fb13a433-742b-49fd-a148-4074584186de HTTP/1.1" status: 204 len: 168 time: 1.8586581 Dec 09 21:51:12.716968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0f427011-3cff-493d-b6c5-8f2919ce99f7', 'tag': 'e8a40d5d-aaf2-43a0-a210-7e4f0815b848'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:51:12.742879 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7349502c-b6ca-4da3-b679-7d9b368efabf" -d '{"events": [{"name": "network-changed", "server_uuid": "0f427011-3cff-493d-b6c5-8f2919ce99f7", "tag": "e8a40d5d-aaf2-43a0-a210-7e4f0815b848"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:51:12.987132 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-abefd668-796b-4a2b-bbde-287ebec54f21 None None] Set router 115e1e9e-f059-4a58-90c3-f04312423cd9 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:51:13.047921 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5fd1ab1a-364e-4f33-a77c-fd3593f4e106 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'name': 'tempest-TestNetworkBasicOps-router-792281405', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36'}], 'enable_snat': True}, 'gw_port_id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:51:10Z', 'revision_number': 6, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:2c:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3592, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '4eb9c6ee-8df6-4019-8824-be233593b289', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'floating_ip_address': '172.25.3.251', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'port_id': '7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 3637, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'mac_address': 'fa:16:3e:10:cf:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:49:51Z', 'updated_at': '2021-12-09T21:49:56Z', 'revision_number': 1, 'project_id': 'e863bf78256945798e7c717c650258aa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'efd747c8-9308-4be4-8445-86a9ce208bf3', 'name': '', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:c1:e4:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:27Z', 'updated_at': '2021-12-09T21:49:33Z', 'revision_number': 5, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:13.078588 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:51:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a35880bc-c34c-4712-b48e-7c8c89a6fca0 x-openstack-request-id: req-a35880bc-c34c-4712-b48e-7c8c89a6fca0 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:51:13.078885 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0f427011-3cff-493d-b6c5-8f2919ce99f7", "tag": "e8a40d5d-aaf2-43a0-a210-7e4f0815b848", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:51:13.079140 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a35880bc-c34c-4712-b48e-7c8c89a6fca0 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:51:13.079616 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0f427011-3cff-493d-b6c5-8f2919ce99f7', 'tag': 'e8a40d5d-aaf2-43a0-a210-7e4f0815b848', 'status': 'completed', 'code': 200} Dec 09 21:51:13.085688 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5fd1ab1a-364e-4f33-a77c-fd3593f4e106 None None] The sync data for ids ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'] in n-d-713301-27 is: [{'id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'name': 'tempest-TestNetworkBasicOps-router-792281405', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36'}], 'enable_snat': True}, 'gw_port_id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:51:10Z', 'revision_number': 6, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:2c:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3592, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '4eb9c6ee-8df6-4019-8824-be233593b289', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'floating_ip_address': '172.25.3.251', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'port_id': '7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 3637, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'mac_address': 'fa:16:3e:10:cf:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:49:51Z', 'updated_at': '2021-12-09T21:49:56Z', 'revision_number': 1, 'project_id': 'e863bf78256945798e7c717c650258aa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'efd747c8-9308-4be4-8445-86a9ce208bf3', 'name': '', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:c1:e4:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:27Z', 'updated_at': '2021-12-09T21:49:33Z', 'revision_number': 5, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:51:13.226337 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7349502c-b6ca-4da3-b679-7d9b368efabf req-9701711a-acf2-423c-9577-d953cb8891be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:13.229310 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7349502c-b6ca-4da3-b679-7d9b368efabf req-9701711a-acf2-423c-9577-d953cb8891be service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 1096 time: 0.1251411 Dec 09 21:51:13.242372 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12c5bc30-a41f-49c8-87e7-a17474396f8a req-be0a78ce-1518-4807-98d0-cf911546aeac tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:13.265361 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-12c5bc30-a41f-49c8-87e7-a17474396f8a req-be0a78ce-1518-4807-98d0-cf911546aeac tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 944 time: 0.1033559 Dec 09 21:51:13.297635 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c25e2147-08fc-4848-8f9f-6febf1fa159f req-167b3335-a86e-4246-910a-cd8d96835f9b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:13.300074 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c25e2147-08fc-4848-8f9f-6febf1fa159f req-167b3335-a86e-4246-910a-cd8d96835f9b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.31 "GET /v2.0/ports?device_id=770cd4f6-d7e5-43f3-9b0c-380cc9271551 HTTP/1.1" status: 200 len: 946 time: 0.0776975 Dec 09 21:51:13.316190 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-abefd668-796b-4a2b-bbde-287ebec54f21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1363834495', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78'}], 'enable_snat': True}, 'gw_port_id': '5acb1872-d950-4751-958f-af9bafe79bef', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:56Z', 'updated_at': '2021-12-09T21:50:02Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '5acb1872-d950-4751-958f-af9bafe79bef', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:8d:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3660, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:57Z', 'updated_at': '2021-12-09T21:50:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc', 'name': '', 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:bd:e6:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 3678, 'fixed_ips': [{'subnet_id': '1317305d-5040-4a27-9e95-c846c3faa444', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:50:01Z', 'updated_at': '2021-12-09T21:50:06Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '1317305d-5040-4a27-9e95-c846c3faa444', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:13.355533 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abefd668-796b-4a2b-bbde-287ebec54f21 None None] Checking router: 115e1e9e-f059-4a58-90c3-f04312423cd9 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:51:13.367374 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-abefd668-796b-4a2b-bbde-287ebec54f21 None None] Routers {'115e1e9e-f059-4a58-90c3-f04312423cd9'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:51:13.368420 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-abefd668-796b-4a2b-bbde-287ebec54f21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:51:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['115e1e9e-f059-4a58-90c3-f04312423cd9'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:13.503538 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-c25e2147-08fc-4848-8f9f-6febf1fa159f req-40959630-fe2a-4fe9-bfe0-801d5b053206 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Deleting port 4035706f-a949-4d9b-9aa6-aa924a3b6167 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:51:13.504208 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c25e2147-08fc-4848-8f9f-6febf1fa159f req-40959630-fe2a-4fe9-bfe0-801d5b053206 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:13.519638 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-abefd668-796b-4a2b-bbde-287ebec54f21 None None] Set router 115e1e9e-f059-4a58-90c3-f04312423cd9 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:51:13.520470 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86898a54-1189-45f2-8c5c-62c7618a25df req-8bde153d-19b6-4d4d-b64e-a13b2292ea22 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:13.524012 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86898a54-1189-45f2-8c5c-62c7618a25df req-8bde153d-19b6-4d4d-b64e-a13b2292ea22 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.10 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 944 time: 0.1114216 Dec 09 21:51:13.580084 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-12c5bc30-a41f-49c8-87e7-a17474396f8a req-6e085676-05af-461f-b4f3-1fde575f1899 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=804c3895-61f7-4cc1-b0c5-503b9ff5fa56&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3137264 Dec 09 21:51:13.657864 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7349502c-b6ca-4da3-b679-7d9b368efabf req-7d09c419-8f3e-46ca-81e5-2f9374fc0343 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:13.662379 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7349502c-b6ca-4da3-b679-7d9b368efabf req-7d09c419-8f3e-46ca-81e5-2f9374fc0343 service neutron] 10.222.0.10 "GET /v2.0/networks?id=69e4f0dc-5303-45fd-9842-f33d6a22b48d HTTP/1.1" status: 200 len: 897 time: 0.3949280 Dec 09 21:51:13.749247 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-c25e2147-08fc-4848-8f9f-6febf1fa159f req-40959630-fe2a-4fe9-bfe0-801d5b053206 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] For port 4035706f-a949-4d9b-9aa6-aa924a3b6167, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=4035706f-a949-4d9b-9aa6-aa924a3b6167,segment=NetworkSegment(efd94242-a7b2-491d-b555-cf8b471e00ae),segment_id=efd94242-a7b2-491d-b555-cf8b471e00ae)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:13.749767 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c25e2147-08fc-4848-8f9f-6febf1fa159f req-40959630-fe2a-4fe9-bfe0-801d5b053206 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:13.775019 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-c25e2147-08fc-4848-8f9f-6febf1fa159f req-40959630-fe2a-4fe9-bfe0-801d5b053206 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Calling delete_port for 4035706f-a949-4d9b-9aa6-aa924a3b6167 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:51:13.784750 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-86898a54-1189-45f2-8c5c-62c7618a25df req-3f6e0892-2f92-4de9-a160-ebe41789350c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Deleting port e8a40d5d-aaf2-43a0-a210-7e4f0815b848 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:51:13.785460 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-86898a54-1189-45f2-8c5c-62c7618a25df req-3f6e0892-2f92-4de9-a160-ebe41789350c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:13.825579 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:51:13.833173 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7349502c-b6ca-4da3-b679-7d9b368efabf req-e4878c1a-67f3-4fd4-a4ca-db90836ff178 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e8a40d5d-aaf2-43a0-a210-7e4f0815b848 HTTP/1.1" status: 200 len: 217 time: 0.1563818 Dec 09 21:51:13.868537 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:51:13.869593 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f6e087d7-ddc0-4bd9-b4b6-c0706e970b1f not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:51:13.916612 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7349502c-b6ca-4da3-b679-7d9b368efabf req-147ee933-132c-4374-9b46-685bf919a4b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:13.919497 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7349502c-b6ca-4da3-b679-7d9b368efabf req-147ee933-132c-4374-9b46-685bf919a4b8 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=1317305d-5040-4a27-9e95-c846c3faa444 HTTP/1.1" status: 200 len: 835 time: 0.0624409 Dec 09 21:51:13.992580 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-86898a54-1189-45f2-8c5c-62c7618a25df req-3f6e0892-2f92-4de9-a160-ebe41789350c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] For port e8a40d5d-aaf2-43a0-a210-7e4f0815b848, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e8a40d5d-aaf2-43a0-a210-7e4f0815b848,segment=NetworkSegment(bb2623a0-5941-46ea-9e2a-adfecf120d3a),segment_id=bb2623a0-5941-46ea-9e2a-adfecf120d3a)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:13.993170 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-86898a54-1189-45f2-8c5c-62c7618a25df req-3f6e0892-2f92-4de9-a160-ebe41789350c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:14.008252 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-86898a54-1189-45f2-8c5c-62c7618a25df req-3f6e0892-2f92-4de9-a160-ebe41789350c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Calling delete_port for e8a40d5d-aaf2-43a0-a210-7e4f0815b848 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:51:14.011189 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60c30d3e-aa84-446f-abb8-60ad5641c299 req-e59554a9-f8ee-4df5-902e-5752c011bb1f tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:14.020464 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60c30d3e-aa84-446f-abb8-60ad5641c299 req-e59554a9-f8ee-4df5-902e-5752c011bb1f tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=770cd4f6-d7e5-43f3-9b0c-380cc9271551 HTTP/1.1" status: 200 len: 946 time: 0.2358475 Dec 09 21:51:14.105459 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-abefd668-796b-4a2b-bbde-287ebec54f21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1363834495', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78'}], 'enable_snat': True}, 'gw_port_id': '5acb1872-d950-4751-958f-af9bafe79bef', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:56Z', 'updated_at': '2021-12-09T21:50:02Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '5acb1872-d950-4751-958f-af9bafe79bef', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:8d:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3660, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:57Z', 'updated_at': '2021-12-09T21:50:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc', 'name': '', 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:bd:e6:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 3678, 'fixed_ips': [{'subnet_id': '1317305d-5040-4a27-9e95-c846c3faa444', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:50:01Z', 'updated_at': '2021-12-09T21:50:06Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '1317305d-5040-4a27-9e95-c846c3faa444', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:14.111334 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60c30d3e-aa84-446f-abb8-60ad5641c299 req-73d3ada8-7ac8-4cfd-8a51-2d31d3d3f0c8 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=84678483-baf9-4a9e-ba44-4d435fde916e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0898020 Dec 09 21:51:14.125171 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7349502c-b6ca-4da3-b679-7d9b368efabf req-6eb9ef2c-6e0e-4f56-9d4f-f4f07098067a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:14.125171 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7349502c-b6ca-4da3-b679-7d9b368efabf req-6eb9ef2c-6e0e-4f56-9d4f-f4f07098067a service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=69e4f0dc-5303-45fd-9842-f33d6a22b48d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1972713 Dec 09 21:51:14.165508 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-86898a54-1189-45f2-8c5c-62c7618a25df req-3f6e0892-2f92-4de9-a160-ebe41789350c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:14.178929 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-abefd668-796b-4a2b-bbde-287ebec54f21 None None] The sync data for ids ['115e1e9e-f059-4a58-90c3-f04312423cd9'] in n-d-713301-27 is: [{'id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1363834495', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78'}], 'enable_snat': True}, 'gw_port_id': '5acb1872-d950-4751-958f-af9bafe79bef', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:56Z', 'updated_at': '2021-12-09T21:50:02Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '5acb1872-d950-4751-958f-af9bafe79bef', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:8d:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3660, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:57Z', 'updated_at': '2021-12-09T21:50:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc', 'name': '', 'network_id': '69e4f0dc-5303-45fd-9842-f33d6a22b48d', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:bd:e6:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 3678, 'fixed_ips': [{'subnet_id': '1317305d-5040-4a27-9e95-c846c3faa444', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:50:01Z', 'updated_at': '2021-12-09T21:50:06Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': '1317305d-5040-4a27-9e95-c846c3faa444', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:51:14.251662 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7349502c-b6ca-4da3-b679-7d9b368efabf req-72f8c1e1-dc92-42e3-b763-ec6f67790710 service neutron] 10.222.0.10 "GET /v2.0/networks/69e4f0dc-5303-45fd-9842-f33d6a22b48d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1184046 Dec 09 21:51:14.301490 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f6e0892-2f92-4de9-a160-ebe41789350c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'Port': ['ID=e8a40d5d-aaf2-43a0-a210-7e4f0815b848,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:14.369362 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-86898a54-1189-45f2-8c5c-62c7618a25df req-3f6e0892-2f92-4de9-a160-ebe41789350c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] No DVR routers for this DVR port e8a40d5d-aaf2-43a0-a210-7e4f0815b848 on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:51:14.374344 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-86898a54-1189-45f2-8c5c-62c7618a25df req-3f6e0892-2f92-4de9-a160-ebe41789350c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:14.378010 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86898a54-1189-45f2-8c5c-62c7618a25df req-3f6e0892-2f92-4de9-a160-ebe41789350c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.10 "DELETE /v2.0/ports/e8a40d5d-aaf2-43a0-a210-7e4f0815b848 HTTP/1.1" status: 204 len: 173 time: 0.8472240 Dec 09 21:51:14.378570 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0f427011-3cff-493d-b6c5-8f2919ce99f7', 'name': 'network-vif-deleted', 'tag': 'e8a40d5d-aaf2-43a0-a210-7e4f0815b848'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:51:14.381834 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bccdbf88-a39d-41d8-aa87-59b10ffb7379" -d '{"events": [{"server_uuid": "0f427011-3cff-493d-b6c5-8f2919ce99f7", "name": "network-vif-deleted", "tag": "e8a40d5d-aaf2-43a0-a210-7e4f0815b848"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:51:14.490980 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7349502c-b6ca-4da3-b679-7d9b368efabf req-b1683ca2-fd72-4fbf-9c50-60b96affdac8 service neutron] 10.222.0.10 "GET /v2.0/networks/69e4f0dc-5303-45fd-9842-f33d6a22b48d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2300544 Dec 09 21:51:14.510364 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:51:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3482c634-939e-4784-8fe7-057c165a8c70 x-openstack-request-id: req-3482c634-939e-4784-8fe7-057c165a8c70 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:51:14.511793 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0f427011-3cff-493d-b6c5-8f2919ce99f7", "name": "network-vif-deleted", "tag": "e8a40d5d-aaf2-43a0-a210-7e4f0815b848", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:51:14.512822 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-3482c634-939e-4784-8fe7-057c165a8c70 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:51:14.513312 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0f427011-3cff-493d-b6c5-8f2919ce99f7', 'name': 'network-vif-deleted', 'tag': 'e8a40d5d-aaf2-43a0-a210-7e4f0815b848', 'status': 'completed', 'code': 200} Dec 09 21:51:14.587235 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c25e2147-08fc-4848-8f9f-6febf1fa159f req-40959630-fe2a-4fe9-bfe0-801d5b053206 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:14.742692 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92841d24-24ea-4f00-846c-1c73b45a9746 None None] New status for floating IP fb13a433-742b-49fd-a148-4074584186de: DOWN {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:51:14.789005 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ce4b86f9-7caa-4de2-b91b-02bead6f118c req-a2a6979d-c357-4655-98ad-2b040b56c83d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=0f427011-3cff-493d-b6c5-8f2919ce99f7 HTTP/1.1" status: 200 len: 210 time: 0.0595970 Dec 09 21:51:15.236348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40959630-fe2a-4fe9-bfe0-801d5b053206 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event deleted for resources: {'Port': ['ID=4035706f-a949-4d9b-9aa6-aa924a3b6167,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:15.326561 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-c25e2147-08fc-4848-8f9f-6febf1fa159f req-40959630-fe2a-4fe9-bfe0-801d5b053206 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] No DVR routers for this DVR port 4035706f-a949-4d9b-9aa6-aa924a3b6167 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:51:15.332875 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c25e2147-08fc-4848-8f9f-6febf1fa159f req-40959630-fe2a-4fe9-bfe0-801d5b053206 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:15.342361 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c25e2147-08fc-4848-8f9f-6febf1fa159f req-40959630-fe2a-4fe9-bfe0-801d5b053206 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.31 "DELETE /v2.0/ports/4035706f-a949-4d9b-9aa6-aa924a3b6167 HTTP/1.1" status: 204 len: 173 time: 2.0360422 Dec 09 21:51:15.364948 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-557a4fba-04cf-44b7-a15f-6ed489948b34 req-8874ebf9-8b9d-428c-ab10-d2a8c8263d1c tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=770cd4f6-d7e5-43f3-9b0c-380cc9271551 HTTP/1.1" status: 200 len: 210 time: 0.1118543 Dec 09 21:51:15.867132 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51164) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:16.397312 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51186) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:16.468935 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51190) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:16.475670 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3b157f19-89ae-476e-91f5-8d99217e9dae tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:16.522549 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '770cd4f6-d7e5-43f3-9b0c-380cc9271551', 'name': 'network-vif-deleted', 'tag': '4035706f-a949-4d9b-9aa6-aa924a3b6167'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:51:16.530110 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-61e59d88-44d0-4bb6-85b6-7f689b9f58a2" -d '{"events": [{"server_uuid": "770cd4f6-d7e5-43f3-9b0c-380cc9271551", "name": "network-vif-deleted", "tag": "4035706f-a949-4d9b-9aa6-aa924a3b6167"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:51:16.642737 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:51:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a7af424c-7656-41f3-9eff-9b2787bbfd93 x-openstack-request-id: req-a7af424c-7656-41f3-9eff-9b2787bbfd93 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:51:16.643254 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "770cd4f6-d7e5-43f3-9b0c-380cc9271551", "name": "network-vif-deleted", "tag": "4035706f-a949-4d9b-9aa6-aa924a3b6167", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:51:16.643691 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a7af424c-7656-41f3-9eff-9b2787bbfd93 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:51:16.644323 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '770cd4f6-d7e5-43f3-9b0c-380cc9271551', 'name': 'network-vif-deleted', 'tag': '4035706f-a949-4d9b-9aa6-aa924a3b6167', 'status': 'completed', 'code': 200} Dec 09 21:51:16.663257 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b96a0f3f-f15e-46a9-97da-712579eb1d4a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:16.690044 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f1ef06f-2dc3-4154-b422-f0d69b5347f0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:16.730274 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b96a0f3f-f15e-46a9-97da-712579eb1d4a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:16.861205 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b96a0f3f-f15e-46a9-97da-712579eb1d4a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:16.864360 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b96a0f3f-f15e-46a9-97da-712579eb1d4a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:16.865701 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b96a0f3f-f15e-46a9-97da-712579eb1d4a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "DELETE /v2.0/security-groups/84678483-baf9-4a9e-ba44-4d435fde916e HTTP/1.1" status: 204 len: 168 time: 0.3954835 Dec 09 21:51:16.901476 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-3b157f19-89ae-476e-91f5-8d99217e9dae tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Deleting port f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:51:16.902183 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3b157f19-89ae-476e-91f5-8d99217e9dae tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:16.904681 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b96a0f3f-f15e-46a9-97da-712579eb1d4a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=84678483-baf9-4a9e-ba44-4d435fde916e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:16.922554 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51202) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:16.993342 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-b4b28d5c-a812-432d-b092-e3ed10c04d64 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Deleting subnet db260714-c8e4-49a8-961f-2d6c653a6d1a {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:51:16.996954 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b4b28d5c-a812-432d-b092-e3ed10c04d64 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:17.038701 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b4b28d5c-a812-432d-b092-e3ed10c04d64 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:17.051815 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-3b157f19-89ae-476e-91f5-8d99217e9dae tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] For port f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc,segment=NetworkSegment(bb2623a0-5941-46ea-9e2a-adfecf120d3a),segment_id=bb2623a0-5941-46ea-9e2a-adfecf120d3a)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:17.052687 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3b157f19-89ae-476e-91f5-8d99217e9dae tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:17.071020 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-3b157f19-89ae-476e-91f5-8d99217e9dae tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Calling delete_port for f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:51:17.087801 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a0f3f-f15e-46a9-97da-712579eb1d4a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:17.088146 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a0f3f-f15e-46a9-97da-712579eb1d4a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:17.088489 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a0f3f-f15e-46a9-97da-712579eb1d4a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:17.088824 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a0f3f-f15e-46a9-97da-712579eb1d4a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:17.089158 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a0f3f-f15e-46a9-97da-712579eb1d4a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:17.089518 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a0f3f-f15e-46a9-97da-712579eb1d4a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:17.089815 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a0f3f-f15e-46a9-97da-712579eb1d4a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:17.090138 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a0f3f-f15e-46a9-97da-712579eb1d4a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:17.090589 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a0f3f-f15e-46a9-97da-712579eb1d4a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:17.090915 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a0f3f-f15e-46a9-97da-712579eb1d4a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:17.091237 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a0f3f-f15e-46a9-97da-712579eb1d4a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:17.091582 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a0f3f-f15e-46a9-97da-712579eb1d4a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:17.091907 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b96a0f3f-f15e-46a9-97da-712579eb1d4a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:17.157567 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f1ef06f-2dc3-4154-b422-f0d69b5347f0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:17.171417 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f1ef06f-2dc3-4154-b422-f0d69b5347f0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:17.188069 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b4b28d5c-a812-432d-b092-e3ed10c04d64 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:17.250485 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f1ef06f-2dc3-4154-b422-f0d69b5347f0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=96a6a042-ef53-497c-8da9-b4f8ad71597e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:17.316043 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7f1ef06f-2dc3-4154-b422-f0d69b5347f0 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=4183aa0c42cf40a4999b3ee98f79dd92&name=default HTTP/1.1" status: 200 len: 3000 time: 0.9173613 Dec 09 21:51:17.318700 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51210) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:17.343796 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3b157f19-89ae-476e-91f5-8d99217e9dae tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:17.376221 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b4b28d5c-a812-432d-b092-e3ed10c04d64 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:17.388838 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e8a40d5d-aaf2-43a0-a210-7e4f0815b848 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:51:17.394258 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b157f19-89ae-476e-91f5-8d99217e9dae tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'Port': ['ID=f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:17.416791 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4b28d5c-a812-432d-b092-e3ed10c04d64 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event deleted for resources: {'Subnet': ['ID=db260714-c8e4-49a8-961f-2d6c653a6d1a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:17.428845 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b4b28d5c-a812-432d-b092-e3ed10c04d64 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:17.432164 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b4b28d5c-a812-432d-b092-e3ed10c04d64 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "DELETE /v2.0/subnets/db260714-c8e4-49a8-961f-2d6c653a6d1a HTTP/1.1" status: 204 len: 168 time: 0.5073051 Dec 09 21:51:17.433361 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f4a46819-5b8e-49de-b839-85f58fb13df8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:17.457184 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51212) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:17.460929 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f4a46819-5b8e-49de-b839-85f58fb13df8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:17.461371 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: e8a40d5d-aaf2-43a0-a210-7e4f0815b848 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:51:17.461716 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e8a40d5d-aaf2-43a0-a210-7e4f0815b848 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:51:17.468629 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7806b7c1-717e-4b4f-9433-cdd2a0d3e76a None None] Network f481e34c-08b7-4b81-995d-857e3c7f684d requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:51:17.530409 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f4a46819-5b8e-49de-b839-85f58fb13df8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:17.533677 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f4a46819-5b8e-49de-b839-85f58fb13df8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:17.538292 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f4a46819-5b8e-49de-b839-85f58fb13df8 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/96a6a042-ef53-497c-8da9-b4f8ad71597e HTTP/1.1" status: 204 len: 168 time: 0.2144361 Dec 09 21:51:17.560832 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4a46819-5b8e-49de-b839-85f58fb13df8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=96a6a042-ef53-497c-8da9-b4f8ad71597e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:17.597472 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 4035706f-a949-4d9b-9aa6-aa924a3b6167 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:51:17.646970 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 4035706f-a949-4d9b-9aa6-aa924a3b6167 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:51:17.647737 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 4035706f-a949-4d9b-9aa6-aa924a3b6167 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:51:17.729338 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d2d2e1b-6b6b-487e-82f3-41a648fcdcbe tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:17.826772 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f8b71f8a-fdf6-4718-87c2-6cf8cde3c23a None None] DHCP port deletion for f481e34c-08b7-4b81-995d-857e3c7f684d request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:51:17.963336 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f8b71f8a-fdf6-4718-87c2-6cf8cde3c23a None None] Deleting port 1e95cc67-64d4-43d0-a8d6-5e5ee08804fb {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:51:17.963740 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f8b71f8a-fdf6-4718-87c2-6cf8cde3c23a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:18.039863 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3b157f19-89ae-476e-91f5-8d99217e9dae tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:18.090248 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 1e95cc67-64d4-43d0-a8d6-5e5ee08804fb no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:51:18.124933 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-2d2d2e1b-6b6b-487e-82f3-41a648fcdcbe tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Deleting port 1e95cc67-64d4-43d0-a8d6-5e5ee08804fb {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:51:18.125283 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d2d2e1b-6b6b-487e-82f3-41a648fcdcbe tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:18.147352 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f8b71f8a-fdf6-4718-87c2-6cf8cde3c23a None None] For port 1e95cc67-64d4-43d0-a8d6-5e5ee08804fb, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=1e95cc67-64d4-43d0-a8d6-5e5ee08804fb,segment=NetworkSegment(efd94242-a7b2-491d-b555-cf8b471e00ae),segment_id=efd94242-a7b2-491d-b555-cf8b471e00ae)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:18.147773 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f8b71f8a-fdf6-4718-87c2-6cf8cde3c23a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:18.167696 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f8b71f8a-fdf6-4718-87c2-6cf8cde3c23a None None] Calling delete_port for 1e95cc67-64d4-43d0-a8d6-5e5ee08804fb owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:51:18.229190 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-2d2d2e1b-6b6b-487e-82f3-41a648fcdcbe tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] For port 1e95cc67-64d4-43d0-a8d6-5e5ee08804fb, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=1e95cc67-64d4-43d0-a8d6-5e5ee08804fb,segment=NetworkSegment(efd94242-a7b2-491d-b555-cf8b471e00ae),segment_id=efd94242-a7b2-491d-b555-cf8b471e00ae)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:18.230106 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d2d2e1b-6b6b-487e-82f3-41a648fcdcbe tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:18.251470 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-2d2d2e1b-6b6b-487e-82f3-41a648fcdcbe tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Calling delete_port for 1e95cc67-64d4-43d0-a8d6-5e5ee08804fb owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:51:18.290113 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f8b71f8a-fdf6-4718-87c2-6cf8cde3c23a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:18.361507 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8b71f8a-fdf6-4718-87c2-6cf8cde3c23a None None] Pushing event deleted for resources: {'Port': ['ID=1e95cc67-64d4-43d0-a8d6-5e5ee08804fb,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:18.375702 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8b71f8a-fdf6-4718-87c2-6cf8cde3c23a None None] No DVR routers for this DVR port 1e95cc67-64d4-43d0-a8d6-5e5ee08804fb on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:51:18.391770 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:18.442617 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d2d2e1b-6b6b-487e-82f3-41a648fcdcbe tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:18.476514 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d2d2e1b-6b6b-487e-82f3-41a648fcdcbe tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event deleted for resources: {'Port': ['ID=1e95cc67-64d4-43d0-a8d6-5e5ee08804fb,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:18.488898 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d2d2e1b-6b6b-487e-82f3-41a648fcdcbe tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] No DVR routers for this DVR port 1e95cc67-64d4-43d0-a8d6-5e5ee08804fb on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:51:18.652891 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d2d2e1b-6b6b-487e-82f3-41a648fcdcbe tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:18.706938 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-2d2d2e1b-6b6b-487e-82f3-41a648fcdcbe tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f481e34c-08b7-4b81-995d-857e3c7f684d']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:18.723366 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-2d2d2e1b-6b6b-487e-82f3-41a648fcdcbe tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'efd94242-a7b2-491d-b555-cf8b471e00ae') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:18.723683 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-2d2d2e1b-6b6b-487e-82f3-41a648fcdcbe tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'efd94242-a7b2-491d-b555-cf8b471e00ae') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:18.740679 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d2d2e1b-6b6b-487e-82f3-41a648fcdcbe tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:18.757322 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3b157f19-89ae-476e-91f5-8d99217e9dae tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Router 115e1e9e-f059-4a58-90c3-f04312423cd9 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:51:18.769199 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d2d2e1b-6b6b-487e-82f3-41a648fcdcbe tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:18.778798 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2d2d2e1b-6b6b-487e-82f3-41a648fcdcbe tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Releasing vlan 142 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:51:18.779217 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d2d2e1b-6b6b-487e-82f3-41a648fcdcbe tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: self.session.flush() Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: self.session.flush() Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: self.session.flush() Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: self.session.flush() Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:51:18.786076 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:51:18.907149 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d2d2e1b-6b6b-487e-82f3-41a648fcdcbe tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:18.918487 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2d2d2e1b-6b6b-487e-82f3-41a648fcdcbe tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:18.921668 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2d2d2e1b-6b6b-487e-82f3-41a648fcdcbe tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "DELETE /v2.0/networks/f481e34c-08b7-4b81-995d-857e3c7f684d HTTP/1.1" status: 204 len: 168 time: 1.4626276 Dec 09 21:51:18.924632 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51264) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:18.993938 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d2d2e1b-6b6b-487e-82f3-41a648fcdcbe tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event deleted for resources: {'Network': ['ID=f481e34c-08b7-4b81-995d-857e3c7f684d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:19.020662 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3b157f19-89ae-476e-91f5-8d99217e9dae tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:51:19.029375 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3b157f19-89ae-476e-91f5-8d99217e9dae tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "PUT /v2.0/routers/115e1e9e-f059-4a58-90c3-f04312423cd9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1608064 Dec 09 21:51:19.030091 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51286) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:19.036811 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74d7566f-ab6e-42cb-bc37-e7d20b511cfc None None] Sync routers for ids ['115e1e9e-f059-4a58-90c3-f04312423cd9'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:51:19.074933 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74d7566f-ab6e-42cb-bc37-e7d20b511cfc None None] Routers {'115e1e9e-f059-4a58-90c3-f04312423cd9'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:51:19.076107 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-74d7566f-ab6e-42cb-bc37-e7d20b511cfc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:51:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['115e1e9e-f059-4a58-90c3-f04312423cd9'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:19.119458 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-743eafec-b580-4128-8947-3e218319a7dc tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Deleting subnet 1317305d-5040-4a27-9e95-c846c3faa444 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:51:19.122941 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-743eafec-b580-4128-8947-3e218319a7dc tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:19.215578 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-743eafec-b580-4128-8947-3e218319a7dc tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:19.223925 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-e0c25bd6-2fc3-47db-b3d6-2d884b400e44 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Deleting port 5f2d17b1-c2fa-4f5a-88ac-a959f3404a74 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:51:19.224271 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0c25bd6-2fc3-47db-b3d6-2d884b400e44 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:19.231129 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-74d7566f-ab6e-42cb-bc37-e7d20b511cfc None None] Set router 115e1e9e-f059-4a58-90c3-f04312423cd9 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:51:19.324681 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-743eafec-b580-4128-8947-3e218319a7dc tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:19.367363 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0c25bd6-2fc3-47db-b3d6-2d884b400e44 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:19.367705 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0c25bd6-2fc3-47db-b3d6-2d884b400e44 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:19.389706 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-e0c25bd6-2fc3-47db-b3d6-2d884b400e44 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Calling delete_port for 5f2d17b1-c2fa-4f5a-88ac-a959f3404a74 owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:51:19.410897 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-743eafec-b580-4128-8947-3e218319a7dc tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:19.479688 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-743eafec-b580-4128-8947-3e218319a7dc tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'Subnet': ['ID=1317305d-5040-4a27-9e95-c846c3faa444,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:19.486043 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-743eafec-b580-4128-8947-3e218319a7dc tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:19.488546 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e6d3627-9d3f-4f6b-8e8d-bc853e2a66bf None None] Network 69e4f0dc-5303-45fd-9842-f33d6a22b48d requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:51:19.508203 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-743eafec-b580-4128-8947-3e218319a7dc tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "DELETE /v2.0/subnets/1317305d-5040-4a27-9e95-c846c3faa444 HTTP/1.1" status: 204 len: 168 time: 0.4708347 Dec 09 21:51:19.512339 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51306) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:19.568751 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-74d7566f-ab6e-42cb-bc37-e7d20b511cfc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1363834495', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78'}], 'enable_snat': True}, 'gw_port_id': '5acb1872-d950-4751-958f-af9bafe79bef', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:56Z', 'updated_at': '2021-12-09T21:51:17Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '5acb1872-d950-4751-958f-af9bafe79bef', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:8d:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3660, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:57Z', 'updated_at': '2021-12-09T21:50:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:19.643207 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74d7566f-ab6e-42cb-bc37-e7d20b511cfc None None] Checking router: 115e1e9e-f059-4a58-90c3-f04312423cd9 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:51:19.674406 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74d7566f-ab6e-42cb-bc37-e7d20b511cfc None None] Routers {'115e1e9e-f059-4a58-90c3-f04312423cd9'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:51:19.675848 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-74d7566f-ab6e-42cb-bc37-e7d20b511cfc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:51:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['115e1e9e-f059-4a58-90c3-f04312423cd9'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:19.786439 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f843702c-d5bc-42af-bc93-cf168dabbb87 None None] DHCP port deletion for 69e4f0dc-5303-45fd-9842-f33d6a22b48d request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:51:19.933171 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0c25bd6-2fc3-47db-b3d6-2d884b400e44 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:19.952474 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a196a712-e676-435b-80b5-de2dae28882d no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:51:19.955266 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-74d7566f-ab6e-42cb-bc37-e7d20b511cfc None None] Set router 115e1e9e-f059-4a58-90c3-f04312423cd9 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:51:20.014525 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f843702c-d5bc-42af-bc93-cf168dabbb87 None None] Deleting port a196a712-e676-435b-80b5-de2dae28882d {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:51:20.015191 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f843702c-d5bc-42af-bc93-cf168dabbb87 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:20.076965 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0c25bd6-2fc3-47db-b3d6-2d884b400e44 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event deleted for resources: {'Port': ['ID=5f2d17b1-c2fa-4f5a-88ac-a959f3404a74,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:20.093832 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee9609a0-5fd2-473f-a2c2-4e39b0baa968 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:20.177827 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0c25bd6-2fc3-47db-b3d6-2d884b400e44 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:20.179760 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-e0c25bd6-2fc3-47db-b3d6-2d884b400e44 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Floating IP 4eb9c6ee-8df6-4019-8824-be233593b289 disassociated (deleted). External IP: 172.25.3.251, port: 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2. Dec 09 21:51:20.192764 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f843702c-d5bc-42af-bc93-cf168dabbb87 None None] For port a196a712-e676-435b-80b5-de2dae28882d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a196a712-e676-435b-80b5-de2dae28882d,segment=NetworkSegment(bb2623a0-5941-46ea-9e2a-adfecf120d3a),segment_id=bb2623a0-5941-46ea-9e2a-adfecf120d3a)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:20.203999 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f843702c-d5bc-42af-bc93-cf168dabbb87 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:20.232598 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:20.258755 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f843702c-d5bc-42af-bc93-cf168dabbb87 None None] Calling delete_port for a196a712-e676-435b-80b5-de2dae28882d owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:51:20.320360 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port a196a712-e676-435b-80b5-de2dae28882d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a196a712-e676-435b-80b5-de2dae28882d,segment=NetworkSegment(bb2623a0-5941-46ea-9e2a-adfecf120d3a),segment_id=bb2623a0-5941-46ea-9e2a-adfecf120d3a)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:20.345487 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:20.482814 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-74d7566f-ab6e-42cb-bc37-e7d20b511cfc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1363834495', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78'}], 'enable_snat': True}, 'gw_port_id': '5acb1872-d950-4751-958f-af9bafe79bef', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:56Z', 'updated_at': '2021-12-09T21:51:17Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '5acb1872-d950-4751-958f-af9bafe79bef', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:8d:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3660, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:57Z', 'updated_at': '2021-12-09T21:50:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:20.556191 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74d7566f-ab6e-42cb-bc37-e7d20b511cfc None None] The sync data for ids ['115e1e9e-f059-4a58-90c3-f04312423cd9'] in n-d-713301-27 is: [{'id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1363834495', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78'}], 'enable_snat': True}, 'gw_port_id': '5acb1872-d950-4751-958f-af9bafe79bef', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:56Z', 'updated_at': '2021-12-09T21:51:17Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': '5acb1872-d950-4751-958f-af9bafe79bef', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:8d:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '115e1e9e-f059-4a58-90c3-f04312423cd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3660, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.78', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:57Z', 'updated_at': '2021-12-09T21:50:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:51:20.585715 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f843702c-d5bc-42af-bc93-cf168dabbb87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:20.606180 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=a196a712-e676-435b-80b5-de2dae28882d,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:20.664474 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f843702c-d5bc-42af-bc93-cf168dabbb87 None None] No DVR routers for this DVR port a196a712-e676-435b-80b5-de2dae28882d on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:51:20.669698 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f843702c-d5bc-42af-bc93-cf168dabbb87 None None] Pushing event deleted for resources: {'Port': ['ID=a196a712-e676-435b-80b5-de2dae28882d,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:21.023504 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee9609a0-5fd2-473f-a2c2-4e39b0baa968 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:21.214772 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-ee9609a0-5fd2-473f-a2c2-4e39b0baa968 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Deleting port 5acb1872-d950-4751-958f-af9bafe79bef {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:51:21.215126 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee9609a0-5fd2-473f-a2c2-4e39b0baa968 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:21.266152 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e0c25bd6-2fc3-47db-b3d6-2d884b400e44 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:51:21.441566 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-ee9609a0-5fd2-473f-a2c2-4e39b0baa968 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] For port 5acb1872-d950-4751-958f-af9bafe79bef, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5acb1872-d950-4751-958f-af9bafe79bef,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:21.442017 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee9609a0-5fd2-473f-a2c2-4e39b0baa968 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:21.467999 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-ee9609a0-5fd2-473f-a2c2-4e39b0baa968 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Calling delete_port for 5acb1872-d950-4751-958f-af9bafe79bef owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:51:21.497950 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e0c25bd6-2fc3-47db-b3d6-2d884b400e44 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:51:21.502815 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e0c25bd6-2fc3-47db-b3d6-2d884b400e44 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:21.511034 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4fe79103-e23e-4170-b009-dc0e7092c1f7 None None] Sync routers for ids ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:51:21.523614 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4fe79103-e23e-4170-b009-dc0e7092c1f7 None None] Routers {'6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:51:21.524831 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-4fe79103-e23e-4170-b009-dc0e7092c1f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:51:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:21.592524 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e0c25bd6-2fc3-47db-b3d6-2d884b400e44 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "DELETE /v2.0/floatingips/4eb9c6ee-8df6-4019-8824-be233593b289 HTTP/1.1" status: 204 len: 168 time: 2.6665053 Dec 09 21:51:21.594564 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a', 'tag': '7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:51:21.597813 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-54fcdf40-d961-4aa4-831d-f30271833fa0" -d '{"events": [{"name": "network-changed", "server_uuid": "6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a", "tag": "7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:51:21.804881 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-4fe79103-e23e-4170-b009-dc0e7092c1f7 None None] Set router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:51:21.858332 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:51:21.887876 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:51:21.888509 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f8bf4bdb-8eae-4543-867e-2ef7b8ccf8bc not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:51:21.989667 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee9609a0-5fd2-473f-a2c2-4e39b0baa968 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:22.002195 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:51:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-264d0758-e71e-4db6-ad0f-7a7c4897340a x-openstack-request-id: req-264d0758-e71e-4db6-ad0f-7a7c4897340a {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:51:22.002489 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a", "tag": "7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:51:22.002745 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-264d0758-e71e-4db6-ad0f-7a7c4897340a {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:51:22.003160 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a', 'tag': '7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2', 'status': 'completed', 'code': 200} Dec 09 21:51:22.049313 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee9609a0-5fd2-473f-a2c2-4e39b0baa968 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'Port': ['ID=5acb1872-d950-4751-958f-af9bafe79bef,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:22.149471 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54fcdf40-d961-4aa4-831d-f30271833fa0 req-436c5ea9-4923-4dce-af02-56d43ac5ab5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:22.151022 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-54fcdf40-d961-4aa4-831d-f30271833fa0 req-436c5ea9-4923-4dce-af02-56d43ac5ab5e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e863bf78256945798e7c717c650258aa&device_id=6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a HTTP/1.1" status: 200 len: 1098 time: 0.1225307 Dec 09 21:51:22.280389 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54fcdf40-d961-4aa4-831d-f30271833fa0 req-c8eb58a7-69d7-4d29-9caf-f717290517af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:22.282812 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-54fcdf40-d961-4aa4-831d-f30271833fa0 req-c8eb58a7-69d7-4d29-9caf-f717290517af service neutron] 10.222.0.31 "GET /v2.0/networks?id=5ed1c0c9-0d1a-458b-9180-fe96edb96b56 HTTP/1.1" status: 200 len: 896 time: 0.1219006 Dec 09 21:51:22.299510 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee9609a0-5fd2-473f-a2c2-4e39b0baa968 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:22.333442 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-805f6943-51ed-4931-a615-fc1284174387 req-8e1cd70c-9aaf-4731-bf88-6ed25f08988a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:22.337178 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-54fcdf40-d961-4aa4-831d-f30271833fa0 req-583111d2-97c2-4fae-8032-55756f05f14e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 HTTP/1.1" status: 200 len: 217 time: 0.0461400 Dec 09 21:51:22.341056 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-805f6943-51ed-4931-a615-fc1284174387 req-8e1cd70c-9aaf-4731-bf88-6ed25f08988a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a HTTP/1.1" status: 200 len: 946 time: 0.1688259 Dec 09 21:51:22.403700 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-01252c9d-a90b-4e0f-b205-548775c0738f None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:51:22.422698 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54fcdf40-d961-4aa4-831d-f30271833fa0 req-0d792ac5-a3f7-44e9-975b-398427dc5403 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:22.424434 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-54fcdf40-d961-4aa4-831d-f30271833fa0 req-0d792ac5-a3f7-44e9-975b-398427dc5403 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=01104ce9-312c-40a5-b51d-c30bc463bf2c HTTP/1.1" status: 200 len: 835 time: 0.0792706 Dec 09 21:51:22.480773 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee9609a0-5fd2-473f-a2c2-4e39b0baa968 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:22.484337 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee9609a0-5fd2-473f-a2c2-4e39b0baa968 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:22.531720 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54fcdf40-d961-4aa4-831d-f30271833fa0 req-eb1266f6-a62b-4a2f-baa7-d54aeff7abce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:22.533657 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-54fcdf40-d961-4aa4-831d-f30271833fa0 req-eb1266f6-a62b-4a2f-baa7-d54aeff7abce service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5ed1c0c9-0d1a-458b-9180-fe96edb96b56&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1000314 Dec 09 21:51:22.587098 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-4fe79103-e23e-4170-b009-dc0e7092c1f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'name': 'tempest-TestNetworkBasicOps-router-792281405', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36'}], 'enable_snat': True}, 'gw_port_id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:51:10Z', 'revision_number': 6, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:2c:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3592, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'efd747c8-9308-4be4-8445-86a9ce208bf3', 'name': '', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:c1:e4:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:27Z', 'updated_at': '2021-12-09T21:49:33Z', 'revision_number': 5, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:22.588724 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-805f6943-51ed-4931-a615-fc1284174387 req-fc18b368-9f1d-4cba-b0eb-be4379512a14 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=d4fc7436-bf9a-45b0-ae03-980628053e8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2461982 Dec 09 21:51:22.600732 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee9609a0-5fd2-473f-a2c2-4e39b0baa968 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:22.601313 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ee9609a0-5fd2-473f-a2c2-4e39b0baa968 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Fanout notify agent at l3_agent the message router_deleted on router 115e1e9e-f059-4a58-90c3-f04312423cd9 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:51:22.614883 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ee9609a0-5fd2-473f-a2c2-4e39b0baa968 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:22.624420 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ee9609a0-5fd2-473f-a2c2-4e39b0baa968 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "DELETE /v2.0/routers/115e1e9e-f059-4a58-90c3-f04312423cd9 HTTP/1.1" status: 204 len: 168 time: 3.1100078 Dec 09 21:51:22.626695 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51396) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:22.685586 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4fe79103-e23e-4170-b009-dc0e7092c1f7 None None] Checking router: 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:51:22.710110 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4fe79103-e23e-4170-b009-dc0e7092c1f7 None None] Routers {'6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:51:22.712333 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-4fe79103-e23e-4170-b009-dc0e7092c1f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:51:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:22.737497 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-54fcdf40-d961-4aa4-831d-f30271833fa0 req-0187b2f0-1ef4-4004-b654-86457989d11c service neutron] 10.222.0.31 "GET /v2.0/networks/5ed1c0c9-0d1a-458b-9180-fe96edb96b56?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1957531 Dec 09 21:51:22.750133 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-97d339d4-0fe6-4b6f-8a04-ff04212ae4b0 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:22.925629 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-54fcdf40-d961-4aa4-831d-f30271833fa0 req-dff56db1-b4b5-4eb7-8759-84338836d602 service neutron] 10.222.0.31 "GET /v2.0/networks/5ed1c0c9-0d1a-458b-9180-fe96edb96b56?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1792405 Dec 09 21:51:22.981923 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-4fe79103-e23e-4170-b009-dc0e7092c1f7 None None] Set router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:51:22.998443 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-97d339d4-0fe6-4b6f-8a04-ff04212ae4b0 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:23.029866 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-97d339d4-0fe6-4b6f-8a04-ff04212ae4b0 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['69e4f0dc-5303-45fd-9842-f33d6a22b48d']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:23.043407 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-97d339d4-0fe6-4b6f-8a04-ff04212ae4b0 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bb2623a0-5941-46ea-9e2a-adfecf120d3a') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:23.043797 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-97d339d4-0fe6-4b6f-8a04-ff04212ae4b0 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bb2623a0-5941-46ea-9e2a-adfecf120d3a') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:23.093818 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-97d339d4-0fe6-4b6f-8a04-ff04212ae4b0 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:23.110704 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-97d339d4-0fe6-4b6f-8a04-ff04212ae4b0 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:23.117469 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-97d339d4-0fe6-4b6f-8a04-ff04212ae4b0 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Releasing vlan 104 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:51:23.118118 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-97d339d4-0fe6-4b6f-8a04-ff04212ae4b0 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:51:23.121989 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:51:23.235626 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-97d339d4-0fe6-4b6f-8a04-ff04212ae4b0 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:23.251174 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-4fe79103-e23e-4170-b009-dc0e7092c1f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'name': 'tempest-TestNetworkBasicOps-router-792281405', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36'}], 'enable_snat': True}, 'gw_port_id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:51:10Z', 'revision_number': 6, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:2c:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3592, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'efd747c8-9308-4be4-8445-86a9ce208bf3', 'name': '', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:c1:e4:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:27Z', 'updated_at': '2021-12-09T21:49:33Z', 'revision_number': 5, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:23.266565 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-97d339d4-0fe6-4b6f-8a04-ff04212ae4b0 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:23.273830 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-97d339d4-0fe6-4b6f-8a04-ff04212ae4b0 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "DELETE /v2.0/networks/69e4f0dc-5303-45fd-9842-f33d6a22b48d HTTP/1.1" status: 204 len: 168 time: 0.6428447 Dec 09 21:51:23.273944 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e74504b-2ae4-455e-919c-c711bd7220a1 req-2b0e0cf2-00fa-42c2-9c9c-2beb953d06a1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:23.274316 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51410) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:23.275169 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7e74504b-2ae4-455e-919c-c711bd7220a1 req-2b0e0cf2-00fa-42c2-9c9c-2beb953d06a1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.31 "GET /v2.0/ports?device_id=6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a HTTP/1.1" status: 200 len: 946 time: 0.1223209 Dec 09 21:51:23.293183 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4fe79103-e23e-4170-b009-dc0e7092c1f7 None None] The sync data for ids ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'] in n-d-713301-27 is: [{'id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'name': 'tempest-TestNetworkBasicOps-router-792281405', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36'}], 'enable_snat': True}, 'gw_port_id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:51:10Z', 'revision_number': 6, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:2c:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3592, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'efd747c8-9308-4be4-8445-86a9ce208bf3', 'name': '', 'network_id': '5ed1c0c9-0d1a-458b-9180-fe96edb96b56', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:c1:e4:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_interface', 'standard_attr_id': 3595, 'fixed_ips': [{'subnet_id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:27Z', 'updated_at': '2021-12-09T21:49:33Z', 'revision_number': 5, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': '01104ce9-312c-40a5-b51d-c30bc463bf2c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:51:23.383675 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97d339d4-0fe6-4b6f-8a04-ff04212ae4b0 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'Network': ['ID=69e4f0dc-5303-45fd-9842-f33d6a22b48d,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:23.416646 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a54259e5-ee3e-4b4c-8d13-75979e2e7ca6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:23.449423 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a54259e5-ee3e-4b4c-8d13-75979e2e7ca6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:23.499964 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-7e74504b-2ae4-455e-919c-c711bd7220a1 req-10811413-0c86-4310-ab61-4366b5ec9a93 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Deleting port 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:51:23.500287 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7e74504b-2ae4-455e-919c-c711bd7220a1 req-10811413-0c86-4310-ab61-4366b5ec9a93 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:23.582222 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a54259e5-ee3e-4b4c-8d13-75979e2e7ca6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:23.585268 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a54259e5-ee3e-4b4c-8d13-75979e2e7ca6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:23.589271 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a54259e5-ee3e-4b4c-8d13-75979e2e7ca6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "DELETE /v2.0/security-groups/804c3895-61f7-4cc1-b0c5-503b9ff5fa56 HTTP/1.1" status: 204 len: 168 time: 0.2975166 Dec 09 21:51:23.606129 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a54259e5-ee3e-4b4c-8d13-75979e2e7ca6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=804c3895-61f7-4cc1-b0c5-503b9ff5fa56,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:23.717860 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-7e74504b-2ae4-455e-919c-c711bd7220a1 req-10811413-0c86-4310-ab61-4366b5ec9a93 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] For port 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2,segment=NetworkSegment(502907cd-3e3c-478f-b989-3f2602eebfc8),segment_id=502907cd-3e3c-478f-b989-3f2602eebfc8)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:23.718238 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7e74504b-2ae4-455e-919c-c711bd7220a1 req-10811413-0c86-4310-ab61-4366b5ec9a93 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:23.748473 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-7e74504b-2ae4-455e-919c-c711bd7220a1 req-10811413-0c86-4310-ab61-4366b5ec9a93 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Calling delete_port for 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:51:23.856337 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4fd2c0e0-10f5-4772-8b58-d6b840315251 None None] New status for floating IP 4eb9c6ee-8df6-4019-8824-be233593b289: DOWN {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:51:23.890671 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81a2c402-7626-42f8-83e6-7e85ae2ae9e4 req-db25cffa-a1dc-4e82-880f-fbd39f3412e8 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:23.896751 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-81a2c402-7626-42f8-83e6-7e85ae2ae9e4 req-db25cffa-a1dc-4e82-880f-fbd39f3412e8 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a HTTP/1.1" status: 200 len: 946 time: 0.1359947 Dec 09 21:51:23.937460 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5acb1872-d950-4751-958f-af9bafe79bef no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:51:23.993749 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 5acb1872-d950-4751-958f-af9bafe79bef {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:51:23.994462 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5acb1872-d950-4751-958f-af9bafe79bef not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:51:23.999605 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7e74504b-2ae4-455e-919c-c711bd7220a1 req-10811413-0c86-4310-ab61-4366b5ec9a93 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:24.022393 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-81a2c402-7626-42f8-83e6-7e85ae2ae9e4 req-20a3cbab-d478-4d6c-8392-96defb26abaa tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=d4fc7436-bf9a-45b0-ae03-980628053e8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1172750 Dec 09 21:51:24.037981 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10811413-0c86-4310-ab61-4366b5ec9a93 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event deleted for resources: {'Port': ['ID=7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:24.126331 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-7e74504b-2ae4-455e-919c-c711bd7220a1 req-10811413-0c86-4310-ab61-4366b5ec9a93 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] No DVR routers for this DVR port 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:51:24.133418 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7e74504b-2ae4-455e-919c-c711bd7220a1 req-10811413-0c86-4310-ab61-4366b5ec9a93 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:24.137682 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7e74504b-2ae4-455e-919c-c711bd7220a1 req-10811413-0c86-4310-ab61-4366b5ec9a93 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.31 "DELETE /v2.0/ports/7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 HTTP/1.1" status: 204 len: 173 time: 0.8557377 Dec 09 21:51:24.138437 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a', 'name': 'network-vif-deleted', 'tag': '7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:51:24.141372 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-96956c10-efae-4181-a8e6-b108e4e8c7da" -d '{"events": [{"server_uuid": "6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a", "name": "network-vif-deleted", "tag": "7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:51:24.311491 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-6fae1b63-14b1-4c36-a099-b327e4827f19 req-3a5719a8-9f62-4d35-b6b8-7a3006539970 service neutron] (103437) timed out ('10.222.0.13', 52606) {{(pid=103437) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 09 21:51:24.434220 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51436) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:24.440272 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-739ee1fc-75d0-4b9b-88e2-88722c37f566 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-578938762', 'description': 'tempest-secgroup-smoke-578938762 description', 'project_id': 'dce7594ac2a74901912a2f19de04bf79'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:24.475853 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-739ee1fc-75d0-4b9b-88e2-88722c37f566 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:24.484941 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:51:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d9a0693e-79cd-43e2-acd0-5218cd705db0 x-openstack-request-id: req-d9a0693e-79cd-43e2-acd0-5218cd705db0 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:51:24.485243 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a", "name": "network-vif-deleted", "tag": "7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:51:24.485519 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-d9a0693e-79cd-43e2-acd0-5218cd705db0 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:51:24.485933 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6bf8fc07-760e-4eba-a9aa-aafd7f4efb3a', 'name': 'network-vif-deleted', 'tag': '7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2', 'status': 'completed', 'code': 200} Dec 09 21:51:24.584484 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-739ee1fc-75d0-4b9b-88e2-88722c37f566 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:24.592981 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-739ee1fc-75d0-4b9b-88e2-88722c37f566 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:24.695823 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-739ee1fc-75d0-4b9b-88e2-88722c37f566 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:24.700022 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-739ee1fc-75d0-4b9b-88e2-88722c37f566 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.2618756 Dec 09 21:51:24.700022 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-739ee1fc-75d0-4b9b-88e2-88722c37f566 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1731c834-efb2-47cd-b818-853b3aef0517,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:24.700346 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51442) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:24.705305 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-103c2933-3918-4050-9194-5a81179a3dcb tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group_rule': {'security_group_id': '1731c834-efb2-47cd-b818-853b3aef0517', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:24.761664 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-103c2933-3918-4050-9194-5a81179a3dcb tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:24.870067 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-103c2933-3918-4050-9194-5a81179a3dcb tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:24.876312 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-103c2933-3918-4050-9194-5a81179a3dcb tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:24.899623 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-103c2933-3918-4050-9194-5a81179a3dcb tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=79519da1-4bb4-428f-a21f-2ba57dda679a,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:24.909511 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-103c2933-3918-4050-9194-5a81179a3dcb tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:24.910790 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-103c2933-3918-4050-9194-5a81179a3dcb tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2092226 Dec 09 21:51:24.913665 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51446) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:24.919284 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a76bcf2c-1266-4543-bfdf-7cf46b2ca48b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group_rule': {'security_group_id': '1731c834-efb2-47cd-b818-853b3aef0517', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:24.954604 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a76bcf2c-1266-4543-bfdf-7cf46b2ca48b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.032716 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a76bcf2c-1266-4543-bfdf-7cf46b2ca48b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.038158 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a76bcf2c-1266-4543-bfdf-7cf46b2ca48b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.068241 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a76bcf2c-1266-4543-bfdf-7cf46b2ca48b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f99f13b1-3b8b-433c-9555-c9702c7a95b5,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:25.076690 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a76bcf2c-1266-4543-bfdf-7cf46b2ca48b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.077120 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a76bcf2c-1266-4543-bfdf-7cf46b2ca48b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1622677 Dec 09 21:51:25.080193 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51458) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:25.085346 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-5655c8ef-384a-4785-98ac-58827ccda708 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group_rule': {'security_group_id': '1731c834-efb2-47cd-b818-853b3aef0517', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:25.118839 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5655c8ef-384a-4785-98ac-58827ccda708 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.174461 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51460) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:25.216861 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5655c8ef-384a-4785-98ac-58827ccda708 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.231532 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5655c8ef-384a-4785-98ac-58827ccda708 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.264452 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5655c8ef-384a-4785-98ac-58827ccda708 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=da9b4877-5c9f-437b-bb05-0fe605655964,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:25.276299 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-62906400-20be-4f52-a36e-850f4458b91f tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.286051 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5655c8ef-384a-4785-98ac-58827ccda708 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.289866 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5655c8ef-384a-4785-98ac-58827ccda708 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2063367 Dec 09 21:51:25.290148 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51462) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:25.296302 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-05682a3e-79a1-4e51-ba20-2f68f679cbc3 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group_rule': {'security_group_id': '1731c834-efb2-47cd-b818-853b3aef0517', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:25.312286 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-62906400-20be-4f52-a36e-850f4458b91f tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.333634 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-05682a3e-79a1-4e51-ba20-2f68f679cbc3 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.397641 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-62906400-20be-4f52-a36e-850f4458b91f tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.404285 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-62906400-20be-4f52-a36e-850f4458b91f tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.406854 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-62906400-20be-4f52-a36e-850f4458b91f tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "DELETE /v2.0/security-groups/d4fc7436-bf9a-45b0-ae03-980628053e8f HTTP/1.1" status: 204 len: 168 time: 0.2307053 Dec 09 21:51:25.409085 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-05682a3e-79a1-4e51-ba20-2f68f679cbc3 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.420053 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62906400-20be-4f52-a36e-850f4458b91f tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d4fc7436-bf9a-45b0-ae03-980628053e8f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:25.425276 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-05682a3e-79a1-4e51-ba20-2f68f679cbc3 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.456621 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05682a3e-79a1-4e51-ba20-2f68f679cbc3 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2ede0e75-e4b5-4338-996e-44d81e340bb0,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:25.474671 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51472) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:25.479038 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-05682a3e-79a1-4e51-ba20-2f68f679cbc3 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.483123 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-05682a3e-79a1-4e51-ba20-2f68f679cbc3 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1891534 Dec 09 21:51:25.483423 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51474) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:25.488525 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-38ff5d59-a138-42cb-8733-cfc70ade0688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group_rule': {'security_group_id': '1731c834-efb2-47cd-b818-853b3aef0517', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:25.520554 n-d-713301-27 neutron-server[103438]: INFO neutron.db.securitygroups_db [None req-38ff5d59-a138-42cb-8733-cfc70ade0688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Project dce7594ac2a74901912a2f19de04bf79 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 21:51:25.526191 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-38ff5d59-a138-42cb-8733-cfc70ade0688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.610524 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-38ff5d59-a138-42cb-8733-cfc70ade0688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.617188 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-38ff5d59-a138-42cb-8733-cfc70ade0688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.647000 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38ff5d59-a138-42cb-8733-cfc70ade0688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=89f1ed0a-c772-4261-a42c-50a2b254871d,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:25.654100 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-38ff5d59-a138-42cb-8733-cfc70ade0688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.658245 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-38ff5d59-a138-42cb-8733-cfc70ade0688 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1736331 Dec 09 21:51:25.658873 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51480) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:25.663616 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-b7ca8219-c214-4f3c-9e53-5a6e33da6dc6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'security_group_rule': {'security_group_id': '1731c834-efb2-47cd-b818-853b3aef0517', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:25.700635 n-d-713301-27 neutron-server[103438]: INFO neutron.db.securitygroups_db [None req-b7ca8219-c214-4f3c-9e53-5a6e33da6dc6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Project dce7594ac2a74901912a2f19de04bf79 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 21:51:25.707837 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7ca8219-c214-4f3c-9e53-5a6e33da6dc6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.820023 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7ca8219-c214-4f3c-9e53-5a6e33da6dc6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.833159 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7ca8219-c214-4f3c-9e53-5a6e33da6dc6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.863685 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b7ca8219-c214-4f3c-9e53-5a6e33da6dc6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.868303 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b7ca8219-c214-4f3c-9e53-5a6e33da6dc6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2082670 Dec 09 21:51:25.869055 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51484) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:25.877034 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-8ee9740e-31bf-4faa-8548-0b2b65608fbe tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'network': {'name': 'tempest-network-smoke--1030235756', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'port_security_enabled': True}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:25.883106 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7ca8219-c214-4f3c-9e53-5a6e33da6dc6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b6efd63c-c765-480b-aef3-b32b928577da,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:25.911176 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8ee9740e-31bf-4faa-8548-0b2b65608fbe tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Made reservation on behalf of dce7594ac2a74901912a2f19de04bf79 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:51:25.917693 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8ee9740e-31bf-4faa-8548-0b2b65608fbe tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.950734 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8ee9740e-31bf-4faa-8548-0b2b65608fbe tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] vlan segment allocate from pool success with {'vlan_id': 112, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:51:25.965158 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8ee9740e-31bf-4faa-8548-0b2b65608fbe tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:25.965556 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-8ee9740e-31bf-4faa-8548-0b2b65608fbe tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Added segment bbcc9b75-8c59-49b6-9441-82060a46e422 of type vlan for network dbbab540-d32c-4ae4-8405-4fd5a5d9b94c Dec 09 21:51:26.015975 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8ee9740e-31bf-4faa-8548-0b2b65608fbe tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:26.049499 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8ee9740e-31bf-4faa-8548-0b2b65608fbe tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:26.057077 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8ee9740e-31bf-4faa-8548-0b2b65608fbe tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:26.058048 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8ee9740e-31bf-4faa-8548-0b2b65608fbe tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:26.157594 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8ee9740e-31bf-4faa-8548-0b2b65608fbe tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.2851648 Dec 09 21:51:26.160750 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51490) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:26.167020 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-849d92bb-81fd-4541-844e-22a41c2f13d2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-279236251', 'admin_state_up': True, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:26.174921 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ee9740e-31bf-4faa-8548-0b2b65608fbe tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Network': ['ID=dbbab540-d32c-4ae4-8405-4fd5a5d9b94c,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:26.188894 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network dbbab540-d32c-4ae4-8405-4fd5a5d9b94c details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:51:26.196983 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-849d92bb-81fd-4541-844e-22a41c2f13d2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:26.198804 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-849d92bb-81fd-4541-844e-22a41c2f13d2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:26.284750 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-849d92bb-81fd-4541-844e-22a41c2f13d2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:26.381850 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae92b45f-435f-46e3-803b-9d685db96940 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:26.526224 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-849d92bb-81fd-4541-844e-22a41c2f13d2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:26.824224 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-849d92bb-81fd-4541-844e-22a41c2f13d2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:26.846276 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-849d92bb-81fd-4541-844e-22a41c2f13d2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:26.885669 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-ae92b45f-435f-46e3-803b-9d685db96940 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Deleting port efd747c8-9308-4be4-8445-86a9ce208bf3 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:51:26.886035 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae92b45f-435f-46e3-803b-9d685db96940 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:27.232502 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-ae92b45f-435f-46e3-803b-9d685db96940 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] For port efd747c8-9308-4be4-8445-86a9ce208bf3, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=efd747c8-9308-4be4-8445-86a9ce208bf3,segment=NetworkSegment(502907cd-3e3c-478f-b989-3f2602eebfc8),segment_id=502907cd-3e3c-478f-b989-3f2602eebfc8)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:27.232502 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae92b45f-435f-46e3-803b-9d685db96940 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:27.232502 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-ae92b45f-435f-46e3-803b-9d685db96940 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Calling delete_port for efd747c8-9308-4be4-8445-86a9ce208bf3 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:51:27.240365 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-849d92bb-81fd-4541-844e-22a41c2f13d2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Allocated IP 172.25.3.80 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/b3e30202-b84c-499d-8636-99b6c3b89dde) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:51:27.288525 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-849d92bb-81fd-4541-844e-22a41c2f13d2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:27.346378 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:27.349101 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-849d92bb-81fd-4541-844e-22a41c2f13d2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:27.389916 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae92b45f-435f-46e3-803b-9d685db96940 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:27.416073 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-849d92bb-81fd-4541-844e-22a41c2f13d2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:51:27.420754 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-849d92bb-81fd-4541-844e-22a41c2f13d2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:51:27.424581 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae92b45f-435f-46e3-803b-9d685db96940 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event deleted for resources: {'Port': ['ID=efd747c8-9308-4be4-8445-86a9ce208bf3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:27.444790 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-849d92bb-81fd-4541-844e-22a41c2f13d2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:51:27.448840 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-13307631-7f08-4442-af66-c104256fcfb4 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:51:27.538500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-849d92bb-81fd-4541-844e-22a41c2f13d2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Port': ['ID=b3e30202-b84c-499d-8636-99b6c3b89dde,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:27.581774 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:51:27.660236 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:27.669461 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:51:27.670453 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 7f02c7eb-5c11-4a63-a2b8-31e6197d3bd2 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:51:27.686691 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-61af20ae-f4e7-4ce1-9fea-be69a77b813f None None] Provisioning complete for port b3e30202-b84c-499d-8636-99b6c3b89dde triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:27.686691 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-61af20ae-f4e7-4ce1-9fea-be69a77b813f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:27.771037 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-61af20ae-f4e7-4ce1-9fea-be69a77b813f None None] Port b3e30202-b84c-499d-8636-99b6c3b89dde cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:51:27.782950 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae92b45f-435f-46e3-803b-9d685db96940 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:27.974578 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-849d92bb-81fd-4541-844e-22a41c2f13d2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:28.211291 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ae92b45f-435f-46e3-803b-9d685db96940 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:51:28.392049 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ae92b45f-435f-46e3-803b-9d685db96940 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:51:28.393438 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-849d92bb-81fd-4541-844e-22a41c2f13d2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:28.412297 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4be68fee-ded5-438a-a021-bf5c296e745f None None] Sync routers for ids ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:51:28.416166 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ae92b45f-435f-46e3-803b-9d685db96940 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "PUT /v2.0/routers/6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9391148 Dec 09 21:51:28.418268 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51550) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:28.451670 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4be68fee-ded5-438a-a021-bf5c296e745f None None] Routers {'6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:51:28.452322 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-4be68fee-ded5-438a-a021-bf5c296e745f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:51:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:28.564796 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-eec7c92e-3f45-480c-9a6b-07e50adb3549 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Deleting subnet 01104ce9-312c-40a5-b51d-c30bc463bf2c {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:51:28.568563 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eec7c92e-3f45-480c-9a6b-07e50adb3549 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:28.642204 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-4be68fee-ded5-438a-a021-bf5c296e745f None None] Set router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:51:28.655556 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eec7c92e-3f45-480c-9a6b-07e50adb3549 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:28.881977 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eec7c92e-3f45-480c-9a6b-07e50adb3549 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:28.952765 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-4be68fee-ded5-438a-a021-bf5c296e745f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'name': 'tempest-TestNetworkBasicOps-router-792281405', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36'}], 'enable_snat': True}, 'gw_port_id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:51:27Z', 'revision_number': 7, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:2c:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3592, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:29.028349 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eec7c92e-3f45-480c-9a6b-07e50adb3549 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:29.031568 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4be68fee-ded5-438a-a021-bf5c296e745f None None] Checking router: 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:51:29.040719 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4be68fee-ded5-438a-a021-bf5c296e745f None None] Routers {'6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:51:29.041164 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-4be68fee-ded5-438a-a021-bf5c296e745f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:51:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:29.046366 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eec7c92e-3f45-480c-9a6b-07e50adb3549 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:29.053283 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-eec7c92e-3f45-480c-9a6b-07e50adb3549 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "DELETE /v2.0/subnets/01104ce9-312c-40a5-b51d-c30bc463bf2c HTTP/1.1" status: 204 len: 168 time: 0.6335399 Dec 09 21:51:29.055315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51568) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:29.073786 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eec7c92e-3f45-480c-9a6b-07e50adb3549 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event deleted for resources: {'Subnet': ['ID=01104ce9-312c-40a5-b51d-c30bc463bf2c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:29.113383 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72e1ecd2-9920-4a96-b6d5-6deacb691b32 None None] Network 5ed1c0c9-0d1a-458b-9180-fe96edb96b56 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:51:29.134709 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-849d92bb-81fd-4541-844e-22a41c2f13d2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Router 9c1d018e-ab43-4dc3-aa27-cf34a503bdd1 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:51:29.346291 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-4be68fee-ded5-438a-a021-bf5c296e745f None None] Set router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:51:29.374697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-849d92bb-81fd-4541-844e-22a41c2f13d2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:51:29.388623 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] Sync routers for ids ['9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:51:29.399877 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] Routers {'9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:51:29.401019 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:51:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:29.513743 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-997b1e0e-efff-4733-8406-92de5cd90bbf tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:29.523085 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19015a7d-02f5-4d82-a86b-e214ef679276 None None] DHCP port deletion for 5ed1c0c9-0d1a-458b-9180-fe96edb96b56 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:51:29.528090 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-849d92bb-81fd-4541-844e-22a41c2f13d2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:29.531508 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-849d92bb-81fd-4541-844e-22a41c2f13d2 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 894 time: 3.3696611 Dec 09 21:51:29.535513 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51584) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:29.564447 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] Set router 9c1d018e-ab43-4dc3-aa27-cf34a503bdd1 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:51:29.694062 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-44122f93-0d94-4310-bc47-5406c87df1a1 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/subnets?project_id=dce7594ac2a74901912a2f19de04bf79&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.1534622 Dec 09 21:51:29.697356 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51592) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:29.812909 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-19015a7d-02f5-4d82-a86b-e214ef679276 None None] Deleting port a9c0abd0-adfe-418f-b8d5-32d910b49066 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:51:29.816200 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-279236251', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80'}], 'enable_snat': True}, 'gw_port_id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:27Z', 'revision_number': 3, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:8c:6f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3762, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:27Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:29.817738 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-19015a7d-02f5-4d82-a86b-e214ef679276 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:29.844596 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] Checking router: 9c1d018e-ab43-4dc3-aa27-cf34a503bdd1 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:51:29.845265 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] Updating router 9c1d018e-ab43-4dc3-aa27-cf34a503bdd1 port b3e30202-b84c-499d-8636-99b6c3b89dde binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:51:29.852564 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-997b1e0e-efff-4733-8406-92de5cd90bbf tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:29.884725 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:29.961243 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a982ae90-3b5c-434a-b20a-03163cc8ebfd tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:29.963330 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a982ae90-3b5c-434a-b20a-03163cc8ebfd tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.2606876 Dec 09 21:51:29.966446 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51596) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:30.014534 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-19015a7d-02f5-4d82-a86b-e214ef679276 None None] For port a9c0abd0-adfe-418f-b8d5-32d910b49066, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a9c0abd0-adfe-418f-b8d5-32d910b49066,segment=NetworkSegment(502907cd-3e3c-478f-b989-3f2602eebfc8),segment_id=502907cd-3e3c-478f-b989-3f2602eebfc8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:30.014972 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-19015a7d-02f5-4d82-a86b-e214ef679276 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:30.024261 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-997b1e0e-efff-4733-8406-92de5cd90bbf tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Deleting port 4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:51:30.024528 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-997b1e0e-efff-4733-8406-92de5cd90bbf tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:30.032346 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7c87fcf9-2b33-439f-a856-8d09a69c5880 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/subnets?network_id=97925a19-460a-4476-8208-41db134b6c83&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0645025 Dec 09 21:51:30.036674 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51600) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:30.041800 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-be5eb02b-fd01-4e13-9f04-7af03a4ee748 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-106128083', 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:30.059081 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-19015a7d-02f5-4d82-a86b-e214ef679276 None None] Calling delete_port for a9c0abd0-adfe-418f-b8d5-32d910b49066 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:51:30.170421 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a9c0abd0-adfe-418f-b8d5-32d910b49066 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:51:30.220042 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-19015a7d-02f5-4d82-a86b-e214ef679276 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:30.240014 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-997b1e0e-efff-4733-8406-92de5cd90bbf tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] For port 4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:30.241001 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-997b1e0e-efff-4733-8406-92de5cd90bbf tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:30.265300 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-997b1e0e-efff-4733-8406-92de5cd90bbf tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Calling delete_port for 4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7 owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:51:30.269152 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-4be68fee-ded5-438a-a021-bf5c296e745f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'name': 'tempest-TestNetworkBasicOps-router-792281405', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36'}], 'enable_snat': True}, 'gw_port_id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:51:27Z', 'revision_number': 7, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:2c:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3592, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:30.271658 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19015a7d-02f5-4d82-a86b-e214ef679276 None None] Pushing event deleted for resources: {'Port': ['ID=a9c0abd0-adfe-418f-b8d5-32d910b49066,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:30.273948 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19015a7d-02f5-4d82-a86b-e214ef679276 None None] No DVR routers for this DVR port a9c0abd0-adfe-418f-b8d5-32d910b49066 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:51:30.278673 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No active binding found for port a9c0abd0-adfe-418f-b8d5-32d910b49066 {{(pid=103439) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:216}} Dec 09 21:51:30.279406 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a9c0abd0-adfe-418f-b8d5-32d910b49066 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:51:30.324016 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4be68fee-ded5-438a-a021-bf5c296e745f None None] The sync data for ids ['6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b'] in n-d-713301-27 is: [{'id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'name': 'tempest-TestNetworkBasicOps-router-792281405', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36'}], 'enable_snat': True}, 'gw_port_id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:51:27Z', 'revision_number': 7, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:29:2c:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3592, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:49:24Z', 'updated_at': '2021-12-09T21:49:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:51:30.376299 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-be5eb02b-fd01-4e13-9f04-7af03a4ee748 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Made reservation on behalf of dce7594ac2a74901912a2f19de04bf79 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:51:30.385743 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-be5eb02b-fd01-4e13-9f04-7af03a4ee748 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:30.496271 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:30.509338 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:30.551349 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a089af1-c372-483d-889f-b207b487ff94 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:51:30.627100 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7d2d8625-37fa-424f-9c68-927fc0688b0a None None] Provisioning complete for port b3e30202-b84c-499d-8636-99b6c3b89dde triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:30.627778 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7d2d8625-37fa-424f-9c68-927fc0688b0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:30.628323 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44aa3452-3ead-493a-89dc-37222c620025 None None] Pushing event updated for resources: {'Port': ['ID=b3e30202-b84c-499d-8636-99b6c3b89dde,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:30.682935 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] Attempting to bind port b3e30202-b84c-499d-8636-99b6c3b89dde on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:51:30.683578 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] Attempting to bind port b3e30202-b84c-499d-8636-99b6c3b89dde by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:51:30.684147 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] Attempting to bind port b3e30202-b84c-499d-8636-99b6c3b89dde on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:51:30.695393 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44aa3452-3ead-493a-89dc-37222c620025 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:30.696040 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44aa3452-3ead-493a-89dc-37222c620025 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:30.696613 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44aa3452-3ead-493a-89dc-37222c620025 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:30.697814 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44aa3452-3ead-493a-89dc-37222c620025 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:30.698680 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44aa3452-3ead-493a-89dc-37222c620025 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:30.699581 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44aa3452-3ead-493a-89dc-37222c620025 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:30.700291 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44aa3452-3ead-493a-89dc-37222c620025 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:30.700785 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44aa3452-3ead-493a-89dc-37222c620025 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:30.712618 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44aa3452-3ead-493a-89dc-37222c620025 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:30.717263 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44aa3452-3ead-493a-89dc-37222c620025 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:30.717879 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44aa3452-3ead-493a-89dc-37222c620025 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:30.718377 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44aa3452-3ead-493a-89dc-37222c620025 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:30.719677 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44aa3452-3ead-493a-89dc-37222c620025 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:30.730383 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-997b1e0e-efff-4733-8406-92de5cd90bbf tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:30.731163 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 51, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:51:30.731796 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:51:30.732410 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:30.732997 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:51:30.734960 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] Bound port: b3e30202-b84c-499d-8636-99b6c3b89dde, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:51:30.736375 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:30.796951 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-7d2d8625-37fa-424f-9c68-927fc0688b0a None None] Port b3e30202-b84c-499d-8636-99b6c3b89dde cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:51:30.837012 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-be5eb02b-fd01-4e13-9f04-7af03a4ee748 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:30.837666 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a6af7aca-1a76-4158-9f6e-5a413d8c34c5 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:51:30.856032 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-997b1e0e-efff-4733-8406-92de5cd90bbf tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event deleted for resources: {'Port': ['ID=4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:30.921585 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] For port b3e30202-b84c-499d-8636-99b6c3b89dde, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:51:30.927611 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] For port b3e30202-b84c-499d-8636-99b6c3b89dde, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b3e30202-b84c-499d-8636-99b6c3b89dde,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:51:30.937060 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:30.955757 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-997b1e0e-efff-4733-8406-92de5cd90bbf tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:31.031017 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be5eb02b-fd01-4e13-9f04-7af03a4ee748 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Subnet': ['ID=df92f5f0-ea14-470b-bca7-c613b8daecf5,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:31.047746 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-199365a3-c279-463c-a623-ee586c7eccdc None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:51:31.054838 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44aa3452-3ead-493a-89dc-37222c620025 None None] Pushing event updated for resources: {'Port': ['ID=b3e30202-b84c-499d-8636-99b6c3b89dde,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:31.060403 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] Routers {'9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:51:31.063484 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-be5eb02b-fd01-4e13-9f04-7af03a4ee748 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Checking segment: {'id': 'bbcc9b75-8c59-49b6-9441-82060a46e422', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:51:31.063843 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be5eb02b-fd01-4e13-9f04-7af03a4ee748 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network hostable DHCP agents. Network: dbbab540-d32c-4ae4-8405-4fd5a5d9b94c, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:51:31.064567 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:51:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:31.098339 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be5eb02b-fd01-4e13-9f04-7af03a4ee748 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network dbbab540-d32c-4ae4-8405-4fd5a5d9b94c is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:51:31.133561 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-be5eb02b-fd01-4e13-9f04-7af03a4ee748 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, dbbab540-d32c-4ae4-8405-4fd5a5d9b94c) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:51:31.141239 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9745f2d0-3db9-4fea-ba71-07bb0ac95b37 None None] Network dbbab540-d32c-4ae4-8405-4fd5a5d9b94c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:51:31.143306 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be5eb02b-fd01-4e13-9f04-7af03a4ee748 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:31.144016 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-be5eb02b-fd01-4e13-9f04-7af03a4ee748 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:31.180984 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-be5eb02b-fd01-4e13-9f04-7af03a4ee748 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 1.1406491 Dec 09 21:51:31.181575 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51626) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:31.209031 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-997b1e0e-efff-4733-8406-92de5cd90bbf tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:31.211766 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-997b1e0e-efff-4733-8406-92de5cd90bbf tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:31.323420 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-997b1e0e-efff-4733-8406-92de5cd90bbf tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:31.324796 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-997b1e0e-efff-4733-8406-92de5cd90bbf tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Fanout notify agent at l3_agent the message router_deleted on router 6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:51:31.330236 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] Set router 9c1d018e-ab43-4dc3-aa27-cf34a503bdd1 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:51:31.346502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-922484e7-751d-4a34-b0ca-473eeb034d37 None None] Provisioning complete for port b3e30202-b84c-499d-8636-99b6c3b89dde triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:31.347148 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-922484e7-751d-4a34-b0ca-473eeb034d37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:31.363365 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-997b1e0e-efff-4733-8406-92de5cd90bbf tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:31.371987 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-997b1e0e-efff-4733-8406-92de5cd90bbf tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "DELETE /v2.0/routers/6d98b334-8a6e-49bb-8fdc-7aaf8dc2296b HTTP/1.1" status: 204 len: 168 time: 2.3135462 Dec 09 21:51:31.373549 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51634) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:31.479029 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb644a19-49a7-4580-ad88-921de80d2a88 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-dbbab540-d32c-4ae4-8405-4fd5a5d9b94c', 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c', 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'fixed_ips': [{'subnet_id': 'df92f5f0-ea14-470b-bca7-c613b8daecf5'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:51:31.483246 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb644a19-49a7-4580-ad88-921de80d2a88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:31.589160 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-34a19c96-e390-4e2c-9c3c-9629194e370b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:31.702492 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-922484e7-751d-4a34-b0ca-473eeb034d37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:31.726450 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-922484e7-751d-4a34-b0ca-473eeb034d37 None None] For port b3e30202-b84c-499d-8636-99b6c3b89dde, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b3e30202-b84c-499d-8636-99b6c3b89dde,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:31.749719 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-922484e7-751d-4a34-b0ca-473eeb034d37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:31.824958 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-279236251', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80'}], 'enable_snat': True}, 'gw_port_id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:27Z', 'revision_number': 3, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:8c:6f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3762, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:30Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:31.858124 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7bb2214-3643-4c56-b347-bab3841fa428 None None] The sync data for ids ['9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'] in n-d-713301-27 is: [{'id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-279236251', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80'}], 'enable_snat': True}, 'gw_port_id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:27Z', 'revision_number': 3, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:8c:6f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3762, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:30Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:51:31.916832 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-34a19c96-e390-4e2c-9c3c-9629194e370b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:31.950645 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-922484e7-751d-4a34-b0ca-473eeb034d37 None None] Pushing event updated for resources: {'Port': ['ID=b3e30202-b84c-499d-8636-99b6c3b89dde,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:31.983487 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-eb644a19-49a7-4580-ad88-921de80d2a88 None None] Allocated IP 172.20.0.2 (dbbab540-d32c-4ae4-8405-4fd5a5d9b94c/df92f5f0-ea14-470b-bca7-c613b8daecf5/9af3cfd9-c449-420f-a79b-81fa9c03465d) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:51:31.995877 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-34a19c96-e390-4e2c-9c3c-9629194e370b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5ed1c0c9-0d1a-458b-9180-fe96edb96b56']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:32.019159 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-34a19c96-e390-4e2c-9c3c-9629194e370b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '502907cd-3e3c-478f-b989-3f2602eebfc8') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:32.019349 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-34a19c96-e390-4e2c-9c3c-9629194e370b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '502907cd-3e3c-478f-b989-3f2602eebfc8') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:32.056623 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-34a19c96-e390-4e2c-9c3c-9629194e370b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:32.099752 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-34a19c96-e390-4e2c-9c3c-9629194e370b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:32.115803 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-34a19c96-e390-4e2c-9c3c-9629194e370b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Releasing vlan 136 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:51:32.116504 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-34a19c96-e390-4e2c-9c3c-9629194e370b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:51:32.197866 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:51:32.256527 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:51:32.265032 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-34a19c96-e390-4e2c-9c3c-9629194e370b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:32.273107 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-34a19c96-e390-4e2c-9c3c-9629194e370b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:32.288271 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-34a19c96-e390-4e2c-9c3c-9629194e370b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "DELETE /v2.0/networks/5ed1c0c9-0d1a-458b-9180-fe96edb96b56 HTTP/1.1" status: 204 len: 168 time: 0.9135947 Dec 09 21:51:32.309624 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51654) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:32.333972 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-38d051a8-747c-47d4-a8bf-a6e40c0785e9 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'network': {'name': 'tempest-network-smoke--1838338455', 'project_id': 'e863bf78256945798e7c717c650258aa', 'port_security_enabled': True}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:32.343350 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:51:32.344060 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 4cd4b83c-b1e4-46ce-a2f4-16fd7539bdc7 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:51:32.344418 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device efd747c8-9308-4be4-8445-86a9ce208bf3 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:51:32.365272 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34a19c96-e390-4e2c-9c3c-9629194e370b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event deleted for resources: {'Network': ['ID=5ed1c0c9-0d1a-458b-9180-fe96edb96b56,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:32.423375 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: efd747c8-9308-4be4-8445-86a9ce208bf3 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:51:32.423749 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device efd747c8-9308-4be4-8445-86a9ce208bf3 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:51:32.440449 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-38d051a8-747c-47d4-a8bf-a6e40c0785e9 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Made reservation on behalf of e863bf78256945798e7c717c650258aa for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:51:32.444070 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-38d051a8-747c-47d4-a8bf-a6e40c0785e9 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:32.480186 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4e1d234c-bffe-4547-834d-8f986139b5af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:32.502504 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-38d051a8-747c-47d4-a8bf-a6e40c0785e9 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] vlan segment allocate from pool success with {'vlan_id': 144, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:51:32.517734 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-38d051a8-747c-47d4-a8bf-a6e40c0785e9 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:32.519770 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-38d051a8-747c-47d4-a8bf-a6e40c0785e9 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Added segment dc0bd24b-5723-4625-bde4-525782b5f73e of type vlan for network 5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3 Dec 09 21:51:32.558668 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb644a19-49a7-4580-ad88-921de80d2a88 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:32.582674 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb644a19-49a7-4580-ad88-921de80d2a88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:32.624887 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-38d051a8-747c-47d4-a8bf-a6e40c0785e9 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:32.643923 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb644a19-49a7-4580-ad88-921de80d2a88 None None] Pushing event updated for resources: {'Port': ['ID=9af3cfd9-c449-420f-a79b-81fa9c03465d,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:32.657754 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb644a19-49a7-4580-ad88-921de80d2a88 None None] Network dbbab540-d32c-4ae4-8405-4fd5a5d9b94c is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:51:32.659968 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-eb644a19-49a7-4580-ad88-921de80d2a88 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:51:32.662581 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb644a19-49a7-4580-ad88-921de80d2a88 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:51:32.717731 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-38d051a8-747c-47d4-a8bf-a6e40c0785e9 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:32.732747 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-38d051a8-747c-47d4-a8bf-a6e40c0785e9 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:32.733416 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-38d051a8-747c-47d4-a8bf-a6e40c0785e9 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:32.885566 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38d051a8-747c-47d4-a8bf-a6e40c0785e9 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'Network': ['ID=5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:32.905257 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-38d051a8-747c-47d4-a8bf-a6e40c0785e9 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.5837538 Dec 09 21:51:32.909073 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51668) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:32.920746 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-8cdd3339-c8bb-4131-b5df-5835fe1fc5d1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'router': {'name': 'tempest-TestNetworkBasicOps-router-421012370', 'admin_state_up': True, 'project_id': 'e863bf78256945798e7c717c650258aa', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:32.963065 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8cdd3339-c8bb-4131-b5df-5835fe1fc5d1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:32.965913 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8cdd3339-c8bb-4131-b5df-5835fe1fc5d1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:33.073217 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:51:33.081493 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8cdd3339-c8bb-4131-b5df-5835fe1fc5d1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:33.145977 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2bc101f3-a572-4ac0-9f3e-e55feb8a19f7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:33.162258 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-eb644a19-49a7-4580-ad88-921de80d2a88 None None] Attempting to bind port 9af3cfd9-c449-420f-a79b-81fa9c03465d on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:51:33.162918 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-eb644a19-49a7-4580-ad88-921de80d2a88 None None] Attempting to bind port 9af3cfd9-c449-420f-a79b-81fa9c03465d by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'bbcc9b75-8c59-49b6-9441-82060a46e422', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:51:33.163388 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb644a19-49a7-4580-ad88-921de80d2a88 None None] Attempting to bind port 9af3cfd9-c449-420f-a79b-81fa9c03465d on network dbbab540-d32c-4ae4-8405-4fd5a5d9b94c {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:51:33.222935 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb644a19-49a7-4580-ad88-921de80d2a88 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 51, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:51:33.225229 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb644a19-49a7-4580-ad88-921de80d2a88 None None] Checking segment: {'id': 'bbcc9b75-8c59-49b6-9441-82060a46e422', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:51:33.226969 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb644a19-49a7-4580-ad88-921de80d2a88 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:33.227517 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb644a19-49a7-4580-ad88-921de80d2a88 None None] Bound using segment: {'id': 'bbcc9b75-8c59-49b6-9441-82060a46e422', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:51:33.228163 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-eb644a19-49a7-4580-ad88-921de80d2a88 None None] Bound port: 9af3cfd9-c449-420f-a79b-81fa9c03465d, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bbcc9b75-8c59-49b6-9441-82060a46e422', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:51:33.228662 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb644a19-49a7-4580-ad88-921de80d2a88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:33.346797 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-4e1d234c-bffe-4547-834d-8f986139b5af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Allocated IP 172.20.0.1 (dbbab540-d32c-4ae4-8405-4fd5a5d9b94c/df92f5f0-ea14-470b-bca7-c613b8daecf5/34b5b36b-2611-4360-8169-d595d507e923) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:51:33.410102 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8cdd3339-c8bb-4131-b5df-5835fe1fc5d1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:33.444032 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-eb644a19-49a7-4580-ad88-921de80d2a88 None None] For port 9af3cfd9-c449-420f-a79b-81fa9c03465d, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:51:33.456235 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-eb644a19-49a7-4580-ad88-921de80d2a88 None None] For port 9af3cfd9-c449-420f-a79b-81fa9c03465d, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9af3cfd9-c449-420f-a79b-81fa9c03465d,segment=NetworkSegment(bbcc9b75-8c59-49b6-9441-82060a46e422),segment_id=bbcc9b75-8c59-49b6-9441-82060a46e422)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:51:33.463655 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb644a19-49a7-4580-ad88-921de80d2a88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:33.546778 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb644a19-49a7-4580-ad88-921de80d2a88 None None] Pushing event updated for resources: {'Port': ['ID=9af3cfd9-c449-420f-a79b-81fa9c03465d,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:33.665217 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4e1d234c-bffe-4547-834d-8f986139b5af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:33.739237 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4e1d234c-bffe-4547-834d-8f986139b5af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:33.871916 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e1d234c-bffe-4547-834d-8f986139b5af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network dbbab540-d32c-4ae4-8405-4fd5a5d9b94c is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:51:33.874397 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-4e1d234c-bffe-4547-834d-8f986139b5af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:51:33.900671 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e1d234c-bffe-4547-834d-8f986139b5af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:51:33.994068 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e1d234c-bffe-4547-834d-8f986139b5af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Port': ['ID=34b5b36b-2611-4360-8169-d595d507e923,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:34.017707 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4e1d234c-bffe-4547-834d-8f986139b5af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:34.028507 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b3e30202-b84c-499d-8636-99b6c3b89dde up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:51:34.070380 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8cdd3339-c8bb-4131-b5df-5835fe1fc5d1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:34.123219 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8cdd3339-c8bb-4131-b5df-5835fe1fc5d1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:34.180664 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port b3e30202-b84c-499d-8636-99b6c3b89dde triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:34.181195 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:34.376485 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-8cdd3339-c8bb-4131-b5df-5835fe1fc5d1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Allocated IP 172.25.3.48 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/686c9484-e87b-44c7-bb33-f79163a23d69) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:51:34.607056 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8cdd3339-c8bb-4131-b5df-5835fe1fc5d1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:34.685988 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8cdd3339-c8bb-4131-b5df-5835fe1fc5d1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:34.785117 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8cdd3339-c8bb-4131-b5df-5835fe1fc5d1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:51:34.787121 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-8cdd3339-c8bb-4131-b5df-5835fe1fc5d1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:51:34.792788 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8cdd3339-c8bb-4131-b5df-5835fe1fc5d1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:51:34.802801 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5c83475f-4e16-4046-b448-89ee2d7bd0ad None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:51:34.855853 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cdd3339-c8bb-4131-b5df-5835fe1fc5d1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'Port': ['ID=686c9484-e87b-44c7-bb33-f79163a23d69,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:34.897261 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4e1d234c-bffe-4547-834d-8f986139b5af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:34.933808 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-acfdcd1f-087f-47f5-9f01-a8b797b469c4 None None] Provisioning complete for port 686c9484-e87b-44c7-bb33-f79163a23d69 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:34.934180 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-acfdcd1f-087f-47f5-9f01-a8b797b469c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:35.016622 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-acfdcd1f-087f-47f5-9f01-a8b797b469c4 None None] Port 686c9484-e87b-44c7-bb33-f79163a23d69 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:51:35.304138 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8cdd3339-c8bb-4131-b5df-5835fe1fc5d1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:35.584622 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e12841a0-fe6e-4629-8cee-71b69afe49e2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:35.601905 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4e1d234c-bffe-4547-834d-8f986139b5af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:35.616601 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4e1d234c-bffe-4547-834d-8f986139b5af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:35.718065 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8cdd3339-c8bb-4131-b5df-5835fe1fc5d1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:35.765576 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4e1d234c-bffe-4547-834d-8f986139b5af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:35.769389 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e1d234c-bffe-4547-834d-8f986139b5af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Port': ['ID=34b5b36b-2611-4360-8169-d595d507e923,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:35.935336 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e1d234c-bffe-4547-834d-8f986139b5af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network dbbab540-d32c-4ae4-8405-4fd5a5d9b94c is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:51:35.937557 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-4e1d234c-bffe-4547-834d-8f986139b5af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:51:36.002318 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8cdd3339-c8bb-4131-b5df-5835fe1fc5d1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Router ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:51:36.029254 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65c16961-705c-419d-bf74-0a02c7e9f549 None None] Network dbbab540-d32c-4ae4-8405-4fd5a5d9b94c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:51:36.058458 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9af3cfd9-c449-420f-a79b-81fa9c03465d up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:51:36.110467 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4e1d234c-bffe-4547-834d-8f986139b5af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Router 9c1d018e-ab43-4dc3-aa27-cf34a503bdd1 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:51:36.188054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4e0a32b8-bb8f-4cd8-b8bf-7cfab4ecd605 None None] Provisioning complete for port 9af3cfd9-c449-420f-a79b-81fa9c03465d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:36.189398 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4e0a32b8-bb8f-4cd8-b8bf-7cfab4ecd605 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:36.288776 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8cdd3339-c8bb-4131-b5df-5835fe1fc5d1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:51:36.295146 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4e1d234c-bffe-4547-834d-8f986139b5af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:51:36.306136 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4e1d234c-bffe-4547-834d-8f986139b5af tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "PUT /v2.0/routers/9c1d018e-ab43-4dc3-aa27-cf34a503bdd1/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.1233566 Dec 09 21:51:36.312026 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] Sync routers for ids ['ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:51:36.317873 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] Sync routers for ids ['9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:51:36.320773 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 9af3cfd9-c449-420f-a79b-81fa9c03465d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:36.321573 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:36.341284 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] Routers {'9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:51:36.343500 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:51:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:36.361609 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8cdd3339-c8bb-4131-b5df-5835fe1fc5d1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:36.363306 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8cdd3339-c8bb-4131-b5df-5835fe1fc5d1 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 885 time: 3.4523597 Dec 09 21:51:36.367919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] Routers {'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:51:36.367919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:51:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:36.368342 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51752) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:36.470318 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-04610cf6-b71c-4dc5-921d-4e7ef10a8f77 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] 10.222.0.13 "GET /v2.0/subnets?project_id=e863bf78256945798e7c717c650258aa&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.1021111 Dec 09 21:51:36.473107 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51758) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:36.561709 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] Set router 9c1d018e-ab43-4dc3-aa27-cf34a503bdd1 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:51:36.625224 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4e0a32b8-bb8f-4cd8-b8bf-7cfab4ecd605 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:36.716086 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8be9787c-8b1d-43ac-8442-9b84aca40343 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:36.721362 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8be9787c-8b1d-43ac-8442-9b84aca40343 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.2449086 Dec 09 21:51:36.724574 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 51772) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:36.741155 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] Set router ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:51:36.887619 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51776) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:36.893758 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-7672ebe9-dd7f-4b71-afbc-a83ff31df6d0 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1264213882', 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3', 'project_id': 'e863bf78256945798e7c717c650258aa', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:36.905295 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-517aacff-a6fc-4fcd-970d-d803469c3033 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] 10.222.0.13 "GET /v2.0/subnets?network_id=97925a19-460a-4476-8208-41db134b6c83&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.1787939 Dec 09 21:51:36.922514 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3731df97-ea3b-472c-ab03-b2139f459158 req-9a415e05-c835-406d-aff0-1a7550c2badb tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-578938762&fields=id&tenant_id=dce7594ac2a74901912a2f19de04bf79 HTTP/1.1" status: 200 len: 267 time: 0.2328458 Dec 09 21:51:36.934844 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-4e0a32b8-bb8f-4cd8-b8bf-7cfab4ecd605 None None] For port 9af3cfd9-c449-420f-a79b-81fa9c03465d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9af3cfd9-c449-420f-a79b-81fa9c03465d,segment=NetworkSegment(bbcc9b75-8c59-49b6-9441-82060a46e422),segment_id=bbcc9b75-8c59-49b6-9441-82060a46e422)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:37.108663 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7672ebe9-dd7f-4b71-afbc-a83ff31df6d0 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Made reservation on behalf of e863bf78256945798e7c717c650258aa for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:51:37.114697 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7672ebe9-dd7f-4b71-afbc-a83ff31df6d0 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:37.148766 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4e0a32b8-bb8f-4cd8-b8bf-7cfab4ecd605 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:37.228438 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e0a32b8-bb8f-4cd8-b8bf-7cfab4ecd605 None None] Pushing event updated for resources: {'Port': ['ID=9af3cfd9-c449-420f-a79b-81fa9c03465d,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:37.236098 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:37.249512 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:37.263761 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3731df97-ea3b-472c-ab03-b2139f459158 req-3f485e14-007d-42c5-a637-893c48577bb7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:37.278104 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3731df97-ea3b-472c-ab03-b2139f459158 req-3f485e14-007d-42c5-a637-893c48577bb7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/networks?id=dbbab540-d32c-4ae4-8405-4fd5a5d9b94c HTTP/1.1" status: 200 len: 797 time: 0.3534346 Dec 09 21:51:37.301765 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3731df97-ea3b-472c-ab03-b2139f459158 req-01ac8e67-169c-4f50-9538-48fa0d42df69 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/quotas/dce7594ac2a74901912a2f19de04bf79 HTTP/1.1" status: 200 len: 375 time: 0.0224633 Dec 09 21:51:37.429686 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3731df97-ea3b-472c-ab03-b2139f459158 req-e6c9551e-2e38-48c3-8d59-e470758e67c8 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1269736 Dec 09 21:51:37.509434 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e98611be-3ca3-404f-aea9-5cf60299c2bb None None] Provisioning complete for port 9af3cfd9-c449-420f-a79b-81fa9c03465d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:37.509807 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e98611be-3ca3-404f-aea9-5cf60299c2bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:37.523558 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-279236251', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80'}], 'enable_snat': True}, 'gw_port_id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:34Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:8c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3762, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '34b5b36b-2611-4360-8169-d595d507e923', 'name': '', 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:78:ac:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'device_owner': 'network:router_interface', 'standard_attr_id': 3767, 'fixed_ips': [{'subnet_id': 'df92f5f0-ea14-470b-bca7-c613b8daecf5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:32Z', 'updated_at': '2021-12-09T21:51:35Z', 'revision_number': 2, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': 'df92f5f0-ea14-470b-bca7-c613b8daecf5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:37.599259 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] Checking router: 9c1d018e-ab43-4dc3-aa27-cf34a503bdd1 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:51:37.599784 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] Updating router 9c1d018e-ab43-4dc3-aa27-cf34a503bdd1 port 34b5b36b-2611-4360-8169-d595d507e923 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:51:37.655033 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:51:37.657142 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:51:37.664292 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7672ebe9-dd7f-4b71-afbc-a83ff31df6d0 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:37.670343 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:37.718465 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3731df97-ea3b-472c-ab03-b2139f459158 req-b5ac3a7d-650d-4bff-9460-776892f1613f service neutron] 10.222.0.13 "GET /v2.0/networks/dbbab540-d32c-4ae4-8405-4fd5a5d9b94c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2652340 Dec 09 21:51:37.788758 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'name': 'tempest-TestNetworkBasicOps-router-421012370', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48'}], 'enable_snat': True}, 'gw_port_id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:32Z', 'updated_at': '2021-12-09T21:51:35Z', 'revision_number': 3, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:55:ea', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3769, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:34Z', 'updated_at': '2021-12-09T21:51:34Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:37.872838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7672ebe9-dd7f-4b71-afbc-a83ff31df6d0 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'Subnet': ['ID=6112c97b-e0b7-4ba1-8f0e-463e550e07f7,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:37.888518 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7672ebe9-dd7f-4b71-afbc-a83ff31df6d0 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Checking segment: {'id': 'dc0bd24b-5723-4625-bde4-525782b5f73e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:51:37.889221 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7672ebe9-dd7f-4b71-afbc-a83ff31df6d0 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Network hostable DHCP agents. Network: 5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:51:37.938248 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7672ebe9-dd7f-4b71-afbc-a83ff31df6d0 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Network 5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:51:37.956636 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-7672ebe9-dd7f-4b71-afbc-a83ff31df6d0 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:51:37.968502 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7672ebe9-dd7f-4b71-afbc-a83ff31df6d0 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:37.969163 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7672ebe9-dd7f-4b71-afbc-a83ff31df6d0 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:37.979363 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3731df97-ea3b-472c-ab03-b2139f459158 req-b9faac1d-5ad2-4e6a-ab8c-831cd63cdd57 service neutron] 10.222.0.13 "GET /v2.0/networks/dbbab540-d32c-4ae4-8405-4fd5a5d9b94c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2597630 Dec 09 21:51:37.991503 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f47457d1-272c-4b6a-8e6a-ff6d9b87c3b5 None None] Network 5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:51:38.003532 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7672ebe9-dd7f-4b71-afbc-a83ff31df6d0 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 1.1144211 Dec 09 21:51:38.006726 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 51804) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:38.130959 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] Checking router: ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:51:38.131397 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] Updating router ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb port 686c9484-e87b-44c7-bb33-f79163a23d69 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:51:38.369234 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:38.388642 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:38.418579 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:38.452554 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-453074d0-44d8-47e4-833c-f1c5e033d189 req-5c85e70c-3506-4eb1-9ba6-49e671622388 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 210 time: 0.1094353 Dec 09 21:51:38.492456 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e98611be-3ca3-404f-aea9-5cf60299c2bb None None] Provisioning complete for port 34b5b36b-2611-4360-8169-d595d507e923 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:38.507765 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e98611be-3ca3-404f-aea9-5cf60299c2bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:38.544406 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] Attempting to bind port 34b5b36b-2611-4360-8169-d595d507e923 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:51:38.544862 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] Attempting to bind port 34b5b36b-2611-4360-8169-d595d507e923 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'bbcc9b75-8c59-49b6-9441-82060a46e422', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:51:38.544997 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] Attempting to bind port 34b5b36b-2611-4360-8169-d595d507e923 on network dbbab540-d32c-4ae4-8405-4fd5a5d9b94c {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:51:38.572666 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 51, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:51:38.573039 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] Checking segment: {'id': 'bbcc9b75-8c59-49b6-9441-82060a46e422', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:51:38.573446 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:38.573832 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] Bound using segment: {'id': 'bbcc9b75-8c59-49b6-9441-82060a46e422', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:51:38.574350 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] Bound port: 34b5b36b-2611-4360-8169-d595d507e923, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bbcc9b75-8c59-49b6-9441-82060a46e422', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:51:38.574730 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:38.663401 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:38.710848 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] For port 34b5b36b-2611-4360-8169-d595d507e923, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:51:38.718257 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] For port 34b5b36b-2611-4360-8169-d595d507e923, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=34b5b36b-2611-4360-8169-d595d507e923,segment=NetworkSegment(bbcc9b75-8c59-49b6-9441-82060a46e422),segment_id=bbcc9b75-8c59-49b6-9441-82060a46e422)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:51:38.733257 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:38.835858 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e457b9ef-2a38-47f4-9926-e9983696afe5 None None] Pushing event updated for resources: {'Port': ['ID=34b5b36b-2611-4360-8169-d595d507e923,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:38.838823 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] Routers {'9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:51:38.839472 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:51:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:39.178504 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e457b9ef-2a38-47f4-9926-e9983696afe5 None None] Pushing event updated for resources: {'Port': ['ID=34b5b36b-2611-4360-8169-d595d507e923,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:39.425515 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] Set router 9c1d018e-ab43-4dc3-aa27-cf34a503bdd1 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:51:39.560852 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e98611be-3ca3-404f-aea9-5cf60299c2bb None None] Port 34b5b36b-2611-4360-8169-d595d507e923 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:51:39.577265 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9af3cfd9-c449-420f-a79b-81fa9c03465d up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:51:39.583837 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-816a7d90-06dd-43b9-b239-7226e657cfe4 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:39.586530 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7aa22d0f-14db-46c7-b391-26d2edce7fcc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3', 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3', 'project_id': 'e863bf78256945798e7c717c650258aa', 'fixed_ips': [{'subnet_id': '6112c97b-e0b7-4ba1-8f0e-463e550e07f7'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:51:39.587403 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7aa22d0f-14db-46c7-b391-26d2edce7fcc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:39.614336 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d1fa639-0695-4416-a265-8c5f37b839c3 req-2984d1e6-e3e6-4121-b560-b1d1bace8a67 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 210 time: 0.0663817 Dec 09 21:51:39.993209 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:40.009116 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-279236251', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80'}], 'enable_snat': True}, 'gw_port_id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:34Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:8c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3762, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '34b5b36b-2611-4360-8169-d595d507e923', 'name': '', 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:78:ac:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'device_owner': 'network:router_interface', 'standard_attr_id': 3767, 'fixed_ips': [{'subnet_id': 'df92f5f0-ea14-470b-bca7-c613b8daecf5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:32Z', 'updated_at': '2021-12-09T21:51:38Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': 'df92f5f0-ea14-470b-bca7-c613b8daecf5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:40.041512 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ea298224-6f7b-4ba4-8b94-31c243e42ec1 None None] The sync data for ids ['9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'] in n-d-713301-27 is: [{'id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-279236251', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80'}], 'enable_snat': True}, 'gw_port_id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:34Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:8c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3762, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '34b5b36b-2611-4360-8169-d595d507e923', 'name': '', 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:78:ac:fa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'device_owner': 'network:router_interface', 'standard_attr_id': 3767, 'fixed_ips': [{'subnet_id': 'df92f5f0-ea14-470b-bca7-c613b8daecf5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:32Z', 'updated_at': '2021-12-09T21:51:38Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': 'df92f5f0-ea14-470b-bca7-c613b8daecf5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:51:40.119937 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:40.201416 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:40.212858 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 9af3cfd9-c449-420f-a79b-81fa9c03465d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:40.213221 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:40.214649 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-04d0bb05-07d1-428c-b5ef-c8eafe2ebb17 None None] Provisioning complete for port 34b5b36b-2611-4360-8169-d595d507e923 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:40.215004 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-04d0bb05-07d1-428c-b5ef-c8eafe2ebb17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:40.441133 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] Attempting to bind port 686c9484-e87b-44c7-bb33-f79163a23d69 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:51:40.441528 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] Attempting to bind port 686c9484-e87b-44c7-bb33-f79163a23d69 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:51:40.441884 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] Attempting to bind port 686c9484-e87b-44c7-bb33-f79163a23d69 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:51:40.458864 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 51, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:51:40.459319 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:51:40.475061 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:40.475061 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:51:40.475061 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] Bound port: 686c9484-e87b-44c7-bb33-f79163a23d69, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:51:40.475061 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:40.475061 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f04d3ac-131f-4e75-9c87-cffbc3c5db92 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:51:40.581294 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b2f29e5-2ab7-470b-88ba-4a0655b4e2f9 None None] Pushing event updated for resources: {'Port': ['ID=686c9484-e87b-44c7-bb33-f79163a23d69,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:40.602138 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-04d0bb05-07d1-428c-b5ef-c8eafe2ebb17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:40.709809 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3731df97-ea3b-472c-ab03-b2139f459158 req-d123e036-5ec2-497f-89fa-c0ac0e359860 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:40.712316 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3731df97-ea3b-472c-ab03-b2139f459158 req-d123e036-5ec2-497f-89fa-c0ac0e359860 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.31 "GET /v2.0/networks?id=dbbab540-d32c-4ae4-8405-4fd5a5d9b94c HTTP/1.1" status: 200 len: 797 time: 0.4642406 Dec 09 21:51:40.718399 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-816a7d90-06dd-43b9-b239-7226e657cfe4 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Allocated IP 172.20.0.1 (5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3/6112c97b-e0b7-4ba1-8f0e-463e550e07f7/ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:51:40.776382 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35a658d3-a8a1-494c-a7a5-863727caa46c req-0b486bb7-0643-4d76-9021-837859ffd046 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 210 time: 0.0791266 Dec 09 21:51:40.792356 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] For port 686c9484-e87b-44c7-bb33-f79163a23d69, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:51:40.795791 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] For port 686c9484-e87b-44c7-bb33-f79163a23d69, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=686c9484-e87b-44c7-bb33-f79163a23d69,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:51:40.817751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-04d0bb05-07d1-428c-b5ef-c8eafe2ebb17 None None] For port 34b5b36b-2611-4360-8169-d595d507e923, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=34b5b36b-2611-4360-8169-d595d507e923,segment=NetworkSegment(bbcc9b75-8c59-49b6-9441-82060a46e422),segment_id=bbcc9b75-8c59-49b6-9441-82060a46e422)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:40.819380 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:40.865602 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-04d0bb05-07d1-428c-b5ef-c8eafe2ebb17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:40.922093 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33fda99c-a0e1-421c-a654-6fd158d90c1f None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:51:40.955036 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] Routers {'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:51:40.960872 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:51:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:41.098539 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3731df97-ea3b-472c-ab03-b2139f459158 req-30228463-756e-4156-96c5-02b4b782a771 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=dce7594ac2a74901912a2f19de04bf79 HTTP/1.1" status: 200 len: 379 time: 0.3699617 Dec 09 21:51:41.144255 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-3731df97-ea3b-472c-ab03-b2139f459158 req-fa96fccb-f7ca-4872-8559-d41e293fc948 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'port': {'device_id': 'cdcb1836-6369-4540-b4f2-07f714a9590f', 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c', 'admin_state_up': True, 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'security_groups': ['1731c834-efb2-47cd-b818-853b3aef0517']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:41.261389 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b2f29e5-2ab7-470b-88ba-4a0655b4e2f9 None None] Pushing event updated for resources: {'Port': ['ID=686c9484-e87b-44c7-bb33-f79163a23d69,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:41.285472 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] Set router ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:51:41.295571 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-816a7d90-06dd-43b9-b239-7226e657cfe4 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:41.372775 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 34b5b36b-2611-4360-8169-d595d507e923 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:51:41.425296 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-816a7d90-06dd-43b9-b239-7226e657cfe4 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:41.480621 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3731df97-ea3b-472c-ab03-b2139f459158 req-fa96fccb-f7ca-4872-8559-d41e293fc948 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Made reservation on behalf of dce7594ac2a74901912a2f19de04bf79 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:51:41.499336 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-3731df97-ea3b-472c-ab03-b2139f459158 req-fa96fccb-f7ca-4872-8559-d41e293fc948 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:41.510200 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-816a7d90-06dd-43b9-b239-7226e657cfe4 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Network 5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:51:41.530410 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-816a7d90-06dd-43b9-b239-7226e657cfe4 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:51:41.537444 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04d0bb05-07d1-428c-b5ef-c8eafe2ebb17 None None] Pushing event updated for resources: {'Port': ['ID=34b5b36b-2611-4360-8169-d595d507e923,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:41.538050 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-816a7d90-06dd-43b9-b239-7226e657cfe4 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:51:41.614051 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-816a7d90-06dd-43b9-b239-7226e657cfe4 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:41.651659 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-272024f7-d494-4b5f-83c6-2f8fada087c6 None None] Provisioning complete for port 686c9484-e87b-44c7-bb33-f79163a23d69 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:41.651972 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-272024f7-d494-4b5f-83c6-2f8fada087c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:41.691147 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-816a7d90-06dd-43b9-b239-7226e657cfe4 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'Port': ['ID=ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:41.828139 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 34b5b36b-2611-4360-8169-d595d507e923 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:41.828683 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:41.979818 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-272024f7-d494-4b5f-83c6-2f8fada087c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:41.988825 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0dc5af82-a25f-4b26-9f6a-8129160c1f7d req-827ee7c0-5db8-49cb-ba33-6ac4282745fe tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 210 time: 0.0656152 Dec 09 21:51:42.025256 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-272024f7-d494-4b5f-83c6-2f8fada087c6 None None] For port 686c9484-e87b-44c7-bb33-f79163a23d69, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=686c9484-e87b-44c7-bb33-f79163a23d69,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:42.050761 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-7aa22d0f-14db-46c7-b391-26d2edce7fcc None None] Allocated IP 172.20.0.2 (5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3/6112c97b-e0b7-4ba1-8f0e-463e550e07f7/2a750c92-ff70-4d20-9026-400cbad85554) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:51:42.060777 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-272024f7-d494-4b5f-83c6-2f8fada087c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:42.089385 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-816a7d90-06dd-43b9-b239-7226e657cfe4 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:42.125162 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-3731df97-ea3b-472c-ab03-b2139f459158 req-fa96fccb-f7ca-4872-8559-d41e293fc948 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Allocated IP 172.20.0.5 (dbbab540-d32c-4ae4-8405-4fd5a5d9b94c/df92f5f0-ea14-470b-bca7-c613b8daecf5/50c46228-45fd-43c8-9fd2-e6ae52717651) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:51:42.318862 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-272024f7-d494-4b5f-83c6-2f8fada087c6 None None] Pushing event updated for resources: {'Port': ['ID=686c9484-e87b-44c7-bb33-f79163a23d69,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:42.327918 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'name': 'tempest-TestNetworkBasicOps-router-421012370', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48'}], 'enable_snat': True}, 'gw_port_id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:32Z', 'updated_at': '2021-12-09T21:51:35Z', 'revision_number': 3, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:55:ea', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3769, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:34Z', 'updated_at': '2021-12-09T21:51:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:42.410088 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a715e14-e3a8-4ce3-b371-2702f03f1f8e None None] The sync data for ids ['ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'] in n-d-713301-27 is: [{'id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'name': 'tempest-TestNetworkBasicOps-router-421012370', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48'}], 'enable_snat': True}, 'gw_port_id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:32Z', 'updated_at': '2021-12-09T21:51:35Z', 'revision_number': 3, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:55:ea', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3769, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:34Z', 'updated_at': '2021-12-09T21:51:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:51:42.518344 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7aa22d0f-14db-46c7-b391-26d2edce7fcc None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:42.527822 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7aa22d0f-14db-46c7-b391-26d2edce7fcc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:42.532044 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-3731df97-ea3b-472c-ab03-b2139f459158 req-fa96fccb-f7ca-4872-8559-d41e293fc948 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:42.580122 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7aa22d0f-14db-46c7-b391-26d2edce7fcc None None] Network 5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:51:42.585675 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-7aa22d0f-14db-46c7-b391-26d2edce7fcc None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:51:42.590487 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7aa22d0f-14db-46c7-b391-26d2edce7fcc None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:51:42.593746 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7aa22d0f-14db-46c7-b391-26d2edce7fcc None None] Pushing event updated for resources: {'Port': ['ID=2a750c92-ff70-4d20-9026-400cbad85554,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:42.691154 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-7aa22d0f-14db-46c7-b391-26d2edce7fcc None None] Attempting to bind port 2a750c92-ff70-4d20-9026-400cbad85554 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:51:42.691566 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-7aa22d0f-14db-46c7-b391-26d2edce7fcc None None] Attempting to bind port 2a750c92-ff70-4d20-9026-400cbad85554 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'dc0bd24b-5723-4625-bde4-525782b5f73e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:51:42.691988 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7aa22d0f-14db-46c7-b391-26d2edce7fcc None None] Attempting to bind port 2a750c92-ff70-4d20-9026-400cbad85554 on network 5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:51:42.700173 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7aa22d0f-14db-46c7-b391-26d2edce7fcc None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 51, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:51:42.700556 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7aa22d0f-14db-46c7-b391-26d2edce7fcc None None] Checking segment: {'id': 'dc0bd24b-5723-4625-bde4-525782b5f73e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:51:42.701020 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7aa22d0f-14db-46c7-b391-26d2edce7fcc None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:42.701422 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7aa22d0f-14db-46c7-b391-26d2edce7fcc None None] Bound using segment: {'id': 'dc0bd24b-5723-4625-bde4-525782b5f73e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:51:42.701951 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-7aa22d0f-14db-46c7-b391-26d2edce7fcc None None] Bound port: 2a750c92-ff70-4d20-9026-400cbad85554, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'dc0bd24b-5723-4625-bde4-525782b5f73e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:51:42.702343 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7aa22d0f-14db-46c7-b391-26d2edce7fcc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:42.740257 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-3731df97-ea3b-472c-ab03-b2139f459158 req-fa96fccb-f7ca-4872-8559-d41e293fc948 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:42.825210 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3731df97-ea3b-472c-ab03-b2139f459158 req-fa96fccb-f7ca-4872-8559-d41e293fc948 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network dbbab540-d32c-4ae4-8405-4fd5a5d9b94c is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:51:42.825630 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-7aa22d0f-14db-46c7-b391-26d2edce7fcc None None] For port 2a750c92-ff70-4d20-9026-400cbad85554, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:51:42.831781 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-7aa22d0f-14db-46c7-b391-26d2edce7fcc None None] For port 2a750c92-ff70-4d20-9026-400cbad85554, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2a750c92-ff70-4d20-9026-400cbad85554,segment=NetworkSegment(dc0bd24b-5723-4625-bde4-525782b5f73e),segment_id=dc0bd24b-5723-4625-bde4-525782b5f73e)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:51:42.835850 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-3731df97-ea3b-472c-ab03-b2139f459158 req-fa96fccb-f7ca-4872-8559-d41e293fc948 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:51:42.841852 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7aa22d0f-14db-46c7-b391-26d2edce7fcc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:42.868880 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-3731df97-ea3b-472c-ab03-b2139f459158 req-fa96fccb-f7ca-4872-8559-d41e293fc948 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:51:43.105822 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa96fccb-f7ca-4872-8559-d41e293fc948 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Port': ['ID=50c46228-45fd-43c8-9fd2-e6ae52717651,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:43.160273 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7aa22d0f-14db-46c7-b391-26d2edce7fcc None None] Pushing event updated for resources: {'Port': ['ID=2a750c92-ff70-4d20-9026-400cbad85554,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:43.189746 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3731df97-ea3b-472c-ab03-b2139f459158 req-fa96fccb-f7ca-4872-8559-d41e293fc948 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:43.190564 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-3731df97-ea3b-472c-ab03-b2139f459158 req-fa96fccb-f7ca-4872-8559-d41e293fc948 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:43.313283 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3731df97-ea3b-472c-ab03-b2139f459158 req-fa96fccb-f7ca-4872-8559-d41e293fc948 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.2042706 Dec 09 21:51:43.314974 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe87c7d-82e6-4903-a3c6-46b2246c92b2 req-4d440552-58ea-4ff4-922c-117dd79556a6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:43.332262 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ebe87c7d-82e6-4903-a3c6-46b2246c92b2 req-4d440552-58ea-4ff4-922c-117dd79556a6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 931 time: 0.1273413 Dec 09 21:51:43.339588 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-3731df97-ea3b-472c-ab03-b2139f459158 req-8b4e1400-3b77-41cf-86f5-67d4972eb856 service neutron] Request body: {'port': {'device_id': 'cdcb1836-6369-4540-b4f2-07f714a9590f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:43.463420 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 686c9484-e87b-44c7-bb33-f79163a23d69 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:51:43.490149 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-816a7d90-06dd-43b9-b239-7226e657cfe4 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:43.522779 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-816a7d90-06dd-43b9-b239-7226e657cfe4 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:43.528425 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ebe87c7d-82e6-4903-a3c6-46b2246c92b2 req-417624c5-5121-42a8-abae-99056a2fe75d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1946795 Dec 09 21:51:43.746827 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-816a7d90-06dd-43b9-b239-7226e657cfe4 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:43.772088 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-3731df97-ea3b-472c-ab03-b2139f459158 req-8b4e1400-3b77-41cf-86f5-67d4972eb856 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:43.951101 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-816a7d90-06dd-43b9-b239-7226e657cfe4 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'Port': ['ID=ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:44.105394 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b6f5f375-8cce-40bc-9829-bc5afc6c467d None None] Provisioning complete for port 50c46228-45fd-43c8-9fd2-e6ae52717651 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:44.106008 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b6f5f375-8cce-40bc-9829-bc5afc6c467d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:44.184156 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-816a7d90-06dd-43b9-b239-7226e657cfe4 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Network 5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:51:44.188274 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-816a7d90-06dd-43b9-b239-7226e657cfe4 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:51:44.305071 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 686c9484-e87b-44c7-bb33-f79163a23d69 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:44.305805 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:44.307916 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-b6f5f375-8cce-40bc-9829-bc5afc6c467d None None] Port 50c46228-45fd-43c8-9fd2-e6ae52717651 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:51:44.556889 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 34b5b36b-2611-4360-8169-d595d507e923 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:51:44.625699 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 34b5b36b-2611-4360-8169-d595d507e923 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:44.625981 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:44.696854 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0946a65-24ff-4ad0-8755-a77c54ba3e58 req-7337bf8f-ea3e-4a22-921a-bcfe382fe8d1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:44.716163 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c0946a65-24ff-4ad0-8755-a77c54ba3e58 req-7337bf8f-ea3e-4a22-921a-bcfe382fe8d1 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 931 time: 0.0942957 Dec 09 21:51:44.832852 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c0946a65-24ff-4ad0-8755-a77c54ba3e58 req-6c4bb878-6fc0-4a0b-808f-558bdcbb7317 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1006835 Dec 09 21:51:45.031055 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c49dd26a-672a-436c-8916-bcfebe375601 None None] Network 5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:51:45.144605 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2a750c92-ff70-4d20-9026-400cbad85554 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:51:45.161472 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-3731df97-ea3b-472c-ab03-b2139f459158 req-8b4e1400-3b77-41cf-86f5-67d4972eb856 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 50c46228-45fd-43c8-9fd2-e6ae52717651 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:51:45.171121 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-3731df97-ea3b-472c-ab03-b2139f459158 req-8b4e1400-3b77-41cf-86f5-67d4972eb856 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:45.185819 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-3731df97-ea3b-472c-ab03-b2139f459158 req-8b4e1400-3b77-41cf-86f5-67d4972eb856 service neutron] Transition to ACTIVE for port object 50c46228-45fd-43c8-9fd2-e6ae52717651 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:51:45.235564 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-3731df97-ea3b-472c-ab03-b2139f459158 req-8b4e1400-3b77-41cf-86f5-67d4972eb856 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:45.250523 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8183601a-379b-4ac9-8706-44f24087a158 None None] Provisioning complete for port 2a750c92-ff70-4d20-9026-400cbad85554 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:45.251165 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8183601a-379b-4ac9-8706-44f24087a158 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:45.287170 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-816a7d90-06dd-43b9-b239-7226e657cfe4 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Router ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:51:45.298488 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 2a750c92-ff70-4d20-9026-400cbad85554 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:45.299839 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:45.516627 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b4e1400-3b77-41cf-86f5-67d4972eb856 service neutron] Pushing event updated for resources: {'Port': ['ID=50c46228-45fd-43c8-9fd2-e6ae52717651,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:45.552643 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8183601a-379b-4ac9-8706-44f24087a158 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:45.592436 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:45.658676 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-8183601a-379b-4ac9-8706-44f24087a158 None None] For port 2a750c92-ff70-4d20-9026-400cbad85554, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2a750c92-ff70-4d20-9026-400cbad85554,segment=NetworkSegment(dc0bd24b-5723-4625-bde4-525782b5f73e),segment_id=dc0bd24b-5723-4625-bde4-525782b5f73e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:45.698913 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8183601a-379b-4ac9-8706-44f24087a158 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:45.798378 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-3731df97-ea3b-472c-ab03-b2139f459158 req-8b4e1400-3b77-41cf-86f5-67d4972eb856 service neutron] Attempting to bind port 50c46228-45fd-43c8-9fd2-e6ae52717651 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:51:45.799064 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-3731df97-ea3b-472c-ab03-b2139f459158 req-8b4e1400-3b77-41cf-86f5-67d4972eb856 service neutron] Attempting to bind port 50c46228-45fd-43c8-9fd2-e6ae52717651 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'bbcc9b75-8c59-49b6-9441-82060a46e422', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:51:45.799926 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3731df97-ea3b-472c-ab03-b2139f459158 req-8b4e1400-3b77-41cf-86f5-67d4972eb856 service neutron] Attempting to bind port 50c46228-45fd-43c8-9fd2-e6ae52717651 on network dbbab540-d32c-4ae4-8405-4fd5a5d9b94c {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:51:45.819271 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3731df97-ea3b-472c-ab03-b2139f459158 req-8b4e1400-3b77-41cf-86f5-67d4972eb856 service neutron] Port 50c46228-45fd-43c8-9fd2-e6ae52717651 on network dbbab540-d32c-4ae4-8405-4fd5a5d9b94c not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:51:45.820094 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3731df97-ea3b-472c-ab03-b2139f459158 req-8b4e1400-3b77-41cf-86f5-67d4972eb856 service neutron] Attempting to bind port 50c46228-45fd-43c8-9fd2-e6ae52717651 on network dbbab540-d32c-4ae4-8405-4fd5a5d9b94c {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:51:45.839929 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3731df97-ea3b-472c-ab03-b2139f459158 req-8b4e1400-3b77-41cf-86f5-67d4972eb856 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 51, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:51:45.840483 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3731df97-ea3b-472c-ab03-b2139f459158 req-8b4e1400-3b77-41cf-86f5-67d4972eb856 service neutron] Checking segment: {'id': 'bbcc9b75-8c59-49b6-9441-82060a46e422', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:51:45.845012 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3731df97-ea3b-472c-ab03-b2139f459158 req-8b4e1400-3b77-41cf-86f5-67d4972eb856 service neutron] Bound using segment: {'id': 'bbcc9b75-8c59-49b6-9441-82060a46e422', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:51:45.845931 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-3731df97-ea3b-472c-ab03-b2139f459158 req-8b4e1400-3b77-41cf-86f5-67d4972eb856 service neutron] Bound port: 50c46228-45fd-43c8-9fd2-e6ae52717651, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bbcc9b75-8c59-49b6-9441-82060a46e422', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:51:45.846652 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-3731df97-ea3b-472c-ab03-b2139f459158 req-8b4e1400-3b77-41cf-86f5-67d4972eb856 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:45.961554 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-816a7d90-06dd-43b9-b239-7226e657cfe4 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:51:45.990056 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-816a7d90-06dd-43b9-b239-7226e657cfe4 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "PUT /v2.0/routers/ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.9816957 Dec 09 21:51:46.000100 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52018) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:46.049876 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] Sync routers for ids ['ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:51:46.088258 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8183601a-379b-4ac9-8706-44f24087a158 None None] Pushing event updated for resources: {'Port': ['ID=2a750c92-ff70-4d20-9026-400cbad85554,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:46.098577 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:51:46.098859 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:51:46.099977 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-70fa5a39-6eae-4acf-b22b-2a7edc64c04f None None] Provisioning complete for port ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:46.099977 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-70fa5a39-6eae-4acf-b22b-2a7edc64c04f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:46.119835 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:51:46.177015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07f901c4-e8f6-4935-88c6-f4a50f434d0f req-a755ee9a-bbf8-4da1-8558-9c2d73ea43aa tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:46.179416 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07f901c4-e8f6-4935-88c6-f4a50f434d0f req-a755ee9a-bbf8-4da1-8558-9c2d73ea43aa tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 943 time: 0.1912587 Dec 09 21:51:46.184603 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] Routers {'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:51:46.185281 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:51:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:46.241186 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-70fa5a39-6eae-4acf-b22b-2a7edc64c04f None None] Port ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:51:46.289403 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07f901c4-e8f6-4935-88c6-f4a50f434d0f req-e1fafae5-18eb-44ac-a795-0ce30b4063ba tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0937927 Dec 09 21:51:46.304719 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-3731df97-ea3b-472c-ab03-b2139f459158 req-8b4e1400-3b77-41cf-86f5-67d4972eb856 service neutron] For port 50c46228-45fd-43c8-9fd2-e6ae52717651, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:51:46.314978 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-3731df97-ea3b-472c-ab03-b2139f459158 req-8b4e1400-3b77-41cf-86f5-67d4972eb856 service neutron] For port 50c46228-45fd-43c8-9fd2-e6ae52717651, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=50c46228-45fd-43c8-9fd2-e6ae52717651,segment=NetworkSegment(bbcc9b75-8c59-49b6-9441-82060a46e422),segment_id=bbcc9b75-8c59-49b6-9441-82060a46e422)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:51:46.334292 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-70fa5a39-6eae-4acf-b22b-2a7edc64c04f None None] Provisioning complete for port 2a750c92-ff70-4d20-9026-400cbad85554 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:46.334940 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-70fa5a39-6eae-4acf-b22b-2a7edc64c04f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:46.335276 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-3731df97-ea3b-472c-ab03-b2139f459158 req-8b4e1400-3b77-41cf-86f5-67d4972eb856 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:46.419333 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3731df97-ea3b-472c-ab03-b2139f459158 req-8b4e1400-3b77-41cf-86f5-67d4972eb856 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:46.420010 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-3731df97-ea3b-472c-ab03-b2139f459158 req-8b4e1400-3b77-41cf-86f5-67d4972eb856 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:46.421559 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3731df97-ea3b-472c-ab03-b2139f459158 req-8b4e1400-3b77-41cf-86f5-67d4972eb856 service neutron] 10.222.0.31 "PUT /v2.0/ports/50c46228-45fd-43c8-9fd2-e6ae52717651 HTTP/1.1" status: 200 len: 1092 time: 3.0946667 Dec 09 21:51:46.423974 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cdcb1836-6369-4540-b4f2-07f714a9590f', 'tag': '50c46228-45fd-43c8-9fd2-e6ae52717651'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:51:46.426582 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0490b5f3-461b-4e5b-a600-4c80aa731b2c" -d '{"events": [{"name": "network-changed", "server_uuid": "cdcb1836-6369-4540-b4f2-07f714a9590f", "tag": "50c46228-45fd-43c8-9fd2-e6ae52717651"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:51:46.471381 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0ec82c7-9edc-4ea9-829e-1bb313055b42 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:46.471877 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0ec82c7-9edc-4ea9-829e-1bb313055b42 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:46.472930 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0ec82c7-9edc-4ea9-829e-1bb313055b42 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:46.473054 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0ec82c7-9edc-4ea9-829e-1bb313055b42 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:46.473451 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0ec82c7-9edc-4ea9-829e-1bb313055b42 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:46.473956 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0ec82c7-9edc-4ea9-829e-1bb313055b42 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:46.478678 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52042) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:46.485178 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a0ec82c7-9edc-4ea9-829e-1bb313055b42 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] 10.222.0.13 "GET /v2.0/networks HTTP/1.1" status: 200 len: 4273 time: 0.4357097 Dec 09 21:51:46.519289 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] Set router ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:51:46.587111 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:51:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-12fd321a-b026-4cce-903d-e8b096c58907 x-openstack-request-id: req-12fd321a-b026-4cce-903d-e8b096c58907 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:51:46.587409 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cdcb1836-6369-4540-b4f2-07f714a9590f", "tag": "50c46228-45fd-43c8-9fd2-e6ae52717651", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:51:46.587690 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-12fd321a-b026-4cce-903d-e8b096c58907 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:51:46.588098 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cdcb1836-6369-4540-b4f2-07f714a9590f', 'tag': '50c46228-45fd-43c8-9fd2-e6ae52717651', 'status': 'completed', 'code': 200} Dec 09 21:51:46.664965 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b4e1400-3b77-41cf-86f5-67d4972eb856 service neutron] Pushing event updated for resources: {'Port': ['ID=50c46228-45fd-43c8-9fd2-e6ae52717651,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:46.679211 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-049c86bb-ba02-4959-9ffa-cd93658a2639 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:46.679926 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-049c86bb-ba02-4959-9ffa-cd93658a2639 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:46.680533 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-049c86bb-ba02-4959-9ffa-cd93658a2639 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:46.681322 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-049c86bb-ba02-4959-9ffa-cd93658a2639 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:46.681927 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-049c86bb-ba02-4959-9ffa-cd93658a2639 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:46.682649 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-049c86bb-ba02-4959-9ffa-cd93658a2639 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:46.684980 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-049c86bb-ba02-4959-9ffa-cd93658a2639 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 3992 time: 0.2052782 Dec 09 21:51:46.689196 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52050) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:46.694627 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3731df97-ea3b-472c-ab03-b2139f459158 req-2a802d27-1533-4322-afc4-cb1c8a5fd1b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:46.696222 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3731df97-ea3b-472c-ab03-b2139f459158 req-2a802d27-1533-4322-afc4-cb1c8a5fd1b9 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 1095 time: 0.1955545 Dec 09 21:51:46.794434 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3731df97-ea3b-472c-ab03-b2139f459158 req-75417ade-d1b4-4983-8860-d441f6f555ba service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=50c46228-45fd-43c8-9fd2-e6ae52717651 HTTP/1.1" status: 200 len: 217 time: 0.0867100 Dec 09 21:51:46.912388 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3731df97-ea3b-472c-ab03-b2139f459158 req-2b9c84af-132a-43e7-a912-de08ec64e787 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:46.914213 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3731df97-ea3b-472c-ab03-b2139f459158 req-2b9c84af-132a-43e7-a912-de08ec64e787 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=df92f5f0-ea14-470b-bca7-c613b8daecf5 HTTP/1.1" status: 200 len: 834 time: 0.1136851 Dec 09 21:51:46.986839 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5cce7ed6-23a1-4245-b4f5-8cf17acb9891 None None] Provisioning complete for port ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:46.987580 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5cce7ed6-23a1-4245-b4f5-8cf17acb9891 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:47.002736 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3731df97-ea3b-472c-ab03-b2139f459158 req-9a39759a-8098-46f2-bb39-312feca892a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:47.004621 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3731df97-ea3b-472c-ab03-b2139f459158 req-9a39759a-8098-46f2-bb39-312feca892a0 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=dbbab540-d32c-4ae4-8405-4fd5a5d9b94c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0829978 Dec 09 21:51:47.054100 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-5cce7ed6-23a1-4245-b4f5-8cf17acb9891 None None] Port ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:51:47.094717 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'name': 'tempest-TestNetworkBasicOps-router-421012370', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48'}], 'enable_snat': True}, 'gw_port_id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:32Z', 'updated_at': '2021-12-09T21:51:41Z', 'revision_number': 4, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:55:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3769, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:34Z', 'updated_at': '2021-12-09T21:51:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01', 'name': '', 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:0b:51:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 3772, 'fixed_ips': [{'subnet_id': '6112c97b-e0b7-4ba1-8f0e-463e550e07f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:40Z', 'updated_at': '2021-12-09T21:51:42Z', 'revision_number': 2, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': '6112c97b-e0b7-4ba1-8f0e-463e550e07f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:47.156572 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3731df97-ea3b-472c-ab03-b2139f459158 req-34da9a0b-20a9-4521-9ac4-5ea160d702e3 service neutron] 10.222.0.31 "GET /v2.0/networks/dbbab540-d32c-4ae4-8405-4fd5a5d9b94c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1431134 Dec 09 21:51:47.163825 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] Checking router: ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:51:47.164586 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] Updating router ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb port ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:51:47.205009 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2a750c92-ff70-4d20-9026-400cbad85554 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:51:47.210566 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:47.445972 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3731df97-ea3b-472c-ab03-b2139f459158 req-ba9a9cc1-0f2a-4dfa-acd3-bb7a8a397b70 service neutron] 10.222.0.31 "GET /v2.0/networks/dbbab540-d32c-4ae4-8405-4fd5a5d9b94c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2811718 Dec 09 21:51:47.560162 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81e55115-b856-43d7-9fa3-7efa5c6cd17f req-1a064d50-5617-41e6-bb7c-b93b34ec4487 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:47.561913 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-81e55115-b856-43d7-9fa3-7efa5c6cd17f req-1a064d50-5617-41e6-bb7c-b93b34ec4487 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 943 time: 0.1070058 Dec 09 21:51:47.618858 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0490b5f3-461b-4e5b-a600-4c80aa731b2c req-135a08ce-e3f2-48a9-9e57-6813eecc2799 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:47.620528 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0490b5f3-461b-4e5b-a600-4c80aa731b2c req-135a08ce-e3f2-48a9-9e57-6813eecc2799 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 1095 time: 0.0912192 Dec 09 21:51:47.662588 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:47.677264 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:47.716675 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-81e55115-b856-43d7-9fa3-7efa5c6cd17f req-460fbae1-73e8-4766-a0a9-16dffb8c91e0 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1458161 Dec 09 21:51:47.778057 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 2a750c92-ff70-4d20-9026-400cbad85554 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:47.778436 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:47.782244 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eb57c1c-a8f7-49b7-9977-1add4b7efecc None None] Pushing event updated for resources: {'Port': ['ID=ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:47.810017 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0490b5f3-461b-4e5b-a600-4c80aa731b2c req-11e49790-0700-4662-97b3-df2b43174680 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:47.811958 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0490b5f3-461b-4e5b-a600-4c80aa731b2c req-11e49790-0700-4662-97b3-df2b43174680 service neutron] 10.222.0.31 "GET /v2.0/networks?id=dbbab540-d32c-4ae4-8405-4fd5a5d9b94c HTTP/1.1" status: 200 len: 898 time: 0.1790128 Dec 09 21:51:47.815858 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3c2bcf44-0c7c-4c16-b859-a64328d27da8 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 2332 time: 1.1166346 Dec 09 21:51:47.888553 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0490b5f3-461b-4e5b-a600-4c80aa731b2c req-21f523eb-fc2f-48e6-a1af-6548e40d10a2 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=50c46228-45fd-43c8-9fd2-e6ae52717651 HTTP/1.1" status: 200 len: 217 time: 0.0677111 Dec 09 21:51:47.922844 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] Attempting to bind port ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:51:47.923235 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] Attempting to bind port ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'dc0bd24b-5723-4625-bde4-525782b5f73e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:51:47.935312 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] Attempting to bind port ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01 on network 5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:51:47.951721 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 51, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:51:47.959230 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] Checking segment: {'id': 'dc0bd24b-5723-4625-bde4-525782b5f73e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:51:47.960013 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:47.960528 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] Bound using segment: {'id': 'dc0bd24b-5723-4625-bde4-525782b5f73e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:51:47.963431 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] Bound port: ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'dc0bd24b-5723-4625-bde4-525782b5f73e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:51:47.963967 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:47.993733 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0490b5f3-461b-4e5b-a600-4c80aa731b2c req-e14b9be1-8061-4315-9b4e-e49c5bb871d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:47.995353 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0490b5f3-461b-4e5b-a600-4c80aa731b2c req-e14b9be1-8061-4315-9b4e-e49c5bb871d7 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=df92f5f0-ea14-470b-bca7-c613b8daecf5 HTTP/1.1" status: 200 len: 834 time: 0.0949814 Dec 09 21:51:48.106550 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0490b5f3-461b-4e5b-a600-4c80aa731b2c req-ed81cd27-3770-490a-8b88-6f5064f1efc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:48.108154 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0490b5f3-461b-4e5b-a600-4c80aa731b2c req-ed81cd27-3770-490a-8b88-6f5064f1efc6 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=dbbab540-d32c-4ae4-8405-4fd5a5d9b94c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1049769 Dec 09 21:51:48.214721 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] For port ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:51:48.247132 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] For port ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01,segment=NetworkSegment(dc0bd24b-5723-4625-bde4-525782b5f73e),segment_id=dc0bd24b-5723-4625-bde4-525782b5f73e)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:51:48.258714 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-90e004bf-f002-45ea-923c-9db8de019461 None None] Provisioning complete for port ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:48.267891 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-90e004bf-f002-45ea-923c-9db8de019461 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:48.273611 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:48.307304 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0490b5f3-461b-4e5b-a600-4c80aa731b2c req-44fe8e04-3840-4697-b3ff-5fc5ef14572d service neutron] 10.222.0.31 "GET /v2.0/networks/dbbab540-d32c-4ae4-8405-4fd5a5d9b94c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1900632 Dec 09 21:51:48.475271 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eb57c1c-a8f7-49b7-9977-1add4b7efecc None None] Pushing event updated for resources: {'Port': ['ID=ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:48.516629 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52088) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:48.521897 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-bcc08c49-5add-47b0-bfcc-fec8dca3c46c tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1796801596', 'description': 'tempest-secgroup-smoke-1796801596 description', 'project_id': 'e863bf78256945798e7c717c650258aa'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:48.549566 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] Routers {'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:51:48.549566 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:51:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:48.584453 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0490b5f3-461b-4e5b-a600-4c80aa731b2c req-90ba822a-777c-469a-a30b-c7482faa7ce2 service neutron] 10.222.0.31 "GET /v2.0/networks/dbbab540-d32c-4ae4-8405-4fd5a5d9b94c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2670496 Dec 09 21:51:48.585068 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bcc08c49-5add-47b0-bfcc-fec8dca3c46c tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:48.735970 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bcc08c49-5add-47b0-bfcc-fec8dca3c46c tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:48.745046 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bcc08c49-5add-47b0-bfcc-fec8dca3c46c tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:48.811021 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcc08c49-5add-47b0-bfcc-fec8dca3c46c tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'SecurityGroup': ['ID=91e8cd34-2082-4604-9b4a-5995f7f0b0c6,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:48.820207 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bcc08c49-5add-47b0-bfcc-fec8dca3c46c tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:48.826428 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52094) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:48.833263 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-9b953bd6-542a-4344-ae3d-939fe24f2a1b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'security_group_rule': {'security_group_id': '91e8cd34-2082-4604-9b4a-5995f7f0b0c6', 'project_id': 'e863bf78256945798e7c717c650258aa', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:48.839265 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bcc08c49-5add-47b0-bfcc-fec8dca3c46c tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.3214157 Dec 09 21:51:48.876068 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9b953bd6-542a-4344-ae3d-939fe24f2a1b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:48.935157 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5b97887-07bf-4b49-82e7-24f83c241cd2 req-a25f295c-4f75-4817-98cf-0bf2c11f8a9b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:48.948808 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c5b97887-07bf-4b49-82e7-24f83c241cd2 req-a25f295c-4f75-4817-98cf-0bf2c11f8a9b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 943 time: 0.0830882 Dec 09 21:51:49.007674 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9b953bd6-542a-4344-ae3d-939fe24f2a1b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:49.013276 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9b953bd6-542a-4344-ae3d-939fe24f2a1b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:49.052572 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9b953bd6-542a-4344-ae3d-939fe24f2a1b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:49.057422 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c5b97887-07bf-4b49-82e7-24f83c241cd2 req-3c4470b9-fdad-490f-aaa7-4afdb4bd9c8f tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1033559 Dec 09 21:51:49.057906 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9b953bd6-542a-4344-ae3d-939fe24f2a1b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2297568 Dec 09 21:51:49.060750 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52096) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:49.075518 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-90e004bf-f002-45ea-923c-9db8de019461 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:49.096242 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-6cee9ee7-4847-4721-9444-0d36416be04a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'security_group_rule': {'security_group_id': '91e8cd34-2082-4604-9b4a-5995f7f0b0c6', 'project_id': 'e863bf78256945798e7c717c650258aa', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:49.110842 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b953bd6-542a-4344-ae3d-939fe24f2a1b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d65f42ea-6bbc-4e13-833f-0b29f9e2d8a6,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:49.127804 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] Set router ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:51:49.181426 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-90e004bf-f002-45ea-923c-9db8de019461 None None] For port ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01,segment=NetworkSegment(dc0bd24b-5723-4625-bde4-525782b5f73e),segment_id=dc0bd24b-5723-4625-bde4-525782b5f73e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:49.193339 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6cee9ee7-4847-4721-9444-0d36416be04a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:49.196942 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-90e004bf-f002-45ea-923c-9db8de019461 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:49.334190 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6cee9ee7-4847-4721-9444-0d36416be04a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:49.345080 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6cee9ee7-4847-4721-9444-0d36416be04a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:49.365695 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cee9ee7-4847-4721-9444-0d36416be04a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=49e0a8b2-1b2f-4d0b-8d6d-5d92486fc388,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:49.378958 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6cee9ee7-4847-4721-9444-0d36416be04a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:49.381340 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6cee9ee7-4847-4721-9444-0d36416be04a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2910438 Dec 09 21:51:49.384312 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52100) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:49.389189 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-ca417a40-4a6d-4d16-8cae-5ef3cc999a62 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'security_group_rule': {'security_group_id': '91e8cd34-2082-4604-9b4a-5995f7f0b0c6', 'project_id': 'e863bf78256945798e7c717c650258aa', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:49.451272 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ca417a40-4a6d-4d16-8cae-5ef3cc999a62 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:49.494965 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90e004bf-f002-45ea-923c-9db8de019461 None None] Pushing event updated for resources: {'Port': ['ID=ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:49.510843 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5d56baf5-4300-4fd2-8a74-1d5083047279 None None] Provisioning complete for port ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:49.511362 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5d56baf5-4300-4fd2-8a74-1d5083047279 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:49.538392 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ca417a40-4a6d-4d16-8cae-5ef3cc999a62 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:49.558305 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ca417a40-4a6d-4d16-8cae-5ef3cc999a62 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:49.585563 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'name': 'tempest-TestNetworkBasicOps-router-421012370', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48'}], 'enable_snat': True}, 'gw_port_id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:32Z', 'updated_at': '2021-12-09T21:51:41Z', 'revision_number': 4, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:55:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3769, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:34Z', 'updated_at': '2021-12-09T21:51:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01', 'name': '', 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:0b:51:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 3772, 'fixed_ips': [{'subnet_id': '6112c97b-e0b7-4ba1-8f0e-463e550e07f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:40Z', 'updated_at': '2021-12-09T21:51:48Z', 'revision_number': 4, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': '6112c97b-e0b7-4ba1-8f0e-463e550e07f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:49.615804 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ca417a40-4a6d-4d16-8cae-5ef3cc999a62 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:49.622852 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52104) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:49.625078 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ca417a40-4a6d-4d16-8cae-5ef3cc999a62 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2396092 Dec 09 21:51:49.628038 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-d30d1112-ebe0-49b5-8113-5a333d475517 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'security_group_rule': {'security_group_id': '91e8cd34-2082-4604-9b4a-5995f7f0b0c6', 'project_id': 'e863bf78256945798e7c717c650258aa', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:49.644714 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca417a40-4a6d-4d16-8cae-5ef3cc999a62 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d7d6f0e0-6b77-47d6-af37-ebde2da52323,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:49.692192 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 50c46228-45fd-43c8-9fd2-e6ae52717651 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:51:49.704201 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d30d1112-ebe0-49b5-8113-5a333d475517 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:49.712806 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0ee3e8f-24de-4dc8-9442-a95fbff7cb4f None None] The sync data for ids ['ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'] in n-d-713301-27 is: [{'id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'name': 'tempest-TestNetworkBasicOps-router-421012370', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48'}], 'enable_snat': True}, 'gw_port_id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:32Z', 'updated_at': '2021-12-09T21:51:41Z', 'revision_number': 4, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:55:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3769, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:34Z', 'updated_at': '2021-12-09T21:51:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01', 'name': '', 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:0b:51:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 3772, 'fixed_ips': [{'subnet_id': '6112c97b-e0b7-4ba1-8f0e-463e550e07f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:40Z', 'updated_at': '2021-12-09T21:51:48Z', 'revision_number': 4, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': '6112c97b-e0b7-4ba1-8f0e-463e550e07f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:51:49.860498 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d30d1112-ebe0-49b5-8113-5a333d475517 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:49.874533 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d30d1112-ebe0-49b5-8113-5a333d475517 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:49.905598 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 50c46228-45fd-43c8-9fd2-e6ae52717651, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=50c46228-45fd-43c8-9fd2-e6ae52717651,segment=NetworkSegment(bbcc9b75-8c59-49b6-9441-82060a46e422),segment_id=bbcc9b75-8c59-49b6-9441-82060a46e422)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:49.919030 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '50c46228-45fd-43c8-9fd2-e6ae52717651', 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c', 'port_id': '50c46228-45fd-43c8-9fd2-e6ae52717651', 'mac_address': 'fa:16:3e:4f:df:b4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 112, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'df92f5f0-ea14-470b-bca7-c613b8daecf5', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:51:49.930229 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d30d1112-ebe0-49b5-8113-5a333d475517 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:49.934573 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52108) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:49.939180 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-7c3e8027-5030-44d8-ad81-ceee6cd14085 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'security_group_rule': {'security_group_id': '91e8cd34-2082-4604-9b4a-5995f7f0b0c6', 'project_id': 'e863bf78256945798e7c717c650258aa', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:49.945262 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d30d1112-ebe0-49b5-8113-5a333d475517 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3197265 Dec 09 21:51:49.950792 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d30d1112-ebe0-49b5-8113-5a333d475517 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bd4b48cd-569e-4662-8d63-c91554030de6,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:49.975007 n-d-713301-27 neutron-server[103438]: INFO neutron.db.securitygroups_db [None req-7c3e8027-5030-44d8-ad81-ceee6cd14085 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Project e863bf78256945798e7c717c650258aa added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 21:51:49.982955 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c3e8027-5030-44d8-ad81-ceee6cd14085 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:49.995576 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:50.035854 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 50c46228-45fd-43c8-9fd2-e6ae52717651 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:51:50.067923 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 50c46228-45fd-43c8-9fd2-e6ae52717651, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=50c46228-45fd-43c8-9fd2-e6ae52717651,segment=NetworkSegment(bbcc9b75-8c59-49b6-9441-82060a46e422),segment_id=bbcc9b75-8c59-49b6-9441-82060a46e422)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:50.076546 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:50.094100 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c3e8027-5030-44d8-ad81-ceee6cd14085 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:50.105953 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c3e8027-5030-44d8-ad81-ceee6cd14085 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:50.145658 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=50c46228-45fd-43c8-9fd2-e6ae52717651,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:50.166893 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c3e8027-5030-44d8-ad81-ceee6cd14085 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6ec123df-ff45-4624-8265-13a70e455ce5,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:50.225736 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c3e8027-5030-44d8-ad81-ceee6cd14085 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:50.231061 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52114) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:50.236372 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-9d95e685-b06c-45bb-85e8-a4f409c65f97 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'security_group_rule': {'security_group_id': '91e8cd34-2082-4604-9b4a-5995f7f0b0c6', 'project_id': 'e863bf78256945798e7c717c650258aa', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:50.241215 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7c3e8027-5030-44d8-ad81-ceee6cd14085 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3054421 Dec 09 21:51:50.279048 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0a11ad2-2768-4c2c-a9f7-2857360fff48 req-348e889a-0db5-4773-976a-0fae18f7065d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:50.282846 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c0a11ad2-2768-4c2c-a9f7-2857360fff48 req-348e889a-0db5-4773-976a-0fae18f7065d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 944 time: 0.1012697 Dec 09 21:51:50.287185 n-d-713301-27 neutron-server[103437]: INFO neutron.db.securitygroups_db [None req-9d95e685-b06c-45bb-85e8-a4f409c65f97 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Project e863bf78256945798e7c717c650258aa added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 21:51:50.289650 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['50c46228-45fd-43c8-9fd2-e6ae52717651'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:51:50.306888 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d95e685-b06c-45bb-85e8-a4f409c65f97 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:50.387330 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c0a11ad2-2768-4c2c-a9f7-2857360fff48 req-a4c7436e-abd5-491e-bd49-6336497834ab tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0948675 Dec 09 21:51:50.453320 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d95e685-b06c-45bb-85e8-a4f409c65f97 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:50.482791 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d95e685-b06c-45bb-85e8-a4f409c65f97 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:50.521828 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d95e685-b06c-45bb-85e8-a4f409c65f97 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=250c488c-f868-47af-85bf-03e9ff26c89d,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:50.534591 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d95e685-b06c-45bb-85e8-a4f409c65f97 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:50.544560 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9d95e685-b06c-45bb-85e8-a4f409c65f97 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3034203 Dec 09 21:51:50.831176 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-2b0e7c7e-e701-4598-8f3d-8f6c91befe6d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1796801596&fields=id&tenant_id=e863bf78256945798e7c717c650258aa HTTP/1.1" status: 200 len: 267 time: 0.0698140 Dec 09 21:51:51.016572 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-b43f4c0c-2cb3-4064-ba27-18066827d766 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:51.026724 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-b43f4c0c-2cb3-4064-ba27-18066827d766 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/networks?id=5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3 HTTP/1.1" status: 200 len: 797 time: 0.1862807 Dec 09 21:51:51.051916 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-37b988fd-82e3-44f7-bde0-8b13012cc6d4 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/quotas/e863bf78256945798e7c717c650258aa HTTP/1.1" status: 200 len: 375 time: 0.0229657 Dec 09 21:51:51.106140 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:51:51.164876 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-b21958ea-fd9b-4a1a-b4ba-9fc5080feccb tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=e863bf78256945798e7c717c650258aa&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1114640 Dec 09 21:51:51.208993 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:51.209932 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:51.385446 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-b1b827bc-28ce-416f-9ed4-e286eba7d778 service neutron] 10.222.0.13 "GET /v2.0/networks/5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2035217 Dec 09 21:51:51.487958 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-c076279e-110e-4fff-ad85-bcc3078baee0 service neutron] 10.222.0.13 "GET /v2.0/networks/5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0958223 Dec 09 21:51:51.663311 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 50c46228-45fd-43c8-9fd2-e6ae52717651 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:51:51.792714 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 50c46228-45fd-43c8-9fd2-e6ae52717651 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:51:51.798498 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 50c46228-45fd-43c8-9fd2-e6ae52717651 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:51.799485 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:51.805824 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1070dc7-4532-472b-a2ff-b2758af44b05 req-8b55f818-ee8c-480b-875c-d896354b3147 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:51.818742 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e1070dc7-4532-472b-a2ff-b2758af44b05 req-8b55f818-ee8c-480b-875c-d896354b3147 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 944 time: 0.0935311 Dec 09 21:51:51.912360 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e1070dc7-4532-472b-a2ff-b2758af44b05 req-7e3aefb8-b663-4d08-a51d-349ad7c7bb91 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0917797 Dec 09 21:51:51.968288 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:52.022609 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c5060f5-c509-40aa-94d9-ddbe27da6e8b req-dca8bfb1-a3df-4ace-a2fc-791cb6780bdc tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=e3992eb9-4e32-4dc2-be65-a102058d2974 HTTP/1.1" status: 200 len: 210 time: 0.0587459 Dec 09 21:51:52.023101 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 50c46228-45fd-43c8-9fd2-e6ae52717651, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=50c46228-45fd-43c8-9fd2-e6ae52717651,segment=NetworkSegment(bbcc9b75-8c59-49b6-9441-82060a46e422),segment_id=bbcc9b75-8c59-49b6-9441-82060a46e422)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:52.024552 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cdcb1836-6369-4540-b4f2-07f714a9590f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '50c46228-45fd-43c8-9fd2-e6ae52717651'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:51:52.027888 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-29c21a59-ff61-436d-8569-34b23e103b85" -d '{"events": [{"server_uuid": "cdcb1836-6369-4540-b4f2-07f714a9590f", "name": "network-vif-plugged", "status": "completed", "tag": "50c46228-45fd-43c8-9fd2-e6ae52717651"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:51:52.032649 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:52.097518 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:51:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6475ea85-68a7-44c2-bdb0-7e666c071d3e x-openstack-request-id: req-6475ea85-68a7-44c2-bdb0-7e666c071d3e {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:51:52.097944 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cdcb1836-6369-4540-b4f2-07f714a9590f", "name": "network-vif-plugged", "status": "completed", "tag": "50c46228-45fd-43c8-9fd2-e6ae52717651", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:51:52.098336 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-6475ea85-68a7-44c2-bdb0-7e666c071d3e {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:51:52.098834 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cdcb1836-6369-4540-b4f2-07f714a9590f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '50c46228-45fd-43c8-9fd2-e6ae52717651', 'code': 200} Dec 09 21:51:52.105280 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=50c46228-45fd-43c8-9fd2-e6ae52717651,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:52.116028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:52.116745 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:52.117322 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:52.118002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:52.118576 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:52.118922 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:52.119261 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:52.119618 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:52.120127 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:52.120746 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:52.121362 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:52.121853 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:52.122334 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:51:52.207028 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66282e33-1797-4a0b-b260-b670e94825c9 req-5f73d1b2-645f-4492-b443-6a2a4ed0036a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:52.208938 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-66282e33-1797-4a0b-b260-b670e94825c9 req-5f73d1b2-645f-4492-b443-6a2a4ed0036a service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 1097 time: 0.0500209 Dec 09 21:51:52.276355 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-66282e33-1797-4a0b-b260-b670e94825c9 req-734cabbb-d22f-4732-9b9e-12bab517814d service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0599153 Dec 09 21:51:53.069593 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9d400e4-c109-473c-b49c-fa7f5186844c req-0caf0208-0008-4ac4-9cb3-3023488d76be tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:53.072614 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f9d400e4-c109-473c-b49c-fa7f5186844c req-0caf0208-0008-4ac4-9cb3-3023488d76be tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 945 time: 0.0746770 Dec 09 21:51:53.122243 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-f5795d9e-986a-47ff-aaf5-c379fe8489af tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:53.123975 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-f5795d9e-986a-47ff-aaf5-c379fe8489af tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.31 "GET /v2.0/networks?id=5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3 HTTP/1.1" status: 200 len: 797 time: 0.1432743 Dec 09 21:51:53.134331 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f9d400e4-c109-473c-b49c-fa7f5186844c req-81aacccf-292f-4068-99db-1df49fe20e11 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0541294 Dec 09 21:51:53.222656 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-44c20c0b-0e49-45fb-8827-cccd8decbc61 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=e863bf78256945798e7c717c650258aa HTTP/1.1" status: 200 len: 380 time: 0.0812883 Dec 09 21:51:53.234407 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-ad161d48-4882-45c0-bb55-2f536ab40c5a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'port': {'device_id': 'e3992eb9-4e32-4dc2-be65-a102058d2974', 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3', 'admin_state_up': True, 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'security_groups': ['91e8cd34-2082-4604-9b4a-5995f7f0b0c6']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:53.277632 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e50c50a5-1dda-411e-86de-6c8bba9651d1 req-33878e3f-4246-426e-82b0-0cf067d1564e tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=e3992eb9-4e32-4dc2-be65-a102058d2974 HTTP/1.1" status: 200 len: 210 time: 0.0418899 Dec 09 21:51:53.421944 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-ad161d48-4882-45c0-bb55-2f536ab40c5a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Made reservation on behalf of e863bf78256945798e7c717c650258aa for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:51:53.427312 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-ad161d48-4882-45c0-bb55-2f536ab40c5a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:53.572180 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-ad161d48-4882-45c0-bb55-2f536ab40c5a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Allocated IP 172.20.0.13 (5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3/6112c97b-e0b7-4ba1-8f0e-463e550e07f7/a1e280f8-4599-42bc-9eec-7c9618c84471) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:51:53.730275 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-ad161d48-4882-45c0-bb55-2f536ab40c5a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:53.779474 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-ad161d48-4882-45c0-bb55-2f536ab40c5a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:53.829745 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-ad161d48-4882-45c0-bb55-2f536ab40c5a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Network 5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:51:53.833453 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-ad161d48-4882-45c0-bb55-2f536ab40c5a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:51:53.836181 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-ad161d48-4882-45c0-bb55-2f536ab40c5a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:51:53.880015 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad161d48-4882-45c0-bb55-2f536ab40c5a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'Port': ['ID=a1e280f8-4599-42bc-9eec-7c9618c84471,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:53.910175 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-ad161d48-4882-45c0-bb55-2f536ab40c5a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:53.910739 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-ad161d48-4882-45c0-bb55-2f536ab40c5a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:53.929338 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-ad161d48-4882-45c0-bb55-2f536ab40c5a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6992617 Dec 09 21:51:53.941942 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-bde37d0c-e925-4474-bd9f-bc0503aeed45 service neutron] Request body: {'port': {'device_id': 'e3992eb9-4e32-4dc2-be65-a102058d2974', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:54.001683 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-bde37d0c-e925-4474-bd9f-bc0503aeed45 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:54.157441 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b8f5cfdb-3733-436d-88f7-01bd98cfbfca None None] Provisioning complete for port a1e280f8-4599-42bc-9eec-7c9618c84471 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:54.159405 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b8f5cfdb-3733-436d-88f7-01bd98cfbfca None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:54.211962 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-b8f5cfdb-3733-436d-88f7-01bd98cfbfca None None] Port a1e280f8-4599-42bc-9eec-7c9618c84471 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:51:54.296009 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50f6d084-079f-4e82-83ca-31645f118149 req-f2125eb9-66eb-441b-bb99-9c966c03c0ae tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:54.298377 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50f6d084-079f-4e82-83ca-31645f118149 req-f2125eb9-66eb-441b-bb99-9c966c03c0ae tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 945 time: 0.0685821 Dec 09 21:51:54.320822 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-bde37d0c-e925-4474-bd9f-bc0503aeed45 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a1e280f8-4599-42bc-9eec-7c9618c84471 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:51:54.330284 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-bde37d0c-e925-4474-bd9f-bc0503aeed45 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:54.357708 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-bde37d0c-e925-4474-bd9f-bc0503aeed45 service neutron] Transition to ACTIVE for port object a1e280f8-4599-42bc-9eec-7c9618c84471 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:51:54.375796 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-bde37d0c-e925-4474-bd9f-bc0503aeed45 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:54.391637 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50f6d084-079f-4e82-83ca-31645f118149 req-f54a14e6-253e-4c03-8fcc-088889f81deb tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0813093 Dec 09 21:51:54.503018 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bde37d0c-e925-4474-bd9f-bc0503aeed45 service neutron] Pushing event updated for resources: {'Port': ['ID=a1e280f8-4599-42bc-9eec-7c9618c84471,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:54.517905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0532d881-da96-42fa-90cd-6fa03f4470b7 req-ab7caf35-1249-4fde-b332-509842107396 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:54.527497 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0532d881-da96-42fa-90cd-6fa03f4470b7 req-ab7caf35-1249-4fde-b332-509842107396 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=e3992eb9-4e32-4dc2-be65-a102058d2974 HTTP/1.1" status: 200 len: 944 time: 0.0761044 Dec 09 21:51:54.593374 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-bde37d0c-e925-4474-bd9f-bc0503aeed45 service neutron] Attempting to bind port a1e280f8-4599-42bc-9eec-7c9618c84471 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:51:54.593719 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-bde37d0c-e925-4474-bd9f-bc0503aeed45 service neutron] Attempting to bind port a1e280f8-4599-42bc-9eec-7c9618c84471 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'dc0bd24b-5723-4625-bde4-525782b5f73e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:51:54.594052 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-bde37d0c-e925-4474-bd9f-bc0503aeed45 service neutron] Attempting to bind port a1e280f8-4599-42bc-9eec-7c9618c84471 on network 5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:51:54.598967 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-bde37d0c-e925-4474-bd9f-bc0503aeed45 service neutron] Port a1e280f8-4599-42bc-9eec-7c9618c84471 on network 5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:51:54.599306 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-bde37d0c-e925-4474-bd9f-bc0503aeed45 service neutron] Attempting to bind port a1e280f8-4599-42bc-9eec-7c9618c84471 on network 5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:51:54.606460 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-bde37d0c-e925-4474-bd9f-bc0503aeed45 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 51, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:51:54.606807 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-bde37d0c-e925-4474-bd9f-bc0503aeed45 service neutron] Checking segment: {'id': 'dc0bd24b-5723-4625-bde4-525782b5f73e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:51:54.607190 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-bde37d0c-e925-4474-bd9f-bc0503aeed45 service neutron] Bound using segment: {'id': 'dc0bd24b-5723-4625-bde4-525782b5f73e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:51:54.607700 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-bde37d0c-e925-4474-bd9f-bc0503aeed45 service neutron] Bound port: a1e280f8-4599-42bc-9eec-7c9618c84471, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dc0bd24b-5723-4625-bde4-525782b5f73e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:51:54.608121 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-bde37d0c-e925-4474-bd9f-bc0503aeed45 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:54.612296 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0532d881-da96-42fa-90cd-6fa03f4470b7 req-0f414cf2-187f-44ec-986c-5dfa5272074e tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=91e8cd34-2082-4604-9b4a-5995f7f0b0c6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0835490 Dec 09 21:51:54.697277 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-bde37d0c-e925-4474-bd9f-bc0503aeed45 service neutron] For port a1e280f8-4599-42bc-9eec-7c9618c84471, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:51:54.701256 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-bde37d0c-e925-4474-bd9f-bc0503aeed45 service neutron] For port a1e280f8-4599-42bc-9eec-7c9618c84471, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a1e280f8-4599-42bc-9eec-7c9618c84471,segment=NetworkSegment(dc0bd24b-5723-4625-bde4-525782b5f73e),segment_id=dc0bd24b-5723-4625-bde4-525782b5f73e)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:51:54.709898 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-bde37d0c-e925-4474-bd9f-bc0503aeed45 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:54.729128 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-bde37d0c-e925-4474-bd9f-bc0503aeed45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:54.729803 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-bde37d0c-e925-4474-bd9f-bc0503aeed45 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:54.732676 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-bde37d0c-e925-4474-bd9f-bc0503aeed45 service neutron] 10.222.0.31 "PUT /v2.0/ports/a1e280f8-4599-42bc-9eec-7c9618c84471 HTTP/1.1" status: 200 len: 1093 time: 0.7956879 Dec 09 21:51:54.753315 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e3992eb9-4e32-4dc2-be65-a102058d2974', 'tag': 'a1e280f8-4599-42bc-9eec-7c9618c84471'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:51:54.757258 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c6bc7ed9-d9ab-4742-99ef-7c53eb0a692c" -d '{"events": [{"name": "network-changed", "server_uuid": "e3992eb9-4e32-4dc2-be65-a102058d2974", "tag": "a1e280f8-4599-42bc-9eec-7c9618c84471"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:51:54.770795 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c60f9592-2c6f-4e25-b1af-1d6eff03612c req-38d74493-ca9e-46d1-8b09-fbc06eaa2c55 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:54.778377 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c60f9592-2c6f-4e25-b1af-1d6eff03612c req-38d74493-ca9e-46d1-8b09-fbc06eaa2c55 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 945 time: 0.0902059 Dec 09 21:51:54.853417 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bde37d0c-e925-4474-bd9f-bc0503aeed45 service neutron] Pushing event updated for resources: {'Port': ['ID=a1e280f8-4599-42bc-9eec-7c9618c84471,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:54.892080 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c60f9592-2c6f-4e25-b1af-1d6eff03612c req-f612a798-b008-4e3b-a098-8ed9f60761a6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1018877 Dec 09 21:51:54.897837 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-d927c012-907f-4e9d-bbf5-0e5ac0483737 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:54.900178 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-d927c012-907f-4e9d-bbf5-0e5ac0483737 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e863bf78256945798e7c717c650258aa&device_id=e3992eb9-4e32-4dc2-be65-a102058d2974 HTTP/1.1" status: 200 len: 1096 time: 0.1094050 Dec 09 21:51:54.913945 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52184) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:54.960252 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-f526d6e3-749d-4c1f-b634-ae6c70771a0a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=a1e280f8-4599-42bc-9eec-7c9618c84471 HTTP/1.1" status: 200 len: 217 time: 0.0515180 Dec 09 21:51:54.971284 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-54533ab9-4d15-4bd2-8ef4-0e9a3e2e33f1 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:54.975754 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-54533ab9-4d15-4bd2-8ef4-0e9a3e2e33f1 tempest-TestNetworkAdvancedServerOps-1625414146 tempest-TestNetworkAdvancedServerOps-1625414146-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 1092 time: 0.0574744 Dec 09 21:51:54.977271 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52186) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:54.987475 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-6a2f1e20-6c5a-41dc-b542-800cea288757 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': '50c46228-45fd-43c8-9fd2-e6ae52717651', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'fixed_ip_address': '172.20.0.5'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:51:54.988946 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:51:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4a644f6f-f374-4b11-a1a9-6ae89e312913 x-openstack-request-id: req-4a644f6f-f374-4b11-a1a9-6ae89e312913 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:51:54.989332 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e3992eb9-4e32-4dc2-be65-a102058d2974", "tag": "a1e280f8-4599-42bc-9eec-7c9618c84471", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:51:54.989692 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-4a644f6f-f374-4b11-a1a9-6ae89e312913 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:51:54.990514 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e3992eb9-4e32-4dc2-be65-a102058d2974', 'tag': 'a1e280f8-4599-42bc-9eec-7c9618c84471', 'status': 'completed', 'code': 200} Dec 09 21:51:55.017493 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6a2f1e20-6c5a-41dc-b542-800cea288757 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:55.043775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-56c7cf17-152e-445c-a7c0-6d9db5f79806 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:55.046560 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-56c7cf17-152e-445c-a7c0-6d9db5f79806 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=6112c97b-e0b7-4ba1-8f0e-463e550e07f7 HTTP/1.1" status: 200 len: 835 time: 0.0794406 Dec 09 21:51:55.113578 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-49f7234c-041c-4392-919a-4b4c16c62018 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:55.115588 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-49f7234c-041c-4392-919a-4b4c16c62018 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0598841 Dec 09 21:51:55.162133 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6a2f1e20-6c5a-41dc-b542-800cea288757 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:55.219881 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-86608739-cbf8-49c4-baa7-1833124777a6 service neutron] 10.222.0.31 "GET /v2.0/networks/5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0974569 Dec 09 21:51:55.286307 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-6a2f1e20-6c5a-41dc-b542-800cea288757 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Allocated IP 172.25.3.237 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/3929cee5-813b-483c-a625-9a1af2282e29) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:51:55.314147 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ed34097d-b9a6-40a3-a263-df31c99776dd req-d1b636b1-3247-4a6c-84f0-dcc16345e0f6 service neutron] 10.222.0.31 "GET /v2.0/networks/5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0870664 Dec 09 21:51:55.392958 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6a2f1e20-6c5a-41dc-b542-800cea288757 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:55.430250 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6bc7ed9-d9ab-4742-99ef-7c53eb0a692c req-00c126cf-faa8-4182-b9ca-4084836b9b72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:55.432727 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c6bc7ed9-d9ab-4742-99ef-7c53eb0a692c req-00c126cf-faa8-4182-b9ca-4084836b9b72 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e863bf78256945798e7c717c650258aa&device_id=e3992eb9-4e32-4dc2-be65-a102058d2974 HTTP/1.1" status: 200 len: 1096 time: 0.0618422 Dec 09 21:51:55.438859 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6a2f1e20-6c5a-41dc-b542-800cea288757 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:55.484256 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6a2f1e20-6c5a-41dc-b542-800cea288757 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:51:55.489422 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-6a2f1e20-6c5a-41dc-b542-800cea288757 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:51:55.494088 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a2f1e20-6c5a-41dc-b542-800cea288757 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:51:55.497316 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a2f1e20-6c5a-41dc-b542-800cea288757 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Port': ['ID=3929cee5-813b-483c-a625-9a1af2282e29,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:55.558736 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6bc7ed9-d9ab-4742-99ef-7c53eb0a692c req-db9fadc0-b84a-492a-82c7-952623caf4ac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:55.560307 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c6bc7ed9-d9ab-4742-99ef-7c53eb0a692c req-db9fadc0-b84a-492a-82c7-952623caf4ac service neutron] 10.222.0.31 "GET /v2.0/networks?id=5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3 HTTP/1.1" status: 200 len: 898 time: 0.1205924 Dec 09 21:51:55.625379 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c6bc7ed9-d9ab-4742-99ef-7c53eb0a692c req-dab85cba-7293-4770-a088-fde332f27680 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=a1e280f8-4599-42bc-9eec-7c9618c84471 HTTP/1.1" status: 200 len: 217 time: 0.0567977 Dec 09 21:51:55.689745 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6bc7ed9-d9ab-4742-99ef-7c53eb0a692c req-798a43ac-9b44-490f-92ab-f3e81bb169a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:55.691504 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c6bc7ed9-d9ab-4742-99ef-7c53eb0a692c req-798a43ac-9b44-490f-92ab-f3e81bb169a5 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=6112c97b-e0b7-4ba1-8f0e-463e550e07f7 HTTP/1.1" status: 200 len: 835 time: 0.0587270 Dec 09 21:51:55.790699 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a38aedf-d6e4-4c68-8307-296185cd3fdc req-67510144-9672-48da-975c-23256043c706 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:55.792360 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a38aedf-d6e4-4c68-8307-296185cd3fdc req-67510144-9672-48da-975c-23256043c706 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=e3992eb9-4e32-4dc2-be65-a102058d2974 HTTP/1.1" status: 200 len: 944 time: 0.1114244 Dec 09 21:51:55.798006 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6bc7ed9-d9ab-4742-99ef-7c53eb0a692c req-18fac919-bb56-40d2-9b78-7a028439a23e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:55.799803 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c6bc7ed9-d9ab-4742-99ef-7c53eb0a692c req-18fac919-bb56-40d2-9b78-7a028439a23e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0999753 Dec 09 21:51:55.909033 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a38aedf-d6e4-4c68-8307-296185cd3fdc req-ab620dd0-b7f7-477f-819a-96e2aba8eb62 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=91e8cd34-2082-4604-9b4a-5995f7f0b0c6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1055231 Dec 09 21:51:55.951738 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c6bc7ed9-d9ab-4742-99ef-7c53eb0a692c req-3c015369-0100-4a38-b569-073d169de336 service neutron] 10.222.0.31 "GET /v2.0/networks/5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1425643 Dec 09 21:51:56.047031 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6a2f1e20-6c5a-41dc-b542-800cea288757 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:56.069593 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c6bc7ed9-d9ab-4742-99ef-7c53eb0a692c req-5409ddc5-02b7-4641-80eb-98f987d988bf service neutron] 10.222.0.31 "GET /v2.0/networks/5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1108260 Dec 09 21:51:56.128429 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6a2f1e20-6c5a-41dc-b542-800cea288757 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:56.290213 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6a2f1e20-6c5a-41dc-b542-800cea288757 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:56.297059 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6a2f1e20-6c5a-41dc-b542-800cea288757 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:56.370332 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a2f1e20-6c5a-41dc-b542-800cea288757 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event updated for resources: {'Port': ['ID=3929cee5-813b-483c-a625-9a1af2282e29,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:56.381721 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6a2f1e20-6c5a-41dc-b542-800cea288757 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:56.486684 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-6a2f1e20-6c5a-41dc-b542-800cea288757 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Floating IP e7a2e8df-af1c-4df1-9f51-140291c8185b associated. External IP: 172.25.3.237, port: 50c46228-45fd-43c8-9fd2-e6ae52717651. Dec 09 21:51:56.705320 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6a2f1e20-6c5a-41dc-b542-800cea288757 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Router 9c1d018e-ab43-4dc3-aa27-cf34a503bdd1 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:51:56.885180 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6a2f1e20-6c5a-41dc-b542-800cea288757 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:51:56.896264 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ad73f70-0340-4205-85f8-05a1a5390aa2 None None] Sync routers for ids ['9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:51:56.909491 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ad73f70-0340-4205-85f8-05a1a5390aa2 None None] Routers {'9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:51:56.910288 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-3ad73f70-0340-4205-85f8-05a1a5390aa2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:51:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:56.915714 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6a2f1e20-6c5a-41dc-b542-800cea288757 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:56.950131 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6a2f1e20-6c5a-41dc-b542-800cea288757 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.9716718 Dec 09 21:51:56.950775 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cdcb1836-6369-4540-b4f2-07f714a9590f', 'tag': '50c46228-45fd-43c8-9fd2-e6ae52717651'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:51:56.953552 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bd3f38c6-9f5b-4111-b58d-472d921a5a8d" -d '{"events": [{"name": "network-changed", "server_uuid": "cdcb1836-6369-4540-b4f2-07f714a9590f", "tag": "50c46228-45fd-43c8-9fd2-e6ae52717651"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:51:57.061223 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-286f982d-eb26-4387-86ce-39511feb928c req-714be3f0-481c-45c8-a498-c8f60e92eae6 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:57.062951 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-286f982d-eb26-4387-86ce-39511feb928c req-714be3f0-481c-45c8-a498-c8f60e92eae6 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=e3992eb9-4e32-4dc2-be65-a102058d2974 HTTP/1.1" status: 200 len: 944 time: 0.0594978 Dec 09 21:51:57.068813 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-3ad73f70-0340-4205-85f8-05a1a5390aa2 None None] Set router 9c1d018e-ab43-4dc3-aa27-cf34a503bdd1 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:51:57.127194 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-286f982d-eb26-4387-86ce-39511feb928c req-8fb03c17-f425-4e01-b107-18a13d628c20 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=91e8cd34-2082-4604-9b4a-5995f7f0b0c6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0575995 Dec 09 21:51:57.272686 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19d41ddf-5162-489c-849b-241c7e19641f req-0149d776-08ab-4c63-abd5-212192519765 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:57.274575 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19d41ddf-5162-489c-849b-241c7e19641f req-0149d776-08ab-4c63-abd5-212192519765 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 945 time: 0.0769234 Dec 09 21:51:57.328475 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:57.360627 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19d41ddf-5162-489c-849b-241c7e19641f req-f79b6bc6-dcd6-40e3-a1de-e5614512f6bf tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0730405 Dec 09 21:51:57.375326 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52224) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:57.424548 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-3ad73f70-0340-4205-85f8-05a1a5390aa2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-279236251', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80'}], 'enable_snat': True}, 'gw_port_id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:34Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:8c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3762, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'e7a2e8df-af1c-4df1-9f51-140291c8185b', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'floating_ip_address': '172.25.3.237', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'port_id': '50c46228-45fd-43c8-9fd2-e6ae52717651', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 3785, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c', 'mac_address': 'fa:16:3e:4f:df:b4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdcb1836-6369-4540-b4f2-07f714a9590f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:51:55Z', 'updated_at': '2021-12-09T21:51:55Z', 'revision_number': 0, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '34b5b36b-2611-4360-8169-d595d507e923', 'name': '', 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:78:ac:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'device_owner': 'network:router_interface', 'standard_attr_id': 3767, 'fixed_ips': [{'subnet_id': 'df92f5f0-ea14-470b-bca7-c613b8daecf5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:32Z', 'updated_at': '2021-12-09T21:51:40Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': 'df92f5f0-ea14-470b-bca7-c613b8daecf5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:57.431021 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:51:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0d14bddd-6aee-4bea-bc8f-a5334910b77f x-openstack-request-id: req-0d14bddd-6aee-4bea-bc8f-a5334910b77f {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:51:57.431313 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cdcb1836-6369-4540-b4f2-07f714a9590f", "tag": "50c46228-45fd-43c8-9fd2-e6ae52717651", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:51:57.431587 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0d14bddd-6aee-4bea-bc8f-a5334910b77f {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:51:57.432031 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cdcb1836-6369-4540-b4f2-07f714a9590f', 'tag': '50c46228-45fd-43c8-9fd2-e6ae52717651', 'status': 'completed', 'code': 200} Dec 09 21:51:57.482085 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-087483f9-0bfa-4c73-aa93-2c85d577e7cd tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/floatingips/e7a2e8df-af1c-4df1-9f51-140291c8185b HTTP/1.1" status: 200 len: 991 time: 0.1037714 Dec 09 21:51:57.493725 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd3f38c6-9f5b-4111-b58d-472d921a5a8d req-4ee92c0e-9a57-4cfd-8639-3639d531b014 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:57.496953 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd3f38c6-9f5b-4111-b58d-472d921a5a8d req-4ee92c0e-9a57-4cfd-8639-3639d531b014 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 1097 time: 0.0662165 Dec 09 21:51:57.503077 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ad73f70-0340-4205-85f8-05a1a5390aa2 None None] Checking router: 9c1d018e-ab43-4dc3-aa27-cf34a503bdd1 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:51:57.516122 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ad73f70-0340-4205-85f8-05a1a5390aa2 None None] Routers {'9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:51:57.516122 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-3ad73f70-0340-4205-85f8-05a1a5390aa2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:51:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:57.571407 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:57.636729 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-3ad73f70-0340-4205-85f8-05a1a5390aa2 None None] Set router 9c1d018e-ab43-4dc3-aa27-cf34a503bdd1 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:51:57.705709 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device a1e280f8-4599-42bc-9eec-7c9618c84471 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:51:57.708392 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd3f38c6-9f5b-4111-b58d-472d921a5a8d req-aee70269-d5f3-428a-97c1-f1a750d31401 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:57.709941 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd3f38c6-9f5b-4111-b58d-472d921a5a8d req-aee70269-d5f3-428a-97c1-f1a750d31401 service neutron] 10.222.0.31 "GET /v2.0/networks?id=dbbab540-d32c-4ae4-8405-4fd5a5d9b94c HTTP/1.1" status: 200 len: 898 time: 0.2057486 Dec 09 21:51:57.812922 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd3f38c6-9f5b-4111-b58d-472d921a5a8d req-e52475cd-692b-40a0-b5f7-f1b9bc714f32 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=50c46228-45fd-43c8-9fd2-e6ae52717651 HTTP/1.1" status: 200 len: 999 time: 0.0901189 Dec 09 21:51:57.890190 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port a1e280f8-4599-42bc-9eec-7c9618c84471, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a1e280f8-4599-42bc-9eec-7c9618c84471,segment=NetworkSegment(dc0bd24b-5723-4625-bde4-525782b5f73e),segment_id=dc0bd24b-5723-4625-bde4-525782b5f73e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:57.905511 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'a1e280f8-4599-42bc-9eec-7c9618c84471', 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3', 'port_id': 'a1e280f8-4599-42bc-9eec-7c9618c84471', 'mac_address': 'fa:16:3e:f7:55:55', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 144, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6112c97b-e0b7-4ba1-8f0e-463e550e07f7', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:51:57.962042 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd3f38c6-9f5b-4111-b58d-472d921a5a8d req-5d7408be-44f7-49f1-831b-d9bf42311aae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:57.965250 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd3f38c6-9f5b-4111-b58d-472d921a5a8d req-5d7408be-44f7-49f1-831b-d9bf42311aae service neutron] 10.222.0.31 "GET /v2.0/subnets?id=df92f5f0-ea14-470b-bca7-c613b8daecf5 HTTP/1.1" status: 200 len: 834 time: 0.1441355 Dec 09 21:51:57.967913 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:57.989007 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a1e280f8-4599-42bc-9eec-7c9618c84471 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:51:58.015048 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port a1e280f8-4599-42bc-9eec-7c9618c84471, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a1e280f8-4599-42bc-9eec-7c9618c84471,segment=NetworkSegment(dc0bd24b-5723-4625-bde4-525782b5f73e),segment_id=dc0bd24b-5723-4625-bde4-525782b5f73e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:58.024023 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:58.053695 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd3f38c6-9f5b-4111-b58d-472d921a5a8d req-17e63a27-5fa9-499d-82ca-cf185147bac6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:58.055996 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd3f38c6-9f5b-4111-b58d-472d921a5a8d req-17e63a27-5fa9-499d-82ca-cf185147bac6 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=dbbab540-d32c-4ae4-8405-4fd5a5d9b94c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0766511 Dec 09 21:51:58.278582 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['a1e280f8-4599-42bc-9eec-7c9618c84471'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:51:58.293919 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-3ad73f70-0340-4205-85f8-05a1a5390aa2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-279236251', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80'}], 'enable_snat': True}, 'gw_port_id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:34Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:8c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3762, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'e7a2e8df-af1c-4df1-9f51-140291c8185b', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'floating_ip_address': '172.25.3.237', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'port_id': '50c46228-45fd-43c8-9fd2-e6ae52717651', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 3785, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c', 'mac_address': 'fa:16:3e:4f:df:b4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdcb1836-6369-4540-b4f2-07f714a9590f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:51:55Z', 'updated_at': '2021-12-09T21:51:55Z', 'revision_number': 0, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '34b5b36b-2611-4360-8169-d595d507e923', 'name': '', 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:78:ac:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'device_owner': 'network:router_interface', 'standard_attr_id': 3767, 'fixed_ips': [{'subnet_id': 'df92f5f0-ea14-470b-bca7-c613b8daecf5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:32Z', 'updated_at': '2021-12-09T21:51:40Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': 'df92f5f0-ea14-470b-bca7-c613b8daecf5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:51:58.299941 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd3f38c6-9f5b-4111-b58d-472d921a5a8d req-d4cfa5cc-e9dc-4bd7-b390-60e8fb40beaf service neutron] 10.222.0.31 "GET /v2.0/networks/dbbab540-d32c-4ae4-8405-4fd5a5d9b94c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2351842 Dec 09 21:51:58.359862 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ad73f70-0340-4205-85f8-05a1a5390aa2 None None] The sync data for ids ['9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'] in n-d-713301-27 is: [{'id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-279236251', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80'}], 'enable_snat': True}, 'gw_port_id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:34Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:8c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3762, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'e7a2e8df-af1c-4df1-9f51-140291c8185b', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'floating_ip_address': '172.25.3.237', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'port_id': '50c46228-45fd-43c8-9fd2-e6ae52717651', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 3785, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c', 'mac_address': 'fa:16:3e:4f:df:b4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cdcb1836-6369-4540-b4f2-07f714a9590f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:51:55Z', 'updated_at': '2021-12-09T21:51:55Z', 'revision_number': 0, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '34b5b36b-2611-4360-8169-d595d507e923', 'name': '', 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:78:ac:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'device_owner': 'network:router_interface', 'standard_attr_id': 3767, 'fixed_ips': [{'subnet_id': 'df92f5f0-ea14-470b-bca7-c613b8daecf5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:32Z', 'updated_at': '2021-12-09T21:51:40Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': 'df92f5f0-ea14-470b-bca7-c613b8daecf5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:51:58.366616 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc0aa413-fe25-486d-8646-5d91e6ee3d9f req-1665e28a-7f1c-479d-9a18-47791e8ae839 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:58.377705 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc0aa413-fe25-486d-8646-5d91e6ee3d9f req-1665e28a-7f1c-479d-9a18-47791e8ae839 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=e3992eb9-4e32-4dc2-be65-a102058d2974 HTTP/1.1" status: 200 len: 945 time: 0.1082709 Dec 09 21:51:58.383264 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=a1e280f8-4599-42bc-9eec-7c9618c84471,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:58.445069 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc0aa413-fe25-486d-8646-5d91e6ee3d9f req-87805bf7-71e7-459f-9e84-1388239e921a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=91e8cd34-2082-4604-9b4a-5995f7f0b0c6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0659168 Dec 09 21:51:58.481779 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52308) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:58.516364 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd3f38c6-9f5b-4111-b58d-472d921a5a8d req-1b4db572-3a8c-4ccb-96b9-ad63f016b2ae service neutron] 10.222.0.31 "GET /v2.0/networks/dbbab540-d32c-4ae4-8405-4fd5a5d9b94c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2076852 Dec 09 21:51:58.622821 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8783f064-cdc7-4fc7-b48c-c9bbdf45af80 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/floatingips/e7a2e8df-af1c-4df1-9f51-140291c8185b HTTP/1.1" status: 200 len: 991 time: 0.1391511 Dec 09 21:51:58.813941 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64d1eb7e-6874-4e46-9594-e491da652d97 None None] New status for floating IP e7a2e8df-af1c-4df1-9f51-140291c8185b: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:51:59.568603 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b609a0-a389-44fa-974e-f15caa0d8dfe req-c5a0da08-9b5c-411a-b75f-1b509cc15a88 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:51:59.570134 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31b609a0-a389-44fa-974e-f15caa0d8dfe req-c5a0da08-9b5c-411a-b75f-1b509cc15a88 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=e3992eb9-4e32-4dc2-be65-a102058d2974 HTTP/1.1" status: 200 len: 945 time: 0.0552790 Dec 09 21:51:59.622547 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31b609a0-a389-44fa-974e-f15caa0d8dfe req-dd3df34a-d25a-4d7b-849d-7af7a4945fec tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=91e8cd34-2082-4604-9b4a-5995f7f0b0c6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456109 Dec 09 21:51:59.626307 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52444) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:51:59.701415 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8a42671e-6dde-4948-8378-e80a66248296 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/floatingips/e7a2e8df-af1c-4df1-9f51-140291c8185b HTTP/1.1" status: 200 len: 993 time: 0.0735538 Dec 09 21:51:59.722855 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device a1e280f8-4599-42bc-9eec-7c9618c84471 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:51:59.777864 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port a1e280f8-4599-42bc-9eec-7c9618c84471 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:51:59.783125 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port a1e280f8-4599-42bc-9eec-7c9618c84471 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:51:59.783646 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:59.877130 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:59.904838 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e3992eb9-4e32-4dc2-be65-a102058d2974', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a1e280f8-4599-42bc-9eec-7c9618c84471'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:51:59.907416 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ec8bc306-d74f-4cd4-9d1e-52fdf17b715a" -d '{"events": [{"server_uuid": "e3992eb9-4e32-4dc2-be65-a102058d2974", "name": "network-vif-plugged", "status": "completed", "tag": "a1e280f8-4599-42bc-9eec-7c9618c84471"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:51:59.922036 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port a1e280f8-4599-42bc-9eec-7c9618c84471, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a1e280f8-4599-42bc-9eec-7c9618c84471,segment=NetworkSegment(dc0bd24b-5723-4625-bde4-525782b5f73e),segment_id=dc0bd24b-5723-4625-bde4-525782b5f73e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:51:59.927840 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:51:59.988781 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=a1e280f8-4599-42bc-9eec-7c9618c84471,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:51:59.993132 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:51:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b0dee36f-2179-4188-9ed3-9df95462c18d x-openstack-request-id: req-b0dee36f-2179-4188-9ed3-9df95462c18d {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:51:59.993495 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e3992eb9-4e32-4dc2-be65-a102058d2974", "name": "network-vif-plugged", "status": "completed", "tag": "a1e280f8-4599-42bc-9eec-7c9618c84471", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:51:59.993939 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-b0dee36f-2179-4188-9ed3-9df95462c18d {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:51:59.994379 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e3992eb9-4e32-4dc2-be65-a102058d2974', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a1e280f8-4599-42bc-9eec-7c9618c84471', 'code': 200} Dec 09 21:52:00.116930 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17c569e0-fd8c-43a2-b30d-f4bc60691279 req-b7d52b17-23b9-4b20-95fe-12fba323d824 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:00.118550 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-17c569e0-fd8c-43a2-b30d-f4bc60691279 req-b7d52b17-23b9-4b20-95fe-12fba323d824 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=e3992eb9-4e32-4dc2-be65-a102058d2974 HTTP/1.1" status: 200 len: 1098 time: 0.0571268 Dec 09 21:52:00.182035 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-17c569e0-fd8c-43a2-b30d-f4bc60691279 req-ad7094c0-e0a2-42b1-be0d-26ce4badbcb2 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=91e8cd34-2082-4604-9b4a-5995f7f0b0c6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0539310 Dec 09 21:52:00.779997 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0e1f228-0538-49d5-b518-327915aed45b req-8360859a-5928-46bf-afe3-0c89453dc85d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:00.796786 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d0e1f228-0538-49d5-b518-327915aed45b req-8360859a-5928-46bf-afe3-0c89453dc85d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=e3992eb9-4e32-4dc2-be65-a102058d2974 HTTP/1.1" status: 200 len: 946 time: 0.0734599 Dec 09 21:52:00.867790 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d0e1f228-0538-49d5-b518-327915aed45b req-005edcb5-08d6-401a-b08b-24f63418196b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=91e8cd34-2082-4604-9b4a-5995f7f0b0c6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0699353 Dec 09 21:52:02.024732 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7df0251a-44f2-4309-a552-11ce1d582f5b req-a78f8774-efb8-4b95-8966-51d502a8a498 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:02.032186 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7df0251a-44f2-4309-a552-11ce1d582f5b req-a78f8774-efb8-4b95-8966-51d502a8a498 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=e3992eb9-4e32-4dc2-be65-a102058d2974 HTTP/1.1" status: 200 len: 946 time: 0.0708261 Dec 09 21:52:02.083578 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7df0251a-44f2-4309-a552-11ce1d582f5b req-18da0eb7-7740-41a6-9627-6220739b4fab tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=91e8cd34-2082-4604-9b4a-5995f7f0b0c6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476406 Dec 09 21:52:02.216985 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29cad6be-c789-48de-914d-d37001b9af0a req-c5e6a8be-05c1-42a3-b260-2e794c2d9e29 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:02.220956 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-29cad6be-c789-48de-914d-d37001b9af0a req-c5e6a8be-05c1-42a3-b260-2e794c2d9e29 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=e3992eb9-4e32-4dc2-be65-a102058d2974 HTTP/1.1" status: 200 len: 946 time: 0.0629110 Dec 09 21:52:02.278125 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-29cad6be-c789-48de-914d-d37001b9af0a req-f0572d19-0555-4e95-8f16-17c51b23f06f tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=91e8cd34-2082-4604-9b4a-5995f7f0b0c6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0521610 Dec 09 21:52:02.318396 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52720) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:02.382448 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3574d52b-6b34-454b-8a87-e00eef410861 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:02.389645 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3574d52b-6b34-454b-8a87-e00eef410861 tempest-TestNetworkBasicOps-338240728 tempest-TestNetworkBasicOps-338240728-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=e3992eb9-4e32-4dc2-be65-a102058d2974 HTTP/1.1" status: 200 len: 1093 time: 0.0661113 Dec 09 21:52:02.390080 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52722) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:02.396417 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-84799a3d-ef79-4569-83c9-34d1f3f5b04d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': 'a1e280f8-4599-42bc-9eec-7c9618c84471', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'fixed_ip_address': '172.20.0.13'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:52:02.427098 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84799a3d-ef79-4569-83c9-34d1f3f5b04d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:02.562524 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84799a3d-ef79-4569-83c9-34d1f3f5b04d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:02.687184 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-84799a3d-ef79-4569-83c9-34d1f3f5b04d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Allocated IP 172.25.3.189 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/ea78f544-71a6-40d1-a8b8-1cdf4de86b25) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:52:02.808908 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84799a3d-ef79-4569-83c9-34d1f3f5b04d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:02.857352 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84799a3d-ef79-4569-83c9-34d1f3f5b04d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:02.910876 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84799a3d-ef79-4569-83c9-34d1f3f5b04d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'Port': ['ID=ea78f544-71a6-40d1-a8b8-1cdf4de86b25,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:02.938444 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84799a3d-ef79-4569-83c9-34d1f3f5b04d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:52:02.940692 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-84799a3d-ef79-4569-83c9-34d1f3f5b04d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:52:02.943666 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84799a3d-ef79-4569-83c9-34d1f3f5b04d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:52:02.989313 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-317db53b-79e2-48e4-adb7-60e6d0ebe3ab None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:03.341880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-13b1ea44-7b29-4857-b993-fa886620f180 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:03.343466 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-13b1ea44-7b29-4857-b993-fa886620f180 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/networks?id=eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a HTTP/1.1" status: 200 len: 814 time: 0.1809189 Dec 09 21:52:03.395149 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-8272560d-2104-441e-afad-d9dabfd2b613 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/quotas/2671ed6f9fdf4c9cb0e0438099319f7d HTTP/1.1" status: 200 len: 375 time: 0.0279274 Dec 09 21:52:03.821131 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-332eb3ff-b352-4133-b283-5cabf1af2697 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=2671ed6f9fdf4c9cb0e0438099319f7d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.4249284 Dec 09 21:52:03.973221 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84799a3d-ef79-4569-83c9-34d1f3f5b04d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:03.976538 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-b87b5058-0e2b-4109-942c-9d3ee2d8cdaa service neutron] 10.222.0.13 "GET /v2.0/networks/eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1461623 Dec 09 21:52:04.112078 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84799a3d-ef79-4569-83c9-34d1f3f5b04d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:04.117403 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-051999a2-a3f0-4787-847f-7e2f5c99532b service neutron] 10.222.0.13 "GET /v2.0/networks/eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1225729 Dec 09 21:52:04.387213 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27c06c68-49fd-445d-a568-b0efa9459be5 req-6a7418d7-eabe-477a-a769-3292a75f2334 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/ports?device_id=a7cd5203-8be8-4571-9b6a-ccb745d3f244 HTTP/1.1" status: 200 len: 210 time: 0.0614033 Dec 09 21:52:04.412161 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84799a3d-ef79-4569-83c9-34d1f3f5b04d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:04.426979 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84799a3d-ef79-4569-83c9-34d1f3f5b04d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:04.517865 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84799a3d-ef79-4569-83c9-34d1f3f5b04d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event updated for resources: {'Port': ['ID=ea78f544-71a6-40d1-a8b8-1cdf4de86b25,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:04.534459 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84799a3d-ef79-4569-83c9-34d1f3f5b04d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:04.656431 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-84799a3d-ef79-4569-83c9-34d1f3f5b04d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Floating IP 168a6a14-af7b-43e5-89ba-e2a51fb82886 associated. External IP: 172.25.3.189, port: a1e280f8-4599-42bc-9eec-7c9618c84471. Dec 09 21:52:04.891899 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-84799a3d-ef79-4569-83c9-34d1f3f5b04d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Router ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:52:05.037480 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-84799a3d-ef79-4569-83c9-34d1f3f5b04d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:52:05.050550 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-73655b34-68af-4f22-a216-fa313883eae6 None None] Sync routers for ids ['ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:52:05.061746 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-73655b34-68af-4f22-a216-fa313883eae6 None None] Routers {'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:52:05.062859 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-73655b34-68af-4f22-a216-fa313883eae6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:51:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:05.067156 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84799a3d-ef79-4569-83c9-34d1f3f5b04d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:05.101739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 52764) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:05.110594 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-84799a3d-ef79-4569-83c9-34d1f3f5b04d tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.7128446 Dec 09 21:52:05.112109 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e3992eb9-4e32-4dc2-be65-a102058d2974', 'tag': 'a1e280f8-4599-42bc-9eec-7c9618c84471'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:52:05.121529 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4440799a-e8e4-46ad-bc1b-b837832c4033" -d '{"events": [{"name": "network-changed", "server_uuid": "e3992eb9-4e32-4dc2-be65-a102058d2974", "tag": "a1e280f8-4599-42bc-9eec-7c9618c84471"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:52:05.205510 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:52:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0796dab3-f133-4024-afa4-dbd137dd2f3c x-openstack-request-id: req-0796dab3-f133-4024-afa4-dbd137dd2f3c {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:52:05.209491 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-437163c4-7122-47a1-8a30-8941cebe2a1b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/floatingips/168a6a14-af7b-43e5-89ba-e2a51fb82886 HTTP/1.1" status: 200 len: 992 time: 0.1060958 Dec 09 21:52:05.212632 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e3992eb9-4e32-4dc2-be65-a102058d2974", "tag": "a1e280f8-4599-42bc-9eec-7c9618c84471", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:52:05.213002 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0796dab3-f133-4024-afa4-dbd137dd2f3c {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:52:05.213561 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e3992eb9-4e32-4dc2-be65-a102058d2974', 'tag': 'a1e280f8-4599-42bc-9eec-7c9618c84471', 'status': 'completed', 'code': 200} Dec 09 21:52:05.237408 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-73655b34-68af-4f22-a216-fa313883eae6 None None] Set router ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:52:05.287677 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4440799a-e8e4-46ad-bc1b-b837832c4033 req-461a7fa7-7dae-4d81-9bf2-0356413d5b1e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:05.289479 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4440799a-e8e4-46ad-bc1b-b837832c4033 req-461a7fa7-7dae-4d81-9bf2-0356413d5b1e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e863bf78256945798e7c717c650258aa&device_id=e3992eb9-4e32-4dc2-be65-a102058d2974 HTTP/1.1" status: 200 len: 1098 time: 0.0489268 Dec 09 21:52:05.409225 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4440799a-e8e4-46ad-bc1b-b837832c4033 req-f0f57662-7f96-4410-b06c-c1b739bf7574 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:05.411038 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4440799a-e8e4-46ad-bc1b-b837832c4033 req-f0f57662-7f96-4410-b06c-c1b739bf7574 service neutron] 10.222.0.31 "GET /v2.0/networks?id=5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3 HTTP/1.1" status: 200 len: 898 time: 0.1127746 Dec 09 21:52:05.489951 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4440799a-e8e4-46ad-bc1b-b837832c4033 req-a441e3e9-6bde-4798-b1df-cd503aeb6708 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=a1e280f8-4599-42bc-9eec-7c9618c84471 HTTP/1.1" status: 200 len: 1000 time: 0.0671430 Dec 09 21:52:05.517092 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-73655b34-68af-4f22-a216-fa313883eae6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'name': 'tempest-TestNetworkBasicOps-router-421012370', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48'}], 'enable_snat': True}, 'gw_port_id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:32Z', 'updated_at': '2021-12-09T21:51:41Z', 'revision_number': 4, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:55:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3769, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:34Z', 'updated_at': '2021-12-09T21:51:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '168a6a14-af7b-43e5-89ba-e2a51fb82886', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'floating_ip_address': '172.25.3.189', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'port_id': 'a1e280f8-4599-42bc-9eec-7c9618c84471', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 3787, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3', 'mac_address': 'fa:16:3e:f7:55:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e3992eb9-4e32-4dc2-be65-a102058d2974', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:52:03Z', 'updated_at': '2021-12-09T21:52:03Z', 'revision_number': 0, 'project_id': 'e863bf78256945798e7c717c650258aa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01', 'name': '', 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:0b:51:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 3772, 'fixed_ips': [{'subnet_id': '6112c97b-e0b7-4ba1-8f0e-463e550e07f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:40Z', 'updated_at': '2021-12-09T21:51:49Z', 'revision_number': 5, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': '6112c97b-e0b7-4ba1-8f0e-463e550e07f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:05.581118 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-73655b34-68af-4f22-a216-fa313883eae6 None None] Checking router: ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:52:05.582544 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b08368b6-383f-43e0-8646-586599160a3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:05.603289 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-73655b34-68af-4f22-a216-fa313883eae6 None None] Routers {'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:52:05.604225 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-73655b34-68af-4f22-a216-fa313883eae6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:05.617873 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba51ed3f-0942-4394-984f-67f6d8ccbf05 req-d2ff5c87-81cc-4cc6-9802-eab1815a59be tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/ports?device_id=a7cd5203-8be8-4571-9b6a-ccb745d3f244 HTTP/1.1" status: 200 len: 210 time: 0.0904543 Dec 09 21:52:05.656030 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4440799a-e8e4-46ad-bc1b-b837832c4033 req-214ef184-5c2a-4692-b745-a22a9306fc48 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:05.658950 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4440799a-e8e4-46ad-bc1b-b837832c4033 req-214ef184-5c2a-4692-b745-a22a9306fc48 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=6112c97b-e0b7-4ba1-8f0e-463e550e07f7 HTTP/1.1" status: 200 len: 835 time: 0.1529262 Dec 09 21:52:05.852626 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4440799a-e8e4-46ad-bc1b-b837832c4033 req-9e595724-191d-4aca-a68a-0b69c627c15a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:05.854429 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4440799a-e8e4-46ad-bc1b-b837832c4033 req-9e595724-191d-4aca-a68a-0b69c627c15a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.1882768 Dec 09 21:52:05.885323 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-73655b34-68af-4f22-a216-fa313883eae6 None None] Set router ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:52:05.984848 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-59bc093b-9b15-47de-a6a8-f6e347bde9df tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:05.986837 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-59bc093b-9b15-47de-a6a8-f6e347bde9df tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.31 "GET /v2.0/networks?id=eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a HTTP/1.1" status: 200 len: 814 time: 0.2679763 Dec 09 21:52:06.004520 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-98937006-8fa1-4b8f-b3bb-90c21db8d4e1 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Request body: {'port': {'device_id': 'a7cd5203-8be8-4571-9b6a-ccb745d3f244', 'network_id': 'eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a', 'admin_state_up': True, 'tenant_id': '2671ed6f9fdf4c9cb0e0438099319f7d'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:52:06.071984 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4440799a-e8e4-46ad-bc1b-b837832c4033 req-53fed28c-635b-4570-a754-f733eb28f960 service neutron] 10.222.0.31 "GET /v2.0/networks/5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2039800 Dec 09 21:52:06.213791 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52834) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:06.310580 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-73655b34-68af-4f22-a216-fa313883eae6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'name': 'tempest-TestNetworkBasicOps-router-421012370', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48'}], 'enable_snat': True}, 'gw_port_id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:32Z', 'updated_at': '2021-12-09T21:51:41Z', 'revision_number': 4, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:55:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3769, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:34Z', 'updated_at': '2021-12-09T21:51:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '168a6a14-af7b-43e5-89ba-e2a51fb82886', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'floating_ip_address': '172.25.3.189', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'port_id': 'a1e280f8-4599-42bc-9eec-7c9618c84471', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 3787, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3', 'mac_address': 'fa:16:3e:f7:55:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e3992eb9-4e32-4dc2-be65-a102058d2974', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:52:03Z', 'updated_at': '2021-12-09T21:52:03Z', 'revision_number': 0, 'project_id': 'e863bf78256945798e7c717c650258aa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01', 'name': '', 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:0b:51:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 3772, 'fixed_ips': [{'subnet_id': '6112c97b-e0b7-4ba1-8f0e-463e550e07f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:40Z', 'updated_at': '2021-12-09T21:51:49Z', 'revision_number': 5, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': '6112c97b-e0b7-4ba1-8f0e-463e550e07f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:06.332699 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ddf46b99-a63e-403d-b432-77a8965168fe tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/floatingips/168a6a14-af7b-43e5-89ba-e2a51fb82886 HTTP/1.1" status: 200 len: 992 time: 0.1158760 Dec 09 21:52:06.355220 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-73655b34-68af-4f22-a216-fa313883eae6 None None] The sync data for ids ['ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'] in n-d-713301-27 is: [{'id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'name': 'tempest-TestNetworkBasicOps-router-421012370', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48'}], 'enable_snat': True}, 'gw_port_id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:32Z', 'updated_at': '2021-12-09T21:51:41Z', 'revision_number': 4, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:55:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3769, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:34Z', 'updated_at': '2021-12-09T21:51:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '168a6a14-af7b-43e5-89ba-e2a51fb82886', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'floating_ip_address': '172.25.3.189', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'port_id': 'a1e280f8-4599-42bc-9eec-7c9618c84471', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 3787, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3', 'mac_address': 'fa:16:3e:f7:55:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e3992eb9-4e32-4dc2-be65-a102058d2974', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:52:03Z', 'updated_at': '2021-12-09T21:52:03Z', 'revision_number': 0, 'project_id': 'e863bf78256945798e7c717c650258aa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01', 'name': '', 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:0b:51:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 3772, 'fixed_ips': [{'subnet_id': '6112c97b-e0b7-4ba1-8f0e-463e550e07f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:40Z', 'updated_at': '2021-12-09T21:51:49Z', 'revision_number': 5, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': '6112c97b-e0b7-4ba1-8f0e-463e550e07f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:52:06.678940 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:06.692697 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-98937006-8fa1-4b8f-b3bb-90c21db8d4e1 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Made reservation on behalf of 2671ed6f9fdf4c9cb0e0438099319f7d for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:52:06.696930 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-98937006-8fa1-4b8f-b3bb-90c21db8d4e1 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:06.714592 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd347797-30e6-424f-8812-e84b8294bf4b None None] New status for floating IP 168a6a14-af7b-43e5-89ba-e2a51fb82886: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:52:06.798502 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a48178e-1fa7-40eb-889e-6bdaa0b19f2b req-09efe9b1-764a-4e76-ba67-f989a952e758 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/ports?device_id=a7cd5203-8be8-4571-9b6a-ccb745d3f244 HTTP/1.1" status: 200 len: 210 time: 0.0567043 Dec 09 21:52:06.879341 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4440799a-e8e4-46ad-bc1b-b837832c4033 req-9183696e-0479-4d6b-8c60-a4a0a89b092a service neutron] 10.222.0.31 "GET /v2.0/networks/5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7556553 Dec 09 21:52:06.981135 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-98937006-8fa1-4b8f-b3bb-90c21db8d4e1 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Allocated IP 172.20.0.13 (eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a/938dec21-7b2e-4de4-a129-71c1f3ba1dd6/81fcff43-a433-4ab6-8549-e6a7daf568ec) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:52:07.238165 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-98937006-8fa1-4b8f-b3bb-90c21db8d4e1 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:07.290255 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-98937006-8fa1-4b8f-b3bb-90c21db8d4e1 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:07.336208 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 52946) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:07.338977 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-98937006-8fa1-4b8f-b3bb-90c21db8d4e1 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Network eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:52:07.342233 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-98937006-8fa1-4b8f-b3bb-90c21db8d4e1 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:52:07.346176 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-98937006-8fa1-4b8f-b3bb-90c21db8d4e1 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:52:07.386114 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98937006-8fa1-4b8f-b3bb-90c21db8d4e1 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Pushing event updated for resources: {'Port': ['ID=81fcff43-a433-4ab6-8549-e6a7daf568ec,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:07.417686 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-98937006-8fa1-4b8f-b3bb-90c21db8d4e1 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:07.418350 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-98937006-8fa1-4b8f-b3bb-90c21db8d4e1 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:07.434878 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6a65f2a6-9c4b-4c7a-902e-e034481e21f5 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/floatingips/168a6a14-af7b-43e5-89ba-e2a51fb82886 HTTP/1.1" status: 200 len: 994 time: 0.0971320 Dec 09 21:52:07.438070 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-98937006-8fa1-4b8f-b3bb-90c21db8d4e1 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.4405155 Dec 09 21:52:07.457602 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-d4683622-401d-4dcd-967c-d200a730ce45 service neutron] Request body: {'port': {'device_id': 'a7cd5203-8be8-4571-9b6a-ccb745d3f244', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:52:07.520367 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-d4683622-401d-4dcd-967c-d200a730ce45 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:07.834314 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-d4683622-401d-4dcd-967c-d200a730ce45 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 81fcff43-a433-4ab6-8549-e6a7daf568ec {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:52:07.842853 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-d4683622-401d-4dcd-967c-d200a730ce45 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:07.856935 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-d4683622-401d-4dcd-967c-d200a730ce45 service neutron] Transition to ACTIVE for port object 81fcff43-a433-4ab6-8549-e6a7daf568ec will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:52:07.864783 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-d4683622-401d-4dcd-967c-d200a730ce45 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:07.928879 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4683622-401d-4dcd-967c-d200a730ce45 service neutron] Pushing event updated for resources: {'Port': ['ID=81fcff43-a433-4ab6-8549-e6a7daf568ec,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:07.981669 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee8d1b8-4409-4f0d-8c82-a41b6a8b0d36 req-3af8b07e-6a77-4656-bd9c-ea7b1062fd38 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:07.984043 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1ee8d1b8-4409-4f0d-8c82-a41b6a8b0d36 req-3af8b07e-6a77-4656-bd9c-ea7b1062fd38 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/ports?device_id=a7cd5203-8be8-4571-9b6a-ccb745d3f244 HTTP/1.1" status: 200 len: 944 time: 0.0853944 Dec 09 21:52:08.026696 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:08.029386 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-d4683622-401d-4dcd-967c-d200a730ce45 service neutron] Attempting to bind port 81fcff43-a433-4ab6-8549-e6a7daf568ec on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:52:08.029737 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-d4683622-401d-4dcd-967c-d200a730ce45 service neutron] Attempting to bind port 81fcff43-a433-4ab6-8549-e6a7daf568ec by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:52:08.030274 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-d4683622-401d-4dcd-967c-d200a730ce45 service neutron] Attempting to bind port 81fcff43-a433-4ab6-8549-e6a7daf568ec on network eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:52:08.036979 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-d4683622-401d-4dcd-967c-d200a730ce45 service neutron] Port 81fcff43-a433-4ab6-8549-e6a7daf568ec on network eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:52:08.037312 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-d4683622-401d-4dcd-967c-d200a730ce45 service neutron] Attempting to bind port 81fcff43-a433-4ab6-8549-e6a7daf568ec on network eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:52:08.043867 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-d4683622-401d-4dcd-967c-d200a730ce45 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 51, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:52:08.044231 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-d4683622-401d-4dcd-967c-d200a730ce45 service neutron] Checking segment: {'id': 'fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:52:08.044566 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-d4683622-401d-4dcd-967c-d200a730ce45 service neutron] Bound using segment: {'id': 'fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:52:08.045035 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-d4683622-401d-4dcd-967c-d200a730ce45 service neutron] Bound port: 81fcff43-a433-4ab6-8549-e6a7daf568ec, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:52:08.045682 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-d4683622-401d-4dcd-967c-d200a730ce45 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:08.050739 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1ee8d1b8-4409-4f0d-8c82-a41b6a8b0d36 req-a6fac162-3ab3-41f8-94ab-a9df9026054f tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/security-groups?id=ce5c7bc1-de04-4060-901f-bf2612c44351&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0577703 Dec 09 21:52:08.152630 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-d4683622-401d-4dcd-967c-d200a730ce45 service neutron] For port 81fcff43-a433-4ab6-8549-e6a7daf568ec, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:52:08.156415 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-d4683622-401d-4dcd-967c-d200a730ce45 service neutron] For port 81fcff43-a433-4ab6-8549-e6a7daf568ec, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=81fcff43-a433-4ab6-8549-e6a7daf568ec,segment=NetworkSegment(fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8),segment_id=fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:52:08.162331 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-d4683622-401d-4dcd-967c-d200a730ce45 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:08.211328 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-d4683622-401d-4dcd-967c-d200a730ce45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:08.212286 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-d4683622-401d-4dcd-967c-d200a730ce45 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:08.215520 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-d4683622-401d-4dcd-967c-d200a730ce45 service neutron] 10.222.0.31 "PUT /v2.0/ports/81fcff43-a433-4ab6-8549-e6a7daf568ec HTTP/1.1" status: 200 len: 1093 time: 0.7611089 Dec 09 21:52:08.215520 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a7cd5203-8be8-4571-9b6a-ccb745d3f244', 'tag': '81fcff43-a433-4ab6-8549-e6a7daf568ec'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:52:08.217151 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-974b0b9b-60a7-42fc-9559-2320a2d409ac" -d '{"events": [{"name": "network-changed", "server_uuid": "a7cd5203-8be8-4571-9b6a-ccb745d3f244", "tag": "81fcff43-a433-4ab6-8549-e6a7daf568ec"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:52:08.305752 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:52:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2159d043-f4b5-4e4e-a087-d72ce55a1de2 x-openstack-request-id: req-2159d043-f4b5-4e4e-a087-d72ce55a1de2 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:52:08.306171 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a7cd5203-8be8-4571-9b6a-ccb745d3f244", "tag": "81fcff43-a433-4ab6-8549-e6a7daf568ec", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:52:08.306489 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-2159d043-f4b5-4e4e-a087-d72ce55a1de2 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:52:08.306958 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a7cd5203-8be8-4571-9b6a-ccb745d3f244', 'tag': '81fcff43-a433-4ab6-8549-e6a7daf568ec', 'status': 'completed', 'code': 200} Dec 09 21:52:08.309563 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4683622-401d-4dcd-967c-d200a730ce45 service neutron] Pushing event updated for resources: {'Port': ['ID=81fcff43-a433-4ab6-8549-e6a7daf568ec,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:08.327867 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-bf31eab5-cb8c-40ca-8522-62c3dbedbf98 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:08.329694 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-bf31eab5-cb8c-40ca-8522-62c3dbedbf98 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2671ed6f9fdf4c9cb0e0438099319f7d&device_id=a7cd5203-8be8-4571-9b6a-ccb745d3f244 HTTP/1.1" status: 200 len: 1096 time: 0.0641801 Dec 09 21:52:08.383143 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-291e7942-7e73-4348-943e-55b9c0c36e4d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=81fcff43-a433-4ab6-8549-e6a7daf568ec HTTP/1.1" status: 200 len: 217 time: 0.0435879 Dec 09 21:52:08.435737 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-0ae967f7-da78-4494-94f2-19f4c1f8ecaf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:08.437259 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-0ae967f7-da78-4494-94f2-19f4c1f8ecaf service neutron] 10.222.0.31 "GET /v2.0/subnets?id=938dec21-7b2e-4de4-a129-71c1f3ba1dd6 HTTP/1.1" status: 200 len: 854 time: 0.0465593 Dec 09 21:52:08.472311 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-9df453ac-58f6-48f7-9993-d34d7e33317a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0277042 Dec 09 21:52:08.576884 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-c000b46d-f70a-4bae-8a93-27f56212f33d service neutron] 10.222.0.31 "GET /v2.0/networks/eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0974348 Dec 09 21:52:08.673051 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f6283cd3-c776-4452-8003-1ed3a10109a3 req-33dc3d8a-b2ca-452c-9168-77f00c1bc3fb service neutron] 10.222.0.31 "GET /v2.0/networks/eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0885725 Dec 09 21:52:08.775229 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-974b0b9b-60a7-42fc-9559-2320a2d409ac req-1deed597-472c-4548-8624-87217f33a742 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:08.776828 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-974b0b9b-60a7-42fc-9559-2320a2d409ac req-1deed597-472c-4548-8624-87217f33a742 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2671ed6f9fdf4c9cb0e0438099319f7d&device_id=a7cd5203-8be8-4571-9b6a-ccb745d3f244 HTTP/1.1" status: 200 len: 1096 time: 0.0501459 Dec 09 21:52:08.887937 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-974b0b9b-60a7-42fc-9559-2320a2d409ac req-b243aa7b-7605-425f-a71d-729bc3198924 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:08.889563 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-974b0b9b-60a7-42fc-9559-2320a2d409ac req-b243aa7b-7605-425f-a71d-729bc3198924 service neutron] 10.222.0.31 "GET /v2.0/networks?id=eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a HTTP/1.1" status: 200 len: 915 time: 0.1045985 Dec 09 21:52:08.937029 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-974b0b9b-60a7-42fc-9559-2320a2d409ac req-ea7a8861-c348-437c-b277-0ef3dc178155 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=81fcff43-a433-4ab6-8549-e6a7daf568ec HTTP/1.1" status: 200 len: 217 time: 0.0403764 Dec 09 21:52:08.999867 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-974b0b9b-60a7-42fc-9559-2320a2d409ac req-c394042a-9a5d-4c13-99cf-2001dde0ae34 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:09.001719 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-974b0b9b-60a7-42fc-9559-2320a2d409ac req-c394042a-9a5d-4c13-99cf-2001dde0ae34 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=938dec21-7b2e-4de4-a129-71c1f3ba1dd6 HTTP/1.1" status: 200 len: 854 time: 0.0563486 Dec 09 21:52:09.034901 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-974b0b9b-60a7-42fc-9559-2320a2d409ac req-6d2db7f8-7719-48ff-acf9-0922cf3d50df service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0261836 Dec 09 21:52:09.142450 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-974b0b9b-60a7-42fc-9559-2320a2d409ac req-b897e27b-25fd-48ab-ae1a-d5fdf5374383 service neutron] 10.222.0.31 "GET /v2.0/networks/eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0984268 Dec 09 21:52:09.230244 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27f84c60-64b9-4e2f-84ac-e773b0c7f5cf req-e578a17c-9896-45c6-ac2d-7dce81d18041 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:09.238607 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27f84c60-64b9-4e2f-84ac-e773b0c7f5cf req-e578a17c-9896-45c6-ac2d-7dce81d18041 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/ports?device_id=a7cd5203-8be8-4571-9b6a-ccb745d3f244 HTTP/1.1" status: 200 len: 944 time: 0.0764098 Dec 09 21:52:09.272771 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-974b0b9b-60a7-42fc-9559-2320a2d409ac req-917740fa-fd62-4537-9c2a-583a88242b0d service neutron] 10.222.0.31 "GET /v2.0/networks/eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1223521 Dec 09 21:52:09.312334 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27f84c60-64b9-4e2f-84ac-e773b0c7f5cf req-374fbf39-90e9-4a60-a618-84783e386cb3 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/security-groups?id=ce5c7bc1-de04-4060-901f-bf2612c44351&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0726793 Dec 09 21:52:09.658085 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:09.774879 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 81fcff43-a433-4ab6-8549-e6a7daf568ec details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:52:09.880568 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 81fcff43-a433-4ab6-8549-e6a7daf568ec, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=81fcff43-a433-4ab6-8549-e6a7daf568ec,segment=NetworkSegment(fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8),segment_id=fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:09.898644 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '81fcff43-a433-4ab6-8549-e6a7daf568ec', 'network_id': 'eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a', 'port_id': '81fcff43-a433-4ab6-8549-e6a7daf568ec', 'mac_address': 'fa:16:3e:d8:32:b1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '938dec21-7b2e-4de4-a129-71c1f3ba1dd6', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:52:09.942626 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:09.956117 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 81fcff43-a433-4ab6-8549-e6a7daf568ec {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:52:09.975771 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 81fcff43-a433-4ab6-8549-e6a7daf568ec, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=81fcff43-a433-4ab6-8549-e6a7daf568ec,segment=NetworkSegment(fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8),segment_id=fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:09.980409 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:10.032916 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=81fcff43-a433-4ab6-8549-e6a7daf568ec,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:10.220615 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['81fcff43-a433-4ab6-8549-e6a7daf568ec'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:52:10.450026 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74472185-8fa9-40da-87e6-d20dd8af0f93 req-39f27ba0-0b48-477d-b215-59916e07a61a tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:10.451796 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-74472185-8fa9-40da-87e6-d20dd8af0f93 req-39f27ba0-0b48-477d-b215-59916e07a61a tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/ports?device_id=a7cd5203-8be8-4571-9b6a-ccb745d3f244 HTTP/1.1" status: 200 len: 945 time: 0.0605688 Dec 09 21:52:10.512671 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-74472185-8fa9-40da-87e6-d20dd8af0f93 req-e0537290-eb5c-43b7-a206-a2ac29af5b5d tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/security-groups?id=ce5c7bc1-de04-4060-901f-bf2612c44351&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473213 Dec 09 21:52:11.657326 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd43e066-fda2-4f27-af5d-785ecac58374 req-11106236-56e1-4ef3-acc2-7d56df1cb35e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:11.659368 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fd43e066-fda2-4f27-af5d-785ecac58374 req-11106236-56e1-4ef3-acc2-7d56df1cb35e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/ports?device_id=a7cd5203-8be8-4571-9b6a-ccb745d3f244 HTTP/1.1" status: 200 len: 945 time: 0.0631745 Dec 09 21:52:11.708743 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fd43e066-fda2-4f27-af5d-785ecac58374 req-e308e3b2-9766-4139-ae64-44fb6db1b93e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/security-groups?id=ce5c7bc1-de04-4060-901f-bf2612c44351&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426867 Dec 09 21:52:11.790860 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 81fcff43-a433-4ab6-8549-e6a7daf568ec up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:52:11.854741 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 81fcff43-a433-4ab6-8549-e6a7daf568ec completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:52:11.859737 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 81fcff43-a433-4ab6-8549-e6a7daf568ec triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:11.860254 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:11.955550 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:11.989570 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 81fcff43-a433-4ab6-8549-e6a7daf568ec, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=81fcff43-a433-4ab6-8549-e6a7daf568ec,segment=NetworkSegment(fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8),segment_id=fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:11.990791 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a7cd5203-8be8-4571-9b6a-ccb745d3f244', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '81fcff43-a433-4ab6-8549-e6a7daf568ec'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:52:11.993637 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b919f63c-d1ad-4036-aa64-e4c2b7bb66c5" -d '{"events": [{"server_uuid": "a7cd5203-8be8-4571-9b6a-ccb745d3f244", "name": "network-vif-plugged", "status": "completed", "tag": "81fcff43-a433-4ab6-8549-e6a7daf568ec"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:52:11.997943 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:12.033137 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:52:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3cdd3f67-f5f6-4267-9d3b-26fb3b7a21c7 x-openstack-request-id: req-3cdd3f67-f5f6-4267-9d3b-26fb3b7a21c7 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:52:12.033430 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a7cd5203-8be8-4571-9b6a-ccb745d3f244", "name": "network-vif-plugged", "status": "completed", "tag": "81fcff43-a433-4ab6-8549-e6a7daf568ec", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:52:12.033680 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-3cdd3f67-f5f6-4267-9d3b-26fb3b7a21c7 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:52:12.034202 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a7cd5203-8be8-4571-9b6a-ccb745d3f244', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '81fcff43-a433-4ab6-8549-e6a7daf568ec', 'code': 200} Dec 09 21:52:12.061474 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=81fcff43-a433-4ab6-8549-e6a7daf568ec,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:12.150871 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8be42dce-0e06-4939-9fc5-cbba4dac58fa req-c93f8659-1a9b-4e88-bd29-2eb9d36524e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:12.152514 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8be42dce-0e06-4939-9fc5-cbba4dac58fa req-c93f8659-1a9b-4e88-bd29-2eb9d36524e9 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=a7cd5203-8be8-4571-9b6a-ccb745d3f244 HTTP/1.1" status: 200 len: 1098 time: 0.0455897 Dec 09 21:52:12.198310 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8be42dce-0e06-4939-9fc5-cbba4dac58fa req-92a9405e-f91f-40f0-a367-fb70c97fee9a service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=ce5c7bc1-de04-4060-901f-bf2612c44351&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0379767 Dec 09 21:52:12.866670 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aefae532-5cfd-4599-bd60-c38274346c5b req-3e0416f9-b99a-47c1-b040-04bbe8928b5e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:12.871948 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aefae532-5cfd-4599-bd60-c38274346c5b req-3e0416f9-b99a-47c1-b040-04bbe8928b5e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/ports?device_id=a7cd5203-8be8-4571-9b6a-ccb745d3f244 HTTP/1.1" status: 200 len: 946 time: 0.0751975 Dec 09 21:52:12.933703 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aefae532-5cfd-4599-bd60-c38274346c5b req-cbce4195-a84e-4f34-b284-9600424b679a tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/security-groups?id=ce5c7bc1-de04-4060-901f-bf2612c44351&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0579784 Dec 09 21:52:13.025823 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53274) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:13.196339 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ad9e9c52-4297-4ea2-b975-dcc54c2e1a65 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:13.298343 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ad9e9c52-4297-4ea2-b975-dcc54c2e1a65 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:13.304853 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ad9e9c52-4297-4ea2-b975-dcc54c2e1a65 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:13.376571 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad9e9c52-4297-4ea2-b975-dcc54c2e1a65 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4edfcf5c-7f06-4f2d-844a-1b2c0ebaa1e7,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:13.382025 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ad9e9c52-4297-4ea2-b975-dcc54c2e1a65 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=d43632a3f16c47d49fe6b337f7b3c206&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3551309 Dec 09 21:52:13.385313 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53284) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:13.456692 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-351ad8e5-b957-4f7d-886d-37c40832d160 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:13.484513 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-351ad8e5-b957-4f7d-886d-37c40832d160 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:13.538829 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-351ad8e5-b957-4f7d-886d-37c40832d160 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:13.542297 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-351ad8e5-b957-4f7d-886d-37c40832d160 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:13.543788 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-351ad8e5-b957-4f7d-886d-37c40832d160 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/4edfcf5c-7f06-4f2d-844a-1b2c0ebaa1e7 HTTP/1.1" status: 204 len: 168 time: 0.1577344 Dec 09 21:52:13.577166 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-351ad8e5-b957-4f7d-886d-37c40832d160 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4edfcf5c-7f06-4f2d-844a-1b2c0ebaa1e7,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:13.603397 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-351ad8e5-b957-4f7d-886d-37c40832d160 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:13.604199 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-351ad8e5-b957-4f7d-886d-37c40832d160 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:13.606099 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-351ad8e5-b957-4f7d-886d-37c40832d160 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:13.606689 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-351ad8e5-b957-4f7d-886d-37c40832d160 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:13.607425 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-351ad8e5-b957-4f7d-886d-37c40832d160 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:13.608023 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-351ad8e5-b957-4f7d-886d-37c40832d160 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:13.608597 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-351ad8e5-b957-4f7d-886d-37c40832d160 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:13.610750 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-351ad8e5-b957-4f7d-886d-37c40832d160 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:13.611810 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-351ad8e5-b957-4f7d-886d-37c40832d160 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:13.612418 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-351ad8e5-b957-4f7d-886d-37c40832d160 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:13.613226 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-351ad8e5-b957-4f7d-886d-37c40832d160 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:13.613814 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-351ad8e5-b957-4f7d-886d-37c40832d160 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:13.614534 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-351ad8e5-b957-4f7d-886d-37c40832d160 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:14.104767 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaaf0c44-642f-42eb-b41d-938f049c1920 req-3d04a7ed-7c37-45ce-a6c0-c8d68ab531d1 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:14.106464 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aaaf0c44-642f-42eb-b41d-938f049c1920 req-3d04a7ed-7c37-45ce-a6c0-c8d68ab531d1 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/ports?device_id=a7cd5203-8be8-4571-9b6a-ccb745d3f244 HTTP/1.1" status: 200 len: 946 time: 0.0938342 Dec 09 21:52:14.185531 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aaaf0c44-642f-42eb-b41d-938f049c1920 req-c76b6c24-cb61-4918-a2aa-ddd23422484c tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/security-groups?id=ce5c7bc1-de04-4060-901f-bf2612c44351&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0672567 Dec 09 21:52:17.735348 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-7e4f065e-e06a-4d52-8d46-2d73d8834f6e req-b4209fd8-7cce-4646-a934-f09767ba67c3 tempest-ServerActionsTestJSON-1796592425 tempest-ServerActionsTestJSON-1796592425-project] (103438) timed out ('10.222.0.13', 53676) {{(pid=103438) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 09 21:52:17.833034 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53426) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:17.993960 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e1b4e8ea-de2b-4230-b2e6-6e0bc522b697 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=289b15efb1cc4b5fbaefca8970d43a70&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1595449 Dec 09 21:52:17.996460 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53432) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:18.046848 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5dc355e-0c09-4488-8d72-5ae40223071e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:18.069632 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5dc355e-0c09-4488-8d72-5ae40223071e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:18.124720 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5dc355e-0c09-4488-8d72-5ae40223071e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:18.128259 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5dc355e-0c09-4488-8d72-5ae40223071e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:18.129458 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d5dc355e-0c09-4488-8d72-5ae40223071e admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/70b6e8f6-3793-4fd9-91c8-b7d3cb7e3581 HTTP/1.1" status: 204 len: 168 time: 0.1320693 Dec 09 21:52:18.137872 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5dc355e-0c09-4488-8d72-5ae40223071e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=70b6e8f6-3793-4fd9-91c8-b7d3cb7e3581,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:23.119809 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:52:24.158243 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53524) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:24.385992 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ad6e8804-ae6e-41f7-b90e-35fb51e79abb admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:24.483160 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ad6e8804-ae6e-41f7-b90e-35fb51e79abb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:24.487467 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ad6e8804-ae6e-41f7-b90e-35fb51e79abb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:24.525756 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad6e8804-ae6e-41f7-b90e-35fb51e79abb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=60d02e16-27e3-4424-bedc-674530f172ff,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:24.530254 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ad6e8804-ae6e-41f7-b90e-35fb51e79abb admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=46b880c5c097471d922bb2598688506a&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3703141 Dec 09 21:52:24.534704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53530) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:24.588927 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16d34aa5-4758-4503-8234-4aa13625efbd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:24.611118 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16d34aa5-4758-4503-8234-4aa13625efbd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:24.658608 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16d34aa5-4758-4503-8234-4aa13625efbd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:24.661273 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-16d34aa5-4758-4503-8234-4aa13625efbd admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:24.664965 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-16d34aa5-4758-4503-8234-4aa13625efbd admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/60d02e16-27e3-4424-bedc-674530f172ff HTTP/1.1" status: 204 len: 168 time: 0.1265640 Dec 09 21:52:24.671688 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16d34aa5-4758-4503-8234-4aa13625efbd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=60d02e16-27e3-4424-bedc-674530f172ff,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:25.392334 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53560) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:25.516624 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2c7a15bd-281d-4ff1-b403-181a254433ec admin admin] Request body: {'network': {'name': 'tempest-ImageQuotaTest-227939004-network', 'tenant_id': '4246c907211d47f3a86430f8469bba20'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:52:25.548369 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2c7a15bd-281d-4ff1-b403-181a254433ec admin admin] Made reservation on behalf of 4246c907211d47f3a86430f8469bba20 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:52:25.551616 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2c7a15bd-281d-4ff1-b403-181a254433ec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:25.563240 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2c7a15bd-281d-4ff1-b403-181a254433ec admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:25.656326 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2c7a15bd-281d-4ff1-b403-181a254433ec admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:25.661046 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2c7a15bd-281d-4ff1-b403-181a254433ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:25.692267 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2c7a15bd-281d-4ff1-b403-181a254433ec admin admin] vlan segment allocate from pool success with {'vlan_id': 101, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:52:25.699143 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c7a15bd-281d-4ff1-b403-181a254433ec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9d251dce-9ac5-491a-9e88-3e50531d49b7,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:25.717088 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2c7a15bd-281d-4ff1-b403-181a254433ec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:25.717351 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-2c7a15bd-281d-4ff1-b403-181a254433ec admin admin] Added segment ad01124d-d7a6-4de3-b89b-fb85b4381531 of type vlan for network 0604719a-3ef3-479d-89b6-fd8462631749 Dec 09 21:52:25.762949 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2c7a15bd-281d-4ff1-b403-181a254433ec admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:25.796273 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2c7a15bd-281d-4ff1-b403-181a254433ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:25.799983 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2c7a15bd-281d-4ff1-b403-181a254433ec admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:25.800664 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2c7a15bd-281d-4ff1-b403-181a254433ec admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:25.896960 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2c7a15bd-281d-4ff1-b403-181a254433ec admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 877 time: 0.5031970 Dec 09 21:52:25.901259 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53564) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:25.906227 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-f4577f15-cddf-4de9-88ae-aaea812d5b08 admin admin] Request body: {'subnet': {'network_id': '0604719a-3ef3-479d-89b6-fd8462631749', 'cidr': '172.20.0.0/28', 'name': 'tempest-ImageQuotaTest-227939004-subnet', 'tenant_id': '4246c907211d47f3a86430f8469bba20', 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:52:25.912780 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c7a15bd-281d-4ff1-b403-181a254433ec admin admin] Pushing event updated for resources: {'Network': ['ID=0604719a-3ef3-479d-89b6-fd8462631749,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:25.930380 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 0604719a-3ef3-479d-89b6-fd8462631749 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:52:25.940595 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f4577f15-cddf-4de9-88ae-aaea812d5b08 admin admin] Made reservation on behalf of 4246c907211d47f3a86430f8469bba20 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:52:25.943929 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f4577f15-cddf-4de9-88ae-aaea812d5b08 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:26.155490 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f4577f15-cddf-4de9-88ae-aaea812d5b08 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:26.219992 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4577f15-cddf-4de9-88ae-aaea812d5b08 admin admin] Pushing event updated for resources: {'Subnet': ['ID=bfb53115-a1a8-41f6-8cf7-50ca07471498,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:26.228441 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4577f15-cddf-4de9-88ae-aaea812d5b08 admin admin] Checking segment: {'id': 'ad01124d-d7a6-4de3-b89b-fb85b4381531', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '0604719a-3ef3-479d-89b6-fd8462631749'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:52:26.228863 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f4577f15-cddf-4de9-88ae-aaea812d5b08 admin admin] Network hostable DHCP agents. Network: 0604719a-3ef3-479d-89b6-fd8462631749, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:52:26.249770 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f4577f15-cddf-4de9-88ae-aaea812d5b08 admin admin] Network 0604719a-3ef3-479d-89b6-fd8462631749 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:52:26.262963 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-f4577f15-cddf-4de9-88ae-aaea812d5b08 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 0604719a-3ef3-479d-89b6-fd8462631749) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:52:26.268126 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f4577f15-cddf-4de9-88ae-aaea812d5b08 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:26.268819 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f4577f15-cddf-4de9-88ae-aaea812d5b08 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:26.273860 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce597c5c-498e-4042-85a0-34b5ee17f1e1 None None] Network 0604719a-3ef3-479d-89b6-fd8462631749 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:52:26.294473 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f4577f15-cddf-4de9-88ae-aaea812d5b08 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 840 time: 0.3895719 Dec 09 21:52:26.295086 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53570) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:26.299847 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-225c9928-5e68-4fa1-892a-2dd145aea961 admin admin] Request body: {'router': {'name': 'tempest-ImageQuotaTest-227939004-router', 'tenant_id': '4246c907211d47f3a86430f8469bba20', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:52:26.340051 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-225c9928-5e68-4fa1-892a-2dd145aea961 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:26.341352 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-225c9928-5e68-4fa1-892a-2dd145aea961 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:26.513241 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-225c9928-5e68-4fa1-892a-2dd145aea961 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:26.661424 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a24b9862-9a03-4c76-afc9-1d0b4c1a4d6a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-0604719a-3ef3-479d-89b6-fd8462631749', 'network_id': '0604719a-3ef3-479d-89b6-fd8462631749', 'project_id': '4246c907211d47f3a86430f8469bba20', 'fixed_ips': [{'subnet_id': 'bfb53115-a1a8-41f6-8cf7-50ca07471498'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:52:26.661424 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a24b9862-9a03-4c76-afc9-1d0b4c1a4d6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:26.713323 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-225c9928-5e68-4fa1-892a-2dd145aea961 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:26.841165 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-a24b9862-9a03-4c76-afc9-1d0b4c1a4d6a None None] Allocated IP 172.20.0.2 (0604719a-3ef3-479d-89b6-fd8462631749/bfb53115-a1a8-41f6-8cf7-50ca07471498/edb92ce6-bbea-4720-a8a8-5c0725433d33) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:52:26.936103 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-225c9928-5e68-4fa1-892a-2dd145aea961 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:26.956085 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-225c9928-5e68-4fa1-892a-2dd145aea961 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:26.997046 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a24b9862-9a03-4c76-afc9-1d0b4c1a4d6a None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:27.005213 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a24b9862-9a03-4c76-afc9-1d0b4c1a4d6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:27.042387 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a24b9862-9a03-4c76-afc9-1d0b4c1a4d6a None None] Network 0604719a-3ef3-479d-89b6-fd8462631749 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:52:27.045394 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-a24b9862-9a03-4c76-afc9-1d0b4c1a4d6a None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:52:27.049026 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a24b9862-9a03-4c76-afc9-1d0b4c1a4d6a None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:52:27.062497 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a24b9862-9a03-4c76-afc9-1d0b4c1a4d6a None None] Pushing event updated for resources: {'Port': ['ID=edb92ce6-bbea-4720-a8a8-5c0725433d33,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:27.081053 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-225c9928-5e68-4fa1-892a-2dd145aea961 admin admin] Allocated IP 172.25.3.29 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/2d31f6ec-796d-4952-89ae-ac5fd4beb2d4) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:52:27.121421 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a24b9862-9a03-4c76-afc9-1d0b4c1a4d6a None None] Attempting to bind port edb92ce6-bbea-4720-a8a8-5c0725433d33 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:52:27.121789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a24b9862-9a03-4c76-afc9-1d0b4c1a4d6a None None] Attempting to bind port edb92ce6-bbea-4720-a8a8-5c0725433d33 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'ad01124d-d7a6-4de3-b89b-fb85b4381531', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '0604719a-3ef3-479d-89b6-fd8462631749'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:52:27.122151 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a24b9862-9a03-4c76-afc9-1d0b4c1a4d6a None None] Attempting to bind port edb92ce6-bbea-4720-a8a8-5c0725433d33 on network 0604719a-3ef3-479d-89b6-fd8462631749 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:52:27.127527 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a24b9862-9a03-4c76-afc9-1d0b4c1a4d6a None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 52, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:52:27.127926 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a24b9862-9a03-4c76-afc9-1d0b4c1a4d6a None None] Checking segment: {'id': 'ad01124d-d7a6-4de3-b89b-fb85b4381531', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '0604719a-3ef3-479d-89b6-fd8462631749'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:52:27.128520 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a24b9862-9a03-4c76-afc9-1d0b4c1a4d6a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:27.129068 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a24b9862-9a03-4c76-afc9-1d0b4c1a4d6a None None] Bound using segment: {'id': 'ad01124d-d7a6-4de3-b89b-fb85b4381531', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '0604719a-3ef3-479d-89b6-fd8462631749'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:52:27.130071 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a24b9862-9a03-4c76-afc9-1d0b4c1a4d6a None None] Bound port: edb92ce6-bbea-4720-a8a8-5c0725433d33, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ad01124d-d7a6-4de3-b89b-fb85b4381531', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '0604719a-3ef3-479d-89b6-fd8462631749'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:52:27.130434 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a24b9862-9a03-4c76-afc9-1d0b4c1a4d6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:27.204506 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a24b9862-9a03-4c76-afc9-1d0b4c1a4d6a None None] For port edb92ce6-bbea-4720-a8a8-5c0725433d33, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:52:27.208544 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a24b9862-9a03-4c76-afc9-1d0b4c1a4d6a None None] For port edb92ce6-bbea-4720-a8a8-5c0725433d33, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=edb92ce6-bbea-4720-a8a8-5c0725433d33,segment=NetworkSegment(ad01124d-d7a6-4de3-b89b-fb85b4381531),segment_id=ad01124d-d7a6-4de3-b89b-fb85b4381531)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:52:27.214093 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-225c9928-5e68-4fa1-892a-2dd145aea961 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:27.214991 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a24b9862-9a03-4c76-afc9-1d0b4c1a4d6a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:27.267115 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-225c9928-5e68-4fa1-892a-2dd145aea961 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:27.301903 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a24b9862-9a03-4c76-afc9-1d0b4c1a4d6a None None] Pushing event updated for resources: {'Port': ['ID=edb92ce6-bbea-4720-a8a8-5c0725433d33,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:27.324547 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-225c9928-5e68-4fa1-892a-2dd145aea961 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:52:27.330902 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-225c9928-5e68-4fa1-892a-2dd145aea961 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:52:27.337263 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-225c9928-5e68-4fa1-892a-2dd145aea961 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:52:27.349882 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:27.354808 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0da7c43b-3473-4f49-8730-bf01c7b7e2a9 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:52:27.419751 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-225c9928-5e68-4fa1-892a-2dd145aea961 admin admin] Pushing event updated for resources: {'Port': ['ID=2d31f6ec-796d-4952-89ae-ac5fd4beb2d4,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:27.478024 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e829b097-6d8b-401d-96dc-a4911c5fb65b None None] Provisioning complete for port 2d31f6ec-796d-4952-89ae-ac5fd4beb2d4 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:27.485357 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e829b097-6d8b-401d-96dc-a4911c5fb65b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:27.546010 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e829b097-6d8b-401d-96dc-a4911c5fb65b None None] Port 2d31f6ec-796d-4952-89ae-ac5fd4beb2d4 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:52:27.589010 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:27.742683 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-225c9928-5e68-4fa1-892a-2dd145aea961 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:28.022659 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-225c9928-5e68-4fa1-892a-2dd145aea961 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:28.177355 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-225c9928-5e68-4fa1-892a-2dd145aea961 admin admin] Router 17cb8c89-2c13-481f-8d15-0095bbe6bb36 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:52:28.302310 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-225c9928-5e68-4fa1-892a-2dd145aea961 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:52:28.316280 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] Sync routers for ids ['17cb8c89-2c13-481f-8d15-0095bbe6bb36'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:52:28.323112 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-225c9928-5e68-4fa1-892a-2dd145aea961 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:28.327563 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53632) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:28.334563 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] Routers {'17cb8c89-2c13-481f-8d15-0095bbe6bb36'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:52:28.335049 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-225c9928-5e68-4fa1-892a-2dd145aea961 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 915 time: 2.0387702 Dec 09 21:52:28.340127 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['17cb8c89-2c13-481f-8d15-0095bbe6bb36'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:28.479509 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] Set router 17cb8c89-2c13-481f-8d15-0095bbe6bb36 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:52:28.685118 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '17cb8c89-2c13-481f-8d15-0095bbe6bb36', 'name': 'tempest-ImageQuotaTest-227939004-router', 'tenant_id': '4246c907211d47f3a86430f8469bba20', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.29'}], 'enable_snat': True}, 'gw_port_id': '2d31f6ec-796d-4952-89ae-ac5fd4beb2d4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:26Z', 'updated_at': '2021-12-09T21:52:27Z', 'revision_number': 3, 'project_id': '4246c907211d47f3a86430f8469bba20', 'gw_port': {'id': '2d31f6ec-796d-4952-89ae-ac5fd4beb2d4', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:c5:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '17cb8c89-2c13-481f-8d15-0095bbe6bb36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3809, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:26Z', 'updated_at': '2021-12-09T21:52:27Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:28.712965 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] Checking router: 17cb8c89-2c13-481f-8d15-0095bbe6bb36 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:52:28.713315 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] Updating router 17cb8c89-2c13-481f-8d15-0095bbe6bb36 port 2d31f6ec-796d-4952-89ae-ac5fd4beb2d4 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:52:28.746281 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:28.882815 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e68b208c-fabe-4356-af63-1b51c0d327d0 None None] Network 0604719a-3ef3-479d-89b6-fd8462631749 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:52:28.915838 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:29.023043 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e0176d6c-7247-44a9-959a-83b4db113609 None None] Provisioning complete for port edb92ce6-bbea-4720-a8a8-5c0725433d33 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:29.023689 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e0176d6c-7247-44a9-959a-83b4db113609 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:29.152338 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device edb92ce6-bbea-4720-a8a8-5c0725433d33 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:52:29.267897 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e0176d6c-7247-44a9-959a-83b4db113609 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:29.281494 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:29.282552 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Allocated IP 172.20.0.1 (0604719a-3ef3-479d-89b6-fd8462631749/bfb53115-a1a8-41f6-8cf7-50ca07471498/e97c41d9-9003-45eb-9767-1e3f4972136f) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:52:29.285134 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port edb92ce6-bbea-4720-a8a8-5c0725433d33 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:29.285576 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:29.292494 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:29.355764 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e0176d6c-7247-44a9-959a-83b4db113609 None None] For port edb92ce6-bbea-4720-a8a8-5c0725433d33, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=edb92ce6-bbea-4720-a8a8-5c0725433d33,segment=NetworkSegment(ad01124d-d7a6-4de3-b89b-fb85b4381531),segment_id=ad01124d-d7a6-4de3-b89b-fb85b4381531)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:29.396835 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72309b8b-22fc-4dff-927f-e44b43d7b3c0 None None] Pushing event updated for resources: {'Port': ['ID=2d31f6ec-796d-4952-89ae-ac5fd4beb2d4,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:29.413634 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e0176d6c-7247-44a9-959a-83b4db113609 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:29.426329 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b8dabe9-f3b8-46b9-8633-8afa142e38f9 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:52:29.431961 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] Attempting to bind port 2d31f6ec-796d-4952-89ae-ac5fd4beb2d4 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:52:29.433790 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] Attempting to bind port 2d31f6ec-796d-4952-89ae-ac5fd4beb2d4 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:52:29.433937 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] Attempting to bind port 2d31f6ec-796d-4952-89ae-ac5fd4beb2d4 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:52:29.461647 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 52, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:52:29.463878 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:52:29.464367 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:29.466041 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:52:29.466754 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] Bound port: 2d31f6ec-796d-4952-89ae-ac5fd4beb2d4, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:52:29.468926 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:29.482690 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:29.504031 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:29.563796 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] For port 2d31f6ec-796d-4952-89ae-ac5fd4beb2d4, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:52:29.567791 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] For port 2d31f6ec-796d-4952-89ae-ac5fd4beb2d4, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2d31f6ec-796d-4952-89ae-ac5fd4beb2d4,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:52:29.577725 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:29.585537 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:29.607669 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0176d6c-7247-44a9-959a-83b4db113609 None None] Pushing event updated for resources: {'Port': ['ID=edb92ce6-bbea-4720-a8a8-5c0725433d33,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:29.621598 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ba9f9d71-54ec-472c-a7e5-bb50814d2db6 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:52:29.626993 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:52:29.627350 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:52:29.628615 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-320abc46-45e1-4442-95b7-84e217a9bdfd None None] Provisioning complete for port 2d31f6ec-796d-4952-89ae-ac5fd4beb2d4 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:29.628988 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-320abc46-45e1-4442-95b7-84e217a9bdfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:29.667240 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] Routers {'17cb8c89-2c13-481f-8d15-0095bbe6bb36'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:52:29.668358 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['17cb8c89-2c13-481f-8d15-0095bbe6bb36'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:29.674139 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Network 0604719a-3ef3-479d-89b6-fd8462631749 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:52:29.677391 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:52:29.696476 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:52:29.743778 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Pushing event updated for resources: {'Port': ['ID=e97c41d9-9003-45eb-9767-1e3f4972136f,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:29.749289 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-320abc46-45e1-4442-95b7-84e217a9bdfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:29.766088 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72309b8b-22fc-4dff-927f-e44b43d7b3c0 None None] Pushing event updated for resources: {'Port': ['ID=2d31f6ec-796d-4952-89ae-ac5fd4beb2d4,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:29.779278 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:29.779850 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-320abc46-45e1-4442-95b7-84e217a9bdfd None None] For port 2d31f6ec-796d-4952-89ae-ac5fd4beb2d4, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2d31f6ec-796d-4952-89ae-ac5fd4beb2d4,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:29.780083 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:29.780425 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:29.780758 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:29.781086 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:29.781558 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:29.781805 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:29.793338 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:29.793848 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:29.794342 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:29.794551 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:29.794836 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:29.795165 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:29.797536 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-320abc46-45e1-4442-95b7-84e217a9bdfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:29.833416 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:29.869346 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] Set router 17cb8c89-2c13-481f-8d15-0095bbe6bb36 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:52:29.944320 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-320abc46-45e1-4442-95b7-84e217a9bdfd None None] Pushing event updated for resources: {'Port': ['ID=2d31f6ec-796d-4952-89ae-ac5fd4beb2d4,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:29.981580 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-65a3a0f9-ed1d-49bb-9ed0-02635cbfd97c None None] Provisioning complete for port edb92ce6-bbea-4720-a8a8-5c0725433d33 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:29.982010 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-65a3a0f9-ed1d-49bb-9ed0-02635cbfd97c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:30.132171 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-65a3a0f9-ed1d-49bb-9ed0-02635cbfd97c None None] Provisioning complete for port 2d31f6ec-796d-4952-89ae-ac5fd4beb2d4 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:30.132540 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-65a3a0f9-ed1d-49bb-9ed0-02635cbfd97c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:30.200197 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:30.229558 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '17cb8c89-2c13-481f-8d15-0095bbe6bb36', 'name': 'tempest-ImageQuotaTest-227939004-router', 'tenant_id': '4246c907211d47f3a86430f8469bba20', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.29'}], 'enable_snat': True}, 'gw_port_id': '2d31f6ec-796d-4952-89ae-ac5fd4beb2d4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:26Z', 'updated_at': '2021-12-09T21:52:27Z', 'revision_number': 3, 'project_id': '4246c907211d47f3a86430f8469bba20', 'gw_port': {'id': '2d31f6ec-796d-4952-89ae-ac5fd4beb2d4', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:c5:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '17cb8c89-2c13-481f-8d15-0095bbe6bb36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3809, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:26Z', 'updated_at': '2021-12-09T21:52:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:30.272367 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e7f92b6-ece2-4323-af1e-bcb72de01b71 None None] The sync data for ids ['17cb8c89-2c13-481f-8d15-0095bbe6bb36'] in n-d-713301-27 is: [{'id': '17cb8c89-2c13-481f-8d15-0095bbe6bb36', 'name': 'tempest-ImageQuotaTest-227939004-router', 'tenant_id': '4246c907211d47f3a86430f8469bba20', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.29'}], 'enable_snat': True}, 'gw_port_id': '2d31f6ec-796d-4952-89ae-ac5fd4beb2d4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:26Z', 'updated_at': '2021-12-09T21:52:27Z', 'revision_number': 3, 'project_id': '4246c907211d47f3a86430f8469bba20', 'gw_port': {'id': '2d31f6ec-796d-4952-89ae-ac5fd4beb2d4', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:c5:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '17cb8c89-2c13-481f-8d15-0095bbe6bb36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3809, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:26Z', 'updated_at': '2021-12-09T21:52:29Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:52:30.416734 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:30.420865 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4b613a24-6849-47bb-b6c9-8b7bb1e33d21 None None] Provisioning complete for port e97c41d9-9003-45eb-9767-1e3f4972136f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:30.421298 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4b613a24-6849-47bb-b6c9-8b7bb1e33d21 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:30.424038 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:30.472534 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-4b613a24-6849-47bb-b6c9-8b7bb1e33d21 None None] Port e97c41d9-9003-45eb-9767-1e3f4972136f cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:52:30.502775 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:30.505344 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Pushing event updated for resources: {'Port': ['ID=e97c41d9-9003-45eb-9767-1e3f4972136f,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:30.637046 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Network 0604719a-3ef3-479d-89b6-fd8462631749 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:52:30.638594 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:52:30.771288 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Router 17cb8c89-2c13-481f-8d15-0095bbe6bb36 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:52:30.916505 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9847844b-057b-479d-a644-b0665e021a43 None None] Provisioning complete for port e97c41d9-9003-45eb-9767-1e3f4972136f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:30.917197 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9847844b-057b-479d-a644-b0665e021a43 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:30.939751 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:52:30.967710 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f4bfcd8b-0536-4007-b2ea-5abf07316b78 admin admin] 10.222.0.13 "PUT /v2.0/routers/17cb8c89-2c13-481f-8d15-0095bbe6bb36/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6380603 Dec 09 21:52:31.019098 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9847844b-057b-479d-a644-b0665e021a43 None None] Port e97c41d9-9003-45eb-9767-1e3f4972136f cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:52:31.234893 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2d31f6ec-796d-4952-89ae-ac5fd4beb2d4 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:52:31.326567 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 2d31f6ec-796d-4952-89ae-ac5fd4beb2d4 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:31.327116 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:31.354054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-422d14bf-4b16-4a0c-92ef-0478ba246971 req-7d988469-8a41-4d5f-89ee-482034392cc4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:31.364807 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-422d14bf-4b16-4a0c-92ef-0478ba246971 req-7d988469-8a41-4d5f-89ee-482034392cc4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 945 time: 0.1043241 Dec 09 21:52:31.472068 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-422d14bf-4b16-4a0c-92ef-0478ba246971 req-4b9375ff-c068-4497-b73c-0e413959bbd3 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1047306 Dec 09 21:52:31.496607 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device edb92ce6-bbea-4720-a8a8-5c0725433d33 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:52:31.571541 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port edb92ce6-bbea-4720-a8a8-5c0725433d33 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:31.572005 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:32.484225 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53710) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:32.707694 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] Sync routers for ids ['17cb8c89-2c13-481f-8d15-0095bbe6bb36'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:52:32.724379 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] Routers {'17cb8c89-2c13-481f-8d15-0095bbe6bb36'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:52:32.725034 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['17cb8c89-2c13-481f-8d15-0095bbe6bb36'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:32.998559 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] Set router 17cb8c89-2c13-481f-8d15-0095bbe6bb36 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:52:33.102208 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0a988a99-5b2e-458c-ae40-8a581b6036ac admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:33.111274 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0d8e5b01-6c82-4b10-abf1-288a30694a62 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:33.167299 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d13ad10-7a2e-43f2-865c-7ab8689e8066 req-405c5d9c-16b0-400f-8ffe-c0506e90bb35 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:33.169464 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d13ad10-7a2e-43f2-865c-7ab8689e8066 req-405c5d9c-16b0-400f-8ffe-c0506e90bb35 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 945 time: 0.1086905 Dec 09 21:52:33.309234 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d13ad10-7a2e-43f2-865c-7ab8689e8066 req-d0564c01-3ca1-489f-a181-0a952494e82b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1108072 Dec 09 21:52:33.339009 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '17cb8c89-2c13-481f-8d15-0095bbe6bb36', 'name': 'tempest-ImageQuotaTest-227939004-router', 'tenant_id': '4246c907211d47f3a86430f8469bba20', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.29'}], 'enable_snat': True}, 'gw_port_id': '2d31f6ec-796d-4952-89ae-ac5fd4beb2d4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:26Z', 'updated_at': '2021-12-09T21:52:30Z', 'revision_number': 4, 'project_id': '4246c907211d47f3a86430f8469bba20', 'gw_port': {'id': '2d31f6ec-796d-4952-89ae-ac5fd4beb2d4', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:c5:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '17cb8c89-2c13-481f-8d15-0095bbe6bb36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3809, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:26Z', 'updated_at': '2021-12-09T21:52:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'e97c41d9-9003-45eb-9767-1e3f4972136f', 'name': '', 'network_id': '0604719a-3ef3-479d-89b6-fd8462631749', 'tenant_id': '4246c907211d47f3a86430f8469bba20', 'mac_address': 'fa:16:3e:4a:69:64', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '17cb8c89-2c13-481f-8d15-0095bbe6bb36', 'device_owner': 'network:router_interface', 'standard_attr_id': 3810, 'fixed_ips': [{'subnet_id': 'bfb53115-a1a8-41f6-8cf7-50ca07471498', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:28Z', 'updated_at': '2021-12-09T21:52:30Z', 'revision_number': 2, 'project_id': '4246c907211d47f3a86430f8469bba20', 'subnets': [{'id': 'bfb53115-a1a8-41f6-8cf7-50ca07471498', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:33.368626 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] Checking router: 17cb8c89-2c13-481f-8d15-0095bbe6bb36 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:52:33.369120 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] Updating router 17cb8c89-2c13-481f-8d15-0095bbe6bb36 port e97c41d9-9003-45eb-9767-1e3f4972136f binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:52:33.398632 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:33.709845 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:33.719480 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:33.769409 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85aadb10-ad0c-4782-9cc1-80f7a90d9e99 None None] Pushing event updated for resources: {'Port': ['ID=e97c41d9-9003-45eb-9767-1e3f4972136f,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:33.870409 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] Attempting to bind port e97c41d9-9003-45eb-9767-1e3f4972136f on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:52:33.870688 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] Attempting to bind port e97c41d9-9003-45eb-9767-1e3f4972136f by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'ad01124d-d7a6-4de3-b89b-fb85b4381531', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '0604719a-3ef3-479d-89b6-fd8462631749'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:52:33.871060 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] Attempting to bind port e97c41d9-9003-45eb-9767-1e3f4972136f on network 0604719a-3ef3-479d-89b6-fd8462631749 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:52:33.877034 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 52, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:52:33.877417 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] Checking segment: {'id': 'ad01124d-d7a6-4de3-b89b-fb85b4381531', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '0604719a-3ef3-479d-89b6-fd8462631749'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:52:33.877943 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:33.878337 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] Bound using segment: {'id': 'ad01124d-d7a6-4de3-b89b-fb85b4381531', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '0604719a-3ef3-479d-89b6-fd8462631749'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:52:33.878952 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] Bound port: e97c41d9-9003-45eb-9767-1e3f4972136f, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ad01124d-d7a6-4de3-b89b-fb85b4381531', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': '0604719a-3ef3-479d-89b6-fd8462631749'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:52:33.879744 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:33.958595 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] For port e97c41d9-9003-45eb-9767-1e3f4972136f, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:52:33.963625 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] For port e97c41d9-9003-45eb-9767-1e3f4972136f, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e97c41d9-9003-45eb-9767-1e3f4972136f,segment=NetworkSegment(ad01124d-d7a6-4de3-b89b-fb85b4381531),segment_id=ad01124d-d7a6-4de3-b89b-fb85b4381531)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:52:33.969127 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:33.980763 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-0a988a99-5b2e-458c-ae40-8a581b6036ac admin admin] Deleting port e97c41d9-9003-45eb-9767-1e3f4972136f {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:52:33.981815 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0a988a99-5b2e-458c-ae40-8a581b6036ac admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:34.062205 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85aadb10-ad0c-4782-9cc1-80f7a90d9e99 None None] Pushing event updated for resources: {'Port': ['ID=e97c41d9-9003-45eb-9767-1e3f4972136f,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:34.092445 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] Routers {'17cb8c89-2c13-481f-8d15-0095bbe6bb36'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:52:34.093124 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['17cb8c89-2c13-481f-8d15-0095bbe6bb36'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:34.159431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-0a988a99-5b2e-458c-ae40-8a581b6036ac admin admin] For port e97c41d9-9003-45eb-9767-1e3f4972136f, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e97c41d9-9003-45eb-9767-1e3f4972136f,segment=NetworkSegment(ad01124d-d7a6-4de3-b89b-fb85b4381531),segment_id=ad01124d-d7a6-4de3-b89b-fb85b4381531)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:34.160592 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0a988a99-5b2e-458c-ae40-8a581b6036ac admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:34.178923 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-350f5cfa-65f9-45ae-9eab-7af46373ef3a None None] Provisioning complete for port e97c41d9-9003-45eb-9767-1e3f4972136f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:34.179291 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-350f5cfa-65f9-45ae-9eab-7af46373ef3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:34.180021 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-0a988a99-5b2e-458c-ae40-8a581b6036ac admin admin] Calling delete_port for e97c41d9-9003-45eb-9767-1e3f4972136f owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:52:34.288541 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] Set router 17cb8c89-2c13-481f-8d15-0095bbe6bb36 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:52:34.474122 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-350f5cfa-65f9-45ae-9eab-7af46373ef3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:34.504899 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-288514aa-dc98-4dac-944a-317dd36c30b6 req-aa19204b-88c3-4d8a-88b5-ad1438473579 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:34.506934 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-288514aa-dc98-4dac-944a-317dd36c30b6 req-aa19204b-88c3-4d8a-88b5-ad1438473579 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 945 time: 0.0879529 Dec 09 21:52:34.657958 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0a988a99-5b2e-458c-ae40-8a581b6036ac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:34.709921 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a988a99-5b2e-458c-ae40-8a581b6036ac admin admin] Pushing event deleted for resources: {'Port': ['ID=e97c41d9-9003-45eb-9767-1e3f4972136f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:34.746681 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-288514aa-dc98-4dac-944a-317dd36c30b6 req-08e0fc7c-b03a-4256-b89f-938f52fb980a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2253633 Dec 09 21:52:34.891114 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6ea57b5b-63a4-437d-b11a-d3f5da250b57 None None] Could not find standard attr ID for object e97c41d9-9003-45eb-9767-1e3f4972136f. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 21:52:34.897697 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '17cb8c89-2c13-481f-8d15-0095bbe6bb36', 'name': 'tempest-ImageQuotaTest-227939004-router', 'tenant_id': '4246c907211d47f3a86430f8469bba20', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.29'}], 'enable_snat': True}, 'gw_port_id': '2d31f6ec-796d-4952-89ae-ac5fd4beb2d4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:26Z', 'updated_at': '2021-12-09T21:52:30Z', 'revision_number': 4, 'project_id': '4246c907211d47f3a86430f8469bba20', 'gw_port': {'id': '2d31f6ec-796d-4952-89ae-ac5fd4beb2d4', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:c5:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '17cb8c89-2c13-481f-8d15-0095bbe6bb36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3809, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:26Z', 'updated_at': '2021-12-09T21:52:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'e97c41d9-9003-45eb-9767-1e3f4972136f', 'name': '', 'network_id': '0604719a-3ef3-479d-89b6-fd8462631749', 'tenant_id': '4246c907211d47f3a86430f8469bba20', 'mac_address': 'fa:16:3e:4a:69:64', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '17cb8c89-2c13-481f-8d15-0095bbe6bb36', 'device_owner': 'network:router_interface', 'standard_attr_id': 3810, 'fixed_ips': [{'subnet_id': 'bfb53115-a1a8-41f6-8cf7-50ca07471498', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:28Z', 'updated_at': '2021-12-09T21:52:33Z', 'revision_number': 4, 'project_id': '4246c907211d47f3a86430f8469bba20', 'subnets': [{'id': 'bfb53115-a1a8-41f6-8cf7-50ca07471498', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:34.936778 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-973eb159-139a-49d8-9f34-8b37bb33b164 None None] The sync data for ids ['17cb8c89-2c13-481f-8d15-0095bbe6bb36'] in n-d-713301-27 is: [{'id': '17cb8c89-2c13-481f-8d15-0095bbe6bb36', 'name': 'tempest-ImageQuotaTest-227939004-router', 'tenant_id': '4246c907211d47f3a86430f8469bba20', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.29'}], 'enable_snat': True}, 'gw_port_id': '2d31f6ec-796d-4952-89ae-ac5fd4beb2d4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:26Z', 'updated_at': '2021-12-09T21:52:30Z', 'revision_number': 4, 'project_id': '4246c907211d47f3a86430f8469bba20', 'gw_port': {'id': '2d31f6ec-796d-4952-89ae-ac5fd4beb2d4', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:c5:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '17cb8c89-2c13-481f-8d15-0095bbe6bb36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3809, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:26Z', 'updated_at': '2021-12-09T21:52:29Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'e97c41d9-9003-45eb-9767-1e3f4972136f', 'name': '', 'network_id': '0604719a-3ef3-479d-89b6-fd8462631749', 'tenant_id': '4246c907211d47f3a86430f8469bba20', 'mac_address': 'fa:16:3e:4a:69:64', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '17cb8c89-2c13-481f-8d15-0095bbe6bb36', 'device_owner': 'network:router_interface', 'standard_attr_id': 3810, 'fixed_ips': [{'subnet_id': 'bfb53115-a1a8-41f6-8cf7-50ca07471498', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:28Z', 'updated_at': '2021-12-09T21:52:33Z', 'revision_number': 4, 'project_id': '4246c907211d47f3a86430f8469bba20', 'subnets': [{'id': 'bfb53115-a1a8-41f6-8cf7-50ca07471498', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:52:35.040675 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0a988a99-5b2e-458c-ae40-8a581b6036ac admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:35.336683 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0a988a99-5b2e-458c-ae40-8a581b6036ac admin admin] Router 17cb8c89-2c13-481f-8d15-0095bbe6bb36 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:52:35.496756 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0a988a99-5b2e-458c-ae40-8a581b6036ac admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:52:35.509532 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0a988a99-5b2e-458c-ae40-8a581b6036ac admin admin] 10.222.0.13 "PUT /v2.0/routers/17cb8c89-2c13-481f-8d15-0095bbe6bb36/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.0219049 Dec 09 21:52:35.510234 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53732) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:35.585518 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b9027b46-142e-4aea-855d-1de2dd7c77d3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:35.645430 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ff389cb0-9afe-4c46-bac6-786ed8567d2c admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:35.770761 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ff389cb0-9afe-4c46-bac6-786ed8567d2c admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:35.836700 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-ff389cb0-9afe-4c46-bac6-786ed8567d2c admin admin] Deleting port 2d31f6ec-796d-4952-89ae-ac5fd4beb2d4 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:52:35.837758 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ff389cb0-9afe-4c46-bac6-786ed8567d2c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:35.892884 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-021506e3-105d-4e8f-9957-e81cfca7d4a7 req-5d5f05de-0af5-467f-8f1f-369e35267e11 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:35.900658 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-021506e3-105d-4e8f-9957-e81cfca7d4a7 req-5d5f05de-0af5-467f-8f1f-369e35267e11 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 945 time: 0.0608246 Dec 09 21:52:35.954153 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-ff389cb0-9afe-4c46-bac6-786ed8567d2c admin admin] For port 2d31f6ec-796d-4952-89ae-ac5fd4beb2d4, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2d31f6ec-796d-4952-89ae-ac5fd4beb2d4,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:35.954735 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ff389cb0-9afe-4c46-bac6-786ed8567d2c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:35.964711 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-021506e3-105d-4e8f-9957-e81cfca7d4a7 req-e00ed10a-6709-457d-81c1-2329e34495b6 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0627513 Dec 09 21:52:35.973731 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-ff389cb0-9afe-4c46-bac6-786ed8567d2c admin admin] Calling delete_port for 2d31f6ec-796d-4952-89ae-ac5fd4beb2d4 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:52:36.161674 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ff389cb0-9afe-4c46-bac6-786ed8567d2c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:36.198012 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff389cb0-9afe-4c46-bac6-786ed8567d2c admin admin] Pushing event deleted for resources: {'Port': ['ID=2d31f6ec-796d-4952-89ae-ac5fd4beb2d4,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:36.214845 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb80bc71-1acb-4a2b-a47f-772e9dd772dc None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:52:36.264332 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ff389cb0-9afe-4c46-bac6-786ed8567d2c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:36.359300 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ff389cb0-9afe-4c46-bac6-786ed8567d2c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:36.361378 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ff389cb0-9afe-4c46-bac6-786ed8567d2c admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:36.428166 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd5f0c5c-c6c3-44e3-ba69-df448aea24c0 None None] Sync routers for ids ['17cb8c89-2c13-481f-8d15-0095bbe6bb36'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:52:36.439578 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd5f0c5c-c6c3-44e3-ba69-df448aea24c0 None None] Routers {'17cb8c89-2c13-481f-8d15-0095bbe6bb36'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:52:36.440323 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-dd5f0c5c-c6c3-44e3-ba69-df448aea24c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['17cb8c89-2c13-481f-8d15-0095bbe6bb36'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:36.517944 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-dd5f0c5c-c6c3-44e3-ba69-df448aea24c0 None None] Set router 17cb8c89-2c13-481f-8d15-0095bbe6bb36 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:52:36.574881 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-dd5f0c5c-c6c3-44e3-ba69-df448aea24c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '17cb8c89-2c13-481f-8d15-0095bbe6bb36', 'name': 'tempest-ImageQuotaTest-227939004-router', 'tenant_id': '4246c907211d47f3a86430f8469bba20', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:26Z', 'updated_at': '2021-12-09T21:52:36Z', 'revision_number': 7, 'project_id': '4246c907211d47f3a86430f8469bba20', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:36.603039 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd5f0c5c-c6c3-44e3-ba69-df448aea24c0 None None] Checking router: 17cb8c89-2c13-481f-8d15-0095bbe6bb36 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:52:36.613070 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd5f0c5c-c6c3-44e3-ba69-df448aea24c0 None None] Routers {'17cb8c89-2c13-481f-8d15-0095bbe6bb36'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:52:36.613588 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-dd5f0c5c-c6c3-44e3-ba69-df448aea24c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['17cb8c89-2c13-481f-8d15-0095bbe6bb36'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:36.687768 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-dd5f0c5c-c6c3-44e3-ba69-df448aea24c0 None None] Set router 17cb8c89-2c13-481f-8d15-0095bbe6bb36 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:52:36.689779 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:36.750780 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-dd5f0c5c-c6c3-44e3-ba69-df448aea24c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '17cb8c89-2c13-481f-8d15-0095bbe6bb36', 'name': 'tempest-ImageQuotaTest-227939004-router', 'tenant_id': '4246c907211d47f3a86430f8469bba20', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:26Z', 'updated_at': '2021-12-09T21:52:36Z', 'revision_number': 7, 'project_id': '4246c907211d47f3a86430f8469bba20', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:36.778991 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ff389cb0-9afe-4c46-bac6-786ed8567d2c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:36.780329 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ff389cb0-9afe-4c46-bac6-786ed8567d2c admin admin] Fanout notify agent at l3_agent the message router_deleted on router 17cb8c89-2c13-481f-8d15-0095bbe6bb36 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:52:36.785836 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd5f0c5c-c6c3-44e3-ba69-df448aea24c0 None None] The sync data for ids ['17cb8c89-2c13-481f-8d15-0095bbe6bb36'] in n-d-713301-27 is: [{'id': '17cb8c89-2c13-481f-8d15-0095bbe6bb36', 'name': 'tempest-ImageQuotaTest-227939004-router', 'tenant_id': '4246c907211d47f3a86430f8469bba20', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:26Z', 'updated_at': '2021-12-09T21:52:36Z', 'revision_number': 7, 'project_id': '4246c907211d47f3a86430f8469bba20', 'gw_port_host': None}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:52:36.789318 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ff389cb0-9afe-4c46-bac6-786ed8567d2c admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:36.790739 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ff389cb0-9afe-4c46-bac6-786ed8567d2c admin admin] 10.222.0.13 "DELETE /v2.0/routers/17cb8c89-2c13-481f-8d15-0095bbe6bb36 HTTP/1.1" status: 204 len: 168 time: 1.2793717 Dec 09 21:52:36.793454 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53754) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:36.864458 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-5fc6db79-053e-4532-a6d2-c14aa8f6c521 admin admin] Deleting subnet bfb53115-a1a8-41f6-8cf7-50ca07471498 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:52:36.876808 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5fc6db79-053e-4532-a6d2-c14aa8f6c521 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:36.926156 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5fc6db79-053e-4532-a6d2-c14aa8f6c521 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:37.037025 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5fc6db79-053e-4532-a6d2-c14aa8f6c521 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:37.121857 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5fc6db79-053e-4532-a6d2-c14aa8f6c521 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:37.155801 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fc6db79-053e-4532-a6d2-c14aa8f6c521 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=bfb53115-a1a8-41f6-8cf7-50ca07471498,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:37.170763 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5fc6db79-053e-4532-a6d2-c14aa8f6c521 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:37.171577 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b8f019e-2b85-4013-ac0d-e628f3482d18 None None] Network 0604719a-3ef3-479d-89b6-fd8462631749 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:52:37.179889 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5fc6db79-053e-4532-a6d2-c14aa8f6c521 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/bfb53115-a1a8-41f6-8cf7-50ca07471498 HTTP/1.1" status: 204 len: 168 time: 0.3828721 Dec 09 21:52:37.180630 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53760) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:37.209486 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae7e914c-2159-4048-b1d7-c22936aa8efe req-5ee87892-948b-4c50-8061-d173d00c7e35 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:37.212067 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae7e914c-2159-4048-b1d7-c22936aa8efe req-5ee87892-948b-4c50-8061-d173d00c7e35 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 945 time: 0.1094222 Dec 09 21:52:37.320300 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae7e914c-2159-4048-b1d7-c22936aa8efe req-5ff71b61-04fc-4bc0-b9f4-73d63ea7f89e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1002398 Dec 09 21:52:37.349849 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-05cc4ecf-461f-4148-9400-55d4924699bc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:37.416414 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-05cc4ecf-461f-4148-9400-55d4924699bc admin admin] Deleting port edb92ce6-bbea-4720-a8a8-5c0725433d33 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:52:37.416781 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-05cc4ecf-461f-4148-9400-55d4924699bc admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:37.427376 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1eaeccf9-3e8f-41f6-971e-6cfc6f269491 None None] DHCP port deletion for 0604719a-3ef3-479d-89b6-fd8462631749 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:52:37.430731 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e97c41d9-9003-45eb-9767-1e3f4972136f no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:52:37.470139 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: e97c41d9-9003-45eb-9767-1e3f4972136f {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:52:37.472387 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e97c41d9-9003-45eb-9767-1e3f4972136f not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:52:37.508560 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-05cc4ecf-461f-4148-9400-55d4924699bc admin admin] For port edb92ce6-bbea-4720-a8a8-5c0725433d33, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=edb92ce6-bbea-4720-a8a8-5c0725433d33,segment=NetworkSegment(ad01124d-d7a6-4de3-b89b-fb85b4381531),segment_id=ad01124d-d7a6-4de3-b89b-fb85b4381531)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:37.509222 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-05cc4ecf-461f-4148-9400-55d4924699bc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:37.523528 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-05cc4ecf-461f-4148-9400-55d4924699bc admin admin] Calling delete_port for edb92ce6-bbea-4720-a8a8-5c0725433d33 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:52:37.538385 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-1eaeccf9-3e8f-41f6-971e-6cfc6f269491 None None] Deleting port edb92ce6-bbea-4720-a8a8-5c0725433d33 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:52:37.538771 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1eaeccf9-3e8f-41f6-971e-6cfc6f269491 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:37.619402 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-1eaeccf9-3e8f-41f6-971e-6cfc6f269491 None None] For port edb92ce6-bbea-4720-a8a8-5c0725433d33, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=edb92ce6-bbea-4720-a8a8-5c0725433d33,segment=NetworkSegment(ad01124d-d7a6-4de3-b89b-fb85b4381531),segment_id=ad01124d-d7a6-4de3-b89b-fb85b4381531)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:37.619851 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1eaeccf9-3e8f-41f6-971e-6cfc6f269491 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:37.637418 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-05cc4ecf-461f-4148-9400-55d4924699bc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:37.641192 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-1eaeccf9-3e8f-41f6-971e-6cfc6f269491 None None] Calling delete_port for edb92ce6-bbea-4720-a8a8-5c0725433d33 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:52:37.668574 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05cc4ecf-461f-4148-9400-55d4924699bc admin admin] Pushing event deleted for resources: {'Port': ['ID=edb92ce6-bbea-4720-a8a8-5c0725433d33,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:37.674196 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05cc4ecf-461f-4148-9400-55d4924699bc admin admin] No DVR routers for this DVR port edb92ce6-bbea-4720-a8a8-5c0725433d33 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:52:37.756317 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1eaeccf9-3e8f-41f6-971e-6cfc6f269491 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:37.782812 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-05cc4ecf-461f-4148-9400-55d4924699bc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:37.795805 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eaeccf9-3e8f-41f6-971e-6cfc6f269491 None None] Pushing event deleted for resources: {'Port': ['ID=edb92ce6-bbea-4720-a8a8-5c0725433d33,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:37.798539 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1eaeccf9-3e8f-41f6-971e-6cfc6f269491 None None] No DVR routers for this DVR port edb92ce6-bbea-4720-a8a8-5c0725433d33 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:52:37.818451 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-05cc4ecf-461f-4148-9400-55d4924699bc admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0604719a-3ef3-479d-89b6-fd8462631749']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:37.830351 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-05cc4ecf-461f-4148-9400-55d4924699bc admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ad01124d-d7a6-4de3-b89b-fb85b4381531') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:37.830650 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-05cc4ecf-461f-4148-9400-55d4924699bc admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ad01124d-d7a6-4de3-b89b-fb85b4381531') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:37.842903 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-05cc4ecf-461f-4148-9400-55d4924699bc admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:37.858480 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-05cc4ecf-461f-4148-9400-55d4924699bc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:37.865479 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-05cc4ecf-461f-4148-9400-55d4924699bc admin admin] Releasing vlan 101 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:52:37.865872 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-05cc4ecf-461f-4148-9400-55d4924699bc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:52:37.923723 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:52:37.932821 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-05cc4ecf-461f-4148-9400-55d4924699bc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:37.941156 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-05cc4ecf-461f-4148-9400-55d4924699bc admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:37.945776 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-05cc4ecf-461f-4148-9400-55d4924699bc admin admin] 10.222.0.13 "DELETE /v2.0/networks/0604719a-3ef3-479d-89b6-fd8462631749 HTTP/1.1" status: 204 len: 168 time: 0.7635634 Dec 09 21:52:37.962338 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05cc4ecf-461f-4148-9400-55d4924699bc admin admin] Pushing event deleted for resources: {'Network': ['ID=0604719a-3ef3-479d-89b6-fd8462631749,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:38.023004 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:38.124509 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53768) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:38.179419 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5637246c-d491-4316-aea8-926fc40ce46d admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=4246c907211d47f3a86430f8469bba20&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0503919 Dec 09 21:52:38.179678 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53770) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:38.232263 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ce5d3e1-5a1d-4c8d-a88e-24ee0c2452d6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:38.254619 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ce5d3e1-5a1d-4c8d-a88e-24ee0c2452d6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:38.302133 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ce5d3e1-5a1d-4c8d-a88e-24ee0c2452d6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:38.305291 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ce5d3e1-5a1d-4c8d-a88e-24ee0c2452d6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:38.309457 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2ce5d3e1-5a1d-4c8d-a88e-24ee0c2452d6 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/9d251dce-9ac5-491a-9e88-3e50531d49b7 HTTP/1.1" status: 204 len: 168 time: 0.1263008 Dec 09 21:52:38.325290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ce5d3e1-5a1d-4c8d-a88e-24ee0c2452d6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9d251dce-9ac5-491a-9e88-3e50531d49b7,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:38.621004 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53782) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:38.734271 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d73c30fa-a40a-47eb-8a12-afba80bee0e3 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/floatingips/168a6a14-af7b-43e5-89ba-e2a51fb82886 HTTP/1.1" status: 200 len: 994 time: 0.1103911 Dec 09 21:52:38.757565 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1494a26-85f2-4d06-823c-cdf884700830 req-e761038f-20dd-44a1-8ba9-7596552de661 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:38.759864 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e1494a26-85f2-4d06-823c-cdf884700830 req-e761038f-20dd-44a1-8ba9-7596552de661 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 945 time: 0.3404996 Dec 09 21:52:38.831274 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53786) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:38.844083 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e1494a26-85f2-4d06-823c-cdf884700830 req-87626843-c88d-4ec3-a86b-0933f80d267f tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0755606 Dec 09 21:52:38.852064 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ff4c3a3c-b2c9-4a51-8a03-fd8b1badcd81 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:38.945711 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ff4c3a3c-b2c9-4a51-8a03-fd8b1badcd81 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:38.949817 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ff4c3a3c-b2c9-4a51-8a03-fd8b1badcd81 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:38.993670 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53790) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:38.994192 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ff4c3a3c-b2c9-4a51-8a03-fd8b1badcd81 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=None&name=default HTTP/1.1" status: 200 len: 2720 time: 0.1615429 Dec 09 21:52:38.996235 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff4c3a3c-b2c9-4a51-8a03-fd8b1badcd81 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=abd4174b-e41e-4bb0-9aaf-97e8ed266070,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:39.073143 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8518da55-de27-423a-8004-63fa807caabc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:39.098922 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8518da55-de27-423a-8004-63fa807caabc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:39.126924 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2d31f6ec-796d-4952-89ae-ac5fd4beb2d4 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:52:39.148630 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 2d31f6ec-796d-4952-89ae-ac5fd4beb2d4 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:52:39.149412 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2d31f6ec-796d-4952-89ae-ac5fd4beb2d4 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:52:39.149994 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device edb92ce6-bbea-4720-a8a8-5c0725433d33 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:52:39.172585 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8518da55-de27-423a-8004-63fa807caabc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:39.173846 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: edb92ce6-bbea-4720-a8a8-5c0725433d33 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:52:39.174528 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device edb92ce6-bbea-4720-a8a8-5c0725433d33 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:52:39.177950 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53796) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:39.180562 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8518da55-de27-423a-8004-63fa807caabc admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:39.184438 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8518da55-de27-423a-8004-63fa807caabc admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/abd4174b-e41e-4bb0-9aaf-97e8ed266070 HTTP/1.1" status: 204 len: 168 time: 0.1857088 Dec 09 21:52:39.194299 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8518da55-de27-423a-8004-63fa807caabc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=abd4174b-e41e-4bb0-9aaf-97e8ed266070,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:39.428191 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-4d229a9c-b93c-42b1-824d-b12ddb15435b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Deleting port ea78f544-71a6-40d1-a8b8-1cdf4de86b25 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:52:39.428818 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4d229a9c-b93c-42b1-824d-b12ddb15435b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:39.538625 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4d229a9c-b93c-42b1-824d-b12ddb15435b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:39.539102 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4d229a9c-b93c-42b1-824d-b12ddb15435b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:39.555622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-4d229a9c-b93c-42b1-824d-b12ddb15435b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Calling delete_port for ea78f544-71a6-40d1-a8b8-1cdf4de86b25 owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:52:39.687059 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:39.771045 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4d229a9c-b93c-42b1-824d-b12ddb15435b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:39.830772 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d229a9c-b93c-42b1-824d-b12ddb15435b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event deleted for resources: {'Port': ['ID=ea78f544-71a6-40d1-a8b8-1cdf4de86b25,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:39.876903 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4d229a9c-b93c-42b1-824d-b12ddb15435b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:39.877416 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-4d229a9c-b93c-42b1-824d-b12ddb15435b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Floating IP 168a6a14-af7b-43e5-89ba-e2a51fb82886 disassociated (deleted). External IP: 172.25.3.189, port: a1e280f8-4599-42bc-9eec-7c9618c84471. Dec 09 21:52:40.035381 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60253c48-e42b-48dd-960e-3fe00553f795 req-40ac97bc-0108-422c-b12e-ba3630c705d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:40.037869 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60253c48-e42b-48dd-960e-3fe00553f795 req-40ac97bc-0108-422c-b12e-ba3630c705d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 945 time: 0.1113477 Dec 09 21:52:40.205571 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60253c48-e42b-48dd-960e-3fe00553f795 req-51e68176-f41c-44bc-9586-7b499b32026b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1489911 Dec 09 21:52:40.238830 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4d229a9c-b93c-42b1-824d-b12ddb15435b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Router ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:52:40.369498 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4d229a9c-b93c-42b1-824d-b12ddb15435b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:52:40.380550 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-151f6fd1-8be2-45d5-a1ab-9197a8d3f159 None None] Sync routers for ids ['ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:52:40.384307 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53810) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:40.384790 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4d229a9c-b93c-42b1-824d-b12ddb15435b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:40.412314 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-151f6fd1-8be2-45d5-a1ab-9197a8d3f159 None None] Routers {'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:52:40.415623 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4d229a9c-b93c-42b1-824d-b12ddb15435b tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "DELETE /v2.0/floatingips/168a6a14-af7b-43e5-89ba-e2a51fb82886 HTTP/1.1" status: 204 len: 168 time: 1.2370396 Dec 09 21:52:40.416322 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e3992eb9-4e32-4dc2-be65-a102058d2974', 'tag': 'a1e280f8-4599-42bc-9eec-7c9618c84471'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:52:40.418775 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-151f6fd1-8be2-45d5-a1ab-9197a8d3f159 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:40.419178 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1daab424-6edf-4041-9d51-1dc64962117f" -d '{"events": [{"name": "network-changed", "server_uuid": "e3992eb9-4e32-4dc2-be65-a102058d2974", "tag": "a1e280f8-4599-42bc-9eec-7c9618c84471"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:52:40.556055 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-702bf67d-6074-461c-b1f7-87554e849365 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:40.604781 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-151f6fd1-8be2-45d5-a1ab-9197a8d3f159 None None] Set router ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:52:40.615598 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:52:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-94444355-441d-4288-921a-9a0a7b6dc5ab x-openstack-request-id: req-94444355-441d-4288-921a-9a0a7b6dc5ab {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:52:40.616075 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e3992eb9-4e32-4dc2-be65-a102058d2974", "tag": "a1e280f8-4599-42bc-9eec-7c9618c84471", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:52:40.616495 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-94444355-441d-4288-921a-9a0a7b6dc5ab {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:52:40.617050 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e3992eb9-4e32-4dc2-be65-a102058d2974', 'tag': 'a1e280f8-4599-42bc-9eec-7c9618c84471', 'status': 'completed', 'code': 200} Dec 09 21:52:40.753878 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2290b734-c0b8-4fc5-994a-6a82f0704ca9 req-695870b0-db8b-4178-898a-8e190deb5084 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:40.757019 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1daab424-6edf-4041-9d51-1dc64962117f req-daf03951-7851-4f39-aebb-31ebd3d212e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:40.758286 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2290b734-c0b8-4fc5-994a-6a82f0704ca9 req-695870b0-db8b-4178-898a-8e190deb5084 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=e3992eb9-4e32-4dc2-be65-a102058d2974 HTTP/1.1" status: 200 len: 946 time: 0.0819664 Dec 09 21:52:40.758558 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1daab424-6edf-4041-9d51-1dc64962117f req-daf03951-7851-4f39-aebb-31ebd3d212e3 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e863bf78256945798e7c717c650258aa&device_id=e3992eb9-4e32-4dc2-be65-a102058d2974 HTTP/1.1" status: 200 len: 1098 time: 0.1025357 Dec 09 21:52:40.789018 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-702bf67d-6074-461c-b1f7-87554e849365 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:40.810394 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-702bf67d-6074-461c-b1f7-87554e849365 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:40.849622 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-702bf67d-6074-461c-b1f7-87554e849365 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a51ca348-3e56-49ce-baf9-7b45d292a249,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:40.878347 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2290b734-c0b8-4fc5-994a-6a82f0704ca9 req-4952248b-34e7-47a6-b879-a95ab99a44ef tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=91e8cd34-2082-4604-9b4a-5995f7f0b0c6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1103215 Dec 09 21:52:40.913502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-151f6fd1-8be2-45d5-a1ab-9197a8d3f159 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'name': 'tempest-TestNetworkBasicOps-router-421012370', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48'}], 'enable_snat': True}, 'gw_port_id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:32Z', 'updated_at': '2021-12-09T21:51:41Z', 'revision_number': 4, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:55:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3769, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:34Z', 'updated_at': '2021-12-09T21:51:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01', 'name': '', 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:0b:51:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 3772, 'fixed_ips': [{'subnet_id': '6112c97b-e0b7-4ba1-8f0e-463e550e07f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:40Z', 'updated_at': '2021-12-09T21:51:49Z', 'revision_number': 5, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': '6112c97b-e0b7-4ba1-8f0e-463e550e07f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:40.921195 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-702bf67d-6074-461c-b1f7-87554e849365 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=59d7ef227a0749078e633c5fa1cdc248&name=default HTTP/1.1" status: 200 len: 3000 time: 0.5356545 Dec 09 21:52:40.923812 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53820) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:40.949770 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-151f6fd1-8be2-45d5-a1ab-9197a8d3f159 None None] Checking router: ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:52:40.960771 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-151f6fd1-8be2-45d5-a1ab-9197a8d3f159 None None] Routers {'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:52:40.961835 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-151f6fd1-8be2-45d5-a1ab-9197a8d3f159 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:40.970380 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1daab424-6edf-4041-9d51-1dc64962117f req-3be67796-5993-4ee3-9727-79bb41b983f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:40.971986 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1daab424-6edf-4041-9d51-1dc64962117f req-3be67796-5993-4ee3-9727-79bb41b983f0 service neutron] 10.222.0.31 "GET /v2.0/networks?id=5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3 HTTP/1.1" status: 200 len: 898 time: 0.2028639 Dec 09 21:52:41.034935 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1daab424-6edf-4041-9d51-1dc64962117f req-bf42a019-bca8-4bc3-b76e-405a9d2afe50 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=a1e280f8-4599-42bc-9eec-7c9618c84471 HTTP/1.1" status: 200 len: 217 time: 0.0433760 Dec 09 21:52:41.035976 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a138aea-85f1-481e-9a8f-16ada1129d78 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:41.094186 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1daab424-6edf-4041-9d51-1dc64962117f req-9f32f83d-4994-4064-ba0d-52db059d68f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:41.095849 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1daab424-6edf-4041-9d51-1dc64962117f req-9f32f83d-4994-4064-ba0d-52db059d68f1 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=6112c97b-e0b7-4ba1-8f0e-463e550e07f7 HTTP/1.1" status: 200 len: 835 time: 0.0506363 Dec 09 21:52:41.101164 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-151f6fd1-8be2-45d5-a1ab-9197a8d3f159 None None] Set router ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:52:41.133101 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a138aea-85f1-481e-9a8f-16ada1129d78 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:41.179348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1daab424-6edf-4041-9d51-1dc64962117f req-2c20fa77-166a-456e-a15f-ebacd12cb49e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:41.181005 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1daab424-6edf-4041-9d51-1dc64962117f req-2c20fa77-166a-456e-a15f-ebacd12cb49e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0745375 Dec 09 21:52:41.230561 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a138aea-85f1-481e-9a8f-16ada1129d78 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:41.233419 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a138aea-85f1-481e-9a8f-16ada1129d78 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:41.238535 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2a138aea-85f1-481e-9a8f-16ada1129d78 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/a51ca348-3e56-49ce-baf9-7b45d292a249 HTTP/1.1" status: 204 len: 168 time: 0.3097050 Dec 09 21:52:41.247281 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a138aea-85f1-481e-9a8f-16ada1129d78 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a51ca348-3e56-49ce-baf9-7b45d292a249,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:41.317685 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1daab424-6edf-4041-9d51-1dc64962117f req-c1882b77-d6fb-4a75-8e73-a7c74fa05c6c service neutron] 10.222.0.31 "GET /v2.0/networks/5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1264715 Dec 09 21:52:41.466839 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a78053b5-409a-425a-accf-37e49312d35d req-dd7ce965-871c-4c89-bb7b-3f4e9cba705b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:41.478632 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-151f6fd1-8be2-45d5-a1ab-9197a8d3f159 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'name': 'tempest-TestNetworkBasicOps-router-421012370', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48'}], 'enable_snat': True}, 'gw_port_id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:32Z', 'updated_at': '2021-12-09T21:51:41Z', 'revision_number': 4, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:55:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3769, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:34Z', 'updated_at': '2021-12-09T21:51:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01', 'name': '', 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:0b:51:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 3772, 'fixed_ips': [{'subnet_id': '6112c97b-e0b7-4ba1-8f0e-463e550e07f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:40Z', 'updated_at': '2021-12-09T21:51:49Z', 'revision_number': 5, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': '6112c97b-e0b7-4ba1-8f0e-463e550e07f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:41.485787 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a78053b5-409a-425a-accf-37e49312d35d req-dd7ce965-871c-4c89-bb7b-3f4e9cba705b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 945 time: 0.1701715 Dec 09 21:52:41.519255 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-151f6fd1-8be2-45d5-a1ab-9197a8d3f159 None None] The sync data for ids ['ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'] in n-d-713301-27 is: [{'id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'name': 'tempest-TestNetworkBasicOps-router-421012370', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48'}], 'enable_snat': True}, 'gw_port_id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:32Z', 'updated_at': '2021-12-09T21:51:41Z', 'revision_number': 4, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:55:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3769, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:34Z', 'updated_at': '2021-12-09T21:51:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01', 'name': '', 'network_id': '5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'mac_address': 'fa:16:3e:0b:51:d4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 3772, 'fixed_ips': [{'subnet_id': '6112c97b-e0b7-4ba1-8f0e-463e550e07f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:40Z', 'updated_at': '2021-12-09T21:51:49Z', 'revision_number': 5, 'project_id': 'e863bf78256945798e7c717c650258aa', 'subnets': [{'id': '6112c97b-e0b7-4ba1-8f0e-463e550e07f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:52:41.520238 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1daab424-6edf-4041-9d51-1dc64962117f req-568ab64f-234a-4577-aeaf-f2085bd2bfec service neutron] 10.222.0.31 "GET /v2.0/networks/5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1927323 Dec 09 21:52:41.562875 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a78053b5-409a-425a-accf-37e49312d35d req-2f77ebff-2a33-4f7e-9190-61b98d5c162b tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0756886 Dec 09 21:52:41.800624 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2092c5e4-136e-44fb-a046-dd0af76e361e None None] New status for floating IP 168a6a14-af7b-43e5-89ba-e2a51fb82886: DOWN {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:52:42.042399 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9912835-fb37-473a-83b4-ca8ca6e0a15e req-7b4f6809-63f1-43b2-9ecb-a219d2791d64 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:42.044083 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e9912835-fb37-473a-83b4-ca8ca6e0a15e req-7b4f6809-63f1-43b2-9ecb-a219d2791d64 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=e3992eb9-4e32-4dc2-be65-a102058d2974 HTTP/1.1" status: 200 len: 946 time: 0.0573690 Dec 09 21:52:42.117824 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e9912835-fb37-473a-83b4-ca8ca6e0a15e req-2f86364e-d27c-416a-b104-bd041c4b122a tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/security-groups?id=91e8cd34-2082-4604-9b4a-5995f7f0b0c6&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0667241 Dec 09 21:52:42.134502 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53848) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:42.147611 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f1b3b84-9604-46f3-b507-8a39688c4dae req-14f17e30-4f11-43dc-9a80-42a6a7e76c86 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:42.149205 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2f1b3b84-9604-46f3-b507-8a39688c4dae req-14f17e30-4f11-43dc-9a80-42a6a7e76c86 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.31 "GET /v2.0/ports?device_id=e3992eb9-4e32-4dc2-be65-a102058d2974 HTTP/1.1" status: 200 len: 946 time: 0.0717170 Dec 09 21:52:42.247246 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-2f1b3b84-9604-46f3-b507-8a39688c4dae req-66de76f1-4290-4198-a341-e364b0d1cec8 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Deleting port a1e280f8-4599-42bc-9eec-7c9618c84471 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:52:42.247773 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2f1b3b84-9604-46f3-b507-8a39688c4dae req-66de76f1-4290-4198-a341-e364b0d1cec8 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:42.269463 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-7dce6d98-9ffc-4ffc-b26f-19396430938a admin admin] Request body: {'network': {'name': 'tempest-TestAggregatesBasicOps-1642153010-network', 'tenant_id': 'e1c29cd411134d0696683880e25d3ad6'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:52:42.338539 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7dce6d98-9ffc-4ffc-b26f-19396430938a admin admin] Made reservation on behalf of e1c29cd411134d0696683880e25d3ad6 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:52:42.340849 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7dce6d98-9ffc-4ffc-b26f-19396430938a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:42.358603 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7dce6d98-9ffc-4ffc-b26f-19396430938a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:42.377626 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-2f1b3b84-9604-46f3-b507-8a39688c4dae req-66de76f1-4290-4198-a341-e364b0d1cec8 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] For port a1e280f8-4599-42bc-9eec-7c9618c84471, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a1e280f8-4599-42bc-9eec-7c9618c84471,segment=NetworkSegment(dc0bd24b-5723-4625-bde4-525782b5f73e),segment_id=dc0bd24b-5723-4625-bde4-525782b5f73e)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:42.377626 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2f1b3b84-9604-46f3-b507-8a39688c4dae req-66de76f1-4290-4198-a341-e364b0d1cec8 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:42.394408 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-2f1b3b84-9604-46f3-b507-8a39688c4dae req-66de76f1-4290-4198-a341-e364b0d1cec8 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Calling delete_port for a1e280f8-4599-42bc-9eec-7c9618c84471 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:52:42.521111 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7dce6d98-9ffc-4ffc-b26f-19396430938a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:42.526340 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7dce6d98-9ffc-4ffc-b26f-19396430938a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:42.583027 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dce6d98-9ffc-4ffc-b26f-19396430938a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=25279242-ee89-4747-9da4-ac3a64774d91,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:42.599839 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2f1b3b84-9604-46f3-b507-8a39688c4dae req-66de76f1-4290-4198-a341-e364b0d1cec8 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:42.611605 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7dce6d98-9ffc-4ffc-b26f-19396430938a admin admin] vlan segment allocate from pool success with {'vlan_id': 132, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:52:42.643314 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66de76f1-4290-4198-a341-e364b0d1cec8 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event deleted for resources: {'Port': ['ID=a1e280f8-4599-42bc-9eec-7c9618c84471,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:42.648817 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7dce6d98-9ffc-4ffc-b26f-19396430938a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:42.649160 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-7dce6d98-9ffc-4ffc-b26f-19396430938a admin admin] Added segment 2cf8af64-5fcd-450c-a642-55c17e8db111 of type vlan for network 982ab6c6-e858-4907-9da8-7b116210104a Dec 09 21:52:42.708936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00c397ee-7342-4667-ab2c-505adef76647 req-9d38f6ed-bf9c-4e32-827f-6fbd26e8cb9d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:42.710619 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-00c397ee-7342-4667-ab2c-505adef76647 req-9d38f6ed-bf9c-4e32-827f-6fbd26e8cb9d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 945 time: 0.0609889 Dec 09 21:52:42.720855 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-2f1b3b84-9604-46f3-b507-8a39688c4dae req-66de76f1-4290-4198-a341-e364b0d1cec8 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] No DVR routers for this DVR port a1e280f8-4599-42bc-9eec-7c9618c84471 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:52:42.728570 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2f1b3b84-9604-46f3-b507-8a39688c4dae req-66de76f1-4290-4198-a341-e364b0d1cec8 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:42.732005 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2f1b3b84-9604-46f3-b507-8a39688c4dae req-66de76f1-4290-4198-a341-e364b0d1cec8 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.31 "DELETE /v2.0/ports/a1e280f8-4599-42bc-9eec-7c9618c84471 HTTP/1.1" status: 204 len: 173 time: 0.5755179 Dec 09 21:52:42.732489 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e3992eb9-4e32-4dc2-be65-a102058d2974', 'name': 'network-vif-deleted', 'tag': 'a1e280f8-4599-42bc-9eec-7c9618c84471'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:52:42.735894 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0e21be02-4c10-4ad6-85c9-a2b9472ed3c6" -d '{"events": [{"server_uuid": "e3992eb9-4e32-4dc2-be65-a102058d2974", "name": "network-vif-deleted", "tag": "a1e280f8-4599-42bc-9eec-7c9618c84471"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:52:42.741547 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7dce6d98-9ffc-4ffc-b26f-19396430938a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:42.770550 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-00c397ee-7342-4667-ab2c-505adef76647 req-90204f71-316e-459d-a465-bdc0cd96cabd tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0530603 Dec 09 21:52:42.777816 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7dce6d98-9ffc-4ffc-b26f-19396430938a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:42.778884 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7dce6d98-9ffc-4ffc-b26f-19396430938a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:42.779520 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7dce6d98-9ffc-4ffc-b26f-19396430938a admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:42.816807 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7dce6d98-9ffc-4ffc-b26f-19396430938a admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.6811125 Dec 09 21:52:42.823489 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53858) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:42.824533 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-86e1396a-6281-48ed-b230-044f2ec0a95c admin admin] Request body: {'subnet': {'network_id': '982ab6c6-e858-4907-9da8-7b116210104a', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestAggregatesBasicOps-1642153010-subnet', 'tenant_id': 'e1c29cd411134d0696683880e25d3ad6', 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:52:42.859527 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dce6d98-9ffc-4ffc-b26f-19396430938a admin admin] Pushing event updated for resources: {'Network': ['ID=982ab6c6-e858-4907-9da8-7b116210104a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:42.878138 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 982ab6c6-e858-4907-9da8-7b116210104a details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:52:42.891079 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:52:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c714ebfa-4122-45b9-8a1f-19ab3b580411 x-openstack-request-id: req-c714ebfa-4122-45b9-8a1f-19ab3b580411 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:52:42.891953 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e3992eb9-4e32-4dc2-be65-a102058d2974", "name": "network-vif-deleted", "tag": "a1e280f8-4599-42bc-9eec-7c9618c84471", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:52:42.892199 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c714ebfa-4122-45b9-8a1f-19ab3b580411 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:52:42.892710 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e3992eb9-4e32-4dc2-be65-a102058d2974', 'name': 'network-vif-deleted', 'tag': 'a1e280f8-4599-42bc-9eec-7c9618c84471', 'status': 'completed', 'code': 200} Dec 09 21:52:42.898892 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-86e1396a-6281-48ed-b230-044f2ec0a95c admin admin] Made reservation on behalf of e1c29cd411134d0696683880e25d3ad6 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:52:42.903382 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86e1396a-6281-48ed-b230-044f2ec0a95c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:43.079464 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86e1396a-6281-48ed-b230-044f2ec0a95c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:43.141074 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86e1396a-6281-48ed-b230-044f2ec0a95c admin admin] Pushing event updated for resources: {'Subnet': ['ID=ccc6c1d7-5b8e-4ddd-8a24-7c6dd0ffc5a1,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:43.150477 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86e1396a-6281-48ed-b230-044f2ec0a95c admin admin] Checking segment: {'id': '2cf8af64-5fcd-450c-a642-55c17e8db111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '982ab6c6-e858-4907-9da8-7b116210104a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:52:43.151173 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-86e1396a-6281-48ed-b230-044f2ec0a95c admin admin] Network hostable DHCP agents. Network: 982ab6c6-e858-4907-9da8-7b116210104a, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:52:43.169469 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-86e1396a-6281-48ed-b230-044f2ec0a95c admin admin] Network 982ab6c6-e858-4907-9da8-7b116210104a is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:52:43.180919 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-86e1396a-6281-48ed-b230-044f2ec0a95c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 982ab6c6-e858-4907-9da8-7b116210104a) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:52:43.185035 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-86e1396a-6281-48ed-b230-044f2ec0a95c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:43.185865 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86e1396a-6281-48ed-b230-044f2ec0a95c admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:43.192603 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ceb4f549-8873-45b2-9ebf-dd568255abec None None] Network 982ab6c6-e858-4907-9da8-7b116210104a requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:52:43.215631 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-86e1396a-6281-48ed-b230-044f2ec0a95c admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.3948967 Dec 09 21:52:43.218387 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53862) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:43.224558 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-d5b1bd76-0d49-4dfd-a7a3-33eb1e903e51 admin admin] Request body: {'router': {'name': 'tempest-TestAggregatesBasicOps-1642153010-router', 'tenant_id': 'e1c29cd411134d0696683880e25d3ad6', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:52:43.245110 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e056bc19-2ba8-43c2-8a76-4d9d9227bac0 req-9ac869a4-42bb-49df-bf62-3cb17b41fc21 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "GET /v2.0/ports?device_id=e3992eb9-4e32-4dc2-be65-a102058d2974 HTTP/1.1" status: 200 len: 210 time: 0.0409427 Dec 09 21:52:43.249863 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5b1bd76-0d49-4dfd-a7a3-33eb1e903e51 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:43.251120 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5b1bd76-0d49-4dfd-a7a3-33eb1e903e51 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:43.297353 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-572c50ca-2e7f-4abb-b4de-4df5af51fc02 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-982ab6c6-e858-4907-9da8-7b116210104a', 'network_id': '982ab6c6-e858-4907-9da8-7b116210104a', 'project_id': 'e1c29cd411134d0696683880e25d3ad6', 'fixed_ips': [{'subnet_id': 'ccc6c1d7-5b8e-4ddd-8a24-7c6dd0ffc5a1'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:52:43.298240 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-572c50ca-2e7f-4abb-b4de-4df5af51fc02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:43.313749 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5b1bd76-0d49-4dfd-a7a3-33eb1e903e51 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:43.445919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-572c50ca-2e7f-4abb-b4de-4df5af51fc02 None None] Allocated IP 172.20.0.2 (982ab6c6-e858-4907-9da8-7b116210104a/ccc6c1d7-5b8e-4ddd-8a24-7c6dd0ffc5a1/27259ce3-53db-4b5e-b24d-ccd77e9b9e85) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:52:43.493752 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5b1bd76-0d49-4dfd-a7a3-33eb1e903e51 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:43.526733 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7454a1d-43c2-487b-9d3b-536ef7db6813 req-cb325c93-4653-4919-a939-578da896afc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:43.528290 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d7454a1d-43c2-487b-9d3b-536ef7db6813 req-cb325c93-4653-4919-a939-578da896afc9 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 1097 time: 0.0911126 Dec 09 21:52:43.595268 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-572c50ca-2e7f-4abb-b4de-4df5af51fc02 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:43.602743 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-572c50ca-2e7f-4abb-b4de-4df5af51fc02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:43.645821 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-572c50ca-2e7f-4abb-b4de-4df5af51fc02 None None] Network 982ab6c6-e858-4907-9da8-7b116210104a is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:52:43.649725 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-572c50ca-2e7f-4abb-b4de-4df5af51fc02 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:52:43.651616 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-572c50ca-2e7f-4abb-b4de-4df5af51fc02 None None] Pushing event updated for resources: {'Port': ['ID=27259ce3-53db-4b5e-b24d-ccd77e9b9e85,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:43.653733 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-572c50ca-2e7f-4abb-b4de-4df5af51fc02 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:52:43.676694 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7454a1d-43c2-487b-9d3b-536ef7db6813 req-dbf37345-a2d6-4be6-bdc0-b6102aeeffe8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:43.678190 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d7454a1d-43c2-487b-9d3b-536ef7db6813 req-dbf37345-a2d6-4be6-bdc0-b6102aeeffe8 service neutron] 10.222.0.31 "GET /v2.0/networks?id=dbbab540-d32c-4ae4-8405-4fd5a5d9b94c HTTP/1.1" status: 200 len: 898 time: 0.1069660 Dec 09 21:52:43.709808 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-572c50ca-2e7f-4abb-b4de-4df5af51fc02 None None] Attempting to bind port 27259ce3-53db-4b5e-b24d-ccd77e9b9e85 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:52:43.710175 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-572c50ca-2e7f-4abb-b4de-4df5af51fc02 None None] Attempting to bind port 27259ce3-53db-4b5e-b24d-ccd77e9b9e85 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '2cf8af64-5fcd-450c-a642-55c17e8db111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '982ab6c6-e858-4907-9da8-7b116210104a'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:52:43.710531 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-572c50ca-2e7f-4abb-b4de-4df5af51fc02 None None] Attempting to bind port 27259ce3-53db-4b5e-b24d-ccd77e9b9e85 on network 982ab6c6-e858-4907-9da8-7b116210104a {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:52:43.715393 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-572c50ca-2e7f-4abb-b4de-4df5af51fc02 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 52, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:52:43.715789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-572c50ca-2e7f-4abb-b4de-4df5af51fc02 None None] Checking segment: {'id': '2cf8af64-5fcd-450c-a642-55c17e8db111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '982ab6c6-e858-4907-9da8-7b116210104a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:52:43.716182 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-572c50ca-2e7f-4abb-b4de-4df5af51fc02 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:43.716564 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-572c50ca-2e7f-4abb-b4de-4df5af51fc02 None None] Bound using segment: {'id': '2cf8af64-5fcd-450c-a642-55c17e8db111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '982ab6c6-e858-4907-9da8-7b116210104a'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:52:43.717047 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-572c50ca-2e7f-4abb-b4de-4df5af51fc02 None None] Bound port: 27259ce3-53db-4b5e-b24d-ccd77e9b9e85, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2cf8af64-5fcd-450c-a642-55c17e8db111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '982ab6c6-e858-4907-9da8-7b116210104a'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:52:43.717421 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-572c50ca-2e7f-4abb-b4de-4df5af51fc02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:43.780445 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-572c50ca-2e7f-4abb-b4de-4df5af51fc02 None None] For port 27259ce3-53db-4b5e-b24d-ccd77e9b9e85, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:52:43.783868 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-572c50ca-2e7f-4abb-b4de-4df5af51fc02 None None] For port 27259ce3-53db-4b5e-b24d-ccd77e9b9e85, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=27259ce3-53db-4b5e-b24d-ccd77e9b9e85,segment=NetworkSegment(2cf8af64-5fcd-450c-a642-55c17e8db111),segment_id=2cf8af64-5fcd-450c-a642-55c17e8db111)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:52:43.790722 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-572c50ca-2e7f-4abb-b4de-4df5af51fc02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:43.834036 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d7454a1d-43c2-487b-9d3b-536ef7db6813 req-7feae1c8-1b33-4f3b-a81c-14ae716d865f service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=50c46228-45fd-43c8-9fd2-e6ae52717651 HTTP/1.1" status: 200 len: 1001 time: 0.1160154 Dec 09 21:52:43.850065 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-572c50ca-2e7f-4abb-b4de-4df5af51fc02 None None] Pushing event updated for resources: {'Port': ['ID=27259ce3-53db-4b5e-b24d-ccd77e9b9e85,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:43.877486 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5b1bd76-0d49-4dfd-a7a3-33eb1e903e51 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:43.901951 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5b1bd76-0d49-4dfd-a7a3-33eb1e903e51 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:43.917217 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7454a1d-43c2-487b-9d3b-536ef7db6813 req-bfbefb83-a206-4f5d-87ec-f7e87a39fb63 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:43.918791 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d7454a1d-43c2-487b-9d3b-536ef7db6813 req-bfbefb83-a206-4f5d-87ec-f7e87a39fb63 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=df92f5f0-ea14-470b-bca7-c613b8daecf5 HTTP/1.1" status: 200 len: 834 time: 0.0754261 Dec 09 21:52:43.936784 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2e3efc4-1877-478f-bf59-f3eaf173c7c0 req-d5692d21-c5af-4b7c-9dfc-812936478de7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:43.938469 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2e3efc4-1877-478f-bf59-f3eaf173c7c0 req-d5692d21-c5af-4b7c-9dfc-812936478de7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 945 time: 0.0570383 Dec 09 21:52:43.990787 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a2e3efc4-1877-478f-bf59-f3eaf173c7c0 req-b4a3915b-38f4-4a85-9e30-a6353c7262c0 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457368 Dec 09 21:52:44.040039 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7454a1d-43c2-487b-9d3b-536ef7db6813 req-389de32b-b01f-4a9c-9e45-fc1e9d838939 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:44.041567 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d7454a1d-43c2-487b-9d3b-536ef7db6813 req-389de32b-b01f-4a9c-9e45-fc1e9d838939 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=dbbab540-d32c-4ae4-8405-4fd5a5d9b94c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0925646 Dec 09 21:52:44.099890 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-d5b1bd76-0d49-4dfd-a7a3-33eb1e903e51 admin admin] Allocated IP 172.25.3.196 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/920c449e-6a22-483f-95fa-c51b7b4c0846) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:52:44.238705 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d7454a1d-43c2-487b-9d3b-536ef7db6813 req-9df45986-4737-4d94-8843-423fe8e2d70f service neutron] 10.222.0.31 "GET /v2.0/networks/dbbab540-d32c-4ae4-8405-4fd5a5d9b94c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1832821 Dec 09 21:52:44.299564 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5b1bd76-0d49-4dfd-a7a3-33eb1e903e51 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:44.311902 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53870) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:44.371591 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7da587a5-40a5-48ef-8a4c-389992167880 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:44.377021 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d7454a1d-43c2-487b-9d3b-536ef7db6813 req-4fc5746a-c37a-4ce0-95f7-6b59c5f9561e service neutron] 10.222.0.31 "GET /v2.0/networks/dbbab540-d32c-4ae4-8405-4fd5a5d9b94c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1236434 Dec 09 21:52:44.388669 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5b1bd76-0d49-4dfd-a7a3-33eb1e903e51 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:44.402960 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7da587a5-40a5-48ef-8a4c-389992167880 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:44.426383 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d5b1bd76-0d49-4dfd-a7a3-33eb1e903e51 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:52:44.429471 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-d5b1bd76-0d49-4dfd-a7a3-33eb1e903e51 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:52:44.433086 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5b1bd76-0d49-4dfd-a7a3-33eb1e903e51 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:52:44.442798 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-263f6e7a-209c-4242-83a6-908c2b0c9425 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:52:44.467753 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5b1bd76-0d49-4dfd-a7a3-33eb1e903e51 admin admin] Pushing event updated for resources: {'Port': ['ID=920c449e-6a22-483f-95fa-c51b7b4c0846,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:44.485062 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7da587a5-40a5-48ef-8a4c-389992167880 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:44.494558 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7da587a5-40a5-48ef-8a4c-389992167880 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:44.498277 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7da587a5-40a5-48ef-8a4c-389992167880 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "DELETE /v2.0/security-groups/91e8cd34-2082-4604-9b4a-5995f7f0b0c6 HTTP/1.1" status: 204 len: 168 time: 0.1827314 Dec 09 21:52:44.511602 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7da587a5-40a5-48ef-8a4c-389992167880 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=91e8cd34-2082-4604-9b4a-5995f7f0b0c6,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:44.515555 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-0625e55d-ad54-4c7e-8c01-b94da3563ebc None None] Provisioning complete for port 920c449e-6a22-483f-95fa-c51b7b4c0846 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:44.516369 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0625e55d-ad54-4c7e-8c01-b94da3563ebc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:44.552137 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53876) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:44.581030 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-0625e55d-ad54-4c7e-8c01-b94da3563ebc None None] Port 920c449e-6a22-483f-95fa-c51b7b4c0846 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:52:44.753287 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5b1bd76-0d49-4dfd-a7a3-33eb1e903e51 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:44.901225 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3cf23fb-a56a-42f7-9c6d-2cf8e6ce72cf None None] Network 982ab6c6-e858-4907-9da8-7b116210104a requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:52:44.969134 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5b1bd76-0d49-4dfd-a7a3-33eb1e903e51 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:44.979575 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6519bbf9-b273-47c2-a42e-5bc086e721b7 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:45.026510 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b0fbe70a-dc41-4d9e-b87d-2182c02f0109 None None] Provisioning complete for port 27259ce3-53db-4b5e-b24d-ccd77e9b9e85 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:45.027392 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b0fbe70a-dc41-4d9e-b87d-2182c02f0109 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:45.188766 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 27259ce3-53db-4b5e-b24d-ccd77e9b9e85 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:52:45.194226 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b0fbe70a-dc41-4d9e-b87d-2182c02f0109 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:45.278900 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-b0fbe70a-dc41-4d9e-b87d-2182c02f0109 None None] For port 27259ce3-53db-4b5e-b24d-ccd77e9b9e85, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=27259ce3-53db-4b5e-b24d-ccd77e9b9e85,segment=NetworkSegment(2cf8af64-5fcd-450c-a642-55c17e8db111),segment_id=2cf8af64-5fcd-450c-a642-55c17e8db111)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:45.290432 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eff885e8-8e84-484a-b565-26acf0f98f08 req-f42eac86-925b-44ec-bbde-0cf85334a14a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:45.291200 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b0fbe70a-dc41-4d9e-b87d-2182c02f0109 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:45.292242 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eff885e8-8e84-484a-b565-26acf0f98f08 req-f42eac86-925b-44ec-bbde-0cf85334a14a tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 945 time: 0.1932349 Dec 09 21:52:45.366582 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0fbe70a-dc41-4d9e-b87d-2182c02f0109 None None] Pushing event updated for resources: {'Port': ['ID=27259ce3-53db-4b5e-b24d-ccd77e9b9e85,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:45.377746 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 27259ce3-53db-4b5e-b24d-ccd77e9b9e85 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:45.378677 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:45.388167 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eff885e8-8e84-484a-b565-26acf0f98f08 req-8847db6a-897c-4a43-b2ac-38aac23b05dc tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0878711 Dec 09 21:52:45.440022 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-93debc0c-634b-43a4-abd9-7e12b0fbc025 None None] Provisioning complete for port 27259ce3-53db-4b5e-b24d-ccd77e9b9e85 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:45.440545 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-93debc0c-634b-43a4-abd9-7e12b0fbc025 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:45.445737 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-6519bbf9-b273-47c2-a42e-5bc086e721b7 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Deleting port ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:52:45.446085 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6519bbf9-b273-47c2-a42e-5bc086e721b7 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:45.543780 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-6519bbf9-b273-47c2-a42e-5bc086e721b7 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] For port ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01,segment=NetworkSegment(dc0bd24b-5723-4625-bde4-525782b5f73e),segment_id=dc0bd24b-5723-4625-bde4-525782b5f73e)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:45.544150 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6519bbf9-b273-47c2-a42e-5bc086e721b7 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:45.558365 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-6519bbf9-b273-47c2-a42e-5bc086e721b7 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Calling delete_port for ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01 owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:52:45.558748 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe83c359-e266-44af-936d-99d45cf00172 req-4eecec56-fac9-4710-a6ea-940692df6f75 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:45.560317 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fe83c359-e266-44af-936d-99d45cf00172 req-4eecec56-fac9-4710-a6ea-940692df6f75 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 1097 time: 0.0696857 Dec 09 21:52:45.603796 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d5b1bd76-0d49-4dfd-a7a3-33eb1e903e51 admin admin] Router fed6ac4f-7897-4c4e-90bc-64c20cbfe82c is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:52:45.626684 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fe83c359-e266-44af-936d-99d45cf00172 req-70659e98-2d5f-4f03-99e2-f4953cd82737 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0558403 Dec 09 21:52:45.726740 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d5b1bd76-0d49-4dfd-a7a3-33eb1e903e51 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:52:45.736973 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] Sync routers for ids ['fed6ac4f-7897-4c4e-90bc-64c20cbfe82c'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:52:45.745997 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d5b1bd76-0d49-4dfd-a7a3-33eb1e903e51 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:45.746743 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] Routers {'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:52:45.747485 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d5b1bd76-0d49-4dfd-a7a3-33eb1e903e51 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 2.5272090 Dec 09 21:52:45.747728 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['fed6ac4f-7897-4c4e-90bc-64c20cbfe82c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:45.750547 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53882) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:45.768036 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6519bbf9-b273-47c2-a42e-5bc086e721b7 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:45.801584 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6519bbf9-b273-47c2-a42e-5bc086e721b7 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event deleted for resources: {'Port': ['ID=ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:46.003386 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6519bbf9-b273-47c2-a42e-5bc086e721b7 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:46.049963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 50c46228-45fd-43c8-9fd2-e6ae52717651 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:52:46.051918 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device a1e280f8-4599-42bc-9eec-7c9618c84471 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:52:46.079919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: a1e280f8-4599-42bc-9eec-7c9618c84471 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:52:46.080262 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device a1e280f8-4599-42bc-9eec-7c9618c84471 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:52:46.106456 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] Set router fed6ac4f-7897-4c4e-90bc-64c20cbfe82c gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:52:46.274715 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d78145c1-fc28-491e-bfa3-31e2dc2dd5c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:46.303014 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 50c46228-45fd-43c8-9fd2-e6ae52717651, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=50c46228-45fd-43c8-9fd2-e6ae52717651,segment=NetworkSegment(bbcc9b75-8c59-49b6-9441-82060a46e422),segment_id=bbcc9b75-8c59-49b6-9441-82060a46e422)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:46.324191 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '50c46228-45fd-43c8-9fd2-e6ae52717651', 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c', 'port_id': '50c46228-45fd-43c8-9fd2-e6ae52717651', 'mac_address': 'fa:16:3e:4f:df:b4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 112, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'df92f5f0-ea14-470b-bca7-c613b8daecf5', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:52:46.399933 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:46.418741 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 50c46228-45fd-43c8-9fd2-e6ae52717651 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:52:46.428440 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c', 'name': 'tempest-TestAggregatesBasicOps-1642153010-router', 'tenant_id': 'e1c29cd411134d0696683880e25d3ad6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.196'}], 'enable_snat': True}, 'gw_port_id': '920c449e-6a22-483f-95fa-c51b7b4c0846', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:43Z', 'updated_at': '2021-12-09T21:52:44Z', 'revision_number': 3, 'project_id': 'e1c29cd411134d0696683880e25d3ad6', 'gw_port': {'id': '920c449e-6a22-483f-95fa-c51b7b4c0846', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:2b:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3831, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:43Z', 'updated_at': '2021-12-09T21:52:44Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:46.467147 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] Checking router: fed6ac4f-7897-4c4e-90bc-64c20cbfe82c for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:52:46.467529 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] Updating router fed6ac4f-7897-4c4e-90bc-64c20cbfe82c port 920c449e-6a22-483f-95fa-c51b7b4c0846 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:52:46.471699 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 50c46228-45fd-43c8-9fd2-e6ae52717651, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=50c46228-45fd-43c8-9fd2-e6ae52717651,segment=NetworkSegment(bbcc9b75-8c59-49b6-9441-82060a46e422),segment_id=bbcc9b75-8c59-49b6-9441-82060a46e422)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:46.487565 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:46.518539 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-d78145c1-fc28-491e-bfa3-31e2dc2dd5c9 admin admin] Allocated IP 172.20.0.1 (982ab6c6-e858-4907-9da8-7b116210104a/ccc6c1d7-5b8e-4ddd-8a24-7c6dd0ffc5a1/69ef926f-d069-4c61-a267-f116dfe6923d) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:52:46.524812 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:46.559982 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d6800ab-e7df-400e-9402-29a99bd1d1c1 req-8cf02af2-cddc-42e2-bd24-9f89500d1aa7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:46.566050 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d6800ab-e7df-400e-9402-29a99bd1d1c1 req-8cf02af2-cddc-42e2-bd24-9f89500d1aa7 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 944 time: 0.0776045 Dec 09 21:52:46.574900 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=50c46228-45fd-43c8-9fd2-e6ae52717651,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:46.662690 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d78145c1-fc28-491e-bfa3-31e2dc2dd5c9 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:46.706213 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d78145c1-fc28-491e-bfa3-31e2dc2dd5c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:46.715394 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d6800ab-e7df-400e-9402-29a99bd1d1c1 req-1b860d2c-42c5-434c-b4f7-1c39872a9e7d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1074929 Dec 09 21:52:46.730093 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['50c46228-45fd-43c8-9fd2-e6ae52717651'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:52:46.763601 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d78145c1-fc28-491e-bfa3-31e2dc2dd5c9 admin admin] Network 982ab6c6-e858-4907-9da8-7b116210104a is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:52:46.766090 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6519bbf9-b273-47c2-a42e-5bc086e721b7 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Router ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:52:46.768281 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-d78145c1-fc28-491e-bfa3-31e2dc2dd5c9 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:52:46.770498 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d78145c1-fc28-491e-bfa3-31e2dc2dd5c9 admin admin] Pushing event updated for resources: {'Port': ['ID=69ef926f-d069-4c61-a267-f116dfe6923d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:46.776013 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d78145c1-fc28-491e-bfa3-31e2dc2dd5c9 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:52:46.848585 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d78145c1-fc28-491e-bfa3-31e2dc2dd5c9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:46.918181 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6519bbf9-b273-47c2-a42e-5bc086e721b7 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:52:46.936528 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f561657-003c-4164-9150-8a7a7fb056b6 None None] Sync routers for ids ['ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:52:46.942844 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6519bbf9-b273-47c2-a42e-5bc086e721b7 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "PUT /v2.0/routers/ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3871500 Dec 09 21:52:46.943384 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53888) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:46.957041 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f561657-003c-4164-9150-8a7a7fb056b6 None None] Routers {'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:52:46.961260 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2f561657-003c-4164-9150-8a7a7fb056b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:47.018704 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-1376c396-7420-46f1-a8ea-e19a4f724274 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Deleting subnet 6112c97b-e0b7-4ba1-8f0e-463e550e07f7 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:52:47.022500 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1376c396-7420-46f1-a8ea-e19a4f724274 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:47.036954 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:47.057681 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d78145c1-fc28-491e-bfa3-31e2dc2dd5c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:47.064961 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:47.094733 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1376c396-7420-46f1-a8ea-e19a4f724274 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:47.143047 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7681d488-4a0a-496c-9497-3bc342cc8d9b None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:52:47.153806 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c0d1782-a408-4f89-9e94-23eafb055ef8 None None] Pushing event updated for resources: {'Port': ['ID=920c449e-6a22-483f-95fa-c51b7b4c0846,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:47.157838 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] Attempting to bind port 920c449e-6a22-483f-95fa-c51b7b4c0846 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:52:47.158486 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] Attempting to bind port 920c449e-6a22-483f-95fa-c51b7b4c0846 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:52:47.158908 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] Attempting to bind port 920c449e-6a22-483f-95fa-c51b7b4c0846 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:52:47.176595 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 52, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:52:47.176971 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:52:47.178311 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:47.178311 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:52:47.178311 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] Bound port: 920c449e-6a22-483f-95fa-c51b7b4c0846, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:52:47.178673 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:47.210970 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-2f561657-003c-4164-9150-8a7a7fb056b6 None None] Set router ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:52:47.224797 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 27259ce3-53db-4b5e-b24d-ccd77e9b9e85 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:52:47.236713 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1376c396-7420-46f1-a8ea-e19a4f724274 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:47.306102 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-61cd60ce-0f7c-476e-acac-8052403c84ed None None] Provisioning complete for port 920c449e-6a22-483f-95fa-c51b7b4c0846 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:47.306509 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-61cd60ce-0f7c-476e-acac-8052403c84ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:47.322902 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] For port 920c449e-6a22-483f-95fa-c51b7b4c0846, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:52:47.324266 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1376c396-7420-46f1-a8ea-e19a4f724274 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:47.351907 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d78145c1-fc28-491e-bfa3-31e2dc2dd5c9 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:47.362332 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d78145c1-fc28-491e-bfa3-31e2dc2dd5c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:47.364424 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1376c396-7420-46f1-a8ea-e19a4f724274 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event deleted for resources: {'Subnet': ['ID=6112c97b-e0b7-4ba1-8f0e-463e550e07f7,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:47.366775 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1376c396-7420-46f1-a8ea-e19a4f724274 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:47.371090 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1376c396-7420-46f1-a8ea-e19a4f724274 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "DELETE /v2.0/subnets/6112c97b-e0b7-4ba1-8f0e-463e550e07f7 HTTP/1.1" status: 204 len: 168 time: 0.4269483 Dec 09 21:52:47.371695 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] For port 920c449e-6a22-483f-95fa-c51b7b4c0846, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=920c449e-6a22-483f-95fa-c51b7b4c0846,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:52:47.374035 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53890) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:47.385311 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-935a2979-9bf8-4fd0-a5d3-606edbf84268 None None] Network 5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:52:47.407071 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:47.409217 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-61cd60ce-0f7c-476e-acac-8052403c84ed None None] Port 920c449e-6a22-483f-95fa-c51b7b4c0846 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:52:47.457641 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d78145c1-fc28-491e-bfa3-31e2dc2dd5c9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:47.522556 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4820b9c9-99be-43d5-8f00-2f2e1b053263 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:52:47.534183 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 27259ce3-53db-4b5e-b24d-ccd77e9b9e85 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:47.534548 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:47.536215 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2f561657-003c-4164-9150-8a7a7fb056b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'name': 'tempest-TestNetworkBasicOps-router-421012370', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48'}], 'enable_snat': True}, 'gw_port_id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:32Z', 'updated_at': '2021-12-09T21:52:45Z', 'revision_number': 5, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:55:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3769, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:34Z', 'updated_at': '2021-12-09T21:51:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:47.548387 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a62b3911-c632-4bab-a053-4abe18c7bb05 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:47.552278 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d78145c1-fc28-491e-bfa3-31e2dc2dd5c9 admin admin] Pushing event updated for resources: {'Port': ['ID=69ef926f-d069-4c61-a267-f116dfe6923d,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:47.572391 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f561657-003c-4164-9150-8a7a7fb056b6 None None] Checking router: ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:52:47.582397 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f561657-003c-4164-9150-8a7a7fb056b6 None None] Routers {'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:52:47.583565 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2f561657-003c-4164-9150-8a7a7fb056b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:47.589237 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d78145c1-fc28-491e-bfa3-31e2dc2dd5c9 admin admin] Network 982ab6c6-e858-4907-9da8-7b116210104a is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:52:47.590785 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-d78145c1-fc28-491e-bfa3-31e2dc2dd5c9 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:52:47.610136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-61cd60ce-0f7c-476e-acac-8052403c84ed None None] Provisioning complete for port 69ef926f-d069-4c61-a267-f116dfe6923d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:47.610517 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-61cd60ce-0f7c-476e-acac-8052403c84ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:47.665700 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] Routers {'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:52:47.666365 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['fed6ac4f-7897-4c4e-90bc-64c20cbfe82c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:47.721152 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-2f561657-003c-4164-9150-8a7a7fb056b6 None None] Set router ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:52:47.738936 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a62b3911-c632-4bab-a053-4abe18c7bb05 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:47.761960 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d78145c1-fc28-491e-bfa3-31e2dc2dd5c9 admin admin] Router fed6ac4f-7897-4c4e-90bc-64c20cbfe82c has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:52:47.863194 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-a62b3911-c632-4bab-a053-4abe18c7bb05 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Deleting port 686c9484-e87b-44c7-bb33-f79163a23d69 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:52:47.868649 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a62b3911-c632-4bab-a053-4abe18c7bb05 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:47.871842 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] Set router fed6ac4f-7897-4c4e-90bc-64c20cbfe82c gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:52:47.963348 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c0d1782-a408-4f89-9e94-23eafb055ef8 None None] Pushing event updated for resources: {'Port': ['ID=920c449e-6a22-483f-95fa-c51b7b4c0846,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:47.974298 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 50c46228-45fd-43c8-9fd2-e6ae52717651 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:52:47.981044 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-61cd60ce-0f7c-476e-acac-8052403c84ed None None] Port 69ef926f-d069-4c61-a267-f116dfe6923d cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:52:47.989100 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2f561657-003c-4164-9150-8a7a7fb056b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'name': 'tempest-TestNetworkBasicOps-router-421012370', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48'}], 'enable_snat': True}, 'gw_port_id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:32Z', 'updated_at': '2021-12-09T21:52:45Z', 'revision_number': 5, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:55:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3769, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:34Z', 'updated_at': '2021-12-09T21:51:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:48.000702 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d78145c1-fc28-491e-bfa3-31e2dc2dd5c9 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:52:48.021027 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03241baa-d8ff-4bbf-bb89-ed3867ae764d req-7103294e-713b-415b-a09c-b2ae3f8c8f4e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:48.021027 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-03241baa-d8ff-4bbf-bb89-ed3867ae764d req-7103294e-713b-415b-a09c-b2ae3f8c8f4e tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 944 time: 0.1863222 Dec 09 21:52:48.026704 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2f561657-003c-4164-9150-8a7a7fb056b6 None None] The sync data for ids ['ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb'] in n-d-713301-27 is: [{'id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'name': 'tempest-TestNetworkBasicOps-router-421012370', 'tenant_id': 'e863bf78256945798e7c717c650258aa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48'}], 'enable_snat': True}, 'gw_port_id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:32Z', 'updated_at': '2021-12-09T21:52:45Z', 'revision_number': 5, 'project_id': 'e863bf78256945798e7c717c650258aa', 'gw_port': {'id': '686c9484-e87b-44c7-bb33-f79163a23d69', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:4a:55:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3769, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.48', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:34Z', 'updated_at': '2021-12-09T21:51:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:52:48.039868 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d78145c1-fc28-491e-bfa3-31e2dc2dd5c9 admin admin] 10.222.0.13 "PUT /v2.0/routers/fed6ac4f-7897-4c4e-90bc-64c20cbfe82c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2881045 Dec 09 21:52:48.077710 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-a62b3911-c632-4bab-a053-4abe18c7bb05 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] For port 686c9484-e87b-44c7-bb33-f79163a23d69, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=686c9484-e87b-44c7-bb33-f79163a23d69,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:48.078891 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a62b3911-c632-4bab-a053-4abe18c7bb05 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:48.102326 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-a62b3911-c632-4bab-a053-4abe18c7bb05 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Calling delete_port for 686c9484-e87b-44c7-bb33-f79163a23d69 owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:52:48.123390 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-03241baa-d8ff-4bbf-bb89-ed3867ae764d req-3d08d242-eabc-405c-b46f-baf149e59682 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0968671 Dec 09 21:52:48.172514 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53898) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:48.186387 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d221b7a0-8ba9-4846-acab-11cf828e0820 None None] Provisioning complete for port 920c449e-6a22-483f-95fa-c51b7b4c0846 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:48.186939 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d221b7a0-8ba9-4846-acab-11cf828e0820 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:48.253444 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-701bbdc5-f7b9-43f1-8cdf-4459ade52bce tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/floatingips/e7a2e8df-af1c-4df1-9f51-140291c8185b HTTP/1.1" status: 200 len: 992 time: 0.0820696 Dec 09 21:52:48.326900 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:48.400560 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a62b3911-c632-4bab-a053-4abe18c7bb05 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:48.492761 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a62b3911-c632-4bab-a053-4abe18c7bb05 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event deleted for resources: {'Port': ['ID=686c9484-e87b-44c7-bb33-f79163a23d69,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:48.559998 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9d6ae77a-36f0-4347-83ea-46d763b9726f None None] DHCP port deletion for 5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:52:48.566270 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ee138e0c-dba7-403c-b1ee-8a0ce05e3d29 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:52:48.574522 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a62b3911-c632-4bab-a053-4abe18c7bb05 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:48.612210 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: BUILD current_port_status: DOWN port_id 50c46228-45fd-43c8-9fd2-e6ae52717651 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:52:48.668461 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c', 'name': 'tempest-TestAggregatesBasicOps-1642153010-router', 'tenant_id': 'e1c29cd411134d0696683880e25d3ad6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.196'}], 'enable_snat': True}, 'gw_port_id': '920c449e-6a22-483f-95fa-c51b7b4c0846', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:43Z', 'updated_at': '2021-12-09T21:52:46Z', 'revision_number': 4, 'project_id': 'e1c29cd411134d0696683880e25d3ad6', 'gw_port': {'id': '920c449e-6a22-483f-95fa-c51b7b4c0846', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:2b:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3831, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:43Z', 'updated_at': '2021-12-09T21:52:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '69ef926f-d069-4c61-a267-f116dfe6923d', 'name': '', 'network_id': '982ab6c6-e858-4907-9da8-7b116210104a', 'tenant_id': 'e1c29cd411134d0696683880e25d3ad6', 'mac_address': 'fa:16:3e:43:c1:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c', 'device_owner': 'network:router_interface', 'standard_attr_id': 3832, 'fixed_ips': [{'subnet_id': 'ccc6c1d7-5b8e-4ddd-8a24-7c6dd0ffc5a1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:46Z', 'updated_at': '2021-12-09T21:52:47Z', 'revision_number': 2, 'project_id': 'e1c29cd411134d0696683880e25d3ad6', 'subnets': [{'id': 'ccc6c1d7-5b8e-4ddd-8a24-7c6dd0ffc5a1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:48.671887 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 50c46228-45fd-43c8-9fd2-e6ae52717651, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=50c46228-45fd-43c8-9fd2-e6ae52717651,segment=NetworkSegment(bbcc9b75-8c59-49b6-9441-82060a46e422),segment_id=bbcc9b75-8c59-49b6-9441-82060a46e422)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:48.708728 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a62b3911-c632-4bab-a053-4abe18c7bb05 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:48.710840 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a62b3911-c632-4bab-a053-4abe18c7bb05 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:48.712241 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:48.716742 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd9c137a-f138-4f36-8257-1a7567117d25 None None] The sync data for ids ['fed6ac4f-7897-4c4e-90bc-64c20cbfe82c'] in n-d-713301-27 is: [{'id': 'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c', 'name': 'tempest-TestAggregatesBasicOps-1642153010-router', 'tenant_id': 'e1c29cd411134d0696683880e25d3ad6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.196'}], 'enable_snat': True}, 'gw_port_id': '920c449e-6a22-483f-95fa-c51b7b4c0846', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:43Z', 'updated_at': '2021-12-09T21:52:46Z', 'revision_number': 4, 'project_id': 'e1c29cd411134d0696683880e25d3ad6', 'gw_port': {'id': '920c449e-6a22-483f-95fa-c51b7b4c0846', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:2b:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3831, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:43Z', 'updated_at': '2021-12-09T21:52:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '69ef926f-d069-4c61-a267-f116dfe6923d', 'name': '', 'network_id': '982ab6c6-e858-4907-9da8-7b116210104a', 'tenant_id': 'e1c29cd411134d0696683880e25d3ad6', 'mac_address': 'fa:16:3e:43:c1:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c', 'device_owner': 'network:router_interface', 'standard_attr_id': 3832, 'fixed_ips': [{'subnet_id': 'ccc6c1d7-5b8e-4ddd-8a24-7c6dd0ffc5a1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:46Z', 'updated_at': '2021-12-09T21:52:47Z', 'revision_number': 2, 'project_id': 'e1c29cd411134d0696683880e25d3ad6', 'subnets': [{'id': 'ccc6c1d7-5b8e-4ddd-8a24-7c6dd0ffc5a1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:52:48.719982 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d221b7a0-8ba9-4846-acab-11cf828e0820 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:48.732243 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53912) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:48.739977 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2ae63fdc-6d1c-4697-984f-54181e397b7f admin admin] Request body: {'network': {'name': 'tempest-TestAggregatesBasicOps-32586551-network', 'tenant_id': '21be760267124f1fa7d0bfc7d602fe2c'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:52:48.775060 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2ae63fdc-6d1c-4697-984f-54181e397b7f admin admin] Made reservation on behalf of 21be760267124f1fa7d0bfc7d602fe2c for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:52:48.777771 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ae63fdc-6d1c-4697-984f-54181e397b7f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:48.786574 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a62b3911-c632-4bab-a053-4abe18c7bb05 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:48.787279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-d221b7a0-8ba9-4846-acab-11cf828e0820 None None] For port 920c449e-6a22-483f-95fa-c51b7b4c0846, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=920c449e-6a22-483f-95fa-c51b7b4c0846,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:48.787671 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a62b3911-c632-4bab-a053-4abe18c7bb05 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Fanout notify agent at l3_agent the message router_deleted on router ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:52:48.795366 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d221b7a0-8ba9-4846-acab-11cf828e0820 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:48.797734 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a62b3911-c632-4bab-a053-4abe18c7bb05 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:48.799616 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=50c46228-45fd-43c8-9fd2-e6ae52717651,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:48.799753 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a62b3911-c632-4bab-a053-4abe18c7bb05 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "DELETE /v2.0/routers/ddc6ad02-70b7-4fc7-8ee1-4370e17a44fb HTTP/1.1" status: 204 len: 168 time: 1.4241490 Dec 09 21:52:48.808718 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9d6ae77a-36f0-4347-83ea-46d763b9726f None None] Deleting port 2a750c92-ff70-4d20-9026-400cbad85554 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:52:48.809098 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9d6ae77a-36f0-4347-83ea-46d763b9726f None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:48.810085 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53914) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:48.824506 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ae63fdc-6d1c-4697-984f-54181e397b7f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:48.869626 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d221b7a0-8ba9-4846-acab-11cf828e0820 None None] Provisioning complete for port 69ef926f-d069-4c61-a267-f116dfe6923d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:48.870004 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d221b7a0-8ba9-4846-acab-11cf828e0820 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:48.960219 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da1fd1ec-a981-45b9-b700-cb37c9e40bc2 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:48.990534 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-9d6ae77a-36f0-4347-83ea-46d763b9726f None None] For port 2a750c92-ff70-4d20-9026-400cbad85554, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2a750c92-ff70-4d20-9026-400cbad85554,segment=NetworkSegment(dc0bd24b-5723-4625-bde4-525782b5f73e),segment_id=dc0bd24b-5723-4625-bde4-525782b5f73e)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:48.991188 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9d6ae77a-36f0-4347-83ea-46d763b9726f None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:48.994066 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d221b7a0-8ba9-4846-acab-11cf828e0820 None None] Pushing event updated for resources: {'Port': ['ID=920c449e-6a22-483f-95fa-c51b7b4c0846,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:49.011522 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d221b7a0-8ba9-4846-acab-11cf828e0820 None None] Port 69ef926f-d069-4c61-a267-f116dfe6923d cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:52:49.013440 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9d6ae77a-36f0-4347-83ea-46d763b9726f None None] Calling delete_port for 2a750c92-ff70-4d20-9026-400cbad85554 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:52:49.021316 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ae63fdc-6d1c-4697-984f-54181e397b7f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:49.029495 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ae63fdc-6d1c-4697-984f-54181e397b7f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:49.075431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-da1fd1ec-a981-45b9-b700-cb37c9e40bc2 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Deleting port 2a750c92-ff70-4d20-9026-400cbad85554 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:52:49.076779 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da1fd1ec-a981-45b9-b700-cb37c9e40bc2 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:49.083318 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2ae63fdc-6d1c-4697-984f-54181e397b7f admin admin] vlan segment allocate from pool success with {'vlan_id': 137, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:52:49.158778 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9d6ae77a-36f0-4347-83ea-46d763b9726f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:49.170804 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ae63fdc-6d1c-4697-984f-54181e397b7f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=af521c3c-3c99-4b67-98df-23dfe79338c8,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:49.174696 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ae63fdc-6d1c-4697-984f-54181e397b7f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:49.175071 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-2ae63fdc-6d1c-4697-984f-54181e397b7f admin admin] Added segment aceca204-8e76-42cc-8d81-7615c906ebaa of type vlan for network 87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b Dec 09 21:52:49.181687 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d6ae77a-36f0-4347-83ea-46d763b9726f None None] No DVR routers for this DVR port 2a750c92-ff70-4d20-9026-400cbad85554 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:52:49.221879 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d6ae77a-36f0-4347-83ea-46d763b9726f None None] Pushing event deleted for resources: {'Port': ['ID=2a750c92-ff70-4d20-9026-400cbad85554,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:49.247216 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ae63fdc-6d1c-4697-984f-54181e397b7f admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:49.256938 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-da1fd1ec-a981-45b9-b700-cb37c9e40bc2 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] For port 2a750c92-ff70-4d20-9026-400cbad85554, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2a750c92-ff70-4d20-9026-400cbad85554,segment=NetworkSegment(dc0bd24b-5723-4625-bde4-525782b5f73e),segment_id=dc0bd24b-5723-4625-bde4-525782b5f73e)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:49.257308 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da1fd1ec-a981-45b9-b700-cb37c9e40bc2 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:49.279756 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-da1fd1ec-a981-45b9-b700-cb37c9e40bc2 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Calling delete_port for 2a750c92-ff70-4d20-9026-400cbad85554 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:52:49.299113 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ae63fdc-6d1c-4697-984f-54181e397b7f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:49.300888 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ae63fdc-6d1c-4697-984f-54181e397b7f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:49.302388 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ae63fdc-6d1c-4697-984f-54181e397b7f admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:49.352589 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2ae63fdc-6d1c-4697-984f-54181e397b7f admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.6179452 Dec 09 21:52:49.355526 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53924) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:49.363231 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-56227dc6-1489-44cb-800a-ac609fa1f236 admin admin] Request body: {'subnet': {'network_id': '87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestAggregatesBasicOps-32586551-subnet', 'tenant_id': '21be760267124f1fa7d0bfc7d602fe2c', 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:52:49.398789 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da1fd1ec-a981-45b9-b700-cb37c9e40bc2 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:49.402992 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ae63fdc-6d1c-4697-984f-54181e397b7f admin admin] Pushing event updated for resources: {'Network': ['ID=87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:49.416245 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:52:49.419363 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-56227dc6-1489-44cb-800a-ac609fa1f236 admin admin] Made reservation on behalf of 21be760267124f1fa7d0bfc7d602fe2c for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:52:49.425712 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56227dc6-1489-44cb-800a-ac609fa1f236 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:49.434605 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da1fd1ec-a981-45b9-b700-cb37c9e40bc2 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event deleted for resources: {'Port': ['ID=2a750c92-ff70-4d20-9026-400cbad85554,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:49.438632 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da1fd1ec-a981-45b9-b700-cb37c9e40bc2 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] No DVR routers for this DVR port 2a750c92-ff70-4d20-9026-400cbad85554 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:52:49.565205 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da1fd1ec-a981-45b9-b700-cb37c9e40bc2 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:49.595315 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2a750c92-ff70-4d20-9026-400cbad85554 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:52:49.616781 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-da1fd1ec-a981-45b9-b700-cb37c9e40bc2 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:49.626496 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 2a750c92-ff70-4d20-9026-400cbad85554 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:52:49.626496 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2a750c92-ff70-4d20-9026-400cbad85554 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:52:49.626496 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:52:49.628587 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-da1fd1ec-a981-45b9-b700-cb37c9e40bc2 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dc0bd24b-5723-4625-bde4-525782b5f73e') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:49.629569 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-da1fd1ec-a981-45b9-b700-cb37c9e40bc2 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dc0bd24b-5723-4625-bde4-525782b5f73e') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:49.641043 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da1fd1ec-a981-45b9-b700-cb37c9e40bc2 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:49.655902 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:52:49.656216 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device ddcdadc2-34b6-40a1-adc4-bb1fdc4bda01 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:52:49.666945 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da1fd1ec-a981-45b9-b700-cb37c9e40bc2 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:49.679359 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-da1fd1ec-a981-45b9-b700-cb37c9e40bc2 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Releasing vlan 144 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:52:49.679831 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da1fd1ec-a981-45b9-b700-cb37c9e40bc2 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:49.737745 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56227dc6-1489-44cb-800a-ac609fa1f236 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: self.session.flush() Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:52:49.757091 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:52:49.761004 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da1fd1ec-a981-45b9-b700-cb37c9e40bc2 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:49.766929 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da1fd1ec-a981-45b9-b700-cb37c9e40bc2 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:49.770507 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-da1fd1ec-a981-45b9-b700-cb37c9e40bc2 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] 10.222.0.13 "DELETE /v2.0/networks/5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3 HTTP/1.1" status: 204 len: 168 time: 0.9592085 Dec 09 21:52:49.785650 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da1fd1ec-a981-45b9-b700-cb37c9e40bc2 tempest-TestNetworkBasicOps-124592000 tempest-TestNetworkBasicOps-124592000-project] Pushing event deleted for resources: {'Network': ['ID=5e5a86b2-67af-4d9b-ba1b-2da4b872bdc3,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:49.842998 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56227dc6-1489-44cb-800a-ac609fa1f236 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1a66e0da-6b2f-4dd5-a0b6-4a8745999ff9,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:49.855774 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-56227dc6-1489-44cb-800a-ac609fa1f236 admin admin] Checking segment: {'id': 'aceca204-8e76-42cc-8d81-7615c906ebaa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:52:49.856142 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56227dc6-1489-44cb-800a-ac609fa1f236 admin admin] Network hostable DHCP agents. Network: 87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:52:49.878607 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56227dc6-1489-44cb-800a-ac609fa1f236 admin admin] Network 87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:52:49.895426 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-56227dc6-1489-44cb-800a-ac609fa1f236 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:52:49.916833 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03c52a63-65e8-4b91-adf6-40471304c391 None None] Network 87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:52:49.925009 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56227dc6-1489-44cb-800a-ac609fa1f236 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:49.925615 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-56227dc6-1489-44cb-800a-ac609fa1f236 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:49.950451 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 50c46228-45fd-43c8-9fd2-e6ae52717651 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:52:49.957706 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-56227dc6-1489-44cb-800a-ac609fa1f236 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.5993662 Dec 09 21:52:49.958649 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 53928) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:49.971634 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-6486c2fb-4b74-4bf7-bd65-333943b0f10a admin admin] Request body: {'router': {'name': 'tempest-TestAggregatesBasicOps-32586551-router', 'tenant_id': '21be760267124f1fa7d0bfc7d602fe2c', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:52:50.006921 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6486c2fb-4b74-4bf7-bd65-333943b0f10a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:50.009969 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6486c2fb-4b74-4bf7-bd65-333943b0f10a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:50.102669 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 50c46228-45fd-43c8-9fd2-e6ae52717651 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:50.103124 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:50.142558 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6486c2fb-4b74-4bf7-bd65-333943b0f10a admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:50.165763 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6dd9361a-9bb6-4f65-a2d0-7ea975ec3d66 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b', 'network_id': '87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b', 'project_id': '21be760267124f1fa7d0bfc7d602fe2c', 'fixed_ips': [{'subnet_id': '1a66e0da-6b2f-4dd5-a0b6-4a8745999ff9'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:52:50.166828 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6dd9361a-9bb6-4f65-a2d0-7ea975ec3d66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:50.214465 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53932) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:50.316741 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6486c2fb-4b74-4bf7-bd65-333943b0f10a admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:50.352188 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:50.413066 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cdcb1836-6369-4540-b4f2-07f714a9590f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '50c46228-45fd-43c8-9fd2-e6ae52717651'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:52:50.416262 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cb75cfe2-2c11-4aa1-915b-d791ed954097" -d '{"events": [{"server_uuid": "cdcb1836-6369-4540-b4f2-07f714a9590f", "name": "network-vif-plugged", "status": "completed", "tag": "50c46228-45fd-43c8-9fd2-e6ae52717651"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:52:50.440957 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 50c46228-45fd-43c8-9fd2-e6ae52717651, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=50c46228-45fd-43c8-9fd2-e6ae52717651,segment=NetworkSegment(bbcc9b75-8c59-49b6-9441-82060a46e422),segment_id=bbcc9b75-8c59-49b6-9441-82060a46e422)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:50.463565 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:50.496496 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d211cec6-8a8a-481c-8305-e11071b63edd admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e863bf78256945798e7c717c650258aa&name=default HTTP/1.1" status: 200 len: 3000 time: 0.2808042 Dec 09 21:52:50.498975 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53940) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:50.541021 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:52:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e4075c05-62da-4b0e-9d78-407dafa69abf x-openstack-request-id: req-e4075c05-62da-4b0e-9d78-407dafa69abf {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:52:50.541585 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cdcb1836-6369-4540-b4f2-07f714a9590f", "name": "network-vif-plugged", "status": "completed", "tag": "50c46228-45fd-43c8-9fd2-e6ae52717651", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:52:50.542121 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e4075c05-62da-4b0e-9d78-407dafa69abf {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:52:50.542680 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cdcb1836-6369-4540-b4f2-07f714a9590f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '50c46228-45fd-43c8-9fd2-e6ae52717651', 'code': 200} Dec 09 21:52:50.581133 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a0235a44-d895-4cec-b64e-a7e64a014d3c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:50.606876 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=50c46228-45fd-43c8-9fd2-e6ae52717651,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:50.618473 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a0235a44-d895-4cec-b64e-a7e64a014d3c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:50.630412 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6486c2fb-4b74-4bf7-bd65-333943b0f10a admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:50.636403 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-6dd9361a-9bb6-4f65-a2d0-7ea975ec3d66 None None] Allocated IP 172.20.0.2 (87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b/1a66e0da-6b2f-4dd5-a0b6-4a8745999ff9/20956168-e0b1-43c0-a98f-3fbf0c9ee9ed) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:52:50.662043 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6486c2fb-4b74-4bf7-bd65-333943b0f10a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:50.689504 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a0235a44-d895-4cec-b64e-a7e64a014d3c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:50.692716 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a0235a44-d895-4cec-b64e-a7e64a014d3c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:50.694158 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a0235a44-d895-4cec-b64e-a7e64a014d3c admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/06ad4920-6b5b-46e0-a62a-a31f5c7b2075 HTTP/1.1" status: 204 len: 168 time: 0.1940188 Dec 09 21:52:50.711773 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0235a44-d895-4cec-b64e-a7e64a014d3c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=06ad4920-6b5b-46e0-a62a-a31f5c7b2075,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:50.836296 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-6486c2fb-4b74-4bf7-bd65-333943b0f10a admin admin] Allocated IP 172.25.3.244 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/daaf4d44-9b33-4d88-9124-018dbc96289c) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:52:50.875840 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6dd9361a-9bb6-4f65-a2d0-7ea975ec3d66 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:50.888956 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6dd9361a-9bb6-4f65-a2d0-7ea975ec3d66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:50.944318 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6dd9361a-9bb6-4f65-a2d0-7ea975ec3d66 None None] Network 87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:52:50.949836 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-6dd9361a-9bb6-4f65-a2d0-7ea975ec3d66 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:52:50.952686 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6dd9361a-9bb6-4f65-a2d0-7ea975ec3d66 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:52:50.966007 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dd9361a-9bb6-4f65-a2d0-7ea975ec3d66 None None] Pushing event updated for resources: {'Port': ['ID=20956168-e0b1-43c0-a98f-3fbf0c9ee9ed,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:51.039099 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6dd9361a-9bb6-4f65-a2d0-7ea975ec3d66 None None] Attempting to bind port 20956168-e0b1-43c0-a98f-3fbf0c9ee9ed on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:52:51.039496 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6dd9361a-9bb6-4f65-a2d0-7ea975ec3d66 None None] Attempting to bind port 20956168-e0b1-43c0-a98f-3fbf0c9ee9ed by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'aceca204-8e76-42cc-8d81-7615c906ebaa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:52:51.039866 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6dd9361a-9bb6-4f65-a2d0-7ea975ec3d66 None None] Attempting to bind port 20956168-e0b1-43c0-a98f-3fbf0c9ee9ed on network 87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:52:51.045293 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6dd9361a-9bb6-4f65-a2d0-7ea975ec3d66 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 52, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:52:51.045652 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6dd9361a-9bb6-4f65-a2d0-7ea975ec3d66 None None] Checking segment: {'id': 'aceca204-8e76-42cc-8d81-7615c906ebaa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:52:51.046163 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6dd9361a-9bb6-4f65-a2d0-7ea975ec3d66 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:51.046566 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6dd9361a-9bb6-4f65-a2d0-7ea975ec3d66 None None] Bound using segment: {'id': 'aceca204-8e76-42cc-8d81-7615c906ebaa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:52:51.047036 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6dd9361a-9bb6-4f65-a2d0-7ea975ec3d66 None None] Bound port: 20956168-e0b1-43c0-a98f-3fbf0c9ee9ed, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aceca204-8e76-42cc-8d81-7615c906ebaa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:52:51.047408 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6dd9361a-9bb6-4f65-a2d0-7ea975ec3d66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:51.072401 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6486c2fb-4b74-4bf7-bd65-333943b0f10a admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:51.132762 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6486c2fb-4b74-4bf7-bd65-333943b0f10a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:51.154351 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6dd9361a-9bb6-4f65-a2d0-7ea975ec3d66 None None] For port 20956168-e0b1-43c0-a98f-3fbf0c9ee9ed, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:52:51.165090 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6dd9361a-9bb6-4f65-a2d0-7ea975ec3d66 None None] For port 20956168-e0b1-43c0-a98f-3fbf0c9ee9ed, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=20956168-e0b1-43c0-a98f-3fbf0c9ee9ed,segment=NetworkSegment(aceca204-8e76-42cc-8d81-7615c906ebaa),segment_id=aceca204-8e76-42cc-8d81-7615c906ebaa)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:52:51.174209 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6dd9361a-9bb6-4f65-a2d0-7ea975ec3d66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:51.246449 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6486c2fb-4b74-4bf7-bd65-333943b0f10a admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:52:51.248133 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 920c449e-6a22-483f-95fa-c51b7b4c0846 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:52:51.250856 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6486c2fb-4b74-4bf7-bd65-333943b0f10a admin admin] Pushing event updated for resources: {'Port': ['ID=daaf4d44-9b33-4d88-9124-018dbc96289c,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:51.277637 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-6486c2fb-4b74-4bf7-bd65-333943b0f10a admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:52:51.288104 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6486c2fb-4b74-4bf7-bd65-333943b0f10a admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:52:51.300612 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53946) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:51.327044 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cbc04a0d-e415-4c54-a7a8-f4d57b9cc00a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:51.340599 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bd181cb6-d1e0-4d18-bfe7-4ceba2e63934 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:52:51.401783 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dd9361a-9bb6-4f65-a2d0-7ea975ec3d66 None None] Pushing event updated for resources: {'Port': ['ID=20956168-e0b1-43c0-a98f-3fbf0c9ee9ed,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:51.428577 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 920c449e-6a22-483f-95fa-c51b7b4c0846 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:51.428953 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:51.515754 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-608dd570-6589-4044-8720-7f243ba9ecd2 None None] Provisioning complete for port daaf4d44-9b33-4d88-9124-018dbc96289c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:51.515754 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-608dd570-6589-4044-8720-7f243ba9ecd2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:51.530304 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cbc04a0d-e415-4c54-a7a8-f4d57b9cc00a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:51.538180 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cbc04a0d-e415-4c54-a7a8-f4d57b9cc00a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:51.585656 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbc04a0d-e415-4c54-a7a8-f4d57b9cc00a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d2a0dc2c-8bed-42d0-b114-20f6e85a5ff8,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:51.590936 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-608dd570-6589-4044-8720-7f243ba9ecd2 None None] Port daaf4d44-9b33-4d88-9124-018dbc96289c cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:52:51.613551 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 686c9484-e87b-44c7-bb33-f79163a23d69 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:52:51.637540 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 686c9484-e87b-44c7-bb33-f79163a23d69 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:52:51.637992 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 686c9484-e87b-44c7-bb33-f79163a23d69 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:52:51.677692 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cbc04a0d-e415-4c54-a7a8-f4d57b9cc00a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=b1a3c530a4954549b492df0ec37fbef1&name=default HTTP/1.1" status: 200 len: 3000 time: 0.3716955 Dec 09 21:52:51.681793 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53950) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:51.748808 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-53c1a5d5-232a-4db2-a8d9-2db1816c1fc9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:51.779036 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-53c1a5d5-232a-4db2-a8d9-2db1816c1fc9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:51.780029 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6486c2fb-4b74-4bf7-bd65-333943b0f10a admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:51.846404 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-53c1a5d5-232a-4db2-a8d9-2db1816c1fc9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:51.849626 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-53c1a5d5-232a-4db2-a8d9-2db1816c1fc9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:51.850917 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-53c1a5d5-232a-4db2-a8d9-2db1816c1fc9 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/d2a0dc2c-8bed-42d0-b114-20f6e85a5ff8 HTTP/1.1" status: 204 len: 168 time: 0.1680961 Dec 09 21:52:51.859890 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53c1a5d5-232a-4db2-a8d9-2db1816c1fc9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d2a0dc2c-8bed-42d0-b114-20f6e85a5ff8,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:52.009123 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6486c2fb-4b74-4bf7-bd65-333943b0f10a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:52.046448 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] Sync routers for ids ['fed6ac4f-7897-4c4e-90bc-64c20cbfe82c'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:52:52.058130 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] Routers {'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:52:52.058736 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['fed6ac4f-7897-4c4e-90bc-64c20cbfe82c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:52.149766 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6486c2fb-4b74-4bf7-bd65-333943b0f10a admin admin] Router 55c83978-4466-47ab-a39c-ada0ddbd1aa6 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:52:52.173298 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] Set router fed6ac4f-7897-4c4e-90bc-64c20cbfe82c gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:52:52.263536 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6486c2fb-4b74-4bf7-bd65-333943b0f10a admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:52:52.276778 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] Sync routers for ids ['55c83978-4466-47ab-a39c-ada0ddbd1aa6'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:52:52.283789 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6486c2fb-4b74-4bf7-bd65-333943b0f10a admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:52.287283 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 53962) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:52.288111 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6486c2fb-4b74-4bf7-bd65-333943b0f10a admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 2.3281350 Dec 09 21:52:52.290492 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] Routers {'55c83978-4466-47ab-a39c-ada0ddbd1aa6'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:52:52.291122 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['55c83978-4466-47ab-a39c-ada0ddbd1aa6'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:52.437264 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c', 'name': 'tempest-TestAggregatesBasicOps-1642153010-router', 'tenant_id': 'e1c29cd411134d0696683880e25d3ad6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.196'}], 'enable_snat': True}, 'gw_port_id': '920c449e-6a22-483f-95fa-c51b7b4c0846', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:43Z', 'updated_at': '2021-12-09T21:52:46Z', 'revision_number': 4, 'project_id': 'e1c29cd411134d0696683880e25d3ad6', 'gw_port': {'id': '920c449e-6a22-483f-95fa-c51b7b4c0846', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:2b:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3831, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:43Z', 'updated_at': '2021-12-09T21:52:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '69ef926f-d069-4c61-a267-f116dfe6923d', 'name': '', 'network_id': '982ab6c6-e858-4907-9da8-7b116210104a', 'tenant_id': 'e1c29cd411134d0696683880e25d3ad6', 'mac_address': 'fa:16:3e:43:c1:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c', 'device_owner': 'network:router_interface', 'standard_attr_id': 3832, 'fixed_ips': [{'subnet_id': 'ccc6c1d7-5b8e-4ddd-8a24-7c6dd0ffc5a1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:46Z', 'updated_at': '2021-12-09T21:52:47Z', 'revision_number': 2, 'project_id': 'e1c29cd411134d0696683880e25d3ad6', 'subnets': [{'id': 'ccc6c1d7-5b8e-4ddd-8a24-7c6dd0ffc5a1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:52.438695 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] Set router 55c83978-4466-47ab-a39c-ada0ddbd1aa6 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:52:52.521070 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] Checking router: fed6ac4f-7897-4c4e-90bc-64c20cbfe82c for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:52:52.521423 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] Updating router fed6ac4f-7897-4c4e-90bc-64c20cbfe82c port 69ef926f-d069-4c61-a267-f116dfe6923d binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:52:52.570881 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:52.821248 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55c83978-4466-47ab-a39c-ada0ddbd1aa6', 'name': 'tempest-TestAggregatesBasicOps-32586551-router', 'tenant_id': '21be760267124f1fa7d0bfc7d602fe2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.244'}], 'enable_snat': True}, 'gw_port_id': 'daaf4d44-9b33-4d88-9124-018dbc96289c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:50Z', 'updated_at': '2021-12-09T21:52:51Z', 'revision_number': 3, 'project_id': '21be760267124f1fa7d0bfc7d602fe2c', 'gw_port': {'id': 'daaf4d44-9b33-4d88-9124-018dbc96289c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:b1:1b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55c83978-4466-47ab-a39c-ada0ddbd1aa6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3843, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.244', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:50Z', 'updated_at': '2021-12-09T21:52:50Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:52.861303 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] Checking router: 55c83978-4466-47ab-a39c-ada0ddbd1aa6 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:52:52.861706 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] Updating router 55c83978-4466-47ab-a39c-ada0ddbd1aa6 port daaf4d44-9b33-4d88-9124-018dbc96289c binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:52:52.894029 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:53.002494 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad7f9dc9-7335-45bc-88a5-3e04b334b71e None None] Network 87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:52:53.043326 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f849a91d-7f60-4a5a-a909-c5d1abbfdd87 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:53.315378 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-f849a91d-7f60-4a5a-a909-c5d1abbfdd87 admin admin] Allocated IP 172.20.0.1 (87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b/1a66e0da-6b2f-4dd5-a0b6-4a8745999ff9/398483e4-55ee-4535-80eb-ee84849f56c3) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:52:53.350039 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:53.359231 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:53.390490 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 20956168-e0b1-43c0-a98f-3fbf0c9ee9ed up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:52:53.418495 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] Attempting to bind port daaf4d44-9b33-4d88-9124-018dbc96289c on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:52:53.418879 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] Attempting to bind port daaf4d44-9b33-4d88-9124-018dbc96289c by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:52:53.419281 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] Attempting to bind port daaf4d44-9b33-4d88-9124-018dbc96289c on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:52:53.429171 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 52, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:52:53.430126 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:52:53.430454 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:53.430844 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:52:53.431674 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] Bound port: daaf4d44-9b33-4d88-9124-018dbc96289c, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:52:53.432256 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:53.433761 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b7e05bab-4b86-4890-ab7a-6141ecbaea79 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:52:53.451778 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5ff7aede-c4f8-4855-aab2-8ae43443cc81 None None] Provisioning complete for port 20956168-e0b1-43c0-a98f-3fbf0c9ee9ed triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:53.452514 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5ff7aede-c4f8-4855-aab2-8ae43443cc81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:53.499717 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] For port daaf4d44-9b33-4d88-9124-018dbc96289c, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:52:53.501946 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:53.504211 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] For port daaf4d44-9b33-4d88-9124-018dbc96289c, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=daaf4d44-9b33-4d88-9124-018dbc96289c,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:52:53.518557 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:53.522769 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd8b4e83-d860-40ca-b225-45059f3452a5 None None] Pushing event updated for resources: {'Port': ['ID=daaf4d44-9b33-4d88-9124-018dbc96289c,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:53.525762 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:53.534181 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8b4e83-d860-40ca-b225-45059f3452a5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.534528 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8b4e83-d860-40ca-b225-45059f3452a5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.534910 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8b4e83-d860-40ca-b225-45059f3452a5 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.535330 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8b4e83-d860-40ca-b225-45059f3452a5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.535702 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8b4e83-d860-40ca-b225-45059f3452a5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.536526 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8b4e83-d860-40ca-b225-45059f3452a5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.537111 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8b4e83-d860-40ca-b225-45059f3452a5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.537600 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8b4e83-d860-40ca-b225-45059f3452a5 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.538085 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8b4e83-d860-40ca-b225-45059f3452a5 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.538590 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8b4e83-d860-40ca-b225-45059f3452a5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.539074 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8b4e83-d860-40ca-b225-45059f3452a5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.539597 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8b4e83-d860-40ca-b225-45059f3452a5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.540272 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd8b4e83-d860-40ca-b225-45059f3452a5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.581159 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd099d05-bf62-44f3-ac31-55c811bc55c1 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:52:53.586498 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] Routers {'55c83978-4466-47ab-a39c-ada0ddbd1aa6'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:52:53.587359 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['55c83978-4466-47ab-a39c-ada0ddbd1aa6'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:53.598214 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f849a91d-7f60-4a5a-a909-c5d1abbfdd87 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:53.663050 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22fcbc05-90e3-4dbb-bbc2-432a554e913e None None] Pushing event updated for resources: {'Port': ['ID=69ef926f-d069-4c61-a267-f116dfe6923d,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:53.711921 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] Set router 55c83978-4466-47ab-a39c-ada0ddbd1aa6 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:52:53.722193 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f849a91d-7f60-4a5a-a909-c5d1abbfdd87 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:53.771956 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22fcbc05-90e3-4dbb-bbc2-432a554e913e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.772682 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22fcbc05-90e3-4dbb-bbc2-432a554e913e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.773397 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22fcbc05-90e3-4dbb-bbc2-432a554e913e None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.773943 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22fcbc05-90e3-4dbb-bbc2-432a554e913e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.774532 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22fcbc05-90e3-4dbb-bbc2-432a554e913e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.774916 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22fcbc05-90e3-4dbb-bbc2-432a554e913e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.775280 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22fcbc05-90e3-4dbb-bbc2-432a554e913e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.775754 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22fcbc05-90e3-4dbb-bbc2-432a554e913e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.776079 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22fcbc05-90e3-4dbb-bbc2-432a554e913e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.776450 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22fcbc05-90e3-4dbb-bbc2-432a554e913e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.776979 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22fcbc05-90e3-4dbb-bbc2-432a554e913e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.779135 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22fcbc05-90e3-4dbb-bbc2-432a554e913e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.779547 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22fcbc05-90e3-4dbb-bbc2-432a554e913e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:52:53.829411 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 20956168-e0b1-43c0-a98f-3fbf0c9ee9ed triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:53.829785 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:53.831792 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f849a91d-7f60-4a5a-a909-c5d1abbfdd87 admin admin] Network 87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:52:53.840636 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-f849a91d-7f60-4a5a-a909-c5d1abbfdd87 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:52:53.858030 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5ff7aede-c4f8-4855-aab2-8ae43443cc81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:53.883883 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f849a91d-7f60-4a5a-a909-c5d1abbfdd87 admin admin] Pushing event updated for resources: {'Port': ['ID=398483e4-55ee-4535-80eb-ee84849f56c3,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:53.891833 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f849a91d-7f60-4a5a-a909-c5d1abbfdd87 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:52:53.909733 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] Attempting to bind port 69ef926f-d069-4c61-a267-f116dfe6923d on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:52:53.910118 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] Attempting to bind port 69ef926f-d069-4c61-a267-f116dfe6923d by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '2cf8af64-5fcd-450c-a642-55c17e8db111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '982ab6c6-e858-4907-9da8-7b116210104a'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:52:53.910486 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] Attempting to bind port 69ef926f-d069-4c61-a267-f116dfe6923d on network 982ab6c6-e858-4907-9da8-7b116210104a {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:52:53.940313 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 52, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:52:53.940692 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] Checking segment: {'id': '2cf8af64-5fcd-450c-a642-55c17e8db111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '982ab6c6-e858-4907-9da8-7b116210104a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:52:53.941095 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:53.941493 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] Bound using segment: {'id': '2cf8af64-5fcd-450c-a642-55c17e8db111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '982ab6c6-e858-4907-9da8-7b116210104a'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:52:53.941982 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] Bound port: 69ef926f-d069-4c61-a267-f116dfe6923d, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2cf8af64-5fcd-450c-a642-55c17e8db111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 132, 'network_id': '982ab6c6-e858-4907-9da8-7b116210104a'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:52:53.942368 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:53.992053 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f849a91d-7f60-4a5a-a909-c5d1abbfdd87 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:54.028918 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-5ff7aede-c4f8-4855-aab2-8ae43443cc81 None None] For port 20956168-e0b1-43c0-a98f-3fbf0c9ee9ed, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=20956168-e0b1-43c0-a98f-3fbf0c9ee9ed,segment=NetworkSegment(aceca204-8e76-42cc-8d81-7615c906ebaa),segment_id=aceca204-8e76-42cc-8d81-7615c906ebaa)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:54.042492 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd8b4e83-d860-40ca-b225-45059f3452a5 None None] Pushing event updated for resources: {'Port': ['ID=daaf4d44-9b33-4d88-9124-018dbc96289c,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:54.095652 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5ff7aede-c4f8-4855-aab2-8ae43443cc81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:54.210534 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55c83978-4466-47ab-a39c-ada0ddbd1aa6', 'name': 'tempest-TestAggregatesBasicOps-32586551-router', 'tenant_id': '21be760267124f1fa7d0bfc7d602fe2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.244'}], 'enable_snat': True}, 'gw_port_id': 'daaf4d44-9b33-4d88-9124-018dbc96289c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:50Z', 'updated_at': '2021-12-09T21:52:51Z', 'revision_number': 3, 'project_id': '21be760267124f1fa7d0bfc7d602fe2c', 'gw_port': {'id': 'daaf4d44-9b33-4d88-9124-018dbc96289c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:b1:1b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55c83978-4466-47ab-a39c-ada0ddbd1aa6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3843, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.244', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:50Z', 'updated_at': '2021-12-09T21:52:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:54.247929 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] For port 69ef926f-d069-4c61-a267-f116dfe6923d, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:52:54.262771 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f849a91d-7f60-4a5a-a909-c5d1abbfdd87 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:54.286512 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-586c92be-4a75-4f88-93fd-1143b4b1ad5e None None] The sync data for ids ['55c83978-4466-47ab-a39c-ada0ddbd1aa6'] in n-d-713301-27 is: [{'id': '55c83978-4466-47ab-a39c-ada0ddbd1aa6', 'name': 'tempest-TestAggregatesBasicOps-32586551-router', 'tenant_id': '21be760267124f1fa7d0bfc7d602fe2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.244'}], 'enable_snat': True}, 'gw_port_id': 'daaf4d44-9b33-4d88-9124-018dbc96289c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:50Z', 'updated_at': '2021-12-09T21:52:51Z', 'revision_number': 3, 'project_id': '21be760267124f1fa7d0bfc7d602fe2c', 'gw_port': {'id': 'daaf4d44-9b33-4d88-9124-018dbc96289c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:b1:1b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55c83978-4466-47ab-a39c-ada0ddbd1aa6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3843, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.244', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:50Z', 'updated_at': '2021-12-09T21:52:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:52:54.352838 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] For port 69ef926f-d069-4c61-a267-f116dfe6923d, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=69ef926f-d069-4c61-a267-f116dfe6923d,segment=NetworkSegment(2cf8af64-5fcd-450c-a642-55c17e8db111),segment_id=2cf8af64-5fcd-450c-a642-55c17e8db111)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:52:54.356802 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ff7aede-c4f8-4855-aab2-8ae43443cc81 None None] Pushing event updated for resources: {'Port': ['ID=20956168-e0b1-43c0-a98f-3fbf0c9ee9ed,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:54.364069 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:54.415021 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e285544c-7ec8-4b34-968e-c5a28e3af20e None None] Provisioning complete for port daaf4d44-9b33-4d88-9124-018dbc96289c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:54.416047 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e285544c-7ec8-4b34-968e-c5a28e3af20e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:54.489798 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22fcbc05-90e3-4dbb-bbc2-432a554e913e None None] Pushing event updated for resources: {'Port': ['ID=69ef926f-d069-4c61-a267-f116dfe6923d,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:54.520779 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] Routers {'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:52:54.521806 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['fed6ac4f-7897-4c4e-90bc-64c20cbfe82c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:54.670121 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f849a91d-7f60-4a5a-a909-c5d1abbfdd87 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:54.686521 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f849a91d-7f60-4a5a-a909-c5d1abbfdd87 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:54.817977 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f849a91d-7f60-4a5a-a909-c5d1abbfdd87 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:54.823582 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f849a91d-7f60-4a5a-a909-c5d1abbfdd87 admin admin] Pushing event updated for resources: {'Port': ['ID=398483e4-55ee-4535-80eb-ee84849f56c3,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:54.866655 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] Set router fed6ac4f-7897-4c4e-90bc-64c20cbfe82c gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:52:54.927831 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e285544c-7ec8-4b34-968e-c5a28e3af20e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:54.984760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f849a91d-7f60-4a5a-a909-c5d1abbfdd87 admin admin] Network 87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:52:54.986479 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-f849a91d-7f60-4a5a-a909-c5d1abbfdd87 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:52:55.015834 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e285544c-7ec8-4b34-968e-c5a28e3af20e None None] For port daaf4d44-9b33-4d88-9124-018dbc96289c, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=daaf4d44-9b33-4d88-9124-018dbc96289c,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:55.045178 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e285544c-7ec8-4b34-968e-c5a28e3af20e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:55.226497 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e285544c-7ec8-4b34-968e-c5a28e3af20e None None] Provisioning complete for port 69ef926f-d069-4c61-a267-f116dfe6923d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:55.229048 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e285544c-7ec8-4b34-968e-c5a28e3af20e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:55.281603 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f849a91d-7f60-4a5a-a909-c5d1abbfdd87 admin admin] Router 55c83978-4466-47ab-a39c-ada0ddbd1aa6 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:52:55.330870 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e285544c-7ec8-4b34-968e-c5a28e3af20e None None] Pushing event updated for resources: {'Port': ['ID=daaf4d44-9b33-4d88-9124-018dbc96289c,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:55.394754 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device daaf4d44-9b33-4d88-9124-018dbc96289c up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:52:55.504602 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f849a91d-7f60-4a5a-a909-c5d1abbfdd87 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:52:55.526188 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f849a91d-7f60-4a5a-a909-c5d1abbfdd87 admin admin] 10.222.0.13 "PUT /v2.0/routers/55c83978-4466-47ab-a39c-ada0ddbd1aa6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2300940 Dec 09 21:52:55.574869 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e285544c-7ec8-4b34-968e-c5a28e3af20e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:55.626674 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e285544c-7ec8-4b34-968e-c5a28e3af20e None None] For port 69ef926f-d069-4c61-a267-f116dfe6923d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=69ef926f-d069-4c61-a267-f116dfe6923d,segment=NetworkSegment(2cf8af64-5fcd-450c-a642-55c17e8db111),segment_id=2cf8af64-5fcd-450c-a642-55c17e8db111)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:55.637705 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e285544c-7ec8-4b34-968e-c5a28e3af20e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:55.670454 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c', 'name': 'tempest-TestAggregatesBasicOps-1642153010-router', 'tenant_id': 'e1c29cd411134d0696683880e25d3ad6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.196'}], 'enable_snat': True}, 'gw_port_id': '920c449e-6a22-483f-95fa-c51b7b4c0846', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:43Z', 'updated_at': '2021-12-09T21:52:46Z', 'revision_number': 4, 'project_id': 'e1c29cd411134d0696683880e25d3ad6', 'gw_port': {'id': '920c449e-6a22-483f-95fa-c51b7b4c0846', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:2b:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3831, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:43Z', 'updated_at': '2021-12-09T21:52:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '69ef926f-d069-4c61-a267-f116dfe6923d', 'name': '', 'network_id': '982ab6c6-e858-4907-9da8-7b116210104a', 'tenant_id': 'e1c29cd411134d0696683880e25d3ad6', 'mac_address': 'fa:16:3e:43:c1:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c', 'device_owner': 'network:router_interface', 'standard_attr_id': 3832, 'fixed_ips': [{'subnet_id': 'ccc6c1d7-5b8e-4ddd-8a24-7c6dd0ffc5a1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:46Z', 'updated_at': '2021-12-09T21:52:54Z', 'revision_number': 4, 'project_id': 'e1c29cd411134d0696683880e25d3ad6', 'subnets': [{'id': 'ccc6c1d7-5b8e-4ddd-8a24-7c6dd0ffc5a1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:55.711008 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e60deee-4dc6-46ff-b99a-a2f3bb4503ce None None] The sync data for ids ['fed6ac4f-7897-4c4e-90bc-64c20cbfe82c'] in n-d-713301-27 is: [{'id': 'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c', 'name': 'tempest-TestAggregatesBasicOps-1642153010-router', 'tenant_id': 'e1c29cd411134d0696683880e25d3ad6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.196'}], 'enable_snat': True}, 'gw_port_id': '920c449e-6a22-483f-95fa-c51b7b4c0846', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:43Z', 'updated_at': '2021-12-09T21:52:46Z', 'revision_number': 4, 'project_id': 'e1c29cd411134d0696683880e25d3ad6', 'gw_port': {'id': '920c449e-6a22-483f-95fa-c51b7b4c0846', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:2b:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3831, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:43Z', 'updated_at': '2021-12-09T21:52:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '69ef926f-d069-4c61-a267-f116dfe6923d', 'name': '', 'network_id': '982ab6c6-e858-4907-9da8-7b116210104a', 'tenant_id': 'e1c29cd411134d0696683880e25d3ad6', 'mac_address': 'fa:16:3e:43:c1:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c', 'device_owner': 'network:router_interface', 'standard_attr_id': 3832, 'fixed_ips': [{'subnet_id': 'ccc6c1d7-5b8e-4ddd-8a24-7c6dd0ffc5a1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:46Z', 'updated_at': '2021-12-09T21:52:54Z', 'revision_number': 4, 'project_id': 'e1c29cd411134d0696683880e25d3ad6', 'subnets': [{'id': 'ccc6c1d7-5b8e-4ddd-8a24-7c6dd0ffc5a1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:52:55.716993 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port daaf4d44-9b33-4d88-9124-018dbc96289c triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:55.717367 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:55.797562 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e285544c-7ec8-4b34-968e-c5a28e3af20e None None] Pushing event updated for resources: {'Port': ['ID=69ef926f-d069-4c61-a267-f116dfe6923d,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:55.812724 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-64c894c0-a06d-4f46-aa98-9046e4b77ae7 None None] Provisioning complete for port 398483e4-55ee-4535-80eb-ee84849f56c3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:55.813092 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-64c894c0-a06d-4f46-aa98-9046e4b77ae7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:55.892940 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-64c894c0-a06d-4f46-aa98-9046e4b77ae7 None None] Port 398483e4-55ee-4535-80eb-ee84849f56c3 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:52:55.922881 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 20956168-e0b1-43c0-a98f-3fbf0c9ee9ed up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:52:55.946199 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-64c894c0-a06d-4f46-aa98-9046e4b77ae7 None None] Provisioning complete for port 20956168-e0b1-43c0-a98f-3fbf0c9ee9ed triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:55.946739 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-64c894c0-a06d-4f46-aa98-9046e4b77ae7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:56.021008 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 20956168-e0b1-43c0-a98f-3fbf0c9ee9ed triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:56.021409 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:56.045600 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54022) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:56.052557 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c7965c86-240a-4208-9644-22dbdcb5d140 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Request body: {'network': {'name': 'tempest-network-smoke--72850682', 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'port_security_enabled': True}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:52:56.081939 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c7965c86-240a-4208-9644-22dbdcb5d140 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Made reservation on behalf of 594fec82d9ab4e97a76f8c869f0bbcf0 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:52:56.085674 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7965c86-240a-4208-9644-22dbdcb5d140 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:56.095886 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7965c86-240a-4208-9644-22dbdcb5d140 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:56.150583 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-64c894c0-a06d-4f46-aa98-9046e4b77ae7 None None] Provisioning complete for port 69ef926f-d069-4c61-a267-f116dfe6923d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:56.150953 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-64c894c0-a06d-4f46-aa98-9046e4b77ae7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:56.218095 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7965c86-240a-4208-9644-22dbdcb5d140 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:56.226370 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7965c86-240a-4208-9644-22dbdcb5d140 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:56.318767 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c7965c86-240a-4208-9644-22dbdcb5d140 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] vlan segment allocate from pool success with {'vlan_id': 145, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:52:56.349017 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7965c86-240a-4208-9644-22dbdcb5d140 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9149939d-106b-4547-b858-03ff611467ff,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:56.372354 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7965c86-240a-4208-9644-22dbdcb5d140 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:56.373016 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-c7965c86-240a-4208-9644-22dbdcb5d140 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Added segment c1baef7b-1212-4007-90e6-bd8d9f348b6f of type vlan for network bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2 Dec 09 21:52:56.435728 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7965c86-240a-4208-9644-22dbdcb5d140 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:56.482797 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 69ef926f-d069-4c61-a267-f116dfe6923d up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:52:56.501125 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7965c86-240a-4208-9644-22dbdcb5d140 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:56.508962 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c7965c86-240a-4208-9644-22dbdcb5d140 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:56.509606 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c7965c86-240a-4208-9644-22dbdcb5d140 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:56.593738 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7965c86-240a-4208-9644-22dbdcb5d140 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event updated for resources: {'Network': ['ID=bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:56.620492 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:52:56.644826 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c7965c86-240a-4208-9644-22dbdcb5d140 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 767 time: 0.5972784 Dec 09 21:52:56.649631 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54042) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:56.654935 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-f0475a9e-ca94-4ff4-bc98-4c62ff3c9b4a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Request body: {'router': {'name': 'tempest-TestSecurityGroupsBasicOps-router-551544193', 'admin_state_up': True, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:52:56.691733 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0475a9e-ca94-4ff4-bc98-4c62ff3c9b4a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:56.693177 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0475a9e-ca94-4ff4-bc98-4c62ff3c9b4a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:56.735271 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 69ef926f-d069-4c61-a267-f116dfe6923d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:56.735671 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:56.771968 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0475a9e-ca94-4ff4-bc98-4c62ff3c9b4a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:56.974228 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0475a9e-ca94-4ff4-bc98-4c62ff3c9b4a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:57.129980 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device daaf4d44-9b33-4d88-9124-018dbc96289c up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:52:57.203635 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port daaf4d44-9b33-4d88-9124-018dbc96289c triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:57.204188 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:57.276168 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0475a9e-ca94-4ff4-bc98-4c62ff3c9b4a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:57.280583 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] Sync routers for ids ['55c83978-4466-47ab-a39c-ada0ddbd1aa6'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:52:57.294675 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] Routers {'55c83978-4466-47ab-a39c-ada0ddbd1aa6'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:52:57.295833 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['55c83978-4466-47ab-a39c-ada0ddbd1aa6'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:57.298883 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0475a9e-ca94-4ff4-bc98-4c62ff3c9b4a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:57.331875 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54070) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:57.388043 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:57.428485 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-f0475a9e-ca94-4ff4-bc98-4c62ff3c9b4a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Allocated IP 172.25.3.173 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/fb327925-1394-41b3-b56e-d10fa9a24586) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:52:57.432104 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 69ef926f-d069-4c61-a267-f116dfe6923d up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:52:57.489318 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] Set router 55c83978-4466-47ab-a39c-ada0ddbd1aa6 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:52:57.561100 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0475a9e-ca94-4ff4-bc98-4c62ff3c9b4a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:57.600839 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0475a9e-ca94-4ff4-bc98-4c62ff3c9b4a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:57.647049 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f0475a9e-ca94-4ff4-bc98-4c62ff3c9b4a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:52:57.652716 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-f0475a9e-ca94-4ff4-bc98-4c62ff3c9b4a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:52:57.668177 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f0475a9e-ca94-4ff4-bc98-4c62ff3c9b4a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:52:57.683418 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-78d3ac9e-b7f5-4eee-9278-fbdb3696bf6b None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:52:57.693233 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:57.709747 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 69ef926f-d069-4c61-a267-f116dfe6923d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:57.710378 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:57.730354 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0475a9e-ca94-4ff4-bc98-4c62ff3c9b4a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event updated for resources: {'Port': ['ID=fb327925-1394-41b3-b56e-d10fa9a24586,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:57.878126 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-47d7e430-aba1-4e7d-bc33-ba27d3eba79c None None] Provisioning complete for port fb327925-1394-41b3-b56e-d10fa9a24586 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:57.879394 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-47d7e430-aba1-4e7d-bc33-ba27d3eba79c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:57.978835 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55c83978-4466-47ab-a39c-ada0ddbd1aa6', 'name': 'tempest-TestAggregatesBasicOps-32586551-router', 'tenant_id': '21be760267124f1fa7d0bfc7d602fe2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.244'}], 'enable_snat': True}, 'gw_port_id': 'daaf4d44-9b33-4d88-9124-018dbc96289c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:50Z', 'updated_at': '2021-12-09T21:52:54Z', 'revision_number': 4, 'project_id': '21be760267124f1fa7d0bfc7d602fe2c', 'gw_port': {'id': 'daaf4d44-9b33-4d88-9124-018dbc96289c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:b1:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55c83978-4466-47ab-a39c-ada0ddbd1aa6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3843, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.244', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:50Z', 'updated_at': '2021-12-09T21:52:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '398483e4-55ee-4535-80eb-ee84849f56c3', 'name': '', 'network_id': '87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b', 'tenant_id': '21be760267124f1fa7d0bfc7d602fe2c', 'mac_address': 'fa:16:3e:5a:16:b7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55c83978-4466-47ab-a39c-ada0ddbd1aa6', 'device_owner': 'network:router_interface', 'standard_attr_id': 3849, 'fixed_ips': [{'subnet_id': '1a66e0da-6b2f-4dd5-a0b6-4a8745999ff9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:53Z', 'updated_at': '2021-12-09T21:52:54Z', 'revision_number': 2, 'project_id': '21be760267124f1fa7d0bfc7d602fe2c', 'subnets': [{'id': '1a66e0da-6b2f-4dd5-a0b6-4a8745999ff9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:57.980909 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-47d7e430-aba1-4e7d-bc33-ba27d3eba79c None None] Port fb327925-1394-41b3-b56e-d10fa9a24586 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:52:58.017779 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] Checking router: 55c83978-4466-47ab-a39c-ada0ddbd1aa6 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:52:58.018630 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] Updating router 55c83978-4466-47ab-a39c-ada0ddbd1aa6 port 398483e4-55ee-4535-80eb-ee84849f56c3 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:52:58.063002 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:58.294133 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1de9dfd7-0a9e-45c3-a462-7e3added0837 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:58.465364 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:58.472318 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:58.551093 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76ea5f69-dfa5-437b-bdac-203a54b1aff3 None None] Pushing event updated for resources: {'Port': ['ID=398483e4-55ee-4535-80eb-ee84849f56c3,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:58.577396 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0475a9e-ca94-4ff4-bc98-4c62ff3c9b4a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:58.590586 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] Attempting to bind port 398483e4-55ee-4535-80eb-ee84849f56c3 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:52:58.590961 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] Attempting to bind port 398483e4-55ee-4535-80eb-ee84849f56c3 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'aceca204-8e76-42cc-8d81-7615c906ebaa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:52:58.591394 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] Attempting to bind port 398483e4-55ee-4535-80eb-ee84849f56c3 on network 87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:52:58.597659 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 52, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:52:58.598035 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] Checking segment: {'id': 'aceca204-8e76-42cc-8d81-7615c906ebaa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:52:58.598441 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:58.598846 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] Bound using segment: {'id': 'aceca204-8e76-42cc-8d81-7615c906ebaa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:52:58.599488 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] Bound port: 398483e4-55ee-4535-80eb-ee84849f56c3, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aceca204-8e76-42cc-8d81-7615c906ebaa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 137, 'network_id': '87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:52:58.600158 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:58.604287 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1de9dfd7-0a9e-45c3-a462-7e3added0837 admin admin] Deleting port 69ef926f-d069-4c61-a267-f116dfe6923d {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:52:58.605420 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1de9dfd7-0a9e-45c3-a462-7e3added0837 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:58.671020 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] For port 398483e4-55ee-4535-80eb-ee84849f56c3, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:52:58.674907 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] For port 398483e4-55ee-4535-80eb-ee84849f56c3, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=398483e4-55ee-4535-80eb-ee84849f56c3,segment=NetworkSegment(aceca204-8e76-42cc-8d81-7615c906ebaa),segment_id=aceca204-8e76-42cc-8d81-7615c906ebaa)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:52:58.681633 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:58.700430 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-1de9dfd7-0a9e-45c3-a462-7e3added0837 admin admin] For port 69ef926f-d069-4c61-a267-f116dfe6923d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=69ef926f-d069-4c61-a267-f116dfe6923d,segment=NetworkSegment(2cf8af64-5fcd-450c-a642-55c17e8db111),segment_id=2cf8af64-5fcd-450c-a642-55c17e8db111)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:58.701342 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1de9dfd7-0a9e-45c3-a462-7e3added0837 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:58.722854 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1de9dfd7-0a9e-45c3-a462-7e3added0837 admin admin] Calling delete_port for 69ef926f-d069-4c61-a267-f116dfe6923d owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:52:58.752617 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] Routers {'55c83978-4466-47ab-a39c-ada0ddbd1aa6'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:52:58.753402 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['55c83978-4466-47ab-a39c-ada0ddbd1aa6'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:58.814344 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76ea5f69-dfa5-437b-bdac-203a54b1aff3 None None] Pushing event updated for resources: {'Port': ['ID=398483e4-55ee-4535-80eb-ee84849f56c3,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:58.830922 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c80c3118-7e72-4e3e-8007-9c8c9cf1c7e9 None None] Provisioning complete for port 398483e4-55ee-4535-80eb-ee84849f56c3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:58.831381 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c80c3118-7e72-4e3e-8007-9c8c9cf1c7e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:58.854182 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0475a9e-ca94-4ff4-bc98-4c62ff3c9b4a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:58.957984 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1de9dfd7-0a9e-45c3-a462-7e3added0837 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:58.984835 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c80c3118-7e72-4e3e-8007-9c8c9cf1c7e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:58.990848 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1de9dfd7-0a9e-45c3-a462-7e3added0837 admin admin] Pushing event deleted for resources: {'Port': ['ID=69ef926f-d069-4c61-a267-f116dfe6923d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:58.999880 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] Set router 55c83978-4466-47ab-a39c-ada0ddbd1aa6 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:52:59.031257 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f0475a9e-ca94-4ff4-bc98-4c62ff3c9b4a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Router 7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:52:59.119048 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c80c3118-7e72-4e3e-8007-9c8c9cf1c7e9 None None] For port 398483e4-55ee-4535-80eb-ee84849f56c3, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=398483e4-55ee-4535-80eb-ee84849f56c3,segment=NetworkSegment(aceca204-8e76-42cc-8d81-7615c906ebaa),segment_id=aceca204-8e76-42cc-8d81-7615c906ebaa)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:52:59.139118 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c80c3118-7e72-4e3e-8007-9c8c9cf1c7e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:59.188003 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f0475a9e-ca94-4ff4-bc98-4c62ff3c9b4a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:52:59.204512 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] Sync routers for ids ['7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:52:59.218126 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] Routers {'7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:52:59.219256 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:59.225768 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0475a9e-ca94-4ff4-bc98-4c62ff3c9b4a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:59.227305 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f0475a9e-ca94-4ff4-bc98-4c62ff3c9b4a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 893 time: 2.5762579 Dec 09 21:52:59.230321 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54074) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:59.279948 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1de9dfd7-0a9e-45c3-a462-7e3added0837 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:59.287720 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c80c3118-7e72-4e3e-8007-9c8c9cf1c7e9 None None] Pushing event updated for resources: {'Port': ['ID=398483e4-55ee-4535-80eb-ee84849f56c3,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:52:59.296596 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-17e91350-4174-4aa0-8d55-134508125149 None None] Provisioning complete for port 398483e4-55ee-4535-80eb-ee84849f56c3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:52:59.297018 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-17e91350-4174-4aa0-8d55-134508125149 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:59.431079 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] Set router 7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:52:59.431680 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55c83978-4466-47ab-a39c-ada0ddbd1aa6', 'name': 'tempest-TestAggregatesBasicOps-32586551-router', 'tenant_id': '21be760267124f1fa7d0bfc7d602fe2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.244'}], 'enable_snat': True}, 'gw_port_id': 'daaf4d44-9b33-4d88-9124-018dbc96289c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:50Z', 'updated_at': '2021-12-09T21:52:54Z', 'revision_number': 4, 'project_id': '21be760267124f1fa7d0bfc7d602fe2c', 'gw_port': {'id': 'daaf4d44-9b33-4d88-9124-018dbc96289c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:b1:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55c83978-4466-47ab-a39c-ada0ddbd1aa6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3843, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.244', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:50Z', 'updated_at': '2021-12-09T21:52:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '398483e4-55ee-4535-80eb-ee84849f56c3', 'name': '', 'network_id': '87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b', 'tenant_id': '21be760267124f1fa7d0bfc7d602fe2c', 'mac_address': 'fa:16:3e:5a:16:b7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55c83978-4466-47ab-a39c-ada0ddbd1aa6', 'device_owner': 'network:router_interface', 'standard_attr_id': 3849, 'fixed_ips': [{'subnet_id': '1a66e0da-6b2f-4dd5-a0b6-4a8745999ff9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:53Z', 'updated_at': '2021-12-09T21:52:58Z', 'revision_number': 4, 'project_id': '21be760267124f1fa7d0bfc7d602fe2c', 'subnets': [{'id': '1a66e0da-6b2f-4dd5-a0b6-4a8745999ff9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:59.460169 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a4eb534b-5b96-447f-bfce-42085fdec27b None None] The sync data for ids ['55c83978-4466-47ab-a39c-ada0ddbd1aa6'] in n-d-713301-27 is: [{'id': '55c83978-4466-47ab-a39c-ada0ddbd1aa6', 'name': 'tempest-TestAggregatesBasicOps-32586551-router', 'tenant_id': '21be760267124f1fa7d0bfc7d602fe2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.244'}], 'enable_snat': True}, 'gw_port_id': 'daaf4d44-9b33-4d88-9124-018dbc96289c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:50Z', 'updated_at': '2021-12-09T21:52:54Z', 'revision_number': 4, 'project_id': '21be760267124f1fa7d0bfc7d602fe2c', 'gw_port': {'id': 'daaf4d44-9b33-4d88-9124-018dbc96289c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:b1:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55c83978-4466-47ab-a39c-ada0ddbd1aa6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3843, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.244', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:50Z', 'updated_at': '2021-12-09T21:52:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '398483e4-55ee-4535-80eb-ee84849f56c3', 'name': '', 'network_id': '87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b', 'tenant_id': '21be760267124f1fa7d0bfc7d602fe2c', 'mac_address': 'fa:16:3e:5a:16:b7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55c83978-4466-47ab-a39c-ada0ddbd1aa6', 'device_owner': 'network:router_interface', 'standard_attr_id': 3849, 'fixed_ips': [{'subnet_id': '1a66e0da-6b2f-4dd5-a0b6-4a8745999ff9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:53Z', 'updated_at': '2021-12-09T21:52:58Z', 'revision_number': 4, 'project_id': '21be760267124f1fa7d0bfc7d602fe2c', 'subnets': [{'id': '1a66e0da-6b2f-4dd5-a0b6-4a8745999ff9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:52:59.490791 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fddb5a6d-6f19-44aa-b339-7f58854e19dc tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] 10.222.0.13 "GET /v2.0/subnets?project_id=594fec82d9ab4e97a76f8c869f0bbcf0&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.2592740 Dec 09 21:52:59.493686 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54084) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:59.658660 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-65b3d50d-7d90-4cad-adeb-7fd29371db01 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:52:59.662805 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-65b3d50d-7d90-4cad-adeb-7fd29371db01 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1650362 Dec 09 21:52:59.665652 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54086) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:59.709044 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1de9dfd7-0a9e-45c3-a462-7e3added0837 admin admin] Router fed6ac4f-7897-4c4e-90bc-64c20cbfe82c has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:52:59.709044 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-196321f4-9efc-4744-bac3-f1fc9258f3d6 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] 10.222.0.13 "GET /v2.0/subnets?network_id=97925a19-460a-4476-8208-41db134b6c83&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0393119 Dec 09 21:52:59.709262 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54088) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:59.714945 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-b576aa6f-c2a3-45f6-adc5-4af8075df32c tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1316866744', 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2', 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:52:59.792239 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-551544193', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173'}], 'enable_snat': True}, 'gw_port_id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:56Z', 'updated_at': '2021-12-09T21:52:58Z', 'revision_number': 3, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'gw_port': {'id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ea:5c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3858, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:57Z', 'updated_at': '2021-12-09T21:52:57Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:59.848391 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] Checking router: 7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:52:59.848643 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1de9dfd7-0a9e-45c3-a462-7e3added0837 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:52:59.848879 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] Updating router 7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e port fb327925-1394-41b3-b56e-d10fa9a24586 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:52:59.858489 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1de9dfd7-0a9e-45c3-a462-7e3added0837 admin admin] 10.222.0.13 "PUT /v2.0/routers/fed6ac4f-7897-4c4e-90bc-64c20cbfe82c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5249789 Dec 09 21:52:59.859888 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0533055e-606f-4c69-941c-f9d0edc48ed2 None None] Sync routers for ids ['fed6ac4f-7897-4c4e-90bc-64c20cbfe82c'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:52:59.860696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54090) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:52:59.866804 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b576aa6f-c2a3-45f6-adc5-4af8075df32c tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Made reservation on behalf of 594fec82d9ab4e97a76f8c869f0bbcf0 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:52:59.871132 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b576aa6f-c2a3-45f6-adc5-4af8075df32c tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:52:59.885024 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0533055e-606f-4c69-941c-f9d0edc48ed2 None None] Routers {'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:52:59.887543 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-0533055e-606f-4c69-941c-f9d0edc48ed2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['fed6ac4f-7897-4c4e-90bc-64c20cbfe82c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:52:59.892289 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:00.043638 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-0533055e-606f-4c69-941c-f9d0edc48ed2 None None] Set router fed6ac4f-7897-4c4e-90bc-64c20cbfe82c gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:53:00.079127 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8c92da20-d7db-41a3-81e0-686b85a6274d admin admin] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:00.196656 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:53:00.206479 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:00.214235 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:00.254726 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8c92da20-d7db-41a3-81e0-686b85a6274d admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:00.269743 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7ef6652-574b-4879-bb0c-8ff662c4aab4 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:53:00.271241 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] Attempting to bind port fb327925-1394-41b3-b56e-d10fa9a24586 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:53:00.271765 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] Attempting to bind port fb327925-1394-41b3-b56e-d10fa9a24586 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:53:00.272099 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] Attempting to bind port fb327925-1394-41b3-b56e-d10fa9a24586 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:53:00.299778 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b609547-25af-4285-8e13-50bcd165aad2 None None] Pushing event updated for resources: {'Port': ['ID=fb327925-1394-41b3-b56e-d10fa9a24586,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:00.303236 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 52, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:53:00.303616 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:53:00.304022 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:00.304394 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:53:00.305043 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] Bound port: fb327925-1394-41b3-b56e-d10fa9a24586, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:53:00.305413 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:00.369701 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b576aa6f-c2a3-45f6-adc5-4af8075df32c tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:00.388374 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7325aec3-f7f9-4c31-8101-77f2aaf67747 None None] Provisioning complete for port fb327925-1394-41b3-b56e-d10fa9a24586 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:00.391185 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7325aec3-f7f9-4c31-8101-77f2aaf67747 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:00.399163 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] For port fb327925-1394-41b3-b56e-d10fa9a24586, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:53:00.402817 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] For port fb327925-1394-41b3-b56e-d10fa9a24586, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=fb327925-1394-41b3-b56e-d10fa9a24586,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:53:00.411337 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:00.429996 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-0533055e-606f-4c69-941c-f9d0edc48ed2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c', 'name': 'tempest-TestAggregatesBasicOps-1642153010-router', 'tenant_id': 'e1c29cd411134d0696683880e25d3ad6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.196'}], 'enable_snat': True}, 'gw_port_id': '920c449e-6a22-483f-95fa-c51b7b4c0846', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:43Z', 'updated_at': '2021-12-09T21:52:58Z', 'revision_number': 5, 'project_id': 'e1c29cd411134d0696683880e25d3ad6', 'gw_port': {'id': '920c449e-6a22-483f-95fa-c51b7b4c0846', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:02:2b:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3831, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:43Z', 'updated_at': '2021-12-09T21:52:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:00.443644 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-8c92da20-d7db-41a3-81e0-686b85a6274d admin admin] Deleting port 920c449e-6a22-483f-95fa-c51b7b4c0846 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:53:00.444038 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8c92da20-d7db-41a3-81e0-686b85a6274d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:00.444550 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-7325aec3-f7f9-4c31-8101-77f2aaf67747 None None] Port fb327925-1394-41b3-b56e-d10fa9a24586 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:53:00.479535 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] Routers {'7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:53:00.480158 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:00.552132 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a52353e4-1dd6-46c2-ab66-5c13f99015d7 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:53:00.556035 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0533055e-606f-4c69-941c-f9d0edc48ed2 None None] Checking router: fed6ac4f-7897-4c4e-90bc-64c20cbfe82c for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:53:00.566539 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-8c92da20-d7db-41a3-81e0-686b85a6274d admin admin] For port 920c449e-6a22-483f-95fa-c51b7b4c0846, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=920c449e-6a22-483f-95fa-c51b7b4c0846,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:00.566914 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8c92da20-d7db-41a3-81e0-686b85a6274d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:00.579920 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-8c92da20-d7db-41a3-81e0-686b85a6274d admin admin] Calling delete_port for 920c449e-6a22-483f-95fa-c51b7b4c0846 owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:53:00.591060 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b609547-25af-4285-8e13-50bcd165aad2 None None] Pushing event updated for resources: {'Port': ['ID=fb327925-1394-41b3-b56e-d10fa9a24586,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:00.593587 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0533055e-606f-4c69-941c-f9d0edc48ed2 None None] Routers {'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:53:00.594062 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-0533055e-606f-4c69-941c-f9d0edc48ed2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['fed6ac4f-7897-4c4e-90bc-64c20cbfe82c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:00.649172 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] Set router 7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:53:00.765966 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8c92da20-d7db-41a3-81e0-686b85a6274d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:00.779988 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b576aa6f-c2a3-45f6-adc5-4af8075df32c tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event updated for resources: {'Subnet': ['ID=a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:00.815889 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c92da20-d7db-41a3-81e0-686b85a6274d admin admin] Pushing event deleted for resources: {'Port': ['ID=920c449e-6a22-483f-95fa-c51b7b4c0846,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:00.824667 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-23ee0ee0-3ce7-492c-8ed4-9886449af0c2 None None] Provisioning complete for port fb327925-1394-41b3-b56e-d10fa9a24586 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:00.825039 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-23ee0ee0-3ce7-492c-8ed4-9886449af0c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:00.858724 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b576aa6f-c2a3-45f6-adc5-4af8075df32c tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Checking segment: {'id': 'c1baef7b-1212-4007-90e6-bd8d9f348b6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:53:00.858965 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b576aa6f-c2a3-45f6-adc5-4af8075df32c tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Network hostable DHCP agents. Network: bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:53:00.911038 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8c92da20-d7db-41a3-81e0-686b85a6274d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:00.913804 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b576aa6f-c2a3-45f6-adc5-4af8075df32c tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Network bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:53:01.017129 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-b576aa6f-c2a3-45f6-adc5-4af8075df32c tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:53:01.022697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b576aa6f-c2a3-45f6-adc5-4af8075df32c tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:01.023302 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b576aa6f-c2a3-45f6-adc5-4af8075df32c tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:01.048985 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8c92da20-d7db-41a3-81e0-686b85a6274d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:01.054732 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8c92da20-d7db-41a3-81e0-686b85a6274d admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:01.076047 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b576aa6f-c2a3-45f6-adc5-4af8075df32c tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 1.3657441 Dec 09 21:53:01.079083 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54094) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:01.088255 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-551544193', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173'}], 'enable_snat': True}, 'gw_port_id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:56Z', 'updated_at': '2021-12-09T21:52:58Z', 'revision_number': 3, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'gw_port': {'id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ea:5c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3858, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:57Z', 'updated_at': '2021-12-09T21:53:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:01.139206 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df6476fc-24d4-4a17-bb89-2441192d2d95 None None] The sync data for ids ['7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'] in n-d-713301-27 is: [{'id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-551544193', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173'}], 'enable_snat': True}, 'gw_port_id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:56Z', 'updated_at': '2021-12-09T21:52:58Z', 'revision_number': 3, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'gw_port': {'id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ea:5c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3858, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:57Z', 'updated_at': '2021-12-09T21:53:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:53:01.140992 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-91ffa19f-1eab-4058-916d-ce1abd81700e None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:53:01.152746 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-978b9395-3b3b-4bfb-82fd-8acb452f7dd4 None None] Network bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:53:01.207251 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8c92da20-d7db-41a3-81e0-686b85a6274d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:01.207841 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8c92da20-d7db-41a3-81e0-686b85a6274d admin admin] Fanout notify agent at l3_agent the message router_deleted on router fed6ac4f-7897-4c4e-90bc-64c20cbfe82c {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:53:01.218324 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8c92da20-d7db-41a3-81e0-686b85a6274d admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:01.221367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-0533055e-606f-4c69-941c-f9d0edc48ed2 None None] Set router fed6ac4f-7897-4c4e-90bc-64c20cbfe82c gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:53:01.222047 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54096) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:01.225715 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8c92da20-d7db-41a3-81e0-686b85a6274d admin admin] 10.222.0.13 "DELETE /v2.0/routers/fed6ac4f-7897-4c4e-90bc-64c20cbfe82c HTTP/1.1" status: 204 len: 168 time: 1.3627751 Dec 09 21:53:01.301538 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 398483e4-55ee-4535-80eb-ee84849f56c3 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:53:01.309929 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-0533055e-606f-4c69-941c-f9d0edc48ed2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c', 'name': 'tempest-TestAggregatesBasicOps-1642153010-router', 'tenant_id': 'e1c29cd411134d0696683880e25d3ad6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:43Z', 'updated_at': '2021-12-09T21:53:00Z', 'revision_number': 6, 'project_id': 'e1c29cd411134d0696683880e25d3ad6', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:01.322933 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-2cc3256d-dce2-4dec-a6e5-7b7fa441e90b admin admin] Deleting subnet ccc6c1d7-5b8e-4ddd-8a24-7c6dd0ffc5a1 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:53:01.326910 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2cc3256d-dce2-4dec-a6e5-7b7fa441e90b admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:01.368854 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2cc3256d-dce2-4dec-a6e5-7b7fa441e90b admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:01.452828 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0533055e-606f-4c69-941c-f9d0edc48ed2 None None] The sync data for ids ['fed6ac4f-7897-4c4e-90bc-64c20cbfe82c'] in n-d-713301-27 is: [{'id': 'fed6ac4f-7897-4c4e-90bc-64c20cbfe82c', 'name': 'tempest-TestAggregatesBasicOps-1642153010-router', 'tenant_id': 'e1c29cd411134d0696683880e25d3ad6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:43Z', 'updated_at': '2021-12-09T21:53:00Z', 'revision_number': 6, 'project_id': 'e1c29cd411134d0696683880e25d3ad6', 'gw_port_host': None}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:53:01.562258 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2cc3256d-dce2-4dec-a6e5-7b7fa441e90b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:01.591292 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab8e5220-5827-4e7f-a2af-b9790515e570 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2', 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2', 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'fixed_ips': [{'subnet_id': 'a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:53:01.593944 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ab8e5220-5827-4e7f-a2af-b9790515e570 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:01.644071 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-23ee0ee0-3ce7-492c-8ed4-9886449af0c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:01.648075 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2cc3256d-dce2-4dec-a6e5-7b7fa441e90b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:01.649150 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 398483e4-55ee-4535-80eb-ee84849f56c3 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:01.649524 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:01.679769 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cc3256d-dce2-4dec-a6e5-7b7fa441e90b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ccc6c1d7-5b8e-4ddd-8a24-7c6dd0ffc5a1,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:01.687046 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2cc3256d-dce2-4dec-a6e5-7b7fa441e90b admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:01.694890 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2cc3256d-dce2-4dec-a6e5-7b7fa441e90b admin admin] 10.222.0.13 "DELETE /v2.0/subnets/ccc6c1d7-5b8e-4ddd-8a24-7c6dd0ffc5a1 HTTP/1.1" status: 204 len: 168 time: 0.4693911 Dec 09 21:53:01.696466 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54100) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:01.731640 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4cd458ba-c1d7-4410-9461-54eaed99b062 None None] Network 982ab6c6-e858-4907-9da8-7b116210104a requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:53:01.764069 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-23ee0ee0-3ce7-492c-8ed4-9886449af0c2 None None] For port fb327925-1394-41b3-b56e-d10fa9a24586, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=fb327925-1394-41b3-b56e-d10fa9a24586,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:01.779764 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-23ee0ee0-3ce7-492c-8ed4-9886449af0c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:01.801838 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2308a2d1-9177-44af-bba1-eb8edbc35449 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:01.894403 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-754c95d2-7762-4fc1-a75d-0aff9bf90bc5 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:01.917935 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-2308a2d1-9177-44af-bba1-eb8edbc35449 admin admin] Deleting port 27259ce3-53db-4b5e-b24d-ccd77e9b9e85 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:53:01.918265 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2308a2d1-9177-44af-bba1-eb8edbc35449 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:01.946963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23ee0ee0-3ce7-492c-8ed4-9886449af0c2 None None] Pushing event updated for resources: {'Port': ['ID=fb327925-1394-41b3-b56e-d10fa9a24586,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:01.972338 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-ab8e5220-5827-4e7f-a2af-b9790515e570 None None] Allocated IP 172.20.0.2 (bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2/a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5/4a93f4ac-1360-4c70-951c-d805521e39c3) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:53:02.051617 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-2308a2d1-9177-44af-bba1-eb8edbc35449 admin admin] For port 27259ce3-53db-4b5e-b24d-ccd77e9b9e85, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=27259ce3-53db-4b5e-b24d-ccd77e9b9e85,segment=NetworkSegment(2cf8af64-5fcd-450c-a642-55c17e8db111),segment_id=2cf8af64-5fcd-450c-a642-55c17e8db111)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:02.051947 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2308a2d1-9177-44af-bba1-eb8edbc35449 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:02.074907 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-2308a2d1-9177-44af-bba1-eb8edbc35449 admin admin] Calling delete_port for 27259ce3-53db-4b5e-b24d-ccd77e9b9e85 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:53:02.086192 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-501b9566-f13e-4c71-b473-578caeb82e09 None None] DHCP port deletion for 982ab6c6-e858-4907-9da8-7b116210104a request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:53:02.196274 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ab8e5220-5827-4e7f-a2af-b9790515e570 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:02.206633 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ab8e5220-5827-4e7f-a2af-b9790515e570 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:02.209033 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-501b9566-f13e-4c71-b473-578caeb82e09 None None] Deleting port 27259ce3-53db-4b5e-b24d-ccd77e9b9e85 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:53:02.209377 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-501b9566-f13e-4c71-b473-578caeb82e09 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:02.274910 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab8e5220-5827-4e7f-a2af-b9790515e570 None None] Network bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:53:02.279200 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2308a2d1-9177-44af-bba1-eb8edbc35449 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:02.304652 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-ab8e5220-5827-4e7f-a2af-b9790515e570 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:53:02.307689 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab8e5220-5827-4e7f-a2af-b9790515e570 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:53:02.313163 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab8e5220-5827-4e7f-a2af-b9790515e570 None None] Pushing event updated for resources: {'Port': ['ID=4a93f4ac-1360-4c70-951c-d805521e39c3,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:02.315426 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2308a2d1-9177-44af-bba1-eb8edbc35449 admin admin] Pushing event deleted for resources: {'Port': ['ID=27259ce3-53db-4b5e-b24d-ccd77e9b9e85,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:02.317333 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2308a2d1-9177-44af-bba1-eb8edbc35449 admin admin] No DVR routers for this DVR port 27259ce3-53db-4b5e-b24d-ccd77e9b9e85 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:53:02.336502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-501b9566-f13e-4c71-b473-578caeb82e09 None None] For port 27259ce3-53db-4b5e-b24d-ccd77e9b9e85, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=27259ce3-53db-4b5e-b24d-ccd77e9b9e85,segment=NetworkSegment(2cf8af64-5fcd-450c-a642-55c17e8db111),segment_id=2cf8af64-5fcd-450c-a642-55c17e8db111)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:02.336917 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-501b9566-f13e-4c71-b473-578caeb82e09 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:02.355912 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-754c95d2-7762-4fc1-a75d-0aff9bf90bc5 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Allocated IP 172.20.0.1 (bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2/a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5/968bf96c-fe29-4aff-afc1-7d0710db3d10) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:53:02.377285 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-501b9566-f13e-4c71-b473-578caeb82e09 None None] Calling delete_port for 27259ce3-53db-4b5e-b24d-ccd77e9b9e85 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:53:02.418381 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-ab8e5220-5827-4e7f-a2af-b9790515e570 None None] Attempting to bind port 4a93f4ac-1360-4c70-951c-d805521e39c3 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:53:02.418682 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-ab8e5220-5827-4e7f-a2af-b9790515e570 None None] Attempting to bind port 4a93f4ac-1360-4c70-951c-d805521e39c3 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'c1baef7b-1212-4007-90e6-bd8d9f348b6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:53:02.419035 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab8e5220-5827-4e7f-a2af-b9790515e570 None None] Attempting to bind port 4a93f4ac-1360-4c70-951c-d805521e39c3 on network bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:53:02.435329 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2308a2d1-9177-44af-bba1-eb8edbc35449 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:02.453839 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab8e5220-5827-4e7f-a2af-b9790515e570 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 52, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:53:02.454218 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab8e5220-5827-4e7f-a2af-b9790515e570 None None] Checking segment: {'id': 'c1baef7b-1212-4007-90e6-bd8d9f348b6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:53:02.455895 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ab8e5220-5827-4e7f-a2af-b9790515e570 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:02.456223 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab8e5220-5827-4e7f-a2af-b9790515e570 None None] Bound using segment: {'id': 'c1baef7b-1212-4007-90e6-bd8d9f348b6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:53:02.456778 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-ab8e5220-5827-4e7f-a2af-b9790515e570 None None] Bound port: 4a93f4ac-1360-4c70-951c-d805521e39c3, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c1baef7b-1212-4007-90e6-bd8d9f348b6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:53:02.457117 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ab8e5220-5827-4e7f-a2af-b9790515e570 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:02.540147 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-2308a2d1-9177-44af-bba1-eb8edbc35449 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['982ab6c6-e858-4907-9da8-7b116210104a']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:02.558332 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-2308a2d1-9177-44af-bba1-eb8edbc35449 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2cf8af64-5fcd-450c-a642-55c17e8db111') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:02.558332 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-2308a2d1-9177-44af-bba1-eb8edbc35449 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2cf8af64-5fcd-450c-a642-55c17e8db111') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:02.565021 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-501b9566-f13e-4c71-b473-578caeb82e09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:02.575963 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2308a2d1-9177-44af-bba1-eb8edbc35449 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:02.581908 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-501b9566-f13e-4c71-b473-578caeb82e09 None None] No DVR routers for this DVR port 27259ce3-53db-4b5e-b24d-ccd77e9b9e85 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:53:02.584012 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ab8e5220-5827-4e7f-a2af-b9790515e570 None None] For port 4a93f4ac-1360-4c70-951c-d805521e39c3, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:53:02.610756 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2308a2d1-9177-44af-bba1-eb8edbc35449 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:02.622693 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-754c95d2-7762-4fc1-a75d-0aff9bf90bc5 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:02.635304 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2308a2d1-9177-44af-bba1-eb8edbc35449 admin admin] Releasing vlan 132 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:53:02.641876 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2308a2d1-9177-44af-bba1-eb8edbc35449 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:02.643468 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-501b9566-f13e-4c71-b473-578caeb82e09 None None] Pushing event deleted for resources: {'Port': ['ID=27259ce3-53db-4b5e-b24d-ccd77e9b9e85,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:53:02.643985 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:53:02.649312 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ab8e5220-5827-4e7f-a2af-b9790515e570 None None] For port 4a93f4ac-1360-4c70-951c-d805521e39c3, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=4a93f4ac-1360-4c70-951c-d805521e39c3,segment=NetworkSegment(c1baef7b-1212-4007-90e6-bd8d9f348b6f),segment_id=c1baef7b-1212-4007-90e6-bd8d9f348b6f)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:53:02.660488 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ab8e5220-5827-4e7f-a2af-b9790515e570 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:02.749139 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab8e5220-5827-4e7f-a2af-b9790515e570 None None] Pushing event updated for resources: {'Port': ['ID=4a93f4ac-1360-4c70-951c-d805521e39c3,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:02.749363 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2308a2d1-9177-44af-bba1-eb8edbc35449 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:02.766290 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2308a2d1-9177-44af-bba1-eb8edbc35449 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:02.766916 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2308a2d1-9177-44af-bba1-eb8edbc35449 admin admin] 10.222.0.13 "DELETE /v2.0/networks/982ab6c6-e858-4907-9da8-7b116210104a HTTP/1.1" status: 204 len: 168 time: 1.0695255 Dec 09 21:53:02.769592 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54108) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:02.795572 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2308a2d1-9177-44af-bba1-eb8edbc35449 admin admin] Pushing event deleted for resources: {'Network': ['ID=982ab6c6-e858-4907-9da8-7b116210104a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:02.810960 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-754c95d2-7762-4fc1-a75d-0aff9bf90bc5 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:02.868957 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-754c95d2-7762-4fc1-a75d-0aff9bf90bc5 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Network bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:53:02.873843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-754c95d2-7762-4fc1-a75d-0aff9bf90bc5 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:53:02.883697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-754c95d2-7762-4fc1-a75d-0aff9bf90bc5 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:53:03.040007 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ef719a36-ef1d-4c52-b007-3255646e55c1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:03.387712 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 4a93f4ac-1360-4c70-951c-d805521e39c3 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:53:03.466228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 4a93f4ac-1360-4c70-951c-d805521e39c3 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:03.466607 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:03.552924 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-754c95d2-7762-4fc1-a75d-0aff9bf90bc5 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event updated for resources: {'Port': ['ID=968bf96c-fe29-4aff-afc1-7d0710db3d10,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:03.576020 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-754c95d2-7762-4fc1-a75d-0aff9bf90bc5 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:03.622870 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:03.657037 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b2d165af-ed13-4e12-be67-f0a6a75559e9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:03.680502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 4a93f4ac-1360-4c70-951c-d805521e39c3, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=4a93f4ac-1360-4c70-951c-d805521e39c3,segment=NetworkSegment(c1baef7b-1212-4007-90e6-bd8d9f348b6f),segment_id=c1baef7b-1212-4007-90e6-bd8d9f348b6f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:03.687293 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:03.688641 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device fb327925-1394-41b3-b56e-d10fa9a24586 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:53:03.780809 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-754c95d2-7762-4fc1-a75d-0aff9bf90bc5 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:03.803012 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=4a93f4ac-1360-4c70-951c-d805521e39c3,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:03.838008 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port fb327925-1394-41b3-b56e-d10fa9a24586 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:03.838633 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:04.030362 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 69ef926f-d069-4c61-a267-f116dfe6923d no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:53:04.056640 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 69ef926f-d069-4c61-a267-f116dfe6923d {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:53:04.057266 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 69ef926f-d069-4c61-a267-f116dfe6923d not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:53:04.060091 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 27259ce3-53db-4b5e-b24d-ccd77e9b9e85 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:53:04.105002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 27259ce3-53db-4b5e-b24d-ccd77e9b9e85 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:53:04.105347 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 27259ce3-53db-4b5e-b24d-ccd77e9b9e85 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:53:04.106097 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 920c449e-6a22-483f-95fa-c51b7b4c0846 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:53:04.136061 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-b2d165af-ed13-4e12-be67-f0a6a75559e9 admin admin] Deleting port 398483e4-55ee-4535-80eb-ee84849f56c3 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:53:04.137040 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b2d165af-ed13-4e12-be67-f0a6a75559e9 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:04.156889 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 920c449e-6a22-483f-95fa-c51b7b4c0846 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:53:04.157659 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 920c449e-6a22-483f-95fa-c51b7b4c0846 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:53:04.213683 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-754c95d2-7762-4fc1-a75d-0aff9bf90bc5 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:04.224257 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-754c95d2-7762-4fc1-a75d-0aff9bf90bc5 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:04.271794 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-b2d165af-ed13-4e12-be67-f0a6a75559e9 admin admin] For port 398483e4-55ee-4535-80eb-ee84849f56c3, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=398483e4-55ee-4535-80eb-ee84849f56c3,segment=NetworkSegment(aceca204-8e76-42cc-8d81-7615c906ebaa),segment_id=aceca204-8e76-42cc-8d81-7615c906ebaa)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:04.272163 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b2d165af-ed13-4e12-be67-f0a6a75559e9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:04.287175 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-b2d165af-ed13-4e12-be67-f0a6a75559e9 admin admin] Calling delete_port for 398483e4-55ee-4535-80eb-ee84849f56c3 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:53:04.308885 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-754c95d2-7762-4fc1-a75d-0aff9bf90bc5 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event updated for resources: {'Port': ['ID=968bf96c-fe29-4aff-afc1-7d0710db3d10,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:04.313093 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-754c95d2-7762-4fc1-a75d-0aff9bf90bc5 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:04.437936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-754c95d2-7762-4fc1-a75d-0aff9bf90bc5 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Network bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:53:04.442426 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-754c95d2-7762-4fc1-a75d-0aff9bf90bc5 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:53:04.524370 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b2d165af-ed13-4e12-be67-f0a6a75559e9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:04.549230 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a0e28f06-dba2-43df-baec-4512c3e08e87 None None] Network bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:53:04.578883 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2d165af-ed13-4e12-be67-f0a6a75559e9 admin admin] Pushing event deleted for resources: {'Port': ['ID=398483e4-55ee-4535-80eb-ee84849f56c3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:04.605049 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-754c95d2-7762-4fc1-a75d-0aff9bf90bc5 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Router 7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:53:04.659101 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-92e7f597-a944-4b8e-a9fd-7cc17f361d38 None None] Provisioning complete for port 4a93f4ac-1360-4c70-951c-d805521e39c3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:04.659497 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-92e7f597-a944-4b8e-a9fd-7cc17f361d38 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:04.821606 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b2d165af-ed13-4e12-be67-f0a6a75559e9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:04.898939 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-754c95d2-7762-4fc1-a75d-0aff9bf90bc5 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:53:04.904531 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-754c95d2-7762-4fc1-a75d-0aff9bf90bc5 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "PUT /v2.0/routers/7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.8237469 Dec 09 21:53:04.907636 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54114) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:04.913759 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-25e6122b-38f3-4a87-9288-8a868aa9f949 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Request body: {'security_group': {'name': 'tempest-secgroup_access--469637627', 'description': 'tempest-secgroup_access--469637627 description', 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:04.941506 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-25e6122b-38f3-4a87-9288-8a868aa9f949 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:05.044655 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-25e6122b-38f3-4a87-9288-8a868aa9f949 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:05.058406 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-25e6122b-38f3-4a87-9288-8a868aa9f949 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:05.126013 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] Sync routers for ids ['7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:53:05.135689 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-25e6122b-38f3-4a87-9288-8a868aa9f949 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:05.136978 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-25e6122b-38f3-4a87-9288-8a868aa9f949 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1815 time: 0.2283447 Dec 09 21:53:05.137833 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25e6122b-38f3-4a87-9288-8a868aa9f949 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event updated for resources: {'SecurityGroup': ['ID=cff07a74-5957-4506-85f7-9b25c08d5db0,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:05.140226 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54116) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:05.144968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c0a48d44-82f6-425e-b030-2699b7cc23b2 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Request body: {'security_group': {'name': 'tempest-secgroup_general--474303031', 'description': 'tempest-secgroup_general--474303031 description', 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:05.145279 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] Routers {'7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:53:05.146065 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:05.175239 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c0a48d44-82f6-425e-b030-2699b7cc23b2 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:05.184141 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-aabbff77-8a7b-4e23-a9d6-0c8c71c33c58 None None] Provisioning complete for port 968bf96c-fe29-4aff-afc1-7d0710db3d10 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:05.184976 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aabbff77-8a7b-4e23-a9d6-0c8c71c33c58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:05.230081 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-aabbff77-8a7b-4e23-a9d6-0c8c71c33c58 None None] Port 968bf96c-fe29-4aff-afc1-7d0710db3d10 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:53:05.243625 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-aabbff77-8a7b-4e23-a9d6-0c8c71c33c58 None None] Provisioning complete for port 4a93f4ac-1360-4c70-951c-d805521e39c3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:05.243625 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aabbff77-8a7b-4e23-a9d6-0c8c71c33c58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:05.246942 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 4a93f4ac-1360-4c70-951c-d805521e39c3 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:53:05.269422 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b2d165af-ed13-4e12-be67-f0a6a75559e9 admin admin] Router 55c83978-4466-47ab-a39c-ada0ddbd1aa6 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:53:05.337012 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c0a48d44-82f6-425e-b030-2699b7cc23b2 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:05.344412 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c0a48d44-82f6-425e-b030-2699b7cc23b2 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:05.379522 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c0a48d44-82f6-425e-b030-2699b7cc23b2 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:05.383018 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c0a48d44-82f6-425e-b030-2699b7cc23b2 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1817 time: 0.2412567 Dec 09 21:53:05.388292 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54118) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:05.400801 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-d33e417a-00bb-4e82-bfcf-21418b07a045 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Request body: {'security_group_rule': {'security_group_id': 'cff07a74-5957-4506-85f7-9b25c08d5db0', 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:05.423062 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0a48d44-82f6-425e-b030-2699b7cc23b2 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event updated for resources: {'SecurityGroup': ['ID=99f9372d-12fa-4d58-a142-20d749c9a2e5,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:05.447141 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] Set router 7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:53:05.477902 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b2d165af-ed13-4e12-be67-f0a6a75559e9 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:53:05.488731 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b2d165af-ed13-4e12-be67-f0a6a75559e9 admin admin] 10.222.0.13 "PUT /v2.0/routers/55c83978-4466-47ab-a39c-ada0ddbd1aa6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7179298 Dec 09 21:53:05.489681 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d33e417a-00bb-4e82-bfcf-21418b07a045 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:05.491317 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54120) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:05.549119 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d33e417a-00bb-4e82-bfcf-21418b07a045 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:05.551911 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8be674d5-0d87-4bfd-95c5-c3992fcfc4e0 None None] Sync routers for ids ['55c83978-4466-47ab-a39c-ada0ddbd1aa6'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:53:05.556143 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d33e417a-00bb-4e82-bfcf-21418b07a045 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:05.583155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d33e417a-00bb-4e82-bfcf-21418b07a045 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d2947f15-d98b-4251-bcc1-b8c0c666e541,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:05.595990 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d33e417a-00bb-4e82-bfcf-21418b07a045 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:05.604319 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d33e417a-00bb-4e82-bfcf-21418b07a045 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2119925 Dec 09 21:53:05.606607 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8be674d5-0d87-4bfd-95c5-c3992fcfc4e0 None None] Routers {'55c83978-4466-47ab-a39c-ada0ddbd1aa6'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:53:05.607354 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-8be674d5-0d87-4bfd-95c5-c3992fcfc4e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:52:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['55c83978-4466-47ab-a39c-ada0ddbd1aa6'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:05.619700 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4b6e9c06-cf10-4b0e-90aa-df413bd54975 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:05.657309 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 4a93f4ac-1360-4c70-951c-d805521e39c3 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:05.658292 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:05.740268 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-551544193', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173'}], 'enable_snat': True}, 'gw_port_id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:56Z', 'updated_at': '2021-12-09T21:53:03Z', 'revision_number': 4, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'gw_port': {'id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ea:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3858, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:57Z', 'updated_at': '2021-12-09T21:53:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '968bf96c-fe29-4aff-afc1-7d0710db3d10', 'name': '', 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'mac_address': 'fa:16:3e:13:a3:db', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'device_owner': 'network:router_interface', 'standard_attr_id': 3861, 'fixed_ips': [{'subnet_id': 'a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:02Z', 'updated_at': '2021-12-09T21:53:04Z', 'revision_number': 2, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'subnets': [{'id': 'a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:05.745618 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-728858d6-a89f-45ee-bd51-19a7c6807eae admin admin] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:05.778786 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] Checking router: 7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:53:05.779174 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] Updating router 7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e port 968bf96c-fe29-4aff-afc1-7d0710db3d10 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:53:05.808310 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:05.871561 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-8be674d5-0d87-4bfd-95c5-c3992fcfc4e0 None None] Set router 55c83978-4466-47ab-a39c-ada0ddbd1aa6 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:53:05.880716 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7788c1da-b884-4583-8700-318debf9ba68 req-9cd3668d-ba7f-4eb8-9711-306772f54e2c tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup_access--469637627&fields=id&tenant_id=594fec82d9ab4e97a76f8c869f0bbcf0 HTTP/1.1" status: 200 len: 267 time: 0.0973046 Dec 09 21:53:05.939255 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-728858d6-a89f-45ee-bd51-19a7c6807eae admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:05.946523 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7788c1da-b884-4583-8700-318debf9ba68 req-6925d195-b8e4-4ed2-ae35-c5ef0dd48cf1 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup_general--474303031&fields=id&tenant_id=594fec82d9ab4e97a76f8c869f0bbcf0 HTTP/1.1" status: 200 len: 267 time: 0.0595756 Dec 09 21:53:06.099209 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-728858d6-a89f-45ee-bd51-19a7c6807eae admin admin] Deleting port daaf4d44-9b33-4d88-9124-018dbc96289c {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:53:06.099594 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-728858d6-a89f-45ee-bd51-19a7c6807eae admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:06.135171 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5844c5c0-0f25-445b-843f-cba50497b9dd None None] Provisioning complete for port 968bf96c-fe29-4aff-afc1-7d0710db3d10 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:06.135792 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5844c5c0-0f25-445b-843f-cba50497b9dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:06.189232 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-5844c5c0-0f25-445b-843f-cba50497b9dd None None] Port 968bf96c-fe29-4aff-afc1-7d0710db3d10 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:53:06.193870 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-728858d6-a89f-45ee-bd51-19a7c6807eae admin admin] For port daaf4d44-9b33-4d88-9124-018dbc96289c, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=daaf4d44-9b33-4d88-9124-018dbc96289c,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:06.194269 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-728858d6-a89f-45ee-bd51-19a7c6807eae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:06.204458 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-8be674d5-0d87-4bfd-95c5-c3992fcfc4e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55c83978-4466-47ab-a39c-ada0ddbd1aa6', 'name': 'tempest-TestAggregatesBasicOps-32586551-router', 'tenant_id': '21be760267124f1fa7d0bfc7d602fe2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.244'}], 'enable_snat': True}, 'gw_port_id': 'daaf4d44-9b33-4d88-9124-018dbc96289c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:50Z', 'updated_at': '2021-12-09T21:53:04Z', 'revision_number': 5, 'project_id': '21be760267124f1fa7d0bfc7d602fe2c', 'gw_port': {'id': 'daaf4d44-9b33-4d88-9124-018dbc96289c', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:b1:1b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55c83978-4466-47ab-a39c-ada0ddbd1aa6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3843, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.244', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:50Z', 'updated_at': '2021-12-09T21:52:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:06.207607 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-728858d6-a89f-45ee-bd51-19a7c6807eae admin admin] Calling delete_port for daaf4d44-9b33-4d88-9124-018dbc96289c owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:53:06.223420 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:06.224573 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7788c1da-b884-4583-8700-318debf9ba68 req-e4473acb-2e8b-40de-b3e5-e4ec8c38e02e tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:06.231997 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:06.233004 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7788c1da-b884-4583-8700-318debf9ba68 req-e4473acb-2e8b-40de-b3e5-e4ec8c38e02e tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/networks?id=bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2 HTTP/1.1" status: 200 len: 795 time: 0.2680387 Dec 09 21:53:06.236891 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8be674d5-0d87-4bfd-95c5-c3992fcfc4e0 None None] Checking router: 55c83978-4466-47ab-a39c-ada0ddbd1aa6 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:53:06.247168 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8be674d5-0d87-4bfd-95c5-c3992fcfc4e0 None None] Routers {'55c83978-4466-47ab-a39c-ada0ddbd1aa6'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:53:06.247542 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-8be674d5-0d87-4bfd-95c5-c3992fcfc4e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:53:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['55c83978-4466-47ab-a39c-ada0ddbd1aa6'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:06.250927 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7788c1da-b884-4583-8700-318debf9ba68 req-2a7a35fe-54ac-41d5-b951-fb2042d0733b tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/quotas/594fec82d9ab4e97a76f8c869f0bbcf0 HTTP/1.1" status: 200 len: 375 time: 0.0169382 Dec 09 21:53:06.376036 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] Attempting to bind port 968bf96c-fe29-4aff-afc1-7d0710db3d10 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:53:06.376704 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] Attempting to bind port 968bf96c-fe29-4aff-afc1-7d0710db3d10 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'c1baef7b-1212-4007-90e6-bd8d9f348b6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:53:06.377536 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] Attempting to bind port 968bf96c-fe29-4aff-afc1-7d0710db3d10 on network bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:53:06.385786 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 52, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:53:06.386440 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] Checking segment: {'id': 'c1baef7b-1212-4007-90e6-bd8d9f348b6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:53:06.387005 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:06.387880 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] Bound using segment: {'id': 'c1baef7b-1212-4007-90e6-bd8d9f348b6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:53:06.388528 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] Bound port: 968bf96c-fe29-4aff-afc1-7d0710db3d10, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c1baef7b-1212-4007-90e6-bd8d9f348b6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:53:06.389128 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:06.392664 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7788c1da-b884-4583-8700-318debf9ba68 req-b9136c02-38bf-4356-ab3c-f5ad66955e48 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=594fec82d9ab4e97a76f8c869f0bbcf0&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1325860 Dec 09 21:53:06.408174 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-8be674d5-0d87-4bfd-95c5-c3992fcfc4e0 None None] Set router 55c83978-4466-47ab-a39c-ada0ddbd1aa6 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:53:06.472425 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] For port 968bf96c-fe29-4aff-afc1-7d0710db3d10, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:53:06.476036 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] For port 968bf96c-fe29-4aff-afc1-7d0710db3d10, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=968bf96c-fe29-4aff-afc1-7d0710db3d10,segment=NetworkSegment(c1baef7b-1212-4007-90e6-bd8d9f348b6f),segment_id=c1baef7b-1212-4007-90e6-bd8d9f348b6f)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:53:06.488098 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-8be674d5-0d87-4bfd-95c5-c3992fcfc4e0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55c83978-4466-47ab-a39c-ada0ddbd1aa6', 'name': 'tempest-TestAggregatesBasicOps-32586551-router', 'tenant_id': '21be760267124f1fa7d0bfc7d602fe2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:50Z', 'updated_at': '2021-12-09T21:53:05Z', 'revision_number': 6, 'project_id': '21be760267124f1fa7d0bfc7d602fe2c', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:06.496456 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:06.505865 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d9bdb7c-0c1b-4267-b0a9-9e4fcf4d82f4 None None] Pushing event updated for resources: {'Port': ['ID=968bf96c-fe29-4aff-afc1-7d0710db3d10,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:06.553578 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8be674d5-0d87-4bfd-95c5-c3992fcfc4e0 None None] The sync data for ids ['55c83978-4466-47ab-a39c-ada0ddbd1aa6'] in n-d-713301-27 is: [{'id': '55c83978-4466-47ab-a39c-ada0ddbd1aa6', 'name': 'tempest-TestAggregatesBasicOps-32586551-router', 'tenant_id': '21be760267124f1fa7d0bfc7d602fe2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:50Z', 'updated_at': '2021-12-09T21:53:05Z', 'revision_number': 6, 'project_id': '21be760267124f1fa7d0bfc7d602fe2c', 'gw_port_host': None}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:53:06.611585 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d9bdb7c-0c1b-4267-b0a9-9e4fcf4d82f4 None None] Pushing event updated for resources: {'Port': ['ID=968bf96c-fe29-4aff-afc1-7d0710db3d10,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:06.614785 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] Routers {'7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:53:06.615404 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:53:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:06.619380 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-dd9bead9-ff5a-4c13-8d8c-808fa8b12672 None None] Provisioning complete for port 968bf96c-fe29-4aff-afc1-7d0710db3d10 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:06.619792 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dd9bead9-ff5a-4c13-8d8c-808fa8b12672 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:06.657110 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-728858d6-a89f-45ee-bd51-19a7c6807eae admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:06.697251 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:06.719094 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-728858d6-a89f-45ee-bd51-19a7c6807eae admin admin] Pushing event deleted for resources: {'Port': ['ID=daaf4d44-9b33-4d88-9124-018dbc96289c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:06.744466 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6b5cf22e-dfdd-457c-9b93-e2a3865e22fa None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:53:06.773580 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dd9bead9-ff5a-4c13-8d8c-808fa8b12672 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:06.779852 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7788c1da-b884-4583-8700-318debf9ba68 req-6ff7e413-9861-41a7-82f2-776ec6a984fa service neutron] 10.222.0.13 "GET /v2.0/networks/bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3833404 Dec 09 21:53:06.809440 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] Set router 7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:53:06.826259 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-dd9bead9-ff5a-4c13-8d8c-808fa8b12672 None None] For port 968bf96c-fe29-4aff-afc1-7d0710db3d10, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=968bf96c-fe29-4aff-afc1-7d0710db3d10,segment=NetworkSegment(c1baef7b-1212-4007-90e6-bd8d9f348b6f),segment_id=c1baef7b-1212-4007-90e6-bd8d9f348b6f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:06.832787 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dd9bead9-ff5a-4c13-8d8c-808fa8b12672 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:06.897493 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd9bead9-ff5a-4c13-8d8c-808fa8b12672 None None] Pushing event updated for resources: {'Port': ['ID=968bf96c-fe29-4aff-afc1-7d0710db3d10,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:06.964772 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-728858d6-a89f-45ee-bd51-19a7c6807eae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:07.086717 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-39dc9aa6-0ede-456b-b37c-e0262f3f3e10 None None] Provisioning complete for port 968bf96c-fe29-4aff-afc1-7d0710db3d10 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:07.088039 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-39dc9aa6-0ede-456b-b37c-e0262f3f3e10 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:07.139094 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 398483e4-55ee-4535-80eb-ee84849f56c3 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:53:07.170668 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7788c1da-b884-4583-8700-318debf9ba68 req-6ddd52c0-f30b-44aa-8749-70536203dc00 service neutron] 10.222.0.13 "GET /v2.0/networks/bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3457608 Dec 09 21:53:07.173963 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-728858d6-a89f-45ee-bd51-19a7c6807eae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:07.180484 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-728858d6-a89f-45ee-bd51-19a7c6807eae admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:07.196509 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 398483e4-55ee-4535-80eb-ee84849f56c3 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:53:07.197454 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 398483e4-55ee-4535-80eb-ee84849f56c3 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:53:07.251681 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-551544193', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173'}], 'enable_snat': True}, 'gw_port_id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:56Z', 'updated_at': '2021-12-09T21:53:03Z', 'revision_number': 4, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'gw_port': {'id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ea:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3858, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:57Z', 'updated_at': '2021-12-09T21:53:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '968bf96c-fe29-4aff-afc1-7d0710db3d10', 'name': '', 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'mac_address': 'fa:16:3e:13:a3:db', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'device_owner': 'network:router_interface', 'standard_attr_id': 3861, 'fixed_ips': [{'subnet_id': 'a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:02Z', 'updated_at': '2021-12-09T21:53:06Z', 'revision_number': 4, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'subnets': [{'id': 'a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:07.272426 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-728858d6-a89f-45ee-bd51-19a7c6807eae admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:07.273307 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-728858d6-a89f-45ee-bd51-19a7c6807eae admin admin] Fanout notify agent at l3_agent the message router_deleted on router 55c83978-4466-47ab-a39c-ada0ddbd1aa6 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:53:07.280205 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-728858d6-a89f-45ee-bd51-19a7c6807eae admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:07.282443 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-728858d6-a89f-45ee-bd51-19a7c6807eae admin admin] 10.222.0.13 "DELETE /v2.0/routers/55c83978-4466-47ab-a39c-ada0ddbd1aa6 HTTP/1.1" status: 204 len: 168 time: 1.7896593 Dec 09 21:53:07.284822 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54142) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:07.299642 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f151d17-00b6-484e-800b-ecf66327e949 None None] The sync data for ids ['7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'] in n-d-713301-27 is: [{'id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-551544193', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173'}], 'enable_snat': True}, 'gw_port_id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:56Z', 'updated_at': '2021-12-09T21:53:03Z', 'revision_number': 4, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'gw_port': {'id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ea:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3858, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:57Z', 'updated_at': '2021-12-09T21:53:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '968bf96c-fe29-4aff-afc1-7d0710db3d10', 'name': '', 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'mac_address': 'fa:16:3e:13:a3:db', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'device_owner': 'network:router_interface', 'standard_attr_id': 3861, 'fixed_ips': [{'subnet_id': 'a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:02Z', 'updated_at': '2021-12-09T21:53:06Z', 'revision_number': 4, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'subnets': [{'id': 'a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:53:07.366275 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-2f9dc108-cb31-453f-953a-6d48946bdd9f admin admin] Deleting subnet 1a66e0da-6b2f-4dd5-a0b6-4a8745999ff9 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:53:07.369935 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f9dc108-cb31-453f-953a-6d48946bdd9f admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:07.452285 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-342d6cc9-e8d4-45e3-8c3d-3660514d3b9d req-bc88ab3d-4928-45b3-bf45-78947bef4f46 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=71d6946a-a0e2-426d-a148-1d5b76c4f68c HTTP/1.1" status: 200 len: 210 time: 0.0450904 Dec 09 21:53:07.476328 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f9dc108-cb31-453f-953a-6d48946bdd9f admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:07.627777 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f9dc108-cb31-453f-953a-6d48946bdd9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:07.692948 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f9dc108-cb31-453f-953a-6d48946bdd9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:07.719903 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dcfc703c-6d67-4644-a0e2-d83bb50e7b27 None None] Network 87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:53:07.786568 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2f9dc108-cb31-453f-953a-6d48946bdd9f admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:07.807522 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2f9dc108-cb31-453f-953a-6d48946bdd9f admin admin] 10.222.0.13 "DELETE /v2.0/subnets/1a66e0da-6b2f-4dd5-a0b6-4a8745999ff9 HTTP/1.1" status: 204 len: 168 time: 0.5192838 Dec 09 21:53:07.816210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f9dc108-cb31-453f-953a-6d48946bdd9f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1a66e0da-6b2f-4dd5-a0b6-4a8745999ff9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:07.830450 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54152) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:08.016837 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:08.034108 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a30bda54-a999-47b2-a9e8-953da4a28ec1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:08.098121 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7723e33c-b0f5-4471-b91c-d4d7eb3bd00a None None] DHCP port deletion for 87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:53:08.186635 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-a30bda54-a999-47b2-a9e8-953da4a28ec1 admin admin] Deleting port 20956168-e0b1-43c0-a98f-3fbf0c9ee9ed {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:53:08.187105 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a30bda54-a999-47b2-a9e8-953da4a28ec1 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:08.218610 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-7723e33c-b0f5-4471-b91c-d4d7eb3bd00a None None] Deleting port 20956168-e0b1-43c0-a98f-3fbf0c9ee9ed {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:53:08.218992 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7723e33c-b0f5-4471-b91c-d4d7eb3bd00a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:08.281035 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-a30bda54-a999-47b2-a9e8-953da4a28ec1 admin admin] For port 20956168-e0b1-43c0-a98f-3fbf0c9ee9ed, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=20956168-e0b1-43c0-a98f-3fbf0c9ee9ed,segment=NetworkSegment(aceca204-8e76-42cc-8d81-7615c906ebaa),segment_id=aceca204-8e76-42cc-8d81-7615c906ebaa)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:08.281841 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a30bda54-a999-47b2-a9e8-953da4a28ec1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:08.319236 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-7723e33c-b0f5-4471-b91c-d4d7eb3bd00a None None] For port 20956168-e0b1-43c0-a98f-3fbf0c9ee9ed, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=20956168-e0b1-43c0-a98f-3fbf0c9ee9ed,segment=NetworkSegment(aceca204-8e76-42cc-8d81-7615c906ebaa),segment_id=aceca204-8e76-42cc-8d81-7615c906ebaa)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:08.320561 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7723e33c-b0f5-4471-b91c-d4d7eb3bd00a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:08.341227 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-a30bda54-a999-47b2-a9e8-953da4a28ec1 admin admin] Calling delete_port for 20956168-e0b1-43c0-a98f-3fbf0c9ee9ed owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:53:08.343895 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-7723e33c-b0f5-4471-b91c-d4d7eb3bd00a None None] Calling delete_port for 20956168-e0b1-43c0-a98f-3fbf0c9ee9ed owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:53:08.494809 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a30bda54-a999-47b2-a9e8-953da4a28ec1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:08.519358 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7723e33c-b0f5-4471-b91c-d4d7eb3bd00a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:08.532781 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a30bda54-a999-47b2-a9e8-953da4a28ec1 admin admin] Pushing event deleted for resources: {'Port': ['ID=20956168-e0b1-43c0-a98f-3fbf0c9ee9ed,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:08.541423 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a30bda54-a999-47b2-a9e8-953da4a28ec1 admin admin] No DVR routers for this DVR port 20956168-e0b1-43c0-a98f-3fbf0c9ee9ed on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:53:08.571903 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7723e33c-b0f5-4471-b91c-d4d7eb3bd00a None None] Pushing event deleted for resources: {'Port': ['ID=20956168-e0b1-43c0-a98f-3fbf0c9ee9ed,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:08.583080 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7723e33c-b0f5-4471-b91c-d4d7eb3bd00a None None] No DVR routers for this DVR port 20956168-e0b1-43c0-a98f-3fbf0c9ee9ed on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:53:08.625752 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c34988e-735d-4c59-b6eb-05ac9aef8415 req-c709db47-2524-4ad0-9006-63a9b42b8ff6 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=71d6946a-a0e2-426d-a148-1d5b76c4f68c HTTP/1.1" status: 200 len: 210 time: 0.0522137 Dec 09 21:53:08.663771 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a30bda54-a999-47b2-a9e8-953da4a28ec1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:08.685252 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-a30bda54-a999-47b2-a9e8-953da4a28ec1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:08.700119 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-a30bda54-a999-47b2-a9e8-953da4a28ec1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'aceca204-8e76-42cc-8d81-7615c906ebaa') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:08.700407 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-a30bda54-a999-47b2-a9e8-953da4a28ec1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'aceca204-8e76-42cc-8d81-7615c906ebaa') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:08.710793 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a30bda54-a999-47b2-a9e8-953da4a28ec1 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:08.726076 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a30bda54-a999-47b2-a9e8-953da4a28ec1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:08.734903 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a30bda54-a999-47b2-a9e8-953da4a28ec1 admin admin] Releasing vlan 137 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:53:08.735481 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a30bda54-a999-47b2-a9e8-953da4a28ec1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:53:08.737428 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:53:08.801520 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a30bda54-a999-47b2-a9e8-953da4a28ec1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:08.814104 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a30bda54-a999-47b2-a9e8-953da4a28ec1 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:08.820575 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a30bda54-a999-47b2-a9e8-953da4a28ec1 admin admin] 10.222.0.13 "DELETE /v2.0/networks/87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b HTTP/1.1" status: 204 len: 168 time: 0.9887371 Dec 09 21:53:08.840885 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a30bda54-a999-47b2-a9e8-953da4a28ec1 admin admin] Pushing event deleted for resources: {'Network': ['ID=87dd37cc-c6bc-4c4c-a6f6-da5db6f7404b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:08.998473 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7788c1da-b884-4583-8700-318debf9ba68 req-37b07531-385f-482d-b1de-21fa89374205 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:09.000237 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7788c1da-b884-4583-8700-318debf9ba68 req-37b07531-385f-482d-b1de-21fa89374205 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.31 "GET /v2.0/networks?id=bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2 HTTP/1.1" status: 200 len: 795 time: 0.1530266 Dec 09 21:53:09.109054 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7788c1da-b884-4583-8700-318debf9ba68 req-628cf58e-4b7f-47a4-a0ba-d8233b4de6cd tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=594fec82d9ab4e97a76f8c869f0bbcf0 HTTP/1.1" status: 200 len: 476 time: 0.0980704 Dec 09 21:53:09.118268 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-7788c1da-b884-4583-8700-318debf9ba68 req-8d16dd21-05b4-43f4-bd85-9419eb1a031e tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Request body: {'port': {'device_id': '71d6946a-a0e2-426d-a148-1d5b76c4f68c', 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2', 'admin_state_up': True, 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'security_groups': ['cff07a74-5957-4506-85f7-9b25c08d5db0', '99f9372d-12fa-4d58-a142-20d749c9a2e5']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:09.153817 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 968bf96c-fe29-4aff-afc1-7d0710db3d10 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:53:09.173145 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54164) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:09.225477 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 968bf96c-fe29-4aff-afc1-7d0710db3d10 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:09.226003 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:09.251084 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6b2c1c50-44d7-4abd-a500-32815870a613 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e1c29cd411134d0696683880e25d3ad6&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0765982 Dec 09 21:53:09.254086 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54168) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:09.327192 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7788c1da-b884-4583-8700-318debf9ba68 req-8d16dd21-05b4-43f4-bd85-9419eb1a031e tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Made reservation on behalf of 594fec82d9ab4e97a76f8c869f0bbcf0 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:53:09.331097 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7788c1da-b884-4583-8700-318debf9ba68 req-8d16dd21-05b4-43f4-bd85-9419eb1a031e tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:09.375350 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30ddf979-0b3d-419c-8d29-cc30bba53853 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:09.402157 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device daaf4d44-9b33-4d88-9124-018dbc96289c no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:53:09.425146 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: daaf4d44-9b33-4d88-9124-018dbc96289c {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:53:09.425664 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device daaf4d44-9b33-4d88-9124-018dbc96289c not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:53:09.430539 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 20956168-e0b1-43c0-a98f-3fbf0c9ee9ed no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:53:09.442791 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30ddf979-0b3d-419c-8d29-cc30bba53853 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:09.455116 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 20956168-e0b1-43c0-a98f-3fbf0c9ee9ed {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:53:09.455725 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 20956168-e0b1-43c0-a98f-3fbf0c9ee9ed not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:53:09.530510 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-7788c1da-b884-4583-8700-318debf9ba68 req-8d16dd21-05b4-43f4-bd85-9419eb1a031e tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Allocated IP 172.20.0.10 (bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2/a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5/5bb39f06-5e7c-4c4d-ae8c-af7b245ca536) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:53:09.552656 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30ddf979-0b3d-419c-8d29-cc30bba53853 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:09.555237 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30ddf979-0b3d-419c-8d29-cc30bba53853 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:09.556468 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-30ddf979-0b3d-419c-8d29-cc30bba53853 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/25279242-ee89-4747-9da4-ac3a64774d91 HTTP/1.1" status: 204 len: 168 time: 0.3013666 Dec 09 21:53:09.578065 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30ddf979-0b3d-419c-8d29-cc30bba53853 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=25279242-ee89-4747-9da4-ac3a64774d91,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:09.664565 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:09.706027 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7788c1da-b884-4583-8700-318debf9ba68 req-8d16dd21-05b4-43f4-bd85-9419eb1a031e tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:09.742994 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7788c1da-b884-4583-8700-318debf9ba68 req-8d16dd21-05b4-43f4-bd85-9419eb1a031e tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:09.746266 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83f010f1-ae47-4745-9128-70dbc79197cf req-9a957c67-9d79-4652-b4c6-336a642e5b39 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=71d6946a-a0e2-426d-a148-1d5b76c4f68c HTTP/1.1" status: 200 len: 210 time: 0.0338557 Dec 09 21:53:09.790447 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7788c1da-b884-4583-8700-318debf9ba68 req-8d16dd21-05b4-43f4-bd85-9419eb1a031e tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Network bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:53:09.793667 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-7788c1da-b884-4583-8700-318debf9ba68 req-8d16dd21-05b4-43f4-bd85-9419eb1a031e tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:53:09.797826 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-7788c1da-b884-4583-8700-318debf9ba68 req-8d16dd21-05b4-43f4-bd85-9419eb1a031e tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:53:09.828819 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d16dd21-05b4-43f4-bd85-9419eb1a031e tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event updated for resources: {'Port': ['ID=5bb39f06-5e7c-4c4d-ae8c-af7b245ca536,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:09.857505 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7788c1da-b884-4583-8700-318debf9ba68 req-8d16dd21-05b4-43f4-bd85-9419eb1a031e tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:09.858864 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7788c1da-b884-4583-8700-318debf9ba68 req-8d16dd21-05b4-43f4-bd85-9419eb1a031e tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:09.877742 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7788c1da-b884-4583-8700-318debf9ba68 req-8d16dd21-05b4-43f4-bd85-9419eb1a031e tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 973 time: 0.7632494 Dec 09 21:53:09.895517 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-7788c1da-b884-4583-8700-318debf9ba68 req-a0762bad-c970-4267-bbe4-f6173c19d96c service neutron] Request body: {'port': {'device_id': '71d6946a-a0e2-426d-a148-1d5b76c4f68c', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:09.946877 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54182) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:09.959338 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7788c1da-b884-4583-8700-318debf9ba68 req-a0762bad-c970-4267-bbe4-f6173c19d96c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:09.999196 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-27a02e81-d59c-4102-a8be-ca657f9385db admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=21be760267124f1fa7d0bfc7d602fe2c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0507414 Dec 09 21:53:10.004851 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54184) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:10.056839 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da5b7764-92fd-48ab-bc8e-ef1716cc0632 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:10.078414 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da5b7764-92fd-48ab-bc8e-ef1716cc0632 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:10.118541 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-0606cfbb-9f65-4688-86e7-852eecba10f0 None None] Provisioning complete for port 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:10.119572 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0606cfbb-9f65-4688-86e7-852eecba10f0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:10.143523 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da5b7764-92fd-48ab-bc8e-ef1716cc0632 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:10.147147 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-da5b7764-92fd-48ab-bc8e-ef1716cc0632 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:10.149653 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-da5b7764-92fd-48ab-bc8e-ef1716cc0632 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/af521c3c-3c99-4b67-98df-23dfe79338c8 HTTP/1.1" status: 204 len: 168 time: 0.1435139 Dec 09 21:53:10.177342 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-0606cfbb-9f65-4688-86e7-852eecba10f0 None None] Port 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:53:10.190142 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da5b7764-92fd-48ab-bc8e-ef1716cc0632 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=af521c3c-3c99-4b67-98df-23dfe79338c8,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:10.642281 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-7788c1da-b884-4583-8700-318debf9ba68 req-a0762bad-c970-4267-bbe4-f6173c19d96c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:53:10.650683 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7788c1da-b884-4583-8700-318debf9ba68 req-a0762bad-c970-4267-bbe4-f6173c19d96c service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:10.664963 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-7788c1da-b884-4583-8700-318debf9ba68 req-a0762bad-c970-4267-bbe4-f6173c19d96c service neutron] Transition to ACTIVE for port object 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:53:10.669950 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7788c1da-b884-4583-8700-318debf9ba68 req-a0762bad-c970-4267-bbe4-f6173c19d96c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:10.728904 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0762bad-c970-4267-bbe4-f6173c19d96c service neutron] Pushing event updated for resources: {'Port': ['ID=5bb39f06-5e7c-4c4d-ae8c-af7b245ca536,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:10.834695 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-7788c1da-b884-4583-8700-318debf9ba68 req-a0762bad-c970-4267-bbe4-f6173c19d96c service neutron] Attempting to bind port 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:53:10.836075 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-7788c1da-b884-4583-8700-318debf9ba68 req-a0762bad-c970-4267-bbe4-f6173c19d96c service neutron] Attempting to bind port 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'c1baef7b-1212-4007-90e6-bd8d9f348b6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:53:10.836075 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7788c1da-b884-4583-8700-318debf9ba68 req-a0762bad-c970-4267-bbe4-f6173c19d96c service neutron] Attempting to bind port 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 on network bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:53:10.846333 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7788c1da-b884-4583-8700-318debf9ba68 req-a0762bad-c970-4267-bbe4-f6173c19d96c service neutron] Port 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 on network bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:53:10.846666 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7788c1da-b884-4583-8700-318debf9ba68 req-a0762bad-c970-4267-bbe4-f6173c19d96c service neutron] Attempting to bind port 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 on network bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:53:10.852454 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7788c1da-b884-4583-8700-318debf9ba68 req-a0762bad-c970-4267-bbe4-f6173c19d96c service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 52, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:53:10.852798 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7788c1da-b884-4583-8700-318debf9ba68 req-a0762bad-c970-4267-bbe4-f6173c19d96c service neutron] Checking segment: {'id': 'c1baef7b-1212-4007-90e6-bd8d9f348b6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:53:10.853181 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7788c1da-b884-4583-8700-318debf9ba68 req-a0762bad-c970-4267-bbe4-f6173c19d96c service neutron] Bound using segment: {'id': 'c1baef7b-1212-4007-90e6-bd8d9f348b6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:53:10.853614 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-7788c1da-b884-4583-8700-318debf9ba68 req-a0762bad-c970-4267-bbe4-f6173c19d96c service neutron] Bound port: 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c1baef7b-1212-4007-90e6-bd8d9f348b6f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 145, 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:53:10.854274 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7788c1da-b884-4583-8700-318debf9ba68 req-a0762bad-c970-4267-bbe4-f6173c19d96c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:10.927871 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-7788c1da-b884-4583-8700-318debf9ba68 req-a0762bad-c970-4267-bbe4-f6173c19d96c service neutron] For port 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:53:10.932016 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-7788c1da-b884-4583-8700-318debf9ba68 req-a0762bad-c970-4267-bbe4-f6173c19d96c service neutron] For port 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=5bb39f06-5e7c-4c4d-ae8c-af7b245ca536,segment=NetworkSegment(c1baef7b-1212-4007-90e6-bd8d9f348b6f),segment_id=c1baef7b-1212-4007-90e6-bd8d9f348b6f)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:53:10.936973 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-921e3302-c750-4771-a472-87391ec1074a req-84003088-0924-46a1-a08e-19f0c0439c31 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:10.939563 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-921e3302-c750-4771-a472-87391ec1074a req-84003088-0924-46a1-a08e-19f0c0439c31 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=71d6946a-a0e2-426d-a148-1d5b76c4f68c HTTP/1.1" status: 200 len: 983 time: 0.0589600 Dec 09 21:53:10.940923 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7788c1da-b884-4583-8700-318debf9ba68 req-a0762bad-c970-4267-bbe4-f6173c19d96c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:10.988267 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7788c1da-b884-4583-8700-318debf9ba68 req-a0762bad-c970-4267-bbe4-f6173c19d96c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:10.989475 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7788c1da-b884-4583-8700-318debf9ba68 req-a0762bad-c970-4267-bbe4-f6173c19d96c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:10.991563 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7788c1da-b884-4583-8700-318debf9ba68 req-a0762bad-c970-4267-bbe4-f6173c19d96c service neutron] 10.222.0.31 "PUT /v2.0/ports/5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 HTTP/1.1" status: 200 len: 1132 time: 1.1006732 Dec 09 21:53:10.992217 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '71d6946a-a0e2-426d-a148-1d5b76c4f68c', 'tag': '5bb39f06-5e7c-4c4d-ae8c-af7b245ca536'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:53:10.994521 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a5f74077-fcef-4c0c-a303-489b9e266be4" -d '{"events": [{"name": "network-changed", "server_uuid": "71d6946a-a0e2-426d-a148-1d5b76c4f68c", "tag": "5bb39f06-5e7c-4c4d-ae8c-af7b245ca536"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:53:11.006785 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-921e3302-c750-4771-a472-87391ec1074a req-0fd636d4-73e6-4f77-9111-1fc825e9692c tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/security-groups?id=cff07a74-5957-4506-85f7-9b25c08d5db0&id=99f9372d-12fa-4d58-a142-20d749c9a2e5&fields=id&fields=name HTTP/1.1" status: 200 len: 409 time: 0.0602839 Dec 09 21:53:11.038987 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0762bad-c970-4267-bbe4-f6173c19d96c service neutron] Pushing event updated for resources: {'Port': ['ID=5bb39f06-5e7c-4c4d-ae8c-af7b245ca536,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:11.087421 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:53:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7abfb718-95bb-4d15-b6ef-91d9ddd67927 x-openstack-request-id: req-7abfb718-95bb-4d15-b6ef-91d9ddd67927 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:53:11.087751 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "71d6946a-a0e2-426d-a148-1d5b76c4f68c", "tag": "5bb39f06-5e7c-4c4d-ae8c-af7b245ca536", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:53:11.088007 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-7abfb718-95bb-4d15-b6ef-91d9ddd67927 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:53:11.088417 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '71d6946a-a0e2-426d-a148-1d5b76c4f68c', 'tag': '5bb39f06-5e7c-4c4d-ae8c-af7b245ca536', 'status': 'completed', 'code': 200} Dec 09 21:53:11.105306 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7788c1da-b884-4583-8700-318debf9ba68 req-838b6e20-a30e-4b80-85a4-d8f945922037 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:11.106928 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7788c1da-b884-4583-8700-318debf9ba68 req-838b6e20-a30e-4b80-85a4-d8f945922037 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=594fec82d9ab4e97a76f8c869f0bbcf0&device_id=71d6946a-a0e2-426d-a148-1d5b76c4f68c HTTP/1.1" status: 200 len: 1135 time: 0.0490470 Dec 09 21:53:11.159690 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7788c1da-b884-4583-8700-318debf9ba68 req-198aacdc-3931-46f9-88f5-78fdf459870c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 HTTP/1.1" status: 200 len: 217 time: 0.0412748 Dec 09 21:53:11.217358 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7788c1da-b884-4583-8700-318debf9ba68 req-5a4485f7-88d4-445e-9628-09aba6ea3378 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:11.218873 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7788c1da-b884-4583-8700-318debf9ba68 req-5a4485f7-88d4-445e-9628-09aba6ea3378 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5 HTTP/1.1" status: 200 len: 835 time: 0.0522544 Dec 09 21:53:11.267540 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7788c1da-b884-4583-8700-318debf9ba68 req-8b1269dc-2a13-4cf7-b63d-8cd88e9b96fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:11.269072 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7788c1da-b884-4583-8700-318debf9ba68 req-8b1269dc-2a13-4cf7-b63d-8cd88e9b96fd service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0429623 Dec 09 21:53:11.365068 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7788c1da-b884-4583-8700-318debf9ba68 req-7f807a10-262a-450f-b09c-9a499ce338cc service neutron] 10.222.0.31 "GET /v2.0/networks/bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0887914 Dec 09 21:53:11.458068 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7788c1da-b884-4583-8700-318debf9ba68 req-02e90c89-f842-4073-ad7e-ea43303d750a service neutron] 10.222.0.31 "GET /v2.0/networks/bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0844202 Dec 09 21:53:11.552199 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f74077-fcef-4c0c-a303-489b9e266be4 req-987596f0-18b1-44c8-b7d1-68807ed5773f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:11.553760 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a5f74077-fcef-4c0c-a303-489b9e266be4 req-987596f0-18b1-44c8-b7d1-68807ed5773f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=594fec82d9ab4e97a76f8c869f0bbcf0&device_id=71d6946a-a0e2-426d-a148-1d5b76c4f68c HTTP/1.1" status: 200 len: 1135 time: 0.0505950 Dec 09 21:53:11.654333 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f74077-fcef-4c0c-a303-489b9e266be4 req-6fce04ed-26e2-4ccf-a7fe-dad174423801 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:11.656089 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a5f74077-fcef-4c0c-a303-489b9e266be4 req-6fce04ed-26e2-4ccf-a7fe-dad174423801 service neutron] 10.222.0.31 "GET /v2.0/networks?id=bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2 HTTP/1.1" status: 200 len: 896 time: 0.0934691 Dec 09 21:53:11.703545 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a5f74077-fcef-4c0c-a303-489b9e266be4 req-09c66bd1-8a48-42cf-9db2-537372fe16b0 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 HTTP/1.1" status: 200 len: 217 time: 0.0395350 Dec 09 21:53:11.757103 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f74077-fcef-4c0c-a303-489b9e266be4 req-e5834ed9-0920-49bc-bf95-c1c0b7f400a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:11.758624 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a5f74077-fcef-4c0c-a303-489b9e266be4 req-e5834ed9-0920-49bc-bf95-c1c0b7f400a9 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5 HTTP/1.1" status: 200 len: 835 time: 0.0467832 Dec 09 21:53:11.810059 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f74077-fcef-4c0c-a303-489b9e266be4 req-da1f1bd2-d118-46ec-9e9c-3513984074cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:11.812053 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a5f74077-fcef-4c0c-a303-489b9e266be4 req-da1f1bd2-d118-46ec-9e9c-3513984074cc service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0455322 Dec 09 21:53:11.907371 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a5f74077-fcef-4c0c-a303-489b9e266be4 req-68774821-6664-4b56-86ab-509154c1a4fb service neutron] 10.222.0.31 "GET /v2.0/networks/bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0874615 Dec 09 21:53:12.002872 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a5f74077-fcef-4c0c-a303-489b9e266be4 req-6b2c14a1-0704-4fb9-be0e-fb865828f330 service neutron] 10.222.0.31 "GET /v2.0/networks/bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0881424 Dec 09 21:53:12.131926 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb6463c8-d71c-4518-816d-2e2a92d61e98 req-83a662fe-d69c-4bb9-a9c0-110f723cc887 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:12.133471 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bb6463c8-d71c-4518-816d-2e2a92d61e98 req-83a662fe-d69c-4bb9-a9c0-110f723cc887 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=71d6946a-a0e2-426d-a148-1d5b76c4f68c HTTP/1.1" status: 200 len: 983 time: 0.0515232 Dec 09 21:53:12.191173 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bb6463c8-d71c-4518-816d-2e2a92d61e98 req-61d28934-aac1-4544-a9b8-dfce57790835 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/security-groups?id=cff07a74-5957-4506-85f7-9b25c08d5db0&id=99f9372d-12fa-4d58-a142-20d749c9a2e5&fields=id&fields=name HTTP/1.1" status: 200 len: 409 time: 0.0511220 Dec 09 21:53:13.316721 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ab26460-535a-4591-843b-53c419695ac3 req-c598155a-212f-4e1c-a2fb-34954f80b61e tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:13.318190 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3ab26460-535a-4591-843b-53c419695ac3 req-c598155a-212f-4e1c-a2fb-34954f80b61e tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=71d6946a-a0e2-426d-a148-1d5b76c4f68c HTTP/1.1" status: 200 len: 983 time: 0.0550673 Dec 09 21:53:13.382098 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3ab26460-535a-4591-843b-53c419695ac3 req-3b3fd142-72c3-4d26-9df3-d2ee28367b31 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/security-groups?id=cff07a74-5957-4506-85f7-9b25c08d5db0&id=99f9372d-12fa-4d58-a142-20d749c9a2e5&fields=id&fields=name HTTP/1.1" status: 200 len: 409 time: 0.0574274 Dec 09 21:53:14.035689 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:53:14.136445 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=5bb39f06-5e7c-4c4d-ae8c-af7b245ca536,segment=NetworkSegment(c1baef7b-1212-4007-90e6-bd8d9f348b6f),segment_id=c1baef7b-1212-4007-90e6-bd8d9f348b6f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:14.150727 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '5bb39f06-5e7c-4c4d-ae8c-af7b245ca536', 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2', 'port_id': '5bb39f06-5e7c-4c4d-ae8c-af7b245ca536', 'mac_address': 'fa:16:3e:1d:29:72', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 145, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:53:14.196541 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:14.211779 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:53:14.233646 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=5bb39f06-5e7c-4c4d-ae8c-af7b245ca536,segment=NetworkSegment(c1baef7b-1212-4007-90e6-bd8d9f348b6f),segment_id=c1baef7b-1212-4007-90e6-bd8d9f348b6f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:14.240143 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:14.289555 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=5bb39f06-5e7c-4c4d-ae8c-af7b245ca536,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:14.481661 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['5bb39f06-5e7c-4c4d-ae8c-af7b245ca536'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:53:14.502129 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30b8b398-1d5c-41f0-8641-44b2ef3aa0dd req-c4982bb7-d698-41e7-afe0-f8762058c8ac tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:14.503959 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-30b8b398-1d5c-41f0-8641-44b2ef3aa0dd req-c4982bb7-d698-41e7-afe0-f8762058c8ac tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=71d6946a-a0e2-426d-a148-1d5b76c4f68c HTTP/1.1" status: 200 len: 984 time: 0.0517728 Dec 09 21:53:14.566532 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-30b8b398-1d5c-41f0-8641-44b2ef3aa0dd req-f70ed425-f01f-4868-9e29-da4f40a23b6d tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/security-groups?id=cff07a74-5957-4506-85f7-9b25c08d5db0&id=99f9372d-12fa-4d58-a142-20d749c9a2e5&fields=id&fields=name HTTP/1.1" status: 200 len: 409 time: 0.0563438 Dec 09 21:53:15.044687 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e970cec-7865-44e3-9a33-800dc87dd0c2 req-06669aa7-77b9-482c-bbba-5d83207e259b tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:15.046212 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e970cec-7865-44e3-9a33-800dc87dd0c2 req-06669aa7-77b9-482c-bbba-5d83207e259b tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/ports?device_id=a7cd5203-8be8-4571-9b6a-ccb745d3f244 HTTP/1.1" status: 200 len: 946 time: 0.0616741 Dec 09 21:53:15.108494 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e970cec-7865-44e3-9a33-800dc87dd0c2 req-b49d7dee-64cc-4d2f-abc5-10172577cb8f tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/security-groups?id=ce5c7bc1-de04-4060-901f-bf2612c44351&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0533607 Dec 09 21:53:15.698204 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b4e1bbe-01d6-47d0-a195-c029b640f525 req-8a7f6671-a39c-40b2-b0db-604b6d96da1e tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:15.699714 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2b4e1bbe-01d6-47d0-a195-c029b640f525 req-8a7f6671-a39c-40b2-b0db-604b6d96da1e tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=71d6946a-a0e2-426d-a148-1d5b76c4f68c HTTP/1.1" status: 200 len: 984 time: 0.0515287 Dec 09 21:53:15.760100 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2b4e1bbe-01d6-47d0-a195-c029b640f525 req-0d435c97-72de-4685-9cf6-5acf2b720054 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/security-groups?id=cff07a74-5957-4506-85f7-9b25c08d5db0&id=99f9372d-12fa-4d58-a142-20d749c9a2e5&fields=id&fields=name HTTP/1.1" status: 200 len: 409 time: 0.0526216 Dec 09 21:53:16.050917 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:53:16.104029 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:53:16.108352 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:16.108751 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:16.196587 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:16.218936 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '71d6946a-a0e2-426d-a148-1d5b76c4f68c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5bb39f06-5e7c-4c4d-ae8c-af7b245ca536'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:53:16.221236 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-82ccb4e4-729d-43cf-9d4a-d9c2aaad9251" -d '{"events": [{"server_uuid": "71d6946a-a0e2-426d-a148-1d5b76c4f68c", "name": "network-vif-plugged", "status": "completed", "tag": "5bb39f06-5e7c-4c4d-ae8c-af7b245ca536"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:53:16.236452 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29689035-5449-4c5e-8074-4bade72af26b req-702e369f-f5fc-4177-904f-b1ec3793bdfe tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:16.237154 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=5bb39f06-5e7c-4c4d-ae8c-af7b245ca536,segment=NetworkSegment(c1baef7b-1212-4007-90e6-bd8d9f348b6f),segment_id=c1baef7b-1212-4007-90e6-bd8d9f348b6f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:16.238087 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-29689035-5449-4c5e-8074-4bade72af26b req-702e369f-f5fc-4177-904f-b1ec3793bdfe tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/ports?device_id=a7cd5203-8be8-4571-9b6a-ccb745d3f244 HTTP/1.1" status: 200 len: 946 time: 0.0525248 Dec 09 21:53:16.241756 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:16.295158 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=5bb39f06-5e7c-4c4d-ae8c-af7b245ca536,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:16.301000 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-29689035-5449-4c5e-8074-4bade72af26b req-6cfb317e-7efb-43ae-b1d1-3289bd2e3c61 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/security-groups?id=ce5c7bc1-de04-4060-901f-bf2612c44351&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0528378 Dec 09 21:53:16.352305 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:53:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-58f5b230-0440-4448-9559-64d89317c6e8 x-openstack-request-id: req-58f5b230-0440-4448-9559-64d89317c6e8 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:53:16.352586 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "71d6946a-a0e2-426d-a148-1d5b76c4f68c", "name": "network-vif-plugged", "status": "completed", "tag": "5bb39f06-5e7c-4c4d-ae8c-af7b245ca536", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:53:16.352864 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-58f5b230-0440-4448-9559-64d89317c6e8 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:53:16.353233 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '71d6946a-a0e2-426d-a148-1d5b76c4f68c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5bb39f06-5e7c-4c4d-ae8c-af7b245ca536', 'code': 200} Dec 09 21:53:16.461749 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5e7f68b-9071-4e22-b784-67ffa1d11dbd req-64657c9f-784a-40ef-97a3-ce8016ac8caa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:16.463307 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f5e7f68b-9071-4e22-b784-67ffa1d11dbd req-64657c9f-784a-40ef-97a3-ce8016ac8caa service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=71d6946a-a0e2-426d-a148-1d5b76c4f68c HTTP/1.1" status: 200 len: 1137 time: 0.0427053 Dec 09 21:53:16.564290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd2a0a34-36ac-488e-9058-4ee95b6e2de6 req-c18def8a-65be-45f8-83f9-afb0c60a8ed4 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:16.565695 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fd2a0a34-36ac-488e-9058-4ee95b6e2de6 req-c18def8a-65be-45f8-83f9-afb0c60a8ed4 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.31 "GET /v2.0/ports?device_id=a7cd5203-8be8-4571-9b6a-ccb745d3f244 HTTP/1.1" status: 200 len: 946 time: 0.0901687 Dec 09 21:53:16.568533 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f5e7f68b-9071-4e22-b784-67ffa1d11dbd req-8ae4f043-0717-40e2-834a-a1b5ee716beb service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=99f9372d-12fa-4d58-a142-20d749c9a2e5&id=cff07a74-5957-4506-85f7-9b25c08d5db0&fields=id&fields=name HTTP/1.1" status: 200 len: 409 time: 0.0918746 Dec 09 21:53:16.864504 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-fd2a0a34-36ac-488e-9058-4ee95b6e2de6 req-f781cae5-ae57-4081-a9ff-2df467e57e0e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Deleting port 81fcff43-a433-4ab6-8549-e6a7daf568ec {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:53:16.864864 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fd2a0a34-36ac-488e-9058-4ee95b6e2de6 req-f781cae5-ae57-4081-a9ff-2df467e57e0e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:16.891534 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-609a07ae-dccf-41f1-90b8-cf932b3ef45b req-96a36df6-fe12-4c1b-864b-0f9437e75ae5 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:16.893051 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-609a07ae-dccf-41f1-90b8-cf932b3ef45b req-96a36df6-fe12-4c1b-864b-0f9437e75ae5 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=71d6946a-a0e2-426d-a148-1d5b76c4f68c HTTP/1.1" status: 200 len: 985 time: 0.0547705 Dec 09 21:53:16.950142 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-609a07ae-dccf-41f1-90b8-cf932b3ef45b req-e254d937-d7d0-45bd-8ffc-066b9866e6c4 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/security-groups?id=cff07a74-5957-4506-85f7-9b25c08d5db0&id=99f9372d-12fa-4d58-a142-20d749c9a2e5&fields=id&fields=name HTTP/1.1" status: 200 len: 409 time: 0.0508459 Dec 09 21:53:16.958503 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-fd2a0a34-36ac-488e-9058-4ee95b6e2de6 req-f781cae5-ae57-4081-a9ff-2df467e57e0e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] For port 81fcff43-a433-4ab6-8549-e6a7daf568ec, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=81fcff43-a433-4ab6-8549-e6a7daf568ec,segment=NetworkSegment(fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8),segment_id=fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:16.958850 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fd2a0a34-36ac-488e-9058-4ee95b6e2de6 req-f781cae5-ae57-4081-a9ff-2df467e57e0e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:16.972598 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-fd2a0a34-36ac-488e-9058-4ee95b6e2de6 req-f781cae5-ae57-4081-a9ff-2df467e57e0e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Calling delete_port for 81fcff43-a433-4ab6-8549-e6a7daf568ec owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:53:17.113064 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fd2a0a34-36ac-488e-9058-4ee95b6e2de6 req-f781cae5-ae57-4081-a9ff-2df467e57e0e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:17.124419 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['81fcff43-a433-4ab6-8549-e6a7daf568ec'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:53:17.142362 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f781cae5-ae57-4081-a9ff-2df467e57e0e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Pushing event deleted for resources: {'Port': ['ID=81fcff43-a433-4ab6-8549-e6a7daf568ec,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:17.155070 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f781cae5-ae57-4081-a9ff-2df467e57e0e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:17.155430 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f781cae5-ae57-4081-a9ff-2df467e57e0e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:17.155803 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f781cae5-ae57-4081-a9ff-2df467e57e0e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:17.156178 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f781cae5-ae57-4081-a9ff-2df467e57e0e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:17.156571 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f781cae5-ae57-4081-a9ff-2df467e57e0e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:17.157000 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f781cae5-ae57-4081-a9ff-2df467e57e0e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:17.157373 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f781cae5-ae57-4081-a9ff-2df467e57e0e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:17.157588 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f781cae5-ae57-4081-a9ff-2df467e57e0e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:17.157939 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f781cae5-ae57-4081-a9ff-2df467e57e0e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:17.158269 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f781cae5-ae57-4081-a9ff-2df467e57e0e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:17.158590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f781cae5-ae57-4081-a9ff-2df467e57e0e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:17.158914 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f781cae5-ae57-4081-a9ff-2df467e57e0e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:17.159215 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f781cae5-ae57-4081-a9ff-2df467e57e0e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:17.193443 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-fd2a0a34-36ac-488e-9058-4ee95b6e2de6 req-f781cae5-ae57-4081-a9ff-2df467e57e0e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] No DVR routers for this DVR port 81fcff43-a433-4ab6-8549-e6a7daf568ec on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:53:17.196088 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-fd2a0a34-36ac-488e-9058-4ee95b6e2de6 req-f781cae5-ae57-4081-a9ff-2df467e57e0e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:17.199477 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fd2a0a34-36ac-488e-9058-4ee95b6e2de6 req-f781cae5-ae57-4081-a9ff-2df467e57e0e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.31 "DELETE /v2.0/ports/81fcff43-a433-4ab6-8549-e6a7daf568ec HTTP/1.1" status: 204 len: 173 time: 0.4355133 Dec 09 21:53:17.199923 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a7cd5203-8be8-4571-9b6a-ccb745d3f244', 'name': 'network-vif-deleted', 'tag': '81fcff43-a433-4ab6-8549-e6a7daf568ec'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:53:17.202195 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5e044f3e-d819-4782-a0a2-9b603c8cd71f" -d '{"events": [{"server_uuid": "a7cd5203-8be8-4571-9b6a-ccb745d3f244", "name": "network-vif-deleted", "tag": "81fcff43-a433-4ab6-8549-e6a7daf568ec"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:53:17.240990 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:53:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c7b84d15-3ecb-482d-82b9-58ea8ac50234 x-openstack-request-id: req-c7b84d15-3ecb-482d-82b9-58ea8ac50234 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:53:17.241294 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a7cd5203-8be8-4571-9b6a-ccb745d3f244", "name": "network-vif-deleted", "tag": "81fcff43-a433-4ab6-8549-e6a7daf568ec", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:53:17.241549 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c7b84d15-3ecb-482d-82b9-58ea8ac50234 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:53:17.241963 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a7cd5203-8be8-4571-9b6a-ccb745d3f244', 'name': 'network-vif-deleted', 'tag': '81fcff43-a433-4ab6-8549-e6a7daf568ec', 'status': 'completed', 'code': 200} Dec 09 21:53:17.409286 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31021229-f770-4e41-a112-196944f4c026 req-c006c572-8d2c-4715-9938-63021b593535 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/ports?device_id=a7cd5203-8be8-4571-9b6a-ccb745d3f244 HTTP/1.1" status: 200 len: 210 time: 0.0269778 Dec 09 21:53:18.084402 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67cbbe1e-a2e0-407f-a8b9-d8949ceead2e req-e18bb68c-8f44-4237-acb4-6ad59704a24b tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:18.086007 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67cbbe1e-a2e0-407f-a8b9-d8949ceead2e req-e18bb68c-8f44-4237-acb4-6ad59704a24b tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=71d6946a-a0e2-426d-a148-1d5b76c4f68c HTTP/1.1" status: 200 len: 985 time: 0.0549312 Dec 09 21:53:18.146292 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67cbbe1e-a2e0-407f-a8b9-d8949ceead2e req-b7cb6bb4-6382-424e-b7f7-324acc7c591c tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/security-groups?id=cff07a74-5957-4506-85f7-9b25c08d5db0&id=99f9372d-12fa-4d58-a142-20d749c9a2e5&fields=id&fields=name HTTP/1.1" status: 200 len: 409 time: 0.0537894 Dec 09 21:53:18.272833 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65e4a244-9209-4614-b30d-f51155342707 req-7d3af5b3-9ffe-40ff-a838-abadf0ca1a82 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:18.274345 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-65e4a244-9209-4614-b30d-f51155342707 req-7d3af5b3-9ffe-40ff-a838-abadf0ca1a82 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=71d6946a-a0e2-426d-a148-1d5b76c4f68c HTTP/1.1" status: 200 len: 985 time: 0.0597928 Dec 09 21:53:18.334681 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-65e4a244-9209-4614-b30d-f51155342707 req-415f0104-78cf-48ba-92df-9bb6030b171e tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/security-groups?id=cff07a74-5957-4506-85f7-9b25c08d5db0&id=99f9372d-12fa-4d58-a142-20d749c9a2e5&fields=id&fields=name HTTP/1.1" status: 200 len: 409 time: 0.0540528 Dec 09 21:53:18.444507 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f914775-1932-47d5-8136-d7949bb58aec req-56bc4285-ca30-48d5-bc81-9a3812779b5d tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:18.446035 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f914775-1932-47d5-8136-d7949bb58aec req-56bc4285-ca30-48d5-bc81-9a3812779b5d tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=71d6946a-a0e2-426d-a148-1d5b76c4f68c HTTP/1.1" status: 200 len: 1137 time: 0.0455680 Dec 09 21:53:18.464544 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4f914775-1932-47d5-8136-d7949bb58aec req-4d9b4e1c-00ad-4ebd-b8f7-b402813a0640 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:18.546151 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4f914775-1932-47d5-8136-d7949bb58aec req-4d9b4e1c-00ad-4ebd-b8f7-b402813a0640 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:18.551618 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-4f914775-1932-47d5-8136-d7949bb58aec req-4d9b4e1c-00ad-4ebd-b8f7-b402813a0640 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:18.599010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d9b4e1c-00ad-4ebd-b8f7-b402813a0640 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Pushing event updated for resources: {'SecurityGroup': ['ID=011fc51a-94af-4eec-903e-f116ba590915,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:18.604793 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f914775-1932-47d5-8136-d7949bb58aec req-4d9b4e1c-00ad-4ebd-b8f7-b402813a0640 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=cff07a74-5957-4506-85f7-9b25c08d5db0&id=99f9372d-12fa-4d58-a142-20d749c9a2e5&fields=id&fields=name HTTP/1.1" status: 200 len: 409 time: 0.1524532 Dec 09 21:53:18.627381 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54242) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:18.678716 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7f2719c-f6c7-4622-b64c-80613caac379 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:18.680294 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e7f2719c-f6c7-4622-b64c-80613caac379 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=71d6946a-a0e2-426d-a148-1d5b76c4f68c HTTP/1.1" status: 200 len: 1132 time: 0.0519516 Dec 09 21:53:18.683638 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54246) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:18.688226 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-3e114835-7ee2-4ee2-b957-a0f261962c66 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': '5bb39f06-5e7c-4c4d-ae8c-af7b245ca536', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'fixed_ip_address': '172.20.0.10'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:18.713946 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e114835-7ee2-4ee2-b957-a0f261962c66 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for floatingip, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:18.817060 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e114835-7ee2-4ee2-b957-a0f261962c66 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:18.931369 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-3e114835-7ee2-4ee2-b957-a0f261962c66 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Allocated IP 172.25.3.107 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/bdb2d922-a20c-4d5b-a1ac-c4bedc041f12) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:53:19.035931 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e114835-7ee2-4ee2-b957-a0f261962c66 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:19.071078 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e114835-7ee2-4ee2-b957-a0f261962c66 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:19.114047 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3e114835-7ee2-4ee2-b957-a0f261962c66 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:53:19.120512 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-3e114835-7ee2-4ee2-b957-a0f261962c66 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:53:19.125238 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e114835-7ee2-4ee2-b957-a0f261962c66 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:53:19.129529 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e114835-7ee2-4ee2-b957-a0f261962c66 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event updated for resources: {'Port': ['ID=bdb2d922-a20c-4d5b-a1ac-c4bedc041f12,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:19.504765 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e114835-7ee2-4ee2-b957-a0f261962c66 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:19.575043 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e114835-7ee2-4ee2-b957-a0f261962c66 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:19.738027 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e114835-7ee2-4ee2-b957-a0f261962c66 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:19.743861 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e114835-7ee2-4ee2-b957-a0f261962c66 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:19.817531 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e114835-7ee2-4ee2-b957-a0f261962c66 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event updated for resources: {'Port': ['ID=bdb2d922-a20c-4d5b-a1ac-c4bedc041f12,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:19.825678 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e114835-7ee2-4ee2-b957-a0f261962c66 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:19.928373 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-3e114835-7ee2-4ee2-b957-a0f261962c66 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Floating IP 35067f66-8275-4a95-ae8b-4c9ce1a86ac2 associated. External IP: 172.25.3.107, port: 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536. Dec 09 21:53:20.098844 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 81fcff43-a433-4ab6-8549-e6a7daf568ec no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:53:20.135284 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 81fcff43-a433-4ab6-8549-e6a7daf568ec {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:53:20.135647 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 81fcff43-a433-4ab6-8549-e6a7daf568ec not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:53:20.202547 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3e114835-7ee2-4ee2-b957-a0f261962c66 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Router 7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:53:20.322997 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3e114835-7ee2-4ee2-b957-a0f261962c66 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:53:20.332867 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-802a480d-17f7-4853-a7c4-3bedbeb80140 None None] Sync routers for ids ['7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:53:20.343914 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-802a480d-17f7-4853-a7c4-3bedbeb80140 None None] Routers {'7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:53:20.344820 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-802a480d-17f7-4853-a7c4-3bedbeb80140 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:53:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:20.347156 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e114835-7ee2-4ee2-b957-a0f261962c66 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:20.379339 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3e114835-7ee2-4ee2-b957-a0f261962c66 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.6944387 Dec 09 21:53:20.379926 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '71d6946a-a0e2-426d-a148-1d5b76c4f68c', 'tag': '5bb39f06-5e7c-4c4d-ae8c-af7b245ca536'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:53:20.381973 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54252) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:20.383627 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-90d1410b-804f-41e8-a0fb-a314a6f2abf0" -d '{"events": [{"name": "network-changed", "server_uuid": "71d6946a-a0e2-426d-a148-1d5b76c4f68c", "tag": "5bb39f06-5e7c-4c4d-ae8c-af7b245ca536"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:53:20.422048 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:53:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8b78f301-9f1c-45a0-9ca0-b578d77d3588 x-openstack-request-id: req-8b78f301-9f1c-45a0-9ca0-b578d77d3588 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:53:20.422523 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "71d6946a-a0e2-426d-a148-1d5b76c4f68c", "tag": "5bb39f06-5e7c-4c4d-ae8c-af7b245ca536", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:53:20.422959 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8b78f301-9f1c-45a0-9ca0-b578d77d3588 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:53:20.423924 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '71d6946a-a0e2-426d-a148-1d5b76c4f68c', 'tag': '5bb39f06-5e7c-4c4d-ae8c-af7b245ca536', 'status': 'completed', 'code': 200} Dec 09 21:53:20.457925 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-802a480d-17f7-4853-a7c4-3bedbeb80140 None None] Set router 7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:53:20.503360 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90d1410b-804f-41e8-a0fb-a314a6f2abf0 req-8a35ad6f-dece-4494-9a71-a526a824a6c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:20.505102 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-90d1410b-804f-41e8-a0fb-a314a6f2abf0 req-8a35ad6f-dece-4494-9a71-a526a824a6c9 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=594fec82d9ab4e97a76f8c869f0bbcf0&device_id=71d6946a-a0e2-426d-a148-1d5b76c4f68c HTTP/1.1" status: 200 len: 1137 time: 0.0428169 Dec 09 21:53:20.564767 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb1715bb-8e2e-4a0f-bf85-89538664f82a tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:20.565240 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb1715bb-8e2e-4a0f-bf85-89538664f82a tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:20.565698 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb1715bb-8e2e-4a0f-bf85-89538664f82a tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:20.566182 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb1715bb-8e2e-4a0f-bf85-89538664f82a tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:20.566636 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb1715bb-8e2e-4a0f-bf85-89538664f82a tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:20.567080 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb1715bb-8e2e-4a0f-bf85-89538664f82a tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:20.572490 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-fb1715bb-8e2e-4a0f-bf85-89538664f82a tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] 10.222.0.13 "GET /v2.0/networks HTTP/1.1" status: 200 len: 4271 time: 0.1889119 Dec 09 21:53:20.572490 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54256) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:20.605728 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90d1410b-804f-41e8-a0fb-a314a6f2abf0 req-21b82da6-e0cc-428e-8da9-2177dcafed51 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:20.607464 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-90d1410b-804f-41e8-a0fb-a314a6f2abf0 req-21b82da6-e0cc-428e-8da9-2177dcafed51 service neutron] 10.222.0.31 "GET /v2.0/networks?id=bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2 HTTP/1.1" status: 200 len: 896 time: 0.0949731 Dec 09 21:53:20.631142 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52d15417-fff8-49cf-9f62-fb4188f2a764 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:20.632198 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52d15417-fff8-49cf-9f62-fb4188f2a764 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:20.632661 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52d15417-fff8-49cf-9f62-fb4188f2a764 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:20.633105 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52d15417-fff8-49cf-9f62-fb4188f2a764 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:20.633549 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52d15417-fff8-49cf-9f62-fb4188f2a764 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:20.633991 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52d15417-fff8-49cf-9f62-fb4188f2a764 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:20.635794 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-52d15417-fff8-49cf-9f62-fb4188f2a764 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] 10.222.0.13 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 3992 time: 0.0623837 Dec 09 21:53:20.638637 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54258) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:20.678151 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-90d1410b-804f-41e8-a0fb-a314a6f2abf0 req-997eea3b-b61e-484e-825f-e9112adfc147 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 HTTP/1.1" status: 200 len: 1000 time: 0.0639307 Dec 09 21:53:20.698422 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-802a480d-17f7-4853-a7c4-3bedbeb80140 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-551544193', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173'}], 'enable_snat': True}, 'gw_port_id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:56Z', 'updated_at': '2021-12-09T21:53:03Z', 'revision_number': 4, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'gw_port': {'id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ea:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3858, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:57Z', 'updated_at': '2021-12-09T21:53:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '35067f66-8275-4a95-ae8b-4c9ce1a86ac2', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'floating_ip_address': '172.25.3.107', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'port_id': '5bb39f06-5e7c-4c4d-ae8c-af7b245ca536', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 3876, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2', 'mac_address': 'fa:16:3e:1d:29:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71d6946a-a0e2-426d-a148-1d5b76c4f68c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:53:19Z', 'updated_at': '2021-12-09T21:53:19Z', 'revision_number': 0, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '968bf96c-fe29-4aff-afc1-7d0710db3d10', 'name': '', 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'mac_address': 'fa:16:3e:13:a3:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'device_owner': 'network:router_interface', 'standard_attr_id': 3861, 'fixed_ips': [{'subnet_id': 'a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:02Z', 'updated_at': '2021-12-09T21:53:06Z', 'revision_number': 5, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'subnets': [{'id': 'a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:20.725782 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-802a480d-17f7-4853-a7c4-3bedbeb80140 None None] Checking router: 7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:53:20.734149 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-802a480d-17f7-4853-a7c4-3bedbeb80140 None None] Routers {'7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:53:20.734474 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90d1410b-804f-41e8-a0fb-a314a6f2abf0 req-fdeb4a8d-4d97-4bc1-9688-22cb778a0a27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:20.735126 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-802a480d-17f7-4853-a7c4-3bedbeb80140 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:53:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:20.736224 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-90d1410b-804f-41e8-a0fb-a314a6f2abf0 req-fdeb4a8d-4d97-4bc1-9688-22cb778a0a27 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5 HTTP/1.1" status: 200 len: 835 time: 0.0501711 Dec 09 21:53:20.774302 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-022aa828-4082-4961-8aa6-b3f6066b350f tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] 10.222.0.13 "GET /v2.0/routers HTTP/1.1" status: 200 len: 2340 time: 0.1344588 Dec 09 21:53:20.777325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54260) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:20.803198 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90d1410b-804f-41e8-a0fb-a314a6f2abf0 req-c51ae5e8-f005-4012-81cc-2be8b407142c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:20.804815 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-90d1410b-804f-41e8-a0fb-a314a6f2abf0 req-c51ae5e8-f005-4012-81cc-2be8b407142c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0607581 Dec 09 21:53:20.822037 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-54df625f-e43f-40b1-93b4-3fff99fe27b9 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:20.822807 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-54df625f-e43f-40b1-93b4-3fff99fe27b9 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:20.824611 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-54df625f-e43f-40b1-93b4-3fff99fe27b9 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e HTTP/1.1" status: 200 len: 1992 time: 0.0463800 Dec 09 21:53:20.855466 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-802a480d-17f7-4853-a7c4-3bedbeb80140 None None] Set router 7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:53:20.907928 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-90d1410b-804f-41e8-a0fb-a314a6f2abf0 req-83e0824e-b5b7-4405-b449-bd06bb7b03d8 service neutron] 10.222.0.31 "GET /v2.0/networks/bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0942662 Dec 09 21:53:21.012302 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-90d1410b-804f-41e8-a0fb-a314a6f2abf0 req-524b930e-c1b3-4e84-b157-f894a281b9b8 service neutron] 10.222.0.31 "GET /v2.0/networks/bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0944858 Dec 09 21:53:21.096974 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-802a480d-17f7-4853-a7c4-3bedbeb80140 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-551544193', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173'}], 'enable_snat': True}, 'gw_port_id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:56Z', 'updated_at': '2021-12-09T21:53:03Z', 'revision_number': 4, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'gw_port': {'id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ea:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3858, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:57Z', 'updated_at': '2021-12-09T21:53:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '35067f66-8275-4a95-ae8b-4c9ce1a86ac2', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'floating_ip_address': '172.25.3.107', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'port_id': '5bb39f06-5e7c-4c4d-ae8c-af7b245ca536', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 3876, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2', 'mac_address': 'fa:16:3e:1d:29:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71d6946a-a0e2-426d-a148-1d5b76c4f68c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:53:19Z', 'updated_at': '2021-12-09T21:53:19Z', 'revision_number': 0, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '968bf96c-fe29-4aff-afc1-7d0710db3d10', 'name': '', 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'mac_address': 'fa:16:3e:13:a3:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'device_owner': 'network:router_interface', 'standard_attr_id': 3861, 'fixed_ips': [{'subnet_id': 'a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:02Z', 'updated_at': '2021-12-09T21:53:06Z', 'revision_number': 5, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'subnets': [{'id': 'a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:21.123839 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-802a480d-17f7-4853-a7c4-3bedbeb80140 None None] The sync data for ids ['7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'] in n-d-713301-27 is: [{'id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-551544193', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173'}], 'enable_snat': True}, 'gw_port_id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:56Z', 'updated_at': '2021-12-09T21:53:03Z', 'revision_number': 4, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'gw_port': {'id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ea:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3858, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:57Z', 'updated_at': '2021-12-09T21:53:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '35067f66-8275-4a95-ae8b-4c9ce1a86ac2', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'floating_ip_address': '172.25.3.107', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'port_id': '5bb39f06-5e7c-4c4d-ae8c-af7b245ca536', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 3876, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2', 'mac_address': 'fa:16:3e:1d:29:72', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '71d6946a-a0e2-426d-a148-1d5b76c4f68c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:53:19Z', 'updated_at': '2021-12-09T21:53:19Z', 'revision_number': 0, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '968bf96c-fe29-4aff-afc1-7d0710db3d10', 'name': '', 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'mac_address': 'fa:16:3e:13:a3:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'device_owner': 'network:router_interface', 'standard_attr_id': 3861, 'fixed_ips': [{'subnet_id': 'a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:02Z', 'updated_at': '2021-12-09T21:53:06Z', 'revision_number': 5, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'subnets': [{'id': 'a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:53:21.333959 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b6e7b16-9864-4bd8-b8d5-114927faa8fe None None] New status for floating IP 35067f66-8275-4a95-ae8b-4c9ce1a86ac2: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:53:23.323078 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54288) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:23.500770 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-439a8f75-1af1-4f21-b1a2-b1a9d2808b8d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Deleting port 3929cee5-813b-483c-a625-9a1af2282e29 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:53:23.501120 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-439a8f75-1af1-4f21-b1a2-b1a9d2808b8d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:23.579169 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-439a8f75-1af1-4f21-b1a2-b1a9d2808b8d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:23.579389 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-439a8f75-1af1-4f21-b1a2-b1a9d2808b8d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:23.591221 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-439a8f75-1af1-4f21-b1a2-b1a9d2808b8d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Calling delete_port for 3929cee5-813b-483c-a625-9a1af2282e29 owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:53:23.779106 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-439a8f75-1af1-4f21-b1a2-b1a9d2808b8d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:23.805165 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-439a8f75-1af1-4f21-b1a2-b1a9d2808b8d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'Port': ['ID=3929cee5-813b-483c-a625-9a1af2282e29,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:23.882378 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-439a8f75-1af1-4f21-b1a2-b1a9d2808b8d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:23.882664 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-439a8f75-1af1-4f21-b1a2-b1a9d2808b8d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Floating IP e7a2e8df-af1c-4df1-9f51-140291c8185b disassociated (deleted). External IP: 172.25.3.237, port: 50c46228-45fd-43c8-9fd2-e6ae52717651. Dec 09 21:53:24.096466 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-439a8f75-1af1-4f21-b1a2-b1a9d2808b8d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Router 9c1d018e-ab43-4dc3-aa27-cf34a503bdd1 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:53:24.216763 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-439a8f75-1af1-4f21-b1a2-b1a9d2808b8d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:53:24.222110 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-439a8f75-1af1-4f21-b1a2-b1a9d2808b8d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:24.229397 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07a8880c-cb87-4967-a1aa-068073d5c1b4 None None] Sync routers for ids ['9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:53:24.241593 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07a8880c-cb87-4967-a1aa-068073d5c1b4 None None] Routers {'9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:53:24.242312 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-07a8880c-cb87-4967-a1aa-068073d5c1b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:53:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:24.250718 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-439a8f75-1af1-4f21-b1a2-b1a9d2808b8d tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "DELETE /v2.0/floatingips/e7a2e8df-af1c-4df1-9f51-140291c8185b HTTP/1.1" status: 204 len: 168 time: 0.9261658 Dec 09 21:53:24.251496 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cdcb1836-6369-4540-b4f2-07f714a9590f', 'tag': '50c46228-45fd-43c8-9fd2-e6ae52717651'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:53:24.254650 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-696bf231-56da-4498-9293-70947e0230eb" -d '{"events": [{"name": "network-changed", "server_uuid": "cdcb1836-6369-4540-b4f2-07f714a9590f", "tag": "50c46228-45fd-43c8-9fd2-e6ae52717651"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:53:24.365957 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-07a8880c-cb87-4967-a1aa-068073d5c1b4 None None] Set router 9c1d018e-ab43-4dc3-aa27-cf34a503bdd1 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:53:24.436416 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:53:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c4f34196-ba78-4cca-b395-f92c3c6350ad x-openstack-request-id: req-c4f34196-ba78-4cca-b395-f92c3c6350ad {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:53:24.437039 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "cdcb1836-6369-4540-b4f2-07f714a9590f", "tag": "50c46228-45fd-43c8-9fd2-e6ae52717651", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:53:24.437039 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c4f34196-ba78-4cca-b395-f92c3c6350ad {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:53:24.437470 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cdcb1836-6369-4540-b4f2-07f714a9590f', 'tag': '50c46228-45fd-43c8-9fd2-e6ae52717651', 'status': 'completed', 'code': 200} Dec 09 21:53:24.533371 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-696bf231-56da-4498-9293-70947e0230eb req-1fdfee72-c358-4d81-bca0-c57f5fd08e7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:24.535570 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-696bf231-56da-4498-9293-70947e0230eb req-1fdfee72-c358-4d81-bca0-c57f5fd08e7b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=dce7594ac2a74901912a2f19de04bf79&device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 1097 time: 0.0584002 Dec 09 21:53:24.555708 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b491667e-8d33-4f88-a161-8f0c4a20e884 req-91c6e957-2dea-4ee7-9bb9-b418593cf887 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:24.558160 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b491667e-8d33-4f88-a161-8f0c4a20e884 req-91c6e957-2dea-4ee7-9bb9-b418593cf887 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 945 time: 0.0625324 Dec 09 21:53:24.616887 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b491667e-8d33-4f88-a161-8f0c4a20e884 req-1ad6edf4-0ab1-4c0e-8c38-58a158820598 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0496790 Dec 09 21:53:24.659473 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-696bf231-56da-4498-9293-70947e0230eb req-fc30dba0-3945-40b2-bb12-b43d12c6111a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:24.661131 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-696bf231-56da-4498-9293-70947e0230eb req-fc30dba0-3945-40b2-bb12-b43d12c6111a service neutron] 10.222.0.31 "GET /v2.0/networks?id=dbbab540-d32c-4ae4-8405-4fd5a5d9b94c HTTP/1.1" status: 200 len: 898 time: 0.1159501 Dec 09 21:53:24.703690 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-07a8880c-cb87-4967-a1aa-068073d5c1b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-279236251', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80'}], 'enable_snat': True}, 'gw_port_id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:34Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:8c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3762, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '34b5b36b-2611-4360-8169-d595d507e923', 'name': '', 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:78:ac:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'device_owner': 'network:router_interface', 'standard_attr_id': 3767, 'fixed_ips': [{'subnet_id': 'df92f5f0-ea14-470b-bca7-c613b8daecf5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:32Z', 'updated_at': '2021-12-09T21:51:40Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': 'df92f5f0-ea14-470b-bca7-c613b8daecf5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:24.718770 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-696bf231-56da-4498-9293-70947e0230eb req-662ad929-c87f-4f54-ab85-137175f93073 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=50c46228-45fd-43c8-9fd2-e6ae52717651 HTTP/1.1" status: 200 len: 217 time: 0.0490313 Dec 09 21:53:24.758036 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07a8880c-cb87-4967-a1aa-068073d5c1b4 None None] Checking router: 9c1d018e-ab43-4dc3-aa27-cf34a503bdd1 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:53:24.788452 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07a8880c-cb87-4967-a1aa-068073d5c1b4 None None] Routers {'9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:53:24.788452 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-07a8880c-cb87-4967-a1aa-068073d5c1b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:53:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:24.827316 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-696bf231-56da-4498-9293-70947e0230eb req-612f640f-23aa-4fb3-ad09-5ce9345117ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:24.828949 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-696bf231-56da-4498-9293-70947e0230eb req-612f640f-23aa-4fb3-ad09-5ce9345117ec service neutron] 10.222.0.31 "GET /v2.0/subnets?id=df92f5f0-ea14-470b-bca7-c613b8daecf5 HTTP/1.1" status: 200 len: 834 time: 0.0999081 Dec 09 21:53:24.878944 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-696bf231-56da-4498-9293-70947e0230eb req-a776b22d-b5c8-4029-9b55-1d0cc4ed269e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:24.880548 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-696bf231-56da-4498-9293-70947e0230eb req-a776b22d-b5c8-4029-9b55-1d0cc4ed269e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=dbbab540-d32c-4ae4-8405-4fd5a5d9b94c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0433800 Dec 09 21:53:24.917701 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-07a8880c-cb87-4967-a1aa-068073d5c1b4 None None] Set router 9c1d018e-ab43-4dc3-aa27-cf34a503bdd1 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:53:24.982581 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-696bf231-56da-4498-9293-70947e0230eb req-1fb33068-fca8-4ecb-9bf1-0b9e0e14496f service neutron] 10.222.0.31 "GET /v2.0/networks/dbbab540-d32c-4ae4-8405-4fd5a5d9b94c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0939298 Dec 09 21:53:25.074587 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-696bf231-56da-4498-9293-70947e0230eb req-95cc71d3-0ebc-4e17-9144-068decd16b8e service neutron] 10.222.0.31 "GET /v2.0/networks/dbbab540-d32c-4ae4-8405-4fd5a5d9b94c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0832286 Dec 09 21:53:25.114176 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-07a8880c-cb87-4967-a1aa-068073d5c1b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-279236251', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80'}], 'enable_snat': True}, 'gw_port_id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:34Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:8c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3762, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '34b5b36b-2611-4360-8169-d595d507e923', 'name': '', 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:78:ac:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'device_owner': 'network:router_interface', 'standard_attr_id': 3767, 'fixed_ips': [{'subnet_id': 'df92f5f0-ea14-470b-bca7-c613b8daecf5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:32Z', 'updated_at': '2021-12-09T21:51:40Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': 'df92f5f0-ea14-470b-bca7-c613b8daecf5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:25.143944 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07a8880c-cb87-4967-a1aa-068073d5c1b4 None None] The sync data for ids ['9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'] in n-d-713301-27 is: [{'id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-279236251', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80'}], 'enable_snat': True}, 'gw_port_id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:34Z', 'revision_number': 4, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:8c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3762, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '34b5b36b-2611-4360-8169-d595d507e923', 'name': '', 'network_id': 'dbbab540-d32c-4ae4-8405-4fd5a5d9b94c', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'mac_address': 'fa:16:3e:78:ac:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'device_owner': 'network:router_interface', 'standard_attr_id': 3767, 'fixed_ips': [{'subnet_id': 'df92f5f0-ea14-470b-bca7-c613b8daecf5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:32Z', 'updated_at': '2021-12-09T21:51:40Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'subnets': [{'id': 'df92f5f0-ea14-470b-bca7-c613b8daecf5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:53:25.372936 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5021e0d-d162-4a1f-8f0b-f27f413070fd None None] New status for floating IP e7a2e8df-af1c-4df1-9f51-140291c8185b: DOWN {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:53:25.656999 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-2e60d11c-bd46-45b4-bf56-a40b2842946f tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:25.658552 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-2e60d11c-bd46-45b4-bf56-a40b2842946f tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/networks?id=eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a HTTP/1.1" status: 200 len: 814 time: 0.1090074 Dec 09 21:53:25.674522 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-1c2e9540-382c-44ba-9d6f-957ade8a824c tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/quotas/2671ed6f9fdf4c9cb0e0438099319f7d HTTP/1.1" status: 200 len: 375 time: 0.0097766 Dec 09 21:53:25.705582 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-400dd3bb-323e-4781-a6ff-96f7b6597813 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=2671ed6f9fdf4c9cb0e0438099319f7d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0257328 Dec 09 21:53:25.761660 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87a74f0f-3f7a-4119-b5cf-db5911b5bb2d req-021c8e0f-ed8b-4486-b087-a9f6260a3e77 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:25.763162 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-87a74f0f-3f7a-4119-b5cf-db5911b5bb2d req-021c8e0f-ed8b-4486-b087-a9f6260a3e77 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.31 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 945 time: 0.0488667 Dec 09 21:53:25.797383 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-cb14e982-0c66-41ed-8867-c93505419d62 service neutron] 10.222.0.13 "GET /v2.0/networks/eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0847347 Dec 09 21:53:25.859862 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-87a74f0f-3f7a-4119-b5cf-db5911b5bb2d req-202f1093-03bd-4d64-a3fd-f643ba893066 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Deleting port 50c46228-45fd-43c8-9fd2-e6ae52717651 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:53:25.860209 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-87a74f0f-3f7a-4119-b5cf-db5911b5bb2d req-202f1093-03bd-4d64-a3fd-f643ba893066 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:25.890851 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-be7259bb-e927-46b8-89b7-378c77e4813a service neutron] 10.222.0.13 "GET /v2.0/networks/eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0877569 Dec 09 21:53:25.954015 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-87a74f0f-3f7a-4119-b5cf-db5911b5bb2d req-202f1093-03bd-4d64-a3fd-f643ba893066 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] For port 50c46228-45fd-43c8-9fd2-e6ae52717651, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=50c46228-45fd-43c8-9fd2-e6ae52717651,segment=NetworkSegment(bbcc9b75-8c59-49b6-9441-82060a46e422),segment_id=bbcc9b75-8c59-49b6-9441-82060a46e422)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:25.954387 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-87a74f0f-3f7a-4119-b5cf-db5911b5bb2d req-202f1093-03bd-4d64-a3fd-f643ba893066 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:25.966577 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-87a74f0f-3f7a-4119-b5cf-db5911b5bb2d req-202f1093-03bd-4d64-a3fd-f643ba893066 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Calling delete_port for 50c46228-45fd-43c8-9fd2-e6ae52717651 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:53:26.089334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fedfe008-0e2d-4476-9cc6-3fb73e13dd41 req-ee2ba869-42d2-40b6-a1e9-f8d462829e30 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:26.090847 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fedfe008-0e2d-4476-9cc6-3fb73e13dd41 req-ee2ba869-42d2-40b6-a1e9-f8d462829e30 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/ports?device_id=cdcb1836-6369-4540-b4f2-07f714a9590f HTTP/1.1" status: 200 len: 945 time: 0.0514991 Dec 09 21:53:26.104584 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-87a74f0f-3f7a-4119-b5cf-db5911b5bb2d req-202f1093-03bd-4d64-a3fd-f643ba893066 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:26.133258 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-202f1093-03bd-4d64-a3fd-f643ba893066 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'Port': ['ID=50c46228-45fd-43c8-9fd2-e6ae52717651,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:26.149817 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fedfe008-0e2d-4476-9cc6-3fb73e13dd41 req-02a06cfe-79f8-4ad4-b0af-900d5c83ad71 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "GET /v2.0/security-groups?id=1731c834-efb2-47cd-b818-853b3aef0517&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0526948 Dec 09 21:53:26.196541 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-87a74f0f-3f7a-4119-b5cf-db5911b5bb2d req-202f1093-03bd-4d64-a3fd-f643ba893066 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] No DVR routers for this DVR port 50c46228-45fd-43c8-9fd2-e6ae52717651 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:53:26.199266 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-87a74f0f-3f7a-4119-b5cf-db5911b5bb2d req-202f1093-03bd-4d64-a3fd-f643ba893066 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:26.203612 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-87a74f0f-3f7a-4119-b5cf-db5911b5bb2d req-202f1093-03bd-4d64-a3fd-f643ba893066 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.31 "DELETE /v2.0/ports/50c46228-45fd-43c8-9fd2-e6ae52717651 HTTP/1.1" status: 204 len: 173 time: 0.4330986 Dec 09 21:53:26.229164 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e62242b-a33c-4063-81aa-92f39868bc6b req-3ea09f86-8337-4b11-89eb-1bbb651dd778 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/ports?device_id=fce69021-c7d1-432f-a078-b917814309b9 HTTP/1.1" status: 200 len: 210 time: 0.0318503 Dec 09 21:53:26.439261 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cdcb1836-6369-4540-b4f2-07f714a9590f', 'name': 'network-vif-deleted', 'tag': '50c46228-45fd-43c8-9fd2-e6ae52717651'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:53:26.441752 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a18001f6-c3b7-4b05-9efd-24951a052e9b" -d '{"events": [{"server_uuid": "cdcb1836-6369-4540-b4f2-07f714a9590f", "name": "network-vif-deleted", "tag": "50c46228-45fd-43c8-9fd2-e6ae52717651"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:53:26.489612 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:53:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-736a8372-cf79-4277-ba5a-b9ba7342c984 x-openstack-request-id: req-736a8372-cf79-4277-ba5a-b9ba7342c984 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:53:26.489911 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "cdcb1836-6369-4540-b4f2-07f714a9590f", "name": "network-vif-deleted", "tag": "50c46228-45fd-43c8-9fd2-e6ae52717651", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:53:26.490167 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-736a8372-cf79-4277-ba5a-b9ba7342c984 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:53:26.490576 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cdcb1836-6369-4540-b4f2-07f714a9590f', 'name': 'network-vif-deleted', 'tag': '50c46228-45fd-43c8-9fd2-e6ae52717651', 'status': 'completed', 'code': 200} Dec 09 21:53:27.086077 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-c4e77c1e-ae24-42f2-8c60-c097adfd2a48 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:27.087463 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-c4e77c1e-ae24-42f2-8c60-c097adfd2a48 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.31 "GET /v2.0/networks?id=eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a HTTP/1.1" status: 200 len: 814 time: 0.1016641 Dec 09 21:53:27.100542 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-2b5cf87e-bf3f-4a84-862d-3ee4d439088a tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Request body: {'port': {'device_id': 'fce69021-c7d1-432f-a078-b917814309b9', 'network_id': 'eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a', 'admin_state_up': True, 'tenant_id': '2671ed6f9fdf4c9cb0e0438099319f7d'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:27.214313 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-2b5cf87e-bf3f-4a84-862d-3ee4d439088a tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Made reservation on behalf of 2671ed6f9fdf4c9cb0e0438099319f7d for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:53:27.215372 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54330) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:27.217848 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-2b5cf87e-bf3f-4a84-862d-3ee4d439088a tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:27.348516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-2b5cf87e-bf3f-4a84-862d-3ee4d439088a tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Allocated IP 172.20.0.3 (eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a/938dec21-7b2e-4de4-a129-71c1f3ba1dd6/27fa9a24-1d20-4e50-aaa5-c9c665553e6f) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:53:27.352799 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:27.586931 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:27.717354 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e9dfc11-167e-45ae-bf66-71acb9b798be req-00ffb88b-9c52-4532-9ede-818712de271e tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/ports?device_id=fce69021-c7d1-432f-a078-b917814309b9 HTTP/1.1" status: 200 len: 210 time: 0.4072151 Dec 09 21:53:27.841061 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-2b5cf87e-bf3f-4a84-862d-3ee4d439088a tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:27.875785 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-2b5cf87e-bf3f-4a84-862d-3ee4d439088a tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:27.921141 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-2b5cf87e-bf3f-4a84-862d-3ee4d439088a tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Network eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:53:27.924823 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-2b5cf87e-bf3f-4a84-862d-3ee4d439088a tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:53:27.928485 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-2b5cf87e-bf3f-4a84-862d-3ee4d439088a tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:53:27.956088 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b5cf87e-bf3f-4a84-862d-3ee4d439088a tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Pushing event updated for resources: {'Port': ['ID=27fa9a24-1d20-4e50-aaa5-c9c665553e6f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:27.982884 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b57e4668-1fe7-47eb-9f10-9ad241fa95d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:27.985129 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-2b5cf87e-bf3f-4a84-862d-3ee4d439088a tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:27.985763 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-2b5cf87e-bf3f-4a84-862d-3ee4d439088a tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:28.002631 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-2b5cf87e-bf3f-4a84-862d-3ee4d439088a tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9057088 Dec 09 21:53:28.014606 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-07911cc4-9766-4313-b8ba-5f4f63586bf3 service neutron] Request body: {'port': {'device_id': 'fce69021-c7d1-432f-a078-b917814309b9', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:28.067243 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-07911cc4-9766-4313-b8ba-5f4f63586bf3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:28.111373 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 50c46228-45fd-43c8-9fd2-e6ae52717651 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:53:28.252332 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-b57e4668-1fe7-47eb-9f10-9ad241fa95d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Deleting port 34b5b36b-2611-4360-8169-d595d507e923 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:53:28.253288 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b57e4668-1fe7-47eb-9f10-9ad241fa95d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:28.300956 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 50c46228-45fd-43c8-9fd2-e6ae52717651 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:53:28.301300 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 50c46228-45fd-43c8-9fd2-e6ae52717651 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:53:28.347517 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-b57e4668-1fe7-47eb-9f10-9ad241fa95d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] For port 34b5b36b-2611-4360-8169-d595d507e923, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=34b5b36b-2611-4360-8169-d595d507e923,segment=NetworkSegment(bbcc9b75-8c59-49b6-9441-82060a46e422),segment_id=bbcc9b75-8c59-49b6-9441-82060a46e422)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:28.347891 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b57e4668-1fe7-47eb-9f10-9ad241fa95d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:28.348166 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-07911cc4-9766-4313-b8ba-5f4f63586bf3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 27fa9a24-1d20-4e50-aaa5-c9c665553e6f {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:53:28.355786 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-07911cc4-9766-4313-b8ba-5f4f63586bf3 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:28.360955 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-b57e4668-1fe7-47eb-9f10-9ad241fa95d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Calling delete_port for 34b5b36b-2611-4360-8169-d595d507e923 owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:53:28.368361 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-07911cc4-9766-4313-b8ba-5f4f63586bf3 service neutron] Transition to ACTIVE for port object 27fa9a24-1d20-4e50-aaa5-c9c665553e6f will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:53:28.373080 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-07911cc4-9766-4313-b8ba-5f4f63586bf3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:28.422188 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07911cc4-9766-4313-b8ba-5f4f63586bf3 service neutron] Pushing event updated for resources: {'Port': ['ID=27fa9a24-1d20-4e50-aaa5-c9c665553e6f,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:28.493800 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-07911cc4-9766-4313-b8ba-5f4f63586bf3 service neutron] Attempting to bind port 27fa9a24-1d20-4e50-aaa5-c9c665553e6f on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:53:28.494108 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-07911cc4-9766-4313-b8ba-5f4f63586bf3 service neutron] Attempting to bind port 27fa9a24-1d20-4e50-aaa5-c9c665553e6f by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:53:28.494458 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-07911cc4-9766-4313-b8ba-5f4f63586bf3 service neutron] Attempting to bind port 27fa9a24-1d20-4e50-aaa5-c9c665553e6f on network eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:53:28.498900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-07911cc4-9766-4313-b8ba-5f4f63586bf3 service neutron] Port 27fa9a24-1d20-4e50-aaa5-c9c665553e6f on network eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:53:28.499246 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-07911cc4-9766-4313-b8ba-5f4f63586bf3 service neutron] Attempting to bind port 27fa9a24-1d20-4e50-aaa5-c9c665553e6f on network eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:53:28.504938 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-07911cc4-9766-4313-b8ba-5f4f63586bf3 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 53, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:53:28.505214 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-07911cc4-9766-4313-b8ba-5f4f63586bf3 service neutron] Checking segment: {'id': 'fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:53:28.505593 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-07911cc4-9766-4313-b8ba-5f4f63586bf3 service neutron] Bound using segment: {'id': 'fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:53:28.506019 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-07911cc4-9766-4313-b8ba-5f4f63586bf3 service neutron] Bound port: 27fa9a24-1d20-4e50-aaa5-c9c665553e6f, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 139, 'network_id': 'eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:53:28.506373 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-07911cc4-9766-4313-b8ba-5f4f63586bf3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:28.552780 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b57e4668-1fe7-47eb-9f10-9ad241fa95d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:28.578947 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-07911cc4-9766-4313-b8ba-5f4f63586bf3 service neutron] For port 27fa9a24-1d20-4e50-aaa5-c9c665553e6f, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:53:28.582415 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-07911cc4-9766-4313-b8ba-5f4f63586bf3 service neutron] For port 27fa9a24-1d20-4e50-aaa5-c9c665553e6f, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=27fa9a24-1d20-4e50-aaa5-c9c665553e6f,segment=NetworkSegment(fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8),segment_id=fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:53:28.587271 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-07911cc4-9766-4313-b8ba-5f4f63586bf3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:28.595190 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b57e4668-1fe7-47eb-9f10-9ad241fa95d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'Port': ['ID=34b5b36b-2611-4360-8169-d595d507e923,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:28.624030 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-07911cc4-9766-4313-b8ba-5f4f63586bf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:28.625022 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-07911cc4-9766-4313-b8ba-5f4f63586bf3 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:28.626579 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-07911cc4-9766-4313-b8ba-5f4f63586bf3 service neutron] 10.222.0.31 "PUT /v2.0/ports/27fa9a24-1d20-4e50-aaa5-c9c665553e6f HTTP/1.1" status: 200 len: 1092 time: 0.6156487 Dec 09 21:53:28.626774 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fce69021-c7d1-432f-a078-b917814309b9', 'tag': '27fa9a24-1d20-4e50-aaa5-c9c665553e6f'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:53:28.629375 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-18675637-527e-4aab-b4c9-8648917d8e4c" -d '{"events": [{"name": "network-changed", "server_uuid": "fce69021-c7d1-432f-a078-b917814309b9", "tag": "27fa9a24-1d20-4e50-aaa5-c9c665553e6f"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:53:28.661601 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07911cc4-9766-4313-b8ba-5f4f63586bf3 service neutron] Pushing event updated for resources: {'Port': ['ID=27fa9a24-1d20-4e50-aaa5-c9c665553e6f,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:28.689695 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:53:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-92935c8d-8513-4e7a-8b76-7b73f61d1697 x-openstack-request-id: req-92935c8d-8513-4e7a-8b76-7b73f61d1697 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:53:28.689976 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fce69021-c7d1-432f-a078-b917814309b9", "tag": "27fa9a24-1d20-4e50-aaa5-c9c665553e6f", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:53:28.690236 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-92935c8d-8513-4e7a-8b76-7b73f61d1697 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:53:28.690647 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fce69021-c7d1-432f-a078-b917814309b9', 'tag': '27fa9a24-1d20-4e50-aaa5-c9c665553e6f', 'status': 'completed', 'code': 200} Dec 09 21:53:28.723162 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-add1158f-420d-47f4-adb7-788970ca57b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:28.724780 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-add1158f-420d-47f4-adb7-788970ca57b1 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2671ed6f9fdf4c9cb0e0438099319f7d&device_id=fce69021-c7d1-432f-a078-b917814309b9 HTTP/1.1" status: 200 len: 1095 time: 0.0476198 Dec 09 21:53:28.783342 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-f1af95bf-a7a8-4177-925f-c5ac260a4d49 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=27fa9a24-1d20-4e50-aaa5-c9c665553e6f HTTP/1.1" status: 200 len: 217 time: 0.0504029 Dec 09 21:53:28.840670 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b57e4668-1fe7-47eb-9f10-9ad241fa95d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:28.842060 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-dfe1fbfa-d259-48d0-bbf2-517477c3db29 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:28.843954 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-dfe1fbfa-d259-48d0-bbf2-517477c3db29 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=938dec21-7b2e-4de4-a129-71c1f3ba1dd6 HTTP/1.1" status: 200 len: 854 time: 0.0535054 Dec 09 21:53:28.876209 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-8eaffa35-470e-4eb0-a5b0-fc373289e244 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0251234 Dec 09 21:53:28.895880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c0288ee-6588-4539-b066-b7ac004a930a req-57cd50cb-db40-4e12-b3ab-5d096556500b tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:28.898592 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c0288ee-6588-4539-b066-b7ac004a930a req-57cd50cb-db40-4e12-b3ab-5d096556500b tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/ports?device_id=fce69021-c7d1-432f-a078-b917814309b9 HTTP/1.1" status: 200 len: 943 time: 0.1046803 Dec 09 21:53:28.968180 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-c5fbe01b-cd82-408f-b009-9607437e1c6c service neutron] 10.222.0.31 "GET /v2.0/networks/eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0851088 Dec 09 21:53:28.994241 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c0288ee-6588-4539-b066-b7ac004a930a req-be719d2c-4cd7-4535-bb5e-c24e8745e432 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/security-groups?id=ce5c7bc1-de04-4060-901f-bf2612c44351&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0890489 Dec 09 21:53:29.064528 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8fae0b7b-2b21-4241-98ca-4b917780cbb1 req-676455a9-bca5-45bd-8ae5-3d316335f3e9 service neutron] 10.222.0.31 "GET /v2.0/networks/eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0892897 Dec 09 21:53:29.112557 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b57e4668-1fe7-47eb-9f10-9ad241fa95d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Router 9c1d018e-ab43-4dc3-aa27-cf34a503bdd1 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:53:29.159141 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18675637-527e-4aab-b4c9-8648917d8e4c req-f2ef4e2d-e75b-4f9b-ae3b-f3893e92eeef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:29.160696 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-18675637-527e-4aab-b4c9-8648917d8e4c req-f2ef4e2d-e75b-4f9b-ae3b-f3893e92eeef service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2671ed6f9fdf4c9cb0e0438099319f7d&device_id=fce69021-c7d1-432f-a078-b917814309b9 HTTP/1.1" status: 200 len: 1095 time: 0.0456195 Dec 09 21:53:29.223174 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b57e4668-1fe7-47eb-9f10-9ad241fa95d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:53:29.228609 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b57e4668-1fe7-47eb-9f10-9ad241fa95d4 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "PUT /v2.0/routers/9c1d018e-ab43-4dc3-aa27-cf34a503bdd1/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0112631 Dec 09 21:53:29.231162 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54338) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:29.235295 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f103cdb8-cd98-4002-827f-8dd57f1b673e None None] Sync routers for ids ['9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:53:29.244856 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f103cdb8-cd98-4002-827f-8dd57f1b673e None None] Routers {'9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:53:29.245476 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f103cdb8-cd98-4002-827f-8dd57f1b673e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:53:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:29.254009 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18675637-527e-4aab-b4c9-8648917d8e4c req-70af100e-c667-4763-82c0-67161d316798 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:29.255549 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-18675637-527e-4aab-b4c9-8648917d8e4c req-70af100e-c667-4763-82c0-67161d316798 service neutron] 10.222.0.31 "GET /v2.0/networks?id=eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a HTTP/1.1" status: 200 len: 915 time: 0.0875440 Dec 09 21:53:29.285574 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-eb79d78b-6e2f-422f-87bc-f5d06923790c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Deleting subnet df92f5f0-ea14-470b-bca7-c613b8daecf5 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:53:29.288765 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eb79d78b-6e2f-422f-87bc-f5d06923790c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:29.307464 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-18675637-527e-4aab-b4c9-8648917d8e4c req-2d2668a9-7cd5-457a-bacb-86d98459e3d5 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=27fa9a24-1d20-4e50-aaa5-c9c665553e6f HTTP/1.1" status: 200 len: 217 time: 0.0445669 Dec 09 21:53:29.330624 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eb79d78b-6e2f-422f-87bc-f5d06923790c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:29.355937 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-f103cdb8-cd98-4002-827f-8dd57f1b673e None None] Set router 9c1d018e-ab43-4dc3-aa27-cf34a503bdd1 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:53:29.360780 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18675637-527e-4aab-b4c9-8648917d8e4c req-40aae103-bbf7-42d2-9759-04a437791e02 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:29.362281 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-18675637-527e-4aab-b4c9-8648917d8e4c req-40aae103-bbf7-42d2-9759-04a437791e02 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=938dec21-7b2e-4de4-a129-71c1f3ba1dd6 HTTP/1.1" status: 200 len: 854 time: 0.0457172 Dec 09 21:53:29.396366 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-18675637-527e-4aab-b4c9-8648917d8e4c req-71029e0b-745d-4fb3-a616-938cfb645c52 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0253973 Dec 09 21:53:29.424550 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eb79d78b-6e2f-422f-87bc-f5d06923790c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:29.486560 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eb79d78b-6e2f-422f-87bc-f5d06923790c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:29.504493 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-18675637-527e-4aab-b4c9-8648917d8e4c req-18577cbe-d5e6-46bf-9bbf-17e837e07cb5 service neutron] 10.222.0.31 "GET /v2.0/networks/eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1002562 Dec 09 21:53:29.517646 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb79d78b-6e2f-422f-87bc-f5d06923790c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'Subnet': ['ID=df92f5f0-ea14-470b-bca7-c613b8daecf5,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:29.524212 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-eb79d78b-6e2f-422f-87bc-f5d06923790c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:29.529912 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-eb79d78b-6e2f-422f-87bc-f5d06923790c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "DELETE /v2.0/subnets/df92f5f0-ea14-470b-bca7-c613b8daecf5 HTTP/1.1" status: 204 len: 168 time: 0.2953289 Dec 09 21:53:29.530173 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54340) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:29.536434 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ddbda3da-3876-4f39-a738-d9cb1089dd6d None None] Network dbbab540-d32c-4ae4-8405-4fd5a5d9b94c requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:53:29.543410 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f103cdb8-cd98-4002-827f-8dd57f1b673e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-279236251', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80'}], 'enable_snat': True}, 'gw_port_id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:53:28Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:8c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3762, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:29.574262 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f103cdb8-cd98-4002-827f-8dd57f1b673e None None] Checking router: 9c1d018e-ab43-4dc3-aa27-cf34a503bdd1 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:53:29.583803 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f103cdb8-cd98-4002-827f-8dd57f1b673e None None] Routers {'9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:53:29.584479 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f103cdb8-cd98-4002-827f-8dd57f1b673e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:53:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:29.615094 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-18675637-527e-4aab-b4c9-8648917d8e4c req-869be73c-dc5c-4a60-9364-ba6057265e01 service neutron] 10.222.0.31 "GET /v2.0/networks/eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1028254 Dec 09 21:53:29.683740 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:29.709762 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-f103cdb8-cd98-4002-827f-8dd57f1b673e None None] Set router 9c1d018e-ab43-4dc3-aa27-cf34a503bdd1 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:53:29.713239 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b1b064e7-fd49-432b-a4ec-b98a5495fe20 None None] DHCP port deletion for dbbab540-d32c-4ae4-8405-4fd5a5d9b94c request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:53:29.760287 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-b1b064e7-fd49-432b-a4ec-b98a5495fe20 None None] Deleting port 9af3cfd9-c449-420f-a79b-81fa9c03465d {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:53:29.760663 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b1b064e7-fd49-432b-a4ec-b98a5495fe20 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:29.794278 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:29.827143 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-b1b064e7-fd49-432b-a4ec-b98a5495fe20 None None] For port 9af3cfd9-c449-420f-a79b-81fa9c03465d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=9af3cfd9-c449-420f-a79b-81fa9c03465d,segment=NetworkSegment(bbcc9b75-8c59-49b6-9441-82060a46e422),segment_id=bbcc9b75-8c59-49b6-9441-82060a46e422)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:29.827645 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b1b064e7-fd49-432b-a4ec-b98a5495fe20 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:29.846585 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-b1b064e7-fd49-432b-a4ec-b98a5495fe20 None None] Calling delete_port for 9af3cfd9-c449-420f-a79b-81fa9c03465d owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:53:29.849316 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Deleting port b3e30202-b84c-499d-8636-99b6c3b89dde {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:53:29.849670 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:29.905832 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f103cdb8-cd98-4002-827f-8dd57f1b673e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-279236251', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80'}], 'enable_snat': True}, 'gw_port_id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:53:28Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:8c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3762, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:29.931764 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b1b064e7-fd49-432b-a4ec-b98a5495fe20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:29.933100 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f103cdb8-cd98-4002-827f-8dd57f1b673e None None] The sync data for ids ['9c1d018e-ab43-4dc3-aa27-cf34a503bdd1'] in n-d-713301-27 is: [{'id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-279236251', 'tenant_id': 'dce7594ac2a74901912a2f19de04bf79', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80'}], 'enable_snat': True}, 'gw_port_id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:53:28Z', 'revision_number': 5, 'project_id': 'dce7594ac2a74901912a2f19de04bf79', 'gw_port': {'id': 'b3e30202-b84c-499d-8636-99b6c3b89dde', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:8c:6f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c1d018e-ab43-4dc3-aa27-cf34a503bdd1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3762, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.80', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:51:26Z', 'updated_at': '2021-12-09T21:51:31Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:53:29.938495 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] For port b3e30202-b84c-499d-8636-99b6c3b89dde, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b3e30202-b84c-499d-8636-99b6c3b89dde,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:29.938778 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:29.952120 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Calling delete_port for b3e30202-b84c-499d-8636-99b6c3b89dde owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:53:29.956368 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1b064e7-fd49-432b-a4ec-b98a5495fe20 None None] Pushing event deleted for resources: {'Port': ['ID=9af3cfd9-c449-420f-a79b-81fa9c03465d,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:29.962087 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1b064e7-fd49-432b-a4ec-b98a5495fe20 None None] No DVR routers for this DVR port 9af3cfd9-c449-420f-a79b-81fa9c03465d on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:53:30.111950 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 27fa9a24-1d20-4e50-aaa5-c9c665553e6f details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:53:30.147560 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41bbad81-61ac-4770-83b3-f501b9b36352 req-8ba2d68e-eebf-4b78-8462-459e43c5fc0a tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:30.149046 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-41bbad81-61ac-4770-83b3-f501b9b36352 req-8ba2d68e-eebf-4b78-8462-459e43c5fc0a tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/ports?device_id=fce69021-c7d1-432f-a078-b917814309b9 HTTP/1.1" status: 200 len: 943 time: 0.0822437 Dec 09 21:53:30.191578 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:30.212943 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 27fa9a24-1d20-4e50-aaa5-c9c665553e6f, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=27fa9a24-1d20-4e50-aaa5-c9c665553e6f,segment=NetworkSegment(fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8),segment_id=fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:30.223935 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '27fa9a24-1d20-4e50-aaa5-c9c665553e6f', 'network_id': 'eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a', 'port_id': '27fa9a24-1d20-4e50-aaa5-c9c665553e6f', 'mac_address': 'fa:16:3e:7f:f2:6d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 139, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '938dec21-7b2e-4de4-a129-71c1f3ba1dd6', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:53:30.229109 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'Port': ['ID=b3e30202-b84c-499d-8636-99b6c3b89dde,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:30.238931 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-41bbad81-61ac-4770-83b3-f501b9b36352 req-8380b7a6-a382-4d81-a93c-975d931e7907 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/security-groups?id=ce5c7bc1-de04-4060-901f-bf2612c44351&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0830259 Dec 09 21:53:30.249860 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-151d968e-7cfc-4ec4-8729-acfa405e54ca None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:53:30.262564 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:30.262905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:30.263266 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:30.263651 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:30.263990 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:30.264312 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:30.264638 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:30.264993 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:30.265306 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:30.265639 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:30.265957 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:30.266383 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:30.266707 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:30.271979 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:30.292960 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 27fa9a24-1d20-4e50-aaa5-c9c665553e6f {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:53:30.309785 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:30.320180 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 27fa9a24-1d20-4e50-aaa5-c9c665553e6f, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=27fa9a24-1d20-4e50-aaa5-c9c665553e6f,segment=NetworkSegment(fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8),segment_id=fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:30.327363 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:30.378604 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=27fa9a24-1d20-4e50-aaa5-c9c665553e6f,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:30.408392 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:30.410825 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:30.455996 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:30.456566 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Fanout notify agent at l3_agent the message router_deleted on router 9c1d018e-ab43-4dc3-aa27-cf34a503bdd1 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:53:30.464960 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:30.467982 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f89b49ba-d926-4a75-bd50-4d802a318f27 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "DELETE /v2.0/routers/9c1d018e-ab43-4dc3-aa27-cf34a503bdd1 HTTP/1.1" status: 204 len: 168 time: 0.9367499 Dec 09 21:53:30.468733 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54344) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:30.530956 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['27fa9a24-1d20-4e50-aaa5-c9c665553e6f'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:53:30.548812 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a627ad87-cabc-4952-830d-1818d22e8c00 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:30.644471 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a627ad87-cabc-4952-830d-1818d22e8c00 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:30.672952 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-a627ad87-cabc-4952-830d-1818d22e8c00 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['dbbab540-d32c-4ae4-8405-4fd5a5d9b94c']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:30.683878 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-a627ad87-cabc-4952-830d-1818d22e8c00 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bbcc9b75-8c59-49b6-9441-82060a46e422') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:30.684176 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-a627ad87-cabc-4952-830d-1818d22e8c00 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bbcc9b75-8c59-49b6-9441-82060a46e422') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:30.694201 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a627ad87-cabc-4952-830d-1818d22e8c00 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:30.707140 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a627ad87-cabc-4952-830d-1818d22e8c00 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:30.712852 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a627ad87-cabc-4952-830d-1818d22e8c00 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Releasing vlan 112 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:53:30.713238 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a627ad87-cabc-4952-830d-1818d22e8c00 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:53:30.716166 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:53:30.778679 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a627ad87-cabc-4952-830d-1818d22e8c00 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:30.790880 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a627ad87-cabc-4952-830d-1818d22e8c00 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:30.797282 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a627ad87-cabc-4952-830d-1818d22e8c00 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "DELETE /v2.0/networks/dbbab540-d32c-4ae4-8405-4fd5a5d9b94c HTTP/1.1" status: 204 len: 168 time: 0.3275518 Dec 09 21:53:30.800011 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54346) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:30.816405 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a627ad87-cabc-4952-830d-1818d22e8c00 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'Network': ['ID=dbbab540-d32c-4ae4-8405-4fd5a5d9b94c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:30.866524 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-591c86ea-a80b-4248-9a49-c6f4f1660486 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:30.900633 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-591c86ea-a80b-4248-9a49-c6f4f1660486 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:30.965608 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-591c86ea-a80b-4248-9a49-c6f4f1660486 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:30.968377 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-591c86ea-a80b-4248-9a49-c6f4f1660486 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:30.969569 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-591c86ea-a80b-4248-9a49-c6f4f1660486 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] 10.222.0.13 "DELETE /v2.0/security-groups/1731c834-efb2-47cd-b818-853b3aef0517 HTTP/1.1" status: 204 len: 168 time: 0.1686151 Dec 09 21:53:30.978941 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-591c86ea-a80b-4248-9a49-c6f4f1660486 tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1731c834-efb2-47cd-b818-853b3aef0517,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:31.106162 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 34b5b36b-2611-4360-8169-d595d507e923 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:53:31.129763 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 34b5b36b-2611-4360-8169-d595d507e923 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:53:31.130104 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 34b5b36b-2611-4360-8169-d595d507e923 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:53:31.130500 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9af3cfd9-c449-420f-a79b-81fa9c03465d no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:53:31.149984 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 9af3cfd9-c449-420f-a79b-81fa9c03465d {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:53:31.150322 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 9af3cfd9-c449-420f-a79b-81fa9c03465d not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:53:31.150785 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b3e30202-b84c-499d-8636-99b6c3b89dde no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:53:31.170269 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: b3e30202-b84c-499d-8636-99b6c3b89dde {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:53:31.170610 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b3e30202-b84c-499d-8636-99b6c3b89dde not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:53:31.278790 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54356) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:31.375607 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1701fa0c-0eee-4d84-a1f6-1224269e378d req-7ed40a24-9787-4cef-bd22-192bc8923326 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:31.377430 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1701fa0c-0eee-4d84-a1f6-1224269e378d req-7ed40a24-9787-4cef-bd22-192bc8923326 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/ports?device_id=fce69021-c7d1-432f-a078-b917814309b9 HTTP/1.1" status: 200 len: 944 time: 0.0513194 Dec 09 21:53:31.444993 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1ba3b9e0-ad76-419b-98d3-4ec65f167186 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=dce7594ac2a74901912a2f19de04bf79&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1646729 Dec 09 21:53:31.447797 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54360) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:31.448712 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1701fa0c-0eee-4d84-a1f6-1224269e378d req-b516a505-e496-4ab9-a89e-647a84713846 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/security-groups?id=ce5c7bc1-de04-4060-901f-bf2612c44351&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0644028 Dec 09 21:53:31.499766 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bf83b2aa-d5ef-41b9-a18f-c16ff984f9ba admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:31.523003 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bf83b2aa-d5ef-41b9-a18f-c16ff984f9ba admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:31.576916 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bf83b2aa-d5ef-41b9-a18f-c16ff984f9ba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:31.580126 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bf83b2aa-d5ef-41b9-a18f-c16ff984f9ba admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:31.581348 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bf83b2aa-d5ef-41b9-a18f-c16ff984f9ba admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/0637a134-8109-472c-a5e7-d4a5a860b96c HTTP/1.1" status: 204 len: 168 time: 0.1325309 Dec 09 21:53:31.589704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf83b2aa-d5ef-41b9-a18f-c16ff984f9ba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0637a134-8109-472c-a5e7-d4a5a860b96c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:31.868054 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54366) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:31.908322 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-51a99014-d23d-4ac4-8073-72687df26c3c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=bbc10c82e99a475bb784b9ed15b43213&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0390306 Dec 09 21:53:31.912055 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54368) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:31.969518 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82f0288c-b50d-4545-bef7-c23af8175758 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:31.992579 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82f0288c-b50d-4545-bef7-c23af8175758 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:32.050284 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82f0288c-b50d-4545-bef7-c23af8175758 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:32.053005 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-82f0288c-b50d-4545-bef7-c23af8175758 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:32.054169 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-82f0288c-b50d-4545-bef7-c23af8175758 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/2b662a7b-61cc-471a-b834-dfeada7ed11a HTTP/1.1" status: 204 len: 168 time: 0.1410203 Dec 09 21:53:32.061925 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82f0288c-b50d-4545-bef7-c23af8175758 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2b662a7b-61cc-471a-b834-dfeada7ed11a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:32.111782 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 27fa9a24-1d20-4e50-aaa5-c9c665553e6f up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:53:32.160951 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 27fa9a24-1d20-4e50-aaa5-c9c665553e6f completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:53:32.165362 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 27fa9a24-1d20-4e50-aaa5-c9c665553e6f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:32.165810 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:32.254128 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:32.276783 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fce69021-c7d1-432f-a078-b917814309b9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '27fa9a24-1d20-4e50-aaa5-c9c665553e6f'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:53:32.279053 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-877d677b-0ddf-4402-9ef8-2ec96881ca76" -d '{"events": [{"server_uuid": "fce69021-c7d1-432f-a078-b917814309b9", "name": "network-vif-plugged", "status": "completed", "tag": "27fa9a24-1d20-4e50-aaa5-c9c665553e6f"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:53:32.291797 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 27fa9a24-1d20-4e50-aaa5-c9c665553e6f, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=27fa9a24-1d20-4e50-aaa5-c9c665553e6f,segment=NetworkSegment(fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8),segment_id=fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:32.297093 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:32.323489 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:53:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e02fb16f-94e5-405c-a760-9ac899db0739 x-openstack-request-id: req-e02fb16f-94e5-405c-a760-9ac899db0739 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:53:32.323791 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fce69021-c7d1-432f-a078-b917814309b9", "name": "network-vif-plugged", "status": "completed", "tag": "27fa9a24-1d20-4e50-aaa5-c9c665553e6f", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:53:32.324044 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e02fb16f-94e5-405c-a760-9ac899db0739 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:53:32.324432 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fce69021-c7d1-432f-a078-b917814309b9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '27fa9a24-1d20-4e50-aaa5-c9c665553e6f', 'code': 200} Dec 09 21:53:32.353340 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=27fa9a24-1d20-4e50-aaa5-c9c665553e6f,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:32.423290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db762976-6bce-44be-8ab4-8985b6cd409f req-c82599a2-1108-4f59-9563-ed0d4acabe95 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:32.424873 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-db762976-6bce-44be-8ab4-8985b6cd409f req-c82599a2-1108-4f59-9563-ed0d4acabe95 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=fce69021-c7d1-432f-a078-b917814309b9 HTTP/1.1" status: 200 len: 1097 time: 0.0405126 Dec 09 21:53:32.475016 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-db762976-6bce-44be-8ab4-8985b6cd409f req-4158290c-b796-4cce-a105-30141d1d1340 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=ce5c7bc1-de04-4060-901f-bf2612c44351&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424984 Dec 09 21:53:32.576968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49c32831-bb39-4d4b-8402-e9ee2fef2ba1 req-ddd7940d-aea4-4e45-a92f-778735b613c7 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:32.578898 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-49c32831-bb39-4d4b-8402-e9ee2fef2ba1 req-ddd7940d-aea4-4e45-a92f-778735b613c7 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/ports?device_id=fce69021-c7d1-432f-a078-b917814309b9 HTTP/1.1" status: 200 len: 945 time: 0.0580873 Dec 09 21:53:32.628070 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-49c32831-bb39-4d4b-8402-e9ee2fef2ba1 req-053e4ca3-6a22-411c-a970-503c38472541 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/security-groups?id=ce5c7bc1-de04-4060-901f-bf2612c44351&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426154 Dec 09 21:53:32.755685 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54394) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:32.871574 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-0e8d50cd-6248-44c1-a95e-d4d83c288726 admin admin] Request body: {'network': {'name': 'tempest-TestServerBasicOps-833518784-network', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:32.896468 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0e8d50cd-6248-44c1-a95e-d4d83c288726 admin admin] Made reservation on behalf of a1dd4ab6f25741058f3000ebf6ce1eac for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:53:32.898764 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e8d50cd-6248-44c1-a95e-d4d83c288726 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:32.908090 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e8d50cd-6248-44c1-a95e-d4d83c288726 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:32.979805 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cde2a967-2b5a-4df1-af16-b2d554f4a56b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:32.986672 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e8d50cd-6248-44c1-a95e-d4d83c288726 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:32.992341 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e8d50cd-6248-44c1-a95e-d4d83c288726 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:33.017042 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0e8d50cd-6248-44c1-a95e-d4d83c288726 admin admin] vlan segment allocate from pool success with {'vlan_id': 142, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:53:33.026763 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e8d50cd-6248-44c1-a95e-d4d83c288726 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7371d9f1-cfae-4ce3-8eb7-979c71348d71,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:33.031707 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e8d50cd-6248-44c1-a95e-d4d83c288726 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:33.032052 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-0e8d50cd-6248-44c1-a95e-d4d83c288726 admin admin] Added segment bd059ed1-b661-4e68-8df0-ed7798fa0c5d of type vlan for network 9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 Dec 09 21:53:33.072122 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e8d50cd-6248-44c1-a95e-d4d83c288726 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:33.098111 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e8d50cd-6248-44c1-a95e-d4d83c288726 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:33.099097 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0e8d50cd-6248-44c1-a95e-d4d83c288726 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:33.099777 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0e8d50cd-6248-44c1-a95e-d4d83c288726 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:33.133773 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0e8d50cd-6248-44c1-a95e-d4d83c288726 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.3769920 Dec 09 21:53:33.137019 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54398) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:33.142319 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-d88ba590-5a99-4d52-bbcc-1bd66438911d admin admin] Request body: {'subnet': {'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerBasicOps-833518784-subnet', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:33.165196 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e8d50cd-6248-44c1-a95e-d4d83c288726 admin admin] Pushing event updated for resources: {'Network': ['ID=9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:33.166110 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d88ba590-5a99-4d52-bbcc-1bd66438911d admin admin] Made reservation on behalf of a1dd4ab6f25741058f3000ebf6ce1eac for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:53:33.169838 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d88ba590-5a99-4d52-bbcc-1bd66438911d admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:33.179558 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:53:33.351892 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d88ba590-5a99-4d52-bbcc-1bd66438911d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:33.408228 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d88ba590-5a99-4d52-bbcc-1bd66438911d admin admin] Pushing event updated for resources: {'Subnet': ['ID=912d0a1a-1b1a-4383-8291-491e8e3358fe,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:33.418455 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d88ba590-5a99-4d52-bbcc-1bd66438911d admin admin] Checking segment: {'id': 'bd059ed1-b661-4e68-8df0-ed7798fa0c5d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:53:33.418813 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d88ba590-5a99-4d52-bbcc-1bd66438911d admin admin] Network hostable DHCP agents. Network: 9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:53:33.437511 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d88ba590-5a99-4d52-bbcc-1bd66438911d admin admin] Network 9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:53:33.447496 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-d88ba590-5a99-4d52-bbcc-1bd66438911d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:53:33.453080 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d88ba590-5a99-4d52-bbcc-1bd66438911d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:33.454127 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d88ba590-5a99-4d52-bbcc-1bd66438911d admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:33.460664 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f97199a-296d-4c77-a82b-2cd4dd615ac1 None None] Network 9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:53:33.477827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54402) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:33.478078 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d88ba590-5a99-4d52-bbcc-1bd66438911d admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.3397248 Dec 09 21:53:33.484057 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-32c06a54-9d4e-4625-ab89-ccc3c7a3e672 admin admin] Request body: {'router': {'name': 'tempest-TestServerBasicOps-833518784-router', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:33.508267 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-32c06a54-9d4e-4625-ab89-ccc3c7a3e672 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:33.509452 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-32c06a54-9d4e-4625-ab89-ccc3c7a3e672 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:33.560119 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-32c06a54-9d4e-4625-ab89-ccc3c7a3e672 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:33.574096 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00619588-db4e-4a91-b735-b44105cefb5b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7', 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7', 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'fixed_ips': [{'subnet_id': '912d0a1a-1b1a-4383-8291-491e8e3358fe'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:53:33.575061 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-00619588-db4e-4a91-b735-b44105cefb5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:33.701607 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-32c06a54-9d4e-4625-ab89-ccc3c7a3e672 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:33.721051 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-00619588-db4e-4a91-b735-b44105cefb5b None None] Allocated IP 172.20.0.2 (9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7/912d0a1a-1b1a-4383-8291-491e8e3358fe/fd986418-b3fd-4b4b-9e4f-2d0201d3fe50) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:53:33.772441 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e11b06d5-2955-4157-839c-c2955ba56a48 req-1c15b2ef-410d-4e30-9631-f0bceb0e0310 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:33.773954 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e11b06d5-2955-4157-839c-c2955ba56a48 req-1c15b2ef-410d-4e30-9631-f0bceb0e0310 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/ports?device_id=fce69021-c7d1-432f-a078-b917814309b9 HTTP/1.1" status: 200 len: 945 time: 0.0686479 Dec 09 21:53:33.857314 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e11b06d5-2955-4157-839c-c2955ba56a48 req-7e79bd6f-6109-4793-8a92-be9f84942087 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/security-groups?id=ce5c7bc1-de04-4060-901f-bf2612c44351&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0758436 Dec 09 21:53:33.866562 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-00619588-db4e-4a91-b735-b44105cefb5b None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:33.885176 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-00619588-db4e-4a91-b735-b44105cefb5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:33.928388 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00619588-db4e-4a91-b735-b44105cefb5b None None] Network 9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:53:33.932624 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-00619588-db4e-4a91-b735-b44105cefb5b None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:53:33.938928 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00619588-db4e-4a91-b735-b44105cefb5b None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:53:33.946317 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00619588-db4e-4a91-b735-b44105cefb5b None None] Pushing event updated for resources: {'Port': ['ID=fd986418-b3fd-4b4b-9e4f-2d0201d3fe50,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:33.991952 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-32c06a54-9d4e-4625-ab89-ccc3c7a3e672 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:34.000109 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-00619588-db4e-4a91-b735-b44105cefb5b None None] Attempting to bind port fd986418-b3fd-4b4b-9e4f-2d0201d3fe50 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:53:34.000499 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-00619588-db4e-4a91-b735-b44105cefb5b None None] Attempting to bind port fd986418-b3fd-4b4b-9e4f-2d0201d3fe50 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'bd059ed1-b661-4e68-8df0-ed7798fa0c5d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:53:34.000903 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00619588-db4e-4a91-b735-b44105cefb5b None None] Attempting to bind port fd986418-b3fd-4b4b-9e4f-2d0201d3fe50 on network 9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:53:34.008199 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00619588-db4e-4a91-b735-b44105cefb5b None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 53, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:53:34.008579 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00619588-db4e-4a91-b735-b44105cefb5b None None] Checking segment: {'id': 'bd059ed1-b661-4e68-8df0-ed7798fa0c5d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:53:34.008986 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-00619588-db4e-4a91-b735-b44105cefb5b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:34.009383 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00619588-db4e-4a91-b735-b44105cefb5b None None] Bound using segment: {'id': 'bd059ed1-b661-4e68-8df0-ed7798fa0c5d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:53:34.009857 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-00619588-db4e-4a91-b735-b44105cefb5b None None] Bound port: fd986418-b3fd-4b4b-9e4f-2d0201d3fe50, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bd059ed1-b661-4e68-8df0-ed7798fa0c5d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:53:34.010244 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-00619588-db4e-4a91-b735-b44105cefb5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:34.021991 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-32c06a54-9d4e-4625-ab89-ccc3c7a3e672 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:34.080732 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-00619588-db4e-4a91-b735-b44105cefb5b None None] For port fd986418-b3fd-4b4b-9e4f-2d0201d3fe50, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:53:34.084362 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-00619588-db4e-4a91-b735-b44105cefb5b None None] For port fd986418-b3fd-4b4b-9e4f-2d0201d3fe50, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=fd986418-b3fd-4b4b-9e4f-2d0201d3fe50,segment=NetworkSegment(bd059ed1-b661-4e68-8df0-ed7798fa0c5d),segment_id=bd059ed1-b661-4e68-8df0-ed7798fa0c5d)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:53:34.090084 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-00619588-db4e-4a91-b735-b44105cefb5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:34.146196 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-32c06a54-9d4e-4625-ab89-ccc3c7a3e672 admin admin] Allocated IP 172.25.3.129 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/e8d93782-8b94-42dc-84a9-f5481f9afe13) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:53:34.161503 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00619588-db4e-4a91-b735-b44105cefb5b None None] Pushing event updated for resources: {'Port': ['ID=fd986418-b3fd-4b4b-9e4f-2d0201d3fe50,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:34.283656 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-32c06a54-9d4e-4625-ab89-ccc3c7a3e672 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:34.343837 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-32c06a54-9d4e-4625-ab89-ccc3c7a3e672 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:34.388408 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-32c06a54-9d4e-4625-ab89-ccc3c7a3e672 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:53:34.392667 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-32c06a54-9d4e-4625-ab89-ccc3c7a3e672 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:53:34.396573 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32c06a54-9d4e-4625-ab89-ccc3c7a3e672 admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:53:34.410801 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5dc67e64-efa3-41f8-9ab2-4fd0618831af None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:53:34.439961 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32c06a54-9d4e-4625-ab89-ccc3c7a3e672 admin admin] Pushing event updated for resources: {'Port': ['ID=e8d93782-8b94-42dc-84a9-f5481f9afe13,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:34.461349 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-eb29033b-e3c7-4c35-8e75-eba0680e4693 None None] Provisioning complete for port e8d93782-8b94-42dc-84a9-f5481f9afe13 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:34.461942 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb29033b-e3c7-4c35-8e75-eba0680e4693 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:34.516808 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-eb29033b-e3c7-4c35-8e75-eba0680e4693 None None] Port e8d93782-8b94-42dc-84a9-f5481f9afe13 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:53:34.683202 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-32c06a54-9d4e-4625-ab89-ccc3c7a3e672 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:35.153908 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device fd986418-b3fd-4b4b-9e4f-2d0201d3fe50 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:53:35.206991 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port fd986418-b3fd-4b4b-9e4f-2d0201d3fe50 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:35.207606 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:35.275136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-760fdf66-848d-44fe-ac93-c072de27fa22 None None] Network 9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:53:35.284570 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-32c06a54-9d4e-4625-ab89-ccc3c7a3e672 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:35.397109 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:35.407366 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f3872067-2b1a-422d-9870-0e12b99f9c0c None None] Provisioning complete for port fd986418-b3fd-4b4b-9e4f-2d0201d3fe50 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:35.407832 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f3872067-2b1a-422d-9870-0e12b99f9c0c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:35.428911 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-32c06a54-9d4e-4625-ab89-ccc3c7a3e672 admin admin] Router d9cf6337-3bad-4310-b6ab-6a6e5ee3198c is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:53:35.482020 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port fd986418-b3fd-4b4b-9e4f-2d0201d3fe50, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=fd986418-b3fd-4b4b-9e4f-2d0201d3fe50,segment=NetworkSegment(bd059ed1-b661-4e68-8df0-ed7798fa0c5d),segment_id=bd059ed1-b661-4e68-8df0-ed7798fa0c5d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:35.493597 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:35.548685 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-32c06a54-9d4e-4625-ab89-ccc3c7a3e672 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:53:35.568939 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-32c06a54-9d4e-4625-ab89-ccc3c7a3e672 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:35.569476 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] Sync routers for ids ['d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:53:35.572790 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-32c06a54-9d4e-4625-ab89-ccc3c7a3e672 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 2.0901504 Dec 09 21:53:35.573715 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54418) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:35.596210 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=fd986418-b3fd-4b4b-9e4f-2d0201d3fe50,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:35.615207 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] Routers {'d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:53:35.616051 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:53:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:35.618075 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1eed7f55-d248-4b6b-bb4e-d146c7c00a99 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:35.770014 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] Set router d9cf6337-3bad-4310-b6ab-6a6e5ee3198c gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:53:35.900693 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4bf393b6-c94c-49bf-9d03-78d00563ae58 None None] Provisioning complete for port fd986418-b3fd-4b4b-9e4f-2d0201d3fe50 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:35.901058 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4bf393b6-c94c-49bf-9d03-78d00563ae58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:36.057527 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'name': 'tempest-TestServerBasicOps-833518784-router', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129'}], 'enable_snat': True}, 'gw_port_id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:33Z', 'updated_at': '2021-12-09T21:53:34Z', 'revision_number': 3, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'gw_port': {'id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:c4:ec', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3888, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:34Z', 'updated_at': '2021-12-09T21:53:34Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:36.084892 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] Checking router: d9cf6337-3bad-4310-b6ab-6a6e5ee3198c for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:53:36.085386 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] Updating router d9cf6337-3bad-4310-b6ab-6a6e5ee3198c port e8d93782-8b94-42dc-84a9-f5481f9afe13 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:53:36.085804 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-66cbce7a-fe47-4b54-8a5f-085a593e9f36 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:36.110109 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:36.253067 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-66cbce7a-fe47-4b54-8a5f-085a593e9f36 admin admin] Allocated IP 172.20.0.1 (9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7/912d0a1a-1b1a-4383-8291-491e8e3358fe/efce1b9c-0122-448d-b190-5f99e09d575a) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:53:36.361569 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-66cbce7a-fe47-4b54-8a5f-085a593e9f36 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:36.399873 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-66cbce7a-fe47-4b54-8a5f-085a593e9f36 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:36.437937 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-66cbce7a-fe47-4b54-8a5f-085a593e9f36 admin admin] Network 9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:53:36.441375 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-66cbce7a-fe47-4b54-8a5f-085a593e9f36 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:53:36.445151 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66cbce7a-fe47-4b54-8a5f-085a593e9f36 admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:53:36.491383 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66cbce7a-fe47-4b54-8a5f-085a593e9f36 admin admin] Pushing event updated for resources: {'Port': ['ID=efce1b9c-0122-448d-b190-5f99e09d575a,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:36.511044 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-66cbce7a-fe47-4b54-8a5f-085a593e9f36 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:36.574431 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:36.586242 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:36.620228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] Attempting to bind port e8d93782-8b94-42dc-84a9-f5481f9afe13 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:53:36.620610 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] Attempting to bind port e8d93782-8b94-42dc-84a9-f5481f9afe13 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:53:36.621502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] Attempting to bind port e8d93782-8b94-42dc-84a9-f5481f9afe13 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:53:36.650417 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 53, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:53:36.650795 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:53:36.651203 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:36.651617 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:53:36.652112 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] Bound port: e8d93782-8b94-42dc-84a9-f5481f9afe13, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:53:36.652495 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:36.677654 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab9a135a-2f01-48f4-b766-09fb29b5d40e None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:53:36.679323 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-66cbce7a-fe47-4b54-8a5f-085a593e9f36 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:36.726351 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:36.731718 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cf38d81-1539-4ff5-81d5-4ba0cf19e325 None None] Pushing event updated for resources: {'Port': ['ID=e8d93782-8b94-42dc-84a9-f5481f9afe13,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:36.744520 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] For port e8d93782-8b94-42dc-84a9-f5481f9afe13, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:53:36.748041 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] For port e8d93782-8b94-42dc-84a9-f5481f9afe13, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e8d93782-8b94-42dc-84a9-f5481f9afe13,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:53:36.755089 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:36.796037 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d8a22d5-c050-4952-b420-0aac1e30a456 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:53:36.845776 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8248d9fd-e87e-4006-b51a-1565d8ed20dd None None] Provisioning complete for port e8d93782-8b94-42dc-84a9-f5481f9afe13 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:36.846230 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8248d9fd-e87e-4006-b51a-1565d8ed20dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:36.849776 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] Routers {'d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:53:36.850458 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:53:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:36.894886 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-66cbce7a-fe47-4b54-8a5f-085a593e9f36 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:36.900698 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-66cbce7a-fe47-4b54-8a5f-085a593e9f36 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:36.912685 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cf38d81-1539-4ff5-81d5-4ba0cf19e325 None None] Pushing event updated for resources: {'Port': ['ID=e8d93782-8b94-42dc-84a9-f5481f9afe13,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:36.979126 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66cbce7a-fe47-4b54-8a5f-085a593e9f36 admin admin] Pushing event updated for resources: {'Port': ['ID=efce1b9c-0122-448d-b190-5f99e09d575a,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:36.981984 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-66cbce7a-fe47-4b54-8a5f-085a593e9f36 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:37.024990 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] Set router d9cf6337-3bad-4310-b6ab-6a6e5ee3198c gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:53:37.062565 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8248d9fd-e87e-4006-b51a-1565d8ed20dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:37.090703 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-66cbce7a-fe47-4b54-8a5f-085a593e9f36 admin admin] Network 9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:53:37.093148 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-66cbce7a-fe47-4b54-8a5f-085a593e9f36 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:53:37.120825 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-8248d9fd-e87e-4006-b51a-1565d8ed20dd None None] For port e8d93782-8b94-42dc-84a9-f5481f9afe13, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e8d93782-8b94-42dc-84a9-f5481f9afe13,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:37.147280 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8248d9fd-e87e-4006-b51a-1565d8ed20dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:37.150245 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device fd986418-b3fd-4b4b-9e4f-2d0201d3fe50 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:53:37.198960 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:53:37.242404 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-66cbce7a-fe47-4b54-8a5f-085a593e9f36 admin admin] Router d9cf6337-3bad-4310-b6ab-6a6e5ee3198c has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:53:37.300323 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8248d9fd-e87e-4006-b51a-1565d8ed20dd None None] Provisioning complete for port efce1b9c-0122-448d-b190-5f99e09d575a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:37.300650 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8248d9fd-e87e-4006-b51a-1565d8ed20dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:37.379512 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8248d9fd-e87e-4006-b51a-1565d8ed20dd None None] Pushing event updated for resources: {'Port': ['ID=e8d93782-8b94-42dc-84a9-f5481f9afe13,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:37.388432 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-66cbce7a-fe47-4b54-8a5f-085a593e9f36 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:53:37.393222 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-8248d9fd-e87e-4006-b51a-1565d8ed20dd None None] Port efce1b9c-0122-448d-b190-5f99e09d575a cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:53:37.394035 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-66cbce7a-fe47-4b54-8a5f-085a593e9f36 admin admin] 10.222.0.13 "PUT /v2.0/routers/d9cf6337-3bad-4310-b6ab-6a6e5ee3198c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8192859 Dec 09 21:53:37.427641 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port fd986418-b3fd-4b4b-9e4f-2d0201d3fe50 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:37.428020 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:37.530412 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'name': 'tempest-TestServerBasicOps-833518784-router', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129'}], 'enable_snat': True}, 'gw_port_id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:33Z', 'updated_at': '2021-12-09T21:53:36Z', 'revision_number': 4, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'gw_port': {'id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:c4:ec', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3888, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:34Z', 'updated_at': '2021-12-09T21:53:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'efce1b9c-0122-448d-b190-5f99e09d575a', 'name': '', 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'mac_address': 'fa:16:3e:5a:e8:52', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'device_owner': 'network:router_interface', 'standard_attr_id': 3889, 'fixed_ips': [{'subnet_id': '912d0a1a-1b1a-4383-8291-491e8e3358fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:36Z', 'updated_at': '2021-12-09T21:53:36Z', 'revision_number': 1, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'subnets': [{'id': '912d0a1a-1b1a-4383-8291-491e8e3358fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:37.565531 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bc61121-c71e-4b9a-adba-49c9921c6ed6 None None] The sync data for ids ['d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'] in n-d-713301-27 is: [{'id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'name': 'tempest-TestServerBasicOps-833518784-router', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129'}], 'enable_snat': True}, 'gw_port_id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:33Z', 'updated_at': '2021-12-09T21:53:36Z', 'revision_number': 4, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'gw_port': {'id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:c4:ec', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3888, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:34Z', 'updated_at': '2021-12-09T21:53:36Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'efce1b9c-0122-448d-b190-5f99e09d575a', 'name': '', 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'mac_address': 'fa:16:3e:5a:e8:52', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'device_owner': 'network:router_interface', 'standard_attr_id': 3889, 'fixed_ips': [{'subnet_id': '912d0a1a-1b1a-4383-8291-491e8e3358fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:36Z', 'updated_at': '2021-12-09T21:53:36Z', 'revision_number': 1, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'subnets': [{'id': '912d0a1a-1b1a-4383-8291-491e8e3358fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:53:37.569960 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c8366347-e583-493f-8f0d-6babf29cf374 None None] Provisioning complete for port e8d93782-8b94-42dc-84a9-f5481f9afe13 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:37.570385 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c8366347-e583-493f-8f0d-6babf29cf374 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:37.677289 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c8366347-e583-493f-8f0d-6babf29cf374 None None] Provisioning complete for port efce1b9c-0122-448d-b190-5f99e09d575a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:37.677846 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c8366347-e583-493f-8f0d-6babf29cf374 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:37.715862 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-c8366347-e583-493f-8f0d-6babf29cf374 None None] Port efce1b9c-0122-448d-b190-5f99e09d575a cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:53:37.998614 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54438) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:38.004785 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-6b76f20d-af3a-4d62-844e-5af16897ae3c admin admin] Request body: {'network': {'name': 'tempest-TestServerBasicOps-1606904686-network', 'tenant_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:38.019721 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:38.029509 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6b76f20d-af3a-4d62-844e-5af16897ae3c admin admin] Made reservation on behalf of cbabd8b8a5fa406fa7b82743c1ae4bd0 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:53:38.032722 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6b76f20d-af3a-4d62-844e-5af16897ae3c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:38.043081 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6b76f20d-af3a-4d62-844e-5af16897ae3c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:38.123736 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6b76f20d-af3a-4d62-844e-5af16897ae3c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:38.132838 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6b76f20d-af3a-4d62-844e-5af16897ae3c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:38.154097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6b76f20d-af3a-4d62-844e-5af16897ae3c admin admin] vlan segment allocate from pool success with {'vlan_id': 140, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:53:38.174628 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6b76f20d-af3a-4d62-844e-5af16897ae3c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:38.175282 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-6b76f20d-af3a-4d62-844e-5af16897ae3c admin admin] Added segment 1cf908c4-b2d8-4a3c-a764-c91d90de89cd of type vlan for network 0fbb81d3-e114-41cc-97c1-0df7c248e4a9 Dec 09 21:53:38.176551 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b76f20d-af3a-4d62-844e-5af16897ae3c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d7f9feff-3408-4863-9991-099facc4c9a8,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:38.222466 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6b76f20d-af3a-4d62-844e-5af16897ae3c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:38.251722 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6b76f20d-af3a-4d62-844e-5af16897ae3c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:38.253138 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b76f20d-af3a-4d62-844e-5af16897ae3c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:38.253723 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6b76f20d-af3a-4d62-844e-5af16897ae3c admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:38.296222 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6b76f20d-af3a-4d62-844e-5af16897ae3c admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.2927704 Dec 09 21:53:38.296329 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54440) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:38.301118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-6fc89b1b-f04e-4f6f-92be-9998d4b3c997 admin admin] Request body: {'subnet': {'network_id': '0fbb81d3-e114-41cc-97c1-0df7c248e4a9', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerBasicOps-1606904686-subnet', 'tenant_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:38.329033 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6fc89b1b-f04e-4f6f-92be-9998d4b3c997 admin admin] Made reservation on behalf of cbabd8b8a5fa406fa7b82743c1ae4bd0 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:53:38.332070 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6fc89b1b-f04e-4f6f-92be-9998d4b3c997 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:38.345540 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b76f20d-af3a-4d62-844e-5af16897ae3c admin admin] Pushing event updated for resources: {'Network': ['ID=0fbb81d3-e114-41cc-97c1-0df7c248e4a9,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:38.379145 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 0fbb81d3-e114-41cc-97c1-0df7c248e4a9 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:53:38.572169 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6fc89b1b-f04e-4f6f-92be-9998d4b3c997 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:38.629254 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fc89b1b-f04e-4f6f-92be-9998d4b3c997 admin admin] Pushing event updated for resources: {'Subnet': ['ID=aef9b85f-e47c-4201-91c9-161e142a9441,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:38.658287 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6fc89b1b-f04e-4f6f-92be-9998d4b3c997 admin admin] Checking segment: {'id': '1cf908c4-b2d8-4a3c-a764-c91d90de89cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '0fbb81d3-e114-41cc-97c1-0df7c248e4a9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:53:38.658821 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6fc89b1b-f04e-4f6f-92be-9998d4b3c997 admin admin] Network hostable DHCP agents. Network: 0fbb81d3-e114-41cc-97c1-0df7c248e4a9, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:53:38.679235 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6fc89b1b-f04e-4f6f-92be-9998d4b3c997 admin admin] Network 0fbb81d3-e114-41cc-97c1-0df7c248e4a9 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:53:38.690335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-6fc89b1b-f04e-4f6f-92be-9998d4b3c997 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 0fbb81d3-e114-41cc-97c1-0df7c248e4a9) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:53:38.695965 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6fc89b1b-f04e-4f6f-92be-9998d4b3c997 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:38.696936 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6fc89b1b-f04e-4f6f-92be-9998d4b3c997 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:38.699770 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d1494d4c-ce1d-44c2-a1ce-b1139eab22d0 None None] Network 0fbb81d3-e114-41cc-97c1-0df7c248e4a9 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:53:38.716234 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6fc89b1b-f04e-4f6f-92be-9998d4b3c997 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.4191852 Dec 09 21:53:38.718869 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54444) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:38.723622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-3eed6a6e-dd67-4b62-90b5-d1bce4944305 admin admin] Request body: {'router': {'name': 'tempest-TestServerBasicOps-1606904686-router', 'tenant_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:38.767005 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3eed6a6e-dd67-4b62-90b5-d1bce4944305 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:38.768336 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3eed6a6e-dd67-4b62-90b5-d1bce4944305 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:38.852129 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3eed6a6e-dd67-4b62-90b5-d1bce4944305 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:38.863260 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b6042f7a-2262-4be3-a51e-988f40c2597d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-0fbb81d3-e114-41cc-97c1-0df7c248e4a9', 'network_id': '0fbb81d3-e114-41cc-97c1-0df7c248e4a9', 'project_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'fixed_ips': [{'subnet_id': 'aef9b85f-e47c-4201-91c9-161e142a9441'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:53:38.865494 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b6042f7a-2262-4be3-a51e-988f40c2597d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:39.021351 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-b6042f7a-2262-4be3-a51e-988f40c2597d None None] Allocated IP 172.20.0.2 (0fbb81d3-e114-41cc-97c1-0df7c248e4a9/aef9b85f-e47c-4201-91c9-161e142a9441/a8247118-063a-462d-bc8f-34d1bd44a31e) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:53:39.032143 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3eed6a6e-dd67-4b62-90b5-d1bce4944305 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:39.208003 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e8d93782-8b94-42dc-84a9-f5481f9afe13 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:53:39.282830 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b6042f7a-2262-4be3-a51e-988f40c2597d None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:39.287234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port e8d93782-8b94-42dc-84a9-f5481f9afe13 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:39.287983 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:39.289158 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3eed6a6e-dd67-4b62-90b5-d1bce4944305 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:39.311535 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3eed6a6e-dd67-4b62-90b5-d1bce4944305 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:39.314078 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b6042f7a-2262-4be3-a51e-988f40c2597d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:39.367074 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b6042f7a-2262-4be3-a51e-988f40c2597d None None] Network 0fbb81d3-e114-41cc-97c1-0df7c248e4a9 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:53:39.370859 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-b6042f7a-2262-4be3-a51e-988f40c2597d None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:53:39.373090 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6042f7a-2262-4be3-a51e-988f40c2597d None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:53:39.415174 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6042f7a-2262-4be3-a51e-988f40c2597d None None] Pushing event updated for resources: {'Port': ['ID=a8247118-063a-462d-bc8f-34d1bd44a31e,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:39.445795 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-3eed6a6e-dd67-4b62-90b5-d1bce4944305 admin admin] Allocated IP 172.25.3.162 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/cfca101a-a0fb-4ffb-99fe-557a861caf93) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:53:39.466178 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-b6042f7a-2262-4be3-a51e-988f40c2597d None None] Attempting to bind port a8247118-063a-462d-bc8f-34d1bd44a31e on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:53:39.466562 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-b6042f7a-2262-4be3-a51e-988f40c2597d None None] Attempting to bind port a8247118-063a-462d-bc8f-34d1bd44a31e by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '1cf908c4-b2d8-4a3c-a764-c91d90de89cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '0fbb81d3-e114-41cc-97c1-0df7c248e4a9'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:53:39.466929 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6042f7a-2262-4be3-a51e-988f40c2597d None None] Attempting to bind port a8247118-063a-462d-bc8f-34d1bd44a31e on network 0fbb81d3-e114-41cc-97c1-0df7c248e4a9 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:53:39.476544 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6042f7a-2262-4be3-a51e-988f40c2597d None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 53, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:53:39.476926 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6042f7a-2262-4be3-a51e-988f40c2597d None None] Checking segment: {'id': '1cf908c4-b2d8-4a3c-a764-c91d90de89cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '0fbb81d3-e114-41cc-97c1-0df7c248e4a9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:53:39.477397 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b6042f7a-2262-4be3-a51e-988f40c2597d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:39.477801 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6042f7a-2262-4be3-a51e-988f40c2597d None None] Bound using segment: {'id': '1cf908c4-b2d8-4a3c-a764-c91d90de89cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '0fbb81d3-e114-41cc-97c1-0df7c248e4a9'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:53:39.478273 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-b6042f7a-2262-4be3-a51e-988f40c2597d None None] Bound port: a8247118-063a-462d-bc8f-34d1bd44a31e, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1cf908c4-b2d8-4a3c-a764-c91d90de89cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '0fbb81d3-e114-41cc-97c1-0df7c248e4a9'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:53:39.478659 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b6042f7a-2262-4be3-a51e-988f40c2597d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:39.553690 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-b6042f7a-2262-4be3-a51e-988f40c2597d None None] For port a8247118-063a-462d-bc8f-34d1bd44a31e, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:53:39.556905 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-b6042f7a-2262-4be3-a51e-988f40c2597d None None] For port a8247118-063a-462d-bc8f-34d1bd44a31e, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a8247118-063a-462d-bc8f-34d1bd44a31e,segment=NetworkSegment(1cf908c4-b2d8-4a3c-a764-c91d90de89cd),segment_id=1cf908c4-b2d8-4a3c-a764-c91d90de89cd)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:53:39.563964 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b6042f7a-2262-4be3-a51e-988f40c2597d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:39.590140 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3eed6a6e-dd67-4b62-90b5-d1bce4944305 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:39.633669 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3eed6a6e-dd67-4b62-90b5-d1bce4944305 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:39.685446 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6042f7a-2262-4be3-a51e-988f40c2597d None None] Pushing event updated for resources: {'Port': ['ID=a8247118-063a-462d-bc8f-34d1bd44a31e,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:39.696499 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3eed6a6e-dd67-4b62-90b5-d1bce4944305 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:53:39.700471 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-3eed6a6e-dd67-4b62-90b5-d1bce4944305 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:53:39.707803 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3eed6a6e-dd67-4b62-90b5-d1bce4944305 admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:53:39.712898 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:39.719899 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0e7182b6-6ee7-4e98-81af-5843c290b998 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:53:39.741904 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eed6a6e-dd67-4b62-90b5-d1bce4944305 admin admin] Pushing event updated for resources: {'Port': ['ID=cfca101a-a0fb-4ffb-99fe-557a861caf93,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:39.776458 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-171b8490-76e3-4dbd-9b04-01a87eb4ffc2 None None] Provisioning complete for port cfca101a-a0fb-4ffb-99fe-557a861caf93 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:39.780180 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-171b8490-76e3-4dbd-9b04-01a87eb4ffc2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:39.847509 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-171b8490-76e3-4dbd-9b04-01a87eb4ffc2 None None] Port cfca101a-a0fb-4ffb-99fe-557a861caf93 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:53:40.052892 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3eed6a6e-dd67-4b62-90b5-d1bce4944305 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:40.269799 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3eed6a6e-dd67-4b62-90b5-d1bce4944305 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:40.326788 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] Sync routers for ids ['d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:53:40.337284 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] Routers {'d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:53:40.337888 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:53:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:40.401381 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3eed6a6e-dd67-4b62-90b5-d1bce4944305 admin admin] Router 8c937498-e34f-483d-b4e0-1b40a8f681f1 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:53:40.443881 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] Set router d9cf6337-3bad-4310-b6ab-6a6e5ee3198c gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:53:40.508939 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3eed6a6e-dd67-4b62-90b5-d1bce4944305 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:53:40.519107 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] Sync routers for ids ['8c937498-e34f-483d-b4e0-1b40a8f681f1'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:53:40.531804 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] Routers {'8c937498-e34f-483d-b4e0-1b40a8f681f1'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:53:40.532479 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:53:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['8c937498-e34f-483d-b4e0-1b40a8f681f1'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:40.534670 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3eed6a6e-dd67-4b62-90b5-d1bce4944305 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:40.536279 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3eed6a6e-dd67-4b62-90b5-d1bce4944305 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 1.8162122 Dec 09 21:53:40.539017 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54448) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:40.665012 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] Set router 8c937498-e34f-483d-b4e0-1b40a8f681f1 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:53:40.807044 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'name': 'tempest-TestServerBasicOps-833518784-router', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129'}], 'enable_snat': True}, 'gw_port_id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:33Z', 'updated_at': '2021-12-09T21:53:36Z', 'revision_number': 4, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'gw_port': {'id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:c4:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3888, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:34Z', 'updated_at': '2021-12-09T21:53:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'efce1b9c-0122-448d-b190-5f99e09d575a', 'name': '', 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'mac_address': 'fa:16:3e:5a:e8:52', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'device_owner': 'network:router_interface', 'standard_attr_id': 3889, 'fixed_ips': [{'subnet_id': '912d0a1a-1b1a-4383-8291-491e8e3358fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:36Z', 'updated_at': '2021-12-09T21:53:36Z', 'revision_number': 2, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'subnets': [{'id': '912d0a1a-1b1a-4383-8291-491e8e3358fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:40.838218 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] Checking router: d9cf6337-3bad-4310-b6ab-6a6e5ee3198c for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:53:40.838893 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] Updating router d9cf6337-3bad-4310-b6ab-6a6e5ee3198c port efce1b9c-0122-448d-b190-5f99e09d575a binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:53:40.877990 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:40.898748 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8c937498-e34f-483d-b4e0-1b40a8f681f1', 'name': 'tempest-TestServerBasicOps-1606904686-router', 'tenant_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.162'}], 'enable_snat': True}, 'gw_port_id': 'cfca101a-a0fb-4ffb-99fe-557a861caf93', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:38Z', 'updated_at': '2021-12-09T21:53:39Z', 'revision_number': 3, 'project_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'gw_port': {'id': 'cfca101a-a0fb-4ffb-99fe-557a861caf93', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:f3:3e:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8c937498-e34f-483d-b4e0-1b40a8f681f1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3900, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:39Z', 'updated_at': '2021-12-09T21:53:39Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:40.933356 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] Checking router: 8c937498-e34f-483d-b4e0-1b40a8f681f1 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:53:40.933851 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] Updating router 8c937498-e34f-483d-b4e0-1b40a8f681f1 port cfca101a-a0fb-4ffb-99fe-557a861caf93 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:53:40.963205 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:40.990443 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4040cd4f-4a71-4021-9d5a-176128ade5cd None None] Network 0fbb81d3-e114-41cc-97c1-0df7c248e4a9 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:53:41.273324 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:41.280023 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:41.320745 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a8247118-063a-462d-bc8f-34d1bd44a31e up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:53:41.330707 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-733d0071-1517-4205-a426-174c3a905354 None None] Pushing event updated for resources: {'Port': ['ID=efce1b9c-0122-448d-b190-5f99e09d575a,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:41.391483 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] Attempting to bind port efce1b9c-0122-448d-b190-5f99e09d575a on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:53:41.392005 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] Attempting to bind port efce1b9c-0122-448d-b190-5f99e09d575a by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'bd059ed1-b661-4e68-8df0-ed7798fa0c5d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:53:41.392378 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] Attempting to bind port efce1b9c-0122-448d-b190-5f99e09d575a on network 9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:53:41.400036 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 53, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:53:41.400405 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] Checking segment: {'id': 'bd059ed1-b661-4e68-8df0-ed7798fa0c5d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:53:41.400812 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:41.401204 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] Bound using segment: {'id': 'bd059ed1-b661-4e68-8df0-ed7798fa0c5d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:53:41.401998 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] Bound port: efce1b9c-0122-448d-b190-5f99e09d575a, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bd059ed1-b661-4e68-8df0-ed7798fa0c5d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:53:41.402215 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:41.447266 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-12d840d8-1dc5-4725-89e6-a30652eba32d None None] Provisioning complete for port a8247118-063a-462d-bc8f-34d1bd44a31e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:41.447681 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-12d840d8-1dc5-4725-89e6-a30652eba32d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:41.490102 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] For port efce1b9c-0122-448d-b190-5f99e09d575a, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:53:41.493967 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] For port efce1b9c-0122-448d-b190-5f99e09d575a, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=efce1b9c-0122-448d-b190-5f99e09d575a,segment=NetworkSegment(bd059ed1-b661-4e68-8df0-ed7798fa0c5d),segment_id=bd059ed1-b661-4e68-8df0-ed7798fa0c5d)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:53:41.501061 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:41.528788 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3e1f7c05-1393-4a76-bd6c-b56676e6fea9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:41.566833 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port a8247118-063a-462d-bc8f-34d1bd44a31e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:41.567512 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:41.570287 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] Routers {'d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:53:41.571087 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:53:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:41.706622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-3e1f7c05-1393-4a76-bd6c-b56676e6fea9 admin admin] Allocated IP 172.20.0.1 (0fbb81d3-e114-41cc-97c1-0df7c248e4a9/aef9b85f-e47c-4201-91c9-161e142a9441/f40f0052-c615-4c88-9cc5-8c66748c34fe) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:53:41.707259 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] Set router d9cf6337-3bad-4310-b6ab-6a6e5ee3198c gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:53:41.845858 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-12d840d8-1dc5-4725-89e6-a30652eba32d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:41.847503 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-733d0071-1517-4205-a426-174c3a905354 None None] Pushing event updated for resources: {'Port': ['ID=efce1b9c-0122-448d-b190-5f99e09d575a,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:41.859267 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:41.869199 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3e1f7c05-1393-4a76-bd6c-b56676e6fea9 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:41.885080 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:41.907826 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3e1f7c05-1393-4a76-bd6c-b56676e6fea9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:41.921699 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:41.964855 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3e1f7c05-1393-4a76-bd6c-b56676e6fea9 admin admin] Network 0fbb81d3-e114-41cc-97c1-0df7c248e4a9 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:53:41.972198 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-3e1f7c05-1393-4a76-bd6c-b56676e6fea9 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:53:41.977220 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3e1f7c05-1393-4a76-bd6c-b56676e6fea9 admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:53:41.979118 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58ac29aa-2872-4ca6-973e-9b2edfc5419b None None] Pushing event updated for resources: {'Port': ['ID=cfca101a-a0fb-4ffb-99fe-557a861caf93,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:41.991194 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-12d840d8-1dc5-4725-89e6-a30652eba32d None None] For port a8247118-063a-462d-bc8f-34d1bd44a31e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a8247118-063a-462d-bc8f-34d1bd44a31e,segment=NetworkSegment(1cf908c4-b2d8-4a3c-a764-c91d90de89cd),segment_id=1cf908c4-b2d8-4a3c-a764-c91d90de89cd)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:42.000860 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e1f7c05-1393-4a76-bd6c-b56676e6fea9 admin admin] Pushing event updated for resources: {'Port': ['ID=f40f0052-c615-4c88-9cc5-8c66748c34fe,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:42.009515 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-12d840d8-1dc5-4725-89e6-a30652eba32d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:42.010661 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'name': 'tempest-TestServerBasicOps-833518784-router', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129'}], 'enable_snat': True}, 'gw_port_id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:33Z', 'updated_at': '2021-12-09T21:53:36Z', 'revision_number': 4, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'gw_port': {'id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:c4:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3888, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:34Z', 'updated_at': '2021-12-09T21:53:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'efce1b9c-0122-448d-b190-5f99e09d575a', 'name': '', 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'mac_address': 'fa:16:3e:5a:e8:52', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'device_owner': 'network:router_interface', 'standard_attr_id': 3889, 'fixed_ips': [{'subnet_id': '912d0a1a-1b1a-4383-8291-491e8e3358fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:36Z', 'updated_at': '2021-12-09T21:53:41Z', 'revision_number': 4, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'subnets': [{'id': '912d0a1a-1b1a-4383-8291-491e8e3358fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:42.020671 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3e1f7c05-1393-4a76-bd6c-b56676e6fea9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:42.035790 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] Attempting to bind port cfca101a-a0fb-4ffb-99fe-557a861caf93 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:53:42.036171 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] Attempting to bind port cfca101a-a0fb-4ffb-99fe-557a861caf93 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:53:42.036533 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] Attempting to bind port cfca101a-a0fb-4ffb-99fe-557a861caf93 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:53:42.043383 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc354b0b-91a9-4ac7-aa60-e7db25ae9354 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:53:42.043906 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22950957-1fae-4494-bda5-40dc45826b86 None None] The sync data for ids ['d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'] in n-d-713301-27 is: [{'id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'name': 'tempest-TestServerBasicOps-833518784-router', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129'}], 'enable_snat': True}, 'gw_port_id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:33Z', 'updated_at': '2021-12-09T21:53:36Z', 'revision_number': 4, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'gw_port': {'id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:c4:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3888, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:34Z', 'updated_at': '2021-12-09T21:53:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'efce1b9c-0122-448d-b190-5f99e09d575a', 'name': '', 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'mac_address': 'fa:16:3e:5a:e8:52', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'device_owner': 'network:router_interface', 'standard_attr_id': 3889, 'fixed_ips': [{'subnet_id': '912d0a1a-1b1a-4383-8291-491e8e3358fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:36Z', 'updated_at': '2021-12-09T21:53:41Z', 'revision_number': 4, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'subnets': [{'id': '912d0a1a-1b1a-4383-8291-491e8e3358fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:53:42.086948 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 53, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:53:42.087335 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:53:42.087767 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:42.088174 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:53:42.088646 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] Bound port: cfca101a-a0fb-4ffb-99fe-557a861caf93, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:53:42.089006 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:42.173785 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12d840d8-1dc5-4725-89e6-a30652eba32d None None] Pushing event updated for resources: {'Port': ['ID=a8247118-063a-462d-bc8f-34d1bd44a31e,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:42.179231 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:53:42.179769 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:53:42.180824 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] For port cfca101a-a0fb-4ffb-99fe-557a861caf93, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:53:42.184615 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] For port cfca101a-a0fb-4ffb-99fe-557a861caf93, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=cfca101a-a0fb-4ffb-99fe-557a861caf93,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:53:42.192663 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:42.214627 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3e1f7c05-1393-4a76-bd6c-b56676e6fea9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:42.265217 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] Routers {'8c937498-e34f-483d-b4e0-1b40a8f681f1'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:53:42.265753 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:53:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['8c937498-e34f-483d-b4e0-1b40a8f681f1'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:42.376412 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d4c46fd0-427f-4f9f-9d87-170a736242b0 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:53:42.388189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58ac29aa-2872-4ca6-973e-9b2edfc5419b None None] Pushing event updated for resources: {'Port': ['ID=cfca101a-a0fb-4ffb-99fe-557a861caf93,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:42.398898 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] Set router 8c937498-e34f-483d-b4e0-1b40a8f681f1 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:53:42.442909 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3e1f7c05-1393-4a76-bd6c-b56676e6fea9 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:42.451536 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-15212905-4263-4024-b903-dfe0addd8571 None None] Provisioning complete for port a8247118-063a-462d-bc8f-34d1bd44a31e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:42.451852 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3e1f7c05-1393-4a76-bd6c-b56676e6fea9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:42.452062 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-15212905-4263-4024-b903-dfe0addd8571 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:42.523908 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e1f7c05-1393-4a76-bd6c-b56676e6fea9 admin admin] Pushing event updated for resources: {'Port': ['ID=f40f0052-c615-4c88-9cc5-8c66748c34fe,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:42.526816 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3e1f7c05-1393-4a76-bd6c-b56676e6fea9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:42.624358 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3e1f7c05-1393-4a76-bd6c-b56676e6fea9 admin admin] Network 0fbb81d3-e114-41cc-97c1-0df7c248e4a9 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:53:42.626403 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-3e1f7c05-1393-4a76-bd6c-b56676e6fea9 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:53:42.709231 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-15212905-4263-4024-b903-dfe0addd8571 None None] Provisioning complete for port efce1b9c-0122-448d-b190-5f99e09d575a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:42.709600 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-15212905-4263-4024-b903-dfe0addd8571 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:42.759781 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3e1f7c05-1393-4a76-bd6c-b56676e6fea9 admin admin] Router 8c937498-e34f-483d-b4e0-1b40a8f681f1 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:53:42.772707 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8c937498-e34f-483d-b4e0-1b40a8f681f1', 'name': 'tempest-TestServerBasicOps-1606904686-router', 'tenant_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.162'}], 'enable_snat': True}, 'gw_port_id': 'cfca101a-a0fb-4ffb-99fe-557a861caf93', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:38Z', 'updated_at': '2021-12-09T21:53:42Z', 'revision_number': 4, 'project_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'gw_port': {'id': 'cfca101a-a0fb-4ffb-99fe-557a861caf93', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:f3:3e:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8c937498-e34f-483d-b4e0-1b40a8f681f1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3900, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:39Z', 'updated_at': '2021-12-09T21:53:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'f40f0052-c615-4c88-9cc5-8c66748c34fe', 'name': '', 'network_id': '0fbb81d3-e114-41cc-97c1-0df7c248e4a9', 'tenant_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'mac_address': 'fa:16:3e:49:46:df', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8c937498-e34f-483d-b4e0-1b40a8f681f1', 'device_owner': 'network:router_interface', 'standard_attr_id': 3901, 'fixed_ips': [{'subnet_id': 'aef9b85f-e47c-4201-91c9-161e142a9441', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:41Z', 'updated_at': '2021-12-09T21:53:41Z', 'revision_number': 1, 'project_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'subnets': [{'id': 'aef9b85f-e47c-4201-91c9-161e142a9441', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:42.819575 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a5a4af4-ed24-4e2d-8b99-b8740e91a465 None None] The sync data for ids ['8c937498-e34f-483d-b4e0-1b40a8f681f1'] in n-d-713301-27 is: [{'id': '8c937498-e34f-483d-b4e0-1b40a8f681f1', 'name': 'tempest-TestServerBasicOps-1606904686-router', 'tenant_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.162'}], 'enable_snat': True}, 'gw_port_id': 'cfca101a-a0fb-4ffb-99fe-557a861caf93', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:38Z', 'updated_at': '2021-12-09T21:53:42Z', 'revision_number': 4, 'project_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'gw_port': {'id': 'cfca101a-a0fb-4ffb-99fe-557a861caf93', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:f3:3e:68', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8c937498-e34f-483d-b4e0-1b40a8f681f1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3900, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:39Z', 'updated_at': '2021-12-09T21:53:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'f40f0052-c615-4c88-9cc5-8c66748c34fe', 'name': '', 'network_id': '0fbb81d3-e114-41cc-97c1-0df7c248e4a9', 'tenant_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'mac_address': 'fa:16:3e:49:46:df', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8c937498-e34f-483d-b4e0-1b40a8f681f1', 'device_owner': 'network:router_interface', 'standard_attr_id': 3901, 'fixed_ips': [{'subnet_id': 'aef9b85f-e47c-4201-91c9-161e142a9441', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:41Z', 'updated_at': '2021-12-09T21:53:41Z', 'revision_number': 1, 'project_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'subnets': [{'id': 'aef9b85f-e47c-4201-91c9-161e142a9441', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:53:42.897361 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-15212905-4263-4024-b903-dfe0addd8571 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:42.918824 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3e1f7c05-1393-4a76-bd6c-b56676e6fea9 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:53:42.929629 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3e1f7c05-1393-4a76-bd6c-b56676e6fea9 admin admin] 10.222.0.13 "PUT /v2.0/routers/8c937498-e34f-483d-b4e0-1b40a8f681f1/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3893321 Dec 09 21:53:42.960801 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-15212905-4263-4024-b903-dfe0addd8571 None None] For port efce1b9c-0122-448d-b190-5f99e09d575a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=efce1b9c-0122-448d-b190-5f99e09d575a,segment=NetworkSegment(bd059ed1-b661-4e68-8df0-ed7798fa0c5d),segment_id=bd059ed1-b661-4e68-8df0-ed7798fa0c5d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:42.968890 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-15212905-4263-4024-b903-dfe0addd8571 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:43.046299 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-15212905-4263-4024-b903-dfe0addd8571 None None] Provisioning complete for port cfca101a-a0fb-4ffb-99fe-557a861caf93 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:43.046936 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-15212905-4263-4024-b903-dfe0addd8571 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:43.099330 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15212905-4263-4024-b903-dfe0addd8571 None None] Pushing event updated for resources: {'Port': ['ID=efce1b9c-0122-448d-b190-5f99e09d575a,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:43.403220 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a8247118-063a-462d-bc8f-34d1bd44a31e up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:53:43.435733 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-15212905-4263-4024-b903-dfe0addd8571 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:43.475222 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-15212905-4263-4024-b903-dfe0addd8571 None None] For port cfca101a-a0fb-4ffb-99fe-557a861caf93, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=cfca101a-a0fb-4ffb-99fe-557a861caf93,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:43.483964 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-15212905-4263-4024-b903-dfe0addd8571 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:43.530439 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54464) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:43.535256 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-8ead63cd-0f31-4e50-b4e5-8211dab6e691 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1679145500', 'description': 'tempest-secgroup-smoke-1679145500 description', 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:43.537172 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port a8247118-063a-462d-bc8f-34d1bd44a31e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:43.537545 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:43.561296 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8ead63cd-0f31-4e50-b4e5-8211dab6e691 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:43.589398 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15212905-4263-4024-b903-dfe0addd8571 None None] Pushing event updated for resources: {'Port': ['ID=cfca101a-a0fb-4ffb-99fe-557a861caf93,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:43.617710 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c6177ed6-a8cc-466a-9ef3-fc2084dd16b7 None None] Provisioning complete for port f40f0052-c615-4c88-9cc5-8c66748c34fe triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:43.618103 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6177ed6-a8cc-466a-9ef3-fc2084dd16b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:43.647042 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8ead63cd-0f31-4e50-b4e5-8211dab6e691 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:43.652451 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8ead63cd-0f31-4e50-b4e5-8211dab6e691 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:43.680889 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-c6177ed6-a8cc-466a-9ef3-fc2084dd16b7 None None] Port f40f0052-c615-4c88-9cc5-8c66748c34fe cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:53:43.681362 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8ead63cd-0f31-4e50-b4e5-8211dab6e691 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:43.682692 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8ead63cd-0f31-4e50-b4e5-8211dab6e691 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1511352 Dec 09 21:53:43.686353 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54466) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:43.687112 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ead63cd-0f31-4e50-b4e5-8211dab6e691 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e0446b46-bdd5-496a-bc4f-672214f90d12,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:43.690024 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device efce1b9c-0122-448d-b190-5f99e09d575a up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:53:43.692446 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-6f521dc2-601e-4307-8181-a9f0cf221a6d tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Request body: {'security_group_rule': {'security_group_id': 'e0446b46-bdd5-496a-bc4f-672214f90d12', 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:43.721876 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f521dc2-601e-4307-8181-a9f0cf221a6d tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:43.727490 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c6177ed6-a8cc-466a-9ef3-fc2084dd16b7 None None] Provisioning complete for port cfca101a-a0fb-4ffb-99fe-557a861caf93 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:43.727936 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6177ed6-a8cc-466a-9ef3-fc2084dd16b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:43.777021 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f521dc2-601e-4307-8181-a9f0cf221a6d tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:43.781630 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f521dc2-601e-4307-8181-a9f0cf221a6d tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:43.782434 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port efce1b9c-0122-448d-b190-5f99e09d575a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:43.783525 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:43.800156 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f521dc2-601e-4307-8181-a9f0cf221a6d tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2b979e8e-a25a-4675-afa8-28c9203a515e,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:43.808771 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f521dc2-601e-4307-8181-a9f0cf221a6d tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:43.810011 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6f521dc2-601e-4307-8181-a9f0cf221a6d tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1216216 Dec 09 21:53:43.812808 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54468) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:43.817202 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-003b09f8-72ce-4700-b541-e440e4682e95 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Request body: {'security_group_rule': {'security_group_id': 'e0446b46-bdd5-496a-bc4f-672214f90d12', 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:43.845119 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-003b09f8-72ce-4700-b541-e440e4682e95 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:43.919103 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-003b09f8-72ce-4700-b541-e440e4682e95 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:43.927219 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-003b09f8-72ce-4700-b541-e440e4682e95 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:43.945157 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-003b09f8-72ce-4700-b541-e440e4682e95 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=66a21d3d-f3e9-4a5c-a9cc-36ba69a1c5e0,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:43.954310 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-003b09f8-72ce-4700-b541-e440e4682e95 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:43.955555 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-003b09f8-72ce-4700-b541-e440e4682e95 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1417840 Dec 09 21:53:43.958283 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54472) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:43.962527 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-4b0ed19a-45e2-43b8-ad48-3343d03a85a7 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Request body: {'security_group_rule': {'security_group_id': 'e0446b46-bdd5-496a-bc4f-672214f90d12', 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:43.988920 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4b0ed19a-45e2-43b8-ad48-3343d03a85a7 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:44.054346 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4b0ed19a-45e2-43b8-ad48-3343d03a85a7 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:44.061088 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4b0ed19a-45e2-43b8-ad48-3343d03a85a7 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:44.079273 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b0ed19a-45e2-43b8-ad48-3343d03a85a7 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=275507d1-e2bc-4d20-8911-f695d8596f86,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:44.087088 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4b0ed19a-45e2-43b8-ad48-3343d03a85a7 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:44.088335 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4b0ed19a-45e2-43b8-ad48-3343d03a85a7 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1291282 Dec 09 21:53:44.092332 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54474) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:44.096744 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-6794d8e6-8705-4ea0-ac9f-78bcb0fe249d tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Request body: {'security_group_rule': {'security_group_id': 'e0446b46-bdd5-496a-bc4f-672214f90d12', 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:44.124528 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6794d8e6-8705-4ea0-ac9f-78bcb0fe249d tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:44.184132 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6794d8e6-8705-4ea0-ac9f-78bcb0fe249d tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:44.190245 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6794d8e6-8705-4ea0-ac9f-78bcb0fe249d tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:44.212702 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6794d8e6-8705-4ea0-ac9f-78bcb0fe249d tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f8d2fb99-67a1-47bc-bd35-918ee2fce5f7,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:44.221135 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6794d8e6-8705-4ea0-ac9f-78bcb0fe249d tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:44.222356 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6794d8e6-8705-4ea0-ac9f-78bcb0fe249d tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1290867 Dec 09 21:53:44.226000 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54476) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:44.230398 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-5d40f3e6-7e7d-4fd6-a627-6394135e60a2 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Request body: {'security_group_rule': {'security_group_id': 'e0446b46-bdd5-496a-bc4f-672214f90d12', 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:44.254677 n-d-713301-27 neutron-server[103437]: INFO neutron.db.securitygroups_db [None req-5d40f3e6-7e7d-4fd6-a627-6394135e60a2 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Project a1dd4ab6f25741058f3000ebf6ce1eac added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 21:53:44.259719 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d40f3e6-7e7d-4fd6-a627-6394135e60a2 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:44.320068 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d40f3e6-7e7d-4fd6-a627-6394135e60a2 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:44.326397 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d40f3e6-7e7d-4fd6-a627-6394135e60a2 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:44.344479 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d40f3e6-7e7d-4fd6-a627-6394135e60a2 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3b9c15d5-466a-445a-870d-72cb41792a21,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:44.353379 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5d40f3e6-7e7d-4fd6-a627-6394135e60a2 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:44.354614 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5d40f3e6-7e7d-4fd6-a627-6394135e60a2 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1276402 Dec 09 21:53:44.357632 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54478) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:44.362387 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-5ff0205f-072c-4243-b6ad-a144cf8328ba tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Request body: {'security_group_rule': {'security_group_id': 'e0446b46-bdd5-496a-bc4f-672214f90d12', 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:44.385607 n-d-713301-27 neutron-server[103438]: INFO neutron.db.securitygroups_db [None req-5ff0205f-072c-4243-b6ad-a144cf8328ba tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Project a1dd4ab6f25741058f3000ebf6ce1eac added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 21:53:44.390735 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ff0205f-072c-4243-b6ad-a144cf8328ba tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:44.470534 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ff0205f-072c-4243-b6ad-a144cf8328ba tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:44.474996 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ff0205f-072c-4243-b6ad-a144cf8328ba tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:44.494206 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ff0205f-072c-4243-b6ad-a144cf8328ba tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e14464a4-d932-4fc7-a2f1-4d63a4364f64,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:44.503565 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ff0205f-072c-4243-b6ad-a144cf8328ba tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:44.505149 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5ff0205f-072c-4243-b6ad-a144cf8328ba tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1463096 Dec 09 21:53:44.665144 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-d888219a-6636-4e07-a32d-c724254b1347 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1679145500&fields=id&tenant_id=a1dd4ab6f25741058f3000ebf6ce1eac HTTP/1.1" status: 200 len: 267 time: 0.0468938 Dec 09 21:53:44.781895 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-fcae54a6-21b5-4571-8e10-3e7da3ef43a3 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:44.783499 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-fcae54a6-21b5-4571-8e10-3e7da3ef43a3 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/networks?id=9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 HTTP/1.1" status: 200 len: 808 time: 0.1100469 Dec 09 21:53:44.801005 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-532e18c2-77c4-4fe0-aa2a-addffbc56c3b tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/quotas/a1dd4ab6f25741058f3000ebf6ce1eac HTTP/1.1" status: 200 len: 375 time: 0.0112636 Dec 09 21:53:44.854407 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-e8df0780-3d0d-4eef-9033-e9f68dfcc721 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=a1dd4ab6f25741058f3000ebf6ce1eac&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0476148 Dec 09 21:53:44.962511 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-646c09ea-e7ef-4a49-abb8-d6a3bafe2da5 service neutron] 10.222.0.13 "GET /v2.0/networks/9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0952108 Dec 09 21:53:45.056235 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-b089952b-b23d-4582-b9b1-26c7c2e2f23e service neutron] 10.222.0.13 "GET /v2.0/networks/9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0872271 Dec 09 21:53:45.221343 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device cfca101a-a0fb-4ffb-99fe-557a861caf93 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:53:45.258842 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-73890411-4f6e-47c0-8451-1bff2f54809e req-bb0e71c1-8145-4c86-a27f-de91310f5d62 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/ports?device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 210 time: 0.0278151 Dec 09 21:53:45.280464 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port cfca101a-a0fb-4ffb-99fe-557a861caf93 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:45.281041 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:45.368512 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device efce1b9c-0122-448d-b190-5f99e09d575a up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:53:45.434227 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port efce1b9c-0122-448d-b190-5f99e09d575a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:45.434643 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:45.845967 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] Sync routers for ids ['8c937498-e34f-483d-b4e0-1b40a8f681f1'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:53:45.856613 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] Routers {'8c937498-e34f-483d-b4e0-1b40a8f681f1'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:53:45.857220 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:53:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['8c937498-e34f-483d-b4e0-1b40a8f681f1'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:45.961401 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] Set router 8c937498-e34f-483d-b4e0-1b40a8f681f1 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:53:46.169868 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8c937498-e34f-483d-b4e0-1b40a8f681f1', 'name': 'tempest-TestServerBasicOps-1606904686-router', 'tenant_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.162'}], 'enable_snat': True}, 'gw_port_id': 'cfca101a-a0fb-4ffb-99fe-557a861caf93', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:38Z', 'updated_at': '2021-12-09T21:53:42Z', 'revision_number': 4, 'project_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'gw_port': {'id': 'cfca101a-a0fb-4ffb-99fe-557a861caf93', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:f3:3e:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c937498-e34f-483d-b4e0-1b40a8f681f1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3900, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:39Z', 'updated_at': '2021-12-09T21:53:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'f40f0052-c615-4c88-9cc5-8c66748c34fe', 'name': '', 'network_id': '0fbb81d3-e114-41cc-97c1-0df7c248e4a9', 'tenant_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'mac_address': 'fa:16:3e:49:46:df', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8c937498-e34f-483d-b4e0-1b40a8f681f1', 'device_owner': 'network:router_interface', 'standard_attr_id': 3901, 'fixed_ips': [{'subnet_id': 'aef9b85f-e47c-4201-91c9-161e142a9441', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:41Z', 'updated_at': '2021-12-09T21:53:42Z', 'revision_number': 2, 'project_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'subnets': [{'id': 'aef9b85f-e47c-4201-91c9-161e142a9441', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:46.200129 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] Checking router: 8c937498-e34f-483d-b4e0-1b40a8f681f1 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:53:46.200750 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] Updating router 8c937498-e34f-483d-b4e0-1b40a8f681f1 port f40f0052-c615-4c88-9cc5-8c66748c34fe binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:53:46.229126 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:46.318492 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-7673b632-f7b6-409e-89b4-347b1131ef40 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:46.321816 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-7673b632-f7b6-409e-89b4-347b1131ef40 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.31 "GET /v2.0/networks?id=9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 HTTP/1.1" status: 200 len: 808 time: 0.1530492 Dec 09 21:53:46.383275 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7da5b95d-d431-48cb-b861-ebc7f64ca885 req-12278fcf-b723-4047-8df5-1170e4e7ae5f tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/ports?device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 210 time: 0.0373528 Dec 09 21:53:46.415248 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-63f56150-3f9b-446a-b36e-03e4df519f58 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a1dd4ab6f25741058f3000ebf6ce1eac HTTP/1.1" status: 200 len: 380 time: 0.0771377 Dec 09 21:53:46.430925 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0984bac7-aaa8-4380-bd90-5dee062b8535 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Request body: {'port': {'device_id': '4cf5eac2-f76a-49ca-aabf-537385b7e325', 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7', 'admin_state_up': True, 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'security_groups': ['e0446b46-bdd5-496a-bc4f-672214f90d12']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:46.557089 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0984bac7-aaa8-4380-bd90-5dee062b8535 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Made reservation on behalf of a1dd4ab6f25741058f3000ebf6ce1eac for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:53:46.560873 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0984bac7-aaa8-4380-bd90-5dee062b8535 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:46.634476 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:46.641065 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:46.701811 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0984bac7-aaa8-4380-bd90-5dee062b8535 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Allocated IP 172.20.0.13 (9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7/912d0a1a-1b1a-4383-8291-491e8e3358fe/48ed4870-53b4-441d-92a8-1562825c8ca3) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:53:46.710410 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34b934b1-3aee-400b-a4ce-355917e2398f None None] Pushing event updated for resources: {'Port': ['ID=f40f0052-c615-4c88-9cc5-8c66748c34fe,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:46.738360 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] Attempting to bind port f40f0052-c615-4c88-9cc5-8c66748c34fe on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:53:46.738731 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] Attempting to bind port f40f0052-c615-4c88-9cc5-8c66748c34fe by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '1cf908c4-b2d8-4a3c-a764-c91d90de89cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '0fbb81d3-e114-41cc-97c1-0df7c248e4a9'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:53:46.739094 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] Attempting to bind port f40f0052-c615-4c88-9cc5-8c66748c34fe on network 0fbb81d3-e114-41cc-97c1-0df7c248e4a9 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:53:46.744142 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 53, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:53:46.744508 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] Checking segment: {'id': '1cf908c4-b2d8-4a3c-a764-c91d90de89cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '0fbb81d3-e114-41cc-97c1-0df7c248e4a9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:53:46.744903 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:46.745281 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] Bound using segment: {'id': '1cf908c4-b2d8-4a3c-a764-c91d90de89cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '0fbb81d3-e114-41cc-97c1-0df7c248e4a9'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:53:46.745743 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] Bound port: f40f0052-c615-4c88-9cc5-8c66748c34fe, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1cf908c4-b2d8-4a3c-a764-c91d90de89cd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 140, 'network_id': '0fbb81d3-e114-41cc-97c1-0df7c248e4a9'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:53:46.746109 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:46.827590 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] For port f40f0052-c615-4c88-9cc5-8c66748c34fe, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:53:46.832731 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] For port f40f0052-c615-4c88-9cc5-8c66748c34fe, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f40f0052-c615-4c88-9cc5-8c66748c34fe,segment=NetworkSegment(1cf908c4-b2d8-4a3c-a764-c91d90de89cd),segment_id=1cf908c4-b2d8-4a3c-a764-c91d90de89cd)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:53:46.840075 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:46.900903 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] Routers {'8c937498-e34f-483d-b4e0-1b40a8f681f1'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:53:46.902420 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:53:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['8c937498-e34f-483d-b4e0-1b40a8f681f1'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:46.912336 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0984bac7-aaa8-4380-bd90-5dee062b8535 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:46.939941 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34b934b1-3aee-400b-a4ce-355917e2398f None None] Pushing event updated for resources: {'Port': ['ID=f40f0052-c615-4c88-9cc5-8c66748c34fe,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:46.959833 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0984bac7-aaa8-4380-bd90-5dee062b8535 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:47.017355 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0984bac7-aaa8-4380-bd90-5dee062b8535 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Network 9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:53:47.021153 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0984bac7-aaa8-4380-bd90-5dee062b8535 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:53:47.030221 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0984bac7-aaa8-4380-bd90-5dee062b8535 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:53:47.030784 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1e21eb94-84cb-454e-b796-7e113f605178 None None] Provisioning complete for port f40f0052-c615-4c88-9cc5-8c66748c34fe triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:47.031245 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1e21eb94-84cb-454e-b796-7e113f605178 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:47.040036 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] Set router 8c937498-e34f-483d-b4e0-1b40a8f681f1 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:53:47.086978 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0984bac7-aaa8-4380-bd90-5dee062b8535 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Pushing event updated for resources: {'Port': ['ID=48ed4870-53b4-441d-92a8-1562825c8ca3,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:47.152687 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0984bac7-aaa8-4380-bd90-5dee062b8535 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:47.153882 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0984bac7-aaa8-4380-bd90-5dee062b8535 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:47.190090 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1e21eb94-84cb-454e-b796-7e113f605178 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:47.199287 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0984bac7-aaa8-4380-bd90-5dee062b8535 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7711196 Dec 09 21:53:47.236919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-1e21eb94-84cb-454e-b796-7e113f605178 None None] For port f40f0052-c615-4c88-9cc5-8c66748c34fe, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f40f0052-c615-4c88-9cc5-8c66748c34fe,segment=NetworkSegment(1cf908c4-b2d8-4a3c-a764-c91d90de89cd),segment_id=1cf908c4-b2d8-4a3c-a764-c91d90de89cd)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:47.245028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f40f0052-c615-4c88-9cc5-8c66748c34fe up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:53:47.251968 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1e21eb94-84cb-454e-b796-7e113f605178 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:47.422162 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e21eb94-84cb-454e-b796-7e113f605178 None None] Pushing event updated for resources: {'Port': ['ID=f40f0052-c615-4c88-9cc5-8c66748c34fe,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:47.470160 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f40f0052-c615-4c88-9cc5-8c66748c34fe triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:47.471375 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:47.474482 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8c937498-e34f-483d-b4e0-1b40a8f681f1', 'name': 'tempest-TestServerBasicOps-1606904686-router', 'tenant_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.162'}], 'enable_snat': True}, 'gw_port_id': 'cfca101a-a0fb-4ffb-99fe-557a861caf93', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:38Z', 'updated_at': '2021-12-09T21:53:42Z', 'revision_number': 4, 'project_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'gw_port': {'id': 'cfca101a-a0fb-4ffb-99fe-557a861caf93', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:f3:3e:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c937498-e34f-483d-b4e0-1b40a8f681f1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3900, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:39Z', 'updated_at': '2021-12-09T21:53:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'f40f0052-c615-4c88-9cc5-8c66748c34fe', 'name': '', 'network_id': '0fbb81d3-e114-41cc-97c1-0df7c248e4a9', 'tenant_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'mac_address': 'fa:16:3e:49:46:df', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8c937498-e34f-483d-b4e0-1b40a8f681f1', 'device_owner': 'network:router_interface', 'standard_attr_id': 3901, 'fixed_ips': [{'subnet_id': 'aef9b85f-e47c-4201-91c9-161e142a9441', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:41Z', 'updated_at': '2021-12-09T21:53:46Z', 'revision_number': 4, 'project_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'subnets': [{'id': 'aef9b85f-e47c-4201-91c9-161e142a9441', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:47.475727 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0d0dafe9-bdeb-40fe-8588-c95eb32c7c72 service neutron] Request body: {'port': {'device_id': '4cf5eac2-f76a-49ca-aabf-537385b7e325', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:47.542684 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a440ba1d-f6a6-4c3c-9ae1-f7cb9c470225 None None] The sync data for ids ['8c937498-e34f-483d-b4e0-1b40a8f681f1'] in n-d-713301-27 is: [{'id': '8c937498-e34f-483d-b4e0-1b40a8f681f1', 'name': 'tempest-TestServerBasicOps-1606904686-router', 'tenant_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.162'}], 'enable_snat': True}, 'gw_port_id': 'cfca101a-a0fb-4ffb-99fe-557a861caf93', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:38Z', 'updated_at': '2021-12-09T21:53:42Z', 'revision_number': 4, 'project_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'gw_port': {'id': 'cfca101a-a0fb-4ffb-99fe-557a861caf93', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:f3:3e:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c937498-e34f-483d-b4e0-1b40a8f681f1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3900, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:39Z', 'updated_at': '2021-12-09T21:53:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'f40f0052-c615-4c88-9cc5-8c66748c34fe', 'name': '', 'network_id': '0fbb81d3-e114-41cc-97c1-0df7c248e4a9', 'tenant_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'mac_address': 'fa:16:3e:49:46:df', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8c937498-e34f-483d-b4e0-1b40a8f681f1', 'device_owner': 'network:router_interface', 'standard_attr_id': 3901, 'fixed_ips': [{'subnet_id': 'aef9b85f-e47c-4201-91c9-161e142a9441', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:41Z', 'updated_at': '2021-12-09T21:53:46Z', 'revision_number': 4, 'project_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'subnets': [{'id': 'aef9b85f-e47c-4201-91c9-161e142a9441', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:53:47.553804 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-48ef56c8-53a1-48a4-814a-62a89c3cdf42 None None] Provisioning complete for port f40f0052-c615-4c88-9cc5-8c66748c34fe triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:47.554174 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-48ef56c8-53a1-48a4-814a-62a89c3cdf42 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:47.562679 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4446567c-90c6-446c-a8e8-6ca92a7ed914 req-ea42240d-838a-4070-822d-e3efff12bac0 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:47.571721 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4446567c-90c6-446c-a8e8-6ca92a7ed914 req-ea42240d-838a-4070-822d-e3efff12bac0 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/ports?device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 932 time: 0.0828474 Dec 09 21:53:47.592055 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0d0dafe9-bdeb-40fe-8588-c95eb32c7c72 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:47.646461 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4446567c-90c6-446c-a8e8-6ca92a7ed914 req-d5efef9e-502a-4f78-9539-55c0ba4e9c04 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/security-groups?id=e0446b46-bdd5-496a-bc4f-672214f90d12&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0736029 Dec 09 21:53:47.834274 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a2a7833f-1d91-4daf-9111-f4f7e419ca24 None None] Provisioning complete for port 48ed4870-53b4-441d-92a8-1562825c8ca3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:47.835030 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a2a7833f-1d91-4daf-9111-f4f7e419ca24 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:47.875956 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a2a7833f-1d91-4daf-9111-f4f7e419ca24 None None] Port 48ed4870-53b4-441d-92a8-1562825c8ca3 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:53:47.935038 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0d0dafe9-bdeb-40fe-8588-c95eb32c7c72 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 48ed4870-53b4-441d-92a8-1562825c8ca3 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:53:47.947854 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0d0dafe9-bdeb-40fe-8588-c95eb32c7c72 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:47.996418 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0d0dafe9-bdeb-40fe-8588-c95eb32c7c72 service neutron] Transition to ACTIVE for port object 48ed4870-53b4-441d-92a8-1562825c8ca3 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:53:48.006815 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0d0dafe9-bdeb-40fe-8588-c95eb32c7c72 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:48.095006 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d0dafe9-bdeb-40fe-8588-c95eb32c7c72 service neutron] Pushing event updated for resources: {'Port': ['ID=48ed4870-53b4-441d-92a8-1562825c8ca3,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:48.184373 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0d0dafe9-bdeb-40fe-8588-c95eb32c7c72 service neutron] Attempting to bind port 48ed4870-53b4-441d-92a8-1562825c8ca3 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:53:48.184718 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0d0dafe9-bdeb-40fe-8588-c95eb32c7c72 service neutron] Attempting to bind port 48ed4870-53b4-441d-92a8-1562825c8ca3 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'bd059ed1-b661-4e68-8df0-ed7798fa0c5d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:53:48.185060 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0d0dafe9-bdeb-40fe-8588-c95eb32c7c72 service neutron] Attempting to bind port 48ed4870-53b4-441d-92a8-1562825c8ca3 on network 9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:53:48.190798 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0d0dafe9-bdeb-40fe-8588-c95eb32c7c72 service neutron] Port 48ed4870-53b4-441d-92a8-1562825c8ca3 on network 9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:53:48.191125 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0d0dafe9-bdeb-40fe-8588-c95eb32c7c72 service neutron] Attempting to bind port 48ed4870-53b4-441d-92a8-1562825c8ca3 on network 9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:53:48.196203 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0d0dafe9-bdeb-40fe-8588-c95eb32c7c72 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 53, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:53:48.196542 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0d0dafe9-bdeb-40fe-8588-c95eb32c7c72 service neutron] Checking segment: {'id': 'bd059ed1-b661-4e68-8df0-ed7798fa0c5d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:53:48.196929 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0d0dafe9-bdeb-40fe-8588-c95eb32c7c72 service neutron] Bound using segment: {'id': 'bd059ed1-b661-4e68-8df0-ed7798fa0c5d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:53:48.197385 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0d0dafe9-bdeb-40fe-8588-c95eb32c7c72 service neutron] Bound port: 48ed4870-53b4-441d-92a8-1562825c8ca3, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bd059ed1-b661-4e68-8df0-ed7798fa0c5d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 142, 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:53:48.197794 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0d0dafe9-bdeb-40fe-8588-c95eb32c7c72 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:48.267702 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0d0dafe9-bdeb-40fe-8588-c95eb32c7c72 service neutron] For port 48ed4870-53b4-441d-92a8-1562825c8ca3, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:53:48.271032 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0d0dafe9-bdeb-40fe-8588-c95eb32c7c72 service neutron] For port 48ed4870-53b4-441d-92a8-1562825c8ca3, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=48ed4870-53b4-441d-92a8-1562825c8ca3,segment=NetworkSegment(bd059ed1-b661-4e68-8df0-ed7798fa0c5d),segment_id=bd059ed1-b661-4e68-8df0-ed7798fa0c5d)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:53:48.276131 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0d0dafe9-bdeb-40fe-8588-c95eb32c7c72 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:48.309909 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0d0dafe9-bdeb-40fe-8588-c95eb32c7c72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:48.310544 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0d0dafe9-bdeb-40fe-8588-c95eb32c7c72 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:48.312330 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-0d0dafe9-bdeb-40fe-8588-c95eb32c7c72 service neutron] 10.222.0.31 "PUT /v2.0/ports/48ed4870-53b4-441d-92a8-1562825c8ca3 HTTP/1.1" status: 200 len: 1093 time: 1.1021941 Dec 09 21:53:48.312916 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4cf5eac2-f76a-49ca-aabf-537385b7e325', 'tag': '48ed4870-53b4-441d-92a8-1562825c8ca3'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:53:48.315248 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3f428893-ceba-4419-8e2b-05c4806ac962" -d '{"events": [{"name": "network-changed", "server_uuid": "4cf5eac2-f76a-49ca-aabf-537385b7e325", "tag": "48ed4870-53b4-441d-92a8-1562825c8ca3"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:53:48.354949 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d0dafe9-bdeb-40fe-8588-c95eb32c7c72 service neutron] Pushing event updated for resources: {'Port': ['ID=48ed4870-53b4-441d-92a8-1562825c8ca3,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:48.377203 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:53:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5b41e572-611d-411d-b0e0-bf23bfd27499 x-openstack-request-id: req-5b41e572-611d-411d-b0e0-bf23bfd27499 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:53:48.377888 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4cf5eac2-f76a-49ca-aabf-537385b7e325", "tag": "48ed4870-53b4-441d-92a8-1562825c8ca3", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:53:48.378121 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-5b41e572-611d-411d-b0e0-bf23bfd27499 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:53:48.378586 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4cf5eac2-f76a-49ca-aabf-537385b7e325', 'tag': '48ed4870-53b4-441d-92a8-1562825c8ca3', 'status': 'completed', 'code': 200} Dec 09 21:53:48.412146 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-8eb1f753-b2cc-456c-b86a-ac29c22e4d64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:48.413720 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-8eb1f753-b2cc-456c-b86a-ac29c22e4d64 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a1dd4ab6f25741058f3000ebf6ce1eac&device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 1096 time: 0.0528910 Dec 09 21:53:48.464412 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-1e1fb355-f308-4b01-a5e9-a15df9ff04c7 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=48ed4870-53b4-441d-92a8-1562825c8ca3 HTTP/1.1" status: 200 len: 217 time: 0.0411506 Dec 09 21:53:48.538254 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-b2b1bf90-fb48-4740-a115-e061b4e5a588 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:48.540044 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-b2b1bf90-fb48-4740-a115-e061b4e5a588 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=912d0a1a-1b1a-4383-8291-491e8e3358fe HTTP/1.1" status: 200 len: 847 time: 0.0672884 Dec 09 21:53:48.589221 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-d8779806-c036-42c1-abcc-cc101d49a208 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:48.590882 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-d8779806-c036-42c1-abcc-cc101d49a208 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0438206 Dec 09 21:53:48.706623 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-07914398-30b2-4416-b384-0db3f16f8efc service neutron] 10.222.0.31 "GET /v2.0/networks/9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1073041 Dec 09 21:53:48.788988 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad83ae4c-1387-48ac-8494-6f4ba33a6643 req-404a5431-ae81-419f-8c10-f1b04d216b80 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:48.807338 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ad83ae4c-1387-48ac-8494-6f4ba33a6643 req-404a5431-ae81-419f-8c10-f1b04d216b80 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/ports?device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 944 time: 0.0728126 Dec 09 21:53:48.823747 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b73669ba-2e5f-4d90-80c4-5ae952687b9d req-420d02eb-a1e3-4d19-9a7b-45827e13b688 service neutron] 10.222.0.31 "GET /v2.0/networks/9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1094003 Dec 09 21:53:48.878040 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ad83ae4c-1387-48ac-8494-6f4ba33a6643 req-626dc46e-0cc9-4451-9bf2-a30897bdbc0f tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/security-groups?id=e0446b46-bdd5-496a-bc4f-672214f90d12&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0618465 Dec 09 21:53:48.930717 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f428893-ceba-4419-8e2b-05c4806ac962 req-8ca361f0-1931-44e5-8f56-ef362ece1879 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:48.932353 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3f428893-ceba-4419-8e2b-05c4806ac962 req-8ca361f0-1931-44e5-8f56-ef362ece1879 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a1dd4ab6f25741058f3000ebf6ce1eac&device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 1096 time: 0.0514309 Dec 09 21:53:49.033525 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f428893-ceba-4419-8e2b-05c4806ac962 req-659de57c-6586-4121-90ea-5b9de9bb5b9e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:49.035047 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3f428893-ceba-4419-8e2b-05c4806ac962 req-659de57c-6586-4121-90ea-5b9de9bb5b9e service neutron] 10.222.0.31 "GET /v2.0/networks?id=9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 HTTP/1.1" status: 200 len: 909 time: 0.0926654 Dec 09 21:53:49.082291 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3f428893-ceba-4419-8e2b-05c4806ac962 req-ab9b543b-79a5-41f3-a9cc-90709effea85 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=48ed4870-53b4-441d-92a8-1562825c8ca3 HTTP/1.1" status: 200 len: 217 time: 0.0394955 Dec 09 21:53:49.133948 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f40f0052-c615-4c88-9cc5-8c66748c34fe up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:53:49.148726 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f428893-ceba-4419-8e2b-05c4806ac962 req-9f757648-bf8c-4994-a0eb-89c5347d94f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:49.150191 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3f428893-ceba-4419-8e2b-05c4806ac962 req-9f757648-bf8c-4994-a0eb-89c5347d94f6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=912d0a1a-1b1a-4383-8291-491e8e3358fe HTTP/1.1" status: 200 len: 847 time: 0.0585439 Dec 09 21:53:49.187559 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f40f0052-c615-4c88-9cc5-8c66748c34fe triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:49.187870 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:49.204459 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f428893-ceba-4419-8e2b-05c4806ac962 req-330a8293-b66c-4c38-a504-84d6b5159c2b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:49.206062 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3f428893-ceba-4419-8e2b-05c4806ac962 req-330a8293-b66c-4c38-a504-84d6b5159c2b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0482690 Dec 09 21:53:49.311956 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3f428893-ceba-4419-8e2b-05c4806ac962 req-c8cdca00-fb3b-4b6b-82aa-dfb03cae8e9c service neutron] 10.222.0.31 "GET /v2.0/networks/9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0978675 Dec 09 21:53:49.412345 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3f428893-ceba-4419-8e2b-05c4806ac962 req-2651372e-18af-4837-b05c-fd6fa5992919 service neutron] 10.222.0.31 "GET /v2.0/networks/9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0923729 Dec 09 21:53:50.081177 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa1dda81-aae7-4f5f-b3a8-e773813f9acf req-f1b80922-444f-4c4e-b0a1-5c4ce409d482 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:50.088544 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fa1dda81-aae7-4f5f-b3a8-e773813f9acf req-f1b80922-444f-4c4e-b0a1-5c4ce409d482 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/ports?device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 944 time: 0.1275539 Dec 09 21:53:50.133353 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fa1dda81-aae7-4f5f-b3a8-e773813f9acf req-d4f537cd-98d0-42dc-9f1b-d33ac306ca9c tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/security-groups?id=e0446b46-bdd5-496a-bc4f-672214f90d12&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436893 Dec 09 21:53:51.255621 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cbc472f-5866-4e79-a960-1271a0b690e0 req-cbbc239d-d982-4c68-89b4-9e03c38c5ad3 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:51.257126 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6cbc472f-5866-4e79-a960-1271a0b690e0 req-cbbc239d-d982-4c68-89b4-9e03c38c5ad3 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/ports?device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 944 time: 0.0521743 Dec 09 21:53:51.319380 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6cbc472f-5866-4e79-a960-1271a0b690e0 req-fc283033-c089-4a18-adf3-fef421ab1dcf tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/security-groups?id=e0446b46-bdd5-496a-bc4f-672214f90d12&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0558574 Dec 09 21:53:52.166731 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 48ed4870-53b4-441d-92a8-1562825c8ca3 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:53:52.268192 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 48ed4870-53b4-441d-92a8-1562825c8ca3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=48ed4870-53b4-441d-92a8-1562825c8ca3,segment=NetworkSegment(bd059ed1-b661-4e68-8df0-ed7798fa0c5d),segment_id=bd059ed1-b661-4e68-8df0-ed7798fa0c5d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:52.283904 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '48ed4870-53b4-441d-92a8-1562825c8ca3', 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7', 'port_id': '48ed4870-53b4-441d-92a8-1562825c8ca3', 'mac_address': 'fa:16:3e:b1:7a:f9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 142, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '912d0a1a-1b1a-4383-8291-491e8e3358fe', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:53:52.328282 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:52.345709 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 48ed4870-53b4-441d-92a8-1562825c8ca3 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:53:52.366809 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 48ed4870-53b4-441d-92a8-1562825c8ca3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=48ed4870-53b4-441d-92a8-1562825c8ca3,segment=NetworkSegment(bd059ed1-b661-4e68-8df0-ed7798fa0c5d),segment_id=bd059ed1-b661-4e68-8df0-ed7798fa0c5d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:52.371281 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:52.420956 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=48ed4870-53b4-441d-92a8-1562825c8ca3,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:52.438096 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-983d9e53-8b21-43a7-9356-58bd40ab2680 req-fd1a223b-f291-481b-8477-a0b23b58eff9 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:52.439627 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-983d9e53-8b21-43a7-9356-58bd40ab2680 req-fd1a223b-f291-481b-8477-a0b23b58eff9 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/ports?device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 945 time: 0.0488346 Dec 09 21:53:52.493020 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-983d9e53-8b21-43a7-9356-58bd40ab2680 req-19f673e0-4405-4804-9482-a55bc3fd67b9 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/security-groups?id=e0446b46-bdd5-496a-bc4f-672214f90d12&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0471766 Dec 09 21:53:52.601279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['48ed4870-53b4-441d-92a8-1562825c8ca3'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:53:53.617317 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26476020-62b5-4d9e-a621-444597801cea req-278881da-eba6-444a-b07b-301a34dcd4e6 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:53.618846 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-26476020-62b5-4d9e-a621-444597801cea req-278881da-eba6-444a-b07b-301a34dcd4e6 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/ports?device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 945 time: 0.0499008 Dec 09 21:53:53.672564 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-26476020-62b5-4d9e-a621-444597801cea req-232e0b20-6a45-41f9-b134-035ca88b0cbb tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/security-groups?id=e0446b46-bdd5-496a-bc4f-672214f90d12&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465214 Dec 09 21:53:54.173727 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 48ed4870-53b4-441d-92a8-1562825c8ca3 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:53:54.228397 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 48ed4870-53b4-441d-92a8-1562825c8ca3 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:53:54.232783 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 48ed4870-53b4-441d-92a8-1562825c8ca3 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:54.233149 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:54.314910 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:54.338804 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4cf5eac2-f76a-49ca-aabf-537385b7e325', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '48ed4870-53b4-441d-92a8-1562825c8ca3'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:53:54.341074 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f5ed9400-e264-4b35-b9c9-83cf730ce500" -d '{"events": [{"server_uuid": "4cf5eac2-f76a-49ca-aabf-537385b7e325", "name": "network-vif-plugged", "status": "completed", "tag": "48ed4870-53b4-441d-92a8-1562825c8ca3"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:53:54.355091 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 48ed4870-53b4-441d-92a8-1562825c8ca3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=48ed4870-53b4-441d-92a8-1562825c8ca3,segment=NetworkSegment(bd059ed1-b661-4e68-8df0-ed7798fa0c5d),segment_id=bd059ed1-b661-4e68-8df0-ed7798fa0c5d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:53:54.361388 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:54.387622 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:53:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5d501567-13b2-4fa6-ac24-b50d541473a8 x-openstack-request-id: req-5d501567-13b2-4fa6-ac24-b50d541473a8 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:53:54.387947 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4cf5eac2-f76a-49ca-aabf-537385b7e325", "name": "network-vif-plugged", "status": "completed", "tag": "48ed4870-53b4-441d-92a8-1562825c8ca3", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:53:54.388218 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-5d501567-13b2-4fa6-ac24-b50d541473a8 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:53:54.388633 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4cf5eac2-f76a-49ca-aabf-537385b7e325', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '48ed4870-53b4-441d-92a8-1562825c8ca3', 'code': 200} Dec 09 21:53:54.414582 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=48ed4870-53b4-441d-92a8-1562825c8ca3,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:54.422340 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:54.422691 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:54.423033 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:54.423382 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:54.423747 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:54.424108 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:54.424404 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:54.424726 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:54.425053 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:54.425372 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:54.425732 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:54.426014 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:54.426359 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:53:54.487765 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ec12a53-73f0-4a85-a182-3bbc935f833d req-fdfbc77b-82c8-474f-9a27-3d8986dcc4b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:54.489292 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9ec12a53-73f0-4a85-a182-3bbc935f833d req-fdfbc77b-82c8-474f-9a27-3d8986dcc4b1 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 1098 time: 0.0412569 Dec 09 21:53:54.542128 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9ec12a53-73f0-4a85-a182-3bbc935f833d req-fcda2a32-e15f-417f-961b-d3d18a4a6252 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=e0446b46-bdd5-496a-bc4f-672214f90d12&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431688 Dec 09 21:53:54.798580 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd0437eb-78a7-4431-96ab-db7f822c63a6 req-1d12af42-c8bd-48ab-a3f4-9ce3f55ca3bb tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:54.800155 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd0437eb-78a7-4431-96ab-db7f822c63a6 req-1d12af42-c8bd-48ab-a3f4-9ce3f55ca3bb tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/ports?device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 946 time: 0.0540397 Dec 09 21:53:54.850660 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd0437eb-78a7-4431-96ab-db7f822c63a6 req-fd4a6923-2714-426c-9508-f232a5575730 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/security-groups?id=e0446b46-bdd5-496a-bc4f-672214f90d12&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443673 Dec 09 21:53:55.977005 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4af6c8b-9697-4fe5-9624-183daa7559e5 req-66bf06e0-e0d9-4925-b7f0-5d335a1e52f9 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:55.981016 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b4af6c8b-9697-4fe5-9624-183daa7559e5 req-66bf06e0-e0d9-4925-b7f0-5d335a1e52f9 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/ports?device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 946 time: 0.0576057 Dec 09 21:53:56.030235 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b4af6c8b-9697-4fe5-9624-183daa7559e5 req-c427ed1f-4a12-48dd-b52e-15122697470e tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/security-groups?id=e0446b46-bdd5-496a-bc4f-672214f90d12&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455124 Dec 09 21:53:56.163245 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6003f47-bdb1-4720-a7fc-738f86ecf30e req-fd0c89ef-3dfe-4fb9-9394-529183d9bd8d tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:56.164982 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a6003f47-bdb1-4720-a7fc-738f86ecf30e req-fd0c89ef-3dfe-4fb9-9394-529183d9bd8d tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/ports?device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 946 time: 0.0674436 Dec 09 21:53:56.222295 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a6003f47-bdb1-4720-a7fc-738f86ecf30e req-27076710-4efc-45f5-ade8-cc4c7f1ecb57 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/security-groups?id=e0446b46-bdd5-496a-bc4f-672214f90d12&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0495484 Dec 09 21:53:56.302657 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54578) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:56.352159 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a729d7ce-1c16-43dc-b37f-6ea3f8c442ed req-bc0f2410-52e2-4e84-b720-789e6036416f tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:56.353688 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a729d7ce-1c16-43dc-b37f-6ea3f8c442ed req-bc0f2410-52e2-4e84-b720-789e6036416f tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/ports?device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 946 time: 0.0575788 Dec 09 21:53:56.404190 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cdcd8cbb-491c-498d-942a-7c18589b7b2c tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] 10.222.0.13 "GET /v2.0/ports?fields=fixed_ips&fields=mac_address HTTP/1.1" status: 200 len: 2414 time: 0.0959017 Dec 09 21:53:56.404442 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54580) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:56.409533 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-8477ce66-4ae7-4e93-be06-5aa18b6465af tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Request body: {'network': {'name': 'tempest-network-smoke--1333808944', 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'port_security_enabled': False}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:56.415606 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a729d7ce-1c16-43dc-b37f-6ea3f8c442ed req-a063e6a0-ee6d-4f1f-8a07-4ef2f18e5172 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/security-groups?id=e0446b46-bdd5-496a-bc4f-672214f90d12&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0555568 Dec 09 21:53:56.434207 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8477ce66-4ae7-4e93-be06-5aa18b6465af tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Made reservation on behalf of 594fec82d9ab4e97a76f8c869f0bbcf0 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:53:56.438610 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8477ce66-4ae7-4e93-be06-5aa18b6465af tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:56.440831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54582) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:56.467317 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8477ce66-4ae7-4e93-be06-5aa18b6465af tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] vlan segment allocate from pool success with {'vlan_id': 123, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:53:56.477127 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8477ce66-4ae7-4e93-be06-5aa18b6465af tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:56.477476 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-8477ce66-4ae7-4e93-be06-5aa18b6465af tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Added segment 6d67c360-0c3e-45bc-a87c-f081fe129dc5 of type vlan for network d44855ac-a8dc-4ffd-bff8-176929f8ca30 Dec 09 21:53:56.527825 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8477ce66-4ae7-4e93-be06-5aa18b6465af tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:56.540159 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13efdbf7-7940-4557-804d-68f55477db9c tempest-TestServerBasicOps-1737142071 tempest-TestServerBasicOps-1737142071-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:56.543494 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-13efdbf7-7940-4557-804d-68f55477db9c tempest-TestServerBasicOps-1737142071 tempest-TestServerBasicOps-1737142071-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 1093 time: 0.0996916 Dec 09 21:53:56.545106 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54586) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:56.549862 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-8badf683-d48b-423b-8b7f-abb7cedec81c tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': '48ed4870-53b4-441d-92a8-1562825c8ca3', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'fixed_ip_address': '172.20.0.13'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:56.555935 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8477ce66-4ae7-4e93-be06-5aa18b6465af tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:56.563363 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8477ce66-4ae7-4e93-be06-5aa18b6465af tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:56.564124 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8477ce66-4ae7-4e93-be06-5aa18b6465af tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:56.573785 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8badf683-d48b-423b-8b7f-abb7cedec81c tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:56.603483 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8477ce66-4ae7-4e93-be06-5aa18b6465af tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 770 time: 0.1977866 Dec 09 21:53:56.606045 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54588) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:56.611943 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c9d2a0a5-0144-450c-84ae-779c76f20c79 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Request body: {'router': {'name': 'tempest-TestSecurityGroupsBasicOps-router-850480051', 'admin_state_up': True, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:53:56.635737 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8477ce66-4ae7-4e93-be06-5aa18b6465af tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event updated for resources: {'Network': ['ID=d44855ac-a8dc-4ffd-bff8-176929f8ca30,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:56.647094 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network d44855ac-a8dc-4ffd-bff8-176929f8ca30 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:53:56.673994 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c9d2a0a5-0144-450c-84ae-779c76f20c79 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:56.675101 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c9d2a0a5-0144-450c-84ae-779c76f20c79 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:56.740529 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c9d2a0a5-0144-450c-84ae-779c76f20c79 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:56.751466 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8badf683-d48b-423b-8b7f-abb7cedec81c tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:56.928492 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c9d2a0a5-0144-450c-84ae-779c76f20c79 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:56.993746 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-8badf683-d48b-423b-8b7f-abb7cedec81c tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Allocated IP 172.25.3.223 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/8cbaa3dc-5239-44ca-a1c0-9146b8fefd35) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:53:57.153749 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8badf683-d48b-423b-8b7f-abb7cedec81c tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:57.273392 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c9d2a0a5-0144-450c-84ae-779c76f20c79 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:57.293821 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c9d2a0a5-0144-450c-84ae-779c76f20c79 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:57.296241 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8badf683-d48b-423b-8b7f-abb7cedec81c tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:57.361908 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:57.373228 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8badf683-d48b-423b-8b7f-abb7cedec81c tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:53:57.379562 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-8badf683-d48b-423b-8b7f-abb7cedec81c tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:53:57.386737 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8badf683-d48b-423b-8b7f-abb7cedec81c tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:53:57.411912 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8badf683-d48b-423b-8b7f-abb7cedec81c tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Pushing event updated for resources: {'Port': ['ID=8cbaa3dc-5239-44ca-a1c0-9146b8fefd35,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:57.495205 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-c9d2a0a5-0144-450c-84ae-779c76f20c79 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Allocated IP 172.25.3.217 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/d434eb5a-ab43-4057-96cb-3339e8aed8e8) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:53:57.580453 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:57.717440 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c9d2a0a5-0144-450c-84ae-779c76f20c79 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:57.831845 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c9d2a0a5-0144-450c-84ae-779c76f20c79 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:57.904561 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c9d2a0a5-0144-450c-84ae-779c76f20c79 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:53:57.910308 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-c9d2a0a5-0144-450c-84ae-779c76f20c79 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:53:57.920052 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9d2a0a5-0144-450c-84ae-779c76f20c79 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:53:57.924745 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9d2a0a5-0144-450c-84ae-779c76f20c79 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event updated for resources: {'Port': ['ID=d434eb5a-ab43-4057-96cb-3339e8aed8e8,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:57.925835 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4242750d-946e-4b61-a6d9-30c60da3a53b None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:53:57.971502 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8badf683-d48b-423b-8b7f-abb7cedec81c tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:58.008731 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-96f94865-aed8-44c4-a4ce-43590858c6ef None None] Provisioning complete for port d434eb5a-ab43-4057-96cb-3339e8aed8e8 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:53:58.009052 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-96f94865-aed8-44c4-a4ce-43590858c6ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:58.047375 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-96f94865-aed8-44c4-a4ce-43590858c6ef None None] Port d434eb5a-ab43-4057-96cb-3339e8aed8e8 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:53:58.503010 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8badf683-d48b-423b-8b7f-abb7cedec81c tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:58.689175 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c9d2a0a5-0144-450c-84ae-779c76f20c79 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:58.832709 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8badf683-d48b-423b-8b7f-abb7cedec81c tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:58.838272 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8badf683-d48b-423b-8b7f-abb7cedec81c tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:58.975303 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8badf683-d48b-423b-8b7f-abb7cedec81c tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Pushing event updated for resources: {'Port': ['ID=8cbaa3dc-5239-44ca-a1c0-9146b8fefd35,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:53:59.007230 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8badf683-d48b-423b-8b7f-abb7cedec81c tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:59.009388 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c9d2a0a5-0144-450c-84ae-779c76f20c79 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:59.189120 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-8badf683-d48b-423b-8b7f-abb7cedec81c tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Floating IP d70d14fc-db5b-450b-881c-4d7fd32c036f associated. External IP: 172.25.3.223, port: 48ed4870-53b4-441d-92a8-1562825c8ca3. Dec 09 21:53:59.303665 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c9d2a0a5-0144-450c-84ae-779c76f20c79 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Router fc45912b-0461-4a97-9b3b-3855aa3f688c is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:53:59.506387 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c9d2a0a5-0144-450c-84ae-779c76f20c79 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:53:59.517071 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] Sync routers for ids ['fc45912b-0461-4a97-9b3b-3855aa3f688c'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:53:59.521225 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8badf683-d48b-423b-8b7f-abb7cedec81c tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Router d9cf6337-3bad-4310-b6ab-6a6e5ee3198c has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:53:59.528179 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] Routers {'fc45912b-0461-4a97-9b3b-3855aa3f688c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:53:59.528831 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:53:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['fc45912b-0461-4a97-9b3b-3855aa3f688c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:59.537160 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c9d2a0a5-0144-450c-84ae-779c76f20c79 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:59.541254 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c9d2a0a5-0144-450c-84ae-779c76f20c79 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 893 time: 2.9313076 Dec 09 21:53:59.542096 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54604) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:59.596192 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e6ed4e5e-b821-466b-b8b0-a04c2212501e tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:59.603714 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e6ed4e5e-b821-466b-b8b0-a04c2212501e tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] 10.222.0.13 "GET /v2.0/subnets?project_id=594fec82d9ab4e97a76f8c869f0bbcf0&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 830 time: 0.0593917 Dec 09 21:53:59.604679 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54606) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:59.644972 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] Set router fc45912b-0461-4a97-9b3b-3855aa3f688c gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:53:59.648037 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8badf683-d48b-423b-8b7f-abb7cedec81c tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:53:59.659503 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b653cf35-d801-40bc-b9d3-efac64e9ce72 None None] Sync routers for ids ['d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:53:59.671943 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b653cf35-d801-40bc-b9d3-efac64e9ce72 None None] Routers {'d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:53:59.673357 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-b653cf35-d801-40bc-b9d3-efac64e9ce72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:53:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:59.688130 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8badf683-d48b-423b-8b7f-abb7cedec81c tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:59.733340 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ac34760-2fef-4346-ab80-6052d80d3db6 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:59.738793 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54608) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:59.741423 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5ac34760-2fef-4346-ab80-6052d80d3db6 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1342735 Dec 09 21:53:59.751770 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8badf683-d48b-423b-8b7f-abb7cedec81c tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 3.2055666 Dec 09 21:53:59.771649 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4cf5eac2-f76a-49ca-aabf-537385b7e325', 'tag': '48ed4870-53b4-441d-92a8-1562825c8ca3'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:53:59.772435 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b056993d-b8c3-4f9f-a928-69eea2cff3d6" -d '{"events": [{"name": "network-changed", "server_uuid": "4cf5eac2-f76a-49ca-aabf-537385b7e325", "tag": "48ed4870-53b4-441d-92a8-1562825c8ca3"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:53:59.780768 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-33e3133f-d17d-444e-b726-473271cb5870 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] 10.222.0.13 "GET /v2.0/subnets?network_id=97925a19-460a-4476-8208-41db134b6c83&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0380192 Dec 09 21:53:59.781635 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54614) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:59.847722 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-34eb5d87-abfe-4807-b31f-fc7b296fb283 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] 10.222.0.13 "GET /v2.0/subnets?project_id=594fec82d9ab4e97a76f8c869f0bbcf0&cidr=172.20.0.16%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0645263 Dec 09 21:53:59.850292 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54618) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:53:59.866592 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-b653cf35-d801-40bc-b9d3-efac64e9ce72 None None] Set router d9cf6337-3bad-4310-b6ab-6a6e5ee3198c gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:53:59.882526 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fc45912b-0461-4a97-9b3b-3855aa3f688c', 'name': 'tempest-TestSecurityGroupsBasicOps-router-850480051', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.217'}], 'enable_snat': True}, 'gw_port_id': 'd434eb5a-ab43-4057-96cb-3339e8aed8e8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:56Z', 'updated_at': '2021-12-09T21:53:58Z', 'revision_number': 3, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'gw_port': {'id': 'd434eb5a-ab43-4057-96cb-3339e8aed8e8', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:a9:a7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fc45912b-0461-4a97-9b3b-3855aa3f688c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3916, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.217', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:57Z', 'updated_at': '2021-12-09T21:53:57Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:53:59.935917 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:53:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e0913ffe-360b-4a78-8b8a-739de591dec7 x-openstack-request-id: req-e0913ffe-360b-4a78-8b8a-739de591dec7 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:53:59.936352 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4cf5eac2-f76a-49ca-aabf-537385b7e325", "tag": "48ed4870-53b4-441d-92a8-1562825c8ca3", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:53:59.936703 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e0913ffe-360b-4a78-8b8a-739de591dec7 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:53:59.937205 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4cf5eac2-f76a-49ca-aabf-537385b7e325', 'tag': '48ed4870-53b4-441d-92a8-1562825c8ca3', 'status': 'completed', 'code': 200} Dec 09 21:53:59.941024 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] Checking router: fc45912b-0461-4a97-9b3b-3855aa3f688c for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:53:59.941367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] Updating router fc45912b-0461-4a97-9b3b-3855aa3f688c port d434eb5a-ab43-4057-96cb-3339e8aed8e8 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:53:59.975638 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:53:59.977075 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ef969c24-545d-473f-bf2c-db99883422b8 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:53:59.983870 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ef969c24-545d-473f-bf2c-db99883422b8 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1321778 Dec 09 21:53:59.988100 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54620) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:00.038453 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b056993d-b8c3-4f9f-a928-69eea2cff3d6 req-42acf3e7-6725-49ac-a19f-e7210b1e83c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:00.040378 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b056993d-b8c3-4f9f-a928-69eea2cff3d6 req-42acf3e7-6725-49ac-a19f-e7210b1e83c9 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a1dd4ab6f25741058f3000ebf6ce1eac&device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 1098 time: 0.0812478 Dec 09 21:54:00.047827 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54622) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:00.053545 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-35cfcd0b-b299-471d-afa9-f55f2845fd33 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] 10.222.0.13 "GET /v2.0/subnets?network_id=97925a19-460a-4476-8208-41db134b6c83&cidr=172.20.0.16%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0633490 Dec 09 21:54:00.054680 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-affe1fa1-4d67-4406-8cde-dfb2469fa19a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1461197510', 'network_id': 'd44855ac-a8dc-4ffd-bff8-176929f8ca30', 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'ip_version': 4, 'cidr': '172.20.0.16/28'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:54:00.146964 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-b653cf35-d801-40bc-b9d3-efac64e9ce72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'name': 'tempest-TestServerBasicOps-833518784-router', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129'}], 'enable_snat': True}, 'gw_port_id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:33Z', 'updated_at': '2021-12-09T21:53:36Z', 'revision_number': 4, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'gw_port': {'id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:c4:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3888, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:34Z', 'updated_at': '2021-12-09T21:53:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'd70d14fc-db5b-450b-881c-4d7fd32c036f', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'floating_ip_address': '172.25.3.223', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'port_id': '48ed4870-53b4-441d-92a8-1562825c8ca3', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 3917, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7', 'mac_address': 'fa:16:3e:b1:7a:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cf5eac2-f76a-49ca-aabf-537385b7e325', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:53:57Z', 'updated_at': '2021-12-09T21:53:57Z', 'revision_number': 0, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'efce1b9c-0122-448d-b190-5f99e09d575a', 'name': '', 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'mac_address': 'fa:16:3e:5a:e8:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'device_owner': 'network:router_interface', 'standard_attr_id': 3889, 'fixed_ips': [{'subnet_id': '912d0a1a-1b1a-4383-8291-491e8e3358fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:36Z', 'updated_at': '2021-12-09T21:53:42Z', 'revision_number': 5, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'subnets': [{'id': '912d0a1a-1b1a-4383-8291-491e8e3358fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:00.183076 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b653cf35-d801-40bc-b9d3-efac64e9ce72 None None] Checking router: d9cf6337-3bad-4310-b6ab-6a6e5ee3198c for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:54:00.192900 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b653cf35-d801-40bc-b9d3-efac64e9ce72 None None] Routers {'d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:54:00.194636 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-b653cf35-d801-40bc-b9d3-efac64e9ce72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:53:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:00.222032 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-affe1fa1-4d67-4406-8cde-dfb2469fa19a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Made reservation on behalf of 594fec82d9ab4e97a76f8c869f0bbcf0 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:54:00.226248 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-affe1fa1-4d67-4406-8cde-dfb2469fa19a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:00.255584 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:00.266020 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:00.272427 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b056993d-b8c3-4f9f-a928-69eea2cff3d6 req-c19fc303-c0bd-434e-82bb-cf781e2effdc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:00.273935 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b056993d-b8c3-4f9f-a928-69eea2cff3d6 req-c19fc303-c0bd-434e-82bb-cf781e2effdc service neutron] 10.222.0.31 "GET /v2.0/networks?id=9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 HTTP/1.1" status: 200 len: 909 time: 0.1830554 Dec 09 21:54:00.322404 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-650dc6e1-f5f5-4503-bb1d-b20f4bf08bb4 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:54:00.326565 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-b653cf35-d801-40bc-b9d3-efac64e9ce72 None None] Set router d9cf6337-3bad-4310-b6ab-6a6e5ee3198c gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:54:00.356812 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] Attempting to bind port d434eb5a-ab43-4057-96cb-3339e8aed8e8 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:54:00.357416 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] Attempting to bind port d434eb5a-ab43-4057-96cb-3339e8aed8e8 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:54:00.358068 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] Attempting to bind port d434eb5a-ab43-4057-96cb-3339e8aed8e8 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:54:00.361367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e48b731-9b3a-439e-95c4-0761525558f1 None None] Pushing event updated for resources: {'Port': ['ID=d434eb5a-ab43-4057-96cb-3339e8aed8e8,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:00.412766 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 53, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:54:00.413454 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:54:00.414623 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:00.415130 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:54:00.416947 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] Bound port: d434eb5a-ab43-4057-96cb-3339e8aed8e8, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:54:00.417443 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:00.490750 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] For port d434eb5a-ab43-4057-96cb-3339e8aed8e8, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:54:00.494729 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] For port d434eb5a-ab43-4057-96cb-3339e8aed8e8, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d434eb5a-ab43-4057-96cb-3339e8aed8e8,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:54:00.499015 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b171f086-ffb3-48a3-93de-e33c35210ccd None None] Provisioning complete for port d434eb5a-ab43-4057-96cb-3339e8aed8e8 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:00.499735 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b171f086-ffb3-48a3-93de-e33c35210ccd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:00.527261 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:00.531610 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b056993d-b8c3-4f9f-a928-69eea2cff3d6 req-adb5a536-d03f-43e1-af9f-3e3e4ea0c30d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=48ed4870-53b4-441d-92a8-1562825c8ca3 HTTP/1.1" status: 200 len: 1000 time: 0.2156947 Dec 09 21:54:00.536834 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-affe1fa1-4d67-4406-8cde-dfb2469fa19a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:00.586245 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-b171f086-ffb3-48a3-93de-e33c35210ccd None None] Port d434eb5a-ab43-4057-96cb-3339e8aed8e8 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:54:00.595088 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-76162282-89b3-4d48-8728-ab7c2c746ace None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:54:00.613415 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] Routers {'fc45912b-0461-4a97-9b3b-3855aa3f688c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:54:00.614115 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:53:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['fc45912b-0461-4a97-9b3b-3855aa3f688c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:00.616251 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-b653cf35-d801-40bc-b9d3-efac64e9ce72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'name': 'tempest-TestServerBasicOps-833518784-router', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129'}], 'enable_snat': True}, 'gw_port_id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:33Z', 'updated_at': '2021-12-09T21:53:36Z', 'revision_number': 4, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'gw_port': {'id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:c4:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3888, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:34Z', 'updated_at': '2021-12-09T21:53:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'd70d14fc-db5b-450b-881c-4d7fd32c036f', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'floating_ip_address': '172.25.3.223', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'port_id': '48ed4870-53b4-441d-92a8-1562825c8ca3', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 3917, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7', 'mac_address': 'fa:16:3e:b1:7a:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cf5eac2-f76a-49ca-aabf-537385b7e325', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:53:57Z', 'updated_at': '2021-12-09T21:53:57Z', 'revision_number': 0, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'efce1b9c-0122-448d-b190-5f99e09d575a', 'name': '', 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'mac_address': 'fa:16:3e:5a:e8:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'device_owner': 'network:router_interface', 'standard_attr_id': 3889, 'fixed_ips': [{'subnet_id': '912d0a1a-1b1a-4383-8291-491e8e3358fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:36Z', 'updated_at': '2021-12-09T21:53:42Z', 'revision_number': 5, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'subnets': [{'id': '912d0a1a-1b1a-4383-8291-491e8e3358fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:00.621289 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e48b731-9b3a-439e-95c4-0761525558f1 None None] Pushing event updated for resources: {'Port': ['ID=d434eb5a-ab43-4057-96cb-3339e8aed8e8,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:00.689206 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-affe1fa1-4d67-4406-8cde-dfb2469fa19a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event updated for resources: {'Subnet': ['ID=351b49c0-d93c-498b-806a-c48ba9ce774c,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:00.697430 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b056993d-b8c3-4f9f-a928-69eea2cff3d6 req-1c6b7c50-e2be-47d3-b09d-381deed31cec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:00.698981 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b056993d-b8c3-4f9f-a928-69eea2cff3d6 req-1c6b7c50-e2be-47d3-b09d-381deed31cec service neutron] 10.222.0.31 "GET /v2.0/subnets?id=912d0a1a-1b1a-4383-8291-491e8e3358fe HTTP/1.1" status: 200 len: 847 time: 0.1594226 Dec 09 21:54:00.737279 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-affe1fa1-4d67-4406-8cde-dfb2469fa19a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Checking segment: {'id': '6d67c360-0c3e-45bc-a87c-f081fe129dc5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'd44855ac-a8dc-4ffd-bff8-176929f8ca30'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:54:00.737686 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-affe1fa1-4d67-4406-8cde-dfb2469fa19a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Network hostable DHCP agents. Network: d44855ac-a8dc-4ffd-bff8-176929f8ca30, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:54:00.772829 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b056993d-b8c3-4f9f-a928-69eea2cff3d6 req-91474b93-53cd-4440-b50c-8ed21bca125a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:00.774493 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b056993d-b8c3-4f9f-a928-69eea2cff3d6 req-91474b93-53cd-4440-b50c-8ed21bca125a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0660319 Dec 09 21:54:00.776145 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-affe1fa1-4d67-4406-8cde-dfb2469fa19a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Network d44855ac-a8dc-4ffd-bff8-176929f8ca30 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:54:00.776391 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b653cf35-d801-40bc-b9d3-efac64e9ce72 None None] The sync data for ids ['d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'] in n-d-713301-27 is: [{'id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'name': 'tempest-TestServerBasicOps-833518784-router', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129'}], 'enable_snat': True}, 'gw_port_id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:33Z', 'updated_at': '2021-12-09T21:53:36Z', 'revision_number': 4, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'gw_port': {'id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:c4:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3888, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:34Z', 'updated_at': '2021-12-09T21:53:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'd70d14fc-db5b-450b-881c-4d7fd32c036f', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'floating_ip_address': '172.25.3.223', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'port_id': '48ed4870-53b4-441d-92a8-1562825c8ca3', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 3917, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7', 'mac_address': 'fa:16:3e:b1:7a:f9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cf5eac2-f76a-49ca-aabf-537385b7e325', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:53:57Z', 'updated_at': '2021-12-09T21:53:57Z', 'revision_number': 0, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'efce1b9c-0122-448d-b190-5f99e09d575a', 'name': '', 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'mac_address': 'fa:16:3e:5a:e8:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'device_owner': 'network:router_interface', 'standard_attr_id': 3889, 'fixed_ips': [{'subnet_id': '912d0a1a-1b1a-4383-8291-491e8e3358fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:36Z', 'updated_at': '2021-12-09T21:53:42Z', 'revision_number': 5, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'subnets': [{'id': '912d0a1a-1b1a-4383-8291-491e8e3358fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:54:00.800630 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-affe1fa1-4d67-4406-8cde-dfb2469fa19a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, d44855ac-a8dc-4ffd-bff8-176929f8ca30) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:54:00.830432 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-affe1fa1-4d67-4406-8cde-dfb2469fa19a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:00.831636 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-affe1fa1-4d67-4406-8cde-dfb2469fa19a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:00.893360 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-affe1fa1-4d67-4406-8cde-dfb2469fa19a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 835 time: 0.8441412 Dec 09 21:54:00.896477 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54626) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:00.929431 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b056993d-b8c3-4f9f-a928-69eea2cff3d6 req-7781cc91-764f-4bc3-894d-aeb14e1c3ad3 service neutron] 10.222.0.31 "GET /v2.0/networks/9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1405556 Dec 09 21:54:00.973284 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-929b5de1-c43f-4637-bff9-486cc0df02da None None] Network d44855ac-a8dc-4ffd-bff8-176929f8ca30 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:54:00.978705 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-0aa9a0ae-8b52-45f7-8173-91332fcf9535 None None] Provisioning complete for port d434eb5a-ab43-4057-96cb-3339e8aed8e8 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:00.979408 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0aa9a0ae-8b52-45f7-8173-91332fcf9535 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:01.035461 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] Set router fc45912b-0461-4a97-9b3b-3855aa3f688c gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:54:01.061685 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b056993d-b8c3-4f9f-a928-69eea2cff3d6 req-b559176f-007e-416c-8bc1-ac26e1bccd9c service neutron] 10.222.0.31 "GET /v2.0/networks/9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1234078 Dec 09 21:54:01.137323 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-51bdd211-1cda-49b0-a127-00efed45e80b None None] New status for floating IP d70d14fc-db5b-450b-881c-4d7fd32c036f: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:54:01.426658 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e50be242-a458-4d40-a6f0-6393b9d3a5de None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-d44855ac-a8dc-4ffd-bff8-176929f8ca30', 'network_id': 'd44855ac-a8dc-4ffd-bff8-176929f8ca30', 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'fixed_ips': [{'subnet_id': '351b49c0-d93c-498b-806a-c48ba9ce774c'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:54:01.427585 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e50be242-a458-4d40-a6f0-6393b9d3a5de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:01.470085 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62640630-8bbb-4454-9a99-7bd6c1417317 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:01.511972 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0aa9a0ae-8b52-45f7-8173-91332fcf9535 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:01.602802 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0aa9a0ae-8b52-45f7-8173-91332fcf9535 None None] For port d434eb5a-ab43-4057-96cb-3339e8aed8e8, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d434eb5a-ab43-4057-96cb-3339e8aed8e8,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:54:01.613781 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0aa9a0ae-8b52-45f7-8173-91332fcf9535 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:01.707621 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fc45912b-0461-4a97-9b3b-3855aa3f688c', 'name': 'tempest-TestSecurityGroupsBasicOps-router-850480051', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.217'}], 'enable_snat': True}, 'gw_port_id': 'd434eb5a-ab43-4057-96cb-3339e8aed8e8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:56Z', 'updated_at': '2021-12-09T21:53:58Z', 'revision_number': 3, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'gw_port': {'id': 'd434eb5a-ab43-4057-96cb-3339e8aed8e8', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:a9:a7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fc45912b-0461-4a97-9b3b-3855aa3f688c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3916, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.217', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:57Z', 'updated_at': '2021-12-09T21:54:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:01.713547 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0aa9a0ae-8b52-45f7-8173-91332fcf9535 None None] Pushing event updated for resources: {'Port': ['ID=d434eb5a-ab43-4057-96cb-3339e8aed8e8,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:01.746385 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3dc9615c-fe2a-4f8c-83a1-7a8d98df9cfa None None] The sync data for ids ['fc45912b-0461-4a97-9b3b-3855aa3f688c'] in n-d-713301-27 is: [{'id': 'fc45912b-0461-4a97-9b3b-3855aa3f688c', 'name': 'tempest-TestSecurityGroupsBasicOps-router-850480051', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.217'}], 'enable_snat': True}, 'gw_port_id': 'd434eb5a-ab43-4057-96cb-3339e8aed8e8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:56Z', 'updated_at': '2021-12-09T21:53:58Z', 'revision_number': 3, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'gw_port': {'id': 'd434eb5a-ab43-4057-96cb-3339e8aed8e8', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:a9:a7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fc45912b-0461-4a97-9b3b-3855aa3f688c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3916, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.217', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:57Z', 'updated_at': '2021-12-09T21:54:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:54:01.753327 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-e50be242-a458-4d40-a6f0-6393b9d3a5de None None] Allocated IP 172.20.0.18 (d44855ac-a8dc-4ffd-bff8-176929f8ca30/351b49c0-d93c-498b-806a-c48ba9ce774c/f944a894-e15c-472c-8798-3f3b9afe54ee) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:54:01.912479 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e50be242-a458-4d40-a6f0-6393b9d3a5de None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:01.924896 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e50be242-a458-4d40-a6f0-6393b9d3a5de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:01.963900 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e50be242-a458-4d40-a6f0-6393b9d3a5de None None] Network d44855ac-a8dc-4ffd-bff8-176929f8ca30 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:54:01.968437 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-e50be242-a458-4d40-a6f0-6393b9d3a5de None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:54:01.975297 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e50be242-a458-4d40-a6f0-6393b9d3a5de None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:54:01.982667 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e50be242-a458-4d40-a6f0-6393b9d3a5de None None] Pushing event updated for resources: {'Port': ['ID=f944a894-e15c-472c-8798-3f3b9afe54ee,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:01.995639 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-62640630-8bbb-4454-9a99-7bd6c1417317 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Allocated IP 172.20.0.17 (d44855ac-a8dc-4ffd-bff8-176929f8ca30/351b49c0-d93c-498b-806a-c48ba9ce774c/bee54b51-b1c3-4c4a-890e-e8e0fb373e12) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:54:02.086913 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e50be242-a458-4d40-a6f0-6393b9d3a5de None None] Attempting to bind port f944a894-e15c-472c-8798-3f3b9afe54ee on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:54:02.087648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e50be242-a458-4d40-a6f0-6393b9d3a5de None None] Attempting to bind port f944a894-e15c-472c-8798-3f3b9afe54ee by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '6d67c360-0c3e-45bc-a87c-f081fe129dc5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'd44855ac-a8dc-4ffd-bff8-176929f8ca30'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:54:02.088196 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e50be242-a458-4d40-a6f0-6393b9d3a5de None None] Attempting to bind port f944a894-e15c-472c-8798-3f3b9afe54ee on network d44855ac-a8dc-4ffd-bff8-176929f8ca30 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:54:02.094253 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e50be242-a458-4d40-a6f0-6393b9d3a5de None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 53, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:54:02.095046 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e50be242-a458-4d40-a6f0-6393b9d3a5de None None] Checking segment: {'id': '6d67c360-0c3e-45bc-a87c-f081fe129dc5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'd44855ac-a8dc-4ffd-bff8-176929f8ca30'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:54:02.095654 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e50be242-a458-4d40-a6f0-6393b9d3a5de None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:02.096217 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e50be242-a458-4d40-a6f0-6393b9d3a5de None None] Bound using segment: {'id': '6d67c360-0c3e-45bc-a87c-f081fe129dc5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'd44855ac-a8dc-4ffd-bff8-176929f8ca30'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:54:02.096854 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-e50be242-a458-4d40-a6f0-6393b9d3a5de None None] Bound port: f944a894-e15c-472c-8798-3f3b9afe54ee, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6d67c360-0c3e-45bc-a87c-f081fe129dc5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'd44855ac-a8dc-4ffd-bff8-176929f8ca30'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:54:02.097412 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e50be242-a458-4d40-a6f0-6393b9d3a5de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:02.151186 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62640630-8bbb-4454-9a99-7bd6c1417317 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:02.170488 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e50be242-a458-4d40-a6f0-6393b9d3a5de None None] For port f944a894-e15c-472c-8798-3f3b9afe54ee, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:54:02.178874 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e50be242-a458-4d40-a6f0-6393b9d3a5de None None] For port f944a894-e15c-472c-8798-3f3b9afe54ee, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f944a894-e15c-472c-8798-3f3b9afe54ee,segment=NetworkSegment(6d67c360-0c3e-45bc-a87c-f081fe129dc5),segment_id=6d67c360-0c3e-45bc-a87c-f081fe129dc5)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:54:02.188235 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e50be242-a458-4d40-a6f0-6393b9d3a5de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:02.214616 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62640630-8bbb-4454-9a99-7bd6c1417317 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:02.239688 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-62640630-8bbb-4454-9a99-7bd6c1417317 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Network d44855ac-a8dc-4ffd-bff8-176929f8ca30 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:54:02.258151 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e50be242-a458-4d40-a6f0-6393b9d3a5de None None] Pushing event updated for resources: {'Port': ['ID=f944a894-e15c-472c-8798-3f3b9afe54ee,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:02.273451 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-62640630-8bbb-4454-9a99-7bd6c1417317 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:54:02.276606 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62640630-8bbb-4454-9a99-7bd6c1417317 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:54:02.349094 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62640630-8bbb-4454-9a99-7bd6c1417317 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event updated for resources: {'Port': ['ID=bee54b51-b1c3-4c4a-890e-e8e0fb373e12,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:02.355468 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62640630-8bbb-4454-9a99-7bd6c1417317 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:02.556234 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62640630-8bbb-4454-9a99-7bd6c1417317 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:02.909098 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39cbef5a-341c-44ae-8282-a8c501f14156 req-773c04ec-f034-485f-a7d5-8ce6b20205d8 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:02.910441 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-39cbef5a-341c-44ae-8282-a8c501f14156 req-773c04ec-f034-485f-a7d5-8ce6b20205d8 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/ports?device_id=fce69021-c7d1-432f-a078-b917814309b9 HTTP/1.1" status: 200 len: 945 time: 0.0877473 Dec 09 21:54:02.941491 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62640630-8bbb-4454-9a99-7bd6c1417317 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:02.948064 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62640630-8bbb-4454-9a99-7bd6c1417317 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:02.984960 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f23dbcd2-5238-427f-9635-d67f8774b294 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:03.200255 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d434eb5a-ab43-4057-96cb-3339e8aed8e8 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:54:03.267894 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port d434eb5a-ab43-4057-96cb-3339e8aed8e8 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:03.268209 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:03.354091 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f944a894-e15c-472c-8798-3f3b9afe54ee up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:54:03.411224 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f944a894-e15c-472c-8798-3f3b9afe54ee triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:03.411767 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:03.416124 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5149c2f2-bfce-45a2-a897-ce1df1b75426 None None] Network d44855ac-a8dc-4ffd-bff8-176929f8ca30 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:54:03.443290 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-39cbef5a-341c-44ae-8282-a8c501f14156 req-ff0812ee-b908-4b91-96d5-1a767552654c tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/security-groups?id=ce5c7bc1-de04-4060-901f-bf2612c44351&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5266118 Dec 09 21:54:03.448571 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62640630-8bbb-4454-9a99-7bd6c1417317 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event updated for resources: {'Port': ['ID=bee54b51-b1c3-4c4a-890e-e8e0fb373e12,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:03.454549 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62640630-8bbb-4454-9a99-7bd6c1417317 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:03.519429 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c59374d0-90a5-4a02-a2fd-7fe5b9c6bf82 None None] Provisioning complete for port f944a894-e15c-472c-8798-3f3b9afe54ee triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:03.519719 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c59374d0-90a5-4a02-a2fd-7fe5b9c6bf82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:03.554586 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-62640630-8bbb-4454-9a99-7bd6c1417317 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Network d44855ac-a8dc-4ffd-bff8-176929f8ca30 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:54:03.556248 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-62640630-8bbb-4454-9a99-7bd6c1417317 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:54:03.632508 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:03.679500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-62640630-8bbb-4454-9a99-7bd6c1417317 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Router fc45912b-0461-4a97-9b3b-3855aa3f688c has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:54:03.700172 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c59374d0-90a5-4a02-a2fd-7fe5b9c6bf82 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:03.702958 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port f944a894-e15c-472c-8798-3f3b9afe54ee, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f944a894-e15c-472c-8798-3f3b9afe54ee,segment=NetworkSegment(6d67c360-0c3e-45bc-a87c-f081fe129dc5),segment_id=6d67c360-0c3e-45bc-a87c-f081fe129dc5)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:54:03.713821 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:03.804200 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-62640630-8bbb-4454-9a99-7bd6c1417317 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:54:03.807311 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=f944a894-e15c-472c-8798-3f3b9afe54ee,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:03.811554 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-c59374d0-90a5-4a02-a2fd-7fe5b9c6bf82 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 21:54:03.811976 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-c59374d0-90a5-4a02-a2fd-7fe5b9c6bf82 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 21:54:03.813104 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-62640630-8bbb-4454-9a99-7bd6c1417317 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "PUT /v2.0/routers/fc45912b-0461-4a97-9b3b-3855aa3f688c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9152536 Dec 09 21:54:03.953058 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] Sync routers for ids ['fc45912b-0461-4a97-9b3b-3855aa3f688c'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:54:03.963252 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] Routers {'fc45912b-0461-4a97-9b3b-3855aa3f688c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:54:03.963936 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:53:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['fc45912b-0461-4a97-9b3b-3855aa3f688c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:04.075093 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] Set router fc45912b-0461-4a97-9b3b-3855aa3f688c gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:54:04.104364 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-a7275ec3-c1b7-4469-a870-512dfcf8a12e tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:04.105900 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-a7275ec3-c1b7-4469-a870-512dfcf8a12e tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/networks?id=d44855ac-a8dc-4ffd-bff8-176929f8ca30 HTTP/1.1" status: 200 len: 798 time: 0.1209469 Dec 09 21:54:04.130505 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-2d7ceeca-354f-41b2-a467-5accf33dae73 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/quotas/594fec82d9ab4e97a76f8c869f0bbcf0 HTTP/1.1" status: 200 len: 375 time: 0.0169411 Dec 09 21:54:04.188354 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-ed05d801-5271-47d3-8ceb-d32cbda1cbef tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=594fec82d9ab4e97a76f8c869f0bbcf0&fields=id HTTP/1.1" status: 200 len: 440 time: 0.0561831 Dec 09 21:54:04.287796 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fc45912b-0461-4a97-9b3b-3855aa3f688c', 'name': 'tempest-TestSecurityGroupsBasicOps-router-850480051', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.217'}], 'enable_snat': True}, 'gw_port_id': 'd434eb5a-ab43-4057-96cb-3339e8aed8e8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:56Z', 'updated_at': '2021-12-09T21:54:02Z', 'revision_number': 4, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'gw_port': {'id': 'd434eb5a-ab43-4057-96cb-3339e8aed8e8', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:a9:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fc45912b-0461-4a97-9b3b-3855aa3f688c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3916, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.217', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:57Z', 'updated_at': '2021-12-09T21:54:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'bee54b51-b1c3-4c4a-890e-e8e0fb373e12', 'name': '', 'network_id': 'd44855ac-a8dc-4ffd-bff8-176929f8ca30', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'mac_address': 'fa:16:3e:3e:44:dc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fc45912b-0461-4a97-9b3b-3855aa3f688c', 'device_owner': 'network:router_interface', 'standard_attr_id': 3920, 'fixed_ips': [{'subnet_id': '351b49c0-d93c-498b-806a-c48ba9ce774c', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:01Z', 'updated_at': '2021-12-09T21:54:02Z', 'revision_number': 2, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'subnets': [{'id': '351b49c0-d93c-498b-806a-c48ba9ce774c', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:04.300334 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-becfc1cd-ef00-49c1-ac01-4edc30f88711 service neutron] 10.222.0.13 "GET /v2.0/networks/d44855ac-a8dc-4ffd-bff8-176929f8ca30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0923862 Dec 09 21:54:04.317915 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] Checking router: fc45912b-0461-4a97-9b3b-3855aa3f688c for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:54:04.318301 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] Updating router fc45912b-0461-4a97-9b3b-3855aa3f688c port bee54b51-b1c3-4c4a-890e-e8e0fb373e12 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:54:04.348585 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:04.379459 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c498c6ee-ec44-487e-920e-060bfcefeb72 req-4bea8689-4564-455b-ab5c-52a9fa1316b1 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:04.381159 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c498c6ee-ec44-487e-920e-060bfcefeb72 req-4bea8689-4564-455b-ab5c-52a9fa1316b1 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.31 "GET /v2.0/ports?device_id=fce69021-c7d1-432f-a078-b917814309b9 HTTP/1.1" status: 200 len: 945 time: 0.0577130 Dec 09 21:54:04.394008 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-9d60284c-1c5f-4805-8bb2-e6c7f4eb8455 service neutron] 10.222.0.13 "GET /v2.0/networks/d44855ac-a8dc-4ffd-bff8-176929f8ca30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0874863 Dec 09 21:54:04.482076 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-0fdb83b4-f6c8-4282-8a89-7ea809b3cb09 None None] Provisioning complete for port f944a894-e15c-472c-8798-3f3b9afe54ee triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:04.482875 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0fdb83b4-f6c8-4282-8a89-7ea809b3cb09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:04.490255 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-c498c6ee-ec44-487e-920e-060bfcefeb72 req-d28c4fe1-9f3d-4677-bc03-614571a7d892 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Deleting port 27fa9a24-1d20-4e50-aaa5-c9c665553e6f {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:54:04.490746 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c498c6ee-ec44-487e-920e-060bfcefeb72 req-d28c4fe1-9f3d-4677-bc03-614571a7d892 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:04.599048 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-0fdb83b4-f6c8-4282-8a89-7ea809b3cb09 None None] Provisioning complete for port bee54b51-b1c3-4c4a-890e-e8e0fb373e12 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:04.600075 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0fdb83b4-f6c8-4282-8a89-7ea809b3cb09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:04.636092 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-c498c6ee-ec44-487e-920e-060bfcefeb72 req-d28c4fe1-9f3d-4677-bc03-614571a7d892 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] For port 27fa9a24-1d20-4e50-aaa5-c9c665553e6f, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=27fa9a24-1d20-4e50-aaa5-c9c665553e6f,segment=NetworkSegment(fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8),segment_id=fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:54:04.636669 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c498c6ee-ec44-487e-920e-060bfcefeb72 req-d28c4fe1-9f3d-4677-bc03-614571a7d892 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:04.643107 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-0fdb83b4-f6c8-4282-8a89-7ea809b3cb09 None None] Port bee54b51-b1c3-4c4a-890e-e8e0fb373e12 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:54:04.667922 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-c498c6ee-ec44-487e-920e-060bfcefeb72 req-d28c4fe1-9f3d-4677-bc03-614571a7d892 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Calling delete_port for 27fa9a24-1d20-4e50-aaa5-c9c665553e6f owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:54:04.668284 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:04.677045 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:04.688275 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18723829-263a-4ec4-ba30-9bb6c3568dd5 req-c19febdb-c75f-478a-b1e1-1e1e969ae583 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:04.689875 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-18723829-263a-4ec4-ba30-9bb6c3568dd5 req-c19febdb-c75f-478a-b1e1-1e1e969ae583 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/ports?device_id=fce69021-c7d1-432f-a078-b917814309b9 HTTP/1.1" status: 200 len: 945 time: 0.0924518 Dec 09 21:54:04.750180 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c46c229-3084-4bf1-a35f-3cdf8b0a962e None None] Pushing event updated for resources: {'Port': ['ID=bee54b51-b1c3-4c4a-890e-e8e0fb373e12,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:04.788000 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c46c229-3084-4bf1-a35f-3cdf8b0a962e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:04.789572 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c46c229-3084-4bf1-a35f-3cdf8b0a962e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:04.789975 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c46c229-3084-4bf1-a35f-3cdf8b0a962e None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:04.790370 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c46c229-3084-4bf1-a35f-3cdf8b0a962e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:04.793191 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-18723829-263a-4ec4-ba30-9bb6c3568dd5 req-f6a70816-9fc8-434c-8583-51fa89467487 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.13 "GET /v2.0/security-groups?id=ce5c7bc1-de04-4060-901f-bf2612c44351&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0892429 Dec 09 21:54:04.796192 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c46c229-3084-4bf1-a35f-3cdf8b0a962e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:04.796825 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c46c229-3084-4bf1-a35f-3cdf8b0a962e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:04.797252 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c46c229-3084-4bf1-a35f-3cdf8b0a962e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:04.797672 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c46c229-3084-4bf1-a35f-3cdf8b0a962e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:04.798088 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c46c229-3084-4bf1-a35f-3cdf8b0a962e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:04.798608 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c46c229-3084-4bf1-a35f-3cdf8b0a962e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:04.799026 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c46c229-3084-4bf1-a35f-3cdf8b0a962e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:04.799431 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c46c229-3084-4bf1-a35f-3cdf8b0a962e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:04.799965 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c46c229-3084-4bf1-a35f-3cdf8b0a962e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:04.848628 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] Attempting to bind port bee54b51-b1c3-4c4a-890e-e8e0fb373e12 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:54:04.849101 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] Attempting to bind port bee54b51-b1c3-4c4a-890e-e8e0fb373e12 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '6d67c360-0c3e-45bc-a87c-f081fe129dc5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'd44855ac-a8dc-4ffd-bff8-176929f8ca30'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:54:04.849802 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] Attempting to bind port bee54b51-b1c3-4c4a-890e-e8e0fb373e12 on network d44855ac-a8dc-4ffd-bff8-176929f8ca30 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:54:04.853246 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c498c6ee-ec44-487e-920e-060bfcefeb72 req-d28c4fe1-9f3d-4677-bc03-614571a7d892 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:04.855823 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 53, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:54:04.856448 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] Checking segment: {'id': '6d67c360-0c3e-45bc-a87c-f081fe129dc5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'd44855ac-a8dc-4ffd-bff8-176929f8ca30'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:54:04.857607 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:04.857607 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] Bound using segment: {'id': '6d67c360-0c3e-45bc-a87c-f081fe129dc5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'd44855ac-a8dc-4ffd-bff8-176929f8ca30'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:54:04.858232 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] Bound port: bee54b51-b1c3-4c4a-890e-e8e0fb373e12, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6d67c360-0c3e-45bc-a87c-f081fe129dc5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'd44855ac-a8dc-4ffd-bff8-176929f8ca30'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:54:04.858693 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:04.865679 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['27fa9a24-1d20-4e50-aaa5-c9c665553e6f'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:54:04.878022 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-306d39c8-b57c-4f7d-9a71-d20464c7cf0d req-7e14c446-43c9-4c3f-b883-d77e33ba31fa tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=132a25b8-7c98-4fe1-8ac5-5510020ba022 HTTP/1.1" status: 200 len: 210 time: 0.0362554 Dec 09 21:54:04.928609 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] For port bee54b51-b1c3-4c4a-890e-e8e0fb373e12, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:54:04.933898 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] For port bee54b51-b1c3-4c4a-890e-e8e0fb373e12, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=bee54b51-b1c3-4c4a-890e-e8e0fb373e12,segment=NetworkSegment(6d67c360-0c3e-45bc-a87c-f081fe129dc5),segment_id=6d67c360-0c3e-45bc-a87c-f081fe129dc5)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:54:04.936287 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d28c4fe1-9f3d-4677-bc03-614571a7d892 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Pushing event deleted for resources: {'Port': ['ID=27fa9a24-1d20-4e50-aaa5-c9c665553e6f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:04.939756 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:04.960313 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-c498c6ee-ec44-487e-920e-060bfcefeb72 req-d28c4fe1-9f3d-4677-bc03-614571a7d892 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] No DVR routers for this DVR port 27fa9a24-1d20-4e50-aaa5-c9c665553e6f on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:54:04.963269 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-c498c6ee-ec44-487e-920e-060bfcefeb72 req-d28c4fe1-9f3d-4677-bc03-614571a7d892 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:04.967783 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c498c6ee-ec44-487e-920e-060bfcefeb72 req-d28c4fe1-9f3d-4677-bc03-614571a7d892 tempest-VolumesSnapshotTestJSON-1079268487 tempest-VolumesSnapshotTestJSON-1079268487-project] 10.222.0.31 "DELETE /v2.0/ports/27fa9a24-1d20-4e50-aaa5-c9c665553e6f HTTP/1.1" status: 204 len: 173 time: 0.5802593 Dec 09 21:54:04.968266 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fce69021-c7d1-432f-a078-b917814309b9', 'name': 'network-vif-deleted', 'tag': '27fa9a24-1d20-4e50-aaa5-c9c665553e6f'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:54:04.973004 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-59e8bba6-ff7b-4b45-9941-34c49024decf" -d '{"events": [{"server_uuid": "fce69021-c7d1-432f-a078-b917814309b9", "name": "network-vif-deleted", "tag": "27fa9a24-1d20-4e50-aaa5-c9c665553e6f"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:54:05.025669 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] Routers {'fc45912b-0461-4a97-9b3b-3855aa3f688c'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:54:05.026417 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:53:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['fc45912b-0461-4a97-9b3b-3855aa3f688c'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:05.098964 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c46c229-3084-4bf1-a35f-3cdf8b0a962e None None] Pushing event updated for resources: {'Port': ['ID=bee54b51-b1c3-4c4a-890e-e8e0fb373e12,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:05.137865 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:54:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0f1b8088-4a4a-4859-8a99-b0fb764fbb17 x-openstack-request-id: req-0f1b8088-4a4a-4859-8a99-b0fb764fbb17 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:54:05.138023 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fce69021-c7d1-432f-a078-b917814309b9", "name": "network-vif-deleted", "tag": "27fa9a24-1d20-4e50-aaa5-c9c665553e6f", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:54:05.138447 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0f1b8088-4a4a-4859-8a99-b0fb764fbb17 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:54:05.138901 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fce69021-c7d1-432f-a078-b917814309b9', 'name': 'network-vif-deleted', 'tag': '27fa9a24-1d20-4e50-aaa5-c9c665553e6f', 'status': 'completed', 'code': 200} Dec 09 21:54:05.179238 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-47694d1d-0071-4321-981e-adea3862c372 None None] Provisioning complete for port bee54b51-b1c3-4c4a-890e-e8e0fb373e12 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:05.180290 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-47694d1d-0071-4321-981e-adea3862c372 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:05.203052 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] Set router fc45912b-0461-4a97-9b3b-3855aa3f688c gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:54:05.212451 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f944a894-e15c-472c-8798-3f3b9afe54ee up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:54:05.327256 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-47694d1d-0071-4321-981e-adea3862c372 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:05.343408 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f944a894-e15c-472c-8798-3f3b9afe54ee triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:05.344067 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:05.401263 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-47694d1d-0071-4321-981e-adea3862c372 None None] For port bee54b51-b1c3-4c4a-890e-e8e0fb373e12, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=bee54b51-b1c3-4c4a-890e-e8e0fb373e12,segment=NetworkSegment(6d67c360-0c3e-45bc-a87c-f081fe129dc5),segment_id=6d67c360-0c3e-45bc-a87c-f081fe129dc5)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:54:05.409409 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-47694d1d-0071-4321-981e-adea3862c372 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:05.475452 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fc45912b-0461-4a97-9b3b-3855aa3f688c', 'name': 'tempest-TestSecurityGroupsBasicOps-router-850480051', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.217'}], 'enable_snat': True}, 'gw_port_id': 'd434eb5a-ab43-4057-96cb-3339e8aed8e8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:56Z', 'updated_at': '2021-12-09T21:54:02Z', 'revision_number': 4, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'gw_port': {'id': 'd434eb5a-ab43-4057-96cb-3339e8aed8e8', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:a9:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fc45912b-0461-4a97-9b3b-3855aa3f688c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3916, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.217', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:57Z', 'updated_at': '2021-12-09T21:54:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'bee54b51-b1c3-4c4a-890e-e8e0fb373e12', 'name': '', 'network_id': 'd44855ac-a8dc-4ffd-bff8-176929f8ca30', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'mac_address': 'fa:16:3e:3e:44:dc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fc45912b-0461-4a97-9b3b-3855aa3f688c', 'device_owner': 'network:router_interface', 'standard_attr_id': 3920, 'fixed_ips': [{'subnet_id': '351b49c0-d93c-498b-806a-c48ba9ce774c', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:01Z', 'updated_at': '2021-12-09T21:54:04Z', 'revision_number': 4, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'subnets': [{'id': '351b49c0-d93c-498b-806a-c48ba9ce774c', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:05.505340 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-363d5251-9c30-4d88-8328-c6e5986be4cb None None] The sync data for ids ['fc45912b-0461-4a97-9b3b-3855aa3f688c'] in n-d-713301-27 is: [{'id': 'fc45912b-0461-4a97-9b3b-3855aa3f688c', 'name': 'tempest-TestSecurityGroupsBasicOps-router-850480051', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.217'}], 'enable_snat': True}, 'gw_port_id': 'd434eb5a-ab43-4057-96cb-3339e8aed8e8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:56Z', 'updated_at': '2021-12-09T21:54:02Z', 'revision_number': 4, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'gw_port': {'id': 'd434eb5a-ab43-4057-96cb-3339e8aed8e8', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:a9:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fc45912b-0461-4a97-9b3b-3855aa3f688c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3916, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.217', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:57Z', 'updated_at': '2021-12-09T21:54:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'bee54b51-b1c3-4c4a-890e-e8e0fb373e12', 'name': '', 'network_id': 'd44855ac-a8dc-4ffd-bff8-176929f8ca30', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'mac_address': 'fa:16:3e:3e:44:dc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fc45912b-0461-4a97-9b3b-3855aa3f688c', 'device_owner': 'network:router_interface', 'standard_attr_id': 3920, 'fixed_ips': [{'subnet_id': '351b49c0-d93c-498b-806a-c48ba9ce774c', 'ip_address': '172.20.0.17', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:01Z', 'updated_at': '2021-12-09T21:54:04Z', 'revision_number': 4, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'subnets': [{'id': '351b49c0-d93c-498b-806a-c48ba9ce774c', 'cidr': '172.20.0.16/28', 'gateway_ip': '172.20.0.17', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:54:05.695988 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4f1ac2ea-8ea2-4fcd-ae18-33202271f12b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:05.702231 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47694d1d-0071-4321-981e-adea3862c372 None None] Pushing event updated for resources: {'Port': ['ID=bee54b51-b1c3-4c4a-890e-e8e0fb373e12,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:05.704885 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e597305b-8737-493b-8435-3c2c5f560e5a None None] Provisioning complete for port bee54b51-b1c3-4c4a-890e-e8e0fb373e12 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:05.705252 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e597305b-8737-493b-8435-3c2c5f560e5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:05.870039 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-bf79498a-42ef-4d8f-880f-1fb9a1b6e840 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:05.871608 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-bf79498a-42ef-4d8f-880f-1fb9a1b6e840 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.10 "GET /v2.0/networks?id=d44855ac-a8dc-4ffd-bff8-176929f8ca30 HTTP/1.1" status: 200 len: 798 time: 0.1278224 Dec 09 21:54:05.886865 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-1954575c-c0fe-4985-9991-602e08652ca6 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Request body: {'port': {'device_id': '132a25b8-7c98-4fe1-8ac5-5510020ba022', 'network_id': 'd44855ac-a8dc-4ffd-bff8-176929f8ca30', 'admin_state_up': True, 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:54:06.010839 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-817d0e47-f29c-4ad7-b274-6023b55dab5c req-2d432cb1-f0f3-4a98-9fe2-e31227e904e2 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=132a25b8-7c98-4fe1-8ac5-5510020ba022 HTTP/1.1" status: 200 len: 210 time: 0.0351400 Dec 09 21:54:06.068919 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-1954575c-c0fe-4985-9991-602e08652ca6 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Made reservation on behalf of 594fec82d9ab4e97a76f8c869f0bbcf0 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:54:06.072848 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-1954575c-c0fe-4985-9991-602e08652ca6 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:06.225921 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-1954575c-c0fe-4985-9991-602e08652ca6 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Allocated IP 172.20.0.19 (d44855ac-a8dc-4ffd-bff8-176929f8ca30/351b49c0-d93c-498b-806a-c48ba9ce774c/3cdcf011-5667-4154-985f-63d9f734d548) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:54:06.356936 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-1954575c-c0fe-4985-9991-602e08652ca6 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:06.393214 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-1954575c-c0fe-4985-9991-602e08652ca6 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:06.443531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-1954575c-c0fe-4985-9991-602e08652ca6 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Network d44855ac-a8dc-4ffd-bff8-176929f8ca30 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:54:06.449046 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-1954575c-c0fe-4985-9991-602e08652ca6 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:54:06.453818 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-1954575c-c0fe-4985-9991-602e08652ca6 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:54:06.486122 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1954575c-c0fe-4985-9991-602e08652ca6 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event updated for resources: {'Port': ['ID=3cdcf011-5667-4154-985f-63d9f734d548,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:06.506473 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-1954575c-c0fe-4985-9991-602e08652ca6 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:06.507135 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-1954575c-c0fe-4985-9991-602e08652ca6 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:06.529342 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-1954575c-c0fe-4985-9991-602e08652ca6 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 897 time: 0.6466358 Dec 09 21:54:06.605843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-412b31be-1915-4bfd-85ea-42acb325ba5d service neutron] Request body: {'port': {'device_id': '132a25b8-7c98-4fe1-8ac5-5510020ba022', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:54:06.676113 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-412b31be-1915-4bfd-85ea-42acb325ba5d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:06.697899 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:06.732045 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b9762075-e263-4fa1-aaae-0a5070d57b12 None None] Provisioning complete for port 3cdcf011-5667-4154-985f-63d9f734d548 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:06.732409 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b9762075-e263-4fa1-aaae-0a5070d57b12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:06.789442 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-b9762075-e263-4fa1-aaae-0a5070d57b12 None None] Port 3cdcf011-5667-4154-985f-63d9f734d548 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:54:07.019082 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-412b31be-1915-4bfd-85ea-42acb325ba5d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3cdcf011-5667-4154-985f-63d9f734d548 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:54:07.038595 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-412b31be-1915-4bfd-85ea-42acb325ba5d service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:07.057515 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-412b31be-1915-4bfd-85ea-42acb325ba5d service neutron] Transition to ACTIVE for port object 3cdcf011-5667-4154-985f-63d9f734d548 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:54:07.063628 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-412b31be-1915-4bfd-85ea-42acb325ba5d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:07.187261 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-412b31be-1915-4bfd-85ea-42acb325ba5d service neutron] Pushing event updated for resources: {'Port': ['ID=3cdcf011-5667-4154-985f-63d9f734d548,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:07.242698 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device bee54b51-b1c3-4c4a-890e-e8e0fb373e12 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:54:07.311988 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6c5c7ce-c9f8-4001-ac4d-0d9ee22e880e req-321b3cbe-b6dd-4f32-96e6-058e9c42d366 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:07.313302 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c6c5c7ce-c9f8-4001-ac4d-0d9ee22e880e req-321b3cbe-b6dd-4f32-96e6-058e9c42d366 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=132a25b8-7c98-4fe1-8ac5-5510020ba022 HTTP/1.1" status: 200 len: 907 time: 0.1705980 Dec 09 21:54:07.349049 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-412b31be-1915-4bfd-85ea-42acb325ba5d service neutron] Attempting to bind port 3cdcf011-5667-4154-985f-63d9f734d548 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:54:07.349547 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-412b31be-1915-4bfd-85ea-42acb325ba5d service neutron] Attempting to bind port 3cdcf011-5667-4154-985f-63d9f734d548 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '6d67c360-0c3e-45bc-a87c-f081fe129dc5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'd44855ac-a8dc-4ffd-bff8-176929f8ca30'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:54:07.349746 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-412b31be-1915-4bfd-85ea-42acb325ba5d service neutron] Attempting to bind port 3cdcf011-5667-4154-985f-63d9f734d548 on network d44855ac-a8dc-4ffd-bff8-176929f8ca30 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:54:07.350385 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port bee54b51-b1c3-4c4a-890e-e8e0fb373e12 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:07.350838 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:07.358759 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-412b31be-1915-4bfd-85ea-42acb325ba5d service neutron] Port 3cdcf011-5667-4154-985f-63d9f734d548 on network d44855ac-a8dc-4ffd-bff8-176929f8ca30 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:54:07.359554 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-412b31be-1915-4bfd-85ea-42acb325ba5d service neutron] Attempting to bind port 3cdcf011-5667-4154-985f-63d9f734d548 on network d44855ac-a8dc-4ffd-bff8-176929f8ca30 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:54:07.371839 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-412b31be-1915-4bfd-85ea-42acb325ba5d service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 53, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:54:07.373736 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-412b31be-1915-4bfd-85ea-42acb325ba5d service neutron] Checking segment: {'id': '6d67c360-0c3e-45bc-a87c-f081fe129dc5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'd44855ac-a8dc-4ffd-bff8-176929f8ca30'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:54:07.374227 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-412b31be-1915-4bfd-85ea-42acb325ba5d service neutron] Bound using segment: {'id': '6d67c360-0c3e-45bc-a87c-f081fe129dc5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'd44855ac-a8dc-4ffd-bff8-176929f8ca30'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:54:07.374864 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-412b31be-1915-4bfd-85ea-42acb325ba5d service neutron] Bound port: 3cdcf011-5667-4154-985f-63d9f734d548, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6d67c360-0c3e-45bc-a87c-f081fe129dc5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 123, 'network_id': 'd44855ac-a8dc-4ffd-bff8-176929f8ca30'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:54:07.375323 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-412b31be-1915-4bfd-85ea-42acb325ba5d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:07.465146 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-412b31be-1915-4bfd-85ea-42acb325ba5d service neutron] For port 3cdcf011-5667-4154-985f-63d9f734d548, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:54:07.470049 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-412b31be-1915-4bfd-85ea-42acb325ba5d service neutron] For port 3cdcf011-5667-4154-985f-63d9f734d548, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3cdcf011-5667-4154-985f-63d9f734d548,segment=NetworkSegment(6d67c360-0c3e-45bc-a87c-f081fe129dc5),segment_id=6d67c360-0c3e-45bc-a87c-f081fe129dc5)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:54:07.475421 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-412b31be-1915-4bfd-85ea-42acb325ba5d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:07.512685 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-412b31be-1915-4bfd-85ea-42acb325ba5d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:07.513935 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-412b31be-1915-4bfd-85ea-42acb325ba5d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:07.515582 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-412b31be-1915-4bfd-85ea-42acb325ba5d service neutron] 10.222.0.10 "PUT /v2.0/ports/3cdcf011-5667-4154-985f-63d9f734d548 HTTP/1.1" status: 200 len: 1056 time: 0.9780033 Dec 09 21:54:07.516042 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '132a25b8-7c98-4fe1-8ac5-5510020ba022', 'tag': '3cdcf011-5667-4154-985f-63d9f734d548'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:54:07.518328 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cbf7971c-0656-4fd9-ab23-5789b071425e" -d '{"events": [{"name": "network-changed", "server_uuid": "132a25b8-7c98-4fe1-8ac5-5510020ba022", "tag": "3cdcf011-5667-4154-985f-63d9f734d548"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:54:07.540113 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-412b31be-1915-4bfd-85ea-42acb325ba5d service neutron] Pushing event updated for resources: {'Port': ['ID=3cdcf011-5667-4154-985f-63d9f734d548,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:07.607701 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:54:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-11826919-4b86-4b0c-a6c1-e1aec0852258 x-openstack-request-id: req-11826919-4b86-4b0c-a6c1-e1aec0852258 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:54:07.608184 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "132a25b8-7c98-4fe1-8ac5-5510020ba022", "tag": "3cdcf011-5667-4154-985f-63d9f734d548", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:54:07.608442 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-11826919-4b86-4b0c-a6c1-e1aec0852258 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:54:07.608858 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '132a25b8-7c98-4fe1-8ac5-5510020ba022', 'tag': '3cdcf011-5667-4154-985f-63d9f734d548', 'status': 'completed', 'code': 200} Dec 09 21:54:07.629393 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-533c854c-3543-428e-a5d4-29e9512a1071 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:07.631114 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-533c854c-3543-428e-a5d4-29e9512a1071 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=594fec82d9ab4e97a76f8c869f0bbcf0&device_id=132a25b8-7c98-4fe1-8ac5-5510020ba022 HTTP/1.1" status: 200 len: 1059 time: 0.0629086 Dec 09 21:54:07.678359 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-11d44cc0-fffe-4d2b-bc79-d27dcd7039df service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.19&port_id=3cdcf011-5667-4154-985f-63d9f734d548 HTTP/1.1" status: 200 len: 217 time: 0.0392387 Dec 09 21:54:07.735914 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-e598b06f-5053-44e5-a81d-febf68112331 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:07.738172 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-e598b06f-5053-44e5-a81d-febf68112331 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=351b49c0-d93c-498b-806a-c48ba9ce774c HTTP/1.1" status: 200 len: 838 time: 0.0532167 Dec 09 21:54:07.814227 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-5551a1d0-1e24-46ed-b403-b11c912a1744 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:07.815724 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-5551a1d0-1e24-46ed-b403-b11c912a1744 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=d44855ac-a8dc-4ffd-bff8-176929f8ca30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1165 time: 0.0703256 Dec 09 21:54:07.910994 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-4fb15850-d770-4b4f-9fc6-f65519d29da0 service neutron] 10.222.0.10 "GET /v2.0/networks/d44855ac-a8dc-4ffd-bff8-176929f8ca30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0882652 Dec 09 21:54:08.016831 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ad5df6b-4b26-44d6-91f8-58b9344e95c0 req-265bec98-637d-4d3c-868d-044711fc5dfe service neutron] 10.222.0.10 "GET /v2.0/networks/d44855ac-a8dc-4ffd-bff8-176929f8ca30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0983620 Dec 09 21:54:08.018970 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:08.125458 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbf7971c-0656-4fd9-ab23-5789b071425e req-89bc9bf7-a1aa-4710-b7cc-4eed24b9146c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:08.128055 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbf7971c-0656-4fd9-ab23-5789b071425e req-89bc9bf7-a1aa-4710-b7cc-4eed24b9146c service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=594fec82d9ab4e97a76f8c869f0bbcf0&device_id=132a25b8-7c98-4fe1-8ac5-5510020ba022 HTTP/1.1" status: 200 len: 1059 time: 0.0581148 Dec 09 21:54:08.229777 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbf7971c-0656-4fd9-ab23-5789b071425e req-3e1b5778-fbbd-4c24-8a6a-e6c05a8d2aeb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:08.231360 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbf7971c-0656-4fd9-ab23-5789b071425e req-3e1b5778-fbbd-4c24-8a6a-e6c05a8d2aeb service neutron] 10.222.0.10 "GET /v2.0/networks?id=d44855ac-a8dc-4ffd-bff8-176929f8ca30 HTTP/1.1" status: 200 len: 899 time: 0.0956271 Dec 09 21:54:08.243239 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 27fa9a24-1d20-4e50-aaa5-c9c665553e6f no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:54:08.264938 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 27fa9a24-1d20-4e50-aaa5-c9c665553e6f {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:54:08.273083 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 27fa9a24-1d20-4e50-aaa5-c9c665553e6f not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:54:08.284146 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbf7971c-0656-4fd9-ab23-5789b071425e req-ff316eba-c36c-454b-8dba-3c3214f88a67 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.19&port_id=3cdcf011-5667-4154-985f-63d9f734d548 HTTP/1.1" status: 200 len: 217 time: 0.0443370 Dec 09 21:54:08.339269 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbf7971c-0656-4fd9-ab23-5789b071425e req-20b58fea-c7d2-461a-81e3-f6591f961762 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:08.340832 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbf7971c-0656-4fd9-ab23-5789b071425e req-20b58fea-c7d2-461a-81e3-f6591f961762 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=351b49c0-d93c-498b-806a-c48ba9ce774c HTTP/1.1" status: 200 len: 838 time: 0.0490005 Dec 09 21:54:08.389649 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbf7971c-0656-4fd9-ab23-5789b071425e req-646954a4-a45c-4fbf-8e04-50401b377847 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:08.391178 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbf7971c-0656-4fd9-ab23-5789b071425e req-646954a4-a45c-4fbf-8e04-50401b377847 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=d44855ac-a8dc-4ffd-bff8-176929f8ca30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1165 time: 0.0420127 Dec 09 21:54:08.498557 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9024fcf-134b-4ba6-a8e9-822f305a2b84 req-aefb4042-7bce-40c6-b29c-b6a373408bd6 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:08.500240 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9024fcf-134b-4ba6-a8e9-822f305a2b84 req-aefb4042-7bce-40c6-b29c-b6a373408bd6 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=132a25b8-7c98-4fe1-8ac5-5510020ba022 HTTP/1.1" status: 200 len: 907 time: 0.1058223 Dec 09 21:54:08.526072 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbf7971c-0656-4fd9-ab23-5789b071425e req-4b2844e8-dbae-4b7a-8a00-924257b3d8ac service neutron] 10.222.0.10 "GET /v2.0/networks/d44855ac-a8dc-4ffd-bff8-176929f8ca30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1232381 Dec 09 21:54:08.625477 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbf7971c-0656-4fd9-ab23-5789b071425e req-a8136ec7-1e37-4e0f-afba-a7db7bd866ee service neutron] 10.222.0.10 "GET /v2.0/networks/d44855ac-a8dc-4ffd-bff8-176929f8ca30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0919251 Dec 09 21:54:09.626363 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-044f9240-ecfa-4c44-a995-a863e40ffd8c req-fe686ac9-7cd4-43e7-a162-9c923877b862 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:09.628266 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-044f9240-ecfa-4c44-a995-a863e40ffd8c req-fe686ac9-7cd4-43e7-a162-9c923877b862 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=132a25b8-7c98-4fe1-8ac5-5510020ba022 HTTP/1.1" status: 200 len: 907 time: 0.0521128 Dec 09 21:54:09.662317 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:10.754726 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd2eb1ef-c0ce-41a9-a04f-7e75a88a6c8e req-62b2089c-e154-4beb-ac82-75b41517f402 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:10.756412 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd2eb1ef-c0ce-41a9-a04f-7e75a88a6c8e req-62b2089c-e154-4beb-ac82-75b41517f402 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=132a25b8-7c98-4fe1-8ac5-5510020ba022 HTTP/1.1" status: 200 len: 907 time: 0.0514553 Dec 09 21:54:11.890249 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-394633db-ee5e-45d1-9aaa-704eb7d7794e req-abe318c4-df47-4b70-ad72-79ec0a0f172d tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:11.891892 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-394633db-ee5e-45d1-9aaa-704eb7d7794e req-abe318c4-df47-4b70-ad72-79ec0a0f172d tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=132a25b8-7c98-4fe1-8ac5-5510020ba022 HTTP/1.1" status: 200 len: 907 time: 0.0610628 Dec 09 21:54:12.300983 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 3cdcf011-5667-4154-985f-63d9f734d548 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:54:12.404908 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 3cdcf011-5667-4154-985f-63d9f734d548, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3cdcf011-5667-4154-985f-63d9f734d548,segment=NetworkSegment(6d67c360-0c3e-45bc-a87c-f081fe129dc5),segment_id=6d67c360-0c3e-45bc-a87c-f081fe129dc5)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:54:12.416401 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '3cdcf011-5667-4154-985f-63d9f734d548', 'network_id': 'd44855ac-a8dc-4ffd-bff8-176929f8ca30', 'port_id': '3cdcf011-5667-4154-985f-63d9f734d548', 'mac_address': 'fa:16:3e:11:0b:2e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 123, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '351b49c0-d93c-498b-806a-c48ba9ce774c', 'ip_address': '172.20.0.19'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': False, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:54:12.466363 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:12.480726 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3cdcf011-5667-4154-985f-63d9f734d548 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:54:12.499864 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 3cdcf011-5667-4154-985f-63d9f734d548, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3cdcf011-5667-4154-985f-63d9f734d548,segment=NetworkSegment(6d67c360-0c3e-45bc-a87c-f081fe129dc5),segment_id=6d67c360-0c3e-45bc-a87c-f081fe129dc5)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:54:12.505495 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:12.552572 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=3cdcf011-5667-4154-985f-63d9f734d548,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:12.761288 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['3cdcf011-5667-4154-985f-63d9f734d548'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:54:13.010033 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3664bc1e-ebe4-4baf-8b47-0bbc9c01c893 req-f487c4ea-2b3d-4eb8-8cd7-687add454a6b tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:13.011837 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3664bc1e-ebe4-4baf-8b47-0bbc9c01c893 req-f487c4ea-2b3d-4eb8-8cd7-687add454a6b tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=132a25b8-7c98-4fe1-8ac5-5510020ba022 HTTP/1.1" status: 200 len: 908 time: 0.0511565 Dec 09 21:54:14.143794 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec37b7d7-a659-49ff-9f14-4293dd48507e req-1e8e4f1b-1ae3-457f-9e04-8fde290e0011 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:14.147986 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec37b7d7-a659-49ff-9f14-4293dd48507e req-1e8e4f1b-1ae3-457f-9e04-8fde290e0011 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=132a25b8-7c98-4fe1-8ac5-5510020ba022 HTTP/1.1" status: 200 len: 908 time: 0.0560966 Dec 09 21:54:14.198383 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:54:14.299151 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 3cdcf011-5667-4154-985f-63d9f734d548 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:54:14.357054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 3cdcf011-5667-4154-985f-63d9f734d548 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:54:14.360826 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 3cdcf011-5667-4154-985f-63d9f734d548 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:14.361197 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:14.440240 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:14.463410 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '132a25b8-7c98-4fe1-8ac5-5510020ba022', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3cdcf011-5667-4154-985f-63d9f734d548'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:54:14.465741 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8944c6b0-2fc3-4a40-83c0-dee31e05106f" -d '{"events": [{"server_uuid": "132a25b8-7c98-4fe1-8ac5-5510020ba022", "name": "network-vif-plugged", "status": "completed", "tag": "3cdcf011-5667-4154-985f-63d9f734d548"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:54:14.485661 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 3cdcf011-5667-4154-985f-63d9f734d548, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3cdcf011-5667-4154-985f-63d9f734d548,segment=NetworkSegment(6d67c360-0c3e-45bc-a87c-f081fe129dc5),segment_id=6d67c360-0c3e-45bc-a87c-f081fe129dc5)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:54:14.492203 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:14.550366 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=3cdcf011-5667-4154-985f-63d9f734d548,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:14.579117 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:54:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-084ecf2b-d028-4ee2-b4fb-eca7057c346e x-openstack-request-id: req-084ecf2b-d028-4ee2-b4fb-eca7057c346e {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:54:14.579420 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "132a25b8-7c98-4fe1-8ac5-5510020ba022", "name": "network-vif-plugged", "status": "completed", "tag": "3cdcf011-5667-4154-985f-63d9f734d548", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:54:14.579709 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-084ecf2b-d028-4ee2-b4fb-eca7057c346e {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:54:14.580176 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '132a25b8-7c98-4fe1-8ac5-5510020ba022', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3cdcf011-5667-4154-985f-63d9f734d548', 'code': 200} Dec 09 21:54:14.675533 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-223587e9-056e-4da4-9494-79391e8999f1 req-dc4d6e5e-197b-4900-9a83-5b6e4983b681 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:14.677135 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-223587e9-056e-4da4-9494-79391e8999f1 req-dc4d6e5e-197b-4900-9a83-5b6e4983b681 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=132a25b8-7c98-4fe1-8ac5-5510020ba022 HTTP/1.1" status: 200 len: 1061 time: 0.0408862 Dec 09 21:54:15.272435 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fcbbb1a-1ed5-470d-9495-a6bc88276134 req-53cbd295-ec7c-4d80-a1dc-04572bdb301f tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:15.274138 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5fcbbb1a-1ed5-470d-9495-a6bc88276134 req-53cbd295-ec7c-4d80-a1dc-04572bdb301f tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=132a25b8-7c98-4fe1-8ac5-5510020ba022 HTTP/1.1" status: 200 len: 909 time: 0.0536017 Dec 09 21:54:16.450346 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4b1785c-5714-4c60-98ad-d10744aea85d req-465097e7-6173-4cc9-a1bb-b3787d90e8ac tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:16.461418 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d4b1785c-5714-4c60-98ad-d10744aea85d req-465097e7-6173-4cc9-a1bb-b3787d90e8ac tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=132a25b8-7c98-4fe1-8ac5-5510020ba022 HTTP/1.1" status: 200 len: 909 time: 0.0763512 Dec 09 21:54:16.580809 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92a814c5-97c9-449e-94fd-cb9a7c763c82 req-e900786e-d639-4a3e-b834-4e2bb2557c26 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:16.582513 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-92a814c5-97c9-449e-94fd-cb9a7c763c82 req-e900786e-d639-4a3e-b834-4e2bb2557c26 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=132a25b8-7c98-4fe1-8ac5-5510020ba022 HTTP/1.1" status: 200 len: 909 time: 0.0545092 Dec 09 21:54:16.716833 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3dd493d-03c9-42b0-b5c3-b31d2ffdd2b4 req-790309dc-8829-4e7b-ae03-27b1fa154fec tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:16.718378 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c3dd493d-03c9-42b0-b5c3-b31d2ffdd2b4 req-790309dc-8829-4e7b-ae03-27b1fa154fec tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=132a25b8-7c98-4fe1-8ac5-5510020ba022 HTTP/1.1" status: 200 len: 1061 time: 0.0588815 Dec 09 21:54:16.835879 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cacafe08-abb8-482e-ab14-7b8b42e7eeed req-39efecf8-6a0a-4bcb-bbd4-871e532af325 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:16.837450 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cacafe08-abb8-482e-ab14-7b8b42e7eeed req-39efecf8-6a0a-4bcb-bbd4-871e532af325 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=71d6946a-a0e2-426d-a148-1d5b76c4f68c HTTP/1.1" status: 200 len: 1137 time: 0.0499949 Dec 09 21:54:16.896325 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cacafe08-abb8-482e-ab14-7b8b42e7eeed req-6c5a050e-3997-4478-a869-0333f1f7d348 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=cff07a74-5957-4506-85f7-9b25c08d5db0&id=99f9372d-12fa-4d58-a142-20d749c9a2e5&fields=id&fields=name HTTP/1.1" status: 200 len: 409 time: 0.0510337 Dec 09 21:54:16.920683 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54744) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:16.961952 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-097df8dc-b7e6-40bb-a786-1cdcfc59ce28 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:16.963631 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-097df8dc-b7e6-40bb-a786-1cdcfc59ce28 tempest-TestSecurityGroupsBasicOps-891595762 tempest-TestSecurityGroupsBasicOps-891595762-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=132a25b8-7c98-4fe1-8ac5-5510020ba022 HTTP/1.1" status: 200 len: 1056 time: 0.0416658 Dec 09 21:54:17.207423 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dce2166b-fd37-42ea-8cb6-de1c2af57322 req-fd6f7612-99ea-4975-b28a-8fe2d5f07380 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:17.208911 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dce2166b-fd37-42ea-8cb6-de1c2af57322 req-fd6f7612-99ea-4975-b28a-8fe2d5f07380 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=132a25b8-7c98-4fe1-8ac5-5510020ba022 HTTP/1.1" status: 200 len: 909 time: 0.0559120 Dec 09 21:54:18.337500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-461ba2a7-6b29-42af-a63a-69d408e8de42 req-c7b6b60c-9897-4809-a456-030635828afd tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:18.338866 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-461ba2a7-6b29-42af-a63a-69d408e8de42 req-c7b6b60c-9897-4809-a456-030635828afd tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=132a25b8-7c98-4fe1-8ac5-5510020ba022 HTTP/1.1" status: 200 len: 909 time: 0.0553474 Dec 09 21:54:18.405269 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bb4d73c-6a1f-4b6f-9fe7-6c164fc6c8d5 req-4b754048-18bb-4641-b14c-52296d6afdd9 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:18.406760 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bb4d73c-6a1f-4b6f-9fe7-6c164fc6c8d5 req-4b754048-18bb-4641-b14c-52296d6afdd9 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.10 "GET /v2.0/ports?device_id=132a25b8-7c98-4fe1-8ac5-5510020ba022 HTTP/1.1" status: 200 len: 909 time: 0.0509915 Dec 09 21:54:18.498489 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-7bb4d73c-6a1f-4b6f-9fe7-6c164fc6c8d5 req-b1aa7afa-e05b-4ea6-b1fd-78d25eed3c26 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Deleting port 3cdcf011-5667-4154-985f-63d9f734d548 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:54:18.498816 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7bb4d73c-6a1f-4b6f-9fe7-6c164fc6c8d5 req-b1aa7afa-e05b-4ea6-b1fd-78d25eed3c26 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:18.595060 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-7bb4d73c-6a1f-4b6f-9fe7-6c164fc6c8d5 req-b1aa7afa-e05b-4ea6-b1fd-78d25eed3c26 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] For port 3cdcf011-5667-4154-985f-63d9f734d548, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=3cdcf011-5667-4154-985f-63d9f734d548,segment=NetworkSegment(6d67c360-0c3e-45bc-a87c-f081fe129dc5),segment_id=6d67c360-0c3e-45bc-a87c-f081fe129dc5)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:54:18.595425 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7bb4d73c-6a1f-4b6f-9fe7-6c164fc6c8d5 req-b1aa7afa-e05b-4ea6-b1fd-78d25eed3c26 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:18.609183 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-7bb4d73c-6a1f-4b6f-9fe7-6c164fc6c8d5 req-b1aa7afa-e05b-4ea6-b1fd-78d25eed3c26 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Calling delete_port for 3cdcf011-5667-4154-985f-63d9f734d548 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:54:18.748124 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7bb4d73c-6a1f-4b6f-9fe7-6c164fc6c8d5 req-b1aa7afa-e05b-4ea6-b1fd-78d25eed3c26 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:18.772336 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1aa7afa-e05b-4ea6-b1fd-78d25eed3c26 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event deleted for resources: {'Port': ['ID=3cdcf011-5667-4154-985f-63d9f734d548,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:18.824852 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-7bb4d73c-6a1f-4b6f-9fe7-6c164fc6c8d5 req-b1aa7afa-e05b-4ea6-b1fd-78d25eed3c26 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] No DVR routers for this DVR port 3cdcf011-5667-4154-985f-63d9f734d548 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:54:18.828084 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7bb4d73c-6a1f-4b6f-9fe7-6c164fc6c8d5 req-b1aa7afa-e05b-4ea6-b1fd-78d25eed3c26 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:18.831825 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bb4d73c-6a1f-4b6f-9fe7-6c164fc6c8d5 req-b1aa7afa-e05b-4ea6-b1fd-78d25eed3c26 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.10 "DELETE /v2.0/ports/3cdcf011-5667-4154-985f-63d9f734d548 HTTP/1.1" status: 204 len: 173 time: 0.4190698 Dec 09 21:54:18.832291 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '132a25b8-7c98-4fe1-8ac5-5510020ba022', 'name': 'network-vif-deleted', 'tag': '3cdcf011-5667-4154-985f-63d9f734d548'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:54:18.835134 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-994abb5a-b32a-4640-99cf-49b9fe0c408a" -d '{"events": [{"server_uuid": "132a25b8-7c98-4fe1-8ac5-5510020ba022", "name": "network-vif-deleted", "tag": "3cdcf011-5667-4154-985f-63d9f734d548"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:54:18.878197 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:54:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8c77b7cf-3dd1-4896-a98a-e209d6ef0349 x-openstack-request-id: req-8c77b7cf-3dd1-4896-a98a-e209d6ef0349 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:54:18.878499 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "132a25b8-7c98-4fe1-8ac5-5510020ba022", "name": "network-vif-deleted", "tag": "3cdcf011-5667-4154-985f-63d9f734d548", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:54:18.878753 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8c77b7cf-3dd1-4896-a98a-e209d6ef0349 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:54:18.879158 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '132a25b8-7c98-4fe1-8ac5-5510020ba022', 'name': 'network-vif-deleted', 'tag': '3cdcf011-5667-4154-985f-63d9f734d548', 'status': 'completed', 'code': 200} Dec 09 21:54:19.401355 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54766) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:19.829256 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5bca44f4-9354-4027-99b7-3c5a51810e2a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:20.101606 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-5bca44f4-9354-4027-99b7-3c5a51810e2a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Deleting port bee54b51-b1c3-4c4a-890e-e8e0fb373e12 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:54:20.102078 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5bca44f4-9354-4027-99b7-3c5a51810e2a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:20.193054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-5bca44f4-9354-4027-99b7-3c5a51810e2a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] For port bee54b51-b1c3-4c4a-890e-e8e0fb373e12, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=bee54b51-b1c3-4c4a-890e-e8e0fb373e12,segment=NetworkSegment(6d67c360-0c3e-45bc-a87c-f081fe129dc5),segment_id=6d67c360-0c3e-45bc-a87c-f081fe129dc5)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:54:20.193472 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5bca44f4-9354-4027-99b7-3c5a51810e2a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:20.207251 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-5bca44f4-9354-4027-99b7-3c5a51810e2a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Calling delete_port for bee54b51-b1c3-4c4a-890e-e8e0fb373e12 owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:54:20.398481 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5bca44f4-9354-4027-99b7-3c5a51810e2a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:20.496567 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bca44f4-9354-4027-99b7-3c5a51810e2a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event deleted for resources: {'Port': ['ID=bee54b51-b1c3-4c4a-890e-e8e0fb373e12,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:20.629425 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5bca44f4-9354-4027-99b7-3c5a51810e2a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:21.234364 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5bca44f4-9354-4027-99b7-3c5a51810e2a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Router fc45912b-0461-4a97-9b3b-3855aa3f688c has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:54:21.343018 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5bca44f4-9354-4027-99b7-3c5a51810e2a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:54:21.352743 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5bca44f4-9354-4027-99b7-3c5a51810e2a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "PUT /v2.0/routers/fc45912b-0461-4a97-9b3b-3855aa3f688c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9464138 Dec 09 21:54:21.353384 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54786) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:21.354105 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7b209d4-98a7-4dba-811c-56a0212fc792 None None] Sync routers for ids ['fc45912b-0461-4a97-9b3b-3855aa3f688c'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:54:21.365445 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7b209d4-98a7-4dba-811c-56a0212fc792 None None] Routers {'fc45912b-0461-4a97-9b3b-3855aa3f688c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:54:21.366083 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b7b209d4-98a7-4dba-811c-56a0212fc792 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:54:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['fc45912b-0461-4a97-9b3b-3855aa3f688c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:21.407197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-343fa2b9-2918-4bdd-b943-30b2f2d1f373 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Deleting subnet 351b49c0-d93c-498b-806a-c48ba9ce774c {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:54:21.410385 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-343fa2b9-2918-4bdd-b943-30b2f2d1f373 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:21.450968 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-343fa2b9-2918-4bdd-b943-30b2f2d1f373 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:21.472991 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-b7b209d4-98a7-4dba-811c-56a0212fc792 None None] Set router fc45912b-0461-4a97-9b3b-3855aa3f688c gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:54:21.667842 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b7b209d4-98a7-4dba-811c-56a0212fc792 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fc45912b-0461-4a97-9b3b-3855aa3f688c', 'name': 'tempest-TestSecurityGroupsBasicOps-router-850480051', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.217'}], 'enable_snat': True}, 'gw_port_id': 'd434eb5a-ab43-4057-96cb-3339e8aed8e8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:56Z', 'updated_at': '2021-12-09T21:54:20Z', 'revision_number': 5, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'gw_port': {'id': 'd434eb5a-ab43-4057-96cb-3339e8aed8e8', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:a9:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fc45912b-0461-4a97-9b3b-3855aa3f688c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3916, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.217', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:57Z', 'updated_at': '2021-12-09T21:54:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:21.701982 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7b209d4-98a7-4dba-811c-56a0212fc792 None None] Checking router: fc45912b-0461-4a97-9b3b-3855aa3f688c for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:54:21.711256 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7b209d4-98a7-4dba-811c-56a0212fc792 None None] Routers {'fc45912b-0461-4a97-9b3b-3855aa3f688c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:54:21.711912 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b7b209d4-98a7-4dba-811c-56a0212fc792 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:54:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['fc45912b-0461-4a97-9b3b-3855aa3f688c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:21.828676 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-b7b209d4-98a7-4dba-811c-56a0212fc792 None None] Set router fc45912b-0461-4a97-9b3b-3855aa3f688c gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:54:21.885142 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-343fa2b9-2918-4bdd-b943-30b2f2d1f373 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:21.945440 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-343fa2b9-2918-4bdd-b943-30b2f2d1f373 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:21.974384 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-343fa2b9-2918-4bdd-b943-30b2f2d1f373 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event deleted for resources: {'Subnet': ['ID=351b49c0-d93c-498b-806a-c48ba9ce774c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:21.976911 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-343fa2b9-2918-4bdd-b943-30b2f2d1f373 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:21.981069 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-343fa2b9-2918-4bdd-b943-30b2f2d1f373 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "DELETE /v2.0/subnets/351b49c0-d93c-498b-806a-c48ba9ce774c HTTP/1.1" status: 204 len: 168 time: 0.6266544 Dec 09 21:54:21.983873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54788) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:21.992763 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0678b1f8-14f7-4401-b9b6-ed4da2004c76 None None] Network d44855ac-a8dc-4ffd-bff8-176929f8ca30 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:54:22.039235 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-343fa2b9-2918-4bdd-b943-30b2f2d1f373 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:22.039706 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-343fa2b9-2918-4bdd-b943-30b2f2d1f373 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:22.040131 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-343fa2b9-2918-4bdd-b943-30b2f2d1f373 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:22.040539 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-343fa2b9-2918-4bdd-b943-30b2f2d1f373 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:22.040969 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-343fa2b9-2918-4bdd-b943-30b2f2d1f373 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:22.041341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-343fa2b9-2918-4bdd-b943-30b2f2d1f373 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:22.041749 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-343fa2b9-2918-4bdd-b943-30b2f2d1f373 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:22.042180 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-343fa2b9-2918-4bdd-b943-30b2f2d1f373 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:22.042571 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-343fa2b9-2918-4bdd-b943-30b2f2d1f373 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:22.042971 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-343fa2b9-2918-4bdd-b943-30b2f2d1f373 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:22.043365 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-343fa2b9-2918-4bdd-b943-30b2f2d1f373 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:22.043783 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-343fa2b9-2918-4bdd-b943-30b2f2d1f373 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:22.044187 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-343fa2b9-2918-4bdd-b943-30b2f2d1f373 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:22.100507 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b7b209d4-98a7-4dba-811c-56a0212fc792 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fc45912b-0461-4a97-9b3b-3855aa3f688c', 'name': 'tempest-TestSecurityGroupsBasicOps-router-850480051', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.217'}], 'enable_snat': True}, 'gw_port_id': 'd434eb5a-ab43-4057-96cb-3339e8aed8e8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:56Z', 'updated_at': '2021-12-09T21:54:20Z', 'revision_number': 5, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'gw_port': {'id': 'd434eb5a-ab43-4057-96cb-3339e8aed8e8', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:a9:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fc45912b-0461-4a97-9b3b-3855aa3f688c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3916, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.217', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:57Z', 'updated_at': '2021-12-09T21:54:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:22.126044 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-254d0369-fa92-4ff1-ab10-991f27b00334 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:22.129707 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7b209d4-98a7-4dba-811c-56a0212fc792 None None] The sync data for ids ['fc45912b-0461-4a97-9b3b-3855aa3f688c'] in n-d-713301-27 is: [{'id': 'fc45912b-0461-4a97-9b3b-3855aa3f688c', 'name': 'tempest-TestSecurityGroupsBasicOps-router-850480051', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.217'}], 'enable_snat': True}, 'gw_port_id': 'd434eb5a-ab43-4057-96cb-3339e8aed8e8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:56Z', 'updated_at': '2021-12-09T21:54:20Z', 'revision_number': 5, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'gw_port': {'id': 'd434eb5a-ab43-4057-96cb-3339e8aed8e8', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:78:a9:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fc45912b-0461-4a97-9b3b-3855aa3f688c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3916, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.217', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:57Z', 'updated_at': '2021-12-09T21:54:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:54:22.184777 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-86fda26f-ebe5-4785-96ca-df5b2c603cdd None None] DHCP port deletion for d44855ac-a8dc-4ffd-bff8-176929f8ca30 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:54:22.232132 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-86fda26f-ebe5-4785-96ca-df5b2c603cdd None None] Deleting port f944a894-e15c-472c-8798-3f3b9afe54ee {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:54:22.232511 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-86fda26f-ebe5-4785-96ca-df5b2c603cdd None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:22.244251 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-254d0369-fa92-4ff1-ab10-991f27b00334 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:22.306633 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-254d0369-fa92-4ff1-ab10-991f27b00334 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Deleting port d434eb5a-ab43-4057-96cb-3339e8aed8e8 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:54:22.306982 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-254d0369-fa92-4ff1-ab10-991f27b00334 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:22.309497 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-86fda26f-ebe5-4785-96ca-df5b2c603cdd None None] For port f944a894-e15c-472c-8798-3f3b9afe54ee, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f944a894-e15c-472c-8798-3f3b9afe54ee,segment=NetworkSegment(6d67c360-0c3e-45bc-a87c-f081fe129dc5),segment_id=6d67c360-0c3e-45bc-a87c-f081fe129dc5)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:54:22.309974 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-86fda26f-ebe5-4785-96ca-df5b2c603cdd None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:22.326730 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-86fda26f-ebe5-4785-96ca-df5b2c603cdd None None] Calling delete_port for f944a894-e15c-472c-8798-3f3b9afe54ee owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:54:22.427558 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-254d0369-fa92-4ff1-ab10-991f27b00334 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] For port d434eb5a-ab43-4057-96cb-3339e8aed8e8, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d434eb5a-ab43-4057-96cb-3339e8aed8e8,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:54:22.427558 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-254d0369-fa92-4ff1-ab10-991f27b00334 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:22.442720 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-254d0369-fa92-4ff1-ab10-991f27b00334 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Calling delete_port for d434eb5a-ab43-4057-96cb-3339e8aed8e8 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:54:22.467079 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 3cdcf011-5667-4154-985f-63d9f734d548 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:54:22.514631 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 3cdcf011-5667-4154-985f-63d9f734d548 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:54:22.515030 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 3cdcf011-5667-4154-985f-63d9f734d548 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:54:22.529827 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-86fda26f-ebe5-4785-96ca-df5b2c603cdd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:22.562295 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86fda26f-ebe5-4785-96ca-df5b2c603cdd None None] Pushing event deleted for resources: {'Port': ['ID=f944a894-e15c-472c-8798-3f3b9afe54ee,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:22.566669 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86fda26f-ebe5-4785-96ca-df5b2c603cdd None None] No DVR routers for this DVR port f944a894-e15c-472c-8798-3f3b9afe54ee on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:54:22.686881 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-254d0369-fa92-4ff1-ab10-991f27b00334 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:22.726757 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-254d0369-fa92-4ff1-ab10-991f27b00334 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event deleted for resources: {'Port': ['ID=d434eb5a-ab43-4057-96cb-3339e8aed8e8,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:22.740373 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c76a8fe2-25ef-460d-8bfc-56db21f2f6a2 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:54:22.796615 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-254d0369-fa92-4ff1-ab10-991f27b00334 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:22.906690 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-254d0369-fa92-4ff1-ab10-991f27b00334 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:22.909228 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-254d0369-fa92-4ff1-ab10-991f27b00334 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:22.959924 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-254d0369-fa92-4ff1-ab10-991f27b00334 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:22.960907 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-254d0369-fa92-4ff1-ab10-991f27b00334 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Fanout notify agent at l3_agent the message router_deleted on router fc45912b-0461-4a97-9b3b-3855aa3f688c {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:54:22.970042 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-254d0369-fa92-4ff1-ab10-991f27b00334 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:22.971189 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-254d0369-fa92-4ff1-ab10-991f27b00334 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "DELETE /v2.0/routers/fc45912b-0461-4a97-9b3b-3855aa3f688c HTTP/1.1" status: 204 len: 168 time: 0.9863012 Dec 09 21:54:22.976533 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54792) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:23.077568 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4ee765d0-5e39-436e-876f-da83f2bc9362 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:23.195522 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4ee765d0-5e39-436e-876f-da83f2bc9362 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:23.218548 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-4ee765d0-5e39-436e-876f-da83f2bc9362 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d44855ac-a8dc-4ffd-bff8-176929f8ca30']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:23.230517 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-4ee765d0-5e39-436e-876f-da83f2bc9362 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6d67c360-0c3e-45bc-a87c-f081fe129dc5') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:23.230806 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-4ee765d0-5e39-436e-876f-da83f2bc9362 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6d67c360-0c3e-45bc-a87c-f081fe129dc5') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:23.242932 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4ee765d0-5e39-436e-876f-da83f2bc9362 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:23.257672 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4ee765d0-5e39-436e-876f-da83f2bc9362 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:23.266530 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4ee765d0-5e39-436e-876f-da83f2bc9362 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Releasing vlan 123 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:54:23.267306 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4ee765d0-5e39-436e-876f-da83f2bc9362 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:54:23.270585 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:54:23.339541 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4ee765d0-5e39-436e-876f-da83f2bc9362 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:23.347665 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4ee765d0-5e39-436e-876f-da83f2bc9362 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:23.351106 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4ee765d0-5e39-436e-876f-da83f2bc9362 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "DELETE /v2.0/networks/d44855ac-a8dc-4ffd-bff8-176929f8ca30 HTTP/1.1" status: 204 len: 168 time: 0.3735301 Dec 09 21:54:23.354064 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54798) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:23.364490 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ee765d0-5e39-436e-876f-da83f2bc9362 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event deleted for resources: {'Network': ['ID=d44855ac-a8dc-4ffd-bff8-176929f8ca30,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:23.556957 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-ebfb2af9-111a-4205-bcd6-1426b07a40ad tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Deleting port bdb2d922-a20c-4d5b-a1ac-c4bedc041f12 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:54:23.557308 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ebfb2af9-111a-4205-bcd6-1426b07a40ad tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:23.565234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device bee54b51-b1c3-4c4a-890e-e8e0fb373e12 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:54:23.586797 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: bee54b51-b1c3-4c4a-890e-e8e0fb373e12 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:54:23.587140 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device bee54b51-b1c3-4c4a-890e-e8e0fb373e12 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:54:23.590176 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f944a894-e15c-472c-8798-3f3b9afe54ee no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:54:23.608637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: f944a894-e15c-472c-8798-3f3b9afe54ee {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:54:23.608985 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f944a894-e15c-472c-8798-3f3b9afe54ee not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:54:23.637629 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ebfb2af9-111a-4205-bcd6-1426b07a40ad tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:23.637939 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ebfb2af9-111a-4205-bcd6-1426b07a40ad tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:23.649744 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-ebfb2af9-111a-4205-bcd6-1426b07a40ad tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Calling delete_port for bdb2d922-a20c-4d5b-a1ac-c4bedc041f12 owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:54:23.809775 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ebfb2af9-111a-4205-bcd6-1426b07a40ad tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:23.833594 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebfb2af9-111a-4205-bcd6-1426b07a40ad tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event deleted for resources: {'Port': ['ID=bdb2d922-a20c-4d5b-a1ac-c4bedc041f12,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:23.902438 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ebfb2af9-111a-4205-bcd6-1426b07a40ad tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:23.902855 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-ebfb2af9-111a-4205-bcd6-1426b07a40ad tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Floating IP 35067f66-8275-4a95-ae8b-4c9ce1a86ac2 disassociated (deleted). External IP: 172.25.3.107, port: 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536. Dec 09 21:54:24.114040 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ebfb2af9-111a-4205-bcd6-1426b07a40ad tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Router 7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:54:24.236839 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ebfb2af9-111a-4205-bcd6-1426b07a40ad tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:54:24.241767 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ebfb2af9-111a-4205-bcd6-1426b07a40ad tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:24.252492 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bf8a979-1d66-4520-b657-c47bd267bd81 None None] Sync routers for ids ['7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:54:24.269324 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4bf8a979-1d66-4520-b657-c47bd267bd81 None None] Routers {'7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:54:24.269972 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-4bf8a979-1d66-4520-b657-c47bd267bd81 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:54:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:24.280104 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ebfb2af9-111a-4205-bcd6-1426b07a40ad tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "DELETE /v2.0/floatingips/35067f66-8275-4a95-ae8b-4c9ce1a86ac2 HTTP/1.1" status: 204 len: 168 time: 0.9219873 Dec 09 21:54:24.280104 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '71d6946a-a0e2-426d-a148-1d5b76c4f68c', 'tag': '5bb39f06-5e7c-4c4d-ae8c-af7b245ca536'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:54:24.280821 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f891720b-c1f4-46a2-8273-54b6a0f5acb1" -d '{"events": [{"name": "network-changed", "server_uuid": "71d6946a-a0e2-426d-a148-1d5b76c4f68c", "tag": "5bb39f06-5e7c-4c4d-ae8c-af7b245ca536"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:54:24.392765 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-4bf8a979-1d66-4520-b657-c47bd267bd81 None None] Set router 7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:54:24.452081 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:54:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b0e20a65-cca5-4c0d-9af2-60438fc01d35 x-openstack-request-id: req-b0e20a65-cca5-4c0d-9af2-60438fc01d35 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:54:24.452597 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "71d6946a-a0e2-426d-a148-1d5b76c4f68c", "tag": "5bb39f06-5e7c-4c4d-ae8c-af7b245ca536", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:54:24.452597 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-b0e20a65-cca5-4c0d-9af2-60438fc01d35 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:54:24.453008 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '71d6946a-a0e2-426d-a148-1d5b76c4f68c', 'tag': '5bb39f06-5e7c-4c4d-ae8c-af7b245ca536', 'status': 'completed', 'code': 200} Dec 09 21:54:24.526370 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f891720b-c1f4-46a2-8273-54b6a0f5acb1 req-11f05fc5-1c86-42fb-af68-999efc41e879 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:24.528174 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f891720b-c1f4-46a2-8273-54b6a0f5acb1 req-11f05fc5-1c86-42fb-af68-999efc41e879 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=594fec82d9ab4e97a76f8c869f0bbcf0&device_id=71d6946a-a0e2-426d-a148-1d5b76c4f68c HTTP/1.1" status: 200 len: 1137 time: 0.0493085 Dec 09 21:54:24.571306 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b062557-13aa-4081-8886-621e18d8fd92 req-28bfb352-b889-4cb0-ac0f-3ef029d7548a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:24.573285 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b062557-13aa-4081-8886-621e18d8fd92 req-28bfb352-b889-4cb0-ac0f-3ef029d7548a tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=71d6946a-a0e2-426d-a148-1d5b76c4f68c HTTP/1.1" status: 200 len: 985 time: 0.0575216 Dec 09 21:54:24.648409 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b062557-13aa-4081-8886-621e18d8fd92 req-6fac0670-abf6-487e-a35a-6eaea35c0f26 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/security-groups?id=cff07a74-5957-4506-85f7-9b25c08d5db0&id=99f9372d-12fa-4d58-a142-20d749c9a2e5&fields=id&fields=name HTTP/1.1" status: 200 len: 409 time: 0.0664124 Dec 09 21:54:24.653622 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f891720b-c1f4-46a2-8273-54b6a0f5acb1 req-0aa1a55a-7f97-43fb-a645-9d9e6a8c7f15 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:24.661791 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f891720b-c1f4-46a2-8273-54b6a0f5acb1 req-0aa1a55a-7f97-43fb-a645-9d9e6a8c7f15 service neutron] 10.222.0.31 "GET /v2.0/networks?id=bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2 HTTP/1.1" status: 200 len: 896 time: 0.1250539 Dec 09 21:54:24.706715 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f891720b-c1f4-46a2-8273-54b6a0f5acb1 req-f9e55849-9b85-49a4-8109-1d8be89336a6 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 HTTP/1.1" status: 200 len: 217 time: 0.0371106 Dec 09 21:54:24.724978 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-4bf8a979-1d66-4520-b657-c47bd267bd81 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-551544193', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173'}], 'enable_snat': True}, 'gw_port_id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:56Z', 'updated_at': '2021-12-09T21:53:03Z', 'revision_number': 4, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'gw_port': {'id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ea:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3858, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:57Z', 'updated_at': '2021-12-09T21:53:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '968bf96c-fe29-4aff-afc1-7d0710db3d10', 'name': '', 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'mac_address': 'fa:16:3e:13:a3:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'device_owner': 'network:router_interface', 'standard_attr_id': 3861, 'fixed_ips': [{'subnet_id': 'a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:02Z', 'updated_at': '2021-12-09T21:53:06Z', 'revision_number': 5, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'subnets': [{'id': 'a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:24.751384 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bf8a979-1d66-4520-b657-c47bd267bd81 None None] Checking router: 7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:54:24.757186 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f891720b-c1f4-46a2-8273-54b6a0f5acb1 req-8e8b79f1-6d8a-4d76-8ef1-367a4dddb32f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:24.759658 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f891720b-c1f4-46a2-8273-54b6a0f5acb1 req-8e8b79f1-6d8a-4d76-8ef1-367a4dddb32f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5 HTTP/1.1" status: 200 len: 835 time: 0.0456195 Dec 09 21:54:24.760138 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4bf8a979-1d66-4520-b657-c47bd267bd81 None None] Routers {'7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:54:24.760739 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-4bf8a979-1d66-4520-b657-c47bd267bd81 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:54:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:24.820282 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f891720b-c1f4-46a2-8273-54b6a0f5acb1 req-3e4e997e-39f3-4a86-8193-3249968ff9f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:24.821932 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f891720b-c1f4-46a2-8273-54b6a0f5acb1 req-3e4e997e-39f3-4a86-8193-3249968ff9f0 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0541604 Dec 09 21:54:24.873484 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-4bf8a979-1d66-4520-b657-c47bd267bd81 None None] Set router 7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:54:24.916086 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f891720b-c1f4-46a2-8273-54b6a0f5acb1 req-4cddcd77-7037-434c-ab59-dd52ec8c718d service neutron] 10.222.0.31 "GET /v2.0/networks/bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0847311 Dec 09 21:54:25.021878 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f891720b-c1f4-46a2-8273-54b6a0f5acb1 req-637d4ffb-b154-4339-9078-e25b8a5df82a service neutron] 10.222.0.31 "GET /v2.0/networks/bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0941308 Dec 09 21:54:25.079108 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-4bf8a979-1d66-4520-b657-c47bd267bd81 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-551544193', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173'}], 'enable_snat': True}, 'gw_port_id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:56Z', 'updated_at': '2021-12-09T21:53:03Z', 'revision_number': 4, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'gw_port': {'id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ea:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3858, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:57Z', 'updated_at': '2021-12-09T21:53:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '968bf96c-fe29-4aff-afc1-7d0710db3d10', 'name': '', 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'mac_address': 'fa:16:3e:13:a3:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'device_owner': 'network:router_interface', 'standard_attr_id': 3861, 'fixed_ips': [{'subnet_id': 'a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:02Z', 'updated_at': '2021-12-09T21:53:06Z', 'revision_number': 5, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'subnets': [{'id': 'a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:25.097725 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d434eb5a-ab43-4057-96cb-3339e8aed8e8 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:54:25.105472 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4bf8a979-1d66-4520-b657-c47bd267bd81 None None] The sync data for ids ['7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'] in n-d-713301-27 is: [{'id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-551544193', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173'}], 'enable_snat': True}, 'gw_port_id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:56Z', 'updated_at': '2021-12-09T21:53:03Z', 'revision_number': 4, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'gw_port': {'id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ea:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3858, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:57Z', 'updated_at': '2021-12-09T21:53:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '968bf96c-fe29-4aff-afc1-7d0710db3d10', 'name': '', 'network_id': 'bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'mac_address': 'fa:16:3e:13:a3:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'device_owner': 'network:router_interface', 'standard_attr_id': 3861, 'fixed_ips': [{'subnet_id': 'a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:02Z', 'updated_at': '2021-12-09T21:53:06Z', 'revision_number': 5, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'subnets': [{'id': 'a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:54:25.119161 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: d434eb5a-ab43-4057-96cb-3339e8aed8e8 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:54:25.119640 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d434eb5a-ab43-4057-96cb-3339e8aed8e8 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:54:25.345675 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7c96186-adc1-4129-8324-75c47186b6cc None None] New status for floating IP 35067f66-8275-4a95-ae8b-4c9ce1a86ac2: DOWN {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:54:25.767732 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-584717ec-3c7a-42fe-bec5-b16f4597e5dd req-71f520db-4977-4ad8-bd14-1e02dd5f5811 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:25.769358 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-584717ec-3c7a-42fe-bec5-b16f4597e5dd req-71f520db-4977-4ad8-bd14-1e02dd5f5811 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/ports?device_id=71d6946a-a0e2-426d-a148-1d5b76c4f68c HTTP/1.1" status: 200 len: 985 time: 0.0537333 Dec 09 21:54:25.835114 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25057d37-e13b-4b6b-b194-f6d26363a38b req-5b40d736-5f84-4d2a-91de-118297f87f75 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:25.837225 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-25057d37-e13b-4b6b-b194-f6d26363a38b req-5b40d736-5f84-4d2a-91de-118297f87f75 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.31 "GET /v2.0/ports?device_id=71d6946a-a0e2-426d-a148-1d5b76c4f68c HTTP/1.1" status: 200 len: 985 time: 0.0527067 Dec 09 21:54:25.840968 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-584717ec-3c7a-42fe-bec5-b16f4597e5dd req-00baa7df-622a-4f9a-b4ca-978cd48b2e66 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "GET /v2.0/security-groups?id=cff07a74-5957-4506-85f7-9b25c08d5db0&id=99f9372d-12fa-4d58-a142-20d749c9a2e5&fields=id&fields=name HTTP/1.1" status: 200 len: 409 time: 0.0652761 Dec 09 21:54:25.938130 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-25057d37-e13b-4b6b-b194-f6d26363a38b req-a55ec4bb-eed6-4a45-be70-72e3ab9c2089 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Deleting port 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:54:25.938370 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-25057d37-e13b-4b6b-b194-f6d26363a38b req-a55ec4bb-eed6-4a45-be70-72e3ab9c2089 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:26.030142 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-25057d37-e13b-4b6b-b194-f6d26363a38b req-a55ec4bb-eed6-4a45-be70-72e3ab9c2089 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] For port 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=5bb39f06-5e7c-4c4d-ae8c-af7b245ca536,segment=NetworkSegment(c1baef7b-1212-4007-90e6-bd8d9f348b6f),segment_id=c1baef7b-1212-4007-90e6-bd8d9f348b6f)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:54:26.030546 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-25057d37-e13b-4b6b-b194-f6d26363a38b req-a55ec4bb-eed6-4a45-be70-72e3ab9c2089 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:26.047532 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-25057d37-e13b-4b6b-b194-f6d26363a38b req-a55ec4bb-eed6-4a45-be70-72e3ab9c2089 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Calling delete_port for 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:54:26.195697 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-25057d37-e13b-4b6b-b194-f6d26363a38b req-a55ec4bb-eed6-4a45-be70-72e3ab9c2089 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:26.224360 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a55ec4bb-eed6-4a45-be70-72e3ab9c2089 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event deleted for resources: {'Port': ['ID=5bb39f06-5e7c-4c4d-ae8c-af7b245ca536,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:26.267613 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-25057d37-e13b-4b6b-b194-f6d26363a38b req-a55ec4bb-eed6-4a45-be70-72e3ab9c2089 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] No DVR routers for this DVR port 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:54:26.270425 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-25057d37-e13b-4b6b-b194-f6d26363a38b req-a55ec4bb-eed6-4a45-be70-72e3ab9c2089 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:26.274580 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-25057d37-e13b-4b6b-b194-f6d26363a38b req-a55ec4bb-eed6-4a45-be70-72e3ab9c2089 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.31 "DELETE /v2.0/ports/5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 HTTP/1.1" status: 204 len: 173 time: 0.4301755 Dec 09 21:54:26.275049 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '71d6946a-a0e2-426d-a148-1d5b76c4f68c', 'name': 'network-vif-deleted', 'tag': '5bb39f06-5e7c-4c4d-ae8c-af7b245ca536'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:54:26.277429 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6555455a-6dee-4288-9882-ea8f1e5bd512" -d '{"events": [{"server_uuid": "71d6946a-a0e2-426d-a148-1d5b76c4f68c", "name": "network-vif-deleted", "tag": "5bb39f06-5e7c-4c4d-ae8c-af7b245ca536"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:54:26.319979 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:54:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3d37fbbe-d756-4b67-b700-b19f0e870306 x-openstack-request-id: req-3d37fbbe-d756-4b67-b700-b19f0e870306 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:54:26.320345 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "71d6946a-a0e2-426d-a148-1d5b76c4f68c", "name": "network-vif-deleted", "tag": "5bb39f06-5e7c-4c4d-ae8c-af7b245ca536", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:54:26.320729 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-3d37fbbe-d756-4b67-b700-b19f0e870306 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:54:26.321863 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '71d6946a-a0e2-426d-a148-1d5b76c4f68c', 'name': 'network-vif-deleted', 'tag': '5bb39f06-5e7c-4c4d-ae8c-af7b245ca536', 'status': 'completed', 'code': 200} Dec 09 21:54:26.902166 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54824) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:26.958629 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ebbfc10-a813-4473-b272-b1f445dfcac9 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:26.982280 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ebbfc10-a813-4473-b272-b1f445dfcac9 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:27.026081 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ebbfc10-a813-4473-b272-b1f445dfcac9 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:27.028686 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ebbfc10-a813-4473-b272-b1f445dfcac9 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:27.030224 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5ebbfc10-a813-4473-b272-b1f445dfcac9 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "DELETE /v2.0/security-groups/99f9372d-12fa-4d58-a142-20d749c9a2e5 HTTP/1.1" status: 204 len: 168 time: 0.1264634 Dec 09 21:54:27.033269 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54826) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:27.039956 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ebbfc10-a813-4473-b272-b1f445dfcac9 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=99f9372d-12fa-4d58-a142-20d749c9a2e5,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:27.109274 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd4752d4-f719-4eb0-a85b-e0dd8330412f tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:27.134012 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd4752d4-f719-4eb0-a85b-e0dd8330412f tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:27.188373 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd4752d4-f719-4eb0-a85b-e0dd8330412f tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:27.191902 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fd4752d4-f719-4eb0-a85b-e0dd8330412f tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:27.195744 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fd4752d4-f719-4eb0-a85b-e0dd8330412f tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "DELETE /v2.0/security-groups/cff07a74-5957-4506-85f7-9b25c08d5db0 HTTP/1.1" status: 204 len: 168 time: 0.1588166 Dec 09 21:54:27.196500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54828) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:27.203406 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd4752d4-f719-4eb0-a85b-e0dd8330412f tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=cff07a74-5957-4506-85f7-9b25c08d5db0,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:27.361786 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:27.584452 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bc4cb092-cebf-44f3-9688-dad83cd9360f tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:27.585570 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:27.872044 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-bc4cb092-cebf-44f3-9688-dad83cd9360f tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Deleting port 968bf96c-fe29-4aff-afc1-7d0710db3d10 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:54:27.872385 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bc4cb092-cebf-44f3-9688-dad83cd9360f tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:27.965474 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-bc4cb092-cebf-44f3-9688-dad83cd9360f tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] For port 968bf96c-fe29-4aff-afc1-7d0710db3d10, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=968bf96c-fe29-4aff-afc1-7d0710db3d10,segment=NetworkSegment(c1baef7b-1212-4007-90e6-bd8d9f348b6f),segment_id=c1baef7b-1212-4007-90e6-bd8d9f348b6f)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:54:27.966320 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bc4cb092-cebf-44f3-9688-dad83cd9360f tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:27.978900 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-bc4cb092-cebf-44f3-9688-dad83cd9360f tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Calling delete_port for 968bf96c-fe29-4aff-afc1-7d0710db3d10 owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:54:28.192132 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bc4cb092-cebf-44f3-9688-dad83cd9360f tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:28.217568 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc4cb092-cebf-44f3-9688-dad83cd9360f tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event deleted for resources: {'Port': ['ID=968bf96c-fe29-4aff-afc1-7d0710db3d10,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:28.331448 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:54:28.353514 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:54:28.353858 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 5bb39f06-5e7c-4c4d-ae8c-af7b245ca536 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:54:28.430312 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bc4cb092-cebf-44f3-9688-dad83cd9360f tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:28.659161 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bc4cb092-cebf-44f3-9688-dad83cd9360f tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Router 7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:54:28.774247 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bc4cb092-cebf-44f3-9688-dad83cd9360f tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:54:28.780457 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bc4cb092-cebf-44f3-9688-dad83cd9360f tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "PUT /v2.0/routers/7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5827398 Dec 09 21:54:28.783267 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54836) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:28.786999 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58010b1d-ec63-41f4-8885-541639df75c3 None None] Sync routers for ids ['7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:54:28.798595 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58010b1d-ec63-41f4-8885-541639df75c3 None None] Routers {'7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:54:28.799915 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-58010b1d-ec63-41f4-8885-541639df75c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:54:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:28.850074 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-c90e2217-55ff-454e-b0a5-4c58aa1387fa tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Deleting subnet a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:54:28.853497 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c90e2217-55ff-454e-b0a5-4c58aa1387fa tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:28.896326 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c90e2217-55ff-454e-b0a5-4c58aa1387fa tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:28.923527 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-58010b1d-ec63-41f4-8885-541639df75c3 None None] Set router 7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:54:28.996713 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c90e2217-55ff-454e-b0a5-4c58aa1387fa tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:29.065992 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c90e2217-55ff-454e-b0a5-4c58aa1387fa tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:29.096300 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c90e2217-55ff-454e-b0a5-4c58aa1387fa tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event deleted for resources: {'Subnet': ['ID=a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:29.101264 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c90e2217-55ff-454e-b0a5-4c58aa1387fa tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:29.107327 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c90e2217-55ff-454e-b0a5-4c58aa1387fa tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "DELETE /v2.0/subnets/a5c5ecaf-5e41-492d-af1f-b4a5d79e18d5 HTTP/1.1" status: 204 len: 168 time: 0.3204670 Dec 09 21:54:29.107528 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54838) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:29.112450 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9746b45a-b74c-4b18-b351-3b2fd0bb0e2f None None] Network bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:54:29.151320 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-58010b1d-ec63-41f4-8885-541639df75c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-551544193', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173'}], 'enable_snat': True}, 'gw_port_id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:56Z', 'updated_at': '2021-12-09T21:54:28Z', 'revision_number': 5, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'gw_port': {'id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ea:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3858, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:57Z', 'updated_at': '2021-12-09T21:53:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:29.192938 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58010b1d-ec63-41f4-8885-541639df75c3 None None] Checking router: 7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:54:29.210323 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58010b1d-ec63-41f4-8885-541639df75c3 None None] Routers {'7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:54:29.210994 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-58010b1d-ec63-41f4-8885-541639df75c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:54:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:29.349561 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb15ff30-f189-4de3-ba76-0368a00b20a8 None None] DHCP port deletion for bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:54:29.354703 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-58010b1d-ec63-41f4-8885-541639df75c3 None None] Set router 7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:54:29.429529 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-eb15ff30-f189-4de3-ba76-0368a00b20a8 None None] Deleting port 4a93f4ac-1360-4c70-951c-d805521e39c3 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:54:29.430308 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb15ff30-f189-4de3-ba76-0368a00b20a8 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:29.506196 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-eb15ff30-f189-4de3-ba76-0368a00b20a8 None None] For port 4a93f4ac-1360-4c70-951c-d805521e39c3, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=4a93f4ac-1360-4c70-951c-d805521e39c3,segment=NetworkSegment(c1baef7b-1212-4007-90e6-bd8d9f348b6f),segment_id=c1baef7b-1212-4007-90e6-bd8d9f348b6f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:54:29.507034 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb15ff30-f189-4de3-ba76-0368a00b20a8 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:29.520972 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-eb15ff30-f189-4de3-ba76-0368a00b20a8 None None] Calling delete_port for 4a93f4ac-1360-4c70-951c-d805521e39c3 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:54:29.622000 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-58010b1d-ec63-41f4-8885-541639df75c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-551544193', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173'}], 'enable_snat': True}, 'gw_port_id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:56Z', 'updated_at': '2021-12-09T21:54:28Z', 'revision_number': 5, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'gw_port': {'id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ea:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3858, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:57Z', 'updated_at': '2021-12-09T21:53:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:29.631798 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6f9e26f-0a4f-4203-8789-1365fcb3314d tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:29.650386 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb15ff30-f189-4de3-ba76-0368a00b20a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:29.658490 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58010b1d-ec63-41f4-8885-541639df75c3 None None] The sync data for ids ['7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e'] in n-d-713301-27 is: [{'id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'name': 'tempest-TestSecurityGroupsBasicOps-router-551544193', 'tenant_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173'}], 'enable_snat': True}, 'gw_port_id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:52:56Z', 'updated_at': '2021-12-09T21:54:28Z', 'revision_number': 5, 'project_id': '594fec82d9ab4e97a76f8c869f0bbcf0', 'gw_port': {'id': 'fb327925-1394-41b3-b56e-d10fa9a24586', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d8:ea:5c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3858, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.173', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:52:57Z', 'updated_at': '2021-12-09T21:53:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:54:29.692891 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb15ff30-f189-4de3-ba76-0368a00b20a8 None None] Pushing event deleted for resources: {'Port': ['ID=4a93f4ac-1360-4c70-951c-d805521e39c3,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:29.705610 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb15ff30-f189-4de3-ba76-0368a00b20a8 None None] No DVR routers for this DVR port 4a93f4ac-1360-4c70-951c-d805521e39c3 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:54:29.775974 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6f9e26f-0a4f-4203-8789-1365fcb3314d tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:29.837709 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-a6f9e26f-0a4f-4203-8789-1365fcb3314d tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Deleting port fb327925-1394-41b3-b56e-d10fa9a24586 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:54:29.838087 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6f9e26f-0a4f-4203-8789-1365fcb3314d tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:29.918645 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-a6f9e26f-0a4f-4203-8789-1365fcb3314d tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] For port fb327925-1394-41b3-b56e-d10fa9a24586, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=fb327925-1394-41b3-b56e-d10fa9a24586,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:54:29.919382 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6f9e26f-0a4f-4203-8789-1365fcb3314d tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:29.936314 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-a6f9e26f-0a4f-4203-8789-1365fcb3314d tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Calling delete_port for fb327925-1394-41b3-b56e-d10fa9a24586 owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:54:30.144621 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6f9e26f-0a4f-4203-8789-1365fcb3314d tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:30.179612 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6f9e26f-0a4f-4203-8789-1365fcb3314d tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event deleted for resources: {'Port': ['ID=fb327925-1394-41b3-b56e-d10fa9a24586,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:30.197561 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a9a2711-5d23-46a5-9a0e-0ee36e267211 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:54:30.258143 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6f9e26f-0a4f-4203-8789-1365fcb3314d tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:30.355922 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6f9e26f-0a4f-4203-8789-1365fcb3314d tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:30.358491 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6f9e26f-0a4f-4203-8789-1365fcb3314d tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:30.406410 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6f9e26f-0a4f-4203-8789-1365fcb3314d tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:30.406949 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a6f9e26f-0a4f-4203-8789-1365fcb3314d tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Fanout notify agent at l3_agent the message router_deleted on router 7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:54:30.414151 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6f9e26f-0a4f-4203-8789-1365fcb3314d tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:30.415272 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a6f9e26f-0a4f-4203-8789-1365fcb3314d tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "DELETE /v2.0/routers/7becd4f3-fc7c-4dcb-8b0e-a3d27410bf7e HTTP/1.1" status: 204 len: 168 time: 1.3069375 Dec 09 21:54:30.417891 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54842) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:30.503717 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:30.601860 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:30.621351 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:30.630893 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c1baef7b-1212-4007-90e6-bd8d9f348b6f') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:30.631199 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c1baef7b-1212-4007-90e6-bd8d9f348b6f') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:30.641035 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:30.655192 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:30.661244 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Releasing vlan 145 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:54:30.661641 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:54:30.664910 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:54:30.725322 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:30.730254 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:30.734453 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] 10.222.0.13 "DELETE /v2.0/networks/bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2 HTTP/1.1" status: 204 len: 168 time: 0.3153753 Dec 09 21:54:30.754771 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Pushing event deleted for resources: {'Network': ['ID=bf762a8f-55a7-4c73-a5fa-6dfbfd74ceb2,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:30.764210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:30.764613 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:30.764970 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:30.765315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:30.765645 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:30.765997 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:30.766369 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:30.766886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:30.767397 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:30.767980 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:30.768735 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:30.768735 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:30.768735 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52671bed-b999-4645-a417-979361737e64 tempest-TestSecurityGroupsBasicOps-849147086 tempest-TestSecurityGroupsBasicOps-849147086-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:31.103080 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54852) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:31.162598 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 4a93f4ac-1360-4c70-951c-d805521e39c3 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:54:31.186121 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 4a93f4ac-1360-4c70-951c-d805521e39c3 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:54:31.186669 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 4a93f4ac-1360-4c70-951c-d805521e39c3 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:54:31.187602 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 968bf96c-fe29-4aff-afc1-7d0710db3d10 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:54:31.209759 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 968bf96c-fe29-4aff-afc1-7d0710db3d10 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:54:31.210407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 968bf96c-fe29-4aff-afc1-7d0710db3d10 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:54:31.210407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device fb327925-1394-41b3-b56e-d10fa9a24586 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:54:31.232659 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: fb327925-1394-41b3-b56e-d10fa9a24586 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:54:31.233132 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device fb327925-1394-41b3-b56e-d10fa9a24586 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:54:31.270078 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f1fdf2b4-0976-497f-98f3-4cb5eb27941a admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=594fec82d9ab4e97a76f8c869f0bbcf0&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1657555 Dec 09 21:54:31.272714 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54856) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:31.329026 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-46bd77bd-9a3b-4c66-871d-b88b7ee0aede admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:31.353050 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-46bd77bd-9a3b-4c66-871d-b88b7ee0aede admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:31.407225 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-46bd77bd-9a3b-4c66-871d-b88b7ee0aede admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:31.410330 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-46bd77bd-9a3b-4c66-871d-b88b7ee0aede admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:31.414362 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-46bd77bd-9a3b-4c66-871d-b88b7ee0aede admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/9149939d-106b-4547-b858-03ff611467ff HTTP/1.1" status: 204 len: 168 time: 0.1374075 Dec 09 21:54:31.421460 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46bd77bd-9a3b-4c66-871d-b88b7ee0aede admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9149939d-106b-4547-b858-03ff611467ff,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:31.697208 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54862) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:31.710876 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-031dd2c0-8229-4f01-9642-67b20c326f45 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:31.789082 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-031dd2c0-8229-4f01-9642-67b20c326f45 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:31.794047 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-031dd2c0-8229-4f01-9642-67b20c326f45 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:31.830932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-031dd2c0-8229-4f01-9642-67b20c326f45 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e07bc8b2-f376-4e7a-8155-710cf4f57837,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:31.835134 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-031dd2c0-8229-4f01-9642-67b20c326f45 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=08f99c063f4746d099038f279c95cd3f&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1368752 Dec 09 21:54:31.838237 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54864) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:31.887914 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c6e1a4b-1033-44fc-ad06-247dee8565bc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:31.909628 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c6e1a4b-1033-44fc-ad06-247dee8565bc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:31.956559 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c6e1a4b-1033-44fc-ad06-247dee8565bc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:31.959196 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c6e1a4b-1033-44fc-ad06-247dee8565bc admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:31.961083 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5c6e1a4b-1033-44fc-ad06-247dee8565bc admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/e07bc8b2-f376-4e7a-8155-710cf4f57837 HTTP/1.1" status: 204 len: 168 time: 0.1220980 Dec 09 21:54:31.969079 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c6e1a4b-1033-44fc-ad06-247dee8565bc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e07bc8b2-f376-4e7a-8155-710cf4f57837,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:32.314008 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54878) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:32.354748 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f2d011ec-5c0d-4709-9a34-04f759fe2cca admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=7152c52b14df48c6a9ba04fad9022360&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0394592 Dec 09 21:54:32.357400 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54880) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:32.405282 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25dcc64e-7f11-49db-bc6a-15167d116f5a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:32.430039 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25dcc64e-7f11-49db-bc6a-15167d116f5a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:32.478182 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25dcc64e-7f11-49db-bc6a-15167d116f5a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:32.481297 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-25dcc64e-7f11-49db-bc6a-15167d116f5a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:32.483000 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-25dcc64e-7f11-49db-bc6a-15167d116f5a admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/011fc51a-94af-4eec-903e-f116ba590915 HTTP/1.1" status: 204 len: 168 time: 0.1244404 Dec 09 21:54:32.495013 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25dcc64e-7f11-49db-bc6a-15167d116f5a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=011fc51a-94af-4eec-903e-f116ba590915,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:32.978795 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-43442d6f-cccb-499b-875f-35854f08ff80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:33.203817 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54904) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:33.312949 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-4ff915a2-0a2d-4d57-a46f-1ac755ab604a admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-68643702-network', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:54:33.335989 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4ff915a2-0a2d-4d57-a46f-1ac755ab604a admin admin] Made reservation on behalf of be526cfddc4f4783b993a3f6e5b5e630 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:54:33.338394 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4ff915a2-0a2d-4d57-a46f-1ac755ab604a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:33.347344 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4ff915a2-0a2d-4d57-a46f-1ac755ab604a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:33.423740 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4ff915a2-0a2d-4d57-a46f-1ac755ab604a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:33.428729 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4ff915a2-0a2d-4d57-a46f-1ac755ab604a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:33.456669 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4ff915a2-0a2d-4d57-a46f-1ac755ab604a admin admin] vlan segment allocate from pool success with {'vlan_id': 124, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:54:33.462058 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ff915a2-0a2d-4d57-a46f-1ac755ab604a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=04593cf6-df62-4851-bed9-8fc871e1c284,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:33.470115 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4ff915a2-0a2d-4d57-a46f-1ac755ab604a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:33.470590 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-4ff915a2-0a2d-4d57-a46f-1ac755ab604a admin admin] Added segment efd99328-8749-4154-94c0-14d978d592d7 of type vlan for network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 Dec 09 21:54:33.512759 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4ff915a2-0a2d-4d57-a46f-1ac755ab604a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:33.538945 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4ff915a2-0a2d-4d57-a46f-1ac755ab604a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:33.539946 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4ff915a2-0a2d-4d57-a46f-1ac755ab604a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:33.540526 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4ff915a2-0a2d-4d57-a46f-1ac755ab604a admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:33.575520 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4ff915a2-0a2d-4d57-a46f-1ac755ab604a admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.3704255 Dec 09 21:54:33.578522 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54908) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:33.584240 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a50174ff-044e-48c6-9039-26f2e64c31de admin admin] Request body: {'subnet': {'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-68643702-subnet', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:54:33.607010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ff915a2-0a2d-4d57-a46f-1ac755ab604a admin admin] Pushing event updated for resources: {'Network': ['ID=486ad174-ad0c-4065-a4b6-6f9af6b2a208,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:33.607333 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a50174ff-044e-48c6-9039-26f2e64c31de admin admin] Made reservation on behalf of be526cfddc4f4783b993a3f6e5b5e630 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:54:33.609794 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a50174ff-044e-48c6-9039-26f2e64c31de admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:33.620643 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:54:33.784738 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a50174ff-044e-48c6-9039-26f2e64c31de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:33.837718 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a50174ff-044e-48c6-9039-26f2e64c31de admin admin] Pushing event updated for resources: {'Subnet': ['ID=7004626f-deda-4ef1-8abe-97a447b2d2e9,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:33.847806 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a50174ff-044e-48c6-9039-26f2e64c31de admin admin] Checking segment: {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:54:33.848176 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a50174ff-044e-48c6-9039-26f2e64c31de admin admin] Network hostable DHCP agents. Network: 486ad174-ad0c-4065-a4b6-6f9af6b2a208, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:54:33.871757 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a50174ff-044e-48c6-9039-26f2e64c31de admin admin] Network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:54:33.884103 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-a50174ff-044e-48c6-9039-26f2e64c31de admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 486ad174-ad0c-4065-a4b6-6f9af6b2a208) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:54:33.887700 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a50174ff-044e-48c6-9039-26f2e64c31de admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:33.888459 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a50174ff-044e-48c6-9039-26f2e64c31de admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:33.892733 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8548e496-ebd6-48c0-b8bb-74f10638165e None None] Network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:54:33.910656 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54910) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:33.910957 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a50174ff-044e-48c6-9039-26f2e64c31de admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.3309948 Dec 09 21:54:33.915814 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-2055cf00-c7e9-4046-b856-8b5f43677029 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:54:33.941690 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2055cf00-c7e9-4046-b856-8b5f43677029 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:33.943202 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2055cf00-c7e9-4046-b856-8b5f43677029 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:34.001897 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2055cf00-c7e9-4046-b856-8b5f43677029 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:34.007447 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-944e1e43-f08f-4a47-8b52-f5ec08894518 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:54:34.008495 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-944e1e43-f08f-4a47-8b52-f5ec08894518 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:34.152028 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2055cf00-c7e9-4046-b856-8b5f43677029 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:34.353016 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-944e1e43-f08f-4a47-8b52-f5ec08894518 None None] Allocated IP 172.20.0.2 (486ad174-ad0c-4065-a4b6-6f9af6b2a208/7004626f-deda-4ef1-8abe-97a447b2d2e9/531d78f5-2683-4d75-a638-f4d5d7296300) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:54:34.438976 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2055cf00-c7e9-4046-b856-8b5f43677029 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:34.469662 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2055cf00-c7e9-4046-b856-8b5f43677029 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:34.515507 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-944e1e43-f08f-4a47-8b52-f5ec08894518 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:34.526734 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-944e1e43-f08f-4a47-8b52-f5ec08894518 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:34.563319 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-944e1e43-f08f-4a47-8b52-f5ec08894518 None None] Network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:54:34.566730 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-944e1e43-f08f-4a47-8b52-f5ec08894518 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:54:34.570813 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-944e1e43-f08f-4a47-8b52-f5ec08894518 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:54:34.597349 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-2055cf00-c7e9-4046-b856-8b5f43677029 admin admin] Allocated IP 172.25.3.165 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:54:34.606394 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-944e1e43-f08f-4a47-8b52-f5ec08894518 None None] Pushing event updated for resources: {'Port': ['ID=531d78f5-2683-4d75-a638-f4d5d7296300,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:34.640677 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-944e1e43-f08f-4a47-8b52-f5ec08894518 None None] Attempting to bind port 531d78f5-2683-4d75-a638-f4d5d7296300 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:54:34.641354 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-944e1e43-f08f-4a47-8b52-f5ec08894518 None None] Attempting to bind port 531d78f5-2683-4d75-a638-f4d5d7296300 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:54:34.641934 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-944e1e43-f08f-4a47-8b52-f5ec08894518 None None] Attempting to bind port 531d78f5-2683-4d75-a638-f4d5d7296300 on network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:54:34.647183 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-944e1e43-f08f-4a47-8b52-f5ec08894518 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 54, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:54:34.647873 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-944e1e43-f08f-4a47-8b52-f5ec08894518 None None] Checking segment: {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:54:34.648506 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-944e1e43-f08f-4a47-8b52-f5ec08894518 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:34.649184 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-944e1e43-f08f-4a47-8b52-f5ec08894518 None None] Bound using segment: {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:54:34.649822 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-944e1e43-f08f-4a47-8b52-f5ec08894518 None None] Bound port: 531d78f5-2683-4d75-a638-f4d5d7296300, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:54:34.650395 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-944e1e43-f08f-4a47-8b52-f5ec08894518 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:34.729248 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-944e1e43-f08f-4a47-8b52-f5ec08894518 None None] For port 531d78f5-2683-4d75-a638-f4d5d7296300, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:54:34.734993 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-944e1e43-f08f-4a47-8b52-f5ec08894518 None None] For port 531d78f5-2683-4d75-a638-f4d5d7296300, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=531d78f5-2683-4d75-a638-f4d5d7296300,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:54:34.743964 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-944e1e43-f08f-4a47-8b52-f5ec08894518 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:34.745153 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2055cf00-c7e9-4046-b856-8b5f43677029 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:34.785554 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2055cf00-c7e9-4046-b856-8b5f43677029 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:34.831203 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2055cf00-c7e9-4046-b856-8b5f43677029 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:54:34.834442 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-2055cf00-c7e9-4046-b856-8b5f43677029 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:54:34.838611 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2055cf00-c7e9-4046-b856-8b5f43677029 admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:54:34.854188 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-edf0b33b-8ad0-4c96-bf84-e266ad0bee03 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:54:34.857083 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-944e1e43-f08f-4a47-8b52-f5ec08894518 None None] Pushing event updated for resources: {'Port': ['ID=531d78f5-2683-4d75-a638-f4d5d7296300,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:34.892391 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2055cf00-c7e9-4046-b856-8b5f43677029 admin admin] Pushing event updated for resources: {'Port': ['ID=8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:34.948683 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3fcbddfa-2364-442c-9257-45198d78b1c0 None None] Provisioning complete for port 8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:34.949365 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3fcbddfa-2364-442c-9257-45198d78b1c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:35.000799 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-3fcbddfa-2364-442c-9257-45198d78b1c0 None None] Port 8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:54:35.246423 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2055cf00-c7e9-4046-b856-8b5f43677029 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:35.277457 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 531d78f5-2683-4d75-a638-f4d5d7296300 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:54:35.374848 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 531d78f5-2683-4d75-a638-f4d5d7296300 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:35.375359 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:35.420292 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54930) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:35.494790 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:35.523137 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2055cf00-c7e9-4046-b856-8b5f43677029 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:35.563864 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 531d78f5-2683-4d75-a638-f4d5d7296300, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=531d78f5-2683-4d75-a638-f4d5d7296300,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:54:35.582997 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:35.591561 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4d7328e5-2c4e-49ac-ad87-ae4c951045d3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:35.615034 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8ce2493-84ec-4886-a816-e3ae0e705776 req-a5c04c17-a7cd-424d-8b8b-f75ab063a8f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:35.625263 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d8ce2493-84ec-4886-a816-e3ae0e705776 req-a5c04c17-a7cd-424d-8b8b-f75ab063a8f8 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 1098 time: 0.2034595 Dec 09 21:54:35.652963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=531d78f5-2683-4d75-a638-f4d5d7296300,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:35.678503 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d8ce2493-84ec-4886-a816-e3ae0e705776 req-5380301e-b9f7-421c-9c69-59cae42f5213 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=e0446b46-bdd5-496a-bc4f-672214f90d12&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0522606 Dec 09 21:54:35.715359 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2055cf00-c7e9-4046-b856-8b5f43677029 admin admin] Router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:54:35.893577 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2055cf00-c7e9-4046-b856-8b5f43677029 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:54:35.905320 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] Sync routers for ids ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:54:35.915315 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2055cf00-c7e9-4046-b856-8b5f43677029 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:35.916666 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2055cf00-c7e9-4046-b856-8b5f43677029 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 2.0046911 Dec 09 21:54:35.919740 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54936) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:35.931994 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] Routers {'52333c17-500b-4d13-8de7-f3d9c4c6eb46'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:54:35.932922 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:54:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:36.108368 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] Set router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:54:36.256545 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2dd02b25-695b-4278-9ac4-929b16582497 None None] Network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:54:36.439150 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d72ff462-685a-46d7-b630-1e4066e0011f None None] Provisioning complete for port 531d78f5-2683-4d75-a638-f4d5d7296300 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:36.441321 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d72ff462-685a-46d7-b630-1e4066e0011f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:36.446886 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f2d8df0-b15a-4b84-803a-284773547eec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:36.616638 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T21:54:35Z', 'revision_number': 3, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:34Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:36.639883 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-1f2d8df0-b15a-4b84-803a-284773547eec admin admin] Allocated IP 172.20.0.1 (486ad174-ad0c-4065-a4b6-6f9af6b2a208/7004626f-deda-4ef1-8abe-97a447b2d2e9/db7c12a5-60a7-41e6-ae5c-e42348c373b4) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:54:36.657222 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] Checking router: 52333c17-500b-4d13-8de7-f3d9c4c6eb46 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:54:36.658842 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] Updating router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 port 8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:54:36.698829 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:36.708742 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:36.812994 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f2d8df0-b15a-4b84-803a-284773547eec admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:36.856960 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-00663485-f477-4906-8bd6-b79eb4252a25 None None] Provisioning complete for port 531d78f5-2683-4d75-a638-f4d5d7296300 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:36.857934 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-00663485-f477-4906-8bd6-b79eb4252a25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:36.858571 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f2d8df0-b15a-4b84-803a-284773547eec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:36.898021 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f2d8df0-b15a-4b84-803a-284773547eec admin admin] Network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:54:36.901247 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-1f2d8df0-b15a-4b84-803a-284773547eec admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:54:36.904822 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f2d8df0-b15a-4b84-803a-284773547eec admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:54:36.933250 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f2d8df0-b15a-4b84-803a-284773547eec admin admin] Pushing event updated for resources: {'Port': ['ID=db7c12a5-60a7-41e6-ae5c-e42348c373b4,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:36.955806 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f2d8df0-b15a-4b84-803a-284773547eec admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:37.101396 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f2d8df0-b15a-4b84-803a-284773547eec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:37.128891 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:37.146791 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:37.187714 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] Attempting to bind port 8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:54:37.187714 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] Attempting to bind port 8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:54:37.187714 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] Attempting to bind port 8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:54:37.189962 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f5aed34-1a29-4710-b3d0-78b99bdacb7c None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:54:37.222779 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 531d78f5-2683-4d75-a638-f4d5d7296300 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:54:37.230492 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 54, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:54:37.230882 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:54:37.232409 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:37.232409 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:54:37.232409 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] Bound port: 8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:54:37.232733 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:37.302237 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-902ac558-8245-4fbc-b926-cf7172fd4e7a None None] Pushing event updated for resources: {'Port': ['ID=8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:37.341102 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-eaeccdf8-8e6d-4fbe-a773-271524d74b66 None None] Provisioning complete for port db7c12a5-60a7-41e6-ae5c-e42348c373b4 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:37.341871 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eaeccdf8-8e6d-4fbe-a773-271524d74b66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:37.344674 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f2d8df0-b15a-4b84-803a-284773547eec admin admin] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:37.350052 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f2d8df0-b15a-4b84-803a-284773547eec admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:37.369662 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] For port 8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:54:37.390907 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] For port 8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:54:37.400969 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:37.408672 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 531d78f5-2683-4d75-a638-f4d5d7296300 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:37.409045 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:37.410504 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-eaeccdf8-8e6d-4fbe-a773-271524d74b66 None None] Port db7c12a5-60a7-41e6-ae5c-e42348c373b4 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:54:37.421106 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1f2d8df0-b15a-4b84-803a-284773547eec admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:37.422927 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f2d8df0-b15a-4b84-803a-284773547eec admin admin] Pushing event updated for resources: {'Port': ['ID=db7c12a5-60a7-41e6-ae5c-e42348c373b4,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:37.492338 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eae13794-60e1-44f2-afd7-be4a2b3236e7 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:54:37.509158 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-eaeccdf8-8e6d-4fbe-a773-271524d74b66 None None] Provisioning complete for port 8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:37.509534 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eaeccdf8-8e6d-4fbe-a773-271524d74b66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:37.546206 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] Routers {'52333c17-500b-4d13-8de7-f3d9c4c6eb46'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:54:37.546859 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:54:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:37.589101 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-902ac558-8245-4fbc-b926-cf7172fd4e7a None None] Pushing event updated for resources: {'Port': ['ID=8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:37.907137 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1f2d8df0-b15a-4b84-803a-284773547eec admin admin] Network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:54:37.909616 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-1f2d8df0-b15a-4b84-803a-284773547eec admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:54:37.933384 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eaeccdf8-8e6d-4fbe-a773-271524d74b66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:37.943627 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] Set router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:54:37.998386 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-eaeccdf8-8e6d-4fbe-a773-271524d74b66 None None] For port 8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:54:38.005467 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eaeccdf8-8e6d-4fbe-a773-271524d74b66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:38.057613 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1f2d8df0-b15a-4b84-803a-284773547eec admin admin] Router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:54:38.093689 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:38.159878 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaeccdf8-8e6d-4fbe-a773-271524d74b66 None None] Pushing event updated for resources: {'Port': ['ID=8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:38.185405 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-42fa5c32-9215-412b-8679-1cb0240386da None None] Provisioning complete for port 8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:38.185789 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-42fa5c32-9215-412b-8679-1cb0240386da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:38.202683 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1f2d8df0-b15a-4b84-803a-284773547eec admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:54:38.218089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1f2d8df0-b15a-4b84-803a-284773547eec admin admin] 10.222.0.13 "PUT /v2.0/routers/52333c17-500b-4d13-8de7-f3d9c4c6eb46/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2970810 Dec 09 21:54:38.326455 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'db7c12a5-60a7-41e6-ae5c-e42348c373b4', 'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'mac_address': 'fa:16:3e:79:8f:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_interface', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:36Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 2, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'subnets': [{'id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:38.366735 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed59f5b0-66f7-42ce-b82c-a55c3c2f456e None None] The sync data for ids ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'] in n-d-713301-27 is: [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'db7c12a5-60a7-41e6-ae5c-e42348c373b4', 'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'mac_address': 'fa:16:3e:79:8f:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_interface', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:36Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 2, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'subnets': [{'id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:54:38.497337 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f095858c-44cd-46e4-a0b8-cab0251ae8dd None None] Provisioning complete for port db7c12a5-60a7-41e6-ae5c-e42348c373b4 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:38.497883 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f095858c-44cd-46e4-a0b8-cab0251ae8dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:38.540149 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f095858c-44cd-46e4-a0b8-cab0251ae8dd None None] Port db7c12a5-60a7-41e6-ae5c-e42348c373b4 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:54:38.803342 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54976) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:38.808434 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-99a15e6d-c936-4300-b438-51b22b60486b admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-78789970-network', 'tenant_id': '1dff2c41373b452ca617836c4bf8f952'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:54:38.834100 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-99a15e6d-c936-4300-b438-51b22b60486b admin admin] Made reservation on behalf of 1dff2c41373b452ca617836c4bf8f952 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:54:38.836804 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99a15e6d-c936-4300-b438-51b22b60486b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:38.846873 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99a15e6d-c936-4300-b438-51b22b60486b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:38.930408 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99a15e6d-c936-4300-b438-51b22b60486b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:38.937137 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99a15e6d-c936-4300-b438-51b22b60486b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:38.966046 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-99a15e6d-c936-4300-b438-51b22b60486b admin admin] vlan segment allocate from pool success with {'vlan_id': 101, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:54:38.972674 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99a15e6d-c936-4300-b438-51b22b60486b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d4fc259f-764d-4b97-a5bd-111902b97b1f,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:38.980779 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99a15e6d-c936-4300-b438-51b22b60486b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:38.981038 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-99a15e6d-c936-4300-b438-51b22b60486b admin admin] Added segment d4d23ac9-b7fb-4582-aa7f-b0313907bb51 of type vlan for network a40f73e2-2be7-4c6a-9103-48879b1376b3 Dec 09 21:54:39.031466 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99a15e6d-c936-4300-b438-51b22b60486b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:39.058513 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99a15e6d-c936-4300-b438-51b22b60486b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:39.059939 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99a15e6d-c936-4300-b438-51b22b60486b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:39.060650 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99a15e6d-c936-4300-b438-51b22b60486b admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:39.122575 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-99a15e6d-c936-4300-b438-51b22b60486b admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.3179750 Dec 09 21:54:39.125454 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 54978) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:39.131196 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-094f6f31-16b4-4a70-a2bc-13f250c3c314 admin admin] Request body: {'subnet': {'network_id': 'a40f73e2-2be7-4c6a-9103-48879b1376b3', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-78789970-subnet', 'tenant_id': '1dff2c41373b452ca617836c4bf8f952', 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:54:39.133817 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99a15e6d-c936-4300-b438-51b22b60486b admin admin] Pushing event updated for resources: {'Network': ['ID=a40f73e2-2be7-4c6a-9103-48879b1376b3,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:39.175046 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network a40f73e2-2be7-4c6a-9103-48879b1376b3 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:54:39.186423 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-094f6f31-16b4-4a70-a2bc-13f250c3c314 admin admin] Made reservation on behalf of 1dff2c41373b452ca617836c4bf8f952 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:54:39.189326 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-094f6f31-16b4-4a70-a2bc-13f250c3c314 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:39.391739 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-094f6f31-16b4-4a70-a2bc-13f250c3c314 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:39.460604 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-094f6f31-16b4-4a70-a2bc-13f250c3c314 admin admin] Checking segment: {'id': 'd4d23ac9-b7fb-4582-aa7f-b0313907bb51', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'a40f73e2-2be7-4c6a-9103-48879b1376b3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:54:39.461237 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-094f6f31-16b4-4a70-a2bc-13f250c3c314 admin admin] Network hostable DHCP agents. Network: a40f73e2-2be7-4c6a-9103-48879b1376b3, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:54:39.465146 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-094f6f31-16b4-4a70-a2bc-13f250c3c314 admin admin] Pushing event updated for resources: {'Subnet': ['ID=530ff632-ec21-4b96-a24b-61c4b22f4827,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:39.484964 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-094f6f31-16b4-4a70-a2bc-13f250c3c314 admin admin] Network a40f73e2-2be7-4c6a-9103-48879b1376b3 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:54:39.497402 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-094f6f31-16b4-4a70-a2bc-13f250c3c314 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, a40f73e2-2be7-4c6a-9103-48879b1376b3) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:54:39.503135 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-094f6f31-16b4-4a70-a2bc-13f250c3c314 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:39.503829 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-094f6f31-16b4-4a70-a2bc-13f250c3c314 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:39.509831 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-33745d9e-7ce1-4277-a4e6-91bea96b9dae None None] Network a40f73e2-2be7-4c6a-9103-48879b1376b3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:54:39.534341 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54980) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:39.539122 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-5e6e7749-d671-4e39-af1c-b1118e34902f admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-78789970-router', 'tenant_id': '1dff2c41373b452ca617836c4bf8f952', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:54:39.543411 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-094f6f31-16b4-4a70-a2bc-13f250c3c314 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.4158890 Dec 09 21:54:39.567549 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e6e7749-d671-4e39-af1c-b1118e34902f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:39.569148 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e6e7749-d671-4e39-af1c-b1118e34902f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:39.637124 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e6e7749-d671-4e39-af1c-b1118e34902f admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:39.659854 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6c05899c-eaa7-4118-aafb-179f203323f8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-a40f73e2-2be7-4c6a-9103-48879b1376b3', 'network_id': 'a40f73e2-2be7-4c6a-9103-48879b1376b3', 'project_id': '1dff2c41373b452ca617836c4bf8f952', 'fixed_ips': [{'subnet_id': '530ff632-ec21-4b96-a24b-61c4b22f4827'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:54:39.660980 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6c05899c-eaa7-4118-aafb-179f203323f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:39.877570 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e6e7749-d671-4e39-af1c-b1118e34902f admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:39.887605 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-6c05899c-eaa7-4118-aafb-179f203323f8 None None] Allocated IP 172.20.0.2 (a40f73e2-2be7-4c6a-9103-48879b1376b3/530ff632-ec21-4b96-a24b-61c4b22f4827/6493d4a3-01d6-4f58-8330-009006bd42be) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:54:39.980951 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:40.179886 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e6e7749-d671-4e39-af1c-b1118e34902f admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:40.182605 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6c05899c-eaa7-4118-aafb-179f203323f8 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:40.189400 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6c05899c-eaa7-4118-aafb-179f203323f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:40.201522 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e6e7749-d671-4e39-af1c-b1118e34902f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:40.236353 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6c05899c-eaa7-4118-aafb-179f203323f8 None None] Network a40f73e2-2be7-4c6a-9103-48879b1376b3 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:54:40.240221 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-6c05899c-eaa7-4118-aafb-179f203323f8 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:54:40.242809 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c05899c-eaa7-4118-aafb-179f203323f8 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:54:40.245436 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c05899c-eaa7-4118-aafb-179f203323f8 None None] Pushing event updated for resources: {'Port': ['ID=6493d4a3-01d6-4f58-8330-009006bd42be,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:40.304518 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6c05899c-eaa7-4118-aafb-179f203323f8 None None] Attempting to bind port 6493d4a3-01d6-4f58-8330-009006bd42be on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:54:40.305034 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6c05899c-eaa7-4118-aafb-179f203323f8 None None] Attempting to bind port 6493d4a3-01d6-4f58-8330-009006bd42be by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'd4d23ac9-b7fb-4582-aa7f-b0313907bb51', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'a40f73e2-2be7-4c6a-9103-48879b1376b3'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:54:40.306612 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c05899c-eaa7-4118-aafb-179f203323f8 None None] Attempting to bind port 6493d4a3-01d6-4f58-8330-009006bd42be on network a40f73e2-2be7-4c6a-9103-48879b1376b3 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:54:40.311919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c05899c-eaa7-4118-aafb-179f203323f8 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 54, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:54:40.312302 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c05899c-eaa7-4118-aafb-179f203323f8 None None] Checking segment: {'id': 'd4d23ac9-b7fb-4582-aa7f-b0313907bb51', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'a40f73e2-2be7-4c6a-9103-48879b1376b3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:54:40.312712 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6c05899c-eaa7-4118-aafb-179f203323f8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:40.313125 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c05899c-eaa7-4118-aafb-179f203323f8 None None] Bound using segment: {'id': 'd4d23ac9-b7fb-4582-aa7f-b0313907bb51', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'a40f73e2-2be7-4c6a-9103-48879b1376b3'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:54:40.313599 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-6c05899c-eaa7-4118-aafb-179f203323f8 None None] Bound port: 6493d4a3-01d6-4f58-8330-009006bd42be, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd4d23ac9-b7fb-4582-aa7f-b0313907bb51', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'a40f73e2-2be7-4c6a-9103-48879b1376b3'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:54:40.313993 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6c05899c-eaa7-4118-aafb-179f203323f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:40.362740 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-5e6e7749-d671-4e39-af1c-b1118e34902f admin admin] Allocated IP 172.25.3.245 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/b602231c-6ee6-4253-987e-c9855434bb2a) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:54:40.416869 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6c05899c-eaa7-4118-aafb-179f203323f8 None None] For port 6493d4a3-01d6-4f58-8330-009006bd42be, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:54:40.421250 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6c05899c-eaa7-4118-aafb-179f203323f8 None None] For port 6493d4a3-01d6-4f58-8330-009006bd42be, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6493d4a3-01d6-4f58-8330-009006bd42be,segment=NetworkSegment(d4d23ac9-b7fb-4582-aa7f-b0313907bb51),segment_id=d4d23ac9-b7fb-4582-aa7f-b0313907bb51)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:54:40.425749 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6c05899c-eaa7-4118-aafb-179f203323f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:40.485213 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c05899c-eaa7-4118-aafb-179f203323f8 None None] Pushing event updated for resources: {'Port': ['ID=6493d4a3-01d6-4f58-8330-009006bd42be,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:40.486374 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e6e7749-d671-4e39-af1c-b1118e34902f admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:40.526733 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e6e7749-d671-4e39-af1c-b1118e34902f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:40.568201 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5e6e7749-d671-4e39-af1c-b1118e34902f admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:54:40.572812 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-5e6e7749-d671-4e39-af1c-b1118e34902f admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:54:40.579286 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e6e7749-d671-4e39-af1c-b1118e34902f admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:54:40.588297 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-53620ee8-f2df-431b-9673-ff7d3a1585be None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:54:40.608998 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e6e7749-d671-4e39-af1c-b1118e34902f admin admin] Pushing event updated for resources: {'Port': ['ID=b602231c-6ee6-4253-987e-c9855434bb2a,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:40.699002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-20b494d8-d830-48b9-950a-d73fe822797a None None] Provisioning complete for port b602231c-6ee6-4253-987e-c9855434bb2a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:40.699431 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-20b494d8-d830-48b9-950a-d73fe822797a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:40.759827 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-20b494d8-d830-48b9-950a-d73fe822797a None None] Port b602231c-6ee6-4253-987e-c9855434bb2a cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:54:40.929577 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e6e7749-d671-4e39-af1c-b1118e34902f admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:41.153631 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e6e7749-d671-4e39-af1c-b1118e34902f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:41.248514 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6493d4a3-01d6-4f58-8330-009006bd42be up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:54:41.326858 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5e6e7749-d671-4e39-af1c-b1118e34902f admin admin] Router 81c166f6-53f6-46c3-94a6-18a6c1225074 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:54:41.332051 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 6493d4a3-01d6-4f58-8330-009006bd42be triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:41.332339 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:41.437711 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:41.474709 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 6493d4a3-01d6-4f58-8330-009006bd42be, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6493d4a3-01d6-4f58-8330-009006bd42be,segment=NetworkSegment(d4d23ac9-b7fb-4582-aa7f-b0313907bb51),segment_id=d4d23ac9-b7fb-4582-aa7f-b0313907bb51)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:54:41.478201 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5e6e7749-d671-4e39-af1c-b1118e34902f admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:54:41.481681 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:41.483930 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:54:41.490999 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] Sync routers for ids ['81c166f6-53f6-46c3-94a6-18a6c1225074'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:54:41.508322 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] Routers {'81c166f6-53f6-46c3-94a6-18a6c1225074'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:54:41.508944 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:54:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['81c166f6-53f6-46c3-94a6-18a6c1225074'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:41.514770 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5e6e7749-d671-4e39-af1c-b1118e34902f admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:41.516528 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5e6e7749-d671-4e39-af1c-b1118e34902f admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 1.9809849 Dec 09 21:54:41.519571 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 54992) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:41.584463 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=6493d4a3-01d6-4f58-8330-009006bd42be,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:41.596794 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:41.597360 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:41.694319 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] Set router 81c166f6-53f6-46c3-94a6-18a6c1225074 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:54:41.696168 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] Sync routers for ids ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:54:41.721299 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] Routers {'52333c17-500b-4d13-8de7-f3d9c4c6eb46'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:54:41.722031 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:54:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:41.891772 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a367e1e-b872-47ce-a06c-0b619dc0fe59 None None] Network a40f73e2-2be7-4c6a-9103-48879b1376b3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:54:41.967540 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] Set router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:54:42.035397 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '81c166f6-53f6-46c3-94a6-18a6c1225074', 'name': 'tempest-TestVolumeBootPattern-78789970-router', 'tenant_id': '1dff2c41373b452ca617836c4bf8f952', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.245'}], 'enable_snat': True}, 'gw_port_id': 'b602231c-6ee6-4253-987e-c9855434bb2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:39Z', 'updated_at': '2021-12-09T21:54:40Z', 'revision_number': 3, 'project_id': '1dff2c41373b452ca617836c4bf8f952', 'gw_port': {'id': 'b602231c-6ee6-4253-987e-c9855434bb2a', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:c9:90', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '81c166f6-53f6-46c3-94a6-18a6c1225074', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3949, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:40Z', 'updated_at': '2021-12-09T21:54:40Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:42.047369 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a738eb08-b7f2-4340-b5ac-1ac6b1eaf5ca None None] Provisioning complete for port 6493d4a3-01d6-4f58-8330-009006bd42be triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:42.047833 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a738eb08-b7f2-4340-b5ac-1ac6b1eaf5ca None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:42.077133 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] Checking router: 81c166f6-53f6-46c3-94a6-18a6c1225074 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:54:42.077799 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] Updating router 81c166f6-53f6-46c3-94a6-18a6c1225074 port b602231c-6ee6-4253-987e-c9855434bb2a binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:54:42.104041 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8bd6f3ca-416b-4771-ab81-f5ea14a7e2e9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:42.107185 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:42.295196 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-8bd6f3ca-416b-4771-ab81-f5ea14a7e2e9 admin admin] Allocated IP 172.20.0.1 (a40f73e2-2be7-4c6a-9103-48879b1376b3/530ff632-ec21-4b96-a24b-61c4b22f4827/a2a7ed1c-77f1-4378-94db-cc40981b8c34) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:54:42.348575 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'db7c12a5-60a7-41e6-ae5c-e42348c373b4', 'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'mac_address': 'fa:16:3e:79:8f:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_interface', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:36Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 2, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'subnets': [{'id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:42.385599 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] Checking router: 52333c17-500b-4d13-8de7-f3d9c4c6eb46 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:54:42.386395 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] Updating router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 port db7c12a5-60a7-41e6-ae5c-e42348c373b4 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:54:42.428728 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:42.440150 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:42.453163 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:42.480620 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8bd6f3ca-416b-4771-ab81-f5ea14a7e2e9 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:42.520496 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3b3f78f6-f1c5-4085-b8b5-b409a353eba4 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:54:42.530346 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8bd6f3ca-416b-4771-ab81-f5ea14a7e2e9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:42.536800 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eec1aea-4441-486a-ab5b-ec401163dce0 None None] Pushing event updated for resources: {'Port': ['ID=b602231c-6ee6-4253-987e-c9855434bb2a,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:42.543188 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] Attempting to bind port b602231c-6ee6-4253-987e-c9855434bb2a on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:54:42.543972 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] Attempting to bind port b602231c-6ee6-4253-987e-c9855434bb2a by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:54:42.544529 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] Attempting to bind port b602231c-6ee6-4253-987e-c9855434bb2a on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:54:42.550509 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 54, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:54:42.550886 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:54:42.551281 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:42.551692 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:54:42.552157 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] Bound port: b602231c-6ee6-4253-987e-c9855434bb2a, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:54:42.552536 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:42.570200 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8bd6f3ca-416b-4771-ab81-f5ea14a7e2e9 admin admin] Network a40f73e2-2be7-4c6a-9103-48879b1376b3 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:54:42.573845 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-8bd6f3ca-416b-4771-ab81-f5ea14a7e2e9 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:54:42.597971 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8bd6f3ca-416b-4771-ab81-f5ea14a7e2e9 admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:54:42.610962 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] For port b602231c-6ee6-4253-987e-c9855434bb2a, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:54:42.614381 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] For port b602231c-6ee6-4253-987e-c9855434bb2a, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b602231c-6ee6-4253-987e-c9855434bb2a,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:54:42.623272 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:42.648552 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bd6f3ca-416b-4771-ab81-f5ea14a7e2e9 admin admin] Pushing event updated for resources: {'Port': ['ID=a2a7ed1c-77f1-4378-94db-cc40981b8c34,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:42.657721 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3ec0b936-df23-4880-a095-a3e69772f4cf None None] Provisioning complete for port b602231c-6ee6-4253-987e-c9855434bb2a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:42.658380 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3ec0b936-df23-4880-a095-a3e69772f4cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:42.663377 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8bd6f3ca-416b-4771-ab81-f5ea14a7e2e9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:42.728636 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eec1aea-4441-486a-ab5b-ec401163dce0 None None] Pushing event updated for resources: {'Port': ['ID=b602231c-6ee6-4253-987e-c9855434bb2a,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:42.795047 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] Routers {'81c166f6-53f6-46c3-94a6-18a6c1225074'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:54:42.796307 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:54:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['81c166f6-53f6-46c3-94a6-18a6c1225074'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:42.879206 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8bd6f3ca-416b-4771-ab81-f5ea14a7e2e9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:42.984929 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da16537e-6ea7-4a57-87a8-07d898c0c042 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:54:43.022815 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3ec0b936-df23-4880-a095-a3e69772f4cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:43.032221 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] Set router 81c166f6-53f6-46c3-94a6-18a6c1225074 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:54:43.073713 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-3ec0b936-df23-4880-a095-a3e69772f4cf None None] For port b602231c-6ee6-4253-987e-c9855434bb2a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b602231c-6ee6-4253-987e-c9855434bb2a,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:54:43.085703 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:43.087279 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3ec0b936-df23-4880-a095-a3e69772f4cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:43.115577 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:43.116811 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8bd6f3ca-416b-4771-ab81-f5ea14a7e2e9 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:43.123745 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8bd6f3ca-416b-4771-ab81-f5ea14a7e2e9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:43.192819 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ec0b936-df23-4880-a095-a3e69772f4cf None None] Pushing event updated for resources: {'Port': ['ID=b602231c-6ee6-4253-987e-c9855434bb2a,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:43.248112 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6493d4a3-01d6-4f58-8330-009006bd42be up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:54:43.255278 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8bd6f3ca-416b-4771-ab81-f5ea14a7e2e9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:43.259602 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bd6f3ca-416b-4771-ab81-f5ea14a7e2e9 admin admin] Pushing event updated for resources: {'Port': ['ID=a2a7ed1c-77f1-4378-94db-cc40981b8c34,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:43.320390 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9a855068-ef0c-41f2-8760-1f51f20e6073 None None] Provisioning complete for port a2a7ed1c-77f1-4378-94db-cc40981b8c34 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:43.320754 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9a855068-ef0c-41f2-8760-1f51f20e6073 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:43.388403 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '81c166f6-53f6-46c3-94a6-18a6c1225074', 'name': 'tempest-TestVolumeBootPattern-78789970-router', 'tenant_id': '1dff2c41373b452ca617836c4bf8f952', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.245'}], 'enable_snat': True}, 'gw_port_id': 'b602231c-6ee6-4253-987e-c9855434bb2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:39Z', 'updated_at': '2021-12-09T21:54:40Z', 'revision_number': 3, 'project_id': '1dff2c41373b452ca617836c4bf8f952', 'gw_port': {'id': 'b602231c-6ee6-4253-987e-c9855434bb2a', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:c9:90', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '81c166f6-53f6-46c3-94a6-18a6c1225074', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3949, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:40Z', 'updated_at': '2021-12-09T21:54:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:43.391870 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a427df35-dfd9-41a2-b532-79df4fca0cf3 None None] Pushing event updated for resources: {'Port': ['ID=db7c12a5-60a7-41e6-ae5c-e42348c373b4,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:43.410305 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8bd6f3ca-416b-4771-ab81-f5ea14a7e2e9 admin admin] Network a40f73e2-2be7-4c6a-9103-48879b1376b3 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:54:43.411348 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] Attempting to bind port db7c12a5-60a7-41e6-ae5c-e42348c373b4 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:54:43.412002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] Attempting to bind port db7c12a5-60a7-41e6-ae5c-e42348c373b4 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:54:43.412375 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] Attempting to bind port db7c12a5-60a7-41e6-ae5c-e42348c373b4 on network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:54:43.413285 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-8bd6f3ca-416b-4771-ab81-f5ea14a7e2e9 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:54:43.432034 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 54, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:54:43.432396 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] Checking segment: {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:54:43.432806 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:43.433206 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] Bound using segment: {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:54:43.433775 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] Bound port: db7c12a5-60a7-41e6-ae5c-e42348c373b4, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:54:43.434074 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:43.435003 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ba544f0-0dbe-499c-8b12-6410125eeee9 None None] The sync data for ids ['81c166f6-53f6-46c3-94a6-18a6c1225074'] in n-d-713301-27 is: [{'id': '81c166f6-53f6-46c3-94a6-18a6c1225074', 'name': 'tempest-TestVolumeBootPattern-78789970-router', 'tenant_id': '1dff2c41373b452ca617836c4bf8f952', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.245'}], 'enable_snat': True}, 'gw_port_id': 'b602231c-6ee6-4253-987e-c9855434bb2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:39Z', 'updated_at': '2021-12-09T21:54:40Z', 'revision_number': 3, 'project_id': '1dff2c41373b452ca617836c4bf8f952', 'gw_port': {'id': 'b602231c-6ee6-4253-987e-c9855434bb2a', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:c9:90', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '81c166f6-53f6-46c3-94a6-18a6c1225074', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3949, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:40Z', 'updated_at': '2021-12-09T21:54:42Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:54:43.438962 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9a855068-ef0c-41f2-8760-1f51f20e6073 None None] Port a2a7ed1c-77f1-4378-94db-cc40981b8c34 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:54:43.502600 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 6493d4a3-01d6-4f58-8330-009006bd42be triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:43.503113 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:43.544681 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9a855068-ef0c-41f2-8760-1f51f20e6073 None None] Provisioning complete for port b602231c-6ee6-4253-987e-c9855434bb2a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:43.545173 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9a855068-ef0c-41f2-8760-1f51f20e6073 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:43.573441 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8bd6f3ca-416b-4771-ab81-f5ea14a7e2e9 admin admin] Router 81c166f6-53f6-46c3-94a6-18a6c1225074 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:54:43.665824 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] For port db7c12a5-60a7-41e6-ae5c-e42348c373b4, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:54:43.719043 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] For port db7c12a5-60a7-41e6-ae5c-e42348c373b4, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=db7c12a5-60a7-41e6-ae5c-e42348c373b4,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:54:43.741403 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:43.790964 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8bd6f3ca-416b-4771-ab81-f5ea14a7e2e9 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:54:43.802123 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8bd6f3ca-416b-4771-ab81-f5ea14a7e2e9 admin admin] 10.222.0.13 "PUT /v2.0/routers/81c166f6-53f6-46c3-94a6-18a6c1225074/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2778752 Dec 09 21:54:43.884845 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a427df35-dfd9-41a2-b532-79df4fca0cf3 None None] Pushing event updated for resources: {'Port': ['ID=db7c12a5-60a7-41e6-ae5c-e42348c373b4,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:43.892443 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] Routers {'52333c17-500b-4d13-8de7-f3d9c4c6eb46'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:54:43.893088 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:54:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:43.915341 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9a855068-ef0c-41f2-8760-1f51f20e6073 None None] Provisioning complete for port 6493d4a3-01d6-4f58-8330-009006bd42be triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:43.915540 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9a855068-ef0c-41f2-8760-1f51f20e6073 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:44.149026 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] Set router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:54:44.342751 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fa9887f7-7e91-4ad6-ac2a-03b0a3abaf3e req-18322da3-4991-4ad5-9569-6c6418c36a43 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0707955 Dec 09 21:54:44.364273 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-51aa43b0-cb96-47e2-8a9e-07f499afafee None None] Provisioning complete for port db7c12a5-60a7-41e6-ae5c-e42348c373b4 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:44.364648 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-51aa43b0-cb96-47e2-8a9e-07f499afafee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:44.446265 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9887f7-7e91-4ad6-ac2a-03b0a3abaf3e req-41e5b2a9-243f-4d41-abbe-4630b5fed39f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:44.448832 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fa9887f7-7e91-4ad6-ac2a-03b0a3abaf3e req-41e5b2a9-243f-4d41-abbe-4630b5fed39f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a1dd4ab6f25741058f3000ebf6ce1eac&device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 1098 time: 0.0535641 Dec 09 21:54:44.533187 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-51aa43b0-cb96-47e2-8a9e-07f499afafee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:44.548336 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'db7c12a5-60a7-41e6-ae5c-e42348c373b4', 'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'mac_address': 'fa:16:3e:79:8f:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_interface', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:36Z', 'updated_at': '2021-12-09T21:54:43Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'subnets': [{'id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:44.576370 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9887f7-7e91-4ad6-ac2a-03b0a3abaf3e req-cf028b99-0aa6-4590-973a-401b3cadb32d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:44.577884 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fa9887f7-7e91-4ad6-ac2a-03b0a3abaf3e req-cf028b99-0aa6-4590-973a-401b3cadb32d service neutron] 10.222.0.31 "GET /v2.0/networks?id=9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 HTTP/1.1" status: 200 len: 909 time: 0.1077287 Dec 09 21:54:44.585531 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-698068a4-a79c-4cf4-9be8-306f48aabeb1 None None] The sync data for ids ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'] in n-d-713301-27 is: [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'db7c12a5-60a7-41e6-ae5c-e42348c373b4', 'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'mac_address': 'fa:16:3e:79:8f:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_interface', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:36Z', 'updated_at': '2021-12-09T21:54:43Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'subnets': [{'id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:54:44.609981 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-51aa43b0-cb96-47e2-8a9e-07f499afafee None None] For port db7c12a5-60a7-41e6-ae5c-e42348c373b4, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=db7c12a5-60a7-41e6-ae5c-e42348c373b4,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:54:44.618808 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-51aa43b0-cb96-47e2-8a9e-07f499afafee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:44.661584 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fa9887f7-7e91-4ad6-ac2a-03b0a3abaf3e req-820c840f-e2f3-413e-8cab-b363a6c9d01a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=48ed4870-53b4-441d-92a8-1562825c8ca3 HTTP/1.1" status: 200 len: 1002 time: 0.0757854 Dec 09 21:54:44.690998 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-51aa43b0-cb96-47e2-8a9e-07f499afafee None None] Provisioning complete for port a2a7ed1c-77f1-4378-94db-cc40981b8c34 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:44.691555 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-51aa43b0-cb96-47e2-8a9e-07f499afafee None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:44.757726 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9887f7-7e91-4ad6-ac2a-03b0a3abaf3e req-cef536ec-9021-4a8d-b921-06e30b9ddda8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:44.761311 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fa9887f7-7e91-4ad6-ac2a-03b0a3abaf3e req-cef536ec-9021-4a8d-b921-06e30b9ddda8 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=912d0a1a-1b1a-4383-8291-491e8e3358fe HTTP/1.1" status: 200 len: 847 time: 0.0874710 Dec 09 21:54:44.763149 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51aa43b0-cb96-47e2-8a9e-07f499afafee None None] Pushing event updated for resources: {'Port': ['ID=db7c12a5-60a7-41e6-ae5c-e42348c373b4,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:44.788138 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-51aa43b0-cb96-47e2-8a9e-07f499afafee None None] Port a2a7ed1c-77f1-4378-94db-cc40981b8c34 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:54:44.833960 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa9887f7-7e91-4ad6-ac2a-03b0a3abaf3e req-01191957-5d0b-4fa3-8d4d-785eebc5652c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:44.835708 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fa9887f7-7e91-4ad6-ac2a-03b0a3abaf3e req-01191957-5d0b-4fa3-8d4d-785eebc5652c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0672436 Dec 09 21:54:44.994430 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fa9887f7-7e91-4ad6-ac2a-03b0a3abaf3e req-3c7983b0-4038-4d93-9a67-153a68d03d6a service neutron] 10.222.0.31 "GET /v2.0/networks/9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1509593 Dec 09 21:54:45.112087 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fa9887f7-7e91-4ad6-ac2a-03b0a3abaf3e req-8b4b4e53-dc59-4c41-a5cf-28cf6b0ac57a service neutron] 10.222.0.31 "GET /v2.0/networks/9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1084092 Dec 09 21:54:45.368102 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device db7c12a5-60a7-41e6-ae5c-e42348c373b4 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:54:45.470510 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port db7c12a5-60a7-41e6-ae5c-e42348c373b4 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:45.471120 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:45.583020 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b602231c-6ee6-4253-987e-c9855434bb2a up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:54:45.687964 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port b602231c-6ee6-4253-987e-c9855434bb2a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:45.688385 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:46.260755 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] Sync routers for ids ['81c166f6-53f6-46c3-94a6-18a6c1225074'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:54:46.272856 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] Routers {'81c166f6-53f6-46c3-94a6-18a6c1225074'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:54:46.273769 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:54:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['81c166f6-53f6-46c3-94a6-18a6c1225074'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:46.384072 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] Set router 81c166f6-53f6-46c3-94a6-18a6c1225074 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:54:46.596525 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '81c166f6-53f6-46c3-94a6-18a6c1225074', 'name': 'tempest-TestVolumeBootPattern-78789970-router', 'tenant_id': '1dff2c41373b452ca617836c4bf8f952', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.245'}], 'enable_snat': True}, 'gw_port_id': 'b602231c-6ee6-4253-987e-c9855434bb2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:39Z', 'updated_at': '2021-12-09T21:54:42Z', 'revision_number': 4, 'project_id': '1dff2c41373b452ca617836c4bf8f952', 'gw_port': {'id': 'b602231c-6ee6-4253-987e-c9855434bb2a', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:c9:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '81c166f6-53f6-46c3-94a6-18a6c1225074', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3949, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:40Z', 'updated_at': '2021-12-09T21:54:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'a2a7ed1c-77f1-4378-94db-cc40981b8c34', 'name': '', 'network_id': 'a40f73e2-2be7-4c6a-9103-48879b1376b3', 'tenant_id': '1dff2c41373b452ca617836c4bf8f952', 'mac_address': 'fa:16:3e:fa:e7:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '81c166f6-53f6-46c3-94a6-18a6c1225074', 'device_owner': 'network:router_interface', 'standard_attr_id': 3950, 'fixed_ips': [{'subnet_id': '530ff632-ec21-4b96-a24b-61c4b22f4827', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:42Z', 'updated_at': '2021-12-09T21:54:42Z', 'revision_number': 2, 'project_id': '1dff2c41373b452ca617836c4bf8f952', 'subnets': [{'id': '530ff632-ec21-4b96-a24b-61c4b22f4827', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:46.628039 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] Checking router: 81c166f6-53f6-46c3-94a6-18a6c1225074 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:54:46.628467 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] Updating router 81c166f6-53f6-46c3-94a6-18a6c1225074 port a2a7ed1c-77f1-4378-94db-cc40981b8c34 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:54:46.653898 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:46.916226 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:46.922368 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:46.970683 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c76c7d1-e2f6-4c9d-aac4-aecf64349b19 None None] Pushing event updated for resources: {'Port': ['ID=a2a7ed1c-77f1-4378-94db-cc40981b8c34,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:47.026294 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] Attempting to bind port a2a7ed1c-77f1-4378-94db-cc40981b8c34 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:54:47.026702 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] Attempting to bind port a2a7ed1c-77f1-4378-94db-cc40981b8c34 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'd4d23ac9-b7fb-4582-aa7f-b0313907bb51', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'a40f73e2-2be7-4c6a-9103-48879b1376b3'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:54:47.027059 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] Attempting to bind port a2a7ed1c-77f1-4378-94db-cc40981b8c34 on network a40f73e2-2be7-4c6a-9103-48879b1376b3 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:54:47.033465 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 54, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:54:47.033907 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] Checking segment: {'id': 'd4d23ac9-b7fb-4582-aa7f-b0313907bb51', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'a40f73e2-2be7-4c6a-9103-48879b1376b3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:54:47.034320 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:47.034740 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] Bound using segment: {'id': 'd4d23ac9-b7fb-4582-aa7f-b0313907bb51', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'a40f73e2-2be7-4c6a-9103-48879b1376b3'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:54:47.035228 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] Bound port: a2a7ed1c-77f1-4378-94db-cc40981b8c34, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd4d23ac9-b7fb-4582-aa7f-b0313907bb51', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'a40f73e2-2be7-4c6a-9103-48879b1376b3'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:54:47.035637 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:47.118931 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] For port a2a7ed1c-77f1-4378-94db-cc40981b8c34, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:54:47.124277 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] For port a2a7ed1c-77f1-4378-94db-cc40981b8c34, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a2a7ed1c-77f1-4378-94db-cc40981b8c34,segment=NetworkSegment(d4d23ac9-b7fb-4582-aa7f-b0313907bb51),segment_id=d4d23ac9-b7fb-4582-aa7f-b0313907bb51)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:54:47.134178 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:47.247280 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-441883b7-658e-4382-b101-1795194eb56b None None] Provisioning complete for port a2a7ed1c-77f1-4378-94db-cc40981b8c34 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:47.248476 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-441883b7-658e-4382-b101-1795194eb56b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:47.285493 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] Routers {'81c166f6-53f6-46c3-94a6-18a6c1225074'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:54:47.286171 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:54:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['81c166f6-53f6-46c3-94a6-18a6c1225074'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:47.374505 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-441883b7-658e-4382-b101-1795194eb56b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:47.424952 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-441883b7-658e-4382-b101-1795194eb56b None None] For port a2a7ed1c-77f1-4378-94db-cc40981b8c34, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a2a7ed1c-77f1-4378-94db-cc40981b8c34,segment=NetworkSegment(d4d23ac9-b7fb-4582-aa7f-b0313907bb51),segment_id=d4d23ac9-b7fb-4582-aa7f-b0313907bb51)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:54:47.433940 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-441883b7-658e-4382-b101-1795194eb56b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:47.476842 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] Set router 81c166f6-53f6-46c3-94a6-18a6c1225074 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:54:47.499274 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-441883b7-658e-4382-b101-1795194eb56b None None] Pushing event updated for resources: {'Port': ['ID=a2a7ed1c-77f1-4378-94db-cc40981b8c34,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:47.535035 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c76c7d1-e2f6-4c9d-aac4-aecf64349b19 None None] Pushing event updated for resources: {'Port': ['ID=a2a7ed1c-77f1-4378-94db-cc40981b8c34,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:47.590045 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-7118d648-9357-43bf-b297-8558d1597600 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:47.591712 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-7118d648-9357-43bf-b297-8558d1597600 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 810 time: 0.1858385 Dec 09 21:54:47.607714 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-df014a13-4d72-4933-9812-8195bc08875b tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/quotas/be526cfddc4f4783b993a3f6e5b5e630 HTTP/1.1" status: 200 len: 375 time: 0.0099525 Dec 09 21:54:47.663773 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-d3f46889-a171-456c-a6d3-68902f7a1a88 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0499771 Dec 09 21:54:47.665946 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-568b1e1b-2dc4-4384-936e-b9eaae843422 None None] Provisioning complete for port a2a7ed1c-77f1-4378-94db-cc40981b8c34 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:47.666402 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-568b1e1b-2dc4-4384-936e-b9eaae843422 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:47.754455 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '81c166f6-53f6-46c3-94a6-18a6c1225074', 'name': 'tempest-TestVolumeBootPattern-78789970-router', 'tenant_id': '1dff2c41373b452ca617836c4bf8f952', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.245'}], 'enable_snat': True}, 'gw_port_id': 'b602231c-6ee6-4253-987e-c9855434bb2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:39Z', 'updated_at': '2021-12-09T21:54:42Z', 'revision_number': 4, 'project_id': '1dff2c41373b452ca617836c4bf8f952', 'gw_port': {'id': 'b602231c-6ee6-4253-987e-c9855434bb2a', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:c9:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '81c166f6-53f6-46c3-94a6-18a6c1225074', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3949, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:40Z', 'updated_at': '2021-12-09T21:54:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'a2a7ed1c-77f1-4378-94db-cc40981b8c34', 'name': '', 'network_id': 'a40f73e2-2be7-4c6a-9103-48879b1376b3', 'tenant_id': '1dff2c41373b452ca617836c4bf8f952', 'mac_address': 'fa:16:3e:fa:e7:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '81c166f6-53f6-46c3-94a6-18a6c1225074', 'device_owner': 'network:router_interface', 'standard_attr_id': 3950, 'fixed_ips': [{'subnet_id': '530ff632-ec21-4b96-a24b-61c4b22f4827', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:42Z', 'updated_at': '2021-12-09T21:54:47Z', 'revision_number': 4, 'project_id': '1dff2c41373b452ca617836c4bf8f952', 'subnets': [{'id': '530ff632-ec21-4b96-a24b-61c4b22f4827', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:47.792744 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5016db4c-055f-4127-9417-7cf1aa8fb8c6 None None] The sync data for ids ['81c166f6-53f6-46c3-94a6-18a6c1225074'] in n-d-713301-27 is: [{'id': '81c166f6-53f6-46c3-94a6-18a6c1225074', 'name': 'tempest-TestVolumeBootPattern-78789970-router', 'tenant_id': '1dff2c41373b452ca617836c4bf8f952', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.245'}], 'enable_snat': True}, 'gw_port_id': 'b602231c-6ee6-4253-987e-c9855434bb2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:39Z', 'updated_at': '2021-12-09T21:54:42Z', 'revision_number': 4, 'project_id': '1dff2c41373b452ca617836c4bf8f952', 'gw_port': {'id': 'b602231c-6ee6-4253-987e-c9855434bb2a', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:c9:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '81c166f6-53f6-46c3-94a6-18a6c1225074', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3949, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:40Z', 'updated_at': '2021-12-09T21:54:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'a2a7ed1c-77f1-4378-94db-cc40981b8c34', 'name': '', 'network_id': 'a40f73e2-2be7-4c6a-9103-48879b1376b3', 'tenant_id': '1dff2c41373b452ca617836c4bf8f952', 'mac_address': 'fa:16:3e:fa:e7:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '81c166f6-53f6-46c3-94a6-18a6c1225074', 'device_owner': 'network:router_interface', 'standard_attr_id': 3950, 'fixed_ips': [{'subnet_id': '530ff632-ec21-4b96-a24b-61c4b22f4827', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:42Z', 'updated_at': '2021-12-09T21:54:47Z', 'revision_number': 4, 'project_id': '1dff2c41373b452ca617836c4bf8f952', 'subnets': [{'id': '530ff632-ec21-4b96-a24b-61c4b22f4827', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:54:47.899743 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-4e1cd268-9cd7-41a3-88ab-01631ae43a9c service neutron] 10.222.0.13 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2277455 Dec 09 21:54:48.004809 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-6ffe8940-e19d-440b-8162-0a554418b917 service neutron] 10.222.0.13 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0987685 Dec 09 21:54:48.353669 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-299ce583-8657-4c02-8cf1-0b31f0ab261b req-3baa707c-6d17-426a-93d6-2eb7a3ac60ea tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 210 time: 0.0366552 Dec 09 21:54:49.206146 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a2a7ed1c-77f1-4378-94db-cc40981b8c34 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:54:49.256276 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port a2a7ed1c-77f1-4378-94db-cc40981b8c34 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:49.256747 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:49.485892 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5ed48fa6-2a31-4c8e-8cef-9fcda4eb0c74 req-be28548a-735b-4b0e-b0ca-03814b971452 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 210 time: 0.0438297 Dec 09 21:54:49.623028 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-1c7bb277-2f61-42ad-bee4-96aaf7bee798 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:49.625116 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-1c7bb277-2f61-42ad-bee4-96aaf7bee798 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.10 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 810 time: 0.1373999 Dec 09 21:54:49.638554 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-05014169-50a0-440e-b03a-bb2c8b8366ec tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Request body: {'port': {'device_id': 'aa8d4704-dab9-4d12-971a-6330f2fb603a', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'admin_state_up': True, 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:54:49.762504 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-05014169-50a0-440e-b03a-bb2c8b8366ec tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Made reservation on behalf of be526cfddc4f4783b993a3f6e5b5e630 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:54:49.768928 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-05014169-50a0-440e-b03a-bb2c8b8366ec tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:49.914399 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-05014169-50a0-440e-b03a-bb2c8b8366ec tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Allocated IP 172.20.0.5 (486ad174-ad0c-4065-a4b6-6f9af6b2a208/7004626f-deda-4ef1-8abe-97a447b2d2e9/97360c49-325c-47af-8916-2e920bf107d3) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:54:50.505350 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-05014169-50a0-440e-b03a-bb2c8b8366ec tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:50.544571 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-05014169-50a0-440e-b03a-bb2c8b8366ec tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:50.623661 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-05014169-50a0-440e-b03a-bb2c8b8366ec tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:54:50.627700 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05014169-50a0-440e-b03a-bb2c8b8366ec tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event updated for resources: {'Port': ['ID=97360c49-325c-47af-8916-2e920bf107d3,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:50.631042 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-05014169-50a0-440e-b03a-bb2c8b8366ec tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:54:50.634161 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-05014169-50a0-440e-b03a-bb2c8b8366ec tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:54:50.687337 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef975ada-6dd7-409a-bf99-4dc5962cc5f3 req-4f8ca388-db61-40e1-8bb0-d5901b21e30a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:50.688949 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef975ada-6dd7-409a-bf99-4dc5962cc5f3 req-4f8ca388-db61-40e1-8bb0-d5901b21e30a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 931 time: 0.1145368 Dec 09 21:54:50.718790 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-05014169-50a0-440e-b03a-bb2c8b8366ec tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:50.719474 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-05014169-50a0-440e-b03a-bb2c8b8366ec tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:50.748058 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-05014169-50a0-440e-b03a-bb2c8b8366ec tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1136184 Dec 09 21:54:50.760895 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-bcad093c-c77f-4e67-a2f8-60e4d407457b service neutron] Request body: {'port': {'device_id': 'aa8d4704-dab9-4d12-971a-6330f2fb603a', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:54:50.791685 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef975ada-6dd7-409a-bf99-4dc5962cc5f3 req-21224bd8-a093-49e4-a45b-e89f31af8ac7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0961864 Dec 09 21:54:50.850685 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-bcad093c-c77f-4e67-a2f8-60e4d407457b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:51.001133 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-fd79f50e-934d-429f-a42c-93695594b030 None None] Provisioning complete for port 97360c49-325c-47af-8916-2e920bf107d3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:51.002222 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fd79f50e-934d-429f-a42c-93695594b030 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:51.036722 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-fd79f50e-934d-429f-a42c-93695594b030 None None] Port 97360c49-325c-47af-8916-2e920bf107d3 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:54:51.158574 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-bcad093c-c77f-4e67-a2f8-60e4d407457b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 97360c49-325c-47af-8916-2e920bf107d3 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:54:51.166961 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-bcad093c-c77f-4e67-a2f8-60e4d407457b service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:51.179964 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-bcad093c-c77f-4e67-a2f8-60e4d407457b service neutron] Transition to ACTIVE for port object 97360c49-325c-47af-8916-2e920bf107d3 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:54:51.183883 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-bcad093c-c77f-4e67-a2f8-60e4d407457b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:51.198333 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:54:51.232314 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcad093c-c77f-4e67-a2f8-60e4d407457b service neutron] Pushing event updated for resources: {'Port': ['ID=97360c49-325c-47af-8916-2e920bf107d3,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:51.327087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-bcad093c-c77f-4e67-a2f8-60e4d407457b service neutron] Attempting to bind port 97360c49-325c-47af-8916-2e920bf107d3 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:54:51.327620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-bcad093c-c77f-4e67-a2f8-60e4d407457b service neutron] Attempting to bind port 97360c49-325c-47af-8916-2e920bf107d3 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:54:51.327989 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-bcad093c-c77f-4e67-a2f8-60e4d407457b service neutron] Attempting to bind port 97360c49-325c-47af-8916-2e920bf107d3 on network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:54:51.333920 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-bcad093c-c77f-4e67-a2f8-60e4d407457b service neutron] Port 97360c49-325c-47af-8916-2e920bf107d3 on network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:54:51.334242 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-bcad093c-c77f-4e67-a2f8-60e4d407457b service neutron] Attempting to bind port 97360c49-325c-47af-8916-2e920bf107d3 on network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:54:51.340169 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-bcad093c-c77f-4e67-a2f8-60e4d407457b service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 54, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:54:51.340731 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-bcad093c-c77f-4e67-a2f8-60e4d407457b service neutron] Checking segment: {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:54:51.341512 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-bcad093c-c77f-4e67-a2f8-60e4d407457b service neutron] Bound using segment: {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:54:51.342364 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-bcad093c-c77f-4e67-a2f8-60e4d407457b service neutron] Bound port: 97360c49-325c-47af-8916-2e920bf107d3, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:54:51.343177 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-bcad093c-c77f-4e67-a2f8-60e4d407457b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:51.419027 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-bcad093c-c77f-4e67-a2f8-60e4d407457b service neutron] For port 97360c49-325c-47af-8916-2e920bf107d3, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:54:51.423491 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-bcad093c-c77f-4e67-a2f8-60e4d407457b service neutron] For port 97360c49-325c-47af-8916-2e920bf107d3, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=97360c49-325c-47af-8916-2e920bf107d3,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:54:51.429474 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-bcad093c-c77f-4e67-a2f8-60e4d407457b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:51.468531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-bcad093c-c77f-4e67-a2f8-60e4d407457b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:51.469160 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-bcad093c-c77f-4e67-a2f8-60e4d407457b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:51.470530 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-bcad093c-c77f-4e67-a2f8-60e4d407457b service neutron] 10.222.0.10 "PUT /v2.0/ports/97360c49-325c-47af-8916-2e920bf107d3 HTTP/1.1" status: 200 len: 1092 time: 0.7139175 Dec 09 21:54:51.470971 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'aa8d4704-dab9-4d12-971a-6330f2fb603a', 'tag': '97360c49-325c-47af-8916-2e920bf107d3'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:54:51.473270 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bd8665b5-6ea3-429e-908b-36480e4aa1a2" -d '{"events": [{"name": "network-changed", "server_uuid": "aa8d4704-dab9-4d12-971a-6330f2fb603a", "tag": "97360c49-325c-47af-8916-2e920bf107d3"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:54:51.495980 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcad093c-c77f-4e67-a2f8-60e4d407457b service neutron] Pushing event updated for resources: {'Port': ['ID=97360c49-325c-47af-8916-2e920bf107d3,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:51.546186 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:54:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7ababb58-0ec2-43fd-8c60-6cb2fed438b8 x-openstack-request-id: req-7ababb58-0ec2-43fd-8c60-6cb2fed438b8 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:54:51.546918 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "aa8d4704-dab9-4d12-971a-6330f2fb603a", "tag": "97360c49-325c-47af-8916-2e920bf107d3", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:54:51.546918 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-7ababb58-0ec2-43fd-8c60-6cb2fed438b8 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:54:51.547163 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'aa8d4704-dab9-4d12-971a-6330f2fb603a', 'tag': '97360c49-325c-47af-8916-2e920bf107d3', 'status': 'completed', 'code': 200} Dec 09 21:54:51.563761 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-18a67867-3839-4cf8-baca-0a773fa3bda5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:51.565292 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-18a67867-3839-4cf8-baca-0a773fa3bda5 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 1095 time: 0.0483685 Dec 09 21:54:51.613489 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-802fb149-f789-4ba3-8c29-b93458fa9371 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=97360c49-325c-47af-8916-2e920bf107d3 HTTP/1.1" status: 200 len: 217 time: 0.0395262 Dec 09 21:54:51.667461 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-e4e3b2c2-b643-4a38-89c1-f647135e18e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:51.669281 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-e4e3b2c2-b643-4a38-89c1-f647135e18e0 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0488012 Dec 09 21:54:51.717543 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-c3763e85-3bb2-4836-ad0c-dd2fe4359e00 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:51.719080 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-c3763e85-3bb2-4836-ad0c-dd2fe4359e00 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0426846 Dec 09 21:54:51.819274 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-fabb7d60-d3f4-470e-ac3f-57043a9719b8 service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0926111 Dec 09 21:54:51.951337 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bc4b7bc-ad33-41b2-9258-3917d68a6010 req-74474790-14fc-4a9b-90a0-c550b89102db service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1246569 Dec 09 21:54:51.962249 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c475c7bf-3e5f-43aa-bc0b-114d949af2ae req-2b7e287d-da02-4091-9f78-740cac6746ac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:51.964071 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c475c7bf-3e5f-43aa-bc0b-114d949af2ae req-2b7e287d-da02-4091-9f78-740cac6746ac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 943 time: 0.0775950 Dec 09 21:54:52.034947 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c475c7bf-3e5f-43aa-bc0b-114d949af2ae req-68af1fee-7ad0-4ddd-aef2-c613812597d1 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0570970 Dec 09 21:54:52.064723 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd8665b5-6ea3-429e-908b-36480e4aa1a2 req-06d6ddbe-db82-400b-a24d-adb5caf710a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:52.066278 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd8665b5-6ea3-429e-908b-36480e4aa1a2 req-06d6ddbe-db82-400b-a24d-adb5caf710a3 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 1095 time: 0.0470586 Dec 09 21:54:52.168028 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd8665b5-6ea3-429e-908b-36480e4aa1a2 req-9f5fcc7d-4574-422f-ac58-6b5f2d039d4f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:52.169915 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd8665b5-6ea3-429e-908b-36480e4aa1a2 req-9f5fcc7d-4574-422f-ac58-6b5f2d039d4f service neutron] 10.222.0.10 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 911 time: 0.0970631 Dec 09 21:54:52.213201 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd8665b5-6ea3-429e-908b-36480e4aa1a2 req-b5eeb91d-de4e-474e-a395-c542dc5a6285 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=97360c49-325c-47af-8916-2e920bf107d3 HTTP/1.1" status: 200 len: 217 time: 0.0360451 Dec 09 21:54:52.267024 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd8665b5-6ea3-429e-908b-36480e4aa1a2 req-17e1e5af-970e-4d9d-9918-17aa99c0c2f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:52.268570 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd8665b5-6ea3-429e-908b-36480e4aa1a2 req-17e1e5af-970e-4d9d-9918-17aa99c0c2f9 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0453420 Dec 09 21:54:52.322263 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd8665b5-6ea3-429e-908b-36480e4aa1a2 req-4ef39600-2c51-441a-a19f-73edc7e5836b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:52.323838 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd8665b5-6ea3-429e-908b-36480e4aa1a2 req-4ef39600-2c51-441a-a19f-73edc7e5836b service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0481176 Dec 09 21:54:52.415692 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd8665b5-6ea3-429e-908b-36480e4aa1a2 req-530cd04a-fdbd-45ed-8aa3-555f54fb1aa7 service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0834436 Dec 09 21:54:52.509384 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd8665b5-6ea3-429e-908b-36480e4aa1a2 req-d4d9df04-2c1c-4555-acd1-304c6bf8bf28 service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0866861 Dec 09 21:54:53.158889 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52983afd-9f40-4611-a1f2-17eccfb61654 req-b7bd7502-9209-4ead-86ff-018cf6f7ed0d tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:53.160432 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52983afd-9f40-4611-a1f2-17eccfb61654 req-b7bd7502-9209-4ead-86ff-018cf6f7ed0d tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 943 time: 0.0515258 Dec 09 21:54:53.211282 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52983afd-9f40-4611-a1f2-17eccfb61654 req-f8232756-d0cb-4e00-bd22-59783264868c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439658 Dec 09 21:54:54.333520 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61a29a31-b45d-4717-89b1-a4f358e751db req-c748ddc8-ded1-4204-b516-4fd1c60e4cb9 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:54.335064 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-61a29a31-b45d-4717-89b1-a4f358e751db req-c748ddc8-ded1-4204-b516-4fd1c60e4cb9 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 943 time: 0.0518219 Dec 09 21:54:54.390780 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-61a29a31-b45d-4717-89b1-a4f358e751db req-d2e97da5-e186-402c-8f2c-573e5bb875ae tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0490146 Dec 09 21:54:55.513436 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8aeafb9-332c-406e-804c-70436df3d21e req-3fb94cca-1dd3-4690-881c-300aec18a63a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:55.520407 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8aeafb9-332c-406e-804c-70436df3d21e req-3fb94cca-1dd3-4690-881c-300aec18a63a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 943 time: 0.0566995 Dec 09 21:54:55.571390 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8aeafb9-332c-406e-804c-70436df3d21e req-97a5de32-447d-47ec-859c-6be2bce4177c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500221 Dec 09 21:54:56.163698 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55118) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:56.214699 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-d7906e59-c23a-477e-8e4c-e072ecdc1c16 admin admin] Deleting subnet 938dec21-7b2e-4de4-a129-71c1f3ba1dd6 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:54:56.218256 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d7906e59-c23a-477e-8e4c-e072ecdc1c16 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:56.254147 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d7906e59-c23a-477e-8e4c-e072ecdc1c16 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:56.302874 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d7906e59-c23a-477e-8e4c-e072ecdc1c16 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:56.363810 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d7906e59-c23a-477e-8e4c-e072ecdc1c16 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:56.389258 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7906e59-c23a-477e-8e4c-e072ecdc1c16 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=938dec21-7b2e-4de4-a129-71c1f3ba1dd6,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:56.395080 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d7906e59-c23a-477e-8e4c-e072ecdc1c16 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:56.398417 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d7906e59-c23a-477e-8e4c-e072ecdc1c16 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/938dec21-7b2e-4de4-a129-71c1f3ba1dd6 HTTP/1.1" status: 204 len: 168 time: 0.2335093 Dec 09 21:54:56.401034 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55120) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:56.468725 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b135063b-8e62-4c3e-89b6-1687fc447d58 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:56.552902 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b135063b-8e62-4c3e-89b6-1687fc447d58 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:56.573593 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-b135063b-8e62-4c3e-89b6-1687fc447d58 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:56.582950 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-b135063b-8e62-4c3e-89b6-1687fc447d58 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:56.583248 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-b135063b-8e62-4c3e-89b6-1687fc447d58 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fd1870db-f3b3-4bf8-9a31-f4f0b4c9c1e8') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:54:56.593681 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b135063b-8e62-4c3e-89b6-1687fc447d58 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:56.608220 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b135063b-8e62-4c3e-89b6-1687fc447d58 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:56.614938 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b135063b-8e62-4c3e-89b6-1687fc447d58 admin admin] Releasing vlan 139 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:54:56.615396 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b135063b-8e62-4c3e-89b6-1687fc447d58 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:54:56.617065 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:54:56.684508 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b135063b-8e62-4c3e-89b6-1687fc447d58 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:56.710434 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b135063b-8e62-4c3e-89b6-1687fc447d58 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:56.713909 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b135063b-8e62-4c3e-89b6-1687fc447d58 admin admin] 10.222.0.13 "DELETE /v2.0/networks/eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a HTTP/1.1" status: 204 len: 168 time: 0.3117845 Dec 09 21:54:56.727511 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b135063b-8e62-4c3e-89b6-1687fc447d58 admin admin] Pushing event deleted for resources: {'Network': ['ID=eaebdf79-e0f8-4d5e-a139-ec71c53e2f4a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:56.752523 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11407537-5db4-4df8-bb2b-af18b2d782c4 req-d9003be2-d9f8-4c6d-87a4-268bc079ca34 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:56.754165 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11407537-5db4-4df8-bb2b-af18b2d782c4 req-d9003be2-d9f8-4c6d-87a4-268bc079ca34 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 943 time: 0.0890574 Dec 09 21:54:56.820058 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11407537-5db4-4df8-bb2b-af18b2d782c4 req-1583bc0e-482c-4d88-b890-b736ac58c21c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0563886 Dec 09 21:54:56.918649 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55126) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:56.962876 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7d79f005-9d9e-4166-8484-fcac54f2e0b5 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=2671ed6f9fdf4c9cb0e0438099319f7d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0429204 Dec 09 21:54:56.965509 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55128) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:57.023166 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a41431f0-d720-48a7-b16f-3f18d56f7b2c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:57.045558 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a41431f0-d720-48a7-b16f-3f18d56f7b2c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:57.105255 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a41431f0-d720-48a7-b16f-3f18d56f7b2c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:57.108953 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a41431f0-d720-48a7-b16f-3f18d56f7b2c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:57.110108 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a41431f0-d720-48a7-b16f-3f18d56f7b2c admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/ce5c7bc1-de04-4060-901f-bf2612c44351 HTTP/1.1" status: 204 len: 168 time: 0.1435905 Dec 09 21:54:57.119172 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a41431f0-d720-48a7-b16f-3f18d56f7b2c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ce5c7bc1-de04-4060-901f-bf2612c44351,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:57.366208 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:57.606776 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:57.837496 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55150) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:57.941695 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-7306584f-13d7-4561-9240-265c577a81bb admin admin] Request body: {'network': {'name': 'tempest-TestServerMultinode-702334193-network', 'tenant_id': '371f1d86e2f94da5bb1809b41a9eba58'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:54:57.944565 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1644332c-fd6d-4b82-8adc-786e898891f3 req-348097fe-f1c6-44f1-8c5f-4a28cc4ce297 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:57.946080 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1644332c-fd6d-4b82-8adc-786e898891f3 req-348097fe-f1c6-44f1-8c5f-4a28cc4ce297 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 943 time: 0.0506568 Dec 09 21:54:57.964325 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7306584f-13d7-4561-9240-265c577a81bb admin admin] Made reservation on behalf of 371f1d86e2f94da5bb1809b41a9eba58 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:54:57.966769 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7306584f-13d7-4561-9240-265c577a81bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:57.975149 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7306584f-13d7-4561-9240-265c577a81bb admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:57.999990 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1644332c-fd6d-4b82-8adc-786e898891f3 req-f2f2b772-8c90-4772-b341-b38dfec61fee tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471809 Dec 09 21:54:58.053513 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7306584f-13d7-4561-9240-265c577a81bb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:58.059309 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7306584f-13d7-4561-9240-265c577a81bb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:58.084222 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7306584f-13d7-4561-9240-265c577a81bb admin admin] vlan segment allocate from pool success with {'vlan_id': 136, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:54:58.093350 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7306584f-13d7-4561-9240-265c577a81bb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=17ebf86b-a339-4100-a365-5b5aa7323016,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:58.099955 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7306584f-13d7-4561-9240-265c577a81bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:58.100338 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-7306584f-13d7-4561-9240-265c577a81bb admin admin] Added segment 0d6ecccc-88ae-48f3-a22d-f126ecb40d84 of type vlan for network 942064c7-756f-4754-a77d-0fafe38ff60f Dec 09 21:54:58.143008 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7306584f-13d7-4561-9240-265c577a81bb admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:58.171037 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7306584f-13d7-4561-9240-265c577a81bb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:58.172055 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7306584f-13d7-4561-9240-265c577a81bb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:58.172668 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7306584f-13d7-4561-9240-265c577a81bb admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:58.202815 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7306584f-13d7-4561-9240-265c577a81bb admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.3641710 Dec 09 21:54:58.205887 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55156) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:58.210892 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-2e3a1b97-e14d-444a-85eb-8b27b1d01ec4 admin admin] Request body: {'subnet': {'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerMultinode-702334193-subnet', 'tenant_id': '371f1d86e2f94da5bb1809b41a9eba58', 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:54:58.233533 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e3a1b97-e14d-444a-85eb-8b27b1d01ec4 admin admin] Made reservation on behalf of 371f1d86e2f94da5bb1809b41a9eba58 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:54:58.236281 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e3a1b97-e14d-444a-85eb-8b27b1d01ec4 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:58.236418 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7306584f-13d7-4561-9240-265c577a81bb admin admin] Pushing event updated for resources: {'Network': ['ID=942064c7-756f-4754-a77d-0fafe38ff60f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:58.246711 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 942064c7-756f-4754-a77d-0fafe38ff60f details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:54:58.407898 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e3a1b97-e14d-444a-85eb-8b27b1d01ec4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:58.461275 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e3a1b97-e14d-444a-85eb-8b27b1d01ec4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=052fcd50-6803-4f87-8dfb-d2c1cc2fb02e,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:58.477717 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e3a1b97-e14d-444a-85eb-8b27b1d01ec4 admin admin] Checking segment: {'id': '0d6ecccc-88ae-48f3-a22d-f126ecb40d84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:54:58.478060 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e3a1b97-e14d-444a-85eb-8b27b1d01ec4 admin admin] Network hostable DHCP agents. Network: 942064c7-756f-4754-a77d-0fafe38ff60f, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:54:58.498990 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e3a1b97-e14d-444a-85eb-8b27b1d01ec4 admin admin] Network 942064c7-756f-4754-a77d-0fafe38ff60f is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:54:58.508959 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-2e3a1b97-e14d-444a-85eb-8b27b1d01ec4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 942064c7-756f-4754-a77d-0fafe38ff60f) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:54:58.513762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e3a1b97-e14d-444a-85eb-8b27b1d01ec4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:58.514349 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2e3a1b97-e14d-444a-85eb-8b27b1d01ec4 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:58.518880 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e6e27f5-ddb5-4738-ae46-eedab79d5c34 None None] Network 942064c7-756f-4754-a77d-0fafe38ff60f requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:54:58.533873 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2e3a1b97-e14d-444a-85eb-8b27b1d01ec4 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3268380 Dec 09 21:54:58.536790 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55158) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:54:58.541442 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-c5a7aab0-9d40-41c8-a6e2-4e95d01d73c4 admin admin] Request body: {'router': {'name': 'tempest-TestServerMultinode-702334193-router', 'tenant_id': '371f1d86e2f94da5bb1809b41a9eba58', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:54:58.564064 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c5a7aab0-9d40-41c8-a6e2-4e95d01d73c4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:58.565172 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c5a7aab0-9d40-41c8-a6e2-4e95d01d73c4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:58.618143 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c5a7aab0-9d40-41c8-a6e2-4e95d01d73c4 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:58.620917 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-942064c7-756f-4754-a77d-0fafe38ff60f', 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f', 'project_id': '371f1d86e2f94da5bb1809b41a9eba58', 'fixed_ips': [{'subnet_id': '052fcd50-6803-4f87-8dfb-d2c1cc2fb02e'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:54:58.622286 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:58.757465 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c5a7aab0-9d40-41c8-a6e2-4e95d01d73c4 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:58.759651 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Allocated IP 172.20.0.2 (942064c7-756f-4754-a77d-0fafe38ff60f/052fcd50-6803-4f87-8dfb-d2c1cc2fb02e/d066a8c3-8cbd-453f-83f3-7b3674bc42ba) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:54:58.961374 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c5a7aab0-9d40-41c8-a6e2-4e95d01d73c4 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:58.985104 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c5a7aab0-9d40-41c8-a6e2-4e95d01d73c4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:59.078948 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:59.086491 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:59.092513 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-c5a7aab0-9d40-41c8-a6e2-4e95d01d73c4 admin admin] Allocated IP 172.25.3.13 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/1e06e036-0c04-4ded-b403-9e482e494971) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:54:59.124397 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Network 942064c7-756f-4754-a77d-0fafe38ff60f is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:54:59.127514 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:54:59.129867 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19bba8b5-53f3-4647-b676-787ff9632adb req-3437a7ee-02c5-4a0e-8d2b-6c0a92af2ca7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:54:59.132018 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19bba8b5-53f3-4647-b676-787ff9632adb req-3437a7ee-02c5-4a0e-8d2b-6c0a92af2ca7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 943 time: 0.0606344 Dec 09 21:54:59.133141 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:54:59.138919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Pushing event updated for resources: {'Port': ['ID=d066a8c3-8cbd-453f-83f3-7b3674bc42ba,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:59.153305 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:59.153777 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:59.154118 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:59.154458 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:59.154787 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:59.155698 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:59.156039 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:59.156367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:59.156695 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:59.157493 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:59.157909 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:59.158372 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:59.158908 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:54:59.191818 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19bba8b5-53f3-4647-b676-787ff9632adb req-ad7de133-6832-47fc-8c71-a693ec98b59d tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503130 Dec 09 21:54:59.206929 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c5a7aab0-9d40-41c8-a6e2-4e95d01d73c4 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:59.211038 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Attempting to bind port d066a8c3-8cbd-453f-83f3-7b3674bc42ba on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:54:59.211410 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Attempting to bind port d066a8c3-8cbd-453f-83f3-7b3674bc42ba by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '0d6ecccc-88ae-48f3-a22d-f126ecb40d84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:54:59.211914 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Attempting to bind port d066a8c3-8cbd-453f-83f3-7b3674bc42ba on network 942064c7-756f-4754-a77d-0fafe38ff60f {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:54:59.217673 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 54, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:54:59.218057 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Checking segment: {'id': '0d6ecccc-88ae-48f3-a22d-f126ecb40d84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:54:59.218463 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:59.218860 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Bound using segment: {'id': '0d6ecccc-88ae-48f3-a22d-f126ecb40d84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:54:59.219330 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Bound port: d066a8c3-8cbd-453f-83f3-7b3674bc42ba, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0d6ecccc-88ae-48f3-a22d-f126ecb40d84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:54:59.219787 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:59.240566 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c5a7aab0-9d40-41c8-a6e2-4e95d01d73c4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:59.278358 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5a7aab0-9d40-41c8-a6e2-4e95d01d73c4 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:54:59.281252 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-c5a7aab0-9d40-41c8-a6e2-4e95d01d73c4 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:54:59.281711 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] For port d066a8c3-8cbd-453f-83f3-7b3674bc42ba, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:54:59.286866 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5a7aab0-9d40-41c8-a6e2-4e95d01d73c4 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:54:59.289466 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] For port d066a8c3-8cbd-453f-83f3-7b3674bc42ba, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d066a8c3-8cbd-453f-83f3-7b3674bc42ba,segment=NetworkSegment(0d6ecccc-88ae-48f3-a22d-f126ecb40d84),segment_id=0d6ecccc-88ae-48f3-a22d-f126ecb40d84)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:54:59.292419 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5a7aab0-9d40-41c8-a6e2-4e95d01d73c4 admin admin] Pushing event updated for resources: {'Port': ['ID=1e06e036-0c04-4ded-b403-9e482e494971,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:59.294927 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04cc35d1-7c6e-45b2-b393-0c953c9483d5 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:54:59.299421 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:59.373890 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-614dce7f-0607-4107-bea7-4da2e39f5934 None None] Pushing event updated for resources: {'Port': ['ID=d066a8c3-8cbd-453f-83f3-7b3674bc42ba,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:54:59.384863 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a3dbfe6b-3a07-49fc-ba3b-40a74e3c5e28 None None] Provisioning complete for port 1e06e036-0c04-4ded-b403-9e482e494971 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:54:59.385458 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a3dbfe6b-3a07-49fc-ba3b-40a74e3c5e28 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:54:59.428764 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a3dbfe6b-3a07-49fc-ba3b-40a74e3c5e28 None None] Port 1e06e036-0c04-4ded-b403-9e482e494971 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:54:59.567680 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c5a7aab0-9d40-41c8-a6e2-4e95d01d73c4 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:00.116502 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c5a7aab0-9d40-41c8-a6e2-4e95d01d73c4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:00.256073 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fea55399-bdff-462e-a142-de4ae816169e None None] Network 942064c7-756f-4754-a77d-0fafe38ff60f requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:55:00.269495 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c5a7aab0-9d40-41c8-a6e2-4e95d01d73c4 admin admin] Router f3e7ff9a-b5b4-4721-82b3-7d8488ad0844 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:55:00.345030 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb2e0642-2295-467d-984f-3fc3f691f479 req-dacc7c75-a0f4-4157-b451-f31675f2c7c9 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:00.348177 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bb2e0642-2295-467d-984f-3fc3f691f479 req-dacc7c75-a0f4-4157-b451-f31675f2c7c9 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 943 time: 0.0696473 Dec 09 21:55:00.377311 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d1032796-51e9-448c-8df2-7c015d6b4543 None None] Provisioning complete for port d066a8c3-8cbd-453f-83f3-7b3674bc42ba triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:00.377685 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d1032796-51e9-448c-8df2-7c015d6b4543 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:00.396637 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c5a7aab0-9d40-41c8-a6e2-4e95d01d73c4 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:55:00.413277 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bb2e0642-2295-467d-984f-3fc3f691f479 req-3d376454-76c1-413c-bc2f-e9abf03f6d34 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0566144 Dec 09 21:55:00.413637 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] Sync routers for ids ['f3e7ff9a-b5b4-4721-82b3-7d8488ad0844'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:55:00.417928 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c5a7aab0-9d40-41c8-a6e2-4e95d01d73c4 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:00.419777 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c5a7aab0-9d40-41c8-a6e2-4e95d01d73c4 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 1.8816907 Dec 09 21:55:00.427668 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55164) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:55:00.442385 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] Routers {'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:55:00.443065 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:54:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f3e7ff9a-b5b4-4721-82b3-7d8488ad0844'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:00.540736 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d1032796-51e9-448c-8df2-7c015d6b4543 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:00.617922 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-d1032796-51e9-448c-8df2-7c015d6b4543 None None] For port d066a8c3-8cbd-453f-83f3-7b3674bc42ba, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d066a8c3-8cbd-453f-83f3-7b3674bc42ba,segment=NetworkSegment(0d6ecccc-88ae-48f3-a22d-f126ecb40d84),segment_id=0d6ecccc-88ae-48f3-a22d-f126ecb40d84)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:00.625242 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d1032796-51e9-448c-8df2-7c015d6b4543 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:00.629687 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] Set router f3e7ff9a-b5b4-4721-82b3-7d8488ad0844 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:55:00.805013 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1032796-51e9-448c-8df2-7c015d6b4543 None None] Pushing event updated for resources: {'Port': ['ID=d066a8c3-8cbd-453f-83f3-7b3674bc42ba,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:00.816622 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-18ff24ed-e751-41d8-b4e5-05f1795aba12 None None] Provisioning complete for port d066a8c3-8cbd-453f-83f3-7b3674bc42ba triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:00.817010 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-18ff24ed-e751-41d8-b4e5-05f1795aba12 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:00.904970 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-288c14cb-83a2-44af-b51b-3137fb636341 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:00.951963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844', 'name': 'tempest-TestServerMultinode-702334193-router', 'tenant_id': '371f1d86e2f94da5bb1809b41a9eba58', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.13'}], 'enable_snat': True}, 'gw_port_id': '1e06e036-0c04-4ded-b403-9e482e494971', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:58Z', 'updated_at': '2021-12-09T21:54:59Z', 'revision_number': 3, 'project_id': '371f1d86e2f94da5bb1809b41a9eba58', 'gw_port': {'id': '1e06e036-0c04-4ded-b403-9e482e494971', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d6:42:8c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:58Z', 'updated_at': '2021-12-09T21:54:59Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:00.983825 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] Checking router: f3e7ff9a-b5b4-4721-82b3-7d8488ad0844 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:55:00.984194 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] Updating router f3e7ff9a-b5b4-4721-82b3-7d8488ad0844 port 1e06e036-0c04-4ded-b403-9e482e494971 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:55:01.010603 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:01.077547 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-288c14cb-83a2-44af-b51b-3137fb636341 admin admin] Allocated IP 172.20.0.1 (942064c7-756f-4754-a77d-0fafe38ff60f/052fcd50-6803-4f87-8dfb-d2c1cc2fb02e/783979bb-dc5d-4926-bdd6-1f873990a322) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:55:01.225737 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-288c14cb-83a2-44af-b51b-3137fb636341 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:01.237143 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d066a8c3-8cbd-453f-83f3-7b3674bc42ba up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:55:01.264825 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-288c14cb-83a2-44af-b51b-3137fb636341 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:01.304173 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-288c14cb-83a2-44af-b51b-3137fb636341 admin admin] Network 942064c7-756f-4754-a77d-0fafe38ff60f is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:55:01.312645 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-288c14cb-83a2-44af-b51b-3137fb636341 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:55:01.314618 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-288c14cb-83a2-44af-b51b-3137fb636341 admin admin] Pushing event updated for resources: {'Port': ['ID=783979bb-dc5d-4926-bdd6-1f873990a322,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:01.317010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-288c14cb-83a2-44af-b51b-3137fb636341 admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:55:01.344345 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:01.350514 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port d066a8c3-8cbd-453f-83f3-7b3674bc42ba triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:01.350880 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:01.362946 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-288c14cb-83a2-44af-b51b-3137fb636341 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:01.372610 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:01.441123 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6dd360d5-825f-4169-8677-0cd284032466 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:55:01.447862 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7f484c2-7332-468d-9b08-74cd56fe44f9 None None] Pushing event updated for resources: {'Port': ['ID=1e06e036-0c04-4ded-b403-9e482e494971,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:01.455779 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] Attempting to bind port 1e06e036-0c04-4ded-b403-9e482e494971 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:55:01.455978 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] Attempting to bind port 1e06e036-0c04-4ded-b403-9e482e494971 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:55:01.456333 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] Attempting to bind port 1e06e036-0c04-4ded-b403-9e482e494971 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:55:01.468469 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 54, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:55:01.468761 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:55:01.469549 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:01.470124 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:55:01.470788 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] Bound port: 1e06e036-0c04-4ded-b403-9e482e494971, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:55:01.471356 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:01.558507 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-288c14cb-83a2-44af-b51b-3137fb636341 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:01.566153 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] For port 1e06e036-0c04-4ded-b403-9e482e494971, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:55:01.571383 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] For port 1e06e036-0c04-4ded-b403-9e482e494971, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=1e06e036-0c04-4ded-b403-9e482e494971,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:55:01.579610 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:01.589625 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-acfb5f4d-bff9-463f-90db-6c0783ff4161 None None] Provisioning complete for port 1e06e036-0c04-4ded-b403-9e482e494971 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:01.589997 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-acfb5f4d-bff9-463f-90db-6c0783ff4161 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:01.595653 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-441eaf98-d97d-4840-86cb-b99d407ee855 req-f3a9ae1e-7bc8-499e-8750-739eb6a6dd71 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:01.597325 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-441eaf98-d97d-4840-86cb-b99d407ee855 req-f3a9ae1e-7bc8-499e-8750-739eb6a6dd71 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 943 time: 0.0917304 Dec 09 21:55:01.649337 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4b3b8be0-2d6b-46b1-a63e-700cd5e36992 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:55:01.684633 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] Routers {'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:55:01.685253 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:54:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f3e7ff9a-b5b4-4721-82b3-7d8488ad0844'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:01.688760 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7f484c2-7332-468d-9b08-74cd56fe44f9 None None] Pushing event updated for resources: {'Port': ['ID=1e06e036-0c04-4ded-b403-9e482e494971,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:01.689258 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-441eaf98-d97d-4840-86cb-b99d407ee855 req-da1f6686-4555-4f12-ad5b-0a99d89937d7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0734966 Dec 09 21:55:01.795254 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-288c14cb-83a2-44af-b51b-3137fb636341 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:01.801618 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-288c14cb-83a2-44af-b51b-3137fb636341 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:01.808221 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-acfb5f4d-bff9-463f-90db-6c0783ff4161 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:01.841575 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-acfb5f4d-bff9-463f-90db-6c0783ff4161 None None] For port 1e06e036-0c04-4ded-b403-9e482e494971, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=1e06e036-0c04-4ded-b403-9e482e494971,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:01.843683 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] Set router f3e7ff9a-b5b4-4721-82b3-7d8488ad0844 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:55:01.868947 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-acfb5f4d-bff9-463f-90db-6c0783ff4161 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:01.869672 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-288c14cb-83a2-44af-b51b-3137fb636341 admin admin] Pushing event updated for resources: {'Port': ['ID=783979bb-dc5d-4926-bdd6-1f873990a322,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:01.880130 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-288c14cb-83a2-44af-b51b-3137fb636341 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:01.974758 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acfb5f4d-bff9-463f-90db-6c0783ff4161 None None] Pushing event updated for resources: {'Port': ['ID=1e06e036-0c04-4ded-b403-9e482e494971,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:01.976962 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-288c14cb-83a2-44af-b51b-3137fb636341 admin admin] Network 942064c7-756f-4754-a77d-0fafe38ff60f is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:55:01.981124 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-288c14cb-83a2-44af-b51b-3137fb636341 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:55:02.026780 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e1d58c84-6c83-402f-bcb1-7ae7e67e4572 None None] Provisioning complete for port 1e06e036-0c04-4ded-b403-9e482e494971 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:02.027150 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e1d58c84-6c83-402f-bcb1-7ae7e67e4572 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:02.103979 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-288c14cb-83a2-44af-b51b-3137fb636341 admin admin] Router f3e7ff9a-b5b4-4721-82b3-7d8488ad0844 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:55:02.218692 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-288c14cb-83a2-44af-b51b-3137fb636341 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:55:02.224591 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-288c14cb-83a2-44af-b51b-3137fb636341 admin admin] 10.222.0.13 "PUT /v2.0/routers/f3e7ff9a-b5b4-4721-82b3-7d8488ad0844/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8002849 Dec 09 21:55:02.338200 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844', 'name': 'tempest-TestServerMultinode-702334193-router', 'tenant_id': '371f1d86e2f94da5bb1809b41a9eba58', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.13'}], 'enable_snat': True}, 'gw_port_id': '1e06e036-0c04-4ded-b403-9e482e494971', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:58Z', 'updated_at': '2021-12-09T21:55:01Z', 'revision_number': 4, 'project_id': '371f1d86e2f94da5bb1809b41a9eba58', 'gw_port': {'id': '1e06e036-0c04-4ded-b403-9e482e494971', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d6:42:8c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:58Z', 'updated_at': '2021-12-09T21:55:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '783979bb-dc5d-4926-bdd6-1f873990a322', 'name': '', 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f', 'tenant_id': '371f1d86e2f94da5bb1809b41a9eba58', 'mac_address': 'fa:16:3e:bd:1e:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844', 'device_owner': 'network:router_interface', 'standard_attr_id': 3963, 'fixed_ips': [{'subnet_id': '052fcd50-6803-4f87-8dfb-d2c1cc2fb02e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:55:00Z', 'updated_at': '2021-12-09T21:55:01Z', 'revision_number': 1, 'project_id': '371f1d86e2f94da5bb1809b41a9eba58', 'subnets': [{'id': '052fcd50-6803-4f87-8dfb-d2c1cc2fb02e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:02.365281 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d58d67b-7c9c-4b53-bb0f-8091ef45ab86 None None] The sync data for ids ['f3e7ff9a-b5b4-4721-82b3-7d8488ad0844'] in n-d-713301-27 is: [{'id': 'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844', 'name': 'tempest-TestServerMultinode-702334193-router', 'tenant_id': '371f1d86e2f94da5bb1809b41a9eba58', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.13'}], 'enable_snat': True}, 'gw_port_id': '1e06e036-0c04-4ded-b403-9e482e494971', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:58Z', 'updated_at': '2021-12-09T21:55:01Z', 'revision_number': 4, 'project_id': '371f1d86e2f94da5bb1809b41a9eba58', 'gw_port': {'id': '1e06e036-0c04-4ded-b403-9e482e494971', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d6:42:8c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:58Z', 'updated_at': '2021-12-09T21:55:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '783979bb-dc5d-4926-bdd6-1f873990a322', 'name': '', 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f', 'tenant_id': '371f1d86e2f94da5bb1809b41a9eba58', 'mac_address': 'fa:16:3e:bd:1e:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844', 'device_owner': 'network:router_interface', 'standard_attr_id': 3963, 'fixed_ips': [{'subnet_id': '052fcd50-6803-4f87-8dfb-d2c1cc2fb02e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:55:00Z', 'updated_at': '2021-12-09T21:55:01Z', 'revision_number': 1, 'project_id': '371f1d86e2f94da5bb1809b41a9eba58', 'subnets': [{'id': '052fcd50-6803-4f87-8dfb-d2c1cc2fb02e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:55:02.367997 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e1d58c84-6c83-402f-bcb1-7ae7e67e4572 None None] Provisioning complete for port 783979bb-dc5d-4926-bdd6-1f873990a322 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:02.368381 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e1d58c84-6c83-402f-bcb1-7ae7e67e4572 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:02.409028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e1d58c84-6c83-402f-bcb1-7ae7e67e4572 None None] Port 783979bb-dc5d-4926-bdd6-1f873990a322 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:55:02.534453 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b16229ff-0727-49ea-970c-0ff326750b17 None None] Provisioning complete for port 783979bb-dc5d-4926-bdd6-1f873990a322 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:02.534823 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b16229ff-0727-49ea-970c-0ff326750b17 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:02.588002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-b16229ff-0727-49ea-970c-0ff326750b17 None None] Port 783979bb-dc5d-4926-bdd6-1f873990a322 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:55:02.757159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55184) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:55:02.763219 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-1032009e-b5d1-417b-a5ae-af11551f72c2 admin admin] Request body: {'network': {'name': 'tempest-TestServerMultinode-1041862185-network', 'tenant_id': 'fadc53efe432454da595fb0618fbe948'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:55:02.791033 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1032009e-b5d1-417b-a5ae-af11551f72c2 admin admin] Made reservation on behalf of fadc53efe432454da595fb0618fbe948 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:55:02.793813 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1032009e-b5d1-417b-a5ae-af11551f72c2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:02.805654 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1032009e-b5d1-417b-a5ae-af11551f72c2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:02.830601 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4f9f52d-e51f-443e-83ac-b56b55cb6e7d req-2e8369e2-f9dc-4d18-a025-df3c9fa49119 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:02.832412 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4f9f52d-e51f-443e-83ac-b56b55cb6e7d req-2e8369e2-f9dc-4d18-a025-df3c9fa49119 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 943 time: 0.0610833 Dec 09 21:55:02.897163 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1032009e-b5d1-417b-a5ae-af11551f72c2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:02.900267 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4f9f52d-e51f-443e-83ac-b56b55cb6e7d req-dc0bf910-245b-40dd-b039-a7e062ebd1e7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0606966 Dec 09 21:55:02.905856 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1032009e-b5d1-417b-a5ae-af11551f72c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:02.930097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1032009e-b5d1-417b-a5ae-af11551f72c2 admin admin] vlan segment allocate from pool success with {'vlan_id': 126, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:55:02.944723 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1032009e-b5d1-417b-a5ae-af11551f72c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=191aace8-55a0-479e-b6ec-3e59836d90b8,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:02.950468 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1032009e-b5d1-417b-a5ae-af11551f72c2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:02.951064 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-1032009e-b5d1-417b-a5ae-af11551f72c2 admin admin] Added segment d3454a3b-857c-446f-9f63-b9d0ea8cd06f of type vlan for network 3b1f160d-45e8-4246-9496-3beebccaa493 Dec 09 21:55:02.980521 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-98833767-5a70-46ff-8305-e1a7ccb3f4cb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:03.002900 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1032009e-b5d1-417b-a5ae-af11551f72c2 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:03.042100 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1032009e-b5d1-417b-a5ae-af11551f72c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:03.043150 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1032009e-b5d1-417b-a5ae-af11551f72c2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:03.044243 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1032009e-b5d1-417b-a5ae-af11551f72c2 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:03.084241 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1032009e-b5d1-417b-a5ae-af11551f72c2 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.3251500 Dec 09 21:55:03.087759 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55186) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:55:03.093740 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a03cc8f9-9dc0-4258-8298-0449433de651 admin admin] Request body: {'subnet': {'network_id': '3b1f160d-45e8-4246-9496-3beebccaa493', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestServerMultinode-1041862185-subnet', 'tenant_id': 'fadc53efe432454da595fb0618fbe948', 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:55:03.122371 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a03cc8f9-9dc0-4258-8298-0449433de651 admin admin] Made reservation on behalf of fadc53efe432454da595fb0618fbe948 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:55:03.125206 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a03cc8f9-9dc0-4258-8298-0449433de651 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:03.138479 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1032009e-b5d1-417b-a5ae-af11551f72c2 admin admin] Pushing event updated for resources: {'Network': ['ID=3b1f160d-45e8-4246-9496-3beebccaa493,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:03.165672 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 3b1f160d-45e8-4246-9496-3beebccaa493 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:55:03.255966 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 1e06e036-0c04-4ded-b403-9e482e494971 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:55:03.320992 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 1e06e036-0c04-4ded-b403-9e482e494971 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:03.321369 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:03.703955 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a03cc8f9-9dc0-4258-8298-0449433de651 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:03.758382 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a03cc8f9-9dc0-4258-8298-0449433de651 admin admin] Pushing event updated for resources: {'Subnet': ['ID=19eb8709-f745-473a-862f-c0d2fdb14a6a,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:03.769308 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a03cc8f9-9dc0-4258-8298-0449433de651 admin admin] Checking segment: {'id': 'd3454a3b-857c-446f-9f63-b9d0ea8cd06f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '3b1f160d-45e8-4246-9496-3beebccaa493'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:55:03.769676 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a03cc8f9-9dc0-4258-8298-0449433de651 admin admin] Network hostable DHCP agents. Network: 3b1f160d-45e8-4246-9496-3beebccaa493, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:55:03.790045 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a03cc8f9-9dc0-4258-8298-0449433de651 admin admin] Network 3b1f160d-45e8-4246-9496-3beebccaa493 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:55:03.801118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-a03cc8f9-9dc0-4258-8298-0449433de651 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 3b1f160d-45e8-4246-9496-3beebccaa493) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:55:03.805503 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a03cc8f9-9dc0-4258-8298-0449433de651 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:03.806120 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a03cc8f9-9dc0-4258-8298-0449433de651 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:03.812008 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f624d3ea-9693-4ca6-946e-e4f948482b89 None None] Network 3b1f160d-45e8-4246-9496-3beebccaa493 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:55:03.828948 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a03cc8f9-9dc0-4258-8298-0449433de651 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.7398441 Dec 09 21:55:03.831567 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55188) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:55:03.836202 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-bbad8be9-01f6-4beb-a738-01b7b27a78b6 admin admin] Request body: {'router': {'name': 'tempest-TestServerMultinode-1041862185-router', 'tenant_id': 'fadc53efe432454da595fb0618fbe948', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:55:03.857119 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bbad8be9-01f6-4beb-a738-01b7b27a78b6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:03.858152 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bbad8be9-01f6-4beb-a738-01b7b27a78b6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:03.913008 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bbad8be9-01f6-4beb-a738-01b7b27a78b6 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:03.921983 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad2e671b-2b87-41a7-bb7f-9b3a4f74a6e3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-3b1f160d-45e8-4246-9496-3beebccaa493', 'network_id': '3b1f160d-45e8-4246-9496-3beebccaa493', 'project_id': 'fadc53efe432454da595fb0618fbe948', 'fixed_ips': [{'subnet_id': '19eb8709-f745-473a-862f-c0d2fdb14a6a'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:55:03.922881 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ad2e671b-2b87-41a7-bb7f-9b3a4f74a6e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:04.062868 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-ad2e671b-2b87-41a7-bb7f-9b3a4f74a6e3 None None] Allocated IP 172.20.0.2 (3b1f160d-45e8-4246-9496-3beebccaa493/19eb8709-f745-473a-862f-c0d2fdb14a6a/2a5a46c0-c097-4512-ab3a-d9c8b8a6c749) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:55:04.087286 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bbad8be9-01f6-4beb-a738-01b7b27a78b6 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:04.103668 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53e7fe83-d38d-4819-b6be-d1fd6b052842 req-9a12abd8-bbe3-44f2-a363-e6703960c7d7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:04.105167 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-53e7fe83-d38d-4819-b6be-d1fd6b052842 req-9a12abd8-bbe3-44f2-a363-e6703960c7d7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 943 time: 0.1193776 Dec 09 21:55:04.176328 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-53e7fe83-d38d-4819-b6be-d1fd6b052842 req-7f8c2b2a-57eb-4fd4-9fce-581ab170ce60 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0590534 Dec 09 21:55:04.215823 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ad2e671b-2b87-41a7-bb7f-9b3a4f74a6e3 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:04.224217 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ad2e671b-2b87-41a7-bb7f-9b3a4f74a6e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:04.264800 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad2e671b-2b87-41a7-bb7f-9b3a4f74a6e3 None None] Network 3b1f160d-45e8-4246-9496-3beebccaa493 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:55:04.267613 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-ad2e671b-2b87-41a7-bb7f-9b3a4f74a6e3 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:55:04.273117 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad2e671b-2b87-41a7-bb7f-9b3a4f74a6e3 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:55:04.278615 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad2e671b-2b87-41a7-bb7f-9b3a4f74a6e3 None None] Pushing event updated for resources: {'Port': ['ID=2a5a46c0-c097-4512-ab3a-d9c8b8a6c749,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:04.334204 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-ad2e671b-2b87-41a7-bb7f-9b3a4f74a6e3 None None] Attempting to bind port 2a5a46c0-c097-4512-ab3a-d9c8b8a6c749 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:55:04.334607 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-ad2e671b-2b87-41a7-bb7f-9b3a4f74a6e3 None None] Attempting to bind port 2a5a46c0-c097-4512-ab3a-d9c8b8a6c749 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'd3454a3b-857c-446f-9f63-b9d0ea8cd06f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '3b1f160d-45e8-4246-9496-3beebccaa493'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:55:04.335057 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad2e671b-2b87-41a7-bb7f-9b3a4f74a6e3 None None] Attempting to bind port 2a5a46c0-c097-4512-ab3a-d9c8b8a6c749 on network 3b1f160d-45e8-4246-9496-3beebccaa493 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:55:04.340264 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad2e671b-2b87-41a7-bb7f-9b3a4f74a6e3 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 54, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:55:04.340737 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad2e671b-2b87-41a7-bb7f-9b3a4f74a6e3 None None] Checking segment: {'id': 'd3454a3b-857c-446f-9f63-b9d0ea8cd06f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '3b1f160d-45e8-4246-9496-3beebccaa493'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:55:04.341141 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ad2e671b-2b87-41a7-bb7f-9b3a4f74a6e3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:04.341527 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad2e671b-2b87-41a7-bb7f-9b3a4f74a6e3 None None] Bound using segment: {'id': 'd3454a3b-857c-446f-9f63-b9d0ea8cd06f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '3b1f160d-45e8-4246-9496-3beebccaa493'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:55:04.341985 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-ad2e671b-2b87-41a7-bb7f-9b3a4f74a6e3 None None] Bound port: 2a5a46c0-c097-4512-ab3a-d9c8b8a6c749, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd3454a3b-857c-446f-9f63-b9d0ea8cd06f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '3b1f160d-45e8-4246-9496-3beebccaa493'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:55:04.342364 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ad2e671b-2b87-41a7-bb7f-9b3a4f74a6e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:04.361800 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bbad8be9-01f6-4beb-a738-01b7b27a78b6 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:04.382660 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bbad8be9-01f6-4beb-a738-01b7b27a78b6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:04.410341 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ad2e671b-2b87-41a7-bb7f-9b3a4f74a6e3 None None] For port 2a5a46c0-c097-4512-ab3a-d9c8b8a6c749, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:55:04.413451 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ad2e671b-2b87-41a7-bb7f-9b3a4f74a6e3 None None] For port 2a5a46c0-c097-4512-ab3a-d9c8b8a6c749, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2a5a46c0-c097-4512-ab3a-d9c8b8a6c749,segment=NetworkSegment(d3454a3b-857c-446f-9f63-b9d0ea8cd06f),segment_id=d3454a3b-857c-446f-9f63-b9d0ea8cd06f)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:55:04.417039 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ad2e671b-2b87-41a7-bb7f-9b3a4f74a6e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:04.472186 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad2e671b-2b87-41a7-bb7f-9b3a4f74a6e3 None None] Pushing event updated for resources: {'Port': ['ID=2a5a46c0-c097-4512-ab3a-d9c8b8a6c749,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:04.498623 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-bbad8be9-01f6-4beb-a738-01b7b27a78b6 admin admin] Allocated IP 172.25.3.174 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/b3895463-dfd0-4aa2-b3a3-b265816b639a) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:55:04.563107 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 97360c49-325c-47af-8916-2e920bf107d3 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:55:04.577736 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] Sync routers for ids ['f3e7ff9a-b5b4-4721-82b3-7d8488ad0844'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:55:04.589351 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] Routers {'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:55:04.590987 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:54:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f3e7ff9a-b5b4-4721-82b3-7d8488ad0844'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:04.617328 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bbad8be9-01f6-4beb-a738-01b7b27a78b6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:04.683719 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bbad8be9-01f6-4beb-a738-01b7b27a78b6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:04.726730 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bbad8be9-01f6-4beb-a738-01b7b27a78b6 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:55:04.732313 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-bbad8be9-01f6-4beb-a738-01b7b27a78b6 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:55:04.734497 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] Set router f3e7ff9a-b5b4-4721-82b3-7d8488ad0844 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:55:04.738243 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bbad8be9-01f6-4beb-a738-01b7b27a78b6 admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:55:04.744550 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 97360c49-325c-47af-8916-2e920bf107d3, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=97360c49-325c-47af-8916-2e920bf107d3,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:04.753236 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eca96bd9-12b7-4a37-b51f-443215181cfd None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:55:04.777592 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbad8be9-01f6-4beb-a738-01b7b27a78b6 admin admin] Pushing event updated for resources: {'Port': ['ID=b3895463-dfd0-4aa2-b3a3-b265816b639a,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:04.788667 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '97360c49-325c-47af-8916-2e920bf107d3', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'port_id': '97360c49-325c-47af-8916-2e920bf107d3', 'mac_address': 'fa:16:3e:f2:fb:4d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:55:04.854747 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:04.870190 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f3342fd3-f75c-44cc-b1ff-28333f86a011 None None] Provisioning complete for port b3895463-dfd0-4aa2-b3a3-b265816b639a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:04.870692 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f3342fd3-f75c-44cc-b1ff-28333f86a011 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:04.897334 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 97360c49-325c-47af-8916-2e920bf107d3 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:55:04.925485 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 97360c49-325c-47af-8916-2e920bf107d3, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=97360c49-325c-47af-8916-2e920bf107d3,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:04.926494 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f3342fd3-f75c-44cc-b1ff-28333f86a011 None None] Port b3895463-dfd0-4aa2-b3a3-b265816b639a cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:55:04.931363 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:04.987378 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=97360c49-325c-47af-8916-2e920bf107d3,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:04.991419 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844', 'name': 'tempest-TestServerMultinode-702334193-router', 'tenant_id': '371f1d86e2f94da5bb1809b41a9eba58', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.13'}], 'enable_snat': True}, 'gw_port_id': '1e06e036-0c04-4ded-b403-9e482e494971', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:58Z', 'updated_at': '2021-12-09T21:55:01Z', 'revision_number': 4, 'project_id': '371f1d86e2f94da5bb1809b41a9eba58', 'gw_port': {'id': '1e06e036-0c04-4ded-b403-9e482e494971', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d6:42:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:58Z', 'updated_at': '2021-12-09T21:55:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '783979bb-dc5d-4926-bdd6-1f873990a322', 'name': '', 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f', 'tenant_id': '371f1d86e2f94da5bb1809b41a9eba58', 'mac_address': 'fa:16:3e:bd:1e:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844', 'device_owner': 'network:router_interface', 'standard_attr_id': 3963, 'fixed_ips': [{'subnet_id': '052fcd50-6803-4f87-8dfb-d2c1cc2fb02e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:55:00Z', 'updated_at': '2021-12-09T21:55:01Z', 'revision_number': 2, 'project_id': '371f1d86e2f94da5bb1809b41a9eba58', 'subnets': [{'id': '052fcd50-6803-4f87-8dfb-d2c1cc2fb02e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:05.017837 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] Checking router: f3e7ff9a-b5b4-4721-82b3-7d8488ad0844 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:55:05.018184 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] Updating router f3e7ff9a-b5b4-4721-82b3-7d8488ad0844 port 783979bb-dc5d-4926-bdd6-1f873990a322 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:55:05.041183 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bbad8be9-01f6-4beb-a738-01b7b27a78b6 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:05.042930 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:05.119847 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['97360c49-325c-47af-8916-2e920bf107d3'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:55:05.271955 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2a5a46c0-c097-4512-ab3a-d9c8b8a6c749 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:55:05.273653 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bbad8be9-01f6-4beb-a738-01b7b27a78b6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:05.374616 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:05.383738 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:05.421058 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 2a5a46c0-c097-4512-ab3a-d9c8b8a6c749 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:05.421442 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:05.428266 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42a8e10b-6c16-4d30-8f26-e84e6b0b8a53 req-79a9aec9-fdb3-4e25-a512-a219803d257d tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:05.430325 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42a8e10b-6c16-4d30-8f26-e84e6b0b8a53 req-79a9aec9-fdb3-4e25-a512-a219803d257d tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 944 time: 0.1043332 Dec 09 21:55:05.495694 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-669db818-9ac8-4b59-9bca-f84cf20edc42 None None] Pushing event updated for resources: {'Port': ['ID=783979bb-dc5d-4926-bdd6-1f873990a322,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:05.505256 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-669db818-9ac8-4b59-9bca-f84cf20edc42 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:05.505929 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-669db818-9ac8-4b59-9bca-f84cf20edc42 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:05.506591 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-669db818-9ac8-4b59-9bca-f84cf20edc42 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:05.507182 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-669db818-9ac8-4b59-9bca-f84cf20edc42 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:05.507904 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-669db818-9ac8-4b59-9bca-f84cf20edc42 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:05.508474 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-669db818-9ac8-4b59-9bca-f84cf20edc42 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:05.509205 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-669db818-9ac8-4b59-9bca-f84cf20edc42 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:05.510351 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-669db818-9ac8-4b59-9bca-f84cf20edc42 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:05.510811 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-669db818-9ac8-4b59-9bca-f84cf20edc42 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:05.511277 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-669db818-9ac8-4b59-9bca-f84cf20edc42 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:05.511955 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-669db818-9ac8-4b59-9bca-f84cf20edc42 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:05.512524 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-669db818-9ac8-4b59-9bca-f84cf20edc42 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:05.512914 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-669db818-9ac8-4b59-9bca-f84cf20edc42 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:05.533695 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42a8e10b-6c16-4d30-8f26-e84e6b0b8a53 req-cfe49f6d-bc71-4423-a481-0b08ff644784 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0877786 Dec 09 21:55:05.534457 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bbad8be9-01f6-4beb-a738-01b7b27a78b6 admin admin] Router 9add2ea6-7c71-4404-a87a-19bd194cde59 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:55:05.548016 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] Attempting to bind port 783979bb-dc5d-4926-bdd6-1f873990a322 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:55:05.548676 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] Attempting to bind port 783979bb-dc5d-4926-bdd6-1f873990a322 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '0d6ecccc-88ae-48f3-a22d-f126ecb40d84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:55:05.549276 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] Attempting to bind port 783979bb-dc5d-4926-bdd6-1f873990a322 on network 942064c7-756f-4754-a77d-0fafe38ff60f {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:55:05.558622 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 54, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:55:05.559396 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] Checking segment: {'id': '0d6ecccc-88ae-48f3-a22d-f126ecb40d84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:55:05.560074 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:05.561076 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] Bound using segment: {'id': '0d6ecccc-88ae-48f3-a22d-f126ecb40d84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:55:05.561786 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] Bound port: 783979bb-dc5d-4926-bdd6-1f873990a322, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0d6ecccc-88ae-48f3-a22d-f126ecb40d84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:55:05.562431 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:05.584978 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:05.638654 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6fb4ffe8-1cbb-46fd-8aea-1c6fba0a7424 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:05.660557 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 2a5a46c0-c097-4512-ab3a-d9c8b8a6c749, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2a5a46c0-c097-4512-ab3a-d9c8b8a6c749,segment=NetworkSegment(d3454a3b-857c-446f-9f63-b9d0ea8cd06f),segment_id=d3454a3b-857c-446f-9f63-b9d0ea8cd06f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:05.667935 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:05.674691 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bbad8be9-01f6-4beb-a738-01b7b27a78b6 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:55:05.694226 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] For port 783979bb-dc5d-4926-bdd6-1f873990a322, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:55:05.698004 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] For port 783979bb-dc5d-4926-bdd6-1f873990a322, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=783979bb-dc5d-4926-bdd6-1f873990a322,segment=NetworkSegment(0d6ecccc-88ae-48f3-a22d-f126ecb40d84),segment_id=0d6ecccc-88ae-48f3-a22d-f126ecb40d84)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:55:05.701796 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] Sync routers for ids ['9add2ea6-7c71-4404-a87a-19bd194cde59'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:55:05.705207 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bbad8be9-01f6-4beb-a738-01b7b27a78b6 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:05.707803 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:05.713860 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bbad8be9-01f6-4beb-a738-01b7b27a78b6 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 1.8809192 Dec 09 21:55:05.716937 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55194) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:55:05.736242 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] Routers {'9add2ea6-7c71-4404-a87a-19bd194cde59'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:55:05.736800 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:55:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9add2ea6-7c71-4404-a87a-19bd194cde59'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:05.742335 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=2a5a46c0-c097-4512-ab3a-d9c8b8a6c749,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:05.795202 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] Routers {'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:55:05.795202 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:55:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f3e7ff9a-b5b4-4721-82b3-7d8488ad0844'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:05.836324 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-669db818-9ac8-4b59-9bca-f84cf20edc42 None None] Pushing event updated for resources: {'Port': ['ID=783979bb-dc5d-4926-bdd6-1f873990a322,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:05.886584 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-430dc067-9536-4f42-8078-c60a0e7ba22c None None] Provisioning complete for port 783979bb-dc5d-4926-bdd6-1f873990a322 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:05.887302 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-430dc067-9536-4f42-8078-c60a0e7ba22c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:05.930408 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2661c381-ef8a-43b1-af0e-f572c8b3de4a None None] Network 3b1f160d-45e8-4246-9496-3beebccaa493 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:55:05.939395 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] Set router 9add2ea6-7c71-4404-a87a-19bd194cde59 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:55:06.029867 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] Set router f3e7ff9a-b5b4-4721-82b3-7d8488ad0844 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:55:06.192471 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-430dc067-9536-4f42-8078-c60a0e7ba22c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:06.258912 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af764d3c-8aff-4dcf-9ad8-0bf71214f5f2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:06.272843 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844', 'name': 'tempest-TestServerMultinode-702334193-router', 'tenant_id': '371f1d86e2f94da5bb1809b41a9eba58', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.13'}], 'enable_snat': True}, 'gw_port_id': '1e06e036-0c04-4ded-b403-9e482e494971', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:58Z', 'updated_at': '2021-12-09T21:55:01Z', 'revision_number': 4, 'project_id': '371f1d86e2f94da5bb1809b41a9eba58', 'gw_port': {'id': '1e06e036-0c04-4ded-b403-9e482e494971', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d6:42:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:58Z', 'updated_at': '2021-12-09T21:55:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '783979bb-dc5d-4926-bdd6-1f873990a322', 'name': '', 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f', 'tenant_id': '371f1d86e2f94da5bb1809b41a9eba58', 'mac_address': 'fa:16:3e:bd:1e:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844', 'device_owner': 'network:router_interface', 'standard_attr_id': 3963, 'fixed_ips': [{'subnet_id': '052fcd50-6803-4f87-8dfb-d2c1cc2fb02e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:55:00Z', 'updated_at': '2021-12-09T21:55:05Z', 'revision_number': 4, 'project_id': '371f1d86e2f94da5bb1809b41a9eba58', 'subnets': [{'id': '052fcd50-6803-4f87-8dfb-d2c1cc2fb02e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:06.274073 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-430dc067-9536-4f42-8078-c60a0e7ba22c None None] For port 783979bb-dc5d-4926-bdd6-1f873990a322, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=783979bb-dc5d-4926-bdd6-1f873990a322,segment=NetworkSegment(0d6ecccc-88ae-48f3-a22d-f126ecb40d84),segment_id=0d6ecccc-88ae-48f3-a22d-f126ecb40d84)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:06.286897 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-430dc067-9536-4f42-8078-c60a0e7ba22c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:06.305740 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8253f561-fb25-497e-9aeb-1a4fa9ed8010 None None] The sync data for ids ['f3e7ff9a-b5b4-4721-82b3-7d8488ad0844'] in n-d-713301-27 is: [{'id': 'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844', 'name': 'tempest-TestServerMultinode-702334193-router', 'tenant_id': '371f1d86e2f94da5bb1809b41a9eba58', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.13'}], 'enable_snat': True}, 'gw_port_id': '1e06e036-0c04-4ded-b403-9e482e494971', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:58Z', 'updated_at': '2021-12-09T21:55:01Z', 'revision_number': 4, 'project_id': '371f1d86e2f94da5bb1809b41a9eba58', 'gw_port': {'id': '1e06e036-0c04-4ded-b403-9e482e494971', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d6:42:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:58Z', 'updated_at': '2021-12-09T21:55:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '783979bb-dc5d-4926-bdd6-1f873990a322', 'name': '', 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f', 'tenant_id': '371f1d86e2f94da5bb1809b41a9eba58', 'mac_address': 'fa:16:3e:bd:1e:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844', 'device_owner': 'network:router_interface', 'standard_attr_id': 3963, 'fixed_ips': [{'subnet_id': '052fcd50-6803-4f87-8dfb-d2c1cc2fb02e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:55:00Z', 'updated_at': '2021-12-09T21:55:05Z', 'revision_number': 4, 'project_id': '371f1d86e2f94da5bb1809b41a9eba58', 'subnets': [{'id': '052fcd50-6803-4f87-8dfb-d2c1cc2fb02e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:55:06.351125 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-430dc067-9536-4f42-8078-c60a0e7ba22c None None] Pushing event updated for resources: {'Port': ['ID=783979bb-dc5d-4926-bdd6-1f873990a322,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:06.361592 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9add2ea6-7c71-4404-a87a-19bd194cde59', 'name': 'tempest-TestServerMultinode-1041862185-router', 'tenant_id': 'fadc53efe432454da595fb0618fbe948', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.174'}], 'enable_snat': True}, 'gw_port_id': 'b3895463-dfd0-4aa2-b3a3-b265816b639a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:55:03Z', 'updated_at': '2021-12-09T21:55:04Z', 'revision_number': 3, 'project_id': 'fadc53efe432454da595fb0618fbe948', 'gw_port': {'id': 'b3895463-dfd0-4aa2-b3a3-b265816b639a', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:f6:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9add2ea6-7c71-4404-a87a-19bd194cde59', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3974, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.174', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:55:04Z', 'updated_at': '2021-12-09T21:55:04Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:06.391682 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] Checking router: 9add2ea6-7c71-4404-a87a-19bd194cde59 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:55:06.392185 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] Updating router 9add2ea6-7c71-4404-a87a-19bd194cde59 port b3895463-dfd0-4aa2-b3a3-b265816b639a binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:55:06.430027 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d4ea2c3f-ede6-477d-90c0-9ba6bee2b27a None None] Provisioning complete for port 2a5a46c0-c097-4512-ab3a-d9c8b8a6c749 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:06.430552 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d4ea2c3f-ede6-477d-90c0-9ba6bee2b27a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:06.434514 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:06.467911 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-af764d3c-8aff-4dcf-9ad8-0bf71214f5f2 admin admin] Allocated IP 172.20.0.1 (3b1f160d-45e8-4246-9496-3beebccaa493/19eb8709-f745-473a-862f-c0d2fdb14a6a/b2405e36-5694-4cd4-ae1a-30e33803456e) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:55:06.579624 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 97360c49-325c-47af-8916-2e920bf107d3 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:55:06.599678 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af764d3c-8aff-4dcf-9ad8-0bf71214f5f2 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:06.654492 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af764d3c-8aff-4dcf-9ad8-0bf71214f5f2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:06.698698 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af764d3c-8aff-4dcf-9ad8-0bf71214f5f2 admin admin] Network 3b1f160d-45e8-4246-9496-3beebccaa493 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:55:06.702909 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-af764d3c-8aff-4dcf-9ad8-0bf71214f5f2 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:55:06.710395 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af764d3c-8aff-4dcf-9ad8-0bf71214f5f2 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:55:06.720798 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3531ea1d-edcb-4e92-b611-92dc11b060e8 req-63417cfe-19be-44d1-8528-55c13a6099a8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:06.731543 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3531ea1d-edcb-4e92-b611-92dc11b060e8 req-63417cfe-19be-44d1-8528-55c13a6099a8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 944 time: 0.1092668 Dec 09 21:55:06.733362 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af764d3c-8aff-4dcf-9ad8-0bf71214f5f2 admin admin] Pushing event updated for resources: {'Port': ['ID=b2405e36-5694-4cd4-ae1a-30e33803456e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:06.749378 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:06.750258 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d4ea2c3f-ede6-477d-90c0-9ba6bee2b27a None None] Provisioning complete for port 783979bb-dc5d-4926-bdd6-1f873990a322 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:06.751596 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d4ea2c3f-ede6-477d-90c0-9ba6bee2b27a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:06.766000 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af764d3c-8aff-4dcf-9ad8-0bf71214f5f2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:06.828037 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3531ea1d-edcb-4e92-b611-92dc11b060e8 req-7794cfb1-825d-4840-b609-4b08c45663d8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0871401 Dec 09 21:55:07.002611 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af764d3c-8aff-4dcf-9ad8-0bf71214f5f2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:07.059732 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 97360c49-325c-47af-8916-2e920bf107d3 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:55:07.076552 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 97360c49-325c-47af-8916-2e920bf107d3 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:07.077074 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:07.212356 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:07.246814 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:07.281978 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 783979bb-dc5d-4926-bdd6-1f873990a322 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:55:07.291050 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af764d3c-8aff-4dcf-9ad8-0bf71214f5f2 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:07.297400 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af764d3c-8aff-4dcf-9ad8-0bf71214f5f2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:07.361520 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fcfb8c24-2816-48d1-8e4e-fa93314210a1 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:55:07.380133 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:07.390384 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92ed5aba-5555-402b-bc4e-5a7f39296729 None None] Pushing event updated for resources: {'Port': ['ID=b3895463-dfd0-4aa2-b3a3-b265816b639a,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:07.391182 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af764d3c-8aff-4dcf-9ad8-0bf71214f5f2 admin admin] Pushing event updated for resources: {'Port': ['ID=b2405e36-5694-4cd4-ae1a-30e33803456e,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:07.399334 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af764d3c-8aff-4dcf-9ad8-0bf71214f5f2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:07.409796 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] Attempting to bind port b3895463-dfd0-4aa2-b3a3-b265816b639a on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:55:07.410265 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] Attempting to bind port b3895463-dfd0-4aa2-b3a3-b265816b639a by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:55:07.410720 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] Attempting to bind port b3895463-dfd0-4aa2-b3a3-b265816b639a on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:55:07.430167 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 54, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:55:07.430703 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:55:07.431211 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:07.431739 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:55:07.432321 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] Bound port: b3895463-dfd0-4aa2-b3a3-b265816b639a, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:55:07.432800 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:07.463948 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'aa8d4704-dab9-4d12-971a-6330f2fb603a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '97360c49-325c-47af-8916-2e920bf107d3'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:55:07.466749 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d2373c83-c2e1-4316-be1f-5f8cfc69232b" -d '{"events": [{"server_uuid": "aa8d4704-dab9-4d12-971a-6330f2fb603a", "name": "network-vif-plugged", "status": "completed", "tag": "97360c49-325c-47af-8916-2e920bf107d3"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:55:07.484491 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e7d9538e-2934-42cd-96d6-980a2ed9c060 None None] Provisioning complete for port 2a5a46c0-c097-4512-ab3a-d9c8b8a6c749 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:07.484960 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e7d9538e-2934-42cd-96d6-980a2ed9c060 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:07.506926 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af764d3c-8aff-4dcf-9ad8-0bf71214f5f2 admin admin] Network 3b1f160d-45e8-4246-9496-3beebccaa493 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:55:07.508455 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-af764d3c-8aff-4dcf-9ad8-0bf71214f5f2 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:55:07.511402 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 97360c49-325c-47af-8916-2e920bf107d3, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=97360c49-325c-47af-8916-2e920bf107d3,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:07.520006 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:55:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0bb2ea53-b00c-4513-8d9f-16721ea322de x-openstack-request-id: req-0bb2ea53-b00c-4513-8d9f-16721ea322de {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:55:07.520306 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "aa8d4704-dab9-4d12-971a-6330f2fb603a", "name": "network-vif-plugged", "status": "completed", "tag": "97360c49-325c-47af-8916-2e920bf107d3", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:55:07.520613 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0bb2ea53-b00c-4513-8d9f-16721ea322de {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:55:07.521728 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'aa8d4704-dab9-4d12-971a-6330f2fb603a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '97360c49-325c-47af-8916-2e920bf107d3', 'code': 200} Dec 09 21:55:07.527328 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:07.550206 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 783979bb-dc5d-4926-bdd6-1f873990a322 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:07.550582 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:07.638533 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] For port b3895463-dfd0-4aa2-b3a3-b265816b639a, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:55:07.644825 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] For port b3895463-dfd0-4aa2-b3a3-b265816b639a, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b3895463-dfd0-4aa2-b3a3-b265816b639a,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:55:07.663766 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-af764d3c-8aff-4dcf-9ad8-0bf71214f5f2 admin admin] Router 9add2ea6-7c71-4404-a87a-19bd194cde59 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:55:07.665523 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:07.677691 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=97360c49-325c-47af-8916-2e920bf107d3,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:07.702232 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f4087c3-9c3e-4a9e-a945-27594a22c054 req-bdc67fa2-8fad-40ea-bc43-928fcba005c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:07.703809 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f4087c3-9c3e-4a9e-a945-27594a22c054 req-bdc67fa2-8fad-40ea-bc43-928fcba005c2 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 1097 time: 0.0946190 Dec 09 21:55:07.747301 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92ed5aba-5555-402b-bc4e-5a7f39296729 None None] Pushing event updated for resources: {'Port': ['ID=b3895463-dfd0-4aa2-b3a3-b265816b639a,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:07.789303 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f4087c3-9c3e-4a9e-a945-27594a22c054 req-8662b64b-9238-4263-bf08-5d810acd57ac service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0772398 Dec 09 21:55:07.802159 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4aff867e-a771-4d7c-9e26-72651127406b None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:55:07.832219 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-af764d3c-8aff-4dcf-9ad8-0bf71214f5f2 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:55:07.842277 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-af764d3c-8aff-4dcf-9ad8-0bf71214f5f2 admin admin] 10.222.0.13 "PUT /v2.0/routers/9add2ea6-7c71-4404-a87a-19bd194cde59/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1237423 Dec 09 21:55:07.845725 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] Routers {'9add2ea6-7c71-4404-a87a-19bd194cde59'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:55:07.846381 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:55:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9add2ea6-7c71-4404-a87a-19bd194cde59'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:07.932980 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2a5a46c0-c097-4512-ab3a-d9c8b8a6c749 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:55:07.961593 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e7d9538e-2934-42cd-96d6-980a2ed9c060 None None] Provisioning complete for port b2405e36-5694-4cd4-ae1a-30e33803456e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:07.961969 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e7d9538e-2934-42cd-96d6-980a2ed9c060 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:07.999712 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c94bd70d-479f-44e2-85fc-7115c64a0a6d req-19dd6186-ecce-4f51-9f80-599bdbc3d5da tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:08.002318 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c94bd70d-479f-44e2-85fc-7115c64a0a6d req-19dd6186-ecce-4f51-9f80-599bdbc3d5da tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 945 time: 0.0756922 Dec 09 21:55:08.063859 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c94bd70d-479f-44e2-85fc-7115c64a0a6d req-4d0e9dc5-98a6-4548-a576-d403037aa479 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0529153 Dec 09 21:55:08.073853 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:08.074796 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e7d9538e-2934-42cd-96d6-980a2ed9c060 None None] Port b2405e36-5694-4cd4-ae1a-30e33803456e cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:55:08.084589 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] Set router 9add2ea6-7c71-4404-a87a-19bd194cde59 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:55:08.137620 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 2a5a46c0-c097-4512-ab3a-d9c8b8a6c749 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:08.137994 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:08.241961 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ba5d65f2-cf6b-4ba5-9a52-1aea13311a89 None None] Provisioning complete for port b3895463-dfd0-4aa2-b3a3-b265816b639a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:08.242329 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ba5d65f2-cf6b-4ba5-9a52-1aea13311a89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:08.439969 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ba5d65f2-cf6b-4ba5-9a52-1aea13311a89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:08.464440 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ba5d65f2-cf6b-4ba5-9a52-1aea13311a89 None None] For port b3895463-dfd0-4aa2-b3a3-b265816b639a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b3895463-dfd0-4aa2-b3a3-b265816b639a,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:08.471680 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ba5d65f2-cf6b-4ba5-9a52-1aea13311a89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:08.477445 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9add2ea6-7c71-4404-a87a-19bd194cde59', 'name': 'tempest-TestServerMultinode-1041862185-router', 'tenant_id': 'fadc53efe432454da595fb0618fbe948', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.174'}], 'enable_snat': True}, 'gw_port_id': 'b3895463-dfd0-4aa2-b3a3-b265816b639a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:55:03Z', 'updated_at': '2021-12-09T21:55:06Z', 'revision_number': 4, 'project_id': 'fadc53efe432454da595fb0618fbe948', 'gw_port': {'id': 'b3895463-dfd0-4aa2-b3a3-b265816b639a', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:f6:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9add2ea6-7c71-4404-a87a-19bd194cde59', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3974, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.174', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:55:04Z', 'updated_at': '2021-12-09T21:55:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'b2405e36-5694-4cd4-ae1a-30e33803456e', 'name': '', 'network_id': '3b1f160d-45e8-4246-9496-3beebccaa493', 'tenant_id': 'fadc53efe432454da595fb0618fbe948', 'mac_address': 'fa:16:3e:ac:99:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9add2ea6-7c71-4404-a87a-19bd194cde59', 'device_owner': 'network:router_interface', 'standard_attr_id': 3975, 'fixed_ips': [{'subnet_id': '19eb8709-f745-473a-862f-c0d2fdb14a6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:55:06Z', 'updated_at': '2021-12-09T21:55:07Z', 'revision_number': 2, 'project_id': 'fadc53efe432454da595fb0618fbe948', 'subnets': [{'id': '19eb8709-f745-473a-862f-c0d2fdb14a6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:08.526983 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-16bc2596-338b-4770-880b-2a1b3fe879cd None None] The sync data for ids ['9add2ea6-7c71-4404-a87a-19bd194cde59'] in n-d-713301-27 is: [{'id': '9add2ea6-7c71-4404-a87a-19bd194cde59', 'name': 'tempest-TestServerMultinode-1041862185-router', 'tenant_id': 'fadc53efe432454da595fb0618fbe948', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.174'}], 'enable_snat': True}, 'gw_port_id': 'b3895463-dfd0-4aa2-b3a3-b265816b639a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:55:03Z', 'updated_at': '2021-12-09T21:55:06Z', 'revision_number': 4, 'project_id': 'fadc53efe432454da595fb0618fbe948', 'gw_port': {'id': 'b3895463-dfd0-4aa2-b3a3-b265816b639a', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:f6:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9add2ea6-7c71-4404-a87a-19bd194cde59', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3974, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.174', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:55:04Z', 'updated_at': '2021-12-09T21:55:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'b2405e36-5694-4cd4-ae1a-30e33803456e', 'name': '', 'network_id': '3b1f160d-45e8-4246-9496-3beebccaa493', 'tenant_id': 'fadc53efe432454da595fb0618fbe948', 'mac_address': 'fa:16:3e:ac:99:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9add2ea6-7c71-4404-a87a-19bd194cde59', 'device_owner': 'network:router_interface', 'standard_attr_id': 3975, 'fixed_ips': [{'subnet_id': '19eb8709-f745-473a-862f-c0d2fdb14a6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:55:06Z', 'updated_at': '2021-12-09T21:55:07Z', 'revision_number': 2, 'project_id': 'fadc53efe432454da595fb0618fbe948', 'subnets': [{'id': '19eb8709-f745-473a-862f-c0d2fdb14a6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:55:08.536138 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-2ad3550c-6d00-4d14-94ee-e120d603988f tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:08.537779 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-2ad3550c-6d00-4d14-94ee-e120d603988f tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/networks?id=942064c7-756f-4754-a77d-0fafe38ff60f HTTP/1.1" status: 200 len: 910 time: 0.0906992 Dec 09 21:55:08.542359 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ba5d65f2-cf6b-4ba5-9a52-1aea13311a89 None None] Provisioning complete for port b2405e36-5694-4cd4-ae1a-30e33803456e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:08.542731 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ba5d65f2-cf6b-4ba5-9a52-1aea13311a89 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:08.556863 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-3c7e4254-1394-4f2a-bd95-1c6a0302fa40 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/quotas/fadc53efe432454da595fb0618fbe948 HTTP/1.1" status: 200 len: 375 time: 0.0102892 Dec 09 21:55:08.573577 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba5d65f2-cf6b-4ba5-9a52-1aea13311a89 None None] Pushing event updated for resources: {'Port': ['ID=b3895463-dfd0-4aa2-b3a3-b265816b639a,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:08.588921 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ba5d65f2-cf6b-4ba5-9a52-1aea13311a89 None None] Port b2405e36-5694-4cd4-ae1a-30e33803456e cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:55:08.642959 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-77eeff35-3429-4bba-9ca2-2025b80b5f76 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?tenant_id=fadc53efe432454da595fb0618fbe948&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0792034 Dec 09 21:55:08.748132 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-96684a0f-891c-4666-a000-c2e165c43483 service neutron] 10.222.0.13 "GET /v2.0/networks/942064c7-756f-4754-a77d-0fafe38ff60f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0980890 Dec 09 21:55:08.872916 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-8061b71c-5fe8-4f32-8385-9e300e5c41db service neutron] 10.222.0.13 "GET /v2.0/networks/942064c7-756f-4754-a77d-0fafe38ff60f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1169269 Dec 09 21:55:09.040419 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1961f018-16e4-4bca-9513-b132390c3d2e req-8829cc4e-9a56-452a-a023-67f94e5a5c54 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee HTTP/1.1" status: 200 len: 210 time: 0.0280805 Dec 09 21:55:09.257234 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e2175a9-c868-4097-9663-20f817784ac7 req-6b3674eb-002a-4fa7-bb77-89a144ed9205 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:09.258765 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0e2175a9-c868-4097-9663-20f817784ac7 req-6b3674eb-002a-4fa7-bb77-89a144ed9205 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 945 time: 0.0848656 Dec 09 21:55:09.319671 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0e2175a9-c868-4097-9663-20f817784ac7 req-7f815d6c-69ae-4be0-9c00-f614e5d42125 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492680 Dec 09 21:55:09.462492 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbf2a9eb-885b-4e31-a529-66e7b0b03538 req-a1345a5c-265c-4070-82a3-4717a2150a8b tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:09.464466 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dbf2a9eb-885b-4e31-a529-66e7b0b03538 req-a1345a5c-265c-4070-82a3-4717a2150a8b tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 945 time: 0.0598783 Dec 09 21:55:09.521692 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dbf2a9eb-885b-4e31-a529-66e7b0b03538 req-7b47cd43-2e19-42e5-bb7b-c8cfea6d9428 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495737 Dec 09 21:55:09.656554 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a2e6aa7-beec-4142-b175-3d247b410693 req-d22c84f6-050e-443b-b05b-fb9a4bd89bd8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:09.659908 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a2e6aa7-beec-4142-b175-3d247b410693 req-d22c84f6-050e-443b-b05b-fb9a4bd89bd8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 945 time: 0.0573604 Dec 09 21:55:09.666381 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:09.710488 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a2e6aa7-beec-4142-b175-3d247b410693 req-cbef3025-98df-4e70-b5ea-60776cc1a981 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459723 Dec 09 21:55:09.972582 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46b5e30f-650d-4137-a621-256c479a5d2b req-4407959e-40bd-4139-aad0-32896e128f17 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:09.974807 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46b5e30f-650d-4137-a621-256c479a5d2b req-4407959e-40bd-4139-aad0-32896e128f17 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 945 time: 0.0515175 Dec 09 21:55:10.027402 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46b5e30f-650d-4137-a621-256c479a5d2b req-e0df10f7-0c95-4635-b33e-709441161428 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468645 Dec 09 21:55:10.135467 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8b6a451c-3ef5-4113-89a9-dd3d68228a19 req-1e06e696-fd28-42a1-b3b4-5826bc31cecf tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee HTTP/1.1" status: 200 len: 210 time: 0.0262053 Dec 09 21:55:10.262920 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-577f4054-14a7-4d1a-b33c-f955daae50b4 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:10.264495 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-577f4054-14a7-4d1a-b33c-f955daae50b4 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.31 "GET /v2.0/networks?id=942064c7-756f-4754-a77d-0fafe38ff60f HTTP/1.1" status: 200 len: 910 time: 0.1040785 Dec 09 21:55:10.276866 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-b51a8083-1709-4b65-b92b-e15c1ccd6d37 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Request body: {'port': {'device_id': '1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee', 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f', 'admin_state_up': True, 'tenant_id': 'fadc53efe432454da595fb0618fbe948'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:55:10.299958 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-b51a8083-1709-4b65-b92b-e15c1ccd6d37 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Made reservation on behalf of fadc53efe432454da595fb0618fbe948 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:55:10.302398 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-b51a8083-1709-4b65-b92b-e15c1ccd6d37 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:10.425376 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-b51a8083-1709-4b65-b92b-e15c1ccd6d37 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Allocated IP 172.20.0.13 (942064c7-756f-4754-a77d-0fafe38ff60f/052fcd50-6803-4f87-8dfb-d2c1cc2fb02e/b4227972-6565-4adb-b0ec-462b6105136a) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:55:10.573671 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-b51a8083-1709-4b65-b92b-e15c1ccd6d37 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:10.611096 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-b51a8083-1709-4b65-b92b-e15c1ccd6d37 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:10.653080 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-b51a8083-1709-4b65-b92b-e15c1ccd6d37 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Network 942064c7-756f-4754-a77d-0fafe38ff60f is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:55:10.656062 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-b51a8083-1709-4b65-b92b-e15c1ccd6d37 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:55:10.661859 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-b51a8083-1709-4b65-b92b-e15c1ccd6d37 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:55:10.667288 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b51a8083-1709-4b65-b92b-e15c1ccd6d37 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Pushing event updated for resources: {'Port': ['ID=b4227972-6565-4adb-b0ec-462b6105136a,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:10.704471 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-b51a8083-1709-4b65-b92b-e15c1ccd6d37 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:10.705199 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-b51a8083-1709-4b65-b92b-e15c1ccd6d37 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:10.722869 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] Sync routers for ids ['9add2ea6-7c71-4404-a87a-19bd194cde59'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:55:10.725275 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-b51a8083-1709-4b65-b92b-e15c1ccd6d37 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1030 time: 0.4519656 Dec 09 21:55:10.739131 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-82e8d743-e764-4059-8ee5-d34ecbe7fec6 service neutron] Request body: {'port': {'device_id': '1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:55:10.740156 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] Routers {'9add2ea6-7c71-4404-a87a-19bd194cde59'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:55:10.740779 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:55:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9add2ea6-7c71-4404-a87a-19bd194cde59'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:10.800340 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-82e8d743-e764-4059-8ee5-d34ecbe7fec6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:10.855276 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] Set router 9add2ea6-7c71-4404-a87a-19bd194cde59 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:55:10.936839 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2e0e988f-4262-4aa8-b2a1-fb85bc4fff24 None None] Provisioning complete for port b4227972-6565-4adb-b0ec-462b6105136a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:10.938979 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2e0e988f-4262-4aa8-b2a1-fb85bc4fff24 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:10.973625 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-2e0e988f-4262-4aa8-b2a1-fb85bc4fff24 None None] Port b4227972-6565-4adb-b0ec-462b6105136a cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:55:11.081853 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9add2ea6-7c71-4404-a87a-19bd194cde59', 'name': 'tempest-TestServerMultinode-1041862185-router', 'tenant_id': 'fadc53efe432454da595fb0618fbe948', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.174'}], 'enable_snat': True}, 'gw_port_id': 'b3895463-dfd0-4aa2-b3a3-b265816b639a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:55:03Z', 'updated_at': '2021-12-09T21:55:06Z', 'revision_number': 4, 'project_id': 'fadc53efe432454da595fb0618fbe948', 'gw_port': {'id': 'b3895463-dfd0-4aa2-b3a3-b265816b639a', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:f6:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9add2ea6-7c71-4404-a87a-19bd194cde59', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3974, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.174', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:55:04Z', 'updated_at': '2021-12-09T21:55:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'b2405e36-5694-4cd4-ae1a-30e33803456e', 'name': '', 'network_id': '3b1f160d-45e8-4246-9496-3beebccaa493', 'tenant_id': 'fadc53efe432454da595fb0618fbe948', 'mac_address': 'fa:16:3e:ac:99:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9add2ea6-7c71-4404-a87a-19bd194cde59', 'device_owner': 'network:router_interface', 'standard_attr_id': 3975, 'fixed_ips': [{'subnet_id': '19eb8709-f745-473a-862f-c0d2fdb14a6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:55:06Z', 'updated_at': '2021-12-09T21:55:07Z', 'revision_number': 2, 'project_id': 'fadc53efe432454da595fb0618fbe948', 'subnets': [{'id': '19eb8709-f745-473a-862f-c0d2fdb14a6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:11.095916 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-82e8d743-e764-4059-8ee5-d34ecbe7fec6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b4227972-6565-4adb-b0ec-462b6105136a {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:55:11.104317 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-82e8d743-e764-4059-8ee5-d34ecbe7fec6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:11.115662 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] Checking router: 9add2ea6-7c71-4404-a87a-19bd194cde59 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:55:11.116023 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] Updating router 9add2ea6-7c71-4404-a87a-19bd194cde59 port b2405e36-5694-4cd4-ae1a-30e33803456e binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:55:11.120584 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-82e8d743-e764-4059-8ee5-d34ecbe7fec6 service neutron] Transition to ACTIVE for port object b4227972-6565-4adb-b0ec-462b6105136a will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:55:11.129245 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-82e8d743-e764-4059-8ee5-d34ecbe7fec6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:11.146213 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:11.172507 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7e7b0bc-5141-42df-a762-f3d8340a1e40 req-f079d012-b9ba-45c7-a4bf-593613c9447e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:11.177340 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f7e7b0bc-5141-42df-a762-f3d8340a1e40 req-f079d012-b9ba-45c7-a4bf-593613c9447e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 945 time: 0.0624976 Dec 09 21:55:11.195252 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82e8d743-e764-4059-8ee5-d34ecbe7fec6 service neutron] Pushing event updated for resources: {'Port': ['ID=b4227972-6565-4adb-b0ec-462b6105136a,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:11.293387 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b3895463-dfd0-4aa2-b3a3-b265816b639a up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:55:11.295214 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f7e7b0bc-5141-42df-a762-f3d8340a1e40 req-bfa4fe22-1403-4e25-acd6-c6dc9c3574bb tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1109684 Dec 09 21:55:11.322984 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-82e8d743-e764-4059-8ee5-d34ecbe7fec6 service neutron] Attempting to bind port b4227972-6565-4adb-b0ec-462b6105136a on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:55:11.323554 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-82e8d743-e764-4059-8ee5-d34ecbe7fec6 service neutron] Attempting to bind port b4227972-6565-4adb-b0ec-462b6105136a by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '0d6ecccc-88ae-48f3-a22d-f126ecb40d84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:55:11.326290 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-82e8d743-e764-4059-8ee5-d34ecbe7fec6 service neutron] Attempting to bind port b4227972-6565-4adb-b0ec-462b6105136a on network 942064c7-756f-4754-a77d-0fafe38ff60f {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:55:11.344091 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-82e8d743-e764-4059-8ee5-d34ecbe7fec6 service neutron] Port b4227972-6565-4adb-b0ec-462b6105136a on network 942064c7-756f-4754-a77d-0fafe38ff60f not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:55:11.344722 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-82e8d743-e764-4059-8ee5-d34ecbe7fec6 service neutron] Attempting to bind port b4227972-6565-4adb-b0ec-462b6105136a on network 942064c7-756f-4754-a77d-0fafe38ff60f {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:55:11.350509 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-82e8d743-e764-4059-8ee5-d34ecbe7fec6 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 54, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:55:11.351166 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-82e8d743-e764-4059-8ee5-d34ecbe7fec6 service neutron] Checking segment: {'id': '0d6ecccc-88ae-48f3-a22d-f126ecb40d84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:55:11.351701 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-82e8d743-e764-4059-8ee5-d34ecbe7fec6 service neutron] Bound using segment: {'id': '0d6ecccc-88ae-48f3-a22d-f126ecb40d84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:55:11.352238 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-82e8d743-e764-4059-8ee5-d34ecbe7fec6 service neutron] Bound port: b4227972-6565-4adb-b0ec-462b6105136a, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0d6ecccc-88ae-48f3-a22d-f126ecb40d84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:55:11.352684 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-82e8d743-e764-4059-8ee5-d34ecbe7fec6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:11.382998 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port b3895463-dfd0-4aa2-b3a3-b265816b639a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:11.383538 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:11.462932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-82e8d743-e764-4059-8ee5-d34ecbe7fec6 service neutron] For port b4227972-6565-4adb-b0ec-462b6105136a, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:55:11.464366 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cb2070d-ae89-4610-bab5-c91b172b43d3 req-0c64bbc1-f748-46e4-8c45-021e8e60ab16 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:11.466170 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3cb2070d-ae89-4610-bab5-c91b172b43d3 req-0c64bbc1-f748-46e4-8c45-021e8e60ab16 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.10 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 945 time: 0.1330762 Dec 09 21:55:11.467972 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-82e8d743-e764-4059-8ee5-d34ecbe7fec6 service neutron] For port b4227972-6565-4adb-b0ec-462b6105136a, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b4227972-6565-4adb-b0ec-462b6105136a,segment=NetworkSegment(0d6ecccc-88ae-48f3-a22d-f126ecb40d84),segment_id=0d6ecccc-88ae-48f3-a22d-f126ecb40d84)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:55:11.481825 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-82e8d743-e764-4059-8ee5-d34ecbe7fec6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:11.509974 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:11.525169 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:11.546635 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eb7a15b-d6bd-4aca-9405-0b06db097b52 req-4a926215-f627-4a68-854f-539ee74133a9 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:11.548465 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3eb7a15b-d6bd-4aca-9405-0b06db097b52 req-4a926215-f627-4a68-854f-539ee74133a9 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee HTTP/1.1" status: 200 len: 1054 time: 0.1394076 Dec 09 21:55:11.568140 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82e8d743-e764-4059-8ee5-d34ecbe7fec6 service neutron] Pushing event updated for resources: {'Port': ['ID=b4227972-6565-4adb-b0ec-462b6105136a,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:11.578878 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-82e8d743-e764-4059-8ee5-d34ecbe7fec6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:11.579779 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-82e8d743-e764-4059-8ee5-d34ecbe7fec6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:11.581840 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-82e8d743-e764-4059-8ee5-d34ecbe7fec6 service neutron] 10.222.0.31 "PUT /v2.0/ports/b4227972-6565-4adb-b0ec-462b6105136a HTTP/1.1" status: 200 len: 1093 time: 0.8472555 Dec 09 21:55:11.583254 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee', 'tag': 'b4227972-6565-4adb-b0ec-462b6105136a'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:55:11.586614 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d38bb7fc-3875-4c26-b8a5-38f4a3275714" -d '{"events": [{"name": "network-changed", "server_uuid": "1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee", "tag": "b4227972-6565-4adb-b0ec-462b6105136a"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:55:11.612773 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f049ff6-7b9c-4374-96ce-5a6c703a3118 None None] Pushing event updated for resources: {'Port': ['ID=b2405e36-5694-4cd4-ae1a-30e33803456e,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:11.620329 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-3cb2070d-ae89-4610-bab5-c91b172b43d3 req-905c708f-d4e5-4ba9-8bf6-22f31aba1ae7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Deleting port 97360c49-325c-47af-8916-2e920bf107d3 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:55:11.620682 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3cb2070d-ae89-4610-bab5-c91b172b43d3 req-905c708f-d4e5-4ba9-8bf6-22f31aba1ae7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:11.664295 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3eb7a15b-d6bd-4aca-9405-0b06db097b52 req-40677ceb-f4e9-47c0-b264-1a6255230463 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1072609 Dec 09 21:55:11.682037 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] Attempting to bind port b2405e36-5694-4cd4-ae1a-30e33803456e on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:55:11.682037 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] Attempting to bind port b2405e36-5694-4cd4-ae1a-30e33803456e by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'd3454a3b-857c-446f-9f63-b9d0ea8cd06f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '3b1f160d-45e8-4246-9496-3beebccaa493'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:55:11.682037 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] Attempting to bind port b2405e36-5694-4cd4-ae1a-30e33803456e on network 3b1f160d-45e8-4246-9496-3beebccaa493 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:55:11.691572 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 55, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:55:11.692096 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] Checking segment: {'id': 'd3454a3b-857c-446f-9f63-b9d0ea8cd06f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '3b1f160d-45e8-4246-9496-3beebccaa493'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:55:11.692586 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:11.693063 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] Bound using segment: {'id': 'd3454a3b-857c-446f-9f63-b9d0ea8cd06f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '3b1f160d-45e8-4246-9496-3beebccaa493'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:55:11.693630 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] Bound port: b2405e36-5694-4cd4-ae1a-30e33803456e, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd3454a3b-857c-446f-9f63-b9d0ea8cd06f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '3b1f160d-45e8-4246-9496-3beebccaa493'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:55:11.694848 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:11.724555 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-deccb5b7-c3c1-45d4-87f9-ef47e59837f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:11.726128 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-deccb5b7-c3c1-45d4-87f9-ef47e59837f9 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=fadc53efe432454da595fb0618fbe948&device_id=1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee HTTP/1.1" status: 200 len: 1096 time: 0.0922279 Dec 09 21:55:11.779728 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:55:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-596d3adc-99d0-49fd-8830-d08b4a03133c x-openstack-request-id: req-596d3adc-99d0-49fd-8830-d08b4a03133c {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:55:11.780027 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee", "tag": "b4227972-6565-4adb-b0ec-462b6105136a", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:55:11.780259 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-596d3adc-99d0-49fd-8830-d08b4a03133c {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:55:11.781043 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee', 'tag': 'b4227972-6565-4adb-b0ec-462b6105136a', 'status': 'completed', 'code': 200} Dec 09 21:55:11.782538 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-f02a7adb-f1c6-45b6-b148-e452de9b3680 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b4227972-6565-4adb-b0ec-462b6105136a HTTP/1.1" status: 200 len: 217 time: 0.0464549 Dec 09 21:55:11.786943 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] For port b2405e36-5694-4cd4-ae1a-30e33803456e, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:55:11.787757 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-3cb2070d-ae89-4610-bab5-c91b172b43d3 req-905c708f-d4e5-4ba9-8bf6-22f31aba1ae7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] For port 97360c49-325c-47af-8916-2e920bf107d3, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=97360c49-325c-47af-8916-2e920bf107d3,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:11.787757 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3cb2070d-ae89-4610-bab5-c91b172b43d3 req-905c708f-d4e5-4ba9-8bf6-22f31aba1ae7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:11.797920 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] For port b2405e36-5694-4cd4-ae1a-30e33803456e, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b2405e36-5694-4cd4-ae1a-30e33803456e,segment=NetworkSegment(d3454a3b-857c-446f-9f63-b9d0ea8cd06f),segment_id=d3454a3b-857c-446f-9f63-b9d0ea8cd06f)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:55:11.805008 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:11.806584 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-3cb2070d-ae89-4610-bab5-c91b172b43d3 req-905c708f-d4e5-4ba9-8bf6-22f31aba1ae7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Calling delete_port for 97360c49-325c-47af-8916-2e920bf107d3 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:55:11.848950 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-7dd0ab6f-9448-49e0-b32b-b81ff39de1d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:11.850680 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-7dd0ab6f-9448-49e0-b32b-b81ff39de1d1 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=052fcd50-6803-4f87-8dfb-d2c1cc2fb02e HTTP/1.1" status: 200 len: 848 time: 0.0612555 Dec 09 21:55:11.887851 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] Routers {'9add2ea6-7c71-4404-a87a-19bd194cde59'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:55:11.888735 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:55:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9add2ea6-7c71-4404-a87a-19bd194cde59'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:11.930405 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-3d37de14-7b44-49ff-a253-65e8c9011509 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:11.932035 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-3d37de14-7b44-49ff-a253-65e8c9011509 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=942064c7-756f-4754-a77d-0fafe38ff60f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0657740 Dec 09 21:55:11.942415 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f049ff6-7b9c-4374-96ce-5a6c703a3118 None None] Pushing event updated for resources: {'Port': ['ID=b2405e36-5694-4cd4-ae1a-30e33803456e,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:11.971497 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3cb2070d-ae89-4610-bab5-c91b172b43d3 req-905c708f-d4e5-4ba9-8bf6-22f31aba1ae7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:11.989650 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['97360c49-325c-47af-8916-2e920bf107d3'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:55:12.008947 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-905c708f-d4e5-4ba9-8bf6-22f31aba1ae7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event deleted for resources: {'Port': ['ID=97360c49-325c-47af-8916-2e920bf107d3,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:12.047072 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] Set router 9add2ea6-7c71-4404-a87a-19bd194cde59 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:55:12.081519 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-3cb2070d-ae89-4610-bab5-c91b172b43d3 req-905c708f-d4e5-4ba9-8bf6-22f31aba1ae7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] No DVR routers for this DVR port 97360c49-325c-47af-8916-2e920bf107d3 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:55:12.084951 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-3cb2070d-ae89-4610-bab5-c91b172b43d3 req-905c708f-d4e5-4ba9-8bf6-22f31aba1ae7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:12.089689 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3cb2070d-ae89-4610-bab5-c91b172b43d3 req-905c708f-d4e5-4ba9-8bf6-22f31aba1ae7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.10 "DELETE /v2.0/ports/97360c49-325c-47af-8916-2e920bf107d3 HTTP/1.1" status: 204 len: 173 time: 0.6157835 Dec 09 21:55:12.090382 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'aa8d4704-dab9-4d12-971a-6330f2fb603a', 'name': 'network-vif-deleted', 'tag': '97360c49-325c-47af-8916-2e920bf107d3'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:55:12.093147 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f07b1e94-a804-4fec-839d-ad8421a41ce3" -d '{"events": [{"server_uuid": "aa8d4704-dab9-4d12-971a-6330f2fb603a", "name": "network-vif-deleted", "tag": "97360c49-325c-47af-8916-2e920bf107d3"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:55:12.117707 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a13c65b5-0ffc-4380-ae5f-b77bee51e1c1 None None] Provisioning complete for port b2405e36-5694-4cd4-ae1a-30e33803456e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:12.118082 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a13c65b5-0ffc-4380-ae5f-b77bee51e1c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:12.127663 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-f81055b9-4a2d-4f6e-a013-dc87c9e6034c service neutron] 10.222.0.31 "GET /v2.0/networks/942064c7-756f-4754-a77d-0fafe38ff60f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1871424 Dec 09 21:55:12.196520 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:55:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2f7904d6-f8d2-47ca-8e26-1d448c4a0064 x-openstack-request-id: req-2f7904d6-f8d2-47ca-8e26-1d448c4a0064 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:55:12.197058 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "aa8d4704-dab9-4d12-971a-6330f2fb603a", "name": "network-vif-deleted", "tag": "97360c49-325c-47af-8916-2e920bf107d3", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:55:12.197058 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-2f7904d6-f8d2-47ca-8e26-1d448c4a0064 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:55:12.197462 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'aa8d4704-dab9-4d12-971a-6330f2fb603a', 'name': 'network-vif-deleted', 'tag': '97360c49-325c-47af-8916-2e920bf107d3', 'status': 'completed', 'code': 200} Dec 09 21:55:12.229091 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a13c65b5-0ffc-4380-ae5f-b77bee51e1c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:12.288070 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a13c65b5-0ffc-4380-ae5f-b77bee51e1c1 None None] For port b2405e36-5694-4cd4-ae1a-30e33803456e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b2405e36-5694-4cd4-ae1a-30e33803456e,segment=NetworkSegment(d3454a3b-857c-446f-9f63-b9d0ea8cd06f),segment_id=d3454a3b-857c-446f-9f63-b9d0ea8cd06f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:12.306753 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a13c65b5-0ffc-4380-ae5f-b77bee51e1c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:12.316945 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4b056808-cc5b-4096-8d2b-70927c5cfb4a req-b75d078d-0285-4f74-9186-e048997971fe service neutron] 10.222.0.31 "GET /v2.0/networks/942064c7-756f-4754-a77d-0fafe38ff60f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1738541 Dec 09 21:55:12.424964 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d38bb7fc-3875-4c26-b8a5-38f4a3275714 req-427e4dcd-4bcd-4a93-9e15-fd9447366e6b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:12.426754 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d38bb7fc-3875-4c26-b8a5-38f4a3275714 req-427e4dcd-4bcd-4a93-9e15-fd9447366e6b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=fadc53efe432454da595fb0618fbe948&device_id=1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee HTTP/1.1" status: 200 len: 1096 time: 0.0652685 Dec 09 21:55:12.433044 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a13c65b5-0ffc-4380-ae5f-b77bee51e1c1 None None] Pushing event updated for resources: {'Port': ['ID=b2405e36-5694-4cd4-ae1a-30e33803456e,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:12.479426 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9add2ea6-7c71-4404-a87a-19bd194cde59', 'name': 'tempest-TestServerMultinode-1041862185-router', 'tenant_id': 'fadc53efe432454da595fb0618fbe948', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.174'}], 'enable_snat': True}, 'gw_port_id': 'b3895463-dfd0-4aa2-b3a3-b265816b639a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:55:03Z', 'updated_at': '2021-12-09T21:55:06Z', 'revision_number': 4, 'project_id': 'fadc53efe432454da595fb0618fbe948', 'gw_port': {'id': 'b3895463-dfd0-4aa2-b3a3-b265816b639a', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:f6:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9add2ea6-7c71-4404-a87a-19bd194cde59', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3974, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.174', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:55:04Z', 'updated_at': '2021-12-09T21:55:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'b2405e36-5694-4cd4-ae1a-30e33803456e', 'name': '', 'network_id': '3b1f160d-45e8-4246-9496-3beebccaa493', 'tenant_id': 'fadc53efe432454da595fb0618fbe948', 'mac_address': 'fa:16:3e:ac:99:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9add2ea6-7c71-4404-a87a-19bd194cde59', 'device_owner': 'network:router_interface', 'standard_attr_id': 3975, 'fixed_ips': [{'subnet_id': '19eb8709-f745-473a-862f-c0d2fdb14a6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:55:06Z', 'updated_at': '2021-12-09T21:55:11Z', 'revision_number': 4, 'project_id': 'fadc53efe432454da595fb0618fbe948', 'subnets': [{'id': '19eb8709-f745-473a-862f-c0d2fdb14a6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:12.487324 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66d1bc9c-4c6b-4123-9278-a396f6b2d4d9 req-f0c96513-e865-4e76-835c-c1d93d7b0b18 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 210 time: 0.0631907 Dec 09 21:55:12.515408 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fbd15446-60a1-41a9-a4fe-c25999acc8c9 None None] The sync data for ids ['9add2ea6-7c71-4404-a87a-19bd194cde59'] in n-d-713301-27 is: [{'id': '9add2ea6-7c71-4404-a87a-19bd194cde59', 'name': 'tempest-TestServerMultinode-1041862185-router', 'tenant_id': 'fadc53efe432454da595fb0618fbe948', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.174'}], 'enable_snat': True}, 'gw_port_id': 'b3895463-dfd0-4aa2-b3a3-b265816b639a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:55:03Z', 'updated_at': '2021-12-09T21:55:06Z', 'revision_number': 4, 'project_id': 'fadc53efe432454da595fb0618fbe948', 'gw_port': {'id': 'b3895463-dfd0-4aa2-b3a3-b265816b639a', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:f6:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9add2ea6-7c71-4404-a87a-19bd194cde59', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3974, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.174', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:55:04Z', 'updated_at': '2021-12-09T21:55:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'b2405e36-5694-4cd4-ae1a-30e33803456e', 'name': '', 'network_id': '3b1f160d-45e8-4246-9496-3beebccaa493', 'tenant_id': 'fadc53efe432454da595fb0618fbe948', 'mac_address': 'fa:16:3e:ac:99:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9add2ea6-7c71-4404-a87a-19bd194cde59', 'device_owner': 'network:router_interface', 'standard_attr_id': 3975, 'fixed_ips': [{'subnet_id': '19eb8709-f745-473a-862f-c0d2fdb14a6a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:55:06Z', 'updated_at': '2021-12-09T21:55:11Z', 'revision_number': 4, 'project_id': 'fadc53efe432454da595fb0618fbe948', 'subnets': [{'id': '19eb8709-f745-473a-862f-c0d2fdb14a6a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:55:12.535479 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d38bb7fc-3875-4c26-b8a5-38f4a3275714 req-5d82bed5-4516-4b24-a296-7deb1fcbd176 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:12.535796 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-103b7d73-b1c7-448f-a78a-57f7bdce847d None None] Provisioning complete for port b2405e36-5694-4cd4-ae1a-30e33803456e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:12.536242 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-103b7d73-b1c7-448f-a78a-57f7bdce847d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:12.537137 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d38bb7fc-3875-4c26-b8a5-38f4a3275714 req-5d82bed5-4516-4b24-a296-7deb1fcbd176 service neutron] 10.222.0.31 "GET /v2.0/networks?id=942064c7-756f-4754-a77d-0fafe38ff60f HTTP/1.1" status: 200 len: 910 time: 0.1027679 Dec 09 21:55:12.597588 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d38bb7fc-3875-4c26-b8a5-38f4a3275714 req-be672db9-78eb-4061-ab52-4e400fefb156 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b4227972-6565-4adb-b0ec-462b6105136a HTTP/1.1" status: 200 len: 217 time: 0.0516016 Dec 09 21:55:12.663823 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d38bb7fc-3875-4c26-b8a5-38f4a3275714 req-5f4d0656-30a1-4d0d-8403-e7fccf7c4e59 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:12.665400 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d38bb7fc-3875-4c26-b8a5-38f4a3275714 req-5f4d0656-30a1-4d0d-8403-e7fccf7c4e59 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=052fcd50-6803-4f87-8dfb-d2c1cc2fb02e HTTP/1.1" status: 200 len: 848 time: 0.0601442 Dec 09 21:55:12.723155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d38bb7fc-3875-4c26-b8a5-38f4a3275714 req-3c52e960-54d1-4652-821f-6c7c6c4b75e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:12.725068 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d38bb7fc-3875-4c26-b8a5-38f4a3275714 req-3c52e960-54d1-4652-821f-6c7c6c4b75e2 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=942064c7-756f-4754-a77d-0fafe38ff60f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0517969 Dec 09 21:55:12.780095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c20168f2-2b0f-443d-82a8-d025b8752e14 req-719853c8-70d1-469b-bb7d-0c9bdd9b3c9b tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:12.781877 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c20168f2-2b0f-443d-82a8-d025b8752e14 req-719853c8-70d1-469b-bb7d-0c9bdd9b3c9b tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee HTTP/1.1" status: 200 len: 1096 time: 0.0455897 Dec 09 21:55:12.848007 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c20168f2-2b0f-443d-82a8-d025b8752e14 req-18eb9342-cee8-497e-9062-bf914c6713b4 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595293 Dec 09 21:55:12.848642 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d38bb7fc-3875-4c26-b8a5-38f4a3275714 req-ac5a311d-7dab-4a53-adcc-0e6fd44ea5e6 service neutron] 10.222.0.31 "GET /v2.0/networks/942064c7-756f-4754-a77d-0fafe38ff60f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1150150 Dec 09 21:55:12.950532 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d38bb7fc-3875-4c26-b8a5-38f4a3275714 req-80678a1e-9b63-4811-8505-5c1ea3268782 service neutron] 10.222.0.31 "GET /v2.0/networks/942064c7-756f-4754-a77d-0fafe38ff60f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0936193 Dec 09 21:55:13.209747 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b2405e36-5694-4cd4-ae1a-30e33803456e up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:55:13.264997 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port b2405e36-5694-4cd4-ae1a-30e33803456e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:13.265359 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:13.585747 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc00e4ee-2a43-4d7d-8c5c-90f416fd6e54 req-0869064e-61f8-486a-9f95-de6897f7c898 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 210 time: 0.0271680 Dec 09 21:55:13.955696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a7ca035-a84e-4574-b011-f54994e5839a req-09561517-9965-441b-910d-c542d11a87cb tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:13.957301 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a7ca035-a84e-4574-b011-f54994e5839a req-09561517-9965-441b-910d-c542d11a87cb tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee HTTP/1.1" status: 200 len: 1096 time: 0.0421517 Dec 09 21:55:14.005621 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a7ca035-a84e-4574-b011-f54994e5839a req-fdd988e3-01f7-4f2d-933d-9b419c485386 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419629 Dec 09 21:55:14.593602 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 97360c49-325c-47af-8916-2e920bf107d3 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:55:14.614751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 97360c49-325c-47af-8916-2e920bf107d3 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:55:14.614751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 97360c49-325c-47af-8916-2e920bf107d3 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:55:14.683170 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-23251b85-8dd0-4d1e-ac9a-c62cc8389f2e req-605e8005-fb64-4eb6-bd8c-6d06eedc6519 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 210 time: 0.0265820 Dec 09 21:55:15.118538 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a18824f5-2edd-46dc-82a0-06fe4593bb7f req-2ac22e1d-2d0a-4a2b-9d51-99771cf76503 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:15.119725 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a18824f5-2edd-46dc-82a0-06fe4593bb7f req-2ac22e1d-2d0a-4a2b-9d51-99771cf76503 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee HTTP/1.1" status: 200 len: 1096 time: 0.0446398 Dec 09 21:55:15.165759 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a18824f5-2edd-46dc-82a0-06fe4593bb7f req-fd173f88-ae23-4661-a967-2e88adc439ec tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388284 Dec 09 21:55:15.782207 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0716a623-ec08-4444-93bc-c76da55635cb req-c6bce5dc-d380-407c-a76d-ecf7f13df648 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 210 time: 0.0262847 Dec 09 21:55:16.276147 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba534826-fa5f-4625-b51e-7d0f51124dff req-3a639bcf-05e1-4356-a1d3-8ccc445a45c2 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:16.277790 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba534826-fa5f-4625-b51e-7d0f51124dff req-3a639bcf-05e1-4356-a1d3-8ccc445a45c2 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee HTTP/1.1" status: 200 len: 1096 time: 0.0420859 Dec 09 21:55:16.322670 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba534826-fa5f-4625-b51e-7d0f51124dff req-9ce3de31-6dca-4411-bb3e-4443539366dd tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382118 Dec 09 21:55:16.513691 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device b4227972-6565-4adb-b0ec-462b6105136a details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:55:16.611578 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port b4227972-6565-4adb-b0ec-462b6105136a, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b4227972-6565-4adb-b0ec-462b6105136a,segment=NetworkSegment(0d6ecccc-88ae-48f3-a22d-f126ecb40d84),segment_id=0d6ecccc-88ae-48f3-a22d-f126ecb40d84)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:16.627159 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'b4227972-6565-4adb-b0ec-462b6105136a', 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f', 'port_id': 'b4227972-6565-4adb-b0ec-462b6105136a', 'mac_address': 'fa:16:3e:e3:6e:b8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 136, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '052fcd50-6803-4f87-8dfb-d2c1cc2fb02e', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:55:16.667142 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:16.681014 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b4227972-6565-4adb-b0ec-462b6105136a {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:55:16.701346 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port b4227972-6565-4adb-b0ec-462b6105136a, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b4227972-6565-4adb-b0ec-462b6105136a,segment=NetworkSegment(0d6ecccc-88ae-48f3-a22d-f126ecb40d84),segment_id=0d6ecccc-88ae-48f3-a22d-f126ecb40d84)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:16.706122 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:16.756345 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=b4227972-6565-4adb-b0ec-462b6105136a,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:16.913186 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d0c6ba2-5895-4e83-a70b-483f590f47a7 req-496b7b04-e24e-4d94-9276-01245fcdbeee tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa8d4704-dab9-4d12-971a-6330f2fb603a HTTP/1.1" status: 200 len: 210 time: 0.0420735 Dec 09 21:55:16.952611 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['b4227972-6565-4adb-b0ec-462b6105136a'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:55:17.436565 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51eec52c-19cb-4edc-94af-6269ece07b40 req-e2757cc4-9edb-46cf-bb70-902470445034 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:17.438084 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51eec52c-19cb-4edc-94af-6269ece07b40 req-e2757cc4-9edb-46cf-bb70-902470445034 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee HTTP/1.1" status: 200 len: 1097 time: 0.0407887 Dec 09 21:55:17.484702 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51eec52c-19cb-4edc-94af-6269ece07b40 req-31d437b3-1324-4b8c-8352-4ba6a2fd09ff tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0375102 Dec 09 21:55:18.529885 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device b4227972-6565-4adb-b0ec-462b6105136a up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:55:18.580001 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port b4227972-6565-4adb-b0ec-462b6105136a completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:55:18.585037 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port b4227972-6565-4adb-b0ec-462b6105136a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:18.585572 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:18.597097 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15eab86f-a060-4e9f-81ef-8304f35548cf req-4058359b-164b-4df6-8373-c0b6cae846d4 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:18.598653 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15eab86f-a060-4e9f-81ef-8304f35548cf req-4058359b-164b-4df6-8373-c0b6cae846d4 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee HTTP/1.1" status: 200 len: 1097 time: 0.0432494 Dec 09 21:55:18.644455 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15eab86f-a060-4e9f-81ef-8304f35548cf req-09278d00-4322-4bfd-806f-c8d8cae36f7b tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389805 Dec 09 21:55:18.677411 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:18.700890 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b4227972-6565-4adb-b0ec-462b6105136a'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:55:18.704162 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3760b7ef-9122-41d8-b243-0cdfba618bcb" -d '{"events": [{"server_uuid": "1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee", "name": "network-vif-plugged", "status": "completed", "tag": "b4227972-6565-4adb-b0ec-462b6105136a"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:55:18.717115 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port b4227972-6565-4adb-b0ec-462b6105136a, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b4227972-6565-4adb-b0ec-462b6105136a,segment=NetworkSegment(0d6ecccc-88ae-48f3-a22d-f126ecb40d84),segment_id=0d6ecccc-88ae-48f3-a22d-f126ecb40d84)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:18.721625 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:18.749700 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:55:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-61eefe5e-bbee-4329-9759-3e59a484000f x-openstack-request-id: req-61eefe5e-bbee-4329-9759-3e59a484000f {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:55:18.750431 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee", "name": "network-vif-plugged", "status": "completed", "tag": "b4227972-6565-4adb-b0ec-462b6105136a", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:55:18.750711 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-61eefe5e-bbee-4329-9759-3e59a484000f {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:55:18.751750 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b4227972-6565-4adb-b0ec-462b6105136a', 'code': 200} Dec 09 21:55:18.779283 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=b4227972-6565-4adb-b0ec-462b6105136a,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:18.863777 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-935e54ce-6ea1-4b9f-8958-413cb03192d3 req-59c06951-5188-4b21-b6b9-1f92597fd258 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:18.865342 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-935e54ce-6ea1-4b9f-8958-413cb03192d3 req-59c06951-5188-4b21-b6b9-1f92597fd258 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee HTTP/1.1" status: 200 len: 1098 time: 0.0481875 Dec 09 21:55:18.915253 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-935e54ce-6ea1-4b9f-8958-413cb03192d3 req-b584514b-00fc-4232-b386-9a114ef6784b service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411022 Dec 09 21:55:19.761108 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6958e1f-f808-412d-b97b-57941d4462b2 req-517ba759-f067-465a-8a2a-2a15fd173678 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:19.762794 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6958e1f-f808-412d-b97b-57941d4462b2 req-517ba759-f067-465a-8a2a-2a15fd173678 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee HTTP/1.1" status: 200 len: 1098 time: 0.0462120 Dec 09 21:55:19.808197 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6958e1f-f808-412d-b97b-57941d4462b2 req-ddf30e12-ddc6-4c7e-8667-993d0c19b5c1 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392573 Dec 09 21:55:20.924085 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06df50f6-b840-44d5-b434-bcb3c53f6eb4 req-173031a5-db67-4ff4-a480-c14b0e3c1027 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:20.925676 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-06df50f6-b840-44d5-b434-bcb3c53f6eb4 req-173031a5-db67-4ff4-a480-c14b0e3c1027 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee HTTP/1.1" status: 200 len: 1098 time: 0.0455656 Dec 09 21:55:20.971952 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-06df50f6-b840-44d5-b434-bcb3c53f6eb4 req-48f5cff3-8789-45f8-bd2a-e4a3c984ed7d tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400889 Dec 09 21:55:21.085845 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc64e398-7f3f-41f1-99db-3bededb6bd08 req-9bbae6b7-c93d-4eb3-a5aa-f10530338923 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:21.092041 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc64e398-7f3f-41f1-99db-3bededb6bd08 req-9bbae6b7-c93d-4eb3-a5aa-f10530338923 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee HTTP/1.1" status: 200 len: 1098 time: 0.0497880 Dec 09 21:55:21.138304 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc64e398-7f3f-41f1-99db-3bededb6bd08 req-356466ce-119c-4f26-8aa5-1eacd679eba3 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444398 Dec 09 21:55:21.251252 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40a29d23-1b3b-4a01-8cee-7f7fca95bd5e req-fe3d6494-c7eb-495a-9890-1fd72aa9b8c2 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:21.253116 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-40a29d23-1b3b-4a01-8cee-7f7fca95bd5e req-fe3d6494-c7eb-495a-9890-1fd72aa9b8c2 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee HTTP/1.1" status: 200 len: 1098 time: 0.0480843 Dec 09 21:55:21.309467 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-40a29d23-1b3b-4a01-8cee-7f7fca95bd5e req-d743361d-f553-4010-9cc8-ae097eddfc15 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498543 Dec 09 21:55:21.541886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-77d9e95d-254b-4672-a59a-6d3a4bc88d3a tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:21.543774 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-77d9e95d-254b-4672-a59a-6d3a4bc88d3a tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/networks?id=942064c7-756f-4754-a77d-0fafe38ff60f HTTP/1.1" status: 200 len: 910 time: 0.0949004 Dec 09 21:55:21.567589 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-481a1c98-c527-4fe8-b4fc-edc2e07ea6a8 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/quotas/fadc53efe432454da595fb0618fbe948 HTTP/1.1" status: 200 len: 375 time: 0.0094390 Dec 09 21:55:21.620086 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-41f5306a-5492-4938-9fbe-1c7e8033f69d tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?tenant_id=fadc53efe432454da595fb0618fbe948&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0453730 Dec 09 21:55:21.637588 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-691ac00b-c780-4ce6-a0af-4fc9e9fba259 req-a6933278-686a-4749-83dd-c4501861d06b service neutron] (103437) timed out ('10.222.0.10', 63863) {{(pid=103437) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 09 21:55:21.718136 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-a07fde23-7b4d-4c05-ba03-85d0f23d6533 service neutron] 10.222.0.13 "GET /v2.0/networks/942064c7-756f-4754-a77d-0fafe38ff60f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0897415 Dec 09 21:55:21.827490 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-1ace5df7-885c-4461-90ff-81f038a0b64f service neutron] 10.222.0.13 "GET /v2.0/networks/942064c7-756f-4754-a77d-0fafe38ff60f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1006217 Dec 09 21:55:22.017350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5fb69bc3-1940-4f50-b92c-eb56ca2184ec req-826b2eff-f26b-4dbf-aa3e-1b12c1b089ff tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=33fb03e3-a8aa-405f-9b46-e805f5ff1234 HTTP/1.1" status: 200 len: 210 time: 0.0371819 Dec 09 21:55:23.008444 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-13d5bda3-b515-4101-a825-8c8f2e2c8de1 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:23.009919 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-13d5bda3-b515-4101-a825-8c8f2e2c8de1 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.10 "GET /v2.0/networks?id=942064c7-756f-4754-a77d-0fafe38ff60f HTTP/1.1" status: 200 len: 910 time: 0.0959136 Dec 09 21:55:23.022815 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-e4872657-10b7-454c-bf0f-157ce6f22b07 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Request body: {'port': {'device_id': '33fb03e3-a8aa-405f-9b46-e805f5ff1234', 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f', 'admin_state_up': True, 'tenant_id': 'fadc53efe432454da595fb0618fbe948'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:55:23.051352 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-e4872657-10b7-454c-bf0f-157ce6f22b07 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Made reservation on behalf of fadc53efe432454da595fb0618fbe948 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:55:23.054449 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-e4872657-10b7-454c-bf0f-157ce6f22b07 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:23.141647 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a0bb9c6-e82a-4931-93a8-4c18d04890a6 req-ac0cbc05-5ef1-4176-b34d-723f37e2a5f2 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=33fb03e3-a8aa-405f-9b46-e805f5ff1234 HTTP/1.1" status: 200 len: 210 time: 0.0349016 Dec 09 21:55:23.201535 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-e4872657-10b7-454c-bf0f-157ce6f22b07 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Allocated IP 172.20.0.6 (942064c7-756f-4754-a77d-0fafe38ff60f/052fcd50-6803-4f87-8dfb-d2c1cc2fb02e/7155b379-cb2b-43f4-9434-8e3aafe31c19) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:55:23.340667 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-e4872657-10b7-454c-bf0f-157ce6f22b07 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:23.384857 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-e4872657-10b7-454c-bf0f-157ce6f22b07 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:23.396641 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['b4227972-6565-4adb-b0ec-462b6105136a'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:55:23.438260 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-e4872657-10b7-454c-bf0f-157ce6f22b07 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Network 942064c7-756f-4754-a77d-0fafe38ff60f is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:55:23.443189 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-e4872657-10b7-454c-bf0f-157ce6f22b07 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:55:23.447940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-e4872657-10b7-454c-bf0f-157ce6f22b07 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:55:23.451109 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4872657-10b7-454c-bf0f-157ce6f22b07 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Pushing event updated for resources: {'Port': ['ID=7155b379-cb2b-43f4-9434-8e3aafe31c19,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:23.504980 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-e4872657-10b7-454c-bf0f-157ce6f22b07 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:23.505699 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-e4872657-10b7-454c-bf0f-157ce6f22b07 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:23.533218 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-e4872657-10b7-454c-bf0f-157ce6f22b07 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 1029 time: 0.5142035 Dec 09 21:55:23.549671 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-97fb2cbe-1720-407f-b6aa-b91529aebd21 service neutron] Request body: {'port': {'device_id': '33fb03e3-a8aa-405f-9b46-e805f5ff1234', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:55:23.631077 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-97fb2cbe-1720-407f-b6aa-b91529aebd21 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:23.734098 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b742a617-7152-4ee4-8897-b8a9dcda0104 None None] Provisioning complete for port 7155b379-cb2b-43f4-9434-8e3aafe31c19 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:23.734730 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b742a617-7152-4ee4-8897-b8a9dcda0104 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:23.773555 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-b742a617-7152-4ee4-8897-b8a9dcda0104 None None] Port 7155b379-cb2b-43f4-9434-8e3aafe31c19 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:55:23.961118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-97fb2cbe-1720-407f-b6aa-b91529aebd21 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7155b379-cb2b-43f4-9434-8e3aafe31c19 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:55:23.970441 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-97fb2cbe-1720-407f-b6aa-b91529aebd21 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:23.984523 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-97fb2cbe-1720-407f-b6aa-b91529aebd21 service neutron] Transition to ACTIVE for port object 7155b379-cb2b-43f4-9434-8e3aafe31c19 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:55:23.992833 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-97fb2cbe-1720-407f-b6aa-b91529aebd21 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:24.066833 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97fb2cbe-1720-407f-b6aa-b91529aebd21 service neutron] Pushing event updated for resources: {'Port': ['ID=7155b379-cb2b-43f4-9434-8e3aafe31c19,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:24.132172 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-97fb2cbe-1720-407f-b6aa-b91529aebd21 service neutron] Attempting to bind port 7155b379-cb2b-43f4-9434-8e3aafe31c19 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:55:24.132517 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-97fb2cbe-1720-407f-b6aa-b91529aebd21 service neutron] Attempting to bind port 7155b379-cb2b-43f4-9434-8e3aafe31c19 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '0d6ecccc-88ae-48f3-a22d-f126ecb40d84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:55:24.132876 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-97fb2cbe-1720-407f-b6aa-b91529aebd21 service neutron] Attempting to bind port 7155b379-cb2b-43f4-9434-8e3aafe31c19 on network 942064c7-756f-4754-a77d-0fafe38ff60f {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:55:24.142818 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-97fb2cbe-1720-407f-b6aa-b91529aebd21 service neutron] Port 7155b379-cb2b-43f4-9434-8e3aafe31c19 on network 942064c7-756f-4754-a77d-0fafe38ff60f not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:55:24.143162 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-97fb2cbe-1720-407f-b6aa-b91529aebd21 service neutron] Attempting to bind port 7155b379-cb2b-43f4-9434-8e3aafe31c19 on network 942064c7-756f-4754-a77d-0fafe38ff60f {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:55:24.149241 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-97fb2cbe-1720-407f-b6aa-b91529aebd21 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 54, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:55:24.155742 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-97fb2cbe-1720-407f-b6aa-b91529aebd21 service neutron] Checking segment: {'id': '0d6ecccc-88ae-48f3-a22d-f126ecb40d84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:55:24.155742 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-97fb2cbe-1720-407f-b6aa-b91529aebd21 service neutron] Bound using segment: {'id': '0d6ecccc-88ae-48f3-a22d-f126ecb40d84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:55:24.155742 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-97fb2cbe-1720-407f-b6aa-b91529aebd21 service neutron] Bound port: 7155b379-cb2b-43f4-9434-8e3aafe31c19, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0d6ecccc-88ae-48f3-a22d-f126ecb40d84', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:55:24.155742 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-97fb2cbe-1720-407f-b6aa-b91529aebd21 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:24.264189 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-97fb2cbe-1720-407f-b6aa-b91529aebd21 service neutron] For port 7155b379-cb2b-43f4-9434-8e3aafe31c19, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:55:24.281427 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-97fb2cbe-1720-407f-b6aa-b91529aebd21 service neutron] For port 7155b379-cb2b-43f4-9434-8e3aafe31c19, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=7155b379-cb2b-43f4-9434-8e3aafe31c19,segment=NetworkSegment(0d6ecccc-88ae-48f3-a22d-f126ecb40d84),segment_id=0d6ecccc-88ae-48f3-a22d-f126ecb40d84)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:55:24.287748 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-97fb2cbe-1720-407f-b6aa-b91529aebd21 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:24.329702 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beb1af8a-37ff-48c5-a394-cc0ee2b0e895 req-06cab6c2-8c23-42f1-a061-8d7389915a79 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:24.332181 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-beb1af8a-37ff-48c5-a394-cc0ee2b0e895 req-06cab6c2-8c23-42f1-a061-8d7389915a79 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=33fb03e3-a8aa-405f-9b46-e805f5ff1234 HTTP/1.1" status: 200 len: 1053 time: 0.1054540 Dec 09 21:55:24.344347 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-97fb2cbe-1720-407f-b6aa-b91529aebd21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:24.345386 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-97fb2cbe-1720-407f-b6aa-b91529aebd21 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:24.347004 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-97fb2cbe-1720-407f-b6aa-b91529aebd21 service neutron] 10.222.0.10 "PUT /v2.0/ports/7155b379-cb2b-43f4-9434-8e3aafe31c19 HTTP/1.1" status: 200 len: 1092 time: 0.8046136 Dec 09 21:55:24.347481 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '33fb03e3-a8aa-405f-9b46-e805f5ff1234', 'tag': '7155b379-cb2b-43f4-9434-8e3aafe31c19'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:55:24.350245 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-db900c8e-981e-471c-a103-b8d0c1fa3809" -d '{"events": [{"name": "network-changed", "server_uuid": "33fb03e3-a8aa-405f-9b46-e805f5ff1234", "tag": "7155b379-cb2b-43f4-9434-8e3aafe31c19"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:55:24.435221 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97fb2cbe-1720-407f-b6aa-b91529aebd21 service neutron] Pushing event updated for resources: {'Port': ['ID=7155b379-cb2b-43f4-9434-8e3aafe31c19,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:24.455799 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-beb1af8a-37ff-48c5-a394-cc0ee2b0e895 req-e2b5c27a-0bd2-4649-8fcd-d229df8eb07b tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1137159 Dec 09 21:55:24.469122 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-b3803647-767c-4916-8c07-3147e6eb3f44 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:24.470805 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-b3803647-767c-4916-8c07-3147e6eb3f44 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=fadc53efe432454da595fb0618fbe948&device_id=33fb03e3-a8aa-405f-9b46-e805f5ff1234 HTTP/1.1" status: 200 len: 1095 time: 0.0666227 Dec 09 21:55:24.524622 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:55:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0043001a-51d8-4ce6-ae58-99f35e33236a x-openstack-request-id: req-0043001a-51d8-4ce6-ae58-99f35e33236a {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:55:24.524904 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "33fb03e3-a8aa-405f-9b46-e805f5ff1234", "tag": "7155b379-cb2b-43f4-9434-8e3aafe31c19", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:55:24.525157 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0043001a-51d8-4ce6-ae58-99f35e33236a {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:55:24.525568 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '33fb03e3-a8aa-405f-9b46-e805f5ff1234', 'tag': '7155b379-cb2b-43f4-9434-8e3aafe31c19', 'status': 'completed', 'code': 200} Dec 09 21:55:24.527497 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-52393dbb-572e-4a61-84d5-d0f56d22dc77 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=7155b379-cb2b-43f4-9434-8e3aafe31c19 HTTP/1.1" status: 200 len: 217 time: 0.0455916 Dec 09 21:55:24.578938 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-0c737e25-1b0b-4f57-97c0-9a13b440eb24 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:24.580443 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-0c737e25-1b0b-4f57-97c0-9a13b440eb24 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=052fcd50-6803-4f87-8dfb-d2c1cc2fb02e HTTP/1.1" status: 200 len: 848 time: 0.0467238 Dec 09 21:55:24.633791 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-053de3e3-b0da-4b61-97c9-52449023f763 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:24.635366 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-053de3e3-b0da-4b61-97c9-52449023f763 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=942064c7-756f-4754-a77d-0fafe38ff60f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0462661 Dec 09 21:55:24.728677 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-31a6056d-df1f-477c-b9ce-2d662ac1befe service neutron] 10.222.0.10 "GET /v2.0/networks/942064c7-756f-4754-a77d-0fafe38ff60f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0857966 Dec 09 21:55:25.199463 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38605d3a-047e-4ff4-9dd6-0a53c492a499 req-e2d1434a-6853-44f9-b288-0d750300d5bd service neutron] 10.222.0.10 "GET /v2.0/networks/942064c7-756f-4754-a77d-0fafe38ff60f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4631736 Dec 09 21:55:25.290861 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db900c8e-981e-471c-a103-b8d0c1fa3809 req-f16f5188-98d4-45d5-b91a-5a56ddcbeac2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:25.292421 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db900c8e-981e-471c-a103-b8d0c1fa3809 req-f16f5188-98d4-45d5-b91a-5a56ddcbeac2 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=fadc53efe432454da595fb0618fbe948&device_id=33fb03e3-a8aa-405f-9b46-e805f5ff1234 HTTP/1.1" status: 200 len: 1095 time: 0.0427060 Dec 09 21:55:25.390697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db900c8e-981e-471c-a103-b8d0c1fa3809 req-9846dd63-7162-45da-a2ec-06e2b9e25ff6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:25.392276 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db900c8e-981e-471c-a103-b8d0c1fa3809 req-9846dd63-7162-45da-a2ec-06e2b9e25ff6 service neutron] 10.222.0.10 "GET /v2.0/networks?id=942064c7-756f-4754-a77d-0fafe38ff60f HTTP/1.1" status: 200 len: 910 time: 0.0928380 Dec 09 21:55:25.437719 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db900c8e-981e-471c-a103-b8d0c1fa3809 req-7600c783-ca83-462b-bb5f-eb108c3bff94 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=7155b379-cb2b-43f4-9434-8e3aafe31c19 HTTP/1.1" status: 200 len: 217 time: 0.0384464 Dec 09 21:55:25.490541 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db900c8e-981e-471c-a103-b8d0c1fa3809 req-3db0ac91-2753-495e-8d86-442bddc6d771 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:25.491559 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db900c8e-981e-471c-a103-b8d0c1fa3809 req-3db0ac91-2753-495e-8d86-442bddc6d771 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=052fcd50-6803-4f87-8dfb-d2c1cc2fb02e HTTP/1.1" status: 200 len: 848 time: 0.0459833 Dec 09 21:55:25.568435 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db900c8e-981e-471c-a103-b8d0c1fa3809 req-bd1f8260-de99-4238-85c2-9b6638347def service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:25.569957 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db900c8e-981e-471c-a103-b8d0c1fa3809 req-bd1f8260-de99-4238-85c2-9b6638347def service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=942064c7-756f-4754-a77d-0fafe38ff60f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0706835 Dec 09 21:55:25.588273 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88c23c47-f386-4bc7-a215-43cfd5740d91 req-6d2390be-9f92-4dd9-ba84-db025874ee17 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:25.589739 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-88c23c47-f386-4bc7-a215-43cfd5740d91 req-6d2390be-9f92-4dd9-ba84-db025874ee17 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=33fb03e3-a8aa-405f-9b46-e805f5ff1234 HTTP/1.1" status: 200 len: 1095 time: 0.0557380 Dec 09 21:55:25.686792 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-88c23c47-f386-4bc7-a215-43cfd5740d91 req-7e53e2d3-4574-4bc2-af22-968b57809f40 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0856690 Dec 09 21:55:25.700775 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db900c8e-981e-471c-a103-b8d0c1fa3809 req-80c76f65-8521-4592-a01e-6ed8387ae4d1 service neutron] 10.222.0.10 "GET /v2.0/networks/942064c7-756f-4754-a77d-0fafe38ff60f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1217322 Dec 09 21:55:25.796058 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db900c8e-981e-471c-a103-b8d0c1fa3809 req-504c2ded-5578-4282-b64e-7d7fbd208953 service neutron] 10.222.0.10 "GET /v2.0/networks/942064c7-756f-4754-a77d-0fafe38ff60f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0877407 Dec 09 21:55:26.807775 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d21d4f1b-538b-4bc2-b5d8-161d5fa270ee req-d2c325d2-0b2f-4109-9d82-7a02c6c40a03 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:26.815102 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d21d4f1b-538b-4bc2-b5d8-161d5fa270ee req-d2c325d2-0b2f-4109-9d82-7a02c6c40a03 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=33fb03e3-a8aa-405f-9b46-e805f5ff1234 HTTP/1.1" status: 200 len: 1095 time: 0.0518906 Dec 09 21:55:26.863273 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d21d4f1b-538b-4bc2-b5d8-161d5fa270ee req-dc5c7f8c-3dea-486a-977b-2b0174f800ed tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467510 Dec 09 21:55:27.357843 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:27.611119 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:27.979183 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82953a94-7205-4fb3-9b47-7df04db3aed2 req-d92ae820-e48f-4f9f-93d5-34da3551a7d4 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:27.983954 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-82953a94-7205-4fb3-9b47-7df04db3aed2 req-d92ae820-e48f-4f9f-93d5-34da3551a7d4 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=33fb03e3-a8aa-405f-9b46-e805f5ff1234 HTTP/1.1" status: 200 len: 1095 time: 0.0463116 Dec 09 21:55:28.028987 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-82953a94-7205-4fb3-9b47-7df04db3aed2 req-276fadd4-d2a3-478d-9496-0055ad5b591f tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393431 Dec 09 21:55:28.197795 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:55:28.719304 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 7155b379-cb2b-43f4-9434-8e3aafe31c19 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:55:28.820746 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 7155b379-cb2b-43f4-9434-8e3aafe31c19, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=7155b379-cb2b-43f4-9434-8e3aafe31c19,segment=NetworkSegment(0d6ecccc-88ae-48f3-a22d-f126ecb40d84),segment_id=0d6ecccc-88ae-48f3-a22d-f126ecb40d84)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:28.836033 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '7155b379-cb2b-43f4-9434-8e3aafe31c19', 'network_id': '942064c7-756f-4754-a77d-0fafe38ff60f', 'port_id': '7155b379-cb2b-43f4-9434-8e3aafe31c19', 'mac_address': 'fa:16:3e:ad:74:be', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 136, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '052fcd50-6803-4f87-8dfb-d2c1cc2fb02e', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:55:29.042206 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:29.056078 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7155b379-cb2b-43f4-9434-8e3aafe31c19 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:55:29.077270 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 7155b379-cb2b-43f4-9434-8e3aafe31c19, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=7155b379-cb2b-43f4-9434-8e3aafe31c19,segment=NetworkSegment(0d6ecccc-88ae-48f3-a22d-f126ecb40d84),segment_id=0d6ecccc-88ae-48f3-a22d-f126ecb40d84)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:29.085116 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:29.141122 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=7155b379-cb2b-43f4-9434-8e3aafe31c19,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:29.150136 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9afeb2d8-055b-4292-ac1f-6df42f98fcde req-dd94ef05-b1df-4d00-acc9-17acd8482a49 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:29.156278 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9afeb2d8-055b-4292-ac1f-6df42f98fcde req-dd94ef05-b1df-4d00-acc9-17acd8482a49 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=33fb03e3-a8aa-405f-9b46-e805f5ff1234 HTTP/1.1" status: 200 len: 1096 time: 0.0515714 Dec 09 21:55:29.209977 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9afeb2d8-055b-4292-ac1f-6df42f98fcde req-63160c66-b123-40f4-9666-9ef2769aa3d3 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0466065 Dec 09 21:55:29.294101 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['7155b379-cb2b-43f4-9434-8e3aafe31c19'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:55:30.323033 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3f3090c-2f09-4ee2-9f53-bfa7f0e4a668 req-2904826d-ffc5-46cd-a69c-45ae08e1e1ef tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:30.324915 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b3f3090c-2f09-4ee2-9f53-bfa7f0e4a668 req-2904826d-ffc5-46cd-a69c-45ae08e1e1ef tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=33fb03e3-a8aa-405f-9b46-e805f5ff1234 HTTP/1.1" status: 200 len: 1096 time: 0.0461290 Dec 09 21:55:30.371254 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b3f3090c-2f09-4ee2-9f53-bfa7f0e4a668 req-ce663cf4-661b-4a9a-be76-68dbf22320ff tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391240 Dec 09 21:55:30.733995 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 7155b379-cb2b-43f4-9434-8e3aafe31c19 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:55:30.792561 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 7155b379-cb2b-43f4-9434-8e3aafe31c19 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:55:30.799047 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 7155b379-cb2b-43f4-9434-8e3aafe31c19 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:30.799622 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:30.899822 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:30.926325 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '33fb03e3-a8aa-405f-9b46-e805f5ff1234', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7155b379-cb2b-43f4-9434-8e3aafe31c19'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:55:30.928735 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9da3909f-fdf1-4dc5-a6da-048ab65bde2d" -d '{"events": [{"server_uuid": "33fb03e3-a8aa-405f-9b46-e805f5ff1234", "name": "network-vif-plugged", "status": "completed", "tag": "7155b379-cb2b-43f4-9434-8e3aafe31c19"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:55:30.942368 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 7155b379-cb2b-43f4-9434-8e3aafe31c19, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=7155b379-cb2b-43f4-9434-8e3aafe31c19,segment=NetworkSegment(0d6ecccc-88ae-48f3-a22d-f126ecb40d84),segment_id=0d6ecccc-88ae-48f3-a22d-f126ecb40d84)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:30.949307 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:30.976066 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:55:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-65f36f9c-354b-4eef-84dc-16b817cf9dd4 x-openstack-request-id: req-65f36f9c-354b-4eef-84dc-16b817cf9dd4 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:55:30.976370 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "33fb03e3-a8aa-405f-9b46-e805f5ff1234", "name": "network-vif-plugged", "status": "completed", "tag": "7155b379-cb2b-43f4-9434-8e3aafe31c19", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:55:30.976624 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-65f36f9c-354b-4eef-84dc-16b817cf9dd4 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:55:30.977021 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '33fb03e3-a8aa-405f-9b46-e805f5ff1234', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7155b379-cb2b-43f4-9434-8e3aafe31c19', 'code': 200} Dec 09 21:55:31.004630 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=7155b379-cb2b-43f4-9434-8e3aafe31c19,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:31.076701 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bf302a8-5bfb-4271-9819-a0bf1b630ea5 req-9cf958bf-fa4d-436c-9667-f66e12346985 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:31.078259 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1bf302a8-5bfb-4271-9819-a0bf1b630ea5 req-9cf958bf-fa4d-436c-9667-f66e12346985 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=33fb03e3-a8aa-405f-9b46-e805f5ff1234 HTTP/1.1" status: 200 len: 1097 time: 0.0426953 Dec 09 21:55:31.128979 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1bf302a8-5bfb-4271-9819-a0bf1b630ea5 req-50fa3ddc-8aa6-4d2c-a168-ce4bc02a825f service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435960 Dec 09 21:55:31.489269 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6402234-c7cb-454f-9479-8f090265e058 req-e680114f-939d-4a40-9da3-6fbb41228dd8 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:31.490811 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6402234-c7cb-454f-9479-8f090265e058 req-e680114f-939d-4a40-9da3-6fbb41228dd8 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=33fb03e3-a8aa-405f-9b46-e805f5ff1234 HTTP/1.1" status: 200 len: 1097 time: 0.0404866 Dec 09 21:55:31.539967 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6402234-c7cb-454f-9479-8f090265e058 req-781d4e67-aa61-49fb-9145-64197d457beb tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430539 Dec 09 21:55:32.648416 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74aefa53-23a5-451e-a0d0-19c0b9e79eea req-a34601a8-ae73-4901-8c1f-2bed42ad2657 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:32.650736 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-74aefa53-23a5-451e-a0d0-19c0b9e79eea req-a34601a8-ae73-4901-8c1f-2bed42ad2657 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=33fb03e3-a8aa-405f-9b46-e805f5ff1234 HTTP/1.1" status: 200 len: 1097 time: 0.0428231 Dec 09 21:55:32.699675 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-74aefa53-23a5-451e-a0d0-19c0b9e79eea req-7bf0177d-b5cf-4b25-8ec2-13189f3e43f7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390501 Dec 09 21:55:32.813393 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cf54592-4d28-4e86-955f-e0fd3a15eae6 req-9472a32b-288e-4440-85e9-19d628db5917 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:32.814990 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9cf54592-4d28-4e86-955f-e0fd3a15eae6 req-9472a32b-288e-4440-85e9-19d628db5917 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=33fb03e3-a8aa-405f-9b46-e805f5ff1234 HTTP/1.1" status: 200 len: 1097 time: 0.0434558 Dec 09 21:55:32.861762 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9cf54592-4d28-4e86-955f-e0fd3a15eae6 req-617944af-c89a-4431-a017-8f321c5e0c8c tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402267 Dec 09 21:55:32.971918 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e253a4a5-aa56-4445-b3df-1544006ede21 req-34644228-51af-4c00-a847-845aba8d5131 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:32.973698 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e253a4a5-aa56-4445-b3df-1544006ede21 req-34644228-51af-4c00-a847-845aba8d5131 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=33fb03e3-a8aa-405f-9b46-e805f5ff1234 HTTP/1.1" status: 200 len: 1097 time: 0.0472450 Dec 09 21:55:32.974695 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d6b5e28b-9183-4f14-af36-19d05314d06c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:33.024942 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e253a4a5-aa56-4445-b3df-1544006ede21 req-8d680f44-bc64-485d-bc74-ee6acd381c0a tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416026 Dec 09 21:55:33.280599 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da828a3c-211e-4600-8d2a-86a528627ae4 req-fc889889-924d-49c8-a183-7601a1e40716 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:33.282162 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da828a3c-211e-4600-8d2a-86a528627ae4 req-fc889889-924d-49c8-a183-7601a1e40716 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=33fb03e3-a8aa-405f-9b46-e805f5ff1234 HTTP/1.1" status: 200 len: 1097 time: 0.0425048 Dec 09 21:55:33.328105 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da828a3c-211e-4600-8d2a-86a528627ae4 req-3b3bb273-4df8-4783-b1ad-14ef5d6943d4 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398870 Dec 09 21:55:34.441993 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71f3c122-d25a-448c-8bed-5f6706bf4605 req-432d93a6-3ce6-4835-81a8-81de5557d5e4 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:34.443380 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71f3c122-d25a-448c-8bed-5f6706bf4605 req-432d93a6-3ce6-4835-81a8-81de5557d5e4 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=33fb03e3-a8aa-405f-9b46-e805f5ff1234 HTTP/1.1" status: 200 len: 1097 time: 0.0447521 Dec 09 21:55:34.509944 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71f3c122-d25a-448c-8bed-5f6706bf4605 req-c5ddeca2-d4e5-412a-81dd-05f8b00ef378 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0599711 Dec 09 21:55:34.522958 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-001eb69e-95ec-4a30-a9e3-6f9f59c47fb8 req-7de247f8-3a21-48fe-a4ca-9ac586358495 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:34.524589 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-001eb69e-95ec-4a30-a9e3-6f9f59c47fb8 req-7de247f8-3a21-48fe-a4ca-9ac586358495 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.10 "GET /v2.0/ports?device_id=33fb03e3-a8aa-405f-9b46-e805f5ff1234 HTTP/1.1" status: 200 len: 1097 time: 0.0466361 Dec 09 21:55:34.605953 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-001eb69e-95ec-4a30-a9e3-6f9f59c47fb8 req-6658a600-e7dc-4fe8-b4b7-23e2d2e82384 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Deleting port 7155b379-cb2b-43f4-9434-8e3aafe31c19 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:55:34.606232 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-001eb69e-95ec-4a30-a9e3-6f9f59c47fb8 req-6658a600-e7dc-4fe8-b4b7-23e2d2e82384 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:34.687674 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-001eb69e-95ec-4a30-a9e3-6f9f59c47fb8 req-6658a600-e7dc-4fe8-b4b7-23e2d2e82384 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] For port 7155b379-cb2b-43f4-9434-8e3aafe31c19, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=7155b379-cb2b-43f4-9434-8e3aafe31c19,segment=NetworkSegment(0d6ecccc-88ae-48f3-a22d-f126ecb40d84),segment_id=0d6ecccc-88ae-48f3-a22d-f126ecb40d84)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:34.687997 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-001eb69e-95ec-4a30-a9e3-6f9f59c47fb8 req-6658a600-e7dc-4fe8-b4b7-23e2d2e82384 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:34.700467 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-001eb69e-95ec-4a30-a9e3-6f9f59c47fb8 req-6658a600-e7dc-4fe8-b4b7-23e2d2e82384 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Calling delete_port for 7155b379-cb2b-43f4-9434-8e3aafe31c19 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:55:34.831299 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-001eb69e-95ec-4a30-a9e3-6f9f59c47fb8 req-6658a600-e7dc-4fe8-b4b7-23e2d2e82384 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:34.843835 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['7155b379-cb2b-43f4-9434-8e3aafe31c19'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:55:34.851115 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['b4227972-6565-4adb-b0ec-462b6105136a'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:55:34.863892 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6658a600-e7dc-4fe8-b4b7-23e2d2e82384 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Pushing event deleted for resources: {'Port': ['ID=7155b379-cb2b-43f4-9434-8e3aafe31c19,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:34.915180 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-001eb69e-95ec-4a30-a9e3-6f9f59c47fb8 req-6658a600-e7dc-4fe8-b4b7-23e2d2e82384 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] No DVR routers for this DVR port 7155b379-cb2b-43f4-9434-8e3aafe31c19 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:55:34.917363 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6658a600-e7dc-4fe8-b4b7-23e2d2e82384 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:34.917764 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6658a600-e7dc-4fe8-b4b7-23e2d2e82384 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:34.918153 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6658a600-e7dc-4fe8-b4b7-23e2d2e82384 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:34.918920 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6658a600-e7dc-4fe8-b4b7-23e2d2e82384 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:34.919062 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6658a600-e7dc-4fe8-b4b7-23e2d2e82384 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:34.919363 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6658a600-e7dc-4fe8-b4b7-23e2d2e82384 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:34.919721 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6658a600-e7dc-4fe8-b4b7-23e2d2e82384 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:34.920050 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6658a600-e7dc-4fe8-b4b7-23e2d2e82384 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:34.920363 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6658a600-e7dc-4fe8-b4b7-23e2d2e82384 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:34.920688 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6658a600-e7dc-4fe8-b4b7-23e2d2e82384 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:34.921004 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6658a600-e7dc-4fe8-b4b7-23e2d2e82384 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:34.921323 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6658a600-e7dc-4fe8-b4b7-23e2d2e82384 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:34.921638 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6658a600-e7dc-4fe8-b4b7-23e2d2e82384 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:34.925046 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-001eb69e-95ec-4a30-a9e3-6f9f59c47fb8 req-6658a600-e7dc-4fe8-b4b7-23e2d2e82384 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:34.928389 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-001eb69e-95ec-4a30-a9e3-6f9f59c47fb8 req-6658a600-e7dc-4fe8-b4b7-23e2d2e82384 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.10 "DELETE /v2.0/ports/7155b379-cb2b-43f4-9434-8e3aafe31c19 HTTP/1.1" status: 204 len: 173 time: 0.3968341 Dec 09 21:55:34.928843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '33fb03e3-a8aa-405f-9b46-e805f5ff1234', 'name': 'network-vif-deleted', 'tag': '7155b379-cb2b-43f4-9434-8e3aafe31c19'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:55:34.931096 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7c27a0ca-9ecf-48bd-a9cb-e7e5d8affcf6" -d '{"events": [{"server_uuid": "33fb03e3-a8aa-405f-9b46-e805f5ff1234", "name": "network-vif-deleted", "tag": "7155b379-cb2b-43f4-9434-8e3aafe31c19"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:55:34.988819 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:55:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ce08bf87-417b-406b-b3b2-70c747948b51 x-openstack-request-id: req-ce08bf87-417b-406b-b3b2-70c747948b51 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:55:34.989483 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "33fb03e3-a8aa-405f-9b46-e805f5ff1234", "name": "network-vif-deleted", "tag": "7155b379-cb2b-43f4-9434-8e3aafe31c19", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:55:34.989797 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-ce08bf87-417b-406b-b3b2-70c747948b51 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:55:34.990268 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '33fb03e3-a8aa-405f-9b46-e805f5ff1234', 'name': 'network-vif-deleted', 'tag': '7155b379-cb2b-43f4-9434-8e3aafe31c19', 'status': 'completed', 'code': 200} Dec 09 21:55:35.579993 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-71cc725c-3624-4477-b3ad-71bcbd908e15 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:35.790186 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64e9b317-fc22-496c-a2f3-77d4341be955 req-8a0a5b1e-478d-48ec-976a-eac805bf4847 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:35.792562 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-64e9b317-fc22-496c-a2f3-77d4341be955 req-8a0a5b1e-478d-48ec-976a-eac805bf4847 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee HTTP/1.1" status: 200 len: 1098 time: 0.0447128 Dec 09 21:55:35.848828 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-64e9b317-fc22-496c-a2f3-77d4341be955 req-a8364586-64da-4bf5-8223-c60b38862a07 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495574 Dec 09 21:55:36.699304 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:36.962780 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18eb6cb1-e335-47bb-8f6f-4704d76b34d2 req-e8ef7a9d-a9f5-4a81-af23-b17e3be98aa7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:36.964315 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-18eb6cb1-e335-47bb-8f6f-4704d76b34d2 req-e8ef7a9d-a9f5-4a81-af23-b17e3be98aa7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee HTTP/1.1" status: 200 len: 1098 time: 0.0418246 Dec 09 21:55:37.009990 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-18eb6cb1-e335-47bb-8f6f-4704d76b34d2 req-c6ffb630-957c-40be-ae1b-00f16a6c42d9 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/security-groups?id=191aace8-55a0-479e-b6ec-3e59836d90b8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394392 Dec 09 21:55:37.068662 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7fd82fd-2939-4f39-8c18-15ceea1a0c6a req-7b811b96-a9de-44c8-b07e-8d8f59d736dd tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:37.070247 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f7fd82fd-2939-4f39-8c18-15ceea1a0c6a req-7b811b96-a9de-44c8-b07e-8d8f59d736dd tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.31 "GET /v2.0/ports?device_id=1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee HTTP/1.1" status: 200 len: 1098 time: 0.0431068 Dec 09 21:55:37.154820 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-f7fd82fd-2939-4f39-8c18-15ceea1a0c6a req-7d6b4dfd-beb2-43c5-ae19-f2927d4585e7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Deleting port b4227972-6565-4adb-b0ec-462b6105136a {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:55:37.155166 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f7fd82fd-2939-4f39-8c18-15ceea1a0c6a req-7d6b4dfd-beb2-43c5-ae19-f2927d4585e7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:37.239312 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-f7fd82fd-2939-4f39-8c18-15ceea1a0c6a req-7d6b4dfd-beb2-43c5-ae19-f2927d4585e7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] For port b4227972-6565-4adb-b0ec-462b6105136a, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=b4227972-6565-4adb-b0ec-462b6105136a,segment=NetworkSegment(0d6ecccc-88ae-48f3-a22d-f126ecb40d84),segment_id=0d6ecccc-88ae-48f3-a22d-f126ecb40d84)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:37.239705 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f7fd82fd-2939-4f39-8c18-15ceea1a0c6a req-7d6b4dfd-beb2-43c5-ae19-f2927d4585e7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:37.256092 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-f7fd82fd-2939-4f39-8c18-15ceea1a0c6a req-7d6b4dfd-beb2-43c5-ae19-f2927d4585e7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Calling delete_port for b4227972-6565-4adb-b0ec-462b6105136a owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:55:37.389036 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f7fd82fd-2939-4f39-8c18-15ceea1a0c6a req-7d6b4dfd-beb2-43c5-ae19-f2927d4585e7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:37.400126 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['b4227972-6565-4adb-b0ec-462b6105136a'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:55:37.417498 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d6b4dfd-beb2-43c5-ae19-f2927d4585e7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Pushing event deleted for resources: {'Port': ['ID=b4227972-6565-4adb-b0ec-462b6105136a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:37.442730 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6b4dfd-beb2-43c5-ae19-f2927d4585e7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:37.443055 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6b4dfd-beb2-43c5-ae19-f2927d4585e7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:37.443391 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6b4dfd-beb2-43c5-ae19-f2927d4585e7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:37.443787 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6b4dfd-beb2-43c5-ae19-f2927d4585e7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:37.444142 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6b4dfd-beb2-43c5-ae19-f2927d4585e7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:37.444474 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6b4dfd-beb2-43c5-ae19-f2927d4585e7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:37.444801 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6b4dfd-beb2-43c5-ae19-f2927d4585e7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:37.445125 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6b4dfd-beb2-43c5-ae19-f2927d4585e7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:37.445419 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6b4dfd-beb2-43c5-ae19-f2927d4585e7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:37.445775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6b4dfd-beb2-43c5-ae19-f2927d4585e7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:37.446096 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6b4dfd-beb2-43c5-ae19-f2927d4585e7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:37.446410 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6b4dfd-beb2-43c5-ae19-f2927d4585e7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:37.446740 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7d6b4dfd-beb2-43c5-ae19-f2927d4585e7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:55:37.467925 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-f7fd82fd-2939-4f39-8c18-15ceea1a0c6a req-7d6b4dfd-beb2-43c5-ae19-f2927d4585e7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] No DVR routers for this DVR port b4227972-6565-4adb-b0ec-462b6105136a on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:55:37.470964 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f7fd82fd-2939-4f39-8c18-15ceea1a0c6a req-7d6b4dfd-beb2-43c5-ae19-f2927d4585e7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:37.474490 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f7fd82fd-2939-4f39-8c18-15ceea1a0c6a req-7d6b4dfd-beb2-43c5-ae19-f2927d4585e7 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.31 "DELETE /v2.0/ports/b4227972-6565-4adb-b0ec-462b6105136a HTTP/1.1" status: 204 len: 173 time: 0.3970175 Dec 09 21:55:37.474943 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee', 'name': 'network-vif-deleted', 'tag': 'b4227972-6565-4adb-b0ec-462b6105136a'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:55:37.477255 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-10f6fd52-7f66-4bc4-85fd-a6325d7c1257" -d '{"events": [{"server_uuid": "1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee", "name": "network-vif-deleted", "tag": "b4227972-6565-4adb-b0ec-462b6105136a"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:55:37.549249 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:55:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e07b8ef4-6a31-4c74-a0ce-60cdb3472326 x-openstack-request-id: req-e07b8ef4-6a31-4c74-a0ce-60cdb3472326 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:55:37.550466 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee", "name": "network-vif-deleted", "tag": "b4227972-6565-4adb-b0ec-462b6105136a", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:55:37.550787 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e07b8ef4-6a31-4c74-a0ce-60cdb3472326 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:55:37.551303 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee', 'name': 'network-vif-deleted', 'tag': 'b4227972-6565-4adb-b0ec-462b6105136a', 'status': 'completed', 'code': 200} Dec 09 21:55:38.033126 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:38.124305 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2689ba3e-4c33-49d1-9eea-588602e6c617 req-e0992f8d-0cfe-43b2-8853-26256c0ac429 tempest-TestServerMultinode-200835018 tempest-TestServerMultinode-200835018-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=1e958aff-a1bd-44d7-a0a9-1aa89ac0b2ee HTTP/1.1" status: 200 len: 210 time: 0.0302908 Dec 09 21:55:38.764446 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 7155b379-cb2b-43f4-9434-8e3aafe31c19 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:55:38.785909 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 7155b379-cb2b-43f4-9434-8e3aafe31c19 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:55:38.786401 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 7155b379-cb2b-43f4-9434-8e3aafe31c19 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:55:39.211112 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55516) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:55:39.663413 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:39.939365 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b03edfd-0da4-49fe-aed0-25df0bdfaaa3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:40.162348 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85ae6731-4265-40b4-8784-376842435271 req-ae7b663f-a2ba-425e-8d09-abb05b201135 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:40.163889 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85ae6731-4265-40b4-8784-376842435271 req-ae7b663f-a2ba-425e-8d09-abb05b201135 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 810 time: 0.1086738 Dec 09 21:55:40.181576 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85ae6731-4265-40b4-8784-376842435271 req-13c06326-441b-45d5-8ef4-9b4deadcde10 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/quotas/be526cfddc4f4783b993a3f6e5b5e630 HTTP/1.1" status: 200 len: 375 time: 0.0100667 Dec 09 21:55:40.194806 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-5b03edfd-0da4-49fe-aed0-25df0bdfaaa3 admin admin] Deleting port 783979bb-dc5d-4926-bdd6-1f873990a322 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:55:40.195146 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b03edfd-0da4-49fe-aed0-25df0bdfaaa3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:40.236596 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85ae6731-4265-40b4-8784-376842435271 req-799c61e4-5d92-4b38-b01c-8d9b2d8c28c2 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0490482 Dec 09 21:55:40.276183 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-5b03edfd-0da4-49fe-aed0-25df0bdfaaa3 admin admin] For port 783979bb-dc5d-4926-bdd6-1f873990a322, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=783979bb-dc5d-4926-bdd6-1f873990a322,segment=NetworkSegment(0d6ecccc-88ae-48f3-a22d-f126ecb40d84),segment_id=0d6ecccc-88ae-48f3-a22d-f126ecb40d84)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:40.276827 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b03edfd-0da4-49fe-aed0-25df0bdfaaa3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:40.297948 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-5b03edfd-0da4-49fe-aed0-25df0bdfaaa3 admin admin] Calling delete_port for 783979bb-dc5d-4926-bdd6-1f873990a322 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:55:40.339057 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85ae6731-4265-40b4-8784-376842435271 req-69ccffe9-8085-40e3-b07a-f281bd42349f service neutron] 10.222.0.13 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0954509 Dec 09 21:55:40.433289 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85ae6731-4265-40b4-8784-376842435271 req-45f9758c-06df-4174-8ad3-fac14713b000 service neutron] 10.222.0.13 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0875719 Dec 09 21:55:40.481811 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b03edfd-0da4-49fe-aed0-25df0bdfaaa3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:40.507570 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b03edfd-0da4-49fe-aed0-25df0bdfaaa3 admin admin] Pushing event deleted for resources: {'Port': ['ID=783979bb-dc5d-4926-bdd6-1f873990a322,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:40.609988 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device b4227972-6565-4adb-b0ec-462b6105136a no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:55:40.658668 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: b4227972-6565-4adb-b0ec-462b6105136a {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:55:40.659011 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device b4227972-6565-4adb-b0ec-462b6105136a not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:55:40.676130 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e185f99-db2b-48d1-a2d6-61ff5672a520 req-b44b5245-caf8-48e8-b8c3-f938b07ed544 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 210 time: 0.0605395 Dec 09 21:55:40.738602 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5b03edfd-0da4-49fe-aed0-25df0bdfaaa3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:40.966000 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5b03edfd-0da4-49fe-aed0-25df0bdfaaa3 admin admin] Router f3e7ff9a-b5b4-4721-82b3-7d8488ad0844 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:55:41.084366 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5b03edfd-0da4-49fe-aed0-25df0bdfaaa3 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:55:41.090535 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5b03edfd-0da4-49fe-aed0-25df0bdfaaa3 admin admin] 10.222.0.13 "PUT /v2.0/routers/f3e7ff9a-b5b4-4721-82b3-7d8488ad0844/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8781533 Dec 09 21:55:41.094332 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55544) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:55:41.100828 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50c32b22-7e96-4530-b817-a654cf0a0e06 None None] Sync routers for ids ['f3e7ff9a-b5b4-4721-82b3-7d8488ad0844'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:55:41.111729 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50c32b22-7e96-4530-b817-a654cf0a0e06 None None] Routers {'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:55:41.112356 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-50c32b22-7e96-4530-b817-a654cf0a0e06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:55:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f3e7ff9a-b5b4-4721-82b3-7d8488ad0844'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:41.207731 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83ddaffc-8aa4-465b-8b05-e933b029d49f admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:41.260432 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-50c32b22-7e96-4530-b817-a654cf0a0e06 None None] Set router f3e7ff9a-b5b4-4721-82b3-7d8488ad0844 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:55:41.316003 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83ddaffc-8aa4-465b-8b05-e933b029d49f admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:41.372722 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-83ddaffc-8aa4-465b-8b05-e933b029d49f admin admin] Deleting port 1e06e036-0c04-4ded-b403-9e482e494971 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:55:41.373143 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83ddaffc-8aa4-465b-8b05-e933b029d49f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:41.446931 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-50c32b22-7e96-4530-b817-a654cf0a0e06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844', 'name': 'tempest-TestServerMultinode-702334193-router', 'tenant_id': '371f1d86e2f94da5bb1809b41a9eba58', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.13'}], 'enable_snat': True}, 'gw_port_id': '1e06e036-0c04-4ded-b403-9e482e494971', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:58Z', 'updated_at': '2021-12-09T21:55:40Z', 'revision_number': 5, 'project_id': '371f1d86e2f94da5bb1809b41a9eba58', 'gw_port': {'id': '1e06e036-0c04-4ded-b403-9e482e494971', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d6:42:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3962, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.13', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:58Z', 'updated_at': '2021-12-09T21:55:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:41.451862 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-83ddaffc-8aa4-465b-8b05-e933b029d49f admin admin] For port 1e06e036-0c04-4ded-b403-9e482e494971, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=1e06e036-0c04-4ded-b403-9e482e494971,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:41.452233 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83ddaffc-8aa4-465b-8b05-e933b029d49f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:41.464606 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-83ddaffc-8aa4-465b-8b05-e933b029d49f admin admin] Calling delete_port for 1e06e036-0c04-4ded-b403-9e482e494971 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:55:41.473305 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50c32b22-7e96-4530-b817-a654cf0a0e06 None None] Checking router: f3e7ff9a-b5b4-4721-82b3-7d8488ad0844 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:55:41.482048 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50c32b22-7e96-4530-b817-a654cf0a0e06 None None] Routers {'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:55:41.482664 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-50c32b22-7e96-4530-b817-a654cf0a0e06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:55:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f3e7ff9a-b5b4-4721-82b3-7d8488ad0844'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:41.569501 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-50c32b22-7e96-4530-b817-a654cf0a0e06 None None] Set router f3e7ff9a-b5b4-4721-82b3-7d8488ad0844 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:55:41.623925 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-50c32b22-7e96-4530-b817-a654cf0a0e06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844', 'name': 'tempest-TestServerMultinode-702334193-router', 'tenant_id': '371f1d86e2f94da5bb1809b41a9eba58', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:58Z', 'updated_at': '2021-12-09T21:55:41Z', 'revision_number': 6, 'project_id': '371f1d86e2f94da5bb1809b41a9eba58', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:41.633449 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83ddaffc-8aa4-465b-8b05-e933b029d49f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:41.651158 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50c32b22-7e96-4530-b817-a654cf0a0e06 None None] The sync data for ids ['f3e7ff9a-b5b4-4721-82b3-7d8488ad0844'] in n-d-713301-27 is: [{'id': 'f3e7ff9a-b5b4-4721-82b3-7d8488ad0844', 'name': 'tempest-TestServerMultinode-702334193-router', 'tenant_id': '371f1d86e2f94da5bb1809b41a9eba58', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:58Z', 'updated_at': '2021-12-09T21:55:41Z', 'revision_number': 6, 'project_id': '371f1d86e2f94da5bb1809b41a9eba58', 'gw_port_host': None}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:55:41.679270 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83ddaffc-8aa4-465b-8b05-e933b029d49f admin admin] Pushing event deleted for resources: {'Port': ['ID=1e06e036-0c04-4ded-b403-9e482e494971,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:41.690693 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a34cb5cb-bc5b-4e62-adaa-17b20bd37352 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:55:41.763045 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83ddaffc-8aa4-465b-8b05-e933b029d49f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:41.813952 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c93246e9-8ed7-4b7e-938d-f5881fcfde8b req-a701f504-8bf5-4921-b206-9f0a6b10fba2 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 210 time: 0.0490181 Dec 09 21:55:41.901385 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83ddaffc-8aa4-465b-8b05-e933b029d49f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:41.904178 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83ddaffc-8aa4-465b-8b05-e933b029d49f admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:41.914231 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85ae6731-4265-40b4-8784-376842435271 req-4ec0eebb-a489-471b-9bce-7f4e996f576b tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:41.916171 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85ae6731-4265-40b4-8784-376842435271 req-4ec0eebb-a489-471b-9bce-7f4e996f576b tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.10 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 810 time: 0.1786509 Dec 09 21:55:41.930105 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-85ae6731-4265-40b4-8784-376842435271 req-9233b843-ab05-4490-a73e-fa0af197f7ab tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Request body: {'port': {'device_id': '5de856a4-16d5-4daf-bb44-33720883b50f', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'admin_state_up': True, 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:55:41.950571 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83ddaffc-8aa4-465b-8b05-e933b029d49f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:41.951145 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-83ddaffc-8aa4-465b-8b05-e933b029d49f admin admin] Fanout notify agent at l3_agent the message router_deleted on router f3e7ff9a-b5b4-4721-82b3-7d8488ad0844 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:55:41.958055 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-83ddaffc-8aa4-465b-8b05-e933b029d49f admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:41.959400 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-83ddaffc-8aa4-465b-8b05-e933b029d49f admin admin] 10.222.0.13 "DELETE /v2.0/routers/f3e7ff9a-b5b4-4721-82b3-7d8488ad0844 HTTP/1.1" status: 204 len: 168 time: 0.8641460 Dec 09 21:55:41.961987 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55548) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:55:42.020899 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-7a7da23b-59e8-442d-a90a-e090c7e003c5 admin admin] Deleting subnet 052fcd50-6803-4f87-8dfb-d2c1cc2fb02e {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:55:42.024661 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a7da23b-59e8-442d-a90a-e090c7e003c5 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:42.060612 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-85ae6731-4265-40b4-8784-376842435271 req-9233b843-ab05-4490-a73e-fa0af197f7ab tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Made reservation on behalf of be526cfddc4f4783b993a3f6e5b5e630 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:55:42.065440 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a7da23b-59e8-442d-a90a-e090c7e003c5 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:42.068660 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-85ae6731-4265-40b4-8784-376842435271 req-9233b843-ab05-4490-a73e-fa0af197f7ab tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:42.159993 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a7da23b-59e8-442d-a90a-e090c7e003c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:42.205344 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-85ae6731-4265-40b4-8784-376842435271 req-9233b843-ab05-4490-a73e-fa0af197f7ab tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Allocated IP 172.20.0.8 (486ad174-ad0c-4065-a4b6-6f9af6b2a208/7004626f-deda-4ef1-8abe-97a447b2d2e9/f9a9feec-30f7-4833-acf6-15a3cc16604c) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:55:42.231246 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a7da23b-59e8-442d-a90a-e090c7e003c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:42.273638 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a7da23b-59e8-442d-a90a-e090c7e003c5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=052fcd50-6803-4f87-8dfb-d2c1cc2fb02e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:42.281352 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a7da23b-59e8-442d-a90a-e090c7e003c5 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:42.287157 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7a7da23b-59e8-442d-a90a-e090c7e003c5 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/052fcd50-6803-4f87-8dfb-d2c1cc2fb02e HTTP/1.1" status: 204 len: 168 time: 0.3237388 Dec 09 21:55:42.287865 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-527759aa-3a37-481b-b148-1f7dfd71d3d2 None None] Network 942064c7-756f-4754-a77d-0fafe38ff60f requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:55:42.289705 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55550) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:55:42.384127 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02aa9173-b437-4284-80db-4ed16c449173 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:42.443512 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-85ae6731-4265-40b4-8784-376842435271 req-9233b843-ab05-4490-a73e-fa0af197f7ab tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:42.480969 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-02aa9173-b437-4284-80db-4ed16c449173 admin admin] Deleting port d066a8c3-8cbd-453f-83f3-7b3674bc42ba {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:55:42.481548 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02aa9173-b437-4284-80db-4ed16c449173 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:42.487881 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-85ae6731-4265-40b4-8784-376842435271 req-9233b843-ab05-4490-a73e-fa0af197f7ab tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:42.540209 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-85ae6731-4265-40b4-8784-376842435271 req-9233b843-ab05-4490-a73e-fa0af197f7ab tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:55:42.547650 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-85ae6731-4265-40b4-8784-376842435271 req-9233b843-ab05-4490-a73e-fa0af197f7ab tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:55:42.552042 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-85ae6731-4265-40b4-8784-376842435271 req-9233b843-ab05-4490-a73e-fa0af197f7ab tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:55:42.564209 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f58e41d0-9d12-4630-a48f-dfcae314f058 None None] DHCP port deletion for 942064c7-756f-4754-a77d-0fafe38ff60f request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:55:42.579429 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-02aa9173-b437-4284-80db-4ed16c449173 admin admin] For port d066a8c3-8cbd-453f-83f3-7b3674bc42ba, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d066a8c3-8cbd-453f-83f3-7b3674bc42ba,segment=NetworkSegment(0d6ecccc-88ae-48f3-a22d-f126ecb40d84),segment_id=0d6ecccc-88ae-48f3-a22d-f126ecb40d84)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:42.579841 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02aa9173-b437-4284-80db-4ed16c449173 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:42.595405 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-02aa9173-b437-4284-80db-4ed16c449173 admin admin] Calling delete_port for d066a8c3-8cbd-453f-83f3-7b3674bc42ba owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:55:42.614729 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9233b843-ab05-4490-a73e-fa0af197f7ab tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event updated for resources: {'Port': ['ID=f9a9feec-30f7-4833-acf6-15a3cc16604c,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:42.622639 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85ae6731-4265-40b4-8784-376842435271 req-9233b843-ab05-4490-a73e-fa0af197f7ab tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:42.623549 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-85ae6731-4265-40b4-8784-376842435271 req-9233b843-ab05-4490-a73e-fa0af197f7ab tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:42.641586 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f58e41d0-9d12-4630-a48f-dfcae314f058 None None] Deleting port d066a8c3-8cbd-453f-83f3-7b3674bc42ba {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:55:42.642338 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f58e41d0-9d12-4630-a48f-dfcae314f058 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:42.660028 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85ae6731-4265-40b4-8784-376842435271 req-9233b843-ab05-4490-a73e-fa0af197f7ab tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7337856 Dec 09 21:55:42.674529 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-85ae6731-4265-40b4-8784-376842435271 req-b1a81a15-3f2b-499e-9db5-350e05bb33f5 service neutron] Request body: {'port': {'device_id': '5de856a4-16d5-4daf-bb44-33720883b50f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:55:42.715938 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02aa9173-b437-4284-80db-4ed16c449173 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:42.753323 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02aa9173-b437-4284-80db-4ed16c449173 admin admin] Pushing event deleted for resources: {'Port': ['ID=d066a8c3-8cbd-453f-83f3-7b3674bc42ba,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:42.755239 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f58e41d0-9d12-4630-a48f-dfcae314f058 None None] For port d066a8c3-8cbd-453f-83f3-7b3674bc42ba, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d066a8c3-8cbd-453f-83f3-7b3674bc42ba,segment=NetworkSegment(0d6ecccc-88ae-48f3-a22d-f126ecb40d84),segment_id=0d6ecccc-88ae-48f3-a22d-f126ecb40d84)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:42.757521 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02aa9173-b437-4284-80db-4ed16c449173 admin admin] No DVR routers for this DVR port d066a8c3-8cbd-453f-83f3-7b3674bc42ba on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:55:42.763174 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f58e41d0-9d12-4630-a48f-dfcae314f058 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:42.765376 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-85ae6731-4265-40b4-8784-376842435271 req-b1a81a15-3f2b-499e-9db5-350e05bb33f5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:42.792438 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f58e41d0-9d12-4630-a48f-dfcae314f058 None None] Calling delete_port for d066a8c3-8cbd-453f-83f3-7b3674bc42ba owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:55:42.852653 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02aa9173-b437-4284-80db-4ed16c449173 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:42.920024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-02aa9173-b437-4284-80db-4ed16c449173 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['942064c7-756f-4754-a77d-0fafe38ff60f']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:42.934530 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-02aa9173-b437-4284-80db-4ed16c449173 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0d6ecccc-88ae-48f3-a22d-f126ecb40d84') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:42.935470 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-02aa9173-b437-4284-80db-4ed16c449173 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0d6ecccc-88ae-48f3-a22d-f126ecb40d84') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:42.945261 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02aa9173-b437-4284-80db-4ed16c449173 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:42.969116 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02aa9173-b437-4284-80db-4ed16c449173 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:42.977745 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-02aa9173-b437-4284-80db-4ed16c449173 admin admin] Releasing vlan 136 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:55:42.978158 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02aa9173-b437-4284-80db-4ed16c449173 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:55:42.980284 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:55:43.003687 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-49aacd3d-5374-4199-b51b-b381430cb67d None None] Provisioning complete for port f9a9feec-30f7-4833-acf6-15a3cc16604c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:55:43.004110 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-49aacd3d-5374-4199-b51b-b381430cb67d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:43.032723 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f58e41d0-9d12-4630-a48f-dfcae314f058 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:43.070181 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02aa9173-b437-4284-80db-4ed16c449173 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:43.080447 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f58e41d0-9d12-4630-a48f-dfcae314f058 None None] Pushing event deleted for resources: {'Port': ['ID=d066a8c3-8cbd-453f-83f3-7b3674bc42ba,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:43.088759 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f58e41d0-9d12-4630-a48f-dfcae314f058 None None] No DVR routers for this DVR port d066a8c3-8cbd-453f-83f3-7b3674bc42ba on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:55:43.091170 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-49aacd3d-5374-4199-b51b-b381430cb67d None None] Port f9a9feec-30f7-4833-acf6-15a3cc16604c cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:55:43.092899 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-02aa9173-b437-4284-80db-4ed16c449173 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:43.101789 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-02aa9173-b437-4284-80db-4ed16c449173 admin admin] 10.222.0.13 "DELETE /v2.0/networks/942064c7-756f-4754-a77d-0fafe38ff60f HTTP/1.1" status: 204 len: 168 time: 0.8079453 Dec 09 21:55:43.101789 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02aa9173-b437-4284-80db-4ed16c449173 admin admin] Pushing event deleted for resources: {'Network': ['ID=942064c7-756f-4754-a77d-0fafe38ff60f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:43.102582 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55558) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:55:43.168803 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b666792-0d1c-48c3-afbf-b81884d7c5eb req-89d649cb-2897-4d8e-91e7-9df3f83c3c9a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:43.177266 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b666792-0d1c-48c3-afbf-b81884d7c5eb req-89d649cb-2897-4d8e-91e7-9df3f83c3c9a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 931 time: 0.2175682 Dec 09 21:55:43.266818 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 783979bb-dc5d-4926-bdd6-1f873990a322 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:55:43.291031 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-85ae6731-4265-40b4-8784-376842435271 req-b1a81a15-3f2b-499e-9db5-350e05bb33f5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f9a9feec-30f7-4833-acf6-15a3cc16604c {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:55:43.293585 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 783979bb-dc5d-4926-bdd6-1f873990a322 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:55:43.294070 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 783979bb-dc5d-4926-bdd6-1f873990a322 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:55:43.294523 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 1e06e036-0c04-4ded-b403-9e482e494971 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:55:43.303651 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b666792-0d1c-48c3-afbf-b81884d7c5eb req-fc6c21f0-1461-4867-92cf-1846310c9098 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1254725 Dec 09 21:55:43.305471 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-85ae6731-4265-40b4-8784-376842435271 req-b1a81a15-3f2b-499e-9db5-350e05bb33f5 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:43.321686 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 1e06e036-0c04-4ded-b403-9e482e494971 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:55:43.322384 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 1e06e036-0c04-4ded-b403-9e482e494971 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:55:43.322836 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d066a8c3-8cbd-453f-83f3-7b3674bc42ba no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:55:43.325551 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-85ae6731-4265-40b4-8784-376842435271 req-b1a81a15-3f2b-499e-9db5-350e05bb33f5 service neutron] Transition to ACTIVE for port object f9a9feec-30f7-4833-acf6-15a3cc16604c will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:55:43.332764 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-85ae6731-4265-40b4-8784-376842435271 req-b1a81a15-3f2b-499e-9db5-350e05bb33f5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:43.361297 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: d066a8c3-8cbd-453f-83f3-7b3674bc42ba {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:55:43.361657 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d066a8c3-8cbd-453f-83f3-7b3674bc42ba not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:55:43.390138 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1a81a15-3f2b-499e-9db5-350e05bb33f5 service neutron] Pushing event updated for resources: {'Port': ['ID=f9a9feec-30f7-4833-acf6-15a3cc16604c,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:43.472648 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-85ae6731-4265-40b4-8784-376842435271 req-b1a81a15-3f2b-499e-9db5-350e05bb33f5 service neutron] Attempting to bind port f9a9feec-30f7-4833-acf6-15a3cc16604c on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:55:43.472979 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-85ae6731-4265-40b4-8784-376842435271 req-b1a81a15-3f2b-499e-9db5-350e05bb33f5 service neutron] Attempting to bind port f9a9feec-30f7-4833-acf6-15a3cc16604c by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:55:43.473467 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85ae6731-4265-40b4-8784-376842435271 req-b1a81a15-3f2b-499e-9db5-350e05bb33f5 service neutron] Attempting to bind port f9a9feec-30f7-4833-acf6-15a3cc16604c on network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:55:43.486215 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85ae6731-4265-40b4-8784-376842435271 req-b1a81a15-3f2b-499e-9db5-350e05bb33f5 service neutron] Port f9a9feec-30f7-4833-acf6-15a3cc16604c on network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:55:43.486538 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85ae6731-4265-40b4-8784-376842435271 req-b1a81a15-3f2b-499e-9db5-350e05bb33f5 service neutron] Attempting to bind port f9a9feec-30f7-4833-acf6-15a3cc16604c on network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:55:43.492822 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85ae6731-4265-40b4-8784-376842435271 req-b1a81a15-3f2b-499e-9db5-350e05bb33f5 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 55, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:55:43.493148 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85ae6731-4265-40b4-8784-376842435271 req-b1a81a15-3f2b-499e-9db5-350e05bb33f5 service neutron] Checking segment: {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:55:43.493527 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85ae6731-4265-40b4-8784-376842435271 req-b1a81a15-3f2b-499e-9db5-350e05bb33f5 service neutron] Bound using segment: {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:55:43.493942 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-85ae6731-4265-40b4-8784-376842435271 req-b1a81a15-3f2b-499e-9db5-350e05bb33f5 service neutron] Bound port: f9a9feec-30f7-4833-acf6-15a3cc16604c, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:55:43.494291 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-85ae6731-4265-40b4-8784-376842435271 req-b1a81a15-3f2b-499e-9db5-350e05bb33f5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:43.584865 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-85ae6731-4265-40b4-8784-376842435271 req-b1a81a15-3f2b-499e-9db5-350e05bb33f5 service neutron] For port f9a9feec-30f7-4833-acf6-15a3cc16604c, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:55:43.588823 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-85ae6731-4265-40b4-8784-376842435271 req-b1a81a15-3f2b-499e-9db5-350e05bb33f5 service neutron] For port f9a9feec-30f7-4833-acf6-15a3cc16604c, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=f9a9feec-30f7-4833-acf6-15a3cc16604c,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:55:43.596400 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-85ae6731-4265-40b4-8784-376842435271 req-b1a81a15-3f2b-499e-9db5-350e05bb33f5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:43.613596 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-17966464-1e7d-465b-95e8-e44b137b00f6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:43.638471 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85ae6731-4265-40b4-8784-376842435271 req-b1a81a15-3f2b-499e-9db5-350e05bb33f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:43.639279 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-85ae6731-4265-40b4-8784-376842435271 req-b1a81a15-3f2b-499e-9db5-350e05bb33f5 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:43.640804 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85ae6731-4265-40b4-8784-376842435271 req-b1a81a15-3f2b-499e-9db5-350e05bb33f5 service neutron] 10.222.0.10 "PUT /v2.0/ports/f9a9feec-30f7-4833-acf6-15a3cc16604c HTTP/1.1" status: 200 len: 1092 time: 0.9788046 Dec 09 21:55:43.641336 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5de856a4-16d5-4daf-bb44-33720883b50f', 'tag': 'f9a9feec-30f7-4833-acf6-15a3cc16604c'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:55:43.643733 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9ca2b4fa-c30d-4624-aa09-859b17ac53b9" -d '{"events": [{"name": "network-changed", "server_uuid": "5de856a4-16d5-4daf-bb44-33720883b50f", "tag": "f9a9feec-30f7-4833-acf6-15a3cc16604c"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:55:43.669094 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1a81a15-3f2b-499e-9db5-350e05bb33f5 service neutron] Pushing event updated for resources: {'Port': ['ID=f9a9feec-30f7-4833-acf6-15a3cc16604c,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:43.739122 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:55:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0b36f3a9-ddf3-4ccd-b5b7-97dea6397f6b x-openstack-request-id: req-0b36f3a9-ddf3-4ccd-b5b7-97dea6397f6b {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:55:43.739122 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5de856a4-16d5-4daf-bb44-33720883b50f", "tag": "f9a9feec-30f7-4833-acf6-15a3cc16604c", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:55:43.739122 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0b36f3a9-ddf3-4ccd-b5b7-97dea6397f6b {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:55:43.739644 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5de856a4-16d5-4daf-bb44-33720883b50f', 'tag': 'f9a9feec-30f7-4833-acf6-15a3cc16604c', 'status': 'completed', 'code': 200} Dec 09 21:55:43.754620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85ae6731-4265-40b4-8784-376842435271 req-b12ef193-13db-45be-962a-9ba55af87c29 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:43.756275 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85ae6731-4265-40b4-8784-376842435271 req-b12ef193-13db-45be-962a-9ba55af87c29 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 1095 time: 0.0534885 Dec 09 21:55:43.844613 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85ae6731-4265-40b4-8784-376842435271 req-b2ecc878-b236-4542-a269-a15dbfeed393 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f9a9feec-30f7-4833-acf6-15a3cc16604c HTTP/1.1" status: 200 len: 217 time: 0.0787561 Dec 09 21:55:43.899144 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-17966464-1e7d-465b-95e8-e44b137b00f6 admin admin] Deleting port b2405e36-5694-4cd4-ae1a-30e33803456e {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:55:43.899513 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-17966464-1e7d-465b-95e8-e44b137b00f6 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:43.908454 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85ae6731-4265-40b4-8784-376842435271 req-4422379e-7065-4b95-aaf3-b4a95d7c1d94 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:43.910258 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85ae6731-4265-40b4-8784-376842435271 req-4422379e-7065-4b95-aaf3-b4a95d7c1d94 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0592730 Dec 09 21:55:43.973598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85ae6731-4265-40b4-8784-376842435271 req-36938574-fc40-4615-8f66-07998a379871 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:43.975529 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85ae6731-4265-40b4-8784-376842435271 req-36938574-fc40-4615-8f66-07998a379871 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0567451 Dec 09 21:55:43.993119 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-17966464-1e7d-465b-95e8-e44b137b00f6 admin admin] For port b2405e36-5694-4cd4-ae1a-30e33803456e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b2405e36-5694-4cd4-ae1a-30e33803456e,segment=NetworkSegment(d3454a3b-857c-446f-9f63-b9d0ea8cd06f),segment_id=d3454a3b-857c-446f-9f63-b9d0ea8cd06f)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:43.993522 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-17966464-1e7d-465b-95e8-e44b137b00f6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:44.008732 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-17966464-1e7d-465b-95e8-e44b137b00f6 admin admin] Calling delete_port for b2405e36-5694-4cd4-ae1a-30e33803456e owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:55:44.071242 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85ae6731-4265-40b4-8784-376842435271 req-33cd5338-0261-48a6-a8ff-b716f5fc0fdc service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0878828 Dec 09 21:55:44.170481 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85ae6731-4265-40b4-8784-376842435271 req-0996d356-f196-41d4-a3d0-aa96ff08c996 service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0902188 Dec 09 21:55:44.200529 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-17966464-1e7d-465b-95e8-e44b137b00f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:44.227017 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17966464-1e7d-465b-95e8-e44b137b00f6 admin admin] Pushing event deleted for resources: {'Port': ['ID=b2405e36-5694-4cd4-ae1a-30e33803456e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:44.265526 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ca2b4fa-c30d-4624-aa09-859b17ac53b9 req-9aaf16ba-5e0e-4cfc-b1a6-1ff92d4e4a08 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:44.267085 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ca2b4fa-c30d-4624-aa09-859b17ac53b9 req-9aaf16ba-5e0e-4cfc-b1a6-1ff92d4e4a08 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 1095 time: 0.0477190 Dec 09 21:55:44.396271 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ca2b4fa-c30d-4624-aa09-859b17ac53b9 req-f0ddcf04-91cc-42c7-b523-947d2ceeb3e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:44.398153 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ca2b4fa-c30d-4624-aa09-859b17ac53b9 req-f0ddcf04-91cc-42c7-b523-947d2ceeb3e5 service neutron] 10.222.0.10 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 911 time: 0.1220176 Dec 09 21:55:44.471064 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ca2b4fa-c30d-4624-aa09-859b17ac53b9 req-8597fdf0-a171-4ca6-8ce0-05fcdc4bf99a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=f9a9feec-30f7-4833-acf6-15a3cc16604c HTTP/1.1" status: 200 len: 217 time: 0.0613887 Dec 09 21:55:44.527228 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f5d7dbd-2be0-4a3c-8a68-fe6149a9af3b req-cd9ab622-0b91-4d26-841d-3adc5fe75594 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:44.528799 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f5d7dbd-2be0-4a3c-8a68-fe6149a9af3b req-cd9ab622-0b91-4d26-841d-3adc5fe75594 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 943 time: 0.1291683 Dec 09 21:55:44.547683 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ca2b4fa-c30d-4624-aa09-859b17ac53b9 req-149e05c0-d4a9-4bef-8770-9d771d898b50 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:44.549126 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ca2b4fa-c30d-4624-aa09-859b17ac53b9 req-149e05c0-d4a9-4bef-8770-9d771d898b50 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0709815 Dec 09 21:55:44.623372 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f5d7dbd-2be0-4a3c-8a68-fe6149a9af3b req-4c47abd1-fcbd-4100-86fd-50f709a3711e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0836122 Dec 09 21:55:44.630149 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ca2b4fa-c30d-4624-aa09-859b17ac53b9 req-0282370a-0e00-452d-a8d6-ed913556a745 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:44.631730 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ca2b4fa-c30d-4624-aa09-859b17ac53b9 req-0282370a-0e00-452d-a8d6-ed913556a745 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0702200 Dec 09 21:55:44.729576 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ca2b4fa-c30d-4624-aa09-859b17ac53b9 req-8af982d1-b0a9-4f82-9427-f08e6cf06619 service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0897985 Dec 09 21:55:44.797800 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-17966464-1e7d-465b-95e8-e44b137b00f6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:44.840157 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ca2b4fa-c30d-4624-aa09-859b17ac53b9 req-bbb1b454-be6d-4e7f-8bb4-1a456ab6408b service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1034451 Dec 09 21:55:45.029322 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-17966464-1e7d-465b-95e8-e44b137b00f6 admin admin] Router 9add2ea6-7c71-4404-a87a-19bd194cde59 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:55:45.135976 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-17966464-1e7d-465b-95e8-e44b137b00f6 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:55:45.142075 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-17966464-1e7d-465b-95e8-e44b137b00f6 admin admin] 10.222.0.13 "PUT /v2.0/routers/9add2ea6-7c71-4404-a87a-19bd194cde59/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0383625 Dec 09 21:55:45.144736 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55564) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:55:45.156512 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30253459-7665-4d8a-a10a-ab43e0339313 None None] Sync routers for ids ['9add2ea6-7c71-4404-a87a-19bd194cde59'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:55:45.169714 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30253459-7665-4d8a-a10a-ab43e0339313 None None] Routers {'9add2ea6-7c71-4404-a87a-19bd194cde59'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:55:45.170408 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-30253459-7665-4d8a-a10a-ab43e0339313 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:55:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9add2ea6-7c71-4404-a87a-19bd194cde59'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:45.267132 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a147374-956f-4adf-9056-41d073086f53 admin admin] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:45.296210 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-30253459-7665-4d8a-a10a-ab43e0339313 None None] Set router 9add2ea6-7c71-4404-a87a-19bd194cde59 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:55:45.373913 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a147374-956f-4adf-9056-41d073086f53 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:45.438404 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-8a147374-956f-4adf-9056-41d073086f53 admin admin] Deleting port b3895463-dfd0-4aa2-b3a3-b265816b639a {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:55:45.438792 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a147374-956f-4adf-9056-41d073086f53 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:45.491779 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-30253459-7665-4d8a-a10a-ab43e0339313 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9add2ea6-7c71-4404-a87a-19bd194cde59', 'name': 'tempest-TestServerMultinode-1041862185-router', 'tenant_id': 'fadc53efe432454da595fb0618fbe948', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.174'}], 'enable_snat': True}, 'gw_port_id': 'b3895463-dfd0-4aa2-b3a3-b265816b639a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:55:03Z', 'updated_at': '2021-12-09T21:55:44Z', 'revision_number': 5, 'project_id': 'fadc53efe432454da595fb0618fbe948', 'gw_port': {'id': 'b3895463-dfd0-4aa2-b3a3-b265816b639a', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:9f:f6:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9add2ea6-7c71-4404-a87a-19bd194cde59', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3974, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.174', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:55:04Z', 'updated_at': '2021-12-09T21:55:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:45.526700 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30253459-7665-4d8a-a10a-ab43e0339313 None None] Checking router: 9add2ea6-7c71-4404-a87a-19bd194cde59 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:55:45.530880 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-8a147374-956f-4adf-9056-41d073086f53 admin admin] For port b3895463-dfd0-4aa2-b3a3-b265816b639a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b3895463-dfd0-4aa2-b3a3-b265816b639a,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:45.531252 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a147374-956f-4adf-9056-41d073086f53 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:45.535792 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30253459-7665-4d8a-a10a-ab43e0339313 None None] Routers {'9add2ea6-7c71-4404-a87a-19bd194cde59'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:55:45.536394 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-30253459-7665-4d8a-a10a-ab43e0339313 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:55:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['9add2ea6-7c71-4404-a87a-19bd194cde59'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:45.545519 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-8a147374-956f-4adf-9056-41d073086f53 admin admin] Calling delete_port for b3895463-dfd0-4aa2-b3a3-b265816b639a owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:55:45.621390 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-30253459-7665-4d8a-a10a-ab43e0339313 None None] Set router 9add2ea6-7c71-4404-a87a-19bd194cde59 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:55:45.682823 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-30253459-7665-4d8a-a10a-ab43e0339313 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9add2ea6-7c71-4404-a87a-19bd194cde59', 'name': 'tempest-TestServerMultinode-1041862185-router', 'tenant_id': 'fadc53efe432454da595fb0618fbe948', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:55:03Z', 'updated_at': '2021-12-09T21:55:45Z', 'revision_number': 6, 'project_id': 'fadc53efe432454da595fb0618fbe948', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:45.724118 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a147374-956f-4adf-9056-41d073086f53 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:45.724457 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30253459-7665-4d8a-a10a-ab43e0339313 None None] The sync data for ids ['9add2ea6-7c71-4404-a87a-19bd194cde59'] in n-d-713301-27 is: [{'id': '9add2ea6-7c71-4404-a87a-19bd194cde59', 'name': 'tempest-TestServerMultinode-1041862185-router', 'tenant_id': 'fadc53efe432454da595fb0618fbe948', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:55:03Z', 'updated_at': '2021-12-09T21:55:45Z', 'revision_number': 6, 'project_id': 'fadc53efe432454da595fb0618fbe948', 'gw_port_host': None}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:55:45.781801 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a147374-956f-4adf-9056-41d073086f53 admin admin] Pushing event deleted for resources: {'Port': ['ID=b3895463-dfd0-4aa2-b3a3-b265816b639a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:45.800151 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d26d5d8e-6b18-4f18-87b3-c4299fb5e392 req-8d15cc35-8a0f-44ef-acf6-bcd9ee93f1b4 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0694990 Dec 09 21:55:45.801150 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d1a627b4-b909-406a-867f-8cff28773ad6 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:55:45.854667 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f823b869-43cc-49ee-927b-7a18250dc6c7 req-655bd2ad-1f25-4866-b9c2-98f0278f356d tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:45.858445 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f823b869-43cc-49ee-927b-7a18250dc6c7 req-655bd2ad-1f25-4866-b9c2-98f0278f356d tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 943 time: 0.1296377 Dec 09 21:55:45.892123 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a147374-956f-4adf-9056-41d073086f53 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:45.893790 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d26d5d8e-6b18-4f18-87b3-c4299fb5e392 req-34ae2356-bb8d-4ea4-95e5-b441be9bb3aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:45.895515 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d26d5d8e-6b18-4f18-87b3-c4299fb5e392 req-34ae2356-bb8d-4ea4-95e5-b441be9bb3aa service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a1dd4ab6f25741058f3000ebf6ce1eac&device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 1098 time: 0.0484471 Dec 09 21:55:46.004735 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a147374-956f-4adf-9056-41d073086f53 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:46.007144 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a147374-956f-4adf-9056-41d073086f53 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:46.007316 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d26d5d8e-6b18-4f18-87b3-c4299fb5e392 req-853b3ca5-6b46-4f88-95e0-85fa7830792e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:46.010182 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d26d5d8e-6b18-4f18-87b3-c4299fb5e392 req-853b3ca5-6b46-4f88-95e0-85fa7830792e service neutron] 10.222.0.31 "GET /v2.0/networks?id=9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 HTTP/1.1" status: 200 len: 909 time: 0.0943582 Dec 09 21:55:46.015682 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f823b869-43cc-49ee-927b-7a18250dc6c7 req-0af2d5ed-828f-4bff-b750-c8d33db727ff tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1520059 Dec 09 21:55:46.078744 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a147374-956f-4adf-9056-41d073086f53 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:46.079571 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8a147374-956f-4adf-9056-41d073086f53 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 9add2ea6-7c71-4404-a87a-19bd194cde59 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:55:46.084970 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8a147374-956f-4adf-9056-41d073086f53 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:46.086212 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8a147374-956f-4adf-9056-41d073086f53 admin admin] 10.222.0.13 "DELETE /v2.0/routers/9add2ea6-7c71-4404-a87a-19bd194cde59 HTTP/1.1" status: 204 len: 168 time: 0.9403141 Dec 09 21:55:46.091961 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55568) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:55:46.130208 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d26d5d8e-6b18-4f18-87b3-c4299fb5e392 req-c823b6d2-c4c6-4d63-a374-bbf9ec6249e8 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=48ed4870-53b4-441d-92a8-1562825c8ca3 HTTP/1.1" status: 200 len: 1002 time: 0.1113703 Dec 09 21:55:46.221031 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-a1326dc8-5c83-414a-9623-bad274e819c3 admin admin] Deleting subnet 19eb8709-f745-473a-862f-c0d2fdb14a6a {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:55:46.224321 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a1326dc8-5c83-414a-9623-bad274e819c3 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:46.285339 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d26d5d8e-6b18-4f18-87b3-c4299fb5e392 req-7eee187a-3621-46aa-99d2-8a8877bd4161 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:46.286753 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d26d5d8e-6b18-4f18-87b3-c4299fb5e392 req-7eee187a-3621-46aa-99d2-8a8877bd4161 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=912d0a1a-1b1a-4383-8291-491e8e3358fe HTTP/1.1" status: 200 len: 847 time: 0.1478913 Dec 09 21:55:46.294303 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a1326dc8-5c83-414a-9623-bad274e819c3 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:46.377286 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d26d5d8e-6b18-4f18-87b3-c4299fb5e392 req-137f6e72-715f-4e62-82dc-6c9c57c39417 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:46.379324 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d26d5d8e-6b18-4f18-87b3-c4299fb5e392 req-137f6e72-715f-4e62-82dc-6c9c57c39417 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0828636 Dec 09 21:55:46.502226 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a1326dc8-5c83-414a-9623-bad274e819c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:46.573908 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d26d5d8e-6b18-4f18-87b3-c4299fb5e392 req-0d82d14b-b415-4a3c-a2b2-cfea0ac821f4 service neutron] 10.222.0.31 "GET /v2.0/networks/9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1859808 Dec 09 21:55:46.620423 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a1326dc8-5c83-414a-9623-bad274e819c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:46.680567 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1326dc8-5c83-414a-9623-bad274e819c3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=19eb8709-f745-473a-862f-c0d2fdb14a6a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:46.688034 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a1326dc8-5c83-414a-9623-bad274e819c3 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:46.692507 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a1326dc8-5c83-414a-9623-bad274e819c3 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/19eb8709-f745-473a-862f-c0d2fdb14a6a HTTP/1.1" status: 204 len: 168 time: 0.5942361 Dec 09 21:55:46.694190 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55570) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:55:46.696241 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7124668-88a4-41f0-b480-8b4e063c8be1 None None] Network 3b1f160d-45e8-4246-9496-3beebccaa493 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:55:46.745659 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d26d5d8e-6b18-4f18-87b3-c4299fb5e392 req-bbad043d-d285-44e1-ac7e-b4456ebd09a0 service neutron] 10.222.0.31 "GET /v2.0/networks/9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1656203 Dec 09 21:55:46.797336 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6cbbe81e-ff23-4d49-92ee-23654bb9f3cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:46.883596 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-6cbbe81e-ff23-4d49-92ee-23654bb9f3cf admin admin] Deleting port 2a5a46c0-c097-4512-ab3a-d9c8b8a6c749 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:55:46.884230 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6cbbe81e-ff23-4d49-92ee-23654bb9f3cf admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:46.920887 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-daff2f34-ef99-46c5-9f48-d88bc2d80763 None None] DHCP port deletion for 3b1f160d-45e8-4246-9496-3beebccaa493 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:55:46.971116 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-6cbbe81e-ff23-4d49-92ee-23654bb9f3cf admin admin] For port 2a5a46c0-c097-4512-ab3a-d9c8b8a6c749, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2a5a46c0-c097-4512-ab3a-d9c8b8a6c749,segment=NetworkSegment(d3454a3b-857c-446f-9f63-b9d0ea8cd06f),segment_id=d3454a3b-857c-446f-9f63-b9d0ea8cd06f)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:46.971815 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6cbbe81e-ff23-4d49-92ee-23654bb9f3cf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:46.987461 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-6cbbe81e-ff23-4d49-92ee-23654bb9f3cf admin admin] Calling delete_port for 2a5a46c0-c097-4512-ab3a-d9c8b8a6c749 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:55:47.018678 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-daff2f34-ef99-46c5-9f48-d88bc2d80763 None None] Deleting port 2a5a46c0-c097-4512-ab3a-d9c8b8a6c749 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:55:47.019378 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-daff2f34-ef99-46c5-9f48-d88bc2d80763 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:47.125250 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6cbbe81e-ff23-4d49-92ee-23654bb9f3cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:47.134959 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-daff2f34-ef99-46c5-9f48-d88bc2d80763 None None] For port 2a5a46c0-c097-4512-ab3a-d9c8b8a6c749, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2a5a46c0-c097-4512-ab3a-d9c8b8a6c749,segment=NetworkSegment(d3454a3b-857c-446f-9f63-b9d0ea8cd06f),segment_id=d3454a3b-857c-446f-9f63-b9d0ea8cd06f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:55:47.136007 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-daff2f34-ef99-46c5-9f48-d88bc2d80763 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:47.149587 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-daff2f34-ef99-46c5-9f48-d88bc2d80763 None None] Calling delete_port for 2a5a46c0-c097-4512-ab3a-d9c8b8a6c749 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:55:47.159936 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6cbbe81e-ff23-4d49-92ee-23654bb9f3cf admin admin] No DVR routers for this DVR port 2a5a46c0-c097-4512-ab3a-d9c8b8a6c749 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:55:47.161976 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cbbe81e-ff23-4d49-92ee-23654bb9f3cf admin admin] Pushing event deleted for resources: {'Port': ['ID=2a5a46c0-c097-4512-ab3a-d9c8b8a6c749,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:47.236228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b2405e36-5694-4cd4-ae1a-30e33803456e no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:55:47.274272 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6cbbe81e-ff23-4d49-92ee-23654bb9f3cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:47.274611 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: b2405e36-5694-4cd4-ae1a-30e33803456e {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:55:47.274611 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b2405e36-5694-4cd4-ae1a-30e33803456e not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:55:47.275020 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2a5a46c0-c097-4512-ab3a-d9c8b8a6c749 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:55:47.278467 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4496cbc3-343b-4b80-b865-091588284175 req-53bd9e70-e60b-4aad-adc6-61aea814f818 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:47.286880 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4496cbc3-343b-4b80-b865-091588284175 req-53bd9e70-e60b-4aad-adc6-61aea814f818 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 943 time: 0.1503336 Dec 09 21:55:47.299754 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 2a5a46c0-c097-4512-ab3a-d9c8b8a6c749 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:55:47.300088 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2a5a46c0-c097-4512-ab3a-d9c8b8a6c749 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:55:47.300760 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b3895463-dfd0-4aa2-b3a3-b265816b639a no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:55:47.304049 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-6cbbe81e-ff23-4d49-92ee-23654bb9f3cf admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3b1f160d-45e8-4246-9496-3beebccaa493']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:47.322199 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-6cbbe81e-ff23-4d49-92ee-23654bb9f3cf admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd3454a3b-857c-446f-9f63-b9d0ea8cd06f') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:47.322760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-6cbbe81e-ff23-4d49-92ee-23654bb9f3cf admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd3454a3b-857c-446f-9f63-b9d0ea8cd06f') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:55:47.328861 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: b3895463-dfd0-4aa2-b3a3-b265816b639a {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:55:47.329132 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b3895463-dfd0-4aa2-b3a3-b265816b639a not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:55:47.331814 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-daff2f34-ef99-46c5-9f48-d88bc2d80763 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:47.339619 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6cbbe81e-ff23-4d49-92ee-23654bb9f3cf admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:47.346700 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-daff2f34-ef99-46c5-9f48-d88bc2d80763 None None] No DVR routers for this DVR port 2a5a46c0-c097-4512-ab3a-d9c8b8a6c749 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:55:47.359958 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4496cbc3-343b-4b80-b865-091588284175 req-c4eb785c-1262-407e-8e6b-e7971d6e169f tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0720842 Dec 09 21:55:47.367496 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daff2f34-ef99-46c5-9f48-d88bc2d80763 None None] Pushing event deleted for resources: {'Port': ['ID=2a5a46c0-c097-4512-ab3a-d9c8b8a6c749,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:47.372402 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6cbbe81e-ff23-4d49-92ee-23654bb9f3cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:47.380159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6cbbe81e-ff23-4d49-92ee-23654bb9f3cf admin admin] Releasing vlan 126 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:55:47.380552 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6cbbe81e-ff23-4d49-92ee-23654bb9f3cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: timer() Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:55:47.388746 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:55:47.464241 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6cbbe81e-ff23-4d49-92ee-23654bb9f3cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:47.471815 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6cbbe81e-ff23-4d49-92ee-23654bb9f3cf admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:47.476601 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6cbbe81e-ff23-4d49-92ee-23654bb9f3cf admin admin] 10.222.0.13 "DELETE /v2.0/networks/3b1f160d-45e8-4246-9496-3beebccaa493 HTTP/1.1" status: 204 len: 168 time: 0.7815909 Dec 09 21:55:47.491964 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cbbe81e-ff23-4d49-92ee-23654bb9f3cf admin admin] Pushing event deleted for resources: {'Network': ['ID=3b1f160d-45e8-4246-9496-3beebccaa493,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:47.755548 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 55576) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:55:47.811952 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ec2e05ee-2e75-49d5-8657-ec14f4406f94 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=371f1d86e2f94da5bb1809b41a9eba58&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0548825 Dec 09 21:55:47.815356 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55578) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:55:47.889720 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c970e94b-6573-4c09-b3f2-46a05294674c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:47.924280 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c970e94b-6573-4c09-b3f2-46a05294674c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:47.994074 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c970e94b-6573-4c09-b3f2-46a05294674c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:47.997015 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c970e94b-6573-4c09-b3f2-46a05294674c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:47.998193 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c970e94b-6573-4c09-b3f2-46a05294674c admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/17ebf86b-a339-4100-a365-5b5aa7323016 HTTP/1.1" status: 204 len: 168 time: 0.1817911 Dec 09 21:55:48.015223 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c970e94b-6573-4c09-b3f2-46a05294674c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=17ebf86b-a339-4100-a365-5b5aa7323016,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:48.525832 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55586) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:55:48.543011 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0db315c7-885b-40eb-be9a-d074dc50883d req-4483b480-1e6a-4edd-ad30-6448c93f5345 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:48.551866 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0db315c7-885b-40eb-be9a-d074dc50883d req-4483b480-1e6a-4edd-ad30-6448c93f5345 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 943 time: 0.0945916 Dec 09 21:55:48.585305 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0fdc109d-c5a8-467b-bb85-8dc3a1288cbd admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=fadc53efe432454da595fb0618fbe948&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0577891 Dec 09 21:55:48.587806 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 55588) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:55:48.616979 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0db315c7-885b-40eb-be9a-d074dc50883d req-406dd9d5-9fa3-4afd-8ea3-6497091f73ab tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0634103 Dec 09 21:55:48.645758 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1d35e8b0-6f3f-403a-982d-630df7de42d2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:48.673355 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1d35e8b0-6f3f-403a-982d-630df7de42d2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:48.749671 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1d35e8b0-6f3f-403a-982d-630df7de42d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:48.752577 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1d35e8b0-6f3f-403a-982d-630df7de42d2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:48.753993 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1d35e8b0-6f3f-403a-982d-630df7de42d2 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/191aace8-55a0-479e-b6ec-3e59836d90b8 HTTP/1.1" status: 204 len: 168 time: 0.1650159 Dec 09 21:55:48.765225 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d35e8b0-6f3f-403a-982d-630df7de42d2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=191aace8-55a0-479e-b6ec-3e59836d90b8,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:55:49.755365 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-145a4007-43da-41c0-b92b-c9550880cf01 req-d28c18dc-769b-4a47-afe8-d813ab57010d tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:49.756916 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-145a4007-43da-41c0-b92b-c9550880cf01 req-d28c18dc-769b-4a47-afe8-d813ab57010d tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 943 time: 0.0609703 Dec 09 21:55:49.832213 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-145a4007-43da-41c0-b92b-c9550880cf01 req-109c36b3-427a-4d48-8939-6386072a6db9 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0654233 Dec 09 21:55:50.956542 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c09b47e1-7a8f-4e9b-93d9-cb1e384620fd req-ad13bb9b-7452-4d81-9b39-e72f29d2ee2e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:50.958343 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c09b47e1-7a8f-4e9b-93d9-cb1e384620fd req-ad13bb9b-7452-4d81-9b39-e72f29d2ee2e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 943 time: 0.0498552 Dec 09 21:55:51.008579 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c09b47e1-7a8f-4e9b-93d9-cb1e384620fd req-11c8d8c6-ca51-41a5-9ea8-787258881127 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440309 Dec 09 21:55:52.129346 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ba0fadb-aeda-4c96-afe7-db379ff60817 req-5fab9be3-4361-4c82-952f-eb52f8b68bc9 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:52.130759 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5ba0fadb-aeda-4c96-afe7-db379ff60817 req-5fab9be3-4361-4c82-952f-eb52f8b68bc9 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 943 time: 0.0504379 Dec 09 21:55:52.179789 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5ba0fadb-aeda-4c96-afe7-db379ff60817 req-818f0107-e0ae-4dbd-9edf-c7d5826cf113 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428264 Dec 09 21:55:53.310519 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3c1b579-b4fe-448e-b3fe-039a44b2ccd9 req-a1d71594-9430-4812-a19e-58980cc6d15d tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:53.312194 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a3c1b579-b4fe-448e-b3fe-039a44b2ccd9 req-a1d71594-9430-4812-a19e-58980cc6d15d tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 943 time: 0.0554214 Dec 09 21:55:53.359371 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a3c1b579-b4fe-448e-b3fe-039a44b2ccd9 req-ac883728-41f0-4da6-93c4-b09876eaa50f tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410597 Dec 09 21:55:54.479103 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c9ff8df-3cbb-4d76-9888-7b71d8490eea req-8113ce99-2d4c-4034-9970-a234733f2b29 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:54.480581 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c9ff8df-3cbb-4d76-9888-7b71d8490eea req-8113ce99-2d4c-4034-9970-a234733f2b29 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 943 time: 0.0495632 Dec 09 21:55:54.529764 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c9ff8df-3cbb-4d76-9888-7b71d8490eea req-3ccd6aa3-d0b4-452d-8aa1-8e0614218134 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428910 Dec 09 21:55:55.653008 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ddd93fa-de9e-435b-8763-d48f9d554604 req-e1a2a2ef-bd12-4854-8ab4-170a9a9dc635 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:55.654770 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5ddd93fa-de9e-435b-8763-d48f9d554604 req-e1a2a2ef-bd12-4854-8ab4-170a9a9dc635 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 943 time: 0.0507002 Dec 09 21:55:56.087183 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5ddd93fa-de9e-435b-8763-d48f9d554604 req-edf8befc-456c-46c1-a853-5c5862b735df tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4259586 Dec 09 21:55:57.218655 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41cbfb27-2c99-4bf6-a26e-921bb30e729a req-f001b660-ff94-4e35-9feb-dbd4d5fa77f5 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:57.220259 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-41cbfb27-2c99-4bf6-a26e-921bb30e729a req-f001b660-ff94-4e35-9feb-dbd4d5fa77f5 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 943 time: 0.0549574 Dec 09 21:55:57.269610 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-41cbfb27-2c99-4bf6-a26e-921bb30e729a req-09cf75a2-47be-424d-906f-5ab97e9c2ec7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428629 Dec 09 21:55:57.394819 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:57.605219 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:55:58.395715 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57f8e812-d8ec-4693-9436-b5060de9779c req-ba8539ea-3874-4d6d-aa8f-46d8e1956683 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:58.397164 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-57f8e812-d8ec-4693-9436-b5060de9779c req-ba8539ea-3874-4d6d-aa8f-46d8e1956683 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 943 time: 0.0492959 Dec 09 21:55:58.446074 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-57f8e812-d8ec-4693-9436-b5060de9779c req-b38c01b2-01f9-4316-a5b5-a6e3c4cc604f tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428066 Dec 09 21:55:59.598245 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0deac20-8b3d-44ad-a3f3-d37af04d571c req-56008a0d-f5fa-4bf4-9e38-b7585856e7a6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:55:59.599890 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0deac20-8b3d-44ad-a3f3-d37af04d571c req-56008a0d-f5fa-4bf4-9e38-b7585856e7a6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 943 time: 0.0571158 Dec 09 21:55:59.652346 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0deac20-8b3d-44ad-a3f3-d37af04d571c req-17d4b7e7-2025-45d8-8f0f-c205e2406211 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431519 Dec 09 21:56:00.780748 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f7076e9-f6ff-4c2a-bed7-007d1fd4cab0 req-38489630-b4a9-4813-ac2f-9d1827c225d8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:00.782328 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f7076e9-f6ff-4c2a-bed7-007d1fd4cab0 req-38489630-b4a9-4813-ac2f-9d1827c225d8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 943 time: 0.0572808 Dec 09 21:56:00.841235 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f7076e9-f6ff-4c2a-bed7-007d1fd4cab0 req-9f808bca-ffac-41d7-a1e2-4f729d8fbeff tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0510502 Dec 09 21:56:01.984020 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-183cbd74-ed2c-4cd9-a697-58913004bfdd req-0384cf16-ec26-449f-86cb-f8ef97284090 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:01.985527 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-183cbd74-ed2c-4cd9-a697-58913004bfdd req-0384cf16-ec26-449f-86cb-f8ef97284090 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 943 time: 0.0649011 Dec 09 21:56:02.037049 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-183cbd74-ed2c-4cd9-a697-58913004bfdd req-e19d3716-43d6-4821-8ccf-e352de527e44 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428295 Dec 09 21:56:02.980188 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8e9559f0-7a3a-4470-bf4b-479a1cce0b83 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:03.171410 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-427bc63e-e79b-4ecc-8b51-8c9b07d5e6b9 req-81f0975c-4d09-451b-874a-1f494de738dc tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:03.172929 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-427bc63e-e79b-4ecc-8b51-8c9b07d5e6b9 req-81f0975c-4d09-451b-874a-1f494de738dc tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 943 time: 0.0505807 Dec 09 21:56:03.222253 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-427bc63e-e79b-4ecc-8b51-8c9b07d5e6b9 req-7e66a0f4-47fe-4398-a90f-7b302204b63b tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428607 Dec 09 21:56:04.346845 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0f7e40c-9bf5-4b4e-abb0-c76442032ca0 req-83cfeaed-ed6c-4507-95ad-d41a418e8c6e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:04.348365 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0f7e40c-9bf5-4b4e-abb0-c76442032ca0 req-83cfeaed-ed6c-4507-95ad-d41a418e8c6e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 943 time: 0.0518148 Dec 09 21:56:04.403157 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0f7e40c-9bf5-4b4e-abb0-c76442032ca0 req-28b0e7b1-511d-498d-9cb2-37aec101a348 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458281 Dec 09 21:56:04.872145 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device f9a9feec-30f7-4833-acf6-15a3cc16604c details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:56:04.972121 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port f9a9feec-30f7-4833-acf6-15a3cc16604c, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=f9a9feec-30f7-4833-acf6-15a3cc16604c,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:56:05.145900 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'f9a9feec-30f7-4833-acf6-15a3cc16604c', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'port_id': 'f9a9feec-30f7-4833-acf6-15a3cc16604c', 'mac_address': 'fa:16:3e:22:8d:6c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:56:05.184513 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:05.197186 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:56:05.197778 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f9a9feec-30f7-4833-acf6-15a3cc16604c {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:56:05.217941 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port f9a9feec-30f7-4833-acf6-15a3cc16604c, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=f9a9feec-30f7-4833-acf6-15a3cc16604c,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:56:05.225027 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:05.271939 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=f9a9feec-30f7-4833-acf6-15a3cc16604c,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:56:05.280328 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:05.280681 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:05.281032 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:05.281378 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:05.281719 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:05.282054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:05.282386 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:05.282731 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:05.283051 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:05.283379 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:05.283738 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:05.284075 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:05.284402 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:05.410832 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['f9a9feec-30f7-4833-acf6-15a3cc16604c'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:56:05.522182 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b05088ff-909e-4b2e-81d7-c77eee9c88ab req-a507dd10-b493-4359-bbc5-9c790c17da37 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:05.523710 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b05088ff-909e-4b2e-81d7-c77eee9c88ab req-a507dd10-b493-4359-bbc5-9c790c17da37 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 944 time: 0.0500805 Dec 09 21:56:05.572575 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b05088ff-909e-4b2e-81d7-c77eee9c88ab req-3fbd43c3-a103-4de2-95a3-328e271a45de tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423129 Dec 09 21:56:05.575763 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1c1dd80d-7a92-40c2-a8c2-0a3a22739d90 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:06.699340 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:06.701987 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72beebd5-deeb-4464-b0eb-b0eaa77fe3e0 req-4599e8d9-8c9d-4a91-af64-03c0b836b1bc tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:06.703581 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72beebd5-deeb-4464-b0eb-b0eaa77fe3e0 req-4599e8d9-8c9d-4a91-af64-03c0b836b1bc tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 944 time: 0.0501513 Dec 09 21:56:06.753071 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72beebd5-deeb-4464-b0eb-b0eaa77fe3e0 req-17ced7e7-065a-4736-b759-aa930e9e3f7f tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432019 Dec 09 21:56:06.887108 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device f9a9feec-30f7-4833-acf6-15a3cc16604c up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:56:06.941961 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port f9a9feec-30f7-4833-acf6-15a3cc16604c completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:56:06.946080 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port f9a9feec-30f7-4833-acf6-15a3cc16604c triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:56:06.946451 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:07.027348 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:07.051059 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5de856a4-16d5-4daf-bb44-33720883b50f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f9a9feec-30f7-4833-acf6-15a3cc16604c'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:56:07.053344 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b643051d-3827-4a5e-839e-b7677113cb8e" -d '{"events": [{"server_uuid": "5de856a4-16d5-4daf-bb44-33720883b50f", "name": "network-vif-plugged", "status": "completed", "tag": "f9a9feec-30f7-4833-acf6-15a3cc16604c"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:56:07.066152 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port f9a9feec-30f7-4833-acf6-15a3cc16604c, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=f9a9feec-30f7-4833-acf6-15a3cc16604c,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:56:07.071794 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:07.097794 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:56:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-16ce67b1-6962-4216-8ba9-2951a62db2cb x-openstack-request-id: req-16ce67b1-6962-4216-8ba9-2951a62db2cb {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:56:07.098216 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5de856a4-16d5-4daf-bb44-33720883b50f", "name": "network-vif-plugged", "status": "completed", "tag": "f9a9feec-30f7-4833-acf6-15a3cc16604c", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:56:07.098458 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-16ce67b1-6962-4216-8ba9-2951a62db2cb {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:56:07.098852 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5de856a4-16d5-4daf-bb44-33720883b50f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f9a9feec-30f7-4833-acf6-15a3cc16604c', 'code': 200} Dec 09 21:56:07.127058 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=f9a9feec-30f7-4833-acf6-15a3cc16604c,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:56:07.197745 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9419303b-205b-4eea-8a83-a7d8870a1f17 req-780081ef-efae-43ac-88ea-b2fc535660d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:07.199371 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9419303b-205b-4eea-8a83-a7d8870a1f17 req-780081ef-efae-43ac-88ea-b2fc535660d7 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 1097 time: 0.0453012 Dec 09 21:56:07.246191 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9419303b-205b-4eea-8a83-a7d8870a1f17 req-daa838c3-4ee3-4b60-8ece-90421d9349f2 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395398 Dec 09 21:56:07.872971 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47a3a5ae-92bb-46ed-ac9d-7c1a3b0892ea req-d6d62fcb-2039-4fae-b22e-79c2ae7a4c0c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:07.875067 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-47a3a5ae-92bb-46ed-ac9d-7c1a3b0892ea req-d6d62fcb-2039-4fae-b22e-79c2ae7a4c0c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 945 time: 0.0496874 Dec 09 21:56:07.932080 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-47a3a5ae-92bb-46ed-ac9d-7c1a3b0892ea req-629495d9-5453-4787-8019-9cdc2c5450a8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0491872 Dec 09 21:56:08.043564 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:09.055061 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67a64195-3dc0-422d-b3fd-332f428a1e5a req-7f985265-656f-4844-89a7-a04da4fc1195 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:09.056555 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67a64195-3dc0-422d-b3fd-332f428a1e5a req-7f985265-656f-4844-89a7-a04da4fc1195 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 945 time: 0.0498338 Dec 09 21:56:09.108320 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67a64195-3dc0-422d-b3fd-332f428a1e5a req-f33948c5-741a-4252-90df-697db19ca3b0 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456462 Dec 09 21:56:09.222530 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b2f979b-ad0b-4bac-8b2c-80bc5f2006d8 req-4d5f0d83-1b30-4dc3-b46e-858b570e4a98 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:09.224024 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b2f979b-ad0b-4bac-8b2c-80bc5f2006d8 req-4d5f0d83-1b30-4dc3-b46e-858b570e4a98 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 945 time: 0.0490038 Dec 09 21:56:09.283430 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b2f979b-ad0b-4bac-8b2c-80bc5f2006d8 req-463a2dac-2ae2-4ff3-b614-017550eeb589 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0533879 Dec 09 21:56:09.402311 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-777f1a1d-ef22-4d9e-aef6-e0881bef2131 req-c64fea0b-83ba-4104-a965-8ac31f867239 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:09.403842 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-777f1a1d-ef22-4d9e-aef6-e0881bef2131 req-c64fea0b-83ba-4104-a965-8ac31f867239 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 945 time: 0.0550780 Dec 09 21:56:09.450701 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-777f1a1d-ef22-4d9e-aef6-e0881bef2131 req-0194d9ae-1da5-4212-8e9f-eb324bd72b19 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405734 Dec 09 21:56:09.665397 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:09.783511 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5c723df-6bee-44b0-a307-f13e7b1c79f2 req-c908a311-9784-420d-8012-968494d233bf tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:09.785553 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5c723df-6bee-44b0-a307-f13e7b1c79f2 req-c908a311-9784-420d-8012-968494d233bf tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 945 time: 0.0620930 Dec 09 21:56:09.836570 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5c723df-6bee-44b0-a307-f13e7b1c79f2 req-ec2b1d41-2928-473a-83b0-32b113f65055 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433409 Dec 09 21:56:10.965782 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-351c139c-39ce-40a4-bf60-e884c973c1d0 req-091fa557-4bb9-4279-b111-7e9f861cc806 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:10.967276 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-351c139c-39ce-40a4-bf60-e884c973c1d0 req-091fa557-4bb9-4279-b111-7e9f861cc806 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 945 time: 0.0503700 Dec 09 21:56:11.015209 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-351c139c-39ce-40a4-bf60-e884c973c1d0 req-7b3806bb-90fd-4e60-97c0-5d7da13fff59 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415127 Dec 09 21:56:11.167320 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5605ae17-9323-4f04-b5c2-4f63ff810aa5 req-72dcd2e7-b659-48a2-bf52-4eddf2d937d4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:11.168835 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5605ae17-9323-4f04-b5c2-4f63ff810aa5 req-72dcd2e7-b659-48a2-bf52-4eddf2d937d4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.10 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 945 time: 0.0673592 Dec 09 21:56:11.277161 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-5605ae17-9323-4f04-b5c2-4f63ff810aa5 req-71ced3d4-edf2-4778-9aea-432bded584c8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Deleting port f9a9feec-30f7-4833-acf6-15a3cc16604c {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:56:11.277463 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5605ae17-9323-4f04-b5c2-4f63ff810aa5 req-71ced3d4-edf2-4778-9aea-432bded584c8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:11.372327 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-5605ae17-9323-4f04-b5c2-4f63ff810aa5 req-71ced3d4-edf2-4778-9aea-432bded584c8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] For port f9a9feec-30f7-4833-acf6-15a3cc16604c, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=f9a9feec-30f7-4833-acf6-15a3cc16604c,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:56:11.372689 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5605ae17-9323-4f04-b5c2-4f63ff810aa5 req-71ced3d4-edf2-4778-9aea-432bded584c8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:11.385288 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-5605ae17-9323-4f04-b5c2-4f63ff810aa5 req-71ced3d4-edf2-4778-9aea-432bded584c8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Calling delete_port for f9a9feec-30f7-4833-acf6-15a3cc16604c owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:56:11.521370 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5605ae17-9323-4f04-b5c2-4f63ff810aa5 req-71ced3d4-edf2-4778-9aea-432bded584c8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:11.533584 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['f9a9feec-30f7-4833-acf6-15a3cc16604c'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:56:11.561232 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71ced3d4-edf2-4778-9aea-432bded584c8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event deleted for resources: {'Port': ['ID=f9a9feec-30f7-4833-acf6-15a3cc16604c,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:56:11.599925 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-5605ae17-9323-4f04-b5c2-4f63ff810aa5 req-71ced3d4-edf2-4778-9aea-432bded584c8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] No DVR routers for this DVR port f9a9feec-30f7-4833-acf6-15a3cc16604c on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:56:11.602978 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5605ae17-9323-4f04-b5c2-4f63ff810aa5 req-71ced3d4-edf2-4778-9aea-432bded584c8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:11.606944 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5605ae17-9323-4f04-b5c2-4f63ff810aa5 req-71ced3d4-edf2-4778-9aea-432bded584c8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.10 "DELETE /v2.0/ports/f9a9feec-30f7-4833-acf6-15a3cc16604c HTTP/1.1" status: 204 len: 173 time: 0.4319293 Dec 09 21:56:11.607461 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5de856a4-16d5-4daf-bb44-33720883b50f', 'name': 'network-vif-deleted', 'tag': 'f9a9feec-30f7-4833-acf6-15a3cc16604c'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:56:11.610589 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-366b9d0c-cde6-4dca-983e-8083ca448654" -d '{"events": [{"server_uuid": "5de856a4-16d5-4daf-bb44-33720883b50f", "name": "network-vif-deleted", "tag": "f9a9feec-30f7-4833-acf6-15a3cc16604c"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:56:11.653941 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:56:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-77093314-5ec3-415b-8ad7-e6de427c1e49 x-openstack-request-id: req-77093314-5ec3-415b-8ad7-e6de427c1e49 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:56:11.654198 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5de856a4-16d5-4daf-bb44-33720883b50f", "name": "network-vif-deleted", "tag": "f9a9feec-30f7-4833-acf6-15a3cc16604c", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:56:11.654443 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-77093314-5ec3-415b-8ad7-e6de427c1e49 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:56:11.654849 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5de856a4-16d5-4daf-bb44-33720883b50f', 'name': 'network-vif-deleted', 'tag': 'f9a9feec-30f7-4833-acf6-15a3cc16604c', 'status': 'completed', 'code': 200} Dec 09 21:56:12.126212 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-119b8a55-ef12-4f9d-b225-81861ccbea78 req-903fa44e-6380-410e-a14e-fbeb0fea3d11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 210 time: 0.0287414 Dec 09 21:56:13.224646 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ce8534a-2d49-4bdd-8bc0-8d1f725e2d6f req-832e5991-2be3-4f7e-88da-dea895906f6f tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 210 time: 0.0270650 Dec 09 21:56:14.322111 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1650b6c3-aee0-45fd-8235-db27b1305a2c req-b4c21aaa-0c81-4bfd-b64f-01623af3af7b tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 210 time: 0.0274725 Dec 09 21:56:14.920456 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device f9a9feec-30f7-4833-acf6-15a3cc16604c no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:56:14.941264 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: f9a9feec-30f7-4833-acf6-15a3cc16604c {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:56:14.941616 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device f9a9feec-30f7-4833-acf6-15a3cc16604c not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:56:15.422417 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eeeeba1c-2b67-45bb-b418-c8b0e9d22a58 req-09962e74-9310-422a-a881-75e5dd77340a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=5de856a4-16d5-4daf-bb44-33720883b50f HTTP/1.1" status: 200 len: 210 time: 0.0298636 Dec 09 21:56:27.386975 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:27.604133 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:33.048907 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7ec51669-def0-4563-b17b-73ba2ed6b0c8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:35.586197 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-775a6552-fe49-4b67-bcef-629cc5a8297b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:36.703109 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:38.046074 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:39.665834 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:40.527317 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b45a7343-51ef-4078-ae36-201d9a66067d tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:40.528826 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b45a7343-51ef-4078-ae36-201d9a66067d tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 810 time: 0.1070731 Dec 09 21:56:40.544436 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-0abef3ce-1c00-480f-889f-fed2c48814e1 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/quotas/be526cfddc4f4783b993a3f6e5b5e630 HTTP/1.1" status: 200 len: 375 time: 0.0096574 Dec 09 21:56:40.595472 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-ca191e40-b7a9-4292-a144-c7fb0c0b9998 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0457006 Dec 09 21:56:40.695011 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-4b6e5bd2-176b-4666-825a-e860a90787f1 service neutron] 10.222.0.13 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0888474 Dec 09 21:56:40.792715 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-ff4b7985-cc73-44f6-b5ee-ced091324129 service neutron] 10.222.0.13 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0909646 Dec 09 21:56:41.088062 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb302514-f852-4c1b-8cf9-0b49699dd63f req-51a3a210-d808-4746-b74c-9fc259b8f3ba tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 210 time: 0.0264103 Dec 09 21:56:42.070480 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-e6fbfa83-8bdd-4b2e-85fb-07d6b82868b2 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:42.072041 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-e6fbfa83-8bdd-4b2e-85fb-07d6b82868b2 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.10 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 810 time: 0.1075120 Dec 09 21:56:42.084419 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Request body: {'port': {'device_id': '0dee750b-74e3-4839-959c-726f883dd1d5', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'admin_state_up': True, 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:56:42.192716 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2267ea3b-a99c-4dd2-9c9f-3cdf18a36948 req-7511e455-856c-4372-8c82-012f02263f72 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 210 time: 0.0333033 Dec 09 21:56:42.198787 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:56:42.229799 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Made reservation on behalf of be526cfddc4f4783b993a3f6e5b5e630 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:56:42.233359 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:42.374753 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Allocated IP 172.20.0.12 (486ad174-ad0c-4065-a4b6-6f9af6b2a208/7004626f-deda-4ef1-8abe-97a447b2d2e9/c491c718-3982-4712-bb47-2fcfd2377987) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:56:42.526425 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:42.562429 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:42.605431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:56:42.612435 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:56:42.616869 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:56:42.643145 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event updated for resources: {'Port': ['ID=c491c718-3982-4712-bb47-2fcfd2377987,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:56:42.658601 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:42.658903 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:42.659278 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:42.659673 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:42.660007 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:42.660308 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:42.660636 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:42.660958 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:42.661279 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:42.661598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:42.661925 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:42.662238 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:42.662558 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:56:42.687058 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:42.687712 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:42.705201 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-4a779732-4b2b-4920-abdc-cc8ef1e0c1e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6244855 Dec 09 21:56:42.718304 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b1b5688e-42c0-4651-aebd-cb87268948fc service neutron] Request body: {'port': {'device_id': '0dee750b-74e3-4839-959c-726f883dd1d5', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:56:42.787128 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b1b5688e-42c0-4651-aebd-cb87268948fc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:42.915533 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-df718a32-da27-4650-b138-6b9567d4e55b None None] Provisioning complete for port c491c718-3982-4712-bb47-2fcfd2377987 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:56:42.916159 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-df718a32-da27-4650-b138-6b9567d4e55b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:42.953870 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-df718a32-da27-4650-b138-6b9567d4e55b None None] Port c491c718-3982-4712-bb47-2fcfd2377987 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:56:43.075097 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b1b5688e-42c0-4651-aebd-cb87268948fc service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c491c718-3982-4712-bb47-2fcfd2377987 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:56:43.082941 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b1b5688e-42c0-4651-aebd-cb87268948fc service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:43.100169 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b1b5688e-42c0-4651-aebd-cb87268948fc service neutron] Transition to ACTIVE for port object c491c718-3982-4712-bb47-2fcfd2377987 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:56:43.104250 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b1b5688e-42c0-4651-aebd-cb87268948fc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:43.216257 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1b5688e-42c0-4651-aebd-cb87268948fc service neutron] Pushing event updated for resources: {'Port': ['ID=c491c718-3982-4712-bb47-2fcfd2377987,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:56:43.241891 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b1b5688e-42c0-4651-aebd-cb87268948fc service neutron] Attempting to bind port c491c718-3982-4712-bb47-2fcfd2377987 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:56:43.242229 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b1b5688e-42c0-4651-aebd-cb87268948fc service neutron] Attempting to bind port c491c718-3982-4712-bb47-2fcfd2377987 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:56:43.242630 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b1b5688e-42c0-4651-aebd-cb87268948fc service neutron] Attempting to bind port c491c718-3982-4712-bb47-2fcfd2377987 on network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:56:43.249004 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b1b5688e-42c0-4651-aebd-cb87268948fc service neutron] Port c491c718-3982-4712-bb47-2fcfd2377987 on network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:56:43.249356 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b1b5688e-42c0-4651-aebd-cb87268948fc service neutron] Attempting to bind port c491c718-3982-4712-bb47-2fcfd2377987 on network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:56:43.254734 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b1b5688e-42c0-4651-aebd-cb87268948fc service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 56, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:56:43.255121 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b1b5688e-42c0-4651-aebd-cb87268948fc service neutron] Checking segment: {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:56:43.255529 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b1b5688e-42c0-4651-aebd-cb87268948fc service neutron] Bound using segment: {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:56:43.256102 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b1b5688e-42c0-4651-aebd-cb87268948fc service neutron] Bound port: c491c718-3982-4712-bb47-2fcfd2377987, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:56:43.256463 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b1b5688e-42c0-4651-aebd-cb87268948fc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:43.365700 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b1b5688e-42c0-4651-aebd-cb87268948fc service neutron] For port c491c718-3982-4712-bb47-2fcfd2377987, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:56:43.370072 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b1b5688e-42c0-4651-aebd-cb87268948fc service neutron] For port c491c718-3982-4712-bb47-2fcfd2377987, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=c491c718-3982-4712-bb47-2fcfd2377987,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:56:43.379021 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e03ecb87-3f94-45b3-963a-41f290f4925c req-ae3c22c4-b7f8-401f-a1d2-26cb363db171 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:43.380579 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e03ecb87-3f94-45b3-963a-41f290f4925c req-ae3c22c4-b7f8-401f-a1d2-26cb363db171 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 944 time: 0.0829821 Dec 09 21:56:43.382193 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b1b5688e-42c0-4651-aebd-cb87268948fc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:43.442656 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b1b5688e-42c0-4651-aebd-cb87268948fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:43.443279 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b1b5688e-42c0-4651-aebd-cb87268948fc service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:43.444862 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b1b5688e-42c0-4651-aebd-cb87268948fc service neutron] 10.222.0.10 "PUT /v2.0/ports/c491c718-3982-4712-bb47-2fcfd2377987 HTTP/1.1" status: 200 len: 1093 time: 0.7308464 Dec 09 21:56:43.445213 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0dee750b-74e3-4839-959c-726f883dd1d5', 'tag': 'c491c718-3982-4712-bb47-2fcfd2377987'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:56:43.447464 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-88558ecc-87d7-4d4e-9cfc-5dee3578dcdf" -d '{"events": [{"name": "network-changed", "server_uuid": "0dee750b-74e3-4839-959c-726f883dd1d5", "tag": "c491c718-3982-4712-bb47-2fcfd2377987"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:56:43.474422 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1b5688e-42c0-4651-aebd-cb87268948fc service neutron] Pushing event updated for resources: {'Port': ['ID=c491c718-3982-4712-bb47-2fcfd2377987,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:56:43.512404 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e03ecb87-3f94-45b3-963a-41f290f4925c req-02b27051-d8f7-4759-8f06-838ed90b21d2 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1247580 Dec 09 21:56:43.556871 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-d61d7196-7ac0-427a-8a2a-5fcfd1687b8a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:43.558557 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-d61d7196-7ac0-427a-8a2a-5fcfd1687b8a service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 1096 time: 0.0604939 Dec 09 21:56:43.605002 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-ff3855c7-4b79-4edb-b3ea-07846903e77a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=c491c718-3982-4712-bb47-2fcfd2377987 HTTP/1.1" status: 200 len: 217 time: 0.0384240 Dec 09 21:56:43.606684 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:56:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a024ac8b-9e9b-4b4a-aa35-51b396a9debc x-openstack-request-id: req-a024ac8b-9e9b-4b4a-aa35-51b396a9debc {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:56:43.606966 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0dee750b-74e3-4839-959c-726f883dd1d5", "tag": "c491c718-3982-4712-bb47-2fcfd2377987", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:56:43.607217 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a024ac8b-9e9b-4b4a-aa35-51b396a9debc {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:56:43.608685 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0dee750b-74e3-4839-959c-726f883dd1d5', 'tag': 'c491c718-3982-4712-bb47-2fcfd2377987', 'status': 'completed', 'code': 200} Dec 09 21:56:43.664941 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b1956861-1edd-427f-9c08-7efbb3e6aa8a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:43.666701 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-b1956861-1edd-427f-9c08-7efbb3e6aa8a service neutron] 10.222.0.10 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0549142 Dec 09 21:56:43.717515 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-a438cb6b-b09c-4fad-b630-8f3757f1ff2f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:43.718813 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-a438cb6b-b09c-4fad-b630-8f3757f1ff2f service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0448129 Dec 09 21:56:43.819697 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-e153a081-f6e8-4f8f-930f-5a7f73e22a1e service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0920618 Dec 09 21:56:43.911140 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f4dad80-ee76-47da-9cd8-dd0a26c39e5c req-7c22e9c9-7cd0-4791-acb4-3d65311709ca service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0845070 Dec 09 21:56:43.997630 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88558ecc-87d7-4d4e-9cfc-5dee3578dcdf req-3b2a4003-f4db-4827-bc62-33789b2b62b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:43.999402 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-88558ecc-87d7-4d4e-9cfc-5dee3578dcdf req-3b2a4003-f4db-4827-bc62-33789b2b62b7 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 1096 time: 0.0436487 Dec 09 21:56:44.094263 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88558ecc-87d7-4d4e-9cfc-5dee3578dcdf req-1cb4ee6c-2460-469b-a9ca-4ffca17e3a04 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:44.095906 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-88558ecc-87d7-4d4e-9cfc-5dee3578dcdf req-1cb4ee6c-2460-469b-a9ca-4ffca17e3a04 service neutron] 10.222.0.10 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 911 time: 0.0895329 Dec 09 21:56:44.140047 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-88558ecc-87d7-4d4e-9cfc-5dee3578dcdf req-b99fe3e7-2e37-4de1-b192-6ef35770d1eb service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=c491c718-3982-4712-bb47-2fcfd2377987 HTTP/1.1" status: 200 len: 217 time: 0.0363889 Dec 09 21:56:44.195766 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88558ecc-87d7-4d4e-9cfc-5dee3578dcdf req-47fb6839-c0fc-4e77-8d27-a7b335c9f6a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:44.197270 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-88558ecc-87d7-4d4e-9cfc-5dee3578dcdf req-47fb6839-c0fc-4e77-8d27-a7b335c9f6a9 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0501318 Dec 09 21:56:44.246958 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88558ecc-87d7-4d4e-9cfc-5dee3578dcdf req-f7af7a7c-090a-45db-9292-397ef5f86e98 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:44.248992 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-88558ecc-87d7-4d4e-9cfc-5dee3578dcdf req-f7af7a7c-090a-45db-9292-397ef5f86e98 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0445938 Dec 09 21:56:44.341392 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-88558ecc-87d7-4d4e-9cfc-5dee3578dcdf req-a9dc120f-d056-4ab3-ab8b-fefdd4217a59 service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0854845 Dec 09 21:56:44.440451 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-88558ecc-87d7-4d4e-9cfc-5dee3578dcdf req-42540809-7783-4a48-b71d-bc485dac086f service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0923738 Dec 09 21:56:44.637973 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-567d2990-96af-4960-b449-8483ac58dff6 req-eaad68a0-cfcc-4018-8ab2-c821fa710cd5 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:44.639490 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-567d2990-96af-4960-b449-8483ac58dff6 req-eaad68a0-cfcc-4018-8ab2-c821fa710cd5 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 944 time: 0.0517340 Dec 09 21:56:44.689930 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-567d2990-96af-4960-b449-8483ac58dff6 req-c7ed210a-1126-4097-900e-a0afacdb1396 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442922 Dec 09 21:56:45.817453 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85e09242-892d-4190-8000-06e48343e8c0 req-c5f8e907-738d-458f-b426-8d680f8cfd40 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:45.818998 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85e09242-892d-4190-8000-06e48343e8c0 req-c5f8e907-738d-458f-b426-8d680f8cfd40 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 944 time: 0.0559833 Dec 09 21:56:45.871464 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85e09242-892d-4190-8000-06e48343e8c0 req-566d0dac-0e7f-46c5-a123-2b87483b3785 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417960 Dec 09 21:56:46.314779 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a21e4b4d-1dd5-468c-9681-4255369d95a1 req-b25da02c-be20-494e-ac7b-2cb9bed111d7 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0472450 Dec 09 21:56:46.399583 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a21e4b4d-1dd5-468c-9681-4255369d95a1 req-a3777c51-3513-4cc7-a132-685a9c5a4282 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:46.401134 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a21e4b4d-1dd5-468c-9681-4255369d95a1 req-a3777c51-3513-4cc7-a132-685a9c5a4282 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a1dd4ab6f25741058f3000ebf6ce1eac&device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 1098 time: 0.0429370 Dec 09 21:56:46.509774 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a21e4b4d-1dd5-468c-9681-4255369d95a1 req-ef7a57f9-b763-4f48-91dc-d7c4570d8242 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:46.511310 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a21e4b4d-1dd5-468c-9681-4255369d95a1 req-ef7a57f9-b763-4f48-91dc-d7c4570d8242 service neutron] 10.222.0.31 "GET /v2.0/networks?id=9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 HTTP/1.1" status: 200 len: 909 time: 0.0898094 Dec 09 21:56:46.581827 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a21e4b4d-1dd5-468c-9681-4255369d95a1 req-6e6dccb6-7b1f-4533-8907-a5eb6b171625 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=48ed4870-53b4-441d-92a8-1562825c8ca3 HTTP/1.1" status: 200 len: 1002 time: 0.0629849 Dec 09 21:56:46.630770 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a21e4b4d-1dd5-468c-9681-4255369d95a1 req-2fbc3675-d95d-4292-8d39-58f73d31ea38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:46.632298 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a21e4b4d-1dd5-468c-9681-4255369d95a1 req-2fbc3675-d95d-4292-8d39-58f73d31ea38 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=912d0a1a-1b1a-4383-8291-491e8e3358fe HTTP/1.1" status: 200 len: 847 time: 0.0436370 Dec 09 21:56:46.679014 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a21e4b4d-1dd5-468c-9681-4255369d95a1 req-80c6ae13-1371-4c8c-b845-9c52786253f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:46.680705 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a21e4b4d-1dd5-468c-9681-4255369d95a1 req-80c6ae13-1371-4c8c-b845-9c52786253f0 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0407381 Dec 09 21:56:46.774706 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a21e4b4d-1dd5-468c-9681-4255369d95a1 req-ba17e406-3551-4307-8285-c0f1bae3ebe7 service neutron] 10.222.0.31 "GET /v2.0/networks/9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0868409 Dec 09 21:56:46.870998 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a21e4b4d-1dd5-468c-9681-4255369d95a1 req-ae1301cc-20f9-4247-bb57-303bd5d400fb service neutron] 10.222.0.31 "GET /v2.0/networks/9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0896604 Dec 09 21:56:46.990971 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-575d654b-2f94-46aa-b22c-290ee655a59a req-442fbc76-bad7-49b5-bfcb-8d2f7fc28f0e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:46.992565 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-575d654b-2f94-46aa-b22c-290ee655a59a req-442fbc76-bad7-49b5-bfcb-8d2f7fc28f0e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 944 time: 0.0493743 Dec 09 21:56:47.040628 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-575d654b-2f94-46aa-b22c-290ee655a59a req-6af42bf5-590a-48a8-ad2e-eab77231b2b6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412936 Dec 09 21:56:48.172039 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51f42e9b-88a1-49c7-a491-4450bb15592c req-7f8e0243-120f-44ac-bc31-bb1232230dc3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:48.173528 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51f42e9b-88a1-49c7-a491-4450bb15592c req-7f8e0243-120f-44ac-bc31-bb1232230dc3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 944 time: 0.0528672 Dec 09 21:56:48.222457 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51f42e9b-88a1-49c7-a491-4450bb15592c req-54d2f759-bdcf-46d9-b9c7-e6458b1437ed tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427413 Dec 09 21:56:49.357683 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92377881-813c-4439-a7bc-c458955f54a6 req-fe69c1af-52fc-4fb9-90d7-dac10bb9ebf5 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:49.359234 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-92377881-813c-4439-a7bc-c458955f54a6 req-fe69c1af-52fc-4fb9-90d7-dac10bb9ebf5 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 944 time: 0.0501888 Dec 09 21:56:49.407950 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-92377881-813c-4439-a7bc-c458955f54a6 req-8b9b6c0b-357d-4f03-83f4-3574040ec180 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421686 Dec 09 21:56:50.543573 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbcf73a8-0241-4b1f-84ec-89dffb0fc3e7 req-96482e82-53a7-414d-afea-42225024856c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:50.545060 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bbcf73a8-0241-4b1f-84ec-89dffb0fc3e7 req-96482e82-53a7-414d-afea-42225024856c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 944 time: 0.0605323 Dec 09 21:56:50.600119 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bbcf73a8-0241-4b1f-84ec-89dffb0fc3e7 req-b99606ea-b9d8-4228-b8b2-ce6adb52e952 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485306 Dec 09 21:56:51.722356 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6132770-0a28-4f74-8ecf-ea960ef12f61 req-ccc94c49-867b-455e-b930-4ea501a997b9 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:51.723878 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6132770-0a28-4f74-8ecf-ea960ef12f61 req-ccc94c49-867b-455e-b930-4ea501a997b9 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 944 time: 0.0503652 Dec 09 21:56:51.773116 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6132770-0a28-4f74-8ecf-ea960ef12f61 req-235c8e0f-bd20-4301-885d-1a6254e10ec5 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431461 Dec 09 21:56:52.901842 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9493a13-7d75-413b-91be-815f8338b703 req-0f55ee6e-2e8f-41ae-94fe-943feed9d867 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:52.903408 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e9493a13-7d75-413b-91be-815f8338b703 req-0f55ee6e-2e8f-41ae-94fe-943feed9d867 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 944 time: 0.0517085 Dec 09 21:56:52.952133 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e9493a13-7d75-413b-91be-815f8338b703 req-03c5d1c2-db5b-4de0-b009-b9548b3cb9a0 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425880 Dec 09 21:56:54.083359 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edf290bb-e97c-4f10-9694-3851066fc1f2 req-2d44b952-049e-4575-99b4-c0acb27c70b7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:54.084791 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-edf290bb-e97c-4f10-9694-3851066fc1f2 req-2d44b952-049e-4575-99b4-c0acb27c70b7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 944 time: 0.0560250 Dec 09 21:56:54.136455 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-edf290bb-e97c-4f10-9694-3851066fc1f2 req-60b2e739-03f7-4570-a0c0-ad30eacc6190 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439918 Dec 09 21:56:55.136204 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device c491c718-3982-4712-bb47-2fcfd2377987 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:56:55.239478 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port c491c718-3982-4712-bb47-2fcfd2377987, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=c491c718-3982-4712-bb47-2fcfd2377987,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:56:55.250961 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'c491c718-3982-4712-bb47-2fcfd2377987', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'port_id': 'c491c718-3982-4712-bb47-2fcfd2377987', 'mac_address': 'fa:16:3e:b7:a0:96', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:56:55.259320 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5df5b672-c43f-4e65-8722-457584277c83 req-21448aa0-8e26-45f6-a562-84e1f028bb40 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:55.260990 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5df5b672-c43f-4e65-8722-457584277c83 req-21448aa0-8e26-45f6-a562-84e1f028bb40 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 944 time: 0.0501754 Dec 09 21:56:55.288604 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:55.302052 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c491c718-3982-4712-bb47-2fcfd2377987 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:56:55.308702 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5df5b672-c43f-4e65-8722-457584277c83 req-3016b940-91b2-493d-91b1-c8db8cda804c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413046 Dec 09 21:56:55.322358 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port c491c718-3982-4712-bb47-2fcfd2377987, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=c491c718-3982-4712-bb47-2fcfd2377987,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:56:55.327138 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:55.380404 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=c491c718-3982-4712-bb47-2fcfd2377987,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:56:55.527595 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['c491c718-3982-4712-bb47-2fcfd2377987'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:56:56.448447 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d95435ff-c8f1-4f61-a5a6-e776da197560 req-86bbabf5-6896-4bba-b107-43fc6a7ef2c4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:56.449960 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d95435ff-c8f1-4f61-a5a6-e776da197560 req-86bbabf5-6896-4bba-b107-43fc6a7ef2c4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 945 time: 0.0589554 Dec 09 21:56:56.505955 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d95435ff-c8f1-4f61-a5a6-e776da197560 req-96cab622-b27d-4ae5-bd75-21075a84a29e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470881 Dec 09 21:56:57.141967 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device c491c718-3982-4712-bb47-2fcfd2377987 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:56:57.204761 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port c491c718-3982-4712-bb47-2fcfd2377987 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:56:57.208378 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port c491c718-3982-4712-bb47-2fcfd2377987 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:56:57.208748 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:57.283942 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:57.307377 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0dee750b-74e3-4839-959c-726f883dd1d5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c491c718-3982-4712-bb47-2fcfd2377987'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:56:57.309642 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ad435659-495f-4207-941e-1fd945bc8610" -d '{"events": [{"server_uuid": "0dee750b-74e3-4839-959c-726f883dd1d5", "name": "network-vif-plugged", "status": "completed", "tag": "c491c718-3982-4712-bb47-2fcfd2377987"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:56:57.321805 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port c491c718-3982-4712-bb47-2fcfd2377987, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=c491c718-3982-4712-bb47-2fcfd2377987,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:56:57.326712 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:57.352833 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:56:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0a35b6bd-a3d9-4743-886b-eb1b73c997cf x-openstack-request-id: req-0a35b6bd-a3d9-4743-886b-eb1b73c997cf {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:56:57.353124 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0dee750b-74e3-4839-959c-726f883dd1d5", "name": "network-vif-plugged", "status": "completed", "tag": "c491c718-3982-4712-bb47-2fcfd2377987", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:56:57.353389 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0a35b6bd-a3d9-4743-886b-eb1b73c997cf {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:56:57.353789 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0dee750b-74e3-4839-959c-726f883dd1d5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c491c718-3982-4712-bb47-2fcfd2377987', 'code': 200} Dec 09 21:56:57.388849 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=c491c718-3982-4712-bb47-2fcfd2377987,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:56:57.398330 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:57.449959 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-771d5e36-49cd-455c-821b-0f55ac4ac9ee req-bb58ca40-a860-46ea-abf7-417a432d7ec9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:57.451494 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-771d5e36-49cd-455c-821b-0f55ac4ac9ee req-bb58ca40-a860-46ea-abf7-417a432d7ec9 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 1098 time: 0.0414131 Dec 09 21:56:57.495720 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-771d5e36-49cd-455c-821b-0f55ac4ac9ee req-e4ae648d-c340-4a64-a930-d8942f9bdaba service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0373759 Dec 09 21:56:57.618364 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:56:57.639732 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b96f716-18e9-4cde-80ac-d3201c19e19d req-9df7f266-0a65-4a4c-af4a-59c4f871384d tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:57.641258 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2b96f716-18e9-4cde-80ac-d3201c19e19d req-9df7f266-0a65-4a4c-af4a-59c4f871384d tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 946 time: 0.0510175 Dec 09 21:56:57.691185 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2b96f716-18e9-4cde-80ac-d3201c19e19d req-6ccfea06-15ce-42f8-ab07-9266ab7c4396 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436091 Dec 09 21:56:58.823829 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce47fe03-dbef-4a5d-920d-f3fc8a8e7662 req-c4649b65-5123-43b2-8e84-898a7823b071 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:58.825522 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ce47fe03-dbef-4a5d-920d-f3fc8a8e7662 req-c4649b65-5123-43b2-8e84-898a7823b071 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 946 time: 0.0624826 Dec 09 21:56:58.875321 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ce47fe03-dbef-4a5d-920d-f3fc8a8e7662 req-2e412a1b-ec96-44e1-8b0b-94c4d8e7432d tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434866 Dec 09 21:56:58.999481 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-390ebe5a-c16a-4a4c-b97f-781bf759dec0 req-16cdd282-16b9-4cbb-b8fa-eb5b2f44bc0b tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:56:59.000857 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-390ebe5a-c16a-4a4c-b97f-781bf759dec0 req-16cdd282-16b9-4cbb-b8fa-eb5b2f44bc0b tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 946 time: 0.0548923 Dec 09 21:56:59.052798 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-390ebe5a-c16a-4a4c-b97f-781bf759dec0 req-1c6f09c1-8c85-4cbc-a9d5-d434ba8347c0 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427210 Dec 09 21:57:01.569132 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-717b3fb7-e655-454a-9428-5f3efe430789 req-b1e0e9f4-3c93-4aec-b695-7eb51326dd28 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:01.570603 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-717b3fb7-e655-454a-9428-5f3efe430789 req-b1e0e9f4-3c93-4aec-b695-7eb51326dd28 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 810 time: 0.1063936 Dec 09 21:57:01.589229 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-717b3fb7-e655-454a-9428-5f3efe430789 req-ae00d117-39d5-4628-8cd5-a45acd2c261b tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/quotas/be526cfddc4f4783b993a3f6e5b5e630 HTTP/1.1" status: 200 len: 375 time: 0.0094016 Dec 09 21:57:01.642515 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-717b3fb7-e655-454a-9428-5f3efe430789 req-0544cb94-958e-41da-8637-296aceb2b449 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0477831 Dec 09 21:57:01.736396 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-717b3fb7-e655-454a-9428-5f3efe430789 req-1ddcd98a-6c03-47e9-9d5c-1a295358222e service neutron] 10.222.0.13 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0864418 Dec 09 21:57:01.838142 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-717b3fb7-e655-454a-9428-5f3efe430789 req-50fa52e8-01d0-476b-88f6-88fa5961233c service neutron] 10.222.0.13 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0953529 Dec 09 21:57:02.036056 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c3946064-576d-4d59-a305-52ba5354ac8c req-58317cec-a33d-476c-877c-dc15f435f5a1 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 210 time: 0.0300846 Dec 09 21:57:02.976417 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f4b9df3c-b78c-4d8b-9b22-06d70c93df23 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:03.016112 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-717b3fb7-e655-454a-9428-5f3efe430789 req-e9eddc99-b276-4697-9ebb-d1e9853bcc6e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:03.017632 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-717b3fb7-e655-454a-9428-5f3efe430789 req-e9eddc99-b276-4697-9ebb-d1e9853bcc6e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.31 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 810 time: 0.1165297 Dec 09 21:57:03.030536 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-717b3fb7-e655-454a-9428-5f3efe430789 req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Request body: {'port': {'device_id': 'fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'admin_state_up': True, 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:57:03.135339 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1f430dbd-09e0-4923-8166-6c124f311f10 req-d50441ce-d437-4d95-a292-e64809592489 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 210 time: 0.0306590 Dec 09 21:57:03.150150 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-717b3fb7-e655-454a-9428-5f3efe430789 req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Made reservation on behalf of be526cfddc4f4783b993a3f6e5b5e630 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:57:03.154176 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-717b3fb7-e655-454a-9428-5f3efe430789 req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:03.281626 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-717b3fb7-e655-454a-9428-5f3efe430789 req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Allocated IP 172.20.0.7 (486ad174-ad0c-4065-a4b6-6f9af6b2a208/7004626f-deda-4ef1-8abe-97a447b2d2e9/d7c0b793-2d0a-4ee2-88a8-be634688e2a6) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:57:03.442853 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-717b3fb7-e655-454a-9428-5f3efe430789 req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:03.476934 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-717b3fb7-e655-454a-9428-5f3efe430789 req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:03.490526 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['c491c718-3982-4712-bb47-2fcfd2377987'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:57:03.525681 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-717b3fb7-e655-454a-9428-5f3efe430789 req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:57:03.531087 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-717b3fb7-e655-454a-9428-5f3efe430789 req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:57:03.534706 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-717b3fb7-e655-454a-9428-5f3efe430789 req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:57:03.541552 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event updated for resources: {'Port': ['ID=d7c0b793-2d0a-4ee2-88a8-be634688e2a6,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:57:03.583688 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:03.584313 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:03.584818 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:03.585357 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:03.585692 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:03.586023 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:03.586351 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:03.586675 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:03.586996 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:03.587316 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:03.587662 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:03.587983 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:03.588305 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:03.612628 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-717b3fb7-e655-454a-9428-5f3efe430789 req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:03.613282 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-717b3fb7-e655-454a-9428-5f3efe430789 req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:03.635370 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-717b3fb7-e655-454a-9428-5f3efe430789 req-a1f2aab9-100e-41e7-a08b-d07b7feb4e31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6088417 Dec 09 21:57:03.650407 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-717b3fb7-e655-454a-9428-5f3efe430789 req-5d5d23d3-37fa-46f3-a47d-3334f9918f64 service neutron] Request body: {'port': {'device_id': 'fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:57:03.709080 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-717b3fb7-e655-454a-9428-5f3efe430789 req-5d5d23d3-37fa-46f3-a47d-3334f9918f64 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:03.873806 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5d644a19-7099-40f1-bb8f-8861d4ae1bbe None None] Provisioning complete for port d7c0b793-2d0a-4ee2-88a8-be634688e2a6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:57:03.874144 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5d644a19-7099-40f1-bb8f-8861d4ae1bbe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:03.908667 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-5d644a19-7099-40f1-bb8f-8861d4ae1bbe None None] Port d7c0b793-2d0a-4ee2-88a8-be634688e2a6 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:57:03.992455 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-717b3fb7-e655-454a-9428-5f3efe430789 req-5d5d23d3-37fa-46f3-a47d-3334f9918f64 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d7c0b793-2d0a-4ee2-88a8-be634688e2a6 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:57:04.000995 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-717b3fb7-e655-454a-9428-5f3efe430789 req-5d5d23d3-37fa-46f3-a47d-3334f9918f64 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:04.014119 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-717b3fb7-e655-454a-9428-5f3efe430789 req-5d5d23d3-37fa-46f3-a47d-3334f9918f64 service neutron] Transition to ACTIVE for port object d7c0b793-2d0a-4ee2-88a8-be634688e2a6 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:57:04.017615 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-717b3fb7-e655-454a-9428-5f3efe430789 req-5d5d23d3-37fa-46f3-a47d-3334f9918f64 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:04.111176 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d5d23d3-37fa-46f3-a47d-3334f9918f64 service neutron] Pushing event updated for resources: {'Port': ['ID=d7c0b793-2d0a-4ee2-88a8-be634688e2a6,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:57:04.158500 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-717b3fb7-e655-454a-9428-5f3efe430789 req-5d5d23d3-37fa-46f3-a47d-3334f9918f64 service neutron] Attempting to bind port d7c0b793-2d0a-4ee2-88a8-be634688e2a6 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:57:04.158844 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-717b3fb7-e655-454a-9428-5f3efe430789 req-5d5d23d3-37fa-46f3-a47d-3334f9918f64 service neutron] Attempting to bind port d7c0b793-2d0a-4ee2-88a8-be634688e2a6 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:57:04.159594 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-717b3fb7-e655-454a-9428-5f3efe430789 req-5d5d23d3-37fa-46f3-a47d-3334f9918f64 service neutron] Attempting to bind port d7c0b793-2d0a-4ee2-88a8-be634688e2a6 on network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:57:04.173185 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-717b3fb7-e655-454a-9428-5f3efe430789 req-5d5d23d3-37fa-46f3-a47d-3334f9918f64 service neutron] Port d7c0b793-2d0a-4ee2-88a8-be634688e2a6 on network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:57:04.173796 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-717b3fb7-e655-454a-9428-5f3efe430789 req-5d5d23d3-37fa-46f3-a47d-3334f9918f64 service neutron] Attempting to bind port d7c0b793-2d0a-4ee2-88a8-be634688e2a6 on network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:57:04.179188 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-717b3fb7-e655-454a-9428-5f3efe430789 req-5d5d23d3-37fa-46f3-a47d-3334f9918f64 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 56, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:57:04.179567 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-717b3fb7-e655-454a-9428-5f3efe430789 req-5d5d23d3-37fa-46f3-a47d-3334f9918f64 service neutron] Checking segment: {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:57:04.179940 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-717b3fb7-e655-454a-9428-5f3efe430789 req-5d5d23d3-37fa-46f3-a47d-3334f9918f64 service neutron] Bound using segment: {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:57:04.180540 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-717b3fb7-e655-454a-9428-5f3efe430789 req-5d5d23d3-37fa-46f3-a47d-3334f9918f64 service neutron] Bound port: d7c0b793-2d0a-4ee2-88a8-be634688e2a6, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:57:04.181686 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-717b3fb7-e655-454a-9428-5f3efe430789 req-5d5d23d3-37fa-46f3-a47d-3334f9918f64 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:04.262026 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-717b3fb7-e655-454a-9428-5f3efe430789 req-5d5d23d3-37fa-46f3-a47d-3334f9918f64 service neutron] For port d7c0b793-2d0a-4ee2-88a8-be634688e2a6, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:57:04.267974 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-717b3fb7-e655-454a-9428-5f3efe430789 req-5d5d23d3-37fa-46f3-a47d-3334f9918f64 service neutron] For port d7c0b793-2d0a-4ee2-88a8-be634688e2a6, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=d7c0b793-2d0a-4ee2-88a8-be634688e2a6,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:57:04.274825 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-717b3fb7-e655-454a-9428-5f3efe430789 req-5d5d23d3-37fa-46f3-a47d-3334f9918f64 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:04.297272 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fabda408-6ef4-4576-b906-958e89214348 req-2e9cdb48-067c-4099-a9a2-3d5d3abfc01c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:04.298765 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fabda408-6ef4-4576-b906-958e89214348 req-2e9cdb48-067c-4099-a9a2-3d5d3abfc01c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 943 time: 0.0772989 Dec 09 21:57:04.323663 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-717b3fb7-e655-454a-9428-5f3efe430789 req-5d5d23d3-37fa-46f3-a47d-3334f9918f64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:04.324511 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-717b3fb7-e655-454a-9428-5f3efe430789 req-5d5d23d3-37fa-46f3-a47d-3334f9918f64 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:04.326439 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-717b3fb7-e655-454a-9428-5f3efe430789 req-5d5d23d3-37fa-46f3-a47d-3334f9918f64 service neutron] 10.222.0.31 "PUT /v2.0/ports/d7c0b793-2d0a-4ee2-88a8-be634688e2a6 HTTP/1.1" status: 200 len: 1092 time: 0.6820669 Dec 09 21:57:04.327273 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba', 'tag': 'd7c0b793-2d0a-4ee2-88a8-be634688e2a6'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:57:04.330060 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-45bbb86c-a2a6-4ee2-bb88-f78075ed986d" -d '{"events": [{"name": "network-changed", "server_uuid": "fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba", "tag": "d7c0b793-2d0a-4ee2-88a8-be634688e2a6"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:57:04.384065 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fabda408-6ef4-4576-b906-958e89214348 req-266e2b48-c1e9-457a-92f7-2f55f86292fb tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0788481 Dec 09 21:57:04.420561 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d5d23d3-37fa-46f3-a47d-3334f9918f64 service neutron] Pushing event updated for resources: {'Port': ['ID=d7c0b793-2d0a-4ee2-88a8-be634688e2a6,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:57:04.437174 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-717b3fb7-e655-454a-9428-5f3efe430789 req-2d3bcc6a-fec1-4541-b287-7d9373c84935 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:04.438950 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-717b3fb7-e655-454a-9428-5f3efe430789 req-2d3bcc6a-fec1-4541-b287-7d9373c84935 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 1095 time: 0.0657461 Dec 09 21:57:04.447642 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:57:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8f9e3fc1-cd09-4f6d-b660-235914b21e5c x-openstack-request-id: req-8f9e3fc1-cd09-4f6d-b660-235914b21e5c {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:57:04.447938 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba", "tag": "d7c0b793-2d0a-4ee2-88a8-be634688e2a6", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:57:04.448194 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8f9e3fc1-cd09-4f6d-b660-235914b21e5c {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:57:04.448606 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba', 'tag': 'd7c0b793-2d0a-4ee2-88a8-be634688e2a6', 'status': 'completed', 'code': 200} Dec 09 21:57:04.489578 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-717b3fb7-e655-454a-9428-5f3efe430789 req-7874c8b5-113a-49ba-a0c5-0eb67d9e1a3f service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d7c0b793-2d0a-4ee2-88a8-be634688e2a6 HTTP/1.1" status: 200 len: 217 time: 0.0374653 Dec 09 21:57:04.546696 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-717b3fb7-e655-454a-9428-5f3efe430789 req-d77eaafc-592d-49e2-838a-aaeba9526b44 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:04.548249 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-717b3fb7-e655-454a-9428-5f3efe430789 req-d77eaafc-592d-49e2-838a-aaeba9526b44 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0514989 Dec 09 21:57:04.599017 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-717b3fb7-e655-454a-9428-5f3efe430789 req-1c590f0b-0a1b-45b0-8d94-4900612ac7cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:04.600503 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-717b3fb7-e655-454a-9428-5f3efe430789 req-1c590f0b-0a1b-45b0-8d94-4900612ac7cb service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0436151 Dec 09 21:57:04.692229 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-717b3fb7-e655-454a-9428-5f3efe430789 req-0c691fa5-67b2-4c48-af75-555b6c132454 service neutron] 10.222.0.31 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842783 Dec 09 21:57:04.793216 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-717b3fb7-e655-454a-9428-5f3efe430789 req-ff8a569b-2ddd-4acd-9467-30dd7ea42a29 service neutron] 10.222.0.31 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0925806 Dec 09 21:57:04.881305 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45bbb86c-a2a6-4ee2-bb88-f78075ed986d req-1c3111e1-c2b9-473e-84fc-294ca1172e07 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:04.882937 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-45bbb86c-a2a6-4ee2-bb88-f78075ed986d req-1c3111e1-c2b9-473e-84fc-294ca1172e07 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 1095 time: 0.0438654 Dec 09 21:57:04.981575 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45bbb86c-a2a6-4ee2-bb88-f78075ed986d req-596887bd-fd03-4b63-a76e-c58efdd39053 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:04.983090 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-45bbb86c-a2a6-4ee2-bb88-f78075ed986d req-596887bd-fd03-4b63-a76e-c58efdd39053 service neutron] 10.222.0.31 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 911 time: 0.0936098 Dec 09 21:57:05.025061 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-45bbb86c-a2a6-4ee2-bb88-f78075ed986d req-68629537-01c3-477f-bd66-ab2b2fa436ea service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=d7c0b793-2d0a-4ee2-88a8-be634688e2a6 HTTP/1.1" status: 200 len: 217 time: 0.0349178 Dec 09 21:57:05.078733 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45bbb86c-a2a6-4ee2-bb88-f78075ed986d req-63307fb9-c2ee-4488-8de8-6a25e8085b51 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:05.080358 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-45bbb86c-a2a6-4ee2-bb88-f78075ed986d req-63307fb9-c2ee-4488-8de8-6a25e8085b51 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0483789 Dec 09 21:57:05.129063 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45bbb86c-a2a6-4ee2-bb88-f78075ed986d req-f4a210b7-dfe6-4213-aaba-304c7b977316 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:05.130631 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-45bbb86c-a2a6-4ee2-bb88-f78075ed986d req-f4a210b7-dfe6-4213-aaba-304c7b977316 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0426917 Dec 09 21:57:05.223249 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-45bbb86c-a2a6-4ee2-bb88-f78075ed986d req-16d80b10-0fbd-4edf-b1df-14aa3456a438 service neutron] 10.222.0.31 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0849776 Dec 09 21:57:05.320303 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-45bbb86c-a2a6-4ee2-bb88-f78075ed986d req-89b80379-3bfa-46fb-85a3-9bab6a23bfa5 service neutron] 10.222.0.31 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0893085 Dec 09 21:57:05.510630 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17dd74ed-bdbc-414d-aae8-127f403bed26 req-99c6b732-3677-41ab-a6e4-8a3f0f59995c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:05.512635 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-17dd74ed-bdbc-414d-aae8-127f403bed26 req-99c6b732-3677-41ab-a6e4-8a3f0f59995c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 943 time: 0.0521491 Dec 09 21:57:05.565435 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-17dd74ed-bdbc-414d-aae8-127f403bed26 req-01233834-1013-4a2e-a2ca-023dc0ad6aaf tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467982 Dec 09 21:57:05.579738 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eca2d53b-aa92-4a64-9044-e6be46ed1a83 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:06.710028 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:06.734787 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e607e43f-b854-4dbb-b5a9-89c9ddf84b4b req-3533dc66-877c-4151-81d2-1ff80ef96e43 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:06.736408 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e607e43f-b854-4dbb-b5a9-89c9ddf84b4b req-3533dc66-877c-4151-81d2-1ff80ef96e43 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 943 time: 0.0659781 Dec 09 21:57:06.815921 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e607e43f-b854-4dbb-b5a9-89c9ddf84b4b req-0f6fcb1c-2971-4ec3-bcc1-b5d335d69875 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0726533 Dec 09 21:57:07.957691 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a73b7354-c9eb-4c24-9e92-675abfba2c47 req-cdbc321b-ddd6-4ec7-abc7-d056a9f20891 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:07.967254 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a73b7354-c9eb-4c24-9e92-675abfba2c47 req-cdbc321b-ddd6-4ec7-abc7-d056a9f20891 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 943 time: 0.0676866 Dec 09 21:57:08.021183 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a73b7354-c9eb-4c24-9e92-675abfba2c47 req-be80a629-58a9-40ab-a7e7-2a5a1c83a8c7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0528207 Dec 09 21:57:08.045241 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:09.164046 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40bc400d-2962-40cc-afbc-cc763b2c64a9 req-eb3ab241-4796-44a0-9ba6-7b63dc71b12e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:09.166251 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-40bc400d-2962-40cc-afbc-cc763b2c64a9 req-eb3ab241-4796-44a0-9ba6-7b63dc71b12e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 943 time: 0.0658834 Dec 09 21:57:09.221041 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-40bc400d-2962-40cc-afbc-cc763b2c64a9 req-46495eb4-5370-47fd-8141-29954ad2ca67 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477989 Dec 09 21:57:09.674354 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:10.346537 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b58bb98-03d2-4620-9ee9-365f20c6155a req-14e1a88e-6993-4300-8ce2-587726617d4e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:10.351874 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4b58bb98-03d2-4620-9ee9-365f20c6155a req-14e1a88e-6993-4300-8ce2-587726617d4e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 943 time: 0.0541711 Dec 09 21:57:10.400223 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4b58bb98-03d2-4620-9ee9-365f20c6155a req-6b107b23-9f95-4767-94e1-3d3bd473ac6e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452874 Dec 09 21:57:11.529409 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9dd886c-6ae3-422b-8f50-223ca21e31f4 req-50a71844-0989-47d1-9c45-31c01872ad10 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:11.530884 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9dd886c-6ae3-422b-8f50-223ca21e31f4 req-50a71844-0989-47d1-9c45-31c01872ad10 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 943 time: 0.0633562 Dec 09 21:57:11.586629 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9dd886c-6ae3-422b-8f50-223ca21e31f4 req-8d8711fe-3eca-43fd-80cf-8f3d80df7236 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492284 Dec 09 21:57:12.713384 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cfb7dad-cfac-4892-ae2b-45f4dbb35318 req-e88ad217-9481-4954-ae5c-f92d23f27125 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:12.714916 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5cfb7dad-cfac-4892-ae2b-45f4dbb35318 req-e88ad217-9481-4954-ae5c-f92d23f27125 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 943 time: 0.0499265 Dec 09 21:57:12.766073 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5cfb7dad-cfac-4892-ae2b-45f4dbb35318 req-e1fe29a4-eccd-4f5f-805f-25f290842e93 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429966 Dec 09 21:57:13.886051 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69cf3c30-c9ea-49ff-a22c-cc1aa98cd884 req-d8efc892-f3c9-43c2-8b87-fa11b23d725c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:13.887750 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69cf3c30-c9ea-49ff-a22c-cc1aa98cd884 req-d8efc892-f3c9-43c2-8b87-fa11b23d725c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 943 time: 0.0499754 Dec 09 21:57:13.936027 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69cf3c30-c9ea-49ff-a22c-cc1aa98cd884 req-2771570f-fad5-467e-a45c-577873802e9a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419831 Dec 09 21:57:15.069983 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eeb7644-0bb9-456c-8a93-b779d8772e6a req-49cff2d4-65cd-4cea-9967-d3dfad7598d8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:15.071489 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7eeb7644-0bb9-456c-8a93-b779d8772e6a req-49cff2d4-65cd-4cea-9967-d3dfad7598d8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 943 time: 0.0561228 Dec 09 21:57:15.120515 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7eeb7644-0bb9-456c-8a93-b779d8772e6a req-a60bae9c-d07c-46d8-b9ef-71b5860e3998 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421579 Dec 09 21:57:16.245442 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66df820f-8724-418f-858b-006fe354ff25 req-7f8b0316-0503-437d-9584-a197c874ad96 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:16.247951 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66df820f-8724-418f-858b-006fe354ff25 req-7f8b0316-0503-437d-9584-a197c874ad96 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 943 time: 0.0531077 Dec 09 21:57:16.299482 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66df820f-8724-418f-858b-006fe354ff25 req-1c828204-19db-4fc0-826f-485725ba29d4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451994 Dec 09 21:57:17.434073 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ae4441-fecb-4d9c-82fa-4f6f40a4318d req-e564213e-0091-40de-9f58-e033206e3fe3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:17.436413 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2ae4441-fecb-4d9c-82fa-4f6f40a4318d req-e564213e-0091-40de-9f58-e033206e3fe3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 943 time: 0.0591304 Dec 09 21:57:17.485907 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2ae4441-fecb-4d9c-82fa-4f6f40a4318d req-d7d2d44f-08c4-4fbc-838e-06771b3a94ea tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439451 Dec 09 21:57:18.614771 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9115c1d6-e415-4920-beb3-b198c4610cc6 req-92eb0c2a-2a3a-4307-bd46-f5eca5c778d6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:18.616250 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9115c1d6-e415-4920-beb3-b198c4610cc6 req-92eb0c2a-2a3a-4307-bd46-f5eca5c778d6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 943 time: 0.0537267 Dec 09 21:57:18.674985 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9115c1d6-e415-4920-beb3-b198c4610cc6 req-71b74d63-5404-4581-aecc-af417d34ab0b tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497172 Dec 09 21:57:19.199018 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:57:19.819811 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0647638-7619-477f-8b6e-5bf25c32cd48 req-edfe8fad-f08e-446d-bc32-55afee6b1e01 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:19.821344 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0647638-7619-477f-8b6e-5bf25c32cd48 req-edfe8fad-f08e-446d-bc32-55afee6b1e01 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 943 time: 0.0697050 Dec 09 21:57:19.875591 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0647638-7619-477f-8b6e-5bf25c32cd48 req-d7456d65-9cd1-42dd-9987-7e0bc337b777 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479069 Dec 09 21:57:20.999865 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2928a5e0-d44a-4f8c-ae64-006650f76c5d req-e6020982-bf94-4aab-8888-3debeed88472 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:21.001341 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2928a5e0-d44a-4f8c-ae64-006650f76c5d req-e6020982-bf94-4aab-8888-3debeed88472 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 943 time: 0.0506327 Dec 09 21:57:21.058779 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2928a5e0-d44a-4f8c-ae64-006650f76c5d req-dbc8ee53-876f-4774-aa71-d53cf23017c5 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0478134 Dec 09 21:57:22.190785 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1c5633c-1b0b-4229-9d43-cce68e14365f req-03eb92cb-246b-435b-a4d5-f0ccf45d7e3a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:22.192612 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f1c5633c-1b0b-4229-9d43-cce68e14365f req-03eb92cb-246b-435b-a4d5-f0ccf45d7e3a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 943 time: 0.0539517 Dec 09 21:57:22.244193 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f1c5633c-1b0b-4229-9d43-cce68e14365f req-f9c4473c-0a6c-420a-9b42-d7c0333067bb tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450423 Dec 09 21:57:23.387195 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd54f656-bd14-4bc9-b351-7e229c53a56c req-47702218-ec10-4fa7-a81d-256c50c53a3e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:23.389533 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd54f656-bd14-4bc9-b351-7e229c53a56c req-47702218-ec10-4fa7-a81d-256c50c53a3e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 943 time: 0.0635808 Dec 09 21:57:23.441384 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd54f656-bd14-4bc9-b351-7e229c53a56c req-70b5d8bf-be09-4d49-947a-d110e68d7810 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452342 Dec 09 21:57:24.579487 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bdf25c3-de02-4188-8e0e-c0549bfafe4f req-31a14504-66d1-44d3-8d99-f9afc6f3fa5a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:24.580995 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9bdf25c3-de02-4188-8e0e-c0549bfafe4f req-31a14504-66d1-44d3-8d99-f9afc6f3fa5a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 943 time: 0.0686178 Dec 09 21:57:24.635085 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9bdf25c3-de02-4188-8e0e-c0549bfafe4f req-f24e821a-ef0c-4d83-95eb-239cd18c0fe0 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461085 Dec 09 21:57:25.764425 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fcbf595-8eb0-43bd-ba99-4f0fcb082c4e req-61080b8c-ef44-42ec-a915-34bdec440800 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:25.765971 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fcbf595-8eb0-43bd-ba99-4f0fcb082c4e req-61080b8c-ef44-42ec-a915-34bdec440800 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 943 time: 0.0499640 Dec 09 21:57:25.818182 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4fcbf595-8eb0-43bd-ba99-4f0fcb082c4e req-b1ab563d-ae61-41df-81cd-24a61f520446 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455246 Dec 09 21:57:26.947288 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddfa69dc-8b8d-48c5-99dd-e4b4eea75de5 req-7ea2c52e-b526-484b-ac3e-7e0a6ee5c82c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:26.949089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ddfa69dc-8b8d-48c5-99dd-e4b4eea75de5 req-7ea2c52e-b526-484b-ac3e-7e0a6ee5c82c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 943 time: 0.0550883 Dec 09 21:57:27.002649 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ddfa69dc-8b8d-48c5-99dd-e4b4eea75de5 req-643a22eb-383d-4abd-8a44-f9f82c01abc3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454252 Dec 09 21:57:27.040610 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device d7c0b793-2d0a-4ee2-88a8-be634688e2a6 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:57:27.142567 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port d7c0b793-2d0a-4ee2-88a8-be634688e2a6, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=d7c0b793-2d0a-4ee2-88a8-be634688e2a6,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:57:27.154684 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'd7c0b793-2d0a-4ee2-88a8-be634688e2a6', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'port_id': 'd7c0b793-2d0a-4ee2-88a8-be634688e2a6', 'mac_address': 'fa:16:3e:33:e7:d5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:57:27.192343 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:27.208790 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d7c0b793-2d0a-4ee2-88a8-be634688e2a6 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:57:27.228477 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port d7c0b793-2d0a-4ee2-88a8-be634688e2a6, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=d7c0b793-2d0a-4ee2-88a8-be634688e2a6,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:57:27.233433 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:27.283427 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=d7c0b793-2d0a-4ee2-88a8-be634688e2a6,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:57:27.291622 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:27.291956 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:27.292320 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:27.292692 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:27.293043 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:27.293455 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:27.293757 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:27.294080 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:27.294406 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:27.294756 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:27.295076 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:27.295396 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:27.295800 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:27.398104 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:27.444310 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['d7c0b793-2d0a-4ee2-88a8-be634688e2a6'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:57:27.617393 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:28.136118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4715ea3-2b41-425e-b303-f19128f3e08a req-bced1f14-28d1-4a4c-8d43-590e8a684f05 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:28.137657 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4715ea3-2b41-425e-b303-f19128f3e08a req-bced1f14-28d1-4a4c-8d43-590e8a684f05 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 944 time: 0.0569541 Dec 09 21:57:28.189380 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4715ea3-2b41-425e-b303-f19128f3e08a req-d81240e5-9436-4f62-9ad6-a417634b5a09 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455933 Dec 09 21:57:29.054156 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device d7c0b793-2d0a-4ee2-88a8-be634688e2a6 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:57:29.106997 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port d7c0b793-2d0a-4ee2-88a8-be634688e2a6 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:57:29.110825 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port d7c0b793-2d0a-4ee2-88a8-be634688e2a6 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:57:29.111192 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:29.190891 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:29.217981 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd7c0b793-2d0a-4ee2-88a8-be634688e2a6'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:57:29.220208 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-05239c59-b2b3-4bbc-83b1-6815a3f64b35" -d '{"events": [{"server_uuid": "fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba", "name": "network-vif-plugged", "status": "completed", "tag": "d7c0b793-2d0a-4ee2-88a8-be634688e2a6"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:57:29.234018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port d7c0b793-2d0a-4ee2-88a8-be634688e2a6, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=d7c0b793-2d0a-4ee2-88a8-be634688e2a6,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:57:29.238920 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:29.292533 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=d7c0b793-2d0a-4ee2-88a8-be634688e2a6,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:57:29.316205 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-609bd387-6dd1-4ecf-9366-424d5aabf6ba req-20eab628-6abd-4910-abb2-9658342725a8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:29.317656 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-609bd387-6dd1-4ecf-9366-424d5aabf6ba req-20eab628-6abd-4910-abb2-9658342725a8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 945 time: 0.0550673 Dec 09 21:57:29.367531 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-609bd387-6dd1-4ecf-9366-424d5aabf6ba req-f4cd5784-ca5d-4b44-9b2a-1ce5cfb69d56 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436161 Dec 09 21:57:29.414995 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:57:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0e7f17e1-33c9-4e85-b16e-22bcd81d2311 x-openstack-request-id: req-0e7f17e1-33c9-4e85-b16e-22bcd81d2311 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:57:29.415303 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba", "name": "network-vif-plugged", "status": "completed", "tag": "d7c0b793-2d0a-4ee2-88a8-be634688e2a6", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:57:29.415588 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0e7f17e1-33c9-4e85-b16e-22bcd81d2311 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:57:29.415999 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd7c0b793-2d0a-4ee2-88a8-be634688e2a6', 'code': 200} Dec 09 21:57:29.517403 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f591ed68-e968-4a4c-927a-af25a2e6637d req-4f957446-4c23-4c7e-b8bd-144d51c3dba7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:29.518940 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f591ed68-e968-4a4c-927a-af25a2e6637d req-4f957446-4c23-4c7e-b8bd-144d51c3dba7 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 1097 time: 0.0432787 Dec 09 21:57:29.564469 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f591ed68-e968-4a4c-927a-af25a2e6637d req-9276f2e7-9c6f-466e-8f43-10e3a0d5d994 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0383496 Dec 09 21:57:30.495862 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-069973cb-829f-4b87-93f7-07d9f7cc84f1 req-669c4e59-ab8f-4888-b970-e77897efc7c3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:30.497824 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-069973cb-829f-4b87-93f7-07d9f7cc84f1 req-669c4e59-ab8f-4888-b970-e77897efc7c3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 945 time: 0.0503235 Dec 09 21:57:30.548280 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-069973cb-829f-4b87-93f7-07d9f7cc84f1 req-5aeb4bc6-8d24-48dd-b396-5cc813c79409 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441456 Dec 09 21:57:31.679207 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04c0d9f0-caa0-4df4-8e78-4ceba3654667 req-e3bc199e-44a0-46f6-bcc4-6c38d3912ba5 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:31.680745 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04c0d9f0-caa0-4df4-8e78-4ceba3654667 req-e3bc199e-44a0-46f6-bcc4-6c38d3912ba5 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 945 time: 0.0610631 Dec 09 21:57:31.727654 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04c0d9f0-caa0-4df4-8e78-4ceba3654667 req-8820949a-326d-4ba7-bf2d-c7067ca6830b tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407298 Dec 09 21:57:31.849290 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57b29164-2ecd-4551-880b-e7715cd55efe req-b7084c56-d273-4993-8cce-e86e56595ebe tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:31.850700 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-57b29164-2ecd-4551-880b-e7715cd55efe req-b7084c56-d273-4993-8cce-e86e56595ebe tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 945 time: 0.0510550 Dec 09 21:57:31.898994 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-57b29164-2ecd-4551-880b-e7715cd55efe req-1c84b5bd-5329-4d07-99dc-22cab54b67fc tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422633 Dec 09 21:57:32.204172 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdc713ef-1414-4702-b79d-e6218a5f3b9b req-c6ed7949-6b7f-44db-a562-42ecc4bea194 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:32.205938 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cdc713ef-1414-4702-b79d-e6218a5f3b9b req-c6ed7949-6b7f-44db-a562-42ecc4bea194 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 945 time: 0.0515621 Dec 09 21:57:32.267679 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cdc713ef-1414-4702-b79d-e6218a5f3b9b req-06c2efba-b453-48fd-9af0-a00bdc469ee7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0528672 Dec 09 21:57:32.974650 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b1c6b830-ad8e-4339-94fe-67fd415ecd45 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:33.402170 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbdba519-8416-4b05-ae6c-ffd04a22afa1 req-c6105bd4-c848-4ddd-8905-fefb9e44ff9e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:33.403734 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbdba519-8416-4b05-ae6c-ffd04a22afa1 req-c6105bd4-c848-4ddd-8905-fefb9e44ff9e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 945 time: 0.0539889 Dec 09 21:57:33.453687 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cbdba519-8416-4b05-ae6c-ffd04a22afa1 req-efdf0a0b-95dc-419c-8527-58c7cffdbbe4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435982 Dec 09 21:57:33.603465 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e9c3600-31fa-4d74-9d9a-b6d124f01185 req-dbfff85e-2c92-44ec-ad2f-233e3241f178 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:33.604963 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6e9c3600-31fa-4d74-9d9a-b6d124f01185 req-dbfff85e-2c92-44ec-ad2f-233e3241f178 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.31 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 945 time: 0.0584722 Dec 09 21:57:33.699864 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-6e9c3600-31fa-4d74-9d9a-b6d124f01185 req-b4e5d6c5-c28e-4c45-8993-bd92ab6b3ee8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Deleting port d7c0b793-2d0a-4ee2-88a8-be634688e2a6 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:57:33.700170 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6e9c3600-31fa-4d74-9d9a-b6d124f01185 req-b4e5d6c5-c28e-4c45-8993-bd92ab6b3ee8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:33.793066 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-6e9c3600-31fa-4d74-9d9a-b6d124f01185 req-b4e5d6c5-c28e-4c45-8993-bd92ab6b3ee8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] For port d7c0b793-2d0a-4ee2-88a8-be634688e2a6, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=d7c0b793-2d0a-4ee2-88a8-be634688e2a6,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:57:33.793309 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6e9c3600-31fa-4d74-9d9a-b6d124f01185 req-b4e5d6c5-c28e-4c45-8993-bd92ab6b3ee8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:33.805725 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-6e9c3600-31fa-4d74-9d9a-b6d124f01185 req-b4e5d6c5-c28e-4c45-8993-bd92ab6b3ee8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Calling delete_port for d7c0b793-2d0a-4ee2-88a8-be634688e2a6 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:57:33.948653 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6e9c3600-31fa-4d74-9d9a-b6d124f01185 req-b4e5d6c5-c28e-4c45-8993-bd92ab6b3ee8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:33.961147 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['d7c0b793-2d0a-4ee2-88a8-be634688e2a6'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:57:33.964963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['c491c718-3982-4712-bb47-2fcfd2377987'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:57:33.981219 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4e5d6c5-c28e-4c45-8993-bd92ab6b3ee8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event deleted for resources: {'Port': ['ID=d7c0b793-2d0a-4ee2-88a8-be634688e2a6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:57:34.023755 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-6e9c3600-31fa-4d74-9d9a-b6d124f01185 req-b4e5d6c5-c28e-4c45-8993-bd92ab6b3ee8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] No DVR routers for this DVR port d7c0b793-2d0a-4ee2-88a8-be634688e2a6 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:57:34.027053 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6e9c3600-31fa-4d74-9d9a-b6d124f01185 req-b4e5d6c5-c28e-4c45-8993-bd92ab6b3ee8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:34.030645 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6e9c3600-31fa-4d74-9d9a-b6d124f01185 req-b4e5d6c5-c28e-4c45-8993-bd92ab6b3ee8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.31 "DELETE /v2.0/ports/d7c0b793-2d0a-4ee2-88a8-be634688e2a6 HTTP/1.1" status: 204 len: 173 time: 0.4193056 Dec 09 21:57:34.031172 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba', 'name': 'network-vif-deleted', 'tag': 'd7c0b793-2d0a-4ee2-88a8-be634688e2a6'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:57:34.033551 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-63cc7231-3c5f-4266-bbd4-1d460836d9d0" -d '{"events": [{"server_uuid": "fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba", "name": "network-vif-deleted", "tag": "d7c0b793-2d0a-4ee2-88a8-be634688e2a6"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:57:34.081319 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:57:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-92a67515-c454-4925-85ae-10033f069502 x-openstack-request-id: req-92a67515-c454-4925-85ae-10033f069502 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:57:34.081490 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba", "name": "network-vif-deleted", "tag": "d7c0b793-2d0a-4ee2-88a8-be634688e2a6", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:57:34.081707 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-92a67515-c454-4925-85ae-10033f069502 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:57:34.082406 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba', 'name': 'network-vif-deleted', 'tag': 'd7c0b793-2d0a-4ee2-88a8-be634688e2a6', 'status': 'completed', 'code': 200} Dec 09 21:57:34.552704 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2b0148f0-d125-4386-a1b6-db52ee0ae73d req-4b8ab791-8218-412a-88ed-c2373ca0dd4c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 210 time: 0.0264206 Dec 09 21:57:35.585222 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e47a434a-6a5b-493f-9117-0faf07605dc8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:35.659308 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0fa84246-e351-4e1b-ac50-c8ca3a38487d req-bd16cc68-c8e2-4bfa-8e40-9cf35220193b tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 210 time: 0.0318739 Dec 09 21:57:36.712510 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:36.762748 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66ef02aa-59b6-4fea-8f3a-e5ea338046b0 req-e26f3297-7b7e-45ed-a334-1038784aeb94 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 210 time: 0.0276892 Dec 09 21:57:36.853326 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ba5955d-1789-4791-bb80-24e8c1a136de req-904adbe3-71db-4972-b8d4-96560bc7adfd service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0470805 Dec 09 21:57:36.941081 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ba5955d-1789-4791-bb80-24e8c1a136de req-f20ba9c3-cbc4-497d-944d-66b78d1adeca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:36.943203 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ba5955d-1789-4791-bb80-24e8c1a136de req-f20ba9c3-cbc4-497d-944d-66b78d1adeca service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 1098 time: 0.0442085 Dec 09 21:57:37.069837 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ba5955d-1789-4791-bb80-24e8c1a136de req-6be59920-69aa-40de-8f26-ec451680bd42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:37.071347 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ba5955d-1789-4791-bb80-24e8c1a136de req-6be59920-69aa-40de-8f26-ec451680bd42 service neutron] 10.222.0.10 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 911 time: 0.1081653 Dec 09 21:57:37.084812 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device d7c0b793-2d0a-4ee2-88a8-be634688e2a6 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:57:37.106333 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: d7c0b793-2d0a-4ee2-88a8-be634688e2a6 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:57:37.106564 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device d7c0b793-2d0a-4ee2-88a8-be634688e2a6 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:57:37.118938 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ba5955d-1789-4791-bb80-24e8c1a136de req-8a666859-92f6-45d1-8e19-26dd56669cf6 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=c491c718-3982-4712-bb47-2fcfd2377987 HTTP/1.1" status: 200 len: 217 time: 0.0401485 Dec 09 21:57:37.169932 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ba5955d-1789-4791-bb80-24e8c1a136de req-df33c4c5-066a-4d77-af9d-e9781634d91b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:37.171816 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ba5955d-1789-4791-bb80-24e8c1a136de req-df33c4c5-066a-4d77-af9d-e9781634d91b service neutron] 10.222.0.10 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0460873 Dec 09 21:57:37.220982 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ba5955d-1789-4791-bb80-24e8c1a136de req-eff22969-14e5-4694-bfe0-23c63ffc8b41 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:37.222692 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ba5955d-1789-4791-bb80-24e8c1a136de req-eff22969-14e5-4694-bfe0-23c63ffc8b41 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0439901 Dec 09 21:57:37.317393 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ba5955d-1789-4791-bb80-24e8c1a136de req-645684a3-1ff3-40f1-9a04-308a0f218a5e service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0874538 Dec 09 21:57:37.791406 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ba5955d-1789-4791-bb80-24e8c1a136de req-234adf49-53fe-4a47-81e3-28dff0592c2a service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4639778 Dec 09 21:57:37.871992 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5240a59a-8867-48ef-94db-4a71dec0200f req-2f54833b-fd7d-4808-9b53-f89949a577ef tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=fb8b64bd-5586-4abf-bfd6-8fc25d63d8ba HTTP/1.1" status: 200 len: 210 time: 0.0255194 Dec 09 21:57:38.044470 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:39.666251 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:44.677069 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a54a0c2c-bcbc-40ef-942a-1dea71237fdd req-02cc530c-150e-4485-b5e1-6f9901f6eebc tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:44.678562 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a54a0c2c-bcbc-40ef-942a-1dea71237fdd req-02cc530c-150e-4485-b5e1-6f9901f6eebc tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 946 time: 0.2546344 Dec 09 21:57:44.730653 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a54a0c2c-bcbc-40ef-942a-1dea71237fdd req-c3fcc567-757b-42ea-8bcc-e4aa5597e135 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438943 Dec 09 21:57:45.895612 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a65bd1c-946a-42a1-984f-aa1af5ceb854 req-517eb75d-722c-43fe-8807-066237a62a57 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:45.897108 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a65bd1c-946a-42a1-984f-aa1af5ceb854 req-517eb75d-722c-43fe-8807-066237a62a57 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 946 time: 0.0788941 Dec 09 21:57:45.917464 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6ba3729-64fa-4f39-9bc6-6f3241b39319 req-bff29793-4070-428c-913f-e66791c0918f tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:45.918808 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6ba3729-64fa-4f39-9bc6-6f3241b39319 req-bff29793-4070-428c-913f-e66791c0918f tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.10 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 946 time: 0.0751646 Dec 09 21:57:45.984018 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a65bd1c-946a-42a1-984f-aa1af5ceb854 req-d84bc7c1-f1d6-4647-9213-078418fb16a0 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=04593cf6-df62-4851-bed9-8fc871e1c284&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0794163 Dec 09 21:57:46.030994 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-b6ba3729-64fa-4f39-9bc6-6f3241b39319 req-717343b7-9305-4cca-811f-20b1a980e32e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Deleting port c491c718-3982-4712-bb47-2fcfd2377987 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:57:46.031274 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b6ba3729-64fa-4f39-9bc6-6f3241b39319 req-717343b7-9305-4cca-811f-20b1a980e32e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:46.122858 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-b6ba3729-64fa-4f39-9bc6-6f3241b39319 req-717343b7-9305-4cca-811f-20b1a980e32e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] For port c491c718-3982-4712-bb47-2fcfd2377987, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=c491c718-3982-4712-bb47-2fcfd2377987,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:57:46.123171 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b6ba3729-64fa-4f39-9bc6-6f3241b39319 req-717343b7-9305-4cca-811f-20b1a980e32e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:46.135048 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-b6ba3729-64fa-4f39-9bc6-6f3241b39319 req-717343b7-9305-4cca-811f-20b1a980e32e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Calling delete_port for c491c718-3982-4712-bb47-2fcfd2377987 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:57:46.273451 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b6ba3729-64fa-4f39-9bc6-6f3241b39319 req-717343b7-9305-4cca-811f-20b1a980e32e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:46.285706 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['c491c718-3982-4712-bb47-2fcfd2377987'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:57:46.301630 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-717343b7-9305-4cca-811f-20b1a980e32e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event deleted for resources: {'Port': ['ID=c491c718-3982-4712-bb47-2fcfd2377987,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:57:46.314290 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-717343b7-9305-4cca-811f-20b1a980e32e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:46.314611 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-717343b7-9305-4cca-811f-20b1a980e32e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:46.314968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-717343b7-9305-4cca-811f-20b1a980e32e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:46.315298 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-717343b7-9305-4cca-811f-20b1a980e32e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:46.315646 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-717343b7-9305-4cca-811f-20b1a980e32e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:46.315971 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-717343b7-9305-4cca-811f-20b1a980e32e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:46.316289 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-717343b7-9305-4cca-811f-20b1a980e32e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:46.316612 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-717343b7-9305-4cca-811f-20b1a980e32e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:46.316932 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-717343b7-9305-4cca-811f-20b1a980e32e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:46.317247 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-717343b7-9305-4cca-811f-20b1a980e32e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:46.317559 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-717343b7-9305-4cca-811f-20b1a980e32e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:46.317869 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-717343b7-9305-4cca-811f-20b1a980e32e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:46.318185 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-717343b7-9305-4cca-811f-20b1a980e32e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:57:46.351636 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-b6ba3729-64fa-4f39-9bc6-6f3241b39319 req-717343b7-9305-4cca-811f-20b1a980e32e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] No DVR routers for this DVR port c491c718-3982-4712-bb47-2fcfd2377987 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:57:46.354300 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b6ba3729-64fa-4f39-9bc6-6f3241b39319 req-717343b7-9305-4cca-811f-20b1a980e32e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:46.357634 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6ba3729-64fa-4f39-9bc6-6f3241b39319 req-717343b7-9305-4cca-811f-20b1a980e32e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.10 "DELETE /v2.0/ports/c491c718-3982-4712-bb47-2fcfd2377987 HTTP/1.1" status: 204 len: 173 time: 0.4317188 Dec 09 21:57:46.358064 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0dee750b-74e3-4839-959c-726f883dd1d5', 'name': 'network-vif-deleted', 'tag': 'c491c718-3982-4712-bb47-2fcfd2377987'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:57:46.360387 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bee28d8e-9aef-409d-a528-a7485a63f830" -d '{"events": [{"server_uuid": "0dee750b-74e3-4839-959c-726f883dd1d5", "name": "network-vif-deleted", "tag": "c491c718-3982-4712-bb47-2fcfd2377987"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:57:46.404611 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:57:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-686aa8d0-e09e-4b23-8ab5-73a854c623aa x-openstack-request-id: req-686aa8d0-e09e-4b23-8ab5-73a854c623aa {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:57:46.404910 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0dee750b-74e3-4839-959c-726f883dd1d5", "name": "network-vif-deleted", "tag": "c491c718-3982-4712-bb47-2fcfd2377987", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:57:46.405165 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-686aa8d0-e09e-4b23-8ab5-73a854c623aa {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:57:46.405596 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0dee750b-74e3-4839-959c-726f883dd1d5', 'name': 'network-vif-deleted', 'tag': 'c491c718-3982-4712-bb47-2fcfd2377987', 'status': 'completed', 'code': 200} Dec 09 21:57:47.084210 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8166eb7e-c14b-41dc-a718-756fe0faaa6b req-e2287875-d247-4587-9ecc-be76322f355b tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 210 time: 0.0268309 Dec 09 21:57:48.184219 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ae8cbc5-1271-4e16-86ce-dc45d9b6a4d2 req-1c0e8a59-d951-4bdd-a808-6af3887458b1 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 210 time: 0.0268121 Dec 09 21:57:48.226562 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bff45d8b-f88a-4ab1-9544-5d5677dc432d req-5abb4b75-5982-4887-a2d8-a555cdc855fa service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0412712 Dec 09 21:57:48.312402 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bff45d8b-f88a-4ab1-9544-5d5677dc432d req-6c3cc1b6-139c-4f6d-bb14-f8a4f4558463 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:48.314008 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bff45d8b-f88a-4ab1-9544-5d5677dc432d req-6c3cc1b6-139c-4f6d-bb14-f8a4f4558463 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=a1dd4ab6f25741058f3000ebf6ce1eac&device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 1098 time: 0.0422835 Dec 09 21:57:48.422341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bff45d8b-f88a-4ab1-9544-5d5677dc432d req-690ee767-d312-4367-aea4-7fef5fd7f7d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:48.423907 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bff45d8b-f88a-4ab1-9544-5d5677dc432d req-690ee767-d312-4367-aea4-7fef5fd7f7d8 service neutron] 10.222.0.31 "GET /v2.0/networks?id=9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 HTTP/1.1" status: 200 len: 909 time: 0.0904541 Dec 09 21:57:48.492250 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bff45d8b-f88a-4ab1-9544-5d5677dc432d req-57b7927f-d102-44ca-bb23-dc1876e61249 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=48ed4870-53b4-441d-92a8-1562825c8ca3 HTTP/1.1" status: 200 len: 1002 time: 0.0615604 Dec 09 21:57:48.540520 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bff45d8b-f88a-4ab1-9544-5d5677dc432d req-a38a4796-c753-4607-b37a-72595367f994 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:48.541974 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bff45d8b-f88a-4ab1-9544-5d5677dc432d req-a38a4796-c753-4607-b37a-72595367f994 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=912d0a1a-1b1a-4383-8291-491e8e3358fe HTTP/1.1" status: 200 len: 847 time: 0.0431781 Dec 09 21:57:48.587262 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bff45d8b-f88a-4ab1-9544-5d5677dc432d req-5c8841cd-3c33-4362-bf09-2889380a06ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:57:48.588921 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bff45d8b-f88a-4ab1-9544-5d5677dc432d req-5c8841cd-3c33-4362-bf09-2889380a06ff service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0401251 Dec 09 21:57:48.680813 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bff45d8b-f88a-4ab1-9544-5d5677dc432d req-0ecf4b07-c5d8-413a-9b96-766df2d5be03 service neutron] 10.222.0.31 "GET /v2.0/networks/9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0848119 Dec 09 21:57:48.774330 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bff45d8b-f88a-4ab1-9544-5d5677dc432d req-683ecb5f-d314-4abf-b9b9-5e7bfd49ba14 service neutron] 10.222.0.31 "GET /v2.0/networks/9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0869055 Dec 09 21:57:49.287048 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7eb41a08-28f4-496d-914b-8e90482ec872 req-568966aa-e86f-4e90-b4e6-31190698cca7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 210 time: 0.0288968 Dec 09 21:57:49.381780 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device c491c718-3982-4712-bb47-2fcfd2377987 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:57:49.402343 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: c491c718-3982-4712-bb47-2fcfd2377987 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:57:49.402713 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device c491c718-3982-4712-bb47-2fcfd2377987 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:57:50.384628 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ff8aec2-434f-4ca0-81c5-d145a2585f9a req-0310849b-1df4-4ca2-b5ee-425b30b8d52e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=0dee750b-74e3-4839-959c-726f883dd1d5 HTTP/1.1" status: 200 len: 210 time: 0.0271997 Dec 09 21:57:54.334458 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56130) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:57:54.340549 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-e03af501-1749-4c41-a6a3-ad0752411cc6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1956229723', 'description': 'tempest-secgroup-smoke-1956229723 description', 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:57:54.368502 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e03af501-1749-4c41-a6a3-ad0752411cc6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:54.443542 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e03af501-1749-4c41-a6a3-ad0752411cc6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:54.448383 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e03af501-1749-4c41-a6a3-ad0752411cc6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:54.472593 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e03af501-1749-4c41-a6a3-ad0752411cc6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:54.473853 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e03af501-1749-4c41-a6a3-ad0752411cc6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1383777 Dec 09 21:57:54.477133 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56132) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:57:54.481951 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-1d48a7e4-aebc-4ced-b635-7f45570b71ec tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Request body: {'security_group_rule': {'security_group_id': 'aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f', 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:57:54.483547 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e03af501-1749-4c41-a6a3-ad0752411cc6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event updated for resources: {'SecurityGroup': ['ID=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:57:54.514090 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1d48a7e4-aebc-4ced-b635-7f45570b71ec tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:54.569587 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1d48a7e4-aebc-4ced-b635-7f45570b71ec tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:54.573801 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1d48a7e4-aebc-4ced-b635-7f45570b71ec tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:54.592274 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d48a7e4-aebc-4ced-b635-7f45570b71ec tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3c6cdb64-a4e7-410a-8e30-7e67016c90dd,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:57:54.600562 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1d48a7e4-aebc-4ced-b635-7f45570b71ec tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:54.604158 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1d48a7e4-aebc-4ced-b635-7f45570b71ec tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1255293 Dec 09 21:57:54.605374 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56134) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:57:54.610035 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-218334c4-f0ef-42b8-923d-41a12636746f tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Request body: {'security_group_rule': {'security_group_id': 'aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f', 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:57:54.637747 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-218334c4-f0ef-42b8-923d-41a12636746f tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:54.699985 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-218334c4-f0ef-42b8-923d-41a12636746f tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:54.704910 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-218334c4-f0ef-42b8-923d-41a12636746f tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:54.722856 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-218334c4-f0ef-42b8-923d-41a12636746f tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=274b4ee1-2df3-4a7c-abb7-619e61a2da4d,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:57:54.730854 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-218334c4-f0ef-42b8-923d-41a12636746f tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:54.732114 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-218334c4-f0ef-42b8-923d-41a12636746f tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1256669 Dec 09 21:57:54.735009 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56136) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:57:54.739329 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-288aa21b-28f4-4bbe-bf54-1ae8c01e57c3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Request body: {'security_group_rule': {'security_group_id': 'aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f', 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:57:54.767500 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-288aa21b-28f4-4bbe-bf54-1ae8c01e57c3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:54.833667 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-288aa21b-28f4-4bbe-bf54-1ae8c01e57c3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:54.840609 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-288aa21b-28f4-4bbe-bf54-1ae8c01e57c3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:54.862325 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-288aa21b-28f4-4bbe-bf54-1ae8c01e57c3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=33f398ef-91fa-4864-9cc0-d7a22f067da0,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:57:54.871566 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-288aa21b-28f4-4bbe-bf54-1ae8c01e57c3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:54.872787 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-288aa21b-28f4-4bbe-bf54-1ae8c01e57c3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1368117 Dec 09 21:57:54.875583 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56138) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:57:54.879932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b277cce8-1357-428c-a004-0ee5730ba835 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Request body: {'security_group_rule': {'security_group_id': 'aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f', 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:57:54.906255 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b277cce8-1357-428c-a004-0ee5730ba835 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:54.963867 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b277cce8-1357-428c-a004-0ee5730ba835 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:54.967944 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b277cce8-1357-428c-a004-0ee5730ba835 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:54.987725 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b277cce8-1357-428c-a004-0ee5730ba835 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=af6fe874-b962-4141-a82b-0a899af82c5f,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:57:54.993256 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b277cce8-1357-428c-a004-0ee5730ba835 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:54.994267 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b277cce8-1357-428c-a004-0ee5730ba835 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1177306 Dec 09 21:57:54.997419 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56140) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:57:55.001766 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-d7da508c-2f37-4c09-a1b2-cfc10dab6a5e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Request body: {'security_group_rule': {'security_group_id': 'aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f', 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:57:55.025176 n-d-713301-27 neutron-server[103437]: INFO neutron.db.securitygroups_db [None req-d7da508c-2f37-4c09-a1b2-cfc10dab6a5e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Project be526cfddc4f4783b993a3f6e5b5e630 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 21:57:55.030947 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d7da508c-2f37-4c09-a1b2-cfc10dab6a5e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:55.097593 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d7da508c-2f37-4c09-a1b2-cfc10dab6a5e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:55.102122 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d7da508c-2f37-4c09-a1b2-cfc10dab6a5e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:55.121766 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7da508c-2f37-4c09-a1b2-cfc10dab6a5e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5fdd1eed-5df2-4e2d-b33b-ee475f0574da,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:57:55.127709 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d7da508c-2f37-4c09-a1b2-cfc10dab6a5e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:55.128929 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d7da508c-2f37-4c09-a1b2-cfc10dab6a5e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1305401 Dec 09 21:57:55.131639 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56142) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:57:55.136175 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-5c346713-6fb3-4106-82bd-42a71030a2a6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Request body: {'security_group_rule': {'security_group_id': 'aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f', 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:57:55.158860 n-d-713301-27 neutron-server[103437]: INFO neutron.db.securitygroups_db [None req-5c346713-6fb3-4106-82bd-42a71030a2a6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Project be526cfddc4f4783b993a3f6e5b5e630 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 21:57:55.163639 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c346713-6fb3-4106-82bd-42a71030a2a6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:55.233824 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c346713-6fb3-4106-82bd-42a71030a2a6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:55.238554 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c346713-6fb3-4106-82bd-42a71030a2a6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:55.259210 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c346713-6fb3-4106-82bd-42a71030a2a6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=222831a8-ba32-4f7e-8778-1bc3ef9bbd80,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:57:55.265101 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5c346713-6fb3-4106-82bd-42a71030a2a6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:55.266254 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5c346713-6fb3-4106-82bd-42a71030a2a6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1337044 Dec 09 21:57:56.198594 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:57:57.417583 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:57:57.615746 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:02.970007 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-15e9ee4e-33f3-4d46-b820-a055fbe3b044 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:05.589789 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-17521b2d-6974-47d8-9b3b-1762abccf8ce None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:06.714754 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:08.048019 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:09.667243 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:11.651476 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-76f377e4-4aac-4129-adc5-922582b24052 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1956229723&fields=id&tenant_id=be526cfddc4f4783b993a3f6e5b5e630 HTTP/1.1" status: 200 len: 267 time: 0.0467820 Dec 09 21:58:11.763339 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-a70be086-2681-4e03-a027-e9d55445f23d tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:11.764726 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-a70be086-2681-4e03-a027-e9d55445f23d tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 810 time: 0.1036718 Dec 09 21:58:11.782412 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-f4e54772-f014-4e50-b4f9-6cb50477f775 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/quotas/be526cfddc4f4783b993a3f6e5b5e630 HTTP/1.1" status: 200 len: 375 time: 0.0091872 Dec 09 21:58:11.836096 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-5a62b0ef-431b-4ec0-843c-c2e4f7541a1e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0457702 Dec 09 21:58:11.944104 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-a67a5bba-10cf-41f3-9fc9-a78258409bc4 service neutron] 10.222.0.13 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0953257 Dec 09 21:58:12.034214 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-439bcbab-f21f-4ee5-997a-fc8f9fa6761f service neutron] 10.222.0.13 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0836391 Dec 09 21:58:12.339033 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f82d2974-d8b1-4bd2-a28e-18637b4a7e8d req-ac7deb10-41fa-4873-9a8d-e70d194ae5a2 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 210 time: 0.0312035 Dec 09 21:58:13.283331 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-c6cc45b7-e523-4654-a8c9-53a5f73e3a03 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:13.284828 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-c6cc45b7-e523-4654-a8c9-53a5f73e3a03 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.10 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 810 time: 0.1067564 Dec 09 21:58:13.358068 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-1f45de4d-cf62-41e5-8558-28f0cd755031 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.10 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=be526cfddc4f4783b993a3f6e5b5e630 HTTP/1.1" status: 200 len: 380 time: 0.0639613 Dec 09 21:58:13.368103 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-1073c59b-34df-481a-8a0c-32bd7a3df385 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Request body: {'port': {'device_id': 'f458582b-068a-42d3-9612-896ab989567c', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'admin_state_up': True, 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'security_groups': ['aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:58:13.469099 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c6e07afd-bfaa-4903-8823-a862750c7971 req-67db075f-7057-46fb-ad5d-12abdda2d7de tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 210 time: 0.0329447 Dec 09 21:58:13.511743 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-1073c59b-34df-481a-8a0c-32bd7a3df385 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Made reservation on behalf of be526cfddc4f4783b993a3f6e5b5e630 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:58:13.515251 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-1073c59b-34df-481a-8a0c-32bd7a3df385 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:13.647338 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-1073c59b-34df-481a-8a0c-32bd7a3df385 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Allocated IP 172.20.0.3 (486ad174-ad0c-4065-a4b6-6f9af6b2a208/7004626f-deda-4ef1-8abe-97a447b2d2e9/1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:58:13.786974 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-1073c59b-34df-481a-8a0c-32bd7a3df385 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:13.830460 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-1073c59b-34df-481a-8a0c-32bd7a3df385 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:13.875525 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-1073c59b-34df-481a-8a0c-32bd7a3df385 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:58:13.880640 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-1073c59b-34df-481a-8a0c-32bd7a3df385 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:58:13.885129 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-1073c59b-34df-481a-8a0c-32bd7a3df385 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:58:13.889721 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1073c59b-34df-481a-8a0c-32bd7a3df385 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event updated for resources: {'Port': ['ID=1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:13.950739 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-1073c59b-34df-481a-8a0c-32bd7a3df385 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:13.951607 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-1073c59b-34df-481a-8a0c-32bd7a3df385 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:13.970891 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-1073c59b-34df-481a-8a0c-32bd7a3df385 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6066043 Dec 09 21:58:13.983658 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-418d5b6f-1d70-4838-940b-1ae2d90731e5 service neutron] Request body: {'port': {'device_id': 'f458582b-068a-42d3-9612-896ab989567c', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:58:14.048887 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-418d5b6f-1d70-4838-940b-1ae2d90731e5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:14.116900 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-0e7bbee9-dddc-4238-9796-e57bfa9dcc29 None None] Provisioning complete for port 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:58:14.118025 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0e7bbee9-dddc-4238-9796-e57bfa9dcc29 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:14.156177 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-0e7bbee9-dddc-4238-9796-e57bfa9dcc29 None None] Port 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:58:14.316464 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-418d5b6f-1d70-4838-940b-1ae2d90731e5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:58:14.324135 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-418d5b6f-1d70-4838-940b-1ae2d90731e5 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:14.336302 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-418d5b6f-1d70-4838-940b-1ae2d90731e5 service neutron] Transition to ACTIVE for port object 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 21:58:14.341373 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-418d5b6f-1d70-4838-940b-1ae2d90731e5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:14.390877 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-418d5b6f-1d70-4838-940b-1ae2d90731e5 service neutron] Pushing event updated for resources: {'Port': ['ID=1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:14.467747 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-418d5b6f-1d70-4838-940b-1ae2d90731e5 service neutron] Attempting to bind port 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:58:14.468064 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-418d5b6f-1d70-4838-940b-1ae2d90731e5 service neutron] Attempting to bind port 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:58:14.468413 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-418d5b6f-1d70-4838-940b-1ae2d90731e5 service neutron] Attempting to bind port 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 on network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:58:14.473124 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-418d5b6f-1d70-4838-940b-1ae2d90731e5 service neutron] Port 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 on network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 21:58:14.473575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-418d5b6f-1d70-4838-940b-1ae2d90731e5 service neutron] Attempting to bind port 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 on network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:58:14.478726 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-418d5b6f-1d70-4838-940b-1ae2d90731e5 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 57, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:58:14.479238 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-418d5b6f-1d70-4838-940b-1ae2d90731e5 service neutron] Checking segment: {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:58:14.479550 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-418d5b6f-1d70-4838-940b-1ae2d90731e5 service neutron] Bound using segment: {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:58:14.479990 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-418d5b6f-1d70-4838-940b-1ae2d90731e5 service neutron] Bound port: 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:58:14.480478 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-418d5b6f-1d70-4838-940b-1ae2d90731e5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:14.584304 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-418d5b6f-1d70-4838-940b-1ae2d90731e5 service neutron] For port 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:58:14.601045 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-418d5b6f-1d70-4838-940b-1ae2d90731e5 service neutron] For port 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:58:14.606977 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-418d5b6f-1d70-4838-940b-1ae2d90731e5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:14.650054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2635d1fa-2e58-426b-b60e-4c5525b6d16b req-d2ccb327-4039-4d2c-a828-f9c503fbbdd9 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:14.651856 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2635d1fa-2e58-426b-b60e-4c5525b6d16b req-d2ccb327-4039-4d2c-a828-f9c503fbbdd9 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 943 time: 0.0990558 Dec 09 21:58:14.661062 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-418d5b6f-1d70-4838-940b-1ae2d90731e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:14.661541 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-418d5b6f-1d70-4838-940b-1ae2d90731e5 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:14.662991 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-418d5b6f-1d70-4838-940b-1ae2d90731e5 service neutron] 10.222.0.10 "PUT /v2.0/ports/1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 HTTP/1.1" status: 200 len: 1092 time: 0.6839347 Dec 09 21:58:14.663463 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f458582b-068a-42d3-9612-896ab989567c', 'tag': '1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:58:14.665812 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-00595b6a-c874-4527-a642-b8df27e1d2f2" -d '{"events": [{"name": "network-changed", "server_uuid": "f458582b-068a-42d3-9612-896ab989567c", "tag": "1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:58:14.766263 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-418d5b6f-1d70-4838-940b-1ae2d90731e5 service neutron] Pushing event updated for resources: {'Port': ['ID=1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:14.797992 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2635d1fa-2e58-426b-b60e-4c5525b6d16b req-5a5ca3a8-2081-4f34-a74b-0533050d1f57 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1128545 Dec 09 21:58:14.815201 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-f97985d0-20b7-4dad-b842-f5885526866e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:14.815201 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-f97985d0-20b7-4dad-b842-f5885526866e service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 1095 time: 0.0948997 Dec 09 21:58:14.861358 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-596ff1b8-1731-4ed7-a529-6dfc43d83db7 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 HTTP/1.1" status: 200 len: 217 time: 0.0461087 Dec 09 21:58:14.863060 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:58:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1c0a8920-e260-4569-a36e-c17e87462751 x-openstack-request-id: req-1c0a8920-e260-4569-a36e-c17e87462751 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:58:14.863356 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f458582b-068a-42d3-9612-896ab989567c", "tag": "1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:58:14.863637 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-1c0a8920-e260-4569-a36e-c17e87462751 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:58:14.864055 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f458582b-068a-42d3-9612-896ab989567c', 'tag': '1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5', 'status': 'completed', 'code': 200} Dec 09 21:58:14.923294 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-f87686c0-f3b4-492c-84e1-246c59e6d661 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:14.926266 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-f87686c0-f3b4-492c-84e1-246c59e6d661 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0573006 Dec 09 21:58:14.980481 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-1a8e2c70-0b04-4991-82a7-9658ffe60dd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:14.981972 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-1a8e2c70-0b04-4991-82a7-9658ffe60dd7 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0485654 Dec 09 21:58:15.080616 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-765cc397-7670-4ee3-bda9-d3e18fc58065 service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0909314 Dec 09 21:58:15.169865 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2efacfd8-16b8-40ed-bd83-38f7df27a0f4 req-27b4a7b7-7813-4ba6-9a59-660cb0e6dab7 service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0825264 Dec 09 21:58:15.257647 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00595b6a-c874-4527-a642-b8df27e1d2f2 req-77d28288-cdd6-4c37-900b-6e9ad77dd246 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:15.259202 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-00595b6a-c874-4527-a642-b8df27e1d2f2 req-77d28288-cdd6-4c37-900b-6e9ad77dd246 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 1095 time: 0.0424972 Dec 09 21:58:15.360069 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00595b6a-c874-4527-a642-b8df27e1d2f2 req-4151ef15-31cb-48b8-a947-d6e3855c5c73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:15.361531 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-00595b6a-c874-4527-a642-b8df27e1d2f2 req-4151ef15-31cb-48b8-a947-d6e3855c5c73 service neutron] 10.222.0.10 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 911 time: 0.0951858 Dec 09 21:58:15.404282 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-00595b6a-c874-4527-a642-b8df27e1d2f2 req-91a2542f-b8fb-4136-a979-0cf87c8bdf13 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 HTTP/1.1" status: 200 len: 217 time: 0.0357628 Dec 09 21:58:15.458930 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00595b6a-c874-4527-a642-b8df27e1d2f2 req-49f364c4-f537-4aa4-ad68-bfa4d660dcce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:15.460471 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-00595b6a-c874-4527-a642-b8df27e1d2f2 req-49f364c4-f537-4aa4-ad68-bfa4d660dcce service neutron] 10.222.0.10 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0493574 Dec 09 21:58:15.510239 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00595b6a-c874-4527-a642-b8df27e1d2f2 req-1baa2ce5-f989-41b9-9e69-d63b74d83712 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:15.511929 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-00595b6a-c874-4527-a642-b8df27e1d2f2 req-1baa2ce5-f989-41b9-9e69-d63b74d83712 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0436008 Dec 09 21:58:15.607998 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-00595b6a-c874-4527-a642-b8df27e1d2f2 req-4b601197-3df1-4a93-95de-4a9d13335c7f service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0883565 Dec 09 21:58:15.710639 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-00595b6a-c874-4527-a642-b8df27e1d2f2 req-c9f74fde-3fe6-4f81-8a41-4f9d55bc3785 service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0950096 Dec 09 21:58:15.917259 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-003f9ee6-b526-4f50-9e3a-cbb2ad686036 req-956429c5-7793-480b-9f52-4e7bf31c1d0e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:15.918662 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-003f9ee6-b526-4f50-9e3a-cbb2ad686036 req-956429c5-7793-480b-9f52-4e7bf31c1d0e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 943 time: 0.0513809 Dec 09 21:58:15.971188 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-003f9ee6-b526-4f50-9e3a-cbb2ad686036 req-ed21b2a8-baa7-42a9-97b3-b46c7d74b67f tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461571 Dec 09 21:58:17.097983 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9635c5f6-a333-43d9-ac1a-b278e391b38b req-8b378ea8-18fe-4e7b-aea5-822e99754551 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:17.099401 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9635c5f6-a333-43d9-ac1a-b278e391b38b req-8b378ea8-18fe-4e7b-aea5-822e99754551 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 943 time: 0.0556548 Dec 09 21:58:17.150266 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9635c5f6-a333-43d9-ac1a-b278e391b38b req-da39b150-4192-4158-b2d1-44715c6393e6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444994 Dec 09 21:58:18.274292 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6741753a-93d3-4c27-a5ef-d5550d33084d req-9c7dcef1-f4f7-4f55-95b5-8c2bac5b098a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:18.276104 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6741753a-93d3-4c27-a5ef-d5550d33084d req-9c7dcef1-f4f7-4f55-95b5-8c2bac5b098a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 943 time: 0.0524776 Dec 09 21:58:18.329199 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6741753a-93d3-4c27-a5ef-d5550d33084d req-c4d5beaf-9975-4516-8c84-8033218971ae tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465744 Dec 09 21:58:19.453951 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c2abb81-132a-4d1c-9447-29f536abb171 req-279cfc1c-60c2-4b85-8df9-dd836ad6647c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:19.455492 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c2abb81-132a-4d1c-9447-29f536abb171 req-279cfc1c-60c2-4b85-8df9-dd836ad6647c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 943 time: 0.0503860 Dec 09 21:58:19.515935 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c2abb81-132a-4d1c-9447-29f536abb171 req-9f1d1b90-a256-4abd-ab66-27390b2f3d8c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0541608 Dec 09 21:58:20.647335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15e0eb65-2080-47a7-81f9-5686c27e06d0 req-7acf0635-b0a1-49cd-9845-15fb5ef1e0ab tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:20.649021 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15e0eb65-2080-47a7-81f9-5686c27e06d0 req-7acf0635-b0a1-49cd-9845-15fb5ef1e0ab tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 943 time: 0.0563722 Dec 09 21:58:20.705133 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15e0eb65-2080-47a7-81f9-5686c27e06d0 req-055f1648-3541-4372-8fac-5d876ba5c5d9 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0495021 Dec 09 21:58:21.841711 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cacf6179-111f-44ec-a248-1c73744440dc req-bec7f9df-162f-4e59-8a3e-9941cf1d8eed tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:21.843191 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cacf6179-111f-44ec-a248-1c73744440dc req-bec7f9df-162f-4e59-8a3e-9941cf1d8eed tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 943 time: 0.0606112 Dec 09 21:58:21.894522 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cacf6179-111f-44ec-a248-1c73744440dc req-d77706ce-d2e3-489b-bb05-e7d88fd36f3b tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451295 Dec 09 21:58:23.038152 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-625f80ed-6ba9-4b50-8d08-c02efc11a5b2 req-a0c5b8a6-fbf6-464f-8573-e67c432dccb6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:23.039720 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-625f80ed-6ba9-4b50-8d08-c02efc11a5b2 req-a0c5b8a6-fbf6-464f-8573-e67c432dccb6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 943 time: 0.0631077 Dec 09 21:58:23.093149 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-625f80ed-6ba9-4b50-8d08-c02efc11a5b2 req-bfd43ac7-3395-4deb-a780-0459b2465396 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469947 Dec 09 21:58:24.231140 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-109ff9a4-67ed-4273-9f32-bfbb036d8193 req-146ff2fc-534e-4b57-860f-36073fd25411 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:24.232645 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-109ff9a4-67ed-4273-9f32-bfbb036d8193 req-146ff2fc-534e-4b57-860f-36073fd25411 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 943 time: 0.0518680 Dec 09 21:58:24.287526 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-109ff9a4-67ed-4273-9f32-bfbb036d8193 req-664c8786-6e4d-465a-80ce-bb7fd99455d7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456691 Dec 09 21:58:25.442754 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c54b1b46-ee28-4fa8-a5d7-4ff083f8d8ad req-d11a71fc-18e2-4a0b-9033-fc4af6d3de5e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:25.444333 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c54b1b46-ee28-4fa8-a5d7-4ff083f8d8ad req-d11a71fc-18e2-4a0b-9033-fc4af6d3de5e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 943 time: 0.0716650 Dec 09 21:58:25.498508 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c54b1b46-ee28-4fa8-a5d7-4ff083f8d8ad req-c375cefb-20f0-4f8f-8cec-4a57f3ac513b tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456448 Dec 09 21:58:26.624902 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a7c6e70-f569-4a9e-bb0c-3e92ef19e78e req-efe1142a-12f7-410a-bedb-b9173b6e31e3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:26.626397 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a7c6e70-f569-4a9e-bb0c-3e92ef19e78e req-efe1142a-12f7-410a-bedb-b9173b6e31e3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 943 time: 0.0499153 Dec 09 21:58:26.684676 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a7c6e70-f569-4a9e-bb0c-3e92ef19e78e req-dd600732-de32-4b94-b439-bc509f00baea tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0490398 Dec 09 21:58:27.421702 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:27.552385 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 21:58:27.645809 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:27.664131 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:58:27.675230 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'port_id': '1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5', 'mac_address': 'fa:16:3e:85:fb:97', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 21:58:27.717568 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:27.730883 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 21:58:27.750987 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:58:27.756089 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:27.803636 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f888fb75-8508-43ab-a657-614e6b331689 req-a25ed322-4dd5-478c-84d7-117d0325f73a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:27.805052 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f888fb75-8508-43ab-a657-614e6b331689 req-a25ed322-4dd5-478c-84d7-117d0325f73a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 944 time: 0.0504584 Dec 09 21:58:27.806205 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:27.814196 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:27.814534 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:27.814873 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:27.815205 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:27.815678 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:27.816009 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:27.816332 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:27.816675 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:27.816993 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:27.817314 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:27.817629 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:27.817945 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:27.818262 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:27.860284 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f888fb75-8508-43ab-a657-614e6b331689 req-277728fc-5b20-4b20-8ff1-bd4b131cb85f tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0487657 Dec 09 21:58:27.958799 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 21:58:28.991641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d55c9c2a-795f-4393-bb8d-d5f2f144acd1 req-e1409e55-a021-4b08-92a3-101fa09a9a5f tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:28.993141 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d55c9c2a-795f-4393-bb8d-d5f2f144acd1 req-e1409e55-a021-4b08-92a3-101fa09a9a5f tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 944 time: 0.0532985 Dec 09 21:58:29.046861 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d55c9c2a-795f-4393-bb8d-d5f2f144acd1 req-35577946-ff43-439e-a85e-eaf4fdb31277 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461731 Dec 09 21:58:29.573045 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:58:29.632172 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 21:58:29.636164 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:58:29.636539 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:29.720834 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:29.742715 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f458582b-068a-42d3-9612-896ab989567c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:58:29.745084 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5905ac7a-56ac-4994-ba5c-1ab7041e7c33" -d '{"events": [{"server_uuid": "f458582b-068a-42d3-9612-896ab989567c", "name": "network-vif-plugged", "status": "completed", "tag": "1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:58:29.758173 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:58:29.763724 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:29.788034 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:58:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6c709cfa-55bc-464a-a29f-adcc8a3cf081 x-openstack-request-id: req-6c709cfa-55bc-464a-a29f-adcc8a3cf081 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:58:29.788324 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f458582b-068a-42d3-9612-896ab989567c", "name": "network-vif-plugged", "status": "completed", "tag": "1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:58:29.788764 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-6c709cfa-55bc-464a-a29f-adcc8a3cf081 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:58:29.789058 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f458582b-068a-42d3-9612-896ab989567c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5', 'code': 200} Dec 09 21:58:29.820080 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:29.888190 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-167247de-31fd-4106-b4e4-47dafc54fdb7 req-44c2d799-cb11-4746-b24c-305ddbf452df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:29.889703 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-167247de-31fd-4106-b4e4-47dafc54fdb7 req-44c2d799-cb11-4746-b24c-305ddbf452df service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 1097 time: 0.0415511 Dec 09 21:58:29.939299 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-167247de-31fd-4106-b4e4-47dafc54fdb7 req-2a0e71a0-010a-4cbb-bfd9-8818dc3f3a8f service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412045 Dec 09 21:58:30.188278 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f5cfb1f-6b68-406b-9a6e-eada31f40558 req-5371c29b-6b6a-4ca9-a23c-9a3d2e9b6a1f tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:30.189763 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f5cfb1f-6b68-406b-9a6e-eada31f40558 req-5371c29b-6b6a-4ca9-a23c-9a3d2e9b6a1f tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 945 time: 0.0648680 Dec 09 21:58:30.244878 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f5cfb1f-6b68-406b-9a6e-eada31f40558 req-bce9948d-e7b7-4a58-b13f-2c1c6092dec5 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448642 Dec 09 21:58:31.384056 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29719674-9b66-4425-ac7c-2623011c1d18 req-372abcb2-a727-47a7-b3ca-e631e024cf81 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:31.385562 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-29719674-9b66-4425-ac7c-2623011c1d18 req-372abcb2-a727-47a7-b3ca-e631e024cf81 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 945 time: 0.0584002 Dec 09 21:58:31.435301 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-29719674-9b66-4425-ac7c-2623011c1d18 req-6237d0f3-3661-4183-a720-22cf6f6cfb30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429697 Dec 09 21:58:31.571829 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3efb3af-4f26-4912-9c55-e9e3aa031ddc req-637f92a0-a6d5-4872-b62e-284f6a82c879 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:31.573328 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3efb3af-4f26-4912-9c55-e9e3aa031ddc req-637f92a0-a6d5-4872-b62e-284f6a82c879 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 945 time: 0.0598888 Dec 09 21:58:31.628353 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3efb3af-4f26-4912-9c55-e9e3aa031ddc req-858c62e8-59b9-4b3d-9b56-38af01b88070 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482359 Dec 09 21:58:31.654527 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56334) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:58:31.694691 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df818854-a6a5-49ca-80af-40043d363d20 tempest-TestVolumeBootPattern-2003139207 tempest-TestVolumeBootPattern-2003139207-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:31.696301 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-df818854-a6a5-49ca-80af-40043d363d20 tempest-TestVolumeBootPattern-2003139207 tempest-TestVolumeBootPattern-2003139207-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 1092 time: 0.0407801 Dec 09 21:58:31.700557 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56336) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:58:31.704983 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': '1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'fixed_ip_address': '172.20.0.3'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:58:31.729077 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for floatingip, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:32.182272 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:32.289061 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Allocated IP 172.25.3.142 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/7f8b5e41-4308-4d85-ae3e-6d92aee9e9de) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:58:32.391395 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:32.430196 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:32.467951 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:58:32.470582 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:58:32.476018 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:58:32.481493 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event updated for resources: {'Port': ['ID=7f8b5e41-4308-4d85-ae3e-6d92aee9e9de,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:32.512835 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:32.513178 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:32.513738 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:32.514091 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:32.514395 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:32.514724 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:32.515052 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:32.515373 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:32.515719 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:32.516038 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:32.516356 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:32.516672 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:32.516990 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:32.858579 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:32.929825 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:32.968116 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca4d612a-bf55-4d75-bd33-8686d4979c03 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:33.083237 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:33.091239 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:33.156270 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event updated for resources: {'Port': ['ID=7f8b5e41-4308-4d85-ae3e-6d92aee9e9de,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:33.167963 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:33.197886 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:58:33.268700 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Floating IP fa4716d2-6124-4a9c-b9d7-e84a2afe830c associated. External IP: 172.25.3.142, port: 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5. Dec 09 21:58:33.479186 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:58:33.597569 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:58:33.608563 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a50d4b2f-5d73-4eed-ad50-b74c6cd0a40e None None] Sync routers for ids ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:58:33.617315 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:33.618751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a50d4b2f-5d73-4eed-ad50-b74c6cd0a40e None None] Routers {'52333c17-500b-4d13-8de7-f3d9c4c6eb46'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:58:33.619511 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a50d4b2f-5d73-4eed-ad50-b74c6cd0a40e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:58:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:33.645395 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3fdf31bc-d986-4686-aaa1-0c031ba361f4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.9436691 Dec 09 21:58:33.646006 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f458582b-068a-42d3-9612-896ab989567c', 'tag': '1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:58:33.648336 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-df252a91-68de-45b1-a091-ef5068cd98e6" -d '{"events": [{"name": "network-changed", "server_uuid": "f458582b-068a-42d3-9612-896ab989567c", "tag": "1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:58:33.693542 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 21:58:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5c07301d-182f-4645-9a69-04d7810bcb81 x-openstack-request-id: req-5c07301d-182f-4645-9a69-04d7810bcb81 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:58:33.693907 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f458582b-068a-42d3-9612-896ab989567c", "tag": "1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:58:33.694234 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-5c07301d-182f-4645-9a69-04d7810bcb81 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:58:33.694760 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f458582b-068a-42d3-9612-896ab989567c', 'tag': '1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5', 'status': 'completed', 'code': 200} Dec 09 21:58:33.731122 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-a50d4b2f-5d73-4eed-ad50-b74c6cd0a40e None None] Set router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:58:33.760740 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df252a91-68de-45b1-a091-ef5068cd98e6 req-77a6a10b-9efd-4fd5-a9c3-3118ced901f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:33.762255 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df252a91-68de-45b1-a091-ef5068cd98e6 req-77a6a10b-9efd-4fd5-a9c3-3118ced901f4 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 1097 time: 0.0447774 Dec 09 21:58:33.861763 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df252a91-68de-45b1-a091-ef5068cd98e6 req-a578cd8b-eba3-4980-8a8c-62beb9ba0917 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:33.863277 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df252a91-68de-45b1-a091-ef5068cd98e6 req-a578cd8b-eba3-4980-8a8c-62beb9ba0917 service neutron] 10.222.0.10 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 911 time: 0.0928404 Dec 09 21:58:33.938053 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df252a91-68de-45b1-a091-ef5068cd98e6 req-202be074-1742-488b-97dc-d771214be88e service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 HTTP/1.1" status: 200 len: 999 time: 0.0665784 Dec 09 21:58:33.990095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df252a91-68de-45b1-a091-ef5068cd98e6 req-65ba53ed-bbc5-458e-84a1-18a6d76c21d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:33.991528 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df252a91-68de-45b1-a091-ef5068cd98e6 req-65ba53ed-bbc5-458e-84a1-18a6d76c21d7 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0464547 Dec 09 21:58:34.039867 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df252a91-68de-45b1-a091-ef5068cd98e6 req-58c40115-d678-4bb0-8341-3d38626032df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:34.041432 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df252a91-68de-45b1-a091-ef5068cd98e6 req-58c40115-d678-4bb0-8341-3d38626032df service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0432348 Dec 09 21:58:34.142081 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df252a91-68de-45b1-a091-ef5068cd98e6 req-44548482-2210-41d5-931d-39afac70712c service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0925465 Dec 09 21:58:34.142601 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a50d4b2f-5d73-4eed-ad50-b74c6cd0a40e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'fa4716d2-6124-4a9c-b9d7-e84a2afe830c', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'floating_ip_address': '172.25.3.142', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'port_id': '1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 3992, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'mac_address': 'fa:16:3e:85:fb:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f458582b-068a-42d3-9612-896ab989567c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:58:32Z', 'updated_at': '2021-12-09T21:58:32Z', 'revision_number': 0, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'db7c12a5-60a7-41e6-ae5c-e42348c373b4', 'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'mac_address': 'fa:16:3e:79:8f:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_interface', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:36Z', 'updated_at': '2021-12-09T21:54:44Z', 'revision_number': 5, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'subnets': [{'id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:34.171163 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a50d4b2f-5d73-4eed-ad50-b74c6cd0a40e None None] Checking router: 52333c17-500b-4d13-8de7-f3d9c4c6eb46 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:58:34.179665 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a50d4b2f-5d73-4eed-ad50-b74c6cd0a40e None None] Routers {'52333c17-500b-4d13-8de7-f3d9c4c6eb46'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:58:34.180287 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a50d4b2f-5d73-4eed-ad50-b74c6cd0a40e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:58:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:34.240298 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df252a91-68de-45b1-a091-ef5068cd98e6 req-e7ef46a7-5621-471f-a1e0-391b79f56485 service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0904517 Dec 09 21:58:34.286971 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-a50d4b2f-5d73-4eed-ad50-b74c6cd0a40e None None] Set router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:58:34.537530 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a50d4b2f-5d73-4eed-ad50-b74c6cd0a40e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'fa4716d2-6124-4a9c-b9d7-e84a2afe830c', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'floating_ip_address': '172.25.3.142', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'port_id': '1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 3992, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'mac_address': 'fa:16:3e:85:fb:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f458582b-068a-42d3-9612-896ab989567c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:58:32Z', 'updated_at': '2021-12-09T21:58:32Z', 'revision_number': 0, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'db7c12a5-60a7-41e6-ae5c-e42348c373b4', 'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'mac_address': 'fa:16:3e:79:8f:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_interface', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:36Z', 'updated_at': '2021-12-09T21:54:44Z', 'revision_number': 5, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'subnets': [{'id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:34.564672 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a50d4b2f-5d73-4eed-ad50-b74c6cd0a40e None None] The sync data for ids ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'] in n-d-713301-27 is: [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'fa4716d2-6124-4a9c-b9d7-e84a2afe830c', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'floating_ip_address': '172.25.3.142', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'port_id': '1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 3992, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'mac_address': 'fa:16:3e:85:fb:97', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f458582b-068a-42d3-9612-896ab989567c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T21:58:32Z', 'updated_at': '2021-12-09T21:58:32Z', 'revision_number': 0, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'db7c12a5-60a7-41e6-ae5c-e42348c373b4', 'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'mac_address': 'fa:16:3e:79:8f:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_interface', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:36Z', 'updated_at': '2021-12-09T21:54:44Z', 'revision_number': 5, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'subnets': [{'id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:58:34.758562 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a95ff23c-7916-4e2e-b3e5-531357c0e8b6 None None] New status for floating IP fa4716d2-6124-4a9c-b9d7-e84a2afe830c: ACTIVE {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:58:35.606030 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5a71920e-2baa-4e27-9e58-722e0062a353 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:36.718597 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:37.846415 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe31b86d-4b09-432c-b9ab-665029bd78e2 req-3dd303f0-ca93-4c13-a4a4-f8c0fcbec19d service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0424595 Dec 09 21:58:37.943918 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe31b86d-4b09-432c-b9ab-665029bd78e2 req-5a0b297d-9025-4106-a5b5-b1121913fc5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:37.945446 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe31b86d-4b09-432c-b9ab-665029bd78e2 req-5a0b297d-9025-4106-a5b5-b1121913fc5e service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 1097 time: 0.0531228 Dec 09 21:58:38.051475 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:38.066262 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe31b86d-4b09-432c-b9ab-665029bd78e2 req-f6e601ec-c9bf-4651-9fbb-a2d79c0c5156 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:38.067814 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe31b86d-4b09-432c-b9ab-665029bd78e2 req-f6e601ec-c9bf-4651-9fbb-a2d79c0c5156 service neutron] 10.222.0.10 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 911 time: 0.0997629 Dec 09 21:58:38.134387 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe31b86d-4b09-432c-b9ab-665029bd78e2 req-fb12a261-857c-44f1-a6b8-e82b10cc08ef service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 HTTP/1.1" status: 200 len: 1001 time: 0.0592248 Dec 09 21:58:38.184123 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe31b86d-4b09-432c-b9ab-665029bd78e2 req-c19fd6c9-e6dd-4059-b130-7fcd17fca439 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:38.185727 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe31b86d-4b09-432c-b9ab-665029bd78e2 req-c19fd6c9-e6dd-4059-b130-7fcd17fca439 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0445206 Dec 09 21:58:38.237130 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe31b86d-4b09-432c-b9ab-665029bd78e2 req-40b20932-ff6f-44d7-807f-323ba2b18caf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:38.238677 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe31b86d-4b09-432c-b9ab-665029bd78e2 req-40b20932-ff6f-44d7-807f-323ba2b18caf service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0461700 Dec 09 21:58:38.331350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe31b86d-4b09-432c-b9ab-665029bd78e2 req-24c92606-b5c8-4929-85a6-357d6bac66fb service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0847635 Dec 09 21:58:38.422900 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe31b86d-4b09-432c-b9ab-665029bd78e2 req-5ac1c15d-cc70-40b7-b71a-d2a719f80894 service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0842381 Dec 09 21:58:39.667817 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:40.299705 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c057c48-3459-47d1-b94f-af45809428e1 req-cb412192-492a-4d66-8101-98e17ff255bc tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:40.301463 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c057c48-3459-47d1-b94f-af45809428e1 req-cb412192-492a-4d66-8101-98e17ff255bc tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/ports?device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 946 time: 0.0597408 Dec 09 21:58:40.353646 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c057c48-3459-47d1-b94f-af45809428e1 req-7c0349cd-bec4-4d4e-bc52-c9a8a5c43981 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/security-groups?id=e0446b46-bdd5-496a-bc4f-672214f90d12&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457003 Dec 09 21:58:41.479699 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21604fc6-7749-4bb3-ace8-4de496a2260e req-3f4ebb8e-4fcc-479f-9fe8-11f49d97fa4e tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:41.481150 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-21604fc6-7749-4bb3-ace8-4de496a2260e req-3f4ebb8e-4fcc-479f-9fe8-11f49d97fa4e tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/ports?device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 946 time: 0.0520751 Dec 09 21:58:41.519187 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9fc3d1a-ac84-4b34-8e23-7e4d5c38f992 req-05212fe2-d012-48be-a870-cdb95499cdee tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:41.520879 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b9fc3d1a-ac84-4b34-8e23-7e4d5c38f992 req-05212fe2-d012-48be-a870-cdb95499cdee tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.31 "GET /v2.0/ports?device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 946 time: 0.0538485 Dec 09 21:58:41.539475 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-21604fc6-7749-4bb3-ace8-4de496a2260e req-8e71c092-a22e-4d5e-9d0f-8725f09b11ec tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/security-groups?id=e0446b46-bdd5-496a-bc4f-672214f90d12&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0512333 Dec 09 21:58:41.625653 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-b9fc3d1a-ac84-4b34-8e23-7e4d5c38f992 req-76af0b55-e143-4e35-9a31-896a46afb646 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Deleting port 48ed4870-53b4-441d-92a8-1562825c8ca3 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:58:41.625955 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b9fc3d1a-ac84-4b34-8e23-7e4d5c38f992 req-76af0b55-e143-4e35-9a31-896a46afb646 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:41.722460 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-b9fc3d1a-ac84-4b34-8e23-7e4d5c38f992 req-76af0b55-e143-4e35-9a31-896a46afb646 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] For port 48ed4870-53b4-441d-92a8-1562825c8ca3, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=48ed4870-53b4-441d-92a8-1562825c8ca3,segment=NetworkSegment(bd059ed1-b661-4e68-8df0-ed7798fa0c5d),segment_id=bd059ed1-b661-4e68-8df0-ed7798fa0c5d)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:58:41.722833 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b9fc3d1a-ac84-4b34-8e23-7e4d5c38f992 req-76af0b55-e143-4e35-9a31-896a46afb646 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:41.971597 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b9fc3d1a-ac84-4b34-8e23-7e4d5c38f992 req-76af0b55-e143-4e35-9a31-896a46afb646 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:41.971919 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b9fc3d1a-ac84-4b34-8e23-7e4d5c38f992 req-76af0b55-e143-4e35-9a31-896a46afb646 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:41.972458 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [req-b9fc3d1a-ac84-4b34-8e23-7e4d5c38f992 req-76af0b55-e143-4e35-9a31-896a46afb646 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Floating IP d70d14fc-db5b-450b-881c-4d7fd32c036f disassociated. External IP: 172.25.3.223, port: 48ed4870-53b4-441d-92a8-1562825c8ca3. Dec 09 21:58:41.972872 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-b9fc3d1a-ac84-4b34-8e23-7e4d5c38f992 req-76af0b55-e143-4e35-9a31-896a46afb646 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Calling delete_port for 48ed4870-53b4-441d-92a8-1562825c8ca3 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:58:42.119169 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b9fc3d1a-ac84-4b34-8e23-7e4d5c38f992 req-76af0b55-e143-4e35-9a31-896a46afb646 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:42.150170 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76af0b55-e143-4e35-9a31-896a46afb646 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Pushing event deleted for resources: {'Port': ['ID=48ed4870-53b4-441d-92a8-1562825c8ca3,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:42.279881 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [req-b9fc3d1a-ac84-4b34-8e23-7e4d5c38f992 req-76af0b55-e143-4e35-9a31-896a46afb646 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Router d9cf6337-3bad-4310-b6ab-6a6e5ee3198c has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:58:42.391328 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-b9fc3d1a-ac84-4b34-8e23-7e4d5c38f992 req-76af0b55-e143-4e35-9a31-896a46afb646 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:58:42.403731 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-faeafd7f-85db-4421-85a4-eb15d96c8363 None None] Sync routers for ids ['d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:58:42.415364 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-faeafd7f-85db-4421-85a4-eb15d96c8363 None None] Routers {'d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:58:42.416529 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-faeafd7f-85db-4421-85a4-eb15d96c8363 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:58:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:42.430621 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-b9fc3d1a-ac84-4b34-8e23-7e4d5c38f992 req-76af0b55-e143-4e35-9a31-896a46afb646 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] No DVR routers for this DVR port 48ed4870-53b4-441d-92a8-1562825c8ca3 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:58:42.433471 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-b9fc3d1a-ac84-4b34-8e23-7e4d5c38f992 req-76af0b55-e143-4e35-9a31-896a46afb646 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:42.437001 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b9fc3d1a-ac84-4b34-8e23-7e4d5c38f992 req-76af0b55-e143-4e35-9a31-896a46afb646 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.31 "DELETE /v2.0/ports/48ed4870-53b4-441d-92a8-1562825c8ca3 HTTP/1.1" status: 204 len: 173 time: 0.9094582 Dec 09 21:58:42.437452 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4cf5eac2-f76a-49ca-aabf-537385b7e325', 'name': 'network-vif-deleted', 'tag': '48ed4870-53b4-441d-92a8-1562825c8ca3'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 21:58:42.439995 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2026df6b-7fac-4938-a285-17b728cd9778" -d '{"events": [{"server_uuid": "4cf5eac2-f76a-49ca-aabf-537385b7e325", "name": "network-vif-deleted", "tag": "48ed4870-53b4-441d-92a8-1562825c8ca3"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 21:58:42.478874 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 21:58:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cc7ba86f-437e-4b7f-996e-ece30c12ac9d x-openstack-request-id: req-cc7ba86f-437e-4b7f-996e-ece30c12ac9d {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 21:58:42.479165 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4cf5eac2-f76a-49ca-aabf-537385b7e325", "name": "network-vif-deleted", "tag": "48ed4870-53b4-441d-92a8-1562825c8ca3", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 21:58:42.479430 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-cc7ba86f-437e-4b7f-996e-ece30c12ac9d {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 21:58:42.479870 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4cf5eac2-f76a-49ca-aabf-537385b7e325', 'name': 'network-vif-deleted', 'tag': '48ed4870-53b4-441d-92a8-1562825c8ca3', 'status': 'completed', 'code': 200} Dec 09 21:58:42.535620 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-faeafd7f-85db-4421-85a4-eb15d96c8363 None None] Set router d9cf6337-3bad-4310-b6ab-6a6e5ee3198c gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:58:42.662862 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f669932-2446-4db1-abe9-0f2cacd4c4ba req-5816c4ec-bb73-4497-b3b1-0866b3ecbad9 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "GET /v2.0/ports?device_id=4cf5eac2-f76a-49ca-aabf-537385b7e325 HTTP/1.1" status: 200 len: 210 time: 0.0276852 Dec 09 21:58:42.745299 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-faeafd7f-85db-4421-85a4-eb15d96c8363 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'name': 'tempest-TestServerBasicOps-833518784-router', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129'}], 'enable_snat': True}, 'gw_port_id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:33Z', 'updated_at': '2021-12-09T21:53:36Z', 'revision_number': 4, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'gw_port': {'id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:c4:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3888, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:34Z', 'updated_at': '2021-12-09T21:53:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'efce1b9c-0122-448d-b190-5f99e09d575a', 'name': '', 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'mac_address': 'fa:16:3e:5a:e8:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'device_owner': 'network:router_interface', 'standard_attr_id': 3889, 'fixed_ips': [{'subnet_id': '912d0a1a-1b1a-4383-8291-491e8e3358fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:36Z', 'updated_at': '2021-12-09T21:53:42Z', 'revision_number': 5, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'subnets': [{'id': '912d0a1a-1b1a-4383-8291-491e8e3358fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:42.775323 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-faeafd7f-85db-4421-85a4-eb15d96c8363 None None] Checking router: d9cf6337-3bad-4310-b6ab-6a6e5ee3198c for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:58:42.784856 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-faeafd7f-85db-4421-85a4-eb15d96c8363 None None] Routers {'d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:58:42.785470 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-faeafd7f-85db-4421-85a4-eb15d96c8363 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:58:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:42.894350 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-faeafd7f-85db-4421-85a4-eb15d96c8363 None None] Set router d9cf6337-3bad-4310-b6ab-6a6e5ee3198c gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:58:43.095982 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-faeafd7f-85db-4421-85a4-eb15d96c8363 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'name': 'tempest-TestServerBasicOps-833518784-router', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129'}], 'enable_snat': True}, 'gw_port_id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:33Z', 'updated_at': '2021-12-09T21:53:36Z', 'revision_number': 4, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'gw_port': {'id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:c4:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3888, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:34Z', 'updated_at': '2021-12-09T21:53:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'efce1b9c-0122-448d-b190-5f99e09d575a', 'name': '', 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'mac_address': 'fa:16:3e:5a:e8:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'device_owner': 'network:router_interface', 'standard_attr_id': 3889, 'fixed_ips': [{'subnet_id': '912d0a1a-1b1a-4383-8291-491e8e3358fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:36Z', 'updated_at': '2021-12-09T21:53:42Z', 'revision_number': 5, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'subnets': [{'id': '912d0a1a-1b1a-4383-8291-491e8e3358fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:43.122641 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-faeafd7f-85db-4421-85a4-eb15d96c8363 None None] The sync data for ids ['d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'] in n-d-713301-27 is: [{'id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'name': 'tempest-TestServerBasicOps-833518784-router', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129'}], 'enable_snat': True}, 'gw_port_id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:33Z', 'updated_at': '2021-12-09T21:53:36Z', 'revision_number': 4, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'gw_port': {'id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:c4:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3888, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:34Z', 'updated_at': '2021-12-09T21:53:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'efce1b9c-0122-448d-b190-5f99e09d575a', 'name': '', 'network_id': '9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'mac_address': 'fa:16:3e:5a:e8:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'device_owner': 'network:router_interface', 'standard_attr_id': 3889, 'fixed_ips': [{'subnet_id': '912d0a1a-1b1a-4383-8291-491e8e3358fe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:36Z', 'updated_at': '2021-12-09T21:53:42Z', 'revision_number': 5, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'subnets': [{'id': '912d0a1a-1b1a-4383-8291-491e8e3358fe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:58:43.364257 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04b13816-f166-4341-a9a1-c51bad547a83 None None] New status for floating IP d70d14fc-db5b-450b-881c-4d7fd32c036f: DOWN {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 21:58:43.899123 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56358) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:58:44.024354 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-7b4de3a0-3163-41f9-a83d-22e375de6e71 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Deleting port 8cbaa3dc-5239-44ca-a1c0-9146b8fefd35 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:58:44.024635 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7b4de3a0-3163-41f9-a83d-22e375de6e71 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:44.101409 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7b4de3a0-3163-41f9-a83d-22e375de6e71 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:44.101690 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7b4de3a0-3163-41f9-a83d-22e375de6e71 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:44.114242 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-7b4de3a0-3163-41f9-a83d-22e375de6e71 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Calling delete_port for 8cbaa3dc-5239-44ca-a1c0-9146b8fefd35 owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:58:44.256319 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7b4de3a0-3163-41f9-a83d-22e375de6e71 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:44.280667 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b4de3a0-3163-41f9-a83d-22e375de6e71 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Pushing event deleted for resources: {'Port': ['ID=8cbaa3dc-5239-44ca-a1c0-9146b8fefd35,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:44.339919 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7b4de3a0-3163-41f9-a83d-22e375de6e71 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:44.342471 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7b4de3a0-3163-41f9-a83d-22e375de6e71 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:44.343680 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7b4de3a0-3163-41f9-a83d-22e375de6e71 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "DELETE /v2.0/floatingips/d70d14fc-db5b-450b-881c-4d7fd32c036f HTTP/1.1" status: 204 len: 168 time: 0.4434459 Dec 09 21:58:44.412375 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56364) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:58:44.472668 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cd06f934-7675-4b1c-803d-dccd8e2bf658 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:44.499107 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cd06f934-7675-4b1c-803d-dccd8e2bf658 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:44.573001 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cd06f934-7675-4b1c-803d-dccd8e2bf658 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:44.575650 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cd06f934-7675-4b1c-803d-dccd8e2bf658 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:44.576861 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cd06f934-7675-4b1c-803d-dccd8e2bf658 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] 10.222.0.13 "DELETE /v2.0/security-groups/e0446b46-bdd5-496a-bc4f-672214f90d12 HTTP/1.1" status: 204 len: 168 time: 0.1634676 Dec 09 21:58:44.587574 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd06f934-7675-4b1c-803d-dccd8e2bf658 tempest-TestServerBasicOps-2124645575 tempest-TestServerBasicOps-2124645575-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e0446b46-bdd5-496a-bc4f-672214f90d12,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:44.621224 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56368) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:58:45.134274 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a17c2e74-bd68-4ebe-9be8-422b422c8a20 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:45.381929 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-a17c2e74-bd68-4ebe-9be8-422b422c8a20 admin admin] Deleting port efce1b9c-0122-448d-b190-5f99e09d575a {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:58:45.382191 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a17c2e74-bd68-4ebe-9be8-422b422c8a20 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:45.425722 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 48ed4870-53b4-441d-92a8-1562825c8ca3 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:58:45.449743 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 48ed4870-53b4-441d-92a8-1562825c8ca3 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:58:45.450086 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 48ed4870-53b4-441d-92a8-1562825c8ca3 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:58:45.461492 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-a17c2e74-bd68-4ebe-9be8-422b422c8a20 admin admin] For port efce1b9c-0122-448d-b190-5f99e09d575a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=efce1b9c-0122-448d-b190-5f99e09d575a,segment=NetworkSegment(bd059ed1-b661-4e68-8df0-ed7798fa0c5d),segment_id=bd059ed1-b661-4e68-8df0-ed7798fa0c5d)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:58:45.461860 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a17c2e74-bd68-4ebe-9be8-422b422c8a20 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:45.474843 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-a17c2e74-bd68-4ebe-9be8-422b422c8a20 admin admin] Calling delete_port for efce1b9c-0122-448d-b190-5f99e09d575a owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:58:45.655572 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a17c2e74-bd68-4ebe-9be8-422b422c8a20 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:45.684325 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a17c2e74-bd68-4ebe-9be8-422b422c8a20 admin admin] Pushing event deleted for resources: {'Port': ['ID=efce1b9c-0122-448d-b190-5f99e09d575a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:45.849973 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a17c2e74-bd68-4ebe-9be8-422b422c8a20 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:46.411873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a17c2e74-bd68-4ebe-9be8-422b422c8a20 admin admin] Router d9cf6337-3bad-4310-b6ab-6a6e5ee3198c has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:58:46.522537 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a17c2e74-bd68-4ebe-9be8-422b422c8a20 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:58:46.529114 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a17c2e74-bd68-4ebe-9be8-422b422c8a20 admin admin] 10.222.0.13 "PUT /v2.0/routers/d9cf6337-3bad-4310-b6ab-6a6e5ee3198c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9055269 Dec 09 21:58:46.530404 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56372) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:58:46.533242 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5dfaca9-a545-4148-84b0-7e04fd4614e4 None None] Sync routers for ids ['d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:58:46.544308 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5dfaca9-a545-4148-84b0-7e04fd4614e4 None None] Routers {'d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:58:46.544930 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a5dfaca9-a545-4148-84b0-7e04fd4614e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:58:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:46.635116 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15773dbc-a036-4766-bcbd-6f1798c91245 admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:46.651175 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-a5dfaca9-a545-4148-84b0-7e04fd4614e4 None None] Set router d9cf6337-3bad-4310-b6ab-6a6e5ee3198c gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:58:46.737751 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15773dbc-a036-4766-bcbd-6f1798c91245 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:46.798898 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-15773dbc-a036-4766-bcbd-6f1798c91245 admin admin] Deleting port e8d93782-8b94-42dc-84a9-f5481f9afe13 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:58:46.799250 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15773dbc-a036-4766-bcbd-6f1798c91245 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:46.828148 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a5dfaca9-a545-4148-84b0-7e04fd4614e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'name': 'tempest-TestServerBasicOps-833518784-router', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129'}], 'enable_snat': True}, 'gw_port_id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:33Z', 'updated_at': '2021-12-09T21:58:45Z', 'revision_number': 5, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'gw_port': {'id': 'e8d93782-8b94-42dc-84a9-f5481f9afe13', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:c4:ec', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3888, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.129', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:34Z', 'updated_at': '2021-12-09T21:53:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:46.858377 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5dfaca9-a545-4148-84b0-7e04fd4614e4 None None] Checking router: d9cf6337-3bad-4310-b6ab-6a6e5ee3198c for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:58:46.867358 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5dfaca9-a545-4148-84b0-7e04fd4614e4 None None] Routers {'d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:58:46.868020 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a5dfaca9-a545-4148-84b0-7e04fd4614e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:58:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:46.879680 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-15773dbc-a036-4766-bcbd-6f1798c91245 admin admin] For port e8d93782-8b94-42dc-84a9-f5481f9afe13, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e8d93782-8b94-42dc-84a9-f5481f9afe13,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:58:46.880166 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15773dbc-a036-4766-bcbd-6f1798c91245 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:46.892788 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-15773dbc-a036-4766-bcbd-6f1798c91245 admin admin] Calling delete_port for e8d93782-8b94-42dc-84a9-f5481f9afe13 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:58:46.954461 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-a5dfaca9-a545-4148-84b0-7e04fd4614e4 None None] Set router d9cf6337-3bad-4310-b6ab-6a6e5ee3198c gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:58:47.008990 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a5dfaca9-a545-4148-84b0-7e04fd4614e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'name': 'tempest-TestServerBasicOps-833518784-router', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:33Z', 'updated_at': '2021-12-09T21:58:46Z', 'revision_number': 6, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:47.034891 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5dfaca9-a545-4148-84b0-7e04fd4614e4 None None] The sync data for ids ['d9cf6337-3bad-4310-b6ab-6a6e5ee3198c'] in n-d-713301-27 is: [{'id': 'd9cf6337-3bad-4310-b6ab-6a6e5ee3198c', 'name': 'tempest-TestServerBasicOps-833518784-router', 'tenant_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:33Z', 'updated_at': '2021-12-09T21:58:46Z', 'revision_number': 6, 'project_id': 'a1dd4ab6f25741058f3000ebf6ce1eac', 'gw_port_host': None}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:58:47.055771 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15773dbc-a036-4766-bcbd-6f1798c91245 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:47.082702 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15773dbc-a036-4766-bcbd-6f1798c91245 admin admin] Pushing event deleted for resources: {'Port': ['ID=e8d93782-8b94-42dc-84a9-f5481f9afe13,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:47.097169 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d2797418-1eb7-4c1b-bd74-43a59bf44fdf None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:58:47.151076 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15773dbc-a036-4766-bcbd-6f1798c91245 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:47.245047 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15773dbc-a036-4766-bcbd-6f1798c91245 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:47.248120 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15773dbc-a036-4766-bcbd-6f1798c91245 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:47.302110 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15773dbc-a036-4766-bcbd-6f1798c91245 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:47.302559 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-15773dbc-a036-4766-bcbd-6f1798c91245 admin admin] Fanout notify agent at l3_agent the message router_deleted on router d9cf6337-3bad-4310-b6ab-6a6e5ee3198c {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:58:47.307018 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15773dbc-a036-4766-bcbd-6f1798c91245 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:47.308216 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-15773dbc-a036-4766-bcbd-6f1798c91245 admin admin] 10.222.0.13 "DELETE /v2.0/routers/d9cf6337-3bad-4310-b6ab-6a6e5ee3198c HTTP/1.1" status: 204 len: 168 time: 0.7769260 Dec 09 21:58:47.310733 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56376) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:58:47.361199 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-9d76b188-02d7-4284-91a6-ace8993de71a admin admin] Deleting subnet 912d0a1a-1b1a-4383-8291-491e8e3358fe {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:58:47.364825 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d76b188-02d7-4284-91a6-ace8993de71a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:47.410993 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d76b188-02d7-4284-91a6-ace8993de71a admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:47.496801 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d76b188-02d7-4284-91a6-ace8993de71a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:47.554074 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d76b188-02d7-4284-91a6-ace8993de71a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:47.562263 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device efce1b9c-0122-448d-b190-5f99e09d575a no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:58:47.568248 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9d76b188-02d7-4284-91a6-ace8993de71a admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:47.574646 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56378) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:58:47.575260 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9d76b188-02d7-4284-91a6-ace8993de71a admin admin] 10.222.0.13 "DELETE /v2.0/subnets/912d0a1a-1b1a-4383-8291-491e8e3358fe HTTP/1.1" status: 204 len: 168 time: 0.2630212 Dec 09 21:58:47.594719 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: efce1b9c-0122-448d-b190-5f99e09d575a {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:58:47.595071 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device efce1b9c-0122-448d-b190-5f99e09d575a not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:58:47.596811 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0e43a7c9-ca9a-4bb0-96e1-c6b20bf31c9b None None] Network 9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:58:47.600401 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d76b188-02d7-4284-91a6-ace8993de71a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=912d0a1a-1b1a-4383-8291-491e8e3358fe,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:47.660347 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:47.729843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Deleting port fd986418-b3fd-4b4b-9e4f-2d0201d3fe50 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:58:47.730136 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:47.781485 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-13d3427b-69d2-4309-beb7-b8e6301757c3 None None] DHCP port deletion for 9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:58:47.799541 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] For port fd986418-b3fd-4b4b-9e4f-2d0201d3fe50, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=fd986418-b3fd-4b4b-9e4f-2d0201d3fe50,segment=NetworkSegment(bd059ed1-b661-4e68-8df0-ed7798fa0c5d),segment_id=bd059ed1-b661-4e68-8df0-ed7798fa0c5d)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:58:47.800060 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:47.815046 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Calling delete_port for fd986418-b3fd-4b4b-9e4f-2d0201d3fe50 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:58:47.847243 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-13d3427b-69d2-4309-beb7-b8e6301757c3 None None] Deleting port fd986418-b3fd-4b4b-9e4f-2d0201d3fe50 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:58:47.847673 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-13d3427b-69d2-4309-beb7-b8e6301757c3 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:47.924373 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:47.954436 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Pushing event deleted for resources: {'Port': ['ID=fd986418-b3fd-4b4b-9e4f-2d0201d3fe50,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:47.957107 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] No DVR routers for this DVR port fd986418-b3fd-4b4b-9e4f-2d0201d3fe50 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:58:47.984778 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:47.985110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:47.985509 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:47.985887 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:47.986166 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:47.986625 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:47.986962 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:47.987636 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:47.987974 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:47.988411 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:47.988769 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:47.989097 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:47.989468 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:58:48.064023 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:48.086263 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:48.097714 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bd059ed1-b661-4e68-8df0-ed7798fa0c5d') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:48.098015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bd059ed1-b661-4e68-8df0-ed7798fa0c5d') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:48.107186 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-13d3427b-69d2-4309-beb7-b8e6301757c3 None None] For port fd986418-b3fd-4b4b-9e4f-2d0201d3fe50, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=fd986418-b3fd-4b4b-9e4f-2d0201d3fe50,segment=NetworkSegment(bd059ed1-b661-4e68-8df0-ed7798fa0c5d),segment_id=bd059ed1-b661-4e68-8df0-ed7798fa0c5d)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:58:48.107618 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:48.107749 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-13d3427b-69d2-4309-beb7-b8e6301757c3 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:48.123283 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-13d3427b-69d2-4309-beb7-b8e6301757c3 None None] Calling delete_port for fd986418-b3fd-4b4b-9e4f-2d0201d3fe50 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:58:48.126494 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:48.132766 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Releasing vlan 142 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:58:48.133227 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:58:48.135014 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:58:48.192590 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:48.199131 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:48.205295 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] 10.222.0.13 "DELETE /v2.0/networks/9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 HTTP/1.1" status: 204 len: 168 time: 0.6261983 Dec 09 21:58:48.205643 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56380) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:58:48.215756 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c7c2553-b8fa-4bd5-80a3-f2b84396c08e admin admin] Pushing event deleted for resources: {'Network': ['ID=9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:48.217840 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-13d3427b-69d2-4309-beb7-b8e6301757c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:48.240138 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13d3427b-69d2-4309-beb7-b8e6301757c3 None None] Pushing event deleted for resources: {'Port': ['ID=fd986418-b3fd-4b4b-9e4f-2d0201d3fe50,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:48.245206 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-13d3427b-69d2-4309-beb7-b8e6301757c3 None None] Network 9b3cfb68-85c7-4e0e-b1d7-da8b995ee5a7 is not hosted by any dhcp agent {{(pid=103439) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 09 21:58:48.245573 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13d3427b-69d2-4309-beb7-b8e6301757c3 None None] No DVR routers for this DVR port fd986418-b3fd-4b4b-9e4f-2d0201d3fe50 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:58:48.576197 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a36f003b-c81b-458f-9f02-207443375eab admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:48.831406 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-a36f003b-c81b-458f-9f02-207443375eab admin admin] Deleting port f40f0052-c615-4c88-9cc5-8c66748c34fe {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:58:48.831684 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a36f003b-c81b-458f-9f02-207443375eab admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:48.913991 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-a36f003b-c81b-458f-9f02-207443375eab admin admin] For port f40f0052-c615-4c88-9cc5-8c66748c34fe, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f40f0052-c615-4c88-9cc5-8c66748c34fe,segment=NetworkSegment(1cf908c4-b2d8-4a3c-a764-c91d90de89cd),segment_id=1cf908c4-b2d8-4a3c-a764-c91d90de89cd)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:58:48.914322 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a36f003b-c81b-458f-9f02-207443375eab admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:48.927776 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-a36f003b-c81b-458f-9f02-207443375eab admin admin] Calling delete_port for f40f0052-c615-4c88-9cc5-8c66748c34fe owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:58:49.114277 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a36f003b-c81b-458f-9f02-207443375eab admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:49.141632 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a36f003b-c81b-458f-9f02-207443375eab admin admin] Pushing event deleted for resources: {'Port': ['ID=f40f0052-c615-4c88-9cc5-8c66748c34fe,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:49.315721 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a36f003b-c81b-458f-9f02-207443375eab admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:49.353911 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e8d93782-8b94-42dc-84a9-f5481f9afe13 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:58:49.376451 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: e8d93782-8b94-42dc-84a9-f5481f9afe13 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:58:49.376699 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e8d93782-8b94-42dc-84a9-f5481f9afe13 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:58:49.377111 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device fd986418-b3fd-4b4b-9e4f-2d0201d3fe50 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:58:49.396751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: fd986418-b3fd-4b4b-9e4f-2d0201d3fe50 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:58:49.397095 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device fd986418-b3fd-4b4b-9e4f-2d0201d3fe50 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:58:49.545221 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a36f003b-c81b-458f-9f02-207443375eab admin admin] Router 8c937498-e34f-483d-b4e0-1b40a8f681f1 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:58:49.653612 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a36f003b-c81b-458f-9f02-207443375eab admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:58:49.658794 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a36f003b-c81b-458f-9f02-207443375eab admin admin] 10.222.0.13 "PUT /v2.0/routers/8c937498-e34f-483d-b4e0-1b40a8f681f1/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4512818 Dec 09 21:58:49.661535 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56384) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:58:49.663027 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17863d12-8326-4955-8d2f-af4fb57c4ae2 None None] Sync routers for ids ['8c937498-e34f-483d-b4e0-1b40a8f681f1'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:58:49.674267 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17863d12-8326-4955-8d2f-af4fb57c4ae2 None None] Routers {'8c937498-e34f-483d-b4e0-1b40a8f681f1'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:58:49.674975 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-17863d12-8326-4955-8d2f-af4fb57c4ae2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:58:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['8c937498-e34f-483d-b4e0-1b40a8f681f1'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:49.772953 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0b9ef8ab-4f65-40f8-8661-bbf68959588a admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:49.875509 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-17863d12-8326-4955-8d2f-af4fb57c4ae2 None None] Set router 8c937498-e34f-483d-b4e0-1b40a8f681f1 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:58:49.881447 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0b9ef8ab-4f65-40f8-8661-bbf68959588a admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:49.938675 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-0b9ef8ab-4f65-40f8-8661-bbf68959588a admin admin] Deleting port cfca101a-a0fb-4ffb-99fe-557a861caf93 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:58:49.938932 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0b9ef8ab-4f65-40f8-8661-bbf68959588a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:50.023956 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-0b9ef8ab-4f65-40f8-8661-bbf68959588a admin admin] For port cfca101a-a0fb-4ffb-99fe-557a861caf93, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=cfca101a-a0fb-4ffb-99fe-557a861caf93,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:58:50.024332 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0b9ef8ab-4f65-40f8-8661-bbf68959588a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:50.037925 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-0b9ef8ab-4f65-40f8-8661-bbf68959588a admin admin] Calling delete_port for cfca101a-a0fb-4ffb-99fe-557a861caf93 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:58:50.055046 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-17863d12-8326-4955-8d2f-af4fb57c4ae2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8c937498-e34f-483d-b4e0-1b40a8f681f1', 'name': 'tempest-TestServerBasicOps-1606904686-router', 'tenant_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.162'}], 'enable_snat': True}, 'gw_port_id': 'cfca101a-a0fb-4ffb-99fe-557a861caf93', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:38Z', 'updated_at': '2021-12-09T21:58:49Z', 'revision_number': 5, 'project_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'gw_port': {'id': 'cfca101a-a0fb-4ffb-99fe-557a861caf93', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:f3:3e:68', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8c937498-e34f-483d-b4e0-1b40a8f681f1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3900, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.162', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:53:39Z', 'updated_at': '2021-12-09T21:53:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:50.082608 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17863d12-8326-4955-8d2f-af4fb57c4ae2 None None] Checking router: 8c937498-e34f-483d-b4e0-1b40a8f681f1 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:58:50.091712 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17863d12-8326-4955-8d2f-af4fb57c4ae2 None None] Routers {'8c937498-e34f-483d-b4e0-1b40a8f681f1'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:58:50.092329 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-17863d12-8326-4955-8d2f-af4fb57c4ae2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:58:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['8c937498-e34f-483d-b4e0-1b40a8f681f1'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:50.180070 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-17863d12-8326-4955-8d2f-af4fb57c4ae2 None None] Set router 8c937498-e34f-483d-b4e0-1b40a8f681f1 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:58:50.216395 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0b9ef8ab-4f65-40f8-8661-bbf68959588a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:50.232476 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-17863d12-8326-4955-8d2f-af4fb57c4ae2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8c937498-e34f-483d-b4e0-1b40a8f681f1', 'name': 'tempest-TestServerBasicOps-1606904686-router', 'tenant_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:38Z', 'updated_at': '2021-12-09T21:58:49Z', 'revision_number': 6, 'project_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:50.239857 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b9ef8ab-4f65-40f8-8661-bbf68959588a admin admin] Pushing event deleted for resources: {'Port': ['ID=cfca101a-a0fb-4ffb-99fe-557a861caf93,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:50.260261 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bcb3f1ac-dac1-4bbb-ae5a-213dc7ce3257 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:58:50.262862 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17863d12-8326-4955-8d2f-af4fb57c4ae2 None None] The sync data for ids ['8c937498-e34f-483d-b4e0-1b40a8f681f1'] in n-d-713301-27 is: [{'id': '8c937498-e34f-483d-b4e0-1b40a8f681f1', 'name': 'tempest-TestServerBasicOps-1606904686-router', 'tenant_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:53:38Z', 'updated_at': '2021-12-09T21:58:49Z', 'revision_number': 6, 'project_id': 'cbabd8b8a5fa406fa7b82743c1ae4bd0', 'gw_port_host': None}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:58:50.313714 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0b9ef8ab-4f65-40f8-8661-bbf68959588a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:50.415491 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0b9ef8ab-4f65-40f8-8661-bbf68959588a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:50.422327 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0b9ef8ab-4f65-40f8-8661-bbf68959588a admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:50.485576 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0b9ef8ab-4f65-40f8-8661-bbf68959588a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:50.486189 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0b9ef8ab-4f65-40f8-8661-bbf68959588a admin admin] Fanout notify agent at l3_agent the message router_deleted on router 8c937498-e34f-483d-b4e0-1b40a8f681f1 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 21:58:50.491797 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0b9ef8ab-4f65-40f8-8661-bbf68959588a admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:50.493115 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0b9ef8ab-4f65-40f8-8661-bbf68959588a admin admin] 10.222.0.13 "DELETE /v2.0/routers/8c937498-e34f-483d-b4e0-1b40a8f681f1 HTTP/1.1" status: 204 len: 168 time: 0.8306828 Dec 09 21:58:50.496287 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56386) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:58:50.547144 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-4b297e14-3c05-4a54-8b32-66f65d6fe394 admin admin] Deleting subnet aef9b85f-e47c-4201-91c9-161e142a9441 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 21:58:50.551162 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4b297e14-3c05-4a54-8b32-66f65d6fe394 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:50.588050 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4b297e14-3c05-4a54-8b32-66f65d6fe394 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:50.668042 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4b297e14-3c05-4a54-8b32-66f65d6fe394 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:50.734824 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4b297e14-3c05-4a54-8b32-66f65d6fe394 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:50.767010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b297e14-3c05-4a54-8b32-66f65d6fe394 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=aef9b85f-e47c-4201-91c9-161e142a9441,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:50.769691 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4b297e14-3c05-4a54-8b32-66f65d6fe394 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:50.773533 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4b297e14-3c05-4a54-8b32-66f65d6fe394 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/aef9b85f-e47c-4201-91c9-161e142a9441 HTTP/1.1" status: 204 len: 168 time: 0.2762091 Dec 09 21:58:50.774605 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd4335ec-0b59-4c7d-b1f4-8cd9ed19ccf0 None None] Network 0fbb81d3-e114-41cc-97c1-0df7c248e4a9 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:58:50.776055 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56388) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:58:50.854232 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-488524ac-3283-49fb-974f-1cf3b2510b89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:50.909452 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-488524ac-3283-49fb-974f-1cf3b2510b89 admin admin] Deleting port a8247118-063a-462d-bc8f-34d1bd44a31e {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 21:58:50.909800 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-488524ac-3283-49fb-974f-1cf3b2510b89 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:50.988257 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-488524ac-3283-49fb-974f-1cf3b2510b89 admin admin] For port a8247118-063a-462d-bc8f-34d1bd44a31e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a8247118-063a-462d-bc8f-34d1bd44a31e,segment=NetworkSegment(1cf908c4-b2d8-4a3c-a764-c91d90de89cd),segment_id=1cf908c4-b2d8-4a3c-a764-c91d90de89cd)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:58:50.988560 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-488524ac-3283-49fb-974f-1cf3b2510b89 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:51.002879 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-488524ac-3283-49fb-974f-1cf3b2510b89 admin admin] Calling delete_port for a8247118-063a-462d-bc8f-34d1bd44a31e owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 21:58:51.095018 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-488524ac-3283-49fb-974f-1cf3b2510b89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:51.120209 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-488524ac-3283-49fb-974f-1cf3b2510b89 admin admin] Pushing event deleted for resources: {'Port': ['ID=a8247118-063a-462d-bc8f-34d1bd44a31e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:51.123868 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-488524ac-3283-49fb-974f-1cf3b2510b89 admin admin] No DVR routers for this DVR port a8247118-063a-462d-bc8f-34d1bd44a31e on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 21:58:51.154991 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2fa81277-5203-4c3c-9faa-5b49290ea3b6 None None] DHCP port deletion for 0fbb81d3-e114-41cc-97c1-0df7c248e4a9 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:58:51.202477 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-488524ac-3283-49fb-974f-1cf3b2510b89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:51.229573 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-488524ac-3283-49fb-974f-1cf3b2510b89 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0fbb81d3-e114-41cc-97c1-0df7c248e4a9']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:51.241625 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-488524ac-3283-49fb-974f-1cf3b2510b89 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1cf908c4-b2d8-4a3c-a764-c91d90de89cd') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:51.241854 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-488524ac-3283-49fb-974f-1cf3b2510b89 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1cf908c4-b2d8-4a3c-a764-c91d90de89cd') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:51.258014 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-488524ac-3283-49fb-974f-1cf3b2510b89 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:51.274909 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-488524ac-3283-49fb-974f-1cf3b2510b89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:51.282285 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-488524ac-3283-49fb-974f-1cf3b2510b89 admin admin] Releasing vlan 140 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 21:58:51.282689 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-488524ac-3283-49fb-974f-1cf3b2510b89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: timer() Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 21:58:51.284528 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 21:58:51.317763 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a8247118-063a-462d-bc8f-34d1bd44a31e no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:58:51.337970 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: a8247118-063a-462d-bc8f-34d1bd44a31e {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:58:51.338377 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a8247118-063a-462d-bc8f-34d1bd44a31e not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:58:51.338882 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device cfca101a-a0fb-4ffb-99fe-557a861caf93 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:58:51.345903 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-488524ac-3283-49fb-974f-1cf3b2510b89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:51.354359 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-488524ac-3283-49fb-974f-1cf3b2510b89 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:51.357878 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-488524ac-3283-49fb-974f-1cf3b2510b89 admin admin] 10.222.0.13 "DELETE /v2.0/networks/0fbb81d3-e114-41cc-97c1-0df7c248e4a9 HTTP/1.1" status: 204 len: 168 time: 0.5805562 Dec 09 21:58:51.363270 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: cfca101a-a0fb-4ffb-99fe-557a861caf93 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:58:51.363645 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device cfca101a-a0fb-4ffb-99fe-557a861caf93 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:58:51.364188 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f40f0052-c615-4c88-9cc5-8c66748c34fe no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 21:58:51.372785 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-488524ac-3283-49fb-974f-1cf3b2510b89 admin admin] Pushing event deleted for resources: {'Network': ['ID=0fbb81d3-e114-41cc-97c1-0df7c248e4a9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:51.387224 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: f40f0052-c615-4c88-9cc5-8c66748c34fe {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 21:58:51.387523 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f40f0052-c615-4c88-9cc5-8c66748c34fe not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 21:58:51.498739 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56392) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:58:51.539487 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7ef26585-09d4-4879-9531-7e8f8861f070 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=a1dd4ab6f25741058f3000ebf6ce1eac&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0394711 Dec 09 21:58:51.542045 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56394) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:58:51.588789 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0abec89f-4c49-49b4-a90b-849f97cdd33a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:51.613370 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0abec89f-4c49-49b4-a90b-849f97cdd33a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:51.668334 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0abec89f-4c49-49b4-a90b-849f97cdd33a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:51.671378 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0abec89f-4c49-49b4-a90b-849f97cdd33a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:51.672630 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0abec89f-4c49-49b4-a90b-849f97cdd33a admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/7371d9f1-cfae-4ce3-8eb7-979c71348d71 HTTP/1.1" status: 204 len: 168 time: 0.1296818 Dec 09 21:58:51.681014 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0abec89f-4c49-49b4-a90b-849f97cdd33a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7371d9f1-cfae-4ce3-8eb7-979c71348d71,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:52.009027 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56400) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:58:52.050038 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7c0cda5b-13c8-4811-a726-8d2f349d6d9c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=cbabd8b8a5fa406fa7b82743c1ae4bd0&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0397830 Dec 09 21:58:52.053010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56402) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:58:52.108804 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c8a93dc6-c111-4432-b75a-e9cfc250797a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:52.140223 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c8a93dc6-c111-4432-b75a-e9cfc250797a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:52.189346 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c8a93dc6-c111-4432-b75a-e9cfc250797a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:52.193108 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c8a93dc6-c111-4432-b75a-e9cfc250797a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:52.194294 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c8a93dc6-c111-4432-b75a-e9cfc250797a admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/d7f9feff-3408-4863-9991-099facc4c9a8 HTTP/1.1" status: 204 len: 168 time: 0.1401660 Dec 09 21:58:52.203903 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8a93dc6-c111-4432-b75a-e9cfc250797a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d7f9feff-3408-4863-9991-099facc4c9a8,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:52.979792 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56424) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:58:53.085719 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-b745845c-989a-4d74-a9a8-20bc459be647 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBackupRestore-1315296361-network', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:58:53.108968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b745845c-989a-4d74-a9a8-20bc459be647 admin admin] Made reservation on behalf of fbf735848dcf4d12b202a013c40dbc22 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:58:53.111509 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b745845c-989a-4d74-a9a8-20bc459be647 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:53.121280 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b745845c-989a-4d74-a9a8-20bc459be647 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:53.204946 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b745845c-989a-4d74-a9a8-20bc459be647 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:53.210184 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b745845c-989a-4d74-a9a8-20bc459be647 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:53.234455 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b745845c-989a-4d74-a9a8-20bc459be647 admin admin] vlan segment allocate from pool success with {'vlan_id': 105, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:58:53.244250 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b745845c-989a-4d74-a9a8-20bc459be647 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=81e616cb-d65d-4295-8236-a6b64ea5fcd0,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:53.249403 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b745845c-989a-4d74-a9a8-20bc459be647 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:53.249741 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-b745845c-989a-4d74-a9a8-20bc459be647 admin admin] Added segment 51312a71-17d4-413a-8049-8ec25b223e8b of type vlan for network 7d2b997d-488a-4244-8788-25a6953a7b67 Dec 09 21:58:53.288395 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b745845c-989a-4d74-a9a8-20bc459be647 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:53.316307 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b745845c-989a-4d74-a9a8-20bc459be647 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:53.317840 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b745845c-989a-4d74-a9a8-20bc459be647 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:53.318855 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b745845c-989a-4d74-a9a8-20bc459be647 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:53.354441 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b745845c-989a-4d74-a9a8-20bc459be647 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.3734779 Dec 09 21:58:53.357536 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56428) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:58:53.362989 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-c34563d6-05ab-4fd4-950d-bed4912fe605 admin admin] Request body: {'subnet': {'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBackupRestore-1315296361-subnet', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:58:53.383608 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b745845c-989a-4d74-a9a8-20bc459be647 admin admin] Pushing event updated for resources: {'Network': ['ID=7d2b997d-488a-4244-8788-25a6953a7b67,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:53.385955 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c34563d6-05ab-4fd4-950d-bed4912fe605 admin admin] Made reservation on behalf of fbf735848dcf4d12b202a013c40dbc22 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:58:53.388422 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c34563d6-05ab-4fd4-950d-bed4912fe605 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:53.394166 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 7d2b997d-488a-4244-8788-25a6953a7b67 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:58:53.930557 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c34563d6-05ab-4fd4-950d-bed4912fe605 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:53.993767 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c34563d6-05ab-4fd4-950d-bed4912fe605 admin admin] Pushing event updated for resources: {'Subnet': ['ID=99243393-13ed-459f-904c-d6635896912a,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:54.002316 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c34563d6-05ab-4fd4-950d-bed4912fe605 admin admin] Checking segment: {'id': '51312a71-17d4-413a-8049-8ec25b223e8b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:58:54.002748 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c34563d6-05ab-4fd4-950d-bed4912fe605 admin admin] Network hostable DHCP agents. Network: 7d2b997d-488a-4244-8788-25a6953a7b67, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:58:54.020941 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c34563d6-05ab-4fd4-950d-bed4912fe605 admin admin] Network 7d2b997d-488a-4244-8788-25a6953a7b67 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:58:54.030104 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-c34563d6-05ab-4fd4-950d-bed4912fe605 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 7d2b997d-488a-4244-8788-25a6953a7b67) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:58:54.034716 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c34563d6-05ab-4fd4-950d-bed4912fe605 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:54.035426 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c34563d6-05ab-4fd4-950d-bed4912fe605 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:54.040379 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-494d8c0e-5228-439a-8bca-dd7bb3272b4b None None] Network 7d2b997d-488a-4244-8788-25a6953a7b67 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:58:54.053139 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c34563d6-05ab-4fd4-950d-bed4912fe605 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.6943386 Dec 09 21:58:54.055844 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56430) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:58:54.060137 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-7d66c366-7ce2-4f33-8a68-38a360c15a0d admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBackupRestore-1315296361-router', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:58:54.082087 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7d66c366-7ce2-4f33-8a68-38a360c15a0d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:54.083109 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7d66c366-7ce2-4f33-8a68-38a360c15a0d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:54.142381 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7d66c366-7ce2-4f33-8a68-38a360c15a0d admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:54.147326 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-341005c9-b2ff-4c8c-a07a-5804dc1a90b3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-7d2b997d-488a-4244-8788-25a6953a7b67', 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67', 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'fixed_ips': [{'subnet_id': '99243393-13ed-459f-904c-d6635896912a'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:58:54.148226 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-341005c9-b2ff-4c8c-a07a-5804dc1a90b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:54.279585 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7d66c366-7ce2-4f33-8a68-38a360c15a0d admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:54.282831 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-341005c9-b2ff-4c8c-a07a-5804dc1a90b3 None None] Allocated IP 172.20.0.2 (7d2b997d-488a-4244-8788-25a6953a7b67/99243393-13ed-459f-904c-d6635896912a/b65c71ad-25bd-4721-97bc-96c821017151) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:58:54.432324 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-341005c9-b2ff-4c8c-a07a-5804dc1a90b3 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:54.439252 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-341005c9-b2ff-4c8c-a07a-5804dc1a90b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:54.477223 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-341005c9-b2ff-4c8c-a07a-5804dc1a90b3 None None] Network 7d2b997d-488a-4244-8788-25a6953a7b67 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:58:54.480547 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-341005c9-b2ff-4c8c-a07a-5804dc1a90b3 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:58:54.484653 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-341005c9-b2ff-4c8c-a07a-5804dc1a90b3 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:58:54.494451 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7d66c366-7ce2-4f33-8a68-38a360c15a0d admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:54.499454 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-341005c9-b2ff-4c8c-a07a-5804dc1a90b3 None None] Pushing event updated for resources: {'Port': ['ID=b65c71ad-25bd-4721-97bc-96c821017151,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:54.516459 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7d66c366-7ce2-4f33-8a68-38a360c15a0d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:54.550284 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-341005c9-b2ff-4c8c-a07a-5804dc1a90b3 None None] Attempting to bind port b65c71ad-25bd-4721-97bc-96c821017151 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:58:54.550680 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-341005c9-b2ff-4c8c-a07a-5804dc1a90b3 None None] Attempting to bind port b65c71ad-25bd-4721-97bc-96c821017151 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '51312a71-17d4-413a-8049-8ec25b223e8b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:58:54.551059 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-341005c9-b2ff-4c8c-a07a-5804dc1a90b3 None None] Attempting to bind port b65c71ad-25bd-4721-97bc-96c821017151 on network 7d2b997d-488a-4244-8788-25a6953a7b67 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:58:54.556724 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-341005c9-b2ff-4c8c-a07a-5804dc1a90b3 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 58, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:58:54.557278 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-341005c9-b2ff-4c8c-a07a-5804dc1a90b3 None None] Checking segment: {'id': '51312a71-17d4-413a-8049-8ec25b223e8b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:58:54.557905 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-341005c9-b2ff-4c8c-a07a-5804dc1a90b3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:54.558436 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-341005c9-b2ff-4c8c-a07a-5804dc1a90b3 None None] Bound using segment: {'id': '51312a71-17d4-413a-8049-8ec25b223e8b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:58:54.559102 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-341005c9-b2ff-4c8c-a07a-5804dc1a90b3 None None] Bound port: b65c71ad-25bd-4721-97bc-96c821017151, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '51312a71-17d4-413a-8049-8ec25b223e8b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:58:54.559716 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-341005c9-b2ff-4c8c-a07a-5804dc1a90b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:54.622368 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-341005c9-b2ff-4c8c-a07a-5804dc1a90b3 None None] For port b65c71ad-25bd-4721-97bc-96c821017151, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:58:54.624009 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-7d66c366-7ce2-4f33-8a68-38a360c15a0d admin admin] Allocated IP 172.25.3.111 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/d48358d4-545a-4282-816d-a3f37022551e) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:58:54.625533 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-341005c9-b2ff-4c8c-a07a-5804dc1a90b3 None None] For port b65c71ad-25bd-4721-97bc-96c821017151, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b65c71ad-25bd-4721-97bc-96c821017151,segment=NetworkSegment(51312a71-17d4-413a-8049-8ec25b223e8b),segment_id=51312a71-17d4-413a-8049-8ec25b223e8b)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:58:54.630679 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-341005c9-b2ff-4c8c-a07a-5804dc1a90b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:54.687416 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-341005c9-b2ff-4c8c-a07a-5804dc1a90b3 None None] Pushing event updated for resources: {'Port': ['ID=b65c71ad-25bd-4721-97bc-96c821017151,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:54.729405 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7d66c366-7ce2-4f33-8a68-38a360c15a0d admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:54.764335 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7d66c366-7ce2-4f33-8a68-38a360c15a0d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:54.801294 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d66c366-7ce2-4f33-8a68-38a360c15a0d admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:58:54.804599 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-7d66c366-7ce2-4f33-8a68-38a360c15a0d admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:58:54.808287 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d66c366-7ce2-4f33-8a68-38a360c15a0d admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:58:54.819839 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab821ca0-1a4a-4bde-abcb-0a712da102a8 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:58:54.840799 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d66c366-7ce2-4f33-8a68-38a360c15a0d admin admin] Pushing event updated for resources: {'Port': ['ID=d48358d4-545a-4282-816d-a3f37022551e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:54.926079 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-97453dfb-ce2e-4302-a745-b6b99e4104cb None None] Provisioning complete for port d48358d4-545a-4282-816d-a3f37022551e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:58:54.926519 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-97453dfb-ce2e-4302-a745-b6b99e4104cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:54.965986 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-97453dfb-ce2e-4302-a745-b6b99e4104cb None None] Port d48358d4-545a-4282-816d-a3f37022551e cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:58:55.084077 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7d66c366-7ce2-4f33-8a68-38a360c15a0d admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:55.289913 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7d66c366-7ce2-4f33-8a68-38a360c15a0d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:55.318668 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b65c71ad-25bd-4721-97bc-96c821017151 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:58:55.368803 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port b65c71ad-25bd-4721-97bc-96c821017151 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:58:55.369175 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:55.431273 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7d66c366-7ce2-4f33-8a68-38a360c15a0d admin admin] Router 0d60ac0a-7a8a-48a2-be00-905446e6480e is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:58:55.450688 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:55.488208 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port b65c71ad-25bd-4721-97bc-96c821017151, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b65c71ad-25bd-4721-97bc-96c821017151,segment=NetworkSegment(51312a71-17d4-413a-8049-8ec25b223e8b),segment_id=51312a71-17d4-413a-8049-8ec25b223e8b)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:58:55.493992 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:55.547058 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=b65c71ad-25bd-4721-97bc-96c821017151,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:55.547373 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7d66c366-7ce2-4f33-8a68-38a360c15a0d admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:58:55.559663 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] Sync routers for ids ['0d60ac0a-7a8a-48a2-be00-905446e6480e'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:58:55.571306 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7d66c366-7ce2-4f33-8a68-38a360c15a0d admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:55.572080 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] Routers {'0d60ac0a-7a8a-48a2-be00-905446e6480e'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:58:55.575269 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7d66c366-7ce2-4f33-8a68-38a360c15a0d admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 1.5158782 Dec 09 21:58:55.575608 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:58:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['0d60ac0a-7a8a-48a2-be00-905446e6480e'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:55.575764 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56434) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:58:55.671513 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb0a33e0-5cb3-4afc-907d-f6a163eb074a None None] Network 7d2b997d-488a-4244-8788-25a6953a7b67 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:58:55.699234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] Set router 0d60ac0a-7a8a-48a2-be00-905446e6480e gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:58:55.819889 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-eb5c54ed-5e7a-4ed8-a6ae-b489548614e6 None None] Provisioning complete for port b65c71ad-25bd-4721-97bc-96c821017151 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:58:55.820144 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb5c54ed-5e7a-4ed8-a6ae-b489548614e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:56.024279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'name': 'tempest-TestVolumeBackupRestore-1315296361-router', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111'}], 'enable_snat': True}, 'gw_port_id': 'd48358d4-545a-4282-816d-a3f37022551e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:54Z', 'revision_number': 3, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'gw_port': {'id': 'd48358d4-545a-4282-816d-a3f37022551e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:41:df', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4003, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:54Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:56.032700 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ddd83395-3a2a-48f6-83ee-33ce22101ae1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:56.056989 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] Checking router: 0d60ac0a-7a8a-48a2-be00-905446e6480e for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:58:56.057415 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] Updating router 0d60ac0a-7a8a-48a2-be00-905446e6480e port d48358d4-545a-4282-816d-a3f37022551e binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:58:56.088534 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:56.209573 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-ddd83395-3a2a-48f6-83ee-33ce22101ae1 admin admin] Allocated IP 172.20.0.1 (7d2b997d-488a-4244-8788-25a6953a7b67/99243393-13ed-459f-904c-d6635896912a/565414b3-feaa-4ac4-9283-5a140e9e8de2) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:58:56.293039 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-96e88d72-72ca-4ff8-bfa4-4e4fdd84b4e6 None None] Provisioning complete for port b65c71ad-25bd-4721-97bc-96c821017151 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:58:56.293382 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-96e88d72-72ca-4ff8-bfa4-4e4fdd84b4e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:56.326826 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ddd83395-3a2a-48f6-83ee-33ce22101ae1 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:56.363193 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ddd83395-3a2a-48f6-83ee-33ce22101ae1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:56.405343 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ddd83395-3a2a-48f6-83ee-33ce22101ae1 admin admin] Network 7d2b997d-488a-4244-8788-25a6953a7b67 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:58:56.411639 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-ddd83395-3a2a-48f6-83ee-33ce22101ae1 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:58:56.416615 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ddd83395-3a2a-48f6-83ee-33ce22101ae1 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:58:56.442472 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddd83395-3a2a-48f6-83ee-33ce22101ae1 admin admin] Pushing event updated for resources: {'Port': ['ID=565414b3-feaa-4ac4-9283-5a140e9e8de2,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:56.464384 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ddd83395-3a2a-48f6-83ee-33ce22101ae1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:56.616005 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ddd83395-3a2a-48f6-83ee-33ce22101ae1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:56.686128 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:56.694005 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:56.748347 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1550a35e-1b8a-4f81-9431-481c0bd43bca None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:58:56.764277 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] Attempting to bind port d48358d4-545a-4282-816d-a3f37022551e on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:58:56.764668 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] Attempting to bind port d48358d4-545a-4282-816d-a3f37022551e by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:58:56.765032 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] Attempting to bind port d48358d4-545a-4282-816d-a3f37022551e on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:58:56.767010 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59ff3501-82be-4e32-8903-d362f9568d8c None None] Pushing event updated for resources: {'Port': ['ID=d48358d4-545a-4282-816d-a3f37022551e,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:56.776744 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 58, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:58:56.777143 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:58:56.777566 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:56.778012 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:58:56.778506 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] Bound port: d48358d4-545a-4282-816d-a3f37022551e, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:58:56.778928 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:56.806646 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ddd83395-3a2a-48f6-83ee-33ce22101ae1 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:56.812322 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ddd83395-3a2a-48f6-83ee-33ce22101ae1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:56.845227 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6b927166-b05b-4731-9806-de49653d2a7b None None] Provisioning complete for port d48358d4-545a-4282-816d-a3f37022551e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:58:56.845609 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6b927166-b05b-4731-9806-de49653d2a7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:56.849464 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] For port d48358d4-545a-4282-816d-a3f37022551e, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:58:56.885159 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] For port d48358d4-545a-4282-816d-a3f37022551e, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d48358d4-545a-4282-816d-a3f37022551e,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:58:56.894908 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:56.900100 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-6b927166-b05b-4731-9806-de49653d2a7b None None] Port d48358d4-545a-4282-816d-a3f37022551e cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:58:56.901354 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddd83395-3a2a-48f6-83ee-33ce22101ae1 admin admin] Pushing event updated for resources: {'Port': ['ID=565414b3-feaa-4ac4-9283-5a140e9e8de2,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:56.905405 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ddd83395-3a2a-48f6-83ee-33ce22101ae1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:56.951693 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f72d3cc-30ef-4d56-b080-cb34165ec080 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:58:56.965017 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6b927166-b05b-4731-9806-de49653d2a7b None None] Provisioning complete for port 565414b3-feaa-4ac4-9283-5a140e9e8de2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:58:56.965429 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6b927166-b05b-4731-9806-de49653d2a7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:56.989001 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59ff3501-82be-4e32-8903-d362f9568d8c None None] Pushing event updated for resources: {'Port': ['ID=d48358d4-545a-4282-816d-a3f37022551e,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:56.991645 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] Routers {'0d60ac0a-7a8a-48a2-be00-905446e6480e'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:58:56.992265 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:58:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['0d60ac0a-7a8a-48a2-be00-905446e6480e'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:57.008155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ddd83395-3a2a-48f6-83ee-33ce22101ae1 admin admin] Network 7d2b997d-488a-4244-8788-25a6953a7b67 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:58:57.009657 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-ddd83395-3a2a-48f6-83ee-33ce22101ae1 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:58:57.052516 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-6b927166-b05b-4731-9806-de49653d2a7b None None] Port 565414b3-feaa-4ac4-9283-5a140e9e8de2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:58:57.123040 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] Set router 0d60ac0a-7a8a-48a2-be00-905446e6480e gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:58:57.142691 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ddd83395-3a2a-48f6-83ee-33ce22101ae1 admin admin] Router 0d60ac0a-7a8a-48a2-be00-905446e6480e has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:58:57.223179 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e6058072-1d3d-4a55-a08e-089eae3f4822 None None] Provisioning complete for port d48358d4-545a-4282-816d-a3f37022551e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:58:57.223179 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e6058072-1d3d-4a55-a08e-089eae3f4822 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:57.288732 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ddd83395-3a2a-48f6-83ee-33ce22101ae1 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:58:57.294357 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ddd83395-3a2a-48f6-83ee-33ce22101ae1 admin admin] 10.222.0.13 "PUT /v2.0/routers/0d60ac0a-7a8a-48a2-be00-905446e6480e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7177479 Dec 09 21:58:57.338562 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b65c71ad-25bd-4721-97bc-96c821017151 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:58:57.481875 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:57.484485 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e6058072-1d3d-4a55-a08e-089eae3f4822 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:57.520460 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e6058072-1d3d-4a55-a08e-089eae3f4822 None None] For port d48358d4-545a-4282-816d-a3f37022551e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d48358d4-545a-4282-816d-a3f37022551e,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:58:57.527756 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port b65c71ad-25bd-4721-97bc-96c821017151 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:58:57.528137 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:57.529669 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e6058072-1d3d-4a55-a08e-089eae3f4822 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:57.567332 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'name': 'tempest-TestVolumeBackupRestore-1315296361-router', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111'}], 'enable_snat': True}, 'gw_port_id': 'd48358d4-545a-4282-816d-a3f37022551e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:56Z', 'revision_number': 4, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'gw_port': {'id': 'd48358d4-545a-4282-816d-a3f37022551e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:41:df', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4003, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:56Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '565414b3-feaa-4ac4-9283-5a140e9e8de2', 'name': '', 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'mac_address': 'fa:16:3e:bf:e6:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_interface', 'standard_attr_id': 4004, 'fixed_ips': [{'subnet_id': '99243393-13ed-459f-904c-d6635896912a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:56Z', 'updated_at': '2021-12-09T21:58:56Z', 'revision_number': 2, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'subnets': [{'id': '99243393-13ed-459f-904c-d6635896912a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:58:57.648902 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-765f90c0-29a1-447f-bac8-93040c133916 None None] The sync data for ids ['0d60ac0a-7a8a-48a2-be00-905446e6480e'] in n-d-713301-27 is: [{'id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'name': 'tempest-TestVolumeBackupRestore-1315296361-router', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111'}], 'enable_snat': True}, 'gw_port_id': 'd48358d4-545a-4282-816d-a3f37022551e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:56Z', 'revision_number': 4, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'gw_port': {'id': 'd48358d4-545a-4282-816d-a3f37022551e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:41:df', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4003, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:56Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '565414b3-feaa-4ac4-9283-5a140e9e8de2', 'name': '', 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'mac_address': 'fa:16:3e:bf:e6:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_interface', 'standard_attr_id': 4004, 'fixed_ips': [{'subnet_id': '99243393-13ed-459f-904c-d6635896912a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:56Z', 'updated_at': '2021-12-09T21:58:56Z', 'revision_number': 2, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'subnets': [{'id': '99243393-13ed-459f-904c-d6635896912a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:58:57.692974 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:57.698595 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6058072-1d3d-4a55-a08e-089eae3f4822 None None] Pushing event updated for resources: {'Port': ['ID=d48358d4-545a-4282-816d-a3f37022551e,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:57.708665 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5ef34fc5-2357-41a0-ac1b-a695a4f03433 None None] Provisioning complete for port 565414b3-feaa-4ac4-9283-5a140e9e8de2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:58:57.709039 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5ef34fc5-2357-41a0-ac1b-a695a4f03433 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:57.786950 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-5ef34fc5-2357-41a0-ac1b-a695a4f03433 None None] Port 565414b3-feaa-4ac4-9283-5a140e9e8de2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:58:57.812726 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 56450) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:58:57.818727 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-f610ec6a-7761-4d54-ab95-3b5dca5f2b90 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBackupRestore-929229115-network', 'tenant_id': '4fd5bf27e9dc4615b74a0e66b330b7a2'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:58:57.841530 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f610ec6a-7761-4d54-ab95-3b5dca5f2b90 admin admin] Made reservation on behalf of 4fd5bf27e9dc4615b74a0e66b330b7a2 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:58:57.844157 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f610ec6a-7761-4d54-ab95-3b5dca5f2b90 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:57.853350 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f610ec6a-7761-4d54-ab95-3b5dca5f2b90 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:57.967403 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f610ec6a-7761-4d54-ab95-3b5dca5f2b90 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:57.971881 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f610ec6a-7761-4d54-ab95-3b5dca5f2b90 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:58.000625 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f610ec6a-7761-4d54-ab95-3b5dca5f2b90 admin admin] vlan segment allocate from pool success with {'vlan_id': 130, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 21:58:58.007390 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f610ec6a-7761-4d54-ab95-3b5dca5f2b90 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1046cd49-cb0d-4896-b1f7-64feb372796d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:58.015033 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f610ec6a-7761-4d54-ab95-3b5dca5f2b90 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:58.015390 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-f610ec6a-7761-4d54-ab95-3b5dca5f2b90 admin admin] Added segment 62b79127-8016-490f-b1dd-c0016e8eff44 of type vlan for network 89e8de90-a18a-43c7-9ef0-8220654a3666 Dec 09 21:58:58.068161 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f610ec6a-7761-4d54-ab95-3b5dca5f2b90 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:58.096185 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f610ec6a-7761-4d54-ab95-3b5dca5f2b90 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:58.097423 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f610ec6a-7761-4d54-ab95-3b5dca5f2b90 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:58.098120 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f610ec6a-7761-4d54-ab95-3b5dca5f2b90 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:58.132262 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f610ec6a-7761-4d54-ab95-3b5dca5f2b90 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.3181627 Dec 09 21:58:58.135095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56452) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:58:58.143402 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-cba09170-489a-4b84-9b8b-9114c20f0b8c admin admin] Request body: {'subnet': {'network_id': '89e8de90-a18a-43c7-9ef0-8220654a3666', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBackupRestore-929229115-subnet', 'tenant_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:58:58.165537 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f610ec6a-7761-4d54-ab95-3b5dca5f2b90 admin admin] Pushing event updated for resources: {'Network': ['ID=89e8de90-a18a-43c7-9ef0-8220654a3666,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:58.175851 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cba09170-489a-4b84-9b8b-9114c20f0b8c admin admin] Made reservation on behalf of 4fd5bf27e9dc4615b74a0e66b330b7a2 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 21:58:58.177031 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 89e8de90-a18a-43c7-9ef0-8220654a3666 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 21:58:58.179530 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cba09170-489a-4b84-9b8b-9114c20f0b8c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:58.371738 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cba09170-489a-4b84-9b8b-9114c20f0b8c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:58.440750 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cba09170-489a-4b84-9b8b-9114c20f0b8c admin admin] Pushing event updated for resources: {'Subnet': ['ID=53871afb-219b-4853-8669-d625f98b4a10,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:58.452148 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cba09170-489a-4b84-9b8b-9114c20f0b8c admin admin] Checking segment: {'id': '62b79127-8016-490f-b1dd-c0016e8eff44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '89e8de90-a18a-43c7-9ef0-8220654a3666'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:58:58.452491 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cba09170-489a-4b84-9b8b-9114c20f0b8c admin admin] Network hostable DHCP agents. Network: 89e8de90-a18a-43c7-9ef0-8220654a3666, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 21:58:58.478616 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cba09170-489a-4b84-9b8b-9114c20f0b8c admin admin] Network 89e8de90-a18a-43c7-9ef0-8220654a3666 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 21:58:58.490748 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-cba09170-489a-4b84-9b8b-9114c20f0b8c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 89e8de90-a18a-43c7-9ef0-8220654a3666) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:58:58.496774 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cba09170-489a-4b84-9b8b-9114c20f0b8c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:58:58.498372 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cba09170-489a-4b84-9b8b-9114c20f0b8c admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:58.502046 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da9f0655-6a94-4cab-8e67-3793ba8be15a None None] Network 89e8de90-a18a-43c7-9ef0-8220654a3666 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:58:58.521652 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cba09170-489a-4b84-9b8b-9114c20f0b8c admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.3834350 Dec 09 21:58:58.524124 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56454) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:58:58.528628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-bf954786-1ae6-4de0-8530-c0c2b32d8083 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBackupRestore-929229115-router', 'tenant_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 21:58:58.550286 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf954786-1ae6-4de0-8530-c0c2b32d8083 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:58.551416 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf954786-1ae6-4de0-8530-c0c2b32d8083 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:58.609506 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf954786-1ae6-4de0-8530-c0c2b32d8083 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:58.621594 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-118c6684-6b4b-4bd5-b511-e03879d1b369 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-89e8de90-a18a-43c7-9ef0-8220654a3666', 'network_id': '89e8de90-a18a-43c7-9ef0-8220654a3666', 'project_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'fixed_ips': [{'subnet_id': '53871afb-219b-4853-8669-d625f98b4a10'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 21:58:58.622569 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-118c6684-6b4b-4bd5-b511-e03879d1b369 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:58.764696 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf954786-1ae6-4de0-8530-c0c2b32d8083 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:58.767284 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-118c6684-6b4b-4bd5-b511-e03879d1b369 None None] Allocated IP 172.20.0.2 (89e8de90-a18a-43c7-9ef0-8220654a3666/53871afb-219b-4853-8669-d625f98b4a10/f8c42185-cce2-4d11-8132-809bd1768950) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:58:58.926440 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-118c6684-6b4b-4bd5-b511-e03879d1b369 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:58.933823 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-118c6684-6b4b-4bd5-b511-e03879d1b369 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:58.976561 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-118c6684-6b4b-4bd5-b511-e03879d1b369 None None] Network 89e8de90-a18a-43c7-9ef0-8220654a3666 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:58:58.979758 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-118c6684-6b4b-4bd5-b511-e03879d1b369 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:58:58.986310 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-118c6684-6b4b-4bd5-b511-e03879d1b369 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:58:58.993742 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-118c6684-6b4b-4bd5-b511-e03879d1b369 None None] Pushing event updated for resources: {'Port': ['ID=f8c42185-cce2-4d11-8132-809bd1768950,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:59.056583 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-118c6684-6b4b-4bd5-b511-e03879d1b369 None None] Attempting to bind port f8c42185-cce2-4d11-8132-809bd1768950 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:58:59.057414 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-118c6684-6b4b-4bd5-b511-e03879d1b369 None None] Attempting to bind port f8c42185-cce2-4d11-8132-809bd1768950 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '62b79127-8016-490f-b1dd-c0016e8eff44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '89e8de90-a18a-43c7-9ef0-8220654a3666'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:58:59.058123 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-118c6684-6b4b-4bd5-b511-e03879d1b369 None None] Attempting to bind port f8c42185-cce2-4d11-8132-809bd1768950 on network 89e8de90-a18a-43c7-9ef0-8220654a3666 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:58:59.065429 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-118c6684-6b4b-4bd5-b511-e03879d1b369 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 58, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:58:59.065875 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-118c6684-6b4b-4bd5-b511-e03879d1b369 None None] Checking segment: {'id': '62b79127-8016-490f-b1dd-c0016e8eff44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '89e8de90-a18a-43c7-9ef0-8220654a3666'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:58:59.066309 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-118c6684-6b4b-4bd5-b511-e03879d1b369 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:59.066844 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-118c6684-6b4b-4bd5-b511-e03879d1b369 None None] Bound using segment: {'id': '62b79127-8016-490f-b1dd-c0016e8eff44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '89e8de90-a18a-43c7-9ef0-8220654a3666'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:58:59.067587 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-118c6684-6b4b-4bd5-b511-e03879d1b369 None None] Bound port: f8c42185-cce2-4d11-8132-809bd1768950, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '62b79127-8016-490f-b1dd-c0016e8eff44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '89e8de90-a18a-43c7-9ef0-8220654a3666'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:58:59.068111 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-118c6684-6b4b-4bd5-b511-e03879d1b369 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:59.146053 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-118c6684-6b4b-4bd5-b511-e03879d1b369 None None] For port f8c42185-cce2-4d11-8132-809bd1768950, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:58:59.149678 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-118c6684-6b4b-4bd5-b511-e03879d1b369 None None] For port f8c42185-cce2-4d11-8132-809bd1768950, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f8c42185-cce2-4d11-8132-809bd1768950,segment=NetworkSegment(62b79127-8016-490f-b1dd-c0016e8eff44),segment_id=62b79127-8016-490f-b1dd-c0016e8eff44)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:58:59.154691 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-118c6684-6b4b-4bd5-b511-e03879d1b369 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:59.220721 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-118c6684-6b4b-4bd5-b511-e03879d1b369 None None] Pushing event updated for resources: {'Port': ['ID=f8c42185-cce2-4d11-8132-809bd1768950,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:59.346907 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d48358d4-545a-4282-816d-a3f37022551e up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:58:59.409876 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf954786-1ae6-4de0-8530-c0c2b32d8083 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:59.427506 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port d48358d4-545a-4282-816d-a3f37022551e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:58:59.427900 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:59.434982 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf954786-1ae6-4de0-8530-c0c2b32d8083 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:59.551802 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-bf954786-1ae6-4de0-8530-c0c2b32d8083 admin admin] Allocated IP 172.25.3.79 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/c64af06f-73c3-4030-857c-512cbfe1631e) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:58:59.660470 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf954786-1ae6-4de0-8530-c0c2b32d8083 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:59.698533 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf954786-1ae6-4de0-8530-c0c2b32d8083 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:59.742429 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf954786-1ae6-4de0-8530-c0c2b32d8083 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:58:59.745889 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-bf954786-1ae6-4de0-8530-c0c2b32d8083 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:58:59.749295 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf954786-1ae6-4de0-8530-c0c2b32d8083 admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:58:59.764045 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf2a5a5c-ee43-4145-b5e8-543073e3a346 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:58:59.775331 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf954786-1ae6-4de0-8530-c0c2b32d8083 admin admin] Pushing event updated for resources: {'Port': ['ID=c64af06f-73c3-4030-857c-512cbfe1631e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:58:59.830019 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-982928fa-7852-4ae0-9667-b2632453194a None None] Provisioning complete for port c64af06f-73c3-4030-857c-512cbfe1631e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:58:59.830512 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-982928fa-7852-4ae0-9667-b2632453194a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:58:59.863893 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-982928fa-7852-4ae0-9667-b2632453194a None None] Port c64af06f-73c3-4030-857c-512cbfe1631e cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:58:59.946264 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] Sync routers for ids ['0d60ac0a-7a8a-48a2-be00-905446e6480e'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:58:59.956879 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] Routers {'0d60ac0a-7a8a-48a2-be00-905446e6480e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:58:59.957496 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:58:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['0d60ac0a-7a8a-48a2-be00-905446e6480e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:59:00.010417 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf954786-1ae6-4de0-8530-c0c2b32d8083 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:00.065577 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] Set router 0d60ac0a-7a8a-48a2-be00-905446e6480e gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:59:00.224856 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf954786-1ae6-4de0-8530-c0c2b32d8083 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:00.270144 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'name': 'tempest-TestVolumeBackupRestore-1315296361-router', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111'}], 'enable_snat': True}, 'gw_port_id': 'd48358d4-545a-4282-816d-a3f37022551e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:56Z', 'revision_number': 4, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'gw_port': {'id': 'd48358d4-545a-4282-816d-a3f37022551e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:41:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4003, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '565414b3-feaa-4ac4-9283-5a140e9e8de2', 'name': '', 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'mac_address': 'fa:16:3e:bf:e6:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_interface', 'standard_attr_id': 4004, 'fixed_ips': [{'subnet_id': '99243393-13ed-459f-904c-d6635896912a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:56Z', 'updated_at': '2021-12-09T21:58:56Z', 'revision_number': 2, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'subnets': [{'id': '99243393-13ed-459f-904c-d6635896912a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:59:00.300840 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] Checking router: 0d60ac0a-7a8a-48a2-be00-905446e6480e for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:59:00.301198 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] Updating router 0d60ac0a-7a8a-48a2-be00-905446e6480e port 565414b3-feaa-4ac4-9283-5a140e9e8de2 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:59:00.328506 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:00.368779 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bf954786-1ae6-4de0-8530-c0c2b32d8083 admin admin] Router fa62ad77-eb7a-463b-820a-5cf17642dec6 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 21:59:00.483692 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bf954786-1ae6-4de0-8530-c0c2b32d8083 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:59:00.495856 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] Sync routers for ids ['fa62ad77-eb7a-463b-820a-5cf17642dec6'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:59:00.507674 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bf954786-1ae6-4de0-8530-c0c2b32d8083 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:00.509169 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bf954786-1ae6-4de0-8530-c0c2b32d8083 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 1.9840305 Dec 09 21:59:00.511870 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 56456) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 21:59:00.512123 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] Routers {'fa62ad77-eb7a-463b-820a-5cf17642dec6'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:59:00.512861 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:58:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['fa62ad77-eb7a-463b-820a-5cf17642dec6'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:59:00.609812 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a959319f-c9c5-45a2-bc85-54107d7ea4e0 None None] Network 89e8de90-a18a-43c7-9ef0-8220654a3666 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 21:59:00.618774 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:00.627083 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:00.679005 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3481f9fe-f478-484e-8b9c-3fb868e6c796 None None] Pushing event updated for resources: {'Port': ['ID=565414b3-feaa-4ac4-9283-5a140e9e8de2,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:59:00.708417 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3481f9fe-f478-484e-8b9c-3fb868e6c796 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:59:00.708895 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3481f9fe-f478-484e-8b9c-3fb868e6c796 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:59:00.709596 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3481f9fe-f478-484e-8b9c-3fb868e6c796 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:59:00.710164 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3481f9fe-f478-484e-8b9c-3fb868e6c796 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:59:00.710711 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3481f9fe-f478-484e-8b9c-3fb868e6c796 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:59:00.711295 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3481f9fe-f478-484e-8b9c-3fb868e6c796 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:59:00.711875 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3481f9fe-f478-484e-8b9c-3fb868e6c796 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:59:00.712416 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3481f9fe-f478-484e-8b9c-3fb868e6c796 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:59:00.712953 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3481f9fe-f478-484e-8b9c-3fb868e6c796 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:59:00.713491 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3481f9fe-f478-484e-8b9c-3fb868e6c796 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:59:00.714025 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3481f9fe-f478-484e-8b9c-3fb868e6c796 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:59:00.714580 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3481f9fe-f478-484e-8b9c-3fb868e6c796 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:59:00.715112 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3481f9fe-f478-484e-8b9c-3fb868e6c796 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 21:59:00.762091 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] Attempting to bind port 565414b3-feaa-4ac4-9283-5a140e9e8de2 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:59:00.762606 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] Attempting to bind port 565414b3-feaa-4ac4-9283-5a140e9e8de2 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '51312a71-17d4-413a-8049-8ec25b223e8b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:59:00.763192 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] Attempting to bind port 565414b3-feaa-4ac4-9283-5a140e9e8de2 on network 7d2b997d-488a-4244-8788-25a6953a7b67 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:59:00.769150 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 58, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:59:00.769936 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] Checking segment: {'id': '51312a71-17d4-413a-8049-8ec25b223e8b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:59:00.770952 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:00.771550 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] Bound using segment: {'id': '51312a71-17d4-413a-8049-8ec25b223e8b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:59:00.772227 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] Bound port: 565414b3-feaa-4ac4-9283-5a140e9e8de2, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '51312a71-17d4-413a-8049-8ec25b223e8b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:59:00.772793 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:00.853705 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] Set router fa62ad77-eb7a-463b-820a-5cf17642dec6 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:59:00.867939 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] For port 565414b3-feaa-4ac4-9283-5a140e9e8de2, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:59:00.874110 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] For port 565414b3-feaa-4ac4-9283-5a140e9e8de2, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=565414b3-feaa-4ac4-9283-5a140e9e8de2,segment=NetworkSegment(51312a71-17d4-413a-8049-8ec25b223e8b),segment_id=51312a71-17d4-413a-8049-8ec25b223e8b)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:59:00.881836 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:00.944644 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3481f9fe-f478-484e-8b9c-3fb868e6c796 None None] Pushing event updated for resources: {'Port': ['ID=565414b3-feaa-4ac4-9283-5a140e9e8de2,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:59:00.970399 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] Routers {'0d60ac0a-7a8a-48a2-be00-905446e6480e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:59:00.971288 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:58:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['0d60ac0a-7a8a-48a2-be00-905446e6480e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:59:00.984470 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2d0ef273-f475-4ec2-a1aa-055e2cf45efb None None] Provisioning complete for port f8c42185-cce2-4d11-8132-809bd1768950 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:59:00.984826 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2d0ef273-f475-4ec2-a1aa-055e2cf45efb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:01.040180 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-411cb6f8-c4d2-4ce9-942a-eac21c67d1ed admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:01.191796 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2d0ef273-f475-4ec2-a1aa-055e2cf45efb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:01.222079 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] Set router 0d60ac0a-7a8a-48a2-be00-905446e6480e gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:59:01.272919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa62ad77-eb7a-463b-820a-5cf17642dec6', 'name': 'tempest-TestVolumeBackupRestore-929229115-router', 'tenant_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.79'}], 'enable_snat': True}, 'gw_port_id': 'c64af06f-73c3-4030-857c-512cbfe1631e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:58Z', 'updated_at': '2021-12-09T21:58:59Z', 'revision_number': 3, 'project_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'gw_port': {'id': 'c64af06f-73c3-4030-857c-512cbfe1631e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:db:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa62ad77-eb7a-463b-820a-5cf17642dec6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4015, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.79', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:59Z', 'updated_at': '2021-12-09T21:58:59Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:59:01.282843 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2d0ef273-f475-4ec2-a1aa-055e2cf45efb None None] For port f8c42185-cce2-4d11-8132-809bd1768950, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f8c42185-cce2-4d11-8132-809bd1768950,segment=NetworkSegment(62b79127-8016-490f-b1dd-c0016e8eff44),segment_id=62b79127-8016-490f-b1dd-c0016e8eff44)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:59:01.326301 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-411cb6f8-c4d2-4ce9-942a-eac21c67d1ed admin admin] Allocated IP 172.20.0.1 (89e8de90-a18a-43c7-9ef0-8220654a3666/53871afb-219b-4853-8669-d625f98b4a10/6576f85b-e71d-4fbc-b002-a724de69ef07) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 21:59:01.336699 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] Checking router: fa62ad77-eb7a-463b-820a-5cf17642dec6 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:59:01.337229 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] Updating router fa62ad77-eb7a-463b-820a-5cf17642dec6 port c64af06f-73c3-4030-857c-512cbfe1631e binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:59:01.339368 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2d0ef273-f475-4ec2-a1aa-055e2cf45efb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:01.446503 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:01.492988 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-411cb6f8-c4d2-4ce9-942a-eac21c67d1ed admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:01.547330 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-411cb6f8-c4d2-4ce9-942a-eac21c67d1ed admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:01.573690 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'name': 'tempest-TestVolumeBackupRestore-1315296361-router', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111'}], 'enable_snat': True}, 'gw_port_id': 'd48358d4-545a-4282-816d-a3f37022551e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:56Z', 'revision_number': 4, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'gw_port': {'id': 'd48358d4-545a-4282-816d-a3f37022551e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:41:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4003, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '565414b3-feaa-4ac4-9283-5a140e9e8de2', 'name': '', 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'mac_address': 'fa:16:3e:bf:e6:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_interface', 'standard_attr_id': 4004, 'fixed_ips': [{'subnet_id': '99243393-13ed-459f-904c-d6635896912a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:56Z', 'updated_at': '2021-12-09T21:59:00Z', 'revision_number': 4, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'subnets': [{'id': '99243393-13ed-459f-904c-d6635896912a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:59:01.582348 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f8c42185-cce2-4d11-8132-809bd1768950 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:59:01.585137 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-411cb6f8-c4d2-4ce9-942a-eac21c67d1ed admin admin] Network 89e8de90-a18a-43c7-9ef0-8220654a3666 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:59:01.588706 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-411cb6f8-c4d2-4ce9-942a-eac21c67d1ed admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:59:01.594272 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-411cb6f8-c4d2-4ce9-942a-eac21c67d1ed admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 21:59:01.607717 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2905f8b5-e77d-4ef6-8dce-6f02246008a7 None None] The sync data for ids ['0d60ac0a-7a8a-48a2-be00-905446e6480e'] in n-d-713301-27 is: [{'id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'name': 'tempest-TestVolumeBackupRestore-1315296361-router', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111'}], 'enable_snat': True}, 'gw_port_id': 'd48358d4-545a-4282-816d-a3f37022551e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:56Z', 'revision_number': 4, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'gw_port': {'id': 'd48358d4-545a-4282-816d-a3f37022551e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:41:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4003, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '565414b3-feaa-4ac4-9283-5a140e9e8de2', 'name': '', 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'mac_address': 'fa:16:3e:bf:e6:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_interface', 'standard_attr_id': 4004, 'fixed_ips': [{'subnet_id': '99243393-13ed-459f-904c-d6635896912a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:56Z', 'updated_at': '2021-12-09T21:59:00Z', 'revision_number': 4, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'subnets': [{'id': '99243393-13ed-459f-904c-d6635896912a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:59:01.622998 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-19474c88-126f-43bc-8f53-68f922e4dff2 None None] Provisioning complete for port 565414b3-feaa-4ac4-9283-5a140e9e8de2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:59:01.623622 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-19474c88-126f-43bc-8f53-68f922e4dff2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:01.639883 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-411cb6f8-c4d2-4ce9-942a-eac21c67d1ed admin admin] Pushing event updated for resources: {'Port': ['ID=6576f85b-e71d-4fbc-b002-a724de69ef07,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:59:01.658234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d0ef273-f475-4ec2-a1aa-055e2cf45efb None None] Pushing event updated for resources: {'Port': ['ID=f8c42185-cce2-4d11-8132-809bd1768950,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:59:01.658476 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-411cb6f8-c4d2-4ce9-942a-eac21c67d1ed admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:01.826894 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-19474c88-126f-43bc-8f53-68f922e4dff2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:01.830352 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-411cb6f8-c4d2-4ce9-942a-eac21c67d1ed admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:01.842659 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f8c42185-cce2-4d11-8132-809bd1768950 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:59:01.842810 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:01.944932 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-19474c88-126f-43bc-8f53-68f922e4dff2 None None] For port 565414b3-feaa-4ac4-9283-5a140e9e8de2, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=565414b3-feaa-4ac4-9283-5a140e9e8de2,segment=NetworkSegment(51312a71-17d4-413a-8049-8ec25b223e8b),segment_id=51312a71-17d4-413a-8049-8ec25b223e8b)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:59:01.960955 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-19474c88-126f-43bc-8f53-68f922e4dff2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:02.016058 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-411cb6f8-c4d2-4ce9-942a-eac21c67d1ed admin admin] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:02.022700 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-411cb6f8-c4d2-4ce9-942a-eac21c67d1ed admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:02.088499 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-411cb6f8-c4d2-4ce9-942a-eac21c67d1ed admin admin] Pushing event updated for resources: {'Port': ['ID=6576f85b-e71d-4fbc-b002-a724de69ef07,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:59:02.091024 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-411cb6f8-c4d2-4ce9-942a-eac21c67d1ed admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:02.106330 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19474c88-126f-43bc-8f53-68f922e4dff2 None None] Pushing event updated for resources: {'Port': ['ID=565414b3-feaa-4ac4-9283-5a140e9e8de2,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:59:02.122075 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 565414b3-feaa-4ac4-9283-5a140e9e8de2 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:59:02.129986 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:02.153974 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-99c7ac4b-403e-40d4-9041-ad6ba600583c None None] Provisioning complete for port 6576f85b-e71d-4fbc-b002-a724de69ef07 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:59:02.154375 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-99c7ac4b-403e-40d4-9041-ad6ba600583c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:02.177748 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:02.188941 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-411cb6f8-c4d2-4ce9-942a-eac21c67d1ed admin admin] Network 89e8de90-a18a-43c7-9ef0-8220654a3666 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 21:59:02.191012 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-411cb6f8-c4d2-4ce9-942a-eac21c67d1ed admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 21:59:02.239541 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0c8fae17-4580-45ad-9f40-d010718213ec None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:59:02.258408 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-99c7ac4b-403e-40d4-9041-ad6ba600583c None None] Port 6576f85b-e71d-4fbc-b002-a724de69ef07 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:59:02.266341 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa30fe63-1938-4295-aeb8-0ef1167f4eb6 None None] Pushing event updated for resources: {'Port': ['ID=c64af06f-73c3-4030-857c-512cbfe1631e,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:59:02.281228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] Attempting to bind port c64af06f-73c3-4030-857c-512cbfe1631e on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:59:02.281609 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] Attempting to bind port c64af06f-73c3-4030-857c-512cbfe1631e by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:59:02.281965 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] Attempting to bind port c64af06f-73c3-4030-857c-512cbfe1631e on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:59:02.303384 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 58, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:59:02.303797 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:59:02.304198 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:02.304583 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:59:02.305066 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] Bound port: c64af06f-73c3-4030-857c-512cbfe1631e, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:59:02.305444 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:02.334530 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 565414b3-feaa-4ac4-9283-5a140e9e8de2 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:59:02.334885 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:02.336770 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-411cb6f8-c4d2-4ce9-942a-eac21c67d1ed admin admin] Router fa62ad77-eb7a-463b-820a-5cf17642dec6 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 21:59:02.338136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-99c7ac4b-403e-40d4-9041-ad6ba600583c None None] Provisioning complete for port f8c42185-cce2-4d11-8132-809bd1768950 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:59:02.338485 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-99c7ac4b-403e-40d4-9041-ad6ba600583c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:02.422052 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] For port c64af06f-73c3-4030-857c-512cbfe1631e, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:59:02.428682 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] For port c64af06f-73c3-4030-857c-512cbfe1631e, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c64af06f-73c3-4030-857c-512cbfe1631e,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:59:02.442808 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:02.474941 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-411cb6f8-c4d2-4ce9-942a-eac21c67d1ed admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 21:59:02.490082 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-411cb6f8-c4d2-4ce9-942a-eac21c67d1ed admin admin] 10.222.0.13 "PUT /v2.0/routers/fa62ad77-eb7a-463b-820a-5cf17642dec6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9706733 Dec 09 21:59:02.511975 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6ac42b8-7792-4ab4-b15e-347bcc13384a None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 21:59:02.579800 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] Routers {'fa62ad77-eb7a-463b-820a-5cf17642dec6'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:59:02.580432 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:58:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['fa62ad77-eb7a-463b-820a-5cf17642dec6'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:59:02.620780 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa30fe63-1938-4295-aeb8-0ef1167f4eb6 None None] Pushing event updated for resources: {'Port': ['ID=c64af06f-73c3-4030-857c-512cbfe1631e,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:59:02.700991 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] Set router fa62ad77-eb7a-463b-820a-5cf17642dec6 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:59:02.798000 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-810c17c4-7def-46c6-99a5-c88fe77acd2a None None] Provisioning complete for port 6576f85b-e71d-4fbc-b002-a724de69ef07 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:59:02.798361 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-810c17c4-7def-46c6-99a5-c88fe77acd2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:02.872054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-810c17c4-7def-46c6-99a5-c88fe77acd2a None None] Port 6576f85b-e71d-4fbc-b002-a724de69ef07 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 21:59:02.918760 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-810c17c4-7def-46c6-99a5-c88fe77acd2a None None] Provisioning complete for port c64af06f-73c3-4030-857c-512cbfe1631e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:59:02.919128 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-810c17c4-7def-46c6-99a5-c88fe77acd2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:02.985818 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8457b20f-c2a1-496f-bfed-d3abd0a96574 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:02.996610 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa62ad77-eb7a-463b-820a-5cf17642dec6', 'name': 'tempest-TestVolumeBackupRestore-929229115-router', 'tenant_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.79'}], 'enable_snat': True}, 'gw_port_id': 'c64af06f-73c3-4030-857c-512cbfe1631e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:58Z', 'updated_at': '2021-12-09T21:59:01Z', 'revision_number': 4, 'project_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'gw_port': {'id': 'c64af06f-73c3-4030-857c-512cbfe1631e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:db:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa62ad77-eb7a-463b-820a-5cf17642dec6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4015, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.79', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:59Z', 'updated_at': '2021-12-09T21:59:02Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '6576f85b-e71d-4fbc-b002-a724de69ef07', 'name': '', 'network_id': '89e8de90-a18a-43c7-9ef0-8220654a3666', 'tenant_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'mac_address': 'fa:16:3e:67:cf:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa62ad77-eb7a-463b-820a-5cf17642dec6', 'device_owner': 'network:router_interface', 'standard_attr_id': 4016, 'fixed_ips': [{'subnet_id': '53871afb-219b-4853-8669-d625f98b4a10', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:59:01Z', 'updated_at': '2021-12-09T21:59:01Z', 'revision_number': 2, 'project_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'subnets': [{'id': '53871afb-219b-4853-8669-d625f98b4a10', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:59:03.046718 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb19d413-6dd6-49f4-8b65-f2d1a6d332f1 None None] The sync data for ids ['fa62ad77-eb7a-463b-820a-5cf17642dec6'] in n-d-713301-27 is: [{'id': 'fa62ad77-eb7a-463b-820a-5cf17642dec6', 'name': 'tempest-TestVolumeBackupRestore-929229115-router', 'tenant_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.79'}], 'enable_snat': True}, 'gw_port_id': 'c64af06f-73c3-4030-857c-512cbfe1631e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:58Z', 'updated_at': '2021-12-09T21:59:01Z', 'revision_number': 4, 'project_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'gw_port': {'id': 'c64af06f-73c3-4030-857c-512cbfe1631e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:db:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa62ad77-eb7a-463b-820a-5cf17642dec6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4015, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.79', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:59Z', 'updated_at': '2021-12-09T21:59:02Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '6576f85b-e71d-4fbc-b002-a724de69ef07', 'name': '', 'network_id': '89e8de90-a18a-43c7-9ef0-8220654a3666', 'tenant_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'mac_address': 'fa:16:3e:67:cf:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa62ad77-eb7a-463b-820a-5cf17642dec6', 'device_owner': 'network:router_interface', 'standard_attr_id': 4016, 'fixed_ips': [{'subnet_id': '53871afb-219b-4853-8669-d625f98b4a10', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:59:01Z', 'updated_at': '2021-12-09T21:59:01Z', 'revision_number': 2, 'project_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'subnets': [{'id': '53871afb-219b-4853-8669-d625f98b4a10', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:59:03.061803 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-810c17c4-7def-46c6-99a5-c88fe77acd2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:03.087872 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-810c17c4-7def-46c6-99a5-c88fe77acd2a None None] For port c64af06f-73c3-4030-857c-512cbfe1631e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c64af06f-73c3-4030-857c-512cbfe1631e,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:59:03.093435 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-810c17c4-7def-46c6-99a5-c88fe77acd2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:03.355778 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-810c17c4-7def-46c6-99a5-c88fe77acd2a None None] Pushing event updated for resources: {'Port': ['ID=c64af06f-73c3-4030-857c-512cbfe1631e,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:59:03.412288 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f8c42185-cce2-4d11-8132-809bd1768950 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:59:03.463532 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f8c42185-cce2-4d11-8132-809bd1768950 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:59:03.463941 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:03.560948 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 565414b3-feaa-4ac4-9283-5a140e9e8de2 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:59:03.610124 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 565414b3-feaa-4ac4-9283-5a140e9e8de2 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:59:03.610535 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:05.334305 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c64af06f-73c3-4030-857c-512cbfe1631e up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:59:05.397592 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port c64af06f-73c3-4030-857c-512cbfe1631e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:59:05.398597 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:05.590091 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-53d7612c-2903-49d1-a42b-882d8e85dc91 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:05.981935 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c106020e-3c54-4427-a388-5757677bffdf None None] Sync routers for ids ['fa62ad77-eb7a-463b-820a-5cf17642dec6'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 21:59:05.993026 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c106020e-3c54-4427-a388-5757677bffdf None None] Routers {'fa62ad77-eb7a-463b-820a-5cf17642dec6'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:59:05.993558 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c106020e-3c54-4427-a388-5757677bffdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:59:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['fa62ad77-eb7a-463b-820a-5cf17642dec6'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:59:06.107188 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-c106020e-3c54-4427-a388-5757677bffdf None None] Set router fa62ad77-eb7a-463b-820a-5cf17642dec6 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:59:06.347649 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c106020e-3c54-4427-a388-5757677bffdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa62ad77-eb7a-463b-820a-5cf17642dec6', 'name': 'tempest-TestVolumeBackupRestore-929229115-router', 'tenant_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.79'}], 'enable_snat': True}, 'gw_port_id': 'c64af06f-73c3-4030-857c-512cbfe1631e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:58Z', 'updated_at': '2021-12-09T21:59:01Z', 'revision_number': 4, 'project_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'gw_port': {'id': 'c64af06f-73c3-4030-857c-512cbfe1631e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:db:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa62ad77-eb7a-463b-820a-5cf17642dec6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4015, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.79', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:59Z', 'updated_at': '2021-12-09T21:59:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '6576f85b-e71d-4fbc-b002-a724de69ef07', 'name': '', 'network_id': '89e8de90-a18a-43c7-9ef0-8220654a3666', 'tenant_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'mac_address': 'fa:16:3e:67:cf:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa62ad77-eb7a-463b-820a-5cf17642dec6', 'device_owner': 'network:router_interface', 'standard_attr_id': 4016, 'fixed_ips': [{'subnet_id': '53871afb-219b-4853-8669-d625f98b4a10', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:59:01Z', 'updated_at': '2021-12-09T21:59:01Z', 'revision_number': 2, 'project_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'subnets': [{'id': '53871afb-219b-4853-8669-d625f98b4a10', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:59:06.384702 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c106020e-3c54-4427-a388-5757677bffdf None None] Checking router: fa62ad77-eb7a-463b-820a-5cf17642dec6 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 21:59:06.385100 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c106020e-3c54-4427-a388-5757677bffdf None None] Updating router fa62ad77-eb7a-463b-820a-5cf17642dec6 port 6576f85b-e71d-4fbc-b002-a724de69ef07 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 21:59:06.424886 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-c106020e-3c54-4427-a388-5757677bffdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:06.710626 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-c106020e-3c54-4427-a388-5757677bffdf None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:06.716669 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-c106020e-3c54-4427-a388-5757677bffdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:06.720845 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:06.768963 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e56b09c4-91a7-49f2-82e0-cb9a321588a4 None None] Pushing event updated for resources: {'Port': ['ID=6576f85b-e71d-4fbc-b002-a724de69ef07,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:59:06.829134 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-c106020e-3c54-4427-a388-5757677bffdf None None] Attempting to bind port 6576f85b-e71d-4fbc-b002-a724de69ef07 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 21:59:06.829705 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-c106020e-3c54-4427-a388-5757677bffdf None None] Attempting to bind port 6576f85b-e71d-4fbc-b002-a724de69ef07 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '62b79127-8016-490f-b1dd-c0016e8eff44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '89e8de90-a18a-43c7-9ef0-8220654a3666'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 21:59:06.830258 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c106020e-3c54-4427-a388-5757677bffdf None None] Attempting to bind port 6576f85b-e71d-4fbc-b002-a724de69ef07 on network 89e8de90-a18a-43c7-9ef0-8220654a3666 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 21:59:06.836749 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c106020e-3c54-4427-a388-5757677bffdf None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 21, 58, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 21:59:06.837207 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c106020e-3c54-4427-a388-5757677bffdf None None] Checking segment: {'id': '62b79127-8016-490f-b1dd-c0016e8eff44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '89e8de90-a18a-43c7-9ef0-8220654a3666'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 21:59:06.837855 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-c106020e-3c54-4427-a388-5757677bffdf None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:06.838494 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c106020e-3c54-4427-a388-5757677bffdf None None] Bound using segment: {'id': '62b79127-8016-490f-b1dd-c0016e8eff44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '89e8de90-a18a-43c7-9ef0-8220654a3666'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 21:59:06.838976 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-c106020e-3c54-4427-a388-5757677bffdf None None] Bound port: 6576f85b-e71d-4fbc-b002-a724de69ef07, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '62b79127-8016-490f-b1dd-c0016e8eff44', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '89e8de90-a18a-43c7-9ef0-8220654a3666'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 21:59:06.839395 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-c106020e-3c54-4427-a388-5757677bffdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:06.920916 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-c106020e-3c54-4427-a388-5757677bffdf None None] For port 6576f85b-e71d-4fbc-b002-a724de69ef07, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 21:59:06.925874 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-c106020e-3c54-4427-a388-5757677bffdf None None] For port 6576f85b-e71d-4fbc-b002-a724de69ef07, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6576f85b-e71d-4fbc-b002-a724de69ef07,segment=NetworkSegment(62b79127-8016-490f-b1dd-c0016e8eff44),segment_id=62b79127-8016-490f-b1dd-c0016e8eff44)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 21:59:06.931741 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-c106020e-3c54-4427-a388-5757677bffdf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:06.980702 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c106020e-3c54-4427-a388-5757677bffdf None None] Routers {'fa62ad77-eb7a-463b-820a-5cf17642dec6'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 21:59:06.981508 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c106020e-3c54-4427-a388-5757677bffdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T21:59:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['fa62ad77-eb7a-463b-820a-5cf17642dec6'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:59:07.056277 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e56b09c4-91a7-49f2-82e0-cb9a321588a4 None None] Pushing event updated for resources: {'Port': ['ID=6576f85b-e71d-4fbc-b002-a724de69ef07,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:59:07.066069 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b85da089-11e8-4aff-abea-c1e698cdd2fc None None] Provisioning complete for port 6576f85b-e71d-4fbc-b002-a724de69ef07 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:59:07.066472 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b85da089-11e8-4aff-abea-c1e698cdd2fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:07.157194 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-c106020e-3c54-4427-a388-5757677bffdf None None] Set router fa62ad77-eb7a-463b-820a-5cf17642dec6 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 21:59:07.214852 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b85da089-11e8-4aff-abea-c1e698cdd2fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:07.278127 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-b85da089-11e8-4aff-abea-c1e698cdd2fc None None] For port 6576f85b-e71d-4fbc-b002-a724de69ef07, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6576f85b-e71d-4fbc-b002-a724de69ef07,segment=NetworkSegment(62b79127-8016-490f-b1dd-c0016e8eff44),segment_id=62b79127-8016-490f-b1dd-c0016e8eff44)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 21:59:07.285542 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b85da089-11e8-4aff-abea-c1e698cdd2fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:07.386431 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b85da089-11e8-4aff-abea-c1e698cdd2fc None None] Pushing event updated for resources: {'Port': ['ID=6576f85b-e71d-4fbc-b002-a724de69ef07,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 21:59:07.411034 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6576f85b-e71d-4fbc-b002-a724de69ef07 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:59:07.443798 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3f36736c-a9de-4437-a2f2-ed2c08c661d2 None None] Provisioning complete for port 6576f85b-e71d-4fbc-b002-a724de69ef07 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:59:07.444171 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3f36736c-a9de-4437-a2f2-ed2c08c661d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:07.533045 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 6576f85b-e71d-4fbc-b002-a724de69ef07 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:59:07.533431 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:07.574542 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c106020e-3c54-4427-a388-5757677bffdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa62ad77-eb7a-463b-820a-5cf17642dec6', 'name': 'tempest-TestVolumeBackupRestore-929229115-router', 'tenant_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.79'}], 'enable_snat': True}, 'gw_port_id': 'c64af06f-73c3-4030-857c-512cbfe1631e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:58Z', 'updated_at': '2021-12-09T21:59:01Z', 'revision_number': 4, 'project_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'gw_port': {'id': 'c64af06f-73c3-4030-857c-512cbfe1631e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:db:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa62ad77-eb7a-463b-820a-5cf17642dec6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4015, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.79', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:59Z', 'updated_at': '2021-12-09T21:59:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '6576f85b-e71d-4fbc-b002-a724de69ef07', 'name': '', 'network_id': '89e8de90-a18a-43c7-9ef0-8220654a3666', 'tenant_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'mac_address': 'fa:16:3e:67:cf:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa62ad77-eb7a-463b-820a-5cf17642dec6', 'device_owner': 'network:router_interface', 'standard_attr_id': 4016, 'fixed_ips': [{'subnet_id': '53871afb-219b-4853-8669-d625f98b4a10', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:59:01Z', 'updated_at': '2021-12-09T21:59:06Z', 'revision_number': 4, 'project_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'subnets': [{'id': '53871afb-219b-4853-8669-d625f98b4a10', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 21:59:07.608556 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c106020e-3c54-4427-a388-5757677bffdf None None] The sync data for ids ['fa62ad77-eb7a-463b-820a-5cf17642dec6'] in n-d-713301-27 is: [{'id': 'fa62ad77-eb7a-463b-820a-5cf17642dec6', 'name': 'tempest-TestVolumeBackupRestore-929229115-router', 'tenant_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.79'}], 'enable_snat': True}, 'gw_port_id': 'c64af06f-73c3-4030-857c-512cbfe1631e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:58Z', 'updated_at': '2021-12-09T21:59:01Z', 'revision_number': 4, 'project_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'gw_port': {'id': 'c64af06f-73c3-4030-857c-512cbfe1631e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:db:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa62ad77-eb7a-463b-820a-5cf17642dec6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4015, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.79', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:59Z', 'updated_at': '2021-12-09T21:59:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '6576f85b-e71d-4fbc-b002-a724de69ef07', 'name': '', 'network_id': '89e8de90-a18a-43c7-9ef0-8220654a3666', 'tenant_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'mac_address': 'fa:16:3e:67:cf:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa62ad77-eb7a-463b-820a-5cf17642dec6', 'device_owner': 'network:router_interface', 'standard_attr_id': 4016, 'fixed_ips': [{'subnet_id': '53871afb-219b-4853-8669-d625f98b4a10', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:59:01Z', 'updated_at': '2021-12-09T21:59:06Z', 'revision_number': 4, 'project_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'subnets': [{'id': '53871afb-219b-4853-8669-d625f98b4a10', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 21:59:08.056750 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:09.322977 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6576f85b-e71d-4fbc-b002-a724de69ef07 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 21:59:09.374749 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 6576f85b-e71d-4fbc-b002-a724de69ef07 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 21:59:09.375101 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:09.661157 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:10.197677 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:59:27.430923 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:27.628800 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:32.970988 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9594c240-09fc-4098-b505-2b0f3fb539b8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:35.586497 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6df468d-e901-4261-ac15-69d4b55a2aaf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:36.723589 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:38.057731 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:38.945648 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1bdd8af2-fb9e-4ca3-99b8-2960d1119ced req-0b03cdf6-ffcb-473d-a760-5985881c2a46 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1418276 Dec 09 21:59:39.031772 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bdd8af2-fb9e-4ca3-99b8-2960d1119ced req-b0efd023-5d08-42ab-a4db-54dc1dbe1a69 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:59:39.033296 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1bdd8af2-fb9e-4ca3-99b8-2960d1119ced req-b0efd023-5d08-42ab-a4db-54dc1dbe1a69 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 1097 time: 0.0436432 Dec 09 21:59:39.145299 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bdd8af2-fb9e-4ca3-99b8-2960d1119ced req-766382f5-73ae-456b-b50e-e9c577a8c40c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:59:39.146807 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1bdd8af2-fb9e-4ca3-99b8-2960d1119ced req-766382f5-73ae-456b-b50e-e9c577a8c40c service neutron] 10.222.0.10 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 911 time: 0.0928102 Dec 09 21:59:39.217009 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1bdd8af2-fb9e-4ca3-99b8-2960d1119ced req-98ecd212-051d-4d04-9b3e-64a169a64b78 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 HTTP/1.1" status: 200 len: 1001 time: 0.0616307 Dec 09 21:59:39.270694 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bdd8af2-fb9e-4ca3-99b8-2960d1119ced req-112167e0-8971-4c09-941a-1d86dd75bdac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:59:39.272220 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1bdd8af2-fb9e-4ca3-99b8-2960d1119ced req-112167e0-8971-4c09-941a-1d86dd75bdac service neutron] 10.222.0.10 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0488987 Dec 09 21:59:39.319752 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bdd8af2-fb9e-4ca3-99b8-2960d1119ced req-19e538b3-162a-4ffa-988a-6ea94c4c1e71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 21:59:39.321260 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1bdd8af2-fb9e-4ca3-99b8-2960d1119ced req-19e538b3-162a-4ffa-988a-6ea94c4c1e71 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0410531 Dec 09 21:59:39.332560 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-1bdd8af2-fb9e-4ca3-99b8-2960d1119ced req-575eb71c-a796-4945-95ae-31ae03468c4c service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 21:59:39.333591 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1bdd8af2-fb9e-4ca3-99b8-2960d1119ced req-575eb71c-a796-4945-95ae-31ae03468c4c service neutron] 10.222.0.10 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0049629 Dec 09 21:59:39.425263 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1bdd8af2-fb9e-4ca3-99b8-2960d1119ced req-c0ff7df1-e947-427b-86c9-30fbd5dfdaf6 service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0833962 Dec 09 21:59:39.520104 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1bdd8af2-fb9e-4ca3-99b8-2960d1119ced req-71a3d932-47ce-49e8-8fd6-267c8de7dcdf service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0881851 Dec 09 21:59:39.666879 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:47.197198 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 21:59:57.422968 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 21:59:57.644263 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:02.974879 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6f6ae0ff-dab5-4f84-87b2-a6f8a44a1216 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:05.590697 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-60b7c767-56ed-476a-9506-47c1b10ee9aa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:06.725479 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:08.060641 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:09.663103 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:20.870124 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-b1e943fb-1056-44c5-9964-519f1cd22445 req-49818b34-02d8-4c8b-b89d-3f6ee93b0fb6 service neutron] (103438) timed out ('10.222.0.31', 57403) {{(pid=103438) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 09 22:00:24.196288 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:00:27.419890 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:27.640596 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:29.856429 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11654dea-0f0e-4c45-8b8e-d2c48dda2400 req-1b0a5d07-0c80-47db-a1c1-37363c88f23a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:29.857973 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11654dea-0f0e-4c45-8b8e-d2c48dda2400 req-1b0a5d07-0c80-47db-a1c1-37363c88f23a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 945 time: 0.0555665 Dec 09 22:00:29.908178 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11654dea-0f0e-4c45-8b8e-d2c48dda2400 req-e54a019d-3f2f-49f2-b504-4d5169ae62ab tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440011 Dec 09 22:00:31.067309 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ff9bf06-9773-4b65-af92-2e2206453dde req-2925ca69-eb85-4fa8-b517-c36e57b67750 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:31.068817 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ff9bf06-9773-4b65-af92-2e2206453dde req-2925ca69-eb85-4fa8-b517-c36e57b67750 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 945 time: 0.0532470 Dec 09 22:00:31.118889 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ff9bf06-9773-4b65-af92-2e2206453dde req-045da411-073b-4100-ac83-ebe59f10a03a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436468 Dec 09 22:00:31.340330 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-587af3c7-577e-438e-885c-3eaf4f01043d req-92f6dfd7-e795-4264-8bd2-eb6fe7fac846 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:31.341833 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-587af3c7-577e-438e-885c-3eaf4f01043d req-92f6dfd7-e795-4264-8bd2-eb6fe7fac846 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.10 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 945 time: 0.0511248 Dec 09 22:00:31.445265 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-587af3c7-577e-438e-885c-3eaf4f01043d req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Deleting port 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:00:31.445567 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-587af3c7-577e-438e-885c-3eaf4f01043d req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:31.539295 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-587af3c7-577e-438e-885c-3eaf4f01043d req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] For port 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:00:31.539690 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-587af3c7-577e-438e-885c-3eaf4f01043d req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:32.242927 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-587af3c7-577e-438e-885c-3eaf4f01043d req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:32.243703 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-587af3c7-577e-438e-885c-3eaf4f01043d req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:32.243703 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [req-587af3c7-577e-438e-885c-3eaf4f01043d req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Floating IP fa4716d2-6124-4a9c-b9d7-e84a2afe830c disassociated. External IP: 172.25.3.142, port: 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5. Dec 09 22:00:32.243986 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-587af3c7-577e-438e-885c-3eaf4f01043d req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Calling delete_port for 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:00:32.303761 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cade6090-77c3-4adb-b047-8eeb872947ee req-b4246df5-f582-424e-8de5-0e3ed369b7e6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:32.305170 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cade6090-77c3-4adb-b047-8eeb872947ee req-b4246df5-f582-424e-8de5-0e3ed369b7e6 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 945 time: 0.1059492 Dec 09 22:00:32.379318 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cade6090-77c3-4adb-b047-8eeb872947ee req-3074a92c-8a87-4371-a991-cac21f9cdd15 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0651464 Dec 09 22:00:32.429352 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-587af3c7-577e-438e-885c-3eaf4f01043d req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:32.457460 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event deleted for resources: {'Port': ['ID=1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:00:32.513783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:32.514127 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:32.519827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:32.519827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:32.519827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:32.519827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:32.519827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:32.519827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:32.519827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:32.519827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:32.519827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:32.519827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:32.519827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:32.587486 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [req-587af3c7-577e-438e-885c-3eaf4f01043d req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:00:32.698155 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-587af3c7-577e-438e-885c-3eaf4f01043d req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:00:32.710456 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5d65cd9-bf8d-4ef1-83db-600a1ab6ac6e None None] Sync routers for ids ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:00:32.723346 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5d65cd9-bf8d-4ef1-83db-600a1ab6ac6e None None] Routers {'52333c17-500b-4d13-8de7-f3d9c4c6eb46'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:00:32.724110 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-d5d65cd9-bf8d-4ef1-83db-600a1ab6ac6e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:00:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:00:32.749630 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-587af3c7-577e-438e-885c-3eaf4f01043d req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] No DVR routers for this DVR port 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:00:32.752642 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-587af3c7-577e-438e-885c-3eaf4f01043d req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:32.757845 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-587af3c7-577e-438e-885c-3eaf4f01043d req-da47fc5d-7a56-43df-af7d-7215ae4f834c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.10 "DELETE /v2.0/ports/1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 HTTP/1.1" status: 204 len: 173 time: 1.4095430 Dec 09 22:00:32.758672 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f458582b-068a-42d3-9612-896ab989567c', 'name': 'network-vif-deleted', 'tag': '1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:00:32.762186 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a6bbe607-592e-4758-a91f-381d5ec8006b" -d '{"events": [{"server_uuid": "f458582b-068a-42d3-9612-896ab989567c", "name": "network-vif-deleted", "tag": "1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:00:32.880416 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-d5d65cd9-bf8d-4ef1-83db-600a1ab6ac6e None None] Set router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:00:32.923136 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:00:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-93be99ce-d6dd-4abc-bffa-1ebde4a42052 x-openstack-request-id: req-93be99ce-d6dd-4abc-bffa-1ebde4a42052 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:00:32.923861 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f458582b-068a-42d3-9612-896ab989567c", "name": "network-vif-deleted", "tag": "1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:00:32.923861 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-93be99ce-d6dd-4abc-bffa-1ebde4a42052 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:00:32.924165 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f458582b-068a-42d3-9612-896ab989567c', 'name': 'network-vif-deleted', 'tag': '1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5', 'status': 'completed', 'code': 200} Dec 09 22:00:33.029645 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ba36f7cf-9d40-4187-9507-9864b0e10383 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:33.112921 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-d5d65cd9-bf8d-4ef1-83db-600a1ab6ac6e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'db7c12a5-60a7-41e6-ae5c-e42348c373b4', 'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'mac_address': 'fa:16:3e:79:8f:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_interface', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:36Z', 'updated_at': '2021-12-09T21:54:44Z', 'revision_number': 5, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'subnets': [{'id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:00:33.144794 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5d65cd9-bf8d-4ef1-83db-600a1ab6ac6e None None] Checking router: 52333c17-500b-4d13-8de7-f3d9c4c6eb46 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:00:33.153761 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5d65cd9-bf8d-4ef1-83db-600a1ab6ac6e None None] Routers {'52333c17-500b-4d13-8de7-f3d9c4c6eb46'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:00:33.154377 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-d5d65cd9-bf8d-4ef1-83db-600a1ab6ac6e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:00:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:00:33.258854 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-d5d65cd9-bf8d-4ef1-83db-600a1ab6ac6e None None] Set router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:00:33.462844 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-d5d65cd9-bf8d-4ef1-83db-600a1ab6ac6e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'db7c12a5-60a7-41e6-ae5c-e42348c373b4', 'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'mac_address': 'fa:16:3e:79:8f:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_interface', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:36Z', 'updated_at': '2021-12-09T21:54:44Z', 'revision_number': 5, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'subnets': [{'id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:00:33.481809 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf01f0a3-c14f-4976-a4f3-facd62202e47 req-de675e5c-38ee-4d1f-8598-a55fdd428b56 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 210 time: 0.0280123 Dec 09 22:00:33.489163 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5d65cd9-bf8d-4ef1-83db-600a1ab6ac6e None None] The sync data for ids ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'] in n-d-713301-27 is: [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'db7c12a5-60a7-41e6-ae5c-e42348c373b4', 'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'mac_address': 'fa:16:3e:79:8f:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_interface', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:36Z', 'updated_at': '2021-12-09T21:54:44Z', 'revision_number': 5, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'subnets': [{'id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:00:33.737503 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d24250b9-c894-4110-9b7d-43fb6c114a7e None None] New status for floating IP fa4716d2-6124-4a9c-b9d7-e84a2afe830c: DOWN {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:00:34.124821 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:00:34.145763 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:00:34.146113 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1d43a9e8-0aa4-43cf-a9f1-eb1bf35c98e5 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:00:34.596481 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9039767b-9aae-4ad4-b3d9-90db20350b4a req-304b66fb-fdfe-49ee-a541-630f24fda526 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 210 time: 0.0297408 Dec 09 22:00:35.611630 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-836d5717-c73e-41ac-b05f-49061ebf545c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:35.693776 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7fa8d1c4-efd6-420f-a1fc-8bc0c14d677d req-b7eaad69-6535-44d2-a25a-2248f9bfa5f9 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 210 time: 0.0263107 Dec 09 22:00:36.731318 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:36.793501 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f3d97b30-4c36-4e62-868f-835a4d64c37e req-b4bcec6a-dbe3-4b4a-8202-a5ded60274a4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 210 time: 0.0269334 Dec 09 22:00:37.896999 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-698b4ce0-c823-4e9c-a155-778bf9825b4c req-3c88f3c0-ed9c-4f5b-bafc-4f03e3d864e7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=f458582b-068a-42d3-9612-896ab989567c HTTP/1.1" status: 200 len: 210 time: 0.0288951 Dec 09 22:00:38.065182 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:39.129197 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-be6ae6c4-6d0b-4916-a644-b5d0f0484cc8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1956229723&fields=id&tenant_id=be526cfddc4f4783b993a3f6e5b5e630 HTTP/1.1" status: 200 len: 267 time: 0.0460408 Dec 09 22:00:39.253162 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-c27a8b17-57f2-4377-9cf3-47e8bf57126d tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:39.254592 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-c27a8b17-57f2-4377-9cf3-47e8bf57126d tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 810 time: 0.1171989 Dec 09 22:00:39.283228 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-6bfe884a-fd46-45fd-9438-5e0073c745e4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/quotas/be526cfddc4f4783b993a3f6e5b5e630 HTTP/1.1" status: 200 len: 375 time: 0.0105553 Dec 09 22:00:39.339640 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-c07833de-922b-4ada-9b5d-2f170b8366d8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0496993 Dec 09 22:00:39.410508 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-582e730e-4947-45c0-93ac-1538ef1fb886 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 22:00:39.411538 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-582e730e-4947-45c0-93ac-1538ef1fb886 service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0592604 Dec 09 22:00:39.511792 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-f36e09ac-0d2b-421c-bfd5-bd228e6d02f2 service neutron] 10.222.0.13 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0932207 Dec 09 22:00:39.602521 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-d894ac2c-6178-4007-bc8e-a341016d541f service neutron] 10.222.0.13 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0844417 Dec 09 22:00:39.666267 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:39.923424 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dd7f5f62-1736-4e15-bfd5-0c378a7dc227 req-313528eb-1657-4a62-bf7c-17f75655e609 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 210 time: 0.0278258 Dec 09 22:00:41.042957 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31945fe2-7bee-4f34-8397-153cdea2a8d7 req-a8fb5fac-bb35-4790-9a23-398e4351cc4f tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 210 time: 0.0352032 Dec 09 22:00:41.232009 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-dd62f372-0a69-4fc8-8dbc-63ec19ef55ff tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:41.233711 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-dd62f372-0a69-4fc8-8dbc-63ec19ef55ff tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.31 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 810 time: 0.1197381 Dec 09 22:00:41.301276 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-660c6e6d-bef1-48e2-a278-e9a7be70c40d tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=be526cfddc4f4783b993a3f6e5b5e630 HTTP/1.1" status: 200 len: 380 time: 0.0569096 Dec 09 22:00:41.311068 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Request body: {'port': {'device_id': '15c3e0cc-52ce-44d9-8464-2ed50a05ba15', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'admin_state_up': True, 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'security_groups': ['aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:00:41.427104 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Made reservation on behalf of be526cfddc4f4783b993a3f6e5b5e630 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:00:41.430975 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:41.568478 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Allocated IP 172.20.0.10 (486ad174-ad0c-4065-a4b6-6f9af6b2a208/7004626f-deda-4ef1-8abe-97a447b2d2e9/a0d8fd2f-f691-4d83-8320-05b91efdafbd) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:00:41.829142 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:41.840560 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:41.894218 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:00:41.899536 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:00:41.904197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:00:41.908415 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event updated for resources: {'Port': ['ID=a0d8fd2f-f691-4d83-8320-05b91efdafbd,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:00:41.944543 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:41.944890 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:41.945230 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:41.945567 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:41.945900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:41.946234 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:41.946559 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:41.947067 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:41.947394 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:41.947751 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:41.948154 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:41.948399 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:41.948720 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:41.972712 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:41.973402 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:42.016516 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-d590aac7-ff59-4d48-adc3-2ca90b1f5cac tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7091746 Dec 09 22:00:42.030805 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-0160a994-3855-42dc-bb37-ae6a4d96b1d3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 22:00:42.031922 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-0160a994-3855-42dc-bb37-ae6a4d96b1d3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0088377 Dec 09 22:00:42.118906 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-90ce32cb-fbf7-46c5-866c-b76a80046f17 service neutron] Request body: {'port': {'device_id': '15c3e0cc-52ce-44d9-8464-2ed50a05ba15', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:00:42.199455 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-90ce32cb-fbf7-46c5-866c-b76a80046f17 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:42.222985 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-899e3646-5def-4157-b917-c2f27c9d6c12 req-e3ed8c84-7c03-40c7-b57d-65a8d8b65120 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:42.224674 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-899e3646-5def-4157-b917-c2f27c9d6c12 req-e3ed8c84-7c03-40c7-b57d-65a8d8b65120 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 932 time: 0.0623724 Dec 09 22:00:42.280815 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-93f12328-8404-404d-8c02-d90766f8e802 None None] Provisioning complete for port a0d8fd2f-f691-4d83-8320-05b91efdafbd triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:00:42.281412 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-93f12328-8404-404d-8c02-d90766f8e802 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:42.286113 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-899e3646-5def-4157-b917-c2f27c9d6c12 req-981f3309-d701-47eb-851c-057c62479c51 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0535624 Dec 09 22:00:42.344676 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-93f12328-8404-404d-8c02-d90766f8e802 None None] Port a0d8fd2f-f691-4d83-8320-05b91efdafbd cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:00:42.518468 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-90ce32cb-fbf7-46c5-866c-b76a80046f17 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a0d8fd2f-f691-4d83-8320-05b91efdafbd {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:00:42.526481 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-90ce32cb-fbf7-46c5-866c-b76a80046f17 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:42.544801 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-90ce32cb-fbf7-46c5-866c-b76a80046f17 service neutron] Transition to ACTIVE for port object a0d8fd2f-f691-4d83-8320-05b91efdafbd will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:00:42.549929 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-90ce32cb-fbf7-46c5-866c-b76a80046f17 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:42.626604 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90ce32cb-fbf7-46c5-866c-b76a80046f17 service neutron] Pushing event updated for resources: {'Port': ['ID=a0d8fd2f-f691-4d83-8320-05b91efdafbd,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:00:42.686763 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-90ce32cb-fbf7-46c5-866c-b76a80046f17 service neutron] Attempting to bind port a0d8fd2f-f691-4d83-8320-05b91efdafbd on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:00:42.687113 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-90ce32cb-fbf7-46c5-866c-b76a80046f17 service neutron] Attempting to bind port a0d8fd2f-f691-4d83-8320-05b91efdafbd by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:00:42.687467 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-90ce32cb-fbf7-46c5-866c-b76a80046f17 service neutron] Attempting to bind port a0d8fd2f-f691-4d83-8320-05b91efdafbd on network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:00:42.694296 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-90ce32cb-fbf7-46c5-866c-b76a80046f17 service neutron] Port a0d8fd2f-f691-4d83-8320-05b91efdafbd on network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:00:42.694631 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-90ce32cb-fbf7-46c5-866c-b76a80046f17 service neutron] Attempting to bind port a0d8fd2f-f691-4d83-8320-05b91efdafbd on network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:00:42.704073 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-90ce32cb-fbf7-46c5-866c-b76a80046f17 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 0, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:00:42.704426 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-90ce32cb-fbf7-46c5-866c-b76a80046f17 service neutron] Checking segment: {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:00:42.704827 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-90ce32cb-fbf7-46c5-866c-b76a80046f17 service neutron] Bound using segment: {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:00:42.705276 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-90ce32cb-fbf7-46c5-866c-b76a80046f17 service neutron] Bound port: a0d8fd2f-f691-4d83-8320-05b91efdafbd, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:00:42.707283 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-90ce32cb-fbf7-46c5-866c-b76a80046f17 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:42.804207 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-90ce32cb-fbf7-46c5-866c-b76a80046f17 service neutron] For port a0d8fd2f-f691-4d83-8320-05b91efdafbd, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:00:42.808874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-90ce32cb-fbf7-46c5-866c-b76a80046f17 service neutron] For port a0d8fd2f-f691-4d83-8320-05b91efdafbd, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a0d8fd2f-f691-4d83-8320-05b91efdafbd,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:00:42.816469 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-90ce32cb-fbf7-46c5-866c-b76a80046f17 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:42.857977 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-90ce32cb-fbf7-46c5-866c-b76a80046f17 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:42.858915 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-90ce32cb-fbf7-46c5-866c-b76a80046f17 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:42.860938 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-90ce32cb-fbf7-46c5-866c-b76a80046f17 service neutron] 10.222.0.31 "PUT /v2.0/ports/a0d8fd2f-f691-4d83-8320-05b91efdafbd HTTP/1.1" status: 200 len: 1093 time: 0.8196902 Dec 09 22:00:42.861565 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '15c3e0cc-52ce-44d9-8464-2ed50a05ba15', 'tag': 'a0d8fd2f-f691-4d83-8320-05b91efdafbd'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:00:42.864676 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-29e80dea-8bc2-4d79-9d8b-ffcd28dc2a30" -d '{"events": [{"name": "network-changed", "server_uuid": "15c3e0cc-52ce-44d9-8464-2ed50a05ba15", "tag": "a0d8fd2f-f691-4d83-8320-05b91efdafbd"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:00:42.929212 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90ce32cb-fbf7-46c5-866c-b76a80046f17 service neutron] Pushing event updated for resources: {'Port': ['ID=a0d8fd2f-f691-4d83-8320-05b91efdafbd,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:00:42.997758 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-41131168-4689-4f9f-9b66-dbc85748070e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:42.999344 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-41131168-4689-4f9f-9b66-dbc85748070e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 1096 time: 0.0892329 Dec 09 22:00:43.068889 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:00:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-acacf012-af08-413f-a6b5-abaec9cf0f5e x-openstack-request-id: req-acacf012-af08-413f-a6b5-abaec9cf0f5e {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:00:43.069191 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "15c3e0cc-52ce-44d9-8464-2ed50a05ba15", "tag": "a0d8fd2f-f691-4d83-8320-05b91efdafbd", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:00:43.069455 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-acacf012-af08-413f-a6b5-abaec9cf0f5e {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:00:43.069860 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '15c3e0cc-52ce-44d9-8464-2ed50a05ba15', 'tag': 'a0d8fd2f-f691-4d83-8320-05b91efdafbd', 'status': 'completed', 'code': 200} Dec 09 22:00:43.071848 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-c106acd8-e50e-4a20-9080-b20ff5fb9caf service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a0d8fd2f-f691-4d83-8320-05b91efdafbd HTTP/1.1" status: 200 len: 217 time: 0.0564663 Dec 09 22:00:43.138750 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-4df70ebe-0f20-4ac7-a2ce-cddf4d057f18 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:43.140480 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-4df70ebe-0f20-4ac7-a2ce-cddf4d057f18 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0620363 Dec 09 22:00:43.197729 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-74bc9020-9db0-4625-af4d-3d7a4c645b24 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:43.199325 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-74bc9020-9db0-4625-af4d-3d7a4c645b24 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0514433 Dec 09 22:00:43.321710 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-122066c8-eb62-4566-aef7-f25b11058124 service neutron] 10.222.0.31 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1134205 Dec 09 22:00:43.445711 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-073ec3fa-961e-4160-9de7-944bbf7868cc req-a7d0c7b4-af32-40d1-8be6-3832a9a3d7a2 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:43.453957 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-073ec3fa-961e-4160-9de7-944bbf7868cc req-a7d0c7b4-af32-40d1-8be6-3832a9a3d7a2 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 944 time: 0.0849321 Dec 09 22:00:43.545686 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-073ec3fa-961e-4160-9de7-944bbf7868cc req-3544346b-61de-4fd0-828e-dbdd80c89a6f tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0903382 Dec 09 22:00:43.820617 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-47073ce9-9b9a-450e-bcab-e273aa6bd739 req-8708b6ea-a428-4e99-868a-dcd384d9bfad service neutron] 10.222.0.31 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4917073 Dec 09 22:00:43.924298 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29e80dea-8bc2-4d79-9d8b-ffcd28dc2a30 req-b3373cd5-11df-4e7c-8c66-fe42025d5b95 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:43.925819 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-29e80dea-8bc2-4d79-9d8b-ffcd28dc2a30 req-b3373cd5-11df-4e7c-8c66-fe42025d5b95 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 1096 time: 0.0476155 Dec 09 22:00:44.038682 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29e80dea-8bc2-4d79-9d8b-ffcd28dc2a30 req-474a336f-f12d-47f7-8b61-49ccc5438de5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:44.040261 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-29e80dea-8bc2-4d79-9d8b-ffcd28dc2a30 req-474a336f-f12d-47f7-8b61-49ccc5438de5 service neutron] 10.222.0.31 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 911 time: 0.1068521 Dec 09 22:00:44.089536 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-29e80dea-8bc2-4d79-9d8b-ffcd28dc2a30 req-10967367-a27b-4c4c-aae0-9d38bb6381f4 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a0d8fd2f-f691-4d83-8320-05b91efdafbd HTTP/1.1" status: 200 len: 217 time: 0.0420454 Dec 09 22:00:44.147086 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29e80dea-8bc2-4d79-9d8b-ffcd28dc2a30 req-ecb8ad1b-15bc-4442-a7e5-6a564692165e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:44.148665 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-29e80dea-8bc2-4d79-9d8b-ffcd28dc2a30 req-ecb8ad1b-15bc-4442-a7e5-6a564692165e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0519724 Dec 09 22:00:44.205630 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29e80dea-8bc2-4d79-9d8b-ffcd28dc2a30 req-f27bd49f-1a87-4799-bf72-ea8d1ceda843 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:44.207332 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-29e80dea-8bc2-4d79-9d8b-ffcd28dc2a30 req-f27bd49f-1a87-4799-bf72-ea8d1ceda843 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0512257 Dec 09 22:00:44.311313 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-29e80dea-8bc2-4d79-9d8b-ffcd28dc2a30 req-12e62ae2-22d0-43db-a5a3-b30154d3c603 service neutron] 10.222.0.31 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0867753 Dec 09 22:00:44.409605 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-29e80dea-8bc2-4d79-9d8b-ffcd28dc2a30 req-c25a6821-62ce-4a01-a7ef-af67c6a39d30 service neutron] 10.222.0.31 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0911953 Dec 09 22:00:44.686272 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cc64109-04d7-418e-b779-6e469e28adf5 req-f9866618-04cc-4243-977d-ea9b74f6ad6b tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:44.688564 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7cc64109-04d7-418e-b779-6e469e28adf5 req-f9866618-04cc-4243-977d-ea9b74f6ad6b tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 944 time: 0.0655475 Dec 09 22:00:44.748712 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7cc64109-04d7-418e-b779-6e469e28adf5 req-01d9bad3-2402-4db0-b0a5-bd147bbe9cbd tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0528650 Dec 09 22:00:45.889485 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-338d6112-7fb3-4741-a91f-323f9d9ed692 req-3d6b9f33-5f79-4ebf-8730-de6043e449e2 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:45.891474 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-338d6112-7fb3-4741-a91f-323f9d9ed692 req-3d6b9f33-5f79-4ebf-8730-de6043e449e2 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 944 time: 0.0542479 Dec 09 22:00:45.947510 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-338d6112-7fb3-4741-a91f-323f9d9ed692 req-39b81a97-0d78-4f66-9b4d-f10aec4fdc7e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0498002 Dec 09 22:00:47.092515 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4623aea-ec18-4240-8aea-b81ac9428811 req-b065b993-f6f6-403d-863e-d6e5cee39196 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:47.094027 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c4623aea-ec18-4240-8aea-b81ac9428811 req-b065b993-f6f6-403d-863e-d6e5cee39196 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 944 time: 0.0570674 Dec 09 22:00:47.148389 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c4623aea-ec18-4240-8aea-b81ac9428811 req-1e80fa99-2938-4af8-a588-5c1517b65599 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477092 Dec 09 22:00:48.309721 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fadb6c4e-adf3-410a-ba1d-aa0fcf9a6ee5 req-a2e4fc70-40a3-4ca6-87ac-ba50424d3ff0 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:48.311230 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fadb6c4e-adf3-410a-ba1d-aa0fcf9a6ee5 req-a2e4fc70-40a3-4ca6-87ac-ba50424d3ff0 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 944 time: 0.0540190 Dec 09 22:00:48.361087 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fadb6c4e-adf3-410a-ba1d-aa0fcf9a6ee5 req-dea555c5-206e-47c3-80b5-51377ddc4af3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434635 Dec 09 22:00:49.484351 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa714b59-6e34-4bfd-83a9-be911e4ee341 req-5dbe2e1c-7a7b-494c-a3d8-45dc46409513 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:49.485884 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aa714b59-6e34-4bfd-83a9-be911e4ee341 req-5dbe2e1c-7a7b-494c-a3d8-45dc46409513 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 944 time: 0.0486324 Dec 09 22:00:49.542512 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aa714b59-6e34-4bfd-83a9-be911e4ee341 req-1962cf8f-4cca-4478-af81-cb3c1038dff7 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0498972 Dec 09 22:00:50.670876 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc01d8be-1751-436a-8cb9-f6200428598c req-2361cecb-2f4e-4583-81ae-2c22d39b1d78 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:50.672431 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc01d8be-1751-436a-8cb9-f6200428598c req-2361cecb-2f4e-4583-81ae-2c22d39b1d78 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 944 time: 0.0507429 Dec 09 22:00:50.722293 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc01d8be-1751-436a-8cb9-f6200428598c req-7f178ffb-dcf6-419a-8c49-ad7a5f4dac70 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437920 Dec 09 22:00:51.851696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67d79382-ad94-4764-aef3-d34646b56e54 req-86a5d10f-b01b-4a9f-9228-99eb544f1850 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:51.853331 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67d79382-ad94-4764-aef3-d34646b56e54 req-86a5d10f-b01b-4a9f-9228-99eb544f1850 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 944 time: 0.0511785 Dec 09 22:00:51.906636 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-67d79382-ad94-4764-aef3-d34646b56e54 req-f205d0d7-13a2-4398-8704-ed6e53491510 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469799 Dec 09 22:00:53.034294 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df4afb96-728d-4bdf-9f37-44b401917e9b req-46ef6e48-2600-4255-baa4-f02ee90d5020 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:53.035835 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df4afb96-728d-4bdf-9f37-44b401917e9b req-46ef6e48-2600-4255-baa4-f02ee90d5020 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 944 time: 0.0562332 Dec 09 22:00:53.090276 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df4afb96-728d-4bdf-9f37-44b401917e9b req-bdd6a996-5d77-4d76-84f1-08c1bd4f6672 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474770 Dec 09 22:00:54.210169 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0accea8d-aa34-4dc1-a480-4c094293e23f req-31c8fa43-74f0-41ea-b1e9-e5d1d3f3ffcb tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:54.211708 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0accea8d-aa34-4dc1-a480-4c094293e23f req-31c8fa43-74f0-41ea-b1e9-e5d1d3f3ffcb tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 944 time: 0.0525644 Dec 09 22:00:54.263407 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0accea8d-aa34-4dc1-a480-4c094293e23f req-0a4255b8-d359-4c8a-9f65-0ae76c8b8214 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451317 Dec 09 22:00:55.393781 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24c57341-db62-4d27-9d35-a25686b0382f req-3e7a889a-cc2d-4225-b4e1-35edb783655a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:55.395292 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-24c57341-db62-4d27-9d35-a25686b0382f req-3e7a889a-cc2d-4225-b4e1-35edb783655a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 944 time: 0.0545766 Dec 09 22:00:55.455366 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-24c57341-db62-4d27-9d35-a25686b0382f req-0fdba818-860d-4039-9b50-66320e3de2aa tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0509984 Dec 09 22:00:55.997977 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device a0d8fd2f-f691-4d83-8320-05b91efdafbd details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:00:56.099119 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port a0d8fd2f-f691-4d83-8320-05b91efdafbd, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a0d8fd2f-f691-4d83-8320-05b91efdafbd,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:00:56.110441 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'a0d8fd2f-f691-4d83-8320-05b91efdafbd', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'port_id': 'a0d8fd2f-f691-4d83-8320-05b91efdafbd', 'mac_address': 'fa:16:3e:0d:14:89', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:00:56.149200 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:56.162118 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a0d8fd2f-f691-4d83-8320-05b91efdafbd {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:00:56.181982 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port a0d8fd2f-f691-4d83-8320-05b91efdafbd, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a0d8fd2f-f691-4d83-8320-05b91efdafbd,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:00:56.187312 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:56.236471 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=a0d8fd2f-f691-4d83-8320-05b91efdafbd,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:00:56.245136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:56.245610 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:56.246066 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:56.246471 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:56.246796 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:56.247110 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:56.247425 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:56.247769 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:56.248091 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:56.248411 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:56.248733 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:56.249052 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:56.249373 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:00:56.400205 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['a0d8fd2f-f691-4d83-8320-05b91efdafbd'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:00:56.574377 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bac4e1d-29b8-424e-b03e-252ef060e351 req-d1e4e20b-2e11-447d-ae40-ee1ff15b3b95 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:56.575831 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bac4e1d-29b8-424e-b03e-252ef060e351 req-d1e4e20b-2e11-447d-ae40-ee1ff15b3b95 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 945 time: 0.0500724 Dec 09 22:00:56.626968 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bac4e1d-29b8-424e-b03e-252ef060e351 req-ddc20128-af74-45d9-b35a-96387f1732ab tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443490 Dec 09 22:00:57.419903 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:57.640590 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:57.753274 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4205d45-ced6-4743-a5c8-9b4a7f92e074 req-5c1a5ee5-ace3-4e9e-a4cb-e89b8ded6c90 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:57.755028 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b4205d45-ced6-4743-a5c8-9b4a7f92e074 req-5c1a5ee5-ace3-4e9e-a4cb-e89b8ded6c90 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 945 time: 0.0507748 Dec 09 22:00:57.812867 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b4205d45-ced6-4743-a5c8-9b4a7f92e074 req-0f692c0a-a666-4a0b-8c86-089207dfc976 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466845 Dec 09 22:00:57.998462 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device a0d8fd2f-f691-4d83-8320-05b91efdafbd up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:00:58.058798 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port a0d8fd2f-f691-4d83-8320-05b91efdafbd completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:00:58.063119 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port a0d8fd2f-f691-4d83-8320-05b91efdafbd triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:00:58.063519 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:58.141764 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:58.165128 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '15c3e0cc-52ce-44d9-8464-2ed50a05ba15', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a0d8fd2f-f691-4d83-8320-05b91efdafbd'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:00:58.167429 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f109b2a3-144a-4386-92f2-02c9141e12ae" -d '{"events": [{"server_uuid": "15c3e0cc-52ce-44d9-8464-2ed50a05ba15", "name": "network-vif-plugged", "status": "completed", "tag": "a0d8fd2f-f691-4d83-8320-05b91efdafbd"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:00:58.193974 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port a0d8fd2f-f691-4d83-8320-05b91efdafbd, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a0d8fd2f-f691-4d83-8320-05b91efdafbd,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:00:58.201434 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:00:58.259865 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=a0d8fd2f-f691-4d83-8320-05b91efdafbd,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:00:58.299653 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:00:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2ad62565-8bc8-44be-a176-4dcda615fb23 x-openstack-request-id: req-2ad62565-8bc8-44be-a176-4dcda615fb23 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:00:58.300033 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "15c3e0cc-52ce-44d9-8464-2ed50a05ba15", "name": "network-vif-plugged", "status": "completed", "tag": "a0d8fd2f-f691-4d83-8320-05b91efdafbd", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:00:58.300284 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-2ad62565-8bc8-44be-a176-4dcda615fb23 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:00:58.300716 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '15c3e0cc-52ce-44d9-8464-2ed50a05ba15', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a0d8fd2f-f691-4d83-8320-05b91efdafbd', 'code': 200} Dec 09 22:00:58.400302 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5b54f3d-d32f-494a-a8af-5737d381bae8 req-7f58dfcd-e48b-4d71-bb97-1ee5c0ec78da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:58.401901 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a5b54f3d-d32f-494a-a8af-5737d381bae8 req-7f58dfcd-e48b-4d71-bb97-1ee5c0ec78da service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 1098 time: 0.0424092 Dec 09 22:00:58.453316 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a5b54f3d-d32f-494a-a8af-5737d381bae8 req-3a8e9716-ac96-446c-b66d-d75a437b43b9 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446129 Dec 09 22:00:58.939405 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0129c8af-6b90-4735-bafa-efcccdca358c req-390b8a1e-0eb6-493c-ab1e-26e9bb2f00ec tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:00:58.940924 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0129c8af-6b90-4735-bafa-efcccdca358c req-390b8a1e-0eb6-493c-ab1e-26e9bb2f00ec tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 946 time: 0.0538242 Dec 09 22:00:58.991630 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0129c8af-6b90-4735-bafa-efcccdca358c req-2adda21f-a349-4328-9bdc-14b2f21118c2 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441129 Dec 09 22:01:00.140300 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdd9b2ad-9bda-4380-b3f1-2f8fc2af9ba0 req-a8bd7a00-b9fa-4a1c-a605-4d6bd88462b1 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:00.141797 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bdd9b2ad-9bda-4380-b3f1-2f8fc2af9ba0 req-a8bd7a00-b9fa-4a1c-a605-4d6bd88462b1 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 946 time: 0.0631685 Dec 09 22:01:00.201546 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bdd9b2ad-9bda-4380-b3f1-2f8fc2af9ba0 req-79e1cd54-f5a7-47cc-b128-efdd8a0484b0 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0535820 Dec 09 22:01:00.330724 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ead67506-6936-4e00-bc7c-dcef429373ca req-7e09c91a-89ac-4f21-ab8e-3e7eb7624db5 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:00.332037 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ead67506-6936-4e00-bc7c-dcef429373ca req-7e09c91a-89ac-4f21-ab8e-3e7eb7624db5 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 946 time: 0.0525975 Dec 09 22:01:00.385370 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ead67506-6936-4e00-bc7c-dcef429373ca req-2d8fe9bb-0053-4086-9e66-61af8f144cc4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0471585 Dec 09 22:01:00.413217 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57608) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:01:00.557772 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44385500-f8da-4901-a866-828549695a9a tempest-TestVolumeBootPattern-2003139207 tempest-TestVolumeBootPattern-2003139207-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:00.559271 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-44385500-f8da-4901-a866-828549695a9a tempest-TestVolumeBootPattern-2003139207 tempest-TestVolumeBootPattern-2003139207-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 1093 time: 0.1450498 Dec 09 22:01:00.563537 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57612) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:01:00.568233 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-e684efa0-478f-4d46-8bd8-78561962ea7c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': 'a0d8fd2f-f691-4d83-8320-05b91efdafbd', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'fixed_ip_address': '172.20.0.10'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:01:00.592797 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e684efa0-478f-4d46-8bd8-78561962ea7c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:00.596830 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57614) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:01:00.609278 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-f733f44b-62b1-4da8-9be7-c80ae02c6409 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1384883369', 'description': 'tempest-secgroup-smoke-1384883369 description', 'project_id': 'fbf735848dcf4d12b202a013c40dbc22'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:01:00.645780 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f733f44b-62b1-4da8-9be7-c80ae02c6409 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:00.761216 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f733f44b-62b1-4da8-9be7-c80ae02c6409 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:00.766075 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e684efa0-478f-4d46-8bd8-78561962ea7c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:00.769074 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f733f44b-62b1-4da8-9be7-c80ae02c6409 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:00.835210 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f733f44b-62b1-4da8-9be7-c80ae02c6409 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:00.836470 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f733f44b-62b1-4da8-9be7-c80ae02c6409 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.2386646 Dec 09 22:01:00.840430 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57616) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:01:00.841842 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f733f44b-62b1-4da8-9be7-c80ae02c6409 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Pushing event updated for resources: {'SecurityGroup': ['ID=302e1c34-4e37-4e5f-85fc-306fd6b66871,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:01:00.847900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2dcf9922-a63f-4d79-bab7-0f1ef7ea3e1f tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Request body: {'security_group_rule': {'security_group_id': '302e1c34-4e37-4e5f-85fc-306fd6b66871', 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:01:00.877838 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2dcf9922-a63f-4d79-bab7-0f1ef7ea3e1f tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:00.906893 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-e684efa0-478f-4d46-8bd8-78561962ea7c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Allocated IP 172.25.3.41 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/4145e620-8c9f-4126-90ad-237b1b78ab68) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:01:00.933392 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2dcf9922-a63f-4d79-bab7-0f1ef7ea3e1f tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:00.938308 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2dcf9922-a63f-4d79-bab7-0f1ef7ea3e1f tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:00.955624 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dcf9922-a63f-4d79-bab7-0f1ef7ea3e1f tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3c00e8bc-91e8-4887-932d-0b97d811a423,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:01:00.965894 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2dcf9922-a63f-4d79-bab7-0f1ef7ea3e1f tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:00.967175 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2dcf9922-a63f-4d79-bab7-0f1ef7ea3e1f tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1256013 Dec 09 22:01:00.970041 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57618) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:01:00.974616 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-7e869921-6e32-4dbd-8bf6-1ab723e597ec tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Request body: {'security_group_rule': {'security_group_id': '302e1c34-4e37-4e5f-85fc-306fd6b66871', 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:01:01.001990 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7e869921-6e32-4dbd-8bf6-1ab723e597ec tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:01.013193 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e684efa0-478f-4d46-8bd8-78561962ea7c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:01.047207 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e684efa0-478f-4d46-8bd8-78561962ea7c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:01.059173 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7e869921-6e32-4dbd-8bf6-1ab723e597ec tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:01.063138 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7e869921-6e32-4dbd-8bf6-1ab723e597ec tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:01.083156 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e869921-6e32-4dbd-8bf6-1ab723e597ec tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3163662e-4ddc-4254-bac4-c38923e2ad1a,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:01:01.083591 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e684efa0-478f-4d46-8bd8-78561962ea7c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:01:01.086641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-e684efa0-478f-4d46-8bd8-78561962ea7c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:01:01.090337 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e684efa0-478f-4d46-8bd8-78561962ea7c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:01:01.091172 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7e869921-6e32-4dbd-8bf6-1ab723e597ec tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:01.095042 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7e869921-6e32-4dbd-8bf6-1ab723e597ec tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1211865 Dec 09 22:01:01.095269 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57620) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:01:01.099826 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-0b320161-c595-426f-bc57-e8d9d169fad6 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Request body: {'security_group_rule': {'security_group_id': '302e1c34-4e37-4e5f-85fc-306fd6b66871', 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:01:01.121840 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e684efa0-478f-4d46-8bd8-78561962ea7c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event updated for resources: {'Port': ['ID=4145e620-8c9f-4126-90ad-237b1b78ab68,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:01:01.130885 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0b320161-c595-426f-bc57-e8d9d169fad6 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:01.189252 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0b320161-c595-426f-bc57-e8d9d169fad6 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:01.196613 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0b320161-c595-426f-bc57-e8d9d169fad6 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:01.196777 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:01:01.219943 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b320161-c595-426f-bc57-e8d9d169fad6 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=65c6a269-ce73-40f4-89cc-c55d3bfbe7d6,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:01:01.225249 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0b320161-c595-426f-bc57-e8d9d169fad6 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:01.229334 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0b320161-c595-426f-bc57-e8d9d169fad6 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1302612 Dec 09 22:01:01.229750 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57622) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:01:01.234044 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-87bd8892-68f3-4643-bae7-5638b7491622 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Request body: {'security_group_rule': {'security_group_id': '302e1c34-4e37-4e5f-85fc-306fd6b66871', 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:01:01.262054 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-87bd8892-68f3-4643-bae7-5638b7491622 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:01.322950 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-87bd8892-68f3-4643-bae7-5638b7491622 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:01.327094 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-87bd8892-68f3-4643-bae7-5638b7491622 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:01.345440 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87bd8892-68f3-4643-bae7-5638b7491622 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2d32db4a-5456-459b-ba60-2f530ef82cb7,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:01:01.355030 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-87bd8892-68f3-4643-bae7-5638b7491622 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:01.356437 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-87bd8892-68f3-4643-bae7-5638b7491622 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1260262 Dec 09 22:01:01.359396 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57624) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:01:01.363844 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-cded813f-d3ed-4b52-802a-c8755ef6adb7 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Request body: {'security_group_rule': {'security_group_id': '302e1c34-4e37-4e5f-85fc-306fd6b66871', 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:01:01.390836 n-d-713301-27 neutron-server[103437]: INFO neutron.db.securitygroups_db [None req-cded813f-d3ed-4b52-802a-c8755ef6adb7 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Project fbf735848dcf4d12b202a013c40dbc22 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 22:01:01.401976 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cded813f-d3ed-4b52-802a-c8755ef6adb7 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:01.462058 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cded813f-d3ed-4b52-802a-c8755ef6adb7 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:01.465829 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cded813f-d3ed-4b52-802a-c8755ef6adb7 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:01.484254 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cded813f-d3ed-4b52-802a-c8755ef6adb7 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=26b14f21-fd15-411a-82c1-0ccd6af22db5,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:01:01.493975 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cded813f-d3ed-4b52-802a-c8755ef6adb7 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:01.495290 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cded813f-d3ed-4b52-802a-c8755ef6adb7 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1349380 Dec 09 22:01:01.498241 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57626) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:01:01.502685 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-86a35306-40e3-4b35-ae13-dc5a6c39b936 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Request body: {'security_group_rule': {'security_group_id': '302e1c34-4e37-4e5f-85fc-306fd6b66871', 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:01:01.525372 n-d-713301-27 neutron-server[103437]: INFO neutron.db.securitygroups_db [None req-86a35306-40e3-4b35-ae13-dc5a6c39b936 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Project fbf735848dcf4d12b202a013c40dbc22 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 22:01:01.530551 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86a35306-40e3-4b35-ae13-dc5a6c39b936 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:01.590545 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86a35306-40e3-4b35-ae13-dc5a6c39b936 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:01.595147 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86a35306-40e3-4b35-ae13-dc5a6c39b936 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:01.614736 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e684efa0-478f-4d46-8bd8-78561962ea7c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:01.615347 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86a35306-40e3-4b35-ae13-dc5a6c39b936 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=85066e80-3005-4a05-af0a-2fa01b4b7fcd,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:01:01.625425 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-86a35306-40e3-4b35-ae13-dc5a6c39b936 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:01.626646 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-86a35306-40e3-4b35-ae13-dc5a6c39b936 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1274054 Dec 09 22:01:01.984261 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c21da539-9442-42e0-a9bc-8daa700c710e req-936ca97e-c60f-4e99-8ced-d7f463e3135a tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1384883369&fields=id&tenant_id=fbf735848dcf4d12b202a013c40dbc22 HTTP/1.1" status: 200 len: 267 time: 0.1093433 Dec 09 22:01:01.988717 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e684efa0-478f-4d46-8bd8-78561962ea7c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:02.174794 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c21da539-9442-42e0-a9bc-8daa700c710e req-2f78e988-5fa7-4365-8191-f09939aa0165 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:02.176280 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c21da539-9442-42e0-a9bc-8daa700c710e req-2f78e988-5fa7-4365-8191-f09939aa0165 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/networks?id=7d2b997d-488a-4244-8788-25a6953a7b67 HTTP/1.1" status: 200 len: 814 time: 0.1849854 Dec 09 22:01:02.203383 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c21da539-9442-42e0-a9bc-8daa700c710e req-1e7e7993-d081-4db0-aa9c-0af75f1142e0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/quotas/fbf735848dcf4d12b202a013c40dbc22 HTTP/1.1" status: 200 len: 375 time: 0.0210037 Dec 09 22:01:02.264632 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e684efa0-478f-4d46-8bd8-78561962ea7c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:02.272293 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e684efa0-478f-4d46-8bd8-78561962ea7c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:02.315693 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c21da539-9442-42e0-a9bc-8daa700c710e req-0e8a1617-8043-4454-bad4-87d39f1f002f tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=fbf735848dcf4d12b202a013c40dbc22&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1022897 Dec 09 22:01:02.363353 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e684efa0-478f-4d46-8bd8-78561962ea7c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event updated for resources: {'Port': ['ID=4145e620-8c9f-4126-90ad-237b1b78ab68,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:01:02.415577 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e684efa0-478f-4d46-8bd8-78561962ea7c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:02.483862 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c21da539-9442-42e0-a9bc-8daa700c710e req-1e128bd3-4cec-4406-81d3-9b67e65b684f service neutron] 10.222.0.13 "GET /v2.0/networks/7d2b997d-488a-4244-8788-25a6953a7b67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1474378 Dec 09 22:01:02.579938 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-e684efa0-478f-4d46-8bd8-78561962ea7c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Floating IP 3eb7a989-3635-422c-91f5-9a2972ccc18c associated. External IP: 172.25.3.41, port: a0d8fd2f-f691-4d83-8320-05b91efdafbd. Dec 09 22:01:02.654133 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c21da539-9442-42e0-a9bc-8daa700c710e req-2b15befd-e2f7-4deb-965e-15e6ba092a6e service neutron] 10.222.0.13 "GET /v2.0/networks/7d2b997d-488a-4244-8788-25a6953a7b67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1412988 Dec 09 22:01:02.813461 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e684efa0-478f-4d46-8bd8-78561962ea7c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:01:02.951058 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea9ee6c6-d768-4e85-959e-0fcf986b9e07 req-b74a8071-8b30-496f-b975-f61506ea9f26 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 210 time: 0.0281649 Dec 09 22:01:02.964317 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e684efa0-478f-4d46-8bd8-78561962ea7c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:01:02.981781 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cda4e8c3-8cec-4730-85f0-e7bc444236b1 None None] Sync routers for ids ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:01:02.987920 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e684efa0-478f-4d46-8bd8-78561962ea7c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:02.998650 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eec8e8c6-c364-4b7c-9546-e5a3011cb1b9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:03.001815 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cda4e8c3-8cec-4730-85f0-e7bc444236b1 None None] Routers {'52333c17-500b-4d13-8de7-f3d9c4c6eb46'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:01:03.002621 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-cda4e8c3-8cec-4730-85f0-e7bc444236b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:00:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:01:03.036728 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e684efa0-478f-4d46-8bd8-78561962ea7c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.4710670 Dec 09 22:01:03.037374 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '15c3e0cc-52ce-44d9-8464-2ed50a05ba15', 'tag': 'a0d8fd2f-f691-4d83-8320-05b91efdafbd'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:01:03.039948 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b21992a5-330f-4382-9674-a3a4ea889018" -d '{"events": [{"name": "network-changed", "server_uuid": "15c3e0cc-52ce-44d9-8464-2ed50a05ba15", "tag": "a0d8fd2f-f691-4d83-8320-05b91efdafbd"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:01:03.083107 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:01:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f027c35c-01d5-40d9-af3a-ead5305dafe1 x-openstack-request-id: req-f027c35c-01d5-40d9-af3a-ead5305dafe1 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:01:03.083404 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "15c3e0cc-52ce-44d9-8464-2ed50a05ba15", "tag": "a0d8fd2f-f691-4d83-8320-05b91efdafbd", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:01:03.083687 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f027c35c-01d5-40d9-af3a-ead5305dafe1 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:01:03.084097 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '15c3e0cc-52ce-44d9-8464-2ed50a05ba15', 'tag': 'a0d8fd2f-f691-4d83-8320-05b91efdafbd', 'status': 'completed', 'code': 200} Dec 09 22:01:03.150917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b21992a5-330f-4382-9674-a3a4ea889018 req-ad639c39-b75d-4c38-853c-246fc5bf63f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:03.152739 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b21992a5-330f-4382-9674-a3a4ea889018 req-ad639c39-b75d-4c38-853c-246fc5bf63f2 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 1098 time: 0.0459657 Dec 09 22:01:03.254456 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b21992a5-330f-4382-9674-a3a4ea889018 req-218bcafe-4922-48a1-a7cc-9acee0ba9830 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:03.256447 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b21992a5-330f-4382-9674-a3a4ea889018 req-218bcafe-4922-48a1-a7cc-9acee0ba9830 service neutron] 10.222.0.31 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 911 time: 0.0968537 Dec 09 22:01:03.296576 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-cda4e8c3-8cec-4730-85f0-e7bc444236b1 None None] Set router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:01:03.332625 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b21992a5-330f-4382-9674-a3a4ea889018 req-65ad489e-6142-486a-9595-28dcc6f90b6a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a0d8fd2f-f691-4d83-8320-05b91efdafbd HTTP/1.1" status: 200 len: 999 time: 0.0678146 Dec 09 22:01:03.386024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b21992a5-330f-4382-9674-a3a4ea889018 req-f4a14563-1beb-44e4-a5f6-e73666f49809 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:03.388575 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b21992a5-330f-4382-9674-a3a4ea889018 req-f4a14563-1beb-44e4-a5f6-e73666f49809 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0483754 Dec 09 22:01:03.436272 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b21992a5-330f-4382-9674-a3a4ea889018 req-ede84d30-563a-4e44-8443-0a32f872c06d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:03.438128 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b21992a5-330f-4382-9674-a3a4ea889018 req-ede84d30-563a-4e44-8443-0a32f872c06d service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0426936 Dec 09 22:01:03.536643 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-cda4e8c3-8cec-4730-85f0-e7bc444236b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3eb7a989-3635-422c-91f5-9a2972ccc18c', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'floating_ip_address': '172.25.3.41', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'port_id': 'a0d8fd2f-f691-4d83-8320-05b91efdafbd', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 4026, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'mac_address': 'fa:16:3e:0d:14:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15c3e0cc-52ce-44d9-8464-2ed50a05ba15', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:01:01Z', 'updated_at': '2021-12-09T22:01:01Z', 'revision_number': 0, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'db7c12a5-60a7-41e6-ae5c-e42348c373b4', 'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'mac_address': 'fa:16:3e:79:8f:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_interface', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:36Z', 'updated_at': '2021-12-09T21:54:44Z', 'revision_number': 5, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'subnets': [{'id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:01:03.538493 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b21992a5-330f-4382-9674-a3a4ea889018 req-7159934e-3e92-4ab4-bee7-6e3ea1b71c6b service neutron] 10.222.0.31 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0933623 Dec 09 22:01:03.565238 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cda4e8c3-8cec-4730-85f0-e7bc444236b1 None None] Checking router: 52333c17-500b-4d13-8de7-f3d9c4c6eb46 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:01:03.575245 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cda4e8c3-8cec-4730-85f0-e7bc444236b1 None None] Routers {'52333c17-500b-4d13-8de7-f3d9c4c6eb46'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:01:03.575905 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-cda4e8c3-8cec-4730-85f0-e7bc444236b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:00:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:01:03.635501 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b21992a5-330f-4382-9674-a3a4ea889018 req-8ccc5379-d543-4c5a-8a20-9ac94566f8f1 service neutron] 10.222.0.31 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0899334 Dec 09 22:01:03.685709 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-cda4e8c3-8cec-4730-85f0-e7bc444236b1 None None] Set router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:01:03.932139 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-cda4e8c3-8cec-4730-85f0-e7bc444236b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3eb7a989-3635-422c-91f5-9a2972ccc18c', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'floating_ip_address': '172.25.3.41', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'port_id': 'a0d8fd2f-f691-4d83-8320-05b91efdafbd', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 4026, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'mac_address': 'fa:16:3e:0d:14:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15c3e0cc-52ce-44d9-8464-2ed50a05ba15', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:01:01Z', 'updated_at': '2021-12-09T22:01:01Z', 'revision_number': 0, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'db7c12a5-60a7-41e6-ae5c-e42348c373b4', 'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'mac_address': 'fa:16:3e:79:8f:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_interface', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:36Z', 'updated_at': '2021-12-09T21:54:44Z', 'revision_number': 5, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'subnets': [{'id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:01:03.959839 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cda4e8c3-8cec-4730-85f0-e7bc444236b1 None None] The sync data for ids ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'] in n-d-713301-27 is: [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3eb7a989-3635-422c-91f5-9a2972ccc18c', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'floating_ip_address': '172.25.3.41', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'port_id': 'a0d8fd2f-f691-4d83-8320-05b91efdafbd', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 4026, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'mac_address': 'fa:16:3e:0d:14:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15c3e0cc-52ce-44d9-8464-2ed50a05ba15', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:01:01Z', 'updated_at': '2021-12-09T22:01:01Z', 'revision_number': 0, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'db7c12a5-60a7-41e6-ae5c-e42348c373b4', 'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'mac_address': 'fa:16:3e:79:8f:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_interface', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:36Z', 'updated_at': '2021-12-09T21:54:44Z', 'revision_number': 5, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'subnets': [{'id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:01:03.982452 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c21da539-9442-42e0-a9bc-8daa700c710e req-98547969-3953-465a-a569-98092957faa2 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:03.984036 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c21da539-9442-42e0-a9bc-8daa700c710e req-98547969-3953-465a-a569-98092957faa2 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.10 "GET /v2.0/networks?id=7d2b997d-488a-4244-8788-25a6953a7b67 HTTP/1.1" status: 200 len: 814 time: 0.1111324 Dec 09 22:01:04.079220 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-41e7d020-1b79-4b77-aa3b-860f28058ddc req-65aef7c9-64a4-4716-ab0b-00edb406a369 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 210 time: 0.0385993 Dec 09 22:01:04.086697 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c21da539-9442-42e0-a9bc-8daa700c710e req-b8e306e2-3240-4b4c-9b8f-d0d7cd168082 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.10 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=fbf735848dcf4d12b202a013c40dbc22 HTTP/1.1" status: 200 len: 380 time: 0.0930984 Dec 09 22:01:04.096697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-c21da539-9442-42e0-a9bc-8daa700c710e req-a6cead40-f6a3-4478-a86a-13abd94f4c4b tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Request body: {'port': {'device_id': '89b4d72b-ae53-4337-b942-67c67b092930', 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67', 'admin_state_up': True, 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'security_groups': ['302e1c34-4e37-4e5f-85fc-306fd6b66871']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:01:04.196912 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d910039d-5098-46b3-83ff-865460256edf None None] New status for floating IP 3eb7a989-3635-422c-91f5-9a2972ccc18c: ACTIVE {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:01:04.221933 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c21da539-9442-42e0-a9bc-8daa700c710e req-a6cead40-f6a3-4478-a86a-13abd94f4c4b tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Made reservation on behalf of fbf735848dcf4d12b202a013c40dbc22 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:01:04.226098 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c21da539-9442-42e0-a9bc-8daa700c710e req-a6cead40-f6a3-4478-a86a-13abd94f4c4b tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:04.361387 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-c21da539-9442-42e0-a9bc-8daa700c710e req-a6cead40-f6a3-4478-a86a-13abd94f4c4b tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Allocated IP 172.20.0.4 (7d2b997d-488a-4244-8788-25a6953a7b67/99243393-13ed-459f-904c-d6635896912a/513bfcea-f059-4489-894f-16fc8a090aab) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:01:04.504528 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c21da539-9442-42e0-a9bc-8daa700c710e req-a6cead40-f6a3-4478-a86a-13abd94f4c4b tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:04.538501 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c21da539-9442-42e0-a9bc-8daa700c710e req-a6cead40-f6a3-4478-a86a-13abd94f4c4b tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:04.584757 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c21da539-9442-42e0-a9bc-8daa700c710e req-a6cead40-f6a3-4478-a86a-13abd94f4c4b tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Network 7d2b997d-488a-4244-8788-25a6953a7b67 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:01:04.587822 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-c21da539-9442-42e0-a9bc-8daa700c710e req-a6cead40-f6a3-4478-a86a-13abd94f4c4b tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:01:04.593968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-c21da539-9442-42e0-a9bc-8daa700c710e req-a6cead40-f6a3-4478-a86a-13abd94f4c4b tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:01:04.600634 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6cead40-f6a3-4478-a86a-13abd94f4c4b tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Pushing event updated for resources: {'Port': ['ID=513bfcea-f059-4489-894f-16fc8a090aab,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:01:04.648464 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c21da539-9442-42e0-a9bc-8daa700c710e req-a6cead40-f6a3-4478-a86a-13abd94f4c4b tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:04.649117 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c21da539-9442-42e0-a9bc-8daa700c710e req-a6cead40-f6a3-4478-a86a-13abd94f4c4b tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:04.667027 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c21da539-9442-42e0-a9bc-8daa700c710e req-a6cead40-f6a3-4478-a86a-13abd94f4c4b tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5744212 Dec 09 22:01:04.678998 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-c21da539-9442-42e0-a9bc-8daa700c710e req-de2ef5dd-f67d-4c64-b6db-3206bd01da78 service neutron] Request body: {'port': {'device_id': '89b4d72b-ae53-4337-b942-67c67b092930', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:01:04.737076 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c21da539-9442-42e0-a9bc-8daa700c710e req-de2ef5dd-f67d-4c64-b6db-3206bd01da78 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:04.889888 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d81bb21f-030e-4802-9a6f-5dc2002f6955 None None] Provisioning complete for port 513bfcea-f059-4489-894f-16fc8a090aab triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:01:04.890920 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d81bb21f-030e-4802-9a6f-5dc2002f6955 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:04.926455 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d81bb21f-030e-4802-9a6f-5dc2002f6955 None None] Port 513bfcea-f059-4489-894f-16fc8a090aab cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:01:05.016525 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-c21da539-9442-42e0-a9bc-8daa700c710e req-de2ef5dd-f67d-4c64-b6db-3206bd01da78 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 513bfcea-f059-4489-894f-16fc8a090aab {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:01:05.024590 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c21da539-9442-42e0-a9bc-8daa700c710e req-de2ef5dd-f67d-4c64-b6db-3206bd01da78 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:05.037571 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-c21da539-9442-42e0-a9bc-8daa700c710e req-de2ef5dd-f67d-4c64-b6db-3206bd01da78 service neutron] Transition to ACTIVE for port object 513bfcea-f059-4489-894f-16fc8a090aab will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:01:05.042914 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c21da539-9442-42e0-a9bc-8daa700c710e req-de2ef5dd-f67d-4c64-b6db-3206bd01da78 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:05.093955 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de2ef5dd-f67d-4c64-b6db-3206bd01da78 service neutron] Pushing event updated for resources: {'Port': ['ID=513bfcea-f059-4489-894f-16fc8a090aab,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:01:05.161043 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-c21da539-9442-42e0-a9bc-8daa700c710e req-de2ef5dd-f67d-4c64-b6db-3206bd01da78 service neutron] Attempting to bind port 513bfcea-f059-4489-894f-16fc8a090aab on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:01:05.161371 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-c21da539-9442-42e0-a9bc-8daa700c710e req-de2ef5dd-f67d-4c64-b6db-3206bd01da78 service neutron] Attempting to bind port 513bfcea-f059-4489-894f-16fc8a090aab by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '51312a71-17d4-413a-8049-8ec25b223e8b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:01:05.161700 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c21da539-9442-42e0-a9bc-8daa700c710e req-de2ef5dd-f67d-4c64-b6db-3206bd01da78 service neutron] Attempting to bind port 513bfcea-f059-4489-894f-16fc8a090aab on network 7d2b997d-488a-4244-8788-25a6953a7b67 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:01:05.167212 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c21da539-9442-42e0-a9bc-8daa700c710e req-de2ef5dd-f67d-4c64-b6db-3206bd01da78 service neutron] Port 513bfcea-f059-4489-894f-16fc8a090aab on network 7d2b997d-488a-4244-8788-25a6953a7b67 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:01:05.167605 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c21da539-9442-42e0-a9bc-8daa700c710e req-de2ef5dd-f67d-4c64-b6db-3206bd01da78 service neutron] Attempting to bind port 513bfcea-f059-4489-894f-16fc8a090aab on network 7d2b997d-488a-4244-8788-25a6953a7b67 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:01:05.185480 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c21da539-9442-42e0-a9bc-8daa700c710e req-de2ef5dd-f67d-4c64-b6db-3206bd01da78 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 0, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:01:05.185480 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c21da539-9442-42e0-a9bc-8daa700c710e req-de2ef5dd-f67d-4c64-b6db-3206bd01da78 service neutron] Checking segment: {'id': '51312a71-17d4-413a-8049-8ec25b223e8b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:01:05.185480 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c21da539-9442-42e0-a9bc-8daa700c710e req-de2ef5dd-f67d-4c64-b6db-3206bd01da78 service neutron] Bound using segment: {'id': '51312a71-17d4-413a-8049-8ec25b223e8b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:01:05.185480 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-c21da539-9442-42e0-a9bc-8daa700c710e req-de2ef5dd-f67d-4c64-b6db-3206bd01da78 service neutron] Bound port: 513bfcea-f059-4489-894f-16fc8a090aab, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '51312a71-17d4-413a-8049-8ec25b223e8b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 105, 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:01:05.185480 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c21da539-9442-42e0-a9bc-8daa700c710e req-de2ef5dd-f67d-4c64-b6db-3206bd01da78 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:05.261382 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49ac5019-f01a-4c06-b6fb-9306dcfd6ff7 req-6c88bf47-312c-411c-8b03-4dd50a6fa527 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:05.262945 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-49ac5019-f01a-4c06-b6fb-9306dcfd6ff7 req-6c88bf47-312c-411c-8b03-4dd50a6fa527 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 943 time: 0.0918014 Dec 09 22:01:05.302702 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-c21da539-9442-42e0-a9bc-8daa700c710e req-de2ef5dd-f67d-4c64-b6db-3206bd01da78 service neutron] For port 513bfcea-f059-4489-894f-16fc8a090aab, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:01:05.322661 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-c21da539-9442-42e0-a9bc-8daa700c710e req-de2ef5dd-f67d-4c64-b6db-3206bd01da78 service neutron] For port 513bfcea-f059-4489-894f-16fc8a090aab, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=513bfcea-f059-4489-894f-16fc8a090aab,segment=NetworkSegment(51312a71-17d4-413a-8049-8ec25b223e8b),segment_id=51312a71-17d4-413a-8049-8ec25b223e8b)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:01:05.328125 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c21da539-9442-42e0-a9bc-8daa700c710e req-de2ef5dd-f67d-4c64-b6db-3206bd01da78 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:05.369175 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-49ac5019-f01a-4c06-b6fb-9306dcfd6ff7 req-8a494079-ca9d-4256-9ba4-b9b4b43b491b tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/security-groups?id=302e1c34-4e37-4e5f-85fc-306fd6b66871&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0971546 Dec 09 22:01:05.372723 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c21da539-9442-42e0-a9bc-8daa700c710e req-de2ef5dd-f67d-4c64-b6db-3206bd01da78 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:05.373346 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c21da539-9442-42e0-a9bc-8daa700c710e req-de2ef5dd-f67d-4c64-b6db-3206bd01da78 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:05.374725 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c21da539-9442-42e0-a9bc-8daa700c710e req-de2ef5dd-f67d-4c64-b6db-3206bd01da78 service neutron] 10.222.0.10 "PUT /v2.0/ports/513bfcea-f059-4489-894f-16fc8a090aab HTTP/1.1" status: 200 len: 1092 time: 0.7000580 Dec 09 22:01:05.375199 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '89b4d72b-ae53-4337-b942-67c67b092930', 'tag': '513bfcea-f059-4489-894f-16fc8a090aab'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:01:05.377432 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-318fb0c7-5b41-4297-bc9c-a7254fdb9f93" -d '{"events": [{"name": "network-changed", "server_uuid": "89b4d72b-ae53-4337-b942-67c67b092930", "tag": "513bfcea-f059-4489-894f-16fc8a090aab"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:01:05.417399 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de2ef5dd-f67d-4c64-b6db-3206bd01da78 service neutron] Pushing event updated for resources: {'Port': ['ID=513bfcea-f059-4489-894f-16fc8a090aab,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:01:05.433392 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:01:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-370cc887-24ec-4e2e-8378-6fbd36d4411c x-openstack-request-id: req-370cc887-24ec-4e2e-8378-6fbd36d4411c {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:01:05.433696 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "89b4d72b-ae53-4337-b942-67c67b092930", "tag": "513bfcea-f059-4489-894f-16fc8a090aab", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:01:05.433960 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-370cc887-24ec-4e2e-8378-6fbd36d4411c {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:01:05.434517 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '89b4d72b-ae53-4337-b942-67c67b092930', 'tag': '513bfcea-f059-4489-894f-16fc8a090aab', 'status': 'completed', 'code': 200} Dec 09 22:01:05.494695 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c21da539-9442-42e0-a9bc-8daa700c710e req-504157b8-dafb-4f28-863a-be4367b6dbe9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:05.497142 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c21da539-9442-42e0-a9bc-8daa700c710e req-504157b8-dafb-4f28-863a-be4367b6dbe9 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=fbf735848dcf4d12b202a013c40dbc22&device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 1095 time: 0.0570376 Dec 09 22:01:05.541109 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c21da539-9442-42e0-a9bc-8daa700c710e req-125f0fb9-714e-4638-b1eb-0469c0ac9631 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=513bfcea-f059-4489-894f-16fc8a090aab HTTP/1.1" status: 200 len: 217 time: 0.0363119 Dec 09 22:01:05.605672 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cefc721a-a2a3-4815-abd3-897160d07828 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:05.608078 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c21da539-9442-42e0-a9bc-8daa700c710e req-231b55c5-8a81-49b5-9677-783cab2695fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:05.609825 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c21da539-9442-42e0-a9bc-8daa700c710e req-231b55c5-8a81-49b5-9677-783cab2695fa service neutron] 10.222.0.10 "GET /v2.0/subnets?id=99243393-13ed-459f-904c-d6635896912a HTTP/1.1" status: 200 len: 853 time: 0.0618689 Dec 09 22:01:05.659411 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c21da539-9442-42e0-a9bc-8daa700c710e req-7adbc75a-b2c4-49c9-89ef-1d28f66c5718 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:05.660936 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c21da539-9442-42e0-a9bc-8daa700c710e req-7adbc75a-b2c4-49c9-89ef-1d28f66c5718 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=7d2b997d-488a-4244-8788-25a6953a7b67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0439353 Dec 09 22:01:05.759587 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c21da539-9442-42e0-a9bc-8daa700c710e req-aadce4a0-d36e-4450-957f-cc9af2b59c94 service neutron] 10.222.0.10 "GET /v2.0/networks/7d2b997d-488a-4244-8788-25a6953a7b67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0906024 Dec 09 22:01:05.855767 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c21da539-9442-42e0-a9bc-8daa700c710e req-2e937839-ceeb-4535-bb2b-787a1ae255e3 service neutron] 10.222.0.10 "GET /v2.0/networks/7d2b997d-488a-4244-8788-25a6953a7b67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0895014 Dec 09 22:01:05.945248 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-318fb0c7-5b41-4297-bc9c-a7254fdb9f93 req-043102ef-8b41-445f-954d-df16d5ad57fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:05.946705 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-318fb0c7-5b41-4297-bc9c-a7254fdb9f93 req-043102ef-8b41-445f-954d-df16d5ad57fa service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=fbf735848dcf4d12b202a013c40dbc22&device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 1095 time: 0.0429761 Dec 09 22:01:06.037097 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-318fb0c7-5b41-4297-bc9c-a7254fdb9f93 req-6d530506-dbfc-459a-928e-fc8f7ee905e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:06.038577 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-318fb0c7-5b41-4297-bc9c-a7254fdb9f93 req-6d530506-dbfc-459a-928e-fc8f7ee905e8 service neutron] 10.222.0.10 "GET /v2.0/networks?id=7d2b997d-488a-4244-8788-25a6953a7b67 HTTP/1.1" status: 200 len: 915 time: 0.0852220 Dec 09 22:01:06.083949 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-318fb0c7-5b41-4297-bc9c-a7254fdb9f93 req-0c54e2c6-4340-4c6b-b7af-6ebd76d74cf7 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=513bfcea-f059-4489-894f-16fc8a090aab HTTP/1.1" status: 200 len: 217 time: 0.0381470 Dec 09 22:01:06.137195 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-318fb0c7-5b41-4297-bc9c-a7254fdb9f93 req-5b7a986c-a964-49b9-b120-7a7edd402de7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:06.138587 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-318fb0c7-5b41-4297-bc9c-a7254fdb9f93 req-5b7a986c-a964-49b9-b120-7a7edd402de7 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=99243393-13ed-459f-904c-d6635896912a HTTP/1.1" status: 200 len: 853 time: 0.0475430 Dec 09 22:01:06.184970 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-318fb0c7-5b41-4297-bc9c-a7254fdb9f93 req-1a8c9ac5-0d43-4078-8637-e42383ab9741 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:06.186487 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-318fb0c7-5b41-4297-bc9c-a7254fdb9f93 req-1a8c9ac5-0d43-4078-8637-e42383ab9741 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=7d2b997d-488a-4244-8788-25a6953a7b67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0407002 Dec 09 22:01:06.282311 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-318fb0c7-5b41-4297-bc9c-a7254fdb9f93 req-7da0346e-3048-465b-adbc-68a650de6b41 service neutron] 10.222.0.10 "GET /v2.0/networks/7d2b997d-488a-4244-8788-25a6953a7b67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0883782 Dec 09 22:01:06.376633 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-318fb0c7-5b41-4297-bc9c-a7254fdb9f93 req-012eb826-f085-4c7f-9fad-7fdcfc8bfaef service neutron] 10.222.0.10 "GET /v2.0/networks/7d2b997d-488a-4244-8788-25a6953a7b67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0864351 Dec 09 22:01:06.509140 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97479ca2-0f76-4932-8806-3e7d684a3d18 req-fb90f191-fc7e-4838-8508-7c3fb69c3473 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:06.510799 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-97479ca2-0f76-4932-8806-3e7d684a3d18 req-fb90f191-fc7e-4838-8508-7c3fb69c3473 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 943 time: 0.0566852 Dec 09 22:01:06.561451 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-97479ca2-0f76-4932-8806-3e7d684a3d18 req-3d748657-a6d2-4998-b6ea-1afe2ad92574 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/security-groups?id=302e1c34-4e37-4e5f-85fc-306fd6b66871&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443361 Dec 09 22:01:06.732969 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:07.682738 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21de9bed-0406-4614-9982-2f497b28500b req-f96a3b97-4430-4ffb-94ff-4a785676c169 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:07.684577 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-21de9bed-0406-4614-9982-2f497b28500b req-f96a3b97-4430-4ffb-94ff-4a785676c169 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 943 time: 0.0521314 Dec 09 22:01:07.736276 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-21de9bed-0406-4614-9982-2f497b28500b req-b4c11118-d8fd-4e12-991c-acdd880a44c3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/security-groups?id=302e1c34-4e37-4e5f-85fc-306fd6b66871&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451515 Dec 09 22:01:08.072835 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:08.860948 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36a9e1de-c308-471b-a614-0848853ba926 req-37c4369b-3f7e-44fd-8aca-f02dbbac16f7 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:08.862600 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36a9e1de-c308-471b-a614-0848853ba926 req-37c4369b-3f7e-44fd-8aca-f02dbbac16f7 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 943 time: 0.0531824 Dec 09 22:01:08.920427 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36a9e1de-c308-471b-a614-0848853ba926 req-25027462-6071-4a26-a64b-b810c1361347 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/security-groups?id=302e1c34-4e37-4e5f-85fc-306fd6b66871&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0495110 Dec 09 22:01:09.663715 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:10.042287 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4f7f8a0-b239-4c64-8cab-eeb8e9e24908 req-3f411b94-f0b2-47e5-8af7-e47d505a725a tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:10.043765 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d4f7f8a0-b239-4c64-8cab-eeb8e9e24908 req-3f411b94-f0b2-47e5-8af7-e47d505a725a tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 943 time: 0.0503953 Dec 09 22:01:10.100700 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d4f7f8a0-b239-4c64-8cab-eeb8e9e24908 req-cb0ea6ca-5c02-478c-a695-3f238d158bee tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/security-groups?id=302e1c34-4e37-4e5f-85fc-306fd6b66871&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0501676 Dec 09 22:01:11.233512 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f90a0e1-1ee2-4fcf-bd32-4850f24e947e req-4e5346f8-8fbe-4fbe-b7ca-e34836da68be tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:11.235414 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7f90a0e1-1ee2-4fcf-bd32-4850f24e947e req-4e5346f8-8fbe-4fbe-b7ca-e34836da68be tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 943 time: 0.0649107 Dec 09 22:01:11.298037 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7f90a0e1-1ee2-4fcf-bd32-4850f24e947e req-9afae89b-3413-4e4f-a944-449de90c8ef6 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/security-groups?id=302e1c34-4e37-4e5f-85fc-306fd6b66871&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0554581 Dec 09 22:01:12.425374 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce17536d-59e4-4cec-a4db-21e4d549672c req-45666e9d-a62b-4aba-bc99-c588c05e4cd3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:12.426853 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ce17536d-59e4-4cec-a4db-21e4d549672c req-45666e9d-a62b-4aba-bc99-c588c05e4cd3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 943 time: 0.0566757 Dec 09 22:01:12.478376 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ce17536d-59e4-4cec-a4db-21e4d549672c req-11d184fa-279b-44e3-9961-9716cf3e5fc8 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/security-groups?id=302e1c34-4e37-4e5f-85fc-306fd6b66871&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453174 Dec 09 22:01:13.612765 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b325bb18-d49f-4b67-a875-a477067ec6b7 req-b3c93d53-40ae-418b-aaa5-b71c5fabdeff tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:13.614145 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b325bb18-d49f-4b67-a875-a477067ec6b7 req-b3c93d53-40ae-418b-aaa5-b71c5fabdeff tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 943 time: 0.0530035 Dec 09 22:01:13.667679 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b325bb18-d49f-4b67-a875-a477067ec6b7 req-1133bcd4-3fd9-42d8-a4a2-7c7e71b10e2f tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/security-groups?id=302e1c34-4e37-4e5f-85fc-306fd6b66871&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449455 Dec 09 22:01:15.074088 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1212957d-dc42-4a53-883f-0b794f07add8 req-fe4cb176-c438-41e7-9c9e-999a5ed3341f tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:15.075580 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1212957d-dc42-4a53-883f-0b794f07add8 req-fe4cb176-c438-41e7-9c9e-999a5ed3341f tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 943 time: 0.3132074 Dec 09 22:01:15.135554 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1212957d-dc42-4a53-883f-0b794f07add8 req-56478d28-cbf8-4629-9fdb-b6b50362aeb5 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/security-groups?id=302e1c34-4e37-4e5f-85fc-306fd6b66871&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430272 Dec 09 22:01:16.285615 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15909e5c-67f4-4a8f-a50e-5ce0a5e6dd47 req-7edb05be-5e73-4d8e-9a7d-7e1bc8b38c71 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:16.288048 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15909e5c-67f4-4a8f-a50e-5ce0a5e6dd47 req-7edb05be-5e73-4d8e-9a7d-7e1bc8b38c71 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 943 time: 0.0581436 Dec 09 22:01:16.294171 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 513bfcea-f059-4489-894f-16fc8a090aab details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:01:16.344232 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15909e5c-67f4-4a8f-a50e-5ce0a5e6dd47 req-06a0443d-043f-4917-9885-f14309d58a26 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/security-groups?id=302e1c34-4e37-4e5f-85fc-306fd6b66871&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0486531 Dec 09 22:01:16.402974 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 513bfcea-f059-4489-894f-16fc8a090aab, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=513bfcea-f059-4489-894f-16fc8a090aab,segment=NetworkSegment(51312a71-17d4-413a-8049-8ec25b223e8b),segment_id=51312a71-17d4-413a-8049-8ec25b223e8b)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:01:16.414524 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '513bfcea-f059-4489-894f-16fc8a090aab', 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67', 'port_id': '513bfcea-f059-4489-894f-16fc8a090aab', 'mac_address': 'fa:16:3e:cc:03:50', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 105, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '99243393-13ed-459f-904c-d6635896912a', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:01:16.454020 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:16.466936 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 513bfcea-f059-4489-894f-16fc8a090aab {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:01:16.490303 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 513bfcea-f059-4489-894f-16fc8a090aab, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=513bfcea-f059-4489-894f-16fc8a090aab,segment=NetworkSegment(51312a71-17d4-413a-8049-8ec25b223e8b),segment_id=51312a71-17d4-413a-8049-8ec25b223e8b)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:01:16.497782 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:16.544071 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=513bfcea-f059-4489-894f-16fc8a090aab,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:01:16.729181 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['513bfcea-f059-4489-894f-16fc8a090aab'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:01:17.508249 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f88166a3-82b0-4046-a275-ed87ae255d96 req-2bdffd62-f6cd-4fe6-abfb-ffcfd7649c45 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:17.511018 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f88166a3-82b0-4046-a275-ed87ae255d96 req-2bdffd62-f6cd-4fe6-abfb-ffcfd7649c45 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 944 time: 0.0754373 Dec 09 22:01:17.573235 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f88166a3-82b0-4046-a275-ed87ae255d96 req-450e9497-0f43-4aeb-8022-89ff24085c6c tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/security-groups?id=302e1c34-4e37-4e5f-85fc-306fd6b66871&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0495999 Dec 09 22:01:18.293041 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 513bfcea-f059-4489-894f-16fc8a090aab up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:01:18.345779 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 513bfcea-f059-4489-894f-16fc8a090aab completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:01:18.351700 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 513bfcea-f059-4489-894f-16fc8a090aab triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:01:18.352161 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:18.444505 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:18.469053 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '89b4d72b-ae53-4337-b942-67c67b092930', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '513bfcea-f059-4489-894f-16fc8a090aab'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:01:18.471364 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dbfc5707-42fe-496f-98b4-1b5773baaafd" -d '{"events": [{"server_uuid": "89b4d72b-ae53-4337-b942-67c67b092930", "name": "network-vif-plugged", "status": "completed", "tag": "513bfcea-f059-4489-894f-16fc8a090aab"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:01:18.485749 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 513bfcea-f059-4489-894f-16fc8a090aab, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=513bfcea-f059-4489-894f-16fc8a090aab,segment=NetworkSegment(51312a71-17d4-413a-8049-8ec25b223e8b),segment_id=51312a71-17d4-413a-8049-8ec25b223e8b)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:01:18.495476 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:18.516920 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:01:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2cb4bb02-c03e-4c68-ba7e-b9528fae7834 x-openstack-request-id: req-2cb4bb02-c03e-4c68-ba7e-b9528fae7834 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:01:18.517222 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "89b4d72b-ae53-4337-b942-67c67b092930", "name": "network-vif-plugged", "status": "completed", "tag": "513bfcea-f059-4489-894f-16fc8a090aab", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:01:18.517476 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-2cb4bb02-c03e-4c68-ba7e-b9528fae7834 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:01:18.517916 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '89b4d72b-ae53-4337-b942-67c67b092930', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '513bfcea-f059-4489-894f-16fc8a090aab', 'code': 200} Dec 09 22:01:18.546411 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=513bfcea-f059-4489-894f-16fc8a090aab,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:01:18.613968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2812fb63-f227-4084-8f05-16d74d94f1c1 req-d1b28c3d-52e3-4f7e-ba66-6e354e5fa60c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:18.615517 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2812fb63-f227-4084-8f05-16d74d94f1c1 req-d1b28c3d-52e3-4f7e-ba66-6e354e5fa60c service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 1097 time: 0.0409374 Dec 09 22:01:18.689230 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2812fb63-f227-4084-8f05-16d74d94f1c1 req-5ec58717-a110-4fef-9e7d-3e7f358336b6 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=302e1c34-4e37-4e5f-85fc-306fd6b66871&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0655754 Dec 09 22:01:18.709571 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fdf9752-49cd-4a67-9f35-1b396d53985f req-dc9b06d6-6f36-4c11-a808-477b93c8ac98 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:18.711325 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5fdf9752-49cd-4a67-9f35-1b396d53985f req-dc9b06d6-6f36-4c11-a808-477b93c8ac98 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 945 time: 0.0604935 Dec 09 22:01:18.764367 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5fdf9752-49cd-4a67-9f35-1b396d53985f req-81c42bcc-c082-41fb-9019-29553a05de44 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/security-groups?id=302e1c34-4e37-4e5f-85fc-306fd6b66871&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465059 Dec 09 22:01:19.888919 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51c4ffd5-6295-4a34-9ebc-0ce3b51e0d15 req-23d632be-fe00-4333-af3a-f1df874be390 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:19.890407 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51c4ffd5-6295-4a34-9ebc-0ce3b51e0d15 req-23d632be-fe00-4333-af3a-f1df874be390 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 945 time: 0.0542884 Dec 09 22:01:19.943128 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51c4ffd5-6295-4a34-9ebc-0ce3b51e0d15 req-d4a04ed1-e2ad-47e0-b1f3-5f41d77d4663 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/security-groups?id=302e1c34-4e37-4e5f-85fc-306fd6b66871&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463519 Dec 09 22:01:20.062583 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-328b62c0-239d-4a71-b07b-d922b8ea61a9 req-ea8de794-1ab5-4fd2-b3d4-a6f46c2d3339 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:20.064008 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-328b62c0-239d-4a71-b07b-d922b8ea61a9 req-ea8de794-1ab5-4fd2-b3d4-a6f46c2d3339 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 945 time: 0.0514519 Dec 09 22:01:20.114522 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-328b62c0-239d-4a71-b07b-d922b8ea61a9 req-803d5fe9-2086-4471-8313-7d11e0104daa tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/security-groups?id=302e1c34-4e37-4e5f-85fc-306fd6b66871&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443771 Dec 09 22:01:20.137198 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57692) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:01:20.227006 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f720ec72-a3e9-454a-80e5-6b3d3dfcbfd8 tempest-TestVolumeBackupRestore-303115385 tempest-TestVolumeBackupRestore-303115385-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:20.228693 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f720ec72-a3e9-454a-80e5-6b3d3dfcbfd8 tempest-TestVolumeBackupRestore-303115385 tempest-TestVolumeBackupRestore-303115385-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 1092 time: 0.0904591 Dec 09 22:01:20.232703 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57696) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:01:20.237084 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a8c38031-5155-4be2-83da-aa5bed7d00e3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': '513bfcea-f059-4489-894f-16fc8a090aab', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'fixed_ip_address': '172.20.0.4'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:01:20.268740 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a8c38031-5155-4be2-83da-aa5bed7d00e3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:20.379971 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a8c38031-5155-4be2-83da-aa5bed7d00e3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:20.490580 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-a8c38031-5155-4be2-83da-aa5bed7d00e3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Allocated IP 172.25.3.80 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/d10ea8ef-c9dc-49bc-a9e1-cd3b0868d859) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:01:20.594937 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a8c38031-5155-4be2-83da-aa5bed7d00e3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:20.633100 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a8c38031-5155-4be2-83da-aa5bed7d00e3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:20.669056 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a8c38031-5155-4be2-83da-aa5bed7d00e3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:01:20.671959 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-a8c38031-5155-4be2-83da-aa5bed7d00e3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:01:20.674684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8c38031-5155-4be2-83da-aa5bed7d00e3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:01:20.709977 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8c38031-5155-4be2-83da-aa5bed7d00e3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Pushing event updated for resources: {'Port': ['ID=d10ea8ef-c9dc-49bc-a9e1-cd3b0868d859,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:01:21.070505 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a8c38031-5155-4be2-83da-aa5bed7d00e3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:21.152056 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a8c38031-5155-4be2-83da-aa5bed7d00e3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:21.296775 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a8c38031-5155-4be2-83da-aa5bed7d00e3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:21.302451 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a8c38031-5155-4be2-83da-aa5bed7d00e3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:21.375180 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8c38031-5155-4be2-83da-aa5bed7d00e3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Pushing event updated for resources: {'Port': ['ID=d10ea8ef-c9dc-49bc-a9e1-cd3b0868d859,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:01:21.387769 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a8c38031-5155-4be2-83da-aa5bed7d00e3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:21.506210 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-a8c38031-5155-4be2-83da-aa5bed7d00e3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Floating IP 2fd13ae5-7a80-4797-9101-d0e2161f8e26 associated. External IP: 172.25.3.80, port: 513bfcea-f059-4489-894f-16fc8a090aab. Dec 09 22:01:21.722858 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a8c38031-5155-4be2-83da-aa5bed7d00e3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Router 0d60ac0a-7a8a-48a2-be00-905446e6480e has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:01:21.835058 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a8c38031-5155-4be2-83da-aa5bed7d00e3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:01:21.846058 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-563e2466-80aa-4895-85ff-d563103aea8b None None] Sync routers for ids ['0d60ac0a-7a8a-48a2-be00-905446e6480e'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:01:21.853773 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a8c38031-5155-4be2-83da-aa5bed7d00e3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:21.856224 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-563e2466-80aa-4895-85ff-d563103aea8b None None] Routers {'0d60ac0a-7a8a-48a2-be00-905446e6480e'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:01:21.856852 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-563e2466-80aa-4895-85ff-d563103aea8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:01:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['0d60ac0a-7a8a-48a2-be00-905446e6480e'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:01:21.882212 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a8c38031-5155-4be2-83da-aa5bed7d00e3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.6484318 Dec 09 22:01:21.882832 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '89b4d72b-ae53-4337-b942-67c67b092930', 'tag': '513bfcea-f059-4489-894f-16fc8a090aab'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:01:21.885214 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1b7ed754-1a60-4ebb-a552-5f27a989f44e" -d '{"events": [{"name": "network-changed", "server_uuid": "89b4d72b-ae53-4337-b942-67c67b092930", "tag": "513bfcea-f059-4489-894f-16fc8a090aab"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:01:21.885762 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57698) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:01:21.924436 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:01:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e6ef0be9-b3d0-4c1c-b00d-6a74b6ab1a38 x-openstack-request-id: req-e6ef0be9-b3d0-4c1c-b00d-6a74b6ab1a38 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:01:21.924749 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "89b4d72b-ae53-4337-b942-67c67b092930", "tag": "513bfcea-f059-4489-894f-16fc8a090aab", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:01:21.924989 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e6ef0be9-b3d0-4c1c-b00d-6a74b6ab1a38 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:01:21.925436 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '89b4d72b-ae53-4337-b942-67c67b092930', 'tag': '513bfcea-f059-4489-894f-16fc8a090aab', 'status': 'completed', 'code': 200} Dec 09 22:01:21.932729 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-41700556-1315-43cb-94f1-7f1434cf86f2 tempest-TestVolumeBackupRestore-303115385 tempest-TestVolumeBackupRestore-303115385-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:21.934440 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-41700556-1315-43cb-94f1-7f1434cf86f2 tempest-TestVolumeBackupRestore-303115385 tempest-TestVolumeBackupRestore-303115385-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 1092 time: 0.0476224 Dec 09 22:01:21.937363 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 57702) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:01:21.942001 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-0e476dd7-0a29-4f5f-be51-c61db7838a3e tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Request body: {'floatingip': {'port_id': '513bfcea-f059-4489-894f-16fc8a090aab'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:01:21.974437 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-563e2466-80aa-4895-85ff-d563103aea8b None None] Set router 0d60ac0a-7a8a-48a2-be00-905446e6480e gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:01:21.995465 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b7ed754-1a60-4ebb-a552-5f27a989f44e req-3c980660-e939-49f2-a6e1-1d38a442ae48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:21.996928 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b7ed754-1a60-4ebb-a552-5f27a989f44e req-3c980660-e939-49f2-a6e1-1d38a442ae48 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=fbf735848dcf4d12b202a013c40dbc22&device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 1097 time: 0.0456581 Dec 09 22:01:22.002260 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0e476dd7-0a29-4f5f-be51-c61db7838a3e tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for floatingip, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:22.107658 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b7ed754-1a60-4ebb-a552-5f27a989f44e req-7d16fc8b-a184-4418-a6f7-87fab0a3a96a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:22.109894 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b7ed754-1a60-4ebb-a552-5f27a989f44e req-7d16fc8b-a184-4418-a6f7-87fab0a3a96a service neutron] 10.222.0.10 "GET /v2.0/networks?id=7d2b997d-488a-4244-8788-25a6953a7b67 HTTP/1.1" status: 200 len: 915 time: 0.1064439 Dec 09 22:01:22.179108 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b7ed754-1a60-4ebb-a552-5f27a989f44e req-2fde0892-b50e-4c0d-ab81-b6c2a025620e service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=513bfcea-f059-4489-894f-16fc8a090aab HTTP/1.1" status: 200 len: 998 time: 0.0622110 Dec 09 22:01:22.215280 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-563e2466-80aa-4895-85ff-d563103aea8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'name': 'tempest-TestVolumeBackupRestore-1315296361-router', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111'}], 'enable_snat': True}, 'gw_port_id': 'd48358d4-545a-4282-816d-a3f37022551e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:56Z', 'revision_number': 4, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'gw_port': {'id': 'd48358d4-545a-4282-816d-a3f37022551e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:41:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4003, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '2fd13ae5-7a80-4797-9101-d0e2161f8e26', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'floating_ip_address': '172.25.3.80', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'port_id': '513bfcea-f059-4489-894f-16fc8a090aab', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 4031, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67', 'mac_address': 'fa:16:3e:cc:03:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '89b4d72b-ae53-4337-b942-67c67b092930', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:01:20Z', 'updated_at': '2021-12-09T22:01:20Z', 'revision_number': 0, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '565414b3-feaa-4ac4-9283-5a140e9e8de2', 'name': '', 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'mac_address': 'fa:16:3e:bf:e6:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_interface', 'standard_attr_id': 4004, 'fixed_ips': [{'subnet_id': '99243393-13ed-459f-904c-d6635896912a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:56Z', 'updated_at': '2021-12-09T21:59:01Z', 'revision_number': 5, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'subnets': [{'id': '99243393-13ed-459f-904c-d6635896912a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:01:22.232484 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b7ed754-1a60-4ebb-a552-5f27a989f44e req-e7c925c7-2f20-449d-844f-b50aa6859665 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:22.234966 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b7ed754-1a60-4ebb-a552-5f27a989f44e req-e7c925c7-2f20-449d-844f-b50aa6859665 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=99243393-13ed-459f-904c-d6635896912a HTTP/1.1" status: 200 len: 853 time: 0.0490055 Dec 09 22:01:22.245869 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-563e2466-80aa-4895-85ff-d563103aea8b None None] Checking router: 0d60ac0a-7a8a-48a2-be00-905446e6480e for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:01:22.257612 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-563e2466-80aa-4895-85ff-d563103aea8b None None] Routers {'0d60ac0a-7a8a-48a2-be00-905446e6480e'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:01:22.258351 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-563e2466-80aa-4895-85ff-d563103aea8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:01:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['0d60ac0a-7a8a-48a2-be00-905446e6480e'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:01:22.286158 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b7ed754-1a60-4ebb-a552-5f27a989f44e req-385c22f8-01a1-4a6c-8ad6-ae2ea7b37985 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:22.287693 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b7ed754-1a60-4ebb-a552-5f27a989f44e req-385c22f8-01a1-4a6c-8ad6-ae2ea7b37985 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=7d2b997d-488a-4244-8788-25a6953a7b67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0451512 Dec 09 22:01:22.372126 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-563e2466-80aa-4895-85ff-d563103aea8b None None] Set router 0d60ac0a-7a8a-48a2-be00-905446e6480e gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:01:22.386664 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b7ed754-1a60-4ebb-a552-5f27a989f44e req-6f2d8883-9d9b-48bf-85ca-e53e8c17ef9d service neutron] 10.222.0.10 "GET /v2.0/networks/7d2b997d-488a-4244-8788-25a6953a7b67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0915647 Dec 09 22:01:22.487084 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1b7ed754-1a60-4ebb-a552-5f27a989f44e req-73e7769a-3f0c-4981-a01c-e5f278c3c070 service neutron] 10.222.0.10 "GET /v2.0/networks/7d2b997d-488a-4244-8788-25a6953a7b67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0935590 Dec 09 22:01:22.520371 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0e476dd7-0a29-4f5f-be51-c61db7838a3e tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:22.525826 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0e476dd7-0a29-4f5f-be51-c61db7838a3e tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:22.620129 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-563e2466-80aa-4895-85ff-d563103aea8b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'name': 'tempest-TestVolumeBackupRestore-1315296361-router', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111'}], 'enable_snat': True}, 'gw_port_id': 'd48358d4-545a-4282-816d-a3f37022551e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:56Z', 'revision_number': 4, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'gw_port': {'id': 'd48358d4-545a-4282-816d-a3f37022551e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:41:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4003, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '2fd13ae5-7a80-4797-9101-d0e2161f8e26', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'floating_ip_address': '172.25.3.80', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'port_id': '513bfcea-f059-4489-894f-16fc8a090aab', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 4031, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67', 'mac_address': 'fa:16:3e:cc:03:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '89b4d72b-ae53-4337-b942-67c67b092930', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:01:20Z', 'updated_at': '2021-12-09T22:01:20Z', 'revision_number': 0, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '565414b3-feaa-4ac4-9283-5a140e9e8de2', 'name': '', 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'mac_address': 'fa:16:3e:bf:e6:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_interface', 'standard_attr_id': 4004, 'fixed_ips': [{'subnet_id': '99243393-13ed-459f-904c-d6635896912a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:56Z', 'updated_at': '2021-12-09T21:59:01Z', 'revision_number': 5, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'subnets': [{'id': '99243393-13ed-459f-904c-d6635896912a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:01:22.647012 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-563e2466-80aa-4895-85ff-d563103aea8b None None] The sync data for ids ['0d60ac0a-7a8a-48a2-be00-905446e6480e'] in n-d-713301-27 is: [{'id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'name': 'tempest-TestVolumeBackupRestore-1315296361-router', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111'}], 'enable_snat': True}, 'gw_port_id': 'd48358d4-545a-4282-816d-a3f37022551e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:56Z', 'revision_number': 4, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'gw_port': {'id': 'd48358d4-545a-4282-816d-a3f37022551e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:41:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4003, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '2fd13ae5-7a80-4797-9101-d0e2161f8e26', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'floating_ip_address': '172.25.3.80', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'port_id': '513bfcea-f059-4489-894f-16fc8a090aab', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 4031, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67', 'mac_address': 'fa:16:3e:cc:03:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '89b4d72b-ae53-4337-b942-67c67b092930', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:01:20Z', 'updated_at': '2021-12-09T22:01:20Z', 'revision_number': 0, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '565414b3-feaa-4ac4-9283-5a140e9e8de2', 'name': '', 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'mac_address': 'fa:16:3e:bf:e6:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_interface', 'standard_attr_id': 4004, 'fixed_ips': [{'subnet_id': '99243393-13ed-459f-904c-d6635896912a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:56Z', 'updated_at': '2021-12-09T21:59:01Z', 'revision_number': 5, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'subnets': [{'id': '99243393-13ed-459f-904c-d6635896912a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:01:22.746063 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0e476dd7-0a29-4f5f-be51-c61db7838a3e tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Router 0d60ac0a-7a8a-48a2-be00-905446e6480e has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:01:22.855909 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f07894e5-3430-4426-bdae-d85da17a2031 None None] New status for floating IP 2fd13ae5-7a80-4797-9101-d0e2161f8e26: ACTIVE {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:01:22.870876 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0e476dd7-0a29-4f5f-be51-c61db7838a3e tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:01:22.875862 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0e476dd7-0a29-4f5f-be51-c61db7838a3e tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:22.903927 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '89b4d72b-ae53-4337-b942-67c67b092930', 'tag': '513bfcea-f059-4489-894f-16fc8a090aab'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:01:22.906270 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-73874e54-7de8-462b-a32d-d306c48baf6c" -d '{"events": [{"name": "network-changed", "server_uuid": "89b4d72b-ae53-4337-b942-67c67b092930", "tag": "513bfcea-f059-4489-894f-16fc8a090aab"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:01:22.936329 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0e476dd7-0a29-4f5f-be51-c61db7838a3e tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "PUT /v2.0/floatingips/2fd13ae5-7a80-4797-9101-d0e2161f8e26 HTTP/1.1" status: 200 len: 990 time: 0.9973888 Dec 09 22:01:22.959799 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:01:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e60f6097-7144-4f70-ab7e-08e05bc8fc4d x-openstack-request-id: req-e60f6097-7144-4f70-ab7e-08e05bc8fc4d {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:01:22.960207 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "89b4d72b-ae53-4337-b942-67c67b092930", "tag": "513bfcea-f059-4489-894f-16fc8a090aab", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:01:22.960521 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e60f6097-7144-4f70-ab7e-08e05bc8fc4d {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:01:22.960940 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '89b4d72b-ae53-4337-b942-67c67b092930', 'tag': '513bfcea-f059-4489-894f-16fc8a090aab', 'status': 'completed', 'code': 200} Dec 09 22:01:23.031509 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73874e54-7de8-462b-a32d-d306c48baf6c req-803c7dee-f08d-4e5b-a930-0ff71d08dd04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:23.033025 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-73874e54-7de8-462b-a32d-d306c48baf6c req-803c7dee-f08d-4e5b-a930-0ff71d08dd04 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=fbf735848dcf4d12b202a013c40dbc22&device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 1097 time: 0.0446205 Dec 09 22:01:23.103592 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b71bb1b0-9e4d-49fc-bcba-eca64289974d None None] Sync routers for ids ['0d60ac0a-7a8a-48a2-be00-905446e6480e'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:01:23.114801 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b71bb1b0-9e4d-49fc-bcba-eca64289974d None None] Routers {'0d60ac0a-7a8a-48a2-be00-905446e6480e'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:01:23.115480 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b71bb1b0-9e4d-49fc-bcba-eca64289974d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:01:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['0d60ac0a-7a8a-48a2-be00-905446e6480e'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:01:23.140287 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73874e54-7de8-462b-a32d-d306c48baf6c req-5eb1aa30-8e49-49e9-bf8a-80804604920f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:23.141963 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-73874e54-7de8-462b-a32d-d306c48baf6c req-5eb1aa30-8e49-49e9-bf8a-80804604920f service neutron] 10.222.0.10 "GET /v2.0/networks?id=7d2b997d-488a-4244-8788-25a6953a7b67 HTTP/1.1" status: 200 len: 915 time: 0.1023037 Dec 09 22:01:23.208867 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-73874e54-7de8-462b-a32d-d306c48baf6c req-1c9a0df1-a28b-4611-b7b3-b91e7bb03fd9 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=513bfcea-f059-4489-894f-16fc8a090aab HTTP/1.1" status: 200 len: 1000 time: 0.0603921 Dec 09 22:01:23.225978 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-b71bb1b0-9e4d-49fc-bcba-eca64289974d None None] Set router 0d60ac0a-7a8a-48a2-be00-905446e6480e gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:01:23.258561 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73874e54-7de8-462b-a32d-d306c48baf6c req-5c57788d-0ffe-4d43-a59b-c3ed509cde9f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:23.260185 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-73874e54-7de8-462b-a32d-d306c48baf6c req-5c57788d-0ffe-4d43-a59b-c3ed509cde9f service neutron] 10.222.0.10 "GET /v2.0/subnets?id=99243393-13ed-459f-904c-d6635896912a HTTP/1.1" status: 200 len: 853 time: 0.0450282 Dec 09 22:01:23.312637 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73874e54-7de8-462b-a32d-d306c48baf6c req-dc7ba0b6-2250-4e89-babf-a335658bfe7e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:23.314104 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-73874e54-7de8-462b-a32d-d306c48baf6c req-dc7ba0b6-2250-4e89-babf-a335658bfe7e service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=7d2b997d-488a-4244-8788-25a6953a7b67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0474830 Dec 09 22:01:23.415089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-73874e54-7de8-462b-a32d-d306c48baf6c req-1876ee64-f668-4d89-b5dc-4b7250018f47 service neutron] 10.222.0.10 "GET /v2.0/networks/7d2b997d-488a-4244-8788-25a6953a7b67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0933118 Dec 09 22:01:23.517256 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-73874e54-7de8-462b-a32d-d306c48baf6c req-b401a406-a87a-4dd6-b1fa-3e439b5562bc service neutron] 10.222.0.10 "GET /v2.0/networks/7d2b997d-488a-4244-8788-25a6953a7b67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0956395 Dec 09 22:01:23.629164 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b71bb1b0-9e4d-49fc-bcba-eca64289974d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'name': 'tempest-TestVolumeBackupRestore-1315296361-router', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111'}], 'enable_snat': True}, 'gw_port_id': 'd48358d4-545a-4282-816d-a3f37022551e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:56Z', 'revision_number': 4, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'gw_port': {'id': 'd48358d4-545a-4282-816d-a3f37022551e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:41:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4003, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '2fd13ae5-7a80-4797-9101-d0e2161f8e26', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'floating_ip_address': '172.25.3.80', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'port_id': '513bfcea-f059-4489-894f-16fc8a090aab', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 4031, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67', 'mac_address': 'fa:16:3e:cc:03:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '89b4d72b-ae53-4337-b942-67c67b092930', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:01:20Z', 'updated_at': '2021-12-09T22:01:22Z', 'revision_number': 2, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '565414b3-feaa-4ac4-9283-5a140e9e8de2', 'name': '', 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'mac_address': 'fa:16:3e:bf:e6:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_interface', 'standard_attr_id': 4004, 'fixed_ips': [{'subnet_id': '99243393-13ed-459f-904c-d6635896912a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:56Z', 'updated_at': '2021-12-09T21:59:01Z', 'revision_number': 5, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'subnets': [{'id': '99243393-13ed-459f-904c-d6635896912a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:01:23.655214 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b71bb1b0-9e4d-49fc-bcba-eca64289974d None None] Checking router: 0d60ac0a-7a8a-48a2-be00-905446e6480e for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:01:23.663259 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b71bb1b0-9e4d-49fc-bcba-eca64289974d None None] Routers {'0d60ac0a-7a8a-48a2-be00-905446e6480e'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:01:23.663966 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b71bb1b0-9e4d-49fc-bcba-eca64289974d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:01:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['0d60ac0a-7a8a-48a2-be00-905446e6480e'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:01:23.767896 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-b71bb1b0-9e4d-49fc-bcba-eca64289974d None None] Set router 0d60ac0a-7a8a-48a2-be00-905446e6480e gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:01:24.006208 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-b71bb1b0-9e4d-49fc-bcba-eca64289974d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'name': 'tempest-TestVolumeBackupRestore-1315296361-router', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111'}], 'enable_snat': True}, 'gw_port_id': 'd48358d4-545a-4282-816d-a3f37022551e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:56Z', 'revision_number': 4, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'gw_port': {'id': 'd48358d4-545a-4282-816d-a3f37022551e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:41:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4003, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '2fd13ae5-7a80-4797-9101-d0e2161f8e26', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'floating_ip_address': '172.25.3.80', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'port_id': '513bfcea-f059-4489-894f-16fc8a090aab', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 4031, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67', 'mac_address': 'fa:16:3e:cc:03:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '89b4d72b-ae53-4337-b942-67c67b092930', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:01:20Z', 'updated_at': '2021-12-09T22:01:22Z', 'revision_number': 2, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '565414b3-feaa-4ac4-9283-5a140e9e8de2', 'name': '', 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'mac_address': 'fa:16:3e:bf:e6:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_interface', 'standard_attr_id': 4004, 'fixed_ips': [{'subnet_id': '99243393-13ed-459f-904c-d6635896912a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:56Z', 'updated_at': '2021-12-09T21:59:01Z', 'revision_number': 5, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'subnets': [{'id': '99243393-13ed-459f-904c-d6635896912a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:01:24.041865 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b71bb1b0-9e4d-49fc-bcba-eca64289974d None None] The sync data for ids ['0d60ac0a-7a8a-48a2-be00-905446e6480e'] in n-d-713301-27 is: [{'id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'name': 'tempest-TestVolumeBackupRestore-1315296361-router', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111'}], 'enable_snat': True}, 'gw_port_id': 'd48358d4-545a-4282-816d-a3f37022551e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:56Z', 'revision_number': 4, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'gw_port': {'id': 'd48358d4-545a-4282-816d-a3f37022551e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:41:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4003, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '2fd13ae5-7a80-4797-9101-d0e2161f8e26', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'floating_ip_address': '172.25.3.80', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'port_id': '513bfcea-f059-4489-894f-16fc8a090aab', 'fixed_ip_address': '172.20.0.4', 'status': 'ACTIVE', 'standard_attr_id': 4031, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67', 'mac_address': 'fa:16:3e:cc:03:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '89b4d72b-ae53-4337-b942-67c67b092930', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:01:20Z', 'updated_at': '2021-12-09T22:01:22Z', 'revision_number': 2, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '565414b3-feaa-4ac4-9283-5a140e9e8de2', 'name': '', 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'mac_address': 'fa:16:3e:bf:e6:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_interface', 'standard_attr_id': 4004, 'fixed_ips': [{'subnet_id': '99243393-13ed-459f-904c-d6635896912a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:56Z', 'updated_at': '2021-12-09T21:59:01Z', 'revision_number': 5, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'subnets': [{'id': '99243393-13ed-459f-904c-d6635896912a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:01:24.962412 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '89b4d72b-ae53-4337-b942-67c67b092930', 'tag': '513bfcea-f059-4489-894f-16fc8a090aab'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:01:24.965170 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aceb2256-348b-42ce-b2fa-050b92791d63" -d '{"events": [{"name": "network-changed", "server_uuid": "89b4d72b-ae53-4337-b942-67c67b092930", "tag": "513bfcea-f059-4489-894f-16fc8a090aab"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:01:25.003614 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:01:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0c24ff11-9865-426b-a84a-181cf1bb7b6c x-openstack-request-id: req-0c24ff11-9865-426b-a84a-181cf1bb7b6c {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:01:25.003917 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "89b4d72b-ae53-4337-b942-67c67b092930", "tag": "513bfcea-f059-4489-894f-16fc8a090aab", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:01:25.004157 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0c24ff11-9865-426b-a84a-181cf1bb7b6c {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:01:25.004560 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '89b4d72b-ae53-4337-b942-67c67b092930', 'tag': '513bfcea-f059-4489-894f-16fc8a090aab', 'status': 'completed', 'code': 200} Dec 09 22:01:25.073577 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aceb2256-348b-42ce-b2fa-050b92791d63 req-d43a82b8-8a2a-4972-b458-1b54b7515ce2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:25.075368 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aceb2256-348b-42ce-b2fa-050b92791d63 req-d43a82b8-8a2a-4972-b458-1b54b7515ce2 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=fbf735848dcf4d12b202a013c40dbc22&device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 1097 time: 0.0463221 Dec 09 22:01:25.180698 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aceb2256-348b-42ce-b2fa-050b92791d63 req-6f2e88e0-de24-4b9d-92ae-547832d1a575 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:25.182370 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aceb2256-348b-42ce-b2fa-050b92791d63 req-6f2e88e0-de24-4b9d-92ae-547832d1a575 service neutron] 10.222.0.10 "GET /v2.0/networks?id=7d2b997d-488a-4244-8788-25a6953a7b67 HTTP/1.1" status: 200 len: 915 time: 0.1001444 Dec 09 22:01:25.251303 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aceb2256-348b-42ce-b2fa-050b92791d63 req-43c972ef-9cdf-45b0-973e-4658c0cf2816 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=513bfcea-f059-4489-894f-16fc8a090aab HTTP/1.1" status: 200 len: 1000 time: 0.0618100 Dec 09 22:01:25.302832 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aceb2256-348b-42ce-b2fa-050b92791d63 req-a967ead9-8a1c-4a7f-b6cb-4a161e4701ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:25.304451 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aceb2256-348b-42ce-b2fa-050b92791d63 req-a967ead9-8a1c-4a7f-b6cb-4a161e4701ea service neutron] 10.222.0.10 "GET /v2.0/subnets?id=99243393-13ed-459f-904c-d6635896912a HTTP/1.1" status: 200 len: 853 time: 0.0462990 Dec 09 22:01:25.355979 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aceb2256-348b-42ce-b2fa-050b92791d63 req-5e7b5b74-a151-4122-9fa6-6ae850677cc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:25.357604 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aceb2256-348b-42ce-b2fa-050b92791d63 req-5e7b5b74-a151-4122-9fa6-6ae850677cc9 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=7d2b997d-488a-4244-8788-25a6953a7b67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0464084 Dec 09 22:01:25.451405 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aceb2256-348b-42ce-b2fa-050b92791d63 req-c264fa72-82eb-4640-85b2-b01d63f39143 service neutron] 10.222.0.10 "GET /v2.0/networks/7d2b997d-488a-4244-8788-25a6953a7b67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0870194 Dec 09 22:01:25.549122 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aceb2256-348b-42ce-b2fa-050b92791d63 req-7dcb2a52-e1ec-419f-9da6-3fe60f3a09bd service neutron] 10.222.0.10 "GET /v2.0/networks/7d2b997d-488a-4244-8788-25a6953a7b67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0906057 Dec 09 22:01:27.442664 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:27.648012 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:32.989627 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-079f603d-10cb-4334-b78e-69afd3b9dc68 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:35.612061 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-17d0a5f8-aa62-4db9-9c22-dac0e040f6c7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:36.748033 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:38.066877 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:38.198857 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:01:38.829811 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0c95c46-3671-413f-956a-3868214a99c6 req-2cd4b60b-d8ca-4cb8-8c92-1f0c0d4fc3b7 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0413840 Dec 09 22:01:38.914939 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0c95c46-3671-413f-956a-3868214a99c6 req-03a5e9cc-8455-4769-9f25-ce22a7c977d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:38.916447 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0c95c46-3671-413f-956a-3868214a99c6 req-03a5e9cc-8455-4769-9f25-ce22a7c977d4 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=fbf735848dcf4d12b202a013c40dbc22&device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 1097 time: 0.0414622 Dec 09 22:01:39.027531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0c95c46-3671-413f-956a-3868214a99c6 req-4e1dc3e5-28d3-4a98-855d-87bfd173f25c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:39.029049 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0c95c46-3671-413f-956a-3868214a99c6 req-4e1dc3e5-28d3-4a98-855d-87bfd173f25c service neutron] 10.222.0.10 "GET /v2.0/networks?id=7d2b997d-488a-4244-8788-25a6953a7b67 HTTP/1.1" status: 200 len: 915 time: 0.0911384 Dec 09 22:01:39.095645 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0c95c46-3671-413f-956a-3868214a99c6 req-2b27c746-fd2e-4f50-89d6-3ab7ee57f45e service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=513bfcea-f059-4489-894f-16fc8a090aab HTTP/1.1" status: 200 len: 1000 time: 0.0591843 Dec 09 22:01:39.151741 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0c95c46-3671-413f-956a-3868214a99c6 req-9b03248c-9561-4c6d-bb5b-0b8e5f4a3070 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:39.153333 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0c95c46-3671-413f-956a-3868214a99c6 req-9b03248c-9561-4c6d-bb5b-0b8e5f4a3070 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=99243393-13ed-459f-904c-d6635896912a HTTP/1.1" status: 200 len: 853 time: 0.0500295 Dec 09 22:01:39.200035 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0c95c46-3671-413f-956a-3868214a99c6 req-4558b510-18e3-446c-8495-5d18859725ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:39.201593 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0c95c46-3671-413f-956a-3868214a99c6 req-4558b510-18e3-446c-8495-5d18859725ae service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=7d2b997d-488a-4244-8788-25a6953a7b67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0415304 Dec 09 22:01:39.309673 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0c95c46-3671-413f-956a-3868214a99c6 req-1a0e9820-c5cb-48d2-85e2-54ba9f7b82f4 service neutron] 10.222.0.10 "GET /v2.0/networks/7d2b997d-488a-4244-8788-25a6953a7b67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0982347 Dec 09 22:01:39.403123 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0c95c46-3671-413f-956a-3868214a99c6 req-7bf7e0cd-d146-44ed-bc36-2599222d3302 service neutron] 10.222.0.10 "GET /v2.0/networks/7d2b997d-488a-4244-8788-25a6953a7b67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0868187 Dec 09 22:01:39.669825 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:53.284027 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd557463-9258-4b69-b2cc-7a56f45d91f5 req-c75976d3-5ba2-4e33-902b-b63258839dd9 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0518956 Dec 09 22:01:53.380914 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd557463-9258-4b69-b2cc-7a56f45d91f5 req-5205dc8b-925f-4a34-bc01-201373ecbb53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:53.382442 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd557463-9258-4b69-b2cc-7a56f45d91f5 req-5205dc8b-925f-4a34-bc01-201373ecbb53 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 1098 time: 0.0467961 Dec 09 22:01:53.491424 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd557463-9258-4b69-b2cc-7a56f45d91f5 req-a2ece88e-983a-4e49-9ab7-2d533fa13362 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:53.493620 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd557463-9258-4b69-b2cc-7a56f45d91f5 req-a2ece88e-983a-4e49-9ab7-2d533fa13362 service neutron] 10.222.0.31 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 911 time: 0.0893157 Dec 09 22:01:53.567551 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd557463-9258-4b69-b2cc-7a56f45d91f5 req-9ee4e31a-60e7-466f-863e-8d392480e94a service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a0d8fd2f-f691-4d83-8320-05b91efdafbd HTTP/1.1" status: 200 len: 1001 time: 0.0657554 Dec 09 22:01:53.620008 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd557463-9258-4b69-b2cc-7a56f45d91f5 req-79a8a7fb-8396-4c6b-8243-cba44dab3aa8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:53.621463 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd557463-9258-4b69-b2cc-7a56f45d91f5 req-79a8a7fb-8396-4c6b-8243-cba44dab3aa8 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0458162 Dec 09 22:01:53.671311 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd557463-9258-4b69-b2cc-7a56f45d91f5 req-fd7f0c27-c267-4af3-9dfa-afd9b60ba4cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:53.672953 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd557463-9258-4b69-b2cc-7a56f45d91f5 req-fd7f0c27-c267-4af3-9dfa-afd9b60ba4cf service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0442820 Dec 09 22:01:53.782489 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd557463-9258-4b69-b2cc-7a56f45d91f5 req-b0dca621-ac03-451e-a0c3-ca2d2eecdd00 service neutron] 10.222.0.31 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1014428 Dec 09 22:01:53.883741 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bd557463-9258-4b69-b2cc-7a56f45d91f5 req-45543c35-629e-4610-ba16-a91eb3f0758f service neutron] 10.222.0.31 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0939837 Dec 09 22:01:55.825233 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57726) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:01:56.268260 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Deleting port d10ea8ef-c9dc-49bc-a9e1-cd3b0868d859 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:01:56.268692 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:56.361656 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:56.361976 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:56.375528 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Calling delete_port for d10ea8ef-c9dc-49bc-a9e1-cd3b0868d859 owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:01:56.565704 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:56.596569 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Pushing event deleted for resources: {'Port': ['ID=d10ea8ef-c9dc-49bc-a9e1-cd3b0868d859,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:01:56.624542 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:01:56.624890 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:01:56.625364 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:01:56.625805 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:01:56.626235 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:01:56.626613 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:01:56.626978 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:01:56.627309 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:01:56.627671 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:01:56.628002 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:01:56.628327 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:01:56.628654 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:01:56.628980 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:01:56.677546 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:56.677854 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Floating IP 2fd13ae5-7a80-4797-9101-d0e2161f8e26 disassociated (deleted). External IP: 172.25.3.80, port: 513bfcea-f059-4489-894f-16fc8a090aab. Dec 09 22:01:56.914918 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Router 0d60ac0a-7a8a-48a2-be00-905446e6480e has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:01:57.027386 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:01:57.032955 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:57.039113 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1d7ecc4-5f74-403a-b270-90fb75f5ad51 None None] Sync routers for ids ['0d60ac0a-7a8a-48a2-be00-905446e6480e'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:01:57.049908 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1d7ecc4-5f74-403a-b270-90fb75f5ad51 None None] Routers {'0d60ac0a-7a8a-48a2-be00-905446e6480e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:01:57.051299 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a1d7ecc4-5f74-403a-b270-90fb75f5ad51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:01:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['0d60ac0a-7a8a-48a2-be00-905446e6480e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:01:57.060000 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8fead4e3-46a4-45f1-99ea-dc98f91c57d0 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "DELETE /v2.0/floatingips/2fd13ae5-7a80-4797-9101-d0e2161f8e26 HTTP/1.1" status: 204 len: 168 time: 1.2340605 Dec 09 22:01:57.060602 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '89b4d72b-ae53-4337-b942-67c67b092930', 'tag': '513bfcea-f059-4489-894f-16fc8a090aab'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:01:57.062914 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-22cde8fb-fcc5-48c3-9ed7-084ad5ccbd93" -d '{"events": [{"name": "network-changed", "server_uuid": "89b4d72b-ae53-4337-b942-67c67b092930", "tag": "513bfcea-f059-4489-894f-16fc8a090aab"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:01:57.178704 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-a1d7ecc4-5f74-403a-b270-90fb75f5ad51 None None] Set router 0d60ac0a-7a8a-48a2-be00-905446e6480e gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:01:57.253859 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:01:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e7bae948-167b-4df9-a15c-7c54191c7a6c x-openstack-request-id: req-e7bae948-167b-4df9-a15c-7c54191c7a6c {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:01:57.255124 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "89b4d72b-ae53-4337-b942-67c67b092930", "tag": "513bfcea-f059-4489-894f-16fc8a090aab", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:01:57.255581 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e7bae948-167b-4df9-a15c-7c54191c7a6c {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:01:57.257749 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '89b4d72b-ae53-4337-b942-67c67b092930', 'tag': '513bfcea-f059-4489-894f-16fc8a090aab', 'status': 'completed', 'code': 200} Dec 09 22:01:57.344078 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22cde8fb-fcc5-48c3-9ed7-084ad5ccbd93 req-0f25da7c-873c-4859-bc55-f724cd070548 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:57.345642 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22cde8fb-fcc5-48c3-9ed7-084ad5ccbd93 req-0f25da7c-873c-4859-bc55-f724cd070548 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=fbf735848dcf4d12b202a013c40dbc22&device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 1097 time: 0.0679827 Dec 09 22:01:57.389257 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98e3d464-172b-4465-bec5-36e432471aa9 req-ddb39b23-5095-4d26-a0ac-0b88ae7392aa tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:57.390852 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98e3d464-172b-4465-bec5-36e432471aa9 req-ddb39b23-5095-4d26-a0ac-0b88ae7392aa tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 945 time: 0.0799277 Dec 09 22:01:57.411876 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a1d7ecc4-5f74-403a-b270-90fb75f5ad51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'name': 'tempest-TestVolumeBackupRestore-1315296361-router', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111'}], 'enable_snat': True}, 'gw_port_id': 'd48358d4-545a-4282-816d-a3f37022551e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:56Z', 'revision_number': 4, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'gw_port': {'id': 'd48358d4-545a-4282-816d-a3f37022551e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:41:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4003, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '565414b3-feaa-4ac4-9283-5a140e9e8de2', 'name': '', 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'mac_address': 'fa:16:3e:bf:e6:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_interface', 'standard_attr_id': 4004, 'fixed_ips': [{'subnet_id': '99243393-13ed-459f-904c-d6635896912a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:56Z', 'updated_at': '2021-12-09T21:59:01Z', 'revision_number': 5, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'subnets': [{'id': '99243393-13ed-459f-904c-d6635896912a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:01:57.433900 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:57.438727 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1d7ecc4-5f74-403a-b270-90fb75f5ad51 None None] Checking router: 0d60ac0a-7a8a-48a2-be00-905446e6480e for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:01:57.447661 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a1d7ecc4-5f74-403a-b270-90fb75f5ad51 None None] Routers {'0d60ac0a-7a8a-48a2-be00-905446e6480e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:01:57.448184 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a1d7ecc4-5f74-403a-b270-90fb75f5ad51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:01:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['0d60ac0a-7a8a-48a2-be00-905446e6480e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:01:57.500125 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98e3d464-172b-4465-bec5-36e432471aa9 req-ffa73dbb-b679-4837-b2d5-42d3f90f3bb7 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/security-groups?id=302e1c34-4e37-4e5f-85fc-306fd6b66871&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1001046 Dec 09 22:01:57.501654 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22cde8fb-fcc5-48c3-9ed7-084ad5ccbd93 req-37b8e7fe-2e74-4388-83b9-9d7c93f00454 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:57.503113 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22cde8fb-fcc5-48c3-9ed7-084ad5ccbd93 req-37b8e7fe-2e74-4388-83b9-9d7c93f00454 service neutron] 10.222.0.10 "GET /v2.0/networks?id=7d2b997d-488a-4244-8788-25a6953a7b67 HTTP/1.1" status: 200 len: 915 time: 0.1470244 Dec 09 22:01:57.551940 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22cde8fb-fcc5-48c3-9ed7-084ad5ccbd93 req-d179758e-1629-487b-842c-54c6cd183953 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=513bfcea-f059-4489-894f-16fc8a090aab HTTP/1.1" status: 200 len: 217 time: 0.0404637 Dec 09 22:01:57.610489 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22cde8fb-fcc5-48c3-9ed7-084ad5ccbd93 req-a3ea53da-2f53-4f08-9746-314833d1b00c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:57.611930 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22cde8fb-fcc5-48c3-9ed7-084ad5ccbd93 req-a3ea53da-2f53-4f08-9746-314833d1b00c service neutron] 10.222.0.10 "GET /v2.0/subnets?id=99243393-13ed-459f-904c-d6635896912a HTTP/1.1" status: 200 len: 853 time: 0.0520105 Dec 09 22:01:57.649353 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-a1d7ecc4-5f74-403a-b270-90fb75f5ad51 None None] Set router 0d60ac0a-7a8a-48a2-be00-905446e6480e gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:01:57.651623 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:57.661910 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22cde8fb-fcc5-48c3-9ed7-084ad5ccbd93 req-06df38ea-1a2c-4120-ae13-eff2f317ea4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:57.663568 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22cde8fb-fcc5-48c3-9ed7-084ad5ccbd93 req-06df38ea-1a2c-4120-ae13-eff2f317ea4b service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=7d2b997d-488a-4244-8788-25a6953a7b67&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0417860 Dec 09 22:01:57.761331 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22cde8fb-fcc5-48c3-9ed7-084ad5ccbd93 req-fe132a8f-5797-4a72-9971-1dcc98a83a70 service neutron] 10.222.0.10 "GET /v2.0/networks/7d2b997d-488a-4244-8788-25a6953a7b67?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0896139 Dec 09 22:01:57.848749 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a1d7ecc4-5f74-403a-b270-90fb75f5ad51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'name': 'tempest-TestVolumeBackupRestore-1315296361-router', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111'}], 'enable_snat': True}, 'gw_port_id': 'd48358d4-545a-4282-816d-a3f37022551e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:56Z', 'revision_number': 4, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'gw_port': {'id': 'd48358d4-545a-4282-816d-a3f37022551e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:41:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4003, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '565414b3-feaa-4ac4-9283-5a140e9e8de2', 'name': '', 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'mac_address': 'fa:16:3e:bf:e6:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_interface', 'standard_attr_id': 4004, 'fixed_ips': [{'subnet_id': '99243393-13ed-459f-904c-d6635896912a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:56Z', 'updated_at': '2021-12-09T21:59:01Z', 'revision_number': 5, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'subnets': [{'id': '99243393-13ed-459f-904c-d6635896912a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:01:57.853905 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22cde8fb-fcc5-48c3-9ed7-084ad5ccbd93 req-c08cd1de-b2f7-4a28-873e-b3b562be4cd7 service neutron] 10.222.0.10 "GET /v2.0/networks/7d2b997d-488a-4244-8788-25a6953a7b67?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0849380 Dec 09 22:01:57.878742 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a1d7ecc4-5f74-403a-b270-90fb75f5ad51 None None] The sync data for ids ['0d60ac0a-7a8a-48a2-be00-905446e6480e'] in n-d-713301-27 is: [{'id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'name': 'tempest-TestVolumeBackupRestore-1315296361-router', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111'}], 'enable_snat': True}, 'gw_port_id': 'd48358d4-545a-4282-816d-a3f37022551e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:56Z', 'revision_number': 4, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'gw_port': {'id': 'd48358d4-545a-4282-816d-a3f37022551e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:41:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4003, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '565414b3-feaa-4ac4-9283-5a140e9e8de2', 'name': '', 'network_id': '7d2b997d-488a-4244-8788-25a6953a7b67', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'mac_address': 'fa:16:3e:bf:e6:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_interface', 'standard_attr_id': 4004, 'fixed_ips': [{'subnet_id': '99243393-13ed-459f-904c-d6635896912a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:56Z', 'updated_at': '2021-12-09T21:59:01Z', 'revision_number': 5, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'subnets': [{'id': '99243393-13ed-459f-904c-d6635896912a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:01:58.109807 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3f584c29-b010-4b0f-9d26-eef9e1a6ed08 None None] New status for floating IP 2fd13ae5-7a80-4797-9101-d0e2161f8e26: DOWN {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:01:58.623141 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-510eb545-6b77-4cca-a9e5-07593459abf0 req-4da35e9f-74ed-4e21-9f2d-ae2bd43e0fb5 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:58.624707 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-510eb545-6b77-4cca-a9e5-07593459abf0 req-4da35e9f-74ed-4e21-9f2d-ae2bd43e0fb5 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 945 time: 0.0501201 Dec 09 22:01:58.684612 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-510eb545-6b77-4cca-a9e5-07593459abf0 req-0ba6f5f9-669a-4980-969a-960081ff60f3 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/security-groups?id=302e1c34-4e37-4e5f-85fc-306fd6b66871&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0536580 Dec 09 22:01:58.842558 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaeec112-3ca9-45fb-b00e-626fd5060e68 req-e5fed4fa-8a91-4d2a-b43c-5d505e8b71f2 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:01:58.844162 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eaeec112-3ca9-45fb-b00e-626fd5060e68 req-e5fed4fa-8a91-4d2a-b43c-5d505e8b71f2 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.10 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 945 time: 0.0691609 Dec 09 22:01:58.947581 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-eaeec112-3ca9-45fb-b00e-626fd5060e68 req-a12e98a5-0c78-4364-9c26-536d5333f3e4 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Deleting port 513bfcea-f059-4489-894f-16fc8a090aab {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:01:58.947963 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-eaeec112-3ca9-45fb-b00e-626fd5060e68 req-a12e98a5-0c78-4364-9c26-536d5333f3e4 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:59.046928 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-eaeec112-3ca9-45fb-b00e-626fd5060e68 req-a12e98a5-0c78-4364-9c26-536d5333f3e4 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] For port 513bfcea-f059-4489-894f-16fc8a090aab, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=513bfcea-f059-4489-894f-16fc8a090aab,segment=NetworkSegment(51312a71-17d4-413a-8049-8ec25b223e8b),segment_id=51312a71-17d4-413a-8049-8ec25b223e8b)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:01:59.047296 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-eaeec112-3ca9-45fb-b00e-626fd5060e68 req-a12e98a5-0c78-4364-9c26-536d5333f3e4 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:59.059662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-eaeec112-3ca9-45fb-b00e-626fd5060e68 req-a12e98a5-0c78-4364-9c26-536d5333f3e4 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Calling delete_port for 513bfcea-f059-4489-894f-16fc8a090aab owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:01:59.216734 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-eaeec112-3ca9-45fb-b00e-626fd5060e68 req-a12e98a5-0c78-4364-9c26-536d5333f3e4 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:59.252757 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a12e98a5-0c78-4364-9c26-536d5333f3e4 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Pushing event deleted for resources: {'Port': ['ID=513bfcea-f059-4489-894f-16fc8a090aab,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:01:59.290527 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-eaeec112-3ca9-45fb-b00e-626fd5060e68 req-a12e98a5-0c78-4364-9c26-536d5333f3e4 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] No DVR routers for this DVR port 513bfcea-f059-4489-894f-16fc8a090aab on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:01:59.293537 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-eaeec112-3ca9-45fb-b00e-626fd5060e68 req-a12e98a5-0c78-4364-9c26-536d5333f3e4 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:01:59.297243 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eaeec112-3ca9-45fb-b00e-626fd5060e68 req-a12e98a5-0c78-4364-9c26-536d5333f3e4 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.10 "DELETE /v2.0/ports/513bfcea-f059-4489-894f-16fc8a090aab HTTP/1.1" status: 204 len: 173 time: 0.4467244 Dec 09 22:01:59.297713 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '89b4d72b-ae53-4337-b942-67c67b092930', 'name': 'network-vif-deleted', 'tag': '513bfcea-f059-4489-894f-16fc8a090aab'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:01:59.300503 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2c31877a-0ea3-434f-ac37-82ec463e919b" -d '{"events": [{"server_uuid": "89b4d72b-ae53-4337-b942-67c67b092930", "name": "network-vif-deleted", "tag": "513bfcea-f059-4489-894f-16fc8a090aab"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:01:59.344080 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:01:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ba6257d5-fae7-4c61-8fca-c5056fb60501 x-openstack-request-id: req-ba6257d5-fae7-4c61-8fca-c5056fb60501 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:01:59.344383 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "89b4d72b-ae53-4337-b942-67c67b092930", "name": "network-vif-deleted", "tag": "513bfcea-f059-4489-894f-16fc8a090aab", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:01:59.344641 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-ba6257d5-fae7-4c61-8fca-c5056fb60501 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:01:59.345049 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '89b4d72b-ae53-4337-b942-67c67b092930', 'name': 'network-vif-deleted', 'tag': '513bfcea-f059-4489-894f-16fc8a090aab', 'status': 'completed', 'code': 200} Dec 09 22:01:59.785332 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-05b1ec9f-e4e4-40ff-bdee-6adbadbd5e15 req-b93ed239-7e67-472f-8e50-d032af7389ee tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 210 time: 0.0271993 Dec 09 22:02:00.884278 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98dab25f-7cac-4726-952a-29d77b130948 req-00739225-c0c0-41ba-9fb5-7a03ab16c003 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 210 time: 0.0270813 Dec 09 22:02:01.983592 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eae4da1e-d173-4de3-b457-82bf8ce5a88a req-73889439-0f87-4948-a662-a420d85e099d tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 210 time: 0.0300758 Dec 09 22:02:02.587360 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 513bfcea-f059-4489-894f-16fc8a090aab no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:02:02.608605 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 513bfcea-f059-4489-894f-16fc8a090aab {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:02:02.608944 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 513bfcea-f059-4489-894f-16fc8a090aab not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:02:02.985077 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d9c6d54f-663c-41ad-b4f2-8305d6940e28 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:03.081568 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44c2071d-7660-4b34-a6f4-66a528587deb req-d014bf7f-e3ba-4605-9433-7709f934dd9d tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "GET /v2.0/ports?device_id=89b4d72b-ae53-4337-b942-67c67b092930 HTTP/1.1" status: 200 len: 210 time: 0.0272815 Dec 09 22:02:04.145791 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 57748) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:02:04.206431 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2954341-48c1-4d62-8209-63a2f680e4b8 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:04.236174 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2954341-48c1-4d62-8209-63a2f680e4b8 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:04.296114 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2954341-48c1-4d62-8209-63a2f680e4b8 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:04.298766 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d2954341-48c1-4d62-8209-63a2f680e4b8 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:04.300002 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d2954341-48c1-4d62-8209-63a2f680e4b8 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] 10.222.0.13 "DELETE /v2.0/security-groups/302e1c34-4e37-4e5f-85fc-306fd6b66871 HTTP/1.1" status: 204 len: 168 time: 0.1531792 Dec 09 22:02:04.315558 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2954341-48c1-4d62-8209-63a2f680e4b8 tempest-TestVolumeBackupRestore-1232721580 tempest-TestVolumeBackupRestore-1232721580-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=302e1c34-4e37-4e5f-85fc-306fd6b66871,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:02:05.621630 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d9e5b458-e399-4839-885c-37e480c925fa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:06.748586 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:08.071727 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:08.807431 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58202) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:02:09.164980 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:09.417000 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] Deleting port 565414b3-feaa-4ac4-9283-5a140e9e8de2 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:02:09.417327 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:09.494795 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] For port 565414b3-feaa-4ac4-9283-5a140e9e8de2, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=565414b3-feaa-4ac4-9283-5a140e9e8de2,segment=NetworkSegment(51312a71-17d4-413a-8049-8ec25b223e8b),segment_id=51312a71-17d4-413a-8049-8ec25b223e8b)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:02:09.495043 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:09.513838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] Calling delete_port for 565414b3-feaa-4ac4-9283-5a140e9e8de2 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:02:09.663156 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:09.705509 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:09.730812 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] Pushing event deleted for resources: {'Port': ['ID=565414b3-feaa-4ac4-9283-5a140e9e8de2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:02:09.742925 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:09.743274 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:09.743633 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:09.743967 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:09.744299 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:09.744622 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:09.744984 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:09.745266 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:09.745585 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:09.745912 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:09.746254 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:09.746571 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:09.746891 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:09.909711 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:10.134503 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] Router 0d60ac0a-7a8a-48a2-be00-905446e6480e has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:02:10.254093 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:02:10.259269 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3f8150b7-e2a3-41ae-845b-235a64e4fa78 admin admin] 10.222.0.13 "PUT /v2.0/routers/0d60ac0a-7a8a-48a2-be00-905446e6480e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4507196 Dec 09 22:02:10.261976 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58206) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:02:10.264962 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ba2f923-c241-465b-8f29-58bc84100473 None None] Sync routers for ids ['0d60ac0a-7a8a-48a2-be00-905446e6480e'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:02:10.276089 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ba2f923-c241-465b-8f29-58bc84100473 None None] Routers {'0d60ac0a-7a8a-48a2-be00-905446e6480e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:02:10.276722 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-0ba2f923-c241-465b-8f29-58bc84100473 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:02:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['0d60ac0a-7a8a-48a2-be00-905446e6480e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:02:10.365636 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8afaf54b-59fa-45c8-b4fd-1045deeeac13 admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:10.384055 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-0ba2f923-c241-465b-8f29-58bc84100473 None None] Set router 0d60ac0a-7a8a-48a2-be00-905446e6480e gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:02:10.569156 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-0ba2f923-c241-465b-8f29-58bc84100473 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'name': 'tempest-TestVolumeBackupRestore-1315296361-router', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111'}], 'enable_snat': True}, 'gw_port_id': 'd48358d4-545a-4282-816d-a3f37022551e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T22:02:09Z', 'revision_number': 5, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'gw_port': {'id': 'd48358d4-545a-4282-816d-a3f37022551e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:41:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4003, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:02:10.600949 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ba2f923-c241-465b-8f29-58bc84100473 None None] Checking router: 0d60ac0a-7a8a-48a2-be00-905446e6480e for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:02:10.610440 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ba2f923-c241-465b-8f29-58bc84100473 None None] Routers {'0d60ac0a-7a8a-48a2-be00-905446e6480e'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:02:10.611046 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-0ba2f923-c241-465b-8f29-58bc84100473 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:02:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['0d60ac0a-7a8a-48a2-be00-905446e6480e'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:02:10.719366 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-0ba2f923-c241-465b-8f29-58bc84100473 None None] Set router 0d60ac0a-7a8a-48a2-be00-905446e6480e gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:02:10.818517 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8afaf54b-59fa-45c8-b4fd-1045deeeac13 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:10.871888 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-8afaf54b-59fa-45c8-b4fd-1045deeeac13 admin admin] Deleting port d48358d4-545a-4282-816d-a3f37022551e {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:02:10.872229 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8afaf54b-59fa-45c8-b4fd-1045deeeac13 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:10.899405 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-0ba2f923-c241-465b-8f29-58bc84100473 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'name': 'tempest-TestVolumeBackupRestore-1315296361-router', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111'}], 'enable_snat': True}, 'gw_port_id': 'd48358d4-545a-4282-816d-a3f37022551e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T22:02:09Z', 'revision_number': 5, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'gw_port': {'id': 'd48358d4-545a-4282-816d-a3f37022551e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:41:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4003, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:02:10.925363 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ba2f923-c241-465b-8f29-58bc84100473 None None] The sync data for ids ['0d60ac0a-7a8a-48a2-be00-905446e6480e'] in n-d-713301-27 is: [{'id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'name': 'tempest-TestVolumeBackupRestore-1315296361-router', 'tenant_id': 'fbf735848dcf4d12b202a013c40dbc22', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111'}], 'enable_snat': True}, 'gw_port_id': 'd48358d4-545a-4282-816d-a3f37022551e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T22:02:09Z', 'revision_number': 5, 'project_id': 'fbf735848dcf4d12b202a013c40dbc22', 'gw_port': {'id': 'd48358d4-545a-4282-816d-a3f37022551e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:98:41:df', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d60ac0a-7a8a-48a2-be00-905446e6480e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4003, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.111', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:54Z', 'updated_at': '2021-12-09T21:58:57Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:02:10.950377 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-8afaf54b-59fa-45c8-b4fd-1045deeeac13 admin admin] For port d48358d4-545a-4282-816d-a3f37022551e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d48358d4-545a-4282-816d-a3f37022551e,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:02:10.950872 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8afaf54b-59fa-45c8-b4fd-1045deeeac13 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:10.967155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-8afaf54b-59fa-45c8-b4fd-1045deeeac13 admin admin] Calling delete_port for d48358d4-545a-4282-816d-a3f37022551e owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:02:11.138080 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8afaf54b-59fa-45c8-b4fd-1045deeeac13 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:11.166625 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8afaf54b-59fa-45c8-b4fd-1045deeeac13 admin admin] Pushing event deleted for resources: {'Port': ['ID=d48358d4-545a-4282-816d-a3f37022551e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:02:11.180723 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2bb5a813-7aab-4cf8-8666-951ff6e0a590 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:02:11.228017 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8afaf54b-59fa-45c8-b4fd-1045deeeac13 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:11.325771 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8afaf54b-59fa-45c8-b4fd-1045deeeac13 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:11.328272 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8afaf54b-59fa-45c8-b4fd-1045deeeac13 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:11.381198 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8afaf54b-59fa-45c8-b4fd-1045deeeac13 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:11.381898 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8afaf54b-59fa-45c8-b4fd-1045deeeac13 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0d60ac0a-7a8a-48a2-be00-905446e6480e {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 22:02:11.386630 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8afaf54b-59fa-45c8-b4fd-1045deeeac13 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:11.388270 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8afaf54b-59fa-45c8-b4fd-1045deeeac13 admin admin] 10.222.0.13 "DELETE /v2.0/routers/0d60ac0a-7a8a-48a2-be00-905446e6480e HTTP/1.1" status: 204 len: 168 time: 1.1253016 Dec 09 22:02:11.391120 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58208) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:02:11.445174 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-a307b99d-e918-49d7-a2ea-8aa482f7d3a5 admin admin] Deleting subnet 99243393-13ed-459f-904c-d6635896912a {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:02:11.448551 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a307b99d-e918-49d7-a2ea-8aa482f7d3a5 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:11.478730 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 565414b3-feaa-4ac4-9283-5a140e9e8de2 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:02:11.488611 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a307b99d-e918-49d7-a2ea-8aa482f7d3a5 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:11.500086 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 565414b3-feaa-4ac4-9283-5a140e9e8de2 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:02:11.500427 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 565414b3-feaa-4ac4-9283-5a140e9e8de2 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:02:11.569699 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a307b99d-e918-49d7-a2ea-8aa482f7d3a5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:11.623698 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a307b99d-e918-49d7-a2ea-8aa482f7d3a5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:11.648695 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a307b99d-e918-49d7-a2ea-8aa482f7d3a5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=99243393-13ed-459f-904c-d6635896912a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:02:11.652393 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a307b99d-e918-49d7-a2ea-8aa482f7d3a5 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:11.655763 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a307b99d-e918-49d7-a2ea-8aa482f7d3a5 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/99243393-13ed-459f-904c-d6635896912a HTTP/1.1" status: 204 len: 168 time: 0.2634585 Dec 09 22:02:11.658117 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c0d1c7e-a2aa-4d89-94e1-54c2b4c71635 None None] Network 7d2b997d-488a-4244-8788-25a6953a7b67 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:02:11.658805 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58210) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:02:11.728693 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b25a57bb-284e-4e13-87d4-52a46427606e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:11.783190 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-b25a57bb-284e-4e13-87d4-52a46427606e admin admin] Deleting port b65c71ad-25bd-4721-97bc-96c821017151 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:02:11.783571 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b25a57bb-284e-4e13-87d4-52a46427606e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:11.849711 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-b25a57bb-284e-4e13-87d4-52a46427606e admin admin] For port b65c71ad-25bd-4721-97bc-96c821017151, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b65c71ad-25bd-4721-97bc-96c821017151,segment=NetworkSegment(51312a71-17d4-413a-8049-8ec25b223e8b),segment_id=51312a71-17d4-413a-8049-8ec25b223e8b)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:02:11.850077 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b25a57bb-284e-4e13-87d4-52a46427606e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:11.863167 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-b25a57bb-284e-4e13-87d4-52a46427606e admin admin] Calling delete_port for b65c71ad-25bd-4721-97bc-96c821017151 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:02:11.954697 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b25a57bb-284e-4e13-87d4-52a46427606e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:11.955417 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a3c1991-b32c-4cdb-8bdc-30699430bfa7 None None] DHCP port deletion for 7d2b997d-488a-4244-8788-25a6953a7b67 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:02:11.983065 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b25a57bb-284e-4e13-87d4-52a46427606e admin admin] Pushing event deleted for resources: {'Port': ['ID=b65c71ad-25bd-4721-97bc-96c821017151,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:02:11.986593 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b25a57bb-284e-4e13-87d4-52a46427606e admin admin] No DVR routers for this DVR port b65c71ad-25bd-4721-97bc-96c821017151 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:02:12.063719 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b25a57bb-284e-4e13-87d4-52a46427606e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:12.085372 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-b25a57bb-284e-4e13-87d4-52a46427606e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7d2b997d-488a-4244-8788-25a6953a7b67']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:02:12.094970 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-b25a57bb-284e-4e13-87d4-52a46427606e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '51312a71-17d4-413a-8049-8ec25b223e8b') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:02:12.095263 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-b25a57bb-284e-4e13-87d4-52a46427606e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '51312a71-17d4-413a-8049-8ec25b223e8b') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:02:12.105531 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b25a57bb-284e-4e13-87d4-52a46427606e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:12.121243 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b25a57bb-284e-4e13-87d4-52a46427606e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:12.127151 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b25a57bb-284e-4e13-87d4-52a46427606e admin admin] Releasing vlan 105 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:02:12.127564 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b25a57bb-284e-4e13-87d4-52a46427606e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: timer() Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:02:12.129188 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:02:12.186849 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b25a57bb-284e-4e13-87d4-52a46427606e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:12.192203 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b25a57bb-284e-4e13-87d4-52a46427606e admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:12.195300 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b25a57bb-284e-4e13-87d4-52a46427606e admin admin] 10.222.0.13 "DELETE /v2.0/networks/7d2b997d-488a-4244-8788-25a6953a7b67 HTTP/1.1" status: 204 len: 168 time: 0.5353200 Dec 09 22:02:12.198502 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58212) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:02:12.206561 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b25a57bb-284e-4e13-87d4-52a46427606e admin admin] Pushing event deleted for resources: {'Network': ['ID=7d2b997d-488a-4244-8788-25a6953a7b67,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:02:12.598090 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8c4fd6e3-f449-407b-905f-cb56df0435fe admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:12.863516 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-8c4fd6e3-f449-407b-905f-cb56df0435fe admin admin] Deleting port 6576f85b-e71d-4fbc-b002-a724de69ef07 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:02:12.863795 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8c4fd6e3-f449-407b-905f-cb56df0435fe admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:12.952044 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-8c4fd6e3-f449-407b-905f-cb56df0435fe admin admin] For port 6576f85b-e71d-4fbc-b002-a724de69ef07, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6576f85b-e71d-4fbc-b002-a724de69ef07,segment=NetworkSegment(62b79127-8016-490f-b1dd-c0016e8eff44),segment_id=62b79127-8016-490f-b1dd-c0016e8eff44)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:02:12.952401 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8c4fd6e3-f449-407b-905f-cb56df0435fe admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:12.965393 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-8c4fd6e3-f449-407b-905f-cb56df0435fe admin admin] Calling delete_port for 6576f85b-e71d-4fbc-b002-a724de69ef07 owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:02:13.416669 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8c4fd6e3-f449-407b-905f-cb56df0435fe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:13.422422 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d48358d4-545a-4282-816d-a3f37022551e no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:02:13.445721 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c4fd6e3-f449-407b-905f-cb56df0435fe admin admin] Pushing event deleted for resources: {'Port': ['ID=6576f85b-e71d-4fbc-b002-a724de69ef07,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:02:13.447223 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: d48358d4-545a-4282-816d-a3f37022551e {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:02:13.447223 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d48358d4-545a-4282-816d-a3f37022551e not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:02:13.447766 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b65c71ad-25bd-4721-97bc-96c821017151 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:02:13.470034 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: b65c71ad-25bd-4721-97bc-96c821017151 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:02:13.470564 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b65c71ad-25bd-4721-97bc-96c821017151 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:02:13.609212 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8c4fd6e3-f449-407b-905f-cb56df0435fe admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:13.821689 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8c4fd6e3-f449-407b-905f-cb56df0435fe admin admin] Router fa62ad77-eb7a-463b-820a-5cf17642dec6 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:02:13.950895 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8c4fd6e3-f449-407b-905f-cb56df0435fe admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:02:13.956169 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8c4fd6e3-f449-407b-905f-cb56df0435fe admin admin] 10.222.0.13 "PUT /v2.0/routers/fa62ad77-eb7a-463b-820a-5cf17642dec6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7566254 Dec 09 22:02:13.959005 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58214) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:02:13.960549 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80d1fef0-a4fd-420f-bc51-552edd75fd66 None None] Sync routers for ids ['fa62ad77-eb7a-463b-820a-5cf17642dec6'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:02:13.972747 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80d1fef0-a4fd-420f-bc51-552edd75fd66 None None] Routers {'fa62ad77-eb7a-463b-820a-5cf17642dec6'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:02:13.973365 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-80d1fef0-a4fd-420f-bc51-552edd75fd66 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:02:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['fa62ad77-eb7a-463b-820a-5cf17642dec6'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:02:14.064961 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0c918c3b-6318-4716-ac90-b627c8664652 admin admin] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:14.077803 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-80d1fef0-a4fd-420f-bc51-552edd75fd66 None None] Set router fa62ad77-eb7a-463b-820a-5cf17642dec6 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:02:14.169689 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0c918c3b-6318-4716-ac90-b627c8664652 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:14.225213 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-0c918c3b-6318-4716-ac90-b627c8664652 admin admin] Deleting port c64af06f-73c3-4030-857c-512cbfe1631e {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:02:14.225475 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0c918c3b-6318-4716-ac90-b627c8664652 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:14.254993 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-80d1fef0-a4fd-420f-bc51-552edd75fd66 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa62ad77-eb7a-463b-820a-5cf17642dec6', 'name': 'tempest-TestVolumeBackupRestore-929229115-router', 'tenant_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.79'}], 'enable_snat': True}, 'gw_port_id': 'c64af06f-73c3-4030-857c-512cbfe1631e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:58Z', 'updated_at': '2021-12-09T22:02:13Z', 'revision_number': 5, 'project_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'gw_port': {'id': 'c64af06f-73c3-4030-857c-512cbfe1631e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:af:db:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa62ad77-eb7a-463b-820a-5cf17642dec6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4015, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.79', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:58:59Z', 'updated_at': '2021-12-09T21:59:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:02:14.282301 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80d1fef0-a4fd-420f-bc51-552edd75fd66 None None] Checking router: fa62ad77-eb7a-463b-820a-5cf17642dec6 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:02:14.290761 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80d1fef0-a4fd-420f-bc51-552edd75fd66 None None] Routers {'fa62ad77-eb7a-463b-820a-5cf17642dec6'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:02:14.291380 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-80d1fef0-a4fd-420f-bc51-552edd75fd66 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:02:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['fa62ad77-eb7a-463b-820a-5cf17642dec6'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:02:14.309706 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-0c918c3b-6318-4716-ac90-b627c8664652 admin admin] For port c64af06f-73c3-4030-857c-512cbfe1631e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c64af06f-73c3-4030-857c-512cbfe1631e,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:02:14.310069 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0c918c3b-6318-4716-ac90-b627c8664652 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:14.321927 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-0c918c3b-6318-4716-ac90-b627c8664652 admin admin] Calling delete_port for c64af06f-73c3-4030-857c-512cbfe1631e owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:02:14.378003 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-80d1fef0-a4fd-420f-bc51-552edd75fd66 None None] Set router fa62ad77-eb7a-463b-820a-5cf17642dec6 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:02:14.431903 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-80d1fef0-a4fd-420f-bc51-552edd75fd66 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fa62ad77-eb7a-463b-820a-5cf17642dec6', 'name': 'tempest-TestVolumeBackupRestore-929229115-router', 'tenant_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:58Z', 'updated_at': '2021-12-09T22:02:14Z', 'revision_number': 6, 'project_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:02:14.458349 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80d1fef0-a4fd-420f-bc51-552edd75fd66 None None] The sync data for ids ['fa62ad77-eb7a-463b-820a-5cf17642dec6'] in n-d-713301-27 is: [{'id': 'fa62ad77-eb7a-463b-820a-5cf17642dec6', 'name': 'tempest-TestVolumeBackupRestore-929229115-router', 'tenant_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:58:58Z', 'updated_at': '2021-12-09T22:02:14Z', 'revision_number': 6, 'project_id': '4fd5bf27e9dc4615b74a0e66b330b7a2', 'gw_port_host': None}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:02:14.500171 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0c918c3b-6318-4716-ac90-b627c8664652 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:14.524231 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c918c3b-6318-4716-ac90-b627c8664652 admin admin] Pushing event deleted for resources: {'Port': ['ID=c64af06f-73c3-4030-857c-512cbfe1631e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:02:14.539773 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f26adc72-03a9-47b4-b27d-4e68a2b8ff65 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:02:14.585083 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0c918c3b-6318-4716-ac90-b627c8664652 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:14.680307 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0c918c3b-6318-4716-ac90-b627c8664652 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:14.682519 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0c918c3b-6318-4716-ac90-b627c8664652 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:14.735033 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0c918c3b-6318-4716-ac90-b627c8664652 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:14.735565 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0c918c3b-6318-4716-ac90-b627c8664652 admin admin] Fanout notify agent at l3_agent the message router_deleted on router fa62ad77-eb7a-463b-820a-5cf17642dec6 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 22:02:14.740258 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-0c918c3b-6318-4716-ac90-b627c8664652 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:14.741420 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-0c918c3b-6318-4716-ac90-b627c8664652 admin admin] 10.222.0.13 "DELETE /v2.0/routers/fa62ad77-eb7a-463b-820a-5cf17642dec6 HTTP/1.1" status: 204 len: 168 time: 0.7814934 Dec 09 22:02:14.744147 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58216) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:02:14.789000 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-c2550d93-3b8d-48a4-a371-6d42065cafea admin admin] Deleting subnet 53871afb-219b-4853-8669-d625f98b4a10 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:02:14.792127 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c2550d93-3b8d-48a4-a371-6d42065cafea admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:14.829385 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c2550d93-3b8d-48a4-a371-6d42065cafea admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:14.914866 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c2550d93-3b8d-48a4-a371-6d42065cafea admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:14.974697 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c2550d93-3b8d-48a4-a371-6d42065cafea admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:15.005612 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c2550d93-3b8d-48a4-a371-6d42065cafea admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:15.008987 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c2550d93-3b8d-48a4-a371-6d42065cafea admin admin] 10.222.0.13 "DELETE /v2.0/subnets/53871afb-219b-4853-8669-d625f98b4a10 HTTP/1.1" status: 204 len: 168 time: 0.2638884 Dec 09 22:02:15.010431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2550d93-3b8d-48a4-a371-6d42065cafea admin admin] Pushing event deleted for resources: {'Subnet': ['ID=53871afb-219b-4853-8669-d625f98b4a10,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:02:15.010613 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2df1f911-5d0d-4c2b-b3f6-a8a2007441fd None None] Network 89e8de90-a18a-43c7-9ef0-8220654a3666 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:02:15.011563 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58218) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:02:15.081670 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-535fe2cf-c062-454c-9df5-2cb5753bced1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:15.136959 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-535fe2cf-c062-454c-9df5-2cb5753bced1 admin admin] Deleting port f8c42185-cce2-4d11-8132-809bd1768950 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:02:15.137308 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-535fe2cf-c062-454c-9df5-2cb5753bced1 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:15.200832 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:02:15.205024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-535fe2cf-c062-454c-9df5-2cb5753bced1 admin admin] For port f8c42185-cce2-4d11-8132-809bd1768950, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f8c42185-cce2-4d11-8132-809bd1768950,segment=NetworkSegment(62b79127-8016-490f-b1dd-c0016e8eff44),segment_id=62b79127-8016-490f-b1dd-c0016e8eff44)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:02:15.205399 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-535fe2cf-c062-454c-9df5-2cb5753bced1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:15.219034 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-535fe2cf-c062-454c-9df5-2cb5753bced1 admin admin] Calling delete_port for f8c42185-cce2-4d11-8132-809bd1768950 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:02:15.226343 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5c901f0-af10-4210-b57e-ac7bee9dd721 None None] DHCP port deletion for 89e8de90-a18a-43c7-9ef0-8220654a3666 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:02:15.279265 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e5c901f0-af10-4210-b57e-ac7bee9dd721 None None] Deleting port f8c42185-cce2-4d11-8132-809bd1768950 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:02:15.279564 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e5c901f0-af10-4210-b57e-ac7bee9dd721 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:15.300787 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-535fe2cf-c062-454c-9df5-2cb5753bced1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:15.331247 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-535fe2cf-c062-454c-9df5-2cb5753bced1 admin admin] Pushing event deleted for resources: {'Port': ['ID=f8c42185-cce2-4d11-8132-809bd1768950,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:02:15.335399 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-535fe2cf-c062-454c-9df5-2cb5753bced1 admin admin] No DVR routers for this DVR port f8c42185-cce2-4d11-8132-809bd1768950 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:02:15.353674 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e5c901f0-af10-4210-b57e-ac7bee9dd721 None None] For port f8c42185-cce2-4d11-8132-809bd1768950, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f8c42185-cce2-4d11-8132-809bd1768950,segment=NetworkSegment(62b79127-8016-490f-b1dd-c0016e8eff44),segment_id=62b79127-8016-490f-b1dd-c0016e8eff44)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:02:15.354085 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e5c901f0-af10-4210-b57e-ac7bee9dd721 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:15.371089 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-e5c901f0-af10-4210-b57e-ac7bee9dd721 None None] Calling delete_port for f8c42185-cce2-4d11-8132-809bd1768950 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:02:15.416594 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-535fe2cf-c062-454c-9df5-2cb5753bced1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:15.437437 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f8c42185-cce2-4d11-8132-809bd1768950 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:02:15.441217 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-535fe2cf-c062-454c-9df5-2cb5753bced1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['89e8de90-a18a-43c7-9ef0-8220654a3666']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:02:15.452248 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-535fe2cf-c062-454c-9df5-2cb5753bced1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '62b79127-8016-490f-b1dd-c0016e8eff44') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:02:15.452676 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-535fe2cf-c062-454c-9df5-2cb5753bced1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '62b79127-8016-490f-b1dd-c0016e8eff44') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:02:15.466677 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: f8c42185-cce2-4d11-8132-809bd1768950 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:02:15.467069 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f8c42185-cce2-4d11-8132-809bd1768950 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:02:15.467740 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c64af06f-73c3-4030-857c-512cbfe1631e no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:02:15.468436 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-535fe2cf-c062-454c-9df5-2cb5753bced1 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:15.482613 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-535fe2cf-c062-454c-9df5-2cb5753bced1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:15.490647 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-535fe2cf-c062-454c-9df5-2cb5753bced1 admin admin] Releasing vlan 130 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:02:15.491265 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-535fe2cf-c062-454c-9df5-2cb5753bced1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: timer() Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:02:15.493453 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:02:15.495531 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: c64af06f-73c3-4030-857c-512cbfe1631e {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:02:15.495531 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c64af06f-73c3-4030-857c-512cbfe1631e not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:02:15.495531 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6576f85b-e71d-4fbc-b002-a724de69ef07 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:02:15.516276 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 6576f85b-e71d-4fbc-b002-a724de69ef07 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:02:15.516276 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6576f85b-e71d-4fbc-b002-a724de69ef07 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:02:15.519331 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e5c901f0-af10-4210-b57e-ac7bee9dd721 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:15.544211 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5c901f0-af10-4210-b57e-ac7bee9dd721 None None] Pushing event deleted for resources: {'Port': ['ID=f8c42185-cce2-4d11-8132-809bd1768950,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:02:15.553353 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5c901f0-af10-4210-b57e-ac7bee9dd721 None None] No DVR routers for this DVR port f8c42185-cce2-4d11-8132-809bd1768950 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:02:15.555756 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5c901f0-af10-4210-b57e-ac7bee9dd721 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:15.556170 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5c901f0-af10-4210-b57e-ac7bee9dd721 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:15.556863 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5c901f0-af10-4210-b57e-ac7bee9dd721 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:15.557108 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5c901f0-af10-4210-b57e-ac7bee9dd721 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:15.557444 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5c901f0-af10-4210-b57e-ac7bee9dd721 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:15.557967 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5c901f0-af10-4210-b57e-ac7bee9dd721 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:15.558263 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5c901f0-af10-4210-b57e-ac7bee9dd721 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:15.558619 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5c901f0-af10-4210-b57e-ac7bee9dd721 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:15.558953 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5c901f0-af10-4210-b57e-ac7bee9dd721 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:15.559278 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5c901f0-af10-4210-b57e-ac7bee9dd721 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:15.559620 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5c901f0-af10-4210-b57e-ac7bee9dd721 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:15.560113 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5c901f0-af10-4210-b57e-ac7bee9dd721 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:15.560597 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e5c901f0-af10-4210-b57e-ac7bee9dd721 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:02:15.569613 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-535fe2cf-c062-454c-9df5-2cb5753bced1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:15.579967 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-535fe2cf-c062-454c-9df5-2cb5753bced1 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:15.583503 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-535fe2cf-c062-454c-9df5-2cb5753bced1 admin admin] 10.222.0.13 "DELETE /v2.0/networks/89e8de90-a18a-43c7-9ef0-8220654a3666 HTTP/1.1" status: 204 len: 168 time: 0.5699303 Dec 09 22:02:15.597031 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-535fe2cf-c062-454c-9df5-2cb5753bced1 admin admin] Pushing event deleted for resources: {'Network': ['ID=89e8de90-a18a-43c7-9ef0-8220654a3666,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:02:15.767078 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58222) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:02:15.809336 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4067706b-db86-48be-b1ab-2d536b54827b admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=fbf735848dcf4d12b202a013c40dbc22&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0408981 Dec 09 22:02:15.811988 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58224) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:02:15.862759 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-672c2b04-1765-4f5e-9f51-77c1c3303ffc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:15.889124 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-672c2b04-1765-4f5e-9f51-77c1c3303ffc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:15.938282 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-672c2b04-1765-4f5e-9f51-77c1c3303ffc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:15.941165 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-672c2b04-1765-4f5e-9f51-77c1c3303ffc admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:15.942315 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-672c2b04-1765-4f5e-9f51-77c1c3303ffc admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/81e616cb-d65d-4295-8236-a6b64ea5fcd0 HTTP/1.1" status: 204 len: 168 time: 0.1293991 Dec 09 22:02:15.950591 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-672c2b04-1765-4f5e-9f51-77c1c3303ffc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=81e616cb-d65d-4295-8236-a6b64ea5fcd0,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:02:16.276154 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58230) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:02:16.317301 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-508bf23f-6d11-4b14-bafb-6d95f02c62a1 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=4fd5bf27e9dc4615b74a0e66b330b7a2&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0398724 Dec 09 22:02:16.319829 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58232) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:02:16.370675 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62eac8c4-7dc2-4793-81a3-8d5364b2cd55 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:16.394808 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62eac8c4-7dc2-4793-81a3-8d5364b2cd55 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:16.448008 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62eac8c4-7dc2-4793-81a3-8d5364b2cd55 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:16.450699 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62eac8c4-7dc2-4793-81a3-8d5364b2cd55 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:16.451879 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-62eac8c4-7dc2-4793-81a3-8d5364b2cd55 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/1046cd49-cb0d-4896-b1f7-64feb372796d HTTP/1.1" status: 204 len: 168 time: 0.1310177 Dec 09 22:02:16.459632 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62eac8c4-7dc2-4793-81a3-8d5364b2cd55 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1046cd49-cb0d-4896-b1f7-64feb372796d,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:02:27.440690 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:27.675143 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:32.993294 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a160f68d-dc34-434e-a388-621d4351e535 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:35.607759 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-77ccaea1-902d-4bac-9307-7f078b37a826 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:36.751102 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:38.080791 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:39.668377 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:42.129947 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-33a10a2f-6f37-4ffa-aeb2-05f0e2be4e25 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1956229723&fields=id&tenant_id=be526cfddc4f4783b993a3f6e5b5e630 HTTP/1.1" status: 200 len: 267 time: 0.0564120 Dec 09 22:02:42.249153 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-745da108-518f-4c01-8ffa-b0c5ca0f4977 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:42.250729 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-745da108-518f-4c01-8ffa-b0c5ca0f4977 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 810 time: 0.1132247 Dec 09 22:02:42.270100 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-a62bdafa-e8b3-4748-bc73-3a3aeafcb10f tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/quotas/be526cfddc4f4783b993a3f6e5b5e630 HTTP/1.1" status: 200 len: 375 time: 0.0108232 Dec 09 22:02:42.328853 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-74c0a4fb-3e88-4ca0-9488-59745fc94322 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0526381 Dec 09 22:02:42.432045 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-067d0782-7a09-4e1f-a4e7-e0e44d65722b service neutron] 10.222.0.13 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0903652 Dec 09 22:02:42.523042 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-31553f32-6689-4069-bafc-cc9bfc874a48 service neutron] 10.222.0.13 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847199 Dec 09 22:02:42.820261 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1bafbe60-9484-4320-8c1b-56e0330b1ab9 req-a7e8cd66-4410-4dfc-91d2-b07640e511e3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 210 time: 0.0315633 Dec 09 22:02:43.734046 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-bb455299-687b-4d9e-8bf3-4a6b11f6a3fa tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:43.735518 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-bb455299-687b-4d9e-8bf3-4a6b11f6a3fa tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.10 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 810 time: 0.1016204 Dec 09 22:02:43.803627 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-e0eb1110-cbcf-4fe7-9948-f1f2fc10c291 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.10 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=be526cfddc4f4783b993a3f6e5b5e630 HTTP/1.1" status: 200 len: 380 time: 0.0577352 Dec 09 22:02:43.812822 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-fdcaf408-7fac-4107-b4f1-1c8dc9df66a3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Request body: {'port': {'device_id': 'b1351705-30cf-41ea-9aa5-a1839969cc2d', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'admin_state_up': True, 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'security_groups': ['aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:02:43.933638 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e3a7502-a14e-47f7-ac19-b2d479957b4f req-84650f54-ab37-418d-9652-e333076318fa tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 210 time: 0.0358238 Dec 09 22:02:43.958060 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-fdcaf408-7fac-4107-b4f1-1c8dc9df66a3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Made reservation on behalf of be526cfddc4f4783b993a3f6e5b5e630 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:02:43.961704 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-fdcaf408-7fac-4107-b4f1-1c8dc9df66a3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:44.090914 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-fdcaf408-7fac-4107-b4f1-1c8dc9df66a3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Allocated IP 172.20.0.9 (486ad174-ad0c-4065-a4b6-6f9af6b2a208/7004626f-deda-4ef1-8abe-97a447b2d2e9/ca52519f-6403-4107-bf09-14de9a102b79) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:02:44.229157 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-fdcaf408-7fac-4107-b4f1-1c8dc9df66a3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:44.270594 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-fdcaf408-7fac-4107-b4f1-1c8dc9df66a3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:44.311963 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-fdcaf408-7fac-4107-b4f1-1c8dc9df66a3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:02:44.315151 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-fdcaf408-7fac-4107-b4f1-1c8dc9df66a3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:02:44.321792 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-fdcaf408-7fac-4107-b4f1-1c8dc9df66a3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:02:44.328917 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdcaf408-7fac-4107-b4f1-1c8dc9df66a3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event updated for resources: {'Port': ['ID=ca52519f-6403-4107-bf09-14de9a102b79,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:02:44.376887 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-fdcaf408-7fac-4107-b4f1-1c8dc9df66a3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:44.377810 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-fdcaf408-7fac-4107-b4f1-1c8dc9df66a3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:44.396311 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-fdcaf408-7fac-4107-b4f1-1c8dc9df66a3 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5871530 Dec 09 22:02:44.408428 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-56cb1f5f-fdd7-46dc-83e2-bdb3c431d187 service neutron] Request body: {'port': {'device_id': 'b1351705-30cf-41ea-9aa5-a1839969cc2d', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:02:44.471605 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-56cb1f5f-fdd7-46dc-83e2-bdb3c431d187 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:44.532799 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6487fa7a-3cc8-47e3-a095-fac393bc6365 None None] Provisioning complete for port ca52519f-6403-4107-bf09-14de9a102b79 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:02:44.533366 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6487fa7a-3cc8-47e3-a095-fac393bc6365 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:44.573467 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-6487fa7a-3cc8-47e3-a095-fac393bc6365 None None] Port ca52519f-6403-4107-bf09-14de9a102b79 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:02:44.748049 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-56cb1f5f-fdd7-46dc-83e2-bdb3c431d187 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ca52519f-6403-4107-bf09-14de9a102b79 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:02:44.756055 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-56cb1f5f-fdd7-46dc-83e2-bdb3c431d187 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:44.768111 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-56cb1f5f-fdd7-46dc-83e2-bdb3c431d187 service neutron] Transition to ACTIVE for port object ca52519f-6403-4107-bf09-14de9a102b79 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:02:44.773010 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-56cb1f5f-fdd7-46dc-83e2-bdb3c431d187 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:44.841935 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56cb1f5f-fdd7-46dc-83e2-bdb3c431d187 service neutron] Pushing event updated for resources: {'Port': ['ID=ca52519f-6403-4107-bf09-14de9a102b79,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:02:44.905883 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-56cb1f5f-fdd7-46dc-83e2-bdb3c431d187 service neutron] Attempting to bind port ca52519f-6403-4107-bf09-14de9a102b79 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:02:44.907229 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-56cb1f5f-fdd7-46dc-83e2-bdb3c431d187 service neutron] Attempting to bind port ca52519f-6403-4107-bf09-14de9a102b79 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:02:44.907883 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-56cb1f5f-fdd7-46dc-83e2-bdb3c431d187 service neutron] Attempting to bind port ca52519f-6403-4107-bf09-14de9a102b79 on network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:02:44.913240 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-56cb1f5f-fdd7-46dc-83e2-bdb3c431d187 service neutron] Port ca52519f-6403-4107-bf09-14de9a102b79 on network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:02:44.913562 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-56cb1f5f-fdd7-46dc-83e2-bdb3c431d187 service neutron] Attempting to bind port ca52519f-6403-4107-bf09-14de9a102b79 on network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:02:44.918971 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-56cb1f5f-fdd7-46dc-83e2-bdb3c431d187 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 2, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:02:44.919301 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-56cb1f5f-fdd7-46dc-83e2-bdb3c431d187 service neutron] Checking segment: {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:02:44.919711 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-56cb1f5f-fdd7-46dc-83e2-bdb3c431d187 service neutron] Bound using segment: {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:02:44.920278 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-56cb1f5f-fdd7-46dc-83e2-bdb3c431d187 service neutron] Bound port: ca52519f-6403-4107-bf09-14de9a102b79, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'efd99328-8749-4154-94c0-14d978d592d7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 124, 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:02:44.920668 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-56cb1f5f-fdd7-46dc-83e2-bdb3c431d187 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:44.991633 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-56cb1f5f-fdd7-46dc-83e2-bdb3c431d187 service neutron] For port ca52519f-6403-4107-bf09-14de9a102b79, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:02:44.995023 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-56cb1f5f-fdd7-46dc-83e2-bdb3c431d187 service neutron] For port ca52519f-6403-4107-bf09-14de9a102b79, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=ca52519f-6403-4107-bf09-14de9a102b79,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:02:45.003546 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-56cb1f5f-fdd7-46dc-83e2-bdb3c431d187 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:45.051308 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-56cb1f5f-fdd7-46dc-83e2-bdb3c431d187 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:45.052111 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-56cb1f5f-fdd7-46dc-83e2-bdb3c431d187 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:45.053871 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-56cb1f5f-fdd7-46dc-83e2-bdb3c431d187 service neutron] 10.222.0.10 "PUT /v2.0/ports/ca52519f-6403-4107-bf09-14de9a102b79 HTTP/1.1" status: 200 len: 1092 time: 0.6497264 Dec 09 22:02:45.054389 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b1351705-30cf-41ea-9aa5-a1839969cc2d', 'tag': 'ca52519f-6403-4107-bf09-14de9a102b79'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:02:45.056909 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8963bc75-bd2c-4b3a-97f7-c4a50958bae4" -d '{"events": [{"name": "network-changed", "server_uuid": "b1351705-30cf-41ea-9aa5-a1839969cc2d", "tag": "ca52519f-6403-4107-bf09-14de9a102b79"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:02:45.082624 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56cb1f5f-fdd7-46dc-83e2-bdb3c431d187 service neutron] Pushing event updated for resources: {'Port': ['ID=ca52519f-6403-4107-bf09-14de9a102b79,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:02:45.175905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-5f92b5eb-6b53-4a9d-b1c8-4fd812d9db58 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:45.178257 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-5f92b5eb-6b53-4a9d-b1c8-4fd812d9db58 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 1095 time: 0.0739462 Dec 09 22:02:45.233790 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-1dc56b3b-6e6a-4f7c-ad0d-d4e195ffe682 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ca52519f-6403-4107-bf09-14de9a102b79 HTTP/1.1" status: 200 len: 217 time: 0.0468664 Dec 09 22:02:45.324211 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-771a2abd-8bc5-497f-b444-93b00f2271bf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:45.326319 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-771a2abd-8bc5-497f-b444-93b00f2271bf service neutron] 10.222.0.10 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0848899 Dec 09 22:02:45.385712 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9116a773-b741-4833-9332-dbac94bba9d0 req-530faf16-92d5-4adb-b0fb-b720aa76b494 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:45.387384 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9116a773-b741-4833-9332-dbac94bba9d0 req-530faf16-92d5-4adb-b0fb-b720aa76b494 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 943 time: 0.3576024 Dec 09 22:02:45.422826 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-376244da-27d8-4e22-bc8f-a4828aa71f3d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:45.424489 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-376244da-27d8-4e22-bc8f-a4828aa71f3d service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0896275 Dec 09 22:02:45.478263 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9116a773-b741-4833-9332-dbac94bba9d0 req-a806d4c1-02eb-4ecb-9182-2aee4599a44f tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0842569 Dec 09 22:02:45.534770 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:02:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bbc400e5-39dc-4b9f-8d05-bbc0909261ed x-openstack-request-id: req-bbc400e5-39dc-4b9f-8d05-bbc0909261ed {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:02:45.535058 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b1351705-30cf-41ea-9aa5-a1839969cc2d", "tag": "ca52519f-6403-4107-bf09-14de9a102b79", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:02:45.535305 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-bbc400e5-39dc-4b9f-8d05-bbc0909261ed {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:02:45.535731 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b1351705-30cf-41ea-9aa5-a1839969cc2d', 'tag': 'ca52519f-6403-4107-bf09-14de9a102b79', 'status': 'completed', 'code': 200} Dec 09 22:02:45.546263 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-bae3c334-2a0c-4bff-beeb-4e6e84f1c4ba service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1135328 Dec 09 22:02:45.649655 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11791dc7-6eae-4b99-b1b8-843c81e6f813 req-2071d97e-3f7f-4a77-8d27-baf218c49236 service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0950389 Dec 09 22:02:45.739180 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8963bc75-bd2c-4b3a-97f7-c4a50958bae4 req-77091e95-6b1c-4b0b-89a6-f03f979a4077 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:45.740775 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8963bc75-bd2c-4b3a-97f7-c4a50958bae4 req-77091e95-6b1c-4b0b-89a6-f03f979a4077 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 1095 time: 0.0451093 Dec 09 22:02:45.839029 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8963bc75-bd2c-4b3a-97f7-c4a50958bae4 req-871c73e1-ddb1-4504-9804-4896436fe95a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:45.840588 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8963bc75-bd2c-4b3a-97f7-c4a50958bae4 req-871c73e1-ddb1-4504-9804-4896436fe95a service neutron] 10.222.0.10 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 911 time: 0.0912795 Dec 09 22:02:45.884745 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8963bc75-bd2c-4b3a-97f7-c4a50958bae4 req-750a7051-7c4b-4bc1-aaea-4c9b99961233 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ca52519f-6403-4107-bf09-14de9a102b79 HTTP/1.1" status: 200 len: 217 time: 0.0363302 Dec 09 22:02:45.941303 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8963bc75-bd2c-4b3a-97f7-c4a50958bae4 req-1aa64946-4f5d-4cb0-8c07-b40a9dbae630 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:45.943044 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8963bc75-bd2c-4b3a-97f7-c4a50958bae4 req-1aa64946-4f5d-4cb0-8c07-b40a9dbae630 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0514450 Dec 09 22:02:45.994135 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8963bc75-bd2c-4b3a-97f7-c4a50958bae4 req-6e498039-e89d-47c6-a26a-a085966f3d9e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:45.995662 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8963bc75-bd2c-4b3a-97f7-c4a50958bae4 req-6e498039-e89d-47c6-a26a-a085966f3d9e service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0455921 Dec 09 22:02:46.084260 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8963bc75-bd2c-4b3a-97f7-c4a50958bae4 req-12088d16-ea0d-45c8-a6fd-72db22eb5455 service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0814569 Dec 09 22:02:46.178401 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8963bc75-bd2c-4b3a-97f7-c4a50958bae4 req-84a0bbed-0b87-4dcf-8499-bed465b259eb service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0872257 Dec 09 22:02:46.601797 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-280453b3-af70-4d12-84b1-afa3c9baf87d req-adcf4962-47af-4c55-82b7-75fbeeb01308 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:46.603298 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-280453b3-af70-4d12-84b1-afa3c9baf87d req-adcf4962-47af-4c55-82b7-75fbeeb01308 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 943 time: 0.0511262 Dec 09 22:02:46.653658 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-280453b3-af70-4d12-84b1-afa3c9baf87d req-68b0d236-190b-44e5-891e-e00296ae73f0 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443127 Dec 09 22:02:47.777337 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ddab1a9-2634-439e-85f9-123a068504b6 req-9c3ad255-7354-4292-95fb-8e1b6a1f7d39 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:47.778946 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ddab1a9-2634-439e-85f9-123a068504b6 req-9c3ad255-7354-4292-95fb-8e1b6a1f7d39 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 943 time: 0.0542920 Dec 09 22:02:47.833223 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ddab1a9-2634-439e-85f9-123a068504b6 req-98abe145-a6bb-4d7e-b6bc-287a08c21079 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469346 Dec 09 22:02:48.955783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-576933cc-58ef-42e5-8d85-ac0a04d22091 req-193701b1-ec30-48f3-9f77-56c62aaa22cc tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:48.957311 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-576933cc-58ef-42e5-8d85-ac0a04d22091 req-193701b1-ec30-48f3-9f77-56c62aaa22cc tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 943 time: 0.0507791 Dec 09 22:02:49.007757 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-576933cc-58ef-42e5-8d85-ac0a04d22091 req-533a71e9-21b0-4264-80e4-55a9b8360064 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439124 Dec 09 22:02:50.137997 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be3eb83d-7f4a-4b0b-8bef-32202b26085f req-6b652377-bd4b-46a6-989d-e5160fb432be tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:50.139401 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-be3eb83d-7f4a-4b0b-8bef-32202b26085f req-6b652377-bd4b-46a6-989d-e5160fb432be tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 943 time: 0.0531034 Dec 09 22:02:50.194773 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-be3eb83d-7f4a-4b0b-8bef-32202b26085f req-d7c68035-4254-42be-88ff-caf125b648a4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0492103 Dec 09 22:02:51.328568 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50b7bc0c-a206-48bb-ac04-917c4e56ef63 req-4237de13-f4db-462f-b1d4-d95867c45adb tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:51.330162 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50b7bc0c-a206-48bb-ac04-917c4e56ef63 req-4237de13-f4db-462f-b1d4-d95867c45adb tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 943 time: 0.0540211 Dec 09 22:02:51.382366 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50b7bc0c-a206-48bb-ac04-917c4e56ef63 req-76317db8-6250-4b20-9255-549891e4b401 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456674 Dec 09 22:02:52.203133 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:02:52.502902 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4199b02d-6669-47d1-8dbe-91ab5b8a08fc req-7e70d47a-8965-4de0-80e9-d3925c30aa5a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:52.504369 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4199b02d-6669-47d1-8dbe-91ab5b8a08fc req-7e70d47a-8965-4de0-80e9-d3925c30aa5a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 943 time: 0.0499568 Dec 09 22:02:52.553735 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4199b02d-6669-47d1-8dbe-91ab5b8a08fc req-00501ae2-f28e-4ac0-a19f-f590dde39b73 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430596 Dec 09 22:02:53.683425 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c47ed433-6aa0-4d3f-93ab-0b4a0c141100 req-f7b94d9d-f727-41dc-9d4b-4aa9544224d4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:53.684983 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c47ed433-6aa0-4d3f-93ab-0b4a0c141100 req-f7b94d9d-f727-41dc-9d4b-4aa9544224d4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 943 time: 0.0595503 Dec 09 22:02:53.743605 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c47ed433-6aa0-4d3f-93ab-0b4a0c141100 req-24d6976a-8c13-426e-9f78-d81adb13ac14 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0520630 Dec 09 22:02:53.756254 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f75d0a68-2737-48a2-8471-b3501b2efb62 req-01c22010-cc60-4636-9793-f4235078fe25 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0432100 Dec 09 22:02:53.842876 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f75d0a68-2737-48a2-8471-b3501b2efb62 req-fc285007-32a5-4860-80cd-6d862bc9d5b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:53.844399 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f75d0a68-2737-48a2-8471-b3501b2efb62 req-fc285007-32a5-4860-80cd-6d862bc9d5b4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 1098 time: 0.0435011 Dec 09 22:02:53.960194 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f75d0a68-2737-48a2-8471-b3501b2efb62 req-c749c55b-89a4-4ecc-96d5-2f781dc89363 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:53.961656 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f75d0a68-2737-48a2-8471-b3501b2efb62 req-c749c55b-89a4-4ecc-96d5-2f781dc89363 service neutron] 10.222.0.31 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 911 time: 0.0967307 Dec 09 22:02:54.038594 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f75d0a68-2737-48a2-8471-b3501b2efb62 req-d16c0e5f-4ce1-4c72-8f69-39bc110c0338 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a0d8fd2f-f691-4d83-8320-05b91efdafbd HTTP/1.1" status: 200 len: 1001 time: 0.0697877 Dec 09 22:02:54.105157 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f75d0a68-2737-48a2-8471-b3501b2efb62 req-64350cc2-5e2a-4742-aeb6-67eaa5328d79 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:54.106952 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f75d0a68-2737-48a2-8471-b3501b2efb62 req-64350cc2-5e2a-4742-aeb6-67eaa5328d79 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0614693 Dec 09 22:02:54.156558 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f75d0a68-2737-48a2-8471-b3501b2efb62 req-258137f1-6f1e-4cb1-a933-01bee878b020 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:54.158206 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f75d0a68-2737-48a2-8471-b3501b2efb62 req-258137f1-6f1e-4cb1-a933-01bee878b020 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0439792 Dec 09 22:02:54.254989 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f75d0a68-2737-48a2-8471-b3501b2efb62 req-e203702b-4e04-4fff-a745-4d71b17d0fce service neutron] 10.222.0.31 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0889435 Dec 09 22:02:54.344047 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f75d0a68-2737-48a2-8471-b3501b2efb62 req-a85bd444-6999-478a-a21e-fae5a59734b6 service neutron] 10.222.0.31 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0818641 Dec 09 22:02:54.874375 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0c7193b-b954-4613-9ef6-cc71096294c8 req-e3f009d1-8c77-4e24-8e1e-8b96d5a7bb9a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:54.875939 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b0c7193b-b954-4613-9ef6-cc71096294c8 req-e3f009d1-8c77-4e24-8e1e-8b96d5a7bb9a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 943 time: 0.0523150 Dec 09 22:02:54.934634 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b0c7193b-b954-4613-9ef6-cc71096294c8 req-d137e688-9e1e-4ff6-9f9d-23faff7fc7fb tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0526345 Dec 09 22:02:56.072805 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41ff1701-3ac3-4091-943c-5c369b5bed4e req-49f11b95-ab78-451d-9258-320fc756d927 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:56.074358 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-41ff1701-3ac3-4091-943c-5c369b5bed4e req-49f11b95-ab78-451d-9258-320fc756d927 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 943 time: 0.0582452 Dec 09 22:02:56.133145 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-41ff1701-3ac3-4091-943c-5c369b5bed4e req-03cf92ef-af9f-410f-9f90-0ae99c9f4d5a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0525591 Dec 09 22:02:56.866461 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device ca52519f-6403-4107-bf09-14de9a102b79 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:02:56.966473 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port ca52519f-6403-4107-bf09-14de9a102b79, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=ca52519f-6403-4107-bf09-14de9a102b79,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:02:56.980135 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'ca52519f-6403-4107-bf09-14de9a102b79', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'port_id': 'ca52519f-6403-4107-bf09-14de9a102b79', 'mac_address': 'fa:16:3e:c1:f4:d5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 124, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:02:57.017974 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:57.031409 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ca52519f-6403-4107-bf09-14de9a102b79 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:02:57.050790 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port ca52519f-6403-4107-bf09-14de9a102b79, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=ca52519f-6403-4107-bf09-14de9a102b79,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:02:57.056434 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:57.106465 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=ca52519f-6403-4107-bf09-14de9a102b79,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:02:57.259273 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['ca52519f-6403-4107-bf09-14de9a102b79'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:02:57.262109 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2af311c-24f6-42a1-afec-736c332db9f1 req-d00aa592-d16b-4e0c-9b7c-411d8c3da297 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:57.263956 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b2af311c-24f6-42a1-afec-736c332db9f1 req-d00aa592-d16b-4e0c-9b7c-411d8c3da297 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 944 time: 0.0530696 Dec 09 22:02:57.316385 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b2af311c-24f6-42a1-afec-736c332db9f1 req-cb9d1790-9968-4486-9e48-0978704476a5 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448906 Dec 09 22:02:57.457702 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:57.683486 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:58.451783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30b086f3-57b8-4cfe-9253-26f099d5a3f5 req-4146e074-1156-4bc1-b338-b8f36ccc6770 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:58.453298 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-30b086f3-57b8-4cfe-9253-26f099d5a3f5 req-4146e074-1156-4bc1-b338-b8f36ccc6770 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 944 time: 0.0569189 Dec 09 22:02:58.502704 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-30b086f3-57b8-4cfe-9253-26f099d5a3f5 req-1cf9a66c-fb33-460b-8b2e-8756cfc3da5a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433550 Dec 09 22:02:58.867331 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device ca52519f-6403-4107-bf09-14de9a102b79 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:02:58.926587 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port ca52519f-6403-4107-bf09-14de9a102b79 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:02:58.930592 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port ca52519f-6403-4107-bf09-14de9a102b79 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:02:58.930964 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:59.019547 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:59.205398 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b1351705-30cf-41ea-9aa5-a1839969cc2d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ca52519f-6403-4107-bf09-14de9a102b79'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:02:59.207692 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-75c0d88b-1f83-4eed-ba45-603d362b9aac" -d '{"events": [{"server_uuid": "b1351705-30cf-41ea-9aa5-a1839969cc2d", "name": "network-vif-plugged", "status": "completed", "tag": "ca52519f-6403-4107-bf09-14de9a102b79"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:02:59.220628 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port ca52519f-6403-4107-bf09-14de9a102b79, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=ca52519f-6403-4107-bf09-14de9a102b79,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:02:59.227400 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:02:59.250910 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:02:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a9804405-ef5c-452c-946b-107e8a085277 x-openstack-request-id: req-a9804405-ef5c-452c-946b-107e8a085277 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:02:59.251327 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b1351705-30cf-41ea-9aa5-a1839969cc2d", "name": "network-vif-plugged", "status": "completed", "tag": "ca52519f-6403-4107-bf09-14de9a102b79", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:02:59.251668 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a9804405-ef5c-452c-946b-107e8a085277 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:02:59.252127 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b1351705-30cf-41ea-9aa5-a1839969cc2d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ca52519f-6403-4107-bf09-14de9a102b79', 'code': 200} Dec 09 22:02:59.278081 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=ca52519f-6403-4107-bf09-14de9a102b79,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:02:59.348136 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cd9d6a9-df6b-4385-86b9-77f554f94bd8 req-ac63a77c-1eb2-4b54-9b53-410a95c0734c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:59.349636 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0cd9d6a9-df6b-4385-86b9-77f554f94bd8 req-ac63a77c-1eb2-4b54-9b53-410a95c0734c service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 1097 time: 0.0446651 Dec 09 22:02:59.396733 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0cd9d6a9-df6b-4385-86b9-77f554f94bd8 req-862feba0-e531-4732-88c4-62cb81552eeb service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397136 Dec 09 22:02:59.627798 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1e6280f-d73b-4bdb-83bc-847bc07df3c3 req-21bf1c9a-904e-4281-a65f-09228d743d9c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:02:59.629279 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f1e6280f-d73b-4bdb-83bc-847bc07df3c3 req-21bf1c9a-904e-4281-a65f-09228d743d9c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 945 time: 0.0520821 Dec 09 22:02:59.684555 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f1e6280f-d73b-4bdb-83bc-847bc07df3c3 req-42ecde24-bbe2-48f0-841b-9ac8140b1dc8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455828 Dec 09 22:03:00.825940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dbe8e25-b044-497f-a697-bef6ad1a98c0 req-cee236d7-bd3a-40e3-b030-7bec9361931a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:03:00.827468 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4dbe8e25-b044-497f-a697-bef6ad1a98c0 req-cee236d7-bd3a-40e3-b030-7bec9361931a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 945 time: 0.0534530 Dec 09 22:03:00.879486 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4dbe8e25-b044-497f-a697-bef6ad1a98c0 req-8271f35f-0f84-46ca-b731-da89581e834d tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458834 Dec 09 22:03:00.997154 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a73a871-936a-46d5-95fe-04eb3535f293 req-ec5bb061-66e8-4a81-adac-469966aefed9 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:03:00.998608 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a73a871-936a-46d5-95fe-04eb3535f293 req-ec5bb061-66e8-4a81-adac-469966aefed9 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 945 time: 0.0534568 Dec 09 22:03:01.052020 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a73a871-936a-46d5-95fe-04eb3535f293 req-9567f955-3fd8-474c-a611-6ccc45c08844 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440917 Dec 09 22:03:01.074487 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58336) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:03:01.114114 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1a9b34b-156b-4fcd-bb5a-337814c8aafa tempest-TestVolumeBootPattern-2003139207 tempest-TestVolumeBootPattern-2003139207-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:03:01.115663 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c1a9b34b-156b-4fcd-bb5a-337814c8aafa tempest-TestVolumeBootPattern-2003139207 tempest-TestVolumeBootPattern-2003139207-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 1092 time: 0.0401382 Dec 09 22:03:01.118593 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58338) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:03:01.122977 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': 'ca52519f-6403-4107-bf09-14de9a102b79', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'fixed_ip_address': '172.20.0.9'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:03:01.147837 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:03:01.255069 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:03:01.362182 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Allocated IP 172.25.3.53 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/6211024e-e7d8-4375-bc84-78dc99363024) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:03:01.469292 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:03:01.513689 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:03:01.549836 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:03:01.554120 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:03:01.559534 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:03:01.565063 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event updated for resources: {'Port': ['ID=6211024e-e7d8-4375-bc84-78dc99363024,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:03:01.596907 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:03:01.597253 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:03:01.597596 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:03:01.597937 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:03:01.598270 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:03:01.598607 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:03:01.598932 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:03:01.599259 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:03:01.599597 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:03:01.599924 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:03:01.600251 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:03:01.600569 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:03:01.600895 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:03:02.210178 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:03:02.282541 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:03:02.438771 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:03:02.446557 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:03:02.513433 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event updated for resources: {'Port': ['ID=6211024e-e7d8-4375-bc84-78dc99363024,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:03:02.527547 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:03:02.631825 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Floating IP 7c5fd4bc-11fe-4e4c-b81a-a5ea83c2e08d associated. External IP: 172.25.3.53, port: ca52519f-6403-4107-bf09-14de9a102b79. Dec 09 22:03:02.842505 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:03:02.954116 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:03:02.973004 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:03:02.986964 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74e338b8-8e39-4af1-9829-802c85cd51f0 None None] Sync routers for ids ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:03:02.987721 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-914d592e-b4b6-4ea4-adc2-9e5790494621 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:03:03.003347 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d6628249-27aa-4036-89c4-606a0d709c30 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.8836305 Dec 09 22:03:03.003616 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74e338b8-8e39-4af1-9829-802c85cd51f0 None None] Routers {'52333c17-500b-4d13-8de7-f3d9c4c6eb46'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:03:03.004213 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b1351705-30cf-41ea-9aa5-a1839969cc2d', 'tag': 'ca52519f-6403-4107-bf09-14de9a102b79'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:03:03.004461 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-74e338b8-8e39-4af1-9829-802c85cd51f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:02:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:03:03.007146 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a4ae9652-0f71-4838-b5be-4215a7d6b453" -d '{"events": [{"name": "network-changed", "server_uuid": "b1351705-30cf-41ea-9aa5-a1839969cc2d", "tag": "ca52519f-6403-4107-bf09-14de9a102b79"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:03:03.044671 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:03:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a90391f0-f0f0-40b4-a7e0-b5bb2781ed23 x-openstack-request-id: req-a90391f0-f0f0-40b4-a7e0-b5bb2781ed23 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:03:03.045000 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b1351705-30cf-41ea-9aa5-a1839969cc2d", "tag": "ca52519f-6403-4107-bf09-14de9a102b79", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:03:03.045244 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a90391f0-f0f0-40b4-a7e0-b5bb2781ed23 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:03:03.045647 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b1351705-30cf-41ea-9aa5-a1839969cc2d', 'tag': 'ca52519f-6403-4107-bf09-14de9a102b79', 'status': 'completed', 'code': 200} Dec 09 22:03:03.108832 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4ae9652-0f71-4838-b5be-4215a7d6b453 req-50d8fae8-f931-4788-97cd-0e00159b1770 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:03:03.110254 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4ae9652-0f71-4838-b5be-4215a7d6b453 req-50d8fae8-f931-4788-97cd-0e00159b1770 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 1097 time: 0.0420854 Dec 09 22:03:03.135649 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-74e338b8-8e39-4af1-9829-802c85cd51f0 None None] Set router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:03:03.207803 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4ae9652-0f71-4838-b5be-4215a7d6b453 req-4fab6a5f-8c52-4c54-af12-2afd2566783e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:03:03.209370 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4ae9652-0f71-4838-b5be-4215a7d6b453 req-4fab6a5f-8c52-4c54-af12-2afd2566783e service neutron] 10.222.0.10 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 911 time: 0.0920339 Dec 09 22:03:03.278608 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4ae9652-0f71-4838-b5be-4215a7d6b453 req-3b2de822-afe7-4b72-8026-ea9f163e4c45 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ca52519f-6403-4107-bf09-14de9a102b79 HTTP/1.1" status: 200 len: 998 time: 0.0623131 Dec 09 22:03:03.328999 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4ae9652-0f71-4838-b5be-4215a7d6b453 req-222145c8-afed-4454-8ac5-c3b44e90c536 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:03:03.330483 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4ae9652-0f71-4838-b5be-4215a7d6b453 req-222145c8-afed-4454-8ac5-c3b44e90c536 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0441389 Dec 09 22:03:03.381729 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4ae9652-0f71-4838-b5be-4215a7d6b453 req-1d2e47df-c456-4b7a-bd83-87f23935321c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:03:03.383323 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4ae9652-0f71-4838-b5be-4215a7d6b453 req-1d2e47df-c456-4b7a-bd83-87f23935321c service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0453186 Dec 09 22:03:03.463422 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-74e338b8-8e39-4af1-9829-802c85cd51f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3eb7a989-3635-422c-91f5-9a2972ccc18c', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'floating_ip_address': '172.25.3.41', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'port_id': 'a0d8fd2f-f691-4d83-8320-05b91efdafbd', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 4026, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'mac_address': 'fa:16:3e:0d:14:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15c3e0cc-52ce-44d9-8464-2ed50a05ba15', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:01:01Z', 'updated_at': '2021-12-09T22:01:04Z', 'revision_number': 1, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'fixed_ip_address_scope': None}, {'id': '7c5fd4bc-11fe-4e4c-b81a-a5ea83c2e08d', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'floating_ip_address': '172.25.3.53', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'port_id': 'ca52519f-6403-4107-bf09-14de9a102b79', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 4034, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'mac_address': 'fa:16:3e:c1:f4:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b1351705-30cf-41ea-9aa5-a1839969cc2d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:03:02Z', 'updated_at': '2021-12-09T22:03:02Z', 'revision_number': 0, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'db7c12a5-60a7-41e6-ae5c-e42348c373b4', 'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'mac_address': 'fa:16:3e:79:8f:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_interface', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:36Z', 'updated_at': '2021-12-09T21:54:44Z', 'revision_number': 5, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'subnets': [{'id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:03:03.474810 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4ae9652-0f71-4838-b5be-4215a7d6b453 req-3b805934-3a93-4dea-ae04-67004bfb7229 service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0840356 Dec 09 22:03:03.489503 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74e338b8-8e39-4af1-9829-802c85cd51f0 None None] Checking router: 52333c17-500b-4d13-8de7-f3d9c4c6eb46 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:03:03.498144 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74e338b8-8e39-4af1-9829-802c85cd51f0 None None] Routers {'52333c17-500b-4d13-8de7-f3d9c4c6eb46'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:03:03.498762 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-74e338b8-8e39-4af1-9829-802c85cd51f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:02:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:03:03.568838 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a4ae9652-0f71-4838-b5be-4215a7d6b453 req-14771f61-d144-4a84-8f9f-2bde1d74ad11 service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0870469 Dec 09 22:03:03.605062 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-74e338b8-8e39-4af1-9829-802c85cd51f0 None None] Set router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:03:03.849586 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-74e338b8-8e39-4af1-9829-802c85cd51f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3eb7a989-3635-422c-91f5-9a2972ccc18c', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'floating_ip_address': '172.25.3.41', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'port_id': 'a0d8fd2f-f691-4d83-8320-05b91efdafbd', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 4026, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'mac_address': 'fa:16:3e:0d:14:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15c3e0cc-52ce-44d9-8464-2ed50a05ba15', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:01:01Z', 'updated_at': '2021-12-09T22:01:04Z', 'revision_number': 1, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'fixed_ip_address_scope': None}, {'id': '7c5fd4bc-11fe-4e4c-b81a-a5ea83c2e08d', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'floating_ip_address': '172.25.3.53', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'port_id': 'ca52519f-6403-4107-bf09-14de9a102b79', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 4034, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'mac_address': 'fa:16:3e:c1:f4:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b1351705-30cf-41ea-9aa5-a1839969cc2d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:03:02Z', 'updated_at': '2021-12-09T22:03:02Z', 'revision_number': 0, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'db7c12a5-60a7-41e6-ae5c-e42348c373b4', 'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'mac_address': 'fa:16:3e:79:8f:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_interface', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:36Z', 'updated_at': '2021-12-09T21:54:44Z', 'revision_number': 5, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'subnets': [{'id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:03:03.875628 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74e338b8-8e39-4af1-9829-802c85cd51f0 None None] The sync data for ids ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'] in n-d-713301-27 is: [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3eb7a989-3635-422c-91f5-9a2972ccc18c', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'floating_ip_address': '172.25.3.41', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'port_id': 'a0d8fd2f-f691-4d83-8320-05b91efdafbd', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 4026, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'mac_address': 'fa:16:3e:0d:14:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15c3e0cc-52ce-44d9-8464-2ed50a05ba15', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:01:01Z', 'updated_at': '2021-12-09T22:01:04Z', 'revision_number': 1, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'fixed_ip_address_scope': None}, {'id': '7c5fd4bc-11fe-4e4c-b81a-a5ea83c2e08d', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'floating_ip_address': '172.25.3.53', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'port_id': 'ca52519f-6403-4107-bf09-14de9a102b79', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 4034, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'mac_address': 'fa:16:3e:c1:f4:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b1351705-30cf-41ea-9aa5-a1839969cc2d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:03:02Z', 'updated_at': '2021-12-09T22:03:02Z', 'revision_number': 0, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'db7c12a5-60a7-41e6-ae5c-e42348c373b4', 'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'mac_address': 'fa:16:3e:79:8f:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_interface', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:36Z', 'updated_at': '2021-12-09T21:54:44Z', 'revision_number': 5, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'subnets': [{'id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:03:04.070812 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4be48d7-d5af-479d-9bc0-e5acfd2b9921 None None] New status for floating IP 7c5fd4bc-11fe-4e4c-b81a-a5ea83c2e08d: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:03:05.619026 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ea012600-296e-43c0-ab63-6386546b422d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:03:06.755739 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:03:08.083811 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:03:09.671326 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:03:27.481554 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:03:27.704599 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:03:29.204704 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:03:32.998232 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f9158d30-159a-486f-97ad-ab0ac4754db8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:03:33.484704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-332ba37b-9b9c-412e-b86c-b88c22d79fb1 req-902886fb-aae9-451e-9791-9f07b63dd2e7 service neutron] (103437) timed out ('10.222.0.13', 57266) {{(pid=103437) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 09 22:03:35.622676 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c9efcea6-81b6-48a0-8a52-f17e88e7a1f2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:03:36.760358 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:03:38.084706 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:03:39.664644 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:03:40.826883 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c511bb72-dc5b-4a7b-b365-f5aab69e008a req-b7edf161-99ce-40ff-a565-1a05d7a485ce service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0415711 Dec 09 22:03:40.923790 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c511bb72-dc5b-4a7b-b365-f5aab69e008a req-bd2bb506-3f62-4a49-9646-187a6d62ecc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:03:40.925301 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c511bb72-dc5b-4a7b-b365-f5aab69e008a req-bd2bb506-3f62-4a49-9646-187a6d62ecc5 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 1097 time: 0.0517623 Dec 09 22:03:41.033496 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c511bb72-dc5b-4a7b-b365-f5aab69e008a req-b5a566aa-5924-4378-b576-a2ec44b75a72 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:03:41.034955 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c511bb72-dc5b-4a7b-b365-f5aab69e008a req-b5a566aa-5924-4378-b576-a2ec44b75a72 service neutron] 10.222.0.10 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 911 time: 0.0871994 Dec 09 22:03:41.100158 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c511bb72-dc5b-4a7b-b365-f5aab69e008a req-87284d82-f797-4b3e-8585-87bcd958a8c4 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ca52519f-6403-4107-bf09-14de9a102b79 HTTP/1.1" status: 200 len: 1000 time: 0.0579188 Dec 09 22:03:41.153512 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c511bb72-dc5b-4a7b-b365-f5aab69e008a req-0f169e83-ccd0-44ca-b836-b5c7343e2fbb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:03:41.154963 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c511bb72-dc5b-4a7b-b365-f5aab69e008a req-0f169e83-ccd0-44ca-b836-b5c7343e2fbb service neutron] 10.222.0.10 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0480783 Dec 09 22:03:41.205661 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c511bb72-dc5b-4a7b-b365-f5aab69e008a req-84d4b7f3-eb47-480b-8df4-2cf1dc157edb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:03:41.207466 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c511bb72-dc5b-4a7b-b365-f5aab69e008a req-84d4b7f3-eb47-480b-8df4-2cf1dc157edb service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0446494 Dec 09 22:03:41.312461 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c511bb72-dc5b-4a7b-b365-f5aab69e008a req-e2c62cd0-faf6-4087-9b5d-6b74612f62a9 service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0972507 Dec 09 22:03:41.420064 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c511bb72-dc5b-4a7b-b365-f5aab69e008a req-d05fe312-8e42-42c7-967c-bdd4b032c74d service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1006615 Dec 09 22:03:55.704356 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a44e75ce-f940-4826-b3e1-222d0b497fc7 req-98538454-b29d-455b-bc4d-42f256084d55 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0432723 Dec 09 22:03:55.798581 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a44e75ce-f940-4826-b3e1-222d0b497fc7 req-873b4083-3f2b-4b3d-b61c-f0229dd130dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:03:55.800162 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a44e75ce-f940-4826-b3e1-222d0b497fc7 req-873b4083-3f2b-4b3d-b61c-f0229dd130dc service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 1098 time: 0.0461133 Dec 09 22:03:55.906209 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a44e75ce-f940-4826-b3e1-222d0b497fc7 req-b067a90c-6ccc-4e84-9de9-45cf6c02106b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:03:55.907754 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a44e75ce-f940-4826-b3e1-222d0b497fc7 req-b067a90c-6ccc-4e84-9de9-45cf6c02106b service neutron] 10.222.0.31 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 911 time: 0.0863304 Dec 09 22:03:55.977905 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a44e75ce-f940-4826-b3e1-222d0b497fc7 req-e9c9cbe8-2506-43f9-897c-d8307f71ee8c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a0d8fd2f-f691-4d83-8320-05b91efdafbd HTTP/1.1" status: 200 len: 1001 time: 0.0628195 Dec 09 22:03:56.028389 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a44e75ce-f940-4826-b3e1-222d0b497fc7 req-74b3412a-64be-48db-8073-d13ec9ae59f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:03:56.029916 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a44e75ce-f940-4826-b3e1-222d0b497fc7 req-74b3412a-64be-48db-8073-d13ec9ae59f3 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0452278 Dec 09 22:03:56.076133 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a44e75ce-f940-4826-b3e1-222d0b497fc7 req-258488cc-e40b-4897-9725-5add114add9f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:03:56.077653 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a44e75ce-f940-4826-b3e1-222d0b497fc7 req-258488cc-e40b-4897-9725-5add114add9f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0410309 Dec 09 22:03:56.173920 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a44e75ce-f940-4826-b3e1-222d0b497fc7 req-e65fb66b-030c-48fd-b38f-7ff9f94089ea service neutron] 10.222.0.31 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0882273 Dec 09 22:03:56.272926 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a44e75ce-f940-4826-b3e1-222d0b497fc7 req-96ccde75-cddf-476c-be18-6218301ddfcb service neutron] 10.222.0.31 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0911124 Dec 09 22:03:57.519401 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:03:57.710939 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:03.003430 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b246e910-0361-4d35-b9d3-2fea34b85305 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:05.622596 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-abb7fa0f-32f9-417f-9a1a-d789054ca540 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:06.206588 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:04:06.763631 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:08.085176 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:09.670543 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:27.525103 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:27.729768 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:29.846792 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58374) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:04:30.014169 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Deleting port 6211024e-e7d8-4375-bc84-78dc99363024 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:04:30.014509 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:30.090626 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:30.090837 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:30.103348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Calling delete_port for 6211024e-e7d8-4375-bc84-78dc99363024 owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:04:30.260181 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:30.287003 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event deleted for resources: {'Port': ['ID=6211024e-e7d8-4375-bc84-78dc99363024,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:04:30.299201 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:30.299626 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:30.299979 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:30.300328 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:30.300668 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:30.301010 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:30.301343 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:30.301673 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:30.302003 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:30.302329 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:30.302642 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:30.302974 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:30.303294 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:30.362833 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:30.363047 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Floating IP 7c5fd4bc-11fe-4e4c-b81a-a5ea83c2e08d disassociated (deleted). External IP: 172.25.3.53, port: ca52519f-6403-4107-bf09-14de9a102b79. Dec 09 22:04:30.577654 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:04:30.695233 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:04:30.700123 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:30.705332 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d4fe2f7-4cbf-4f90-9c05-263982c1614f None None] Sync routers for ids ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:04:30.717818 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d4fe2f7-4cbf-4f90-9c05-263982c1614f None None] Routers {'52333c17-500b-4d13-8de7-f3d9c4c6eb46'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:04:30.718426 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-4d4fe2f7-4cbf-4f90-9c05-263982c1614f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:04:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:04:30.731142 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1dc91c47-a97a-4ea9-ad18-def7ab906f11 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "DELETE /v2.0/floatingips/7c5fd4bc-11fe-4e4c-b81a-a5ea83c2e08d HTTP/1.1" status: 204 len: 168 time: 0.8831604 Dec 09 22:04:30.731761 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b1351705-30cf-41ea-9aa5-a1839969cc2d', 'tag': 'ca52519f-6403-4107-bf09-14de9a102b79'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:04:30.734100 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-89ce9eb1-d8f9-49a9-8d5e-55cd2fc7fdff" -d '{"events": [{"name": "network-changed", "server_uuid": "b1351705-30cf-41ea-9aa5-a1839969cc2d", "tag": "ca52519f-6403-4107-bf09-14de9a102b79"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:04:30.825856 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-4d4fe2f7-4cbf-4f90-9c05-263982c1614f None None] Set router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:04:30.897561 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:04:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-96550de5-cb66-4780-8165-180b871e9a8d x-openstack-request-id: req-96550de5-cb66-4780-8165-180b871e9a8d {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:04:30.898081 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b1351705-30cf-41ea-9aa5-a1839969cc2d", "tag": "ca52519f-6403-4107-bf09-14de9a102b79", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:04:30.898081 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-96550de5-cb66-4780-8165-180b871e9a8d {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:04:30.898613 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b1351705-30cf-41ea-9aa5-a1839969cc2d', 'tag': 'ca52519f-6403-4107-bf09-14de9a102b79', 'status': 'completed', 'code': 200} Dec 09 22:04:30.990757 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89ce9eb1-d8f9-49a9-8d5e-55cd2fc7fdff req-bb119bd9-4f0b-4a9c-b1b0-4694288b1eef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:04:30.992191 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89ce9eb1-d8f9-49a9-8d5e-55cd2fc7fdff req-bb119bd9-4f0b-4a9c-b1b0-4694288b1eef service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 1097 time: 0.0701332 Dec 09 22:04:31.004339 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d1867f9-4cf9-4d6c-bf1d-52c602364133 req-abc7eeb2-4328-461f-9e98-7c6013f39f2c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:04:31.005759 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5d1867f9-4cf9-4d6c-bf1d-52c602364133 req-abc7eeb2-4328-461f-9e98-7c6013f39f2c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 945 time: 0.0587842 Dec 09 22:04:31.055273 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-4d4fe2f7-4cbf-4f90-9c05-263982c1614f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3eb7a989-3635-422c-91f5-9a2972ccc18c', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'floating_ip_address': '172.25.3.41', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'port_id': 'a0d8fd2f-f691-4d83-8320-05b91efdafbd', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 4026, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'mac_address': 'fa:16:3e:0d:14:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15c3e0cc-52ce-44d9-8464-2ed50a05ba15', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:01:01Z', 'updated_at': '2021-12-09T22:01:04Z', 'revision_number': 1, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'db7c12a5-60a7-41e6-ae5c-e42348c373b4', 'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'mac_address': 'fa:16:3e:79:8f:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_interface', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:36Z', 'updated_at': '2021-12-09T21:54:44Z', 'revision_number': 5, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'subnets': [{'id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:04:31.084361 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d4fe2f7-4cbf-4f90-9c05-263982c1614f None None] Checking router: 52333c17-500b-4d13-8de7-f3d9c4c6eb46 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:04:31.093291 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d4fe2f7-4cbf-4f90-9c05-263982c1614f None None] Routers {'52333c17-500b-4d13-8de7-f3d9c4c6eb46'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:04:31.093908 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-4d4fe2f7-4cbf-4f90-9c05-263982c1614f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:04:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:04:31.115528 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5d1867f9-4cf9-4d6c-bf1d-52c602364133 req-0dc4ec51-9c4f-49d2-8dbf-59a896a950a4 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1016357 Dec 09 22:04:31.132610 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89ce9eb1-d8f9-49a9-8d5e-55cd2fc7fdff req-aa0e9899-915c-4e22-b26f-7a9d536c53b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:04:31.134067 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89ce9eb1-d8f9-49a9-8d5e-55cd2fc7fdff req-aa0e9899-915c-4e22-b26f-7a9d536c53b0 service neutron] 10.222.0.10 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 911 time: 0.1274624 Dec 09 22:04:31.181383 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89ce9eb1-d8f9-49a9-8d5e-55cd2fc7fdff req-ec0725f4-15fe-4461-b646-3cf19bbae41e service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ca52519f-6403-4107-bf09-14de9a102b79 HTTP/1.1" status: 200 len: 217 time: 0.0384731 Dec 09 22:04:31.199789 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-4d4fe2f7-4cbf-4f90-9c05-263982c1614f None None] Set router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:04:31.231178 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89ce9eb1-d8f9-49a9-8d5e-55cd2fc7fdff req-8e284593-acbc-48b4-81bc-16981effc35f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:04:31.232691 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89ce9eb1-d8f9-49a9-8d5e-55cd2fc7fdff req-8e284593-acbc-48b4-81bc-16981effc35f service neutron] 10.222.0.10 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0438788 Dec 09 22:04:31.279237 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89ce9eb1-d8f9-49a9-8d5e-55cd2fc7fdff req-a2c98543-bd91-4aee-858e-4d57fa07d860 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:04:31.280716 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89ce9eb1-d8f9-49a9-8d5e-55cd2fc7fdff req-a2c98543-bd91-4aee-858e-4d57fa07d860 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0404398 Dec 09 22:04:31.378926 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89ce9eb1-d8f9-49a9-8d5e-55cd2fc7fdff req-84dfef93-a076-40d5-bfa2-5e04c97f0fd8 service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0897217 Dec 09 22:04:31.472582 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-89ce9eb1-d8f9-49a9-8d5e-55cd2fc7fdff req-c87e2e4c-f4ec-4cc4-afd8-059790154729 service neutron] 10.222.0.10 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860496 Dec 09 22:04:31.521232 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-4d4fe2f7-4cbf-4f90-9c05-263982c1614f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3eb7a989-3635-422c-91f5-9a2972ccc18c', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'floating_ip_address': '172.25.3.41', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'port_id': 'a0d8fd2f-f691-4d83-8320-05b91efdafbd', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 4026, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'mac_address': 'fa:16:3e:0d:14:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15c3e0cc-52ce-44d9-8464-2ed50a05ba15', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:01:01Z', 'updated_at': '2021-12-09T22:01:04Z', 'revision_number': 1, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'db7c12a5-60a7-41e6-ae5c-e42348c373b4', 'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'mac_address': 'fa:16:3e:79:8f:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_interface', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:36Z', 'updated_at': '2021-12-09T21:54:44Z', 'revision_number': 5, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'subnets': [{'id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:04:31.547337 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d4fe2f7-4cbf-4f90-9c05-263982c1614f None None] The sync data for ids ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'] in n-d-713301-27 is: [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '3eb7a989-3635-422c-91f5-9a2972ccc18c', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'floating_ip_address': '172.25.3.41', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'port_id': 'a0d8fd2f-f691-4d83-8320-05b91efdafbd', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 4026, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'mac_address': 'fa:16:3e:0d:14:89', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15c3e0cc-52ce-44d9-8464-2ed50a05ba15', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:01:01Z', 'updated_at': '2021-12-09T22:01:04Z', 'revision_number': 1, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'db7c12a5-60a7-41e6-ae5c-e42348c373b4', 'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'mac_address': 'fa:16:3e:79:8f:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_interface', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:36Z', 'updated_at': '2021-12-09T21:54:44Z', 'revision_number': 5, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'subnets': [{'id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:04:31.788419 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42f5cf42-36b2-4da4-b998-2ec99503968b None None] New status for floating IP 7c5fd4bc-11fe-4e4c-b81a-a5ea83c2e08d: DOWN {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:04:32.259140 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cefcf68a-2b76-4750-9da1-dab58a57880d req-5f242c9c-9757-4a0f-b8e9-bce396898149 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:04:32.260693 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cefcf68a-2b76-4750-9da1-dab58a57880d req-5f242c9c-9757-4a0f-b8e9-bce396898149 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 945 time: 0.0667100 Dec 09 22:04:32.325458 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cefcf68a-2b76-4750-9da1-dab58a57880d req-2b2349ab-43d0-449b-81ba-30cb88ed5d31 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0583987 Dec 09 22:04:32.435484 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c22ca29e-945b-4fe6-8f41-bd9ae664f83b req-f0728fd4-8c18-460a-b4a2-594280642cf8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:04:32.436870 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c22ca29e-945b-4fe6-8f41-bd9ae664f83b req-f0728fd4-8c18-460a-b4a2-594280642cf8 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.10 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 945 time: 0.0554626 Dec 09 22:04:32.529711 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-c22ca29e-945b-4fe6-8f41-bd9ae664f83b req-13b4e92e-f74d-42c9-b7e9-0416f84bb883 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Deleting port ca52519f-6403-4107-bf09-14de9a102b79 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:04:32.530044 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c22ca29e-945b-4fe6-8f41-bd9ae664f83b req-13b4e92e-f74d-42c9-b7e9-0416f84bb883 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:32.632235 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-c22ca29e-945b-4fe6-8f41-bd9ae664f83b req-13b4e92e-f74d-42c9-b7e9-0416f84bb883 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] For port ca52519f-6403-4107-bf09-14de9a102b79, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=ca52519f-6403-4107-bf09-14de9a102b79,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:04:32.632563 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c22ca29e-945b-4fe6-8f41-bd9ae664f83b req-13b4e92e-f74d-42c9-b7e9-0416f84bb883 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:32.644325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-c22ca29e-945b-4fe6-8f41-bd9ae664f83b req-13b4e92e-f74d-42c9-b7e9-0416f84bb883 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Calling delete_port for ca52519f-6403-4107-bf09-14de9a102b79 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:04:32.785920 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c22ca29e-945b-4fe6-8f41-bd9ae664f83b req-13b4e92e-f74d-42c9-b7e9-0416f84bb883 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:32.818565 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13b4e92e-f74d-42c9-b7e9-0416f84bb883 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event deleted for resources: {'Port': ['ID=ca52519f-6403-4107-bf09-14de9a102b79,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:04:32.831618 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13b4e92e-f74d-42c9-b7e9-0416f84bb883 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:32.831618 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13b4e92e-f74d-42c9-b7e9-0416f84bb883 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:32.831877 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13b4e92e-f74d-42c9-b7e9-0416f84bb883 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:32.832250 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13b4e92e-f74d-42c9-b7e9-0416f84bb883 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:32.832582 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13b4e92e-f74d-42c9-b7e9-0416f84bb883 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:32.832908 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13b4e92e-f74d-42c9-b7e9-0416f84bb883 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:32.833235 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13b4e92e-f74d-42c9-b7e9-0416f84bb883 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:32.833556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13b4e92e-f74d-42c9-b7e9-0416f84bb883 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:32.833877 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13b4e92e-f74d-42c9-b7e9-0416f84bb883 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:32.834199 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13b4e92e-f74d-42c9-b7e9-0416f84bb883 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:32.834514 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13b4e92e-f74d-42c9-b7e9-0416f84bb883 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:32.834808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13b4e92e-f74d-42c9-b7e9-0416f84bb883 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:32.835141 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13b4e92e-f74d-42c9-b7e9-0416f84bb883 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:32.869628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-c22ca29e-945b-4fe6-8f41-bd9ae664f83b req-13b4e92e-f74d-42c9-b7e9-0416f84bb883 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] No DVR routers for this DVR port ca52519f-6403-4107-bf09-14de9a102b79 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:04:32.872355 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-c22ca29e-945b-4fe6-8f41-bd9ae664f83b req-13b4e92e-f74d-42c9-b7e9-0416f84bb883 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:32.875693 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c22ca29e-945b-4fe6-8f41-bd9ae664f83b req-13b4e92e-f74d-42c9-b7e9-0416f84bb883 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.10 "DELETE /v2.0/ports/ca52519f-6403-4107-bf09-14de9a102b79 HTTP/1.1" status: 204 len: 173 time: 0.4324689 Dec 09 22:04:32.876130 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b1351705-30cf-41ea-9aa5-a1839969cc2d', 'name': 'network-vif-deleted', 'tag': 'ca52519f-6403-4107-bf09-14de9a102b79'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:04:32.878644 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1c164c25-4f6f-4315-9c3c-c2e6f8d05c7a" -d '{"events": [{"server_uuid": "b1351705-30cf-41ea-9aa5-a1839969cc2d", "name": "network-vif-deleted", "tag": "ca52519f-6403-4107-bf09-14de9a102b79"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:04:32.916077 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:04:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-85c70c41-1093-4647-9b6e-6ec5ba66bdd4 x-openstack-request-id: req-85c70c41-1093-4647-9b6e-6ec5ba66bdd4 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:04:32.916434 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b1351705-30cf-41ea-9aa5-a1839969cc2d", "name": "network-vif-deleted", "tag": "ca52519f-6403-4107-bf09-14de9a102b79", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:04:32.916663 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-85c70c41-1093-4647-9b6e-6ec5ba66bdd4 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:04:32.917086 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b1351705-30cf-41ea-9aa5-a1839969cc2d', 'name': 'network-vif-deleted', 'tag': 'ca52519f-6403-4107-bf09-14de9a102b79', 'status': 'completed', 'code': 200} Dec 09 22:04:32.999229 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f36508c7-53b8-49c2-886f-c0e6ce64840a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:33.431388 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a16ff5e8-c2c4-4afe-9b5d-98fa1a8e7da6 req-cb9ba771-d402-42b6-96db-a5793de84d54 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 210 time: 0.0266459 Dec 09 22:04:34.529545 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7999fbb1-630c-4bd0-87e1-5951833ac755 req-61d1f77c-7c37-4c82-a276-6b411447e205 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 210 time: 0.0264101 Dec 09 22:04:35.316655 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device ca52519f-6403-4107-bf09-14de9a102b79 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:04:35.338336 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: ca52519f-6403-4107-bf09-14de9a102b79 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:04:35.338683 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device ca52519f-6403-4107-bf09-14de9a102b79 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:04:35.626807 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d505be53-cd37-4bb3-8b6e-1473c678d10f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:35.633541 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-baa50c42-4b8a-41b8-ad40-8e5f7ca651dd req-61087f76-a8c7-47ed-bacc-219b32d158e2 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 210 time: 0.0311513 Dec 09 22:04:36.734468 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a7596ee6-b502-404a-895f-47a2c291215c req-8a5ebf6e-c9f6-4340-81a1-97c7d796df5e tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=b1351705-30cf-41ea-9aa5-a1839969cc2d HTTP/1.1" status: 200 len: 210 time: 0.0270360 Dec 09 22:04:36.768191 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:38.086817 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:39.678735 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:43.174920 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58420) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:04:43.206131 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:04:43.338743 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-e9214d38-957d-4e3f-993c-3c393e63d5cd tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Deleting port 4145e620-8c9f-4126-90ad-237b1b78ab68 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:04:43.339094 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9214d38-957d-4e3f-993c-3c393e63d5cd tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:43.415201 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9214d38-957d-4e3f-993c-3c393e63d5cd tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:43.415421 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9214d38-957d-4e3f-993c-3c393e63d5cd tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:43.427671 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-e9214d38-957d-4e3f-993c-3c393e63d5cd tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Calling delete_port for 4145e620-8c9f-4126-90ad-237b1b78ab68 owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:04:43.584626 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9214d38-957d-4e3f-993c-3c393e63d5cd tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:43.609473 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9214d38-957d-4e3f-993c-3c393e63d5cd tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event deleted for resources: {'Port': ['ID=4145e620-8c9f-4126-90ad-237b1b78ab68,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:04:43.673415 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9214d38-957d-4e3f-993c-3c393e63d5cd tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:43.673682 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-e9214d38-957d-4e3f-993c-3c393e63d5cd tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Floating IP 3eb7a989-3635-422c-91f5-9a2972ccc18c disassociated (deleted). External IP: 172.25.3.41, port: a0d8fd2f-f691-4d83-8320-05b91efdafbd. Dec 09 22:04:43.881178 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e9214d38-957d-4e3f-993c-3c393e63d5cd tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:04:43.994049 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e9214d38-957d-4e3f-993c-3c393e63d5cd tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:04:43.999268 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e9214d38-957d-4e3f-993c-3c393e63d5cd tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:44.003980 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a986413a-edc5-4f70-a89a-760ead679317 None None] Sync routers for ids ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:04:44.017606 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a986413a-edc5-4f70-a89a-760ead679317 None None] Routers {'52333c17-500b-4d13-8de7-f3d9c4c6eb46'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:04:44.018387 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a986413a-edc5-4f70-a89a-760ead679317 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:04:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:04:44.029752 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e9214d38-957d-4e3f-993c-3c393e63d5cd tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "DELETE /v2.0/floatingips/3eb7a989-3635-422c-91f5-9a2972ccc18c HTTP/1.1" status: 204 len: 168 time: 0.8536348 Dec 09 22:04:44.030408 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '15c3e0cc-52ce-44d9-8464-2ed50a05ba15', 'tag': 'a0d8fd2f-f691-4d83-8320-05b91efdafbd'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:04:44.034727 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b56e742b-adb1-42fa-84e4-3469872abe79" -d '{"events": [{"name": "network-changed", "server_uuid": "15c3e0cc-52ce-44d9-8464-2ed50a05ba15", "tag": "a0d8fd2f-f691-4d83-8320-05b91efdafbd"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:04:44.124176 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-a986413a-edc5-4f70-a89a-760ead679317 None None] Set router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:04:44.186120 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:04:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-daa2c13e-d64d-4e47-8ffe-733d585703f7 x-openstack-request-id: req-daa2c13e-d64d-4e47-8ffe-733d585703f7 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:04:44.186627 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "15c3e0cc-52ce-44d9-8464-2ed50a05ba15", "tag": "a0d8fd2f-f691-4d83-8320-05b91efdafbd", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:04:44.186727 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-daa2c13e-d64d-4e47-8ffe-733d585703f7 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:04:44.187302 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '15c3e0cc-52ce-44d9-8464-2ed50a05ba15', 'tag': 'a0d8fd2f-f691-4d83-8320-05b91efdafbd', 'status': 'completed', 'code': 200} Dec 09 22:04:44.261669 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b56e742b-adb1-42fa-84e4-3469872abe79 req-baa7f8fe-2f27-499b-a84b-fd8d773eda71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:04:44.263091 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b56e742b-adb1-42fa-84e4-3469872abe79 req-baa7f8fe-2f27-499b-a84b-fd8d773eda71 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 1098 time: 0.0534725 Dec 09 22:04:44.295584 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dfabd39-48a8-44d6-9aa2-42eba22946a3 req-e244309e-ccc9-4164-a39d-66c5fb266dfd tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:04:44.297096 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0dfabd39-48a8-44d6-9aa2-42eba22946a3 req-e244309e-ccc9-4164-a39d-66c5fb266dfd tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 946 time: 0.0577908 Dec 09 22:04:44.338252 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a986413a-edc5-4f70-a89a-760ead679317 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'db7c12a5-60a7-41e6-ae5c-e42348c373b4', 'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'mac_address': 'fa:16:3e:79:8f:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_interface', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:36Z', 'updated_at': '2021-12-09T21:54:44Z', 'revision_number': 5, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'subnets': [{'id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:04:44.352381 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0dfabd39-48a8-44d6-9aa2-42eba22946a3 req-d8d0c8fd-24f8-49f8-b059-c46d94a10019 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0485897 Dec 09 22:04:44.361218 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b56e742b-adb1-42fa-84e4-3469872abe79 req-12e2c71c-a909-4b33-925b-f0f253e180ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:04:44.363022 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b56e742b-adb1-42fa-84e4-3469872abe79 req-12e2c71c-a909-4b33-925b-f0f253e180ab service neutron] 10.222.0.31 "GET /v2.0/networks?id=486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 200 len: 911 time: 0.0907164 Dec 09 22:04:44.365979 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a986413a-edc5-4f70-a89a-760ead679317 None None] Checking router: 52333c17-500b-4d13-8de7-f3d9c4c6eb46 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:04:44.374474 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a986413a-edc5-4f70-a89a-760ead679317 None None] Routers {'52333c17-500b-4d13-8de7-f3d9c4c6eb46'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:04:44.375068 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a986413a-edc5-4f70-a89a-760ead679317 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:04:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:04:44.409734 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b56e742b-adb1-42fa-84e4-3469872abe79 req-1507fa1a-a8b2-475b-ad7d-d88348b8ced5 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a0d8fd2f-f691-4d83-8320-05b91efdafbd HTTP/1.1" status: 200 len: 217 time: 0.0394111 Dec 09 22:04:44.460590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b56e742b-adb1-42fa-84e4-3469872abe79 req-9c55cc95-7f22-4c06-b2e9-7d57b68a584f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:04:44.462088 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b56e742b-adb1-42fa-84e4-3469872abe79 req-9c55cc95-7f22-4c06-b2e9-7d57b68a584f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 200 len: 849 time: 0.0443280 Dec 09 22:04:44.481447 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-a986413a-edc5-4f70-a89a-760ead679317 None None] Set router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:04:44.511531 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b56e742b-adb1-42fa-84e4-3469872abe79 req-ad6ad1b0-17cf-4aa2-9537-569262b6a2f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:04:44.513158 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b56e742b-adb1-42fa-84e4-3469872abe79 req-ad6ad1b0-17cf-4aa2-9537-569262b6a2f4 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=486ad174-ad0c-4065-a4b6-6f9af6b2a208&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0435493 Dec 09 22:04:44.608233 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b56e742b-adb1-42fa-84e4-3469872abe79 req-33918b95-56d5-41de-9a98-d4b6ec86b529 service neutron] 10.222.0.31 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0872662 Dec 09 22:04:44.681784 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a986413a-edc5-4f70-a89a-760ead679317 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'db7c12a5-60a7-41e6-ae5c-e42348c373b4', 'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'mac_address': 'fa:16:3e:79:8f:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_interface', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:36Z', 'updated_at': '2021-12-09T21:54:44Z', 'revision_number': 5, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'subnets': [{'id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:04:44.700374 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b56e742b-adb1-42fa-84e4-3469872abe79 req-3456926b-8820-45f1-9bda-cf52b2b6541b service neutron] 10.222.0.31 "GET /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0836439 Dec 09 22:04:44.708068 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a986413a-edc5-4f70-a89a-760ead679317 None None] The sync data for ids ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'] in n-d-713301-27 is: [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'db7c12a5-60a7-41e6-ae5c-e42348c373b4', 'name': '', 'network_id': '486ad174-ad0c-4065-a4b6-6f9af6b2a208', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'mac_address': 'fa:16:3e:79:8f:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_interface', 'standard_attr_id': 3938, 'fixed_ips': [{'subnet_id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:36Z', 'updated_at': '2021-12-09T21:54:44Z', 'revision_number': 5, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'subnets': [{'id': '7004626f-deda-4ef1-8abe-97a447b2d2e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:04:44.933783 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1b2e180-f49b-457e-a683-f5b6fa4ddc67 None None] New status for floating IP 3eb7a989-3635-422c-91f5-9a2972ccc18c: DOWN {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:04:45.475762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5581f14b-67ee-4724-ba05-0b62c6304c34 req-b886e96a-f571-4615-a79e-462d3eaa17e2 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:04:45.477252 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5581f14b-67ee-4724-ba05-0b62c6304c34 req-b886e96a-f571-4615-a79e-462d3eaa17e2 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 946 time: 0.0545816 Dec 09 22:04:45.533635 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5581f14b-67ee-4724-ba05-0b62c6304c34 req-5292c9e9-f0be-4e5f-b6cd-6bff89d2802b tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/security-groups?id=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0497291 Dec 09 22:04:45.742984 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a37d608-831c-4c1e-ba54-cd71d4bb2896 req-3fb62b8c-f898-4144-b83c-27b62ffcc36a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:04:45.744466 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7a37d608-831c-4c1e-ba54-cd71d4bb2896 req-3fb62b8c-f898-4144-b83c-27b62ffcc36a tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.31 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 946 time: 0.0552349 Dec 09 22:04:45.837176 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-7a37d608-831c-4c1e-ba54-cd71d4bb2896 req-5b87bb8b-0c68-40b0-acba-76a3387b6269 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Deleting port a0d8fd2f-f691-4d83-8320-05b91efdafbd {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:04:45.837512 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7a37d608-831c-4c1e-ba54-cd71d4bb2896 req-5b87bb8b-0c68-40b0-acba-76a3387b6269 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:45.932274 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-7a37d608-831c-4c1e-ba54-cd71d4bb2896 req-5b87bb8b-0c68-40b0-acba-76a3387b6269 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] For port a0d8fd2f-f691-4d83-8320-05b91efdafbd, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=a0d8fd2f-f691-4d83-8320-05b91efdafbd,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:04:45.932645 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7a37d608-831c-4c1e-ba54-cd71d4bb2896 req-5b87bb8b-0c68-40b0-acba-76a3387b6269 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:45.945285 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-7a37d608-831c-4c1e-ba54-cd71d4bb2896 req-5b87bb8b-0c68-40b0-acba-76a3387b6269 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Calling delete_port for a0d8fd2f-f691-4d83-8320-05b91efdafbd owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:04:46.081264 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7a37d608-831c-4c1e-ba54-cd71d4bb2896 req-5b87bb8b-0c68-40b0-acba-76a3387b6269 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:46.114281 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b87bb8b-0c68-40b0-acba-76a3387b6269 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event deleted for resources: {'Port': ['ID=a0d8fd2f-f691-4d83-8320-05b91efdafbd,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:04:46.154958 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-7a37d608-831c-4c1e-ba54-cd71d4bb2896 req-5b87bb8b-0c68-40b0-acba-76a3387b6269 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] No DVR routers for this DVR port a0d8fd2f-f691-4d83-8320-05b91efdafbd on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:04:46.157586 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-7a37d608-831c-4c1e-ba54-cd71d4bb2896 req-5b87bb8b-0c68-40b0-acba-76a3387b6269 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:46.161059 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7a37d608-831c-4c1e-ba54-cd71d4bb2896 req-5b87bb8b-0c68-40b0-acba-76a3387b6269 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.31 "DELETE /v2.0/ports/a0d8fd2f-f691-4d83-8320-05b91efdafbd HTTP/1.1" status: 204 len: 173 time: 0.4092662 Dec 09 22:04:46.188867 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '15c3e0cc-52ce-44d9-8464-2ed50a05ba15', 'name': 'network-vif-deleted', 'tag': 'a0d8fd2f-f691-4d83-8320-05b91efdafbd'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:04:46.191465 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a92e7e15-c0cf-49f7-86b0-664989ef687a" -d '{"events": [{"server_uuid": "15c3e0cc-52ce-44d9-8464-2ed50a05ba15", "name": "network-vif-deleted", "tag": "a0d8fd2f-f691-4d83-8320-05b91efdafbd"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:04:46.228854 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:04:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b3dd8918-8c30-486f-bed2-beb1a856ee1a x-openstack-request-id: req-b3dd8918-8c30-486f-bed2-beb1a856ee1a {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:04:46.229148 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "15c3e0cc-52ce-44d9-8464-2ed50a05ba15", "name": "network-vif-deleted", "tag": "a0d8fd2f-f691-4d83-8320-05b91efdafbd", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:04:46.229418 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-b3dd8918-8c30-486f-bed2-beb1a856ee1a {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:04:46.229808 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '15c3e0cc-52ce-44d9-8464-2ed50a05ba15', 'name': 'network-vif-deleted', 'tag': 'a0d8fd2f-f691-4d83-8320-05b91efdafbd', 'status': 'completed', 'code': 200} Dec 09 22:04:46.644790 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb5759b9-de6c-4dea-90d9-5a8740774083 req-3eec9359-000e-48de-a87f-7b43ed2ec983 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 210 time: 0.0285275 Dec 09 22:04:47.742279 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd63871f-3b5c-4185-bfe1-23009aeb74f0 req-3e485c98-8ede-4b13-93c5-a6be9f7af60c tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 210 time: 0.0270309 Dec 09 22:04:48.840357 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9742b3db-e03f-466e-8823-dfd5ec4ec5c2 req-a3f6d610-bf9a-407a-9a32-d302d1631137 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 210 time: 0.0284088 Dec 09 22:04:49.113168 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device a0d8fd2f-f691-4d83-8320-05b91efdafbd no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:04:49.133530 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: a0d8fd2f-f691-4d83-8320-05b91efdafbd {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:04:49.133873 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device a0d8fd2f-f691-4d83-8320-05b91efdafbd not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:04:49.939028 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a58a5a1-3c49-4160-bbd5-ba26d3f6936f req-758a3118-717c-4025-9451-0f0d162b13b0 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "GET /v2.0/ports?device_id=15c3e0cc-52ce-44d9-8464-2ed50a05ba15 HTTP/1.1" status: 200 len: 210 time: 0.0289276 Dec 09 22:04:51.006656 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58442) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:04:51.478876 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-00cf78fd-5b97-4397-bb39-2c7fdaf70402 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Deleting port 7f8b5e41-4308-4d85-ae3e-6d92aee9e9de {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:04:51.479221 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-00cf78fd-5b97-4397-bb39-2c7fdaf70402 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:51.552780 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-00cf78fd-5b97-4397-bb39-2c7fdaf70402 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:51.553105 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-00cf78fd-5b97-4397-bb39-2c7fdaf70402 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:51.565476 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-00cf78fd-5b97-4397-bb39-2c7fdaf70402 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Calling delete_port for 7f8b5e41-4308-4d85-ae3e-6d92aee9e9de owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:04:51.711755 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-00cf78fd-5b97-4397-bb39-2c7fdaf70402 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:51.740687 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00cf78fd-5b97-4397-bb39-2c7fdaf70402 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event deleted for resources: {'Port': ['ID=7f8b5e41-4308-4d85-ae3e-6d92aee9e9de,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:04:51.812339 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-00cf78fd-5b97-4397-bb39-2c7fdaf70402 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:51.814950 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-00cf78fd-5b97-4397-bb39-2c7fdaf70402 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:51.816201 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-00cf78fd-5b97-4397-bb39-2c7fdaf70402 tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "DELETE /v2.0/floatingips/fa4716d2-6124-4a9c-b9d7-e84a2afe830c HTTP/1.1" status: 204 len: 168 time: 0.8084657 Dec 09 22:04:55.112194 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58458) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:04:55.172357 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-278eaf0a-9767-426e-8bce-ee65823ddadb tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:55.198732 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-278eaf0a-9767-426e-8bce-ee65823ddadb tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:55.260336 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-278eaf0a-9767-426e-8bce-ee65823ddadb tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:55.263796 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-278eaf0a-9767-426e-8bce-ee65823ddadb tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:55.267802 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-278eaf0a-9767-426e-8bce-ee65823ddadb tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] 10.222.0.13 "DELETE /v2.0/security-groups/aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f HTTP/1.1" status: 204 len: 168 time: 0.1545126 Dec 09 22:04:55.278870 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-278eaf0a-9767-426e-8bce-ee65823ddadb tempest-TestVolumeBootPattern-1173131366 tempest-TestVolumeBootPattern-1173131366-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=aafa8bf8-5fcc-4abf-b4f2-5f3ebb55da8f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:04:55.326754 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58462) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:04:55.804447 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c0b61bd2-7a37-4bdd-8cc6-0c08099a5cd7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:56.075690 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c0b61bd2-7a37-4bdd-8cc6-0c08099a5cd7 admin admin] Deleting port db7c12a5-60a7-41e6-ae5c-e42348c373b4 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:04:56.075925 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c0b61bd2-7a37-4bdd-8cc6-0c08099a5cd7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:56.155658 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-c0b61bd2-7a37-4bdd-8cc6-0c08099a5cd7 admin admin] For port db7c12a5-60a7-41e6-ae5c-e42348c373b4, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=db7c12a5-60a7-41e6-ae5c-e42348c373b4,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:04:56.156337 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c0b61bd2-7a37-4bdd-8cc6-0c08099a5cd7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:56.169104 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c0b61bd2-7a37-4bdd-8cc6-0c08099a5cd7 admin admin] Calling delete_port for db7c12a5-60a7-41e6-ae5c-e42348c373b4 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:04:56.359244 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c0b61bd2-7a37-4bdd-8cc6-0c08099a5cd7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:56.388527 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0b61bd2-7a37-4bdd-8cc6-0c08099a5cd7 admin admin] Pushing event deleted for resources: {'Port': ['ID=db7c12a5-60a7-41e6-ae5c-e42348c373b4,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:04:56.566576 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c0b61bd2-7a37-4bdd-8cc6-0c08099a5cd7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:56.791094 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c0b61bd2-7a37-4bdd-8cc6-0c08099a5cd7 admin admin] Router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:04:56.904017 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c0b61bd2-7a37-4bdd-8cc6-0c08099a5cd7 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:04:56.909311 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c0b61bd2-7a37-4bdd-8cc6-0c08099a5cd7 admin admin] 10.222.0.13 "PUT /v2.0/routers/52333c17-500b-4d13-8de7-f3d9c4c6eb46/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5814402 Dec 09 22:04:56.912360 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58466) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:04:56.914900 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-205e9f94-8554-4988-a130-d76883bfa7b4 None None] Sync routers for ids ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:04:56.929954 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-205e9f94-8554-4988-a130-d76883bfa7b4 None None] Routers {'52333c17-500b-4d13-8de7-f3d9c4c6eb46'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:04:56.930716 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-205e9f94-8554-4988-a130-d76883bfa7b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:04:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:04:57.022043 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-58d79479-734b-4118-9b2d-ba3251aa009d admin admin] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:57.038543 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-205e9f94-8554-4988-a130-d76883bfa7b4 None None] Set router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:04:57.230081 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-205e9f94-8554-4988-a130-d76883bfa7b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T22:04:56Z', 'revision_number': 5, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:04:57.257182 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-205e9f94-8554-4988-a130-d76883bfa7b4 None None] Checking router: 52333c17-500b-4d13-8de7-f3d9c4c6eb46 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:04:57.265753 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-205e9f94-8554-4988-a130-d76883bfa7b4 None None] Routers {'52333c17-500b-4d13-8de7-f3d9c4c6eb46'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:04:57.266427 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-205e9f94-8554-4988-a130-d76883bfa7b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:04:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:04:57.370433 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-205e9f94-8554-4988-a130-d76883bfa7b4 None None] Set router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:04:57.394137 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-58d79479-734b-4118-9b2d-ba3251aa009d admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:57.451635 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-58d79479-734b-4118-9b2d-ba3251aa009d admin admin] Deleting port 8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:04:57.451864 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-58d79479-734b-4118-9b2d-ba3251aa009d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:57.533485 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:57.540617 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-58d79479-734b-4118-9b2d-ba3251aa009d admin admin] For port 8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:04:57.541151 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-58d79479-734b-4118-9b2d-ba3251aa009d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:57.553849 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-58d79479-734b-4118-9b2d-ba3251aa009d admin admin] Calling delete_port for 8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2 owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:04:57.642756 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-205e9f94-8554-4988-a130-d76883bfa7b4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T22:04:56Z', 'revision_number': 5, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:04:57.672322 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-205e9f94-8554-4988-a130-d76883bfa7b4 None None] The sync data for ids ['52333c17-500b-4d13-8de7-f3d9c4c6eb46'] in n-d-713301-27 is: [{'id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'name': 'tempest-TestVolumeBootPattern-68643702-router', 'tenant_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165'}], 'enable_snat': True}, 'gw_port_id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:33Z', 'updated_at': '2021-12-09T22:04:56Z', 'revision_number': 5, 'project_id': 'be526cfddc4f4783b993a3f6e5b5e630', 'gw_port': {'id': '8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:86:e5:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '52333c17-500b-4d13-8de7-f3d9c4c6eb46', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3937, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.165', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:34Z', 'updated_at': '2021-12-09T21:54:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:04:57.722679 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-58d79479-734b-4118-9b2d-ba3251aa009d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:57.727531 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:57.748887 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58d79479-734b-4118-9b2d-ba3251aa009d admin admin] Pushing event deleted for resources: {'Port': ['ID=8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:04:57.763596 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c73ed37-e78d-4b15-9f7d-4953672b9265 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:04:57.813339 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-58d79479-734b-4118-9b2d-ba3251aa009d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:57.905841 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-58d79479-734b-4118-9b2d-ba3251aa009d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:57.908181 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-58d79479-734b-4118-9b2d-ba3251aa009d admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:57.960041 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-58d79479-734b-4118-9b2d-ba3251aa009d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:57.962209 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-58d79479-734b-4118-9b2d-ba3251aa009d admin admin] Fanout notify agent at l3_agent the message router_deleted on router 52333c17-500b-4d13-8de7-f3d9c4c6eb46 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 22:04:57.969501 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-58d79479-734b-4118-9b2d-ba3251aa009d admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:57.970730 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-58d79479-734b-4118-9b2d-ba3251aa009d admin admin] 10.222.0.13 "DELETE /v2.0/routers/52333c17-500b-4d13-8de7-f3d9c4c6eb46 HTTP/1.1" status: 204 len: 168 time: 1.0573444 Dec 09 22:04:57.973712 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58468) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:04:58.021154 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-b1f2c82b-b310-44d8-b56b-48e32a6a237a admin admin] Deleting subnet 7004626f-deda-4ef1-8abe-97a447b2d2e9 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:04:58.025908 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b1f2c82b-b310-44d8-b56b-48e32a6a237a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:58.067270 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b1f2c82b-b310-44d8-b56b-48e32a6a237a admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:58.147289 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b1f2c82b-b310-44d8-b56b-48e32a6a237a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:58.206505 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b1f2c82b-b310-44d8-b56b-48e32a6a237a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:58.227670 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d6f620a6-6456-4270-8fa3-fe6644ab71af None None] Network 486ad174-ad0c-4065-a4b6-6f9af6b2a208 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:04:58.238550 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b1f2c82b-b310-44d8-b56b-48e32a6a237a admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:58.241795 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b1f2c82b-b310-44d8-b56b-48e32a6a237a admin admin] 10.222.0.13 "DELETE /v2.0/subnets/7004626f-deda-4ef1-8abe-97a447b2d2e9 HTTP/1.1" status: 204 len: 168 time: 0.2671618 Dec 09 22:04:58.242881 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1f2c82b-b310-44d8-b56b-48e32a6a237a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7004626f-deda-4ef1-8abe-97a447b2d2e9,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:04:58.245353 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58470) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:04:58.318468 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fb0f1b9c-b967-4570-94ab-1ee1fc119ddc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:58.373196 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-fb0f1b9c-b967-4570-94ab-1ee1fc119ddc admin admin] Deleting port 531d78f5-2683-4d75-a638-f4d5d7296300 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:04:58.373532 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fb0f1b9c-b967-4570-94ab-1ee1fc119ddc admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:58.396047 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04ecf200-fb68-4410-8f60-7831c70b67cd None None] DHCP port deletion for 486ad174-ad0c-4065-a4b6-6f9af6b2a208 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:04:58.442905 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-fb0f1b9c-b967-4570-94ab-1ee1fc119ddc admin admin] For port 531d78f5-2683-4d75-a638-f4d5d7296300, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=531d78f5-2683-4d75-a638-f4d5d7296300,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:04:58.443278 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fb0f1b9c-b967-4570-94ab-1ee1fc119ddc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:58.446208 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-04ecf200-fb68-4410-8f60-7831c70b67cd None None] Deleting port 531d78f5-2683-4d75-a638-f4d5d7296300 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:04:58.446606 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-04ecf200-fb68-4410-8f60-7831c70b67cd None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:58.456445 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-fb0f1b9c-b967-4570-94ab-1ee1fc119ddc admin admin] Calling delete_port for 531d78f5-2683-4d75-a638-f4d5d7296300 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:04:58.509160 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-04ecf200-fb68-4410-8f60-7831c70b67cd None None] For port 531d78f5-2683-4d75-a638-f4d5d7296300, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=531d78f5-2683-4d75-a638-f4d5d7296300,segment=NetworkSegment(efd99328-8749-4154-94c0-14d978d592d7),segment_id=efd99328-8749-4154-94c0-14d978d592d7)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:04:58.509576 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-04ecf200-fb68-4410-8f60-7831c70b67cd None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:58.522230 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-04ecf200-fb68-4410-8f60-7831c70b67cd None None] Calling delete_port for 531d78f5-2683-4d75-a638-f4d5d7296300 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:04:58.543875 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fb0f1b9c-b967-4570-94ab-1ee1fc119ddc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:58.574988 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb0f1b9c-b967-4570-94ab-1ee1fc119ddc admin admin] Pushing event deleted for resources: {'Port': ['ID=531d78f5-2683-4d75-a638-f4d5d7296300,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:04:58.576850 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb0f1b9c-b967-4570-94ab-1ee1fc119ddc admin admin] No DVR routers for this DVR port 531d78f5-2683-4d75-a638-f4d5d7296300 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Dec 09 22:04:58.593899 n-d-713301-27 neutron-server[103439]: self.session.flush() Dec 09 22:04:58.599921 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-04ecf200-fb68-4410-8f60-7831c70b67cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:58.624861 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04ecf200-fb68-4410-8f60-7831c70b67cd None None] Pushing event deleted for resources: {'Port': ['ID=531d78f5-2683-4d75-a638-f4d5d7296300,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:04:58.629240 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04ecf200-fb68-4410-8f60-7831c70b67cd None None] No DVR routers for this DVR port 531d78f5-2683-4d75-a638-f4d5d7296300 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:04:58.636545 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04ecf200-fb68-4410-8f60-7831c70b67cd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:58.637054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04ecf200-fb68-4410-8f60-7831c70b67cd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:58.637548 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04ecf200-fb68-4410-8f60-7831c70b67cd None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:58.638014 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04ecf200-fb68-4410-8f60-7831c70b67cd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:58.638972 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04ecf200-fb68-4410-8f60-7831c70b67cd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:58.639938 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04ecf200-fb68-4410-8f60-7831c70b67cd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:58.640421 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04ecf200-fb68-4410-8f60-7831c70b67cd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:58.640897 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04ecf200-fb68-4410-8f60-7831c70b67cd None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:58.641386 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04ecf200-fb68-4410-8f60-7831c70b67cd None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:58.641871 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04ecf200-fb68-4410-8f60-7831c70b67cd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:58.642351 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04ecf200-fb68-4410-8f60-7831c70b67cd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:58.642819 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04ecf200-fb68-4410-8f60-7831c70b67cd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:58.643319 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-04ecf200-fb68-4410-8f60-7831c70b67cd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:04:58.652748 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fb0f1b9c-b967-4570-94ab-1ee1fc119ddc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:58.672845 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-fb0f1b9c-b967-4570-94ab-1ee1fc119ddc admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['486ad174-ad0c-4065-a4b6-6f9af6b2a208']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:04:58.682509 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-fb0f1b9c-b967-4570-94ab-1ee1fc119ddc admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'efd99328-8749-4154-94c0-14d978d592d7') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:04:58.682787 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-fb0f1b9c-b967-4570-94ab-1ee1fc119ddc admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'efd99328-8749-4154-94c0-14d978d592d7') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:04:58.692325 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fb0f1b9c-b967-4570-94ab-1ee1fc119ddc admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:58.709318 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fb0f1b9c-b967-4570-94ab-1ee1fc119ddc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:58.717050 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fb0f1b9c-b967-4570-94ab-1ee1fc119ddc admin admin] Releasing vlan 124 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:04:58.717528 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fb0f1b9c-b967-4570-94ab-1ee1fc119ddc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: timer() Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:04:58.719396 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:04:58.781544 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fb0f1b9c-b967-4570-94ab-1ee1fc119ddc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:58.787304 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fb0f1b9c-b967-4570-94ab-1ee1fc119ddc admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:58.793273 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fb0f1b9c-b967-4570-94ab-1ee1fc119ddc admin admin] 10.222.0.13 "DELETE /v2.0/networks/486ad174-ad0c-4065-a4b6-6f9af6b2a208 HTTP/1.1" status: 204 len: 168 time: 0.5436246 Dec 09 22:04:58.795265 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58472) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:04:58.801385 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb0f1b9c-b967-4570-94ab-1ee1fc119ddc admin admin] Pushing event deleted for resources: {'Network': ['ID=486ad174-ad0c-4065-a4b6-6f9af6b2a208,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:04:59.152768 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f98fc239-d77d-4a06-a2df-384815fdf671 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:59.405886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-f98fc239-d77d-4a06-a2df-384815fdf671 admin admin] Deleting port a2a7ed1c-77f1-4378-94db-cc40981b8c34 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:04:59.406093 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f98fc239-d77d-4a06-a2df-384815fdf671 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:59.487411 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-f98fc239-d77d-4a06-a2df-384815fdf671 admin admin] For port a2a7ed1c-77f1-4378-94db-cc40981b8c34, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a2a7ed1c-77f1-4378-94db-cc40981b8c34,segment=NetworkSegment(d4d23ac9-b7fb-4582-aa7f-b0313907bb51),segment_id=d4d23ac9-b7fb-4582-aa7f-b0313907bb51)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:04:59.487920 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f98fc239-d77d-4a06-a2df-384815fdf671 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:59.501615 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-f98fc239-d77d-4a06-a2df-384815fdf671 admin admin] Calling delete_port for a2a7ed1c-77f1-4378-94db-cc40981b8c34 owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:04:59.526347 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device db7c12a5-60a7-41e6-ae5c-e42348c373b4 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:04:59.548023 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: db7c12a5-60a7-41e6-ae5c-e42348c373b4 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:04:59.548472 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device db7c12a5-60a7-41e6-ae5c-e42348c373b4 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:04:59.548962 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:04:59.569678 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:04:59.570001 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 8b4dea99-1da1-4d55-8c4c-b7d8139fe5d2 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:04:59.570629 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 531d78f5-2683-4d75-a638-f4d5d7296300 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:04:59.593029 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 531d78f5-2683-4d75-a638-f4d5d7296300 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:04:59.593376 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 531d78f5-2683-4d75-a638-f4d5d7296300 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:04:59.698425 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f98fc239-d77d-4a06-a2df-384815fdf671 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:04:59.727731 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f98fc239-d77d-4a06-a2df-384815fdf671 admin admin] Pushing event deleted for resources: {'Port': ['ID=a2a7ed1c-77f1-4378-94db-cc40981b8c34,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:04:59.912643 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f98fc239-d77d-4a06-a2df-384815fdf671 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:00.144357 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f98fc239-d77d-4a06-a2df-384815fdf671 admin admin] Router 81c166f6-53f6-46c3-94a6-18a6c1225074 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:05:00.253941 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f98fc239-d77d-4a06-a2df-384815fdf671 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:05:00.259216 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f98fc239-d77d-4a06-a2df-384815fdf671 admin admin] 10.222.0.13 "PUT /v2.0/routers/81c166f6-53f6-46c3-94a6-18a6c1225074/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4626639 Dec 09 22:05:00.262258 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58474) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:05:00.265125 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-516fa8bc-ac9e-4b1e-9b8a-48a193c84554 None None] Sync routers for ids ['81c166f6-53f6-46c3-94a6-18a6c1225074'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:05:00.276434 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-516fa8bc-ac9e-4b1e-9b8a-48a193c84554 None None] Routers {'81c166f6-53f6-46c3-94a6-18a6c1225074'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:05:00.277057 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-516fa8bc-ac9e-4b1e-9b8a-48a193c84554 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:04:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['81c166f6-53f6-46c3-94a6-18a6c1225074'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:05:00.367355 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4938d061-7a0d-4702-8aff-cb79801e73c9 admin admin] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:00.381496 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-516fa8bc-ac9e-4b1e-9b8a-48a193c84554 None None] Set router 81c166f6-53f6-46c3-94a6-18a6c1225074 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:05:00.475778 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4938d061-7a0d-4702-8aff-cb79801e73c9 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:00.528094 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-4938d061-7a0d-4702-8aff-cb79801e73c9 admin admin] Deleting port b602231c-6ee6-4253-987e-c9855434bb2a {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:05:00.528431 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4938d061-7a0d-4702-8aff-cb79801e73c9 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:00.562507 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-516fa8bc-ac9e-4b1e-9b8a-48a193c84554 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '81c166f6-53f6-46c3-94a6-18a6c1225074', 'name': 'tempest-TestVolumeBootPattern-78789970-router', 'tenant_id': '1dff2c41373b452ca617836c4bf8f952', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.245'}], 'enable_snat': True}, 'gw_port_id': 'b602231c-6ee6-4253-987e-c9855434bb2a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:39Z', 'updated_at': '2021-12-09T22:04:59Z', 'revision_number': 5, 'project_id': '1dff2c41373b452ca617836c4bf8f952', 'gw_port': {'id': 'b602231c-6ee6-4253-987e-c9855434bb2a', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:c9:90', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '81c166f6-53f6-46c3-94a6-18a6c1225074', 'device_owner': 'network:router_gateway', 'standard_attr_id': 3949, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.245', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T21:54:40Z', 'updated_at': '2021-12-09T21:54:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:05:00.588570 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-516fa8bc-ac9e-4b1e-9b8a-48a193c84554 None None] Checking router: 81c166f6-53f6-46c3-94a6-18a6c1225074 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:05:00.597692 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-516fa8bc-ac9e-4b1e-9b8a-48a193c84554 None None] Routers {'81c166f6-53f6-46c3-94a6-18a6c1225074'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:05:00.598292 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-516fa8bc-ac9e-4b1e-9b8a-48a193c84554 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:04:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['81c166f6-53f6-46c3-94a6-18a6c1225074'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:05:00.605366 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-4938d061-7a0d-4702-8aff-cb79801e73c9 admin admin] For port b602231c-6ee6-4253-987e-c9855434bb2a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b602231c-6ee6-4253-987e-c9855434bb2a,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:05:00.605705 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4938d061-7a0d-4702-8aff-cb79801e73c9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:00.619111 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-4938d061-7a0d-4702-8aff-cb79801e73c9 admin admin] Calling delete_port for b602231c-6ee6-4253-987e-c9855434bb2a owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:05:00.684045 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-516fa8bc-ac9e-4b1e-9b8a-48a193c84554 None None] Set router 81c166f6-53f6-46c3-94a6-18a6c1225074 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:05:00.738705 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-516fa8bc-ac9e-4b1e-9b8a-48a193c84554 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '81c166f6-53f6-46c3-94a6-18a6c1225074', 'name': 'tempest-TestVolumeBootPattern-78789970-router', 'tenant_id': '1dff2c41373b452ca617836c4bf8f952', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:39Z', 'updated_at': '2021-12-09T22:05:00Z', 'revision_number': 6, 'project_id': '1dff2c41373b452ca617836c4bf8f952', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:05:00.764962 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-516fa8bc-ac9e-4b1e-9b8a-48a193c84554 None None] The sync data for ids ['81c166f6-53f6-46c3-94a6-18a6c1225074'] in n-d-713301-27 is: [{'id': '81c166f6-53f6-46c3-94a6-18a6c1225074', 'name': 'tempest-TestVolumeBootPattern-78789970-router', 'tenant_id': '1dff2c41373b452ca617836c4bf8f952', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T21:54:39Z', 'updated_at': '2021-12-09T22:05:00Z', 'revision_number': 6, 'project_id': '1dff2c41373b452ca617836c4bf8f952', 'gw_port_host': None}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:05:00.785747 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4938d061-7a0d-4702-8aff-cb79801e73c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:00.818915 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4938d061-7a0d-4702-8aff-cb79801e73c9 admin admin] Pushing event deleted for resources: {'Port': ['ID=b602231c-6ee6-4253-987e-c9855434bb2a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:00.834000 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4a21180-c025-4fa8-b421-85519cb5d632 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:05:00.881909 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4938d061-7a0d-4702-8aff-cb79801e73c9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:00.973628 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4938d061-7a0d-4702-8aff-cb79801e73c9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:00.975806 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4938d061-7a0d-4702-8aff-cb79801e73c9 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:01.021672 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4938d061-7a0d-4702-8aff-cb79801e73c9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:01.022130 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4938d061-7a0d-4702-8aff-cb79801e73c9 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 81c166f6-53f6-46c3-94a6-18a6c1225074 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 22:05:01.026530 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4938d061-7a0d-4702-8aff-cb79801e73c9 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:01.027723 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4938d061-7a0d-4702-8aff-cb79801e73c9 admin admin] 10.222.0.13 "DELETE /v2.0/routers/81c166f6-53f6-46c3-94a6-18a6c1225074 HTTP/1.1" status: 204 len: 168 time: 0.7645617 Dec 09 22:05:01.030478 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58476) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:05:01.076515 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-2a1c6dae-fdcd-4aca-9410-040ebb669c82 admin admin] Deleting subnet 530ff632-ec21-4b96-a24b-61c4b22f4827 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:05:01.079820 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a1c6dae-fdcd-4aca-9410-040ebb669c82 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:01.121321 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a1c6dae-fdcd-4aca-9410-040ebb669c82 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:01.210697 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a1c6dae-fdcd-4aca-9410-040ebb669c82 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:01.270887 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a1c6dae-fdcd-4aca-9410-040ebb669c82 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:01.301690 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a1c6dae-fdcd-4aca-9410-040ebb669c82 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=530ff632-ec21-4b96-a24b-61c4b22f4827,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:01.303636 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2a1c6dae-fdcd-4aca-9410-040ebb669c82 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:01.306888 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2a1c6dae-fdcd-4aca-9410-040ebb669c82 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/530ff632-ec21-4b96-a24b-61c4b22f4827 HTTP/1.1" status: 204 len: 168 time: 0.2753923 Dec 09 22:05:01.309073 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ad9f68f-5457-4d61-9eb2-7406bccaab19 None None] Network a40f73e2-2be7-4c6a-9103-48879b1376b3 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:05:01.312424 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58478) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:05:01.384556 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-630703b1-0c9b-4581-add1-c3cc1c07d3dc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:01.439973 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-630703b1-0c9b-4581-add1-c3cc1c07d3dc admin admin] Deleting port 6493d4a3-01d6-4f58-8330-009006bd42be {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:05:01.440324 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-630703b1-0c9b-4581-add1-c3cc1c07d3dc admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:01.506113 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-630703b1-0c9b-4581-add1-c3cc1c07d3dc admin admin] For port 6493d4a3-01d6-4f58-8330-009006bd42be, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6493d4a3-01d6-4f58-8330-009006bd42be,segment=NetworkSegment(d4d23ac9-b7fb-4582-aa7f-b0313907bb51),segment_id=d4d23ac9-b7fb-4582-aa7f-b0313907bb51)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:05:01.506472 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-630703b1-0c9b-4581-add1-c3cc1c07d3dc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:01.521905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-630703b1-0c9b-4581-add1-c3cc1c07d3dc admin admin] Calling delete_port for 6493d4a3-01d6-4f58-8330-009006bd42be owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:05:01.551672 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab20958b-fe7b-4ffb-a837-67018d05166e None None] DHCP port deletion for a40f73e2-2be7-4c6a-9103-48879b1376b3 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:05:01.618380 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-630703b1-0c9b-4581-add1-c3cc1c07d3dc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:01.623946 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ab20958b-fe7b-4ffb-a837-67018d05166e None None] Deleting port 6493d4a3-01d6-4f58-8330-009006bd42be {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:05:01.624430 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ab20958b-fe7b-4ffb-a837-67018d05166e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:01.640082 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b602231c-6ee6-4253-987e-c9855434bb2a no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:05:01.647778 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-630703b1-0c9b-4581-add1-c3cc1c07d3dc admin admin] Pushing event deleted for resources: {'Port': ['ID=6493d4a3-01d6-4f58-8330-009006bd42be,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:01.649642 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-630703b1-0c9b-4581-add1-c3cc1c07d3dc admin admin] No DVR routers for this DVR port 6493d4a3-01d6-4f58-8330-009006bd42be on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:05:01.671000 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: b602231c-6ee6-4253-987e-c9855434bb2a {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:05:01.671345 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b602231c-6ee6-4253-987e-c9855434bb2a not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:05:01.671794 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a2a7ed1c-77f1-4378-94db-cc40981b8c34 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:05:01.717829 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: a2a7ed1c-77f1-4378-94db-cc40981b8c34 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:05:01.718176 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a2a7ed1c-77f1-4378-94db-cc40981b8c34 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:05:01.718602 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6493d4a3-01d6-4f58-8330-009006bd42be no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:05:01.750876 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 6493d4a3-01d6-4f58-8330-009006bd42be {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:05:01.751221 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6493d4a3-01d6-4f58-8330-009006bd42be not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:05:01.757228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ab20958b-fe7b-4ffb-a837-67018d05166e None None] For port 6493d4a3-01d6-4f58-8330-009006bd42be, host n-d-713301-27, got binding levels [] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:05:01.757874 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ab20958b-fe7b-4ffb-a837-67018d05166e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:01.771402 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ab20958b-fe7b-4ffb-a837-67018d05166e None None] Calling delete_port for 6493d4a3-01d6-4f58-8330-009006bd42be owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:05:01.774694 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.ipam_backend_mixin [None req-ab20958b-fe7b-4ffb-a837-67018d05166e None None] Port 6493d4a3-01d6-4f58-8330-009006bd42be was not found and therefore no delete operation was performed {{(pid=103439) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 09 22:05:01.776066 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ab20958b-fe7b-4ffb-a837-67018d05166e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:01.801284 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab20958b-fe7b-4ffb-a837-67018d05166e None None] Pushing event deleted for resources: {'Port': ['ID=6493d4a3-01d6-4f58-8330-009006bd42be,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:01.807604 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab20958b-fe7b-4ffb-a837-67018d05166e None None] No DVR routers for this DVR port 6493d4a3-01d6-4f58-8330-009006bd42be on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:05:02.006667 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-630703b1-0c9b-4581-add1-c3cc1c07d3dc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:02.027945 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-630703b1-0c9b-4581-add1-c3cc1c07d3dc admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a40f73e2-2be7-4c6a-9103-48879b1376b3']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:05:02.038813 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-630703b1-0c9b-4581-add1-c3cc1c07d3dc admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd4d23ac9-b7fb-4582-aa7f-b0313907bb51') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:05:02.039310 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-630703b1-0c9b-4581-add1-c3cc1c07d3dc admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd4d23ac9-b7fb-4582-aa7f-b0313907bb51') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:05:02.050445 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-630703b1-0c9b-4581-add1-c3cc1c07d3dc admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:02.065486 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-630703b1-0c9b-4581-add1-c3cc1c07d3dc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:02.071888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-630703b1-0c9b-4581-add1-c3cc1c07d3dc admin admin] Releasing vlan 101 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:05:02.072242 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-630703b1-0c9b-4581-add1-c3cc1c07d3dc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: timer() Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:05:02.074205 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:05:02.140616 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-630703b1-0c9b-4581-add1-c3cc1c07d3dc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:02.146812 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-630703b1-0c9b-4581-add1-c3cc1c07d3dc admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:02.150154 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-630703b1-0c9b-4581-add1-c3cc1c07d3dc admin admin] 10.222.0.13 "DELETE /v2.0/networks/a40f73e2-2be7-4c6a-9103-48879b1376b3 HTTP/1.1" status: 204 len: 168 time: 0.8367181 Dec 09 22:05:02.164804 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-630703b1-0c9b-4581-add1-c3cc1c07d3dc admin admin] Pushing event deleted for resources: {'Network': ['ID=a40f73e2-2be7-4c6a-9103-48879b1376b3,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:02.287854 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58482) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:05:02.329456 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f5294ab6-941b-45a3-8593-489e490e6c79 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=be526cfddc4f4783b993a3f6e5b5e630&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0403116 Dec 09 22:05:02.331951 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58484) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:05:02.384239 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3c309d40-2841-4fce-b5a4-9ade63ad15cd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:02.405125 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3c309d40-2841-4fce-b5a4-9ade63ad15cd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:02.453485 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3c309d40-2841-4fce-b5a4-9ade63ad15cd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:02.456375 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3c309d40-2841-4fce-b5a4-9ade63ad15cd admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:02.457506 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3c309d40-2841-4fce-b5a4-9ade63ad15cd admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/04593cf6-df62-4851-bed9-8fc871e1c284 HTTP/1.1" status: 204 len: 168 time: 0.1246717 Dec 09 22:05:02.465050 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c309d40-2841-4fce-b5a4-9ade63ad15cd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=04593cf6-df62-4851-bed9-8fc871e1c284,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:02.820300 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58490) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:05:02.860246 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3b8a8500-a7d9-43c5-b047-cc4584e0c163 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=1dff2c41373b452ca617836c4bf8f952&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0380189 Dec 09 22:05:02.862694 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58492) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:05:02.911661 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9bea646d-92ba-4d70-a80a-cfa2a61a4990 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:02.933110 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9bea646d-92ba-4d70-a80a-cfa2a61a4990 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:02.984405 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9bea646d-92ba-4d70-a80a-cfa2a61a4990 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:02.987906 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9bea646d-92ba-4d70-a80a-cfa2a61a4990 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:02.989087 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9bea646d-92ba-4d70-a80a-cfa2a61a4990 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/d4fc259f-764d-4b97-a5bd-111902b97b1f HTTP/1.1" status: 204 len: 168 time: 0.1254554 Dec 09 22:05:02.997825 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f861e449-a03b-49f9-b25e-38778c65f5f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:02.998344 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9bea646d-92ba-4d70-a80a-cfa2a61a4990 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d4fc259f-764d-4b97-a5bd-111902b97b1f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:05.627045 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-959ac01d-4c96-4166-9cd5-c8ff6d5f63e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:06.763824 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:08.093226 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:09.665243 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:13.768152 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc533709-59cf-4b35-9e75-568596d74e0b req-89a4acda-a3d4-4e19-a4bd-e7565e9f694c tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=30802ffdc56641febab58f9b7df16e60&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0297012 Dec 09 22:05:13.955470 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc533709-59cf-4b35-9e75-568596d74e0b req-50a833e6-9712-4279-b31f-07fca5c08185 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:13.956960 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc533709-59cf-4b35-9e75-568596d74e0b req-50a833e6-9712-4279-b31f-07fca5c08185 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1829822 Dec 09 22:05:13.972332 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc533709-59cf-4b35-9e75-568596d74e0b req-7d51b6e3-0a4c-4de7-af14-cde9a4366afb tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.13 "GET /v2.0/quotas/30802ffdc56641febab58f9b7df16e60 HTTP/1.1" status: 200 len: 375 time: 0.0092866 Dec 09 22:05:14.003542 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc533709-59cf-4b35-9e75-568596d74e0b req-0ece775c-e5f6-4521-90f2-d721cff56bf7 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=30802ffdc56641febab58f9b7df16e60&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0255506 Dec 09 22:05:14.180655 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fac08a53-0388-4117-b8e4-b2b10a212c3d req-591b647c-83e4-4025-888f-28d3d68bf3a8 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.13 "GET /v2.0/ports?device_id=845b9b9c-3887-41e2-aeac-effc6f01d4d1 HTTP/1.1" status: 200 len: 210 time: 0.0273471 Dec 09 22:05:15.071307 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc533709-59cf-4b35-9e75-568596d74e0b req-9a1357b1-9706-41be-8bc1-5227e4af91f3 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.10 "GET /v2.0/networks?tenant_id=30802ffdc56641febab58f9b7df16e60&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0221891 Dec 09 22:05:15.185421 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc533709-59cf-4b35-9e75-568596d74e0b req-6c04e2a8-ac52-4731-add2-2ccccd18052d tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:15.186882 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc533709-59cf-4b35-9e75-568596d74e0b req-6c04e2a8-ac52-4731-add2-2ccccd18052d tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.10 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1091440 Dec 09 22:05:15.200390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-bc533709-59cf-4b35-9e75-568596d74e0b req-a8aef193-45b6-4eda-990e-9b20ed6b2cf1 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Request body: {'port': {'device_id': '845b9b9c-3887-41e2-aeac-effc6f01d4d1', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'admin_state_up': True, 'tenant_id': '30802ffdc56641febab58f9b7df16e60'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:05:15.293948 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfc5966f-d498-4ef4-819c-57e10433e525 req-9b65ae18-9e83-4a5c-94d2-b109e2ead310 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.13 "GET /v2.0/ports?device_id=845b9b9c-3887-41e2-aeac-effc6f01d4d1 HTTP/1.1" status: 200 len: 210 time: 0.0319762 Dec 09 22:05:15.336562 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bc533709-59cf-4b35-9e75-568596d74e0b req-a8aef193-45b6-4eda-990e-9b20ed6b2cf1 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Made reservation on behalf of 30802ffdc56641febab58f9b7df16e60 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:05:15.341528 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bc533709-59cf-4b35-9e75-568596d74e0b req-a8aef193-45b6-4eda-990e-9b20ed6b2cf1 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:15.355600 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bc533709-59cf-4b35-9e75-568596d74e0b req-a8aef193-45b6-4eda-990e-9b20ed6b2cf1 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:15.435457 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bc533709-59cf-4b35-9e75-568596d74e0b req-a8aef193-45b6-4eda-990e-9b20ed6b2cf1 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:15.442287 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bc533709-59cf-4b35-9e75-568596d74e0b req-a8aef193-45b6-4eda-990e-9b20ed6b2cf1 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:15.501452 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8aef193-45b6-4eda-990e-9b20ed6b2cf1 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b570a1f9-fbff-4bcf-a2fe-86baededcf9e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:15.586438 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-bc533709-59cf-4b35-9e75-568596d74e0b req-a8aef193-45b6-4eda-990e-9b20ed6b2cf1 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Allocated IP 192.168.233.217 (a65c426d-3aa0-44a9-a050-356ed74ee6a0/331e71ac-cc5a-4dd1-9d4e-e83d568ec849/aa1c5272-b45d-4974-a7c4-5e9b8fb2136f) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:05:15.738791 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bc533709-59cf-4b35-9e75-568596d74e0b req-a8aef193-45b6-4eda-990e-9b20ed6b2cf1 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:15.776224 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bc533709-59cf-4b35-9e75-568596d74e0b req-a8aef193-45b6-4eda-990e-9b20ed6b2cf1 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:15.816689 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bc533709-59cf-4b35-9e75-568596d74e0b req-a8aef193-45b6-4eda-990e-9b20ed6b2cf1 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Network a65c426d-3aa0-44a9-a050-356ed74ee6a0 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:05:15.819912 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-bc533709-59cf-4b35-9e75-568596d74e0b req-a8aef193-45b6-4eda-990e-9b20ed6b2cf1 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:05:15.823738 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-bc533709-59cf-4b35-9e75-568596d74e0b req-a8aef193-45b6-4eda-990e-9b20ed6b2cf1 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:05:15.853743 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8aef193-45b6-4eda-990e-9b20ed6b2cf1 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Pushing event updated for resources: {'Port': ['ID=aa1c5272-b45d-4974-a7c4-5e9b8fb2136f,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:15.880989 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc533709-59cf-4b35-9e75-568596d74e0b req-a8aef193-45b6-4eda-990e-9b20ed6b2cf1 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:15.881626 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bc533709-59cf-4b35-9e75-568596d74e0b req-a8aef193-45b6-4eda-990e-9b20ed6b2cf1 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:15.901277 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc533709-59cf-4b35-9e75-568596d74e0b req-a8aef193-45b6-4eda-990e-9b20ed6b2cf1 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 0.7042389 Dec 09 22:05:16.019641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-bc533709-59cf-4b35-9e75-568596d74e0b req-e39a9b9f-6a45-42d4-af4e-5581d0f08186 service neutron] Request body: {'port': {'device_id': '845b9b9c-3887-41e2-aeac-effc6f01d4d1', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:05:16.025008 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-440cfb2e-b3d5-4bf9-8e26-0d196774be52 None None] Provisioning complete for port aa1c5272-b45d-4974-a7c4-5e9b8fb2136f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:05:16.025543 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-440cfb2e-b3d5-4bf9-8e26-0d196774be52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:16.059995 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-440cfb2e-b3d5-4bf9-8e26-0d196774be52 None None] Port aa1c5272-b45d-4974-a7c4-5e9b8fb2136f cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:05:16.076334 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bc533709-59cf-4b35-9e75-568596d74e0b req-e39a9b9f-6a45-42d4-af4e-5581d0f08186 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:16.337103 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-bc533709-59cf-4b35-9e75-568596d74e0b req-e39a9b9f-6a45-42d4-af4e-5581d0f08186 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id aa1c5272-b45d-4974-a7c4-5e9b8fb2136f {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:05:16.344613 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bc533709-59cf-4b35-9e75-568596d74e0b req-e39a9b9f-6a45-42d4-af4e-5581d0f08186 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:16.357632 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-bc533709-59cf-4b35-9e75-568596d74e0b req-e39a9b9f-6a45-42d4-af4e-5581d0f08186 service neutron] Transition to ACTIVE for port object aa1c5272-b45d-4974-a7c4-5e9b8fb2136f will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:05:16.362574 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bc533709-59cf-4b35-9e75-568596d74e0b req-e39a9b9f-6a45-42d4-af4e-5581d0f08186 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:16.440317 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e39a9b9f-6a45-42d4-af4e-5581d0f08186 service neutron] Pushing event updated for resources: {'Port': ['ID=aa1c5272-b45d-4974-a7c4-5e9b8fb2136f,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:16.478110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6e80450-622b-4057-8fb1-80cb9fcdf403 req-c3981e1d-f646-4435-8ab2-f92fc0da0262 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:16.479848 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d6e80450-622b-4057-8fb1-80cb9fcdf403 req-c3981e1d-f646-4435-8ab2-f92fc0da0262 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.13 "GET /v2.0/ports?device_id=845b9b9c-3887-41e2-aeac-effc6f01d4d1 HTTP/1.1" status: 200 len: 948 time: 0.1149042 Dec 09 22:05:16.561162 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-bc533709-59cf-4b35-9e75-568596d74e0b req-e39a9b9f-6a45-42d4-af4e-5581d0f08186 service neutron] Attempting to bind port aa1c5272-b45d-4974-a7c4-5e9b8fb2136f on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:05:16.561492 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-bc533709-59cf-4b35-9e75-568596d74e0b req-e39a9b9f-6a45-42d4-af4e-5581d0f08186 service neutron] Attempting to bind port aa1c5272-b45d-4974-a7c4-5e9b8fb2136f by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:05:16.561821 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc533709-59cf-4b35-9e75-568596d74e0b req-e39a9b9f-6a45-42d4-af4e-5581d0f08186 service neutron] Attempting to bind port aa1c5272-b45d-4974-a7c4-5e9b8fb2136f on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:05:16.566863 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d6e80450-622b-4057-8fb1-80cb9fcdf403 req-336a6748-61bf-4a1c-a080-63864322325e tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.13 "GET /v2.0/security-groups?id=b570a1f9-fbff-4bcf-a2fe-86baededcf9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0675936 Dec 09 22:05:16.570292 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc533709-59cf-4b35-9e75-568596d74e0b req-e39a9b9f-6a45-42d4-af4e-5581d0f08186 service neutron] Port aa1c5272-b45d-4974-a7c4-5e9b8fb2136f on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:05:16.570660 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc533709-59cf-4b35-9e75-568596d74e0b req-e39a9b9f-6a45-42d4-af4e-5581d0f08186 service neutron] Attempting to bind port aa1c5272-b45d-4974-a7c4-5e9b8fb2136f on network a65c426d-3aa0-44a9-a050-356ed74ee6a0 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:05:16.576000 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc533709-59cf-4b35-9e75-568596d74e0b req-e39a9b9f-6a45-42d4-af4e-5581d0f08186 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 4, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:05:16.576273 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc533709-59cf-4b35-9e75-568596d74e0b req-e39a9b9f-6a45-42d4-af4e-5581d0f08186 service neutron] Checking segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:05:16.576617 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc533709-59cf-4b35-9e75-568596d74e0b req-e39a9b9f-6a45-42d4-af4e-5581d0f08186 service neutron] Bound using segment: {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:05:16.577022 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-bc533709-59cf-4b35-9e75-568596d74e0b req-e39a9b9f-6a45-42d4-af4e-5581d0f08186 service neutron] Bound port: aa1c5272-b45d-4974-a7c4-5e9b8fb2136f, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '21b42a1d-3e05-4768-9d37-d79980247879', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 114, 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:05:16.577394 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bc533709-59cf-4b35-9e75-568596d74e0b req-e39a9b9f-6a45-42d4-af4e-5581d0f08186 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:16.651286 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-bc533709-59cf-4b35-9e75-568596d74e0b req-e39a9b9f-6a45-42d4-af4e-5581d0f08186 service neutron] For port aa1c5272-b45d-4974-a7c4-5e9b8fb2136f, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:05:16.654273 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-bc533709-59cf-4b35-9e75-568596d74e0b req-e39a9b9f-6a45-42d4-af4e-5581d0f08186 service neutron] For port aa1c5272-b45d-4974-a7c4-5e9b8fb2136f, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=aa1c5272-b45d-4974-a7c4-5e9b8fb2136f,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:05:16.661582 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bc533709-59cf-4b35-9e75-568596d74e0b req-e39a9b9f-6a45-42d4-af4e-5581d0f08186 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:16.696752 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc533709-59cf-4b35-9e75-568596d74e0b req-e39a9b9f-6a45-42d4-af4e-5581d0f08186 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:16.697372 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bc533709-59cf-4b35-9e75-568596d74e0b req-e39a9b9f-6a45-42d4-af4e-5581d0f08186 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:16.698797 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc533709-59cf-4b35-9e75-568596d74e0b req-e39a9b9f-6a45-42d4-af4e-5581d0f08186 service neutron] 10.222.0.10 "PUT /v2.0/ports/aa1c5272-b45d-4974-a7c4-5e9b8fb2136f HTTP/1.1" status: 200 len: 1097 time: 0.7890835 Dec 09 22:05:16.699193 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '845b9b9c-3887-41e2-aeac-effc6f01d4d1', 'tag': 'aa1c5272-b45d-4974-a7c4-5e9b8fb2136f'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:05:16.701484 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-06ac1343-3fd3-40db-b0f8-453c3d08463c" -d '{"events": [{"name": "network-changed", "server_uuid": "845b9b9c-3887-41e2-aeac-effc6f01d4d1", "tag": "aa1c5272-b45d-4974-a7c4-5e9b8fb2136f"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:05:16.725470 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e39a9b9f-6a45-42d4-af4e-5581d0f08186 service neutron] Pushing event updated for resources: {'Port': ['ID=aa1c5272-b45d-4974-a7c4-5e9b8fb2136f,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:16.744168 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:05:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a4500c18-0964-4fe0-b019-a1a216fb441c x-openstack-request-id: req-a4500c18-0964-4fe0-b019-a1a216fb441c {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:05:16.744428 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "845b9b9c-3887-41e2-aeac-effc6f01d4d1", "tag": "aa1c5272-b45d-4974-a7c4-5e9b8fb2136f", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:05:16.744683 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a4500c18-0964-4fe0-b019-a1a216fb441c {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:05:16.745096 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '845b9b9c-3887-41e2-aeac-effc6f01d4d1', 'tag': 'aa1c5272-b45d-4974-a7c4-5e9b8fb2136f', 'status': 'completed', 'code': 200} Dec 09 22:05:16.794928 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc533709-59cf-4b35-9e75-568596d74e0b req-6e4ff390-f705-4b38-bb4c-8cdf029ca24e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:16.796664 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc533709-59cf-4b35-9e75-568596d74e0b req-6e4ff390-f705-4b38-bb4c-8cdf029ca24e service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=30802ffdc56641febab58f9b7df16e60&device_id=845b9b9c-3887-41e2-aeac-effc6f01d4d1 HTTP/1.1" status: 200 len: 1100 time: 0.0449774 Dec 09 22:05:16.841968 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc533709-59cf-4b35-9e75-568596d74e0b req-2b797a2a-f94a-45ed-a0a8-50ff552a0454 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.217&port_id=aa1c5272-b45d-4974-a7c4-5e9b8fb2136f HTTP/1.1" status: 200 len: 217 time: 0.0370712 Dec 09 22:05:16.896005 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc533709-59cf-4b35-9e75-568596d74e0b req-e81eaf94-d8c6-4754-b87f-04443ad080fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:16.897839 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc533709-59cf-4b35-9e75-568596d74e0b req-e81eaf94-d8c6-4754-b87f-04443ad080fb service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0495021 Dec 09 22:05:16.950379 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc533709-59cf-4b35-9e75-568596d74e0b req-2542be85-76e0-4d74-91f2-846f1647be36 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:16.951940 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc533709-59cf-4b35-9e75-568596d74e0b req-2542be85-76e0-4d74-91f2-846f1647be36 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0465026 Dec 09 22:05:17.058450 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc533709-59cf-4b35-9e75-568596d74e0b req-a60e7960-2a5f-4e03-86de-bb3a8c3fbf6a service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0982246 Dec 09 22:05:17.149305 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc533709-59cf-4b35-9e75-568596d74e0b req-43980382-9d89-41b6-a789-890a4b7c21e6 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0842745 Dec 09 22:05:17.254668 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06ac1343-3fd3-40db-b0f8-453c3d08463c req-08cbf20f-cfe2-4b32-8ef9-4ac90e7277d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:17.256216 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-06ac1343-3fd3-40db-b0f8-453c3d08463c req-08cbf20f-cfe2-4b32-8ef9-4ac90e7277d3 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=30802ffdc56641febab58f9b7df16e60&device_id=845b9b9c-3887-41e2-aeac-effc6f01d4d1 HTTP/1.1" status: 200 len: 1100 time: 0.0465670 Dec 09 22:05:17.351726 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06ac1343-3fd3-40db-b0f8-453c3d08463c req-aa5e4171-20c0-4102-ac1c-cc1750e2149a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:17.353277 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-06ac1343-3fd3-40db-b0f8-453c3d08463c req-aa5e4171-20c0-4102-ac1c-cc1750e2149a service neutron] 10.222.0.10 "GET /v2.0/networks?id=a65c426d-3aa0-44a9-a050-356ed74ee6a0 HTTP/1.1" status: 200 len: 870 time: 0.0895932 Dec 09 22:05:17.396012 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-06ac1343-3fd3-40db-b0f8-453c3d08463c req-a18154d0-7e4c-4d2b-a5f5-b9ac4ce71686 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.217&port_id=aa1c5272-b45d-4974-a7c4-5e9b8fb2136f HTTP/1.1" status: 200 len: 217 time: 0.0347161 Dec 09 22:05:17.449389 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06ac1343-3fd3-40db-b0f8-453c3d08463c req-f5509735-4301-41f6-b1e9-0f3a01aba6e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:17.450732 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-06ac1343-3fd3-40db-b0f8-453c3d08463c req-f5509735-4301-41f6-b1e9-0f3a01aba6e3 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=331e71ac-cc5a-4dd1-9d4e-e83d568ec849 HTTP/1.1" status: 200 len: 843 time: 0.0475657 Dec 09 22:05:17.498691 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06ac1343-3fd3-40db-b0f8-453c3d08463c req-74e6afc9-a9b4-43d4-addd-460f2766d64c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:17.500242 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-06ac1343-3fd3-40db-b0f8-453c3d08463c req-74e6afc9-a9b4-43d4-addd-460f2766d64c service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=a65c426d-3aa0-44a9-a050-356ed74ee6a0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1167 time: 0.0413589 Dec 09 22:05:17.590314 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-06ac1343-3fd3-40db-b0f8-453c3d08463c req-05caa571-0743-4e9b-9e06-31b75efef308 service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0817673 Dec 09 22:05:17.714660 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-06ac1343-3fd3-40db-b0f8-453c3d08463c req-56324e56-f706-4848-b8ad-b1de5eedccab service neutron] 10.222.0.10 "GET /v2.0/networks/a65c426d-3aa0-44a9-a050-356ed74ee6a0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1157665 Dec 09 22:05:17.727787 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15aa5868-956f-4f9b-bbce-557d63030000 req-411dac27-684b-4ac3-9a38-82d3db3ee901 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:17.729225 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15aa5868-956f-4f9b-bbce-557d63030000 req-411dac27-684b-4ac3-9a38-82d3db3ee901 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.13 "GET /v2.0/ports?device_id=845b9b9c-3887-41e2-aeac-effc6f01d4d1 HTTP/1.1" status: 200 len: 948 time: 0.0704544 Dec 09 22:05:17.786513 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15aa5868-956f-4f9b-bbce-557d63030000 req-2469cba5-8da7-4e6e-a6a3-91f9724e0da3 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.13 "GET /v2.0/security-groups?id=b570a1f9-fbff-4bcf-a2fe-86baededcf9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503449 Dec 09 22:05:18.931819 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8954ca73-5cdf-411d-b5c2-f7534e5632e6 req-e024b259-cff5-4ee0-b72b-a9670b61f2bd tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:18.933294 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8954ca73-5cdf-411d-b5c2-f7534e5632e6 req-e024b259-cff5-4ee0-b72b-a9670b61f2bd tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.13 "GET /v2.0/ports?device_id=845b9b9c-3887-41e2-aeac-effc6f01d4d1 HTTP/1.1" status: 200 len: 948 time: 0.0569208 Dec 09 22:05:18.984073 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8954ca73-5cdf-411d-b5c2-f7534e5632e6 req-c5b04890-e019-4e14-a4f4-a4d4a805f4d3 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.13 "GET /v2.0/security-groups?id=b570a1f9-fbff-4bcf-a2fe-86baededcf9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420823 Dec 09 22:05:19.436243 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device aa1c5272-b45d-4974-a7c4-5e9b8fb2136f details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:05:19.541466 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port aa1c5272-b45d-4974-a7c4-5e9b8fb2136f, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=aa1c5272-b45d-4974-a7c4-5e9b8fb2136f,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:05:19.553036 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'aa1c5272-b45d-4974-a7c4-5e9b8fb2136f', 'network_id': 'a65c426d-3aa0-44a9-a050-356ed74ee6a0', 'port_id': 'aa1c5272-b45d-4974-a7c4-5e9b8fb2136f', 'mac_address': 'fa:16:3e:3e:92:3b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 114, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '331e71ac-cc5a-4dd1-9d4e-e83d568ec849', 'ip_address': '192.168.233.217'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:05:19.594846 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:19.608405 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id aa1c5272-b45d-4974-a7c4-5e9b8fb2136f {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:05:19.629338 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port aa1c5272-b45d-4974-a7c4-5e9b8fb2136f, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=aa1c5272-b45d-4974-a7c4-5e9b8fb2136f,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:05:19.634075 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:19.680201 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=aa1c5272-b45d-4974-a7c4-5e9b8fb2136f,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:19.867866 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['aa1c5272-b45d-4974-a7c4-5e9b8fb2136f'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:05:20.112368 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3a7456c-0138-40f3-ae95-e1cac667373f req-fca00440-d535-4ab6-a47b-143ddd75fc55 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:20.113912 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b3a7456c-0138-40f3-ae95-e1cac667373f req-fca00440-d535-4ab6-a47b-143ddd75fc55 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.13 "GET /v2.0/ports?device_id=845b9b9c-3887-41e2-aeac-effc6f01d4d1 HTTP/1.1" status: 200 len: 949 time: 0.0519905 Dec 09 22:05:20.167993 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b3a7456c-0138-40f3-ae95-e1cac667373f req-741a6787-4011-422d-b212-c7df8f374211 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.13 "GET /v2.0/security-groups?id=b570a1f9-fbff-4bcf-a2fe-86baededcf9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0472002 Dec 09 22:05:20.204841 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:05:21.301791 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a53bae66-8a96-4000-9a24-7149ed0c27b2 req-c4951cce-7271-4c8e-818b-7adb1eff143a tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:21.303294 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a53bae66-8a96-4000-9a24-7149ed0c27b2 req-c4951cce-7271-4c8e-818b-7adb1eff143a tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.13 "GET /v2.0/ports?device_id=845b9b9c-3887-41e2-aeac-effc6f01d4d1 HTTP/1.1" status: 200 len: 949 time: 0.0613263 Dec 09 22:05:21.353072 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a53bae66-8a96-4000-9a24-7149ed0c27b2 req-c0deb162-d446-4ff8-963a-3ca563851c3e tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.13 "GET /v2.0/security-groups?id=b570a1f9-fbff-4bcf-a2fe-86baededcf9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435476 Dec 09 22:05:21.455252 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device aa1c5272-b45d-4974-a7c4-5e9b8fb2136f up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:05:21.517706 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port aa1c5272-b45d-4974-a7c4-5e9b8fb2136f completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:05:21.522760 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port aa1c5272-b45d-4974-a7c4-5e9b8fb2136f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:05:21.523379 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:21.607419 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:21.630865 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '845b9b9c-3887-41e2-aeac-effc6f01d4d1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aa1c5272-b45d-4974-a7c4-5e9b8fb2136f'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:05:21.633145 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6eceadc4-9768-40ea-89b0-cb8090b0ba1d" -d '{"events": [{"server_uuid": "845b9b9c-3887-41e2-aeac-effc6f01d4d1", "name": "network-vif-plugged", "status": "completed", "tag": "aa1c5272-b45d-4974-a7c4-5e9b8fb2136f"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:05:21.645665 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port aa1c5272-b45d-4974-a7c4-5e9b8fb2136f, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=aa1c5272-b45d-4974-a7c4-5e9b8fb2136f,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:05:21.651189 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:21.673422 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:05:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-06c5f947-8090-4f57-bc99-d2980b4f3dc7 x-openstack-request-id: req-06c5f947-8090-4f57-bc99-d2980b4f3dc7 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:05:21.673716 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "845b9b9c-3887-41e2-aeac-effc6f01d4d1", "name": "network-vif-plugged", "status": "completed", "tag": "aa1c5272-b45d-4974-a7c4-5e9b8fb2136f", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:05:21.673968 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-06c5f947-8090-4f57-bc99-d2980b4f3dc7 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:05:21.674357 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '845b9b9c-3887-41e2-aeac-effc6f01d4d1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aa1c5272-b45d-4974-a7c4-5e9b8fb2136f', 'code': 200} Dec 09 22:05:21.704222 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=aa1c5272-b45d-4974-a7c4-5e9b8fb2136f,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:21.769072 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e99d75c-2766-4e96-b690-28104d645b26 req-63b96dbc-a12e-4b2f-a5b5-0f78252beb86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:21.770551 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e99d75c-2766-4e96-b690-28104d645b26 req-63b96dbc-a12e-4b2f-a5b5-0f78252beb86 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=845b9b9c-3887-41e2-aeac-effc6f01d4d1 HTTP/1.1" status: 200 len: 1102 time: 0.0421610 Dec 09 22:05:21.819043 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e99d75c-2766-4e96-b690-28104d645b26 req-97350712-67db-4f56-9948-adb5e34c2c07 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=b570a1f9-fbff-4bcf-a2fe-86baededcf9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401580 Dec 09 22:05:22.493343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56b0ff4f-9e0a-4cdf-bece-552e5307f14b req-f1c35156-4810-407b-9cb3-9e225eed5a37 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:22.494795 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56b0ff4f-9e0a-4cdf-bece-552e5307f14b req-f1c35156-4810-407b-9cb3-9e225eed5a37 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.13 "GET /v2.0/ports?device_id=845b9b9c-3887-41e2-aeac-effc6f01d4d1 HTTP/1.1" status: 200 len: 950 time: 0.0526638 Dec 09 22:05:22.551010 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56b0ff4f-9e0a-4cdf-bece-552e5307f14b req-6bf66999-f787-429d-bb6f-32014f8eac67 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.13 "GET /v2.0/security-groups?id=b570a1f9-fbff-4bcf-a2fe-86baededcf9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473223 Dec 09 22:05:23.692424 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a4fcc8c-8500-4932-add3-59f6beb6f9ba req-2dde80d9-20df-4e21-9ba0-783627f21ad3 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:23.693912 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a4fcc8c-8500-4932-add3-59f6beb6f9ba req-2dde80d9-20df-4e21-9ba0-783627f21ad3 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.13 "GET /v2.0/ports?device_id=845b9b9c-3887-41e2-aeac-effc6f01d4d1 HTTP/1.1" status: 200 len: 950 time: 0.0596826 Dec 09 22:05:23.743971 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a4fcc8c-8500-4932-add3-59f6beb6f9ba req-30eada59-693b-4e88-8be0-ba81bccde498 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.13 "GET /v2.0/security-groups?id=b570a1f9-fbff-4bcf-a2fe-86baededcf9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432901 Dec 09 22:05:24.039007 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-44c5d252-40af-4ccb-b59b-c01107c9f9c8 req-2cf1f895-c445-4cd4-8da0-98f7d784d41e service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 22:05:24.040396 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44c5d252-40af-4ccb-b59b-c01107c9f9c8 req-2cf1f895-c445-4cd4-8da0-98f7d784d41e service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0088468 Dec 09 22:05:24.682256 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5cc67a1-2e1e-4ae9-ad87-75b1043a72ca req-d9d49b52-3ea7-401d-af37-721eb3eab8d4 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:24.683772 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5cc67a1-2e1e-4ae9-ad87-75b1043a72ca req-d9d49b52-3ea7-401d-af37-721eb3eab8d4 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.13 "GET /v2.0/ports?device_id=845b9b9c-3887-41e2-aeac-effc6f01d4d1 HTTP/1.1" status: 200 len: 950 time: 0.0501182 Dec 09 22:05:24.736339 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5cc67a1-2e1e-4ae9-ad87-75b1043a72ca req-4d75a0d7-c6c3-44b8-8bcb-2fbd429d2dba tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.13 "GET /v2.0/security-groups?id=b570a1f9-fbff-4bcf-a2fe-86baededcf9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434732 Dec 09 22:05:25.858821 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98db7c74-6c34-4056-8675-a6f4ca4d2535 req-54d80cba-4932-4552-91a2-488c4a28fcbf tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:25.860724 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98db7c74-6c34-4056-8675-a6f4ca4d2535 req-54d80cba-4932-4552-91a2-488c4a28fcbf tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.13 "GET /v2.0/ports?device_id=845b9b9c-3887-41e2-aeac-effc6f01d4d1 HTTP/1.1" status: 200 len: 950 time: 0.0546000 Dec 09 22:05:25.941080 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9f6d58a-b587-4092-8f47-b6c6428887b1 req-a3fb5c43-1a59-4dbb-8610-200da28ec23d tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:25.942532 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9f6d58a-b587-4092-8f47-b6c6428887b1 req-a3fb5c43-1a59-4dbb-8610-200da28ec23d tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.10 "GET /v2.0/ports?device_id=845b9b9c-3887-41e2-aeac-effc6f01d4d1 HTTP/1.1" status: 200 len: 950 time: 0.0746131 Dec 09 22:05:25.946400 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98db7c74-6c34-4056-8675-a6f4ca4d2535 req-b5cf6742-d961-42f6-8d9b-cec7f5ce563a tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.13 "GET /v2.0/security-groups?id=b570a1f9-fbff-4bcf-a2fe-86baededcf9e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0708549 Dec 09 22:05:26.045224 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-b9f6d58a-b587-4092-8f47-b6c6428887b1 req-1dae3e22-f0c6-4ec0-b74e-3d0792f0fb74 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Deleting port aa1c5272-b45d-4974-a7c4-5e9b8fb2136f {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:05:26.045435 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b9f6d58a-b587-4092-8f47-b6c6428887b1 req-1dae3e22-f0c6-4ec0-b74e-3d0792f0fb74 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:26.138211 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-b9f6d58a-b587-4092-8f47-b6c6428887b1 req-1dae3e22-f0c6-4ec0-b74e-3d0792f0fb74 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] For port aa1c5272-b45d-4974-a7c4-5e9b8fb2136f, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=aa1c5272-b45d-4974-a7c4-5e9b8fb2136f,segment=NetworkSegment(21b42a1d-3e05-4768-9d37-d79980247879),segment_id=21b42a1d-3e05-4768-9d37-d79980247879)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:05:26.138573 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b9f6d58a-b587-4092-8f47-b6c6428887b1 req-1dae3e22-f0c6-4ec0-b74e-3d0792f0fb74 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:26.151178 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-b9f6d58a-b587-4092-8f47-b6c6428887b1 req-1dae3e22-f0c6-4ec0-b74e-3d0792f0fb74 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Calling delete_port for aa1c5272-b45d-4974-a7c4-5e9b8fb2136f owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:05:26.322556 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b9f6d58a-b587-4092-8f47-b6c6428887b1 req-1dae3e22-f0c6-4ec0-b74e-3d0792f0fb74 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:26.335461 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['aa1c5272-b45d-4974-a7c4-5e9b8fb2136f'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:05:26.353251 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dae3e22-f0c6-4ec0-b74e-3d0792f0fb74 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Pushing event deleted for resources: {'Port': ['ID=aa1c5272-b45d-4974-a7c4-5e9b8fb2136f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:26.397294 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-b9f6d58a-b587-4092-8f47-b6c6428887b1 req-1dae3e22-f0c6-4ec0-b74e-3d0792f0fb74 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] No DVR routers for this DVR port aa1c5272-b45d-4974-a7c4-5e9b8fb2136f on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:05:26.400377 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-b9f6d58a-b587-4092-8f47-b6c6428887b1 req-1dae3e22-f0c6-4ec0-b74e-3d0792f0fb74 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:26.403894 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9f6d58a-b587-4092-8f47-b6c6428887b1 req-1dae3e22-f0c6-4ec0-b74e-3d0792f0fb74 tempest-ServersAdminNegativeTestJSON-82844279 tempest-ServersAdminNegativeTestJSON-82844279-project] 10.222.0.10 "DELETE /v2.0/ports/aa1c5272-b45d-4974-a7c4-5e9b8fb2136f HTTP/1.1" status: 204 len: 173 time: 0.4538906 Dec 09 22:05:26.404351 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '845b9b9c-3887-41e2-aeac-effc6f01d4d1', 'name': 'network-vif-deleted', 'tag': 'aa1c5272-b45d-4974-a7c4-5e9b8fb2136f'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:05:26.406658 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-82a19db9-7955-48b7-ab67-61fde6967abe" -d '{"events": [{"server_uuid": "845b9b9c-3887-41e2-aeac-effc6f01d4d1", "name": "network-vif-deleted", "tag": "aa1c5272-b45d-4974-a7c4-5e9b8fb2136f"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:05:26.452596 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:05:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1a1f8f07-a846-4f70-a01c-a4493ea50361 x-openstack-request-id: req-1a1f8f07-a846-4f70-a01c-a4493ea50361 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:05:26.453155 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "845b9b9c-3887-41e2-aeac-effc6f01d4d1", "name": "network-vif-deleted", "tag": "aa1c5272-b45d-4974-a7c4-5e9b8fb2136f", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:05:26.453503 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-1a1f8f07-a846-4f70-a01c-a4493ea50361 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:05:26.453843 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '845b9b9c-3887-41e2-aeac-effc6f01d4d1', 'name': 'network-vif-deleted', 'tag': 'aa1c5272-b45d-4974-a7c4-5e9b8fb2136f', 'status': 'completed', 'code': 200} Dec 09 22:05:27.272477 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58622) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:05:27.416825 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-66c9685c-031b-4f9a-b7c7-5ea05e59771f admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=30802ffdc56641febab58f9b7df16e60&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1431148 Dec 09 22:05:27.419639 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58626) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:05:27.471298 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f02de9da-6e21-4e0a-afb5-a0f02cd85bf6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:27.494317 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f02de9da-6e21-4e0a-afb5-a0f02cd85bf6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:27.533204 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:27.544294 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f02de9da-6e21-4e0a-afb5-a0f02cd85bf6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:27.548535 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f02de9da-6e21-4e0a-afb5-a0f02cd85bf6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:27.550024 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f02de9da-6e21-4e0a-afb5-a0f02cd85bf6 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/b570a1f9-fbff-4bcf-a2fe-86baededcf9e HTTP/1.1" status: 204 len: 168 time: 0.1294074 Dec 09 22:05:27.559404 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f02de9da-6e21-4e0a-afb5-a0f02cd85bf6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b570a1f9-fbff-4bcf-a2fe-86baededcf9e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:27.718645 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:27.830865 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58632) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:05:27.844624 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9881e695-c7eb-4539-8de3-d8d172473791 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:27.922445 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9881e695-c7eb-4539-8de3-d8d172473791 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:27.929032 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9881e695-c7eb-4539-8de3-d8d172473791 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:27.967213 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9881e695-c7eb-4539-8de3-d8d172473791 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=499651977ade4348957da15feb7d8dcb&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1351776 Dec 09 22:05:27.968202 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9881e695-c7eb-4539-8de3-d8d172473791 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f5b29b5a-1e0f-4f5b-bdce-9931a6b4418b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:27.970157 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58634) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:05:28.020808 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d9f6709-1729-4652-8b6e-a168f8069bda admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:28.042710 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d9f6709-1729-4652-8b6e-a168f8069bda admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:28.095788 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d9f6709-1729-4652-8b6e-a168f8069bda admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:28.098514 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0d9f6709-1729-4652-8b6e-a168f8069bda admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:28.099707 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0d9f6709-1729-4652-8b6e-a168f8069bda admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/f5b29b5a-1e0f-4f5b-bdce-9931a6b4418b HTTP/1.1" status: 204 len: 168 time: 0.1277573 Dec 09 22:05:28.107685 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d9f6709-1729-4652-8b6e-a168f8069bda admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f5b29b5a-1e0f-4f5b-bdce-9931a6b4418b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:28.825559 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58656) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:05:28.937179 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-f6de0452-d09b-4e36-858f-cf896a9f1caf admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1300055890-network', 'tenant_id': '2a4743baf90d462d968f7df0cc265733'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:05:28.964558 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f6de0452-d09b-4e36-858f-cf896a9f1caf admin admin] Made reservation on behalf of 2a4743baf90d462d968f7df0cc265733 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:05:28.966934 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f6de0452-d09b-4e36-858f-cf896a9f1caf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:28.976752 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f6de0452-d09b-4e36-858f-cf896a9f1caf admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:29.061251 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f6de0452-d09b-4e36-858f-cf896a9f1caf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:29.067231 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f6de0452-d09b-4e36-858f-cf896a9f1caf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:29.091704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f6de0452-d09b-4e36-858f-cf896a9f1caf admin admin] vlan segment allocate from pool success with {'vlan_id': 112, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 22:05:29.101340 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6de0452-d09b-4e36-858f-cf896a9f1caf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1a04ea57-7f43-4bc8-a460-c680058708fe,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:29.106115 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f6de0452-d09b-4e36-858f-cf896a9f1caf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:29.106465 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-f6de0452-d09b-4e36-858f-cf896a9f1caf admin admin] Added segment dc72244a-ee60-4e55-a4fb-6c577a5c32a9 of type vlan for network 26c6a367-09c3-4bad-85bb-c9ecda687989 Dec 09 22:05:29.146636 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f6de0452-d09b-4e36-858f-cf896a9f1caf admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:29.173132 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f6de0452-d09b-4e36-858f-cf896a9f1caf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:29.174089 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f6de0452-d09b-4e36-858f-cf896a9f1caf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:29.174697 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f6de0452-d09b-4e36-858f-cf896a9f1caf admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:29.209331 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f6de0452-d09b-4e36-858f-cf896a9f1caf admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.3825977 Dec 09 22:05:29.212532 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58660) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:05:29.217601 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-f90590ac-fd2b-4fb2-aa3a-3b75d92c2486 admin admin] Request body: {'subnet': {'network_id': '26c6a367-09c3-4bad-85bb-c9ecda687989', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1300055890-subnet', 'tenant_id': '2a4743baf90d462d968f7df0cc265733', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:05:29.242706 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f90590ac-fd2b-4fb2-aa3a-3b75d92c2486 admin admin] Made reservation on behalf of 2a4743baf90d462d968f7df0cc265733 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:05:29.245183 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f90590ac-fd2b-4fb2-aa3a-3b75d92c2486 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:29.245962 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6de0452-d09b-4e36-858f-cf896a9f1caf admin admin] Pushing event updated for resources: {'Network': ['ID=26c6a367-09c3-4bad-85bb-c9ecda687989,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:29.256320 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 26c6a367-09c3-4bad-85bb-c9ecda687989 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 22:05:29.433681 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f90590ac-fd2b-4fb2-aa3a-3b75d92c2486 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:29.467051 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device aa1c5272-b45d-4974-a7c4-5e9b8fb2136f no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:05:29.491089 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f90590ac-fd2b-4fb2-aa3a-3b75d92c2486 admin admin] Pushing event updated for resources: {'Subnet': ['ID=de9277ea-28ea-4da0-9494-aa247eb38df7,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:29.492332 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: aa1c5272-b45d-4974-a7c4-5e9b8fb2136f {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:05:29.492667 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device aa1c5272-b45d-4974-a7c4-5e9b8fb2136f not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:05:29.501059 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f90590ac-fd2b-4fb2-aa3a-3b75d92c2486 admin admin] Checking segment: {'id': 'dc72244a-ee60-4e55-a4fb-6c577a5c32a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '26c6a367-09c3-4bad-85bb-c9ecda687989'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:05:29.501401 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f90590ac-fd2b-4fb2-aa3a-3b75d92c2486 admin admin] Network hostable DHCP agents. Network: 26c6a367-09c3-4bad-85bb-c9ecda687989, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 22:05:29.519417 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f90590ac-fd2b-4fb2-aa3a-3b75d92c2486 admin admin] Network 26c6a367-09c3-4bad-85bb-c9ecda687989 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 22:05:29.529145 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-f90590ac-fd2b-4fb2-aa3a-3b75d92c2486 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 26c6a367-09c3-4bad-85bb-c9ecda687989) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:05:29.533646 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f90590ac-fd2b-4fb2-aa3a-3b75d92c2486 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:29.534218 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f90590ac-fd2b-4fb2-aa3a-3b75d92c2486 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:29.539685 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce54cb09-ffe3-4485-b7a2-ccff1eb354ed None None] Network 26c6a367-09c3-4bad-85bb-c9ecda687989 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:05:29.550651 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f90590ac-fd2b-4fb2-aa3a-3b75d92c2486 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.3369396 Dec 09 22:05:29.644375 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-31218b5e-b8c2-418d-8b7e-d32a38708c58 None None] Network 26c6a367-09c3-4bad-85bb-c9ecda687989 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:05:29.986410 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-e6b57402-4667-4729-af75-c6de1aaa17c1 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:29.987829 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-e6b57402-4667-4729-af75-c6de1aaa17c1 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/networks?id=26c6a367-09c3-4bad-85bb-c9ecda687989 HTTP/1.1" status: 200 len: 812 time: 0.1050887 Dec 09 22:05:30.002803 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-32390b10-a811-499a-9d79-fcd3d1aa17ab tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/quotas/2a4743baf90d462d968f7df0cc265733 HTTP/1.1" status: 200 len: 375 time: 0.0091851 Dec 09 22:05:30.039091 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-982869a2-9494-4ba5-bf16-ec582198a2b7 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=2a4743baf90d462d968f7df0cc265733&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0308928 Dec 09 22:05:30.136230 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-7fff33c3-4739-4567-83ff-80c38363236d service neutron] 10.222.0.13 "GET /v2.0/networks/26c6a367-09c3-4bad-85bb-c9ecda687989?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0898514 Dec 09 22:05:30.523466 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-99513347-0e8b-4b14-a724-a70ad3efa6c7 service neutron] 10.222.0.13 "GET /v2.0/networks/26c6a367-09c3-4bad-85bb-c9ecda687989?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3778996 Dec 09 22:05:30.716648 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3c4a233-fb23-48e2-b643-0f5d8c5fc7b5 req-1ec0a709-1e7f-4750-892a-af154405131d tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 210 time: 0.0302413 Dec 09 22:05:31.804033 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-146c6760-5c2f-4af4-92c3-91b184d165cf req-fcc18020-d413-4634-b8c4-236b26d7c720 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 210 time: 0.0263193 Dec 09 22:05:32.883910 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d94adccc-3925-4f9f-9cca-da361b0cabc1 req-963150db-2ba0-41ee-adcf-de7684582665 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 210 time: 0.0273979 Dec 09 22:05:33.001409 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-107d8292-173a-4f44-8e96-1b7468f54c0c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:33.964221 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ea98dc1-8733-4afd-93ca-a2fb40b54487 req-38f7d529-3a1d-40a3-b404-29d83bc7bf42 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 210 time: 0.0264606 Dec 09 22:05:35.076691 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-21dcca20-1839-45ef-b8b7-9b1a67f3dfac req-fbb32fbe-21f8-4dc2-a006-29c4d4e1fd18 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 210 time: 0.0325994 Dec 09 22:05:35.622591 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bc176a16-8c10-466b-b205-7978d8454de7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:35.800333 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-e01f5a3c-5e0d-4c7b-8b13-6d706f32b0dc tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:35.802036 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-e01f5a3c-5e0d-4c7b-8b13-6d706f32b0dc tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.10 "GET /v2.0/networks?id=26c6a367-09c3-4bad-85bb-c9ecda687989 HTTP/1.1" status: 200 len: 812 time: 0.1169074 Dec 09 22:05:35.815474 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Request body: {'port': {'device_id': 'bf0c4eae-8daf-4db9-aac2-e7b5c631804f', 'network_id': '26c6a367-09c3-4bad-85bb-c9ecda687989', 'admin_state_up': True, 'tenant_id': '2a4743baf90d462d968f7df0cc265733'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:05:35.927261 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Made reservation on behalf of 2a4743baf90d462d968f7df0cc265733 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:05:35.930982 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:36.058214 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Allocated IP 172.20.0.13 (26c6a367-09c3-4bad-85bb-c9ecda687989/de9277ea-28ea-4da0-9494-aa247eb38df7/be91670b-dbb8-4fce-b904-952d0880b662) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:05:36.201565 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-13aa92a6-d188-44ef-aa62-2d0e0b49028f req-68f6a91d-e866-43b3-a059-8f541ae9b1a0 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 210 time: 0.0541384 Dec 09 22:05:36.243704 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:36.282289 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:36.327645 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Network 26c6a367-09c3-4bad-85bb-c9ecda687989 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:05:36.330593 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:05:36.337213 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:05:36.344047 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Pushing event updated for resources: {'Port': ['ID=be91670b-dbb8-4fce-b904-952d0880b662,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:36.373263 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:05:36.373608 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:05:36.373948 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:05:36.374289 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:05:36.374621 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:05:36.374949 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:05:36.375278 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:05:36.375619 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:05:36.375945 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:05:36.376267 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:05:36.376588 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:05:36.376907 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:05:36.377230 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:05:36.399409 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:36.400052 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:36.421508 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-9d5a1195-cd79-485a-916d-81d3c9485928 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6102767 Dec 09 22:05:36.436302 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-05708fe8-e5fe-449e-b9a9-4c2ce35a45c3 service neutron] Request body: {'port': {'device_id': 'bf0c4eae-8daf-4db9-aac2-e7b5c631804f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:05:36.502371 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-05708fe8-e5fe-449e-b9a9-4c2ce35a45c3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:36.772905 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:36.774137 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-05708fe8-e5fe-449e-b9a9-4c2ce35a45c3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id be91670b-dbb8-4fce-b904-952d0880b662 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:05:36.782331 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-05708fe8-e5fe-449e-b9a9-4c2ce35a45c3 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:36.795374 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-05708fe8-e5fe-449e-b9a9-4c2ce35a45c3 service neutron] Transition to ACTIVE for port object be91670b-dbb8-4fce-b904-952d0880b662 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:05:36.800843 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-05708fe8-e5fe-449e-b9a9-4c2ce35a45c3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:36.848390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05708fe8-e5fe-449e-b9a9-4c2ce35a45c3 service neutron] Pushing event updated for resources: {'Port': ['ID=be91670b-dbb8-4fce-b904-952d0880b662,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:36.918280 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-05708fe8-e5fe-449e-b9a9-4c2ce35a45c3 service neutron] Attempting to bind port be91670b-dbb8-4fce-b904-952d0880b662 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:05:36.918576 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-05708fe8-e5fe-449e-b9a9-4c2ce35a45c3 service neutron] Attempting to bind port be91670b-dbb8-4fce-b904-952d0880b662 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'dc72244a-ee60-4e55-a4fb-6c577a5c32a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '26c6a367-09c3-4bad-85bb-c9ecda687989'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:05:36.918930 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-05708fe8-e5fe-449e-b9a9-4c2ce35a45c3 service neutron] Attempting to bind port be91670b-dbb8-4fce-b904-952d0880b662 on network 26c6a367-09c3-4bad-85bb-c9ecda687989 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:05:36.923341 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-05708fe8-e5fe-449e-b9a9-4c2ce35a45c3 service neutron] Port be91670b-dbb8-4fce-b904-952d0880b662 on network 26c6a367-09c3-4bad-85bb-c9ecda687989 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:05:36.923686 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-05708fe8-e5fe-449e-b9a9-4c2ce35a45c3 service neutron] Attempting to bind port be91670b-dbb8-4fce-b904-952d0880b662 on network 26c6a367-09c3-4bad-85bb-c9ecda687989 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:05:36.929175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-05708fe8-e5fe-449e-b9a9-4c2ce35a45c3 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 5, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:05:36.929506 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-05708fe8-e5fe-449e-b9a9-4c2ce35a45c3 service neutron] Checking segment: {'id': 'dc72244a-ee60-4e55-a4fb-6c577a5c32a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '26c6a367-09c3-4bad-85bb-c9ecda687989'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:05:36.929888 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-05708fe8-e5fe-449e-b9a9-4c2ce35a45c3 service neutron] Bound using segment: {'id': 'dc72244a-ee60-4e55-a4fb-6c577a5c32a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '26c6a367-09c3-4bad-85bb-c9ecda687989'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:05:36.930315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-05708fe8-e5fe-449e-b9a9-4c2ce35a45c3 service neutron] Bound port: be91670b-dbb8-4fce-b904-952d0880b662, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dc72244a-ee60-4e55-a4fb-6c577a5c32a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '26c6a367-09c3-4bad-85bb-c9ecda687989'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:05:36.930668 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-05708fe8-e5fe-449e-b9a9-4c2ce35a45c3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:36.994568 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-05708fe8-e5fe-449e-b9a9-4c2ce35a45c3 service neutron] For port be91670b-dbb8-4fce-b904-952d0880b662, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:05:36.997976 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-05708fe8-e5fe-449e-b9a9-4c2ce35a45c3 service neutron] For port be91670b-dbb8-4fce-b904-952d0880b662, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=be91670b-dbb8-4fce-b904-952d0880b662,segment=NetworkSegment(dc72244a-ee60-4e55-a4fb-6c577a5c32a9),segment_id=dc72244a-ee60-4e55-a4fb-6c577a5c32a9)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:05:37.002975 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-05708fe8-e5fe-449e-b9a9-4c2ce35a45c3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:37.035479 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-05708fe8-e5fe-449e-b9a9-4c2ce35a45c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:37.036241 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-05708fe8-e5fe-449e-b9a9-4c2ce35a45c3 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:37.037625 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-05708fe8-e5fe-449e-b9a9-4c2ce35a45c3 service neutron] 10.222.0.10 "PUT /v2.0/ports/be91670b-dbb8-4fce-b904-952d0880b662 HTTP/1.1" status: 200 len: 1093 time: 0.6071169 Dec 09 22:05:37.038068 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bf0c4eae-8daf-4db9-aac2-e7b5c631804f', 'tag': 'be91670b-dbb8-4fce-b904-952d0880b662'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:05:37.043381 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8c5ffbcf-679a-4091-8b86-3921b4df4d80" -d '{"events": [{"name": "network-changed", "server_uuid": "bf0c4eae-8daf-4db9-aac2-e7b5c631804f", "tag": "be91670b-dbb8-4fce-b904-952d0880b662"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:05:37.074091 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05708fe8-e5fe-449e-b9a9-4c2ce35a45c3 service neutron] Pushing event updated for resources: {'Port': ['ID=be91670b-dbb8-4fce-b904-952d0880b662,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:37.122646 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-5476ce7e-e1d6-4301-b258-ac05a1cedf12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:37.124221 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-5476ce7e-e1d6-4301-b258-ac05a1cedf12 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=2a4743baf90d462d968f7df0cc265733&device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 1096 time: 0.0439756 Dec 09 22:05:37.171853 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:05:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2bdbcfa7-8b39-438d-95fb-5d47cdccbc92 x-openstack-request-id: req-2bdbcfa7-8b39-438d-95fb-5d47cdccbc92 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:05:37.172150 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bf0c4eae-8daf-4db9-aac2-e7b5c631804f", "tag": "be91670b-dbb8-4fce-b904-952d0880b662", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:05:37.172406 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-2bdbcfa7-8b39-438d-95fb-5d47cdccbc92 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:05:37.172802 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bf0c4eae-8daf-4db9-aac2-e7b5c631804f', 'tag': 'be91670b-dbb8-4fce-b904-952d0880b662', 'status': 'completed', 'code': 200} Dec 09 22:05:37.174588 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-02f7add5-4e5b-405d-bbff-fdb6e54348de service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=be91670b-dbb8-4fce-b904-952d0880b662 HTTP/1.1" status: 200 len: 217 time: 0.0425608 Dec 09 22:05:37.224889 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-873dee34-8438-4f61-b5d0-b5ed292e7a3a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:37.226351 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-873dee34-8438-4f61-b5d0-b5ed292e7a3a service neutron] 10.222.0.10 "GET /v2.0/subnets?id=de9277ea-28ea-4da0-9494-aa247eb38df7 HTTP/1.1" status: 200 len: 852 time: 0.0443046 Dec 09 22:05:37.262256 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-efbb64b6-359f-4543-9059-7e52b2a69fad service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=26c6a367-09c3-4bad-85bb-c9ecda687989&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0267889 Dec 09 22:05:37.380014 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f24a7ce-f84b-45a1-b841-56b01f142acb req-4ccd285d-a17f-42d4-acc2-1c5804634816 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:37.381391 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f24a7ce-f84b-45a1-b841-56b01f142acb req-4ccd285d-a17f-42d4-acc2-1c5804634816 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 944 time: 0.1035941 Dec 09 22:05:37.403239 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-89694956-dd3e-4203-bd2f-a6e1a40855d9 service neutron] 10.222.0.10 "GET /v2.0/networks/26c6a367-09c3-4bad-85bb-c9ecda687989?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1329787 Dec 09 22:05:37.509256 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f24a7ce-f84b-45a1-b841-56b01f142acb req-399109c0-3858-4953-aa40-a408da4a0997 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1199732 Dec 09 22:05:37.534524 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-104a56dc-59c2-4e9a-9866-f929f3df824b req-af1f9817-51f8-4780-afe2-7a3f09d0cffb service neutron] 10.222.0.10 "GET /v2.0/networks/26c6a367-09c3-4bad-85bb-c9ecda687989?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1210525 Dec 09 22:05:37.621730 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c5ffbcf-679a-4091-8b86-3921b4df4d80 req-bd187fcf-87c1-4240-9807-502849ea61cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:37.623218 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c5ffbcf-679a-4091-8b86-3921b4df4d80 req-bd187fcf-87c1-4240-9807-502849ea61cc service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=2a4743baf90d462d968f7df0cc265733&device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 1096 time: 0.0422323 Dec 09 22:05:37.719355 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c5ffbcf-679a-4091-8b86-3921b4df4d80 req-5ab45dfc-57b1-4000-9621-35cd32c58b8c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:37.721621 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c5ffbcf-679a-4091-8b86-3921b4df4d80 req-5ab45dfc-57b1-4000-9621-35cd32c58b8c service neutron] 10.222.0.10 "GET /v2.0/networks?id=26c6a367-09c3-4bad-85bb-c9ecda687989 HTTP/1.1" status: 200 len: 913 time: 0.0906842 Dec 09 22:05:37.765035 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c5ffbcf-679a-4091-8b86-3921b4df4d80 req-8ffceb87-953a-45fd-a04b-c96ca39075f5 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=be91670b-dbb8-4fce-b904-952d0880b662 HTTP/1.1" status: 200 len: 217 time: 0.0362816 Dec 09 22:05:37.819244 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c5ffbcf-679a-4091-8b86-3921b4df4d80 req-66ceb0db-b63a-44cb-a263-cc3a13a9e85f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:37.820758 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c5ffbcf-679a-4091-8b86-3921b4df4d80 req-66ceb0db-b63a-44cb-a263-cc3a13a9e85f service neutron] 10.222.0.10 "GET /v2.0/subnets?id=de9277ea-28ea-4da0-9494-aa247eb38df7 HTTP/1.1" status: 200 len: 852 time: 0.0488651 Dec 09 22:05:37.853239 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c5ffbcf-679a-4091-8b86-3921b4df4d80 req-28edc631-34f2-4990-93c7-5168d2fdac9d service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=26c6a367-09c3-4bad-85bb-c9ecda687989&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0249817 Dec 09 22:05:37.949922 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c5ffbcf-679a-4091-8b86-3921b4df4d80 req-8563fa0c-f9cd-4258-b6a0-0683cb2adc02 service neutron] 10.222.0.10 "GET /v2.0/networks/26c6a367-09c3-4bad-85bb-c9ecda687989?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0887892 Dec 09 22:05:38.046936 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c5ffbcf-679a-4091-8b86-3921b4df4d80 req-98b5f76e-d932-413a-80c2-9886bff4df14 service neutron] 10.222.0.10 "GET /v2.0/networks/26c6a367-09c3-4bad-85bb-c9ecda687989?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0892754 Dec 09 22:05:38.093216 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:38.638159 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a100084c-5425-42ff-8420-4a4a081941bd req-f56d3ddb-eeed-4675-9b90-77af42b03d07 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:38.639696 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a100084c-5425-42ff-8420-4a4a081941bd req-f56d3ddb-eeed-4675-9b90-77af42b03d07 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 944 time: 0.0519030 Dec 09 22:05:38.689252 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a100084c-5425-42ff-8420-4a4a081941bd req-de82970e-2589-4476-8aec-0c86ceb5ab6b tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435355 Dec 09 22:05:39.513577 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device be91670b-dbb8-4fce-b904-952d0880b662 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:05:39.613506 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port be91670b-dbb8-4fce-b904-952d0880b662, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=be91670b-dbb8-4fce-b904-952d0880b662,segment=NetworkSegment(dc72244a-ee60-4e55-a4fb-6c577a5c32a9),segment_id=dc72244a-ee60-4e55-a4fb-6c577a5c32a9)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:05:39.625054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'be91670b-dbb8-4fce-b904-952d0880b662', 'network_id': '26c6a367-09c3-4bad-85bb-c9ecda687989', 'port_id': 'be91670b-dbb8-4fce-b904-952d0880b662', 'mac_address': 'fa:16:3e:2e:10:76', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 112, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'de9277ea-28ea-4da0-9494-aa247eb38df7', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:05:39.676338 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:39.678080 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:39.692282 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id be91670b-dbb8-4fce-b904-952d0880b662 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:05:39.712672 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port be91670b-dbb8-4fce-b904-952d0880b662, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=be91670b-dbb8-4fce-b904-952d0880b662,segment=NetworkSegment(dc72244a-ee60-4e55-a4fb-6c577a5c32a9),segment_id=dc72244a-ee60-4e55-a4fb-6c577a5c32a9)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:05:39.718845 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:39.767178 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=be91670b-dbb8-4fce-b904-952d0880b662,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:39.814556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53620fe4-84fc-46b5-9836-e4c13761179a req-542722f9-5f4f-44c0-93df-f7f15eca693f tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:39.816111 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-53620fe4-84fc-46b5-9836-e4c13761179a req-542722f9-5f4f-44c0-93df-f7f15eca693f tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 945 time: 0.0536938 Dec 09 22:05:39.864349 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-53620fe4-84fc-46b5-9836-e4c13761179a req-4b814c25-dff5-4045-ad2e-5972a15cc410 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419762 Dec 09 22:05:39.905604 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['be91670b-dbb8-4fce-b904-952d0880b662'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:05:40.990168 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd93e18f-5dbc-4970-8db8-407c53d59da8 req-942ebdd3-9242-4aa0-b08a-e27d07463196 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:40.991685 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd93e18f-5dbc-4970-8db8-407c53d59da8 req-942ebdd3-9242-4aa0-b08a-e27d07463196 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 945 time: 0.0535719 Dec 09 22:05:41.038997 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cd93e18f-5dbc-4970-8db8-407c53d59da8 req-76f9d28e-961f-470a-ae90-6b7d778af153 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411768 Dec 09 22:05:41.513272 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device be91670b-dbb8-4fce-b904-952d0880b662 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:05:41.567297 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port be91670b-dbb8-4fce-b904-952d0880b662 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:05:41.571353 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port be91670b-dbb8-4fce-b904-952d0880b662 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:05:41.571750 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:41.653782 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:41.679136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bf0c4eae-8daf-4db9-aac2-e7b5c631804f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'be91670b-dbb8-4fce-b904-952d0880b662'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:05:41.682730 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c929aa01-1c4c-448d-ba12-a845717015ea" -d '{"events": [{"server_uuid": "bf0c4eae-8daf-4db9-aac2-e7b5c631804f", "name": "network-vif-plugged", "status": "completed", "tag": "be91670b-dbb8-4fce-b904-952d0880b662"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:05:41.695374 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port be91670b-dbb8-4fce-b904-952d0880b662, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=be91670b-dbb8-4fce-b904-952d0880b662,segment=NetworkSegment(dc72244a-ee60-4e55-a4fb-6c577a5c32a9),segment_id=dc72244a-ee60-4e55-a4fb-6c577a5c32a9)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:05:41.700615 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:41.723066 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:05:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-386ef320-edda-44a3-aa7d-82d16497272b x-openstack-request-id: req-386ef320-edda-44a3-aa7d-82d16497272b {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:05:41.723360 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bf0c4eae-8daf-4db9-aac2-e7b5c631804f", "name": "network-vif-plugged", "status": "completed", "tag": "be91670b-dbb8-4fce-b904-952d0880b662", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:05:41.723638 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-386ef320-edda-44a3-aa7d-82d16497272b {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:05:41.724046 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bf0c4eae-8daf-4db9-aac2-e7b5c631804f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'be91670b-dbb8-4fce-b904-952d0880b662', 'code': 200} Dec 09 22:05:41.750737 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=be91670b-dbb8-4fce-b904-952d0880b662,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:05:41.828069 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a25d04-f64b-410e-aff2-6f159f9c2b7d req-47217c7e-1b8f-4aec-bb50-a8a147357c9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:41.829621 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8a25d04-f64b-410e-aff2-6f159f9c2b7d req-47217c7e-1b8f-4aec-bb50-a8a147357c9d service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 1098 time: 0.0448377 Dec 09 22:05:41.874926 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8a25d04-f64b-410e-aff2-6f159f9c2b7d req-cb9fc132-826a-4a04-971a-3a1ac9963db0 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0380487 Dec 09 22:05:42.166765 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6f24335-fcd8-4a6d-89a7-eb7718de8ef8 req-98ca860b-af15-4a3a-85d5-48316ad921b9 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:42.168286 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6f24335-fcd8-4a6d-89a7-eb7718de8ef8 req-98ca860b-af15-4a3a-85d5-48316ad921b9 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0538287 Dec 09 22:05:42.221423 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6f24335-fcd8-4a6d-89a7-eb7718de8ef8 req-8246a31e-415e-4063-ad91-9f6d5924585f tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442889 Dec 09 22:05:43.353104 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0741d694-06e1-4030-9acc-2c3ee70da793 req-7cc17c60-1fcf-42de-80cc-3033ff8ad98d tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:43.354709 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0741d694-06e1-4030-9acc-2c3ee70da793 req-7cc17c60-1fcf-42de-80cc-3033ff8ad98d tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0566730 Dec 09 22:05:43.405560 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0741d694-06e1-4030-9acc-2c3ee70da793 req-0eeebc27-ca8c-43ef-9acd-2efddf3777d3 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414436 Dec 09 22:05:43.606388 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58730) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:05:43.665376 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2b38203-7496-4cce-8b06-1d3bf74a9ada req-596b115f-391b-46fc-9886-35363eeaf80f tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:43.667007 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f2b38203-7496-4cce-8b06-1d3bf74a9ada req-596b115f-391b-46fc-9886-35363eeaf80f tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0530741 Dec 09 22:05:43.739210 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-600a1ffc-8830-45b8-ae38-ff476d5ab08f service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1314771 Dec 09 22:05:43.742847 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f2b38203-7496-4cce-8b06-1d3bf74a9ada req-f8bcaf79-0595-4b96-9082-1bba25193f8e tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0672507 Dec 09 22:05:43.748560 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-fb0b9aa8-60c6-4aa3-bd02-2d275fde7e14 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 22:05:43.749612 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-fb0b9aa8-60c6-4aa3-bd02-2d275fde7e14 service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0050883 Dec 09 22:05:44.865041 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-337e9048-a3ac-460a-925f-d379361f95a2 req-7e595524-3326-4c58-a691-750871abad28 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:44.866539 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-337e9048-a3ac-460a-925f-d379361f95a2 req-7e595524-3326-4c58-a691-750871abad28 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0523870 Dec 09 22:05:44.915989 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-337e9048-a3ac-460a-925f-d379361f95a2 req-7e94876f-1ca9-471d-81e0-fca9f6d0b36b tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432916 Dec 09 22:05:45.226477 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-7549e9be-478c-4e1c-afef-b9b963dfb10a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:45.228049 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-7549e9be-478c-4e1c-afef-b9b963dfb10a service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=2a4743baf90d462d968f7df0cc265733&device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 1098 time: 0.0467784 Dec 09 22:05:45.325815 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-45374d7e-4b23-4f56-96c4-c75bd0bd63ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:45.327316 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-45374d7e-4b23-4f56-96c4-c75bd0bd63ca service neutron] 10.222.0.10 "GET /v2.0/networks?id=26c6a367-09c3-4bad-85bb-c9ecda687989 HTTP/1.1" status: 200 len: 913 time: 0.0914657 Dec 09 22:05:45.377191 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-de8b8c10-859d-4cd2-9c5b-a20485494aef service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=be91670b-dbb8-4fce-b904-952d0880b662 HTTP/1.1" status: 200 len: 217 time: 0.0423617 Dec 09 22:05:45.427681 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-660a6783-7940-465c-bb20-9c7f2d71adc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:45.429127 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-660a6783-7940-465c-bb20-9c7f2d71adc1 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=de9277ea-28ea-4da0-9494-aa247eb38df7 HTTP/1.1" status: 200 len: 852 time: 0.0443704 Dec 09 22:05:45.459678 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-3c9d2e98-b158-47c6-af2f-fd1f487c9aa8 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=26c6a367-09c3-4bad-85bb-c9ecda687989&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0234611 Dec 09 22:05:45.557682 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-9c083055-40a2-4f36-b6b9-8c30c77471ea service neutron] 10.222.0.10 "GET /v2.0/networks/26c6a367-09c3-4bad-85bb-c9ecda687989?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0905163 Dec 09 22:05:45.649132 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-8241cfc1-01e8-41ef-89e1-4340df69c111 service neutron] 10.222.0.10 "GET /v2.0/networks/26c6a367-09c3-4bad-85bb-c9ecda687989?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0849779 Dec 09 22:05:46.059338 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-909695a3-5da5-4a4c-abdf-2992206c1209 req-dd97e22b-eb05-406b-98e8-48b155749e1a tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:46.060853 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-909695a3-5da5-4a4c-abdf-2992206c1209 req-dd97e22b-eb05-406b-98e8-48b155749e1a tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0539811 Dec 09 22:05:46.115674 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-909695a3-5da5-4a4c-abdf-2992206c1209 req-f1dd8171-1515-42b7-a111-8e764a9b82e7 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463433 Dec 09 22:05:47.243184 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dae860d-d026-468d-b620-1ae0466b0196 req-77e78390-7ee3-4049-aa7d-0eb1e319b598 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:47.245383 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6dae860d-d026-468d-b620-1ae0466b0196 req-77e78390-7ee3-4049-aa7d-0eb1e319b598 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0535135 Dec 09 22:05:47.295659 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6dae860d-d026-468d-b620-1ae0466b0196 req-f09250cb-be02-4e0f-8e88-39e7c558bcb1 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437837 Dec 09 22:05:48.433838 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52a66b8f-eb3a-4e36-a260-da4b8d0e5e3a req-fe18d74e-6b07-425b-a835-b87c5c68019a tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:48.435318 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52a66b8f-eb3a-4e36-a260-da4b8d0e5e3a req-fe18d74e-6b07-425b-a835-b87c5c68019a tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0590630 Dec 09 22:05:48.482013 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52a66b8f-eb3a-4e36-a260-da4b8d0e5e3a req-be75074c-a530-4942-a6b3-073587dc8a96 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406210 Dec 09 22:05:49.611679 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe6dc596-a5ad-4e97-a3ba-02b0b125ab4a req-5219eea1-0cd7-4f24-bbef-c53beb557f75 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:49.613194 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe6dc596-a5ad-4e97-a3ba-02b0b125ab4a req-5219eea1-0cd7-4f24-bbef-c53beb557f75 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0545852 Dec 09 22:05:49.662930 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe6dc596-a5ad-4e97-a3ba-02b0b125ab4a req-546f582a-6167-449a-b4dd-64191baa8393 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408583 Dec 09 22:05:50.800067 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74d00e88-58a9-4696-bc31-03c4c08a8279 req-9fc95457-04ca-46f0-907c-1d6901f92777 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:50.801611 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-74d00e88-58a9-4696-bc31-03c4c08a8279 req-9fc95457-04ca-46f0-907c-1d6901f92777 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0523756 Dec 09 22:05:50.853769 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-74d00e88-58a9-4696-bc31-03c4c08a8279 req-b8847607-ee8d-4752-b3ac-2a255dfd4fc5 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435262 Dec 09 22:05:51.976501 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ec4b9e3-5c88-4e98-87e3-b99f10228c2c req-0fcaea47-0cf7-4b7f-9691-1e5d4b79a1df tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:51.977967 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ec4b9e3-5c88-4e98-87e3-b99f10228c2c req-0fcaea47-0cf7-4b7f-9691-1e5d4b79a1df tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0492492 Dec 09 22:05:52.028352 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8ec4b9e3-5c88-4e98-87e3-b99f10228c2c req-68dc9a97-adf4-414b-81ce-f3638e0ce83d tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439007 Dec 09 22:05:53.148492 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3cbb4bb-3988-40f0-880b-4cad536e5a7d req-ce38daff-1067-499c-b70c-b64e20f5fd3d tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:53.150025 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b3cbb4bb-3988-40f0-880b-4cad536e5a7d req-ce38daff-1067-499c-b70c-b64e20f5fd3d tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0501161 Dec 09 22:05:53.198475 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b3cbb4bb-3988-40f0-880b-4cad536e5a7d req-0e1054f0-bf30-49a9-90d3-9ad9cee12c9b tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420010 Dec 09 22:05:54.342751 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa14395b-fb88-47bc-b116-5bf06982b167 req-e6fce112-055f-4efe-81d3-18df95bdd911 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:54.344286 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fa14395b-fb88-47bc-b116-5bf06982b167 req-e6fce112-055f-4efe-81d3-18df95bdd911 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0690327 Dec 09 22:05:54.398067 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fa14395b-fb88-47bc-b116-5bf06982b167 req-2d667860-8410-4816-b67d-da3afc040926 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476823 Dec 09 22:05:55.528496 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcf0ba4c-de9c-488c-ac28-7073cf896c3c req-d7d4336a-c6e8-4d11-a556-51c86e502379 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:55.529991 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fcf0ba4c-de9c-488c-ac28-7073cf896c3c req-d7d4336a-c6e8-4d11-a556-51c86e502379 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0557506 Dec 09 22:05:55.578554 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fcf0ba4c-de9c-488c-ac28-7073cf896c3c req-7664aafa-db0d-4133-ad9e-bc2843efb879 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423737 Dec 09 22:05:56.709617 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe26973d-3031-4738-be75-dd6d12087752 req-18b5e537-4384-47d2-8f09-c18d25163421 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:56.711075 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe26973d-3031-4738-be75-dd6d12087752 req-18b5e537-4384-47d2-8f09-c18d25163421 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0510652 Dec 09 22:05:56.758450 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe26973d-3031-4738-be75-dd6d12087752 req-f8f6ee80-f535-48d1-8a76-2047f2b14cdb tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413146 Dec 09 22:05:56.981733 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-42a822c2-6489-46c1-8e91-884d84f828d9 req-347cb1d7-64ea-4d52-80be-066be240fa9e service neutron] (103437) timed out ('10.222.0.13', 56268) {{(pid=103437) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 09 22:05:57.210162 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:05:57.537330 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:57.720692 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:05:57.888785 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbfaf450-279d-494e-a7cb-4b91a1632e96 req-2c9029cb-35d3-485a-9a25-41c6834f9ef4 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:57.890330 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dbfaf450-279d-494e-a7cb-4b91a1632e96 req-2c9029cb-35d3-485a-9a25-41c6834f9ef4 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0556598 Dec 09 22:05:57.938829 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dbfaf450-279d-494e-a7cb-4b91a1632e96 req-e5ffc7a3-3e62-45ce-ac63-5cd1c638caae tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423648 Dec 09 22:05:59.081160 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a57dcd6-7719-43e6-8346-64d63a8ddcb3 req-875f87ea-6774-4baa-806f-2b9061183d78 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:05:59.082573 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a57dcd6-7719-43e6-8346-64d63a8ddcb3 req-875f87ea-6774-4baa-806f-2b9061183d78 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0539281 Dec 09 22:05:59.132994 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a57dcd6-7719-43e6-8346-64d63a8ddcb3 req-cc37d0c2-3cad-45a2-be83-70e194fa94d4 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441663 Dec 09 22:06:00.266960 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-641a2940-1603-4f4c-a318-99ce691f467d req-69045928-aff4-4aa8-8404-3f96bdba3823 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:00.268516 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-641a2940-1603-4f4c-a318-99ce691f467d req-69045928-aff4-4aa8-8404-3f96bdba3823 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0583010 Dec 09 22:06:00.323717 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-641a2940-1603-4f4c-a318-99ce691f467d req-a7649660-9648-43d8-bf1f-c3d41b3f684c tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461769 Dec 09 22:06:01.447195 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a27c37d-fa73-497b-9d11-6d54d9bf3924 req-ad75ac13-1aee-4f98-8d32-bc878ee8ac3f tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:01.448706 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a27c37d-fa73-497b-9d11-6d54d9bf3924 req-ad75ac13-1aee-4f98-8d32-bc878ee8ac3f tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0501091 Dec 09 22:06:01.499093 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a27c37d-fa73-497b-9d11-6d54d9bf3924 req-df6dcd67-4204-4490-a842-c87f2d1f82a6 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429542 Dec 09 22:06:02.628214 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a46a601-2d3e-4701-a474-7af00cfc1212 req-c7ec4773-6301-4fdd-be84-52355b86b6e6 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:02.629693 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5a46a601-2d3e-4701-a474-7af00cfc1212 req-c7ec4773-6301-4fdd-be84-52355b86b6e6 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0516412 Dec 09 22:06:02.679670 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5a46a601-2d3e-4701-a474-7af00cfc1212 req-de1396fc-43dc-459e-a972-4a8fbb762119 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437639 Dec 09 22:06:03.001737 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-52cedea8-747d-4024-b268-d8b15d1f3c3d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:03.827627 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83074763-c45c-491b-b085-6c94a751b89a req-ea629fe8-8da8-4ae7-b1d1-37b318972fe6 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:03.829169 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83074763-c45c-491b-b085-6c94a751b89a req-ea629fe8-8da8-4ae7-b1d1-37b318972fe6 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0613167 Dec 09 22:06:03.881676 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83074763-c45c-491b-b085-6c94a751b89a req-b0063b52-f3ed-46e7-b802-b564e95a143b tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463541 Dec 09 22:06:05.016145 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9de0461-347c-4bee-9faa-53262522661e req-75357b7c-422f-4478-9c8b-a9136eee1b9f tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:05.017636 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e9de0461-347c-4bee-9faa-53262522661e req-75357b7c-422f-4478-9c8b-a9136eee1b9f tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0509691 Dec 09 22:06:05.073858 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e9de0461-347c-4bee-9faa-53262522661e req-63b65776-6f62-4a94-8245-4f07bed79f59 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501661 Dec 09 22:06:05.635486 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ed95c31b-695b-4b39-b911-de805d43a3b6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:06.217108 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5d3713e-3e1c-4a3f-929e-0c30517cb0a4 req-8fe8756c-1ea1-4638-9aea-d33114eaf52b tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:06.218663 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5d3713e-3e1c-4a3f-929e-0c30517cb0a4 req-8fe8756c-1ea1-4638-9aea-d33114eaf52b tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0527456 Dec 09 22:06:06.273325 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f5d3713e-3e1c-4a3f-929e-0c30517cb0a4 req-f6dd72ba-9f09-45d6-a8bd-5815a5b9ab91 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457010 Dec 09 22:06:06.777255 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:07.396220 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fc5ab4e-6e6b-4bf9-b433-d9a08e2e0820 req-65114775-7235-46bf-bf6e-d98ec1de42b5 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:07.397863 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6fc5ab4e-6e6b-4bf9-b433-d9a08e2e0820 req-65114775-7235-46bf-bf6e-d98ec1de42b5 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0538642 Dec 09 22:06:07.446846 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6fc5ab4e-6e6b-4bf9-b433-d9a08e2e0820 req-a71514d0-17cd-4649-a354-f03be798cea5 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428052 Dec 09 22:06:08.096483 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:08.584377 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a24180-d8ce-4ed7-9583-90ed0e2fa0c6 req-2969dec3-e09f-415f-8de3-0a4cd8f8e1dd tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:08.585859 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8a24180-d8ce-4ed7-9583-90ed0e2fa0c6 req-2969dec3-e09f-415f-8de3-0a4cd8f8e1dd tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0560818 Dec 09 22:06:08.635402 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8a24180-d8ce-4ed7-9583-90ed0e2fa0c6 req-ef659fd1-286a-4737-9125-56ed7b74dde9 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432706 Dec 09 22:06:09.675050 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:09.767984 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8efe043-fdca-447d-9970-8193c8113fcc req-3660f049-9d3a-43b5-8691-06dada294054 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:09.769526 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8efe043-fdca-447d-9970-8193c8113fcc req-3660f049-9d3a-43b5-8691-06dada294054 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0545285 Dec 09 22:06:09.821747 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8efe043-fdca-447d-9970-8193c8113fcc req-79b5fcd4-6abf-4dbd-878a-0be58270bffe tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432081 Dec 09 22:06:10.946864 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e2dbe36-5ecb-4ad5-9349-577073c94162 req-9a48650f-9903-4f47-860d-9b8b10bb859c tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:10.948357 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8e2dbe36-5ecb-4ad5-9349-577073c94162 req-9a48650f-9903-4f47-860d-9b8b10bb859c tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0522640 Dec 09 22:06:10.996052 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8e2dbe36-5ecb-4ad5-9349-577073c94162 req-a49eb4ec-2438-40d5-8d9c-a8e1bb027733 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415127 Dec 09 22:06:12.144849 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3001d045-8291-4763-b792-77a719570b0c req-f2b38544-fc1a-46de-94c9-6a25fcb8944f tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:12.146347 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3001d045-8291-4763-b792-77a719570b0c req-f2b38544-fc1a-46de-94c9-6a25fcb8944f tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0632663 Dec 09 22:06:12.195976 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3001d045-8291-4763-b792-77a719570b0c req-dcc0b50f-b763-4b6c-b132-348e0001d102 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435388 Dec 09 22:06:12.782088 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-7ab8d72d-217d-4925-91b7-11149a0afd55 service neutron] show failed (client error): The resource could not be found. Dec 09 22:06:12.783110 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-7ab8d72d-217d-4925-91b7-11149a0afd55 service neutron] 10.222.0.10 "GET /v2.0/ports/be91670b-dbb8-4fce-b904-952d0880b662/bindings/n-h1-713301-27 HTTP/1.1" status: 404 len: 381 time: 0.0657120 Dec 09 22:06:13.106079 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-65d9d313-33a4-4367-96e8-d61822ff0f23 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:13.107642 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-65d9d313-33a4-4367-96e8-d61822ff0f23 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f&tenant_id=2a4743baf90d462d968f7df0cc265733 HTTP/1.1" status: 200 len: 1098 time: 0.1574113 Dec 09 22:06:13.119294 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Request body: {'port': {'binding:host_id': 'n-h1-713301-27', 'device_owner': 'compute:nova'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:06:13.173194 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:13.329686 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8050b5cd-a297-4858-8c6a-f5d42060a5d6 req-6a4e0b24-f1d3-4046-af06-bc1acc109ffb tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:13.331222 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8050b5cd-a297-4858-8c6a-f5d42060a5d6 req-6a4e0b24-f1d3-4046-af06-bc1acc109ffb tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0535717 Dec 09 22:06:13.381131 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8050b5cd-a297-4858-8c6a-f5d42060a5d6 req-7e798bac-b3c5-4935-bda3-b773c8a8b7ab tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436480 Dec 09 22:06:13.400760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] For port be91670b-dbb8-4fce-b904-952d0880b662, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=be91670b-dbb8-4fce-b904-952d0880b662,segment=NetworkSegment(dc72244a-ee60-4e55-a4fb-6c577a5c32a9),segment_id=dc72244a-ee60-4e55-a4fb-6c577a5c32a9)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:06:13.432268 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] For port be91670b-dbb8-4fce-b904-952d0880b662, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:06:13.471782 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bf0c4eae-8daf-4db9-aac2-e7b5c631804f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'be91670b-dbb8-4fce-b904-952d0880b662'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:06:13.474162 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9c6de37c-fe69-47f0-aee8-a6775531a1c1" -d '{"events": [{"server_uuid": "bf0c4eae-8daf-4db9-aac2-e7b5c631804f", "name": "network-vif-unplugged", "status": "completed", "tag": "be91670b-dbb8-4fce-b904-952d0880b662"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:06:13.478197 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:13.491790 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Transition to ACTIVE for port object be91670b-dbb8-4fce-b904-952d0880b662 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:06:13.496221 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:13.556900 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] No DVR routers for this DVR port be91670b-dbb8-4fce-b904-952d0880b662 on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:06:13.563552 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Pushing event updated for resources: {'Port': ['ID=be91670b-dbb8-4fce-b904-952d0880b662,revision_number=6']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:06:13.574655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:13.574655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:13.574655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:13.575000 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:13.575322 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:13.575677 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:13.575999 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:13.576320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:13.576636 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:13.576955 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:13.577271 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:13.577568 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:13.577918 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:13.600856 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 22:06:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0fd70b5b-26f2-4500-ba06-744c2525b0e7 x-openstack-request-id: req-0fd70b5b-26f2-4500-ba06-744c2525b0e7 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:06:13.601245 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bf0c4eae-8daf-4db9-aac2-e7b5c631804f", "name": "network-vif-unplugged", "status": "completed", "tag": "be91670b-dbb8-4fce-b904-952d0880b662", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:06:13.601664 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0fd70b5b-26f2-4500-ba06-744c2525b0e7 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:06:13.602324 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bf0c4eae-8daf-4db9-aac2-e7b5c631804f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'be91670b-dbb8-4fce-b904-952d0880b662', 'code': 200} Dec 09 22:06:13.617723 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Attempting to bind port be91670b-dbb8-4fce-b904-952d0880b662 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:06:13.618061 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Attempting to bind port be91670b-dbb8-4fce-b904-952d0880b662 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'dc72244a-ee60-4e55-a4fb-6c577a5c32a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '26c6a367-09c3-4bad-85bb-c9ecda687989'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:06:13.618391 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Attempting to bind port be91670b-dbb8-4fce-b904-952d0880b662 on network 26c6a367-09c3-4bad-85bb-c9ecda687989 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:06:13.622742 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Port be91670b-dbb8-4fce-b904-952d0880b662 on network 26c6a367-09c3-4bad-85bb-c9ecda687989 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:06:13.623064 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Attempting to bind port be91670b-dbb8-4fce-b904-952d0880b662 on network 26c6a367-09c3-4bad-85bb-c9ecda687989 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:06:13.627853 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 5, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:06:13.628237 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Checking segment: {'id': 'dc72244a-ee60-4e55-a4fb-6c577a5c32a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '26c6a367-09c3-4bad-85bb-c9ecda687989'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:06:13.628620 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Bound using segment: {'id': 'dc72244a-ee60-4e55-a4fb-6c577a5c32a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '26c6a367-09c3-4bad-85bb-c9ecda687989'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:06:13.629043 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Bound port: be91670b-dbb8-4fce-b904-952d0880b662, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dc72244a-ee60-4e55-a4fb-6c577a5c32a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 112, 'network_id': '26c6a367-09c3-4bad-85bb-c9ecda687989'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:06:13.629399 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:13.692045 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] For port be91670b-dbb8-4fce-b904-952d0880b662, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:06:13.695324 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] For port be91670b-dbb8-4fce-b904-952d0880b662, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=be91670b-dbb8-4fce-b904-952d0880b662,segment=NetworkSegment(dc72244a-ee60-4e55-a4fb-6c577a5c32a9),segment_id=dc72244a-ee60-4e55-a4fb-6c577a5c32a9)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:06:13.701219 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:13.735391 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:13.736110 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:13.737553 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] 10.222.0.31 "PUT /v2.0/ports/be91670b-dbb8-4fce-b904-952d0880b662 HTTP/1.1" status: 200 len: 1093 time: 0.6221635 Dec 09 22:06:13.758412 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3417c0e-a54d-4840-95b3-6f2d18bd1c80 service neutron] Pushing event updated for resources: {'Port': ['ID=be91670b-dbb8-4fce-b904-952d0880b662,revision_number=7']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:06:13.802001 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-fe98c6dd-72ff-4f01-8cec-e1967d53001f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:13.803553 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-fe98c6dd-72ff-4f01-8cec-e1967d53001f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2a4743baf90d462d968f7df0cc265733&device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 1096 time: 0.0414169 Dec 09 22:06:13.903607 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-5ff5c4e4-17cd-46a7-934b-ad6a48d7048b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:13.905135 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-5ff5c4e4-17cd-46a7-934b-ad6a48d7048b service neutron] 10.222.0.31 "GET /v2.0/networks?id=26c6a367-09c3-4bad-85bb-c9ecda687989 HTTP/1.1" status: 200 len: 913 time: 0.0941012 Dec 09 22:06:13.948834 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-c072d347-87a9-4629-aa00-b507d4676946 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=be91670b-dbb8-4fce-b904-952d0880b662 HTTP/1.1" status: 200 len: 217 time: 0.0365994 Dec 09 22:06:14.005688 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-baf98e17-336f-4d7b-9eb5-9da2b3c25a2a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:14.007149 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-baf98e17-336f-4d7b-9eb5-9da2b3c25a2a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=de9277ea-28ea-4da0-9494-aa247eb38df7 HTTP/1.1" status: 200 len: 852 time: 0.0511940 Dec 09 22:06:14.039532 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-e6daabef-c2ae-4f36-a5d3-31997a1dc831 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=26c6a367-09c3-4bad-85bb-c9ecda687989&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0242815 Dec 09 22:06:14.131217 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-32e441ab-ba16-4d16-acca-8799102e2e55 service neutron] 10.222.0.31 "GET /v2.0/networks/26c6a367-09c3-4bad-85bb-c9ecda687989?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0843105 Dec 09 22:06:14.236944 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-11aa90e3-06b9-43fa-857e-7111d86f765b req-70fde1f9-565c-4a4b-95ea-4d4c4011e47b service neutron] 10.222.0.31 "GET /v2.0/networks/26c6a367-09c3-4bad-85bb-c9ecda687989?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0969806 Dec 09 22:06:14.379524 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-86898a54-1189-45f2-8c5c-62c7618a25df req-3f6e0892-2f92-4de9-a160-ebe41789350c tempest-TestNetworkAdvancedServerOps-1770804423 tempest-TestNetworkAdvancedServerOps-1770804423-project] (103437) timed out ('10.222.0.10', 63561) {{(pid=103437) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 09 22:06:14.509791 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-819d5a6a-9e9d-4d21-9a6e-8b56b083cf2a req-5c5e1daf-b637-4bc8-886e-f218bddc4b12 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:14.511170 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-819d5a6a-9e9d-4d21-9a6e-8b56b083cf2a req-5c5e1daf-b637-4bc8-886e-f218bddc4b12 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 944 time: 0.0604877 Dec 09 22:06:14.559294 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-819d5a6a-9e9d-4d21-9a6e-8b56b083cf2a req-cf544c00-0b03-444c-820c-c98a07e7196a tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420074 Dec 09 22:06:15.604411 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bf0c4eae-8daf-4db9-aac2-e7b5c631804f', 'tag': 'be91670b-dbb8-4fce-b904-952d0880b662'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:06:15.608842 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-03992e99-b7bb-4acd-b83b-30e7d8f2d6a4" -d '{"events": [{"name": "network-changed", "server_uuid": "bf0c4eae-8daf-4db9-aac2-e7b5c631804f", "tag": "be91670b-dbb8-4fce-b904-952d0880b662"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:06:15.699671 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cd5b28f-2367-4e09-beae-bf0ca1bf11a4 req-315c3590-4006-4ec0-96fb-5b5ffde749b4 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:15.700532 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device be91670b-dbb8-4fce-b904-952d0880b662 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:06:15.701427 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8cd5b28f-2367-4e09-beae-bf0ca1bf11a4 req-315c3590-4006-4ec0-96fb-5b5ffde749b4 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 944 time: 0.0586727 Dec 09 22:06:15.753161 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8cd5b28f-2367-4e09-beae-bf0ca1bf11a4 req-82932b7d-0144-4ae0-b4e0-4de8f438c7e0 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446169 Dec 09 22:06:15.753422 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device be91670b-dbb8-4fce-b904-952d0880b662 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:06:15.809998 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:06:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-03afc7da-ac8b-4751-b06e-3240a3a639af x-openstack-request-id: req-03afc7da-ac8b-4751-b06e-3240a3a639af {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:06:15.810297 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bf0c4eae-8daf-4db9-aac2-e7b5c631804f", "tag": "be91670b-dbb8-4fce-b904-952d0880b662", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:06:15.810558 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-03afc7da-ac8b-4751-b06e-3240a3a639af {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:06:15.810981 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bf0c4eae-8daf-4db9-aac2-e7b5c631804f', 'tag': 'be91670b-dbb8-4fce-b904-952d0880b662', 'status': 'completed', 'code': 200} Dec 09 22:06:15.873344 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03992e99-b7bb-4acd-b83b-30e7d8f2d6a4 req-25819fe2-781f-4827-b594-bcc21092fa2e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:15.874693 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03992e99-b7bb-4acd-b83b-30e7d8f2d6a4 req-ce4ca399-e9ba-47fa-909a-d5bf4705dbfc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:15.874888 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-03992e99-b7bb-4acd-b83b-30e7d8f2d6a4 req-25819fe2-781f-4827-b594-bcc21092fa2e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2a4743baf90d462d968f7df0cc265733&device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 1096 time: 0.0440373 Dec 09 22:06:15.876217 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-03992e99-b7bb-4acd-b83b-30e7d8f2d6a4 req-ce4ca399-e9ba-47fa-909a-d5bf4705dbfc service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=2a4743baf90d462d968f7df0cc265733&device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 1096 time: 0.0442696 Dec 09 22:06:15.969420 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03992e99-b7bb-4acd-b83b-30e7d8f2d6a4 req-a3333ebb-65e9-4b67-acd6-9145ce776f3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:15.969871 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03992e99-b7bb-4acd-b83b-30e7d8f2d6a4 req-88b3e4d4-5866-49d2-9271-77659f4cfddf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:15.970928 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-03992e99-b7bb-4acd-b83b-30e7d8f2d6a4 req-a3333ebb-65e9-4b67-acd6-9145ce776f3c service neutron] 10.222.0.10 "GET /v2.0/networks?id=26c6a367-09c3-4bad-85bb-c9ecda687989 HTTP/1.1" status: 200 len: 913 time: 0.0871837 Dec 09 22:06:15.971372 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-03992e99-b7bb-4acd-b83b-30e7d8f2d6a4 req-88b3e4d4-5866-49d2-9271-77659f4cfddf service neutron] 10.222.0.31 "GET /v2.0/networks?id=26c6a367-09c3-4bad-85bb-c9ecda687989 HTTP/1.1" status: 200 len: 913 time: 0.0894206 Dec 09 22:06:16.014394 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-03992e99-b7bb-4acd-b83b-30e7d8f2d6a4 req-0f66c78e-f8c4-4262-84b2-3f29c6fefe41 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=be91670b-dbb8-4fce-b904-952d0880b662 HTTP/1.1" status: 200 len: 217 time: 0.0361464 Dec 09 22:06:16.017861 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-03992e99-b7bb-4acd-b83b-30e7d8f2d6a4 req-710f1c03-5f1f-48f9-b139-de44f152ea65 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=be91670b-dbb8-4fce-b904-952d0880b662 HTTP/1.1" status: 200 len: 217 time: 0.0393741 Dec 09 22:06:16.066925 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03992e99-b7bb-4acd-b83b-30e7d8f2d6a4 req-ef8233d3-9dfe-4de2-867b-83d682ea892d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:16.067289 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03992e99-b7bb-4acd-b83b-30e7d8f2d6a4 req-6add76b0-4ce0-492d-9090-33c824b4c57c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:16.068482 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-03992e99-b7bb-4acd-b83b-30e7d8f2d6a4 req-ef8233d3-9dfe-4de2-867b-83d682ea892d service neutron] 10.222.0.31 "GET /v2.0/subnets?id=de9277ea-28ea-4da0-9494-aa247eb38df7 HTTP/1.1" status: 200 len: 852 time: 0.0471573 Dec 09 22:06:16.068801 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-03992e99-b7bb-4acd-b83b-30e7d8f2d6a4 req-6add76b0-4ce0-492d-9090-33c824b4c57c service neutron] 10.222.0.10 "GET /v2.0/subnets?id=de9277ea-28ea-4da0-9494-aa247eb38df7 HTTP/1.1" status: 200 len: 852 time: 0.0434697 Dec 09 22:06:16.101231 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-03992e99-b7bb-4acd-b83b-30e7d8f2d6a4 req-09debe98-d6b1-439b-9c80-66c7668635b2 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=26c6a367-09c3-4bad-85bb-c9ecda687989&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0250533 Dec 09 22:06:16.105225 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-03992e99-b7bb-4acd-b83b-30e7d8f2d6a4 req-1ebac51b-a497-4c64-b68c-e939aa298833 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=26c6a367-09c3-4bad-85bb-c9ecda687989&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0290267 Dec 09 22:06:16.193475 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-03992e99-b7bb-4acd-b83b-30e7d8f2d6a4 req-ea78d947-4931-4dda-b4ec-acc24060e6b2 service neutron] 10.222.0.10 "GET /v2.0/networks/26c6a367-09c3-4bad-85bb-c9ecda687989?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0853903 Dec 09 22:06:16.198760 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-03992e99-b7bb-4acd-b83b-30e7d8f2d6a4 req-181bcb17-5860-44bc-9954-38edd73e51b6 service neutron] 10.222.0.31 "GET /v2.0/networks/26c6a367-09c3-4bad-85bb-c9ecda687989?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0855768 Dec 09 22:06:16.283534 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-03992e99-b7bb-4acd-b83b-30e7d8f2d6a4 req-259d2194-6e65-4f2c-8057-2b468db52a6a service neutron] 10.222.0.10 "GET /v2.0/networks/26c6a367-09c3-4bad-85bb-c9ecda687989?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0820034 Dec 09 22:06:16.298161 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-03992e99-b7bb-4acd-b83b-30e7d8f2d6a4 req-8d3f3b37-73c1-45d0-83cd-145d4f6f86df service neutron] 10.222.0.31 "GET /v2.0/networks/26c6a367-09c3-4bad-85bb-c9ecda687989?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0908654 Dec 09 22:06:16.879266 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-352c1b19-701e-40d0-9868-02665271c6ea req-97c40334-6a51-4a2d-8ef6-36f12c5acdcb tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:16.880773 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-352c1b19-701e-40d0-9868-02665271c6ea req-97c40334-6a51-4a2d-8ef6-36f12c5acdcb tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 944 time: 0.0519550 Dec 09 22:06:16.933658 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-352c1b19-701e-40d0-9868-02665271c6ea req-d2278b1b-b2ab-4c35-8df2-03f03ad4b96e tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467305 Dec 09 22:06:17.228229 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc14ab6a-803b-4278-a009-f1289c97074c req-2e3a0fa5-33c3-4a28-b79f-5edc70531116 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:17.229688 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc14ab6a-803b-4278-a009-f1289c97074c req-2e3a0fa5-33c3-4a28-b79f-5edc70531116 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.10 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f&tenant_id=2a4743baf90d462d968f7df0cc265733&binding%3Ahost_id=n-h1-713301-27 HTTP/1.1" status: 200 len: 944 time: 0.0980070 Dec 09 22:06:17.292443 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-dc14ab6a-803b-4278-a009-f1289c97074c req-0901bd8a-c2b6-4b09-9645-b9a96f05c03e service neutron] delete failed (client error): The resource could not be found. Dec 09 22:06:17.293414 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc14ab6a-803b-4278-a009-f1289c97074c req-0901bd8a-c2b6-4b09-9645-b9a96f05c03e service neutron] 10.222.0.10 "DELETE /v2.0/ports/be91670b-dbb8-4fce-b904-952d0880b662/bindings/n-h2-713301-27 HTTP/1.1" status: 404 len: 381 time: 0.0558832 Dec 09 22:06:17.459958 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device be91670b-dbb8-4fce-b904-952d0880b662 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:06:17.559915 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port be91670b-dbb8-4fce-b904-952d0880b662, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=be91670b-dbb8-4fce-b904-952d0880b662,segment=NetworkSegment(dc72244a-ee60-4e55-a4fb-6c577a5c32a9),segment_id=dc72244a-ee60-4e55-a4fb-6c577a5c32a9)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:06:17.572350 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'be91670b-dbb8-4fce-b904-952d0880b662', 'network_id': '26c6a367-09c3-4bad-85bb-c9ecda687989', 'port_id': 'be91670b-dbb8-4fce-b904-952d0880b662', 'mac_address': 'fa:16:3e:2e:10:76', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 112, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'de9277ea-28ea-4da0-9494-aa247eb38df7', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:06:17.616623 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:17.629779 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id be91670b-dbb8-4fce-b904-952d0880b662 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:06:17.650141 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port be91670b-dbb8-4fce-b904-952d0880b662, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=be91670b-dbb8-4fce-b904-952d0880b662,segment=NetworkSegment(dc72244a-ee60-4e55-a4fb-6c577a5c32a9),segment_id=dc72244a-ee60-4e55-a4fb-6c577a5c32a9)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:06:17.655405 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:17.675597 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc14ab6a-803b-4278-a009-f1289c97074c req-b4b03b2c-4070-4a6f-988e-323df699334c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:17.677125 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc14ab6a-803b-4278-a009-f1289c97074c req-b4b03b2c-4070-4a6f-988e-323df699334c service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=2a4743baf90d462d968f7df0cc265733&device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 1096 time: 0.3345387 Dec 09 22:06:17.706027 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=be91670b-dbb8-4fce-b904-952d0880b662,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:06:17.714048 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:17.714358 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:17.714692 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:17.715035 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:17.715372 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:17.715751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:17.716124 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:17.716451 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:17.716785 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:17.717137 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:17.717447 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:17.717774 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:17.718211 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:06:17.770646 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc14ab6a-803b-4278-a009-f1289c97074c req-376b7197-2d75-4aca-8bf9-51aa64174df6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:17.772151 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc14ab6a-803b-4278-a009-f1289c97074c req-376b7197-2d75-4aca-8bf9-51aa64174df6 service neutron] 10.222.0.10 "GET /v2.0/networks?id=26c6a367-09c3-4bad-85bb-c9ecda687989 HTTP/1.1" status: 200 len: 913 time: 0.0868421 Dec 09 22:06:17.818900 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc14ab6a-803b-4278-a009-f1289c97074c req-c51fd2c9-54de-4784-8e2c-1acb9f053102 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=be91670b-dbb8-4fce-b904-952d0880b662 HTTP/1.1" status: 200 len: 217 time: 0.0395823 Dec 09 22:06:17.868392 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc14ab6a-803b-4278-a009-f1289c97074c req-441d5926-a542-4707-b225-b2d763df4aac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:17.869811 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc14ab6a-803b-4278-a009-f1289c97074c req-441d5926-a542-4707-b225-b2d763df4aac service neutron] 10.222.0.10 "GET /v2.0/subnets?id=de9277ea-28ea-4da0-9494-aa247eb38df7 HTTP/1.1" status: 200 len: 852 time: 0.0441194 Dec 09 22:06:17.879592 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['be91670b-dbb8-4fce-b904-952d0880b662'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:06:17.902487 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc14ab6a-803b-4278-a009-f1289c97074c req-5a3af849-4ea0-4a66-a233-31447301adb0 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=26c6a367-09c3-4bad-85bb-c9ecda687989&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0252421 Dec 09 22:06:18.001237 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc14ab6a-803b-4278-a009-f1289c97074c req-c3671736-7899-4f1e-9cc5-c23db0bd8243 service neutron] 10.222.0.10 "GET /v2.0/networks/26c6a367-09c3-4bad-85bb-c9ecda687989?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0911725 Dec 09 22:06:18.091342 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc14ab6a-803b-4278-a009-f1289c97074c req-6cc47d61-b18f-4e56-bbbc-1795636a26d9 service neutron] 10.222.0.10 "GET /v2.0/networks/26c6a367-09c3-4bad-85bb-c9ecda687989?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0826559 Dec 09 22:06:18.840521 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44e6f687-95b9-4e62-a4b5-2f7a38ef4314 req-b6585fc4-08cf-4a76-9166-0e814efa886c tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:18.842048 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44e6f687-95b9-4e62-a4b5-2f7a38ef4314 req-b6585fc4-08cf-4a76-9166-0e814efa886c tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 945 time: 0.0510306 Dec 09 22:06:18.897291 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44e6f687-95b9-4e62-a4b5-2f7a38ef4314 req-1d26cbc7-a1d7-4eff-8be2-c5b0357183d5 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0491271 Dec 09 22:06:19.462952 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device be91670b-dbb8-4fce-b904-952d0880b662 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:06:19.528236 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port be91670b-dbb8-4fce-b904-952d0880b662 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:06:19.531995 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port be91670b-dbb8-4fce-b904-952d0880b662 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:06:19.532369 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:19.611752 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:19.633933 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bf0c4eae-8daf-4db9-aac2-e7b5c631804f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'be91670b-dbb8-4fce-b904-952d0880b662'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:06:19.636290 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dfe45b3b-1362-4bc1-b51a-81a2cf3759ee" -d '{"events": [{"server_uuid": "bf0c4eae-8daf-4db9-aac2-e7b5c631804f", "name": "network-vif-plugged", "status": "completed", "tag": "be91670b-dbb8-4fce-b904-952d0880b662"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:06:19.648932 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port be91670b-dbb8-4fce-b904-952d0880b662, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=be91670b-dbb8-4fce-b904-952d0880b662,segment=NetworkSegment(dc72244a-ee60-4e55-a4fb-6c577a5c32a9),segment_id=dc72244a-ee60-4e55-a4fb-6c577a5c32a9)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:06:19.655312 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:19.713241 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=be91670b-dbb8-4fce-b904-952d0880b662,revision_number=9']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:06:19.760923 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:06:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-51467f9d-4c84-4fef-aed0-20664888fcf0 x-openstack-request-id: req-51467f9d-4c84-4fef-aed0-20664888fcf0 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:06:19.761802 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bf0c4eae-8daf-4db9-aac2-e7b5c631804f", "name": "network-vif-plugged", "status": "completed", "tag": "be91670b-dbb8-4fce-b904-952d0880b662", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:06:19.762111 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-51467f9d-4c84-4fef-aed0-20664888fcf0 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:06:19.763369 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bf0c4eae-8daf-4db9-aac2-e7b5c631804f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'be91670b-dbb8-4fce-b904-952d0880b662', 'code': 200} Dec 09 22:06:20.019342 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d427d2b-1730-4add-ab47-8594d8146410 req-d1a3d173-a3f7-41e9-a7f5-c86d7e2e43bb tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:20.021074 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8d427d2b-1730-4add-ab47-8594d8146410 req-d1a3d173-a3f7-41e9-a7f5-c86d7e2e43bb tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0528100 Dec 09 22:06:20.045085 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc14ab6a-803b-4278-a009-f1289c97074c req-7e1be234-f40e-479e-8c33-dccbe06e5182 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:20.046669 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dc14ab6a-803b-4278-a009-f1289c97074c req-7e1be234-f40e-479e-8c33-dccbe06e5182 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.31 "GET /v2.0/ports?device_id=bf0c4eae-8daf-4db9-aac2-e7b5c631804f HTTP/1.1" status: 200 len: 946 time: 0.0493746 Dec 09 22:06:20.072121 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8d427d2b-1730-4add-ab47-8594d8146410 req-e97105c8-8802-4e4b-963e-d2dc15acecd2 tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.13 "GET /v2.0/security-groups?id=1a04ea57-7f43-4bc8-a460-c680058708fe&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447557 Dec 09 22:06:20.141047 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-dc14ab6a-803b-4278-a009-f1289c97074c req-b419ed16-915c-4061-9f58-016de6b9c6ab tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Deleting port be91670b-dbb8-4fce-b904-952d0880b662 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:06:20.141445 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-dc14ab6a-803b-4278-a009-f1289c97074c req-b419ed16-915c-4061-9f58-016de6b9c6ab tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:20.230019 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-dc14ab6a-803b-4278-a009-f1289c97074c req-b419ed16-915c-4061-9f58-016de6b9c6ab tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] For port be91670b-dbb8-4fce-b904-952d0880b662, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=be91670b-dbb8-4fce-b904-952d0880b662,segment=NetworkSegment(dc72244a-ee60-4e55-a4fb-6c577a5c32a9),segment_id=dc72244a-ee60-4e55-a4fb-6c577a5c32a9)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:06:20.230381 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-dc14ab6a-803b-4278-a009-f1289c97074c req-b419ed16-915c-4061-9f58-016de6b9c6ab tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:20.246035 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-dc14ab6a-803b-4278-a009-f1289c97074c req-b419ed16-915c-4061-9f58-016de6b9c6ab tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Calling delete_port for be91670b-dbb8-4fce-b904-952d0880b662 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:06:20.406116 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-dc14ab6a-803b-4278-a009-f1289c97074c req-b419ed16-915c-4061-9f58-016de6b9c6ab tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:20.417604 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['be91670b-dbb8-4fce-b904-952d0880b662'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:06:20.437931 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b419ed16-915c-4061-9f58-016de6b9c6ab tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Pushing event deleted for resources: {'Port': ['ID=be91670b-dbb8-4fce-b904-952d0880b662,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:06:20.479553 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-dc14ab6a-803b-4278-a009-f1289c97074c req-b419ed16-915c-4061-9f58-016de6b9c6ab tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] No DVR routers for this DVR port be91670b-dbb8-4fce-b904-952d0880b662 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:06:20.482244 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-dc14ab6a-803b-4278-a009-f1289c97074c req-b419ed16-915c-4061-9f58-016de6b9c6ab tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:20.486090 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dc14ab6a-803b-4278-a009-f1289c97074c req-b419ed16-915c-4061-9f58-016de6b9c6ab tempest-DeleteServersTestJSON-2003746517 tempest-DeleteServersTestJSON-2003746517-project] 10.222.0.31 "DELETE /v2.0/ports/be91670b-dbb8-4fce-b904-952d0880b662 HTTP/1.1" status: 204 len: 173 time: 0.4335225 Dec 09 22:06:20.486539 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bf0c4eae-8daf-4db9-aac2-e7b5c631804f', 'name': 'network-vif-deleted', 'tag': 'be91670b-dbb8-4fce-b904-952d0880b662'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:06:20.488810 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fe409f1a-ba69-40e1-babd-e498c426725b" -d '{"events": [{"server_uuid": "bf0c4eae-8daf-4db9-aac2-e7b5c631804f", "name": "network-vif-deleted", "tag": "be91670b-dbb8-4fce-b904-952d0880b662"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:06:20.525862 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:06:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0ed094d5-9757-4279-9fa2-0d0575644cde x-openstack-request-id: req-0ed094d5-9757-4279-9fa2-0d0575644cde {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:06:20.526147 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bf0c4eae-8daf-4db9-aac2-e7b5c631804f", "name": "network-vif-deleted", "tag": "be91670b-dbb8-4fce-b904-952d0880b662", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:06:20.526404 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0ed094d5-9757-4279-9fa2-0d0575644cde {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:06:20.526819 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bf0c4eae-8daf-4db9-aac2-e7b5c631804f', 'name': 'network-vif-deleted', 'tag': 'be91670b-dbb8-4fce-b904-952d0880b662', 'status': 'completed', 'code': 200} Dec 09 22:06:21.216592 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58846) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:06:21.265483 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-8780ecba-1085-4001-8755-f6cd5842c125 admin admin] Deleting subnet de9277ea-28ea-4da0-9494-aa247eb38df7 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:06:21.268741 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8780ecba-1085-4001-8755-f6cd5842c125 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:21.305333 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8780ecba-1085-4001-8755-f6cd5842c125 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:21.344958 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8780ecba-1085-4001-8755-f6cd5842c125 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:21.407376 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8780ecba-1085-4001-8755-f6cd5842c125 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:21.431479 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8780ecba-1085-4001-8755-f6cd5842c125 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=de9277ea-28ea-4da0-9494-aa247eb38df7,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:06:21.434992 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8780ecba-1085-4001-8755-f6cd5842c125 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:21.438218 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8780ecba-1085-4001-8755-f6cd5842c125 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/de9277ea-28ea-4da0-9494-aa247eb38df7 HTTP/1.1" status: 204 len: 168 time: 0.2206001 Dec 09 22:06:21.440912 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58848) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:06:21.512642 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f4d6e871-8260-4161-b167-6f5405f5e8cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:21.593970 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f4d6e871-8260-4161-b167-6f5405f5e8cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:21.961760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-f4d6e871-8260-4161-b167-6f5405f5e8cd admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['26c6a367-09c3-4bad-85bb-c9ecda687989']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:06:21.972047 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-f4d6e871-8260-4161-b167-6f5405f5e8cd admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dc72244a-ee60-4e55-a4fb-6c577a5c32a9') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:06:21.972340 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-f4d6e871-8260-4161-b167-6f5405f5e8cd admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dc72244a-ee60-4e55-a4fb-6c577a5c32a9') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:06:21.981840 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f4d6e871-8260-4161-b167-6f5405f5e8cd admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:21.997038 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f4d6e871-8260-4161-b167-6f5405f5e8cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:22.003736 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f4d6e871-8260-4161-b167-6f5405f5e8cd admin admin] Releasing vlan 112 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:06:22.004119 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f4d6e871-8260-4161-b167-6f5405f5e8cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: timer() Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:06:22.006532 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:06:22.073355 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f4d6e871-8260-4161-b167-6f5405f5e8cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:22.080912 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f4d6e871-8260-4161-b167-6f5405f5e8cd admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:22.084437 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f4d6e871-8260-4161-b167-6f5405f5e8cd admin admin] 10.222.0.13 "DELETE /v2.0/networks/26c6a367-09c3-4bad-85bb-c9ecda687989 HTTP/1.1" status: 204 len: 168 time: 0.6426198 Dec 09 22:06:22.100243 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4d6e871-8260-4161-b167-6f5405f5e8cd admin admin] Pushing event deleted for resources: {'Network': ['ID=26c6a367-09c3-4bad-85bb-c9ecda687989,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:06:22.208702 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58852) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:06:22.250568 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2f7a649d-07b4-48fd-8dd8-aa19d183894c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=2a4743baf90d462d968f7df0cc265733&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0406306 Dec 09 22:06:22.253092 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58854) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:06:22.308508 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0ea7951d-9602-40e0-a05e-04692110677d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:22.330360 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0ea7951d-9602-40e0-a05e-04692110677d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:22.383094 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0ea7951d-9602-40e0-a05e-04692110677d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:22.386014 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0ea7951d-9602-40e0-a05e-04692110677d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:22.387348 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0ea7951d-9602-40e0-a05e-04692110677d admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/1a04ea57-7f43-4bc8-a460-c680058708fe HTTP/1.1" status: 204 len: 168 time: 0.1332505 Dec 09 22:06:22.396759 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ea7951d-9602-40e0-a05e-04692110677d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1a04ea57-7f43-4bc8-a460-c680058708fe,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:06:23.105657 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 58876) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:06:23.215431 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-aa96ea12-9818-46ef-86c0-2fea7f457d6c admin admin] Request body: {'network': {'name': 'tempest-ServerDiskConfigTestJSON-1978184719-network', 'tenant_id': '4e6e98b6ce8149c49f718a22c26736d8'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:06:23.242387 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aa96ea12-9818-46ef-86c0-2fea7f457d6c admin admin] Made reservation on behalf of 4e6e98b6ce8149c49f718a22c26736d8 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:06:23.245768 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa96ea12-9818-46ef-86c0-2fea7f457d6c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:23.258754 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa96ea12-9818-46ef-86c0-2fea7f457d6c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:23.338192 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa96ea12-9818-46ef-86c0-2fea7f457d6c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:23.344162 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa96ea12-9818-46ef-86c0-2fea7f457d6c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:23.365690 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-aa96ea12-9818-46ef-86c0-2fea7f457d6c admin admin] vlan segment allocate from pool success with {'vlan_id': 136, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 22:06:23.381219 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa96ea12-9818-46ef-86c0-2fea7f457d6c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=44fb00aa-12b9-43e2-9356-e9fcf03af445,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:06:23.384190 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa96ea12-9818-46ef-86c0-2fea7f457d6c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:23.384532 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-aa96ea12-9818-46ef-86c0-2fea7f457d6c admin admin] Added segment bb19ea59-b907-4a2f-a9d7-f47a74902855 of type vlan for network fcd51eae-6fa3-41c8-9622-47a1ed852c66 Dec 09 22:06:23.424846 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa96ea12-9818-46ef-86c0-2fea7f457d6c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:23.451884 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa96ea12-9818-46ef-86c0-2fea7f457d6c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:23.452763 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa96ea12-9818-46ef-86c0-2fea7f457d6c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:23.453437 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-aa96ea12-9818-46ef-86c0-2fea7f457d6c admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:23.483045 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device be91670b-dbb8-4fce-b904-952d0880b662 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:06:23.487185 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-aa96ea12-9818-46ef-86c0-2fea7f457d6c admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.3804381 Dec 09 22:06:23.490481 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 58880) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:06:23.495390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-5ed520b9-8dbd-4c46-9d82-638a0a6c7161 admin admin] Request body: {'subnet': {'network_id': 'fcd51eae-6fa3-41c8-9622-47a1ed852c66', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerDiskConfigTestJSON-1978184719-subnet', 'tenant_id': '4e6e98b6ce8149c49f718a22c26736d8', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:06:23.505147 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: be91670b-dbb8-4fce-b904-952d0880b662 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:06:23.505470 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device be91670b-dbb8-4fce-b904-952d0880b662 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:06:23.517471 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5ed520b9-8dbd-4c46-9d82-638a0a6c7161 admin admin] Made reservation on behalf of 4e6e98b6ce8149c49f718a22c26736d8 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:06:23.520384 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa96ea12-9818-46ef-86c0-2fea7f457d6c admin admin] Pushing event updated for resources: {'Network': ['ID=fcd51eae-6fa3-41c8-9622-47a1ed852c66,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:06:23.520520 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ed520b9-8dbd-4c46-9d82-638a0a6c7161 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:23.531790 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network fcd51eae-6fa3-41c8-9622-47a1ed852c66 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 22:06:23.693801 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ed520b9-8dbd-4c46-9d82-638a0a6c7161 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:23.749804 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ed520b9-8dbd-4c46-9d82-638a0a6c7161 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2d05eb0f-5210-4210-a0bf-465840e19241,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:06:23.758915 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5ed520b9-8dbd-4c46-9d82-638a0a6c7161 admin admin] Checking segment: {'id': 'bb19ea59-b907-4a2f-a9d7-f47a74902855', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'fcd51eae-6fa3-41c8-9622-47a1ed852c66'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:06:23.759272 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5ed520b9-8dbd-4c46-9d82-638a0a6c7161 admin admin] Network hostable DHCP agents. Network: fcd51eae-6fa3-41c8-9622-47a1ed852c66, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 22:06:23.779223 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5ed520b9-8dbd-4c46-9d82-638a0a6c7161 admin admin] Network fcd51eae-6fa3-41c8-9622-47a1ed852c66 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 22:06:23.788898 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-5ed520b9-8dbd-4c46-9d82-638a0a6c7161 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, fcd51eae-6fa3-41c8-9622-47a1ed852c66) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:06:23.793327 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ed520b9-8dbd-4c46-9d82-638a0a6c7161 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:23.793927 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5ed520b9-8dbd-4c46-9d82-638a0a6c7161 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:23.800178 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3dc9ea51-9917-49af-b0ee-5250372c2661 None None] Network fcd51eae-6fa3-41c8-9622-47a1ed852c66 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:06:23.811891 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5ed520b9-8dbd-4c46-9d82-638a0a6c7161 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.3203051 Dec 09 22:06:23.900118 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1eb0f9b4-f6fa-49b7-b3dd-d4cc3de21981 None None] Network fcd51eae-6fa3-41c8-9622-47a1ed852c66 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:06:24.246954 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-ab70ce69-5691-49ae-9b67-bbe6501e8faa tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:24.248497 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-ab70ce69-5691-49ae-9b67-bbe6501e8faa tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/networks?id=fcd51eae-6fa3-41c8-9622-47a1ed852c66 HTTP/1.1" status: 200 len: 815 time: 0.1071146 Dec 09 22:06:24.263802 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-67feb979-fec7-47df-b4b4-7e220ba87bd0 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/quotas/4e6e98b6ce8149c49f718a22c26736d8 HTTP/1.1" status: 200 len: 375 time: 0.0093124 Dec 09 22:06:24.294484 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-30efeca0-8256-4598-87d0-7c88730ce3b8 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=4e6e98b6ce8149c49f718a22c26736d8&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0252571 Dec 09 22:06:24.488759 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-48888433-b181-434a-a404-fc031c1ac320 service neutron] 10.222.0.13 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1873171 Dec 09 22:06:24.587408 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-9ff09773-bbde-4864-a718-7e3d21fa05c1 service neutron] 10.222.0.13 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0921061 Dec 09 22:06:24.756763 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7f48dd58-6e0d-46d2-8210-effcf0ad3a37 req-bbc1d291-c524-4266-b7cb-6259f260964b tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 210 time: 0.0321119 Dec 09 22:06:25.740646 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-00993bb4-5b35-404c-be3d-864954ed1df6 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:25.742136 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-00993bb4-5b35-404c-be3d-864954ed1df6 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.31 "GET /v2.0/networks?id=fcd51eae-6fa3-41c8-9622-47a1ed852c66 HTTP/1.1" status: 200 len: 815 time: 0.1126754 Dec 09 22:06:25.756405 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-b4efd340-50e8-4813-abb2-3b32c1bbbb3c tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Request body: {'port': {'device_id': '65714618-af46-4989-96f7-bc4683e29b0c', 'network_id': 'fcd51eae-6fa3-41c8-9622-47a1ed852c66', 'admin_state_up': True, 'tenant_id': '4e6e98b6ce8149c49f718a22c26736d8'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:06:25.853135 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8e3d0d4e-2ccf-4305-9f04-c4d5995a8b04 req-4d8874b1-9b76-4128-901f-a9e2bfe8a065 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 210 time: 0.0263655 Dec 09 22:06:25.864312 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-b4efd340-50e8-4813-abb2-3b32c1bbbb3c tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Made reservation on behalf of 4e6e98b6ce8149c49f718a22c26736d8 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:06:25.868172 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-b4efd340-50e8-4813-abb2-3b32c1bbbb3c tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:25.997367 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-b4efd340-50e8-4813-abb2-3b32c1bbbb3c tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Allocated IP 172.20.0.11 (fcd51eae-6fa3-41c8-9622-47a1ed852c66/2d05eb0f-5210-4210-a0bf-465840e19241/e1c400c1-dab7-4394-9188-b3d61e3129e4) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:06:26.152939 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-b4efd340-50e8-4813-abb2-3b32c1bbbb3c tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:26.192125 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-b4efd340-50e8-4813-abb2-3b32c1bbbb3c tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:26.238743 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-b4efd340-50e8-4813-abb2-3b32c1bbbb3c tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Network fcd51eae-6fa3-41c8-9622-47a1ed852c66 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:06:26.245777 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-b4efd340-50e8-4813-abb2-3b32c1bbbb3c tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:06:26.250366 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-b4efd340-50e8-4813-abb2-3b32c1bbbb3c tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:06:26.254331 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4efd340-50e8-4813-abb2-3b32c1bbbb3c tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Pushing event updated for resources: {'Port': ['ID=e1c400c1-dab7-4394-9188-b3d61e3129e4,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:06:26.300186 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-b4efd340-50e8-4813-abb2-3b32c1bbbb3c tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:26.300782 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-b4efd340-50e8-4813-abb2-3b32c1bbbb3c tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:26.321089 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-b4efd340-50e8-4813-abb2-3b32c1bbbb3c tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5691218 Dec 09 22:06:26.333873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-79d85cf4-18af-4e78-ace6-7999cd757154 service neutron] Request body: {'port': {'device_id': '65714618-af46-4989-96f7-bc4683e29b0c', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:06:26.392459 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-79d85cf4-18af-4e78-ace6-7999cd757154 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:26.661595 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-79d85cf4-18af-4e78-ace6-7999cd757154 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e1c400c1-dab7-4394-9188-b3d61e3129e4 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:06:26.669804 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-79d85cf4-18af-4e78-ace6-7999cd757154 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:26.687476 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-79d85cf4-18af-4e78-ace6-7999cd757154 service neutron] Transition to ACTIVE for port object e1c400c1-dab7-4394-9188-b3d61e3129e4 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:06:26.694792 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-79d85cf4-18af-4e78-ace6-7999cd757154 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:26.754233 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79d85cf4-18af-4e78-ace6-7999cd757154 service neutron] Pushing event updated for resources: {'Port': ['ID=e1c400c1-dab7-4394-9188-b3d61e3129e4,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:06:26.826558 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-79d85cf4-18af-4e78-ace6-7999cd757154 service neutron] Attempting to bind port e1c400c1-dab7-4394-9188-b3d61e3129e4 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:06:26.826934 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-79d85cf4-18af-4e78-ace6-7999cd757154 service neutron] Attempting to bind port e1c400c1-dab7-4394-9188-b3d61e3129e4 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'bb19ea59-b907-4a2f-a9d7-f47a74902855', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'fcd51eae-6fa3-41c8-9622-47a1ed852c66'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:06:26.827267 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-79d85cf4-18af-4e78-ace6-7999cd757154 service neutron] Attempting to bind port e1c400c1-dab7-4394-9188-b3d61e3129e4 on network fcd51eae-6fa3-41c8-9622-47a1ed852c66 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:06:26.832201 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-79d85cf4-18af-4e78-ace6-7999cd757154 service neutron] Port e1c400c1-dab7-4394-9188-b3d61e3129e4 on network fcd51eae-6fa3-41c8-9622-47a1ed852c66 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:06:26.832527 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-79d85cf4-18af-4e78-ace6-7999cd757154 service neutron] Attempting to bind port e1c400c1-dab7-4394-9188-b3d61e3129e4 on network fcd51eae-6fa3-41c8-9622-47a1ed852c66 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:06:26.838145 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-79d85cf4-18af-4e78-ace6-7999cd757154 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 5, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:06:26.838482 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-79d85cf4-18af-4e78-ace6-7999cd757154 service neutron] Checking segment: {'id': 'bb19ea59-b907-4a2f-a9d7-f47a74902855', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'fcd51eae-6fa3-41c8-9622-47a1ed852c66'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:06:26.838869 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-79d85cf4-18af-4e78-ace6-7999cd757154 service neutron] Bound using segment: {'id': 'bb19ea59-b907-4a2f-a9d7-f47a74902855', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'fcd51eae-6fa3-41c8-9622-47a1ed852c66'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:06:26.839297 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-79d85cf4-18af-4e78-ace6-7999cd757154 service neutron] Bound port: e1c400c1-dab7-4394-9188-b3d61e3129e4, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bb19ea59-b907-4a2f-a9d7-f47a74902855', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'fcd51eae-6fa3-41c8-9622-47a1ed852c66'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:06:26.839686 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-79d85cf4-18af-4e78-ace6-7999cd757154 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:26.905729 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-79d85cf4-18af-4e78-ace6-7999cd757154 service neutron] For port e1c400c1-dab7-4394-9188-b3d61e3129e4, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:06:26.908879 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-79d85cf4-18af-4e78-ace6-7999cd757154 service neutron] For port e1c400c1-dab7-4394-9188-b3d61e3129e4, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e1c400c1-dab7-4394-9188-b3d61e3129e4,segment=NetworkSegment(bb19ea59-b907-4a2f-a9d7-f47a74902855),segment_id=bb19ea59-b907-4a2f-a9d7-f47a74902855)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:06:26.914934 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-79d85cf4-18af-4e78-ace6-7999cd757154 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:26.951899 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-79d85cf4-18af-4e78-ace6-7999cd757154 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:26.952560 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-79d85cf4-18af-4e78-ace6-7999cd757154 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:26.953944 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-79d85cf4-18af-4e78-ace6-7999cd757154 service neutron] 10.222.0.31 "PUT /v2.0/ports/e1c400c1-dab7-4394-9188-b3d61e3129e4 HTTP/1.1" status: 200 len: 1093 time: 0.6241651 Dec 09 22:06:26.954414 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '65714618-af46-4989-96f7-bc4683e29b0c', 'tag': 'e1c400c1-dab7-4394-9188-b3d61e3129e4'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:06:26.956790 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-918eb1d8-c30c-4eb7-87b6-3b1014503284" -d '{"events": [{"name": "network-changed", "server_uuid": "65714618-af46-4989-96f7-bc4683e29b0c", "tag": "e1c400c1-dab7-4394-9188-b3d61e3129e4"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:06:26.984231 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79d85cf4-18af-4e78-ace6-7999cd757154 service neutron] Pushing event updated for resources: {'Port': ['ID=e1c400c1-dab7-4394-9188-b3d61e3129e4,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:06:26.985211 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a108731-60d5-46f1-a6ca-515284360068 req-ba9ae7c5-8330-47b2-82bd-042af28ec1ba tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:26.993392 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a108731-60d5-46f1-a6ca-515284360068 req-ba9ae7c5-8330-47b2-82bd-042af28ec1ba tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 944 time: 0.0684943 Dec 09 22:06:27.041210 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-c465939d-1cd1-4d46-8e1b-f8a8bc12aee4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:27.041477 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a108731-60d5-46f1-a6ca-515284360068 req-e7116068-7bab-4fa9-95b4-ce7a2a281810 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415523 Dec 09 22:06:27.042731 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-c465939d-1cd1-4d46-8e1b-f8a8bc12aee4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=4e6e98b6ce8149c49f718a22c26736d8&device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 1096 time: 0.0477936 Dec 09 22:06:27.092074 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:06:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1bb94c25-5c9c-430c-bc91-4eed5bd61121 x-openstack-request-id: req-1bb94c25-5c9c-430c-bc91-4eed5bd61121 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:06:27.092377 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "65714618-af46-4989-96f7-bc4683e29b0c", "tag": "e1c400c1-dab7-4394-9188-b3d61e3129e4", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:06:27.092630 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-1bb94c25-5c9c-430c-bc91-4eed5bd61121 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:06:27.093034 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '65714618-af46-4989-96f7-bc4683e29b0c', 'tag': 'e1c400c1-dab7-4394-9188-b3d61e3129e4', 'status': 'completed', 'code': 200} Dec 09 22:06:27.094847 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-1fe2165d-8b6b-4c47-b418-fe729ae37a85 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=e1c400c1-dab7-4394-9188-b3d61e3129e4 HTTP/1.1" status: 200 len: 217 time: 0.0434420 Dec 09 22:06:27.156898 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-45eaf8bc-6407-41ee-b3d8-253bb3876ea0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:27.158352 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-45eaf8bc-6407-41ee-b3d8-253bb3876ea0 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=2d05eb0f-5210-4210-a0bf-465840e19241 HTTP/1.1" status: 200 len: 855 time: 0.0564692 Dec 09 22:06:27.189758 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-59932dc9-8c0d-4816-92b4-c71791816e86 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fcd51eae-6fa3-41c8-9622-47a1ed852c66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0242221 Dec 09 22:06:27.285508 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-88e9f83d-3edb-492d-b2a8-fdac8f742cbf service neutron] 10.222.0.31 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0884969 Dec 09 22:06:27.382661 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-98c74a69-fe9c-4456-b1c4-81848967ea90 req-52ad9a10-a965-47e9-8eaa-afdd1adb0bc7 service neutron] 10.222.0.31 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0904326 Dec 09 22:06:27.474162 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-918eb1d8-c30c-4eb7-87b6-3b1014503284 req-c26e18df-2663-41af-8b85-0b38511c123a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:27.475718 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-918eb1d8-c30c-4eb7-87b6-3b1014503284 req-c26e18df-2663-41af-8b85-0b38511c123a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=4e6e98b6ce8149c49f718a22c26736d8&device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 1096 time: 0.0446241 Dec 09 22:06:27.526516 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:27.565722 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-918eb1d8-c30c-4eb7-87b6-3b1014503284 req-2bc20465-2da1-4f8f-962b-fa0c6235b629 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:27.567258 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-918eb1d8-c30c-4eb7-87b6-3b1014503284 req-2bc20465-2da1-4f8f-962b-fa0c6235b629 service neutron] 10.222.0.31 "GET /v2.0/networks?id=fcd51eae-6fa3-41c8-9622-47a1ed852c66 HTTP/1.1" status: 200 len: 916 time: 0.0850565 Dec 09 22:06:27.614131 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-918eb1d8-c30c-4eb7-87b6-3b1014503284 req-d1ec0e08-e05c-4929-ba8c-df8b514ea3bb service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=e1c400c1-dab7-4394-9188-b3d61e3129e4 HTTP/1.1" status: 200 len: 217 time: 0.0396371 Dec 09 22:06:27.664124 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-918eb1d8-c30c-4eb7-87b6-3b1014503284 req-efe70a91-a636-4bb8-9617-096ef4ef2632 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:27.665564 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-918eb1d8-c30c-4eb7-87b6-3b1014503284 req-efe70a91-a636-4bb8-9617-096ef4ef2632 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=2d05eb0f-5210-4210-a0bf-465840e19241 HTTP/1.1" status: 200 len: 855 time: 0.0439010 Dec 09 22:06:27.696719 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-918eb1d8-c30c-4eb7-87b6-3b1014503284 req-df3280b6-dfa0-45fa-a064-f238219f141d service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fcd51eae-6fa3-41c8-9622-47a1ed852c66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0239592 Dec 09 22:06:27.712568 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:27.796505 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-918eb1d8-c30c-4eb7-87b6-3b1014503284 req-87c40a64-aa6f-4df7-a564-b1ffb239fcfb service neutron] 10.222.0.31 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0916655 Dec 09 22:06:27.890751 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-918eb1d8-c30c-4eb7-87b6-3b1014503284 req-b5877fce-27f5-4a8e-81c1-db3541a95a6f service neutron] 10.222.0.31 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0863554 Dec 09 22:06:28.173955 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c83df366-4efa-4be9-aedc-f7e339d29c17 req-81bd6bee-e797-45e8-9e25-1d854303a913 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:28.175476 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c83df366-4efa-4be9-aedc-f7e339d29c17 req-81bd6bee-e797-45e8-9e25-1d854303a913 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 944 time: 0.0563922 Dec 09 22:06:28.238202 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c83df366-4efa-4be9-aedc-f7e339d29c17 req-9952af10-92ef-4900-9e09-0338a94e945c tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0561240 Dec 09 22:06:29.365858 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d971f543-8d80-4ce0-a16e-8111234f0a55 req-84ac096f-11c9-4ed9-9164-26d99c95f3e8 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:29.367724 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d971f543-8d80-4ce0-a16e-8111234f0a55 req-84ac096f-11c9-4ed9-9164-26d99c95f3e8 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 944 time: 0.0551908 Dec 09 22:06:29.415379 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d971f543-8d80-4ce0-a16e-8111234f0a55 req-744b3f46-2731-466f-9e8c-0f154d820ead tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415244 Dec 09 22:06:29.514635 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e1c400c1-dab7-4394-9188-b3d61e3129e4 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:06:29.624612 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port e1c400c1-dab7-4394-9188-b3d61e3129e4, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e1c400c1-dab7-4394-9188-b3d61e3129e4,segment=NetworkSegment(bb19ea59-b907-4a2f-a9d7-f47a74902855),segment_id=bb19ea59-b907-4a2f-a9d7-f47a74902855)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:06:29.636948 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'e1c400c1-dab7-4394-9188-b3d61e3129e4', 'network_id': 'fcd51eae-6fa3-41c8-9622-47a1ed852c66', 'port_id': 'e1c400c1-dab7-4394-9188-b3d61e3129e4', 'mac_address': 'fa:16:3e:9b:05:f0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 136, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2d05eb0f-5210-4210-a0bf-465840e19241', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:06:29.674279 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:29.687887 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e1c400c1-dab7-4394-9188-b3d61e3129e4 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:06:29.707906 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port e1c400c1-dab7-4394-9188-b3d61e3129e4, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e1c400c1-dab7-4394-9188-b3d61e3129e4,segment=NetworkSegment(bb19ea59-b907-4a2f-a9d7-f47a74902855),segment_id=bb19ea59-b907-4a2f-a9d7-f47a74902855)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:06:29.715805 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:29.776072 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=e1c400c1-dab7-4394-9188-b3d61e3129e4,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:06:29.906482 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['e1c400c1-dab7-4394-9188-b3d61e3129e4'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:06:30.552715 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbcc8749-7932-4727-86ec-adbbdbb3cb56 req-20294806-a3ac-42ec-a099-7b99bda287b4 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:30.554209 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fbcc8749-7932-4727-86ec-adbbdbb3cb56 req-20294806-a3ac-42ec-a099-7b99bda287b4 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 945 time: 0.0598052 Dec 09 22:06:30.604389 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fbcc8749-7932-4727-86ec-adbbdbb3cb56 req-05786768-c057-4138-a03e-944ae3148578 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409751 Dec 09 22:06:31.515528 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e1c400c1-dab7-4394-9188-b3d61e3129e4 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:06:31.583106 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port e1c400c1-dab7-4394-9188-b3d61e3129e4 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:06:31.587275 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port e1c400c1-dab7-4394-9188-b3d61e3129e4 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:06:31.587672 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:31.682412 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:31.705891 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '65714618-af46-4989-96f7-bc4683e29b0c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e1c400c1-dab7-4394-9188-b3d61e3129e4'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:06:31.709239 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6af36e21-4bc9-428a-b719-e655bca3cf0a" -d '{"events": [{"server_uuid": "65714618-af46-4989-96f7-bc4683e29b0c", "name": "network-vif-plugged", "status": "completed", "tag": "e1c400c1-dab7-4394-9188-b3d61e3129e4"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:06:31.723475 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port e1c400c1-dab7-4394-9188-b3d61e3129e4, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e1c400c1-dab7-4394-9188-b3d61e3129e4,segment=NetworkSegment(bb19ea59-b907-4a2f-a9d7-f47a74902855),segment_id=bb19ea59-b907-4a2f-a9d7-f47a74902855)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:06:31.731852 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:31.742501 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c3032ab-85d7-4ff9-8df2-da06a8ab30d1 req-4043b8a8-4673-43e9-a0dc-38f3dfeb4cf6 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:31.744700 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4c3032ab-85d7-4ff9-8df2-da06a8ab30d1 req-4043b8a8-4673-43e9-a0dc-38f3dfeb4cf6 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 945 time: 0.0605531 Dec 09 22:06:31.786807 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=e1c400c1-dab7-4394-9188-b3d61e3129e4,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:06:31.803544 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4c3032ab-85d7-4ff9-8df2-da06a8ab30d1 req-9f0b7461-c339-4ee6-a82d-44cff0d04eaf tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516188 Dec 09 22:06:31.862039 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:06:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-149f2b1d-d157-46db-a0e3-2b0b27604574 x-openstack-request-id: req-149f2b1d-d157-46db-a0e3-2b0b27604574 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:06:31.862340 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "65714618-af46-4989-96f7-bc4683e29b0c", "name": "network-vif-plugged", "status": "completed", "tag": "e1c400c1-dab7-4394-9188-b3d61e3129e4", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:06:31.862586 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-149f2b1d-d157-46db-a0e3-2b0b27604574 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:06:31.863007 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '65714618-af46-4989-96f7-bc4683e29b0c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e1c400c1-dab7-4394-9188-b3d61e3129e4', 'code': 200} Dec 09 22:06:31.991920 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2396fb07-a34e-4981-961e-8bb1936360d8 req-9dc18112-510a-40f1-88be-3ef698105ad7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:31.993488 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2396fb07-a34e-4981-961e-8bb1936360d8 req-9dc18112-510a-40f1-88be-3ef698105ad7 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 1098 time: 0.0578108 Dec 09 22:06:32.055270 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2396fb07-a34e-4981-961e-8bb1936360d8 req-e090e15d-c14e-412a-a640-1096219f3470 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0542283 Dec 09 22:06:32.934590 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd236b78-f7df-4c23-91ba-20c58356d788 req-8c5a3d10-1e8d-481d-a8fc-daa8d1a8eb55 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:32.936185 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd236b78-f7df-4c23-91ba-20c58356d788 req-8c5a3d10-1e8d-481d-a8fc-daa8d1a8eb55 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0521576 Dec 09 22:06:32.988108 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd236b78-f7df-4c23-91ba-20c58356d788 req-a7bfb7e7-8684-46fa-bf69-45b87f559055 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458484 Dec 09 22:06:33.001875 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ef0c8470-949d-4ea4-b46e-eae5cdd53734 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:34.123837 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-798c8140-723c-4628-97e4-10df5fe20b1c req-3ad9224f-de6d-49d0-9ca4-15e96137800d tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:34.125228 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-798c8140-723c-4628-97e4-10df5fe20b1c req-3ad9224f-de6d-49d0-9ca4-15e96137800d tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0543709 Dec 09 22:06:34.179346 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-798c8140-723c-4628-97e4-10df5fe20b1c req-64ae9184-8cb6-4ae0-86ea-da420d66f813 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457380 Dec 09 22:06:34.208930 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:06:34.307473 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d455c3c5-8934-4cc1-8675-e97cbc341f23 req-87c913c2-37ef-4258-8691-3f7d0a5c9576 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:34.308973 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d455c3c5-8934-4cc1-8675-e97cbc341f23 req-87c913c2-37ef-4258-8691-3f7d0a5c9576 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0570774 Dec 09 22:06:34.358954 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d455c3c5-8934-4cc1-8675-e97cbc341f23 req-c599956e-2747-444b-ba26-cf5dd6bf64cb tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438714 Dec 09 22:06:34.566590 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1944d3a2-233b-4016-ab67-2665081b98c7 req-946e0c80-65df-467e-b1f2-9fa78b88d0b4 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:34.568091 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1944d3a2-233b-4016-ab67-2665081b98c7 req-946e0c80-65df-467e-b1f2-9fa78b88d0b4 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0516372 Dec 09 22:06:34.616352 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1944d3a2-233b-4016-ab67-2665081b98c7 req-41c0b7fe-01f0-4a65-8f9a-c54a25a1aeac tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421047 Dec 09 22:06:34.738779 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0a46073-659f-43d3-b949-682e6811c241 req-a36bd48e-7d4e-4570-9938-ec60f7cb54de tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:34.740255 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0a46073-659f-43d3-b949-682e6811c241 req-a36bd48e-7d4e-4570-9938-ec60f7cb54de tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0580776 Dec 09 22:06:34.808814 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0a46073-659f-43d3-b949-682e6811c241 req-30ddcc4d-0539-4c55-96a1-1ce96155c5ca tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0562646 Dec 09 22:06:35.084941 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-5faefd4f-defc-46ad-9b00-4cf8bec48b5a service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0641408 Dec 09 22:06:35.097740 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf2940f2-a045-4331-9a48-df5887799985 req-c9712466-9512-4e2e-9c1f-098cc9c58383 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:35.099209 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf2940f2-a045-4331-9a48-df5887799985 req-c9712466-9512-4e2e-9c1f-098cc9c58383 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0704162 Dec 09 22:06:35.153755 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf2940f2-a045-4331-9a48-df5887799985 req-3d0f66ac-ecda-4cea-b7cf-427e9605683a tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476899 Dec 09 22:06:35.630149 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f5cecd15-1f49-4cad-a85b-8c990c778944 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:36.281732 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63724f08-c1dc-4075-9eb5-2c5aa7717fdd req-958aa9ce-462f-4843-add1-b2dda0631de1 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:36.283240 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63724f08-c1dc-4075-9eb5-2c5aa7717fdd req-958aa9ce-462f-4843-add1-b2dda0631de1 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0556853 Dec 09 22:06:36.335670 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63724f08-c1dc-4075-9eb5-2c5aa7717fdd req-38f9a350-ffec-4325-9758-74a4f82d06e6 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454526 Dec 09 22:06:36.366278 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a72d3c2a-3358-4484-a875-5a728fb51a28 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:36.367861 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a72d3c2a-3358-4484-a875-5a728fb51a28 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=4e6e98b6ce8149c49f718a22c26736d8&device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 1098 time: 0.0433276 Dec 09 22:06:36.463325 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-e7dd82e7-7333-4a75-b152-c68a44d8bfe3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:36.464794 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-e7dd82e7-7333-4a75-b152-c68a44d8bfe3 service neutron] 10.222.0.31 "GET /v2.0/networks?id=fcd51eae-6fa3-41c8-9622-47a1ed852c66 HTTP/1.1" status: 200 len: 916 time: 0.0896165 Dec 09 22:06:36.514625 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-23d51bcf-c94c-4d45-adb5-ddc5c4f02834 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=e1c400c1-dab7-4394-9188-b3d61e3129e4 HTTP/1.1" status: 200 len: 217 time: 0.0431094 Dec 09 22:06:36.567247 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-bd4d6161-a09f-4e83-9283-63ade4b63adc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:36.568739 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-bd4d6161-a09f-4e83-9283-63ade4b63adc service neutron] 10.222.0.31 "GET /v2.0/subnets?id=2d05eb0f-5210-4210-a0bf-465840e19241 HTTP/1.1" status: 200 len: 855 time: 0.0476663 Dec 09 22:06:36.605111 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a307d599-ba7d-4f6c-b1f5-d0e006f1b52e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fcd51eae-6fa3-41c8-9622-47a1ed852c66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0287097 Dec 09 22:06:36.705224 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-fc333800-9626-4513-8dd6-aea508dbfd58 service neutron] 10.222.0.31 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0911908 Dec 09 22:06:36.775908 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:36.808055 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-844d6c0f-d08b-4f33-aafb-c3eca50e6e23 service neutron] 10.222.0.31 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0953925 Dec 09 22:06:37.463780 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfb8588e-154d-4c95-9b15-bad22016bc5a req-17e48d4c-a0db-457b-858a-7df9536e9db1 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:37.465276 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dfb8588e-154d-4c95-9b15-bad22016bc5a req-17e48d4c-a0db-457b-858a-7df9536e9db1 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0584042 Dec 09 22:06:37.514971 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dfb8588e-154d-4c95-9b15-bad22016bc5a req-40871fef-f6fb-4d03-8d70-57a48d2a942b tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436428 Dec 09 22:06:38.099245 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:38.657374 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e4bb355-856e-4cb3-8a05-c21976901080 req-2ccc2fc3-7718-4c1b-acd9-26fc8d708ddd tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:38.658856 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e4bb355-856e-4cb3-8a05-c21976901080 req-2ccc2fc3-7718-4c1b-acd9-26fc8d708ddd tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0568957 Dec 09 22:06:38.709468 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e4bb355-856e-4cb3-8a05-c21976901080 req-2b6e4cf3-2fc8-4bd9-8641-77c52d7c6314 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420434 Dec 09 22:06:39.666044 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:39.834388 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6831515-f9eb-47a8-86d4-7d7f29742859 req-c60cfe43-6f4a-454b-9b69-e35ed03eb07a tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:39.835903 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6831515-f9eb-47a8-86d4-7d7f29742859 req-c60cfe43-6f4a-454b-9b69-e35ed03eb07a tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0540016 Dec 09 22:06:39.888740 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6831515-f9eb-47a8-86d4-7d7f29742859 req-09a00d6c-0438-41ae-88a2-6adc922599d7 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463965 Dec 09 22:06:41.024010 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb0fc554-fbc8-43ed-85f1-4d4f6c749796 req-7e7c9f5d-4560-4f59-b40a-486e8d96eabc tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:41.025643 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eb0fc554-fbc8-43ed-85f1-4d4f6c749796 req-7e7c9f5d-4560-4f59-b40a-486e8d96eabc tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0566142 Dec 09 22:06:41.074677 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eb0fc554-fbc8-43ed-85f1-4d4f6c749796 req-6105368c-ff88-41a8-a6ad-c18895157f63 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429497 Dec 09 22:06:42.201695 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49cf363a-927e-4232-acd2-2104649e1e94 req-bf6716fb-ace8-492b-8042-2fa6be9bb27a tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:42.203168 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-49cf363a-927e-4232-acd2-2104649e1e94 req-bf6716fb-ace8-492b-8042-2fa6be9bb27a tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0515645 Dec 09 22:06:42.254367 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-49cf363a-927e-4232-acd2-2104649e1e94 req-546571de-7dc9-47f1-913c-f7fe1aa372b5 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422192 Dec 09 22:06:43.389064 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bb88d66-a602-4382-9c69-e953e6457846 req-c01a96b2-dd7a-4ea2-8c77-f9881f613924 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:43.390764 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5bb88d66-a602-4382-9c69-e953e6457846 req-c01a96b2-dd7a-4ea2-8c77-f9881f613924 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0624681 Dec 09 22:06:43.444947 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5bb88d66-a602-4382-9c69-e953e6457846 req-79ae14c4-1d82-47d4-a580-0e5c51e13640 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479403 Dec 09 22:06:44.589979 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b1c4ae4-3888-4e52-9ab7-59db6747e0cb req-4d956727-063a-41bc-bd56-a7b40162d339 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:44.591472 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4b1c4ae4-3888-4e52-9ab7-59db6747e0cb req-4d956727-063a-41bc-bd56-a7b40162d339 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0693641 Dec 09 22:06:44.641065 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4b1c4ae4-3888-4e52-9ab7-59db6747e0cb req-f4583893-6196-46ae-bf9a-a0d56f393d61 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434732 Dec 09 22:06:45.772427 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-868082a9-c40b-4d16-9cae-49a2ed7fa252 req-8830ace3-f322-4a97-8538-f98095292cf8 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:45.773855 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-868082a9-c40b-4d16-9cae-49a2ed7fa252 req-8830ace3-f322-4a97-8538-f98095292cf8 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0549057 Dec 09 22:06:45.826257 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-868082a9-c40b-4d16-9cae-49a2ed7fa252 req-8fe5a99f-6536-45f7-8ca3-1e9aa6d70dca tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460730 Dec 09 22:06:46.968682 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76a6f777-97f6-4e68-b828-605e1533976e req-a55c5bf3-0a40-4ab6-ba28-1447ef3d1a30 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:46.970199 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-76a6f777-97f6-4e68-b828-605e1533976e req-a55c5bf3-0a40-4ab6-ba28-1447ef3d1a30 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0614400 Dec 09 22:06:47.019615 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-76a6f777-97f6-4e68-b828-605e1533976e req-c11d211f-59ba-4879-a3c8-b68040d0fbbb tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432205 Dec 09 22:06:48.165057 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e08e967c-1ddb-4f96-b637-90f28eafb97b req-a9bbccc5-53b8-4699-83bc-f7519819e2c1 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:48.166672 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e08e967c-1ddb-4f96-b637-90f28eafb97b req-a9bbccc5-53b8-4699-83bc-f7519819e2c1 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0636203 Dec 09 22:06:48.222732 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e08e967c-1ddb-4f96-b637-90f28eafb97b req-bbcc1058-62a0-4c7f-9617-34533865604c tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497115 Dec 09 22:06:49.355849 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04aec100-9ec7-4a29-8876-22bf3b1eb35f req-cfbd8513-b183-4b32-947c-b3113df8bec0 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:49.357709 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04aec100-9ec7-4a29-8876-22bf3b1eb35f req-cfbd8513-b183-4b32-947c-b3113df8bec0 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0526776 Dec 09 22:06:49.411104 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-04aec100-9ec7-4a29-8876-22bf3b1eb35f req-b9e46d57-e148-417e-b37e-6f15c45a98f9 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448251 Dec 09 22:06:50.542758 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3765be84-dbac-4edc-803a-893ab1f7dbab req-3adba0c9-25ab-4370-aff9-1f388f10cf32 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:50.544269 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3765be84-dbac-4edc-803a-893ab1f7dbab req-3adba0c9-25ab-4370-aff9-1f388f10cf32 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0579143 Dec 09 22:06:50.594323 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3765be84-dbac-4edc-803a-893ab1f7dbab req-e49e23b2-0f46-4ae3-84f3-e2d82450645a tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412111 Dec 09 22:06:51.726979 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a321340-cc79-4f0a-8b3a-285c606a4e6f req-695275e4-ebba-45f5-87c5-16b2d77ab679 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:51.728483 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4a321340-cc79-4f0a-8b3a-285c606a4e6f req-695275e4-ebba-45f5-87c5-16b2d77ab679 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0561023 Dec 09 22:06:51.776477 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4a321340-cc79-4f0a-8b3a-285c606a4e6f req-d80dcabb-c7e6-4b29-a7ea-0107b98c3d0f tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412025 Dec 09 22:06:52.899855 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dbbca6b-add9-401d-b8bd-05624d38501a req-77ec2473-fff1-4dd3-9cf7-79ea4ff9de0d tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:52.901329 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4dbbca6b-add9-401d-b8bd-05624d38501a req-77ec2473-fff1-4dd3-9cf7-79ea4ff9de0d tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0545936 Dec 09 22:06:52.952750 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4dbbca6b-add9-401d-b8bd-05624d38501a req-8b7f2d8e-9728-45c5-9521-30a2555f53a4 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446758 Dec 09 22:06:54.093650 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ee44bae-5d34-4e0c-a64e-9007291ec71d req-852f9885-277a-4722-b17f-133558d32ab5 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:54.095139 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0ee44bae-5d34-4e0c-a64e-9007291ec71d req-852f9885-277a-4722-b17f-133558d32ab5 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0534875 Dec 09 22:06:54.145746 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0ee44bae-5d34-4e0c-a64e-9007291ec71d req-ed91a152-eae3-4131-ae0f-d64466b0e5d2 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445011 Dec 09 22:06:55.284789 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51f63055-faeb-44a5-b7f3-31652f355298 req-4287f194-718d-430c-9ace-65f9e2d99647 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:55.286275 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51f63055-faeb-44a5-b7f3-31652f355298 req-4287f194-718d-430c-9ace-65f9e2d99647 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0561180 Dec 09 22:06:55.338735 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51f63055-faeb-44a5-b7f3-31652f355298 req-bfedad54-245f-4e2c-b85b-1de8a3cce766 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433402 Dec 09 22:06:56.464875 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98f02928-ddd4-441c-8fb0-759dad3ded20 req-254a140f-35fc-4184-bca1-9ac3174fd484 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:56.466415 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98f02928-ddd4-441c-8fb0-759dad3ded20 req-254a140f-35fc-4184-bca1-9ac3174fd484 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0494866 Dec 09 22:06:56.515043 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98f02928-ddd4-441c-8fb0-759dad3ded20 req-4a5215ea-197f-4cf6-9c0e-592e4e26dfcf tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422802 Dec 09 22:06:57.530738 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:57.637387 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-773808d1-5353-410f-97c8-07f6b70a7d62 req-166ff750-8c0c-4cdc-86bc-f6f7f718cabf tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:57.638959 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-773808d1-5353-410f-97c8-07f6b70a7d62 req-166ff750-8c0c-4cdc-86bc-f6f7f718cabf tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0515015 Dec 09 22:06:57.691310 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-773808d1-5353-410f-97c8-07f6b70a7d62 req-062724d9-43b6-493e-ad11-4e43add02189 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463195 Dec 09 22:06:57.723522 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:06:58.742889 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2034caf9-a4d4-4ce1-9f21-8267d7b36a90 req-58dd4672-2ef3-4d23-a838-817bb9946b5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:58.744499 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2034caf9-a4d4-4ce1-9f21-8267d7b36a90 req-58dd4672-2ef3-4d23-a838-817bb9946b5e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=4e6e98b6ce8149c49f718a22c26736d8&device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 1098 time: 0.0441852 Dec 09 22:06:58.817429 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ddedfa9-0bb9-4962-9bff-d3f4cea7d8f0 req-871825c4-1f92-40f5-ab19-48ca94db148a tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:58.819493 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ddedfa9-0bb9-4962-9bff-d3f4cea7d8f0 req-871825c4-1f92-40f5-ab19-48ca94db148a tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0531614 Dec 09 22:06:58.854258 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2034caf9-a4d4-4ce1-9f21-8267d7b36a90 req-50286ba8-95a9-4451-a118-ce6631a5d216 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:58.855790 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2034caf9-a4d4-4ce1-9f21-8267d7b36a90 req-50286ba8-95a9-4451-a118-ce6631a5d216 service neutron] 10.222.0.31 "GET /v2.0/networks?id=fcd51eae-6fa3-41c8-9622-47a1ed852c66 HTTP/1.1" status: 200 len: 916 time: 0.0913408 Dec 09 22:06:58.868949 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ddedfa9-0bb9-4962-9bff-d3f4cea7d8f0 req-4f2a9fff-2f00-4f66-b2be-3dc748a3c0d4 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420170 Dec 09 22:06:58.898890 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2034caf9-a4d4-4ce1-9f21-8267d7b36a90 req-992217b9-86be-4d41-9a72-1004e4990e78 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=e1c400c1-dab7-4394-9188-b3d61e3129e4 HTTP/1.1" status: 200 len: 217 time: 0.0357525 Dec 09 22:06:58.951098 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2034caf9-a4d4-4ce1-9f21-8267d7b36a90 req-de989dff-1dee-4c38-959e-289654a021eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:58.952635 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2034caf9-a4d4-4ce1-9f21-8267d7b36a90 req-de989dff-1dee-4c38-959e-289654a021eb service neutron] 10.222.0.31 "GET /v2.0/subnets?id=2d05eb0f-5210-4210-a0bf-465840e19241 HTTP/1.1" status: 200 len: 855 time: 0.0464020 Dec 09 22:06:58.986354 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2034caf9-a4d4-4ce1-9f21-8267d7b36a90 req-947c5ba6-8cf3-4db2-956a-62dc56b28e05 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fcd51eae-6fa3-41c8-9622-47a1ed852c66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0260971 Dec 09 22:06:59.100522 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2034caf9-a4d4-4ce1-9f21-8267d7b36a90 req-27650ad7-0ed0-4509-b35e-7cb6c21e4124 service neutron] 10.222.0.31 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1068459 Dec 09 22:06:59.208178 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2034caf9-a4d4-4ce1-9f21-8267d7b36a90 req-3c5136f8-1491-4c29-a5aa-d8c7fb91f206 service neutron] 10.222.0.31 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0995908 Dec 09 22:06:59.992987 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b22ca0d1-ccd6-4594-8625-812de270cdec req-173b3997-9f39-495e-8b06-2eae3f56ee66 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:06:59.994485 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b22ca0d1-ccd6-4594-8625-812de270cdec req-173b3997-9f39-495e-8b06-2eae3f56ee66 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0520768 Dec 09 22:07:00.044434 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b22ca0d1-ccd6-4594-8625-812de270cdec req-ffb4cab6-733f-4952-9d01-3b3e1b595c1a tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433919 Dec 09 22:07:01.170219 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83028ef9-ec65-4edd-aaa6-c87bdc93cfae req-661f8b1f-6344-4322-8e5d-c8dfc02e2de5 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:01.171742 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83028ef9-ec65-4edd-aaa6-c87bdc93cfae req-661f8b1f-6344-4322-8e5d-c8dfc02e2de5 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0543227 Dec 09 22:07:01.226071 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83028ef9-ec65-4edd-aaa6-c87bdc93cfae req-e087d95b-0028-4856-aa23-96e15127620d tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457971 Dec 09 22:07:02.372846 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99f3fd32-aef4-4cc3-a46b-4fdab06b1d8e req-8f74d982-9978-4e87-be61-d02eeb9ebe91 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:02.374347 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99f3fd32-aef4-4cc3-a46b-4fdab06b1d8e req-8f74d982-9978-4e87-be61-d02eeb9ebe91 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0610025 Dec 09 22:07:02.431747 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99f3fd32-aef4-4cc3-a46b-4fdab06b1d8e req-13f92334-03c8-4716-813e-be1d61d7a000 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0509889 Dec 09 22:07:02.996929 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-07bb1a08-e68e-441d-938b-d33317d47cbf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:03.568609 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5714f74e-4678-40cc-a659-862e83a74126 req-f3d463a7-594b-4406-a870-8b7857c5c4ec tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:03.570099 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5714f74e-4678-40cc-a659-862e83a74126 req-f3d463a7-594b-4406-a870-8b7857c5c4ec tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0492876 Dec 09 22:07:03.627560 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5714f74e-4678-40cc-a659-862e83a74126 req-ef46137c-1438-4424-89bd-2f7687250907 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0513802 Dec 09 22:07:03.678180 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-d5733ca7-9f9e-41d6-80b5-c3f66ccbab0c service neutron] show failed (client error): The resource could not be found. Dec 09 22:07:03.679232 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-d5733ca7-9f9e-41d6-80b5-c3f66ccbab0c service neutron] 10.222.0.31 "GET /v2.0/ports/e1c400c1-dab7-4394-9188-b3d61e3129e4/bindings/n-h2-713301-27 HTTP/1.1" status: 404 len: 381 time: 0.0550735 Dec 09 22:07:03.925378 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-b3aceb91-389d-457b-baa3-43a590f5171c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:03.927610 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-b3aceb91-389d-457b-baa3-43a590f5171c service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c&tenant_id=4e6e98b6ce8149c49f718a22c26736d8 HTTP/1.1" status: 200 len: 1098 time: 0.0764544 Dec 09 22:07:03.939689 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Request body: {'port': {'binding:host_id': 'n-h2-713301-27', 'device_owner': 'compute:nova'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:07:03.996400 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:04.204783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] For port e1c400c1-dab7-4394-9188-b3d61e3129e4, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e1c400c1-dab7-4394-9188-b3d61e3129e4,segment=NetworkSegment(bb19ea59-b907-4a2f-a9d7-f47a74902855),segment_id=bb19ea59-b907-4a2f-a9d7-f47a74902855)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:07:04.239280 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] For port e1c400c1-dab7-4394-9188-b3d61e3129e4, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:07:04.287812 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '65714618-af46-4989-96f7-bc4683e29b0c', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e1c400c1-dab7-4394-9188-b3d61e3129e4'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:07:04.290135 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-972eecf1-ee9a-458d-899b-cc8cc9507920" -d '{"events": [{"server_uuid": "65714618-af46-4989-96f7-bc4683e29b0c", "name": "network-vif-unplugged", "status": "completed", "tag": "e1c400c1-dab7-4394-9188-b3d61e3129e4"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:07:04.294268 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:04.307041 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Transition to ACTIVE for port object e1c400c1-dab7-4394-9188-b3d61e3129e4 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:07:04.312178 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:04.340383 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 22:07:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c17c6830-e9b3-416e-a6f4-90abd3c793a0 x-openstack-request-id: req-c17c6830-e9b3-416e-a6f4-90abd3c793a0 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:07:04.340680 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "65714618-af46-4989-96f7-bc4683e29b0c", "name": "network-vif-unplugged", "status": "completed", "tag": "e1c400c1-dab7-4394-9188-b3d61e3129e4", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:07:04.340921 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c17c6830-e9b3-416e-a6f4-90abd3c793a0 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:07:04.341311 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '65714618-af46-4989-96f7-bc4683e29b0c', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e1c400c1-dab7-4394-9188-b3d61e3129e4', 'code': 200} Dec 09 22:07:04.362752 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Pushing event updated for resources: {'Port': ['ID=e1c400c1-dab7-4394-9188-b3d61e3129e4,revision_number=6']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:07:04.381539 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] No DVR routers for this DVR port e1c400c1-dab7-4394-9188-b3d61e3129e4 on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:07:04.389490 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:04.389834 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:04.390169 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:04.390504 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:04.390831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:04.391158 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:04.391524 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:04.391842 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:04.392161 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:04.392484 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:04.392806 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:04.393104 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:04.393420 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:04.426557 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Attempting to bind port e1c400c1-dab7-4394-9188-b3d61e3129e4 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:07:04.426924 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Attempting to bind port e1c400c1-dab7-4394-9188-b3d61e3129e4 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'bb19ea59-b907-4a2f-a9d7-f47a74902855', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'fcd51eae-6fa3-41c8-9622-47a1ed852c66'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:07:04.427251 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Attempting to bind port e1c400c1-dab7-4394-9188-b3d61e3129e4 on network fcd51eae-6fa3-41c8-9622-47a1ed852c66 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:07:04.432003 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Port e1c400c1-dab7-4394-9188-b3d61e3129e4 on network fcd51eae-6fa3-41c8-9622-47a1ed852c66 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:07:04.432317 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Attempting to bind port e1c400c1-dab7-4394-9188-b3d61e3129e4 on network fcd51eae-6fa3-41c8-9622-47a1ed852c66 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:07:04.437384 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 6, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:07:04.437718 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Checking segment: {'id': 'bb19ea59-b907-4a2f-a9d7-f47a74902855', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'fcd51eae-6fa3-41c8-9622-47a1ed852c66'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:07:04.438103 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Bound using segment: {'id': 'bb19ea59-b907-4a2f-a9d7-f47a74902855', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'fcd51eae-6fa3-41c8-9622-47a1ed852c66'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:07:04.438515 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Bound port: e1c400c1-dab7-4394-9188-b3d61e3129e4, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bb19ea59-b907-4a2f-a9d7-f47a74902855', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'fcd51eae-6fa3-41c8-9622-47a1ed852c66'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:07:04.438869 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:04.505209 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] For port e1c400c1-dab7-4394-9188-b3d61e3129e4, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:07:04.508295 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] For port e1c400c1-dab7-4394-9188-b3d61e3129e4, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e1c400c1-dab7-4394-9188-b3d61e3129e4,segment=NetworkSegment(bb19ea59-b907-4a2f-a9d7-f47a74902855),segment_id=bb19ea59-b907-4a2f-a9d7-f47a74902855)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:07:04.516803 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:04.558791 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:04.559521 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:04.561444 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] 10.222.0.10 "PUT /v2.0/ports/e1c400c1-dab7-4394-9188-b3d61e3129e4 HTTP/1.1" status: 200 len: 1093 time: 0.6260242 Dec 09 22:07:04.585186 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5a4a8cb-4557-4931-a5e2-5b91ef312c68 service neutron] Pushing event updated for resources: {'Port': ['ID=e1c400c1-dab7-4394-9188-b3d61e3129e4,revision_number=7']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:07:04.631965 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-6f132d81-5351-46a7-8fa8-4d7157225fda service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:04.633461 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-6f132d81-5351-46a7-8fa8-4d7157225fda service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=4e6e98b6ce8149c49f718a22c26736d8&device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 1096 time: 0.0453463 Dec 09 22:07:04.752039 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-665e2455-a7e5-49ad-8b2f-a07d2463f920 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:04.753552 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-665e2455-a7e5-49ad-8b2f-a07d2463f920 service neutron] 10.222.0.10 "GET /v2.0/networks?id=fcd51eae-6fa3-41c8-9622-47a1ed852c66 HTTP/1.1" status: 200 len: 916 time: 0.1130073 Dec 09 22:07:04.774639 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-129ec7d8-f231-48e2-9193-2a8369c30b35 req-0ed9c4b0-1454-45e5-a355-748e6e89013e tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:04.776336 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-129ec7d8-f231-48e2-9193-2a8369c30b35 req-0ed9c4b0-1454-45e5-a355-748e6e89013e tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 944 time: 0.0731618 Dec 09 22:07:04.810158 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a200d743-26c0-4c07-9e80-57a95cf59ee3 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=e1c400c1-dab7-4394-9188-b3d61e3129e4 HTTP/1.1" status: 200 len: 217 time: 0.0498633 Dec 09 22:07:04.885196 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-129ec7d8-f231-48e2-9193-2a8369c30b35 req-933f52a1-7aea-42e5-8938-c465ce105540 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0774605 Dec 09 22:07:04.886668 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-8ca958cd-443d-47e4-a0ad-29241999df94 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:04.888036 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-8ca958cd-443d-47e4-a0ad-29241999df94 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=2d05eb0f-5210-4210-a0bf-465840e19241 HTTP/1.1" status: 200 len: 855 time: 0.0709260 Dec 09 22:07:04.925241 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-af9ff4fa-535b-4d96-812e-3e8c7baccfc8 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=fcd51eae-6fa3-41c8-9622-47a1ed852c66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0304008 Dec 09 22:07:05.029354 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-853caf43-1938-4bef-9a01-0e96f49202d7 service neutron] 10.222.0.10 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0965543 Dec 09 22:07:05.132892 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d300d37e-07d5-4959-b98b-5cdf663a72af req-a1640a97-4e6a-456d-8360-80c5fc9faa9b service neutron] 10.222.0.10 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0963798 Dec 09 22:07:05.637462 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b85d5f99-4727-4e13-ae73-13bead01199b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:06.020932 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fc6fb88-bbd3-43cd-9d10-33022589a83a req-4bfa84ac-b887-4433-9271-7c634f20ec6d tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:06.022442 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5fc6fb88-bbd3-43cd-9d10-33022589a83a req-4bfa84ac-b887-4433-9271-7c634f20ec6d tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 944 time: 0.0579159 Dec 09 22:07:06.072005 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5fc6fb88-bbd3-43cd-9d10-33022589a83a req-98dd27e8-ac15-4bf8-91df-7b7c32bf111f tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431712 Dec 09 22:07:06.343851 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '65714618-af46-4989-96f7-bc4683e29b0c', 'tag': 'e1c400c1-dab7-4394-9188-b3d61e3129e4'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:07:06.347556 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bfd10ad7-2a6e-4d5f-b1c7-b25471d570ac" -d '{"events": [{"name": "network-changed", "server_uuid": "65714618-af46-4989-96f7-bc4683e29b0c", "tag": "e1c400c1-dab7-4394-9188-b3d61e3129e4"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:07:06.400231 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:07:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-04e6b154-8c78-4d76-bde1-83d27a2ab1e3 x-openstack-request-id: req-04e6b154-8c78-4d76-bde1-83d27a2ab1e3 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:07:06.400537 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "65714618-af46-4989-96f7-bc4683e29b0c", "tag": "e1c400c1-dab7-4394-9188-b3d61e3129e4", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:07:06.400812 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-04e6b154-8c78-4d76-bde1-83d27a2ab1e3 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:07:06.401220 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '65714618-af46-4989-96f7-bc4683e29b0c', 'tag': 'e1c400c1-dab7-4394-9188-b3d61e3129e4', 'status': 'completed', 'code': 200} Dec 09 22:07:06.461333 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfd10ad7-2a6e-4d5f-b1c7-b25471d570ac req-e9134377-d265-497a-8a49-ef8febe24abf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:06.462931 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bfd10ad7-2a6e-4d5f-b1c7-b25471d570ac req-e9134377-d265-497a-8a49-ef8febe24abf service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=4e6e98b6ce8149c49f718a22c26736d8&device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 1096 time: 0.0430408 Dec 09 22:07:06.471353 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfd10ad7-2a6e-4d5f-b1c7-b25471d570ac req-f8ca0ec5-eb78-4b6c-b8cd-ce09179f1c90 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:06.472966 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfd10ad7-2a6e-4d5f-b1c7-b25471d570ac req-f8ca0ec5-eb78-4b6c-b8cd-ce09179f1c90 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=4e6e98b6ce8149c49f718a22c26736d8&device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 1096 time: 0.0450747 Dec 09 22:07:06.565072 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfd10ad7-2a6e-4d5f-b1c7-b25471d570ac req-54d9cac5-49a5-40e1-affc-03c8f657137b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:06.566723 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bfd10ad7-2a6e-4d5f-b1c7-b25471d570ac req-54d9cac5-49a5-40e1-affc-03c8f657137b service neutron] 10.222.0.31 "GET /v2.0/networks?id=fcd51eae-6fa3-41c8-9622-47a1ed852c66 HTTP/1.1" status: 200 len: 916 time: 0.0961831 Dec 09 22:07:06.572037 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfd10ad7-2a6e-4d5f-b1c7-b25471d570ac req-aceb6c2c-6c7a-482a-96da-c534922e239e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:06.573646 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfd10ad7-2a6e-4d5f-b1c7-b25471d570ac req-aceb6c2c-6c7a-482a-96da-c534922e239e service neutron] 10.222.0.10 "GET /v2.0/networks?id=fcd51eae-6fa3-41c8-9622-47a1ed852c66 HTTP/1.1" status: 200 len: 916 time: 0.0931540 Dec 09 22:07:06.610950 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bfd10ad7-2a6e-4d5f-b1c7-b25471d570ac req-01d998b6-e085-446a-b390-4bb534b8d005 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=e1c400c1-dab7-4394-9188-b3d61e3129e4 HTTP/1.1" status: 200 len: 217 time: 0.0373092 Dec 09 22:07:06.622981 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfd10ad7-2a6e-4d5f-b1c7-b25471d570ac req-044f6f2a-15ab-4a59-bdb0-9f298c6ade9f service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=e1c400c1-dab7-4394-9188-b3d61e3129e4 HTTP/1.1" status: 200 len: 217 time: 0.0392265 Dec 09 22:07:06.663956 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfd10ad7-2a6e-4d5f-b1c7-b25471d570ac req-747eb315-8560-4efc-90ee-233cc6b1f428 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:06.665473 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bfd10ad7-2a6e-4d5f-b1c7-b25471d570ac req-747eb315-8560-4efc-90ee-233cc6b1f428 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=2d05eb0f-5210-4210-a0bf-465840e19241 HTTP/1.1" status: 200 len: 855 time: 0.0472596 Dec 09 22:07:06.688178 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfd10ad7-2a6e-4d5f-b1c7-b25471d570ac req-f98dc1eb-8815-413f-a2ba-3f06b9c2dd20 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:06.690967 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfd10ad7-2a6e-4d5f-b1c7-b25471d570ac req-f98dc1eb-8815-413f-a2ba-3f06b9c2dd20 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=2d05eb0f-5210-4210-a0bf-465840e19241 HTTP/1.1" status: 200 len: 855 time: 0.0598681 Dec 09 22:07:06.701162 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bfd10ad7-2a6e-4d5f-b1c7-b25471d570ac req-5c639135-0138-4d0e-b197-2218321c2cba service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fcd51eae-6fa3-41c8-9622-47a1ed852c66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0282731 Dec 09 22:07:06.726781 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfd10ad7-2a6e-4d5f-b1c7-b25471d570ac req-5b728ab8-1f02-40a4-8892-80da3c8a53ff service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=fcd51eae-6fa3-41c8-9622-47a1ed852c66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0287495 Dec 09 22:07:06.782865 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:06.800276 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bfd10ad7-2a6e-4d5f-b1c7-b25471d570ac req-2d56d9f7-049e-471e-be8f-a4fd286a9cde service neutron] 10.222.0.31 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0918775 Dec 09 22:07:06.828276 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfd10ad7-2a6e-4d5f-b1c7-b25471d570ac req-14ad6bbf-773f-4b54-b9d9-4b97b927b381 service neutron] 10.222.0.10 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0939550 Dec 09 22:07:06.896838 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bfd10ad7-2a6e-4d5f-b1c7-b25471d570ac req-61c4d8db-ad58-413e-80e0-32e6d24b55d3 service neutron] 10.222.0.31 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0890121 Dec 09 22:07:06.921708 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfd10ad7-2a6e-4d5f-b1c7-b25471d570ac req-7e194a11-9824-4487-86db-5219136a976a service neutron] 10.222.0.10 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0867462 Dec 09 22:07:07.205575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ccdfce9-58c9-402c-8436-f4b8bb100f5d req-0d25a28a-f6ba-40a8-8d02-c36d53441f37 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:07.206982 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ccdfce9-58c9-402c-8436-f4b8bb100f5d req-0d25a28a-f6ba-40a8-8d02-c36d53441f37 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 944 time: 0.0560007 Dec 09 22:07:07.260286 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ccdfce9-58c9-402c-8436-f4b8bb100f5d req-213b4901-dc71-4a00-9f43-b17dd15cdc08 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0472701 Dec 09 22:07:07.473118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc43c2bf-89e8-491e-9504-aed8bd2e2ee4 req-9d95df3e-3e56-4695-a9a3-507452683d11 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:07.475937 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc43c2bf-89e8-491e-9504-aed8bd2e2ee4 req-9d95df3e-3e56-4695-a9a3-507452683d11 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 944 time: 0.0538247 Dec 09 22:07:07.516449 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7736fc8-48ed-4041-bd76-da4c677fa36d req-034d6c64-2804-47a6-b591-7f029c27e6f7 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:07.517962 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a7736fc8-48ed-4041-bd76-da4c677fa36d req-034d6c64-2804-47a6-b591-7f029c27e6f7 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.31 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c&tenant_id=4e6e98b6ce8149c49f718a22c26736d8&binding%3Ahost_id=n-h2-713301-27 HTTP/1.1" status: 200 len: 944 time: 0.0873780 Dec 09 22:07:07.532650 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc43c2bf-89e8-491e-9504-aed8bd2e2ee4 req-6a05523a-29de-456e-bcdd-7eca60880430 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517011 Dec 09 22:07:07.586372 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [req-a7736fc8-48ed-4041-bd76-da4c677fa36d req-389fe0e5-a939-4420-83da-a2b5c2b53cbb service neutron] delete failed (client error): The resource could not be found. Dec 09 22:07:07.587399 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a7736fc8-48ed-4041-bd76-da4c677fa36d req-389fe0e5-a939-4420-83da-a2b5c2b53cbb service neutron] 10.222.0.31 "DELETE /v2.0/ports/e1c400c1-dab7-4394-9188-b3d61e3129e4/bindings/n-h1-713301-27 HTTP/1.1" status: 404 len: 381 time: 0.0619941 Dec 09 22:07:07.661473 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e1c400c1-dab7-4394-9188-b3d61e3129e4 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:07:07.680230 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7736fc8-48ed-4041-bd76-da4c677fa36d req-dd2c7e15-6681-4f85-8512-8336d3a8e28a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:07.681808 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a7736fc8-48ed-4041-bd76-da4c677fa36d req-dd2c7e15-6681-4f85-8512-8336d3a8e28a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=4e6e98b6ce8149c49f718a22c26736d8&device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 1096 time: 0.0476079 Dec 09 22:07:07.701481 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e1c400c1-dab7-4394-9188-b3d61e3129e4 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:07:07.771459 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7736fc8-48ed-4041-bd76-da4c677fa36d req-f0145bc1-8db2-4ce2-9481-7c28b306f0ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:07.772895 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a7736fc8-48ed-4041-bd76-da4c677fa36d req-f0145bc1-8db2-4ce2-9481-7c28b306f0ad service neutron] 10.222.0.31 "GET /v2.0/networks?id=fcd51eae-6fa3-41c8-9622-47a1ed852c66 HTTP/1.1" status: 200 len: 916 time: 0.0841162 Dec 09 22:07:07.819061 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a7736fc8-48ed-4041-bd76-da4c677fa36d req-05b51701-579d-436a-9079-0132700d41bd service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=e1c400c1-dab7-4394-9188-b3d61e3129e4 HTTP/1.1" status: 200 len: 217 time: 0.0388634 Dec 09 22:07:07.869787 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7736fc8-48ed-4041-bd76-da4c677fa36d req-44585ac8-3852-4272-b46e-2160c2ef2c5e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:07.871290 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a7736fc8-48ed-4041-bd76-da4c677fa36d req-44585ac8-3852-4272-b46e-2160c2ef2c5e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=2d05eb0f-5210-4210-a0bf-465840e19241 HTTP/1.1" status: 200 len: 855 time: 0.0457590 Dec 09 22:07:07.904737 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a7736fc8-48ed-4041-bd76-da4c677fa36d req-1d80713e-f0b7-4fbe-a004-ab39fa359d92 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fcd51eae-6fa3-41c8-9622-47a1ed852c66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0255072 Dec 09 22:07:07.954969 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e1c400c1-dab7-4394-9188-b3d61e3129e4 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:07:07.998316 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a7736fc8-48ed-4041-bd76-da4c677fa36d req-8a9a0f71-ff2a-473b-b6c2-2f38b7ec7e59 service neutron] 10.222.0.31 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860205 Dec 09 22:07:08.096113 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a7736fc8-48ed-4041-bd76-da4c677fa36d req-9aa73389-8c58-446f-a7a8-1386a345349c service neutron] 10.222.0.31 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0910251 Dec 09 22:07:08.227731 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:08.239137 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port e1c400c1-dab7-4394-9188-b3d61e3129e4, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e1c400c1-dab7-4394-9188-b3d61e3129e4,segment=NetworkSegment(bb19ea59-b907-4a2f-a9d7-f47a74902855),segment_id=bb19ea59-b907-4a2f-a9d7-f47a74902855)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:07:08.249967 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'e1c400c1-dab7-4394-9188-b3d61e3129e4', 'network_id': 'fcd51eae-6fa3-41c8-9622-47a1ed852c66', 'port_id': 'e1c400c1-dab7-4394-9188-b3d61e3129e4', 'mac_address': 'fa:16:3e:9b:05:f0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 136, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2d05eb0f-5210-4210-a0bf-465840e19241', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:07:08.286878 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:08.299839 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e1c400c1-dab7-4394-9188-b3d61e3129e4 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:07:08.319820 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port e1c400c1-dab7-4394-9188-b3d61e3129e4, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e1c400c1-dab7-4394-9188-b3d61e3129e4,segment=NetworkSegment(bb19ea59-b907-4a2f-a9d7-f47a74902855),segment_id=bb19ea59-b907-4a2f-a9d7-f47a74902855)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:07:08.326536 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:08.379961 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=e1c400c1-dab7-4394-9188-b3d61e3129e4,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:07:08.539723 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['e1c400c1-dab7-4394-9188-b3d61e3129e4'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:07:08.661622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9c2b792-4d3d-4df8-bdbc-33f93ae3a4e3 req-d572a257-40ca-4196-b0be-7df1881ca759 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:08.669339 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d9c2b792-4d3d-4df8-bdbc-33f93ae3a4e3 req-d572a257-40ca-4196-b0be-7df1881ca759 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 945 time: 0.0606022 Dec 09 22:07:08.717171 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d9c2b792-4d3d-4df8-bdbc-33f93ae3a4e3 req-3ee27b13-a5f6-4219-af6e-363b0e9f9ee6 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469162 Dec 09 22:07:08.837652 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57620b1c-84c0-4131-9cd1-c9da3a5bb82a req-4e728c09-d144-4d2f-8da8-d3da24618a66 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:08.839150 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-57620b1c-84c0-4131-9cd1-c9da3a5bb82a req-4e728c09-d144-4d2f-8da8-d3da24618a66 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 945 time: 0.0497158 Dec 09 22:07:08.898702 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-57620b1c-84c0-4131-9cd1-c9da3a5bb82a req-04f77dc3-807b-4592-a7f6-b2c4d81254d0 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0531039 Dec 09 22:07:09.025008 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfde469a-7d61-45c1-8e6d-4e3668996336 req-15a803e9-09ba-4802-a436-08685dac651d tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:09.026451 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dfde469a-7d61-45c1-8e6d-4e3668996336 req-15a803e9-09ba-4802-a436-08685dac651d tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 945 time: 0.0599947 Dec 09 22:07:09.091474 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dfde469a-7d61-45c1-8e6d-4e3668996336 req-5dbec118-369c-4b43-8815-e09a49a47a4e tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0564332 Dec 09 22:07:09.464588 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-1daa1a64-9533-443c-bb4f-fc1e59f709eb tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:09.466061 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-1daa1a64-9533-443c-bb4f-fc1e59f709eb tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/networks?id=fcd51eae-6fa3-41c8-9622-47a1ed852c66 HTTP/1.1" status: 200 len: 815 time: 0.1167653 Dec 09 22:07:09.480828 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-d3e1b606-0022-4813-b67b-31c3cd4295ec tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/quotas/4e6e98b6ce8149c49f718a22c26736d8 HTTP/1.1" status: 200 len: 375 time: 0.0088255 Dec 09 22:07:09.534515 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-cc4980b8-c2b0-41d7-bc34-2f0297c03f5c tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=4e6e98b6ce8149c49f718a22c26736d8&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0474634 Dec 09 22:07:09.628976 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-52d71a37-b429-499b-9ffd-fac020b4f173 service neutron] 10.222.0.13 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0872977 Dec 09 22:07:09.662118 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:09.727147 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-83bd0f50-7776-4e90-8e8d-534c12635c87 service neutron] 10.222.0.13 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0890684 Dec 09 22:07:09.889189 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e45ed9a-a6d5-44d9-a437-cb559318bdb4 req-4aa80f11-8d8b-4a73-81fa-cb4eb4a070e1 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 210 time: 0.0272744 Dec 09 22:07:09.964028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e1c400c1-dab7-4394-9188-b3d61e3129e4 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:07:10.014800 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port e1c400c1-dab7-4394-9188-b3d61e3129e4 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:07:10.019765 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port e1c400c1-dab7-4394-9188-b3d61e3129e4 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:07:10.020150 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:10.104498 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:10.128544 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '65714618-af46-4989-96f7-bc4683e29b0c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e1c400c1-dab7-4394-9188-b3d61e3129e4'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:07:10.130806 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fa7f8657-e1bc-4493-8c8a-3952e2cb90e4" -d '{"events": [{"server_uuid": "65714618-af46-4989-96f7-bc4683e29b0c", "name": "network-vif-plugged", "status": "completed", "tag": "e1c400c1-dab7-4394-9188-b3d61e3129e4"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:07:10.146374 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port e1c400c1-dab7-4394-9188-b3d61e3129e4, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e1c400c1-dab7-4394-9188-b3d61e3129e4,segment=NetworkSegment(bb19ea59-b907-4a2f-a9d7-f47a74902855),segment_id=bb19ea59-b907-4a2f-a9d7-f47a74902855)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:07:10.151456 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:10.186618 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:07:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ac48e326-0396-4cf2-b9a0-6c0d1b49a94c x-openstack-request-id: req-ac48e326-0396-4cf2-b9a0-6c0d1b49a94c {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:07:10.187252 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "65714618-af46-4989-96f7-bc4683e29b0c", "name": "network-vif-plugged", "status": "completed", "tag": "e1c400c1-dab7-4394-9188-b3d61e3129e4", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:07:10.187763 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-ac48e326-0396-4cf2-b9a0-6c0d1b49a94c {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:07:10.188142 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '65714618-af46-4989-96f7-bc4683e29b0c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e1c400c1-dab7-4394-9188-b3d61e3129e4', 'code': 200} Dec 09 22:07:10.205407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=e1c400c1-dab7-4394-9188-b3d61e3129e4,revision_number=9']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:07:10.556643 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d201df5f-88bf-434c-9754-2ec997e306ba req-af860f73-2840-4c19-b07e-6cbf39fc5d59 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:10.558117 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d201df5f-88bf-434c-9754-2ec997e306ba req-af860f73-2840-4c19-b07e-6cbf39fc5d59 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.10 "GET /v2.0/ports?device_id=65714618-af46-4989-96f7-bc4683e29b0c HTTP/1.1" status: 200 len: 946 time: 0.0557585 Dec 09 22:07:10.651962 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-d201df5f-88bf-434c-9754-2ec997e306ba req-704c2983-b6ae-413c-b177-4bf0d29c0bc5 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Deleting port e1c400c1-dab7-4394-9188-b3d61e3129e4 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:07:10.652279 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d201df5f-88bf-434c-9754-2ec997e306ba req-704c2983-b6ae-413c-b177-4bf0d29c0bc5 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:10.745914 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-d201df5f-88bf-434c-9754-2ec997e306ba req-704c2983-b6ae-413c-b177-4bf0d29c0bc5 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] For port e1c400c1-dab7-4394-9188-b3d61e3129e4, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e1c400c1-dab7-4394-9188-b3d61e3129e4,segment=NetworkSegment(bb19ea59-b907-4a2f-a9d7-f47a74902855),segment_id=bb19ea59-b907-4a2f-a9d7-f47a74902855)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:07:10.746583 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d201df5f-88bf-434c-9754-2ec997e306ba req-704c2983-b6ae-413c-b177-4bf0d29c0bc5 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:10.759367 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-d201df5f-88bf-434c-9754-2ec997e306ba req-704c2983-b6ae-413c-b177-4bf0d29c0bc5 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Calling delete_port for e1c400c1-dab7-4394-9188-b3d61e3129e4 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:07:10.832873 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.10', 64137) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:07:10.894465 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d201df5f-88bf-434c-9754-2ec997e306ba req-704c2983-b6ae-413c-b177-4bf0d29c0bc5 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:10.910649 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['e1c400c1-dab7-4394-9188-b3d61e3129e4'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:07:10.926488 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-704c2983-b6ae-413c-b177-4bf0d29c0bc5 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Pushing event deleted for resources: {'Port': ['ID=e1c400c1-dab7-4394-9188-b3d61e3129e4,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:07:10.962514 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-84cd7726-7886-4b56-8316-8a642f38ac3c tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:10.964356 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-84cd7726-7886-4b56-8316-8a642f38ac3c tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.10 "GET /v2.0/networks?id=fcd51eae-6fa3-41c8-9622-47a1ed852c66 HTTP/1.1" status: 200 len: 815 time: 0.1300232 Dec 09 22:07:10.979094 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-6d0124f2-d063-4dfe-b0d1-20323d069806 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Request body: {'port': {'device_id': '511cdfd7-3413-4420-8290-90169e7ba169', 'network_id': 'fcd51eae-6fa3-41c8-9622-47a1ed852c66', 'admin_state_up': True, 'tenant_id': '4e6e98b6ce8149c49f718a22c26736d8'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:07:11.098002 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-6d0124f2-d063-4dfe-b0d1-20323d069806 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Made reservation on behalf of 4e6e98b6ce8149c49f718a22c26736d8 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:07:11.101606 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-6d0124f2-d063-4dfe-b0d1-20323d069806 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:11.209403 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:07:11.236450 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-6d0124f2-d063-4dfe-b0d1-20323d069806 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Allocated IP 172.20.0.14 (fcd51eae-6fa3-41c8-9622-47a1ed852c66/2d05eb0f-5210-4210-a0bf-465840e19241/0b27d59f-1b96-4f39-ab74-4dde82deb244) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:07:11.271148 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-d201df5f-88bf-434c-9754-2ec997e306ba req-704c2983-b6ae-413c-b177-4bf0d29c0bc5 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] No DVR routers for this DVR port e1c400c1-dab7-4394-9188-b3d61e3129e4 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:07:11.281448 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d201df5f-88bf-434c-9754-2ec997e306ba req-704c2983-b6ae-413c-b177-4bf0d29c0bc5 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:11.284668 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d201df5f-88bf-434c-9754-2ec997e306ba req-704c2983-b6ae-413c-b177-4bf0d29c0bc5 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.10 "DELETE /v2.0/ports/e1c400c1-dab7-4394-9188-b3d61e3129e4 HTTP/1.1" status: 204 len: 173 time: 0.7199345 Dec 09 22:07:11.285111 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '65714618-af46-4989-96f7-bc4683e29b0c', 'name': 'network-vif-deleted', 'tag': 'e1c400c1-dab7-4394-9188-b3d61e3129e4'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:07:11.287311 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c4673ddb-b577-4b33-bbca-dd2ada03c05d" -d '{"events": [{"server_uuid": "65714618-af46-4989-96f7-bc4683e29b0c", "name": "network-vif-deleted", "tag": "e1c400c1-dab7-4394-9188-b3d61e3129e4"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:07:11.304302 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0eb459b1-96d1-45f8-9f54-4b5f2969c17a req-e8c8a6a0-c73e-4ca8-9e82-402d4ce127d4 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 210 time: 0.0344837 Dec 09 22:07:11.365558 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:07:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-db236575-c68a-4dc8-9e6a-87176de0a6fb x-openstack-request-id: req-db236575-c68a-4dc8-9e6a-87176de0a6fb {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:07:11.365875 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "65714618-af46-4989-96f7-bc4683e29b0c", "name": "network-vif-deleted", "tag": "e1c400c1-dab7-4394-9188-b3d61e3129e4", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:07:11.366135 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-db236575-c68a-4dc8-9e6a-87176de0a6fb {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:07:11.366525 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '65714618-af46-4989-96f7-bc4683e29b0c', 'name': 'network-vif-deleted', 'tag': 'e1c400c1-dab7-4394-9188-b3d61e3129e4', 'status': 'completed', 'code': 200} Dec 09 22:07:11.404958 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-6d0124f2-d063-4dfe-b0d1-20323d069806 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:11.438600 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-6d0124f2-d063-4dfe-b0d1-20323d069806 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:11.450371 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['e1c400c1-dab7-4394-9188-b3d61e3129e4'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:07:11.482191 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-6d0124f2-d063-4dfe-b0d1-20323d069806 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Network fcd51eae-6fa3-41c8-9622-47a1ed852c66 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:07:11.485387 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-6d0124f2-d063-4dfe-b0d1-20323d069806 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:07:11.491352 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-6d0124f2-d063-4dfe-b0d1-20323d069806 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:07:11.498093 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d0124f2-d063-4dfe-b0d1-20323d069806 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Pushing event updated for resources: {'Port': ['ID=0b27d59f-1b96-4f39-ab74-4dde82deb244,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:07:11.544249 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-6d0124f2-d063-4dfe-b0d1-20323d069806 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:11.544879 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-6d0124f2-d063-4dfe-b0d1-20323d069806 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:11.562424 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-6d0124f2-d063-4dfe-b0d1-20323d069806 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5875778 Dec 09 22:07:11.575179 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-ef9035c5-d278-4003-ae44-fd7b96813701 service neutron] Request body: {'port': {'device_id': '511cdfd7-3413-4420-8290-90169e7ba169', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:07:11.632248 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-ef9035c5-d278-4003-ae44-fd7b96813701 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:11.894190 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-ef9035c5-d278-4003-ae44-fd7b96813701 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0b27d59f-1b96-4f39-ab74-4dde82deb244 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:07:11.901676 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-ef9035c5-d278-4003-ae44-fd7b96813701 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:11.914104 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-ef9035c5-d278-4003-ae44-fd7b96813701 service neutron] Transition to ACTIVE for port object 0b27d59f-1b96-4f39-ab74-4dde82deb244 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:07:11.921670 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-ef9035c5-d278-4003-ae44-fd7b96813701 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:11.969213 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef9035c5-d278-4003-ae44-fd7b96813701 service neutron] Pushing event updated for resources: {'Port': ['ID=0b27d59f-1b96-4f39-ab74-4dde82deb244,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:07:12.043793 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-ef9035c5-d278-4003-ae44-fd7b96813701 service neutron] Attempting to bind port 0b27d59f-1b96-4f39-ab74-4dde82deb244 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:07:12.044131 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-ef9035c5-d278-4003-ae44-fd7b96813701 service neutron] Attempting to bind port 0b27d59f-1b96-4f39-ab74-4dde82deb244 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'bb19ea59-b907-4a2f-a9d7-f47a74902855', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'fcd51eae-6fa3-41c8-9622-47a1ed852c66'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:07:12.044466 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-ef9035c5-d278-4003-ae44-fd7b96813701 service neutron] Attempting to bind port 0b27d59f-1b96-4f39-ab74-4dde82deb244 on network fcd51eae-6fa3-41c8-9622-47a1ed852c66 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:07:12.049507 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-ef9035c5-d278-4003-ae44-fd7b96813701 service neutron] Port 0b27d59f-1b96-4f39-ab74-4dde82deb244 on network fcd51eae-6fa3-41c8-9622-47a1ed852c66 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:07:12.049835 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-ef9035c5-d278-4003-ae44-fd7b96813701 service neutron] Attempting to bind port 0b27d59f-1b96-4f39-ab74-4dde82deb244 on network fcd51eae-6fa3-41c8-9622-47a1ed852c66 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:07:12.054731 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-ef9035c5-d278-4003-ae44-fd7b96813701 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 6, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:07:12.055071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-ef9035c5-d278-4003-ae44-fd7b96813701 service neutron] Checking segment: {'id': 'bb19ea59-b907-4a2f-a9d7-f47a74902855', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'fcd51eae-6fa3-41c8-9622-47a1ed852c66'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:07:12.055488 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-ef9035c5-d278-4003-ae44-fd7b96813701 service neutron] Bound using segment: {'id': 'bb19ea59-b907-4a2f-a9d7-f47a74902855', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'fcd51eae-6fa3-41c8-9622-47a1ed852c66'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:07:12.055939 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-ef9035c5-d278-4003-ae44-fd7b96813701 service neutron] Bound port: 0b27d59f-1b96-4f39-ab74-4dde82deb244, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bb19ea59-b907-4a2f-a9d7-f47a74902855', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'fcd51eae-6fa3-41c8-9622-47a1ed852c66'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:07:12.056289 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-ef9035c5-d278-4003-ae44-fd7b96813701 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:12.121213 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-ef9035c5-d278-4003-ae44-fd7b96813701 service neutron] For port 0b27d59f-1b96-4f39-ab74-4dde82deb244, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:07:12.124510 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-ef9035c5-d278-4003-ae44-fd7b96813701 service neutron] For port 0b27d59f-1b96-4f39-ab74-4dde82deb244, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=0b27d59f-1b96-4f39-ab74-4dde82deb244,segment=NetworkSegment(bb19ea59-b907-4a2f-a9d7-f47a74902855),segment_id=bb19ea59-b907-4a2f-a9d7-f47a74902855)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:07:12.132097 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-ef9035c5-d278-4003-ae44-fd7b96813701 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:12.166400 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-ef9035c5-d278-4003-ae44-fd7b96813701 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:12.167066 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-ef9035c5-d278-4003-ae44-fd7b96813701 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:12.168523 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-ef9035c5-d278-4003-ae44-fd7b96813701 service neutron] 10.222.0.10 "PUT /v2.0/ports/0b27d59f-1b96-4f39-ab74-4dde82deb244 HTTP/1.1" status: 200 len: 1093 time: 0.5973780 Dec 09 22:07:12.168959 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '511cdfd7-3413-4420-8290-90169e7ba169', 'tag': '0b27d59f-1b96-4f39-ab74-4dde82deb244'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:07:12.171205 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b06a9a9b-520d-4912-afae-a758dd099b4a" -d '{"events": [{"name": "network-changed", "server_uuid": "511cdfd7-3413-4420-8290-90169e7ba169", "tag": "0b27d59f-1b96-4f39-ab74-4dde82deb244"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:07:12.193660 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef9035c5-d278-4003-ae44-fd7b96813701 service neutron] Pushing event updated for resources: {'Port': ['ID=0b27d59f-1b96-4f39-ab74-4dde82deb244,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:07:12.221422 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:07:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c22e5ea2-06a1-49e1-8f84-8e2f686259bb x-openstack-request-id: req-c22e5ea2-06a1-49e1-8f84-8e2f686259bb {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:07:12.221696 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "511cdfd7-3413-4420-8290-90169e7ba169", "tag": "0b27d59f-1b96-4f39-ab74-4dde82deb244", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:07:12.221941 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c22e5ea2-06a1-49e1-8f84-8e2f686259bb {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:07:12.222357 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '511cdfd7-3413-4420-8290-90169e7ba169', 'tag': '0b27d59f-1b96-4f39-ab74-4dde82deb244', 'status': 'completed', 'code': 200} Dec 09 22:07:12.257095 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-196601c5-7fb4-4c8b-ad2a-8233232f57a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:12.258635 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-196601c5-7fb4-4c8b-ad2a-8233232f57a0 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=4e6e98b6ce8149c49f718a22c26736d8&device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 1096 time: 0.0482349 Dec 09 22:07:12.302308 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-699ea5fa-1f8a-4435-8bdb-94a92328ac7a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0b27d59f-1b96-4f39-ab74-4dde82deb244 HTTP/1.1" status: 200 len: 217 time: 0.0355701 Dec 09 22:07:12.356062 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-1853c2da-9ec9-4775-bffd-648a744b75d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:12.357961 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-1853c2da-9ec9-4775-bffd-648a744b75d7 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=2d05eb0f-5210-4210-a0bf-465840e19241 HTTP/1.1" status: 200 len: 855 time: 0.0492444 Dec 09 22:07:12.392822 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-b6397cfa-57aa-4a18-a9b6-28e849cb9041 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=fcd51eae-6fa3-41c8-9622-47a1ed852c66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0278468 Dec 09 22:07:12.439110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b916257d-e200-409c-b523-01175c4a53c9 req-2fef85ea-b256-4cf9-95ee-046538ae4f74 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:12.441358 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b916257d-e200-409c-b523-01175c4a53c9 req-2fef85ea-b256-4cf9-95ee-046538ae4f74 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 944 time: 0.0556490 Dec 09 22:07:12.492195 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b916257d-e200-409c-b523-01175c4a53c9 req-b1a41f9a-9674-4fad-be9c-493e976fad41 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443816 Dec 09 22:07:12.493128 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-8d6772c1-1d6a-4aea-bc90-d02b477aeea6 service neutron] 10.222.0.10 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0924568 Dec 09 22:07:12.937322 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f4605d6f-58fb-4ac5-917f-fdec930d8fa9 req-b5ddcfae-f87d-4686-9c1f-b93bf6c82c87 service neutron] 10.222.0.10 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4367411 Dec 09 22:07:13.036123 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b06a9a9b-520d-4912-afae-a758dd099b4a req-337815d0-6574-4c95-b502-6042b3c2bd28 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:13.037634 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b06a9a9b-520d-4912-afae-a758dd099b4a req-337815d0-6574-4c95-b502-6042b3c2bd28 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=4e6e98b6ce8149c49f718a22c26736d8&device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 1096 time: 0.0449932 Dec 09 22:07:13.132492 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b06a9a9b-520d-4912-afae-a758dd099b4a req-bcffc4d2-8862-4416-9170-ad0dbd071fae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:13.133914 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b06a9a9b-520d-4912-afae-a758dd099b4a req-bcffc4d2-8862-4416-9170-ad0dbd071fae service neutron] 10.222.0.10 "GET /v2.0/networks?id=fcd51eae-6fa3-41c8-9622-47a1ed852c66 HTTP/1.1" status: 200 len: 916 time: 0.0886817 Dec 09 22:07:13.179639 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b06a9a9b-520d-4912-afae-a758dd099b4a req-c21480d9-5c81-487d-9798-57ae91f2e21b service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0b27d59f-1b96-4f39-ab74-4dde82deb244 HTTP/1.1" status: 200 len: 217 time: 0.0379403 Dec 09 22:07:13.236942 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b06a9a9b-520d-4912-afae-a758dd099b4a req-f393fa47-6af5-422c-a427-4589981ee77b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:13.238401 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b06a9a9b-520d-4912-afae-a758dd099b4a req-f393fa47-6af5-422c-a427-4589981ee77b service neutron] 10.222.0.10 "GET /v2.0/subnets?id=2d05eb0f-5210-4210-a0bf-465840e19241 HTTP/1.1" status: 200 len: 855 time: 0.0505335 Dec 09 22:07:13.270831 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b06a9a9b-520d-4912-afae-a758dd099b4a req-2e62b912-6c33-4ae7-a2e6-103bbebd1ee6 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=fcd51eae-6fa3-41c8-9622-47a1ed852c66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0248899 Dec 09 22:07:13.364129 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b06a9a9b-520d-4912-afae-a758dd099b4a req-5230a96e-67fb-456b-b03d-666b5e7e478f service neutron] 10.222.0.10 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860331 Dec 09 22:07:13.452362 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-b06a9a9b-520d-4912-afae-a758dd099b4a req-34e4144e-bfd7-4f3b-928e-ab75550c6bf1 service neutron] 10.222.0.10 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0804579 Dec 09 22:07:13.617181 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d7d8e2-04af-4cd4-b5f5-748f7913025a req-347c654e-94d9-4f5d-8a61-49e904c25d76 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:13.618665 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9d7d8e2-04af-4cd4-b5f5-748f7913025a req-347c654e-94d9-4f5d-8a61-49e904c25d76 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 944 time: 0.0516059 Dec 09 22:07:13.665622 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9d7d8e2-04af-4cd4-b5f5-748f7913025a req-ac1dfb59-88de-4753-87bf-d2965d4e82e9 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407815 Dec 09 22:07:13.994691 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e1c400c1-dab7-4394-9188-b3d61e3129e4 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:07:14.023710 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: e1c400c1-dab7-4394-9188-b3d61e3129e4 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:07:14.024057 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e1c400c1-dab7-4394-9188-b3d61e3129e4 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:07:14.808202 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44befdcb-d388-4af9-b7c9-4406c600d6af req-fe7534b3-b08a-43fa-8dcc-490b24b346d1 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:14.809689 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44befdcb-d388-4af9-b7c9-4406c600d6af req-fe7534b3-b08a-43fa-8dcc-490b24b346d1 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 944 time: 0.0682006 Dec 09 22:07:14.868405 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-44befdcb-d388-4af9-b7c9-4406c600d6af req-bea18da2-44db-4a5b-bd0a-953ada4aa38f tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502274 Dec 09 22:07:15.994411 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46616245-3a8e-4fc9-8304-a44da9c7268e req-85f95f0b-4659-49cb-8443-857b2040f746 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:15.995904 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46616245-3a8e-4fc9-8304-a44da9c7268e req-85f95f0b-4659-49cb-8443-857b2040f746 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 944 time: 0.0491505 Dec 09 22:07:16.007804 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 0b27d59f-1b96-4f39-ab74-4dde82deb244 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:07:16.049163 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46616245-3a8e-4fc9-8304-a44da9c7268e req-155d9979-3e84-4327-9127-bcb0f5d936fd tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471907 Dec 09 22:07:16.105890 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 0b27d59f-1b96-4f39-ab74-4dde82deb244, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=0b27d59f-1b96-4f39-ab74-4dde82deb244,segment=NetworkSegment(bb19ea59-b907-4a2f-a9d7-f47a74902855),segment_id=bb19ea59-b907-4a2f-a9d7-f47a74902855)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:07:16.117275 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '0b27d59f-1b96-4f39-ab74-4dde82deb244', 'network_id': 'fcd51eae-6fa3-41c8-9622-47a1ed852c66', 'port_id': '0b27d59f-1b96-4f39-ab74-4dde82deb244', 'mac_address': 'fa:16:3e:4e:72:03', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 136, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2d05eb0f-5210-4210-a0bf-465840e19241', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:07:16.153504 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:16.166175 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0b27d59f-1b96-4f39-ab74-4dde82deb244 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:07:16.185515 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 0b27d59f-1b96-4f39-ab74-4dde82deb244, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=0b27d59f-1b96-4f39-ab74-4dde82deb244,segment=NetworkSegment(bb19ea59-b907-4a2f-a9d7-f47a74902855),segment_id=bb19ea59-b907-4a2f-a9d7-f47a74902855)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:07:16.190753 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:16.241108 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=0b27d59f-1b96-4f39-ab74-4dde82deb244,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:07:16.375521 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['0b27d59f-1b96-4f39-ab74-4dde82deb244'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:07:17.187228 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78409268-8708-4fb9-834e-1769b83ae6d4 req-c9dedbdb-6f1c-4bb8-8e4e-ea8b4198140a tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:17.189131 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78409268-8708-4fb9-834e-1769b83ae6d4 req-c9dedbdb-6f1c-4bb8-8e4e-ea8b4198140a tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 945 time: 0.0583220 Dec 09 22:07:17.236688 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78409268-8708-4fb9-834e-1769b83ae6d4 req-cc94f42c-2932-4ab2-a281-8c1846cdec1e tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414536 Dec 09 22:07:18.031416 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 0b27d59f-1b96-4f39-ab74-4dde82deb244 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:07:18.086467 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 0b27d59f-1b96-4f39-ab74-4dde82deb244 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:07:18.091938 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 0b27d59f-1b96-4f39-ab74-4dde82deb244 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:07:18.092485 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:18.172342 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:18.195598 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '511cdfd7-3413-4420-8290-90169e7ba169', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0b27d59f-1b96-4f39-ab74-4dde82deb244'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:07:18.197831 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-43ccc24f-8f6d-4efd-9fe5-27790b4da49f" -d '{"events": [{"server_uuid": "511cdfd7-3413-4420-8290-90169e7ba169", "name": "network-vif-plugged", "status": "completed", "tag": "0b27d59f-1b96-4f39-ab74-4dde82deb244"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:07:18.210381 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 0b27d59f-1b96-4f39-ab74-4dde82deb244, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=0b27d59f-1b96-4f39-ab74-4dde82deb244,segment=NetworkSegment(bb19ea59-b907-4a2f-a9d7-f47a74902855),segment_id=bb19ea59-b907-4a2f-a9d7-f47a74902855)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:07:18.216561 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:18.245077 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:07:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0b8c49e9-237e-492c-9d86-d14b9620f0d6 x-openstack-request-id: req-0b8c49e9-237e-492c-9d86-d14b9620f0d6 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:07:18.245367 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "511cdfd7-3413-4420-8290-90169e7ba169", "name": "network-vif-plugged", "status": "completed", "tag": "0b27d59f-1b96-4f39-ab74-4dde82deb244", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:07:18.245613 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0b8c49e9-237e-492c-9d86-d14b9620f0d6 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:07:18.245982 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '511cdfd7-3413-4420-8290-90169e7ba169', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0b27d59f-1b96-4f39-ab74-4dde82deb244', 'code': 200} Dec 09 22:07:18.273280 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=0b27d59f-1b96-4f39-ab74-4dde82deb244,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:07:18.280925 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:18.281326 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:18.281891 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:18.282303 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:18.283155 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:18.283155 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:18.283506 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:18.283812 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:18.284141 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:18.284561 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:18.284893 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:18.285222 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:18.285565 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:18.349377 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f7d5e0c-c6b5-4bbf-9ec8-e4f4181d68af req-27c00669-2be8-48c4-a3ab-3e77c7ba8751 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:18.350950 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0f7d5e0c-c6b5-4bbf-9ec8-e4f4181d68af req-27c00669-2be8-48c4-a3ab-3e77c7ba8751 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 1098 time: 0.0409975 Dec 09 22:07:18.365286 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-301d5277-7975-4242-8903-3a57b69d2237 req-f4f8caa8-f5b6-4252-8b73-a409dcdc977f tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:18.366794 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-301d5277-7975-4242-8903-3a57b69d2237 req-f4f8caa8-f5b6-4252-8b73-a409dcdc977f tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0487556 Dec 09 22:07:18.399727 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0f7d5e0c-c6b5-4bbf-9ec8-e4f4181d68af req-b3acccfc-3a1b-4b6d-9e27-d9b2bb8c24ea service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416899 Dec 09 22:07:18.415207 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-301d5277-7975-4242-8903-3a57b69d2237 req-81a547df-b1cd-40b1-84b5-fee7e83435b9 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421355 Dec 09 22:07:19.561957 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28c52766-1100-427c-8dc0-576cc41dc62b req-e31665ab-8931-472b-a59d-79d8ed52231d tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:19.563669 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-28c52766-1100-427c-8dc0-576cc41dc62b req-e31665ab-8931-472b-a59d-79d8ed52231d tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0650213 Dec 09 22:07:19.621649 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-28c52766-1100-427c-8dc0-576cc41dc62b req-3f3afb47-6fb0-43ef-b489-e2fbbeb9e489 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0519392 Dec 09 22:07:19.748879 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-739e8580-77b9-4d8d-84c6-9356806434c8 req-5208b44a-c1c8-4ca2-b52b-a5e5129b28c7 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:19.750400 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-739e8580-77b9-4d8d-84c6-9356806434c8 req-5208b44a-c1c8-4ca2-b52b-a5e5129b28c7 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0519104 Dec 09 22:07:19.800682 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-739e8580-77b9-4d8d-84c6-9356806434c8 req-89e033d3-15b8-45dc-9d0f-d9f997be56e8 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416000 Dec 09 22:07:20.074067 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0c7ad26-d6b6-4ad4-80f4-b2e160904073 req-e75360af-8c4c-4af8-9332-0f0d0dc034d2 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:20.075540 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0c7ad26-d6b6-4ad4-80f4-b2e160904073 req-e75360af-8c4c-4af8-9332-0f0d0dc034d2 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0770228 Dec 09 22:07:20.079054 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-fe41a5eb-13ea-4396-932e-bb5aabe22faf service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0718517 Dec 09 22:07:20.148879 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e0c7ad26-d6b6-4ad4-80f4-b2e160904073 req-0f52c4b7-e5a0-498e-8f0b-8c6dcb286ff8 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0570750 Dec 09 22:07:21.201353 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-875fbb39-2c81-4174-8fcc-c668dc1f9082 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:21.203139 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-875fbb39-2c81-4174-8fcc-c668dc1f9082 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=4e6e98b6ce8149c49f718a22c26736d8&device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 1098 time: 0.0448208 Dec 09 22:07:21.252383 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa374412-3c3f-44b5-a78f-b1d6d4784aeb req-9acd5a56-c0ff-4c4a-b32b-384e631a1691 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:21.254043 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aa374412-3c3f-44b5-a78f-b1d6d4784aeb req-9acd5a56-c0ff-4c4a-b32b-384e631a1691 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0516980 Dec 09 22:07:21.295917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-3daec20a-77bd-4533-947d-795a6e028d38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:21.297562 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-3daec20a-77bd-4533-947d-795a6e028d38 service neutron] 10.222.0.10 "GET /v2.0/networks?id=fcd51eae-6fa3-41c8-9622-47a1ed852c66 HTTP/1.1" status: 200 len: 916 time: 0.0863125 Dec 09 22:07:21.302433 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aa374412-3c3f-44b5-a78f-b1d6d4784aeb req-20871985-d5da-44b2-b76b-7a4a17e8f6ea tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421703 Dec 09 22:07:21.344894 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-cfcc2253-6674-411e-8b4e-34687ef55cbe service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0b27d59f-1b96-4f39-ab74-4dde82deb244 HTTP/1.1" status: 200 len: 217 time: 0.0401387 Dec 09 22:07:21.395501 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-5853910d-ebde-48c1-9e77-4fe34fb02e8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:21.396995 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-5853910d-ebde-48c1-9e77-4fe34fb02e8e service neutron] 10.222.0.10 "GET /v2.0/subnets?id=2d05eb0f-5210-4210-a0bf-465840e19241 HTTP/1.1" status: 200 len: 855 time: 0.0450971 Dec 09 22:07:21.429458 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-d8cfc695-8190-4dd4-82d6-b1a295ddc9e3 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=fcd51eae-6fa3-41c8-9622-47a1ed852c66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0254314 Dec 09 22:07:21.535837 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-6558a966-59e0-40a5-b778-afdf252a376f service neutron] 10.222.0.10 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0990615 Dec 09 22:07:21.632742 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-13c6e150-a806-4b86-9c46-acd24f677ee2 service neutron] 10.222.0.10 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0902636 Dec 09 22:07:22.439768 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7455146-b9eb-4051-9b82-160002013d40 req-71b927ab-3be0-47d3-8184-3828bcdb75b4 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:22.441261 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a7455146-b9eb-4051-9b82-160002013d40 req-71b927ab-3be0-47d3-8184-3828bcdb75b4 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0594299 Dec 09 22:07:22.489227 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a7455146-b9eb-4051-9b82-160002013d40 req-ec5fac59-e2f7-4a5f-843c-e1d787421aa7 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419407 Dec 09 22:07:23.626816 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bab4168-5d5e-4e1e-9162-111ccdd1db91 req-28ec03c7-a8d1-4c46-ad5a-9c8b730059e1 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:23.628416 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6bab4168-5d5e-4e1e-9162-111ccdd1db91 req-28ec03c7-a8d1-4c46-ad5a-9c8b730059e1 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0521722 Dec 09 22:07:23.675342 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6bab4168-5d5e-4e1e-9162-111ccdd1db91 req-b41a3c53-9346-4b44-89cb-33ca59084c47 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406671 Dec 09 22:07:24.815026 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56058c59-02ea-4ca3-88f3-cae1c66b3119 req-36714e02-98b3-4195-b2c9-962554e68673 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:24.816658 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56058c59-02ea-4ca3-88f3-cae1c66b3119 req-36714e02-98b3-4195-b2c9-962554e68673 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0594018 Dec 09 22:07:24.873014 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-56058c59-02ea-4ca3-88f3-cae1c66b3119 req-622993d8-f904-42ff-9017-91a5e31f96f0 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0478125 Dec 09 22:07:26.013569 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6be48bdf-3498-4d4f-a5fa-9cb676651984 req-2a094315-040b-495d-bcf6-9340f9424b4e tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:26.015045 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6be48bdf-3498-4d4f-a5fa-9cb676651984 req-2a094315-040b-495d-bcf6-9340f9424b4e tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0530217 Dec 09 22:07:26.072028 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6be48bdf-3498-4d4f-a5fa-9cb676651984 req-91fcc4aa-0c90-4810-894a-ea327c325c57 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0505066 Dec 09 22:07:27.202348 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20961a00-daa5-43b5-9385-86409d305a23 req-e7fbfe21-8bc6-4c01-8597-16b60383e1ad tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:27.204447 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20961a00-daa5-43b5-9385-86409d305a23 req-e7fbfe21-8bc6-4c01-8597-16b60383e1ad tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0509684 Dec 09 22:07:27.263573 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-20961a00-daa5-43b5-9385-86409d305a23 req-bff64928-4626-43ff-a4e5-82596d2e3b27 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0509181 Dec 09 22:07:27.545836 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:27.723792 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:28.389135 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b216357-ae5e-4229-a4c1-0abf7d3e430c req-6025f348-dc75-4553-b806-e12f5473c888 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:28.390607 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b216357-ae5e-4229-a4c1-0abf7d3e430c req-6025f348-dc75-4553-b806-e12f5473c888 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0550885 Dec 09 22:07:28.442291 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b216357-ae5e-4229-a4c1-0abf7d3e430c req-7746bc8a-1094-40c3-81ad-55b70c510793 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425413 Dec 09 22:07:29.572901 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ef878da-07df-4433-a92b-d9738e308762 req-6b6b581d-152f-4e06-adfd-ea3f65f83e5a tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:29.574418 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ef878da-07df-4433-a92b-d9738e308762 req-6b6b581d-152f-4e06-adfd-ea3f65f83e5a tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0519741 Dec 09 22:07:29.621985 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ef878da-07df-4433-a92b-d9738e308762 req-5fb2f5e5-3342-4ae9-a013-b5ec01b79158 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412781 Dec 09 22:07:31.040425 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-652c0900-2a05-4a8a-9ea1-c0f78f1d5f3b req-ceb6f599-5ffe-4e7d-9654-33a3a08293f8 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:31.041807 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-652c0900-2a05-4a8a-9ea1-c0f78f1d5f3b req-ceb6f599-5ffe-4e7d-9654-33a3a08293f8 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0548687 Dec 09 22:07:31.096992 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-652c0900-2a05-4a8a-9ea1-c0f78f1d5f3b req-203a8796-d575-4c7a-bf4e-08adcf028153 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0489783 Dec 09 22:07:32.236237 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c488a46-f212-44a3-af44-d8551fd62be3 req-7f04144b-d2e1-4dc9-941c-891af03ee196 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:32.237831 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c488a46-f212-44a3-af44-d8551fd62be3 req-7f04144b-d2e1-4dc9-941c-891af03ee196 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0531905 Dec 09 22:07:32.289440 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c488a46-f212-44a3-af44-d8551fd62be3 req-0d2f06c4-8dd2-4666-8097-b38186338343 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428054 Dec 09 22:07:33.006808 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dab33276-2183-40d3-8daf-4cbf560d6bac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:33.437260 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45f27bef-2453-4dd3-9a47-c7303d9c7615 req-e956188c-0604-4c2f-a190-c452a2bc6112 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:33.438728 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-45f27bef-2453-4dd3-9a47-c7303d9c7615 req-e956188c-0604-4c2f-a190-c452a2bc6112 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0599141 Dec 09 22:07:33.490976 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-45f27bef-2453-4dd3-9a47-c7303d9c7615 req-15aaad1c-7a6d-4ea6-84c8-19a3b9b45810 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459983 Dec 09 22:07:34.627166 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14c3d932-c6af-4181-917d-fea15b32370e req-8bec55b3-2eee-45ad-bcf7-13d3ae7193a7 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:34.628668 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-14c3d932-c6af-4181-917d-fea15b32370e req-8bec55b3-2eee-45ad-bcf7-13d3ae7193a7 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0598371 Dec 09 22:07:34.682443 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-14c3d932-c6af-4181-917d-fea15b32370e req-719067c9-67ab-4f72-af4a-1c92e11580f5 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446668 Dec 09 22:07:35.644270 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9c72c275-d165-4ef4-b0f9-8ecb5e249193 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:35.817357 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e982387-85ca-4352-9ceb-f871cf9e67f4 req-7cb79d1c-ac16-46c6-8a2f-a1becbc41d99 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:35.818821 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e982387-85ca-4352-9ceb-f871cf9e67f4 req-7cb79d1c-ac16-46c6-8a2f-a1becbc41d99 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0579572 Dec 09 22:07:35.866396 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e982387-85ca-4352-9ceb-f871cf9e67f4 req-43f8b6e2-a749-4066-9116-25fce12b20b4 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414386 Dec 09 22:07:36.785027 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:36.993342 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-104e34f1-32e6-43b0-95e3-6d0d14ead1cb req-9a7de8c3-5c66-4811-bbb3-dffb94b681f6 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:36.994863 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-104e34f1-32e6-43b0-95e3-6d0d14ead1cb req-9a7de8c3-5c66-4811-bbb3-dffb94b681f6 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0555246 Dec 09 22:07:37.044042 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-104e34f1-32e6-43b0-95e3-6d0d14ead1cb req-0f9b683f-cca7-4a00-ac46-4304f36f6070 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428414 Dec 09 22:07:38.113970 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:38.180311 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f84d5d3a-f885-4b51-a68b-625ff7c5fd71 req-a4f6e410-696b-49a9-8bad-e53ddf39bf06 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:38.181805 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f84d5d3a-f885-4b51-a68b-625ff7c5fd71 req-a4f6e410-696b-49a9-8bad-e53ddf39bf06 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0511725 Dec 09 22:07:38.233207 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f84d5d3a-f885-4b51-a68b-625ff7c5fd71 req-85e0ec2f-81aa-45f5-bb2b-4fae36908cee tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454180 Dec 09 22:07:39.369306 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bfc32b2-62cf-41f7-9874-5aa20a95d58f req-e7ba452d-ba09-4840-831d-1ccc11d80b2f tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:39.370789 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9bfc32b2-62cf-41f7-9874-5aa20a95d58f req-e7ba452d-ba09-4840-831d-1ccc11d80b2f tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0615532 Dec 09 22:07:39.427424 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9bfc32b2-62cf-41f7-9874-5aa20a95d58f req-c91da592-132a-4dab-be1a-cdda3353a2e1 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0483422 Dec 09 22:07:39.660743 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:40.570943 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21467b68-e4a3-4c08-9651-342492289598 req-897459ce-0f98-4463-8dc5-0f41115289c0 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:40.572747 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-21467b68-e4a3-4c08-9651-342492289598 req-897459ce-0f98-4463-8dc5-0f41115289c0 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0616169 Dec 09 22:07:40.624442 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-21467b68-e4a3-4c08-9651-342492289598 req-497877f0-7e7a-4db3-8d4a-63e554fcc981 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453877 Dec 09 22:07:41.752457 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc126a70-0724-4b9b-93ba-4021d06d23cd req-068e3de0-c959-41a8-8391-db24ab241c25 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:41.754601 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cc126a70-0724-4b9b-93ba-4021d06d23cd req-068e3de0-c959-41a8-8391-db24ab241c25 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0534751 Dec 09 22:07:41.804548 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cc126a70-0724-4b9b-93ba-4021d06d23cd req-53978d57-0276-4f98-a2e8-0a6d8244a2c4 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432651 Dec 09 22:07:42.926321 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-612eec65-f0fb-4eb0-9fdb-8647f2b9e755 req-d85c8c16-54d5-4a95-8b42-7a5456a7db51 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:42.927823 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-612eec65-f0fb-4eb0-9fdb-8647f2b9e755 req-d85c8c16-54d5-4a95-8b42-7a5456a7db51 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0530646 Dec 09 22:07:42.974711 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-612eec65-f0fb-4eb0-9fdb-8647f2b9e755 req-6fb8e5bd-7cbb-4ea0-a859-44d1fbca436f tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403795 Dec 09 22:07:43.854681 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c0be649-ea72-4eb0-8877-d50e78983fa5 req-ff31f7a2-f84c-4748-bf70-3e608231f57f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:43.856607 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7c0be649-ea72-4eb0-8877-d50e78983fa5 req-ff31f7a2-f84c-4748-bf70-3e608231f57f service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=4e6e98b6ce8149c49f718a22c26736d8&device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 1098 time: 0.0498707 Dec 09 22:07:43.961384 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c0be649-ea72-4eb0-8877-d50e78983fa5 req-677c22ff-5f00-4fc3-a848-92c6e893d0cd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:43.962875 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7c0be649-ea72-4eb0-8877-d50e78983fa5 req-677c22ff-5f00-4fc3-a848-92c6e893d0cd service neutron] 10.222.0.10 "GET /v2.0/networks?id=fcd51eae-6fa3-41c8-9622-47a1ed852c66 HTTP/1.1" status: 200 len: 916 time: 0.0852659 Dec 09 22:07:44.008783 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7c0be649-ea72-4eb0-8877-d50e78983fa5 req-8a2ad775-1f97-49b4-b37f-4568cb964e7a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0b27d59f-1b96-4f39-ab74-4dde82deb244 HTTP/1.1" status: 200 len: 217 time: 0.0384786 Dec 09 22:07:44.059532 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c0be649-ea72-4eb0-8877-d50e78983fa5 req-02dfbb94-1a7a-4460-887d-4b6d3b3fcdb9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:44.061049 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7c0be649-ea72-4eb0-8877-d50e78983fa5 req-02dfbb94-1a7a-4460-887d-4b6d3b3fcdb9 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=2d05eb0f-5210-4210-a0bf-465840e19241 HTTP/1.1" status: 200 len: 855 time: 0.0460370 Dec 09 22:07:44.092968 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7c0be649-ea72-4eb0-8877-d50e78983fa5 req-2ca98bfb-ec29-4bdb-86a1-41a70192f253 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=fcd51eae-6fa3-41c8-9622-47a1ed852c66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0241630 Dec 09 22:07:44.098024 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3f461e5-98f8-41d1-9730-b00d4e70d014 req-8b56f0eb-bea5-41e8-9b92-c596e578deec tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:44.099626 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b3f461e5-98f8-41d1-9730-b00d4e70d014 req-8b56f0eb-bea5-41e8-9b92-c596e578deec tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0528715 Dec 09 22:07:44.148626 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b3f461e5-98f8-41d1-9730-b00d4e70d014 req-f89cac2e-01c7-4cd0-b85c-1900ea864c75 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418062 Dec 09 22:07:44.195638 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7c0be649-ea72-4eb0-8877-d50e78983fa5 req-0047dcf4-1c72-43e5-95d2-37059cf11a44 service neutron] 10.222.0.10 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0954480 Dec 09 22:07:44.286091 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7c0be649-ea72-4eb0-8877-d50e78983fa5 req-b622b55b-dc48-48de-bef2-4058036aeacb service neutron] 10.222.0.10 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0833621 Dec 09 22:07:45.359765 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d80b711-4b4a-4365-90b2-7b8545b7afbe req-b6a438fb-4201-468d-bcca-0532effaef4f tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:45.361285 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1d80b711-4b4a-4365-90b2-7b8545b7afbe req-b6a438fb-4201-468d-bcca-0532effaef4f tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.1342063 Dec 09 22:07:45.415147 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1d80b711-4b4a-4365-90b2-7b8545b7afbe req-2c6d2a3d-c875-468c-b1c9-dedb1e25cc50 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465727 Dec 09 22:07:46.546137 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccd6db19-cd53-47df-b091-ba3601e72986 req-d0d4697a-cc20-4202-b9cc-e57ed6eed138 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:46.547655 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ccd6db19-cd53-47df-b091-ba3601e72986 req-d0d4697a-cc20-4202-b9cc-e57ed6eed138 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0598662 Dec 09 22:07:46.596408 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ccd6db19-cd53-47df-b091-ba3601e72986 req-6dc98fdd-d7ed-40bb-ac0f-67991cb415e8 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404322 Dec 09 22:07:47.722266 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d2e2806-f5ba-4f60-9ee3-560c0832d2b2 req-8b7dda6f-a207-461e-b57b-be8f613fde12 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:47.723780 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5d2e2806-f5ba-4f60-9ee3-560c0832d2b2 req-8b7dda6f-a207-461e-b57b-be8f613fde12 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0521336 Dec 09 22:07:47.778388 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5d2e2806-f5ba-4f60-9ee3-560c0832d2b2 req-dc1b11f2-ce82-414a-be17-60de4f53835b tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453026 Dec 09 22:07:48.214283 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:07:48.409142 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-33e6ab4f-ef16-4884-b8b8-8e1f91564071 service neutron] show failed (client error): The resource could not be found. Dec 09 22:07:48.410203 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-33e6ab4f-ef16-4884-b8b8-8e1f91564071 service neutron] 10.222.0.10 "GET /v2.0/ports/0b27d59f-1b96-4f39-ab74-4dde82deb244/bindings/n-h1-713301-27 HTTP/1.1" status: 404 len: 381 time: 0.0574901 Dec 09 22:07:48.630580 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-036cd621-a944-4e66-9f2c-3b3bc1e08426 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:48.632090 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-036cd621-a944-4e66-9f2c-3b3bc1e08426 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169&tenant_id=4e6e98b6ce8149c49f718a22c26736d8 HTTP/1.1" status: 200 len: 1098 time: 0.0495024 Dec 09 22:07:48.644298 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Request body: {'port': {'binding:host_id': 'n-h1-713301-27', 'device_owner': 'compute:nova'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:07:48.696536 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:48.897333 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] For port 0b27d59f-1b96-4f39-ab74-4dde82deb244, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=0b27d59f-1b96-4f39-ab74-4dde82deb244,segment=NetworkSegment(bb19ea59-b907-4a2f-a9d7-f47a74902855),segment_id=bb19ea59-b907-4a2f-a9d7-f47a74902855)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:07:48.900340 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cb837b1-961e-4e70-a58e-98bf95a43ad1 req-16e7e5b2-7077-4e96-ac85-8d061dd50a28 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:48.901867 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0cb837b1-961e-4e70-a58e-98bf95a43ad1 req-16e7e5b2-7077-4e96-ac85-8d061dd50a28 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0502470 Dec 09 22:07:48.930599 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] For port 0b27d59f-1b96-4f39-ab74-4dde82deb244, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:07:48.950862 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0cb837b1-961e-4e70-a58e-98bf95a43ad1 req-4882f7b3-9bc6-46c4-9993-e7810c8b6ba3 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418904 Dec 09 22:07:48.973853 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '511cdfd7-3413-4420-8290-90169e7ba169', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '0b27d59f-1b96-4f39-ab74-4dde82deb244'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:07:48.976156 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2c531ada-fff1-47c9-8430-56b4f2cbe3a4" -d '{"events": [{"server_uuid": "511cdfd7-3413-4420-8290-90169e7ba169", "name": "network-vif-unplugged", "status": "completed", "tag": "0b27d59f-1b96-4f39-ab74-4dde82deb244"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:07:48.980755 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:48.992951 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Transition to ACTIVE for port object 0b27d59f-1b96-4f39-ab74-4dde82deb244 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:07:48.996804 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:49.026246 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 22:07:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-15159a15-92b5-47a7-b613-e00dabae3ecb x-openstack-request-id: req-15159a15-92b5-47a7-b613-e00dabae3ecb {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:07:49.026539 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "511cdfd7-3413-4420-8290-90169e7ba169", "name": "network-vif-unplugged", "status": "completed", "tag": "0b27d59f-1b96-4f39-ab74-4dde82deb244", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:07:49.026820 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-15159a15-92b5-47a7-b613-e00dabae3ecb {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:07:49.027197 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '511cdfd7-3413-4420-8290-90169e7ba169', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '0b27d59f-1b96-4f39-ab74-4dde82deb244', 'code': 200} Dec 09 22:07:49.058739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] No DVR routers for this DVR port 0b27d59f-1b96-4f39-ab74-4dde82deb244 on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:07:49.061756 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Pushing event updated for resources: {'Port': ['ID=0b27d59f-1b96-4f39-ab74-4dde82deb244,revision_number=6']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:07:49.074331 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:49.074688 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:49.075053 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:49.075398 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:49.075834 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:49.076209 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:49.076548 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:49.076882 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:49.077216 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:49.077551 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:49.077886 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:49.078230 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:49.078564 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:07:49.108949 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Attempting to bind port 0b27d59f-1b96-4f39-ab74-4dde82deb244 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:07:49.109297 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Attempting to bind port 0b27d59f-1b96-4f39-ab74-4dde82deb244 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'bb19ea59-b907-4a2f-a9d7-f47a74902855', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'fcd51eae-6fa3-41c8-9622-47a1ed852c66'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:07:49.109629 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Attempting to bind port 0b27d59f-1b96-4f39-ab74-4dde82deb244 on network fcd51eae-6fa3-41c8-9622-47a1ed852c66 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:07:49.114276 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Port 0b27d59f-1b96-4f39-ab74-4dde82deb244 on network fcd51eae-6fa3-41c8-9622-47a1ed852c66 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:07:49.114607 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Attempting to bind port 0b27d59f-1b96-4f39-ab74-4dde82deb244 on network fcd51eae-6fa3-41c8-9622-47a1ed852c66 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:07:49.120094 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 7, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:07:49.120437 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Checking segment: {'id': 'bb19ea59-b907-4a2f-a9d7-f47a74902855', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'fcd51eae-6fa3-41c8-9622-47a1ed852c66'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:07:49.120818 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Bound using segment: {'id': 'bb19ea59-b907-4a2f-a9d7-f47a74902855', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'fcd51eae-6fa3-41c8-9622-47a1ed852c66'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:07:49.121246 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Bound port: 0b27d59f-1b96-4f39-ab74-4dde82deb244, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bb19ea59-b907-4a2f-a9d7-f47a74902855', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 136, 'network_id': 'fcd51eae-6fa3-41c8-9622-47a1ed852c66'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:07:49.121608 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:49.191883 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] For port 0b27d59f-1b96-4f39-ab74-4dde82deb244, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:07:49.195075 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] For port 0b27d59f-1b96-4f39-ab74-4dde82deb244, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=0b27d59f-1b96-4f39-ab74-4dde82deb244,segment=NetworkSegment(bb19ea59-b907-4a2f-a9d7-f47a74902855),segment_id=bb19ea59-b907-4a2f-a9d7-f47a74902855)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:07:49.203651 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:49.237436 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:49.238084 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:49.239512 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] 10.222.0.31 "PUT /v2.0/ports/0b27d59f-1b96-4f39-ab74-4dde82deb244 HTTP/1.1" status: 200 len: 1093 time: 0.5992346 Dec 09 22:07:49.260987 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da4a2d25-491d-453d-ac76-2b31ff3dacdc service neutron] Pushing event updated for resources: {'Port': ['ID=0b27d59f-1b96-4f39-ab74-4dde82deb244,revision_number=7']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:07:49.303276 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-4a2a3f20-a36c-419b-aadf-e4d064681c6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:49.304799 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-4a2a3f20-a36c-419b-aadf-e4d064681c6c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=4e6e98b6ce8149c49f718a22c26736d8&device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 1096 time: 0.0408757 Dec 09 22:07:49.399476 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-d1e9aea6-7ddc-40a6-8e56-d5bd3a86c81b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:49.401386 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-d1e9aea6-7ddc-40a6-8e56-d5bd3a86c81b service neutron] 10.222.0.31 "GET /v2.0/networks?id=fcd51eae-6fa3-41c8-9622-47a1ed852c66 HTTP/1.1" status: 200 len: 916 time: 0.0896890 Dec 09 22:07:49.448585 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-ecf354aa-b29b-4dc9-8a29-841348ccfcb9 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0b27d59f-1b96-4f39-ab74-4dde82deb244 HTTP/1.1" status: 200 len: 217 time: 0.0395694 Dec 09 22:07:49.498985 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-4ba1cc2f-ebfd-46ec-9763-2b37ed9b89a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:49.500521 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-4ba1cc2f-ebfd-46ec-9763-2b37ed9b89a3 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=2d05eb0f-5210-4210-a0bf-465840e19241 HTTP/1.1" status: 200 len: 855 time: 0.0452287 Dec 09 22:07:49.536774 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-9dc84381-01f1-4328-b774-7595d2654b7a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fcd51eae-6fa3-41c8-9622-47a1ed852c66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0286827 Dec 09 22:07:49.637526 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-059c5c1a-3186-45c9-80af-653f792d0682 service neutron] 10.222.0.31 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0937996 Dec 09 22:07:49.737228 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-03dba70e-7127-4a81-832e-1bbf6b63bb8f req-a6c7297d-f9d2-490a-84a3-f71ff769fe40 service neutron] 10.222.0.31 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0928528 Dec 09 22:07:50.073239 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55145b0b-d532-4530-8e92-83cacecc5c3a req-d9b2bb8d-fe07-4aaf-b370-6b08800271bb tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:50.074779 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-55145b0b-d532-4530-8e92-83cacecc5c3a req-d9b2bb8d-fe07-4aaf-b370-6b08800271bb tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 944 time: 0.0501804 Dec 09 22:07:50.123825 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-55145b0b-d532-4530-8e92-83cacecc5c3a req-a43c333a-faf5-46ce-bd6a-43f0c2463c53 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429685 Dec 09 22:07:51.029196 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '511cdfd7-3413-4420-8290-90169e7ba169', 'tag': '0b27d59f-1b96-4f39-ab74-4dde82deb244'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:07:51.033197 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-27835ebd-a23d-4357-8e6b-8ff060f229eb" -d '{"events": [{"name": "network-changed", "server_uuid": "511cdfd7-3413-4420-8290-90169e7ba169", "tag": "0b27d59f-1b96-4f39-ab74-4dde82deb244"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:07:51.090673 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:07:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7e45faec-82bb-4f4c-a23a-28c8d75b8c54 x-openstack-request-id: req-7e45faec-82bb-4f4c-a23a-28c8d75b8c54 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:07:51.090969 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "511cdfd7-3413-4420-8290-90169e7ba169", "tag": "0b27d59f-1b96-4f39-ab74-4dde82deb244", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:07:51.091229 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-7e45faec-82bb-4f4c-a23a-28c8d75b8c54 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:07:51.091681 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '511cdfd7-3413-4420-8290-90169e7ba169', 'tag': '0b27d59f-1b96-4f39-ab74-4dde82deb244', 'status': 'completed', 'code': 200} Dec 09 22:07:51.180435 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27835ebd-a23d-4357-8e6b-8ff060f229eb req-deb2d54a-cbf9-4a80-a786-abc66f36436c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:51.182146 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-27835ebd-a23d-4357-8e6b-8ff060f229eb req-deb2d54a-cbf9-4a80-a786-abc66f36436c service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=4e6e98b6ce8149c49f718a22c26736d8&device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 1096 time: 0.0624301 Dec 09 22:07:51.184169 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27835ebd-a23d-4357-8e6b-8ff060f229eb req-7e2ec667-e37c-4437-b3bd-0a1391d40a89 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:51.185592 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-27835ebd-a23d-4357-8e6b-8ff060f229eb req-7e2ec667-e37c-4437-b3bd-0a1391d40a89 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=4e6e98b6ce8149c49f718a22c26736d8&device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 1096 time: 0.0743709 Dec 09 22:07:51.279692 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c72d16d0-6059-40fd-ab2f-42e4d33eb7a4 req-21db2e95-3d71-4aa4-b510-55d8ca186a7a tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:51.281229 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c72d16d0-6059-40fd-ab2f-42e4d33eb7a4 req-21db2e95-3d71-4aa4-b510-55d8ca186a7a tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 944 time: 0.0792005 Dec 09 22:07:51.343692 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c72d16d0-6059-40fd-ab2f-42e4d33eb7a4 req-23778873-ab9a-4407-888c-729f419e48de tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459967 Dec 09 22:07:51.348888 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27835ebd-a23d-4357-8e6b-8ff060f229eb req-1a171280-1381-4593-b06f-ccc9a1bbed8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:51.350400 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-27835ebd-a23d-4357-8e6b-8ff060f229eb req-1a171280-1381-4593-b06f-ccc9a1bbed8e service neutron] 10.222.0.10 "GET /v2.0/networks?id=fcd51eae-6fa3-41c8-9622-47a1ed852c66 HTTP/1.1" status: 200 len: 916 time: 0.1617825 Dec 09 22:07:51.372911 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27835ebd-a23d-4357-8e6b-8ff060f229eb req-019a3568-4fc8-4fa5-876c-e28a644c20b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:51.374359 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-27835ebd-a23d-4357-8e6b-8ff060f229eb req-019a3568-4fc8-4fa5-876c-e28a644c20b7 service neutron] 10.222.0.31 "GET /v2.0/networks?id=fcd51eae-6fa3-41c8-9622-47a1ed852c66 HTTP/1.1" status: 200 len: 916 time: 0.1676793 Dec 09 22:07:51.406395 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-27835ebd-a23d-4357-8e6b-8ff060f229eb req-eec4280e-a247-442a-8631-5b039baf8a0a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0b27d59f-1b96-4f39-ab74-4dde82deb244 HTTP/1.1" status: 200 len: 217 time: 0.0479476 Dec 09 22:07:51.445363 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-27835ebd-a23d-4357-8e6b-8ff060f229eb req-ca4e1991-214b-43e5-84c9-5dc7d82f8031 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0b27d59f-1b96-4f39-ab74-4dde82deb244 HTTP/1.1" status: 200 len: 217 time: 0.0457225 Dec 09 22:07:51.515039 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27835ebd-a23d-4357-8e6b-8ff060f229eb req-c580efcf-30fb-47ca-9536-0fa6f1642df2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:51.516519 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-27835ebd-a23d-4357-8e6b-8ff060f229eb req-c580efcf-30fb-47ca-9536-0fa6f1642df2 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=2d05eb0f-5210-4210-a0bf-465840e19241 HTTP/1.1" status: 200 len: 855 time: 0.0794566 Dec 09 22:07:51.521586 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27835ebd-a23d-4357-8e6b-8ff060f229eb req-fe061c80-fee4-40dd-82a1-c21c1bc689cf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:51.522882 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-27835ebd-a23d-4357-8e6b-8ff060f229eb req-fe061c80-fee4-40dd-82a1-c21c1bc689cf service neutron] 10.222.0.31 "GET /v2.0/subnets?id=2d05eb0f-5210-4210-a0bf-465840e19241 HTTP/1.1" status: 200 len: 855 time: 0.0594401 Dec 09 22:07:51.565883 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-27835ebd-a23d-4357-8e6b-8ff060f229eb req-becf8d30-ddf8-43d3-8eb8-1676297bfa43 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=fcd51eae-6fa3-41c8-9622-47a1ed852c66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0420203 Dec 09 22:07:51.567763 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-27835ebd-a23d-4357-8e6b-8ff060f229eb req-add36d80-e1a7-472a-9afd-bfccd7a1940f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=fcd51eae-6fa3-41c8-9622-47a1ed852c66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0368805 Dec 09 22:07:51.721922 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-27835ebd-a23d-4357-8e6b-8ff060f229eb req-b5d71aea-5e2d-4307-b559-5d3600829996 service neutron] 10.222.0.10 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1488607 Dec 09 22:07:51.723897 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-27835ebd-a23d-4357-8e6b-8ff060f229eb req-c5447b3a-00a3-4a70-8bfb-17880659eed1 service neutron] 10.222.0.31 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1439209 Dec 09 22:07:51.880161 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-27835ebd-a23d-4357-8e6b-8ff060f229eb req-a8ac7565-33ca-414c-890d-5008f23377fa service neutron] 10.222.0.10 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1513107 Dec 09 22:07:51.882072 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-27835ebd-a23d-4357-8e6b-8ff060f229eb req-b88d9b34-df32-42ce-9d87-9707055c2090 service neutron] 10.222.0.31 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1459157 Dec 09 22:07:51.891936 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 0b27d59f-1b96-4f39-ab74-4dde82deb244 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:07:51.989614 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 0b27d59f-1b96-4f39-ab74-4dde82deb244, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=0b27d59f-1b96-4f39-ab74-4dde82deb244,segment=NetworkSegment(bb19ea59-b907-4a2f-a9d7-f47a74902855),segment_id=bb19ea59-b907-4a2f-a9d7-f47a74902855)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:07:52.000959 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '0b27d59f-1b96-4f39-ab74-4dde82deb244', 'network_id': 'fcd51eae-6fa3-41c8-9622-47a1ed852c66', 'port_id': '0b27d59f-1b96-4f39-ab74-4dde82deb244', 'mac_address': 'fa:16:3e:4e:72:03', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 136, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2d05eb0f-5210-4210-a0bf-465840e19241', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:07:52.042928 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:52.058006 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0b27d59f-1b96-4f39-ab74-4dde82deb244 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:07:52.077240 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 0b27d59f-1b96-4f39-ab74-4dde82deb244, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=0b27d59f-1b96-4f39-ab74-4dde82deb244,segment=NetworkSegment(bb19ea59-b907-4a2f-a9d7-f47a74902855),segment_id=bb19ea59-b907-4a2f-a9d7-f47a74902855)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:07:52.083744 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:52.131841 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=0b27d59f-1b96-4f39-ab74-4dde82deb244,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:07:52.146974 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 0b27d59f-1b96-4f39-ab74-4dde82deb244 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:07:52.187079 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 0b27d59f-1b96-4f39-ab74-4dde82deb244 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:07:52.308590 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['0b27d59f-1b96-4f39-ab74-4dde82deb244'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:07:52.466738 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a76dcdf3-6691-4116-80b3-2b6f3853fac6 req-fb2fcc9c-5075-48d3-a898-eea8ae014fe8 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:52.468465 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a76dcdf3-6691-4116-80b3-2b6f3853fac6 req-fb2fcc9c-5075-48d3-a898-eea8ae014fe8 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 945 time: 0.0533316 Dec 09 22:07:52.521847 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a76dcdf3-6691-4116-80b3-2b6f3853fac6 req-f4bce3f9-5b2b-4655-b65e-7614bd8d4d22 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473185 Dec 09 22:07:52.720905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f9dd6b2-6f4b-40bb-9c5c-99f2322f9de9 req-bebf985c-a112-4349-a633-8e3e5e672eca tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:52.722397 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f9dd6b2-6f4b-40bb-9c5c-99f2322f9de9 req-bebf985c-a112-4349-a633-8e3e5e672eca tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 945 time: 0.0514677 Dec 09 22:07:52.735141 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-828637f8-a800-45e4-8e83-a4dc4d084543 req-56f572f2-e4c1-41b9-8110-5837b888f12c tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:52.736679 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-828637f8-a800-45e4-8e83-a4dc4d084543 req-56f572f2-e4c1-41b9-8110-5837b888f12c tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.10 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169&tenant_id=4e6e98b6ce8149c49f718a22c26736d8&binding%3Ahost_id=n-h1-713301-27 HTTP/1.1" status: 200 len: 945 time: 0.0530109 Dec 09 22:07:52.778941 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f9dd6b2-6f4b-40bb-9c5c-99f2322f9de9 req-aad98b68-9a1e-437c-b47f-7b119525e7d5 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500562 Dec 09 22:07:52.798983 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [req-828637f8-a800-45e4-8e83-a4dc4d084543 req-5bb63818-4ed3-4145-af0f-e53aa91724ba service neutron] delete failed (client error): The resource could not be found. Dec 09 22:07:52.800129 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-828637f8-a800-45e4-8e83-a4dc4d084543 req-5bb63818-4ed3-4145-af0f-e53aa91724ba service neutron] 10.222.0.10 "DELETE /v2.0/ports/0b27d59f-1b96-4f39-ab74-4dde82deb244/bindings/n-h2-713301-27 HTTP/1.1" status: 404 len: 381 time: 0.0559456 Dec 09 22:07:52.896412 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-828637f8-a800-45e4-8e83-a4dc4d084543 req-cdf63e06-4475-46cd-88f1-e55dcfc4a0f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:52.897987 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-828637f8-a800-45e4-8e83-a4dc4d084543 req-cdf63e06-4475-46cd-88f1-e55dcfc4a0f2 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=4e6e98b6ce8149c49f718a22c26736d8&device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 1097 time: 0.0459418 Dec 09 22:07:53.006931 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-828637f8-a800-45e4-8e83-a4dc4d084543 req-1a1bebe4-9929-4b1a-a331-34859ceb12e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:53.008482 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-828637f8-a800-45e4-8e83-a4dc4d084543 req-1a1bebe4-9929-4b1a-a331-34859ceb12e7 service neutron] 10.222.0.10 "GET /v2.0/networks?id=fcd51eae-6fa3-41c8-9622-47a1ed852c66 HTTP/1.1" status: 200 len: 916 time: 0.1037807 Dec 09 22:07:53.052206 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-828637f8-a800-45e4-8e83-a4dc4d084543 req-5b2831ba-d96c-4449-84d8-05b3aa0a120a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=0b27d59f-1b96-4f39-ab74-4dde82deb244 HTTP/1.1" status: 200 len: 217 time: 0.0363348 Dec 09 22:07:53.106808 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-828637f8-a800-45e4-8e83-a4dc4d084543 req-babe1079-d7ba-4b3b-b93c-637d5c7a0de3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:53.108315 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-828637f8-a800-45e4-8e83-a4dc4d084543 req-babe1079-d7ba-4b3b-b93c-637d5c7a0de3 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=2d05eb0f-5210-4210-a0bf-465840e19241 HTTP/1.1" status: 200 len: 855 time: 0.0489671 Dec 09 22:07:53.140702 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-828637f8-a800-45e4-8e83-a4dc4d084543 req-acde30aa-7e05-44cc-a33d-4d113391dd50 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=fcd51eae-6fa3-41c8-9622-47a1ed852c66&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0253954 Dec 09 22:07:53.231361 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-828637f8-a800-45e4-8e83-a4dc4d084543 req-c18336c5-457a-4431-90e5-98425ca01ffc service neutron] 10.222.0.10 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0831990 Dec 09 22:07:53.330073 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-828637f8-a800-45e4-8e83-a4dc4d084543 req-059afdc0-5b00-46e5-98d6-e78f36485a0a service neutron] 10.222.0.10 "GET /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0911231 Dec 09 22:07:53.893990 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 0b27d59f-1b96-4f39-ab74-4dde82deb244 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:07:53.906856 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02ba2f61-1053-46f8-afc9-b9eea489a231 req-f1bfa405-90b3-4c13-8593-7c1de86c610a tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:53.908526 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02ba2f61-1053-46f8-afc9-b9eea489a231 req-f1bfa405-90b3-4c13-8593-7c1de86c610a tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 945 time: 0.0551596 Dec 09 22:07:53.949854 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 0b27d59f-1b96-4f39-ab74-4dde82deb244 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:07:53.956170 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 0b27d59f-1b96-4f39-ab74-4dde82deb244 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:07:53.956784 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:53.979615 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02ba2f61-1053-46f8-afc9-b9eea489a231 req-ce2fb657-bc79-4d6b-be29-c9241a99b2aa tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0609565 Dec 09 22:07:54.045101 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:54.068168 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '511cdfd7-3413-4420-8290-90169e7ba169', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0b27d59f-1b96-4f39-ab74-4dde82deb244'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:07:54.070208 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-783da1a0-0c91-40f6-bda3-35fa26dada08" -d '{"events": [{"server_uuid": "511cdfd7-3413-4420-8290-90169e7ba169", "name": "network-vif-plugged", "status": "completed", "tag": "0b27d59f-1b96-4f39-ab74-4dde82deb244"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:07:54.082401 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 0b27d59f-1b96-4f39-ab74-4dde82deb244, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=0b27d59f-1b96-4f39-ab74-4dde82deb244,segment=NetworkSegment(bb19ea59-b907-4a2f-a9d7-f47a74902855),segment_id=bb19ea59-b907-4a2f-a9d7-f47a74902855)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:07:54.086838 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:54.088774 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f263e933-396b-49c0-9ff4-fbfae53a868c req-6ebbb94b-3916-4759-bfd2-b607d7bd41b6 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:54.090325 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f263e933-396b-49c0-9ff4-fbfae53a868c req-6ebbb94b-3916-4759-bfd2-b607d7bd41b6 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 945 time: 0.0499895 Dec 09 22:07:54.137912 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=0b27d59f-1b96-4f39-ab74-4dde82deb244,revision_number=9']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:07:54.141037 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f263e933-396b-49c0-9ff4-fbfae53a868c req-2af2e160-0759-4195-9af2-c2f98ee6ee13 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440764 Dec 09 22:07:54.184393 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:07:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0db8a11a-d392-43eb-9e27-03e4109f4fd8 x-openstack-request-id: req-0db8a11a-d392-43eb-9e27-03e4109f4fd8 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:07:54.184699 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "511cdfd7-3413-4420-8290-90169e7ba169", "name": "network-vif-plugged", "status": "completed", "tag": "0b27d59f-1b96-4f39-ab74-4dde82deb244", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:07:54.184953 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0db8a11a-d392-43eb-9e27-03e4109f4fd8 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:07:54.185359 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '511cdfd7-3413-4420-8290-90169e7ba169', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0b27d59f-1b96-4f39-ab74-4dde82deb244', 'code': 200} Dec 09 22:07:54.286658 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e31df162-f82d-4d4d-9aaa-2baef3c8dca4 req-51381dd1-42c6-4704-bcbd-dc7901b39d96 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:54.288179 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e31df162-f82d-4d4d-9aaa-2baef3c8dca4 req-51381dd1-42c6-4704-bcbd-dc7901b39d96 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0594451 Dec 09 22:07:54.337063 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e31df162-f82d-4d4d-9aaa-2baef3c8dca4 req-f521de37-68f2-4531-afe1-88822e4469b1 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425305 Dec 09 22:07:54.674407 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-313a14e9-82de-4cdb-9519-88218133d18a req-832df936-81da-4988-bea1-e5c8bfe2ca03 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:54.675913 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-313a14e9-82de-4cdb-9519-88218133d18a req-832df936-81da-4988-bea1-e5c8bfe2ca03 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0548749 Dec 09 22:07:54.723800 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-313a14e9-82de-4cdb-9519-88218133d18a req-7db28abb-f808-4576-9b21-53a527857941 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417845 Dec 09 22:07:55.789334 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16786468-f5c8-4315-a360-197d9823af87 req-b702cfc4-1aa5-493a-9145-b06851472452 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:55.790855 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-16786468-f5c8-4315-a360-197d9823af87 req-b702cfc4-1aa5-493a-9145-b06851472452 tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.31 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0518579 Dec 09 22:07:55.845383 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bea9deb8-41ea-4cb0-80c2-afb80574bd3f req-dc152049-d768-43c2-b318-8819c683c98d tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:55.846963 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bea9deb8-41ea-4cb0-80c2-afb80574bd3f req-dc152049-d768-43c2-b318-8819c683c98d tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/ports?device_id=511cdfd7-3413-4420-8290-90169e7ba169 HTTP/1.1" status: 200 len: 946 time: 0.0528688 Dec 09 22:07:55.887818 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-16786468-f5c8-4315-a360-197d9823af87 req-99a719ff-2243-4139-8fca-a6e805618d3b tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Deleting port 0b27d59f-1b96-4f39-ab74-4dde82deb244 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:07:55.888168 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-16786468-f5c8-4315-a360-197d9823af87 req-99a719ff-2243-4139-8fca-a6e805618d3b tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:55.894416 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bea9deb8-41ea-4cb0-80c2-afb80574bd3f req-82e89365-6a92-47a8-8f2c-46ff7499463d tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.13 "GET /v2.0/security-groups?id=44fb00aa-12b9-43e2-9356-e9fcf03af445&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414205 Dec 09 22:07:55.985959 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-16786468-f5c8-4315-a360-197d9823af87 req-99a719ff-2243-4139-8fca-a6e805618d3b tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] For port 0b27d59f-1b96-4f39-ab74-4dde82deb244, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=0b27d59f-1b96-4f39-ab74-4dde82deb244,segment=NetworkSegment(bb19ea59-b907-4a2f-a9d7-f47a74902855),segment_id=bb19ea59-b907-4a2f-a9d7-f47a74902855)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:07:55.986288 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-16786468-f5c8-4315-a360-197d9823af87 req-99a719ff-2243-4139-8fca-a6e805618d3b tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:56.000143 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-16786468-f5c8-4315-a360-197d9823af87 req-99a719ff-2243-4139-8fca-a6e805618d3b tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Calling delete_port for 0b27d59f-1b96-4f39-ab74-4dde82deb244 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:07:56.145028 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-16786468-f5c8-4315-a360-197d9823af87 req-99a719ff-2243-4139-8fca-a6e805618d3b tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:56.156943 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['0b27d59f-1b96-4f39-ab74-4dde82deb244'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:07:56.172996 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99a719ff-2243-4139-8fca-a6e805618d3b tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Pushing event deleted for resources: {'Port': ['ID=0b27d59f-1b96-4f39-ab74-4dde82deb244,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:07:56.213177 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-16786468-f5c8-4315-a360-197d9823af87 req-99a719ff-2243-4139-8fca-a6e805618d3b tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] No DVR routers for this DVR port 0b27d59f-1b96-4f39-ab74-4dde82deb244 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:07:56.215882 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-16786468-f5c8-4315-a360-197d9823af87 req-99a719ff-2243-4139-8fca-a6e805618d3b tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:56.219247 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-16786468-f5c8-4315-a360-197d9823af87 req-99a719ff-2243-4139-8fca-a6e805618d3b tempest-ServerDiskConfigTestJSON-1252872366 tempest-ServerDiskConfigTestJSON-1252872366-project] 10.222.0.31 "DELETE /v2.0/ports/0b27d59f-1b96-4f39-ab74-4dde82deb244 HTTP/1.1" status: 204 len: 173 time: 0.4215257 Dec 09 22:07:56.219708 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '511cdfd7-3413-4420-8290-90169e7ba169', 'name': 'network-vif-deleted', 'tag': '0b27d59f-1b96-4f39-ab74-4dde82deb244'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:07:56.221951 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5b57f5e0-49e3-4807-ad45-e0b273de631b" -d '{"events": [{"server_uuid": "511cdfd7-3413-4420-8290-90169e7ba169", "name": "network-vif-deleted", "tag": "0b27d59f-1b96-4f39-ab74-4dde82deb244"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:07:56.265971 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:07:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-86fe909b-62f7-4e57-8e70-68b56b8addb6 x-openstack-request-id: req-86fe909b-62f7-4e57-8e70-68b56b8addb6 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:07:56.266267 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "511cdfd7-3413-4420-8290-90169e7ba169", "name": "network-vif-deleted", "tag": "0b27d59f-1b96-4f39-ab74-4dde82deb244", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:07:56.266555 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-86fe909b-62f7-4e57-8e70-68b56b8addb6 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:07:56.266966 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '511cdfd7-3413-4420-8290-90169e7ba169', 'name': 'network-vif-deleted', 'tag': '0b27d59f-1b96-4f39-ab74-4dde82deb244', 'status': 'completed', 'code': 200} Dec 09 22:07:57.020685 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59228) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:07:57.069767 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-13366bd1-1d9a-4fa4-871c-d9bc349299bc admin admin] Deleting subnet 2d05eb0f-5210-4210-a0bf-465840e19241 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:07:57.073241 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-13366bd1-1d9a-4fa4-871c-d9bc349299bc admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:57.107432 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-13366bd1-1d9a-4fa4-871c-d9bc349299bc admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:57.146879 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-13366bd1-1d9a-4fa4-871c-d9bc349299bc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:57.204355 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-13366bd1-1d9a-4fa4-871c-d9bc349299bc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:57.229573 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13366bd1-1d9a-4fa4-871c-d9bc349299bc admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2d05eb0f-5210-4210-a0bf-465840e19241,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:07:57.233537 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-13366bd1-1d9a-4fa4-871c-d9bc349299bc admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:57.236832 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-13366bd1-1d9a-4fa4-871c-d9bc349299bc admin admin] 10.222.0.13 "DELETE /v2.0/subnets/2d05eb0f-5210-4210-a0bf-465840e19241 HTTP/1.1" status: 204 len: 168 time: 0.2151403 Dec 09 22:07:57.240226 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59230) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:07:57.316365 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-64cfe4bb-7aad-4641-956b-b38447f3c7d4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:57.399125 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-64cfe4bb-7aad-4641-956b-b38447f3c7d4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:57.420391 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-64cfe4bb-7aad-4641-956b-b38447f3c7d4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fcd51eae-6fa3-41c8-9622-47a1ed852c66']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:07:57.433232 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-64cfe4bb-7aad-4641-956b-b38447f3c7d4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bb19ea59-b907-4a2f-a9d7-f47a74902855') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:07:57.433662 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-64cfe4bb-7aad-4641-956b-b38447f3c7d4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bb19ea59-b907-4a2f-a9d7-f47a74902855') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:07:57.448109 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-64cfe4bb-7aad-4641-956b-b38447f3c7d4 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:57.463833 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-64cfe4bb-7aad-4641-956b-b38447f3c7d4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:57.472670 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-64cfe4bb-7aad-4641-956b-b38447f3c7d4 admin admin] Releasing vlan 136 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:07:57.473288 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-64cfe4bb-7aad-4641-956b-b38447f3c7d4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: timer() Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:07:57.475655 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:07:57.533064 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-64cfe4bb-7aad-4641-956b-b38447f3c7d4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:57.548513 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-64cfe4bb-7aad-4641-956b-b38447f3c7d4 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:57.551977 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:57.552484 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-64cfe4bb-7aad-4641-956b-b38447f3c7d4 admin admin] 10.222.0.13 "DELETE /v2.0/networks/fcd51eae-6fa3-41c8-9622-47a1ed852c66 HTTP/1.1" status: 204 len: 168 time: 0.3108582 Dec 09 22:07:57.555537 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64cfe4bb-7aad-4641-956b-b38447f3c7d4 admin admin] Pushing event deleted for resources: {'Network': ['ID=fcd51eae-6fa3-41c8-9622-47a1ed852c66,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:07:57.663853 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59234) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:07:57.708086 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f3a6f0ab-7193-4d5a-84f2-728af0a60854 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=4e6e98b6ce8149c49f718a22c26736d8&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0430336 Dec 09 22:07:57.711169 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59236) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:07:57.713808 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:57.761976 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-47e9a35c-59a9-49f2-8d7c-80bed833812f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:57.785925 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-47e9a35c-59a9-49f2-8d7c-80bed833812f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:57.845924 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-47e9a35c-59a9-49f2-8d7c-80bed833812f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:57.848635 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-47e9a35c-59a9-49f2-8d7c-80bed833812f admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:57.849816 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-47e9a35c-59a9-49f2-8d7c-80bed833812f admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/44fb00aa-12b9-43e2-9356-e9fcf03af445 HTTP/1.1" status: 204 len: 168 time: 0.1376789 Dec 09 22:07:57.859162 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47e9a35c-59a9-49f2-8d7c-80bed833812f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=44fb00aa-12b9-43e2-9356-e9fcf03af445,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:07:58.559675 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59258) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:07:58.662545 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c91fed19-1de5-4875-9812-2b0abf99fb64 admin admin] Request body: {'network': {'name': 'tempest-ServerActionsTestJSON-1978455332-network', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:07:58.688340 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c91fed19-1de5-4875-9812-2b0abf99fb64 admin admin] Made reservation on behalf of ecd32dac944041b58de1a396ec18cd2c for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:07:58.691914 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c91fed19-1de5-4875-9812-2b0abf99fb64 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:58.705415 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c91fed19-1de5-4875-9812-2b0abf99fb64 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:58.794496 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c91fed19-1de5-4875-9812-2b0abf99fb64 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:58.800344 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c91fed19-1de5-4875-9812-2b0abf99fb64 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:58.821394 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c91fed19-1de5-4875-9812-2b0abf99fb64 admin admin] vlan segment allocate from pool success with {'vlan_id': 149, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 22:07:58.837561 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c91fed19-1de5-4875-9812-2b0abf99fb64 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5ea41c71-ea38-4a77-96f9-63d9b0ec498c,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:07:58.840542 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c91fed19-1de5-4875-9812-2b0abf99fb64 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:58.840891 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-c91fed19-1de5-4875-9812-2b0abf99fb64 admin admin] Added segment a7afa2ad-9134-4da5-a606-e7c776822e63 of type vlan for network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec Dec 09 22:07:58.880934 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c91fed19-1de5-4875-9812-2b0abf99fb64 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:58.908912 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c91fed19-1de5-4875-9812-2b0abf99fb64 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:58.909958 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c91fed19-1de5-4875-9812-2b0abf99fb64 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:58.910551 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c91fed19-1de5-4875-9812-2b0abf99fb64 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:58.944448 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c91fed19-1de5-4875-9812-2b0abf99fb64 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.3835902 Dec 09 22:07:58.947520 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59262) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:07:58.952770 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-36e1c9c6-b446-402e-8a42-d3114579a9e2 admin admin] Request body: {'subnet': {'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerActionsTestJSON-1978455332-subnet', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:07:58.975708 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c91fed19-1de5-4875-9812-2b0abf99fb64 admin admin] Pushing event updated for resources: {'Network': ['ID=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:07:58.976252 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-36e1c9c6-b446-402e-8a42-d3114579a9e2 admin admin] Made reservation on behalf of ecd32dac944041b58de1a396ec18cd2c for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:07:58.980000 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-36e1c9c6-b446-402e-8a42-d3114579a9e2 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:58.987206 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 22:07:59.156452 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-36e1c9c6-b446-402e-8a42-d3114579a9e2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:59.214715 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36e1c9c6-b446-402e-8a42-d3114579a9e2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=88c86202-31f6-4618-8f06-f2283fac961c,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:07:59.230648 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36e1c9c6-b446-402e-8a42-d3114579a9e2 admin admin] Checking segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:07:59.231474 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36e1c9c6-b446-402e-8a42-d3114579a9e2 admin admin] Network hostable DHCP agents. Network: 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 22:07:59.249062 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-36e1c9c6-b446-402e-8a42-d3114579a9e2 admin admin] Network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 22:07:59.261038 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-36e1c9c6-b446-402e-8a42-d3114579a9e2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:07:59.268770 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-36e1c9c6-b446-402e-8a42-d3114579a9e2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:07:59.270011 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-36e1c9c6-b446-402e-8a42-d3114579a9e2 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:59.273186 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b35ff27-03ce-4759-9ec2-a46435e595b3 None None] Network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:07:59.291037 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-36e1c9c6-b446-402e-8a42-d3114579a9e2 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.3398533 Dec 09 22:07:59.291235 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59264) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:07:59.295816 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-cde93c9c-b3f1-4e3d-9214-ac991cc71746 admin admin] Request body: {'router': {'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:07:59.318798 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cde93c9c-b3f1-4e3d-9214-ac991cc71746 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:59.319949 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cde93c9c-b3f1-4e3d-9214-ac991cc71746 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:59.376969 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cde93c9c-b3f1-4e3d-9214-ac991cc71746 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:59.381536 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-064982b4-9869-41c5-9545-abf312fa41b4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 22:07:59.382547 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-064982b4-9869-41c5-9545-abf312fa41b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:59.519136 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-064982b4-9869-41c5-9545-abf312fa41b4 None None] Allocated IP 172.20.0.2 (91a989ca-03f4-4cf9-a2af-b26f8b1a2bec/88c86202-31f6-4618-8f06-f2283fac961c/3af4e820-b4a0-4171-8821-93844e0562c3) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:07:59.520080 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cde93c9c-b3f1-4e3d-9214-ac991cc71746 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:59.661283 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-064982b4-9869-41c5-9545-abf312fa41b4 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:59.668107 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-064982b4-9869-41c5-9545-abf312fa41b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:59.705568 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-064982b4-9869-41c5-9545-abf312fa41b4 None None] Network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:07:59.712687 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-064982b4-9869-41c5-9545-abf312fa41b4 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:07:59.717356 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-064982b4-9869-41c5-9545-abf312fa41b4 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:07:59.719319 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-064982b4-9869-41c5-9545-abf312fa41b4 None None] Pushing event updated for resources: {'Port': ['ID=3af4e820-b4a0-4171-8821-93844e0562c3,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:07:59.720408 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cde93c9c-b3f1-4e3d-9214-ac991cc71746 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:59.741995 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cde93c9c-b3f1-4e3d-9214-ac991cc71746 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:59.772788 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-064982b4-9869-41c5-9545-abf312fa41b4 None None] Attempting to bind port 3af4e820-b4a0-4171-8821-93844e0562c3 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:07:59.773076 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-064982b4-9869-41c5-9545-abf312fa41b4 None None] Attempting to bind port 3af4e820-b4a0-4171-8821-93844e0562c3 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:07:59.773460 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-064982b4-9869-41c5-9545-abf312fa41b4 None None] Attempting to bind port 3af4e820-b4a0-4171-8821-93844e0562c3 on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:07:59.778629 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-064982b4-9869-41c5-9545-abf312fa41b4 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 7, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:07:59.779005 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-064982b4-9869-41c5-9545-abf312fa41b4 None None] Checking segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:07:59.779413 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-064982b4-9869-41c5-9545-abf312fa41b4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:59.779871 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-064982b4-9869-41c5-9545-abf312fa41b4 None None] Bound using segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:07:59.780346 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-064982b4-9869-41c5-9545-abf312fa41b4 None None] Bound port: 3af4e820-b4a0-4171-8821-93844e0562c3, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:07:59.780722 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-064982b4-9869-41c5-9545-abf312fa41b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:59.847319 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-064982b4-9869-41c5-9545-abf312fa41b4 None None] For port 3af4e820-b4a0-4171-8821-93844e0562c3, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:07:59.850447 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-cde93c9c-b3f1-4e3d-9214-ac991cc71746 admin admin] Allocated IP 172.25.3.128 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/cbd45403-82fe-4c33-9dfa-acddcbec6a8f) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:07:59.850592 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-064982b4-9869-41c5-9545-abf312fa41b4 None None] For port 3af4e820-b4a0-4171-8821-93844e0562c3, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=3af4e820-b4a0-4171-8821-93844e0562c3,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:07:59.856730 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-064982b4-9869-41c5-9545-abf312fa41b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:59.913732 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-064982b4-9869-41c5-9545-abf312fa41b4 None None] Pushing event updated for resources: {'Port': ['ID=3af4e820-b4a0-4171-8821-93844e0562c3,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:07:59.947508 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 0b27d59f-1b96-4f39-ab74-4dde82deb244 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:07:59.959073 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cde93c9c-b3f1-4e3d-9214-ac991cc71746 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:07:59.970050 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 0b27d59f-1b96-4f39-ab74-4dde82deb244 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:07:59.970228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 0b27d59f-1b96-4f39-ab74-4dde82deb244 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:07:59.994345 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cde93c9c-b3f1-4e3d-9214-ac991cc71746 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:00.031428 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cde93c9c-b3f1-4e3d-9214-ac991cc71746 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:08:00.034345 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-cde93c9c-b3f1-4e3d-9214-ac991cc71746 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:08:00.037746 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cde93c9c-b3f1-4e3d-9214-ac991cc71746 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:08:00.067338 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1efe980f-b9b0-4233-ac90-a2e0043a8ab5 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:08:00.084106 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cde93c9c-b3f1-4e3d-9214-ac991cc71746 admin admin] Pushing event updated for resources: {'Port': ['ID=cbd45403-82fe-4c33-9dfa-acddcbec6a8f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:08:00.182716 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-67a82e47-97b6-43b9-b7e6-87df3e691e73 None None] Provisioning complete for port cbd45403-82fe-4c33-9dfa-acddcbec6a8f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:08:00.183197 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-67a82e47-97b6-43b9-b7e6-87df3e691e73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:00.221763 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-67a82e47-97b6-43b9-b7e6-87df3e691e73 None None] Port cbd45403-82fe-4c33-9dfa-acddcbec6a8f cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:08:00.681853 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cde93c9c-b3f1-4e3d-9214-ac991cc71746 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:00.774842 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-13da804c-4e76-4da1-ac9b-6a5bac526f52 None None] Network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:08:00.876501 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2530449a-3bab-415a-a533-d6de51a3653e None None] Provisioning complete for port 3af4e820-b4a0-4171-8821-93844e0562c3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:08:00.876728 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2530449a-3bab-415a-a533-d6de51a3653e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:00.893714 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cde93c9c-b3f1-4e3d-9214-ac991cc71746 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:00.963319 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2530449a-3bab-415a-a533-d6de51a3653e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:00.998749 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2530449a-3bab-415a-a533-d6de51a3653e None None] For port 3af4e820-b4a0-4171-8821-93844e0562c3, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=3af4e820-b4a0-4171-8821-93844e0562c3,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:08:01.004730 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2530449a-3bab-415a-a533-d6de51a3653e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:01.040738 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cde93c9c-b3f1-4e3d-9214-ac991cc71746 admin admin] Router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 22:08:01.058316 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2530449a-3bab-415a-a533-d6de51a3653e None None] Pushing event updated for resources: {'Port': ['ID=3af4e820-b4a0-4171-8821-93844e0562c3,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:08:01.129677 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-b56b26d9-cd4b-4e7f-9c24-9a69ac02e7b7 None None] Provisioning complete for port 3af4e820-b4a0-4171-8821-93844e0562c3 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:08:01.130353 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b56b26d9-cd4b-4e7f-9c24-9a69ac02e7b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:01.151902 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cde93c9c-b3f1-4e3d-9214-ac991cc71746 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:08:01.163692 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] Sync routers for ids ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:08:01.171764 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cde93c9c-b3f1-4e3d-9214-ac991cc71746 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:01.173044 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cde93c9c-b3f1-4e3d-9214-ac991cc71746 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 1.8807931 Dec 09 22:08:01.175621 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] Routers {'7e861ee9-d29c-4ade-a3ab-cce44cba2c97'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:08:01.175776 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59266) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:08:01.176816 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:07:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:08:01.284515 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] Set router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:08:01.461057 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:00Z', 'revision_number': 3, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:07:59Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:08:01.496051 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] Checking router: 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:08:01.496494 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] Updating router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 port cbd45403-82fe-4c33-9dfa-acddcbec6a8f binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:08:01.521559 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:01.606269 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-096bed7f-cf9f-4ff7-8993-d1d1509cc2aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:01.663748 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 3af4e820-b4a0-4171-8821-93844e0562c3 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:08:01.712942 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 3af4e820-b4a0-4171-8821-93844e0562c3 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:08:01.713230 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:01.780446 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-096bed7f-cf9f-4ff7-8993-d1d1509cc2aa admin admin] Allocated IP 172.20.0.1 (91a989ca-03f4-4cf9-a2af-b26f8b1a2bec/88c86202-31f6-4618-8f06-f2283fac961c/52d4a6b2-48f9-42e8-b835-607fc25683b7) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:08:01.782475 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:01.788700 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:01.833106 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fdcb8689-ae0c-4a24-a46c-46fb8468602c None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:08:01.834522 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] Attempting to bind port cbd45403-82fe-4c33-9dfa-acddcbec6a8f on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:08:01.834895 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] Attempting to bind port cbd45403-82fe-4c33-9dfa-acddcbec6a8f by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:08:01.835250 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] Attempting to bind port cbd45403-82fe-4c33-9dfa-acddcbec6a8f on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:08:01.843937 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 7, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:08:01.844302 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:08:01.844696 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:01.845072 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:08:01.845561 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] Bound port: cbd45403-82fe-4c33-9dfa-acddcbec6a8f, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:08:01.845935 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:01.880071 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-629e521e-794d-4901-8b92-1f0e5d0b8546 None None] Pushing event updated for resources: {'Port': ['ID=cbd45403-82fe-4c33-9dfa-acddcbec6a8f,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:08:01.897946 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629e521e-794d-4901-8b92-1f0e5d0b8546 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:01.898284 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629e521e-794d-4901-8b92-1f0e5d0b8546 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:01.898619 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629e521e-794d-4901-8b92-1f0e5d0b8546 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:01.898819 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-096bed7f-cf9f-4ff7-8993-d1d1509cc2aa admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:01.898933 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629e521e-794d-4901-8b92-1f0e5d0b8546 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:01.899255 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629e521e-794d-4901-8b92-1f0e5d0b8546 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:01.899832 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629e521e-794d-4901-8b92-1f0e5d0b8546 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:01.899965 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629e521e-794d-4901-8b92-1f0e5d0b8546 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:01.900218 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629e521e-794d-4901-8b92-1f0e5d0b8546 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:01.900530 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629e521e-794d-4901-8b92-1f0e5d0b8546 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:01.900837 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629e521e-794d-4901-8b92-1f0e5d0b8546 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:01.901150 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629e521e-794d-4901-8b92-1f0e5d0b8546 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:01.901644 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629e521e-794d-4901-8b92-1f0e5d0b8546 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:01.901788 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-629e521e-794d-4901-8b92-1f0e5d0b8546 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:01.914403 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] For port cbd45403-82fe-4c33-9dfa-acddcbec6a8f, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:08:01.917698 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] For port cbd45403-82fe-4c33-9dfa-acddcbec6a8f, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=cbd45403-82fe-4c33-9dfa-acddcbec6a8f,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:08:01.922032 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:01.937753 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-17d60b97-06c0-407b-9a8b-be5791e646d2 None None] Provisioning complete for port cbd45403-82fe-4c33-9dfa-acddcbec6a8f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:08:01.938078 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-096bed7f-cf9f-4ff7-8993-d1d1509cc2aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:01.938229 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-17d60b97-06c0-407b-9a8b-be5791e646d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:01.971927 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3065bc56-05b3-40fb-8ddc-538f72e16d43 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:08:01.976828 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] Routers {'7e861ee9-d29c-4ade-a3ab-cce44cba2c97'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:08:01.977185 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:07:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:08:01.983725 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-096bed7f-cf9f-4ff7-8993-d1d1509cc2aa admin admin] Network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:08:01.988493 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-096bed7f-cf9f-4ff7-8993-d1d1509cc2aa admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:08:01.997080 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-096bed7f-cf9f-4ff7-8993-d1d1509cc2aa admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:08:02.025639 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-17d60b97-06c0-407b-9a8b-be5791e646d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:02.025848 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-096bed7f-cf9f-4ff7-8993-d1d1509cc2aa admin admin] Pushing event updated for resources: {'Port': ['ID=52d4a6b2-48f9-42e8-b835-607fc25683b7,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:08:02.035167 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-629e521e-794d-4901-8b92-1f0e5d0b8546 None None] Pushing event updated for resources: {'Port': ['ID=cbd45403-82fe-4c33-9dfa-acddcbec6a8f,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:08:02.047829 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-17d60b97-06c0-407b-9a8b-be5791e646d2 None None] For port cbd45403-82fe-4c33-9dfa-acddcbec6a8f, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=cbd45403-82fe-4c33-9dfa-acddcbec6a8f,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:08:02.054052 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-17d60b97-06c0-407b-9a8b-be5791e646d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:02.059780 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-096bed7f-cf9f-4ff7-8993-d1d1509cc2aa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:02.121537 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17d60b97-06c0-407b-9a8b-be5791e646d2 None None] Pushing event updated for resources: {'Port': ['ID=cbd45403-82fe-4c33-9dfa-acddcbec6a8f,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:08:02.174775 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-677b58c4-1496-4152-b2fc-6adc3a750260 None None] Provisioning complete for port cbd45403-82fe-4c33-9dfa-acddcbec6a8f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:08:02.175489 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-677b58c4-1496-4152-b2fc-6adc3a750260 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:02.204632 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] Set router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:08:02.239468 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-096bed7f-cf9f-4ff7-8993-d1d1509cc2aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:02.384682 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6f692d57-659f-4370-8884-b8b8e500b50b None None] Provisioning complete for port 52d4a6b2-48f9-42e8-b835-607fc25683b7 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:08:02.384916 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6f692d57-659f-4370-8884-b8b8e500b50b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:02.389169 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:00Z', 'revision_number': 3, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:08:02.408667 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-096bed7f-cf9f-4ff7-8993-d1d1509cc2aa admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:02.414944 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-096bed7f-cf9f-4ff7-8993-d1d1509cc2aa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:02.422188 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c3823aa6-2ba6-44c0-9722-773d68b22e7a None None] The sync data for ids ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'] in n-d-713301-27 is: [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:00Z', 'revision_number': 3, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:08:02.424221 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-6f692d57-659f-4370-8884-b8b8e500b50b None None] Port 52d4a6b2-48f9-42e8-b835-607fc25683b7 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:08:02.487193 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-096bed7f-cf9f-4ff7-8993-d1d1509cc2aa admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:02.488905 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-096bed7f-cf9f-4ff7-8993-d1d1509cc2aa admin admin] Pushing event updated for resources: {'Port': ['ID=52d4a6b2-48f9-42e8-b835-607fc25683b7,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:08:02.589934 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-096bed7f-cf9f-4ff7-8993-d1d1509cc2aa admin admin] Network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:08:02.591542 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-096bed7f-cf9f-4ff7-8993-d1d1509cc2aa admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:08:02.725605 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-096bed7f-cf9f-4ff7-8993-d1d1509cc2aa admin admin] Router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:08:02.857118 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-096bed7f-cf9f-4ff7-8993-d1d1509cc2aa admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:08:02.866558 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-096bed7f-cf9f-4ff7-8993-d1d1509cc2aa admin admin] 10.222.0.13 "PUT /v2.0/routers/7e861ee9-d29c-4ade-a3ab-cce44cba2c97/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6856649 Dec 09 22:08:02.957207 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3960725b-6eb1-46b9-a686-22cb58c1d56c None None] Provisioning complete for port 52d4a6b2-48f9-42e8-b835-607fc25683b7 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:08:02.957697 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3960725b-6eb1-46b9-a686-22cb58c1d56c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:03.005644 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-3960725b-6eb1-46b9-a686-22cb58c1d56c None None] Port 52d4a6b2-48f9-42e8-b835-607fc25683b7 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:08:03.010205 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-28cb0923-1670-454d-99ad-ae03997f9ed6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:03.453494 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59274) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:08:03.458185 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a36548c2-1588-49f6-b243-61fd33926f0d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1276791935', 'description': 'tempest-description--792125319'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:08:03.485885 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a36548c2-1588-49f6-b243-61fd33926f0d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:03.554068 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a36548c2-1588-49f6-b243-61fd33926f0d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:03.559391 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a36548c2-1588-49f6-b243-61fd33926f0d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:03.590930 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a36548c2-1588-49f6-b243-61fd33926f0d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:03.592194 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a36548c2-1588-49f6-b243-61fd33926f0d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1798 time: 0.1377039 Dec 09 22:08:03.595042 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 59276) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:08:03.600435 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-1f4aca67-6c18-42c6-b090-789f2598fee8 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Request body: {'security_group_rule': {'security_group_id': 'fc389abb-6202-4d61-870a-d6749ba1a635', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:08:03.606640 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a36548c2-1588-49f6-b243-61fd33926f0d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fc389abb-6202-4d61-870a-d6749ba1a635,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:08:03.638912 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1f4aca67-6c18-42c6-b090-789f2598fee8 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:03.664314 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device cbd45403-82fe-4c33-9dfa-acddcbec6a8f up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:08:03.707566 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1f4aca67-6c18-42c6-b090-789f2598fee8 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:03.711910 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1f4aca67-6c18-42c6-b090-789f2598fee8 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:03.716479 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port cbd45403-82fe-4c33-9dfa-acddcbec6a8f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:08:03.716854 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:03.733378 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f4aca67-6c18-42c6-b090-789f2598fee8 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f1ccf791-24a6-4a89-a831-715c7e0363e7,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:08:03.739597 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1f4aca67-6c18-42c6-b090-789f2598fee8 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:03.740831 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1f4aca67-6c18-42c6-b090-789f2598fee8 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1446514 Dec 09 22:08:03.743720 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59278) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:08:03.748469 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-854e00e6-d60c-43e1-9a2a-7e664c14f5ae tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Request body: {'security_group_rule': {'security_group_id': 'fc389abb-6202-4d61-870a-d6749ba1a635', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:08:03.776969 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-854e00e6-d60c-43e1-9a2a-7e664c14f5ae tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:03.847076 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-854e00e6-d60c-43e1-9a2a-7e664c14f5ae tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:03.852015 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-854e00e6-d60c-43e1-9a2a-7e664c14f5ae tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:03.870258 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-854e00e6-d60c-43e1-9a2a-7e664c14f5ae tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b0106738-7cc2-4512-a7ed-4418583bcd9c,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:08:03.879684 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-854e00e6-d60c-43e1-9a2a-7e664c14f5ae tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:03.880910 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-854e00e6-d60c-43e1-9a2a-7e664c14f5ae tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1361680 Dec 09 22:08:03.884103 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59280) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:08:03.888928 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:08:03.911031 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:03.960496 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] Sync routers for ids ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:08:03.970708 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] Routers {'7e861ee9-d29c-4ade-a3ab-cce44cba2c97'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:08:03.971327 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:07:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:08:04.018817 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:04.075942 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] Set router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:08:04.121179 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Allocated IP 172.25.3.185 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/7faa465b-785a-449e-89df-cc9d716fca67) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:08:04.225676 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:04.270270 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:04.293776 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 2, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:08:04.333351 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:08:04.342201 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] Checking router: 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:08:04.342758 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] Updating router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 port 52d4a6b2-48f9-42e8-b835-607fc25683b7 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:08:04.345470 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:08:04.348642 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Pushing event updated for resources: {'Port': ['ID=7faa465b-785a-449e-89df-cc9d716fca67,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:08:04.351989 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:08:04.370979 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:04.444739 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:04.478800 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:04.645348 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:04.651758 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:04.719033 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Pushing event updated for resources: {'Port': ['ID=7faa465b-785a-449e-89df-cc9d716fca67,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:08:04.731420 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:04.731706 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:04.732048 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:04.732381 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:04.732710 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:04.733037 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:04.733365 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:04.733684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:04.734002 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:04.734319 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:04.734641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:04.734958 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:04.735273 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:08:04.743887 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:04.759716 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:04.761092 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9794bd7e-1973-488e-8a9f-8681cbd173b5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 0.8759854 Dec 09 22:08:04.804580 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:04.811907 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:04.859617 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaac6991-f488-482b-af16-10fe0264dc63 None None] Pushing event updated for resources: {'Port': ['ID=52d4a6b2-48f9-42e8-b835-607fc25683b7,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:08:04.912179 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] Attempting to bind port 52d4a6b2-48f9-42e8-b835-607fc25683b7 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:08:04.912559 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] Attempting to bind port 52d4a6b2-48f9-42e8-b835-607fc25683b7 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:08:04.912932 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] Attempting to bind port 52d4a6b2-48f9-42e8-b835-607fc25683b7 on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:08:04.918245 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 7, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:08:04.918626 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] Checking segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:08:04.919039 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:04.919467 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] Bound using segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:08:04.921172 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] Bound port: 52d4a6b2-48f9-42e8-b835-607fc25683b7, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:08:04.921172 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:04.935571 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-8303315a-bda4-4b77-b20c-59817f4c18ed tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-securitygroup--1276791935&fields=id&tenant_id=ecd32dac944041b58de1a396ec18cd2c HTTP/1.1" status: 200 len: 267 time: 0.0459232 Dec 09 22:08:04.990525 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] For port 52d4a6b2-48f9-42e8-b835-607fc25683b7, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:08:04.993740 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] For port 52d4a6b2-48f9-42e8-b835-607fc25683b7, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=52d4a6b2-48f9-42e8-b835-607fc25683b7,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:08:05.000172 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:05.058454 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-5a9a97ba-f27f-4684-8a96-22cc618d9270 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:05.060136 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-5a9a97ba-f27f-4684-8a96-22cc618d9270 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 812 time: 0.1157842 Dec 09 22:08:05.061327 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] Routers {'7e861ee9-d29c-4ade-a3ab-cce44cba2c97'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:08:05.061972 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:07:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:08:05.066885 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaac6991-f488-482b-af16-10fe0264dc63 None None] Pushing event updated for resources: {'Port': ['ID=52d4a6b2-48f9-42e8-b835-607fc25683b7,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:08:05.078836 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-d65d0106-10df-4a76-b598-5adeb87c0626 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/quotas/ecd32dac944041b58de1a396ec18cd2c HTTP/1.1" status: 200 len: 375 time: 0.0116606 Dec 09 22:08:05.141386 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-f51ed94d-a242-444c-ac56-fd94b045b553 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0518799 Dec 09 22:08:05.183345 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-20ca406e-b04b-4245-a864-4834b6e9b060 None None] Provisioning complete for port 52d4a6b2-48f9-42e8-b835-607fc25683b7 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:08:05.183895 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-20ca406e-b04b-4245-a864-4834b6e9b060 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:05.205253 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] Set router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:08:05.244961 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-bfc283c0-6584-4a05-901c-2d5ed9c888c8 service neutron] 10.222.0.13 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0904453 Dec 09 22:08:05.333264 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-c8f6adae-4d7e-4588-9315-aeb2e5fa5c28 service neutron] 10.222.0.13 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0818405 Dec 09 22:08:05.385413 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-20ca406e-b04b-4245-a864-4834b6e9b060 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:05.451063 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-20ca406e-b04b-4245-a864-4834b6e9b060 None None] For port 52d4a6b2-48f9-42e8-b835-607fc25683b7, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=52d4a6b2-48f9-42e8-b835-607fc25683b7,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:08:05.458693 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-20ca406e-b04b-4245-a864-4834b6e9b060 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:05.506540 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e8e96d1-1a61-48b7-a617-fa1e4f4c7ed1 req-ff0effb8-3c4b-4298-ade2-167970e6a772 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 210 time: 0.0343506 Dec 09 22:08:05.527809 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20ca406e-b04b-4245-a864-4834b6e9b060 None None] Pushing event updated for resources: {'Port': ['ID=52d4a6b2-48f9-42e8-b835-607fc25683b7,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:08:05.527809 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:04Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:08:05.559383 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fe47775-c2a7-459c-85cc-ac3abec1e76d None None] The sync data for ids ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'] in n-d-713301-27 is: [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:04Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:08:05.581286 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7c17ce2a-e25f-4cda-b721-85dc4604f0c9 None None] Provisioning complete for port 52d4a6b2-48f9-42e8-b835-607fc25683b7 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:08:05.581595 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7c17ce2a-e25f-4cda-b721-85dc4604f0c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:05.665278 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-294f3b88-a335-4915-8fc6-3ef628e3b958 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:06.522610 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-ca63d1e3-2b46-4f63-b47c-d486f6db621c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:06.524221 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-ca63d1e3-2b46-4f63-b47c-d486f6db621c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.10 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 812 time: 0.1144345 Dec 09 22:08:06.598908 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-39572a5c-38a0-4a39-bec8-1d62b3ce76a0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.10 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ecd32dac944041b58de1a396ec18cd2c HTTP/1.1" status: 200 len: 380 time: 0.0641868 Dec 09 22:08:06.609272 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-204ea424-764a-4f48-a6dd-dd0ba4ca2873 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Request body: {'port': {'device_id': '4e0535c2-518e-45d6-8033-4ccf3b4927b1', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'admin_state_up': True, 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'security_groups': ['fc389abb-6202-4d61-870a-d6749ba1a635']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:08:06.613421 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d77f6fda-e344-4485-8b4f-11e2f8018528 req-cfeedfeb-c694-4623-8f78-06d383058efb tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 210 time: 0.0290678 Dec 09 22:08:06.744814 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-204ea424-764a-4f48-a6dd-dd0ba4ca2873 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Made reservation on behalf of ecd32dac944041b58de1a396ec18cd2c for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:08:06.748489 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-204ea424-764a-4f48-a6dd-dd0ba4ca2873 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:06.778389 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:06.876011 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-204ea424-764a-4f48-a6dd-dd0ba4ca2873 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Allocated IP 172.20.0.6 (91a989ca-03f4-4cf9-a2af-b26f8b1a2bec/88c86202-31f6-4618-8f06-f2283fac961c/9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:08:07.019794 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-204ea424-764a-4f48-a6dd-dd0ba4ca2873 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:07.054684 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-204ea424-764a-4f48-a6dd-dd0ba4ca2873 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:07.095344 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-204ea424-764a-4f48-a6dd-dd0ba4ca2873 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:08:07.098552 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-204ea424-764a-4f48-a6dd-dd0ba4ca2873 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:08:07.102285 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-204ea424-764a-4f48-a6dd-dd0ba4ca2873 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:08:07.146303 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-204ea424-764a-4f48-a6dd-dd0ba4ca2873 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Pushing event updated for resources: {'Port': ['ID=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:08:07.164444 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-204ea424-764a-4f48-a6dd-dd0ba4ca2873 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:07.165098 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-204ea424-764a-4f48-a6dd-dd0ba4ca2873 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:07.184033 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-204ea424-764a-4f48-a6dd-dd0ba4ca2873 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5792427 Dec 09 22:08:07.196777 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-f6884f08-8352-4b56-bb51-4bf24205c368 service neutron] Request body: {'port': {'device_id': '4e0535c2-518e-45d6-8033-4ccf3b4927b1', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:08:07.259202 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-f6884f08-8352-4b56-bb51-4bf24205c368 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:07.331247 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7f8d3c17-add6-4a52-8056-3c66003e4c81 None None] Provisioning complete for port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:08:07.331646 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7f8d3c17-add6-4a52-8056-3c66003e4c81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:07.377761 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-7f8d3c17-add6-4a52-8056-3c66003e4c81 None None] Port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:08:07.668738 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 52d4a6b2-48f9-42e8-b835-607fc25683b7 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:08:07.733578 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 52d4a6b2-48f9-42e8-b835-607fc25683b7 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:08:07.734234 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:07.747259 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e821ad4-0eea-4445-b283-8eca9d5b37db req-cce2f94d-5207-4c4d-8b1a-46ee1010316b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:07.749490 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e821ad4-0eea-4445-b283-8eca9d5b37db req-cce2f94d-5207-4c4d-8b1a-46ee1010316b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 931 time: 0.0596282 Dec 09 22:08:07.806177 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e821ad4-0eea-4445-b283-8eca9d5b37db req-669285bf-6ece-4c40-a27d-4cca460eaa61 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0498009 Dec 09 22:08:07.929066 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-f6884f08-8352-4b56-bb51-4bf24205c368 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:08:07.936650 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-f6884f08-8352-4b56-bb51-4bf24205c368 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:07.948356 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-f6884f08-8352-4b56-bb51-4bf24205c368 service neutron] Transition to ACTIVE for port object 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:08:07.955653 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-f6884f08-8352-4b56-bb51-4bf24205c368 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:08.004385 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6884f08-8352-4b56-bb51-4bf24205c368 service neutron] Pushing event updated for resources: {'Port': ['ID=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:08:08.099302 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-f6884f08-8352-4b56-bb51-4bf24205c368 service neutron] Attempting to bind port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:08:08.099679 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-f6884f08-8352-4b56-bb51-4bf24205c368 service neutron] Attempting to bind port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:08:08.100028 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-f6884f08-8352-4b56-bb51-4bf24205c368 service neutron] Attempting to bind port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:08:08.107635 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-f6884f08-8352-4b56-bb51-4bf24205c368 service neutron] Port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:08:08.108210 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-f6884f08-8352-4b56-bb51-4bf24205c368 service neutron] Attempting to bind port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:08:08.114110 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:08.116262 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-f6884f08-8352-4b56-bb51-4bf24205c368 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 7, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:08:08.116605 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-f6884f08-8352-4b56-bb51-4bf24205c368 service neutron] Checking segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:08:08.116990 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-f6884f08-8352-4b56-bb51-4bf24205c368 service neutron] Bound using segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:08:08.117418 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-f6884f08-8352-4b56-bb51-4bf24205c368 service neutron] Bound port: 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:08:08.117812 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-f6884f08-8352-4b56-bb51-4bf24205c368 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:08.184440 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-f6884f08-8352-4b56-bb51-4bf24205c368 service neutron] For port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:08:08.188020 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-f6884f08-8352-4b56-bb51-4bf24205c368 service neutron] For port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:08:08.193261 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-f6884f08-8352-4b56-bb51-4bf24205c368 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:08.227199 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-f6884f08-8352-4b56-bb51-4bf24205c368 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:08.229482 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-f6884f08-8352-4b56-bb51-4bf24205c368 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:08.231481 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-f6884f08-8352-4b56-bb51-4bf24205c368 service neutron] 10.222.0.10 "PUT /v2.0/ports/9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b HTTP/1.1" status: 200 len: 1092 time: 1.0388894 Dec 09 22:08:08.231911 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4e0535c2-518e-45d6-8033-4ccf3b4927b1', 'tag': '9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:08:08.234508 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-255e081d-5439-4ced-a1c4-bd225a2224ad" -d '{"events": [{"name": "network-changed", "server_uuid": "4e0535c2-518e-45d6-8033-4ccf3b4927b1", "tag": "9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:08:08.263496 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6884f08-8352-4b56-bb51-4bf24205c368 service neutron] Pushing event updated for resources: {'Port': ['ID=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:08:08.283079 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:08:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f56a440a-2703-454c-955f-9b89b89416dc x-openstack-request-id: req-f56a440a-2703-454c-955f-9b89b89416dc {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:08:08.283381 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4e0535c2-518e-45d6-8033-4ccf3b4927b1", "tag": "9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:08:08.283873 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f56a440a-2703-454c-955f-9b89b89416dc {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:08:08.284292 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4e0535c2-518e-45d6-8033-4ccf3b4927b1', 'tag': '9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b', 'status': 'completed', 'code': 200} Dec 09 22:08:08.333744 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-12d232e4-7956-475f-ab51-605b89d082f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:08.335389 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-12d232e4-7956-475f-ab51-605b89d082f5 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 1095 time: 0.0493989 Dec 09 22:08:08.386096 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-4edf6ade-de24-4e0a-910b-ad391ab4e6af service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b HTTP/1.1" status: 200 len: 217 time: 0.0408206 Dec 09 22:08:08.437756 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-df5ada67-734e-4a4f-b3e5-259a1971db4d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:08.439186 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-df5ada67-734e-4a4f-b3e5-259a1971db4d service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0466640 Dec 09 22:08:08.485861 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-d7dbf7e3-94f9-4c25-bfe0-0b7d514dc821 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:08.487412 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-d7dbf7e3-94f9-4c25-bfe0-0b7d514dc821 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0411065 Dec 09 22:08:08.592304 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-abc780d7-0c95-4f93-a593-7d8d3856f50b service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0974593 Dec 09 22:08:08.694805 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86a857ed-5cb7-4756-9f2d-83126b77f0b0 req-56be0c9f-8312-44e5-b714-bc26252addeb service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0949254 Dec 09 22:08:08.804424 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-255e081d-5439-4ced-a1c4-bd225a2224ad req-42fb2ed2-d746-4ede-a39c-55b985712e2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:08.806015 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-255e081d-5439-4ced-a1c4-bd225a2224ad req-42fb2ed2-d746-4ede-a39c-55b985712e2a service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 1095 time: 0.0493441 Dec 09 22:08:08.902513 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-255e081d-5439-4ced-a1c4-bd225a2224ad req-00e81aaf-3b17-4c2a-a4d3-0aa95079723f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:08.904239 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-255e081d-5439-4ced-a1c4-bd225a2224ad req-00e81aaf-3b17-4c2a-a4d3-0aa95079723f service neutron] 10.222.0.10 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0908163 Dec 09 22:08:08.926416 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d59f5a1-2b8d-426a-8437-ecc568998ece req-1dc0e4da-4d90-46b6-98ae-36ad7b7dbeae tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:08.927951 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5d59f5a1-2b8d-426a-8437-ecc568998ece req-1dc0e4da-4d90-46b6-98ae-36ad7b7dbeae tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 943 time: 0.0494809 Dec 09 22:08:08.952333 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-255e081d-5439-4ced-a1c4-bd225a2224ad req-c73f3b8f-2e23-4f6b-9073-5ec541d789ba service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b HTTP/1.1" status: 200 len: 217 time: 0.0402641 Dec 09 22:08:08.983286 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5d59f5a1-2b8d-426a-8437-ecc568998ece req-f104d8db-a724-49b4-90df-1b37a7fdc700 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0490224 Dec 09 22:08:09.003698 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-255e081d-5439-4ced-a1c4-bd225a2224ad req-2ba23b30-11ea-4bae-95ee-451a21388781 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:09.005201 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-255e081d-5439-4ced-a1c4-bd225a2224ad req-2ba23b30-11ea-4bae-95ee-451a21388781 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0454702 Dec 09 22:08:09.056010 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-255e081d-5439-4ced-a1c4-bd225a2224ad req-5793da81-1e09-426d-aae8-05d9853b042d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:09.057627 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-255e081d-5439-4ced-a1c4-bd225a2224ad req-5793da81-1e09-426d-aae8-05d9853b042d service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0445259 Dec 09 22:08:09.153533 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-255e081d-5439-4ced-a1c4-bd225a2224ad req-db2303ce-0a32-452d-9c08-9182be6073e5 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0883300 Dec 09 22:08:09.247299 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-255e081d-5439-4ced-a1c4-bd225a2224ad req-1a3464d8-594b-443a-9d78-597d6d2c8c9a service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0849340 Dec 09 22:08:09.664766 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:10.105382 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e0607d6-6ab2-42ed-9c06-e02a80ebf188 req-bc9e1d8b-8177-409b-aa9c-f6f060adb7bb tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:10.107166 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8e0607d6-6ab2-42ed-9c06-e02a80ebf188 req-bc9e1d8b-8177-409b-aa9c-f6f060adb7bb tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 943 time: 0.0530665 Dec 09 22:08:10.154853 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8e0607d6-6ab2-42ed-9c06-e02a80ebf188 req-56e9ac5d-c3dd-4592-91a8-5d0ed1a652ff tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415480 Dec 09 22:08:10.178197 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:08:10.282486 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:08:10.294901 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'port_id': '9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b', 'mac_address': 'fa:16:3e:0a:46:bf', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:08:10.334976 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:10.348779 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:08:10.369396 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:08:10.375657 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:10.431363 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:08:10.582997 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:08:11.278059 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cabd8ca-6701-4f58-9fad-d860c612636d req-71491df2-a6ab-4e62-9ebb-4c19b4561d2a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:11.279592 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6cabd8ca-6701-4f58-9fad-d860c612636d req-71491df2-a6ab-4e62-9ebb-4c19b4561d2a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 944 time: 0.0524890 Dec 09 22:08:11.332601 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6cabd8ca-6701-4f58-9fad-d860c612636d req-8aa16ece-868c-445a-b72b-9b022c46fb46 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468545 Dec 09 22:08:12.177748 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:08:12.231390 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:08:12.235109 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:08:12.235550 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:12.319318 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:12.345591 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4e0535c2-518e-45d6-8033-4ccf3b4927b1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:08:12.347968 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bf918658-e5fb-4009-86d4-4750f803a0f9" -d '{"events": [{"server_uuid": "4e0535c2-518e-45d6-8033-4ccf3b4927b1", "name": "network-vif-plugged", "status": "completed", "tag": "9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:08:12.361179 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:08:12.366631 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:12.391478 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:08:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6be4bef4-7ea5-4513-aee3-cc07b7d1146c x-openstack-request-id: req-6be4bef4-7ea5-4513-aee3-cc07b7d1146c {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:08:12.391634 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4e0535c2-518e-45d6-8033-4ccf3b4927b1", "name": "network-vif-plugged", "status": "completed", "tag": "9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:08:12.391906 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-6be4bef4-7ea5-4513-aee3-cc07b7d1146c {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:08:12.392284 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4e0535c2-518e-45d6-8033-4ccf3b4927b1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b', 'code': 200} Dec 09 22:08:12.422565 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:08:12.486517 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-447c9f0e-1c41-45f7-97c4-0ff4a702e88b req-b2e2a683-e542-4bbc-ba8f-ff4b57829ff3 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:12.488032 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-447c9f0e-1c41-45f7-97c4-0ff4a702e88b req-b2e2a683-e542-4bbc-ba8f-ff4b57829ff3 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 945 time: 0.0536253 Dec 09 22:08:12.497564 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-738d7cd8-e7cf-4a53-a132-1494de49a166 req-3d998a95-8302-4fb9-85fb-e8e101b2e299 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:12.499600 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-738d7cd8-e7cf-4a53-a132-1494de49a166 req-3d998a95-8302-4fb9-85fb-e8e101b2e299 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 1097 time: 0.0419831 Dec 09 22:08:12.537379 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-447c9f0e-1c41-45f7-97c4-0ff4a702e88b req-751a1a9d-75de-4305-8999-2c59bc5852dd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430489 Dec 09 22:08:12.550772 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-738d7cd8-e7cf-4a53-a132-1494de49a166 req-b2c60a0b-f8c7-48e6-b372-a219e505a1f1 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437529 Dec 09 22:08:13.664495 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c99d5a6-950c-4ca9-90bd-5dc7e7624e8c req-5d0f2a49-6978-4796-ae5c-d60943b91ac2 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:13.665977 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c99d5a6-950c-4ca9-90bd-5dc7e7624e8c req-5d0f2a49-6978-4796-ae5c-d60943b91ac2 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 945 time: 0.0525091 Dec 09 22:08:13.716842 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c99d5a6-950c-4ca9-90bd-5dc7e7624e8c req-f0cedce0-cc3a-4748-bc75-df7b782c0558 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421951 Dec 09 22:08:13.833333 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72270ada-ae2e-4d8f-a571-d04116c974cd req-28dbf0fd-4551-4b32-b04b-62a4e5047e75 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:13.834816 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-72270ada-ae2e-4d8f-a571-d04116c974cd req-28dbf0fd-4551-4b32-b04b-62a4e5047e75 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 945 time: 0.0535254 Dec 09 22:08:13.845093 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59324) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:08:13.851343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-3359f49f-ea04-4b7d-a322-03bbbac7aca0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Request body: {'floatingip': {'port_id': '9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:08:13.895714 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3359f49f-ea04-4b7d-a322-03bbbac7aca0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for floatingip, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:14.336378 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3359f49f-ea04-4b7d-a322-03bbbac7aca0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:14.342155 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3359f49f-ea04-4b7d-a322-03bbbac7aca0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:14.441421 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-3359f49f-ea04-4b7d-a322-03bbbac7aca0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Floating IP ded53112-c89a-4a62-a1b4-d803c592f310 associated. External IP: 172.25.3.185, port: 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b. Dec 09 22:08:14.653005 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3359f49f-ea04-4b7d-a322-03bbbac7aca0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:08:15.043552 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3359f49f-ea04-4b7d-a322-03bbbac7aca0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:08:15.048594 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3359f49f-ea04-4b7d-a322-03bbbac7aca0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:15.053964 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a023e58d-f52f-4841-9541-b0a23f07584c None None] Sync routers for ids ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:08:15.065276 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a023e58d-f52f-4841-9541-b0a23f07584c None None] Routers {'7e861ee9-d29c-4ade-a3ab-cce44cba2c97'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:08:15.065895 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a023e58d-f52f-4841-9541-b0a23f07584c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:08:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:08:15.079584 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3359f49f-ea04-4b7d-a322-03bbbac7aca0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "PUT /v2.0/floatingips/ded53112-c89a-4a62-a1b4-d803c592f310 HTTP/1.1" status: 200 len: 991 time: 1.2332575 Dec 09 22:08:15.080194 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4e0535c2-518e-45d6-8033-4ccf3b4927b1', 'tag': '9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:08:15.082468 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9220b3ac-40c4-4fce-8a85-49621f428ba1" -d '{"events": [{"name": "network-changed", "server_uuid": "4e0535c2-518e-45d6-8033-4ccf3b4927b1", "tag": "9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:08:15.172744 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:08:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8d07f4c0-97f4-49c9-9e1c-107ff9d5949b x-openstack-request-id: req-8d07f4c0-97f4-49c9-9e1c-107ff9d5949b {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:08:15.173012 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4e0535c2-518e-45d6-8033-4ccf3b4927b1", "tag": "9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:08:15.173281 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8d07f4c0-97f4-49c9-9e1c-107ff9d5949b {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:08:15.173720 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4e0535c2-518e-45d6-8033-4ccf3b4927b1', 'tag': '9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b', 'status': 'completed', 'code': 200} Dec 09 22:08:15.173858 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-a023e58d-f52f-4841-9541-b0a23f07584c None None] Set router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:08:15.238656 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9220b3ac-40c4-4fce-8a85-49621f428ba1 req-a6517bb3-c284-4297-90e5-a2c92215e57e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:15.240386 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9220b3ac-40c4-4fce-8a85-49621f428ba1 req-a6517bb3-c284-4297-90e5-a2c92215e57e service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 1097 time: 0.0442133 Dec 09 22:08:15.331590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9220b3ac-40c4-4fce-8a85-49621f428ba1 req-59d03a87-9f8a-4281-9d11-37801fb790c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:15.333018 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9220b3ac-40c4-4fce-8a85-49621f428ba1 req-59d03a87-9f8a-4281-9d11-37801fb790c7 service neutron] 10.222.0.10 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0840485 Dec 09 22:08:15.400188 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a023e58d-f52f-4841-9541-b0a23f07584c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'ded53112-c89a-4a62-a1b4-d803c592f310', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'floating_ip_address': '172.25.3.185', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'port_id': '9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4083, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'mac_address': 'fa:16:3e:0a:46:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e0535c2-518e-45d6-8033-4ccf3b4927b1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:08:04Z', 'updated_at': '2021-12-09T22:08:14Z', 'revision_number': 1, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:05Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:08:15.403859 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9220b3ac-40c4-4fce-8a85-49621f428ba1 req-00108d6a-f88d-43ee-8708-04edca184f8e service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b HTTP/1.1" status: 200 len: 999 time: 0.0633123 Dec 09 22:08:15.426071 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a023e58d-f52f-4841-9541-b0a23f07584c None None] Checking router: 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:08:15.434748 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a023e58d-f52f-4841-9541-b0a23f07584c None None] Routers {'7e861ee9-d29c-4ade-a3ab-cce44cba2c97'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:08:15.435390 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a023e58d-f52f-4841-9541-b0a23f07584c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:08:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:08:15.453453 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9220b3ac-40c4-4fce-8a85-49621f428ba1 req-64f8c35d-f4e7-4247-a5b8-f7012ac730af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:15.455000 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9220b3ac-40c4-4fce-8a85-49621f428ba1 req-64f8c35d-f4e7-4247-a5b8-f7012ac730af service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0447741 Dec 09 22:08:15.500112 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9220b3ac-40c4-4fce-8a85-49621f428ba1 req-ebeede1a-88e8-490a-805a-6f2c4812fb52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:15.502029 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9220b3ac-40c4-4fce-8a85-49621f428ba1 req-ebeede1a-88e8-490a-805a-6f2c4812fb52 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0397625 Dec 09 22:08:15.542157 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-a023e58d-f52f-4841-9541-b0a23f07584c None None] Set router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:08:15.599141 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9220b3ac-40c4-4fce-8a85-49621f428ba1 req-9870ec2d-92ce-41f2-be85-e96c8ccf2e44 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0898237 Dec 09 22:08:15.694402 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9220b3ac-40c4-4fce-8a85-49621f428ba1 req-b1a44aed-04c1-4fa1-82ed-243f71a86c69 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0877407 Dec 09 22:08:15.766916 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a023e58d-f52f-4841-9541-b0a23f07584c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'ded53112-c89a-4a62-a1b4-d803c592f310', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'floating_ip_address': '172.25.3.185', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'port_id': '9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4083, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'mac_address': 'fa:16:3e:0a:46:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e0535c2-518e-45d6-8033-4ccf3b4927b1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:08:04Z', 'updated_at': '2021-12-09T22:08:14Z', 'revision_number': 1, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:05Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:08:15.797327 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a023e58d-f52f-4841-9541-b0a23f07584c None None] The sync data for ids ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'] in n-d-713301-27 is: [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'ded53112-c89a-4a62-a1b4-d803c592f310', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'floating_ip_address': '172.25.3.185', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'port_id': '9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4083, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'mac_address': 'fa:16:3e:0a:46:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e0535c2-518e-45d6-8033-4ccf3b4927b1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:08:04Z', 'updated_at': '2021-12-09T22:08:14Z', 'revision_number': 1, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:05Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:08:16.013529 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b205b829-588b-4f5d-9fcf-a839a6316a9e None None] New status for floating IP ded53112-c89a-4a62-a1b4-d803c592f310: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:08:16.570812 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-f5e7f68b-9071-4e22-b784-67ffa1d11dbd req-8ae4f043-0717-40e2-834a-a1b5ee716beb service neutron] (103437) timed out ('10.222.0.31', 57653) {{(pid=103437) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 09 22:08:25.219308 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:08:27.561239 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:27.713424 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:33.006228 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-be931f2d-05bd-4a55-b3c9-5d4e87cd4f34 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:35.643715 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7455f8d5-44e5-4f59-807a-9b71d6bf4514 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:36.792532 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:38.120430 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:39.666648 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:43.827400 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fde7048e-00fe-46d4-bbfd-9b5f8cdf5891 req-c5cb752d-1687-4ffd-829d-624807cf2f4d service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0508304 Dec 09 22:08:43.923621 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fde7048e-00fe-46d4-bbfd-9b5f8cdf5891 req-55a2c72a-6772-4e35-bd90-25f2d8883607 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:43.925146 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fde7048e-00fe-46d4-bbfd-9b5f8cdf5891 req-55a2c72a-6772-4e35-bd90-25f2d8883607 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 1097 time: 0.0426195 Dec 09 22:08:44.037000 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fde7048e-00fe-46d4-bbfd-9b5f8cdf5891 req-01a80cd5-f372-413d-b223-2a4792be3c08 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:44.038972 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fde7048e-00fe-46d4-bbfd-9b5f8cdf5891 req-01a80cd5-f372-413d-b223-2a4792be3c08 service neutron] 10.222.0.10 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0929008 Dec 09 22:08:44.107851 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fde7048e-00fe-46d4-bbfd-9b5f8cdf5891 req-c586568f-819e-4cb8-afdc-8f755f529efb service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b HTTP/1.1" status: 200 len: 1001 time: 0.0617168 Dec 09 22:08:44.158166 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fde7048e-00fe-46d4-bbfd-9b5f8cdf5891 req-30f11518-571e-4d1a-b5ae-247b6d8993bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:44.159701 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fde7048e-00fe-46d4-bbfd-9b5f8cdf5891 req-30f11518-571e-4d1a-b5ae-247b6d8993bc service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0440242 Dec 09 22:08:44.210899 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fde7048e-00fe-46d4-bbfd-9b5f8cdf5891 req-c93e9fb5-ad80-47f4-93c7-89a306fef569 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:08:44.212384 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fde7048e-00fe-46d4-bbfd-9b5f8cdf5891 req-c93e9fb5-ad80-47f4-93c7-89a306fef569 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0458028 Dec 09 22:08:44.304794 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fde7048e-00fe-46d4-bbfd-9b5f8cdf5891 req-77b307e1-a72a-4113-af6e-933ace11c694 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0847917 Dec 09 22:08:44.399155 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fde7048e-00fe-46d4-bbfd-9b5f8cdf5891 req-cc79771a-1c62-4fe4-b4a7-3baff112add4 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0867903 Dec 09 22:08:57.568345 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:08:57.713142 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:09:02.224826 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:09:03.001085 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-af6d6bc8-b4f6-4ce8-a13d-d1952ae59128 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:09:05.638762 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a876e5dc-c49d-4344-935f-f47c85cfdf0f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:09:06.797227 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:09:08.115470 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:09:09.664209 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:09:27.574062 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:09:27.709819 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:09:33.013249 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d958c4bc-6ea9-4f72-b145-6dca2aed6453 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:09:35.655770 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5b87c995-6ce7-445a-97d9-97bed580b259 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:09:35.682341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-d8ce2493-84ec-4886-a816-e3ae0e705776 req-5380301e-b9f7-421c-9c69-59cae42f5213 service neutron] (103437) timed out ('10.222.0.13', 54930) {{(pid=103437) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 09 22:09:36.790353 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:09:38.128682 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:09:39.224751 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:09:39.669664 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:09:45.807935 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52e6fd6b-7006-4251-893c-4344117f0256 req-b4a75a97-45ac-47a3-bad3-608b3e1a0a56 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0435240 Dec 09 22:09:45.897054 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52e6fd6b-7006-4251-893c-4344117f0256 req-71fda74e-983d-45dd-b989-6466a51e7717 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:09:45.898620 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52e6fd6b-7006-4251-893c-4344117f0256 req-71fda74e-983d-45dd-b989-6466a51e7717 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 1097 time: 0.0424359 Dec 09 22:09:46.013436 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52e6fd6b-7006-4251-893c-4344117f0256 req-98271351-bb38-4eec-869f-ba300e20d0db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:09:46.014930 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52e6fd6b-7006-4251-893c-4344117f0256 req-98271351-bb38-4eec-869f-ba300e20d0db service neutron] 10.222.0.10 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0915439 Dec 09 22:09:46.083303 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52e6fd6b-7006-4251-893c-4344117f0256 req-f4bd964a-6903-45a6-9235-9cda1d54778d service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b HTTP/1.1" status: 200 len: 1001 time: 0.0608938 Dec 09 22:09:46.137820 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52e6fd6b-7006-4251-893c-4344117f0256 req-dd052c3e-0398-4aa2-a597-01514bfd27a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:09:46.139242 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52e6fd6b-7006-4251-893c-4344117f0256 req-dd052c3e-0398-4aa2-a597-01514bfd27a5 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0487404 Dec 09 22:09:46.185298 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52e6fd6b-7006-4251-893c-4344117f0256 req-6ae8f92c-d90f-4a60-8069-ffefe438b271 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:09:46.186702 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52e6fd6b-7006-4251-893c-4344117f0256 req-6ae8f92c-d90f-4a60-8069-ffefe438b271 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0397966 Dec 09 22:09:46.198057 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-52e6fd6b-7006-4251-893c-4344117f0256 req-026d6f4f-6910-44a4-bba3-fa60e89b2151 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 22:09:46.199045 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52e6fd6b-7006-4251-893c-4344117f0256 req-026d6f4f-6910-44a4-bba3-fa60e89b2151 service neutron] 10.222.0.10 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0050633 Dec 09 22:09:46.294894 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52e6fd6b-7006-4251-893c-4344117f0256 req-a896a283-1952-4b40-a95a-22e58cd6f1ac service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0885830 Dec 09 22:09:46.395844 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-52e6fd6b-7006-4251-893c-4344117f0256 req-4f5ad8c1-267d-42c9-80d8-0717b4326d03 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0932605 Dec 09 22:09:50.654160 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a9212ae-4209-4602-b40b-ef23b815fba8 req-76428876-2b8d-4eb6-b89b-cfdb8fdf3f1c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:09:50.655674 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4a9212ae-4209-4602-b40b-ef23b815fba8 req-76428876-2b8d-4eb6-b89b-cfdb8fdf3f1c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 945 time: 0.0512183 Dec 09 22:09:50.706686 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4a9212ae-4209-4602-b40b-ef23b815fba8 req-f43e7aa4-22c1-4666-97e5-30a86b1297c5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440254 Dec 09 22:09:50.963514 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-28184a53-96f7-45eb-980c-a2ced35416aa service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0698822 Dec 09 22:09:50.971651 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaa92bbf-4ee3-49f4-ba53-6d06aeade5bf req-aa48688f-26c9-49e5-8455-520d82e63aaf tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:09:50.973026 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eaa92bbf-4ee3-49f4-ba53-6d06aeade5bf req-aa48688f-26c9-49e5-8455-520d82e63aaf tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 945 time: 0.0715783 Dec 09 22:09:51.022716 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eaa92bbf-4ee3-49f4-ba53-6d06aeade5bf req-5f75ee81-8f51-4e53-9ca9-17b813374157 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429256 Dec 09 22:09:52.154547 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee0baf3d-5ef6-43b7-89b6-05900da5d970 req-0f3c770b-07c0-4e0c-9940-59b4c62bc6f8 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:09:52.156090 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ee0baf3d-5ef6-43b7-89b6-05900da5d970 req-0f3c770b-07c0-4e0c-9940-59b4c62bc6f8 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 945 time: 0.0527072 Dec 09 22:09:52.206882 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ee0baf3d-5ef6-43b7-89b6-05900da5d970 req-243cdbf6-970f-48ac-86f8-42e23a7a7ac5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440013 Dec 09 22:09:52.243787 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-7ebd390f-bca8-4437-a627-3712e21c8ab7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:09:52.245343 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-7ebd390f-bca8-4437-a627-3712e21c8ab7 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 1097 time: 0.0425220 Dec 09 22:09:52.340784 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-5b332991-4c4d-48f2-99d6-5431d1d69f67 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:09:52.342161 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-5b332991-4c4d-48f2-99d6-5431d1d69f67 service neutron] 10.222.0.10 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0899439 Dec 09 22:09:52.423649 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-400355bf-7957-495a-9dd7-7292215cad3a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b HTTP/1.1" status: 200 len: 1001 time: 0.0718243 Dec 09 22:09:52.482520 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-bdd0dc4b-ecac-42ef-b65a-708039168b9a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:09:52.484714 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-bdd0dc4b-ecac-42ef-b65a-708039168b9a service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0541344 Dec 09 22:09:52.532425 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-f0121ce0-5fb5-4c1a-8325-1d8b17014941 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:09:52.534190 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-f0121ce0-5fb5-4c1a-8325-1d8b17014941 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0419703 Dec 09 22:09:52.628969 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-66113ac9-de09-4c3d-a72b-85cdb48d7f9c service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0876045 Dec 09 22:09:52.728467 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-2379511a-8afd-4b01-b977-e52b6da957eb service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0929644 Dec 09 22:09:53.332296 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c93aa5a4-5c7c-48f4-a1cd-773bb166aad0 req-7dab0eee-6496-4ab9-b0e8-14b5220a84bf tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:09:53.333821 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c93aa5a4-5c7c-48f4-a1cd-773bb166aad0 req-7dab0eee-6496-4ab9-b0e8-14b5220a84bf tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 945 time: 0.0531898 Dec 09 22:09:53.390318 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c93aa5a4-5c7c-48f4-a1cd-773bb166aad0 req-9bcf5180-9aed-46aa-a403-7b5472ae95a6 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0475502 Dec 09 22:09:54.520204 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-718a3d56-6c0a-403f-ab3a-3b39c56b9b93 req-af66b10c-a92e-4253-b7a4-3f5db50c0e36 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:09:54.521710 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-718a3d56-6c0a-403f-ab3a-3b39c56b9b93 req-af66b10c-a92e-4253-b7a4-3f5db50c0e36 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 945 time: 0.0560699 Dec 09 22:09:54.570203 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-718a3d56-6c0a-403f-ab3a-3b39c56b9b93 req-0a29ae67-fd27-452f-879d-0153b4a6d043 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423732 Dec 09 22:09:55.704251 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59c9eb83-db40-4f27-adbd-ec40fcba7603 req-5e60301e-64db-48a6-9c52-aae5df9afeed tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:09:55.706023 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-59c9eb83-db40-4f27-adbd-ec40fcba7603 req-5e60301e-64db-48a6-9c52-aae5df9afeed tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 945 time: 0.0509446 Dec 09 22:09:55.756578 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-59c9eb83-db40-4f27-adbd-ec40fcba7603 req-d7359255-df8a-462e-9b2d-80d9571d128f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423663 Dec 09 22:09:56.879285 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98210780-610a-4336-88e5-e57c9283f09a req-47fb8b31-12e8-4ca0-bd2d-396f912ed814 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:09:56.880812 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98210780-610a-4336-88e5-e57c9283f09a req-47fb8b31-12e8-4ca0-bd2d-396f912ed814 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 945 time: 0.0543916 Dec 09 22:09:56.930658 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98210780-610a-4336-88e5-e57c9283f09a req-c735b1b7-a14f-4811-ac8c-e7d62fc1b1ba tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405035 Dec 09 22:09:57.572604 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:09:57.707688 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:09:58.065636 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0f45732-ec2e-45f5-9f01-6b5ab3029179 req-9e32de14-c2bc-44ae-8e24-07391575a8fe tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:09:58.067552 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d0f45732-ec2e-45f5-9f01-6b5ab3029179 req-9e32de14-c2bc-44ae-8e24-07391575a8fe tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 945 time: 0.0515676 Dec 09 22:09:58.121474 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d0f45732-ec2e-45f5-9f01-6b5ab3029179 req-f51e0c1b-5e62-4295-be2e-1c64687b29e7 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456352 Dec 09 22:09:59.251343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e81e2d5f-3f4e-40ef-8bc1-5e7411189f9f req-68db58af-41b6-4d06-a41b-e19c26cf7038 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:09:59.252880 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e81e2d5f-3f4e-40ef-8bc1-5e7411189f9f req-68db58af-41b6-4d06-a41b-e19c26cf7038 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 945 time: 0.0567446 Dec 09 22:09:59.308858 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e81e2d5f-3f4e-40ef-8bc1-5e7411189f9f req-6c97d94c-1719-405d-9143-905ed407769b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467801 Dec 09 22:10:00.438077 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3ef4f9f-2413-4ac8-8846-d0d6072f0508 req-a114fafd-0fd3-4e41-a78b-d2fa2255a0dc tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:00.439580 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3ef4f9f-2413-4ac8-8846-d0d6072f0508 req-a114fafd-0fd3-4e41-a78b-d2fa2255a0dc tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 945 time: 0.0516284 Dec 09 22:10:00.502350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3ef4f9f-2413-4ac8-8846-d0d6072f0508 req-ea5d787a-d75c-4d9d-9ea3-5d94f6c0dab9 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0520585 Dec 09 22:10:01.630492 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9b37814-79ef-41c8-b03d-ea6d87ea6f16 req-e345150f-ff2f-41c8-a377-2e75373faad6 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:01.632002 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9b37814-79ef-41c8-b03d-ea6d87ea6f16 req-e345150f-ff2f-41c8-a377-2e75373faad6 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 945 time: 0.0505621 Dec 09 22:10:01.682662 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b9b37814-79ef-41c8-b03d-ea6d87ea6f16 req-711537e4-85b1-4f9e-a472-3b8b86d1bc54 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413933 Dec 09 22:10:02.819511 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6814e9f5-7b67-484e-b1b9-60a147579506 req-1cf2e503-6f4f-4cae-9bb9-b705da9425bb tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:02.821014 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6814e9f5-7b67-484e-b1b9-60a147579506 req-1cf2e503-6f4f-4cae-9bb9-b705da9425bb tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 945 time: 0.0585175 Dec 09 22:10:02.874003 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6814e9f5-7b67-484e-b1b9-60a147579506 req-7b2e6d16-8ee9-4c91-b700-a17ac8656cd4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467241 Dec 09 22:10:03.020334 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4c14a439-24cf-4ed7-a0b5-97915d65fd75 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:04.007277 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-228332d8-bb5d-4746-b5ee-114201cc9d4f req-3b760749-da51-4cbb-a6be-ca9d4c0cfbf3 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:04.008767 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-228332d8-bb5d-4746-b5ee-114201cc9d4f req-3b760749-da51-4cbb-a6be-ca9d4c0cfbf3 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 945 time: 0.0511479 Dec 09 22:10:04.060089 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-228332d8-bb5d-4746-b5ee-114201cc9d4f req-540d3a60-8831-4cb6-b789-2cce7e891ca2 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418549 Dec 09 22:10:04.545917 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-708e3cea-400c-4e31-bd13-b82595fa5ced service neutron] show failed (client error): The resource could not be found. Dec 09 22:10:04.546962 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-708e3cea-400c-4e31-bd13-b82595fa5ced service neutron] 10.222.0.10 "GET /v2.0/ports/9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b/bindings/n-h1-713301-27 HTTP/1.1" status: 404 len: 381 time: 0.0761223 Dec 09 22:10:04.764323 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-711de284-e073-4413-a873-794b1fec7803 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:04.765890 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-711de284-e073-4413-a873-794b1fec7803 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1&tenant_id=ecd32dac944041b58de1a396ec18cd2c HTTP/1.1" status: 200 len: 1097 time: 0.0454533 Dec 09 22:10:04.777309 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Request body: {'port': {'binding:host_id': 'n-h1-713301-27', 'device_owner': 'compute:nova'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:10:04.836417 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:05.050278 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] For port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:10:05.086526 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] For port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:10:05.131464 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4e0535c2-518e-45d6-8033-4ccf3b4927b1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:10:05.133782 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-903cf741-d339-42a7-bb80-fafe4079214b" -d '{"events": [{"server_uuid": "4e0535c2-518e-45d6-8033-4ccf3b4927b1", "name": "network-vif-unplugged", "status": "completed", "tag": "9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:10:05.137718 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:05.150723 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Transition to ACTIVE for port object 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:10:05.155225 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:05.190111 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-307f2cf4-43c5-4a35-b3ce-74fdf4e0f8b4 req-d240fa0b-9171-430f-ac62-39f8eea7c348 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:05.191273 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-307f2cf4-43c5-4a35-b3ce-74fdf4e0f8b4 req-d240fa0b-9171-430f-ac62-39f8eea7c348 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 945 time: 0.0559313 Dec 09 22:10:05.247473 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Pushing event updated for resources: {'Port': ['ID=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b,revision_number=6']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:10:05.256396 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-307f2cf4-43c5-4a35-b3ce-74fdf4e0f8b4 req-d74a0c13-8741-4076-9df6-5702af75540d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0511813 Dec 09 22:10:05.264553 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:05.264917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:05.265261 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:05.265608 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:05.265945 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:05.266281 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:05.266614 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:05.266945 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:05.267282 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:05.267651 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:05.268023 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:05.268350 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:05.268674 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:05.298401 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] No DVR routers for this DVR port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:10:05.331461 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 22:10:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ace53110-9899-4983-9ec6-934d6558066f x-openstack-request-id: req-ace53110-9899-4983-9ec6-934d6558066f {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:10:05.331766 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4e0535c2-518e-45d6-8033-4ccf3b4927b1", "name": "network-vif-unplugged", "status": "completed", "tag": "9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:10:05.332019 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-ace53110-9899-4983-9ec6-934d6558066f {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:10:05.332415 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4e0535c2-518e-45d6-8033-4ccf3b4927b1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b', 'code': 200} Dec 09 22:10:05.436014 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Attempting to bind port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:10:05.436344 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Attempting to bind port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:10:05.436669 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Attempting to bind port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:10:05.440816 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:10:05.441132 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Attempting to bind port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:10:05.446537 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 9, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:10:05.446868 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Checking segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:10:05.447242 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Bound using segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:10:05.447692 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Bound port: 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:10:05.448043 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:05.513328 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] For port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:10:05.516666 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] For port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:10:05.523823 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:05.558955 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:05.559622 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:05.561014 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] 10.222.0.31 "PUT /v2.0/ports/9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b HTTP/1.1" status: 200 len: 1092 time: 0.7876484 Dec 09 22:10:05.582998 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94158f66-fe44-4200-ab60-de3d95c19e10 service neutron] Pushing event updated for resources: {'Port': ['ID=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b,revision_number=7']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:10:05.635758 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-fef9c279-dd9c-4e10-ac6e-dd13fa75f485 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:05.637531 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-fef9c279-dd9c-4e10-ac6e-dd13fa75f485 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 1095 time: 0.0513687 Dec 09 22:10:05.640527 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4770e4bd-cded-4b6e-adfb-58dbc335cdab None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:05.733572 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-e17ab22b-a026-4715-aa8f-2e9fd799772e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:05.735138 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-e17ab22b-a026-4715-aa8f-2e9fd799772e service neutron] 10.222.0.31 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0901282 Dec 09 22:10:05.805504 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-fb1397ef-be79-4647-90d9-bce9b08d629e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b HTTP/1.1" status: 200 len: 999 time: 0.0636365 Dec 09 22:10:05.856154 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-a7bd751d-0cb1-49cb-bdd7-cacf0ca23e2d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:05.857647 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-a7bd751d-0cb1-49cb-bdd7-cacf0ca23e2d service neutron] 10.222.0.31 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0448008 Dec 09 22:10:05.904620 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-eba108fa-7e3b-4d66-b251-f66d8b11a1b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:05.906135 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-eba108fa-7e3b-4d66-b251-f66d8b11a1b9 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0413439 Dec 09 22:10:06.008798 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-81bd4aba-e7ca-4822-a97f-b63411de947f service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0950902 Dec 09 22:10:06.100285 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2236e5e7-f5ce-4288-9258-8b5d171529a9 req-0d02814e-976d-4d48-8e57-fceb5796599c service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0841656 Dec 09 22:10:06.392017 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ba6219f-0cc3-4d17-aa20-1225d2c44092 req-f6bfa2e0-a856-4047-9d54-c8470464e092 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:06.393491 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ba6219f-0cc3-4d17-aa20-1225d2c44092 req-f6bfa2e0-a856-4047-9d54-c8470464e092 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 943 time: 0.0551486 Dec 09 22:10:06.440932 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ba6219f-0cc3-4d17-aa20-1225d2c44092 req-022a2368-9c9b-4951-bb0e-a4560c615f02 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410807 Dec 09 22:10:06.794785 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:07.334189 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4e0535c2-518e-45d6-8033-4ccf3b4927b1', 'tag': '9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:10:07.336730 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1e661f7f-5a95-459b-9926-53fa57e79c81" -d '{"events": [{"name": "network-changed", "server_uuid": "4e0535c2-518e-45d6-8033-4ccf3b4927b1", "tag": "9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:10:07.397188 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:10:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-27860bd0-404f-454c-879e-8300f2e5607a x-openstack-request-id: req-27860bd0-404f-454c-879e-8300f2e5607a {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:10:07.397743 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4e0535c2-518e-45d6-8033-4ccf3b4927b1", "tag": "9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:10:07.398005 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-27860bd0-404f-454c-879e-8300f2e5607a {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:10:07.398418 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4e0535c2-518e-45d6-8033-4ccf3b4927b1', 'tag': '9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b', 'status': 'completed', 'code': 200} Dec 09 22:10:07.494379 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e661f7f-5a95-459b-9926-53fa57e79c81 req-b1428ee1-e716-467a-9ff0-42f27a8c0611 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:07.496069 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1e661f7f-5a95-459b-9926-53fa57e79c81 req-b1428ee1-e716-467a-9ff0-42f27a8c0611 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 1095 time: 0.0735242 Dec 09 22:10:07.514133 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e661f7f-5a95-459b-9926-53fa57e79c81 req-3fceadb4-eae8-4d7a-a317-4ee9b43c0a69 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:07.516504 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1e661f7f-5a95-459b-9926-53fa57e79c81 req-3fceadb4-eae8-4d7a-a317-4ee9b43c0a69 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 1095 time: 0.0856054 Dec 09 22:10:07.604707 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01813fec-1900-4541-8415-bc7206823d0d req-3b87bd9e-f099-498e-bbb2-bf3e96811442 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:07.613643 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-01813fec-1900-4541-8415-bc7206823d0d req-3b87bd9e-f099-498e-bbb2-bf3e96811442 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 943 time: 0.0906162 Dec 09 22:10:07.677449 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-01813fec-1900-4541-8415-bc7206823d0d req-8b20be18-504c-4a9c-892a-f1eed79ad6f0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0553126 Dec 09 22:10:07.678929 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e661f7f-5a95-459b-9926-53fa57e79c81 req-9869a3a7-17e0-4ac1-b7af-1415ea307399 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:07.680539 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1e661f7f-5a95-459b-9926-53fa57e79c81 req-9869a3a7-17e0-4ac1-b7af-1415ea307399 service neutron] 10.222.0.10 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.1762331 Dec 09 22:10:07.686047 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e661f7f-5a95-459b-9926-53fa57e79c81 req-80780202-ec05-45f6-9902-5b575d58266c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:07.687029 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1e661f7f-5a95-459b-9926-53fa57e79c81 req-80780202-ec05-45f6-9902-5b575d58266c service neutron] 10.222.0.31 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.1572967 Dec 09 22:10:07.803656 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1e661f7f-5a95-459b-9926-53fa57e79c81 req-9f9a89f1-877a-4e89-9c47-793b6c138b9c service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b HTTP/1.1" status: 200 len: 999 time: 0.1151168 Dec 09 22:10:07.805722 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1e661f7f-5a95-459b-9926-53fa57e79c81 req-943aacd2-ff6b-4e2d-95ab-1a0b053d2353 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b HTTP/1.1" status: 200 len: 999 time: 0.1024573 Dec 09 22:10:07.895560 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e661f7f-5a95-459b-9926-53fa57e79c81 req-717f8144-39d4-4174-9c53-43f6194994f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:07.897282 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1e661f7f-5a95-459b-9926-53fa57e79c81 req-717f8144-39d4-4174-9c53-43f6194994f5 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0784085 Dec 09 22:10:07.898713 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e661f7f-5a95-459b-9926-53fa57e79c81 req-66a9dc0c-8fe8-48a5-b3e8-f157aa24e7c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:07.900020 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1e661f7f-5a95-459b-9926-53fa57e79c81 req-66a9dc0c-8fe8-48a5-b3e8-f157aa24e7c4 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0895355 Dec 09 22:10:07.971356 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e661f7f-5a95-459b-9926-53fa57e79c81 req-78d73c97-f905-4eb6-97dc-3c14743347f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:07.972925 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1e661f7f-5a95-459b-9926-53fa57e79c81 req-78d73c97-f905-4eb6-97dc-3c14743347f2 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0688541 Dec 09 22:10:07.974613 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e661f7f-5a95-459b-9926-53fa57e79c81 req-d48c6bfd-cb27-403a-95e9-b1e77102098f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:07.976234 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1e661f7f-5a95-459b-9926-53fa57e79c81 req-d48c6bfd-cb27-403a-95e9-b1e77102098f service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0648873 Dec 09 22:10:08.125236 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:08.472402 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1e661f7f-5a95-459b-9926-53fa57e79c81 req-b85b4b02-913d-411a-80dd-9814383949f7 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4914176 Dec 09 22:10:08.478231 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1e661f7f-5a95-459b-9926-53fa57e79c81 req-25c3a26d-41ce-455b-8111-9a2d968f770a service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4902258 Dec 09 22:10:08.534376 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:10:08.545327 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:10:08.609572 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:10:08.637191 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1e661f7f-5a95-459b-9926-53fa57e79c81 req-59cae17a-24e4-4e3e-8fd5-5ea2ab73bb54 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1566110 Dec 09 22:10:08.639109 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1e661f7f-5a95-459b-9926-53fa57e79c81 req-9a1c2125-7369-42fd-97f4-d85171651368 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1517105 Dec 09 22:10:08.666931 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:10:08.677184 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'port_id': '9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b', 'mac_address': 'fa:16:3e:0a:46:bf', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:10:08.718891 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:08.733281 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:10:08.753671 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:10:08.759048 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:08.800958 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bd720f2-aa49-4251-b651-66a01fa2a27c req-e6a58a3e-3aab-4694-86bb-5786f7a1fba1 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:08.802440 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0bd720f2-aa49-4251-b651-66a01fa2a27c req-e6a58a3e-3aab-4694-86bb-5786f7a1fba1 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 944 time: 0.0494540 Dec 09 22:10:08.807869 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:10:08.815506 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:08.815878 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:08.816242 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:08.816527 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:08.816866 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:08.817197 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:08.817523 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:08.817847 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:08.818193 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:08.818579 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:08.822539 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:08.822539 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:08.822539 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:10:08.852574 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0bd720f2-aa49-4251-b651-66a01fa2a27c req-b865b35f-a6b1-4723-b58e-dd1ffad89307 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431588 Dec 09 22:10:09.013565 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:10:09.048105 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38553b65-ee3a-41a0-a761-b474426e1319 req-2b437127-0c80-4bff-89ed-d34bfa824b22 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:09.052047 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38553b65-ee3a-41a0-a761-b474426e1319 req-2b437127-0c80-4bff-89ed-d34bfa824b22 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 944 time: 0.0552568 Dec 09 22:10:09.059678 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9e2e369-3cb8-451c-9902-2b580784964c req-98d384f8-519c-4d0a-8164-ab12941e9b95 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:09.061202 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f9e2e369-3cb8-451c-9902-2b580784964c req-98d384f8-519c-4d0a-8164-ab12941e9b95 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.10 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1&tenant_id=ecd32dac944041b58de1a396ec18cd2c&binding%3Ahost_id=n-h1-713301-27 HTTP/1.1" status: 200 len: 944 time: 0.0529943 Dec 09 22:10:09.100226 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38553b65-ee3a-41a0-a761-b474426e1319 req-52a5d418-18af-4bf8-854a-84eaecb815d4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436940 Dec 09 22:10:09.123250 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [req-f9e2e369-3cb8-451c-9902-2b580784964c req-814331ab-4ac0-462f-bd8c-57090bbfe9b1 service neutron] delete failed (client error): The resource could not be found. Dec 09 22:10:09.124332 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f9e2e369-3cb8-451c-9902-2b580784964c req-814331ab-4ac0-462f-bd8c-57090bbfe9b1 service neutron] 10.222.0.10 "DELETE /v2.0/ports/9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b/bindings/n-h2-713301-27 HTTP/1.1" status: 404 len: 381 time: 0.0558915 Dec 09 22:10:09.210181 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9e2e369-3cb8-451c-9902-2b580784964c req-3d800f40-e90e-4b1a-8d6b-360cc5d62367 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:09.211770 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f9e2e369-3cb8-451c-9902-2b580784964c req-3d800f40-e90e-4b1a-8d6b-360cc5d62367 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 1096 time: 0.0420127 Dec 09 22:10:09.311518 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9e2e369-3cb8-451c-9902-2b580784964c req-513b8a96-0551-4ada-abb6-9be652f803b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:09.312924 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f9e2e369-3cb8-451c-9902-2b580784964c req-513b8a96-0551-4ada-abb6-9be652f803b3 service neutron] 10.222.0.10 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0935149 Dec 09 22:10:09.384439 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f9e2e369-3cb8-451c-9902-2b580784964c req-ccd5b068-1ad7-4a88-921e-a218c4ca6f68 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b HTTP/1.1" status: 200 len: 1000 time: 0.0645819 Dec 09 22:10:09.438803 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9e2e369-3cb8-451c-9902-2b580784964c req-133b3e8c-4c33-4c2c-9033-a53b50e4be28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:09.440283 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f9e2e369-3cb8-451c-9902-2b580784964c req-133b3e8c-4c33-4c2c-9033-a53b50e4be28 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0490897 Dec 09 22:10:09.494622 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9e2e369-3cb8-451c-9902-2b580784964c req-37724fcd-622d-48d0-8e2a-cb2dd32f2b3b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:09.496142 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f9e2e369-3cb8-451c-9902-2b580784964c req-37724fcd-622d-48d0-8e2a-cb2dd32f2b3b service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0485315 Dec 09 22:10:09.586208 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f9e2e369-3cb8-451c-9902-2b580784964c req-27588942-8e63-45a1-b31e-5ff1e3b73fc4 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0825069 Dec 09 22:10:09.664216 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:09.682577 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f9e2e369-3cb8-451c-9902-2b580784964c req-c57b762e-7c60-497c-945d-12188c66eed9 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0890510 Dec 09 22:10:10.228097 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52374a1a-b3ee-4369-986e-b13bf23035b5 req-18ccbc13-62a8-41f8-8e14-e995ec04fc41 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:10.229669 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52374a1a-b3ee-4369-986e-b13bf23035b5 req-18ccbc13-62a8-41f8-8e14-e995ec04fc41 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 944 time: 0.0553823 Dec 09 22:10:10.281677 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-52374a1a-b3ee-4369-986e-b13bf23035b5 req-f032b815-7783-49b1-b575-57230f3e5387 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444562 Dec 09 22:10:10.399262 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c00927-4166-404c-9512-4cc53911a128 req-5732b66a-ec0e-4771-9563-54f1e47377a2 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:10.400773 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98c00927-4166-404c-9512-4cc53911a128 req-5732b66a-ec0e-4771-9563-54f1e47377a2 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 944 time: 0.0499003 Dec 09 22:10:10.451663 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-98c00927-4166-404c-9512-4cc53911a128 req-443f375a-a7b3-4b59-9e2e-48d6ce18d2c9 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418172 Dec 09 22:10:10.544264 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:10:10.582166 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07d6356f-4ea6-4d24-811c-53d0eb3d13f9 req-59e3bf78-592d-46b0-ad67-c557835ccdf1 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:10.583719 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07d6356f-4ea6-4d24-811c-53d0eb3d13f9 req-59e3bf78-592d-46b0-ad67-c557835ccdf1 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 944 time: 0.0537605 Dec 09 22:10:10.597636 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:10:10.602059 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:10:10.602430 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:10.637719 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07d6356f-4ea6-4d24-811c-53d0eb3d13f9 req-4cabf8cc-bf44-4e10-bac5-b6f9359f359b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474532 Dec 09 22:10:10.682989 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:10.705785 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4e0535c2-518e-45d6-8033-4ccf3b4927b1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:10:10.708075 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-553d570e-5a85-4629-8d32-18c2ee6a561d" -d '{"events": [{"server_uuid": "4e0535c2-518e-45d6-8033-4ccf3b4927b1", "name": "network-vif-plugged", "status": "completed", "tag": "9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:10:10.720736 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:10:10.724810 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:10.777087 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b,revision_number=9']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:10:10.813683 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:10:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3662b418-dc56-4bb5-8f95-325e74814566 x-openstack-request-id: req-3662b418-dc56-4bb5-8f95-325e74814566 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:10:10.814092 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4e0535c2-518e-45d6-8033-4ccf3b4927b1", "name": "network-vif-plugged", "status": "completed", "tag": "9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:10:10.814379 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-3662b418-dc56-4bb5-8f95-325e74814566 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:10:10.814790 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4e0535c2-518e-45d6-8033-4ccf3b4927b1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b', 'code': 200} Dec 09 22:10:10.908062 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50be58e5-6cff-4aca-9c1c-8caa293c9da2 req-fda47c77-0378-4446-ab28-63880f0a3e4a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:10.909465 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50be58e5-6cff-4aca-9c1c-8caa293c9da2 req-fda47c77-0378-4446-ab28-63880f0a3e4a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 945 time: 0.0514293 Dec 09 22:10:10.958647 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50be58e5-6cff-4aca-9c1c-8caa293c9da2 req-ecd4b0bb-a6c2-4f0a-89ce-2e8e81d19f51 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426371 Dec 09 22:10:12.079201 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0781dfc7-a863-45c8-acb4-1c6f04cc1a5a req-5b86d879-2d74-4b11-ad07-5fe8a79190d2 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:12.080735 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0781dfc7-a863-45c8-acb4-1c6f04cc1a5a req-5b86d879-2d74-4b11-ad07-5fe8a79190d2 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 945 time: 0.0507445 Dec 09 22:10:12.108617 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6488fa9d-64db-4bfa-9925-f2a28839919b req-26c0b338-adb3-42a8-b569-0f7818269d49 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:12.110132 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6488fa9d-64db-4bfa-9925-f2a28839919b req-26c0b338-adb3-42a8-b569-0f7818269d49 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.31 "GET /v2.0/ports?device_id=4e0535c2-518e-45d6-8033-4ccf3b4927b1 HTTP/1.1" status: 200 len: 945 time: 0.0518110 Dec 09 22:10:12.128576 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0781dfc7-a863-45c8-acb4-1c6f04cc1a5a req-0b4ade88-ab18-4e91-8dd5-2677b2a8d931 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413082 Dec 09 22:10:12.206607 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-6488fa9d-64db-4bfa-9925-f2a28839919b req-84ee60b4-6b6d-4ca4-a6ff-75978231dbf4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Deleting port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:10:12.206914 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6488fa9d-64db-4bfa-9925-f2a28839919b req-84ee60b4-6b6d-4ca4-a6ff-75978231dbf4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:12.293990 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-6488fa9d-64db-4bfa-9925-f2a28839919b req-84ee60b4-6b6d-4ca4-a6ff-75978231dbf4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] For port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:10:12.294224 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6488fa9d-64db-4bfa-9925-f2a28839919b req-84ee60b4-6b6d-4ca4-a6ff-75978231dbf4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:12.467515 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6488fa9d-64db-4bfa-9925-f2a28839919b req-84ee60b4-6b6d-4ca4-a6ff-75978231dbf4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:12.467886 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6488fa9d-64db-4bfa-9925-f2a28839919b req-84ee60b4-6b6d-4ca4-a6ff-75978231dbf4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:12.468187 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [req-6488fa9d-64db-4bfa-9925-f2a28839919b req-84ee60b4-6b6d-4ca4-a6ff-75978231dbf4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Floating IP ded53112-c89a-4a62-a1b4-d803c592f310 disassociated. External IP: 172.25.3.185, port: 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b. Dec 09 22:10:12.468530 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-6488fa9d-64db-4bfa-9925-f2a28839919b req-84ee60b4-6b6d-4ca4-a6ff-75978231dbf4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Calling delete_port for 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:10:12.614608 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6488fa9d-64db-4bfa-9925-f2a28839919b req-84ee60b4-6b6d-4ca4-a6ff-75978231dbf4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:12.644223 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84ee60b4-6b6d-4ca4-a6ff-75978231dbf4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Pushing event deleted for resources: {'Port': ['ID=9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:10:12.768303 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [req-6488fa9d-64db-4bfa-9925-f2a28839919b req-84ee60b4-6b6d-4ca4-a6ff-75978231dbf4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:10:12.882183 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-6488fa9d-64db-4bfa-9925-f2a28839919b req-84ee60b4-6b6d-4ca4-a6ff-75978231dbf4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:10:12.893562 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37bc04f6-2f60-48b0-86db-64cf15e237f4 None None] Sync routers for ids ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:10:12.905508 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37bc04f6-2f60-48b0-86db-64cf15e237f4 None None] Routers {'7e861ee9-d29c-4ade-a3ab-cce44cba2c97'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:10:12.906216 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-37bc04f6-2f60-48b0-86db-64cf15e237f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:10:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:10:12.930502 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-6488fa9d-64db-4bfa-9925-f2a28839919b req-84ee60b4-6b6d-4ca4-a6ff-75978231dbf4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] No DVR routers for this DVR port 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:10:12.933385 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6488fa9d-64db-4bfa-9925-f2a28839919b req-84ee60b4-6b6d-4ca4-a6ff-75978231dbf4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:12.936831 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6488fa9d-64db-4bfa-9925-f2a28839919b req-84ee60b4-6b6d-4ca4-a6ff-75978231dbf4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.31 "DELETE /v2.0/ports/9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b HTTP/1.1" status: 204 len: 173 time: 0.8203435 Dec 09 22:10:12.937341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4e0535c2-518e-45d6-8033-4ccf3b4927b1', 'name': 'network-vif-deleted', 'tag': '9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:10:12.940045 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a6c2f76b-6477-4eb7-9e41-5e0857c5fc88" -d '{"events": [{"server_uuid": "4e0535c2-518e-45d6-8033-4ccf3b4927b1", "name": "network-vif-deleted", "tag": "9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:10:12.977540 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:10:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ac2d39c8-dad7-4be2-badc-36afd0b8f6fa x-openstack-request-id: req-ac2d39c8-dad7-4be2-badc-36afd0b8f6fa {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:10:12.977836 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4e0535c2-518e-45d6-8033-4ccf3b4927b1", "name": "network-vif-deleted", "tag": "9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:10:12.978093 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-ac2d39c8-dad7-4be2-badc-36afd0b8f6fa {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:10:12.978641 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4e0535c2-518e-45d6-8033-4ccf3b4927b1', 'name': 'network-vif-deleted', 'tag': '9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b', 'status': 'completed', 'code': 200} Dec 09 22:10:13.018846 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-37bc04f6-2f60-48b0-86db-64cf15e237f4 None None] Set router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:10:13.228028 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-37bc04f6-2f60-48b0-86db-64cf15e237f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:05Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:10:13.258689 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37bc04f6-2f60-48b0-86db-64cf15e237f4 None None] Checking router: 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:10:13.267048 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37bc04f6-2f60-48b0-86db-64cf15e237f4 None None] Routers {'7e861ee9-d29c-4ade-a3ab-cce44cba2c97'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:10:13.267683 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-37bc04f6-2f60-48b0-86db-64cf15e237f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:10:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:10:13.374542 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-37bc04f6-2f60-48b0-86db-64cf15e237f4 None None] Set router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:10:13.389844 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-736aa6a8-cef8-4e13-afae-ba3f91f5e354 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-securitygroup--1276791935&fields=id&tenant_id=ecd32dac944041b58de1a396ec18cd2c HTTP/1.1" status: 200 len: 267 time: 0.0483284 Dec 09 22:10:13.498761 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-450fc249-0a33-404e-9ad3-eee025c9af95 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:13.500190 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-450fc249-0a33-404e-9ad3-eee025c9af95 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 812 time: 0.1032825 Dec 09 22:10:13.515359 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-f71eed9f-78a6-4c43-b40a-6d4959b63bab tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/quotas/ecd32dac944041b58de1a396ec18cd2c HTTP/1.1" status: 200 len: 375 time: 0.0092320 Dec 09 22:10:13.571166 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-91a14e32-48bd-4903-8f3d-bebc6c2495a3 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0500503 Dec 09 22:10:13.574220 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-37bc04f6-2f60-48b0-86db-64cf15e237f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:05Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:10:13.600929 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37bc04f6-2f60-48b0-86db-64cf15e237f4 None None] The sync data for ids ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'] in n-d-713301-27 is: [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:05Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:10:13.673765 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-1b8ade97-f1b8-46e7-8803-23bad5ded08f service neutron] 10.222.0.13 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0906122 Dec 09 22:10:13.772878 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-2d20c31f-73cb-4a9f-a1b7-fd8cb607dde5 service neutron] 10.222.0.13 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0923116 Dec 09 22:10:13.842922 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47f1c6c4-fa94-4c99-9464-9f370f2cc81b None None] New status for floating IP ded53112-c89a-4a62-a1b4-d803c592f310: DOWN {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:10:13.952961 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4121803c-cd3e-469f-ae32-f0a5a1467f3b req-2c4e6810-3fc2-4926-b61a-5a34159c33dd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 210 time: 0.0324006 Dec 09 22:10:14.923672 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-5940f7b0-59e2-423b-a95a-5cb41fcdaeb0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:14.926183 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-5940f7b0-59e2-423b-a95a-5cb41fcdaeb0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.31 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 812 time: 0.1184862 Dec 09 22:10:14.991811 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-d199ea7e-00cb-46b7-a314-c4a60fee4bed tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ecd32dac944041b58de1a396ec18cd2c HTTP/1.1" status: 200 len: 380 time: 0.0562646 Dec 09 22:10:15.001665 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-9c7e0048-9134-42a7-9601-f322905317cd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Request body: {'port': {'device_id': '7fdff4bc-9748-44a2-952f-49c96d156e5d', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'admin_state_up': True, 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'security_groups': ['fc389abb-6202-4d61-870a-d6749ba1a635']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:10:15.051323 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8f2eb7d-6459-4503-acb0-b88f2d8baa2a req-4dc3d0ee-1669-47ce-b387-5d4f4d71c402 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 210 time: 0.0263643 Dec 09 22:10:15.117127 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-9c7e0048-9134-42a7-9601-f322905317cd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Made reservation on behalf of ecd32dac944041b58de1a396ec18cd2c for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:10:15.120680 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-9c7e0048-9134-42a7-9601-f322905317cd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:15.261582 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-9c7e0048-9134-42a7-9601-f322905317cd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Allocated IP 172.20.0.4 (91a989ca-03f4-4cf9-a2af-b26f8b1a2bec/88c86202-31f6-4618-8f06-f2283fac961c/610b4b75-1d84-4d75-824c-9acc7e706b58) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:10:15.399147 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-9c7e0048-9134-42a7-9601-f322905317cd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:15.436577 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-9c7e0048-9134-42a7-9601-f322905317cd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:15.483469 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-9c7e0048-9134-42a7-9601-f322905317cd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:10:15.486519 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-9c7e0048-9134-42a7-9601-f322905317cd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:10:15.492234 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-9c7e0048-9134-42a7-9601-f322905317cd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:10:15.498686 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c7e0048-9134-42a7-9601-f322905317cd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Pushing event updated for resources: {'Port': ['ID=610b4b75-1d84-4d75-824c-9acc7e706b58,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:10:15.546029 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-9c7e0048-9134-42a7-9601-f322905317cd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:15.546660 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-9c7e0048-9134-42a7-9601-f322905317cd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:15.565747 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-9c7e0048-9134-42a7-9601-f322905317cd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5678003 Dec 09 22:10:15.578839 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-0a80c4d4-7b80-409c-9605-fe7b5161e4d6 service neutron] Request body: {'port': {'device_id': '7fdff4bc-9748-44a2-952f-49c96d156e5d', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:10:15.637970 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-0a80c4d4-7b80-409c-9605-fe7b5161e4d6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:15.686886 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-767d2d25-a543-43ea-991e-b0381d559d98 None None] Provisioning complete for port 610b4b75-1d84-4d75-824c-9acc7e706b58 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:10:15.687460 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-767d2d25-a543-43ea-991e-b0381d559d98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:15.726671 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-767d2d25-a543-43ea-991e-b0381d559d98 None None] Port 610b4b75-1d84-4d75-824c-9acc7e706b58 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:10:15.912922 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-0a80c4d4-7b80-409c-9605-fe7b5161e4d6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 610b4b75-1d84-4d75-824c-9acc7e706b58 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:10:15.920602 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-0a80c4d4-7b80-409c-9605-fe7b5161e4d6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:15.933339 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-0a80c4d4-7b80-409c-9605-fe7b5161e4d6 service neutron] Transition to ACTIVE for port object 610b4b75-1d84-4d75-824c-9acc7e706b58 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:10:15.940014 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-0a80c4d4-7b80-409c-9605-fe7b5161e4d6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:15.988921 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a80c4d4-7b80-409c-9605-fe7b5161e4d6 service neutron] Pushing event updated for resources: {'Port': ['ID=610b4b75-1d84-4d75-824c-9acc7e706b58,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:10:16.062091 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-0a80c4d4-7b80-409c-9605-fe7b5161e4d6 service neutron] Attempting to bind port 610b4b75-1d84-4d75-824c-9acc7e706b58 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:10:16.062426 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-0a80c4d4-7b80-409c-9605-fe7b5161e4d6 service neutron] Attempting to bind port 610b4b75-1d84-4d75-824c-9acc7e706b58 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:10:16.063087 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-0a80c4d4-7b80-409c-9605-fe7b5161e4d6 service neutron] Attempting to bind port 610b4b75-1d84-4d75-824c-9acc7e706b58 on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:10:16.067807 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-0a80c4d4-7b80-409c-9605-fe7b5161e4d6 service neutron] Port 610b4b75-1d84-4d75-824c-9acc7e706b58 on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:10:16.068137 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-0a80c4d4-7b80-409c-9605-fe7b5161e4d6 service neutron] Attempting to bind port 610b4b75-1d84-4d75-824c-9acc7e706b58 on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:10:16.073277 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-0a80c4d4-7b80-409c-9605-fe7b5161e4d6 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 9, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:10:16.073622 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-0a80c4d4-7b80-409c-9605-fe7b5161e4d6 service neutron] Checking segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:10:16.074009 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-0a80c4d4-7b80-409c-9605-fe7b5161e4d6 service neutron] Bound using segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:10:16.074445 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-0a80c4d4-7b80-409c-9605-fe7b5161e4d6 service neutron] Bound port: 610b4b75-1d84-4d75-824c-9acc7e706b58, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:10:16.074869 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-0a80c4d4-7b80-409c-9605-fe7b5161e4d6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:16.147223 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-0a80c4d4-7b80-409c-9605-fe7b5161e4d6 service neutron] For port 610b4b75-1d84-4d75-824c-9acc7e706b58, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:10:16.150574 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-0a80c4d4-7b80-409c-9605-fe7b5161e4d6 service neutron] For port 610b4b75-1d84-4d75-824c-9acc7e706b58, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=610b4b75-1d84-4d75-824c-9acc7e706b58,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:10:16.156381 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-0a80c4d4-7b80-409c-9605-fe7b5161e4d6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:16.174864 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9da93109-575c-43b5-b506-e2e047a7d648 req-74d92ff7-757d-42a4-8b3b-7e24e3fd91e6 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:16.176291 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9da93109-575c-43b5-b506-e2e047a7d648 req-74d92ff7-757d-42a4-8b3b-7e24e3fd91e6 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 943 time: 0.0509074 Dec 09 22:10:16.192183 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-0a80c4d4-7b80-409c-9605-fe7b5161e4d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:16.192821 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-0a80c4d4-7b80-409c-9605-fe7b5161e4d6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:16.194314 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-0a80c4d4-7b80-409c-9605-fe7b5161e4d6 service neutron] 10.222.0.31 "PUT /v2.0/ports/610b4b75-1d84-4d75-824c-9acc7e706b58 HTTP/1.1" status: 200 len: 1092 time: 0.6200202 Dec 09 22:10:16.194765 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7fdff4bc-9748-44a2-952f-49c96d156e5d', 'tag': '610b4b75-1d84-4d75-824c-9acc7e706b58'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:10:16.197092 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4ef300f6-2987-4f22-8d53-627be49eac70" -d '{"events": [{"name": "network-changed", "server_uuid": "7fdff4bc-9748-44a2-952f-49c96d156e5d", "tag": "610b4b75-1d84-4d75-824c-9acc7e706b58"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:10:16.223790 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a80c4d4-7b80-409c-9605-fe7b5161e4d6 service neutron] Pushing event updated for resources: {'Port': ['ID=610b4b75-1d84-4d75-824c-9acc7e706b58,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:10:16.225895 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:10:16.240116 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9da93109-575c-43b5-b506-e2e047a7d648 req-ef9ff202-023c-4f73-a56c-09afa36ad993 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0573928 Dec 09 22:10:16.303917 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:10:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-02d35be5-fb7a-43b7-8cc0-7328dbd213de x-openstack-request-id: req-02d35be5-fb7a-43b7-8cc0-7328dbd213de {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:10:16.304435 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7fdff4bc-9748-44a2-952f-49c96d156e5d", "tag": "610b4b75-1d84-4d75-824c-9acc7e706b58", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:10:16.304849 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-02d35be5-fb7a-43b7-8cc0-7328dbd213de {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:10:16.305418 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7fdff4bc-9748-44a2-952f-49c96d156e5d', 'tag': '610b4b75-1d84-4d75-824c-9acc7e706b58', 'status': 'completed', 'code': 200} Dec 09 22:10:16.307559 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-230b0963-8084-4e88-b865-9fc24e0e470a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:16.309113 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-230b0963-8084-4e88-b865-9fc24e0e470a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 1095 time: 0.0608175 Dec 09 22:10:16.360070 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-d713a067-64c0-4675-8ab3-d46e4cddaa07 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=610b4b75-1d84-4d75-824c-9acc7e706b58 HTTP/1.1" status: 200 len: 217 time: 0.0425818 Dec 09 22:10:16.411413 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-a89c356e-d989-45c5-a9bb-97d8dba9bb78 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:16.413457 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-a89c356e-d989-45c5-a9bb-97d8dba9bb78 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0460684 Dec 09 22:10:16.462698 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-3577e37c-ec46-4d9f-9625-a94b83f38043 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:16.464166 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-3577e37c-ec46-4d9f-9625-a94b83f38043 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0425615 Dec 09 22:10:16.561911 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-ff99cadb-120e-4b55-8442-a26b4b0be186 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0903020 Dec 09 22:10:16.597498 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:10:16.624270 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:10:16.624571 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 9c7c5d98-2f3e-4c71-8a05-aaa1bd60463b not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:10:16.667981 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f8e5352-6667-4b7b-88b8-8a14af5fdf45 req-d6e00f85-c0f4-4c61-9723-5b14e4e8a11d service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0988219 Dec 09 22:10:16.763800 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ef300f6-2987-4f22-8d53-627be49eac70 req-ad94b83f-37ac-4afc-9ee1-5ba004943406 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:16.765236 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4ef300f6-2987-4f22-8d53-627be49eac70 req-ad94b83f-37ac-4afc-9ee1-5ba004943406 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 1095 time: 0.0455003 Dec 09 22:10:16.864435 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ef300f6-2987-4f22-8d53-627be49eac70 req-8e49feeb-7607-4e51-95b9-c3ebde5a253a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:16.866082 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4ef300f6-2987-4f22-8d53-627be49eac70 req-8e49feeb-7607-4e51-95b9-c3ebde5a253a service neutron] 10.222.0.31 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0936661 Dec 09 22:10:16.908439 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4ef300f6-2987-4f22-8d53-627be49eac70 req-e2942585-70f8-462e-9b98-9f8f5018004c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=610b4b75-1d84-4d75-824c-9acc7e706b58 HTTP/1.1" status: 200 len: 217 time: 0.0355310 Dec 09 22:10:16.972282 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ef300f6-2987-4f22-8d53-627be49eac70 req-2d428044-a5a9-40b5-93a6-dfd6127a4f4f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:16.974072 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4ef300f6-2987-4f22-8d53-627be49eac70 req-2d428044-a5a9-40b5-93a6-dfd6127a4f4f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0589657 Dec 09 22:10:17.020803 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ef300f6-2987-4f22-8d53-627be49eac70 req-9a24ebcc-f261-4038-9c45-5f4cd805b983 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:17.022252 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4ef300f6-2987-4f22-8d53-627be49eac70 req-9a24ebcc-f261-4038-9c45-5f4cd805b983 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0400369 Dec 09 22:10:17.114084 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4ef300f6-2987-4f22-8d53-627be49eac70 req-a0988628-4e57-4130-a760-c590f4af12f0 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844078 Dec 09 22:10:17.211310 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4ef300f6-2987-4f22-8d53-627be49eac70 req-4122cd7f-d7b3-4b8b-a005-6de3f7c65b1b service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0888069 Dec 09 22:10:17.368488 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4484bfd0-2e7e-4dde-8889-112320678651 req-b67ca961-c47b-4b24-a6c6-e05fe202f6f2 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:17.369954 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4484bfd0-2e7e-4dde-8889-112320678651 req-b67ca961-c47b-4b24-a6c6-e05fe202f6f2 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 943 time: 0.0533295 Dec 09 22:10:17.417966 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4484bfd0-2e7e-4dde-8889-112320678651 req-b3c747a5-a4a8-4815-802f-2a3eadb76372 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418069 Dec 09 22:10:18.540272 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d049c2ec-1817-4152-ba7e-84b6acc77f3a req-2456a4ef-35a1-45f6-b9af-b2096e112a8f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:18.541762 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d049c2ec-1817-4152-ba7e-84b6acc77f3a req-2456a4ef-35a1-45f6-b9af-b2096e112a8f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 943 time: 0.0519004 Dec 09 22:10:18.590255 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d049c2ec-1817-4152-ba7e-84b6acc77f3a req-7775cd47-f88a-4bbe-8b22-0b54d6fa8240 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423622 Dec 09 22:10:18.608819 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 610b4b75-1d84-4d75-824c-9acc7e706b58 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:10:18.714586 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 610b4b75-1d84-4d75-824c-9acc7e706b58, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=610b4b75-1d84-4d75-824c-9acc7e706b58,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:10:18.726060 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '610b4b75-1d84-4d75-824c-9acc7e706b58', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'port_id': '610b4b75-1d84-4d75-824c-9acc7e706b58', 'mac_address': 'fa:16:3e:03:6e:ba', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:10:18.764174 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:18.777409 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 610b4b75-1d84-4d75-824c-9acc7e706b58 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:10:18.797909 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 610b4b75-1d84-4d75-824c-9acc7e706b58, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=610b4b75-1d84-4d75-824c-9acc7e706b58,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:10:18.805092 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:18.857863 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=610b4b75-1d84-4d75-824c-9acc7e706b58,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:10:18.993546 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['610b4b75-1d84-4d75-824c-9acc7e706b58'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:10:19.730912 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ac17a44-e76f-4ae2-879b-78c36105d8d2 req-1cd3028a-00fe-47f9-a68b-eea39e3797b0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:19.732432 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ac17a44-e76f-4ae2-879b-78c36105d8d2 req-1cd3028a-00fe-47f9-a68b-eea39e3797b0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 944 time: 0.0524974 Dec 09 22:10:19.795982 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7ac17a44-e76f-4ae2-879b-78c36105d8d2 req-62139bf9-8774-4891-a7dd-f3fbd8303785 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0546501 Dec 09 22:10:20.629786 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 610b4b75-1d84-4d75-824c-9acc7e706b58 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:10:20.687491 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 610b4b75-1d84-4d75-824c-9acc7e706b58 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:10:20.693462 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 610b4b75-1d84-4d75-824c-9acc7e706b58 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:10:20.693965 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:20.777850 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:20.801366 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7fdff4bc-9748-44a2-952f-49c96d156e5d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '610b4b75-1d84-4d75-824c-9acc7e706b58'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:10:20.803710 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e9ee08a1-f6e4-40e0-8533-b7565d4e23a5" -d '{"events": [{"server_uuid": "7fdff4bc-9748-44a2-952f-49c96d156e5d", "name": "network-vif-plugged", "status": "completed", "tag": "610b4b75-1d84-4d75-824c-9acc7e706b58"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:10:20.817640 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 610b4b75-1d84-4d75-824c-9acc7e706b58, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=610b4b75-1d84-4d75-824c-9acc7e706b58,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:10:20.827679 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:20.855618 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:10:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f3c78a97-51d2-4a84-bf32-cfd1868e0b6d x-openstack-request-id: req-f3c78a97-51d2-4a84-bf32-cfd1868e0b6d {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:10:20.855914 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7fdff4bc-9748-44a2-952f-49c96d156e5d", "name": "network-vif-plugged", "status": "completed", "tag": "610b4b75-1d84-4d75-824c-9acc7e706b58", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:10:20.856174 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f3c78a97-51d2-4a84-bf32-cfd1868e0b6d {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:10:20.856566 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7fdff4bc-9748-44a2-952f-49c96d156e5d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '610b4b75-1d84-4d75-824c-9acc7e706b58', 'code': 200} Dec 09 22:10:20.884234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=610b4b75-1d84-4d75-824c-9acc7e706b58,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:10:20.947701 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dccc7f8-1902-423e-8452-beb1f19b1b55 req-4bcdcbc4-59b5-491c-84ea-0f3d1301d25e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:20.950022 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8dccc7f8-1902-423e-8452-beb1f19b1b55 req-4bcdcbc4-59b5-491c-84ea-0f3d1301d25e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 945 time: 0.0577128 Dec 09 22:10:20.960968 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4709fcd1-30eb-4f42-bf16-b1237471678f req-e8a1eb84-ed61-4787-8bd2-f1db87562635 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:20.962521 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4709fcd1-30eb-4f42-bf16-b1237471678f req-e8a1eb84-ed61-4787-8bd2-f1db87562635 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 1097 time: 0.0440333 Dec 09 22:10:21.002314 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8dccc7f8-1902-423e-8452-beb1f19b1b55 req-a86101af-3314-4651-a257-1c6470ee4583 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446742 Dec 09 22:10:21.015867 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4709fcd1-30eb-4f42-bf16-b1237471678f req-0c0e5482-ffbe-4606-8a59-ec3d32838dd6 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452704 Dec 09 22:10:22.136544 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74015917-6384-427c-96e3-bbfaea794b6c req-6154be6b-1ffe-485e-9965-bfbd5eac3112 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:22.138048 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-74015917-6384-427c-96e3-bbfaea794b6c req-6154be6b-1ffe-485e-9965-bfbd5eac3112 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 945 time: 0.0598817 Dec 09 22:10:22.186372 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-74015917-6384-427c-96e3-bbfaea794b6c req-a04f997b-7907-4b6b-b029-5d3df5e2ba8e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422378 Dec 09 22:10:22.306231 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec3e15e6-ebe1-42c4-9771-eabf5a5e17d0 req-22d74387-344f-42e5-ab26-0a88ae97fd5d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:22.307669 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ec3e15e6-ebe1-42c4-9771-eabf5a5e17d0 req-22d74387-344f-42e5-ab26-0a88ae97fd5d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 945 time: 0.0552781 Dec 09 22:10:22.316891 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 59662) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:10:22.322340 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-37c9424d-0d5a-4ccb-8dc8-e641a6b02099 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Request body: {'floatingip': {'port_id': '610b4b75-1d84-4d75-824c-9acc7e706b58'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:10:22.366539 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-37c9424d-0d5a-4ccb-8dc8-e641a6b02099 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for floatingip, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:22.818397 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-37c9424d-0d5a-4ccb-8dc8-e641a6b02099 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:22.823802 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-37c9424d-0d5a-4ccb-8dc8-e641a6b02099 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:22.928168 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-37c9424d-0d5a-4ccb-8dc8-e641a6b02099 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Floating IP ded53112-c89a-4a62-a1b4-d803c592f310 associated. External IP: 172.25.3.185, port: 610b4b75-1d84-4d75-824c-9acc7e706b58. Dec 09 22:10:23.140641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-37c9424d-0d5a-4ccb-8dc8-e641a6b02099 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:10:23.253892 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-37c9424d-0d5a-4ccb-8dc8-e641a6b02099 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:10:23.259007 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-37c9424d-0d5a-4ccb-8dc8-e641a6b02099 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:23.263769 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7df10229-05f4-4caa-92c7-7bf4d816df0e None None] Sync routers for ids ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:10:23.274848 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7df10229-05f4-4caa-92c7-7bf4d816df0e None None] Routers {'7e861ee9-d29c-4ade-a3ab-cce44cba2c97'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:10:23.275424 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-7df10229-05f4-4caa-92c7-7bf4d816df0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:10:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:10:23.286648 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-37c9424d-0d5a-4ccb-8dc8-e641a6b02099 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "PUT /v2.0/floatingips/ded53112-c89a-4a62-a1b4-d803c592f310 HTTP/1.1" status: 200 len: 991 time: 0.9684432 Dec 09 22:10:23.287240 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7fdff4bc-9748-44a2-952f-49c96d156e5d', 'tag': '610b4b75-1d84-4d75-824c-9acc7e706b58'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:10:23.289778 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-70345e36-ebce-4de5-824c-bb1195c97219" -d '{"events": [{"name": "network-changed", "server_uuid": "7fdff4bc-9748-44a2-952f-49c96d156e5d", "tag": "610b4b75-1d84-4d75-824c-9acc7e706b58"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:10:23.383119 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:10:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fcfec61c-f7c9-4597-8ea5-a376d64e1100 x-openstack-request-id: req-fcfec61c-f7c9-4597-8ea5-a376d64e1100 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:10:23.383469 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7fdff4bc-9748-44a2-952f-49c96d156e5d", "tag": "610b4b75-1d84-4d75-824c-9acc7e706b58", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:10:23.383738 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-fcfec61c-f7c9-4597-8ea5-a376d64e1100 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:10:23.384155 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7fdff4bc-9748-44a2-952f-49c96d156e5d', 'tag': '610b4b75-1d84-4d75-824c-9acc7e706b58', 'status': 'completed', 'code': 200} Dec 09 22:10:23.392088 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-7df10229-05f4-4caa-92c7-7bf4d816df0e None None] Set router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:10:23.447612 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70345e36-ebce-4de5-824c-bb1195c97219 req-c70e4765-0253-41c5-8efd-b770ba30a0c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:23.449183 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70345e36-ebce-4de5-824c-bb1195c97219 req-c70e4765-0253-41c5-8efd-b770ba30a0c4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 1097 time: 0.0418882 Dec 09 22:10:23.541965 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70345e36-ebce-4de5-824c-bb1195c97219 req-ef6b6bda-8a3b-4afa-b129-5492623de564 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:23.543499 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70345e36-ebce-4de5-824c-bb1195c97219 req-ef6b6bda-8a3b-4afa-b129-5492623de564 service neutron] 10.222.0.31 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0874736 Dec 09 22:10:23.613387 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70345e36-ebce-4de5-824c-bb1195c97219 req-a7ef8487-596e-445c-95c1-092866d0ccbe service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=610b4b75-1d84-4d75-824c-9acc7e706b58 HTTP/1.1" status: 200 len: 999 time: 0.0627606 Dec 09 22:10:23.613677 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-7df10229-05f4-4caa-92c7-7bf4d816df0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'ded53112-c89a-4a62-a1b4-d803c592f310', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'floating_ip_address': '172.25.3.185', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'port_id': '610b4b75-1d84-4d75-824c-9acc7e706b58', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 4083, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'mac_address': 'fa:16:3e:03:6e:ba', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7fdff4bc-9748-44a2-952f-49c96d156e5d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:08:04Z', 'updated_at': '2021-12-09T22:10:22Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:05Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:10:23.643938 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7df10229-05f4-4caa-92c7-7bf4d816df0e None None] Checking router: 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:10:23.652442 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7df10229-05f4-4caa-92c7-7bf4d816df0e None None] Routers {'7e861ee9-d29c-4ade-a3ab-cce44cba2c97'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:10:23.653051 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-7df10229-05f4-4caa-92c7-7bf4d816df0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:10:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:10:23.662952 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70345e36-ebce-4de5-824c-bb1195c97219 req-41bcfb19-c5cc-482f-9cd6-c5e5b774ce5e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:23.664545 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70345e36-ebce-4de5-824c-bb1195c97219 req-41bcfb19-c5cc-482f-9cd6-c5e5b774ce5e service neutron] 10.222.0.31 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0438156 Dec 09 22:10:23.709819 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70345e36-ebce-4de5-824c-bb1195c97219 req-2c49fd87-805e-438b-a3e9-d7ecc49707c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:10:23.711420 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70345e36-ebce-4de5-824c-bb1195c97219 req-2c49fd87-805e-438b-a3e9-d7ecc49707c4 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0403767 Dec 09 22:10:23.759318 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-7df10229-05f4-4caa-92c7-7bf4d816df0e None None] Set router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:10:23.806168 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70345e36-ebce-4de5-824c-bb1195c97219 req-8eef5e73-deb4-405a-9e30-3fa6aaf7f2e5 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0875905 Dec 09 22:10:23.897114 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70345e36-ebce-4de5-824c-bb1195c97219 req-c6b2aee0-6299-4650-b223-2261142179b5 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0837369 Dec 09 22:10:24.076284 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-7df10229-05f4-4caa-92c7-7bf4d816df0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'ded53112-c89a-4a62-a1b4-d803c592f310', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'floating_ip_address': '172.25.3.185', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'port_id': '610b4b75-1d84-4d75-824c-9acc7e706b58', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 4083, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'mac_address': 'fa:16:3e:03:6e:ba', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7fdff4bc-9748-44a2-952f-49c96d156e5d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:08:04Z', 'updated_at': '2021-12-09T22:10:22Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:05Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:10:24.104750 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7df10229-05f4-4caa-92c7-7bf4d816df0e None None] The sync data for ids ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'] in n-d-713301-27 is: [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'ded53112-c89a-4a62-a1b4-d803c592f310', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'floating_ip_address': '172.25.3.185', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'port_id': '610b4b75-1d84-4d75-824c-9acc7e706b58', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 4083, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'mac_address': 'fa:16:3e:03:6e:ba', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7fdff4bc-9748-44a2-952f-49c96d156e5d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:08:04Z', 'updated_at': '2021-12-09T22:10:22Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:05Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:10:24.307551 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a58e4a01-4532-4fa1-825e-883486937a4b None None] New status for floating IP ded53112-c89a-4a62-a1b4-d803c592f310: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:10:27.578650 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:27.705767 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:33.007952 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ada57d0c-92ac-4a2c-b4aa-fd4938ad4228 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:35.645592 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5b25129b-c589-47f2-81f7-2cfd008c71ac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:36.796470 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:38.135177 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:39.671972 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:53.233932 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:10:57.603671 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:10:57.704752 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:11:02.699096 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4fc71be9-3246-4363-8568-97d9d2ced1fa req-945380b7-5b4e-4aaf-9deb-c018b27fe80c service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0474622 Dec 09 22:11:02.786694 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fc71be9-3246-4363-8568-97d9d2ced1fa req-20899af5-12e6-490c-b580-821c4a7dd994 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:11:02.788406 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4fc71be9-3246-4363-8568-97d9d2ced1fa req-20899af5-12e6-490c-b580-821c4a7dd994 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 1097 time: 0.0428631 Dec 09 22:11:02.905744 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fc71be9-3246-4363-8568-97d9d2ced1fa req-de35f09a-f48f-4b57-bdfa-62af96ee3192 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:11:02.907252 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4fc71be9-3246-4363-8568-97d9d2ced1fa req-de35f09a-f48f-4b57-bdfa-62af96ee3192 service neutron] 10.222.0.31 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0945475 Dec 09 22:11:02.978200 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4fc71be9-3246-4363-8568-97d9d2ced1fa req-9b5ae3de-e943-41f2-9376-2a21c623c70c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=610b4b75-1d84-4d75-824c-9acc7e706b58 HTTP/1.1" status: 200 len: 1001 time: 0.0640385 Dec 09 22:11:03.009004 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6b844fc2-f272-4eb8-b6f6-e4ec49aef2d5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:11:03.036259 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fc71be9-3246-4363-8568-97d9d2ced1fa req-8aa1d032-6fa7-47c9-a2b0-4604c281e6e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:11:03.037848 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4fc71be9-3246-4363-8568-97d9d2ced1fa req-8aa1d032-6fa7-47c9-a2b0-4604c281e6e3 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0525825 Dec 09 22:11:03.088835 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fc71be9-3246-4363-8568-97d9d2ced1fa req-e65bc435-7457-453e-9820-305925f36cdd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:11:03.090339 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4fc71be9-3246-4363-8568-97d9d2ced1fa req-e65bc435-7457-453e-9820-305925f36cdd service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0446069 Dec 09 22:11:03.101559 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-4fc71be9-3246-4363-8568-97d9d2ced1fa req-bd80525b-48bd-48d4-9f83-b246a036c2ac service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 22:11:03.102467 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4fc71be9-3246-4363-8568-97d9d2ced1fa req-bd80525b-48bd-48d4-9f83-b246a036c2ac service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0052056 Dec 09 22:11:03.192303 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4fc71be9-3246-4363-8568-97d9d2ced1fa req-18ca8fed-7f73-459b-a9f0-ebfdea1e7321 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0815184 Dec 09 22:11:03.295551 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4fc71be9-3246-4363-8568-97d9d2ced1fa req-6c6512dd-b7c5-483c-946b-69acde459477 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0963907 Dec 09 22:11:05.649976 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b1200df8-e4d8-4664-9967-1044e85b4f6a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:11:06.802196 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:11:08.132425 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:11:09.668366 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:11:27.596285 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:11:27.702783 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:11:30.228857 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:11:33.005482 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-83507864-e3eb-4b26-bac1-6379ed1369fd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:11:35.654827 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6f0effb8-8953-4b5c-8d14-13c551ebf5fd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:11:36.815887 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:11:38.135958 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:11:39.673867 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:11:57.594557 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:11:57.720412 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:00.116963 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a5ab06-ebb9-4a2c-9177-51f63bf26c8c req-1836e30a-8ac4-4b98-aa58-a63df3aeef4b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:00.118487 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99a5ab06-ebb9-4a2c-9177-51f63bf26c8c req-1836e30a-8ac4-4b98-aa58-a63df3aeef4b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 945 time: 0.0595644 Dec 09 22:12:00.167674 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99a5ab06-ebb9-4a2c-9177-51f63bf26c8c req-38bba269-8df7-47df-82b8-882b9deb6d16 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427704 Dec 09 22:12:01.304108 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5656e07-71d9-4abe-83dd-bae7026988e1 req-7e8b95ed-32bb-4ce6-bfce-7c1969b9642a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:01.305618 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5656e07-71d9-4abe-83dd-bae7026988e1 req-7e8b95ed-32bb-4ce6-bfce-7c1969b9642a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 945 time: 0.0613954 Dec 09 22:12:01.358229 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5656e07-71d9-4abe-83dd-bae7026988e1 req-2049dadd-1149-4481-922f-6a9480bb0e6b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464897 Dec 09 22:12:02.494647 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eeafd46-dbad-436b-b63d-53470457f7b1 req-a4f249c5-8e4b-46e7-b50a-e12a9cdc441a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:02.496144 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9eeafd46-dbad-436b-b63d-53470457f7b1 req-a4f249c5-8e4b-46e7-b50a-e12a9cdc441a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 945 time: 0.0513198 Dec 09 22:12:02.544579 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9eeafd46-dbad-436b-b63d-53470457f7b1 req-a1a818a9-0c5e-4380-bace-85a7e387dd92 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422893 Dec 09 22:12:03.009258 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-07b66a9f-fb53-4926-b976-30e8b89a47ff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:03.679296 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43029970-4f57-4337-8e26-37abddae786f req-1bec2119-b761-4756-8b18-cafd0c04889a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:03.680898 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43029970-4f57-4337-8e26-37abddae786f req-1bec2119-b761-4756-8b18-cafd0c04889a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 945 time: 0.0522172 Dec 09 22:12:03.738988 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43029970-4f57-4337-8e26-37abddae786f req-b3b452a9-e6f2-45fc-9439-e7b9e4631453 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517113 Dec 09 22:12:04.788356 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19274ccc-2a5c-4f2f-844f-4d776231ab9d req-5b3e9108-b04c-4087-a72b-9541f0a6d53d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:04.789967 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-19274ccc-2a5c-4f2f-844f-4d776231ab9d req-5b3e9108-b04c-4087-a72b-9541f0a6d53d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 1097 time: 0.1153615 Dec 09 22:12:04.865655 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-781e0298-6076-4c83-a36a-d40a3812543e req-aec35501-4b54-4066-a1c2-30b144a53446 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:04.867194 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-781e0298-6076-4c83-a36a-d40a3812543e req-aec35501-4b54-4066-a1c2-30b144a53446 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 945 time: 0.0507617 Dec 09 22:12:04.902056 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19274ccc-2a5c-4f2f-844f-4d776231ab9d req-0b46f1b3-2eb8-41a3-aecd-6a75716d8251 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:04.903775 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-19274ccc-2a5c-4f2f-844f-4d776231ab9d req-0b46f1b3-2eb8-41a3-aecd-6a75716d8251 service neutron] 10.222.0.31 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0914557 Dec 09 22:12:04.915709 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-781e0298-6076-4c83-a36a-d40a3812543e req-2fe82229-b346-4b3f-a367-e1a37027fe48 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423234 Dec 09 22:12:04.971630 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-19274ccc-2a5c-4f2f-844f-4d776231ab9d req-f7378617-47d2-4e77-b2f0-e6a0e5597a2f service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=610b4b75-1d84-4d75-824c-9acc7e706b58 HTTP/1.1" status: 200 len: 1001 time: 0.0606136 Dec 09 22:12:05.021994 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19274ccc-2a5c-4f2f-844f-4d776231ab9d req-1c2667b9-adc2-430f-94cf-a4149df81f04 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:05.023427 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-19274ccc-2a5c-4f2f-844f-4d776231ab9d req-1c2667b9-adc2-430f-94cf-a4149df81f04 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0447252 Dec 09 22:12:05.072226 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19274ccc-2a5c-4f2f-844f-4d776231ab9d req-0ec92c16-e34f-457d-837f-104d131912f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:05.073709 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-19274ccc-2a5c-4f2f-844f-4d776231ab9d req-0ec92c16-e34f-457d-837f-104d131912f2 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0427508 Dec 09 22:12:05.168433 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-19274ccc-2a5c-4f2f-844f-4d776231ab9d req-8e274514-43bd-42b4-9f15-cfc0a97e5fae service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0870037 Dec 09 22:12:05.275276 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-19274ccc-2a5c-4f2f-844f-4d776231ab9d req-a29273e8-b41e-49f5-b8e9-ec8f0ee84a46 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0978165 Dec 09 22:12:05.666135 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6a286156-2b8b-4552-aff6-2f685dcda0ee None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:06.045624 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e731240e-311a-447e-adab-a0d29b7acc40 req-64b87cde-6d94-44fc-9bf5-357eaa357e82 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:06.047118 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e731240e-311a-447e-adab-a0d29b7acc40 req-64b87cde-6d94-44fc-9bf5-357eaa357e82 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 945 time: 0.0545540 Dec 09 22:12:06.098017 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e731240e-311a-447e-adab-a0d29b7acc40 req-62b8b527-2c89-4915-b59b-4b1bca26b718 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420551 Dec 09 22:12:06.807781 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:07.228366 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:12:07.230330 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ab28ff2-50e7-4607-bd9e-0004780f38bc req-b1ecf6ae-98e7-4f2d-a710-c25e1817f7e7 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:07.231881 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0ab28ff2-50e7-4607-bd9e-0004780f38bc req-b1ecf6ae-98e7-4f2d-a710-c25e1817f7e7 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 945 time: 0.0550394 Dec 09 22:12:07.282506 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0ab28ff2-50e7-4607-bd9e-0004780f38bc req-b1e04163-2ce7-47b1-8f8f-d993274876dc tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441704 Dec 09 22:12:08.138047 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:08.408528 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a33dbafd-5b3b-44aa-b11d-07a0f9f9846e req-c5f94475-fdd9-4390-95d8-870d4579457b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:08.410020 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a33dbafd-5b3b-44aa-b11d-07a0f9f9846e req-c5f94475-fdd9-4390-95d8-870d4579457b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 945 time: 0.0497007 Dec 09 22:12:08.458499 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a33dbafd-5b3b-44aa-b11d-07a0f9f9846e req-677919d5-a436-4e4d-9171-4fe6c63d4ff2 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421822 Dec 09 22:12:09.597733 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5603ac5d-8089-4b66-a76d-9de20bc8b92b req-999b67d8-1084-4c51-8819-d21c1bf1bb84 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:09.600191 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5603ac5d-8089-4b66-a76d-9de20bc8b92b req-999b67d8-1084-4c51-8819-d21c1bf1bb84 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 945 time: 0.0654829 Dec 09 22:12:09.660396 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5603ac5d-8089-4b66-a76d-9de20bc8b92b req-0d85c17e-13da-4de2-9064-33acaacf7660 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0494583 Dec 09 22:12:09.672183 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:10.786506 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-028dc1f5-c0f8-4984-b290-643e7846c4db req-12671db8-f645-4936-a9c0-87f916f4fc1a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:10.788043 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-028dc1f5-c0f8-4984-b290-643e7846c4db req-12671db8-f645-4936-a9c0-87f916f4fc1a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 945 time: 0.0520296 Dec 09 22:12:10.837468 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-028dc1f5-c0f8-4984-b290-643e7846c4db req-de36f607-e560-4759-83e4-ba8155863eb8 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433640 Dec 09 22:12:11.087325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ef7dfb3-ad0b-428f-a026-ca5e2f15ad2f req-a44df324-34bf-462a-8db0-7d5c87b9d562 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:11.088966 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ef7dfb3-ad0b-428f-a026-ca5e2f15ad2f req-a44df324-34bf-462a-8db0-7d5c87b9d562 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 945 time: 0.0497420 Dec 09 22:12:11.163886 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-317ace12-c174-4224-ad98-4ee6a26b46c4 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1307099 Dec 09 22:12:11.167554 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ef7dfb3-ad0b-428f-a026-ca5e2f15ad2f req-4eb7a299-02ba-4f2a-b2b1-03eb5cb3c69a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0701175 Dec 09 22:12:12.301945 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a507297-c6a7-4cc4-9e76-f4313879bcfd req-4e0e69ab-b32a-40d2-8017-62e25798d610 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:12.303684 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a507297-c6a7-4cc4-9e76-f4313879bcfd req-4e0e69ab-b32a-40d2-8017-62e25798d610 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 945 time: 0.0586178 Dec 09 22:12:12.351923 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a507297-c6a7-4cc4-9e76-f4313879bcfd req-d3f7e583-5023-49a7-b232-cda8480c1036 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422137 Dec 09 22:12:13.480424 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4ad37f3-d6e7-42c6-b112-8b70135ae9d3 req-bf7c1d01-eea8-4eb4-af0c-9813eb8059ed tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:13.481917 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e4ad37f3-d6e7-42c6-b112-8b70135ae9d3 req-bf7c1d01-eea8-4eb4-af0c-9813eb8059ed tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 945 time: 0.0534704 Dec 09 22:12:13.533193 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e4ad37f3-d6e7-42c6-b112-8b70135ae9d3 req-1a199056-63fb-4418-bb79-25e16e6c092d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450740 Dec 09 22:12:14.658977 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d6c612f-5611-46c6-bed7-8b061600b041 req-4ee27898-10af-44e0-9e3f-1b21001512ae tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:14.660489 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5d6c612f-5611-46c6-bed7-8b061600b041 req-4ee27898-10af-44e0-9e3f-1b21001512ae tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 945 time: 0.0523570 Dec 09 22:12:14.711263 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5d6c612f-5611-46c6-bed7-8b061600b041 req-ca9a400d-0546-44cf-8414-cfc78004d7bd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412824 Dec 09 22:12:15.850560 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b04bf855-dcfb-4279-983e-f0063e086169 req-25e359b7-96d2-476c-b7b7-5558fc0f69fc tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:15.852095 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b04bf855-dcfb-4279-983e-f0063e086169 req-25e359b7-96d2-476c-b7b7-5558fc0f69fc tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 945 time: 0.0522480 Dec 09 22:12:15.904269 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b04bf855-dcfb-4279-983e-f0063e086169 req-cd2890af-9475-49df-9bdc-a07d5d7d4d87 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456414 Dec 09 22:12:16.475104 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-1e8c237e-8f54-4b17-8861-7c4341a760cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:16.476641 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-1e8c237e-8f54-4b17-8861-7c4341a760cf service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 1097 time: 0.0432978 Dec 09 22:12:16.571942 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d0a3dbaf-78a4-424f-a7f4-58e5c7942eda service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:16.573424 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d0a3dbaf-78a4-424f-a7f4-58e5c7942eda service neutron] 10.222.0.31 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0896511 Dec 09 22:12:16.648698 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-b18d029c-75f9-4904-aa0b-f11ca9a8d5f0 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=610b4b75-1d84-4d75-824c-9acc7e706b58 HTTP/1.1" status: 200 len: 1001 time: 0.0682938 Dec 09 22:12:16.705024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-bedc0064-43e2-4657-8179-5b4f3e916013 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:16.706477 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-bedc0064-43e2-4657-8179-5b4f3e916013 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0510292 Dec 09 22:12:16.760331 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-ef0983ec-1e2a-4c1f-8114-24963bb265ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:16.761791 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-ef0983ec-1e2a-4c1f-8114-24963bb265ea service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0483201 Dec 09 22:12:16.852441 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-44e0531f-0363-42c1-9afb-3f15a88b31a8 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0831492 Dec 09 22:12:16.947622 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-6b0bb5b5-6cb5-4c9b-b426-c3aa0d6dd9ba service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0881426 Dec 09 22:12:17.029036 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7f5732b-225e-4bf0-af97-5df0971a521f req-0a499648-7447-4670-be02-17ceda815166 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:17.030600 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7f5732b-225e-4bf0-af97-5df0971a521f req-0a499648-7447-4670-be02-17ceda815166 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 945 time: 0.0567820 Dec 09 22:12:17.085259 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7f5732b-225e-4bf0-af97-5df0971a521f req-18234368-5389-4fb8-a825-313cd17c8006 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0485401 Dec 09 22:12:18.216589 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea1824b0-3dbb-43f6-8934-471e669859b5 req-f079858b-9798-4335-8a98-dd75b2593ec0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:18.218058 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea1824b0-3dbb-43f6-8934-471e669859b5 req-f079858b-9798-4335-8a98-dd75b2593ec0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 945 time: 0.0533822 Dec 09 22:12:18.268055 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea1824b0-3dbb-43f6-8934-471e669859b5 req-df113861-83ce-4d71-a8d8-a5f11146d6b7 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417664 Dec 09 22:12:18.672905 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-8556e387-a559-4e6b-8cba-fdaa58823d15 service neutron] show failed (client error): The resource could not be found. Dec 09 22:12:18.673943 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-8556e387-a559-4e6b-8cba-fdaa58823d15 service neutron] 10.222.0.31 "GET /v2.0/ports/610b4b75-1d84-4d75-824c-9acc7e706b58/bindings/n-h2-713301-27 HTTP/1.1" status: 404 len: 381 time: 0.0637853 Dec 09 22:12:18.935478 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-5d651617-7a2a-444c-9322-ad81572e0034 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:18.936930 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-5d651617-7a2a-444c-9322-ad81572e0034 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d&tenant_id=ecd32dac944041b58de1a396ec18cd2c HTTP/1.1" status: 200 len: 1097 time: 0.0935838 Dec 09 22:12:18.948738 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Request body: {'port': {'binding:host_id': 'n-h2-713301-27', 'device_owner': 'compute:nova'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:12:19.003403 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:19.404998 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3421eee-9d4a-442b-997e-49db340a702b req-60bae5d3-f0b3-4648-bc1b-e894167132d8 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:19.406637 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b3421eee-9d4a-442b-997e-49db340a702b req-60bae5d3-f0b3-4648-bc1b-e894167132d8 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 945 time: 0.0619283 Dec 09 22:12:19.458807 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b3421eee-9d4a-442b-997e-49db340a702b req-3217834b-c017-49ee-aa27-4322872f8250 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451443 Dec 09 22:12:19.552079 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] For port 610b4b75-1d84-4d75-824c-9acc7e706b58, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=610b4b75-1d84-4d75-824c-9acc7e706b58,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:12:19.585726 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] For port 610b4b75-1d84-4d75-824c-9acc7e706b58, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:12:19.633487 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7fdff4bc-9748-44a2-952f-49c96d156e5d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '610b4b75-1d84-4d75-824c-9acc7e706b58'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:12:19.636085 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-306fd7be-d3bf-4026-885b-9b7db0f41769" -d '{"events": [{"server_uuid": "7fdff4bc-9748-44a2-952f-49c96d156e5d", "name": "network-vif-unplugged", "status": "completed", "tag": "610b4b75-1d84-4d75-824c-9acc7e706b58"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:12:19.639816 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:19.652486 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Transition to ACTIVE for port object 610b4b75-1d84-4d75-824c-9acc7e706b58 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:12:19.657802 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:19.747431 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Pushing event updated for resources: {'Port': ['ID=610b4b75-1d84-4d75-824c-9acc7e706b58,revision_number=6']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:12:19.758527 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:19.759286 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:19.759663 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:19.760129 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:19.760326 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:19.760656 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:19.760978 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:19.761297 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:19.761616 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:19.761935 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:19.762258 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:19.762577 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:19.762886 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:19.787730 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 22:12:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-235a44c9-5962-49e7-aeb4-b0b7ea6067ef x-openstack-request-id: req-235a44c9-5962-49e7-aeb4-b0b7ea6067ef {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:12:19.788031 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7fdff4bc-9748-44a2-952f-49c96d156e5d", "name": "network-vif-unplugged", "status": "completed", "tag": "610b4b75-1d84-4d75-824c-9acc7e706b58", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:12:19.788279 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-235a44c9-5962-49e7-aeb4-b0b7ea6067ef {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:12:19.788679 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7fdff4bc-9748-44a2-952f-49c96d156e5d', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '610b4b75-1d84-4d75-824c-9acc7e706b58', 'code': 200} Dec 09 22:12:19.809442 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] No DVR routers for this DVR port 610b4b75-1d84-4d75-824c-9acc7e706b58 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:12:19.945653 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Attempting to bind port 610b4b75-1d84-4d75-824c-9acc7e706b58 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:12:19.945865 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Attempting to bind port 610b4b75-1d84-4d75-824c-9acc7e706b58 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:12:19.946229 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Attempting to bind port 610b4b75-1d84-4d75-824c-9acc7e706b58 on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:12:19.950630 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Port 610b4b75-1d84-4d75-824c-9acc7e706b58 on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:12:19.950945 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Attempting to bind port 610b4b75-1d84-4d75-824c-9acc7e706b58 on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:12:19.956011 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 11, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:12:19.956348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Checking segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:12:19.956727 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Bound using segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:12:19.957143 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Bound port: 610b4b75-1d84-4d75-824c-9acc7e706b58, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:12:19.957489 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:20.023220 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] For port 610b4b75-1d84-4d75-824c-9acc7e706b58, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:12:20.026503 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] For port 610b4b75-1d84-4d75-824c-9acc7e706b58, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=610b4b75-1d84-4d75-824c-9acc7e706b58,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:12:20.034608 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:20.069407 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:20.070089 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:20.071515 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] 10.222.0.10 "PUT /v2.0/ports/610b4b75-1d84-4d75-824c-9acc7e706b58 HTTP/1.1" status: 200 len: 1092 time: 1.1267171 Dec 09 22:12:20.108376 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1bc769e-1dfa-4537-ba9e-95c55527bc86 service neutron] Pushing event updated for resources: {'Port': ['ID=610b4b75-1d84-4d75-824c-9acc7e706b58,revision_number=7']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:12:20.141167 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-324e8e6c-9a6d-4a16-9287-47be84914043 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:20.142703 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-324e8e6c-9a6d-4a16-9287-47be84914043 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 1095 time: 0.0476096 Dec 09 22:12:20.243700 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-46d0e8e7-3f05-4936-a576-75634cd3783b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:20.245279 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-46d0e8e7-3f05-4936-a576-75634cd3783b service neutron] 10.222.0.10 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0947592 Dec 09 22:12:20.321982 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-c045276d-73e9-427b-aa8f-b0266545dd0d service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=610b4b75-1d84-4d75-824c-9acc7e706b58 HTTP/1.1" status: 200 len: 999 time: 0.0691192 Dec 09 22:12:20.376925 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-9495989a-76dd-42e8-ac40-2d5fe9250554 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:20.378819 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-9495989a-76dd-42e8-ac40-2d5fe9250554 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0500388 Dec 09 22:12:20.429216 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-35098ad9-a10f-432d-8b1a-cbe0abf70be8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:20.430741 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-35098ad9-a10f-432d-8b1a-cbe0abf70be8 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0448551 Dec 09 22:12:20.523081 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-af17cf6c-67cd-48fd-8eab-5a7ea9ef27e7 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0846384 Dec 09 22:12:20.582688 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7fbf9f6-e9a3-4d3f-a721-35ac24e0f9fd req-98604a44-9ed0-49bf-aac4-166b8e942833 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:20.584366 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7fbf9f6-e9a3-4d3f-a721-35ac24e0f9fd req-98604a44-9ed0-49bf-aac4-166b8e942833 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 943 time: 0.0508678 Dec 09 22:12:20.619706 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33456c36-5151-4fc2-8c38-3a1bdf8dca0a req-2102ca99-513e-458d-a6f7-bab76f0428a3 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0896077 Dec 09 22:12:20.632021 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7fbf9f6-e9a3-4d3f-a721-35ac24e0f9fd req-5e75ee20-9536-4021-852b-af8a5aaeb6c4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413563 Dec 09 22:12:21.309384 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 610b4b75-1d84-4d75-824c-9acc7e706b58 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:12:21.348939 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 610b4b75-1d84-4d75-824c-9acc7e706b58 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:12:21.754735 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecebfcdd-0a9c-44cf-a2da-4798a081fda4 req-06b0cdb7-4bd6-4d8d-ad93-567f1524cd4e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:21.756247 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ecebfcdd-0a9c-44cf-a2da-4798a081fda4 req-06b0cdb7-4bd6-4d8d-ad93-567f1524cd4e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 943 time: 0.0503907 Dec 09 22:12:21.791076 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7fdff4bc-9748-44a2-952f-49c96d156e5d', 'tag': '610b4b75-1d84-4d75-824c-9acc7e706b58'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:12:21.793832 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fffb8065-791c-41e6-bd03-61026453aaa3" -d '{"events": [{"name": "network-changed", "server_uuid": "7fdff4bc-9748-44a2-952f-49c96d156e5d", "tag": "610b4b75-1d84-4d75-824c-9acc7e706b58"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:12:21.816955 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ecebfcdd-0a9c-44cf-a2da-4798a081fda4 req-00eaa9bb-2697-4b9d-a8aa-4a92d4501dec tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0534337 Dec 09 22:12:21.880558 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:12:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8797224a-988d-4302-be4c-1babcaeb17b4 x-openstack-request-id: req-8797224a-988d-4302-be4c-1babcaeb17b4 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:12:21.880862 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7fdff4bc-9748-44a2-952f-49c96d156e5d", "tag": "610b4b75-1d84-4d75-824c-9acc7e706b58", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:12:21.881122 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8797224a-988d-4302-be4c-1babcaeb17b4 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:12:21.882146 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7fdff4bc-9748-44a2-952f-49c96d156e5d', 'tag': '610b4b75-1d84-4d75-824c-9acc7e706b58', 'status': 'completed', 'code': 200} Dec 09 22:12:21.966321 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fffb8065-791c-41e6-bd03-61026453aaa3 req-64753c41-38d3-4f6a-974b-4689c7b37e9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:21.967788 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fffb8065-791c-41e6-bd03-61026453aaa3 req-64753c41-38d3-4f6a-974b-4689c7b37e9c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 1095 time: 0.0687501 Dec 09 22:12:21.972151 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fffb8065-791c-41e6-bd03-61026453aaa3 req-22ca9f69-5184-425a-9966-17e63fc154a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:21.973900 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fffb8065-791c-41e6-bd03-61026453aaa3 req-22ca9f69-5184-425a-9966-17e63fc154a6 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 1095 time: 0.0652144 Dec 09 22:12:22.136482 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fffb8065-791c-41e6-bd03-61026453aaa3 req-4053b73d-92d0-47e9-9b5a-4475714132ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:22.137978 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fffb8065-791c-41e6-bd03-61026453aaa3 req-4053b73d-92d0-47e9-9b5a-4475714132ea service neutron] 10.222.0.31 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.1631508 Dec 09 22:12:22.139040 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fffb8065-791c-41e6-bd03-61026453aaa3 req-876ed7e3-d3a1-4e7d-9fa3-2c5fca1eb1f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:22.140388 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fffb8065-791c-41e6-bd03-61026453aaa3 req-876ed7e3-d3a1-4e7d-9fa3-2c5fca1eb1f6 service neutron] 10.222.0.10 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.1578779 Dec 09 22:12:22.253107 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fffb8065-791c-41e6-bd03-61026453aaa3 req-c4f79d09-2435-43e3-96bb-ec87d8b0b0ff service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=610b4b75-1d84-4d75-824c-9acc7e706b58 HTTP/1.1" status: 200 len: 999 time: 0.1075704 Dec 09 22:12:22.256250 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fffb8065-791c-41e6-bd03-61026453aaa3 req-25a04afb-1ef1-4655-8b08-d10d512b6b3b service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=610b4b75-1d84-4d75-824c-9acc7e706b58 HTTP/1.1" status: 200 len: 999 time: 0.1048341 Dec 09 22:12:22.336681 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fffb8065-791c-41e6-bd03-61026453aaa3 req-447584ed-ffae-404f-87b7-d83ab1e1db39 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:22.338178 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fffb8065-791c-41e6-bd03-61026453aaa3 req-447584ed-ffae-404f-87b7-d83ab1e1db39 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0781524 Dec 09 22:12:22.339392 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fffb8065-791c-41e6-bd03-61026453aaa3 req-de0787c2-36b0-4ed5-9d81-6fbc49d72b10 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:22.340731 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fffb8065-791c-41e6-bd03-61026453aaa3 req-de0787c2-36b0-4ed5-9d81-6fbc49d72b10 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0733900 Dec 09 22:12:22.415467 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fffb8065-791c-41e6-bd03-61026453aaa3 req-ea39cd72-df17-4249-91f6-494471bda836 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:22.417005 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fffb8065-791c-41e6-bd03-61026453aaa3 req-ea39cd72-df17-4249-91f6-494471bda836 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0720413 Dec 09 22:12:22.421547 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fffb8065-791c-41e6-bd03-61026453aaa3 req-6090b227-fa51-4793-a14d-f6b039282309 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:22.422907 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fffb8065-791c-41e6-bd03-61026453aaa3 req-6090b227-fa51-4793-a14d-f6b039282309 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0694916 Dec 09 22:12:22.574670 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fffb8065-791c-41e6-bd03-61026453aaa3 req-4b52d825-e099-4911-b103-614e9553a667 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1501551 Dec 09 22:12:22.576454 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fffb8065-791c-41e6-bd03-61026453aaa3 req-1d3a8848-a0a1-4b44-ac6c-41c0fde33054 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1447055 Dec 09 22:12:22.731934 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fffb8065-791c-41e6-bd03-61026453aaa3 req-4f52eeb0-c6ee-4b82-bc76-4ea08856ed96 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1499505 Dec 09 22:12:22.735810 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fffb8065-791c-41e6-bd03-61026453aaa3 req-51d9a733-1d7a-44f5-b4c0-38b2785e869e service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1463971 Dec 09 22:12:22.950376 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0670a540-722e-48b9-b5de-8b97bec3bce2 req-c66929fe-12eb-442a-8527-89433aa1cf51 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:22.952095 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0670a540-722e-48b9-b5de-8b97bec3bce2 req-c66929fe-12eb-442a-8527-89433aa1cf51 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 943 time: 0.0606620 Dec 09 22:12:22.999448 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0670a540-722e-48b9-b5de-8b97bec3bce2 req-fe7fc35f-f84c-4fd3-8b30-3d40f79f8683 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412102 Dec 09 22:12:23.198160 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-825a104e-10ba-42b7-8b57-3560e2dfe391 req-7cdee41f-66b6-44c5-a8b3-a600f6887af2 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:23.199699 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-825a104e-10ba-42b7-8b57-3560e2dfe391 req-7cdee41f-66b6-44c5-a8b3-a600f6887af2 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 943 time: 0.0514696 Dec 09 22:12:23.214915 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d75372ea-9271-44cc-80e0-67a2a64731dc req-fdfc8a67-326e-4c48-91eb-7f93f35cc019 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:23.216475 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d75372ea-9271-44cc-80e0-67a2a64731dc req-fdfc8a67-326e-4c48-91eb-7f93f35cc019 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.31 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d&tenant_id=ecd32dac944041b58de1a396ec18cd2c&binding%3Ahost_id=n-h2-713301-27 HTTP/1.1" status: 200 len: 943 time: 0.0578330 Dec 09 22:12:23.248486 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-825a104e-10ba-42b7-8b57-3560e2dfe391 req-fbff9228-512a-4a55-adea-bc006daa89ac tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426474 Dec 09 22:12:23.279377 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [req-d75372ea-9271-44cc-80e0-67a2a64731dc req-1026e762-441d-4af2-9a20-97c538496fd0 service neutron] delete failed (client error): The resource could not be found. Dec 09 22:12:23.280485 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d75372ea-9271-44cc-80e0-67a2a64731dc req-1026e762-441d-4af2-9a20-97c538496fd0 service neutron] 10.222.0.31 "DELETE /v2.0/ports/610b4b75-1d84-4d75-824c-9acc7e706b58/bindings/n-h1-713301-27 HTTP/1.1" status: 404 len: 381 time: 0.0565238 Dec 09 22:12:23.371321 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d75372ea-9271-44cc-80e0-67a2a64731dc req-d92226ca-8669-4af3-ae9f-4df6d0a77b0e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:23.372852 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d75372ea-9271-44cc-80e0-67a2a64731dc req-d92226ca-8669-4af3-ae9f-4df6d0a77b0e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 1095 time: 0.0452332 Dec 09 22:12:23.469466 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d75372ea-9271-44cc-80e0-67a2a64731dc req-a4e13beb-9778-4c11-ac3a-edacf141870d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:23.470962 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d75372ea-9271-44cc-80e0-67a2a64731dc req-a4e13beb-9778-4c11-ac3a-edacf141870d service neutron] 10.222.0.31 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0908506 Dec 09 22:12:23.543593 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d75372ea-9271-44cc-80e0-67a2a64731dc req-1ac75029-5132-4d16-b1a7-ffbf5a95876e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=610b4b75-1d84-4d75-824c-9acc7e706b58 HTTP/1.1" status: 200 len: 999 time: 0.0645461 Dec 09 22:12:23.594545 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d75372ea-9271-44cc-80e0-67a2a64731dc req-79b0d992-742a-42d9-8bf5-cbb096783a6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:23.596660 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d75372ea-9271-44cc-80e0-67a2a64731dc req-79b0d992-742a-42d9-8bf5-cbb096783a6c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0463519 Dec 09 22:12:23.656350 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d75372ea-9271-44cc-80e0-67a2a64731dc req-3151d4c5-82a7-4b17-a029-b9ce14216356 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:23.657868 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d75372ea-9271-44cc-80e0-67a2a64731dc req-3151d4c5-82a7-4b17-a029-b9ce14216356 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0538507 Dec 09 22:12:23.758275 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d75372ea-9271-44cc-80e0-67a2a64731dc req-9b9d0a27-e6bf-46ef-9a2e-4f77820b2bf3 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0912344 Dec 09 22:12:23.860424 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d75372ea-9271-44cc-80e0-67a2a64731dc req-d6f3d3f4-d03f-499d-8ece-c5e8a1a05206 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0953498 Dec 09 22:12:24.377757 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-299eb02e-0ce1-43f2-b422-f23ab7f419b7 req-70ac57ba-b8a3-4b0e-8b51-1e0b10614551 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:24.379280 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-299eb02e-0ce1-43f2-b422-f23ab7f419b7 req-70ac57ba-b8a3-4b0e-8b51-1e0b10614551 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 943 time: 0.0566735 Dec 09 22:12:24.429270 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-299eb02e-0ce1-43f2-b422-f23ab7f419b7 req-5e935f0e-8cb7-4cbe-8a0e-f11cdf2d1e7e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431066 Dec 09 22:12:24.565051 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8695be72-be4b-47fb-9511-065bc2721ef7 req-f92fbae5-f08a-434d-9150-d021178fa153 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:24.566929 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8695be72-be4b-47fb-9511-065bc2721ef7 req-f92fbae5-f08a-434d-9150-d021178fa153 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 943 time: 0.0641937 Dec 09 22:12:24.615637 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8695be72-be4b-47fb-9511-065bc2721ef7 req-ee150dcf-46d5-41da-ad62-0a980c2af4d0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415580 Dec 09 22:12:24.823728 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b1063db-47e6-41d2-a033-e22be390f138 req-93507025-e4a2-4934-8888-af24caf58f3f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:24.825174 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8b1063db-47e6-41d2-a033-e22be390f138 req-93507025-e4a2-4934-8888-af24caf58f3f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 943 time: 0.0546401 Dec 09 22:12:24.859203 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-416ce04e-97a6-41a4-bab8-d98d8417fab3 req-9a34c638-fae1-4695-bac0-3cb2bf7f73cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:24.860766 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-416ce04e-97a6-41a4-bab8-d98d8417fab3 req-9a34c638-fae1-4695-bac0-3cb2bf7f73cb service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 1095 time: 0.0508466 Dec 09 22:12:24.964956 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-416ce04e-97a6-41a4-bab8-d98d8417fab3 req-fc24791b-7aaf-4739-9c4d-0400e15c162d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:24.966504 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-416ce04e-97a6-41a4-bab8-d98d8417fab3 req-fc24791b-7aaf-4739-9c4d-0400e15c162d service neutron] 10.222.0.10 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0979745 Dec 09 22:12:25.037469 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-416ce04e-97a6-41a4-bab8-d98d8417fab3 req-1b04a3f8-6dba-4106-9e1c-922ed7254a1a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=610b4b75-1d84-4d75-824c-9acc7e706b58 HTTP/1.1" status: 200 len: 999 time: 0.0630684 Dec 09 22:12:25.088706 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-416ce04e-97a6-41a4-bab8-d98d8417fab3 req-bfdf6b88-503e-4bab-bddb-334dab4f0a73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:25.090142 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-416ce04e-97a6-41a4-bab8-d98d8417fab3 req-bfdf6b88-503e-4bab-bddb-334dab4f0a73 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0460968 Dec 09 22:12:25.141624 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-416ce04e-97a6-41a4-bab8-d98d8417fab3 req-ff04876e-bfb0-4e7f-b3c2-2a2d724830b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:25.143193 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-416ce04e-97a6-41a4-bab8-d98d8417fab3 req-ff04876e-bfb0-4e7f-b3c2-2a2d724830b7 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0463588 Dec 09 22:12:25.167402 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8b1063db-47e6-41d2-a033-e22be390f138 req-f7413b60-ae9e-4640-8968-49e3e953f44a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3356140 Dec 09 22:12:25.195314 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 610b4b75-1d84-4d75-824c-9acc7e706b58 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:12:25.243016 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-416ce04e-97a6-41a4-bab8-d98d8417fab3 req-9ba0319c-b2dc-4dec-b4d3-336f60f3e0e5 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0923684 Dec 09 22:12:25.291757 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 610b4b75-1d84-4d75-824c-9acc7e706b58, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=610b4b75-1d84-4d75-824c-9acc7e706b58,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:12:25.303542 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '610b4b75-1d84-4d75-824c-9acc7e706b58', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'port_id': '610b4b75-1d84-4d75-824c-9acc7e706b58', 'mac_address': 'fa:16:3e:03:6e:ba', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:12:25.338082 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-416ce04e-97a6-41a4-bab8-d98d8417fab3 req-6d842729-c9a1-4d7e-8e7d-02bb5d40d0d8 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0877583 Dec 09 22:12:25.343693 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:25.357111 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 610b4b75-1d84-4d75-824c-9acc7e706b58 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:12:25.376652 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 610b4b75-1d84-4d75-824c-9acc7e706b58, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=610b4b75-1d84-4d75-824c-9acc7e706b58,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:12:25.382167 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:25.430821 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=610b4b75-1d84-4d75-824c-9acc7e706b58,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:12:25.438788 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:25.439131 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:25.439472 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:25.439839 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:25.440167 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:25.440533 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:25.440856 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:25.441171 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:25.441490 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:25.441809 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:25.442115 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:25.442428 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:25.442744 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:12:26.311246 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb335262-6c8e-414f-b484-9b6639eb3dd0 req-ef51e551-b1cd-44d6-b194-6b8b8428e156 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:26.312746 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bb335262-6c8e-414f-b484-9b6639eb3dd0 req-ef51e551-b1cd-44d6-b194-6b8b8428e156 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 944 time: 0.0590637 Dec 09 22:12:26.374680 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bb335262-6c8e-414f-b484-9b6639eb3dd0 req-e27ea446-3dcf-4da3-bccf-f3e00585bf1f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0528851 Dec 09 22:12:26.629395 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85e02d73-7c55-474a-a16d-5b30fb195208 req-1bc09872-28dd-4df3-9c17-555a1861bde1 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:26.630880 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85e02d73-7c55-474a-a16d-5b30fb195208 req-1bc09872-28dd-4df3-9c17-555a1861bde1 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 944 time: 0.0508523 Dec 09 22:12:26.657813 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['610b4b75-1d84-4d75-824c-9acc7e706b58'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:12:26.681367 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85e02d73-7c55-474a-a16d-5b30fb195208 req-2d0aa22d-09a9-457e-bdee-5e53d4d7054e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418830 Dec 09 22:12:27.226692 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 610b4b75-1d84-4d75-824c-9acc7e706b58 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:12:27.280563 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 610b4b75-1d84-4d75-824c-9acc7e706b58 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:12:27.284827 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 610b4b75-1d84-4d75-824c-9acc7e706b58 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:12:27.285195 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:27.366692 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:27.389819 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7fdff4bc-9748-44a2-952f-49c96d156e5d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '610b4b75-1d84-4d75-824c-9acc7e706b58'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:12:27.392483 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-13ba5f54-3459-46fc-b2f9-3f70fde544e2" -d '{"events": [{"server_uuid": "7fdff4bc-9748-44a2-952f-49c96d156e5d", "name": "network-vif-plugged", "status": "completed", "tag": "610b4b75-1d84-4d75-824c-9acc7e706b58"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:12:27.405504 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 610b4b75-1d84-4d75-824c-9acc7e706b58, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=610b4b75-1d84-4d75-824c-9acc7e706b58,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:12:27.409969 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:27.456960 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=610b4b75-1d84-4d75-824c-9acc7e706b58,revision_number=9']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:12:27.503209 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:12:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9461bbd2-d3a9-4a1f-8bc6-5f6356fa47c2 x-openstack-request-id: req-9461bbd2-d3a9-4a1f-8bc6-5f6356fa47c2 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:12:27.503532 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7fdff4bc-9748-44a2-952f-49c96d156e5d", "name": "network-vif-plugged", "status": "completed", "tag": "610b4b75-1d84-4d75-824c-9acc7e706b58", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:12:27.503833 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-9461bbd2-d3a9-4a1f-8bc6-5f6356fa47c2 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:12:27.504262 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7fdff4bc-9748-44a2-952f-49c96d156e5d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '610b4b75-1d84-4d75-824c-9acc7e706b58', 'code': 200} Dec 09 22:12:27.588739 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:27.737296 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:27.816065 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc73da4e-56dc-4154-b9c6-7463fe0f75ae req-effd626f-4164-4644-9284-3a40c313a76e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:27.817674 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc73da4e-56dc-4154-b9c6-7463fe0f75ae req-effd626f-4164-4644-9284-3a40c313a76e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 945 time: 0.0540137 Dec 09 22:12:27.847622 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24719aa6-f0d6-4829-803d-1ee4936216af req-df03a5ad-2ccc-433b-9172-8f05ea7c8180 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:27.849494 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-24719aa6-f0d6-4829-803d-1ee4936216af req-df03a5ad-2ccc-433b-9172-8f05ea7c8180 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.10 "GET /v2.0/ports?device_id=7fdff4bc-9748-44a2-952f-49c96d156e5d HTTP/1.1" status: 200 len: 945 time: 0.0512521 Dec 09 22:12:27.868548 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc73da4e-56dc-4154-b9c6-7463fe0f75ae req-f61375ec-f1d2-4a31-a7e3-c1ed3fba1e31 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443239 Dec 09 22:12:27.942935 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-24719aa6-f0d6-4829-803d-1ee4936216af req-04ba2e9e-ebad-426b-b678-9c0a40a10f53 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Deleting port 610b4b75-1d84-4d75-824c-9acc7e706b58 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:12:27.943226 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-24719aa6-f0d6-4829-803d-1ee4936216af req-04ba2e9e-ebad-426b-b678-9c0a40a10f53 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:28.031551 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-24719aa6-f0d6-4829-803d-1ee4936216af req-04ba2e9e-ebad-426b-b678-9c0a40a10f53 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] For port 610b4b75-1d84-4d75-824c-9acc7e706b58, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=610b4b75-1d84-4d75-824c-9acc7e706b58,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:12:28.031858 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-24719aa6-f0d6-4829-803d-1ee4936216af req-04ba2e9e-ebad-426b-b678-9c0a40a10f53 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:28.217909 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-24719aa6-f0d6-4829-803d-1ee4936216af req-04ba2e9e-ebad-426b-b678-9c0a40a10f53 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:28.218274 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-24719aa6-f0d6-4829-803d-1ee4936216af req-04ba2e9e-ebad-426b-b678-9c0a40a10f53 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:28.218586 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [req-24719aa6-f0d6-4829-803d-1ee4936216af req-04ba2e9e-ebad-426b-b678-9c0a40a10f53 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Floating IP ded53112-c89a-4a62-a1b4-d803c592f310 disassociated. External IP: 172.25.3.185, port: 610b4b75-1d84-4d75-824c-9acc7e706b58. Dec 09 22:12:28.218928 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-24719aa6-f0d6-4829-803d-1ee4936216af req-04ba2e9e-ebad-426b-b678-9c0a40a10f53 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Calling delete_port for 610b4b75-1d84-4d75-824c-9acc7e706b58 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:12:28.348399 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-24719aa6-f0d6-4829-803d-1ee4936216af req-04ba2e9e-ebad-426b-b678-9c0a40a10f53 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:28.377682 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04ba2e9e-ebad-426b-b678-9c0a40a10f53 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Pushing event deleted for resources: {'Port': ['ID=610b4b75-1d84-4d75-824c-9acc7e706b58,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:12:28.494650 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [req-24719aa6-f0d6-4829-803d-1ee4936216af req-04ba2e9e-ebad-426b-b678-9c0a40a10f53 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:12:28.609069 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-24719aa6-f0d6-4829-803d-1ee4936216af req-04ba2e9e-ebad-426b-b678-9c0a40a10f53 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:12:28.620984 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6713d67-a2c0-4b50-bd52-816b9233c83f None None] Sync routers for ids ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:12:28.631095 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6713d67-a2c0-4b50-bd52-816b9233c83f None None] Routers {'7e861ee9-d29c-4ade-a3ab-cce44cba2c97'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:12:28.631707 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-b6713d67-a2c0-4b50-bd52-816b9233c83f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:12:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:12:28.652624 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-24719aa6-f0d6-4829-803d-1ee4936216af req-04ba2e9e-ebad-426b-b678-9c0a40a10f53 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] No DVR routers for this DVR port 610b4b75-1d84-4d75-824c-9acc7e706b58 on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:12:28.655406 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-24719aa6-f0d6-4829-803d-1ee4936216af req-04ba2e9e-ebad-426b-b678-9c0a40a10f53 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:28.658823 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-24719aa6-f0d6-4829-803d-1ee4936216af req-04ba2e9e-ebad-426b-b678-9c0a40a10f53 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.10 "DELETE /v2.0/ports/610b4b75-1d84-4d75-824c-9acc7e706b58 HTTP/1.1" status: 204 len: 173 time: 0.8031738 Dec 09 22:12:28.659286 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7fdff4bc-9748-44a2-952f-49c96d156e5d', 'name': 'network-vif-deleted', 'tag': '610b4b75-1d84-4d75-824c-9acc7e706b58'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:12:28.661582 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d73ffed4-3cb3-48fa-9e08-b71955cf7c82" -d '{"events": [{"server_uuid": "7fdff4bc-9748-44a2-952f-49c96d156e5d", "name": "network-vif-deleted", "tag": "610b4b75-1d84-4d75-824c-9acc7e706b58"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:12:28.700524 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:12:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-96395812-37dd-457b-b1d7-0567892f62cf x-openstack-request-id: req-96395812-37dd-457b-b1d7-0567892f62cf {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:12:28.700823 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7fdff4bc-9748-44a2-952f-49c96d156e5d", "name": "network-vif-deleted", "tag": "610b4b75-1d84-4d75-824c-9acc7e706b58", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:12:28.701079 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-96395812-37dd-457b-b1d7-0567892f62cf {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:12:28.701484 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7fdff4bc-9748-44a2-952f-49c96d156e5d', 'name': 'network-vif-deleted', 'tag': '610b4b75-1d84-4d75-824c-9acc7e706b58', 'status': 'completed', 'code': 200} Dec 09 22:12:28.740428 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-b6713d67-a2c0-4b50-bd52-816b9233c83f None None] Set router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:12:28.945680 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-b6713d67-a2c0-4b50-bd52-816b9233c83f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:05Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:12:28.971875 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6713d67-a2c0-4b50-bd52-816b9233c83f None None] Checking router: 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:12:28.980602 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6713d67-a2c0-4b50-bd52-816b9233c83f None None] Routers {'7e861ee9-d29c-4ade-a3ab-cce44cba2c97'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:12:28.981227 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-b6713d67-a2c0-4b50-bd52-816b9233c83f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:12:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:12:29.085985 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-b6713d67-a2c0-4b50-bd52-816b9233c83f None None] Set router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:12:29.150015 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-b6eb6602-dc86-4586-86a5-c15a8cfaf262 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-securitygroup--1276791935&fields=id&tenant_id=ecd32dac944041b58de1a396ec18cd2c HTTP/1.1" status: 200 len: 267 time: 0.0444794 Dec 09 22:12:29.261016 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-ae859c9d-0e86-4765-9000-28212edd536d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:29.262550 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-ae859c9d-0e86-4765-9000-28212edd536d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 812 time: 0.1056852 Dec 09 22:12:29.279331 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-03df3c2d-1593-4d20-9dc4-12aebe5abd74 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/quotas/ecd32dac944041b58de1a396ec18cd2c HTTP/1.1" status: 200 len: 375 time: 0.0097122 Dec 09 22:12:29.288186 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-b6713d67-a2c0-4b50-bd52-816b9233c83f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:05Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:12:29.314052 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6713d67-a2c0-4b50-bd52-816b9233c83f None None] The sync data for ids ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'] in n-d-713301-27 is: [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:05Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:12:29.332086 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-0c17c436-625f-44c4-be01-de4a48e3b1ed tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0479820 Dec 09 22:12:29.400507 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-d444f1f1-e07e-4e61-b129-2755ce180e00 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 22:12:29.401499 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-d444f1f1-e07e-4e61-b129-2755ce180e00 service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0572760 Dec 09 22:12:29.499206 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-7f3959f4-ddaa-439f-aee3-fa36ca569bed service neutron] 10.222.0.13 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0910788 Dec 09 22:12:29.529902 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94a4a248-f7b5-4907-a4ea-5fe5cab22f73 None None] New status for floating IP ded53112-c89a-4a62-a1b4-d803c592f310: DOWN {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:12:29.593011 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-dafeda08-91c8-444c-a059-0854eb6b9c68 service neutron] 10.222.0.13 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0875371 Dec 09 22:12:29.756873 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-58f8f046-e81e-4187-af0e-bc9736316b78 req-cf815f8d-396f-47ff-9671-2b8b77e81725 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 210 time: 0.0263910 Dec 09 22:12:30.780084 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-37b5dd14-07bd-4662-bf1d-273c9d6a74d9 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:30.782211 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-37b5dd14-07bd-4662-bf1d-273c9d6a74d9 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.31 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 812 time: 0.1057541 Dec 09 22:12:30.852830 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-7b536c4c-3047-4a5a-9c28-fb5b19c4e3e7 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ecd32dac944041b58de1a396ec18cd2c HTTP/1.1" status: 200 len: 380 time: 0.0618591 Dec 09 22:12:30.857467 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31d770f7-8113-42aa-bdf0-fb2f9315c2f4 req-dcae8f7e-8a55-472b-aaf2-0044af49ec9b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 210 time: 0.0267227 Dec 09 22:12:30.862479 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-f76b8435-9132-49ac-bf20-9c90c672520c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Request body: {'port': {'device_id': 'bd4f065d-f008-4c10-8635-244507bc2821', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'admin_state_up': True, 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'security_groups': ['fc389abb-6202-4d61-870a-d6749ba1a635']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:12:30.973238 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-f76b8435-9132-49ac-bf20-9c90c672520c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Made reservation on behalf of ecd32dac944041b58de1a396ec18cd2c for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:12:30.978072 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-f76b8435-9132-49ac-bf20-9c90c672520c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:31.116878 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-f76b8435-9132-49ac-bf20-9c90c672520c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Allocated IP 172.20.0.4 (91a989ca-03f4-4cf9-a2af-b26f8b1a2bec/88c86202-31f6-4618-8f06-f2283fac961c/e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:12:31.260415 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-f76b8435-9132-49ac-bf20-9c90c672520c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:31.299609 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-f76b8435-9132-49ac-bf20-9c90c672520c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:31.346079 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-f76b8435-9132-49ac-bf20-9c90c672520c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:12:31.349607 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-f76b8435-9132-49ac-bf20-9c90c672520c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:12:31.356461 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-f76b8435-9132-49ac-bf20-9c90c672520c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:12:31.379942 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f76b8435-9132-49ac-bf20-9c90c672520c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Pushing event updated for resources: {'Port': ['ID=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:12:31.413301 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-f76b8435-9132-49ac-bf20-9c90c672520c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:31.413965 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-f76b8435-9132-49ac-bf20-9c90c672520c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:31.432931 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-f76b8435-9132-49ac-bf20-9c90c672520c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5740788 Dec 09 22:12:31.445848 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-e3dee9ee-775e-4c61-aa25-506de7dba506 service neutron] Request body: {'port': {'device_id': 'bd4f065d-f008-4c10-8635-244507bc2821', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:12:31.508064 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-e3dee9ee-775e-4c61-aa25-506de7dba506 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:31.589295 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6670c936-8c9f-40a9-841a-71ab33c572df None None] Provisioning complete for port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:12:31.589909 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6670c936-8c9f-40a9-841a-71ab33c572df None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:31.624402 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-6670c936-8c9f-40a9-841a-71ab33c572df None None] Port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:12:31.779042 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-e3dee9ee-775e-4c61-aa25-506de7dba506 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:12:31.787064 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-e3dee9ee-775e-4c61-aa25-506de7dba506 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:31.801821 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-e3dee9ee-775e-4c61-aa25-506de7dba506 service neutron] Transition to ACTIVE for port object e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:12:31.809616 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-e3dee9ee-775e-4c61-aa25-506de7dba506 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:31.862334 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3dee9ee-775e-4c61-aa25-506de7dba506 service neutron] Pushing event updated for resources: {'Port': ['ID=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:12:31.946292 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-e3dee9ee-775e-4c61-aa25-506de7dba506 service neutron] Attempting to bind port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:12:31.946785 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-e3dee9ee-775e-4c61-aa25-506de7dba506 service neutron] Attempting to bind port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:12:31.947223 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-e3dee9ee-775e-4c61-aa25-506de7dba506 service neutron] Attempting to bind port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:12:31.952435 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-e3dee9ee-775e-4c61-aa25-506de7dba506 service neutron] Port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:12:31.952892 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-e3dee9ee-775e-4c61-aa25-506de7dba506 service neutron] Attempting to bind port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:12:31.958266 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-e3dee9ee-775e-4c61-aa25-506de7dba506 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 12, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:12:31.958757 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-e3dee9ee-775e-4c61-aa25-506de7dba506 service neutron] Checking segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:12:31.959251 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-e3dee9ee-775e-4c61-aa25-506de7dba506 service neutron] Bound using segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:12:31.959820 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-e3dee9ee-775e-4c61-aa25-506de7dba506 service neutron] Bound port: e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:12:31.960290 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-e3dee9ee-775e-4c61-aa25-506de7dba506 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:31.985095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-249c1d17-0ac2-4c43-a613-7e04aace3953 req-bfcbc021-5a6d-4e18-bb7e-18ccf6f5aedd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:31.986638 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-249c1d17-0ac2-4c43-a613-7e04aace3953 req-bfcbc021-5a6d-4e18-bb7e-18ccf6f5aedd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 943 time: 0.0560060 Dec 09 22:12:32.040235 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-249c1d17-0ac2-4c43-a613-7e04aace3953 req-fe61702f-0272-494d-9dc8-854cd43e7f77 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462129 Dec 09 22:12:32.378393 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-e3dee9ee-775e-4c61-aa25-506de7dba506 service neutron] For port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:12:32.383561 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-e3dee9ee-775e-4c61-aa25-506de7dba506 service neutron] For port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:12:32.390824 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-e3dee9ee-775e-4c61-aa25-506de7dba506 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:32.422415 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-e3dee9ee-775e-4c61-aa25-506de7dba506 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:32.423048 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-e3dee9ee-775e-4c61-aa25-506de7dba506 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:32.424484 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-e3dee9ee-775e-4c61-aa25-506de7dba506 service neutron] 10.222.0.31 "PUT /v2.0/ports/e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba HTTP/1.1" status: 200 len: 1092 time: 0.9832456 Dec 09 22:12:32.424967 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bd4f065d-f008-4c10-8635-244507bc2821', 'tag': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:12:32.427214 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-74bce805-2577-4667-b1a9-aa91f095ee3f" -d '{"events": [{"name": "network-changed", "server_uuid": "bd4f065d-f008-4c10-8635-244507bc2821", "tag": "e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:12:32.454674 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3dee9ee-775e-4c61-aa25-506de7dba506 service neutron] Pushing event updated for resources: {'Port': ['ID=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:12:32.478189 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:12:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0fb18f6f-c609-422c-8eeb-303860678dfa x-openstack-request-id: req-0fb18f6f-c609-422c-8eeb-303860678dfa {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:12:32.478480 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bd4f065d-f008-4c10-8635-244507bc2821", "tag": "e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:12:32.478754 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0fb18f6f-c609-422c-8eeb-303860678dfa {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:12:32.479222 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bd4f065d-f008-4c10-8635-244507bc2821', 'tag': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba', 'status': 'completed', 'code': 200} Dec 09 22:12:32.512821 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-49045458-be2a-4aae-930d-3ff3385c64bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:32.514359 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-49045458-be2a-4aae-930d-3ff3385c64bf service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 1095 time: 0.0463638 Dec 09 22:12:32.561114 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-0d764898-20f1-40c4-b74e-ac4256391a85 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba HTTP/1.1" status: 200 len: 217 time: 0.0389485 Dec 09 22:12:32.615389 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-65514f10-38ba-4ff4-88a8-ab37a34b94ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:32.616956 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-65514f10-38ba-4ff4-88a8-ab37a34b94ad service neutron] 10.222.0.31 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0490732 Dec 09 22:12:32.663617 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-31589215-08be-47f0-8958-0c91b443b10e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:32.665284 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-31589215-08be-47f0-8958-0c91b443b10e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0416498 Dec 09 22:12:32.759107 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-0dca3d96-fa86-4be7-9a37-c9e287fc90fe service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0867417 Dec 09 22:12:32.859179 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d57ce873-0b12-4de2-8a7f-0dd5471ea72c req-ce7c1956-3070-4f9c-b512-9757066a8547 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0926566 Dec 09 22:12:32.955347 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74bce805-2577-4667-b1a9-aa91f095ee3f req-bc8efea6-fc71-4ab1-b131-e43d727d13e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:32.956925 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-74bce805-2577-4667-b1a9-aa91f095ee3f req-bc8efea6-fc71-4ab1-b131-e43d727d13e1 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 1095 time: 0.0479653 Dec 09 22:12:33.003600 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ce448fc5-fa47-457d-9b25-0cd3a55c0ebc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:33.050456 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74bce805-2577-4667-b1a9-aa91f095ee3f req-8fe2351b-1c55-490d-bade-ad27ef74ebb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:33.051981 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-74bce805-2577-4667-b1a9-aa91f095ee3f req-8fe2351b-1c55-490d-bade-ad27ef74ebb3 service neutron] 10.222.0.31 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0875473 Dec 09 22:12:33.098712 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-74bce805-2577-4667-b1a9-aa91f095ee3f req-d246a449-8b07-417d-8542-76963d9659b0 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba HTTP/1.1" status: 200 len: 217 time: 0.0387726 Dec 09 22:12:33.151528 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74bce805-2577-4667-b1a9-aa91f095ee3f req-935fba8f-a634-4247-8709-1757e6a33a4c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:33.153047 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-74bce805-2577-4667-b1a9-aa91f095ee3f req-935fba8f-a634-4247-8709-1757e6a33a4c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0459082 Dec 09 22:12:33.162600 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f5a3f49-d66b-4dc7-b46f-907672344e29 req-dd3e4d62-0520-4123-b4b0-b96251a9a3d9 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:33.164242 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2f5a3f49-d66b-4dc7-b46f-907672344e29 req-dd3e4d62-0520-4123-b4b0-b96251a9a3d9 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 943 time: 0.0503230 Dec 09 22:12:33.201059 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74bce805-2577-4667-b1a9-aa91f095ee3f req-3585b2e0-f195-4e84-9c11-091d2ad72845 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:33.202628 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-74bce805-2577-4667-b1a9-aa91f095ee3f req-3585b2e0-f195-4e84-9c11-091d2ad72845 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0423961 Dec 09 22:12:33.212929 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2f5a3f49-d66b-4dc7-b46f-907672344e29 req-4edbbe2a-ab14-4fbe-b8b7-10f970cfdcaf tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424082 Dec 09 22:12:33.300500 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-74bce805-2577-4667-b1a9-aa91f095ee3f req-d28b0b73-aad9-47fa-96bf-4dcdaf349c30 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0887558 Dec 09 22:12:33.305739 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 610b4b75-1d84-4d75-824c-9acc7e706b58 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:12:33.328345 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 610b4b75-1d84-4d75-824c-9acc7e706b58 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:12:33.328690 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 610b4b75-1d84-4d75-824c-9acc7e706b58 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:12:33.389872 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-74bce805-2577-4667-b1a9-aa91f095ee3f req-7b6fa44e-b11d-43e4-9bba-f30f1280d1da service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0814922 Dec 09 22:12:34.356225 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ba45c12-05ab-458b-a5ad-02fa6db87ba1 req-fa60ea85-0336-4f81-bb93-ab44c3f0260a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:34.357742 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ba45c12-05ab-458b-a5ad-02fa6db87ba1 req-fa60ea85-0336-4f81-bb93-ab44c3f0260a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 943 time: 0.0643003 Dec 09 22:12:34.407240 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6ba45c12-05ab-458b-a5ad-02fa6db87ba1 req-a8eb31cf-d226-4f19-974f-d1acbd366637 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430439 Dec 09 22:12:35.374021 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:12:35.474483 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:12:35.486776 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'port_id': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba', 'mac_address': 'fa:16:3e:29:8a:0d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:12:35.524291 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-749a23c5-cf65-4456-9a92-2bfa86d1b4ed req-add8616e-e5b3-4091-80f5-be77306aed11 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:35.525803 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-749a23c5-cf65-4456-9a92-2bfa86d1b4ed req-add8616e-e5b3-4091-80f5-be77306aed11 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 943 time: 0.0484858 Dec 09 22:12:35.527281 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:35.540083 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:12:35.559888 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:12:35.564906 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:35.576028 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-749a23c5-cf65-4456-9a92-2bfa86d1b4ed req-d1fd8c39-9da9-4c55-b4db-2fb4a8ad01df tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440500 Dec 09 22:12:35.613631 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:12:35.662946 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9966b049-7a9c-4a4b-bf8e-aa0ff4f9fe0d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:35.787862 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:12:36.729626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-793f2db9-5c72-4e56-9bca-141f79465a77 req-e7261c66-a80d-44d9-97ce-b88ff05ee3d9 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:36.731050 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-793f2db9-5c72-4e56-9bca-141f79465a77 req-e7261c66-a80d-44d9-97ce-b88ff05ee3d9 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 944 time: 0.0711493 Dec 09 22:12:36.791068 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-793f2db9-5c72-4e56-9bca-141f79465a77 req-f0a63014-29f8-4c0f-acdb-7351f557dc59 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0534790 Dec 09 22:12:36.827081 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:37.388687 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:12:37.439724 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:12:37.444073 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:12:37.444446 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:37.525099 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:37.549042 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bd4f065d-f008-4c10-8635-244507bc2821', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:12:37.551303 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d6691768-9d44-4a5e-a661-46350af2be84" -d '{"events": [{"server_uuid": "bd4f065d-f008-4c10-8635-244507bc2821", "name": "network-vif-plugged", "status": "completed", "tag": "e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:12:37.563683 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:12:37.568686 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:37.594359 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:12:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3d2638ef-a3c1-4493-8776-7d4f4396e39c x-openstack-request-id: req-3d2638ef-a3c1-4493-8776-7d4f4396e39c {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:12:37.595258 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bd4f065d-f008-4c10-8635-244507bc2821", "name": "network-vif-plugged", "status": "completed", "tag": "e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:12:37.595550 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-3d2638ef-a3c1-4493-8776-7d4f4396e39c {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:12:37.595951 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bd4f065d-f008-4c10-8635-244507bc2821', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba', 'code': 200} Dec 09 22:12:37.625403 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:12:37.703271 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91c318dd-45bc-4389-bb81-1e26bb7752d4 req-fb9077f9-4869-43fb-8db7-348b290ef5d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:37.704842 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-91c318dd-45bc-4389-bb81-1e26bb7752d4 req-fb9077f9-4869-43fb-8db7-348b290ef5d5 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 1097 time: 0.0561841 Dec 09 22:12:37.755921 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-91c318dd-45bc-4389-bb81-1e26bb7752d4 req-7012c0f3-aafe-4bb1-9930-b9917175b17d service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438600 Dec 09 22:12:37.915768 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a83bd78-5974-4234-8183-214cfb1f13c7 req-1ba2df41-fc77-438d-87ad-1b60dcb1ca34 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:37.917288 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a83bd78-5974-4234-8183-214cfb1f13c7 req-1ba2df41-fc77-438d-87ad-1b60dcb1ca34 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 945 time: 0.0511179 Dec 09 22:12:37.966061 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a83bd78-5974-4234-8183-214cfb1f13c7 req-7b93f1af-e8ed-4764-b02d-8359ef7b2790 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425038 Dec 09 22:12:38.147777 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:39.095933 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11c63753-0071-43a6-88a4-21fa525ff61b req-4c9878a3-6d8d-40c8-a28c-221c8226fb40 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:39.097348 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11c63753-0071-43a6-88a4-21fa525ff61b req-4c9878a3-6d8d-40c8-a28c-221c8226fb40 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 945 time: 0.0535147 Dec 09 22:12:39.145609 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11c63753-0071-43a6-88a4-21fa525ff61b req-4c2d42ad-bacc-4b3e-80e2-7edd62172d0c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418274 Dec 09 22:12:39.264566 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b7e9edb-a9ad-4cb3-b6a8-eb9f8eaed611 req-d63e24a1-2be3-4b88-83c4-1888dc1305f4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:39.266098 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b7e9edb-a9ad-4cb3-b6a8-eb9f8eaed611 req-d63e24a1-2be3-4b88-83c4-1888dc1305f4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 945 time: 0.0560441 Dec 09 22:12:39.274992 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60038) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:12:39.279726 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-9ec05021-0a50-4434-8b1a-f6ec5d559248 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Request body: {'floatingip': {'port_id': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:12:39.319857 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9ec05021-0a50-4434-8b1a-f6ec5d559248 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for floatingip, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:39.664972 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:39.773235 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9ec05021-0a50-4434-8b1a-f6ec5d559248 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:39.779551 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9ec05021-0a50-4434-8b1a-f6ec5d559248 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:39.881835 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-9ec05021-0a50-4434-8b1a-f6ec5d559248 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Floating IP ded53112-c89a-4a62-a1b4-d803c592f310 associated. External IP: 172.25.3.185, port: e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba. Dec 09 22:12:40.091960 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9ec05021-0a50-4434-8b1a-f6ec5d559248 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:12:40.202058 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9ec05021-0a50-4434-8b1a-f6ec5d559248 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:12:40.207066 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9ec05021-0a50-4434-8b1a-f6ec5d559248 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:40.214397 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac5eb70a-44d7-45f6-b580-b512e377ab79 None None] Sync routers for ids ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:12:40.225473 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac5eb70a-44d7-45f6-b580-b512e377ab79 None None] Routers {'7e861ee9-d29c-4ade-a3ab-cce44cba2c97'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:12:40.226090 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-ac5eb70a-44d7-45f6-b580-b512e377ab79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:12:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:12:40.235588 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9ec05021-0a50-4434-8b1a-f6ec5d559248 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "PUT /v2.0/floatingips/ded53112-c89a-4a62-a1b4-d803c592f310 HTTP/1.1" status: 200 len: 991 time: 0.9594450 Dec 09 22:12:40.236172 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bd4f065d-f008-4c10-8635-244507bc2821', 'tag': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:12:40.238419 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0f8b3233-8443-4e6a-b84d-7cfab11e0f36" -d '{"events": [{"name": "network-changed", "server_uuid": "bd4f065d-f008-4c10-8635-244507bc2821", "tag": "e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:12:40.343270 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-ac5eb70a-44d7-45f6-b580-b512e377ab79 None None] Set router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:12:40.410763 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:12:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bcd62023-35ca-4a22-b2b7-f14fdcedc358 x-openstack-request-id: req-bcd62023-35ca-4a22-b2b7-f14fdcedc358 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:12:40.411175 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bd4f065d-f008-4c10-8635-244507bc2821", "tag": "e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:12:40.411568 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-bcd62023-35ca-4a22-b2b7-f14fdcedc358 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:12:40.412097 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bd4f065d-f008-4c10-8635-244507bc2821', 'tag': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba', 'status': 'completed', 'code': 200} Dec 09 22:12:40.476437 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f8b3233-8443-4e6a-b84d-7cfab11e0f36 req-3ba4afa8-e706-4e14-b725-b06f78ce8430 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:40.477989 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0f8b3233-8443-4e6a-b84d-7cfab11e0f36 req-3ba4afa8-e706-4e14-b725-b06f78ce8430 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 1097 time: 0.0436873 Dec 09 22:12:40.574669 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f8b3233-8443-4e6a-b84d-7cfab11e0f36 req-544d7f44-a790-4f18-bf22-bc376c4c2917 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:40.576245 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0f8b3233-8443-4e6a-b84d-7cfab11e0f36 req-544d7f44-a790-4f18-bf22-bc376c4c2917 service neutron] 10.222.0.31 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0905924 Dec 09 22:12:40.647795 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0f8b3233-8443-4e6a-b84d-7cfab11e0f36 req-185df579-46b2-487f-9e8a-af6ef4e0099b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba HTTP/1.1" status: 200 len: 999 time: 0.0644107 Dec 09 22:12:40.672473 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-ac5eb70a-44d7-45f6-b580-b512e377ab79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'ded53112-c89a-4a62-a1b4-d803c592f310', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'floating_ip_address': '172.25.3.185', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'port_id': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 4083, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'mac_address': 'fa:16:3e:29:8a:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd4f065d-f008-4c10-8635-244507bc2821', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:08:04Z', 'updated_at': '2021-12-09T22:12:39Z', 'revision_number': 9, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:05Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:12:40.698202 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f8b3233-8443-4e6a-b84d-7cfab11e0f36 req-0b86edd9-751a-4e66-bc5d-7d417053de11 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:40.699717 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0f8b3233-8443-4e6a-b84d-7cfab11e0f36 req-0b86edd9-751a-4e66-bc5d-7d417053de11 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0448565 Dec 09 22:12:40.700665 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac5eb70a-44d7-45f6-b580-b512e377ab79 None None] Checking router: 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:12:40.710085 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ac5eb70a-44d7-45f6-b580-b512e377ab79 None None] Routers {'7e861ee9-d29c-4ade-a3ab-cce44cba2c97'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:12:40.710707 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-ac5eb70a-44d7-45f6-b580-b512e377ab79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:12:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:12:40.751723 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f8b3233-8443-4e6a-b84d-7cfab11e0f36 req-cd6aa073-3d68-4712-9476-de0ab0edd6ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:12:40.753313 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0f8b3233-8443-4e6a-b84d-7cfab11e0f36 req-cd6aa073-3d68-4712-9476-de0ab0edd6ae service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0469887 Dec 09 22:12:40.820655 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-ac5eb70a-44d7-45f6-b580-b512e377ab79 None None] Set router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:12:40.852227 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0f8b3233-8443-4e6a-b84d-7cfab11e0f36 req-20646632-1e21-4999-a765-343b9ae46674 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0913365 Dec 09 22:12:40.947882 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0f8b3233-8443-4e6a-b84d-7cfab11e0f36 req-feffd6cf-e887-4339-93d4-39636ed13a10 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0885599 Dec 09 22:12:41.047905 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-ac5eb70a-44d7-45f6-b580-b512e377ab79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'ded53112-c89a-4a62-a1b4-d803c592f310', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'floating_ip_address': '172.25.3.185', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'port_id': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 4083, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'mac_address': 'fa:16:3e:29:8a:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd4f065d-f008-4c10-8635-244507bc2821', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:08:04Z', 'updated_at': '2021-12-09T22:12:39Z', 'revision_number': 9, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:05Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:12:41.075412 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ac5eb70a-44d7-45f6-b580-b512e377ab79 None None] The sync data for ids ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'] in n-d-713301-27 is: [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'ded53112-c89a-4a62-a1b4-d803c592f310', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'floating_ip_address': '172.25.3.185', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'port_id': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 4083, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'mac_address': 'fa:16:3e:29:8a:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bd4f065d-f008-4c10-8635-244507bc2821', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:08:04Z', 'updated_at': '2021-12-09T22:12:39Z', 'revision_number': 9, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:05Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:12:41.288458 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f47b9271-6af7-4c5b-86fd-381c09d45c62 None None] New status for floating IP ded53112-c89a-4a62-a1b4-d803c592f310: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:12:44.233948 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:12:57.594123 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:12:57.734547 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:13:03.008644 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cd02158c-844d-4302-ab2f-e5bc23df6f4e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:13:04.676685 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4aaa8cec-4e04-44b4-9e6e-696b7de71716 req-245fd2ca-34ce-44d5-a42d-612533056977 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0425980 Dec 09 22:13:04.764146 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aaa8cec-4e04-44b4-9e6e-696b7de71716 req-fc5fff24-86c7-4062-9f57-f11ad94906d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:13:04.765647 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4aaa8cec-4e04-44b4-9e6e-696b7de71716 req-fc5fff24-86c7-4062-9f57-f11ad94906d6 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 1097 time: 0.0442526 Dec 09 22:13:04.877427 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aaa8cec-4e04-44b4-9e6e-696b7de71716 req-00d87756-c284-4c2d-9493-cfbe3e7cb468 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:13:04.878930 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4aaa8cec-4e04-44b4-9e6e-696b7de71716 req-00d87756-c284-4c2d-9493-cfbe3e7cb468 service neutron] 10.222.0.31 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0930905 Dec 09 22:13:04.948075 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4aaa8cec-4e04-44b4-9e6e-696b7de71716 req-c6144ee0-507b-4277-a161-40ac1432d2ff service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba HTTP/1.1" status: 200 len: 1002 time: 0.0606070 Dec 09 22:13:05.004542 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aaa8cec-4e04-44b4-9e6e-696b7de71716 req-c572e1a0-b32d-4a42-a3a7-e8eeaecf3459 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:13:05.006172 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4aaa8cec-4e04-44b4-9e6e-696b7de71716 req-c572e1a0-b32d-4a42-a3a7-e8eeaecf3459 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0514514 Dec 09 22:13:05.055031 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aaa8cec-4e04-44b4-9e6e-696b7de71716 req-888d33ca-2253-4a12-b3da-ea22c52dc2f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:13:05.056563 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4aaa8cec-4e04-44b4-9e6e-696b7de71716 req-888d33ca-2253-4a12-b3da-ea22c52dc2f5 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0414495 Dec 09 22:13:05.155041 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4aaa8cec-4e04-44b4-9e6e-696b7de71716 req-969ce132-d91a-4910-8460-b560ed78a398 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0909586 Dec 09 22:13:05.269893 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4aaa8cec-4e04-44b4-9e6e-696b7de71716 req-240a2de9-8470-4578-b419-62049d310ec5 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1068118 Dec 09 22:13:05.663128 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5fb8fd52-a12a-462e-88d8-bd8977ed03bb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:13:06.809943 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:13:08.145073 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:13:09.678509 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:13:21.236283 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:13:27.587102 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:13:27.731199 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:13:33.018647 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-44fea9e3-284f-4afc-9e90-6077a2ff3c11 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:13:35.665103 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a339b89b-0baf-4add-a233-991f10131d29 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:13:36.819132 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:13:38.157991 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:13:39.682884 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:13:57.582286 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:13:57.738670 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:13:58.242660 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:14:03.014364 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3d5594eb-5019-43bb-8e3c-1808335175a1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:05.240460 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a823f99c-3567-4216-9587-d5f004a48a9d req-8ecf4e4a-c7b4-4932-a59a-80dd0fdec985 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0481949 Dec 09 22:14:05.324395 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a823f99c-3567-4216-9587-d5f004a48a9d req-cc267111-6c35-4085-950b-f9f6e7b09ba4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:05.325942 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a823f99c-3567-4216-9587-d5f004a48a9d req-cc267111-6c35-4085-950b-f9f6e7b09ba4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 1097 time: 0.0431316 Dec 09 22:14:05.434820 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a823f99c-3567-4216-9587-d5f004a48a9d req-df1643e7-f17b-4a2c-b800-ca33462c3028 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:05.436371 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a823f99c-3567-4216-9587-d5f004a48a9d req-df1643e7-f17b-4a2c-b800-ca33462c3028 service neutron] 10.222.0.31 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0903144 Dec 09 22:14:05.504406 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a823f99c-3567-4216-9587-d5f004a48a9d req-0a2af051-176a-4be7-b548-a97ef711d495 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba HTTP/1.1" status: 200 len: 1002 time: 0.0598240 Dec 09 22:14:05.567774 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a823f99c-3567-4216-9587-d5f004a48a9d req-6d187b14-2fa6-403e-b739-de47cfe7fff0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:05.570196 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a823f99c-3567-4216-9587-d5f004a48a9d req-6d187b14-2fa6-403e-b739-de47cfe7fff0 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0585687 Dec 09 22:14:05.625943 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a823f99c-3567-4216-9587-d5f004a48a9d req-86b8a02d-d769-429c-b084-895bd926c9ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:05.627477 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a823f99c-3567-4216-9587-d5f004a48a9d req-86b8a02d-d769-429c-b084-895bd926c9ca service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0498233 Dec 09 22:14:05.660728 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aa0b2279-daf7-41f8-8963-a66e4695e7b5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:05.726202 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a823f99c-3567-4216-9587-d5f004a48a9d req-a6eee9eb-cae9-4a06-970d-b16da5df25f5 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0905423 Dec 09 22:14:05.831930 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a823f99c-3567-4216-9587-d5f004a48a9d req-922ba8a8-1519-4d85-8d1a-13fc45e58a7b service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0989170 Dec 09 22:14:06.819783 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:08.152365 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:09.682019 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:17.141734 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-45192aa8-d29d-4969-984e-2a7108230429 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0567513 Dec 09 22:14:17.228446 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d1d93d0-3d19-400c-a0d4-f547143f6631 req-fa5026e6-5faa-45f8-9c66-3e5de2b7e0fa tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:17.229961 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3d1d93d0-3d19-400c-a0d4-f547143f6631 req-fa5026e6-5faa-45f8-9c66-3e5de2b7e0fa tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 945 time: 0.1358032 Dec 09 22:14:17.283201 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3d1d93d0-3d19-400c-a0d4-f547143f6631 req-d9744ed6-cc5f-47aa-9daf-c7dcedc93a98 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469689 Dec 09 22:14:18.263537 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-70ffc357-9c81-4325-922c-b58c775b6c09 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:18.265072 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-70ffc357-9c81-4325-922c-b58c775b6c09 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 1097 time: 0.0442059 Dec 09 22:14:18.363592 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-023a71ff-4767-4a9b-a745-abcc141ebb06 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:18.365472 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-023a71ff-4767-4a9b-a745-abcc141ebb06 service neutron] 10.222.0.31 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0922093 Dec 09 22:14:18.405407 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eebb420-bbdf-42ae-ab30-11158f41c41d req-01c1ac82-5467-4e7b-8dd7-f0a6a3995412 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:18.406927 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2eebb420-bbdf-42ae-ab30-11158f41c41d req-01c1ac82-5467-4e7b-8dd7-f0a6a3995412 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 945 time: 0.0498879 Dec 09 22:14:18.433306 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-5ea12bf5-5230-4068-b4a7-3088cd130ae1 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba HTTP/1.1" status: 200 len: 1002 time: 0.0608418 Dec 09 22:14:18.453885 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2eebb420-bbdf-42ae-ab30-11158f41c41d req-59e18d74-0aca-41f4-ba24-2e3c52952f7a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406339 Dec 09 22:14:18.493309 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-35b94e4c-9eea-4b61-a1e9-369c209e1313 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:18.495490 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-35b94e4c-9eea-4b61-a1e9-369c209e1313 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0553205 Dec 09 22:14:18.545772 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-05002e0f-06ff-47b9-8e70-af63d487579b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:18.547184 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-05002e0f-06ff-47b9-8e70-af63d487579b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0443525 Dec 09 22:14:18.645967 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-81c341f8-b7f2-4b7f-af6b-f17fd21e9b9a service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0907090 Dec 09 22:14:18.742302 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-a1afda3d-ca9d-4c35-bd8d-a45b4c62502a service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0902364 Dec 09 22:14:19.578645 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-525b4958-ef77-4aaf-8cde-b938df61260e req-a9cbb49b-02d5-4c9f-be5e-7dc547ecb319 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:19.580139 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-525b4958-ef77-4aaf-8cde-b938df61260e req-a9cbb49b-02d5-4c9f-be5e-7dc547ecb319 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 945 time: 0.0506613 Dec 09 22:14:19.628622 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-525b4958-ef77-4aaf-8cde-b938df61260e req-00597892-1f57-46f6-9b84-762806a8b6d5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416164 Dec 09 22:14:20.777362 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e93138ef-a3ea-4908-8a4a-6299e4d9de8e req-9f305ebc-ff14-4708-b9dc-d41953d69eb0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:20.778828 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e93138ef-a3ea-4908-8a4a-6299e4d9de8e req-9f305ebc-ff14-4708-b9dc-d41953d69eb0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 945 time: 0.0613146 Dec 09 22:14:20.828719 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e93138ef-a3ea-4908-8a4a-6299e4d9de8e req-ed24592e-bd25-4e71-9fc3-0d97e61fb93c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437832 Dec 09 22:14:21.954121 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5064fc9-3eaf-40c4-839a-e1f55d4991ba req-f6d1e9ea-df5b-4e1d-a152-213a9d6465c1 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:21.955643 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b5064fc9-3eaf-40c4-839a-e1f55d4991ba req-f6d1e9ea-df5b-4e1d-a152-213a9d6465c1 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 945 time: 0.0513434 Dec 09 22:14:22.004083 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b5064fc9-3eaf-40c4-839a-e1f55d4991ba req-7da2a5c1-21d3-4fde-a277-d6a04ba7581f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421705 Dec 09 22:14:23.125503 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29dc60b8-e055-4fda-890b-3708f828a993 req-e6375ebd-b205-4593-b9ca-20fa6e73742d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:23.126886 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-29dc60b8-e055-4fda-890b-3708f828a993 req-e6375ebd-b205-4593-b9ca-20fa6e73742d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 945 time: 0.0509253 Dec 09 22:14:23.189279 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-29dc60b8-e055-4fda-890b-3708f828a993 req-be9a5c5e-47e8-4927-8a0a-3cc9966cf477 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0546148 Dec 09 22:14:24.318499 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69f060a1-4412-4452-a4b1-386ab6df6426 req-8a2ea6c3-b376-4868-a01e-61a39b6dd6ec tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:24.320018 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69f060a1-4412-4452-a4b1-386ab6df6426 req-8a2ea6c3-b376-4868-a01e-61a39b6dd6ec tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 945 time: 0.0513246 Dec 09 22:14:24.367598 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69f060a1-4412-4452-a4b1-386ab6df6426 req-7e96bd70-1093-4b44-961a-c45e578e0770 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415070 Dec 09 22:14:25.500780 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27fb3a1c-2dc8-4f09-bd58-6a23fbc03e04 req-11511bd3-3a27-4f76-b99f-f7b0acc94994 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:25.502263 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27fb3a1c-2dc8-4f09-bd58-6a23fbc03e04 req-11511bd3-3a27-4f76-b99f-f7b0acc94994 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 945 time: 0.0557642 Dec 09 22:14:25.548984 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27fb3a1c-2dc8-4f09-bd58-6a23fbc03e04 req-38e3e028-bb37-471e-b7ba-363cafbd6def tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404923 Dec 09 22:14:26.682498 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc64c082-65ea-42da-8caa-cef7b92eedf2 req-4d33436f-c934-4f00-a3c4-94451d132672 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:26.683979 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc64c082-65ea-42da-8caa-cef7b92eedf2 req-4d33436f-c934-4f00-a3c4-94451d132672 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 945 time: 0.0543363 Dec 09 22:14:26.733945 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc64c082-65ea-42da-8caa-cef7b92eedf2 req-b4e9ffe4-55a1-42e8-95d4-ef80882a2e10 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411267 Dec 09 22:14:27.600648 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:27.726226 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:27.862968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb9634c7-73f9-43c0-8beb-c93adab901fb req-53d2a9fc-ceef-40e9-9f62-ea56a69874b1 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:27.864506 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb9634c7-73f9-43c0-8beb-c93adab901fb req-53d2a9fc-ceef-40e9-9f62-ea56a69874b1 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 945 time: 0.0513220 Dec 09 22:14:27.915490 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb9634c7-73f9-43c0-8beb-c93adab901fb req-2159de3b-7e73-42e0-aa45-d0ebf9a1dcf9 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427933 Dec 09 22:14:29.060915 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-133e4e0c-de1a-46f4-84ba-685b1486c5b9 req-4c4a576f-153a-4e7f-a9ee-95d2a94650f4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:29.062393 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-133e4e0c-de1a-46f4-84ba-685b1486c5b9 req-4c4a576f-153a-4e7f-a9ee-95d2a94650f4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 945 time: 0.0595131 Dec 09 22:14:29.121058 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-133e4e0c-de1a-46f4-84ba-685b1486c5b9 req-02853244-3eec-43c7-867a-0219b4842fd0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0521121 Dec 09 22:14:30.252292 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a79489-e6c4-409e-889c-e5de79a20d18 req-6f32f635-6af6-4ab2-ad73-20003ea82c80 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:30.253787 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99a79489-e6c4-409e-889c-e5de79a20d18 req-6f32f635-6af6-4ab2-ad73-20003ea82c80 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 945 time: 0.0507517 Dec 09 22:14:30.306972 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-99a79489-e6c4-409e-889c-e5de79a20d18 req-d06cf2e2-63db-4686-8b4e-caa2cb1196ce tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445771 Dec 09 22:14:30.537366 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-a2a0e586-2fcf-4730-ad09-e7cce4730261 service neutron] show failed (client error): The resource could not be found. Dec 09 22:14:30.538288 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-a2a0e586-2fcf-4730-ad09-e7cce4730261 service neutron] 10.222.0.31 "GET /v2.0/ports/e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba/bindings/n-h2-713301-27 HTTP/1.1" status: 404 len: 381 time: 0.0603957 Dec 09 22:14:30.757129 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-723ee054-2b9e-4a05-8841-cb4b3b356f5c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:30.758735 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-723ee054-2b9e-4a05-8841-cb4b3b356f5c service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821&tenant_id=ecd32dac944041b58de1a396ec18cd2c HTTP/1.1" status: 200 len: 1097 time: 0.0467863 Dec 09 22:14:30.771324 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Request body: {'port': {'binding:host_id': 'n-h2-713301-27', 'device_owner': 'compute:nova'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:14:30.831794 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:31.046211 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] For port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:14:31.081331 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] For port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:14:31.125494 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bd4f065d-f008-4c10-8635-244507bc2821', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:14:31.127829 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1618f4ce-b69c-4c4e-ad30-15ebd41bd876" -d '{"events": [{"server_uuid": "bd4f065d-f008-4c10-8635-244507bc2821", "name": "network-vif-unplugged", "status": "completed", "tag": "e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:14:31.131832 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:31.144244 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Transition to ACTIVE for port object e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:14:31.148467 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:31.184342 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 22:14:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-617b3b7f-b76f-4fff-bd05-63e2f1b6fff8 x-openstack-request-id: req-617b3b7f-b76f-4fff-bd05-63e2f1b6fff8 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:14:31.184470 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bd4f065d-f008-4c10-8635-244507bc2821", "name": "network-vif-unplugged", "status": "completed", "tag": "e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:14:31.184673 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-617b3b7f-b76f-4fff-bd05-63e2f1b6fff8 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:14:31.185101 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bd4f065d-f008-4c10-8635-244507bc2821', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba', 'code': 200} Dec 09 22:14:31.234948 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Pushing event updated for resources: {'Port': ['ID=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,revision_number=6']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:14:31.249386 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:31.249748 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:31.250088 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:31.250440 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:31.250780 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:31.251114 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:31.251460 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:31.251917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:31.252121 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:31.252449 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:31.252783 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:31.253108 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:31.253434 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:31.284996 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] No DVR routers for this DVR port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:14:31.420591 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Attempting to bind port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:14:31.420929 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Attempting to bind port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:14:31.421261 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Attempting to bind port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:14:31.425643 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:14:31.425967 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Attempting to bind port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:14:31.428079 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf5d9bca-732e-4010-ad2c-c0d76968cbab req-65cec0a7-ba08-477e-bf87-8b120ab00e33 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:31.429714 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf5d9bca-732e-4010-ad2c-c0d76968cbab req-65cec0a7-ba08-477e-bf87-8b120ab00e33 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 943 time: 0.0509307 Dec 09 22:14:31.431284 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 14, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:14:31.431654 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Checking segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:14:31.432037 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Bound using segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:14:31.432460 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Bound port: e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:14:31.432821 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:31.481155 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf5d9bca-732e-4010-ad2c-c0d76968cbab req-353be813-edd1-4ca2-9d4f-abf8a3717832 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453928 Dec 09 22:14:31.494446 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] For port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:14:31.497544 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] For port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:14:31.503591 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:31.555559 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:31.556209 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:31.557693 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] 10.222.0.10 "PUT /v2.0/ports/e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba HTTP/1.1" status: 200 len: 1092 time: 0.7903273 Dec 09 22:14:31.561125 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4ce71e5-5dff-4bd7-96ab-9e754b12b0d3 service neutron] Pushing event updated for resources: {'Port': ['ID=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,revision_number=7']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:14:31.632564 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-0352cdd7-3481-4c42-b6ae-73b6b4652bca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:31.634155 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-0352cdd7-3481-4c42-b6ae-73b6b4652bca service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 1095 time: 0.0466499 Dec 09 22:14:31.730036 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-23c51da2-a212-4be7-8d7b-cb545cf0adfc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:31.731601 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-23c51da2-a212-4be7-8d7b-cb545cf0adfc service neutron] 10.222.0.10 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0889769 Dec 09 22:14:31.803359 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-36822939-3d8b-41a2-bdf0-77d790206149 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba HTTP/1.1" status: 200 len: 1000 time: 0.0643840 Dec 09 22:14:31.855220 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-e20487b0-a873-4081-8a56-c782bbe1fba9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:31.856654 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-e20487b0-a873-4081-8a56-c782bbe1fba9 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0450227 Dec 09 22:14:31.902446 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-0ad929e3-26f2-45d8-938b-be4ddd130bfd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:31.903972 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-0ad929e3-26f2-45d8-938b-be4ddd130bfd service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0403039 Dec 09 22:14:31.997055 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-42fc5601-2a4b-4e0d-abe0-89511beb02bd service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0859659 Dec 09 22:14:32.087585 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d10552c9-f1ed-44a2-b680-60528659bb3f req-cd2088b4-51b9-4531-896b-7b9c3904893a service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829861 Dec 09 22:14:32.604087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a91ed938-d397-4eeb-b604-980d538cae50 req-6e873089-ed7a-49dc-b34c-9b543f28d046 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:32.605577 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a91ed938-d397-4eeb-b604-980d538cae50 req-6e873089-ed7a-49dc-b34c-9b543f28d046 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 943 time: 0.0528336 Dec 09 22:14:32.653621 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a91ed938-d397-4eeb-b604-980d538cae50 req-e17178f3-a501-4f49-a8af-c534254f6456 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419757 Dec 09 22:14:33.028166 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-67ee0ac4-9140-42d2-879a-8c4eb5fb4f22 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:33.186910 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bd4f065d-f008-4c10-8635-244507bc2821', 'tag': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:14:33.190849 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1ce1a4e2-a92a-4d87-b46b-b71363490f9a" -d '{"events": [{"name": "network-changed", "server_uuid": "bd4f065d-f008-4c10-8635-244507bc2821", "tag": "e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:14:33.240886 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:14:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7bd4ac11-29b9-4cea-a4e0-c1a085f29cab x-openstack-request-id: req-7bd4ac11-29b9-4cea-a4e0-c1a085f29cab {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:14:33.241180 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bd4f065d-f008-4c10-8635-244507bc2821", "tag": "e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:14:33.241442 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-7bd4ac11-29b9-4cea-a4e0-c1a085f29cab {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:14:33.241855 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bd4f065d-f008-4c10-8635-244507bc2821', 'tag': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba', 'status': 'completed', 'code': 200} Dec 09 22:14:33.345383 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ce1a4e2-a92a-4d87-b46b-b71363490f9a req-b276bdf0-f149-4714-99a9-6138ca23dd2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:33.346909 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ce1a4e2-a92a-4d87-b46b-b71363490f9a req-b276bdf0-f149-4714-99a9-6138ca23dd2a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 1095 time: 0.0849037 Dec 09 22:14:33.352769 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ce1a4e2-a92a-4d87-b46b-b71363490f9a req-40e8b253-f83b-4fb9-8b1d-f3bf675c4d1a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:33.354219 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ce1a4e2-a92a-4d87-b46b-b71363490f9a req-40e8b253-f83b-4fb9-8b1d-f3bf675c4d1a service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 1095 time: 0.0797045 Dec 09 22:14:33.506555 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ce1a4e2-a92a-4d87-b46b-b71363490f9a req-184efaa4-75bc-4ccd-91b7-fb244decb5bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:33.508001 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ce1a4e2-a92a-4d87-b46b-b71363490f9a req-184efaa4-75bc-4ccd-91b7-fb244decb5bb service neutron] 10.222.0.31 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.1529181 Dec 09 22:14:33.510640 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ce1a4e2-a92a-4d87-b46b-b71363490f9a req-644792f8-fcc0-4f7e-a7c8-ee5cd69256bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:33.511991 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ce1a4e2-a92a-4d87-b46b-b71363490f9a req-644792f8-fcc0-4f7e-a7c8-ee5cd69256bb service neutron] 10.222.0.10 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.1498148 Dec 09 22:14:33.628514 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ce1a4e2-a92a-4d87-b46b-b71363490f9a req-b6124363-2615-4866-82a4-7f5a3a51f659 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba HTTP/1.1" status: 200 len: 1000 time: 0.1134603 Dec 09 22:14:33.630929 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ce1a4e2-a92a-4d87-b46b-b71363490f9a req-11e128c9-452d-4e72-b9fc-326877c718ea service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba HTTP/1.1" status: 200 len: 1000 time: 0.1084330 Dec 09 22:14:33.715580 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ce1a4e2-a92a-4d87-b46b-b71363490f9a req-3f838598-8102-4230-ad5d-201446776277 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:33.717082 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ce1a4e2-a92a-4d87-b46b-b71363490f9a req-3f838598-8102-4230-ad5d-201446776277 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0811915 Dec 09 22:14:33.718479 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ce1a4e2-a92a-4d87-b46b-b71363490f9a req-9440c8ab-1954-4ac1-ac94-3349cb0800ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:33.720192 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ce1a4e2-a92a-4d87-b46b-b71363490f9a req-9440c8ab-1954-4ac1-ac94-3349cb0800ef service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0767026 Dec 09 22:14:33.782716 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bd42513-24c0-4d4a-b34d-35ff4911811c req-cf806ce3-17d3-4050-88ba-c32ccd60ecb4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:33.784515 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8bd42513-24c0-4d4a-b34d-35ff4911811c req-cf806ce3-17d3-4050-88ba-c32ccd60ecb4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 943 time: 0.0498908 Dec 09 22:14:33.788317 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ce1a4e2-a92a-4d87-b46b-b71363490f9a req-25aa3f52-e27f-46c4-a183-ea9b8312a0c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:33.789835 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ce1a4e2-a92a-4d87-b46b-b71363490f9a req-25aa3f52-e27f-46c4-a183-ea9b8312a0c4 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0657341 Dec 09 22:14:33.796657 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ce1a4e2-a92a-4d87-b46b-b71363490f9a req-67c9f0c8-c5be-4ac3-8cf5-2d8b99e0f549 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:33.798129 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ce1a4e2-a92a-4d87-b46b-b71363490f9a req-67c9f0c8-c5be-4ac3-8cf5-2d8b99e0f549 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0664792 Dec 09 22:14:33.836127 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8bd42513-24c0-4d4a-b34d-35ff4911811c req-871dc62b-e19b-44d1-add2-f90af70b4ab1 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448558 Dec 09 22:14:33.866047 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:14:33.907972 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:14:33.952457 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ce1a4e2-a92a-4d87-b46b-b71363490f9a req-ce16aca9-d6c7-4b7e-b490-e137e9e013a0 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1533644 Dec 09 22:14:33.957605 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ce1a4e2-a92a-4d87-b46b-b71363490f9a req-2c9ea010-5edc-45ef-b416-af2723ff18d1 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1507180 Dec 09 22:14:34.120460 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ce1a4e2-a92a-4d87-b46b-b71363490f9a req-9b34c1fe-c4a7-4371-8e1e-00390ffeadd1 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1604085 Dec 09 22:14:34.122672 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1ce1a4e2-a92a-4d87-b46b-b71363490f9a req-cfc3fba3-6a92-4375-a630-c5d6b4e4a589 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1556833 Dec 09 22:14:34.169757 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-61596f17-1439-416a-bd83-bd3acf4a5be7 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:34.171242 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-61596f17-1439-416a-bd83-bd3acf4a5be7 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.10 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821&tenant_id=ecd32dac944041b58de1a396ec18cd2c&binding%3Ahost_id=n-h2-713301-27 HTTP/1.1" status: 200 len: 943 time: 0.0892158 Dec 09 22:14:34.192313 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8efcb404-a71d-45a8-9b2e-517f5437a58e req-b9d38998-c986-437e-98f9-efdda0053562 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:34.193750 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8efcb404-a71d-45a8-9b2e-517f5437a58e req-b9d38998-c986-437e-98f9-efdda0053562 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 943 time: 0.0753038 Dec 09 22:14:34.278176 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-707d0438-2bea-4967-af2f-68c0020e026c service neutron] 10.222.0.10 "GET /v2.0/ports/e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba/bindings/n-h2-713301-27 HTTP/1.1" status: 200 len: 383 time: 0.0983503 Dec 09 22:14:34.282783 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8efcb404-a71d-45a8-9b2e-517f5437a58e req-38d76e6a-f7bd-407a-8469-d63ff3f6048b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0691504 Dec 09 22:14:34.345690 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-7450015c-a405-4348-acd8-693906565101 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:34.347181 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-7450015c-a405-4348-acd8-693906565101 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 1095 time: 0.0451660 Dec 09 22:14:34.438295 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-18410482-9216-488b-8193-331c4eb625f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:34.439811 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-18410482-9216-488b-8193-331c4eb625f1 service neutron] 10.222.0.10 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0856268 Dec 09 22:14:34.510208 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-3958cc38-ba5f-491b-90d2-826e28486cb2 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba HTTP/1.1" status: 200 len: 1000 time: 0.0636377 Dec 09 22:14:34.559889 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b68a6b82-821d-40c4-b30a-a22e6cddb819 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:34.561305 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b68a6b82-821d-40c4-b30a-a22e6cddb819 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0430551 Dec 09 22:14:34.607229 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-455fe225-2b97-428d-8672-076e5b11700b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:34.608820 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-455fe225-2b97-428d-8672-076e5b11700b service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0403457 Dec 09 22:14:34.699751 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-8f78cd29-be66-4770-96b0-b768dcf46296 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837417 Dec 09 22:14:34.789441 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-83fba9dc-5587-40a4-85ca-346dd9fb8b17 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0828383 Dec 09 22:14:35.248674 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:14:35.424295 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74f26382-2da8-4be7-9b6f-7b424d27a6df req-d3a7ec0c-7769-4558-9c61-ff00eb33f8c4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:35.426379 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-74f26382-2da8-4be7-9b6f-7b424d27a6df req-d3a7ec0c-7769-4558-9c61-ff00eb33f8c4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 943 time: 0.0617940 Dec 09 22:14:35.482256 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-74f26382-2da8-4be7-9b6f-7b424d27a6df req-e380b345-6b6e-4cc1-9951-b37022ea964a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461781 Dec 09 22:14:35.664891 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-026248be-3d2e-4d88-ab75-85d887fd0877 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:35.880182 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:14:35.983151 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:14:35.998268 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'port_id': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba', 'mac_address': 'fa:16:3e:29:8a:0d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:14:36.034984 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:36.048263 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:14:36.067819 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:14:36.072406 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:36.118516 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:14:36.126002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:36.126345 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:36.126688 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:36.127020 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:36.127351 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:36.127710 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:36.128041 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:36.128362 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:36.128679 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:36.129015 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:36.129334 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:36.129888 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:36.130199 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:36.606225 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac3bdd0f-6182-4298-ab91-79f48debb4a6 req-cdf32d2d-f839-4483-b3ae-500c1011375c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:36.607765 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac3bdd0f-6182-4298-ab91-79f48debb4a6 req-cdf32d2d-f839-4483-b3ae-500c1011375c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 944 time: 0.0545259 Dec 09 22:14:36.656530 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ac3bdd0f-6182-4298-ab91-79f48debb4a6 req-ef97c537-d06d-476b-bf9f-31fdd8cd8224 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428216 Dec 09 22:14:36.813017 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:37.030920 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-0193baf7-ed0e-4a15-bbc1-acef0e08fc39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:37.032478 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-0193baf7-ed0e-4a15-bbc1-acef0e08fc39 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821&tenant_id=ecd32dac944041b58de1a396ec18cd2c HTTP/1.1" status: 200 len: 1096 time: 0.3960392 Dec 09 22:14:37.044475 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] Request body: {'port': {'binding:host_id': 'n-h1-713301-27', 'device_owner': 'compute:nova'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:14:37.098715 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:37.309368 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] For port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:14:37.361348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] For port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:14:37.401160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] Ignoring state change previous_port_status: BUILD current_port_status: DOWN port_id e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:14:37.409613 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:37.420712 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] Ignored duplicate provisioning block setup for port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:68}} Dec 09 22:14:37.425880 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:37.508541 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] Pushing event updated for resources: {'Port': ['ID=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,revision_number=9']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:14:37.560264 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] No DVR routers for this DVR port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:14:37.709660 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] Attempting to bind port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:14:37.709660 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] Attempting to bind port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:14:37.709660 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] Attempting to bind port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:14:37.713791 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] Port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:14:37.714111 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] Attempting to bind port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:14:37.720090 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 14, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:14:37.720634 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] Checking segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:14:37.721002 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] Bound using segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:14:37.721427 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] Bound port: e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:14:37.721928 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:37.791079 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94fd44b5-8068-47ee-96d9-3363a4aa2f5b req-7ad73e4e-6f8c-4469-918d-1a3600fb9ed4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:37.792608 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94fd44b5-8068-47ee-96d9-3363a4aa2f5b req-7ad73e4e-6f8c-4469-918d-1a3600fb9ed4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 943 time: 0.0521536 Dec 09 22:14:37.802094 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] For port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:14:37.805738 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] For port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:14:37.811150 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:37.854481 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:37.854652 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94fd44b5-8068-47ee-96d9-3363a4aa2f5b req-827dbf32-bc31-47f5-a3eb-97ddf47dd158 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0550711 Dec 09 22:14:37.854810 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:37.856232 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] 10.222.0.31 "PUT /v2.0/ports/e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba HTTP/1.1" status: 200 len: 1092 time: 0.8156483 Dec 09 22:14:37.856681 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bd4f065d-f008-4c10-8635-244507bc2821', 'tag': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:14:37.859143 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-84b75496-39ed-4dc7-9984-06fac65b4237" -d '{"events": [{"name": "network-changed", "server_uuid": "bd4f065d-f008-4c10-8635-244507bc2821", "tag": "e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:14:37.889911 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5c6ac42-be3f-436b-a128-8132a449d24b service neutron] Pushing event updated for resources: {'Port': ['ID=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,revision_number=10']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:14:37.937234 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:14:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-23bfc7ed-48f3-4c10-accb-c7cc55e931c4 x-openstack-request-id: req-23bfc7ed-48f3-4c10-accb-c7cc55e931c4 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:14:37.937538 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bd4f065d-f008-4c10-8635-244507bc2821", "tag": "e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:14:37.937797 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-23bfc7ed-48f3-4c10-accb-c7cc55e931c4 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:14:37.938273 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bd4f065d-f008-4c10-8635-244507bc2821', 'tag': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba', 'status': 'completed', 'code': 200} Dec 09 22:14:37.949941 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-28612c02-1017-41e7-9646-fab8ceb1ca1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:37.951533 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-28612c02-1017-41e7-9646-fab8ceb1ca1f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 1096 time: 0.0581336 Dec 09 22:14:38.005035 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84b75496-39ed-4dc7-9984-06fac65b4237 req-dfe823a0-95e0-49d9-be54-b24c6ea4408c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:38.006774 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84b75496-39ed-4dc7-9984-06fac65b4237 req-dfe823a0-95e0-49d9-be54-b24c6ea4408c service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 1096 time: 0.0458620 Dec 09 22:14:38.056976 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b7f6108a-f200-479f-83ad-707c069738d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:38.058553 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-b7f6108a-f200-479f-83ad-707c069738d4 service neutron] 10.222.0.31 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0980289 Dec 09 22:14:38.124968 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84b75496-39ed-4dc7-9984-06fac65b4237 req-0fe55f8e-ed2a-45ec-aa8c-108299e81a03 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:38.127209 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84b75496-39ed-4dc7-9984-06fac65b4237 req-0fe55f8e-ed2a-45ec-aa8c-108299e81a03 service neutron] 10.222.0.10 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.1112094 Dec 09 22:14:38.143254 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-303a4e3f-7fdc-4d3b-b08b-3f18f04ec56b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba HTTP/1.1" status: 200 len: 1000 time: 0.0765986 Dec 09 22:14:38.155122 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:38.205646 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-fcd74afb-1bcc-4b60-9cd1-ad06fb531a72 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:38.207291 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-fcd74afb-1bcc-4b60-9cd1-ad06fb531a72 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0569110 Dec 09 22:14:38.263159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-bded75e7-a3df-48a9-847d-ce58dc1eb7d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:38.264781 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-bded75e7-a3df-48a9-847d-ce58dc1eb7d3 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0504103 Dec 09 22:14:38.371780 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-ee176d0a-da03-4b34-87d0-a1353cf11653 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0988333 Dec 09 22:14:38.475301 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dc4d05dc-662f-497c-83e3-fafe8d8b4e89 req-a68a4363-f23b-43dc-a0bf-781b68565fec service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0956967 Dec 09 22:14:38.523277 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84b75496-39ed-4dc7-9984-06fac65b4237 req-584b14fe-218d-4d20-a932-3bc5c28f50c2 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba HTTP/1.1" status: 200 len: 1000 time: 0.3892083 Dec 09 22:14:38.577314 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84b75496-39ed-4dc7-9984-06fac65b4237 req-76956c2e-80bb-4bc4-be83-200fd597216b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:38.578347 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84b75496-39ed-4dc7-9984-06fac65b4237 req-56e698ab-0884-4b64-b7e2-a231195570a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:38.578913 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-84b75496-39ed-4dc7-9984-06fac65b4237 req-76956c2e-80bb-4bc4-be83-200fd597216b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 1096 time: 0.0533726 Dec 09 22:14:38.580113 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84b75496-39ed-4dc7-9984-06fac65b4237 req-56e698ab-0884-4b64-b7e2-a231195570a6 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0491285 Dec 09 22:14:38.628314 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84b75496-39ed-4dc7-9984-06fac65b4237 req-423df384-8d58-410d-b8e5-b50f0c3ae5a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:38.630023 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84b75496-39ed-4dc7-9984-06fac65b4237 req-423df384-8d58-410d-b8e5-b50f0c3ae5a5 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0432463 Dec 09 22:14:38.672339 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84b75496-39ed-4dc7-9984-06fac65b4237 req-63c9f8a4-2a41-498e-96c8-2c1e54c518ae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:38.673888 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-84b75496-39ed-4dc7-9984-06fac65b4237 req-63c9f8a4-2a41-498e-96c8-2c1e54c518ae service neutron] 10.222.0.31 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0882926 Dec 09 22:14:38.726551 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84b75496-39ed-4dc7-9984-06fac65b4237 req-ce391c9d-eb15-4e5f-88de-b21fb7047071 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0893595 Dec 09 22:14:38.747893 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-84b75496-39ed-4dc7-9984-06fac65b4237 req-7ad2de73-808d-4a58-b3a2-60fe12458698 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba HTTP/1.1" status: 200 len: 1000 time: 0.0654886 Dec 09 22:14:38.799674 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84b75496-39ed-4dc7-9984-06fac65b4237 req-9e52e754-50d6-4f6d-aa0e-c36d51415aa6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:38.801309 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-84b75496-39ed-4dc7-9984-06fac65b4237 req-9e52e754-50d6-4f6d-aa0e-c36d51415aa6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0451319 Dec 09 22:14:38.821699 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84b75496-39ed-4dc7-9984-06fac65b4237 req-7601648c-d004-4737-9039-ed36ac61bd11 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0877385 Dec 09 22:14:38.848622 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84b75496-39ed-4dc7-9984-06fac65b4237 req-c9df5fc9-5188-4a98-94a4-daa63dabfbae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:38.850407 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-84b75496-39ed-4dc7-9984-06fac65b4237 req-c9df5fc9-5188-4a98-94a4-daa63dabfbae service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0416799 Dec 09 22:14:38.959880 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-84b75496-39ed-4dc7-9984-06fac65b4237 req-c7659991-50d3-4f6e-85e4-914f66037d44 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1005633 Dec 09 22:14:38.985665 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d47b2fe2-f67a-4ee8-aa4d-11b0fe5af254 req-02dd38ac-e982-4caf-936d-52f2ab0ef6bf tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:38.987022 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d47b2fe2-f67a-4ee8-aa4d-11b0fe5af254 req-02dd38ac-e982-4caf-936d-52f2ab0ef6bf tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 944 time: 0.0489984 Dec 09 22:14:39.035040 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d47b2fe2-f67a-4ee8-aa4d-11b0fe5af254 req-6d1c722e-2b6f-4366-a36f-5007f2943152 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411501 Dec 09 22:14:39.052675 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-84b75496-39ed-4dc7-9984-06fac65b4237 req-b19a8836-ea78-44ff-b279-7395085b2ac8 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847423 Dec 09 22:14:39.685810 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:39.903986 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:14:39.908309 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:14:40.007773 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:14:40.071653 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:14:40.085418 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'port_id': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba', 'mac_address': 'fa:16:3e:29:8a:0d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:14:40.123295 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:40.136007 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:14:40.156363 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:14:40.158561 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4febf801-46df-4ad5-a18a-0b96849df158 req-8b84fc42-52b5-4b08-babb-128cf3535f31 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:40.160141 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4febf801-46df-4ad5-a18a-0b96849df158 req-8b84fc42-52b5-4b08-babb-128cf3535f31 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 944 time: 0.0491509 Dec 09 22:14:40.161478 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:40.208878 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,revision_number=11']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:14:40.209751 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4febf801-46df-4ad5-a18a-0b96849df158 req-eb1a06fa-93f8-425e-a02d-c592a0723a9d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421510 Dec 09 22:14:40.335125 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38791f0d-ad34-4c3c-b4d9-532ee2118380 req-50be1e76-9e41-4cc7-b7b2-2de482a6c36c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:40.336532 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38791f0d-ad34-4c3c-b4d9-532ee2118380 req-50be1e76-9e41-4cc7-b7b2-2de482a6c36c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 945 time: 0.0595689 Dec 09 22:14:40.383323 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38791f0d-ad34-4c3c-b4d9-532ee2118380 req-62692444-b011-4661-9192-27b391618f54 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407705 Dec 09 22:14:40.383617 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:14:40.499803 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9541f7ed-e2b7-46d3-a96d-6ecc15535db7 req-19571912-c499-46c4-b025-a375a907782a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:40.501293 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9541f7ed-e2b7-46d3-a96d-6ecc15535db7 req-19571912-c499-46c4-b025-a375a907782a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 945 time: 0.0506449 Dec 09 22:14:40.550335 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9541f7ed-e2b7-46d3-a96d-6ecc15535db7 req-c16c442a-dcaf-4ccd-ae61-1f0879a2f81c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426147 Dec 09 22:14:40.806958 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42cf955d-64a0-473d-9545-501c75a36143 req-a9a80808-6d97-471f-b8e5-31bea16f6b7f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:40.808496 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42cf955d-64a0-473d-9545-501c75a36143 req-a9a80808-6d97-471f-b8e5-31bea16f6b7f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 945 time: 0.0511630 Dec 09 22:14:40.860366 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42cf955d-64a0-473d-9545-501c75a36143 req-2d3b7a9d-48d9-4de8-8226-2d266215e410 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455539 Dec 09 22:14:41.928887 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:14:41.980538 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:14:41.984297 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:14:41.984658 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:41.987688 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3fbe4dc-00e5-42d3-a56c-6c399ea9fe42 req-24ac4024-dfee-4e63-88bb-748ba88a8935 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:41.989213 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3fbe4dc-00e5-42d3-a56c-6c399ea9fe42 req-24ac4024-dfee-4e63-88bb-748ba88a8935 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 945 time: 0.0502331 Dec 09 22:14:42.038747 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3fbe4dc-00e5-42d3-a56c-6c399ea9fe42 req-75f21fb6-5679-494f-acef-d1e84dfea61d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420160 Dec 09 22:14:42.047609 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc89cfdb-6c31-4f89-aa06-9fd8e2771285 req-1951648f-14c8-4119-9838-3f64bc48adb6 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:42.049127 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cc89cfdb-6c31-4f89-aa06-9fd8e2771285 req-1951648f-14c8-4119-9838-3f64bc48adb6 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.31 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 945 time: 0.0581870 Dec 09 22:14:42.066592 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:42.089249 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bd4f065d-f008-4c10-8635-244507bc2821', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:14:42.091513 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5a370a67-3a5c-448a-a1cc-cca7e24ba738" -d '{"events": [{"server_uuid": "bd4f065d-f008-4c10-8635-244507bc2821", "name": "network-vif-plugged", "status": "completed", "tag": "e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:14:42.105269 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:14:42.109828 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:42.134187 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:14:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-984b3e21-a236-4756-a83d-55936172ab8a x-openstack-request-id: req-984b3e21-a236-4756-a83d-55936172ab8a {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:14:42.134490 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bd4f065d-f008-4c10-8635-244507bc2821", "name": "network-vif-plugged", "status": "completed", "tag": "e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:14:42.134745 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-984b3e21-a236-4756-a83d-55936172ab8a {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:14:42.135138 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bd4f065d-f008-4c10-8635-244507bc2821', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba', 'code': 200} Dec 09 22:14:42.140850 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-cc89cfdb-6c31-4f89-aa06-9fd8e2771285 req-37c91dd4-2e15-45fd-8fc1-61bb56917a7b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Deleting port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:14:42.141197 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cc89cfdb-6c31-4f89-aa06-9fd8e2771285 req-37c91dd4-2e15-45fd-8fc1-61bb56917a7b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:42.160302 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,revision_number=12']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:14:42.233846 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-cc89cfdb-6c31-4f89-aa06-9fd8e2771285 req-37c91dd4-2e15-45fd-8fc1-61bb56917a7b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] For port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:14:42.234215 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cc89cfdb-6c31-4f89-aa06-9fd8e2771285 req-37c91dd4-2e15-45fd-8fc1-61bb56917a7b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:42.406565 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cc89cfdb-6c31-4f89-aa06-9fd8e2771285 req-37c91dd4-2e15-45fd-8fc1-61bb56917a7b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:42.406950 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cc89cfdb-6c31-4f89-aa06-9fd8e2771285 req-37c91dd4-2e15-45fd-8fc1-61bb56917a7b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:42.407270 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [req-cc89cfdb-6c31-4f89-aa06-9fd8e2771285 req-37c91dd4-2e15-45fd-8fc1-61bb56917a7b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Floating IP ded53112-c89a-4a62-a1b4-d803c592f310 disassociated. External IP: 172.25.3.185, port: e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba. Dec 09 22:14:42.407643 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-cc89cfdb-6c31-4f89-aa06-9fd8e2771285 req-37c91dd4-2e15-45fd-8fc1-61bb56917a7b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Calling delete_port for e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:14:42.544928 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cc89cfdb-6c31-4f89-aa06-9fd8e2771285 req-37c91dd4-2e15-45fd-8fc1-61bb56917a7b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:42.582532 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37c91dd4-2e15-45fd-8fc1-61bb56917a7b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Pushing event deleted for resources: {'Port': ['ID=e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:14:42.702933 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [req-cc89cfdb-6c31-4f89-aa06-9fd8e2771285 req-37c91dd4-2e15-45fd-8fc1-61bb56917a7b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:14:42.813908 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-cc89cfdb-6c31-4f89-aa06-9fd8e2771285 req-37c91dd4-2e15-45fd-8fc1-61bb56917a7b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:14:42.826590 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdac8d6f-0847-413d-9d94-dc8b0dc82471 None None] Sync routers for ids ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:14:42.837118 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bdac8d6f-0847-413d-9d94-dc8b0dc82471 None None] Routers {'7e861ee9-d29c-4ade-a3ab-cce44cba2c97'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:14:42.837712 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-bdac8d6f-0847-413d-9d94-dc8b0dc82471 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:14:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:14:42.854078 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-cc89cfdb-6c31-4f89-aa06-9fd8e2771285 req-37c91dd4-2e15-45fd-8fc1-61bb56917a7b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] No DVR routers for this DVR port e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:14:42.856836 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cc89cfdb-6c31-4f89-aa06-9fd8e2771285 req-37c91dd4-2e15-45fd-8fc1-61bb56917a7b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:42.860181 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cc89cfdb-6c31-4f89-aa06-9fd8e2771285 req-37c91dd4-2e15-45fd-8fc1-61bb56917a7b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.31 "DELETE /v2.0/ports/e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba HTTP/1.1" status: 204 len: 173 time: 0.8040638 Dec 09 22:14:42.860629 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bd4f065d-f008-4c10-8635-244507bc2821', 'name': 'network-vif-deleted', 'tag': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:14:42.862880 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3811363268aba028bccdbd4d555fd9b6e4fda53ba56603516de81be7a1d82836" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-75476e86-1646-4534-95cd-2cd6fed81ba9" -d '{"events": [{"server_uuid": "bd4f065d-f008-4c10-8635-244507bc2821", "name": "network-vif-deleted", "tag": "e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:14:42.908473 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:14:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8bf9aaa2-b860-445d-ac76-92c7e7748760 x-openstack-request-id: req-8bf9aaa2-b860-445d-ac76-92c7e7748760 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:14:42.909085 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bd4f065d-f008-4c10-8635-244507bc2821", "name": "network-vif-deleted", "tag": "e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:14:42.909355 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8bf9aaa2-b860-445d-ac76-92c7e7748760 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:14:42.909932 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bd4f065d-f008-4c10-8635-244507bc2821', 'name': 'network-vif-deleted', 'tag': 'e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba', 'status': 'completed', 'code': 200} Dec 09 22:14:42.954138 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-bdac8d6f-0847-413d-9d94-dc8b0dc82471 None None] Set router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:14:43.151564 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a22ebae7-c686-4a88-a50b-364088b3a2cb req-14eaf5e8-8e28-4cbf-b263-b89c588ded2d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=bd4f065d-f008-4c10-8635-244507bc2821 HTTP/1.1" status: 200 len: 210 time: 0.0257356 Dec 09 22:14:43.154184 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-bdac8d6f-0847-413d-9d94-dc8b0dc82471 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:05Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:14:43.186270 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdac8d6f-0847-413d-9d94-dc8b0dc82471 None None] Checking router: 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:14:43.195391 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bdac8d6f-0847-413d-9d94-dc8b0dc82471 None None] Routers {'7e861ee9-d29c-4ade-a3ab-cce44cba2c97'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:14:43.196049 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-bdac8d6f-0847-413d-9d94-dc8b0dc82471 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:14:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:14:43.305967 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-bdac8d6f-0847-413d-9d94-dc8b0dc82471 None None] Set router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:14:43.617911 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-bdac8d6f-0847-413d-9d94-dc8b0dc82471 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:05Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:14:43.643801 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bdac8d6f-0847-413d-9d94-dc8b0dc82471 None None] The sync data for ids ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'] in n-d-713301-27 is: [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:05Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:14:43.894173 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50dd0a27-eaf2-4093-813c-65bb475739e5 None None] New status for floating IP ded53112-c89a-4a62-a1b4-d803c592f310: DOWN {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:14:44.456998 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-c1048b63-9cc6-4c51-8d5e-e1bfac62a424 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-securitygroup--1276791935&fields=id&tenant_id=ecd32dac944041b58de1a396ec18cd2c HTTP/1.1" status: 200 len: 267 time: 0.0523896 Dec 09 22:14:44.573599 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-e1d417ab-8709-4cf1-aeb7-59d40724a946 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:44.575087 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-e1d417ab-8709-4cf1-aeb7-59d40724a946 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 812 time: 0.1111150 Dec 09 22:14:44.592777 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-a0ed8717-8242-447d-ba35-c3cf4df094f4 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/quotas/ecd32dac944041b58de1a396ec18cd2c HTTP/1.1" status: 200 len: 375 time: 0.0094423 Dec 09 22:14:44.645257 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-3fe508c0-0327-4b3c-9cb0-fe15d9579aa9 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0467749 Dec 09 22:14:44.746044 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-fe3d6c24-bc27-4c9a-b60f-9be4ae487259 service neutron] 10.222.0.13 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0880191 Dec 09 22:14:44.849832 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-f60481b2-33d1-493e-a426-dceb72fbc71a service neutron] 10.222.0.13 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0949295 Dec 09 22:14:45.033217 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6800a22-8655-4b28-9dae-741a10d85da2 req-e7f27290-6454-4dff-a836-c38560615895 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 210 time: 0.0325499 Dec 09 22:14:45.958683 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:14:45.980894 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:14:45.981312 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e37494ea-ff0d-4fbc-915f-b1c5b6cd43ba not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:14:46.016021 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-803a17df-358a-4d0e-9ec6-4ec63e32f68d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:46.017505 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-803a17df-358a-4d0e-9ec6-4ec63e32f68d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.10 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 812 time: 0.1081197 Dec 09 22:14:46.080809 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-a5fd3db6-269e-4b9b-875a-adf8b427dd76 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.10 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=ecd32dac944041b58de1a396ec18cd2c HTTP/1.1" status: 200 len: 380 time: 0.0541720 Dec 09 22:14:46.091943 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Request body: {'port': {'device_id': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'admin_state_up': True, 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'security_groups': ['fc389abb-6202-4d61-870a-d6749ba1a635']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:14:46.146495 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50f937fa-f8c0-4b40-b1ca-f2f48f27d908 req-7b5eff27-b867-4692-9aa0-50c1cc7a6d48 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 210 time: 0.0390790 Dec 09 22:14:46.238863 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Made reservation on behalf of ecd32dac944041b58de1a396ec18cd2c for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:14:46.242836 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:46.379105 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Allocated IP 172.20.0.10 (91a989ca-03f4-4cf9-a2af-b26f8b1a2bec/88c86202-31f6-4618-8f06-f2283fac961c/81af3eef-9e82-4452-afb5-98a928257d50) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:14:46.515369 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:46.552883 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:46.598363 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:14:46.601593 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:14:46.608264 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:14:46.614764 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Pushing event updated for resources: {'Port': ['ID=81af3eef-9e82-4452-afb5-98a928257d50,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:14:46.644696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:46.645037 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:46.645486 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:46.646189 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:46.646189 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:46.646485 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:46.646809 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:46.647136 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:46.647472 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:46.647795 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:46.648111 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:46.648434 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:46.648748 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:14:46.672269 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:46.672886 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:46.693190 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-62fd6fb8-7a73-4404-b496-a8cf0be2b20e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6041205 Dec 09 22:14:46.705767 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-86ace872-8e92-480f-a7ac-ca6a383b8559 service neutron] Request body: {'port': {'device_id': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:14:46.769130 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-86ace872-8e92-480f-a7ac-ca6a383b8559 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:46.804262 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-70be23ba-b1a0-403b-8609-1cdcbb710eb1 None None] Provisioning complete for port 81af3eef-9e82-4452-afb5-98a928257d50 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:14:46.804603 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-70be23ba-b1a0-403b-8609-1cdcbb710eb1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:46.838969 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-70be23ba-b1a0-403b-8609-1cdcbb710eb1 None None] Port 81af3eef-9e82-4452-afb5-98a928257d50 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:14:47.044520 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-86ace872-8e92-480f-a7ac-ca6a383b8559 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 81af3eef-9e82-4452-afb5-98a928257d50 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:14:47.052689 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-86ace872-8e92-480f-a7ac-ca6a383b8559 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:47.064813 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-86ace872-8e92-480f-a7ac-ca6a383b8559 service neutron] Transition to ACTIVE for port object 81af3eef-9e82-4452-afb5-98a928257d50 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:14:47.070395 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-86ace872-8e92-480f-a7ac-ca6a383b8559 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:47.120524 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86ace872-8e92-480f-a7ac-ca6a383b8559 service neutron] Pushing event updated for resources: {'Port': ['ID=81af3eef-9e82-4452-afb5-98a928257d50,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:14:47.201023 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-86ace872-8e92-480f-a7ac-ca6a383b8559 service neutron] Attempting to bind port 81af3eef-9e82-4452-afb5-98a928257d50 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:14:47.201369 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-86ace872-8e92-480f-a7ac-ca6a383b8559 service neutron] Attempting to bind port 81af3eef-9e82-4452-afb5-98a928257d50 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:14:47.201757 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-86ace872-8e92-480f-a7ac-ca6a383b8559 service neutron] Attempting to bind port 81af3eef-9e82-4452-afb5-98a928257d50 on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:14:47.206596 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-86ace872-8e92-480f-a7ac-ca6a383b8559 service neutron] Port 81af3eef-9e82-4452-afb5-98a928257d50 on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:14:47.206926 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-86ace872-8e92-480f-a7ac-ca6a383b8559 service neutron] Attempting to bind port 81af3eef-9e82-4452-afb5-98a928257d50 on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:14:47.213229 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-86ace872-8e92-480f-a7ac-ca6a383b8559 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 14, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:14:47.213572 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-86ace872-8e92-480f-a7ac-ca6a383b8559 service neutron] Checking segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:14:47.213963 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-86ace872-8e92-480f-a7ac-ca6a383b8559 service neutron] Bound using segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:14:47.214397 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-86ace872-8e92-480f-a7ac-ca6a383b8559 service neutron] Bound port: 81af3eef-9e82-4452-afb5-98a928257d50, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:14:47.214759 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-86ace872-8e92-480f-a7ac-ca6a383b8559 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:47.313246 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c92e60-514d-4f06-b0b6-ac8840401c2d req-1aa2b614-8b7d-439a-9feb-ca5e1af2408c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:47.314868 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31c92e60-514d-4f06-b0b6-ac8840401c2d req-1aa2b614-8b7d-439a-9feb-ca5e1af2408c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 944 time: 0.0887275 Dec 09 22:14:47.319080 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-86ace872-8e92-480f-a7ac-ca6a383b8559 service neutron] For port 81af3eef-9e82-4452-afb5-98a928257d50, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:14:47.322756 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-86ace872-8e92-480f-a7ac-ca6a383b8559 service neutron] For port 81af3eef-9e82-4452-afb5-98a928257d50, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=81af3eef-9e82-4452-afb5-98a928257d50,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:14:47.331892 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-86ace872-8e92-480f-a7ac-ca6a383b8559 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:47.397312 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-86ace872-8e92-480f-a7ac-ca6a383b8559 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:47.397942 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-86ace872-8e92-480f-a7ac-ca6a383b8559 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:47.399407 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-86ace872-8e92-480f-a7ac-ca6a383b8559 service neutron] 10.222.0.10 "PUT /v2.0/ports/81af3eef-9e82-4452-afb5-98a928257d50 HTTP/1.1" status: 200 len: 1093 time: 0.6981184 Dec 09 22:14:47.399886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'tag': '81af3eef-9e82-4452-afb5-98a928257d50'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:14:47.402315 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1743d006-6400-4bb1-9b1f-9c67e3c13642" -d '{"events": [{"name": "network-changed", "server_uuid": "40d085f5-12ba-4993-bdbd-d75dd187516c", "tag": "81af3eef-9e82-4452-afb5-98a928257d50"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:14:47.434225 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31c92e60-514d-4f06-b0b6-ac8840401c2d req-9741406f-7743-4b45-b156-e1aa8074f199 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1100469 Dec 09 22:14:47.439626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86ace872-8e92-480f-a7ac-ca6a383b8559 service neutron] Pushing event updated for resources: {'Port': ['ID=81af3eef-9e82-4452-afb5-98a928257d50,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:14:47.494827 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:14:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7bc1e3e0-ef3b-4f46-95f6-23ec6d1d8583 x-openstack-request-id: req-7bc1e3e0-ef3b-4f46-95f6-23ec6d1d8583 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:14:47.495155 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "40d085f5-12ba-4993-bdbd-d75dd187516c", "tag": "81af3eef-9e82-4452-afb5-98a928257d50", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:14:47.495366 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-7bc1e3e0-ef3b-4f46-95f6-23ec6d1d8583 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:14:47.495817 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'tag': '81af3eef-9e82-4452-afb5-98a928257d50', 'status': 'completed', 'code': 200} Dec 09 22:14:47.512909 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-c706a0a9-7ca5-41a5-bb99-30a546695234 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:47.514472 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-c706a0a9-7ca5-41a5-bb99-30a546695234 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 1096 time: 0.0489542 Dec 09 22:14:47.558686 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-0fb41bfc-edcb-49ce-a51e-401d6b0cb3be service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=81af3eef-9e82-4452-afb5-98a928257d50 HTTP/1.1" status: 200 len: 217 time: 0.0353076 Dec 09 22:14:47.615728 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-0d4352a7-2b72-4a2c-8578-023b558cb012 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:47.617233 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-0d4352a7-2b72-4a2c-8578-023b558cb012 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0512772 Dec 09 22:14:47.666510 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-7f61f882-5d73-49e9-aff7-4c26767dfea1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:47.667954 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-7f61f882-5d73-49e9-aff7-4c26767dfea1 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0425425 Dec 09 22:14:47.764796 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-1e105e8a-560a-42e5-adfa-aa4d84ac9628 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0888031 Dec 09 22:14:47.863236 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-516c24ff-8f59-4a99-bcc1-8677c583de57 req-c32d3572-7f66-4d29-ae08-599e0ab409b3 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0912440 Dec 09 22:14:47.953733 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1743d006-6400-4bb1-9b1f-9c67e3c13642 req-ae01e4ec-f1f6-4259-99c2-dad46ac5164d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:47.955218 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1743d006-6400-4bb1-9b1f-9c67e3c13642 req-ae01e4ec-f1f6-4259-99c2-dad46ac5164d service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 1096 time: 0.0412242 Dec 09 22:14:48.048965 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1743d006-6400-4bb1-9b1f-9c67e3c13642 req-1d2bbf3c-a2ad-479f-911e-eb7455bc27c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:48.050445 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1743d006-6400-4bb1-9b1f-9c67e3c13642 req-1d2bbf3c-a2ad-479f-911e-eb7455bc27c0 service neutron] 10.222.0.10 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0876231 Dec 09 22:14:48.091898 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1743d006-6400-4bb1-9b1f-9c67e3c13642 req-33eff7c4-d9b2-483c-a3b4-1f8459e7064c service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=81af3eef-9e82-4452-afb5-98a928257d50 HTTP/1.1" status: 200 len: 217 time: 0.0336869 Dec 09 22:14:48.144743 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1743d006-6400-4bb1-9b1f-9c67e3c13642 req-3a491e44-ae9a-4355-8d72-75555f98389c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:48.146227 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1743d006-6400-4bb1-9b1f-9c67e3c13642 req-3a491e44-ae9a-4355-8d72-75555f98389c service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0468650 Dec 09 22:14:48.193564 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1743d006-6400-4bb1-9b1f-9c67e3c13642 req-ecc727b6-2c81-4c61-b24d-2b13a5286187 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:48.195029 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1743d006-6400-4bb1-9b1f-9c67e3c13642 req-ecc727b6-2c81-4c61-b24d-2b13a5286187 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0395746 Dec 09 22:14:48.286914 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1743d006-6400-4bb1-9b1f-9c67e3c13642 req-21a23220-9250-4d1a-9b58-04fe7dd29bd1 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0835800 Dec 09 22:14:48.380148 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1743d006-6400-4bb1-9b1f-9c67e3c13642 req-92bbb178-e483-4155-b4aa-9b246a72799e service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0856588 Dec 09 22:14:48.569639 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a847e11-0dd5-4889-beda-1a21d4c46b13 req-3892e9a6-7a6f-49ea-bdc2-e28ebc589db8 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:48.571104 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a847e11-0dd5-4889-beda-1a21d4c46b13 req-3892e9a6-7a6f-49ea-bdc2-e28ebc589db8 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 944 time: 0.0518870 Dec 09 22:14:48.619375 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a847e11-0dd5-4889-beda-1a21d4c46b13 req-cb23eb2f-2922-4a62-a518-0ced9401150f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422571 Dec 09 22:14:49.758993 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6400ae63-88a0-4739-9ba4-dd67e166c012 req-4382b30b-99b4-48c2-8320-d43f29fe684b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:49.760517 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6400ae63-88a0-4739-9ba4-dd67e166c012 req-4382b30b-99b4-48c2-8320-d43f29fe684b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 944 time: 0.0632575 Dec 09 22:14:49.811657 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6400ae63-88a0-4739-9ba4-dd67e166c012 req-b419c8b0-fe7f-4dbf-a98a-ad72915b3d96 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449703 Dec 09 22:14:50.936153 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00c164a0-6a1c-40c5-8451-ca441625ffe6 req-fea3ba38-db6a-4a99-8c54-0d29187f386a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:50.937650 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-00c164a0-6a1c-40c5-8451-ca441625ffe6 req-fea3ba38-db6a-4a99-8c54-0d29187f386a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 944 time: 0.0524192 Dec 09 22:14:50.995748 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-00c164a0-6a1c-40c5-8451-ca441625ffe6 req-4c81bd61-3526-4e13-a65f-a509bea9b5ad tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483313 Dec 09 22:14:52.001217 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 81af3eef-9e82-4452-afb5-98a928257d50 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:14:52.113804 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 81af3eef-9e82-4452-afb5-98a928257d50, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=81af3eef-9e82-4452-afb5-98a928257d50,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:14:52.116881 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f3333bd-2271-4515-9ca6-6ab9473502b1 req-4ac7547a-3d58-48ca-92af-ad4c1bcb46f8 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:52.118384 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f3333bd-2271-4515-9ca6-6ab9473502b1 req-4ac7547a-3d58-48ca-92af-ad4c1bcb46f8 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 944 time: 0.0511854 Dec 09 22:14:52.125276 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '81af3eef-9e82-4452-afb5-98a928257d50', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'port_id': '81af3eef-9e82-4452-afb5-98a928257d50', 'mac_address': 'fa:16:3e:25:d0:20', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:14:52.166601 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:52.169538 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f3333bd-2271-4515-9ca6-6ab9473502b1 req-e50751d4-4d86-411a-92cc-7b6e0481deaf tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448282 Dec 09 22:14:52.180273 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 81af3eef-9e82-4452-afb5-98a928257d50 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:14:52.199995 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 81af3eef-9e82-4452-afb5-98a928257d50, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=81af3eef-9e82-4452-afb5-98a928257d50,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:14:52.206524 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:52.251924 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=81af3eef-9e82-4452-afb5-98a928257d50,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:14:52.405061 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['81af3eef-9e82-4452-afb5-98a928257d50'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:14:53.291692 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-318b1f33-de0f-4867-9aca-56afebfc5da1 req-64b23816-de36-47b4-b15e-296ed0e0cca1 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:53.293200 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-318b1f33-de0f-4867-9aca-56afebfc5da1 req-64b23816-de36-47b4-b15e-296ed0e0cca1 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 945 time: 0.0523148 Dec 09 22:14:53.342574 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-318b1f33-de0f-4867-9aca-56afebfc5da1 req-c0d4204b-c4ef-4f69-a5a5-e5ff970f6b0f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431352 Dec 09 22:14:54.017998 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 81af3eef-9e82-4452-afb5-98a928257d50 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:14:54.079558 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 81af3eef-9e82-4452-afb5-98a928257d50 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:14:54.083777 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 81af3eef-9e82-4452-afb5-98a928257d50 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:14:54.084155 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:54.166509 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:54.189668 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '81af3eef-9e82-4452-afb5-98a928257d50'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:14:54.192087 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}33cf59e00220ba208378aeddc76b1b4d1b8b29542885567c779f1afd792af602" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-db2d6d75-566c-4b64-b41f-86ce483a52b1" -d '{"events": [{"server_uuid": "40d085f5-12ba-4993-bdbd-d75dd187516c", "name": "network-vif-plugged", "status": "completed", "tag": "81af3eef-9e82-4452-afb5-98a928257d50"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:14:54.204679 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 81af3eef-9e82-4452-afb5-98a928257d50, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=81af3eef-9e82-4452-afb5-98a928257d50,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:14:54.209148 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:54.232288 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:14:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a7cab684-40bd-419f-a85a-4815c570a92e x-openstack-request-id: req-a7cab684-40bd-419f-a85a-4815c570a92e {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:14:54.232580 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "40d085f5-12ba-4993-bdbd-d75dd187516c", "name": "network-vif-plugged", "status": "completed", "tag": "81af3eef-9e82-4452-afb5-98a928257d50", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:14:54.232831 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a7cab684-40bd-419f-a85a-4815c570a92e {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:14:54.233221 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '81af3eef-9e82-4452-afb5-98a928257d50', 'code': 200} Dec 09 22:14:54.258716 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=81af3eef-9e82-4452-afb5-98a928257d50,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:14:54.329283 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dce471a9-a469-4682-a744-db1365840fd2 req-7af22446-d57e-4ca2-8369-7d52ca9ac378 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:54.330860 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dce471a9-a469-4682-a744-db1365840fd2 req-7af22446-d57e-4ca2-8369-7d52ca9ac378 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 1098 time: 0.0408926 Dec 09 22:14:54.375816 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dce471a9-a469-4682-a744-db1365840fd2 req-5c673d91-6b5e-452c-b173-2743f587f1e6 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0379441 Dec 09 22:14:54.472017 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5f99318-90ad-4eb5-bd4c-aad722aba7d5 req-9491e4d6-faea-4ec4-aaca-efd9f4e37f37 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:54.474195 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b5f99318-90ad-4eb5-bd4c-aad722aba7d5 req-9491e4d6-faea-4ec4-aaca-efd9f4e37f37 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 946 time: 0.0614378 Dec 09 22:14:54.523971 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b5f99318-90ad-4eb5-bd4c-aad722aba7d5 req-0b103f36-3d2e-4249-b992-8d1b3e8e65d6 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435717 Dec 09 22:14:55.655316 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-669641a0-6c5f-4c30-91f8-355fe90bc712 req-6d72e712-c1d8-45ef-8de5-c4861e56e1d8 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:55.656832 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-669641a0-6c5f-4c30-91f8-355fe90bc712 req-6d72e712-c1d8-45ef-8de5-c4861e56e1d8 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 946 time: 0.0508418 Dec 09 22:14:55.715055 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-669641a0-6c5f-4c30-91f8-355fe90bc712 req-092cf517-88c8-4eac-9acc-2338346528f5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0519969 Dec 09 22:14:55.839877 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee8cdcf9-8b2b-4472-a533-de1441ecc649 req-0bc997be-1967-4c26-8008-49f08678aedf tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:55.841331 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ee8cdcf9-8b2b-4472-a533-de1441ecc649 req-0bc997be-1967-4c26-8008-49f08678aedf tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 946 time: 0.0578644 Dec 09 22:14:55.851032 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60392) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:14:55.855629 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-17ff75b6-f6d7-4dc0-b0df-ba3a79d7898f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Request body: {'floatingip': {'port_id': '81af3eef-9e82-4452-afb5-98a928257d50'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:14:55.894792 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-17ff75b6-f6d7-4dc0-b0df-ba3a79d7898f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for floatingip, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:56.338003 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-17ff75b6-f6d7-4dc0-b0df-ba3a79d7898f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:56.344296 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-17ff75b6-f6d7-4dc0-b0df-ba3a79d7898f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:56.449477 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-17ff75b6-f6d7-4dc0-b0df-ba3a79d7898f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Floating IP ded53112-c89a-4a62-a1b4-d803c592f310 associated. External IP: 172.25.3.185, port: 81af3eef-9e82-4452-afb5-98a928257d50. Dec 09 22:14:56.658635 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-17ff75b6-f6d7-4dc0-b0df-ba3a79d7898f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:14:57.069005 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-17ff75b6-f6d7-4dc0-b0df-ba3a79d7898f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:14:57.073989 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-17ff75b6-f6d7-4dc0-b0df-ba3a79d7898f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:57.078602 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95b1d657-5338-4ae2-b006-70c0b5dc7c65 None None] Sync routers for ids ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:14:57.088953 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95b1d657-5338-4ae2-b006-70c0b5dc7c65 None None] Routers {'7e861ee9-d29c-4ade-a3ab-cce44cba2c97'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:14:57.089564 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-95b1d657-5338-4ae2-b006-70c0b5dc7c65 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:14:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:14:57.102836 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-17ff75b6-f6d7-4dc0-b0df-ba3a79d7898f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "PUT /v2.0/floatingips/ded53112-c89a-4a62-a1b4-d803c592f310 HTTP/1.1" status: 200 len: 993 time: 1.2506862 Dec 09 22:14:57.103480 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'tag': '81af3eef-9e82-4452-afb5-98a928257d50'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:14:57.105867 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e92738e0b8f6eee89d0305cb271eb999a03f1f59810a7b3a0216a8cdcd09c3a9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7c4b6462-647e-4ec9-bb7e-52b8f267916a" -d '{"events": [{"name": "network-changed", "server_uuid": "40d085f5-12ba-4993-bdbd-d75dd187516c", "tag": "81af3eef-9e82-4452-afb5-98a928257d50"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:14:57.194043 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:14:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c00a8e4d-1e17-49fa-acc9-b26dae25fccb x-openstack-request-id: req-c00a8e4d-1e17-49fa-acc9-b26dae25fccb {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:14:57.194343 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "40d085f5-12ba-4993-bdbd-d75dd187516c", "tag": "81af3eef-9e82-4452-afb5-98a928257d50", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:14:57.194597 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c00a8e4d-1e17-49fa-acc9-b26dae25fccb {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:14:57.195007 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'tag': '81af3eef-9e82-4452-afb5-98a928257d50', 'status': 'completed', 'code': 200} Dec 09 22:14:57.197493 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-95b1d657-5338-4ae2-b006-70c0b5dc7c65 None None] Set router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:14:57.260687 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c4b6462-647e-4ec9-bb7e-52b8f267916a req-4d1db74e-ff23-4a9b-9546-2d149df6bced service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:57.262262 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7c4b6462-647e-4ec9-bb7e-52b8f267916a req-4d1db74e-ff23-4a9b-9546-2d149df6bced service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 1098 time: 0.0421307 Dec 09 22:14:57.358220 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c4b6462-647e-4ec9-bb7e-52b8f267916a req-d1099c2c-a4d7-449e-b6f1-64fac69f27ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:57.359665 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7c4b6462-647e-4ec9-bb7e-52b8f267916a req-d1099c2c-a4d7-449e-b6f1-64fac69f27ee service neutron] 10.222.0.10 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0899682 Dec 09 22:14:57.423185 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-95b1d657-5338-4ae2-b006-70c0b5dc7c65 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'ded53112-c89a-4a62-a1b4-d803c592f310', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'floating_ip_address': '172.25.3.185', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'port_id': '81af3eef-9e82-4452-afb5-98a928257d50', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 4083, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'mac_address': 'fa:16:3e:25:d0:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:08:04Z', 'updated_at': '2021-12-09T22:14:56Z', 'revision_number': 13, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:05Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:14:57.429557 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7c4b6462-647e-4ec9-bb7e-52b8f267916a req-4312dd59-3966-4599-8955-e6031488e799 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=81af3eef-9e82-4452-afb5-98a928257d50 HTTP/1.1" status: 200 len: 1001 time: 0.0625894 Dec 09 22:14:57.453539 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95b1d657-5338-4ae2-b006-70c0b5dc7c65 None None] Checking router: 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:14:57.462810 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95b1d657-5338-4ae2-b006-70c0b5dc7c65 None None] Routers {'7e861ee9-d29c-4ade-a3ab-cce44cba2c97'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:14:57.463418 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-95b1d657-5338-4ae2-b006-70c0b5dc7c65 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:14:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:14:57.480287 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c4b6462-647e-4ec9-bb7e-52b8f267916a req-4a8c1f17-b0dc-4eee-9efc-6d26555fc7f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:57.481781 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7c4b6462-647e-4ec9-bb7e-52b8f267916a req-4a8c1f17-b0dc-4eee-9efc-6d26555fc7f5 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0446966 Dec 09 22:14:57.530964 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c4b6462-647e-4ec9-bb7e-52b8f267916a req-59a3fbec-f0b1-4501-8750-9e8aa2cb10a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:14:57.532481 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7c4b6462-647e-4ec9-bb7e-52b8f267916a req-59a3fbec-f0b1-4501-8750-9e8aa2cb10a0 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0438845 Dec 09 22:14:57.571217 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-95b1d657-5338-4ae2-b006-70c0b5dc7c65 None None] Set router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:14:57.600555 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:57.622601 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7c4b6462-647e-4ec9-bb7e-52b8f267916a req-8938a28a-d404-40e8-bef6-57d1eeadf24d service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0827210 Dec 09 22:14:57.716784 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7c4b6462-647e-4ec9-bb7e-52b8f267916a req-ec1f3665-6a1c-4944-98cb-ebd38a968f84 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0871484 Dec 09 22:14:57.724802 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:14:57.798533 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-95b1d657-5338-4ae2-b006-70c0b5dc7c65 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'ded53112-c89a-4a62-a1b4-d803c592f310', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'floating_ip_address': '172.25.3.185', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'port_id': '81af3eef-9e82-4452-afb5-98a928257d50', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 4083, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'mac_address': 'fa:16:3e:25:d0:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:08:04Z', 'updated_at': '2021-12-09T22:14:56Z', 'revision_number': 13, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:05Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:14:57.828168 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95b1d657-5338-4ae2-b006-70c0b5dc7c65 None None] The sync data for ids ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'] in n-d-713301-27 is: [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'ded53112-c89a-4a62-a1b4-d803c592f310', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'floating_ip_address': '172.25.3.185', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'port_id': '81af3eef-9e82-4452-afb5-98a928257d50', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 4083, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'mac_address': 'fa:16:3e:25:d0:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:08:04Z', 'updated_at': '2021-12-09T22:14:56Z', 'revision_number': 13, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:05Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:14:58.023291 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-54ae8d22-1579-4885-9032-02eecdd7603b None None] New status for floating IP ded53112-c89a-4a62-a1b4-d803c592f310: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:15:03.022557 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9319fa4f-de5b-4398-90f8-422dc550a93a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:15:05.665067 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6260dfc-255b-46a5-b021-d7173317c6f8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:15:06.814660 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:15:08.167679 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:15:09.689007 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:15:12.251133 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:15:27.608382 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:15:27.730503 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:15:33.020511 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2b3a9b0a-b173-4395-a72d-f034c3af108b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:15:35.662535 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-af888dcc-931c-4bd4-a69e-deb8a10eaed5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:15:36.827394 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:15:38.169010 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:15:39.695805 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:15:49.256345 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:15:52.871103 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b110e66-e9ec-4b4b-a06c-6a7e5846078e req-c8325885-4183-4c91-bc6a-eeb750d0ecdf service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0838411 Dec 09 22:15:52.953822 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b110e66-e9ec-4b4b-a06c-6a7e5846078e req-d9370ad0-b889-48a2-b792-0280c9ecaf4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:15:52.955353 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b110e66-e9ec-4b4b-a06c-6a7e5846078e req-d9370ad0-b889-48a2-b792-0280c9ecaf4e service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 1098 time: 0.0418613 Dec 09 22:15:53.073462 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b110e66-e9ec-4b4b-a06c-6a7e5846078e req-1a267a2f-0120-4eb4-865a-67045b66d3b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:15:53.075032 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b110e66-e9ec-4b4b-a06c-6a7e5846078e req-1a267a2f-0120-4eb4-865a-67045b66d3b9 service neutron] 10.222.0.10 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0910528 Dec 09 22:15:53.141136 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b110e66-e9ec-4b4b-a06c-6a7e5846078e req-7d2b3e0f-8b32-434e-a8f6-8af1f17b03b9 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=81af3eef-9e82-4452-afb5-98a928257d50 HTTP/1.1" status: 200 len: 1003 time: 0.0590963 Dec 09 22:15:53.194463 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b110e66-e9ec-4b4b-a06c-6a7e5846078e req-87c3f562-6c55-4532-830c-caeb0e38bc17 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:15:53.195935 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b110e66-e9ec-4b4b-a06c-6a7e5846078e req-87c3f562-6c55-4532-830c-caeb0e38bc17 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0482314 Dec 09 22:15:53.242508 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b110e66-e9ec-4b4b-a06c-6a7e5846078e req-62d44c1a-3bb5-41c8-a7ab-528cb61d8200 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:15:53.243889 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b110e66-e9ec-4b4b-a06c-6a7e5846078e req-62d44c1a-3bb5-41c8-a7ab-528cb61d8200 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0403552 Dec 09 22:15:53.343727 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b110e66-e9ec-4b4b-a06c-6a7e5846078e req-fe686cd2-b59b-4c08-b332-f8908073809b service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0920594 Dec 09 22:15:53.437885 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3b110e66-e9ec-4b4b-a06c-6a7e5846078e req-b52e9537-ad7c-462d-9b02-d61a0c0f05b1 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0869429 Dec 09 22:15:57.601407 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:15:57.725573 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:16:03.022168 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3876496f-7eb3-4d02-8e05-6b2db34ab1f2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:16:05.668353 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8d6fcad2-5695-46eb-bb7f-814dabf66e23 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:16:06.822425 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:16:08.169997 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:16:09.689103 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:16:26.256628 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:16:27.605984 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:16:27.728352 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:16:33.018505 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-94c750e4-1f3c-4731-aa40-ef86133d6810 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:16:34.352520 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdefaf5f-717f-4b05-a96b-c80d3dd2fc43 req-2935b325-d144-4b18-9595-a2770fdf2aac tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:16:34.353939 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bdefaf5f-717f-4b05-a96b-c80d3dd2fc43 req-2935b325-d144-4b18-9595-a2770fdf2aac tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 946 time: 0.1052964 Dec 09 22:16:34.410455 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bdefaf5f-717f-4b05-a96b-c80d3dd2fc43 req-aaa644ae-021d-4e5b-8415-c9711f4c8a71 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470812 Dec 09 22:16:35.651880 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-51f1ec3e-384c-46b0-892f-fa4d88b3fa77 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:16:36.830774 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:16:38.176018 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:16:39.685924 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:16:45.559808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-d58a3717-7ff2-4e40-9b18-3c1e8ccb3ab8 req-edcf5e68-d570-41d3-a3f8-137028593ab2 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 22:16:45.560820 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d58a3717-7ff2-4e40-9b18-3c1e8ccb3ab8 req-edcf5e68-d570-41d3-a3f8-137028593ab2 service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0457625 Dec 09 22:16:45.763694 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-5ddee72d-2851-488f-841a-7124000af196 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0723932 Dec 09 22:16:45.775197 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e5d9272-2483-42df-b32e-d824bbd0b60a req-39121582-de69-47ab-9ce7-a867d700d3f2 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:16:45.776735 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e5d9272-2483-42df-b32e-d824bbd0b60a req-39121582-de69-47ab-9ce7-a867d700d3f2 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 946 time: 0.0773571 Dec 09 22:16:45.781547 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-c6c28db0-7967-46a1-8b52-07ebce4462ac service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 22:16:45.782488 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-c6c28db0-7967-46a1-8b52-07ebce4462ac service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0049131 Dec 09 22:16:45.830982 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6e5d9272-2483-42df-b32e-d824bbd0b60a req-df9988ad-c126-4818-8b0c-8cdae60f3598 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474997 Dec 09 22:16:46.967910 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e812a53a-90c7-49bb-b7ce-0dcedeb52893 req-f92ce468-cd4e-4a52-b85d-225f1a578eb2 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:16:46.969540 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e812a53a-90c7-49bb-b7ce-0dcedeb52893 req-f92ce468-cd4e-4a52-b85d-225f1a578eb2 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 946 time: 0.0579247 Dec 09 22:16:47.045599 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-343d3775-dd5e-466d-b15e-81a773458c10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:16:47.047136 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-343d3775-dd5e-466d-b15e-81a773458c10 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 1098 time: 0.0753901 Dec 09 22:16:47.050936 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e812a53a-90c7-49bb-b7ce-0dcedeb52893 req-975d3054-4a06-409b-9797-ed9fd98cb3dc tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0714495 Dec 09 22:16:47.142336 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-8f066c42-764e-47ac-81a7-6d6a9d141d23 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:16:47.143879 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-8f066c42-764e-47ac-81a7-6d6a9d141d23 service neutron] 10.222.0.10 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0888569 Dec 09 22:16:47.213762 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-1219fa74-9b27-45a1-b547-c68fa64d06f0 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=81af3eef-9e82-4452-afb5-98a928257d50 HTTP/1.1" status: 200 len: 1003 time: 0.0619543 Dec 09 22:16:47.273747 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-8d53f0a0-9dbb-4f38-b5c4-91103c3cc968 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:16:47.275720 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-8d53f0a0-9dbb-4f38-b5c4-91103c3cc968 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0538490 Dec 09 22:16:47.326966 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-613d920c-9285-495f-b6ee-c3a2de606593 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:16:47.329353 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-613d920c-9285-495f-b6ee-c3a2de606593 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0454667 Dec 09 22:16:47.425016 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-3e80f115-4409-4228-855e-8e9adb7a2384 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0879083 Dec 09 22:16:47.529415 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-45a9e98d-c5f2-4bb7-be24-e27947618b1a service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0967259 Dec 09 22:16:48.177912 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c93b7f5e-03ed-4b95-84b4-aa2d55ef512c req-67942993-feb7-47f5-84e7-e3246f112016 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:16:48.179464 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c93b7f5e-03ed-4b95-84b4-aa2d55ef512c req-67942993-feb7-47f5-84e7-e3246f112016 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 946 time: 0.0548010 Dec 09 22:16:48.229510 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c93b7f5e-03ed-4b95-84b4-aa2d55ef512c req-7a5851f8-e24e-4c9d-aee3-dfbcbfca3857 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434506 Dec 09 22:16:49.363686 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4918690-d3f4-4175-a947-99709eee95e8 req-a0e58a1f-cdfd-47ec-b573-de499c75fa90 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:16:49.365154 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c4918690-d3f4-4175-a947-99709eee95e8 req-a0e58a1f-cdfd-47ec-b573-de499c75fa90 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 946 time: 0.0545762 Dec 09 22:16:49.412866 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c4918690-d3f4-4175-a947-99709eee95e8 req-74f46b4e-a9cd-4f6a-ad85-82c457d75d98 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412989 Dec 09 22:16:50.553127 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22c11b50-5ac3-43db-9212-141d93a5bab8 req-020ab29b-a2b5-4c8a-b332-72dc019d01e7 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:16:50.554631 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22c11b50-5ac3-43db-9212-141d93a5bab8 req-020ab29b-a2b5-4c8a-b332-72dc019d01e7 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 946 time: 0.0601704 Dec 09 22:16:50.615071 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22c11b50-5ac3-43db-9212-141d93a5bab8 req-c0fddf1d-0139-416d-ba46-a4f4577172a5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0513537 Dec 09 22:16:51.746455 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6002d9dd-2abf-4f9c-b3b3-384b14149652 req-cc91fdb6-8d01-407f-9191-f28730b8dedc tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:16:51.747974 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6002d9dd-2abf-4f9c-b3b3-384b14149652 req-cc91fdb6-8d01-407f-9191-f28730b8dedc tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 946 time: 0.0522876 Dec 09 22:16:51.797637 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6002d9dd-2abf-4f9c-b3b3-384b14149652 req-5373a1ce-4d40-4784-be38-a0cdef0a89f3 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429821 Dec 09 22:16:52.920610 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-245addeb-398d-4985-8f4f-379b4213bd70 req-decc1c1e-9e64-44a2-b5bc-16bbc4330899 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:16:52.922107 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-245addeb-398d-4985-8f4f-379b4213bd70 req-decc1c1e-9e64-44a2-b5bc-16bbc4330899 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 946 time: 0.0530622 Dec 09 22:16:52.971194 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-245addeb-398d-4985-8f4f-379b4213bd70 req-bbb0c3b6-b086-4445-a008-0d5f3234bf25 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428791 Dec 09 22:16:54.128555 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8987069b-6bca-4f35-8414-e1542e6fd5c8 req-fa6a7ca5-05eb-4076-801a-dd2dc8c3de91 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:16:54.129995 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8987069b-6bca-4f35-8414-e1542e6fd5c8 req-fa6a7ca5-05eb-4076-801a-dd2dc8c3de91 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 946 time: 0.0695086 Dec 09 22:16:54.190094 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8987069b-6bca-4f35-8414-e1542e6fd5c8 req-12405193-d0f6-4666-adca-10f65f284e34 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0537295 Dec 09 22:16:54.817874 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6226388c-7176-4b15-b955-8960e2bf1da4 req-6c5eeee5-7f33-42f6-9f37-581728c18ce9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:16:54.819408 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6226388c-7176-4b15-b955-8960e2bf1da4 req-6c5eeee5-7f33-42f6-9f37-581728c18ce9 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 1098 time: 0.0432971 Dec 09 22:16:54.930758 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6226388c-7176-4b15-b955-8960e2bf1da4 req-169096ce-c9e0-48fb-a057-3d94e23b52c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:16:54.932266 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6226388c-7176-4b15-b955-8960e2bf1da4 req-169096ce-c9e0-48fb-a057-3d94e23b52c3 service neutron] 10.222.0.10 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0930517 Dec 09 22:16:55.000854 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6226388c-7176-4b15-b955-8960e2bf1da4 req-12c07565-6861-4688-8ac0-ea55c19cf679 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=81af3eef-9e82-4452-afb5-98a928257d50 HTTP/1.1" status: 200 len: 1003 time: 0.0597575 Dec 09 22:16:55.053603 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6226388c-7176-4b15-b955-8960e2bf1da4 req-06c8dc09-570e-40d9-967a-d8eb6eb471ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:16:55.055109 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6226388c-7176-4b15-b955-8960e2bf1da4 req-06c8dc09-570e-40d9-967a-d8eb6eb471ba service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0469363 Dec 09 22:16:55.107342 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6226388c-7176-4b15-b955-8960e2bf1da4 req-e097886d-eaaf-4cc2-ad75-12561f83d51a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:16:55.108782 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6226388c-7176-4b15-b955-8960e2bf1da4 req-e097886d-eaaf-4cc2-ad75-12561f83d51a service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0460477 Dec 09 22:16:55.197735 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6226388c-7176-4b15-b955-8960e2bf1da4 req-5c646e15-244b-495a-b120-672a96a9d764 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0813882 Dec 09 22:16:55.320113 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6226388c-7176-4b15-b955-8960e2bf1da4 req-56df026f-9387-4608-ae7a-a811801ce6d3 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1150537 Dec 09 22:16:55.337639 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce1387cd-5d7e-4ac2-8991-fc6a9fddd7af req-16cbde50-ebce-4a7d-9dfe-7dc25b229f6b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:16:55.339318 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ce1387cd-5d7e-4ac2-8991-fc6a9fddd7af req-16cbde50-ebce-4a7d-9dfe-7dc25b229f6b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 946 time: 0.0703442 Dec 09 22:16:55.387110 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ce1387cd-5d7e-4ac2-8991-fc6a9fddd7af req-dc67c9c9-2c2d-4992-95fa-39b54e5bc720 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412118 Dec 09 22:16:56.519686 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11633f84-c321-44e4-85ec-f5fffebd6e25 req-d84d7812-ba09-48a4-8bbc-56a49ea04fb5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:16:56.521164 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11633f84-c321-44e4-85ec-f5fffebd6e25 req-d84d7812-ba09-48a4-8bbc-56a49ea04fb5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 946 time: 0.0540190 Dec 09 22:16:56.574029 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-11633f84-c321-44e4-85ec-f5fffebd6e25 req-eb59e110-0b9f-42b2-9c0c-77e767ebaa22 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465207 Dec 09 22:16:57.609221 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:16:57.704538 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6fb22b5-b2bc-4099-98ff-d8521f910895 req-0c0351ca-632d-4daf-85b7-c603ca633f72 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:16:57.706058 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6fb22b5-b2bc-4099-98ff-d8521f910895 req-0c0351ca-632d-4daf-85b7-c603ca633f72 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 946 time: 0.0568018 Dec 09 22:16:57.720252 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:16:57.756404 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6fb22b5-b2bc-4099-98ff-d8521f910895 req-4aa52a9d-8d8c-4c65-843a-29cb429ad5a0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437083 Dec 09 22:16:58.883619 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35a1c685-6731-40a7-b421-c3e628a2ba2d req-30d31216-b887-4cbb-b584-69d4a4db16fa tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:16:58.885086 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35a1c685-6731-40a7-b421-c3e628a2ba2d req-30d31216-b887-4cbb-b584-69d4a4db16fa tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 946 time: 0.0508842 Dec 09 22:16:58.935554 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35a1c685-6731-40a7-b421-c3e628a2ba2d req-f36fae60-b1d6-4576-93b0-b23686543fe9 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442309 Dec 09 22:17:00.061499 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-573648fd-d417-4c76-94c0-2f9f008fc1d8 req-f839a590-8c66-455c-be94-5638f3c11d8b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:00.063041 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-573648fd-d417-4c76-94c0-2f9f008fc1d8 req-f839a590-8c66-455c-be94-5638f3c11d8b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 946 time: 0.0541098 Dec 09 22:17:00.113128 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-573648fd-d417-4c76-94c0-2f9f008fc1d8 req-abe802d8-e31c-400b-86b1-f173acff6415 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437188 Dec 09 22:17:01.236023 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f116dd1-9608-418e-985a-0ed39fab7634 req-189c1200-b2b0-48f3-9122-aed4a0a6011a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:01.237573 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0f116dd1-9608-418e-985a-0ed39fab7634 req-189c1200-b2b0-48f3-9122-aed4a0a6011a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 946 time: 0.0506604 Dec 09 22:17:01.288580 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0f116dd1-9608-418e-985a-0ed39fab7634 req-d6b9322d-87a9-48a8-921f-506f95d7d93e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448222 Dec 09 22:17:01.498439 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-9e205d05-ebc3-4f87-a125-2f89a43222f4 service neutron] show failed (client error): The resource could not be found. Dec 09 22:17:01.499465 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-9e205d05-ebc3-4f87-a125-2f89a43222f4 service neutron] 10.222.0.10 "GET /v2.0/ports/81af3eef-9e82-4452-afb5-98a928257d50/bindings/n-h1-713301-27 HTTP/1.1" status: 404 len: 381 time: 0.0609505 Dec 09 22:17:01.853963 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-f49f6278-c6ce-4567-bd7d-ea96b710e06c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:01.855540 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-f49f6278-c6ce-4567-bd7d-ea96b710e06c service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c&tenant_id=ecd32dac944041b58de1a396ec18cd2c HTTP/1.1" status: 200 len: 1098 time: 0.0845470 Dec 09 22:17:01.868115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Request body: {'port': {'binding:host_id': 'n-h1-713301-27', 'device_owner': 'compute:nova'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:17:01.926830 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:02.132395 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] For port 81af3eef-9e82-4452-afb5-98a928257d50, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=81af3eef-9e82-4452-afb5-98a928257d50,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:17:02.165886 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] For port 81af3eef-9e82-4452-afb5-98a928257d50, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:17:02.206291 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '81af3eef-9e82-4452-afb5-98a928257d50'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:17:02.211275 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:02.225255 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Transition to ACTIVE for port object 81af3eef-9e82-4452-afb5-98a928257d50 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:17:02.230353 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:02.262124 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-71389a5e-8a5f-4d6e-80ea-93679d7d7786" -d '{"events": [{"server_uuid": "40d085f5-12ba-4993-bdbd-d75dd187516c", "name": "network-vif-unplugged", "status": "completed", "tag": "81af3eef-9e82-4452-afb5-98a928257d50"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:17:02.321710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Pushing event updated for resources: {'Port': ['ID=81af3eef-9e82-4452-afb5-98a928257d50,revision_number=6']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:17:02.334496 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:02.334851 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:02.335198 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:02.335568 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:02.335973 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:02.336241 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:02.336569 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:02.336895 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:02.337222 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:02.337548 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:02.337874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:02.338249 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:02.338763 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:02.383528 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 22:17:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-25cfac58-f6f9-4265-80d2-6f3141082e3b x-openstack-request-id: req-25cfac58-f6f9-4265-80d2-6f3141082e3b {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:17:02.383828 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "40d085f5-12ba-4993-bdbd-d75dd187516c", "name": "network-vif-unplugged", "status": "completed", "tag": "81af3eef-9e82-4452-afb5-98a928257d50", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:17:02.384084 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-25cfac58-f6f9-4265-80d2-6f3141082e3b {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:17:02.384492 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '81af3eef-9e82-4452-afb5-98a928257d50', 'code': 200} Dec 09 22:17:02.386133 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] No DVR routers for this DVR port 81af3eef-9e82-4452-afb5-98a928257d50 on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:17:02.475492 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a6637d1-675d-4a0f-94e9-5e1fe9f29461 req-74409ec3-7b4b-4e34-9b9f-1db6e8730c71 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:02.477645 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5a6637d1-675d-4a0f-94e9-5e1fe9f29461 req-74409ec3-7b4b-4e34-9b9f-1db6e8730c71 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 944 time: 0.0527108 Dec 09 22:17:02.525887 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5a6637d1-675d-4a0f-94e9-5e1fe9f29461 req-cd4600f9-e264-41ab-8b32-710098673493 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419993 Dec 09 22:17:02.527072 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Attempting to bind port 81af3eef-9e82-4452-afb5-98a928257d50 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:17:02.527411 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Attempting to bind port 81af3eef-9e82-4452-afb5-98a928257d50 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:17:02.527771 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Attempting to bind port 81af3eef-9e82-4452-afb5-98a928257d50 on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:17:02.533971 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Port 81af3eef-9e82-4452-afb5-98a928257d50 on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:17:02.534273 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Attempting to bind port 81af3eef-9e82-4452-afb5-98a928257d50 on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:17:02.539393 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 16, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:17:02.539771 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Checking segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:17:02.540155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Bound using segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:17:02.540580 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Bound port: 81af3eef-9e82-4452-afb5-98a928257d50, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:17:02.540945 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:02.606001 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] For port 81af3eef-9e82-4452-afb5-98a928257d50, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:17:02.609046 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] For port 81af3eef-9e82-4452-afb5-98a928257d50, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=81af3eef-9e82-4452-afb5-98a928257d50,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:17:02.614447 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:02.647939 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:02.648565 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:02.649978 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] 10.222.0.31 "PUT /v2.0/ports/81af3eef-9e82-4452-afb5-98a928257d50 HTTP/1.1" status: 200 len: 1093 time: 0.7860641 Dec 09 22:17:02.670382 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2d91414-4008-4c74-9f32-73d2039f8ae2 service neutron] Pushing event updated for resources: {'Port': ['ID=81af3eef-9e82-4452-afb5-98a928257d50,revision_number=7']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:17:02.717442 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-8fbbcfd1-a632-4f99-a502-0dd9e8e28b44 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:02.718983 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-8fbbcfd1-a632-4f99-a502-0dd9e8e28b44 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 1096 time: 0.0447710 Dec 09 22:17:02.821645 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-fef3f839-f67c-4904-a34b-87902334adbb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:02.823241 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-fef3f839-f67c-4904-a34b-87902334adbb service neutron] 10.222.0.31 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0966039 Dec 09 22:17:02.891700 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-9be07e9f-cd9a-4e35-9f86-22b81a5a51b8 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=81af3eef-9e82-4452-afb5-98a928257d50 HTTP/1.1" status: 200 len: 1001 time: 0.0604014 Dec 09 22:17:02.943157 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-f789843d-704c-4862-b44e-3f0c82d575dd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:02.944622 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-f789843d-704c-4862-b44e-3f0c82d575dd service neutron] 10.222.0.31 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0460527 Dec 09 22:17:02.996123 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-bc8d34b5-ea18-4a1b-9ec6-81699696734f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:02.998007 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-bc8d34b5-ea18-4a1b-9ec6-81699696734f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0453796 Dec 09 22:17:03.013764 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2fcc91d6-2e80-4959-a46c-7ad92d986455 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:03.099394 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-f6554bf6-1f10-43e9-baa3-ce9493136182 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0934486 Dec 09 22:17:03.196044 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-784ae689-5f41-43a6-95d6-25d57f8ac2a1 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0890932 Dec 09 22:17:03.256232 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:17:03.646067 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3202986d-e681-4b27-a7e1-b4fb5ff780d1 req-adcbb443-14b3-494e-8479-6bd2bfd41425 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:03.647637 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3202986d-e681-4b27-a7e1-b4fb5ff780d1 req-adcbb443-14b3-494e-8479-6bd2bfd41425 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 944 time: 0.0500703 Dec 09 22:17:03.695775 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3202986d-e681-4b27-a7e1-b4fb5ff780d1 req-2bd782ad-f651-445b-8204-acbcc67f86ee tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420108 Dec 09 22:17:04.385917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'tag': '81af3eef-9e82-4452-afb5-98a928257d50'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:17:04.389249 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6f4949ea-ea04-4f1c-b2bb-f68f19d0dcda" -d '{"events": [{"name": "network-changed", "server_uuid": "40d085f5-12ba-4993-bdbd-d75dd187516c", "tag": "81af3eef-9e82-4452-afb5-98a928257d50"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:17:04.440318 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:17:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5bfd65ad-1709-4555-b57c-dbe009b0934e x-openstack-request-id: req-5bfd65ad-1709-4555-b57c-dbe009b0934e {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:17:04.440611 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "40d085f5-12ba-4993-bdbd-d75dd187516c", "tag": "81af3eef-9e82-4452-afb5-98a928257d50", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:17:04.440835 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-5bfd65ad-1709-4555-b57c-dbe009b0934e {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:17:04.441244 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'tag': '81af3eef-9e82-4452-afb5-98a928257d50', 'status': 'completed', 'code': 200} Dec 09 22:17:04.506643 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f4949ea-ea04-4f1c-b2bb-f68f19d0dcda req-c65f2521-507a-48e6-947e-b79269aaa768 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:04.508219 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f4949ea-ea04-4f1c-b2bb-f68f19d0dcda req-c65f2521-507a-48e6-947e-b79269aaa768 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 1096 time: 0.0452342 Dec 09 22:17:04.509256 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f4949ea-ea04-4f1c-b2bb-f68f19d0dcda req-570853cc-eb98-462d-b2ab-d5db1597447c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:04.510738 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f4949ea-ea04-4f1c-b2bb-f68f19d0dcda req-570853cc-eb98-462d-b2ab-d5db1597447c service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 1096 time: 0.0466199 Dec 09 22:17:04.590287 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 81af3eef-9e82-4452-afb5-98a928257d50 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:17:04.604636 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f4949ea-ea04-4f1c-b2bb-f68f19d0dcda req-14daed52-38b5-4e6c-9531-eeac5c83dbda service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:04.604872 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f4949ea-ea04-4f1c-b2bb-f68f19d0dcda req-2ca2a1b5-888c-454d-bb6c-5ccae40468ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:04.606132 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f4949ea-ea04-4f1c-b2bb-f68f19d0dcda req-14daed52-38b5-4e6c-9531-eeac5c83dbda service neutron] 10.222.0.31 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0900738 Dec 09 22:17:04.606268 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f4949ea-ea04-4f1c-b2bb-f68f19d0dcda req-2ca2a1b5-888c-454d-bb6c-5ccae40468ef service neutron] 10.222.0.10 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0885117 Dec 09 22:17:04.645461 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 81af3eef-9e82-4452-afb5-98a928257d50 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:17:04.679280 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f4949ea-ea04-4f1c-b2bb-f68f19d0dcda req-2ec398d5-0593-4777-a018-c4ba44a03f71 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=81af3eef-9e82-4452-afb5-98a928257d50 HTTP/1.1" status: 200 len: 1001 time: 0.0658643 Dec 09 22:17:04.681482 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f4949ea-ea04-4f1c-b2bb-f68f19d0dcda req-5adc874f-e623-4776-8c1b-63bf21703d5a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=81af3eef-9e82-4452-afb5-98a928257d50 HTTP/1.1" status: 200 len: 1001 time: 0.0673332 Dec 09 22:17:04.737148 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f4949ea-ea04-4f1c-b2bb-f68f19d0dcda req-ac670339-7acf-45ed-98e6-fe049f6038eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:04.737262 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f4949ea-ea04-4f1c-b2bb-f68f19d0dcda req-dc7ae4fe-965e-4015-b7b2-3e56203cf44f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:04.738211 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f4949ea-ea04-4f1c-b2bb-f68f19d0dcda req-ac670339-7acf-45ed-98e6-fe049f6038eb service neutron] 10.222.0.31 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0514798 Dec 09 22:17:04.738335 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f4949ea-ea04-4f1c-b2bb-f68f19d0dcda req-dc7ae4fe-965e-4015-b7b2-3e56203cf44f service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0484021 Dec 09 22:17:04.797265 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f4949ea-ea04-4f1c-b2bb-f68f19d0dcda req-afab771f-e85e-4737-85de-4a3a8d563ea9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:04.798772 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f4949ea-ea04-4f1c-b2bb-f68f19d0dcda req-afab771f-e85e-4737-85de-4a3a8d563ea9 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0525947 Dec 09 22:17:04.802616 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f4949ea-ea04-4f1c-b2bb-f68f19d0dcda req-9abe8dbd-5764-452e-bc1e-1ac442eb4c2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:04.804255 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f4949ea-ea04-4f1c-b2bb-f68f19d0dcda req-9abe8dbd-5764-452e-bc1e-1ac442eb4c2a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0569458 Dec 09 22:17:04.908388 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-393ad513-51ce-4ba0-8cc6-7df0aca359fc req-1766496c-bc25-4998-b525-87f0b6c5ef78 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:04.908857 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f4949ea-ea04-4f1c-b2bb-f68f19d0dcda req-a7bfeeba-924f-4213-9aac-4760eaf1d186 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0964203 Dec 09 22:17:04.909810 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-393ad513-51ce-4ba0-8cc6-7df0aca359fc req-1766496c-bc25-4998-b525-87f0b6c5ef78 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 944 time: 0.1153398 Dec 09 22:17:04.943221 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f4949ea-ea04-4f1c-b2bb-f68f19d0dcda req-6918b9cb-f927-4c41-afbc-07cbd62294de service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1357095 Dec 09 22:17:04.971484 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-393ad513-51ce-4ba0-8cc6-7df0aca359fc req-88d41ba8-6fc6-472d-899d-56af5a517fed tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0552292 Dec 09 22:17:05.009186 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-6f4949ea-ea04-4f1c-b2bb-f68f19d0dcda req-46fee2ea-d9f5-46f6-a799-f3a42fb3c57f service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0934393 Dec 09 22:17:05.083739 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f4949ea-ea04-4f1c-b2bb-f68f19d0dcda req-5a807087-e9d3-49d3-bdc6-60c186df3fa3 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1105237 Dec 09 22:17:05.657784 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c2c0d54d-0f8a-48cd-8108-4eea79b39bfe None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:05.728899 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf29a4f7-03e1-483c-92fe-677a5e6d71d6 req-d011dd2c-7cc6-43af-aa78-29a212a15719 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:05.730557 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cf29a4f7-03e1-483c-92fe-677a5e6d71d6 req-d011dd2c-7cc6-43af-aa78-29a212a15719 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 1096 time: 0.0430956 Dec 09 22:17:05.839851 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf29a4f7-03e1-483c-92fe-677a5e6d71d6 req-6a72ec1d-64fc-493b-a920-f0ff867dba36 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:05.841365 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cf29a4f7-03e1-483c-92fe-677a5e6d71d6 req-6a72ec1d-64fc-493b-a920-f0ff867dba36 service neutron] 10.222.0.31 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0901904 Dec 09 22:17:06.113991 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-375ca8e2-3f94-418c-8ce9-68563c487bb9 req-436acb45-f0fa-4864-bfbd-b85814bd762a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:06.115669 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-375ca8e2-3f94-418c-8ce9-68563c487bb9 req-436acb45-f0fa-4864-bfbd-b85814bd762a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 944 time: 0.0532823 Dec 09 22:17:06.166036 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-375ca8e2-3f94-418c-8ce9-68563c487bb9 req-00199abc-8e9a-45d3-9fc6-79c1acf6efea tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438385 Dec 09 22:17:06.260081 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cf29a4f7-03e1-483c-92fe-677a5e6d71d6 req-924ca405-9136-4232-98a3-a6df2fb29f73 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=81af3eef-9e82-4452-afb5-98a928257d50 HTTP/1.1" status: 200 len: 1001 time: 0.4108450 Dec 09 22:17:06.308292 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf29a4f7-03e1-483c-92fe-677a5e6d71d6 req-297aec37-b5af-460c-92a8-054f64711fd5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:06.309785 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cf29a4f7-03e1-483c-92fe-677a5e6d71d6 req-297aec37-b5af-460c-92a8-054f64711fd5 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0432694 Dec 09 22:17:06.361259 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf29a4f7-03e1-483c-92fe-677a5e6d71d6 req-13d6f0e4-fc87-4adc-8328-bf2f8bc7b575 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:06.362756 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cf29a4f7-03e1-483c-92fe-677a5e6d71d6 req-13d6f0e4-fc87-4adc-8328-bf2f8bc7b575 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0449593 Dec 09 22:17:06.456758 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cf29a4f7-03e1-483c-92fe-677a5e6d71d6 req-0ef56535-1404-4bc8-a220-c2e10403adf8 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0870752 Dec 09 22:17:06.553965 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cf29a4f7-03e1-483c-92fe-677a5e6d71d6 req-92ad378d-e26e-41fb-a5a9-1f8b008f423f service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0905948 Dec 09 22:17:06.841451 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:07.299598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1499ceb-be1f-4864-a8eb-237a817c575f req-fd911e9c-7f36-4516-a378-fcff581a8899 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:07.301176 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c1499ceb-be1f-4864-a8eb-237a817c575f req-fd911e9c-7f36-4516-a378-fcff581a8899 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 944 time: 0.0575368 Dec 09 22:17:07.352983 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c1499ceb-be1f-4864-a8eb-237a817c575f req-f059d062-37c2-4a1b-9c6e-c495779e5965 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449083 Dec 09 22:17:08.169092 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:08.486924 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7da42c3-3a7b-442e-9f58-a59efbffc515 req-d471e6b4-4150-4c3d-a28a-e2bd692eb151 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:08.488432 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a7da42c3-3a7b-442e-9f58-a59efbffc515 req-d471e6b4-4150-4c3d-a28a-e2bd692eb151 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 944 time: 0.0503721 Dec 09 22:17:08.541850 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a7da42c3-3a7b-442e-9f58-a59efbffc515 req-226e88be-c128-4ee1-90dd-0d78ac7cc7e6 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445025 Dec 09 22:17:09.681210 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:09.689696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2325caec-e735-4a17-8094-3be06a8de3a8 req-cd856044-f861-4396-8a68-abca0fb90261 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:09.691212 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2325caec-e735-4a17-8094-3be06a8de3a8 req-cd856044-f861-4396-8a68-abca0fb90261 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 944 time: 0.0597394 Dec 09 22:17:09.747227 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2325caec-e735-4a17-8094-3be06a8de3a8 req-bc7f6a0b-98bb-4d1e-980a-bbb2f72f3e4d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0479009 Dec 09 22:17:10.890726 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f665b14-0f8d-4a67-a89e-0b786f08847f req-222b9bfe-dad8-4ed4-be04-df2f6599c42c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:10.892381 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f665b14-0f8d-4a67-a89e-0b786f08847f req-222b9bfe-dad8-4ed4-be04-df2f6599c42c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 944 time: 0.0600657 Dec 09 22:17:10.942826 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f665b14-0f8d-4a67-a89e-0b786f08847f req-32f77d64-f635-4a7d-9159-9279c4db4bc0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415161 Dec 09 22:17:12.072447 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a9c9914-b670-4063-b98c-3adbd7895c11 req-f381da3a-e508-4904-b439-a1e75f2e305a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:12.073946 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a9c9914-b670-4063-b98c-3adbd7895c11 req-f381da3a-e508-4904-b439-a1e75f2e305a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 944 time: 0.0547969 Dec 09 22:17:12.125993 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a9c9914-b670-4063-b98c-3adbd7895c11 req-1c97f3fc-5006-4e78-ac4e-2bfcb5ad5d95 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432277 Dec 09 22:17:13.272054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4745c59-dc53-4f8d-8de6-b31cc41fc56c req-6a7bdf2a-f9df-427d-bb64-8992fb65516f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:13.273537 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d4745c59-dc53-4f8d-8de6-b31cc41fc56c req-6a7bdf2a-f9df-427d-bb64-8992fb65516f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 944 time: 0.0598936 Dec 09 22:17:13.326658 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d4745c59-dc53-4f8d-8de6-b31cc41fc56c req-88178487-b04e-4c22-9ba2-0f7addc61565 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439553 Dec 09 22:17:14.477894 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8ad935d-cef2-4783-a952-8a0bf3d57bce req-cf3ad53b-33f0-4743-aea4-b890b2853fb6 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:14.479374 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8ad935d-cef2-4783-a952-8a0bf3d57bce req-cf3ad53b-33f0-4743-aea4-b890b2853fb6 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 944 time: 0.0697706 Dec 09 22:17:14.527649 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8ad935d-cef2-4783-a952-8a0bf3d57bce req-263c2c21-e305-4a15-bcdf-bac22c8f95bd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420182 Dec 09 22:17:15.665028 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87f39aee-c33a-4893-adfd-ef1686f0378f req-a1c2fa16-fbc1-43a9-ad02-38619d4b816a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:15.666736 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-87f39aee-c33a-4893-adfd-ef1686f0378f req-a1c2fa16-fbc1-43a9-ad02-38619d4b816a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 944 time: 0.0515134 Dec 09 22:17:15.722113 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-87f39aee-c33a-4893-adfd-ef1686f0378f req-fb8ca47c-6f7f-4ee0-9ac0-c2e9d34ee47a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0487175 Dec 09 22:17:16.739832 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 81af3eef-9e82-4452-afb5-98a928257d50 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:17:16.843597 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 81af3eef-9e82-4452-afb5-98a928257d50, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=81af3eef-9e82-4452-afb5-98a928257d50,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:17:16.846294 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a30fbe0c-bb43-4b92-91dd-041073cc5b12 req-0320ef47-9d93-45c7-ab7f-4d79a8f0881e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:16.848209 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a30fbe0c-bb43-4b92-91dd-041073cc5b12 req-0320ef47-9d93-45c7-ab7f-4d79a8f0881e tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 944 time: 0.0501542 Dec 09 22:17:16.855312 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '81af3eef-9e82-4452-afb5-98a928257d50', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'port_id': '81af3eef-9e82-4452-afb5-98a928257d50', 'mac_address': 'fa:16:3e:25:d0:20', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:17:16.892806 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:16.896119 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a30fbe0c-bb43-4b92-91dd-041073cc5b12 req-7be492c2-ec63-4d82-9bb1-d39d030ce6ae tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416009 Dec 09 22:17:16.906355 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 81af3eef-9e82-4452-afb5-98a928257d50 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:17:16.931060 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 81af3eef-9e82-4452-afb5-98a928257d50, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=81af3eef-9e82-4452-afb5-98a928257d50,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:17:16.936555 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:16.983832 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=81af3eef-9e82-4452-afb5-98a928257d50,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:17:16.991513 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:16.991825 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:16.992172 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:16.992509 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:16.992870 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:16.993203 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:16.993558 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:16.994003 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:16.994314 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:16.994652 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:16.994976 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:16.995299 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:16.995649 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:17.166526 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['81af3eef-9e82-4452-afb5-98a928257d50'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:17:17.213282 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-5d45a9db-705e-47e7-9413-27656ef9a047 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:17.215546 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-5d45a9db-705e-47e7-9413-27656ef9a047 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.31 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c&tenant_id=ecd32dac944041b58de1a396ec18cd2c&binding%3Ahost_id=n-h1-713301-27 HTTP/1.1" status: 200 len: 945 time: 0.0580227 Dec 09 22:17:17.233263 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8cea872-7ce9-40f9-9264-fb8268ccb348 req-be451c77-64e2-4152-922d-253983e6ec35 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:17.234954 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8cea872-7ce9-40f9-9264-fb8268ccb348 req-be451c77-64e2-4152-922d-253983e6ec35 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 945 time: 0.0521860 Dec 09 22:17:17.283114 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-2ae7add7-ec16-4a87-b653-2d8526e909ff service neutron] 10.222.0.31 "GET /v2.0/ports/81af3eef-9e82-4452-afb5-98a928257d50/bindings/n-h1-713301-27 HTTP/1.1" status: 200 len: 383 time: 0.0564406 Dec 09 22:17:17.284175 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8cea872-7ce9-40f9-9264-fb8268ccb348 req-0ff4fc53-7c52-48da-8c2e-1d8f0232a0d5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424881 Dec 09 22:17:17.346393 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-2104acab-41af-4c3c-945f-22fe080d5303 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:17.348380 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-2104acab-41af-4c3c-945f-22fe080d5303 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 1097 time: 0.0413098 Dec 09 22:17:17.443654 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-d077b1ec-b1a1-43cf-8331-b6f7b1c445dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:17.445201 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-d077b1ec-b1a1-43cf-8331-b6f7b1c445dc service neutron] 10.222.0.31 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0891089 Dec 09 22:17:17.517252 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-2523b776-5c98-4a38-9f45-4d0c7d5d4df1 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=81af3eef-9e82-4452-afb5-98a928257d50 HTTP/1.1" status: 200 len: 1002 time: 0.0645964 Dec 09 22:17:17.568944 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-68939d81-d539-4c02-bb3e-98f48a427308 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:17.570287 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-68939d81-d539-4c02-bb3e-98f48a427308 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0448313 Dec 09 22:17:17.616363 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-31ef19f3-330d-4515-a87f-c6ff753dae82 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:17.617832 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-31ef19f3-330d-4515-a87f-c6ff753dae82 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0398338 Dec 09 22:17:17.715810 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-fa09df65-c840-43c6-bbcf-436a8defdc81 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0902910 Dec 09 22:17:17.807326 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-056b6d88-a004-462d-bee9-83a1a725f977 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0838554 Dec 09 22:17:18.423384 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6f5e7e3-d5f7-47bd-91f9-80f7f2fd7e9c req-4553cd3d-9f4a-4b62-bb9e-dc03af844df5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:18.425439 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6f5e7e3-d5f7-47bd-91f9-80f7f2fd7e9c req-4553cd3d-9f4a-4b62-bb9e-dc03af844df5 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 945 time: 0.0589063 Dec 09 22:17:18.473644 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6f5e7e3-d5f7-47bd-91f9-80f7f2fd7e9c req-9b592a0b-99c7-4472-af8d-93ba731a7dcd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421450 Dec 09 22:17:18.759476 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 81af3eef-9e82-4452-afb5-98a928257d50 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:17:18.821027 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 81af3eef-9e82-4452-afb5-98a928257d50 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:17:18.825036 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 81af3eef-9e82-4452-afb5-98a928257d50 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:17:18.825307 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:18.907216 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:18.930094 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '81af3eef-9e82-4452-afb5-98a928257d50'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:17:18.947113 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 81af3eef-9e82-4452-afb5-98a928257d50, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=81af3eef-9e82-4452-afb5-98a928257d50,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:17:18.953823 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:18.978180 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-649c3836-d814-4e3a-be59-d7d3f1df6014" -d '{"events": [{"server_uuid": "40d085f5-12ba-4993-bdbd-d75dd187516c", "name": "network-vif-plugged", "status": "completed", "tag": "81af3eef-9e82-4452-afb5-98a928257d50"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:17:19.006027 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=81af3eef-9e82-4452-afb5-98a928257d50,revision_number=9']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:17:19.081781 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:17:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-261bd29a-8781-4111-9cbb-a3cd2ae952d0 x-openstack-request-id: req-261bd29a-8781-4111-9cbb-a3cd2ae952d0 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:17:19.082061 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "40d085f5-12ba-4993-bdbd-d75dd187516c", "name": "network-vif-plugged", "status": "completed", "tag": "81af3eef-9e82-4452-afb5-98a928257d50", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:17:19.082337 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-261bd29a-8781-4111-9cbb-a3cd2ae952d0 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:17:19.082743 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '81af3eef-9e82-4452-afb5-98a928257d50', 'code': 200} Dec 09 22:17:19.606221 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-736d2525-2ac5-4a4b-95df-00d07cc13ae1 req-74ea01aa-99b8-482b-ab2d-8672afe4b30d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:19.607799 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-736d2525-2ac5-4a4b-95df-00d07cc13ae1 req-74ea01aa-99b8-482b-ab2d-8672afe4b30d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 946 time: 0.0500741 Dec 09 22:17:19.654501 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-736d2525-2ac5-4a4b-95df-00d07cc13ae1 req-d538fa1f-6bd8-4ca1-80ee-874048c30c3c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405614 Dec 09 22:17:20.780206 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e60e3ad-226c-44f1-91a7-7201e5a5ebc9 req-17f50bc5-adf5-4806-b90a-5c4408697b2c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:20.781715 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e60e3ad-226c-44f1-91a7-7201e5a5ebc9 req-17f50bc5-adf5-4806-b90a-5c4408697b2c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 946 time: 0.0546100 Dec 09 22:17:20.831070 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e60e3ad-226c-44f1-91a7-7201e5a5ebc9 req-2017c523-8102-4faa-9aa3-5dd526e4a6f2 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430079 Dec 09 22:17:21.947167 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-3834d08b-b4d7-4574-bd77-58a3881ba5a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:21.948738 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-3834d08b-b4d7-4574-bd77-58a3881ba5a6 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c&tenant_id=ecd32dac944041b58de1a396ec18cd2c HTTP/1.1" status: 200 len: 1098 time: 0.0706654 Dec 09 22:17:21.961978 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Request body: {'port': {'binding:host_id': 'n-h2-713301-27', 'device_owner': 'compute:nova'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:17:21.971299 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7e34c7c-c458-43b6-98e9-2a2d3f43fb2a req-c1290f84-3cbd-488b-99b1-6631729e4045 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:21.973029 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d7e34c7c-c458-43b6-98e9-2a2d3f43fb2a req-c1290f84-3cbd-488b-99b1-6631729e4045 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 946 time: 0.0646133 Dec 09 22:17:22.054330 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:22.068917 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d7e34c7c-c458-43b6-98e9-2a2d3f43fb2a req-0e937b44-6f24-4579-8c93-db2fa0025b9f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0794475 Dec 09 22:17:22.274898 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] For port 81af3eef-9e82-4452-afb5-98a928257d50, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=81af3eef-9e82-4452-afb5-98a928257d50,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:17:22.308952 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] For port 81af3eef-9e82-4452-afb5-98a928257d50, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:17:22.348837 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '81af3eef-9e82-4452-afb5-98a928257d50'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:17:22.354265 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:22.366946 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Transition to ACTIVE for port object 81af3eef-9e82-4452-afb5-98a928257d50 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:17:22.372184 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:22.403826 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0cd7d9cd-94af-4ea8-9b37-258b10ff7786" -d '{"events": [{"server_uuid": "40d085f5-12ba-4993-bdbd-d75dd187516c", "name": "network-vif-unplugged", "status": "completed", "tag": "81af3eef-9e82-4452-afb5-98a928257d50"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:17:22.484271 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Pushing event updated for resources: {'Port': ['ID=81af3eef-9e82-4452-afb5-98a928257d50,revision_number=10']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:17:22.506850 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:22.507327 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:22.507942 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:22.508543 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:22.509118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:22.509582 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:22.509923 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:22.510254 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:22.510583 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:22.510911 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:22.511327 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:22.511576 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:22.511994 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:17:22.530638 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 22:17:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-574e6fe4-d863-4419-bbaf-5540e0799b7e x-openstack-request-id: req-574e6fe4-d863-4419-bbaf-5540e0799b7e {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:17:22.531029 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "40d085f5-12ba-4993-bdbd-d75dd187516c", "name": "network-vif-unplugged", "status": "completed", "tag": "81af3eef-9e82-4452-afb5-98a928257d50", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:17:22.531353 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-574e6fe4-d863-4419-bbaf-5540e0799b7e {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:17:22.531896 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '81af3eef-9e82-4452-afb5-98a928257d50', 'code': 200} Dec 09 22:17:22.591295 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] No DVR routers for this DVR port 81af3eef-9e82-4452-afb5-98a928257d50 on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:17:22.764292 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 81af3eef-9e82-4452-afb5-98a928257d50 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:17:22.814977 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 81af3eef-9e82-4452-afb5-98a928257d50 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:17:23.023907 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Attempting to bind port 81af3eef-9e82-4452-afb5-98a928257d50 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:17:23.024550 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Attempting to bind port 81af3eef-9e82-4452-afb5-98a928257d50 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:17:23.024550 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Attempting to bind port 81af3eef-9e82-4452-afb5-98a928257d50 on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:17:23.029377 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Port 81af3eef-9e82-4452-afb5-98a928257d50 on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:17:23.029699 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Attempting to bind port 81af3eef-9e82-4452-afb5-98a928257d50 on network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:17:23.034660 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 16, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:17:23.035005 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Checking segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:17:23.035407 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Bound using segment: {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:17:23.035949 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Bound port: 81af3eef-9e82-4452-afb5-98a928257d50, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a7afa2ad-9134-4da5-a606-e7c776822e63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 149, 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:17:23.036308 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:23.099714 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] For port 81af3eef-9e82-4452-afb5-98a928257d50, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:17:23.103377 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] For port 81af3eef-9e82-4452-afb5-98a928257d50, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=81af3eef-9e82-4452-afb5-98a928257d50,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:17:23.109829 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:23.145042 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:23.145737 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:23.147144 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] 10.222.0.10 "PUT /v2.0/ports/81af3eef-9e82-4452-afb5-98a928257d50 HTTP/1.1" status: 200 len: 1094 time: 1.1892352 Dec 09 22:17:23.219944 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b780ed1-4cc1-4cd3-8716-0d091175d757 service neutron] Pushing event updated for resources: {'Port': ['ID=81af3eef-9e82-4452-afb5-98a928257d50,revision_number=11']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:17:23.246638 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1daeb4d8-37f3-44e6-8e50-7bff0dfbc53f req-9e4f0d04-0e5f-4fc8-bb9b-d633afea2d2d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:23.248226 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1daeb4d8-37f3-44e6-8e50-7bff0dfbc53f req-9e4f0d04-0e5f-4fc8-bb9b-d633afea2d2d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 945 time: 0.1001508 Dec 09 22:17:23.255632 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-f1b0f8af-6a8c-46f5-91d4-0ce207dbb472 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:23.257167 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-f1b0f8af-6a8c-46f5-91d4-0ce207dbb472 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 1097 time: 0.0691085 Dec 09 22:17:23.360224 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1daeb4d8-37f3-44e6-8e50-7bff0dfbc53f req-3c4eb67d-7e52-4a76-ada1-60c75e09e5dc tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1019983 Dec 09 22:17:23.383150 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-ea998549-9151-418c-a9af-59e25f996780 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:23.384690 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-ea998549-9151-418c-a9af-59e25f996780 service neutron] 10.222.0.10 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.1195056 Dec 09 22:17:23.454968 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-817580d0-4206-4e68-8136-aaf7b8d5cff6 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=81af3eef-9e82-4452-afb5-98a928257d50 HTTP/1.1" status: 200 len: 1001 time: 0.0625446 Dec 09 22:17:23.508850 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-0da240b9-da20-45f0-ae98-16f9ddf69129 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:23.510266 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-0da240b9-da20-45f0-ae98-16f9ddf69129 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0482492 Dec 09 22:17:23.561320 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-2f606c74-3eb4-4e74-865b-44b6a9de208f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:23.562757 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-2f606c74-3eb4-4e74-865b-44b6a9de208f service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0451152 Dec 09 22:17:23.658326 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-af4fb3f0-c0ae-4f1a-974a-a0778d4d3dde service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0877905 Dec 09 22:17:23.765772 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7bf01a6d-42dd-4e09-9fbe-d0ab77acfc0b req-6af0d970-d258-44f8-9bf4-1fa6ed5b8e81 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1002936 Dec 09 22:17:24.491823 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5aba58d-8b21-4df3-806b-734b2903185e req-6e1a839f-175a-4988-b775-70f2d6ad6964 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:24.493342 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d5aba58d-8b21-4df3-806b-734b2903185e req-6e1a839f-175a-4988-b775-70f2d6ad6964 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 945 time: 0.0532985 Dec 09 22:17:24.535592 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'tag': '81af3eef-9e82-4452-afb5-98a928257d50'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:17:24.537853 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3761ca9d-fa4c-4908-ac8c-c2aecb3cd8ff" -d '{"events": [{"name": "network-changed", "server_uuid": "40d085f5-12ba-4993-bdbd-d75dd187516c", "tag": "81af3eef-9e82-4452-afb5-98a928257d50"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:17:24.547413 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d5aba58d-8b21-4df3-806b-734b2903185e req-6249882a-bea3-425e-8804-5f37ea1e86af tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0480580 Dec 09 22:17:24.604970 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:17:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-efbfb12f-5e32-4c95-943e-b1479bf30a72 x-openstack-request-id: req-efbfb12f-5e32-4c95-943e-b1479bf30a72 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:17:24.605235 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "40d085f5-12ba-4993-bdbd-d75dd187516c", "tag": "81af3eef-9e82-4452-afb5-98a928257d50", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:17:24.605522 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-efbfb12f-5e32-4c95-943e-b1479bf30a72 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:17:24.605950 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'tag': '81af3eef-9e82-4452-afb5-98a928257d50', 'status': 'completed', 'code': 200} Dec 09 22:17:24.672291 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3761ca9d-fa4c-4908-ac8c-c2aecb3cd8ff req-2160aa1a-bd55-43b5-8a80-fb70ee7fca6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:24.673753 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3761ca9d-fa4c-4908-ac8c-c2aecb3cd8ff req-2160aa1a-bd55-43b5-8a80-fb70ee7fca6c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 1097 time: 0.0472610 Dec 09 22:17:24.675882 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3761ca9d-fa4c-4908-ac8c-c2aecb3cd8ff req-5f25b79c-8343-488e-9a3e-821478def807 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:24.677383 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3761ca9d-fa4c-4908-ac8c-c2aecb3cd8ff req-5f25b79c-8343-488e-9a3e-821478def807 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=ecd32dac944041b58de1a396ec18cd2c&device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 1097 time: 0.0478237 Dec 09 22:17:24.776761 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3761ca9d-fa4c-4908-ac8c-c2aecb3cd8ff req-02c3e3ae-6b8a-4f48-8517-751ab41c906b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:24.777121 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3761ca9d-fa4c-4908-ac8c-c2aecb3cd8ff req-6f644314-0fbe-41ff-8a69-a992d6cbfc9f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:24.778281 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3761ca9d-fa4c-4908-ac8c-c2aecb3cd8ff req-02c3e3ae-6b8a-4f48-8517-751ab41c906b service neutron] 10.222.0.31 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0929911 Dec 09 22:17:24.778492 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3761ca9d-fa4c-4908-ac8c-c2aecb3cd8ff req-6f644314-0fbe-41ff-8a69-a992d6cbfc9f service neutron] 10.222.0.10 "GET /v2.0/networks?id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 200 len: 913 time: 0.0932333 Dec 09 22:17:24.852585 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3761ca9d-fa4c-4908-ac8c-c2aecb3cd8ff req-6f0a3e8a-bfd6-4982-8eb9-8efb7bcfd1f6 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=81af3eef-9e82-4452-afb5-98a928257d50 HTTP/1.1" status: 200 len: 1001 time: 0.0667362 Dec 09 22:17:24.852838 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3761ca9d-fa4c-4908-ac8c-c2aecb3cd8ff req-aba11ec0-cefa-4cc7-8e4a-eed450395789 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=81af3eef-9e82-4452-afb5-98a928257d50 HTTP/1.1" status: 200 len: 1001 time: 0.0669768 Dec 09 22:17:24.904170 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3761ca9d-fa4c-4908-ac8c-c2aecb3cd8ff req-b8cb1da8-36aa-408d-9465-6599b714bc72 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:24.905191 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3761ca9d-fa4c-4908-ac8c-c2aecb3cd8ff req-04bfd207-5333-4ecf-8da8-5333771a1353 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:24.905671 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3761ca9d-fa4c-4908-ac8c-c2aecb3cd8ff req-b8cb1da8-36aa-408d-9465-6599b714bc72 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0460758 Dec 09 22:17:24.907078 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3761ca9d-fa4c-4908-ac8c-c2aecb3cd8ff req-04bfd207-5333-4ecf-8da8-5333771a1353 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 200 len: 851 time: 0.0479250 Dec 09 22:17:24.952460 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3761ca9d-fa4c-4908-ac8c-c2aecb3cd8ff req-062a328e-4883-47f2-bcf6-2ec10331012b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:24.953881 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3761ca9d-fa4c-4908-ac8c-c2aecb3cd8ff req-062a328e-4883-47f2-bcf6-2ec10331012b service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0415113 Dec 09 22:17:24.954772 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3761ca9d-fa4c-4908-ac8c-c2aecb3cd8ff req-e759f43e-89da-41f4-989f-d160b80a62fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:24.956329 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3761ca9d-fa4c-4908-ac8c-c2aecb3cd8ff req-e759f43e-89da-41f4-989f-d160b80a62fa service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0419049 Dec 09 22:17:25.055456 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3761ca9d-fa4c-4908-ac8c-c2aecb3cd8ff req-631d60eb-580a-452f-a6ce-f1921fecbf11 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0915802 Dec 09 22:17:25.057515 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3761ca9d-fa4c-4908-ac8c-c2aecb3cd8ff req-e4141012-9c05-46d0-beb7-740cde345ada service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0934176 Dec 09 22:17:25.147809 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3761ca9d-fa4c-4908-ac8c-c2aecb3cd8ff req-b2abde67-d89f-4e8f-a365-24cb2543fed3 service neutron] 10.222.0.10 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0834193 Dec 09 22:17:25.149114 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3761ca9d-fa4c-4908-ac8c-c2aecb3cd8ff req-fc411235-ff17-4b34-80a1-003a50eaa1a8 service neutron] 10.222.0.31 "GET /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0867684 Dec 09 22:17:25.681695 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8fe8b91-6756-4e78-9614-80bafaa092d5 req-3e55fca8-e5a7-469d-9e46-7883f29327bd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:25.683204 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8fe8b91-6756-4e78-9614-80bafaa092d5 req-3e55fca8-e5a7-469d-9e46-7883f29327bd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 945 time: 0.0595570 Dec 09 22:17:25.733823 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8fe8b91-6756-4e78-9614-80bafaa092d5 req-f0faf3d2-a62f-4d5f-81a6-c88376a9c5c7 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440853 Dec 09 22:17:26.854841 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e8fe95f-e176-4843-b57c-6a8cf9a172c6 req-cbb0cdb2-6905-41f5-b976-e755bce9b12f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:26.856443 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e8fe95f-e176-4843-b57c-6a8cf9a172c6 req-cbb0cdb2-6905-41f5-b976-e755bce9b12f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 945 time: 0.0515490 Dec 09 22:17:26.908667 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e8fe95f-e176-4843-b57c-6a8cf9a172c6 req-fc2af0da-c422-4eaa-8e99-451eba79ce28 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460093 Dec 09 22:17:27.621049 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:27.729084 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:28.033951 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b82d715-fa73-443f-a530-0be8b00c6e82 req-0e963115-639f-42a1-ab9d-8a9b321d9080 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:28.035484 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b82d715-fa73-443f-a530-0be8b00c6e82 req-0e963115-639f-42a1-ab9d-8a9b321d9080 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 945 time: 0.0526757 Dec 09 22:17:28.089454 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7b82d715-fa73-443f-a530-0be8b00c6e82 req-2d9c0147-b72c-4245-b435-526561993ed3 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474415 Dec 09 22:17:29.230099 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd26a1d9-401a-442e-afef-ae99d63bd1a0 req-87b6cc33-8982-41dc-ad85-655a7d331474 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:29.231675 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fd26a1d9-401a-442e-afef-ae99d63bd1a0 req-87b6cc33-8982-41dc-ad85-655a7d331474 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 945 time: 0.0569539 Dec 09 22:17:29.284531 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fd26a1d9-401a-442e-afef-ae99d63bd1a0 req-4dbb20f8-aace-4e14-a902-b1520730b6ba tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441163 Dec 09 22:17:30.432045 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f802be43-a986-4d53-9ad8-c4a91d166556 req-0d910f66-7d9a-4358-b70b-d0800f54fdb8 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:30.433518 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f802be43-a986-4d53-9ad8-c4a91d166556 req-0d910f66-7d9a-4358-b70b-d0800f54fdb8 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 945 time: 0.0679424 Dec 09 22:17:30.482069 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f802be43-a986-4d53-9ad8-c4a91d166556 req-7a670af1-665e-4363-ad2f-e77eae209ee3 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424035 Dec 09 22:17:31.630069 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a0b80fe-35e7-4221-acb6-2e1adf31fc49 req-f4403b52-32f3-49b4-accf-057f715d3e43 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:31.632228 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a0b80fe-35e7-4221-acb6-2e1adf31fc49 req-f4403b52-32f3-49b4-accf-057f715d3e43 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 945 time: 0.0648651 Dec 09 22:17:31.683587 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a0b80fe-35e7-4221-acb6-2e1adf31fc49 req-a6cf585a-4b4f-403f-87d7-cb2205bf153c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444639 Dec 09 22:17:32.827782 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c38e54a-8c17-44e8-87b5-34ffe8d71f52 req-03310db1-ef60-4dba-8add-af3567dad625 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:32.829305 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1c38e54a-8c17-44e8-87b5-34ffe8d71f52 req-03310db1-ef60-4dba-8add-af3567dad625 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 945 time: 0.0534215 Dec 09 22:17:32.877197 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1c38e54a-8c17-44e8-87b5-34ffe8d71f52 req-80384113-7fc3-48c7-858e-50a005ea580f tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418024 Dec 09 22:17:33.022282 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-56f827f1-9456-4634-b0a6-5d80432ab1e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:34.003967 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76ec0ba9-acc9-43c2-affb-11551cc0c189 req-1a8b5e89-f0ac-4a1a-8269-91ab233059f9 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:34.005459 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-76ec0ba9-acc9-43c2-affb-11551cc0c189 req-1a8b5e89-f0ac-4a1a-8269-91ab233059f9 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 945 time: 0.0547264 Dec 09 22:17:34.061264 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-76ec0ba9-acc9-43c2-affb-11551cc0c189 req-065e4f74-7eff-4ad8-b6c5-12e41c4fcdb2 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0494356 Dec 09 22:17:35.203740 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36c6f782-8526-454e-bf29-a443abc2a42e req-52954bd4-11db-4b9c-a12a-cef31e89d427 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:35.205231 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36c6f782-8526-454e-bf29-a443abc2a42e req-52954bd4-11db-4b9c-a12a-cef31e89d427 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 945 time: 0.0579050 Dec 09 22:17:35.257347 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36c6f782-8526-454e-bf29-a443abc2a42e req-d891097f-90db-440e-8dbe-ba2abd5eb584 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419390 Dec 09 22:17:35.649404 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fa560285-bf2d-488a-bcf9-7fbb9f1164e2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:36.400468 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aac41c4-48a7-4817-af37-114b6ea0f603 req-08908228-4e08-490d-9625-67e9565d0286 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:36.402417 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8aac41c4-48a7-4817-af37-114b6ea0f603 req-08908228-4e08-490d-9625-67e9565d0286 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 945 time: 0.0614097 Dec 09 22:17:36.454562 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8aac41c4-48a7-4817-af37-114b6ea0f603 req-6e3f121c-2f09-4a95-9507-8fa21273cd1b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460598 Dec 09 22:17:36.593985 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70b5e36b-64e8-45a9-a530-d9e57f82891a req-c9c05393-3970-4313-9854-9a3c1415dc96 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:36.595404 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-70b5e36b-64e8-45a9-a530-d9e57f82891a req-c9c05393-3970-4313-9854-9a3c1415dc96 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 945 time: 0.0707476 Dec 09 22:17:36.649930 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-70b5e36b-64e8-45a9-a530-d9e57f82891a req-4b597702-7387-42c6-a9c1-9f3a09a70ded tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482149 Dec 09 22:17:36.754415 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 81af3eef-9e82-4452-afb5-98a928257d50 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:17:36.774720 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77210635-a407-49bd-a4db-3f523d8144c8 req-40707dbb-8000-4925-b12e-5af6b5553858 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:36.776271 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-77210635-a407-49bd-a4db-3f523d8144c8 req-40707dbb-8000-4925-b12e-5af6b5553858 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 945 time: 0.0563784 Dec 09 22:17:36.830859 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-77210635-a407-49bd-a4db-3f523d8144c8 req-9120f1a8-af80-443d-8236-665185803d80 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481832 Dec 09 22:17:36.860854 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:36.867517 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 81af3eef-9e82-4452-afb5-98a928257d50, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=81af3eef-9e82-4452-afb5-98a928257d50,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:17:36.883542 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '81af3eef-9e82-4452-afb5-98a928257d50', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'port_id': '81af3eef-9e82-4452-afb5-98a928257d50', 'mac_address': 'fa:16:3e:25:d0:20', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 149, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:17:36.922850 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:36.936521 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 81af3eef-9e82-4452-afb5-98a928257d50 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:17:36.957615 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 81af3eef-9e82-4452-afb5-98a928257d50, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=81af3eef-9e82-4452-afb5-98a928257d50,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:17:36.962773 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:37.016491 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=81af3eef-9e82-4452-afb5-98a928257d50,revision_number=12']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:17:37.082673 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ce93769-30a7-4991-84de-d370d75b8dde req-2a08e1a6-e6f4-4073-ac81-11548dac9fb0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:37.084169 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ce93769-30a7-4991-84de-d370d75b8dde req-2a08e1a6-e6f4-4073-ac81-11548dac9fb0 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 946 time: 0.0516083 Dec 09 22:17:37.142592 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ce93769-30a7-4991-84de-d370d75b8dde req-b68789c0-9ec9-4fd0-b996-ee227461d266 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0505273 Dec 09 22:17:37.225405 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['81af3eef-9e82-4452-afb5-98a928257d50'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:17:38.180414 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:38.265097 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0582218c-9565-447e-b0ba-7c8eee3c9d3b req-5a7d8f11-9825-45cf-9632-99cd3e857e3d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:38.266720 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0582218c-9565-447e-b0ba-7c8eee3c9d3b req-5a7d8f11-9825-45cf-9632-99cd3e857e3d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 946 time: 0.0499394 Dec 09 22:17:38.319325 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0582218c-9565-447e-b0ba-7c8eee3c9d3b req-0981a1cd-c820-411e-a379-43808416a459 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups?id=fc389abb-6202-4d61-870a-d6749ba1a635&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432298 Dec 09 22:17:38.608987 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49293d93-23ea-431d-a8a2-ce93a704b54d req-5f767d79-c5b7-44f5-8d4f-c63d854d8d3b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:38.610379 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-49293d93-23ea-431d-a8a2-ce93a704b54d req-5f767d79-c5b7-44f5-8d4f-c63d854d8d3b tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.10 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 946 time: 0.0603929 Dec 09 22:17:38.740432 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-49293d93-23ea-431d-a8a2-ce93a704b54d req-7bb9c542-caaa-4dda-b077-aff3f1d7303a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Deleting port 81af3eef-9e82-4452-afb5-98a928257d50 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:17:38.740776 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-49293d93-23ea-431d-a8a2-ce93a704b54d req-7bb9c542-caaa-4dda-b077-aff3f1d7303a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:38.764466 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 81af3eef-9e82-4452-afb5-98a928257d50 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:17:38.819996 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 81af3eef-9e82-4452-afb5-98a928257d50 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:17:38.826312 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 81af3eef-9e82-4452-afb5-98a928257d50 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:17:38.826685 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:38.848598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-49293d93-23ea-431d-a8a2-ce93a704b54d req-7bb9c542-caaa-4dda-b077-aff3f1d7303a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] For port 81af3eef-9e82-4452-afb5-98a928257d50, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=81af3eef-9e82-4452-afb5-98a928257d50,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:17:38.848980 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-49293d93-23ea-431d-a8a2-ce93a704b54d req-7bb9c542-caaa-4dda-b077-aff3f1d7303a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:38.912459 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:38.937706 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '81af3eef-9e82-4452-afb5-98a928257d50'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:17:38.941143 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-de111fe6-33aa-4d4a-b6c7-4f519fb09f45" -d '{"events": [{"server_uuid": "40d085f5-12ba-4993-bdbd-d75dd187516c", "name": "network-vif-plugged", "status": "completed", "tag": "81af3eef-9e82-4452-afb5-98a928257d50"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:17:38.954817 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 81af3eef-9e82-4452-afb5-98a928257d50, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=81af3eef-9e82-4452-afb5-98a928257d50,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:17:38.961210 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:38.994890 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:17:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c6191319-de9e-458a-96a0-6cd9bc3a09ac x-openstack-request-id: req-c6191319-de9e-458a-96a0-6cd9bc3a09ac {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:17:38.995182 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "40d085f5-12ba-4993-bdbd-d75dd187516c", "name": "network-vif-plugged", "status": "completed", "tag": "81af3eef-9e82-4452-afb5-98a928257d50", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:17:38.995449 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c6191319-de9e-458a-96a0-6cd9bc3a09ac {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:17:38.995844 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '81af3eef-9e82-4452-afb5-98a928257d50', 'code': 200} Dec 09 22:17:39.023907 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=81af3eef-9e82-4452-afb5-98a928257d50,revision_number=13']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:17:39.054864 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-49293d93-23ea-431d-a8a2-ce93a704b54d req-7bb9c542-caaa-4dda-b077-aff3f1d7303a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:39.055226 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-49293d93-23ea-431d-a8a2-ce93a704b54d req-7bb9c542-caaa-4dda-b077-aff3f1d7303a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:39.055573 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [req-49293d93-23ea-431d-a8a2-ce93a704b54d req-7bb9c542-caaa-4dda-b077-aff3f1d7303a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Floating IP ded53112-c89a-4a62-a1b4-d803c592f310 disassociated. External IP: 172.25.3.185, port: 81af3eef-9e82-4452-afb5-98a928257d50. Dec 09 22:17:39.055915 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-49293d93-23ea-431d-a8a2-ce93a704b54d req-7bb9c542-caaa-4dda-b077-aff3f1d7303a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Calling delete_port for 81af3eef-9e82-4452-afb5-98a928257d50 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:17:39.218101 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-49293d93-23ea-431d-a8a2-ce93a704b54d req-7bb9c542-caaa-4dda-b077-aff3f1d7303a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:39.260869 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bb9c542-caaa-4dda-b077-aff3f1d7303a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Pushing event deleted for resources: {'Port': ['ID=81af3eef-9e82-4452-afb5-98a928257d50,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:17:39.394826 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [req-49293d93-23ea-431d-a8a2-ce93a704b54d req-7bb9c542-caaa-4dda-b077-aff3f1d7303a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:17:39.470320 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7f891c0b-58f6-440d-a97d-70484e273793 req-0f90f27f-85df-4197-b7cf-7b009ba6447c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 210 time: 0.0318091 Dec 09 22:17:39.531781 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-49293d93-23ea-431d-a8a2-ce93a704b54d req-7bb9c542-caaa-4dda-b077-aff3f1d7303a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:17:39.543134 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7553388d-a3d0-49bf-bc9b-687bd1a87932 None None] Sync routers for ids ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:17:39.553487 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7553388d-a3d0-49bf-bc9b-687bd1a87932 None None] Routers {'7e861ee9-d29c-4ade-a3ab-cce44cba2c97'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:17:39.554067 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-7553388d-a3d0-49bf-bc9b-687bd1a87932 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:17:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:17:39.573457 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-49293d93-23ea-431d-a8a2-ce93a704b54d req-7bb9c542-caaa-4dda-b077-aff3f1d7303a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] No DVR routers for this DVR port 81af3eef-9e82-4452-afb5-98a928257d50 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:17:39.576252 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-49293d93-23ea-431d-a8a2-ce93a704b54d req-7bb9c542-caaa-4dda-b077-aff3f1d7303a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:39.579628 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-49293d93-23ea-431d-a8a2-ce93a704b54d req-7bb9c542-caaa-4dda-b077-aff3f1d7303a tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.10 "DELETE /v2.0/ports/81af3eef-9e82-4452-afb5-98a928257d50 HTTP/1.1" status: 204 len: 173 time: 0.9627502 Dec 09 22:17:39.580065 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'name': 'network-vif-deleted', 'tag': '81af3eef-9e82-4452-afb5-98a928257d50'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:17:39.582334 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a801329c-a38f-4b49-b68e-3ecbf28cb685" -d '{"events": [{"server_uuid": "40d085f5-12ba-4993-bdbd-d75dd187516c", "name": "network-vif-deleted", "tag": "81af3eef-9e82-4452-afb5-98a928257d50"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:17:39.624466 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:17:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fdb08291-d34a-4b24-b405-d74cd8ac9cc0 x-openstack-request-id: req-fdb08291-d34a-4b24-b405-d74cd8ac9cc0 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:17:39.624885 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "40d085f5-12ba-4993-bdbd-d75dd187516c", "name": "network-vif-deleted", "tag": "81af3eef-9e82-4452-afb5-98a928257d50", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:17:39.625142 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-fdb08291-d34a-4b24-b405-d74cd8ac9cc0 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:17:39.625674 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '40d085f5-12ba-4993-bdbd-d75dd187516c', 'name': 'network-vif-deleted', 'tag': '81af3eef-9e82-4452-afb5-98a928257d50', 'status': 'completed', 'code': 200} Dec 09 22:17:39.665619 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-7553388d-a3d0-49bf-bc9b-687bd1a87932 None None] Set router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:17:39.679361 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:39.871705 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-7553388d-a3d0-49bf-bc9b-687bd1a87932 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:05Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:17:39.898706 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7553388d-a3d0-49bf-bc9b-687bd1a87932 None None] Checking router: 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:17:39.908013 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7553388d-a3d0-49bf-bc9b-687bd1a87932 None None] Routers {'7e861ee9-d29c-4ade-a3ab-cce44cba2c97'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:17:39.908623 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-7553388d-a3d0-49bf-bc9b-687bd1a87932 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:17:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:17:40.013794 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-7553388d-a3d0-49bf-bc9b-687bd1a87932 None None] Set router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:17:40.215543 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-7553388d-a3d0-49bf-bc9b-687bd1a87932 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:05Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:17:40.242865 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7553388d-a3d0-49bf-bc9b-687bd1a87932 None None] The sync data for ids ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'] in n-d-713301-27 is: [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '52d4a6b2-48f9-42e8-b835-607fc25683b7', 'name': '', 'network_id': '91a989ca-03f4-4cf9-a2af-b26f8b1a2bec', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'mac_address': 'fa:16:3e:3a:fd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_interface', 'standard_attr_id': 4076, 'fixed_ips': [{'subnet_id': '88c86202-31f6-4618-8f06-f2283fac961c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:08:01Z', 'updated_at': '2021-12-09T22:08:05Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'subnets': [{'id': '88c86202-31f6-4618-8f06-f2283fac961c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:17:40.254905 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:17:40.487760 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f69a231c-5b50-4a8b-ab9a-60d0156575cf None None] New status for floating IP ded53112-c89a-4a62-a1b4-d803c592f310: DOWN {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:17:40.575784 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b3009952-a551-43f5-b0e4-447607ac13ef req-b932440a-924d-4d0f-b017-8afcc133f180 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 210 time: 0.0288012 Dec 09 22:17:41.675822 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-79d2b9e5-5f4e-4185-a36a-fd02fc701ee7 req-e28d0ef0-15ad-4e35-8b77-b5e888d02775 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 210 time: 0.0281227 Dec 09 22:17:42.771135 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 81af3eef-9e82-4452-afb5-98a928257d50 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:17:42.780668 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-59d37731-1b9e-4378-bf45-95661916e453 req-217f1ce8-d37d-4505-a3e5-6bbbdceed65d tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 210 time: 0.0313187 Dec 09 22:17:42.799846 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 81af3eef-9e82-4452-afb5-98a928257d50 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:17:42.800669 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 81af3eef-9e82-4452-afb5-98a928257d50 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:17:43.890498 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c622a981-a4dd-4883-88a2-eb0933785958 req-369020be-629f-4a69-a867-7f1798193f14 tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/ports?device_id=40d085f5-12ba-4993-bdbd-d75dd187516c HTTP/1.1" status: 200 len: 210 time: 0.0272481 Dec 09 22:17:48.663858 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60880) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:17:48.721568 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-38593f75-1e18-4b3a-8662-d36db66ad28c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:48.745116 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-38593f75-1e18-4b3a-8662-d36db66ad28c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:48.794136 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-38593f75-1e18-4b3a-8662-d36db66ad28c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:48.797287 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-38593f75-1e18-4b3a-8662-d36db66ad28c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:48.798597 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-38593f75-1e18-4b3a-8662-d36db66ad28c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "DELETE /v2.0/security-groups/fc389abb-6202-4d61-870a-d6749ba1a635 HTTP/1.1" status: 204 len: 168 time: 0.1335692 Dec 09 22:17:48.801576 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60882) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:17:48.807955 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38593f75-1e18-4b3a-8662-d36db66ad28c tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fc389abb-6202-4d61-870a-d6749ba1a635,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:17:48.822152 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [None req-9ca09ead-39ca-4e83-b4b2-b7dd4521b2eb tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] show failed (client error): The resource could not be found. Dec 09 22:17:48.827118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60884) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:17:48.827552 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9ca09ead-39ca-4e83-b4b2-b7dd4521b2eb tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "GET /v2.0/security-groups/fc389abb-6202-4d61-870a-d6749ba1a635 HTTP/1.1" status: 404 len: 347 time: 0.0245147 Dec 09 22:17:48.955266 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-698827bf-e32a-49e6-b0b2-be968a6779bd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Deleting port 7faa465b-785a-449e-89df-cc9d716fca67 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:17:48.955529 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-698827bf-e32a-49e6-b0b2-be968a6779bd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:49.035404 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-698827bf-e32a-49e6-b0b2-be968a6779bd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:49.035712 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-698827bf-e32a-49e6-b0b2-be968a6779bd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:49.048092 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-698827bf-e32a-49e6-b0b2-be968a6779bd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Calling delete_port for 7faa465b-785a-449e-89df-cc9d716fca67 owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:17:49.183602 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-698827bf-e32a-49e6-b0b2-be968a6779bd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:49.209777 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-698827bf-e32a-49e6-b0b2-be968a6779bd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Pushing event deleted for resources: {'Port': ['ID=7faa465b-785a-449e-89df-cc9d716fca67,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:17:49.272882 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-698827bf-e32a-49e6-b0b2-be968a6779bd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:49.275607 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-698827bf-e32a-49e6-b0b2-be968a6779bd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:49.276805 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-698827bf-e32a-49e6-b0b2-be968a6779bd tempest-ServerActionsTestJSON-472695847 tempest-ServerActionsTestJSON-472695847-project] 10.222.0.13 "DELETE /v2.0/floatingips/ded53112-c89a-4a62-a1b4-d803c592f310 HTTP/1.1" status: 204 len: 168 time: 0.4485147 Dec 09 22:17:49.280124 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60886) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:17:49.722296 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-98b97273-eb5f-49ee-aae0-cffd31648a3a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:50.268140 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-98b97273-eb5f-49ee-aae0-cffd31648a3a admin admin] Deleting port 52d4a6b2-48f9-42e8-b835-607fc25683b7 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:17:50.268500 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-98b97273-eb5f-49ee-aae0-cffd31648a3a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:50.350685 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-98b97273-eb5f-49ee-aae0-cffd31648a3a admin admin] For port 52d4a6b2-48f9-42e8-b835-607fc25683b7, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=52d4a6b2-48f9-42e8-b835-607fc25683b7,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:17:50.350917 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-98b97273-eb5f-49ee-aae0-cffd31648a3a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:50.363864 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-98b97273-eb5f-49ee-aae0-cffd31648a3a admin admin] Calling delete_port for 52d4a6b2-48f9-42e8-b835-607fc25683b7 owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:17:50.545417 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-98b97273-eb5f-49ee-aae0-cffd31648a3a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:50.573204 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98b97273-eb5f-49ee-aae0-cffd31648a3a admin admin] Pushing event deleted for resources: {'Port': ['ID=52d4a6b2-48f9-42e8-b835-607fc25683b7,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:17:50.741091 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-98b97273-eb5f-49ee-aae0-cffd31648a3a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:50.968500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-98b97273-eb5f-49ee-aae0-cffd31648a3a admin admin] Router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:17:51.087156 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-98b97273-eb5f-49ee-aae0-cffd31648a3a admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:17:51.092721 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-98b97273-eb5f-49ee-aae0-cffd31648a3a admin admin] 10.222.0.13 "PUT /v2.0/routers/7e861ee9-d29c-4ade-a3ab-cce44cba2c97/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8116760 Dec 09 22:17:51.095812 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60890) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:17:51.097682 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-651ee696-4bb4-4e47-ad95-dfd0366521c0 None None] Sync routers for ids ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:17:51.108470 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-651ee696-4bb4-4e47-ad95-dfd0366521c0 None None] Routers {'7e861ee9-d29c-4ade-a3ab-cce44cba2c97'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:17:51.109172 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-651ee696-4bb4-4e47-ad95-dfd0366521c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:17:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:17:51.199685 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-398eee19-463e-4eb6-b851-bd1b97a26358 admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:51.213675 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-651ee696-4bb4-4e47-ad95-dfd0366521c0 None None] Set router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:17:51.305102 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-398eee19-463e-4eb6-b851-bd1b97a26358 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:51.362955 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-398eee19-463e-4eb6-b851-bd1b97a26358 admin admin] Deleting port cbd45403-82fe-4c33-9dfa-acddcbec6a8f {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:17:51.363657 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-398eee19-463e-4eb6-b851-bd1b97a26358 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:51.397174 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-651ee696-4bb4-4e47-ad95-dfd0366521c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128'}], 'enable_snat': True}, 'gw_port_id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:17:50Z', 'revision_number': 5, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port': {'id': 'cbd45403-82fe-4c33-9dfa-acddcbec6a8f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:de:eb:4e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4075, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:08:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:17:51.428327 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-651ee696-4bb4-4e47-ad95-dfd0366521c0 None None] Checking router: 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:17:51.436778 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-651ee696-4bb4-4e47-ad95-dfd0366521c0 None None] Routers {'7e861ee9-d29c-4ade-a3ab-cce44cba2c97'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:17:51.437399 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-651ee696-4bb4-4e47-ad95-dfd0366521c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:17:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:17:51.446517 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-398eee19-463e-4eb6-b851-bd1b97a26358 admin admin] For port cbd45403-82fe-4c33-9dfa-acddcbec6a8f, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=cbd45403-82fe-4c33-9dfa-acddcbec6a8f,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:17:51.446893 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-398eee19-463e-4eb6-b851-bd1b97a26358 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:51.459278 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-398eee19-463e-4eb6-b851-bd1b97a26358 admin admin] Calling delete_port for cbd45403-82fe-4c33-9dfa-acddcbec6a8f owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:17:51.523287 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-651ee696-4bb4-4e47-ad95-dfd0366521c0 None None] Set router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:17:51.574917 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-651ee696-4bb4-4e47-ad95-dfd0366521c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:17:51Z', 'revision_number': 6, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:17:51.633941 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-398eee19-463e-4eb6-b851-bd1b97a26358 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:51.666129 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-398eee19-463e-4eb6-b851-bd1b97a26358 admin admin] Pushing event deleted for resources: {'Port': ['ID=cbd45403-82fe-4c33-9dfa-acddcbec6a8f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:17:51.676036 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49b04a8a-8e2b-41aa-8cfb-d23b30e53851 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:17:51.705977 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-651ee696-4bb4-4e47-ad95-dfd0366521c0 None None] The sync data for ids ['7e861ee9-d29c-4ade-a3ab-cce44cba2c97'] in n-d-713301-27 is: [{'id': '7e861ee9-d29c-4ade-a3ab-cce44cba2c97', 'name': 'tempest-ServerActionsTestJSON-1978455332-router', 'tenant_id': 'ecd32dac944041b58de1a396ec18cd2c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:07:59Z', 'updated_at': '2021-12-09T22:17:51Z', 'revision_number': 6, 'project_id': 'ecd32dac944041b58de1a396ec18cd2c', 'gw_port_host': None}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:17:51.741595 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-398eee19-463e-4eb6-b851-bd1b97a26358 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:51.834973 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-398eee19-463e-4eb6-b851-bd1b97a26358 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:51.837128 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-398eee19-463e-4eb6-b851-bd1b97a26358 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:51.887363 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-398eee19-463e-4eb6-b851-bd1b97a26358 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:51.888009 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-398eee19-463e-4eb6-b851-bd1b97a26358 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7e861ee9-d29c-4ade-a3ab-cce44cba2c97 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 22:17:51.892607 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-398eee19-463e-4eb6-b851-bd1b97a26358 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:51.893761 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-398eee19-463e-4eb6-b851-bd1b97a26358 admin admin] 10.222.0.13 "DELETE /v2.0/routers/7e861ee9-d29c-4ade-a3ab-cce44cba2c97 HTTP/1.1" status: 204 len: 168 time: 0.7969449 Dec 09 22:17:51.896428 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60896) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:17:51.942745 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-0348808e-5ccf-4a59-a764-6a332d80b36c admin admin] Deleting subnet 88c86202-31f6-4618-8f06-f2283fac961c {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:17:51.948216 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0348808e-5ccf-4a59-a764-6a332d80b36c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:51.984212 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0348808e-5ccf-4a59-a764-6a332d80b36c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:52.071209 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0348808e-5ccf-4a59-a764-6a332d80b36c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:52.137629 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0348808e-5ccf-4a59-a764-6a332d80b36c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:52.166838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0348808e-5ccf-4a59-a764-6a332d80b36c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=88c86202-31f6-4618-8f06-f2283fac961c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:17:52.168945 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0348808e-5ccf-4a59-a764-6a332d80b36c admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:52.172774 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0348808e-5ccf-4a59-a764-6a332d80b36c admin admin] 10.222.0.13 "DELETE /v2.0/subnets/88c86202-31f6-4618-8f06-f2283fac961c HTTP/1.1" status: 204 len: 168 time: 0.2754006 Dec 09 22:17:52.174561 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5a920d5-515d-4b68-9dae-b289478eb338 None None] Network 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:17:52.175363 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60898) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:17:52.245004 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60afbb3b-513e-44bb-91ca-31f0cefcac9d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:52.298551 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-60afbb3b-513e-44bb-91ca-31f0cefcac9d admin admin] Deleting port 3af4e820-b4a0-4171-8821-93844e0562c3 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:17:52.298886 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60afbb3b-513e-44bb-91ca-31f0cefcac9d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:52.364595 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-60afbb3b-513e-44bb-91ca-31f0cefcac9d admin admin] For port 3af4e820-b4a0-4171-8821-93844e0562c3, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=3af4e820-b4a0-4171-8821-93844e0562c3,segment=NetworkSegment(a7afa2ad-9134-4da5-a606-e7c776822e63),segment_id=a7afa2ad-9134-4da5-a606-e7c776822e63)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:17:52.364830 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60afbb3b-513e-44bb-91ca-31f0cefcac9d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:52.377003 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-60afbb3b-513e-44bb-91ca-31f0cefcac9d admin admin] Calling delete_port for 3af4e820-b4a0-4171-8821-93844e0562c3 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:17:52.473831 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60afbb3b-513e-44bb-91ca-31f0cefcac9d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:52.499876 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a68aa28d-dbd4-44de-9445-8d32b00db48f None None] DHCP port deletion for 91a989ca-03f4-4cf9-a2af-b26f8b1a2bec request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:17:52.507362 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60afbb3b-513e-44bb-91ca-31f0cefcac9d admin admin] Pushing event deleted for resources: {'Port': ['ID=3af4e820-b4a0-4171-8821-93844e0562c3,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:17:52.512287 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60afbb3b-513e-44bb-91ca-31f0cefcac9d admin admin] No DVR routers for this DVR port 3af4e820-b4a0-4171-8821-93844e0562c3 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:17:52.513244 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 52d4a6b2-48f9-42e8-b835-607fc25683b7 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:17:52.539373 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 52d4a6b2-48f9-42e8-b835-607fc25683b7 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:17:52.539739 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 52d4a6b2-48f9-42e8-b835-607fc25683b7 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:17:52.587825 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60afbb3b-513e-44bb-91ca-31f0cefcac9d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:52.610238 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-60afbb3b-513e-44bb-91ca-31f0cefcac9d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['91a989ca-03f4-4cf9-a2af-b26f8b1a2bec']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:17:52.620882 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-60afbb3b-513e-44bb-91ca-31f0cefcac9d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a7afa2ad-9134-4da5-a606-e7c776822e63') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:17:52.621097 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-60afbb3b-513e-44bb-91ca-31f0cefcac9d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a7afa2ad-9134-4da5-a606-e7c776822e63') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:17:52.632391 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60afbb3b-513e-44bb-91ca-31f0cefcac9d admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:52.648417 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60afbb3b-513e-44bb-91ca-31f0cefcac9d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:52.659357 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-60afbb3b-513e-44bb-91ca-31f0cefcac9d admin admin] Releasing vlan 149 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:17:52.659897 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60afbb3b-513e-44bb-91ca-31f0cefcac9d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: timer() Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:17:52.662167 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:17:52.727843 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60afbb3b-513e-44bb-91ca-31f0cefcac9d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:52.735289 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-60afbb3b-513e-44bb-91ca-31f0cefcac9d admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:52.741348 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-60afbb3b-513e-44bb-91ca-31f0cefcac9d admin admin] 10.222.0.13 "DELETE /v2.0/networks/91a989ca-03f4-4cf9-a2af-b26f8b1a2bec HTTP/1.1" status: 204 len: 168 time: 0.5617659 Dec 09 22:17:52.753810 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60afbb3b-513e-44bb-91ca-31f0cefcac9d admin admin] Pushing event deleted for resources: {'Network': ['ID=91a989ca-03f4-4cf9-a2af-b26f8b1a2bec,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:17:52.860384 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60902) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:17:52.902469 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d8b83aee-6ac0-40f5-babc-2469ef57527c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=ecd32dac944041b58de1a396ec18cd2c&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0407503 Dec 09 22:17:52.905287 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60904) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:17:52.963078 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e02f8cbb-62f5-46e9-8011-2c673b0788d8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:52.986983 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e02f8cbb-62f5-46e9-8011-2c673b0788d8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:53.042963 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e02f8cbb-62f5-46e9-8011-2c673b0788d8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:53.045667 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e02f8cbb-62f5-46e9-8011-2c673b0788d8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:53.046832 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e02f8cbb-62f5-46e9-8011-2c673b0788d8 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/5ea41c71-ea38-4a77-96f9-63d9b0ec498c HTTP/1.1" status: 204 len: 168 time: 0.1405349 Dec 09 22:17:53.055203 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e02f8cbb-62f5-46e9-8011-2c673b0788d8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5ea41c71-ea38-4a77-96f9-63d9b0ec498c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:17:53.816499 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 60926) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:17:53.917714 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ad33fd59-fe60-4b3c-9950-23a26550cc30 admin admin] Request body: {'network': {'name': 'tempest-ServersNegativeTestJSON-1394944029-network', 'tenant_id': 'd0bfdd47813b42e6a73d42a79428b436'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:17:53.942337 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ad33fd59-fe60-4b3c-9950-23a26550cc30 admin admin] Made reservation on behalf of d0bfdd47813b42e6a73d42a79428b436 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:17:53.944691 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ad33fd59-fe60-4b3c-9950-23a26550cc30 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:53.953262 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ad33fd59-fe60-4b3c-9950-23a26550cc30 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:54.027848 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ad33fd59-fe60-4b3c-9950-23a26550cc30 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:54.033811 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ad33fd59-fe60-4b3c-9950-23a26550cc30 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:54.059189 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ad33fd59-fe60-4b3c-9950-23a26550cc30 admin admin] vlan segment allocate from pool success with {'vlan_id': 107, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 22:17:54.069535 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad33fd59-fe60-4b3c-9950-23a26550cc30 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:17:54.074767 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ad33fd59-fe60-4b3c-9950-23a26550cc30 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:54.075118 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-ad33fd59-fe60-4b3c-9950-23a26550cc30 admin admin] Added segment d4bb457d-10ec-462e-b17c-f33f1d659499 of type vlan for network 3caceac7-eeca-4a3e-a461-b371f111f90d Dec 09 22:17:54.108271 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device cbd45403-82fe-4c33-9dfa-acddcbec6a8f no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:17:54.118054 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ad33fd59-fe60-4b3c-9950-23a26550cc30 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:54.129418 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: cbd45403-82fe-4c33-9dfa-acddcbec6a8f {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:17:54.129750 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device cbd45403-82fe-4c33-9dfa-acddcbec6a8f not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:17:54.130158 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 3af4e820-b4a0-4171-8821-93844e0562c3 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:17:54.144920 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ad33fd59-fe60-4b3c-9950-23a26550cc30 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:54.145974 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad33fd59-fe60-4b3c-9950-23a26550cc30 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:54.146555 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ad33fd59-fe60-4b3c-9950-23a26550cc30 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:54.152379 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 3af4e820-b4a0-4171-8821-93844e0562c3 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:17:54.152720 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 3af4e820-b4a0-4171-8821-93844e0562c3 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:17:54.183796 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ad33fd59-fe60-4b3c-9950-23a26550cc30 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.3659954 Dec 09 22:17:54.186771 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 60930) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:17:54.191956 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-51e451e9-4201-474c-b441-446353acfd13 admin admin] Request body: {'subnet': {'network_id': '3caceac7-eeca-4a3e-a461-b371f111f90d', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServersNegativeTestJSON-1394944029-subnet', 'tenant_id': 'd0bfdd47813b42e6a73d42a79428b436', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:17:54.214360 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-51e451e9-4201-474c-b441-446353acfd13 admin admin] Made reservation on behalf of d0bfdd47813b42e6a73d42a79428b436 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:17:54.216660 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-51e451e9-4201-474c-b441-446353acfd13 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:54.217030 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad33fd59-fe60-4b3c-9950-23a26550cc30 admin admin] Pushing event updated for resources: {'Network': ['ID=3caceac7-eeca-4a3e-a461-b371f111f90d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:17:54.228250 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 3caceac7-eeca-4a3e-a461-b371f111f90d details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 22:17:54.389173 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-51e451e9-4201-474c-b441-446353acfd13 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:54.453305 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51e451e9-4201-474c-b441-446353acfd13 admin admin] Pushing event updated for resources: {'Subnet': ['ID=7341cb79-5dc9-47ad-8465-c09aa84ad9cd,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:17:54.458548 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-51e451e9-4201-474c-b441-446353acfd13 admin admin] Checking segment: {'id': 'd4bb457d-10ec-462e-b17c-f33f1d659499', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '3caceac7-eeca-4a3e-a461-b371f111f90d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:17:54.458902 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-51e451e9-4201-474c-b441-446353acfd13 admin admin] Network hostable DHCP agents. Network: 3caceac7-eeca-4a3e-a461-b371f111f90d, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 22:17:54.476969 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-51e451e9-4201-474c-b441-446353acfd13 admin admin] Network 3caceac7-eeca-4a3e-a461-b371f111f90d is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 22:17:54.490327 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-51e451e9-4201-474c-b441-446353acfd13 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 3caceac7-eeca-4a3e-a461-b371f111f90d) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:17:54.494431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-51e451e9-4201-474c-b441-446353acfd13 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:54.495032 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-51e451e9-4201-474c-b441-446353acfd13 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:54.499812 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-63c2dde5-b712-44ba-abd0-4566f0083bd8 None None] Network 3caceac7-eeca-4a3e-a461-b371f111f90d requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:17:54.513768 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-51e451e9-4201-474c-b441-446353acfd13 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.3257577 Dec 09 22:17:54.598027 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e2096212-ca5f-4eb1-8e01-33fbead1a2e0 None None] Network 3caceac7-eeca-4a3e-a461-b371f111f90d requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:17:54.944592 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-0b4b4942-d485-40cf-9bcf-567364fc81b4 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:54.946085 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-0b4b4942-d485-40cf-9bcf-567364fc81b4 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/networks?id=3caceac7-eeca-4a3e-a461-b371f111f90d HTTP/1.1" status: 200 len: 814 time: 0.1030486 Dec 09 22:17:54.964261 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-4ed5595b-7c50-4f33-9ebb-518f7394cc12 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/quotas/d0bfdd47813b42e6a73d42a79428b436 HTTP/1.1" status: 200 len: 375 time: 0.0098953 Dec 09 22:17:54.998422 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-085f194f-71d5-49d7-ba30-ed2ea1d6904e tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=d0bfdd47813b42e6a73d42a79428b436&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0269780 Dec 09 22:17:55.092649 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-28b6402f-d8a7-4e20-b511-73d5af8b4222 service neutron] 10.222.0.13 "GET /v2.0/networks/3caceac7-eeca-4a3e-a461-b371f111f90d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0867088 Dec 09 22:17:55.193729 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-8f6683c4-6a65-4998-985c-ae735aa0518a service neutron] 10.222.0.13 "GET /v2.0/networks/3caceac7-eeca-4a3e-a461-b371f111f90d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0942106 Dec 09 22:17:55.376587 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-647474a3-16ff-4464-a340-d5ba493ba1cd req-38ca4aab-f1ea-4da5-9b02-2fce5d15711c tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=8f111e13-a700-4424-a0b5-d9e5bf631bb4 HTTP/1.1" status: 200 len: 210 time: 0.0280600 Dec 09 22:17:56.477817 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c412b6f6-cb9f-41ef-941a-139c1da3c25f req-8688936d-b89e-4261-bdc1-3ac8e680d0ae tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=8f111e13-a700-4424-a0b5-d9e5bf631bb4 HTTP/1.1" status: 200 len: 210 time: 0.0291691 Dec 09 22:17:56.505294 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-5110b1f5-1619-4c4a-b226-45ea15f527f0 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:56.506775 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-5110b1f5-1619-4c4a-b226-45ea15f527f0 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.31 "GET /v2.0/networks?id=3caceac7-eeca-4a3e-a461-b371f111f90d HTTP/1.1" status: 200 len: 814 time: 0.1096673 Dec 09 22:17:56.520587 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-ee39179c-61a4-40c9-8511-5971f547d83e tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Request body: {'port': {'device_id': '8f111e13-a700-4424-a0b5-d9e5bf631bb4', 'network_id': '3caceac7-eeca-4a3e-a461-b371f111f90d', 'admin_state_up': True, 'tenant_id': 'd0bfdd47813b42e6a73d42a79428b436'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:17:56.640090 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-ee39179c-61a4-40c9-8511-5971f547d83e tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Made reservation on behalf of d0bfdd47813b42e6a73d42a79428b436 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:17:56.644715 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-ee39179c-61a4-40c9-8511-5971f547d83e tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:56.792697 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-ee39179c-61a4-40c9-8511-5971f547d83e tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Allocated IP 172.20.0.5 (3caceac7-eeca-4a3e-a461-b371f111f90d/7341cb79-5dc9-47ad-8465-c09aa84ad9cd/17d1e789-84ef-46af-bd7e-bd36ff63884d) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:17:56.944989 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-ee39179c-61a4-40c9-8511-5971f547d83e tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:56.982849 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-ee39179c-61a4-40c9-8511-5971f547d83e tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:57.031563 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-ee39179c-61a4-40c9-8511-5971f547d83e tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Network 3caceac7-eeca-4a3e-a461-b371f111f90d is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:17:57.036947 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-ee39179c-61a4-40c9-8511-5971f547d83e tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:17:57.041461 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-ee39179c-61a4-40c9-8511-5971f547d83e tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:17:57.045637 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee39179c-61a4-40c9-8511-5971f547d83e tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Pushing event updated for resources: {'Port': ['ID=17d1e789-84ef-46af-bd7e-bd36ff63884d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:17:57.094232 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-ee39179c-61a4-40c9-8511-5971f547d83e tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:57.094849 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-ee39179c-61a4-40c9-8511-5971f547d83e tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:57.114445 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-ee39179c-61a4-40c9-8511-5971f547d83e tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5976889 Dec 09 22:17:57.129779 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-9ef13d67-aeef-4003-9e8e-b69de38ba90d service neutron] Request body: {'port': {'device_id': '8f111e13-a700-4424-a0b5-d9e5bf631bb4', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:17:57.198589 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-9ef13d67-aeef-4003-9e8e-b69de38ba90d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:57.472104 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-9ef13d67-aeef-4003-9e8e-b69de38ba90d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 17d1e789-84ef-46af-bd7e-bd36ff63884d {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:17:57.480108 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-9ef13d67-aeef-4003-9e8e-b69de38ba90d service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:57.495396 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-9ef13d67-aeef-4003-9e8e-b69de38ba90d service neutron] Transition to ACTIVE for port object 17d1e789-84ef-46af-bd7e-bd36ff63884d will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:17:57.502310 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-9ef13d67-aeef-4003-9e8e-b69de38ba90d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:57.554600 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ef13d67-aeef-4003-9e8e-b69de38ba90d service neutron] Pushing event updated for resources: {'Port': ['ID=17d1e789-84ef-46af-bd7e-bd36ff63884d,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:17:57.599756 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19ceb018-74aa-4290-a049-1d82c818aa9e req-0aea30c6-1797-4e9e-a501-2dbc209335c9 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:57.601267 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19ceb018-74aa-4290-a049-1d82c818aa9e req-0aea30c6-1797-4e9e-a501-2dbc209335c9 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=8f111e13-a700-4424-a0b5-d9e5bf631bb4 HTTP/1.1" status: 200 len: 943 time: 0.0528660 Dec 09 22:17:57.625526 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-9ef13d67-aeef-4003-9e8e-b69de38ba90d service neutron] Attempting to bind port 17d1e789-84ef-46af-bd7e-bd36ff63884d on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:17:57.626010 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-9ef13d67-aeef-4003-9e8e-b69de38ba90d service neutron] Attempting to bind port 17d1e789-84ef-46af-bd7e-bd36ff63884d by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'd4bb457d-10ec-462e-b17c-f33f1d659499', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '3caceac7-eeca-4a3e-a461-b371f111f90d'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:17:57.626354 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-9ef13d67-aeef-4003-9e8e-b69de38ba90d service neutron] Attempting to bind port 17d1e789-84ef-46af-bd7e-bd36ff63884d on network 3caceac7-eeca-4a3e-a461-b371f111f90d {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:17:57.627805 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:57.631336 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-9ef13d67-aeef-4003-9e8e-b69de38ba90d service neutron] Port 17d1e789-84ef-46af-bd7e-bd36ff63884d on network 3caceac7-eeca-4a3e-a461-b371f111f90d not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:17:57.631698 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-9ef13d67-aeef-4003-9e8e-b69de38ba90d service neutron] Attempting to bind port 17d1e789-84ef-46af-bd7e-bd36ff63884d on network 3caceac7-eeca-4a3e-a461-b371f111f90d {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:17:57.636788 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-9ef13d67-aeef-4003-9e8e-b69de38ba90d service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 17, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:17:57.637128 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-9ef13d67-aeef-4003-9e8e-b69de38ba90d service neutron] Checking segment: {'id': 'd4bb457d-10ec-462e-b17c-f33f1d659499', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '3caceac7-eeca-4a3e-a461-b371f111f90d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:17:57.637511 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-9ef13d67-aeef-4003-9e8e-b69de38ba90d service neutron] Bound using segment: {'id': 'd4bb457d-10ec-462e-b17c-f33f1d659499', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '3caceac7-eeca-4a3e-a461-b371f111f90d'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:17:57.637929 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-9ef13d67-aeef-4003-9e8e-b69de38ba90d service neutron] Bound port: 17d1e789-84ef-46af-bd7e-bd36ff63884d, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd4bb457d-10ec-462e-b17c-f33f1d659499', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '3caceac7-eeca-4a3e-a461-b371f111f90d'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:17:57.638286 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-9ef13d67-aeef-4003-9e8e-b69de38ba90d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:57.651274 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19ceb018-74aa-4290-a049-1d82c818aa9e req-8a8ecc08-b56a-47d7-a7ee-58ce1c53d2ca tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430946 Dec 09 22:17:57.700171 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-9ef13d67-aeef-4003-9e8e-b69de38ba90d service neutron] For port 17d1e789-84ef-46af-bd7e-bd36ff63884d, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:17:57.703302 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-9ef13d67-aeef-4003-9e8e-b69de38ba90d service neutron] For port 17d1e789-84ef-46af-bd7e-bd36ff63884d, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=17d1e789-84ef-46af-bd7e-bd36ff63884d,segment=NetworkSegment(d4bb457d-10ec-462e-b17c-f33f1d659499),segment_id=d4bb457d-10ec-462e-b17c-f33f1d659499)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:17:57.709560 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-9ef13d67-aeef-4003-9e8e-b69de38ba90d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:57.740940 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:57.750396 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-9ef13d67-aeef-4003-9e8e-b69de38ba90d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:57.751024 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-9ef13d67-aeef-4003-9e8e-b69de38ba90d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:17:57.752726 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-9ef13d67-aeef-4003-9e8e-b69de38ba90d service neutron] 10.222.0.31 "PUT /v2.0/ports/17d1e789-84ef-46af-bd7e-bd36ff63884d HTTP/1.1" status: 200 len: 1092 time: 0.6293507 Dec 09 22:17:57.753170 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8f111e13-a700-4424-a0b5-d9e5bf631bb4', 'tag': '17d1e789-84ef-46af-bd7e-bd36ff63884d'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:17:57.755463 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4c92c6b1-e5a0-43ca-9415-6d6fc52512be" -d '{"events": [{"name": "network-changed", "server_uuid": "8f111e13-a700-4424-a0b5-d9e5bf631bb4", "tag": "17d1e789-84ef-46af-bd7e-bd36ff63884d"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:17:57.783941 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ef13d67-aeef-4003-9e8e-b69de38ba90d service neutron] Pushing event updated for resources: {'Port': ['ID=17d1e789-84ef-46af-bd7e-bd36ff63884d,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:17:57.799817 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:17:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-60de98d6-3042-4b4f-9c5e-d0aaa518f8c4 x-openstack-request-id: req-60de98d6-3042-4b4f-9c5e-d0aaa518f8c4 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:17:57.800139 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8f111e13-a700-4424-a0b5-d9e5bf631bb4", "tag": "17d1e789-84ef-46af-bd7e-bd36ff63884d", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:17:57.800392 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-60de98d6-3042-4b4f-9c5e-d0aaa518f8c4 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:17:57.800865 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8f111e13-a700-4424-a0b5-d9e5bf631bb4', 'tag': '17d1e789-84ef-46af-bd7e-bd36ff63884d', 'status': 'completed', 'code': 200} Dec 09 22:17:57.842743 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-b96282fd-33f5-4957-aa24-98ddd9f9b6e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:57.844301 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-b96282fd-33f5-4957-aa24-98ddd9f9b6e8 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d0bfdd47813b42e6a73d42a79428b436&device_id=8f111e13-a700-4424-a0b5-d9e5bf631bb4 HTTP/1.1" status: 200 len: 1095 time: 0.0426438 Dec 09 22:17:57.891058 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-f564dc71-a37a-471f-aefb-5980d25a54d1 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=17d1e789-84ef-46af-bd7e-bd36ff63884d HTTP/1.1" status: 200 len: 217 time: 0.0386755 Dec 09 22:17:57.942284 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-67070005-79bb-49f6-bb07-e7c92dcf6032 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:57.943815 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-67070005-79bb-49f6-bb07-e7c92dcf6032 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=7341cb79-5dc9-47ad-8465-c09aa84ad9cd HTTP/1.1" status: 200 len: 854 time: 0.0457954 Dec 09 22:17:57.976559 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-2d6c6f6c-7344-4682-a8ea-ae0e6a98fcaf service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=3caceac7-eeca-4a3e-a461-b371f111f90d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0257189 Dec 09 22:17:58.077023 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-68f9fde8-998c-41d6-87f8-33c68955ae23 service neutron] 10.222.0.31 "GET /v2.0/networks/3caceac7-eeca-4a3e-a461-b371f111f90d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0920343 Dec 09 22:17:58.169818 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f8066dcb-625f-4e21-8161-2f4570902ad7 req-50a134f9-89b8-4476-8d84-fc6adacbdf05 service neutron] 10.222.0.31 "GET /v2.0/networks/3caceac7-eeca-4a3e-a461-b371f111f90d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846140 Dec 09 22:17:58.264354 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c92c6b1-e5a0-43ca-9415-6d6fc52512be req-18938a90-50fb-4438-a0b0-f76bcae99eee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:58.265879 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4c92c6b1-e5a0-43ca-9415-6d6fc52512be req-18938a90-50fb-4438-a0b0-f76bcae99eee service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d0bfdd47813b42e6a73d42a79428b436&device_id=8f111e13-a700-4424-a0b5-d9e5bf631bb4 HTTP/1.1" status: 200 len: 1095 time: 0.0458412 Dec 09 22:17:58.357036 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c92c6b1-e5a0-43ca-9415-6d6fc52512be req-47b77b9c-d30d-498e-8c75-fbb292e62a46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:58.358473 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4c92c6b1-e5a0-43ca-9415-6d6fc52512be req-47b77b9c-d30d-498e-8c75-fbb292e62a46 service neutron] 10.222.0.31 "GET /v2.0/networks?id=3caceac7-eeca-4a3e-a461-b371f111f90d HTTP/1.1" status: 200 len: 915 time: 0.0848577 Dec 09 22:17:58.414445 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4c92c6b1-e5a0-43ca-9415-6d6fc52512be req-c2ba78e4-099e-4850-85d0-81f2e2471cea service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=17d1e789-84ef-46af-bd7e-bd36ff63884d HTTP/1.1" status: 200 len: 217 time: 0.0471008 Dec 09 22:17:58.469656 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c92c6b1-e5a0-43ca-9415-6d6fc52512be req-bd31a422-b514-4e14-ab7c-8f96438963af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:58.471329 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4c92c6b1-e5a0-43ca-9415-6d6fc52512be req-bd31a422-b514-4e14-ab7c-8f96438963af service neutron] 10.222.0.31 "GET /v2.0/subnets?id=7341cb79-5dc9-47ad-8465-c09aa84ad9cd HTTP/1.1" status: 200 len: 854 time: 0.0488954 Dec 09 22:17:58.503342 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4c92c6b1-e5a0-43ca-9415-6d6fc52512be req-a571239b-a96f-4dba-9e00-bbefc2518685 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=3caceac7-eeca-4a3e-a461-b371f111f90d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0244586 Dec 09 22:17:58.599716 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4c92c6b1-e5a0-43ca-9415-6d6fc52512be req-0899447d-41e1-4ac8-b415-bc87396f2b75 service neutron] 10.222.0.31 "GET /v2.0/networks/3caceac7-eeca-4a3e-a461-b371f111f90d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0882938 Dec 09 22:17:58.695782 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4c92c6b1-e5a0-43ca-9415-6d6fc52512be req-e48c6307-900d-474d-b5a4-3421ff1bc6bd service neutron] 10.222.0.31 "GET /v2.0/networks/3caceac7-eeca-4a3e-a461-b371f111f90d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0881221 Dec 09 22:17:58.778162 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8344213-a25d-4748-8698-c5957d564082 req-47382709-5f0c-479d-8f99-a20f2a196e7e tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:58.779668 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8344213-a25d-4748-8698-c5957d564082 req-47382709-5f0c-479d-8f99-a20f2a196e7e tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=8f111e13-a700-4424-a0b5-d9e5bf631bb4 HTTP/1.1" status: 200 len: 943 time: 0.0553885 Dec 09 22:17:58.834195 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e8344213-a25d-4748-8698-c5957d564082 req-b1b60182-aef7-4280-972f-68414547d6dd tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463986 Dec 09 22:17:59.957420 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a84fa9c-f8e6-4e8a-8e57-2497cacda407 req-377d2345-a281-40e5-9983-40296fe32124 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:17:59.958889 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5a84fa9c-f8e6-4e8a-8e57-2497cacda407 req-377d2345-a281-40e5-9983-40296fe32124 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=8f111e13-a700-4424-a0b5-d9e5bf631bb4 HTTP/1.1" status: 200 len: 943 time: 0.0514834 Dec 09 22:18:00.005805 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5a84fa9c-f8e6-4e8a-8e57-2497cacda407 req-23a141dd-63ef-415e-a322-c180810443d5 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407898 Dec 09 22:18:00.945116 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 17d1e789-84ef-46af-bd7e-bd36ff63884d details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:18:01.137373 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deb3976b-f165-4f65-9499-3b5c4d42caec req-a1b6231d-09c5-4246-aed9-32ecbe145c27 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:01.138937 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-deb3976b-f165-4f65-9499-3b5c4d42caec req-a1b6231d-09c5-4246-aed9-32ecbe145c27 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=8f111e13-a700-4424-a0b5-d9e5bf631bb4 HTTP/1.1" status: 200 len: 943 time: 0.0551767 Dec 09 22:18:01.195885 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-deb3976b-f165-4f65-9499-3b5c4d42caec req-0287064c-9840-4829-8c87-7ebc87240ca2 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0507805 Dec 09 22:18:01.213932 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 17d1e789-84ef-46af-bd7e-bd36ff63884d, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=17d1e789-84ef-46af-bd7e-bd36ff63884d,segment=NetworkSegment(d4bb457d-10ec-462e-b17c-f33f1d659499),segment_id=d4bb457d-10ec-462e-b17c-f33f1d659499)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:01.225054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '17d1e789-84ef-46af-bd7e-bd36ff63884d', 'network_id': '3caceac7-eeca-4a3e-a461-b371f111f90d', 'port_id': '17d1e789-84ef-46af-bd7e-bd36ff63884d', 'mac_address': 'fa:16:3e:b0:46:7a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 107, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7341cb79-5dc9-47ad-8465-c09aa84ad9cd', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:18:01.262610 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:01.275656 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 17d1e789-84ef-46af-bd7e-bd36ff63884d {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:18:01.295973 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 17d1e789-84ef-46af-bd7e-bd36ff63884d, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=17d1e789-84ef-46af-bd7e-bd36ff63884d,segment=NetworkSegment(d4bb457d-10ec-462e-b17c-f33f1d659499),segment_id=d4bb457d-10ec-462e-b17c-f33f1d659499)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:01.302271 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:01.351238 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=17d1e789-84ef-46af-bd7e-bd36ff63884d,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:01.532396 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['17d1e789-84ef-46af-bd7e-bd36ff63884d'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:18:02.330337 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b5da728-cc8c-4a9c-b909-9cd28414728e req-74dab709-fbee-4e89-a0d2-a0b747e1ab21 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:02.332146 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b5da728-cc8c-4a9c-b909-9cd28414728e req-74dab709-fbee-4e89-a0d2-a0b747e1ab21 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=8f111e13-a700-4424-a0b5-d9e5bf631bb4 HTTP/1.1" status: 200 len: 944 time: 0.0574691 Dec 09 22:18:02.381851 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9b5da728-cc8c-4a9c-b909-9cd28414728e req-93fcd1c2-428c-42c0-a74f-1ea67fad6c77 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430007 Dec 09 22:18:02.973189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 17d1e789-84ef-46af-bd7e-bd36ff63884d up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:18:03.028374 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0e5ccbab-32fc-4df0-8bde-3f3a3471ebf2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:03.044554 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 17d1e789-84ef-46af-bd7e-bd36ff63884d completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:18:03.048292 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 17d1e789-84ef-46af-bd7e-bd36ff63884d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:03.048665 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:03.128532 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:03.151933 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8f111e13-a700-4424-a0b5-d9e5bf631bb4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '17d1e789-84ef-46af-bd7e-bd36ff63884d'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:18:03.154222 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-633c22e3-7010-40e1-8362-435580c13dad" -d '{"events": [{"server_uuid": "8f111e13-a700-4424-a0b5-d9e5bf631bb4", "name": "network-vif-plugged", "status": "completed", "tag": "17d1e789-84ef-46af-bd7e-bd36ff63884d"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:18:03.167945 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 17d1e789-84ef-46af-bd7e-bd36ff63884d, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=17d1e789-84ef-46af-bd7e-bd36ff63884d,segment=NetworkSegment(d4bb457d-10ec-462e-b17c-f33f1d659499),segment_id=d4bb457d-10ec-462e-b17c-f33f1d659499)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:03.172812 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:03.198204 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:18:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-07da5dec-3538-4be9-8c1d-dc11a51705bc x-openstack-request-id: req-07da5dec-3538-4be9-8c1d-dc11a51705bc {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:18:03.198502 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8f111e13-a700-4424-a0b5-d9e5bf631bb4", "name": "network-vif-plugged", "status": "completed", "tag": "17d1e789-84ef-46af-bd7e-bd36ff63884d", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:18:03.198727 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-07da5dec-3538-4be9-8c1d-dc11a51705bc {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:18:03.199151 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8f111e13-a700-4424-a0b5-d9e5bf631bb4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '17d1e789-84ef-46af-bd7e-bd36ff63884d', 'code': 200} Dec 09 22:18:03.226495 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=17d1e789-84ef-46af-bd7e-bd36ff63884d,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:03.290001 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db73d8c5-83c1-49ed-a46a-fc6b5c27ad1f req-03b95c94-41c8-4f2c-888f-60df9f9fe513 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:03.291548 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-db73d8c5-83c1-49ed-a46a-fc6b5c27ad1f req-03b95c94-41c8-4f2c-888f-60df9f9fe513 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=8f111e13-a700-4424-a0b5-d9e5bf631bb4 HTTP/1.1" status: 200 len: 1097 time: 0.0413010 Dec 09 22:18:03.343637 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-db73d8c5-83c1-49ed-a46a-fc6b5c27ad1f req-19124af0-d31d-432e-b4ea-8f0b8b10a780 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448902 Dec 09 22:18:03.504908 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a276ef4-58e6-467f-8f13-ef8d17cdb5cb req-23ba46d9-4978-465f-8a6f-a64e6a284bc6 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:03.506426 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a276ef4-58e6-467f-8f13-ef8d17cdb5cb req-23ba46d9-4978-465f-8a6f-a64e6a284bc6 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=8f111e13-a700-4424-a0b5-d9e5bf631bb4 HTTP/1.1" status: 200 len: 945 time: 0.0503943 Dec 09 22:18:03.559813 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a276ef4-58e6-467f-8f13-ef8d17cdb5cb req-7b37c7d9-664f-49e6-8e83-a8877efc4520 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468595 Dec 09 22:18:04.698505 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b220ed-9d6d-433e-a170-d9503f600ae6 req-987968a6-b4fe-45c1-9383-a632355dbdd8 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:04.700017 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a8b220ed-9d6d-433e-a170-d9503f600ae6 req-987968a6-b4fe-45c1-9383-a632355dbdd8 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=8f111e13-a700-4424-a0b5-d9e5bf631bb4 HTTP/1.1" status: 200 len: 945 time: 0.0589068 Dec 09 22:18:04.753333 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a8b220ed-9d6d-433e-a170-d9503f600ae6 req-9c122ce2-4c82-43cf-be8b-002695c832d6 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445180 Dec 09 22:18:04.988833 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-b6190fdd-2656-4e8c-a295-b7314dfb86b9 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:04.990338 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-b6190fdd-2656-4e8c-a295-b7314dfb86b9 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/networks?id=3caceac7-eeca-4a3e-a461-b371f111f90d HTTP/1.1" status: 200 len: 814 time: 0.1088758 Dec 09 22:18:05.006686 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-fdf645d0-6166-40ad-bdf3-a7823dcab91f tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/quotas/d0bfdd47813b42e6a73d42a79428b436 HTTP/1.1" status: 200 len: 375 time: 0.0097752 Dec 09 22:18:05.064209 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-7949c62b-ade2-4a01-a74f-345a754e04d3 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=d0bfdd47813b42e6a73d42a79428b436&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0507050 Dec 09 22:18:05.163887 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-d999cf91-4928-4634-a1ff-1428df59778f service neutron] 10.222.0.13 "GET /v2.0/networks/3caceac7-eeca-4a3e-a461-b371f111f90d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0931733 Dec 09 22:18:05.265036 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-9c8f81b1-c133-46cc-a4e0-20578296f1ac service neutron] 10.222.0.13 "GET /v2.0/networks/3caceac7-eeca-4a3e-a461-b371f111f90d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0947330 Dec 09 22:18:05.437983 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-12fe443f-a226-4c05-9b3a-1851a6fbae0f req-5ba6cd2a-fbe5-41f5-9c6a-a0f684f15ccb tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=6b516a9c-fd0a-40b3-b181-6719501dc9cc HTTP/1.1" status: 200 len: 210 time: 0.0278091 Dec 09 22:18:05.652784 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-16fd3e5e-a7fa-4239-894c-037daf6e8c99 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:06.500295 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-992955de-7c90-4289-a91e-c2f72b460ff9 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:06.501857 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-992955de-7c90-4289-a91e-c2f72b460ff9 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.10 "GET /v2.0/networks?id=3caceac7-eeca-4a3e-a461-b371f111f90d HTTP/1.1" status: 200 len: 814 time: 0.1164908 Dec 09 22:18:06.528843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-96b97660-6b60-407e-a434-4747606af3b8 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Request body: {'port': {'device_id': '6b516a9c-fd0a-40b3-b181-6719501dc9cc', 'network_id': '3caceac7-eeca-4a3e-a461-b371f111f90d', 'admin_state_up': True, 'tenant_id': 'd0bfdd47813b42e6a73d42a79428b436'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:06.547338 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c185f421-45be-4797-97a4-d30f6f79be24 req-97c35c0c-72fd-43c3-ab87-ed03796d1f77 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=6b516a9c-fd0a-40b3-b181-6719501dc9cc HTTP/1.1" status: 200 len: 210 time: 0.0384660 Dec 09 22:18:06.668746 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-96b97660-6b60-407e-a434-4747606af3b8 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Made reservation on behalf of d0bfdd47813b42e6a73d42a79428b436 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:18:06.673401 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-96b97660-6b60-407e-a434-4747606af3b8 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:06.691535 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dbc757dd-0171-4b3e-b4e6-520371f30d52 req-675ebd3f-1ed0-40b8-86fa-4ebc65375c9f service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=8f111e13-a700-4424-a0b5-d9e5bf631bb4&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0565486 Dec 09 22:18:06.773730 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbc757dd-0171-4b3e-b4e6-520371f30d52 req-b7e858ee-6f17-4a35-8598-f5cfd68c530f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:06.775297 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dbc757dd-0171-4b3e-b4e6-520371f30d52 req-b7e858ee-6f17-4a35-8598-f5cfd68c530f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=d0bfdd47813b42e6a73d42a79428b436&device_id=8f111e13-a700-4424-a0b5-d9e5bf631bb4 HTTP/1.1" status: 200 len: 1097 time: 0.0415411 Dec 09 22:18:06.827278 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-96b97660-6b60-407e-a434-4747606af3b8 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Allocated IP 172.20.0.12 (3caceac7-eeca-4a3e-a461-b371f111f90d/7341cb79-5dc9-47ad-8465-c09aa84ad9cd/fb02c343-d6c2-4635-90b4-96482b43ae7d) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:18:06.836145 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:06.889577 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbc757dd-0171-4b3e-b4e6-520371f30d52 req-ea9d02cb-7aa0-4eac-8ab4-55dbf5e4ce6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:06.891090 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dbc757dd-0171-4b3e-b4e6-520371f30d52 req-ea9d02cb-7aa0-4eac-8ab4-55dbf5e4ce6c service neutron] 10.222.0.31 "GET /v2.0/networks?id=3caceac7-eeca-4a3e-a461-b371f111f90d HTTP/1.1" status: 200 len: 915 time: 0.0958753 Dec 09 22:18:06.935745 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dbc757dd-0171-4b3e-b4e6-520371f30d52 req-6e0ce8ac-4445-4e47-826c-00bda16a9b71 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=17d1e789-84ef-46af-bd7e-bd36ff63884d HTTP/1.1" status: 200 len: 217 time: 0.0375028 Dec 09 22:18:06.992321 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbc757dd-0171-4b3e-b4e6-520371f30d52 req-35fdb580-6832-4ea3-9771-eec90c585c5a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:06.994089 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-96b97660-6b60-407e-a434-4747606af3b8 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:06.995483 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dbc757dd-0171-4b3e-b4e6-520371f30d52 req-35fdb580-6832-4ea3-9771-eec90c585c5a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=7341cb79-5dc9-47ad-8465-c09aa84ad9cd HTTP/1.1" status: 200 len: 854 time: 0.0520117 Dec 09 22:18:07.028151 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dbc757dd-0171-4b3e-b4e6-520371f30d52 req-6b19d854-05f1-4ee5-a04f-b817693f3dae service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=3caceac7-eeca-4a3e-a461-b371f111f90d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0258741 Dec 09 22:18:07.035540 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-96b97660-6b60-407e-a434-4747606af3b8 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:07.048797 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['17d1e789-84ef-46af-bd7e-bd36ff63884d'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:18:07.080903 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-96b97660-6b60-407e-a434-4747606af3b8 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Network 3caceac7-eeca-4a3e-a461-b371f111f90d is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:18:07.084348 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-96b97660-6b60-407e-a434-4747606af3b8 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:18:07.093356 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-96b97660-6b60-407e-a434-4747606af3b8 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:18:07.138688 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96b97660-6b60-407e-a434-4747606af3b8 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Pushing event updated for resources: {'Port': ['ID=fb02c343-d6c2-4635-90b4-96482b43ae7d,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:07.161564 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dbc757dd-0171-4b3e-b4e6-520371f30d52 req-e39fa7fe-2ec4-4966-b240-db7b384c3ece service neutron] 10.222.0.31 "GET /v2.0/networks/3caceac7-eeca-4a3e-a461-b371f111f90d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1260309 Dec 09 22:18:07.174146 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-96b97660-6b60-407e-a434-4747606af3b8 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:07.175020 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-96b97660-6b60-407e-a434-4747606af3b8 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:07.195966 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-96b97660-6b60-407e-a434-4747606af3b8 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6721129 Dec 09 22:18:07.209495 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-5ae74db1-a050-4e9c-ad95-4486990d0f36 service neutron] Request body: {'port': {'device_id': '6b516a9c-fd0a-40b3-b181-6719501dc9cc', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:07.264580 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-dbc757dd-0171-4b3e-b4e6-520371f30d52 req-3d272155-be36-455f-891a-dc963dc9c283 service neutron] 10.222.0.31 "GET /v2.0/networks/3caceac7-eeca-4a3e-a461-b371f111f90d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0955322 Dec 09 22:18:07.267932 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-5ae74db1-a050-4e9c-ad95-4486990d0f36 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:07.545192 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-5ae74db1-a050-4e9c-ad95-4486990d0f36 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fb02c343-d6c2-4635-90b4-96482b43ae7d {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:18:07.553354 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-5ae74db1-a050-4e9c-ad95-4486990d0f36 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:07.566516 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-5ae74db1-a050-4e9c-ad95-4486990d0f36 service neutron] Transition to ACTIVE for port object fb02c343-d6c2-4635-90b4-96482b43ae7d will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:18:07.571850 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-5ae74db1-a050-4e9c-ad95-4486990d0f36 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:07.672074 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ae74db1-a050-4e9c-ad95-4486990d0f36 service neutron] Pushing event updated for resources: {'Port': ['ID=fb02c343-d6c2-4635-90b4-96482b43ae7d,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:07.749557 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb3da08a-3806-4015-b22f-200d6fa62eba req-396bbc12-a4fa-4ff1-a20f-62eb8f029b15 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:07.750972 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bb3da08a-3806-4015-b22f-200d6fa62eba req-396bbc12-a4fa-4ff1-a20f-62eb8f029b15 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=6b516a9c-fd0a-40b3-b181-6719501dc9cc HTTP/1.1" status: 200 len: 944 time: 0.1169672 Dec 09 22:18:07.753525 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-5ae74db1-a050-4e9c-ad95-4486990d0f36 service neutron] Attempting to bind port fb02c343-d6c2-4635-90b4-96482b43ae7d on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:18:07.753857 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-5ae74db1-a050-4e9c-ad95-4486990d0f36 service neutron] Attempting to bind port fb02c343-d6c2-4635-90b4-96482b43ae7d by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'd4bb457d-10ec-462e-b17c-f33f1d659499', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '3caceac7-eeca-4a3e-a461-b371f111f90d'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:18:07.754182 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-5ae74db1-a050-4e9c-ad95-4486990d0f36 service neutron] Attempting to bind port fb02c343-d6c2-4635-90b4-96482b43ae7d on network 3caceac7-eeca-4a3e-a461-b371f111f90d {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:18:07.766071 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-5ae74db1-a050-4e9c-ad95-4486990d0f36 service neutron] Port fb02c343-d6c2-4635-90b4-96482b43ae7d on network 3caceac7-eeca-4a3e-a461-b371f111f90d not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:18:07.766431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-5ae74db1-a050-4e9c-ad95-4486990d0f36 service neutron] Attempting to bind port fb02c343-d6c2-4635-90b4-96482b43ae7d on network 3caceac7-eeca-4a3e-a461-b371f111f90d {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:18:07.773122 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-5ae74db1-a050-4e9c-ad95-4486990d0f36 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 17, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:18:07.773475 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-5ae74db1-a050-4e9c-ad95-4486990d0f36 service neutron] Checking segment: {'id': 'd4bb457d-10ec-462e-b17c-f33f1d659499', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '3caceac7-eeca-4a3e-a461-b371f111f90d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:18:07.773846 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-5ae74db1-a050-4e9c-ad95-4486990d0f36 service neutron] Bound using segment: {'id': 'd4bb457d-10ec-462e-b17c-f33f1d659499', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '3caceac7-eeca-4a3e-a461-b371f111f90d'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:18:07.774267 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-5ae74db1-a050-4e9c-ad95-4486990d0f36 service neutron] Bound port: fb02c343-d6c2-4635-90b4-96482b43ae7d, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd4bb457d-10ec-462e-b17c-f33f1d659499', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 107, 'network_id': '3caceac7-eeca-4a3e-a461-b371f111f90d'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:18:07.774622 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-5ae74db1-a050-4e9c-ad95-4486990d0f36 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:07.845928 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bb3da08a-3806-4015-b22f-200d6fa62eba req-6f2f7d46-e079-4378-a044-411b06fbb38e tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0881789 Dec 09 22:18:07.877216 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-5ae74db1-a050-4e9c-ad95-4486990d0f36 service neutron] For port fb02c343-d6c2-4635-90b4-96482b43ae7d, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:18:07.880868 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-5ae74db1-a050-4e9c-ad95-4486990d0f36 service neutron] For port fb02c343-d6c2-4635-90b4-96482b43ae7d, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=fb02c343-d6c2-4635-90b4-96482b43ae7d,segment=NetworkSegment(d4bb457d-10ec-462e-b17c-f33f1d659499),segment_id=d4bb457d-10ec-462e-b17c-f33f1d659499)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:18:07.888501 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-5ae74db1-a050-4e9c-ad95-4486990d0f36 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:07.923766 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-5ae74db1-a050-4e9c-ad95-4486990d0f36 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:07.924405 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-5ae74db1-a050-4e9c-ad95-4486990d0f36 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:07.925778 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-5ae74db1-a050-4e9c-ad95-4486990d0f36 service neutron] 10.222.0.10 "PUT /v2.0/ports/fb02c343-d6c2-4635-90b4-96482b43ae7d HTTP/1.1" status: 200 len: 1093 time: 0.7205508 Dec 09 22:18:07.926198 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6b516a9c-fd0a-40b3-b181-6719501dc9cc', 'tag': 'fb02c343-d6c2-4635-90b4-96482b43ae7d'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:18:07.928448 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5e18dd5a-4755-49e2-81e3-34b72436d6d7" -d '{"events": [{"name": "network-changed", "server_uuid": "6b516a9c-fd0a-40b3-b181-6719501dc9cc", "tag": "fb02c343-d6c2-4635-90b4-96482b43ae7d"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:18:07.953640 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ae74db1-a050-4e9c-ad95-4486990d0f36 service neutron] Pushing event updated for resources: {'Port': ['ID=fb02c343-d6c2-4635-90b4-96482b43ae7d,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:08.015196 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-0c719501-b4c4-42f3-b94f-103c0e602aa0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:08.016745 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-0c719501-b4c4-42f3-b94f-103c0e602aa0 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=d0bfdd47813b42e6a73d42a79428b436&device_id=6b516a9c-fd0a-40b3-b181-6719501dc9cc HTTP/1.1" status: 200 len: 1096 time: 0.0472164 Dec 09 22:18:08.062805 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-c7f413d6-3cfc-4b0b-b15f-0f9e05d6eb03 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=fb02c343-d6c2-4635-90b4-96482b43ae7d HTTP/1.1" status: 200 len: 217 time: 0.0375655 Dec 09 22:18:08.124251 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-2f97604e-d066-4d63-af80-a5f6b85f01db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:08.125811 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-2f97604e-d066-4d63-af80-a5f6b85f01db service neutron] 10.222.0.10 "GET /v2.0/subnets?id=7341cb79-5dc9-47ad-8465-c09aa84ad9cd HTTP/1.1" status: 200 len: 854 time: 0.0561628 Dec 09 22:18:08.164819 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-d9aa58a9-646f-46aa-be0f-84da21367f2d service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=3caceac7-eeca-4a3e-a461-b371f111f90d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0314715 Dec 09 22:18:08.182879 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:08.264420 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-37b490ec-ab76-4dc4-85a4-fc16f8816c06 service neutron] 10.222.0.10 "GET /v2.0/networks/3caceac7-eeca-4a3e-a461-b371f111f90d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0909503 Dec 09 22:18:08.269032 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:18:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ce7f743e-a761-4c95-aabb-3c80545bb7e7 x-openstack-request-id: req-ce7f743e-a761-4c95-aabb-3c80545bb7e7 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:18:08.269319 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6b516a9c-fd0a-40b3-b181-6719501dc9cc", "tag": "fb02c343-d6c2-4635-90b4-96482b43ae7d", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:18:08.269569 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-ce7f743e-a761-4c95-aabb-3c80545bb7e7 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:18:08.269961 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6b516a9c-fd0a-40b3-b181-6719501dc9cc', 'tag': 'fb02c343-d6c2-4635-90b4-96482b43ae7d', 'status': 'completed', 'code': 200} Dec 09 22:18:08.369132 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5849eaaa-5844-4ec4-9fc6-5f27d950125b req-aaa6e466-5f68-41cb-989f-10d1727deaf1 service neutron] 10.222.0.10 "GET /v2.0/networks/3caceac7-eeca-4a3e-a461-b371f111f90d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0962930 Dec 09 22:18:08.466348 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e18dd5a-4755-49e2-81e3-34b72436d6d7 req-263fa516-7acd-449a-9b73-fe1858a27e4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:08.467881 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e18dd5a-4755-49e2-81e3-34b72436d6d7 req-263fa516-7acd-449a-9b73-fe1858a27e4e service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=d0bfdd47813b42e6a73d42a79428b436&device_id=6b516a9c-fd0a-40b3-b181-6719501dc9cc HTTP/1.1" status: 200 len: 1096 time: 0.0438604 Dec 09 22:18:08.566288 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e18dd5a-4755-49e2-81e3-34b72436d6d7 req-8563f38a-a824-4e2f-81d6-41eba8762829 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:08.567695 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e18dd5a-4755-49e2-81e3-34b72436d6d7 req-8563f38a-a824-4e2f-81d6-41eba8762829 service neutron] 10.222.0.10 "GET /v2.0/networks?id=3caceac7-eeca-4a3e-a461-b371f111f90d HTTP/1.1" status: 200 len: 915 time: 0.0928831 Dec 09 22:18:08.622386 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e18dd5a-4755-49e2-81e3-34b72436d6d7 req-a7f30f64-8b1b-4d27-b6d6-71e56ba572f6 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=fb02c343-d6c2-4635-90b4-96482b43ae7d HTTP/1.1" status: 200 len: 217 time: 0.0466030 Dec 09 22:18:08.676255 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e18dd5a-4755-49e2-81e3-34b72436d6d7 req-cc14ada9-425a-4acc-9bcc-969ef68eeaf2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:08.677749 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e18dd5a-4755-49e2-81e3-34b72436d6d7 req-cc14ada9-425a-4acc-9bcc-969ef68eeaf2 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=7341cb79-5dc9-47ad-8465-c09aa84ad9cd HTTP/1.1" status: 200 len: 854 time: 0.0470078 Dec 09 22:18:08.720932 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e18dd5a-4755-49e2-81e3-34b72436d6d7 req-0e44a55a-5a43-4295-be69-b85295148492 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=3caceac7-eeca-4a3e-a461-b371f111f90d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0353634 Dec 09 22:18:08.821085 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e18dd5a-4755-49e2-81e3-34b72436d6d7 req-b1e1d5ee-4e4e-4db3-a928-692f5ef2556c service neutron] 10.222.0.10 "GET /v2.0/networks/3caceac7-eeca-4a3e-a461-b371f111f90d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0918269 Dec 09 22:18:09.241994 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e18dd5a-4755-49e2-81e3-34b72436d6d7 req-043f8e83-92d4-4b64-937d-0fe4c7855931 service neutron] 10.222.0.10 "GET /v2.0/networks/3caceac7-eeca-4a3e-a461-b371f111f90d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4131722 Dec 09 22:18:09.254080 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-568e3dfe-1504-4a35-98cf-fa120168f5a1 req-71f8b7ef-8430-4954-9862-3b2bb0b5eb9b tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:09.255493 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-568e3dfe-1504-4a35-98cf-fa120168f5a1 req-71f8b7ef-8430-4954-9862-3b2bb0b5eb9b tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=6b516a9c-fd0a-40b3-b181-6719501dc9cc HTTP/1.1" status: 200 len: 944 time: 0.0684423 Dec 09 22:18:09.304455 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-568e3dfe-1504-4a35-98cf-fa120168f5a1 req-cef4dc8f-17a6-4003-851b-9ff523fd789b tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417247 Dec 09 22:18:09.686295 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:10.437790 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0942af77-acf5-4a43-88f0-b1805b936ae3 req-47fa1cac-c77c-497f-adf3-bafa857d1b23 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:10.439263 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0942af77-acf5-4a43-88f0-b1805b936ae3 req-47fa1cac-c77c-497f-adf3-bafa857d1b23 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=6b516a9c-fd0a-40b3-b181-6719501dc9cc HTTP/1.1" status: 200 len: 944 time: 0.0574586 Dec 09 22:18:10.491514 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0942af77-acf5-4a43-88f0-b1805b936ae3 req-cab9fdeb-7125-4d5c-b70e-20fcdcff1dc7 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461416 Dec 09 22:18:10.920169 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device fb02c343-d6c2-4635-90b4-96482b43ae7d details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:18:11.030526 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port fb02c343-d6c2-4635-90b4-96482b43ae7d, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=fb02c343-d6c2-4635-90b4-96482b43ae7d,segment=NetworkSegment(d4bb457d-10ec-462e-b17c-f33f1d659499),segment_id=d4bb457d-10ec-462e-b17c-f33f1d659499)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:11.045178 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'fb02c343-d6c2-4635-90b4-96482b43ae7d', 'network_id': '3caceac7-eeca-4a3e-a461-b371f111f90d', 'port_id': 'fb02c343-d6c2-4635-90b4-96482b43ae7d', 'mac_address': 'fa:16:3e:a4:0b:c3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 107, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7341cb79-5dc9-47ad-8465-c09aa84ad9cd', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:18:11.089959 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:11.103280 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fb02c343-d6c2-4635-90b4-96482b43ae7d {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:18:11.122793 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port fb02c343-d6c2-4635-90b4-96482b43ae7d, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=fb02c343-d6c2-4635-90b4-96482b43ae7d,segment=NetworkSegment(d4bb457d-10ec-462e-b17c-f33f1d659499),segment_id=d4bb457d-10ec-462e-b17c-f33f1d659499)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:11.130137 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:11.177959 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=fb02c343-d6c2-4635-90b4-96482b43ae7d,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:11.318670 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['fb02c343-d6c2-4635-90b4-96482b43ae7d'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:18:11.625158 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc8d029b-dd66-4d69-ad07-bd301917e3f5 req-cb39a413-1bd6-49d2-ae87-5ac33ac6fbe5 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:11.626634 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cc8d029b-dd66-4d69-ad07-bd301917e3f5 req-cb39a413-1bd6-49d2-ae87-5ac33ac6fbe5 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=6b516a9c-fd0a-40b3-b181-6719501dc9cc HTTP/1.1" status: 200 len: 945 time: 0.0531974 Dec 09 22:18:11.676538 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cc8d029b-dd66-4d69-ad07-bd301917e3f5 req-61d71b43-2105-4e69-901f-5964d712f388 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411355 Dec 09 22:18:12.809277 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b57aa876-fdcd-4b22-a78d-485faafc0d7e req-91533707-57c6-46b1-a55a-053fd165c57e tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:12.810800 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b57aa876-fdcd-4b22-a78d-485faafc0d7e req-91533707-57c6-46b1-a55a-053fd165c57e tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=6b516a9c-fd0a-40b3-b181-6719501dc9cc HTTP/1.1" status: 200 len: 945 time: 0.0557909 Dec 09 22:18:12.858480 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b57aa876-fdcd-4b22-a78d-485faafc0d7e req-87e23e40-ce5d-4700-93a8-31d12073d112 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415230 Dec 09 22:18:12.935395 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device fb02c343-d6c2-4635-90b4-96482b43ae7d up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:18:12.991521 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port fb02c343-d6c2-4635-90b4-96482b43ae7d completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:18:12.997232 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port fb02c343-d6c2-4635-90b4-96482b43ae7d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:12.997840 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:13.083123 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:13.105524 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6b516a9c-fd0a-40b3-b181-6719501dc9cc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fb02c343-d6c2-4635-90b4-96482b43ae7d'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:18:13.107784 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0d89b9ba-e82a-4624-9cdd-d04282c404ff" -d '{"events": [{"server_uuid": "6b516a9c-fd0a-40b3-b181-6719501dc9cc", "name": "network-vif-plugged", "status": "completed", "tag": "fb02c343-d6c2-4635-90b4-96482b43ae7d"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:18:13.120353 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port fb02c343-d6c2-4635-90b4-96482b43ae7d, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=fb02c343-d6c2-4635-90b4-96482b43ae7d,segment=NetworkSegment(d4bb457d-10ec-462e-b17c-f33f1d659499),segment_id=d4bb457d-10ec-462e-b17c-f33f1d659499)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:13.125151 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:13.147964 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:18:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0ebb7a64-5c1f-45f7-8b1c-154474764f66 x-openstack-request-id: req-0ebb7a64-5c1f-45f7-8b1c-154474764f66 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:18:13.148279 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6b516a9c-fd0a-40b3-b181-6719501dc9cc", "name": "network-vif-plugged", "status": "completed", "tag": "fb02c343-d6c2-4635-90b4-96482b43ae7d", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:18:13.148505 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0ebb7a64-5c1f-45f7-8b1c-154474764f66 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:18:13.148902 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6b516a9c-fd0a-40b3-b181-6719501dc9cc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fb02c343-d6c2-4635-90b4-96482b43ae7d', 'code': 200} Dec 09 22:18:13.174880 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=fb02c343-d6c2-4635-90b4-96482b43ae7d,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:13.264885 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e52182a-0547-474b-9acb-7e5d2f27b380 req-a8c6c06d-869b-4b2a-a25d-fb25a443a370 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:13.267026 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8e52182a-0547-474b-9acb-7e5d2f27b380 req-a8c6c06d-869b-4b2a-a25d-fb25a443a370 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=6b516a9c-fd0a-40b3-b181-6719501dc9cc HTTP/1.1" status: 200 len: 1098 time: 0.0604322 Dec 09 22:18:13.314435 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8e52182a-0547-474b-9acb-7e5d2f27b380 req-b90848af-fd33-4f84-8c6b-89f86e29ec2d service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397830 Dec 09 22:18:14.010019 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22f0c5e7-4c1f-44e5-8249-99d5b1977af9 req-9472d180-f295-442d-8d57-30bf795a32ad tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:14.011769 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22f0c5e7-4c1f-44e5-8249-99d5b1977af9 req-9472d180-f295-442d-8d57-30bf795a32ad tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=6b516a9c-fd0a-40b3-b181-6719501dc9cc HTTP/1.1" status: 200 len: 946 time: 0.0584378 Dec 09 22:18:14.058715 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22f0c5e7-4c1f-44e5-8249-99d5b1977af9 req-fffa6336-24bf-49f2-a74c-0d5ad0733400 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408194 Dec 09 22:18:15.181738 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60216e6f-4997-4fb6-9ed7-a106e50430a1 req-835154d4-de9c-42bb-8d6c-0e3632c72aa9 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:15.183286 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60216e6f-4997-4fb6-9ed7-a106e50430a1 req-835154d4-de9c-42bb-8d6c-0e3632c72aa9 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=6b516a9c-fd0a-40b3-b181-6719501dc9cc HTTP/1.1" status: 200 len: 946 time: 0.0523374 Dec 09 22:18:15.235696 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60216e6f-4997-4fb6-9ed7-a106e50430a1 req-9937d0f3-f2bb-4c6b-bdcc-e9ee42f46fdf tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463862 Dec 09 22:18:15.479278 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7eb71f5-9328-4692-8885-385b8719e7b5 req-e0aaa91e-c51c-4729-a23e-9bb047dbb4e1 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:15.480932 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7eb71f5-9328-4692-8885-385b8719e7b5 req-e0aaa91e-c51c-4729-a23e-9bb047dbb4e1 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=6b516a9c-fd0a-40b3-b181-6719501dc9cc HTTP/1.1" status: 200 len: 946 time: 0.0502796 Dec 09 22:18:15.532311 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e7eb71f5-9328-4692-8885-385b8719e7b5 req-ef5c6abb-9ad9-4efa-9349-72cd54ca3a99 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419695 Dec 09 22:18:16.668419 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db80b5a4-323f-4cc5-aa4c-b0251152fd67 req-536939f7-561a-4bdd-94c6-491b4397eedd tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:16.670857 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db80b5a4-323f-4cc5-aa4c-b0251152fd67 req-536939f7-561a-4bdd-94c6-491b4397eedd tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=6b516a9c-fd0a-40b3-b181-6719501dc9cc HTTP/1.1" status: 200 len: 946 time: 0.0611000 Dec 09 22:18:16.760104 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9af36fd5-07f2-4ccb-8663-58f9d2515f6a req-00eb7f9b-a65b-4329-94b2-3c0730f84d40 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:16.761572 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9af36fd5-07f2-4ccb-8663-58f9d2515f6a req-00eb7f9b-a65b-4329-94b2-3c0730f84d40 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.10 "GET /v2.0/ports?device_id=6b516a9c-fd0a-40b3-b181-6719501dc9cc HTTP/1.1" status: 200 len: 946 time: 0.0830352 Dec 09 22:18:16.765607 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-db80b5a4-323f-4cc5-aa4c-b0251152fd67 req-1acf67ae-3eac-49ac-a828-8daa99b26bb3 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0859411 Dec 09 22:18:16.854295 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-9af36fd5-07f2-4ccb-8663-58f9d2515f6a req-a1c78ce2-4794-470d-92d0-06e11fe1eddf tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Deleting port fb02c343-d6c2-4635-90b4-96482b43ae7d {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:18:16.854631 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9af36fd5-07f2-4ccb-8663-58f9d2515f6a req-a1c78ce2-4794-470d-92d0-06e11fe1eddf tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:16.954668 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-9af36fd5-07f2-4ccb-8663-58f9d2515f6a req-a1c78ce2-4794-470d-92d0-06e11fe1eddf tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] For port fb02c343-d6c2-4635-90b4-96482b43ae7d, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=fb02c343-d6c2-4635-90b4-96482b43ae7d,segment=NetworkSegment(d4bb457d-10ec-462e-b17c-f33f1d659499),segment_id=d4bb457d-10ec-462e-b17c-f33f1d659499)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:16.955023 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9af36fd5-07f2-4ccb-8663-58f9d2515f6a req-a1c78ce2-4794-470d-92d0-06e11fe1eddf tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:16.967412 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-9af36fd5-07f2-4ccb-8663-58f9d2515f6a req-a1c78ce2-4794-470d-92d0-06e11fe1eddf tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Calling delete_port for fb02c343-d6c2-4635-90b4-96482b43ae7d owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:18:17.100440 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9af36fd5-07f2-4ccb-8663-58f9d2515f6a req-a1c78ce2-4794-470d-92d0-06e11fe1eddf tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:17.114015 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['fb02c343-d6c2-4635-90b4-96482b43ae7d'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:18:17.116313 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['17d1e789-84ef-46af-bd7e-bd36ff63884d'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:18:17.135296 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1c78ce2-4794-470d-92d0-06e11fe1eddf tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Pushing event deleted for resources: {'Port': ['ID=fb02c343-d6c2-4635-90b4-96482b43ae7d,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:17.176805 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-9af36fd5-07f2-4ccb-8663-58f9d2515f6a req-a1c78ce2-4794-470d-92d0-06e11fe1eddf tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] No DVR routers for this DVR port fb02c343-d6c2-4635-90b4-96482b43ae7d on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:18:17.179651 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-9af36fd5-07f2-4ccb-8663-58f9d2515f6a req-a1c78ce2-4794-470d-92d0-06e11fe1eddf tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:17.183314 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9af36fd5-07f2-4ccb-8663-58f9d2515f6a req-a1c78ce2-4794-470d-92d0-06e11fe1eddf tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.10 "DELETE /v2.0/ports/fb02c343-d6c2-4635-90b4-96482b43ae7d HTTP/1.1" status: 204 len: 173 time: 0.4153290 Dec 09 22:18:17.183817 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6b516a9c-fd0a-40b3-b181-6719501dc9cc', 'name': 'network-vif-deleted', 'tag': 'fb02c343-d6c2-4635-90b4-96482b43ae7d'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:18:17.186228 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8926ee92-de7c-4049-9274-1201af6f54b5" -d '{"events": [{"server_uuid": "6b516a9c-fd0a-40b3-b181-6719501dc9cc", "name": "network-vif-deleted", "tag": "fb02c343-d6c2-4635-90b4-96482b43ae7d"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:18:17.224788 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:18:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4be71554-b901-43ec-b3e6-44f4a22dffdd x-openstack-request-id: req-4be71554-b901-43ec-b3e6-44f4a22dffdd {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:18:17.225097 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6b516a9c-fd0a-40b3-b181-6719501dc9cc", "name": "network-vif-deleted", "tag": "fb02c343-d6c2-4635-90b4-96482b43ae7d", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:18:17.225360 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-4be71554-b901-43ec-b3e6-44f4a22dffdd {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:18:17.225852 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6b516a9c-fd0a-40b3-b181-6719501dc9cc', 'name': 'network-vif-deleted', 'tag': 'fb02c343-d6c2-4635-90b4-96482b43ae7d', 'status': 'completed', 'code': 200} Dec 09 22:18:17.254610 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:18:17.927473 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33b13694-12eb-4933-8837-d64f11271c42 req-062aebef-b63d-4dc0-a3e5-e60417988aa6 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:17.929252 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-33b13694-12eb-4933-8837-d64f11271c42 req-062aebef-b63d-4dc0-a3e5-e60417988aa6 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=8f111e13-a700-4424-a0b5-d9e5bf631bb4 HTTP/1.1" status: 200 len: 945 time: 0.0525227 Dec 09 22:18:17.978684 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-33b13694-12eb-4933-8837-d64f11271c42 req-6d7db8a9-24a7-4524-a1ac-135c5220f6d6 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434461 Dec 09 22:18:18.114657 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8057c1aa-e329-46de-a075-b6d31b07f3e1 req-bd7c1560-cc89-4d32-8ef8-ba05dba1388b tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:18.121756 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8057c1aa-e329-46de-a075-b6d31b07f3e1 req-bd7c1560-cc89-4d32-8ef8-ba05dba1388b tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=8f111e13-a700-4424-a0b5-d9e5bf631bb4 HTTP/1.1" status: 200 len: 945 time: 0.0582149 Dec 09 22:18:18.185953 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8057c1aa-e329-46de-a075-b6d31b07f3e1 req-139fcc62-9850-4840-9c69-7e57e7e8fb7e tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0579445 Dec 09 22:18:18.322475 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94a1193a-96c0-464e-8ad4-3bc18d672f4c req-c95e99d9-5a36-4f41-8bd7-20968419352d tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:18.324213 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94a1193a-96c0-464e-8ad4-3bc18d672f4c req-c95e99d9-5a36-4f41-8bd7-20968419352d tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=8f111e13-a700-4424-a0b5-d9e5bf631bb4 HTTP/1.1" status: 200 len: 945 time: 0.0614808 Dec 09 22:18:18.373541 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94a1193a-96c0-464e-8ad4-3bc18d672f4c req-d7834b16-a95a-44f4-9740-882204a86282 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423827 Dec 09 22:18:18.555872 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e77736f-934d-4243-ba54-bb94471f0692 req-aa2f26a3-23f3-400a-a30f-13c3c7cfc3b7 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:18.557342 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9e77736f-934d-4243-ba54-bb94471f0692 req-aa2f26a3-23f3-400a-a30f-13c3c7cfc3b7 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=8f111e13-a700-4424-a0b5-d9e5bf631bb4 HTTP/1.1" status: 200 len: 945 time: 0.0561538 Dec 09 22:18:18.611810 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9e77736f-934d-4243-ba54-bb94471f0692 req-e0fd7e05-75e6-4fd2-94da-d10140ea58c0 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477610 Dec 09 22:18:18.732643 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9060a4c9-e555-4dba-8a7a-e084bbab5f50 req-7b362492-0d25-4e03-9ec7-cf473b2874c3 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:18.734116 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9060a4c9-e555-4dba-8a7a-e084bbab5f50 req-7b362492-0d25-4e03-9ec7-cf473b2874c3 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=8f111e13-a700-4424-a0b5-d9e5bf631bb4 HTTP/1.1" status: 200 len: 945 time: 0.0509531 Dec 09 22:18:18.782704 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9060a4c9-e555-4dba-8a7a-e084bbab5f50 req-597fdb20-7475-412f-8277-9cb25006de98 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420160 Dec 09 22:18:18.911481 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5bc893f-fb26-4774-82d6-0ef1b396203d req-ff08d1ad-6039-49d6-9a0f-f53150ea5b3e tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:18.912967 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b5bc893f-fb26-4774-82d6-0ef1b396203d req-ff08d1ad-6039-49d6-9a0f-f53150ea5b3e tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=8f111e13-a700-4424-a0b5-d9e5bf631bb4 HTTP/1.1" status: 200 len: 945 time: 0.0518420 Dec 09 22:18:18.966073 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b5bc893f-fb26-4774-82d6-0ef1b396203d req-f2f603bc-4d54-4972-94e7-dd680fe29ffe tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469785 Dec 09 22:18:19.292335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc45bb59-2eb2-44dc-9db0-998e7d2bfd06 req-eae8e0b4-262f-4ab3-8d00-87dafde5ef68 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:19.293802 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fc45bb59-2eb2-44dc-9db0-998e7d2bfd06 req-eae8e0b4-262f-4ab3-8d00-87dafde5ef68 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=8f111e13-a700-4424-a0b5-d9e5bf631bb4 HTTP/1.1" status: 200 len: 945 time: 0.0508924 Dec 09 22:18:19.348487 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fc45bb59-2eb2-44dc-9db0-998e7d2bfd06 req-aa7fa2ec-2f95-4ec2-8c53-002bb0c8bf7d tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479965 Dec 09 22:18:20.468452 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-109ed6e0-1ec3-462d-863c-e4da06e445a9 req-faeaccf5-c637-42be-999a-209126b8c036 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:20.469992 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-109ed6e0-1ec3-462d-863c-e4da06e445a9 req-faeaccf5-c637-42be-999a-209126b8c036 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/ports?device_id=8f111e13-a700-4424-a0b5-d9e5bf631bb4 HTTP/1.1" status: 200 len: 945 time: 0.0510423 Dec 09 22:18:20.518291 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-109ed6e0-1ec3-462d-863c-e4da06e445a9 req-0041743f-f857-4d84-a9a2-7e348023c8b8 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.13 "GET /v2.0/security-groups?id=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422995 Dec 09 22:18:20.579777 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dc966ce-9223-48ae-b4ca-d3990d533776 req-85335c57-1ae4-4240-b25b-601a572fd4e9 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:20.581303 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0dc966ce-9223-48ae-b4ca-d3990d533776 req-85335c57-1ae4-4240-b25b-601a572fd4e9 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.31 "GET /v2.0/ports?device_id=8f111e13-a700-4424-a0b5-d9e5bf631bb4 HTTP/1.1" status: 200 len: 945 time: 0.0609965 Dec 09 22:18:20.690115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-0dc966ce-9223-48ae-b4ca-d3990d533776 req-0a5bec6d-a9da-4819-9512-f8d2187f2e87 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Deleting port 17d1e789-84ef-46af-bd7e-bd36ff63884d {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:18:20.690468 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0dc966ce-9223-48ae-b4ca-d3990d533776 req-0a5bec6d-a9da-4819-9512-f8d2187f2e87 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:20.788846 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-0dc966ce-9223-48ae-b4ca-d3990d533776 req-0a5bec6d-a9da-4819-9512-f8d2187f2e87 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] For port 17d1e789-84ef-46af-bd7e-bd36ff63884d, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=17d1e789-84ef-46af-bd7e-bd36ff63884d,segment=NetworkSegment(d4bb457d-10ec-462e-b17c-f33f1d659499),segment_id=d4bb457d-10ec-462e-b17c-f33f1d659499)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:20.789206 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0dc966ce-9223-48ae-b4ca-d3990d533776 req-0a5bec6d-a9da-4819-9512-f8d2187f2e87 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:20.803062 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-0dc966ce-9223-48ae-b4ca-d3990d533776 req-0a5bec6d-a9da-4819-9512-f8d2187f2e87 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Calling delete_port for 17d1e789-84ef-46af-bd7e-bd36ff63884d owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:18:20.942133 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0dc966ce-9223-48ae-b4ca-d3990d533776 req-0a5bec6d-a9da-4819-9512-f8d2187f2e87 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:20.954918 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['17d1e789-84ef-46af-bd7e-bd36ff63884d'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:18:20.957088 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device fb02c343-d6c2-4635-90b4-96482b43ae7d no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:18:20.969326 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a5bec6d-a9da-4819-9512-f8d2187f2e87 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Pushing event deleted for resources: {'Port': ['ID=17d1e789-84ef-46af-bd7e-bd36ff63884d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:20.983159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a5bec6d-a9da-4819-9512-f8d2187f2e87 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:20.983544 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a5bec6d-a9da-4819-9512-f8d2187f2e87 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:20.983891 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a5bec6d-a9da-4819-9512-f8d2187f2e87 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:20.984224 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a5bec6d-a9da-4819-9512-f8d2187f2e87 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:20.984552 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a5bec6d-a9da-4819-9512-f8d2187f2e87 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:20.985099 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a5bec6d-a9da-4819-9512-f8d2187f2e87 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:20.985308 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a5bec6d-a9da-4819-9512-f8d2187f2e87 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:20.985631 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a5bec6d-a9da-4819-9512-f8d2187f2e87 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:20.985956 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a5bec6d-a9da-4819-9512-f8d2187f2e87 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:20.986279 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a5bec6d-a9da-4819-9512-f8d2187f2e87 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:20.986602 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a5bec6d-a9da-4819-9512-f8d2187f2e87 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:20.986919 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a5bec6d-a9da-4819-9512-f8d2187f2e87 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:20.987238 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0a5bec6d-a9da-4819-9512-f8d2187f2e87 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:20.997999 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: fb02c343-d6c2-4635-90b4-96482b43ae7d {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:18:20.998350 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device fb02c343-d6c2-4635-90b4-96482b43ae7d not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:18:21.023661 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-0dc966ce-9223-48ae-b4ca-d3990d533776 req-0a5bec6d-a9da-4819-9512-f8d2187f2e87 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] No DVR routers for this DVR port 17d1e789-84ef-46af-bd7e-bd36ff63884d on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:18:21.026742 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-0dc966ce-9223-48ae-b4ca-d3990d533776 req-0a5bec6d-a9da-4819-9512-f8d2187f2e87 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:21.030154 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0dc966ce-9223-48ae-b4ca-d3990d533776 req-0a5bec6d-a9da-4819-9512-f8d2187f2e87 tempest-ServersNegativeTestJSON-2009495685 tempest-ServersNegativeTestJSON-2009495685-project] 10.222.0.31 "DELETE /v2.0/ports/17d1e789-84ef-46af-bd7e-bd36ff63884d HTTP/1.1" status: 204 len: 173 time: 0.4426565 Dec 09 22:18:21.030593 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8f111e13-a700-4424-a0b5-d9e5bf631bb4', 'name': 'network-vif-deleted', 'tag': '17d1e789-84ef-46af-bd7e-bd36ff63884d'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:18:21.033152 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d94c359c-b408-4df5-82a4-21bf6da32cd0" -d '{"events": [{"server_uuid": "8f111e13-a700-4424-a0b5-d9e5bf631bb4", "name": "network-vif-deleted", "tag": "17d1e789-84ef-46af-bd7e-bd36ff63884d"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:18:21.072607 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:18:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3799d6b4-1aff-4d1f-bb4c-ffcdd19cce53 x-openstack-request-id: req-3799d6b4-1aff-4d1f-bb4c-ffcdd19cce53 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:18:21.072899 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8f111e13-a700-4424-a0b5-d9e5bf631bb4", "name": "network-vif-deleted", "tag": "17d1e789-84ef-46af-bd7e-bd36ff63884d", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:18:21.073130 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-3799d6b4-1aff-4d1f-bb4c-ffcdd19cce53 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:18:21.073541 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8f111e13-a700-4424-a0b5-d9e5bf631bb4', 'name': 'network-vif-deleted', 'tag': '17d1e789-84ef-46af-bd7e-bd36ff63884d', 'status': 'completed', 'code': 200} Dec 09 22:18:21.590411 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 32876) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:21.643386 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-d8afbecd-6259-4ec5-8ca3-37a5a6a3cea6 admin admin] Deleting subnet 7341cb79-5dc9-47ad-8465-c09aa84ad9cd {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:18:21.648129 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8afbecd-6259-4ec5-8ca3-37a5a6a3cea6 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:21.686283 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8afbecd-6259-4ec5-8ca3-37a5a6a3cea6 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:21.726257 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8afbecd-6259-4ec5-8ca3-37a5a6a3cea6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:21.782242 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8afbecd-6259-4ec5-8ca3-37a5a6a3cea6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:21.809463 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8afbecd-6259-4ec5-8ca3-37a5a6a3cea6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7341cb79-5dc9-47ad-8465-c09aa84ad9cd,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:21.811473 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8afbecd-6259-4ec5-8ca3-37a5a6a3cea6 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:21.816036 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d8afbecd-6259-4ec5-8ca3-37a5a6a3cea6 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/7341cb79-5dc9-47ad-8465-c09aa84ad9cd HTTP/1.1" status: 204 len: 168 time: 0.2238886 Dec 09 22:18:21.818117 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32878) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:21.890264 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f9428c9-18d7-4fa7-9f6e-a52d91393d26 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:21.971359 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f9428c9-18d7-4fa7-9f6e-a52d91393d26 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:21.992458 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-3f9428c9-18d7-4fa7-9f6e-a52d91393d26 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3caceac7-eeca-4a3e-a461-b371f111f90d']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:22.006721 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-3f9428c9-18d7-4fa7-9f6e-a52d91393d26 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd4bb457d-10ec-462e-b17c-f33f1d659499') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:22.007105 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-3f9428c9-18d7-4fa7-9f6e-a52d91393d26 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd4bb457d-10ec-462e-b17c-f33f1d659499') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:22.020364 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f9428c9-18d7-4fa7-9f6e-a52d91393d26 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:22.034371 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f9428c9-18d7-4fa7-9f6e-a52d91393d26 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:22.040880 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3f9428c9-18d7-4fa7-9f6e-a52d91393d26 admin admin] Releasing vlan 107 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:18:22.041277 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f9428c9-18d7-4fa7-9f6e-a52d91393d26 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: timer() Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:18:22.043055 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:18:22.105797 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f9428c9-18d7-4fa7-9f6e-a52d91393d26 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:22.111597 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3f9428c9-18d7-4fa7-9f6e-a52d91393d26 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:22.115102 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3f9428c9-18d7-4fa7-9f6e-a52d91393d26 admin admin] 10.222.0.13 "DELETE /v2.0/networks/3caceac7-eeca-4a3e-a461-b371f111f90d HTTP/1.1" status: 204 len: 168 time: 0.2956340 Dec 09 22:18:22.125527 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f9428c9-18d7-4fa7-9f6e-a52d91393d26 admin admin] Pushing event deleted for resources: {'Network': ['ID=3caceac7-eeca-4a3e-a461-b371f111f90d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:22.229959 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32882) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:22.271162 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8893e00c-eab7-40d1-a1ab-5199e0bc24d6 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=d0bfdd47813b42e6a73d42a79428b436&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0399466 Dec 09 22:18:22.273764 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32884) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:22.324274 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-23cfcb8a-a07e-4d41-86aa-7b24f8739c92 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:22.351260 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-23cfcb8a-a07e-4d41-86aa-7b24f8739c92 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:22.762761 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-23cfcb8a-a07e-4d41-86aa-7b24f8739c92 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:22.765662 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-23cfcb8a-a07e-4d41-86aa-7b24f8739c92 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:22.766958 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-23cfcb8a-a07e-4d41-86aa-7b24f8739c92 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b HTTP/1.1" status: 204 len: 168 time: 0.4921954 Dec 09 22:18:22.774769 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23cfcb8a-a07e-4d41-86aa-7b24f8739c92 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=410ebdb5-e633-43ad-8ec6-db0c6e2b7b1b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:23.041947 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 17d1e789-84ef-46af-bd7e-bd36ff63884d no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:18:23.065317 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 17d1e789-84ef-46af-bd7e-bd36ff63884d {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:18:23.065657 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 17d1e789-84ef-46af-bd7e-bd36ff63884d not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:18:23.532544 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32906) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:23.633632 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-28c113f5-92ec-4755-8075-03a3783443b6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1636437870'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:23.660793 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-28c113f5-92ec-4755-8075-03a3783443b6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Made reservation on behalf of 8af3ea01133b4a319f92c353dc0a37dd for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:18:23.664318 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-28c113f5-92ec-4755-8075-03a3783443b6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:23.672421 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-28c113f5-92ec-4755-8075-03a3783443b6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:23.745955 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-28c113f5-92ec-4755-8075-03a3783443b6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:23.751576 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-28c113f5-92ec-4755-8075-03a3783443b6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:23.778590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-28c113f5-92ec-4755-8075-03a3783443b6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] vlan segment allocate from pool success with {'vlan_id': 146, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 22:18:23.787647 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28c113f5-92ec-4755-8075-03a3783443b6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Pushing event updated for resources: {'SecurityGroup': ['ID=697d6980-c5d5-4940-91c0-8925f82d6d29,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:23.793933 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-28c113f5-92ec-4755-8075-03a3783443b6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:23.794378 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-28c113f5-92ec-4755-8075-03a3783443b6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Added segment ac4f0bff-4679-49e0-9cf0-2d12902e77e9 of type vlan for network 7fc76eff-17ac-46c1-b71e-be43ae99ec77 Dec 09 22:18:23.836540 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-28c113f5-92ec-4755-8075-03a3783443b6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:23.863795 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-28c113f5-92ec-4755-8075-03a3783443b6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:23.872539 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28c113f5-92ec-4755-8075-03a3783443b6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:23.873402 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-28c113f5-92ec-4755-8075-03a3783443b6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:23.913106 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-28c113f5-92ec-4755-8075-03a3783443b6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.3791878 Dec 09 22:18:23.946528 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28c113f5-92ec-4755-8075-03a3783443b6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Pushing event updated for resources: {'Network': ['ID=7fc76eff-17ac-46c1-b71e-be43ae99ec77,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:23.960691 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 7fc76eff-17ac-46c1-b71e-be43ae99ec77 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 22:18:27.178408 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 32910) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:27.186788 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Request body: {'subnet': {'network_id': '7fc76eff-17ac-46c1-b71e-be43ae99ec77', 'cidr': '2001:db8:0:ffff::/64', 'ip_version': 6, 'gateway_ip': '2001:db8:0:ffff::1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:27.300515 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Made reservation on behalf of 8af3ea01133b4a319f92c353dc0a37dd for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:18:27.305877 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:27.511842 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:27.570614 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Pushing event updated for resources: {'Subnet': ['ID=9d430125-fb95-429e-944d-529d212a36f2,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:27.582542 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:27.582895 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:27.583210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:27.583585 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:27.583936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:27.584263 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:27.584588 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:27.584912 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:27.585232 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:27.585559 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:27.585877 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:27.586182 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:27.586500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:27.592483 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Checking segment: {'id': 'ac4f0bff-4679-49e0-9cf0-2d12902e77e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '7fc76eff-17ac-46c1-b71e-be43ae99ec77'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:18:27.592845 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Network hostable DHCP agents. Network: 7fc76eff-17ac-46c1-b71e-be43ae99ec77, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 22:18:27.611233 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Network 7fc76eff-17ac-46c1-b71e-be43ae99ec77 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 22:18:27.622106 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 7fc76eff-17ac-46c1-b71e-be43ae99ec77) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:18:27.626095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:27.626742 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:27.633973 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-40afdaee-f11e-4ee4-b908-5244e0b581db None None] Network 7fc76eff-17ac-46c1-b71e-be43ae99ec77 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:18:27.643868 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f4a109bb-a45b-4260-939e-3cf80b50161f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.4633031 Dec 09 22:18:27.646650 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 32912) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:27.647750 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:27.651535 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-1375a5ca-2016-48ab-b333-9fb1158011ab tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-127347010'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:27.672631 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1375a5ca-2016-48ab-b333-9fb1158011ab tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Made reservation on behalf of 8af3ea01133b4a319f92c353dc0a37dd for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:18:27.676821 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1375a5ca-2016-48ab-b333-9fb1158011ab tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:27.701899 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1375a5ca-2016-48ab-b333-9fb1158011ab tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] vlan segment allocate from pool success with {'vlan_id': 138, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 22:18:27.712524 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1375a5ca-2016-48ab-b333-9fb1158011ab tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:27.712936 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-1375a5ca-2016-48ab-b333-9fb1158011ab tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Added segment 552af1d9-5a8a-4d27-8789-806c07461290 of type vlan for network ae33911c-e787-408e-88dd-3ea74c0815e6 Dec 09 22:18:27.739979 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-7fc76eff-17ac-46c1-b71e-be43ae99ec77', 'network_id': '7fc76eff-17ac-46c1-b71e-be43ae99ec77', 'project_id': '8af3ea01133b4a319f92c353dc0a37dd', 'fixed_ips': [{'subnet_id': '9d430125-fb95-429e-944d-529d212a36f2'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 22:18:27.740946 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:27.753770 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:27.761259 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1375a5ca-2016-48ab-b333-9fb1158011ab tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:27.789390 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1375a5ca-2016-48ab-b333-9fb1158011ab tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:27.795171 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1375a5ca-2016-48ab-b333-9fb1158011ab tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:27.795821 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1375a5ca-2016-48ab-b333-9fb1158011ab tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:27.850322 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1375a5ca-2016-48ab-b333-9fb1158011ab tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 783 time: 0.2026193 Dec 09 22:18:27.853414 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32914) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:27.860533 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-6fe5ed8b-9b5d-46a7-9615-00d123be9551 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Request body: {'subnet': {'network_id': 'ae33911c-e787-408e-88dd-3ea74c0815e6', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1', 'enable_dhcp': True, 'host_routes': [{'destination': '2001::/64', 'nexthop': '2003::1'}], 'dns_nameservers': ['2001:4860:4860::8844', '2001:4860:4860::8888']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:27.875547 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Allocated IP 2001:db8:0:ffff::2 (7fc76eff-17ac-46c1-b71e-be43ae99ec77/9d430125-fb95-429e-944d-529d212a36f2/b3c43322-1152-413d-9501-ba898d2fee01) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:18:27.901025 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1375a5ca-2016-48ab-b333-9fb1158011ab tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Pushing event updated for resources: {'Network': ['ID=ae33911c-e787-408e-88dd-3ea74c0815e6,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:27.913758 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network ae33911c-e787-408e-88dd-3ea74c0815e6 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 22:18:27.954707 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6fe5ed8b-9b5d-46a7-9615-00d123be9551 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Made reservation on behalf of 8af3ea01133b4a319f92c353dc0a37dd for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:18:27.958579 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6fe5ed8b-9b5d-46a7-9615-00d123be9551 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:28.078703 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:28.085529 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:28.120472 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Network 7fc76eff-17ac-46c1-b71e-be43ae99ec77 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:18:28.123378 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:18:28.126937 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:18:28.154777 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6fe5ed8b-9b5d-46a7-9615-00d123be9551 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:28.158577 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Pushing event updated for resources: {'Port': ['ID=b3c43322-1152-413d-9501-ba898d2fee01,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:28.180769 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:28.181112 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:28.181454 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:28.181791 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:28.182121 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:28.182444 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:28.182773 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:28.183071 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:28.183391 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:28.183769 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:28.184084 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:28.184401 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:28.184705 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:28.198000 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Attempting to bind port b3c43322-1152-413d-9501-ba898d2fee01 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:18:28.198490 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Attempting to bind port b3c43322-1152-413d-9501-ba898d2fee01 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'ac4f0bff-4679-49e0-9cf0-2d12902e77e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '7fc76eff-17ac-46c1-b71e-be43ae99ec77'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:18:28.198980 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Attempting to bind port b3c43322-1152-413d-9501-ba898d2fee01 on network 7fc76eff-17ac-46c1-b71e-be43ae99ec77 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:18:28.204408 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 18, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:18:28.204921 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Checking segment: {'id': 'ac4f0bff-4679-49e0-9cf0-2d12902e77e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '7fc76eff-17ac-46c1-b71e-be43ae99ec77'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:18:28.205383 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:28.205760 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Bound using segment: {'id': 'ac4f0bff-4679-49e0-9cf0-2d12902e77e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '7fc76eff-17ac-46c1-b71e-be43ae99ec77'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:18:28.206290 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Bound port: b3c43322-1152-413d-9501-ba898d2fee01, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ac4f0bff-4679-49e0-9cf0-2d12902e77e9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 146, 'network_id': '7fc76eff-17ac-46c1-b71e-be43ae99ec77'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:18:28.206709 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:28.213867 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fe5ed8b-9b5d-46a7-9615-00d123be9551 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Pushing event updated for resources: {'Subnet': ['ID=9f2135f6-79bc-43d6-a96f-ee1c002b8b8e,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:28.225780 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6fe5ed8b-9b5d-46a7-9615-00d123be9551 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Checking segment: {'id': '552af1d9-5a8a-4d27-8789-806c07461290', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 138, 'network_id': 'ae33911c-e787-408e-88dd-3ea74c0815e6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:18:28.226145 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6fe5ed8b-9b5d-46a7-9615-00d123be9551 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Network hostable DHCP agents. Network: ae33911c-e787-408e-88dd-3ea74c0815e6, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 22:18:28.243956 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6fe5ed8b-9b5d-46a7-9615-00d123be9551 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Network ae33911c-e787-408e-88dd-3ea74c0815e6 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 22:18:28.254868 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-6fe5ed8b-9b5d-46a7-9615-00d123be9551 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, ae33911c-e787-408e-88dd-3ea74c0815e6) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:18:28.259193 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6fe5ed8b-9b5d-46a7-9615-00d123be9551 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:28.259957 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6fe5ed8b-9b5d-46a7-9615-00d123be9551 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:28.266124 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18356ad7-8632-4b61-bb01-561d7c265dc5 None None] Network ae33911c-e787-408e-88dd-3ea74c0815e6 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:18:28.277257 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6fe5ed8b-9b5d-46a7-9615-00d123be9551 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 913 time: 0.4218664 Dec 09 22:18:28.280190 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32916) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:28.328225 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] For port b3c43322-1152-413d-9501-ba898d2fee01, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:18:28.346986 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] For port b3c43322-1152-413d-9501-ba898d2fee01, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b3c43322-1152-413d-9501-ba898d2fee01,segment=NetworkSegment(ac4f0bff-4679-49e0-9cf0-2d12902e77e9),segment_id=ac4f0bff-4679-49e0-9cf0-2d12902e77e9)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:18:28.352579 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:28.382997 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae5bcba4-15ea-4876-a852-c60b64e67f4c tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:28.435120 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6e507473-337e-49ca-a09c-a72a7673af4f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-ae33911c-e787-408e-88dd-3ea74c0815e6', 'network_id': 'ae33911c-e787-408e-88dd-3ea74c0815e6', 'project_id': '8af3ea01133b4a319f92c353dc0a37dd', 'fixed_ips': [{'subnet_id': '9f2135f6-79bc-43d6-a96f-ee1c002b8b8e'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 22:18:28.436028 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6e507473-337e-49ca-a09c-a72a7673af4f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:28.441684 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0015729-5ee9-490a-9473-34abb1c55c88 None None] Pushing event updated for resources: {'Port': ['ID=b3c43322-1152-413d-9501-ba898d2fee01,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:28.473269 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae5bcba4-15ea-4876-a852-c60b64e67f4c tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:28.543590 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae5bcba4-15ea-4876-a852-c60b64e67f4c tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server [None req-6e507473-337e-49ca-a09c-a72a7673af4f None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 9f2135f6-79bc-43d6-a96f-ee1c002b8b8e: This subnet is being modified by another concurrent operation. Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 306, in create_dhcp_port Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1485, in create_port Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1450, in _create_port_db Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1460, in create_port_db Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnet.lock_register( Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise exception Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 9f2135f6-79bc-43d6-a96f-ee1c002b8b8e: This subnet is being modified by another concurrent operation. Dec 09 22:18:28.570289 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Dec 09 22:18:28.580352 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae5bcba4-15ea-4876-a852-c60b64e67f4c tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Pushing event deleted for resources: {'Subnet': ['ID=9f2135f6-79bc-43d6-a96f-ee1c002b8b8e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:28.596946 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-978d1f8d-b811-49a3-8946-9909fd9a1882 None None] Network ae33911c-e787-408e-88dd-3ea74c0815e6 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:18:28.676672 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae5bcba4-15ea-4876-a852-c60b64e67f4c tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:28.703366 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-ae5bcba4-15ea-4876-a852-c60b64e67f4c tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ae33911c-e787-408e-88dd-3ea74c0815e6']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:28.713829 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-ae5bcba4-15ea-4876-a852-c60b64e67f4c tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '552af1d9-5a8a-4d27-8789-806c07461290') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:28.714284 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-ae5bcba4-15ea-4876-a852-c60b64e67f4c tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '552af1d9-5a8a-4d27-8789-806c07461290') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:28.724686 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae5bcba4-15ea-4876-a852-c60b64e67f4c tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:28.738997 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae5bcba4-15ea-4876-a852-c60b64e67f4c tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:28.746113 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ae5bcba4-15ea-4876-a852-c60b64e67f4c tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Releasing vlan 138 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:18:28.746509 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae5bcba4-15ea-4876-a852-c60b64e67f4c tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: timer() Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:18:28.749800 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:18:28.810578 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae5bcba4-15ea-4876-a852-c60b64e67f4c tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:28.824636 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ae5bcba4-15ea-4876-a852-c60b64e67f4c tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:28.829554 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ae5bcba4-15ea-4876-a852-c60b64e67f4c tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "DELETE /v2.0/networks/ae33911c-e787-408e-88dd-3ea74c0815e6 HTTP/1.1" status: 204 len: 168 time: 0.5484090 Dec 09 22:18:28.833320 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 32918) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:28.838537 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-3c121118-b215-4a3e-b04b-6cee211eac41 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-2135818350'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:28.845513 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae5bcba4-15ea-4876-a852-c60b64e67f4c tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Pushing event deleted for resources: {'Network': ['ID=ae33911c-e787-408e-88dd-3ea74c0815e6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:28.867176 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3c121118-b215-4a3e-b04b-6cee211eac41 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Made reservation on behalf of 8af3ea01133b4a319f92c353dc0a37dd for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:18:28.870738 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3c121118-b215-4a3e-b04b-6cee211eac41 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:28.896291 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3c121118-b215-4a3e-b04b-6cee211eac41 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] vlan segment allocate from pool success with {'vlan_id': 130, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 22:18:28.905933 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3c121118-b215-4a3e-b04b-6cee211eac41 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:28.906277 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-3c121118-b215-4a3e-b04b-6cee211eac41 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Added segment d15c02b6-78d1-4db0-9943-9cc917ee9030 of type vlan for network 245b329a-c144-4a79-a632-113cd0ad4151 Dec 09 22:18:28.954172 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3c121118-b215-4a3e-b04b-6cee211eac41 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:28.978760 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3c121118-b215-4a3e-b04b-6cee211eac41 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:28.984514 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c121118-b215-4a3e-b04b-6cee211eac41 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:28.985100 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3c121118-b215-4a3e-b04b-6cee211eac41 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:29.016316 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3c121118-b215-4a3e-b04b-6cee211eac41 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.1819189 Dec 09 22:18:29.019628 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32920) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:29.024948 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-0b8af392-6640-49ce-b1d5-2389604d220b tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Request body: {'subnet': {'network_id': '245b329a-c144-4a79-a632-113cd0ad4151', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': None, 'allocation_pools': [{'start': '2001:db8::3', 'end': '2001:db8::7'}]}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:29.056791 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c121118-b215-4a3e-b04b-6cee211eac41 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Pushing event updated for resources: {'Network': ['ID=245b329a-c144-4a79-a632-113cd0ad4151,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:29.068475 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 245b329a-c144-4a79-a632-113cd0ad4151 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 22:18:29.128938 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0b8af392-6640-49ce-b1d5-2389604d220b tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Made reservation on behalf of 8af3ea01133b4a319f92c353dc0a37dd for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:18:29.133184 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0b8af392-6640-49ce-b1d5-2389604d220b tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:29.201225 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.ipam_backend_mixin [None req-0b8af392-6640-49ce-b1d5-2389604d220b tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Performing IP validity checks on allocation pools {{(pid=103437) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:325}} Dec 09 22:18:29.201743 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.ipam_backend_mixin [None req-0b8af392-6640-49ce-b1d5-2389604d220b tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Checking for overlaps among allocation pools and gateway ip {{(pid=103437) validate_allocation_pools /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:346}} Dec 09 22:18:29.325730 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0b8af392-6640-49ce-b1d5-2389604d220b tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:29.380790 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b8af392-6640-49ce-b1d5-2389604d220b tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Pushing event updated for resources: {'Subnet': ['ID=994f08bf-152b-4400-a4e4-56424532c33a,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:29.398401 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b8af392-6640-49ce-b1d5-2389604d220b tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Checking segment: {'id': 'd15c02b6-78d1-4db0-9943-9cc917ee9030', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '245b329a-c144-4a79-a632-113cd0ad4151'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:18:29.398775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b8af392-6640-49ce-b1d5-2389604d220b tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Network hostable DHCP agents. Network: 245b329a-c144-4a79-a632-113cd0ad4151, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 22:18:29.401306 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4212e3fe-0201-4917-93c8-8354264c9c97 None None] Network 7fc76eff-17ac-46c1-b71e-be43ae99ec77 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:18:29.416236 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b8af392-6640-49ce-b1d5-2389604d220b tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Network 245b329a-c144-4a79-a632-113cd0ad4151 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 22:18:29.425536 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-0b8af392-6640-49ce-b1d5-2389604d220b tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 245b329a-c144-4a79-a632-113cd0ad4151) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:18:29.430399 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b8af392-6640-49ce-b1d5-2389604d220b tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:29.431049 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0b8af392-6640-49ce-b1d5-2389604d220b tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:29.435031 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-55f27333-577a-4bca-825b-75a680614d9a None None] Network 245b329a-c144-4a79-a632-113cd0ad4151 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:18:29.448232 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0b8af392-6640-49ce-b1d5-2389604d220b tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 794 time: 0.4274449 Dec 09 22:18:29.451157 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 32922) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:29.553852 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-695446f2-1f79-4f1d-9dec-cad37e180a3f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:29.562850 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-965bdeeb-c2aa-44a0-b74e-c92722ac3299 None None] Provisioning complete for port b3c43322-1152-413d-9501-ba898d2fee01 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:29.563221 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-965bdeeb-c2aa-44a0-b74e-c92722ac3299 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:29.629696 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-96dafccd-ea0b-4b32-9738-7ec34d4de5e6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-245b329a-c144-4a79-a632-113cd0ad4151', 'network_id': '245b329a-c144-4a79-a632-113cd0ad4151', 'project_id': '8af3ea01133b4a319f92c353dc0a37dd', 'fixed_ips': [{'subnet_id': '994f08bf-152b-4400-a4e4-56424532c33a'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 22:18:29.630525 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-96dafccd-ea0b-4b32-9738-7ec34d4de5e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:29.632173 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-695446f2-1f79-4f1d-9dec-cad37e180a3f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:29.705188 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-695446f2-1f79-4f1d-9dec-cad37e180a3f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:29.738325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-695446f2-1f79-4f1d-9dec-cad37e180a3f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Pushing event deleted for resources: {'Subnet': ['ID=994f08bf-152b-4400-a4e4-56424532c33a,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:29.747751 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-965bdeeb-c2aa-44a0-b74e-c92722ac3299 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server [None req-96dafccd-ea0b-4b32-9738-7ec34d4de5e6 None None] Exception during message handling: neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 994f08bf-152b-4400-a4e4-56424532c33a: This subnet is being modified by another concurrent operation. Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 95, in wrapper Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ret_val = f(_self, context, *args, **kwargs) Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 306, in create_dhcp_port Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return self._port_action(plugin, context, port, 'create_port') Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 116, in _port_action Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return p_utils.create_port(plugin, context, port) Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/plugins/utils.py", line 337, in create_port Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return core_plugin.create_port( Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/common/utils.py", line 694, in inner Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 218, in wrapped Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return method(*args, **kwargs) Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 139, in wrapped Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server setattr(e, '_RETRY_EXCEEDED', True) Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 135, in wrapped Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 154, in wrapper Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ectxt.value = e.inner_exc Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*args, **kwargs) Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 183, in wrapped Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server LOG.debug("Retry wrapper got retriable exception: %s", e) Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py", line 179, in wrapped Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server return f(*dup_args, **dup_kwargs) Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1485, in create_port Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server result, mech_context = self._create_port_db(context, port) Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 1450, in _create_port_db Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server port_db = self.create_port_db(context, port) Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/db_base_plugin_v2.py", line 1460, in create_port_db Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.ipam.allocate_ips_for_port_and_store( Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 220, in allocate_ips_for_port_and_store Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self._safe_rollback(self._ipam_deallocate_ips, context, Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server self.force_reraise() Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise self.value Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 203, in allocate_ips_for_port_and_store Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server ips = self._allocate_ips_for_port(context, port_copy) Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_pluggable_backend.py", line 234, in _allocate_ips_for_port Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnets = self._ipam_get_subnets( Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/ipam_backend_mixin.py", line 694, in _ipam_get_subnets Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server subnet.lock_register( Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server File "/opt/stack/neutron/neutron/db/models_v2.py", line 55, in lock_register Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server raise exception Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server neutron_lib.exceptions.SubnetInUse: Unable to complete operation on subnet 994f08bf-152b-4400-a4e4-56424532c33a: This subnet is being modified by another concurrent operation. Dec 09 22:18:29.772270 n-d-713301-27 neutron-server[103439]: ERROR oslo_messaging.rpc.server Dec 09 22:18:29.801186 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1245e98e-ceea-4187-b775-44e2da76dd3d None None] Network 245b329a-c144-4a79-a632-113cd0ad4151 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:18:29.805419 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-695446f2-1f79-4f1d-9dec-cad37e180a3f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:29.807817 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-965bdeeb-c2aa-44a0-b74e-c92722ac3299 None None] For port b3c43322-1152-413d-9501-ba898d2fee01, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b3c43322-1152-413d-9501-ba898d2fee01,segment=NetworkSegment(ac4f0bff-4679-49e0-9cf0-2d12902e77e9),segment_id=ac4f0bff-4679-49e0-9cf0-2d12902e77e9)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:29.825877 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-965bdeeb-c2aa-44a0-b74e-c92722ac3299 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:29.830002 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-695446f2-1f79-4f1d-9dec-cad37e180a3f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['245b329a-c144-4a79-a632-113cd0ad4151']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:29.842118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-695446f2-1f79-4f1d-9dec-cad37e180a3f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd15c02b6-78d1-4db0-9943-9cc917ee9030') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:29.842784 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-695446f2-1f79-4f1d-9dec-cad37e180a3f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd15c02b6-78d1-4db0-9943-9cc917ee9030') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:29.857624 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-695446f2-1f79-4f1d-9dec-cad37e180a3f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:29.871751 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-695446f2-1f79-4f1d-9dec-cad37e180a3f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:29.878081 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-695446f2-1f79-4f1d-9dec-cad37e180a3f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Releasing vlan 130 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:18:29.879315 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-695446f2-1f79-4f1d-9dec-cad37e180a3f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: timer() Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:18:29.882379 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:18:29.924608 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0cf4f777-0b8a-4e9b-ab0f-e44862c832da None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 22:18:29.943919 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-695446f2-1f79-4f1d-9dec-cad37e180a3f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:29.953179 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-965bdeeb-c2aa-44a0-b74e-c92722ac3299 None None] Pushing event updated for resources: {'Port': ['ID=b3c43322-1152-413d-9501-ba898d2fee01,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:29.960891 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-695446f2-1f79-4f1d-9dec-cad37e180a3f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:29.964100 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-695446f2-1f79-4f1d-9dec-cad37e180a3f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "DELETE /v2.0/networks/245b329a-c144-4a79-a632-113cd0ad4151 HTTP/1.1" status: 204 len: 168 time: 0.5118625 Dec 09 22:18:29.965109 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-695446f2-1f79-4f1d-9dec-cad37e180a3f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Pushing event deleted for resources: {'Network': ['ID=245b329a-c144-4a79-a632-113cd0ad4151,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:29.967706 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 32924) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:29.972576 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-af6e2345-a26f-475e-bf98-3f1ba5497ce0 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1689507739'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:29.995111 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-af6e2345-a26f-475e-bf98-3f1ba5497ce0 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Made reservation on behalf of 8af3ea01133b4a319f92c353dc0a37dd for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:18:29.997159 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-19867097-6604-425e-9548-cf5a6b29ada2 None None] Provisioning complete for port b3c43322-1152-413d-9501-ba898d2fee01 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:29.997533 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-19867097-6604-425e-9548-cf5a6b29ada2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:29.998739 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-af6e2345-a26f-475e-bf98-3f1ba5497ce0 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:30.022136 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-af6e2345-a26f-475e-bf98-3f1ba5497ce0 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] vlan segment allocate from pool success with {'vlan_id': 101, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 22:18:30.031716 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-af6e2345-a26f-475e-bf98-3f1ba5497ce0 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:30.032067 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-af6e2345-a26f-475e-bf98-3f1ba5497ce0 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Added segment 996aea80-261e-4bbc-9c8b-92b385570a2f of type vlan for network dc65afbc-40d9-4dcd-a984-40434c8bcb05 Dec 09 22:18:30.036945 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0cf4f777-0b8a-4e9b-ab0f-e44862c832da None None] Resources bound (agent type, host, resource id): {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 09 22:18:30.076476 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-af6e2345-a26f-475e-bf98-3f1ba5497ce0 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:30.114841 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-af6e2345-a26f-475e-bf98-3f1ba5497ce0 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:30.121883 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-af6e2345-a26f-475e-bf98-3f1ba5497ce0 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:30.122691 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-af6e2345-a26f-475e-bf98-3f1ba5497ce0 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:30.162356 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-af6e2345-a26f-475e-bf98-3f1ba5497ce0 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.1935651 Dec 09 22:18:30.166179 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 32926) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:30.171462 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-3bb84393-d934-4cb1-8740-be842e4d36dd tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Request body: {'subnet': {'network_id': 'dc65afbc-40d9-4dcd-a984-40434c8bcb05', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:30.222485 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af6e2345-a26f-475e-bf98-3f1ba5497ce0 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Pushing event updated for resources: {'Network': ['ID=dc65afbc-40d9-4dcd-a984-40434c8bcb05,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:30.302081 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3bb84393-d934-4cb1-8740-be842e4d36dd tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Made reservation on behalf of 8af3ea01133b4a319f92c353dc0a37dd for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:18:30.305934 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3bb84393-d934-4cb1-8740-be842e4d36dd tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:30.323392 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b3c43322-1152-413d-9501-ba898d2fee01 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:18:30.325317 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network dc65afbc-40d9-4dcd-a984-40434c8bcb05 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 22:18:30.488663 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port b3c43322-1152-413d-9501-ba898d2fee01 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:30.489029 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:30.493818 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3bb84393-d934-4cb1-8740-be842e4d36dd tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:30.547892 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bb84393-d934-4cb1-8740-be842e4d36dd tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Pushing event updated for resources: {'Subnet': ['ID=901e9a96-cefa-4ce9-9ac7-223f0a636917,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:30.564564 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3bb84393-d934-4cb1-8740-be842e4d36dd tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Checking segment: {'id': '996aea80-261e-4bbc-9c8b-92b385570a2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'dc65afbc-40d9-4dcd-a984-40434c8bcb05'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:18:30.564943 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3bb84393-d934-4cb1-8740-be842e4d36dd tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Network hostable DHCP agents. Network: dc65afbc-40d9-4dcd-a984-40434c8bcb05, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 22:18:30.582672 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3bb84393-d934-4cb1-8740-be842e4d36dd tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Network dc65afbc-40d9-4dcd-a984-40434c8bcb05 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 22:18:30.591559 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-3bb84393-d934-4cb1-8740-be842e4d36dd tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, dc65afbc-40d9-4dcd-a984-40434c8bcb05) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:18:30.595762 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3bb84393-d934-4cb1-8740-be842e4d36dd tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:30.596404 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3bb84393-d934-4cb1-8740-be842e4d36dd tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:30.615256 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-304c20dd-769b-4789-8d3c-442f7a235326 None None] get_active_networks_info from n-d-713301-27 {{(pid=103439) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 22:18:30.617865 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32928) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:30.618715 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3bb84393-d934-4cb1-8740-be842e4d36dd tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4511809 Dec 09 22:18:30.624015 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-71100f67-a7d8-4687-b492-296ced6eedc6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Request body: {'network': {'name': 'tempest-NetworksIpV6Test-test-network-1476644477'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:30.648819 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-71100f67-a7d8-4687-b492-296ced6eedc6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Made reservation on behalf of 8af3ea01133b4a319f92c353dc0a37dd for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:18:30.652394 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71100f67-a7d8-4687-b492-296ced6eedc6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:30.685153 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-71100f67-a7d8-4687-b492-296ced6eedc6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] vlan segment allocate from pool success with {'vlan_id': 148, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 22:18:30.699806 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71100f67-a7d8-4687-b492-296ced6eedc6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:30.700148 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-71100f67-a7d8-4687-b492-296ced6eedc6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Added segment 3d80f27d-0cb5-4274-9800-e79917f1d111 of type vlan for network 1bfe11c5-dc8c-48b4-ac13-20f853c7f154 Dec 09 22:18:30.702413 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-304c20dd-769b-4789-8d3c-442f7a235326 None None] Resources bound (agent type, host, resource id): {{(pid=103439) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:104}} Dec 09 22:18:30.741353 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71100f67-a7d8-4687-b492-296ced6eedc6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:30.767506 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71100f67-a7d8-4687-b492-296ced6eedc6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:30.773148 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71100f67-a7d8-4687-b492-296ced6eedc6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:30.773746 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-71100f67-a7d8-4687-b492-296ced6eedc6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:30.810600 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-71100f67-a7d8-4687-b492-296ced6eedc6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 784 time: 0.1914334 Dec 09 22:18:30.813493 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32930) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:30.821986 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-6f4a8c3a-993b-4690-ae84-03133a2e0b43 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Request body: {'subnet': {'network_id': '1bfe11c5-dc8c-48b4-ac13-20f853c7f154', 'cidr': '2001:db8::/64', 'ip_version': 6, 'gateway_ip': '2001:db8::1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:30.862459 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71100f67-a7d8-4687-b492-296ced6eedc6 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Pushing event updated for resources: {'Network': ['ID=1bfe11c5-dc8c-48b4-ac13-20f853c7f154,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:30.878961 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 1bfe11c5-dc8c-48b4-ac13-20f853c7f154 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 22:18:30.942815 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6f4a8c3a-993b-4690-ae84-03133a2e0b43 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Made reservation on behalf of 8af3ea01133b4a319f92c353dc0a37dd for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:18:30.946463 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f4a8c3a-993b-4690-ae84-03133a2e0b43 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:30.974292 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb70343f-c684-40f9-8ee5-05a5876dbaca None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-dc65afbc-40d9-4dcd-a984-40434c8bcb05', 'network_id': 'dc65afbc-40d9-4dcd-a984-40434c8bcb05', 'project_id': '8af3ea01133b4a319f92c353dc0a37dd', 'fixed_ips': [{'subnet_id': '901e9a96-cefa-4ce9-9ac7-223f0a636917'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 22:18:30.975356 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb70343f-c684-40f9-8ee5-05a5876dbaca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:31.116763 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-eb70343f-c684-40f9-8ee5-05a5876dbaca None None] Allocated IP 2001:db8::2 (dc65afbc-40d9-4dcd-a984-40434c8bcb05/901e9a96-cefa-4ce9-9ac7-223f0a636917/d45ae212-40f9-4095-ae22-a4093a5d034f) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:18:31.136762 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f4a8c3a-993b-4690-ae84-03133a2e0b43 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:31.200349 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f4a8c3a-993b-4690-ae84-03133a2e0b43 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Pushing event updated for resources: {'Subnet': ['ID=663e2962-3a87-418c-84c2-276ebd3e796c,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:31.208187 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6f4a8c3a-993b-4690-ae84-03133a2e0b43 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Checking segment: {'id': '3d80f27d-0cb5-4274-9800-e79917f1d111', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '1bfe11c5-dc8c-48b4-ac13-20f853c7f154'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:18:31.208559 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f4a8c3a-993b-4690-ae84-03133a2e0b43 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Network hostable DHCP agents. Network: 1bfe11c5-dc8c-48b4-ac13-20f853c7f154, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 22:18:31.226775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f4a8c3a-993b-4690-ae84-03133a2e0b43 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Network 1bfe11c5-dc8c-48b4-ac13-20f853c7f154 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 22:18:31.237117 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-6f4a8c3a-993b-4690-ae84-03133a2e0b43 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 1bfe11c5-dc8c-48b4-ac13-20f853c7f154) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:18:31.241720 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6f4a8c3a-993b-4690-ae84-03133a2e0b43 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:31.242683 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f4a8c3a-993b-4690-ae84-03133a2e0b43 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:31.260836 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6f4a8c3a-993b-4690-ae84-03133a2e0b43 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4461138 Dec 09 22:18:31.263489 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32932) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:31.272068 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb70343f-c684-40f9-8ee5-05a5876dbaca None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:31.278518 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb70343f-c684-40f9-8ee5-05a5876dbaca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:31.321729 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb70343f-c684-40f9-8ee5-05a5876dbaca None None] Network dc65afbc-40d9-4dcd-a984-40434c8bcb05 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:18:31.325802 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-eb70343f-c684-40f9-8ee5-05a5876dbaca None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:18:31.328171 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb70343f-c684-40f9-8ee5-05a5876dbaca None None] Pushing event updated for resources: {'Port': ['ID=d45ae212-40f9-4095-ae22-a4093a5d034f,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:31.330632 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb70343f-c684-40f9-8ee5-05a5876dbaca None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:18:31.371221 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c41335a0-8f30-4a9d-be75-e0de7d43fc56 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:31.390163 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-eb70343f-c684-40f9-8ee5-05a5876dbaca None None] Attempting to bind port d45ae212-40f9-4095-ae22-a4093a5d034f on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:18:31.390505 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-eb70343f-c684-40f9-8ee5-05a5876dbaca None None] Attempting to bind port d45ae212-40f9-4095-ae22-a4093a5d034f by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '996aea80-261e-4bbc-9c8b-92b385570a2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'dc65afbc-40d9-4dcd-a984-40434c8bcb05'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:18:31.390900 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb70343f-c684-40f9-8ee5-05a5876dbaca None None] Attempting to bind port d45ae212-40f9-4095-ae22-a4093a5d034f on network dc65afbc-40d9-4dcd-a984-40434c8bcb05 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:18:31.396146 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb70343f-c684-40f9-8ee5-05a5876dbaca None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 18, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:18:31.396507 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb70343f-c684-40f9-8ee5-05a5876dbaca None None] Checking segment: {'id': '996aea80-261e-4bbc-9c8b-92b385570a2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'dc65afbc-40d9-4dcd-a984-40434c8bcb05'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:18:31.396927 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb70343f-c684-40f9-8ee5-05a5876dbaca None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:31.397322 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb70343f-c684-40f9-8ee5-05a5876dbaca None None] Bound using segment: {'id': '996aea80-261e-4bbc-9c8b-92b385570a2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'dc65afbc-40d9-4dcd-a984-40434c8bcb05'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:18:31.397791 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-eb70343f-c684-40f9-8ee5-05a5876dbaca None None] Bound port: d45ae212-40f9-4095-ae22-a4093a5d034f, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '996aea80-261e-4bbc-9c8b-92b385570a2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 101, 'network_id': 'dc65afbc-40d9-4dcd-a984-40434c8bcb05'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:18:31.398170 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb70343f-c684-40f9-8ee5-05a5876dbaca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:31.424044 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c41335a0-8f30-4a9d-be75-e0de7d43fc56 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:31.459362 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-eb70343f-c684-40f9-8ee5-05a5876dbaca None None] For port d45ae212-40f9-4095-ae22-a4093a5d034f, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:18:31.462320 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-eb70343f-c684-40f9-8ee5-05a5876dbaca None None] For port d45ae212-40f9-4095-ae22-a4093a5d034f, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d45ae212-40f9-4095-ae22-a4093a5d034f,segment=NetworkSegment(996aea80-261e-4bbc-9c8b-92b385570a2f),segment_id=996aea80-261e-4bbc-9c8b-92b385570a2f)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:18:31.469389 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb70343f-c684-40f9-8ee5-05a5876dbaca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:31.486034 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c41335a0-8f30-4a9d-be75-e0de7d43fc56 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:31.523708 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c41335a0-8f30-4a9d-be75-e0de7d43fc56 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Pushing event deleted for resources: {'Subnet': ['ID=663e2962-3a87-418c-84c2-276ebd3e796c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:31.539167 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb70343f-c684-40f9-8ee5-05a5876dbaca None None] Pushing event updated for resources: {'Port': ['ID=d45ae212-40f9-4095-ae22-a4093a5d034f,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:31.589453 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c41335a0-8f30-4a9d-be75-e0de7d43fc56 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:31.609997 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-c41335a0-8f30-4a9d-be75-e0de7d43fc56 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1bfe11c5-dc8c-48b4-ac13-20f853c7f154']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:31.620017 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-c41335a0-8f30-4a9d-be75-e0de7d43fc56 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3d80f27d-0cb5-4274-9800-e79917f1d111') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:31.620661 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-c41335a0-8f30-4a9d-be75-e0de7d43fc56 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3d80f27d-0cb5-4274-9800-e79917f1d111') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:31.630948 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c41335a0-8f30-4a9d-be75-e0de7d43fc56 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:31.644874 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c41335a0-8f30-4a9d-be75-e0de7d43fc56 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:31.651061 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c41335a0-8f30-4a9d-be75-e0de7d43fc56 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Releasing vlan 148 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:18:31.651474 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c41335a0-8f30-4a9d-be75-e0de7d43fc56 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: timer() Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:18:31.654475 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:18:31.743116 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c41335a0-8f30-4a9d-be75-e0de7d43fc56 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:31.750263 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c41335a0-8f30-4a9d-be75-e0de7d43fc56 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:31.753713 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c41335a0-8f30-4a9d-be75-e0de7d43fc56 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "DELETE /v2.0/networks/1bfe11c5-dc8c-48b4-ac13-20f853c7f154 HTTP/1.1" status: 204 len: 168 time: 0.4890614 Dec 09 22:18:31.760078 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 32934) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:31.765566 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c41335a0-8f30-4a9d-be75-e0de7d43fc56 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Pushing event deleted for resources: {'Network': ['ID=1bfe11c5-dc8c-48b4-ac13-20f853c7f154,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:31.789234 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-d10c0885-0303-4794-aaf3-ca28fa8dd94d tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] GET failed (client error): The resource could not be found. Dec 09 22:18:31.790610 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d10c0885-0303-4794-aaf3-ca28fa8dd94d tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "GET /v2.0/subnets/663e2962-3a87-418c-84c2-276ebd3e796c HTTP/1.1" status: 404 len: 337 time: 0.0295422 Dec 09 22:18:31.793390 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 32936) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:31.812292 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-2a538997-5f29-4562-90ec-60f630646ed9 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] DELETE failed (client error): The resource could not be found. Dec 09 22:18:31.813037 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-2a538997-5f29-4562-90ec-60f630646ed9 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 22:18:31.817075 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2a538997-5f29-4562-90ec-60f630646ed9 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "DELETE /v2.0/networks/1bfe11c5-dc8c-48b4-ac13-20f853c7f154 HTTP/1.1" status: 404 len: 339 time: 0.0224984 Dec 09 22:18:31.821317 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32938) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:31.852133 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-4864b91f-e62f-417d-8e42-226aee91e17c tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] DELETE failed (client error): The resource could not be found. Dec 09 22:18:31.852609 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-4864b91f-e62f-417d-8e42-226aee91e17c tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 22:18:31.855738 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4864b91f-e62f-417d-8e42-226aee91e17c tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "DELETE /v2.0/subnets/663e2962-3a87-418c-84c2-276ebd3e796c HTTP/1.1" status: 404 len: 337 time: 0.0302699 Dec 09 22:18:31.858391 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32940) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:31.877936 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-5400d2fe-e0fa-4d04-bc56-b3f62dad039f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] DELETE failed (client error): The resource could not be found. Dec 09 22:18:31.878456 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-5400d2fe-e0fa-4d04-bc56-b3f62dad039f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 22:18:31.881444 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5400d2fe-e0fa-4d04-bc56-b3f62dad039f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "DELETE /v2.0/networks/1bfe11c5-dc8c-48b4-ac13-20f853c7f154 HTTP/1.1" status: 404 len: 339 time: 0.0220501 Dec 09 22:18:31.883961 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32942) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:31.935689 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-2fb650be-0ee5-4518-bdb9-97f28a86b3ed tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Deleting subnet 901e9a96-cefa-4ce9-9ac7-223f0a636917 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:18:31.938783 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2fb650be-0ee5-4518-bdb9-97f28a86b3ed tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:31.988078 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2fb650be-0ee5-4518-bdb9-97f28a86b3ed tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:32.079789 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2fb650be-0ee5-4518-bdb9-97f28a86b3ed tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:32.147405 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2fb650be-0ee5-4518-bdb9-97f28a86b3ed tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:32.168474 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d45ae212-40f9-4095-ae22-a4093a5d034f up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:18:32.181630 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fb650be-0ee5-4518-bdb9-97f28a86b3ed tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Pushing event deleted for resources: {'Subnet': ['ID=901e9a96-cefa-4ce9-9ac7-223f0a636917,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:32.185776 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2fb650be-0ee5-4518-bdb9-97f28a86b3ed tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:32.189062 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2fb650be-0ee5-4518-bdb9-97f28a86b3ed tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "DELETE /v2.0/subnets/901e9a96-cefa-4ce9-9ac7-223f0a636917 HTTP/1.1" status: 204 len: 168 time: 0.3041983 Dec 09 22:18:32.191671 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32944) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:32.224721 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port d45ae212-40f9-4095-ae22-a4093a5d034f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:32.225402 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:32.278229 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8de2d0ff-a2c6-448f-b937-c84b1637a0c9 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:32.312208 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:32.338729 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-8de2d0ff-a2c6-448f-b937-c84b1637a0c9 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Deleting port d45ae212-40f9-4095-ae22-a4093a5d034f {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:18:32.339169 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8de2d0ff-a2c6-448f-b937-c84b1637a0c9 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:32.350535 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port d45ae212-40f9-4095-ae22-a4093a5d034f, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d45ae212-40f9-4095-ae22-a4093a5d034f,segment=NetworkSegment(996aea80-261e-4bbc-9c8b-92b385570a2f),segment_id=996aea80-261e-4bbc-9c8b-92b385570a2f)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:32.355194 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:32.404225 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=d45ae212-40f9-4095-ae22-a4093a5d034f,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:32.413229 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-8de2d0ff-a2c6-448f-b937-c84b1637a0c9 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] For port d45ae212-40f9-4095-ae22-a4093a5d034f, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d45ae212-40f9-4095-ae22-a4093a5d034f,segment=NetworkSegment(996aea80-261e-4bbc-9c8b-92b385570a2f),segment_id=996aea80-261e-4bbc-9c8b-92b385570a2f)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:32.413652 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8de2d0ff-a2c6-448f-b937-c84b1637a0c9 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:32.428087 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-8de2d0ff-a2c6-448f-b937-c84b1637a0c9 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Calling delete_port for d45ae212-40f9-4095-ae22-a4093a5d034f owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:18:32.488411 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3937ea97-943c-4529-ace0-b2c28ecfd02a None None] Network dc65afbc-40d9-4dcd-a984-40434c8bcb05 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:18:32.492928 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c002a971-985c-43f5-aa9a-5a93202fa41c None None] Network 1bfe11c5-dc8c-48b4-ac13-20f853c7f154 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:18:32.510450 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8de2d0ff-a2c6-448f-b937-c84b1637a0c9 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:32.530144 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c002a971-985c-43f5-aa9a-5a93202fa41c None None] Network 1bfe11c5-dc8c-48b4-ac13-20f853c7f154 could not be found, it might have been deleted concurrently. {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:224}} Dec 09 22:18:32.533188 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ebad91e9-7582-43a9-8b1c-64ee0868d369 None None] Could not find standard attr ID for object d45ae212-40f9-4095-ae22-a4093a5d034f. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 22:18:32.536213 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8de2d0ff-a2c6-448f-b937-c84b1637a0c9 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Pushing event deleted for resources: {'Port': ['ID=d45ae212-40f9-4095-ae22-a4093a5d034f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:32.539705 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8de2d0ff-a2c6-448f-b937-c84b1637a0c9 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] No DVR routers for this DVR port d45ae212-40f9-4095-ae22-a4093a5d034f on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:18:32.564627 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be84f81d-1f50-4efd-b63f-23e724a193d1 None None] Network 1bfe11c5-dc8c-48b4-ac13-20f853c7f154 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:18:32.578234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be84f81d-1f50-4efd-b63f-23e724a193d1 None None] Network 1bfe11c5-dc8c-48b4-ac13-20f853c7f154 could not be found, it might have been deleted concurrently. {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:224}} Dec 09 22:18:32.599188 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3c04737c-e972-407c-b759-712f05550b3b None None] Network dc65afbc-40d9-4dcd-a984-40434c8bcb05 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:18:32.623205 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8de2d0ff-a2c6-448f-b937-c84b1637a0c9 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:32.643515 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-8de2d0ff-a2c6-448f-b937-c84b1637a0c9 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['dc65afbc-40d9-4dcd-a984-40434c8bcb05']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:32.653174 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-8de2d0ff-a2c6-448f-b937-c84b1637a0c9 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '996aea80-261e-4bbc-9c8b-92b385570a2f') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:32.653472 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-8de2d0ff-a2c6-448f-b937-c84b1637a0c9 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '996aea80-261e-4bbc-9c8b-92b385570a2f') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:32.663376 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8de2d0ff-a2c6-448f-b937-c84b1637a0c9 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:32.681067 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8de2d0ff-a2c6-448f-b937-c84b1637a0c9 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:32.688640 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8de2d0ff-a2c6-448f-b937-c84b1637a0c9 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Releasing vlan 101 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:18:32.689039 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8de2d0ff-a2c6-448f-b937-c84b1637a0c9 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: timer() Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:18:32.692639 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:18:32.749200 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4a566a37-1f1b-4e05-b332-dc591ca26910 None None] DHCP port deletion for dc65afbc-40d9-4dcd-a984-40434c8bcb05 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:18:32.757199 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8de2d0ff-a2c6-448f-b937-c84b1637a0c9 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:32.763424 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8de2d0ff-a2c6-448f-b937-c84b1637a0c9 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:32.769097 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8de2d0ff-a2c6-448f-b937-c84b1637a0c9 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "DELETE /v2.0/networks/dc65afbc-40d9-4dcd-a984-40434c8bcb05 HTTP/1.1" status: 204 len: 168 time: 0.5735519 Dec 09 22:18:32.769566 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 32946) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:32.781563 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8de2d0ff-a2c6-448f-b937-c84b1637a0c9 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Pushing event deleted for resources: {'Network': ['ID=dc65afbc-40d9-4dcd-a984-40434c8bcb05,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:32.797562 n-d-713301-27 neutron-server[103438]: INFO neutron.pecan_wsgi.hooks.translation [None req-8e2e668f-a58a-4ff3-bcde-80df583f43fd tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] DELETE failed (client error): The resource could not be found. Dec 09 22:18:32.798014 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-8e2e668f-a58a-4ff3-bcde-80df583f43fd tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103438) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 22:18:32.801429 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8e2e668f-a58a-4ff3-bcde-80df583f43fd tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "DELETE /v2.0/subnets/994f08bf-152b-4400-a4e4-56424532c33a HTTP/1.1" status: 404 len: 337 time: 0.0305276 Dec 09 22:18:32.805143 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32948) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:32.824093 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-22ef1535-fc6b-475b-be1e-7ed95f07e862 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] DELETE failed (client error): The resource could not be found. Dec 09 22:18:32.824601 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-22ef1535-fc6b-475b-be1e-7ed95f07e862 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 22:18:32.827679 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-22ef1535-fc6b-475b-be1e-7ed95f07e862 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "DELETE /v2.0/networks/245b329a-c144-4a79-a632-113cd0ad4151 HTTP/1.1" status: 404 len: 339 time: 0.0214038 Dec 09 22:18:32.830166 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32950) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:32.855379 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-ddf774c9-f82b-48d1-bf8a-51f7257f5365 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] DELETE failed (client error): The resource could not be found. Dec 09 22:18:32.855861 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-ddf774c9-f82b-48d1-bf8a-51f7257f5365 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 22:18:32.858847 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ddf774c9-f82b-48d1-bf8a-51f7257f5365 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "DELETE /v2.0/subnets/9f2135f6-79bc-43d6-a96f-ee1c002b8b8e HTTP/1.1" status: 404 len: 337 time: 0.0277462 Dec 09 22:18:32.861163 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32952) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:32.879537 n-d-713301-27 neutron-server[103437]: INFO neutron.pecan_wsgi.hooks.translation [None req-e8b33cec-1ca5-46a1-841d-fb7c78d695ef tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] DELETE failed (client error): The resource could not be found. Dec 09 22:18:32.880024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.notifier [None req-e8b33cec-1ca5-46a1-841d-fb7c78d695ef tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] No notification will be sent due to unsuccessful status code: 404 {{(pid=103437) after /opt/stack/neutron/neutron/pecan_wsgi/hooks/notifier.py:78}} Dec 09 22:18:32.882992 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e8b33cec-1ca5-46a1-841d-fb7c78d695ef tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "DELETE /v2.0/networks/ae33911c-e787-408e-88dd-3ea74c0815e6 HTTP/1.1" status: 404 len: 339 time: 0.0209377 Dec 09 22:18:32.885569 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32954) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:32.935930 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-a4e12604-acd0-4a48-b33e-dd999687983f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Deleting subnet 9d430125-fb95-429e-944d-529d212a36f2 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:18:32.939097 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a4e12604-acd0-4a48-b33e-dd999687983f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:32.984500 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a4e12604-acd0-4a48-b33e-dd999687983f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:33.023584 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-65846826-648c-43cb-ab0b-172cb179b80c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:33.069558 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a4e12604-acd0-4a48-b33e-dd999687983f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:33.139116 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a4e12604-acd0-4a48-b33e-dd999687983f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:33.170264 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4e12604-acd0-4a48-b33e-dd999687983f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Pushing event deleted for resources: {'Subnet': ['ID=9d430125-fb95-429e-944d-529d212a36f2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:33.176614 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a4e12604-acd0-4a48-b33e-dd999687983f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:33.181203 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a4e12604-acd0-4a48-b33e-dd999687983f tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "DELETE /v2.0/subnets/9d430125-fb95-429e-944d-529d212a36f2 HTTP/1.1" status: 204 len: 168 time: 0.2934484 Dec 09 22:18:33.182124 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9c71d689-ab10-47dd-a752-7ffdd171d03d None None] Network 7fc76eff-17ac-46c1-b71e-be43ae99ec77 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:18:33.182673 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 32956) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:33.266761 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-012fd4b1-91b4-4ca9-8b14-f5a350c8c517 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:33.321097 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-012fd4b1-91b4-4ca9-8b14-f5a350c8c517 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Deleting port b3c43322-1152-413d-9501-ba898d2fee01 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:18:33.321746 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-012fd4b1-91b4-4ca9-8b14-f5a350c8c517 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:33.323196 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-217ba2be-caa9-4828-9162-3e1644c93cd4 None None] DHCP port deletion for 7fc76eff-17ac-46c1-b71e-be43ae99ec77 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:18:33.369966 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-217ba2be-caa9-4828-9162-3e1644c93cd4 None None] Deleting port b3c43322-1152-413d-9501-ba898d2fee01 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:18:33.370644 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-217ba2be-caa9-4828-9162-3e1644c93cd4 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:33.388468 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-012fd4b1-91b4-4ca9-8b14-f5a350c8c517 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] For port b3c43322-1152-413d-9501-ba898d2fee01, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b3c43322-1152-413d-9501-ba898d2fee01,segment=NetworkSegment(ac4f0bff-4679-49e0-9cf0-2d12902e77e9),segment_id=ac4f0bff-4679-49e0-9cf0-2d12902e77e9)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:33.388824 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-012fd4b1-91b4-4ca9-8b14-f5a350c8c517 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:33.401251 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-012fd4b1-91b4-4ca9-8b14-f5a350c8c517 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Calling delete_port for b3c43322-1152-413d-9501-ba898d2fee01 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:18:33.433549 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-217ba2be-caa9-4828-9162-3e1644c93cd4 None None] For port b3c43322-1152-413d-9501-ba898d2fee01, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b3c43322-1152-413d-9501-ba898d2fee01,segment=NetworkSegment(ac4f0bff-4679-49e0-9cf0-2d12902e77e9),segment_id=ac4f0bff-4679-49e0-9cf0-2d12902e77e9)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:33.433943 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-217ba2be-caa9-4828-9162-3e1644c93cd4 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:33.450555 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-217ba2be-caa9-4828-9162-3e1644c93cd4 None None] Calling delete_port for b3c43322-1152-413d-9501-ba898d2fee01 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:18:33.482630 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-012fd4b1-91b4-4ca9-8b14-f5a350c8c517 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:33.508063 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-012fd4b1-91b4-4ca9-8b14-f5a350c8c517 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Pushing event deleted for resources: {'Port': ['ID=b3c43322-1152-413d-9501-ba898d2fee01,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:33.511556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-012fd4b1-91b4-4ca9-8b14-f5a350c8c517 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] No DVR routers for this DVR port b3c43322-1152-413d-9501-ba898d2fee01 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:18:33.533506 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-217ba2be-caa9-4828-9162-3e1644c93cd4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:33.558290 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-217ba2be-caa9-4828-9162-3e1644c93cd4 None None] Pushing event deleted for resources: {'Port': ['ID=b3c43322-1152-413d-9501-ba898d2fee01,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:33.561735 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-217ba2be-caa9-4828-9162-3e1644c93cd4 None None] No DVR routers for this DVR port b3c43322-1152-413d-9501-ba898d2fee01 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:18:33.596691 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-012fd4b1-91b4-4ca9-8b14-f5a350c8c517 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:33.617248 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-012fd4b1-91b4-4ca9-8b14-f5a350c8c517 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7fc76eff-17ac-46c1-b71e-be43ae99ec77']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:33.626838 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-012fd4b1-91b4-4ca9-8b14-f5a350c8c517 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ac4f0bff-4679-49e0-9cf0-2d12902e77e9') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:33.627135 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-012fd4b1-91b4-4ca9-8b14-f5a350c8c517 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ac4f0bff-4679-49e0-9cf0-2d12902e77e9') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:33.640828 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-012fd4b1-91b4-4ca9-8b14-f5a350c8c517 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:33.659515 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-012fd4b1-91b4-4ca9-8b14-f5a350c8c517 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:33.665749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-012fd4b1-91b4-4ca9-8b14-f5a350c8c517 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Releasing vlan 146 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:18:33.666130 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-012fd4b1-91b4-4ca9-8b14-f5a350c8c517 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: timer() Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:18:33.669207 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:18:33.734506 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-012fd4b1-91b4-4ca9-8b14-f5a350c8c517 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:33.744263 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-012fd4b1-91b4-4ca9-8b14-f5a350c8c517 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:33.747821 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-012fd4b1-91b4-4ca9-8b14-f5a350c8c517 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] 10.222.0.13 "DELETE /v2.0/networks/7fc76eff-17ac-46c1-b71e-be43ae99ec77 HTTP/1.1" status: 204 len: 168 time: 0.5640635 Dec 09 22:18:33.759184 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-012fd4b1-91b4-4ca9-8b14-f5a350c8c517 tempest-NetworksIpV6Test-336661002 tempest-NetworksIpV6Test-336661002-project] Pushing event deleted for resources: {'Network': ['ID=7fc76eff-17ac-46c1-b71e-be43ae99ec77,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:34.000858 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32962) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:34.126244 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b3c43322-1152-413d-9501-ba898d2fee01 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:18:34.141177 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c38d6474-62f9-4516-91fd-a0f4c09c9dd1 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=8af3ea01133b4a319f92c353dc0a37dd&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1390533 Dec 09 22:18:34.143777 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 32966) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:34.147690 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: b3c43322-1152-413d-9501-ba898d2fee01 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:18:34.148016 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b3c43322-1152-413d-9501-ba898d2fee01 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:18:34.148430 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d45ae212-40f9-4095-ae22-a4093a5d034f no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:18:34.171371 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: d45ae212-40f9-4095-ae22-a4093a5d034f {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:18:34.171759 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d45ae212-40f9-4095-ae22-a4093a5d034f not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:18:34.192385 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c3fd7cfd-06ab-4002-9e05-81c6e607dc76 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:34.212771 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c3fd7cfd-06ab-4002-9e05-81c6e607dc76 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:34.260377 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c3fd7cfd-06ab-4002-9e05-81c6e607dc76 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:34.263205 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c3fd7cfd-06ab-4002-9e05-81c6e607dc76 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:34.264961 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c3fd7cfd-06ab-4002-9e05-81c6e607dc76 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/697d6980-c5d5-4940-91c0-8925f82d6d29 HTTP/1.1" status: 204 len: 168 time: 0.1200993 Dec 09 22:18:34.274223 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3fd7cfd-06ab-4002-9e05-81c6e607dc76 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=697d6980-c5d5-4940-91c0-8925f82d6d29,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:34.957323 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32988) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:35.072819 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-40b57dca-1c88-4d48-9b5d-24ac07790da1 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Request body: {'router': {'name': 'tempest-RoutersNegativeTest-router-999691028', 'external_gateway_info': {}, 'admin_state_up': False}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:35.106136 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-40b57dca-1c88-4d48-9b5d-24ac07790da1 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:35.107252 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-40b57dca-1c88-4d48-9b5d-24ac07790da1 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:35.174855 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-40b57dca-1c88-4d48-9b5d-24ac07790da1 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:35.181400 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-40b57dca-1c88-4d48-9b5d-24ac07790da1 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:35.201228 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-40b57dca-1c88-4d48-9b5d-24ac07790da1 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:35.202565 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-40b57dca-1c88-4d48-9b5d-24ac07790da1 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 707 time: 0.2442186 Dec 09 22:18:35.205401 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32992) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:35.210618 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-73d51db8-a104-46f8-923d-d717656c1c78 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Request body: {'network': {'name': 'tempest-RoutersNegativeTest-test-network-2097968511'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:35.232697 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-73d51db8-a104-46f8-923d-d717656c1c78 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Made reservation on behalf of a3d2305086f94cf68e7f5e6c18c80241 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:18:35.236181 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-73d51db8-a104-46f8-923d-d717656c1c78 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:35.245527 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-73d51db8-a104-46f8-923d-d717656c1c78 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:35.324315 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-73d51db8-a104-46f8-923d-d717656c1c78 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:35.329475 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-73d51db8-a104-46f8-923d-d717656c1c78 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:35.356151 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-73d51db8-a104-46f8-923d-d717656c1c78 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] vlan segment allocate from pool success with {'vlan_id': 120, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 22:18:35.364984 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73d51db8-a104-46f8-923d-d717656c1c78 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Pushing event updated for resources: {'SecurityGroup': ['ID=103b15ef-5ea4-4aae-958b-d1af611e252d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:35.371410 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-73d51db8-a104-46f8-923d-d717656c1c78 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:35.371792 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-73d51db8-a104-46f8-923d-d717656c1c78 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Added segment 36fb9842-68f1-48a4-ae63-230992985299 of type vlan for network 6fc0e9b2-9eaa-400f-b146-5c0ec0aa4e70 Dec 09 22:18:35.411912 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-73d51db8-a104-46f8-923d-d717656c1c78 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:35.443317 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-73d51db8-a104-46f8-923d-d717656c1c78 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:35.451955 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73d51db8-a104-46f8-923d-d717656c1c78 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:35.452646 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-73d51db8-a104-46f8-923d-d717656c1c78 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:35.491056 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-73d51db8-a104-46f8-923d-d717656c1c78 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 787 time: 0.2846322 Dec 09 22:18:35.494327 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 32994) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:35.501739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-4300980a-3f48-4f66-959c-cc7dc686e03c tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Request body: {'subnet': {'network_id': '6fc0e9b2-9eaa-400f-b146-5c0ec0aa4e70', 'cidr': '172.20.0.0/28', 'ip_version': 4, 'gateway_ip': '172.20.0.1'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:35.542050 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73d51db8-a104-46f8-923d-d717656c1c78 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Pushing event updated for resources: {'Network': ['ID=6fc0e9b2-9eaa-400f-b146-5c0ec0aa4e70,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:35.552768 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 6fc0e9b2-9eaa-400f-b146-5c0ec0aa4e70 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 22:18:35.625270 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4300980a-3f48-4f66-959c-cc7dc686e03c tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Made reservation on behalf of a3d2305086f94cf68e7f5e6c18c80241 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:18:35.629137 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4300980a-3f48-4f66-959c-cc7dc686e03c tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:35.658934 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3976208b-cad0-4de5-b8db-53b60284b616 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:35.816488 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4300980a-3f48-4f66-959c-cc7dc686e03c tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:35.875384 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4300980a-3f48-4f66-959c-cc7dc686e03c tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Pushing event updated for resources: {'Subnet': ['ID=d8dc7875-9a90-43b4-89de-ee381e927524,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:35.890438 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4300980a-3f48-4f66-959c-cc7dc686e03c tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Checking segment: {'id': '36fb9842-68f1-48a4-ae63-230992985299', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': '6fc0e9b2-9eaa-400f-b146-5c0ec0aa4e70'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:18:35.890802 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4300980a-3f48-4f66-959c-cc7dc686e03c tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Network hostable DHCP agents. Network: 6fc0e9b2-9eaa-400f-b146-5c0ec0aa4e70, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 22:18:35.909457 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4300980a-3f48-4f66-959c-cc7dc686e03c tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Network 6fc0e9b2-9eaa-400f-b146-5c0ec0aa4e70 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 22:18:35.921054 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-4300980a-3f48-4f66-959c-cc7dc686e03c tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 6fc0e9b2-9eaa-400f-b146-5c0ec0aa4e70) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:18:35.926019 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4300980a-3f48-4f66-959c-cc7dc686e03c tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:35.927504 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4300980a-3f48-4f66-959c-cc7dc686e03c tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:35.930435 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4fab7db-5a6d-4097-bae3-d0c83468359a None None] Network 6fc0e9b2-9eaa-400f-b146-5c0ec0aa4e70 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:18:35.945086 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4300980a-3f48-4f66-959c-cc7dc686e03c tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.4496124 Dec 09 22:18:35.948503 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 32996) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:35.953641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-e3c5701c-835d-4071-8e86-e64fdf31e054 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Request body: {'network': {'name': 'tempest-RoutersNegativeTest-test-network-1880761603'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:35.976512 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e3c5701c-835d-4071-8e86-e64fdf31e054 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Made reservation on behalf of a3d2305086f94cf68e7f5e6c18c80241 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:18:35.980066 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e3c5701c-835d-4071-8e86-e64fdf31e054 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:36.004813 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e3c5701c-835d-4071-8e86-e64fdf31e054 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] vlan segment allocate from pool success with {'vlan_id': 121, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 22:18:36.014250 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e3c5701c-835d-4071-8e86-e64fdf31e054 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:36.014589 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-e3c5701c-835d-4071-8e86-e64fdf31e054 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Added segment 87a67136-5646-43e3-9e39-4fce0e0bb55d of type vlan for network f053a6c7-1496-4a1c-bec2-fc05a1f19106 Dec 09 22:18:36.035053 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-84c2b524-a918-400c-aa02-e622f1715be1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-6fc0e9b2-9eaa-400f-b146-5c0ec0aa4e70', 'network_id': '6fc0e9b2-9eaa-400f-b146-5c0ec0aa4e70', 'project_id': 'a3d2305086f94cf68e7f5e6c18c80241', 'fixed_ips': [{'subnet_id': 'd8dc7875-9a90-43b4-89de-ee381e927524'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 22:18:36.036083 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-84c2b524-a918-400c-aa02-e622f1715be1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:36.057097 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e3c5701c-835d-4071-8e86-e64fdf31e054 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:36.082665 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e3c5701c-835d-4071-8e86-e64fdf31e054 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:36.088292 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3c5701c-835d-4071-8e86-e64fdf31e054 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:36.088876 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e3c5701c-835d-4071-8e86-e64fdf31e054 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:36.123619 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e3c5701c-835d-4071-8e86-e64fdf31e054 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 787 time: 0.1739676 Dec 09 22:18:36.126470 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 32998) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:36.133578 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-5a968b9e-6225-4b3a-af38-14473ad42fe6 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Request body: {'subnet': {'network_id': 'f053a6c7-1496-4a1c-bec2-fc05a1f19106', 'cidr': '172.21.0.0/28', 'ip_version': 4, 'gateway_ip': '172.21.0.1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:36.173027 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3c5701c-835d-4071-8e86-e64fdf31e054 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Pushing event updated for resources: {'Network': ['ID=f053a6c7-1496-4a1c-bec2-fc05a1f19106,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:36.174737 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-84c2b524-a918-400c-aa02-e622f1715be1 None None] Allocated IP 172.20.0.2 (6fc0e9b2-9eaa-400f-b146-5c0ec0aa4e70/d8dc7875-9a90-43b4-89de-ee381e927524/787a4a44-d411-4f54-bff4-7efb15e851f6) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:18:36.185567 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network f053a6c7-1496-4a1c-bec2-fc05a1f19106 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 22:18:36.251739 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5a968b9e-6225-4b3a-af38-14473ad42fe6 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Made reservation on behalf of a3d2305086f94cf68e7f5e6c18c80241 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:18:36.255245 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5a968b9e-6225-4b3a-af38-14473ad42fe6 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:36.375216 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-84c2b524-a918-400c-aa02-e622f1715be1 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:36.381770 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-84c2b524-a918-400c-aa02-e622f1715be1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:36.423976 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84c2b524-a918-400c-aa02-e622f1715be1 None None] Network 6fc0e9b2-9eaa-400f-b146-5c0ec0aa4e70 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:18:36.426782 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-84c2b524-a918-400c-aa02-e622f1715be1 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:18:36.432626 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84c2b524-a918-400c-aa02-e622f1715be1 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:18:36.436886 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5a968b9e-6225-4b3a-af38-14473ad42fe6 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:36.438304 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84c2b524-a918-400c-aa02-e622f1715be1 None None] Pushing event updated for resources: {'Port': ['ID=787a4a44-d411-4f54-bff4-7efb15e851f6,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:36.493757 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-84c2b524-a918-400c-aa02-e622f1715be1 None None] Attempting to bind port 787a4a44-d411-4f54-bff4-7efb15e851f6 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:18:36.494130 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-84c2b524-a918-400c-aa02-e622f1715be1 None None] Attempting to bind port 787a4a44-d411-4f54-bff4-7efb15e851f6 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '36fb9842-68f1-48a4-ae63-230992985299', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': '6fc0e9b2-9eaa-400f-b146-5c0ec0aa4e70'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:18:36.494498 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84c2b524-a918-400c-aa02-e622f1715be1 None None] Attempting to bind port 787a4a44-d411-4f54-bff4-7efb15e851f6 on network 6fc0e9b2-9eaa-400f-b146-5c0ec0aa4e70 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:18:36.499612 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84c2b524-a918-400c-aa02-e622f1715be1 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 18, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:18:36.500012 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84c2b524-a918-400c-aa02-e622f1715be1 None None] Checking segment: {'id': '36fb9842-68f1-48a4-ae63-230992985299', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': '6fc0e9b2-9eaa-400f-b146-5c0ec0aa4e70'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:18:36.500419 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-84c2b524-a918-400c-aa02-e622f1715be1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:36.500813 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84c2b524-a918-400c-aa02-e622f1715be1 None None] Bound using segment: {'id': '36fb9842-68f1-48a4-ae63-230992985299', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': '6fc0e9b2-9eaa-400f-b146-5c0ec0aa4e70'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:18:36.501278 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-84c2b524-a918-400c-aa02-e622f1715be1 None None] Bound port: 787a4a44-d411-4f54-bff4-7efb15e851f6, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '36fb9842-68f1-48a4-ae63-230992985299', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 120, 'network_id': '6fc0e9b2-9eaa-400f-b146-5c0ec0aa4e70'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:18:36.501660 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-84c2b524-a918-400c-aa02-e622f1715be1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:36.502428 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a968b9e-6225-4b3a-af38-14473ad42fe6 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Pushing event updated for resources: {'Subnet': ['ID=369769f3-9b70-4559-95fd-816954295bcc,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:36.511862 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a968b9e-6225-4b3a-af38-14473ad42fe6 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Checking segment: {'id': '87a67136-5646-43e3-9e39-4fce0e0bb55d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': 'f053a6c7-1496-4a1c-bec2-fc05a1f19106'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:18:36.512227 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a968b9e-6225-4b3a-af38-14473ad42fe6 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Network hostable DHCP agents. Network: f053a6c7-1496-4a1c-bec2-fc05a1f19106, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 22:18:36.531541 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a968b9e-6225-4b3a-af38-14473ad42fe6 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Network f053a6c7-1496-4a1c-bec2-fc05a1f19106 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 22:18:36.540344 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-5a968b9e-6225-4b3a-af38-14473ad42fe6 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, f053a6c7-1496-4a1c-bec2-fc05a1f19106) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:18:36.544943 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a968b9e-6225-4b3a-af38-14473ad42fe6 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:36.545545 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5a968b9e-6225-4b3a-af38-14473ad42fe6 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:36.549443 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d3a785a-7527-494b-9dff-dd3e8a7d0999 None None] Network f053a6c7-1496-4a1c-bec2-fc05a1f19106 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:18:36.563462 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5a968b9e-6225-4b3a-af38-14473ad42fe6 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 801 time: 0.4359770 Dec 09 22:18:36.566258 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33000) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:36.570989 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-1234f7e4-25b2-4f2d-8b78-d4bed6b62d91 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Request body: {'router': {'external_gateway_info': {'network_id': 'f053a6c7-1496-4a1c-bec2-fc05a1f19106'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:36.619032 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-84c2b524-a918-400c-aa02-e622f1715be1 None None] For port 787a4a44-d411-4f54-bff4-7efb15e851f6, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:18:36.636360 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-84c2b524-a918-400c-aa02-e622f1715be1 None None] For port 787a4a44-d411-4f54-bff4-7efb15e851f6, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=787a4a44-d411-4f54-bff4-7efb15e851f6,segment=NetworkSegment(36fb9842-68f1-48a4-ae63-230992985299),segment_id=36fb9842-68f1-48a4-ae63-230992985299)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:18:36.643522 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-84c2b524-a918-400c-aa02-e622f1715be1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:36.707304 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2687d88-75b3-45df-9f70-7d6987c86ed4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-f053a6c7-1496-4a1c-bec2-fc05a1f19106', 'network_id': 'f053a6c7-1496-4a1c-bec2-fc05a1f19106', 'project_id': 'a3d2305086f94cf68e7f5e6c18c80241', 'fixed_ips': [{'subnet_id': '369769f3-9b70-4559-95fd-816954295bcc'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 22:18:36.708179 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b2687d88-75b3-45df-9f70-7d6987c86ed4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:36.734591 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84c2b524-a918-400c-aa02-e622f1715be1 None None] Pushing event updated for resources: {'Port': ['ID=787a4a44-d411-4f54-bff4-7efb15e851f6,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:36.786580 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1234f7e4-25b2-4f2d-8b78-d4bed6b62d91 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:36.862216 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:36.899113 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-b2687d88-75b3-45df-9f70-7d6987c86ed4 None None] Allocated IP 172.21.0.2 (f053a6c7-1496-4a1c-bec2-fc05a1f19106/369769f3-9b70-4559-95fd-816954295bcc/6ec4c1a8-ed5d-46d4-8985-f536dce9f8ae) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:18:36.930011 n-d-713301-27 neutron-server[103438]: INFO neutron.api.v2.resource [None req-1234f7e4-25b2-4f2d-8b78-d4bed6b62d91 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] update failed (client error): The server could not comply with the request since it is either malformed or otherwise incorrect. Dec 09 22:18:36.931334 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1234f7e4-25b2-4f2d-8b78-d4bed6b62d91 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] 10.222.0.13 "PUT /v2.0/routers/5f7e7ec0-678b-479b-884e-94451e45cb45 HTTP/1.1" status: 400 len: 364 time: 0.3640091 Dec 09 22:18:36.937444 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33002) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:37.001204 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-09adcf12-5bb8-4d79-9b86-26a17328fb85 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Deleting subnet 369769f3-9b70-4559-95fd-816954295bcc {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:18:37.251647 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b2687d88-75b3-45df-9f70-7d6987c86ed4 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:37.257279 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-09adcf12-5bb8-4d79-9b86-26a17328fb85 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:37.257827 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b2687d88-75b3-45df-9f70-7d6987c86ed4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:37.296581 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b2687d88-75b3-45df-9f70-7d6987c86ed4 None None] Network f053a6c7-1496-4a1c-bec2-fc05a1f19106 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:18:37.299360 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-b2687d88-75b3-45df-9f70-7d6987c86ed4 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:18:37.305851 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2687d88-75b3-45df-9f70-7d6987c86ed4 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:18:37.306040 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-09adcf12-5bb8-4d79-9b86-26a17328fb85 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:37.313070 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2687d88-75b3-45df-9f70-7d6987c86ed4 None None] Pushing event updated for resources: {'Port': ['ID=6ec4c1a8-ed5d-46d4-8985-f536dce9f8ae,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:37.376059 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-b2687d88-75b3-45df-9f70-7d6987c86ed4 None None] Attempting to bind port 6ec4c1a8-ed5d-46d4-8985-f536dce9f8ae on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:18:37.376528 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-b2687d88-75b3-45df-9f70-7d6987c86ed4 None None] Attempting to bind port 6ec4c1a8-ed5d-46d4-8985-f536dce9f8ae by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '87a67136-5646-43e3-9e39-4fce0e0bb55d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': 'f053a6c7-1496-4a1c-bec2-fc05a1f19106'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:18:37.376973 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2687d88-75b3-45df-9f70-7d6987c86ed4 None None] Attempting to bind port 6ec4c1a8-ed5d-46d4-8985-f536dce9f8ae on network f053a6c7-1496-4a1c-bec2-fc05a1f19106 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:18:37.382394 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2687d88-75b3-45df-9f70-7d6987c86ed4 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 18, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:18:37.382770 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2687d88-75b3-45df-9f70-7d6987c86ed4 None None] Checking segment: {'id': '87a67136-5646-43e3-9e39-4fce0e0bb55d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': 'f053a6c7-1496-4a1c-bec2-fc05a1f19106'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:18:37.383167 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b2687d88-75b3-45df-9f70-7d6987c86ed4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:37.383624 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b2687d88-75b3-45df-9f70-7d6987c86ed4 None None] Bound using segment: {'id': '87a67136-5646-43e3-9e39-4fce0e0bb55d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': 'f053a6c7-1496-4a1c-bec2-fc05a1f19106'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:18:37.384060 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-b2687d88-75b3-45df-9f70-7d6987c86ed4 None None] Bound port: 6ec4c1a8-ed5d-46d4-8985-f536dce9f8ae, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '87a67136-5646-43e3-9e39-4fce0e0bb55d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 121, 'network_id': 'f053a6c7-1496-4a1c-bec2-fc05a1f19106'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:18:37.384439 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b2687d88-75b3-45df-9f70-7d6987c86ed4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:37.396491 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-09adcf12-5bb8-4d79-9b86-26a17328fb85 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:37.461598 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-09adcf12-5bb8-4d79-9b86-26a17328fb85 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:37.465205 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-b2687d88-75b3-45df-9f70-7d6987c86ed4 None None] For port 6ec4c1a8-ed5d-46d4-8985-f536dce9f8ae, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:18:37.468853 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-b2687d88-75b3-45df-9f70-7d6987c86ed4 None None] For port 6ec4c1a8-ed5d-46d4-8985-f536dce9f8ae, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6ec4c1a8-ed5d-46d4-8985-f536dce9f8ae,segment=NetworkSegment(87a67136-5646-43e3-9e39-4fce0e0bb55d),segment_id=87a67136-5646-43e3-9e39-4fce0e0bb55d)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:18:37.473700 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b2687d88-75b3-45df-9f70-7d6987c86ed4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:37.496929 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09adcf12-5bb8-4d79-9b86-26a17328fb85 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Pushing event deleted for resources: {'Subnet': ['ID=369769f3-9b70-4559-95fd-816954295bcc,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:37.498925 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-09adcf12-5bb8-4d79-9b86-26a17328fb85 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:37.502978 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-09adcf12-5bb8-4d79-9b86-26a17328fb85 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] 10.222.0.13 "DELETE /v2.0/subnets/369769f3-9b70-4559-95fd-816954295bcc HTTP/1.1" status: 204 len: 168 time: 0.5638604 Dec 09 22:18:37.504925 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33004) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:37.534158 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2687d88-75b3-45df-9f70-7d6987c86ed4 None None] Pushing event updated for resources: {'Port': ['ID=6ec4c1a8-ed5d-46d4-8985-f536dce9f8ae,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:37.599300 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-477c280a-f8b3-492b-b0eb-9ed1298fad2a tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:37.657227 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-477c280a-f8b3-492b-b0eb-9ed1298fad2a tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Deleting port 6ec4c1a8-ed5d-46d4-8985-f536dce9f8ae {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:18:37.657577 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-477c280a-f8b3-492b-b0eb-9ed1298fad2a tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:37.731536 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-477c280a-f8b3-492b-b0eb-9ed1298fad2a tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] For port 6ec4c1a8-ed5d-46d4-8985-f536dce9f8ae, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=6ec4c1a8-ed5d-46d4-8985-f536dce9f8ae,segment=NetworkSegment(87a67136-5646-43e3-9e39-4fce0e0bb55d),segment_id=87a67136-5646-43e3-9e39-4fce0e0bb55d)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:37.731536 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-477c280a-f8b3-492b-b0eb-9ed1298fad2a tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:37.745673 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-477c280a-f8b3-492b-b0eb-9ed1298fad2a tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Calling delete_port for 6ec4c1a8-ed5d-46d4-8985-f536dce9f8ae owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:18:37.769752 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b22f4e8e-3465-4df4-97e7-a93a3d0fe23f None None] Network 6fc0e9b2-9eaa-400f-b146-5c0ec0aa4e70 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:18:37.845036 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-477c280a-f8b3-492b-b0eb-9ed1298fad2a tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:37.854925 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4ee460fa-450d-4146-b442-9af307b2a2ba None None] Provisioning complete for port 787a4a44-d411-4f54-bff4-7efb15e851f6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:37.855298 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4ee460fa-450d-4146-b442-9af307b2a2ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:37.875200 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-477c280a-f8b3-492b-b0eb-9ed1298fad2a tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Pushing event deleted for resources: {'Port': ['ID=6ec4c1a8-ed5d-46d4-8985-f536dce9f8ae,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:37.877182 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-477c280a-f8b3-492b-b0eb-9ed1298fad2a tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] No DVR routers for this DVR port 6ec4c1a8-ed5d-46d4-8985-f536dce9f8ae on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:18:37.982563 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4ee460fa-450d-4146-b442-9af307b2a2ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:38.019256 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-4ee460fa-450d-4146-b442-9af307b2a2ba None None] For port 787a4a44-d411-4f54-bff4-7efb15e851f6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=787a4a44-d411-4f54-bff4-7efb15e851f6,segment=NetworkSegment(36fb9842-68f1-48a4-ae63-230992985299),segment_id=36fb9842-68f1-48a4-ae63-230992985299)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:38.029013 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4ee460fa-450d-4146-b442-9af307b2a2ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:38.114407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ee460fa-450d-4146-b442-9af307b2a2ba None None] Pushing event updated for resources: {'Port': ['ID=787a4a44-d411-4f54-bff4-7efb15e851f6,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:38.190908 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 787a4a44-d411-4f54-bff4-7efb15e851f6 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:18:38.194700 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:38.245854 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 787a4a44-d411-4f54-bff4-7efb15e851f6 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:38.246254 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:38.276187 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-477c280a-f8b3-492b-b0eb-9ed1298fad2a tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:38.282489 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-28c572b3-2dc0-495a-b22d-df7f683048f5 None None] Provisioning complete for port 787a4a44-d411-4f54-bff4-7efb15e851f6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:38.282984 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-28c572b3-2dc0-495a-b22d-df7f683048f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:38.297560 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-477c280a-f8b3-492b-b0eb-9ed1298fad2a tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f053a6c7-1496-4a1c-bec2-fc05a1f19106']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:38.310943 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-477c280a-f8b3-492b-b0eb-9ed1298fad2a tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '87a67136-5646-43e3-9e39-4fce0e0bb55d') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:38.311540 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-477c280a-f8b3-492b-b0eb-9ed1298fad2a tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '87a67136-5646-43e3-9e39-4fce0e0bb55d') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:38.324761 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-477c280a-f8b3-492b-b0eb-9ed1298fad2a tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:38.348017 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-477c280a-f8b3-492b-b0eb-9ed1298fad2a tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:38.359325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-477c280a-f8b3-492b-b0eb-9ed1298fad2a tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Releasing vlan 121 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:18:38.359867 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-477c280a-f8b3-492b-b0eb-9ed1298fad2a tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: timer() Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:18:38.363468 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:18:38.443723 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-477c280a-f8b3-492b-b0eb-9ed1298fad2a tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:38.448537 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-477c280a-f8b3-492b-b0eb-9ed1298fad2a tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:38.452197 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-477c280a-f8b3-492b-b0eb-9ed1298fad2a tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] 10.222.0.13 "DELETE /v2.0/networks/f053a6c7-1496-4a1c-bec2-fc05a1f19106 HTTP/1.1" status: 204 len: 168 time: 0.9450190 Dec 09 22:18:38.454797 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33006) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:38.469076 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-477c280a-f8b3-492b-b0eb-9ed1298fad2a tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Pushing event deleted for resources: {'Network': ['ID=f053a6c7-1496-4a1c-bec2-fc05a1f19106,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:38.517755 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-791fe6d7-ffaa-4e18-b5ca-cd4031f5ed55 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Deleting subnet d8dc7875-9a90-43b4-89de-ee381e927524 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:18:38.522609 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-791fe6d7-ffaa-4e18-b5ca-cd4031f5ed55 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:38.578309 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-791fe6d7-ffaa-4e18-b5ca-cd4031f5ed55 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:38.687213 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-791fe6d7-ffaa-4e18-b5ca-cd4031f5ed55 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:38.697795 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae0c86a6-3f52-47e5-b3cd-38da9d8550c8 None None] DHCP port deletion for f053a6c7-1496-4a1c-bec2-fc05a1f19106 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:18:38.717325 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f115e262-818a-47f4-a5e0-1e19cf19829f None None] Network f053a6c7-1496-4a1c-bec2-fc05a1f19106 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:18:38.736862 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f115e262-818a-47f4-a5e0-1e19cf19829f None None] Network f053a6c7-1496-4a1c-bec2-fc05a1f19106 could not be found, it might have been deleted concurrently. {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:224}} Dec 09 22:18:38.740230 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d01b54c1-daa9-495d-b8d3-d0e8280c2200 None None] Could not find standard attr ID for object 6ec4c1a8-ed5d-46d4-8985-f536dce9f8ae. {{(pid=103439) _get_standard_attr_id /opt/stack/neutron/neutron/db/provisioning_blocks.py:175}} Dec 09 22:18:38.758800 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-791fe6d7-ffaa-4e18-b5ca-cd4031f5ed55 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:38.786154 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-791fe6d7-ffaa-4e18-b5ca-cd4031f5ed55 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Pushing event deleted for resources: {'Subnet': ['ID=d8dc7875-9a90-43b4-89de-ee381e927524,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:38.796860 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-791fe6d7-ffaa-4e18-b5ca-cd4031f5ed55 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:38.802074 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-791fe6d7-ffaa-4e18-b5ca-cd4031f5ed55 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] 10.222.0.13 "DELETE /v2.0/subnets/d8dc7875-9a90-43b4-89de-ee381e927524 HTTP/1.1" status: 204 len: 168 time: 0.3457787 Dec 09 22:18:38.803791 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-889fdc07-54c3-4171-a1f7-e66f0f3e4073 None None] Network 6fc0e9b2-9eaa-400f-b146-5c0ec0aa4e70 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:18:38.805164 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33008) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:38.916678 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9b528063-97ab-4ba8-b614-84602d3d611b tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:38.981635 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-114d9f49-420a-4c53-b9de-69b790985802 None None] DHCP port deletion for 6fc0e9b2-9eaa-400f-b146-5c0ec0aa4e70 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:18:38.987384 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-9b528063-97ab-4ba8-b614-84602d3d611b tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Deleting port 787a4a44-d411-4f54-bff4-7efb15e851f6 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:18:38.987774 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9b528063-97ab-4ba8-b614-84602d3d611b tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:39.045086 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-114d9f49-420a-4c53-b9de-69b790985802 None None] Deleting port 787a4a44-d411-4f54-bff4-7efb15e851f6 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:18:39.045457 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-114d9f49-420a-4c53-b9de-69b790985802 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:39.067054 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-9b528063-97ab-4ba8-b614-84602d3d611b tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] For port 787a4a44-d411-4f54-bff4-7efb15e851f6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=787a4a44-d411-4f54-bff4-7efb15e851f6,segment=NetworkSegment(36fb9842-68f1-48a4-ae63-230992985299),segment_id=36fb9842-68f1-48a4-ae63-230992985299)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:39.067591 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9b528063-97ab-4ba8-b614-84602d3d611b tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:39.081547 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-9b528063-97ab-4ba8-b614-84602d3d611b tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Calling delete_port for 787a4a44-d411-4f54-bff4-7efb15e851f6 owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:18:39.115402 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-114d9f49-420a-4c53-b9de-69b790985802 None None] For port 787a4a44-d411-4f54-bff4-7efb15e851f6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=787a4a44-d411-4f54-bff4-7efb15e851f6,segment=NetworkSegment(36fb9842-68f1-48a4-ae63-230992985299),segment_id=36fb9842-68f1-48a4-ae63-230992985299)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:39.115888 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-114d9f49-420a-4c53-b9de-69b790985802 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:39.130975 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-114d9f49-420a-4c53-b9de-69b790985802 None None] Calling delete_port for 787a4a44-d411-4f54-bff4-7efb15e851f6 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:18:39.188721 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9b528063-97ab-4ba8-b614-84602d3d611b tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:39.220100 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b528063-97ab-4ba8-b614-84602d3d611b tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] No DVR routers for this DVR port 787a4a44-d411-4f54-bff4-7efb15e851f6 on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:18:39.225955 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b528063-97ab-4ba8-b614-84602d3d611b tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Pushing event deleted for resources: {'Port': ['ID=787a4a44-d411-4f54-bff4-7efb15e851f6,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:39.234485 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-114d9f49-420a-4c53-b9de-69b790985802 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:39.261599 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-114d9f49-420a-4c53-b9de-69b790985802 None None] Pushing event deleted for resources: {'Port': ['ID=787a4a44-d411-4f54-bff4-7efb15e851f6,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:39.269388 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-114d9f49-420a-4c53-b9de-69b790985802 None None] No DVR routers for this DVR port 787a4a44-d411-4f54-bff4-7efb15e851f6 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:18:39.323110 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9b528063-97ab-4ba8-b614-84602d3d611b tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:39.357852 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-9b528063-97ab-4ba8-b614-84602d3d611b tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6fc0e9b2-9eaa-400f-b146-5c0ec0aa4e70']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:39.372414 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-9b528063-97ab-4ba8-b614-84602d3d611b tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '36fb9842-68f1-48a4-ae63-230992985299') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:39.372710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-9b528063-97ab-4ba8-b614-84602d3d611b tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '36fb9842-68f1-48a4-ae63-230992985299') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:39.382739 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9b528063-97ab-4ba8-b614-84602d3d611b tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:39.400255 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9b528063-97ab-4ba8-b614-84602d3d611b tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:39.410016 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9b528063-97ab-4ba8-b614-84602d3d611b tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Releasing vlan 120 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:18:39.410561 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9b528063-97ab-4ba8-b614-84602d3d611b tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: timer() Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:18:39.414702 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:18:39.474616 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9b528063-97ab-4ba8-b614-84602d3d611b tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:39.479311 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9b528063-97ab-4ba8-b614-84602d3d611b tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:39.483062 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9b528063-97ab-4ba8-b614-84602d3d611b tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] 10.222.0.13 "DELETE /v2.0/networks/6fc0e9b2-9eaa-400f-b146-5c0ec0aa4e70 HTTP/1.1" status: 204 len: 168 time: 0.6763749 Dec 09 22:18:39.485999 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33010) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:39.500178 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b528063-97ab-4ba8-b614-84602d3d611b tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Pushing event deleted for resources: {'Network': ['ID=6fc0e9b2-9eaa-400f-b146-5c0ec0aa4e70,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:39.518908 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ca4bf417-1c0f-4521-ba6a-25cd559ed647 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] 10.222.0.13 "GET /v2.0/ports?device_id=5f7e7ec0-678b-479b-884e-94451e45cb45 HTTP/1.1" status: 200 len: 205 time: 0.0315795 Dec 09 22:18:39.521169 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33012) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:39.593825 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4362620a-90a5-4c0f-9c87-a41f512d2338 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:39.680843 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:39.760407 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4362620a-90a5-4c0f-9c87-a41f512d2338 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:39.762640 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4362620a-90a5-4c0f-9c87-a41f512d2338 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:39.813046 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4362620a-90a5-4c0f-9c87-a41f512d2338 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:39.813577 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4362620a-90a5-4c0f-9c87-a41f512d2338 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Fanout notify agent at l3_agent the message router_deleted on router 5f7e7ec0-678b-479b-884e-94451e45cb45 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 22:18:39.820740 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4362620a-90a5-4c0f-9c87-a41f512d2338 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:39.822071 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4362620a-90a5-4c0f-9c87-a41f512d2338 tempest-RoutersNegativeTest-1480388763 tempest-RoutersNegativeTest-1480388763-project] 10.222.0.13 "DELETE /v2.0/routers/5f7e7ec0-678b-479b-884e-94451e45cb45 HTTP/1.1" status: 204 len: 168 time: 0.2994988 Dec 09 22:18:40.076856 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33018) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:40.122379 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 787a4a44-d411-4f54-bff4-7efb15e851f6 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:18:40.143180 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 787a4a44-d411-4f54-bff4-7efb15e851f6 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:18:40.143563 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 787a4a44-d411-4f54-bff4-7efb15e851f6 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:18:40.144005 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6ec4c1a8-ed5d-46d4-8985-f536dce9f8ae no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:18:40.163400 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 6ec4c1a8-ed5d-46d4-8985-f536dce9f8ae {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:18:40.163770 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 6ec4c1a8-ed5d-46d4-8985-f536dce9f8ae not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:18:40.216277 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a2660ea6-823e-46bd-b5f4-2de4dfddf4b3 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=a3d2305086f94cf68e7f5e6c18c80241&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1382194 Dec 09 22:18:40.218698 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33022) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:40.270312 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-43f07bc8-4e28-4ca4-a9e9-f08be5679d20 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:40.291554 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-43f07bc8-4e28-4ca4-a9e9-f08be5679d20 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:40.348128 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-43f07bc8-4e28-4ca4-a9e9-f08be5679d20 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:40.352010 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-43f07bc8-4e28-4ca4-a9e9-f08be5679d20 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:40.353635 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-43f07bc8-4e28-4ca4-a9e9-f08be5679d20 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/103b15ef-5ea4-4aae-958b-d1af611e252d HTTP/1.1" status: 204 len: 168 time: 0.1340740 Dec 09 22:18:40.361812 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43f07bc8-4e28-4ca4-a9e9-f08be5679d20 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=103b15ef-5ea4-4aae-958b-d1af611e252d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:41.042149 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33044) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:41.145633 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a9b1bbc2-3dda-4ff6-b014-40f199355781 admin admin] Request body: {'network': {'name': 'tempest-TestEncryptedCinderVolumes-1814699298-network', 'tenant_id': 'fe6fc091d42140bf80daf7c889de205d'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:41.172327 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a9b1bbc2-3dda-4ff6-b014-40f199355781 admin admin] Made reservation on behalf of fe6fc091d42140bf80daf7c889de205d for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:18:41.174741 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a9b1bbc2-3dda-4ff6-b014-40f199355781 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:41.183393 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a9b1bbc2-3dda-4ff6-b014-40f199355781 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:41.255621 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a9b1bbc2-3dda-4ff6-b014-40f199355781 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:41.263570 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a9b1bbc2-3dda-4ff6-b014-40f199355781 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:41.284529 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a9b1bbc2-3dda-4ff6-b014-40f199355781 admin admin] vlan segment allocate from pool success with {'vlan_id': 100, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 22:18:41.298167 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9b1bbc2-3dda-4ff6-b014-40f199355781 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=da2e1ee4-0b58-4224-a5d1-3ded9521a53d,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:41.303096 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a9b1bbc2-3dda-4ff6-b014-40f199355781 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:41.303562 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-a9b1bbc2-3dda-4ff6-b014-40f199355781 admin admin] Added segment 00089427-5063-4156-b8c3-e09f3fd9ab49 of type vlan for network f26b9f47-9dd3-4ccc-8f56-670f8249a431 Dec 09 22:18:41.343277 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a9b1bbc2-3dda-4ff6-b014-40f199355781 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:41.370624 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a9b1bbc2-3dda-4ff6-b014-40f199355781 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:41.371546 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a9b1bbc2-3dda-4ff6-b014-40f199355781 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:41.372093 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a9b1bbc2-3dda-4ff6-b014-40f199355781 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:41.405385 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a9b1bbc2-3dda-4ff6-b014-40f199355781 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 0.3621233 Dec 09 22:18:41.408696 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33048) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:41.413792 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-f5c3f50e-6e65-423d-92b7-2c6146f0e3b0 admin admin] Request body: {'subnet': {'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestEncryptedCinderVolumes-1814699298-subnet', 'tenant_id': 'fe6fc091d42140bf80daf7c889de205d', 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:41.435701 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f5c3f50e-6e65-423d-92b7-2c6146f0e3b0 admin admin] Made reservation on behalf of fe6fc091d42140bf80daf7c889de205d for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:18:41.436870 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9b1bbc2-3dda-4ff6-b014-40f199355781 admin admin] Pushing event updated for resources: {'Network': ['ID=f26b9f47-9dd3-4ccc-8f56-670f8249a431,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:41.438061 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f5c3f50e-6e65-423d-92b7-2c6146f0e3b0 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:41.447276 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network f26b9f47-9dd3-4ccc-8f56-670f8249a431 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 22:18:41.605709 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f5c3f50e-6e65-423d-92b7-2c6146f0e3b0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:41.653319 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5c3f50e-6e65-423d-92b7-2c6146f0e3b0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2514586e-123f-4e2a-91a9-d8f14bd6e8d4,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:41.668546 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5c3f50e-6e65-423d-92b7-2c6146f0e3b0 admin admin] Checking segment: {'id': '00089427-5063-4156-b8c3-e09f3fd9ab49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:18:41.668894 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5c3f50e-6e65-423d-92b7-2c6146f0e3b0 admin admin] Network hostable DHCP agents. Network: f26b9f47-9dd3-4ccc-8f56-670f8249a431, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 22:18:41.687387 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5c3f50e-6e65-423d-92b7-2c6146f0e3b0 admin admin] Network f26b9f47-9dd3-4ccc-8f56-670f8249a431 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 22:18:41.696591 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-f5c3f50e-6e65-423d-92b7-2c6146f0e3b0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, f26b9f47-9dd3-4ccc-8f56-670f8249a431) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:18:41.700668 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5c3f50e-6e65-423d-92b7-2c6146f0e3b0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:41.701264 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f5c3f50e-6e65-423d-92b7-2c6146f0e3b0 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:41.706303 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c9ab53cf-42be-4822-98bb-dd216121d177 None None] Network f26b9f47-9dd3-4ccc-8f56-670f8249a431 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:18:41.720261 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f5c3f50e-6e65-423d-92b7-2c6146f0e3b0 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 0.3078825 Dec 09 22:18:41.720456 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33050) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:41.724732 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-daebedc0-bbf3-4027-b9d2-8971f41bff0a admin admin] Request body: {'router': {'name': 'tempest-TestEncryptedCinderVolumes-1814699298-router', 'tenant_id': 'fe6fc091d42140bf80daf7c889de205d', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:41.746732 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-daebedc0-bbf3-4027-b9d2-8971f41bff0a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:41.747762 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-daebedc0-bbf3-4027-b9d2-8971f41bff0a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:41.805753 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-daebedc0-bbf3-4027-b9d2-8971f41bff0a admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:41.810046 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-393e4669-02ed-4791-94b8-4e1d9bf13b5d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-f26b9f47-9dd3-4ccc-8f56-670f8249a431', 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431', 'project_id': 'fe6fc091d42140bf80daf7c889de205d', 'fixed_ips': [{'subnet_id': '2514586e-123f-4e2a-91a9-d8f14bd6e8d4'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 22:18:41.811042 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-393e4669-02ed-4791-94b8-4e1d9bf13b5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:41.947189 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-daebedc0-bbf3-4027-b9d2-8971f41bff0a admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:41.948543 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-393e4669-02ed-4791-94b8-4e1d9bf13b5d None None] Allocated IP 172.20.0.2 (f26b9f47-9dd3-4ccc-8f56-670f8249a431/2514586e-123f-4e2a-91a9-d8f14bd6e8d4/d9478d61-9b43-4595-b182-b3ff840eb518) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:18:42.088459 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-393e4669-02ed-4791-94b8-4e1d9bf13b5d None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:42.099859 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-393e4669-02ed-4791-94b8-4e1d9bf13b5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:42.141783 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-393e4669-02ed-4791-94b8-4e1d9bf13b5d None None] Network f26b9f47-9dd3-4ccc-8f56-670f8249a431 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:18:42.146214 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-393e4669-02ed-4791-94b8-4e1d9bf13b5d None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:18:42.149115 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-393e4669-02ed-4791-94b8-4e1d9bf13b5d None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:18:42.160893 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-393e4669-02ed-4791-94b8-4e1d9bf13b5d None None] Pushing event updated for resources: {'Port': ['ID=d9478d61-9b43-4595-b182-b3ff840eb518,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:42.171305 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-daebedc0-bbf3-4027-b9d2-8971f41bff0a admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:42.191045 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-daebedc0-bbf3-4027-b9d2-8971f41bff0a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:42.212158 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-393e4669-02ed-4791-94b8-4e1d9bf13b5d None None] Attempting to bind port d9478d61-9b43-4595-b182-b3ff840eb518 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:18:42.212589 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-393e4669-02ed-4791-94b8-4e1d9bf13b5d None None] Attempting to bind port d9478d61-9b43-4595-b182-b3ff840eb518 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '00089427-5063-4156-b8c3-e09f3fd9ab49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:18:42.213000 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-393e4669-02ed-4791-94b8-4e1d9bf13b5d None None] Attempting to bind port d9478d61-9b43-4595-b182-b3ff840eb518 on network f26b9f47-9dd3-4ccc-8f56-670f8249a431 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:18:42.218152 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-393e4669-02ed-4791-94b8-4e1d9bf13b5d None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 18, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:18:42.218544 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-393e4669-02ed-4791-94b8-4e1d9bf13b5d None None] Checking segment: {'id': '00089427-5063-4156-b8c3-e09f3fd9ab49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:18:42.219014 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-393e4669-02ed-4791-94b8-4e1d9bf13b5d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:42.219503 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-393e4669-02ed-4791-94b8-4e1d9bf13b5d None None] Bound using segment: {'id': '00089427-5063-4156-b8c3-e09f3fd9ab49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:18:42.220079 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-393e4669-02ed-4791-94b8-4e1d9bf13b5d None None] Bound port: d9478d61-9b43-4595-b182-b3ff840eb518, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '00089427-5063-4156-b8c3-e09f3fd9ab49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:18:42.220540 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-393e4669-02ed-4791-94b8-4e1d9bf13b5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:42.283285 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-393e4669-02ed-4791-94b8-4e1d9bf13b5d None None] For port d9478d61-9b43-4595-b182-b3ff840eb518, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:18:42.286873 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-393e4669-02ed-4791-94b8-4e1d9bf13b5d None None] For port d9478d61-9b43-4595-b182-b3ff840eb518, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d9478d61-9b43-4595-b182-b3ff840eb518,segment=NetworkSegment(00089427-5063-4156-b8c3-e09f3fd9ab49),segment_id=00089427-5063-4156-b8c3-e09f3fd9ab49)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:18:42.291368 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-393e4669-02ed-4791-94b8-4e1d9bf13b5d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:42.296692 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-daebedc0-bbf3-4027-b9d2-8971f41bff0a admin admin] Allocated IP 172.25.3.113 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/82ddfea0-1142-4558-85d2-db322e9f25cf) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:18:42.356146 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-393e4669-02ed-4791-94b8-4e1d9bf13b5d None None] Pushing event updated for resources: {'Port': ['ID=d9478d61-9b43-4595-b182-b3ff840eb518,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:42.413854 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-daebedc0-bbf3-4027-b9d2-8971f41bff0a admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:42.450141 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-daebedc0-bbf3-4027-b9d2-8971f41bff0a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:42.488212 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-daebedc0-bbf3-4027-b9d2-8971f41bff0a admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:18:42.491498 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-daebedc0-bbf3-4027-b9d2-8971f41bff0a admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:18:42.493972 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-daebedc0-bbf3-4027-b9d2-8971f41bff0a admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:18:42.524420 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e02957f6-7751-4a56-a140-cd627e55ce31 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:18:42.530842 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daebedc0-bbf3-4027-b9d2-8971f41bff0a admin admin] Pushing event updated for resources: {'Port': ['ID=82ddfea0-1142-4558-85d2-db322e9f25cf,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:42.596793 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9dc67b23-54ac-4cf7-a0c2-97d1cd0ab1f4 None None] Provisioning complete for port 82ddfea0-1142-4558-85d2-db322e9f25cf triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:42.597589 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9dc67b23-54ac-4cf7-a0c2-97d1cd0ab1f4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:42.633760 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9dc67b23-54ac-4cf7-a0c2-97d1cd0ab1f4 None None] Port 82ddfea0-1142-4558-85d2-db322e9f25cf cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:18:42.792330 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-daebedc0-bbf3-4027-b9d2-8971f41bff0a admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:42.999067 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-daebedc0-bbf3-4027-b9d2-8971f41bff0a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:43.141257 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-daebedc0-bbf3-4027-b9d2-8971f41bff0a admin admin] Router 338d76a7-f43b-4adb-b0a7-9d17e1367513 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 22:18:43.259410 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-daebedc0-bbf3-4027-b9d2-8971f41bff0a admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:18:43.270922 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] Sync routers for ids ['338d76a7-f43b-4adb-b0a7-9d17e1367513'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:18:43.280852 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-daebedc0-bbf3-4027-b9d2-8971f41bff0a admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:43.281048 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-daebedc0-bbf3-4027-b9d2-8971f41bff0a admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 1.5596888 Dec 09 22:18:43.291266 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33052) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:43.296448 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] Routers {'338d76a7-f43b-4adb-b0a7-9d17e1367513'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:18:43.297365 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:18:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['338d76a7-f43b-4adb-b0a7-9d17e1367513'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:43.335177 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-89cf0f11-ccef-4240-a8f9-4e71f4d80687 None None] Network f26b9f47-9dd3-4ccc-8f56-670f8249a431 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:18:43.454546 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-0de2423e-40e3-4b8c-948f-8232d626e594 None None] Provisioning complete for port d9478d61-9b43-4595-b182-b3ff840eb518 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:43.454898 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0de2423e-40e3-4b8c-948f-8232d626e594 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:43.501108 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] Set router 338d76a7-f43b-4adb-b0a7-9d17e1367513 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:18:43.703310 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0de2423e-40e3-4b8c-948f-8232d626e594 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:43.761574 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0de2423e-40e3-4b8c-948f-8232d626e594 None None] For port d9478d61-9b43-4595-b182-b3ff840eb518, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d9478d61-9b43-4595-b182-b3ff840eb518,segment=NetworkSegment(00089427-5063-4156-b8c3-e09f3fd9ab49),segment_id=00089427-5063-4156-b8c3-e09f3fd9ab49)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:43.771072 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0de2423e-40e3-4b8c-948f-8232d626e594 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:43.806188 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '338d76a7-f43b-4adb-b0a7-9d17e1367513', 'name': 'tempest-TestEncryptedCinderVolumes-1814699298-router', 'tenant_id': 'fe6fc091d42140bf80daf7c889de205d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.113'}], 'enable_snat': True}, 'gw_port_id': '82ddfea0-1142-4558-85d2-db322e9f25cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:18:41Z', 'updated_at': '2021-12-09T22:18:42Z', 'revision_number': 3, 'project_id': 'fe6fc091d42140bf80daf7c889de205d', 'gw_port': {'id': '82ddfea0-1142-4558-85d2-db322e9f25cf', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:06:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '338d76a7-f43b-4adb-b0a7-9d17e1367513', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4146, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:18:42Z', 'updated_at': '2021-12-09T22:18:42Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:43.836382 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-356d1c79-c1bb-4665-851c-62e480bfbf40 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:44.016719 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-356d1c79-c1bb-4665-851c-62e480bfbf40 admin admin] Allocated IP 172.20.0.1 (f26b9f47-9dd3-4ccc-8f56-670f8249a431/2514586e-123f-4e2a-91a9-d8f14bd6e8d4/a181fcf9-4253-4c4f-8db7-450a384fdaa0) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:18:44.025542 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] Checking router: 338d76a7-f43b-4adb-b0a7-9d17e1367513 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:18:44.025898 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] Updating router 338d76a7-f43b-4adb-b0a7-9d17e1367513 port 82ddfea0-1142-4558-85d2-db322e9f25cf binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:18:44.052703 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0de2423e-40e3-4b8c-948f-8232d626e594 None None] Pushing event updated for resources: {'Port': ['ID=d9478d61-9b43-4595-b182-b3ff840eb518,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:44.062871 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7d1a949e-f5d3-46eb-bd8b-c8f46c19c966 None None] Provisioning complete for port d9478d61-9b43-4595-b182-b3ff840eb518 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:44.063250 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7d1a949e-f5d3-46eb-bd8b-c8f46c19c966 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:44.064724 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:44.144965 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-356d1c79-c1bb-4665-851c-62e480bfbf40 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:44.182210 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d9478d61-9b43-4595-b182-b3ff840eb518 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:18:44.189322 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-356d1c79-c1bb-4665-851c-62e480bfbf40 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:44.229368 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-356d1c79-c1bb-4665-851c-62e480bfbf40 admin admin] Network f26b9f47-9dd3-4ccc-8f56-670f8249a431 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:18:44.235062 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-356d1c79-c1bb-4665-851c-62e480bfbf40 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:18:44.239570 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-356d1c79-c1bb-4665-851c-62e480bfbf40 admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:18:44.243098 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-356d1c79-c1bb-4665-851c-62e480bfbf40 admin admin] Pushing event updated for resources: {'Port': ['ID=a181fcf9-4253-4c4f-8db7-450a384fdaa0,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:44.284859 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-356d1c79-c1bb-4665-851c-62e480bfbf40 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:44.349616 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port d9478d61-9b43-4595-b182-b3ff840eb518 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:44.349999 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:44.444551 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-356d1c79-c1bb-4665-851c-62e480bfbf40 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:44.510253 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:44.526965 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:44.581307 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90a0e4ec-f65b-4fdb-9675-7ece854e913d None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:18:44.588106 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2c6b21b3-6004-47bf-b751-01435c997008 None None] Provisioning complete for port a181fcf9-4253-4c4f-8db7-450a384fdaa0 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:44.588485 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2c6b21b3-6004-47bf-b751-01435c997008 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:44.614880 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] Attempting to bind port 82ddfea0-1142-4558-85d2-db322e9f25cf on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:18:44.615245 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] Attempting to bind port 82ddfea0-1142-4558-85d2-db322e9f25cf by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:18:44.615638 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] Attempting to bind port 82ddfea0-1142-4558-85d2-db322e9f25cf on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:18:44.626443 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a406daf8-5766-48e4-a5f5-ac3366e8b330 None None] Pushing event updated for resources: {'Port': ['ID=82ddfea0-1142-4558-85d2-db322e9f25cf,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:44.633121 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 18, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:18:44.633508 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:18:44.633922 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:44.634322 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:18:44.634815 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] Bound port: 82ddfea0-1142-4558-85d2-db322e9f25cf, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:18:44.635247 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:44.636772 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-356d1c79-c1bb-4665-851c-62e480bfbf40 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:44.643328 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-356d1c79-c1bb-4665-851c-62e480bfbf40 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:44.665665 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-2c6b21b3-6004-47bf-b751-01435c997008 None None] Port a181fcf9-4253-4c4f-8db7-450a384fdaa0 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:18:44.696824 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] For port 82ddfea0-1142-4558-85d2-db322e9f25cf, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:18:44.700378 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] For port 82ddfea0-1142-4558-85d2-db322e9f25cf, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=82ddfea0-1142-4558-85d2-db322e9f25cf,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:18:44.705816 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:44.745526 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-356d1c79-c1bb-4665-851c-62e480bfbf40 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:44.753553 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-356d1c79-c1bb-4665-851c-62e480bfbf40 admin admin] Pushing event updated for resources: {'Port': ['ID=a181fcf9-4253-4c4f-8db7-450a384fdaa0,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:44.757775 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c211cbd8-59b8-496a-ab7e-2254d783d8c0 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:18:44.782706 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a406daf8-5766-48e4-a5f5-ac3366e8b330 None None] Pushing event updated for resources: {'Port': ['ID=82ddfea0-1142-4558-85d2-db322e9f25cf,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:44.786192 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] Routers {'338d76a7-f43b-4adb-b0a7-9d17e1367513'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:18:44.787335 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:18:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['338d76a7-f43b-4adb-b0a7-9d17e1367513'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:44.834417 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-97a0d70d-2a8a-4fd8-b72f-ea65b3be1569 None None] Provisioning complete for port 82ddfea0-1142-4558-85d2-db322e9f25cf triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:44.834805 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-97a0d70d-2a8a-4fd8-b72f-ea65b3be1569 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:44.849358 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-356d1c79-c1bb-4665-851c-62e480bfbf40 admin admin] Network f26b9f47-9dd3-4ccc-8f56-670f8249a431 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:18:44.851337 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-356d1c79-c1bb-4665-851c-62e480bfbf40 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:18:44.930356 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] Set router 338d76a7-f43b-4adb-b0a7-9d17e1367513 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:18:45.063956 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-97a0d70d-2a8a-4fd8-b72f-ea65b3be1569 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:45.128817 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-97a0d70d-2a8a-4fd8-b72f-ea65b3be1569 None None] For port 82ddfea0-1142-4558-85d2-db322e9f25cf, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=82ddfea0-1142-4558-85d2-db322e9f25cf,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:45.135932 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-97a0d70d-2a8a-4fd8-b72f-ea65b3be1569 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:45.219836 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97a0d70d-2a8a-4fd8-b72f-ea65b3be1569 None None] Pushing event updated for resources: {'Port': ['ID=82ddfea0-1142-4558-85d2-db322e9f25cf,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:45.254795 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '338d76a7-f43b-4adb-b0a7-9d17e1367513', 'name': 'tempest-TestEncryptedCinderVolumes-1814699298-router', 'tenant_id': 'fe6fc091d42140bf80daf7c889de205d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.113'}], 'enable_snat': True}, 'gw_port_id': '82ddfea0-1142-4558-85d2-db322e9f25cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:18:41Z', 'updated_at': '2021-12-09T22:18:44Z', 'revision_number': 4, 'project_id': 'fe6fc091d42140bf80daf7c889de205d', 'gw_port': {'id': '82ddfea0-1142-4558-85d2-db322e9f25cf', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:06:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '338d76a7-f43b-4adb-b0a7-9d17e1367513', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4146, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:18:42Z', 'updated_at': '2021-12-09T22:18:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'a181fcf9-4253-4c4f-8db7-450a384fdaa0', 'name': '', 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431', 'tenant_id': 'fe6fc091d42140bf80daf7c889de205d', 'mac_address': 'fa:16:3e:98:8e:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '338d76a7-f43b-4adb-b0a7-9d17e1367513', 'device_owner': 'network:router_interface', 'standard_attr_id': 4147, 'fixed_ips': [{'subnet_id': '2514586e-123f-4e2a-91a9-d8f14bd6e8d4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:18:43Z', 'updated_at': '2021-12-09T22:18:44Z', 'revision_number': 2, 'project_id': 'fe6fc091d42140bf80daf7c889de205d', 'subnets': [{'id': '2514586e-123f-4e2a-91a9-d8f14bd6e8d4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:45.286495 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df13e945-1a56-4718-b6d8-cce611261cf7 None None] The sync data for ids ['338d76a7-f43b-4adb-b0a7-9d17e1367513'] in n-d-713301-27 is: [{'id': '338d76a7-f43b-4adb-b0a7-9d17e1367513', 'name': 'tempest-TestEncryptedCinderVolumes-1814699298-router', 'tenant_id': 'fe6fc091d42140bf80daf7c889de205d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.113'}], 'enable_snat': True}, 'gw_port_id': '82ddfea0-1142-4558-85d2-db322e9f25cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:18:41Z', 'updated_at': '2021-12-09T22:18:44Z', 'revision_number': 4, 'project_id': 'fe6fc091d42140bf80daf7c889de205d', 'gw_port': {'id': '82ddfea0-1142-4558-85d2-db322e9f25cf', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:06:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '338d76a7-f43b-4adb-b0a7-9d17e1367513', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4146, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:18:42Z', 'updated_at': '2021-12-09T22:18:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'a181fcf9-4253-4c4f-8db7-450a384fdaa0', 'name': '', 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431', 'tenant_id': 'fe6fc091d42140bf80daf7c889de205d', 'mac_address': 'fa:16:3e:98:8e:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '338d76a7-f43b-4adb-b0a7-9d17e1367513', 'device_owner': 'network:router_interface', 'standard_attr_id': 4147, 'fixed_ips': [{'subnet_id': '2514586e-123f-4e2a-91a9-d8f14bd6e8d4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:18:43Z', 'updated_at': '2021-12-09T22:18:44Z', 'revision_number': 2, 'project_id': 'fe6fc091d42140bf80daf7c889de205d', 'subnets': [{'id': '2514586e-123f-4e2a-91a9-d8f14bd6e8d4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:18:45.293768 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9a4d88f3-b64b-4975-8df7-34811e25d9cc None None] Provisioning complete for port a181fcf9-4253-4c4f-8db7-450a384fdaa0 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:45.294159 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9a4d88f3-b64b-4975-8df7-34811e25d9cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:45.314866 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-356d1c79-c1bb-4665-851c-62e480bfbf40 admin admin] Router 338d76a7-f43b-4adb-b0a7-9d17e1367513 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:18:45.336694 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9a4d88f3-b64b-4975-8df7-34811e25d9cc None None] Port a181fcf9-4253-4c4f-8db7-450a384fdaa0 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:18:45.352224 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9a4d88f3-b64b-4975-8df7-34811e25d9cc None None] Provisioning complete for port 82ddfea0-1142-4558-85d2-db322e9f25cf triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:45.352593 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9a4d88f3-b64b-4975-8df7-34811e25d9cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:45.431048 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-356d1c79-c1bb-4665-851c-62e480bfbf40 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:18:45.443308 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-356d1c79-c1bb-4665-851c-62e480bfbf40 admin admin] 10.222.0.13 "PUT /v2.0/routers/338d76a7-f43b-4adb-b0a7-9d17e1367513/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1506200 Dec 09 22:18:45.975347 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33068) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:45.982518 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-ddbaf09f-06aa-4083-b3d8-82a206dbad7a admin admin] Request body: {'network': {'name': 'tempest-TestEncryptedCinderVolumes-69255544-network', 'tenant_id': '4d10a76d507b4127af04417b615f1fe1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:46.006641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ddbaf09f-06aa-4083-b3d8-82a206dbad7a admin admin] Made reservation on behalf of 4d10a76d507b4127af04417b615f1fe1 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:18:46.009178 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ddbaf09f-06aa-4083-b3d8-82a206dbad7a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:46.019062 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ddbaf09f-06aa-4083-b3d8-82a206dbad7a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:46.108629 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ddbaf09f-06aa-4083-b3d8-82a206dbad7a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:46.113768 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ddbaf09f-06aa-4083-b3d8-82a206dbad7a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:46.138830 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ddbaf09f-06aa-4083-b3d8-82a206dbad7a admin admin] vlan segment allocate from pool success with {'vlan_id': 103, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 22:18:46.156952 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddbaf09f-06aa-4083-b3d8-82a206dbad7a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cc77703f-acc6-4a1b-8ff2-916dfd96eb9f,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:46.161568 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ddbaf09f-06aa-4083-b3d8-82a206dbad7a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:46.161964 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-ddbaf09f-06aa-4083-b3d8-82a206dbad7a admin admin] Added segment 8b832101-6531-45f1-b542-347ffd458962 of type vlan for network 92b047ee-0ea4-4eb3-9ba4-67718510564e Dec 09 22:18:46.186347 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 82ddfea0-1142-4558-85d2-db322e9f25cf up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:18:46.213721 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ddbaf09f-06aa-4083-b3d8-82a206dbad7a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:46.243800 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 82ddfea0-1142-4558-85d2-db322e9f25cf triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:46.244171 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:46.244298 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ddbaf09f-06aa-4083-b3d8-82a206dbad7a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:46.245392 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ddbaf09f-06aa-4083-b3d8-82a206dbad7a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:46.246973 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ddbaf09f-06aa-4083-b3d8-82a206dbad7a admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:46.284160 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ddbaf09f-06aa-4083-b3d8-82a206dbad7a admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.3049476 Dec 09 22:18:46.284975 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33070) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:46.290809 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-24fcf837-191c-4cbc-a8ca-19b9bf0c42a1 admin admin] Request body: {'subnet': {'network_id': '92b047ee-0ea4-4eb3-9ba4-67718510564e', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestEncryptedCinderVolumes-69255544-subnet', 'tenant_id': '4d10a76d507b4127af04417b615f1fe1', 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:46.316743 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddbaf09f-06aa-4083-b3d8-82a206dbad7a admin admin] Pushing event updated for resources: {'Network': ['ID=92b047ee-0ea4-4eb3-9ba4-67718510564e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:46.319641 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-24fcf837-191c-4cbc-a8ca-19b9bf0c42a1 admin admin] Made reservation on behalf of 4d10a76d507b4127af04417b615f1fe1 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:18:46.322711 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24fcf837-191c-4cbc-a8ca-19b9bf0c42a1 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:46.332983 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 92b047ee-0ea4-4eb3-9ba4-67718510564e details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 22:18:46.511080 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24fcf837-191c-4cbc-a8ca-19b9bf0c42a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:46.568655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24fcf837-191c-4cbc-a8ca-19b9bf0c42a1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=61a415d1-4ccc-466f-97dc-3ec10f093da5,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:46.576912 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-24fcf837-191c-4cbc-a8ca-19b9bf0c42a1 admin admin] Checking segment: {'id': '8b832101-6531-45f1-b542-347ffd458962', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '92b047ee-0ea4-4eb3-9ba4-67718510564e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:18:46.577251 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-24fcf837-191c-4cbc-a8ca-19b9bf0c42a1 admin admin] Network hostable DHCP agents. Network: 92b047ee-0ea4-4eb3-9ba4-67718510564e, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 22:18:46.596340 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-24fcf837-191c-4cbc-a8ca-19b9bf0c42a1 admin admin] Network 92b047ee-0ea4-4eb3-9ba4-67718510564e is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 22:18:46.607561 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-24fcf837-191c-4cbc-a8ca-19b9bf0c42a1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 92b047ee-0ea4-4eb3-9ba4-67718510564e) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:18:46.612646 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-24fcf837-191c-4cbc-a8ca-19b9bf0c42a1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:46.613315 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-24fcf837-191c-4cbc-a8ca-19b9bf0c42a1 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:46.617878 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eff0902b-23ec-41cd-8d4a-064dc29788f7 None None] Network 92b047ee-0ea4-4eb3-9ba4-67718510564e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:18:46.636132 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-24fcf837-191c-4cbc-a8ca-19b9bf0c42a1 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.3499830 Dec 09 22:18:46.638640 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33072) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:46.643267 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-e6320d2e-511c-4013-8d38-57649d7e3257 admin admin] Request body: {'router': {'name': 'tempest-TestEncryptedCinderVolumes-69255544-router', 'tenant_id': '4d10a76d507b4127af04417b615f1fe1', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:46.666255 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e6320d2e-511c-4013-8d38-57649d7e3257 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:46.667340 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e6320d2e-511c-4013-8d38-57649d7e3257 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:46.728846 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e6320d2e-511c-4013-8d38-57649d7e3257 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:46.729027 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-205e67a6-d320-476e-a7a0-72874bd7e0a6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-92b047ee-0ea4-4eb3-9ba4-67718510564e', 'network_id': '92b047ee-0ea4-4eb3-9ba4-67718510564e', 'project_id': '4d10a76d507b4127af04417b615f1fe1', 'fixed_ips': [{'subnet_id': '61a415d1-4ccc-466f-97dc-3ec10f093da5'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 22:18:46.729921 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-205e67a6-d320-476e-a7a0-72874bd7e0a6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:46.871232 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-205e67a6-d320-476e-a7a0-72874bd7e0a6 None None] Allocated IP 172.20.0.2 (92b047ee-0ea4-4eb3-9ba4-67718510564e/61a415d1-4ccc-466f-97dc-3ec10f093da5/5c97f1ad-ec73-41c5-93c0-2b8b173b6f26) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:18:46.873678 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e6320d2e-511c-4013-8d38-57649d7e3257 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:47.019806 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-205e67a6-d320-476e-a7a0-72874bd7e0a6 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:47.027909 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-205e67a6-d320-476e-a7a0-72874bd7e0a6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:47.071071 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-205e67a6-d320-476e-a7a0-72874bd7e0a6 None None] Network 92b047ee-0ea4-4eb3-9ba4-67718510564e is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:18:47.074415 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-205e67a6-d320-476e-a7a0-72874bd7e0a6 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:18:47.080597 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-205e67a6-d320-476e-a7a0-72874bd7e0a6 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:18:47.081767 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e6320d2e-511c-4013-8d38-57649d7e3257 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:47.101330 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e6320d2e-511c-4013-8d38-57649d7e3257 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:47.107635 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-205e67a6-d320-476e-a7a0-72874bd7e0a6 None None] Pushing event updated for resources: {'Port': ['ID=5c97f1ad-ec73-41c5-93c0-2b8b173b6f26,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:47.142920 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-205e67a6-d320-476e-a7a0-72874bd7e0a6 None None] Attempting to bind port 5c97f1ad-ec73-41c5-93c0-2b8b173b6f26 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:18:47.143284 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-205e67a6-d320-476e-a7a0-72874bd7e0a6 None None] Attempting to bind port 5c97f1ad-ec73-41c5-93c0-2b8b173b6f26 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '8b832101-6531-45f1-b542-347ffd458962', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '92b047ee-0ea4-4eb3-9ba4-67718510564e'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:18:47.143680 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-205e67a6-d320-476e-a7a0-72874bd7e0a6 None None] Attempting to bind port 5c97f1ad-ec73-41c5-93c0-2b8b173b6f26 on network 92b047ee-0ea4-4eb3-9ba4-67718510564e {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:18:47.149165 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-205e67a6-d320-476e-a7a0-72874bd7e0a6 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 18, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:18:47.149549 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-205e67a6-d320-476e-a7a0-72874bd7e0a6 None None] Checking segment: {'id': '8b832101-6531-45f1-b542-347ffd458962', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '92b047ee-0ea4-4eb3-9ba4-67718510564e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:18:47.149956 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-205e67a6-d320-476e-a7a0-72874bd7e0a6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:47.150355 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-205e67a6-d320-476e-a7a0-72874bd7e0a6 None None] Bound using segment: {'id': '8b832101-6531-45f1-b542-347ffd458962', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '92b047ee-0ea4-4eb3-9ba4-67718510564e'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:18:47.150828 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-205e67a6-d320-476e-a7a0-72874bd7e0a6 None None] Bound port: 5c97f1ad-ec73-41c5-93c0-2b8b173b6f26, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8b832101-6531-45f1-b542-347ffd458962', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '92b047ee-0ea4-4eb3-9ba4-67718510564e'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:18:47.151205 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-205e67a6-d320-476e-a7a0-72874bd7e0a6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:47.210157 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-e6320d2e-511c-4013-8d38-57649d7e3257 admin admin] Allocated IP 172.25.3.44 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/a70d4b06-1397-437d-a6de-a8fe713c2995) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:18:47.218155 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-205e67a6-d320-476e-a7a0-72874bd7e0a6 None None] For port 5c97f1ad-ec73-41c5-93c0-2b8b173b6f26, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:18:47.221419 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-205e67a6-d320-476e-a7a0-72874bd7e0a6 None None] For port 5c97f1ad-ec73-41c5-93c0-2b8b173b6f26, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5c97f1ad-ec73-41c5-93c0-2b8b173b6f26,segment=NetworkSegment(8b832101-6531-45f1-b542-347ffd458962),segment_id=8b832101-6531-45f1-b542-347ffd458962)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:18:47.227655 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-205e67a6-d320-476e-a7a0-72874bd7e0a6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:47.285800 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-205e67a6-d320-476e-a7a0-72874bd7e0a6 None None] Pushing event updated for resources: {'Port': ['ID=5c97f1ad-ec73-41c5-93c0-2b8b173b6f26,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:47.321079 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e6320d2e-511c-4013-8d38-57649d7e3257 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:47.359177 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e6320d2e-511c-4013-8d38-57649d7e3257 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:47.392292 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] Sync routers for ids ['338d76a7-f43b-4adb-b0a7-9d17e1367513'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:18:47.402143 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] Routers {'338d76a7-f43b-4adb-b0a7-9d17e1367513'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:18:47.402695 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:18:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['338d76a7-f43b-4adb-b0a7-9d17e1367513'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:47.403370 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6320d2e-511c-4013-8d38-57649d7e3257 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:18:47.406410 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-e6320d2e-511c-4013-8d38-57649d7e3257 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:18:47.408747 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6320d2e-511c-4013-8d38-57649d7e3257 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:18:47.425028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7b63b63-b2f1-4367-8dd8-4f5955562722 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:18:47.438783 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6320d2e-511c-4013-8d38-57649d7e3257 admin admin] Pushing event updated for resources: {'Port': ['ID=a70d4b06-1397-437d-a6de-a8fe713c2995,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:47.498530 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-918d096e-73b6-47d6-b0fc-22ece1d99038 None None] Provisioning complete for port a70d4b06-1397-437d-a6de-a8fe713c2995 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:47.498911 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-918d096e-73b6-47d6-b0fc-22ece1d99038 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:47.540828 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] Set router 338d76a7-f43b-4adb-b0a7-9d17e1367513 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:18:47.550029 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-918d096e-73b6-47d6-b0fc-22ece1d99038 None None] Port a70d4b06-1397-437d-a6de-a8fe713c2995 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:18:47.761271 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '338d76a7-f43b-4adb-b0a7-9d17e1367513', 'name': 'tempest-TestEncryptedCinderVolumes-1814699298-router', 'tenant_id': 'fe6fc091d42140bf80daf7c889de205d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.113'}], 'enable_snat': True}, 'gw_port_id': '82ddfea0-1142-4558-85d2-db322e9f25cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:18:41Z', 'updated_at': '2021-12-09T22:18:44Z', 'revision_number': 4, 'project_id': 'fe6fc091d42140bf80daf7c889de205d', 'gw_port': {'id': '82ddfea0-1142-4558-85d2-db322e9f25cf', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:06:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '338d76a7-f43b-4adb-b0a7-9d17e1367513', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4146, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:18:42Z', 'updated_at': '2021-12-09T22:18:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'a181fcf9-4253-4c4f-8db7-450a384fdaa0', 'name': '', 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431', 'tenant_id': 'fe6fc091d42140bf80daf7c889de205d', 'mac_address': 'fa:16:3e:98:8e:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '338d76a7-f43b-4adb-b0a7-9d17e1367513', 'device_owner': 'network:router_interface', 'standard_attr_id': 4147, 'fixed_ips': [{'subnet_id': '2514586e-123f-4e2a-91a9-d8f14bd6e8d4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:18:43Z', 'updated_at': '2021-12-09T22:18:44Z', 'revision_number': 2, 'project_id': 'fe6fc091d42140bf80daf7c889de205d', 'subnets': [{'id': '2514586e-123f-4e2a-91a9-d8f14bd6e8d4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:47.788273 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] Checking router: 338d76a7-f43b-4adb-b0a7-9d17e1367513 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:18:47.788597 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] Updating router 338d76a7-f43b-4adb-b0a7-9d17e1367513 port a181fcf9-4253-4c4f-8db7-450a384fdaa0 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:18:47.820561 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:48.070496 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e6320d2e-511c-4013-8d38-57649d7e3257 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:48.096532 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:48.103465 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:48.153916 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12b17bf9-8164-4216-b352-45487a086015 None None] Pushing event updated for resources: {'Port': ['ID=a181fcf9-4253-4c4f-8db7-450a384fdaa0,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:48.162045 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b17bf9-8164-4216-b352-45487a086015 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:48.162467 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b17bf9-8164-4216-b352-45487a086015 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:48.162933 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b17bf9-8164-4216-b352-45487a086015 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:48.163313 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b17bf9-8164-4216-b352-45487a086015 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:48.163880 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b17bf9-8164-4216-b352-45487a086015 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:48.164268 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b17bf9-8164-4216-b352-45487a086015 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:48.164653 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b17bf9-8164-4216-b352-45487a086015 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:48.165302 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b17bf9-8164-4216-b352-45487a086015 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:48.165430 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b17bf9-8164-4216-b352-45487a086015 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:48.165718 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b17bf9-8164-4216-b352-45487a086015 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:48.166106 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b17bf9-8164-4216-b352-45487a086015 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:48.166501 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b17bf9-8164-4216-b352-45487a086015 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:48.166869 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12b17bf9-8164-4216-b352-45487a086015 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:18:48.207166 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5c97f1ad-ec73-41c5-93c0-2b8b173b6f26 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:18:48.244792 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] Attempting to bind port a181fcf9-4253-4c4f-8db7-450a384fdaa0 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:18:48.245758 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] Attempting to bind port a181fcf9-4253-4c4f-8db7-450a384fdaa0 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '00089427-5063-4156-b8c3-e09f3fd9ab49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:18:48.245758 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] Attempting to bind port a181fcf9-4253-4c4f-8db7-450a384fdaa0 on network f26b9f47-9dd3-4ccc-8f56-670f8249a431 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:18:48.251888 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 18, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:18:48.252259 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] Checking segment: {'id': '00089427-5063-4156-b8c3-e09f3fd9ab49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:18:48.252663 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:48.253230 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] Bound using segment: {'id': '00089427-5063-4156-b8c3-e09f3fd9ab49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:18:48.253503 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] Bound port: a181fcf9-4253-4c4f-8db7-450a384fdaa0, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '00089427-5063-4156-b8c3-e09f3fd9ab49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:18:48.253880 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:48.289093 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 5c97f1ad-ec73-41c5-93c0-2b8b173b6f26 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:48.290096 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:48.346713 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] For port a181fcf9-4253-4c4f-8db7-450a384fdaa0, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:18:48.352450 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] For port a181fcf9-4253-4c4f-8db7-450a384fdaa0, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a181fcf9-4253-4c4f-8db7-450a384fdaa0,segment=NetworkSegment(00089427-5063-4156-b8c3-e09f3fd9ab49),segment_id=00089427-5063-4156-b8c3-e09f3fd9ab49)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:18:48.362184 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:48.389834 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:48.407085 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e6320d2e-511c-4013-8d38-57649d7e3257 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:48.422476 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] Routers {'338d76a7-f43b-4adb-b0a7-9d17e1367513'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:18:48.423123 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:18:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['338d76a7-f43b-4adb-b0a7-9d17e1367513'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:48.446857 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 5c97f1ad-ec73-41c5-93c0-2b8b173b6f26, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5c97f1ad-ec73-41c5-93c0-2b8b173b6f26,segment=NetworkSegment(8b832101-6531-45f1-b542-347ffd458962),segment_id=8b832101-6531-45f1-b542-347ffd458962)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:48.451655 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6aa55725-1fd9-4446-ab60-002ac0797d75 None None] Network 92b047ee-0ea4-4eb3-9ba4-67718510564e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:18:48.456497 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:48.563721 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] Set router 338d76a7-f43b-4adb-b0a7-9d17e1367513 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:18:48.567680 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7e9d55c5-2775-4dac-97b2-d961f6860a54 None None] Provisioning complete for port 5c97f1ad-ec73-41c5-93c0-2b8b173b6f26 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:48.568053 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7e9d55c5-2775-4dac-97b2-d961f6860a54 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:48.593713 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e6320d2e-511c-4013-8d38-57649d7e3257 admin admin] Router 3cd11f5c-66e8-454c-95b6-1677f0b7bcfb is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 22:18:48.724502 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e6320d2e-511c-4013-8d38-57649d7e3257 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:18:48.748119 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e6320d2e-511c-4013-8d38-57649d7e3257 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:48.749542 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e6320d2e-511c-4013-8d38-57649d7e3257 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 2.1098871 Dec 09 22:18:48.752207 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33074) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:18:48.782443 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12b17bf9-8164-4216-b352-45487a086015 None None] Pushing event updated for resources: {'Port': ['ID=a181fcf9-4253-4c4f-8db7-450a384fdaa0,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:48.792149 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] Sync routers for ids ['3cd11f5c-66e8-454c-95b6-1677f0b7bcfb'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:18:48.798887 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=5c97f1ad-ec73-41c5-93c0-2b8b173b6f26,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:48.834760 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] Routers {'3cd11f5c-66e8-454c-95b6-1677f0b7bcfb'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:18:48.835401 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:18:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3cd11f5c-66e8-454c-95b6-1677f0b7bcfb'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:48.840750 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '338d76a7-f43b-4adb-b0a7-9d17e1367513', 'name': 'tempest-TestEncryptedCinderVolumes-1814699298-router', 'tenant_id': 'fe6fc091d42140bf80daf7c889de205d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.113'}], 'enable_snat': True}, 'gw_port_id': '82ddfea0-1142-4558-85d2-db322e9f25cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:18:41Z', 'updated_at': '2021-12-09T22:18:44Z', 'revision_number': 4, 'project_id': 'fe6fc091d42140bf80daf7c889de205d', 'gw_port': {'id': '82ddfea0-1142-4558-85d2-db322e9f25cf', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:06:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '338d76a7-f43b-4adb-b0a7-9d17e1367513', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4146, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:18:42Z', 'updated_at': '2021-12-09T22:18:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'a181fcf9-4253-4c4f-8db7-450a384fdaa0', 'name': '', 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431', 'tenant_id': 'fe6fc091d42140bf80daf7c889de205d', 'mac_address': 'fa:16:3e:98:8e:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '338d76a7-f43b-4adb-b0a7-9d17e1367513', 'device_owner': 'network:router_interface', 'standard_attr_id': 4147, 'fixed_ips': [{'subnet_id': '2514586e-123f-4e2a-91a9-d8f14bd6e8d4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:18:43Z', 'updated_at': '2021-12-09T22:18:48Z', 'revision_number': 4, 'project_id': 'fe6fc091d42140bf80daf7c889de205d', 'subnets': [{'id': '2514586e-123f-4e2a-91a9-d8f14bd6e8d4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:48.870597 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2851562d-1711-4ef6-85c1-4ab5c2ecf629 None None] The sync data for ids ['338d76a7-f43b-4adb-b0a7-9d17e1367513'] in n-d-713301-27 is: [{'id': '338d76a7-f43b-4adb-b0a7-9d17e1367513', 'name': 'tempest-TestEncryptedCinderVolumes-1814699298-router', 'tenant_id': 'fe6fc091d42140bf80daf7c889de205d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.113'}], 'enable_snat': True}, 'gw_port_id': '82ddfea0-1142-4558-85d2-db322e9f25cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:18:41Z', 'updated_at': '2021-12-09T22:18:44Z', 'revision_number': 4, 'project_id': 'fe6fc091d42140bf80daf7c889de205d', 'gw_port': {'id': '82ddfea0-1142-4558-85d2-db322e9f25cf', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:06:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '338d76a7-f43b-4adb-b0a7-9d17e1367513', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4146, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:18:42Z', 'updated_at': '2021-12-09T22:18:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'a181fcf9-4253-4c4f-8db7-450a384fdaa0', 'name': '', 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431', 'tenant_id': 'fe6fc091d42140bf80daf7c889de205d', 'mac_address': 'fa:16:3e:98:8e:ca', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '338d76a7-f43b-4adb-b0a7-9d17e1367513', 'device_owner': 'network:router_interface', 'standard_attr_id': 4147, 'fixed_ips': [{'subnet_id': '2514586e-123f-4e2a-91a9-d8f14bd6e8d4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:18:43Z', 'updated_at': '2021-12-09T22:18:48Z', 'revision_number': 4, 'project_id': 'fe6fc091d42140bf80daf7c889de205d', 'subnets': [{'id': '2514586e-123f-4e2a-91a9-d8f14bd6e8d4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:18:49.006361 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] Set router 3cd11f5c-66e8-454c-95b6-1677f0b7bcfb gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:18:49.196985 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-02590d8d-fcb0-4935-bacf-1a911f17bfed None None] Provisioning complete for port a181fcf9-4253-4c4f-8db7-450a384fdaa0 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:49.197501 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-02590d8d-fcb0-4935-bacf-1a911f17bfed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:49.225818 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ed9374a-4f02-4072-bec5-9e6f1c581a8e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:49.266513 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3cd11f5c-66e8-454c-95b6-1677f0b7bcfb', 'name': 'tempest-TestEncryptedCinderVolumes-69255544-router', 'tenant_id': '4d10a76d507b4127af04417b615f1fe1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44'}], 'enable_snat': True}, 'gw_port_id': 'a70d4b06-1397-437d-a6de-a8fe713c2995', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:18:46Z', 'updated_at': '2021-12-09T22:18:47Z', 'revision_number': 3, 'project_id': '4d10a76d507b4127af04417b615f1fe1', 'gw_port': {'id': 'a70d4b06-1397-437d-a6de-a8fe713c2995', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:26:08', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3cd11f5c-66e8-454c-95b6-1677f0b7bcfb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4158, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:18:47Z', 'updated_at': '2021-12-09T22:18:47Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:49.318211 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] Checking router: 3cd11f5c-66e8-454c-95b6-1677f0b7bcfb for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:18:49.318903 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] Updating router 3cd11f5c-66e8-454c-95b6-1677f0b7bcfb port a70d4b06-1397-437d-a6de-a8fe713c2995 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:18:49.354536 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-02590d8d-fcb0-4935-bacf-1a911f17bfed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:49.356447 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:49.404262 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-7ed9374a-4f02-4072-bec5-9e6f1c581a8e admin admin] Allocated IP 172.20.0.1 (92b047ee-0ea4-4eb3-9ba4-67718510564e/61a415d1-4ccc-466f-97dc-3ec10f093da5/84fcf019-d7fd-4b96-8e12-451d97ecaad2) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:18:49.468131 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-02590d8d-fcb0-4935-bacf-1a911f17bfed None None] For port a181fcf9-4253-4c4f-8db7-450a384fdaa0, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a181fcf9-4253-4c4f-8db7-450a384fdaa0,segment=NetworkSegment(00089427-5063-4156-b8c3-e09f3fd9ab49),segment_id=00089427-5063-4156-b8c3-e09f3fd9ab49)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:49.479932 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-02590d8d-fcb0-4935-bacf-1a911f17bfed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:49.514996 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ed9374a-4f02-4072-bec5-9e6f1c581a8e admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:49.556235 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ed9374a-4f02-4072-bec5-9e6f1c581a8e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:49.577332 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02590d8d-fcb0-4935-bacf-1a911f17bfed None None] Pushing event updated for resources: {'Port': ['ID=a181fcf9-4253-4c4f-8db7-450a384fdaa0,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:49.601758 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7ed9374a-4f02-4072-bec5-9e6f1c581a8e admin admin] Network 92b047ee-0ea4-4eb3-9ba4-67718510564e is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:18:49.609069 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-7ed9374a-4f02-4072-bec5-9e6f1c581a8e admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:18:49.614206 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ed9374a-4f02-4072-bec5-9e6f1c581a8e admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:18:49.617298 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ed9374a-4f02-4072-bec5-9e6f1c581a8e admin admin] Pushing event updated for resources: {'Port': ['ID=84fcf019-d7fd-4b96-8e12-451d97ecaad2,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:49.638810 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-cab992fa-cd22-4ad9-83cd-1714c28b5228 None None] Provisioning complete for port 5c97f1ad-ec73-41c5-93c0-2b8b173b6f26 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:49.639188 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cab992fa-cd22-4ad9-83cd-1714c28b5228 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:49.659296 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ed9374a-4f02-4072-bec5-9e6f1c581a8e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:49.734766 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:49.759247 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:49.797697 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ed9374a-4f02-4072-bec5-9e6f1c581a8e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:49.824955 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a04ad2af-59a3-4d5d-a015-e56ff3586c60 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:18:49.836978 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db0a86bd-5047-4dfa-a55e-c8c26a0eecdb None None] Pushing event updated for resources: {'Port': ['ID=a70d4b06-1397-437d-a6de-a8fe713c2995,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:49.840959 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] Attempting to bind port a70d4b06-1397-437d-a6de-a8fe713c2995 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:18:49.841335 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] Attempting to bind port a70d4b06-1397-437d-a6de-a8fe713c2995 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:18:49.841704 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] Attempting to bind port a70d4b06-1397-437d-a6de-a8fe713c2995 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:18:49.847600 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 18, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:18:49.847978 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:18:49.848464 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:49.848755 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:18:49.849224 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] Bound port: a70d4b06-1397-437d-a6de-a8fe713c2995, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:18:49.849612 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:49.901273 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] For port a70d4b06-1397-437d-a6de-a8fe713c2995, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:18:49.904919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] For port a70d4b06-1397-437d-a6de-a8fe713c2995, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a70d4b06-1397-437d-a6de-a8fe713c2995,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:18:49.908957 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:49.952411 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7546f56c-c915-48ea-afb3-105dde293748 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:18:49.973604 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ed9374a-4f02-4072-bec5-9e6f1c581a8e admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:49.979114 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ed9374a-4f02-4072-bec5-9e6f1c581a8e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:49.982053 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] Routers {'3cd11f5c-66e8-454c-95b6-1677f0b7bcfb'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:18:49.982701 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:18:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3cd11f5c-66e8-454c-95b6-1677f0b7bcfb'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:50.027638 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db0a86bd-5047-4dfa-a55e-c8c26a0eecdb None None] Pushing event updated for resources: {'Port': ['ID=a70d4b06-1397-437d-a6de-a8fe713c2995,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:50.032012 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9c8bb179-0c64-409e-9489-597a845c4206 None None] Provisioning complete for port 84fcf019-d7fd-4b96-8e12-451d97ecaad2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:50.032377 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9c8bb179-0c64-409e-9489-597a845c4206 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:50.054127 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ed9374a-4f02-4072-bec5-9e6f1c581a8e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:50.056303 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ed9374a-4f02-4072-bec5-9e6f1c581a8e admin admin] Pushing event updated for resources: {'Port': ['ID=84fcf019-d7fd-4b96-8e12-451d97ecaad2,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:50.106317 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9c8bb179-0c64-409e-9489-597a845c4206 None None] Port 84fcf019-d7fd-4b96-8e12-451d97ecaad2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:18:50.136991 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] Set router 3cd11f5c-66e8-454c-95b6-1677f0b7bcfb gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:18:50.158562 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7ed9374a-4f02-4072-bec5-9e6f1c581a8e admin admin] Network 92b047ee-0ea4-4eb3-9ba4-67718510564e is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:18:50.160389 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-7ed9374a-4f02-4072-bec5-9e6f1c581a8e admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:18:50.164528 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9c8bb179-0c64-409e-9489-597a845c4206 None None] Provisioning complete for port a70d4b06-1397-437d-a6de-a8fe713c2995 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:50.165148 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9c8bb179-0c64-409e-9489-597a845c4206 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:50.191355 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a181fcf9-4253-4c4f-8db7-450a384fdaa0 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:18:50.296886 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7ed9374a-4f02-4072-bec5-9e6f1c581a8e admin admin] Router 3cd11f5c-66e8-454c-95b6-1677f0b7bcfb has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:18:50.412078 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7ed9374a-4f02-4072-bec5-9e6f1c581a8e admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:18:50.412493 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port a181fcf9-4253-4c4f-8db7-450a384fdaa0 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:50.413017 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:50.417819 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9c8bb179-0c64-409e-9489-597a845c4206 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:50.424533 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7ed9374a-4f02-4072-bec5-9e6f1c581a8e admin admin] 10.222.0.13 "PUT /v2.0/routers/3cd11f5c-66e8-454c-95b6-1677f0b7bcfb/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6651697 Dec 09 22:18:50.491019 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-9c8bb179-0c64-409e-9489-597a845c4206 None None] For port a70d4b06-1397-437d-a6de-a8fe713c2995, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a70d4b06-1397-437d-a6de-a8fe713c2995,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:50.498171 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9c8bb179-0c64-409e-9489-597a845c4206 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:50.765649 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c8bb179-0c64-409e-9489-597a845c4206 None None] Pushing event updated for resources: {'Port': ['ID=a70d4b06-1397-437d-a6de-a8fe713c2995,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:50.777922 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3cd11f5c-66e8-454c-95b6-1677f0b7bcfb', 'name': 'tempest-TestEncryptedCinderVolumes-69255544-router', 'tenant_id': '4d10a76d507b4127af04417b615f1fe1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44'}], 'enable_snat': True}, 'gw_port_id': 'a70d4b06-1397-437d-a6de-a8fe713c2995', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:18:46Z', 'updated_at': '2021-12-09T22:18:49Z', 'revision_number': 4, 'project_id': '4d10a76d507b4127af04417b615f1fe1', 'gw_port': {'id': 'a70d4b06-1397-437d-a6de-a8fe713c2995', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:26:08', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3cd11f5c-66e8-454c-95b6-1677f0b7bcfb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4158, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:18:47Z', 'updated_at': '2021-12-09T22:18:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '84fcf019-d7fd-4b96-8e12-451d97ecaad2', 'name': '', 'network_id': '92b047ee-0ea4-4eb3-9ba4-67718510564e', 'tenant_id': '4d10a76d507b4127af04417b615f1fe1', 'mac_address': 'fa:16:3e:8f:b4:cf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3cd11f5c-66e8-454c-95b6-1677f0b7bcfb', 'device_owner': 'network:router_interface', 'standard_attr_id': 4159, 'fixed_ips': [{'subnet_id': '61a415d1-4ccc-466f-97dc-3ec10f093da5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:18:49Z', 'updated_at': '2021-12-09T22:18:49Z', 'revision_number': 2, 'project_id': '4d10a76d507b4127af04417b615f1fe1', 'subnets': [{'id': '61a415d1-4ccc-466f-97dc-3ec10f093da5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:50.813314 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5c97f1ad-ec73-41c5-93c0-2b8b173b6f26 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:18:50.816042 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5a99404d-16ac-4ef6-8744-1941c1c44812 None None] The sync data for ids ['3cd11f5c-66e8-454c-95b6-1677f0b7bcfb'] in n-d-713301-27 is: [{'id': '3cd11f5c-66e8-454c-95b6-1677f0b7bcfb', 'name': 'tempest-TestEncryptedCinderVolumes-69255544-router', 'tenant_id': '4d10a76d507b4127af04417b615f1fe1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44'}], 'enable_snat': True}, 'gw_port_id': 'a70d4b06-1397-437d-a6de-a8fe713c2995', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:18:46Z', 'updated_at': '2021-12-09T22:18:49Z', 'revision_number': 4, 'project_id': '4d10a76d507b4127af04417b615f1fe1', 'gw_port': {'id': 'a70d4b06-1397-437d-a6de-a8fe713c2995', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:26:08', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3cd11f5c-66e8-454c-95b6-1677f0b7bcfb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4158, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:18:47Z', 'updated_at': '2021-12-09T22:18:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '84fcf019-d7fd-4b96-8e12-451d97ecaad2', 'name': '', 'network_id': '92b047ee-0ea4-4eb3-9ba4-67718510564e', 'tenant_id': '4d10a76d507b4127af04417b615f1fe1', 'mac_address': 'fa:16:3e:8f:b4:cf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3cd11f5c-66e8-454c-95b6-1677f0b7bcfb', 'device_owner': 'network:router_interface', 'standard_attr_id': 4159, 'fixed_ips': [{'subnet_id': '61a415d1-4ccc-466f-97dc-3ec10f093da5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:18:49Z', 'updated_at': '2021-12-09T22:18:49Z', 'revision_number': 2, 'project_id': '4d10a76d507b4127af04417b615f1fe1', 'subnets': [{'id': '61a415d1-4ccc-466f-97dc-3ec10f093da5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:18:50.837573 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-cc109bdb-5a59-4796-b027-c8bdbdebbc35 None None] Provisioning complete for port 84fcf019-d7fd-4b96-8e12-451d97ecaad2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:50.837952 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cc109bdb-5a59-4796-b027-c8bdbdebbc35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:50.891907 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-cc109bdb-5a59-4796-b027-c8bdbdebbc35 None None] Port 84fcf019-d7fd-4b96-8e12-451d97ecaad2 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:18:50.910193 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-cc109bdb-5a59-4796-b027-c8bdbdebbc35 None None] Provisioning complete for port a70d4b06-1397-437d-a6de-a8fe713c2995 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:50.910567 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cc109bdb-5a59-4796-b027-c8bdbdebbc35 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:50.937294 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 5c97f1ad-ec73-41c5-93c0-2b8b173b6f26 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:50.937672 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:51.125793 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-6fc41aa7-7c1d-4be8-bff9-c6b99edbea41 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:51.128481 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-6fc41aa7-7c1d-4be8-bff9-c6b99edbea41 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/networks?id=f26b9f47-9dd3-4ccc-8f56-670f8249a431 HTTP/1.1" status: 200 len: 817 time: 0.1418803 Dec 09 22:18:51.144031 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-11b9607e-3f82-40fe-924c-69f46ee09a8d tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/quotas/fe6fc091d42140bf80daf7c889de205d HTTP/1.1" status: 200 len: 375 time: 0.0096381 Dec 09 22:18:51.197737 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-b6906aba-255b-40cc-83f8-b356fd0727c7 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=fe6fc091d42140bf80daf7c889de205d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0476785 Dec 09 22:18:51.298967 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-1cf4f396-2e08-47ed-86a2-802bbb54dc11 service neutron] 10.222.0.13 "GET /v2.0/networks/f26b9f47-9dd3-4ccc-8f56-670f8249a431?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0879405 Dec 09 22:18:51.397715 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-7b3983b2-165b-45cd-a8fd-1b6169aa639d service neutron] 10.222.0.13 "GET /v2.0/networks/f26b9f47-9dd3-4ccc-8f56-670f8249a431?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0924177 Dec 09 22:18:51.581947 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ff5dd33d-7c47-41c5-b22d-6fcaacc929a0 req-69e17bf5-a56b-4e26-a589-f43385a2d08f tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=c2751a42-2b08-4d38-8489-06d52cd0c856 HTTP/1.1" status: 200 len: 210 time: 0.0344186 Dec 09 22:18:52.180954 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a70d4b06-1397-437d-a6de-a8fe713c2995 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:18:52.232099 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port a70d4b06-1397-437d-a6de-a8fe713c2995 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:52.232474 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:52.597595 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-cb8c2d36-3478-417a-b4ef-ce03d19c7508 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:52.599135 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-cb8c2d36-3478-417a-b4ef-ce03d19c7508 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.10 "GET /v2.0/networks?id=f26b9f47-9dd3-4ccc-8f56-670f8249a431 HTTP/1.1" status: 200 len: 817 time: 0.1169248 Dec 09 22:18:52.612955 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-f1875e0b-25d0-4ef0-92ed-804be2f5414e tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Request body: {'port': {'device_id': 'c2751a42-2b08-4d38-8489-06d52cd0c856', 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431', 'admin_state_up': True, 'tenant_id': 'fe6fc091d42140bf80daf7c889de205d'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:52.718822 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8275cc20-a1f6-4bd4-afd2-34572926e267 req-9522d688-9022-4975-be95-4c69bb685a03 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=c2751a42-2b08-4d38-8489-06d52cd0c856 HTTP/1.1" status: 200 len: 210 time: 0.0402851 Dec 09 22:18:52.759817 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-f1875e0b-25d0-4ef0-92ed-804be2f5414e tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Made reservation on behalf of fe6fc091d42140bf80daf7c889de205d for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:18:52.763491 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-f1875e0b-25d0-4ef0-92ed-804be2f5414e tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:52.905471 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-f1875e0b-25d0-4ef0-92ed-804be2f5414e tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Allocated IP 172.20.0.9 (f26b9f47-9dd3-4ccc-8f56-670f8249a431/2514586e-123f-4e2a-91a9-d8f14bd6e8d4/923e8788-a027-4fdf-baa3-80ad65f0f6f7) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:18:52.927409 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] Sync routers for ids ['3cd11f5c-66e8-454c-95b6-1677f0b7bcfb'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:18:52.938469 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] Routers {'3cd11f5c-66e8-454c-95b6-1677f0b7bcfb'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:18:52.939083 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:18:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3cd11f5c-66e8-454c-95b6-1677f0b7bcfb'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:53.044468 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] Set router 3cd11f5c-66e8-454c-95b6-1677f0b7bcfb gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:18:53.063589 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-f1875e0b-25d0-4ef0-92ed-804be2f5414e tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:53.100220 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-f1875e0b-25d0-4ef0-92ed-804be2f5414e tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:53.142795 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-f1875e0b-25d0-4ef0-92ed-804be2f5414e tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Network f26b9f47-9dd3-4ccc-8f56-670f8249a431 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:18:53.146136 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-f1875e0b-25d0-4ef0-92ed-804be2f5414e tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:18:53.150103 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-f1875e0b-25d0-4ef0-92ed-804be2f5414e tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:18:53.181367 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1875e0b-25d0-4ef0-92ed-804be2f5414e tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Pushing event updated for resources: {'Port': ['ID=923e8788-a027-4fdf-baa3-80ad65f0f6f7,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:53.208004 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-f1875e0b-25d0-4ef0-92ed-804be2f5414e tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:53.208650 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-f1875e0b-25d0-4ef0-92ed-804be2f5414e tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:53.232207 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-f1875e0b-25d0-4ef0-92ed-804be2f5414e tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6228168 Dec 09 22:18:53.244790 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-746c7a40-2dd7-4c27-8771-1c022c89e143 service neutron] Request body: {'port': {'device_id': 'c2751a42-2b08-4d38-8489-06d52cd0c856', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:18:53.307851 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-746c7a40-2dd7-4c27-8771-1c022c89e143 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:53.371313 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3cd11f5c-66e8-454c-95b6-1677f0b7bcfb', 'name': 'tempest-TestEncryptedCinderVolumes-69255544-router', 'tenant_id': '4d10a76d507b4127af04417b615f1fe1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44'}], 'enable_snat': True}, 'gw_port_id': 'a70d4b06-1397-437d-a6de-a8fe713c2995', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:18:46Z', 'updated_at': '2021-12-09T22:18:49Z', 'revision_number': 4, 'project_id': '4d10a76d507b4127af04417b615f1fe1', 'gw_port': {'id': 'a70d4b06-1397-437d-a6de-a8fe713c2995', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:26:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3cd11f5c-66e8-454c-95b6-1677f0b7bcfb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4158, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:18:47Z', 'updated_at': '2021-12-09T22:18:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '84fcf019-d7fd-4b96-8e12-451d97ecaad2', 'name': '', 'network_id': '92b047ee-0ea4-4eb3-9ba4-67718510564e', 'tenant_id': '4d10a76d507b4127af04417b615f1fe1', 'mac_address': 'fa:16:3e:8f:b4:cf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3cd11f5c-66e8-454c-95b6-1677f0b7bcfb', 'device_owner': 'network:router_interface', 'standard_attr_id': 4159, 'fixed_ips': [{'subnet_id': '61a415d1-4ccc-466f-97dc-3ec10f093da5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:18:49Z', 'updated_at': '2021-12-09T22:18:49Z', 'revision_number': 2, 'project_id': '4d10a76d507b4127af04417b615f1fe1', 'subnets': [{'id': '61a415d1-4ccc-466f-97dc-3ec10f093da5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:53.397628 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] Checking router: 3cd11f5c-66e8-454c-95b6-1677f0b7bcfb for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:18:53.398263 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] Updating router 3cd11f5c-66e8-454c-95b6-1677f0b7bcfb port 84fcf019-d7fd-4b96-8e12-451d97ecaad2 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:18:53.403882 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-63cd99d1-d54f-4212-b45c-c6a0c1efd93c None None] Provisioning complete for port 923e8788-a027-4fdf-baa3-80ad65f0f6f7 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:53.404407 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-63cd99d1-d54f-4212-b45c-c6a0c1efd93c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:53.423878 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:53.438394 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-63cd99d1-d54f-4212-b45c-c6a0c1efd93c None None] Port 923e8788-a027-4fdf-baa3-80ad65f0f6f7 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:18:53.587224 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-746c7a40-2dd7-4c27-8771-1c022c89e143 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 923e8788-a027-4fdf-baa3-80ad65f0f6f7 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:18:53.594911 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-746c7a40-2dd7-4c27-8771-1c022c89e143 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:53.609322 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-746c7a40-2dd7-4c27-8771-1c022c89e143 service neutron] Transition to ACTIVE for port object 923e8788-a027-4fdf-baa3-80ad65f0f6f7 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:18:53.615245 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-746c7a40-2dd7-4c27-8771-1c022c89e143 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:53.688100 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-746c7a40-2dd7-4c27-8771-1c022c89e143 service neutron] Pushing event updated for resources: {'Port': ['ID=923e8788-a027-4fdf-baa3-80ad65f0f6f7,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:53.688904 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:53.699156 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:53.738130 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-746c7a40-2dd7-4c27-8771-1c022c89e143 service neutron] Attempting to bind port 923e8788-a027-4fdf-baa3-80ad65f0f6f7 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:18:53.738469 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-746c7a40-2dd7-4c27-8771-1c022c89e143 service neutron] Attempting to bind port 923e8788-a027-4fdf-baa3-80ad65f0f6f7 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '00089427-5063-4156-b8c3-e09f3fd9ab49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:18:53.738799 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-746c7a40-2dd7-4c27-8771-1c022c89e143 service neutron] Attempting to bind port 923e8788-a027-4fdf-baa3-80ad65f0f6f7 on network f26b9f47-9dd3-4ccc-8f56-670f8249a431 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:18:53.744198 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-746c7a40-2dd7-4c27-8771-1c022c89e143 service neutron] Port 923e8788-a027-4fdf-baa3-80ad65f0f6f7 on network f26b9f47-9dd3-4ccc-8f56-670f8249a431 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:18:53.744556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-746c7a40-2dd7-4c27-8771-1c022c89e143 service neutron] Attempting to bind port 923e8788-a027-4fdf-baa3-80ad65f0f6f7 on network f26b9f47-9dd3-4ccc-8f56-670f8249a431 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:18:53.750313 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-746c7a40-2dd7-4c27-8771-1c022c89e143 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 18, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:18:53.750652 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-746c7a40-2dd7-4c27-8771-1c022c89e143 service neutron] Checking segment: {'id': '00089427-5063-4156-b8c3-e09f3fd9ab49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:18:53.751055 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-746c7a40-2dd7-4c27-8771-1c022c89e143 service neutron] Bound using segment: {'id': '00089427-5063-4156-b8c3-e09f3fd9ab49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:18:53.751531 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-746c7a40-2dd7-4c27-8771-1c022c89e143 service neutron] Bound port: 923e8788-a027-4fdf-baa3-80ad65f0f6f7, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '00089427-5063-4156-b8c3-e09f3fd9ab49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:18:53.751873 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-746c7a40-2dd7-4c27-8771-1c022c89e143 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:53.787833 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfe27397-664f-4ecb-a7d6-942c38eaabd6 None None] Pushing event updated for resources: {'Port': ['ID=84fcf019-d7fd-4b96-8e12-451d97ecaad2,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:53.832382 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] Attempting to bind port 84fcf019-d7fd-4b96-8e12-451d97ecaad2 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:18:53.833033 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] Attempting to bind port 84fcf019-d7fd-4b96-8e12-451d97ecaad2 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '8b832101-6531-45f1-b542-347ffd458962', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '92b047ee-0ea4-4eb3-9ba4-67718510564e'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:18:53.833550 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] Attempting to bind port 84fcf019-d7fd-4b96-8e12-451d97ecaad2 on network 92b047ee-0ea4-4eb3-9ba4-67718510564e {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:18:53.839524 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 18, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:18:53.840193 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] Checking segment: {'id': '8b832101-6531-45f1-b542-347ffd458962', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '92b047ee-0ea4-4eb3-9ba4-67718510564e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:18:53.840748 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:53.841291 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] Bound using segment: {'id': '8b832101-6531-45f1-b542-347ffd458962', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '92b047ee-0ea4-4eb3-9ba4-67718510564e'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:18:53.842434 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] Bound port: 84fcf019-d7fd-4b96-8e12-451d97ecaad2, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8b832101-6531-45f1-b542-347ffd458962', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 103, 'network_id': '92b047ee-0ea4-4eb3-9ba4-67718510564e'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:18:53.842825 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:53.877821 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-746c7a40-2dd7-4c27-8771-1c022c89e143 service neutron] For port 923e8788-a027-4fdf-baa3-80ad65f0f6f7, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:18:53.894479 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-746c7a40-2dd7-4c27-8771-1c022c89e143 service neutron] For port 923e8788-a027-4fdf-baa3-80ad65f0f6f7, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=923e8788-a027-4fdf-baa3-80ad65f0f6f7,segment=NetworkSegment(00089427-5063-4156-b8c3-e09f3fd9ab49),segment_id=00089427-5063-4156-b8c3-e09f3fd9ab49)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:18:53.912415 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-921c3807-a006-4c0f-8e5e-2daa2141da16 req-afc77eaa-e51e-4c9d-a219-751e7036126b tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:53.914450 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-921c3807-a006-4c0f-8e5e-2daa2141da16 req-afc77eaa-e51e-4c9d-a219-751e7036126b tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=c2751a42-2b08-4d38-8489-06d52cd0c856 HTTP/1.1" status: 200 len: 943 time: 0.0868256 Dec 09 22:18:53.918531 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-746c7a40-2dd7-4c27-8771-1c022c89e143 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:53.921788 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] For port 84fcf019-d7fd-4b96-8e12-451d97ecaad2, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:18:53.925290 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] For port 84fcf019-d7fd-4b96-8e12-451d97ecaad2, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=84fcf019-d7fd-4b96-8e12-451d97ecaad2,segment=NetworkSegment(8b832101-6531-45f1-b542-347ffd458962),segment_id=8b832101-6531-45f1-b542-347ffd458962)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:18:53.932048 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:53.988766 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] Routers {'3cd11f5c-66e8-454c-95b6-1677f0b7bcfb'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:18:53.989518 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:18:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3cd11f5c-66e8-454c-95b6-1677f0b7bcfb'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:53.995903 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-746c7a40-2dd7-4c27-8771-1c022c89e143 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:53.996538 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-746c7a40-2dd7-4c27-8771-1c022c89e143 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:53.998335 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-746c7a40-2dd7-4c27-8771-1c022c89e143 service neutron] 10.222.0.10 "PUT /v2.0/ports/923e8788-a027-4fdf-baa3-80ad65f0f6f7 HTTP/1.1" status: 200 len: 1092 time: 0.7587187 Dec 09 22:18:53.998795 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c2751a42-2b08-4d38-8489-06d52cd0c856', 'tag': '923e8788-a027-4fdf-baa3-80ad65f0f6f7'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:18:54.001375 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bfe4a3c3-b047-4db2-a5c9-0498f4f8164a" -d '{"events": [{"name": "network-changed", "server_uuid": "c2751a42-2b08-4d38-8489-06d52cd0c856", "tag": "923e8788-a027-4fdf-baa3-80ad65f0f6f7"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:18:54.033605 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-921c3807-a006-4c0f-8e5e-2daa2141da16 req-b69305b5-4320-4f2f-b8d4-5f7185ca2425 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/security-groups?id=da2e1ee4-0b58-4224-a5d1-3ded9521a53d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1101322 Dec 09 22:18:54.039059 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-746c7a40-2dd7-4c27-8771-1c022c89e143 service neutron] Pushing event updated for resources: {'Port': ['ID=923e8788-a027-4fdf-baa3-80ad65f0f6f7,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:54.102790 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f4160fda-eff7-4def-bac0-bd2876d46021 None None] Provisioning complete for port 84fcf019-d7fd-4b96-8e12-451d97ecaad2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:54.103274 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f4160fda-eff7-4def-bac0-bd2876d46021 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:54.124273 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfe27397-664f-4ecb-a7d6-942c38eaabd6 None None] Pushing event updated for resources: {'Port': ['ID=84fcf019-d7fd-4b96-8e12-451d97ecaad2,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:54.144614 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-eeeb6389-69aa-416d-899e-db7c4b8d18cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:54.146176 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-eeeb6389-69aa-416d-899e-db7c4b8d18cb service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=fe6fc091d42140bf80daf7c889de205d&device_id=c2751a42-2b08-4d38-8489-06d52cd0c856 HTTP/1.1" status: 200 len: 1095 time: 0.0890973 Dec 09 22:18:54.167471 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:18:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-afbeecaf-31f0-4a89-8390-6ad613558f23 x-openstack-request-id: req-afbeecaf-31f0-4a89-8390-6ad613558f23 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:18:54.168271 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c2751a42-2b08-4d38-8489-06d52cd0c856", "tag": "923e8788-a027-4fdf-baa3-80ad65f0f6f7", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:18:54.168591 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-afbeecaf-31f0-4a89-8390-6ad613558f23 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:18:54.169496 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c2751a42-2b08-4d38-8489-06d52cd0c856', 'tag': '923e8788-a027-4fdf-baa3-80ad65f0f6f7', 'status': 'completed', 'code': 200} Dec 09 22:18:54.180358 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] Set router 3cd11f5c-66e8-454c-95b6-1677f0b7bcfb gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:18:54.211515 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-b68eafb4-fb4c-4d4b-8a7c-019d41cd31a5 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=923e8788-a027-4fdf-baa3-80ad65f0f6f7 HTTP/1.1" status: 200 len: 217 time: 0.0573468 Dec 09 22:18:54.241363 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f4160fda-eff7-4def-bac0-bd2876d46021 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:54.284900 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-aa939291-2e3d-4053-8ae4-e5791fc5ea73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:54.286432 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-aa939291-2e3d-4053-8ae4-e5791fc5ea73 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=2514586e-123f-4e2a-91a9-d8f14bd6e8d4 HTTP/1.1" status: 200 len: 856 time: 0.0657542 Dec 09 22:18:54.295081 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f4160fda-eff7-4def-bac0-bd2876d46021 None None] For port 84fcf019-d7fd-4b96-8e12-451d97ecaad2, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=84fcf019-d7fd-4b96-8e12-451d97ecaad2,segment=NetworkSegment(8b832101-6531-45f1-b542-347ffd458962),segment_id=8b832101-6531-45f1-b542-347ffd458962)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:54.302379 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f4160fda-eff7-4def-bac0-bd2876d46021 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:54.316191 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:18:54.344907 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-f4bcd780-e46b-4b06-b32d-c6b5a7607a65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:54.348321 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-f4bcd780-e46b-4b06-b32d-c6b5a7607a65 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=f26b9f47-9dd3-4ccc-8f56-670f8249a431&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0546813 Dec 09 22:18:54.365055 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4160fda-eff7-4def-bac0-bd2876d46021 None None] Pushing event updated for resources: {'Port': ['ID=84fcf019-d7fd-4b96-8e12-451d97ecaad2,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:54.423864 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-31b9a1ba-0199-48ec-9b61-761f079707a7 None None] Provisioning complete for port 84fcf019-d7fd-4b96-8e12-451d97ecaad2 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:54.424629 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-31b9a1ba-0199-48ec-9b61-761f079707a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:54.442138 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3cd11f5c-66e8-454c-95b6-1677f0b7bcfb', 'name': 'tempest-TestEncryptedCinderVolumes-69255544-router', 'tenant_id': '4d10a76d507b4127af04417b615f1fe1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44'}], 'enable_snat': True}, 'gw_port_id': 'a70d4b06-1397-437d-a6de-a8fe713c2995', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:18:46Z', 'updated_at': '2021-12-09T22:18:49Z', 'revision_number': 4, 'project_id': '4d10a76d507b4127af04417b615f1fe1', 'gw_port': {'id': 'a70d4b06-1397-437d-a6de-a8fe713c2995', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:26:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3cd11f5c-66e8-454c-95b6-1677f0b7bcfb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4158, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:18:47Z', 'updated_at': '2021-12-09T22:18:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '84fcf019-d7fd-4b96-8e12-451d97ecaad2', 'name': '', 'network_id': '92b047ee-0ea4-4eb3-9ba4-67718510564e', 'tenant_id': '4d10a76d507b4127af04417b615f1fe1', 'mac_address': 'fa:16:3e:8f:b4:cf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3cd11f5c-66e8-454c-95b6-1677f0b7bcfb', 'device_owner': 'network:router_interface', 'standard_attr_id': 4159, 'fixed_ips': [{'subnet_id': '61a415d1-4ccc-466f-97dc-3ec10f093da5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:18:49Z', 'updated_at': '2021-12-09T22:18:53Z', 'revision_number': 4, 'project_id': '4d10a76d507b4127af04417b615f1fe1', 'subnets': [{'id': '61a415d1-4ccc-466f-97dc-3ec10f093da5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:18:54.448683 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-7a0e3b31-ff47-4145-b4d5-38a7380c8448 service neutron] 10.222.0.10 "GET /v2.0/networks/f26b9f47-9dd3-4ccc-8f56-670f8249a431?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0932240 Dec 09 22:18:54.474021 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e824831-e5e4-4367-bc1e-f1f5f8ef7174 None None] The sync data for ids ['3cd11f5c-66e8-454c-95b6-1677f0b7bcfb'] in n-d-713301-27 is: [{'id': '3cd11f5c-66e8-454c-95b6-1677f0b7bcfb', 'name': 'tempest-TestEncryptedCinderVolumes-69255544-router', 'tenant_id': '4d10a76d507b4127af04417b615f1fe1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44'}], 'enable_snat': True}, 'gw_port_id': 'a70d4b06-1397-437d-a6de-a8fe713c2995', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:18:46Z', 'updated_at': '2021-12-09T22:18:49Z', 'revision_number': 4, 'project_id': '4d10a76d507b4127af04417b615f1fe1', 'gw_port': {'id': 'a70d4b06-1397-437d-a6de-a8fe713c2995', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:26:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3cd11f5c-66e8-454c-95b6-1677f0b7bcfb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4158, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:18:47Z', 'updated_at': '2021-12-09T22:18:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '84fcf019-d7fd-4b96-8e12-451d97ecaad2', 'name': '', 'network_id': '92b047ee-0ea4-4eb3-9ba4-67718510564e', 'tenant_id': '4d10a76d507b4127af04417b615f1fe1', 'mac_address': 'fa:16:3e:8f:b4:cf', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3cd11f5c-66e8-454c-95b6-1677f0b7bcfb', 'device_owner': 'network:router_interface', 'standard_attr_id': 4159, 'fixed_ips': [{'subnet_id': '61a415d1-4ccc-466f-97dc-3ec10f093da5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:18:49Z', 'updated_at': '2021-12-09T22:18:53Z', 'revision_number': 4, 'project_id': '4d10a76d507b4127af04417b615f1fe1', 'subnets': [{'id': '61a415d1-4ccc-466f-97dc-3ec10f093da5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:18:54.544747 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-83218b8a-b8db-4d45-94ac-d5e1a718939f req-39958731-29b4-4bd2-a08c-706a3b10ffb5 service neutron] 10.222.0.10 "GET /v2.0/networks/f26b9f47-9dd3-4ccc-8f56-670f8249a431?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0880432 Dec 09 22:18:54.632047 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfe4a3c3-b047-4db2-a5c9-0498f4f8164a req-3e848790-1941-4bc9-91f7-9dfffee597dd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:54.633707 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfe4a3c3-b047-4db2-a5c9-0498f4f8164a req-3e848790-1941-4bc9-91f7-9dfffee597dd service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=fe6fc091d42140bf80daf7c889de205d&device_id=c2751a42-2b08-4d38-8489-06d52cd0c856 HTTP/1.1" status: 200 len: 1095 time: 0.0422280 Dec 09 22:18:54.731859 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfe4a3c3-b047-4db2-a5c9-0498f4f8164a req-d524f793-5214-4195-83f5-b29094163a3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:54.733376 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfe4a3c3-b047-4db2-a5c9-0498f4f8164a req-d524f793-5214-4195-83f5-b29094163a3b service neutron] 10.222.0.10 "GET /v2.0/networks?id=f26b9f47-9dd3-4ccc-8f56-670f8249a431 HTTP/1.1" status: 200 len: 918 time: 0.0924559 Dec 09 22:18:54.778651 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfe4a3c3-b047-4db2-a5c9-0498f4f8164a req-15acb40c-784f-4651-809e-7a43b6ae81aa service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=923e8788-a027-4fdf-baa3-80ad65f0f6f7 HTTP/1.1" status: 200 len: 217 time: 0.0357676 Dec 09 22:18:54.837260 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfe4a3c3-b047-4db2-a5c9-0498f4f8164a req-f835f055-f98d-4635-8da5-486c048d3aa9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:54.838871 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfe4a3c3-b047-4db2-a5c9-0498f4f8164a req-f835f055-f98d-4635-8da5-486c048d3aa9 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=2514586e-123f-4e2a-91a9-d8f14bd6e8d4 HTTP/1.1" status: 200 len: 856 time: 0.0528526 Dec 09 22:18:54.893892 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfe4a3c3-b047-4db2-a5c9-0498f4f8164a req-67830b23-198a-4569-aa56-3ab71543ca54 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:54.895798 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfe4a3c3-b047-4db2-a5c9-0498f4f8164a req-67830b23-198a-4569-aa56-3ab71543ca54 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=f26b9f47-9dd3-4ccc-8f56-670f8249a431&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0483692 Dec 09 22:18:54.995388 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfe4a3c3-b047-4db2-a5c9-0498f4f8164a req-c10e1722-e86c-4f78-a83f-4d2431bf3741 service neutron] 10.222.0.10 "GET /v2.0/networks/f26b9f47-9dd3-4ccc-8f56-670f8249a431?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0907741 Dec 09 22:18:55.088337 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bfe4a3c3-b047-4db2-a5c9-0498f4f8164a req-940f4cdd-8aa1-4939-b900-5a4e36060c8d service neutron] 10.222.0.10 "GET /v2.0/networks/f26b9f47-9dd3-4ccc-8f56-670f8249a431?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0844171 Dec 09 22:18:55.168013 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8db21318-9e8e-4199-9a69-ad8208fdb333 req-1c508886-db21-4f12-a396-4e7322cf3e35 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:55.169512 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8db21318-9e8e-4199-9a69-ad8208fdb333 req-1c508886-db21-4f12-a396-4e7322cf3e35 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=c2751a42-2b08-4d38-8489-06d52cd0c856 HTTP/1.1" status: 200 len: 943 time: 0.0545478 Dec 09 22:18:55.222683 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8db21318-9e8e-4199-9a69-ad8208fdb333 req-95ddca2f-38e1-4c1e-9b1b-0f85bf604adb tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/security-groups?id=da2e1ee4-0b58-4224-a5d1-3ded9521a53d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469918 Dec 09 22:18:56.153099 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 84fcf019-d7fd-4b96-8e12-451d97ecaad2 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:18:56.205096 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 84fcf019-d7fd-4b96-8e12-451d97ecaad2 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:56.205468 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:56.350136 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62bbe929-155e-4f21-bc9c-2b731278b000 req-3a65e6eb-0679-4633-86a7-dcb3147adcf4 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:56.351558 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-62bbe929-155e-4f21-bc9c-2b731278b000 req-3a65e6eb-0679-4633-86a7-dcb3147adcf4 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=c2751a42-2b08-4d38-8489-06d52cd0c856 HTTP/1.1" status: 200 len: 943 time: 0.0499029 Dec 09 22:18:56.399658 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-62bbe929-155e-4f21-bc9c-2b731278b000 req-bd9768c6-e7a8-4ce1-9290-6d6b483e9483 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/security-groups?id=da2e1ee4-0b58-4224-a5d1-3ded9521a53d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418010 Dec 09 22:18:57.078120 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 923e8788-a027-4fdf-baa3-80ad65f0f6f7 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:18:57.177645 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 923e8788-a027-4fdf-baa3-80ad65f0f6f7, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=923e8788-a027-4fdf-baa3-80ad65f0f6f7,segment=NetworkSegment(00089427-5063-4156-b8c3-e09f3fd9ab49),segment_id=00089427-5063-4156-b8c3-e09f3fd9ab49)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:57.188982 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '923e8788-a027-4fdf-baa3-80ad65f0f6f7', 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431', 'port_id': '923e8788-a027-4fdf-baa3-80ad65f0f6f7', 'mac_address': 'fa:16:3e:5c:45:98', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 100, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2514586e-123f-4e2a-91a9-d8f14bd6e8d4', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:18:57.231061 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:57.249534 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 923e8788-a027-4fdf-baa3-80ad65f0f6f7 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:18:57.268843 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 923e8788-a027-4fdf-baa3-80ad65f0f6f7, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=923e8788-a027-4fdf-baa3-80ad65f0f6f7,segment=NetworkSegment(00089427-5063-4156-b8c3-e09f3fd9ab49),segment_id=00089427-5063-4156-b8c3-e09f3fd9ab49)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:57.274596 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:57.324180 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=923e8788-a027-4fdf-baa3-80ad65f0f6f7,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:57.475505 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['923e8788-a027-4fdf-baa3-80ad65f0f6f7'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:18:57.529024 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e03296ed-771b-4638-bff0-25cb2089ae7a req-be59dea6-4aee-4333-a7d8-10b48b57825c tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:57.530533 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e03296ed-771b-4638-bff0-25cb2089ae7a req-be59dea6-4aee-4333-a7d8-10b48b57825c tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=c2751a42-2b08-4d38-8489-06d52cd0c856 HTTP/1.1" status: 200 len: 944 time: 0.0515707 Dec 09 22:18:57.577987 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e03296ed-771b-4638-bff0-25cb2089ae7a req-948388c0-c79f-41e5-83f0-483c0cd420ff tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/security-groups?id=da2e1ee4-0b58-4224-a5d1-3ded9521a53d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410922 Dec 09 22:18:57.639703 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:57.755782 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:58.701537 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e5cc3ff-10ca-4f75-a78c-4b43d7f495d5 req-f12216b8-9376-4b20-806e-f86711e036d9 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:58.703041 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e5cc3ff-10ca-4f75-a78c-4b43d7f495d5 req-f12216b8-9376-4b20-806e-f86711e036d9 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=c2751a42-2b08-4d38-8489-06d52cd0c856 HTTP/1.1" status: 200 len: 944 time: 0.0550060 Dec 09 22:18:58.751136 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5e5cc3ff-10ca-4f75-a78c-4b43d7f495d5 req-d0cbb1aa-7215-47c7-b4b6-7dfb4d32e606 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/security-groups?id=da2e1ee4-0b58-4224-a5d1-3ded9521a53d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420153 Dec 09 22:18:59.069641 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 923e8788-a027-4fdf-baa3-80ad65f0f6f7 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:18:59.129316 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 923e8788-a027-4fdf-baa3-80ad65f0f6f7 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:18:59.133521 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 923e8788-a027-4fdf-baa3-80ad65f0f6f7 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:18:59.133894 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:59.212163 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:59.234555 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c2751a42-2b08-4d38-8489-06d52cd0c856', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '923e8788-a027-4fdf-baa3-80ad65f0f6f7'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:18:59.236862 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9172bec5-a459-404a-8635-8ef7225dbf88" -d '{"events": [{"server_uuid": "c2751a42-2b08-4d38-8489-06d52cd0c856", "name": "network-vif-plugged", "status": "completed", "tag": "923e8788-a027-4fdf-baa3-80ad65f0f6f7"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:18:59.253485 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 923e8788-a027-4fdf-baa3-80ad65f0f6f7, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=923e8788-a027-4fdf-baa3-80ad65f0f6f7,segment=NetworkSegment(00089427-5063-4156-b8c3-e09f3fd9ab49),segment_id=00089427-5063-4156-b8c3-e09f3fd9ab49)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:18:59.258480 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:18:59.281940 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:18:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-26c4073e-c32b-4691-853f-6defb72a8cc7 x-openstack-request-id: req-26c4073e-c32b-4691-853f-6defb72a8cc7 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:18:59.282238 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c2751a42-2b08-4d38-8489-06d52cd0c856", "name": "network-vif-plugged", "status": "completed", "tag": "923e8788-a027-4fdf-baa3-80ad65f0f6f7", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:18:59.282493 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-26c4073e-c32b-4691-853f-6defb72a8cc7 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:18:59.282887 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c2751a42-2b08-4d38-8489-06d52cd0c856', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '923e8788-a027-4fdf-baa3-80ad65f0f6f7', 'code': 200} Dec 09 22:18:59.308089 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=923e8788-a027-4fdf-baa3-80ad65f0f6f7,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:18:59.378191 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d56b9f2-63f9-40e1-af18-1770dd05eddd req-01e465a3-4659-48c5-bdae-9830714ec722 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:59.379661 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d56b9f2-63f9-40e1-af18-1770dd05eddd req-01e465a3-4659-48c5-bdae-9830714ec722 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=c2751a42-2b08-4d38-8489-06d52cd0c856 HTTP/1.1" status: 200 len: 1097 time: 0.0422175 Dec 09 22:18:59.425642 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9d56b9f2-63f9-40e1-af18-1770dd05eddd req-2790e930-6fb3-464a-92ef-5b55558ddddc service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=da2e1ee4-0b58-4224-a5d1-3ded9521a53d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385652 Dec 09 22:18:59.883549 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca546ce3-b249-4492-ac36-de4f6f37e47f req-f8d3291a-153d-4fb8-8dd6-571ec00e4238 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:18:59.885066 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ca546ce3-b249-4492-ac36-de4f6f37e47f req-f8d3291a-153d-4fb8-8dd6-571ec00e4238 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=c2751a42-2b08-4d38-8489-06d52cd0c856 HTTP/1.1" status: 200 len: 945 time: 0.0496259 Dec 09 22:18:59.947235 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ca546ce3-b249-4492-ac36-de4f6f37e47f req-001ff4e3-c005-4f95-9ece-9e5764894c44 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/security-groups?id=da2e1ee4-0b58-4224-a5d1-3ded9521a53d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0557814 Dec 09 22:19:01.079059 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2295e09e-c7bf-49ae-8ac7-62abbc618c35 req-67cb3471-29d0-47f4-9622-7699aa592572 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:01.080596 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2295e09e-c7bf-49ae-8ac7-62abbc618c35 req-67cb3471-29d0-47f4-9622-7699aa592572 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=c2751a42-2b08-4d38-8489-06d52cd0c856 HTTP/1.1" status: 200 len: 945 time: 0.0543909 Dec 09 22:19:01.131534 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2295e09e-c7bf-49ae-8ac7-62abbc618c35 req-c4e78891-8d0b-48f7-9bdc-452988387f55 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/security-groups?id=da2e1ee4-0b58-4224-a5d1-3ded9521a53d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444932 Dec 09 22:19:01.251066 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c9030a0-e920-4301-8dd7-7ab3c59d7f75 req-20bc706e-2d2e-478f-8ae6-ff101e43cb98 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:01.252483 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7c9030a0-e920-4301-8dd7-7ab3c59d7f75 req-20bc706e-2d2e-478f-8ae6-ff101e43cb98 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=c2751a42-2b08-4d38-8489-06d52cd0c856 HTTP/1.1" status: 200 len: 945 time: 0.0519402 Dec 09 22:19:01.301910 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7c9030a0-e920-4301-8dd7-7ab3c59d7f75 req-416ad42c-d6b4-42a0-bb3d-6ed9ddc4355c tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/security-groups?id=da2e1ee4-0b58-4224-a5d1-3ded9521a53d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433173 Dec 09 22:19:03.017702 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b87eb282-f466-495e-8460-5aec7ce90662 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:05.654379 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-47d9fe5e-635d-4a12-b0af-c6b209c315c7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:06.858909 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:08.186704 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:09.692360 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:23.047575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11fc4a2-12b5-4661-b003-380038fdf7ee req-13ca5ef7-9d3d-4132-8057-a8d8e4e7b263 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:23.049030 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a11fc4a2-12b5-4661-b003-380038fdf7ee req-13ca5ef7-9d3d-4132-8057-a8d8e4e7b263 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=c2751a42-2b08-4d38-8489-06d52cd0c856 HTTP/1.1" status: 200 len: 945 time: 0.0566833 Dec 09 22:19:23.100853 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a11fc4a2-12b5-4661-b003-380038fdf7ee req-72e0f56c-852c-4e35-9ed8-1c1708eb4a7b tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/security-groups?id=da2e1ee4-0b58-4224-a5d1-3ded9521a53d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446427 Dec 09 22:19:24.232598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f6a6ed7-3fd2-4c98-8da0-d0bf7d125d6e req-9c1d74f8-c731-451a-88b8-0ea3d9b0c24d tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:24.234092 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1f6a6ed7-3fd2-4c98-8da0-d0bf7d125d6e req-9c1d74f8-c731-451a-88b8-0ea3d9b0c24d tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=c2751a42-2b08-4d38-8489-06d52cd0c856 HTTP/1.1" status: 200 len: 945 time: 0.0622177 Dec 09 22:19:24.284226 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1f6a6ed7-3fd2-4c98-8da0-d0bf7d125d6e req-a604330c-449a-445e-a51b-bc2413c7aaad tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/security-groups?id=da2e1ee4-0b58-4224-a5d1-3ded9521a53d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432901 Dec 09 22:19:24.553824 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d289b610-c0fd-4a4b-8d1f-5a8c9321d097 req-de1abd6e-df06-456b-860f-7ce4f8f9bccd tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:24.555308 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d289b610-c0fd-4a4b-8d1f-5a8c9321d097 req-de1abd6e-df06-456b-860f-7ce4f8f9bccd tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.10 "GET /v2.0/ports?device_id=c2751a42-2b08-4d38-8489-06d52cd0c856 HTTP/1.1" status: 200 len: 945 time: 0.0652966 Dec 09 22:19:24.648807 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-d289b610-c0fd-4a4b-8d1f-5a8c9321d097 req-10dc0b5f-45c9-4ab7-a6b7-a24135d1c0b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Deleting port 923e8788-a027-4fdf-baa3-80ad65f0f6f7 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:19:24.649163 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d289b610-c0fd-4a4b-8d1f-5a8c9321d097 req-10dc0b5f-45c9-4ab7-a6b7-a24135d1c0b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:24.742394 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-d289b610-c0fd-4a4b-8d1f-5a8c9321d097 req-10dc0b5f-45c9-4ab7-a6b7-a24135d1c0b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] For port 923e8788-a027-4fdf-baa3-80ad65f0f6f7, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=923e8788-a027-4fdf-baa3-80ad65f0f6f7,segment=NetworkSegment(00089427-5063-4156-b8c3-e09f3fd9ab49),segment_id=00089427-5063-4156-b8c3-e09f3fd9ab49)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:19:24.742757 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d289b610-c0fd-4a4b-8d1f-5a8c9321d097 req-10dc0b5f-45c9-4ab7-a6b7-a24135d1c0b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:24.755143 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-d289b610-c0fd-4a4b-8d1f-5a8c9321d097 req-10dc0b5f-45c9-4ab7-a6b7-a24135d1c0b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Calling delete_port for 923e8788-a027-4fdf-baa3-80ad65f0f6f7 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:19:24.887907 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d289b610-c0fd-4a4b-8d1f-5a8c9321d097 req-10dc0b5f-45c9-4ab7-a6b7-a24135d1c0b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:24.900151 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['923e8788-a027-4fdf-baa3-80ad65f0f6f7'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:19:24.920655 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10dc0b5f-45c9-4ab7-a6b7-a24135d1c0b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Pushing event deleted for resources: {'Port': ['ID=923e8788-a027-4fdf-baa3-80ad65f0f6f7,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:19:24.961735 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-d289b610-c0fd-4a4b-8d1f-5a8c9321d097 req-10dc0b5f-45c9-4ab7-a6b7-a24135d1c0b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] No DVR routers for this DVR port 923e8788-a027-4fdf-baa3-80ad65f0f6f7 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:19:24.965157 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d289b610-c0fd-4a4b-8d1f-5a8c9321d097 req-10dc0b5f-45c9-4ab7-a6b7-a24135d1c0b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:24.968746 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d289b610-c0fd-4a4b-8d1f-5a8c9321d097 req-10dc0b5f-45c9-4ab7-a6b7-a24135d1c0b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.10 "DELETE /v2.0/ports/923e8788-a027-4fdf-baa3-80ad65f0f6f7 HTTP/1.1" status: 204 len: 173 time: 0.4074371 Dec 09 22:19:24.969218 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c2751a42-2b08-4d38-8489-06d52cd0c856', 'name': 'network-vif-deleted', 'tag': '923e8788-a027-4fdf-baa3-80ad65f0f6f7'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:19:24.971505 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2c2b2571-fdb2-4b3a-b916-51eb8ffa0067" -d '{"events": [{"server_uuid": "c2751a42-2b08-4d38-8489-06d52cd0c856", "name": "network-vif-deleted", "tag": "923e8788-a027-4fdf-baa3-80ad65f0f6f7"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:19:25.013316 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:19:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6c55e012-6694-4a98-817a-2ba4d4cf618b x-openstack-request-id: req-6c55e012-6694-4a98-817a-2ba4d4cf618b {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:19:25.013708 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c2751a42-2b08-4d38-8489-06d52cd0c856", "name": "network-vif-deleted", "tag": "923e8788-a027-4fdf-baa3-80ad65f0f6f7", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:19:25.013967 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-6c55e012-6694-4a98-817a-2ba4d4cf618b {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:19:25.014385 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c2751a42-2b08-4d38-8489-06d52cd0c856', 'name': 'network-vif-deleted', 'tag': '923e8788-a027-4fdf-baa3-80ad65f0f6f7', 'status': 'completed', 'code': 200} Dec 09 22:19:25.417002 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-292ca7b4-65b6-4c2c-80fa-76d1751110e3 req-bd43a893-6c58-45cc-92ad-4b16e8b6d66e tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=c2751a42-2b08-4d38-8489-06d52cd0c856 HTTP/1.1" status: 200 len: 210 time: 0.0266891 Dec 09 22:19:27.170650 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-598b4700-afed-4e11-b165-95ea53b759b9 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:27.172159 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-598b4700-afed-4e11-b165-95ea53b759b9 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/networks?id=f26b9f47-9dd3-4ccc-8f56-670f8249a431 HTTP/1.1" status: 200 len: 817 time: 0.1219652 Dec 09 22:19:27.188069 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-bf2fa6fb-297e-48ee-8083-64a9e5e96074 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/quotas/fe6fc091d42140bf80daf7c889de205d HTTP/1.1" status: 200 len: 375 time: 0.0098832 Dec 09 22:19:27.243919 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-fd2e3064-40e1-41f1-8163-10d65e325842 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=fe6fc091d42140bf80daf7c889de205d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0480776 Dec 09 22:19:27.343673 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-1920fe6f-0426-4841-b0ee-ee56c04b390b service neutron] 10.222.0.13 "GET /v2.0/networks/f26b9f47-9dd3-4ccc-8f56-670f8249a431?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0849776 Dec 09 22:19:27.436279 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-3ded3062-cd16-4742-8ff7-dd75555f072a service neutron] 10.222.0.13 "GET /v2.0/networks/f26b9f47-9dd3-4ccc-8f56-670f8249a431?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0853298 Dec 09 22:19:27.599826 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8cae471b-bb02-4738-a2a5-8bafca81a7f4 req-0f476c65-e1a9-416a-a116-ffba87c78ee4 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=4d9e66f9-6296-4074-98f6-406349170f9c HTTP/1.1" status: 200 len: 210 time: 0.0266716 Dec 09 22:19:27.645697 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:27.752750 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:28.594172 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-acf87428-0a58-4345-893f-caf1c30dc342 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:28.595702 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-acf87428-0a58-4345-893f-caf1c30dc342 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.31 "GET /v2.0/networks?id=f26b9f47-9dd3-4ccc-8f56-670f8249a431 HTTP/1.1" status: 200 len: 817 time: 0.1086287 Dec 09 22:19:28.608394 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Request body: {'port': {'device_id': '4d9e66f9-6296-4074-98f6-406349170f9c', 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431', 'admin_state_up': True, 'tenant_id': 'fe6fc091d42140bf80daf7c889de205d'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:19:28.696171 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6f3c9c3-8a9c-4070-841e-4460cfab8ce2 req-974f87bc-12de-4748-9a50-2f17ada222cd tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=4d9e66f9-6296-4074-98f6-406349170f9c HTTP/1.1" status: 200 len: 210 time: 0.0263665 Dec 09 22:19:28.722120 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Made reservation on behalf of fe6fc091d42140bf80daf7c889de205d for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:19:28.726417 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:28.863335 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Allocated IP 172.20.0.12 (f26b9f47-9dd3-4ccc-8f56-670f8249a431/2514586e-123f-4e2a-91a9-d8f14bd6e8d4/d76a27c9-41e9-47a1-9b5f-1569d738ee2c) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:19:29.022642 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:29.061479 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:29.101941 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Network f26b9f47-9dd3-4ccc-8f56-670f8249a431 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:19:29.106845 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:19:29.113078 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:19:29.121750 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Pushing event updated for resources: {'Port': ['ID=d76a27c9-41e9-47a1-9b5f-1569d738ee2c,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:19:29.153260 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:29.153613 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:29.153958 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:29.154292 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:29.154620 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:29.154950 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:29.155277 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:29.155603 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:29.155929 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:29.156280 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:29.156597 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:29.156916 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:29.157230 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:29.181651 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:29.182291 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:29.201925 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-c6cc79bf-c22f-45ff-b6fc-2e44cc47c2b3 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5973663 Dec 09 22:19:29.214595 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-6b0086f4-1f77-4279-890e-710a321496cc service neutron] Request body: {'port': {'device_id': '4d9e66f9-6296-4074-98f6-406349170f9c', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:19:29.215025 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 923e8788-a027-4fdf-baa3-80ad65f0f6f7 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:19:29.235973 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 923e8788-a027-4fdf-baa3-80ad65f0f6f7 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:19:29.236324 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 923e8788-a027-4fdf-baa3-80ad65f0f6f7 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:19:29.275084 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-6b0086f4-1f77-4279-890e-710a321496cc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:29.395835 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-32824123-2b3d-43e1-b062-1c554d220599 None None] Provisioning complete for port d76a27c9-41e9-47a1-9b5f-1569d738ee2c triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:19:29.396521 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-32824123-2b3d-43e1-b062-1c554d220599 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:29.429234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-32824123-2b3d-43e1-b062-1c554d220599 None None] Port d76a27c9-41e9-47a1-9b5f-1569d738ee2c cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:19:29.535564 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-6b0086f4-1f77-4279-890e-710a321496cc service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d76a27c9-41e9-47a1-9b5f-1569d738ee2c {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:19:29.543065 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-6b0086f4-1f77-4279-890e-710a321496cc service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:29.555175 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-6b0086f4-1f77-4279-890e-710a321496cc service neutron] Transition to ACTIVE for port object d76a27c9-41e9-47a1-9b5f-1569d738ee2c will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:19:29.561320 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-6b0086f4-1f77-4279-890e-710a321496cc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:29.609486 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b0086f4-1f77-4279-890e-710a321496cc service neutron] Pushing event updated for resources: {'Port': ['ID=d76a27c9-41e9-47a1-9b5f-1569d738ee2c,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:19:29.690472 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-6b0086f4-1f77-4279-890e-710a321496cc service neutron] Attempting to bind port d76a27c9-41e9-47a1-9b5f-1569d738ee2c on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:19:29.690817 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-6b0086f4-1f77-4279-890e-710a321496cc service neutron] Attempting to bind port d76a27c9-41e9-47a1-9b5f-1569d738ee2c by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '00089427-5063-4156-b8c3-e09f3fd9ab49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:19:29.691155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-6b0086f4-1f77-4279-890e-710a321496cc service neutron] Attempting to bind port d76a27c9-41e9-47a1-9b5f-1569d738ee2c on network f26b9f47-9dd3-4ccc-8f56-670f8249a431 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:19:29.697006 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-6b0086f4-1f77-4279-890e-710a321496cc service neutron] Port d76a27c9-41e9-47a1-9b5f-1569d738ee2c on network f26b9f47-9dd3-4ccc-8f56-670f8249a431 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:19:29.697333 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-6b0086f4-1f77-4279-890e-710a321496cc service neutron] Attempting to bind port d76a27c9-41e9-47a1-9b5f-1569d738ee2c on network f26b9f47-9dd3-4ccc-8f56-670f8249a431 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:19:29.703549 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-6b0086f4-1f77-4279-890e-710a321496cc service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 19, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:19:29.703892 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-6b0086f4-1f77-4279-890e-710a321496cc service neutron] Checking segment: {'id': '00089427-5063-4156-b8c3-e09f3fd9ab49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:19:29.704275 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-6b0086f4-1f77-4279-890e-710a321496cc service neutron] Bound using segment: {'id': '00089427-5063-4156-b8c3-e09f3fd9ab49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:19:29.704845 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-6b0086f4-1f77-4279-890e-710a321496cc service neutron] Bound port: d76a27c9-41e9-47a1-9b5f-1569d738ee2c, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '00089427-5063-4156-b8c3-e09f3fd9ab49', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 100, 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:19:29.705213 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-6b0086f4-1f77-4279-890e-710a321496cc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:29.782311 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-6b0086f4-1f77-4279-890e-710a321496cc service neutron] For port d76a27c9-41e9-47a1-9b5f-1569d738ee2c, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:19:29.785490 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-6b0086f4-1f77-4279-890e-710a321496cc service neutron] For port d76a27c9-41e9-47a1-9b5f-1569d738ee2c, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=d76a27c9-41e9-47a1-9b5f-1569d738ee2c,segment=NetworkSegment(00089427-5063-4156-b8c3-e09f3fd9ab49),segment_id=00089427-5063-4156-b8c3-e09f3fd9ab49)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:19:29.790616 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-6b0086f4-1f77-4279-890e-710a321496cc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:29.824792 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b46efb19-d9d0-4ced-be4f-ed634820f48d req-5cf4f8ad-41eb-4628-8b69-d2b3b33311bd tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:29.827034 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b46efb19-d9d0-4ced-be4f-ed634820f48d req-5cf4f8ad-41eb-4628-8b69-d2b3b33311bd tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=4d9e66f9-6296-4074-98f6-406349170f9c HTTP/1.1" status: 200 len: 944 time: 0.0557959 Dec 09 22:19:29.839368 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-6b0086f4-1f77-4279-890e-710a321496cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:29.840028 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-6b0086f4-1f77-4279-890e-710a321496cc service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:29.841422 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-6b0086f4-1f77-4279-890e-710a321496cc service neutron] 10.222.0.31 "PUT /v2.0/ports/d76a27c9-41e9-47a1-9b5f-1569d738ee2c HTTP/1.1" status: 200 len: 1093 time: 0.6311958 Dec 09 22:19:29.841885 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4d9e66f9-6296-4074-98f6-406349170f9c', 'tag': 'd76a27c9-41e9-47a1-9b5f-1569d738ee2c'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:19:29.844308 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-849a688c-07e5-41b4-9ff1-7c4526b7abad" -d '{"events": [{"name": "network-changed", "server_uuid": "4d9e66f9-6296-4074-98f6-406349170f9c", "tag": "d76a27c9-41e9-47a1-9b5f-1569d738ee2c"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:19:29.856663 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b0086f4-1f77-4279-890e-710a321496cc service neutron] Pushing event updated for resources: {'Port': ['ID=d76a27c9-41e9-47a1-9b5f-1569d738ee2c,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:19:29.895224 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b46efb19-d9d0-4ced-be4f-ed634820f48d req-7f6aaf33-ac43-4d09-ad72-ec95d2c7318f tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/security-groups?id=da2e1ee4-0b58-4224-a5d1-3ded9521a53d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0607564 Dec 09 22:19:29.941896 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-87752dab-0574-4526-9aa6-755560b0285f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:29.943522 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-87752dab-0574-4526-9aa6-755560b0285f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=fe6fc091d42140bf80daf7c889de205d&device_id=4d9e66f9-6296-4074-98f6-406349170f9c HTTP/1.1" status: 200 len: 1096 time: 0.0426173 Dec 09 22:19:29.945044 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:19:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ba7c0682-e878-48cc-8c83-150a4077d5b9 x-openstack-request-id: req-ba7c0682-e878-48cc-8c83-150a4077d5b9 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:19:29.945333 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4d9e66f9-6296-4074-98f6-406349170f9c", "tag": "d76a27c9-41e9-47a1-9b5f-1569d738ee2c", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:19:29.945589 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-ba7c0682-e878-48cc-8c83-150a4077d5b9 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:19:29.945968 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4d9e66f9-6296-4074-98f6-406349170f9c', 'tag': 'd76a27c9-41e9-47a1-9b5f-1569d738ee2c', 'status': 'completed', 'code': 200} Dec 09 22:19:29.992200 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-11fce350-eda7-42b8-8ae6-d80c5aa49796 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=d76a27c9-41e9-47a1-9b5f-1569d738ee2c HTTP/1.1" status: 200 len: 217 time: 0.0390470 Dec 09 22:19:30.043892 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-f2a974eb-b17f-4223-9845-93a2f20d4d2a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:30.045390 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-f2a974eb-b17f-4223-9845-93a2f20d4d2a service neutron] 10.222.0.31 "GET /v2.0/subnets?id=2514586e-123f-4e2a-91a9-d8f14bd6e8d4 HTTP/1.1" status: 200 len: 856 time: 0.0461411 Dec 09 22:19:30.095639 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-e4e55263-eecd-4486-8a79-2a27e73d9c1e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:30.097322 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-e4e55263-eecd-4486-8a79-2a27e73d9c1e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=f26b9f47-9dd3-4ccc-8f56-670f8249a431&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0443637 Dec 09 22:19:30.198172 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-53a5b4eb-cd14-4093-a2b8-a2d318cfd703 service neutron] 10.222.0.31 "GET /v2.0/networks/f26b9f47-9dd3-4ccc-8f56-670f8249a431?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0935299 Dec 09 22:19:30.296354 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d75e42ad-5b6b-4f6b-8c79-1bfe1b331325 req-cf8df8da-5ba5-4bed-84cb-3ff1bf44bbce service neutron] 10.222.0.31 "GET /v2.0/networks/f26b9f47-9dd3-4ccc-8f56-670f8249a431?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0909638 Dec 09 22:19:30.391883 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-849a688c-07e5-41b4-9ff1-7c4526b7abad req-0585f6ed-ae7e-459d-9ef7-0af8e11e5198 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:30.393393 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-849a688c-07e5-41b4-9ff1-7c4526b7abad req-0585f6ed-ae7e-459d-9ef7-0af8e11e5198 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=fe6fc091d42140bf80daf7c889de205d&device_id=4d9e66f9-6296-4074-98f6-406349170f9c HTTP/1.1" status: 200 len: 1096 time: 0.0436552 Dec 09 22:19:30.492555 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-849a688c-07e5-41b4-9ff1-7c4526b7abad req-3f952924-23f7-430e-8238-c50f75449ff2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:30.493985 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-849a688c-07e5-41b4-9ff1-7c4526b7abad req-3f952924-23f7-430e-8238-c50f75449ff2 service neutron] 10.222.0.31 "GET /v2.0/networks?id=f26b9f47-9dd3-4ccc-8f56-670f8249a431 HTTP/1.1" status: 200 len: 918 time: 0.0933785 Dec 09 22:19:30.537124 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-849a688c-07e5-41b4-9ff1-7c4526b7abad req-531a8384-0318-4dd5-9689-4b102cc5e32b service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=d76a27c9-41e9-47a1-9b5f-1569d738ee2c HTTP/1.1" status: 200 len: 217 time: 0.0359983 Dec 09 22:19:30.587471 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-849a688c-07e5-41b4-9ff1-7c4526b7abad req-5644321d-5b3a-43f8-8174-2ee66419f886 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:30.588962 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-849a688c-07e5-41b4-9ff1-7c4526b7abad req-5644321d-5b3a-43f8-8174-2ee66419f886 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=2514586e-123f-4e2a-91a9-d8f14bd6e8d4 HTTP/1.1" status: 200 len: 856 time: 0.0449662 Dec 09 22:19:30.640196 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-849a688c-07e5-41b4-9ff1-7c4526b7abad req-3d275e38-c269-414c-a8ef-0a539497f4e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:30.641693 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-849a688c-07e5-41b4-9ff1-7c4526b7abad req-3d275e38-c269-414c-a8ef-0a539497f4e9 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=f26b9f47-9dd3-4ccc-8f56-670f8249a431&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0444815 Dec 09 22:19:30.736575 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-849a688c-07e5-41b4-9ff1-7c4526b7abad req-30aa7cf7-27ac-467d-9f55-32901bfcffe2 service neutron] 10.222.0.31 "GET /v2.0/networks/f26b9f47-9dd3-4ccc-8f56-670f8249a431?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0856130 Dec 09 22:19:30.835874 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-849a688c-07e5-41b4-9ff1-7c4526b7abad req-b2fe3d3c-7663-46bd-bf45-f090a2a7ef0f service neutron] 10.222.0.31 "GET /v2.0/networks/f26b9f47-9dd3-4ccc-8f56-670f8249a431?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0911632 Dec 09 22:19:31.026314 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6439a0f1-b478-4ef2-bafa-d11460b90251 req-46e0311c-ed9b-4a37-b136-8a1d32f0f287 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:31.027848 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6439a0f1-b478-4ef2-bafa-d11460b90251 req-46e0311c-ed9b-4a37-b136-8a1d32f0f287 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=4d9e66f9-6296-4074-98f6-406349170f9c HTTP/1.1" status: 200 len: 944 time: 0.0500152 Dec 09 22:19:31.076077 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6439a0f1-b478-4ef2-bafa-d11460b90251 req-bbe427bd-b851-43ef-8a72-ad8a95aa5844 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/security-groups?id=da2e1ee4-0b58-4224-a5d1-3ded9521a53d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420749 Dec 09 22:19:31.302239 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:19:32.215831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e881a5-98df-4d4a-ab3a-217bb05bde1c req-a456e9c2-b349-4b8b-b05d-66972380d2aa tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:32.217316 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c8e881a5-98df-4d4a-ab3a-217bb05bde1c req-a456e9c2-b349-4b8b-b05d-66972380d2aa tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=4d9e66f9-6296-4074-98f6-406349170f9c HTTP/1.1" status: 200 len: 944 time: 0.0603931 Dec 09 22:19:32.273591 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c8e881a5-98df-4d4a-ab3a-217bb05bde1c req-0ad77a0c-f836-4743-8675-fe55166d222c tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/security-groups?id=da2e1ee4-0b58-4224-a5d1-3ded9521a53d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479088 Dec 09 22:19:33.028269 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a3fb0734-91ba-4b4b-9599-e35998ff607b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:33.334200 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device d76a27c9-41e9-47a1-9b5f-1569d738ee2c details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:19:33.400363 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bd08675-69aa-484f-bd64-55a21aa28190 req-eace7db8-38c2-44b1-aa44-c9d5897d2ad7 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:33.401847 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bd08675-69aa-484f-bd64-55a21aa28190 req-eace7db8-38c2-44b1-aa44-c9d5897d2ad7 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=4d9e66f9-6296-4074-98f6-406349170f9c HTTP/1.1" status: 200 len: 944 time: 0.0499456 Dec 09 22:19:33.432110 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port d76a27c9-41e9-47a1-9b5f-1569d738ee2c, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=d76a27c9-41e9-47a1-9b5f-1569d738ee2c,segment=NetworkSegment(00089427-5063-4156-b8c3-e09f3fd9ab49),segment_id=00089427-5063-4156-b8c3-e09f3fd9ab49)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:19:33.443928 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'd76a27c9-41e9-47a1-9b5f-1569d738ee2c', 'network_id': 'f26b9f47-9dd3-4ccc-8f56-670f8249a431', 'port_id': 'd76a27c9-41e9-47a1-9b5f-1569d738ee2c', 'mac_address': 'fa:16:3e:e6:25:af', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 100, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2514586e-123f-4e2a-91a9-d8f14bd6e8d4', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:19:33.449891 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bd08675-69aa-484f-bd64-55a21aa28190 req-a22eb443-a774-4ece-9f64-0bc5eb84998d tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/security-groups?id=da2e1ee4-0b58-4224-a5d1-3ded9521a53d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416162 Dec 09 22:19:33.485257 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:33.498149 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d76a27c9-41e9-47a1-9b5f-1569d738ee2c {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:19:33.517634 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port d76a27c9-41e9-47a1-9b5f-1569d738ee2c, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=d76a27c9-41e9-47a1-9b5f-1569d738ee2c,segment=NetworkSegment(00089427-5063-4156-b8c3-e09f3fd9ab49),segment_id=00089427-5063-4156-b8c3-e09f3fd9ab49)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:19:33.523295 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:33.570394 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=d76a27c9-41e9-47a1-9b5f-1569d738ee2c,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:19:33.577784 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:33.578127 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:33.578470 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:33.578802 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:33.579130 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:33.579472 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:33.579818 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:33.580144 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:33.580454 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:33.580775 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:33.581096 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:33.581414 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:33.581735 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:19:33.725198 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['d76a27c9-41e9-47a1-9b5f-1569d738ee2c'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:19:34.580031 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-097c372d-85cb-4ba9-92a7-88952ad78358 req-cdb5af7d-1ad1-4b6a-b13f-fbd293befe20 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:34.581530 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-097c372d-85cb-4ba9-92a7-88952ad78358 req-cdb5af7d-1ad1-4b6a-b13f-fbd293befe20 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=4d9e66f9-6296-4074-98f6-406349170f9c HTTP/1.1" status: 200 len: 945 time: 0.0488729 Dec 09 22:19:34.636181 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-097c372d-85cb-4ba9-92a7-88952ad78358 req-f66366ae-1948-4de5-bc8d-d4a745e00313 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/security-groups?id=da2e1ee4-0b58-4224-a5d1-3ded9521a53d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451400 Dec 09 22:19:35.352056 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device d76a27c9-41e9-47a1-9b5f-1569d738ee2c up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:19:35.410252 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port d76a27c9-41e9-47a1-9b5f-1569d738ee2c completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:19:35.414355 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port d76a27c9-41e9-47a1-9b5f-1569d738ee2c triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:19:35.414726 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:35.492849 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:35.519979 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4d9e66f9-6296-4074-98f6-406349170f9c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd76a27c9-41e9-47a1-9b5f-1569d738ee2c'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:19:35.522348 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3c234151-0b0a-44f9-babb-529a42a35d80" -d '{"events": [{"server_uuid": "4d9e66f9-6296-4074-98f6-406349170f9c", "name": "network-vif-plugged", "status": "completed", "tag": "d76a27c9-41e9-47a1-9b5f-1569d738ee2c"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:19:35.534935 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port d76a27c9-41e9-47a1-9b5f-1569d738ee2c, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=d76a27c9-41e9-47a1-9b5f-1569d738ee2c,segment=NetworkSegment(00089427-5063-4156-b8c3-e09f3fd9ab49),segment_id=00089427-5063-4156-b8c3-e09f3fd9ab49)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:19:35.540149 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:35.565551 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:19:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1af660bf-b1ad-48a8-875b-32a444708b2a x-openstack-request-id: req-1af660bf-b1ad-48a8-875b-32a444708b2a {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:19:35.565842 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4d9e66f9-6296-4074-98f6-406349170f9c", "name": "network-vif-plugged", "status": "completed", "tag": "d76a27c9-41e9-47a1-9b5f-1569d738ee2c", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:19:35.566096 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-1af660bf-b1ad-48a8-875b-32a444708b2a {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:19:35.566484 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4d9e66f9-6296-4074-98f6-406349170f9c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd76a27c9-41e9-47a1-9b5f-1569d738ee2c', 'code': 200} Dec 09 22:19:35.589603 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=d76a27c9-41e9-47a1-9b5f-1569d738ee2c,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:19:35.657198 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6f1b3048-13e1-4b64-8fcb-c66eca573a0d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:35.664482 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14a08da4-f79b-417c-a21a-cb7204608571 req-bfbbe6c0-99cd-49f0-9880-c8b0ad6a5688 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:35.666148 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14a08da4-f79b-417c-a21a-cb7204608571 req-bfbbe6c0-99cd-49f0-9880-c8b0ad6a5688 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=4d9e66f9-6296-4074-98f6-406349170f9c HTTP/1.1" status: 200 len: 1098 time: 0.0423999 Dec 09 22:19:35.710771 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-14a08da4-f79b-417c-a21a-cb7204608571 req-66d83795-51ff-49d0-809a-1fda2c5bffc9 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=da2e1ee4-0b58-4224-a5d1-3ded9521a53d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0380840 Dec 09 22:19:35.769239 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e5448af-3fbf-4c71-9eb1-d53ce8d7236a req-666b711e-0e07-42ae-a4a1-a20dd52b3e20 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:35.770716 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e5448af-3fbf-4c71-9eb1-d53ce8d7236a req-666b711e-0e07-42ae-a4a1-a20dd52b3e20 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=4d9e66f9-6296-4074-98f6-406349170f9c HTTP/1.1" status: 200 len: 946 time: 0.0521178 Dec 09 22:19:35.819368 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3e5448af-3fbf-4c71-9eb1-d53ce8d7236a req-666e865c-0f8f-4c15-b5bd-ef3eae546f95 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/security-groups?id=da2e1ee4-0b58-4224-a5d1-3ded9521a53d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420341 Dec 09 22:19:36.848188 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:36.944664 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cb53a21-faca-4e96-aef5-d17ab9bbc254 req-d619fb10-3c8d-475b-b768-9c578ad4c03e tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:36.946455 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4cb53a21-faca-4e96-aef5-d17ab9bbc254 req-d619fb10-3c8d-475b-b768-9c578ad4c03e tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=4d9e66f9-6296-4074-98f6-406349170f9c HTTP/1.1" status: 200 len: 946 time: 0.0555024 Dec 09 22:19:36.999128 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4cb53a21-faca-4e96-aef5-d17ab9bbc254 req-3fac5565-2ac3-4c4d-b514-c80b67de3a96 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/security-groups?id=da2e1ee4-0b58-4224-a5d1-3ded9521a53d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436161 Dec 09 22:19:37.121806 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e5cfd29-e298-420f-95de-1510f62ab293 req-7bf17a02-4acf-4140-89a5-cea542f962a4 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:37.123195 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e5cfd29-e298-420f-95de-1510f62ab293 req-7bf17a02-4acf-4140-89a5-cea542f962a4 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=4d9e66f9-6296-4074-98f6-406349170f9c HTTP/1.1" status: 200 len: 946 time: 0.0537608 Dec 09 22:19:37.169832 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e5cfd29-e298-420f-95de-1510f62ab293 req-f7cd5b8e-e20b-4f45-bcb9-a09159bca918 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/security-groups?id=da2e1ee4-0b58-4224-a5d1-3ded9521a53d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404654 Dec 09 22:19:38.193007 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:39.692620 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:57.645585 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:57.763825 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:19:59.815944 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4709e170-254e-4829-b68c-d5d201019fdf req-762860e3-b96e-41be-bfc6-75ceca776756 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:19:59.817512 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4709e170-254e-4829-b68c-d5d201019fdf req-762860e3-b96e-41be-bfc6-75ceca776756 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=4d9e66f9-6296-4074-98f6-406349170f9c HTTP/1.1" status: 200 len: 946 time: 0.0504284 Dec 09 22:19:59.867658 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4709e170-254e-4829-b68c-d5d201019fdf req-56969ada-535a-4350-81cd-f6593132e1db tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/security-groups?id=da2e1ee4-0b58-4224-a5d1-3ded9521a53d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433779 Dec 09 22:20:00.995057 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8d7a735-d935-4544-9a76-118236f09f61 req-1c12f61b-5a32-41dc-ad42-abe2e7fb78af tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:00.996608 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8d7a735-d935-4544-9a76-118236f09f61 req-1c12f61b-5a32-41dc-ad42-abe2e7fb78af tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=4d9e66f9-6296-4074-98f6-406349170f9c HTTP/1.1" status: 200 len: 946 time: 0.0560565 Dec 09 22:20:01.048116 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f8d7a735-d935-4544-9a76-118236f09f61 req-7f7fc5d8-c318-41f4-bade-fe828d66201c tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/security-groups?id=da2e1ee4-0b58-4224-a5d1-3ded9521a53d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452299 Dec 09 22:20:01.317038 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c9d8dc5-d442-4669-b55f-1608b2364c19 req-dd70b2ea-ebff-488e-8543-a716673dff58 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:01.318496 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8c9d8dc5-d442-4669-b55f-1608b2364c19 req-dd70b2ea-ebff-488e-8543-a716673dff58 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.31 "GET /v2.0/ports?device_id=4d9e66f9-6296-4074-98f6-406349170f9c HTTP/1.1" status: 200 len: 946 time: 0.0561035 Dec 09 22:20:01.425071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-8c9d8dc5-d442-4669-b55f-1608b2364c19 req-fee3d064-5eeb-44ef-b7b8-ab3024a527e0 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Deleting port d76a27c9-41e9-47a1-9b5f-1569d738ee2c {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:20:01.425503 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8c9d8dc5-d442-4669-b55f-1608b2364c19 req-fee3d064-5eeb-44ef-b7b8-ab3024a527e0 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:01.520026 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-8c9d8dc5-d442-4669-b55f-1608b2364c19 req-fee3d064-5eeb-44ef-b7b8-ab3024a527e0 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] For port d76a27c9-41e9-47a1-9b5f-1569d738ee2c, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=d76a27c9-41e9-47a1-9b5f-1569d738ee2c,segment=NetworkSegment(00089427-5063-4156-b8c3-e09f3fd9ab49),segment_id=00089427-5063-4156-b8c3-e09f3fd9ab49)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:20:01.520386 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8c9d8dc5-d442-4669-b55f-1608b2364c19 req-fee3d064-5eeb-44ef-b7b8-ab3024a527e0 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:01.533281 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-8c9d8dc5-d442-4669-b55f-1608b2364c19 req-fee3d064-5eeb-44ef-b7b8-ab3024a527e0 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Calling delete_port for d76a27c9-41e9-47a1-9b5f-1569d738ee2c owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:20:01.677100 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8c9d8dc5-d442-4669-b55f-1608b2364c19 req-fee3d064-5eeb-44ef-b7b8-ab3024a527e0 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:01.689572 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['d76a27c9-41e9-47a1-9b5f-1569d738ee2c'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:20:01.712342 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fee3d064-5eeb-44ef-b7b8-ab3024a527e0 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Pushing event deleted for resources: {'Port': ['ID=d76a27c9-41e9-47a1-9b5f-1569d738ee2c,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:01.753238 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-8c9d8dc5-d442-4669-b55f-1608b2364c19 req-fee3d064-5eeb-44ef-b7b8-ab3024a527e0 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] No DVR routers for this DVR port d76a27c9-41e9-47a1-9b5f-1569d738ee2c on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:20:01.756126 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-8c9d8dc5-d442-4669-b55f-1608b2364c19 req-fee3d064-5eeb-44ef-b7b8-ab3024a527e0 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:01.759576 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8c9d8dc5-d442-4669-b55f-1608b2364c19 req-fee3d064-5eeb-44ef-b7b8-ab3024a527e0 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.31 "DELETE /v2.0/ports/d76a27c9-41e9-47a1-9b5f-1569d738ee2c HTTP/1.1" status: 204 len: 173 time: 0.4346430 Dec 09 22:20:01.760028 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4d9e66f9-6296-4074-98f6-406349170f9c', 'name': 'network-vif-deleted', 'tag': 'd76a27c9-41e9-47a1-9b5f-1569d738ee2c'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:20:01.762767 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-73befdde-3865-45fd-b70c-a07873d8021e" -d '{"events": [{"server_uuid": "4d9e66f9-6296-4074-98f6-406349170f9c", "name": "network-vif-deleted", "tag": "d76a27c9-41e9-47a1-9b5f-1569d738ee2c"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:20:01.806328 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:20:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f9dfa3ac-a884-42eb-be3f-bf12b5e14f7c x-openstack-request-id: req-f9dfa3ac-a884-42eb-be3f-bf12b5e14f7c {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:20:01.806616 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4d9e66f9-6296-4074-98f6-406349170f9c", "name": "network-vif-deleted", "tag": "d76a27c9-41e9-47a1-9b5f-1569d738ee2c", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:20:01.806893 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f9dfa3ac-a884-42eb-be3f-bf12b5e14f7c {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:20:01.807316 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4d9e66f9-6296-4074-98f6-406349170f9c', 'name': 'network-vif-deleted', 'tag': 'd76a27c9-41e9-47a1-9b5f-1569d738ee2c', 'status': 'completed', 'code': 200} Dec 09 22:20:02.177369 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6c7e78b8-efd1-4dff-bbc3-ba48f5840de0 req-abeba11d-d0aa-4dd0-8494-207e61632731 tempest-TestEncryptedCinderVolumes-1800152408 tempest-TestEncryptedCinderVolumes-1800152408-project] 10.222.0.13 "GET /v2.0/ports?device_id=4d9e66f9-6296-4074-98f6-406349170f9c HTTP/1.1" status: 200 len: 210 time: 0.0288453 Dec 09 22:20:03.031275 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8ddba943-b423-4a33-ad78-5753ec448c0d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:03.277862 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33388) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:20:03.934994 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:04.186236 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] Deleting port a181fcf9-4253-4c4f-8db7-450a384fdaa0 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:20:04.186584 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:04.264996 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] For port a181fcf9-4253-4c4f-8db7-450a384fdaa0, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a181fcf9-4253-4c4f-8db7-450a384fdaa0,segment=NetworkSegment(00089427-5063-4156-b8c3-e09f3fd9ab49),segment_id=00089427-5063-4156-b8c3-e09f3fd9ab49)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:20:04.265357 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:04.277580 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] Calling delete_port for a181fcf9-4253-4c4f-8db7-450a384fdaa0 owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:20:04.492967 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:04.517981 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] Pushing event deleted for resources: {'Port': ['ID=a181fcf9-4253-4c4f-8db7-450a384fdaa0,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:04.532071 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:04.532393 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:04.532722 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:04.533069 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:04.533407 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:04.533733 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:04.534058 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:04.534380 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:04.534699 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:04.534996 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:04.535335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:04.535677 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:04.535997 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:04.699238 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:04.920707 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] Router 338d76a7-f43b-4adb-b0a7-9d17e1367513 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:20:05.033115 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:20:05.039977 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-dd764bd9-679b-409b-9a14-f98ddb790c9f admin admin] 10.222.0.13 "PUT /v2.0/routers/338d76a7-f43b-4adb-b0a7-9d17e1367513/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7593691 Dec 09 22:20:05.041258 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33390) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:20:05.044386 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-700f1c3b-ffef-4394-9d43-76ec085ed2b2 None None] Sync routers for ids ['338d76a7-f43b-4adb-b0a7-9d17e1367513'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:20:05.056032 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-700f1c3b-ffef-4394-9d43-76ec085ed2b2 None None] Routers {'338d76a7-f43b-4adb-b0a7-9d17e1367513'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:20:05.056848 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-700f1c3b-ffef-4394-9d43-76ec085ed2b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:19:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['338d76a7-f43b-4adb-b0a7-9d17e1367513'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:05.144584 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68b7b00a-f1b6-409c-9432-66fb8e51c582 admin admin] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:05.162407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-700f1c3b-ffef-4394-9d43-76ec085ed2b2 None None] Set router 338d76a7-f43b-4adb-b0a7-9d17e1367513 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:20:05.249555 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68b7b00a-f1b6-409c-9432-66fb8e51c582 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:05.304537 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-68b7b00a-f1b6-409c-9432-66fb8e51c582 admin admin] Deleting port 82ddfea0-1142-4558-85d2-db322e9f25cf {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:20:05.304889 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68b7b00a-f1b6-409c-9432-66fb8e51c582 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:05.340636 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-700f1c3b-ffef-4394-9d43-76ec085ed2b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '338d76a7-f43b-4adb-b0a7-9d17e1367513', 'name': 'tempest-TestEncryptedCinderVolumes-1814699298-router', 'tenant_id': 'fe6fc091d42140bf80daf7c889de205d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.113'}], 'enable_snat': True}, 'gw_port_id': '82ddfea0-1142-4558-85d2-db322e9f25cf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:18:41Z', 'updated_at': '2021-12-09T22:20:04Z', 'revision_number': 5, 'project_id': 'fe6fc091d42140bf80daf7c889de205d', 'gw_port': {'id': '82ddfea0-1142-4558-85d2-db322e9f25cf', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:dd:06:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '338d76a7-f43b-4adb-b0a7-9d17e1367513', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4146, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.113', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:18:42Z', 'updated_at': '2021-12-09T22:18:45Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:05.371995 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-700f1c3b-ffef-4394-9d43-76ec085ed2b2 None None] Checking router: 338d76a7-f43b-4adb-b0a7-9d17e1367513 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:20:05.380778 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-700f1c3b-ffef-4394-9d43-76ec085ed2b2 None None] Routers {'338d76a7-f43b-4adb-b0a7-9d17e1367513'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:20:05.381375 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-700f1c3b-ffef-4394-9d43-76ec085ed2b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:19:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['338d76a7-f43b-4adb-b0a7-9d17e1367513'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:05.387854 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-68b7b00a-f1b6-409c-9432-66fb8e51c582 admin admin] For port 82ddfea0-1142-4558-85d2-db322e9f25cf, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=82ddfea0-1142-4558-85d2-db322e9f25cf,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:20:05.388214 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68b7b00a-f1b6-409c-9432-66fb8e51c582 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:05.400240 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-68b7b00a-f1b6-409c-9432-66fb8e51c582 admin admin] Calling delete_port for 82ddfea0-1142-4558-85d2-db322e9f25cf owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:20:05.463730 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device d76a27c9-41e9-47a1-9b5f-1569d738ee2c no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:20:05.490789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-700f1c3b-ffef-4394-9d43-76ec085ed2b2 None None] Set router 338d76a7-f43b-4adb-b0a7-9d17e1367513 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:20:05.492616 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: d76a27c9-41e9-47a1-9b5f-1569d738ee2c {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:20:05.492976 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device d76a27c9-41e9-47a1-9b5f-1569d738ee2c not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:20:05.550671 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-700f1c3b-ffef-4394-9d43-76ec085ed2b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '338d76a7-f43b-4adb-b0a7-9d17e1367513', 'name': 'tempest-TestEncryptedCinderVolumes-1814699298-router', 'tenant_id': 'fe6fc091d42140bf80daf7c889de205d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:18:41Z', 'updated_at': '2021-12-09T22:20:05Z', 'revision_number': 6, 'project_id': 'fe6fc091d42140bf80daf7c889de205d', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:05.569216 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68b7b00a-f1b6-409c-9432-66fb8e51c582 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:05.581882 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-700f1c3b-ffef-4394-9d43-76ec085ed2b2 None None] The sync data for ids ['338d76a7-f43b-4adb-b0a7-9d17e1367513'] in n-d-713301-27 is: [{'id': '338d76a7-f43b-4adb-b0a7-9d17e1367513', 'name': 'tempest-TestEncryptedCinderVolumes-1814699298-router', 'tenant_id': 'fe6fc091d42140bf80daf7c889de205d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:18:41Z', 'updated_at': '2021-12-09T22:20:05Z', 'revision_number': 6, 'project_id': 'fe6fc091d42140bf80daf7c889de205d', 'gw_port_host': None}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:20:05.595575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68b7b00a-f1b6-409c-9432-66fb8e51c582 admin admin] Pushing event deleted for resources: {'Port': ['ID=82ddfea0-1142-4558-85d2-db322e9f25cf,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:05.614147 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37cd74a9-7cc3-4ca7-8f49-cf19688dd0d4 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:20:05.659358 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-21eb5c07-0c06-4b0c-be69-374965191dd7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:05.662173 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68b7b00a-f1b6-409c-9432-66fb8e51c582 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:05.752053 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68b7b00a-f1b6-409c-9432-66fb8e51c582 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:05.754213 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68b7b00a-f1b6-409c-9432-66fb8e51c582 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:05.802538 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68b7b00a-f1b6-409c-9432-66fb8e51c582 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:05.803278 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-68b7b00a-f1b6-409c-9432-66fb8e51c582 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 338d76a7-f43b-4adb-b0a7-9d17e1367513 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 22:20:05.808097 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68b7b00a-f1b6-409c-9432-66fb8e51c582 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:05.809267 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-68b7b00a-f1b6-409c-9432-66fb8e51c582 admin admin] 10.222.0.13 "DELETE /v2.0/routers/338d76a7-f43b-4adb-b0a7-9d17e1367513 HTTP/1.1" status: 204 len: 168 time: 0.7670920 Dec 09 22:20:05.812100 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33394) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:20:05.857981 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-8abaa8ab-f8f8-40b3-867c-5dab3fa7c572 admin admin] Deleting subnet 2514586e-123f-4e2a-91a9-d8f14bd6e8d4 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:20:05.861462 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8abaa8ab-f8f8-40b3-867c-5dab3fa7c572 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:05.896551 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8abaa8ab-f8f8-40b3-867c-5dab3fa7c572 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:05.982020 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8abaa8ab-f8f8-40b3-867c-5dab3fa7c572 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:06.037705 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8abaa8ab-f8f8-40b3-867c-5dab3fa7c572 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:06.065092 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8abaa8ab-f8f8-40b3-867c-5dab3fa7c572 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2514586e-123f-4e2a-91a9-d8f14bd6e8d4,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:06.067066 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8abaa8ab-f8f8-40b3-867c-5dab3fa7c572 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:06.070750 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8abaa8ab-f8f8-40b3-867c-5dab3fa7c572 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/2514586e-123f-4e2a-91a9-d8f14bd6e8d4 HTTP/1.1" status: 204 len: 168 time: 0.2576308 Dec 09 22:20:06.071698 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-78b1098d-ca03-4486-9839-fc21a40d2d13 None None] Network f26b9f47-9dd3-4ccc-8f56-670f8249a431 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:20:06.073265 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33396) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:20:06.144736 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99ed2e14-47da-4c2a-abf3-ac88ddf73fd2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:06.199034 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-99ed2e14-47da-4c2a-abf3-ac88ddf73fd2 admin admin] Deleting port d9478d61-9b43-4595-b182-b3ff840eb518 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:20:06.199374 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99ed2e14-47da-4c2a-abf3-ac88ddf73fd2 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:06.260761 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-99ed2e14-47da-4c2a-abf3-ac88ddf73fd2 admin admin] For port d9478d61-9b43-4595-b182-b3ff840eb518, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d9478d61-9b43-4595-b182-b3ff840eb518,segment=NetworkSegment(00089427-5063-4156-b8c3-e09f3fd9ab49),segment_id=00089427-5063-4156-b8c3-e09f3fd9ab49)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:20:06.261113 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99ed2e14-47da-4c2a-abf3-ac88ddf73fd2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:06.273669 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-99ed2e14-47da-4c2a-abf3-ac88ddf73fd2 admin admin] Calling delete_port for d9478d61-9b43-4595-b182-b3ff840eb518 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:20:06.360967 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99ed2e14-47da-4c2a-abf3-ac88ddf73fd2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:06.380412 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf35071f-e256-4f14-a7e4-57685a1a84e1 None None] DHCP port deletion for f26b9f47-9dd3-4ccc-8f56-670f8249a431 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:20:06.391279 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99ed2e14-47da-4c2a-abf3-ac88ddf73fd2 admin admin] Pushing event deleted for resources: {'Port': ['ID=d9478d61-9b43-4595-b182-b3ff840eb518,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:06.404117 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99ed2e14-47da-4c2a-abf3-ac88ddf73fd2 admin admin] No DVR routers for this DVR port d9478d61-9b43-4595-b182-b3ff840eb518 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:20:06.448560 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d9478d61-9b43-4595-b182-b3ff840eb518 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:20:06.470357 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: d9478d61-9b43-4595-b182-b3ff840eb518 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:20:06.470668 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d9478d61-9b43-4595-b182-b3ff840eb518 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:20:06.471288 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a181fcf9-4253-4c4f-8db7-450a384fdaa0 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:20:06.486814 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99ed2e14-47da-4c2a-abf3-ac88ddf73fd2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:06.492621 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: a181fcf9-4253-4c4f-8db7-450a384fdaa0 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:20:06.492969 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a181fcf9-4253-4c4f-8db7-450a384fdaa0 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:20:06.493374 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 82ddfea0-1142-4558-85d2-db322e9f25cf no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:20:06.508433 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-99ed2e14-47da-4c2a-abf3-ac88ddf73fd2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f26b9f47-9dd3-4ccc-8f56-670f8249a431']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:06.513522 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 82ddfea0-1142-4558-85d2-db322e9f25cf {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:20:06.513868 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 82ddfea0-1142-4558-85d2-db322e9f25cf not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:20:06.518365 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-99ed2e14-47da-4c2a-abf3-ac88ddf73fd2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '00089427-5063-4156-b8c3-e09f3fd9ab49') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:06.518668 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-99ed2e14-47da-4c2a-abf3-ac88ddf73fd2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '00089427-5063-4156-b8c3-e09f3fd9ab49') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:06.529186 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99ed2e14-47da-4c2a-abf3-ac88ddf73fd2 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:06.543554 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99ed2e14-47da-4c2a-abf3-ac88ddf73fd2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:06.549806 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-99ed2e14-47da-4c2a-abf3-ac88ddf73fd2 admin admin] Releasing vlan 100 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:20:06.550194 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99ed2e14-47da-4c2a-abf3-ac88ddf73fd2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: timer() Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:20:06.552024 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:20:06.609676 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99ed2e14-47da-4c2a-abf3-ac88ddf73fd2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:06.615535 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99ed2e14-47da-4c2a-abf3-ac88ddf73fd2 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:06.619884 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-99ed2e14-47da-4c2a-abf3-ac88ddf73fd2 admin admin] 10.222.0.13 "DELETE /v2.0/networks/f26b9f47-9dd3-4ccc-8f56-670f8249a431 HTTP/1.1" status: 204 len: 168 time: 0.5455995 Dec 09 22:20:06.621655 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33398) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:20:06.638062 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99ed2e14-47da-4c2a-abf3-ac88ddf73fd2 admin admin] Pushing event deleted for resources: {'Network': ['ID=f26b9f47-9dd3-4ccc-8f56-670f8249a431,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:06.859006 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:06.993922 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-500169fc-d83e-4f69-9cb5-f9c75a081060 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:07.243334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-500169fc-d83e-4f69-9cb5-f9c75a081060 admin admin] Deleting port 84fcf019-d7fd-4b96-8e12-451d97ecaad2 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:20:07.244192 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-500169fc-d83e-4f69-9cb5-f9c75a081060 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:07.321822 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-500169fc-d83e-4f69-9cb5-f9c75a081060 admin admin] For port 84fcf019-d7fd-4b96-8e12-451d97ecaad2, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=84fcf019-d7fd-4b96-8e12-451d97ecaad2,segment=NetworkSegment(8b832101-6531-45f1-b542-347ffd458962),segment_id=8b832101-6531-45f1-b542-347ffd458962)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:20:07.322196 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-500169fc-d83e-4f69-9cb5-f9c75a081060 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:07.334697 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-500169fc-d83e-4f69-9cb5-f9c75a081060 admin admin] Calling delete_port for 84fcf019-d7fd-4b96-8e12-451d97ecaad2 owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:20:07.526625 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-500169fc-d83e-4f69-9cb5-f9c75a081060 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:07.557277 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-500169fc-d83e-4f69-9cb5-f9c75a081060 admin admin] Pushing event deleted for resources: {'Port': ['ID=84fcf019-d7fd-4b96-8e12-451d97ecaad2,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:07.730239 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-500169fc-d83e-4f69-9cb5-f9c75a081060 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:08.194268 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:08.280371 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-500169fc-d83e-4f69-9cb5-f9c75a081060 admin admin] Router 3cd11f5c-66e8-454c-95b6-1677f0b7bcfb has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:20:08.301605 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:20:08.385954 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-500169fc-d83e-4f69-9cb5-f9c75a081060 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:20:08.391625 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-500169fc-d83e-4f69-9cb5-f9c75a081060 admin admin] 10.222.0.13 "PUT /v2.0/routers/3cd11f5c-66e8-454c-95b6-1677f0b7bcfb/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7689071 Dec 09 22:20:08.394382 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33400) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:20:08.395885 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fae3a8cf-3f98-474f-8d80-a923bc8fd78d None None] Sync routers for ids ['3cd11f5c-66e8-454c-95b6-1677f0b7bcfb'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:20:08.407485 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fae3a8cf-3f98-474f-8d80-a923bc8fd78d None None] Routers {'3cd11f5c-66e8-454c-95b6-1677f0b7bcfb'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:20:08.408116 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-fae3a8cf-3f98-474f-8d80-a923bc8fd78d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:20:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3cd11f5c-66e8-454c-95b6-1677f0b7bcfb'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:08.501911 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-be178c59-0d24-4222-8c8e-1fa86a03c7cd admin admin] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:08.513730 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-fae3a8cf-3f98-474f-8d80-a923bc8fd78d None None] Set router 3cd11f5c-66e8-454c-95b6-1677f0b7bcfb gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:20:08.604021 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-be178c59-0d24-4222-8c8e-1fa86a03c7cd admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:08.665179 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-be178c59-0d24-4222-8c8e-1fa86a03c7cd admin admin] Deleting port a70d4b06-1397-437d-a6de-a8fe713c2995 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:20:08.665587 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-be178c59-0d24-4222-8c8e-1fa86a03c7cd admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:08.744655 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-be178c59-0d24-4222-8c8e-1fa86a03c7cd admin admin] For port a70d4b06-1397-437d-a6de-a8fe713c2995, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=a70d4b06-1397-437d-a6de-a8fe713c2995,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:20:08.745380 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-be178c59-0d24-4222-8c8e-1fa86a03c7cd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:08.758025 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-be178c59-0d24-4222-8c8e-1fa86a03c7cd admin admin] Calling delete_port for a70d4b06-1397-437d-a6de-a8fe713c2995 owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:20:08.789738 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-fae3a8cf-3f98-474f-8d80-a923bc8fd78d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3cd11f5c-66e8-454c-95b6-1677f0b7bcfb', 'name': 'tempest-TestEncryptedCinderVolumes-69255544-router', 'tenant_id': '4d10a76d507b4127af04417b615f1fe1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44'}], 'enable_snat': True}, 'gw_port_id': 'a70d4b06-1397-437d-a6de-a8fe713c2995', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:18:46Z', 'updated_at': '2021-12-09T22:20:07Z', 'revision_number': 5, 'project_id': '4d10a76d507b4127af04417b615f1fe1', 'gw_port': {'id': 'a70d4b06-1397-437d-a6de-a8fe713c2995', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:26:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3cd11f5c-66e8-454c-95b6-1677f0b7bcfb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4158, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.44', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:18:47Z', 'updated_at': '2021-12-09T22:18:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:08.816680 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fae3a8cf-3f98-474f-8d80-a923bc8fd78d None None] Checking router: 3cd11f5c-66e8-454c-95b6-1677f0b7bcfb for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:20:08.826306 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fae3a8cf-3f98-474f-8d80-a923bc8fd78d None None] Routers {'3cd11f5c-66e8-454c-95b6-1677f0b7bcfb'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:20:08.827028 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-fae3a8cf-3f98-474f-8d80-a923bc8fd78d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:20:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['3cd11f5c-66e8-454c-95b6-1677f0b7bcfb'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:08.916335 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-fae3a8cf-3f98-474f-8d80-a923bc8fd78d None None] Set router 3cd11f5c-66e8-454c-95b6-1677f0b7bcfb gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:20:08.927192 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-be178c59-0d24-4222-8c8e-1fa86a03c7cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:08.956151 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be178c59-0d24-4222-8c8e-1fa86a03c7cd admin admin] Pushing event deleted for resources: {'Port': ['ID=a70d4b06-1397-437d-a6de-a8fe713c2995,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:08.972269 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc546c6f-839f-4219-86ae-8b5afe4c7175 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:20:08.974093 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-fae3a8cf-3f98-474f-8d80-a923bc8fd78d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3cd11f5c-66e8-454c-95b6-1677f0b7bcfb', 'name': 'tempest-TestEncryptedCinderVolumes-69255544-router', 'tenant_id': '4d10a76d507b4127af04417b615f1fe1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:18:46Z', 'updated_at': '2021-12-09T22:20:08Z', 'revision_number': 6, 'project_id': '4d10a76d507b4127af04417b615f1fe1', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:09.001597 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fae3a8cf-3f98-474f-8d80-a923bc8fd78d None None] The sync data for ids ['3cd11f5c-66e8-454c-95b6-1677f0b7bcfb'] in n-d-713301-27 is: [{'id': '3cd11f5c-66e8-454c-95b6-1677f0b7bcfb', 'name': 'tempest-TestEncryptedCinderVolumes-69255544-router', 'tenant_id': '4d10a76d507b4127af04417b615f1fe1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:18:46Z', 'updated_at': '2021-12-09T22:20:08Z', 'revision_number': 6, 'project_id': '4d10a76d507b4127af04417b615f1fe1', 'gw_port_host': None}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:20:09.021725 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-be178c59-0d24-4222-8c8e-1fa86a03c7cd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:09.117790 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-be178c59-0d24-4222-8c8e-1fa86a03c7cd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:09.120125 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-be178c59-0d24-4222-8c8e-1fa86a03c7cd admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:09.169261 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-be178c59-0d24-4222-8c8e-1fa86a03c7cd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:09.169684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-be178c59-0d24-4222-8c8e-1fa86a03c7cd admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3cd11f5c-66e8-454c-95b6-1677f0b7bcfb {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 22:20:09.174017 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-be178c59-0d24-4222-8c8e-1fa86a03c7cd admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:09.175205 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-be178c59-0d24-4222-8c8e-1fa86a03c7cd admin admin] 10.222.0.13 "DELETE /v2.0/routers/3cd11f5c-66e8-454c-95b6-1677f0b7bcfb HTTP/1.1" status: 204 len: 168 time: 0.7797391 Dec 09 22:20:09.177808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33402) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:20:09.224783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-afa27647-a9c8-4cd0-825a-dab056e4ba34 admin admin] Deleting subnet 61a415d1-4ccc-466f-97dc-3ec10f093da5 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:20:09.229277 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-afa27647-a9c8-4cd0-825a-dab056e4ba34 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:09.269871 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-afa27647-a9c8-4cd0-825a-dab056e4ba34 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:09.347167 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-afa27647-a9c8-4cd0-825a-dab056e4ba34 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:09.409655 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-afa27647-a9c8-4cd0-825a-dab056e4ba34 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:09.436073 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afa27647-a9c8-4cd0-825a-dab056e4ba34 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=61a415d1-4ccc-466f-97dc-3ec10f093da5,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:09.440083 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-afa27647-a9c8-4cd0-825a-dab056e4ba34 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:09.446069 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-afa27647-a9c8-4cd0-825a-dab056e4ba34 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/61a415d1-4ccc-466f-97dc-3ec10f093da5 HTTP/1.1" status: 204 len: 168 time: 0.2644660 Dec 09 22:20:09.446069 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33404) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:20:09.448498 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-768a176a-f68e-42b9-87b2-142d3275d571 None None] Network 92b047ee-0ea4-4eb3-9ba4-67718510564e requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:20:09.523871 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5c0c3631-c2e6-4719-970e-7efda812607b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:09.576096 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-5c0c3631-c2e6-4719-970e-7efda812607b admin admin] Deleting port 5c97f1ad-ec73-41c5-93c0-2b8b173b6f26 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:20:09.576430 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5c0c3631-c2e6-4719-970e-7efda812607b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:09.644210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-5c0c3631-c2e6-4719-970e-7efda812607b admin admin] For port 5c97f1ad-ec73-41c5-93c0-2b8b173b6f26, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5c97f1ad-ec73-41c5-93c0-2b8b173b6f26,segment=NetworkSegment(8b832101-6531-45f1-b542-347ffd458962),segment_id=8b832101-6531-45f1-b542-347ffd458962)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:20:09.644630 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5c0c3631-c2e6-4719-970e-7efda812607b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:09.658028 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-5c0c3631-c2e6-4719-970e-7efda812607b admin admin] Calling delete_port for 5c97f1ad-ec73-41c5-93c0-2b8b173b6f26 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:20:09.688779 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:09.748218 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5c0c3631-c2e6-4719-970e-7efda812607b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:09.772674 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e885e5bc-50dc-4c87-94f3-942a765fa087 None None] DHCP port deletion for 92b047ee-0ea4-4eb3-9ba4-67718510564e request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:20:09.782382 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c0c3631-c2e6-4719-970e-7efda812607b admin admin] Pushing event deleted for resources: {'Port': ['ID=5c97f1ad-ec73-41c5-93c0-2b8b173b6f26,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:09.787835 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c0c3631-c2e6-4719-970e-7efda812607b admin admin] No DVR routers for this DVR port 5c97f1ad-ec73-41c5-93c0-2b8b173b6f26 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:20:09.861313 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5c0c3631-c2e6-4719-970e-7efda812607b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:09.883765 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-5c0c3631-c2e6-4719-970e-7efda812607b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['92b047ee-0ea4-4eb3-9ba4-67718510564e']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:09.894981 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-5c0c3631-c2e6-4719-970e-7efda812607b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8b832101-6531-45f1-b542-347ffd458962') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:09.895413 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-5c0c3631-c2e6-4719-970e-7efda812607b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8b832101-6531-45f1-b542-347ffd458962') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:09.904995 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5c0c3631-c2e6-4719-970e-7efda812607b admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:09.918585 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5c0c3631-c2e6-4719-970e-7efda812607b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:09.925085 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5c0c3631-c2e6-4719-970e-7efda812607b admin admin] Releasing vlan 103 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:20:09.925466 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5c0c3631-c2e6-4719-970e-7efda812607b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: timer() Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:20:09.927146 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:20:09.989305 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5c0c3631-c2e6-4719-970e-7efda812607b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:09.995554 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5c0c3631-c2e6-4719-970e-7efda812607b admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:09.998643 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5c0c3631-c2e6-4719-970e-7efda812607b admin admin] 10.222.0.13 "DELETE /v2.0/networks/92b047ee-0ea4-4eb3-9ba4-67718510564e HTTP/1.1" status: 204 len: 168 time: 0.5518293 Dec 09 22:20:10.010745 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c0c3631-c2e6-4719-970e-7efda812607b admin admin] Pushing event deleted for resources: {'Network': ['ID=92b047ee-0ea4-4eb3-9ba4-67718510564e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:10.194526 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a70d4b06-1397-437d-a6de-a8fe713c2995 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:20:10.198563 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33408) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:20:10.225545 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: a70d4b06-1397-437d-a6de-a8fe713c2995 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:20:10.225886 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device a70d4b06-1397-437d-a6de-a8fe713c2995 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:20:10.226295 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 84fcf019-d7fd-4b96-8e12-451d97ecaad2 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:20:10.243405 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5d5d1476-fdf9-4e8a-8bff-af84b50c5ca0 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=fe6fc091d42140bf80daf7c889de205d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0436482 Dec 09 22:20:10.246062 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33410) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:20:10.298798 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-31fcad62-9381-4456-bb00-66c795ba3cfb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:10.323326 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-31fcad62-9381-4456-bb00-66c795ba3cfb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:10.375855 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-31fcad62-9381-4456-bb00-66c795ba3cfb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:10.378485 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-31fcad62-9381-4456-bb00-66c795ba3cfb admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:10.379680 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-31fcad62-9381-4456-bb00-66c795ba3cfb admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/da2e1ee4-0b58-4224-a5d1-3ded9521a53d HTTP/1.1" status: 204 len: 168 time: 0.1326170 Dec 09 22:20:10.388473 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31fcad62-9381-4456-bb00-66c795ba3cfb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=da2e1ee4-0b58-4224-a5d1-3ded9521a53d,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:10.423567 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 84fcf019-d7fd-4b96-8e12-451d97ecaad2 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:20:10.423915 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 84fcf019-d7fd-4b96-8e12-451d97ecaad2 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:20:10.424333 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5c97f1ad-ec73-41c5-93c0-2b8b173b6f26 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:20:10.448722 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 5c97f1ad-ec73-41c5-93c0-2b8b173b6f26 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:20:10.449382 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5c97f1ad-ec73-41c5-93c0-2b8b173b6f26 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:20:10.740198 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33416) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:20:10.789216 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-aeff0b59-e058-4eae-a4fd-80054694b62d admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=4d10a76d507b4127af04417b615f1fe1&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0473475 Dec 09 22:20:10.792215 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33418) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:20:10.846727 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7db0f528-d6af-4291-a178-dda8033c7bc3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:10.869140 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7db0f528-d6af-4291-a178-dda8033c7bc3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:10.919743 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7db0f528-d6af-4291-a178-dda8033c7bc3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:10.922745 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7db0f528-d6af-4291-a178-dda8033c7bc3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:10.923940 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7db0f528-d6af-4291-a178-dda8033c7bc3 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/cc77703f-acc6-4a1b-8ff2-916dfd96eb9f HTTP/1.1" status: 204 len: 168 time: 0.1308129 Dec 09 22:20:10.931970 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7db0f528-d6af-4291-a178-dda8033c7bc3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cc77703f-acc6-4a1b-8ff2-916dfd96eb9f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:11.662022 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33440) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:20:11.790043 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-1b484611-bf19-4e97-948f-ae2cbb756d0c admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-304437312-network', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:20:11.813943 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1b484611-bf19-4e97-948f-ae2cbb756d0c admin admin] Made reservation on behalf of 70ca64a954a041f5899f38ba64cf0fe9 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:20:11.816286 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1b484611-bf19-4e97-948f-ae2cbb756d0c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:11.825119 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1b484611-bf19-4e97-948f-ae2cbb756d0c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:11.918769 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1b484611-bf19-4e97-948f-ae2cbb756d0c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:11.925017 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1b484611-bf19-4e97-948f-ae2cbb756d0c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:11.949383 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1b484611-bf19-4e97-948f-ae2cbb756d0c admin admin] vlan segment allocate from pool success with {'vlan_id': 111, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 22:20:11.958928 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b484611-bf19-4e97-948f-ae2cbb756d0c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6b184103-34f5-4d74-b063-cc970fc8b573,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:11.963752 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1b484611-bf19-4e97-948f-ae2cbb756d0c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:11.964095 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-1b484611-bf19-4e97-948f-ae2cbb756d0c admin admin] Added segment 16bdd335-351c-4e9d-bde1-07a4c99d195c of type vlan for network 20d197ac-b0d5-4136-851b-f803672ee9e2 Dec 09 22:20:12.007448 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1b484611-bf19-4e97-948f-ae2cbb756d0c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:12.034071 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1b484611-bf19-4e97-948f-ae2cbb756d0c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:12.034997 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1b484611-bf19-4e97-948f-ae2cbb756d0c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:12.035753 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1b484611-bf19-4e97-948f-ae2cbb756d0c admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:12.071849 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1b484611-bf19-4e97-948f-ae2cbb756d0c admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.4086814 Dec 09 22:20:12.074945 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33444) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:20:12.080652 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-7a06b070-ae57-4759-8e34-c4a81c710bed admin admin] Request body: {'subnet': {'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-304437312-subnet', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:20:12.101780 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b484611-bf19-4e97-948f-ae2cbb756d0c admin admin] Pushing event updated for resources: {'Network': ['ID=20d197ac-b0d5-4136-851b-f803672ee9e2,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:12.104066 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7a06b070-ae57-4759-8e34-c4a81c710bed admin admin] Made reservation on behalf of 70ca64a954a041f5899f38ba64cf0fe9 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:20:12.106521 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a06b070-ae57-4759-8e34-c4a81c710bed admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:12.112792 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 20d197ac-b0d5-4136-851b-f803672ee9e2 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 22:20:12.276420 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a06b070-ae57-4759-8e34-c4a81c710bed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:12.327965 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a06b070-ae57-4759-8e34-c4a81c710bed admin admin] Pushing event updated for resources: {'Subnet': ['ID=9016b68e-6021-4bdc-a7b1-be26d9de403a,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:12.338691 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a06b070-ae57-4759-8e34-c4a81c710bed admin admin] Checking segment: {'id': '16bdd335-351c-4e9d-bde1-07a4c99d195c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:20:12.339049 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a06b070-ae57-4759-8e34-c4a81c710bed admin admin] Network hostable DHCP agents. Network: 20d197ac-b0d5-4136-851b-f803672ee9e2, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 22:20:12.358069 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a06b070-ae57-4759-8e34-c4a81c710bed admin admin] Network 20d197ac-b0d5-4136-851b-f803672ee9e2 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 22:20:12.367834 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-7a06b070-ae57-4759-8e34-c4a81c710bed admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 20d197ac-b0d5-4136-851b-f803672ee9e2) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:20:12.371991 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7a06b070-ae57-4759-8e34-c4a81c710bed admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:12.372583 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a06b070-ae57-4759-8e34-c4a81c710bed admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:12.377276 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4fb54b15-06c7-4fbc-95dc-0408a1458532 None None] Network 20d197ac-b0d5-4136-851b-f803672ee9e2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:20:12.388678 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7a06b070-ae57-4759-8e34-c4a81c710bed admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.3119631 Dec 09 22:20:12.391399 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33446) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:20:12.395764 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ea43f40d-6c22-47b6-84f6-30511f7dd9e4 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-304437312-router', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:20:12.417076 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea43f40d-6c22-47b6-84f6-30511f7dd9e4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:12.418108 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea43f40d-6c22-47b6-84f6-30511f7dd9e4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:12.473631 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea43f40d-6c22-47b6-84f6-30511f7dd9e4 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:12.486560 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2617297c-69c7-4644-949a-f0dc425139ab None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-20d197ac-b0d5-4136-851b-f803672ee9e2', 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2', 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'fixed_ips': [{'subnet_id': '9016b68e-6021-4bdc-a7b1-be26d9de403a'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 22:20:12.487480 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2617297c-69c7-4644-949a-f0dc425139ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:12.612310 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea43f40d-6c22-47b6-84f6-30511f7dd9e4 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:12.623223 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-2617297c-69c7-4644-949a-f0dc425139ab None None] Allocated IP 172.20.0.2 (20d197ac-b0d5-4136-851b-f803672ee9e2/9016b68e-6021-4bdc-a7b1-be26d9de403a/d9add3f3-7bdd-4cdf-a092-eac2466765ed) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:20:12.769591 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2617297c-69c7-4644-949a-f0dc425139ab None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:12.776430 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2617297c-69c7-4644-949a-f0dc425139ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:12.817766 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2617297c-69c7-4644-949a-f0dc425139ab None None] Network 20d197ac-b0d5-4136-851b-f803672ee9e2 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:20:12.824118 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-2617297c-69c7-4644-949a-f0dc425139ab None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:20:12.826984 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2617297c-69c7-4644-949a-f0dc425139ab None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:20:12.832279 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea43f40d-6c22-47b6-84f6-30511f7dd9e4 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:12.838372 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2617297c-69c7-4644-949a-f0dc425139ab None None] Pushing event updated for resources: {'Port': ['ID=d9add3f3-7bdd-4cdf-a092-eac2466765ed,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:12.855532 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea43f40d-6c22-47b6-84f6-30511f7dd9e4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:12.888416 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2617297c-69c7-4644-949a-f0dc425139ab None None] Attempting to bind port d9add3f3-7bdd-4cdf-a092-eac2466765ed on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:20:12.888694 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2617297c-69c7-4644-949a-f0dc425139ab None None] Attempting to bind port d9add3f3-7bdd-4cdf-a092-eac2466765ed by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '16bdd335-351c-4e9d-bde1-07a4c99d195c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:20:12.889051 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2617297c-69c7-4644-949a-f0dc425139ab None None] Attempting to bind port d9add3f3-7bdd-4cdf-a092-eac2466765ed on network 20d197ac-b0d5-4136-851b-f803672ee9e2 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:20:12.894862 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2617297c-69c7-4644-949a-f0dc425139ab None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 20, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:20:12.895239 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2617297c-69c7-4644-949a-f0dc425139ab None None] Checking segment: {'id': '16bdd335-351c-4e9d-bde1-07a4c99d195c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:20:12.895666 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2617297c-69c7-4644-949a-f0dc425139ab None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:12.896056 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2617297c-69c7-4644-949a-f0dc425139ab None None] Bound using segment: {'id': '16bdd335-351c-4e9d-bde1-07a4c99d195c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:20:12.896516 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2617297c-69c7-4644-949a-f0dc425139ab None None] Bound port: d9add3f3-7bdd-4cdf-a092-eac2466765ed, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '16bdd335-351c-4e9d-bde1-07a4c99d195c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:20:12.896897 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2617297c-69c7-4644-949a-f0dc425139ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:12.956810 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-ea43f40d-6c22-47b6-84f6-30511f7dd9e4 admin admin] Allocated IP 172.25.3.228 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:20:12.959633 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2617297c-69c7-4644-949a-f0dc425139ab None None] For port d9add3f3-7bdd-4cdf-a092-eac2466765ed, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:20:12.962976 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2617297c-69c7-4644-949a-f0dc425139ab None None] For port d9add3f3-7bdd-4cdf-a092-eac2466765ed, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d9add3f3-7bdd-4cdf-a092-eac2466765ed,segment=NetworkSegment(16bdd335-351c-4e9d-bde1-07a4c99d195c),segment_id=16bdd335-351c-4e9d-bde1-07a4c99d195c)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:20:12.967754 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2617297c-69c7-4644-949a-f0dc425139ab None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:13.026859 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2617297c-69c7-4644-949a-f0dc425139ab None None] Pushing event updated for resources: {'Port': ['ID=d9add3f3-7bdd-4cdf-a092-eac2466765ed,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:13.451558 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea43f40d-6c22-47b6-84f6-30511f7dd9e4 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:13.491106 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea43f40d-6c22-47b6-84f6-30511f7dd9e4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:13.530889 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea43f40d-6c22-47b6-84f6-30511f7dd9e4 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:20:13.533787 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-ea43f40d-6c22-47b6-84f6-30511f7dd9e4 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:20:13.539366 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea43f40d-6c22-47b6-84f6-30511f7dd9e4 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:20:13.549471 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e06bca5c-87bd-483c-b170-564e19bbcdfb None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:20:13.565432 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea43f40d-6c22-47b6-84f6-30511f7dd9e4 admin admin] Pushing event updated for resources: {'Port': ['ID=5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:13.638672 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-83ec29c3-0397-49bf-8cf0-9efe4b719e19 None None] Provisioning complete for port 5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:13.639043 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-83ec29c3-0397-49bf-8cf0-9efe4b719e19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:13.682371 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-83ec29c3-0397-49bf-8cf0-9efe4b719e19 None None] Port 5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:20:13.806503 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea43f40d-6c22-47b6-84f6-30511f7dd9e4 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:13.916538 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f21c69ea-2a54-4942-aaac-76cd8a52ec29 None None] Network 20d197ac-b0d5-4136-851b-f803672ee9e2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:20:14.005125 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea43f40d-6c22-47b6-84f6-30511f7dd9e4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:14.029624 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d7fa01fc-4924-4a06-a8a0-69d04faad43f None None] Provisioning complete for port d9add3f3-7bdd-4cdf-a092-eac2466765ed triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:14.030000 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d7fa01fc-4924-4a06-a8a0-69d04faad43f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:14.118172 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d7fa01fc-4924-4a06-a8a0-69d04faad43f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:14.143120 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ea43f40d-6c22-47b6-84f6-30511f7dd9e4 admin admin] Router 24626fb7-c6a2-4824-af06-13284de6ee53 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 22:20:14.154186 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-d7fa01fc-4924-4a06-a8a0-69d04faad43f None None] For port d9add3f3-7bdd-4cdf-a092-eac2466765ed, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d9add3f3-7bdd-4cdf-a092-eac2466765ed,segment=NetworkSegment(16bdd335-351c-4e9d-bde1-07a4c99d195c),segment_id=16bdd335-351c-4e9d-bde1-07a4c99d195c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:20:14.166012 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d7fa01fc-4924-4a06-a8a0-69d04faad43f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:14.234229 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d9add3f3-7bdd-4cdf-a092-eac2466765ed up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:20:14.260317 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7fa01fc-4924-4a06-a8a0-69d04faad43f None None] Pushing event updated for resources: {'Port': ['ID=d9add3f3-7bdd-4cdf-a092-eac2466765ed,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:14.271996 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ea43f40d-6c22-47b6-84f6-30511f7dd9e4 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:20:14.284993 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] Sync routers for ids ['24626fb7-c6a2-4824-af06-13284de6ee53'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:20:14.294534 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ea43f40d-6c22-47b6-84f6-30511f7dd9e4 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:14.296283 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ea43f40d-6c22-47b6-84f6-30511f7dd9e4 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 1.9038541 Dec 09 22:20:14.299065 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33448) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:20:14.301686 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port d9add3f3-7bdd-4cdf-a092-eac2466765ed triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:14.302065 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:14.323528 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] Routers {'24626fb7-c6a2-4824-af06-13284de6ee53'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:20:14.324186 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:20:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['24626fb7-c6a2-4824-af06-13284de6ee53'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:14.442098 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c617a9d9-b6a1-404d-92aa-80c0a613ac9e None None] Provisioning complete for port d9add3f3-7bdd-4cdf-a092-eac2466765ed triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:14.442472 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c617a9d9-b6a1-404d-92aa-80c0a613ac9e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:14.497963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] Set router 24626fb7-c6a2-4824-af06-13284de6ee53 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:20:14.723055 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-690e8e1b-3d0e-4386-892e-95f522a8cbf8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:14.732148 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'name': 'tempest-TestMinimumBasicScenario-304437312-router', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228'}], 'enable_snat': True}, 'gw_port_id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:13Z', 'revision_number': 3, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'gw_port': {'id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:bb:01', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4172, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:12Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:14.758041 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] Checking router: 24626fb7-c6a2-4824-af06-13284de6ee53 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:20:14.758385 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] Updating router 24626fb7-c6a2-4824-af06-13284de6ee53 port 5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:20:14.783400 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:14.875910 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-690e8e1b-3d0e-4386-892e-95f522a8cbf8 admin admin] Allocated IP 172.20.0.1 (20d197ac-b0d5-4136-851b-f803672ee9e2/9016b68e-6021-4bdc-a7b1-be26d9de403a/4ec2eb7e-aa5f-4a78-af85-c1be398e85de) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:20:14.983078 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-690e8e1b-3d0e-4386-892e-95f522a8cbf8 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:15.017095 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-690e8e1b-3d0e-4386-892e-95f522a8cbf8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:15.036001 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:15.042852 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:15.056485 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-690e8e1b-3d0e-4386-892e-95f522a8cbf8 admin admin] Network 20d197ac-b0d5-4136-851b-f803672ee9e2 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:20:15.059302 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-690e8e1b-3d0e-4386-892e-95f522a8cbf8 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:20:15.061820 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-690e8e1b-3d0e-4386-892e-95f522a8cbf8 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:20:15.093149 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f2b46232-aacb-42e4-8dac-4351c191beca None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:20:15.095889 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-690e8e1b-3d0e-4386-892e-95f522a8cbf8 admin admin] Pushing event updated for resources: {'Port': ['ID=4ec2eb7e-aa5f-4a78-af85-c1be398e85de,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:15.099893 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] Attempting to bind port 5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:20:15.100269 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] Attempting to bind port 5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:20:15.100628 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] Attempting to bind port 5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:20:15.102921 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-772cf9f1-2009-4fec-8bfd-5ebce52afed7 None None] Pushing event updated for resources: {'Port': ['ID=5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:15.110652 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 20, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:20:15.111238 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:20:15.111412 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:15.111819 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:20:15.112291 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] Bound port: 5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:20:15.112668 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:15.125697 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-690e8e1b-3d0e-4386-892e-95f522a8cbf8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:15.168098 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] For port 5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:20:15.173090 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] For port 5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:20:15.178856 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:15.245096 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-495884d5-0390-467d-9853-8333ac446852 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:20:15.264631 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-101fa120-30bd-4269-bb84-68c390d0d6f6 None None] Provisioning complete for port 5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:15.264881 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-690e8e1b-3d0e-4386-892e-95f522a8cbf8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:15.265448 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-101fa120-30bd-4269-bb84-68c390d0d6f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:15.289934 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] Routers {'24626fb7-c6a2-4824-af06-13284de6ee53'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:20:15.290570 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:20:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['24626fb7-c6a2-4824-af06-13284de6ee53'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:15.296681 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-772cf9f1-2009-4fec-8bfd-5ebce52afed7 None None] Pushing event updated for resources: {'Port': ['ID=5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:15.429722 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] Set router 24626fb7-c6a2-4824-af06-13284de6ee53 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:20:15.434869 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-690e8e1b-3d0e-4386-892e-95f522a8cbf8 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:15.440748 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-690e8e1b-3d0e-4386-892e-95f522a8cbf8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:15.474594 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-101fa120-30bd-4269-bb84-68c390d0d6f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:15.512287 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-690e8e1b-3d0e-4386-892e-95f522a8cbf8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:15.514389 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-690e8e1b-3d0e-4386-892e-95f522a8cbf8 admin admin] Pushing event updated for resources: {'Port': ['ID=4ec2eb7e-aa5f-4a78-af85-c1be398e85de,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:15.541828 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-101fa120-30bd-4269-bb84-68c390d0d6f6 None None] For port 5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:20:15.552221 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-101fa120-30bd-4269-bb84-68c390d0d6f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:15.610151 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-690e8e1b-3d0e-4386-892e-95f522a8cbf8 admin admin] Network 20d197ac-b0d5-4136-851b-f803672ee9e2 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:20:15.612085 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-690e8e1b-3d0e-4386-892e-95f522a8cbf8 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:20:15.652195 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-101fa120-30bd-4269-bb84-68c390d0d6f6 None None] Pushing event updated for resources: {'Port': ['ID=5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:15.743516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-690e8e1b-3d0e-4386-892e-95f522a8cbf8 admin admin] Router 24626fb7-c6a2-4824-af06-13284de6ee53 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:20:15.862625 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-690e8e1b-3d0e-4386-892e-95f522a8cbf8 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:20:15.867702 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-690e8e1b-3d0e-4386-892e-95f522a8cbf8 admin admin] 10.222.0.13 "PUT /v2.0/routers/24626fb7-c6a2-4824-af06-13284de6ee53/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5675445 Dec 09 22:20:15.883118 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-74666929-cd99-4c3a-ad13-44be50eaba6c None None] Provisioning complete for port 5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:15.883647 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-74666929-cd99-4c3a-ad13-44be50eaba6c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:15.929217 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'name': 'tempest-TestMinimumBasicScenario-304437312-router', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228'}], 'enable_snat': True}, 'gw_port_id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:15Z', 'revision_number': 4, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'gw_port': {'id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:bb:01', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4172, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '4ec2eb7e-aa5f-4a78-af85-c1be398e85de', 'name': '', 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'mac_address': 'fa:16:3e:32:c1:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'device_owner': 'network:router_interface', 'standard_attr_id': 4173, 'fixed_ips': [{'subnet_id': '9016b68e-6021-4bdc-a7b1-be26d9de403a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:14Z', 'updated_at': '2021-12-09T22:20:14Z', 'revision_number': 1, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'subnets': [{'id': '9016b68e-6021-4bdc-a7b1-be26d9de403a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:15.960521 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f84c0ce9-c3ab-412f-92d2-1242a2e5df08 None None] The sync data for ids ['24626fb7-c6a2-4824-af06-13284de6ee53'] in n-d-713301-27 is: [{'id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'name': 'tempest-TestMinimumBasicScenario-304437312-router', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228'}], 'enable_snat': True}, 'gw_port_id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:15Z', 'revision_number': 4, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'gw_port': {'id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:bb:01', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4172, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '4ec2eb7e-aa5f-4a78-af85-c1be398e85de', 'name': '', 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'mac_address': 'fa:16:3e:32:c1:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'device_owner': 'network:router_interface', 'standard_attr_id': 4173, 'fixed_ips': [{'subnet_id': '9016b68e-6021-4bdc-a7b1-be26d9de403a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:14Z', 'updated_at': '2021-12-09T22:20:14Z', 'revision_number': 1, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'subnets': [{'id': '9016b68e-6021-4bdc-a7b1-be26d9de403a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:20:16.010534 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-74666929-cd99-4c3a-ad13-44be50eaba6c None None] Provisioning complete for port 4ec2eb7e-aa5f-4a78-af85-c1be398e85de triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:16.010912 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-74666929-cd99-4c3a-ad13-44be50eaba6c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:16.052967 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-74666929-cd99-4c3a-ad13-44be50eaba6c None None] Port 4ec2eb7e-aa5f-4a78-af85-c1be398e85de cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:20:16.200075 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-248ce703-59be-4a0b-8033-16477fe6d1c1 None None] Provisioning complete for port 4ec2eb7e-aa5f-4a78-af85-c1be398e85de triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:16.200465 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-248ce703-59be-4a0b-8033-16477fe6d1c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:16.251519 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d9add3f3-7bdd-4cdf-a092-eac2466765ed up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:20:16.289400 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-248ce703-59be-4a0b-8033-16477fe6d1c1 None None] Port 4ec2eb7e-aa5f-4a78-af85-c1be398e85de cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:20:16.320279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port d9add3f3-7bdd-4cdf-a092-eac2466765ed triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:16.320653 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:16.419238 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33464) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:20:16.424516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-7691fdbf-485a-4b40-9fea-8ea8b1aca887 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1848155188-network', 'tenant_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:20:16.446866 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7691fdbf-485a-4b40-9fea-8ea8b1aca887 admin admin] Made reservation on behalf of 6db0ddad81ad44eb8fe3f1a1d8dfd734 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:20:16.449410 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7691fdbf-485a-4b40-9fea-8ea8b1aca887 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:16.458673 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7691fdbf-485a-4b40-9fea-8ea8b1aca887 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:16.541232 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7691fdbf-485a-4b40-9fea-8ea8b1aca887 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:16.546162 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7691fdbf-485a-4b40-9fea-8ea8b1aca887 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:16.573924 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7691fdbf-485a-4b40-9fea-8ea8b1aca887 admin admin] vlan segment allocate from pool success with {'vlan_id': 144, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 22:20:16.579544 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7691fdbf-485a-4b40-9fea-8ea8b1aca887 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6e80c7c3-51e7-4139-9b4a-9933c67d8bef,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:16.587157 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7691fdbf-485a-4b40-9fea-8ea8b1aca887 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:16.587571 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-7691fdbf-485a-4b40-9fea-8ea8b1aca887 admin admin] Added segment 5ba61fcf-8990-4c4d-8d58-4a20e35a9f21 of type vlan for network d2c4bf04-fd51-454e-b93e-6e6e4012c291 Dec 09 22:20:16.634673 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7691fdbf-485a-4b40-9fea-8ea8b1aca887 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:16.670209 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7691fdbf-485a-4b40-9fea-8ea8b1aca887 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:16.672114 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7691fdbf-485a-4b40-9fea-8ea8b1aca887 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:16.673116 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7691fdbf-485a-4b40-9fea-8ea8b1aca887 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:16.705281 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7691fdbf-485a-4b40-9fea-8ea8b1aca887 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.2848158 Dec 09 22:20:16.707913 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33466) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:20:16.714691 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-12a585d4-6995-42d7-9fca-9fe5911dcd98 admin admin] Request body: {'subnet': {'network_id': 'd2c4bf04-fd51-454e-b93e-6e6e4012c291', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1848155188-subnet', 'tenant_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:20:16.748915 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7691fdbf-485a-4b40-9fea-8ea8b1aca887 admin admin] Pushing event updated for resources: {'Network': ['ID=d2c4bf04-fd51-454e-b93e-6e6e4012c291,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:16.759159 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network d2c4bf04-fd51-454e-b93e-6e6e4012c291 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 22:20:16.767018 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-12a585d4-6995-42d7-9fca-9fe5911dcd98 admin admin] Made reservation on behalf of 6db0ddad81ad44eb8fe3f1a1d8dfd734 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:20:16.769722 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-12a585d4-6995-42d7-9fca-9fe5911dcd98 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:16.958508 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-12a585d4-6995-42d7-9fca-9fe5911dcd98 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:17.009282 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12a585d4-6995-42d7-9fca-9fe5911dcd98 admin admin] Pushing event updated for resources: {'Subnet': ['ID=96cbaf46-83b1-48f6-9738-17111c4a4dca,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:17.026035 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12a585d4-6995-42d7-9fca-9fe5911dcd98 admin admin] Checking segment: {'id': '5ba61fcf-8990-4c4d-8d58-4a20e35a9f21', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'd2c4bf04-fd51-454e-b93e-6e6e4012c291'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:20:17.026406 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12a585d4-6995-42d7-9fca-9fe5911dcd98 admin admin] Network hostable DHCP agents. Network: d2c4bf04-fd51-454e-b93e-6e6e4012c291, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 22:20:17.046049 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12a585d4-6995-42d7-9fca-9fe5911dcd98 admin admin] Network d2c4bf04-fd51-454e-b93e-6e6e4012c291 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 22:20:17.056704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-12a585d4-6995-42d7-9fca-9fe5911dcd98 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, d2c4bf04-fd51-454e-b93e-6e6e4012c291) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:20:17.060741 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12a585d4-6995-42d7-9fca-9fe5911dcd98 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:17.061348 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-12a585d4-6995-42d7-9fca-9fe5911dcd98 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:17.066718 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c447920e-597b-48db-9b1c-88f64fbd523c None None] Network d2c4bf04-fd51-454e-b93e-6e6e4012c291 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:20:17.080076 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-12a585d4-6995-42d7-9fca-9fe5911dcd98 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.3711112 Dec 09 22:20:17.082713 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33468) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:20:17.087897 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a3a632e9-4522-4d0e-bffa-c63f6035667a admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1848155188-router', 'tenant_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:20:17.111289 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a3a632e9-4522-4d0e-bffa-c63f6035667a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:17.112478 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a3a632e9-4522-4d0e-bffa-c63f6035667a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:17.180128 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-acf35224-ab39-485d-a971-187daf94ea3c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-d2c4bf04-fd51-454e-b93e-6e6e4012c291', 'network_id': 'd2c4bf04-fd51-454e-b93e-6e6e4012c291', 'project_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'fixed_ips': [{'subnet_id': '96cbaf46-83b1-48f6-9738-17111c4a4dca'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 22:20:17.180751 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a3a632e9-4522-4d0e-bffa-c63f6035667a admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:17.181541 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-acf35224-ab39-485d-a971-187daf94ea3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:17.324802 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-acf35224-ab39-485d-a971-187daf94ea3c None None] Allocated IP 172.20.0.2 (d2c4bf04-fd51-454e-b93e-6e6e4012c291/96cbaf46-83b1-48f6-9738-17111c4a4dca/11df3507-b108-4b04-85f9-39022a13a30b) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:20:17.326563 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a3a632e9-4522-4d0e-bffa-c63f6035667a admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:17.480068 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-acf35224-ab39-485d-a971-187daf94ea3c None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:17.486045 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-acf35224-ab39-485d-a971-187daf94ea3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:17.526320 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-acf35224-ab39-485d-a971-187daf94ea3c None None] Network d2c4bf04-fd51-454e-b93e-6e6e4012c291 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:20:17.529052 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-acf35224-ab39-485d-a971-187daf94ea3c None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:20:17.533270 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a3a632e9-4522-4d0e-bffa-c63f6035667a admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:17.534745 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acf35224-ab39-485d-a971-187daf94ea3c None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:20:17.541658 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acf35224-ab39-485d-a971-187daf94ea3c None None] Pushing event updated for resources: {'Port': ['ID=11df3507-b108-4b04-85f9-39022a13a30b,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:17.555051 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a3a632e9-4522-4d0e-bffa-c63f6035667a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:17.597455 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-acf35224-ab39-485d-a971-187daf94ea3c None None] Attempting to bind port 11df3507-b108-4b04-85f9-39022a13a30b on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:20:17.597819 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-acf35224-ab39-485d-a971-187daf94ea3c None None] Attempting to bind port 11df3507-b108-4b04-85f9-39022a13a30b by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '5ba61fcf-8990-4c4d-8d58-4a20e35a9f21', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'd2c4bf04-fd51-454e-b93e-6e6e4012c291'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:20:17.598185 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acf35224-ab39-485d-a971-187daf94ea3c None None] Attempting to bind port 11df3507-b108-4b04-85f9-39022a13a30b on network d2c4bf04-fd51-454e-b93e-6e6e4012c291 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:20:17.603271 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acf35224-ab39-485d-a971-187daf94ea3c None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 20, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:20:17.603676 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acf35224-ab39-485d-a971-187daf94ea3c None None] Checking segment: {'id': '5ba61fcf-8990-4c4d-8d58-4a20e35a9f21', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'd2c4bf04-fd51-454e-b93e-6e6e4012c291'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:20:17.604084 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-acf35224-ab39-485d-a971-187daf94ea3c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:17.604504 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-acf35224-ab39-485d-a971-187daf94ea3c None None] Bound using segment: {'id': '5ba61fcf-8990-4c4d-8d58-4a20e35a9f21', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'd2c4bf04-fd51-454e-b93e-6e6e4012c291'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:20:17.605112 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-acf35224-ab39-485d-a971-187daf94ea3c None None] Bound port: 11df3507-b108-4b04-85f9-39022a13a30b, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5ba61fcf-8990-4c4d-8d58-4a20e35a9f21', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'd2c4bf04-fd51-454e-b93e-6e6e4012c291'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:20:17.605496 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-acf35224-ab39-485d-a971-187daf94ea3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:17.664771 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-a3a632e9-4522-4d0e-bffa-c63f6035667a admin admin] Allocated IP 172.25.3.183 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/5a865e27-1a28-4929-9eb1-0503f1a4fc4e) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:20:17.671091 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-acf35224-ab39-485d-a971-187daf94ea3c None None] For port 11df3507-b108-4b04-85f9-39022a13a30b, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:20:17.675526 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-acf35224-ab39-485d-a971-187daf94ea3c None None] For port 11df3507-b108-4b04-85f9-39022a13a30b, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=11df3507-b108-4b04-85f9-39022a13a30b,segment=NetworkSegment(5ba61fcf-8990-4c4d-8d58-4a20e35a9f21),segment_id=5ba61fcf-8990-4c4d-8d58-4a20e35a9f21)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:20:17.680667 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-acf35224-ab39-485d-a971-187daf94ea3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:17.745890 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acf35224-ab39-485d-a971-187daf94ea3c None None] Pushing event updated for resources: {'Port': ['ID=11df3507-b108-4b04-85f9-39022a13a30b,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:17.787079 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a3a632e9-4522-4d0e-bffa-c63f6035667a admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:17.826687 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a3a632e9-4522-4d0e-bffa-c63f6035667a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:17.871062 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3a632e9-4522-4d0e-bffa-c63f6035667a admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:20:17.874023 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-a3a632e9-4522-4d0e-bffa-c63f6035667a admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:20:17.876644 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3a632e9-4522-4d0e-bffa-c63f6035667a admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:20:17.889971 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cbc1c5a4-eba9-41ba-a303-285e96d26958 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:20:17.909409 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3a632e9-4522-4d0e-bffa-c63f6035667a admin admin] Pushing event updated for resources: {'Port': ['ID=5a865e27-1a28-4929-9eb1-0503f1a4fc4e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:18.044519 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2077fc9e-9050-4ad4-a146-d0a8ff437dbf None None] Provisioning complete for port 5a865e27-1a28-4929-9eb1-0503f1a4fc4e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:18.044928 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2077fc9e-9050-4ad4-a146-d0a8ff437dbf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:18.093327 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-2077fc9e-9050-4ad4-a146-d0a8ff437dbf None None] Port 5a865e27-1a28-4929-9eb1-0503f1a4fc4e cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:20:18.157256 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] Sync routers for ids ['24626fb7-c6a2-4824-af06-13284de6ee53'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:20:18.177703 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] Routers {'24626fb7-c6a2-4824-af06-13284de6ee53'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:20:18.178351 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:20:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['24626fb7-c6a2-4824-af06-13284de6ee53'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:18.189687 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a3a632e9-4522-4d0e-bffa-c63f6035667a admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:18.249701 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 11df3507-b108-4b04-85f9-39022a13a30b up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:20:18.291803 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] Set router 24626fb7-c6a2-4824-af06-13284de6ee53 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:20:18.302314 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 11df3507-b108-4b04-85f9-39022a13a30b triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:18.302681 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:18.391608 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:18.429667 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 11df3507-b108-4b04-85f9-39022a13a30b, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=11df3507-b108-4b04-85f9-39022a13a30b,segment=NetworkSegment(5ba61fcf-8990-4c4d-8d58-4a20e35a9f21),segment_id=5ba61fcf-8990-4c4d-8d58-4a20e35a9f21)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:20:18.437186 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:18.438020 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:20:18.524037 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=11df3507-b108-4b04-85f9-39022a13a30b,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:18.538239 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'name': 'tempest-TestMinimumBasicScenario-304437312-router', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228'}], 'enable_snat': True}, 'gw_port_id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:15Z', 'revision_number': 4, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'gw_port': {'id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:bb:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4172, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '4ec2eb7e-aa5f-4a78-af85-c1be398e85de', 'name': '', 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'mac_address': 'fa:16:3e:32:c1:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'device_owner': 'network:router_interface', 'standard_attr_id': 4173, 'fixed_ips': [{'subnet_id': '9016b68e-6021-4bdc-a7b1-be26d9de403a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:14Z', 'updated_at': '2021-12-09T22:20:15Z', 'revision_number': 2, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'subnets': [{'id': '9016b68e-6021-4bdc-a7b1-be26d9de403a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:18.538789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:18.539173 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:18.576333 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] Checking router: 24626fb7-c6a2-4824-af06-13284de6ee53 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:20:18.576719 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] Updating router 24626fb7-c6a2-4824-af06-13284de6ee53 port 4ec2eb7e-aa5f-4a78-af85-c1be398e85de binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:20:18.602766 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:18.839546 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a3a632e9-4522-4d0e-bffa-c63f6035667a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:18.844848 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65538154-eba4-4643-81c1-9c0af9de3bcf None None] Network d2c4bf04-fd51-454e-b93e-6e6e4012c291 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:20:18.898041 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:18.905282 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:18.926718 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-8ff49bbc-521f-4882-b02d-7f101eacbd27 None None] Provisioning complete for port 11df3507-b108-4b04-85f9-39022a13a30b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:18.927173 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8ff49bbc-521f-4882-b02d-7f101eacbd27 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:18.959781 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce6caafe-961d-413a-aa4a-f1359e389ccf None None] Pushing event updated for resources: {'Port': ['ID=4ec2eb7e-aa5f-4a78-af85-c1be398e85de,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:18.986708 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce6caafe-961d-413a-aa4a-f1359e389ccf None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:18.986940 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a3a632e9-4522-4d0e-bffa-c63f6035667a admin admin] Router 74c82537-ce8a-4bdd-983a-3cfad6147d1d is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 22:20:18.987255 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce6caafe-961d-413a-aa4a-f1359e389ccf None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:18.987767 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce6caafe-961d-413a-aa4a-f1359e389ccf None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:18.988092 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce6caafe-961d-413a-aa4a-f1359e389ccf None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:18.988509 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce6caafe-961d-413a-aa4a-f1359e389ccf None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:18.988918 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce6caafe-961d-413a-aa4a-f1359e389ccf None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:18.989291 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce6caafe-961d-413a-aa4a-f1359e389ccf None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:18.989831 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce6caafe-961d-413a-aa4a-f1359e389ccf None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:18.990219 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce6caafe-961d-413a-aa4a-f1359e389ccf None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:18.990610 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce6caafe-961d-413a-aa4a-f1359e389ccf None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:18.991029 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce6caafe-961d-413a-aa4a-f1359e389ccf None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:18.991370 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce6caafe-961d-413a-aa4a-f1359e389ccf None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:18.991778 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce6caafe-961d-413a-aa4a-f1359e389ccf None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:19.030924 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] Attempting to bind port 4ec2eb7e-aa5f-4a78-af85-c1be398e85de on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:20:19.031295 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] Attempting to bind port 4ec2eb7e-aa5f-4a78-af85-c1be398e85de by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '16bdd335-351c-4e9d-bde1-07a4c99d195c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:20:19.031691 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] Attempting to bind port 4ec2eb7e-aa5f-4a78-af85-c1be398e85de on network 20d197ac-b0d5-4136-851b-f803672ee9e2 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:20:19.037887 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 20, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:20:19.037887 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] Checking segment: {'id': '16bdd335-351c-4e9d-bde1-07a4c99d195c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:20:19.038243 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:19.038775 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] Bound using segment: {'id': '16bdd335-351c-4e9d-bde1-07a4c99d195c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:20:19.039078 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] Bound port: 4ec2eb7e-aa5f-4a78-af85-c1be398e85de, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '16bdd335-351c-4e9d-bde1-07a4c99d195c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:20:19.039478 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:19.117628 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] For port 4ec2eb7e-aa5f-4a78-af85-c1be398e85de, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:20:19.125387 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] For port 4ec2eb7e-aa5f-4a78-af85-c1be398e85de, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=4ec2eb7e-aa5f-4a78-af85-c1be398e85de,segment=NetworkSegment(16bdd335-351c-4e9d-bde1-07a4c99d195c),segment_id=16bdd335-351c-4e9d-bde1-07a4c99d195c)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:20:19.128123 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a3a632e9-4522-4d0e-bffa-c63f6035667a admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:20:19.137828 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:19.140925 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] Sync routers for ids ['74c82537-ce8a-4bdd-983a-3cfad6147d1d'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:20:19.155778 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a3a632e9-4522-4d0e-bffa-c63f6035667a admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:19.156473 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] Routers {'74c82537-ce8a-4bdd-983a-3cfad6147d1d'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:20:19.157104 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:20:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['74c82537-ce8a-4bdd-983a-3cfad6147d1d'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:19.158069 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a3a632e9-4522-4d0e-bffa-c63f6035667a admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 2.0735528 Dec 09 22:20:19.160545 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33470) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:20:19.232756 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] Routers {'24626fb7-c6a2-4824-af06-13284de6ee53'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:20:19.234024 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:20:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['24626fb7-c6a2-4824-af06-13284de6ee53'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:19.299660 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] Set router 74c82537-ce8a-4bdd-983a-3cfad6147d1d gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:20:19.341719 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce6caafe-961d-413a-aa4a-f1359e389ccf None None] Pushing event updated for resources: {'Port': ['ID=4ec2eb7e-aa5f-4a78-af85-c1be398e85de,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:19.411994 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] Set router 24626fb7-c6a2-4824-af06-13284de6ee53 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:20:19.450490 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9f37726a-1abc-40dd-be64-4f711afda9bb None None] Provisioning complete for port 11df3507-b108-4b04-85f9-39022a13a30b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:19.450859 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9f37726a-1abc-40dd-be64-4f711afda9bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:19.600788 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '74c82537-ce8a-4bdd-983a-3cfad6147d1d', 'name': 'tempest-TestMinimumBasicScenario-1848155188-router', 'tenant_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.183'}], 'enable_snat': True}, 'gw_port_id': '5a865e27-1a28-4929-9eb1-0503f1a4fc4e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:20:17Z', 'updated_at': '2021-12-09T22:20:18Z', 'revision_number': 3, 'project_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'gw_port': {'id': '5a865e27-1a28-4929-9eb1-0503f1a4fc4e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:40:00', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '74c82537-ce8a-4bdd-983a-3cfad6147d1d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4184, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:17Z', 'updated_at': '2021-12-09T22:20:17Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:19.630333 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] Checking router: 74c82537-ce8a-4bdd-983a-3cfad6147d1d for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:20:19.630682 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] Updating router 74c82537-ce8a-4bdd-983a-3cfad6147d1d port 5a865e27-1a28-4929-9eb1-0503f1a4fc4e binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:20:19.634952 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9f37726a-1abc-40dd-be64-4f711afda9bb None None] Provisioning complete for port 4ec2eb7e-aa5f-4a78-af85-c1be398e85de triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:19.634952 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9f37726a-1abc-40dd-be64-4f711afda9bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:19.654797 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-960dcda7-26b6-4e49-b76b-822f518e72bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:19.684205 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:19.752284 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'name': 'tempest-TestMinimumBasicScenario-304437312-router', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228'}], 'enable_snat': True}, 'gw_port_id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:15Z', 'revision_number': 4, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'gw_port': {'id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:bb:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4172, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '4ec2eb7e-aa5f-4a78-af85-c1be398e85de', 'name': '', 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'mac_address': 'fa:16:3e:32:c1:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'device_owner': 'network:router_interface', 'standard_attr_id': 4173, 'fixed_ips': [{'subnet_id': '9016b68e-6021-4bdc-a7b1-be26d9de403a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:14Z', 'updated_at': '2021-12-09T22:20:19Z', 'revision_number': 4, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'subnets': [{'id': '9016b68e-6021-4bdc-a7b1-be26d9de403a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:19.802364 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5643aad4-14c2-4222-bf9d-8a51f2b77d21 None None] The sync data for ids ['24626fb7-c6a2-4824-af06-13284de6ee53'] in n-d-713301-27 is: [{'id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'name': 'tempest-TestMinimumBasicScenario-304437312-router', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228'}], 'enable_snat': True}, 'gw_port_id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:15Z', 'revision_number': 4, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'gw_port': {'id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:bb:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4172, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '4ec2eb7e-aa5f-4a78-af85-c1be398e85de', 'name': '', 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'mac_address': 'fa:16:3e:32:c1:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'device_owner': 'network:router_interface', 'standard_attr_id': 4173, 'fixed_ips': [{'subnet_id': '9016b68e-6021-4bdc-a7b1-be26d9de403a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:14Z', 'updated_at': '2021-12-09T22:20:19Z', 'revision_number': 4, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'subnets': [{'id': '9016b68e-6021-4bdc-a7b1-be26d9de403a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:20:19.845426 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9f37726a-1abc-40dd-be64-4f711afda9bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:19.868666 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-960dcda7-26b6-4e49-b76b-822f518e72bb admin admin] Allocated IP 172.20.0.1 (d2c4bf04-fd51-454e-b93e-6e6e4012c291/96cbaf46-83b1-48f6-9738-17111c4a4dca/7257da7c-1ae2-4377-8d16-b8f186ab5ae6) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:20:19.952247 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-9f37726a-1abc-40dd-be64-4f711afda9bb None None] For port 4ec2eb7e-aa5f-4a78-af85-c1be398e85de, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=4ec2eb7e-aa5f-4a78-af85-c1be398e85de,segment=NetworkSegment(16bdd335-351c-4e9d-bde1-07a4c99d195c),segment_id=16bdd335-351c-4e9d-bde1-07a4c99d195c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:20:19.957741 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9f37726a-1abc-40dd-be64-4f711afda9bb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:20.002217 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-960dcda7-26b6-4e49-b76b-822f518e72bb admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:20.038130 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f37726a-1abc-40dd-be64-4f711afda9bb None None] Pushing event updated for resources: {'Port': ['ID=4ec2eb7e-aa5f-4a78-af85-c1be398e85de,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:20.049930 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-960dcda7-26b6-4e49-b76b-822f518e72bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:20.087161 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-960dcda7-26b6-4e49-b76b-822f518e72bb admin admin] Network d2c4bf04-fd51-454e-b93e-6e6e4012c291 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:20:20.090346 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-960dcda7-26b6-4e49-b76b-822f518e72bb admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:20:20.094099 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-960dcda7-26b6-4e49-b76b-822f518e72bb admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:20:20.100926 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-68646f8a-86f9-4c99-89d9-fdd737b0f688 None None] Provisioning complete for port 4ec2eb7e-aa5f-4a78-af85-c1be398e85de triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:20.101387 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-68646f8a-86f9-4c99-89d9-fdd737b0f688 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:20.107525 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:20.136973 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:20.137594 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-960dcda7-26b6-4e49-b76b-822f518e72bb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:20.198619 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-508ed8fe-419b-43a4-953a-554c821f00d2 None None] Pushing event updated for resources: {'Port': ['ID=5a865e27-1a28-4929-9eb1-0503f1a4fc4e,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:20.220304 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] Attempting to bind port 5a865e27-1a28-4929-9eb1-0503f1a4fc4e on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:20:20.220948 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] Attempting to bind port 5a865e27-1a28-4929-9eb1-0503f1a4fc4e by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:20:20.221320 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] Attempting to bind port 5a865e27-1a28-4929-9eb1-0503f1a4fc4e on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:20:20.227890 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3022ca15-d94b-4d0f-ae77-233d726920b6 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:20:20.242834 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-960dcda7-26b6-4e49-b76b-822f518e72bb admin admin] Pushing event updated for resources: {'Port': ['ID=7257da7c-1ae2-4377-8d16-b8f186ab5ae6,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:20.372794 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-960dcda7-26b6-4e49-b76b-822f518e72bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:20.479282 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 20, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:20:20.479723 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:20:20.480098 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:20.480498 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:20:20.480989 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] Bound port: 5a865e27-1a28-4929-9eb1-0503f1a4fc4e, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:20:20.481372 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:20.505600 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 4ec2eb7e-aa5f-4a78-af85-c1be398e85de up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:20:20.577025 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-960dcda7-26b6-4e49-b76b-822f518e72bb admin admin] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:20.583250 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-960dcda7-26b6-4e49-b76b-822f518e72bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:20.593039 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] For port 5a865e27-1a28-4929-9eb1-0503f1a4fc4e, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:20:20.596829 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] For port 5a865e27-1a28-4929-9eb1-0503f1a4fc4e, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5a865e27-1a28-4929-9eb1-0503f1a4fc4e,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:20:20.607636 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:20.616006 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 4ec2eb7e-aa5f-4a78-af85-c1be398e85de triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:20.616241 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:20.657693 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-960dcda7-26b6-4e49-b76b-822f518e72bb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:20.659803 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-960dcda7-26b6-4e49-b76b-822f518e72bb admin admin] Pushing event updated for resources: {'Port': ['ID=7257da7c-1ae2-4377-8d16-b8f186ab5ae6,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:20.688297 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] Routers {'74c82537-ce8a-4bdd-983a-3cfad6147d1d'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:20:20.688933 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:20:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['74c82537-ce8a-4bdd-983a-3cfad6147d1d'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:20.725656 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c18f582-fd2e-4082-a603-86c27f204181 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:20:20.753458 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-960dcda7-26b6-4e49-b76b-822f518e72bb admin admin] Network d2c4bf04-fd51-454e-b93e-6e6e4012c291 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:20:20.754969 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-960dcda7-26b6-4e49-b76b-822f518e72bb admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:20:20.763963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-508ed8fe-419b-43a4-953a-554c821f00d2 None None] Pushing event updated for resources: {'Port': ['ID=5a865e27-1a28-4929-9eb1-0503f1a4fc4e,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:20.785551 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6ae8da50-e020-4fe6-98ee-91c76f368279 None None] Provisioning complete for port 7257da7c-1ae2-4377-8d16-b8f186ab5ae6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:20.785650 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6ae8da50-e020-4fe6-98ee-91c76f368279 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:20.874804 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-960dcda7-26b6-4e49-b76b-822f518e72bb admin admin] Router 74c82537-ce8a-4bdd-983a-3cfad6147d1d has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:20:20.903962 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-6ae8da50-e020-4fe6-98ee-91c76f368279 None None] Port 7257da7c-1ae2-4377-8d16-b8f186ab5ae6 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:20:20.906561 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] Set router 74c82537-ce8a-4bdd-983a-3cfad6147d1d gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:20:20.910216 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 11df3507-b108-4b04-85f9-39022a13a30b up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:20:20.987168 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-960dcda7-26b6-4e49-b76b-822f518e72bb admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:20:20.992340 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-960dcda7-26b6-4e49-b76b-822f518e72bb admin admin] 10.222.0.13 "PUT /v2.0/routers/74c82537-ce8a-4bdd-983a-3cfad6147d1d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8300054 Dec 09 22:20:21.018746 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6ae8da50-e020-4fe6-98ee-91c76f368279 None None] Provisioning complete for port 5a865e27-1a28-4929-9eb1-0503f1a4fc4e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:21.019120 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6ae8da50-e020-4fe6-98ee-91c76f368279 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:21.118789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 11df3507-b108-4b04-85f9-39022a13a30b triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:21.119164 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:21.233453 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6ae8da50-e020-4fe6-98ee-91c76f368279 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:21.282734 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-6ae8da50-e020-4fe6-98ee-91c76f368279 None None] For port 5a865e27-1a28-4929-9eb1-0503f1a4fc4e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5a865e27-1a28-4929-9eb1-0503f1a4fc4e,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:20:21.291318 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6ae8da50-e020-4fe6-98ee-91c76f368279 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:21.357120 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '74c82537-ce8a-4bdd-983a-3cfad6147d1d', 'name': 'tempest-TestMinimumBasicScenario-1848155188-router', 'tenant_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.183'}], 'enable_snat': True}, 'gw_port_id': '5a865e27-1a28-4929-9eb1-0503f1a4fc4e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:20:17Z', 'updated_at': '2021-12-09T22:20:20Z', 'revision_number': 4, 'project_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'gw_port': {'id': '5a865e27-1a28-4929-9eb1-0503f1a4fc4e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:40:00', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '74c82537-ce8a-4bdd-983a-3cfad6147d1d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4184, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:17Z', 'updated_at': '2021-12-09T22:20:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '7257da7c-1ae2-4377-8d16-b8f186ab5ae6', 'name': '', 'network_id': 'd2c4bf04-fd51-454e-b93e-6e6e4012c291', 'tenant_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'mac_address': 'fa:16:3e:81:9e:3b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '74c82537-ce8a-4bdd-983a-3cfad6147d1d', 'device_owner': 'network:router_interface', 'standard_attr_id': 4185, 'fixed_ips': [{'subnet_id': '96cbaf46-83b1-48f6-9738-17111c4a4dca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:19Z', 'updated_at': '2021-12-09T22:20:20Z', 'revision_number': 2, 'project_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'subnets': [{'id': '96cbaf46-83b1-48f6-9738-17111c4a4dca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:21.360344 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ae8da50-e020-4fe6-98ee-91c76f368279 None None] Pushing event updated for resources: {'Port': ['ID=5a865e27-1a28-4929-9eb1-0503f1a4fc4e,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:21.387290 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52e5fb6a-f2e9-4f8b-9e34-7c71317bc181 None None] The sync data for ids ['74c82537-ce8a-4bdd-983a-3cfad6147d1d'] in n-d-713301-27 is: [{'id': '74c82537-ce8a-4bdd-983a-3cfad6147d1d', 'name': 'tempest-TestMinimumBasicScenario-1848155188-router', 'tenant_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.183'}], 'enable_snat': True}, 'gw_port_id': '5a865e27-1a28-4929-9eb1-0503f1a4fc4e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:20:17Z', 'updated_at': '2021-12-09T22:20:20Z', 'revision_number': 4, 'project_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'gw_port': {'id': '5a865e27-1a28-4929-9eb1-0503f1a4fc4e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:40:00', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '74c82537-ce8a-4bdd-983a-3cfad6147d1d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4184, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:17Z', 'updated_at': '2021-12-09T22:20:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '7257da7c-1ae2-4377-8d16-b8f186ab5ae6', 'name': '', 'network_id': 'd2c4bf04-fd51-454e-b93e-6e6e4012c291', 'tenant_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'mac_address': 'fa:16:3e:81:9e:3b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '74c82537-ce8a-4bdd-983a-3cfad6147d1d', 'device_owner': 'network:router_interface', 'standard_attr_id': 4185, 'fixed_ips': [{'subnet_id': '96cbaf46-83b1-48f6-9738-17111c4a4dca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:19Z', 'updated_at': '2021-12-09T22:20:20Z', 'revision_number': 2, 'project_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'subnets': [{'id': '96cbaf46-83b1-48f6-9738-17111c4a4dca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:20:21.419282 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1de4caed-7fb4-4cac-a703-90b80c04acf6 None None] Provisioning complete for port 7257da7c-1ae2-4377-8d16-b8f186ab5ae6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:21.419808 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1de4caed-7fb4-4cac-a703-90b80c04acf6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:21.467004 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-1de4caed-7fb4-4cac-a703-90b80c04acf6 None None] Port 7257da7c-1ae2-4377-8d16-b8f186ab5ae6 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:20:21.477841 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1de4caed-7fb4-4cac-a703-90b80c04acf6 None None] Provisioning complete for port 5a865e27-1a28-4929-9eb1-0503f1a4fc4e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:21.478254 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1de4caed-7fb4-4cac-a703-90b80c04acf6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:24.208157 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] Sync routers for ids ['74c82537-ce8a-4bdd-983a-3cfad6147d1d'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:20:24.221429 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] Routers {'74c82537-ce8a-4bdd-983a-3cfad6147d1d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:20:24.222049 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:20:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['74c82537-ce8a-4bdd-983a-3cfad6147d1d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:24.248636 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5a865e27-1a28-4929-9eb1-0503f1a4fc4e up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:20:24.316502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 5a865e27-1a28-4929-9eb1-0503f1a4fc4e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:24.317475 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:24.348133 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] Set router 74c82537-ce8a-4bdd-983a-3cfad6147d1d gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:20:24.568753 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '74c82537-ce8a-4bdd-983a-3cfad6147d1d', 'name': 'tempest-TestMinimumBasicScenario-1848155188-router', 'tenant_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.183'}], 'enable_snat': True}, 'gw_port_id': '5a865e27-1a28-4929-9eb1-0503f1a4fc4e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:20:17Z', 'updated_at': '2021-12-09T22:20:20Z', 'revision_number': 4, 'project_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'gw_port': {'id': '5a865e27-1a28-4929-9eb1-0503f1a4fc4e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:40:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74c82537-ce8a-4bdd-983a-3cfad6147d1d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4184, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:17Z', 'updated_at': '2021-12-09T22:20:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '7257da7c-1ae2-4377-8d16-b8f186ab5ae6', 'name': '', 'network_id': 'd2c4bf04-fd51-454e-b93e-6e6e4012c291', 'tenant_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'mac_address': 'fa:16:3e:81:9e:3b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '74c82537-ce8a-4bdd-983a-3cfad6147d1d', 'device_owner': 'network:router_interface', 'standard_attr_id': 4185, 'fixed_ips': [{'subnet_id': '96cbaf46-83b1-48f6-9738-17111c4a4dca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:19Z', 'updated_at': '2021-12-09T22:20:20Z', 'revision_number': 2, 'project_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'subnets': [{'id': '96cbaf46-83b1-48f6-9738-17111c4a4dca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:24.595990 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] Checking router: 74c82537-ce8a-4bdd-983a-3cfad6147d1d for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:20:24.596354 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] Updating router 74c82537-ce8a-4bdd-983a-3cfad6147d1d port 7257da7c-1ae2-4377-8d16-b8f186ab5ae6 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:20:24.626496 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:24.921975 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:24.929091 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:24.989627 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12dcef88-abac-4f80-b88c-33506bd325a0 None None] Pushing event updated for resources: {'Port': ['ID=7257da7c-1ae2-4377-8d16-b8f186ab5ae6,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:25.055503 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] Attempting to bind port 7257da7c-1ae2-4377-8d16-b8f186ab5ae6 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:20:25.055875 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] Attempting to bind port 7257da7c-1ae2-4377-8d16-b8f186ab5ae6 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '5ba61fcf-8990-4c4d-8d58-4a20e35a9f21', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'd2c4bf04-fd51-454e-b93e-6e6e4012c291'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:20:25.056234 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] Attempting to bind port 7257da7c-1ae2-4377-8d16-b8f186ab5ae6 on network d2c4bf04-fd51-454e-b93e-6e6e4012c291 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:20:25.065920 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 20, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:20:25.070977 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] Checking segment: {'id': '5ba61fcf-8990-4c4d-8d58-4a20e35a9f21', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'd2c4bf04-fd51-454e-b93e-6e6e4012c291'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:20:25.071517 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:25.072019 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] Bound using segment: {'id': '5ba61fcf-8990-4c4d-8d58-4a20e35a9f21', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'd2c4bf04-fd51-454e-b93e-6e6e4012c291'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:20:25.072541 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] Bound port: 7257da7c-1ae2-4377-8d16-b8f186ab5ae6, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5ba61fcf-8990-4c4d-8d58-4a20e35a9f21', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 144, 'network_id': 'd2c4bf04-fd51-454e-b93e-6e6e4012c291'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:20:25.072938 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:25.170625 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] For port 7257da7c-1ae2-4377-8d16-b8f186ab5ae6, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:20:25.177244 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] For port 7257da7c-1ae2-4377-8d16-b8f186ab5ae6, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7257da7c-1ae2-4377-8d16-b8f186ab5ae6,segment=NetworkSegment(5ba61fcf-8990-4c4d-8d58-4a20e35a9f21),segment_id=5ba61fcf-8990-4c4d-8d58-4a20e35a9f21)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:20:25.183362 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:25.247877 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12dcef88-abac-4f80-b88c-33506bd325a0 None None] Pushing event updated for resources: {'Port': ['ID=7257da7c-1ae2-4377-8d16-b8f186ab5ae6,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:25.258539 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] Routers {'74c82537-ce8a-4bdd-983a-3cfad6147d1d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:20:25.259167 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:20:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['74c82537-ce8a-4bdd-983a-3cfad6147d1d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:25.326858 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1df0d8c2-7a0f-43b8-8c8d-81cb0d350003 None None] Provisioning complete for port 7257da7c-1ae2-4377-8d16-b8f186ab5ae6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:25.327487 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1df0d8c2-7a0f-43b8-8c8d-81cb0d350003 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:25.373433 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] Set router 74c82537-ce8a-4bdd-983a-3cfad6147d1d gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:20:25.462618 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1df0d8c2-7a0f-43b8-8c8d-81cb0d350003 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:25.525790 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-1df0d8c2-7a0f-43b8-8c8d-81cb0d350003 None None] For port 7257da7c-1ae2-4377-8d16-b8f186ab5ae6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7257da7c-1ae2-4377-8d16-b8f186ab5ae6,segment=NetworkSegment(5ba61fcf-8990-4c4d-8d58-4a20e35a9f21),segment_id=5ba61fcf-8990-4c4d-8d58-4a20e35a9f21)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:20:25.533320 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1df0d8c2-7a0f-43b8-8c8d-81cb0d350003 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:25.599969 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1df0d8c2-7a0f-43b8-8c8d-81cb0d350003 None None] Pushing event updated for resources: {'Port': ['ID=7257da7c-1ae2-4377-8d16-b8f186ab5ae6,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:25.628071 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '74c82537-ce8a-4bdd-983a-3cfad6147d1d', 'name': 'tempest-TestMinimumBasicScenario-1848155188-router', 'tenant_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.183'}], 'enable_snat': True}, 'gw_port_id': '5a865e27-1a28-4929-9eb1-0503f1a4fc4e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:20:17Z', 'updated_at': '2021-12-09T22:20:20Z', 'revision_number': 4, 'project_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'gw_port': {'id': '5a865e27-1a28-4929-9eb1-0503f1a4fc4e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:40:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74c82537-ce8a-4bdd-983a-3cfad6147d1d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4184, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:17Z', 'updated_at': '2021-12-09T22:20:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '7257da7c-1ae2-4377-8d16-b8f186ab5ae6', 'name': '', 'network_id': 'd2c4bf04-fd51-454e-b93e-6e6e4012c291', 'tenant_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'mac_address': 'fa:16:3e:81:9e:3b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '74c82537-ce8a-4bdd-983a-3cfad6147d1d', 'device_owner': 'network:router_interface', 'standard_attr_id': 4185, 'fixed_ips': [{'subnet_id': '96cbaf46-83b1-48f6-9738-17111c4a4dca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:19Z', 'updated_at': '2021-12-09T22:20:25Z', 'revision_number': 4, 'project_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'subnets': [{'id': '96cbaf46-83b1-48f6-9738-17111c4a4dca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:20:25.655425 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6938eccd-b0aa-4a9a-a8da-367262d7f554 None None] The sync data for ids ['74c82537-ce8a-4bdd-983a-3cfad6147d1d'] in n-d-713301-27 is: [{'id': '74c82537-ce8a-4bdd-983a-3cfad6147d1d', 'name': 'tempest-TestMinimumBasicScenario-1848155188-router', 'tenant_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.183'}], 'enable_snat': True}, 'gw_port_id': '5a865e27-1a28-4929-9eb1-0503f1a4fc4e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:20:17Z', 'updated_at': '2021-12-09T22:20:20Z', 'revision_number': 4, 'project_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'gw_port': {'id': '5a865e27-1a28-4929-9eb1-0503f1a4fc4e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:40:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74c82537-ce8a-4bdd-983a-3cfad6147d1d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4184, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:17Z', 'updated_at': '2021-12-09T22:20:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '7257da7c-1ae2-4377-8d16-b8f186ab5ae6', 'name': '', 'network_id': 'd2c4bf04-fd51-454e-b93e-6e6e4012c291', 'tenant_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'mac_address': 'fa:16:3e:81:9e:3b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '74c82537-ce8a-4bdd-983a-3cfad6147d1d', 'device_owner': 'network:router_interface', 'standard_attr_id': 4185, 'fixed_ips': [{'subnet_id': '96cbaf46-83b1-48f6-9738-17111c4a4dca', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:19Z', 'updated_at': '2021-12-09T22:20:25Z', 'revision_number': 4, 'project_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'subnets': [{'id': '96cbaf46-83b1-48f6-9738-17111c4a4dca', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:20:25.660110 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-48dd06bf-50f8-437d-a0fd-8d3062571d98 None None] Provisioning complete for port 7257da7c-1ae2-4377-8d16-b8f186ab5ae6 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:25.660701 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-48dd06bf-50f8-437d-a0fd-8d3062571d98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:26.233154 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7257da7c-1ae2-4377-8d16-b8f186ab5ae6 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:20:26.455168 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 7257da7c-1ae2-4377-8d16-b8f186ab5ae6 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:26.455950 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:27.714942 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:27.764543 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:31.396830 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-da6cb09e-958f-4536-be58-fe94f392bd49 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:31.398416 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-da6cb09e-958f-4536-be58-fe94f392bd49 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/networks?id=20d197ac-b0d5-4136-851b-f803672ee9e2 HTTP/1.1" status: 200 len: 814 time: 0.1237233 Dec 09 22:20:31.414500 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-9a977390-2fd7-42c6-8e92-f3e555f6f6da tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/quotas/70ca64a954a041f5899f38ba64cf0fe9 HTTP/1.1" status: 200 len: 375 time: 0.0096002 Dec 09 22:20:31.470644 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-7914026a-65bd-4c1e-9d30-73f6b7d70190 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=70ca64a954a041f5899f38ba64cf0fe9&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0477188 Dec 09 22:20:31.571104 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-94604a6c-013d-46a1-a0e4-ae0245447172 service neutron] 10.222.0.13 "GET /v2.0/networks/20d197ac-b0d5-4136-851b-f803672ee9e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0877986 Dec 09 22:20:31.674071 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-363b056a-90af-4cdd-87ff-b2c652caf6ac service neutron] 10.222.0.13 "GET /v2.0/networks/20d197ac-b0d5-4136-851b-f803672ee9e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0966053 Dec 09 22:20:31.843466 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-05b0b44b-4f84-4446-923d-5f374b5d63a4 req-705eb0be-f95d-4c1f-93a7-9bbfbd71fb50 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 210 time: 0.0273380 Dec 09 22:20:32.840621 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-42115b8e-4536-48a4-a59b-126749cdc92b tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:32.842119 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-42115b8e-4536-48a4-a59b-126749cdc92b tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.10 "GET /v2.0/networks?id=20d197ac-b0d5-4136-851b-f803672ee9e2 HTTP/1.1" status: 200 len: 814 time: 0.1098268 Dec 09 22:20:32.856137 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-340176b8-01fc-4fd9-930e-f18b5339649c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Request body: {'port': {'device_id': '4e4af9c6-5777-4e4d-83b6-7677b23a5bf2', 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2', 'admin_state_up': True, 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:20:32.959024 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8296fd78-4bb1-471e-866b-6d55d105cb76 req-9e5235b0-77bc-4026-be02-518802a9661d tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 210 time: 0.0414321 Dec 09 22:20:33.001365 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-340176b8-01fc-4fd9-930e-f18b5339649c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Made reservation on behalf of 70ca64a954a041f5899f38ba64cf0fe9 for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:20:33.005029 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-340176b8-01fc-4fd9-930e-f18b5339649c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:33.028863 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dcfbc948-97de-4ba9-be26-e3ee078704ea None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:33.157640 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-340176b8-01fc-4fd9-930e-f18b5339649c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Allocated IP 172.20.0.12 (20d197ac-b0d5-4136-851b-f803672ee9e2/9016b68e-6021-4bdc-a7b1-be26d9de403a/144004a1-e56f-4a7a-a651-c300c1f3c832) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:20:33.385283 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-340176b8-01fc-4fd9-930e-f18b5339649c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:33.429540 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-340176b8-01fc-4fd9-930e-f18b5339649c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:33.482646 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-340176b8-01fc-4fd9-930e-f18b5339649c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Network 20d197ac-b0d5-4136-851b-f803672ee9e2 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:20:33.486086 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-340176b8-01fc-4fd9-930e-f18b5339649c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:20:33.489110 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-340176b8-01fc-4fd9-930e-f18b5339649c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:20:33.519583 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-340176b8-01fc-4fd9-930e-f18b5339649c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Pushing event updated for resources: {'Port': ['ID=144004a1-e56f-4a7a-a651-c300c1f3c832,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:33.559761 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-340176b8-01fc-4fd9-930e-f18b5339649c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:33.561347 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-340176b8-01fc-4fd9-930e-f18b5339649c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:33.581434 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-340176b8-01fc-4fd9-930e-f18b5339649c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7293270 Dec 09 22:20:33.767938 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-cd16ea66-ef6b-464f-9242-1abe2cc58b9c None None] Provisioning complete for port 144004a1-e56f-4a7a-a651-c300c1f3c832 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:33.768196 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cd16ea66-ef6b-464f-9242-1abe2cc58b9c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:33.807934 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-cd16ea66-ef6b-464f-9242-1abe2cc58b9c None None] Port 144004a1-e56f-4a7a-a651-c300c1f3c832 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:20:34.089463 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78d68b69-6421-48b5-9a59-37e317806142 req-45982137-738e-4201-9846-20ccfa471238 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:34.092174 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78d68b69-6421-48b5-9a59-37e317806142 req-45982137-738e-4201-9846-20ccfa471238 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 932 time: 0.0570190 Dec 09 22:20:34.142264 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78d68b69-6421-48b5-9a59-37e317806142 req-b56fb7c1-9fed-4a32-a37f-39fa313c6d02 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439653 Dec 09 22:20:35.261598 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21bfd5b4-df76-4be4-9b48-b8463adcbe87 req-38ac363b-7a32-4d66-9be2-81923f4275d4 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:35.263116 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-21bfd5b4-df76-4be4-9b48-b8463adcbe87 req-38ac363b-7a32-4d66-9be2-81923f4275d4 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 932 time: 0.0507841 Dec 09 22:20:35.317803 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-21bfd5b4-df76-4be4-9b48-b8463adcbe87 req-bfaf2948-bcb1-4d96-84fd-c772f7e7b2a2 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0481863 Dec 09 22:20:35.666005 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-42363479-3054-49f8-81e7-8802c6aa9ace None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:36.751338 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a10659cc-79cd-47ac-b6ae-caf758a7765e req-cb5eaf26-95f3-482e-b6d4-90dba3a09260 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:36.752871 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a10659cc-79cd-47ac-b6ae-caf758a7765e req-cb5eaf26-95f3-482e-b6d4-90dba3a09260 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 932 time: 0.3607934 Dec 09 22:20:36.804621 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a10659cc-79cd-47ac-b6ae-caf758a7765e req-5a4ded22-3018-4c55-bc39-7bb34d83637a tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450802 Dec 09 22:20:36.858685 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:37.930960 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bbd6dd4-8901-40de-b175-06be2733a98e req-2027a69e-c1eb-498b-bfd9-4f41f42d6589 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:37.932516 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8bbd6dd4-8901-40de-b175-06be2733a98e req-2027a69e-c1eb-498b-bfd9-4f41f42d6589 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 932 time: 0.0538287 Dec 09 22:20:37.980375 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8bbd6dd4-8901-40de-b175-06be2733a98e req-c28110ff-1e59-41d3-908b-09b68eca861f tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418310 Dec 09 22:20:38.198238 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:39.109006 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a5613ee-278b-458b-b0d7-d12a18a07ee4 req-3426feb6-ecd2-4331-bccd-2cc136cb2c30 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:39.110593 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a5613ee-278b-458b-b0d7-d12a18a07ee4 req-3426feb6-ecd2-4331-bccd-2cc136cb2c30 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 932 time: 0.0570912 Dec 09 22:20:39.165082 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9a5613ee-278b-458b-b0d7-d12a18a07ee4 req-c714ce6f-5101-4c9b-b513-42a7783072f0 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477800 Dec 09 22:20:39.696431 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:40.292675 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1961edb6-865c-455e-8383-af33a0db567c req-b02d6dc2-64ef-4d46-9005-2db356c48332 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:40.294329 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1961edb6-865c-455e-8383-af33a0db567c req-b02d6dc2-64ef-4d46-9005-2db356c48332 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 932 time: 0.0500300 Dec 09 22:20:40.344146 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1961edb6-865c-455e-8383-af33a0db567c req-b91de725-b6a6-4bce-bf35-0c227072c790 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427234 Dec 09 22:20:41.482651 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7a9be1e-2cd5-4d58-b372-8b60255d978b req-7a5e0f3f-3b8c-4e8b-a706-e3fce0e11b6c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:41.484225 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7a9be1e-2cd5-4d58-b372-8b60255d978b req-7a5e0f3f-3b8c-4e8b-a706-e3fce0e11b6c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 932 time: 0.0567465 Dec 09 22:20:41.548056 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7a9be1e-2cd5-4d58-b372-8b60255d978b req-031bce01-5fa6-4e62-8616-d98351076b63 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0565488 Dec 09 22:20:42.673398 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aa16f4b-eace-4c5c-b7cd-26b000a0a685 req-fcc5067f-6538-4df2-bf23-43bc967c48b8 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:42.674917 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6aa16f4b-eace-4c5c-b7cd-26b000a0a685 req-fcc5067f-6538-4df2-bf23-43bc967c48b8 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 932 time: 0.0512681 Dec 09 22:20:42.725277 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6aa16f4b-eace-4c5c-b7cd-26b000a0a685 req-4870ae1e-de34-433c-a512-7471f38fad32 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441246 Dec 09 22:20:43.336400 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-ce02e491-b473-4f4f-8027-998fa87172fc tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 22:20:43.337964 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-ce02e491-b473-4f4f-8027-998fa87172fc tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.10 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0086195 Dec 09 22:20:43.351215 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-c1ee2879-77ce-4531-b4f4-19da3e2e253d service neutron] Request body: {'port': {'device_id': '4e4af9c6-5777-4e4d-83b6-7677b23a5bf2', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:20:43.414853 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-c1ee2879-77ce-4531-b4f4-19da3e2e253d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:43.690305 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-c1ee2879-77ce-4531-b4f4-19da3e2e253d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 144004a1-e56f-4a7a-a651-c300c1f3c832 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:20:43.697856 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-c1ee2879-77ce-4531-b4f4-19da3e2e253d service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:43.709924 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-c1ee2879-77ce-4531-b4f4-19da3e2e253d service neutron] Transition to ACTIVE for port object 144004a1-e56f-4a7a-a651-c300c1f3c832 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:20:43.716204 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-c1ee2879-77ce-4531-b4f4-19da3e2e253d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:43.766642 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1ee2879-77ce-4531-b4f4-19da3e2e253d service neutron] Pushing event updated for resources: {'Port': ['ID=144004a1-e56f-4a7a-a651-c300c1f3c832,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:43.874644 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-c1ee2879-77ce-4531-b4f4-19da3e2e253d service neutron] Attempting to bind port 144004a1-e56f-4a7a-a651-c300c1f3c832 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:20:43.874983 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-c1ee2879-77ce-4531-b4f4-19da3e2e253d service neutron] Attempting to bind port 144004a1-e56f-4a7a-a651-c300c1f3c832 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '16bdd335-351c-4e9d-bde1-07a4c99d195c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:20:43.875316 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-c1ee2879-77ce-4531-b4f4-19da3e2e253d service neutron] Attempting to bind port 144004a1-e56f-4a7a-a651-c300c1f3c832 on network 20d197ac-b0d5-4136-851b-f803672ee9e2 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:20:43.889007 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a70ace34-7959-4e98-a2d4-b2a0f41b0b84 req-5134554a-189e-4af3-b744-20f6a0fd9759 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:43.890521 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a70ace34-7959-4e98-a2d4-b2a0f41b0b84 req-5134554a-189e-4af3-b744-20f6a0fd9759 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 944 time: 0.0797524 Dec 09 22:20:43.891116 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-c1ee2879-77ce-4531-b4f4-19da3e2e253d service neutron] Port 144004a1-e56f-4a7a-a651-c300c1f3c832 on network 20d197ac-b0d5-4136-851b-f803672ee9e2 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:20:43.891487 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-c1ee2879-77ce-4531-b4f4-19da3e2e253d service neutron] Attempting to bind port 144004a1-e56f-4a7a-a651-c300c1f3c832 on network 20d197ac-b0d5-4136-851b-f803672ee9e2 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:20:43.898610 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-c1ee2879-77ce-4531-b4f4-19da3e2e253d service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 20, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:20:43.898945 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-c1ee2879-77ce-4531-b4f4-19da3e2e253d service neutron] Checking segment: {'id': '16bdd335-351c-4e9d-bde1-07a4c99d195c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:20:43.899329 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-c1ee2879-77ce-4531-b4f4-19da3e2e253d service neutron] Bound using segment: {'id': '16bdd335-351c-4e9d-bde1-07a4c99d195c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:20:43.899786 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-c1ee2879-77ce-4531-b4f4-19da3e2e253d service neutron] Bound port: 144004a1-e56f-4a7a-a651-c300c1f3c832, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '16bdd335-351c-4e9d-bde1-07a4c99d195c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 111, 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:20:43.900144 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-c1ee2879-77ce-4531-b4f4-19da3e2e253d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:43.980886 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a70ace34-7959-4e98-a2d4-b2a0f41b0b84 req-0d832c64-88ea-4bc0-af59-67a6f8610163 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0832314 Dec 09 22:20:44.000293 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-c1ee2879-77ce-4531-b4f4-19da3e2e253d service neutron] For port 144004a1-e56f-4a7a-a651-c300c1f3c832, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:20:44.003653 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-c1ee2879-77ce-4531-b4f4-19da3e2e253d service neutron] For port 144004a1-e56f-4a7a-a651-c300c1f3c832, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=144004a1-e56f-4a7a-a651-c300c1f3c832,segment=NetworkSegment(16bdd335-351c-4e9d-bde1-07a4c99d195c),segment_id=16bdd335-351c-4e9d-bde1-07a4c99d195c)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:20:44.009126 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-c1ee2879-77ce-4531-b4f4-19da3e2e253d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:44.045060 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-c1ee2879-77ce-4531-b4f4-19da3e2e253d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:44.045689 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-c1ee2879-77ce-4531-b4f4-19da3e2e253d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:44.047044 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-c1ee2879-77ce-4531-b4f4-19da3e2e253d service neutron] 10.222.0.10 "PUT /v2.0/ports/144004a1-e56f-4a7a-a651-c300c1f3c832 HTTP/1.1" status: 200 len: 1093 time: 0.7000642 Dec 09 22:20:44.047490 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4e4af9c6-5777-4e4d-83b6-7677b23a5bf2', 'tag': '144004a1-e56f-4a7a-a651-c300c1f3c832'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:20:44.049794 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0a38c557-08b7-4bd8-b786-fe0ec2416bc2" -d '{"events": [{"name": "network-changed", "server_uuid": "4e4af9c6-5777-4e4d-83b6-7677b23a5bf2", "tag": "144004a1-e56f-4a7a-a651-c300c1f3c832"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:20:44.076878 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1ee2879-77ce-4531-b4f4-19da3e2e253d service neutron] Pushing event updated for resources: {'Port': ['ID=144004a1-e56f-4a7a-a651-c300c1f3c832,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:44.093340 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:20:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-40355152-204f-459b-b92f-f1cd1f91bf64 x-openstack-request-id: req-40355152-204f-459b-b92f-f1cd1f91bf64 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:20:44.093639 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4e4af9c6-5777-4e4d-83b6-7677b23a5bf2", "tag": "144004a1-e56f-4a7a-a651-c300c1f3c832", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:20:44.094038 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-40355152-204f-459b-b92f-f1cd1f91bf64 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:20:44.094317 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4e4af9c6-5777-4e4d-83b6-7677b23a5bf2', 'tag': '144004a1-e56f-4a7a-a651-c300c1f3c832', 'status': 'completed', 'code': 200} Dec 09 22:20:44.137778 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-c3f1cfc0-e079-4d03-8d51-d698c51df0dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:44.139311 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-c3f1cfc0-e079-4d03-8d51-d698c51df0dc service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=70ca64a954a041f5899f38ba64cf0fe9&device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 1096 time: 0.0430286 Dec 09 22:20:44.183391 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-fb526377-1e24-4067-ade7-53433ebd0170 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=144004a1-e56f-4a7a-a651-c300c1f3c832 HTTP/1.1" status: 200 len: 217 time: 0.0359087 Dec 09 22:20:44.237788 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-7ca1d110-73a7-4747-8a72-36e12fe093d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:44.239299 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-7ca1d110-73a7-4747-8a72-36e12fe093d0 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9016b68e-6021-4bdc-a7b1-be26d9de403a HTTP/1.1" status: 200 len: 853 time: 0.0491004 Dec 09 22:20:44.286641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-69882607-81f5-4fe4-86d9-04a66251a026 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:44.288171 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-69882607-81f5-4fe4-86d9-04a66251a026 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=20d197ac-b0d5-4136-851b-f803672ee9e2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0419285 Dec 09 22:20:44.384295 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-49a2e7bd-55b5-42cc-ac0d-06bf45653176 service neutron] 10.222.0.10 "GET /v2.0/networks/20d197ac-b0d5-4136-851b-f803672ee9e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0880940 Dec 09 22:20:44.483080 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f80957b6-39e6-4e1e-ae5f-26fee8fd2a78 req-2de23a15-e5f6-4b9b-871a-d27f66706e03 service neutron] 10.222.0.10 "GET /v2.0/networks/20d197ac-b0d5-4136-851b-f803672ee9e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0907998 Dec 09 22:20:44.585462 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a38c557-08b7-4bd8-b786-fe0ec2416bc2 req-a4d44d4a-b7cc-4f88-923c-89ff113c6cb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:44.586947 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a38c557-08b7-4bd8-b786-fe0ec2416bc2 req-a4d44d4a-b7cc-4f88-923c-89ff113c6cb6 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=70ca64a954a041f5899f38ba64cf0fe9&device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 1096 time: 0.0403771 Dec 09 22:20:44.684794 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a38c557-08b7-4bd8-b786-fe0ec2416bc2 req-47189467-4683-4e1b-85f0-3b721c18f38d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:44.686314 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a38c557-08b7-4bd8-b786-fe0ec2416bc2 req-47189467-4683-4e1b-85f0-3b721c18f38d service neutron] 10.222.0.10 "GET /v2.0/networks?id=20d197ac-b0d5-4136-851b-f803672ee9e2 HTTP/1.1" status: 200 len: 915 time: 0.0925422 Dec 09 22:20:44.728381 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a38c557-08b7-4bd8-b786-fe0ec2416bc2 req-036e6f47-fdec-4f89-b26b-f786de3c8b92 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=144004a1-e56f-4a7a-a651-c300c1f3c832 HTTP/1.1" status: 200 len: 217 time: 0.0343201 Dec 09 22:20:44.784569 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a38c557-08b7-4bd8-b786-fe0ec2416bc2 req-5f1e63ff-ea73-465b-b550-4bc704f59fc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:44.785968 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a38c557-08b7-4bd8-b786-fe0ec2416bc2 req-5f1e63ff-ea73-465b-b550-4bc704f59fc9 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9016b68e-6021-4bdc-a7b1-be26d9de403a HTTP/1.1" status: 200 len: 853 time: 0.0499914 Dec 09 22:20:44.833369 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a38c557-08b7-4bd8-b786-fe0ec2416bc2 req-893ba62d-a02e-47bb-95a0-e886547f7319 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:44.834902 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a38c557-08b7-4bd8-b786-fe0ec2416bc2 req-893ba62d-a02e-47bb-95a0-e886547f7319 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=20d197ac-b0d5-4136-851b-f803672ee9e2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0417221 Dec 09 22:20:44.926378 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a38c557-08b7-4bd8-b786-fe0ec2416bc2 req-b3eade7a-7f2c-43e9-bf77-3e4e47dd833b service neutron] 10.222.0.10 "GET /v2.0/networks/20d197ac-b0d5-4136-851b-f803672ee9e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0828216 Dec 09 22:20:45.022330 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0a38c557-08b7-4bd8-b786-fe0ec2416bc2 req-a70bccfe-dc7e-4cd5-9f9d-4689ce5e7d90 service neutron] 10.222.0.10 "GET /v2.0/networks/20d197ac-b0d5-4136-851b-f803672ee9e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0878983 Dec 09 22:20:45.101743 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c79e07-1adc-4899-a6ff-f7d83eafdc59 req-ced9afbc-7de1-4e6a-8975-68804d45e797 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:45.103198 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50c79e07-1adc-4899-a6ff-f7d83eafdc59 req-ced9afbc-7de1-4e6a-8975-68804d45e797 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 944 time: 0.0512466 Dec 09 22:20:45.154826 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50c79e07-1adc-4899-a6ff-f7d83eafdc59 req-4578adc0-a0d1-41fb-a670-806b552d3d76 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450909 Dec 09 22:20:45.306192 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:20:46.305382 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0ffde15-ce5e-4768-abcb-499fba337e3b req-84195506-d2f3-4fba-bd03-8ad3b68d42bc tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:46.306886 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0ffde15-ce5e-4768-abcb-499fba337e3b req-84195506-d2f3-4fba-bd03-8ad3b68d42bc tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 944 time: 0.0647264 Dec 09 22:20:46.354930 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0ffde15-ce5e-4768-abcb-499fba337e3b req-90851fc3-f548-4ece-a74e-e814f841a7c0 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415699 Dec 09 22:20:47.483620 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc9a7e87-6ef2-4d21-9783-1949bced905b req-24124bab-9d12-47be-9965-f46e5653bbe5 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:47.485110 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc9a7e87-6ef2-4d21-9783-1949bced905b req-24124bab-9d12-47be-9965-f46e5653bbe5 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 944 time: 0.0573933 Dec 09 22:20:47.535359 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc9a7e87-6ef2-4d21-9783-1949bced905b req-54fd9c2c-58e5-414a-a2af-07ae7e484d14 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414560 Dec 09 22:20:47.566126 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 144004a1-e56f-4a7a-a651-c300c1f3c832 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:20:47.676482 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 144004a1-e56f-4a7a-a651-c300c1f3c832, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=144004a1-e56f-4a7a-a651-c300c1f3c832,segment=NetworkSegment(16bdd335-351c-4e9d-bde1-07a4c99d195c),segment_id=16bdd335-351c-4e9d-bde1-07a4c99d195c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:20:47.688816 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '144004a1-e56f-4a7a-a651-c300c1f3c832', 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2', 'port_id': '144004a1-e56f-4a7a-a651-c300c1f3c832', 'mac_address': 'fa:16:3e:b0:0c:e3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 111, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9016b68e-6021-4bdc-a7b1-be26d9de403a', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:20:47.730008 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:47.744208 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 144004a1-e56f-4a7a-a651-c300c1f3c832 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:20:47.772713 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 144004a1-e56f-4a7a-a651-c300c1f3c832, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=144004a1-e56f-4a7a-a651-c300c1f3c832,segment=NetworkSegment(16bdd335-351c-4e9d-bde1-07a4c99d195c),segment_id=16bdd335-351c-4e9d-bde1-07a4c99d195c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:20:47.779144 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:47.830262 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=144004a1-e56f-4a7a-a651-c300c1f3c832,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:47.837712 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:47.838054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:47.838387 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:47.838718 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:47.839041 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:47.839361 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:47.839670 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:47.840023 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:47.840305 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:47.840649 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:47.841005 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:47.841357 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:47.841653 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:20:48.003423 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['144004a1-e56f-4a7a-a651-c300c1f3c832'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:20:48.676418 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce317950-bd2d-45e9-9767-e0799e6cdfc4 req-bdb63c1c-db29-47de-bfb9-1937ede87aab tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:48.678064 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ce317950-bd2d-45e9-9767-e0799e6cdfc4 req-bdb63c1c-db29-47de-bfb9-1937ede87aab tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 945 time: 0.0639775 Dec 09 22:20:48.729448 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ce317950-bd2d-45e9-9767-e0799e6cdfc4 req-5621221f-3112-421b-8081-65a97bd61c3c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450022 Dec 09 22:20:49.571740 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 144004a1-e56f-4a7a-a651-c300c1f3c832 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:20:49.626936 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 144004a1-e56f-4a7a-a651-c300c1f3c832 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:20:49.631064 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 144004a1-e56f-4a7a-a651-c300c1f3c832 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:20:49.631480 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:49.734015 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:49.759500 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4e4af9c6-5777-4e4d-83b6-7677b23a5bf2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '144004a1-e56f-4a7a-a651-c300c1f3c832'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:20:49.761538 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-865afce6-85ae-49a6-ad2a-d340055def60" -d '{"events": [{"server_uuid": "4e4af9c6-5777-4e4d-83b6-7677b23a5bf2", "name": "network-vif-plugged", "status": "completed", "tag": "144004a1-e56f-4a7a-a651-c300c1f3c832"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:20:49.775094 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 144004a1-e56f-4a7a-a651-c300c1f3c832, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=144004a1-e56f-4a7a-a651-c300c1f3c832,segment=NetworkSegment(16bdd335-351c-4e9d-bde1-07a4c99d195c),segment_id=16bdd335-351c-4e9d-bde1-07a4c99d195c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:20:49.780448 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:49.831829 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=144004a1-e56f-4a7a-a651-c300c1f3c832,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:20:49.854031 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba2916c8-e6c0-4c67-b7cb-9b500613f063 req-6cbd9ad0-eb44-4c59-92c7-3495167b2da9 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:49.855572 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba2916c8-e6c0-4c67-b7cb-9b500613f063 req-6cbd9ad0-eb44-4c59-92c7-3495167b2da9 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 946 time: 0.0539305 Dec 09 22:20:49.904748 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba2916c8-e6c0-4c67-b7cb-9b500613f063 req-2608c259-45c9-470a-ac93-73aad20206c2 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414474 Dec 09 22:20:49.952582 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:20:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-95119bbc-b1a4-466d-b8ad-8fed0c37619e x-openstack-request-id: req-95119bbc-b1a4-466d-b8ad-8fed0c37619e {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:20:49.952888 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4e4af9c6-5777-4e4d-83b6-7677b23a5bf2", "name": "network-vif-plugged", "status": "completed", "tag": "144004a1-e56f-4a7a-a651-c300c1f3c832", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:20:49.953144 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-95119bbc-b1a4-466d-b8ad-8fed0c37619e {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:20:49.953552 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4e4af9c6-5777-4e4d-83b6-7677b23a5bf2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '144004a1-e56f-4a7a-a651-c300c1f3c832', 'code': 200} Dec 09 22:20:50.056856 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19cc6564-c357-4403-980a-58360b9b0567 req-9e309a39-8011-444e-a47a-e6c1bbb8d289 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:50.058363 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19cc6564-c357-4403-980a-58360b9b0567 req-9e309a39-8011-444e-a47a-e6c1bbb8d289 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 1098 time: 0.0420716 Dec 09 22:20:50.109540 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19cc6564-c357-4403-980a-58360b9b0567 req-63afc8ca-3c97-4d21-8980-7893e5a92ae7 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430632 Dec 09 22:20:51.031805 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9d7f153-03ab-42a5-9217-a82b6a052c2f req-65371924-7517-4ade-b413-3e7e457b9cff tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:51.033298 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e9d7f153-03ab-42a5-9217-a82b6a052c2f req-65371924-7517-4ade-b413-3e7e457b9cff tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 946 time: 0.0515037 Dec 09 22:20:51.083122 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e9d7f153-03ab-42a5-9217-a82b6a052c2f req-7e7749bd-5891-4989-a050-c125c9b41ea7 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433166 Dec 09 22:20:52.208581 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a7f25e-28e8-4f23-9c63-672e48c3e8df req-c7c47d37-a366-4b2b-81e4-03f7a73973ac tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:52.210051 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02a7f25e-28e8-4f23-9c63-672e48c3e8df req-c7c47d37-a366-4b2b-81e4-03f7a73973ac tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 946 time: 0.0517175 Dec 09 22:20:52.271800 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-02a7f25e-28e8-4f23-9c63-672e48c3e8df req-4f1d6360-457a-45b1-8d2d-3b3f4272e04b tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524900 Dec 09 22:20:52.396708 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7242053-6c08-45cd-8f21-87be2599a4bd req-0b5d6efe-03a6-49ac-b9ca-e05e96c96570 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:52.398208 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7242053-6c08-45cd-8f21-87be2599a4bd req-0b5d6efe-03a6-49ac-b9ca-e05e96c96570 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 946 time: 0.0560784 Dec 09 22:20:52.449871 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7242053-6c08-45cd-8f21-87be2599a4bd req-d268c78d-ade7-4257-808f-e3b6b3bac7c6 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428090 Dec 09 22:20:52.655731 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d969ee-5889-48e3-a7a6-1ba2b8bb332e req-46da3315-b635-4576-a2ad-1258087a3ca0 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:20:52.657331 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b4d969ee-5889-48e3-a7a6-1ba2b8bb332e req-46da3315-b635-4576-a2ad-1258087a3ca0 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 946 time: 0.0502083 Dec 09 22:20:52.711343 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b4d969ee-5889-48e3-a7a6-1ba2b8bb332e req-83977010-ccdf-464b-a643-5f311dcffb2d tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452232 Dec 09 22:20:57.670105 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:57.768978 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:20:59.950116 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a06b19ff-fbb9-496c-ad7c-541f7dd92ca3 req-4bba860f-e597-409c-93ab-f89c1849d957 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.1452546 Dec 09 22:21:00.039303 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a06b19ff-fbb9-496c-ad7c-541f7dd92ca3 req-0ed11a14-cb86-4038-96d3-e156838317a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:00.040895 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a06b19ff-fbb9-496c-ad7c-541f7dd92ca3 req-0ed11a14-cb86-4038-96d3-e156838317a1 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=70ca64a954a041f5899f38ba64cf0fe9&device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 1098 time: 0.0459669 Dec 09 22:21:00.150705 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a06b19ff-fbb9-496c-ad7c-541f7dd92ca3 req-83524ed6-116f-4b42-b096-5fbc195d3d1f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:00.152246 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a06b19ff-fbb9-496c-ad7c-541f7dd92ca3 req-83524ed6-116f-4b42-b096-5fbc195d3d1f service neutron] 10.222.0.10 "GET /v2.0/networks?id=20d197ac-b0d5-4136-851b-f803672ee9e2 HTTP/1.1" status: 200 len: 915 time: 0.0883546 Dec 09 22:21:00.198698 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a06b19ff-fbb9-496c-ad7c-541f7dd92ca3 req-7f612384-8d3a-4588-9684-e9b1aa722988 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=144004a1-e56f-4a7a-a651-c300c1f3c832 HTTP/1.1" status: 200 len: 217 time: 0.0398033 Dec 09 22:21:00.249036 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a06b19ff-fbb9-496c-ad7c-541f7dd92ca3 req-47edbb4d-32ab-465e-8a53-b8b56af538a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:00.250458 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a06b19ff-fbb9-496c-ad7c-541f7dd92ca3 req-47edbb4d-32ab-465e-8a53-b8b56af538a2 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9016b68e-6021-4bdc-a7b1-be26d9de403a HTTP/1.1" status: 200 len: 853 time: 0.0448122 Dec 09 22:21:00.296775 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a06b19ff-fbb9-496c-ad7c-541f7dd92ca3 req-1a6f359c-7e55-483c-af8a-c81dc9a31953 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:00.298235 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a06b19ff-fbb9-496c-ad7c-541f7dd92ca3 req-1a6f359c-7e55-483c-af8a-c81dc9a31953 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=20d197ac-b0d5-4136-851b-f803672ee9e2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0412757 Dec 09 22:21:00.400025 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a06b19ff-fbb9-496c-ad7c-541f7dd92ca3 req-49d314ec-c914-41d3-8be5-33be30c9d98f service neutron] 10.222.0.10 "GET /v2.0/networks/20d197ac-b0d5-4136-851b-f803672ee9e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0944152 Dec 09 22:21:00.499079 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a06b19ff-fbb9-496c-ad7c-541f7dd92ca3 req-1ae9ad71-9039-454b-9dcc-8baca020e017 service neutron] 10.222.0.10 "GET /v2.0/networks/20d197ac-b0d5-4136-851b-f803672ee9e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0913651 Dec 09 22:21:03.027367 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8cda7907-6e61-4b9f-969c-8cfd148e43c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:05.396583 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91763452-84d2-4ef4-8a65-e21df8c76fbd req-f17abf19-8ebb-4997-9f51-3640a7e28bea tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:05.398122 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-91763452-84d2-4ef4-8a65-e21df8c76fbd req-f17abf19-8ebb-4997-9f51-3640a7e28bea tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 946 time: 0.0630832 Dec 09 22:21:05.445978 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-91763452-84d2-4ef4-8a65-e21df8c76fbd req-e5be0d30-a613-4ad4-8faf-c1f8d99da635 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416615 Dec 09 22:21:05.478452 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33670) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:21:05.562025 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b513c7ef-4422-424a-9bdf-b035082b70ce tempest-TestMinimumBasicScenario-816204501 tempest-TestMinimumBasicScenario-816204501-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:05.563602 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b513c7ef-4422-424a-9bdf-b035082b70ce tempest-TestMinimumBasicScenario-816204501 tempest-TestMinimumBasicScenario-816204501-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 1093 time: 0.0840371 Dec 09 22:21:05.566907 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33674) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:21:05.573760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': '144004a1-e56f-4a7a-a651-c300c1f3c832', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'fixed_ip_address': '172.20.0.12'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:21:05.606928 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for floatingip, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:05.661227 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-15e71156-3682-41dd-9961-e51752b89087 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:05.712349 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:05.827360 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Allocated IP 172.25.3.44 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/1aa3c51d-82cb-4164-ab8d-8d38a3713855) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:21:05.935937 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:05.974047 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:06.010769 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:21:06.013628 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:21:06.019725 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:21:06.025678 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Pushing event updated for resources: {'Port': ['ID=1aa3c51d-82cb-4164-ab8d-8d38a3713855,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:21:06.057385 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:06.057739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:06.058093 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:06.058436 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:06.058778 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:06.059113 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:06.059468 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:06.059810 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:06.060140 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:06.060473 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:06.060807 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:06.061123 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:06.061438 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:06.403726 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:06.476259 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:06.630680 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:06.638022 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:06.708289 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Pushing event updated for resources: {'Port': ['ID=1aa3c51d-82cb-4164-ab8d-8d38a3713855,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:21:06.721217 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:06.830221 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Floating IP 1ad8b14e-6a35-4b1e-a795-7f2436653d64 associated. External IP: 172.25.3.44, port: 144004a1-e56f-4a7a-a651-c300c1f3c832. Dec 09 22:21:06.857353 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:07.042661 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Router 24626fb7-c6a2-4824-af06-13284de6ee53 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:21:07.156408 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:21:07.167879 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8a784ff-69c6-45db-81ed-aeea49445aa0 None None] Sync routers for ids ['24626fb7-c6a2-4824-af06-13284de6ee53'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:21:07.178463 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8a784ff-69c6-45db-81ed-aeea49445aa0 None None] Routers {'24626fb7-c6a2-4824-af06-13284de6ee53'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:21:07.178705 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:07.179378 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-c8a784ff-69c6-45db-81ed-aeea49445aa0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:21:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['24626fb7-c6a2-4824-af06-13284de6ee53'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:21:07.211005 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b5f7a05d-d206-4d5f-836c-1254273292bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.6428218 Dec 09 22:21:07.212051 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4e4af9c6-5777-4e4d-83b6-7677b23a5bf2', 'tag': '144004a1-e56f-4a7a-a651-c300c1f3c832'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:21:07.214727 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33676) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:21:07.215287 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2c81949f-41b2-4d21-8b80-b95b6740566f" -d '{"events": [{"name": "network-changed", "server_uuid": "4e4af9c6-5777-4e4d-83b6-7677b23a5bf2", "tag": "144004a1-e56f-4a7a-a651-c300c1f3c832"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:21:07.221084 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a29dcfe9-adc2-4999-bea9-43890d506c75 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1556501211', 'description': 'tempest-secgroup-smoke-1556501211 description', 'project_id': '70ca64a954a041f5899f38ba64cf0fe9'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:21:07.253547 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a29dcfe9-adc2-4999-bea9-43890d506c75 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:07.262040 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:21:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1964e70d-0912-4541-8ca8-70dca570dd71 x-openstack-request-id: req-1964e70d-0912-4541-8ca8-70dca570dd71 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:21:07.262341 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4e4af9c6-5777-4e4d-83b6-7677b23a5bf2", "tag": "144004a1-e56f-4a7a-a651-c300c1f3c832", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:21:07.262599 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-1964e70d-0912-4541-8ca8-70dca570dd71 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:21:07.263026 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4e4af9c6-5777-4e4d-83b6-7677b23a5bf2', 'tag': '144004a1-e56f-4a7a-a651-c300c1f3c832', 'status': 'completed', 'code': 200} Dec 09 22:21:07.294169 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-c8a784ff-69c6-45db-81ed-aeea49445aa0 None None] Set router 24626fb7-c6a2-4824-af06-13284de6ee53 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:21:07.349036 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c81949f-41b2-4d21-8b80-b95b6740566f req-e39cfca7-f4eb-4456-ac47-dd9453ce28a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:07.351094 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c81949f-41b2-4d21-8b80-b95b6740566f req-e39cfca7-f4eb-4456-ac47-dd9453ce28a1 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=70ca64a954a041f5899f38ba64cf0fe9&device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 1098 time: 0.0630248 Dec 09 22:21:07.391958 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a29dcfe9-adc2-4999-bea9-43890d506c75 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:07.407805 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a29dcfe9-adc2-4999-bea9-43890d506c75 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:07.473453 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a29dcfe9-adc2-4999-bea9-43890d506c75 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:07.474737 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a29dcfe9-adc2-4999-bea9-43890d506c75 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.2587795 Dec 09 22:21:07.475575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a29dcfe9-adc2-4999-bea9-43890d506c75 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f4262001-ea37-441d-9ef7-adc0bceb8b59,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:21:07.478769 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33680) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:21:07.485736 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-2ae8dc49-12ed-4684-87cb-1b99ce1d80b4 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Request body: {'security_group_rule': {'security_group_id': 'f4262001-ea37-441d-9ef7-adc0bceb8b59', 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:21:07.489059 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a29dcfe9-adc2-4999-bea9-43890d506c75 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:07.489404 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a29dcfe9-adc2-4999-bea9-43890d506c75 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:07.489750 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a29dcfe9-adc2-4999-bea9-43890d506c75 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:07.490081 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a29dcfe9-adc2-4999-bea9-43890d506c75 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:07.490467 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a29dcfe9-adc2-4999-bea9-43890d506c75 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:07.490794 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a29dcfe9-adc2-4999-bea9-43890d506c75 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:07.491122 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a29dcfe9-adc2-4999-bea9-43890d506c75 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:07.491468 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a29dcfe9-adc2-4999-bea9-43890d506c75 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:07.491789 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a29dcfe9-adc2-4999-bea9-43890d506c75 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:07.492114 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a29dcfe9-adc2-4999-bea9-43890d506c75 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:07.492429 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a29dcfe9-adc2-4999-bea9-43890d506c75 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:07.492747 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a29dcfe9-adc2-4999-bea9-43890d506c75 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:07.493066 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a29dcfe9-adc2-4999-bea9-43890d506c75 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:21:07.505723 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c81949f-41b2-4d21-8b80-b95b6740566f req-973d9816-0eed-4b97-a0f6-6b947fe013b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:07.507275 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c81949f-41b2-4d21-8b80-b95b6740566f req-973d9816-0eed-4b97-a0f6-6b947fe013b3 service neutron] 10.222.0.10 "GET /v2.0/networks?id=20d197ac-b0d5-4136-851b-f803672ee9e2 HTTP/1.1" status: 200 len: 915 time: 0.1467938 Dec 09 22:21:07.549194 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ae8dc49-12ed-4684-87cb-1b99ce1d80b4 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:07.556781 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-c8a784ff-69c6-45db-81ed-aeea49445aa0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'name': 'tempest-TestMinimumBasicScenario-304437312-router', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228'}], 'enable_snat': True}, 'gw_port_id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:15Z', 'revision_number': 4, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'gw_port': {'id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:bb:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4172, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '1ad8b14e-6a35-4b1e-a795-7f2436653d64', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'floating_ip_address': '172.25.3.44', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'port_id': '144004a1-e56f-4a7a-a651-c300c1f3c832', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 4188, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2', 'mac_address': 'fa:16:3e:b0:0c:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e4af9c6-5777-4e4d-83b6-7677b23a5bf2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:21:06Z', 'updated_at': '2021-12-09T22:21:06Z', 'revision_number': 0, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4ec2eb7e-aa5f-4a78-af85-c1be398e85de', 'name': '', 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'mac_address': 'fa:16:3e:32:c1:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'device_owner': 'network:router_interface', 'standard_attr_id': 4173, 'fixed_ips': [{'subnet_id': '9016b68e-6021-4bdc-a7b1-be26d9de403a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:14Z', 'updated_at': '2021-12-09T22:20:19Z', 'revision_number': 5, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'subnets': [{'id': '9016b68e-6021-4bdc-a7b1-be26d9de403a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:21:07.586435 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c81949f-41b2-4d21-8b80-b95b6740566f req-a2c767be-0e07-4fac-a455-9eb8f0aeb175 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=144004a1-e56f-4a7a-a651-c300c1f3c832 HTTP/1.1" status: 200 len: 999 time: 0.0701952 Dec 09 22:21:07.590142 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8a784ff-69c6-45db-81ed-aeea49445aa0 None None] Checking router: 24626fb7-c6a2-4824-af06-13284de6ee53 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:21:07.598659 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8a784ff-69c6-45db-81ed-aeea49445aa0 None None] Routers {'24626fb7-c6a2-4824-af06-13284de6ee53'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:21:07.599547 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-c8a784ff-69c6-45db-81ed-aeea49445aa0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:21:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['24626fb7-c6a2-4824-af06-13284de6ee53'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:21:07.626653 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ae8dc49-12ed-4684-87cb-1b99ce1d80b4 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:07.631465 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ae8dc49-12ed-4684-87cb-1b99ce1d80b4 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:07.639870 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c81949f-41b2-4d21-8b80-b95b6740566f req-6f73b4ae-6309-40e8-9ac1-cd963c6cc82e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:07.641759 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c81949f-41b2-4d21-8b80-b95b6740566f req-6f73b4ae-6309-40e8-9ac1-cd963c6cc82e service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9016b68e-6021-4bdc-a7b1-be26d9de403a HTTP/1.1" status: 200 len: 853 time: 0.0483284 Dec 09 22:21:07.658000 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ae8dc49-12ed-4684-87cb-1b99ce1d80b4 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3b460341-2b29-45c3-88c7-104fd59d4285,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:21:07.674780 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2ae8dc49-12ed-4684-87cb-1b99ce1d80b4 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:07.676804 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2ae8dc49-12ed-4684-87cb-1b99ce1d80b4 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1961546 Dec 09 22:21:07.679690 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33682) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:21:07.684724 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-851e6862-30dd-482d-ac6c-4f21b5b1a160 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Request body: {'security_group_rule': {'security_group_id': 'f4262001-ea37-441d-9ef7-adc0bceb8b59', 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:21:07.706491 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c81949f-41b2-4d21-8b80-b95b6740566f req-a8589df9-c290-4fed-a58f-e0b711e22094 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:07.708155 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c81949f-41b2-4d21-8b80-b95b6740566f req-a8589df9-c290-4fed-a58f-e0b711e22094 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=20d197ac-b0d5-4136-851b-f803672ee9e2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0577593 Dec 09 22:21:07.721845 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-c8a784ff-69c6-45db-81ed-aeea49445aa0 None None] Set router 24626fb7-c6a2-4824-af06-13284de6ee53 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:21:07.726187 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-851e6862-30dd-482d-ac6c-4f21b5b1a160 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:07.807954 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-851e6862-30dd-482d-ac6c-4f21b5b1a160 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:07.813823 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-851e6862-30dd-482d-ac6c-4f21b5b1a160 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:07.832368 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c81949f-41b2-4d21-8b80-b95b6740566f req-06c0ad9a-bb7e-4d11-a2f7-07f194660207 service neutron] 10.222.0.10 "GET /v2.0/networks/20d197ac-b0d5-4136-851b-f803672ee9e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1165106 Dec 09 22:21:07.845729 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-851e6862-30dd-482d-ac6c-4f21b5b1a160 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:07.847465 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-851e6862-30dd-482d-ac6c-4f21b5b1a160 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1661894 Dec 09 22:21:07.848475 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-851e6862-30dd-482d-ac6c-4f21b5b1a160 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f65f3f59-38d8-4877-93b6-5f0313bcbfcf,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:21:07.851381 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33684) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:21:07.856229 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-1824fa4e-97df-4b59-ad1b-e79362b2d9d0 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Request body: {'security_group_rule': {'security_group_id': 'f4262001-ea37-441d-9ef7-adc0bceb8b59', 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:21:07.885879 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1824fa4e-97df-4b59-ad1b-e79362b2d9d0 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:07.949383 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c81949f-41b2-4d21-8b80-b95b6740566f req-dbc652ec-a223-4ae2-a8d3-b959c75293f7 service neutron] 10.222.0.10 "GET /v2.0/networks/20d197ac-b0d5-4136-851b-f803672ee9e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1085694 Dec 09 22:21:07.963732 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1824fa4e-97df-4b59-ad1b-e79362b2d9d0 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:07.968696 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1824fa4e-97df-4b59-ad1b-e79362b2d9d0 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:07.991746 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1824fa4e-97df-4b59-ad1b-e79362b2d9d0 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e01b2b90-1677-49b7-a44e-50e29ba3165f,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:21:07.996046 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-c8a784ff-69c6-45db-81ed-aeea49445aa0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'name': 'tempest-TestMinimumBasicScenario-304437312-router', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228'}], 'enable_snat': True}, 'gw_port_id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:15Z', 'revision_number': 4, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'gw_port': {'id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:bb:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4172, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '1ad8b14e-6a35-4b1e-a795-7f2436653d64', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'floating_ip_address': '172.25.3.44', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'port_id': '144004a1-e56f-4a7a-a651-c300c1f3c832', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 4188, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2', 'mac_address': 'fa:16:3e:b0:0c:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e4af9c6-5777-4e4d-83b6-7677b23a5bf2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:21:06Z', 'updated_at': '2021-12-09T22:21:06Z', 'revision_number': 0, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4ec2eb7e-aa5f-4a78-af85-c1be398e85de', 'name': '', 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'mac_address': 'fa:16:3e:32:c1:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'device_owner': 'network:router_interface', 'standard_attr_id': 4173, 'fixed_ips': [{'subnet_id': '9016b68e-6021-4bdc-a7b1-be26d9de403a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:14Z', 'updated_at': '2021-12-09T22:20:19Z', 'revision_number': 5, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'subnets': [{'id': '9016b68e-6021-4bdc-a7b1-be26d9de403a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:21:07.997362 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1824fa4e-97df-4b59-ad1b-e79362b2d9d0 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:07.998772 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1824fa4e-97df-4b59-ad1b-e79362b2d9d0 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1462278 Dec 09 22:21:08.001386 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33686) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:21:08.006055 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b54a5705-f187-44cc-b47d-d95c78c9989b tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Request body: {'security_group_rule': {'security_group_id': 'f4262001-ea37-441d-9ef7-adc0bceb8b59', 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:21:08.035366 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8a784ff-69c6-45db-81ed-aeea49445aa0 None None] The sync data for ids ['24626fb7-c6a2-4824-af06-13284de6ee53'] in n-d-713301-27 is: [{'id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'name': 'tempest-TestMinimumBasicScenario-304437312-router', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228'}], 'enable_snat': True}, 'gw_port_id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:15Z', 'revision_number': 4, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'gw_port': {'id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:bb:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4172, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '1ad8b14e-6a35-4b1e-a795-7f2436653d64', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'floating_ip_address': '172.25.3.44', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'port_id': '144004a1-e56f-4a7a-a651-c300c1f3c832', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 4188, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2', 'mac_address': 'fa:16:3e:b0:0c:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e4af9c6-5777-4e4d-83b6-7677b23a5bf2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:21:06Z', 'updated_at': '2021-12-09T22:21:06Z', 'revision_number': 0, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4ec2eb7e-aa5f-4a78-af85-c1be398e85de', 'name': '', 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'mac_address': 'fa:16:3e:32:c1:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'device_owner': 'network:router_interface', 'standard_attr_id': 4173, 'fixed_ips': [{'subnet_id': '9016b68e-6021-4bdc-a7b1-be26d9de403a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:14Z', 'updated_at': '2021-12-09T22:20:19Z', 'revision_number': 5, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'subnets': [{'id': '9016b68e-6021-4bdc-a7b1-be26d9de403a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:21:08.040923 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b54a5705-f187-44cc-b47d-d95c78c9989b tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:08.105966 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b54a5705-f187-44cc-b47d-d95c78c9989b tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:08.110573 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b54a5705-f187-44cc-b47d-d95c78c9989b tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:08.129515 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b54a5705-f187-44cc-b47d-d95c78c9989b tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c889423d-587b-46b4-9586-f7ffa78c361c,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:21:08.138170 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b54a5705-f187-44cc-b47d-d95c78c9989b tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:08.139392 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b54a5705-f187-44cc-b47d-d95c78c9989b tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1370168 Dec 09 22:21:08.142181 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33688) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:21:08.147043 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b808a613-c926-4120-ba14-95a695d56fb3 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Request body: {'security_group_rule': {'security_group_id': 'f4262001-ea37-441d-9ef7-adc0bceb8b59', 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:21:08.169035 n-d-713301-27 neutron-server[103437]: INFO neutron.db.securitygroups_db [None req-b808a613-c926-4120-ba14-95a695d56fb3 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Project 70ca64a954a041f5899f38ba64cf0fe9 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 22:21:08.174427 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b808a613-c926-4120-ba14-95a695d56fb3 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:08.200938 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:08.239376 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b808a613-c926-4120-ba14-95a695d56fb3 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:08.243841 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b808a613-c926-4120-ba14-95a695d56fb3 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:08.264593 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b808a613-c926-4120-ba14-95a695d56fb3 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2084b8fe-4f14-4e57-820d-3dbf2ce1e4b7,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:21:08.271985 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b808a613-c926-4120-ba14-95a695d56fb3 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:08.276081 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b808a613-c926-4120-ba14-95a695d56fb3 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1300864 Dec 09 22:21:08.276826 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33690) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:21:08.279495 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80045b02-0080-4d6b-96c7-f6b0262f8b96 None None] New status for floating IP 1ad8b14e-6a35-4b1e-a795-7f2436653d64: ACTIVE {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:21:08.281822 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-bb8135b9-854e-43ba-b922-36f6b8aa92dd tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Request body: {'security_group_rule': {'security_group_id': 'f4262001-ea37-441d-9ef7-adc0bceb8b59', 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:21:08.308610 n-d-713301-27 neutron-server[103437]: INFO neutron.db.securitygroups_db [None req-bb8135b9-854e-43ba-b922-36f6b8aa92dd tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Project 70ca64a954a041f5899f38ba64cf0fe9 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 22:21:08.315553 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bb8135b9-854e-43ba-b922-36f6b8aa92dd tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:08.379833 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bb8135b9-854e-43ba-b922-36f6b8aa92dd tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:08.383981 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bb8135b9-854e-43ba-b922-36f6b8aa92dd tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:08.406206 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb8135b9-854e-43ba-b922-36f6b8aa92dd tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=11049e00-bcfd-4ae0-bfe4-f1fa2341ef94,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:21:08.415944 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bb8135b9-854e-43ba-b922-36f6b8aa92dd tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:08.417301 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bb8135b9-854e-43ba-b922-36f6b8aa92dd tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1391482 Dec 09 22:21:08.513553 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8e9cc5dd-aa69-4f2b-bb5e-8457d1b1f36a req-c651be4f-2ac7-4a42-ad85-15f6c176115d tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1556501211&fields=id&tenant_id=70ca64a954a041f5899f38ba64cf0fe9 HTTP/1.1" status: 200 len: 267 time: 0.0461428 Dec 09 22:21:08.574913 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e9cc5dd-aa69-4f2b-bb5e-8457d1b1f36a req-b35a37dd-fa2e-4eb7-9799-311a2ca3f16c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:08.576439 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8e9cc5dd-aa69-4f2b-bb5e-8457d1b1f36a req-b35a37dd-fa2e-4eb7-9799-311a2ca3f16c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 946 time: 0.0568986 Dec 09 22:21:08.590534 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-8e9cc5dd-aa69-4f2b-bb5e-8457d1b1f36a req-af282177-a164-4605-99b8-aca9d9e7120f tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Request body: {'port': {'security_groups': ['6b184103-34f5-4d74-b063-cc970fc8b573', 'f4262001-ea37-441d-9ef7-adc0bceb8b59']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:21:08.652651 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8e9cc5dd-aa69-4f2b-bb5e-8457d1b1f36a req-af282177-a164-4605-99b8-aca9d9e7120f tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:08.854468 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-8e9cc5dd-aa69-4f2b-bb5e-8457d1b1f36a req-af282177-a164-4605-99b8-aca9d9e7120f tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] For port 144004a1-e56f-4a7a-a651-c300c1f3c832, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=144004a1-e56f-4a7a-a651-c300c1f3c832,segment=NetworkSegment(16bdd335-351c-4e9d-bde1-07a4c99d195c),segment_id=16bdd335-351c-4e9d-bde1-07a4c99d195c)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:21:08.886466 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8e9cc5dd-aa69-4f2b-bb5e-8457d1b1f36a req-af282177-a164-4605-99b8-aca9d9e7120f tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:08.894556 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8e9cc5dd-aa69-4f2b-bb5e-8457d1b1f36a req-af282177-a164-4605-99b8-aca9d9e7120f tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:08.906707 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['144004a1-e56f-4a7a-a651-c300c1f3c832'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:21:08.938474 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e9cc5dd-aa69-4f2b-bb5e-8457d1b1f36a req-af282177-a164-4605-99b8-aca9d9e7120f tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:08.939257 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8e9cc5dd-aa69-4f2b-bb5e-8457d1b1f36a req-af282177-a164-4605-99b8-aca9d9e7120f tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:08.940643 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8e9cc5dd-aa69-4f2b-bb5e-8457d1b1f36a req-af282177-a164-4605-99b8-aca9d9e7120f tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "PUT /v2.0/ports/144004a1-e56f-4a7a-a651-c300c1f3c832 HTTP/1.1" status: 200 len: 982 time: 0.3547742 Dec 09 22:21:08.941095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4e4af9c6-5777-4e4d-83b6-7677b23a5bf2', 'tag': '144004a1-e56f-4a7a-a651-c300c1f3c832'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:21:08.943405 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2bd98224-b003-4aed-a6c3-cdb6eca60189" -d '{"events": [{"name": "network-changed", "server_uuid": "4e4af9c6-5777-4e4d-83b6-7677b23a5bf2", "tag": "144004a1-e56f-4a7a-a651-c300c1f3c832"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:21:08.970790 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af282177-a164-4605-99b8-aca9d9e7120f tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Pushing event updated for resources: {'Port': ['ID=144004a1-e56f-4a7a-a651-c300c1f3c832,revision_number=6']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:21:08.992609 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:21:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d0aec256-c8ec-454f-a319-05317d92dfb5 x-openstack-request-id: req-d0aec256-c8ec-454f-a319-05317d92dfb5 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:21:08.993377 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4e4af9c6-5777-4e4d-83b6-7677b23a5bf2", "tag": "144004a1-e56f-4a7a-a651-c300c1f3c832", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:21:08.993640 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-d0aec256-c8ec-454f-a319-05317d92dfb5 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:21:08.994053 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4e4af9c6-5777-4e4d-83b6-7677b23a5bf2', 'tag': '144004a1-e56f-4a7a-a651-c300c1f3c832', 'status': 'completed', 'code': 200} Dec 09 22:21:09.021884 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['144004a1-e56f-4a7a-a651-c300c1f3c832'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:21:09.102236 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bd98224-b003-4aed-a6c3-cdb6eca60189 req-a1b107ac-6d86-423b-bb5d-9441568471f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:09.104020 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bd98224-b003-4aed-a6c3-cdb6eca60189 req-a1b107ac-6d86-423b-bb5d-9441568471f3 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=70ca64a954a041f5899f38ba64cf0fe9&device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 1137 time: 0.0842521 Dec 09 22:21:09.117310 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5577d6e5-28ec-4b4f-ba52-7c73673ed7ab req-82bba201-7f77-470e-a2a7-ef62c9392148 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:09.118638 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5577d6e5-28ec-4b4f-ba52-7c73673ed7ab req-82bba201-7f77-470e-a2a7-ef62c9392148 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 985 time: 0.0622661 Dec 09 22:21:09.244116 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5577d6e5-28ec-4b4f-ba52-7c73673ed7ab req-b1dd5d89-9426-417c-841f-c8db0a68b4c3 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=f4262001-ea37-441d-9ef7-adc0bceb8b59&id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1155684 Dec 09 22:21:09.253792 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bd98224-b003-4aed-a6c3-cdb6eca60189 req-e37d2fea-1846-4289-bdd5-5937ee387d84 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:09.255292 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bd98224-b003-4aed-a6c3-cdb6eca60189 req-e37d2fea-1846-4289-bdd5-5937ee387d84 service neutron] 10.222.0.10 "GET /v2.0/networks?id=20d197ac-b0d5-4136-851b-f803672ee9e2 HTTP/1.1" status: 200 len: 915 time: 0.1357467 Dec 09 22:21:09.282827 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a41c9250-7e0f-4daa-98bd-20eef3c64fd3 None None] Provisioning complete for port 144004a1-e56f-4a7a-a651-c300c1f3c832 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:21:09.283194 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a41c9250-7e0f-4daa-98bd-20eef3c64fd3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:09.334004 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bd98224-b003-4aed-a6c3-cdb6eca60189 req-3277f905-673d-49d5-a3d8-7aed45afeb5a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=144004a1-e56f-4a7a-a651-c300c1f3c832 HTTP/1.1" status: 200 len: 1001 time: 0.0695210 Dec 09 22:21:09.391904 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bd98224-b003-4aed-a6c3-cdb6eca60189 req-d1c6b3ed-8d0b-4335-9620-f4032448b730 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:09.393386 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bd98224-b003-4aed-a6c3-cdb6eca60189 req-d1c6b3ed-8d0b-4335-9620-f4032448b730 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9016b68e-6021-4bdc-a7b1-be26d9de403a HTTP/1.1" status: 200 len: 853 time: 0.0520687 Dec 09 22:21:09.440732 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bd98224-b003-4aed-a6c3-cdb6eca60189 req-5bfbc3a9-9b24-45a1-8e74-04f4306b3526 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:09.442298 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bd98224-b003-4aed-a6c3-cdb6eca60189 req-5bfbc3a9-9b24-45a1-8e74-04f4306b3526 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=20d197ac-b0d5-4136-851b-f803672ee9e2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0411024 Dec 09 22:21:09.533908 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bd98224-b003-4aed-a6c3-cdb6eca60189 req-9e86d2de-f9ac-4559-b742-fb2ffe3fb325 service neutron] 10.222.0.10 "GET /v2.0/networks/20d197ac-b0d5-4136-851b-f803672ee9e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0835776 Dec 09 22:21:09.630840 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2bd98224-b003-4aed-a6c3-cdb6eca60189 req-17f2aeba-38e9-4a3d-9081-5744937d0171 service neutron] 10.222.0.10 "GET /v2.0/networks/20d197ac-b0d5-4136-851b-f803672ee9e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0897291 Dec 09 22:21:09.691968 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:22.306714 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:21:23.427326 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab51a9e6-cb08-49c7-a8a0-956dcdc2683e req-e5d1de5d-37b1-4eba-9944-054bc1dd5bc7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:23.428876 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab51a9e6-cb08-49c7-a8a0-956dcdc2683e req-e5d1de5d-37b1-4eba-9944-054bc1dd5bc7 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=70ca64a954a041f5899f38ba64cf0fe9&device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 1137 time: 0.0662580 Dec 09 22:21:23.436544 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25211094-69c1-433f-8cac-d794fdc33fdd req-2a3b2aa9-ef71-4f18-845b-622a7572b3d2 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:23.437913 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25211094-69c1-433f-8cac-d794fdc33fdd req-2a3b2aa9-ef71-4f18-845b-622a7572b3d2 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 985 time: 0.0851429 Dec 09 22:21:23.571680 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25211094-69c1-433f-8cac-d794fdc33fdd req-33376a2d-08e3-402a-a42c-87cb7769ef26 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=f4262001-ea37-441d-9ef7-adc0bceb8b59&id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1249969 Dec 09 22:21:23.581228 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab51a9e6-cb08-49c7-a8a0-956dcdc2683e req-29a947de-d649-4c6a-a47f-87e1141cfc56 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:23.582677 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab51a9e6-cb08-49c7-a8a0-956dcdc2683e req-29a947de-d649-4c6a-a47f-87e1141cfc56 service neutron] 10.222.0.10 "GET /v2.0/networks?id=20d197ac-b0d5-4136-851b-f803672ee9e2 HTTP/1.1" status: 200 len: 915 time: 0.1439168 Dec 09 22:21:23.656479 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab51a9e6-cb08-49c7-a8a0-956dcdc2683e req-3d480504-1c5f-4a5b-915b-e464915ca902 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=144004a1-e56f-4a7a-a651-c300c1f3c832 HTTP/1.1" status: 200 len: 1001 time: 0.0657153 Dec 09 22:21:23.711814 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab51a9e6-cb08-49c7-a8a0-956dcdc2683e req-64fc2148-af5d-4539-bb9a-48635cde6368 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:23.713695 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab51a9e6-cb08-49c7-a8a0-956dcdc2683e req-64fc2148-af5d-4539-bb9a-48635cde6368 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9016b68e-6021-4bdc-a7b1-be26d9de403a HTTP/1.1" status: 200 len: 853 time: 0.0494783 Dec 09 22:21:23.761361 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab51a9e6-cb08-49c7-a8a0-956dcdc2683e req-9d186c3a-2719-4420-8c86-6d3762999856 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:23.762978 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab51a9e6-cb08-49c7-a8a0-956dcdc2683e req-9d186c3a-2719-4420-8c86-6d3762999856 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=20d197ac-b0d5-4136-851b-f803672ee9e2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0412309 Dec 09 22:21:23.864312 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab51a9e6-cb08-49c7-a8a0-956dcdc2683e req-2f6bc337-1920-4c40-9a3c-686ae57f7e27 service neutron] 10.222.0.10 "GET /v2.0/networks/20d197ac-b0d5-4136-851b-f803672ee9e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0921266 Dec 09 22:21:23.957864 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab51a9e6-cb08-49c7-a8a0-956dcdc2683e req-749390f3-42d3-4d82-bd1b-029170a58eda service neutron] 10.222.0.10 "GET /v2.0/networks/20d197ac-b0d5-4136-851b-f803672ee9e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857465 Dec 09 22:21:24.703929 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-336eeeaf-ec40-4cba-88f7-ffa896185514 req-fed9c58d-f071-4a27-993c-d432808bc3ea tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:24.705439 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-336eeeaf-ec40-4cba-88f7-ffa896185514 req-fed9c58d-f071-4a27-993c-d432808bc3ea tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 985 time: 0.0621789 Dec 09 22:21:24.765916 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-336eeeaf-ec40-4cba-88f7-ffa896185514 req-95b480f4-218e-4205-8472-76df88218ced tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=f4262001-ea37-441d-9ef7-adc0bceb8b59&id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0534914 Dec 09 22:21:25.896041 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-038c5787-b054-4a61-b7b2-0d3963868792 req-69c6afc4-398e-46fd-8fa3-ac8782c60c42 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:25.897528 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-038c5787-b054-4a61-b7b2-0d3963868792 req-69c6afc4-398e-46fd-8fa3-ac8782c60c42 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 985 time: 0.0530221 Dec 09 22:21:25.966290 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-038c5787-b054-4a61-b7b2-0d3963868792 req-d85d9c48-8331-4183-a117-443f8361c5a8 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=f4262001-ea37-441d-9ef7-adc0bceb8b59&id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0620344 Dec 09 22:21:27.105250 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eda7c68-157e-444d-b1ef-a5d7b366ef5e req-f7c839a6-0e72-4b5b-bd6a-5424af8ba78a tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:27.106725 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8eda7c68-157e-444d-b1ef-a5d7b366ef5e req-f7c839a6-0e72-4b5b-bd6a-5424af8ba78a tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 985 time: 0.0537331 Dec 09 22:21:27.169258 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8eda7c68-157e-444d-b1ef-a5d7b366ef5e req-81998bf6-5f58-44eb-90c2-18ff658a3b01 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=f4262001-ea37-441d-9ef7-adc0bceb8b59&id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0562627 Dec 09 22:21:27.675751 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:27.771843 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:28.301938 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb89309c-d1f6-432b-938c-aee3220bc2fe req-bc17c25e-4736-47eb-b476-f4457af29d48 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:28.303790 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fb89309c-d1f6-432b-938c-aee3220bc2fe req-bc17c25e-4736-47eb-b476-f4457af29d48 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 985 time: 0.0578706 Dec 09 22:21:28.363233 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fb89309c-d1f6-432b-938c-aee3220bc2fe req-0a8bdb43-c027-4cab-9d26-ed308cb1c286 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=f4262001-ea37-441d-9ef7-adc0bceb8b59&id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0531211 Dec 09 22:21:29.487945 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4480d1ac-31a4-4317-8f47-0325371c99ee req-fc6bd0ff-807e-4648-b114-7540a39bafef tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:29.489425 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4480d1ac-31a4-4317-8f47-0325371c99ee req-fc6bd0ff-807e-4648-b114-7540a39bafef tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 985 time: 0.0521228 Dec 09 22:21:29.556032 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4480d1ac-31a4-4317-8f47-0325371c99ee req-a56e1135-c00d-4623-a272-b8c42b6f7406 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=f4262001-ea37-441d-9ef7-adc0bceb8b59&id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0571089 Dec 09 22:21:30.686388 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-926da062-e0fb-4344-a4b4-38fb140c8c5e req-db4e72fa-6557-457c-ad3e-bde8ef2e69bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:30.687899 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-926da062-e0fb-4344-a4b4-38fb140c8c5e req-db4e72fa-6557-457c-ad3e-bde8ef2e69bf tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 985 time: 0.0516949 Dec 09 22:21:30.748261 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-926da062-e0fb-4344-a4b4-38fb140c8c5e req-355de439-0b40-450c-91bf-2cb06e796ba7 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=f4262001-ea37-441d-9ef7-adc0bceb8b59&id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0538859 Dec 09 22:21:31.881738 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85f071b6-3249-4558-b5c7-4a1f935ea7b6 req-eb66fc99-a223-4d73-b4e8-6aaa98e94d81 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:31.883328 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85f071b6-3249-4558-b5c7-4a1f935ea7b6 req-eb66fc99-a223-4d73-b4e8-6aaa98e94d81 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 985 time: 0.0520399 Dec 09 22:21:31.946798 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-85f071b6-3249-4558-b5c7-4a1f935ea7b6 req-c77e6b92-71b4-49f3-8b6e-8dabfa3a38b6 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=f4262001-ea37-441d-9ef7-adc0bceb8b59&id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0547113 Dec 09 22:21:33.022500 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-90453758-7224-4b85-92dc-a55928063b9e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:33.085508 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69ca6abb-dde0-4eb8-b13c-8ca73ca87893 req-230e8c29-c0e2-4bb2-9d09-15864b12ee04 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:33.086887 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69ca6abb-dde0-4eb8-b13c-8ca73ca87893 req-230e8c29-c0e2-4bb2-9d09-15864b12ee04 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 985 time: 0.0577676 Dec 09 22:21:33.150783 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69ca6abb-dde0-4eb8-b13c-8ca73ca87893 req-79f6912a-78cb-4581-adce-bcaba523b05b tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=f4262001-ea37-441d-9ef7-adc0bceb8b59&id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0538793 Dec 09 22:21:34.390575 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c59f1ad9-f73f-40b2-a4cd-4f1525b059d7 req-b7657fc5-eebc-44cf-9f12-84c81779cd86 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:34.392078 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c59f1ad9-f73f-40b2-a4cd-4f1525b059d7 req-b7657fc5-eebc-44cf-9f12-84c81779cd86 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 985 time: 0.1654255 Dec 09 22:21:34.455577 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c59f1ad9-f73f-40b2-a4cd-4f1525b059d7 req-72c60cfa-77fc-4538-b1c0-f9d559f79f40 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=f4262001-ea37-441d-9ef7-adc0bceb8b59&id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0569584 Dec 09 22:21:35.592520 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c83bfe5b-8ad9-4951-9175-f6f1a9df6f42 req-84ef9d25-967f-4e4e-85f9-651434cc4f77 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:21:35.594024 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c83bfe5b-8ad9-4951-9175-f6f1a9df6f42 req-84ef9d25-967f-4e4e-85f9-651434cc4f77 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 985 time: 0.0584915 Dec 09 22:21:35.659409 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c83bfe5b-8ad9-4951-9175-f6f1a9df6f42 req-976d74ae-feb4-4369-8fd3-63d19a5cb0e4 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=f4262001-ea37-441d-9ef7-adc0bceb8b59&id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0589676 Dec 09 22:21:35.665354 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7ab312ab-4f1f-4f16-b5ed-1bd14b32fe58 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:36.861315 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:38.209023 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:39.697569 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:57.683495 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:57.783321 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:21:59.312497 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:22:01.853451 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66e61a80-85ea-446c-ba2d-342e68ac8232 req-d7701b7b-9f56-44df-8739-4cc65236de83 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0423956 Dec 09 22:22:01.942263 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66e61a80-85ea-446c-ba2d-342e68ac8232 req-55e4dc7d-76ca-4b2a-a9f1-45ff1488ecd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:01.943801 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66e61a80-85ea-446c-ba2d-342e68ac8232 req-55e4dc7d-76ca-4b2a-a9f1-45ff1488ecd9 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=70ca64a954a041f5899f38ba64cf0fe9&device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 1137 time: 0.0430999 Dec 09 22:22:02.053189 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66e61a80-85ea-446c-ba2d-342e68ac8232 req-33cc729b-eb40-4579-a9d3-202796b6a163 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:02.054613 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66e61a80-85ea-446c-ba2d-342e68ac8232 req-33cc729b-eb40-4579-a9d3-202796b6a163 service neutron] 10.222.0.10 "GET /v2.0/networks?id=20d197ac-b0d5-4136-851b-f803672ee9e2 HTTP/1.1" status: 200 len: 915 time: 0.0886550 Dec 09 22:22:02.130025 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66e61a80-85ea-446c-ba2d-342e68ac8232 req-e5a46bff-1373-4f3b-bea9-36f1e4be4d4d service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=144004a1-e56f-4a7a-a651-c300c1f3c832 HTTP/1.1" status: 200 len: 1001 time: 0.0674381 Dec 09 22:22:02.180541 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66e61a80-85ea-446c-ba2d-342e68ac8232 req-ac6697f6-db22-44e0-b95e-b2cf74a16950 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:02.181949 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66e61a80-85ea-446c-ba2d-342e68ac8232 req-ac6697f6-db22-44e0-b95e-b2cf74a16950 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9016b68e-6021-4bdc-a7b1-be26d9de403a HTTP/1.1" status: 200 len: 853 time: 0.0444157 Dec 09 22:22:02.530628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66e61a80-85ea-446c-ba2d-342e68ac8232 req-5a71777c-0fe4-409b-b8e6-f29e2a6393cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:02.532179 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66e61a80-85ea-446c-ba2d-342e68ac8232 req-5a71777c-0fe4-409b-b8e6-f29e2a6393cb service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=20d197ac-b0d5-4136-851b-f803672ee9e2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.3429554 Dec 09 22:22:02.624666 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66e61a80-85ea-446c-ba2d-342e68ac8232 req-7bc26a31-cd03-49aa-9791-7f856eae2a09 service neutron] 10.222.0.10 "GET /v2.0/networks/20d197ac-b0d5-4136-851b-f803672ee9e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0847845 Dec 09 22:22:02.718297 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-66e61a80-85ea-446c-ba2d-342e68ac8232 req-e619fef7-d937-435c-a864-f4451f1f1f4a service neutron] 10.222.0.10 "GET /v2.0/networks/20d197ac-b0d5-4136-851b-f803672ee9e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0867052 Dec 09 22:22:03.037637 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7e6bbc72-8624-4110-8009-cc1dd777d07e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:05.673536 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c675a78a-ea00-4fee-99e1-c9827a746a05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:06.864088 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:07.948759 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43694e96-ad58-4db2-9acf-66fb211b0c1e req-a4db1ab8-236c-4023-bbe6-94e7919c0d63 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1556501211&fields=id&tenant_id=70ca64a954a041f5899f38ba64cf0fe9 HTTP/1.1" status: 200 len: 267 time: 0.0459204 Dec 09 22:22:08.006422 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43694e96-ad58-4db2-9acf-66fb211b0c1e req-6cc9d938-7299-4046-b8af-f89d8a2cc180 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:08.009232 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43694e96-ad58-4db2-9acf-66fb211b0c1e req-6cc9d938-7299-4046-b8af-f89d8a2cc180 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 985 time: 0.0541184 Dec 09 22:22:08.022830 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-43694e96-ad58-4db2-9acf-66fb211b0c1e req-86ec9640-eed7-473d-a830-d446a8c4c315 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Request body: {'port': {'security_groups': ['6b184103-34f5-4d74-b063-cc970fc8b573']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:22:08.095481 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-43694e96-ad58-4db2-9acf-66fb211b0c1e req-86ec9640-eed7-473d-a830-d446a8c4c315 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:08.205877 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:08.279269 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-43694e96-ad58-4db2-9acf-66fb211b0c1e req-86ec9640-eed7-473d-a830-d446a8c4c315 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] For port 144004a1-e56f-4a7a-a651-c300c1f3c832, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=144004a1-e56f-4a7a-a651-c300c1f3c832,segment=NetworkSegment(16bdd335-351c-4e9d-bde1-07a4c99d195c),segment_id=16bdd335-351c-4e9d-bde1-07a4c99d195c)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:22:08.311383 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-43694e96-ad58-4db2-9acf-66fb211b0c1e req-86ec9640-eed7-473d-a830-d446a8c4c315 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:08.318842 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-43694e96-ad58-4db2-9acf-66fb211b0c1e req-86ec9640-eed7-473d-a830-d446a8c4c315 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:08.333433 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['144004a1-e56f-4a7a-a651-c300c1f3c832'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:22:08.366021 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43694e96-ad58-4db2-9acf-66fb211b0c1e req-86ec9640-eed7-473d-a830-d446a8c4c315 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:08.366654 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-43694e96-ad58-4db2-9acf-66fb211b0c1e req-86ec9640-eed7-473d-a830-d446a8c4c315 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:08.368192 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-43694e96-ad58-4db2-9acf-66fb211b0c1e req-86ec9640-eed7-473d-a830-d446a8c4c315 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "PUT /v2.0/ports/144004a1-e56f-4a7a-a651-c300c1f3c832 HTTP/1.1" status: 200 len: 943 time: 0.3503773 Dec 09 22:22:08.368609 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4e4af9c6-5777-4e4d-83b6-7677b23a5bf2', 'tag': '144004a1-e56f-4a7a-a651-c300c1f3c832'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:22:08.371248 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-da6af6a3-1970-4a58-803d-5cfdc48d29a1" -d '{"events": [{"name": "network-changed", "server_uuid": "4e4af9c6-5777-4e4d-83b6-7677b23a5bf2", "tag": "144004a1-e56f-4a7a-a651-c300c1f3c832"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:22:08.374347 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33738) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:08.408846 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86ec9640-eed7-473d-a830-d446a8c4c315 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Pushing event updated for resources: {'Port': ['ID=144004a1-e56f-4a7a-a651-c300c1f3c832,revision_number=7']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:08.417191 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ec9640-eed7-473d-a830-d446a8c4c315 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.417689 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ec9640-eed7-473d-a830-d446a8c4c315 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.418042 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ec9640-eed7-473d-a830-d446a8c4c315 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.418387 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ec9640-eed7-473d-a830-d446a8c4c315 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.418726 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ec9640-eed7-473d-a830-d446a8c4c315 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.419067 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ec9640-eed7-473d-a830-d446a8c4c315 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.419411 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ec9640-eed7-473d-a830-d446a8c4c315 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.419763 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ec9640-eed7-473d-a830-d446a8c4c315 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.420095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ec9640-eed7-473d-a830-d446a8c4c315 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.420484 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ec9640-eed7-473d-a830-d446a8c4c315 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.420810 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ec9640-eed7-473d-a830-d446a8c4c315 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.421141 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ec9640-eed7-473d-a830-d446a8c4c315 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.421465 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ec9640-eed7-473d-a830-d446a8c4c315 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.451762 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:22:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a8649d9c-dcf4-4903-bfe2-38aca18684b2 x-openstack-request-id: req-a8649d9c-dcf4-4903-bfe2-38aca18684b2 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:22:08.452118 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4e4af9c6-5777-4e4d-83b6-7677b23a5bf2", "tag": "144004a1-e56f-4a7a-a651-c300c1f3c832", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:22:08.452514 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a8649d9c-dcf4-4903-bfe2-38aca18684b2 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:22:08.452974 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4e4af9c6-5777-4e4d-83b6-7677b23a5bf2', 'tag': '144004a1-e56f-4a7a-a651-c300c1f3c832', 'status': 'completed', 'code': 200} Dec 09 22:22:08.471946 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['144004a1-e56f-4a7a-a651-c300c1f3c832'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:22:08.486264 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ec564b8-4d85-439c-b56a-aa6df818da7d tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:08.515885 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ec564b8-4d85-439c-b56a-aa6df818da7d tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:08.517289 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da6af6a3-1970-4a58-803d-5cfdc48d29a1 req-5738b053-ff51-4906-9adb-f2d9528ff3ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:08.519265 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da6af6a3-1970-4a58-803d-5cfdc48d29a1 req-5738b053-ff51-4906-9adb-f2d9528ff3ad service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=70ca64a954a041f5899f38ba64cf0fe9&device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 1098 time: 0.0536318 Dec 09 22:22:08.584135 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ec564b8-4d85-439c-b56a-aa6df818da7d tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:08.587456 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ec564b8-4d85-439c-b56a-aa6df818da7d tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:08.588926 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7ec564b8-4d85-439c-b56a-aa6df818da7d tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "DELETE /v2.0/security-groups/f4262001-ea37-441d-9ef7-adc0bceb8b59 HTTP/1.1" status: 204 len: 168 time: 0.2134445 Dec 09 22:22:08.599522 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33744) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:08.600625 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ec564b8-4d85-439c-b56a-aa6df818da7d tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f4262001-ea37-441d-9ef7-adc0bceb8b59,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:08.644752 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da6af6a3-1970-4a58-803d-5cfdc48d29a1 req-dca37c96-a74a-45f6-bf16-a0bc8c652ae2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:08.646807 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da6af6a3-1970-4a58-803d-5cfdc48d29a1 req-dca37c96-a74a-45f6-bf16-a0bc8c652ae2 service neutron] 10.222.0.10 "GET /v2.0/networks?id=20d197ac-b0d5-4136-851b-f803672ee9e2 HTTP/1.1" status: 200 len: 915 time: 0.1196847 Dec 09 22:22:08.658331 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ec564b8-4d85-439c-b56a-aa6df818da7d tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.658691 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ec564b8-4d85-439c-b56a-aa6df818da7d tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.659037 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ec564b8-4d85-439c-b56a-aa6df818da7d tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.659379 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ec564b8-4d85-439c-b56a-aa6df818da7d tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.659741 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ec564b8-4d85-439c-b56a-aa6df818da7d tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.660077 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ec564b8-4d85-439c-b56a-aa6df818da7d tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.660421 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ec564b8-4d85-439c-b56a-aa6df818da7d tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.660752 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ec564b8-4d85-439c-b56a-aa6df818da7d tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.661082 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ec564b8-4d85-439c-b56a-aa6df818da7d tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.661411 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ec564b8-4d85-439c-b56a-aa6df818da7d tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.661740 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ec564b8-4d85-439c-b56a-aa6df818da7d tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.662065 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ec564b8-4d85-439c-b56a-aa6df818da7d tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.662390 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7ec564b8-4d85-439c-b56a-aa6df818da7d tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:08.722409 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da6af6a3-1970-4a58-803d-5cfdc48d29a1 req-115ee68e-45a0-46e3-9c46-11f32649df4f service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=144004a1-e56f-4a7a-a651-c300c1f3c832 HTTP/1.1" status: 200 len: 1001 time: 0.0677500 Dec 09 22:22:08.762711 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-756917e9-839d-4ecb-8c71-14cd85cbf683 None None] Provisioning complete for port 144004a1-e56f-4a7a-a651-c300c1f3c832 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:22:08.763100 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-756917e9-839d-4ecb-8c71-14cd85cbf683 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:08.777998 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da6af6a3-1970-4a58-803d-5cfdc48d29a1 req-81d8e3a5-36bb-4512-8b58-66794ede7efc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:08.780202 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da6af6a3-1970-4a58-803d-5cfdc48d29a1 req-81d8e3a5-36bb-4512-8b58-66794ede7efc service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9016b68e-6021-4bdc-a7b1-be26d9de403a HTTP/1.1" status: 200 len: 853 time: 0.0502727 Dec 09 22:22:08.783200 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-b4180e78-a15e-4264-8c6f-7b9a351e466c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Deleting port 1aa3c51d-82cb-4164-ab8d-8d38a3713855 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:22:08.783585 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b4180e78-a15e-4264-8c6f-7b9a351e466c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:08.828541 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da6af6a3-1970-4a58-803d-5cfdc48d29a1 req-5200a4cd-5b5a-42da-abe9-a76a3d08180e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:08.830570 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da6af6a3-1970-4a58-803d-5cfdc48d29a1 req-5200a4cd-5b5a-42da-abe9-a76a3d08180e service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=20d197ac-b0d5-4136-851b-f803672ee9e2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0434365 Dec 09 22:22:08.865984 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b4180e78-a15e-4264-8c6f-7b9a351e466c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:08.866315 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b4180e78-a15e-4264-8c6f-7b9a351e466c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:08.878165 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-b4180e78-a15e-4264-8c6f-7b9a351e466c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Calling delete_port for 1aa3c51d-82cb-4164-ab8d-8d38a3713855 owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:22:08.923720 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da6af6a3-1970-4a58-803d-5cfdc48d29a1 req-2eb6a8d8-83f1-477a-bd0c-4ebfa1e1f93c service neutron] 10.222.0.10 "GET /v2.0/networks/20d197ac-b0d5-4136-851b-f803672ee9e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0846362 Dec 09 22:22:09.017350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-da6af6a3-1970-4a58-803d-5cfdc48d29a1 req-e4ff32dd-207c-4ebc-ba9c-d7ad2334c03b service neutron] 10.222.0.10 "GET /v2.0/networks/20d197ac-b0d5-4136-851b-f803672ee9e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0870922 Dec 09 22:22:09.029576 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b4180e78-a15e-4264-8c6f-7b9a351e466c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:09.058606 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4180e78-a15e-4264-8c6f-7b9a351e466c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Pushing event deleted for resources: {'Port': ['ID=1aa3c51d-82cb-4164-ab8d-8d38a3713855,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:09.124934 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b4180e78-a15e-4264-8c6f-7b9a351e466c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:09.125316 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-b4180e78-a15e-4264-8c6f-7b9a351e466c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Floating IP 1ad8b14e-6a35-4b1e-a795-7f2436653d64 disassociated (deleted). External IP: 172.25.3.44, port: 144004a1-e56f-4a7a-a651-c300c1f3c832. Dec 09 22:22:09.359354 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b4180e78-a15e-4264-8c6f-7b9a351e466c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Router 24626fb7-c6a2-4824-af06-13284de6ee53 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:22:09.479786 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b4180e78-a15e-4264-8c6f-7b9a351e466c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:22:09.485206 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b4180e78-a15e-4264-8c6f-7b9a351e466c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:09.490719 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81d4d4d6-da7c-4e96-a41d-8ee4463456d7 None None] Sync routers for ids ['24626fb7-c6a2-4824-af06-13284de6ee53'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:22:09.502267 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81d4d4d6-da7c-4e96-a41d-8ee4463456d7 None None] Routers {'24626fb7-c6a2-4824-af06-13284de6ee53'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:22:09.502964 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-81d4d4d6-da7c-4e96-a41d-8ee4463456d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:22:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['24626fb7-c6a2-4824-af06-13284de6ee53'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:09.514592 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b4180e78-a15e-4264-8c6f-7b9a351e466c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "DELETE /v2.0/floatingips/1ad8b14e-6a35-4b1e-a795-7f2436653d64 HTTP/1.1" status: 204 len: 168 time: 0.9108663 Dec 09 22:22:09.515202 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4e4af9c6-5777-4e4d-83b6-7677b23a5bf2', 'tag': '144004a1-e56f-4a7a-a651-c300c1f3c832'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:22:09.517870 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4ec7dcd4-0bbf-48b5-a239-646d7a305ac3" -d '{"events": [{"name": "network-changed", "server_uuid": "4e4af9c6-5777-4e4d-83b6-7677b23a5bf2", "tag": "144004a1-e56f-4a7a-a651-c300c1f3c832"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:22:09.611825 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-81d4d4d6-da7c-4e96-a41d-8ee4463456d7 None None] Set router 24626fb7-c6a2-4824-af06-13284de6ee53 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:22:09.714278 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:09.793162 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:22:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-721e760a-5e7c-4f4a-958c-88c7ff000cfe x-openstack-request-id: req-721e760a-5e7c-4f4a-958c-88c7ff000cfe {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:22:09.793636 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4e4af9c6-5777-4e4d-83b6-7677b23a5bf2", "tag": "144004a1-e56f-4a7a-a651-c300c1f3c832", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:22:09.794153 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-721e760a-5e7c-4f4a-958c-88c7ff000cfe {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:22:09.794718 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4e4af9c6-5777-4e4d-83b6-7677b23a5bf2', 'tag': '144004a1-e56f-4a7a-a651-c300c1f3c832', 'status': 'completed', 'code': 200} Dec 09 22:22:09.840052 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-81d4d4d6-da7c-4e96-a41d-8ee4463456d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'name': 'tempest-TestMinimumBasicScenario-304437312-router', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228'}], 'enable_snat': True}, 'gw_port_id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:15Z', 'revision_number': 4, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'gw_port': {'id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:bb:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4172, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '4ec2eb7e-aa5f-4a78-af85-c1be398e85de', 'name': '', 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'mac_address': 'fa:16:3e:32:c1:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'device_owner': 'network:router_interface', 'standard_attr_id': 4173, 'fixed_ips': [{'subnet_id': '9016b68e-6021-4bdc-a7b1-be26d9de403a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:14Z', 'updated_at': '2021-12-09T22:20:19Z', 'revision_number': 5, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'subnets': [{'id': '9016b68e-6021-4bdc-a7b1-be26d9de403a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:09.860309 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ec7dcd4-0bbf-48b5-a239-646d7a305ac3 req-1857c865-dde6-4f77-84cf-3ea10b11c823 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:09.861892 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ec7dcd4-0bbf-48b5-a239-646d7a305ac3 req-1857c865-dde6-4f77-84cf-3ea10b11c823 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=70ca64a954a041f5899f38ba64cf0fe9&device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 1098 time: 0.0436625 Dec 09 22:22:09.866231 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81d4d4d6-da7c-4e96-a41d-8ee4463456d7 None None] Checking router: 24626fb7-c6a2-4824-af06-13284de6ee53 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:22:09.874825 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81d4d4d6-da7c-4e96-a41d-8ee4463456d7 None None] Routers {'24626fb7-c6a2-4824-af06-13284de6ee53'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:22:09.875495 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-81d4d4d6-da7c-4e96-a41d-8ee4463456d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:22:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['24626fb7-c6a2-4824-af06-13284de6ee53'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:09.961403 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ec7dcd4-0bbf-48b5-a239-646d7a305ac3 req-e918c816-2d25-4752-806c-2eb640a01b83 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:09.963010 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ec7dcd4-0bbf-48b5-a239-646d7a305ac3 req-e918c816-2d25-4752-806c-2eb640a01b83 service neutron] 10.222.0.10 "GET /v2.0/networks?id=20d197ac-b0d5-4136-851b-f803672ee9e2 HTTP/1.1" status: 200 len: 915 time: 0.0925663 Dec 09 22:22:10.009351 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ec7dcd4-0bbf-48b5-a239-646d7a305ac3 req-110162c3-10d1-4b85-9026-e5ba06092381 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=144004a1-e56f-4a7a-a651-c300c1f3c832 HTTP/1.1" status: 200 len: 217 time: 0.0373237 Dec 09 22:22:10.077301 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ec7dcd4-0bbf-48b5-a239-646d7a305ac3 req-60e7444d-7650-417f-8937-3552461f20fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:10.078708 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ec7dcd4-0bbf-48b5-a239-646d7a305ac3 req-60e7444d-7650-417f-8937-3552461f20fd service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9016b68e-6021-4bdc-a7b1-be26d9de403a HTTP/1.1" status: 200 len: 853 time: 0.0501096 Dec 09 22:22:10.140877 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ec7dcd4-0bbf-48b5-a239-646d7a305ac3 req-ebf5f3da-4a3f-48a3-8e7c-b1577d99e47c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:10.142678 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ec7dcd4-0bbf-48b5-a239-646d7a305ac3 req-ebf5f3da-4a3f-48a3-8e7c-b1577d99e47c service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=20d197ac-b0d5-4136-851b-f803672ee9e2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0423920 Dec 09 22:22:10.153319 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-81d4d4d6-da7c-4e96-a41d-8ee4463456d7 None None] Set router 24626fb7-c6a2-4824-af06-13284de6ee53 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:22:10.243648 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ec7dcd4-0bbf-48b5-a239-646d7a305ac3 req-fbf6a99f-d595-40c1-8c19-da19022f3980 service neutron] 10.222.0.10 "GET /v2.0/networks/20d197ac-b0d5-4136-851b-f803672ee9e2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0880756 Dec 09 22:22:10.345103 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ec7dcd4-0bbf-48b5-a239-646d7a305ac3 req-21113611-3a73-41b6-96b2-608a53411fff service neutron] 10.222.0.10 "GET /v2.0/networks/20d197ac-b0d5-4136-851b-f803672ee9e2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0938590 Dec 09 22:22:10.366298 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-81d4d4d6-da7c-4e96-a41d-8ee4463456d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'name': 'tempest-TestMinimumBasicScenario-304437312-router', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228'}], 'enable_snat': True}, 'gw_port_id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:15Z', 'revision_number': 4, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'gw_port': {'id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:bb:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4172, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '4ec2eb7e-aa5f-4a78-af85-c1be398e85de', 'name': '', 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'mac_address': 'fa:16:3e:32:c1:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'device_owner': 'network:router_interface', 'standard_attr_id': 4173, 'fixed_ips': [{'subnet_id': '9016b68e-6021-4bdc-a7b1-be26d9de403a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:14Z', 'updated_at': '2021-12-09T22:20:19Z', 'revision_number': 5, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'subnets': [{'id': '9016b68e-6021-4bdc-a7b1-be26d9de403a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:10.396267 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81d4d4d6-da7c-4e96-a41d-8ee4463456d7 None None] The sync data for ids ['24626fb7-c6a2-4824-af06-13284de6ee53'] in n-d-713301-27 is: [{'id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'name': 'tempest-TestMinimumBasicScenario-304437312-router', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228'}], 'enable_snat': True}, 'gw_port_id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:15Z', 'revision_number': 4, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'gw_port': {'id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:bb:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4172, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '4ec2eb7e-aa5f-4a78-af85-c1be398e85de', 'name': '', 'network_id': '20d197ac-b0d5-4136-851b-f803672ee9e2', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'mac_address': 'fa:16:3e:32:c1:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'device_owner': 'network:router_interface', 'standard_attr_id': 4173, 'fixed_ips': [{'subnet_id': '9016b68e-6021-4bdc-a7b1-be26d9de403a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:14Z', 'updated_at': '2021-12-09T22:20:19Z', 'revision_number': 5, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'subnets': [{'id': '9016b68e-6021-4bdc-a7b1-be26d9de403a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:22:10.622564 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a0e0ab9-6511-489d-aaa2-27e4817f62d0 None None] New status for floating IP 1ad8b14e-6a35-4b1e-a795-7f2436653d64: DOWN {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:22:18.688722 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93da1308-da4d-47b8-a6da-24a516ac4de1 req-9a7661be-30f0-496e-afeb-f37b79f66ca0 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:18.690220 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-93da1308-da4d-47b8-a6da-24a516ac4de1 req-9a7661be-30f0-496e-afeb-f37b79f66ca0 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 946 time: 0.0592256 Dec 09 22:22:18.747416 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-93da1308-da4d-47b8-a6da-24a516ac4de1 req-3336cf20-d215-45c7-be1f-29421d9581d5 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477581 Dec 09 22:22:19.878215 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b7a1c3e-cb42-4910-9eb2-2929906af400 req-3f4a9127-1bcf-443d-9050-5bf8e892a971 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:19.879729 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b7a1c3e-cb42-4910-9eb2-2929906af400 req-3f4a9127-1bcf-443d-9050-5bf8e892a971 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 946 time: 0.0543854 Dec 09 22:22:19.931763 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b7a1c3e-cb42-4910-9eb2-2929906af400 req-fdf9b320-33d4-4ad0-9b11-168b557f2b0c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/security-groups?id=6b184103-34f5-4d74-b063-cc970fc8b573&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429959 Dec 09 22:22:20.321632 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fb820fb-6239-4d51-8545-f250968671f5 req-85fac950-6d29-4286-8aa6-a1593e86ff0c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:20.323092 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8fb820fb-6239-4d51-8545-f250968671f5 req-85fac950-6d29-4286-8aa6-a1593e86ff0c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.10 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 946 time: 0.0583019 Dec 09 22:22:20.419741 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-8fb820fb-6239-4d51-8545-f250968671f5 req-ccddb523-4b7a-4df6-8642-c0a587ef441c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Deleting port 144004a1-e56f-4a7a-a651-c300c1f3c832 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:22:20.420052 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8fb820fb-6239-4d51-8545-f250968671f5 req-ccddb523-4b7a-4df6-8642-c0a587ef441c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:20.509204 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-8fb820fb-6239-4d51-8545-f250968671f5 req-ccddb523-4b7a-4df6-8642-c0a587ef441c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] For port 144004a1-e56f-4a7a-a651-c300c1f3c832, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=144004a1-e56f-4a7a-a651-c300c1f3c832,segment=NetworkSegment(16bdd335-351c-4e9d-bde1-07a4c99d195c),segment_id=16bdd335-351c-4e9d-bde1-07a4c99d195c)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:22:20.509469 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8fb820fb-6239-4d51-8545-f250968671f5 req-ccddb523-4b7a-4df6-8642-c0a587ef441c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:20.522756 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-8fb820fb-6239-4d51-8545-f250968671f5 req-ccddb523-4b7a-4df6-8642-c0a587ef441c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Calling delete_port for 144004a1-e56f-4a7a-a651-c300c1f3c832 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:22:20.668179 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8fb820fb-6239-4d51-8545-f250968671f5 req-ccddb523-4b7a-4df6-8642-c0a587ef441c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:20.680877 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['144004a1-e56f-4a7a-a651-c300c1f3c832'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:22:20.700800 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccddb523-4b7a-4df6-8642-c0a587ef441c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Pushing event deleted for resources: {'Port': ['ID=144004a1-e56f-4a7a-a651-c300c1f3c832,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:20.740240 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-8fb820fb-6239-4d51-8545-f250968671f5 req-ccddb523-4b7a-4df6-8642-c0a587ef441c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] No DVR routers for this DVR port 144004a1-e56f-4a7a-a651-c300c1f3c832 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:22:20.743112 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-8fb820fb-6239-4d51-8545-f250968671f5 req-ccddb523-4b7a-4df6-8642-c0a587ef441c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:20.746479 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8fb820fb-6239-4d51-8545-f250968671f5 req-ccddb523-4b7a-4df6-8642-c0a587ef441c tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.10 "DELETE /v2.0/ports/144004a1-e56f-4a7a-a651-c300c1f3c832 HTTP/1.1" status: 204 len: 173 time: 0.4168515 Dec 09 22:22:20.746919 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4e4af9c6-5777-4e4d-83b6-7677b23a5bf2', 'name': 'network-vif-deleted', 'tag': '144004a1-e56f-4a7a-a651-c300c1f3c832'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:22:20.749286 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ddf42f8e-f6bd-4a0a-80f6-0d89007f217e" -d '{"events": [{"server_uuid": "4e4af9c6-5777-4e4d-83b6-7677b23a5bf2", "name": "network-vif-deleted", "tag": "144004a1-e56f-4a7a-a651-c300c1f3c832"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:22:20.786530 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:22:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fc41db03-de9f-41cb-b47c-a23c2e0f39b7 x-openstack-request-id: req-fc41db03-de9f-41cb-b47c-a23c2e0f39b7 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:22:20.786936 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4e4af9c6-5777-4e4d-83b6-7677b23a5bf2", "name": "network-vif-deleted", "tag": "144004a1-e56f-4a7a-a651-c300c1f3c832", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:22:20.787068 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-fc41db03-de9f-41cb-b47c-a23c2e0f39b7 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:22:20.787473 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4e4af9c6-5777-4e4d-83b6-7677b23a5bf2', 'name': 'network-vif-deleted', 'tag': '144004a1-e56f-4a7a-a651-c300c1f3c832', 'status': 'completed', 'code': 200} Dec 09 22:22:21.057293 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1801dd77-b07f-4875-9cd6-aa9d3fd32b7d req-9317e570-916d-4674-acbc-0ef0934695e7 tempest-TestMinimumBasicScenario-1673853752 tempest-TestMinimumBasicScenario-1673853752-project] 10.222.0.13 "GET /v2.0/ports?device_id=4e4af9c6-5777-4e4d-83b6-7677b23a5bf2 HTTP/1.1" status: 200 len: 210 time: 0.0320592 Dec 09 22:22:22.683747 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33846) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:23.038258 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0f185f43-d65d-4b6e-90a0-bb618d113fa4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:23.290316 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-0f185f43-d65d-4b6e-90a0-bb618d113fa4 admin admin] Deleting port 4ec2eb7e-aa5f-4a78-af85-c1be398e85de {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:22:23.290565 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0f185f43-d65d-4b6e-90a0-bb618d113fa4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:23.371362 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-0f185f43-d65d-4b6e-90a0-bb618d113fa4 admin admin] For port 4ec2eb7e-aa5f-4a78-af85-c1be398e85de, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=4ec2eb7e-aa5f-4a78-af85-c1be398e85de,segment=NetworkSegment(16bdd335-351c-4e9d-bde1-07a4c99d195c),segment_id=16bdd335-351c-4e9d-bde1-07a4c99d195c)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:22:23.371760 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0f185f43-d65d-4b6e-90a0-bb618d113fa4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:23.384536 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-0f185f43-d65d-4b6e-90a0-bb618d113fa4 admin admin] Calling delete_port for 4ec2eb7e-aa5f-4a78-af85-c1be398e85de owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:22:23.928413 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0f185f43-d65d-4b6e-90a0-bb618d113fa4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:23.954616 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f185f43-d65d-4b6e-90a0-bb618d113fa4 admin admin] Pushing event deleted for resources: {'Port': ['ID=4ec2eb7e-aa5f-4a78-af85-c1be398e85de,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:23.990981 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 144004a1-e56f-4a7a-a651-c300c1f3c832 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:22:24.020715 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 144004a1-e56f-4a7a-a651-c300c1f3c832 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:22:24.021163 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 144004a1-e56f-4a7a-a651-c300c1f3c832 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:22:24.141943 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0f185f43-d65d-4b6e-90a0-bb618d113fa4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:24.363474 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0f185f43-d65d-4b6e-90a0-bb618d113fa4 admin admin] Router 24626fb7-c6a2-4824-af06-13284de6ee53 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:22:24.479788 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0f185f43-d65d-4b6e-90a0-bb618d113fa4 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:22:24.488085 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0f185f43-d65d-4b6e-90a0-bb618d113fa4 admin admin] 10.222.0.13 "PUT /v2.0/routers/24626fb7-c6a2-4824-af06-13284de6ee53/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8004417 Dec 09 22:22:24.488193 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33848) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:24.489032 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-376790ff-dccb-44ff-9bfc-2ecfbb4c5280 None None] Sync routers for ids ['24626fb7-c6a2-4824-af06-13284de6ee53'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:22:24.499893 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-376790ff-dccb-44ff-9bfc-2ecfbb4c5280 None None] Routers {'24626fb7-c6a2-4824-af06-13284de6ee53'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:22:24.500531 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-376790ff-dccb-44ff-9bfc-2ecfbb4c5280 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:22:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['24626fb7-c6a2-4824-af06-13284de6ee53'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:24.594806 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-62935cf8-7b77-45c0-91fc-b75e59739ab0 admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:24.604398 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-376790ff-dccb-44ff-9bfc-2ecfbb4c5280 None None] Set router 24626fb7-c6a2-4824-af06-13284de6ee53 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:22:24.705997 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-62935cf8-7b77-45c0-91fc-b75e59739ab0 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:24.763655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-62935cf8-7b77-45c0-91fc-b75e59739ab0 admin admin] Deleting port 5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:22:24.763991 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-62935cf8-7b77-45c0-91fc-b75e59739ab0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:24.787135 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-376790ff-dccb-44ff-9bfc-2ecfbb4c5280 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'name': 'tempest-TestMinimumBasicScenario-304437312-router', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228'}], 'enable_snat': True}, 'gw_port_id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:22:23Z', 'revision_number': 5, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'gw_port': {'id': '5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:bb:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4172, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:20:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:24.814760 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-376790ff-dccb-44ff-9bfc-2ecfbb4c5280 None None] Checking router: 24626fb7-c6a2-4824-af06-13284de6ee53 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:22:24.824255 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-376790ff-dccb-44ff-9bfc-2ecfbb4c5280 None None] Routers {'24626fb7-c6a2-4824-af06-13284de6ee53'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:22:24.824848 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-376790ff-dccb-44ff-9bfc-2ecfbb4c5280 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:22:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['24626fb7-c6a2-4824-af06-13284de6ee53'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:24.847827 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-62935cf8-7b77-45c0-91fc-b75e59739ab0 admin admin] For port 5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:22:24.848231 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-62935cf8-7b77-45c0-91fc-b75e59739ab0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:24.860529 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-62935cf8-7b77-45c0-91fc-b75e59739ab0 admin admin] Calling delete_port for 5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:22:24.912101 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-376790ff-dccb-44ff-9bfc-2ecfbb4c5280 None None] Set router 24626fb7-c6a2-4824-af06-13284de6ee53 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:22:24.966514 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-376790ff-dccb-44ff-9bfc-2ecfbb4c5280 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'name': 'tempest-TestMinimumBasicScenario-304437312-router', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:22:24Z', 'revision_number': 6, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:24.993638 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-376790ff-dccb-44ff-9bfc-2ecfbb4c5280 None None] The sync data for ids ['24626fb7-c6a2-4824-af06-13284de6ee53'] in n-d-713301-27 is: [{'id': '24626fb7-c6a2-4824-af06-13284de6ee53', 'name': 'tempest-TestMinimumBasicScenario-304437312-router', 'tenant_id': '70ca64a954a041f5899f38ba64cf0fe9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:20:12Z', 'updated_at': '2021-12-09T22:22:24Z', 'revision_number': 6, 'project_id': '70ca64a954a041f5899f38ba64cf0fe9', 'gw_port_host': None}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:22:25.031624 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-62935cf8-7b77-45c0-91fc-b75e59739ab0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:25.059575 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62935cf8-7b77-45c0-91fc-b75e59739ab0 admin admin] Pushing event deleted for resources: {'Port': ['ID=5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:25.074068 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ecfbcfa9-c30b-403c-b44b-afb8b7520330 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:22:25.124614 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-62935cf8-7b77-45c0-91fc-b75e59739ab0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:25.221761 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-62935cf8-7b77-45c0-91fc-b75e59739ab0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:25.223885 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-62935cf8-7b77-45c0-91fc-b75e59739ab0 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:25.269244 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-62935cf8-7b77-45c0-91fc-b75e59739ab0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:25.269828 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-62935cf8-7b77-45c0-91fc-b75e59739ab0 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 24626fb7-c6a2-4824-af06-13284de6ee53 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 22:22:25.274726 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-62935cf8-7b77-45c0-91fc-b75e59739ab0 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:25.275987 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-62935cf8-7b77-45c0-91fc-b75e59739ab0 admin admin] 10.222.0.13 "DELETE /v2.0/routers/24626fb7-c6a2-4824-af06-13284de6ee53 HTTP/1.1" status: 204 len: 168 time: 0.7867916 Dec 09 22:22:25.279655 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33850) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:25.327005 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-81f6352b-c6ce-4cb8-abe8-61bff47c1408 admin admin] Deleting subnet 9016b68e-6021-4bdc-a7b1-be26d9de403a {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:22:25.330540 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-81f6352b-c6ce-4cb8-abe8-61bff47c1408 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:25.371424 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-81f6352b-c6ce-4cb8-abe8-61bff47c1408 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:25.464052 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-81f6352b-c6ce-4cb8-abe8-61bff47c1408 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:25.517583 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-81f6352b-c6ce-4cb8-abe8-61bff47c1408 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:25.549277 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81f6352b-c6ce-4cb8-abe8-61bff47c1408 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9016b68e-6021-4bdc-a7b1-be26d9de403a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:25.552898 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-81f6352b-c6ce-4cb8-abe8-61bff47c1408 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:25.556244 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-81f6352b-c6ce-4cb8-abe8-61bff47c1408 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/9016b68e-6021-4bdc-a7b1-be26d9de403a HTTP/1.1" status: 204 len: 168 time: 0.2752600 Dec 09 22:22:25.558878 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33852) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:25.559274 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fba77e42-8b60-4ab5-b2d2-c8de94f4b764 None None] Network 20d197ac-b0d5-4136-851b-f803672ee9e2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:22:25.631099 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03e28240-4462-4353-a107-ece9271f0ce0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:25.686175 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-03e28240-4462-4353-a107-ece9271f0ce0 admin admin] Deleting port d9add3f3-7bdd-4cdf-a092-eac2466765ed {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:22:25.686518 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03e28240-4462-4353-a107-ece9271f0ce0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:25.748390 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d22bea5c-f1aa-481a-bfec-fee5b0c2a006 None None] DHCP port deletion for 20d197ac-b0d5-4136-851b-f803672ee9e2 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:22:25.760798 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-03e28240-4462-4353-a107-ece9271f0ce0 admin admin] For port d9add3f3-7bdd-4cdf-a092-eac2466765ed, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d9add3f3-7bdd-4cdf-a092-eac2466765ed,segment=NetworkSegment(16bdd335-351c-4e9d-bde1-07a4c99d195c),segment_id=16bdd335-351c-4e9d-bde1-07a4c99d195c)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:22:25.761164 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03e28240-4462-4353-a107-ece9271f0ce0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:25.775824 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-03e28240-4462-4353-a107-ece9271f0ce0 admin admin] Calling delete_port for d9add3f3-7bdd-4cdf-a092-eac2466765ed owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:22:25.797497 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d22bea5c-f1aa-481a-bfec-fee5b0c2a006 None None] Deleting port d9add3f3-7bdd-4cdf-a092-eac2466765ed {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:22:25.797865 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d22bea5c-f1aa-481a-bfec-fee5b0c2a006 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:25.863486 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03e28240-4462-4353-a107-ece9271f0ce0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:25.864382 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-d22bea5c-f1aa-481a-bfec-fee5b0c2a006 None None] For port d9add3f3-7bdd-4cdf-a092-eac2466765ed, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d9add3f3-7bdd-4cdf-a092-eac2466765ed,segment=NetworkSegment(16bdd335-351c-4e9d-bde1-07a4c99d195c),segment_id=16bdd335-351c-4e9d-bde1-07a4c99d195c)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:22:25.865122 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d22bea5c-f1aa-481a-bfec-fee5b0c2a006 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:25.879034 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d22bea5c-f1aa-481a-bfec-fee5b0c2a006 None None] Calling delete_port for d9add3f3-7bdd-4cdf-a092-eac2466765ed owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:22:25.889110 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03e28240-4462-4353-a107-ece9271f0ce0 admin admin] Pushing event deleted for resources: {'Port': ['ID=d9add3f3-7bdd-4cdf-a092-eac2466765ed,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:25.895790 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03e28240-4462-4353-a107-ece9271f0ce0 admin admin] No DVR routers for this DVR port d9add3f3-7bdd-4cdf-a092-eac2466765ed on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:22:25.965265 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d22bea5c-f1aa-481a-bfec-fee5b0c2a006 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:25.978798 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03e28240-4462-4353-a107-ece9271f0ce0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:25.990966 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d22bea5c-f1aa-481a-bfec-fee5b0c2a006 None None] Pushing event deleted for resources: {'Port': ['ID=d9add3f3-7bdd-4cdf-a092-eac2466765ed,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:25.995624 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d22bea5c-f1aa-481a-bfec-fee5b0c2a006 None None] No DVR routers for this DVR port d9add3f3-7bdd-4cdf-a092-eac2466765ed on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:22:26.000396 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-03e28240-4462-4353-a107-ece9271f0ce0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['20d197ac-b0d5-4136-851b-f803672ee9e2']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:26.003189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d22bea5c-f1aa-481a-bfec-fee5b0c2a006 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:26.003571 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d22bea5c-f1aa-481a-bfec-fee5b0c2a006 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:26.003910 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d22bea5c-f1aa-481a-bfec-fee5b0c2a006 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:26.004262 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d22bea5c-f1aa-481a-bfec-fee5b0c2a006 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:26.008788 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d22bea5c-f1aa-481a-bfec-fee5b0c2a006 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:26.009114 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d22bea5c-f1aa-481a-bfec-fee5b0c2a006 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:26.009456 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d22bea5c-f1aa-481a-bfec-fee5b0c2a006 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:26.009916 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d22bea5c-f1aa-481a-bfec-fee5b0c2a006 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:26.010447 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d22bea5c-f1aa-481a-bfec-fee5b0c2a006 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:26.010816 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d22bea5c-f1aa-481a-bfec-fee5b0c2a006 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:26.011147 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d22bea5c-f1aa-481a-bfec-fee5b0c2a006 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:26.011486 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d22bea5c-f1aa-481a-bfec-fee5b0c2a006 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:26.011817 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d22bea5c-f1aa-481a-bfec-fee5b0c2a006 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:26.016342 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-03e28240-4462-4353-a107-ece9271f0ce0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '16bdd335-351c-4e9d-bde1-07a4c99d195c') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:26.016645 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-03e28240-4462-4353-a107-ece9271f0ce0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '16bdd335-351c-4e9d-bde1-07a4c99d195c') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:26.027819 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03e28240-4462-4353-a107-ece9271f0ce0 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:26.042586 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03e28240-4462-4353-a107-ece9271f0ce0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:26.048753 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-03e28240-4462-4353-a107-ece9271f0ce0 admin admin] Releasing vlan 111 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:22:26.049144 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03e28240-4462-4353-a107-ece9271f0ce0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: timer() Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:22:26.050836 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:22:26.110236 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03e28240-4462-4353-a107-ece9271f0ce0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:26.116426 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-03e28240-4462-4353-a107-ece9271f0ce0 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:26.119638 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-03e28240-4462-4353-a107-ece9271f0ce0 admin admin] 10.222.0.13 "DELETE /v2.0/networks/20d197ac-b0d5-4136-851b-f803672ee9e2 HTTP/1.1" status: 204 len: 168 time: 0.5596023 Dec 09 22:22:26.122877 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33856) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:26.130055 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03e28240-4462-4353-a107-ece9271f0ce0 admin admin] Pushing event deleted for resources: {'Network': ['ID=20d197ac-b0d5-4136-851b-f803672ee9e2,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:26.292746 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 4ec2eb7e-aa5f-4a78-af85-c1be398e85de no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:22:26.315882 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 4ec2eb7e-aa5f-4a78-af85-c1be398e85de {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:22:26.316224 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 4ec2eb7e-aa5f-4a78-af85-c1be398e85de not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:22:26.316629 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d9add3f3-7bdd-4cdf-a092-eac2466765ed no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:22:26.335111 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: d9add3f3-7bdd-4cdf-a092-eac2466765ed {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:22:26.335478 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d9add3f3-7bdd-4cdf-a092-eac2466765ed not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:22:26.335890 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:22:26.354817 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:22:26.355161 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5e2b62fa-3e18-497b-b8ec-1a3a0ab4c3a1 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:22:26.482887 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4d413750-d932-4485-93ff-8adcecd048cd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:26.741324 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-4d413750-d932-4485-93ff-8adcecd048cd admin admin] Deleting port 7257da7c-1ae2-4377-8d16-b8f186ab5ae6 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:22:26.741659 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4d413750-d932-4485-93ff-8adcecd048cd admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:26.827393 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-4d413750-d932-4485-93ff-8adcecd048cd admin admin] For port 7257da7c-1ae2-4377-8d16-b8f186ab5ae6, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7257da7c-1ae2-4377-8d16-b8f186ab5ae6,segment=NetworkSegment(5ba61fcf-8990-4c4d-8d58-4a20e35a9f21),segment_id=5ba61fcf-8990-4c4d-8d58-4a20e35a9f21)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:22:26.827858 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4d413750-d932-4485-93ff-8adcecd048cd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:26.844846 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-4d413750-d932-4485-93ff-8adcecd048cd admin admin] Calling delete_port for 7257da7c-1ae2-4377-8d16-b8f186ab5ae6 owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:22:27.030046 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4d413750-d932-4485-93ff-8adcecd048cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:27.056989 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d413750-d932-4485-93ff-8adcecd048cd admin admin] Pushing event deleted for resources: {'Port': ['ID=7257da7c-1ae2-4377-8d16-b8f186ab5ae6,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:27.224064 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-4d413750-d932-4485-93ff-8adcecd048cd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:27.442585 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4d413750-d932-4485-93ff-8adcecd048cd admin admin] Router 74c82537-ce8a-4bdd-983a-3cfad6147d1d has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:22:27.550972 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4d413750-d932-4485-93ff-8adcecd048cd admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:22:27.556407 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-4d413750-d932-4485-93ff-8adcecd048cd admin admin] 10.222.0.13 "PUT /v2.0/routers/74c82537-ce8a-4bdd-983a-3cfad6147d1d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4324517 Dec 09 22:22:27.560363 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33864) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:27.563055 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a07416e1-6b78-4d80-9722-f8f67024fd1c None None] Sync routers for ids ['74c82537-ce8a-4bdd-983a-3cfad6147d1d'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:22:27.575351 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a07416e1-6b78-4d80-9722-f8f67024fd1c None None] Routers {'74c82537-ce8a-4bdd-983a-3cfad6147d1d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:22:27.576008 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a07416e1-6b78-4d80-9722-f8f67024fd1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:22:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['74c82537-ce8a-4bdd-983a-3cfad6147d1d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:27.663752 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59d2f5e2-b277-4e88-90d6-7c1b147c2f5d admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:27.673858 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:27.682258 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-a07416e1-6b78-4d80-9722-f8f67024fd1c None None] Set router 74c82537-ce8a-4bdd-983a-3cfad6147d1d gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:22:27.764546 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59d2f5e2-b277-4e88-90d6-7c1b147c2f5d admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:27.776871 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:27.817605 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-59d2f5e2-b277-4e88-90d6-7c1b147c2f5d admin admin] Deleting port 5a865e27-1a28-4929-9eb1-0503f1a4fc4e {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:22:27.817947 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59d2f5e2-b277-4e88-90d6-7c1b147c2f5d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:27.859462 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a07416e1-6b78-4d80-9722-f8f67024fd1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '74c82537-ce8a-4bdd-983a-3cfad6147d1d', 'name': 'tempest-TestMinimumBasicScenario-1848155188-router', 'tenant_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.183'}], 'enable_snat': True}, 'gw_port_id': '5a865e27-1a28-4929-9eb1-0503f1a4fc4e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:20:17Z', 'updated_at': '2021-12-09T22:22:26Z', 'revision_number': 5, 'project_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'gw_port': {'id': '5a865e27-1a28-4929-9eb1-0503f1a4fc4e', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:40:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '74c82537-ce8a-4bdd-983a-3cfad6147d1d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4184, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:20:17Z', 'updated_at': '2021-12-09T22:20:21Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:27.889129 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a07416e1-6b78-4d80-9722-f8f67024fd1c None None] Checking router: 74c82537-ce8a-4bdd-983a-3cfad6147d1d for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:22:27.894796 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-59d2f5e2-b277-4e88-90d6-7c1b147c2f5d admin admin] For port 5a865e27-1a28-4929-9eb1-0503f1a4fc4e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=5a865e27-1a28-4929-9eb1-0503f1a4fc4e,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:22:27.895156 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59d2f5e2-b277-4e88-90d6-7c1b147c2f5d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:27.897412 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a07416e1-6b78-4d80-9722-f8f67024fd1c None None] Routers {'74c82537-ce8a-4bdd-983a-3cfad6147d1d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:22:27.898010 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a07416e1-6b78-4d80-9722-f8f67024fd1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:22:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['74c82537-ce8a-4bdd-983a-3cfad6147d1d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:27.908246 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-59d2f5e2-b277-4e88-90d6-7c1b147c2f5d admin admin] Calling delete_port for 5a865e27-1a28-4929-9eb1-0503f1a4fc4e owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:22:27.981084 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-a07416e1-6b78-4d80-9722-f8f67024fd1c None None] Set router 74c82537-ce8a-4bdd-983a-3cfad6147d1d gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:22:28.031113 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a07416e1-6b78-4d80-9722-f8f67024fd1c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '74c82537-ce8a-4bdd-983a-3cfad6147d1d', 'name': 'tempest-TestMinimumBasicScenario-1848155188-router', 'tenant_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:20:17Z', 'updated_at': '2021-12-09T22:22:27Z', 'revision_number': 6, 'project_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:28.059657 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a07416e1-6b78-4d80-9722-f8f67024fd1c None None] The sync data for ids ['74c82537-ce8a-4bdd-983a-3cfad6147d1d'] in n-d-713301-27 is: [{'id': '74c82537-ce8a-4bdd-983a-3cfad6147d1d', 'name': 'tempest-TestMinimumBasicScenario-1848155188-router', 'tenant_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:20:17Z', 'updated_at': '2021-12-09T22:22:27Z', 'revision_number': 6, 'project_id': '6db0ddad81ad44eb8fe3f1a1d8dfd734', 'gw_port_host': None}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:22:28.071187 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59d2f5e2-b277-4e88-90d6-7c1b147c2f5d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:28.099558 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59d2f5e2-b277-4e88-90d6-7c1b147c2f5d admin admin] Pushing event deleted for resources: {'Port': ['ID=5a865e27-1a28-4929-9eb1-0503f1a4fc4e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:28.116532 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be755fca-5aee-429b-adff-012ee327a95d None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:22:28.163742 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59d2f5e2-b277-4e88-90d6-7c1b147c2f5d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:28.253083 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59d2f5e2-b277-4e88-90d6-7c1b147c2f5d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:28.255349 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59d2f5e2-b277-4e88-90d6-7c1b147c2f5d admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:28.315675 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59d2f5e2-b277-4e88-90d6-7c1b147c2f5d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:28.316204 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-59d2f5e2-b277-4e88-90d6-7c1b147c2f5d admin admin] Fanout notify agent at l3_agent the message router_deleted on router 74c82537-ce8a-4bdd-983a-3cfad6147d1d {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 22:22:28.321206 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-59d2f5e2-b277-4e88-90d6-7c1b147c2f5d admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:28.322372 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-59d2f5e2-b277-4e88-90d6-7c1b147c2f5d admin admin] 10.222.0.13 "DELETE /v2.0/routers/74c82537-ce8a-4bdd-983a-3cfad6147d1d HTTP/1.1" status: 204 len: 168 time: 0.7610390 Dec 09 22:22:28.325151 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33866) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:28.374456 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-f50b9ff5-5fce-4eb3-b8b9-9cbcd8fb0e42 admin admin] Deleting subnet 96cbaf46-83b1-48f6-9738-17111c4a4dca {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:22:28.377653 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f50b9ff5-5fce-4eb3-b8b9-9cbcd8fb0e42 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:28.416090 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f50b9ff5-5fce-4eb3-b8b9-9cbcd8fb0e42 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:28.498941 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f50b9ff5-5fce-4eb3-b8b9-9cbcd8fb0e42 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:28.553546 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f50b9ff5-5fce-4eb3-b8b9-9cbcd8fb0e42 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:28.580635 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f50b9ff5-5fce-4eb3-b8b9-9cbcd8fb0e42 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=96cbaf46-83b1-48f6-9738-17111c4a4dca,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:28.586616 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f50b9ff5-5fce-4eb3-b8b9-9cbcd8fb0e42 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:28.591482 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f50b9ff5-5fce-4eb3-b8b9-9cbcd8fb0e42 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/96cbaf46-83b1-48f6-9738-17111c4a4dca HTTP/1.1" status: 204 len: 168 time: 0.2637193 Dec 09 22:22:28.592533 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33868) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:28.593985 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7fdc05d1-f080-4ae7-a560-090fbdc19539 None None] Network d2c4bf04-fd51-454e-b93e-6e6e4012c291 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:22:28.661291 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-08793516-ef21-4839-a4c2-e509395a7f04 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:28.716047 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-08793516-ef21-4839-a4c2-e509395a7f04 admin admin] Deleting port 11df3507-b108-4b04-85f9-39022a13a30b {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:22:28.716387 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-08793516-ef21-4839-a4c2-e509395a7f04 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:28.782761 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-08793516-ef21-4839-a4c2-e509395a7f04 admin admin] For port 11df3507-b108-4b04-85f9-39022a13a30b, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=11df3507-b108-4b04-85f9-39022a13a30b,segment=NetworkSegment(5ba61fcf-8990-4c4d-8d58-4a20e35a9f21),segment_id=5ba61fcf-8990-4c4d-8d58-4a20e35a9f21)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:22:28.783012 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-08793516-ef21-4839-a4c2-e509395a7f04 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:28.796888 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-08793516-ef21-4839-a4c2-e509395a7f04 admin admin] Calling delete_port for 11df3507-b108-4b04-85f9-39022a13a30b owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:22:28.875304 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cc3b7a9c-2064-4ab8-89c7-37d63d8943b7 None None] DHCP port deletion for d2c4bf04-fd51-454e-b93e-6e6e4012c291 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:22:28.884227 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7257da7c-1ae2-4377-8d16-b8f186ab5ae6 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:22:28.896592 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-08793516-ef21-4839-a4c2-e509395a7f04 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:28.924641 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08793516-ef21-4839-a4c2-e509395a7f04 admin admin] Pushing event deleted for resources: {'Port': ['ID=11df3507-b108-4b04-85f9-39022a13a30b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:28.927139 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 7257da7c-1ae2-4377-8d16-b8f186ab5ae6 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:22:28.927485 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7257da7c-1ae2-4377-8d16-b8f186ab5ae6 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:22:28.930350 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08793516-ef21-4839-a4c2-e509395a7f04 admin admin] No DVR routers for this DVR port 11df3507-b108-4b04-85f9-39022a13a30b on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:22:28.950919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-cc3b7a9c-2064-4ab8-89c7-37d63d8943b7 None None] Deleting port 11df3507-b108-4b04-85f9-39022a13a30b {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:22:28.951295 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cc3b7a9c-2064-4ab8-89c7-37d63d8943b7 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:29.005774 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-08793516-ef21-4839-a4c2-e509395a7f04 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:29.015039 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-cc3b7a9c-2064-4ab8-89c7-37d63d8943b7 None None] For port 11df3507-b108-4b04-85f9-39022a13a30b, host n-d-713301-27, got binding levels [] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:22:29.015465 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cc3b7a9c-2064-4ab8-89c7-37d63d8943b7 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:29.025670 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-08793516-ef21-4839-a4c2-e509395a7f04 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d2c4bf04-fd51-454e-b93e-6e6e4012c291']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:29.028002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-cc3b7a9c-2064-4ab8-89c7-37d63d8943b7 None None] Calling delete_port for 11df3507-b108-4b04-85f9-39022a13a30b owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:22:29.031056 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.ipam_backend_mixin [None req-cc3b7a9c-2064-4ab8-89c7-37d63d8943b7 None None] Port 11df3507-b108-4b04-85f9-39022a13a30b was not found and therefore no delete operation was performed {{(pid=103439) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 09 22:22:29.032383 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cc3b7a9c-2064-4ab8-89c7-37d63d8943b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:29.035129 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-08793516-ef21-4839-a4c2-e509395a7f04 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5ba61fcf-8990-4c4d-8d58-4a20e35a9f21') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:29.035421 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-08793516-ef21-4839-a4c2-e509395a7f04 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5ba61fcf-8990-4c4d-8d58-4a20e35a9f21') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:29.044774 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-08793516-ef21-4839-a4c2-e509395a7f04 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:29.057617 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc3b7a9c-2064-4ab8-89c7-37d63d8943b7 None None] Pushing event deleted for resources: {'Port': ['ID=11df3507-b108-4b04-85f9-39022a13a30b,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:29.059945 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-08793516-ef21-4839-a4c2-e509395a7f04 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:29.062059 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc3b7a9c-2064-4ab8-89c7-37d63d8943b7 None None] No DVR routers for this DVR port 11df3507-b108-4b04-85f9-39022a13a30b on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:22:29.067872 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-08793516-ef21-4839-a4c2-e509395a7f04 admin admin] Releasing vlan 144 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:22:29.068335 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-08793516-ef21-4839-a4c2-e509395a7f04 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: timer() Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:22:29.072146 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:22:29.133171 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-08793516-ef21-4839-a4c2-e509395a7f04 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:29.139197 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-08793516-ef21-4839-a4c2-e509395a7f04 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:29.142864 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-08793516-ef21-4839-a4c2-e509395a7f04 admin admin] 10.222.0.13 "DELETE /v2.0/networks/d2c4bf04-fd51-454e-b93e-6e6e4012c291 HTTP/1.1" status: 204 len: 168 time: 0.5493834 Dec 09 22:22:29.157193 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08793516-ef21-4839-a4c2-e509395a7f04 admin admin] Pushing event deleted for resources: {'Network': ['ID=d2c4bf04-fd51-454e-b93e-6e6e4012c291,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:29.313743 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33872) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:29.353429 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-dd3a7500-c1b2-460d-b669-f67f15144e07 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=70ca64a954a041f5899f38ba64cf0fe9&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0383451 Dec 09 22:22:29.355825 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33874) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:29.402994 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-54112cf3-017c-4e67-8404-5f389f17d837 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:29.424481 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-54112cf3-017c-4e67-8404-5f389f17d837 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:29.473438 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-54112cf3-017c-4e67-8404-5f389f17d837 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:29.476041 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-54112cf3-017c-4e67-8404-5f389f17d837 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:29.477207 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-54112cf3-017c-4e67-8404-5f389f17d837 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/6b184103-34f5-4d74-b063-cc970fc8b573 HTTP/1.1" status: 204 len: 168 time: 0.1204972 Dec 09 22:22:29.485883 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54112cf3-017c-4e67-8404-5f389f17d837 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6b184103-34f5-4d74-b063-cc970fc8b573,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:29.813724 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33880) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:29.854416 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5f949234-32f1-4c44-8068-9499f0f30610 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=6db0ddad81ad44eb8fe3f1a1d8dfd734&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0394123 Dec 09 22:22:29.856906 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33882) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:29.904311 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-61959252-2ef2-40ae-b046-ae1ca6ad65ca admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:29.926583 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-61959252-2ef2-40ae-b046-ae1ca6ad65ca admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:29.982728 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-61959252-2ef2-40ae-b046-ae1ca6ad65ca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:29.985341 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-61959252-2ef2-40ae-b046-ae1ca6ad65ca admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:29.986538 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-61959252-2ef2-40ae-b046-ae1ca6ad65ca admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/6e80c7c3-51e7-4139-9b4a-9933c67d8bef HTTP/1.1" status: 204 len: 168 time: 0.1287799 Dec 09 22:22:29.995793 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61959252-2ef2-40ae-b046-ae1ca6ad65ca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6e80c7c3-51e7-4139-9b4a-9933c67d8bef,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:30.277512 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 11df3507-b108-4b04-85f9-39022a13a30b no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:22:30.301615 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 11df3507-b108-4b04-85f9-39022a13a30b {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:22:30.301966 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 11df3507-b108-4b04-85f9-39022a13a30b not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:22:30.302384 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5a865e27-1a28-4929-9eb1-0503f1a4fc4e no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:22:30.321703 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 5a865e27-1a28-4929-9eb1-0503f1a4fc4e {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:22:30.322059 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 5a865e27-1a28-4929-9eb1-0503f1a4fc4e not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:22:31.764783 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33922) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:31.769579 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-425d66db-41f7-4f8f-9f26-4108d9d60a1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1059665075', 'description': 'tempest-secgroup-smoke-1059665075 description', 'project_id': 'e21dff80515b44aa9f01117603c6de0d'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:22:31.795407 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-425d66db-41f7-4f8f-9f26-4108d9d60a1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:31.804520 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-425d66db-41f7-4f8f-9f26-4108d9d60a1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:31.887108 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-425d66db-41f7-4f8f-9f26-4108d9d60a1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:31.892064 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-425d66db-41f7-4f8f-9f26-4108d9d60a1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:31.930317 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-425d66db-41f7-4f8f-9f26-4108d9d60a1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9561a413-d255-4ccd-8b82-e57af0f2ca26,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:31.967982 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-425d66db-41f7-4f8f-9f26-4108d9d60a1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:31.974328 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-425d66db-41f7-4f8f-9f26-4108d9d60a1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.006137 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-425d66db-41f7-4f8f-9f26-4108d9d60a1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.007476 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-425d66db-41f7-4f8f-9f26-4108d9d60a1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.2415166 Dec 09 22:22:32.009126 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-425d66db-41f7-4f8f-9f26-4108d9d60a1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0f796547-52c1-43d2-92c2-87811d2e4548,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:32.010804 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33924) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:32.015805 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-d752863a-a2c0-458d-b0ca-987c51081f51 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': '0f796547-52c1-43d2-92c2-87811d2e4548', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:22:32.052078 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d752863a-a2c0-458d-b0ca-987c51081f51 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.104288 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d752863a-a2c0-458d-b0ca-987c51081f51 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.109228 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d752863a-a2c0-458d-b0ca-987c51081f51 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.126004 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d752863a-a2c0-458d-b0ca-987c51081f51 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9ae2da4b-eeb3-45e9-b159-d0e1c8da4d35,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:32.134498 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d752863a-a2c0-458d-b0ca-987c51081f51 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.135720 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d752863a-a2c0-458d-b0ca-987c51081f51 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1236637 Dec 09 22:22:32.138537 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33926) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:32.142855 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-61552277-bdc7-46e7-bdbf-befbc64a5e06 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': '0f796547-52c1-43d2-92c2-87811d2e4548', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:22:32.171341 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-61552277-bdc7-46e7-bdbf-befbc64a5e06 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.226657 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-61552277-bdc7-46e7-bdbf-befbc64a5e06 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.231321 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-61552277-bdc7-46e7-bdbf-befbc64a5e06 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.248556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61552277-bdc7-46e7-bdbf-befbc64a5e06 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=770e47fc-06ea-42ed-8906-46ec6ec80ecb,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:32.256875 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-61552277-bdc7-46e7-bdbf-befbc64a5e06 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.258053 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-61552277-bdc7-46e7-bdbf-befbc64a5e06 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1186209 Dec 09 22:22:32.261217 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33928) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:32.265463 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-3caf8980-4bc6-4870-9288-8fa3c584c693 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': '0f796547-52c1-43d2-92c2-87811d2e4548', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:22:32.293215 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3caf8980-4bc6-4870-9288-8fa3c584c693 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.357108 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3caf8980-4bc6-4870-9288-8fa3c584c693 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.363519 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3caf8980-4bc6-4870-9288-8fa3c584c693 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.382374 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3caf8980-4bc6-4870-9288-8fa3c584c693 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2151b116-f4d6-4888-9115-bd52ca0861be,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:32.390178 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-3caf8980-4bc6-4870-9288-8fa3c584c693 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.391405 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-3caf8980-4bc6-4870-9288-8fa3c584c693 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1292779 Dec 09 22:22:32.394213 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33930) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:32.398943 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c63ce61c-d6d7-4e66-9d14-d5b45a088544 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': '0f796547-52c1-43d2-92c2-87811d2e4548', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:22:32.432162 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c63ce61c-d6d7-4e66-9d14-d5b45a088544 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.493871 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c63ce61c-d6d7-4e66-9d14-d5b45a088544 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.498725 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c63ce61c-d6d7-4e66-9d14-d5b45a088544 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.517830 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c63ce61c-d6d7-4e66-9d14-d5b45a088544 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b3e91251-a185-4cf4-b00c-7ace7296ca07,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:32.526979 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c63ce61c-d6d7-4e66-9d14-d5b45a088544 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.528227 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c63ce61c-d6d7-4e66-9d14-d5b45a088544 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1330836 Dec 09 22:22:32.531556 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33932) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:32.536339 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-bacf309b-88ac-40a9-9d71-d5f638391965 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': '0f796547-52c1-43d2-92c2-87811d2e4548', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:22:32.560838 n-d-713301-27 neutron-server[103437]: INFO neutron.db.securitygroups_db [None req-bacf309b-88ac-40a9-9d71-d5f638391965 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Project e21dff80515b44aa9f01117603c6de0d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 22:22:32.565759 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bacf309b-88ac-40a9-9d71-d5f638391965 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.625262 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bacf309b-88ac-40a9-9d71-d5f638391965 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.629799 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bacf309b-88ac-40a9-9d71-d5f638391965 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.647183 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bacf309b-88ac-40a9-9d71-d5f638391965 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=06e405c5-ee79-43d1-a255-5ec068044da6,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:32.655330 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bacf309b-88ac-40a9-9d71-d5f638391965 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.656929 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bacf309b-88ac-40a9-9d71-d5f638391965 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1242945 Dec 09 22:22:32.660036 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33934) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:32.665335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-9f05d9fe-2527-485c-b882-11b3f884329c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': '0f796547-52c1-43d2-92c2-87811d2e4548', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:22:32.689825 n-d-713301-27 neutron-server[103438]: INFO neutron.db.securitygroups_db [None req-9f05d9fe-2527-485c-b882-11b3f884329c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Project e21dff80515b44aa9f01117603c6de0d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 22:22:32.695155 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9f05d9fe-2527-485c-b882-11b3f884329c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.755456 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9f05d9fe-2527-485c-b882-11b3f884329c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.761137 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9f05d9fe-2527-485c-b882-11b3f884329c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.780508 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f05d9fe-2527-485c-b882-11b3f884329c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=eb103c20-eabd-492b-9fd4-2258dc8befe4,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:32.786590 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9f05d9fe-2527-485c-b882-11b3f884329c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.787839 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9f05d9fe-2527-485c-b882-11b3f884329c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1267912 Dec 09 22:22:32.791124 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33936) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:32.796901 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-1d5266c5-d5b4-485d-9832-358c24405605 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'network': {'name': 'tempest-network-smoke--356113773', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'port_security_enabled': True}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:22:32.819032 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1d5266c5-d5b4-485d-9832-358c24405605 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Made reservation on behalf of e21dff80515b44aa9f01117603c6de0d for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:22:32.823091 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1d5266c5-d5b4-485d-9832-358c24405605 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.848646 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1d5266c5-d5b4-485d-9832-358c24405605 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] vlan segment allocate from pool success with {'vlan_id': 115, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 22:22:32.860069 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1d5266c5-d5b4-485d-9832-358c24405605 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.860437 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-1d5266c5-d5b4-485d-9832-358c24405605 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Added segment 89d44add-d1b4-4677-a543-3bc5ca01ce78 of type vlan for network cff5da94-0610-451c-b1f5-67d31aadb2f2 Dec 09 22:22:32.901951 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1d5266c5-d5b4-485d-9832-358c24405605 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.933127 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1d5266c5-d5b4-485d-9832-358c24405605 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.938670 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d5266c5-d5b4-485d-9832-358c24405605 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:32.939263 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1d5266c5-d5b4-485d-9832-358c24405605 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:32.973179 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1d5266c5-d5b4-485d-9832-358c24405605 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.1803474 Dec 09 22:22:32.976522 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33938) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:32.981193 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-03911d8d-9be7-4efd-a947-96b5cfd81aa7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-639414800', 'admin_state_up': True, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:22:33.005356 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-03911d8d-9be7-4efd-a947-96b5cfd81aa7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:33.006362 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-03911d8d-9be7-4efd-a947-96b5cfd81aa7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:33.007557 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d5266c5-d5b4-485d-9832-358c24405605 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Network': ['ID=cff5da94-0610-451c-b1f5-67d31aadb2f2,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:33.019996 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network cff5da94-0610-451c-b1f5-67d31aadb2f2 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 22:22:33.051808 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cf3fe998-d631-4b8d-bd2e-c4ad1286f721 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:33.063739 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-03911d8d-9be7-4efd-a947-96b5cfd81aa7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:33.200763 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-03911d8d-9be7-4efd-a947-96b5cfd81aa7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:33.399428 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-03911d8d-9be7-4efd-a947-96b5cfd81aa7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:33.418814 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-03911d8d-9be7-4efd-a947-96b5cfd81aa7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:33.522208 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-03911d8d-9be7-4efd-a947-96b5cfd81aa7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Allocated IP 172.25.3.35 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/de197704-e053-4dc5-91d2-42e71583f4bf) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:22:33.642157 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-03911d8d-9be7-4efd-a947-96b5cfd81aa7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:33.680235 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-03911d8d-9be7-4efd-a947-96b5cfd81aa7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:33.718467 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-03911d8d-9be7-4efd-a947-96b5cfd81aa7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:22:33.725730 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-03911d8d-9be7-4efd-a947-96b5cfd81aa7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:22:33.728118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03911d8d-9be7-4efd-a947-96b5cfd81aa7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=de197704-e053-4dc5-91d2-42e71583f4bf,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:33.730287 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03911d8d-9be7-4efd-a947-96b5cfd81aa7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:22:33.741344 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46086789-f9e6-451f-a93a-a9b61784c2e7 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:22:33.856371 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d9a029d3-429f-47cc-9ac1-640909563581 None None] Provisioning complete for port de197704-e053-4dc5-91d2-42e71583f4bf triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:22:33.856706 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d9a029d3-429f-47cc-9ac1-640909563581 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:33.892959 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d9a029d3-429f-47cc-9ac1-640909563581 None None] Port de197704-e053-4dc5-91d2-42e71583f4bf cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:22:34.287798 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-03911d8d-9be7-4efd-a947-96b5cfd81aa7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:34.503708 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-03911d8d-9be7-4efd-a947-96b5cfd81aa7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:34.643297 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-03911d8d-9be7-4efd-a947-96b5cfd81aa7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router f0aed012-421c-4faa-a2f9-bd04de281a35 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 22:22:34.753354 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-03911d8d-9be7-4efd-a947-96b5cfd81aa7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:22:34.764440 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] Sync routers for ids ['f0aed012-421c-4faa-a2f9-bd04de281a35'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:22:34.775960 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-03911d8d-9be7-4efd-a947-96b5cfd81aa7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:34.776186 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] Routers {'f0aed012-421c-4faa-a2f9-bd04de281a35'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:22:34.776611 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:22:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f0aed012-421c-4faa-a2f9-bd04de281a35'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:34.777224 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-03911d8d-9be7-4efd-a947-96b5cfd81aa7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 894 time: 1.7996876 Dec 09 22:22:34.780442 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 33940) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:34.888741 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] Set router f0aed012-421c-4faa-a2f9-bd04de281a35 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:22:34.932666 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33944) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:34.933282 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6277766a-eadb-4da9-a7cf-d55ca42880aa tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] 10.222.0.13 "GET /v2.0/subnets?project_id=e21dff80515b44aa9f01117603c6de0d&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.1506512 Dec 09 22:22:35.029494 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e6101c26-e2f6-4f2d-b136-10014b238b0b tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:35.030960 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e6101c26-e2f6-4f2d-b136-10014b238b0b tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0971205 Dec 09 22:22:35.034473 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33946) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:35.064037 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-33e89da8-fff3-46a1-bb8f-035d3b44ffaf tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] 10.222.0.13 "GET /v2.0/subnets?network_id=97925a19-460a-4476-8208-41db134b6c83&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0284626 Dec 09 22:22:35.067029 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33948) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:35.072014 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-14107373-d772-40bb-bb4e-96e601978cd3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1829448084', 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:22:35.170689 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-14107373-d772-40bb-bb4e-96e601978cd3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Made reservation on behalf of e21dff80515b44aa9f01117603c6de0d for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:22:35.174582 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-14107373-d772-40bb-bb4e-96e601978cd3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:35.250517 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'name': 'tempest-TestNetworkAdvancedServerOps-router-639414800', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35'}], 'enable_snat': True}, 'gw_port_id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:34Z', 'revision_number': 3, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:e6:d6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4215, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:33Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:35.278105 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] Checking router: f0aed012-421c-4faa-a2f9-bd04de281a35 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:22:35.278478 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] Updating router f0aed012-421c-4faa-a2f9-bd04de281a35 port de197704-e053-4dc5-91d2-42e71583f4bf binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:22:35.303264 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:35.361225 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-14107373-d772-40bb-bb4e-96e601978cd3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:35.423197 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14107373-d772-40bb-bb4e-96e601978cd3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Subnet': ['ID=92dfdb7f-86d3-415c-b143-1054a8e59f6f,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:35.431789 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-14107373-d772-40bb-bb4e-96e601978cd3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Checking segment: {'id': '89d44add-d1b4-4677-a543-3bc5ca01ce78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:22:35.432108 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-14107373-d772-40bb-bb4e-96e601978cd3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network hostable DHCP agents. Network: cff5da94-0610-451c-b1f5-67d31aadb2f2, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 22:22:35.449064 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-14107373-d772-40bb-bb4e-96e601978cd3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network cff5da94-0610-451c-b1f5-67d31aadb2f2 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 22:22:35.458779 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-14107373-d772-40bb-bb4e-96e601978cd3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, cff5da94-0610-451c-b1f5-67d31aadb2f2) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:22:35.463792 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-14107373-d772-40bb-bb4e-96e601978cd3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:35.464861 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-14107373-d772-40bb-bb4e-96e601978cd3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:35.467721 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5225395b-4a6d-403a-ac90-a8ce1d9f5fd6 None None] Network cff5da94-0610-451c-b1f5-67d31aadb2f2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:22:35.484056 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-14107373-d772-40bb-bb4e-96e601978cd3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.4148927 Dec 09 22:22:35.485792 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 33950) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:35.619073 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f93fe51d-a541-4969-968d-105230dd024b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-cff5da94-0610-451c-b1f5-67d31aadb2f2', 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ips': [{'subnet_id': '92dfdb7f-86d3-415c-b143-1054a8e59f6f'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 22:22:35.619996 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f93fe51d-a541-4969-968d-105230dd024b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:35.645054 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:35.659752 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:35.760222 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-24e2110b-15e0-4841-b00a-8367dc5a6d6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:35.768858 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f32175b0-2ba7-4bec-b63f-ac755320085f None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:22:35.799041 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7737eac-4aae-4bb3-93b6-ef8de43eb61c None None] Pushing event updated for resources: {'Port': ['ID=de197704-e053-4dc5-91d2-42e71583f4bf,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:35.806319 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] Attempting to bind port de197704-e053-4dc5-91d2-42e71583f4bf on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:22:35.806716 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] Attempting to bind port de197704-e053-4dc5-91d2-42e71583f4bf by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:22:35.807084 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] Attempting to bind port de197704-e053-4dc5-91d2-42e71583f4bf on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:22:35.846340 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 22, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:22:35.846716 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:22:35.847127 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:35.847545 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:22:35.848032 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] Bound port: de197704-e053-4dc5-91d2-42e71583f4bf, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:22:35.848411 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:35.902008 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-abc14caf-e0da-45ee-8a66-593535747197 None None] Provisioning complete for port de197704-e053-4dc5-91d2-42e71583f4bf triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:22:35.902384 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-abc14caf-e0da-45ee-8a66-593535747197 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:35.934944 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-f93fe51d-a541-4969-968d-105230dd024b None None] Allocated IP 172.20.0.2 (cff5da94-0610-451c-b1f5-67d31aadb2f2/92dfdb7f-86d3-415c-b143-1054a8e59f6f/c80ae95c-b930-4325-b1ff-c64be2f2e0f9) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:22:35.968512 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] For port de197704-e053-4dc5-91d2-42e71583f4bf, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:22:35.988191 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-abc14caf-e0da-45ee-8a66-593535747197 None None] Port de197704-e053-4dc5-91d2-42e71583f4bf cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:22:35.994389 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] For port de197704-e053-4dc5-91d2-42e71583f4bf, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=de197704-e053-4dc5-91d2-42e71583f4bf,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:22:36.005306 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:36.082666 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06f13800-5883-440f-a6b9-60ffb0a529d1 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:22:36.123268 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7737eac-4aae-4bb3-93b6-ef8de43eb61c None None] Pushing event updated for resources: {'Port': ['ID=de197704-e053-4dc5-91d2-42e71583f4bf,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:36.127798 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] Routers {'f0aed012-421c-4faa-a2f9-bd04de281a35'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:22:36.128419 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:22:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f0aed012-421c-4faa-a2f9-bd04de281a35'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:36.267176 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f93fe51d-a541-4969-968d-105230dd024b None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:36.273308 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7598d3d7-9782-4b4f-89e8-ea790041618a None None] Provisioning complete for port de197704-e053-4dc5-91d2-42e71583f4bf triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:22:36.273650 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7598d3d7-9782-4b4f-89e8-ea790041618a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:36.276985 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5e2f9de-ae25-4709-b381-8191fea64aea tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:36.278330 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f93fe51d-a541-4969-968d-105230dd024b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:36.312745 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:22:36.350000 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] Set router f0aed012-421c-4faa-a2f9-bd04de281a35 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:22:36.416345 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f93fe51d-a541-4969-968d-105230dd024b None None] Network cff5da94-0610-451c-b1f5-67d31aadb2f2 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:22:36.428499 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-f93fe51d-a541-4969-968d-105230dd024b None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:22:36.435284 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f93fe51d-a541-4969-968d-105230dd024b None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:22:36.448002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f93fe51d-a541-4969-968d-105230dd024b None None] Pushing event updated for resources: {'Port': ['ID=c80ae95c-b930-4325-b1ff-c64be2f2e0f9,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:36.561494 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-f5e2f9de-ae25-4709-b381-8191fea64aea tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Allocated IP 172.20.0.1 (cff5da94-0610-451c-b1f5-67d31aadb2f2/92dfdb7f-86d3-415c-b143-1054a8e59f6f/d935a353-c56a-410a-a299-349bf01c04de) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:22:36.569887 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-f93fe51d-a541-4969-968d-105230dd024b None None] Attempting to bind port c80ae95c-b930-4325-b1ff-c64be2f2e0f9 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:22:36.570365 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-f93fe51d-a541-4969-968d-105230dd024b None None] Attempting to bind port c80ae95c-b930-4325-b1ff-c64be2f2e0f9 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '89d44add-d1b4-4677-a543-3bc5ca01ce78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:22:36.570779 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f93fe51d-a541-4969-968d-105230dd024b None None] Attempting to bind port c80ae95c-b930-4325-b1ff-c64be2f2e0f9 on network cff5da94-0610-451c-b1f5-67d31aadb2f2 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:22:36.595430 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f93fe51d-a541-4969-968d-105230dd024b None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 22, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:22:36.595835 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f93fe51d-a541-4969-968d-105230dd024b None None] Checking segment: {'id': '89d44add-d1b4-4677-a543-3bc5ca01ce78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:22:36.596244 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f93fe51d-a541-4969-968d-105230dd024b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:36.596636 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f93fe51d-a541-4969-968d-105230dd024b None None] Bound using segment: {'id': '89d44add-d1b4-4677-a543-3bc5ca01ce78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:22:36.597123 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-f93fe51d-a541-4969-968d-105230dd024b None None] Bound port: c80ae95c-b930-4325-b1ff-c64be2f2e0f9, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '89d44add-d1b4-4677-a543-3bc5ca01ce78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:22:36.597509 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f93fe51d-a541-4969-968d-105230dd024b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:36.609648 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7598d3d7-9782-4b4f-89e8-ea790041618a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:36.669976 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-7598d3d7-9782-4b4f-89e8-ea790041618a None None] For port de197704-e053-4dc5-91d2-42e71583f4bf, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=de197704-e053-4dc5-91d2-42e71583f4bf,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:22:36.683252 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7598d3d7-9782-4b4f-89e8-ea790041618a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:36.684063 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5e2f9de-ae25-4709-b381-8191fea64aea tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:36.722763 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5e2f9de-ae25-4709-b381-8191fea64aea tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:36.746630 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f93fe51d-a541-4969-968d-105230dd024b None None] For port c80ae95c-b930-4325-b1ff-c64be2f2e0f9, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:22:36.757663 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f93fe51d-a541-4969-968d-105230dd024b None None] For port c80ae95c-b930-4325-b1ff-c64be2f2e0f9, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c80ae95c-b930-4325-b1ff-c64be2f2e0f9,segment=NetworkSegment(89d44add-d1b4-4677-a543-3bc5ca01ce78),segment_id=89d44add-d1b4-4677-a543-3bc5ca01ce78)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:22:36.760706 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5e2f9de-ae25-4709-b381-8191fea64aea tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network cff5da94-0610-451c-b1f5-67d31aadb2f2 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:22:36.764088 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-f5e2f9de-ae25-4709-b381-8191fea64aea tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:22:36.764843 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7598d3d7-9782-4b4f-89e8-ea790041618a None None] Pushing event updated for resources: {'Port': ['ID=de197704-e053-4dc5-91d2-42e71583f4bf,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:36.767867 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f93fe51d-a541-4969-968d-105230dd024b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:36.768040 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5e2f9de-ae25-4709-b381-8191fea64aea tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:22:36.803262 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5e2f9de-ae25-4709-b381-8191fea64aea tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=d935a353-c56a-410a-a299-349bf01c04de,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:36.803740 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'name': 'tempest-TestNetworkAdvancedServerOps-router-639414800', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35'}], 'enable_snat': True}, 'gw_port_id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:34Z', 'revision_number': 3, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:e6:d6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4215, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:36.832488 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5e2f9de-ae25-4709-b381-8191fea64aea tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:36.848999 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-89ae3fb9-787f-4763-b75e-4a46ce701dcf None None] The sync data for ids ['f0aed012-421c-4faa-a2f9-bd04de281a35'] in n-d-713301-27 is: [{'id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'name': 'tempest-TestNetworkAdvancedServerOps-router-639414800', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35'}], 'enable_snat': True}, 'gw_port_id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:34Z', 'revision_number': 3, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:e6:d6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4215, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:22:36.871929 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f93fe51d-a541-4969-968d-105230dd024b None None] Pushing event updated for resources: {'Port': ['ID=c80ae95c-b930-4325-b1ff-c64be2f2e0f9,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:36.882436 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:36.980490 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5e2f9de-ae25-4709-b381-8191fea64aea tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:37.321649 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5e2f9de-ae25-4709-b381-8191fea64aea tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:37.327239 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5e2f9de-ae25-4709-b381-8191fea64aea tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:37.403625 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5e2f9de-ae25-4709-b381-8191fea64aea tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=d935a353-c56a-410a-a299-349bf01c04de,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:37.406119 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5e2f9de-ae25-4709-b381-8191fea64aea tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:37.506959 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5e2f9de-ae25-4709-b381-8191fea64aea tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network cff5da94-0610-451c-b1f5-67d31aadb2f2 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:22:37.508487 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-f5e2f9de-ae25-4709-b381-8191fea64aea tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:22:37.634046 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f5e2f9de-ae25-4709-b381-8191fea64aea tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router f0aed012-421c-4faa-a2f9-bd04de281a35 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:22:37.752648 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f5e2f9de-ae25-4709-b381-8191fea64aea tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:22:37.765242 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f5e2f9de-ae25-4709-b381-8191fea64aea tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "PUT /v2.0/routers/f0aed012-421c-4faa-a2f9-bd04de281a35/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2711051 Dec 09 22:22:37.860468 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f8a20c99-b1bf-4299-99f0-23a85adccf6b None None] Network cff5da94-0610-451c-b1f5-67d31aadb2f2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:22:37.921062 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2f34235a-5ac5-4e14-a872-c5444833752f req-6b68fa9f-903a-44fa-8a5f-77d514189a2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1059665075&fields=id&tenant_id=e21dff80515b44aa9f01117603c6de0d HTTP/1.1" status: 200 len: 267 time: 0.0458696 Dec 09 22:22:37.949993 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-68414df5-ad52-4c8b-b486-3abc7ef4f45d None None] Provisioning complete for port c80ae95c-b930-4325-b1ff-c64be2f2e0f9 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:22:37.949993 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-68414df5-ad52-4c8b-b486-3abc7ef4f45d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:38.033679 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f34235a-5ac5-4e14-a872-c5444833752f req-3e0a8600-9f93-4bc4-a2b6-47ece6503a00 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:38.035275 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2f34235a-5ac5-4e14-a872-c5444833752f req-3e0a8600-9f93-4bc4-a2b6-47ece6503a00 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/networks?id=cff5da94-0610-451c-b1f5-67d31aadb2f2 HTTP/1.1" status: 200 len: 796 time: 0.1067286 Dec 09 22:22:38.059275 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-68414df5-ad52-4c8b-b486-3abc7ef4f45d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:38.072664 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2f34235a-5ac5-4e14-a872-c5444833752f req-0459c582-0572-414d-88f4-118afb7528cd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/quotas/e21dff80515b44aa9f01117603c6de0d HTTP/1.1" status: 200 len: 375 time: 0.0159242 Dec 09 22:22:38.093388 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-68414df5-ad52-4c8b-b486-3abc7ef4f45d None None] For port c80ae95c-b930-4325-b1ff-c64be2f2e0f9, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c80ae95c-b930-4325-b1ff-c64be2f2e0f9,segment=NetworkSegment(89d44add-d1b4-4677-a543-3bc5ca01ce78),segment_id=89d44add-d1b4-4677-a543-3bc5ca01ce78)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:22:38.099326 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-68414df5-ad52-4c8b-b486-3abc7ef4f45d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:38.131565 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2f34235a-5ac5-4e14-a872-c5444833752f req-f2486a11-fa12-40f8-becb-bc9beb406ad3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0557868 Dec 09 22:22:38.156878 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68414df5-ad52-4c8b-b486-3abc7ef4f45d None None] Pushing event updated for resources: {'Port': ['ID=c80ae95c-b930-4325-b1ff-c64be2f2e0f9,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:38.198667 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-2f34235a-5ac5-4e14-a872-c5444833752f req-8c5c8694-6db3-4f40-ab5a-b9357c701e07 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 22:22:38.199968 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2f34235a-5ac5-4e14-a872-c5444833752f req-8c5c8694-6db3-4f40-ab5a-b9357c701e07 service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0548244 Dec 09 22:22:38.210332 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:38.319887 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7cec180c-259a-4243-b38d-b31abd60b6df service neutron] 10.222.0.13 "GET /v2.0/networks/cff5da94-0610-451c-b1f5-67d31aadb2f2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1095910 Dec 09 22:22:38.333263 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4eb51a9e-095d-47ec-8f2e-56a418cc9770 None None] Provisioning complete for port d935a353-c56a-410a-a299-349bf01c04de triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:22:38.333648 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4eb51a9e-095d-47ec-8f2e-56a418cc9770 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:38.375619 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c80ae95c-b930-4325-b1ff-c64be2f2e0f9 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:22:38.442761 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2f34235a-5ac5-4e14-a872-c5444833752f req-a8774991-b2c9-41d4-ba94-b37880167ea5 service neutron] 10.222.0.13 "GET /v2.0/networks/cff5da94-0610-451c-b1f5-67d31aadb2f2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1179590 Dec 09 22:22:38.608405 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-4eb51a9e-095d-47ec-8f2e-56a418cc9770 None None] Port d935a353-c56a-410a-a299-349bf01c04de cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:22:38.628423 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-4eb51a9e-095d-47ec-8f2e-56a418cc9770 None None] Provisioning complete for port c80ae95c-b930-4325-b1ff-c64be2f2e0f9 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:22:38.628641 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4eb51a9e-095d-47ec-8f2e-56a418cc9770 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:38.672787 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aff37df1-60ff-4e7a-b969-4024c0dedc5e req-0f5b5a17-edaa-470a-8653-bf10e3e14d71 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 210 time: 0.0549555 Dec 09 22:22:38.700582 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port c80ae95c-b930-4325-b1ff-c64be2f2e0f9 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:22:38.700959 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:38.775957 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] Sync routers for ids ['f0aed012-421c-4faa-a2f9-bd04de281a35'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:22:38.787578 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] Routers {'f0aed012-421c-4faa-a2f9-bd04de281a35'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:22:38.788204 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:22:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f0aed012-421c-4faa-a2f9-bd04de281a35'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:38.837578 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device de197704-e053-4dc5-91d2-42e71583f4bf up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:22:38.904519 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port de197704-e053-4dc5-91d2-42e71583f4bf triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:22:38.905135 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:38.908978 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5dafb550-4669-4cfe-a3c3-d050bd44382b None None] Provisioning complete for port d935a353-c56a-410a-a299-349bf01c04de triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:22:38.908978 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5dafb550-4669-4cfe-a3c3-d050bd44382b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:38.910473 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] Set router f0aed012-421c-4faa-a2f9-bd04de281a35 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:22:38.982287 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-5dafb550-4669-4cfe-a3c3-d050bd44382b None None] Port d935a353-c56a-410a-a299-349bf01c04de cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:22:39.110547 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'name': 'tempest-TestNetworkAdvancedServerOps-router-639414800', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35'}], 'enable_snat': True}, 'gw_port_id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:36Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:e6:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4215, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'd935a353-c56a-410a-a299-349bf01c04de', 'name': '', 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:b8:f4:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'device_owner': 'network:router_interface', 'standard_attr_id': 4218, 'fixed_ips': [{'subnet_id': '92dfdb7f-86d3-415c-b143-1054a8e59f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:22:36Z', 'updated_at': '2021-12-09T22:22:37Z', 'revision_number': 2, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '92dfdb7f-86d3-415c-b143-1054a8e59f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:39.238054 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] Checking router: f0aed012-421c-4faa-a2f9-bd04de281a35 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:22:39.238436 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] Updating router f0aed012-421c-4faa-a2f9-bd04de281a35 port d935a353-c56a-410a-a299-349bf01c04de binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:22:39.264917 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:39.524409 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:39.534253 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:39.592626 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-584af2e3-9a00-4113-8720-6fb71c9e5c0f None None] Pushing event updated for resources: {'Port': ['ID=d935a353-c56a-410a-a299-349bf01c04de,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:39.618640 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-584af2e3-9a00-4113-8720-6fb71c9e5c0f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:39.619027 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-584af2e3-9a00-4113-8720-6fb71c9e5c0f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:39.619364 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-584af2e3-9a00-4113-8720-6fb71c9e5c0f None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:39.619740 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-584af2e3-9a00-4113-8720-6fb71c9e5c0f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:39.620108 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-584af2e3-9a00-4113-8720-6fb71c9e5c0f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:39.620433 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-584af2e3-9a00-4113-8720-6fb71c9e5c0f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:39.620795 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-584af2e3-9a00-4113-8720-6fb71c9e5c0f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:39.621116 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-584af2e3-9a00-4113-8720-6fb71c9e5c0f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:39.621549 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-584af2e3-9a00-4113-8720-6fb71c9e5c0f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:39.621874 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-584af2e3-9a00-4113-8720-6fb71c9e5c0f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:39.622237 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-584af2e3-9a00-4113-8720-6fb71c9e5c0f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:39.623188 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-584af2e3-9a00-4113-8720-6fb71c9e5c0f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:39.623555 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-584af2e3-9a00-4113-8720-6fb71c9e5c0f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:22:39.654969 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] Attempting to bind port d935a353-c56a-410a-a299-349bf01c04de on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:22:39.655521 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] Attempting to bind port d935a353-c56a-410a-a299-349bf01c04de by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '89d44add-d1b4-4677-a543-3bc5ca01ce78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:22:39.655880 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] Attempting to bind port d935a353-c56a-410a-a299-349bf01c04de on network cff5da94-0610-451c-b1f5-67d31aadb2f2 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:22:39.661828 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 22, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:22:39.662320 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] Checking segment: {'id': '89d44add-d1b4-4677-a543-3bc5ca01ce78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:22:39.662585 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:39.662970 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] Bound using segment: {'id': '89d44add-d1b4-4677-a543-3bc5ca01ce78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:22:39.663556 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] Bound port: d935a353-c56a-410a-a299-349bf01c04de, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '89d44add-d1b4-4677-a543-3bc5ca01ce78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:22:39.665167 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:39.713455 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:39.756918 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] For port d935a353-c56a-410a-a299-349bf01c04de, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:22:39.760769 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] For port d935a353-c56a-410a-a299-349bf01c04de, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d935a353-c56a-410a-a299-349bf01c04de,segment=NetworkSegment(89d44add-d1b4-4677-a543-3bc5ca01ce78),segment_id=89d44add-d1b4-4677-a543-3bc5ca01ce78)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:22:39.771831 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f34235a-5ac5-4e14-a872-c5444833752f req-18bc4258-f0f8-4f54-a298-ea3cf84fe06a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:39.772469 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:39.773583 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2f34235a-5ac5-4e14-a872-c5444833752f req-18bc4258-f0f8-4f54-a298-ea3cf84fe06a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.31 "GET /v2.0/networks?id=cff5da94-0610-451c-b1f5-67d31aadb2f2 HTTP/1.1" status: 200 len: 796 time: 0.1630821 Dec 09 22:22:39.829655 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] Routers {'f0aed012-421c-4faa-a2f9-bd04de281a35'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:22:39.830789 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:22:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f0aed012-421c-4faa-a2f9-bd04de281a35'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:39.853025 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4b323cc4-3958-4836-ae87-41b80c394d8d req-e6da8695-aa74-4518-9b18-2064f5bfdf05 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 210 time: 0.0584712 Dec 09 22:22:39.883826 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2f34235a-5ac5-4e14-a872-c5444833752f req-fd2cfe7c-747a-4718-b4da-c3513154925d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=e21dff80515b44aa9f01117603c6de0d HTTP/1.1" status: 200 len: 380 time: 0.0981064 Dec 09 22:22:39.890569 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-584af2e3-9a00-4113-8720-6fb71c9e5c0f None None] Pushing event updated for resources: {'Port': ['ID=d935a353-c56a-410a-a299-349bf01c04de,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:39.896184 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7d08934d-36a5-425a-bddb-39c1e6c18d79 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'port': {'device_id': '8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f', 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2', 'admin_state_up': True, 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'security_groups': ['0f796547-52c1-43d2-92c2-87811d2e4548']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:22:39.914921 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-69570fe9-8480-4f84-aee2-8b2404822c81 None None] Provisioning complete for port d935a353-c56a-410a-a299-349bf01c04de triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:22:39.916752 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-69570fe9-8480-4f84-aee2-8b2404822c81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:39.979373 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] Set router f0aed012-421c-4faa-a2f9-bd04de281a35 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:22:40.005806 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-69570fe9-8480-4f84-aee2-8b2404822c81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:40.036865 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7d08934d-36a5-425a-bddb-39c1e6c18d79 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Made reservation on behalf of e21dff80515b44aa9f01117603c6de0d for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:22:40.041267 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7d08934d-36a5-425a-bddb-39c1e6c18d79 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:40.047668 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-69570fe9-8480-4f84-aee2-8b2404822c81 None None] For port d935a353-c56a-410a-a299-349bf01c04de, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d935a353-c56a-410a-a299-349bf01c04de,segment=NetworkSegment(89d44add-d1b4-4677-a543-3bc5ca01ce78),segment_id=89d44add-d1b4-4677-a543-3bc5ca01ce78)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:22:40.056204 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-69570fe9-8480-4f84-aee2-8b2404822c81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:40.116415 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69570fe9-8480-4f84-aee2-8b2404822c81 None None] Pushing event updated for resources: {'Port': ['ID=d935a353-c56a-410a-a299-349bf01c04de,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:40.181895 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-cbf57c5a-680e-4326-8182-ad7157761f9d None None] Provisioning complete for port d935a353-c56a-410a-a299-349bf01c04de triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:22:40.182259 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cbf57c5a-680e-4326-8182-ad7157761f9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:40.186323 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7d08934d-36a5-425a-bddb-39c1e6c18d79 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Allocated IP 172.20.0.6 (cff5da94-0610-451c-b1f5-67d31aadb2f2/92dfdb7f-86d3-415c-b143-1054a8e59f6f/79e91533-7acf-4fb0-8ffd-32edbfb1306e) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:22:40.211839 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'name': 'tempest-TestNetworkAdvancedServerOps-router-639414800', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35'}], 'enable_snat': True}, 'gw_port_id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:36Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:e6:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4215, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'd935a353-c56a-410a-a299-349bf01c04de', 'name': '', 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:b8:f4:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'device_owner': 'network:router_interface', 'standard_attr_id': 4218, 'fixed_ips': [{'subnet_id': '92dfdb7f-86d3-415c-b143-1054a8e59f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:22:36Z', 'updated_at': '2021-12-09T22:22:39Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '92dfdb7f-86d3-415c-b143-1054a8e59f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:40.241951 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a2801293-4102-4954-8c83-a504df2c4d73 None None] The sync data for ids ['f0aed012-421c-4faa-a2f9-bd04de281a35'] in n-d-713301-27 is: [{'id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'name': 'tempest-TestNetworkAdvancedServerOps-router-639414800', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35'}], 'enable_snat': True}, 'gw_port_id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:36Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:e6:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4215, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'd935a353-c56a-410a-a299-349bf01c04de', 'name': '', 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:b8:f4:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'device_owner': 'network:router_interface', 'standard_attr_id': 4218, 'fixed_ips': [{'subnet_id': '92dfdb7f-86d3-415c-b143-1054a8e59f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:22:36Z', 'updated_at': '2021-12-09T22:22:39Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '92dfdb7f-86d3-415c-b143-1054a8e59f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:22:40.350546 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7d08934d-36a5-425a-bddb-39c1e6c18d79 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:40.394700 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7d08934d-36a5-425a-bddb-39c1e6c18d79 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:40.438869 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7d08934d-36a5-425a-bddb-39c1e6c18d79 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network cff5da94-0610-451c-b1f5-67d31aadb2f2 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:22:40.441975 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7d08934d-36a5-425a-bddb-39c1e6c18d79 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:22:40.449680 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7d08934d-36a5-425a-bddb-39c1e6c18d79 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:22:40.476401 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d08934d-36a5-425a-bddb-39c1e6c18d79 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=79e91533-7acf-4fb0-8ffd-32edbfb1306e,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:40.511728 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7d08934d-36a5-425a-bddb-39c1e6c18d79 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:40.512408 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7d08934d-36a5-425a-bddb-39c1e6c18d79 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:40.530752 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7d08934d-36a5-425a-bddb-39c1e6c18d79 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6386180 Dec 09 22:22:40.542578 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-2f34235a-5ac5-4e14-a872-c5444833752f req-65442ee2-2989-479a-8c40-a29471753554 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 22:22:40.543640 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2f34235a-5ac5-4e14-a872-c5444833752f req-65442ee2-2989-479a-8c40-a29471753554 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0063884 Dec 09 22:22:40.607769 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7fc8c594-f820-4ae5-b2eb-23e29defbe6c service neutron] Request body: {'port': {'device_id': '8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:22:40.678089 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7fc8c594-f820-4ae5-b2eb-23e29defbe6c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:40.686768 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-aaa26cc0-bad1-47c6-a03f-a780c4ef6ff8 None None] Provisioning complete for port 79e91533-7acf-4fb0-8ffd-32edbfb1306e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:22:40.687148 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aaa26cc0-bad1-47c6-a03f-a780c4ef6ff8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:40.727530 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-aaa26cc0-bad1-47c6-a03f-a780c4ef6ff8 None None] Port 79e91533-7acf-4fb0-8ffd-32edbfb1306e cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:22:40.955340 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7fc8c594-f820-4ae5-b2eb-23e29defbe6c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 79e91533-7acf-4fb0-8ffd-32edbfb1306e {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:22:40.955936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eb875b6-4205-4760-a7a4-b89377369854 req-3bdf4598-f064-489d-bbfd-5348bddcd504 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:40.957027 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5eb875b6-4205-4760-a7a4-b89377369854 req-3bdf4598-f064-489d-bbfd-5348bddcd504 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 931 time: 0.0517418 Dec 09 22:22:40.964532 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7fc8c594-f820-4ae5-b2eb-23e29defbe6c service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:40.978240 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7fc8c594-f820-4ae5-b2eb-23e29defbe6c service neutron] Transition to ACTIVE for port object 79e91533-7acf-4fb0-8ffd-32edbfb1306e will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:22:40.984419 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7fc8c594-f820-4ae5-b2eb-23e29defbe6c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:41.014977 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5eb875b6-4205-4760-a7a4-b89377369854 req-f02b1a75-cc3d-4849-9449-c943b873b9e4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0f796547-52c1-43d2-92c2-87811d2e4548&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0505395 Dec 09 22:22:41.057549 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fc8c594-f820-4ae5-b2eb-23e29defbe6c service neutron] Pushing event updated for resources: {'Port': ['ID=79e91533-7acf-4fb0-8ffd-32edbfb1306e,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:41.115837 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7fc8c594-f820-4ae5-b2eb-23e29defbe6c service neutron] Attempting to bind port 79e91533-7acf-4fb0-8ffd-32edbfb1306e on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:22:41.116153 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7fc8c594-f820-4ae5-b2eb-23e29defbe6c service neutron] Attempting to bind port 79e91533-7acf-4fb0-8ffd-32edbfb1306e by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '89d44add-d1b4-4677-a543-3bc5ca01ce78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:22:41.116417 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7fc8c594-f820-4ae5-b2eb-23e29defbe6c service neutron] Attempting to bind port 79e91533-7acf-4fb0-8ffd-32edbfb1306e on network cff5da94-0610-451c-b1f5-67d31aadb2f2 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:22:41.121450 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7fc8c594-f820-4ae5-b2eb-23e29defbe6c service neutron] Port 79e91533-7acf-4fb0-8ffd-32edbfb1306e on network cff5da94-0610-451c-b1f5-67d31aadb2f2 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:22:41.121789 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7fc8c594-f820-4ae5-b2eb-23e29defbe6c service neutron] Attempting to bind port 79e91533-7acf-4fb0-8ffd-32edbfb1306e on network cff5da94-0610-451c-b1f5-67d31aadb2f2 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:22:41.128772 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7fc8c594-f820-4ae5-b2eb-23e29defbe6c service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 22, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:22:41.129147 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7fc8c594-f820-4ae5-b2eb-23e29defbe6c service neutron] Checking segment: {'id': '89d44add-d1b4-4677-a543-3bc5ca01ce78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:22:41.129491 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7fc8c594-f820-4ae5-b2eb-23e29defbe6c service neutron] Bound using segment: {'id': '89d44add-d1b4-4677-a543-3bc5ca01ce78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:22:41.129927 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7fc8c594-f820-4ae5-b2eb-23e29defbe6c service neutron] Bound port: 79e91533-7acf-4fb0-8ffd-32edbfb1306e, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '89d44add-d1b4-4677-a543-3bc5ca01ce78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 115, 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:22:41.130287 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7fc8c594-f820-4ae5-b2eb-23e29defbe6c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:41.208593 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7fc8c594-f820-4ae5-b2eb-23e29defbe6c service neutron] For port 79e91533-7acf-4fb0-8ffd-32edbfb1306e, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:22:41.212318 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7fc8c594-f820-4ae5-b2eb-23e29defbe6c service neutron] For port 79e91533-7acf-4fb0-8ffd-32edbfb1306e, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=79e91533-7acf-4fb0-8ffd-32edbfb1306e,segment=NetworkSegment(89d44add-d1b4-4677-a543-3bc5ca01ce78),segment_id=89d44add-d1b4-4677-a543-3bc5ca01ce78)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:22:41.219304 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7fc8c594-f820-4ae5-b2eb-23e29defbe6c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:41.270989 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7fc8c594-f820-4ae5-b2eb-23e29defbe6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:41.271641 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7fc8c594-f820-4ae5-b2eb-23e29defbe6c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:41.273074 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2f34235a-5ac5-4e14-a872-c5444833752f req-7fc8c594-f820-4ae5-b2eb-23e29defbe6c service neutron] 10.222.0.31 "PUT /v2.0/ports/79e91533-7acf-4fb0-8ffd-32edbfb1306e HTTP/1.1" status: 200 len: 1092 time: 0.7214062 Dec 09 22:22:41.273517 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f', 'tag': '79e91533-7acf-4fb0-8ffd-32edbfb1306e'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:22:41.275925 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f221fb0e-6b97-4791-9947-c9cd0466690b" -d '{"events": [{"name": "network-changed", "server_uuid": "8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f", "tag": "79e91533-7acf-4fb0-8ffd-32edbfb1306e"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:22:41.283863 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fc8c594-f820-4ae5-b2eb-23e29defbe6c service neutron] Pushing event updated for resources: {'Port': ['ID=79e91533-7acf-4fb0-8ffd-32edbfb1306e,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:41.324310 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:22:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d38ec6bb-4d62-424a-8959-f582f32df45c x-openstack-request-id: req-d38ec6bb-4d62-424a-8959-f582f32df45c {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:22:41.324605 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f", "tag": "79e91533-7acf-4fb0-8ffd-32edbfb1306e", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:22:41.324855 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-d38ec6bb-4d62-424a-8959-f582f32df45c {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:22:41.325309 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f', 'tag': '79e91533-7acf-4fb0-8ffd-32edbfb1306e', 'status': 'completed', 'code': 200} Dec 09 22:22:41.381258 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f34235a-5ac5-4e14-a872-c5444833752f req-e6af8f8e-1d9b-4f35-9f07-696818b63457 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:41.382843 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2f34235a-5ac5-4e14-a872-c5444833752f req-e6af8f8e-1d9b-4f35-9f07-696818b63457 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 1095 time: 0.0523794 Dec 09 22:22:41.429681 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2f34235a-5ac5-4e14-a872-c5444833752f req-450d176c-7b90-42c8-b515-2ae040657acf service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=79e91533-7acf-4fb0-8ffd-32edbfb1306e HTTP/1.1" status: 200 len: 217 time: 0.0387857 Dec 09 22:22:41.481001 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f34235a-5ac5-4e14-a872-c5444833752f req-9e4cab49-d6cd-4d34-856c-ce844ff4e904 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:41.482720 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2f34235a-5ac5-4e14-a872-c5444833752f req-9e4cab49-d6cd-4d34-856c-ce844ff4e904 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=92dfdb7f-86d3-415c-b143-1054a8e59f6f HTTP/1.1" status: 200 len: 835 time: 0.0463717 Dec 09 22:22:41.528944 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f34235a-5ac5-4e14-a872-c5444833752f req-c9af8e5b-efbb-4985-abbb-749635032a9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:41.530456 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2f34235a-5ac5-4e14-a872-c5444833752f req-c9af8e5b-efbb-4985-abbb-749635032a9d service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=cff5da94-0610-451c-b1f5-67d31aadb2f2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0410845 Dec 09 22:22:41.628058 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2f34235a-5ac5-4e14-a872-c5444833752f req-5142ddb9-a54b-4421-a4a1-0079b175a744 service neutron] 10.222.0.31 "GET /v2.0/networks/cff5da94-0610-451c-b1f5-67d31aadb2f2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0905161 Dec 09 22:22:41.731666 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2f34235a-5ac5-4e14-a872-c5444833752f req-66654ff6-2060-410a-9664-eb1a76739b96 service neutron] 10.222.0.31 "GET /v2.0/networks/cff5da94-0610-451c-b1f5-67d31aadb2f2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0960133 Dec 09 22:22:41.831420 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f221fb0e-6b97-4791-9947-c9cd0466690b req-f73ce88c-fd71-4fe8-b5ff-a1edaa985853 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:41.833009 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f221fb0e-6b97-4791-9947-c9cd0466690b req-f73ce88c-fd71-4fe8-b5ff-a1edaa985853 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 1095 time: 0.0453832 Dec 09 22:22:41.926903 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f221fb0e-6b97-4791-9947-c9cd0466690b req-256be619-8670-41e2-9541-923666ba25ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:41.928507 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f221fb0e-6b97-4791-9947-c9cd0466690b req-256be619-8670-41e2-9541-923666ba25ad service neutron] 10.222.0.31 "GET /v2.0/networks?id=cff5da94-0610-451c-b1f5-67d31aadb2f2 HTTP/1.1" status: 200 len: 897 time: 0.0869310 Dec 09 22:22:41.974097 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f221fb0e-6b97-4791-9947-c9cd0466690b req-f581f45d-d7ba-495e-ab6a-59b4fab3c458 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=79e91533-7acf-4fb0-8ffd-32edbfb1306e HTTP/1.1" status: 200 len: 217 time: 0.0375605 Dec 09 22:22:42.025258 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f221fb0e-6b97-4791-9947-c9cd0466690b req-47c26c6d-0fbd-4792-88c9-ee1665a5d808 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:42.026700 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f221fb0e-6b97-4791-9947-c9cd0466690b req-47c26c6d-0fbd-4792-88c9-ee1665a5d808 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=92dfdb7f-86d3-415c-b143-1054a8e59f6f HTTP/1.1" status: 200 len: 835 time: 0.0437591 Dec 09 22:22:42.074121 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f221fb0e-6b97-4791-9947-c9cd0466690b req-1fdee53a-7421-4197-a2d8-786634eac1ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:42.076198 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f221fb0e-6b97-4791-9947-c9cd0466690b req-1fdee53a-7421-4197-a2d8-786634eac1ed service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=cff5da94-0610-451c-b1f5-67d31aadb2f2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0415843 Dec 09 22:22:42.138139 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64685986-3677-4340-a2f0-ad9eb3db0087 req-41907e72-767c-43ee-94c0-3d12b5d991bc tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:42.139697 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-64685986-3677-4340-a2f0-ad9eb3db0087 req-41907e72-767c-43ee-94c0-3d12b5d991bc tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 943 time: 0.0509355 Dec 09 22:22:42.170994 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f221fb0e-6b97-4791-9947-c9cd0466690b req-77d78815-08e8-4a17-9088-4586e33f560b service neutron] 10.222.0.31 "GET /v2.0/networks/cff5da94-0610-451c-b1f5-67d31aadb2f2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0865667 Dec 09 22:22:42.190405 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-64685986-3677-4340-a2f0-ad9eb3db0087 req-f7e2cd68-48d5-4e62-8fbf-bb5281885e28 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0f796547-52c1-43d2-92c2-87811d2e4548&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443411 Dec 09 22:22:42.268031 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f221fb0e-6b97-4791-9947-c9cd0466690b req-9d4d68c3-3139-476c-bf81-c96530ae0d73 service neutron] 10.222.0.31 "GET /v2.0/networks/cff5da94-0610-451c-b1f5-67d31aadb2f2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0892143 Dec 09 22:22:42.305967 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d935a353-c56a-410a-a299-349bf01c04de up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:22:42.353927 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port d935a353-c56a-410a-a299-349bf01c04de triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:22:42.354302 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:43.325174 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54310ce8-c0f3-455c-9944-c803f28fb5ca req-ebd21b8c-fce2-4704-ae6d-70200db54431 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:43.326788 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-54310ce8-c0f3-455c-9944-c803f28fb5ca req-ebd21b8c-fce2-4704-ae6d-70200db54431 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 943 time: 0.0579243 Dec 09 22:22:43.377001 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-54310ce8-c0f3-455c-9944-c803f28fb5ca req-b41b57b9-d11c-4eaf-8006-97b36eec4638 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0f796547-52c1-43d2-92c2-87811d2e4548&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439823 Dec 09 22:22:44.515410 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a651d37-b1fd-48da-a8cb-e67486413907 req-8ef29cd2-e5ab-4beb-991f-16b118d69732 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:44.516855 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a651d37-b1fd-48da-a8cb-e67486413907 req-8ef29cd2-e5ab-4beb-991f-16b118d69732 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 943 time: 0.0589788 Dec 09 22:22:44.570379 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3a651d37-b1fd-48da-a8cb-e67486413907 req-acf3ac0f-0ef9-4e00-8483-a2054e3bf26a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0f796547-52c1-43d2-92c2-87811d2e4548&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447679 Dec 09 22:22:45.710411 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-630e0516-0490-48e7-b066-d7b8d56b7560 req-d907a1a9-a42e-4515-b4a2-51f0fd3b42da tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:45.711936 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-630e0516-0490-48e7-b066-d7b8d56b7560 req-d907a1a9-a42e-4515-b4a2-51f0fd3b42da tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 943 time: 0.0556550 Dec 09 22:22:45.762539 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-630e0516-0490-48e7-b066-d7b8d56b7560 req-b5ddd24c-698c-4f1f-92d2-21d828f542a8 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0f796547-52c1-43d2-92c2-87811d2e4548&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439920 Dec 09 22:22:46.279193 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 79e91533-7acf-4fb0-8ffd-32edbfb1306e details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:22:46.387142 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 79e91533-7acf-4fb0-8ffd-32edbfb1306e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=79e91533-7acf-4fb0-8ffd-32edbfb1306e,segment=NetworkSegment(89d44add-d1b4-4677-a543-3bc5ca01ce78),segment_id=89d44add-d1b4-4677-a543-3bc5ca01ce78)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:22:46.397834 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '79e91533-7acf-4fb0-8ffd-32edbfb1306e', 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2', 'port_id': '79e91533-7acf-4fb0-8ffd-32edbfb1306e', 'mac_address': 'fa:16:3e:4d:1f:2c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 115, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '92dfdb7f-86d3-415c-b143-1054a8e59f6f', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:22:46.435853 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:46.448723 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 79e91533-7acf-4fb0-8ffd-32edbfb1306e {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:22:46.468434 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 79e91533-7acf-4fb0-8ffd-32edbfb1306e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=79e91533-7acf-4fb0-8ffd-32edbfb1306e,segment=NetworkSegment(89d44add-d1b4-4677-a543-3bc5ca01ce78),segment_id=89d44add-d1b4-4677-a543-3bc5ca01ce78)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:22:46.476922 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:46.526722 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=79e91533-7acf-4fb0-8ffd-32edbfb1306e,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:46.723305 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['79e91533-7acf-4fb0-8ffd-32edbfb1306e'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:22:46.881794 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23d00abc-8624-4a2a-8604-2576c7ac31b5 req-1e4a3fd3-ff78-4108-9a93-8c68f6a7a347 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:46.883330 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-23d00abc-8624-4a2a-8604-2576c7ac31b5 req-1e4a3fd3-ff78-4108-9a93-8c68f6a7a347 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 944 time: 0.0488951 Dec 09 22:22:46.934743 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-23d00abc-8624-4a2a-8604-2576c7ac31b5 req-22f83ebc-cfc4-4ec5-aa8b-48a344365db0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0f796547-52c1-43d2-92c2-87811d2e4548&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444176 Dec 09 22:22:48.068633 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ed50ebb-ae73-4a4a-a438-9cc104046375 req-f1b81ebb-8712-4dfa-bee7-ead43516ccfa tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:48.070106 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ed50ebb-ae73-4a4a-a438-9cc104046375 req-f1b81ebb-8712-4dfa-bee7-ead43516ccfa tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 944 time: 0.0557129 Dec 09 22:22:48.126370 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ed50ebb-ae73-4a4a-a438-9cc104046375 req-7396d278-61f0-4312-b939-cdd9c8c2fccd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0f796547-52c1-43d2-92c2-87811d2e4548&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0497186 Dec 09 22:22:48.285400 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 79e91533-7acf-4fb0-8ffd-32edbfb1306e up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:22:48.341277 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 79e91533-7acf-4fb0-8ffd-32edbfb1306e completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:22:48.344956 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 79e91533-7acf-4fb0-8ffd-32edbfb1306e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:22:48.345329 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:48.420127 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:48.442623 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '79e91533-7acf-4fb0-8ffd-32edbfb1306e'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:22:48.444926 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7cd4306d-2bb7-4927-a919-f771608c2ee6" -d '{"events": [{"server_uuid": "8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f", "name": "network-vif-plugged", "status": "completed", "tag": "79e91533-7acf-4fb0-8ffd-32edbfb1306e"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:22:48.458478 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 79e91533-7acf-4fb0-8ffd-32edbfb1306e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=79e91533-7acf-4fb0-8ffd-32edbfb1306e,segment=NetworkSegment(89d44add-d1b4-4677-a543-3bc5ca01ce78),segment_id=89d44add-d1b4-4677-a543-3bc5ca01ce78)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:22:48.465191 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:48.519723 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=79e91533-7acf-4fb0-8ffd-32edbfb1306e,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:48.544564 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:22:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0b6b6bd7-32bd-4010-9e70-7c9e135842b1 x-openstack-request-id: req-0b6b6bd7-32bd-4010-9e70-7c9e135842b1 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:22:48.544867 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f", "name": "network-vif-plugged", "status": "completed", "tag": "79e91533-7acf-4fb0-8ffd-32edbfb1306e", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:22:48.545305 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0b6b6bd7-32bd-4010-9e70-7c9e135842b1 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:22:48.545690 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '79e91533-7acf-4fb0-8ffd-32edbfb1306e', 'code': 200} Dec 09 22:22:48.649614 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a713d97-aab8-4671-b846-71e8b9a93b15 req-5cbe661d-fe81-49b4-ace1-4f7560f747c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:48.651168 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0a713d97-aab8-4671-b846-71e8b9a93b15 req-5cbe661d-fe81-49b4-ace1-4f7560f747c6 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 1097 time: 0.0482631 Dec 09 22:22:48.699079 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0a713d97-aab8-4671-b846-71e8b9a93b15 req-c010ca6f-75aa-4b7d-abc9-26be5aab9fcc service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=0f796547-52c1-43d2-92c2-87811d2e4548&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410955 Dec 09 22:22:49.263799 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b60c48a6-e9ba-43a0-84ce-a98e24ca5f00 req-a8ef5ded-cb15-42e5-8a03-224e8c91fb1c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:49.265300 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b60c48a6-e9ba-43a0-84ce-a98e24ca5f00 req-a8ef5ded-cb15-42e5-8a03-224e8c91fb1c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 945 time: 0.0527246 Dec 09 22:22:49.324577 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b60c48a6-e9ba-43a0-84ce-a98e24ca5f00 req-97e6080f-a036-4976-9163-8320621b6a9d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0f796547-52c1-43d2-92c2-87811d2e4548&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0531361 Dec 09 22:22:50.467927 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc4ef52e-4c0e-4854-8b5e-21cda040481f req-7bde9a16-b07f-4649-ac87-e4c00ac23c4b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:50.469428 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc4ef52e-4c0e-4854-8b5e-21cda040481f req-7bde9a16-b07f-4649-ac87-e4c00ac23c4b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 945 time: 0.0633986 Dec 09 22:22:50.523816 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc4ef52e-4c0e-4854-8b5e-21cda040481f req-3275ce14-3ad3-441f-bdf9-99cd7715fb2a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0f796547-52c1-43d2-92c2-87811d2e4548&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455053 Dec 09 22:22:50.656936 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a04a742c-6852-41a2-ae56-d872c4a74d82 req-a50e56dc-8746-4c7d-a13f-85f3b1666156 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:50.658799 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a04a742c-6852-41a2-ae56-d872c4a74d82 req-a50e56dc-8746-4c7d-a13f-85f3b1666156 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 945 time: 0.0579286 Dec 09 22:22:50.708539 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a04a742c-6852-41a2-ae56-d872c4a74d82 req-202192d1-7079-4a58-a25b-4be26d9a8873 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0f796547-52c1-43d2-92c2-87811d2e4548&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434411 Dec 09 22:22:50.735667 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34016) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:50.788162 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-17ff3cac-9ab0-4cb7-8226-41b38a7225c0 tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:50.789640 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-17ff3cac-9ab0-4cb7-8226-41b38a7225c0 tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 1092 time: 0.0529499 Dec 09 22:22:50.793677 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34018) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:50.798308 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-817e9113-b764-48f5-845a-cb7cbcd10364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': '79e91533-7acf-4fb0-8ffd-32edbfb1306e', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ip_address': '172.20.0.6'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:22:50.824700 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-817e9113-b764-48f5-845a-cb7cbcd10364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for floatingip, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:50.931761 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-817e9113-b764-48f5-845a-cb7cbcd10364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:51.035088 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-817e9113-b764-48f5-845a-cb7cbcd10364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Allocated IP 172.25.3.26 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/80034466-3176-4760-9a5e-2b7b2dc1b19f) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:22:51.143336 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-817e9113-b764-48f5-845a-cb7cbcd10364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:51.181330 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-817e9113-b764-48f5-845a-cb7cbcd10364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:51.218422 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-817e9113-b764-48f5-845a-cb7cbcd10364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:22:51.221322 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-817e9113-b764-48f5-845a-cb7cbcd10364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:22:51.229879 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-817e9113-b764-48f5-845a-cb7cbcd10364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:22:51.258827 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-817e9113-b764-48f5-845a-cb7cbcd10364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=80034466-3176-4760-9a5e-2b7b2dc1b19f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:51.605598 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-817e9113-b764-48f5-845a-cb7cbcd10364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:51.680679 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-817e9113-b764-48f5-845a-cb7cbcd10364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:51.834524 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-817e9113-b764-48f5-845a-cb7cbcd10364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:51.841771 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-817e9113-b764-48f5-845a-cb7cbcd10364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:51.915748 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-817e9113-b764-48f5-845a-cb7cbcd10364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=80034466-3176-4760-9a5e-2b7b2dc1b19f,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:22:51.926491 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-817e9113-b764-48f5-845a-cb7cbcd10364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:52.023610 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-817e9113-b764-48f5-845a-cb7cbcd10364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Floating IP 9ee25649-6072-4ff9-b9af-075b3772ebb0 associated. External IP: 172.25.3.26, port: 79e91533-7acf-4fb0-8ffd-32edbfb1306e. Dec 09 22:22:52.605927 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-817e9113-b764-48f5-845a-cb7cbcd10364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router f0aed012-421c-4faa-a2f9-bd04de281a35 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:22:52.723956 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-817e9113-b764-48f5-845a-cb7cbcd10364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:22:52.734014 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d7853f5-0cd2-43b3-8b0b-af6bda29232b None None] Sync routers for ids ['f0aed012-421c-4faa-a2f9-bd04de281a35'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:22:52.744133 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-817e9113-b764-48f5-845a-cb7cbcd10364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:52.746463 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d7853f5-0cd2-43b3-8b0b-af6bda29232b None None] Routers {'f0aed012-421c-4faa-a2f9-bd04de281a35'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:22:52.747598 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6d7853f5-0cd2-43b3-8b0b-af6bda29232b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:22:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f0aed012-421c-4faa-a2f9-bd04de281a35'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:52.774304 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-817e9113-b764-48f5-845a-cb7cbcd10364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.9794745 Dec 09 22:22:52.775060 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f', 'tag': '79e91533-7acf-4fb0-8ffd-32edbfb1306e'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:22:52.778218 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9f55face-4e3d-4c3f-b3f1-dfa5226ef554" -d '{"events": [{"name": "network-changed", "server_uuid": "8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f", "tag": "79e91533-7acf-4fb0-8ffd-32edbfb1306e"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:22:52.863425 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-6d7853f5-0cd2-43b3-8b0b-af6bda29232b None None] Set router f0aed012-421c-4faa-a2f9-bd04de281a35 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:22:52.874246 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-756b7d9f-e4c8-495a-8228-cbaa44de75f3 req-f1bab98f-cf3d-487b-abf3-0eefa51b335c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:52.875805 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-756b7d9f-e4c8-495a-8228-cbaa44de75f3 req-f1bab98f-cf3d-487b-abf3-0eefa51b335c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 945 time: 0.0513105 Dec 09 22:22:52.926422 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-756b7d9f-e4c8-495a-8228-cbaa44de75f3 req-0296e987-2412-4466-9149-22aa8b356bc1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0f796547-52c1-43d2-92c2-87811d2e4548&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442348 Dec 09 22:22:52.951236 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34024) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:52.989147 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:22:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a3c47773-2c83-4a1d-b86a-2a4dac806689 x-openstack-request-id: req-a3c47773-2c83-4a1d-b86a-2a4dac806689 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:22:52.989522 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f", "tag": "79e91533-7acf-4fb0-8ffd-32edbfb1306e", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:22:52.989703 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a3c47773-2c83-4a1d-b86a-2a4dac806689 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:22:52.990073 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f', 'tag': '79e91533-7acf-4fb0-8ffd-32edbfb1306e', 'status': 'completed', 'code': 200} Dec 09 22:22:53.042042 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-62df142d-9a1c-43c9-a000-f2d06b777cf7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/floatingips/9ee25649-6072-4ff9-b9af-075b3772ebb0 HTTP/1.1" status: 200 len: 990 time: 0.0893083 Dec 09 22:22:53.055135 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f55face-4e3d-4c3f-b3f1-dfa5226ef554 req-b3a732d8-2baa-4877-bd4a-d1701bde7611 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:53.056699 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9f55face-4e3d-4c3f-b3f1-dfa5226ef554 req-b3a732d8-2baa-4877-bd4a-d1701bde7611 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 1097 time: 0.0559385 Dec 09 22:22:53.096953 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6d7853f5-0cd2-43b3-8b0b-af6bda29232b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'name': 'tempest-TestNetworkAdvancedServerOps-router-639414800', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35'}], 'enable_snat': True}, 'gw_port_id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:36Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:e6:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4215, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '9ee25649-6072-4ff9-b9af-075b3772ebb0', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'floating_ip_address': '172.25.3.26', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'port_id': '79e91533-7acf-4fb0-8ffd-32edbfb1306e', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4221, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2', 'mac_address': 'fa:16:3e:4d:1f:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:22:51Z', 'updated_at': '2021-12-09T22:22:51Z', 'revision_number': 0, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd935a353-c56a-410a-a299-349bf01c04de', 'name': '', 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:b8:f4:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'device_owner': 'network:router_interface', 'standard_attr_id': 4218, 'fixed_ips': [{'subnet_id': '92dfdb7f-86d3-415c-b143-1054a8e59f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:22:36Z', 'updated_at': '2021-12-09T22:22:40Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '92dfdb7f-86d3-415c-b143-1054a8e59f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:53.123014 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d7853f5-0cd2-43b3-8b0b-af6bda29232b None None] Checking router: f0aed012-421c-4faa-a2f9-bd04de281a35 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:22:53.131004 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d7853f5-0cd2-43b3-8b0b-af6bda29232b None None] Routers {'f0aed012-421c-4faa-a2f9-bd04de281a35'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:22:53.131635 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6d7853f5-0cd2-43b3-8b0b-af6bda29232b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:22:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f0aed012-421c-4faa-a2f9-bd04de281a35'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:53.149263 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f55face-4e3d-4c3f-b3f1-dfa5226ef554 req-920ec774-8117-4c78-924f-1299c68197f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:53.150772 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9f55face-4e3d-4c3f-b3f1-dfa5226ef554 req-920ec774-8117-4c78-924f-1299c68197f0 service neutron] 10.222.0.31 "GET /v2.0/networks?id=cff5da94-0610-451c-b1f5-67d31aadb2f2 HTTP/1.1" status: 200 len: 897 time: 0.0862994 Dec 09 22:22:53.223300 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9f55face-4e3d-4c3f-b3f1-dfa5226ef554 req-19f6fd68-6acc-4a4a-b72e-0bc437075978 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=79e91533-7acf-4fb0-8ffd-32edbfb1306e HTTP/1.1" status: 200 len: 998 time: 0.0652359 Dec 09 22:22:53.236665 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-6d7853f5-0cd2-43b3-8b0b-af6bda29232b None None] Set router f0aed012-421c-4faa-a2f9-bd04de281a35 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:22:53.278415 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f55face-4e3d-4c3f-b3f1-dfa5226ef554 req-424b1df6-01e3-47de-91a0-e688414a35e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:53.280002 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9f55face-4e3d-4c3f-b3f1-dfa5226ef554 req-424b1df6-01e3-47de-91a0-e688414a35e3 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=92dfdb7f-86d3-415c-b143-1054a8e59f6f HTTP/1.1" status: 200 len: 835 time: 0.0493057 Dec 09 22:22:53.326092 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f55face-4e3d-4c3f-b3f1-dfa5226ef554 req-5d58f815-ca21-4449-a95b-3756685f8e15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:22:53.327763 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9f55face-4e3d-4c3f-b3f1-dfa5226ef554 req-5d58f815-ca21-4449-a95b-3756685f8e15 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=cff5da94-0610-451c-b1f5-67d31aadb2f2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0406847 Dec 09 22:22:53.426875 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9f55face-4e3d-4c3f-b3f1-dfa5226ef554 req-6d2fa33d-bfcc-42fa-9299-b077aef6fa84 service neutron] 10.222.0.31 "GET /v2.0/networks/cff5da94-0610-451c-b1f5-67d31aadb2f2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0922751 Dec 09 22:22:53.462336 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6d7853f5-0cd2-43b3-8b0b-af6bda29232b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'name': 'tempest-TestNetworkAdvancedServerOps-router-639414800', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35'}], 'enable_snat': True}, 'gw_port_id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:36Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:e6:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4215, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '9ee25649-6072-4ff9-b9af-075b3772ebb0', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'floating_ip_address': '172.25.3.26', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'port_id': '79e91533-7acf-4fb0-8ffd-32edbfb1306e', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4221, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2', 'mac_address': 'fa:16:3e:4d:1f:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:22:51Z', 'updated_at': '2021-12-09T22:22:51Z', 'revision_number': 0, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd935a353-c56a-410a-a299-349bf01c04de', 'name': '', 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:b8:f4:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'device_owner': 'network:router_interface', 'standard_attr_id': 4218, 'fixed_ips': [{'subnet_id': '92dfdb7f-86d3-415c-b143-1054a8e59f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:22:36Z', 'updated_at': '2021-12-09T22:22:40Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '92dfdb7f-86d3-415c-b143-1054a8e59f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:22:53.492402 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d7853f5-0cd2-43b3-8b0b-af6bda29232b None None] The sync data for ids ['f0aed012-421c-4faa-a2f9-bd04de281a35'] in n-d-713301-27 is: [{'id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'name': 'tempest-TestNetworkAdvancedServerOps-router-639414800', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35'}], 'enable_snat': True}, 'gw_port_id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:36Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:e6:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4215, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '9ee25649-6072-4ff9-b9af-075b3772ebb0', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'floating_ip_address': '172.25.3.26', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'port_id': '79e91533-7acf-4fb0-8ffd-32edbfb1306e', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4221, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2', 'mac_address': 'fa:16:3e:4d:1f:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:22:51Z', 'updated_at': '2021-12-09T22:22:51Z', 'revision_number': 0, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd935a353-c56a-410a-a299-349bf01c04de', 'name': '', 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:b8:f4:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'device_owner': 'network:router_interface', 'standard_attr_id': 4218, 'fixed_ips': [{'subnet_id': '92dfdb7f-86d3-415c-b143-1054a8e59f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:22:36Z', 'updated_at': '2021-12-09T22:22:40Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '92dfdb7f-86d3-415c-b143-1054a8e59f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:22:53.521437 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9f55face-4e3d-4c3f-b3f1-dfa5226ef554 req-014c8481-b793-4308-91d1-ec6ffcf63bcb service neutron] 10.222.0.31 "GET /v2.0/networks/cff5da94-0610-451c-b1f5-67d31aadb2f2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0864685 Dec 09 22:22:53.702616 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01613491-bf7d-444c-92e8-c15056f228ba None None] New status for floating IP 9ee25649-6072-4ff9-b9af-075b3772ebb0: ACTIVE {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:22:54.046433 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34026) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:22:54.127836 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7270d4cc-c600-427b-ba67-0b33ea7f9c02 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/floatingips/9ee25649-6072-4ff9-b9af-075b3772ebb0 HTTP/1.1" status: 200 len: 992 time: 0.0799265 Dec 09 22:22:57.680686 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:22:57.785511 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:03.038572 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-68eae86a-aa86-4646-bf6b-f4b7e6ceb813 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:05.675949 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0b446921-ac5b-4f0b-9cd1-84f3cc01d3a7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:06.870275 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:08.222179 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:09.704829 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:11.729037 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4da2304b-4df4-42b9-910d-65ff5a7733f7 req-fea2317a-a4ec-4304-95aa-0221564bcf35 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0556624 Dec 09 22:23:11.831803 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da2304b-4df4-42b9-910d-65ff5a7733f7 req-3c3f975f-1777-4a4d-aa7a-d1f9058cf13a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:11.833353 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4da2304b-4df4-42b9-910d-65ff5a7733f7 req-3c3f975f-1777-4a4d-aa7a-d1f9058cf13a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 1097 time: 0.0488989 Dec 09 22:23:11.941974 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da2304b-4df4-42b9-910d-65ff5a7733f7 req-bb8f7ab9-44fe-412d-aa93-032187a072b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:11.943597 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4da2304b-4df4-42b9-910d-65ff5a7733f7 req-bb8f7ab9-44fe-412d-aa93-032187a072b3 service neutron] 10.222.0.31 "GET /v2.0/networks?id=cff5da94-0610-451c-b1f5-67d31aadb2f2 HTTP/1.1" status: 200 len: 897 time: 0.0888033 Dec 09 22:23:12.019542 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4da2304b-4df4-42b9-910d-65ff5a7733f7 req-1d49b02b-9772-4633-b4e4-e250e7c33637 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=79e91533-7acf-4fb0-8ffd-32edbfb1306e HTTP/1.1" status: 200 len: 1000 time: 0.0673318 Dec 09 22:23:12.075113 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da2304b-4df4-42b9-910d-65ff5a7733f7 req-8e20f762-a476-47e5-86f3-a32ddaff0daa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:12.077209 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4da2304b-4df4-42b9-910d-65ff5a7733f7 req-8e20f762-a476-47e5-86f3-a32ddaff0daa service neutron] 10.222.0.31 "GET /v2.0/subnets?id=92dfdb7f-86d3-415c-b143-1054a8e59f6f HTTP/1.1" status: 200 len: 835 time: 0.0502477 Dec 09 22:23:12.128222 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da2304b-4df4-42b9-910d-65ff5a7733f7 req-68107232-e112-4e78-993b-fa538ad98313 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:12.129723 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4da2304b-4df4-42b9-910d-65ff5a7733f7 req-68107232-e112-4e78-993b-fa538ad98313 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=cff5da94-0610-451c-b1f5-67d31aadb2f2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0451078 Dec 09 22:23:12.225329 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4da2304b-4df4-42b9-910d-65ff5a7733f7 req-83a329fa-95de-4246-8656-13470ce6c97c service neutron] 10.222.0.31 "GET /v2.0/networks/cff5da94-0610-451c-b1f5-67d31aadb2f2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0875614 Dec 09 22:23:12.322904 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4da2304b-4df4-42b9-910d-65ff5a7733f7 req-006b7278-8f2f-4713-9620-ab27ed3e9278 service neutron] 10.222.0.31 "GET /v2.0/networks/cff5da94-0610-451c-b1f5-67d31aadb2f2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0896597 Dec 09 22:23:13.315601 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:23:25.592192 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a263fbb4-cba4-4a00-b284-ec6dd012263f req-c43fa9a7-f4de-4565-a21c-87d6d92fd924 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:25.594149 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a263fbb4-cba4-4a00-b284-ec6dd012263f req-c43fa9a7-f4de-4565-a21c-87d6d92fd924 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 945 time: 0.0618808 Dec 09 22:23:25.649819 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a263fbb4-cba4-4a00-b284-ec6dd012263f req-b3ed2c16-7e10-4197-94cb-23ff87fe76d0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0f796547-52c1-43d2-92c2-87811d2e4548&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466664 Dec 09 22:23:26.783915 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d365a38-28b2-46d4-bf48-d9143a8116ee req-6f8bb3df-2fee-452d-a8a0-ce2d8127ee93 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:26.785381 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d365a38-28b2-46d4-bf48-d9143a8116ee req-6f8bb3df-2fee-452d-a8a0-ce2d8127ee93 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 945 time: 0.0546529 Dec 09 22:23:26.843599 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d365a38-28b2-46d4-bf48-d9143a8116ee req-5c385564-7999-4265-b175-95c8ce4a6902 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0f796547-52c1-43d2-92c2-87811d2e4548&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0503042 Dec 09 22:23:26.867393 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34048) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:26.929166 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-95ea33df-68ad-46eb-817e-0492d193f0cd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/floatingips/9ee25649-6072-4ff9-b9af-075b3772ebb0 HTTP/1.1" status: 200 len: 992 time: 0.0604494 Dec 09 22:23:27.689160 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:27.790849 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:28.210341 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15c21237-5e22-4616-a13c-5e8c105d9dfa req-ddcf8e27-b01b-42d8-8f6d-a1822b7f5e7c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:28.211887 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15c21237-5e22-4616-a13c-5e8c105d9dfa req-ddcf8e27-b01b-42d8-8f6d-a1822b7f5e7c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 945 time: 0.0530081 Dec 09 22:23:28.263300 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-15c21237-5e22-4616-a13c-5e8c105d9dfa req-6dfe8e7c-6b24-4043-b384-1448754d68bd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0f796547-52c1-43d2-92c2-87811d2e4548&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452185 Dec 09 22:23:29.400469 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-329d2e34-95a9-4898-98a7-87f9c4de129e req-7dbc7d49-1f66-4ab8-b4b8-bd42d08f3669 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:29.401944 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-329d2e34-95a9-4898-98a7-87f9c4de129e req-7dbc7d49-1f66-4ab8-b4b8-bd42d08f3669 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 945 time: 0.0539174 Dec 09 22:23:29.451469 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-329d2e34-95a9-4898-98a7-87f9c4de129e req-0f6b2897-dc25-4311-a418-2ff71f752892 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0f796547-52c1-43d2-92c2-87811d2e4548&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434322 Dec 09 22:23:29.477599 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34058) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:29.541983 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-02634eea-b2f3-46a8-9938-98f3688ceae2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/floatingips/9ee25649-6072-4ff9-b9af-075b3772ebb0 HTTP/1.1" status: 200 len: 992 time: 0.0632207 Dec 09 22:23:29.781097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34064) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:29.942816 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting port 80034466-3176-4760-9a5e-2b7b2dc1b19f {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:23:29.943141 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:30.017002 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:30.017292 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:30.029154 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Calling delete_port for 80034466-3176-4760-9a5e-2b7b2dc1b19f owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:23:30.190172 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:30.214428 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Port': ['ID=80034466-3176-4760-9a5e-2b7b2dc1b19f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:30.226031 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:30.226384 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:30.226731 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:30.227117 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:30.227466 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:30.227807 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:30.228141 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:30.228470 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:30.228795 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:30.229116 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:30.229435 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:30.229755 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:30.230073 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:30.286146 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:30.286843 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Floating IP 9ee25649-6072-4ff9-b9af-075b3772ebb0 disassociated (deleted). External IP: 172.25.3.26, port: 79e91533-7acf-4fb0-8ffd-32edbfb1306e. Dec 09 22:23:30.495473 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router f0aed012-421c-4faa-a2f9-bd04de281a35 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:23:30.601908 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:23:30.606738 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:30.612913 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a35ffc76-e52c-4cde-843a-88c065f41737 None None] Sync routers for ids ['f0aed012-421c-4faa-a2f9-bd04de281a35'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:23:30.624089 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a35ffc76-e52c-4cde-843a-88c065f41737 None None] Routers {'f0aed012-421c-4faa-a2f9-bd04de281a35'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:23:30.624690 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a35ffc76-e52c-4cde-843a-88c065f41737 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:23:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f0aed012-421c-4faa-a2f9-bd04de281a35'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:23:30.636234 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f8a777e7-3bf9-4da2-ab7a-73758e21d508 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/floatingips/9ee25649-6072-4ff9-b9af-075b3772ebb0 HTTP/1.1" status: 204 len: 168 time: 0.8535943 Dec 09 22:23:30.637205 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f', 'tag': '79e91533-7acf-4fb0-8ffd-32edbfb1306e'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:23:30.639464 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-163d5181-dac2-47d3-adbc-ca2898b71a55" -d '{"events": [{"name": "network-changed", "server_uuid": "8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f", "tag": "79e91533-7acf-4fb0-8ffd-32edbfb1306e"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:23:30.817529 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:23:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-632c1bcb-8184-4f12-bbc2-882b1562e000 x-openstack-request-id: req-632c1bcb-8184-4f12-bbc2-882b1562e000 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:23:30.818230 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f", "tag": "79e91533-7acf-4fb0-8ffd-32edbfb1306e", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:23:30.824805 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-632c1bcb-8184-4f12-bbc2-882b1562e000 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:23:30.825589 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f', 'tag': '79e91533-7acf-4fb0-8ffd-32edbfb1306e', 'status': 'completed', 'code': 200} Dec 09 22:23:30.893817 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163d5181-dac2-47d3-adbc-ca2898b71a55 req-88930210-8874-432b-94c6-66e6dbb0a05c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:30.895496 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-163d5181-dac2-47d3-adbc-ca2898b71a55 req-88930210-8874-432b-94c6-66e6dbb0a05c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 1097 time: 0.0497980 Dec 09 22:23:30.915460 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-a35ffc76-e52c-4cde-843a-88c065f41737 None None] Set router f0aed012-421c-4faa-a2f9-bd04de281a35 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:23:30.921808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ca1530a-3ac9-4dc2-9227-14aa872252a4 req-ed2203fc-5bcc-4442-b2b7-56a348d818ed tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:30.924161 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1ca1530a-3ac9-4dc2-9227-14aa872252a4 req-ed2203fc-5bcc-4442-b2b7-56a348d818ed tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 945 time: 0.0586679 Dec 09 22:23:30.975010 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1ca1530a-3ac9-4dc2-9227-14aa872252a4 req-b86d862e-3993-41df-86de-7af43f7cd7a9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0f796547-52c1-43d2-92c2-87811d2e4548&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447199 Dec 09 22:23:30.994668 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163d5181-dac2-47d3-adbc-ca2898b71a55 req-45cd3e34-5989-4a97-9f5d-51b97a9093ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:30.996234 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-163d5181-dac2-47d3-adbc-ca2898b71a55 req-45cd3e34-5989-4a97-9f5d-51b97a9093ca service neutron] 10.222.0.31 "GET /v2.0/networks?id=cff5da94-0610-451c-b1f5-67d31aadb2f2 HTTP/1.1" status: 200 len: 897 time: 0.0933940 Dec 09 22:23:31.038830 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-163d5181-dac2-47d3-adbc-ca2898b71a55 req-8c4571ee-aff9-4cf5-a492-5d72822ebf79 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=79e91533-7acf-4fb0-8ffd-32edbfb1306e HTTP/1.1" status: 200 len: 217 time: 0.0345788 Dec 09 22:23:31.088487 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163d5181-dac2-47d3-adbc-ca2898b71a55 req-d4da9cd0-0ce0-4e95-8b61-26f1e9fb8cbc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:31.089993 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-163d5181-dac2-47d3-adbc-ca2898b71a55 req-d4da9cd0-0ce0-4e95-8b61-26f1e9fb8cbc service neutron] 10.222.0.31 "GET /v2.0/subnets?id=92dfdb7f-86d3-415c-b143-1054a8e59f6f HTTP/1.1" status: 200 len: 835 time: 0.0437050 Dec 09 22:23:31.116089 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a35ffc76-e52c-4cde-843a-88c065f41737 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'name': 'tempest-TestNetworkAdvancedServerOps-router-639414800', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35'}], 'enable_snat': True}, 'gw_port_id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:36Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:e6:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4215, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'd935a353-c56a-410a-a299-349bf01c04de', 'name': '', 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:b8:f4:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'device_owner': 'network:router_interface', 'standard_attr_id': 4218, 'fixed_ips': [{'subnet_id': '92dfdb7f-86d3-415c-b143-1054a8e59f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:22:36Z', 'updated_at': '2021-12-09T22:22:40Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '92dfdb7f-86d3-415c-b143-1054a8e59f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:23:31.140791 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163d5181-dac2-47d3-adbc-ca2898b71a55 req-6a983507-cfa7-4c8a-84d7-0c8d4d2d858e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:31.142326 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-163d5181-dac2-47d3-adbc-ca2898b71a55 req-6a983507-cfa7-4c8a-84d7-0c8d4d2d858e service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=cff5da94-0610-451c-b1f5-67d31aadb2f2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0442765 Dec 09 22:23:31.145755 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a35ffc76-e52c-4cde-843a-88c065f41737 None None] Checking router: f0aed012-421c-4faa-a2f9-bd04de281a35 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:23:31.154530 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a35ffc76-e52c-4cde-843a-88c065f41737 None None] Routers {'f0aed012-421c-4faa-a2f9-bd04de281a35'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:23:31.155138 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a35ffc76-e52c-4cde-843a-88c065f41737 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:23:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f0aed012-421c-4faa-a2f9-bd04de281a35'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:23:31.238135 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-163d5181-dac2-47d3-adbc-ca2898b71a55 req-7746a070-6a86-432e-9fbe-338d1fefe5da service neutron] 10.222.0.31 "GET /v2.0/networks/cff5da94-0610-451c-b1f5-67d31aadb2f2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0876484 Dec 09 22:23:31.272267 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-a35ffc76-e52c-4cde-843a-88c065f41737 None None] Set router f0aed012-421c-4faa-a2f9-bd04de281a35 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:23:31.335498 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-163d5181-dac2-47d3-adbc-ca2898b71a55 req-c76e75d6-7c93-4e08-bb0d-bc07409caaca service neutron] 10.222.0.31 "GET /v2.0/networks/cff5da94-0610-451c-b1f5-67d31aadb2f2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0881703 Dec 09 22:23:31.472963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a35ffc76-e52c-4cde-843a-88c065f41737 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'name': 'tempest-TestNetworkAdvancedServerOps-router-639414800', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35'}], 'enable_snat': True}, 'gw_port_id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:36Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:e6:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4215, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'd935a353-c56a-410a-a299-349bf01c04de', 'name': '', 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:b8:f4:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'device_owner': 'network:router_interface', 'standard_attr_id': 4218, 'fixed_ips': [{'subnet_id': '92dfdb7f-86d3-415c-b143-1054a8e59f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:22:36Z', 'updated_at': '2021-12-09T22:22:40Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '92dfdb7f-86d3-415c-b143-1054a8e59f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:23:31.499572 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a35ffc76-e52c-4cde-843a-88c065f41737 None None] The sync data for ids ['f0aed012-421c-4faa-a2f9-bd04de281a35'] in n-d-713301-27 is: [{'id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'name': 'tempest-TestNetworkAdvancedServerOps-router-639414800', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35'}], 'enable_snat': True}, 'gw_port_id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:36Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:e6:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4215, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'd935a353-c56a-410a-a299-349bf01c04de', 'name': '', 'network_id': 'cff5da94-0610-451c-b1f5-67d31aadb2f2', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:b8:f4:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'device_owner': 'network:router_interface', 'standard_attr_id': 4218, 'fixed_ips': [{'subnet_id': '92dfdb7f-86d3-415c-b143-1054a8e59f6f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:22:36Z', 'updated_at': '2021-12-09T22:22:40Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '92dfdb7f-86d3-415c-b143-1054a8e59f6f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:23:31.756298 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4fac6a24-8b59-4879-b03c-4463d71dcc87 None None] New status for floating IP 9ee25649-6072-4ff9-b9af-075b3772ebb0: DOWN {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:23:32.099940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d92b639a-6b18-4b22-929d-1066690adbf5 req-34d9b808-4285-4459-910d-7d274a6ecc4b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:32.101440 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d92b639a-6b18-4b22-929d-1066690adbf5 req-34d9b808-4285-4459-910d-7d274a6ecc4b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 945 time: 0.0515838 Dec 09 22:23:32.153079 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d92b639a-6b18-4b22-929d-1066690adbf5 req-338cc8c6-ac57-4366-b0bc-9f017cecb966 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0f796547-52c1-43d2-92c2-87811d2e4548&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449369 Dec 09 22:23:32.381021 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d8a7bc4-3e8d-446b-96d7-91c73e085ed8 req-5d57706f-7acf-4211-bf55-07f872d8fc6e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:32.382677 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3d8a7bc4-3e8d-446b-96d7-91c73e085ed8 req-5d57706f-7acf-4211-bf55-07f872d8fc6e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.31 "GET /v2.0/ports?device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 945 time: 0.0573230 Dec 09 22:23:32.480557 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-3d8a7bc4-3e8d-446b-96d7-91c73e085ed8 req-3a61c27c-3be6-4421-891a-f2b9ff3e0680 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting port 79e91533-7acf-4fb0-8ffd-32edbfb1306e {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:23:32.480860 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-3d8a7bc4-3e8d-446b-96d7-91c73e085ed8 req-3a61c27c-3be6-4421-891a-f2b9ff3e0680 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:32.578435 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-3d8a7bc4-3e8d-446b-96d7-91c73e085ed8 req-3a61c27c-3be6-4421-891a-f2b9ff3e0680 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] For port 79e91533-7acf-4fb0-8ffd-32edbfb1306e, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=79e91533-7acf-4fb0-8ffd-32edbfb1306e,segment=NetworkSegment(89d44add-d1b4-4677-a543-3bc5ca01ce78),segment_id=89d44add-d1b4-4677-a543-3bc5ca01ce78)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:23:32.578682 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-3d8a7bc4-3e8d-446b-96d7-91c73e085ed8 req-3a61c27c-3be6-4421-891a-f2b9ff3e0680 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:32.593676 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-3d8a7bc4-3e8d-446b-96d7-91c73e085ed8 req-3a61c27c-3be6-4421-891a-f2b9ff3e0680 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Calling delete_port for 79e91533-7acf-4fb0-8ffd-32edbfb1306e owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:23:33.043552 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-610f3619-1c51-47f1-b422-ac878a3ce208 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:33.086120 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-3d8a7bc4-3e8d-446b-96d7-91c73e085ed8 req-3a61c27c-3be6-4421-891a-f2b9ff3e0680 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:33.114962 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a61c27c-3be6-4421-891a-f2b9ff3e0680 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Port': ['ID=79e91533-7acf-4fb0-8ffd-32edbfb1306e,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:33.156316 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-3d8a7bc4-3e8d-446b-96d7-91c73e085ed8 req-3a61c27c-3be6-4421-891a-f2b9ff3e0680 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] No DVR routers for this DVR port 79e91533-7acf-4fb0-8ffd-32edbfb1306e on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:23:33.159170 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-3d8a7bc4-3e8d-446b-96d7-91c73e085ed8 req-3a61c27c-3be6-4421-891a-f2b9ff3e0680 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:33.162988 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-3d8a7bc4-3e8d-446b-96d7-91c73e085ed8 req-3a61c27c-3be6-4421-891a-f2b9ff3e0680 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.31 "DELETE /v2.0/ports/79e91533-7acf-4fb0-8ffd-32edbfb1306e HTTP/1.1" status: 204 len: 173 time: 0.7737916 Dec 09 22:23:33.163455 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f', 'name': 'network-vif-deleted', 'tag': '79e91533-7acf-4fb0-8ffd-32edbfb1306e'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:23:33.165729 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b3dfc53c-9339-4cf8-86e5-d24e75b4a334" -d '{"events": [{"server_uuid": "8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f", "name": "network-vif-deleted", "tag": "79e91533-7acf-4fb0-8ffd-32edbfb1306e"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:23:33.204263 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:23:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8b8fb1c0-4e3f-477c-9588-49c635087a4a x-openstack-request-id: req-8b8fb1c0-4e3f-477c-9588-49c635087a4a {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:23:33.204559 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f", "name": "network-vif-deleted", "tag": "79e91533-7acf-4fb0-8ffd-32edbfb1306e", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:23:33.204817 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8b8fb1c0-4e3f-477c-9588-49c635087a4a {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:23:33.205223 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f', 'name': 'network-vif-deleted', 'tag': '79e91533-7acf-4fb0-8ffd-32edbfb1306e', 'status': 'completed', 'code': 200} Dec 09 22:23:33.281737 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-af5ea6f0-abff-43d1-8688-7ebf7034c90c req-82b71318-1040-446b-9538-eb58c2f5b98e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=8bd1a2f5-7e9f-4f06-ad91-15ac536ea19f HTTP/1.1" status: 200 len: 210 time: 0.0300171 Dec 09 22:23:34.346223 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34080) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:34.484915 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 79e91533-7acf-4fb0-8ffd-32edbfb1306e no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:23:34.506007 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 79e91533-7acf-4fb0-8ffd-32edbfb1306e {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:23:34.506373 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 79e91533-7acf-4fb0-8ffd-32edbfb1306e not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:23:34.727316 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-14ddf1df-1e66-4b63-a8a3-58a17822c986 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:34.992750 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-14ddf1df-1e66-4b63-a8a3-58a17822c986 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting port d935a353-c56a-410a-a299-349bf01c04de {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:23:34.992998 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-14ddf1df-1e66-4b63-a8a3-58a17822c986 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:35.086155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-14ddf1df-1e66-4b63-a8a3-58a17822c986 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] For port d935a353-c56a-410a-a299-349bf01c04de, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d935a353-c56a-410a-a299-349bf01c04de,segment=NetworkSegment(89d44add-d1b4-4677-a543-3bc5ca01ce78),segment_id=89d44add-d1b4-4677-a543-3bc5ca01ce78)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:23:35.086520 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-14ddf1df-1e66-4b63-a8a3-58a17822c986 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:35.098353 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-14ddf1df-1e66-4b63-a8a3-58a17822c986 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Calling delete_port for d935a353-c56a-410a-a299-349bf01c04de owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:23:35.304004 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-14ddf1df-1e66-4b63-a8a3-58a17822c986 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:35.330803 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14ddf1df-1e66-4b63-a8a3-58a17822c986 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Port': ['ID=d935a353-c56a-410a-a299-349bf01c04de,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:35.506524 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-14ddf1df-1e66-4b63-a8a3-58a17822c986 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:35.668611 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a79b6e8d-1894-410b-8478-22a2aef7f283 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:35.732681 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-14ddf1df-1e66-4b63-a8a3-58a17822c986 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router f0aed012-421c-4faa-a2f9-bd04de281a35 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:23:35.841248 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-14ddf1df-1e66-4b63-a8a3-58a17822c986 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:23:35.846279 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-14ddf1df-1e66-4b63-a8a3-58a17822c986 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "PUT /v2.0/routers/f0aed012-421c-4faa-a2f9-bd04de281a35/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4990120 Dec 09 22:23:35.850320 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34082) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:35.854872 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5aac75c0-dbb5-402a-b892-15b84c5d7113 None None] Sync routers for ids ['f0aed012-421c-4faa-a2f9-bd04de281a35'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:23:35.866034 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5aac75c0-dbb5-402a-b892-15b84c5d7113 None None] Routers {'f0aed012-421c-4faa-a2f9-bd04de281a35'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:23:35.866851 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5aac75c0-dbb5-402a-b892-15b84c5d7113 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:23:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f0aed012-421c-4faa-a2f9-bd04de281a35'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:23:35.901126 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-a4312cf4-9979-4e7f-8b8a-6f48b280e03c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting subnet 92dfdb7f-86d3-415c-b143-1054a8e59f6f {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:23:35.905501 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a4312cf4-9979-4e7f-8b8a-6f48b280e03c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:35.949543 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a4312cf4-9979-4e7f-8b8a-6f48b280e03c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:35.979635 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-5aac75c0-dbb5-402a-b892-15b84c5d7113 None None] Set router f0aed012-421c-4faa-a2f9-bd04de281a35 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:23:36.038116 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a4312cf4-9979-4e7f-8b8a-6f48b280e03c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:36.098147 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a4312cf4-9979-4e7f-8b8a-6f48b280e03c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:36.124564 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4312cf4-9979-4e7f-8b8a-6f48b280e03c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Subnet': ['ID=92dfdb7f-86d3-415c-b143-1054a8e59f6f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:36.128227 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a4312cf4-9979-4e7f-8b8a-6f48b280e03c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:36.131482 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a4312cf4-9979-4e7f-8b8a-6f48b280e03c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/subnets/92dfdb7f-86d3-415c-b143-1054a8e59f6f HTTP/1.1" status: 204 len: 168 time: 0.2801950 Dec 09 22:23:36.134202 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34084) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:36.138987 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-54474749-7fb5-450d-9520-30964d4cc414 None None] Network cff5da94-0610-451c-b1f5-67d31aadb2f2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:23:36.235187 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5aac75c0-dbb5-402a-b892-15b84c5d7113 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'name': 'tempest-TestNetworkAdvancedServerOps-router-639414800', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35'}], 'enable_snat': True}, 'gw_port_id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:23:35Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:e6:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4215, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:23:36.241832 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c4cda7f-231e-4aa8-ace5-d7cde33e173e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:36.266182 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5aac75c0-dbb5-402a-b892-15b84c5d7113 None None] Checking router: f0aed012-421c-4faa-a2f9-bd04de281a35 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:23:36.278361 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5aac75c0-dbb5-402a-b892-15b84c5d7113 None None] Routers {'f0aed012-421c-4faa-a2f9-bd04de281a35'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:23:36.278361 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5aac75c0-dbb5-402a-b892-15b84c5d7113 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:23:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['f0aed012-421c-4faa-a2f9-bd04de281a35'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:23:36.371216 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-adf1ea08-e2fb-46e7-85fd-753c0e26596b None None] DHCP port deletion for cff5da94-0610-451c-b1f5-67d31aadb2f2 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:23:36.373192 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c4cda7f-231e-4aa8-ace5-d7cde33e173e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:36.420617 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-5aac75c0-dbb5-402a-b892-15b84c5d7113 None None] Set router f0aed012-421c-4faa-a2f9-bd04de281a35 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:23:36.428876 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-6c4cda7f-231e-4aa8-ace5-d7cde33e173e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting port de197704-e053-4dc5-91d2-42e71583f4bf {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:23:36.429229 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c4cda7f-231e-4aa8-ace5-d7cde33e173e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:36.517280 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-6c4cda7f-231e-4aa8-ace5-d7cde33e173e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] For port de197704-e053-4dc5-91d2-42e71583f4bf, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=de197704-e053-4dc5-91d2-42e71583f4bf,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:23:36.517976 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c4cda7f-231e-4aa8-ace5-d7cde33e173e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:36.529674 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-6c4cda7f-231e-4aa8-ace5-d7cde33e173e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Calling delete_port for de197704-e053-4dc5-91d2-42e71583f4bf owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:23:36.542393 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-adf1ea08-e2fb-46e7-85fd-753c0e26596b None None] Deleting port c80ae95c-b930-4325-b1ff-c64be2f2e0f9 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:23:36.542771 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-adf1ea08-e2fb-46e7-85fd-753c0e26596b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:36.636477 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-adf1ea08-e2fb-46e7-85fd-753c0e26596b None None] For port c80ae95c-b930-4325-b1ff-c64be2f2e0f9, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=c80ae95c-b930-4325-b1ff-c64be2f2e0f9,segment=NetworkSegment(89d44add-d1b4-4677-a543-3bc5ca01ce78),segment_id=89d44add-d1b4-4677-a543-3bc5ca01ce78)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:23:36.636766 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-adf1ea08-e2fb-46e7-85fd-753c0e26596b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:36.654952 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-adf1ea08-e2fb-46e7-85fd-753c0e26596b None None] Calling delete_port for c80ae95c-b930-4325-b1ff-c64be2f2e0f9 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:23:36.711044 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c4cda7f-231e-4aa8-ace5-d7cde33e173e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:36.731563 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-5aac75c0-dbb5-402a-b892-15b84c5d7113 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'name': 'tempest-TestNetworkAdvancedServerOps-router-639414800', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35'}], 'enable_snat': True}, 'gw_port_id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:23:35Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:e6:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4215, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:23:36.741500 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c4cda7f-231e-4aa8-ace5-d7cde33e173e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Port': ['ID=de197704-e053-4dc5-91d2-42e71583f4bf,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:36.767823 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e31191a0-851a-4d50-9888-2cff31e34391 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:23:36.771312 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5aac75c0-dbb5-402a-b892-15b84c5d7113 None None] The sync data for ids ['f0aed012-421c-4faa-a2f9-bd04de281a35'] in n-d-713301-27 is: [{'id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'name': 'tempest-TestNetworkAdvancedServerOps-router-639414800', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35'}], 'enable_snat': True}, 'gw_port_id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:23:35Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'de197704-e053-4dc5-91d2-42e71583f4bf', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:f0:e6:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f0aed012-421c-4faa-a2f9-bd04de281a35', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4215, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.35', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:22:33Z', 'updated_at': '2021-12-09T22:22:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:23:36.789234 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-adf1ea08-e2fb-46e7-85fd-753c0e26596b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:36.817595 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c4cda7f-231e-4aa8-ace5-d7cde33e173e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:36.822742 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adf1ea08-e2fb-46e7-85fd-753c0e26596b None None] Pushing event deleted for resources: {'Port': ['ID=c80ae95c-b930-4325-b1ff-c64be2f2e0f9,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:36.831366 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1ea08-e2fb-46e7-85fd-753c0e26596b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:36.831741 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1ea08-e2fb-46e7-85fd-753c0e26596b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:36.832081 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1ea08-e2fb-46e7-85fd-753c0e26596b None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:36.832424 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1ea08-e2fb-46e7-85fd-753c0e26596b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:36.832758 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1ea08-e2fb-46e7-85fd-753c0e26596b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:36.833084 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1ea08-e2fb-46e7-85fd-753c0e26596b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:36.833410 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1ea08-e2fb-46e7-85fd-753c0e26596b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:36.833732 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1ea08-e2fb-46e7-85fd-753c0e26596b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:36.834054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1ea08-e2fb-46e7-85fd-753c0e26596b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:36.834408 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1ea08-e2fb-46e7-85fd-753c0e26596b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:36.834847 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1ea08-e2fb-46e7-85fd-753c0e26596b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:36.835175 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1ea08-e2fb-46e7-85fd-753c0e26596b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:36.835526 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-adf1ea08-e2fb-46e7-85fd-753c0e26596b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:36.839716 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-adf1ea08-e2fb-46e7-85fd-753c0e26596b None None] No DVR routers for this DVR port c80ae95c-b930-4325-b1ff-c64be2f2e0f9 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:23:36.872457 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:36.916450 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c4cda7f-231e-4aa8-ace5-d7cde33e173e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:36.918682 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c4cda7f-231e-4aa8-ace5-d7cde33e173e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:36.965369 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c4cda7f-231e-4aa8-ace5-d7cde33e173e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:36.966733 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6c4cda7f-231e-4aa8-ace5-d7cde33e173e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Fanout notify agent at l3_agent the message router_deleted on router f0aed012-421c-4faa-a2f9-bd04de281a35 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 22:23:36.973633 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6c4cda7f-231e-4aa8-ace5-d7cde33e173e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:36.974763 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6c4cda7f-231e-4aa8-ace5-d7cde33e173e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/routers/f0aed012-421c-4faa-a2f9-bd04de281a35 HTTP/1.1" status: 204 len: 168 time: 0.8396308 Dec 09 22:23:36.977800 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34086) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:37.063344 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:37.156923 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:37.178938 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cff5da94-0610-451c-b1f5-67d31aadb2f2']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:23:37.188767 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '89d44add-d1b4-4677-a543-3bc5ca01ce78') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:23:37.189043 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '89d44add-d1b4-4677-a543-3bc5ca01ce78') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:23:37.198986 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:37.212709 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:37.219022 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Releasing vlan 115 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:23:37.219675 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: timer() Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:23:37.222891 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:23:37.284496 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:37.291916 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:37.295099 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/networks/cff5da94-0610-451c-b1f5-67d31aadb2f2 HTTP/1.1" status: 204 len: 168 time: 0.3162873 Dec 09 22:23:37.297966 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34088) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:37.307084 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Network': ['ID=cff5da94-0610-451c-b1f5-67d31aadb2f2,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:37.315254 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:37.315625 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:37.315974 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:37.316287 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:37.316653 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:37.316983 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:37.317309 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:37.317645 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:37.317989 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:37.318303 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:37.318627 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:37.318922 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:37.319235 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e22afff5-2a72-4a94-8c90-29ae7ed00f6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:37.363565 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bd0c7ef1-8281-46e1-85ca-35000cb9de33 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:37.393118 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bd0c7ef1-8281-46e1-85ca-35000cb9de33 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:37.456937 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bd0c7ef1-8281-46e1-85ca-35000cb9de33 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:37.459692 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-bd0c7ef1-8281-46e1-85ca-35000cb9de33 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:37.460867 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-bd0c7ef1-8281-46e1-85ca-35000cb9de33 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/security-groups/0f796547-52c1-43d2-92c2-87811d2e4548 HTTP/1.1" status: 204 len: 168 time: 0.1615889 Dec 09 22:23:37.470254 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd0c7ef1-8281-46e1-85ca-35000cb9de33 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0f796547-52c1-43d2-92c2-87811d2e4548,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:37.739431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34094) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:37.746361 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-b3a1d043-5ddb-4b1c-9252-09f679f95889 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-819060032', 'description': 'tempest-secgroup-smoke-819060032 description', 'project_id': 'e21dff80515b44aa9f01117603c6de0d'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:23:37.771543 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b3a1d043-5ddb-4b1c-9252-09f679f95889 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:37.839822 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b3a1d043-5ddb-4b1c-9252-09f679f95889 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:37.845937 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b3a1d043-5ddb-4b1c-9252-09f679f95889 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:37.877756 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b3a1d043-5ddb-4b1c-9252-09f679f95889 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:37.879002 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b3a1d043-5ddb-4b1c-9252-09f679f95889 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.1376140 Dec 09 22:23:37.882097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34096) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:37.886701 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-0ae56c59-2415-4308-9d89-4f96a4f9300f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': 'f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:23:37.888712 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3a1d043-5ddb-4b1c-9252-09f679f95889 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroup': ['ID=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:37.915206 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0ae56c59-2415-4308-9d89-4f96a4f9300f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:37.960721 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0ae56c59-2415-4308-9d89-4f96a4f9300f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:37.966175 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0ae56c59-2415-4308-9d89-4f96a4f9300f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:37.987812 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ae56c59-2415-4308-9d89-4f96a4f9300f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8ed45127-f7d5-4823-a724-2bbc8812abc0,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:37.997355 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0ae56c59-2415-4308-9d89-4f96a4f9300f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:37.999570 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0ae56c59-2415-4308-9d89-4f96a4f9300f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1161911 Dec 09 22:23:38.005367 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34098) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:38.010095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-e296073e-2f34-4228-85c2-8032132fd944 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': 'f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:23:38.041450 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e296073e-2f34-4228-85c2-8032132fd944 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.108246 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e296073e-2f34-4228-85c2-8032132fd944 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.113619 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e296073e-2f34-4228-85c2-8032132fd944 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.132658 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e296073e-2f34-4228-85c2-8032132fd944 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=82dae276-9593-4e4c-bbd4-11e4b5fdfafe,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:38.142934 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-e296073e-2f34-4228-85c2-8032132fd944 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.144181 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-e296073e-2f34-4228-85c2-8032132fd944 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1378274 Dec 09 22:23:38.147040 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34100) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:38.151326 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-f2f02406-9dbf-4390-9965-e1aa9ebe4364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': 'f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:23:38.182284 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f2f02406-9dbf-4390-9965-e1aa9ebe4364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.214557 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.240876 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f2f02406-9dbf-4390-9965-e1aa9ebe4364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.245980 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f2f02406-9dbf-4390-9965-e1aa9ebe4364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.264727 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2f02406-9dbf-4390-9965-e1aa9ebe4364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f91e18f3-dacc-4271-8988-6584071ce562,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:38.274178 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f2f02406-9dbf-4390-9965-e1aa9ebe4364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.275389 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f2f02406-9dbf-4390-9965-e1aa9ebe4364 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1273887 Dec 09 22:23:38.278395 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34102) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:38.283132 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-2d076ae6-2796-4c93-8093-cd3933583291 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': 'f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:23:38.312819 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2d076ae6-2796-4c93-8093-cd3933583291 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.337034 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d935a353-c56a-410a-a299-349bf01c04de no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:23:38.357858 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: d935a353-c56a-410a-a299-349bf01c04de {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:23:38.358185 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d935a353-c56a-410a-a299-349bf01c04de not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:23:38.358647 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c80ae95c-b930-4325-b1ff-c64be2f2e0f9 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:23:38.377482 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2d076ae6-2796-4c93-8093-cd3933583291 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.381243 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: c80ae95c-b930-4325-b1ff-c64be2f2e0f9 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:23:38.381397 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2d076ae6-2796-4c93-8093-cd3933583291 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.381613 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device c80ae95c-b930-4325-b1ff-c64be2f2e0f9 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:23:38.382131 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device de197704-e053-4dc5-91d2-42e71583f4bf no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:23:38.402333 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: de197704-e053-4dc5-91d2-42e71583f4bf {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:23:38.402656 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device de197704-e053-4dc5-91d2-42e71583f4bf not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:23:38.404025 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d076ae6-2796-4c93-8093-cd3933583291 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=988ee3ec-d1c3-437a-9b44-cbc2d9821223,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:38.414667 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2d076ae6-2796-4c93-8093-cd3933583291 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.416059 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2d076ae6-2796-4c93-8093-cd3933583291 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1364996 Dec 09 22:23:38.418949 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34104) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:38.423789 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c599e211-f2c9-49d7-8e32-5df1f9928bc2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': 'f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:23:38.445910 n-d-713301-27 neutron-server[103438]: INFO neutron.db.securitygroups_db [None req-c599e211-f2c9-49d7-8e32-5df1f9928bc2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Project e21dff80515b44aa9f01117603c6de0d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 22:23:38.450741 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c599e211-f2c9-49d7-8e32-5df1f9928bc2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.509807 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c599e211-f2c9-49d7-8e32-5df1f9928bc2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.514153 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c599e211-f2c9-49d7-8e32-5df1f9928bc2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.529212 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c599e211-f2c9-49d7-8e32-5df1f9928bc2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=17d24bfb-6b6d-47ef-b019-4a60be637828,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:38.541298 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c599e211-f2c9-49d7-8e32-5df1f9928bc2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.542538 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c599e211-f2c9-49d7-8e32-5df1f9928bc2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1224728 Dec 09 22:23:38.545434 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34106) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:38.549828 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-7254a620-0e47-4e2c-a68a-b1c18d889488 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': 'f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:23:38.574176 n-d-713301-27 neutron-server[103438]: INFO neutron.db.securitygroups_db [None req-7254a620-0e47-4e2c-a68a-b1c18d889488 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Project e21dff80515b44aa9f01117603c6de0d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 22:23:38.579423 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7254a620-0e47-4e2c-a68a-b1c18d889488 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.642333 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7254a620-0e47-4e2c-a68a-b1c18d889488 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.647787 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7254a620-0e47-4e2c-a68a-b1c18d889488 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.668284 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7254a620-0e47-4e2c-a68a-b1c18d889488 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8e99e55a-b68f-4103-9aa0-7e771a33ed11,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:38.676782 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7254a620-0e47-4e2c-a68a-b1c18d889488 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.678469 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7254a620-0e47-4e2c-a68a-b1c18d889488 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1320860 Dec 09 22:23:38.681706 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34108) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:38.686807 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-5e1c0c69-c4ae-44b9-b703-ff208cd5eb69 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'network': {'name': 'tempest-network-smoke--3569566', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'port_security_enabled': True}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:23:38.709945 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5e1c0c69-c4ae-44b9-b703-ff208cd5eb69 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Made reservation on behalf of e21dff80515b44aa9f01117603c6de0d for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:23:38.713551 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5e1c0c69-c4ae-44b9-b703-ff208cd5eb69 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.737759 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5e1c0c69-c4ae-44b9-b703-ff208cd5eb69 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] vlan segment allocate from pool success with {'vlan_id': 119, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 22:23:38.747602 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5e1c0c69-c4ae-44b9-b703-ff208cd5eb69 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.748146 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-5e1c0c69-c4ae-44b9-b703-ff208cd5eb69 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Added segment a9a93e18-2e77-4f70-840a-1a0145ed66db of type vlan for network 001ae614-c091-4847-8da3-f38043ef44ea Dec 09 22:23:38.790404 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5e1c0c69-c4ae-44b9-b703-ff208cd5eb69 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.819352 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5e1c0c69-c4ae-44b9-b703-ff208cd5eb69 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.824980 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e1c0c69-c4ae-44b9-b703-ff208cd5eb69 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:38.825794 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5e1c0c69-c4ae-44b9-b703-ff208cd5eb69 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.860740 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5e1c0c69-c4ae-44b9-b703-ff208cd5eb69 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 766 time: 0.1779137 Dec 09 22:23:38.863775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34110) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:38.868470 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-9e9eb156-9e4c-4103-881a-8de67d219df3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-1559026721', 'admin_state_up': True, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:23:38.909834 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e1c0c69-c4ae-44b9-b703-ff208cd5eb69 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Network': ['ID=001ae614-c091-4847-8da3-f38043ef44ea,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:38.921993 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 001ae614-c091-4847-8da3-f38043ef44ea details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 22:23:38.929289 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e9eb156-9e4c-4103-881a-8de67d219df3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.930379 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e9eb156-9e4c-4103-881a-8de67d219df3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:38.986336 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e9eb156-9e4c-4103-881a-8de67d219df3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:39.126941 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e9eb156-9e4c-4103-881a-8de67d219df3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:39.320963 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e9eb156-9e4c-4103-881a-8de67d219df3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:39.339734 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e9eb156-9e4c-4103-881a-8de67d219df3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:39.444665 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-9e9eb156-9e4c-4103-881a-8de67d219df3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Allocated IP 172.25.3.150 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/7d6542cd-3a73-4535-8181-c9026be1703f) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:23:39.545137 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e9eb156-9e4c-4103-881a-8de67d219df3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:39.581684 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e9eb156-9e4c-4103-881a-8de67d219df3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:39.631084 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9e9eb156-9e4c-4103-881a-8de67d219df3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:23:39.633847 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-9e9eb156-9e4c-4103-881a-8de67d219df3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:23:39.639897 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e9eb156-9e4c-4103-881a-8de67d219df3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:23:39.647257 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-284bf4d7-1449-4459-80d2-2c738955f781 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:23:39.661244 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e9eb156-9e4c-4103-881a-8de67d219df3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=7d6542cd-3a73-4535-8181-c9026be1703f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:39.709530 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:39.712608 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-29eee601-a4a9-4cb4-b44b-7999f150d256 None None] Provisioning complete for port 7d6542cd-3a73-4535-8181-c9026be1703f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:23:39.712967 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-29eee601-a4a9-4cb4-b44b-7999f150d256 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:39.748316 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-29eee601-a4a9-4cb4-b44b-7999f150d256 None None] Port 7d6542cd-3a73-4535-8181-c9026be1703f cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:23:39.891087 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e9eb156-9e4c-4103-881a-8de67d219df3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:40.442068 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e9eb156-9e4c-4103-881a-8de67d219df3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:40.572150 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9e9eb156-9e4c-4103-881a-8de67d219df3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router 911f7322-871f-498f-b69c-2d9baf55d117 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 22:23:40.696568 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9e9eb156-9e4c-4103-881a-8de67d219df3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:23:40.710681 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] Sync routers for ids ['911f7322-871f-498f-b69c-2d9baf55d117'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:23:40.721496 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] Routers {'911f7322-871f-498f-b69c-2d9baf55d117'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:23:40.722193 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:23:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['911f7322-871f-498f-b69c-2d9baf55d117'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:23:40.727382 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-9e9eb156-9e4c-4103-881a-8de67d219df3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:40.730432 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9e9eb156-9e4c-4103-881a-8de67d219df3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 896 time: 1.8639231 Dec 09 22:23:40.731995 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34112) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:40.765605 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-081b8481-431f-4de1-b74c-2760806569b7 tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] 10.222.0.13 "GET /v2.0/subnets?project_id=e21dff80515b44aa9f01117603c6de0d&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0296495 Dec 09 22:23:40.765855 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34114) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:40.827302 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] Set router 911f7322-871f-498f-b69c-2d9baf55d117 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:23:40.850389 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4781ee60-49af-4040-84a7-3401171c018f tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:40.851967 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4781ee60-49af-4040-84a7-3401171c018f tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0851862 Dec 09 22:23:40.854776 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34116) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:40.881469 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ec715575-1d51-428a-8014-dfc1d5500a61 tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] 10.222.0.13 "GET /v2.0/subnets?network_id=97925a19-460a-4476-8208-41db134b6c83&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0256217 Dec 09 22:23:40.884038 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34118) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:40.888919 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b186b560-f508-4de5-bb42-f9990df192cc tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1576753309', 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:23:40.989285 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b186b560-f508-4de5-bb42-f9990df192cc tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Made reservation on behalf of e21dff80515b44aa9f01117603c6de0d for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:23:40.993218 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b186b560-f508-4de5-bb42-f9990df192cc tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:41.008628 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '911f7322-871f-498f-b69c-2d9baf55d117', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1559026721', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150'}], 'enable_snat': True}, 'gw_port_id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:23:38Z', 'updated_at': '2021-12-09T22:23:39Z', 'revision_number': 3, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:eb:cf:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4234, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:23:39Z', 'updated_at': '2021-12-09T22:23:39Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:23:41.035985 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] Checking router: 911f7322-871f-498f-b69c-2d9baf55d117 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:23:41.036325 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] Updating router 911f7322-871f-498f-b69c-2d9baf55d117 port 7d6542cd-3a73-4535-8181-c9026be1703f binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:23:41.061625 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:41.175327 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b186b560-f508-4de5-bb42-f9990df192cc tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:41.239704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b186b560-f508-4de5-bb42-f9990df192cc tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Subnet': ['ID=8e3240f2-9f05-4035-8fad-ce938f6b5d5b,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:41.248377 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b186b560-f508-4de5-bb42-f9990df192cc tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Checking segment: {'id': 'a9a93e18-2e77-4f70-840a-1a0145ed66db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:23:41.248740 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b186b560-f508-4de5-bb42-f9990df192cc tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network hostable DHCP agents. Network: 001ae614-c091-4847-8da3-f38043ef44ea, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 22:23:41.266332 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b186b560-f508-4de5-bb42-f9990df192cc tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network 001ae614-c091-4847-8da3-f38043ef44ea is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 22:23:41.275651 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-b186b560-f508-4de5-bb42-f9990df192cc tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 001ae614-c091-4847-8da3-f38043ef44ea) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:23:41.280123 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b186b560-f508-4de5-bb42-f9990df192cc tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:41.281001 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b186b560-f508-4de5-bb42-f9990df192cc tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:41.286493 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cbdb72e6-1087-4446-8b64-67c010547ced None None] Network 001ae614-c091-4847-8da3-f38043ef44ea requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:23:41.304042 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b186b560-f508-4de5-bb42-f9990df192cc tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.4188960 Dec 09 22:23:41.304851 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34120) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:41.313464 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:41.319958 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:41.400517 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4af0238c-3ed6-4eba-8423-1d03c0c880cd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-001ae614-c091-4847-8da3-f38043ef44ea', 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ips': [{'subnet_id': '8e3240f2-9f05-4035-8fad-ce938f6b5d5b'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 22:23:41.401587 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4af0238c-3ed6-4eba-8423-1d03c0c880cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:41.464101 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] Attempting to bind port 7d6542cd-3a73-4535-8181-c9026be1703f on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:23:41.464472 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] Attempting to bind port 7d6542cd-3a73-4535-8181-c9026be1703f by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:23:41.464831 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] Attempting to bind port 7d6542cd-3a73-4535-8181-c9026be1703f on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:23:41.470596 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8943d1b9-9e06-4ec5-b1a9-c56ce474db05 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:23:41.474900 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 23, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:23:41.475274 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:23:41.475702 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:41.476086 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:23:41.476625 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] Bound port: 7d6542cd-3a73-4535-8181-c9026be1703f, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:23:41.476918 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:41.517316 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b0ecc23-68fe-4747-a18e-90990e626e63 None None] Pushing event updated for resources: {'Port': ['ID=7d6542cd-3a73-4535-8181-c9026be1703f,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:41.540700 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-4af0238c-3ed6-4eba-8423-1d03c0c880cd None None] Allocated IP 172.20.0.2 (001ae614-c091-4847-8da3-f38043ef44ea/8e3240f2-9f05-4035-8fad-ce938f6b5d5b/963b7872-c422-4e30-b58e-bde567f1a16a) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:23:41.542972 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b0ecc23-68fe-4747-a18e-90990e626e63 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:41.543328 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b0ecc23-68fe-4747-a18e-90990e626e63 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:41.543794 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b0ecc23-68fe-4747-a18e-90990e626e63 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:41.544131 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b0ecc23-68fe-4747-a18e-90990e626e63 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:41.544578 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b0ecc23-68fe-4747-a18e-90990e626e63 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:41.545104 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b0ecc23-68fe-4747-a18e-90990e626e63 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:41.545778 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b0ecc23-68fe-4747-a18e-90990e626e63 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:41.546144 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b0ecc23-68fe-4747-a18e-90990e626e63 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:41.546529 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b0ecc23-68fe-4747-a18e-90990e626e63 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:41.546896 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b0ecc23-68fe-4747-a18e-90990e626e63 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:41.547266 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b0ecc23-68fe-4747-a18e-90990e626e63 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:41.547624 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b0ecc23-68fe-4747-a18e-90990e626e63 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:41.547948 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4b0ecc23-68fe-4747-a18e-90990e626e63 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:23:41.554132 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] For port 7d6542cd-3a73-4535-8181-c9026be1703f, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:23:41.557564 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] For port 7d6542cd-3a73-4535-8181-c9026be1703f, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7d6542cd-3a73-4535-8181-c9026be1703f,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:23:41.564634 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:41.618721 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] Routers {'911f7322-871f-498f-b69c-2d9baf55d117'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:23:41.619193 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:23:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['911f7322-871f-498f-b69c-2d9baf55d117'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:23:41.622618 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-84be159b-5f35-48dc-ad22-d75dbc762f77 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:23:41.637911 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-556cbb30-bc66-494a-b980-09db01e6ab3e None None] Provisioning complete for port 7d6542cd-3a73-4535-8181-c9026be1703f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:23:41.638473 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-556cbb30-bc66-494a-b980-09db01e6ab3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:41.720370 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b0ecc23-68fe-4747-a18e-90990e626e63 None None] Pushing event updated for resources: {'Port': ['ID=7d6542cd-3a73-4535-8181-c9026be1703f,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:41.742105 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] Set router 911f7322-871f-498f-b69c-2d9baf55d117 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:23:41.786855 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6521472e-c3c6-4641-a61c-1b2cc723701f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:41.941896 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4af0238c-3ed6-4eba-8423-1d03c0c880cd None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:41.950409 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '911f7322-871f-498f-b69c-2d9baf55d117', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1559026721', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150'}], 'enable_snat': True}, 'gw_port_id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:23:38Z', 'updated_at': '2021-12-09T22:23:39Z', 'revision_number': 3, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:eb:cf:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4234, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:23:39Z', 'updated_at': '2021-12-09T22:23:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:23:41.954337 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4af0238c-3ed6-4eba-8423-1d03c0c880cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:41.978057 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c3750cd6-5de2-40f1-9d9a-04a92ee1ebb8 None None] The sync data for ids ['911f7322-871f-498f-b69c-2d9baf55d117'] in n-d-713301-27 is: [{'id': '911f7322-871f-498f-b69c-2d9baf55d117', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1559026721', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150'}], 'enable_snat': True}, 'gw_port_id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:23:38Z', 'updated_at': '2021-12-09T22:23:39Z', 'revision_number': 3, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:eb:cf:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4234, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:23:39Z', 'updated_at': '2021-12-09T22:23:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:23:41.982945 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-556cbb30-bc66-494a-b980-09db01e6ab3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:42.024951 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4af0238c-3ed6-4eba-8423-1d03c0c880cd None None] Network 001ae614-c091-4847-8da3-f38043ef44ea is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:23:42.030849 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-556cbb30-bc66-494a-b980-09db01e6ab3e None None] For port 7d6542cd-3a73-4535-8181-c9026be1703f, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7d6542cd-3a73-4535-8181-c9026be1703f,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:23:42.035179 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-4af0238c-3ed6-4eba-8423-1d03c0c880cd None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:23:42.038854 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4af0238c-3ed6-4eba-8423-1d03c0c880cd None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:23:42.044168 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4af0238c-3ed6-4eba-8423-1d03c0c880cd None None] Pushing event updated for resources: {'Port': ['ID=963b7872-c422-4e30-b58e-bde567f1a16a,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:42.046781 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-556cbb30-bc66-494a-b980-09db01e6ab3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:42.137448 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-4af0238c-3ed6-4eba-8423-1d03c0c880cd None None] Attempting to bind port 963b7872-c422-4e30-b58e-bde567f1a16a on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:23:42.137820 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-4af0238c-3ed6-4eba-8423-1d03c0c880cd None None] Attempting to bind port 963b7872-c422-4e30-b58e-bde567f1a16a by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'a9a93e18-2e77-4f70-840a-1a0145ed66db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:23:42.138268 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4af0238c-3ed6-4eba-8423-1d03c0c880cd None None] Attempting to bind port 963b7872-c422-4e30-b58e-bde567f1a16a on network 001ae614-c091-4847-8da3-f38043ef44ea {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:23:42.140297 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-556cbb30-bc66-494a-b980-09db01e6ab3e None None] Pushing event updated for resources: {'Port': ['ID=7d6542cd-3a73-4535-8181-c9026be1703f,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:42.144271 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-6521472e-c3c6-4641-a61c-1b2cc723701f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Allocated IP 172.20.0.1 (001ae614-c091-4847-8da3-f38043ef44ea/8e3240f2-9f05-4035-8fad-ce938f6b5d5b/b0f2b769-6f50-4bcb-80a1-dd8e7046ca45) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:23:42.146423 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4af0238c-3ed6-4eba-8423-1d03c0c880cd None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 23, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:23:42.146801 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4af0238c-3ed6-4eba-8423-1d03c0c880cd None None] Checking segment: {'id': 'a9a93e18-2e77-4f70-840a-1a0145ed66db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:23:42.147202 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4af0238c-3ed6-4eba-8423-1d03c0c880cd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:42.147619 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4af0238c-3ed6-4eba-8423-1d03c0c880cd None None] Bound using segment: {'id': 'a9a93e18-2e77-4f70-840a-1a0145ed66db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:23:42.148092 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-4af0238c-3ed6-4eba-8423-1d03c0c880cd None None] Bound port: 963b7872-c422-4e30-b58e-bde567f1a16a, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a9a93e18-2e77-4f70-840a-1a0145ed66db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:23:42.148465 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4af0238c-3ed6-4eba-8423-1d03c0c880cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:42.205745 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c00e5fcc-a5d6-4106-9d9d-885644d63a08 None None] Provisioning complete for port 7d6542cd-3a73-4535-8181-c9026be1703f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:23:42.206112 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c00e5fcc-a5d6-4106-9d9d-885644d63a08 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:42.249094 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-4af0238c-3ed6-4eba-8423-1d03c0c880cd None None] For port 963b7872-c422-4e30-b58e-bde567f1a16a, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:23:42.253853 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-4af0238c-3ed6-4eba-8423-1d03c0c880cd None None] For port 963b7872-c422-4e30-b58e-bde567f1a16a, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=963b7872-c422-4e30-b58e-bde567f1a16a,segment=NetworkSegment(a9a93e18-2e77-4f70-840a-1a0145ed66db),segment_id=a9a93e18-2e77-4f70-840a-1a0145ed66db)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:23:42.261402 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4af0238c-3ed6-4eba-8423-1d03c0c880cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:42.303303 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6521472e-c3c6-4641-a61c-1b2cc723701f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:42.372118 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4af0238c-3ed6-4eba-8423-1d03c0c880cd None None] Pushing event updated for resources: {'Port': ['ID=963b7872-c422-4e30-b58e-bde567f1a16a,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:42.393590 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6521472e-c3c6-4641-a61c-1b2cc723701f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:42.430573 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7d6542cd-3a73-4535-8181-c9026be1703f up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:23:42.460107 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6521472e-c3c6-4641-a61c-1b2cc723701f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network 001ae614-c091-4847-8da3-f38043ef44ea is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:23:42.465136 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-6521472e-c3c6-4641-a61c-1b2cc723701f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:23:42.472656 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6521472e-c3c6-4641-a61c-1b2cc723701f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:23:42.500767 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 7d6542cd-3a73-4535-8181-c9026be1703f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:23:42.501129 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:42.503402 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6521472e-c3c6-4641-a61c-1b2cc723701f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=b0f2b769-6f50-4bcb-80a1-dd8e7046ca45,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:42.540694 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6521472e-c3c6-4641-a61c-1b2cc723701f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:42.721859 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6521472e-c3c6-4641-a61c-1b2cc723701f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:43.329767 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6521472e-c3c6-4641-a61c-1b2cc723701f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:43.335534 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6521472e-c3c6-4641-a61c-1b2cc723701f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:43.353138 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28916b93-2ba8-492c-a783-ff48ffe6892f None None] Network 001ae614-c091-4847-8da3-f38043ef44ea requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:23:43.414745 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6521472e-c3c6-4641-a61c-1b2cc723701f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=b0f2b769-6f50-4bcb-80a1-dd8e7046ca45,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:43.418753 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6521472e-c3c6-4641-a61c-1b2cc723701f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:43.484391 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-17b9bfd1-87f2-49c6-ab84-870017ed7c60 None None] Provisioning complete for port 963b7872-c422-4e30-b58e-bde567f1a16a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:23:43.484902 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-17b9bfd1-87f2-49c6-ab84-870017ed7c60 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:43.533832 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6521472e-c3c6-4641-a61c-1b2cc723701f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network 001ae614-c091-4847-8da3-f38043ef44ea is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:23:43.535585 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-6521472e-c3c6-4641-a61c-1b2cc723701f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:23:43.587066 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-17b9bfd1-87f2-49c6-ab84-870017ed7c60 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:43.632264 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-17b9bfd1-87f2-49c6-ab84-870017ed7c60 None None] For port 963b7872-c422-4e30-b58e-bde567f1a16a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=963b7872-c422-4e30-b58e-bde567f1a16a,segment=NetworkSegment(a9a93e18-2e77-4f70-840a-1a0145ed66db),segment_id=a9a93e18-2e77-4f70-840a-1a0145ed66db)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:23:43.640636 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-17b9bfd1-87f2-49c6-ab84-870017ed7c60 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:43.694373 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6521472e-c3c6-4641-a61c-1b2cc723701f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router 911f7322-871f-498f-b69c-2d9baf55d117 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:23:43.704831 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17b9bfd1-87f2-49c6-ab84-870017ed7c60 None None] Pushing event updated for resources: {'Port': ['ID=963b7872-c422-4e30-b58e-bde567f1a16a,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:43.830683 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6521472e-c3c6-4641-a61c-1b2cc723701f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:23:43.837731 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6521472e-c3c6-4641-a61c-1b2cc723701f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "PUT /v2.0/routers/911f7322-871f-498f-b69c-2d9baf55d117/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5311306 Dec 09 22:23:43.841577 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] Sync routers for ids ['911f7322-871f-498f-b69c-2d9baf55d117'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:23:43.867961 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] Routers {'911f7322-871f-498f-b69c-2d9baf55d117'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:23:43.867961 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:23:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['911f7322-871f-498f-b69c-2d9baf55d117'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:23:43.914430 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-bed51427-758f-450b-a6a1-c66b92949c1c None None] Provisioning complete for port b0f2b769-6f50-4bcb-80a1-dd8e7046ca45 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:23:43.914828 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bed51427-758f-450b-a6a1-c66b92949c1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:44.002750 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-bed51427-758f-450b-a6a1-c66b92949c1c None None] Port b0f2b769-6f50-4bcb-80a1-dd8e7046ca45 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:23:44.024046 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-95362ccd-a011-405b-90e4-502b2729a6c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-819060032&fields=id&tenant_id=e21dff80515b44aa9f01117603c6de0d HTTP/1.1" status: 200 len: 267 time: 0.0582237 Dec 09 22:23:44.034504 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] Set router 911f7322-871f-498f-b69c-2d9baf55d117 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:23:44.037119 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-bed51427-758f-450b-a6a1-c66b92949c1c None None] Provisioning complete for port 963b7872-c422-4e30-b58e-bde567f1a16a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:23:44.037393 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bed51427-758f-450b-a6a1-c66b92949c1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:44.155825 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-95f5d37a-00e4-4396-9278-cc1b39242f73 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:44.157525 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-95f5d37a-00e4-4396-9278-cc1b39242f73 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/networks?id=001ae614-c091-4847-8da3-f38043ef44ea HTTP/1.1" status: 200 len: 794 time: 0.1282616 Dec 09 22:23:44.177694 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-b737a776-1c50-4f64-bb83-72e792614ddd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/quotas/e21dff80515b44aa9f01117603c6de0d HTTP/1.1" status: 200 len: 375 time: 0.0124369 Dec 09 22:23:44.240810 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-3ae4d5fe-3d89-4adb-8301-79b8a0b79ca0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0570614 Dec 09 22:23:44.330141 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '911f7322-871f-498f-b69c-2d9baf55d117', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1559026721', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150'}], 'enable_snat': True}, 'gw_port_id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:23:38Z', 'updated_at': '2021-12-09T22:23:42Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:eb:cf:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4234, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:23:39Z', 'updated_at': '2021-12-09T22:23:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'b0f2b769-6f50-4bcb-80a1-dd8e7046ca45', 'name': '', 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:32:4c:a9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'device_owner': 'network:router_interface', 'standard_attr_id': 4237, 'fixed_ips': [{'subnet_id': '8e3240f2-9f05-4035-8fad-ce938f6b5d5b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:23:41Z', 'updated_at': '2021-12-09T22:23:43Z', 'revision_number': 2, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '8e3240f2-9f05-4035-8fad-ce938f6b5d5b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:23:44.358975 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] Checking router: 911f7322-871f-498f-b69c-2d9baf55d117 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:23:44.359667 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] Updating router 911f7322-871f-498f-b69c-2d9baf55d117 port b0f2b769-6f50-4bcb-80a1-dd8e7046ca45 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:23:44.364515 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-1b53f72e-2509-404b-aa3a-f68f73f2a060 service neutron] 10.222.0.13 "GET /v2.0/networks/001ae614-c091-4847-8da3-f38043ef44ea?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1075394 Dec 09 22:23:44.395900 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 963b7872-c422-4e30-b58e-bde567f1a16a up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:23:44.430436 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:44.457606 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d954f4f5-f418-48bd-ab46-f98a5b583e01 None None] Provisioning complete for port b0f2b769-6f50-4bcb-80a1-dd8e7046ca45 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:23:44.457978 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d954f4f5-f418-48bd-ab46-f98a5b583e01 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:44.473260 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-088e7681-485e-4592-a283-ad6fd298ae1f service neutron] 10.222.0.13 "GET /v2.0/networks/001ae614-c091-4847-8da3-f38043ef44ea?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1036143 Dec 09 22:23:44.527608 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-d954f4f5-f418-48bd-ab46-f98a5b583e01 None None] Port b0f2b769-6f50-4bcb-80a1-dd8e7046ca45 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:23:44.596977 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 963b7872-c422-4e30-b58e-bde567f1a16a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:23:44.597478 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:44.639273 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-09429af2-5002-4bea-8234-53bfc186fdfc req-bfbc60e9-f3c9-45bf-b9c2-9ddf7d1a746e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 210 time: 0.0291908 Dec 09 22:23:44.817059 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:44.823494 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:44.873905 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ad36335-48da-4917-b658-f91714070353 None None] Pushing event updated for resources: {'Port': ['ID=b0f2b769-6f50-4bcb-80a1-dd8e7046ca45,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:44.931774 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] Attempting to bind port b0f2b769-6f50-4bcb-80a1-dd8e7046ca45 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:23:44.932238 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] Attempting to bind port b0f2b769-6f50-4bcb-80a1-dd8e7046ca45 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'a9a93e18-2e77-4f70-840a-1a0145ed66db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:23:44.932674 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] Attempting to bind port b0f2b769-6f50-4bcb-80a1-dd8e7046ca45 on network 001ae614-c091-4847-8da3-f38043ef44ea {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:23:44.938409 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 23, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:23:44.938927 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] Checking segment: {'id': 'a9a93e18-2e77-4f70-840a-1a0145ed66db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:23:44.939476 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:44.940052 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] Bound using segment: {'id': 'a9a93e18-2e77-4f70-840a-1a0145ed66db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:23:44.940632 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] Bound port: b0f2b769-6f50-4bcb-80a1-dd8e7046ca45, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a9a93e18-2e77-4f70-840a-1a0145ed66db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:23:44.941069 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:45.014542 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] For port b0f2b769-6f50-4bcb-80a1-dd8e7046ca45, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:23:45.018423 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] For port b0f2b769-6f50-4bcb-80a1-dd8e7046ca45, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b0f2b769-6f50-4bcb-80a1-dd8e7046ca45,segment=NetworkSegment(a9a93e18-2e77-4f70-840a-1a0145ed66db),segment_id=a9a93e18-2e77-4f70-840a-1a0145ed66db)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:23:45.023092 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:45.086302 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] Routers {'911f7322-871f-498f-b69c-2d9baf55d117'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:23:45.086937 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:23:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['911f7322-871f-498f-b69c-2d9baf55d117'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:23:45.130959 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ad36335-48da-4917-b658-f91714070353 None None] Pushing event updated for resources: {'Port': ['ID=b0f2b769-6f50-4bcb-80a1-dd8e7046ca45,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:45.197610 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-43a1605a-2d92-4800-a252-42453f8d9a3c None None] Provisioning complete for port b0f2b769-6f50-4bcb-80a1-dd8e7046ca45 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:23:45.198593 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-43a1605a-2d92-4800-a252-42453f8d9a3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:45.236163 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] Set router 911f7322-871f-498f-b69c-2d9baf55d117 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:23:45.416390 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-43a1605a-2d92-4800-a252-42453f8d9a3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:45.482744 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-43a1605a-2d92-4800-a252-42453f8d9a3c None None] For port b0f2b769-6f50-4bcb-80a1-dd8e7046ca45, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b0f2b769-6f50-4bcb-80a1-dd8e7046ca45,segment=NetworkSegment(a9a93e18-2e77-4f70-840a-1a0145ed66db),segment_id=a9a93e18-2e77-4f70-840a-1a0145ed66db)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:23:45.490957 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-43a1605a-2d92-4800-a252-42453f8d9a3c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:45.553795 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43a1605a-2d92-4800-a252-42453f8d9a3c None None] Pushing event updated for resources: {'Port': ['ID=b0f2b769-6f50-4bcb-80a1-dd8e7046ca45,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:45.559368 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '911f7322-871f-498f-b69c-2d9baf55d117', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1559026721', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150'}], 'enable_snat': True}, 'gw_port_id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:23:38Z', 'updated_at': '2021-12-09T22:23:42Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:eb:cf:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4234, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:23:39Z', 'updated_at': '2021-12-09T22:23:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'b0f2b769-6f50-4bcb-80a1-dd8e7046ca45', 'name': '', 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:32:4c:a9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'device_owner': 'network:router_interface', 'standard_attr_id': 4237, 'fixed_ips': [{'subnet_id': '8e3240f2-9f05-4035-8fad-ce938f6b5d5b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:23:41Z', 'updated_at': '2021-12-09T22:23:45Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '8e3240f2-9f05-4035-8fad-ce938f6b5d5b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:23:45.721543 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-7e734b48-ad5f-4a7c-ab93-6dbc5cc1178b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:45.723815 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-7e734b48-ad5f-4a7c-ab93-6dbc5cc1178b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.10 "GET /v2.0/networks?id=001ae614-c091-4847-8da3-f38043ef44ea HTTP/1.1" status: 200 len: 794 time: 0.1253114 Dec 09 22:23:45.765655 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3a5ed72-4710-4eec-ac1e-85b5097a9685 req-c8a55635-b2e6-468b-accb-d266944ded3d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 210 time: 0.0406072 Dec 09 22:23:45.769125 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca7ab38e-4fb9-4b0f-bdeb-64bd7e30001c None None] The sync data for ids ['911f7322-871f-498f-b69c-2d9baf55d117'] in n-d-713301-27 is: [{'id': '911f7322-871f-498f-b69c-2d9baf55d117', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1559026721', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150'}], 'enable_snat': True}, 'gw_port_id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:23:38Z', 'updated_at': '2021-12-09T22:23:42Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:eb:cf:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4234, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:23:39Z', 'updated_at': '2021-12-09T22:23:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'b0f2b769-6f50-4bcb-80a1-dd8e7046ca45', 'name': '', 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:32:4c:a9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'device_owner': 'network:router_interface', 'standard_attr_id': 4237, 'fixed_ips': [{'subnet_id': '8e3240f2-9f05-4035-8fad-ce938f6b5d5b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:23:41Z', 'updated_at': '2021-12-09T22:23:45Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '8e3240f2-9f05-4035-8fad-ce938f6b5d5b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:23:45.782395 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d2af8acd-a39f-4395-9b65-0052f627f93f None None] Provisioning complete for port b0f2b769-6f50-4bcb-80a1-dd8e7046ca45 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:23:45.782760 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d2af8acd-a39f-4395-9b65-0052f627f93f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:45.812669 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-2cf3e2b3-08f5-42aa-bdcb-8cd757466c32 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.10 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=e21dff80515b44aa9f01117603c6de0d HTTP/1.1" status: 200 len: 379 time: 0.0777049 Dec 09 22:23:45.834924 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-c5603856-5c91-48d5-9382-3aaeca589e44 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'port': {'device_id': 'fd0def08-070a-4362-9d32-f545e2d642be', 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea', 'admin_state_up': True, 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'security_groups': ['f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad']}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:23:45.971318 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-c5603856-5c91-48d5-9382-3aaeca589e44 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Made reservation on behalf of e21dff80515b44aa9f01117603c6de0d for: {'port': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:23:45.975138 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-c5603856-5c91-48d5-9382-3aaeca589e44 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:46.106887 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-c5603856-5c91-48d5-9382-3aaeca589e44 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Allocated IP 172.20.0.3 (001ae614-c091-4847-8da3-f38043ef44ea/8e3240f2-9f05-4035-8fad-ce938f6b5d5b/2f35cc66-1533-478b-9f3d-ed5fa8f32d65) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:23:46.258954 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-c5603856-5c91-48d5-9382-3aaeca589e44 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:46.301462 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-c5603856-5c91-48d5-9382-3aaeca589e44 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:46.346980 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-c5603856-5c91-48d5-9382-3aaeca589e44 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network 001ae614-c091-4847-8da3-f38043ef44ea is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:23:46.350095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-c5603856-5c91-48d5-9382-3aaeca589e44 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:23:46.355973 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-c5603856-5c91-48d5-9382-3aaeca589e44 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:23:46.364541 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5603856-5c91-48d5-9382-3aaeca589e44 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=2f35cc66-1533-478b-9f3d-ed5fa8f32d65,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:46.384816 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b0f2b769-6f50-4bcb-80a1-dd8e7046ca45 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:23:46.421645 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-c5603856-5c91-48d5-9382-3aaeca589e44 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:46.422401 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-c5603856-5c91-48d5-9382-3aaeca589e44 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:46.442977 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-c5603856-5c91-48d5-9382-3aaeca589e44 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6228933 Dec 09 22:23:46.455658 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-e23ea721-b14b-48c8-b338-5d96a03aff04 service neutron] Request body: {'port': {'device_id': 'fd0def08-070a-4362-9d32-f545e2d642be', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:23:46.462812 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port b0f2b769-6f50-4bcb-80a1-dd8e7046ca45 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:23:46.463185 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:46.533249 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-e23ea721-b14b-48c8-b338-5d96a03aff04 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:46.715678 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a4498aac-a5bd-4376-8326-78bfa8cd55b2 None None] Provisioning complete for port 2f35cc66-1533-478b-9f3d-ed5fa8f32d65 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:23:46.716257 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4498aac-a5bd-4376-8326-78bfa8cd55b2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:46.756622 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-a4498aac-a5bd-4376-8326-78bfa8cd55b2 None None] Port 2f35cc66-1533-478b-9f3d-ed5fa8f32d65 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:23:46.809830 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-e23ea721-b14b-48c8-b338-5d96a03aff04 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2f35cc66-1533-478b-9f3d-ed5fa8f32d65 {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:23:46.820889 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-e23ea721-b14b-48c8-b338-5d96a03aff04 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:46.834491 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-e23ea721-b14b-48c8-b338-5d96a03aff04 service neutron] Transition to ACTIVE for port object 2f35cc66-1533-478b-9f3d-ed5fa8f32d65 will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:23:46.839162 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-e23ea721-b14b-48c8-b338-5d96a03aff04 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:46.928364 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e23ea721-b14b-48c8-b338-5d96a03aff04 service neutron] Pushing event updated for resources: {'Port': ['ID=2f35cc66-1533-478b-9f3d-ed5fa8f32d65,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:46.987242 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2f69e06-dfce-4b3b-a8f6-d8c7351fb08d req-9c51558f-70bd-490d-9af0-8bde8b1b9559 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:46.988930 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b2f69e06-dfce-4b3b-a8f6-d8c7351fb08d req-9c51558f-70bd-490d-9af0-8bde8b1b9559 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 943 time: 0.1186857 Dec 09 22:23:47.030980 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-e23ea721-b14b-48c8-b338-5d96a03aff04 service neutron] Attempting to bind port 2f35cc66-1533-478b-9f3d-ed5fa8f32d65 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:23:47.031309 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-e23ea721-b14b-48c8-b338-5d96a03aff04 service neutron] Attempting to bind port 2f35cc66-1533-478b-9f3d-ed5fa8f32d65 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'a9a93e18-2e77-4f70-840a-1a0145ed66db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:23:47.031673 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-e23ea721-b14b-48c8-b338-5d96a03aff04 service neutron] Attempting to bind port 2f35cc66-1533-478b-9f3d-ed5fa8f32d65 on network 001ae614-c091-4847-8da3-f38043ef44ea {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:23:47.047591 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-e23ea721-b14b-48c8-b338-5d96a03aff04 service neutron] Port 2f35cc66-1533-478b-9f3d-ed5fa8f32d65 on network 001ae614-c091-4847-8da3-f38043ef44ea not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:23:47.048183 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-e23ea721-b14b-48c8-b338-5d96a03aff04 service neutron] Attempting to bind port 2f35cc66-1533-478b-9f3d-ed5fa8f32d65 on network 001ae614-c091-4847-8da3-f38043ef44ea {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:23:47.062862 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-e23ea721-b14b-48c8-b338-5d96a03aff04 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 23, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:23:47.063218 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-e23ea721-b14b-48c8-b338-5d96a03aff04 service neutron] Checking segment: {'id': 'a9a93e18-2e77-4f70-840a-1a0145ed66db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:23:47.063629 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-e23ea721-b14b-48c8-b338-5d96a03aff04 service neutron] Bound using segment: {'id': 'a9a93e18-2e77-4f70-840a-1a0145ed66db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:23:47.064074 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-e23ea721-b14b-48c8-b338-5d96a03aff04 service neutron] Bound port: 2f35cc66-1533-478b-9f3d-ed5fa8f32d65, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a9a93e18-2e77-4f70-840a-1a0145ed66db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 119, 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:23:47.064438 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-e23ea721-b14b-48c8-b338-5d96a03aff04 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:47.070121 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b2f69e06-dfce-4b3b-a8f6-d8c7351fb08d req-3d690739-276b-4446-8733-4d36ccab978b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0742550 Dec 09 22:23:47.145884 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-e23ea721-b14b-48c8-b338-5d96a03aff04 service neutron] For port 2f35cc66-1533-478b-9f3d-ed5fa8f32d65, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:23:47.148992 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-e23ea721-b14b-48c8-b338-5d96a03aff04 service neutron] For port 2f35cc66-1533-478b-9f3d-ed5fa8f32d65, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=2f35cc66-1533-478b-9f3d-ed5fa8f32d65,segment=NetworkSegment(a9a93e18-2e77-4f70-840a-1a0145ed66db),segment_id=a9a93e18-2e77-4f70-840a-1a0145ed66db)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:23:47.152714 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-e23ea721-b14b-48c8-b338-5d96a03aff04 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:47.187684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-e23ea721-b14b-48c8-b338-5d96a03aff04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:47.188281 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-e23ea721-b14b-48c8-b338-5d96a03aff04 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:47.189773 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-e23ea721-b14b-48c8-b338-5d96a03aff04 service neutron] 10.222.0.10 "PUT /v2.0/ports/2f35cc66-1533-478b-9f3d-ed5fa8f32d65 HTTP/1.1" status: 200 len: 1092 time: 0.7387846 Dec 09 22:23:47.190194 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fd0def08-070a-4362-9d32-f545e2d642be', 'tag': '2f35cc66-1533-478b-9f3d-ed5fa8f32d65'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:23:47.192452 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-242952a4-276e-4618-9f70-052c4c2dd81a" -d '{"events": [{"name": "network-changed", "server_uuid": "fd0def08-070a-4362-9d32-f545e2d642be", "tag": "2f35cc66-1533-478b-9f3d-ed5fa8f32d65"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:23:47.221394 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e23ea721-b14b-48c8-b338-5d96a03aff04 service neutron] Pushing event updated for resources: {'Port': ['ID=2f35cc66-1533-478b-9f3d-ed5fa8f32d65,revision_number=3']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:47.280629 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-524d5716-5487-4ce1-8a63-3e5709b038ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:47.289180 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-524d5716-5487-4ce1-8a63-3e5709b038ed service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 1095 time: 0.0511916 Dec 09 22:23:47.333003 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:23:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3eab27ff-e511-4d63-9207-d6ffab49a8fe x-openstack-request-id: req-3eab27ff-e511-4d63-9207-d6ffab49a8fe {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:23:47.333304 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fd0def08-070a-4362-9d32-f545e2d642be", "tag": "2f35cc66-1533-478b-9f3d-ed5fa8f32d65", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:23:47.333557 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-3eab27ff-e511-4d63-9207-d6ffab49a8fe {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:23:47.333968 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fd0def08-070a-4362-9d32-f545e2d642be', 'tag': '2f35cc66-1533-478b-9f3d-ed5fa8f32d65', 'status': 'completed', 'code': 200} Dec 09 22:23:47.335854 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-4a3ab071-063d-493c-82b6-d4d745a6774a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=2f35cc66-1533-478b-9f3d-ed5fa8f32d65 HTTP/1.1" status: 200 len: 217 time: 0.0435400 Dec 09 22:23:47.387904 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-921586df-db92-4624-bb5c-d125cfe6e213 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:47.389688 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-921586df-db92-4624-bb5c-d125cfe6e213 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=8e3240f2-9f05-4035-8fad-ce938f6b5d5b HTTP/1.1" status: 200 len: 835 time: 0.0470707 Dec 09 22:23:47.440210 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-d9e01933-d221-47bc-869f-d1210b0a100f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:47.441726 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-d9e01933-d221-47bc-869f-d1210b0a100f service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=001ae614-c091-4847-8da3-f38043ef44ea&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0439632 Dec 09 22:23:47.535381 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-1093c4f9-3f71-4846-b87a-eb54d84d5b6a service neutron] 10.222.0.10 "GET /v2.0/networks/001ae614-c091-4847-8da3-f38043ef44ea?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863562 Dec 09 22:23:47.624289 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ae381f94-1c54-40d0-a11c-83bba102c91b req-e1a4cec7-73c0-4b3c-a6d6-9b2431137db9 service neutron] 10.222.0.10 "GET /v2.0/networks/001ae614-c091-4847-8da3-f38043ef44ea?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817606 Dec 09 22:23:47.716721 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-242952a4-276e-4618-9f70-052c4c2dd81a req-3ca6b3ab-4259-4bad-b3f8-ab4233a53fbf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:47.718364 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-242952a4-276e-4618-9f70-052c4c2dd81a req-3ca6b3ab-4259-4bad-b3f8-ab4233a53fbf service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 1095 time: 0.0455651 Dec 09 22:23:47.809482 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-242952a4-276e-4618-9f70-052c4c2dd81a req-6721bf6c-c663-4a6f-93d1-ab1f1c267b11 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:47.810902 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-242952a4-276e-4618-9f70-052c4c2dd81a req-6721bf6c-c663-4a6f-93d1-ab1f1c267b11 service neutron] 10.222.0.10 "GET /v2.0/networks?id=001ae614-c091-4847-8da3-f38043ef44ea HTTP/1.1" status: 200 len: 895 time: 0.0855157 Dec 09 22:23:47.857801 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-242952a4-276e-4618-9f70-052c4c2dd81a req-697bdbdb-037c-4e64-94c9-803e97b3cccb service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=2f35cc66-1533-478b-9f3d-ed5fa8f32d65 HTTP/1.1" status: 200 len: 217 time: 0.0381742 Dec 09 22:23:47.911828 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-242952a4-276e-4618-9f70-052c4c2dd81a req-5762ad48-ca54-4198-a53d-97f7f865337b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:47.914332 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-242952a4-276e-4618-9f70-052c4c2dd81a req-5762ad48-ca54-4198-a53d-97f7f865337b service neutron] 10.222.0.10 "GET /v2.0/subnets?id=8e3240f2-9f05-4035-8fad-ce938f6b5d5b HTTP/1.1" status: 200 len: 835 time: 0.0491376 Dec 09 22:23:47.961886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-242952a4-276e-4618-9f70-052c4c2dd81a req-06776273-a1b2-4bb2-b535-bd1025061a31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:47.963460 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-242952a4-276e-4618-9f70-052c4c2dd81a req-06776273-a1b2-4bb2-b535-bd1025061a31 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=001ae614-c091-4847-8da3-f38043ef44ea&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0414038 Dec 09 22:23:48.075455 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-242952a4-276e-4618-9f70-052c4c2dd81a req-f16879a5-aa46-489f-aed9-3f809404c320 service neutron] 10.222.0.10 "GET /v2.0/networks/001ae614-c091-4847-8da3-f38043ef44ea?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1018925 Dec 09 22:23:48.194730 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-242952a4-276e-4618-9f70-052c4c2dd81a req-2122ac83-e2c5-4a4e-8a54-fc3e57cc977c service neutron] 10.222.0.10 "GET /v2.0/networks/001ae614-c091-4847-8da3-f38043ef44ea?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1110604 Dec 09 22:23:48.210927 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05de68fe-9304-420b-bfb7-712374b0b7b6 req-c96742bd-8fdb-42a0-a085-ae1cfc93954e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:48.212373 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-05de68fe-9304-420b-bfb7-712374b0b7b6 req-c96742bd-8fdb-42a0-a085-ae1cfc93954e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 943 time: 0.0649512 Dec 09 22:23:48.268321 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-05de68fe-9304-420b-bfb7-712374b0b7b6 req-ea35b79d-2ab9-4e4c-b351-f21b6c4a88a0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0486002 Dec 09 22:23:49.391141 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df7c685f-2df4-4a8b-b563-e77e33c361f1 req-0693b957-849e-4567-a187-fb7545631301 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:49.392951 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df7c685f-2df4-4a8b-b563-e77e33c361f1 req-0693b957-849e-4567-a187-fb7545631301 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 943 time: 0.0516834 Dec 09 22:23:49.447815 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-df7c685f-2df4-4a8b-b563-e77e33c361f1 req-8bb591cf-fe11-4d1d-ae93-8bb9c49962f2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0486207 Dec 09 22:23:50.316888 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:23:50.385436 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 2f35cc66-1533-478b-9f3d-ed5fa8f32d65 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:23:50.493087 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 2f35cc66-1533-478b-9f3d-ed5fa8f32d65, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=2f35cc66-1533-478b-9f3d-ed5fa8f32d65,segment=NetworkSegment(a9a93e18-2e77-4f70-840a-1a0145ed66db),segment_id=a9a93e18-2e77-4f70-840a-1a0145ed66db)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:23:50.504926 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '2f35cc66-1533-478b-9f3d-ed5fa8f32d65', 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea', 'port_id': '2f35cc66-1533-478b-9f3d-ed5fa8f32d65', 'mac_address': 'fa:16:3e:1b:0f:bc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 119, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8e3240f2-9f05-4035-8fad-ce938f6b5d5b', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:23:50.545844 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:50.559424 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2f35cc66-1533-478b-9f3d-ed5fa8f32d65 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:23:50.569422 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e837719-7367-47e8-8b36-280f613d1905 req-1bdcdad3-ce57-4916-bc5b-2b83ee518171 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:50.570928 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e837719-7367-47e8-8b36-280f613d1905 req-1bdcdad3-ce57-4916-bc5b-2b83ee518171 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 943 time: 0.0490842 Dec 09 22:23:50.579134 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 2f35cc66-1533-478b-9f3d-ed5fa8f32d65, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=2f35cc66-1533-478b-9f3d-ed5fa8f32d65,segment=NetworkSegment(a9a93e18-2e77-4f70-840a-1a0145ed66db),segment_id=a9a93e18-2e77-4f70-840a-1a0145ed66db)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:23:50.584267 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:50.622047 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e837719-7367-47e8-8b36-280f613d1905 req-c6c1b615-c090-4187-b49c-599e4bcf3a37 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447137 Dec 09 22:23:50.636872 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=2f35cc66-1533-478b-9f3d-ed5fa8f32d65,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:50.812107 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['2f35cc66-1533-478b-9f3d-ed5fa8f32d65'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:23:51.760777 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a78ab40-e93a-4be6-a7b3-d509255103fa req-3530a496-74bd-4cb9-b212-4f0ed4107907 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:51.762265 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a78ab40-e93a-4be6-a7b3-d509255103fa req-3530a496-74bd-4cb9-b212-4f0ed4107907 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 944 time: 0.0590022 Dec 09 22:23:51.813075 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a78ab40-e93a-4be6-a7b3-d509255103fa req-1058d077-95a2-478c-8640-22cb6671e9d5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445080 Dec 09 22:23:52.399871 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 2f35cc66-1533-478b-9f3d-ed5fa8f32d65 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:23:52.465593 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 2f35cc66-1533-478b-9f3d-ed5fa8f32d65 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:23:52.470608 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 2f35cc66-1533-478b-9f3d-ed5fa8f32d65 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:23:52.470978 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:52.546444 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:52.568864 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fd0def08-070a-4362-9d32-f545e2d642be', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2f35cc66-1533-478b-9f3d-ed5fa8f32d65'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:23:52.571122 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a7243907-5ce8-4cee-be11-3d8235e22920" -d '{"events": [{"server_uuid": "fd0def08-070a-4362-9d32-f545e2d642be", "name": "network-vif-plugged", "status": "completed", "tag": "2f35cc66-1533-478b-9f3d-ed5fa8f32d65"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:23:52.583310 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 2f35cc66-1533-478b-9f3d-ed5fa8f32d65, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=2f35cc66-1533-478b-9f3d-ed5fa8f32d65,segment=NetworkSegment(a9a93e18-2e77-4f70-840a-1a0145ed66db),segment_id=a9a93e18-2e77-4f70-840a-1a0145ed66db)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:23:52.588650 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:52.613826 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:23:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-34b10504-e219-49a6-9c51-7819dacab151 x-openstack-request-id: req-34b10504-e219-49a6-9c51-7819dacab151 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:23:52.614119 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fd0def08-070a-4362-9d32-f545e2d642be", "name": "network-vif-plugged", "status": "completed", "tag": "2f35cc66-1533-478b-9f3d-ed5fa8f32d65", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:23:52.614336 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-34b10504-e219-49a6-9c51-7819dacab151 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:23:52.614744 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fd0def08-070a-4362-9d32-f545e2d642be', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2f35cc66-1533-478b-9f3d-ed5fa8f32d65', 'code': 200} Dec 09 22:23:52.645704 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=2f35cc66-1533-478b-9f3d-ed5fa8f32d65,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:52.713063 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d329e70a-6e73-4af3-a3ac-68cfdf47303c req-bf7339a2-0423-4561-b3ef-1430139f661c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:52.714552 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d329e70a-6e73-4af3-a3ac-68cfdf47303c req-bf7339a2-0423-4561-b3ef-1430139f661c service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 1097 time: 0.0410159 Dec 09 22:23:52.766408 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d329e70a-6e73-4af3-a3ac-68cfdf47303c req-0b05d786-e2a8-40b5-a094-fa6081e5ea1f service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441473 Dec 09 22:23:52.940062 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ac40756-6682-4641-b915-0ed071c93459 req-1383a2af-1be8-4f28-a1ff-8999c5c2f30e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:52.941541 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5ac40756-6682-4641-b915-0ed071c93459 req-1383a2af-1be8-4f28-a1ff-8999c5c2f30e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 945 time: 0.0566280 Dec 09 22:23:52.990731 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5ac40756-6682-4641-b915-0ed071c93459 req-fb59b9a0-04c2-4d57-b32e-c9d6f66172dd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429358 Dec 09 22:23:54.133567 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fc7514b-4a60-4168-b3f3-42b7d96ca03b req-08cb6c18-82ec-4190-9d38-c5a22357062f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:54.135716 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5fc7514b-4a60-4168-b3f3-42b7d96ca03b req-08cb6c18-82ec-4190-9d38-c5a22357062f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 945 time: 0.0609493 Dec 09 22:23:54.186886 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5fc7514b-4a60-4168-b3f3-42b7d96ca03b req-c7f5874a-d3c2-4c5c-8311-de49bc1d0911 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457969 Dec 09 22:23:54.303184 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b753cbef-933e-406c-b3a7-b55b6dd52aff req-fe6b079f-5b1a-496a-ab6f-bd48a9f11bda tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:54.304694 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b753cbef-933e-406c-b3a7-b55b6dd52aff req-fe6b079f-5b1a-496a-ab6f-bd48a9f11bda tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 945 time: 0.0485089 Dec 09 22:23:54.365571 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b753cbef-933e-406c-b3a7-b55b6dd52aff req-5ce5ae71-bdd1-4522-8e04-a5bd2d26d857 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0547059 Dec 09 22:23:54.394747 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34174) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:54.434863 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26f8d581-032b-485d-8225-8f8453c009bf tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:54.436425 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-26f8d581-032b-485d-8225-8f8453c009bf tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 1092 time: 0.0407112 Dec 09 22:23:54.439485 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34176) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:54.443928 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-015fe9fd-14dc-4c4a-b79e-2fe7968aac5f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': '2f35cc66-1533-478b-9f3d-ed5fa8f32d65', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ip_address': '172.20.0.3'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:23:54.468307 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-015fe9fd-14dc-4c4a-b79e-2fe7968aac5f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:54.565773 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-015fe9fd-14dc-4c4a-b79e-2fe7968aac5f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:54.670865 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-015fe9fd-14dc-4c4a-b79e-2fe7968aac5f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Allocated IP 172.25.3.227 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/27258c3e-3ff7-4157-994f-3c3cc1c42c4e) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:23:54.782770 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-015fe9fd-14dc-4c4a-b79e-2fe7968aac5f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:54.821343 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-015fe9fd-14dc-4c4a-b79e-2fe7968aac5f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:54.863867 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-015fe9fd-14dc-4c4a-b79e-2fe7968aac5f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:23:54.870956 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-015fe9fd-14dc-4c4a-b79e-2fe7968aac5f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:23:54.873216 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-015fe9fd-14dc-4c4a-b79e-2fe7968aac5f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=27258c3e-3ff7-4157-994f-3c3cc1c42c4e,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:54.875344 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-015fe9fd-14dc-4c4a-b79e-2fe7968aac5f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:23:55.226244 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-015fe9fd-14dc-4c4a-b79e-2fe7968aac5f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:55.304531 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-015fe9fd-14dc-4c4a-b79e-2fe7968aac5f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:55.483255 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-015fe9fd-14dc-4c4a-b79e-2fe7968aac5f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:55.490568 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-015fe9fd-14dc-4c4a-b79e-2fe7968aac5f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:55.557622 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-015fe9fd-14dc-4c4a-b79e-2fe7968aac5f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=27258c3e-3ff7-4157-994f-3c3cc1c42c4e,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:23:55.567623 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-015fe9fd-14dc-4c4a-b79e-2fe7968aac5f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:55.668220 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-015fe9fd-14dc-4c4a-b79e-2fe7968aac5f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Floating IP 2dd24a2b-65b7-45d3-91de-b4f5a0b1531b associated. External IP: 172.25.3.227, port: 2f35cc66-1533-478b-9f3d-ed5fa8f32d65. Dec 09 22:23:56.190018 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-015fe9fd-14dc-4c4a-b79e-2fe7968aac5f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router 911f7322-871f-498f-b69c-2d9baf55d117 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:23:56.310214 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-015fe9fd-14dc-4c4a-b79e-2fe7968aac5f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:23:56.320389 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81f366dc-f463-478f-9fa6-aa776d3ae259 None None] Sync routers for ids ['911f7322-871f-498f-b69c-2d9baf55d117'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:23:56.329084 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-015fe9fd-14dc-4c4a-b79e-2fe7968aac5f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:56.330516 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81f366dc-f463-478f-9fa6-aa776d3ae259 None None] Routers {'911f7322-871f-498f-b69c-2d9baf55d117'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:23:56.331193 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-81f366dc-f463-478f-9fa6-aa776d3ae259 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:23:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['911f7322-871f-498f-b69c-2d9baf55d117'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:23:56.357178 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-015fe9fd-14dc-4c4a-b79e-2fe7968aac5f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.9166291 Dec 09 22:23:56.357825 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fd0def08-070a-4362-9d32-f545e2d642be', 'tag': '2f35cc66-1533-478b-9f3d-ed5fa8f32d65'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:23:56.360238 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b170a1d6-3eef-4651-8889-80c7b5bfcc5c" -d '{"events": [{"name": "network-changed", "server_uuid": "fd0def08-070a-4362-9d32-f545e2d642be", "tag": "2f35cc66-1533-478b-9f3d-ed5fa8f32d65"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:23:56.439100 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-81f366dc-f463-478f-9fa6-aa776d3ae259 None None] Set router 911f7322-871f-498f-b69c-2d9baf55d117 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:23:56.455525 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-901bd36c-b5f9-4434-8b6e-ae1e1252f5a7 req-707eb8e0-f683-41b4-97a2-ab15033b0c93 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:56.457596 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-901bd36c-b5f9-4434-8b6e-ae1e1252f5a7 req-707eb8e0-f683-41b4-97a2-ab15033b0c93 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 945 time: 0.0498402 Dec 09 22:23:56.509856 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-901bd36c-b5f9-4434-8b6e-ae1e1252f5a7 req-bc2fdcd9-a342-4bbf-ae83-194e670f5a70 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457177 Dec 09 22:23:56.532850 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34182) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:56.557781 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:23:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ae71de09-751c-4015-92cb-0b112de25b37 x-openstack-request-id: req-ae71de09-751c-4015-92cb-0b112de25b37 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:23:56.558084 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fd0def08-070a-4362-9d32-f545e2d642be", "tag": "2f35cc66-1533-478b-9f3d-ed5fa8f32d65", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:23:56.558340 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-ae71de09-751c-4015-92cb-0b112de25b37 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:23:56.558801 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fd0def08-070a-4362-9d32-f545e2d642be', 'tag': '2f35cc66-1533-478b-9f3d-ed5fa8f32d65', 'status': 'completed', 'code': 200} Dec 09 22:23:56.605182 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0dacea72-cd24-41b6-906d-96dc15f05a1c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/floatingips/2dd24a2b-65b7-45d3-91de-b4f5a0b1531b HTTP/1.1" status: 200 len: 991 time: 0.0710671 Dec 09 22:23:56.627346 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b170a1d6-3eef-4651-8889-80c7b5bfcc5c req-a324537d-7b18-4341-b79a-7e4826e68e04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:56.629410 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b170a1d6-3eef-4651-8889-80c7b5bfcc5c req-a324537d-7b18-4341-b79a-7e4826e68e04 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 1097 time: 0.0465856 Dec 09 22:23:56.680248 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-81f366dc-f463-478f-9fa6-aa776d3ae259 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '911f7322-871f-498f-b69c-2d9baf55d117', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1559026721', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150'}], 'enable_snat': True}, 'gw_port_id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:23:38Z', 'updated_at': '2021-12-09T22:23:42Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:eb:cf:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4234, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:23:39Z', 'updated_at': '2021-12-09T22:23:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '2dd24a2b-65b7-45d3-91de-b4f5a0b1531b', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'floating_ip_address': '172.25.3.227', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'port_id': '2f35cc66-1533-478b-9f3d-ed5fa8f32d65', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 4240, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea', 'mac_address': 'fa:16:3e:1b:0f:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fd0def08-070a-4362-9d32-f545e2d642be', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:23:55Z', 'updated_at': '2021-12-09T22:23:55Z', 'revision_number': 0, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b0f2b769-6f50-4bcb-80a1-dd8e7046ca45', 'name': '', 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:32:4c:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'device_owner': 'network:router_interface', 'standard_attr_id': 4237, 'fixed_ips': [{'subnet_id': '8e3240f2-9f05-4035-8fad-ce938f6b5d5b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:23:41Z', 'updated_at': '2021-12-09T22:23:45Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '8e3240f2-9f05-4035-8fad-ce938f6b5d5b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:23:56.706859 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81f366dc-f463-478f-9fa6-aa776d3ae259 None None] Checking router: 911f7322-871f-498f-b69c-2d9baf55d117 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:23:56.715113 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81f366dc-f463-478f-9fa6-aa776d3ae259 None None] Routers {'911f7322-871f-498f-b69c-2d9baf55d117'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:23:56.715768 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-81f366dc-f463-478f-9fa6-aa776d3ae259 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:23:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['911f7322-871f-498f-b69c-2d9baf55d117'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:23:56.721340 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b170a1d6-3eef-4651-8889-80c7b5bfcc5c req-abb8f785-a985-4def-b068-67d7a99e917a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:56.722926 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b170a1d6-3eef-4651-8889-80c7b5bfcc5c req-abb8f785-a985-4def-b068-67d7a99e917a service neutron] 10.222.0.10 "GET /v2.0/networks?id=001ae614-c091-4847-8da3-f38043ef44ea HTTP/1.1" status: 200 len: 895 time: 0.0859773 Dec 09 22:23:56.800153 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b170a1d6-3eef-4651-8889-80c7b5bfcc5c req-1263936e-3169-44b5-b270-5910a8d7ae4a service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=2f35cc66-1533-478b-9f3d-ed5fa8f32d65 HTTP/1.1" status: 200 len: 999 time: 0.0700021 Dec 09 22:23:56.822796 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-81f366dc-f463-478f-9fa6-aa776d3ae259 None None] Set router 911f7322-871f-498f-b69c-2d9baf55d117 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:23:56.855860 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b170a1d6-3eef-4651-8889-80c7b5bfcc5c req-1bd1433b-1861-4beb-a097-75d5ae76e5f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:56.857350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b170a1d6-3eef-4651-8889-80c7b5bfcc5c req-1bd1433b-1861-4beb-a097-75d5ae76e5f4 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=8e3240f2-9f05-4035-8fad-ce938f6b5d5b HTTP/1.1" status: 200 len: 835 time: 0.0500283 Dec 09 22:23:56.904865 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b170a1d6-3eef-4651-8889-80c7b5bfcc5c req-5ea3ac9e-d774-4f9b-92eb-69facc9edf8f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:23:56.906473 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b170a1d6-3eef-4651-8889-80c7b5bfcc5c req-5ea3ac9e-d774-4f9b-92eb-69facc9edf8f service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=001ae614-c091-4847-8da3-f38043ef44ea&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0414658 Dec 09 22:23:57.002910 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b170a1d6-3eef-4651-8889-80c7b5bfcc5c req-130a757f-e51a-48ff-8fa5-8596e89f880a service neutron] 10.222.0.10 "GET /v2.0/networks/001ae614-c091-4847-8da3-f38043ef44ea?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0875721 Dec 09 22:23:57.056906 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-81f366dc-f463-478f-9fa6-aa776d3ae259 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '911f7322-871f-498f-b69c-2d9baf55d117', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1559026721', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150'}], 'enable_snat': True}, 'gw_port_id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:23:38Z', 'updated_at': '2021-12-09T22:23:42Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:eb:cf:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4234, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:23:39Z', 'updated_at': '2021-12-09T22:23:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '2dd24a2b-65b7-45d3-91de-b4f5a0b1531b', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'floating_ip_address': '172.25.3.227', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'port_id': '2f35cc66-1533-478b-9f3d-ed5fa8f32d65', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 4240, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea', 'mac_address': 'fa:16:3e:1b:0f:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fd0def08-070a-4362-9d32-f545e2d642be', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:23:55Z', 'updated_at': '2021-12-09T22:23:55Z', 'revision_number': 0, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b0f2b769-6f50-4bcb-80a1-dd8e7046ca45', 'name': '', 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:32:4c:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'device_owner': 'network:router_interface', 'standard_attr_id': 4237, 'fixed_ips': [{'subnet_id': '8e3240f2-9f05-4035-8fad-ce938f6b5d5b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:23:41Z', 'updated_at': '2021-12-09T22:23:45Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '8e3240f2-9f05-4035-8fad-ce938f6b5d5b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:23:57.083252 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81f366dc-f463-478f-9fa6-aa776d3ae259 None None] The sync data for ids ['911f7322-871f-498f-b69c-2d9baf55d117'] in n-d-713301-27 is: [{'id': '911f7322-871f-498f-b69c-2d9baf55d117', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1559026721', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150'}], 'enable_snat': True}, 'gw_port_id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:23:38Z', 'updated_at': '2021-12-09T22:23:42Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:eb:cf:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4234, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:23:39Z', 'updated_at': '2021-12-09T22:23:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '2dd24a2b-65b7-45d3-91de-b4f5a0b1531b', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'floating_ip_address': '172.25.3.227', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'port_id': '2f35cc66-1533-478b-9f3d-ed5fa8f32d65', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 4240, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea', 'mac_address': 'fa:16:3e:1b:0f:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fd0def08-070a-4362-9d32-f545e2d642be', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:23:55Z', 'updated_at': '2021-12-09T22:23:55Z', 'revision_number': 0, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b0f2b769-6f50-4bcb-80a1-dd8e7046ca45', 'name': '', 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:32:4c:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'device_owner': 'network:router_interface', 'standard_attr_id': 4237, 'fixed_ips': [{'subnet_id': '8e3240f2-9f05-4035-8fad-ce938f6b5d5b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:23:41Z', 'updated_at': '2021-12-09T22:23:45Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '8e3240f2-9f05-4035-8fad-ce938f6b5d5b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:23:57.098099 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b170a1d6-3eef-4651-8889-80c7b5bfcc5c req-0fa37cab-31e7-4cbb-879d-5e8bf8373bc5 service neutron] 10.222.0.10 "GET /v2.0/networks/001ae614-c091-4847-8da3-f38043ef44ea?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0880444 Dec 09 22:23:57.298237 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd1763e2-40d4-430e-ad4d-14e8c50f58d4 None None] New status for floating IP 2dd24a2b-65b7-45d3-91de-b4f5a0b1531b: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:23:57.610217 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34184) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:23:57.680181 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f43aa691-ff8d-4e93-a13c-2f1703de9fef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/floatingips/2dd24a2b-65b7-45d3-91de-b4f5a0b1531b HTTP/1.1" status: 200 len: 993 time: 0.0686529 Dec 09 22:23:57.695700 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:23:57.789648 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:24:03.048408 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1e490ded-8661-408c-b5ff-ffe30dd43f2e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:24:03.843307 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f9d259c-9d1e-46ca-9785-dbe0a7057adf req-293019df-1389-47c6-8dd8-8572298f0716 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0468829 Dec 09 22:24:03.928981 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f9d259c-9d1e-46ca-9785-dbe0a7057adf req-153c26c5-5968-4056-9a33-2abad2c7b309 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:24:03.930504 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f9d259c-9d1e-46ca-9785-dbe0a7057adf req-153c26c5-5968-4056-9a33-2abad2c7b309 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 1097 time: 0.0431557 Dec 09 22:24:04.037988 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f9d259c-9d1e-46ca-9785-dbe0a7057adf req-1c46df4e-1913-4a16-bb26-08eb9ae66e08 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:24:04.039868 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f9d259c-9d1e-46ca-9785-dbe0a7057adf req-1c46df4e-1913-4a16-bb26-08eb9ae66e08 service neutron] 10.222.0.10 "GET /v2.0/networks?id=001ae614-c091-4847-8da3-f38043ef44ea HTTP/1.1" status: 200 len: 895 time: 0.0894041 Dec 09 22:24:04.108793 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f9d259c-9d1e-46ca-9785-dbe0a7057adf req-30f9f2b4-4112-4593-98cf-b02d19e355ce service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=2f35cc66-1533-478b-9f3d-ed5fa8f32d65 HTTP/1.1" status: 200 len: 1001 time: 0.0613346 Dec 09 22:24:04.159595 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f9d259c-9d1e-46ca-9785-dbe0a7057adf req-0ed7032d-5b80-4c78-9d69-70c2a1d7f810 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:24:04.161053 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f9d259c-9d1e-46ca-9785-dbe0a7057adf req-0ed7032d-5b80-4c78-9d69-70c2a1d7f810 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=8e3240f2-9f05-4035-8fad-ce938f6b5d5b HTTP/1.1" status: 200 len: 835 time: 0.0442486 Dec 09 22:24:04.210378 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f9d259c-9d1e-46ca-9785-dbe0a7057adf req-d5c2f876-42c1-427a-983f-08afa61d15b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:24:04.211903 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f9d259c-9d1e-46ca-9785-dbe0a7057adf req-d5c2f876-42c1-427a-983f-08afa61d15b4 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=001ae614-c091-4847-8da3-f38043ef44ea&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0440981 Dec 09 22:24:04.303876 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f9d259c-9d1e-46ca-9785-dbe0a7057adf req-daf86408-a1ee-4816-a6f5-964390344089 service neutron] 10.222.0.10 "GET /v2.0/networks/001ae614-c091-4847-8da3-f38043ef44ea?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0847518 Dec 09 22:24:04.400896 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5f9d259c-9d1e-46ca-9785-dbe0a7057adf req-a301a215-56b8-4ad5-bf3b-235063cc9c40 service neutron] 10.222.0.10 "GET /v2.0/networks/001ae614-c091-4847-8da3-f38043ef44ea?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0901086 Dec 09 22:24:05.681401 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5805bf63-f455-4a63-828b-7577dc469033 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:24:06.876151 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:24:08.227183 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:24:09.703286 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:24:27.323207 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:24:27.704128 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:24:27.788765 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:24:29.188626 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b9e6e0-73f9-4093-80f1-fd08b8b65d41 req-55849dc2-3a4b-435b-9a27-28a9dcfede2f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:24:29.190148 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31b9e6e0-73f9-4093-80f1-fd08b8b65d41 req-55849dc2-3a4b-435b-9a27-28a9dcfede2f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 945 time: 0.0781367 Dec 09 22:24:29.192854 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2168ab6f-90cd-4c99-9aa6-8c76b389c4a8 req-8b73eec8-da4d-4ef1-8d10-4e23bee93b48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:24:29.194238 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2168ab6f-90cd-4c99-9aa6-8c76b389c4a8 req-8b73eec8-da4d-4ef1-8d10-4e23bee93b48 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 1097 time: 0.0708473 Dec 09 22:24:29.299367 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-31b9e6e0-73f9-4093-80f1-fd08b8b65d41 req-985676e4-a02d-42fc-a1db-3890587d1228 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1030252 Dec 09 22:24:29.319376 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2168ab6f-90cd-4c99-9aa6-8c76b389c4a8 req-72678960-e6db-4edd-8e28-cde496755073 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:24:29.320880 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2168ab6f-90cd-4c99-9aa6-8c76b389c4a8 req-72678960-e6db-4edd-8e28-cde496755073 service neutron] 10.222.0.10 "GET /v2.0/networks?id=001ae614-c091-4847-8da3-f38043ef44ea HTTP/1.1" status: 200 len: 895 time: 0.1186879 Dec 09 22:24:29.391676 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2168ab6f-90cd-4c99-9aa6-8c76b389c4a8 req-a85eff28-8483-4906-8321-5c08d81d94ac service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=2f35cc66-1533-478b-9f3d-ed5fa8f32d65 HTTP/1.1" status: 200 len: 1001 time: 0.0633557 Dec 09 22:24:29.447104 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2168ab6f-90cd-4c99-9aa6-8c76b389c4a8 req-0280327f-088c-48a6-a491-f00732a6ac8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:24:29.449199 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2168ab6f-90cd-4c99-9aa6-8c76b389c4a8 req-0280327f-088c-48a6-a491-f00732a6ac8e service neutron] 10.222.0.10 "GET /v2.0/subnets?id=8e3240f2-9f05-4035-8fad-ce938f6b5d5b HTTP/1.1" status: 200 len: 835 time: 0.0486801 Dec 09 22:24:29.497148 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2168ab6f-90cd-4c99-9aa6-8c76b389c4a8 req-20162dec-1a63-4622-9aae-cc119a766045 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:24:29.498644 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2168ab6f-90cd-4c99-9aa6-8c76b389c4a8 req-20162dec-1a63-4622-9aae-cc119a766045 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=001ae614-c091-4847-8da3-f38043ef44ea&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0421762 Dec 09 22:24:29.593944 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2168ab6f-90cd-4c99-9aa6-8c76b389c4a8 req-e1e950da-3ffd-45cc-a9a8-55071247da87 service neutron] 10.222.0.10 "GET /v2.0/networks/001ae614-c091-4847-8da3-f38043ef44ea?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0873559 Dec 09 22:24:29.688200 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2168ab6f-90cd-4c99-9aa6-8c76b389c4a8 req-402d7e98-c31e-4280-9000-d85ee07d0074 service neutron] 10.222.0.10 "GET /v2.0/networks/001ae614-c091-4847-8da3-f38043ef44ea?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0866671 Dec 09 22:24:30.425938 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77b61044-02e8-4907-893b-83cbfbae66c5 req-f47b52d4-07ef-4098-909b-a607acf30773 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:24:30.427468 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-77b61044-02e8-4907-893b-83cbfbae66c5 req-f47b52d4-07ef-4098-909b-a607acf30773 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 945 time: 0.0562370 Dec 09 22:24:30.482638 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-77b61044-02e8-4907-893b-83cbfbae66c5 req-75143d60-8d92-4366-9522-070ecec45cbe tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0490201 Dec 09 22:24:31.617751 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94efaa23-eb95-4174-8996-e86564afcc0a req-961108dc-16a8-4872-98b7-89d84477ae7e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:24:31.619252 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94efaa23-eb95-4174-8996-e86564afcc0a req-961108dc-16a8-4872-98b7-89d84477ae7e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 945 time: 0.0518787 Dec 09 22:24:31.671220 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-94efaa23-eb95-4174-8996-e86564afcc0a req-690b27e9-b101-4d73-a2ec-b658e67fcac4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445788 Dec 09 22:24:32.820923 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7faaede5-0ca1-40f6-b8d7-823618dc6784 req-46fdbd39-e895-4f80-b533-102cc5d70b5e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:24:32.822456 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7faaede5-0ca1-40f6-b8d7-823618dc6784 req-46fdbd39-e895-4f80-b533-102cc5d70b5e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 945 time: 0.0576046 Dec 09 22:24:32.876260 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7faaede5-0ca1-40f6-b8d7-823618dc6784 req-a2e00820-2473-4cc6-b4cf-90158bd43e22 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0474026 Dec 09 22:24:33.036133 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0952d28b-6901-4277-8fad-7937e2814ddc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:24:34.006907 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-730b5ce6-52cd-4b13-9c40-3709cc91f0ba req-3aae0963-240b-446c-bb91-048173a9d98d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:24:34.008448 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-730b5ce6-52cd-4b13-9c40-3709cc91f0ba req-3aae0963-240b-446c-bb91-048173a9d98d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 945 time: 0.0538044 Dec 09 22:24:34.058355 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-730b5ce6-52cd-4b13-9c40-3709cc91f0ba req-3bfb7073-3c15-4da3-8173-a2551f5318b7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430892 Dec 09 22:24:35.191285 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1ca2fce-4485-49b9-91d3-646366fe6fdf req-329581de-2856-4248-9f12-231897a41e78 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:24:35.192836 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f1ca2fce-4485-49b9-91d3-646366fe6fdf req-329581de-2856-4248-9f12-231897a41e78 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 945 time: 0.0544839 Dec 09 22:24:35.253239 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f1ca2fce-4485-49b9-91d3-646366fe6fdf req-acf4dd28-d377-4df4-a448-03699e75b991 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0509930 Dec 09 22:24:35.675624 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-711152cf-c182-47a2-b892-68e9a6200b95 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:24:36.388562 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a4bbad9-7f94-42b7-8593-28a50bd7ec37 req-2e81de7b-2101-40d4-84ed-b19f7fa6441f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:24:36.390080 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5a4bbad9-7f94-42b7-8593-28a50bd7ec37 req-2e81de7b-2101-40d4-84ed-b19f7fa6441f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 945 time: 0.0560696 Dec 09 22:24:36.444510 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5a4bbad9-7f94-42b7-8593-28a50bd7ec37 req-7b720373-bb5f-4b40-a341-5a5828531705 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453134 Dec 09 22:24:36.879356 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:24:37.571815 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e40d7d7e-0cf6-43b5-af29-12fd44f8c6e7 req-c41379dc-4428-43ed-9b6c-f97f95884e2d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:24:37.573337 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e40d7d7e-0cf6-43b5-af29-12fd44f8c6e7 req-c41379dc-4428-43ed-9b6c-f97f95884e2d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 945 time: 0.0510199 Dec 09 22:24:37.627592 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e40d7d7e-0cf6-43b5-af29-12fd44f8c6e7 req-1607d9fb-2881-4545-bb5e-2cc9d5e4208b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450630 Dec 09 22:24:38.228802 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:24:38.763998 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d84fef47-f05f-4b3b-91d8-f96682f998f6 req-03307f31-6c37-489a-8db8-856d06ea87d9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:24:38.765475 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d84fef47-f05f-4b3b-91d8-f96682f998f6 req-03307f31-6c37-489a-8db8-856d06ea87d9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 945 time: 0.0522957 Dec 09 22:24:38.826816 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d84fef47-f05f-4b3b-91d8-f96682f998f6 req-24195dd7-d873-4434-ab1e-a802e2ffebc6 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0545449 Dec 09 22:24:39.704767 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:24:39.953322 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e62848de-e476-426f-b67c-a5a140e4888e req-f02ed25f-b779-4031-934c-a85403d7a8f5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:24:39.955323 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e62848de-e476-426f-b67c-a5a140e4888e req-f02ed25f-b779-4031-934c-a85403d7a8f5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 945 time: 0.0586367 Dec 09 22:24:40.010434 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e62848de-e476-426f-b67c-a5a140e4888e req-ae764001-929a-4958-abd6-bbc83e7051f9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0490246 Dec 09 22:24:41.143546 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9efbbc2-e708-4dbd-bcc7-216037db6103 req-e2d35226-77df-4507-946a-eec9508c9e4b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:24:41.145027 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e9efbbc2-e708-4dbd-bcc7-216037db6103 req-e2d35226-77df-4507-946a-eec9508c9e4b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 945 time: 0.0551286 Dec 09 22:24:41.194855 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e9efbbc2-e708-4dbd-bcc7-216037db6103 req-81b472fc-ee83-44c7-a31d-104c66a4bbbb tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437088 Dec 09 22:24:42.337635 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7296639-6942-470c-b343-a39b38c7e084 req-9802d7f5-83b4-4c25-bdf6-875060e54c0e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:24:42.339153 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c7296639-6942-470c-b343-a39b38c7e084 req-9802d7f5-83b4-4c25-bdf6-875060e54c0e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 945 time: 0.0661068 Dec 09 22:24:42.401473 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c7296639-6942-470c-b343-a39b38c7e084 req-ffcb0155-4d6d-4324-9643-e66ce727373f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0534041 Dec 09 22:24:43.524764 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-626f15bb-3e63-449c-971f-bb641e8e93fc req-0638bac1-a11a-4812-8cfc-7c0244fc3411 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:24:43.526276 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-626f15bb-3e63-449c-971f-bb641e8e93fc req-0638bac1-a11a-4812-8cfc-7c0244fc3411 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 945 time: 0.0523710 Dec 09 22:24:43.579744 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-626f15bb-3e63-449c-971f-bb641e8e93fc req-f346e148-6176-4f27-acba-18b78e002fa5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449932 Dec 09 22:24:44.718033 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bbf8517-321c-49b2-9b5c-ef41936dcfd3 req-e088afe9-a6b4-40c4-840b-429e5bec0073 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:24:44.719669 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1bbf8517-321c-49b2-9b5c-ef41936dcfd3 req-e088afe9-a6b4-40c4-840b-429e5bec0073 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 945 time: 0.0592551 Dec 09 22:24:44.783701 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1bbf8517-321c-49b2-9b5c-ef41936dcfd3 req-323242d4-745f-485b-9b97-e4b8efff5274 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0561199 Dec 09 22:24:45.911686 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-043aaceb-7457-4cc8-8790-f3fb2d5104b8 req-4ff8fd05-2d3a-4988-828a-a8a639943bb2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:24:45.913229 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-043aaceb-7457-4cc8-8790-f3fb2d5104b8 req-4ff8fd05-2d3a-4988-828a-a8a639943bb2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 945 time: 0.0535269 Dec 09 22:24:45.967511 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-043aaceb-7457-4cc8-8790-f3fb2d5104b8 req-199e785c-4e2f-468e-a534-fa0194c73449 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463893 Dec 09 22:24:45.990409 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34230) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:24:46.059918 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-19a40ac1-101f-433e-af43-9a9e6535ad5e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/floatingips/2dd24a2b-65b7-45d3-91de-b4f5a0b1531b HTTP/1.1" status: 200 len: 993 time: 0.0682733 Dec 09 22:24:57.703681 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:24:57.802797 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:03.040371 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7a1c5a7f-5f5c-4984-ac3f-d7bd5fd00954 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:04.324576 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:25:04.851073 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60428a00-3c24-4d19-8462-aee6c757483c req-d5ac150c-e7f2-4e15-a74c-67b4f0125c8f service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0421951 Dec 09 22:25:04.945849 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60428a00-3c24-4d19-8462-aee6c757483c req-695d9a4d-ac34-4c0e-a7e9-7e378a76adab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:04.947379 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60428a00-3c24-4d19-8462-aee6c757483c req-695d9a4d-ac34-4c0e-a7e9-7e378a76adab service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 1097 time: 0.0472782 Dec 09 22:25:05.052061 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60428a00-3c24-4d19-8462-aee6c757483c req-2a56f2c4-6a40-4672-8042-66c0834e48e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:05.053522 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60428a00-3c24-4d19-8462-aee6c757483c req-2a56f2c4-6a40-4672-8042-66c0834e48e0 service neutron] 10.222.0.10 "GET /v2.0/networks?id=001ae614-c091-4847-8da3-f38043ef44ea HTTP/1.1" status: 200 len: 895 time: 0.0845180 Dec 09 22:25:05.123106 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60428a00-3c24-4d19-8462-aee6c757483c req-5fbed818-0e71-42cb-b4ac-a6a784087c96 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=2f35cc66-1533-478b-9f3d-ed5fa8f32d65 HTTP/1.1" status: 200 len: 1001 time: 0.0618532 Dec 09 22:25:05.178860 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60428a00-3c24-4d19-8462-aee6c757483c req-847585b4-4e1a-4376-b00e-b510a8da5c7b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:05.180445 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60428a00-3c24-4d19-8462-aee6c757483c req-847585b4-4e1a-4376-b00e-b510a8da5c7b service neutron] 10.222.0.10 "GET /v2.0/subnets?id=8e3240f2-9f05-4035-8fad-ce938f6b5d5b HTTP/1.1" status: 200 len: 835 time: 0.0504010 Dec 09 22:25:05.230992 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60428a00-3c24-4d19-8462-aee6c757483c req-04df6f34-1abf-4b37-b673-b56184f7b293 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:05.232610 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60428a00-3c24-4d19-8462-aee6c757483c req-04df6f34-1abf-4b37-b673-b56184f7b293 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=001ae614-c091-4847-8da3-f38043ef44ea&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0438411 Dec 09 22:25:05.328754 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60428a00-3c24-4d19-8462-aee6c757483c req-7879265f-4f3e-4fee-80b5-0d36a460dfaf service neutron] 10.222.0.10 "GET /v2.0/networks/001ae614-c091-4847-8da3-f38043ef44ea?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0881689 Dec 09 22:25:05.437299 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60428a00-3c24-4d19-8462-aee6c757483c req-2453a5de-016e-49c7-9db7-14f65f25ae22 service neutron] 10.222.0.10 "GET /v2.0/networks/001ae614-c091-4847-8da3-f38043ef44ea?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1008008 Dec 09 22:25:05.680715 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ac6ba69b-228f-4bc3-88cc-c0f02bf652a6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:06.882423 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:08.227500 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:09.712622 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:16.547403 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34244) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:16.714548 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting port 27258c3e-3ff7-4157-994f-3c3cc1c42c4e {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:25:16.715121 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:16.794006 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:16.794725 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:16.807825 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Calling delete_port for 27258c3e-3ff7-4157-994f-3c3cc1c42c4e owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:25:16.980321 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:17.009481 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Port': ['ID=27258c3e-3ff7-4157-994f-3c3cc1c42c4e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:17.032152 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:17.032501 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:17.032841 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:17.033175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:17.033500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:17.033827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:17.034153 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:17.034483 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:17.034806 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:17.035128 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:17.035470 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:17.035779 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:17.036074 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:17.079090 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:17.079424 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Floating IP 2dd24a2b-65b7-45d3-91de-b4f5a0b1531b disassociated (deleted). External IP: 172.25.3.227, port: 2f35cc66-1533-478b-9f3d-ed5fa8f32d65. Dec 09 22:25:17.295825 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router 911f7322-871f-498f-b69c-2d9baf55d117 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:25:17.406092 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:25:17.411056 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:17.418009 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e36118e-cc9a-4727-b47f-73cef528e554 None None] Sync routers for ids ['911f7322-871f-498f-b69c-2d9baf55d117'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:25:17.428606 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e36118e-cc9a-4727-b47f-73cef528e554 None None] Routers {'911f7322-871f-498f-b69c-2d9baf55d117'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:25:17.429216 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-9e36118e-cc9a-4727-b47f-73cef528e554 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:25:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['911f7322-871f-498f-b69c-2d9baf55d117'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:25:17.440214 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-79605075-a524-46bb-99f4-dcf79826db2b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/floatingips/2dd24a2b-65b7-45d3-91de-b4f5a0b1531b HTTP/1.1" status: 204 len: 168 time: 0.8916261 Dec 09 22:25:17.440818 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fd0def08-070a-4362-9d32-f545e2d642be', 'tag': '2f35cc66-1533-478b-9f3d-ed5fa8f32d65'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:25:17.443277 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f4506a13-6ecb-4f27-90dc-5a4ed72f4ed3" -d '{"events": [{"name": "network-changed", "server_uuid": "fd0def08-070a-4362-9d32-f545e2d642be", "tag": "2f35cc66-1533-478b-9f3d-ed5fa8f32d65"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:25:17.533549 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-9e36118e-cc9a-4727-b47f-73cef528e554 None None] Set router 911f7322-871f-498f-b69c-2d9baf55d117 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:25:17.604901 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:25:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-07baf9ec-28e6-49d2-a911-586e076713ab x-openstack-request-id: req-07baf9ec-28e6-49d2-a911-586e076713ab {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:25:17.605413 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fd0def08-070a-4362-9d32-f545e2d642be", "tag": "2f35cc66-1533-478b-9f3d-ed5fa8f32d65", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:25:17.605690 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-07baf9ec-28e6-49d2-a911-586e076713ab {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:25:17.606111 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fd0def08-070a-4362-9d32-f545e2d642be', 'tag': '2f35cc66-1533-478b-9f3d-ed5fa8f32d65', 'status': 'completed', 'code': 200} Dec 09 22:25:17.701843 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4506a13-6ecb-4f27-90dc-5a4ed72f4ed3 req-30c99909-fed7-4e76-bb27-5c0eea451579 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:17.703519 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4506a13-6ecb-4f27-90dc-5a4ed72f4ed3 req-30c99909-fed7-4e76-bb27-5c0eea451579 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 1097 time: 0.0730515 Dec 09 22:25:17.718142 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0a906a0-48a3-4f6e-aee2-5cde6cd8b5af req-0f92ec14-5828-4d06-bbb3-c8af1b2172d1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:17.720012 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0a906a0-48a3-4f6e-aee2-5cde6cd8b5af req-0f92ec14-5828-4d06-bbb3-c8af1b2172d1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 945 time: 0.0639465 Dec 09 22:25:17.824022 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0a906a0-48a3-4f6e-aee2-5cde6cd8b5af req-8c4aef8a-18a0-4276-a38c-3a41e8628e8c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0960515 Dec 09 22:25:17.833058 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-9e36118e-cc9a-4727-b47f-73cef528e554 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '911f7322-871f-498f-b69c-2d9baf55d117', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1559026721', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150'}], 'enable_snat': True}, 'gw_port_id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:23:38Z', 'updated_at': '2021-12-09T22:23:42Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:eb:cf:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4234, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:23:39Z', 'updated_at': '2021-12-09T22:23:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'b0f2b769-6f50-4bcb-80a1-dd8e7046ca45', 'name': '', 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:32:4c:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'device_owner': 'network:router_interface', 'standard_attr_id': 4237, 'fixed_ips': [{'subnet_id': '8e3240f2-9f05-4035-8fad-ce938f6b5d5b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:23:41Z', 'updated_at': '2021-12-09T22:23:45Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '8e3240f2-9f05-4035-8fad-ce938f6b5d5b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:25:17.851201 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4506a13-6ecb-4f27-90dc-5a4ed72f4ed3 req-e60563f3-0499-4f3a-942d-60722c695636 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:17.852740 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4506a13-6ecb-4f27-90dc-5a4ed72f4ed3 req-e60563f3-0499-4f3a-942d-60722c695636 service neutron] 10.222.0.10 "GET /v2.0/networks?id=001ae614-c091-4847-8da3-f38043ef44ea HTTP/1.1" status: 200 len: 895 time: 0.1322572 Dec 09 22:25:17.862449 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e36118e-cc9a-4727-b47f-73cef528e554 None None] Checking router: 911f7322-871f-498f-b69c-2d9baf55d117 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:25:17.871576 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e36118e-cc9a-4727-b47f-73cef528e554 None None] Routers {'911f7322-871f-498f-b69c-2d9baf55d117'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:25:17.872193 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-9e36118e-cc9a-4727-b47f-73cef528e554 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:25:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['911f7322-871f-498f-b69c-2d9baf55d117'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:25:17.896108 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4506a13-6ecb-4f27-90dc-5a4ed72f4ed3 req-babab6fe-8251-4095-89c1-3d971bf52c01 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=2f35cc66-1533-478b-9f3d-ed5fa8f32d65 HTTP/1.1" status: 200 len: 217 time: 0.0354526 Dec 09 22:25:17.947838 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4506a13-6ecb-4f27-90dc-5a4ed72f4ed3 req-e8de157b-c750-41ee-b5e9-8587350e0745 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:17.949676 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4506a13-6ecb-4f27-90dc-5a4ed72f4ed3 req-e8de157b-c750-41ee-b5e9-8587350e0745 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=8e3240f2-9f05-4035-8fad-ce938f6b5d5b HTTP/1.1" status: 200 len: 835 time: 0.0456004 Dec 09 22:25:17.985264 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-9e36118e-cc9a-4727-b47f-73cef528e554 None None] Set router 911f7322-871f-498f-b69c-2d9baf55d117 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:25:18.000513 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4506a13-6ecb-4f27-90dc-5a4ed72f4ed3 req-8b3652c2-ea85-4817-83d9-68f0b4742321 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:18.002015 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4506a13-6ecb-4f27-90dc-5a4ed72f4ed3 req-8b3652c2-ea85-4817-83d9-68f0b4742321 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=001ae614-c091-4847-8da3-f38043ef44ea&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0442994 Dec 09 22:25:18.098226 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4506a13-6ecb-4f27-90dc-5a4ed72f4ed3 req-5442e68c-63ca-4343-bfc0-62f783449ef3 service neutron] 10.222.0.10 "GET /v2.0/networks/001ae614-c091-4847-8da3-f38043ef44ea?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0857208 Dec 09 22:25:18.188563 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-9e36118e-cc9a-4727-b47f-73cef528e554 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '911f7322-871f-498f-b69c-2d9baf55d117', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1559026721', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150'}], 'enable_snat': True}, 'gw_port_id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:23:38Z', 'updated_at': '2021-12-09T22:23:42Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:eb:cf:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4234, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:23:39Z', 'updated_at': '2021-12-09T22:23:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'b0f2b769-6f50-4bcb-80a1-dd8e7046ca45', 'name': '', 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:32:4c:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'device_owner': 'network:router_interface', 'standard_attr_id': 4237, 'fixed_ips': [{'subnet_id': '8e3240f2-9f05-4035-8fad-ce938f6b5d5b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:23:41Z', 'updated_at': '2021-12-09T22:23:45Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '8e3240f2-9f05-4035-8fad-ce938f6b5d5b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:25:18.215620 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e36118e-cc9a-4727-b47f-73cef528e554 None None] The sync data for ids ['911f7322-871f-498f-b69c-2d9baf55d117'] in n-d-713301-27 is: [{'id': '911f7322-871f-498f-b69c-2d9baf55d117', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1559026721', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150'}], 'enable_snat': True}, 'gw_port_id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:23:38Z', 'updated_at': '2021-12-09T22:23:42Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:eb:cf:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4234, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:23:39Z', 'updated_at': '2021-12-09T22:23:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'b0f2b769-6f50-4bcb-80a1-dd8e7046ca45', 'name': '', 'network_id': '001ae614-c091-4847-8da3-f38043ef44ea', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:32:4c:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'device_owner': 'network:router_interface', 'standard_attr_id': 4237, 'fixed_ips': [{'subnet_id': '8e3240f2-9f05-4035-8fad-ce938f6b5d5b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:23:41Z', 'updated_at': '2021-12-09T22:23:45Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '8e3240f2-9f05-4035-8fad-ce938f6b5d5b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:25:18.488582 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-966a0112-b83d-4b3e-ba4d-f476580be3c5 None None] New status for floating IP 2dd24a2b-65b7-45d3-91de-b4f5a0b1531b: DOWN {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:25:18.508579 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4506a13-6ecb-4f27-90dc-5a4ed72f4ed3 req-793eadd6-3431-4889-ab5b-a9011f84a332 service neutron] 10.222.0.10 "GET /v2.0/networks/001ae614-c091-4847-8da3-f38043ef44ea?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4032981 Dec 09 22:25:18.957129 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ec0b5db-7b53-4766-b7f9-e79ec613f4ce req-e7d6b126-6ce5-4800-afee-6b1b7e4953b0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:18.958638 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ec0b5db-7b53-4766-b7f9-e79ec613f4ce req-e7d6b126-6ce5-4800-afee-6b1b7e4953b0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 945 time: 0.0562711 Dec 09 22:25:19.011301 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2ec0b5db-7b53-4766-b7f9-e79ec613f4ce req-745dc9d7-6089-4cf2-bf33-75026cfbde0c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441799 Dec 09 22:25:19.109577 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fef890e6-dd66-4836-aeb3-1852672d9bd3 req-ef414ecf-bae1-4003-97a5-31f3b6ebf353 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:19.111140 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fef890e6-dd66-4836-aeb3-1852672d9bd3 req-ef414ecf-bae1-4003-97a5-31f3b6ebf353 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.10 "GET /v2.0/ports?device_id=fd0def08-070a-4362-9d32-f545e2d642be HTTP/1.1" status: 200 len: 945 time: 0.0580792 Dec 09 22:25:19.212684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-fef890e6-dd66-4836-aeb3-1852672d9bd3 req-71422fb5-14c6-40d5-b879-85bfc41a226f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting port 2f35cc66-1533-478b-9f3d-ed5fa8f32d65 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:25:19.212998 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fef890e6-dd66-4836-aeb3-1852672d9bd3 req-71422fb5-14c6-40d5-b879-85bfc41a226f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:19.302831 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-fef890e6-dd66-4836-aeb3-1852672d9bd3 req-71422fb5-14c6-40d5-b879-85bfc41a226f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] For port 2f35cc66-1533-478b-9f3d-ed5fa8f32d65, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=2f35cc66-1533-478b-9f3d-ed5fa8f32d65,segment=NetworkSegment(a9a93e18-2e77-4f70-840a-1a0145ed66db),segment_id=a9a93e18-2e77-4f70-840a-1a0145ed66db)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:25:19.303195 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fef890e6-dd66-4836-aeb3-1852672d9bd3 req-71422fb5-14c6-40d5-b879-85bfc41a226f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:19.315979 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-fef890e6-dd66-4836-aeb3-1852672d9bd3 req-71422fb5-14c6-40d5-b879-85bfc41a226f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Calling delete_port for 2f35cc66-1533-478b-9f3d-ed5fa8f32d65 owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:25:19.452562 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fef890e6-dd66-4836-aeb3-1852672d9bd3 req-71422fb5-14c6-40d5-b879-85bfc41a226f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:19.483890 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71422fb5-14c6-40d5-b879-85bfc41a226f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Port': ['ID=2f35cc66-1533-478b-9f3d-ed5fa8f32d65,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:19.529892 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-fef890e6-dd66-4836-aeb3-1852672d9bd3 req-71422fb5-14c6-40d5-b879-85bfc41a226f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] No DVR routers for this DVR port 2f35cc66-1533-478b-9f3d-ed5fa8f32d65 on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:25:19.533210 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-fef890e6-dd66-4836-aeb3-1852672d9bd3 req-71422fb5-14c6-40d5-b879-85bfc41a226f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:19.538380 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fef890e6-dd66-4836-aeb3-1852672d9bd3 req-71422fb5-14c6-40d5-b879-85bfc41a226f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.10 "DELETE /v2.0/ports/2f35cc66-1533-478b-9f3d-ed5fa8f32d65 HTTP/1.1" status: 204 len: 173 time: 0.4206035 Dec 09 22:25:19.607484 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fd0def08-070a-4362-9d32-f545e2d642be', 'name': 'network-vif-deleted', 'tag': '2f35cc66-1533-478b-9f3d-ed5fa8f32d65'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:25:19.609886 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-79264e0c-a794-41b6-9f4b-d40acd5adae0" -d '{"events": [{"server_uuid": "fd0def08-070a-4362-9d32-f545e2d642be", "name": "network-vif-deleted", "tag": "2f35cc66-1533-478b-9f3d-ed5fa8f32d65"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:25:19.645722 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:25:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c3103e9f-dcbe-4bce-8c61-8e302783c47d x-openstack-request-id: req-c3103e9f-dcbe-4bce-8c61-8e302783c47d {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:25:19.646009 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fd0def08-070a-4362-9d32-f545e2d642be", "name": "network-vif-deleted", "tag": "2f35cc66-1533-478b-9f3d-ed5fa8f32d65", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:25:19.646255 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c3103e9f-dcbe-4bce-8c61-8e302783c47d {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:25:19.646655 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fd0def08-070a-4362-9d32-f545e2d642be', 'name': 'network-vif-deleted', 'tag': '2f35cc66-1533-478b-9f3d-ed5fa8f32d65', 'status': 'completed', 'code': 200} Dec 09 22:25:20.073202 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34258) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:20.433144 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:20.707016 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting port b0f2b769-6f50-4bcb-80a1-dd8e7046ca45 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:25:20.707363 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:20.801714 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] For port b0f2b769-6f50-4bcb-80a1-dd8e7046ca45, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=b0f2b769-6f50-4bcb-80a1-dd8e7046ca45,segment=NetworkSegment(a9a93e18-2e77-4f70-840a-1a0145ed66db),segment_id=a9a93e18-2e77-4f70-840a-1a0145ed66db)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:25:20.802087 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:20.814168 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Calling delete_port for b0f2b769-6f50-4bcb-80a1-dd8e7046ca45 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:25:21.004751 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:21.048457 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Port': ['ID=b0f2b769-6f50-4bcb-80a1-dd8e7046ca45,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:21.061327 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:21.061722 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:21.062021 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:21.062355 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:21.062662 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:21.063003 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:21.063335 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:21.063695 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:21.064016 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:21.064352 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:21.064676 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:21.065116 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:21.066038 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:21.246722 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:21.467268 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router 911f7322-871f-498f-b69c-2d9baf55d117 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:25:21.576316 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:25:21.581490 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-90c65bd1-775b-4d09-96b5-57ed8c21a3c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "PUT /v2.0/routers/911f7322-871f-498f-b69c-2d9baf55d117/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5071564 Dec 09 22:25:21.584656 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34262) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:21.586227 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbaa0b04-476e-4548-8ae5-1cf47b57633f None None] Sync routers for ids ['911f7322-871f-498f-b69c-2d9baf55d117'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:25:21.598280 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbaa0b04-476e-4548-8ae5-1cf47b57633f None None] Routers {'911f7322-871f-498f-b69c-2d9baf55d117'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:25:21.599034 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-cbaa0b04-476e-4548-8ae5-1cf47b57633f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:25:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['911f7322-871f-498f-b69c-2d9baf55d117'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:25:21.637459 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-c1920269-dea7-4f53-ad88-5002ae65feb2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting subnet 8e3240f2-9f05-4035-8fad-ce938f6b5d5b {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:25:21.640823 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c1920269-dea7-4f53-ad88-5002ae65feb2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:21.681424 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c1920269-dea7-4f53-ad88-5002ae65feb2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:21.703632 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-cbaa0b04-476e-4548-8ae5-1cf47b57633f None None] Set router 911f7322-871f-498f-b69c-2d9baf55d117 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:25:21.767409 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c1920269-dea7-4f53-ad88-5002ae65feb2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:21.830388 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c1920269-dea7-4f53-ad88-5002ae65feb2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:21.857021 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1920269-dea7-4f53-ad88-5002ae65feb2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Subnet': ['ID=8e3240f2-9f05-4035-8fad-ce938f6b5d5b,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:21.860689 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c1920269-dea7-4f53-ad88-5002ae65feb2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:21.866323 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c1920269-dea7-4f53-ad88-5002ae65feb2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/subnets/8e3240f2-9f05-4035-8fad-ce938f6b5d5b HTTP/1.1" status: 204 len: 168 time: 0.2778730 Dec 09 22:25:21.866627 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34264) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:21.870162 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf5406d6-e439-416f-8e97-c5c26465c95d None None] Network 001ae614-c091-4847-8da3-f38043ef44ea requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:25:21.887618 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-cbaa0b04-476e-4548-8ae5-1cf47b57633f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '911f7322-871f-498f-b69c-2d9baf55d117', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1559026721', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150'}], 'enable_snat': True}, 'gw_port_id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:23:38Z', 'updated_at': '2021-12-09T22:25:20Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:eb:cf:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4234, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:23:39Z', 'updated_at': '2021-12-09T22:23:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:25:21.914346 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbaa0b04-476e-4548-8ae5-1cf47b57633f None None] Checking router: 911f7322-871f-498f-b69c-2d9baf55d117 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:25:21.924026 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbaa0b04-476e-4548-8ae5-1cf47b57633f None None] Routers {'911f7322-871f-498f-b69c-2d9baf55d117'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:25:21.924643 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-cbaa0b04-476e-4548-8ae5-1cf47b57633f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:25:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['911f7322-871f-498f-b69c-2d9baf55d117'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:25:21.984177 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-736622e3-007a-412e-98aa-7351b85fa02e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:22.034641 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-cbaa0b04-476e-4548-8ae5-1cf47b57633f None None] Set router 911f7322-871f-498f-b69c-2d9baf55d117 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:25:22.041627 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5e355196-2dc7-4569-b2b4-daa924a962c7 None None] DHCP port deletion for 001ae614-c091-4847-8da3-f38043ef44ea request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:25:22.097952 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-5e355196-2dc7-4569-b2b4-daa924a962c7 None None] Deleting port 963b7872-c422-4e30-b58e-bde567f1a16a {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:25:22.098263 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5e355196-2dc7-4569-b2b4-daa924a962c7 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:22.100844 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-736622e3-007a-412e-98aa-7351b85fa02e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:22.157333 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-736622e3-007a-412e-98aa-7351b85fa02e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting port 7d6542cd-3a73-4535-8181-c9026be1703f {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:25:22.157699 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-736622e3-007a-412e-98aa-7351b85fa02e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:22.167203 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-5e355196-2dc7-4569-b2b4-daa924a962c7 None None] For port 963b7872-c422-4e30-b58e-bde567f1a16a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=963b7872-c422-4e30-b58e-bde567f1a16a,segment=NetworkSegment(a9a93e18-2e77-4f70-840a-1a0145ed66db),segment_id=a9a93e18-2e77-4f70-840a-1a0145ed66db)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:25:22.167777 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5e355196-2dc7-4569-b2b4-daa924a962c7 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:22.181524 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-5e355196-2dc7-4569-b2b4-daa924a962c7 None None] Calling delete_port for 963b7872-c422-4e30-b58e-bde567f1a16a owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:25:22.216373 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-cbaa0b04-476e-4548-8ae5-1cf47b57633f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '911f7322-871f-498f-b69c-2d9baf55d117', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1559026721', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150'}], 'enable_snat': True}, 'gw_port_id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:23:38Z', 'updated_at': '2021-12-09T22:25:20Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:eb:cf:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4234, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:23:39Z', 'updated_at': '2021-12-09T22:23:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:25:22.244189 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-736622e3-007a-412e-98aa-7351b85fa02e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] For port 7d6542cd-3a73-4535-8181-c9026be1703f, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7d6542cd-3a73-4535-8181-c9026be1703f,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:25:22.244674 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-736622e3-007a-412e-98aa-7351b85fa02e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:22.246259 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbaa0b04-476e-4548-8ae5-1cf47b57633f None None] The sync data for ids ['911f7322-871f-498f-b69c-2d9baf55d117'] in n-d-713301-27 is: [{'id': '911f7322-871f-498f-b69c-2d9baf55d117', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1559026721', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150'}], 'enable_snat': True}, 'gw_port_id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:23:38Z', 'updated_at': '2021-12-09T22:25:20Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '7d6542cd-3a73-4535-8181-c9026be1703f', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:eb:cf:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '911f7322-871f-498f-b69c-2d9baf55d117', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4234, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.150', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:23:39Z', 'updated_at': '2021-12-09T22:23:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:25:22.258408 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-736622e3-007a-412e-98aa-7351b85fa02e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Calling delete_port for 7d6542cd-3a73-4535-8181-c9026be1703f owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:25:22.266511 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5e355196-2dc7-4569-b2b4-daa924a962c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:22.293405 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e355196-2dc7-4569-b2b4-daa924a962c7 None None] Pushing event deleted for resources: {'Port': ['ID=963b7872-c422-4e30-b58e-bde567f1a16a,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:22.303246 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e355196-2dc7-4569-b2b4-daa924a962c7 None None] No DVR routers for this DVR port 963b7872-c422-4e30-b58e-bde567f1a16a on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:25:22.305578 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e355196-2dc7-4569-b2b4-daa924a962c7 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:22.305814 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e355196-2dc7-4569-b2b4-daa924a962c7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:22.306160 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e355196-2dc7-4569-b2b4-daa924a962c7 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:22.306540 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e355196-2dc7-4569-b2b4-daa924a962c7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:22.307101 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e355196-2dc7-4569-b2b4-daa924a962c7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:22.307231 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e355196-2dc7-4569-b2b4-daa924a962c7 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:22.307565 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e355196-2dc7-4569-b2b4-daa924a962c7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:22.307898 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e355196-2dc7-4569-b2b4-daa924a962c7 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:22.308259 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e355196-2dc7-4569-b2b4-daa924a962c7 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:22.308602 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e355196-2dc7-4569-b2b4-daa924a962c7 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:22.308929 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e355196-2dc7-4569-b2b4-daa924a962c7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:22.309255 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e355196-2dc7-4569-b2b4-daa924a962c7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:22.309578 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5e355196-2dc7-4569-b2b4-daa924a962c7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:22.442503 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-736622e3-007a-412e-98aa-7351b85fa02e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:22.466136 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-736622e3-007a-412e-98aa-7351b85fa02e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Port': ['ID=7d6542cd-3a73-4535-8181-c9026be1703f,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:22.481990 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2efa84c-06af-4d21-956f-876ef41687b3 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:25:22.531045 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-736622e3-007a-412e-98aa-7351b85fa02e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:22.638061 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-736622e3-007a-412e-98aa-7351b85fa02e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:22.640558 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-736622e3-007a-412e-98aa-7351b85fa02e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:22.694794 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-736622e3-007a-412e-98aa-7351b85fa02e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:22.695349 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-736622e3-007a-412e-98aa-7351b85fa02e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Fanout notify agent at l3_agent the message router_deleted on router 911f7322-871f-498f-b69c-2d9baf55d117 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 22:25:22.702767 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-736622e3-007a-412e-98aa-7351b85fa02e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:22.703952 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-736622e3-007a-412e-98aa-7351b85fa02e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/routers/911f7322-871f-498f-b69c-2d9baf55d117 HTTP/1.1" status: 204 len: 168 time: 0.8365006 Dec 09 22:25:22.706558 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34266) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:22.709657 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b0f2b769-6f50-4bcb-80a1-dd8e7046ca45 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:25:22.730172 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: b0f2b769-6f50-4bcb-80a1-dd8e7046ca45 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:25:22.730662 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device b0f2b769-6f50-4bcb-80a1-dd8e7046ca45 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:25:22.731166 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 963b7872-c422-4e30-b58e-bde567f1a16a no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:25:22.756962 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 2f35cc66-1533-478b-9f3d-ed5fa8f32d65 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:25:22.759648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 963b7872-c422-4e30-b58e-bde567f1a16a {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:25:22.760028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 963b7872-c422-4e30-b58e-bde567f1a16a not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:25:22.783973 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 2f35cc66-1533-478b-9f3d-ed5fa8f32d65 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:25:22.784495 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 2f35cc66-1533-478b-9f3d-ed5fa8f32d65 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:25:22.785979 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-31d63ed1-a1e5-4bd0-a862-0f389711f0c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:22.879342 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-31d63ed1-a1e5-4bd0-a862-0f389711f0c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:22.901812 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-31d63ed1-a1e5-4bd0-a862-0f389711f0c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['001ae614-c091-4847-8da3-f38043ef44ea']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:25:22.912847 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-31d63ed1-a1e5-4bd0-a862-0f389711f0c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a9a93e18-2e77-4f70-840a-1a0145ed66db') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:25:22.913154 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-31d63ed1-a1e5-4bd0-a862-0f389711f0c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a9a93e18-2e77-4f70-840a-1a0145ed66db') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:25:22.924089 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-31d63ed1-a1e5-4bd0-a862-0f389711f0c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:22.938182 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-31d63ed1-a1e5-4bd0-a862-0f389711f0c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:22.945024 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-31d63ed1-a1e5-4bd0-a862-0f389711f0c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Releasing vlan 119 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:25:22.945395 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-31d63ed1-a1e5-4bd0-a862-0f389711f0c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: timer() Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:25:22.948645 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:25:23.011818 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-31d63ed1-a1e5-4bd0-a862-0f389711f0c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:23.021296 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-31d63ed1-a1e5-4bd0-a862-0f389711f0c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:23.024400 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-31d63ed1-a1e5-4bd0-a862-0f389711f0c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/networks/001ae614-c091-4847-8da3-f38043ef44ea HTTP/1.1" status: 204 len: 168 time: 0.3169048 Dec 09 22:25:23.027430 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34268) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:23.044282 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31d63ed1-a1e5-4bd0-a862-0f389711f0c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Network': ['ID=001ae614-c091-4847-8da3-f38043ef44ea,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:23.099494 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f30ff37-dc08-4b25-9cdc-6e0d2f5607d9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:23.125908 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f30ff37-dc08-4b25-9cdc-6e0d2f5607d9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:23.198825 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f30ff37-dc08-4b25-9cdc-6e0d2f5607d9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:23.201528 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7f30ff37-dc08-4b25-9cdc-6e0d2f5607d9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:23.202713 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7f30ff37-dc08-4b25-9cdc-6e0d2f5607d9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/security-groups/f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad HTTP/1.1" status: 204 len: 168 time: 0.1742036 Dec 09 22:25:23.211926 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f30ff37-dc08-4b25-9cdc-6e0d2f5607d9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=f20bf3ce-b183-4196-8b30-0ab8a9f2e5ad,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:23.882893 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34274) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:23.890335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-ef8ecd11-e234-40c0-bfca-04ad44ae81c1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1470596506', 'description': 'tempest-secgroup-smoke-1470596506 description', 'project_id': 'e21dff80515b44aa9f01117603c6de0d'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:25:23.919319 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ef8ecd11-e234-40c0-bfca-04ad44ae81c1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:23.987127 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ef8ecd11-e234-40c0-bfca-04ad44ae81c1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:23.992832 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ef8ecd11-e234-40c0-bfca-04ad44ae81c1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.022015 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ef8ecd11-e234-40c0-bfca-04ad44ae81c1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.023247 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ef8ecd11-e234-40c0-bfca-04ad44ae81c1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1389940 Dec 09 22:25:24.025456 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef8ecd11-e234-40c0-bfca-04ad44ae81c1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0457c075-7ec0-4df4-9722-66642b37f50d,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:24.026404 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34276) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:24.031305 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-61a41c23-e0f9-422a-b06d-b34fa758299f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': '0457c075-7ec0-4df4-9722-66642b37f50d', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:25:24.061400 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-61a41c23-e0f9-422a-b06d-b34fa758299f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.119256 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-61a41c23-e0f9-422a-b06d-b34fa758299f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.124101 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-61a41c23-e0f9-422a-b06d-b34fa758299f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.144162 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61a41c23-e0f9-422a-b06d-b34fa758299f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a5b0c337-f472-49d7-a05f-8d5f270656d1,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:24.150099 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-61a41c23-e0f9-422a-b06d-b34fa758299f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.151319 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-61a41c23-e0f9-422a-b06d-b34fa758299f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1237757 Dec 09 22:25:24.154669 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34278) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:24.159276 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b7937e03-cc79-4b84-be61-f9abc51b60c1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': '0457c075-7ec0-4df4-9722-66642b37f50d', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:25:24.189229 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b7937e03-cc79-4b84-be61-f9abc51b60c1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.246240 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b7937e03-cc79-4b84-be61-f9abc51b60c1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.252163 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b7937e03-cc79-4b84-be61-f9abc51b60c1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.271807 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7937e03-cc79-4b84-be61-f9abc51b60c1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b1dabdab-4958-4ce5-aba6-9ece9fc7e7ba,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:24.280767 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b7937e03-cc79-4b84-be61-f9abc51b60c1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.281980 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b7937e03-cc79-4b84-be61-f9abc51b60c1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1262805 Dec 09 22:25:24.284806 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34280) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:24.289126 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-93c519a9-b1e5-4b89-a709-da6f0cc6a2de tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': '0457c075-7ec0-4df4-9722-66642b37f50d', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:25:24.319744 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93c519a9-b1e5-4b89-a709-da6f0cc6a2de tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.342965 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7d6542cd-3a73-4535-8181-c9026be1703f no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:25:24.363431 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 7d6542cd-3a73-4535-8181-c9026be1703f {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:25:24.363810 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7d6542cd-3a73-4535-8181-c9026be1703f not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:25:24.379585 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93c519a9-b1e5-4b89-a709-da6f0cc6a2de tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.385259 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93c519a9-b1e5-4b89-a709-da6f0cc6a2de tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.402227 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93c519a9-b1e5-4b89-a709-da6f0cc6a2de tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e8783fdc-1afe-495d-a3d4-599f5a3aa6bb,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:24.410782 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-93c519a9-b1e5-4b89-a709-da6f0cc6a2de tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.412014 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-93c519a9-b1e5-4b89-a709-da6f0cc6a2de tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1263080 Dec 09 22:25:24.414737 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34282) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:24.419048 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-00d5a154-d394-4db3-a85d-73c0634ed882 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': '0457c075-7ec0-4df4-9722-66642b37f50d', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:25:24.447550 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-00d5a154-d394-4db3-a85d-73c0634ed882 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.510741 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-00d5a154-d394-4db3-a85d-73c0634ed882 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.515873 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-00d5a154-d394-4db3-a85d-73c0634ed882 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.535140 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00d5a154-d394-4db3-a85d-73c0634ed882 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3714a05e-8069-4f3f-aeb2-aaf6c597620b,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:24.543154 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-00d5a154-d394-4db3-a85d-73c0634ed882 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.544417 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-00d5a154-d394-4db3-a85d-73c0634ed882 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1287308 Dec 09 22:25:24.547671 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34284) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:24.552038 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-b8d6b569-6a8b-483b-8520-e4de2c6f4655 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': '0457c075-7ec0-4df4-9722-66642b37f50d', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:25:24.575169 n-d-713301-27 neutron-server[103437]: INFO neutron.db.securitygroups_db [None req-b8d6b569-6a8b-483b-8520-e4de2c6f4655 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Project e21dff80515b44aa9f01117603c6de0d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 22:25:24.579803 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b8d6b569-6a8b-483b-8520-e4de2c6f4655 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.637022 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b8d6b569-6a8b-483b-8520-e4de2c6f4655 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.643052 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b8d6b569-6a8b-483b-8520-e4de2c6f4655 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.661408 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8d6b569-6a8b-483b-8520-e4de2c6f4655 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=023c9cc4-9531-4f53-bb93-6bfdc9ee3412,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:24.668072 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-b8d6b569-6a8b-483b-8520-e4de2c6f4655 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.669341 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-b8d6b569-6a8b-483b-8520-e4de2c6f4655 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1206529 Dec 09 22:25:24.672617 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34286) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:24.677018 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-e357a784-2dfc-42b8-9e9e-888705bfef14 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': '0457c075-7ec0-4df4-9722-66642b37f50d', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:25:24.701575 n-d-713301-27 neutron-server[103437]: INFO neutron.db.securitygroups_db [None req-e357a784-2dfc-42b8-9e9e-888705bfef14 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Project e21dff80515b44aa9f01117603c6de0d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 22:25:24.706835 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e357a784-2dfc-42b8-9e9e-888705bfef14 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.765777 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e357a784-2dfc-42b8-9e9e-888705bfef14 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.771083 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e357a784-2dfc-42b8-9e9e-888705bfef14 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.792212 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e357a784-2dfc-42b8-9e9e-888705bfef14 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0d48841f-2c54-4a77-a954-ea6eaffaf080,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:24.803587 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e357a784-2dfc-42b8-9e9e-888705bfef14 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.806893 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e357a784-2dfc-42b8-9e9e-888705bfef14 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1305697 Dec 09 22:25:24.807097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34288) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:24.812517 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-afcfd34b-f6ab-443c-90f8-e9a30a14933a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'network': {'name': 'tempest-network-smoke--234630921', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'port_security_enabled': True}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:25:24.834093 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-afcfd34b-f6ab-443c-90f8-e9a30a14933a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Made reservation on behalf of e21dff80515b44aa9f01117603c6de0d for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:25:24.837821 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-afcfd34b-f6ab-443c-90f8-e9a30a14933a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.862159 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-afcfd34b-f6ab-443c-90f8-e9a30a14933a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] vlan segment allocate from pool success with {'vlan_id': 130, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 22:25:24.873071 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-afcfd34b-f6ab-443c-90f8-e9a30a14933a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.873445 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-afcfd34b-f6ab-443c-90f8-e9a30a14933a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Added segment d634afa7-444c-47d3-9e02-42921e0c3151 of type vlan for network 4acfc0bf-ef93-4f01-883a-4e582d1c06d7 Dec 09 22:25:24.917319 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-afcfd34b-f6ab-443c-90f8-e9a30a14933a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.943056 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-afcfd34b-f6ab-443c-90f8-e9a30a14933a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.948826 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-afcfd34b-f6ab-443c-90f8-e9a30a14933a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:24.949419 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-afcfd34b-f6ab-443c-90f8-e9a30a14933a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:24.980678 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-afcfd34b-f6ab-443c-90f8-e9a30a14933a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 768 time: 0.1725028 Dec 09 22:25:24.983588 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34290) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:24.988347 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-99bf3276-c3d2-490a-8066-c53251ced884 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-1305906706', 'admin_state_up': True, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:25:25.013687 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99bf3276-c3d2-490a-8066-c53251ced884 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:25.015594 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99bf3276-c3d2-490a-8066-c53251ced884 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:25.022268 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afcfd34b-f6ab-443c-90f8-e9a30a14933a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Network': ['ID=4acfc0bf-ef93-4f01-883a-4e582d1c06d7,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:25.034365 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 4acfc0bf-ef93-4f01-883a-4e582d1c06d7 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 22:25:25.074614 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99bf3276-c3d2-490a-8066-c53251ced884 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:25.213717 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99bf3276-c3d2-490a-8066-c53251ced884 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:25.412076 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99bf3276-c3d2-490a-8066-c53251ced884 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:25.437946 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99bf3276-c3d2-490a-8066-c53251ced884 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:25.545445 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-99bf3276-c3d2-490a-8066-c53251ced884 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Allocated IP 172.25.3.100 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/342d6d27-af9b-4789-91c2-cfc15a483ba5) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:25:25.656257 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99bf3276-c3d2-490a-8066-c53251ced884 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:25.697644 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99bf3276-c3d2-490a-8066-c53251ced884 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:25.739827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99bf3276-c3d2-490a-8066-c53251ced884 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:25:25.742660 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-99bf3276-c3d2-490a-8066-c53251ced884 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:25:25.748673 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99bf3276-c3d2-490a-8066-c53251ced884 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:25:25.754142 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99bf3276-c3d2-490a-8066-c53251ced884 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=342d6d27-af9b-4789-91c2-cfc15a483ba5,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:25.756272 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ea5041b-6b61-441d-8454-2c362bf6c4d4 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:25:25.843630 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-14e1d650-c49d-496b-bbc2-2260fff94678 None None] Provisioning complete for port 342d6d27-af9b-4789-91c2-cfc15a483ba5 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:25:25.844226 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-14e1d650-c49d-496b-bbc2-2260fff94678 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:25.879353 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-14e1d650-c49d-496b-bbc2-2260fff94678 None None] Port 342d6d27-af9b-4789-91c2-cfc15a483ba5 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:25:26.022790 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99bf3276-c3d2-490a-8066-c53251ced884 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:26.219656 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99bf3276-c3d2-490a-8066-c53251ced884 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:26.687547 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-99bf3276-c3d2-490a-8066-c53251ced884 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 22:25:26.792422 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-99bf3276-c3d2-490a-8066-c53251ced884 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:25:26.805150 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] Sync routers for ids ['a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:25:26.816915 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] Routers {'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:25:26.817175 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-99bf3276-c3d2-490a-8066-c53251ced884 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:26.817669 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:25:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:25:26.818434 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-99bf3276-c3d2-490a-8066-c53251ced884 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 896 time: 1.8337791 Dec 09 22:25:26.823257 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34292) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:26.851408 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-75e1e170-038b-42e1-bba1-c86bf88cdf12 tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] 10.222.0.13 "GET /v2.0/subnets?project_id=e21dff80515b44aa9f01117603c6de0d&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0272357 Dec 09 22:25:26.854387 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34294) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:26.933812 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] Set router a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:25:27.019065 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f2193b50-819b-4803-98e0-50774c075deb tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:27.020577 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f2193b50-819b-4803-98e0-50774c075deb tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.1652091 Dec 09 22:25:27.023653 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34296) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:27.063290 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5cd38ff0-c36c-4c12-ba22-92a7b7d23d9a tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] 10.222.0.13 "GET /v2.0/subnets?network_id=97925a19-460a-4476-8208-41db134b6c83&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0356591 Dec 09 22:25:27.063565 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34298) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:27.068700 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-7a477a7d-8bd1-4d53-b798-d7bdc5d0834f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-893263837', 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:25:27.164008 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7a477a7d-8bd1-4d53-b798-d7bdc5d0834f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Made reservation on behalf of e21dff80515b44aa9f01117603c6de0d for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:25:27.167723 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7a477a7d-8bd1-4d53-b798-d7bdc5d0834f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:27.285725 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1305906706', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100'}], 'enable_snat': True}, 'gw_port_id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:25Z', 'revision_number': 3, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:b1:34', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4253, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:25Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:25:27.313461 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] Checking router: a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:25:27.313820 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] Updating router a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1 port 342d6d27-af9b-4789-91c2-cfc15a483ba5 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:25:27.338206 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:27.356685 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7a477a7d-8bd1-4d53-b798-d7bdc5d0834f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:27.414256 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a477a7d-8bd1-4d53-b798-d7bdc5d0834f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Subnet': ['ID=69d8febf-3c3f-4c98-b084-716a5362ebc6,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:27.425297 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7a477a7d-8bd1-4d53-b798-d7bdc5d0834f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Checking segment: {'id': 'd634afa7-444c-47d3-9e02-42921e0c3151', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:25:27.425660 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a477a7d-8bd1-4d53-b798-d7bdc5d0834f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network hostable DHCP agents. Network: 4acfc0bf-ef93-4f01-883a-4e582d1c06d7, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 22:25:27.444249 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a477a7d-8bd1-4d53-b798-d7bdc5d0834f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network 4acfc0bf-ef93-4f01-883a-4e582d1c06d7 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 22:25:27.453309 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-7a477a7d-8bd1-4d53-b798-d7bdc5d0834f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 4acfc0bf-ef93-4f01-883a-4e582d1c06d7) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:25:27.457505 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7a477a7d-8bd1-4d53-b798-d7bdc5d0834f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:27.458101 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-7a477a7d-8bd1-4d53-b798-d7bdc5d0834f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:27.469850 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4533171-695a-4d80-a185-a3d3058d4c8e None None] Network 4acfc0bf-ef93-4f01-883a-4e582d1c06d7 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:25:27.478058 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34300) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:27.478290 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-7a477a7d-8bd1-4d53-b798-d7bdc5d0834f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.4136646 Dec 09 22:25:27.632774 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-161f41be-0e6b-4452-9568-e984143ea804 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-4acfc0bf-ef93-4f01-883a-4e582d1c06d7', 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ips': [{'subnet_id': '69d8febf-3c3f-4c98-b084-716a5362ebc6'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 22:25:27.633609 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-161f41be-0e6b-4452-9568-e984143ea804 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:27.691150 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:27.706740 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:27.780113 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:27.808089 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b2a65d2-49dc-447d-8684-1c4df8136190 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:25:27.863511 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b504ed81-50d6-4e1f-a615-e7b8e411a076 None None] Pushing event updated for resources: {'Port': ['ID=342d6d27-af9b-4789-91c2-cfc15a483ba5,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:27.866367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] Attempting to bind port 342d6d27-af9b-4789-91c2-cfc15a483ba5 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:25:27.866752 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] Attempting to bind port 342d6d27-af9b-4789-91c2-cfc15a483ba5 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:25:27.867112 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] Attempting to bind port 342d6d27-af9b-4789-91c2-cfc15a483ba5 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:25:27.871601 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:27.881850 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 25, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:25:27.882174 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:25:27.882557 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:27.882980 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:25:27.883428 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] Bound port: 342d6d27-af9b-4789-91c2-cfc15a483ba5, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:25:27.883862 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:27.932833 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-161f41be-0e6b-4452-9568-e984143ea804 None None] Allocated IP 172.20.0.2 (4acfc0bf-ef93-4f01-883a-4e582d1c06d7/69d8febf-3c3f-4c98-b084-716a5362ebc6/dd318939-4b9c-4ea2-8945-0b54cd734bfe) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:25:27.941006 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5437cbd-a09c-48a8-9adc-27d2518337da tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:27.964790 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] For port 342d6d27-af9b-4789-91c2-cfc15a483ba5, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:25:27.966781 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-50b020a2-4de2-4505-afa7-46193e8f24a8 None None] Provisioning complete for port 342d6d27-af9b-4789-91c2-cfc15a483ba5 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:25:27.967181 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-50b020a2-4de2-4505-afa7-46193e8f24a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:27.969726 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] For port 342d6d27-af9b-4789-91c2-cfc15a483ba5, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=342d6d27-af9b-4789-91c2-cfc15a483ba5,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:25:28.002393 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:28.097005 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd65d8f2-7e86-4ded-a3e4-1d7b31417f7f None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:25:28.135301 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] Routers {'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:25:28.135994 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:25:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:25:28.142096 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b504ed81-50d6-4e1f-a615-e7b8e411a076 None None] Pushing event updated for resources: {'Port': ['ID=342d6d27-af9b-4789-91c2-cfc15a483ba5,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:28.304900 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-50b020a2-4de2-4505-afa7-46193e8f24a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:28.317084 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-161f41be-0e6b-4452-9568-e984143ea804 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:28.340038 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-161f41be-0e6b-4452-9568-e984143ea804 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:28.344993 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-50b020a2-4de2-4505-afa7-46193e8f24a8 None None] For port 342d6d27-af9b-4789-91c2-cfc15a483ba5, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=342d6d27-af9b-4789-91c2-cfc15a483ba5,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:25:28.372058 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-50b020a2-4de2-4505-afa7-46193e8f24a8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:28.378453 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] Set router a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:25:28.389890 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-f5437cbd-a09c-48a8-9adc-27d2518337da tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Allocated IP 172.20.0.1 (4acfc0bf-ef93-4f01-883a-4e582d1c06d7/69d8febf-3c3f-4c98-b084-716a5362ebc6/de13f219-3194-4b40-82f1-858d74834954) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:25:28.449805 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-161f41be-0e6b-4452-9568-e984143ea804 None None] Network 4acfc0bf-ef93-4f01-883a-4e582d1c06d7 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:25:28.464860 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-161f41be-0e6b-4452-9568-e984143ea804 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:25:28.469077 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-161f41be-0e6b-4452-9568-e984143ea804 None None] Pushing event updated for resources: {'Port': ['ID=dd318939-4b9c-4ea2-8945-0b54cd734bfe,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:28.472832 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-161f41be-0e6b-4452-9568-e984143ea804 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:25:28.505087 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5437cbd-a09c-48a8-9adc-27d2518337da tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:28.541195 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5437cbd-a09c-48a8-9adc-27d2518337da tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:28.579788 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5437cbd-a09c-48a8-9adc-27d2518337da tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network 4acfc0bf-ef93-4f01-883a-4e582d1c06d7 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:25:28.583229 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-f5437cbd-a09c-48a8-9adc-27d2518337da tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:25:28.587117 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5437cbd-a09c-48a8-9adc-27d2518337da tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:25:28.620632 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5437cbd-a09c-48a8-9adc-27d2518337da tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=de13f219-3194-4b40-82f1-858d74834954,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:28.620923 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-979cd136-4e41-4501-a69d-1e41e0f6bfcc None None] Provisioning complete for port 342d6d27-af9b-4789-91c2-cfc15a483ba5 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:25:28.621052 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-979cd136-4e41-4501-a69d-1e41e0f6bfcc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:28.625390 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50b020a2-4de2-4505-afa7-46193e8f24a8 None None] Pushing event updated for resources: {'Port': ['ID=342d6d27-af9b-4789-91c2-cfc15a483ba5,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:28.642657 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5437cbd-a09c-48a8-9adc-27d2518337da tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:28.659465 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-161f41be-0e6b-4452-9568-e984143ea804 None None] Attempting to bind port dd318939-4b9c-4ea2-8945-0b54cd734bfe on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:25:28.659846 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-161f41be-0e6b-4452-9568-e984143ea804 None None] Attempting to bind port dd318939-4b9c-4ea2-8945-0b54cd734bfe by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'd634afa7-444c-47d3-9e02-42921e0c3151', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:25:28.660214 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-161f41be-0e6b-4452-9568-e984143ea804 None None] Attempting to bind port dd318939-4b9c-4ea2-8945-0b54cd734bfe on network 4acfc0bf-ef93-4f01-883a-4e582d1c06d7 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:25:28.692980 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-161f41be-0e6b-4452-9568-e984143ea804 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 25, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:25:28.693364 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-161f41be-0e6b-4452-9568-e984143ea804 None None] Checking segment: {'id': 'd634afa7-444c-47d3-9e02-42921e0c3151', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:25:28.693768 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-161f41be-0e6b-4452-9568-e984143ea804 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:28.694163 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-161f41be-0e6b-4452-9568-e984143ea804 None None] Bound using segment: {'id': 'd634afa7-444c-47d3-9e02-42921e0c3151', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:25:28.694644 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-161f41be-0e6b-4452-9568-e984143ea804 None None] Bound port: dd318939-4b9c-4ea2-8945-0b54cd734bfe, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd634afa7-444c-47d3-9e02-42921e0c3151', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:25:28.695026 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-161f41be-0e6b-4452-9568-e984143ea804 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:28.770750 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5437cbd-a09c-48a8-9adc-27d2518337da tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:28.981367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1305906706', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100'}], 'enable_snat': True}, 'gw_port_id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:25Z', 'revision_number': 3, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:b1:34', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4253, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:25:28.983752 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-161f41be-0e6b-4452-9568-e984143ea804 None None] For port dd318939-4b9c-4ea2-8945-0b54cd734bfe, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:25:28.987683 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-161f41be-0e6b-4452-9568-e984143ea804 None None] For port dd318939-4b9c-4ea2-8945-0b54cd734bfe, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=dd318939-4b9c-4ea2-8945-0b54cd734bfe,segment=NetworkSegment(d634afa7-444c-47d3-9e02-42921e0c3151),segment_id=d634afa7-444c-47d3-9e02-42921e0c3151)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:25:29.015046 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-161f41be-0e6b-4452-9568-e984143ea804 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:29.019317 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e55e1d4-0f1d-4fdb-9fd6-7a2812a2d6da None None] The sync data for ids ['a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'] in n-d-713301-27 is: [{'id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1305906706', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100'}], 'enable_snat': True}, 'gw_port_id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:25Z', 'revision_number': 3, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:b1:34', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4253, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:27Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:25:29.070433 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5437cbd-a09c-48a8-9adc-27d2518337da tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:29.079780 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-161f41be-0e6b-4452-9568-e984143ea804 None None] Pushing event updated for resources: {'Port': ['ID=dd318939-4b9c-4ea2-8945-0b54cd734bfe,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:29.083587 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5437cbd-a09c-48a8-9adc-27d2518337da tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:29.156466 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5437cbd-a09c-48a8-9adc-27d2518337da tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=de13f219-3194-4b40-82f1-858d74834954,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:29.176464 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f5437cbd-a09c-48a8-9adc-27d2518337da tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:29.292379 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5437cbd-a09c-48a8-9adc-27d2518337da tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network 4acfc0bf-ef93-4f01-883a-4e582d1c06d7 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:25:29.293943 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-f5437cbd-a09c-48a8-9adc-27d2518337da tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:25:29.814069 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f5437cbd-a09c-48a8-9adc-27d2518337da tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:25:29.935329 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f5437cbd-a09c-48a8-9adc-27d2518337da tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:25:29.950729 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f5437cbd-a09c-48a8-9adc-27d2518337da tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "PUT /v2.0/routers/a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4709485 Dec 09 22:25:30.080330 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ef37196-d3c4-466c-96d2-b2679e57a394 None None] Network 4acfc0bf-ef93-4f01-883a-4e582d1c06d7 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:25:30.104450 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86e684be-d244-4917-b088-b00bf21cbc85 req-99718e17-c7bd-4f09-85e2-698aa3441674 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1470596506&fields=id&tenant_id=e21dff80515b44aa9f01117603c6de0d HTTP/1.1" status: 200 len: 267 time: 0.0481606 Dec 09 22:25:30.151662 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e1da0a60-e453-4b64-936d-11c8b677e0a0 None None] Provisioning complete for port dd318939-4b9c-4ea2-8945-0b54cd734bfe triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:25:30.152028 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e1da0a60-e453-4b64-936d-11c8b677e0a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:30.219749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86e684be-d244-4917-b088-b00bf21cbc85 req-ed96099e-cede-4b80-a576-553fd597e2ab tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:30.221354 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86e684be-d244-4917-b088-b00bf21cbc85 req-ed96099e-cede-4b80-a576-553fd597e2ab tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/networks?id=4acfc0bf-ef93-4f01-883a-4e582d1c06d7 HTTP/1.1" status: 200 len: 796 time: 0.1097782 Dec 09 22:25:30.237358 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86e684be-d244-4917-b088-b00bf21cbc85 req-959fff30-03bf-426b-b7bb-3425e3ebe040 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/quotas/e21dff80515b44aa9f01117603c6de0d HTTP/1.1" status: 200 len: 375 time: 0.0100636 Dec 09 22:25:30.271017 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e1da0a60-e453-4b64-936d-11c8b677e0a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:30.298251 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86e684be-d244-4917-b088-b00bf21cbc85 req-4e6afde1-5d8d-4aad-b14c-79e78d4317e2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0498383 Dec 09 22:25:30.308474 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e1da0a60-e453-4b64-936d-11c8b677e0a0 None None] For port dd318939-4b9c-4ea2-8945-0b54cd734bfe, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=dd318939-4b9c-4ea2-8945-0b54cd734bfe,segment=NetworkSegment(d634afa7-444c-47d3-9e02-42921e0c3151),segment_id=d634afa7-444c-47d3-9e02-42921e0c3151)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:25:30.316913 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e1da0a60-e453-4b64-936d-11c8b677e0a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:30.382665 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1da0a60-e453-4b64-936d-11c8b677e0a0 None None] Pushing event updated for resources: {'Port': ['ID=dd318939-4b9c-4ea2-8945-0b54cd734bfe,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:30.422467 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86e684be-d244-4917-b088-b00bf21cbc85 req-09f57268-a834-4de8-9896-a3120482772d service neutron] 10.222.0.13 "GET /v2.0/networks/4acfc0bf-ef93-4f01-883a-4e582d1c06d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1113150 Dec 09 22:25:30.494842 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device dd318939-4b9c-4ea2-8945-0b54cd734bfe up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:25:30.547869 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7ed04d6f-02d9-479f-87fc-1eeb3f9cc325 None None] Provisioning complete for port de13f219-3194-4b40-82f1-858d74834954 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:25:30.548584 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86e684be-d244-4917-b088-b00bf21cbc85 req-97da2930-cade-4780-9635-96f2b08752c7 service neutron] 10.222.0.13 "GET /v2.0/networks/4acfc0bf-ef93-4f01-883a-4e582d1c06d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1161964 Dec 09 22:25:30.548718 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7ed04d6f-02d9-479f-87fc-1eeb3f9cc325 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:30.594745 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-7ed04d6f-02d9-479f-87fc-1eeb3f9cc325 None None] Port de13f219-3194-4b40-82f1-858d74834954 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:25:30.596511 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port dd318939-4b9c-4ea2-8945-0b54cd734bfe triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:25:30.596883 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:30.630717 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-7ed04d6f-02d9-479f-87fc-1eeb3f9cc325 None None] Provisioning complete for port dd318939-4b9c-4ea2-8945-0b54cd734bfe triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:25:30.631084 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7ed04d6f-02d9-479f-87fc-1eeb3f9cc325 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:30.738675 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6444e55-89e4-4900-833d-13d011cc6445 req-cab6b11e-20e9-4f22-b41e-aabcd921a559 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 210 time: 0.0316005 Dec 09 22:25:30.750939 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 342d6d27-af9b-4789-91c2-cfc15a483ba5 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:25:30.806645 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] Sync routers for ids ['a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:25:30.817160 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] Routers {'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:25:30.818577 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:25:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:25:30.822180 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 342d6d27-af9b-4789-91c2-cfc15a483ba5 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:25:30.822622 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:30.926714 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5a0eb408-8997-4bc9-814e-4815851b0bad None None] Provisioning complete for port de13f219-3194-4b40-82f1-858d74834954 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:25:30.927182 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5a0eb408-8997-4bc9-814e-4815851b0bad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:30.963941 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-5a0eb408-8997-4bc9-814e-4815851b0bad None None] Port de13f219-3194-4b40-82f1-858d74834954 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:25:31.023130 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] Set router a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:25:31.084872 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f8812e62-b7a4-4e94-b54e-7bb4a5b3ec7c None None] Provisioning complete for port de13f219-3194-4b40-82f1-858d74834954 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:25:31.085467 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f8812e62-b7a4-4e94-b54e-7bb4a5b3ec7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:31.120254 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f8812e62-b7a4-4e94-b54e-7bb4a5b3ec7c None None] Port de13f219-3194-4b40-82f1-858d74834954 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:25:31.216121 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1305906706', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100'}], 'enable_snat': True}, 'gw_port_id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:28Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:b1:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4253, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'de13f219-3194-4b40-82f1-858d74834954', 'name': '', 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:eb:89:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'device_owner': 'network:router_interface', 'standard_attr_id': 4256, 'fixed_ips': [{'subnet_id': '69d8febf-3c3f-4c98-b084-716a5362ebc6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:25:28Z', 'updated_at': '2021-12-09T22:25:28Z', 'revision_number': 2, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '69d8febf-3c3f-4c98-b084-716a5362ebc6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:25:31.245409 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] Checking router: a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:25:31.245755 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] Updating router a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1 port de13f219-3194-4b40-82f1-858d74834954 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:25:31.269746 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:31.536642 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:31.546200 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:31.597291 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8595b84-4d65-4d96-b4ce-f291cb9fbebd None None] Pushing event updated for resources: {'Port': ['ID=de13f219-3194-4b40-82f1-858d74834954,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:31.625331 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8595b84-4d65-4d96-b4ce-f291cb9fbebd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:31.625683 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8595b84-4d65-4d96-b4ce-f291cb9fbebd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:31.626012 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8595b84-4d65-4d96-b4ce-f291cb9fbebd None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:31.626349 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8595b84-4d65-4d96-b4ce-f291cb9fbebd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:31.626640 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8595b84-4d65-4d96-b4ce-f291cb9fbebd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:31.626950 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8595b84-4d65-4d96-b4ce-f291cb9fbebd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:31.627263 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8595b84-4d65-4d96-b4ce-f291cb9fbebd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:31.627603 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8595b84-4d65-4d96-b4ce-f291cb9fbebd None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:31.627914 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8595b84-4d65-4d96-b4ce-f291cb9fbebd None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:31.628221 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8595b84-4d65-4d96-b4ce-f291cb9fbebd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:31.628528 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8595b84-4d65-4d96-b4ce-f291cb9fbebd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:31.628836 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8595b84-4d65-4d96-b4ce-f291cb9fbebd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:31.629136 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8595b84-4d65-4d96-b4ce-f291cb9fbebd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:25:31.661371 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] Attempting to bind port de13f219-3194-4b40-82f1-858d74834954 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:25:31.661808 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] Attempting to bind port de13f219-3194-4b40-82f1-858d74834954 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'd634afa7-444c-47d3-9e02-42921e0c3151', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:25:31.662239 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] Attempting to bind port de13f219-3194-4b40-82f1-858d74834954 on network 4acfc0bf-ef93-4f01-883a-4e582d1c06d7 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:25:31.667550 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 25, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:25:31.667914 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] Checking segment: {'id': 'd634afa7-444c-47d3-9e02-42921e0c3151', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:25:31.668309 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:31.668678 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] Bound using segment: {'id': 'd634afa7-444c-47d3-9e02-42921e0c3151', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:25:31.669151 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] Bound port: de13f219-3194-4b40-82f1-858d74834954, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd634afa7-444c-47d3-9e02-42921e0c3151', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:25:31.669526 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:31.742514 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] For port de13f219-3194-4b40-82f1-858d74834954, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:25:31.746478 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] For port de13f219-3194-4b40-82f1-858d74834954, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=de13f219-3194-4b40-82f1-858d74834954,segment=NetworkSegment(d634afa7-444c-47d3-9e02-42921e0c3151),segment_id=d634afa7-444c-47d3-9e02-42921e0c3151)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:25:31.752454 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:31.811224 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] Routers {'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:25:31.811907 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:25:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:25:31.813693 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8595b84-4d65-4d96-b4ce-f291cb9fbebd None None] Pushing event updated for resources: {'Port': ['ID=de13f219-3194-4b40-82f1-858d74834954,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:31.851285 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5b0b6af7-60d2-4301-8c88-b99a34544819 req-213df396-6430-4c40-a6e7-eefe5a0aabd0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 210 time: 0.0424066 Dec 09 22:25:31.858932 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e2cecead-3456-4e70-bc1a-95c4021f8003 None None] Provisioning complete for port de13f219-3194-4b40-82f1-858d74834954 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:25:31.858932 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e2cecead-3456-4e70-bc1a-95c4021f8003 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:31.941712 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e2cecead-3456-4e70-bc1a-95c4021f8003 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:31.947208 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] Set router a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:25:31.977012 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e2cecead-3456-4e70-bc1a-95c4021f8003 None None] For port de13f219-3194-4b40-82f1-858d74834954, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=de13f219-3194-4b40-82f1-858d74834954,segment=NetworkSegment(d634afa7-444c-47d3-9e02-42921e0c3151),segment_id=d634afa7-444c-47d3-9e02-42921e0c3151)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:25:31.984246 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e2cecead-3456-4e70-bc1a-95c4021f8003 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:32.038940 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2cecead-3456-4e70-bc1a-95c4021f8003 None None] Pushing event updated for resources: {'Port': ['ID=de13f219-3194-4b40-82f1-858d74834954,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:32.104330 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-667ac0d9-9ade-460e-85ac-dad8ba2f4b84 None None] Provisioning complete for port de13f219-3194-4b40-82f1-858d74834954 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:25:32.105048 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-667ac0d9-9ade-460e-85ac-dad8ba2f4b84 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:32.156217 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1305906706', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100'}], 'enable_snat': True}, 'gw_port_id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:28Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:b1:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4253, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'de13f219-3194-4b40-82f1-858d74834954', 'name': '', 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:eb:89:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'device_owner': 'network:router_interface', 'standard_attr_id': 4256, 'fixed_ips': [{'subnet_id': '69d8febf-3c3f-4c98-b084-716a5362ebc6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:25:28Z', 'updated_at': '2021-12-09T22:25:31Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '69d8febf-3c3f-4c98-b084-716a5362ebc6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:25:32.182403 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9ac65397-579e-40a0-92ed-74621e856ed3 None None] The sync data for ids ['a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'] in n-d-713301-27 is: [{'id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1305906706', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100'}], 'enable_snat': True}, 'gw_port_id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:28Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:b1:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4253, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'de13f219-3194-4b40-82f1-858d74834954', 'name': '', 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:eb:89:7f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'device_owner': 'network:router_interface', 'standard_attr_id': 4256, 'fixed_ips': [{'subnet_id': '69d8febf-3c3f-4c98-b084-716a5362ebc6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:25:28Z', 'updated_at': '2021-12-09T22:25:31Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '69d8febf-3c3f-4c98-b084-716a5362ebc6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:25:32.467211 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device dd318939-4b9c-4ea2-8945-0b54cd734bfe up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:25:32.516224 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port dd318939-4b9c-4ea2-8945-0b54cd734bfe triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:25:32.516588 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:32.599126 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device de13f219-3194-4b40-82f1-858d74834954 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:25:32.648021 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port de13f219-3194-4b40-82f1-858d74834954 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:25:32.648396 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:32.947190 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ccdeabe7-465a-4ec5-b37c-e1893ccdf81a req-8435865e-178e-4232-83e5-269136c3f59b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 210 time: 0.0365217 Dec 09 22:25:33.047103 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-25f40c2d-1c0b-4cf4-b31f-c39869997796 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:34.032450 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-90deae3b-9e37-49e8-94b3-4753798af813 req-d3f3bb6e-d6d0-46ff-b5f8-cf9984010b6b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 210 time: 0.0304570 Dec 09 22:25:35.133119 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bcb6aeef-c7ec-47cb-bc4d-b1785e540a01 req-fc3018f4-c359-4d5a-ae87-4165e59b2821 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 210 time: 0.0262754 Dec 09 22:25:35.681622 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-38763cee-6bb7-4f3c-8760-531d41543612 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:35.904367 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86e684be-d244-4917-b088-b00bf21cbc85 req-2b1866ee-84d1-452a-b1dc-90c3b37bc087 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:35.905854 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86e684be-d244-4917-b088-b00bf21cbc85 req-2b1866ee-84d1-452a-b1dc-90c3b37bc087 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.31 "GET /v2.0/networks?id=4acfc0bf-ef93-4f01-883a-4e582d1c06d7 HTTP/1.1" status: 200 len: 796 time: 0.1103687 Dec 09 22:25:35.971747 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86e684be-d244-4917-b088-b00bf21cbc85 req-81cdb395-8e69-4522-8bd5-3387637f014c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=e21dff80515b44aa9f01117603c6de0d HTTP/1.1" status: 200 len: 380 time: 0.0560312 Dec 09 22:25:35.982074 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-86e684be-d244-4917-b088-b00bf21cbc85 req-c7a7cc12-1cb0-4e2f-86cb-cc6897fa2a68 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'port': {'device_id': 'b6c58196-eefa-447d-aa8b-c346e9bca4c9', 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7', 'admin_state_up': True, 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'security_groups': ['0457c075-7ec0-4df4-9722-66642b37f50d']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:25:36.098416 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-86e684be-d244-4917-b088-b00bf21cbc85 req-c7a7cc12-1cb0-4e2f-86cb-cc6897fa2a68 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Made reservation on behalf of e21dff80515b44aa9f01117603c6de0d for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:25:36.102210 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-86e684be-d244-4917-b088-b00bf21cbc85 req-c7a7cc12-1cb0-4e2f-86cb-cc6897fa2a68 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:36.226874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-86e684be-d244-4917-b088-b00bf21cbc85 req-c7a7cc12-1cb0-4e2f-86cb-cc6897fa2a68 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Allocated IP 172.20.0.6 (4acfc0bf-ef93-4f01-883a-4e582d1c06d7/69d8febf-3c3f-4c98-b084-716a5362ebc6/bf2142c4-6b6c-44ec-aa5b-b452734180dc) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:25:36.228414 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3347ed04-951d-4d00-b6d7-2773fd70c640 req-0e3ce35f-ff9d-4032-ae58-56588e47b133 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 210 time: 0.0262263 Dec 09 22:25:36.377658 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-86e684be-d244-4917-b088-b00bf21cbc85 req-c7a7cc12-1cb0-4e2f-86cb-cc6897fa2a68 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:36.424282 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-86e684be-d244-4917-b088-b00bf21cbc85 req-c7a7cc12-1cb0-4e2f-86cb-cc6897fa2a68 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:36.467082 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-86e684be-d244-4917-b088-b00bf21cbc85 req-c7a7cc12-1cb0-4e2f-86cb-cc6897fa2a68 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network 4acfc0bf-ef93-4f01-883a-4e582d1c06d7 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:25:36.470495 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-86e684be-d244-4917-b088-b00bf21cbc85 req-c7a7cc12-1cb0-4e2f-86cb-cc6897fa2a68 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:25:36.476991 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-86e684be-d244-4917-b088-b00bf21cbc85 req-c7a7cc12-1cb0-4e2f-86cb-cc6897fa2a68 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:25:36.482714 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7a7cc12-1cb0-4e2f-86cb-cc6897fa2a68 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=bf2142c4-6b6c-44ec-aa5b-b452734180dc,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:36.530697 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86e684be-d244-4917-b088-b00bf21cbc85 req-c7a7cc12-1cb0-4e2f-86cb-cc6897fa2a68 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:36.531409 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-86e684be-d244-4917-b088-b00bf21cbc85 req-c7a7cc12-1cb0-4e2f-86cb-cc6897fa2a68 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:36.548885 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86e684be-d244-4917-b088-b00bf21cbc85 req-c7a7cc12-1cb0-4e2f-86cb-cc6897fa2a68 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5704653 Dec 09 22:25:36.561003 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-86e684be-d244-4917-b088-b00bf21cbc85 req-a78bb4d7-3185-45d9-8714-762ef44b60d8 service neutron] Request body: {'port': {'device_id': 'b6c58196-eefa-447d-aa8b-c346e9bca4c9', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:25:36.623674 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-86e684be-d244-4917-b088-b00bf21cbc85 req-a78bb4d7-3185-45d9-8714-762ef44b60d8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:36.740071 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-6ddbf814-50c2-4e85-ae7c-77696df8ba63 None None] Provisioning complete for port bf2142c4-6b6c-44ec-aa5b-b452734180dc triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:25:36.740646 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6ddbf814-50c2-4e85-ae7c-77696df8ba63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:36.777480 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-6ddbf814-50c2-4e85-ae7c-77696df8ba63 None None] Port bf2142c4-6b6c-44ec-aa5b-b452734180dc cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:25:36.882572 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:36.899641 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-86e684be-d244-4917-b088-b00bf21cbc85 req-a78bb4d7-3185-45d9-8714-762ef44b60d8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bf2142c4-6b6c-44ec-aa5b-b452734180dc {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:25:36.907477 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-86e684be-d244-4917-b088-b00bf21cbc85 req-a78bb4d7-3185-45d9-8714-762ef44b60d8 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:36.920352 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-86e684be-d244-4917-b088-b00bf21cbc85 req-a78bb4d7-3185-45d9-8714-762ef44b60d8 service neutron] Transition to ACTIVE for port object bf2142c4-6b6c-44ec-aa5b-b452734180dc will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:25:36.925862 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-86e684be-d244-4917-b088-b00bf21cbc85 req-a78bb4d7-3185-45d9-8714-762ef44b60d8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:36.980074 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a78bb4d7-3185-45d9-8714-762ef44b60d8 service neutron] Pushing event updated for resources: {'Port': ['ID=bf2142c4-6b6c-44ec-aa5b-b452734180dc,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:37.051029 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-86e684be-d244-4917-b088-b00bf21cbc85 req-a78bb4d7-3185-45d9-8714-762ef44b60d8 service neutron] Attempting to bind port bf2142c4-6b6c-44ec-aa5b-b452734180dc on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:25:37.051368 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-86e684be-d244-4917-b088-b00bf21cbc85 req-a78bb4d7-3185-45d9-8714-762ef44b60d8 service neutron] Attempting to bind port bf2142c4-6b6c-44ec-aa5b-b452734180dc by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': 'd634afa7-444c-47d3-9e02-42921e0c3151', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:25:37.051755 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86e684be-d244-4917-b088-b00bf21cbc85 req-a78bb4d7-3185-45d9-8714-762ef44b60d8 service neutron] Attempting to bind port bf2142c4-6b6c-44ec-aa5b-b452734180dc on network 4acfc0bf-ef93-4f01-883a-4e582d1c06d7 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:25:37.059464 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86e684be-d244-4917-b088-b00bf21cbc85 req-a78bb4d7-3185-45d9-8714-762ef44b60d8 service neutron] Port bf2142c4-6b6c-44ec-aa5b-b452734180dc on network 4acfc0bf-ef93-4f01-883a-4e582d1c06d7 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:25:37.059960 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86e684be-d244-4917-b088-b00bf21cbc85 req-a78bb4d7-3185-45d9-8714-762ef44b60d8 service neutron] Attempting to bind port bf2142c4-6b6c-44ec-aa5b-b452734180dc on network 4acfc0bf-ef93-4f01-883a-4e582d1c06d7 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:25:37.066506 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86e684be-d244-4917-b088-b00bf21cbc85 req-a78bb4d7-3185-45d9-8714-762ef44b60d8 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 25, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:25:37.066896 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86e684be-d244-4917-b088-b00bf21cbc85 req-a78bb4d7-3185-45d9-8714-762ef44b60d8 service neutron] Checking segment: {'id': 'd634afa7-444c-47d3-9e02-42921e0c3151', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:25:37.067315 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86e684be-d244-4917-b088-b00bf21cbc85 req-a78bb4d7-3185-45d9-8714-762ef44b60d8 service neutron] Bound using segment: {'id': 'd634afa7-444c-47d3-9e02-42921e0c3151', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:25:37.067874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-86e684be-d244-4917-b088-b00bf21cbc85 req-a78bb4d7-3185-45d9-8714-762ef44b60d8 service neutron] Bound port: bf2142c4-6b6c-44ec-aa5b-b452734180dc, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd634afa7-444c-47d3-9e02-42921e0c3151', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:25:37.068142 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-86e684be-d244-4917-b088-b00bf21cbc85 req-a78bb4d7-3185-45d9-8714-762ef44b60d8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:37.135268 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-86e684be-d244-4917-b088-b00bf21cbc85 req-a78bb4d7-3185-45d9-8714-762ef44b60d8 service neutron] For port bf2142c4-6b6c-44ec-aa5b-b452734180dc, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:25:37.138907 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-86e684be-d244-4917-b088-b00bf21cbc85 req-a78bb4d7-3185-45d9-8714-762ef44b60d8 service neutron] For port bf2142c4-6b6c-44ec-aa5b-b452734180dc, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=bf2142c4-6b6c-44ec-aa5b-b452734180dc,segment=NetworkSegment(d634afa7-444c-47d3-9e02-42921e0c3151),segment_id=d634afa7-444c-47d3-9e02-42921e0c3151)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:25:37.143102 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-86e684be-d244-4917-b088-b00bf21cbc85 req-a78bb4d7-3185-45d9-8714-762ef44b60d8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:37.179736 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86e684be-d244-4917-b088-b00bf21cbc85 req-a78bb4d7-3185-45d9-8714-762ef44b60d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:37.180365 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-86e684be-d244-4917-b088-b00bf21cbc85 req-a78bb4d7-3185-45d9-8714-762ef44b60d8 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:37.181752 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86e684be-d244-4917-b088-b00bf21cbc85 req-a78bb4d7-3185-45d9-8714-762ef44b60d8 service neutron] 10.222.0.31 "PUT /v2.0/ports/bf2142c4-6b6c-44ec-aa5b-b452734180dc HTTP/1.1" status: 200 len: 1092 time: 0.6252060 Dec 09 22:25:37.182223 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b6c58196-eefa-447d-aa8b-c346e9bca4c9', 'tag': 'bf2142c4-6b6c-44ec-aa5b-b452734180dc'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:25:37.184519 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f4d951a8-0f10-41fa-a4de-3d13d0f6d6e4" -d '{"events": [{"name": "network-changed", "server_uuid": "b6c58196-eefa-447d-aa8b-c346e9bca4c9", "tag": "bf2142c4-6b6c-44ec-aa5b-b452734180dc"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:25:37.219776 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a78bb4d7-3185-45d9-8714-762ef44b60d8 service neutron] Pushing event updated for resources: {'Port': ['ID=bf2142c4-6b6c-44ec-aa5b-b452734180dc,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:37.257283 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:25:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dd228b8b-4b8c-4268-b2ab-d631943a3141 x-openstack-request-id: req-dd228b8b-4b8c-4268-b2ab-d631943a3141 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:25:37.257584 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b6c58196-eefa-447d-aa8b-c346e9bca4c9", "tag": "bf2142c4-6b6c-44ec-aa5b-b452734180dc", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:25:37.257842 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-dd228b8b-4b8c-4268-b2ab-d631943a3141 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:25:37.258265 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b6c58196-eefa-447d-aa8b-c346e9bca4c9', 'tag': 'bf2142c4-6b6c-44ec-aa5b-b452734180dc', 'status': 'completed', 'code': 200} Dec 09 22:25:37.275127 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86e684be-d244-4917-b088-b00bf21cbc85 req-95ceffaa-a370-4762-8db9-8d31d1a990fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:37.276714 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86e684be-d244-4917-b088-b00bf21cbc85 req-95ceffaa-a370-4762-8db9-8d31d1a990fe service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 1095 time: 0.0482879 Dec 09 22:25:37.323932 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86e684be-d244-4917-b088-b00bf21cbc85 req-d638c243-8ca2-417d-9599-d94410cfc91d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bf2142c4-6b6c-44ec-aa5b-b452734180dc HTTP/1.1" status: 200 len: 217 time: 0.0375121 Dec 09 22:25:37.353940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c675f05-ddff-4832-8355-f621115d5c98 req-0ff95b61-cb31-4358-96ec-4924fe5ee787 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:37.355530 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c675f05-ddff-4832-8355-f621115d5c98 req-0ff95b61-cb31-4358-96ec-4924fe5ee787 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 943 time: 0.0521138 Dec 09 22:25:37.381672 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86e684be-d244-4917-b088-b00bf21cbc85 req-8ac2c042-05a3-4366-9f5f-d161fb7a1076 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:37.383230 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86e684be-d244-4917-b088-b00bf21cbc85 req-8ac2c042-05a3-4366-9f5f-d161fb7a1076 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=69d8febf-3c3f-4c98-b084-716a5362ebc6 HTTP/1.1" status: 200 len: 834 time: 0.0521727 Dec 09 22:25:37.409425 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c675f05-ddff-4832-8355-f621115d5c98 req-7e902e1b-df4d-408b-9f7d-4e41cfb1f60c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462010 Dec 09 22:25:37.434160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86e684be-d244-4917-b088-b00bf21cbc85 req-83e3733a-e085-4ff2-8ba8-a8dd97c22d9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:37.435832 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86e684be-d244-4917-b088-b00bf21cbc85 req-83e3733a-e085-4ff2-8ba8-a8dd97c22d9a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=4acfc0bf-ef93-4f01-883a-4e582d1c06d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0457201 Dec 09 22:25:37.525295 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86e684be-d244-4917-b088-b00bf21cbc85 req-e2fb6ad7-e852-4e65-aecf-ef81e82fa672 service neutron] 10.222.0.31 "GET /v2.0/networks/4acfc0bf-ef93-4f01-883a-4e582d1c06d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0823209 Dec 09 22:25:37.619289 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86e684be-d244-4917-b088-b00bf21cbc85 req-fadb40d6-60a0-4e24-a2d8-20b65f36802e service neutron] 10.222.0.31 "GET /v2.0/networks/4acfc0bf-ef93-4f01-883a-4e582d1c06d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0872052 Dec 09 22:25:37.725775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4d951a8-0f10-41fa-a4de-3d13d0f6d6e4 req-f8fad6d7-84f6-4d98-92f0-857da2fe3b58 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:37.727343 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f4d951a8-0f10-41fa-a4de-3d13d0f6d6e4 req-f8fad6d7-84f6-4d98-92f0-857da2fe3b58 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 1095 time: 0.0565305 Dec 09 22:25:37.823625 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4d951a8-0f10-41fa-a4de-3d13d0f6d6e4 req-7ee6df5b-c508-45a7-a99b-93955e6053ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:37.825291 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f4d951a8-0f10-41fa-a4de-3d13d0f6d6e4 req-7ee6df5b-c508-45a7-a99b-93955e6053ee service neutron] 10.222.0.31 "GET /v2.0/networks?id=4acfc0bf-ef93-4f01-883a-4e582d1c06d7 HTTP/1.1" status: 200 len: 897 time: 0.0902259 Dec 09 22:25:37.867514 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f4d951a8-0f10-41fa-a4de-3d13d0f6d6e4 req-ca6382e3-895a-4e98-8027-376778aeda33 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bf2142c4-6b6c-44ec-aa5b-b452734180dc HTTP/1.1" status: 200 len: 217 time: 0.0349014 Dec 09 22:25:37.919177 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4d951a8-0f10-41fa-a4de-3d13d0f6d6e4 req-36284cd5-9396-4b8c-859b-cde1cece65c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:37.921011 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f4d951a8-0f10-41fa-a4de-3d13d0f6d6e4 req-36284cd5-9396-4b8c-859b-cde1cece65c2 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=69d8febf-3c3f-4c98-b084-716a5362ebc6 HTTP/1.1" status: 200 len: 834 time: 0.0456014 Dec 09 22:25:37.976238 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4d951a8-0f10-41fa-a4de-3d13d0f6d6e4 req-c02fbba3-6b4b-4d75-af2b-9ddc21c52908 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:37.977744 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f4d951a8-0f10-41fa-a4de-3d13d0f6d6e4 req-c02fbba3-6b4b-4d75-af2b-9ddc21c52908 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=4acfc0bf-ef93-4f01-883a-4e582d1c06d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0482609 Dec 09 22:25:38.068741 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f4d951a8-0f10-41fa-a4de-3d13d0f6d6e4 req-b490e5f3-b470-440c-be58-805f6d1e4d72 service neutron] 10.222.0.31 "GET /v2.0/networks/4acfc0bf-ef93-4f01-883a-4e582d1c06d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0828354 Dec 09 22:25:38.171965 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f4d951a8-0f10-41fa-a4de-3d13d0f6d6e4 req-6e0ecff8-0f03-4d63-aad1-a523a96c576d service neutron] 10.222.0.31 "GET /v2.0/networks/4acfc0bf-ef93-4f01-883a-4e582d1c06d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0944307 Dec 09 22:25:38.231905 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:38.538459 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d7bbe3a-6e5c-48c5-81eb-909dc04c903f req-527f75dc-4a6f-4f2c-b681-f8335a1113c7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:38.541312 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5d7bbe3a-6e5c-48c5-81eb-909dc04c903f req-527f75dc-4a6f-4f2c-b681-f8335a1113c7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 943 time: 0.0523932 Dec 09 22:25:38.591723 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5d7bbe3a-6e5c-48c5-81eb-909dc04c903f req-92b1ebde-0f43-41f5-8892-b01820275a8e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426002 Dec 09 22:25:39.699062 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:39.723619 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40ea1f10-17ae-4d4d-8da2-e354e505f2d5 req-51265260-fa79-4dad-a853-b59537bec00d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:39.725125 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-40ea1f10-17ae-4d4d-8da2-e354e505f2d5 req-51265260-fa79-4dad-a853-b59537bec00d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 943 time: 0.0521703 Dec 09 22:25:39.775662 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-40ea1f10-17ae-4d4d-8da2-e354e505f2d5 req-d9bd77ba-cd0c-48a9-bcd1-0747ad0355ec tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444002 Dec 09 22:25:40.901027 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c33187f0-09a4-4df8-aeb8-376c7e1cbb1c req-c3d7e543-0cf6-49f8-8171-a7152a951c93 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:40.902523 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c33187f0-09a4-4df8-aeb8-376c7e1cbb1c req-c3d7e543-0cf6-49f8-8171-a7152a951c93 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 943 time: 0.0500827 Dec 09 22:25:40.959674 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c33187f0-09a4-4df8-aeb8-376c7e1cbb1c req-19124936-ff9f-4829-b33f-b177013b6fb4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0500433 Dec 09 22:25:41.055250 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device bf2142c4-6b6c-44ec-aa5b-b452734180dc details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:25:41.164893 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port bf2142c4-6b6c-44ec-aa5b-b452734180dc, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=bf2142c4-6b6c-44ec-aa5b-b452734180dc,segment=NetworkSegment(d634afa7-444c-47d3-9e02-42921e0c3151),segment_id=d634afa7-444c-47d3-9e02-42921e0c3151)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:25:41.184137 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'bf2142c4-6b6c-44ec-aa5b-b452734180dc', 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7', 'port_id': 'bf2142c4-6b6c-44ec-aa5b-b452734180dc', 'mac_address': 'fa:16:3e:07:46:3a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 130, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '69d8febf-3c3f-4c98-b084-716a5362ebc6', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:25:41.229853 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:41.243793 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bf2142c4-6b6c-44ec-aa5b-b452734180dc {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:25:41.264899 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port bf2142c4-6b6c-44ec-aa5b-b452734180dc, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=bf2142c4-6b6c-44ec-aa5b-b452734180dc,segment=NetworkSegment(d634afa7-444c-47d3-9e02-42921e0c3151),segment_id=d634afa7-444c-47d3-9e02-42921e0c3151)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:25:41.271780 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:41.318870 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=bf2142c4-6b6c-44ec-aa5b-b452734180dc,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:41.324324 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:25:41.503745 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['bf2142c4-6b6c-44ec-aa5b-b452734180dc'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:25:42.087544 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4d733af-d952-4756-88f3-7e1d25740894 req-dfdae049-3fbd-454f-a64f-0a161bdd2207 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:42.089001 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b4d733af-d952-4756-88f3-7e1d25740894 req-dfdae049-3fbd-454f-a64f-0a161bdd2207 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 944 time: 0.0508182 Dec 09 22:25:42.141046 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b4d733af-d952-4756-88f3-7e1d25740894 req-ccae7ab5-948d-4c97-853a-64269e89f312 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459325 Dec 09 22:25:43.054970 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device bf2142c4-6b6c-44ec-aa5b-b452734180dc up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:25:43.113415 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port bf2142c4-6b6c-44ec-aa5b-b452734180dc completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:25:43.118445 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port bf2142c4-6b6c-44ec-aa5b-b452734180dc triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:25:43.118937 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:43.202517 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:43.225156 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b6c58196-eefa-447d-aa8b-c346e9bca4c9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bf2142c4-6b6c-44ec-aa5b-b452734180dc'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:25:43.227394 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3d519b58-ea15-4396-a128-a90f8af0857c" -d '{"events": [{"server_uuid": "b6c58196-eefa-447d-aa8b-c346e9bca4c9", "name": "network-vif-plugged", "status": "completed", "tag": "bf2142c4-6b6c-44ec-aa5b-b452734180dc"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:25:43.239959 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port bf2142c4-6b6c-44ec-aa5b-b452734180dc, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=bf2142c4-6b6c-44ec-aa5b-b452734180dc,segment=NetworkSegment(d634afa7-444c-47d3-9e02-42921e0c3151),segment_id=d634afa7-444c-47d3-9e02-42921e0c3151)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:25:43.244682 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:43.267704 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82974fee-08ca-4310-b452-bbb1cd12dfe8 req-6d002114-84af-4e17-8a5f-18334e81abf9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:43.269289 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-82974fee-08ca-4310-b452-bbb1cd12dfe8 req-6d002114-84af-4e17-8a5f-18334e81abf9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 944 time: 0.0512297 Dec 09 22:25:43.292477 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=bf2142c4-6b6c-44ec-aa5b-b452734180dc,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:43.320294 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-82974fee-08ca-4310-b452-bbb1cd12dfe8 req-1b6d7a22-c5c5-4549-9eb0-c8773c3e4483 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446994 Dec 09 22:25:43.364253 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:25:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-044addaa-3012-4949-a49c-1ec2422330a0 x-openstack-request-id: req-044addaa-3012-4949-a49c-1ec2422330a0 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:25:43.364490 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b6c58196-eefa-447d-aa8b-c346e9bca4c9", "name": "network-vif-plugged", "status": "completed", "tag": "bf2142c4-6b6c-44ec-aa5b-b452734180dc", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:25:43.364733 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-044addaa-3012-4949-a49c-1ec2422330a0 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:25:43.365128 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b6c58196-eefa-447d-aa8b-c346e9bca4c9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bf2142c4-6b6c-44ec-aa5b-b452734180dc', 'code': 200} Dec 09 22:25:43.472611 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2040401e-6a56-4d10-8028-76a808804964 req-7f577202-358c-4a6d-9541-40d9f53c6a31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:43.474120 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2040401e-6a56-4d10-8028-76a808804964 req-7f577202-358c-4a6d-9541-40d9f53c6a31 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 1097 time: 0.0431595 Dec 09 22:25:43.523218 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2040401e-6a56-4d10-8028-76a808804964 req-6695bd54-c3f4-4fc1-9a3e-6e09f3b4fe75 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416710 Dec 09 22:25:44.449728 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60e08718-cdd7-4ccc-89a8-437a4800f288 req-2b521be0-9c79-4e33-a1c2-ce8b20868dee tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:44.451222 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60e08718-cdd7-4ccc-89a8-437a4800f288 req-2b521be0-9c79-4e33-a1c2-ce8b20868dee tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 945 time: 0.0569847 Dec 09 22:25:44.501685 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-60e08718-cdd7-4ccc-89a8-437a4800f288 req-570b5871-0864-43e4-b4a0-245202ea6167 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438001 Dec 09 22:25:45.643470 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eec0a9a8-cdad-4c82-a2cf-5ade917de12b req-bc19971c-af3b-4a84-824e-26ad5b2ff4a6 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:45.645224 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eec0a9a8-cdad-4c82-a2cf-5ade917de12b req-bc19971c-af3b-4a84-824e-26ad5b2ff4a6 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 945 time: 0.0529280 Dec 09 22:25:45.696928 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eec0a9a8-cdad-4c82-a2cf-5ade917de12b req-38e9d51e-4155-4604-9e8f-c855b42b5830 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457549 Dec 09 22:25:45.821868 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0f074fe-bada-4167-8d20-878819e6860d req-f02a44cb-af61-44b7-8d71-29249c7217b6 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:45.823273 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0f074fe-bada-4167-8d20-878819e6860d req-f02a44cb-af61-44b7-8d71-29249c7217b6 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 945 time: 0.0545840 Dec 09 22:25:45.875176 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0f074fe-bada-4167-8d20-878819e6860d req-94b83158-eb86-47a5-856f-29d515574eae tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436308 Dec 09 22:25:45.898394 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34372) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:45.939671 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb7ae2bb-a59a-42f6-8f11-93502ce0883d tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:45.941312 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-eb7ae2bb-a59a-42f6-8f11-93502ce0883d tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 1092 time: 0.0417480 Dec 09 22:25:45.945518 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34374) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:45.949795 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-c6992ff4-9e8c-4df1-8bf0-3755c1104267 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': 'bf2142c4-6b6c-44ec-aa5b-b452734180dc', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ip_address': '172.20.0.6'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:25:45.977908 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6992ff4-9e8c-4df1-8bf0-3755c1104267 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for floatingip, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:46.108275 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6992ff4-9e8c-4df1-8bf0-3755c1104267 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:46.212570 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-c6992ff4-9e8c-4df1-8bf0-3755c1104267 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Allocated IP 172.25.3.113 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/26048042-4c86-430b-928a-51936ab994ed) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:25:46.312328 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6992ff4-9e8c-4df1-8bf0-3755c1104267 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:46.347532 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6992ff4-9e8c-4df1-8bf0-3755c1104267 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:46.388582 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6992ff4-9e8c-4df1-8bf0-3755c1104267 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:25:46.393293 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-c6992ff4-9e8c-4df1-8bf0-3755c1104267 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:25:46.400238 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6992ff4-9e8c-4df1-8bf0-3755c1104267 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:25:46.406416 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6992ff4-9e8c-4df1-8bf0-3755c1104267 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=26048042-4c86-430b-928a-51936ab994ed,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:46.794575 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6992ff4-9e8c-4df1-8bf0-3755c1104267 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:46.895112 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6992ff4-9e8c-4df1-8bf0-3755c1104267 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:47.100825 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6992ff4-9e8c-4df1-8bf0-3755c1104267 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:47.109296 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6992ff4-9e8c-4df1-8bf0-3755c1104267 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:47.200510 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6992ff4-9e8c-4df1-8bf0-3755c1104267 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=26048042-4c86-430b-928a-51936ab994ed,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:25:47.209235 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6992ff4-9e8c-4df1-8bf0-3755c1104267 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:47.335301 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-c6992ff4-9e8c-4df1-8bf0-3755c1104267 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Floating IP f669f9d7-e637-4a06-ab45-46ddefbecab9 associated. External IP: 172.25.3.113, port: bf2142c4-6b6c-44ec-aa5b-b452734180dc. Dec 09 22:25:47.589569 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c6992ff4-9e8c-4df1-8bf0-3755c1104267 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:25:47.702353 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c6992ff4-9e8c-4df1-8bf0-3755c1104267 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:25:47.714216 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c31a3a82-7f5e-4577-b590-40b6d97b5028 None None] Sync routers for ids ['a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:25:47.725493 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c31a3a82-7f5e-4577-b590-40b6d97b5028 None None] Routers {'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:25:47.726105 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c6992ff4-9e8c-4df1-8bf0-3755c1104267 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:47.726258 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-c31a3a82-7f5e-4577-b590-40b6d97b5028 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:25:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:25:47.753889 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c6992ff4-9e8c-4df1-8bf0-3755c1104267 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8072894 Dec 09 22:25:47.754841 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b6c58196-eefa-447d-aa8b-c346e9bca4c9', 'tag': 'bf2142c4-6b6c-44ec-aa5b-b452734180dc'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:25:47.757329 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7bbbfb8a-242d-4b31-bc22-11b8f171f420" -d '{"events": [{"name": "network-changed", "server_uuid": "b6c58196-eefa-447d-aa8b-c346e9bca4c9", "tag": "bf2142c4-6b6c-44ec-aa5b-b452734180dc"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:25:47.833014 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-c31a3a82-7f5e-4577-b590-40b6d97b5028 None None] Set router a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:25:47.853319 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c8dc429-1c05-4e38-9c27-624ed629edd2 req-7677bc62-1bae-4989-ae72-917647e78a76 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:47.854746 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3c8dc429-1c05-4e38-9c27-624ed629edd2 req-7677bc62-1bae-4989-ae72-917647e78a76 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 945 time: 0.0493035 Dec 09 22:25:47.904501 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3c8dc429-1c05-4e38-9c27-624ed629edd2 req-1dff6464-8510-4ade-bf85-d3f50d84a42f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433502 Dec 09 22:25:47.928040 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34380) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:47.949398 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:25:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e1ae3eef-ee2a-4d53-b170-9c7252ac300d x-openstack-request-id: req-e1ae3eef-ee2a-4d53-b170-9c7252ac300d {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:25:47.949694 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b6c58196-eefa-447d-aa8b-c346e9bca4c9", "tag": "bf2142c4-6b6c-44ec-aa5b-b452734180dc", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:25:47.949953 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e1ae3eef-ee2a-4d53-b170-9c7252ac300d {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:25:47.950368 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b6c58196-eefa-447d-aa8b-c346e9bca4c9', 'tag': 'bf2142c4-6b6c-44ec-aa5b-b452734180dc', 'status': 'completed', 'code': 200} Dec 09 22:25:47.996522 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-13793657-f780-4d31-a34c-3d437e7ebade tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/floatingips/f669f9d7-e637-4a06-ab45-46ddefbecab9 HTTP/1.1" status: 200 len: 991 time: 0.0658481 Dec 09 22:25:48.019118 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bbbfb8a-242d-4b31-bc22-11b8f171f420 req-bcd3d00e-dac9-4ed9-8bc0-634a497d6ac6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:48.020985 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bbbfb8a-242d-4b31-bc22-11b8f171f420 req-bcd3d00e-dac9-4ed9-8bc0-634a497d6ac6 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 1097 time: 0.0480793 Dec 09 22:25:48.062619 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-c31a3a82-7f5e-4577-b590-40b6d97b5028 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1305906706', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100'}], 'enable_snat': True}, 'gw_port_id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:28Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:b1:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4253, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'f669f9d7-e637-4a06-ab45-46ddefbecab9', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'floating_ip_address': '172.25.3.113', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'port_id': 'bf2142c4-6b6c-44ec-aa5b-b452734180dc', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4259, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7', 'mac_address': 'fa:16:3e:07:46:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b6c58196-eefa-447d-aa8b-c346e9bca4c9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:25:46Z', 'updated_at': '2021-12-09T22:25:46Z', 'revision_number': 0, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'de13f219-3194-4b40-82f1-858d74834954', 'name': '', 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:eb:89:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'device_owner': 'network:router_interface', 'standard_attr_id': 4256, 'fixed_ips': [{'subnet_id': '69d8febf-3c3f-4c98-b084-716a5362ebc6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:25:28Z', 'updated_at': '2021-12-09T22:25:31Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '69d8febf-3c3f-4c98-b084-716a5362ebc6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:25:48.092534 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c31a3a82-7f5e-4577-b590-40b6d97b5028 None None] Checking router: a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:25:48.101230 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c31a3a82-7f5e-4577-b590-40b6d97b5028 None None] Routers {'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:25:48.101855 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-c31a3a82-7f5e-4577-b590-40b6d97b5028 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:25:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:25:48.117800 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bbbfb8a-242d-4b31-bc22-11b8f171f420 req-b0b7ce04-5f37-44ab-a5de-933a8bdc9b98 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:48.119249 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bbbfb8a-242d-4b31-bc22-11b8f171f420 req-b0b7ce04-5f37-44ab-a5de-933a8bdc9b98 service neutron] 10.222.0.31 "GET /v2.0/networks?id=4acfc0bf-ef93-4f01-883a-4e582d1c06d7 HTTP/1.1" status: 200 len: 897 time: 0.0909519 Dec 09 22:25:48.184499 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bbbfb8a-242d-4b31-bc22-11b8f171f420 req-0dc1e13d-9c7c-49d3-b3f2-31358e2cfd1d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bf2142c4-6b6c-44ec-aa5b-b452734180dc HTTP/1.1" status: 200 len: 999 time: 0.0585184 Dec 09 22:25:48.218734 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-c31a3a82-7f5e-4577-b590-40b6d97b5028 None None] Set router a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:25:48.237751 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bbbfb8a-242d-4b31-bc22-11b8f171f420 req-859f8c1f-bf34-402e-81bb-64b0c961a45c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:48.239409 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bbbfb8a-242d-4b31-bc22-11b8f171f420 req-859f8c1f-bf34-402e-81bb-64b0c961a45c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=69d8febf-3c3f-4c98-b084-716a5362ebc6 HTTP/1.1" status: 200 len: 834 time: 0.0472324 Dec 09 22:25:48.293520 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bbbfb8a-242d-4b31-bc22-11b8f171f420 req-9f3cf92f-fa5a-4041-91e3-f17f66fc2869 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:25:48.295122 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bbbfb8a-242d-4b31-bc22-11b8f171f420 req-9f3cf92f-fa5a-4041-91e3-f17f66fc2869 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=4acfc0bf-ef93-4f01-883a-4e582d1c06d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0493526 Dec 09 22:25:48.393327 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bbbfb8a-242d-4b31-bc22-11b8f171f420 req-06cb83f8-22e4-4867-9a6e-caa964dc3e42 service neutron] 10.222.0.31 "GET /v2.0/networks/4acfc0bf-ef93-4f01-883a-4e582d1c06d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0907493 Dec 09 22:25:48.490958 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bbbfb8a-242d-4b31-bc22-11b8f171f420 req-6449427a-deb1-4027-8a0f-f29976cd500a service neutron] 10.222.0.31 "GET /v2.0/networks/4acfc0bf-ef93-4f01-883a-4e582d1c06d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0907311 Dec 09 22:25:48.615005 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-c31a3a82-7f5e-4577-b590-40b6d97b5028 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1305906706', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100'}], 'enable_snat': True}, 'gw_port_id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:28Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:b1:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4253, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'f669f9d7-e637-4a06-ab45-46ddefbecab9', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'floating_ip_address': '172.25.3.113', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'port_id': 'bf2142c4-6b6c-44ec-aa5b-b452734180dc', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4259, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7', 'mac_address': 'fa:16:3e:07:46:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b6c58196-eefa-447d-aa8b-c346e9bca4c9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:25:46Z', 'updated_at': '2021-12-09T22:25:46Z', 'revision_number': 0, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'de13f219-3194-4b40-82f1-858d74834954', 'name': '', 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:eb:89:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'device_owner': 'network:router_interface', 'standard_attr_id': 4256, 'fixed_ips': [{'subnet_id': '69d8febf-3c3f-4c98-b084-716a5362ebc6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:25:28Z', 'updated_at': '2021-12-09T22:25:31Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '69d8febf-3c3f-4c98-b084-716a5362ebc6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:25:48.643998 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c31a3a82-7f5e-4577-b590-40b6d97b5028 None None] The sync data for ids ['a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'] in n-d-713301-27 is: [{'id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1305906706', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100'}], 'enable_snat': True}, 'gw_port_id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:28Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:b1:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4253, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'f669f9d7-e637-4a06-ab45-46ddefbecab9', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'floating_ip_address': '172.25.3.113', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'port_id': 'bf2142c4-6b6c-44ec-aa5b-b452734180dc', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4259, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7', 'mac_address': 'fa:16:3e:07:46:3a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b6c58196-eefa-447d-aa8b-c346e9bca4c9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:25:46Z', 'updated_at': '2021-12-09T22:25:46Z', 'revision_number': 0, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'de13f219-3194-4b40-82f1-858d74834954', 'name': '', 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:eb:89:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'device_owner': 'network:router_interface', 'standard_attr_id': 4256, 'fixed_ips': [{'subnet_id': '69d8febf-3c3f-4c98-b084-716a5362ebc6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:25:28Z', 'updated_at': '2021-12-09T22:25:31Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '69d8febf-3c3f-4c98-b084-716a5362ebc6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:25:48.867304 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c98e5183-a5a4-48bf-a3e9-849bd3e9842f None None] New status for floating IP f669f9d7-e637-4a06-ab45-46ddefbecab9: ACTIVE {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:25:48.998700 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34382) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:49.062128 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a70b6b3f-0125-429b-a3e2-30399e0318fa tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/floatingips/f669f9d7-e637-4a06-ab45-46ddefbecab9 HTTP/1.1" status: 200 len: 991 time: 0.0623567 Dec 09 22:25:50.067499 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34384) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:25:50.140110 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-dbc3b73d-a13b-4011-9eba-395933f75cfe tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/floatingips/f669f9d7-e637-4a06-ab45-46ddefbecab9 HTTP/1.1" status: 200 len: 993 time: 0.0710509 Dec 09 22:25:57.719398 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:25:57.822635 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:03.057141 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-adbf02b5-4772-4039-8155-d27f5c9eea60 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:05.687553 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4f54c87f-4499-48f0-9562-a65fe076d551 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:06.887343 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:08.236766 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:09.715553 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:14.725011 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-499067c8-d984-4990-b669-fd9c9749ef0a req-63c0cc92-12e8-4c28-9b32-3f050ee59410 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0537593 Dec 09 22:26:14.815053 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-499067c8-d984-4990-b669-fd9c9749ef0a req-3c228b9f-be5a-469f-bb4a-0053c63bfcdc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:14.817521 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-499067c8-d984-4990-b669-fd9c9749ef0a req-3c228b9f-be5a-469f-bb4a-0053c63bfcdc service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 1097 time: 0.0442517 Dec 09 22:26:15.283387 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-499067c8-d984-4990-b669-fd9c9749ef0a req-8b0bff07-c2b4-4992-a510-cb06d1c39ac1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:15.284938 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-499067c8-d984-4990-b669-fd9c9749ef0a req-8b0bff07-c2b4-4992-a510-cb06d1c39ac1 service neutron] 10.222.0.31 "GET /v2.0/networks?id=4acfc0bf-ef93-4f01-883a-4e582d1c06d7 HTTP/1.1" status: 200 len: 897 time: 0.4468875 Dec 09 22:26:15.360185 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-499067c8-d984-4990-b669-fd9c9749ef0a req-4b98277f-6165-4d9d-844b-874b65fa4ffb service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bf2142c4-6b6c-44ec-aa5b-b452734180dc HTTP/1.1" status: 200 len: 1001 time: 0.0653594 Dec 09 22:26:15.413635 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-499067c8-d984-4990-b669-fd9c9749ef0a req-228db976-4810-45eb-9f78-92ac5caef875 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:15.415107 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-499067c8-d984-4990-b669-fd9c9749ef0a req-228db976-4810-45eb-9f78-92ac5caef875 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=69d8febf-3c3f-4c98-b084-716a5362ebc6 HTTP/1.1" status: 200 len: 834 time: 0.0472701 Dec 09 22:26:15.467377 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-499067c8-d984-4990-b669-fd9c9749ef0a req-7886938f-2b21-48b8-843d-814d66dbe8be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:15.468923 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-499067c8-d984-4990-b669-fd9c9749ef0a req-7886938f-2b21-48b8-843d-814d66dbe8be service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=4acfc0bf-ef93-4f01-883a-4e582d1c06d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0465488 Dec 09 22:26:15.559342 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-499067c8-d984-4990-b669-fd9c9749ef0a req-c71ebcd0-6b94-49b0-bddf-16ed2d654eb3 service neutron] 10.222.0.31 "GET /v2.0/networks/4acfc0bf-ef93-4f01-883a-4e582d1c06d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0809648 Dec 09 22:26:15.650231 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-499067c8-d984-4990-b669-fd9c9749ef0a req-129f7630-8f09-4962-9a05-99a2832e3705 service neutron] 10.222.0.31 "GET /v2.0/networks/4acfc0bf-ef93-4f01-883a-4e582d1c06d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0837538 Dec 09 22:26:16.963370 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34402) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:26:16.972376 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-721a997d-b446-45f6-98dd-f39572f7905c req-6de0f5d3-ceed-432c-933a-4a947d207e0c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:16.973910 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-721a997d-b446-45f6-98dd-f39572f7905c req-6de0f5d3-ceed-432c-933a-4a947d207e0c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 945 time: 0.0502989 Dec 09 22:26:17.023378 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-721a997d-b446-45f6-98dd-f39572f7905c req-3caa9f17-3501-43da-be7b-6572f773a68c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433598 Dec 09 22:26:17.042424 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d1eef443-91fa-48e4-8709-177e807385b9 req-6c498328-3e82-45b7-8e81-4c0987e8dc0b service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0778513 Dec 09 22:26:17.053564 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-d1eef443-91fa-48e4-8709-177e807385b9 req-323d0f42-79ea-4fc4-9c97-b7d0babe6eef service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 22:26:17.055195 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d1eef443-91fa-48e4-8709-177e807385b9 req-323d0f42-79ea-4fc4-9c97-b7d0babe6eef service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0074573 Dec 09 22:26:18.153514 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb58efc4-edd6-4b60-9aa7-84238e4f92c0 req-62b70ba5-b3b6-40e1-b967-843e2cf0b390 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:18.155128 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eb58efc4-edd6-4b60-9aa7-84238e4f92c0 req-62b70ba5-b3b6-40e1-b967-843e2cf0b390 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 945 time: 0.0558262 Dec 09 22:26:18.206888 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eb58efc4-edd6-4b60-9aa7-84238e4f92c0 req-81b94eb4-955f-4af2-8ab9-64961860a62c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454881 Dec 09 22:26:18.213615 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1eef443-91fa-48e4-8709-177e807385b9 req-b54c3e28-191d-4190-8a2f-e6993467f86b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:18.215148 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d1eef443-91fa-48e4-8709-177e807385b9 req-b54c3e28-191d-4190-8a2f-e6993467f86b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 1097 time: 0.0408959 Dec 09 22:26:18.321192 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1eef443-91fa-48e4-8709-177e807385b9 req-1b14da17-5031-4bd6-98bf-e03a5326ad25 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:18.322714 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d1eef443-91fa-48e4-8709-177e807385b9 req-1b14da17-5031-4bd6-98bf-e03a5326ad25 service neutron] 10.222.0.31 "GET /v2.0/networks?id=4acfc0bf-ef93-4f01-883a-4e582d1c06d7 HTTP/1.1" status: 200 len: 897 time: 0.0998189 Dec 09 22:26:18.324519 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:26:18.394868 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d1eef443-91fa-48e4-8709-177e807385b9 req-a5fcc04a-983c-401e-81f0-bedbf2ad2b21 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bf2142c4-6b6c-44ec-aa5b-b452734180dc HTTP/1.1" status: 200 len: 1001 time: 0.0636647 Dec 09 22:26:18.453300 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1eef443-91fa-48e4-8709-177e807385b9 req-fc0f6b88-0868-4200-9262-4ad61768906c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:18.454688 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d1eef443-91fa-48e4-8709-177e807385b9 req-fc0f6b88-0868-4200-9262-4ad61768906c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=69d8febf-3c3f-4c98-b084-716a5362ebc6 HTTP/1.1" status: 200 len: 834 time: 0.0515811 Dec 09 22:26:18.508524 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1eef443-91fa-48e4-8709-177e807385b9 req-3a223c22-b338-45da-a5cd-b4597ea8366f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:18.510712 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d1eef443-91fa-48e4-8709-177e807385b9 req-3a223c22-b338-45da-a5cd-b4597ea8366f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=4acfc0bf-ef93-4f01-883a-4e582d1c06d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0475044 Dec 09 22:26:18.614440 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d1eef443-91fa-48e4-8709-177e807385b9 req-c08462f6-ae20-40c6-81a2-be0f905bc784 service neutron] 10.222.0.31 "GET /v2.0/networks/4acfc0bf-ef93-4f01-883a-4e582d1c06d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0954511 Dec 09 22:26:18.707743 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d1eef443-91fa-48e4-8709-177e807385b9 req-98a9c12c-b404-4598-a601-b751532afa6e service neutron] 10.222.0.31 "GET /v2.0/networks/4acfc0bf-ef93-4f01-883a-4e582d1c06d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0854225 Dec 09 22:26:19.342670 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-906a8cc2-2b7f-454a-9eea-f125a58ee17f req-c6d2b659-e2d9-4da2-837d-75e7627b88b8 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:19.344457 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-906a8cc2-2b7f-454a-9eea-f125a58ee17f req-c6d2b659-e2d9-4da2-837d-75e7627b88b8 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 945 time: 0.0601118 Dec 09 22:26:19.398498 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-906a8cc2-2b7f-454a-9eea-f125a58ee17f req-f08bf563-c756-463e-a81c-882981de849f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477335 Dec 09 22:26:20.534957 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24d50c14-9926-4de3-b67e-10568dbc0333 req-dfa32a23-c6b1-4e39-8da9-8f162faadeb8 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:20.536459 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-24d50c14-9926-4de3-b67e-10568dbc0333 req-dfa32a23-c6b1-4e39-8da9-8f162faadeb8 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 945 time: 0.0520256 Dec 09 22:26:20.593912 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-24d50c14-9926-4de3-b67e-10568dbc0333 req-1de9d16b-42c8-4b6c-9ed5-ed31ce0e7a5c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481217 Dec 09 22:26:21.731358 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07a13361-bcf7-4f3b-9d7e-ff36af518511 req-fb8482b2-8af5-40fd-a9da-6b2767c2fc62 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:21.732934 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07a13361-bcf7-4f3b-9d7e-ff36af518511 req-fb8482b2-8af5-40fd-a9da-6b2767c2fc62 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 945 time: 0.0534220 Dec 09 22:26:21.789624 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-07a13361-bcf7-4f3b-9d7e-ff36af518511 req-3d278ae1-c594-4630-a25c-9b9e43b3f210 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0502555 Dec 09 22:26:22.916434 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c87b6c2-1085-4331-8936-94eba5830b53 req-18e1190a-3ed0-41ba-8e58-b4a034731160 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:22.917917 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c87b6c2-1085-4331-8936-94eba5830b53 req-18e1190a-3ed0-41ba-8e58-b4a034731160 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 945 time: 0.0538862 Dec 09 22:26:22.970225 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9c87b6c2-1085-4331-8936-94eba5830b53 req-984d87a7-c646-4018-a336-44e0403086b6 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455210 Dec 09 22:26:24.099596 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bdcac01-8fa9-4411-8a97-1c978b2b6f41 req-16391596-6b4e-4cc9-9eb8-988681e35178 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:24.101013 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9bdcac01-8fa9-4411-8a97-1c978b2b6f41 req-16391596-6b4e-4cc9-9eb8-988681e35178 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 945 time: 0.0534697 Dec 09 22:26:24.155294 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9bdcac01-8fa9-4411-8a97-1c978b2b6f41 req-a1302f11-e7aa-43a7-bb8e-13ae52719c92 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482173 Dec 09 22:26:25.277832 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9589643d-66a1-4f89-97b5-ca5b635c3a1c req-02af3ce7-bad2-435d-b4f6-1edb3b3ea5a8 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:25.279339 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9589643d-66a1-4f89-97b5-ca5b635c3a1c req-02af3ce7-bad2-435d-b4f6-1edb3b3ea5a8 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 945 time: 0.0497270 Dec 09 22:26:25.329828 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9589643d-66a1-4f89-97b5-ca5b635c3a1c req-5da30ca1-c7bb-4def-8415-7be467bd288a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435314 Dec 09 22:26:26.466254 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54a05e97-4577-4a4c-aeb3-6cd2dacaeba2 req-c80f6775-1977-4231-bd84-d43b5fac5fb2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:26.467756 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-54a05e97-4577-4a4c-aeb3-6cd2dacaeba2 req-c80f6775-1977-4231-bd84-d43b5fac5fb2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 945 time: 0.0548906 Dec 09 22:26:26.523950 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-54a05e97-4577-4a4c-aeb3-6cd2dacaeba2 req-1a9bac48-b397-4b05-abc9-75dcacf529f0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0487952 Dec 09 22:26:27.659708 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10ac2156-f491-4784-928c-e67b1279b329 req-01a7eb12-b57d-4d0c-8c62-496b8e7b238e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:27.661356 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-10ac2156-f491-4784-928c-e67b1279b329 req-01a7eb12-b57d-4d0c-8c62-496b8e7b238e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 945 time: 0.0624478 Dec 09 22:26:27.714434 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-10ac2156-f491-4784-928c-e67b1279b329 req-ea1f72ba-2bea-4cd9-9bb1-23ab520465f3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438576 Dec 09 22:26:27.732302 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:27.837385 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:28.850778 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2114e67-4fd6-4781-8917-b0fab8e99f94 req-fa6045b7-1df0-4802-9e84-feecf7032f5e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:28.852319 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2114e67-4fd6-4781-8917-b0fab8e99f94 req-fa6045b7-1df0-4802-9e84-feecf7032f5e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 945 time: 0.0539107 Dec 09 22:26:28.907457 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e2114e67-4fd6-4781-8917-b0fab8e99f94 req-3e4747ef-a50b-4906-9a2c-0d9ff8fb3dda tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0486205 Dec 09 22:26:30.036932 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c714d7e-8d4d-4de9-aeb8-ec92a56905aa req-ccc93afc-9a58-4bc7-ba0e-f308e17919f3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:30.038428 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3c714d7e-8d4d-4de9-aeb8-ec92a56905aa req-ccc93afc-9a58-4bc7-ba0e-f308e17919f3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 945 time: 0.0502048 Dec 09 22:26:30.094579 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3c714d7e-8d4d-4de9-aeb8-ec92a56905aa req-033e831c-f620-450b-91bf-0fb330d682cf tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468357 Dec 09 22:26:30.477850 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [req-d1eef443-91fa-48e4-8709-177e807385b9 req-5a1d427d-286d-43df-8296-5f94217a0945 service neutron] show failed (client error): The resource could not be found. Dec 09 22:26:30.478942 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-d1eef443-91fa-48e4-8709-177e807385b9 req-5a1d427d-286d-43df-8296-5f94217a0945 service neutron] 10.222.0.31 "GET /v2.0/ports/bf2142c4-6b6c-44ec-aa5b-b452734180dc/bindings/n-h2-713301-27 HTTP/1.1" status: 404 len: 381 time: 0.0615923 Dec 09 22:26:30.760922 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1eef443-91fa-48e4-8709-177e807385b9 req-c604bb82-8b61-4992-ab2b-3f3f0d440926 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:30.762426 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d1eef443-91fa-48e4-8709-177e807385b9 req-c604bb82-8b61-4992-ab2b-3f3f0d440926 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9&tenant_id=e21dff80515b44aa9f01117603c6de0d HTTP/1.1" status: 200 len: 1097 time: 0.0940173 Dec 09 22:26:30.775171 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-d1eef443-91fa-48e4-8709-177e807385b9 req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Request body: {'port': {'binding:host_id': 'n-h2-713301-27', 'device_owner': 'compute:nova'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:26:30.827960 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d1eef443-91fa-48e4-8709-177e807385b9 req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:31.031305 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-d1eef443-91fa-48e4-8709-177e807385b9 req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] For port bf2142c4-6b6c-44ec-aa5b-b452734180dc, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=bf2142c4-6b6c-44ec-aa5b-b452734180dc,segment=NetworkSegment(d634afa7-444c-47d3-9e02-42921e0c3151),segment_id=d634afa7-444c-47d3-9e02-42921e0c3151)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:26:31.064617 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-d1eef443-91fa-48e4-8709-177e807385b9 req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] For port bf2142c4-6b6c-44ec-aa5b-b452734180dc, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:26:31.105842 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b6c58196-eefa-447d-aa8b-c346e9bca4c9', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'bf2142c4-6b6c-44ec-aa5b-b452734180dc'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:26:31.109525 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e98df783-ec73-4052-b3b1-9020a11d65a2" -d '{"events": [{"server_uuid": "b6c58196-eefa-447d-aa8b-c346e9bca4c9", "name": "network-vif-unplugged", "status": "completed", "tag": "bf2142c4-6b6c-44ec-aa5b-b452734180dc"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:26:31.114951 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d1eef443-91fa-48e4-8709-177e807385b9 req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:31.128346 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-d1eef443-91fa-48e4-8709-177e807385b9 req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Transition to ACTIVE for port object bf2142c4-6b6c-44ec-aa5b-b452734180dc will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:26:31.132590 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d1eef443-91fa-48e4-8709-177e807385b9 req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:31.171272 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 22:26:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-382e35f5-c599-4dc2-b370-266629d289af x-openstack-request-id: req-382e35f5-c599-4dc2-b370-266629d289af {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:26:31.171412 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b6c58196-eefa-447d-aa8b-c346e9bca4c9", "name": "network-vif-unplugged", "status": "completed", "tag": "bf2142c4-6b6c-44ec-aa5b-b452734180dc", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:26:31.171742 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-382e35f5-c599-4dc2-b370-266629d289af {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:26:31.172210 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b6c58196-eefa-447d-aa8b-c346e9bca4c9', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'bf2142c4-6b6c-44ec-aa5b-b452734180dc', 'code': 200} Dec 09 22:26:31.184180 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Pushing event updated for resources: {'Port': ['ID=bf2142c4-6b6c-44ec-aa5b-b452734180dc,revision_number=6']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:26:31.194396 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:31.194749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:31.195143 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:31.195470 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:31.195819 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:31.196814 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:31.196814 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:31.196814 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:31.197111 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:31.197473 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:31.197799 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:31.198124 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:31.198420 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:31.302434 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-d1eef443-91fa-48e4-8709-177e807385b9 req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] No DVR routers for this DVR port bf2142c4-6b6c-44ec-aa5b-b452734180dc on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:26:31.345903 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b20726f-1869-498e-a687-83bbb4fe9fa4 req-b0e222a6-af55-4910-96ad-f42ca722df44 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:31.347408 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b20726f-1869-498e-a687-83bbb4fe9fa4 req-b0e222a6-af55-4910-96ad-f42ca722df44 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 943 time: 0.1165829 Dec 09 22:26:31.447889 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6b20726f-1869-498e-a687-83bbb4fe9fa4 req-8b337b79-461a-4f5e-abb5-19131a0943da tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0911894 Dec 09 22:26:31.488856 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-d1eef443-91fa-48e4-8709-177e807385b9 req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Attempting to bind port bf2142c4-6b6c-44ec-aa5b-b452734180dc on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:26:31.489330 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-d1eef443-91fa-48e4-8709-177e807385b9 req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Attempting to bind port bf2142c4-6b6c-44ec-aa5b-b452734180dc by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': 'd634afa7-444c-47d3-9e02-42921e0c3151', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:26:31.489665 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d1eef443-91fa-48e4-8709-177e807385b9 req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Attempting to bind port bf2142c4-6b6c-44ec-aa5b-b452734180dc on network 4acfc0bf-ef93-4f01-883a-4e582d1c06d7 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:26:31.494187 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d1eef443-91fa-48e4-8709-177e807385b9 req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Port bf2142c4-6b6c-44ec-aa5b-b452734180dc on network 4acfc0bf-ef93-4f01-883a-4e582d1c06d7 not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:26:31.494513 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d1eef443-91fa-48e4-8709-177e807385b9 req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Attempting to bind port bf2142c4-6b6c-44ec-aa5b-b452734180dc on network 4acfc0bf-ef93-4f01-883a-4e582d1c06d7 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:26:31.499744 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d1eef443-91fa-48e4-8709-177e807385b9 req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 26, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:26:31.500082 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d1eef443-91fa-48e4-8709-177e807385b9 req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Checking segment: {'id': 'd634afa7-444c-47d3-9e02-42921e0c3151', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:26:31.500441 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d1eef443-91fa-48e4-8709-177e807385b9 req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Bound using segment: {'id': 'd634afa7-444c-47d3-9e02-42921e0c3151', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:26:31.500867 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-d1eef443-91fa-48e4-8709-177e807385b9 req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Bound port: bf2142c4-6b6c-44ec-aa5b-b452734180dc, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd634afa7-444c-47d3-9e02-42921e0c3151', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 130, 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:26:31.501227 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d1eef443-91fa-48e4-8709-177e807385b9 req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:31.571324 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-d1eef443-91fa-48e4-8709-177e807385b9 req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] For port bf2142c4-6b6c-44ec-aa5b-b452734180dc, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:26:31.574406 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-d1eef443-91fa-48e4-8709-177e807385b9 req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] For port bf2142c4-6b6c-44ec-aa5b-b452734180dc, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=bf2142c4-6b6c-44ec-aa5b-b452734180dc,segment=NetworkSegment(d634afa7-444c-47d3-9e02-42921e0c3151),segment_id=d634afa7-444c-47d3-9e02-42921e0c3151)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:26:31.582079 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d1eef443-91fa-48e4-8709-177e807385b9 req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:31.613343 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1eef443-91fa-48e4-8709-177e807385b9 req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:31.613953 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-d1eef443-91fa-48e4-8709-177e807385b9 req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:31.615381 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d1eef443-91fa-48e4-8709-177e807385b9 req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] 10.222.0.10 "PUT /v2.0/ports/bf2142c4-6b6c-44ec-aa5b-b452734180dc HTTP/1.1" status: 200 len: 1092 time: 0.8441479 Dec 09 22:26:31.638312 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78a62dd9-9f81-4191-90f2-c95dfd71943c service neutron] Pushing event updated for resources: {'Port': ['ID=bf2142c4-6b6c-44ec-aa5b-b452734180dc,revision_number=7']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:26:31.683416 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1eef443-91fa-48e4-8709-177e807385b9 req-fd144170-748d-4882-9da9-1794e925ed67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:31.685005 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d1eef443-91fa-48e4-8709-177e807385b9 req-fd144170-748d-4882-9da9-1794e925ed67 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 1095 time: 0.0437009 Dec 09 22:26:31.785949 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1eef443-91fa-48e4-8709-177e807385b9 req-2e36d609-a39e-4ced-adfd-35a86df235b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:31.787836 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d1eef443-91fa-48e4-8709-177e807385b9 req-2e36d609-a39e-4ced-adfd-35a86df235b9 service neutron] 10.222.0.10 "GET /v2.0/networks?id=4acfc0bf-ef93-4f01-883a-4e582d1c06d7 HTTP/1.1" status: 200 len: 897 time: 0.0960658 Dec 09 22:26:31.853699 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d1eef443-91fa-48e4-8709-177e807385b9 req-62d3cadc-39f7-4b83-a2d2-4c46df761019 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bf2142c4-6b6c-44ec-aa5b-b452734180dc HTTP/1.1" status: 200 len: 999 time: 0.0581586 Dec 09 22:26:31.905064 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1eef443-91fa-48e4-8709-177e807385b9 req-f596e79e-4380-46ff-a568-8bfd29a89c91 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:31.906542 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d1eef443-91fa-48e4-8709-177e807385b9 req-f596e79e-4380-46ff-a568-8bfd29a89c91 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=69d8febf-3c3f-4c98-b084-716a5362ebc6 HTTP/1.1" status: 200 len: 834 time: 0.0447192 Dec 09 22:26:31.957581 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1eef443-91fa-48e4-8709-177e807385b9 req-4684c13a-8f42-4cb0-afbc-19235d82abb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:31.959064 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d1eef443-91fa-48e4-8709-177e807385b9 req-4684c13a-8f42-4cb0-afbc-19235d82abb5 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=4acfc0bf-ef93-4f01-883a-4e582d1c06d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0447819 Dec 09 22:26:32.049396 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d1eef443-91fa-48e4-8709-177e807385b9 req-1663f7ff-82e6-4eb0-a404-9bdcaff02ef4 service neutron] 10.222.0.10 "GET /v2.0/networks/4acfc0bf-ef93-4f01-883a-4e582d1c06d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0814619 Dec 09 22:26:32.149524 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d1eef443-91fa-48e4-8709-177e807385b9 req-cafc5acf-51c9-442b-99cc-cfe6a5626402 service neutron] 10.222.0.10 "GET /v2.0/networks/4acfc0bf-ef93-4f01-883a-4e582d1c06d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0938900 Dec 09 22:26:32.577015 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-653e1482-da45-4a85-a276-bda8f3fc5a4d req-82707bad-978b-43c0-8384-f57210a1d1f0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:32.579195 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-653e1482-da45-4a85-a276-bda8f3fc5a4d req-82707bad-978b-43c0-8384-f57210a1d1f0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 943 time: 0.0564442 Dec 09 22:26:32.631128 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-653e1482-da45-4a85-a276-bda8f3fc5a4d req-04a945fb-ca2e-45d3-b780-7114823dab92 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456400 Dec 09 22:26:33.060551 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-057337f9-db08-45ac-ab6b-b0c6858b41f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:33.174060 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b6c58196-eefa-447d-aa8b-c346e9bca4c9', 'tag': 'bf2142c4-6b6c-44ec-aa5b-b452734180dc'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:26:33.177326 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ea727769-bc94-467b-b9e3-7b272387d853" -d '{"events": [{"name": "network-changed", "server_uuid": "b6c58196-eefa-447d-aa8b-c346e9bca4c9", "tag": "bf2142c4-6b6c-44ec-aa5b-b452734180dc"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:26:33.226811 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:26:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-16786179-f75c-4c99-9687-b7c89109c116 x-openstack-request-id: req-16786179-f75c-4c99-9687-b7c89109c116 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:26:33.227113 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b6c58196-eefa-447d-aa8b-c346e9bca4c9", "tag": "bf2142c4-6b6c-44ec-aa5b-b452734180dc", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:26:33.227377 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-16786179-f75c-4c99-9687-b7c89109c116 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:26:33.227872 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b6c58196-eefa-447d-aa8b-c346e9bca4c9', 'tag': 'bf2142c4-6b6c-44ec-aa5b-b452734180dc', 'status': 'completed', 'code': 200} Dec 09 22:26:33.295152 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea727769-bc94-467b-b9e3-7b272387d853 req-9d7f3f96-ccf2-4361-97fd-fc0d28a436e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:33.295824 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea727769-bc94-467b-b9e3-7b272387d853 req-48ab9072-5b1a-4645-b70a-edb68a147e37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:33.296825 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ea727769-bc94-467b-b9e3-7b272387d853 req-9d7f3f96-ccf2-4361-97fd-fc0d28a436e4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 1095 time: 0.0501747 Dec 09 22:26:33.296975 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea727769-bc94-467b-b9e3-7b272387d853 req-48ab9072-5b1a-4645-b70a-edb68a147e37 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 1095 time: 0.0441732 Dec 09 22:26:33.390071 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea727769-bc94-467b-b9e3-7b272387d853 req-4ff89deb-2244-426c-9cbc-28927f7b8146 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:33.391131 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea727769-bc94-467b-b9e3-7b272387d853 req-b2cb1e21-1b03-48a6-bae1-e52a8f53068b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:33.391672 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ea727769-bc94-467b-b9e3-7b272387d853 req-4ff89deb-2244-426c-9cbc-28927f7b8146 service neutron] 10.222.0.31 "GET /v2.0/networks?id=4acfc0bf-ef93-4f01-883a-4e582d1c06d7 HTTP/1.1" status: 200 len: 897 time: 0.0866144 Dec 09 22:26:33.392605 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea727769-bc94-467b-b9e3-7b272387d853 req-b2cb1e21-1b03-48a6-bae1-e52a8f53068b service neutron] 10.222.0.10 "GET /v2.0/networks?id=4acfc0bf-ef93-4f01-883a-4e582d1c06d7 HTTP/1.1" status: 200 len: 897 time: 0.0882123 Dec 09 22:26:33.460999 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea727769-bc94-467b-b9e3-7b272387d853 req-b72eb413-318c-4694-838e-ce6710c20f35 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bf2142c4-6b6c-44ec-aa5b-b452734180dc HTTP/1.1" status: 200 len: 999 time: 0.0593772 Dec 09 22:26:33.462457 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ea727769-bc94-467b-b9e3-7b272387d853 req-df97643d-82a1-443b-b1f7-29f8bbe2b1e1 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bf2142c4-6b6c-44ec-aa5b-b452734180dc HTTP/1.1" status: 200 len: 999 time: 0.0637519 Dec 09 22:26:33.516360 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea727769-bc94-467b-b9e3-7b272387d853 req-9ec77a6a-b3c8-4409-bb81-9c7df3a8152f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:33.517260 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea727769-bc94-467b-b9e3-7b272387d853 req-fc94ce7c-ab9e-49d4-8219-a845f725da8c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:33.518379 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea727769-bc94-467b-b9e3-7b272387d853 req-9ec77a6a-b3c8-4409-bb81-9c7df3a8152f service neutron] 10.222.0.10 "GET /v2.0/subnets?id=69d8febf-3c3f-4c98-b084-716a5362ebc6 HTTP/1.1" status: 200 len: 834 time: 0.0494666 Dec 09 22:26:33.518740 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ea727769-bc94-467b-b9e3-7b272387d853 req-fc94ce7c-ab9e-49d4-8219-a845f725da8c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=69d8febf-3c3f-4c98-b084-716a5362ebc6 HTTP/1.1" status: 200 len: 834 time: 0.0438349 Dec 09 22:26:33.567216 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea727769-bc94-467b-b9e3-7b272387d853 req-5f1a47f8-0a66-4c03-bc29-8891f20f5745 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:33.569277 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ea727769-bc94-467b-b9e3-7b272387d853 req-5f1a47f8-0a66-4c03-bc29-8891f20f5745 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=4acfc0bf-ef93-4f01-883a-4e582d1c06d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0432241 Dec 09 22:26:33.574505 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea727769-bc94-467b-b9e3-7b272387d853 req-07121daa-18d9-42c3-bd23-cfa8976e70a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:33.576126 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea727769-bc94-467b-b9e3-7b272387d853 req-07121daa-18d9-42c3-bd23-cfa8976e70a7 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=4acfc0bf-ef93-4f01-883a-4e582d1c06d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0436153 Dec 09 22:26:33.668784 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ea727769-bc94-467b-b9e3-7b272387d853 req-2f9b01ba-e5e5-41b4-a364-c1b8dd79409e service neutron] 10.222.0.31 "GET /v2.0/networks/4acfc0bf-ef93-4f01-883a-4e582d1c06d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0923798 Dec 09 22:26:33.703324 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea727769-bc94-467b-b9e3-7b272387d853 req-b8f23f29-f888-4f09-8530-0d9790e9d646 service neutron] 10.222.0.10 "GET /v2.0/networks/4acfc0bf-ef93-4f01-883a-4e582d1c06d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1110258 Dec 09 22:26:33.763764 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ea727769-bc94-467b-b9e3-7b272387d853 req-6f054534-afeb-4004-b2cb-195e1b228757 service neutron] 10.222.0.31 "GET /v2.0/networks/4acfc0bf-ef93-4f01-883a-4e582d1c06d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0876179 Dec 09 22:26:33.816195 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fad9c33-a61f-4443-858c-37ecaa444770 req-2d872b7b-b898-47b4-9cd6-1948e4f4ed9f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:33.817925 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3fad9c33-a61f-4443-858c-37ecaa444770 req-2d872b7b-b898-47b4-9cd6-1948e4f4ed9f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 943 time: 0.0989287 Dec 09 22:26:33.841408 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea727769-bc94-467b-b9e3-7b272387d853 req-72bf7409-5ccc-4053-8f49-35f72c02a51d service neutron] 10.222.0.10 "GET /v2.0/networks/4acfc0bf-ef93-4f01-883a-4e582d1c06d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1306505 Dec 09 22:26:33.881847 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3fad9c33-a61f-4443-858c-37ecaa444770 req-b94014fb-5eed-45d9-8731-3a7795e3ab89 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0515599 Dec 09 22:26:34.085127 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17fdac4d-aaeb-4056-80da-a3df3fe60d61 req-26d66566-a143-44b7-9982-63f739186d47 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:34.086507 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-17fdac4d-aaeb-4056-80da-a3df3fe60d61 req-26d66566-a143-44b7-9982-63f739186d47 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 943 time: 0.0514150 Dec 09 22:26:34.103348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ae47df-c750-400d-bda1-f5c748580cc7 req-e878ac76-ae41-45ac-8911-a288f48382c3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:34.104878 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e2ae47df-c750-400d-bda1-f5c748580cc7 req-e878ac76-ae41-45ac-8911-a288f48382c3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.31 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9&tenant_id=e21dff80515b44aa9f01117603c6de0d&binding%3Ahost_id=n-h2-713301-27 HTTP/1.1" status: 200 len: 943 time: 0.0571034 Dec 09 22:26:34.135550 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-17fdac4d-aaeb-4056-80da-a3df3fe60d61 req-9c0456cc-6bf0-49c2-bfd9-9aabf7da9c80 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426984 Dec 09 22:26:34.165659 n-d-713301-27 neutron-server[103437]: INFO neutron.api.v2.resource [req-e2ae47df-c750-400d-bda1-f5c748580cc7 req-175eb89a-8351-4405-a85f-cf96a110b2e6 service neutron] delete failed (client error): The resource could not be found. Dec 09 22:26:34.166697 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e2ae47df-c750-400d-bda1-f5c748580cc7 req-175eb89a-8351-4405-a85f-cf96a110b2e6 service neutron] 10.222.0.31 "DELETE /v2.0/ports/bf2142c4-6b6c-44ec-aa5b-b452734180dc/bindings/n-h1-713301-27 HTTP/1.1" status: 404 len: 381 time: 0.0531211 Dec 09 22:26:34.251622 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ae47df-c750-400d-bda1-f5c748580cc7 req-b7e351eb-079f-49e4-9a69-48ee1e0b5adf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:34.253165 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e2ae47df-c750-400d-bda1-f5c748580cc7 req-b7e351eb-079f-49e4-9a69-48ee1e0b5adf service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 1095 time: 0.0423143 Dec 09 22:26:34.253398 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50eb5b78-0b17-48fa-94cd-5f7faa248cc9 req-9f10ad48-83ff-4026-abee-1124f717aeae tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:34.255267 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50eb5b78-0b17-48fa-94cd-5f7faa248cc9 req-9f10ad48-83ff-4026-abee-1124f717aeae tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 943 time: 0.0484376 Dec 09 22:26:34.304109 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50eb5b78-0b17-48fa-94cd-5f7faa248cc9 req-f4221742-29f3-4877-a260-f2d6e672a15b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424106 Dec 09 22:26:34.351772 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ae47df-c750-400d-bda1-f5c748580cc7 req-f67c4ffc-dceb-428e-a4f7-de1cac9a2da2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:34.353137 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e2ae47df-c750-400d-bda1-f5c748580cc7 req-f67c4ffc-dceb-428e-a4f7-de1cac9a2da2 service neutron] 10.222.0.31 "GET /v2.0/networks?id=4acfc0bf-ef93-4f01-883a-4e582d1c06d7 HTTP/1.1" status: 200 len: 897 time: 0.0926549 Dec 09 22:26:34.420435 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e2ae47df-c750-400d-bda1-f5c748580cc7 req-13d68a34-bcad-477f-8f5f-da2401eb010d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bf2142c4-6b6c-44ec-aa5b-b452734180dc HTTP/1.1" status: 200 len: 999 time: 0.0603826 Dec 09 22:26:34.477703 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ae47df-c750-400d-bda1-f5c748580cc7 req-94c6f235-99bf-4a8e-a999-0da3027c53e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:34.479178 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e2ae47df-c750-400d-bda1-f5c748580cc7 req-94c6f235-99bf-4a8e-a999-0da3027c53e0 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=69d8febf-3c3f-4c98-b084-716a5362ebc6 HTTP/1.1" status: 200 len: 834 time: 0.0511384 Dec 09 22:26:34.530246 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ae47df-c750-400d-bda1-f5c748580cc7 req-f378f535-1440-4642-b1db-67bca49d1ec0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:34.531748 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e2ae47df-c750-400d-bda1-f5c748580cc7 req-f378f535-1440-4642-b1db-67bca49d1ec0 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=4acfc0bf-ef93-4f01-883a-4e582d1c06d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0450721 Dec 09 22:26:34.621996 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e2ae47df-c750-400d-bda1-f5c748580cc7 req-48575afd-ef1c-4a96-be60-01421cfb1314 service neutron] 10.222.0.31 "GET /v2.0/networks/4acfc0bf-ef93-4f01-883a-4e582d1c06d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0829315 Dec 09 22:26:34.715236 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e2ae47df-c750-400d-bda1-f5c748580cc7 req-0eff5ab9-dba7-4eeb-a3e4-5eab7071b9a3 service neutron] 10.222.0.31 "GET /v2.0/networks/4acfc0bf-ef93-4f01-883a-4e582d1c06d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0861952 Dec 09 22:26:35.122856 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device bf2142c4-6b6c-44ec-aa5b-b452734180dc details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:26:35.221596 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port bf2142c4-6b6c-44ec-aa5b-b452734180dc, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=bf2142c4-6b6c-44ec-aa5b-b452734180dc,segment=NetworkSegment(d634afa7-444c-47d3-9e02-42921e0c3151),segment_id=d634afa7-444c-47d3-9e02-42921e0c3151)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:26:35.232814 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'bf2142c4-6b6c-44ec-aa5b-b452734180dc', 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7', 'port_id': 'bf2142c4-6b6c-44ec-aa5b-b452734180dc', 'mac_address': 'fa:16:3e:07:46:3a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 130, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '69d8febf-3c3f-4c98-b084-716a5362ebc6', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:26:35.268978 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:35.286725 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bf2142c4-6b6c-44ec-aa5b-b452734180dc {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:26:35.292224 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device bf2142c4-6b6c-44ec-aa5b-b452734180dc no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:26:35.331508 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port bf2142c4-6b6c-44ec-aa5b-b452734180dc, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=bf2142c4-6b6c-44ec-aa5b-b452734180dc,segment=NetworkSegment(d634afa7-444c-47d3-9e02-42921e0c3151),segment_id=d634afa7-444c-47d3-9e02-42921e0c3151)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:26:35.340063 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:35.348040 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device bf2142c4-6b6c-44ec-aa5b-b452734180dc not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:26:35.391189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=bf2142c4-6b6c-44ec-aa5b-b452734180dc,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:26:35.398947 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:35.399306 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:35.399667 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:35.400011 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:35.400342 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:35.400671 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:35.401011 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:35.401336 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:35.401651 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:35.401972 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:35.402293 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:35.402664 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:35.402972 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:26:35.485922 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab1271bb-69e1-4865-a231-260ec77bd585 req-e81d3d6a-84b5-4ee4-ad10-193716eda60e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:26:35.487707 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab1271bb-69e1-4865-a231-260ec77bd585 req-e81d3d6a-84b5-4ee4-ad10-193716eda60e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 944 time: 0.1119297 Dec 09 22:26:35.537730 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ab1271bb-69e1-4865-a231-260ec77bd585 req-98bf9cff-7d7b-403f-898c-1e14271d00af tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437088 Dec 09 22:26:35.565378 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34472) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:26:35.579385 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['bf2142c4-6b6c-44ec-aa5b-b452734180dc'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:26:35.627668 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e42a5afe-11e4-4e6a-886c-6746114b3344 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/floatingips/f669f9d7-e637-4a06-ab45-46ddefbecab9 HTTP/1.1" status: 200 len: 992 time: 0.0610445 Dec 09 22:26:35.684664 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-29e59a11-8ac6-463d-976f-48757bced339 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:36.892736 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:37.164364 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device bf2142c4-6b6c-44ec-aa5b-b452734180dc up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:26:37.230394 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port bf2142c4-6b6c-44ec-aa5b-b452734180dc completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:26:37.234412 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port bf2142c4-6b6c-44ec-aa5b-b452734180dc triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:26:37.234791 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:37.311361 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:37.333818 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b6c58196-eefa-447d-aa8b-c346e9bca4c9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bf2142c4-6b6c-44ec-aa5b-b452734180dc'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:26:37.336113 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fb4b213c-7e98-40ee-8239-9929f8b4c6ae" -d '{"events": [{"server_uuid": "b6c58196-eefa-447d-aa8b-c346e9bca4c9", "name": "network-vif-plugged", "status": "completed", "tag": "bf2142c4-6b6c-44ec-aa5b-b452734180dc"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:26:37.348733 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port bf2142c4-6b6c-44ec-aa5b-b452734180dc, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=bf2142c4-6b6c-44ec-aa5b-b452734180dc,segment=NetworkSegment(d634afa7-444c-47d3-9e02-42921e0c3151),segment_id=d634afa7-444c-47d3-9e02-42921e0c3151)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:26:37.356163 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:37.384825 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:26:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bf524f42-520b-425b-a7fc-97fe93a6cf95 x-openstack-request-id: req-bf524f42-520b-425b-a7fc-97fe93a6cf95 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:26:37.385127 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b6c58196-eefa-447d-aa8b-c346e9bca4c9", "name": "network-vif-plugged", "status": "completed", "tag": "bf2142c4-6b6c-44ec-aa5b-b452734180dc", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:26:37.385445 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-bf524f42-520b-425b-a7fc-97fe93a6cf95 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:26:37.385922 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b6c58196-eefa-447d-aa8b-c346e9bca4c9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bf2142c4-6b6c-44ec-aa5b-b452734180dc', 'code': 200} Dec 09 22:26:37.421010 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=bf2142c4-6b6c-44ec-aa5b-b452734180dc,revision_number=9']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:26:38.239028 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:39.702312 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:55.330792 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:26:57.745552 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:26:57.836115 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:03.055472 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c730f526-a7a0-4cec-abaa-831facc0f72c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:04.035255 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34484) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:27:04.207942 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting port 26048042-4c86-430b-928a-51936ab994ed {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:27:04.208270 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:04.282649 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:04.282934 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:04.296068 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Calling delete_port for 26048042-4c86-430b-928a-51936ab994ed owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:27:04.451341 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:04.474722 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Port': ['ID=26048042-4c86-430b-928a-51936ab994ed,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:04.485023 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:04.485423 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:04.485774 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:04.486120 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:04.486459 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:04.486778 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:04.487555 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:04.487555 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:04.487760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:04.488087 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:04.488445 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:04.488779 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:04.489102 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:04.550735 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:04.551180 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Floating IP f669f9d7-e637-4a06-ab45-46ddefbecab9 disassociated (deleted). External IP: 172.25.3.113, port: bf2142c4-6b6c-44ec-aa5b-b452734180dc. Dec 09 22:27:04.774082 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:27:04.883790 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:27:04.888860 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:04.894183 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fba14b75-2da9-429c-aa2a-83ca4b8c08f6 None None] Sync routers for ids ['a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:27:04.904948 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fba14b75-2da9-429c-aa2a-83ca4b8c08f6 None None] Routers {'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:27:04.905579 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-fba14b75-2da9-429c-aa2a-83ca4b8c08f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:26:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:27:04.915917 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cad8f736-8574-4f4b-b8f2-08f3615a1c55 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/floatingips/f669f9d7-e637-4a06-ab45-46ddefbecab9 HTTP/1.1" status: 204 len: 168 time: 0.8790991 Dec 09 22:27:04.916525 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b6c58196-eefa-447d-aa8b-c346e9bca4c9', 'tag': 'bf2142c4-6b6c-44ec-aa5b-b452734180dc'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:27:04.918790 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d8370c49-9cd1-4a6a-91c9-29e41681c1a5" -d '{"events": [{"name": "network-changed", "server_uuid": "b6c58196-eefa-447d-aa8b-c346e9bca4c9", "tag": "bf2142c4-6b6c-44ec-aa5b-b452734180dc"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:27:05.011659 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-fba14b75-2da9-429c-aa2a-83ca4b8c08f6 None None] Set router a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:27:05.083785 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:27:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-34f26a59-fd04-45e6-8ffe-f376848ea19a x-openstack-request-id: req-34f26a59-fd04-45e6-8ffe-f376848ea19a {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:27:05.084307 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b6c58196-eefa-447d-aa8b-c346e9bca4c9", "tag": "bf2142c4-6b6c-44ec-aa5b-b452734180dc", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:27:05.084307 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-34f26a59-fd04-45e6-8ffe-f376848ea19a {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:27:05.084837 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b6c58196-eefa-447d-aa8b-c346e9bca4c9', 'tag': 'bf2142c4-6b6c-44ec-aa5b-b452734180dc', 'status': 'completed', 'code': 200} Dec 09 22:27:05.174758 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8370c49-9cd1-4a6a-91c9-29e41681c1a5 req-de689bfc-2306-475b-b625-d0320ae69e53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:05.176670 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8370c49-9cd1-4a6a-91c9-29e41681c1a5 req-de689bfc-2306-475b-b625-d0320ae69e53 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 1097 time: 0.0700159 Dec 09 22:27:05.191008 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffce74b6-60ae-44c2-be0c-fdf159a7dfe5 req-adeac42c-e021-49dd-be96-4e6407d75646 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:05.192444 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ffce74b6-60ae-44c2-be0c-fdf159a7dfe5 req-adeac42c-e021-49dd-be96-4e6407d75646 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 945 time: 0.0566859 Dec 09 22:27:05.225542 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-fba14b75-2da9-429c-aa2a-83ca4b8c08f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1305906706', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100'}], 'enable_snat': True}, 'gw_port_id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:28Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:b1:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4253, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'de13f219-3194-4b40-82f1-858d74834954', 'name': '', 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:eb:89:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'device_owner': 'network:router_interface', 'standard_attr_id': 4256, 'fixed_ips': [{'subnet_id': '69d8febf-3c3f-4c98-b084-716a5362ebc6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:25:28Z', 'updated_at': '2021-12-09T22:25:31Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '69d8febf-3c3f-4c98-b084-716a5362ebc6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:27:05.251762 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fba14b75-2da9-429c-aa2a-83ca4b8c08f6 None None] Checking router: a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:27:05.260721 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fba14b75-2da9-429c-aa2a-83ca4b8c08f6 None None] Routers {'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:27:05.261346 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-fba14b75-2da9-429c-aa2a-83ca4b8c08f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:26:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:27:05.302329 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ffce74b6-60ae-44c2-be0c-fdf159a7dfe5 req-ef1d0d79-a575-49e3-b08a-d0765966f6dd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1006486 Dec 09 22:27:05.319451 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8370c49-9cd1-4a6a-91c9-29e41681c1a5 req-95dd92fc-ea03-4aed-a8af-f47f79d519a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:05.320942 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8370c49-9cd1-4a6a-91c9-29e41681c1a5 req-95dd92fc-ea03-4aed-a8af-f47f79d519a6 service neutron] 10.222.0.10 "GET /v2.0/networks?id=4acfc0bf-ef93-4f01-883a-4e582d1c06d7 HTTP/1.1" status: 200 len: 897 time: 0.1276548 Dec 09 22:27:05.368275 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8370c49-9cd1-4a6a-91c9-29e41681c1a5 req-ed781c08-f07c-4e46-a563-929319517803 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bf2142c4-6b6c-44ec-aa5b-b452734180dc HTTP/1.1" status: 200 len: 217 time: 0.0389526 Dec 09 22:27:05.370185 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-fba14b75-2da9-429c-aa2a-83ca4b8c08f6 None None] Set router a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:27:05.423700 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8370c49-9cd1-4a6a-91c9-29e41681c1a5 req-54affedf-1199-4200-a00d-08192afc1d20 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:05.425195 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8370c49-9cd1-4a6a-91c9-29e41681c1a5 req-54affedf-1199-4200-a00d-08192afc1d20 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=69d8febf-3c3f-4c98-b084-716a5362ebc6 HTTP/1.1" status: 200 len: 834 time: 0.0498941 Dec 09 22:27:05.471903 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8370c49-9cd1-4a6a-91c9-29e41681c1a5 req-607918dd-7879-4532-86cb-4d29ce497b37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:05.473430 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8370c49-9cd1-4a6a-91c9-29e41681c1a5 req-607918dd-7879-4532-86cb-4d29ce497b37 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=4acfc0bf-ef93-4f01-883a-4e582d1c06d7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0411272 Dec 09 22:27:05.570553 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8370c49-9cd1-4a6a-91c9-29e41681c1a5 req-67ec2e8a-ce68-41bb-8447-b15cf127559c service neutron] 10.222.0.10 "GET /v2.0/networks/4acfc0bf-ef93-4f01-883a-4e582d1c06d7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0891039 Dec 09 22:27:05.571241 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-fba14b75-2da9-429c-aa2a-83ca4b8c08f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1305906706', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100'}], 'enable_snat': True}, 'gw_port_id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:28Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:b1:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4253, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'de13f219-3194-4b40-82f1-858d74834954', 'name': '', 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:eb:89:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'device_owner': 'network:router_interface', 'standard_attr_id': 4256, 'fixed_ips': [{'subnet_id': '69d8febf-3c3f-4c98-b084-716a5362ebc6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:25:28Z', 'updated_at': '2021-12-09T22:25:31Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '69d8febf-3c3f-4c98-b084-716a5362ebc6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:27:05.601415 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fba14b75-2da9-429c-aa2a-83ca4b8c08f6 None None] The sync data for ids ['a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'] in n-d-713301-27 is: [{'id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1305906706', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100'}], 'enable_snat': True}, 'gw_port_id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:28Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:b1:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4253, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'de13f219-3194-4b40-82f1-858d74834954', 'name': '', 'network_id': '4acfc0bf-ef93-4f01-883a-4e582d1c06d7', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:eb:89:7f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'device_owner': 'network:router_interface', 'standard_attr_id': 4256, 'fixed_ips': [{'subnet_id': '69d8febf-3c3f-4c98-b084-716a5362ebc6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:25:28Z', 'updated_at': '2021-12-09T22:25:31Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '69d8febf-3c3f-4c98-b084-716a5362ebc6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:27:05.670303 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-828c8f8e-bfcd-4a3a-8b88-9699efb231e9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:05.843198 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84a80508-49f2-469a-9669-da438a494161 None None] New status for floating IP f669f9d7-e637-4a06-ab45-46ddefbecab9: DOWN {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:27:05.987452 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d8370c49-9cd1-4a6a-91c9-29e41681c1a5 req-98d63b1e-c135-4b55-923e-10bdc7a9a4e6 service neutron] 10.222.0.10 "GET /v2.0/networks/4acfc0bf-ef93-4f01-883a-4e582d1c06d7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4085035 Dec 09 22:27:06.429737 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eafad43c-c945-45b0-a0b1-8fabb83cab92 req-4450bb4f-f0bd-42d9-baf3-405d020ce559 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:06.431195 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eafad43c-c945-45b0-a0b1-8fabb83cab92 req-4450bb4f-f0bd-42d9-baf3-405d020ce559 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.10 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 945 time: 0.0796015 Dec 09 22:27:06.473353 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aec47588-30ca-450c-8843-f3df8aebbb0a req-7a88f16b-79bd-4607-a3ec-3a64c00de8ea tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:06.474822 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aec47588-30ca-450c-8843-f3df8aebbb0a req-7a88f16b-79bd-4607-a3ec-3a64c00de8ea tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c58196-eefa-447d-aa8b-c346e9bca4c9 HTTP/1.1" status: 200 len: 945 time: 0.0918844 Dec 09 22:27:06.555116 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aec47588-30ca-450c-8843-f3df8aebbb0a req-774b8802-8434-4a66-a92c-28c59c912b72 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=0457c075-7ec0-4df4-9722-66642b37f50d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0727682 Dec 09 22:27:06.571315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-eafad43c-c945-45b0-a0b1-8fabb83cab92 req-5aa28a76-d414-4a76-a72a-c8017fde8c2f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting port bf2142c4-6b6c-44ec-aa5b-b452734180dc {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:27:06.571750 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-eafad43c-c945-45b0-a0b1-8fabb83cab92 req-5aa28a76-d414-4a76-a72a-c8017fde8c2f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:06.668534 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-eafad43c-c945-45b0-a0b1-8fabb83cab92 req-5aa28a76-d414-4a76-a72a-c8017fde8c2f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] For port bf2142c4-6b6c-44ec-aa5b-b452734180dc, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=bf2142c4-6b6c-44ec-aa5b-b452734180dc,segment=NetworkSegment(d634afa7-444c-47d3-9e02-42921e0c3151),segment_id=d634afa7-444c-47d3-9e02-42921e0c3151)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:27:06.668911 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-eafad43c-c945-45b0-a0b1-8fabb83cab92 req-5aa28a76-d414-4a76-a72a-c8017fde8c2f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:06.682381 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [req-eafad43c-c945-45b0-a0b1-8fabb83cab92 req-5aa28a76-d414-4a76-a72a-c8017fde8c2f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Calling delete_port for bf2142c4-6b6c-44ec-aa5b-b452734180dc owned by compute:nova {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:27:06.829014 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-eafad43c-c945-45b0-a0b1-8fabb83cab92 req-5aa28a76-d414-4a76-a72a-c8017fde8c2f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:06.863969 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5aa28a76-d414-4a76-a72a-c8017fde8c2f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Port': ['ID=bf2142c4-6b6c-44ec-aa5b-b452734180dc,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:06.897800 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:06.914965 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-eafad43c-c945-45b0-a0b1-8fabb83cab92 req-5aa28a76-d414-4a76-a72a-c8017fde8c2f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] No DVR routers for this DVR port bf2142c4-6b6c-44ec-aa5b-b452734180dc on host n-h2-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:27:06.917782 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-eafad43c-c945-45b0-a0b1-8fabb83cab92 req-5aa28a76-d414-4a76-a72a-c8017fde8c2f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:06.922213 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-eafad43c-c945-45b0-a0b1-8fabb83cab92 req-5aa28a76-d414-4a76-a72a-c8017fde8c2f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.10 "DELETE /v2.0/ports/bf2142c4-6b6c-44ec-aa5b-b452734180dc HTTP/1.1" status: 204 len: 173 time: 0.4841290 Dec 09 22:27:06.922636 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b6c58196-eefa-447d-aa8b-c346e9bca4c9', 'name': 'network-vif-deleted', 'tag': 'bf2142c4-6b6c-44ec-aa5b-b452734180dc'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:27:06.925838 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-14856a49-e13b-4cd7-afb4-9c576190a2e1" -d '{"events": [{"server_uuid": "b6c58196-eefa-447d-aa8b-c346e9bca4c9", "name": "network-vif-deleted", "tag": "bf2142c4-6b6c-44ec-aa5b-b452734180dc"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:27:06.968587 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:27:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f3d0ee33-57ab-4515-b22d-50785cbefe36 x-openstack-request-id: req-f3d0ee33-57ab-4515-b22d-50785cbefe36 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:27:06.968890 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b6c58196-eefa-447d-aa8b-c346e9bca4c9", "name": "network-vif-deleted", "tag": "bf2142c4-6b6c-44ec-aa5b-b452734180dc", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:27:06.969150 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f3d0ee33-57ab-4515-b22d-50785cbefe36 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:27:06.969565 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b6c58196-eefa-447d-aa8b-c346e9bca4c9', 'name': 'network-vif-deleted', 'tag': 'bf2142c4-6b6c-44ec-aa5b-b452734180dc', 'status': 'completed', 'code': 200} Dec 09 22:27:07.614289 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34498) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:27:07.990829 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c30e12a2-726e-4b30-9b99-d2edafcbb68a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:08.237899 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:08.261944 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c30e12a2-726e-4b30-9b99-d2edafcbb68a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting port de13f219-3194-4b40-82f1-858d74834954 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:27:08.262292 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c30e12a2-726e-4b30-9b99-d2edafcbb68a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:08.353024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-c30e12a2-726e-4b30-9b99-d2edafcbb68a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] For port de13f219-3194-4b40-82f1-858d74834954, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=de13f219-3194-4b40-82f1-858d74834954,segment=NetworkSegment(d634afa7-444c-47d3-9e02-42921e0c3151),segment_id=d634afa7-444c-47d3-9e02-42921e0c3151)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:27:08.353302 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c30e12a2-726e-4b30-9b99-d2edafcbb68a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:08.365091 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-c30e12a2-726e-4b30-9b99-d2edafcbb68a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Calling delete_port for de13f219-3194-4b40-82f1-858d74834954 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:27:08.565099 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c30e12a2-726e-4b30-9b99-d2edafcbb68a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:08.591318 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c30e12a2-726e-4b30-9b99-d2edafcbb68a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Port': ['ID=de13f219-3194-4b40-82f1-858d74834954,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:08.770377 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c30e12a2-726e-4b30-9b99-d2edafcbb68a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:08.990698 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c30e12a2-726e-4b30-9b99-d2edafcbb68a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:27:09.097187 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c30e12a2-726e-4b30-9b99-d2edafcbb68a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:27:09.102751 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c30e12a2-726e-4b30-9b99-d2edafcbb68a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "PUT /v2.0/routers/a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4873977 Dec 09 22:27:09.105798 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34500) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:27:09.107211 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1ab5a76-be8c-4692-a7b8-2dab0a611c9d None None] Sync routers for ids ['a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:27:09.117997 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1ab5a76-be8c-4692-a7b8-2dab0a611c9d None None] Routers {'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:27:09.118622 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-f1ab5a76-be8c-4692-a7b8-2dab0a611c9d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:27:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:27:09.163583 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-dbd69606-b617-4932-bfb4-6276329159f5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting subnet 69d8febf-3c3f-4c98-b084-716a5362ebc6 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:27:09.166776 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dbd69606-b617-4932-bfb4-6276329159f5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:09.212456 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dbd69606-b617-4932-bfb4-6276329159f5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:09.225502 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-f1ab5a76-be8c-4692-a7b8-2dab0a611c9d None None] Set router a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:27:09.294357 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dbd69606-b617-4932-bfb4-6276329159f5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:09.343415 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device bf2142c4-6b6c-44ec-aa5b-b452734180dc no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:27:09.355530 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dbd69606-b617-4932-bfb4-6276329159f5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:09.367833 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: bf2142c4-6b6c-44ec-aa5b-b452734180dc {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:27:09.368188 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device bf2142c4-6b6c-44ec-aa5b-b452734180dc not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:27:09.386784 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbd69606-b617-4932-bfb4-6276329159f5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Subnet': ['ID=69d8febf-3c3f-4c98-b084-716a5362ebc6,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:09.390703 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-dbd69606-b617-4932-bfb4-6276329159f5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:09.396026 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-dbd69606-b617-4932-bfb4-6276329159f5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/subnets/69d8febf-3c3f-4c98-b084-716a5362ebc6 HTTP/1.1" status: 204 len: 168 time: 0.2891266 Dec 09 22:27:09.396812 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34502) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:27:09.412120 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ac1786e-4863-472e-9c0e-b711486ec3d7 None None] Network 4acfc0bf-ef93-4f01-883a-4e582d1c06d7 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:27:09.506198 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e34e03bf-9b99-4bfd-8fb9-4cb54a2cb9e9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:09.612980 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e34e03bf-9b99-4bfd-8fb9-4cb54a2cb9e9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:09.665513 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-e34e03bf-9b99-4bfd-8fb9-4cb54a2cb9e9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting port 342d6d27-af9b-4789-91c2-cfc15a483ba5 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:27:09.665884 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e34e03bf-9b99-4bfd-8fb9-4cb54a2cb9e9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:09.688600 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-f1ab5a76-be8c-4692-a7b8-2dab0a611c9d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1305906706', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100'}], 'enable_snat': True}, 'gw_port_id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:27:08Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '342d6d27-af9b-4789-91c2-cfc15a483ba5', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:48:b1:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4253, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:25:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:27:09.725686 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1ab5a76-be8c-4692-a7b8-2dab0a611c9d None None] Checking router: a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:27:09.735707 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:09.738708 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1ab5a76-be8c-4692-a7b8-2dab0a611c9d None None] Routers {'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:27:09.739328 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-f1ab5a76-be8c-4692-a7b8-2dab0a611c9d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:27:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:27:09.757753 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-e34e03bf-9b99-4bfd-8fb9-4cb54a2cb9e9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] For port 342d6d27-af9b-4789-91c2-cfc15a483ba5, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=342d6d27-af9b-4789-91c2-cfc15a483ba5,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:27:09.758114 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e34e03bf-9b99-4bfd-8fb9-4cb54a2cb9e9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:09.771516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-e34e03bf-9b99-4bfd-8fb9-4cb54a2cb9e9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Calling delete_port for 342d6d27-af9b-4789-91c2-cfc15a483ba5 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:27:09.774941 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5332f1e4-fc3f-4c39-96bb-6b53f3e0c12b None None] DHCP port deletion for 4acfc0bf-ef93-4f01-883a-4e582d1c06d7 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:27:09.851100 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-f1ab5a76-be8c-4692-a7b8-2dab0a611c9d None None] Set router a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:27:09.908535 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-f1ab5a76-be8c-4692-a7b8-2dab0a611c9d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1305906706', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:27:09Z', 'revision_number': 6, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:27:09.939333 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1ab5a76-be8c-4692-a7b8-2dab0a611c9d None None] The sync data for ids ['a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1'] in n-d-713301-27 is: [{'id': 'a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1305906706', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:25:25Z', 'updated_at': '2021-12-09T22:27:09Z', 'revision_number': 6, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port_host': None}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:27:09.943724 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e34e03bf-9b99-4bfd-8fb9-4cb54a2cb9e9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:09.949437 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-5332f1e4-fc3f-4c39-96bb-6b53f3e0c12b None None] Deleting port dd318939-4b9c-4ea2-8945-0b54cd734bfe {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:27:09.949896 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5332f1e4-fc3f-4c39-96bb-6b53f3e0c12b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:09.974362 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e34e03bf-9b99-4bfd-8fb9-4cb54a2cb9e9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Port': ['ID=342d6d27-af9b-4789-91c2-cfc15a483ba5,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:10.021186 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ec24c3b9-b17d-498b-b1f8-3d79161998e3 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:27:10.035901 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e34e03bf-9b99-4bfd-8fb9-4cb54a2cb9e9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:10.039032 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-5332f1e4-fc3f-4c39-96bb-6b53f3e0c12b None None] For port dd318939-4b9c-4ea2-8945-0b54cd734bfe, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=dd318939-4b9c-4ea2-8945-0b54cd734bfe,segment=NetworkSegment(d634afa7-444c-47d3-9e02-42921e0c3151),segment_id=d634afa7-444c-47d3-9e02-42921e0c3151)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:27:10.039343 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5332f1e4-fc3f-4c39-96bb-6b53f3e0c12b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:10.052184 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-5332f1e4-fc3f-4c39-96bb-6b53f3e0c12b None None] Calling delete_port for dd318939-4b9c-4ea2-8945-0b54cd734bfe owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:27:10.132447 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e34e03bf-9b99-4bfd-8fb9-4cb54a2cb9e9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:10.132766 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5332f1e4-fc3f-4c39-96bb-6b53f3e0c12b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:10.134639 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e34e03bf-9b99-4bfd-8fb9-4cb54a2cb9e9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:10.157739 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5332f1e4-fc3f-4c39-96bb-6b53f3e0c12b None None] Pushing event deleted for resources: {'Port': ['ID=dd318939-4b9c-4ea2-8945-0b54cd734bfe,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:10.161494 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5332f1e4-fc3f-4c39-96bb-6b53f3e0c12b None None] No DVR routers for this DVR port dd318939-4b9c-4ea2-8945-0b54cd734bfe on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:27:10.535152 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device dd318939-4b9c-4ea2-8945-0b54cd734bfe no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:27:10.552782 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e34e03bf-9b99-4bfd-8fb9-4cb54a2cb9e9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:10.553436 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e34e03bf-9b99-4bfd-8fb9-4cb54a2cb9e9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Fanout notify agent at l3_agent the message router_deleted on router a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 22:27:10.561275 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e34e03bf-9b99-4bfd-8fb9-4cb54a2cb9e9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:10.562581 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e34e03bf-9b99-4bfd-8fb9-4cb54a2cb9e9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/routers/a5a33ee6-7b04-4b31-b608-a3dab1c8b0f1 HTTP/1.1" status: 204 len: 168 time: 1.1644335 Dec 09 22:27:10.565299 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34504) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:27:10.566795 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: dd318939-4b9c-4ea2-8945-0b54cd734bfe {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:27:10.567141 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device dd318939-4b9c-4ea2-8945-0b54cd734bfe not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:27:10.567580 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device de13f219-3194-4b40-82f1-858d74834954 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:27:10.587730 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: de13f219-3194-4b40-82f1-858d74834954 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:27:10.588069 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device de13f219-3194-4b40-82f1-858d74834954 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:27:10.647376 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-841c32d9-9301-4f00-bbe4-fa43cf8c4dd1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:10.745623 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-841c32d9-9301-4f00-bbe4-fa43cf8c4dd1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:10.767956 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-841c32d9-9301-4f00-bbe4-fa43cf8c4dd1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4acfc0bf-ef93-4f01-883a-4e582d1c06d7']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:27:10.777988 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-841c32d9-9301-4f00-bbe4-fa43cf8c4dd1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd634afa7-444c-47d3-9e02-42921e0c3151') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:27:10.778587 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-841c32d9-9301-4f00-bbe4-fa43cf8c4dd1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd634afa7-444c-47d3-9e02-42921e0c3151') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:27:10.788549 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-841c32d9-9301-4f00-bbe4-fa43cf8c4dd1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:10.804056 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-841c32d9-9301-4f00-bbe4-fa43cf8c4dd1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:10.811137 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-841c32d9-9301-4f00-bbe4-fa43cf8c4dd1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Releasing vlan 130 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:27:10.811783 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-841c32d9-9301-4f00-bbe4-fa43cf8c4dd1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: timer() Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:27:10.814796 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:27:10.891173 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-841c32d9-9301-4f00-bbe4-fa43cf8c4dd1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:10.900309 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-841c32d9-9301-4f00-bbe4-fa43cf8c4dd1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:10.903457 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-841c32d9-9301-4f00-bbe4-fa43cf8c4dd1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/networks/4acfc0bf-ef93-4f01-883a-4e582d1c06d7 HTTP/1.1" status: 204 len: 168 time: 0.3368516 Dec 09 22:27:10.906854 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34506) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:27:10.916736 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-841c32d9-9301-4f00-bbe4-fa43cf8c4dd1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Network': ['ID=4acfc0bf-ef93-4f01-883a-4e582d1c06d7,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:10.966506 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-93de1c30-115e-4144-8fdb-4c26c2b8ed7c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:10.991702 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-93de1c30-115e-4144-8fdb-4c26c2b8ed7c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:11.057798 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-93de1c30-115e-4144-8fdb-4c26c2b8ed7c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:11.060414 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-93de1c30-115e-4144-8fdb-4c26c2b8ed7c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:11.061738 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-93de1c30-115e-4144-8fdb-4c26c2b8ed7c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/security-groups/0457c075-7ec0-4df4-9722-66642b37f50d HTTP/1.1" status: 204 len: 168 time: 0.1537676 Dec 09 22:27:11.070918 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93de1c30-115e-4144-8fdb-4c26c2b8ed7c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0457c075-7ec0-4df4-9722-66642b37f50d,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:11.343674 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34512) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:27:11.348468 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-ed471ea6-9090-4a81-a572-3e006903dd5a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-985744047', 'description': 'tempest-secgroup-smoke-985744047 description', 'project_id': 'e21dff80515b44aa9f01117603c6de0d'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:27:11.374122 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ed471ea6-9090-4a81-a572-3e006903dd5a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:11.442252 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ed471ea6-9090-4a81-a572-3e006903dd5a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:11.448654 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ed471ea6-9090-4a81-a572-3e006903dd5a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:11.479727 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ed471ea6-9090-4a81-a572-3e006903dd5a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:11.480953 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ed471ea6-9090-4a81-a572-3e006903dd5a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.1362221 Dec 09 22:27:11.481828 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed471ea6-9090-4a81-a572-3e006903dd5a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d710d5b3-ff7a-4ab7-931a-cfb5ca198131,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:11.484195 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34514) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:27:11.488540 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-af4a01e9-fd4d-4624-818d-4bd1eb8ab074 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': 'd710d5b3-ff7a-4ab7-931a-cfb5ca198131', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:27:11.514787 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-af4a01e9-fd4d-4624-818d-4bd1eb8ab074 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:11.573883 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-af4a01e9-fd4d-4624-818d-4bd1eb8ab074 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:11.578823 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-af4a01e9-fd4d-4624-818d-4bd1eb8ab074 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:11.596323 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af4a01e9-fd4d-4624-818d-4bd1eb8ab074 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5e492d6d-1d54-454d-a16b-ee29255c2e5d,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:11.603932 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-af4a01e9-fd4d-4624-818d-4bd1eb8ab074 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:11.605110 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-af4a01e9-fd4d-4624-818d-4bd1eb8ab074 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1199386 Dec 09 22:27:11.608994 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34516) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:27:11.613477 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-93f6a765-b22c-4523-9abd-2f76439521fe tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': 'd710d5b3-ff7a-4ab7-931a-cfb5ca198131', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:27:11.642888 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-93f6a765-b22c-4523-9abd-2f76439521fe tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:11.700254 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-93f6a765-b22c-4523-9abd-2f76439521fe tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:11.706846 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-93f6a765-b22c-4523-9abd-2f76439521fe tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:11.727681 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93f6a765-b22c-4523-9abd-2f76439521fe tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=85b38d86-6333-4945-9e53-79f3474863f3,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:11.736672 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-93f6a765-b22c-4523-9abd-2f76439521fe tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:11.737872 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-93f6a765-b22c-4523-9abd-2f76439521fe tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1278303 Dec 09 22:27:11.741791 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34518) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:27:11.746094 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-681f51f4-415f-4048-bdec-a1a4d6b2cbbb tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': 'd710d5b3-ff7a-4ab7-931a-cfb5ca198131', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:27:11.774567 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-681f51f4-415f-4048-bdec-a1a4d6b2cbbb tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:11.834827 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-681f51f4-415f-4048-bdec-a1a4d6b2cbbb tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:11.839907 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-681f51f4-415f-4048-bdec-a1a4d6b2cbbb tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:11.857140 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-681f51f4-415f-4048-bdec-a1a4d6b2cbbb tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=de57eed4-8455-4469-9574-b9caba33c8f6,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:11.863765 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-681f51f4-415f-4048-bdec-a1a4d6b2cbbb tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:11.864831 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-681f51f4-415f-4048-bdec-a1a4d6b2cbbb tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1221275 Dec 09 22:27:11.867767 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34520) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:27:11.872041 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-18997b6e-0b26-4608-a6c0-a73935ee739a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': 'd710d5b3-ff7a-4ab7-931a-cfb5ca198131', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:27:11.897848 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-18997b6e-0b26-4608-a6c0-a73935ee739a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:11.955978 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-18997b6e-0b26-4608-a6c0-a73935ee739a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:11.962162 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-18997b6e-0b26-4608-a6c0-a73935ee739a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:11.986151 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18997b6e-0b26-4608-a6c0-a73935ee739a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a8c3c84c-262b-411a-a0c7-24d207b916ca,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:11.995811 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-18997b6e-0b26-4608-a6c0-a73935ee739a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:11.997095 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-18997b6e-0b26-4608-a6c0-a73935ee739a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1283743 Dec 09 22:27:12.000190 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34522) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:27:12.004992 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-faa072cf-97fb-44eb-acdf-868518b349fd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': 'd710d5b3-ff7a-4ab7-931a-cfb5ca198131', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:27:12.028464 n-d-713301-27 neutron-server[103437]: INFO neutron.db.securitygroups_db [None req-faa072cf-97fb-44eb-acdf-868518b349fd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Project e21dff80515b44aa9f01117603c6de0d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 22:27:12.033712 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-faa072cf-97fb-44eb-acdf-868518b349fd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:12.095451 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-faa072cf-97fb-44eb-acdf-868518b349fd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:12.098933 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-faa072cf-97fb-44eb-acdf-868518b349fd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:12.118739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faa072cf-97fb-44eb-acdf-868518b349fd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=69192245-5a12-4ec9-ba5c-da21b1599195,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:12.127690 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-faa072cf-97fb-44eb-acdf-868518b349fd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:12.129056 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-faa072cf-97fb-44eb-acdf-868518b349fd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1277461 Dec 09 22:27:12.131841 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34524) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:27:12.136223 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-ff14f768-f412-4aa3-bd9c-9f740c378a0a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': 'd710d5b3-ff7a-4ab7-931a-cfb5ca198131', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:27:12.160759 n-d-713301-27 neutron-server[103437]: INFO neutron.db.securitygroups_db [None req-ff14f768-f412-4aa3-bd9c-9f740c378a0a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Project e21dff80515b44aa9f01117603c6de0d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 22:27:12.167218 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ff14f768-f412-4aa3-bd9c-9f740c378a0a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:12.228963 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ff14f768-f412-4aa3-bd9c-9f740c378a0a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:12.234186 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ff14f768-f412-4aa3-bd9c-9f740c378a0a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:12.259481 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff14f768-f412-4aa3-bd9c-9f740c378a0a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=80277cb7-4beb-4fc7-afcf-2bfb60f4f19a,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:12.264770 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-ff14f768-f412-4aa3-bd9c-9f740c378a0a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:12.266240 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ff14f768-f412-4aa3-bd9c-9f740c378a0a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1333332 Dec 09 22:27:12.269364 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34526) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:27:12.274143 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a8472b0f-3f48-4398-a039-a441d0c9a432 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'network': {'name': 'tempest-network-smoke--1290163114', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'port_security_enabled': True}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:27:12.296752 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a8472b0f-3f48-4398-a039-a441d0c9a432 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Made reservation on behalf of e21dff80515b44aa9f01117603c6de0d for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:27:12.301108 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8472b0f-3f48-4398-a039-a441d0c9a432 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:12.324769 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a8472b0f-3f48-4398-a039-a441d0c9a432 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] vlan segment allocate from pool success with {'vlan_id': 109, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 22:27:12.334468 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8472b0f-3f48-4398-a039-a441d0c9a432 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:12.334839 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-a8472b0f-3f48-4398-a039-a441d0c9a432 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Added segment 3f17fd79-d495-4e9d-aa70-314151576549 of type vlan for network d467eac6-2065-4a25-96d1-9c231e3db6c2 Dec 09 22:27:12.377206 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8472b0f-3f48-4398-a039-a441d0c9a432 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:12.401561 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 342d6d27-af9b-4789-91c2-cfc15a483ba5 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:27:12.403289 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8472b0f-3f48-4398-a039-a441d0c9a432 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:12.410347 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a8472b0f-3f48-4398-a039-a441d0c9a432 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:12.411134 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a8472b0f-3f48-4398-a039-a441d0c9a432 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:12.426045 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 342d6d27-af9b-4789-91c2-cfc15a483ba5 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:27:12.426686 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 342d6d27-af9b-4789-91c2-cfc15a483ba5 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:27:12.448807 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a8472b0f-3f48-4398-a039-a441d0c9a432 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.1783624 Dec 09 22:27:12.451501 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34528) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:27:12.456480 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-45f52fc4-04c2-413d-ac04-72f46b411b7e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-220773520', 'admin_state_up': True, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:27:12.496189 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8472b0f-3f48-4398-a039-a441d0c9a432 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Network': ['ID=d467eac6-2065-4a25-96d1-9c231e3db6c2,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:12.506582 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network d467eac6-2065-4a25-96d1-9c231e3db6c2 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 22:27:12.511021 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-45f52fc4-04c2-413d-ac04-72f46b411b7e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:12.512166 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-45f52fc4-04c2-413d-ac04-72f46b411b7e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:12.569703 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-45f52fc4-04c2-413d-ac04-72f46b411b7e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:12.707110 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-45f52fc4-04c2-413d-ac04-72f46b411b7e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:12.913807 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-45f52fc4-04c2-413d-ac04-72f46b411b7e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:12.933307 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-45f52fc4-04c2-413d-ac04-72f46b411b7e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:13.041672 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-45f52fc4-04c2-413d-ac04-72f46b411b7e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Allocated IP 172.25.3.55 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/2fb791f4-4212-4cbc-95e8-2315abfefcec) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:27:13.149515 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-45f52fc4-04c2-413d-ac04-72f46b411b7e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:13.188487 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-45f52fc4-04c2-413d-ac04-72f46b411b7e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:13.224056 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-45f52fc4-04c2-413d-ac04-72f46b411b7e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:27:13.228311 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-45f52fc4-04c2-413d-ac04-72f46b411b7e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:27:13.230729 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45f52fc4-04c2-413d-ac04-72f46b411b7e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:27:13.241533 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6957a461-27f7-42c3-925c-8728ae8984f5 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:27:13.261923 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45f52fc4-04c2-413d-ac04-72f46b411b7e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=2fb791f4-4212-4cbc-95e8-2315abfefcec,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:13.302982 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ed199ee2-c3bf-415f-924c-78877906735f None None] Provisioning complete for port 2fb791f4-4212-4cbc-95e8-2315abfefcec triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:27:13.303239 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ed199ee2-c3bf-415f-924c-78877906735f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:13.337336 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ed199ee2-c3bf-415f-924c-78877906735f None None] Port 2fb791f4-4212-4cbc-95e8-2315abfefcec cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:27:13.497020 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-45f52fc4-04c2-413d-ac04-72f46b411b7e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:13.693979 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-45f52fc4-04c2-413d-ac04-72f46b411b7e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:13.836383 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-45f52fc4-04c2-413d-ac04-72f46b411b7e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router e55e0a83-70fc-4320-8788-01e385b7a908 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 22:27:13.948805 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-45f52fc4-04c2-413d-ac04-72f46b411b7e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:27:13.959362 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] Sync routers for ids ['e55e0a83-70fc-4320-8788-01e385b7a908'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:27:13.969972 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] Routers {'e55e0a83-70fc-4320-8788-01e385b7a908'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:27:13.970718 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-45f52fc4-04c2-413d-ac04-72f46b411b7e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:13.970868 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:27:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['e55e0a83-70fc-4320-8788-01e385b7a908'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:27:13.974921 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-45f52fc4-04c2-413d-ac04-72f46b411b7e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 894 time: 1.5194035 Dec 09 22:27:13.975154 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34530) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:27:14.006922 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-feecbf33-2dc6-4326-9efd-68fdd6b05824 tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] 10.222.0.13 "GET /v2.0/subnets?project_id=e21dff80515b44aa9f01117603c6de0d&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0305793 Dec 09 22:27:14.009648 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34532) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:27:14.098283 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9c36eb59-5d29-4a36-a2fe-1c2638d22039 tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:14.102738 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-9c36eb59-5d29-4a36-a2fe-1c2638d22039 tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0892706 Dec 09 22:27:14.102932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34534) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:27:14.135216 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e01807fe-30c8-4c43-aab1-c8da7ad198f2 tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] 10.222.0.13 "GET /v2.0/subnets?network_id=97925a19-460a-4476-8208-41db134b6c83&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0287397 Dec 09 22:27:14.135469 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34536) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:27:14.141070 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-58dec7d8-ef05-44cf-bf5b-fac46f305119 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-1881059517', 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:27:14.181588 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] Set router e55e0a83-70fc-4320-8788-01e385b7a908 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:27:14.238591 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-58dec7d8-ef05-44cf-bf5b-fac46f305119 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Made reservation on behalf of e21dff80515b44aa9f01117603c6de0d for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:27:14.242281 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58dec7d8-ef05-44cf-bf5b-fac46f305119 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:14.358415 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'name': 'tempest-TestNetworkAdvancedServerOps-router-220773520', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55'}], 'enable_snat': True}, 'gw_port_id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:13Z', 'revision_number': 3, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:51:dc:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4272, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:13Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:27:14.390050 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] Checking router: e55e0a83-70fc-4320-8788-01e385b7a908 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:27:14.390050 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] Updating router e55e0a83-70fc-4320-8788-01e385b7a908 port 2fb791f4-4212-4cbc-95e8-2315abfefcec binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:27:14.416806 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:14.431136 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58dec7d8-ef05-44cf-bf5b-fac46f305119 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:14.495627 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58dec7d8-ef05-44cf-bf5b-fac46f305119 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Subnet': ['ID=fd45a75f-0057-4c2b-974a-168e46ade458,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:14.501363 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58dec7d8-ef05-44cf-bf5b-fac46f305119 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Checking segment: {'id': '3f17fd79-d495-4e9d-aa70-314151576549', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:27:14.501759 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-58dec7d8-ef05-44cf-bf5b-fac46f305119 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network hostable DHCP agents. Network: d467eac6-2065-4a25-96d1-9c231e3db6c2, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 22:27:14.521781 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-58dec7d8-ef05-44cf-bf5b-fac46f305119 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network d467eac6-2065-4a25-96d1-9c231e3db6c2 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 22:27:14.533070 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-58dec7d8-ef05-44cf-bf5b-fac46f305119 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, d467eac6-2065-4a25-96d1-9c231e3db6c2) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:27:14.537761 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-58dec7d8-ef05-44cf-bf5b-fac46f305119 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:14.538431 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-58dec7d8-ef05-44cf-bf5b-fac46f305119 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:14.544941 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f319ed4-1a7d-4bd6-b518-0890709e603f None None] Network d467eac6-2065-4a25-96d1-9c231e3db6c2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:27:14.557756 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-58dec7d8-ef05-44cf-bf5b-fac46f305119 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 832 time: 0.4211771 Dec 09 22:27:14.560725 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34538) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:27:14.662058 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2c4133f4-9ce5-4a4b-9527-a331462ccb2b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-d467eac6-2065-4a25-96d1-9c231e3db6c2', 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ips': [{'subnet_id': 'fd45a75f-0057-4c2b-974a-168e46ade458'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 22:27:14.663153 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2c4133f4-9ce5-4a4b-9527-a331462ccb2b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:14.678968 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:14.686376 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:14.735633 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] Attempting to bind port 2fb791f4-4212-4cbc-95e8-2315abfefcec on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:27:14.736071 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] Attempting to bind port 2fb791f4-4212-4cbc-95e8-2315abfefcec by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:27:14.737200 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] Attempting to bind port 2fb791f4-4212-4cbc-95e8-2315abfefcec on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:27:14.741153 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4bd004ce-e936-4968-8465-0ba0365a202c None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:27:14.751534 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 27, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:27:14.752666 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:27:14.752815 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:14.753304 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:27:14.754136 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] Bound port: 2fb791f4-4212-4cbc-95e8-2315abfefcec, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:27:14.754818 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:14.798252 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb1d10a3-0999-45be-a643-59987e493001 None None] Pushing event updated for resources: {'Port': ['ID=2fb791f4-4212-4cbc-95e8-2315abfefcec,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:14.815123 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-2c4133f4-9ce5-4a4b-9527-a331462ccb2b None None] Allocated IP 172.20.0.2 (d467eac6-2065-4a25-96d1-9c231e3db6c2/fd45a75f-0057-4c2b-974a-168e46ade458/68ec7864-df70-45a3-a181-d400b58f4261) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:27:14.818404 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb1d10a3-0999-45be-a643-59987e493001 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:14.818795 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb1d10a3-0999-45be-a643-59987e493001 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:14.819126 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb1d10a3-0999-45be-a643-59987e493001 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:14.819470 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb1d10a3-0999-45be-a643-59987e493001 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:14.819841 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb1d10a3-0999-45be-a643-59987e493001 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:14.820173 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb1d10a3-0999-45be-a643-59987e493001 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:14.820476 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb1d10a3-0999-45be-a643-59987e493001 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:14.820840 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb1d10a3-0999-45be-a643-59987e493001 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:14.821154 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb1d10a3-0999-45be-a643-59987e493001 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:14.821466 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb1d10a3-0999-45be-a643-59987e493001 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:14.824213 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb1d10a3-0999-45be-a643-59987e493001 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:14.824634 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb1d10a3-0999-45be-a643-59987e493001 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:14.825437 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb1d10a3-0999-45be-a643-59987e493001 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:27:14.842478 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] For port 2fb791f4-4212-4cbc-95e8-2315abfefcec, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:27:14.846036 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] For port 2fb791f4-4212-4cbc-95e8-2315abfefcec, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2fb791f4-4212-4cbc-95e8-2315abfefcec,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:27:14.852181 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:14.910499 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b8b6eaa4-c5e1-4161-a30f-7e70b6a6bdd3 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:27:14.913520 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] Routers {'e55e0a83-70fc-4320-8788-01e385b7a908'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:27:14.914229 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:27:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['e55e0a83-70fc-4320-8788-01e385b7a908'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:27:14.919295 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb1d10a3-0999-45be-a643-59987e493001 None None] Pushing event updated for resources: {'Port': ['ID=2fb791f4-4212-4cbc-95e8-2315abfefcec,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:14.923228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-eacc007c-3f9c-4750-9e10-1dff08296e84 None None] Provisioning complete for port 2fb791f4-4212-4cbc-95e8-2315abfefcec triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:27:14.923642 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eacc007c-3f9c-4750-9e10-1dff08296e84 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:15.013935 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-55677cc9-7e80-4804-85e2-76cc78d32b2d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:15.034659 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] Set router e55e0a83-70fc-4320-8788-01e385b7a908 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:27:15.056210 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2c4133f4-9ce5-4a4b-9527-a331462ccb2b None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:15.063977 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eacc007c-3f9c-4750-9e10-1dff08296e84 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:15.070526 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2c4133f4-9ce5-4a4b-9527-a331462ccb2b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:15.118831 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2c4133f4-9ce5-4a4b-9527-a331462ccb2b None None] Network d467eac6-2065-4a25-96d1-9c231e3db6c2 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:27:15.122119 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-eacc007c-3f9c-4750-9e10-1dff08296e84 None None] For port 2fb791f4-4212-4cbc-95e8-2315abfefcec, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2fb791f4-4212-4cbc-95e8-2315abfefcec,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:27:15.125383 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-2c4133f4-9ce5-4a4b-9527-a331462ccb2b None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:27:15.129455 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2c4133f4-9ce5-4a4b-9527-a331462ccb2b None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:27:15.131540 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eacc007c-3f9c-4750-9e10-1dff08296e84 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:15.161465 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c4133f4-9ce5-4a4b-9527-a331462ccb2b None None] Pushing event updated for resources: {'Port': ['ID=68ec7864-df70-45a3-a181-d400b58f4261,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:15.223406 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2c4133f4-9ce5-4a4b-9527-a331462ccb2b None None] Attempting to bind port 68ec7864-df70-45a3-a181-d400b58f4261 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:27:15.223816 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2c4133f4-9ce5-4a4b-9527-a331462ccb2b None None] Attempting to bind port 68ec7864-df70-45a3-a181-d400b58f4261 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '3f17fd79-d495-4e9d-aa70-314151576549', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:27:15.224157 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c4133f4-9ce5-4a4b-9527-a331462ccb2b None None] Attempting to bind port 68ec7864-df70-45a3-a181-d400b58f4261 on network d467eac6-2065-4a25-96d1-9c231e3db6c2 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:27:15.232733 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'name': 'tempest-TestNetworkAdvancedServerOps-router-220773520', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55'}], 'enable_snat': True}, 'gw_port_id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:13Z', 'revision_number': 3, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:51:dc:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4272, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:27:15.236930 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c4133f4-9ce5-4a4b-9527-a331462ccb2b None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 27, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:27:15.238050 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c4133f4-9ce5-4a4b-9527-a331462ccb2b None None] Checking segment: {'id': '3f17fd79-d495-4e9d-aa70-314151576549', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:27:15.238050 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2c4133f4-9ce5-4a4b-9527-a331462ccb2b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:15.238050 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2c4133f4-9ce5-4a4b-9527-a331462ccb2b None None] Bound using segment: {'id': '3f17fd79-d495-4e9d-aa70-314151576549', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:27:15.238524 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2c4133f4-9ce5-4a4b-9527-a331462ccb2b None None] Bound port: 68ec7864-df70-45a3-a181-d400b58f4261, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3f17fd79-d495-4e9d-aa70-314151576549', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:27:15.238904 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2c4133f4-9ce5-4a4b-9527-a331462ccb2b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:15.255279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eacc007c-3f9c-4750-9e10-1dff08296e84 None None] Pushing event updated for resources: {'Port': ['ID=2fb791f4-4212-4cbc-95e8-2315abfefcec,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:15.268556 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b87e0e94-2f58-48ff-b943-e184f936c4ef None None] The sync data for ids ['e55e0a83-70fc-4320-8788-01e385b7a908'] in n-d-713301-27 is: [{'id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'name': 'tempest-TestNetworkAdvancedServerOps-router-220773520', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55'}], 'enable_snat': True}, 'gw_port_id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:13Z', 'revision_number': 3, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:51:dc:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4272, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:27:15.291842 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-76683e89-bbd9-4188-9a75-f5d023cf7b16 None None] Provisioning complete for port 2fb791f4-4212-4cbc-95e8-2315abfefcec triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:27:15.292210 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-76683e89-bbd9-4188-9a75-f5d023cf7b16 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:15.324937 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-55677cc9-7e80-4804-85e2-76cc78d32b2d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Allocated IP 172.20.0.1 (d467eac6-2065-4a25-96d1-9c231e3db6c2/fd45a75f-0057-4c2b-974a-168e46ade458/7de3f084-1e14-4e02-b1d3-b78821d0bda7) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:27:15.351264 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2c4133f4-9ce5-4a4b-9527-a331462ccb2b None None] For port 68ec7864-df70-45a3-a181-d400b58f4261, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:27:15.365980 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2c4133f4-9ce5-4a4b-9527-a331462ccb2b None None] For port 68ec7864-df70-45a3-a181-d400b58f4261, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=68ec7864-df70-45a3-a181-d400b58f4261,segment=NetworkSegment(3f17fd79-d495-4e9d-aa70-314151576549),segment_id=3f17fd79-d495-4e9d-aa70-314151576549)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:27:15.392325 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2c4133f4-9ce5-4a4b-9527-a331462ccb2b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:15.459240 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-55677cc9-7e80-4804-85e2-76cc78d32b2d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:15.469192 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c4133f4-9ce5-4a4b-9527-a331462ccb2b None None] Pushing event updated for resources: {'Port': ['ID=68ec7864-df70-45a3-a181-d400b58f4261,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:15.524088 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-55677cc9-7e80-4804-85e2-76cc78d32b2d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:15.578353 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55677cc9-7e80-4804-85e2-76cc78d32b2d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network d467eac6-2065-4a25-96d1-9c231e3db6c2 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:27:15.584894 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-55677cc9-7e80-4804-85e2-76cc78d32b2d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:27:15.587541 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55677cc9-7e80-4804-85e2-76cc78d32b2d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:27:15.614477 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55677cc9-7e80-4804-85e2-76cc78d32b2d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=7de3f084-1e14-4e02-b1d3-b78821d0bda7,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:15.651275 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-55677cc9-7e80-4804-85e2-76cc78d32b2d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:15.847294 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-55677cc9-7e80-4804-85e2-76cc78d32b2d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:16.149004 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-55677cc9-7e80-4804-85e2-76cc78d32b2d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:16.155950 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-55677cc9-7e80-4804-85e2-76cc78d32b2d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:16.234669 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55677cc9-7e80-4804-85e2-76cc78d32b2d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=7de3f084-1e14-4e02-b1d3-b78821d0bda7,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:16.240286 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-55677cc9-7e80-4804-85e2-76cc78d32b2d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:16.341281 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-55677cc9-7e80-4804-85e2-76cc78d32b2d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network d467eac6-2065-4a25-96d1-9c231e3db6c2 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:27:16.342779 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-55677cc9-7e80-4804-85e2-76cc78d32b2d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:27:16.476869 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-55677cc9-7e80-4804-85e2-76cc78d32b2d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router e55e0a83-70fc-4320-8788-01e385b7a908 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:27:16.505634 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-846edc99-80b3-4ed1-a057-aaf7ff2b2ad7 None None] Network d467eac6-2065-4a25-96d1-9c231e3db6c2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:27:16.566305 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 68ec7864-df70-45a3-a181-d400b58f4261 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:27:16.598564 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-55677cc9-7e80-4804-85e2-76cc78d32b2d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:27:16.603954 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-55677cc9-7e80-4804-85e2-76cc78d32b2d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "PUT /v2.0/routers/e55e0a83-70fc-4320-8788-01e385b7a908/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0421338 Dec 09 22:27:16.631850 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3baeb4d6-3b7a-4fd2-b957-b3375b4954b4 None None] Provisioning complete for port 68ec7864-df70-45a3-a181-d400b58f4261 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:27:16.632220 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3baeb4d6-3b7a-4fd2-b957-b3375b4954b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:16.701628 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 68ec7864-df70-45a3-a181-d400b58f4261 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:27:16.702012 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:16.786750 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-92c438e4-5981-457f-a56f-480370a79c1c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-985744047&fields=id&tenant_id=e21dff80515b44aa9f01117603c6de0d HTTP/1.1" status: 200 len: 267 time: 0.0606217 Dec 09 22:27:16.822832 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3baeb4d6-3b7a-4fd2-b957-b3375b4954b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:16.841900 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:16.879835 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-3baeb4d6-3b7a-4fd2-b957-b3375b4954b4 None None] For port 68ec7864-df70-45a3-a181-d400b58f4261, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=68ec7864-df70-45a3-a181-d400b58f4261,segment=NetworkSegment(3f17fd79-d495-4e9d-aa70-314151576549),segment_id=3f17fd79-d495-4e9d-aa70-314151576549)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:27:16.886323 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3baeb4d6-3b7a-4fd2-b957-b3375b4954b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:16.914258 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-0106bf8d-1bc7-45f6-9143-b687780fa32d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:16.916057 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-0106bf8d-1bc7-45f6-9143-b687780fa32d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/networks?id=d467eac6-2065-4a25-96d1-9c231e3db6c2 HTTP/1.1" status: 200 len: 797 time: 0.1220279 Dec 09 22:27:16.934679 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-606dfdbf-5c48-4764-a7a0-831d8501ae61 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/quotas/e21dff80515b44aa9f01117603c6de0d HTTP/1.1" status: 200 len: 375 time: 0.0118563 Dec 09 22:27:16.957365 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 22:27:16.957731 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 22:27:16.967429 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3baeb4d6-3b7a-4fd2-b957-b3375b4954b4 None None] Pushing event updated for resources: {'Port': ['ID=68ec7864-df70-45a3-a181-d400b58f4261,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:16.999736 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-e73eeef0-b40a-41b2-9108-68a893c1a351 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0542860 Dec 09 22:27:17.014234 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-85d2de95-b215-4db7-abaa-ea3bf6d3af09 None None] Provisioning complete for port 68ec7864-df70-45a3-a181-d400b58f4261 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:27:17.014695 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-85d2de95-b215-4db7-abaa-ea3bf6d3af09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:17.124935 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-fc2e7074-c062-496b-82f4-15cd350cfd4e service neutron] 10.222.0.13 "GET /v2.0/networks/d467eac6-2065-4a25-96d1-9c231e3db6c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1105473 Dec 09 22:27:17.216746 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] Sync routers for ids ['e55e0a83-70fc-4320-8788-01e385b7a908'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:27:17.234714 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8cef7ef1-267f-4065-9433-e3660fb59602 service neutron] 10.222.0.13 "GET /v2.0/networks/d467eac6-2065-4a25-96d1-9c231e3db6c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1025562 Dec 09 22:27:17.240027 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] Routers {'e55e0a83-70fc-4320-8788-01e385b7a908'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:27:17.240677 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:27:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['e55e0a83-70fc-4320-8788-01e385b7a908'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:27:17.398129 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] Set router e55e0a83-70fc-4320-8788-01e385b7a908 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:27:17.418246 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-36482397-3250-4f4c-b0e2-2c7decef6cb6 req-a7115dd4-5d36-4d88-acd8-3c66f0550469 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 210 time: 0.0315585 Dec 09 22:27:17.455364 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-85d2de95-b215-4db7-abaa-ea3bf6d3af09 None None] Provisioning complete for port 7de3f084-1e14-4e02-b1d3-b78821d0bda7 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:27:17.455764 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-85d2de95-b215-4db7-abaa-ea3bf6d3af09 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:17.571705 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-85d2de95-b215-4db7-abaa-ea3bf6d3af09 None None] Port 7de3f084-1e14-4e02-b1d3-b78821d0bda7 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:27:17.576010 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2fb791f4-4212-4cbc-95e8-2315abfefcec up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:27:17.697638 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 2fb791f4-4212-4cbc-95e8-2315abfefcec triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:27:17.698015 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:17.741452 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-95a42ffd-5c42-4c44-88cc-120a1d23123e None None] Provisioning complete for port 7de3f084-1e14-4e02-b1d3-b78821d0bda7 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:27:17.741862 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-95a42ffd-5c42-4c44-88cc-120a1d23123e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:17.794391 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-95a42ffd-5c42-4c44-88cc-120a1d23123e None None] Port 7de3f084-1e14-4e02-b1d3-b78821d0bda7 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:27:17.828892 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'name': 'tempest-TestNetworkAdvancedServerOps-router-220773520', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55'}], 'enable_snat': True}, 'gw_port_id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:15Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:51:dc:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4272, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '7de3f084-1e14-4e02-b1d3-b78821d0bda7', 'name': '', 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:05:e9:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'device_owner': 'network:router_interface', 'standard_attr_id': 4275, 'fixed_ips': [{'subnet_id': 'fd45a75f-0057-4c2b-974a-168e46ade458', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:27:15Z', 'updated_at': '2021-12-09T22:27:16Z', 'revision_number': 2, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': 'fd45a75f-0057-4c2b-974a-168e46ade458', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:27:17.862929 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] Checking router: e55e0a83-70fc-4320-8788-01e385b7a908 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:27:17.863188 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] Updating router e55e0a83-70fc-4320-8788-01e385b7a908 port 7de3f084-1e14-4e02-b1d3-b78821d0bda7 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:27:17.894837 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:18.180944 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:18.188855 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:18.239826 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13fb859f-741c-4631-8ab2-2ebf008e40c0 None None] Pushing event updated for resources: {'Port': ['ID=7de3f084-1e14-4e02-b1d3-b78821d0bda7,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:18.292552 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] Attempting to bind port 7de3f084-1e14-4e02-b1d3-b78821d0bda7 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:27:18.292916 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] Attempting to bind port 7de3f084-1e14-4e02-b1d3-b78821d0bda7 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '3f17fd79-d495-4e9d-aa70-314151576549', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:27:18.293281 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] Attempting to bind port 7de3f084-1e14-4e02-b1d3-b78821d0bda7 on network d467eac6-2065-4a25-96d1-9c231e3db6c2 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:27:18.299099 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 27, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:27:18.299486 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] Checking segment: {'id': '3f17fd79-d495-4e9d-aa70-314151576549', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:27:18.299898 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:18.300289 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] Bound using segment: {'id': '3f17fd79-d495-4e9d-aa70-314151576549', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:27:18.300755 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] Bound port: 7de3f084-1e14-4e02-b1d3-b78821d0bda7, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3f17fd79-d495-4e9d-aa70-314151576549', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:27:18.301504 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:18.370928 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] For port 7de3f084-1e14-4e02-b1d3-b78821d0bda7, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:27:18.374133 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] For port 7de3f084-1e14-4e02-b1d3-b78821d0bda7, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7de3f084-1e14-4e02-b1d3-b78821d0bda7,segment=NetworkSegment(3f17fd79-d495-4e9d-aa70-314151576549),segment_id=3f17fd79-d495-4e9d-aa70-314151576549)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:27:18.379756 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:18.404218 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-716addf7-b819-4291-b4b9-48afa01b5fac tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:18.405849 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-716addf7-b819-4291-b4b9-48afa01b5fac tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.31 "GET /v2.0/networks?id=d467eac6-2065-4a25-96d1-9c231e3db6c2 HTTP/1.1" status: 200 len: 797 time: 0.1304169 Dec 09 22:27:18.446832 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] Routers {'e55e0a83-70fc-4320-8788-01e385b7a908'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:27:18.447493 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:27:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['e55e0a83-70fc-4320-8788-01e385b7a908'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:27:18.482745 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13fb859f-741c-4631-8ab2-2ebf008e40c0 None None] Pushing event updated for resources: {'Port': ['ID=7de3f084-1e14-4e02-b1d3-b78821d0bda7,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:18.552583 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-de140542-8537-4978-a157-2208316ff681 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=e21dff80515b44aa9f01117603c6de0d HTTP/1.1" status: 200 len: 379 time: 0.1352897 Dec 09 22:27:18.555217 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 68ec7864-df70-45a3-a181-d400b58f4261 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:27:18.574685 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-228af543-2f4e-4d1b-bde1-7d49b1c99d5e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'port': {'device_id': 'f1bd2f03-3e49-4b9f-a1de-41c200addc77', 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2', 'admin_state_up': True, 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'security_groups': ['d710d5b3-ff7a-4ab7-931a-cfb5ca198131']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:27:18.595508 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4491078f-5661-4e43-b4f2-4a2664d0879d req-c0ef710a-e7ea-46e4-a30c-226a9cfd0d92 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 210 time: 0.0345826 Dec 09 22:27:18.615134 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] Set router e55e0a83-70fc-4320-8788-01e385b7a908 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:27:18.618644 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1c7a666b-7fcc-4278-b359-0cae919d57f5 None None] Provisioning complete for port 7de3f084-1e14-4e02-b1d3-b78821d0bda7 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:27:18.619013 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1c7a666b-7fcc-4278-b359-0cae919d57f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:18.706917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-228af543-2f4e-4d1b-bde1-7d49b1c99d5e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Made reservation on behalf of e21dff80515b44aa9f01117603c6de0d for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:27:18.710794 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-228af543-2f4e-4d1b-bde1-7d49b1c99d5e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:18.755305 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 68ec7864-df70-45a3-a181-d400b58f4261 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:27:18.755589 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:18.848242 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-228af543-2f4e-4d1b-bde1-7d49b1c99d5e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Allocated IP 172.20.0.6 (d467eac6-2065-4a25-96d1-9c231e3db6c2/fd45a75f-0057-4c2b-974a-168e46ade458/e928ce55-e398-42cb-9749-85a43037cd08) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:27:18.858642 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1c7a666b-7fcc-4278-b359-0cae919d57f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:18.960402 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-1c7a666b-7fcc-4278-b359-0cae919d57f5 None None] For port 7de3f084-1e14-4e02-b1d3-b78821d0bda7, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7de3f084-1e14-4e02-b1d3-b78821d0bda7,segment=NetworkSegment(3f17fd79-d495-4e9d-aa70-314151576549),segment_id=3f17fd79-d495-4e9d-aa70-314151576549)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:27:18.969586 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1c7a666b-7fcc-4278-b359-0cae919d57f5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:19.000025 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-228af543-2f4e-4d1b-bde1-7d49b1c99d5e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:19.023110 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c7a666b-7fcc-4278-b359-0cae919d57f5 None None] Pushing event updated for resources: {'Port': ['ID=7de3f084-1e14-4e02-b1d3-b78821d0bda7,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:19.028012 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'name': 'tempest-TestNetworkAdvancedServerOps-router-220773520', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55'}], 'enable_snat': True}, 'gw_port_id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:15Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:51:dc:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4272, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '7de3f084-1e14-4e02-b1d3-b78821d0bda7', 'name': '', 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:05:e9:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'device_owner': 'network:router_interface', 'standard_attr_id': 4275, 'fixed_ips': [{'subnet_id': 'fd45a75f-0057-4c2b-974a-168e46ade458', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:27:15Z', 'updated_at': '2021-12-09T22:27:18Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': 'fd45a75f-0057-4c2b-974a-168e46ade458', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:27:19.035868 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-228af543-2f4e-4d1b-bde1-7d49b1c99d5e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:19.056789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7d6252bb-2ca7-4db6-b731-b348540b1257 None None] The sync data for ids ['e55e0a83-70fc-4320-8788-01e385b7a908'] in n-d-713301-27 is: [{'id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'name': 'tempest-TestNetworkAdvancedServerOps-router-220773520', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55'}], 'enable_snat': True}, 'gw_port_id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:15Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:51:dc:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4272, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '7de3f084-1e14-4e02-b1d3-b78821d0bda7', 'name': '', 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:05:e9:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'device_owner': 'network:router_interface', 'standard_attr_id': 4275, 'fixed_ips': [{'subnet_id': 'fd45a75f-0057-4c2b-974a-168e46ade458', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:27:15Z', 'updated_at': '2021-12-09T22:27:18Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': 'fd45a75f-0057-4c2b-974a-168e46ade458', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:27:19.080781 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-228af543-2f4e-4d1b-bde1-7d49b1c99d5e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network d467eac6-2065-4a25-96d1-9c231e3db6c2 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:27:19.084008 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-228af543-2f4e-4d1b-bde1-7d49b1c99d5e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:27:19.089820 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-228af543-2f4e-4d1b-bde1-7d49b1c99d5e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:27:19.101377 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-907ea088-8dc4-4e87-be04-42e17a923ea7 None None] Provisioning complete for port 7de3f084-1e14-4e02-b1d3-b78821d0bda7 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:27:19.101830 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-907ea088-8dc4-4e87-be04-42e17a923ea7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:19.147201 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-228af543-2f4e-4d1b-bde1-7d49b1c99d5e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=e928ce55-e398-42cb-9749-85a43037cd08,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:19.167896 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-228af543-2f4e-4d1b-bde1-7d49b1c99d5e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:19.168516 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-228af543-2f4e-4d1b-bde1-7d49b1c99d5e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:19.189141 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-228af543-2f4e-4d1b-bde1-7d49b1c99d5e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6239715 Dec 09 22:27:19.202246 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8c431d20-d742-4078-9f17-3da2e438c9da service neutron] Request body: {'port': {'device_id': 'f1bd2f03-3e49-4b9f-a1de-41c200addc77', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:27:19.265515 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8c431d20-d742-4078-9f17-3da2e438c9da service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:19.449364 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-fff13516-8810-4337-a65d-ea28556f072a None None] Provisioning complete for port e928ce55-e398-42cb-9749-85a43037cd08 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:27:19.450454 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fff13516-8810-4337-a65d-ea28556f072a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:19.491018 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-fff13516-8810-4337-a65d-ea28556f072a None None] Port e928ce55-e398-42cb-9749-85a43037cd08 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:27:19.540931 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8c431d20-d742-4078-9f17-3da2e438c9da service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e928ce55-e398-42cb-9749-85a43037cd08 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:27:19.549268 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8c431d20-d742-4078-9f17-3da2e438c9da service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:19.562080 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8c431d20-d742-4078-9f17-3da2e438c9da service neutron] Transition to ACTIVE for port object e928ce55-e398-42cb-9749-85a43037cd08 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:27:19.568178 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8c431d20-d742-4078-9f17-3da2e438c9da service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:19.650486 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c431d20-d742-4078-9f17-3da2e438c9da service neutron] Pushing event updated for resources: {'Port': ['ID=e928ce55-e398-42cb-9749-85a43037cd08,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:19.710398 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8c431d20-d742-4078-9f17-3da2e438c9da service neutron] Attempting to bind port e928ce55-e398-42cb-9749-85a43037cd08 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:27:19.710854 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8c431d20-d742-4078-9f17-3da2e438c9da service neutron] Attempting to bind port e928ce55-e398-42cb-9749-85a43037cd08 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '3f17fd79-d495-4e9d-aa70-314151576549', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:27:19.712015 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8c431d20-d742-4078-9f17-3da2e438c9da service neutron] Attempting to bind port e928ce55-e398-42cb-9749-85a43037cd08 on network d467eac6-2065-4a25-96d1-9c231e3db6c2 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:27:19.717929 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8c431d20-d742-4078-9f17-3da2e438c9da service neutron] Port e928ce55-e398-42cb-9749-85a43037cd08 on network d467eac6-2065-4a25-96d1-9c231e3db6c2 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:27:19.718280 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8c431d20-d742-4078-9f17-3da2e438c9da service neutron] Attempting to bind port e928ce55-e398-42cb-9749-85a43037cd08 on network d467eac6-2065-4a25-96d1-9c231e3db6c2 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:27:19.725467 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8c431d20-d742-4078-9f17-3da2e438c9da service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 26, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:27:19.726851 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8c431d20-d742-4078-9f17-3da2e438c9da service neutron] Checking segment: {'id': '3f17fd79-d495-4e9d-aa70-314151576549', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:27:19.727417 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8c431d20-d742-4078-9f17-3da2e438c9da service neutron] Bound using segment: {'id': '3f17fd79-d495-4e9d-aa70-314151576549', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:27:19.728543 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8c431d20-d742-4078-9f17-3da2e438c9da service neutron] Bound port: e928ce55-e398-42cb-9749-85a43037cd08, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3f17fd79-d495-4e9d-aa70-314151576549', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 109, 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:27:19.728970 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8c431d20-d742-4078-9f17-3da2e438c9da service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:19.735811 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f42426-f374-42c5-9403-c3717247717e req-eeaffe95-c146-4444-be2c-f77e79e29eaa tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:19.739965 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5f42426-f374-42c5-9403-c3717247717e req-eeaffe95-c146-4444-be2c-f77e79e29eaa tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 943 time: 0.0593426 Dec 09 22:27:19.804808 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5f42426-f374-42c5-9403-c3717247717e req-82640f17-74fa-47e6-96e9-7956edb6e17a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0582440 Dec 09 22:27:19.811041 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8c431d20-d742-4078-9f17-3da2e438c9da service neutron] For port e928ce55-e398-42cb-9749-85a43037cd08, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:27:19.815806 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8c431d20-d742-4078-9f17-3da2e438c9da service neutron] For port e928ce55-e398-42cb-9749-85a43037cd08, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e928ce55-e398-42cb-9749-85a43037cd08,segment=NetworkSegment(3f17fd79-d495-4e9d-aa70-314151576549),segment_id=3f17fd79-d495-4e9d-aa70-314151576549)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:27:19.829625 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8c431d20-d742-4078-9f17-3da2e438c9da service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:19.868028 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8c431d20-d742-4078-9f17-3da2e438c9da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:19.868767 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8c431d20-d742-4078-9f17-3da2e438c9da service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:19.870167 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8c431d20-d742-4078-9f17-3da2e438c9da service neutron] 10.222.0.31 "PUT /v2.0/ports/e928ce55-e398-42cb-9749-85a43037cd08 HTTP/1.1" status: 200 len: 1092 time: 0.6723230 Dec 09 22:27:19.870606 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f1bd2f03-3e49-4b9f-a1de-41c200addc77', 'tag': 'e928ce55-e398-42cb-9749-85a43037cd08'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:27:19.872919 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-731c0972-ffb0-432d-9ec9-3e2543ad5606" -d '{"events": [{"name": "network-changed", "server_uuid": "f1bd2f03-3e49-4b9f-a1de-41c200addc77", "tag": "e928ce55-e398-42cb-9749-85a43037cd08"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:27:19.903687 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c431d20-d742-4078-9f17-3da2e438c9da service neutron] Pushing event updated for resources: {'Port': ['ID=e928ce55-e398-42cb-9749-85a43037cd08,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:19.993444 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-7b8d94b1-3d68-4a9e-8dd9-eb8c7f6357f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:19.995157 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-7b8d94b1-3d68-4a9e-8dd9-eb8c7f6357f4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 1095 time: 0.0494308 Dec 09 22:27:19.999554 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:27:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-653d1bbc-c6b0-4a41-a582-ed233937e2ca x-openstack-request-id: req-653d1bbc-c6b0-4a41-a582-ed233937e2ca {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:27:19.999954 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f1bd2f03-3e49-4b9f-a1de-41c200addc77", "tag": "e928ce55-e398-42cb-9749-85a43037cd08", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:27:20.000400 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-653d1bbc-c6b0-4a41-a582-ed233937e2ca {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:27:20.001038 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f1bd2f03-3e49-4b9f-a1de-41c200addc77', 'tag': 'e928ce55-e398-42cb-9749-85a43037cd08', 'status': 'completed', 'code': 200} Dec 09 22:27:20.040145 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-f00e0e68-b33f-427e-bd37-611c2937d4de service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e928ce55-e398-42cb-9749-85a43037cd08 HTTP/1.1" status: 200 len: 217 time: 0.0363717 Dec 09 22:27:20.098335 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-d764aa45-8ebb-4545-9c15-de8bd79703bf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:20.100103 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-d764aa45-8ebb-4545-9c15-de8bd79703bf service neutron] 10.222.0.31 "GET /v2.0/subnets?id=fd45a75f-0057-4c2b-974a-168e46ade458 HTTP/1.1" status: 200 len: 835 time: 0.0534904 Dec 09 22:27:20.147532 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8b544344-d22f-4b62-a35f-2d01d3feb604 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:20.149247 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-8b544344-d22f-4b62-a35f-2d01d3feb604 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d467eac6-2065-4a25-96d1-9c231e3db6c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0419221 Dec 09 22:27:20.243945 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-f1c29304-1891-42f4-854d-45da8242454a service neutron] 10.222.0.31 "GET /v2.0/networks/d467eac6-2065-4a25-96d1-9c231e3db6c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0873814 Dec 09 22:27:20.340535 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-70c8817d-8397-4540-97ab-79a78e8bffd5 req-1252eada-161d-43b8-8631-cf58d91005a3 service neutron] 10.222.0.31 "GET /v2.0/networks/d467eac6-2065-4a25-96d1-9c231e3db6c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0888894 Dec 09 22:27:20.447836 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-731c0972-ffb0-432d-9ec9-3e2543ad5606 req-8477a939-81ac-4616-9aac-ec60a4a42ef4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:20.449446 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-731c0972-ffb0-432d-9ec9-3e2543ad5606 req-8477a939-81ac-4616-9aac-ec60a4a42ef4 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 1095 time: 0.0477850 Dec 09 22:27:20.480030 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7de3f084-1e14-4e02-b1d3-b78821d0bda7 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:27:20.546597 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-731c0972-ffb0-432d-9ec9-3e2543ad5606 req-5f31f2b0-cd3f-40cc-a02a-2113a4528c30 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:20.548676 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-731c0972-ffb0-432d-9ec9-3e2543ad5606 req-5f31f2b0-cd3f-40cc-a02a-2113a4528c30 service neutron] 10.222.0.31 "GET /v2.0/networks?id=d467eac6-2065-4a25-96d1-9c231e3db6c2 HTTP/1.1" status: 200 len: 898 time: 0.0912390 Dec 09 22:27:20.597333 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-731c0972-ffb0-432d-9ec9-3e2543ad5606 req-7a364422-598b-432d-966e-b82ef6b9adf5 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e928ce55-e398-42cb-9749-85a43037cd08 HTTP/1.1" status: 200 len: 217 time: 0.0413210 Dec 09 22:27:20.655855 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-731c0972-ffb0-432d-9ec9-3e2543ad5606 req-2a4667ee-3a10-4cac-9c70-1c37e7c6a851 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:20.657719 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-731c0972-ffb0-432d-9ec9-3e2543ad5606 req-2a4667ee-3a10-4cac-9c70-1c37e7c6a851 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=fd45a75f-0057-4c2b-974a-168e46ade458 HTTP/1.1" status: 200 len: 835 time: 0.0519459 Dec 09 22:27:20.699787 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 7de3f084-1e14-4e02-b1d3-b78821d0bda7 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:27:20.700173 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:20.709211 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-731c0972-ffb0-432d-9ec9-3e2543ad5606 req-09872fe1-e18d-4f7f-b181-45b3d4ca35b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:20.710866 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-731c0972-ffb0-432d-9ec9-3e2543ad5606 req-09872fe1-e18d-4f7f-b181-45b3d4ca35b7 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d467eac6-2065-4a25-96d1-9c231e3db6c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0461545 Dec 09 22:27:20.806052 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-731c0972-ffb0-432d-9ec9-3e2543ad5606 req-99bc3e84-e0cd-437e-98f9-465efc145e6f service neutron] 10.222.0.31 "GET /v2.0/networks/d467eac6-2065-4a25-96d1-9c231e3db6c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0868371 Dec 09 22:27:20.910332 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-731c0972-ffb0-432d-9ec9-3e2543ad5606 req-d246296d-cc0a-4dc3-a1a3-2305bb7b3c9a service neutron] 10.222.0.31 "GET /v2.0/networks/d467eac6-2065-4a25-96d1-9c231e3db6c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0958004 Dec 09 22:27:20.929191 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e73e8b57-8519-4b60-b2d0-564cd60f44aa req-d353ee63-8e8d-4a9e-ba2c-cb31c62b3f44 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:20.930799 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e73e8b57-8519-4b60-b2d0-564cd60f44aa req-d353ee63-8e8d-4a9e-ba2c-cb31c62b3f44 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 943 time: 0.0532262 Dec 09 22:27:20.987190 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e73e8b57-8519-4b60-b2d0-564cd60f44aa req-bbe45890-2dda-4a57-8519-4920f88381f1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0502837 Dec 09 22:27:22.127456 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63beafd9-15dc-4f62-9b05-8756480e947a req-d5fa89e6-51d4-43c0-993d-416b1ae6a1da tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:22.128951 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63beafd9-15dc-4f62-9b05-8756480e947a req-d5fa89e6-51d4-43c0-993d-416b1ae6a1da tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 943 time: 0.0582983 Dec 09 22:27:22.180906 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-63beafd9-15dc-4f62-9b05-8756480e947a req-9f1c0af4-43df-4d3c-8c09-093b69a6a2ab tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458400 Dec 09 22:27:23.319963 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a33a2d8-e8a9-4d71-95b0-3edc373b7f75 req-a5ae70ee-8c62-4704-ace1-1e039e5bbf4f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:23.321451 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4a33a2d8-e8a9-4d71-95b0-3edc373b7f75 req-a5ae70ee-8c62-4704-ace1-1e039e5bbf4f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 943 time: 0.0562675 Dec 09 22:27:23.375553 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4a33a2d8-e8a9-4d71-95b0-3edc373b7f75 req-356aa797-2791-434f-a1aa-5845f22998df tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445137 Dec 09 22:27:23.511720 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e928ce55-e398-42cb-9749-85a43037cd08 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:27:23.621268 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port e928ce55-e398-42cb-9749-85a43037cd08, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e928ce55-e398-42cb-9749-85a43037cd08,segment=NetworkSegment(3f17fd79-d495-4e9d-aa70-314151576549),segment_id=3f17fd79-d495-4e9d-aa70-314151576549)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:27:23.632987 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'e928ce55-e398-42cb-9749-85a43037cd08', 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2', 'port_id': 'e928ce55-e398-42cb-9749-85a43037cd08', 'mac_address': 'fa:16:3e:61:50:fa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 109, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fd45a75f-0057-4c2b-974a-168e46ade458', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:27:23.670567 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:23.683760 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e928ce55-e398-42cb-9749-85a43037cd08 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:27:23.703197 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port e928ce55-e398-42cb-9749-85a43037cd08, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e928ce55-e398-42cb-9749-85a43037cd08,segment=NetworkSegment(3f17fd79-d495-4e9d-aa70-314151576549),segment_id=3f17fd79-d495-4e9d-aa70-314151576549)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:27:23.709434 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:23.759367 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=e928ce55-e398-42cb-9749-85a43037cd08,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:23.910902 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['e928ce55-e398-42cb-9749-85a43037cd08'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:27:24.504668 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf40555e-a28e-4a8c-a0d9-16fc302cee46 req-25117604-5cb2-470f-b5fb-d0005e287bdf tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:24.506127 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf40555e-a28e-4a8c-a0d9-16fc302cee46 req-25117604-5cb2-470f-b5fb-d0005e287bdf tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 944 time: 0.0538683 Dec 09 22:27:24.559468 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf40555e-a28e-4a8c-a0d9-16fc302cee46 req-7efd20d6-e3cf-499b-b9b2-8361b73491f2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441973 Dec 09 22:27:25.542300 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e928ce55-e398-42cb-9749-85a43037cd08 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:27:25.597690 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port e928ce55-e398-42cb-9749-85a43037cd08 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:27:25.601857 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port e928ce55-e398-42cb-9749-85a43037cd08 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:27:25.602463 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:25.693931 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:25.694274 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a24dae6-e8fd-499f-bbc7-cdbdeb345ba6 req-436251c9-72c3-40a9-b147-67151687bd6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:25.695889 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a24dae6-e8fd-499f-bbc7-cdbdeb345ba6 req-436251c9-72c3-40a9-b147-67151687bd6a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 944 time: 0.0551472 Dec 09 22:27:25.716852 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f1bd2f03-3e49-4b9f-a1de-41c200addc77', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e928ce55-e398-42cb-9749-85a43037cd08'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:27:25.719190 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2096df07-7fb6-49b6-be2a-ac8643bf5eb5" -d '{"events": [{"server_uuid": "f1bd2f03-3e49-4b9f-a1de-41c200addc77", "name": "network-vif-plugged", "status": "completed", "tag": "e928ce55-e398-42cb-9749-85a43037cd08"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:27:25.731938 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port e928ce55-e398-42cb-9749-85a43037cd08, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e928ce55-e398-42cb-9749-85a43037cd08,segment=NetworkSegment(3f17fd79-d495-4e9d-aa70-314151576549),segment_id=3f17fd79-d495-4e9d-aa70-314151576549)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:27:25.736635 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:25.748296 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6a24dae6-e8fd-499f-bbc7-cdbdeb345ba6 req-ec4236d0-b270-4532-ae2a-f5e736f46bbd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0461409 Dec 09 22:27:25.783906 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=e928ce55-e398-42cb-9749-85a43037cd08,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:25.794331 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:27:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9b5cf2e9-d2e1-4a85-ae77-847e4bbe47b2 x-openstack-request-id: req-9b5cf2e9-d2e1-4a85-ae77-847e4bbe47b2 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:27:25.794679 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f1bd2f03-3e49-4b9f-a1de-41c200addc77", "name": "network-vif-plugged", "status": "completed", "tag": "e928ce55-e398-42cb-9749-85a43037cd08", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:27:25.794963 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-9b5cf2e9-d2e1-4a85-ae77-847e4bbe47b2 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:27:25.795337 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f1bd2f03-3e49-4b9f-a1de-41c200addc77', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e928ce55-e398-42cb-9749-85a43037cd08', 'code': 200} Dec 09 22:27:25.893995 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8dbae07-07d9-4c50-8157-36ef24c6840e req-edfdc7f7-5e9c-46ff-b7d1-5ba616953182 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:25.895559 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f8dbae07-07d9-4c50-8157-36ef24c6840e req-edfdc7f7-5e9c-46ff-b7d1-5ba616953182 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 1097 time: 0.0414658 Dec 09 22:27:25.941680 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f8dbae07-07d9-4c50-8157-36ef24c6840e req-3368e26e-2c5e-414f-b925-73abb295e132 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0391703 Dec 09 22:27:26.885896 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc5348fa-5ef0-4216-9672-3af97cd0a0fb req-36608118-0d24-4a2c-a828-d378b0593435 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:26.887533 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fc5348fa-5ef0-4216-9672-3af97cd0a0fb req-36608118-0d24-4a2c-a828-d378b0593435 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 945 time: 0.0592611 Dec 09 22:27:26.939253 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fc5348fa-5ef0-4216-9672-3af97cd0a0fb req-1dee787b-d2ae-42a7-8cf0-9771a9693e36 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453472 Dec 09 22:27:27.742520 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:27.847708 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:28.065241 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-168aa702-f6a4-43ed-8311-d93cdecc9228 req-6d52f8b3-f89a-4613-813e-9d830162aaf9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:28.066614 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-168aa702-f6a4-43ed-8311-d93cdecc9228 req-6d52f8b3-f89a-4613-813e-9d830162aaf9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 945 time: 0.0528245 Dec 09 22:27:28.125273 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-168aa702-f6a4-43ed-8311-d93cdecc9228 req-a1c86c0a-6683-4919-bde4-f3a60250c5d6 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0494089 Dec 09 22:27:28.255238 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd4a0e6b-d986-4886-a835-ae21ee5be98e req-4273bc2f-93fb-4d57-bd95-905388f05232 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:28.256724 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd4a0e6b-d986-4886-a835-ae21ee5be98e req-4273bc2f-93fb-4d57-bd95-905388f05232 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 945 time: 0.0513859 Dec 09 22:27:28.307506 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bd4a0e6b-d986-4886-a835-ae21ee5be98e req-6f4eebb2-5f6a-4cdd-97a2-0ae97c821975 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446873 Dec 09 22:27:28.331615 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34592) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:27:28.376136 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ecfb922d-d730-4ee3-9983-9229425936cb tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:28.377728 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-ecfb922d-d730-4ee3-9983-9229425936cb tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 1092 time: 0.0450571 Dec 09 22:27:28.380632 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34594) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:27:28.384838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-020edfa3-aadf-490c-bb4f-8b8afb009f3d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': 'e928ce55-e398-42cb-9749-85a43037cd08', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ip_address': '172.20.0.6'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:27:28.410389 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-020edfa3-aadf-490c-bb4f-8b8afb009f3d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for floatingip, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:28.510393 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-020edfa3-aadf-490c-bb4f-8b8afb009f3d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:28.619090 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-020edfa3-aadf-490c-bb4f-8b8afb009f3d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Allocated IP 172.25.3.162 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/0a22f18c-061c-44f7-8880-3b64d93720da) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:27:28.719246 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-020edfa3-aadf-490c-bb4f-8b8afb009f3d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:28.755661 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-020edfa3-aadf-490c-bb4f-8b8afb009f3d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:28.798051 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-020edfa3-aadf-490c-bb4f-8b8afb009f3d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:27:28.803530 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-020edfa3-aadf-490c-bb4f-8b8afb009f3d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:27:28.807838 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-020edfa3-aadf-490c-bb4f-8b8afb009f3d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:27:28.810807 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-020edfa3-aadf-490c-bb4f-8b8afb009f3d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=0a22f18c-061c-44f7-8880-3b64d93720da,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:29.171731 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-020edfa3-aadf-490c-bb4f-8b8afb009f3d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:29.243459 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-020edfa3-aadf-490c-bb4f-8b8afb009f3d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:29.760681 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-020edfa3-aadf-490c-bb4f-8b8afb009f3d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:29.767066 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-020edfa3-aadf-490c-bb4f-8b8afb009f3d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:29.835349 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-020edfa3-aadf-490c-bb4f-8b8afb009f3d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=0a22f18c-061c-44f7-8880-3b64d93720da,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:27:29.849739 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-020edfa3-aadf-490c-bb4f-8b8afb009f3d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:29.959944 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-020edfa3-aadf-490c-bb4f-8b8afb009f3d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Floating IP f6f9b629-6c48-4df9-ac57-95da4e96d677 associated. External IP: 172.25.3.162, port: e928ce55-e398-42cb-9749-85a43037cd08. Dec 09 22:27:30.197031 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-020edfa3-aadf-490c-bb4f-8b8afb009f3d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router e55e0a83-70fc-4320-8788-01e385b7a908 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:27:30.309476 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-020edfa3-aadf-490c-bb4f-8b8afb009f3d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:27:30.320456 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-85141922-0d4b-408f-a68e-66b72baf308b None None] Sync routers for ids ['e55e0a83-70fc-4320-8788-01e385b7a908'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:27:30.329823 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-020edfa3-aadf-490c-bb4f-8b8afb009f3d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:30.332188 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85141922-0d4b-408f-a68e-66b72baf308b None None] Routers {'e55e0a83-70fc-4320-8788-01e385b7a908'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:27:30.332857 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-85141922-0d4b-408f-a68e-66b72baf308b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:27:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['e55e0a83-70fc-4320-8788-01e385b7a908'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:27:30.359708 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-020edfa3-aadf-490c-bb4f-8b8afb009f3d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.9756155 Dec 09 22:27:30.359708 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f1bd2f03-3e49-4b9f-a1de-41c200addc77', 'tag': 'e928ce55-e398-42cb-9749-85a43037cd08'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:27:30.360153 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-02fc8cb1-89f8-4e24-8457-86ec0921845e" -d '{"events": [{"name": "network-changed", "server_uuid": "f1bd2f03-3e49-4b9f-a1de-41c200addc77", "tag": "e928ce55-e398-42cb-9749-85a43037cd08"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:27:30.438785 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-85141922-0d4b-408f-a68e-66b72baf308b None None] Set router e55e0a83-70fc-4320-8788-01e385b7a908 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:27:30.457170 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7e66301-6ac9-457b-aef1-0a30c96cecd4 req-9bdb978c-5664-4cdd-bd7a-df807db1d7db tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:30.458638 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7e66301-6ac9-457b-aef1-0a30c96cecd4 req-9bdb978c-5664-4cdd-bd7a-df807db1d7db tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 945 time: 0.0509143 Dec 09 22:27:30.508675 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7e66301-6ac9-457b-aef1-0a30c96cecd4 req-a53b2a50-0448-4008-8d95-612bf482d65d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437186 Dec 09 22:27:30.531175 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34600) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:27:30.557822 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:27:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-efb1a52b-c2e7-447e-878f-99da99517a79 x-openstack-request-id: req-efb1a52b-c2e7-447e-878f-99da99517a79 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:27:30.558375 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f1bd2f03-3e49-4b9f-a1de-41c200addc77", "tag": "e928ce55-e398-42cb-9749-85a43037cd08", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:27:30.558694 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-efb1a52b-c2e7-447e-878f-99da99517a79 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:27:30.559209 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f1bd2f03-3e49-4b9f-a1de-41c200addc77', 'tag': 'e928ce55-e398-42cb-9749-85a43037cd08', 'status': 'completed', 'code': 200} Dec 09 22:27:30.600319 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-aad70b72-5b69-4720-be49-ef7b74cf29c6 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/floatingips/f6f9b629-6c48-4df9-ac57-95da4e96d677 HTTP/1.1" status: 200 len: 991 time: 0.0678356 Dec 09 22:27:30.625041 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02fc8cb1-89f8-4e24-8457-86ec0921845e req-21d2d073-3915-4f72-90f1-500f8930d0e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:30.626676 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-02fc8cb1-89f8-4e24-8457-86ec0921845e req-21d2d073-3915-4f72-90f1-500f8930d0e6 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 1097 time: 0.0412886 Dec 09 22:27:30.664165 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-85141922-0d4b-408f-a68e-66b72baf308b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'name': 'tempest-TestNetworkAdvancedServerOps-router-220773520', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55'}], 'enable_snat': True}, 'gw_port_id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:15Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:51:dc:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4272, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'f6f9b629-6c48-4df9-ac57-95da4e96d677', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'floating_ip_address': '172.25.3.162', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'port_id': 'e928ce55-e398-42cb-9749-85a43037cd08', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4278, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2', 'mac_address': 'fa:16:3e:61:50:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1bd2f03-3e49-4b9f-a1de-41c200addc77', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:27:29Z', 'updated_at': '2021-12-09T22:27:29Z', 'revision_number': 0, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7de3f084-1e14-4e02-b1d3-b78821d0bda7', 'name': '', 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:05:e9:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'device_owner': 'network:router_interface', 'standard_attr_id': 4275, 'fixed_ips': [{'subnet_id': 'fd45a75f-0057-4c2b-974a-168e46ade458', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:27:15Z', 'updated_at': '2021-12-09T22:27:18Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': 'fd45a75f-0057-4c2b-974a-168e46ade458', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:27:30.694130 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-85141922-0d4b-408f-a68e-66b72baf308b None None] Checking router: e55e0a83-70fc-4320-8788-01e385b7a908 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:27:30.702779 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85141922-0d4b-408f-a68e-66b72baf308b None None] Routers {'e55e0a83-70fc-4320-8788-01e385b7a908'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:27:30.703360 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-85141922-0d4b-408f-a68e-66b72baf308b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:27:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['e55e0a83-70fc-4320-8788-01e385b7a908'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:27:30.721353 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02fc8cb1-89f8-4e24-8457-86ec0921845e req-c06db4c1-ea20-4432-822c-ad22588293ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:30.722768 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-02fc8cb1-89f8-4e24-8457-86ec0921845e req-c06db4c1-ea20-4432-822c-ad22588293ef service neutron] 10.222.0.31 "GET /v2.0/networks?id=d467eac6-2065-4a25-96d1-9c231e3db6c2 HTTP/1.1" status: 200 len: 898 time: 0.0896337 Dec 09 22:27:30.789320 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-02fc8cb1-89f8-4e24-8457-86ec0921845e req-6d6aa33b-de96-4e6d-bbe4-f3bf6431f728 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e928ce55-e398-42cb-9749-85a43037cd08 HTTP/1.1" status: 200 len: 999 time: 0.0594463 Dec 09 22:27:30.845219 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02fc8cb1-89f8-4e24-8457-86ec0921845e req-3845f569-4ddd-425c-a22a-209289e3c929 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:30.846749 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-02fc8cb1-89f8-4e24-8457-86ec0921845e req-3845f569-4ddd-425c-a22a-209289e3c929 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=fd45a75f-0057-4c2b-974a-168e46ade458 HTTP/1.1" status: 200 len: 835 time: 0.0508687 Dec 09 22:27:30.896387 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02fc8cb1-89f8-4e24-8457-86ec0921845e req-38902440-1955-42a2-94b4-dbcf3cd29866 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:27:30.897929 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-02fc8cb1-89f8-4e24-8457-86ec0921845e req-38902440-1955-42a2-94b4-dbcf3cd29866 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d467eac6-2065-4a25-96d1-9c231e3db6c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0441785 Dec 09 22:27:30.908585 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-85141922-0d4b-408f-a68e-66b72baf308b None None] Set router e55e0a83-70fc-4320-8788-01e385b7a908 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:27:30.998126 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-02fc8cb1-89f8-4e24-8457-86ec0921845e req-ff310ff2-e834-4dbe-a728-18471e26b3ef service neutron] 10.222.0.31 "GET /v2.0/networks/d467eac6-2065-4a25-96d1-9c231e3db6c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0929172 Dec 09 22:27:31.091031 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-02fc8cb1-89f8-4e24-8457-86ec0921845e req-e597b209-8291-4375-b9d5-5b05a0fea777 service neutron] 10.222.0.31 "GET /v2.0/networks/d467eac6-2065-4a25-96d1-9c231e3db6c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857592 Dec 09 22:27:31.145968 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-85141922-0d4b-408f-a68e-66b72baf308b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'name': 'tempest-TestNetworkAdvancedServerOps-router-220773520', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55'}], 'enable_snat': True}, 'gw_port_id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:15Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:51:dc:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4272, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'f6f9b629-6c48-4df9-ac57-95da4e96d677', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'floating_ip_address': '172.25.3.162', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'port_id': 'e928ce55-e398-42cb-9749-85a43037cd08', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4278, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2', 'mac_address': 'fa:16:3e:61:50:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1bd2f03-3e49-4b9f-a1de-41c200addc77', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:27:29Z', 'updated_at': '2021-12-09T22:27:29Z', 'revision_number': 0, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7de3f084-1e14-4e02-b1d3-b78821d0bda7', 'name': '', 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:05:e9:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'device_owner': 'network:router_interface', 'standard_attr_id': 4275, 'fixed_ips': [{'subnet_id': 'fd45a75f-0057-4c2b-974a-168e46ade458', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:27:15Z', 'updated_at': '2021-12-09T22:27:18Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': 'fd45a75f-0057-4c2b-974a-168e46ade458', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:27:31.175096 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-85141922-0d4b-408f-a68e-66b72baf308b None None] The sync data for ids ['e55e0a83-70fc-4320-8788-01e385b7a908'] in n-d-713301-27 is: [{'id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'name': 'tempest-TestNetworkAdvancedServerOps-router-220773520', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55'}], 'enable_snat': True}, 'gw_port_id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:15Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:51:dc:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4272, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'f6f9b629-6c48-4df9-ac57-95da4e96d677', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'floating_ip_address': '172.25.3.162', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'port_id': 'e928ce55-e398-42cb-9749-85a43037cd08', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 4278, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2', 'mac_address': 'fa:16:3e:61:50:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1bd2f03-3e49-4b9f-a1de-41c200addc77', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:27:29Z', 'updated_at': '2021-12-09T22:27:29Z', 'revision_number': 0, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7de3f084-1e14-4e02-b1d3-b78821d0bda7', 'name': '', 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:05:e9:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'device_owner': 'network:router_interface', 'standard_attr_id': 4275, 'fixed_ips': [{'subnet_id': 'fd45a75f-0057-4c2b-974a-168e46ade458', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:27:15Z', 'updated_at': '2021-12-09T22:27:18Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': 'fd45a75f-0057-4c2b-974a-168e46ade458', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:27:31.383569 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1e3aa441-dfe0-49d1-bcb7-236857ee6d25 None None] New status for floating IP f6f9b629-6c48-4df9-ac57-95da4e96d677: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:27:31.603007 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34602) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:27:31.663237 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-845f0448-ef39-4b21-8d2f-77b8df0fc67f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/floatingips/f6f9b629-6c48-4df9-ac57-95da4e96d677 HTTP/1.1" status: 200 len: 993 time: 0.0589910 Dec 09 22:27:32.321954 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:27:33.065753 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4c7e4b9-cff6-437b-887b-c69549a92258 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:35.665843 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-56281084-5e80-4af9-862f-121a0972a0c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:36.903098 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:38.246555 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:39.699177 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:57.756032 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:27:57.854781 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:03.060234 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-02ad26ea-8d8b-4084-a09d-3bd9374078c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:03.144896 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0f707d5-3ca3-414c-9e00-6e3df382a4d0 req-6b2543cf-d169-49ba-81a3-7443b70328ce tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:03.146454 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d0f707d5-3ca3-414c-9e00-6e3df382a4d0 req-6b2543cf-d169-49ba-81a3-7443b70328ce tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 945 time: 0.0533049 Dec 09 22:28:03.200279 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d0f707d5-3ca3-414c-9e00-6e3df382a4d0 req-a9889ff7-d360-41ed-a374-eb50b7c8ed50 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0477064 Dec 09 22:28:04.343101 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48b4fecd-104a-4e64-bb47-c76f8f2e2c9d req-143f1f5a-e4c5-4c10-9ab9-0887915f9fac tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:04.347958 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-48b4fecd-104a-4e64-bb47-c76f8f2e2c9d req-143f1f5a-e4c5-4c10-9ab9-0887915f9fac tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 945 time: 0.0616863 Dec 09 22:28:04.406491 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-48b4fecd-104a-4e64-bb47-c76f8f2e2c9d req-b5a7d84b-ab7b-46b6-95f3-6c1e47cd7c51 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0511901 Dec 09 22:28:05.536780 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e95f7e3-3e0e-43f3-b5e0-4beae56710d4 req-8f983f82-8cc0-4249-918f-0798faa27fd3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:05.538265 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e95f7e3-3e0e-43f3-b5e0-4beae56710d4 req-8f983f82-8cc0-4249-918f-0798faa27fd3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 945 time: 0.0538943 Dec 09 22:28:05.597016 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4e95f7e3-3e0e-43f3-b5e0-4beae56710d4 req-10e174d0-2ba1-4353-b86e-9d2a273e77bf tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0526123 Dec 09 22:28:05.670791 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-691c78d0-0da2-4c2d-8edc-b44bafb78c19 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:06.723567 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47ef9e44-a33a-4c4f-8f75-a23e405474df req-3e57db64-6665-4d0e-84d6-f91f89c7a9c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:06.725001 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-47ef9e44-a33a-4c4f-8f75-a23e405474df req-3e57db64-6665-4d0e-84d6-f91f89c7a9c0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 945 time: 0.0575898 Dec 09 22:28:06.774401 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-47ef9e44-a33a-4c4f-8f75-a23e405474df req-13ac01ef-3233-435b-a706-719c6f4af203 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432312 Dec 09 22:28:06.909690 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:07.895772 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bb9390f-c4ed-4b74-b95a-ffdd7ac42405 req-04d84b84-0531-4b37-865c-afe572ad2bf6 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:07.898291 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8bb9390f-c4ed-4b74-b95a-ffdd7ac42405 req-04d84b84-0531-4b37-865c-afe572ad2bf6 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 945 time: 0.0505295 Dec 09 22:28:07.950555 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8bb9390f-c4ed-4b74-b95a-ffdd7ac42405 req-5926df58-edb4-439c-9adf-d04d18ad166e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463500 Dec 09 22:28:08.255892 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:09.085179 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdd605df-6eb5-438e-a5db-3d0ab6a7e580 req-1fce0a15-f958-4d39-9a19-4d6ad3af5ab9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:09.086601 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cdd605df-6eb5-438e-a5db-3d0ab6a7e580 req-1fce0a15-f958-4d39-9a19-4d6ad3af5ab9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 945 time: 0.0529377 Dec 09 22:28:09.137209 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cdd605df-6eb5-438e-a5db-3d0ab6a7e580 req-a46dc367-100a-40d3-b9ac-4e43c193f499 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445108 Dec 09 22:28:09.327427 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:28:09.700026 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:10.271431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-460771f7-a7b3-43fd-9685-64294b8b83f7 req-01084590-fbc6-4c0a-8797-8aaf8ea6aa49 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:10.273383 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-460771f7-a7b3-43fd-9685-64294b8b83f7 req-01084590-fbc6-4c0a-8797-8aaf8ea6aa49 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 945 time: 0.0521758 Dec 09 22:28:10.336471 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-460771f7-a7b3-43fd-9685-64294b8b83f7 req-cc6e3280-1cb1-4d88-ab2a-e9c5fceff766 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0567245 Dec 09 22:28:11.476948 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97949f54-28d8-4ff0-994f-bf23da8b0c98 req-9d7be2d9-435f-425b-9b45-b94a8d041229 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:11.478408 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-97949f54-28d8-4ff0-994f-bf23da8b0c98 req-9d7be2d9-435f-425b-9b45-b94a8d041229 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 945 time: 0.0613544 Dec 09 22:28:11.532706 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-97949f54-28d8-4ff0-994f-bf23da8b0c98 req-e401fd54-1db8-4827-9869-0f3ffd1fdd1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454817 Dec 09 22:28:12.693615 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eb9d64f-7d7b-4521-9e48-d3abfce4c99a req-1bc05d75-2e76-48bd-a13d-cb987d9b2e14 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:12.695071 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2eb9d64f-7d7b-4521-9e48-d3abfce4c99a req-1bc05d75-2e76-48bd-a13d-cb987d9b2e14 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 945 time: 0.0771294 Dec 09 22:28:12.746143 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2eb9d64f-7d7b-4521-9e48-d3abfce4c99a req-daf201d6-c2d7-412a-93c0-92d9b5d70413 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446706 Dec 09 22:28:13.872360 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25128bcc-23bc-4735-8392-2dd4d73d8348 req-4fbf1851-da34-4d7f-af0a-d63bb6bb2186 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:13.873819 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25128bcc-23bc-4735-8392-2dd4d73d8348 req-4fbf1851-da34-4d7f-af0a-d63bb6bb2186 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 945 time: 0.0485528 Dec 09 22:28:13.928032 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25128bcc-23bc-4735-8392-2dd4d73d8348 req-b3f22008-8171-45b0-aa55-9da4a3cee9f4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0464838 Dec 09 22:28:14.813481 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a7b8a99-5a0f-4088-a552-f8b4ad15c858 req-557b4223-5b85-4a52-b1fc-0bed13fa38ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:14.815024 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9a7b8a99-5a0f-4088-a552-f8b4ad15c858 req-557b4223-5b85-4a52-b1fc-0bed13fa38ca service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 1097 time: 0.0972543 Dec 09 22:28:14.928818 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a7b8a99-5a0f-4088-a552-f8b4ad15c858 req-082b234f-5e36-4498-a78c-b64eefa071a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:14.930313 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9a7b8a99-5a0f-4088-a552-f8b4ad15c858 req-082b234f-5e36-4498-a78c-b64eefa071a2 service neutron] 10.222.0.31 "GET /v2.0/networks?id=d467eac6-2065-4a25-96d1-9c231e3db6c2 HTTP/1.1" status: 200 len: 898 time: 0.0928481 Dec 09 22:28:14.998795 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9a7b8a99-5a0f-4088-a552-f8b4ad15c858 req-7aaa00d1-af71-4d0c-a920-b14ea3a90515 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e928ce55-e398-42cb-9749-85a43037cd08 HTTP/1.1" status: 200 len: 1001 time: 0.0607011 Dec 09 22:28:15.054804 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a7b8a99-5a0f-4088-a552-f8b4ad15c858 req-2421f72f-ae27-4102-b7b2-068f608082ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:15.056337 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9a7b8a99-5a0f-4088-a552-f8b4ad15c858 req-2421f72f-ae27-4102-b7b2-068f608082ec service neutron] 10.222.0.31 "GET /v2.0/subnets?id=fd45a75f-0057-4c2b-974a-168e46ade458 HTTP/1.1" status: 200 len: 835 time: 0.0503011 Dec 09 22:28:15.058402 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad3bd9c1-3c08-485f-9bcf-8679cb64a43b req-3486ba83-e0f7-4006-957d-3442bfc37c28 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:15.059890 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ad3bd9c1-3c08-485f-9bcf-8679cb64a43b req-3486ba83-e0f7-4006-957d-3442bfc37c28 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 945 time: 0.0495305 Dec 09 22:28:15.101667 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a7b8a99-5a0f-4088-a552-f8b4ad15c858 req-8bde75df-0afd-418f-afdf-b3509e8ad7d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:15.103189 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9a7b8a99-5a0f-4088-a552-f8b4ad15c858 req-8bde75df-0afd-418f-afdf-b3509e8ad7d1 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d467eac6-2065-4a25-96d1-9c231e3db6c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0395315 Dec 09 22:28:15.111620 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ad3bd9c1-3c08-485f-9bcf-8679cb64a43b req-a8a10de4-0165-4000-aa2b-a63b11daef2c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455513 Dec 09 22:28:15.196366 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9a7b8a99-5a0f-4088-a552-f8b4ad15c858 req-0a288a08-734e-49cc-a878-ee480de89994 service neutron] 10.222.0.31 "GET /v2.0/networks/d467eac6-2065-4a25-96d1-9c231e3db6c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0854805 Dec 09 22:28:15.288872 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-9a7b8a99-5a0f-4088-a552-f8b4ad15c858 req-3ad7a2da-4415-427f-a2da-867579c79e80 service neutron] 10.222.0.31 "GET /v2.0/networks/d467eac6-2065-4a25-96d1-9c231e3db6c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0852501 Dec 09 22:28:16.242411 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bd776cd-a745-468c-bbb3-0307a9f9c8a3 req-1ae4dc7e-f3d2-43a8-9666-e3ec75993992 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:16.243890 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3bd776cd-a745-468c-bbb3-0307a9f9c8a3 req-1ae4dc7e-f3d2-43a8-9666-e3ec75993992 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 945 time: 0.0571132 Dec 09 22:28:16.297232 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3bd776cd-a745-468c-bbb3-0307a9f9c8a3 req-07e1498c-ca07-494b-b09a-c1c8a2d7d0ce tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450342 Dec 09 22:28:17.743225 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ee419ae-3448-4912-ba15-d162faafc2a9 req-e921e343-4f1f-4bcd-a11e-3f46e0f819e6 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:17.744760 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5ee419ae-3448-4912-ba15-d162faafc2a9 req-e921e343-4f1f-4bcd-a11e-3f46e0f819e6 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 945 time: 0.3763721 Dec 09 22:28:17.799205 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5ee419ae-3448-4912-ba15-d162faafc2a9 req-e024f3c3-f1ae-4907-a74f-101679fa5873 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458539 Dec 09 22:28:18.920954 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c54e65e6-4a49-4b7c-b2ca-b21bafaf3e20 req-5b5178cf-dffd-48a5-b554-57d665241565 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:18.922453 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c54e65e6-4a49-4b7c-b2ca-b21bafaf3e20 req-5b5178cf-dffd-48a5-b554-57d665241565 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 945 time: 0.0523438 Dec 09 22:28:18.985537 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c54e65e6-4a49-4b7c-b2ca-b21bafaf3e20 req-49f291dd-f419-46bf-8958-972e74d55ce9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0534008 Dec 09 22:28:19.011157 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34656) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:28:19.075253 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-20b5e224-265a-47ae-8fcb-611d4118fcc7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/floatingips/f6f9b629-6c48-4df9-ac57-95da4e96d677 HTTP/1.1" status: 200 len: 993 time: 0.0629318 Dec 09 22:28:20.353940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57d2bc48-0e1c-4a9c-9b36-e74bde8adac6 req-369119c9-9c4a-4cb7-95c3-c2c9dfb6f4c9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:20.355319 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-57d2bc48-0e1c-4a9c-9b36-e74bde8adac6 req-369119c9-9c4a-4cb7-95c3-c2c9dfb6f4c9 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 945 time: 0.0483973 Dec 09 22:28:20.385204 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e156d3a6-eb94-4fb7-b010-7906421317e0 req-a48dbf38-b565-494c-a60d-d9c283d48e3f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:20.386835 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e156d3a6-eb94-4fb7-b010-7906421317e0 req-a48dbf38-b565-494c-a60d-d9c283d48e3f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 1097 time: 0.0433760 Dec 09 22:28:20.406319 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-57d2bc48-0e1c-4a9c-9b36-e74bde8adac6 req-4d322e3b-5eac-46fa-a15e-55ee6450fe83 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447054 Dec 09 22:28:20.485231 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e156d3a6-eb94-4fb7-b010-7906421317e0 req-2301750d-faf0-4359-9751-b382986cd192 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:20.486725 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e156d3a6-eb94-4fb7-b010-7906421317e0 req-2301750d-faf0-4359-9751-b382986cd192 service neutron] 10.222.0.31 "GET /v2.0/networks?id=d467eac6-2065-4a25-96d1-9c231e3db6c2 HTTP/1.1" status: 200 len: 898 time: 0.0929966 Dec 09 22:28:20.554250 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e156d3a6-eb94-4fb7-b010-7906421317e0 req-1ff94152-7308-4c2c-a814-683d6beb9392 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e928ce55-e398-42cb-9749-85a43037cd08 HTTP/1.1" status: 200 len: 1001 time: 0.0595765 Dec 09 22:28:20.606716 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e156d3a6-eb94-4fb7-b010-7906421317e0 req-6caba21f-2ccc-40ef-8fd6-29f77a2e30da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:20.608076 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e156d3a6-eb94-4fb7-b010-7906421317e0 req-6caba21f-2ccc-40ef-8fd6-29f77a2e30da service neutron] 10.222.0.31 "GET /v2.0/subnets?id=fd45a75f-0057-4c2b-974a-168e46ade458 HTTP/1.1" status: 200 len: 835 time: 0.0472405 Dec 09 22:28:20.654965 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e156d3a6-eb94-4fb7-b010-7906421317e0 req-4d9effa9-c78d-4d7e-a6d1-2598795cf1b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:20.656477 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e156d3a6-eb94-4fb7-b010-7906421317e0 req-4d9effa9-c78d-4d7e-a6d1-2598795cf1b8 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d467eac6-2065-4a25-96d1-9c231e3db6c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0411346 Dec 09 22:28:20.750255 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e156d3a6-eb94-4fb7-b010-7906421317e0 req-ae3d6a37-77bd-4913-98e0-7c9915e891d9 service neutron] 10.222.0.31 "GET /v2.0/networks/d467eac6-2065-4a25-96d1-9c231e3db6c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860207 Dec 09 22:28:20.845788 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e156d3a6-eb94-4fb7-b010-7906421317e0 req-b505a86b-8232-484f-9f7f-0ff24eb04c24 service neutron] 10.222.0.31 "GET /v2.0/networks/d467eac6-2065-4a25-96d1-9c231e3db6c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0876651 Dec 09 22:28:21.532192 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c70afb8-a10c-4b30-a4ff-362f77ed6e0d req-730e043e-1368-4f15-af41-d80074486a6b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:21.533687 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c70afb8-a10c-4b30-a4ff-362f77ed6e0d req-730e043e-1368-4f15-af41-d80074486a6b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 945 time: 0.0562623 Dec 09 22:28:21.583601 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c70afb8-a10c-4b30-a4ff-362f77ed6e0d req-d7e7874d-317c-420c-b65c-ee3333c6f008 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437596 Dec 09 22:28:21.606376 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34666) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:28:21.668910 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5a85f221-c636-47eb-8423-aadf8fd2f2a8 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/floatingips/f6f9b629-6c48-4df9-ac57-95da4e96d677 HTTP/1.1" status: 200 len: 993 time: 0.0613887 Dec 09 22:28:27.767704 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:27.847060 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:33.070935 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c4a4d5e7-90c6-4b51-a236-72aa27c9283b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:35.674240 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4fa78afc-ca0e-4c33-ba7a-7910d01c4d79 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:36.915422 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:38.253589 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:39.704395 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:46.332687 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:28:52.217721 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34680) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:28:52.378948 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting port 0a22f18c-061c-44f7-8880-3b64d93720da {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:28:52.379249 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:52.461598 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:52.461925 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:52.473448 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Calling delete_port for 0a22f18c-061c-44f7-8880-3b64d93720da owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:28:52.626887 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:52.653432 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Port': ['ID=0a22f18c-061c-44f7-8880-3b64d93720da,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:28:52.663665 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:52.664021 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:52.664363 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:52.664699 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:52.665008 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:52.665334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:52.666079 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:52.666079 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:52.666252 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:52.666591 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:52.666916 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:52.667232 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:52.667583 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:52.729833 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:52.730096 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Floating IP f6f9b629-6c48-4df9-ac57-95da4e96d677 disassociated (deleted). External IP: 172.25.3.162, port: e928ce55-e398-42cb-9749-85a43037cd08. Dec 09 22:28:52.943786 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router e55e0a83-70fc-4320-8788-01e385b7a908 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:28:53.050638 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:28:53.056544 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:53.061264 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f68c8a5d-a020-49f1-bc6e-7ca1672f4603 None None] Sync routers for ids ['e55e0a83-70fc-4320-8788-01e385b7a908'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:28:53.071025 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f68c8a5d-a020-49f1-bc6e-7ca1672f4603 None None] Routers {'e55e0a83-70fc-4320-8788-01e385b7a908'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:28:53.071644 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f68c8a5d-a020-49f1-bc6e-7ca1672f4603 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:28:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['e55e0a83-70fc-4320-8788-01e385b7a908'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:28:53.083851 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-72bbc51e-0e71-4a5c-9af1-5371e7ee6126 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/floatingips/f6f9b629-6c48-4df9-ac57-95da4e96d677 HTTP/1.1" status: 204 len: 168 time: 0.8650191 Dec 09 22:28:53.084490 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f1bd2f03-3e49-4b9f-a1de-41c200addc77', 'tag': 'e928ce55-e398-42cb-9749-85a43037cd08'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:28:53.087196 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-07be45ce-8d7f-4f37-862c-626730cd64f0" -d '{"events": [{"name": "network-changed", "server_uuid": "f1bd2f03-3e49-4b9f-a1de-41c200addc77", "tag": "e928ce55-e398-42cb-9749-85a43037cd08"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:28:53.181709 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-f68c8a5d-a020-49f1-bc6e-7ca1672f4603 None None] Set router e55e0a83-70fc-4320-8788-01e385b7a908 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:28:53.312492 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:28:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-57369cd5-0933-476f-a4f8-abdbabb65757 x-openstack-request-id: req-57369cd5-0933-476f-a4f8-abdbabb65757 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:28:53.313491 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f1bd2f03-3e49-4b9f-a1de-41c200addc77", "tag": "e928ce55-e398-42cb-9749-85a43037cd08", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:28:53.313789 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-57369cd5-0933-476f-a4f8-abdbabb65757 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:28:53.314187 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f1bd2f03-3e49-4b9f-a1de-41c200addc77', 'tag': 'e928ce55-e398-42cb-9749-85a43037cd08', 'status': 'completed', 'code': 200} Dec 09 22:28:53.381840 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07be45ce-8d7f-4f37-862c-626730cd64f0 req-ee2b5572-0337-4bce-bf75-a87ac87ca1b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:53.383648 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-07be45ce-8d7f-4f37-862c-626730cd64f0 req-ee2b5572-0337-4bce-bf75-a87ac87ca1b1 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 1097 time: 0.0470269 Dec 09 22:28:53.385177 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f68c8a5d-a020-49f1-bc6e-7ca1672f4603 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'name': 'tempest-TestNetworkAdvancedServerOps-router-220773520', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55'}], 'enable_snat': True}, 'gw_port_id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:15Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:51:dc:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4272, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '7de3f084-1e14-4e02-b1d3-b78821d0bda7', 'name': '', 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:05:e9:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'device_owner': 'network:router_interface', 'standard_attr_id': 4275, 'fixed_ips': [{'subnet_id': 'fd45a75f-0057-4c2b-974a-168e46ade458', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:27:15Z', 'updated_at': '2021-12-09T22:27:18Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': 'fd45a75f-0057-4c2b-974a-168e46ade458', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:28:53.415726 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f68c8a5d-a020-49f1-bc6e-7ca1672f4603 None None] Checking router: e55e0a83-70fc-4320-8788-01e385b7a908 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:28:53.424055 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1a052d7-2774-4926-8198-add51274a8c2 req-e99f52f4-cb79-456e-b097-d0b19cd1abd8 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:53.425039 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f68c8a5d-a020-49f1-bc6e-7ca1672f4603 None None] Routers {'e55e0a83-70fc-4320-8788-01e385b7a908'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:28:53.425720 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f68c8a5d-a020-49f1-bc6e-7ca1672f4603 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:28:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['e55e0a83-70fc-4320-8788-01e385b7a908'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:28:53.426415 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d1a052d7-2774-4926-8198-add51274a8c2 req-e99f52f4-cb79-456e-b097-d0b19cd1abd8 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 945 time: 0.0549664 Dec 09 22:28:53.481100 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07be45ce-8d7f-4f37-862c-626730cd64f0 req-d0da2196-174a-4c95-9a1b-e6a90b6871ae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:53.481414 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d1a052d7-2774-4926-8198-add51274a8c2 req-dfe582f1-34c2-4d3c-a2b5-a17f401bf338 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0487010 Dec 09 22:28:53.482786 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-07be45ce-8d7f-4f37-862c-626730cd64f0 req-d0da2196-174a-4c95-9a1b-e6a90b6871ae service neutron] 10.222.0.31 "GET /v2.0/networks?id=d467eac6-2065-4a25-96d1-9c231e3db6c2 HTTP/1.1" status: 200 len: 898 time: 0.0911481 Dec 09 22:28:53.526094 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-07be45ce-8d7f-4f37-862c-626730cd64f0 req-0d221a75-b9d5-4809-8f7f-c8f3557b21e5 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e928ce55-e398-42cb-9749-85a43037cd08 HTTP/1.1" status: 200 len: 217 time: 0.0348690 Dec 09 22:28:53.540885 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-f68c8a5d-a020-49f1-bc6e-7ca1672f4603 None None] Set router e55e0a83-70fc-4320-8788-01e385b7a908 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:28:53.581126 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07be45ce-8d7f-4f37-862c-626730cd64f0 req-951dbfe1-b953-404b-a235-73c440f8fc81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:53.582571 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-07be45ce-8d7f-4f37-862c-626730cd64f0 req-951dbfe1-b953-404b-a235-73c440f8fc81 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=fd45a75f-0057-4c2b-974a-168e46ade458 HTTP/1.1" status: 200 len: 835 time: 0.0488155 Dec 09 22:28:53.633995 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07be45ce-8d7f-4f37-862c-626730cd64f0 req-5a61ea0f-a805-4eda-ac44-ccb7df61cfd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:53.635597 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-07be45ce-8d7f-4f37-862c-626730cd64f0 req-5a61ea0f-a805-4eda-ac44-ccb7df61cfd7 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=d467eac6-2065-4a25-96d1-9c231e3db6c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0442681 Dec 09 22:28:53.733408 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-07be45ce-8d7f-4f37-862c-626730cd64f0 req-8ede0e91-ebc6-420e-bd89-b16cdb379485 service neutron] 10.222.0.31 "GET /v2.0/networks/d467eac6-2065-4a25-96d1-9c231e3db6c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0843332 Dec 09 22:28:53.742901 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f68c8a5d-a020-49f1-bc6e-7ca1672f4603 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'name': 'tempest-TestNetworkAdvancedServerOps-router-220773520', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55'}], 'enable_snat': True}, 'gw_port_id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:15Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:51:dc:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4272, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '7de3f084-1e14-4e02-b1d3-b78821d0bda7', 'name': '', 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:05:e9:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'device_owner': 'network:router_interface', 'standard_attr_id': 4275, 'fixed_ips': [{'subnet_id': 'fd45a75f-0057-4c2b-974a-168e46ade458', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:27:15Z', 'updated_at': '2021-12-09T22:27:18Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': 'fd45a75f-0057-4c2b-974a-168e46ade458', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:28:53.769112 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f68c8a5d-a020-49f1-bc6e-7ca1672f4603 None None] The sync data for ids ['e55e0a83-70fc-4320-8788-01e385b7a908'] in n-d-713301-27 is: [{'id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'name': 'tempest-TestNetworkAdvancedServerOps-router-220773520', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55'}], 'enable_snat': True}, 'gw_port_id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:15Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:51:dc:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4272, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '7de3f084-1e14-4e02-b1d3-b78821d0bda7', 'name': '', 'network_id': 'd467eac6-2065-4a25-96d1-9c231e3db6c2', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:05:e9:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'device_owner': 'network:router_interface', 'standard_attr_id': 4275, 'fixed_ips': [{'subnet_id': 'fd45a75f-0057-4c2b-974a-168e46ade458', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:27:15Z', 'updated_at': '2021-12-09T22:27:18Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': 'fd45a75f-0057-4c2b-974a-168e46ade458', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:28:53.837323 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-07be45ce-8d7f-4f37-862c-626730cd64f0 req-0d444663-84ee-4ade-850f-c6b7254ef912 service neutron] 10.222.0.31 "GET /v2.0/networks/d467eac6-2065-4a25-96d1-9c231e3db6c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0947685 Dec 09 22:28:54.016808 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fcd4586f-ddae-4751-8265-6c41e28f7883 None None] New status for floating IP f6f9b629-6c48-4df9-ac57-95da4e96d677: DOWN {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:28:54.625192 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d036d18-e251-4853-8f1d-c12f5b52e63d req-d262055f-9d36-4718-a8b0-47d369b72e1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:54.626711 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7d036d18-e251-4853-8f1d-c12f5b52e63d req-d262055f-9d36-4718-a8b0-47d369b72e1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 945 time: 0.0652852 Dec 09 22:28:54.678808 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7d036d18-e251-4853-8f1d-c12f5b52e63d req-45bc6238-d698-4e33-a35d-34b584d6766a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d710d5b3-ff7a-4ab7-931a-cfb5ca198131&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455348 Dec 09 22:28:54.855070 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec3145dc-df92-42ac-a58b-f04a31c9ca6c req-c21cfbf3-93c4-4bed-9648-6a167467a683 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:28:54.856612 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ec3145dc-df92-42ac-a58b-f04a31c9ca6c req-c21cfbf3-93c4-4bed-9648-6a167467a683 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.31 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 945 time: 0.0545723 Dec 09 22:28:54.953317 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-ec3145dc-df92-42ac-a58b-f04a31c9ca6c req-0333d8df-1079-4d1c-a47d-f7988bdacbef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting port e928ce55-e398-42cb-9749-85a43037cd08 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:28:54.953673 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ec3145dc-df92-42ac-a58b-f04a31c9ca6c req-0333d8df-1079-4d1c-a47d-f7988bdacbef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:55.046552 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-ec3145dc-df92-42ac-a58b-f04a31c9ca6c req-0333d8df-1079-4d1c-a47d-f7988bdacbef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] For port e928ce55-e398-42cb-9749-85a43037cd08, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=e928ce55-e398-42cb-9749-85a43037cd08,segment=NetworkSegment(3f17fd79-d495-4e9d-aa70-314151576549),segment_id=3f17fd79-d495-4e9d-aa70-314151576549)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:28:55.046914 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ec3145dc-df92-42ac-a58b-f04a31c9ca6c req-0333d8df-1079-4d1c-a47d-f7988bdacbef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:55.060189 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-ec3145dc-df92-42ac-a58b-f04a31c9ca6c req-0333d8df-1079-4d1c-a47d-f7988bdacbef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Calling delete_port for e928ce55-e398-42cb-9749-85a43037cd08 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:28:55.199919 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ec3145dc-df92-42ac-a58b-f04a31c9ca6c req-0333d8df-1079-4d1c-a47d-f7988bdacbef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:55.239511 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0333d8df-1079-4d1c-a47d-f7988bdacbef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Port': ['ID=e928ce55-e398-42cb-9749-85a43037cd08,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:28:55.252261 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0333d8df-1079-4d1c-a47d-f7988bdacbef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:55.252691 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0333d8df-1079-4d1c-a47d-f7988bdacbef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:55.253094 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0333d8df-1079-4d1c-a47d-f7988bdacbef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:55.253389 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0333d8df-1079-4d1c-a47d-f7988bdacbef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:55.253820 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0333d8df-1079-4d1c-a47d-f7988bdacbef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:55.254175 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0333d8df-1079-4d1c-a47d-f7988bdacbef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:55.254511 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0333d8df-1079-4d1c-a47d-f7988bdacbef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:55.254808 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0333d8df-1079-4d1c-a47d-f7988bdacbef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:55.255141 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0333d8df-1079-4d1c-a47d-f7988bdacbef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:55.255533 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0333d8df-1079-4d1c-a47d-f7988bdacbef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:55.255842 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0333d8df-1079-4d1c-a47d-f7988bdacbef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:55.256156 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0333d8df-1079-4d1c-a47d-f7988bdacbef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:55.256516 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0333d8df-1079-4d1c-a47d-f7988bdacbef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:55.295486 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-ec3145dc-df92-42ac-a58b-f04a31c9ca6c req-0333d8df-1079-4d1c-a47d-f7988bdacbef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] No DVR routers for this DVR port e928ce55-e398-42cb-9749-85a43037cd08 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:28:55.298122 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-ec3145dc-df92-42ac-a58b-f04a31c9ca6c req-0333d8df-1079-4d1c-a47d-f7988bdacbef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:55.301522 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ec3145dc-df92-42ac-a58b-f04a31c9ca6c req-0333d8df-1079-4d1c-a47d-f7988bdacbef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.31 "DELETE /v2.0/ports/e928ce55-e398-42cb-9749-85a43037cd08 HTTP/1.1" status: 204 len: 173 time: 0.4387181 Dec 09 22:28:55.301980 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f1bd2f03-3e49-4b9f-a1de-41c200addc77', 'name': 'network-vif-deleted', 'tag': 'e928ce55-e398-42cb-9749-85a43037cd08'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:28:55.304752 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2eef983e-dfbd-4ae6-baad-2da8a498e19b" -d '{"events": [{"server_uuid": "f1bd2f03-3e49-4b9f-a1de-41c200addc77", "name": "network-vif-deleted", "tag": "e928ce55-e398-42cb-9749-85a43037cd08"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:28:55.344033 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:28:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-33973f7e-1e45-49ec-84bf-7804a969875c x-openstack-request-id: req-33973f7e-1e45-49ec-84bf-7804a969875c {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:28:55.344329 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f1bd2f03-3e49-4b9f-a1de-41c200addc77", "name": "network-vif-deleted", "tag": "e928ce55-e398-42cb-9749-85a43037cd08", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:28:55.344584 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-33973f7e-1e45-49ec-84bf-7804a969875c {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:28:55.344990 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f1bd2f03-3e49-4b9f-a1de-41c200addc77', 'name': 'network-vif-deleted', 'tag': 'e928ce55-e398-42cb-9749-85a43037cd08', 'status': 'completed', 'code': 200} Dec 09 22:28:55.801853 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-047c0ff3-7bbd-4d3b-9046-143600e772a6 req-941c2d5b-1b3c-4c87-8a72-ec1454413d5c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=f1bd2f03-3e49-4b9f-a1de-41c200addc77 HTTP/1.1" status: 200 len: 210 time: 0.0304074 Dec 09 22:28:56.859337 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34698) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:28:57.245469 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8059eb0a-5272-40b2-9493-09beb43a8e07 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:57.501382 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-8059eb0a-5272-40b2-9493-09beb43a8e07 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting port 7de3f084-1e14-4e02-b1d3-b78821d0bda7 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:28:57.501660 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8059eb0a-5272-40b2-9493-09beb43a8e07 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:57.591026 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-8059eb0a-5272-40b2-9493-09beb43a8e07 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] For port 7de3f084-1e14-4e02-b1d3-b78821d0bda7, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=7de3f084-1e14-4e02-b1d3-b78821d0bda7,segment=NetworkSegment(3f17fd79-d495-4e9d-aa70-314151576549),segment_id=3f17fd79-d495-4e9d-aa70-314151576549)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:28:57.591384 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8059eb0a-5272-40b2-9493-09beb43a8e07 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:57.603934 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-8059eb0a-5272-40b2-9493-09beb43a8e07 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Calling delete_port for 7de3f084-1e14-4e02-b1d3-b78821d0bda7 owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:28:57.766406 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:57.810378 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8059eb0a-5272-40b2-9493-09beb43a8e07 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:57.834573 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8059eb0a-5272-40b2-9493-09beb43a8e07 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Port': ['ID=7de3f084-1e14-4e02-b1d3-b78821d0bda7,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:28:57.873024 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:58.011895 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-8059eb0a-5272-40b2-9493-09beb43a8e07 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:58.233232 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8059eb0a-5272-40b2-9493-09beb43a8e07 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router e55e0a83-70fc-4320-8788-01e385b7a908 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:28:58.355851 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8059eb0a-5272-40b2-9493-09beb43a8e07 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:28:58.361965 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8059eb0a-5272-40b2-9493-09beb43a8e07 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "PUT /v2.0/routers/e55e0a83-70fc-4320-8788-01e385b7a908/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5009155 Dec 09 22:28:58.364719 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34700) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:28:58.367937 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8464cfe-82e3-4564-86d7-d3cca3a3c62a None None] Sync routers for ids ['e55e0a83-70fc-4320-8788-01e385b7a908'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:28:58.378048 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8464cfe-82e3-4564-86d7-d3cca3a3c62a None None] Routers {'e55e0a83-70fc-4320-8788-01e385b7a908'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:28:58.378924 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a8464cfe-82e3-4564-86d7-d3cca3a3c62a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:28:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['e55e0a83-70fc-4320-8788-01e385b7a908'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:28:58.418715 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-e3be53d1-eb38-4b42-b6c7-56b55ea1c890 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting subnet fd45a75f-0057-4c2b-974a-168e46ade458 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:28:58.424981 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3be53d1-eb38-4b42-b6c7-56b55ea1c890 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:58.470203 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3be53d1-eb38-4b42-b6c7-56b55ea1c890 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:58.490540 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-a8464cfe-82e3-4564-86d7-d3cca3a3c62a None None] Set router e55e0a83-70fc-4320-8788-01e385b7a908 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:28:58.564349 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3be53d1-eb38-4b42-b6c7-56b55ea1c890 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:58.634232 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3be53d1-eb38-4b42-b6c7-56b55ea1c890 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:58.661421 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3be53d1-eb38-4b42-b6c7-56b55ea1c890 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Subnet': ['ID=fd45a75f-0057-4c2b-974a-168e46ade458,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:28:58.666584 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3be53d1-eb38-4b42-b6c7-56b55ea1c890 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:58.672573 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34702) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:28:58.673306 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e3be53d1-eb38-4b42-b6c7-56b55ea1c890 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/subnets/fd45a75f-0057-4c2b-974a-168e46ade458 HTTP/1.1" status: 204 len: 168 time: 0.3075442 Dec 09 22:28:58.675043 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3dda21a8-36b9-4f3b-aeca-b2db72126f46 None None] Network d467eac6-2065-4a25-96d1-9c231e3db6c2 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:28:58.681375 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a8464cfe-82e3-4564-86d7-d3cca3a3c62a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'name': 'tempest-TestNetworkAdvancedServerOps-router-220773520', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55'}], 'enable_snat': True}, 'gw_port_id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:28:57Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:51:dc:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4272, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:28:58.708737 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8464cfe-82e3-4564-86d7-d3cca3a3c62a None None] Checking router: e55e0a83-70fc-4320-8788-01e385b7a908 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:28:58.717553 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8464cfe-82e3-4564-86d7-d3cca3a3c62a None None] Routers {'e55e0a83-70fc-4320-8788-01e385b7a908'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:28:58.718284 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a8464cfe-82e3-4564-86d7-d3cca3a3c62a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:28:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['e55e0a83-70fc-4320-8788-01e385b7a908'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:28:58.782536 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6e0a37d-e268-400d-8f3c-c07350f00c86 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:58.846762 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dea278e1-69e1-417f-afa1-8a1e2fc00b24 None None] DHCP port deletion for d467eac6-2065-4a25-96d1-9c231e3db6c2 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:28:58.903414 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-dea278e1-69e1-417f-afa1-8a1e2fc00b24 None None] Deleting port 68ec7864-df70-45a3-a181-d400b58f4261 {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:28:58.904100 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dea278e1-69e1-417f-afa1-8a1e2fc00b24 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:58.943793 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-a8464cfe-82e3-4564-86d7-d3cca3a3c62a None None] Set router e55e0a83-70fc-4320-8788-01e385b7a908 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:28:58.971378 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-dea278e1-69e1-417f-afa1-8a1e2fc00b24 None None] For port 68ec7864-df70-45a3-a181-d400b58f4261, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=68ec7864-df70-45a3-a181-d400b58f4261,segment=NetworkSegment(3f17fd79-d495-4e9d-aa70-314151576549),segment_id=3f17fd79-d495-4e9d-aa70-314151576549)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:28:58.971815 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dea278e1-69e1-417f-afa1-8a1e2fc00b24 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:58.985493 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-dea278e1-69e1-417f-afa1-8a1e2fc00b24 None None] Calling delete_port for 68ec7864-df70-45a3-a181-d400b58f4261 owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:28:59.081903 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dea278e1-69e1-417f-afa1-8a1e2fc00b24 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:59.115377 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dea278e1-69e1-417f-afa1-8a1e2fc00b24 None None] Pushing event deleted for resources: {'Port': ['ID=68ec7864-df70-45a3-a181-d400b58f4261,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:28:59.120052 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dea278e1-69e1-417f-afa1-8a1e2fc00b24 None None] No DVR routers for this DVR port 68ec7864-df70-45a3-a181-d400b58f4261 on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:28:59.131624 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea278e1-69e1-417f-afa1-8a1e2fc00b24 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:59.131624 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea278e1-69e1-417f-afa1-8a1e2fc00b24 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:59.132922 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea278e1-69e1-417f-afa1-8a1e2fc00b24 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:59.133610 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea278e1-69e1-417f-afa1-8a1e2fc00b24 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:59.138147 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea278e1-69e1-417f-afa1-8a1e2fc00b24 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:59.138287 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea278e1-69e1-417f-afa1-8a1e2fc00b24 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:59.138635 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea278e1-69e1-417f-afa1-8a1e2fc00b24 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:59.139022 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea278e1-69e1-417f-afa1-8a1e2fc00b24 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:59.139422 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea278e1-69e1-417f-afa1-8a1e2fc00b24 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:59.139836 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea278e1-69e1-417f-afa1-8a1e2fc00b24 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:59.140219 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea278e1-69e1-417f-afa1-8a1e2fc00b24 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:59.140683 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-a8464cfe-82e3-4564-86d7-d3cca3a3c62a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'name': 'tempest-TestNetworkAdvancedServerOps-router-220773520', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55'}], 'enable_snat': True}, 'gw_port_id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:28:57Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:51:dc:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4272, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:28:59.140818 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea278e1-69e1-417f-afa1-8a1e2fc00b24 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:59.141147 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea278e1-69e1-417f-afa1-8a1e2fc00b24 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:28:59.171911 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8464cfe-82e3-4564-86d7-d3cca3a3c62a None None] The sync data for ids ['e55e0a83-70fc-4320-8788-01e385b7a908'] in n-d-713301-27 is: [{'id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'name': 'tempest-TestNetworkAdvancedServerOps-router-220773520', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55'}], 'enable_snat': True}, 'gw_port_id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:28:57Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': '2fb791f4-4212-4cbc-95e8-2315abfefcec', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:51:dc:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e55e0a83-70fc-4320-8788-01e385b7a908', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4272, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.55', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:27:12Z', 'updated_at': '2021-12-09T22:27:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:28:59.224227 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6e0a37d-e268-400d-8f3c-c07350f00c86 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:59.278315 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-a6e0a37d-e268-400d-8f3c-c07350f00c86 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting port 2fb791f4-4212-4cbc-95e8-2315abfefcec {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:28:59.278661 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6e0a37d-e268-400d-8f3c-c07350f00c86 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:59.356347 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-a6e0a37d-e268-400d-8f3c-c07350f00c86 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] For port 2fb791f4-4212-4cbc-95e8-2315abfefcec, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=2fb791f4-4212-4cbc-95e8-2315abfefcec,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:28:59.356704 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6e0a37d-e268-400d-8f3c-c07350f00c86 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:59.369238 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-a6e0a37d-e268-400d-8f3c-c07350f00c86 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Calling delete_port for 2fb791f4-4212-4cbc-95e8-2315abfefcec owned by network:router_gateway {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:28:59.548857 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6e0a37d-e268-400d-8f3c-c07350f00c86 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:59.580243 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6e0a37d-e268-400d-8f3c-c07350f00c86 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Port': ['ID=2fb791f4-4212-4cbc-95e8-2315abfefcec,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:28:59.598043 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d70c111-da8e-445e-8e05-5b8f662dc2ea None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:28:59.641672 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6e0a37d-e268-400d-8f3c-c07350f00c86 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:59.737608 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6e0a37d-e268-400d-8f3c-c07350f00c86 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:59.739959 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6e0a37d-e268-400d-8f3c-c07350f00c86 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:59.786966 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6e0a37d-e268-400d-8f3c-c07350f00c86 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:59.787431 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a6e0a37d-e268-400d-8f3c-c07350f00c86 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Fanout notify agent at l3_agent the message router_deleted on router e55e0a83-70fc-4320-8788-01e385b7a908 {{(pid=103438) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 22:28:59.794442 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a6e0a37d-e268-400d-8f3c-c07350f00c86 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:59.796147 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a6e0a37d-e268-400d-8f3c-c07350f00c86 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/routers/e55e0a83-70fc-4320-8788-01e385b7a908 HTTP/1.1" status: 204 len: 168 time: 1.1215243 Dec 09 22:28:59.798326 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34704) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:28:59.878928 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8e4d463-8e2b-4043-8699-d631ffae3ccb tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:59.969718 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8e4d463-8e2b-4043-8699-d631ffae3ccb tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:28:59.990460 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-d8e4d463-8e2b-4043-8699-d631ffae3ccb tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d467eac6-2065-4a25-96d1-9c231e3db6c2']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:28:59.999746 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-d8e4d463-8e2b-4043-8699-d631ffae3ccb tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3f17fd79-d495-4e9d-aa70-314151576549') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:29:00.000038 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-d8e4d463-8e2b-4043-8699-d631ffae3ccb tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3f17fd79-d495-4e9d-aa70-314151576549') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:29:00.011315 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8e4d463-8e2b-4043-8699-d631ffae3ccb tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:00.025565 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8e4d463-8e2b-4043-8699-d631ffae3ccb tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:00.028236 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e928ce55-e398-42cb-9749-85a43037cd08 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:29:00.031648 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d8e4d463-8e2b-4043-8699-d631ffae3ccb tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Releasing vlan 109 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:29:00.032038 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8e4d463-8e2b-4043-8699-d631ffae3ccb tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: timer() Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:29:00.034980 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:29:00.049042 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: e928ce55-e398-42cb-9749-85a43037cd08 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:29:00.049312 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device e928ce55-e398-42cb-9749-85a43037cd08 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:29:00.094368 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8e4d463-8e2b-4043-8699-d631ffae3ccb tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:00.101522 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8e4d463-8e2b-4043-8699-d631ffae3ccb tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:00.104632 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d8e4d463-8e2b-4043-8699-d631ffae3ccb tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/networks/d467eac6-2065-4a25-96d1-9c231e3db6c2 HTTP/1.1" status: 204 len: 168 time: 0.3053596 Dec 09 22:29:00.107566 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34706) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:29:00.116448 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8e4d463-8e2b-4043-8699-d631ffae3ccb tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Network': ['ID=d467eac6-2065-4a25-96d1-9c231e3db6c2,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:00.168907 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-933cef86-b711-43a7-ba16-9c748904565b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:00.195554 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-933cef86-b711-43a7-ba16-9c748904565b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:00.262449 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-933cef86-b711-43a7-ba16-9c748904565b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:00.266581 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-933cef86-b711-43a7-ba16-9c748904565b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:00.270643 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-933cef86-b711-43a7-ba16-9c748904565b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/security-groups/d710d5b3-ff7a-4ab7-931a-cfb5ca198131 HTTP/1.1" status: 204 len: 168 time: 0.1613519 Dec 09 22:29:00.280750 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-933cef86-b711-43a7-ba16-9c748904565b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d710d5b3-ff7a-4ab7-931a-cfb5ca198131,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:00.519361 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 68ec7864-df70-45a3-a181-d400b58f4261 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:29:00.541956 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 68ec7864-df70-45a3-a181-d400b58f4261 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:29:00.542300 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 68ec7864-df70-45a3-a181-d400b58f4261 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:29:00.542714 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2fb791f4-4212-4cbc-95e8-2315abfefcec no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:29:00.545308 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34712) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:29:00.550273 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-f8a04a0a-a256-4a49-9271-c01722b12265 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-2002628898', 'description': 'tempest-secgroup-smoke-2002628898 description', 'project_id': 'e21dff80515b44aa9f01117603c6de0d'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:29:00.562604 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 2fb791f4-4212-4cbc-95e8-2315abfefcec {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:29:00.562859 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 2fb791f4-4212-4cbc-95e8-2315abfefcec not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:29:00.563266 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7de3f084-1e14-4e02-b1d3-b78821d0bda7 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:29:00.578036 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8a04a0a-a256-4a49-9271-c01722b12265 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:00.582321 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 7de3f084-1e14-4e02-b1d3-b78821d0bda7 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:29:00.582666 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 7de3f084-1e14-4e02-b1d3-b78821d0bda7 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:29:00.643189 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8a04a0a-a256-4a49-9271-c01722b12265 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:00.648504 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8a04a0a-a256-4a49-9271-c01722b12265 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:00.678282 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f8a04a0a-a256-4a49-9271-c01722b12265 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:00.679552 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f8a04a0a-a256-4a49-9271-c01722b12265 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1330681 Dec 09 22:29:00.682222 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8a04a0a-a256-4a49-9271-c01722b12265 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d55fc983-4e08-485c-9436-4f02a9e1dd85,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:00.683075 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34714) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:29:00.687842 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-62065643-5606-4e26-86ec-5458911ab902 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': 'd55fc983-4e08-485c-9436-4f02a9e1dd85', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:29:00.718056 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62065643-5606-4e26-86ec-5458911ab902 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:00.779884 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62065643-5606-4e26-86ec-5458911ab902 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:00.785436 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62065643-5606-4e26-86ec-5458911ab902 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:00.802385 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62065643-5606-4e26-86ec-5458911ab902 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ab648602-342a-4eca-b331-842fe7de6678,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:00.812074 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-62065643-5606-4e26-86ec-5458911ab902 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:00.813384 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-62065643-5606-4e26-86ec-5458911ab902 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1290956 Dec 09 22:29:00.816104 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34716) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:29:00.820548 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-2b5d9802-8c34-4faa-b5ab-5304344b5d4e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': 'd55fc983-4e08-485c-9436-4f02a9e1dd85', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:29:00.851522 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2b5d9802-8c34-4faa-b5ab-5304344b5d4e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:00.911818 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2b5d9802-8c34-4faa-b5ab-5304344b5d4e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:00.917438 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2b5d9802-8c34-4faa-b5ab-5304344b5d4e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:00.936641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b5d9802-8c34-4faa-b5ab-5304344b5d4e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7fb0058b-5924-48f8-a9d9-6dd1f554ac35,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:00.943394 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2b5d9802-8c34-4faa-b5ab-5304344b5d4e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:00.944625 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2b5d9802-8c34-4faa-b5ab-5304344b5d4e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1275420 Dec 09 22:29:00.947598 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34718) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:29:00.952558 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-a241de3c-4116-4d49-80ed-24992f2cee8c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': 'd55fc983-4e08-485c-9436-4f02a9e1dd85', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:29:00.981942 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a241de3c-4116-4d49-80ed-24992f2cee8c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:01.039954 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a241de3c-4116-4d49-80ed-24992f2cee8c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:01.045282 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a241de3c-4116-4d49-80ed-24992f2cee8c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:01.062581 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a241de3c-4116-4d49-80ed-24992f2cee8c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c98d2cea-45f5-4e7e-b919-ece5290523ee,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:01.071674 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-a241de3c-4116-4d49-80ed-24992f2cee8c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:01.072930 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-a241de3c-4116-4d49-80ed-24992f2cee8c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1242790 Dec 09 22:29:01.075931 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34720) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:29:01.080345 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-21908bc8-2205-4b2c-a010-522ca29736bd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': 'd55fc983-4e08-485c-9436-4f02a9e1dd85', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:29:01.109984 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-21908bc8-2205-4b2c-a010-522ca29736bd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:01.168020 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-21908bc8-2205-4b2c-a010-522ca29736bd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:01.173627 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-21908bc8-2205-4b2c-a010-522ca29736bd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:01.191375 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21908bc8-2205-4b2c-a010-522ca29736bd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=086eced3-b46d-46ef-a1aa-bb586354053b,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:01.200703 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-21908bc8-2205-4b2c-a010-522ca29736bd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:01.201924 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-21908bc8-2205-4b2c-a010-522ca29736bd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1250668 Dec 09 22:29:01.204930 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34722) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:29:01.209662 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-595ba31e-9fac-4402-8ddf-4e2ed248e154 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': 'd55fc983-4e08-485c-9436-4f02a9e1dd85', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:29:01.240257 n-d-713301-27 neutron-server[103438]: INFO neutron.db.securitygroups_db [None req-595ba31e-9fac-4402-8ddf-4e2ed248e154 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Project e21dff80515b44aa9f01117603c6de0d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 22:29:01.245456 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-595ba31e-9fac-4402-8ddf-4e2ed248e154 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:01.303271 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-595ba31e-9fac-4402-8ddf-4e2ed248e154 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:01.309330 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-595ba31e-9fac-4402-8ddf-4e2ed248e154 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:01.327365 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-595ba31e-9fac-4402-8ddf-4e2ed248e154 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=52809eb5-a708-4eac-a86c-d3d318da6cf6,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:01.333404 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-595ba31e-9fac-4402-8ddf-4e2ed248e154 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:01.333935 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-595ba31e-9fac-4402-8ddf-4e2ed248e154 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1279426 Dec 09 22:29:01.336684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34724) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:29:01.341252 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a9175bd4-8834-4ade-b2de-a2770156adf1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'security_group_rule': {'security_group_id': 'd55fc983-4e08-485c-9436-4f02a9e1dd85', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:29:01.364260 n-d-713301-27 neutron-server[103438]: INFO neutron.db.securitygroups_db [None req-a9175bd4-8834-4ade-b2de-a2770156adf1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Project e21dff80515b44aa9f01117603c6de0d added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 22:29:01.369310 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a9175bd4-8834-4ade-b2de-a2770156adf1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:01.439172 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a9175bd4-8834-4ade-b2de-a2770156adf1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:01.447243 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a9175bd4-8834-4ade-b2de-a2770156adf1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:01.466641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9175bd4-8834-4ade-b2de-a2770156adf1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=67515d9e-bf29-4f50-8be8-ff552cc92e90,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:01.475868 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a9175bd4-8834-4ade-b2de-a2770156adf1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:01.477082 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a9175bd4-8834-4ade-b2de-a2770156adf1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1394708 Dec 09 22:29:01.480644 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34726) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:29:01.485789 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-563802b5-17f9-43d3-b283-efdc2f3b232d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'network': {'name': 'tempest-network-smoke--1573182280', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'port_security_enabled': True}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:29:01.506278 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-563802b5-17f9-43d3-b283-efdc2f3b232d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Made reservation on behalf of e21dff80515b44aa9f01117603c6de0d for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:29:01.509726 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-563802b5-17f9-43d3-b283-efdc2f3b232d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:01.536287 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-563802b5-17f9-43d3-b283-efdc2f3b232d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] vlan segment allocate from pool success with {'vlan_id': 148, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 22:29:01.546266 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-563802b5-17f9-43d3-b283-efdc2f3b232d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:01.546818 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-563802b5-17f9-43d3-b283-efdc2f3b232d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Added segment 1b04707c-2702-4065-9090-68f189781fea of type vlan for network 605c75e8-98d5-408d-b084-5a5a3eb371a5 Dec 09 22:29:01.594709 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-563802b5-17f9-43d3-b283-efdc2f3b232d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:01.621282 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-563802b5-17f9-43d3-b283-efdc2f3b232d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:01.627182 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-563802b5-17f9-43d3-b283-efdc2f3b232d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:01.627818 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-563802b5-17f9-43d3-b283-efdc2f3b232d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:01.671547 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-563802b5-17f9-43d3-b283-efdc2f3b232d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 769 time: 0.1897571 Dec 09 22:29:01.674669 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34728) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:29:01.681673 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-6d0536f4-acd9-406b-9058-818f775805d5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'router': {'name': 'tempest-TestNetworkAdvancedServerOps-router-1723148457', 'admin_state_up': True, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:29:01.712258 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6d0536f4-acd9-406b-9058-818f775805d5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:01.713360 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6d0536f4-acd9-406b-9058-818f775805d5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:01.715205 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-563802b5-17f9-43d3-b283-efdc2f3b232d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Network': ['ID=605c75e8-98d5-408d-b084-5a5a3eb371a5,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:01.729724 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 605c75e8-98d5-408d-b084-5a5a3eb371a5 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 22:29:01.772381 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6d0536f4-acd9-406b-9058-818f775805d5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:01.908979 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6d0536f4-acd9-406b-9058-818f775805d5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:02.103063 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6d0536f4-acd9-406b-9058-818f775805d5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:02.121733 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6d0536f4-acd9-406b-9058-818f775805d5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:02.225272 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-6d0536f4-acd9-406b-9058-818f775805d5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Allocated IP 172.25.3.59 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/d2f08748-9030-4a88-bc06-d68b94d94999) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:29:02.335256 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6d0536f4-acd9-406b-9058-818f775805d5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:02.370234 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6d0536f4-acd9-406b-9058-818f775805d5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:02.407293 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d0536f4-acd9-406b-9058-818f775805d5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:29:02.410088 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-6d0536f4-acd9-406b-9058-818f775805d5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:29:02.416450 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d0536f4-acd9-406b-9058-818f775805d5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:29:02.422684 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d0536f4-acd9-406b-9058-818f775805d5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=d2f08748-9030-4a88-bc06-d68b94d94999,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:02.428639 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7e7c437-97cb-478e-af41-859314917186 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:29:02.514721 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c9adf403-ceaa-48a3-8505-56f32131fc4a None None] Provisioning complete for port d2f08748-9030-4a88-bc06-d68b94d94999 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:29:02.514976 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c9adf403-ceaa-48a3-8505-56f32131fc4a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:02.549117 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-c9adf403-ceaa-48a3-8505-56f32131fc4a None None] Port d2f08748-9030-4a88-bc06-d68b94d94999 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:29:02.671464 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6d0536f4-acd9-406b-9058-818f775805d5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:02.868101 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6d0536f4-acd9-406b-9058-818f775805d5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:02.997915 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6d0536f4-acd9-406b-9058-818f775805d5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router cad95bae-90ee-4cb5-84cf-346cf111d80d is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 22:29:03.065228 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bfe6141c-0d6b-4ad2-ab4b-e5c6882cd8e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:03.108226 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6d0536f4-acd9-406b-9058-818f775805d5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:29:03.117609 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] Sync routers for ids ['cad95bae-90ee-4cb5-84cf-346cf111d80d'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:29:03.128499 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] Routers {'cad95bae-90ee-4cb5-84cf-346cf111d80d'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:29:03.129124 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:28:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['cad95bae-90ee-4cb5-84cf-346cf111d80d'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:29:03.129638 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6d0536f4-acd9-406b-9058-818f775805d5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:03.130879 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6d0536f4-acd9-406b-9058-818f775805d5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 895 time: 1.4549031 Dec 09 22:29:03.134040 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34730) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:29:03.204286 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a39fbf8f-9a03-4f5e-b854-cd3dbd3a86a6 tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] 10.222.0.13 "GET /v2.0/subnets?project_id=e21dff80515b44aa9f01117603c6de0d&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0691111 Dec 09 22:29:03.206808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34734) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:29:03.235557 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] Set router cad95bae-90ee-4cb5-84cf-346cf111d80d gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:29:03.291461 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6f5f3fc8-0154-4877-a373-eb7289683000 tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:03.293009 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6f5f3fc8-0154-4877-a373-eb7289683000 tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] 10.222.0.13 "GET /v2.0/networks?router%3Aexternal=True HTTP/1.1" status: 200 len: 884 time: 0.0852787 Dec 09 22:29:03.296013 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34736) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:29:03.327647 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6fb4a3e2-440a-46c0-b84e-9d1fb785713a tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] 10.222.0.13 "GET /v2.0/subnets?network_id=97925a19-460a-4476-8208-41db134b6c83&cidr=172.20.0.0%2F28 HTTP/1.1" status: 200 len: 207 time: 0.0304739 Dec 09 22:29:03.330122 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34738) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:29:03.335779 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-1380f8b5-cd78-4152-99c7-6901474ce7cf tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'subnet': {'name': 'tempest-subnet-smoke-681472176', 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'ip_version': 4, 'cidr': '172.20.0.0/28'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:29:03.420277 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1723148457', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59'}], 'enable_snat': True}, 'gw_port_id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:29:01Z', 'updated_at': '2021-12-09T22:29:02Z', 'revision_number': 3, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:7a:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4291, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:29:02Z', 'updated_at': '2021-12-09T22:29:02Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:29:03.432084 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1380f8b5-cd78-4152-99c7-6901474ce7cf tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Made reservation on behalf of e21dff80515b44aa9f01117603c6de0d for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:29:03.435854 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1380f8b5-cd78-4152-99c7-6901474ce7cf tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:03.451725 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] Checking router: cad95bae-90ee-4cb5-84cf-346cf111d80d for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:29:03.452085 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] Updating router cad95bae-90ee-4cb5-84cf-346cf111d80d port d2f08748-9030-4a88-bc06-d68b94d94999 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:29:03.477827 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:03.614431 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1380f8b5-cd78-4152-99c7-6901474ce7cf tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:03.693419 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1380f8b5-cd78-4152-99c7-6901474ce7cf tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Subnet': ['ID=77fdf423-e042-4c38-a771-2a2e0eb90831,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:03.696640 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1380f8b5-cd78-4152-99c7-6901474ce7cf tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Checking segment: {'id': '1b04707c-2702-4065-9090-68f189781fea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:29:03.697012 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1380f8b5-cd78-4152-99c7-6901474ce7cf tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network hostable DHCP agents. Network: 605c75e8-98d5-408d-b084-5a5a3eb371a5, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 22:29:03.714825 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1380f8b5-cd78-4152-99c7-6901474ce7cf tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network 605c75e8-98d5-408d-b084-5a5a3eb371a5 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 22:29:03.723929 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-1380f8b5-cd78-4152-99c7-6901474ce7cf tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 605c75e8-98d5-408d-b084-5a5a3eb371a5) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:29:03.728696 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1380f8b5-cd78-4152-99c7-6901474ce7cf tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:03.730225 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1380f8b5-cd78-4152-99c7-6901474ce7cf tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:03.735394 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ecf0849c-8363-4603-8fb2-95c145780264 None None] Network 605c75e8-98d5-408d-b084-5a5a3eb371a5 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:29:03.749051 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1380f8b5-cd78-4152-99c7-6901474ce7cf tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 831 time: 0.4172468 Dec 09 22:29:03.752062 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34740) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:29:03.779070 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:03.807335 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:03.861774 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad9fe734-0bb1-4646-9a18-10c52eaaba45 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:29:03.897331 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] Attempting to bind port d2f08748-9030-4a88-bc06-d68b94d94999 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:29:03.897700 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] Attempting to bind port d2f08748-9030-4a88-bc06-d68b94d94999 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:29:03.898066 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] Attempting to bind port d2f08748-9030-4a88-bc06-d68b94d94999 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:29:03.904006 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3334ff5b-eb50-4f0b-914e-96fdd4d07868 None None] Pushing event updated for resources: {'Port': ['ID=d2f08748-9030-4a88-bc06-d68b94d94999,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:03.909017 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 28, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:29:03.909397 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:29:03.909804 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:03.910191 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:29:03.910666 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] Bound port: d2f08748-9030-4a88-bc06-d68b94d94999, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:29:03.911048 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:03.932230 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0de16ff4-623d-41ff-9fee-ed92683f2e46 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-605c75e8-98d5-408d-b084-5a5a3eb371a5', 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5', 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ips': [{'subnet_id': '77fdf423-e042-4c38-a771-2a2e0eb90831'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 22:29:03.933610 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0de16ff4-623d-41ff-9fee-ed92683f2e46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:03.989259 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] For port d2f08748-9030-4a88-bc06-d68b94d94999, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:29:04.048716 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] For port d2f08748-9030-4a88-bc06-d68b94d94999, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d2f08748-9030-4a88-bc06-d68b94d94999,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:29:04.058525 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:04.063722 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-bdc49fa9-001f-4880-bdcb-0b500f832029 None None] Provisioning complete for port d2f08748-9030-4a88-bc06-d68b94d94999 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:29:04.064080 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bdc49fa9-001f-4880-bdcb-0b500f832029 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:04.204681 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f45f2b2-5965-4f9d-b48d-5ec93410991e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:04.324464 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae36152b-5e27-4fcb-940f-8b105e7bb3ba None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:29:04.364332 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] Routers {'cad95bae-90ee-4cb5-84cf-346cf111d80d'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:29:04.364636 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:28:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['cad95bae-90ee-4cb5-84cf-346cf111d80d'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:29:04.366349 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3334ff5b-eb50-4f0b-914e-96fdd4d07868 None None] Pushing event updated for resources: {'Port': ['ID=d2f08748-9030-4a88-bc06-d68b94d94999,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:04.414911 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-0de16ff4-623d-41ff-9fee-ed92683f2e46 None None] Allocated IP 172.20.0.2 (605c75e8-98d5-408d-b084-5a5a3eb371a5/77fdf423-e042-4c38-a771-2a2e0eb90831/004d1246-e318-444f-9c8a-94684730b9cd) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:29:04.558192 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bdc49fa9-001f-4880-bdcb-0b500f832029 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:04.581219 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] Set router cad95bae-90ee-4cb5-84cf-346cf111d80d gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:29:04.653129 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-bdc49fa9-001f-4880-bdcb-0b500f832029 None None] For port d2f08748-9030-4a88-bc06-d68b94d94999, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d2f08748-9030-4a88-bc06-d68b94d94999,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:29:04.669455 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-bdc49fa9-001f-4880-bdcb-0b500f832029 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:04.800569 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0de16ff4-623d-41ff-9fee-ed92683f2e46 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:04.821030 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdc49fa9-001f-4880-bdcb-0b500f832029 None None] Pushing event updated for resources: {'Port': ['ID=d2f08748-9030-4a88-bc06-d68b94d94999,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:04.824150 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0de16ff4-623d-41ff-9fee-ed92683f2e46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:04.866947 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-6f45f2b2-5965-4f9d-b48d-5ec93410991e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Allocated IP 172.20.0.1 (605c75e8-98d5-408d-b084-5a5a3eb371a5/77fdf423-e042-4c38-a771-2a2e0eb90831/1bb6f982-cf35-4690-ab35-344e10e36ba5) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:29:04.884272 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-cea3ea8b-d834-4746-9baf-f4a5f1c8c70c None None] Provisioning complete for port d2f08748-9030-4a88-bc06-d68b94d94999 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:29:04.884643 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-cea3ea8b-d834-4746-9baf-f4a5f1c8c70c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:04.916580 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0de16ff4-623d-41ff-9fee-ed92683f2e46 None None] Network 605c75e8-98d5-408d-b084-5a5a3eb371a5 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:29:04.925417 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0de16ff4-623d-41ff-9fee-ed92683f2e46 None None] Pushing event updated for resources: {'Port': ['ID=004d1246-e318-444f-9c8a-94684730b9cd,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:04.927899 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-0de16ff4-623d-41ff-9fee-ed92683f2e46 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:29:04.934725 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0de16ff4-623d-41ff-9fee-ed92683f2e46 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:29:04.988602 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f45f2b2-5965-4f9d-b48d-5ec93410991e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:05.014580 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0de16ff4-623d-41ff-9fee-ed92683f2e46 None None] Attempting to bind port 004d1246-e318-444f-9c8a-94684730b9cd on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:29:05.015194 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0de16ff4-623d-41ff-9fee-ed92683f2e46 None None] Attempting to bind port 004d1246-e318-444f-9c8a-94684730b9cd by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '1b04707c-2702-4065-9090-68f189781fea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:29:05.015880 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0de16ff4-623d-41ff-9fee-ed92683f2e46 None None] Attempting to bind port 004d1246-e318-444f-9c8a-94684730b9cd on network 605c75e8-98d5-408d-b084-5a5a3eb371a5 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:29:05.019938 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1723148457', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59'}], 'enable_snat': True}, 'gw_port_id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:29:01Z', 'updated_at': '2021-12-09T22:29:02Z', 'revision_number': 3, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:7a:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4291, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:29:02Z', 'updated_at': '2021-12-09T22:29:03Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:29:05.025781 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f45f2b2-5965-4f9d-b48d-5ec93410991e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:05.068774 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f45f2b2-5965-4f9d-b48d-5ec93410991e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network 605c75e8-98d5-408d-b084-5a5a3eb371a5 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:29:05.070423 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0de16ff4-623d-41ff-9fee-ed92683f2e46 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 28, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:29:05.070851 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0de16ff4-623d-41ff-9fee-ed92683f2e46 None None] Checking segment: {'id': '1b04707c-2702-4065-9090-68f189781fea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:29:05.071223 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0de16ff4-623d-41ff-9fee-ed92683f2e46 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:05.071667 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0de16ff4-623d-41ff-9fee-ed92683f2e46 None None] Bound using segment: {'id': '1b04707c-2702-4065-9090-68f189781fea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:29:05.072150 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-0de16ff4-623d-41ff-9fee-ed92683f2e46 None None] Bound port: 004d1246-e318-444f-9c8a-94684730b9cd, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1b04707c-2702-4065-9090-68f189781fea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:29:05.072529 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0de16ff4-623d-41ff-9fee-ed92683f2e46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:05.076406 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-6f45f2b2-5965-4f9d-b48d-5ec93410991e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:29:05.078866 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa720270-806b-412f-b2c7-86a53dc628a6 None None] The sync data for ids ['cad95bae-90ee-4cb5-84cf-346cf111d80d'] in n-d-713301-27 is: [{'id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1723148457', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59'}], 'enable_snat': True}, 'gw_port_id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:29:01Z', 'updated_at': '2021-12-09T22:29:02Z', 'revision_number': 3, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:7a:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4291, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:29:02Z', 'updated_at': '2021-12-09T22:29:03Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:29:05.079070 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f45f2b2-5965-4f9d-b48d-5ec93410991e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:29:05.107593 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f45f2b2-5965-4f9d-b48d-5ec93410991e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=1bb6f982-cf35-4690-ab35-344e10e36ba5,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:05.130727 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f45f2b2-5965-4f9d-b48d-5ec93410991e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:05.152739 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0de16ff4-623d-41ff-9fee-ed92683f2e46 None None] For port 004d1246-e318-444f-9c8a-94684730b9cd, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:29:05.156538 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-0de16ff4-623d-41ff-9fee-ed92683f2e46 None None] For port 004d1246-e318-444f-9c8a-94684730b9cd, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=004d1246-e318-444f-9c8a-94684730b9cd,segment=NetworkSegment(1b04707c-2702-4065-9090-68f189781fea),segment_id=1b04707c-2702-4065-9090-68f189781fea)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:29:05.163701 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0de16ff4-623d-41ff-9fee-ed92683f2e46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:05.226998 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0de16ff4-623d-41ff-9fee-ed92683f2e46 None None] Pushing event updated for resources: {'Port': ['ID=004d1246-e318-444f-9c8a-94684730b9cd,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:05.281242 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f45f2b2-5965-4f9d-b48d-5ec93410991e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:05.626761 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f45f2b2-5965-4f9d-b48d-5ec93410991e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:05.632790 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f45f2b2-5965-4f9d-b48d-5ec93410991e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:05.679100 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8b72480f-9be8-4410-912b-ea71c05e0bfa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:05.713207 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6f45f2b2-5965-4f9d-b48d-5ec93410991e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:05.715104 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f45f2b2-5965-4f9d-b48d-5ec93410991e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=1bb6f982-cf35-4690-ab35-344e10e36ba5,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:05.819275 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6f45f2b2-5965-4f9d-b48d-5ec93410991e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network 605c75e8-98d5-408d-b084-5a5a3eb371a5 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:29:05.820936 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-6f45f2b2-5965-4f9d-b48d-5ec93410991e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:29:06.227696 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6340bcf-abaa-49b6-a78a-0d9d58edb3a5 None None] Network 605c75e8-98d5-408d-b084-5a5a3eb371a5 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:29:06.295388 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6f45f2b2-5965-4f9d-b48d-5ec93410991e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router cad95bae-90ee-4cb5-84cf-346cf111d80d has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:29:06.343526 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-75943d86-0c4b-4e23-a790-e98f758a173c None None] Provisioning complete for port 004d1246-e318-444f-9c8a-94684730b9cd triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:29:06.343928 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-75943d86-0c4b-4e23-a790-e98f758a173c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:06.425741 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6f45f2b2-5965-4f9d-b48d-5ec93410991e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:29:06.430991 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6f45f2b2-5965-4f9d-b48d-5ec93410991e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "PUT /v2.0/routers/cad95bae-90ee-4cb5-84cf-346cf111d80d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6774290 Dec 09 22:29:06.440626 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-75943d86-0c4b-4e23-a790-e98f758a173c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:06.482883 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-75943d86-0c4b-4e23-a790-e98f758a173c None None] For port 004d1246-e318-444f-9c8a-94684730b9cd, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=004d1246-e318-444f-9c8a-94684730b9cd,segment=NetworkSegment(1b04707c-2702-4065-9090-68f189781fea),segment_id=1b04707c-2702-4065-9090-68f189781fea)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:29:06.493863 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-75943d86-0c4b-4e23-a790-e98f758a173c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:06.573145 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75943d86-0c4b-4e23-a790-e98f758a173c None None] Pushing event updated for resources: {'Port': ['ID=004d1246-e318-444f-9c8a-94684730b9cd,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:06.602008 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d2f08748-9030-4a88-bc06-d68b94d94999 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:29:06.656300 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-b68af140-2bd5-4117-8c27-febc115d03b0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2002628898&fields=id&tenant_id=e21dff80515b44aa9f01117603c6de0d HTTP/1.1" status: 200 len: 267 time: 0.0640721 Dec 09 22:29:06.659607 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port d2f08748-9030-4a88-bc06-d68b94d94999 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:29:06.660076 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:06.743799 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-89ee8e28-1228-45b8-9235-1d1a36ecdb2c None None] Provisioning complete for port 004d1246-e318-444f-9c8a-94684730b9cd triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:29:06.744489 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-89ee8e28-1228-45b8-9235-1d1a36ecdb2c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:06.779262 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-9239cbf4-77e6-4e8c-80ca-3543038a02a3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:06.780865 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-9239cbf4-77e6-4e8c-80ca-3543038a02a3 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/networks?id=605c75e8-98d5-408d-b084-5a5a3eb371a5 HTTP/1.1" status: 200 len: 797 time: 0.1164732 Dec 09 22:29:06.785964 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 004d1246-e318-444f-9c8a-94684730b9cd up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:29:06.798242 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-42450320-2e85-4388-827b-d90e0f91575c tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/quotas/e21dff80515b44aa9f01117603c6de0d HTTP/1.1" status: 200 len: 375 time: 0.0110450 Dec 09 22:29:06.880186 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-fc2d97a5-8119-4885-a6ee-54610dd0d8a0 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0698197 Dec 09 22:29:06.890949 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 004d1246-e318-444f-9c8a-94684730b9cd triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:29:06.891696 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:06.925147 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] Sync routers for ids ['cad95bae-90ee-4cb5-84cf-346cf111d80d'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:29:06.940152 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] Routers {'cad95bae-90ee-4cb5-84cf-346cf111d80d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:29:06.940792 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:29:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['cad95bae-90ee-4cb5-84cf-346cf111d80d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:29:06.978591 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:06.979201 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-89ee8e28-1228-45b8-9235-1d1a36ecdb2c None None] Provisioning complete for port 1bb6f982-cf35-4690-ab35-344e10e36ba5 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:29:06.992248 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-89ee8e28-1228-45b8-9235-1d1a36ecdb2c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:07.055809 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-5f5cd3d4-b9ef-46f7-8542-77343aa9a959 service neutron] 10.222.0.13 "GET /v2.0/networks/605c75e8-98d5-408d-b084-5a5a3eb371a5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1708724 Dec 09 22:29:07.076334 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-89ee8e28-1228-45b8-9235-1d1a36ecdb2c None None] Port 1bb6f982-cf35-4690-ab35-344e10e36ba5 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:29:07.110766 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] Set router cad95bae-90ee-4cb5-84cf-346cf111d80d gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:29:07.189773 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-231e5f68-cec8-4f0b-9400-f4f79aa8fc2c service neutron] 10.222.0.13 "GET /v2.0/networks/605c75e8-98d5-408d-b084-5a5a3eb371a5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1327896 Dec 09 22:29:07.198901 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-141e4bfb-fbda-4694-8ce9-eae9e0683e9d None None] Provisioning complete for port 1bb6f982-cf35-4690-ab35-344e10e36ba5 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:29:07.199327 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-141e4bfb-fbda-4694-8ce9-eae9e0683e9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:07.238058 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-141e4bfb-fbda-4694-8ce9-eae9e0683e9d None None] Port 1bb6f982-cf35-4690-ab35-344e10e36ba5 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:29:07.322233 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1723148457', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59'}], 'enable_snat': True}, 'gw_port_id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:29:01Z', 'updated_at': '2021-12-09T22:29:05Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:7a:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4291, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:29:02Z', 'updated_at': '2021-12-09T22:29:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '1bb6f982-cf35-4690-ab35-344e10e36ba5', 'name': '', 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:0e:1c:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'device_owner': 'network:router_interface', 'standard_attr_id': 4294, 'fixed_ips': [{'subnet_id': '77fdf423-e042-4c38-a771-2a2e0eb90831', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:29:04Z', 'updated_at': '2021-12-09T22:29:05Z', 'revision_number': 2, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '77fdf423-e042-4c38-a771-2a2e0eb90831', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:29:07.352770 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] Checking router: cad95bae-90ee-4cb5-84cf-346cf111d80d for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:29:07.353123 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] Updating router cad95bae-90ee-4cb5-84cf-346cf111d80d port 1bb6f982-cf35-4690-ab35-344e10e36ba5 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:29:07.362621 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc8b0767-3705-4db3-bc4a-330210912fb2 req-24ef5a23-fd54-4506-8df7-ac867772318f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 210 time: 0.0276461 Dec 09 22:29:07.383258 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:07.647159 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:07.653249 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:07.708006 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14e8e1b3-6b4b-4d69-b348-bc6a21364c90 None None] Pushing event updated for resources: {'Port': ['ID=1bb6f982-cf35-4690-ab35-344e10e36ba5,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:07.738216 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14e8e1b3-6b4b-4d69-b348-bc6a21364c90 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:29:07.738568 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14e8e1b3-6b4b-4d69-b348-bc6a21364c90 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:29:07.738877 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14e8e1b3-6b4b-4d69-b348-bc6a21364c90 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:29:07.739207 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14e8e1b3-6b4b-4d69-b348-bc6a21364c90 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:29:07.739565 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14e8e1b3-6b4b-4d69-b348-bc6a21364c90 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:29:07.739928 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14e8e1b3-6b4b-4d69-b348-bc6a21364c90 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:29:07.740254 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14e8e1b3-6b4b-4d69-b348-bc6a21364c90 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:29:07.740581 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14e8e1b3-6b4b-4d69-b348-bc6a21364c90 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:29:07.740904 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14e8e1b3-6b4b-4d69-b348-bc6a21364c90 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:29:07.741226 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14e8e1b3-6b4b-4d69-b348-bc6a21364c90 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:29:07.741544 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14e8e1b3-6b4b-4d69-b348-bc6a21364c90 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:29:07.741864 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14e8e1b3-6b4b-4d69-b348-bc6a21364c90 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:29:07.742175 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-14e8e1b3-6b4b-4d69-b348-bc6a21364c90 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:29:07.778320 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] Attempting to bind port 1bb6f982-cf35-4690-ab35-344e10e36ba5 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:29:07.778690 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] Attempting to bind port 1bb6f982-cf35-4690-ab35-344e10e36ba5 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '1b04707c-2702-4065-9090-68f189781fea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:29:07.779049 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] Attempting to bind port 1bb6f982-cf35-4690-ab35-344e10e36ba5 on network 605c75e8-98d5-408d-b084-5a5a3eb371a5 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:29:07.788487 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 28, 40), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:29:07.788890 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] Checking segment: {'id': '1b04707c-2702-4065-9090-68f189781fea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:29:07.789254 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:07.789639 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] Bound using segment: {'id': '1b04707c-2702-4065-9090-68f189781fea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:29:07.790128 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] Bound port: 1bb6f982-cf35-4690-ab35-344e10e36ba5, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1b04707c-2702-4065-9090-68f189781fea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:29:07.790505 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:07.857657 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] For port 1bb6f982-cf35-4690-ab35-344e10e36ba5, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:29:07.861523 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] For port 1bb6f982-cf35-4690-ab35-344e10e36ba5, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=1bb6f982-cf35-4690-ab35-344e10e36ba5,segment=NetworkSegment(1b04707c-2702-4065-9090-68f189781fea),segment_id=1b04707c-2702-4065-9090-68f189781fea)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:29:07.867420 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:07.929146 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] Routers {'cad95bae-90ee-4cb5-84cf-346cf111d80d'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:29:07.929934 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:29:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['cad95bae-90ee-4cb5-84cf-346cf111d80d'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:29:07.964145 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-87cfd956-965f-46cc-8347-c00e55f70c52 None None] Provisioning complete for port 1bb6f982-cf35-4690-ab35-344e10e36ba5 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:29:07.965499 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-87cfd956-965f-46cc-8347-c00e55f70c52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:08.042145 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] Set router cad95bae-90ee-4cb5-84cf-346cf111d80d gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:29:08.060327 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-87cfd956-965f-46cc-8347-c00e55f70c52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:08.077142 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14e8e1b3-6b4b-4d69-b348-bc6a21364c90 None None] Pushing event updated for resources: {'Port': ['ID=1bb6f982-cf35-4690-ab35-344e10e36ba5,revision_number=4']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:08.098844 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-87cfd956-965f-46cc-8347-c00e55f70c52 None None] For port 1bb6f982-cf35-4690-ab35-344e10e36ba5, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=1bb6f982-cf35-4690-ab35-344e10e36ba5,segment=NetworkSegment(1b04707c-2702-4065-9090-68f189781fea),segment_id=1b04707c-2702-4065-9090-68f189781fea)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:29:08.105617 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-87cfd956-965f-46cc-8347-c00e55f70c52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:08.153206 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87cfd956-965f-46cc-8347-c00e55f70c52 None None] Pushing event updated for resources: {'Port': ['ID=1bb6f982-cf35-4690-ab35-344e10e36ba5,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:08.227877 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-562e6049-188f-4342-acb3-b3c453743048 None None] Provisioning complete for port 1bb6f982-cf35-4690-ab35-344e10e36ba5 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:29:08.228707 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-562e6049-188f-4342-acb3-b3c453743048 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:08.285125 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:08.360048 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1723148457', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59'}], 'enable_snat': True}, 'gw_port_id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:29:01Z', 'updated_at': '2021-12-09T22:29:05Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:7a:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4291, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:29:02Z', 'updated_at': '2021-12-09T22:29:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '1bb6f982-cf35-4690-ab35-344e10e36ba5', 'name': '', 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:0e:1c:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'device_owner': 'network:router_interface', 'standard_attr_id': 4294, 'fixed_ips': [{'subnet_id': '77fdf423-e042-4c38-a771-2a2e0eb90831', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:29:04Z', 'updated_at': '2021-12-09T22:29:07Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '77fdf423-e042-4c38-a771-2a2e0eb90831', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:29:08.387882 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a7c45e9-770d-44f1-a380-0e7b284a6933 None None] The sync data for ids ['cad95bae-90ee-4cb5-84cf-346cf111d80d'] in n-d-713301-27 is: [{'id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1723148457', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59'}], 'enable_snat': True}, 'gw_port_id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:29:01Z', 'updated_at': '2021-12-09T22:29:05Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:7a:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4291, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:29:02Z', 'updated_at': '2021-12-09T22:29:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '1bb6f982-cf35-4690-ab35-344e10e36ba5', 'name': '', 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:0e:1c:95', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'device_owner': 'network:router_interface', 'standard_attr_id': 4294, 'fixed_ips': [{'subnet_id': '77fdf423-e042-4c38-a771-2a2e0eb90831', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:29:04Z', 'updated_at': '2021-12-09T22:29:07Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '77fdf423-e042-4c38-a771-2a2e0eb90831', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:29:08.485648 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f584e63-47ed-45d6-9514-0e02b6eb4fe6 req-248ed0ec-3561-4611-8d24-f12a9d7a20ff tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 210 time: 0.0701370 Dec 09 22:29:08.619909 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 1bb6f982-cf35-4690-ab35-344e10e36ba5 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:29:08.671290 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 1bb6f982-cf35-4690-ab35-344e10e36ba5 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:29:08.671699 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:08.757105 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 004d1246-e318-444f-9c8a-94684730b9cd up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:29:08.806920 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 004d1246-e318-444f-9c8a-94684730b9cd triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:29:08.807300 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:09.568497 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b805436a-dc67-420d-bbba-b9eb51915e12 req-cd10616f-2bc0-4988-9e29-655b9e77f4be tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 210 time: 0.0281382 Dec 09 22:29:09.700612 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:10.652659 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1fe412a1-d4b4-4642-a7c2-03db2edfa4ec req-ad47560e-c657-425f-8b3b-10bc3a374633 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 210 time: 0.0258811 Dec 09 22:29:11.759833 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ee85c1a9-d2b5-47ac-b2c4-7b2426b72fc7 req-c6f88512-0702-4209-a26d-8a71cca2abe4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 210 time: 0.0308719 Dec 09 22:29:12.480647 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-f0bbfde6-7d40-4e47-b186-13e6926cd7d5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:12.482179 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-f0bbfde6-7d40-4e47-b186-13e6926cd7d5 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.31 "GET /v2.0/networks?id=605c75e8-98d5-408d-b084-5a5a3eb371a5 HTTP/1.1" status: 200 len: 797 time: 0.1096323 Dec 09 22:29:12.544703 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-e1b7e1f7-1ef3-4add-8bb6-427417186a4b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=e21dff80515b44aa9f01117603c6de0d HTTP/1.1" status: 200 len: 380 time: 0.0531819 Dec 09 22:29:12.554762 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-53432fd9-7e20-468b-8b72-c220c0ea4d01 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'port': {'device_id': 'aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8', 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5', 'admin_state_up': True, 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'security_groups': ['d55fc983-4e08-485c-9436-4f02a9e1dd85']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:29:12.665035 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-53432fd9-7e20-468b-8b72-c220c0ea4d01 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Made reservation on behalf of e21dff80515b44aa9f01117603c6de0d for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:29:12.668719 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-53432fd9-7e20-468b-8b72-c220c0ea4d01 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:12.800115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-53432fd9-7e20-468b-8b72-c220c0ea4d01 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Allocated IP 172.20.0.10 (605c75e8-98d5-408d-b084-5a5a3eb371a5/77fdf423-e042-4c38-a771-2a2e0eb90831/876ff4b0-b86b-4101-a775-67f5d43f25c5) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:29:12.863931 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0b17ea26-fc79-4822-a4f6-3712c3b89d17 req-c77f6f11-4d8e-4513-b062-c61d4d920bab tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 210 time: 0.0264831 Dec 09 22:29:12.946104 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-53432fd9-7e20-468b-8b72-c220c0ea4d01 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:12.983756 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-53432fd9-7e20-468b-8b72-c220c0ea4d01 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:13.025517 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-53432fd9-7e20-468b-8b72-c220c0ea4d01 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network 605c75e8-98d5-408d-b084-5a5a3eb371a5 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:29:13.028710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-53432fd9-7e20-468b-8b72-c220c0ea4d01 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:29:13.034348 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-53432fd9-7e20-468b-8b72-c220c0ea4d01 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:29:13.040716 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53432fd9-7e20-468b-8b72-c220c0ea4d01 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=876ff4b0-b86b-4101-a775-67f5d43f25c5,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:13.088751 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-53432fd9-7e20-468b-8b72-c220c0ea4d01 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:13.089389 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-53432fd9-7e20-468b-8b72-c220c0ea4d01 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:13.109423 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-53432fd9-7e20-468b-8b72-c220c0ea4d01 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5581789 Dec 09 22:29:13.122387 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-ff20a06e-9604-477f-a52f-3d46837e1aa5 service neutron] Request body: {'port': {'device_id': 'aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:29:13.191660 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-ff20a06e-9604-477f-a52f-3d46837e1aa5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:13.285156 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-defe5f27-1eb5-4839-a59f-b5329e76aa1a None None] Provisioning complete for port 876ff4b0-b86b-4101-a775-67f5d43f25c5 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:29:13.285793 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-defe5f27-1eb5-4839-a59f-b5329e76aa1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:13.320434 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-defe5f27-1eb5-4839-a59f-b5329e76aa1a None None] Port 876ff4b0-b86b-4101-a775-67f5d43f25c5 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:29:13.462701 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-ff20a06e-9604-477f-a52f-3d46837e1aa5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 876ff4b0-b86b-4101-a775-67f5d43f25c5 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:29:13.471010 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-ff20a06e-9604-477f-a52f-3d46837e1aa5 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:13.483926 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-ff20a06e-9604-477f-a52f-3d46837e1aa5 service neutron] Transition to ACTIVE for port object 876ff4b0-b86b-4101-a775-67f5d43f25c5 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:29:13.490771 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-ff20a06e-9604-477f-a52f-3d46837e1aa5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:13.548134 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff20a06e-9604-477f-a52f-3d46837e1aa5 service neutron] Pushing event updated for resources: {'Port': ['ID=876ff4b0-b86b-4101-a775-67f5d43f25c5,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:13.622474 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-ff20a06e-9604-477f-a52f-3d46837e1aa5 service neutron] Attempting to bind port 876ff4b0-b86b-4101-a775-67f5d43f25c5 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:29:13.622811 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-ff20a06e-9604-477f-a52f-3d46837e1aa5 service neutron] Attempting to bind port 876ff4b0-b86b-4101-a775-67f5d43f25c5 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '1b04707c-2702-4065-9090-68f189781fea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:29:13.623199 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-ff20a06e-9604-477f-a52f-3d46837e1aa5 service neutron] Attempting to bind port 876ff4b0-b86b-4101-a775-67f5d43f25c5 on network 605c75e8-98d5-408d-b084-5a5a3eb371a5 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:29:13.628012 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-ff20a06e-9604-477f-a52f-3d46837e1aa5 service neutron] Port 876ff4b0-b86b-4101-a775-67f5d43f25c5 on network 605c75e8-98d5-408d-b084-5a5a3eb371a5 not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:29:13.628339 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-ff20a06e-9604-477f-a52f-3d46837e1aa5 service neutron] Attempting to bind port 876ff4b0-b86b-4101-a775-67f5d43f25c5 on network 605c75e8-98d5-408d-b084-5a5a3eb371a5 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:29:13.633699 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-ff20a06e-9604-477f-a52f-3d46837e1aa5 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 28, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:29:13.634040 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-ff20a06e-9604-477f-a52f-3d46837e1aa5 service neutron] Checking segment: {'id': '1b04707c-2702-4065-9090-68f189781fea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:29:13.634428 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-ff20a06e-9604-477f-a52f-3d46837e1aa5 service neutron] Bound using segment: {'id': '1b04707c-2702-4065-9090-68f189781fea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:29:13.634850 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-ff20a06e-9604-477f-a52f-3d46837e1aa5 service neutron] Bound port: 876ff4b0-b86b-4101-a775-67f5d43f25c5, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1b04707c-2702-4065-9090-68f189781fea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:29:13.635212 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-ff20a06e-9604-477f-a52f-3d46837e1aa5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:13.700929 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-ff20a06e-9604-477f-a52f-3d46837e1aa5 service neutron] For port 876ff4b0-b86b-4101-a775-67f5d43f25c5, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:29:13.704392 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-ff20a06e-9604-477f-a52f-3d46837e1aa5 service neutron] For port 876ff4b0-b86b-4101-a775-67f5d43f25c5, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=876ff4b0-b86b-4101-a775-67f5d43f25c5,segment=NetworkSegment(1b04707c-2702-4065-9090-68f189781fea),segment_id=1b04707c-2702-4065-9090-68f189781fea)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:29:13.709359 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-ff20a06e-9604-477f-a52f-3d46837e1aa5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:13.743339 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-ff20a06e-9604-477f-a52f-3d46837e1aa5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:13.743754 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-ff20a06e-9604-477f-a52f-3d46837e1aa5 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:13.745100 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-ff20a06e-9604-477f-a52f-3d46837e1aa5 service neutron] 10.222.0.31 "PUT /v2.0/ports/876ff4b0-b86b-4101-a775-67f5d43f25c5 HTTP/1.1" status: 200 len: 1093 time: 0.6273754 Dec 09 22:29:13.745547 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8', 'tag': '876ff4b0-b86b-4101-a775-67f5d43f25c5'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:29:13.747898 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4efe6764-6452-4361-978e-35d2fee0eb26" -d '{"events": [{"name": "network-changed", "server_uuid": "aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8", "tag": "876ff4b0-b86b-4101-a775-67f5d43f25c5"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:29:13.776415 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff20a06e-9604-477f-a52f-3d46837e1aa5 service neutron] Pushing event updated for resources: {'Port': ['ID=876ff4b0-b86b-4101-a775-67f5d43f25c5,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:13.795024 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:29:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7a20aca7-ca0c-4f16-a242-daa6b630ac63 x-openstack-request-id: req-7a20aca7-ca0c-4f16-a242-daa6b630ac63 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:29:13.795024 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8", "tag": "876ff4b0-b86b-4101-a775-67f5d43f25c5", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:29:13.795024 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-7a20aca7-ca0c-4f16-a242-daa6b630ac63 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:29:13.795024 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8', 'tag': '876ff4b0-b86b-4101-a775-67f5d43f25c5', 'status': 'completed', 'code': 200} Dec 09 22:29:13.844800 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-84c4bbc2-9aa7-4654-a28a-6e7788f4f054 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:13.846259 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-84c4bbc2-9aa7-4654-a28a-6e7788f4f054 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 1096 time: 0.0455940 Dec 09 22:29:13.896382 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-5c4309b4-d675-414e-8cb5-c2786bd55c11 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=876ff4b0-b86b-4101-a775-67f5d43f25c5 HTTP/1.1" status: 200 len: 217 time: 0.0402963 Dec 09 22:29:13.950427 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-41427c4b-45dc-4f23-9f75-4ea07d2a4cf8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:13.952539 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-41427c4b-45dc-4f23-9f75-4ea07d2a4cf8 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=77fdf423-e042-4c38-a771-2a2e0eb90831 HTTP/1.1" status: 200 len: 834 time: 0.0483830 Dec 09 22:29:13.992938 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18629255-2306-47be-b6e2-6b56a92a0d1d req-2192cda3-80bf-4a1a-86c6-43487b4ceeca tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:13.994533 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-18629255-2306-47be-b6e2-6b56a92a0d1d req-2192cda3-80bf-4a1a-86c6-43487b4ceeca tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 944 time: 0.0554678 Dec 09 22:29:14.000684 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-bd00a28e-49e4-4e80-9861-67ac0e820935 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:14.002222 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-bd00a28e-49e4-4e80-9861-67ac0e820935 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=605c75e8-98d5-408d-b084-5a5a3eb371a5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0430706 Dec 09 22:29:14.043548 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-18629255-2306-47be-b6e2-6b56a92a0d1d req-40a7f6de-6b58-488e-a191-896f44bf44b4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d55fc983-4e08-485c-9436-4f02a9e1dd85&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429165 Dec 09 22:29:14.101766 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-9c300cfa-e2e4-46c6-bc85-a573b6b122e1 service neutron] 10.222.0.31 "GET /v2.0/networks/605c75e8-98d5-408d-b084-5a5a3eb371a5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0916169 Dec 09 22:29:14.199811 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-51a0c06e-e5d8-4af4-ab5a-a90ad1ade2de req-d1b0a092-e1a3-4cb6-9367-82d0ca24abc8 service neutron] 10.222.0.31 "GET /v2.0/networks/605c75e8-98d5-408d-b084-5a5a3eb371a5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0909603 Dec 09 22:29:14.293216 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4efe6764-6452-4361-978e-35d2fee0eb26 req-7178d58c-f020-4d3f-baaa-1c1da2dadcb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:14.294843 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4efe6764-6452-4361-978e-35d2fee0eb26 req-7178d58c-f020-4d3f-baaa-1c1da2dadcb3 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 1096 time: 0.0484626 Dec 09 22:29:14.386656 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4efe6764-6452-4361-978e-35d2fee0eb26 req-bf709c68-1408-47a8-8640-4ec2f1146a9b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:14.388224 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4efe6764-6452-4361-978e-35d2fee0eb26 req-bf709c68-1408-47a8-8640-4ec2f1146a9b service neutron] 10.222.0.31 "GET /v2.0/networks?id=605c75e8-98d5-408d-b084-5a5a3eb371a5 HTTP/1.1" status: 200 len: 898 time: 0.0867002 Dec 09 22:29:14.434288 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4efe6764-6452-4361-978e-35d2fee0eb26 req-d1155b1a-504f-4472-b41b-7af472d856e2 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=876ff4b0-b86b-4101-a775-67f5d43f25c5 HTTP/1.1" status: 200 len: 217 time: 0.0390291 Dec 09 22:29:14.483674 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4efe6764-6452-4361-978e-35d2fee0eb26 req-9e3a09e5-b1e3-45ba-8efc-c5f8775eeda5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:14.485191 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4efe6764-6452-4361-978e-35d2fee0eb26 req-9e3a09e5-b1e3-45ba-8efc-c5f8775eeda5 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=77fdf423-e042-4c38-a771-2a2e0eb90831 HTTP/1.1" status: 200 len: 834 time: 0.0439317 Dec 09 22:29:14.533911 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4efe6764-6452-4361-978e-35d2fee0eb26 req-5a6d6813-6aaa-4436-9f64-be07d2699bd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:14.535429 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4efe6764-6452-4361-978e-35d2fee0eb26 req-5a6d6813-6aaa-4436-9f64-be07d2699bd4 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=605c75e8-98d5-408d-b084-5a5a3eb371a5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0428195 Dec 09 22:29:14.635404 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4efe6764-6452-4361-978e-35d2fee0eb26 req-807488ef-d26c-4c6a-8fff-2f4b4e4e66e7 service neutron] 10.222.0.31 "GET /v2.0/networks/605c75e8-98d5-408d-b084-5a5a3eb371a5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0907662 Dec 09 22:29:14.726684 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4efe6764-6452-4361-978e-35d2fee0eb26 req-ce896f68-e7c6-4cbf-8d94-d531f2ca9c27 service neutron] 10.222.0.31 "GET /v2.0/networks/605c75e8-98d5-408d-b084-5a5a3eb371a5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0832202 Dec 09 22:29:15.168255 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de274e8e-93ea-47f1-8600-a1e201b32cc8 req-09324437-f88f-4468-96ce-5a95e3b841ef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:15.169786 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de274e8e-93ea-47f1-8600-a1e201b32cc8 req-09324437-f88f-4468-96ce-5a95e3b841ef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 944 time: 0.0516901 Dec 09 22:29:15.227185 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-de274e8e-93ea-47f1-8600-a1e201b32cc8 req-d36eeb8e-f3f2-48f8-9085-ab46c0a72f0e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d55fc983-4e08-485c-9436-4f02a9e1dd85&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483840 Dec 09 22:29:16.358548 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59379a4d-a610-4d61-bec0-19c8620c82c3 req-53f5c7ec-2f7a-4f70-8137-27d6063d1805 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:16.360079 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-59379a4d-a610-4d61-bec0-19c8620c82c3 req-53f5c7ec-2f7a-4f70-8137-27d6063d1805 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 944 time: 0.0587025 Dec 09 22:29:16.412486 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-59379a4d-a610-4d61-bec0-19c8620c82c3 req-0ed1dae2-fe8f-439d-8c41-ec245065b170 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d55fc983-4e08-485c-9436-4f02a9e1dd85&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462081 Dec 09 22:29:17.533607 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-836cda16-8b34-4a7f-a14e-f9615b7d9751 req-38a9f184-b1c0-4931-94ac-1defb7248083 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:17.535105 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-836cda16-8b34-4a7f-a14e-f9615b7d9751 req-38a9f184-b1c0-4931-94ac-1defb7248083 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 944 time: 0.0521772 Dec 09 22:29:17.591652 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-836cda16-8b34-4a7f-a14e-f9615b7d9751 req-28ea6f58-49b0-4a43-8fd8-ad9c41e96bc6 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d55fc983-4e08-485c-9436-4f02a9e1dd85&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0503213 Dec 09 22:29:18.154282 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 876ff4b0-b86b-4101-a775-67f5d43f25c5 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:29:18.258906 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 876ff4b0-b86b-4101-a775-67f5d43f25c5, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=876ff4b0-b86b-4101-a775-67f5d43f25c5,segment=NetworkSegment(1b04707c-2702-4065-9090-68f189781fea),segment_id=1b04707c-2702-4065-9090-68f189781fea)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:29:18.270157 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '876ff4b0-b86b-4101-a775-67f5d43f25c5', 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5', 'port_id': '876ff4b0-b86b-4101-a775-67f5d43f25c5', 'mac_address': 'fa:16:3e:0f:cd:47', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 148, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '77fdf423-e042-4c38-a771-2a2e0eb90831', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:29:18.308001 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:18.321550 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 876ff4b0-b86b-4101-a775-67f5d43f25c5 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:29:18.340507 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 876ff4b0-b86b-4101-a775-67f5d43f25c5, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=876ff4b0-b86b-4101-a775-67f5d43f25c5,segment=NetworkSegment(1b04707c-2702-4065-9090-68f189781fea),segment_id=1b04707c-2702-4065-9090-68f189781fea)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:29:18.345685 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:18.398015 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=876ff4b0-b86b-4101-a775-67f5d43f25c5,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:18.583407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['876ff4b0-b86b-4101-a775-67f5d43f25c5'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:29:18.723539 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5eeea95-b2ac-49c7-b4cc-52ff374da4ac req-86bcb55a-0108-4f71-b14f-a81c1ec79c57 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:18.725016 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b5eeea95-b2ac-49c7-b4cc-52ff374da4ac req-86bcb55a-0108-4f71-b14f-a81c1ec79c57 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 945 time: 0.0560150 Dec 09 22:29:18.774351 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b5eeea95-b2ac-49c7-b4cc-52ff374da4ac req-4d40de92-4793-4928-a04f-d819e2a5c760 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d55fc983-4e08-485c-9436-4f02a9e1dd85&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432518 Dec 09 22:29:19.906027 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9047c01b-4bbb-4333-859a-3fabe78be2d8 req-23b8ae5a-59db-49f8-a173-1ea9eb92655d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:19.907529 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9047c01b-4bbb-4333-859a-3fabe78be2d8 req-23b8ae5a-59db-49f8-a173-1ea9eb92655d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 945 time: 0.0556312 Dec 09 22:29:19.958277 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9047c01b-4bbb-4333-859a-3fabe78be2d8 req-b1139697-c090-4719-8a03-e898cee34ebf tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d55fc983-4e08-485c-9436-4f02a9e1dd85&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445130 Dec 09 22:29:20.170335 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 876ff4b0-b86b-4101-a775-67f5d43f25c5 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:29:20.239812 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 876ff4b0-b86b-4101-a775-67f5d43f25c5 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:29:20.244482 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 876ff4b0-b86b-4101-a775-67f5d43f25c5 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:29:20.244937 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:20.322053 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:20.345004 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '876ff4b0-b86b-4101-a775-67f5d43f25c5'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:29:20.347271 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-39317c02-b121-4072-a163-236b23cc5194" -d '{"events": [{"server_uuid": "aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8", "name": "network-vif-plugged", "status": "completed", "tag": "876ff4b0-b86b-4101-a775-67f5d43f25c5"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:29:20.362799 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 876ff4b0-b86b-4101-a775-67f5d43f25c5, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=876ff4b0-b86b-4101-a775-67f5d43f25c5,segment=NetworkSegment(1b04707c-2702-4065-9090-68f189781fea),segment_id=1b04707c-2702-4065-9090-68f189781fea)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:29:20.368347 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:20.552112 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99397265-ead6-4730-a0a7-82f02c14e8ad req-a5322232-5c2a-465b-aced-72ae28dd7c81 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:20.553800 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-99397265-ead6-4730-a0a7-82f02c14e8ad req-a5322232-5c2a-465b-aced-72ae28dd7c81 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 1098 time: 0.0438654 Dec 09 22:29:20.558986 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:29:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d9f3176a-647a-4bbc-996d-9d93a3a245ed x-openstack-request-id: req-d9f3176a-647a-4bbc-996d-9d93a3a245ed {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:29:20.559283 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8", "name": "network-vif-plugged", "status": "completed", "tag": "876ff4b0-b86b-4101-a775-67f5d43f25c5", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:29:20.559572 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-d9f3176a-647a-4bbc-996d-9d93a3a245ed {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:29:20.559992 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '876ff4b0-b86b-4101-a775-67f5d43f25c5', 'code': 200} Dec 09 22:29:20.584942 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=876ff4b0-b86b-4101-a775-67f5d43f25c5,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:20.605414 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-99397265-ead6-4730-a0a7-82f02c14e8ad req-e2edfcc5-ffd5-4d96-adbd-c506a3406ab6 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=d55fc983-4e08-485c-9436-4f02a9e1dd85&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439479 Dec 09 22:29:21.104063 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-935992fd-9eb5-4779-9baa-98199a8f4a82 req-94ed7aef-2e26-4946-b1b6-9b7537aa5680 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:21.105435 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-935992fd-9eb5-4779-9baa-98199a8f4a82 req-94ed7aef-2e26-4946-b1b6-9b7537aa5680 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 946 time: 0.0581002 Dec 09 22:29:21.161765 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-935992fd-9eb5-4779-9baa-98199a8f4a82 req-9909a02e-743a-4fe2-a290-3d84ebf56de1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d55fc983-4e08-485c-9436-4f02a9e1dd85&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0500696 Dec 09 22:29:22.288515 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc5372c8-fa96-4338-922f-1493d37d3d93 req-de2fc747-1115-4685-a114-cddff7a6b8e7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:22.289984 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc5372c8-fa96-4338-922f-1493d37d3d93 req-de2fc747-1115-4685-a114-cddff7a6b8e7 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 946 time: 0.0512264 Dec 09 22:29:22.339584 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bc5372c8-fa96-4338-922f-1493d37d3d93 req-0fdeb444-5b02-4e92-b1f4-c76b21873749 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d55fc983-4e08-485c-9436-4f02a9e1dd85&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432787 Dec 09 22:29:22.457832 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38a8a2bf-3c5e-435d-ac16-d1398496e559 req-1974a7bc-fdb1-4e1a-a94c-845a1fc8bfcf tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:22.459201 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38a8a2bf-3c5e-435d-ac16-d1398496e559 req-1974a7bc-fdb1-4e1a-a94c-845a1fc8bfcf tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 946 time: 0.0513198 Dec 09 22:29:22.508448 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-38a8a2bf-3c5e-435d-ac16-d1398496e559 req-520a2293-cfb7-4255-a12f-1fa64aa76b9e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d55fc983-4e08-485c-9436-4f02a9e1dd85&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430124 Dec 09 22:29:22.537267 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34814) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:29:22.589387 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-309825e1-da46-41a9-a471-a2a8f18a1407 tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:22.590905 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-309825e1-da46-41a9-a471-a2a8f18a1407 tempest-TestNetworkAdvancedServerOps-2114518303 tempest-TestNetworkAdvancedServerOps-2114518303-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 1093 time: 0.0526841 Dec 09 22:29:22.594150 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34816) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:29:22.598446 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-a5625cf5-a97c-403e-b703-d813d3b1f5e4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': '876ff4b0-b86b-4101-a775-67f5d43f25c5', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ip_address': '172.20.0.10'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:29:22.622154 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a5625cf5-a97c-403e-b703-d813d3b1f5e4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:22.730955 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a5625cf5-a97c-403e-b703-d813d3b1f5e4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:23.150563 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-a5625cf5-a97c-403e-b703-d813d3b1f5e4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Allocated IP 172.25.3.61 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/ac9a05f4-2598-4804-8c0d-eaeb863fe6e0) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:29:23.262319 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a5625cf5-a97c-403e-b703-d813d3b1f5e4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:23.303342 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a5625cf5-a97c-403e-b703-d813d3b1f5e4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:23.331852 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:29:23.340376 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5625cf5-a97c-403e-b703-d813d3b1f5e4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:29:23.343328 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-a5625cf5-a97c-403e-b703-d813d3b1f5e4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:29:23.349353 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5625cf5-a97c-403e-b703-d813d3b1f5e4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:29:23.354773 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5625cf5-a97c-403e-b703-d813d3b1f5e4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=ac9a05f4-2598-4804-8c0d-eaeb863fe6e0,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:23.713857 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a5625cf5-a97c-403e-b703-d813d3b1f5e4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:23.781992 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a5625cf5-a97c-403e-b703-d813d3b1f5e4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:23.948173 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a5625cf5-a97c-403e-b703-d813d3b1f5e4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:23.955845 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a5625cf5-a97c-403e-b703-d813d3b1f5e4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:24.026263 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5625cf5-a97c-403e-b703-d813d3b1f5e4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event updated for resources: {'Port': ['ID=ac9a05f4-2598-4804-8c0d-eaeb863fe6e0,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:29:24.036550 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a5625cf5-a97c-403e-b703-d813d3b1f5e4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:24.145416 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-a5625cf5-a97c-403e-b703-d813d3b1f5e4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Floating IP 6ef0dfb2-9c6a-4972-b564-24e54d4e6545 associated. External IP: 172.25.3.61, port: 876ff4b0-b86b-4101-a775-67f5d43f25c5. Dec 09 22:29:24.352519 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a5625cf5-a97c-403e-b703-d813d3b1f5e4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router cad95bae-90ee-4cb5-84cf-346cf111d80d has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:29:24.477958 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a5625cf5-a97c-403e-b703-d813d3b1f5e4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:29:24.488548 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9bbaf278-3546-4f77-8d1d-10bf000d5771 None None] Sync routers for ids ['cad95bae-90ee-4cb5-84cf-346cf111d80d'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:29:24.498771 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-a5625cf5-a97c-403e-b703-d813d3b1f5e4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:24.499643 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9bbaf278-3546-4f77-8d1d-10bf000d5771 None None] Routers {'cad95bae-90ee-4cb5-84cf-346cf111d80d'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:29:24.500356 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-9bbaf278-3546-4f77-8d1d-10bf000d5771 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:29:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['cad95bae-90ee-4cb5-84cf-346cf111d80d'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:29:24.525906 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-a5625cf5-a97c-403e-b703-d813d3b1f5e4 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.9307601 Dec 09 22:29:24.526548 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8', 'tag': '876ff4b0-b86b-4101-a775-67f5d43f25c5'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:29:24.529732 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cabc9ac7-455e-49e0-bb77-d9c4eef0dfc7" -d '{"events": [{"name": "network-changed", "server_uuid": "aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8", "tag": "876ff4b0-b86b-4101-a775-67f5d43f25c5"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:29:24.606295 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-9bbaf278-3546-4f77-8d1d-10bf000d5771 None None] Set router cad95bae-90ee-4cb5-84cf-346cf111d80d gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:29:24.626683 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdeee136-e394-40c4-9042-52ad407a8797 req-4aecd04a-498c-466e-b743-d52796db89bf tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:24.628209 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cdeee136-e394-40c4-9042-52ad407a8797 req-4aecd04a-498c-466e-b743-d52796db89bf tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 946 time: 0.0498662 Dec 09 22:29:24.680909 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cdeee136-e394-40c4-9042-52ad407a8797 req-11e111b5-5bb6-42ca-b38a-8f43a8dfe5f2 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d55fc983-4e08-485c-9436-4f02a9e1dd85&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465238 Dec 09 22:29:24.703779 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34822) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:29:24.742270 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:29:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2f8d44f2-7502-402f-a5b5-cc5a2053f030 x-openstack-request-id: req-2f8d44f2-7502-402f-a5b5-cc5a2053f030 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:29:24.742557 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8", "tag": "876ff4b0-b86b-4101-a775-67f5d43f25c5", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:29:24.742812 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-2f8d44f2-7502-402f-a5b5-cc5a2053f030 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:29:24.743220 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8', 'tag': '876ff4b0-b86b-4101-a775-67f5d43f25c5', 'status': 'completed', 'code': 200} Dec 09 22:29:24.775019 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f398f56f-1a44-4567-adc6-804977221965 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/floatingips/6ef0dfb2-9c6a-4972-b564-24e54d4e6545 HTTP/1.1" status: 200 len: 991 time: 0.0700376 Dec 09 22:29:24.800556 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cabc9ac7-455e-49e0-bb77-d9c4eef0dfc7 req-bb36cb19-0306-4809-9fd2-535d9b66cdfc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:24.802102 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cabc9ac7-455e-49e0-bb77-d9c4eef0dfc7 req-bb36cb19-0306-4809-9fd2-535d9b66cdfc service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 1098 time: 0.0424712 Dec 09 22:29:24.841262 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-9bbaf278-3546-4f77-8d1d-10bf000d5771 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1723148457', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59'}], 'enable_snat': True}, 'gw_port_id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:29:01Z', 'updated_at': '2021-12-09T22:29:05Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:7a:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4291, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:29:02Z', 'updated_at': '2021-12-09T22:29:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '6ef0dfb2-9c6a-4972-b564-24e54d4e6545', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'floating_ip_address': '172.25.3.61', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'port_id': '876ff4b0-b86b-4101-a775-67f5d43f25c5', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 4297, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5', 'mac_address': 'fa:16:3e:0f:cd:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:29:23Z', 'updated_at': '2021-12-09T22:29:23Z', 'revision_number': 0, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1bb6f982-cf35-4690-ab35-344e10e36ba5', 'name': '', 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:0e:1c:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'device_owner': 'network:router_interface', 'standard_attr_id': 4294, 'fixed_ips': [{'subnet_id': '77fdf423-e042-4c38-a771-2a2e0eb90831', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:29:04Z', 'updated_at': '2021-12-09T22:29:08Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '77fdf423-e042-4c38-a771-2a2e0eb90831', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:29:24.867876 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9bbaf278-3546-4f77-8d1d-10bf000d5771 None None] Checking router: cad95bae-90ee-4cb5-84cf-346cf111d80d for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:29:24.876718 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9bbaf278-3546-4f77-8d1d-10bf000d5771 None None] Routers {'cad95bae-90ee-4cb5-84cf-346cf111d80d'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:29:24.877327 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-9bbaf278-3546-4f77-8d1d-10bf000d5771 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:29:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['cad95bae-90ee-4cb5-84cf-346cf111d80d'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:29:24.893334 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cabc9ac7-455e-49e0-bb77-d9c4eef0dfc7 req-ccee917a-6ee9-4055-8412-f7c3c666a877 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:24.894858 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cabc9ac7-455e-49e0-bb77-d9c4eef0dfc7 req-ccee917a-6ee9-4055-8412-f7c3c666a877 service neutron] 10.222.0.31 "GET /v2.0/networks?id=605c75e8-98d5-408d-b084-5a5a3eb371a5 HTTP/1.1" status: 200 len: 898 time: 0.0859406 Dec 09 22:29:24.968023 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cabc9ac7-455e-49e0-bb77-d9c4eef0dfc7 req-4d180245-917d-4d63-b822-a0c3be3fe9f2 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=876ff4b0-b86b-4101-a775-67f5d43f25c5 HTTP/1.1" status: 200 len: 999 time: 0.0652852 Dec 09 22:29:24.983604 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-9bbaf278-3546-4f77-8d1d-10bf000d5771 None None] Set router cad95bae-90ee-4cb5-84cf-346cf111d80d gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:29:25.018234 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cabc9ac7-455e-49e0-bb77-d9c4eef0dfc7 req-9be9e6c2-1435-4e36-89ab-878cfa462d20 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:25.019778 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cabc9ac7-455e-49e0-bb77-d9c4eef0dfc7 req-9be9e6c2-1435-4e36-89ab-878cfa462d20 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=77fdf423-e042-4c38-a771-2a2e0eb90831 HTTP/1.1" status: 200 len: 834 time: 0.0454357 Dec 09 22:29:25.067083 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cabc9ac7-455e-49e0-bb77-d9c4eef0dfc7 req-7e0b719d-6b26-4e96-b57e-2bdd548b90ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:25.068669 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cabc9ac7-455e-49e0-bb77-d9c4eef0dfc7 req-7e0b719d-6b26-4e96-b57e-2bdd548b90ef service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=605c75e8-98d5-408d-b084-5a5a3eb371a5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0420873 Dec 09 22:29:25.162008 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cabc9ac7-455e-49e0-bb77-d9c4eef0dfc7 req-14b1ac9a-4162-4673-9964-e0c777fb3bec service neutron] 10.222.0.31 "GET /v2.0/networks/605c75e8-98d5-408d-b084-5a5a3eb371a5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0853472 Dec 09 22:29:25.214896 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-9bbaf278-3546-4f77-8d1d-10bf000d5771 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1723148457', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59'}], 'enable_snat': True}, 'gw_port_id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:29:01Z', 'updated_at': '2021-12-09T22:29:05Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:7a:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4291, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:29:02Z', 'updated_at': '2021-12-09T22:29:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '6ef0dfb2-9c6a-4972-b564-24e54d4e6545', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'floating_ip_address': '172.25.3.61', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'port_id': '876ff4b0-b86b-4101-a775-67f5d43f25c5', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 4297, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5', 'mac_address': 'fa:16:3e:0f:cd:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:29:23Z', 'updated_at': '2021-12-09T22:29:23Z', 'revision_number': 0, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1bb6f982-cf35-4690-ab35-344e10e36ba5', 'name': '', 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:0e:1c:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'device_owner': 'network:router_interface', 'standard_attr_id': 4294, 'fixed_ips': [{'subnet_id': '77fdf423-e042-4c38-a771-2a2e0eb90831', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:29:04Z', 'updated_at': '2021-12-09T22:29:08Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '77fdf423-e042-4c38-a771-2a2e0eb90831', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:29:25.243198 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9bbaf278-3546-4f77-8d1d-10bf000d5771 None None] The sync data for ids ['cad95bae-90ee-4cb5-84cf-346cf111d80d'] in n-d-713301-27 is: [{'id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1723148457', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59'}], 'enable_snat': True}, 'gw_port_id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:29:01Z', 'updated_at': '2021-12-09T22:29:05Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:7a:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4291, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:29:02Z', 'updated_at': '2021-12-09T22:29:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '6ef0dfb2-9c6a-4972-b564-24e54d4e6545', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'floating_ip_address': '172.25.3.61', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'port_id': '876ff4b0-b86b-4101-a775-67f5d43f25c5', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 4297, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5', 'mac_address': 'fa:16:3e:0f:cd:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:29:23Z', 'updated_at': '2021-12-09T22:29:23Z', 'revision_number': 0, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1bb6f982-cf35-4690-ab35-344e10e36ba5', 'name': '', 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:0e:1c:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'device_owner': 'network:router_interface', 'standard_attr_id': 4294, 'fixed_ips': [{'subnet_id': '77fdf423-e042-4c38-a771-2a2e0eb90831', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:29:04Z', 'updated_at': '2021-12-09T22:29:08Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '77fdf423-e042-4c38-a771-2a2e0eb90831', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:29:25.260898 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cabc9ac7-455e-49e0-bb77-d9c4eef0dfc7 req-8a1e38b4-4877-4535-9530-ab8a18b37155 service neutron] 10.222.0.31 "GET /v2.0/networks/605c75e8-98d5-408d-b084-5a5a3eb371a5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0910506 Dec 09 22:29:25.444440 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-509b7606-7365-4de5-83f8-e07bbf4a5f05 None None] New status for floating IP 6ef0dfb2-9c6a-4972-b564-24e54d4e6545: ACTIVE {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:29:25.779123 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34824) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:29:25.846523 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-021cdf05-d93d-4989-bf94-c9f448db0424 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/floatingips/6ef0dfb2-9c6a-4972-b564-24e54d4e6545 HTTP/1.1" status: 200 len: 993 time: 0.0660884 Dec 09 22:29:27.784675 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:27.883428 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:33.071528 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7d1de160-1418-4ada-a09c-33d46fa06774 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:34.124856 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-1ce1a4e2-a92a-4d87-b46b-b71363490f9a req-cfc3fba3-6a92-4375-a630-c5d6b4e4a589 service neutron] (103437) timed out ('10.222.0.10', 64137) {{(pid=103437) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 09 22:29:35.678184 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-15b11990-c586-4474-9474-95eae1b9c8ec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:36.927957 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:38.261430 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:39.718461 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:57.208156 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35e0285c-3753-49f3-8fbf-f4fe9c01cfa9 req-540c1ca8-7a70-4947-88b5-974b11fa323e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:57.209634 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35e0285c-3753-49f3-8fbf-f4fe9c01cfa9 req-540c1ca8-7a70-4947-88b5-974b11fa323e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 946 time: 0.0502090 Dec 09 22:29:57.264015 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-35e0285c-3753-49f3-8fbf-f4fe9c01cfa9 req-7724ba70-bbe6-4542-b5ea-c129d79cc2bf tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d55fc983-4e08-485c-9436-4f02a9e1dd85&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448060 Dec 09 22:29:57.799355 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:57.889160 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:29:58.391094 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea640152-a323-4830-937b-49ba12ac8d77 req-dbf36d2a-943a-4770-9905-afbaa950f8cd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:58.392611 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea640152-a323-4830-937b-49ba12ac8d77 req-dbf36d2a-943a-4770-9905-afbaa950f8cd tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 946 time: 0.0535116 Dec 09 22:29:58.451523 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ea640152-a323-4830-937b-49ba12ac8d77 req-3615f2e4-51d9-4e72-a44f-58f96b9d4fd1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d55fc983-4e08-485c-9436-4f02a9e1dd85&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0496697 Dec 09 22:29:58.474784 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34842) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:29:58.544708 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-14a27300-8541-4340-9e30-79598bbac5ce tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/floatingips/6ef0dfb2-9c6a-4972-b564-24e54d4e6545 HTTP/1.1" status: 200 len: 993 time: 0.0686624 Dec 09 22:29:59.832761 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-228ac43a-49c1-4cec-9d07-62f529ca9d78 req-98ebe50d-e125-4d1a-a7d4-6f6a6df9d057 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:59.834310 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-228ac43a-49c1-4cec-9d07-62f529ca9d78 req-98ebe50d-e125-4d1a-a7d4-6f6a6df9d057 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 946 time: 0.0544565 Dec 09 22:29:59.853936 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ea87ea-e80d-43d5-93f2-7e8416532d44 req-748cc291-77d0-4254-972a-3a8f0f25be32 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:59.855468 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e2ea87ea-e80d-43d5-93f2-7e8416532d44 req-748cc291-77d0-4254-972a-3a8f0f25be32 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 1098 time: 0.0420885 Dec 09 22:29:59.884549 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-228ac43a-49c1-4cec-9d07-62f529ca9d78 req-d0e73845-a264-4cf5-b7d7-877dc8ffa4ad tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d55fc983-4e08-485c-9436-4f02a9e1dd85&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440009 Dec 09 22:29:59.944946 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ea87ea-e80d-43d5-93f2-7e8416532d44 req-5031fe6e-27a0-4df8-9f83-a9d7ae442fc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:29:59.946451 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e2ea87ea-e80d-43d5-93f2-7e8416532d44 req-5031fe6e-27a0-4df8-9f83-a9d7ae442fc0 service neutron] 10.222.0.31 "GET /v2.0/networks?id=605c75e8-98d5-408d-b084-5a5a3eb371a5 HTTP/1.1" status: 200 len: 898 time: 0.0842006 Dec 09 22:30:00.016309 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e2ea87ea-e80d-43d5-93f2-7e8416532d44 req-12ed8f54-f19e-49a2-b829-548e7e1528c4 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=876ff4b0-b86b-4101-a775-67f5d43f25c5 HTTP/1.1" status: 200 len: 1001 time: 0.0626693 Dec 09 22:30:00.068617 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ea87ea-e80d-43d5-93f2-7e8416532d44 req-4fe0241d-2bde-4c4a-915b-d8be6cb90d1c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:00.070870 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e2ea87ea-e80d-43d5-93f2-7e8416532d44 req-4fe0241d-2bde-4c4a-915b-d8be6cb90d1c service neutron] 10.222.0.31 "GET /v2.0/subnets?id=77fdf423-e042-4c38-a771-2a2e0eb90831 HTTP/1.1" status: 200 len: 834 time: 0.0477531 Dec 09 22:30:00.121400 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ea87ea-e80d-43d5-93f2-7e8416532d44 req-d1027663-6c1e-4973-a9fe-865bf180f24b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:00.122811 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e2ea87ea-e80d-43d5-93f2-7e8416532d44 req-d1027663-6c1e-4973-a9fe-865bf180f24b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=605c75e8-98d5-408d-b084-5a5a3eb371a5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0449934 Dec 09 22:30:00.218010 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e2ea87ea-e80d-43d5-93f2-7e8416532d44 req-1190b7c2-d366-45ed-a330-bd17c8dfaeb6 service neutron] 10.222.0.31 "GET /v2.0/networks/605c75e8-98d5-408d-b084-5a5a3eb371a5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0878203 Dec 09 22:30:00.312769 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-e2ea87ea-e80d-43d5-93f2-7e8416532d44 req-d1e99373-8784-4b6d-a8da-e2061f4cee27 service neutron] 10.222.0.31 "GET /v2.0/networks/605c75e8-98d5-408d-b084-5a5a3eb371a5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0876498 Dec 09 22:30:00.335068 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:30:01.021409 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f1c3c36-0b56-4508-af79-381a2377798d req-fc9d35be-6463-4c28-9ff5-bb46e514102d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:01.022948 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f1c3c36-0b56-4508-af79-381a2377798d req-fc9d35be-6463-4c28-9ff5-bb46e514102d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 946 time: 0.0563264 Dec 09 22:30:01.075538 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f1c3c36-0b56-4508-af79-381a2377798d req-666061ea-7561-4b92-86db-55db11efaf25 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d55fc983-4e08-485c-9436-4f02a9e1dd85&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459650 Dec 09 22:30:02.213518 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2abee68a-1797-4de4-8c68-5f02877f1faf req-db1e3c79-76c3-4e19-a664-6af295813d78 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:02.215052 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2abee68a-1797-4de4-8c68-5f02877f1faf req-db1e3c79-76c3-4e19-a664-6af295813d78 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 946 time: 0.0609741 Dec 09 22:30:02.268577 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2abee68a-1797-4de4-8c68-5f02877f1faf req-4a5c217d-ad18-4dd9-a174-969e6fa7c07e tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d55fc983-4e08-485c-9436-4f02a9e1dd85&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456452 Dec 09 22:30:02.295884 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34854) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:02.363069 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c0f8c788-c1a0-49ca-ad2c-3f1e2f3439ee tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/floatingips/6ef0dfb2-9c6a-4972-b564-24e54d4e6545 HTTP/1.1" status: 200 len: 993 time: 0.0642593 Dec 09 22:30:02.595339 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34860) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:02.761822 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting port ac9a05f4-2598-4804-8c0d-eaeb863fe6e0 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:30:02.762236 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:02.844185 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:02.844509 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:02.856556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Calling delete_port for ac9a05f4-2598-4804-8c0d-eaeb863fe6e0 owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:30:03.010687 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:03.035506 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Port': ['ID=ac9a05f4-2598-4804-8c0d-eaeb863fe6e0,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:03.047506 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:03.047868 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:03.048213 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:03.048549 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:03.048918 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:03.049250 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:03.049580 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:03.049914 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:03.050212 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:03.050538 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:03.050858 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:03.051193 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:03.051500 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:03.065564 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb636939-83b4-433f-8fd3-e8174b7e3593 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:03.106898 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:03.107206 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Floating IP 6ef0dfb2-9c6a-4972-b564-24e54d4e6545 disassociated (deleted). External IP: 172.25.3.61, port: 876ff4b0-b86b-4101-a775-67f5d43f25c5. Dec 09 22:30:03.322433 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router cad95bae-90ee-4cb5-84cf-346cf111d80d has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:30:03.434729 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:30:03.439971 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:03.445783 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f17fb92-f7f5-48a1-90d4-11e843f16aef None None] Sync routers for ids ['cad95bae-90ee-4cb5-84cf-346cf111d80d'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:30:03.456772 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f17fb92-f7f5-48a1-90d4-11e843f16aef None None] Routers {'cad95bae-90ee-4cb5-84cf-346cf111d80d'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:30:03.457389 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6f17fb92-f7f5-48a1-90d4-11e843f16aef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:29:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['cad95bae-90ee-4cb5-84cf-346cf111d80d'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:03.466349 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-69a6c8f4-b1e0-430f-ba2d-b7c2ea61fa1b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/floatingips/6ef0dfb2-9c6a-4972-b564-24e54d4e6545 HTTP/1.1" status: 204 len: 168 time: 0.8695049 Dec 09 22:30:03.466914 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8', 'tag': '876ff4b0-b86b-4101-a775-67f5d43f25c5'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:30:03.469477 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-be3aa169-4b75-4347-8116-7e38dce66bdc" -d '{"events": [{"name": "network-changed", "server_uuid": "aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8", "tag": "876ff4b0-b86b-4101-a775-67f5d43f25c5"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:30:03.564695 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-6f17fb92-f7f5-48a1-90d4-11e843f16aef None None] Set router cad95bae-90ee-4cb5-84cf-346cf111d80d gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:30:03.636573 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:30:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-76942938-41ef-4056-a954-1478299bc392 x-openstack-request-id: req-76942938-41ef-4056-a954-1478299bc392 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:30:03.636863 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8", "tag": "876ff4b0-b86b-4101-a775-67f5d43f25c5", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:30:03.637163 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-76942938-41ef-4056-a954-1478299bc392 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:30:03.637573 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8', 'tag': '876ff4b0-b86b-4101-a775-67f5d43f25c5', 'status': 'completed', 'code': 200} Dec 09 22:30:03.701920 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be3aa169-4b75-4347-8116-7e38dce66bdc req-1e36e0d0-7457-4c5f-a0f5-29a2f9e3f22d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:03.703634 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-be3aa169-4b75-4347-8116-7e38dce66bdc req-1e36e0d0-7457-4c5f-a0f5-29a2f9e3f22d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=e21dff80515b44aa9f01117603c6de0d&device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 1098 time: 0.0427308 Dec 09 22:30:03.751899 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c67970b7-f086-4a3c-8a98-b136e8b81825 req-1a93ceaa-440e-4c95-af25-005d686b3b12 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:03.753765 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c67970b7-f086-4a3c-8a98-b136e8b81825 req-1a93ceaa-440e-4c95-af25-005d686b3b12 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 946 time: 0.0648069 Dec 09 22:30:03.777059 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6f17fb92-f7f5-48a1-90d4-11e843f16aef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1723148457', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59'}], 'enable_snat': True}, 'gw_port_id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:29:01Z', 'updated_at': '2021-12-09T22:29:05Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:7a:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4291, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:29:02Z', 'updated_at': '2021-12-09T22:29:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '1bb6f982-cf35-4690-ab35-344e10e36ba5', 'name': '', 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:0e:1c:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'device_owner': 'network:router_interface', 'standard_attr_id': 4294, 'fixed_ips': [{'subnet_id': '77fdf423-e042-4c38-a771-2a2e0eb90831', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:29:04Z', 'updated_at': '2021-12-09T22:29:08Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '77fdf423-e042-4c38-a771-2a2e0eb90831', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:03.804010 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f17fb92-f7f5-48a1-90d4-11e843f16aef None None] Checking router: cad95bae-90ee-4cb5-84cf-346cf111d80d for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:30:03.808610 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be3aa169-4b75-4347-8116-7e38dce66bdc req-8383856e-6596-45f4-a77b-82b5e09f3366 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:03.810338 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-be3aa169-4b75-4347-8116-7e38dce66bdc req-8383856e-6596-45f4-a77b-82b5e09f3366 service neutron] 10.222.0.31 "GET /v2.0/networks?id=605c75e8-98d5-408d-b084-5a5a3eb371a5 HTTP/1.1" status: 200 len: 898 time: 0.0992694 Dec 09 22:30:03.812976 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f17fb92-f7f5-48a1-90d4-11e843f16aef None None] Routers {'cad95bae-90ee-4cb5-84cf-346cf111d80d'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:30:03.813570 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6f17fb92-f7f5-48a1-90d4-11e843f16aef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:29:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['cad95bae-90ee-4cb5-84cf-346cf111d80d'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:03.816187 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c67970b7-f086-4a3c-8a98-b136e8b81825 req-40223176-f16b-446a-b343-7ef4e9a9956b tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d55fc983-4e08-485c-9436-4f02a9e1dd85&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0485306 Dec 09 22:30:03.854878 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-be3aa169-4b75-4347-8116-7e38dce66bdc req-47f3778a-ce96-41d7-8062-50d1d60c50fd service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=876ff4b0-b86b-4101-a775-67f5d43f25c5 HTTP/1.1" status: 200 len: 217 time: 0.0368996 Dec 09 22:30:03.908325 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be3aa169-4b75-4347-8116-7e38dce66bdc req-36e047aa-a455-4cc3-8f1b-9a518a9c84d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:03.909843 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-be3aa169-4b75-4347-8116-7e38dce66bdc req-36e047aa-a455-4cc3-8f1b-9a518a9c84d3 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=77fdf423-e042-4c38-a771-2a2e0eb90831 HTTP/1.1" status: 200 len: 834 time: 0.0480084 Dec 09 22:30:03.922563 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-6f17fb92-f7f5-48a1-90d4-11e843f16aef None None] Set router cad95bae-90ee-4cb5-84cf-346cf111d80d gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:30:03.957198 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be3aa169-4b75-4347-8116-7e38dce66bdc req-39570287-064d-41fe-a429-559203eb658b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:03.959352 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-be3aa169-4b75-4347-8116-7e38dce66bdc req-39570287-064d-41fe-a429-559203eb658b service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=605c75e8-98d5-408d-b084-5a5a3eb371a5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0414791 Dec 09 22:30:04.050601 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-be3aa169-4b75-4347-8116-7e38dce66bdc req-141b0e09-c6ad-4422-a6b5-4d517de9c901 service neutron] 10.222.0.31 "GET /v2.0/networks/605c75e8-98d5-408d-b084-5a5a3eb371a5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0832639 Dec 09 22:30:04.116852 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-6f17fb92-f7f5-48a1-90d4-11e843f16aef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1723148457', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59'}], 'enable_snat': True}, 'gw_port_id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:29:01Z', 'updated_at': '2021-12-09T22:29:05Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:7a:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4291, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:29:02Z', 'updated_at': '2021-12-09T22:29:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '1bb6f982-cf35-4690-ab35-344e10e36ba5', 'name': '', 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:0e:1c:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'device_owner': 'network:router_interface', 'standard_attr_id': 4294, 'fixed_ips': [{'subnet_id': '77fdf423-e042-4c38-a771-2a2e0eb90831', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:29:04Z', 'updated_at': '2021-12-09T22:29:08Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '77fdf423-e042-4c38-a771-2a2e0eb90831', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:04.146672 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f17fb92-f7f5-48a1-90d4-11e843f16aef None None] The sync data for ids ['cad95bae-90ee-4cb5-84cf-346cf111d80d'] in n-d-713301-27 is: [{'id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1723148457', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59'}], 'enable_snat': True}, 'gw_port_id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:29:01Z', 'updated_at': '2021-12-09T22:29:05Z', 'revision_number': 4, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:7a:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4291, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:29:02Z', 'updated_at': '2021-12-09T22:29:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': '1bb6f982-cf35-4690-ab35-344e10e36ba5', 'name': '', 'network_id': '605c75e8-98d5-408d-b084-5a5a3eb371a5', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'mac_address': 'fa:16:3e:0e:1c:95', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'device_owner': 'network:router_interface', 'standard_attr_id': 4294, 'fixed_ips': [{'subnet_id': '77fdf423-e042-4c38-a771-2a2e0eb90831', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:29:04Z', 'updated_at': '2021-12-09T22:29:08Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'subnets': [{'id': '77fdf423-e042-4c38-a771-2a2e0eb90831', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:30:04.148403 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-be3aa169-4b75-4347-8116-7e38dce66bdc req-2a6f8c3b-412c-4e96-aed9-fc0a7027dfd9 service neutron] 10.222.0.31 "GET /v2.0/networks/605c75e8-98d5-408d-b084-5a5a3eb371a5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0877743 Dec 09 22:30:04.370496 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4be87c77-9057-4699-8adc-e65a412d354c None None] New status for floating IP 6ef0dfb2-9c6a-4972-b564-24e54d4e6545: DOWN {{(pid=103440) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:30:04.952582 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4627b6b-3304-4aa1-bd61-13b91c80f562 req-b3696c45-eb03-40b4-a6ae-b05230bdfd5a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:04.954082 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4627b6b-3304-4aa1-bd61-13b91c80f562 req-b3696c45-eb03-40b4-a6ae-b05230bdfd5a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 946 time: 0.0626254 Dec 09 22:30:05.011978 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4627b6b-3304-4aa1-bd61-13b91c80f562 req-ad7f216d-f2b4-4959-b10f-f9f21adcbd9f tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/security-groups?id=d55fc983-4e08-485c-9436-4f02a9e1dd85&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517161 Dec 09 22:30:05.194822 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a7948df-abe6-4882-b002-06d4c228b6de req-d3de9627-fb66-4fc4-aa2a-d33ce5653166 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:05.196424 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1a7948df-abe6-4882-b002-06d4c228b6de req-d3de9627-fb66-4fc4-aa2a-d33ce5653166 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.31 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 946 time: 0.0571585 Dec 09 22:30:05.291146 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-1a7948df-abe6-4882-b002-06d4c228b6de req-f363fc7c-d13a-4889-a147-d62585646cef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting port 876ff4b0-b86b-4101-a775-67f5d43f25c5 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:30:05.291490 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1a7948df-abe6-4882-b002-06d4c228b6de req-f363fc7c-d13a-4889-a147-d62585646cef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:05.402647 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-1a7948df-abe6-4882-b002-06d4c228b6de req-f363fc7c-d13a-4889-a147-d62585646cef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] For port 876ff4b0-b86b-4101-a775-67f5d43f25c5, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=876ff4b0-b86b-4101-a775-67f5d43f25c5,segment=NetworkSegment(1b04707c-2702-4065-9090-68f189781fea),segment_id=1b04707c-2702-4065-9090-68f189781fea)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:30:05.403018 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1a7948df-abe6-4882-b002-06d4c228b6de req-f363fc7c-d13a-4889-a147-d62585646cef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:05.416308 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-1a7948df-abe6-4882-b002-06d4c228b6de req-f363fc7c-d13a-4889-a147-d62585646cef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Calling delete_port for 876ff4b0-b86b-4101-a775-67f5d43f25c5 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:30:05.557319 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1a7948df-abe6-4882-b002-06d4c228b6de req-f363fc7c-d13a-4889-a147-d62585646cef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:05.592349 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f363fc7c-d13a-4889-a147-d62585646cef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Port': ['ID=876ff4b0-b86b-4101-a775-67f5d43f25c5,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:05.618997 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f363fc7c-d13a-4889-a147-d62585646cef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:05.619364 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f363fc7c-d13a-4889-a147-d62585646cef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:05.619748 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f363fc7c-d13a-4889-a147-d62585646cef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:05.620095 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f363fc7c-d13a-4889-a147-d62585646cef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:05.620440 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f363fc7c-d13a-4889-a147-d62585646cef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:05.620784 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f363fc7c-d13a-4889-a147-d62585646cef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:05.621121 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f363fc7c-d13a-4889-a147-d62585646cef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:05.621459 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f363fc7c-d13a-4889-a147-d62585646cef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:05.621796 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f363fc7c-d13a-4889-a147-d62585646cef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:05.622116 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f363fc7c-d13a-4889-a147-d62585646cef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:05.622447 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f363fc7c-d13a-4889-a147-d62585646cef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:05.622778 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f363fc7c-d13a-4889-a147-d62585646cef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:05.623101 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f363fc7c-d13a-4889-a147-d62585646cef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:05.645606 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-1a7948df-abe6-4882-b002-06d4c228b6de req-f363fc7c-d13a-4889-a147-d62585646cef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] No DVR routers for this DVR port 876ff4b0-b86b-4101-a775-67f5d43f25c5 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:30:05.648912 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-1a7948df-abe6-4882-b002-06d4c228b6de req-f363fc7c-d13a-4889-a147-d62585646cef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:05.652525 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-1a7948df-abe6-4882-b002-06d4c228b6de req-f363fc7c-d13a-4889-a147-d62585646cef tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.31 "DELETE /v2.0/ports/876ff4b0-b86b-4101-a775-67f5d43f25c5 HTTP/1.1" status: 204 len: 173 time: 0.4500124 Dec 09 22:30:05.652983 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8', 'name': 'network-vif-deleted', 'tag': '876ff4b0-b86b-4101-a775-67f5d43f25c5'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:30:05.655263 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-edef9f0a-c9fc-4147-9d02-8e244d46ffed" -d '{"events": [{"server_uuid": "aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8", "name": "network-vif-deleted", "tag": "876ff4b0-b86b-4101-a775-67f5d43f25c5"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:30:05.672765 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-90bbf19c-d1d6-4957-adf7-0971b2fcca82 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:05.693287 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:30:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-717eb6b8-8683-4646-a33a-5271e19dff97 x-openstack-request-id: req-717eb6b8-8683-4646-a33a-5271e19dff97 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:30:05.693588 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8", "name": "network-vif-deleted", "tag": "876ff4b0-b86b-4101-a775-67f5d43f25c5", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:30:05.693849 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-717eb6b8-8683-4646-a33a-5271e19dff97 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:30:05.694251 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8', 'name': 'network-vif-deleted', 'tag': '876ff4b0-b86b-4101-a775-67f5d43f25c5', 'status': 'completed', 'code': 200} Dec 09 22:30:06.129673 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-47dc4405-a40e-4b4b-b6e8-bf17eacaa5f0 req-ae0f3521-38e3-49bd-ad29-3fe80cf49fa1 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "GET /v2.0/ports?device_id=aa5d9489-7b9a-4ef4-8418-9a8bd20bfac8 HTTP/1.1" status: 200 len: 210 time: 0.0281761 Dec 09 22:30:06.918022 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:07.188907 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34876) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:07.552277 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-168717db-9c2f-44f5-8cbb-a8bc78c2408d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:07.810245 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-168717db-9c2f-44f5-8cbb-a8bc78c2408d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting port 1bb6f982-cf35-4690-ab35-344e10e36ba5 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:30:07.810460 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-168717db-9c2f-44f5-8cbb-a8bc78c2408d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:07.900668 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-168717db-9c2f-44f5-8cbb-a8bc78c2408d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] For port 1bb6f982-cf35-4690-ab35-344e10e36ba5, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=1bb6f982-cf35-4690-ab35-344e10e36ba5,segment=NetworkSegment(1b04707c-2702-4065-9090-68f189781fea),segment_id=1b04707c-2702-4065-9090-68f189781fea)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:30:07.901037 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-168717db-9c2f-44f5-8cbb-a8bc78c2408d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:07.914187 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-168717db-9c2f-44f5-8cbb-a8bc78c2408d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Calling delete_port for 1bb6f982-cf35-4690-ab35-344e10e36ba5 owned by network:router_interface {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:30:08.113362 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-168717db-9c2f-44f5-8cbb-a8bc78c2408d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:08.141095 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-168717db-9c2f-44f5-8cbb-a8bc78c2408d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Port': ['ID=1bb6f982-cf35-4690-ab35-344e10e36ba5,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:08.260760 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:08.321267 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-168717db-9c2f-44f5-8cbb-a8bc78c2408d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:08.545905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-168717db-9c2f-44f5-8cbb-a8bc78c2408d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Router cad95bae-90ee-4cb5-84cf-346cf111d80d has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:30:08.659752 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-168717db-9c2f-44f5-8cbb-a8bc78c2408d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:30:08.665917 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-168717db-9c2f-44f5-8cbb-a8bc78c2408d tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "PUT /v2.0/routers/cad95bae-90ee-4cb5-84cf-346cf111d80d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4753606 Dec 09 22:30:08.668512 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34878) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:08.670489 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27252b6d-3da2-4398-aab4-2e2226b719df None None] Sync routers for ids ['cad95bae-90ee-4cb5-84cf-346cf111d80d'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:30:08.681666 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27252b6d-3da2-4398-aab4-2e2226b719df None None] Routers {'cad95bae-90ee-4cb5-84cf-346cf111d80d'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:30:08.682293 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-27252b6d-3da2-4398-aab4-2e2226b719df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:30:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['cad95bae-90ee-4cb5-84cf-346cf111d80d'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:08.720325 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_v2 [None req-176db618-40da-4515-82bc-8edfe2709e4a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting subnet 77fdf423-e042-4c38-a771-2a2e0eb90831 {{(pid=103438) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:30:08.723604 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-176db618-40da-4515-82bc-8edfe2709e4a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for subnet, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:08.764531 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-176db618-40da-4515-82bc-8edfe2709e4a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8811545'] for subnet, precommit_delete_associations {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:08.787380 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-27252b6d-3da2-4398-aab4-2e2226b719df None None] Set router cad95bae-90ee-4cb5-84cf-346cf111d80d gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:30:08.852532 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-176db618-40da-4515-82bc-8edfe2709e4a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:08.913559 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-176db618-40da-4515-82bc-8edfe2709e4a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8812019', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9191597'] for subnet, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:08.942770 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-176db618-40da-4515-82bc-8edfe2709e4a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Subnet': ['ID=77fdf423-e042-4c38-a771-2a2e0eb90831,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:08.944779 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-176db618-40da-4515-82bc-8edfe2709e4a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:08.950904 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-176db618-40da-4515-82bc-8edfe2709e4a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/subnets/77fdf423-e042-4c38-a771-2a2e0eb90831 HTTP/1.1" status: 204 len: 168 time: 0.2812047 Dec 09 22:30:08.951097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34880) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:08.951919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3b31a162-a1c9-4f1a-87bd-e90538089bd5 None None] Network 605c75e8-98d5-408d-b084-5a5a3eb371a5 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:30:09.082995 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d87f4910-90f8-4a1b-8b00-f6be1831bd1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:09.196775 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d87f4910-90f8-4a1b-8b00-f6be1831bd1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:09.225648 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-27252b6d-3da2-4398-aab4-2e2226b719df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1723148457', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59'}], 'enable_snat': True}, 'gw_port_id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:29:01Z', 'updated_at': '2021-12-09T22:30:08Z', 'revision_number': 5, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port': {'id': 'd2f08748-9030-4a88-bc06-d68b94d94999', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:3a:7a:a8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4291, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:29:02Z', 'updated_at': '2021-12-09T22:29:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:09.256400 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-d87f4910-90f8-4a1b-8b00-f6be1831bd1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Deleting port d2f08748-9030-4a88-bc06-d68b94d94999 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:30:09.256741 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d87f4910-90f8-4a1b-8b00-f6be1831bd1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:09.258746 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27252b6d-3da2-4398-aab4-2e2226b719df None None] Checking router: cad95bae-90ee-4cb5-84cf-346cf111d80d for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:30:09.271548 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27252b6d-3da2-4398-aab4-2e2226b719df None None] Routers {'cad95bae-90ee-4cb5-84cf-346cf111d80d'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:30:09.272198 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-27252b6d-3da2-4398-aab4-2e2226b719df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:30:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['cad95bae-90ee-4cb5-84cf-346cf111d80d'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:09.337438 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-d87f4910-90f8-4a1b-8b00-f6be1831bd1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] For port d2f08748-9030-4a88-bc06-d68b94d94999, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d2f08748-9030-4a88-bc06-d68b94d94999,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:30:09.337673 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9c59ae6c-82d7-4f57-b9da-7010edd69574 None None] DHCP port deletion for 605c75e8-98d5-408d-b084-5a5a3eb371a5 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:30:09.337791 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d87f4910-90f8-4a1b-8b00-f6be1831bd1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:09.350206 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-d87f4910-90f8-4a1b-8b00-f6be1831bd1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Calling delete_port for d2f08748-9030-4a88-bc06-d68b94d94999 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:30:09.382392 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-27252b6d-3da2-4398-aab4-2e2226b719df None None] Set router cad95bae-90ee-4cb5-84cf-346cf111d80d gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:30:09.439091 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-27252b6d-3da2-4398-aab4-2e2226b719df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1723148457', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:29:01Z', 'updated_at': '2021-12-09T22:30:09Z', 'revision_number': 6, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:09.468652 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27252b6d-3da2-4398-aab4-2e2226b719df None None] The sync data for ids ['cad95bae-90ee-4cb5-84cf-346cf111d80d'] in n-d-713301-27 is: [{'id': 'cad95bae-90ee-4cb5-84cf-346cf111d80d', 'name': 'tempest-TestNetworkAdvancedServerOps-router-1723148457', 'tenant_id': 'e21dff80515b44aa9f01117603c6de0d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:29:01Z', 'updated_at': '2021-12-09T22:30:09Z', 'revision_number': 6, 'project_id': 'e21dff80515b44aa9f01117603c6de0d', 'gw_port_host': None}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:30:09.484559 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9c59ae6c-82d7-4f57-b9da-7010edd69574 None None] Deleting port 004d1246-e318-444f-9c8a-94684730b9cd {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:30:09.484952 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9c59ae6c-82d7-4f57-b9da-7010edd69574 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:09.528948 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d87f4910-90f8-4a1b-8b00-f6be1831bd1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:09.547397 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-9c59ae6c-82d7-4f57-b9da-7010edd69574 None None] For port 004d1246-e318-444f-9c8a-94684730b9cd, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=004d1246-e318-444f-9c8a-94684730b9cd,segment=NetworkSegment(1b04707c-2702-4065-9090-68f189781fea),segment_id=1b04707c-2702-4065-9090-68f189781fea)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:30:09.547821 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9c59ae6c-82d7-4f57-b9da-7010edd69574 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:09.557055 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d87f4910-90f8-4a1b-8b00-f6be1831bd1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Port': ['ID=d2f08748-9030-4a88-bc06-d68b94d94999,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:09.568456 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-66bb8cdc-94ac-4dcb-9bea-be856cd097ca None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:30:09.570527 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9c59ae6c-82d7-4f57-b9da-7010edd69574 None None] Calling delete_port for 004d1246-e318-444f-9c8a-94684730b9cd owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:30:09.620917 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d87f4910-90f8-4a1b-8b00-f6be1831bd1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:09.656302 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9c59ae6c-82d7-4f57-b9da-7010edd69574 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:09.679276 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c59ae6c-82d7-4f57-b9da-7010edd69574 None None] Pushing event deleted for resources: {'Port': ['ID=004d1246-e318-444f-9c8a-94684730b9cd,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:09.692604 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c59ae6c-82d7-4f57-b9da-7010edd69574 None None] No DVR routers for this DVR port 004d1246-e318-444f-9c8a-94684730b9cd on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:30:09.695082 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c59ae6c-82d7-4f57-b9da-7010edd69574 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:09.695425 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c59ae6c-82d7-4f57-b9da-7010edd69574 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:09.695875 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c59ae6c-82d7-4f57-b9da-7010edd69574 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:09.696214 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c59ae6c-82d7-4f57-b9da-7010edd69574 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:09.696571 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c59ae6c-82d7-4f57-b9da-7010edd69574 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:09.696888 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c59ae6c-82d7-4f57-b9da-7010edd69574 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:09.697214 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c59ae6c-82d7-4f57-b9da-7010edd69574 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:09.697538 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c59ae6c-82d7-4f57-b9da-7010edd69574 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:09.697859 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c59ae6c-82d7-4f57-b9da-7010edd69574 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:09.698180 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c59ae6c-82d7-4f57-b9da-7010edd69574 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:09.698501 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c59ae6c-82d7-4f57-b9da-7010edd69574 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:09.698834 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c59ae6c-82d7-4f57-b9da-7010edd69574 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:09.699152 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c59ae6c-82d7-4f57-b9da-7010edd69574 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:09.717310 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d87f4910-90f8-4a1b-8b00-f6be1831bd1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:09.717774 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:09.719514 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d87f4910-90f8-4a1b-8b00-f6be1831bd1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:09.764552 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d87f4910-90f8-4a1b-8b00-f6be1831bd1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:09.765109 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d87f4910-90f8-4a1b-8b00-f6be1831bd1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Fanout notify agent at l3_agent the message router_deleted on router cad95bae-90ee-4cb5-84cf-346cf111d80d {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 22:30:09.772982 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d87f4910-90f8-4a1b-8b00-f6be1831bd1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:09.774186 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d87f4910-90f8-4a1b-8b00-f6be1831bd1a tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/routers/cad95bae-90ee-4cb5-84cf-346cf111d80d HTTP/1.1" status: 204 len: 168 time: 0.8212731 Dec 09 22:30:09.777088 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34882) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:09.858175 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de2f61fc-45e2-4ed1-937e-3c1a5cafbf43 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:09.946293 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de2f61fc-45e2-4ed1-937e-3c1a5cafbf43 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:09.965746 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-de2f61fc-45e2-4ed1-937e-3c1a5cafbf43 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['605c75e8-98d5-408d-b084-5a5a3eb371a5']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:09.974861 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-de2f61fc-45e2-4ed1-937e-3c1a5cafbf43 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1b04707c-2702-4065-9090-68f189781fea') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:09.975163 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-de2f61fc-45e2-4ed1-937e-3c1a5cafbf43 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1b04707c-2702-4065-9090-68f189781fea') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:09.989383 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de2f61fc-45e2-4ed1-937e-3c1a5cafbf43 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:10.002846 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de2f61fc-45e2-4ed1-937e-3c1a5cafbf43 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:10.009378 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-de2f61fc-45e2-4ed1-937e-3c1a5cafbf43 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Releasing vlan 148 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:30:10.009798 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de2f61fc-45e2-4ed1-937e-3c1a5cafbf43 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: timer() Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:30:10.012893 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:30:10.080339 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de2f61fc-45e2-4ed1-937e-3c1a5cafbf43 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:10.084963 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-de2f61fc-45e2-4ed1-937e-3c1a5cafbf43 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:10.091228 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-de2f61fc-45e2-4ed1-937e-3c1a5cafbf43 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/networks/605c75e8-98d5-408d-b084-5a5a3eb371a5 HTTP/1.1" status: 204 len: 168 time: 0.3103960 Dec 09 22:30:10.091656 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34884) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:10.102969 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de2f61fc-45e2-4ed1-937e-3c1a5cafbf43 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'Network': ['ID=605c75e8-98d5-408d-b084-5a5a3eb371a5,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:10.150997 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0918abb-5c9a-4d61-97e7-30e784aa7c92 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:10.176472 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0918abb-5c9a-4d61-97e7-30e784aa7c92 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:10.248107 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0918abb-5c9a-4d61-97e7-30e784aa7c92 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:10.251017 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f0918abb-5c9a-4d61-97e7-30e784aa7c92 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:10.252576 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f0918abb-5c9a-4d61-97e7-30e784aa7c92 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] 10.222.0.13 "DELETE /v2.0/security-groups/d55fc983-4e08-485c-9436-4f02a9e1dd85 HTTP/1.1" status: 204 len: 168 time: 0.1598055 Dec 09 22:30:10.264268 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0918abb-5c9a-4d61-97e7-30e784aa7c92 tempest-TestNetworkAdvancedServerOps-416124554 tempest-TestNetworkAdvancedServerOps-416124554-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d55fc983-4e08-485c-9436-4f02a9e1dd85,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:10.436437 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 876ff4b0-b86b-4101-a775-67f5d43f25c5 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:30:10.461522 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 876ff4b0-b86b-4101-a775-67f5d43f25c5 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:30:10.461883 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 876ff4b0-b86b-4101-a775-67f5d43f25c5 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:30:10.555875 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 1bb6f982-cf35-4690-ab35-344e10e36ba5 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:30:10.576458 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 1bb6f982-cf35-4690-ab35-344e10e36ba5 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:30:10.576797 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 1bb6f982-cf35-4690-ab35-344e10e36ba5 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:30:10.577204 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d2f08748-9030-4a88-bc06-d68b94d94999 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:30:10.595781 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: d2f08748-9030-4a88-bc06-d68b94d94999 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:30:10.596126 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d2f08748-9030-4a88-bc06-d68b94d94999 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:30:10.596526 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 004d1246-e318-444f-9c8a-94684730b9cd no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:30:10.614993 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 004d1246-e318-444f-9c8a-94684730b9cd {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:30:10.615341 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 004d1246-e318-444f-9c8a-94684730b9cd not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:30:10.658161 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34892) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:10.798931 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-00c180e1-3391-4f02-ad7b-6f5771b0ceb5 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=e21dff80515b44aa9f01117603c6de0d&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1394429 Dec 09 22:30:10.802016 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34896) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:10.856140 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d988bb0e-4d1e-4618-adbe-7f826e33c206 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:10.876998 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d988bb0e-4d1e-4618-adbe-7f826e33c206 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:10.924560 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d988bb0e-4d1e-4618-adbe-7f826e33c206 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:10.927230 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d988bb0e-4d1e-4618-adbe-7f826e33c206 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:10.928437 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d988bb0e-4d1e-4618-adbe-7f826e33c206 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/9561a413-d255-4ccd-8b82-e57af0f2ca26 HTTP/1.1" status: 204 len: 168 time: 0.1254425 Dec 09 22:30:10.937359 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d988bb0e-4d1e-4618-adbe-7f826e33c206 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9561a413-d255-4ccd-8b82-e57af0f2ca26,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:11.204350 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34902) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:11.218398 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8e7d9f6-0b03-4397-95fb-99822e87c518 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:11.292197 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8e7d9f6-0b03-4397-95fb-99822e87c518 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:11.297004 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d8e7d9f6-0b03-4397-95fb-99822e87c518 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:11.334901 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d8e7d9f6-0b03-4397-95fb-99822e87c518 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=8c7ba3b9cdfe40e98485c7ee9797cfb6&name=default HTTP/1.1" status: 200 len: 3000 time: 0.1294088 Dec 09 22:30:11.335803 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8e7d9f6-0b03-4397-95fb-99822e87c518 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cedc0c47-38c8-461c-b26c-55d1f2ba92ef,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:11.338041 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34904) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:11.397934 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6604c9dc-e1d5-4fc6-b312-f08e8e262c7b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:11.424469 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6604c9dc-e1d5-4fc6-b312-f08e8e262c7b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:11.477213 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6604c9dc-e1d5-4fc6-b312-f08e8e262c7b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:11.482750 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6604c9dc-e1d5-4fc6-b312-f08e8e262c7b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:11.484289 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6604c9dc-e1d5-4fc6-b312-f08e8e262c7b admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/cedc0c47-38c8-461c-b26c-55d1f2ba92ef HTTP/1.1" status: 204 len: 168 time: 0.1444285 Dec 09 22:30:11.498074 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6604c9dc-e1d5-4fc6-b312-f08e8e262c7b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cedc0c47-38c8-461c-b26c-55d1f2ba92ef,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:12.251146 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34926) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:12.384999 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-d1b0bac6-aa2c-4b49-8041-64df4e19cb0e admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1687017519-network', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:30:12.408088 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d1b0bac6-aa2c-4b49-8041-64df4e19cb0e admin admin] Made reservation on behalf of 2f75126e83f04a8eb56e531ea19960e3 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:30:12.410686 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d1b0bac6-aa2c-4b49-8041-64df4e19cb0e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:12.420007 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d1b0bac6-aa2c-4b49-8041-64df4e19cb0e admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:12.500115 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d1b0bac6-aa2c-4b49-8041-64df4e19cb0e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:12.507265 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d1b0bac6-aa2c-4b49-8041-64df4e19cb0e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:12.540849 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d1b0bac6-aa2c-4b49-8041-64df4e19cb0e admin admin] vlan segment allocate from pool success with {'vlan_id': 106, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 22:30:12.550902 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1b0bac6-aa2c-4b49-8041-64df4e19cb0e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=baa12905-212c-417c-8b26-c6e9b9349f43,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:12.556024 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d1b0bac6-aa2c-4b49-8041-64df4e19cb0e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:12.556413 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-d1b0bac6-aa2c-4b49-8041-64df4e19cb0e admin admin] Added segment 4fd32693-bdb8-493a-a8d8-5bd83c6f9f80 of type vlan for network dddb6458-4699-45f3-afbf-66e168e093fa Dec 09 22:30:12.595819 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d1b0bac6-aa2c-4b49-8041-64df4e19cb0e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:12.623013 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d1b0bac6-aa2c-4b49-8041-64df4e19cb0e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:12.623959 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d1b0bac6-aa2c-4b49-8041-64df4e19cb0e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:12.624570 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-d1b0bac6-aa2c-4b49-8041-64df4e19cb0e admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:12.656894 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d1b0bac6-aa2c-4b49-8041-64df4e19cb0e admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.4045386 Dec 09 22:30:12.660043 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34930) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:12.665072 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-358f86fe-3892-47ba-8e32-87e4a052b57e admin admin] Request body: {'subnet': {'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1687017519-subnet', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:30:12.688659 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-358f86fe-3892-47ba-8e32-87e4a052b57e admin admin] Made reservation on behalf of 2f75126e83f04a8eb56e531ea19960e3 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:30:12.691134 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-358f86fe-3892-47ba-8e32-87e4a052b57e admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:12.691529 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1b0bac6-aa2c-4b49-8041-64df4e19cb0e admin admin] Pushing event updated for resources: {'Network': ['ID=dddb6458-4699-45f3-afbf-66e168e093fa,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:12.702592 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network dddb6458-4699-45f3-afbf-66e168e093fa details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 22:30:12.864652 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-358f86fe-3892-47ba-8e32-87e4a052b57e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:12.917658 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-358f86fe-3892-47ba-8e32-87e4a052b57e admin admin] Pushing event updated for resources: {'Subnet': ['ID=34856fdf-2a32-48b3-9f67-7cd8c8d39875,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:12.928065 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-358f86fe-3892-47ba-8e32-87e4a052b57e admin admin] Checking segment: {'id': '4fd32693-bdb8-493a-a8d8-5bd83c6f9f80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:30:12.928419 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-358f86fe-3892-47ba-8e32-87e4a052b57e admin admin] Network hostable DHCP agents. Network: dddb6458-4699-45f3-afbf-66e168e093fa, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 22:30:12.946162 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-358f86fe-3892-47ba-8e32-87e4a052b57e admin admin] Network dddb6458-4699-45f3-afbf-66e168e093fa is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 22:30:12.956581 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-358f86fe-3892-47ba-8e32-87e4a052b57e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, dddb6458-4699-45f3-afbf-66e168e093fa) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:30:12.961099 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-358f86fe-3892-47ba-8e32-87e4a052b57e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:12.961811 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-358f86fe-3892-47ba-8e32-87e4a052b57e admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:12.967553 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87182dd9-5583-417c-8a25-9b78078dfe34 None None] Network dddb6458-4699-45f3-afbf-66e168e093fa requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:30:12.981554 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-358f86fe-3892-47ba-8e32-87e4a052b57e admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3203506 Dec 09 22:30:12.984492 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34932) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:12.989035 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-522bcf60-c5c6-4941-90bc-ed0d7947b7c4 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1687017519-router', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:30:13.010593 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-522bcf60-c5c6-4941-90bc-ed0d7947b7c4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:13.011779 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-522bcf60-c5c6-4941-90bc-ed0d7947b7c4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:13.061894 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-522bcf60-c5c6-4941-90bc-ed0d7947b7c4 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:13.070823 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-566aed14-6543-42ce-be5d-6f72ab3ec396 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-dddb6458-4699-45f3-afbf-66e168e093fa', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'fixed_ips': [{'subnet_id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 22:30:13.071860 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-566aed14-6543-42ce-be5d-6f72ab3ec396 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:13.201963 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-522bcf60-c5c6-4941-90bc-ed0d7947b7c4 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:13.202328 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-566aed14-6543-42ce-be5d-6f72ab3ec396 None None] Allocated IP 172.20.0.2 (dddb6458-4699-45f3-afbf-66e168e093fa/34856fdf-2a32-48b3-9f67-7cd8c8d39875/22d2cda2-1aee-4741-aaa9-f376a689c587) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:30:13.345383 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-566aed14-6543-42ce-be5d-6f72ab3ec396 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:13.351630 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-566aed14-6543-42ce-be5d-6f72ab3ec396 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:13.387851 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-566aed14-6543-42ce-be5d-6f72ab3ec396 None None] Network dddb6458-4699-45f3-afbf-66e168e093fa is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:30:13.390549 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-566aed14-6543-42ce-be5d-6f72ab3ec396 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:30:13.393218 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-566aed14-6543-42ce-be5d-6f72ab3ec396 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:30:13.406789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-566aed14-6543-42ce-be5d-6f72ab3ec396 None None] Pushing event updated for resources: {'Port': ['ID=22d2cda2-1aee-4741-aaa9-f376a689c587,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:13.408777 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-522bcf60-c5c6-4941-90bc-ed0d7947b7c4 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:13.461960 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-566aed14-6543-42ce-be5d-6f72ab3ec396 None None] Attempting to bind port 22d2cda2-1aee-4741-aaa9-f376a689c587 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:30:13.462361 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-566aed14-6543-42ce-be5d-6f72ab3ec396 None None] Attempting to bind port 22d2cda2-1aee-4741-aaa9-f376a689c587 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '4fd32693-bdb8-493a-a8d8-5bd83c6f9f80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:30:13.462853 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-566aed14-6543-42ce-be5d-6f72ab3ec396 None None] Attempting to bind port 22d2cda2-1aee-4741-aaa9-f376a689c587 on network dddb6458-4699-45f3-afbf-66e168e093fa {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:30:13.468464 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-566aed14-6543-42ce-be5d-6f72ab3ec396 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 30, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:30:13.468834 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-566aed14-6543-42ce-be5d-6f72ab3ec396 None None] Checking segment: {'id': '4fd32693-bdb8-493a-a8d8-5bd83c6f9f80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:30:13.469236 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-566aed14-6543-42ce-be5d-6f72ab3ec396 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:13.469629 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-566aed14-6543-42ce-be5d-6f72ab3ec396 None None] Bound using segment: {'id': '4fd32693-bdb8-493a-a8d8-5bd83c6f9f80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:30:13.470092 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-566aed14-6543-42ce-be5d-6f72ab3ec396 None None] Bound port: 22d2cda2-1aee-4741-aaa9-f376a689c587, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4fd32693-bdb8-493a-a8d8-5bd83c6f9f80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:30:13.470485 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-566aed14-6543-42ce-be5d-6f72ab3ec396 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:13.539270 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-566aed14-6543-42ce-be5d-6f72ab3ec396 None None] For port 22d2cda2-1aee-4741-aaa9-f376a689c587, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:30:13.542815 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-566aed14-6543-42ce-be5d-6f72ab3ec396 None None] For port 22d2cda2-1aee-4741-aaa9-f376a689c587, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=22d2cda2-1aee-4741-aaa9-f376a689c587,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:30:13.548594 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-566aed14-6543-42ce-be5d-6f72ab3ec396 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:13.614853 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-566aed14-6543-42ce-be5d-6f72ab3ec396 None None] Pushing event updated for resources: {'Port': ['ID=22d2cda2-1aee-4741-aaa9-f376a689c587,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:13.810256 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-522bcf60-c5c6-4941-90bc-ed0d7947b7c4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:13.920575 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-522bcf60-c5c6-4941-90bc-ed0d7947b7c4 admin admin] Allocated IP 172.25.3.169 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/ab7589e3-3ac4-499f-a5a9-620c6efa7f0b) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:30:14.025643 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-522bcf60-c5c6-4941-90bc-ed0d7947b7c4 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:14.062708 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-522bcf60-c5c6-4941-90bc-ed0d7947b7c4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:14.101748 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-522bcf60-c5c6-4941-90bc-ed0d7947b7c4 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:30:14.106710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-522bcf60-c5c6-4941-90bc-ed0d7947b7c4 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:30:14.112087 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-522bcf60-c5c6-4941-90bc-ed0d7947b7c4 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:30:14.115135 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-522bcf60-c5c6-4941-90bc-ed0d7947b7c4 admin admin] Pushing event updated for resources: {'Port': ['ID=ab7589e3-3ac4-499f-a5a9-620c6efa7f0b,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:14.120571 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87232f2c-465a-4c77-a120-d5fb14d96f35 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:30:14.215831 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ea60a14f-ce21-4231-9a77-f9449b5d7d78 None None] Provisioning complete for port ab7589e3-3ac4-499f-a5a9-620c6efa7f0b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:14.216191 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ea60a14f-ce21-4231-9a77-f9449b5d7d78 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:14.252420 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ea60a14f-ce21-4231-9a77-f9449b5d7d78 None None] Port ab7589e3-3ac4-499f-a5a9-620c6efa7f0b cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:30:14.374057 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-522bcf60-c5c6-4941-90bc-ed0d7947b7c4 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:14.532829 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0fd36067-3187-4dd5-bde5-7efd2c9833a5 None None] Network dddb6458-4699-45f3-afbf-66e168e093fa requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:30:14.583014 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-522bcf60-c5c6-4941-90bc-ed0d7947b7c4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:14.606611 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 22d2cda2-1aee-4741-aaa9-f376a689c587 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:30:14.668721 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-834cd58b-f410-4993-a768-d1eb5e2ff71b None None] Provisioning complete for port 22d2cda2-1aee-4741-aaa9-f376a689c587 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:14.669095 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-834cd58b-f410-4993-a768-d1eb5e2ff71b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:14.713568 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-522bcf60-c5c6-4941-90bc-ed0d7947b7c4 admin admin] Router 4310b7c2-6f1e-4838-bdb6-245416900ec5 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 22:30:14.728631 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 22d2cda2-1aee-4741-aaa9-f376a689c587 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:14.729250 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:14.812280 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-834cd58b-f410-4993-a768-d1eb5e2ff71b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:14.848943 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-522bcf60-c5c6-4941-90bc-ed0d7947b7c4 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:30:14.861453 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] Sync routers for ids ['4310b7c2-6f1e-4838-bdb6-245416900ec5'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:30:14.872341 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] Routers {'4310b7c2-6f1e-4838-bdb6-245416900ec5'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:30:14.874643 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:30:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4310b7c2-6f1e-4838-bdb6-245416900ec5'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:14.874787 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-522bcf60-c5c6-4941-90bc-ed0d7947b7c4 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:14.878865 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34934) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:14.896017 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-522bcf60-c5c6-4941-90bc-ed0d7947b7c4 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 1.9102752 Dec 09 22:30:14.896912 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:14.908297 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-834cd58b-f410-4993-a768-d1eb5e2ff71b None None] For port 22d2cda2-1aee-4741-aaa9-f376a689c587, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=22d2cda2-1aee-4741-aaa9-f376a689c587,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:30:14.918605 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-834cd58b-f410-4993-a768-d1eb5e2ff71b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:14.989881 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] Set router 4310b7c2-6f1e-4838-bdb6-245416900ec5 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:30:14.995583 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 22:30:14.996041 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 22:30:15.022858 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-834cd58b-f410-4993-a768-d1eb5e2ff71b None None] Pushing event updated for resources: {'Port': ['ID=22d2cda2-1aee-4741-aaa9-f376a689c587,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:15.047387 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-d646b1cc-b307-4404-a1ce-128ef50f2b61 None None] Provisioning complete for port 22d2cda2-1aee-4741-aaa9-f376a689c587 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:15.047838 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d646b1cc-b307-4404-a1ce-128ef50f2b61 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:15.183837 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'name': 'tempest-TestShelveInstance-1687017519-router', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169'}], 'enable_snat': True}, 'gw_port_id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:14Z', 'revision_number': 3, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'gw_port': {'id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:7a:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4313, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:13Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:15.212016 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] Checking router: 4310b7c2-6f1e-4838-bdb6-245416900ec5 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:30:15.212368 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] Updating router 4310b7c2-6f1e-4838-bdb6-245416900ec5 port ab7589e3-3ac4-499f-a5a9-620c6efa7f0b binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:30:15.242999 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:15.503079 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:15.512035 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:15.553784 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-34979bd2-729f-421d-b2dd-3378b8dc7f68 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:30:15.558809 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] Attempting to bind port ab7589e3-3ac4-499f-a5a9-620c6efa7f0b on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:30:15.559179 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] Attempting to bind port ab7589e3-3ac4-499f-a5a9-620c6efa7f0b by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:30:15.559568 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] Attempting to bind port ab7589e3-3ac4-499f-a5a9-620c6efa7f0b on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:30:15.572293 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 30, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:30:15.572751 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:30:15.573446 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:15.574007 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:30:15.574488 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] Bound port: ab7589e3-3ac4-499f-a5a9-620c6efa7f0b, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:30:15.574862 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:15.576605 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6eef2752-c9fa-47e4-a7c8-a99f74794b27 None None] Pushing event updated for resources: {'Port': ['ID=ab7589e3-3ac4-499f-a5a9-620c6efa7f0b,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:15.602583 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6eef2752-c9fa-47e4-a7c8-a99f74794b27 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:15.602913 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6eef2752-c9fa-47e4-a7c8-a99f74794b27 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:15.603366 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6eef2752-c9fa-47e4-a7c8-a99f74794b27 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:15.603777 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6eef2752-c9fa-47e4-a7c8-a99f74794b27 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:15.604057 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6eef2752-c9fa-47e4-a7c8-a99f74794b27 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:15.604391 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6eef2752-c9fa-47e4-a7c8-a99f74794b27 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:15.604710 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6eef2752-c9fa-47e4-a7c8-a99f74794b27 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:15.605032 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6eef2752-c9fa-47e4-a7c8-a99f74794b27 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:15.605363 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6eef2752-c9fa-47e4-a7c8-a99f74794b27 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:15.605658 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6eef2752-c9fa-47e4-a7c8-a99f74794b27 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:15.605974 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6eef2752-c9fa-47e4-a7c8-a99f74794b27 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:15.606288 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6eef2752-c9fa-47e4-a7c8-a99f74794b27 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:15.606599 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6eef2752-c9fa-47e4-a7c8-a99f74794b27 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:30:15.640104 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] For port ab7589e3-3ac4-499f-a5a9-620c6efa7f0b, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:30:15.643310 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] For port ab7589e3-3ac4-499f-a5a9-620c6efa7f0b, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=ab7589e3-3ac4-499f-a5a9-620c6efa7f0b,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:30:15.648391 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:15.656071 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-26549c83-d8b9-4e53-921e-d22b3ddce643 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:15.675943 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-30d7074c-1181-4644-b5cc-ac1f4e865acd None None] Provisioning complete for port ab7589e3-3ac4-499f-a5a9-620c6efa7f0b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:15.676721 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-30d7074c-1181-4644-b5cc-ac1f4e865acd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:15.708134 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] Routers {'4310b7c2-6f1e-4838-bdb6-245416900ec5'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:30:15.708372 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12960517-110f-420f-b9ac-70adca2be5de None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:30:15.708760 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:30:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4310b7c2-6f1e-4838-bdb6-245416900ec5'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:15.712925 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6eef2752-c9fa-47e4-a7c8-a99f74794b27 None None] Pushing event updated for resources: {'Port': ['ID=ab7589e3-3ac4-499f-a5a9-620c6efa7f0b,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:15.771912 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-30d7074c-1181-4644-b5cc-ac1f4e865acd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:15.798672 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-30d7074c-1181-4644-b5cc-ac1f4e865acd None None] For port ab7589e3-3ac4-499f-a5a9-620c6efa7f0b, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=ab7589e3-3ac4-499f-a5a9-620c6efa7f0b,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:30:15.803269 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-30d7074c-1181-4644-b5cc-ac1f4e865acd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:15.835515 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] Set router 4310b7c2-6f1e-4838-bdb6-245416900ec5 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:30:15.842591 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-26549c83-d8b9-4e53-921e-d22b3ddce643 admin admin] Allocated IP 172.20.0.1 (dddb6458-4699-45f3-afbf-66e168e093fa/34856fdf-2a32-48b3-9f67-7cd8c8d39875/d79bdb0d-daf1-4af3-967c-0210fc9a4e20) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:30:15.852403 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30d7074c-1181-4644-b5cc-ac1f4e865acd None None] Pushing event updated for resources: {'Port': ['ID=ab7589e3-3ac4-499f-a5a9-620c6efa7f0b,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:15.927466 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a4f365c9-ac96-4aa7-9b4d-7bbe40474daa None None] Provisioning complete for port ab7589e3-3ac4-499f-a5a9-620c6efa7f0b triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:15.928186 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4f365c9-ac96-4aa7-9b4d-7bbe40474daa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:15.957121 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-26549c83-d8b9-4e53-921e-d22b3ddce643 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:15.993787 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-26549c83-d8b9-4e53-921e-d22b3ddce643 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:16.020427 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'name': 'tempest-TestShelveInstance-1687017519-router', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169'}], 'enable_snat': True}, 'gw_port_id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:14Z', 'revision_number': 3, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'gw_port': {'id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:7a:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4313, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:16.032038 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-26549c83-d8b9-4e53-921e-d22b3ddce643 admin admin] Network dddb6458-4699-45f3-afbf-66e168e093fa is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:30:16.036322 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-26549c83-d8b9-4e53-921e-d22b3ddce643 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:30:16.038793 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-26549c83-d8b9-4e53-921e-d22b3ddce643 admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:30:16.067943 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26549c83-d8b9-4e53-921e-d22b3ddce643 admin admin] Pushing event updated for resources: {'Port': ['ID=d79bdb0d-daf1-4af3-967c-0210fc9a4e20,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:16.090206 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-26549c83-d8b9-4e53-921e-d22b3ddce643 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:16.148819 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4a58ccc-5cbf-4e09-9ac4-cb8cdcd30466 None None] The sync data for ids ['4310b7c2-6f1e-4838-bdb6-245416900ec5'] in n-d-713301-27 is: [{'id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'name': 'tempest-TestShelveInstance-1687017519-router', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169'}], 'enable_snat': True}, 'gw_port_id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:14Z', 'revision_number': 3, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'gw_port': {'id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:7a:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4313, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:30:16.235793 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-26549c83-d8b9-4e53-921e-d22b3ddce643 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:16.332442 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2128bf79-2250-4192-8444-43df5b36bf58 None None] Provisioning complete for port d79bdb0d-daf1-4af3-967c-0210fc9a4e20 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:16.332807 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2128bf79-2250-4192-8444-43df5b36bf58 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:16.380897 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-2128bf79-2250-4192-8444-43df5b36bf58 None None] Port d79bdb0d-daf1-4af3-967c-0210fc9a4e20 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:30:16.421791 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-26549c83-d8b9-4e53-921e-d22b3ddce643 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:16.428217 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-26549c83-d8b9-4e53-921e-d22b3ddce643 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:16.504869 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-26549c83-d8b9-4e53-921e-d22b3ddce643 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:16.506666 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26549c83-d8b9-4e53-921e-d22b3ddce643 admin admin] Pushing event updated for resources: {'Port': ['ID=d79bdb0d-daf1-4af3-967c-0210fc9a4e20,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:16.608158 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-26549c83-d8b9-4e53-921e-d22b3ddce643 admin admin] Network dddb6458-4699-45f3-afbf-66e168e093fa is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:30:16.609914 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-26549c83-d8b9-4e53-921e-d22b3ddce643 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:30:16.662575 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 22d2cda2-1aee-4741-aaa9-f376a689c587 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:30:16.729233 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 22d2cda2-1aee-4741-aaa9-f376a689c587 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:16.729693 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:16.752285 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-26549c83-d8b9-4e53-921e-d22b3ddce643 admin admin] Router 4310b7c2-6f1e-4838-bdb6-245416900ec5 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:30:16.839391 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device ab7589e3-3ac4-499f-a5a9-620c6efa7f0b up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:30:16.884899 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-26549c83-d8b9-4e53-921e-d22b3ddce643 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:30:16.890431 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-26549c83-d8b9-4e53-921e-d22b3ddce643 admin admin] 10.222.0.13 "PUT /v2.0/routers/4310b7c2-6f1e-4838-bdb6-245416900ec5/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0118134 Dec 09 22:30:16.893524 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port ab7589e3-3ac4-499f-a5a9-620c6efa7f0b triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:16.893899 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:16.945628 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-281a4133-95bb-445f-8534-2c4484b6ef10 None None] Provisioning complete for port d79bdb0d-daf1-4af3-967c-0210fc9a4e20 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:16.945999 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-281a4133-95bb-445f-8534-2c4484b6ef10 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:16.986544 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-281a4133-95bb-445f-8534-2c4484b6ef10 None None] Port d79bdb0d-daf1-4af3-967c-0210fc9a4e20 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:30:17.408459 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34950) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:17.413544 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-918a9c59-922e-4f8a-925b-35a873eb7701 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-805458701-network', 'tenant_id': '80979eed9a074d9a890d6761b2538311'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:30:17.437863 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-918a9c59-922e-4f8a-925b-35a873eb7701 admin admin] Made reservation on behalf of 80979eed9a074d9a890d6761b2538311 for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:30:17.440410 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-918a9c59-922e-4f8a-925b-35a873eb7701 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:17.449450 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-918a9c59-922e-4f8a-925b-35a873eb7701 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:17.538843 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-918a9c59-922e-4f8a-925b-35a873eb7701 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:17.544237 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-918a9c59-922e-4f8a-925b-35a873eb7701 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:17.573337 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-918a9c59-922e-4f8a-925b-35a873eb7701 admin admin] vlan segment allocate from pool success with {'vlan_id': 126, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 22:30:17.578803 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-918a9c59-922e-4f8a-925b-35a873eb7701 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bb679aef-43f2-4619-92fd-3e97b78cffdd,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:17.586346 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-918a9c59-922e-4f8a-925b-35a873eb7701 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:17.586691 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-918a9c59-922e-4f8a-925b-35a873eb7701 admin admin] Added segment 05593618-d741-4754-9d4e-6f1c26ff7d96 of type vlan for network 49f82d18-7db3-40ef-89a6-99a393947ef5 Dec 09 22:30:17.628709 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-918a9c59-922e-4f8a-925b-35a873eb7701 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:17.654876 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-918a9c59-922e-4f8a-925b-35a873eb7701 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:17.655937 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-918a9c59-922e-4f8a-925b-35a873eb7701 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:17.656509 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-918a9c59-922e-4f8a-925b-35a873eb7701 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:17.692325 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-918a9c59-922e-4f8a-925b-35a873eb7701 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.2826548 Dec 09 22:30:17.695271 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34952) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:17.702009 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-ad439b24-e506-40e8-8281-f1118029a655 admin admin] Request body: {'subnet': {'network_id': '49f82d18-7db3-40ef-89a6-99a393947ef5', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-805458701-subnet', 'tenant_id': '80979eed9a074d9a890d6761b2538311', 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:30:17.724569 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-918a9c59-922e-4f8a-925b-35a873eb7701 admin admin] Pushing event updated for resources: {'Network': ['ID=49f82d18-7db3-40ef-89a6-99a393947ef5,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:17.726189 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ad439b24-e506-40e8-8281-f1118029a655 admin admin] Made reservation on behalf of 80979eed9a074d9a890d6761b2538311 for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:30:17.729928 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ad439b24-e506-40e8-8281-f1118029a655 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:17.736241 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 49f82d18-7db3-40ef-89a6-99a393947ef5 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 22:30:17.834185 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] Sync routers for ids ['4310b7c2-6f1e-4838-bdb6-245416900ec5'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:30:17.845002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] Routers {'4310b7c2-6f1e-4838-bdb6-245416900ec5'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:30:17.845624 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:30:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4310b7c2-6f1e-4838-bdb6-245416900ec5'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:17.901978 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ad439b24-e506-40e8-8281-f1118029a655 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:17.959804 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad439b24-e506-40e8-8281-f1118029a655 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5d9f7177-37b6-464b-8d56-4689fcfa7eae,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:17.968539 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ad439b24-e506-40e8-8281-f1118029a655 admin admin] Checking segment: {'id': '05593618-d741-4754-9d4e-6f1c26ff7d96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '49f82d18-7db3-40ef-89a6-99a393947ef5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:30:17.968890 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad439b24-e506-40e8-8281-f1118029a655 admin admin] Network hostable DHCP agents. Network: 49f82d18-7db3-40ef-89a6-99a393947ef5, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 22:30:17.986426 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad439b24-e506-40e8-8281-f1118029a655 admin admin] Network 49f82d18-7db3-40ef-89a6-99a393947ef5 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 22:30:17.998770 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-ad439b24-e506-40e8-8281-f1118029a655 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 49f82d18-7db3-40ef-89a6-99a393947ef5) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:30:18.003844 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad439b24-e506-40e8-8281-f1118029a655 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:18.004465 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ad439b24-e506-40e8-8281-f1118029a655 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:18.023356 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ad439b24-e506-40e8-8281-f1118029a655 admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.3253837 Dec 09 22:30:18.026349 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34954) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:18.030873 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-067315f2-41e0-47e4-9add-455130808834 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-805458701-router', 'tenant_id': '80979eed9a074d9a890d6761b2538311', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:30:18.054779 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-067315f2-41e0-47e4-9add-455130808834 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:18.055737 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-067315f2-41e0-47e4-9add-455130808834 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:18.103837 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1863a7c5-7d51-4285-92d8-99177c3ae080 None None] Network 49f82d18-7db3-40ef-89a6-99a393947ef5 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:30:18.115975 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-067315f2-41e0-47e4-9add-455130808834 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:18.146797 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] Set router 4310b7c2-6f1e-4838-bdb6-245416900ec5 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:30:18.251594 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-067315f2-41e0-47e4-9add-455130808834 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:18.288259 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c71d2cc3-c89b-41d3-8399-07b4f76d190b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-49f82d18-7db3-40ef-89a6-99a393947ef5', 'network_id': '49f82d18-7db3-40ef-89a6-99a393947ef5', 'project_id': '80979eed9a074d9a890d6761b2538311', 'fixed_ips': [{'subnet_id': '5d9f7177-37b6-464b-8d56-4689fcfa7eae'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 22:30:18.289842 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c71d2cc3-c89b-41d3-8399-07b4f76d190b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:18.466310 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-067315f2-41e0-47e4-9add-455130808834 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:18.484967 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-067315f2-41e0-47e4-9add-455130808834 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:18.501954 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-c71d2cc3-c89b-41d3-8399-07b4f76d190b None None] Allocated IP 172.20.0.2 (49f82d18-7db3-40ef-89a6-99a393947ef5/5d9f7177-37b6-464b-8d56-4689fcfa7eae/3553343e-0d39-4956-98fd-56646fa7305d) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:30:18.521733 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'name': 'tempest-TestShelveInstance-1687017519-router', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169'}], 'enable_snat': True}, 'gw_port_id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:16Z', 'revision_number': 4, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'gw_port': {'id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:7a:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4313, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'd79bdb0d-daf1-4af3-967c-0210fc9a4e20', 'name': '', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'mac_address': 'fa:16:3e:cb:a6:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_interface', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:15Z', 'updated_at': '2021-12-09T22:30:16Z', 'revision_number': 2, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'subnets': [{'id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:18.557808 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] Checking router: 4310b7c2-6f1e-4838-bdb6-245416900ec5 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:30:18.558519 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] Updating router 4310b7c2-6f1e-4838-bdb6-245416900ec5 port d79bdb0d-daf1-4af3-967c-0210fc9a4e20 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:30:18.595138 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-067315f2-41e0-47e4-9add-455130808834 admin admin] Allocated IP 172.25.3.209 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/79b66d9f-11c7-4910-9824-df5cfda46c13) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:30:18.622880 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:18.701031 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-067315f2-41e0-47e4-9add-455130808834 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:18.737633 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-067315f2-41e0-47e4-9add-455130808834 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:18.774303 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-067315f2-41e0-47e4-9add-455130808834 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:30:18.778803 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-067315f2-41e0-47e4-9add-455130808834 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:30:18.781335 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-067315f2-41e0-47e4-9add-455130808834 admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:30:18.783551 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c71d2cc3-c89b-41d3-8399-07b4f76d190b None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:18.796167 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c71d2cc3-c89b-41d3-8399-07b4f76d190b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:18.812751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7943cfbd-7e8d-4ee3-981f-289d2c8b8d8c None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:30:18.815576 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-067315f2-41e0-47e4-9add-455130808834 admin admin] Pushing event updated for resources: {'Port': ['ID=79b66d9f-11c7-4910-9824-df5cfda46c13,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:18.895973 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c71d2cc3-c89b-41d3-8399-07b4f76d190b None None] Network 49f82d18-7db3-40ef-89a6-99a393947ef5 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:30:18.905082 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-c71d2cc3-c89b-41d3-8399-07b4f76d190b None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:30:18.909557 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c71d2cc3-c89b-41d3-8399-07b4f76d190b None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:30:18.910501 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c71d2cc3-c89b-41d3-8399-07b4f76d190b None None] Pushing event updated for resources: {'Port': ['ID=3553343e-0d39-4956-98fd-56646fa7305d,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:18.998354 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1bbd9020-e39a-43dd-857c-461d769735b7 None None] Provisioning complete for port 79b66d9f-11c7-4910-9824-df5cfda46c13 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:18.998607 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1bbd9020-e39a-43dd-857c-461d769735b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:19.048857 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-c71d2cc3-c89b-41d3-8399-07b4f76d190b None None] Attempting to bind port 3553343e-0d39-4956-98fd-56646fa7305d on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:30:19.049191 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-c71d2cc3-c89b-41d3-8399-07b4f76d190b None None] Attempting to bind port 3553343e-0d39-4956-98fd-56646fa7305d by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '05593618-d741-4754-9d4e-6f1c26ff7d96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '49f82d18-7db3-40ef-89a6-99a393947ef5'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:30:19.049541 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c71d2cc3-c89b-41d3-8399-07b4f76d190b None None] Attempting to bind port 3553343e-0d39-4956-98fd-56646fa7305d on network 49f82d18-7db3-40ef-89a6-99a393947ef5 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:30:19.069229 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-067315f2-41e0-47e4-9add-455130808834 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:19.081029 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-1bbd9020-e39a-43dd-857c-461d769735b7 None None] Port 79b66d9f-11c7-4910-9824-df5cfda46c13 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:30:19.085412 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c71d2cc3-c89b-41d3-8399-07b4f76d190b None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 30, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:30:19.085784 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c71d2cc3-c89b-41d3-8399-07b4f76d190b None None] Checking segment: {'id': '05593618-d741-4754-9d4e-6f1c26ff7d96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '49f82d18-7db3-40ef-89a6-99a393947ef5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:30:19.086178 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c71d2cc3-c89b-41d3-8399-07b4f76d190b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:19.086556 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c71d2cc3-c89b-41d3-8399-07b4f76d190b None None] Bound using segment: {'id': '05593618-d741-4754-9d4e-6f1c26ff7d96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '49f82d18-7db3-40ef-89a6-99a393947ef5'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:30:19.087031 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-c71d2cc3-c89b-41d3-8399-07b4f76d190b None None] Bound port: 3553343e-0d39-4956-98fd-56646fa7305d, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '05593618-d741-4754-9d4e-6f1c26ff7d96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '49f82d18-7db3-40ef-89a6-99a393947ef5'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:30:19.087401 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c71d2cc3-c89b-41d3-8399-07b4f76d190b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:19.134750 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:19.143848 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:19.210487 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c71d2cc3-c89b-41d3-8399-07b4f76d190b None None] For port 3553343e-0d39-4956-98fd-56646fa7305d, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:30:19.230080 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ced65ed5-bd24-47e3-9583-025a87da0fc5 None None] Pushing event updated for resources: {'Port': ['ID=d79bdb0d-daf1-4af3-967c-0210fc9a4e20,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:19.238890 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-c71d2cc3-c89b-41d3-8399-07b4f76d190b None None] For port 3553343e-0d39-4956-98fd-56646fa7305d, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=3553343e-0d39-4956-98fd-56646fa7305d,segment=NetworkSegment(05593618-d741-4754-9d4e-6f1c26ff7d96),segment_id=05593618-d741-4754-9d4e-6f1c26ff7d96)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:30:19.267563 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c71d2cc3-c89b-41d3-8399-07b4f76d190b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:19.269940 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-067315f2-41e0-47e4-9add-455130808834 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:19.333600 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] Attempting to bind port d79bdb0d-daf1-4af3-967c-0210fc9a4e20 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:30:19.333973 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] Attempting to bind port d79bdb0d-daf1-4af3-967c-0210fc9a4e20 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '4fd32693-bdb8-493a-a8d8-5bd83c6f9f80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:30:19.334336 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] Attempting to bind port d79bdb0d-daf1-4af3-967c-0210fc9a4e20 on network dddb6458-4699-45f3-afbf-66e168e093fa {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:30:19.347821 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 30, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:30:19.348236 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] Checking segment: {'id': '4fd32693-bdb8-493a-a8d8-5bd83c6f9f80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:30:19.348589 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:19.348982 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] Bound using segment: {'id': '4fd32693-bdb8-493a-a8d8-5bd83c6f9f80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:30:19.349558 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] Bound port: d79bdb0d-daf1-4af3-967c-0210fc9a4e20, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4fd32693-bdb8-493a-a8d8-5bd83c6f9f80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:30:19.349838 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:19.370625 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c71d2cc3-c89b-41d3-8399-07b4f76d190b None None] Pushing event updated for resources: {'Port': ['ID=3553343e-0d39-4956-98fd-56646fa7305d,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:19.416901 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-067315f2-41e0-47e4-9add-455130808834 admin admin] Router 37786c5f-ddff-4682-92be-b41ee0fdaeb8 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 22:30:19.435852 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] For port d79bdb0d-daf1-4af3-967c-0210fc9a4e20, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:30:19.440279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] For port d79bdb0d-daf1-4af3-967c-0210fc9a4e20, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d79bdb0d-daf1-4af3-967c-0210fc9a4e20,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:30:19.446342 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:19.523197 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] Routers {'4310b7c2-6f1e-4838-bdb6-245416900ec5'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:30:19.523884 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:30:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4310b7c2-6f1e-4838-bdb6-245416900ec5'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:19.542062 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-067315f2-41e0-47e4-9add-455130808834 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:30:19.557666 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] Sync routers for ids ['37786c5f-ddff-4682-92be-b41ee0fdaeb8'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:30:19.572512 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-067315f2-41e0-47e4-9add-455130808834 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:19.574087 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-067315f2-41e0-47e4-9add-455130808834 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 1.5467775 Dec 09 22:30:19.577120 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34956) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:19.590537 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] Routers {'37786c5f-ddff-4682-92be-b41ee0fdaeb8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:30:19.593330 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:30:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['37786c5f-ddff-4682-92be-b41ee0fdaeb8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:19.599363 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ced65ed5-bd24-47e3-9583-025a87da0fc5 None None] Pushing event updated for resources: {'Port': ['ID=d79bdb0d-daf1-4af3-967c-0210fc9a4e20,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:19.648286 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-e313b5c2-19a2-46de-8825-d3d82d66acb8 None None] Provisioning complete for port d79bdb0d-daf1-4af3-967c-0210fc9a4e20 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:19.648476 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e313b5c2-19a2-46de-8825-d3d82d66acb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:19.725077 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] Set router 4310b7c2-6f1e-4838-bdb6-245416900ec5 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:30:19.749374 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] Set router 37786c5f-ddff-4682-92be-b41ee0fdaeb8 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:30:19.937783 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e313b5c2-19a2-46de-8825-d3d82d66acb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:19.949469 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '37786c5f-ddff-4682-92be-b41ee0fdaeb8', 'name': 'tempest-TestShelveInstance-805458701-router', 'tenant_id': '80979eed9a074d9a890d6761b2538311', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.209'}], 'enable_snat': True}, 'gw_port_id': '79b66d9f-11c7-4910-9824-df5cfda46c13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:18Z', 'updated_at': '2021-12-09T22:30:18Z', 'revision_number': 3, 'project_id': '80979eed9a074d9a890d6761b2538311', 'gw_port': {'id': '79b66d9f-11c7-4910-9824-df5cfda46c13', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:cf:03', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '37786c5f-ddff-4682-92be-b41ee0fdaeb8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4325, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:18Z', 'updated_at': '2021-12-09T22:30:18Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:19.979996 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] Checking router: 37786c5f-ddff-4682-92be-b41ee0fdaeb8 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:30:19.980438 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] Updating router 37786c5f-ddff-4682-92be-b41ee0fdaeb8 port 79b66d9f-11c7-4910-9824-df5cfda46c13 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:30:20.001727 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-e313b5c2-19a2-46de-8825-d3d82d66acb8 None None] For port d79bdb0d-daf1-4af3-967c-0210fc9a4e20, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d79bdb0d-daf1-4af3-967c-0210fc9a4e20,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:30:20.008033 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:20.012131 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e313b5c2-19a2-46de-8825-d3d82d66acb8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:20.067465 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e313b5c2-19a2-46de-8825-d3d82d66acb8 None None] Pushing event updated for resources: {'Port': ['ID=d79bdb0d-daf1-4af3-967c-0210fc9a4e20,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:20.083111 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'name': 'tempest-TestShelveInstance-1687017519-router', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169'}], 'enable_snat': True}, 'gw_port_id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:16Z', 'revision_number': 4, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'gw_port': {'id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:7a:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4313, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'd79bdb0d-daf1-4af3-967c-0210fc9a4e20', 'name': '', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'mac_address': 'fa:16:3e:cb:a6:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_interface', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:15Z', 'updated_at': '2021-12-09T22:30:19Z', 'revision_number': 4, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'subnets': [{'id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:20.102417 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0f7f6478-db0b-4a7c-8a6c-48acf13d56cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:20.112659 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a85070ba-1c08-44b9-86db-0974b94e2fec None None] The sync data for ids ['4310b7c2-6f1e-4838-bdb6-245416900ec5'] in n-d-713301-27 is: [{'id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'name': 'tempest-TestShelveInstance-1687017519-router', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169'}], 'enable_snat': True}, 'gw_port_id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:16Z', 'revision_number': 4, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'gw_port': {'id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:7a:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4313, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'd79bdb0d-daf1-4af3-967c-0210fc9a4e20', 'name': '', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'mac_address': 'fa:16:3e:cb:a6:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_interface', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:15Z', 'updated_at': '2021-12-09T22:30:19Z', 'revision_number': 4, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'subnets': [{'id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:30:20.138272 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-127b5807-e598-4a5e-bd44-19c7130ec2d0 None None] Provisioning complete for port d79bdb0d-daf1-4af3-967c-0210fc9a4e20 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:20.138933 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-127b5807-e598-4a5e-bd44-19c7130ec2d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:20.320808 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-0f7f6478-db0b-4a7c-8a6c-48acf13d56cd admin admin] Allocated IP 172.20.0.1 (49f82d18-7db3-40ef-89a6-99a393947ef5/5d9f7177-37b6-464b-8d56-4689fcfa7eae/f3ac5e98-37d0-48ca-9851-ec4831fdf253) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:30:20.348736 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:20.361907 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:20.405776 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0466f35e-c4a2-44c1-88f6-84f2e390fffb None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:30:20.413013 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] Attempting to bind port 79b66d9f-11c7-4910-9824-df5cfda46c13 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:30:20.413647 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] Attempting to bind port 79b66d9f-11c7-4910-9824-df5cfda46c13 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:30:20.414181 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] Attempting to bind port 79b66d9f-11c7-4910-9824-df5cfda46c13 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:30:20.424612 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 30, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:30:20.425105 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:30:20.425683 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:20.426282 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:30:20.427043 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] Bound port: 79b66d9f-11c7-4910-9824-df5cfda46c13, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:30:20.427418 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:20.473248 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0f7f6478-db0b-4a7c-8a6c-48acf13d56cd admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:20.487597 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] For port 79b66d9f-11c7-4910-9824-df5cfda46c13, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:30:20.491656 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] For port 79b66d9f-11c7-4910-9824-df5cfda46c13, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=79b66d9f-11c7-4910-9824-df5cfda46c13,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:30:20.498004 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a82097e-27ea-4ee3-8c8f-ebc5cfb89966 None None] Pushing event updated for resources: {'Port': ['ID=79b66d9f-11c7-4910-9824-df5cfda46c13,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:20.503635 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:20.510965 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-da2c4810-55e0-4b85-8242-ee5472e42cdc None None] Provisioning complete for port 79b66d9f-11c7-4910-9824-df5cfda46c13 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:20.511338 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-da2c4810-55e0-4b85-8242-ee5472e42cdc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:20.562980 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0f7f6478-db0b-4a7c-8a6c-48acf13d56cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:20.567663 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] Routers {'37786c5f-ddff-4682-92be-b41ee0fdaeb8'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:30:20.568369 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:30:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['37786c5f-ddff-4682-92be-b41ee0fdaeb8'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:20.606219 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6178d2a9-8fd8-4ac8-aa64-9ea74ad06028 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:30:20.666739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f7f6478-db0b-4a7c-8a6c-48acf13d56cd admin admin] Pushing event updated for resources: {'Port': ['ID=f3ac5e98-37d0-48ca-9851-ec4831fdf253,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:20.706295 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f7f6478-db0b-4a7c-8a6c-48acf13d56cd admin admin] Network 49f82d18-7db3-40ef-89a6-99a393947ef5 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:30:20.706886 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-da2c4810-55e0-4b85-8242-ee5472e42cdc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:20.707844 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-0f7f6478-db0b-4a7c-8a6c-48acf13d56cd admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:30:20.718235 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f7f6478-db0b-4a7c-8a6c-48acf13d56cd admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:30:20.740356 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-da2c4810-55e0-4b85-8242-ee5472e42cdc None None] For port 79b66d9f-11c7-4910-9824-df5cfda46c13, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=79b66d9f-11c7-4910-9824-df5cfda46c13,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:30:20.748058 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-da2c4810-55e0-4b85-8242-ee5472e42cdc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:20.756399 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a82097e-27ea-4ee3-8c8f-ebc5cfb89966 None None] Pushing event updated for resources: {'Port': ['ID=79b66d9f-11c7-4910-9824-df5cfda46c13,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:20.770197 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] Set router 37786c5f-ddff-4682-92be-b41ee0fdaeb8 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:30:20.789081 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0f7f6478-db0b-4a7c-8a6c-48acf13d56cd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:20.982770 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0f7f6478-db0b-4a7c-8a6c-48acf13d56cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:20.983406 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 3553343e-0d39-4956-98fd-56646fa7305d up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:30:20.985612 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-951399a5-6ea0-48b8-ab5e-08882e571336 None None] Network 49f82d18-7db3-40ef-89a6-99a393947ef5 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:30:20.996430 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '37786c5f-ddff-4682-92be-b41ee0fdaeb8', 'name': 'tempest-TestShelveInstance-805458701-router', 'tenant_id': '80979eed9a074d9a890d6761b2538311', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.209'}], 'enable_snat': True}, 'gw_port_id': '79b66d9f-11c7-4910-9824-df5cfda46c13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:18Z', 'updated_at': '2021-12-09T22:30:18Z', 'revision_number': 3, 'project_id': '80979eed9a074d9a890d6761b2538311', 'gw_port': {'id': '79b66d9f-11c7-4910-9824-df5cfda46c13', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:cf:03', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '37786c5f-ddff-4682-92be-b41ee0fdaeb8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4325, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:18Z', 'updated_at': '2021-12-09T22:30:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:21.029879 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f39bc7db-ea77-4e65-92f4-41cb734c08c8 None None] The sync data for ids ['37786c5f-ddff-4682-92be-b41ee0fdaeb8'] in n-d-713301-27 is: [{'id': '37786c5f-ddff-4682-92be-b41ee0fdaeb8', 'name': 'tempest-TestShelveInstance-805458701-router', 'tenant_id': '80979eed9a074d9a890d6761b2538311', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.209'}], 'enable_snat': True}, 'gw_port_id': '79b66d9f-11c7-4910-9824-df5cfda46c13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:18Z', 'updated_at': '2021-12-09T22:30:18Z', 'revision_number': 3, 'project_id': '80979eed9a074d9a890d6761b2538311', 'gw_port': {'id': '79b66d9f-11c7-4910-9824-df5cfda46c13', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:cf:03', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '37786c5f-ddff-4682-92be-b41ee0fdaeb8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4325, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:18Z', 'updated_at': '2021-12-09T22:30:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:30:21.064032 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da2c4810-55e0-4b85-8242-ee5472e42cdc None None] Pushing event updated for resources: {'Port': ['ID=79b66d9f-11c7-4910-9824-df5cfda46c13,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:21.109955 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1767851a-6039-4d1c-b694-cb28a635ad68 None None] Provisioning complete for port 79b66d9f-11c7-4910-9824-df5cfda46c13 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:21.110342 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1767851a-6039-4d1c-b694-cb28a635ad68 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:21.196241 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 3553343e-0d39-4956-98fd-56646fa7305d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:21.196613 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:21.204870 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0f7f6478-db0b-4a7c-8a6c-48acf13d56cd admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:21.212064 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0f7f6478-db0b-4a7c-8a6c-48acf13d56cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:21.294218 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f7f6478-db0b-4a7c-8a6c-48acf13d56cd admin admin] Pushing event updated for resources: {'Port': ['ID=f3ac5e98-37d0-48ca-9851-ec4831fdf253,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:21.301493 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1767851a-6039-4d1c-b694-cb28a635ad68 None None] Provisioning complete for port 3553343e-0d39-4956-98fd-56646fa7305d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:21.303277 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1767851a-6039-4d1c-b694-cb28a635ad68 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:21.304559 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0f7f6478-db0b-4a7c-8a6c-48acf13d56cd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:21.415189 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:21.455167 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f7f6478-db0b-4a7c-8a6c-48acf13d56cd admin admin] Network 49f82d18-7db3-40ef-89a6-99a393947ef5 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:30:21.459543 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-0f7f6478-db0b-4a7c-8a6c-48acf13d56cd admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:30:21.488206 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1767851a-6039-4d1c-b694-cb28a635ad68 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:21.557247 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 3553343e-0d39-4956-98fd-56646fa7305d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=3553343e-0d39-4956-98fd-56646fa7305d,segment=NetworkSegment(05593618-d741-4754-9d4e-6f1c26ff7d96),segment_id=05593618-d741-4754-9d4e-6f1c26ff7d96)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:30:21.570402 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:21.571714 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d79bdb0d-daf1-4af3-967c-0210fc9a4e20 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:30:21.633451 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0f7f6478-db0b-4a7c-8a6c-48acf13d56cd admin admin] Router 37786c5f-ddff-4682-92be-b41ee0fdaeb8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:30:21.751951 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=3553343e-0d39-4956-98fd-56646fa7305d,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:21.755939 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-1767851a-6039-4d1c-b694-cb28a635ad68 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 22:30:21.756431 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-1767851a-6039-4d1c-b694-cb28a635ad68 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 22:30:21.765955 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0f7f6478-db0b-4a7c-8a6c-48acf13d56cd admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:30:21.780307 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0f7f6478-db0b-4a7c-8a6c-48acf13d56cd admin admin] 10.222.0.13 "PUT /v2.0/routers/37786c5f-ddff-4682-92be-b41ee0fdaeb8/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1929755 Dec 09 22:30:21.780562 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port d79bdb0d-daf1-4af3-967c-0210fc9a4e20 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:21.797108 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:22.418179 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3ce5dfcc-0930-4e3e-a716-700c810af91c None None] Provisioning complete for port 3553343e-0d39-4956-98fd-56646fa7305d triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:22.418873 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3ce5dfcc-0930-4e3e-a716-700c810af91c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:22.506665 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-3ce5dfcc-0930-4e3e-a716-700c810af91c None None] Provisioning complete for port f3ac5e98-37d0-48ca-9851-ec4831fdf253 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:22.507162 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3ce5dfcc-0930-4e3e-a716-700c810af91c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:22.548218 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-3ce5dfcc-0930-4e3e-a716-700c810af91c None None] Port f3ac5e98-37d0-48ca-9851-ec4831fdf253 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:30:22.636000 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34964) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:22.640931 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-38423972-3bb2-48a4-a371-22efccb65b9c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-687207857', 'description': 'tempest-secgroup-smoke-687207857 description', 'project_id': '2f75126e83f04a8eb56e531ea19960e3'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:30:22.647843 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 3553343e-0d39-4956-98fd-56646fa7305d up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:30:22.665764 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-38423972-3bb2-48a4-a371-22efccb65b9c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:22.699011 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 3553343e-0d39-4956-98fd-56646fa7305d triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:22.699363 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:22.738042 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-38423972-3bb2-48a4-a371-22efccb65b9c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:22.743005 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-38423972-3bb2-48a4-a371-22efccb65b9c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:22.774752 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-38423972-3bb2-48a4-a371-22efccb65b9c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:22.776356 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-38423972-3bb2-48a4-a371-22efccb65b9c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.1391685 Dec 09 22:30:22.777241 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38423972-3bb2-48a4-a371-22efccb65b9c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2418dd74-008a-49c9-8dfc-3d491a922a03,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:22.779482 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34966) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:22.783789 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-0dd4cdcd-9a38-4657-9b29-4725a668b8cd tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Request body: {'security_group_rule': {'security_group_id': '2418dd74-008a-49c9-8dfc-3d491a922a03', 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:30:22.791308 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 79b66d9f-11c7-4910-9824-df5cfda46c13 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:30:22.812027 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0dd4cdcd-9a38-4657-9b29-4725a668b8cd tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:22.841956 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 79b66d9f-11c7-4910-9824-df5cfda46c13 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:22.842326 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:22.874237 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0dd4cdcd-9a38-4657-9b29-4725a668b8cd tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:22.879409 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0dd4cdcd-9a38-4657-9b29-4725a668b8cd tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:22.902645 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dd4cdcd-9a38-4657-9b29-4725a668b8cd tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bb801ffe-2a4c-4047-973a-2d674ceb651c,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:22.909147 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-0dd4cdcd-9a38-4657-9b29-4725a668b8cd tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:22.910366 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-0dd4cdcd-9a38-4657-9b29-4725a668b8cd tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1299951 Dec 09 22:30:22.913222 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34968) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:22.917904 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-5add95eb-bde1-44dd-970b-9d13d7df903f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Request body: {'security_group_rule': {'security_group_id': '2418dd74-008a-49c9-8dfc-3d491a922a03', 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:30:22.950038 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5add95eb-bde1-44dd-970b-9d13d7df903f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:23.007322 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5add95eb-bde1-44dd-970b-9d13d7df903f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:23.011761 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5add95eb-bde1-44dd-970b-9d13d7df903f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:23.028804 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5add95eb-bde1-44dd-970b-9d13d7df903f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f0432e0c-7742-4ceb-aaff-bc3431a15b09,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:23.039164 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-5add95eb-bde1-44dd-970b-9d13d7df903f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:23.040388 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-5add95eb-bde1-44dd-970b-9d13d7df903f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1262221 Dec 09 22:30:23.043266 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34970) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:23.047626 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-fb41544c-400d-4fe3-ab9e-7f7af8d9cd17 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Request body: {'security_group_rule': {'security_group_id': '2418dd74-008a-49c9-8dfc-3d491a922a03', 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:30:23.074835 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fb41544c-400d-4fe3-ab9e-7f7af8d9cd17 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:23.138540 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fb41544c-400d-4fe3-ab9e-7f7af8d9cd17 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:23.143896 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fb41544c-400d-4fe3-ab9e-7f7af8d9cd17 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:23.162189 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb41544c-400d-4fe3-ab9e-7f7af8d9cd17 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6e8c1ba3-3e26-4287-98a2-1bf0e2d1262c,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:23.171148 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-fb41544c-400d-4fe3-ab9e-7f7af8d9cd17 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:23.172429 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fb41544c-400d-4fe3-ab9e-7f7af8d9cd17 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1281698 Dec 09 22:30:23.175205 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 34972) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:23.179691 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-053269ec-8b40-4941-85c9-3dc24d5f4e59 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Request body: {'security_group_rule': {'security_group_id': '2418dd74-008a-49c9-8dfc-3d491a922a03', 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:30:23.206792 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-053269ec-8b40-4941-85c9-3dc24d5f4e59 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:23.262897 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-053269ec-8b40-4941-85c9-3dc24d5f4e59 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:23.268121 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-053269ec-8b40-4941-85c9-3dc24d5f4e59 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:23.287574 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-053269ec-8b40-4941-85c9-3dc24d5f4e59 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=356b7753-5614-44a5-adfb-e5f4a5c25be2,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:23.296855 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-053269ec-8b40-4941-85c9-3dc24d5f4e59 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:23.298094 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-053269ec-8b40-4941-85c9-3dc24d5f4e59 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1219580 Dec 09 22:30:23.302055 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34974) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:23.306827 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c25cce9f-9892-4b4a-a87d-6aa7130bda78 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Request body: {'security_group_rule': {'security_group_id': '2418dd74-008a-49c9-8dfc-3d491a922a03', 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:30:23.330624 n-d-713301-27 neutron-server[103438]: INFO neutron.db.securitygroups_db [None req-c25cce9f-9892-4b4a-a87d-6aa7130bda78 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Project 2f75126e83f04a8eb56e531ea19960e3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 22:30:23.335743 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c25cce9f-9892-4b4a-a87d-6aa7130bda78 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:23.403893 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c25cce9f-9892-4b4a-a87d-6aa7130bda78 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:23.408807 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c25cce9f-9892-4b4a-a87d-6aa7130bda78 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:23.427673 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c25cce9f-9892-4b4a-a87d-6aa7130bda78 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7feeb600-bdbc-4fd1-8c0b-1472c17ec288,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:23.436654 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c25cce9f-9892-4b4a-a87d-6aa7130bda78 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:23.437884 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c25cce9f-9892-4b4a-a87d-6aa7130bda78 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1348407 Dec 09 22:30:23.440664 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 34976) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:23.445123 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c262964f-a128-4520-a6f9-a9a7f0dafa5f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Request body: {'security_group_rule': {'security_group_id': '2418dd74-008a-49c9-8dfc-3d491a922a03', 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:30:23.469407 n-d-713301-27 neutron-server[103438]: INFO neutron.db.securitygroups_db [None req-c262964f-a128-4520-a6f9-a9a7f0dafa5f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Project 2f75126e83f04a8eb56e531ea19960e3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 22:30:23.474947 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c262964f-a128-4520-a6f9-a9a7f0dafa5f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:23.539800 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c262964f-a128-4520-a6f9-a9a7f0dafa5f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:23.544377 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c262964f-a128-4520-a6f9-a9a7f0dafa5f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:23.562355 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c262964f-a128-4520-a6f9-a9a7f0dafa5f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3c5730ed-170e-459a-8882-68fca6b6de26,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:23.570761 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c262964f-a128-4520-a6f9-a9a7f0dafa5f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:23.572104 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c262964f-a128-4520-a6f9-a9a7f0dafa5f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1303401 Dec 09 22:30:23.690738 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] Sync routers for ids ['37786c5f-ddff-4682-92be-b41ee0fdaeb8'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:30:23.702282 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] Routers {'37786c5f-ddff-4682-92be-b41ee0fdaeb8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:30:23.703033 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:30:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['37786c5f-ddff-4682-92be-b41ee0fdaeb8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:23.729096 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-d0724699-303c-4ecd-b2fe-6f8ac410a98d tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-687207857&fields=id&tenant_id=2f75126e83f04a8eb56e531ea19960e3 HTTP/1.1" status: 200 len: 267 time: 0.0502040 Dec 09 22:30:23.816768 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] Set router 37786c5f-ddff-4682-92be-b41ee0fdaeb8 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:30:23.847919 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-e4e048c3-ddd1-4700-b58f-91c87f487847 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:23.849760 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-e4e048c3-ddd1-4700-b58f-91c87f487847 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/networks?id=dddb6458-4699-45f3-afbf-66e168e093fa HTTP/1.1" status: 200 len: 809 time: 0.1132884 Dec 09 22:30:23.865171 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-1581fd26-a995-4d41-9e75-cb8f2ad49e75 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/quotas/2f75126e83f04a8eb56e531ea19960e3 HTTP/1.1" status: 200 len: 375 time: 0.0094891 Dec 09 22:30:24.033691 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '37786c5f-ddff-4682-92be-b41ee0fdaeb8', 'name': 'tempest-TestShelveInstance-805458701-router', 'tenant_id': '80979eed9a074d9a890d6761b2538311', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.209'}], 'enable_snat': True}, 'gw_port_id': '79b66d9f-11c7-4910-9824-df5cfda46c13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:18Z', 'updated_at': '2021-12-09T22:30:20Z', 'revision_number': 4, 'project_id': '80979eed9a074d9a890d6761b2538311', 'gw_port': {'id': '79b66d9f-11c7-4910-9824-df5cfda46c13', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:cf:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '37786c5f-ddff-4682-92be-b41ee0fdaeb8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4325, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:18Z', 'updated_at': '2021-12-09T22:30:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'f3ac5e98-37d0-48ca-9851-ec4831fdf253', 'name': '', 'network_id': '49f82d18-7db3-40ef-89a6-99a393947ef5', 'tenant_id': '80979eed9a074d9a890d6761b2538311', 'mac_address': 'fa:16:3e:ed:e1:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '37786c5f-ddff-4682-92be-b41ee0fdaeb8', 'device_owner': 'network:router_interface', 'standard_attr_id': 4326, 'fixed_ips': [{'subnet_id': '5d9f7177-37b6-464b-8d56-4689fcfa7eae', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:20Z', 'updated_at': '2021-12-09T22:30:21Z', 'revision_number': 2, 'project_id': '80979eed9a074d9a890d6761b2538311', 'subnets': [{'id': '5d9f7177-37b6-464b-8d56-4689fcfa7eae', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:24.061397 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] Checking router: 37786c5f-ddff-4682-92be-b41ee0fdaeb8 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:30:24.061754 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] Updating router 37786c5f-ddff-4682-92be-b41ee0fdaeb8 port f3ac5e98-37d0-48ca-9851-ec4831fdf253 binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:30:24.088743 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:24.253948 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-e9d704e4-5507-40a5-b604-e5c9459fda2b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=2f75126e83f04a8eb56e531ea19960e3&fields=id HTTP/1.1" status: 200 len: 302 time: 0.3827443 Dec 09 22:30:24.348713 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-a732ce93-6759-4f93-82af-1a5a5c8bc2f4 service neutron] 10.222.0.13 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0824060 Dec 09 22:30:24.361262 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:24.367846 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:24.421651 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40ce909b-55d9-40f8-a050-b7226ddc2ea3 None None] Pushing event updated for resources: {'Port': ['ID=f3ac5e98-37d0-48ca-9851-ec4831fdf253,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:24.450537 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-5d81b689-4734-4c96-93af-ae703bdeef7e service neutron] 10.222.0.13 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0951414 Dec 09 22:30:24.471116 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] Attempting to bind port f3ac5e98-37d0-48ca-9851-ec4831fdf253 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:30:24.471351 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] Attempting to bind port f3ac5e98-37d0-48ca-9851-ec4831fdf253 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '05593618-d741-4754-9d4e-6f1c26ff7d96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '49f82d18-7db3-40ef-89a6-99a393947ef5'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:30:24.471751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] Attempting to bind port f3ac5e98-37d0-48ca-9851-ec4831fdf253 on network 49f82d18-7db3-40ef-89a6-99a393947ef5 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:30:24.477568 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 30, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:30:24.477939 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] Checking segment: {'id': '05593618-d741-4754-9d4e-6f1c26ff7d96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '49f82d18-7db3-40ef-89a6-99a393947ef5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:30:24.478862 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:24.479267 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] Bound using segment: {'id': '05593618-d741-4754-9d4e-6f1c26ff7d96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '49f82d18-7db3-40ef-89a6-99a393947ef5'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:30:24.479969 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] Bound port: f3ac5e98-37d0-48ca-9851-ec4831fdf253, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '05593618-d741-4754-9d4e-6f1c26ff7d96', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 126, 'network_id': '49f82d18-7db3-40ef-89a6-99a393947ef5'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:30:24.480379 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:24.549940 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] For port f3ac5e98-37d0-48ca-9851-ec4831fdf253, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:30:24.553476 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] For port f3ac5e98-37d0-48ca-9851-ec4831fdf253, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f3ac5e98-37d0-48ca-9851-ec4831fdf253,segment=NetworkSegment(05593618-d741-4754-9d4e-6f1c26ff7d96),segment_id=05593618-d741-4754-9d4e-6f1c26ff7d96)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:30:24.558823 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:24.620665 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] Routers {'37786c5f-ddff-4682-92be-b41ee0fdaeb8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:30:24.621307 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:30:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['37786c5f-ddff-4682-92be-b41ee0fdaeb8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:24.624448 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40ce909b-55d9-40f8-a050-b7226ddc2ea3 None None] Pushing event updated for resources: {'Port': ['ID=f3ac5e98-37d0-48ca-9851-ec4831fdf253,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:24.657279 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b887673e-a170-4d51-82ca-b01a060fc053 req-95aa3f31-301d-44b1-a89b-533014d081fe tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 210 time: 0.0330391 Dec 09 22:30:24.725983 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-94f08b66-1e30-42de-a878-e88e2f220a48 None None] Provisioning complete for port f3ac5e98-37d0-48ca-9851-ec4831fdf253 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:24.726460 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-94f08b66-1e30-42de-a878-e88e2f220a48 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:24.774838 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] Set router 37786c5f-ddff-4682-92be-b41ee0fdaeb8 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:30:24.911964 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-94f08b66-1e30-42de-a878-e88e2f220a48 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:25.167994 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-94f08b66-1e30-42de-a878-e88e2f220a48 None None] For port f3ac5e98-37d0-48ca-9851-ec4831fdf253, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f3ac5e98-37d0-48ca-9851-ec4831fdf253,segment=NetworkSegment(05593618-d741-4754-9d4e-6f1c26ff7d96),segment_id=05593618-d741-4754-9d4e-6f1c26ff7d96)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:30:25.174764 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-94f08b66-1e30-42de-a878-e88e2f220a48 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:25.248175 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94f08b66-1e30-42de-a878-e88e2f220a48 None None] Pushing event updated for resources: {'Port': ['ID=f3ac5e98-37d0-48ca-9851-ec4831fdf253,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:25.263897 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '37786c5f-ddff-4682-92be-b41ee0fdaeb8', 'name': 'tempest-TestShelveInstance-805458701-router', 'tenant_id': '80979eed9a074d9a890d6761b2538311', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.209'}], 'enable_snat': True}, 'gw_port_id': '79b66d9f-11c7-4910-9824-df5cfda46c13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:18Z', 'updated_at': '2021-12-09T22:30:20Z', 'revision_number': 4, 'project_id': '80979eed9a074d9a890d6761b2538311', 'gw_port': {'id': '79b66d9f-11c7-4910-9824-df5cfda46c13', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:cf:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '37786c5f-ddff-4682-92be-b41ee0fdaeb8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4325, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:18Z', 'updated_at': '2021-12-09T22:30:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'f3ac5e98-37d0-48ca-9851-ec4831fdf253', 'name': '', 'network_id': '49f82d18-7db3-40ef-89a6-99a393947ef5', 'tenant_id': '80979eed9a074d9a890d6761b2538311', 'mac_address': 'fa:16:3e:ed:e1:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '37786c5f-ddff-4682-92be-b41ee0fdaeb8', 'device_owner': 'network:router_interface', 'standard_attr_id': 4326, 'fixed_ips': [{'subnet_id': '5d9f7177-37b6-464b-8d56-4689fcfa7eae', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:20Z', 'updated_at': '2021-12-09T22:30:24Z', 'revision_number': 4, 'project_id': '80979eed9a074d9a890d6761b2538311', 'subnets': [{'id': '5d9f7177-37b6-464b-8d56-4689fcfa7eae', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:25.303337 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70a04e06-7135-40d8-8587-a0aa43424939 None None] The sync data for ids ['37786c5f-ddff-4682-92be-b41ee0fdaeb8'] in n-d-713301-27 is: [{'id': '37786c5f-ddff-4682-92be-b41ee0fdaeb8', 'name': 'tempest-TestShelveInstance-805458701-router', 'tenant_id': '80979eed9a074d9a890d6761b2538311', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.209'}], 'enable_snat': True}, 'gw_port_id': '79b66d9f-11c7-4910-9824-df5cfda46c13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:18Z', 'updated_at': '2021-12-09T22:30:20Z', 'revision_number': 4, 'project_id': '80979eed9a074d9a890d6761b2538311', 'gw_port': {'id': '79b66d9f-11c7-4910-9824-df5cfda46c13', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:cf:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '37786c5f-ddff-4682-92be-b41ee0fdaeb8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4325, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:18Z', 'updated_at': '2021-12-09T22:30:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'f3ac5e98-37d0-48ca-9851-ec4831fdf253', 'name': '', 'network_id': '49f82d18-7db3-40ef-89a6-99a393947ef5', 'tenant_id': '80979eed9a074d9a890d6761b2538311', 'mac_address': 'fa:16:3e:ed:e1:c9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '37786c5f-ddff-4682-92be-b41ee0fdaeb8', 'device_owner': 'network:router_interface', 'standard_attr_id': 4326, 'fixed_ips': [{'subnet_id': '5d9f7177-37b6-464b-8d56-4689fcfa7eae', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:20Z', 'updated_at': '2021-12-09T22:30:24Z', 'revision_number': 4, 'project_id': '80979eed9a074d9a890d6761b2538311', 'subnets': [{'id': '5d9f7177-37b6-464b-8d56-4689fcfa7eae', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:30:25.314396 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a4aa9be3-be31-44e2-8807-d7a2f0f25d51 None None] Provisioning complete for port f3ac5e98-37d0-48ca-9851-ec4831fdf253 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:25.314768 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a4aa9be3-be31-44e2-8807-d7a2f0f25d51 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:25.695546 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-f72a28ea-e84b-415e-80be-1003381f25de tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:25.697344 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-f72a28ea-e84b-415e-80be-1003381f25de tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.31 "GET /v2.0/networks?id=dddb6458-4699-45f3-afbf-66e168e093fa HTTP/1.1" status: 200 len: 809 time: 0.1224229 Dec 09 22:30:25.768642 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-54700c1d-6884-487c-94f2-6e5b47e5ccc9 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2f75126e83f04a8eb56e531ea19960e3 HTTP/1.1" status: 200 len: 379 time: 0.0623350 Dec 09 22:30:25.776368 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9f54c47e-2c97-4829-b80b-f0d9f14bd442 req-b1ff86a0-bdaf-4b7e-9349-999b223db8b2 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 210 time: 0.0299444 Dec 09 22:30:25.780731 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-a570cc63-02ad-4761-b5c7-1b64388b2956 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Request body: {'port': {'device_id': 'fdb9f136-4581-4ba3-8bcf-3012bb1c01a1', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'admin_state_up': True, 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'security_groups': ['2418dd74-008a-49c9-8dfc-3d491a922a03']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:30:25.903580 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-a570cc63-02ad-4761-b5c7-1b64388b2956 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Made reservation on behalf of 2f75126e83f04a8eb56e531ea19960e3 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:30:25.907224 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-a570cc63-02ad-4761-b5c7-1b64388b2956 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:26.034236 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-a570cc63-02ad-4761-b5c7-1b64388b2956 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Allocated IP 172.20.0.14 (dddb6458-4699-45f3-afbf-66e168e093fa/34856fdf-2a32-48b3-9f67-7cd8c8d39875/cc6a95f2-7fb9-4017-b8da-f9a084d5d0da) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:30:26.184196 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-a570cc63-02ad-4761-b5c7-1b64388b2956 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:26.219659 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-a570cc63-02ad-4761-b5c7-1b64388b2956 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:26.258447 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-a570cc63-02ad-4761-b5c7-1b64388b2956 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Network dddb6458-4699-45f3-afbf-66e168e093fa is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:30:26.261941 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-a570cc63-02ad-4761-b5c7-1b64388b2956 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:30:26.264400 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-a570cc63-02ad-4761-b5c7-1b64388b2956 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:30:26.315596 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a570cc63-02ad-4761-b5c7-1b64388b2956 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event updated for resources: {'Port': ['ID=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:26.337022 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-a570cc63-02ad-4761-b5c7-1b64388b2956 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:26.337779 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-a570cc63-02ad-4761-b5c7-1b64388b2956 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:26.355302 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-a570cc63-02ad-4761-b5c7-1b64388b2956 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5786080 Dec 09 22:30:26.368650 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-98a589e3-c350-4748-9a66-af0a69b3a62e service neutron] Request body: {'port': {'device_id': 'fdb9f136-4581-4ba3-8bcf-3012bb1c01a1', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:30:26.426091 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-98a589e3-c350-4748-9a66-af0a69b3a62e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:26.537771 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-25e3902b-a164-49cc-9b56-0bb640470b37 None None] Provisioning complete for port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:26.538338 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-25e3902b-a164-49cc-9b56-0bb640470b37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:26.582013 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-25e3902b-a164-49cc-9b56-0bb640470b37 None None] Port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:30:26.591093 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f3ac5e98-37d0-48ca-9851-ec4831fdf253 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:30:26.641782 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port f3ac5e98-37d0-48ca-9851-ec4831fdf253 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:26.642155 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:26.702863 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-98a589e3-c350-4748-9a66-af0a69b3a62e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cc6a95f2-7fb9-4017-b8da-f9a084d5d0da {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:30:26.710444 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-98a589e3-c350-4748-9a66-af0a69b3a62e service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:26.722674 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-98a589e3-c350-4748-9a66-af0a69b3a62e service neutron] Transition to ACTIVE for port object cc6a95f2-7fb9-4017-b8da-f9a084d5d0da will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:30:26.726520 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-98a589e3-c350-4748-9a66-af0a69b3a62e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:26.778097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98a589e3-c350-4748-9a66-af0a69b3a62e service neutron] Pushing event updated for resources: {'Port': ['ID=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:26.856430 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-98a589e3-c350-4748-9a66-af0a69b3a62e service neutron] Attempting to bind port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:30:26.856775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-98a589e3-c350-4748-9a66-af0a69b3a62e service neutron] Attempting to bind port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '4fd32693-bdb8-493a-a8d8-5bd83c6f9f80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:30:26.857097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-98a589e3-c350-4748-9a66-af0a69b3a62e service neutron] Attempting to bind port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da on network dddb6458-4699-45f3-afbf-66e168e093fa {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:30:26.862091 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-98a589e3-c350-4748-9a66-af0a69b3a62e service neutron] Port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da on network dddb6458-4699-45f3-afbf-66e168e093fa not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:30:26.862412 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-98a589e3-c350-4748-9a66-af0a69b3a62e service neutron] Attempting to bind port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da on network dddb6458-4699-45f3-afbf-66e168e093fa {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:30:26.870604 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-98a589e3-c350-4748-9a66-af0a69b3a62e service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 29, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:30:26.870954 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-98a589e3-c350-4748-9a66-af0a69b3a62e service neutron] Checking segment: {'id': '4fd32693-bdb8-493a-a8d8-5bd83c6f9f80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:30:26.871506 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-98a589e3-c350-4748-9a66-af0a69b3a62e service neutron] Bound using segment: {'id': '4fd32693-bdb8-493a-a8d8-5bd83c6f9f80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:30:26.872226 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-98a589e3-c350-4748-9a66-af0a69b3a62e service neutron] Bound port: cc6a95f2-7fb9-4017-b8da-f9a084d5d0da, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4fd32693-bdb8-493a-a8d8-5bd83c6f9f80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:30:26.872677 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-98a589e3-c350-4748-9a66-af0a69b3a62e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:26.911956 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d61f6185-fe7f-46c5-9098-bfd2847663c9 req-a88e65d6-377e-4748-8cbf-574d00208728 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:26.915904 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d61f6185-fe7f-46c5-9098-bfd2847663c9 req-a88e65d6-377e-4748-8cbf-574d00208728 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 944 time: 0.0594702 Dec 09 22:30:26.954307 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-98a589e3-c350-4748-9a66-af0a69b3a62e service neutron] For port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:30:26.958160 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-98a589e3-c350-4748-9a66-af0a69b3a62e service neutron] For port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:30:26.964124 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-98a589e3-c350-4748-9a66-af0a69b3a62e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:26.979984 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d61f6185-fe7f-46c5-9098-bfd2847663c9 req-95feaebb-12e0-4f50-ae33-f5c80da202f9 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0595593 Dec 09 22:30:27.006343 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-98a589e3-c350-4748-9a66-af0a69b3a62e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:27.006828 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-98a589e3-c350-4748-9a66-af0a69b3a62e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:27.008270 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-98a589e3-c350-4748-9a66-af0a69b3a62e service neutron] 10.222.0.31 "PUT /v2.0/ports/cc6a95f2-7fb9-4017-b8da-f9a084d5d0da HTTP/1.1" status: 200 len: 1093 time: 0.6439748 Dec 09 22:30:27.008743 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fdb9f136-4581-4ba3-8bcf-3012bb1c01a1', 'tag': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:30:27.011431 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-92f0778f-11ea-4e21-a1ab-78b485b03047" -d '{"events": [{"name": "network-changed", "server_uuid": "fdb9f136-4581-4ba3-8bcf-3012bb1c01a1", "tag": "cc6a95f2-7fb9-4017-b8da-f9a084d5d0da"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:30:27.040983 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98a589e3-c350-4748-9a66-af0a69b3a62e service neutron] Pushing event updated for resources: {'Port': ['ID=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:27.064417 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:30:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-639b0c4a-8373-48f0-9ce5-b727dc04c4cc x-openstack-request-id: req-639b0c4a-8373-48f0-9ce5-b727dc04c4cc {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:30:27.064711 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fdb9f136-4581-4ba3-8bcf-3012bb1c01a1", "tag": "cc6a95f2-7fb9-4017-b8da-f9a084d5d0da", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:30:27.064964 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-639b0c4a-8373-48f0-9ce5-b727dc04c4cc {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:30:27.065372 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fdb9f136-4581-4ba3-8bcf-3012bb1c01a1', 'tag': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da', 'status': 'completed', 'code': 200} Dec 09 22:30:27.103312 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-9bcf3e48-a01f-4c1f-bdb1-99261a9f857c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:27.105103 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-9bcf3e48-a01f-4c1f-bdb1-99261a9f857c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2f75126e83f04a8eb56e531ea19960e3&device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 1096 time: 0.0504389 Dec 09 22:30:27.152980 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-d2d5ad12-b65a-4d3b-84ce-f1b315fec51c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da HTTP/1.1" status: 200 len: 217 time: 0.0399611 Dec 09 22:30:27.205121 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-8d4b8096-33ae-4a48-b0ec-9ad55bbb957f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:27.206643 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-8d4b8096-33ae-4a48-b0ec-9ad55bbb957f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=34856fdf-2a32-48b3-9f67-7cd8c8d39875 HTTP/1.1" status: 200 len: 848 time: 0.0469289 Dec 09 22:30:27.254691 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-304890fa-41d2-4715-b026-3839915e9341 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:27.256257 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-304890fa-41d2-4715-b026-3839915e9341 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=dddb6458-4699-45f3-afbf-66e168e093fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0422976 Dec 09 22:30:27.355002 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-4dcf7821-d86b-42d6-9cf2-03b3f201f5b4 service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0899665 Dec 09 22:30:27.455844 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cf9142fa-b383-43c3-8c6e-b6eba225872c req-0889657c-f4e2-4772-8025-ab449b1eff70 service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0940275 Dec 09 22:30:27.544451 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92f0778f-11ea-4e21-a1ab-78b485b03047 req-10fb0735-bbd9-4ed6-a939-306a8b0c183d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:27.546725 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92f0778f-11ea-4e21-a1ab-78b485b03047 req-10fb0735-bbd9-4ed6-a939-306a8b0c183d service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2f75126e83f04a8eb56e531ea19960e3&device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 1096 time: 0.0454700 Dec 09 22:30:27.645819 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92f0778f-11ea-4e21-a1ab-78b485b03047 req-eb238ff9-592b-4594-92ec-692c72142106 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:27.647328 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92f0778f-11ea-4e21-a1ab-78b485b03047 req-eb238ff9-592b-4594-92ec-692c72142106 service neutron] 10.222.0.31 "GET /v2.0/networks?id=dddb6458-4699-45f3-afbf-66e168e093fa HTTP/1.1" status: 200 len: 910 time: 0.0942967 Dec 09 22:30:27.700210 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92f0778f-11ea-4e21-a1ab-78b485b03047 req-661064fe-88cc-4ca2-bcf6-ab1db506ca0c service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da HTTP/1.1" status: 200 len: 217 time: 0.0439727 Dec 09 22:30:27.754631 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92f0778f-11ea-4e21-a1ab-78b485b03047 req-137b1c6b-80c4-40c8-ae52-d8b1064eb7ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:27.756097 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92f0778f-11ea-4e21-a1ab-78b485b03047 req-137b1c6b-80c4-40c8-ae52-d8b1064eb7ec service neutron] 10.222.0.31 "GET /v2.0/subnets?id=34856fdf-2a32-48b3-9f67-7cd8c8d39875 HTTP/1.1" status: 200 len: 848 time: 0.0485091 Dec 09 22:30:27.798921 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:27.810098 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92f0778f-11ea-4e21-a1ab-78b485b03047 req-12c23c14-c96b-49ed-8272-258fe1e47e33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:27.811674 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92f0778f-11ea-4e21-a1ab-78b485b03047 req-12c23c14-c96b-49ed-8272-258fe1e47e33 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=dddb6458-4699-45f3-afbf-66e168e093fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0484893 Dec 09 22:30:27.897448 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:27.918183 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92f0778f-11ea-4e21-a1ab-78b485b03047 req-e6723607-d7f4-4f8f-9427-58237ad5dd52 service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0983140 Dec 09 22:30:28.017222 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-92f0778f-11ea-4e21-a1ab-78b485b03047 req-7fabdd8d-744f-43bf-89a7-9c53375f045d service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0913808 Dec 09 22:30:28.102428 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-779e5679-5d9d-4ca1-a6ea-6804458b438a req-88bf77bc-fd3f-4af7-97fe-292ff136241a tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:28.104350 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-779e5679-5d9d-4ca1-a6ea-6804458b438a req-88bf77bc-fd3f-4af7-97fe-292ff136241a tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 944 time: 0.0531771 Dec 09 22:30:28.154654 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-779e5679-5d9d-4ca1-a6ea-6804458b438a req-677a138f-e5c8-4c43-8a04-b2b469d4ce5b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441322 Dec 09 22:30:29.281639 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc30b225-0937-466a-aee2-553d6f28c3e4 req-b8d2b0af-88b6-4a0f-8471-dec3f8b8d9aa tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:29.283121 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc30b225-0937-466a-aee2-553d6f28c3e4 req-b8d2b0af-88b6-4a0f-8471-dec3f8b8d9aa tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 944 time: 0.0577648 Dec 09 22:30:29.337117 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-dc30b225-0937-466a-aee2-553d6f28c3e4 req-2e396a44-d18c-4e57-87fa-9da0f4a8b5a6 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0478566 Dec 09 22:30:30.469837 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c31313e-2791-46b6-b763-29ab99fe6c69 req-47d4e606-4032-48ec-b1d1-aa77ce74093b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:30.471309 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1c31313e-2791-46b6-b763-29ab99fe6c69 req-47d4e606-4032-48ec-b1d1-aa77ce74093b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 944 time: 0.0517483 Dec 09 22:30:30.523710 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1c31313e-2791-46b6-b763-29ab99fe6c69 req-4ca19606-4bb3-48d2-bcd4-af05f68036fd tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433474 Dec 09 22:30:30.529102 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device cc6a95f2-7fb9-4017-b8da-f9a084d5d0da details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:30:30.629318 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:30:30.640718 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'port_id': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da', 'mac_address': 'fa:16:3e:b2:d3:d3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 106, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:30:30.686029 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:30.699202 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cc6a95f2-7fb9-4017-b8da-f9a084d5d0da {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:30:30.718736 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:30:30.726765 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:30.778942 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:30.930082 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['cc6a95f2-7fb9-4017-b8da-f9a084d5d0da'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:30:31.646552 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f08d22e3-1bc4-42d9-a6d1-2d1e52f32f29 req-c3fa25de-4ca0-4a62-a32b-aa540e12f290 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:31.648077 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f08d22e3-1bc4-42d9-a6d1-2d1e52f32f29 req-c3fa25de-4ca0-4a62-a32b-aa540e12f290 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 945 time: 0.0493014 Dec 09 22:30:31.697291 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f08d22e3-1bc4-42d9-a6d1-2d1e52f32f29 req-cc9f35aa-4162-4f9d-96e3-ac2b33966924 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427637 Dec 09 22:30:32.546279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device cc6a95f2-7fb9-4017-b8da-f9a084d5d0da up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:30:32.607862 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:30:32.611500 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:30:32.611914 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:32.693283 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:32.716059 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fdb9f136-4581-4ba3-8bcf-3012bb1c01a1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:30:32.718326 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dd1b4fea-641d-49e2-b958-73e0f0fb4701" -d '{"events": [{"server_uuid": "fdb9f136-4581-4ba3-8bcf-3012bb1c01a1", "name": "network-vif-plugged", "status": "completed", "tag": "cc6a95f2-7fb9-4017-b8da-f9a084d5d0da"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:30:32.732345 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:30:32.738110 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:32.761475 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:30:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-83ef5948-acb5-4a59-aef1-0b3491d238ea x-openstack-request-id: req-83ef5948-acb5-4a59-aef1-0b3491d238ea {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:30:32.761754 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fdb9f136-4581-4ba3-8bcf-3012bb1c01a1", "name": "network-vif-plugged", "status": "completed", "tag": "cc6a95f2-7fb9-4017-b8da-f9a084d5d0da", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:30:32.762098 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-83ef5948-acb5-4a59-aef1-0b3491d238ea {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:30:32.762499 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fdb9f136-4581-4ba3-8bcf-3012bb1c01a1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da', 'code': 200} Dec 09 22:30:32.797019 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:32.867539 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4632643-ba3d-49f8-a4df-02ad0cd18731 req-ad9d672e-d4d9-4a73-938a-c0c8c36b2fce tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:32.869055 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d4632643-ba3d-49f8-a4df-02ad0cd18731 req-ad9d672e-d4d9-4a73-938a-c0c8c36b2fce tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0551629 Dec 09 22:30:32.871824 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faebbe73-e62d-4733-b78d-d95f6ffc8092 req-4bf5170e-f3a5-4a63-8873-dbff406319b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:32.873316 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-faebbe73-e62d-4733-b78d-d95f6ffc8092 req-4bf5170e-f3a5-4a63-8873-dbff406319b6 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 1098 time: 0.0397723 Dec 09 22:30:32.918838 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d4632643-ba3d-49f8-a4df-02ad0cd18731 req-317f5cbc-2d84-4122-b5aa-e7bb984cfaed tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433216 Dec 09 22:30:32.922663 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-faebbe73-e62d-4733-b78d-d95f6ffc8092 req-6b29c7c4-4419-454d-affa-70ede7fe93b8 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424204 Dec 09 22:30:33.073888 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5584083e-8e34-497d-a48d-6c4ce0e6a9a6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:34.037513 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3b9ddf6-d808-462a-8b0c-c37d76dbd0c5 req-c4f47aba-59af-4b57-b979-312dd15b051a tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:34.039796 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3b9ddf6-d808-462a-8b0c-c37d76dbd0c5 req-c4f47aba-59af-4b57-b979-312dd15b051a tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0520470 Dec 09 22:30:34.100822 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3b9ddf6-d808-462a-8b0c-c37d76dbd0c5 req-76e71110-0a73-4b92-be7f-ea75d8de1e19 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0545681 Dec 09 22:30:34.222133 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00d614df-13ea-4f68-ae04-b9ffaa64e667 req-0cfdc75e-a699-4b45-bae4-564a6ba228fd tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:34.223668 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-00d614df-13ea-4f68-ae04-b9ffaa64e667 req-0cfdc75e-a699-4b45-bae4-564a6ba228fd tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0571737 Dec 09 22:30:34.275782 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-00d614df-13ea-4f68-ae04-b9ffaa64e667 req-fdf26ba2-c2cb-405e-bf22-504add322131 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431802 Dec 09 22:30:34.299503 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35026) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:34.438866 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39cb545a-303c-453f-aac9-69358f06bd4d tempest-TestShelveInstance-1473918196 tempest-TestShelveInstance-1473918196-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:34.440482 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-39cb545a-303c-453f-aac9-69358f06bd4d tempest-TestShelveInstance-1473918196 tempest-TestShelveInstance-1473918196-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 1093 time: 0.1400456 Dec 09 22:30:34.444788 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35030) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:30:34.449135 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-48da3bfa-14b7-4d09-a519-b889e8f84314 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'fixed_ip_address': '172.20.0.14'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:30:34.477990 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-48da3bfa-14b7-4d09-a519-b889e8f84314 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:34.601182 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-48da3bfa-14b7-4d09-a519-b889e8f84314 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:34.707813 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-48da3bfa-14b7-4d09-a519-b889e8f84314 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Allocated IP 172.25.3.38 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/3cac460c-f013-4687-9e9d-d6c6a744d5f0) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:30:34.817604 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-48da3bfa-14b7-4d09-a519-b889e8f84314 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:34.859065 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-48da3bfa-14b7-4d09-a519-b889e8f84314 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:34.899119 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48da3bfa-14b7-4d09-a519-b889e8f84314 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:30:34.904470 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-48da3bfa-14b7-4d09-a519-b889e8f84314 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:30:34.907192 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48da3bfa-14b7-4d09-a519-b889e8f84314 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:30:34.913497 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48da3bfa-14b7-4d09-a519-b889e8f84314 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event updated for resources: {'Port': ['ID=3cac460c-f013-4687-9e9d-d6c6a744d5f0,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:35.298317 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-48da3bfa-14b7-4d09-a519-b889e8f84314 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:35.377541 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-48da3bfa-14b7-4d09-a519-b889e8f84314 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:35.527909 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-48da3bfa-14b7-4d09-a519-b889e8f84314 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:35.536001 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-48da3bfa-14b7-4d09-a519-b889e8f84314 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:35.613786 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48da3bfa-14b7-4d09-a519-b889e8f84314 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event updated for resources: {'Port': ['ID=3cac460c-f013-4687-9e9d-d6c6a744d5f0,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:30:35.624342 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-48da3bfa-14b7-4d09-a519-b889e8f84314 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:35.666486 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b483a4da-86d2-4765-9242-1431523cb835 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:35.721216 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-48da3bfa-14b7-4d09-a519-b889e8f84314 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Floating IP 7253d0fb-ed8f-40a8-a5fe-4bfc7daca645 associated. External IP: 172.25.3.38, port: cc6a95f2-7fb9-4017-b8da-f9a084d5d0da. Dec 09 22:30:35.931742 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-48da3bfa-14b7-4d09-a519-b889e8f84314 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Router 4310b7c2-6f1e-4838-bdb6-245416900ec5 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:30:36.051383 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-48da3bfa-14b7-4d09-a519-b889e8f84314 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:30:36.062799 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d564c4a4-05e6-4360-ba29-1620449cbb78 None None] Sync routers for ids ['4310b7c2-6f1e-4838-bdb6-245416900ec5'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:30:36.071340 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-48da3bfa-14b7-4d09-a519-b889e8f84314 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:36.073551 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d564c4a4-05e6-4360-ba29-1620449cbb78 None None] Routers {'4310b7c2-6f1e-4838-bdb6-245416900ec5'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:30:36.074232 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d564c4a4-05e6-4360-ba29-1620449cbb78 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:30:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4310b7c2-6f1e-4838-bdb6-245416900ec5'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:36.099958 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-48da3bfa-14b7-4d09-a519-b889e8f84314 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.6539850 Dec 09 22:30:36.100548 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fdb9f136-4581-4ba3-8bcf-3012bb1c01a1', 'tag': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:30:36.103034 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0962455b-c117-4b8a-aba8-8fec3119e6b7" -d '{"events": [{"name": "network-changed", "server_uuid": "fdb9f136-4581-4ba3-8bcf-3012bb1c01a1", "tag": "cc6a95f2-7fb9-4017-b8da-f9a084d5d0da"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:30:36.140787 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:30:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8197fefa-cd48-4193-b717-df02168d2323 x-openstack-request-id: req-8197fefa-cd48-4193-b717-df02168d2323 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:30:36.141055 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fdb9f136-4581-4ba3-8bcf-3012bb1c01a1", "tag": "cc6a95f2-7fb9-4017-b8da-f9a084d5d0da", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:30:36.141311 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8197fefa-cd48-4193-b717-df02168d2323 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:30:36.141725 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fdb9f136-4581-4ba3-8bcf-3012bb1c01a1', 'tag': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da', 'status': 'completed', 'code': 200} Dec 09 22:30:36.184953 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-d564c4a4-05e6-4360-ba29-1620449cbb78 None None] Set router 4310b7c2-6f1e-4838-bdb6-245416900ec5 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:30:36.206421 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0962455b-c117-4b8a-aba8-8fec3119e6b7 req-dbd93d3c-c73f-4a74-8897-5ae8d8d9785e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:36.208064 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0962455b-c117-4b8a-aba8-8fec3119e6b7 req-dbd93d3c-c73f-4a74-8897-5ae8d8d9785e service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2f75126e83f04a8eb56e531ea19960e3&device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 1098 time: 0.0413020 Dec 09 22:30:36.298068 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0962455b-c117-4b8a-aba8-8fec3119e6b7 req-61ec05c4-3aed-44db-874d-8365f0d6e9ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:36.299594 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0962455b-c117-4b8a-aba8-8fec3119e6b7 req-61ec05c4-3aed-44db-874d-8365f0d6e9ea service neutron] 10.222.0.31 "GET /v2.0/networks?id=dddb6458-4699-45f3-afbf-66e168e093fa HTTP/1.1" status: 200 len: 910 time: 0.0833352 Dec 09 22:30:36.411975 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d564c4a4-05e6-4360-ba29-1620449cbb78 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'name': 'tempest-TestShelveInstance-1687017519-router', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169'}], 'enable_snat': True}, 'gw_port_id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:16Z', 'revision_number': 4, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'gw_port': {'id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:7a:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4313, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '7253d0fb-ed8f-40a8-a5fe-4bfc7daca645', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'floating_ip_address': '172.25.3.38', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'port_id': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 4338, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'mac_address': 'fa:16:3e:b2:d3:d3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fdb9f136-4581-4ba3-8bcf-3012bb1c01a1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:30:35Z', 'updated_at': '2021-12-09T22:30:35Z', 'revision_number': 0, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd79bdb0d-daf1-4af3-967c-0210fc9a4e20', 'name': '', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'mac_address': 'fa:16:3e:cb:a6:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_interface', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:15Z', 'updated_at': '2021-12-09T22:30:19Z', 'revision_number': 5, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'subnets': [{'id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:36.546618 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d564c4a4-05e6-4360-ba29-1620449cbb78 None None] Checking router: 4310b7c2-6f1e-4838-bdb6-245416900ec5 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:30:36.556074 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d564c4a4-05e6-4360-ba29-1620449cbb78 None None] Routers {'4310b7c2-6f1e-4838-bdb6-245416900ec5'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:30:36.556699 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d564c4a4-05e6-4360-ba29-1620449cbb78 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:30:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4310b7c2-6f1e-4838-bdb6-245416900ec5'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:36.670263 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-d564c4a4-05e6-4360-ba29-1620449cbb78 None None] Set router 4310b7c2-6f1e-4838-bdb6-245416900ec5 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:30:36.731743 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0962455b-c117-4b8a-aba8-8fec3119e6b7 req-105b381c-a2df-4960-a306-c0898dce6c68 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da HTTP/1.1" status: 200 len: 999 time: 0.4252059 Dec 09 22:30:36.780658 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0962455b-c117-4b8a-aba8-8fec3119e6b7 req-6c4c3f47-91c7-46e3-9404-aa6c632c9114 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:36.782124 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0962455b-c117-4b8a-aba8-8fec3119e6b7 req-6c4c3f47-91c7-46e3-9404-aa6c632c9114 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=34856fdf-2a32-48b3-9f67-7cd8c8d39875 HTTP/1.1" status: 200 len: 848 time: 0.0434086 Dec 09 22:30:36.831354 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0962455b-c117-4b8a-aba8-8fec3119e6b7 req-f7be32bd-5b5c-4e99-acfe-785b74661256 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:30:36.832961 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0962455b-c117-4b8a-aba8-8fec3119e6b7 req-f7be32bd-5b5c-4e99-acfe-785b74661256 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=dddb6458-4699-45f3-afbf-66e168e093fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0441263 Dec 09 22:30:36.900645 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-d564c4a4-05e6-4360-ba29-1620449cbb78 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'name': 'tempest-TestShelveInstance-1687017519-router', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169'}], 'enable_snat': True}, 'gw_port_id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:16Z', 'revision_number': 4, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'gw_port': {'id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:7a:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4313, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '7253d0fb-ed8f-40a8-a5fe-4bfc7daca645', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'floating_ip_address': '172.25.3.38', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'port_id': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 4338, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'mac_address': 'fa:16:3e:b2:d3:d3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fdb9f136-4581-4ba3-8bcf-3012bb1c01a1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:30:35Z', 'updated_at': '2021-12-09T22:30:35Z', 'revision_number': 0, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd79bdb0d-daf1-4af3-967c-0210fc9a4e20', 'name': '', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'mac_address': 'fa:16:3e:cb:a6:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_interface', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:15Z', 'updated_at': '2021-12-09T22:30:19Z', 'revision_number': 5, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'subnets': [{'id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:30:36.923768 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:36.929638 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0962455b-c117-4b8a-aba8-8fec3119e6b7 req-63ae1907-9755-4e6d-a96f-54b194b5df1d service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0884459 Dec 09 22:30:36.934441 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d564c4a4-05e6-4360-ba29-1620449cbb78 None None] The sync data for ids ['4310b7c2-6f1e-4838-bdb6-245416900ec5'] in n-d-713301-27 is: [{'id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'name': 'tempest-TestShelveInstance-1687017519-router', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169'}], 'enable_snat': True}, 'gw_port_id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:16Z', 'revision_number': 4, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'gw_port': {'id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:7a:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4313, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '7253d0fb-ed8f-40a8-a5fe-4bfc7daca645', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'floating_ip_address': '172.25.3.38', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'port_id': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 4338, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'mac_address': 'fa:16:3e:b2:d3:d3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fdb9f136-4581-4ba3-8bcf-3012bb1c01a1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:30:35Z', 'updated_at': '2021-12-09T22:30:35Z', 'revision_number': 0, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd79bdb0d-daf1-4af3-967c-0210fc9a4e20', 'name': '', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'mac_address': 'fa:16:3e:cb:a6:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_interface', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:15Z', 'updated_at': '2021-12-09T22:30:19Z', 'revision_number': 5, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'subnets': [{'id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:30:37.029430 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-0962455b-c117-4b8a-aba8-8fec3119e6b7 req-92efb330-7e78-4a93-a6c7-5b854bbbb243 service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0918689 Dec 09 22:30:37.135049 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9d5729f1-ceeb-4d8c-b46b-fc1d238dd072 None None] New status for floating IP 7253d0fb-ed8f-40a8-a5fe-4bfc7daca645: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:30:37.337595 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:30:38.263818 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:39.716308 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:57.814745 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:30:57.889323 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:31:03.077211 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-487d6575-5546-49b7-849c-8a8c8f82e7b2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:31:05.679998 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c5321420-c2a8-4fa0-b936-f7df482ec4f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:31:06.929149 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:31:08.271017 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:31:09.708858 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:31:14.344958 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:31:17.726994 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-444be020-f1f2-4492-8898-b750fccf133b req-8f1cc584-a6d9-469f-bc39-0d814b714b69 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0424681 Dec 09 22:31:17.817555 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-444be020-f1f2-4492-8898-b750fccf133b req-2237e515-07c4-48f5-a2a8-ba7f2ffd151b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:31:17.819100 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-444be020-f1f2-4492-8898-b750fccf133b req-2237e515-07c4-48f5-a2a8-ba7f2ffd151b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2f75126e83f04a8eb56e531ea19960e3&device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 1098 time: 0.0426250 Dec 09 22:31:17.941959 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-444be020-f1f2-4492-8898-b750fccf133b req-ec42fe95-4ebf-4d1a-b7cc-b72640387c4f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:31:17.943477 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-444be020-f1f2-4492-8898-b750fccf133b req-ec42fe95-4ebf-4d1a-b7cc-b72640387c4f service neutron] 10.222.0.31 "GET /v2.0/networks?id=dddb6458-4699-45f3-afbf-66e168e093fa HTTP/1.1" status: 200 len: 910 time: 0.1024170 Dec 09 22:31:18.010566 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-444be020-f1f2-4492-8898-b750fccf133b req-fdef1cf5-6bff-4758-9035-bbf114d9bf87 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da HTTP/1.1" status: 200 len: 1001 time: 0.0589194 Dec 09 22:31:18.058820 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-444be020-f1f2-4492-8898-b750fccf133b req-4b917ce9-6f81-4982-85c1-d2bc455b4596 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:31:18.060629 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-444be020-f1f2-4492-8898-b750fccf133b req-4b917ce9-6f81-4982-85c1-d2bc455b4596 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=34856fdf-2a32-48b3-9f67-7cd8c8d39875 HTTP/1.1" status: 200 len: 848 time: 0.0433538 Dec 09 22:31:18.111388 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-444be020-f1f2-4492-8898-b750fccf133b req-3d12a288-8df1-453e-a752-554912cc78f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:31:18.112914 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-444be020-f1f2-4492-8898-b750fccf133b req-3d12a288-8df1-453e-a752-554912cc78f9 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=dddb6458-4699-45f3-afbf-66e168e093fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0452673 Dec 09 22:31:18.205009 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-444be020-f1f2-4492-8898-b750fccf133b req-d14865f2-007a-404d-ad34-18ca3466aa72 service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0841923 Dec 09 22:31:18.296952 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-444be020-f1f2-4492-8898-b750fccf133b req-6ca0ac5b-b87d-4bdd-abb7-921192ab68c2 service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0851278 Dec 09 22:31:27.819562 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:31:27.890373 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:31:33.081098 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-61bf2061-d777-42fe-b5e4-1724455eae06 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:31:35.676293 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e51fe893-b500-4795-8104-6f7f2df682d0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:31:36.931759 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:31:38.274242 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:31:39.713850 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:31:45.784186 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-0a4651eb-60de-40d3-b68c-057d4e94073c req-c6c28db0-7967-46a1-8b52-07ebce4462ac service neutron] (103438) timed out ('10.222.0.13', 58730) {{(pid=103438) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 09 22:31:51.340489 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:31:57.822773 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:31:57.891081 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:03.083665 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-781faf24-987b-435f-aeab-8a914b1ef977 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:05.690561 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b11cac24-3291-4d72-a8fe-acb5bcf38f6a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:06.932386 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:08.275295 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:09.713952 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:19.728015 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-01c63073-8a1a-48d5-a111-7d977950d3df req-28cf0b1a-b75b-4cac-9d23-c24038035f76 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0442619 Dec 09 22:32:19.813584 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01c63073-8a1a-48d5-a111-7d977950d3df req-d0b1437c-d564-4d23-a7f7-09a2f5442a34 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:19.815113 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-01c63073-8a1a-48d5-a111-7d977950d3df req-d0b1437c-d564-4d23-a7f7-09a2f5442a34 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2f75126e83f04a8eb56e531ea19960e3&device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 1098 time: 0.0430622 Dec 09 22:32:19.924192 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01c63073-8a1a-48d5-a111-7d977950d3df req-405963b6-c87a-4b67-bb63-8f2f9f96e14f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:19.925667 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-01c63073-8a1a-48d5-a111-7d977950d3df req-405963b6-c87a-4b67-bb63-8f2f9f96e14f service neutron] 10.222.0.31 "GET /v2.0/networks?id=dddb6458-4699-45f3-afbf-66e168e093fa HTTP/1.1" status: 200 len: 910 time: 0.0901556 Dec 09 22:32:19.992418 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-01c63073-8a1a-48d5-a111-7d977950d3df req-c2b12be3-c27b-400b-a03b-2535f4395d37 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da HTTP/1.1" status: 200 len: 1001 time: 0.0591674 Dec 09 22:32:20.056370 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01c63073-8a1a-48d5-a111-7d977950d3df req-67423997-0ebd-4ef6-8b41-7cfe6dacf1b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:20.057887 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-01c63073-8a1a-48d5-a111-7d977950d3df req-67423997-0ebd-4ef6-8b41-7cfe6dacf1b5 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=34856fdf-2a32-48b3-9f67-7cd8c8d39875 HTTP/1.1" status: 200 len: 848 time: 0.0580640 Dec 09 22:32:20.109991 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01c63073-8a1a-48d5-a111-7d977950d3df req-77d8001c-aa9f-4b89-9d48-eadb0b2cb19a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:20.111589 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-01c63073-8a1a-48d5-a111-7d977950d3df req-77d8001c-aa9f-4b89-9d48-eadb0b2cb19a service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=dddb6458-4699-45f3-afbf-66e168e093fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0463579 Dec 09 22:32:20.203121 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-01c63073-8a1a-48d5-a111-7d977950d3df req-5b1e0192-f9c1-4cd0-a216-2552182b04d4 service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0843406 Dec 09 22:32:20.299201 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-01c63073-8a1a-48d5-a111-7d977950d3df req-fe082364-7070-46ee-a515-7d8f1b0c0f8b service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0887303 Dec 09 22:32:27.838011 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:27.890044 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:28.347151 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:32:29.071194 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6076706-d449-4e40-a4ed-5c5500e0fd91 req-3e6fa3d2-5020-4a28-8245-a718b0edc95d tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:29.072758 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c6076706-d449-4e40-a4ed-5c5500e0fd91 req-3e6fa3d2-5020-4a28-8245-a718b0edc95d tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0619624 Dec 09 22:32:29.126428 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c6076706-d449-4e40-a4ed-5c5500e0fd91 req-3d845632-71fa-4dde-aa2e-a796539d6b77 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442271 Dec 09 22:32:30.267305 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d52d86a5-6f56-4c48-9437-be3b8e2db2a6 req-15c69b07-e430-4af6-a6b6-4ea91f93ea0c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:30.269227 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d52d86a5-6f56-4c48-9437-be3b8e2db2a6 req-15c69b07-e430-4af6-a6b6-4ea91f93ea0c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0508235 Dec 09 22:32:30.320264 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d52d86a5-6f56-4c48-9437-be3b8e2db2a6 req-06cc1c63-4833-463c-b0a3-392cbfa3226c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448234 Dec 09 22:32:31.459800 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa1ae668-e6b0-447b-bad9-1a0a959f6d64 req-179f954a-11ca-438d-b2c8-9dd57cd61d82 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:31.461282 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aa1ae668-e6b0-447b-bad9-1a0a959f6d64 req-179f954a-11ca-438d-b2c8-9dd57cd61d82 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0568428 Dec 09 22:32:31.512730 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aa1ae668-e6b0-447b-bad9-1a0a959f6d64 req-3a7b78d1-af8f-4932-b20e-c47cece19bc6 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453017 Dec 09 22:32:32.645477 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed18947-cbf4-432e-955f-f2f09536bfa5 req-7423e05e-55d2-455a-9d88-c612b9ba73b7 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:32.646941 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aed18947-cbf4-432e-955f-f2f09536bfa5 req-7423e05e-55d2-455a-9d88-c612b9ba73b7 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0492537 Dec 09 22:32:32.699939 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-aed18947-cbf4-432e-955f-f2f09536bfa5 req-99729dc5-1cf1-4d38-9f1c-4f316d3d2a07 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444086 Dec 09 22:32:33.087906 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-647b2a8f-9556-4751-b5fd-5e5cef266e81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:33.825303 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3edd61a-4863-492e-95b5-c8a806aa4d5f req-7a3f4233-df10-49d4-af3d-ffdb90453b55 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:33.826392 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b3edd61a-4863-492e-95b5-c8a806aa4d5f req-7a3f4233-df10-49d4-af3d-ffdb90453b55 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0503812 Dec 09 22:32:33.879919 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b3edd61a-4863-492e-95b5-c8a806aa4d5f req-a4b9a02b-7675-42a0-90a8-c3e282d0ce45 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0471735 Dec 09 22:32:35.085477 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4c86dd-9418-4e3a-96a4-1b242648eef2 req-611c50a3-e383-44f4-8f73-785d036538d7 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:35.086977 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4c86dd-9418-4e3a-96a4-1b242648eef2 req-611c50a3-e383-44f4-8f73-785d036538d7 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0598156 Dec 09 22:32:35.140476 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8a4c86dd-9418-4e3a-96a4-1b242648eef2 req-4eabb7e6-b93d-4b67-9e79-632873f34ba7 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446084 Dec 09 22:32:35.685838 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e25b6030-5ffe-46e9-a999-5ede1aafb119 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:36.272133 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d9b5ee-595b-4e19-b77c-6aff1f1b65d6 req-c92bcf9d-b567-4989-8f2e-6ebef9098106 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:36.273673 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7d9b5ee-595b-4e19-b77c-6aff1f1b65d6 req-c92bcf9d-b567-4989-8f2e-6ebef9098106 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0519500 Dec 09 22:32:36.325952 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b7d9b5ee-595b-4e19-b77c-6aff1f1b65d6 req-d02ab025-b174-40ed-9b8b-cc5e2dc829c6 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436714 Dec 09 22:32:36.942587 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:37.462600 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78ef7b5b-1549-40d6-9d02-22e52ad195cb req-b668cef7-1fdc-48b2-b8c0-c3a5fd43f1c6 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:37.464065 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78ef7b5b-1549-40d6-9d02-22e52ad195cb req-b668cef7-1fdc-48b2-b8c0-c3a5fd43f1c6 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0607412 Dec 09 22:32:37.513117 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78ef7b5b-1549-40d6-9d02-22e52ad195cb req-cab4abdc-7ee0-4e4b-ab01-d9968a7a33e0 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428910 Dec 09 22:32:38.277406 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:38.653209 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22b7968e-5b4b-4e47-82e5-2719903258d9 req-3a33f5a1-0672-4c10-b636-89ebefc8a159 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:38.654720 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22b7968e-5b4b-4e47-82e5-2719903258d9 req-3a33f5a1-0672-4c10-b636-89ebefc8a159 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0571778 Dec 09 22:32:38.710454 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-22b7968e-5b4b-4e47-82e5-2719903258d9 req-14e68492-91c4-41c8-83d1-7bbec575abcb tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0495179 Dec 09 22:32:39.717693 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:39.848749 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d979be7a-4c50-4efe-9663-4db47c686a3f req-cc62af71-fe69-4022-9c0a-c50d7d609a23 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:39.850276 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d979be7a-4c50-4efe-9663-4db47c686a3f req-cc62af71-fe69-4022-9c0a-c50d7d609a23 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0586636 Dec 09 22:32:39.907611 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d979be7a-4c50-4efe-9663-4db47c686a3f req-c0395452-c97d-4c0f-b20c-9e103eb9b6f0 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0485718 Dec 09 22:32:41.038654 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb6b6599-d746-43b4-88a0-c2e60179fb48 req-0037ac3a-d1d6-4a16-8851-40808fd63524 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:41.040250 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fb6b6599-d746-43b4-88a0-c2e60179fb48 req-0037ac3a-d1d6-4a16-8851-40808fd63524 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0519302 Dec 09 22:32:41.094131 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fb6b6599-d746-43b4-88a0-c2e60179fb48 req-920ea387-960c-424c-97e9-f7f4e9f3d41f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452003 Dec 09 22:32:41.218587 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device cc6a95f2-7fb9-4017-b8da-f9a084d5d0da details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:32:41.322498 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:32:41.338403 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'port_id': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da', 'mac_address': 'fa:16:3e:b2:d3:d3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 106, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:32:41.376534 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:41.393228 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id cc6a95f2-7fb9-4017-b8da-f9a084d5d0da {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:32:41.413590 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:32:41.418182 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:41.468724 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:32:41.476194 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:41.476548 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:41.476893 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:41.477230 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:41.477566 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:41.477896 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:41.478226 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:41.478567 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:41.478879 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:41.479207 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:41.479570 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:41.479877 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:41.480199 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:41.486479 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['cc6a95f2-7fb9-4017-b8da-f9a084d5d0da'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:32:42.218980 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4fc6f2c-9aef-475c-b4b9-3f78b91b0ec2 req-dda9c7bc-3d8e-4ead-aaed-d879827ec851 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:42.221378 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4fc6f2c-9aef-475c-b4b9-3f78b91b0ec2 req-dda9c7bc-3d8e-4ead-aaed-d879827ec851 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 945 time: 0.0511761 Dec 09 22:32:42.278173 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4fc6f2c-9aef-475c-b4b9-3f78b91b0ec2 req-b85ef487-2796-4dcb-afb5-7f44b8dd917b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0496101 Dec 09 22:32:43.249730 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device cc6a95f2-7fb9-4017-b8da-f9a084d5d0da up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:32:43.304786 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:32:43.305159 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:43.408899 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:43.410258 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46ba3c04-208d-4fb2-b960-73b7ce7b32fd req-48418a19-563c-4dd2-af6b-5fa4b771c157 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:43.418202 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46ba3c04-208d-4fb2-b960-73b7ce7b32fd req-48418a19-563c-4dd2-af6b-5fa4b771c157 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 945 time: 0.0646861 Dec 09 22:32:43.438920 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fdb9f136-4581-4ba3-8bcf-3012bb1c01a1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:32:43.441263 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-564b95ae-e0c1-4bf4-8474-3187fde8a59b" -d '{"events": [{"server_uuid": "fdb9f136-4581-4ba3-8bcf-3012bb1c01a1", "name": "network-vif-plugged", "status": "completed", "tag": "cc6a95f2-7fb9-4017-b8da-f9a084d5d0da"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:32:43.455100 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:32:43.461811 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:43.487279 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46ba3c04-208d-4fb2-b960-73b7ce7b32fd req-09aedeaa-204d-41c4-88c7-578fe5932c15 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0678501 Dec 09 22:32:43.519787 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:32:43.542078 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:32:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6df62a4f-7e9a-416d-a949-652c2d354d65 x-openstack-request-id: req-6df62a4f-7e9a-416d-a949-652c2d354d65 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:32:43.542401 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fdb9f136-4581-4ba3-8bcf-3012bb1c01a1", "name": "network-vif-plugged", "status": "completed", "tag": "cc6a95f2-7fb9-4017-b8da-f9a084d5d0da", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:32:43.542829 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-6df62a4f-7e9a-416d-a949-652c2d354d65 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:32:43.543227 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fdb9f136-4581-4ba3-8bcf-3012bb1c01a1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da', 'code': 200} Dec 09 22:32:44.615889 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27a0aa1f-6e84-4826-931a-c0e17b8f7d54 req-9fd23910-c4e4-4522-ad69-de4c8c5f573f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:44.617685 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27a0aa1f-6e84-4826-931a-c0e17b8f7d54 req-9fd23910-c4e4-4522-ad69-de4c8c5f573f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0589056 Dec 09 22:32:44.672527 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-27a0aa1f-6e84-4826-931a-c0e17b8f7d54 req-db4a4ebc-8af3-494d-91f6-09a961b4adce tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0488136 Dec 09 22:32:45.818873 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b4c53a3-343d-4758-aff5-64d79f0d9535 req-1f9631c5-bbb5-4068-a6b3-0df62085ba7f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:45.820643 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8b4c53a3-343d-4758-aff5-64d79f0d9535 req-1f9631c5-bbb5-4068-a6b3-0df62085ba7f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0724616 Dec 09 22:32:45.881623 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8b4c53a3-343d-4758-aff5-64d79f0d9535 req-5517037e-adec-48a5-b2ef-5057f4cf339b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0537360 Dec 09 22:32:47.019719 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8d22f10-d525-4b78-9a2b-be946a62f2b6 req-961df0e2-e9e6-42ed-9376-f1b8fe663007 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:47.022182 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a8d22f10-d525-4b78-9a2b-be946a62f2b6 req-961df0e2-e9e6-42ed-9376-f1b8fe663007 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0640526 Dec 09 22:32:47.079666 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a8d22f10-d525-4b78-9a2b-be946a62f2b6 req-9af0c646-56a2-4cb7-bb43-ddfdbf0f5b2c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0477936 Dec 09 22:32:48.211741 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e647a94-542d-4be2-9269-805d603676f7 req-b929cb10-be0d-4b9e-a2c2-f987e0c37899 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:48.213443 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e647a94-542d-4be2-9269-805d603676f7 req-b929cb10-be0d-4b9e-a2c2-f987e0c37899 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0526762 Dec 09 22:32:48.272979 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2e647a94-542d-4be2-9269-805d603676f7 req-5720cc5a-0b5b-4344-ba2a-c572b1e71282 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0533741 Dec 09 22:32:49.403470 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b30ddeed-9974-4171-b2b9-81f3f4c4a653 req-1000f246-d73f-4bc2-943c-1b372d629a93 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:49.405894 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b30ddeed-9974-4171-b2b9-81f3f4c4a653 req-1000f246-d73f-4bc2-943c-1b372d629a93 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0551560 Dec 09 22:32:49.468555 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b30ddeed-9974-4171-b2b9-81f3f4c4a653 req-b0a1e116-91ae-4a6a-b25a-9d4dd47a0985 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0573659 Dec 09 22:32:50.589582 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ee6e739-b585-4edb-9d1f-233988454cb0 req-cbe48a9d-dd23-4c29-ad15-0bc0c395dfd8 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:50.591070 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ee6e739-b585-4edb-9d1f-233988454cb0 req-cbe48a9d-dd23-4c29-ad15-0bc0c395dfd8 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0500050 Dec 09 22:32:50.641009 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9ee6e739-b585-4edb-9d1f-233988454cb0 req-0a7a671c-dafe-4311-b2f5-f77519b7ab0c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437396 Dec 09 22:32:51.184733 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82c3c289-bc93-41fc-a56f-129e803d71ff req-4e395a8b-97b7-4104-9882-14618bcb0ac3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:51.186271 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-82c3c289-bc93-41fc-a56f-129e803d71ff req-4e395a8b-97b7-4104-9882-14618bcb0ac3 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2f75126e83f04a8eb56e531ea19960e3&device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 1098 time: 0.0444450 Dec 09 22:32:51.284125 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82c3c289-bc93-41fc-a56f-129e803d71ff req-c9f6c674-7e27-4e60-a5f6-f7da834efbca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:51.285666 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-82c3c289-bc93-41fc-a56f-129e803d71ff req-c9f6c674-7e27-4e60-a5f6-f7da834efbca service neutron] 10.222.0.31 "GET /v2.0/networks?id=dddb6458-4699-45f3-afbf-66e168e093fa HTTP/1.1" status: 200 len: 910 time: 0.0909178 Dec 09 22:32:51.361667 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-82c3c289-bc93-41fc-a56f-129e803d71ff req-9d7229c1-ea5f-44b3-8e64-4b0e5a1f5089 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da HTTP/1.1" status: 200 len: 1001 time: 0.0685585 Dec 09 22:32:51.410963 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82c3c289-bc93-41fc-a56f-129e803d71ff req-445e5350-1e13-464f-a335-89ed91fba4bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:51.412489 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-82c3c289-bc93-41fc-a56f-129e803d71ff req-445e5350-1e13-464f-a335-89ed91fba4bc service neutron] 10.222.0.31 "GET /v2.0/subnets?id=34856fdf-2a32-48b3-9f67-7cd8c8d39875 HTTP/1.1" status: 200 len: 848 time: 0.0435152 Dec 09 22:32:51.464705 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82c3c289-bc93-41fc-a56f-129e803d71ff req-96c6beb1-d5c5-4246-a6d3-f99a0b372edc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:51.466135 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-82c3c289-bc93-41fc-a56f-129e803d71ff req-96c6beb1-d5c5-4246-a6d3-f99a0b372edc service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=dddb6458-4699-45f3-afbf-66e168e093fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0466306 Dec 09 22:32:51.477149 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-82c3c289-bc93-41fc-a56f-129e803d71ff req-8bd69f5d-8f9a-405e-ba58-187c3af0b872 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 22:32:51.478072 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-82c3c289-bc93-41fc-a56f-129e803d71ff req-8bd69f5d-8f9a-405e-ba58-187c3af0b872 service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0049863 Dec 09 22:32:51.571784 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-82c3c289-bc93-41fc-a56f-129e803d71ff req-5a2dfbbf-172a-402e-8887-66af3310fc97 service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0855324 Dec 09 22:32:51.668402 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-82c3c289-bc93-41fc-a56f-129e803d71ff req-075ad613-5f38-4d3e-86c7-5e55bfa07a2f service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0896840 Dec 09 22:32:51.767293 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2500bdf8-d24d-4ac6-9375-e456f434351b req-80057993-ed94-4577-805a-77ce596b9ef1 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:51.768718 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2500bdf8-d24d-4ac6-9375-e456f434351b req-80057993-ed94-4577-805a-77ce596b9ef1 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0543139 Dec 09 22:32:51.830913 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2500bdf8-d24d-4ac6-9375-e456f434351b req-d52590a8-0137-433b-bbed-dd4a5562757f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0543973 Dec 09 22:32:52.951057 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e64374a7-a3eb-40f4-abcc-b67df3129d9e req-0cf3c5f8-3b3f-464f-a2fa-273933d4747c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:52.952667 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e64374a7-a3eb-40f4-abcc-b67df3129d9e req-0cf3c5f8-3b3f-464f-a2fa-273933d4747c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0510476 Dec 09 22:32:53.004624 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e64374a7-a3eb-40f4-abcc-b67df3129d9e req-d30c2b50-27c1-4add-8baa-299081c80a98 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456119 Dec 09 22:32:54.134724 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50bb79f0-ab9e-496e-a62b-6d1489142bf6 req-cb9ae668-a571-4a80-82c7-d37d649053bf tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:54.136161 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50bb79f0-ab9e-496e-a62b-6d1489142bf6 req-cb9ae668-a571-4a80-82c7-d37d649053bf tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0503125 Dec 09 22:32:54.189634 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-50bb79f0-ab9e-496e-a62b-6d1489142bf6 req-bebcca6b-2e46-413c-978f-3a10761f8c6c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0474372 Dec 09 22:32:54.262130 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-c952fc1f-d655-41da-a414-3cda71acef89 req-e6a7c1f1-7740-4485-8902-b7922ef6e80b service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 22:32:54.263228 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c952fc1f-d655-41da-a414-3cda71acef89 req-e6a7c1f1-7740-4485-8902-b7922ef6e80b service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0067267 Dec 09 22:32:54.439470 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78e522c7-3986-4bb9-9d5d-1a54b8af525d req-a6c4a3ea-1947-4a3b-b617-0ae0db5cdace tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:54.441256 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78e522c7-3986-4bb9-9d5d-1a54b8af525d req-a6c4a3ea-1947-4a3b-b617-0ae0db5cdace tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0618122 Dec 09 22:32:54.494541 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-78e522c7-3986-4bb9-9d5d-1a54b8af525d req-1708ccc2-31e7-4552-917e-ac84cca70d90 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462923 Dec 09 22:32:54.677294 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bcd6082b-1850-410a-b248-b893d1cc903e req-12cdee7f-1842-467c-b12d-8b3ae8d77a7b service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1116989 Dec 09 22:32:55.304009 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device cc6a95f2-7fb9-4017-b8da-f9a084d5d0da no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:32:55.404514 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:55.438309 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fdb9f136-4581-4ba3-8bcf-3012bb1c01a1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:32:55.440888 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a3bcac52-2440-4b4f-86f2-f3ed8afca379" -d '{"events": [{"server_uuid": "fdb9f136-4581-4ba3-8bcf-3012bb1c01a1", "name": "network-vif-unplugged", "status": "completed", "tag": "cc6a95f2-7fb9-4017-b8da-f9a084d5d0da"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:32:55.455276 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:32:55.460703 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:55.483788 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 22:32:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a75e2ab0-36ca-446c-8c45-6939d99eea79 x-openstack-request-id: req-a75e2ab0-36ca-446c-8c45-6939d99eea79 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:32:55.484077 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fdb9f136-4581-4ba3-8bcf-3012bb1c01a1", "name": "network-vif-unplugged", "status": "completed", "tag": "cc6a95f2-7fb9-4017-b8da-f9a084d5d0da", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:32:55.484323 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-a75e2ab0-36ca-446c-8c45-6939d99eea79 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:32:55.484710 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fdb9f136-4581-4ba3-8bcf-3012bb1c01a1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da', 'code': 200} Dec 09 22:32:55.510450 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:32:55.645905 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcd6082b-1850-410a-b248-b893d1cc903e req-a0143d89-3790-4b31-b536-044d16376031 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:55.647461 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bcd6082b-1850-410a-b248-b893d1cc903e req-a0143d89-3790-4b31-b536-044d16376031 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1&tenant_id=2f75126e83f04a8eb56e531ea19960e3 HTTP/1.1" status: 200 len: 1096 time: 0.1087415 Dec 09 22:32:55.655047 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2659ba1-f0e1-4f9c-a579-72f416c1e03a req-153be05f-58c9-436b-9d8a-d85efcd2aeb6 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:55.656485 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c2659ba1-f0e1-4f9c-a579-72f416c1e03a req-153be05f-58c9-436b-9d8a-d85efcd2aeb6 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 944 time: 0.0837128 Dec 09 22:32:55.661310 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-bcd6082b-1850-410a-b248-b893d1cc903e req-89c027c9-d4f7-4573-84c4-e98e08fc878f service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 22:32:55.662246 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bcd6082b-1850-410a-b248-b893d1cc903e req-89c027c9-d4f7-4573-84c4-e98e08fc878f service neutron] 10.222.0.10 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0049124 Dec 09 22:32:55.680503 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Request body: {'port': {'binding:host_id': 'n-h2-713301-27', 'device_owner': 'compute:nova'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:32:55.751897 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c2659ba1-f0e1-4f9c-a579-72f416c1e03a req-a1cdc7dd-26e1-465d-b300-cfffb6a51ef4 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0886812 Dec 09 22:32:55.757077 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:55.981176 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] For port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:32:56.014421 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] For port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da, host n-h1-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:32:56.045645 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cc6a95f2-7fb9-4017-b8da-f9a084d5d0da {{(pid=103438) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:32:56.052999 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:56.066856 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.provisioning_blocks [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Transition to ACTIVE for port object cc6a95f2-7fb9-4017-b8da-f9a084d5d0da will not be triggered until provisioned by entity L2. {{(pid=103438) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:32:56.072884 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:56.124038 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Pushing event updated for resources: {'Port': ['ID=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,revision_number=9']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:32:56.163738 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:56.164089 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:56.164432 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:56.164772 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:56.165104 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:56.165513 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:56.165985 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:56.166886 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:56.167224 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:56.167585 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:56.167917 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:56.168244 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:56.168556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:32:56.212180 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] No DVR routers for this DVR port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da on host n-h1-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:32:56.351202 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Attempting to bind port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:32:56.351737 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Attempting to bind port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '4fd32693-bdb8-493a-a8d8-5bd83c6f9f80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa'}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:32:56.352263 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Attempting to bind port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da on network dddb6458-4699-45f3-afbf-66e168e093fa {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:32:56.357478 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da on network dddb6458-4699-45f3-afbf-66e168e093fa not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:32:56.357820 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Attempting to bind port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da on network dddb6458-4699-45f3-afbf-66e168e093fa {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:32:56.362903 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 32, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:32:56.363177 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Checking segment: {'id': '4fd32693-bdb8-493a-a8d8-5bd83c6f9f80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:32:56.363578 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Bound using segment: {'id': '4fd32693-bdb8-493a-a8d8-5bd83c6f9f80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa'} {{(pid=103438) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:32:56.364012 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.managers [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Bound port: cc6a95f2-7fb9-4017-b8da-f9a084d5d0da, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4fd32693-bdb8-493a-a8d8-5bd83c6f9f80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa'}}] {{(pid=103438) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:32:56.364354 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:56.426981 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] For port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da, host n-h2-713301-27, cleared binding levels {{(pid=103438) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:32:56.429947 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] For port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103438) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:32:56.436966 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:56.472078 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:56.472664 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:56.474228 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bcd6082b-1850-410a-b248-b893d1cc903e req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] 10.222.0.10 "PUT /v2.0/ports/cc6a95f2-7fb9-4017-b8da-f9a084d5d0da HTTP/1.1" status: 200 len: 1093 time: 0.7976806 Dec 09 22:32:56.476437 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fdb9f136-4581-4ba3-8bcf-3012bb1c01a1', 'tag': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:32:56.479638 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a0312321-2d1a-4206-a448-10e47b35c220" -d '{"events": [{"name": "network-changed", "server_uuid": "fdb9f136-4581-4ba3-8bcf-3012bb1c01a1", "tag": "cc6a95f2-7fb9-4017-b8da-f9a084d5d0da"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:32:56.535968 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:32:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-51030609-9543-461a-9ae1-45c17697503d x-openstack-request-id: req-51030609-9543-461a-9ae1-45c17697503d {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:32:56.536272 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fdb9f136-4581-4ba3-8bcf-3012bb1c01a1", "tag": "cc6a95f2-7fb9-4017-b8da-f9a084d5d0da", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:32:56.536508 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-51030609-9543-461a-9ae1-45c17697503d {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:32:56.537006 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fdb9f136-4581-4ba3-8bcf-3012bb1c01a1', 'tag': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da', 'status': 'completed', 'code': 200} Dec 09 22:32:56.540266 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0418321d-39d6-4c2c-ba0d-fa3dcc339c46 service neutron] Pushing event updated for resources: {'Port': ['ID=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,revision_number=10']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:32:56.556716 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcd6082b-1850-410a-b248-b893d1cc903e req-1bb870c3-736b-4e58-bb69-9f0cb67f96ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:56.558352 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bcd6082b-1850-410a-b248-b893d1cc903e req-1bb870c3-736b-4e58-bb69-9f0cb67f96ba service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=2f75126e83f04a8eb56e531ea19960e3&device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 1097 time: 0.0597613 Dec 09 22:32:56.654484 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcd6082b-1850-410a-b248-b893d1cc903e req-e6dab497-fbd6-4b5f-be53-7373f58dd18e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:56.656006 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bcd6082b-1850-410a-b248-b893d1cc903e req-e6dab497-fbd6-4b5f-be53-7373f58dd18e service neutron] 10.222.0.10 "GET /v2.0/networks?id=dddb6458-4699-45f3-afbf-66e168e093fa HTTP/1.1" status: 200 len: 910 time: 0.0896962 Dec 09 22:32:56.726069 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bcd6082b-1850-410a-b248-b893d1cc903e req-aab2f1ee-3905-4122-ad0f-01b3d240253e service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da HTTP/1.1" status: 200 len: 999 time: 0.0626884 Dec 09 22:32:56.776955 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcd6082b-1850-410a-b248-b893d1cc903e req-f8d2c9a8-d1e0-412d-ad93-4a60cbb11205 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:56.778473 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bcd6082b-1850-410a-b248-b893d1cc903e req-f8d2c9a8-d1e0-412d-ad93-4a60cbb11205 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=34856fdf-2a32-48b3-9f67-7cd8c8d39875 HTTP/1.1" status: 200 len: 848 time: 0.0450985 Dec 09 22:32:56.826547 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcd6082b-1850-410a-b248-b893d1cc903e req-907a75c9-a364-4e1c-bacc-769637285568 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:56.828054 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bcd6082b-1850-410a-b248-b893d1cc903e req-907a75c9-a364-4e1c-bacc-769637285568 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=dddb6458-4699-45f3-afbf-66e168e093fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0427933 Dec 09 22:32:57.240260 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0040a1c4-cfe0-4fc6-acb3-55615012e1f1 req-b7a438be-dde8-4378-9db6-d4b9483f257d tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:57.241756 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0040a1c4-cfe0-4fc6-acb3-55615012e1f1 req-b7a438be-dde8-4378-9db6-d4b9483f257d tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 945 time: 0.4128160 Dec 09 22:32:57.273198 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bcd6082b-1850-410a-b248-b893d1cc903e req-067c9d57-7cff-44e5-8c45-8e699370e9f9 service neutron] 10.222.0.10 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4361145 Dec 09 22:32:57.327967 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0040a1c4-cfe0-4fc6-acb3-55615012e1f1 req-0029b53b-3694-4ca8-bb83-4f8b41464fe3 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0797806 Dec 09 22:32:57.383601 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bcd6082b-1850-410a-b248-b893d1cc903e req-c3c52d4d-f6ac-49e8-afcf-48d000a2fc4d service neutron] 10.222.0.10 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0997787 Dec 09 22:32:57.487189 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0312321-2d1a-4206-a448-10e47b35c220 req-239405a7-9026-4dea-b21d-138e05e8a2e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:57.488756 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0312321-2d1a-4206-a448-10e47b35c220 req-239405a7-9026-4dea-b21d-138e05e8a2e3 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=2f75126e83f04a8eb56e531ea19960e3&device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 1097 time: 0.0421777 Dec 09 22:32:57.585384 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0312321-2d1a-4206-a448-10e47b35c220 req-c7f90628-d12d-41bb-9d71-a62a1640595e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:57.586966 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0312321-2d1a-4206-a448-10e47b35c220 req-c7f90628-d12d-41bb-9d71-a62a1640595e service neutron] 10.222.0.10 "GET /v2.0/networks?id=dddb6458-4699-45f3-afbf-66e168e093fa HTTP/1.1" status: 200 len: 910 time: 0.0916433 Dec 09 22:32:57.682647 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0312321-2d1a-4206-a448-10e47b35c220 req-5bfcae7b-e1d2-4acd-883a-f23d6801a6e3 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da HTTP/1.1" status: 200 len: 999 time: 0.0876338 Dec 09 22:32:57.846534 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:57.900014 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:32:58.470412 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-180abdbb-c05a-4b4b-bdf7-56b25d02dbaf req-cbc46a99-1b64-4766-8899-4b06f56079ec tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:58.472627 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-180abdbb-c05a-4b4b-bdf7-56b25d02dbaf req-cbc46a99-1b64-4766-8899-4b06f56079ec tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 945 time: 0.0688159 Dec 09 22:32:58.524737 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-180abdbb-c05a-4b4b-bdf7-56b25d02dbaf req-c9566f27-4f7f-4a52-96c9-d3934c0bab46 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455644 Dec 09 22:32:59.649041 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe2c0f35-54de-4e3d-bcc3-db714bc20f13 req-9a5df896-2200-4642-9116-a245435643f9 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:32:59.650551 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe2c0f35-54de-4e3d-bcc3-db714bc20f13 req-9a5df896-2200-4642-9116-a245435643f9 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 945 time: 0.0523853 Dec 09 22:32:59.709415 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fe2c0f35-54de-4e3d-bcc3-db714bc20f13 req-9026518a-9196-4005-9880-fdb68113912a tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0518799 Dec 09 22:33:00.836923 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6542d854-ff30-4c86-96d5-c6df9ed6e0c5 req-c932092d-7921-44b9-9627-d949721f9bc3 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:33:00.838501 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6542d854-ff30-4c86-96d5-c6df9ed6e0c5 req-c932092d-7921-44b9-9627-d949721f9bc3 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 945 time: 0.0523489 Dec 09 22:33:00.908692 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6542d854-ff30-4c86-96d5-c6df9ed6e0c5 req-a1d5d6ce-bf41-47cb-8f3c-c47f0935a116 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0629044 Dec 09 22:33:02.026971 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2fadc84-5f96-40e1-acab-1be4a01f6b33 req-1372ca56-51fe-4bcb-955d-98fe16faa9a9 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:33:02.028874 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f2fadc84-5f96-40e1-acab-1be4a01f6b33 req-1372ca56-51fe-4bcb-955d-98fe16faa9a9 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 945 time: 0.0482290 Dec 09 22:33:02.089795 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f2fadc84-5f96-40e1-acab-1be4a01f6b33 req-0dab7f83-e7cd-4f29-ba7b-c160c360c372 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0539289 Dec 09 22:33:03.081789 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1ce0ee07-c15b-4d67-a27f-762e2c625806 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:33:03.211937 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4d32c2b-5208-40aa-9073-17e314c74e55 req-0bdffda0-b816-44f3-9fd1-15ca355e9307 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:33:03.213872 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4d32c2b-5208-40aa-9073-17e314c74e55 req-0bdffda0-b816-44f3-9fd1-15ca355e9307 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 945 time: 0.0541615 Dec 09 22:33:03.267505 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4d32c2b-5208-40aa-9073-17e314c74e55 req-282ed887-9dcd-4570-ae12-8079af812f6c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0464451 Dec 09 22:33:04.400270 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a29e7c-360e-4604-89e8-848917e27bb4 req-ba840d2c-c519-4880-a8b4-4266cc53627e tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:33:04.401798 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9a29e7c-360e-4604-89e8-848917e27bb4 req-ba840d2c-c519-4880-a8b4-4266cc53627e tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 945 time: 0.0530462 Dec 09 22:33:04.456459 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9a29e7c-360e-4604-89e8-848917e27bb4 req-1fc9f5d4-09aa-4346-80d2-c33a442fcfb0 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0474610 Dec 09 22:33:05.351272 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:33:05.575054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8db6df92-6ea1-48b7-bca6-30b0b35b5811 req-535661d3-4ff1-4bd5-8ffd-ddd44684d3ad tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:33:05.576785 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8db6df92-6ea1-48b7-bca6-30b0b35b5811 req-535661d3-4ff1-4bd5-8ffd-ddd44684d3ad tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 945 time: 0.0515847 Dec 09 22:33:05.628336 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8db6df92-6ea1-48b7-bca6-30b0b35b5811 req-91ed48ea-8e43-4911-ab59-52a50a6b5abd tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454199 Dec 09 22:33:05.680145 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1f8ff858-ac5a-42f8-88c3-8cdd9e742723 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:33:06.762844 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c52d80e3-56e4-4267-a22f-4b8955cd3771 req-b8391c87-0c16-4f58-b35b-8997b04ab74a tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:33:06.765566 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c52d80e3-56e4-4267-a22f-4b8955cd3771 req-b8391c87-0c16-4f58-b35b-8997b04ab74a tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 945 time: 0.0591486 Dec 09 22:33:06.828096 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c52d80e3-56e4-4267-a22f-4b8955cd3771 req-006c4542-3a58-43d9-9d07-e1c2b85f0764 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0527213 Dec 09 22:33:06.946367 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:33:07.971173 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01c95a69-5d4f-4609-9c77-e549708c6f12 req-e7e00d0a-9a94-4bc2-b02d-1d597cb07cff tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:33:07.973785 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-01c95a69-5d4f-4609-9c77-e549708c6f12 req-e7e00d0a-9a94-4bc2-b02d-1d597cb07cff tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 945 time: 0.0618787 Dec 09 22:33:08.029857 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-01c95a69-5d4f-4609-9c77-e549708c6f12 req-0b4e9828-8f68-4db7-b85e-6654e308daaf tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454159 Dec 09 22:33:08.283469 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:33:08.588881 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0312321-2d1a-4206-a448-10e47b35c220 req-03a81fbf-4759-4697-9987-f6359ac175ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:33:08.590321 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0312321-2d1a-4206-a448-10e47b35c220 req-03a81fbf-4759-4697-9987-f6359ac175ce service neutron] 10.222.0.10 "GET /v2.0/subnets?id=34856fdf-2a32-48b3-9f67-7cd8c8d39875 HTTP/1.1" status: 200 len: 848 time: 0.0562792 Dec 09 22:33:08.643862 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0312321-2d1a-4206-a448-10e47b35c220 req-ce39f6ef-a682-4ca5-a652-62012145bcfb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:33:08.645365 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0312321-2d1a-4206-a448-10e47b35c220 req-ce39f6ef-a682-4ca5-a652-62012145bcfb service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=dddb6458-4699-45f3-afbf-66e168e093fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0456429 Dec 09 22:33:08.754374 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0312321-2d1a-4206-a448-10e47b35c220 req-12eaee2d-382a-4d41-ae7c-eecf3a5d4c37 service neutron] 10.222.0.10 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0967784 Dec 09 22:33:08.850282 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a0312321-2d1a-4206-a448-10e47b35c220 req-a21cfd2e-200f-4239-9dc5-73672590e278 service neutron] 10.222.0.10 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0875432 Dec 09 22:33:09.174451 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba15a8c5-c0f9-4331-b8d0-fa606b33759e req-142eaf89-bb37-446f-8ad3-17bf9e739e61 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:33:09.176013 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba15a8c5-c0f9-4331-b8d0-fa606b33759e req-142eaf89-bb37-446f-8ad3-17bf9e739e61 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 945 time: 0.0588117 Dec 09 22:33:09.227694 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba15a8c5-c0f9-4331-b8d0-fa606b33759e req-fb44d977-c2bb-47cc-85ec-5391dfe4a623 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454793 Dec 09 22:33:09.717660 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:33:10.361935 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3882c60f-d990-41ef-9608-7e9068950659 req-bea0add7-bfe6-4cce-b46c-83ccd4223a0d tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:33:10.363476 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3882c60f-d990-41ef-9608-7e9068950659 req-bea0add7-bfe6-4cce-b46c-83ccd4223a0d tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 945 time: 0.0602636 Dec 09 22:33:10.417006 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3882c60f-d990-41ef-9608-7e9068950659 req-d5697fcc-2188-4934-ac83-1e3b9cad0a06 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0474503 Dec 09 22:33:11.550748 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f67b3377-28d0-4264-a0df-eb7357d7935a req-54e8d60d-2259-42cf-b32a-068b79a3933d tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:33:11.552305 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f67b3377-28d0-4264-a0df-eb7357d7935a req-54e8d60d-2259-42cf-b32a-068b79a3933d tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 945 time: 0.0568497 Dec 09 22:33:11.603482 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f67b3377-28d0-4264-a0df-eb7357d7935a req-704717b9-70fe-4149-8176-ccbcdd3c0f64 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451276 Dec 09 22:33:12.738128 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4074a8eb-c3c2-4ae9-b262-2920c0446840 req-ea0fbf85-02f6-4fb2-9316-fb396020a85c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:33:12.739646 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4074a8eb-c3c2-4ae9-b262-2920c0446840 req-ea0fbf85-02f6-4fb2-9316-fb396020a85c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 945 time: 0.0588429 Dec 09 22:33:12.801852 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4074a8eb-c3c2-4ae9-b262-2920c0446840 req-7bccf1dd-b77f-450f-8320-10f49779cb09 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0558887 Dec 09 22:33:12.893652 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device cc6a95f2-7fb9-4017-b8da-f9a084d5d0da details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:33:13.008983 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:33:13.034264 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'port_id': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da', 'mac_address': 'fa:16:3e:b2:d3:d3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 106, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:33:13.085148 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:33:13.103320 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cc6a95f2-7fb9-4017-b8da-f9a084d5d0da {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:33:13.122454 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:33:13.126762 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:33:13.174072 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,revision_number=11']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:33:13.375839 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['cc6a95f2-7fb9-4017-b8da-f9a084d5d0da'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:33:13.926457 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3a16e8e-373f-40c2-a8a2-012181ab7620 req-174b1869-5de7-40e0-8ae7-c256cbeef30c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:33:13.927942 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3a16e8e-373f-40c2-a8a2-012181ab7620 req-174b1869-5de7-40e0-8ae7-c256cbeef30c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0552125 Dec 09 22:33:13.983808 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d3a16e8e-373f-40c2-a8a2-012181ab7620 req-9712783b-da86-43a8-8802-2c8e9b44fc6b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0469275 Dec 09 22:33:14.893516 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fecae4b-7000-4b43-bf3e-b5e2d8a3d112 req-b3f090c8-4f57-4eae-9319-a7d04a5b1ed4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:33:14.895028 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3fecae4b-7000-4b43-bf3e-b5e2d8a3d112 req-b3f090c8-4f57-4eae-9319-a7d04a5b1ed4 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=2f75126e83f04a8eb56e531ea19960e3&device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 1098 time: 0.0437753 Dec 09 22:33:14.908352 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device cc6a95f2-7fb9-4017-b8da-f9a084d5d0da up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:33:14.962666 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:33:14.966639 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:33:14.967003 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:33:15.006995 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fecae4b-7000-4b43-bf3e-b5e2d8a3d112 req-f06378cb-df30-4f7e-86d7-a4668cf51d91 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:33:15.008531 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3fecae4b-7000-4b43-bf3e-b5e2d8a3d112 req-f06378cb-df30-4f7e-86d7-a4668cf51d91 service neutron] 10.222.0.10 "GET /v2.0/networks?id=dddb6458-4699-45f3-afbf-66e168e093fa HTTP/1.1" status: 200 len: 910 time: 0.0926006 Dec 09 22:33:15.045312 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:33:15.068484 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fdb9f136-4581-4ba3-8bcf-3012bb1c01a1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:33:15.070729 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c7795f6f-d1c4-4f95-a165-08c822a4f78e" -d '{"events": [{"server_uuid": "fdb9f136-4581-4ba3-8bcf-3012bb1c01a1", "name": "network-vif-plugged", "status": "completed", "tag": "cc6a95f2-7fb9-4017-b8da-f9a084d5d0da"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:33:15.083872 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:33:15.087955 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:33:15.101437 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3fecae4b-7000-4b43-bf3e-b5e2d8a3d112 req-2cfb1530-9d74-48eb-9a70-5abc4acaf1e1 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da HTTP/1.1" status: 200 len: 1000 time: 0.0848191 Dec 09 22:33:15.134641 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,revision_number=12']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:33:15.147840 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-295c00a7-5862-41f7-92b7-fde566d025d4 req-a9632d8e-d527-4343-a364-53515e22ef84 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:33:15.149220 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-295c00a7-5862-41f7-92b7-fde566d025d4 req-a9632d8e-d527-4343-a364-53515e22ef84 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 946 time: 0.0901237 Dec 09 22:33:15.180201 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fecae4b-7000-4b43-bf3e-b5e2d8a3d112 req-328ec5cb-aac1-44a8-94c2-1aaa26b8d95d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:33:15.181636 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3fecae4b-7000-4b43-bf3e-b5e2d8a3d112 req-328ec5cb-aac1-44a8-94c2-1aaa26b8d95d service neutron] 10.222.0.10 "GET /v2.0/subnets?id=34856fdf-2a32-48b3-9f67-7cd8c8d39875 HTTP/1.1" status: 200 len: 848 time: 0.0719011 Dec 09 22:33:15.230549 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-295c00a7-5862-41f7-92b7-fde566d025d4 req-c4a016fb-1a83-4100-9653-dfca56ac8569 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0750849 Dec 09 22:33:15.243737 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fecae4b-7000-4b43-bf3e-b5e2d8a3d112 req-dccd40aa-279d-49fe-9065-e74efe53c89c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:33:15.245335 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3fecae4b-7000-4b43-bf3e-b5e2d8a3d112 req-dccd40aa-279d-49fe-9065-e74efe53c89c service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=dddb6458-4699-45f3-afbf-66e168e093fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0543671 Dec 09 22:33:15.278034 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:33:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-101cc20e-c81f-4947-a68e-f72e7f375128 x-openstack-request-id: req-101cc20e-c81f-4947-a68e-f72e7f375128 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:33:15.278341 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fdb9f136-4581-4ba3-8bcf-3012bb1c01a1", "name": "network-vif-plugged", "status": "completed", "tag": "cc6a95f2-7fb9-4017-b8da-f9a084d5d0da", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:33:15.278597 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-101cc20e-c81f-4947-a68e-f72e7f375128 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:33:15.278998 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fdb9f136-4581-4ba3-8bcf-3012bb1c01a1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da', 'code': 200} Dec 09 22:33:15.341575 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3fecae4b-7000-4b43-bf3e-b5e2d8a3d112 req-7b2eb0d6-0139-4090-9fa2-718fa79442c8 service neutron] 10.222.0.10 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0879960 Dec 09 22:33:15.398566 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.10', 64274) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:33:15.433201 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3fecae4b-7000-4b43-bf3e-b5e2d8a3d112 req-94ac44f5-4d11-4aa7-a71a-a7180911627b service neutron] 10.222.0.10 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847354 Dec 09 22:33:15.439406 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff47a2ae-24d3-48fe-a300-1c739ce8906a req-f58fb357-736c-47d6-872a-67a7270cb2bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:33:15.440957 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ff47a2ae-24d3-48fe-a300-1c739ce8906a req-f58fb357-736c-47d6-872a-67a7270cb2bf service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 1099 time: 0.0412405 Dec 09 22:33:15.498554 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ff47a2ae-24d3-48fe-a300-1c739ce8906a req-3cde6773-8581-4ee5-b6fc-c43a9a15dbc6 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0501947 Dec 09 22:33:16.374714 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-848b5d56-fe16-411a-9ceb-d82d389f568d req-e1af6360-0e47-46a7-b077-8f9c6cec83ea tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:33:16.376806 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-848b5d56-fe16-411a-9ceb-d82d389f568d req-e1af6360-0e47-46a7-b077-8f9c6cec83ea tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 947 time: 0.0575871 Dec 09 22:33:16.436727 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-848b5d56-fe16-411a-9ceb-d82d389f568d req-5e99f5a1-57f7-4279-a62f-ca949b789837 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0531485 Dec 09 22:33:17.557480 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e92c66a-add9-47f1-9054-002f7a3e5b73 req-359e68c8-bb7b-4fa6-8316-1bccca4263dd tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:33:17.558973 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e92c66a-add9-47f1-9054-002f7a3e5b73 req-359e68c8-bb7b-4fa6-8316-1bccca4263dd tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 947 time: 0.0493724 Dec 09 22:33:17.609374 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1e92c66a-add9-47f1-9054-002f7a3e5b73 req-e38028a6-b594-4320-9ee0-0b967872279d tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436330 Dec 09 22:33:27.850448 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:33:27.889159 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:33:33.091929 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-34183a9f-9ca0-489f-94d9-6571f1b5c0c5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:33:35.690161 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8fea2ede-c32f-47ea-8eb1-90134b98df50 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:33:36.945622 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:33:38.292765 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:33:39.721714 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:33:42.352869 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:33:57.847225 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:33:57.890369 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:03.096393 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e1a38f2c-55e8-4160-bebc-cfe36ba3e142 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:05.686398 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7de5113-ad2b-4417-975c-76951f9ce7bb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:06.946205 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:08.287845 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:09.727824 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:15.857153 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86a63167-3025-4f5a-a160-8fe8b976f5df req-836352f4-8635-45c3-861b-dd6e185412bb service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0436931 Dec 09 22:34:15.953309 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86a63167-3025-4f5a-a160-8fe8b976f5df req-2451c44c-efb7-429c-bba5-069d841aaf3d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:15.955857 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86a63167-3025-4f5a-a160-8fe8b976f5df req-2451c44c-efb7-429c-bba5-069d841aaf3d service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=2f75126e83f04a8eb56e531ea19960e3&device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 1099 time: 0.0490398 Dec 09 22:34:16.075532 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86a63167-3025-4f5a-a160-8fe8b976f5df req-d353c441-0fcc-4ad8-a26e-21cce8a08f48 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:16.076912 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86a63167-3025-4f5a-a160-8fe8b976f5df req-d353c441-0fcc-4ad8-a26e-21cce8a08f48 service neutron] 10.222.0.10 "GET /v2.0/networks?id=dddb6458-4699-45f3-afbf-66e168e093fa HTTP/1.1" status: 200 len: 910 time: 0.1007948 Dec 09 22:34:16.143072 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86a63167-3025-4f5a-a160-8fe8b976f5df req-872ff3c2-d4fa-4948-b05c-508b2ff01d4e service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da HTTP/1.1" status: 200 len: 1001 time: 0.0586836 Dec 09 22:34:16.192404 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86a63167-3025-4f5a-a160-8fe8b976f5df req-f5177f85-fd88-4ef1-b2da-396b9719855b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:16.193838 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86a63167-3025-4f5a-a160-8fe8b976f5df req-f5177f85-fd88-4ef1-b2da-396b9719855b service neutron] 10.222.0.10 "GET /v2.0/subnets?id=34856fdf-2a32-48b3-9f67-7cd8c8d39875 HTTP/1.1" status: 200 len: 848 time: 0.0442152 Dec 09 22:34:16.246758 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86a63167-3025-4f5a-a160-8fe8b976f5df req-b6d35949-46be-4a19-931b-39b9e6c5834a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:16.248295 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86a63167-3025-4f5a-a160-8fe8b976f5df req-b6d35949-46be-4a19-931b-39b9e6c5834a service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=dddb6458-4699-45f3-afbf-66e168e093fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0464938 Dec 09 22:34:16.342249 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86a63167-3025-4f5a-a160-8fe8b976f5df req-d550f541-6fad-439a-aae9-5a4a0a23fe89 service neutron] 10.222.0.10 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860984 Dec 09 22:34:16.441631 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-86a63167-3025-4f5a-a160-8fe8b976f5df req-5fb64ddb-5bd0-4ba6-bcbd-89728997e19e service neutron] 10.222.0.10 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0925484 Dec 09 22:34:19.358520 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:34:26.376640 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35318) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:34:26.545151 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Deleting port 3cac460c-f013-4687-9e9d-d6c6a744d5f0 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:34:26.545470 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:26.630086 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:26.630515 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:26.643079 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Calling delete_port for 3cac460c-f013-4687-9e9d-d6c6a744d5f0 owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:34:26.795431 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:26.829771 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event deleted for resources: {'Port': ['ID=3cac460c-f013-4687-9e9d-d6c6a744d5f0,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:34:26.853397 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:26.853750 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:26.854086 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:26.854425 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:26.854764 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:26.855112 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:26.855473 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:26.855773 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:26.856126 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:26.856471 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:26.856775 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:26.857088 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:26.857434 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:26.897970 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:26.898304 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Floating IP 7253d0fb-ed8f-40a8-a5fe-4bfc7daca645 disassociated (deleted). External IP: 172.25.3.38, port: cc6a95f2-7fb9-4017-b8da-f9a084d5d0da. Dec 09 22:34:27.129379 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Router 4310b7c2-6f1e-4838-bdb6-245416900ec5 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:34:27.244903 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:34:27.250196 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:27.257521 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eaf2445a-0eb8-4b45-924e-7947495f00cb None None] Sync routers for ids ['4310b7c2-6f1e-4838-bdb6-245416900ec5'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:34:27.267798 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eaf2445a-0eb8-4b45-924e-7947495f00cb None None] Routers {'4310b7c2-6f1e-4838-bdb6-245416900ec5'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:34:27.268614 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-eaf2445a-0eb8-4b45-924e-7947495f00cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:34:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4310b7c2-6f1e-4838-bdb6-245416900ec5'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:34:27.281020 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-301ce029-440d-4a08-83f8-89846fcd4965 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "DELETE /v2.0/floatingips/7253d0fb-ed8f-40a8-a5fe-4bfc7daca645 HTTP/1.1" status: 204 len: 168 time: 0.9004812 Dec 09 22:34:27.281020 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fdb9f136-4581-4ba3-8bcf-3012bb1c01a1', 'tag': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:34:27.281763 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-113d126f-7669-4df6-b2d3-474c77d29a23" -d '{"events": [{"name": "network-changed", "server_uuid": "fdb9f136-4581-4ba3-8bcf-3012bb1c01a1", "tag": "cc6a95f2-7fb9-4017-b8da-f9a084d5d0da"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:34:27.386735 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-eaf2445a-0eb8-4b45-924e-7947495f00cb None None] Set router 4310b7c2-6f1e-4838-bdb6-245416900ec5 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:34:27.505880 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:34:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f8163c2a-916a-498d-afd0-d3bb908135b3 x-openstack-request-id: req-f8163c2a-916a-498d-afd0-d3bb908135b3 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:34:27.506451 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fdb9f136-4581-4ba3-8bcf-3012bb1c01a1", "tag": "cc6a95f2-7fb9-4017-b8da-f9a084d5d0da", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:34:27.506550 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-f8163c2a-916a-498d-afd0-d3bb908135b3 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:34:27.506987 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fdb9f136-4581-4ba3-8bcf-3012bb1c01a1', 'tag': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da', 'status': 'completed', 'code': 200} Dec 09 22:34:27.587196 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-113d126f-7669-4df6-b2d3-474c77d29a23 req-a7f5d9d9-e9b4-4703-b32e-e7d918a3a7fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:27.588812 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-113d126f-7669-4df6-b2d3-474c77d29a23 req-a7f5d9d9-e9b4-4703-b32e-e7d918a3a7fd service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=2f75126e83f04a8eb56e531ea19960e3&device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 1099 time: 0.0569391 Dec 09 22:34:27.605724 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5d7608f-cc17-4fde-bb69-1d3f72130e36 req-2fc26457-5246-4822-a524-43377b827a5f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:27.607357 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5d7608f-cc17-4fde-bb69-1d3f72130e36 req-2fc26457-5246-4822-a524-43377b827a5f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 947 time: 0.0565796 Dec 09 22:34:27.669818 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5d7608f-cc17-4fde-bb69-1d3f72130e36 req-2d4f85f5-4f28-4012-bbaf-970b535643e4 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0557988 Dec 09 22:34:27.692152 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-eaf2445a-0eb8-4b45-924e-7947495f00cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'name': 'tempest-TestShelveInstance-1687017519-router', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169'}], 'enable_snat': True}, 'gw_port_id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:16Z', 'revision_number': 4, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'gw_port': {'id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:7a:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4313, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'd79bdb0d-daf1-4af3-967c-0210fc9a4e20', 'name': '', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'mac_address': 'fa:16:3e:cb:a6:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_interface', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:15Z', 'updated_at': '2021-12-09T22:30:19Z', 'revision_number': 5, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'subnets': [{'id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:34:27.698877 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-113d126f-7669-4df6-b2d3-474c77d29a23 req-1b73fe10-8afa-4354-bcf6-98e594c87c8b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:27.700458 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-113d126f-7669-4df6-b2d3-474c77d29a23 req-1b73fe10-8afa-4354-bcf6-98e594c87c8b service neutron] 10.222.0.10 "GET /v2.0/networks?id=dddb6458-4699-45f3-afbf-66e168e093fa HTTP/1.1" status: 200 len: 910 time: 0.1034458 Dec 09 22:34:27.717985 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eaf2445a-0eb8-4b45-924e-7947495f00cb None None] Checking router: 4310b7c2-6f1e-4838-bdb6-245416900ec5 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:34:27.726219 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eaf2445a-0eb8-4b45-924e-7947495f00cb None None] Routers {'4310b7c2-6f1e-4838-bdb6-245416900ec5'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:34:27.726817 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-eaf2445a-0eb8-4b45-924e-7947495f00cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:34:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4310b7c2-6f1e-4838-bdb6-245416900ec5'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:34:27.743413 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-113d126f-7669-4df6-b2d3-474c77d29a23 req-e162ac02-3925-4835-af00-d9d2fbed326b service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da HTTP/1.1" status: 200 len: 217 time: 0.0343959 Dec 09 22:34:27.796439 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-113d126f-7669-4df6-b2d3-474c77d29a23 req-015cf1a0-6e0c-403f-9744-88e689bfbe0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:27.797830 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-113d126f-7669-4df6-b2d3-474c77d29a23 req-015cf1a0-6e0c-403f-9744-88e689bfbe0c service neutron] 10.222.0.10 "GET /v2.0/subnets?id=34856fdf-2a32-48b3-9f67-7cd8c8d39875 HTTP/1.1" status: 200 len: 848 time: 0.0471463 Dec 09 22:34:27.834707 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-eaf2445a-0eb8-4b45-924e-7947495f00cb None None] Set router 4310b7c2-6f1e-4838-bdb6-245416900ec5 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:34:27.847356 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-113d126f-7669-4df6-b2d3-474c77d29a23 req-4c5b5aa7-a725-4b2b-b118-459f7dd8b7d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:27.848969 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-113d126f-7669-4df6-b2d3-474c77d29a23 req-4c5b5aa7-a725-4b2b-b118-459f7dd8b7d2 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=dddb6458-4699-45f3-afbf-66e168e093fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0436592 Dec 09 22:34:27.857929 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:27.887085 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:27.942729 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-113d126f-7669-4df6-b2d3-474c77d29a23 req-45c6c856-9fec-4dab-8039-fce17822f434 service neutron] 10.222.0.10 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863099 Dec 09 22:34:28.040534 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-113d126f-7669-4df6-b2d3-474c77d29a23 req-a3b07678-9578-4127-8eb9-8aa8bafba039 service neutron] 10.222.0.10 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0901077 Dec 09 22:34:28.047948 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-eaf2445a-0eb8-4b45-924e-7947495f00cb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'name': 'tempest-TestShelveInstance-1687017519-router', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169'}], 'enable_snat': True}, 'gw_port_id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:16Z', 'revision_number': 4, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'gw_port': {'id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:7a:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4313, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'd79bdb0d-daf1-4af3-967c-0210fc9a4e20', 'name': '', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'mac_address': 'fa:16:3e:cb:a6:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_interface', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:15Z', 'updated_at': '2021-12-09T22:30:19Z', 'revision_number': 5, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'subnets': [{'id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:34:28.074327 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eaf2445a-0eb8-4b45-924e-7947495f00cb None None] The sync data for ids ['4310b7c2-6f1e-4838-bdb6-245416900ec5'] in n-d-713301-27 is: [{'id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'name': 'tempest-TestShelveInstance-1687017519-router', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169'}], 'enable_snat': True}, 'gw_port_id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:16Z', 'revision_number': 4, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'gw_port': {'id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:7a:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4313, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'd79bdb0d-daf1-4af3-967c-0210fc9a4e20', 'name': '', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'mac_address': 'fa:16:3e:cb:a6:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_interface', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:15Z', 'updated_at': '2021-12-09T22:30:19Z', 'revision_number': 5, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'subnets': [{'id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:34:28.322338 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b8690c9-4c61-40d6-a5c3-90eb6870703d None None] New status for floating IP 7253d0fb-ed8f-40a8-a5fe-4bfc7daca645: DOWN {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:34:28.794347 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a48bc63e-c763-4457-8878-7eea7d1a1f35 req-4b5918bc-bf57-4cf8-8998-974cd1b7b4e4 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:28.795953 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a48bc63e-c763-4457-8878-7eea7d1a1f35 req-4b5918bc-bf57-4cf8-8998-974cd1b7b4e4 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.10 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 947 time: 0.0515020 Dec 09 22:34:28.796919 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082d6e92-d757-4c2b-aae5-a031551cacf4 req-d7b67fd6-961b-42e7-b297-0112fb894297 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:28.798464 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-082d6e92-d757-4c2b-aae5-a031551cacf4 req-d7b67fd6-961b-42e7-b297-0112fb894297 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=fdb9f136-4581-4ba3-8bcf-3012bb1c01a1 HTTP/1.1" status: 200 len: 947 time: 0.0537486 Dec 09 22:34:28.850146 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-082d6e92-d757-4c2b-aae5-a031551cacf4 req-5fc02b74-573b-43c8-865e-fc4f8ac430cd tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=2418dd74-008a-49c9-8dfc-3d491a922a03&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453260 Dec 09 22:34:28.890627 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-a48bc63e-c763-4457-8878-7eea7d1a1f35 req-e5124d87-43a8-4f8a-98c2-aa8fa4be1b32 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Deleting port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:34:28.890979 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a48bc63e-c763-4457-8878-7eea7d1a1f35 req-e5124d87-43a8-4f8a-98c2-aa8fa4be1b32 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:28.980128 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-a48bc63e-c763-4457-8878-7eea7d1a1f35 req-e5124d87-43a8-4f8a-98c2-aa8fa4be1b32 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] For port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:34:28.980388 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a48bc63e-c763-4457-8878-7eea7d1a1f35 req-e5124d87-43a8-4f8a-98c2-aa8fa4be1b32 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:28.993064 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-a48bc63e-c763-4457-8878-7eea7d1a1f35 req-e5124d87-43a8-4f8a-98c2-aa8fa4be1b32 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Calling delete_port for cc6a95f2-7fb9-4017-b8da-f9a084d5d0da owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:34:29.127628 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a48bc63e-c763-4457-8878-7eea7d1a1f35 req-e5124d87-43a8-4f8a-98c2-aa8fa4be1b32 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:29.156657 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5124d87-43a8-4f8a-98c2-aa8fa4be1b32 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event deleted for resources: {'Port': ['ID=cc6a95f2-7fb9-4017-b8da-f9a084d5d0da,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:34:29.197596 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-a48bc63e-c763-4457-8878-7eea7d1a1f35 req-e5124d87-43a8-4f8a-98c2-aa8fa4be1b32 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] No DVR routers for this DVR port cc6a95f2-7fb9-4017-b8da-f9a084d5d0da on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:34:29.200291 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-a48bc63e-c763-4457-8878-7eea7d1a1f35 req-e5124d87-43a8-4f8a-98c2-aa8fa4be1b32 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:29.203737 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a48bc63e-c763-4457-8878-7eea7d1a1f35 req-e5124d87-43a8-4f8a-98c2-aa8fa4be1b32 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.10 "DELETE /v2.0/ports/cc6a95f2-7fb9-4017-b8da-f9a084d5d0da HTTP/1.1" status: 204 len: 173 time: 0.4012129 Dec 09 22:34:29.507992 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fdb9f136-4581-4ba3-8bcf-3012bb1c01a1', 'name': 'network-vif-deleted', 'tag': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:34:29.510481 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fc98ab83-6f6c-4d37-b27d-58a9a69e0c30" -d '{"events": [{"server_uuid": "fdb9f136-4581-4ba3-8bcf-3012bb1c01a1", "name": "network-vif-deleted", "tag": "cc6a95f2-7fb9-4017-b8da-f9a084d5d0da"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:34:29.551724 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:34:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-12b0b539-49f7-4c78-92d6-e83e25007b4a x-openstack-request-id: req-12b0b539-49f7-4c78-92d6-e83e25007b4a {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:34:29.551993 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fdb9f136-4581-4ba3-8bcf-3012bb1c01a1", "name": "network-vif-deleted", "tag": "cc6a95f2-7fb9-4017-b8da-f9a084d5d0da", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:34:29.552426 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-12b0b539-49f7-4c78-92d6-e83e25007b4a {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:34:29.552816 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fdb9f136-4581-4ba3-8bcf-3012bb1c01a1', 'name': 'network-vif-deleted', 'tag': 'cc6a95f2-7fb9-4017-b8da-f9a084d5d0da', 'status': 'completed', 'code': 200} Dec 09 22:34:29.909840 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35338) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:34:29.974537 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd4d8c45-7d05-4576-99a5-386f9efcc2c6 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:30.001058 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd4d8c45-7d05-4576-99a5-386f9efcc2c6 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:30.065214 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd4d8c45-7d05-4576-99a5-386f9efcc2c6 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:30.068244 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-cd4d8c45-7d05-4576-99a5-386f9efcc2c6 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:30.069481 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-cd4d8c45-7d05-4576-99a5-386f9efcc2c6 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "DELETE /v2.0/security-groups/2418dd74-008a-49c9-8dfc-3d491a922a03 HTTP/1.1" status: 204 len: 168 time: 0.1586270 Dec 09 22:34:30.079115 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd4d8c45-7d05-4576-99a5-386f9efcc2c6 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=2418dd74-008a-49c9-8dfc-3d491a922a03,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:34:30.333258 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35344) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:34:30.338013 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-8e247492-4a1f-4a4c-9a04-600cadbd2219 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-159607182', 'description': 'tempest-secgroup-smoke-159607182 description', 'project_id': '2f75126e83f04a8eb56e531ea19960e3'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:34:30.362535 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e247492-4a1f-4a4c-9a04-600cadbd2219 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:30.430569 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e247492-4a1f-4a4c-9a04-600cadbd2219 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:30.436531 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e247492-4a1f-4a4c-9a04-600cadbd2219 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:30.474108 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8e247492-4a1f-4a4c-9a04-600cadbd2219 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:30.475368 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8e247492-4a1f-4a4c-9a04-600cadbd2219 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.1410730 Dec 09 22:34:30.476481 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e247492-4a1f-4a4c-9a04-600cadbd2219 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0481a8d1-09e1-4f35-a1cc-a21989877565,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:34:30.478373 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35346) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:34:30.483226 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-1c2dccf5-7a54-4496-b80f-c5a85dd70883 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Request body: {'security_group_rule': {'security_group_id': '0481a8d1-09e1-4f35-a1cc-a21989877565', 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:34:30.511851 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1c2dccf5-7a54-4496-b80f-c5a85dd70883 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:30.565742 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1c2dccf5-7a54-4496-b80f-c5a85dd70883 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:30.571122 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1c2dccf5-7a54-4496-b80f-c5a85dd70883 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:30.589678 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c2dccf5-7a54-4496-b80f-c5a85dd70883 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9848cc71-c943-4623-bf99-b4d1e9328760,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:34:30.598489 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c2dccf5-7a54-4496-b80f-c5a85dd70883 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:30.598833 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c2dccf5-7a54-4496-b80f-c5a85dd70883 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:30.599216 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c2dccf5-7a54-4496-b80f-c5a85dd70883 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:30.599738 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c2dccf5-7a54-4496-b80f-c5a85dd70883 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:30.600079 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c2dccf5-7a54-4496-b80f-c5a85dd70883 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:30.600414 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c2dccf5-7a54-4496-b80f-c5a85dd70883 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:30.600740 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c2dccf5-7a54-4496-b80f-c5a85dd70883 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:30.601066 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c2dccf5-7a54-4496-b80f-c5a85dd70883 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:30.601386 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c2dccf5-7a54-4496-b80f-c5a85dd70883 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:30.601703 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c2dccf5-7a54-4496-b80f-c5a85dd70883 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:30.602022 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c2dccf5-7a54-4496-b80f-c5a85dd70883 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:30.602342 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c2dccf5-7a54-4496-b80f-c5a85dd70883 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:30.602658 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c2dccf5-7a54-4496-b80f-c5a85dd70883 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:34:30.608299 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-1c2dccf5-7a54-4496-b80f-c5a85dd70883 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:30.609627 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1c2dccf5-7a54-4496-b80f-c5a85dd70883 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1300080 Dec 09 22:34:30.612277 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35348) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:34:30.616972 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-5fd2d167-3f5b-43ee-8276-be7069ed0f3d tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Request body: {'security_group_rule': {'security_group_id': '0481a8d1-09e1-4f35-a1cc-a21989877565', 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:34:30.650225 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fd2d167-3f5b-43ee-8276-be7069ed0f3d tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:30.709336 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fd2d167-3f5b-43ee-8276-be7069ed0f3d tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:30.714763 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fd2d167-3f5b-43ee-8276-be7069ed0f3d tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:30.734907 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fd2d167-3f5b-43ee-8276-be7069ed0f3d tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b0a361a5-a44f-4dc7-a49b-c178d897ff0f,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:34:30.744100 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-5fd2d167-3f5b-43ee-8276-be7069ed0f3d tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:30.745296 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-5fd2d167-3f5b-43ee-8276-be7069ed0f3d tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1320620 Dec 09 22:34:30.748195 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35350) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:34:30.752490 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-395dec25-a825-4c69-b51e-e040fe113bd8 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Request body: {'security_group_rule': {'security_group_id': '0481a8d1-09e1-4f35-a1cc-a21989877565', 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:34:30.780561 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-395dec25-a825-4c69-b51e-e040fe113bd8 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:30.838430 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-395dec25-a825-4c69-b51e-e040fe113bd8 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:30.842710 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-395dec25-a825-4c69-b51e-e040fe113bd8 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:30.860504 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-395dec25-a825-4c69-b51e-e040fe113bd8 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=36efa9fa-e9a3-4e51-9809-94d2d0ef09ef,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:34:30.868619 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-395dec25-a825-4c69-b51e-e040fe113bd8 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:30.869825 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-395dec25-a825-4c69-b51e-e040fe113bd8 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1207078 Dec 09 22:34:30.872753 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35352) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:34:30.877087 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-c98389cb-37e9-45c6-8380-fd47bccc138f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Request body: {'security_group_rule': {'security_group_id': '0481a8d1-09e1-4f35-a1cc-a21989877565', 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:34:30.904386 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c98389cb-37e9-45c6-8380-fd47bccc138f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:30.965020 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c98389cb-37e9-45c6-8380-fd47bccc138f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:30.970479 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c98389cb-37e9-45c6-8380-fd47bccc138f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:30.987723 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c98389cb-37e9-45c6-8380-fd47bccc138f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3cc1dc79-fdf8-47c8-b323-0f334a343c8b,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:34:30.997460 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-c98389cb-37e9-45c6-8380-fd47bccc138f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:30.998678 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-c98389cb-37e9-45c6-8380-fd47bccc138f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1249740 Dec 09 22:34:31.001478 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35354) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:34:31.005860 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-bfdba907-0955-4f45-afed-3437369a82aa tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Request body: {'security_group_rule': {'security_group_id': '0481a8d1-09e1-4f35-a1cc-a21989877565', 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:34:31.027584 n-d-713301-27 neutron-server[103438]: INFO neutron.db.securitygroups_db [None req-bfdba907-0955-4f45-afed-3437369a82aa tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Project 2f75126e83f04a8eb56e531ea19960e3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 22:34:31.032622 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bfdba907-0955-4f45-afed-3437369a82aa tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:31.093082 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bfdba907-0955-4f45-afed-3437369a82aa tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:31.098180 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bfdba907-0955-4f45-afed-3437369a82aa tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:31.119191 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfdba907-0955-4f45-afed-3437369a82aa tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5f0f710e-3d4a-45e4-83f9-79d3249c15e8,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:34:31.127485 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-bfdba907-0955-4f45-afed-3437369a82aa tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:31.128674 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-bfdba907-0955-4f45-afed-3437369a82aa tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1262784 Dec 09 22:34:31.131872 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35356) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:34:31.136216 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-63f05bb3-dc26-4d99-bdbc-b42c901c1264 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Request body: {'security_group_rule': {'security_group_id': '0481a8d1-09e1-4f35-a1cc-a21989877565', 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:34:31.161060 n-d-713301-27 neutron-server[103438]: INFO neutron.db.securitygroups_db [None req-63f05bb3-dc26-4d99-bdbc-b42c901c1264 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Project 2f75126e83f04a8eb56e531ea19960e3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 22:34:31.166514 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-63f05bb3-dc26-4d99-bdbc-b42c901c1264 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:31.227471 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-63f05bb3-dc26-4d99-bdbc-b42c901c1264 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:31.232832 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-63f05bb3-dc26-4d99-bdbc-b42c901c1264 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:31.255012 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63f05bb3-dc26-4d99-bdbc-b42c901c1264 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f99bb15d-e9d9-4a99-8a98-bfbc88bcea2b,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:34:31.260218 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-63f05bb3-dc26-4d99-bdbc-b42c901c1264 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:31.261391 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-63f05bb3-dc26-4d99-bdbc-b42c901c1264 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1286032 Dec 09 22:34:33.091326 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-99b15973-cbd7-468f-820a-30964455352d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:33.234370 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device cc6a95f2-7fb9-4017-b8da-f9a084d5d0da no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:34:33.254793 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: cc6a95f2-7fb9-4017-b8da-f9a084d5d0da {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:34:33.255150 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device cc6a95f2-7fb9-4017-b8da-f9a084d5d0da not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:34:35.680490 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0d8c1246-cf24-43e0-9a5b-dd69e079a12c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:36.953706 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:38.291916 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:39.714360 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:47.619930 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-174a6749-1035-430f-b5ab-146c13bc78da req-bbd4f7c1-3edd-44d0-984d-057bd32975f1 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-159607182&fields=id&tenant_id=2f75126e83f04a8eb56e531ea19960e3 HTTP/1.1" status: 200 len: 267 time: 0.0506968 Dec 09 22:34:47.738607 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174a6749-1035-430f-b5ab-146c13bc78da req-bb4088b6-6292-4c6f-a203-7396dc9318ea tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:47.740440 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-174a6749-1035-430f-b5ab-146c13bc78da req-bb4088b6-6292-4c6f-a203-7396dc9318ea tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/networks?id=dddb6458-4699-45f3-afbf-66e168e093fa HTTP/1.1" status: 200 len: 809 time: 0.1111512 Dec 09 22:34:47.756527 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-174a6749-1035-430f-b5ab-146c13bc78da req-2c56e5f8-72fe-4ff9-9b80-87651421caf8 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/quotas/2f75126e83f04a8eb56e531ea19960e3 HTTP/1.1" status: 200 len: 375 time: 0.0094695 Dec 09 22:34:47.814247 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-174a6749-1035-430f-b5ab-146c13bc78da req-5686a765-36d2-4f72-9d1b-8a1552bb0811 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=2f75126e83f04a8eb56e531ea19960e3&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0517871 Dec 09 22:34:47.886922 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-174a6749-1035-430f-b5ab-146c13bc78da req-3519775d-033d-46ab-a6a2-448fca30377c service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103438) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 22:34:47.888021 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-174a6749-1035-430f-b5ab-146c13bc78da req-3519775d-033d-46ab-a6a2-448fca30377c service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0612061 Dec 09 22:34:47.989789 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-174a6749-1035-430f-b5ab-146c13bc78da req-08335154-f50c-4648-8ff9-3f41f54a51f2 service neutron] 10.222.0.13 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0951841 Dec 09 22:34:48.094438 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-174a6749-1035-430f-b5ab-146c13bc78da req-bdfb1ba4-f5ab-4f60-b649-0a391d8a4265 service neutron] 10.222.0.13 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0924053 Dec 09 22:34:48.389119 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f4a08cf-72dc-4662-aaff-f64bd90cb40b req-636ea323-1961-4436-b1b1-ef4a20822703 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 210 time: 0.0262396 Dec 09 22:34:49.467670 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2f1ccaa5-4be5-4fdf-8905-98fffddfca59 req-6e3f973a-c6d5-4fed-ba08-aaa7b93f64cb tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 210 time: 0.0273039 Dec 09 22:34:50.550825 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7361240d-f706-460f-ad5d-75f66ed00346 req-94772f50-940a-4c28-a30e-364b2cf1bc60 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 210 time: 0.0309386 Dec 09 22:34:51.641780 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a117d75f-64e9-450f-bb7c-6e8466a271df req-4d98a718-0218-40d0-976d-d0638e80ce43 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 210 time: 0.0262992 Dec 09 22:34:52.745215 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-69395440-6923-451f-a52b-cd727898a103 req-84f0e1d0-3208-4835-969d-d84eb6833ed6 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 210 time: 0.0266533 Dec 09 22:34:53.499521 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174a6749-1035-430f-b5ab-146c13bc78da req-21bb9570-8b46-4105-a963-f3fa88bd7f47 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:53.501005 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-174a6749-1035-430f-b5ab-146c13bc78da req-21bb9570-8b46-4105-a963-f3fa88bd7f47 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.31 "GET /v2.0/networks?id=dddb6458-4699-45f3-afbf-66e168e093fa HTTP/1.1" status: 200 len: 809 time: 0.1061506 Dec 09 22:34:53.566959 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-174a6749-1035-430f-b5ab-146c13bc78da req-48540fc5-cfd8-4ba0-ba7e-c9ec4632ebd6 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2f75126e83f04a8eb56e531ea19960e3 HTTP/1.1" status: 200 len: 379 time: 0.0558562 Dec 09 22:34:53.577326 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-174a6749-1035-430f-b5ab-146c13bc78da req-516a6a4e-0680-4f81-bbd0-55179457710b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Request body: {'port': {'device_id': 'b334211c-1c1f-458f-b95a-8a52d4bae7b7', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'admin_state_up': True, 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'security_groups': ['0481a8d1-09e1-4f35-a1cc-a21989877565']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:34:53.692136 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-174a6749-1035-430f-b5ab-146c13bc78da req-516a6a4e-0680-4f81-bbd0-55179457710b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Made reservation on behalf of 2f75126e83f04a8eb56e531ea19960e3 for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:34:53.695736 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-174a6749-1035-430f-b5ab-146c13bc78da req-516a6a4e-0680-4f81-bbd0-55179457710b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:53.835515 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-174a6749-1035-430f-b5ab-146c13bc78da req-516a6a4e-0680-4f81-bbd0-55179457710b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Allocated IP 172.20.0.13 (dddb6458-4699-45f3-afbf-66e168e093fa/34856fdf-2a32-48b3-9f67-7cd8c8d39875/ead426a5-6e3c-4c72-9116-5b7ec9652c55) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:34:53.851721 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-855345ca-0f33-4604-9948-f3eb9f31a778 req-74958635-bf14-459b-9618-0ba775bb4280 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 210 time: 0.0274220 Dec 09 22:34:54.353180 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-174a6749-1035-430f-b5ab-146c13bc78da req-516a6a4e-0680-4f81-bbd0-55179457710b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:54.390340 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-174a6749-1035-430f-b5ab-146c13bc78da req-516a6a4e-0680-4f81-bbd0-55179457710b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:54.432557 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-174a6749-1035-430f-b5ab-146c13bc78da req-516a6a4e-0680-4f81-bbd0-55179457710b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Network dddb6458-4699-45f3-afbf-66e168e093fa is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:34:54.435724 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-174a6749-1035-430f-b5ab-146c13bc78da req-516a6a4e-0680-4f81-bbd0-55179457710b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:34:54.442766 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-174a6749-1035-430f-b5ab-146c13bc78da req-516a6a4e-0680-4f81-bbd0-55179457710b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:34:54.467526 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-516a6a4e-0680-4f81-bbd0-55179457710b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event updated for resources: {'Port': ['ID=ead426a5-6e3c-4c72-9116-5b7ec9652c55,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:34:54.501455 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174a6749-1035-430f-b5ab-146c13bc78da req-516a6a4e-0680-4f81-bbd0-55179457710b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:54.502112 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-174a6749-1035-430f-b5ab-146c13bc78da req-516a6a4e-0680-4f81-bbd0-55179457710b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:54.520375 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-174a6749-1035-430f-b5ab-146c13bc78da req-516a6a4e-0680-4f81-bbd0-55179457710b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9467244 Dec 09 22:34:54.581941 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-174a6749-1035-430f-b5ab-146c13bc78da req-64da73b6-86bb-426b-8635-8165d4dabe86 service neutron] Request body: {'port': {'device_id': 'b334211c-1c1f-458f-b95a-8a52d4bae7b7', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:34:54.641826 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-174a6749-1035-430f-b5ab-146c13bc78da req-64da73b6-86bb-426b-8635-8165d4dabe86 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:54.665867 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-302430bc-fdb1-4275-90da-0c53b25747a5 None None] Provisioning complete for port ead426a5-6e3c-4c72-9116-5b7ec9652c55 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:34:54.666638 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-302430bc-fdb1-4275-90da-0c53b25747a5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:54.715028 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-302430bc-fdb1-4275-90da-0c53b25747a5 None None] Port ead426a5-6e3c-4c72-9116-5b7ec9652c55 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:34:54.919241 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-174a6749-1035-430f-b5ab-146c13bc78da req-64da73b6-86bb-426b-8635-8165d4dabe86 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ead426a5-6e3c-4c72-9116-5b7ec9652c55 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:34:54.927574 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-174a6749-1035-430f-b5ab-146c13bc78da req-64da73b6-86bb-426b-8635-8165d4dabe86 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:54.941200 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-174a6749-1035-430f-b5ab-146c13bc78da req-64da73b6-86bb-426b-8635-8165d4dabe86 service neutron] Transition to ACTIVE for port object ead426a5-6e3c-4c72-9116-5b7ec9652c55 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:34:54.946082 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-174a6749-1035-430f-b5ab-146c13bc78da req-64da73b6-86bb-426b-8635-8165d4dabe86 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:54.981023 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca09bce4-073d-46c0-ba5a-834dc8b29b16 req-a0287ae0-c062-4826-b03d-a6ce9661a00c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:54.982647 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ca09bce4-073d-46c0-ba5a-834dc8b29b16 req-a0287ae0-c062-4826-b03d-a6ce9661a00c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 932 time: 0.0585573 Dec 09 22:34:55.033450 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64da73b6-86bb-426b-8635-8165d4dabe86 service neutron] Pushing event updated for resources: {'Port': ['ID=ead426a5-6e3c-4c72-9116-5b7ec9652c55,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:34:55.062153 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ca09bce4-073d-46c0-ba5a-834dc8b29b16 req-cb0c5bb3-8b8d-422c-81a6-bd9ee05efb56 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0706861 Dec 09 22:34:55.094425 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-174a6749-1035-430f-b5ab-146c13bc78da req-64da73b6-86bb-426b-8635-8165d4dabe86 service neutron] Attempting to bind port ead426a5-6e3c-4c72-9116-5b7ec9652c55 on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:34:55.095648 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-174a6749-1035-430f-b5ab-146c13bc78da req-64da73b6-86bb-426b-8635-8165d4dabe86 service neutron] Attempting to bind port ead426a5-6e3c-4c72-9116-5b7ec9652c55 by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '4fd32693-bdb8-493a-a8d8-5bd83c6f9f80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:34:55.096046 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-174a6749-1035-430f-b5ab-146c13bc78da req-64da73b6-86bb-426b-8635-8165d4dabe86 service neutron] Attempting to bind port ead426a5-6e3c-4c72-9116-5b7ec9652c55 on network dddb6458-4699-45f3-afbf-66e168e093fa {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:34:55.101133 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-174a6749-1035-430f-b5ab-146c13bc78da req-64da73b6-86bb-426b-8635-8165d4dabe86 service neutron] Port ead426a5-6e3c-4c72-9116-5b7ec9652c55 on network dddb6458-4699-45f3-afbf-66e168e093fa not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:34:55.101446 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-174a6749-1035-430f-b5ab-146c13bc78da req-64da73b6-86bb-426b-8635-8165d4dabe86 service neutron] Attempting to bind port ead426a5-6e3c-4c72-9116-5b7ec9652c55 on network dddb6458-4699-45f3-afbf-66e168e093fa {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:34:55.107587 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-174a6749-1035-430f-b5ab-146c13bc78da req-64da73b6-86bb-426b-8635-8165d4dabe86 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 34, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:34:55.107930 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-174a6749-1035-430f-b5ab-146c13bc78da req-64da73b6-86bb-426b-8635-8165d4dabe86 service neutron] Checking segment: {'id': '4fd32693-bdb8-493a-a8d8-5bd83c6f9f80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:34:55.108317 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-174a6749-1035-430f-b5ab-146c13bc78da req-64da73b6-86bb-426b-8635-8165d4dabe86 service neutron] Bound using segment: {'id': '4fd32693-bdb8-493a-a8d8-5bd83c6f9f80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:34:55.108751 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-174a6749-1035-430f-b5ab-146c13bc78da req-64da73b6-86bb-426b-8635-8165d4dabe86 service neutron] Bound port: ead426a5-6e3c-4c72-9116-5b7ec9652c55, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4fd32693-bdb8-493a-a8d8-5bd83c6f9f80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 106, 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:34:55.109247 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-174a6749-1035-430f-b5ab-146c13bc78da req-64da73b6-86bb-426b-8635-8165d4dabe86 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:55.180841 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-174a6749-1035-430f-b5ab-146c13bc78da req-64da73b6-86bb-426b-8635-8165d4dabe86 service neutron] For port ead426a5-6e3c-4c72-9116-5b7ec9652c55, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:34:55.185110 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-174a6749-1035-430f-b5ab-146c13bc78da req-64da73b6-86bb-426b-8635-8165d4dabe86 service neutron] For port ead426a5-6e3c-4c72-9116-5b7ec9652c55, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ead426a5-6e3c-4c72-9116-5b7ec9652c55,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:34:55.191868 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-174a6749-1035-430f-b5ab-146c13bc78da req-64da73b6-86bb-426b-8635-8165d4dabe86 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:55.232261 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174a6749-1035-430f-b5ab-146c13bc78da req-64da73b6-86bb-426b-8635-8165d4dabe86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:55.232941 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-174a6749-1035-430f-b5ab-146c13bc78da req-64da73b6-86bb-426b-8635-8165d4dabe86 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:55.234455 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-174a6749-1035-430f-b5ab-146c13bc78da req-64da73b6-86bb-426b-8635-8165d4dabe86 service neutron] 10.222.0.31 "PUT /v2.0/ports/ead426a5-6e3c-4c72-9116-5b7ec9652c55 HTTP/1.1" status: 200 len: 1093 time: 0.7059176 Dec 09 22:34:55.234802 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b334211c-1c1f-458f-b95a-8a52d4bae7b7', 'tag': 'ead426a5-6e3c-4c72-9116-5b7ec9652c55'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:34:55.237097 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fd963519-0bf6-4231-a305-5dabb784b43f" -d '{"events": [{"name": "network-changed", "server_uuid": "b334211c-1c1f-458f-b95a-8a52d4bae7b7", "tag": "ead426a5-6e3c-4c72-9116-5b7ec9652c55"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:34:55.261060 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64da73b6-86bb-426b-8635-8165d4dabe86 service neutron] Pushing event updated for resources: {'Port': ['ID=ead426a5-6e3c-4c72-9116-5b7ec9652c55,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:34:55.316176 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:34:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0bf55956-3fd1-4298-8942-3a5464cb6c8a x-openstack-request-id: req-0bf55956-3fd1-4298-8942-3a5464cb6c8a {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:34:55.316480 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b334211c-1c1f-458f-b95a-8a52d4bae7b7", "tag": "ead426a5-6e3c-4c72-9116-5b7ec9652c55", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:34:55.316725 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-0bf55956-3fd1-4298-8942-3a5464cb6c8a {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:34:55.317131 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b334211c-1c1f-458f-b95a-8a52d4bae7b7', 'tag': 'ead426a5-6e3c-4c72-9116-5b7ec9652c55', 'status': 'completed', 'code': 200} Dec 09 22:34:55.334448 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174a6749-1035-430f-b5ab-146c13bc78da req-8109027c-e461-4dab-878c-fef2e0f2b117 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:55.336155 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-174a6749-1035-430f-b5ab-146c13bc78da req-8109027c-e461-4dab-878c-fef2e0f2b117 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2f75126e83f04a8eb56e531ea19960e3&device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 1096 time: 0.0504620 Dec 09 22:34:55.390410 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-174a6749-1035-430f-b5ab-146c13bc78da req-d2308ca5-8ae6-468f-89eb-ed647b9e13c5 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ead426a5-6e3c-4c72-9116-5b7ec9652c55 HTTP/1.1" status: 200 len: 217 time: 0.0458896 Dec 09 22:34:55.446832 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174a6749-1035-430f-b5ab-146c13bc78da req-15da21c4-637a-4ba9-bac9-020d75aa3e45 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:55.448769 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-174a6749-1035-430f-b5ab-146c13bc78da req-15da21c4-637a-4ba9-bac9-020d75aa3e45 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=34856fdf-2a32-48b3-9f67-7cd8c8d39875 HTTP/1.1" status: 200 len: 848 time: 0.0500655 Dec 09 22:34:55.495749 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-174a6749-1035-430f-b5ab-146c13bc78da req-92c770d5-5bb6-4aec-bec1-e6ba0c7c4f93 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:55.497334 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-174a6749-1035-430f-b5ab-146c13bc78da req-92c770d5-5bb6-4aec-bec1-e6ba0c7c4f93 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=dddb6458-4699-45f3-afbf-66e168e093fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0411072 Dec 09 22:34:55.594457 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-174a6749-1035-430f-b5ab-146c13bc78da req-4356a9f7-a5d2-4844-a022-9ec63dea6d2c service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0895371 Dec 09 22:34:55.686549 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-174a6749-1035-430f-b5ab-146c13bc78da req-85c5813d-537d-445d-bc7e-84d481ae6df2 service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0839508 Dec 09 22:34:55.773407 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd963519-0bf6-4231-a305-5dabb784b43f req-d936d80b-7070-4c4e-ad4a-b913b8bdea4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:55.774954 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fd963519-0bf6-4231-a305-5dabb784b43f req-d936d80b-7070-4c4e-ad4a-b913b8bdea4b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2f75126e83f04a8eb56e531ea19960e3&device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 1096 time: 0.0428090 Dec 09 22:34:55.873868 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd963519-0bf6-4231-a305-5dabb784b43f req-1d4bcb1f-e988-427a-8564-c3ef8f057b7f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:55.875328 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fd963519-0bf6-4231-a305-5dabb784b43f req-1d4bcb1f-e988-427a-8564-c3ef8f057b7f service neutron] 10.222.0.31 "GET /v2.0/networks?id=dddb6458-4699-45f3-afbf-66e168e093fa HTTP/1.1" status: 200 len: 910 time: 0.0939682 Dec 09 22:34:55.919162 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fd963519-0bf6-4231-a305-5dabb784b43f req-06856e08-65fa-429f-ba09-360cc6c884ab service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ead426a5-6e3c-4c72-9116-5b7ec9652c55 HTTP/1.1" status: 200 len: 217 time: 0.0365593 Dec 09 22:34:55.973814 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd963519-0bf6-4231-a305-5dabb784b43f req-021f4c8d-91f9-454a-bb60-97440923610b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:55.975315 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fd963519-0bf6-4231-a305-5dabb784b43f req-021f4c8d-91f9-454a-bb60-97440923610b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=34856fdf-2a32-48b3-9f67-7cd8c8d39875 HTTP/1.1" status: 200 len: 848 time: 0.0488939 Dec 09 22:34:56.021212 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd963519-0bf6-4231-a305-5dabb784b43f req-a23029c9-be1c-4610-87bd-eed74b637fef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:56.022748 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fd963519-0bf6-4231-a305-5dabb784b43f req-a23029c9-be1c-4610-87bd-eed74b637fef service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=dddb6458-4699-45f3-afbf-66e168e093fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0401926 Dec 09 22:34:56.129329 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fd963519-0bf6-4231-a305-5dabb784b43f req-f8ed73a1-3b10-4128-9d47-7b052b2f5770 service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0989289 Dec 09 22:34:56.197934 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61b5942e-5a4f-4663-870b-d046ea558aaf req-460156fe-e8db-4fc9-8260-b75923dc031e tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:56.200258 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-61b5942e-5a4f-4663-870b-d046ea558aaf req-460156fe-e8db-4fc9-8260-b75923dc031e tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 944 time: 0.0520768 Dec 09 22:34:56.223984 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-fd963519-0bf6-4231-a305-5dabb784b43f req-379e309e-5685-46f4-8abf-1d13080828c0 service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0874579 Dec 09 22:34:56.256109 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-61b5942e-5a4f-4663-870b-d046ea558aaf req-fd3bb691-d1de-45ad-beee-df0d2925da99 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462666 Dec 09 22:34:56.358100 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:34:57.394764 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8c5f6b7-622b-4f0c-b375-2a9842f24753 req-4adc0c5a-8174-4e47-abb2-30deca1a56ed tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:57.396283 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8c5f6b7-622b-4f0c-b375-2a9842f24753 req-4adc0c5a-8174-4e47-abb2-30deca1a56ed tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 944 time: 0.0573702 Dec 09 22:34:57.448991 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b8c5f6b7-622b-4f0c-b375-2a9842f24753 req-7f268771-cf7c-4c5c-90ac-88dfa76a0b3e tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462351 Dec 09 22:34:57.858180 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:57.895714 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:34:58.573603 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42c04c23-33ab-4115-baa1-1b5d00c3f801 req-0be121f6-5b3f-4300-9092-4faad5931d63 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:58.575135 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42c04c23-33ab-4115-baa1-1b5d00c3f801 req-0be121f6-5b3f-4300-9092-4faad5931d63 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 944 time: 0.0558157 Dec 09 22:34:58.625919 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42c04c23-33ab-4115-baa1-1b5d00c3f801 req-063bd026-387f-4a38-8c94-715535a95d92 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444980 Dec 09 22:34:59.752142 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a17b8c41-7c5d-4122-ae36-31886ddc03d8 req-a968c4cc-af21-4836-82b1-d4725999cd48 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:34:59.753613 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a17b8c41-7c5d-4122-ae36-31886ddc03d8 req-a968c4cc-af21-4836-82b1-d4725999cd48 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 944 time: 0.0511031 Dec 09 22:34:59.804141 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a17b8c41-7c5d-4122-ae36-31886ddc03d8 req-79081a31-61f2-457a-9785-bf9bcac5d9e6 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444572 Dec 09 22:35:00.934291 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf57cac9-4eca-49a0-8d8d-1588c101ccd1 req-97cc4e91-d7aa-4c11-8d00-f04f331b532f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:35:00.935713 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf57cac9-4eca-49a0-8d8d-1588c101ccd1 req-97cc4e91-d7aa-4c11-8d00-f04f331b532f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 944 time: 0.0586696 Dec 09 22:35:00.989297 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cf57cac9-4eca-49a0-8d8d-1588c101ccd1 req-def35fe4-8457-4102-888c-2269b24bf549 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0469971 Dec 09 22:35:02.121214 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffaeb1cd-7476-48a6-aa83-d17f4168e1ec req-37755603-7d67-4285-bae6-a63b0fff464f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:35:02.122650 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ffaeb1cd-7476-48a6-aa83-d17f4168e1ec req-37755603-7d67-4285-bae6-a63b0fff464f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 944 time: 0.0531037 Dec 09 22:35:02.176566 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ffaeb1cd-7476-48a6-aa83-d17f4168e1ec req-142c27e9-43ec-43f2-ad89-5b248f5ee13b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447841 Dec 09 22:35:03.104291 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d5179215-8856-43f2-a697-f427e629dbe8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:03.309201 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4e7cff5-dfff-4f38-ac12-f87bd2ed1afe req-0d029ecb-78ca-4e89-8144-bea369933882 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:35:03.310655 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e4e7cff5-dfff-4f38-ac12-f87bd2ed1afe req-0d029ecb-78ca-4e89-8144-bea369933882 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 944 time: 0.0642450 Dec 09 22:35:03.364565 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e4e7cff5-dfff-4f38-ac12-f87bd2ed1afe req-1432709d-d925-4981-ae42-8240e131840a tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0469170 Dec 09 22:35:04.503169 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c30cd91c-d02b-498c-8916-76c85471885e req-8192534d-5869-4edb-b1c2-cf822aa6b7e3 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:35:04.504717 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c30cd91c-d02b-498c-8916-76c85471885e req-8192534d-5869-4edb-b1c2-cf822aa6b7e3 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 944 time: 0.0551577 Dec 09 22:35:04.554445 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c30cd91c-d02b-498c-8916-76c85471885e req-36c24350-226e-4911-867f-beed75e6380b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436959 Dec 09 22:35:05.684813 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-105a95d2-7554-41da-bd94-012cc9525706 req-d80a73df-457c-4844-a14b-95806e367577 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:35:05.686029 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca373e3e-e377-4d04-b75a-412a00a3b23f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:05.686435 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-105a95d2-7554-41da-bd94-012cc9525706 req-d80a73df-457c-4844-a14b-95806e367577 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 944 time: 0.0543680 Dec 09 22:35:05.736556 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-105a95d2-7554-41da-bd94-012cc9525706 req-f10bb575-234e-4deb-a019-b03a43d0ad8b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424213 Dec 09 22:35:06.865853 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e86019f5-eae8-44bc-bee7-2af597a4b3f9 req-d18798a6-0fae-432d-9f80-87d904fd2bf0 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:35:06.867412 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e86019f5-eae8-44bc-bee7-2af597a4b3f9 req-d18798a6-0fae-432d-9f80-87d904fd2bf0 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 944 time: 0.0533221 Dec 09 22:35:06.919254 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e86019f5-eae8-44bc-bee7-2af597a4b3f9 req-103e3352-dda3-4c02-96b4-0bb9736cd14b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442250 Dec 09 22:35:06.950664 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:07.920126 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device ead426a5-6e3c-4c72-9116-5b7ec9652c55 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:35:08.029167 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port ead426a5-6e3c-4c72-9116-5b7ec9652c55, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ead426a5-6e3c-4c72-9116-5b7ec9652c55,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:35:08.042494 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74023a64-88ab-407f-a498-b24405dd1618 req-e1715a2b-e8b8-4849-960a-f5480a5040e5 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:35:08.044392 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'ead426a5-6e3c-4c72-9116-5b7ec9652c55', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'port_id': 'ead426a5-6e3c-4c72-9116-5b7ec9652c55', 'mac_address': 'fa:16:3e:87:03:71', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 106, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:35:08.044993 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-74023a64-88ab-407f-a498-b24405dd1618 req-e1715a2b-e8b8-4849-960a-f5480a5040e5 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 944 time: 0.0537095 Dec 09 22:35:08.089772 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:08.094863 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-74023a64-88ab-407f-a498-b24405dd1618 req-51c960ea-7449-4336-8aeb-5c59e78b77ca tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436409 Dec 09 22:35:08.103098 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ead426a5-6e3c-4c72-9116-5b7ec9652c55 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:35:08.122835 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port ead426a5-6e3c-4c72-9116-5b7ec9652c55, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ead426a5-6e3c-4c72-9116-5b7ec9652c55,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:35:08.129366 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:08.191908 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=ead426a5-6e3c-4c72-9116-5b7ec9652c55,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:35:08.200038 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:35:08.200390 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:35:08.200723 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:35:08.201070 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:35:08.201401 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:35:08.201718 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:35:08.202047 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:35:08.202376 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:35:08.202705 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:35:08.203023 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:35:08.203348 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:35:08.203706 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:35:08.204020 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:35:08.292638 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:08.528091 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['ead426a5-6e3c-4c72-9116-5b7ec9652c55'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:35:09.224870 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e97ea597-3013-40ce-a7f1-da1ef8697f19 req-57284e4f-1e16-41aa-8d0f-f30d32bd1779 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:35:09.226429 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e97ea597-3013-40ce-a7f1-da1ef8697f19 req-57284e4f-1e16-41aa-8d0f-f30d32bd1779 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 945 time: 0.0575180 Dec 09 22:35:09.288620 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e97ea597-3013-40ce-a7f1-da1ef8697f19 req-aeb2274a-6499-47c0-985c-2c06a9e37df4 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0523975 Dec 09 22:35:09.714638 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:09.936456 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device ead426a5-6e3c-4c72-9116-5b7ec9652c55 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:35:10.003466 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port ead426a5-6e3c-4c72-9116-5b7ec9652c55 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:35:10.007078 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port ead426a5-6e3c-4c72-9116-5b7ec9652c55 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:35:10.007426 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:10.085749 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:10.109763 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b334211c-1c1f-458f-b95a-8a52d4bae7b7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ead426a5-6e3c-4c72-9116-5b7ec9652c55'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:35:10.112056 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-335f779f-8db6-4462-bb33-f5c69b3f7149" -d '{"events": [{"server_uuid": "b334211c-1c1f-458f-b95a-8a52d4bae7b7", "name": "network-vif-plugged", "status": "completed", "tag": "ead426a5-6e3c-4c72-9116-5b7ec9652c55"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:35:10.124683 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port ead426a5-6e3c-4c72-9116-5b7ec9652c55, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ead426a5-6e3c-4c72-9116-5b7ec9652c55,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:35:10.129988 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:10.181004 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=ead426a5-6e3c-4c72-9116-5b7ec9652c55,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:35:10.207050 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:35:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2afcff55-22c7-4610-b77c-ec5155179968 x-openstack-request-id: req-2afcff55-22c7-4610-b77c-ec5155179968 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:35:10.207357 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b334211c-1c1f-458f-b95a-8a52d4bae7b7", "name": "network-vif-plugged", "status": "completed", "tag": "ead426a5-6e3c-4c72-9116-5b7ec9652c55", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:35:10.207649 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-2afcff55-22c7-4610-b77c-ec5155179968 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:35:10.208053 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b334211c-1c1f-458f-b95a-8a52d4bae7b7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ead426a5-6e3c-4c72-9116-5b7ec9652c55', 'code': 200} Dec 09 22:35:10.308207 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61c5a6a1-df9d-4ea0-bba1-5bed2ec8ba04 req-6dd5c4e8-6c88-46e4-be1c-b7477eb84247 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:35:10.309639 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-61c5a6a1-df9d-4ea0-bba1-5bed2ec8ba04 req-6dd5c4e8-6c88-46e4-be1c-b7477eb84247 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 1098 time: 0.0420341 Dec 09 22:35:10.368171 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-61c5a6a1-df9d-4ea0-bba1-5bed2ec8ba04 req-983b0d84-0de0-42e7-96d9-3df963c880d9 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0509634 Dec 09 22:35:10.408028 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cd9f6cd-bb65-4167-9211-8c7116af4e94 req-b3b1e14d-5b0b-4821-9dd7-b4b2c26ebe03 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:35:10.409502 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4cd9f6cd-bb65-4167-9211-8c7116af4e94 req-b3b1e14d-5b0b-4821-9dd7-b4b2c26ebe03 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 946 time: 0.0486033 Dec 09 22:35:10.462642 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4cd9f6cd-bb65-4167-9211-8c7116af4e94 req-019f5801-5f63-4250-b2a8-5fe52d8ae98a tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0471344 Dec 09 22:35:11.592956 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87284b77-b2b8-41c3-8276-1f90bbaa394d req-7b5658aa-f489-4a2e-a05e-094f1ee2221a tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:35:11.594642 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-87284b77-b2b8-41c3-8276-1f90bbaa394d req-7b5658aa-f489-4a2e-a05e-094f1ee2221a tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 946 time: 0.0593536 Dec 09 22:35:11.648114 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-87284b77-b2b8-41c3-8276-1f90bbaa394d req-6e085696-33e1-4d1a-818d-ece3f08de258 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444252 Dec 09 22:35:11.792632 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-020621ad-358f-464e-bced-3754cbbb5fca req-d6e823eb-dc41-4ca2-942a-dfbe40797624 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:35:11.794154 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-020621ad-358f-464e-bced-3754cbbb5fca req-d6e823eb-dc41-4ca2-942a-dfbe40797624 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 946 time: 0.0637019 Dec 09 22:35:11.847117 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-020621ad-358f-464e-bced-3754cbbb5fca req-4f0e3ee6-3e19-458c-a8b7-2ae77011be9b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0464265 Dec 09 22:35:11.876043 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35572) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:35:11.919647 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1982dfca-1dbd-4c4e-acea-9fee004d4d0b tempest-TestShelveInstance-1473918196 tempest-TestShelveInstance-1473918196-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:35:11.921143 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-1982dfca-1dbd-4c4e-acea-9fee004d4d0b tempest-TestShelveInstance-1473918196 tempest-TestShelveInstance-1473918196-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 1093 time: 0.0438044 Dec 09 22:35:11.924026 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35574) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:35:11.928209 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-ed2edb6f-0482-42f0-ab53-0db8037d42dc tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': 'ead426a5-6e3c-4c72-9116-5b7ec9652c55', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'fixed_ip_address': '172.20.0.13'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:35:11.954146 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ed2edb6f-0482-42f0-ab53-0db8037d42dc tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:12.056703 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ed2edb6f-0482-42f0-ab53-0db8037d42dc tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:12.161632 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-ed2edb6f-0482-42f0-ab53-0db8037d42dc tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Allocated IP 172.25.3.96 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/fd10b28a-6c59-47cf-9ea9-0ff683c02290) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:35:12.267476 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ed2edb6f-0482-42f0-ab53-0db8037d42dc tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:12.302143 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ed2edb6f-0482-42f0-ab53-0db8037d42dc tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:12.337495 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed2edb6f-0482-42f0-ab53-0db8037d42dc tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:35:12.340249 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-ed2edb6f-0482-42f0-ab53-0db8037d42dc tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:35:12.343020 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed2edb6f-0482-42f0-ab53-0db8037d42dc tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:35:12.374339 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed2edb6f-0482-42f0-ab53-0db8037d42dc tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event updated for resources: {'Port': ['ID=fd10b28a-6c59-47cf-9ea9-0ff683c02290,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:35:12.714239 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ed2edb6f-0482-42f0-ab53-0db8037d42dc tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:12.791120 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ed2edb6f-0482-42f0-ab53-0db8037d42dc tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:12.952463 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ed2edb6f-0482-42f0-ab53-0db8037d42dc tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:12.967090 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ed2edb6f-0482-42f0-ab53-0db8037d42dc tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:13.037132 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed2edb6f-0482-42f0-ab53-0db8037d42dc tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event updated for resources: {'Port': ['ID=fd10b28a-6c59-47cf-9ea9-0ff683c02290,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:35:13.054731 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ed2edb6f-0482-42f0-ab53-0db8037d42dc tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:13.161058 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-ed2edb6f-0482-42f0-ab53-0db8037d42dc tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Floating IP 4b2992f6-418a-4e48-be1f-d164e8b3d52a associated. External IP: 172.25.3.96, port: ead426a5-6e3c-4c72-9116-5b7ec9652c55. Dec 09 22:35:13.702783 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ed2edb6f-0482-42f0-ab53-0db8037d42dc tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Router 4310b7c2-6f1e-4838-bdb6-245416900ec5 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:35:13.810480 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ed2edb6f-0482-42f0-ab53-0db8037d42dc tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:35:13.820918 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67109f7b-a6a1-4b62-9033-a445b1fd349e None None] Sync routers for ids ['4310b7c2-6f1e-4838-bdb6-245416900ec5'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:35:13.830684 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-ed2edb6f-0482-42f0-ab53-0db8037d42dc tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:13.832318 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67109f7b-a6a1-4b62-9033-a445b1fd349e None None] Routers {'4310b7c2-6f1e-4838-bdb6-245416900ec5'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:35:13.832940 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-67109f7b-a6a1-4b62-9033-a445b1fd349e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:35:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4310b7c2-6f1e-4838-bdb6-245416900ec5'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:35:13.861456 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-ed2edb6f-0482-42f0-ab53-0db8037d42dc tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.9364274 Dec 09 22:35:13.862290 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b334211c-1c1f-458f-b95a-8a52d4bae7b7', 'tag': 'ead426a5-6e3c-4c72-9116-5b7ec9652c55'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:35:13.864985 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a0845d5e-07f7-47c3-9800-67f3b1f06ab8" -d '{"events": [{"name": "network-changed", "server_uuid": "b334211c-1c1f-458f-b95a-8a52d4bae7b7", "tag": "ead426a5-6e3c-4c72-9116-5b7ec9652c55"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:35:13.938346 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-67109f7b-a6a1-4b62-9033-a445b1fd349e None None] Set router 4310b7c2-6f1e-4838-bdb6-245416900ec5 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:35:13.956840 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:35:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8ca945fe-d642-4a2c-9ba9-d08d82beea9b x-openstack-request-id: req-8ca945fe-d642-4a2c-9ba9-d08d82beea9b {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:35:13.957145 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b334211c-1c1f-458f-b95a-8a52d4bae7b7", "tag": "ead426a5-6e3c-4c72-9116-5b7ec9652c55", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:35:13.957467 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8ca945fe-d642-4a2c-9ba9-d08d82beea9b {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:35:13.957877 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b334211c-1c1f-458f-b95a-8a52d4bae7b7', 'tag': 'ead426a5-6e3c-4c72-9116-5b7ec9652c55', 'status': 'completed', 'code': 200} Dec 09 22:35:14.019765 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0845d5e-07f7-47c3-9800-67f3b1f06ab8 req-849f5906-2b3f-4614-8a34-ff9272aa354c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:35:14.021370 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a0845d5e-07f7-47c3-9800-67f3b1f06ab8 req-849f5906-2b3f-4614-8a34-ff9272aa354c service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2f75126e83f04a8eb56e531ea19960e3&device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 1098 time: 0.0406525 Dec 09 22:35:14.113812 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0845d5e-07f7-47c3-9800-67f3b1f06ab8 req-744a853d-c381-493f-8244-eb9e8cb523ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:35:14.115311 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a0845d5e-07f7-47c3-9800-67f3b1f06ab8 req-744a853d-c381-493f-8244-eb9e8cb523ee service neutron] 10.222.0.31 "GET /v2.0/networks?id=dddb6458-4699-45f3-afbf-66e168e093fa HTTP/1.1" status: 200 len: 910 time: 0.0863879 Dec 09 22:35:14.167860 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-67109f7b-a6a1-4b62-9033-a445b1fd349e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'name': 'tempest-TestShelveInstance-1687017519-router', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169'}], 'enable_snat': True}, 'gw_port_id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:16Z', 'revision_number': 4, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'gw_port': {'id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:7a:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4313, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '4b2992f6-418a-4e48-be1f-d164e8b3d52a', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'floating_ip_address': '172.25.3.96', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'port_id': 'ead426a5-6e3c-4c72-9116-5b7ec9652c55', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 4350, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'mac_address': 'fa:16:3e:87:03:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b334211c-1c1f-458f-b95a-8a52d4bae7b7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:35:12Z', 'updated_at': '2021-12-09T22:35:12Z', 'revision_number': 0, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd79bdb0d-daf1-4af3-967c-0210fc9a4e20', 'name': '', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'mac_address': 'fa:16:3e:cb:a6:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_interface', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:15Z', 'updated_at': '2021-12-09T22:30:19Z', 'revision_number': 5, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'subnets': [{'id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:35:14.186565 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a0845d5e-07f7-47c3-9800-67f3b1f06ab8 req-49eb23df-57ce-4252-ba73-e4c4088c2906 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ead426a5-6e3c-4c72-9116-5b7ec9652c55 HTTP/1.1" status: 200 len: 999 time: 0.0626023 Dec 09 22:35:14.198318 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67109f7b-a6a1-4b62-9033-a445b1fd349e None None] Checking router: 4310b7c2-6f1e-4838-bdb6-245416900ec5 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:35:14.207156 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67109f7b-a6a1-4b62-9033-a445b1fd349e None None] Routers {'4310b7c2-6f1e-4838-bdb6-245416900ec5'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:35:14.207714 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-67109f7b-a6a1-4b62-9033-a445b1fd349e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:35:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4310b7c2-6f1e-4838-bdb6-245416900ec5'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:35:14.234932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0845d5e-07f7-47c3-9800-67f3b1f06ab8 req-fb0f4cb6-425c-4d53-b411-d90531ffc244 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:35:14.236450 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a0845d5e-07f7-47c3-9800-67f3b1f06ab8 req-fb0f4cb6-425c-4d53-b411-d90531ffc244 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=34856fdf-2a32-48b3-9f67-7cd8c8d39875 HTTP/1.1" status: 200 len: 848 time: 0.0436323 Dec 09 22:35:14.281880 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0845d5e-07f7-47c3-9800-67f3b1f06ab8 req-860e7ec8-b796-41aa-b173-e1deaf5119ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:35:14.283377 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a0845d5e-07f7-47c3-9800-67f3b1f06ab8 req-860e7ec8-b796-41aa-b173-e1deaf5119ba service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=dddb6458-4699-45f3-afbf-66e168e093fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0397007 Dec 09 22:35:14.313648 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-67109f7b-a6a1-4b62-9033-a445b1fd349e None None] Set router 4310b7c2-6f1e-4838-bdb6-245416900ec5 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:35:14.376317 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a0845d5e-07f7-47c3-9800-67f3b1f06ab8 req-5cc170e6-42fe-447c-87dc-5bf98574edd7 service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0853860 Dec 09 22:35:14.469975 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a0845d5e-07f7-47c3-9800-67f3b1f06ab8 req-1c9abfbb-bcc5-42cf-a126-d38f77ff5e32 service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0865493 Dec 09 22:35:14.529561 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-67109f7b-a6a1-4b62-9033-a445b1fd349e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'name': 'tempest-TestShelveInstance-1687017519-router', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169'}], 'enable_snat': True}, 'gw_port_id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:16Z', 'revision_number': 4, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'gw_port': {'id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:7a:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4313, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '4b2992f6-418a-4e48-be1f-d164e8b3d52a', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'floating_ip_address': '172.25.3.96', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'port_id': 'ead426a5-6e3c-4c72-9116-5b7ec9652c55', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 4350, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'mac_address': 'fa:16:3e:87:03:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b334211c-1c1f-458f-b95a-8a52d4bae7b7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:35:12Z', 'updated_at': '2021-12-09T22:35:12Z', 'revision_number': 0, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd79bdb0d-daf1-4af3-967c-0210fc9a4e20', 'name': '', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'mac_address': 'fa:16:3e:cb:a6:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_interface', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:15Z', 'updated_at': '2021-12-09T22:30:19Z', 'revision_number': 5, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'subnets': [{'id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:35:14.558497 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67109f7b-a6a1-4b62-9033-a445b1fd349e None None] The sync data for ids ['4310b7c2-6f1e-4838-bdb6-245416900ec5'] in n-d-713301-27 is: [{'id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'name': 'tempest-TestShelveInstance-1687017519-router', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169'}], 'enable_snat': True}, 'gw_port_id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:16Z', 'revision_number': 4, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'gw_port': {'id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:7a:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4313, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '4b2992f6-418a-4e48-be1f-d164e8b3d52a', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'floating_ip_address': '172.25.3.96', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'port_id': 'ead426a5-6e3c-4c72-9116-5b7ec9652c55', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 4350, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'mac_address': 'fa:16:3e:87:03:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b334211c-1c1f-458f-b95a-8a52d4bae7b7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:35:12Z', 'updated_at': '2021-12-09T22:35:12Z', 'revision_number': 0, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd79bdb0d-daf1-4af3-967c-0210fc9a4e20', 'name': '', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'mac_address': 'fa:16:3e:cb:a6:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_interface', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:15Z', 'updated_at': '2021-12-09T22:30:19Z', 'revision_number': 5, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'subnets': [{'id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:35:14.763651 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-229432c2-2fcc-4ebe-92ca-53110a2aab72 None None] New status for floating IP 4b2992f6-418a-4e48-be1f-d164e8b3d52a: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:35:23.733460 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2b6909d4-b8e9-45a7-b3a0-e7b034860fad req-c7c5bdcb-98cc-4b96-b9ba-be239f8e380c service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0480597 Dec 09 22:35:23.818778 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b6909d4-b8e9-45a7-b3a0-e7b034860fad req-ff3b0f35-637b-4055-aee7-a82a98cc2200 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:35:23.820369 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2b6909d4-b8e9-45a7-b3a0-e7b034860fad req-ff3b0f35-637b-4055-aee7-a82a98cc2200 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2f75126e83f04a8eb56e531ea19960e3&device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 1098 time: 0.0431070 Dec 09 22:35:23.934400 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b6909d4-b8e9-45a7-b3a0-e7b034860fad req-02e5cdfe-ead6-4d3b-9deb-40d7e8b2f1d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:35:23.935937 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2b6909d4-b8e9-45a7-b3a0-e7b034860fad req-02e5cdfe-ead6-4d3b-9deb-40d7e8b2f1d1 service neutron] 10.222.0.31 "GET /v2.0/networks?id=dddb6458-4699-45f3-afbf-66e168e093fa HTTP/1.1" status: 200 len: 910 time: 0.0920019 Dec 09 22:35:24.005222 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2b6909d4-b8e9-45a7-b3a0-e7b034860fad req-94e88760-218f-4f09-9031-3caab0af5e80 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ead426a5-6e3c-4c72-9116-5b7ec9652c55 HTTP/1.1" status: 200 len: 1001 time: 0.0609684 Dec 09 22:35:24.056015 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b6909d4-b8e9-45a7-b3a0-e7b034860fad req-df9a6cbf-0fe4-4882-83b1-0b5ffc173932 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:35:24.057451 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2b6909d4-b8e9-45a7-b3a0-e7b034860fad req-df9a6cbf-0fe4-4882-83b1-0b5ffc173932 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=34856fdf-2a32-48b3-9f67-7cd8c8d39875 HTTP/1.1" status: 200 len: 848 time: 0.0453560 Dec 09 22:35:24.109180 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b6909d4-b8e9-45a7-b3a0-e7b034860fad req-69015fff-4c27-4982-aad0-61887b17dbc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:35:24.110657 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2b6909d4-b8e9-45a7-b3a0-e7b034860fad req-69015fff-4c27-4982-aad0-61887b17dbc5 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=dddb6458-4699-45f3-afbf-66e168e093fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0450685 Dec 09 22:35:24.201374 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2b6909d4-b8e9-45a7-b3a0-e7b034860fad req-56e3a95d-8921-41b6-9b40-e6343eebb0f1 service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0829928 Dec 09 22:35:24.306953 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2b6909d4-b8e9-45a7-b3a0-e7b034860fad req-af9c9d17-427e-42f3-b6c8-5c041f43007b service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0970199 Dec 09 22:35:27.873532 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:27.917976 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:33.098567 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6320e62a-c160-4a84-8fc5-b6c1f960532c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:33.360277 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:35:35.690994 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fe0f5c29-519f-45fa-83a5-8fef19312c3a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:36.965639 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:38.297646 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:39.715620 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:57.896768 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:35:57.930979 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:36:03.115205 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e9f61eba-733a-465c-92f9-2f871342c625 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:36:05.696133 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5f374268-d3be-48c9-ae6c-fcd61bc7fccc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:36:06.962202 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:36:08.308065 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:36:09.712832 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:36:10.365417 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:36:23.724805 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f05bf001-9e2d-40ec-ae5b-161e1fda8e37 req-330fc0db-9923-45c3-a9f8-3b69a44b4d5a service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0438380 Dec 09 22:36:23.810848 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f05bf001-9e2d-40ec-ae5b-161e1fda8e37 req-5c5aa651-083a-4e10-9ad8-f9c60dc6ea76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:36:23.812803 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f05bf001-9e2d-40ec-ae5b-161e1fda8e37 req-5c5aa651-083a-4e10-9ad8-f9c60dc6ea76 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2f75126e83f04a8eb56e531ea19960e3&device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 1098 time: 0.0418668 Dec 09 22:36:23.934520 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f05bf001-9e2d-40ec-ae5b-161e1fda8e37 req-06fa119c-74dd-49f0-bd28-35fbc9d3e46e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:36:23.936051 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f05bf001-9e2d-40ec-ae5b-161e1fda8e37 req-06fa119c-74dd-49f0-bd28-35fbc9d3e46e service neutron] 10.222.0.31 "GET /v2.0/networks?id=dddb6458-4699-45f3-afbf-66e168e093fa HTTP/1.1" status: 200 len: 910 time: 0.1029813 Dec 09 22:36:24.008374 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f05bf001-9e2d-40ec-ae5b-161e1fda8e37 req-90a73073-bb8b-4dc9-bfd2-fe4d6fd5c279 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ead426a5-6e3c-4c72-9116-5b7ec9652c55 HTTP/1.1" status: 200 len: 1001 time: 0.0644662 Dec 09 22:36:24.063936 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f05bf001-9e2d-40ec-ae5b-161e1fda8e37 req-b1c6c7e3-388b-4fa2-9de3-8cae59117757 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:36:24.065377 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f05bf001-9e2d-40ec-ae5b-161e1fda8e37 req-b1c6c7e3-388b-4fa2-9de3-8cae59117757 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=34856fdf-2a32-48b3-9f67-7cd8c8d39875 HTTP/1.1" status: 200 len: 848 time: 0.0500264 Dec 09 22:36:24.111857 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f05bf001-9e2d-40ec-ae5b-161e1fda8e37 req-b6ed384a-b165-43c3-9626-4170d45718c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:36:24.113328 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f05bf001-9e2d-40ec-ae5b-161e1fda8e37 req-b6ed384a-b165-43c3-9626-4170d45718c9 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=dddb6458-4699-45f3-afbf-66e168e093fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0410068 Dec 09 22:36:24.209622 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f05bf001-9e2d-40ec-ae5b-161e1fda8e37 req-1a4d545c-5ec1-4243-8d1d-93239067bc9f service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0888457 Dec 09 22:36:24.318712 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f05bf001-9e2d-40ec-ae5b-161e1fda8e37 req-cf2c8cdb-04fa-4d37-893f-074093424365 service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1012802 Dec 09 22:36:27.886096 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:36:27.930594 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:36:33.104184 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e6f92dea-7ca7-4809-82cd-a75aeb5534eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:36:35.702330 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-e215f96a-65f0-45c6-9b02-caf1b40d3db0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:36:36.965460 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:36:38.305168 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:36:39.719025 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:36:47.370282 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:36:57.895244 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:36:57.945835 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:37:03.098839 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6ab55f88-d9a8-4499-8f37-4660bfbeb7e9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:37:05.705689 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f3e23076-7ef5-4437-bc0c-1370149dbd79 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:37:06.974851 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:37:08.307495 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:37:09.714422 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:37:11.378411 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1ff03b7-f1d2-4572-905f-2b1d9c779c36 req-3dba37bc-232b-4395-8bc1-e455e4d3faf2 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:11.379991 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d1ff03b7-f1d2-4572-905f-2b1d9c779c36 req-3dba37bc-232b-4395-8bc1-e455e4d3faf2 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 946 time: 0.0555418 Dec 09 22:37:11.432556 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d1ff03b7-f1d2-4572-905f-2b1d9c779c36 req-2bf0d444-8a16-4be6-84d2-b2940211c26d tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458531 Dec 09 22:37:12.592921 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12e250ad-37fd-41f9-944c-13fa568ad56a req-ed063f71-7f3a-4724-a1ed-3c5439bb70f7 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:12.594407 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-12e250ad-37fd-41f9-944c-13fa568ad56a req-ed063f71-7f3a-4724-a1ed-3c5439bb70f7 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 946 time: 0.0533171 Dec 09 22:37:12.651887 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-12e250ad-37fd-41f9-944c-13fa568ad56a req-35169b91-d734-4923-b23b-19580dc25c67 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0496542 Dec 09 22:37:13.779764 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb81eb51-8792-46c3-bab0-0d5f296e4838 req-563fb2e8-a37e-4c18-a506-d40f2d424573 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:13.781274 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fb81eb51-8792-46c3-bab0-0d5f296e4838 req-563fb2e8-a37e-4c18-a506-d40f2d424573 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 946 time: 0.0496178 Dec 09 22:37:13.831140 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fb81eb51-8792-46c3-bab0-0d5f296e4838 req-9696c002-7362-40d4-8e4e-d7d51a92e62e tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436230 Dec 09 22:37:14.963869 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9708e783-60b3-4537-847c-e77d307850d8 req-0aaed1ac-61cf-4205-b9d7-22a5b6cf0a51 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:14.965339 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9708e783-60b3-4537-847c-e77d307850d8 req-0aaed1ac-61cf-4205-b9d7-22a5b6cf0a51 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 946 time: 0.0548515 Dec 09 22:37:15.020970 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9708e783-60b3-4537-847c-e77d307850d8 req-c97f7248-b8e2-45dc-a86d-4a1d7aa4e9c2 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0459671 Dec 09 22:37:16.172208 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71b9e506-cccc-4554-bc19-176d6f7b9957 req-a78560f1-1ab0-4cbe-8f6b-9b0f0781a15c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:16.173700 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71b9e506-cccc-4554-bc19-176d6f7b9957 req-a78560f1-1ab0-4cbe-8f6b-9b0f0781a15c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 946 time: 0.0669539 Dec 09 22:37:16.230725 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-71b9e506-cccc-4554-bc19-176d6f7b9957 req-b1ef1838-58be-4dac-b8cf-25780e38633b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0474737 Dec 09 22:37:17.348537 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d91e35c9-5cd4-4cbc-92dd-82b43fccfb4c req-b41f731c-017d-455c-aa13-37c4fca66272 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:17.349900 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d91e35c9-5cd4-4cbc-92dd-82b43fccfb4c req-b41f731c-017d-455c-aa13-37c4fca66272 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 946 time: 0.0509224 Dec 09 22:37:17.399455 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d91e35c9-5cd4-4cbc-92dd-82b43fccfb4c req-5e4dc7f2-bea7-44e8-9c99-14cbb3c01f71 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433283 Dec 09 22:37:18.526214 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6db373c-a42b-4a2b-972f-96e7a049aff5 req-79fccfbe-a186-4056-8e09-df6b4d546ea0 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:18.527851 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6db373c-a42b-4a2b-972f-96e7a049aff5 req-79fccfbe-a186-4056-8e09-df6b4d546ea0 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 946 time: 0.0513811 Dec 09 22:37:18.583145 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e6db373c-a42b-4a2b-972f-96e7a049aff5 req-aba6f20d-e641-4633-88f7-bae03f256bd2 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0490398 Dec 09 22:37:19.720643 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19147d6b-bdaa-4263-b46f-7fc51d7d999f req-c42e989b-8fbd-4f7a-9e04-6faf10597daf tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:19.722336 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19147d6b-bdaa-4263-b46f-7fc51d7d999f req-c42e989b-8fbd-4f7a-9e04-6faf10597daf tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 946 time: 0.0594954 Dec 09 22:37:19.771869 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-19147d6b-bdaa-4263-b46f-7fc51d7d999f req-6ddbcadb-1f92-45da-8813-921bb73eda34 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429544 Dec 09 22:37:20.897793 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-118a9d26-6625-449d-9cfc-578b68570708 req-a0af0dd1-f2d7-4b1e-96f3-743ec837758f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:20.899259 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-118a9d26-6625-449d-9cfc-578b68570708 req-a0af0dd1-f2d7-4b1e-96f3-743ec837758f tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 946 time: 0.0564160 Dec 09 22:37:20.952800 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-118a9d26-6625-449d-9cfc-578b68570708 req-0c878032-5584-4bc1-957a-015053c21692 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444467 Dec 09 22:37:21.513992 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12bb020a-03e7-47be-88f0-fc5a16ed3cfe req-ffd3581d-a6fa-436a-9ad5-0e3faae07ff6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:21.515604 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-12bb020a-03e7-47be-88f0-fc5a16ed3cfe req-ffd3581d-a6fa-436a-9ad5-0e3faae07ff6 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2f75126e83f04a8eb56e531ea19960e3&device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 1098 time: 0.0447838 Dec 09 22:37:21.619211 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12bb020a-03e7-47be-88f0-fc5a16ed3cfe req-b9f974ac-53e3-407b-baef-e1b0718e745a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:21.620776 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-12bb020a-03e7-47be-88f0-fc5a16ed3cfe req-b9f974ac-53e3-407b-baef-e1b0718e745a service neutron] 10.222.0.31 "GET /v2.0/networks?id=dddb6458-4699-45f3-afbf-66e168e093fa HTTP/1.1" status: 200 len: 910 time: 0.0975978 Dec 09 22:37:21.688186 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-12bb020a-03e7-47be-88f0-fc5a16ed3cfe req-80c3da58-6523-452b-a22e-f7e357c8bd08 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ead426a5-6e3c-4c72-9116-5b7ec9652c55 HTTP/1.1" status: 200 len: 1001 time: 0.0600023 Dec 09 22:37:21.738625 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12bb020a-03e7-47be-88f0-fc5a16ed3cfe req-d26d25cc-ef0f-4527-b65f-5fe5be834935 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:21.740166 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-12bb020a-03e7-47be-88f0-fc5a16ed3cfe req-d26d25cc-ef0f-4527-b65f-5fe5be834935 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=34856fdf-2a32-48b3-9f67-7cd8c8d39875 HTTP/1.1" status: 200 len: 848 time: 0.0446854 Dec 09 22:37:21.790840 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12bb020a-03e7-47be-88f0-fc5a16ed3cfe req-95a96947-9d51-4200-84f6-6bbcb218df8c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:21.792299 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-12bb020a-03e7-47be-88f0-fc5a16ed3cfe req-95a96947-9d51-4200-84f6-6bbcb218df8c service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=dddb6458-4699-45f3-afbf-66e168e093fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0454264 Dec 09 22:37:21.882801 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-12bb020a-03e7-47be-88f0-fc5a16ed3cfe req-11012346-1422-450a-9041-fbf6c9b360cc service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0829837 Dec 09 22:37:21.975482 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-12bb020a-03e7-47be-88f0-fc5a16ed3cfe req-295efe0b-1713-47ac-a00f-7057420c3f42 service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0854523 Dec 09 22:37:22.099205 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30f8a814-e195-4040-93d0-38170c13babd req-b3d04b25-fa2f-4c9f-8608-fb8195b692cf tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:22.100598 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-30f8a814-e195-4040-93d0-38170c13babd req-b3d04b25-fa2f-4c9f-8608-fb8195b692cf tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 946 time: 0.0640187 Dec 09 22:37:22.152145 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-30f8a814-e195-4040-93d0-38170c13babd req-d11592c9-b5ad-4504-bf88-46f292d3702d tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429323 Dec 09 22:37:23.287190 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cd01ef6-3a93-40bf-b7ca-42286420d97e req-dbd7ff6a-bef1-462d-b6e5-2d94a0f7f822 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:23.288818 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3cd01ef6-3a93-40bf-b7ca-42286420d97e req-dbd7ff6a-bef1-462d-b6e5-2d94a0f7f822 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 946 time: 0.0516915 Dec 09 22:37:23.354291 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3cd01ef6-3a93-40bf-b7ca-42286420d97e req-cf27b8d1-c5c0-425c-9535-6b54d18ffc8d tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0563343 Dec 09 22:37:24.371066 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:37:24.486548 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f181e66-351e-409f-a08c-345e231180a2 req-d37b7c67-fceb-40e7-95cd-d116040f5aae tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:24.488172 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f181e66-351e-409f-a08c-345e231180a2 req-d37b7c67-fceb-40e7-95cd-d116040f5aae tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 946 time: 0.0567527 Dec 09 22:37:24.539096 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4f181e66-351e-409f-a08c-345e231180a2 req-c09a1be7-9f16-4783-9738-a17b77d655b4 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446014 Dec 09 22:37:25.658864 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6df70da6-9162-4040-b014-508c2a0d7bc7 req-08584221-9be3-48c2-aad1-063ca57912bf tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:25.661678 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6df70da6-9162-4040-b014-508c2a0d7bc7 req-08584221-9be3-48c2-aad1-063ca57912bf tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 946 time: 0.0520585 Dec 09 22:37:25.713569 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6df70da6-9162-4040-b014-508c2a0d7bc7 req-83e690fa-c706-4acf-b4a6-68eda3e6c06b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452313 Dec 09 22:37:25.918930 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bff0693-dec6-4542-acac-4f24a69e8c36 req-a06f78f4-6d49-4389-bf6a-d9c8a3043769 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0434728 Dec 09 22:37:25.928995 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-7bff0693-dec6-4542-acac-4f24a69e8c36 req-12e17635-839b-4a12-93f6-57faf9e26fa1 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 22:37:25.930217 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bff0693-dec6-4542-acac-4f24a69e8c36 req-12e17635-839b-4a12-93f6-57faf9e26fa1 service neutron] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0056190 Dec 09 22:37:25.943940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6c33a7c-393b-40b4-901a-f0b92867b2af req-bfbee3e4-ad0c-44cb-978e-554a42958692 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:25.945500 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6c33a7c-393b-40b4-901a-f0b92867b2af req-bfbee3e4-ad0c-44cb-978e-554a42958692 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 946 time: 0.0497999 Dec 09 22:37:26.001008 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b6c33a7c-393b-40b4-901a-f0b92867b2af req-7cbc1738-305b-4a3f-82d9-b4ca88453599 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0487168 Dec 09 22:37:26.727586 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device ead426a5-6e3c-4c72-9116-5b7ec9652c55 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:37:26.806876 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:37:26.829954 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b334211c-1c1f-458f-b95a-8a52d4bae7b7', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'ead426a5-6e3c-4c72-9116-5b7ec9652c55'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:37:26.832370 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-453c34d1-fa67-49c6-81c6-e47bcf5770dd" -d '{"events": [{"server_uuid": "b334211c-1c1f-458f-b95a-8a52d4bae7b7", "name": "network-vif-unplugged", "status": "completed", "tag": "ead426a5-6e3c-4c72-9116-5b7ec9652c55"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:37:26.845292 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port ead426a5-6e3c-4c72-9116-5b7ec9652c55, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ead426a5-6e3c-4c72-9116-5b7ec9652c55,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:37:26.849633 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:37:26.875834 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Thu, 09 Dec 2021 22:37:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-acd6a29e-51fb-4880-aaf6-b67b6fdcd146 x-openstack-request-id: req-acd6a29e-51fb-4880-aaf6-b67b6fdcd146 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:37:26.876103 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b334211c-1c1f-458f-b95a-8a52d4bae7b7", "name": "network-vif-unplugged", "status": "failed", "tag": "ead426a5-6e3c-4c72-9116-5b7ec9652c55", "code": 422}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:37:26.876360 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-acd6a29e-51fb-4880-aaf6-b67b6fdcd146 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:37:26.876758 n-d-713301-27 neutron-server[103439]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'b334211c-1c1f-458f-b95a-8a52d4bae7b7', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'ead426a5-6e3c-4c72-9116-5b7ec9652c55', 'code': 422} returned with failed status Dec 09 22:37:26.902748 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=ead426a5-6e3c-4c72-9116-5b7ec9652c55,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:37:26.910616 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:37:26.910969 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:37:26.911315 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:37:26.911685 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:37:26.912021 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:37:26.912359 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:37:26.912691 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:37:26.913032 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:37:26.913342 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:37:26.913666 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:37:26.913997 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:37:26.914314 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:37:26.914635 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:37:27.130265 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb658f44-0143-4ce7-8200-9a0db02706ae req-18f252f8-4d99-49f0-aa35-b5188c43bcf9 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:27.131897 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb658f44-0143-4ce7-8200-9a0db02706ae req-18f252f8-4d99-49f0-aa35-b5188c43bcf9 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 944 time: 0.0541472 Dec 09 22:37:27.182969 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb658f44-0143-4ce7-8200-9a0db02706ae req-bb1fe3e1-0b14-45a3-9df7-3818a53f1230 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445979 Dec 09 22:37:27.903760 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:37:27.950038 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:37:28.354540 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77af0eeb-0fa4-4c57-98d4-212d5241d5e1 req-52007175-e7dc-46ce-b01b-346d4ff1e591 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:28.356144 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-77af0eeb-0fa4-4c57-98d4-212d5241d5e1 req-52007175-e7dc-46ce-b01b-346d4ff1e591 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 944 time: 0.0975196 Dec 09 22:37:28.406729 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-77af0eeb-0fa4-4c57-98d4-212d5241d5e1 req-3005a848-7248-401a-bda3-ff408c0fbb27 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444624 Dec 09 22:37:29.533350 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21e32522-63cf-4096-84ab-b78faaa827db req-3572531d-ca6c-49e8-8a0d-b91beee879a4 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:29.534955 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-21e32522-63cf-4096-84ab-b78faaa827db req-3572531d-ca6c-49e8-8a0d-b91beee879a4 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 944 time: 0.0574133 Dec 09 22:37:29.586489 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-21e32522-63cf-4096-84ab-b78faaa827db req-b8ee4e45-e703-4db4-8734-02fba0377dda tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450351 Dec 09 22:37:30.705863 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-029f8be3-33f2-41b0-b06f-56d4ee3b70b9 req-1a00d16d-c4c7-4173-98f1-ffdf2b1193e1 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:30.707466 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-029f8be3-33f2-41b0-b06f-56d4ee3b70b9 req-1a00d16d-c4c7-4173-98f1-ffdf2b1193e1 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 944 time: 0.0527287 Dec 09 22:37:30.758790 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-029f8be3-33f2-41b0-b06f-56d4ee3b70b9 req-b163a5a8-158a-482c-91f6-8d267fc48ceb tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449016 Dec 09 22:37:31.811866 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bff0693-dec6-4542-acac-4f24a69e8c36 req-477df6a8-7620-43f0-98e6-2147585e0d4a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:31.813398 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bff0693-dec6-4542-acac-4f24a69e8c36 req-477df6a8-7620-43f0-98e6-2147585e0d4a service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7&tenant_id=2f75126e83f04a8eb56e531ea19960e3 HTTP/1.1" status: 200 len: 1096 time: 0.0435169 Dec 09 22:37:31.881970 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bff0693-dec6-4542-acac-4f24a69e8c36 req-4fb9fa80-2d3b-49ad-9fed-56bdf218a75b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:31.883715 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb97e11d-5465-4333-b3fd-2edac18d0a35 req-d4901fad-d88f-4ee7-98ec-9178597073f9 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:31.884253 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bff0693-dec6-4542-acac-4f24a69e8c36 req-4fb9fa80-2d3b-49ad-9fed-56bdf218a75b service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2f75126e83f04a8eb56e531ea19960e3&device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 1096 time: 0.0454895 Dec 09 22:37:31.885256 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bb97e11d-5465-4333-b3fd-2edac18d0a35 req-d4901fad-d88f-4ee7-98ec-9178597073f9 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 944 time: 0.0504212 Dec 09 22:37:31.940334 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bb97e11d-5465-4333-b3fd-2edac18d0a35 req-a3acd39c-1932-412c-bac2-877a2880e749 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0488706 Dec 09 22:37:31.976218 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bff0693-dec6-4542-acac-4f24a69e8c36 req-017f6707-1e2b-4c4c-9917-7d7e1e33a9ae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:31.977709 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bff0693-dec6-4542-acac-4f24a69e8c36 req-017f6707-1e2b-4c4c-9917-7d7e1e33a9ae service neutron] 10.222.0.31 "GET /v2.0/networks?id=dddb6458-4699-45f3-afbf-66e168e093fa HTTP/1.1" status: 200 len: 910 time: 0.0874624 Dec 09 22:37:32.045619 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bff0693-dec6-4542-acac-4f24a69e8c36 req-20093acc-f430-4204-9c85-9cfa4a17e698 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ead426a5-6e3c-4c72-9116-5b7ec9652c55 HTTP/1.1" status: 200 len: 999 time: 0.0607357 Dec 09 22:37:32.094360 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bff0693-dec6-4542-acac-4f24a69e8c36 req-43b13d55-18ae-44ba-9229-6bced885b078 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:32.095798 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bff0693-dec6-4542-acac-4f24a69e8c36 req-43b13d55-18ae-44ba-9229-6bced885b078 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=34856fdf-2a32-48b3-9f67-7cd8c8d39875 HTTP/1.1" status: 200 len: 848 time: 0.0427706 Dec 09 22:37:32.141760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bff0693-dec6-4542-acac-4f24a69e8c36 req-60aa67da-7108-4b0e-a522-4fe8e9032ad0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:32.143218 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bff0693-dec6-4542-acac-4f24a69e8c36 req-60aa67da-7108-4b0e-a522-4fe8e9032ad0 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=dddb6458-4699-45f3-afbf-66e168e093fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0391448 Dec 09 22:37:32.238753 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bff0693-dec6-4542-acac-4f24a69e8c36 req-7540b54f-fd36-41cf-8071-2b8a7717d2e3 service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0878818 Dec 09 22:37:32.337925 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-7bff0693-dec6-4542-acac-4f24a69e8c36 req-954f2182-f09b-4d9c-a821-0b40158380bb service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0907218 Dec 09 22:37:33.065446 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb4e634d-d0f2-4507-a95f-0a28510e68c0 req-b9ac4e52-f44e-407f-8e70-2ff5744954fb tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:33.067185 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bb4e634d-d0f2-4507-a95f-0a28510e68c0 req-b9ac4e52-f44e-407f-8e70-2ff5744954fb tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 944 time: 0.0519149 Dec 09 22:37:33.102616 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3bc05126-04f8-4ab2-9a1e-73449c377e51 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:37:33.119830 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-bb4e634d-d0f2-4507-a95f-0a28510e68c0 req-d3fc448d-5749-4c0b-bacc-dd46dcb49a80 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463421 Dec 09 22:37:34.247116 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f26709f4-95d5-4228-8fd9-ac3eb2c24fc8 req-2411ffb8-28f0-4b11-92c7-e0c06b0a2348 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:34.248637 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f26709f4-95d5-4228-8fd9-ac3eb2c24fc8 req-2411ffb8-28f0-4b11-92c7-e0c06b0a2348 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 944 time: 0.0522387 Dec 09 22:37:34.300956 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f26709f4-95d5-4228-8fd9-ac3eb2c24fc8 req-b8d5fa72-b40f-4356-8125-e245b515e33a tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0461104 Dec 09 22:37:35.443808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86615c24-558a-4340-a236-a03dc86ac473 req-02c0b9ec-86c1-4466-bd77-802454dcdd11 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:35.445426 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86615c24-558a-4340-a236-a03dc86ac473 req-02c0b9ec-86c1-4466-bd77-802454dcdd11 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 944 time: 0.0632606 Dec 09 22:37:35.496802 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-86615c24-558a-4340-a236-a03dc86ac473 req-b6d94183-f6ac-4130-8124-ea449575b69b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451818 Dec 09 22:37:35.706807 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-95497a97-fcf7-47ec-9c42-a301a41b7c8c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:37:36.635187 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-343f636a-e46e-4856-967e-8dce3b6966b4 req-a5732f68-53b9-4971-9bbd-90fb1ffe5327 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:36.636721 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-343f636a-e46e-4856-967e-8dce3b6966b4 req-a5732f68-53b9-4971-9bbd-90fb1ffe5327 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 944 time: 0.0535395 Dec 09 22:37:36.691488 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-343f636a-e46e-4856-967e-8dce3b6966b4 req-537978fe-8bc9-4d09-99b0-306481d1ed94 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0473282 Dec 09 22:37:36.981293 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:37:37.824394 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba9dba7b-e5a7-414d-bb21-b3286b539a1a req-2020811a-0c92-42e9-b43b-57c4869ad1e2 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:37.825934 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba9dba7b-e5a7-414d-bb21-b3286b539a1a req-2020811a-0c92-42e9-b43b-57c4869ad1e2 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 944 time: 0.0566645 Dec 09 22:37:37.879178 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ba9dba7b-e5a7-414d-bb21-b3286b539a1a req-5fdfdac9-cf4a-4ffb-a00e-8f75ff62112c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0471215 Dec 09 22:37:38.309850 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:37:39.021986 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0f8e546-e353-4c66-9299-a544abeb1d95 req-23283414-8894-4b6b-9b1a-8cb13e4db6ed tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:39.023494 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d0f8e546-e353-4c66-9299-a544abeb1d95 req-23283414-8894-4b6b-9b1a-8cb13e4db6ed tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 944 time: 0.0540552 Dec 09 22:37:39.090364 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d0f8e546-e353-4c66-9299-a544abeb1d95 req-aecf7123-c45e-4465-8cb3-31b96c226010 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0568023 Dec 09 22:37:39.722845 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:37:40.225202 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a5bf5df-476a-4969-b5f3-51749c3c083a req-3d236b8a-2029-4459-957c-84fd91641962 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:40.226688 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a5bf5df-476a-4969-b5f3-51749c3c083a req-3d236b8a-2029-4459-957c-84fd91641962 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 944 time: 0.0516875 Dec 09 22:37:40.282517 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-1a5bf5df-476a-4969-b5f3-51749c3c083a req-dc4d02ec-6119-45a7-9f6e-365e70ac9d37 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0473709 Dec 09 22:37:40.774023 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device ead426a5-6e3c-4c72-9116-5b7ec9652c55 details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:37:40.875157 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port ead426a5-6e3c-4c72-9116-5b7ec9652c55, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ead426a5-6e3c-4c72-9116-5b7ec9652c55,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:37:40.887386 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': 'ead426a5-6e3c-4c72-9116-5b7ec9652c55', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'port_id': 'ead426a5-6e3c-4c72-9116-5b7ec9652c55', 'mac_address': 'fa:16:3e:87:03:71', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 106, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:37:40.929680 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:37:40.943031 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ead426a5-6e3c-4c72-9116-5b7ec9652c55 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:37:40.963180 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port ead426a5-6e3c-4c72-9116-5b7ec9652c55, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ead426a5-6e3c-4c72-9116-5b7ec9652c55,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:37:40.969553 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:37:41.019704 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=ead426a5-6e3c-4c72-9116-5b7ec9652c55,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:37:41.173825 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['ead426a5-6e3c-4c72-9116-5b7ec9652c55'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:37:41.418900 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff54133d-6246-445b-a807-c4bd1c5e5e16 req-7cfd69f1-d944-4275-8f54-d54dc9865a4d tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:41.420457 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ff54133d-6246-445b-a807-c4bd1c5e5e16 req-7cfd69f1-d944-4275-8f54-d54dc9865a4d tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 945 time: 0.0492420 Dec 09 22:37:41.470175 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ff54133d-6246-445b-a807-c4bd1c5e5e16 req-beda3ab0-5a0f-474e-bc90-5bdafa94c390 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436652 Dec 09 22:37:42.606389 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f14eeacd-9acf-4820-9163-98c3113d0eef req-85345764-3dbc-4aae-af69-7c39daed18df tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:42.607889 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f14eeacd-9acf-4820-9163-98c3113d0eef req-85345764-3dbc-4aae-af69-7c39daed18df tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 945 time: 0.0528812 Dec 09 22:37:42.660099 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f14eeacd-9acf-4820-9163-98c3113d0eef req-5bd68258-f927-4e11-8c9a-f57d05b78d18 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436542 Dec 09 22:37:42.774305 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device ead426a5-6e3c-4c72-9116-5b7ec9652c55 up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:37:42.826907 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port ead426a5-6e3c-4c72-9116-5b7ec9652c55 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:37:42.827263 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:37:42.908274 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:37:42.932131 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b334211c-1c1f-458f-b95a-8a52d4bae7b7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ead426a5-6e3c-4c72-9116-5b7ec9652c55'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:37:42.934498 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c870a03b-02ee-445a-8557-68d2059a580c" -d '{"events": [{"server_uuid": "b334211c-1c1f-458f-b95a-8a52d4bae7b7", "name": "network-vif-plugged", "status": "completed", "tag": "ead426a5-6e3c-4c72-9116-5b7ec9652c55"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:37:42.947344 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port ead426a5-6e3c-4c72-9116-5b7ec9652c55, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ead426a5-6e3c-4c72-9116-5b7ec9652c55,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:37:42.957094 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:37:42.984695 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:37:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e64aa34d-adf8-4bdc-bc9a-1e5857ea455c x-openstack-request-id: req-e64aa34d-adf8-4bdc-bc9a-1e5857ea455c {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:37:42.985360 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b334211c-1c1f-458f-b95a-8a52d4bae7b7", "name": "network-vif-plugged", "status": "completed", "tag": "ead426a5-6e3c-4c72-9116-5b7ec9652c55", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:37:42.985857 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-e64aa34d-adf8-4bdc-bc9a-1e5857ea455c {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:37:42.986256 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b334211c-1c1f-458f-b95a-8a52d4bae7b7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ead426a5-6e3c-4c72-9116-5b7ec9652c55', 'code': 200} Dec 09 22:37:43.019182 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=ead426a5-6e3c-4c72-9116-5b7ec9652c55,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:37:43.148483 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-607aeac4-69dc-40f2-aa8d-a44fe76e42cc req-cd7f59cb-c283-4a90-a4ed-bbea96aae2b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:43.150031 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-607aeac4-69dc-40f2-aa8d-a44fe76e42cc req-cd7f59cb-c283-4a90-a4ed-bbea96aae2b3 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 1098 time: 0.0439332 Dec 09 22:37:43.196045 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-607aeac4-69dc-40f2-aa8d-a44fe76e42cc req-a81b2331-c2c0-4ac5-9827-2d52307023f4 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0389059 Dec 09 22:37:43.798542 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb2075b9-4936-421f-a160-68e0b59c7833 req-dbbb9c40-a693-4108-bf5e-aa028771aa48 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:43.800091 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb2075b9-4936-421f-a160-68e0b59c7833 req-dbbb9c40-a693-4108-bf5e-aa028771aa48 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 946 time: 0.0560241 Dec 09 22:37:43.850976 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-cb2075b9-4936-421f-a160-68e0b59c7833 req-a16d3649-c93b-4726-9ee8-61feaf702a1e tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447736 Dec 09 22:37:44.986254 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6b11435-4301-4e42-94be-713b3a3780cf req-29deb13c-bccc-4f36-972b-13d42319e333 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:37:44.987751 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d6b11435-4301-4e42-94be-713b3a3780cf req-29deb13c-bccc-4f36-972b-13d42319e333 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 946 time: 0.0504384 Dec 09 22:37:45.038694 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d6b11435-4301-4e42-94be-713b3a3780cf req-a8626db0-9741-4400-835f-88971ec5ed14 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446734 Dec 09 22:37:57.910432 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:37:57.950073 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:38:01.372324 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:38:03.106953 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-70e355f7-bcfa-45bf-9a15-7db70ac4f635 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:38:05.701779 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ee3e4feb-a713-43d2-836c-02760b6dfcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:38:07.145186 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:38:08.312048 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:38:09.723716 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:38:27.916617 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:38:27.959295 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:38:28.318029 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ac04e04b-10d2-4f7b-9196-49bf53a96113 req-58eed529-f449-4792-9b1c-cd3361a42de6 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0401535 Dec 09 22:38:28.405196 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac04e04b-10d2-4f7b-9196-49bf53a96113 req-fdb202da-1c98-49b3-9006-df9ab9bfc96a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:38:28.406717 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ac04e04b-10d2-4f7b-9196-49bf53a96113 req-fdb202da-1c98-49b3-9006-df9ab9bfc96a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2f75126e83f04a8eb56e531ea19960e3&device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 1098 time: 0.0420029 Dec 09 22:38:28.521836 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac04e04b-10d2-4f7b-9196-49bf53a96113 req-6ae0451a-9672-4d03-8164-682fd83d3e19 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:38:28.523686 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ac04e04b-10d2-4f7b-9196-49bf53a96113 req-6ae0451a-9672-4d03-8164-682fd83d3e19 service neutron] 10.222.0.31 "GET /v2.0/networks?id=dddb6458-4699-45f3-afbf-66e168e093fa HTTP/1.1" status: 200 len: 910 time: 0.0971742 Dec 09 22:38:28.589818 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ac04e04b-10d2-4f7b-9196-49bf53a96113 req-f6e6bebe-acec-44b0-b30a-78ea9e89c710 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ead426a5-6e3c-4c72-9116-5b7ec9652c55 HTTP/1.1" status: 200 len: 1001 time: 0.0592146 Dec 09 22:38:28.643747 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac04e04b-10d2-4f7b-9196-49bf53a96113 req-99daf332-eee9-48b9-ac23-43ab0bb6041f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:38:28.645205 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ac04e04b-10d2-4f7b-9196-49bf53a96113 req-99daf332-eee9-48b9-ac23-43ab0bb6041f service neutron] 10.222.0.31 "GET /v2.0/subnets?id=34856fdf-2a32-48b3-9f67-7cd8c8d39875 HTTP/1.1" status: 200 len: 848 time: 0.0491090 Dec 09 22:38:28.692478 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac04e04b-10d2-4f7b-9196-49bf53a96113 req-b01ae1eb-195a-4846-8fae-60ac5f7b246f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:38:28.693984 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ac04e04b-10d2-4f7b-9196-49bf53a96113 req-b01ae1eb-195a-4846-8fae-60ac5f7b246f service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=dddb6458-4699-45f3-afbf-66e168e093fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0422065 Dec 09 22:38:28.788485 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ac04e04b-10d2-4f7b-9196-49bf53a96113 req-1533d971-45e8-42dd-8fa5-7c4013028453 service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0874476 Dec 09 22:38:28.882771 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ac04e04b-10d2-4f7b-9196-49bf53a96113 req-0f819ff3-470f-40df-b5c0-09f458cef581 service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0869312 Dec 09 22:38:33.111942 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d5da2562-d864-48f9-b254-c7bdc0154195 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:38:35.721129 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-09af8967-97cc-4b38-a31b-9f64d706008e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:38:36.980708 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:38:38.316949 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:38:38.372437 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:38:39.726538 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:38:57.938318 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:38:57.958199 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:38:58.056541 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35720) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:38:58.222838 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Deleting port fd10b28a-6c59-47cf-9ea9-0ff683c02290 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:38:58.223138 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:38:58.300891 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:38:58.301192 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:38:58.313313 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Calling delete_port for fd10b28a-6c59-47cf-9ea9-0ff683c02290 owned by network:floatingip {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:38:58.475286 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:38:58.499623 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event deleted for resources: {'Port': ['ID=fd10b28a-6c59-47cf-9ea9-0ff683c02290,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:38:58.511566 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:38:58.511911 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:38:58.512251 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:38:58.512582 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:38:58.512908 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:38:58.513191 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:38:58.513537 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:38:58.514048 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:38:58.514466 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:38:58.514794 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:38:58.515118 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:38:58.515502 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:38:58.515800 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:38:58.568229 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for floatingip, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:38:58.568524 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Floating IP 4b2992f6-418a-4e48-be1f-d164e8b3d52a disassociated (deleted). External IP: 172.25.3.96, port: ead426a5-6e3c-4c72-9116-5b7ec9652c55. Dec 09 22:38:58.784047 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Router 4310b7c2-6f1e-4838-bdb6-245416900ec5 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:38:58.894044 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:38:58.898738 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:38:58.904341 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8a26e73-577f-49e5-8d26-3f8d0034b9b5 None None] Sync routers for ids ['4310b7c2-6f1e-4838-bdb6-245416900ec5'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:38:58.915345 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8a26e73-577f-49e5-8d26-3f8d0034b9b5 None None] Routers {'4310b7c2-6f1e-4838-bdb6-245416900ec5'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:38:58.916112 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c8a26e73-577f-49e5-8d26-3f8d0034b9b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:38:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4310b7c2-6f1e-4838-bdb6-245416900ec5'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:38:58.927568 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d4c7068a-6096-4992-80a0-2537e4035b74 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "DELETE /v2.0/floatingips/4b2992f6-418a-4e48-be1f-d164e8b3d52a HTTP/1.1" status: 204 len: 168 time: 0.8698254 Dec 09 22:38:58.928145 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b334211c-1c1f-458f-b95a-8a52d4bae7b7', 'tag': 'ead426a5-6e3c-4c72-9116-5b7ec9652c55'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:38:58.930396 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-98cbbcba-9d8a-4082-922f-c80a17784288" -d '{"events": [{"name": "network-changed", "server_uuid": "b334211c-1c1f-458f-b95a-8a52d4bae7b7", "tag": "ead426a5-6e3c-4c72-9116-5b7ec9652c55"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:38:59.024534 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-c8a26e73-577f-49e5-8d26-3f8d0034b9b5 None None] Set router 4310b7c2-6f1e-4838-bdb6-245416900ec5 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:38:59.090249 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:38:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c9e9e131-ec8d-4de0-8d46-737f87bc038b x-openstack-request-id: req-c9e9e131-ec8d-4de0-8d46-737f87bc038b {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:38:59.090775 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b334211c-1c1f-458f-b95a-8a52d4bae7b7", "tag": "ead426a5-6e3c-4c72-9116-5b7ec9652c55", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:38:59.090775 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-c9e9e131-ec8d-4de0-8d46-737f87bc038b {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:38:59.091188 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b334211c-1c1f-458f-b95a-8a52d4bae7b7', 'tag': 'ead426a5-6e3c-4c72-9116-5b7ec9652c55', 'status': 'completed', 'code': 200} Dec 09 22:38:59.157220 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98cbbcba-9d8a-4082-922f-c80a17784288 req-0e1cf6e6-d795-4835-b540-9360913ca46f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:38:59.158855 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-98cbbcba-9d8a-4082-922f-c80a17784288 req-0e1cf6e6-d795-4835-b540-9360913ca46f service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2f75126e83f04a8eb56e531ea19960e3&device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 1098 time: 0.0445061 Dec 09 22:38:59.189238 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9985c3b-0e4f-449c-b7c6-a3c7f7059ad3 req-e5b955a9-4a44-451e-8afa-f38baf3957d7 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:38:59.191069 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9985c3b-0e4f-449c-b7c6-a3c7f7059ad3 req-e5b955a9-4a44-451e-8afa-f38baf3957d7 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 946 time: 0.0544994 Dec 09 22:38:59.237349 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c8a26e73-577f-49e5-8d26-3f8d0034b9b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'name': 'tempest-TestShelveInstance-1687017519-router', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169'}], 'enable_snat': True}, 'gw_port_id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:16Z', 'revision_number': 4, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'gw_port': {'id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:7a:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4313, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'd79bdb0d-daf1-4af3-967c-0210fc9a4e20', 'name': '', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'mac_address': 'fa:16:3e:cb:a6:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_interface', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:15Z', 'updated_at': '2021-12-09T22:30:19Z', 'revision_number': 5, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'subnets': [{'id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:38:59.243643 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c9985c3b-0e4f-449c-b7c6-a3c7f7059ad3 req-fe402a2b-28c0-4b7d-8ee2-6ecee1eb3d9b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462554 Dec 09 22:38:59.261296 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98cbbcba-9d8a-4082-922f-c80a17784288 req-029149d5-6997-4951-80e8-f9567c63fbe1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:38:59.263126 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-98cbbcba-9d8a-4082-922f-c80a17784288 req-029149d5-6997-4951-80e8-f9567c63fbe1 service neutron] 10.222.0.31 "GET /v2.0/networks?id=dddb6458-4699-45f3-afbf-66e168e093fa HTTP/1.1" status: 200 len: 910 time: 0.0956669 Dec 09 22:38:59.264641 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8a26e73-577f-49e5-8d26-3f8d0034b9b5 None None] Checking router: 4310b7c2-6f1e-4838-bdb6-245416900ec5 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:38:59.272972 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8a26e73-577f-49e5-8d26-3f8d0034b9b5 None None] Routers {'4310b7c2-6f1e-4838-bdb6-245416900ec5'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:38:59.273574 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c8a26e73-577f-49e5-8d26-3f8d0034b9b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:38:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4310b7c2-6f1e-4838-bdb6-245416900ec5'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:38:59.306885 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-98cbbcba-9d8a-4082-922f-c80a17784288 req-55c28db5-2544-4ddc-9eb4-2388fea2acda service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ead426a5-6e3c-4c72-9116-5b7ec9652c55 HTTP/1.1" status: 200 len: 217 time: 0.0342004 Dec 09 22:38:59.362994 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98cbbcba-9d8a-4082-922f-c80a17784288 req-6c83ff8f-e88c-4dae-927e-57bcb40a4acf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:38:59.364523 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-98cbbcba-9d8a-4082-922f-c80a17784288 req-6c83ff8f-e88c-4dae-927e-57bcb40a4acf service neutron] 10.222.0.31 "GET /v2.0/subnets?id=34856fdf-2a32-48b3-9f67-7cd8c8d39875 HTTP/1.1" status: 200 len: 848 time: 0.0506632 Dec 09 22:38:59.382066 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-c8a26e73-577f-49e5-8d26-3f8d0034b9b5 None None] Set router 4310b7c2-6f1e-4838-bdb6-245416900ec5 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:38:59.411006 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98cbbcba-9d8a-4082-922f-c80a17784288 req-3e45aafc-79b6-4ecb-89a1-cb6b3c6c51d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:38:59.412543 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-98cbbcba-9d8a-4082-922f-c80a17784288 req-3e45aafc-79b6-4ecb-89a1-cb6b3c6c51d3 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=dddb6458-4699-45f3-afbf-66e168e093fa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0403244 Dec 09 22:38:59.505927 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-98cbbcba-9d8a-4082-922f-c80a17784288 req-eeaa2b32-3137-4d29-963e-c211130be174 service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0846243 Dec 09 22:38:59.577955 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c8a26e73-577f-49e5-8d26-3f8d0034b9b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'name': 'tempest-TestShelveInstance-1687017519-router', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169'}], 'enable_snat': True}, 'gw_port_id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:16Z', 'revision_number': 4, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'gw_port': {'id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:7a:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4313, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'd79bdb0d-daf1-4af3-967c-0210fc9a4e20', 'name': '', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'mac_address': 'fa:16:3e:cb:a6:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_interface', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:15Z', 'updated_at': '2021-12-09T22:30:19Z', 'revision_number': 5, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'subnets': [{'id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:38:59.600221 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-98cbbcba-9d8a-4082-922f-c80a17784288 req-9be0f880-2103-4ce6-9ef6-e10ba609c78d service neutron] 10.222.0.31 "GET /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0859182 Dec 09 22:38:59.607305 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8a26e73-577f-49e5-8d26-3f8d0034b9b5 None None] The sync data for ids ['4310b7c2-6f1e-4838-bdb6-245416900ec5'] in n-d-713301-27 is: [{'id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'name': 'tempest-TestShelveInstance-1687017519-router', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169'}], 'enable_snat': True}, 'gw_port_id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:16Z', 'revision_number': 4, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'gw_port': {'id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:7a:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4313, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'd79bdb0d-daf1-4af3-967c-0210fc9a4e20', 'name': '', 'network_id': 'dddb6458-4699-45f3-afbf-66e168e093fa', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'mac_address': 'fa:16:3e:cb:a6:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_interface', 'standard_attr_id': 4314, 'fixed_ips': [{'subnet_id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:15Z', 'updated_at': '2021-12-09T22:30:19Z', 'revision_number': 5, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'subnets': [{'id': '34856fdf-2a32-48b3-9f67-7cd8c8d39875', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:38:59.851152 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-277f541f-1a44-4dc9-81e0-6166ada73265 None None] New status for floating IP 4b2992f6-418a-4e48-be1f-d164e8b3d52a: DOWN {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:39:00.384782 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ccef90d-bfc4-4cd0-a8f0-52f7533ff7c1 req-47a30aa3-1baf-48af-8dd3-2e1fd81cdc11 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:00.386317 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ccef90d-bfc4-4cd0-a8f0-52f7533ff7c1 req-47a30aa3-1baf-48af-8dd3-2e1fd81cdc11 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 946 time: 0.0597761 Dec 09 22:39:00.441965 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-4ccef90d-bfc4-4cd0-a8f0-52f7533ff7c1 req-c60f6a68-8475-4a2c-b42f-ae6491cab45d tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/security-groups?id=0481a8d1-09e1-4f35-a1cc-a21989877565&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0467484 Dec 09 22:39:00.595112 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b5994ad-4935-41a1-aa62-f4f8d08f1a0f req-a4420d9b-55ec-4053-a7e0-8042182bd54a tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:00.596492 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4b5994ad-4935-41a1-aa62-f4f8d08f1a0f req-a4420d9b-55ec-4053-a7e0-8042182bd54a tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.31 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 946 time: 0.0520895 Dec 09 22:39:00.711515 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-4b5994ad-4935-41a1-aa62-f4f8d08f1a0f req-89ed38e2-7f38-4757-b853-a538badcc355 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Deleting port ead426a5-6e3c-4c72-9116-5b7ec9652c55 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:39:00.712038 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4b5994ad-4935-41a1-aa62-f4f8d08f1a0f req-89ed38e2-7f38-4757-b853-a538badcc355 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:00.803886 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-4b5994ad-4935-41a1-aa62-f4f8d08f1a0f req-89ed38e2-7f38-4757-b853-a538badcc355 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] For port ead426a5-6e3c-4c72-9116-5b7ec9652c55, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=ead426a5-6e3c-4c72-9116-5b7ec9652c55,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:39:00.804255 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4b5994ad-4935-41a1-aa62-f4f8d08f1a0f req-89ed38e2-7f38-4757-b853-a538badcc355 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:00.817761 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-4b5994ad-4935-41a1-aa62-f4f8d08f1a0f req-89ed38e2-7f38-4757-b853-a538badcc355 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Calling delete_port for ead426a5-6e3c-4c72-9116-5b7ec9652c55 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:39:00.950169 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4b5994ad-4935-41a1-aa62-f4f8d08f1a0f req-89ed38e2-7f38-4757-b853-a538badcc355 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:00.980621 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89ed38e2-7f38-4757-b853-a538badcc355 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event deleted for resources: {'Port': ['ID=ead426a5-6e3c-4c72-9116-5b7ec9652c55,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:00.994855 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89ed38e2-7f38-4757-b853-a538badcc355 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:00.995213 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89ed38e2-7f38-4757-b853-a538badcc355 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:00.995587 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89ed38e2-7f38-4757-b853-a538badcc355 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:00.995929 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89ed38e2-7f38-4757-b853-a538badcc355 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:00.996265 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89ed38e2-7f38-4757-b853-a538badcc355 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:00.996598 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89ed38e2-7f38-4757-b853-a538badcc355 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:00.996926 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89ed38e2-7f38-4757-b853-a538badcc355 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:00.997258 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89ed38e2-7f38-4757-b853-a538badcc355 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:00.997584 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89ed38e2-7f38-4757-b853-a538badcc355 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:00.997906 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89ed38e2-7f38-4757-b853-a538badcc355 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:00.998230 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89ed38e2-7f38-4757-b853-a538badcc355 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:00.998585 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89ed38e2-7f38-4757-b853-a538badcc355 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:00.998905 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89ed38e2-7f38-4757-b853-a538badcc355 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:01.033462 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-4b5994ad-4935-41a1-aa62-f4f8d08f1a0f req-89ed38e2-7f38-4757-b853-a538badcc355 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] No DVR routers for this DVR port ead426a5-6e3c-4c72-9116-5b7ec9652c55 on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:39:01.036062 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-4b5994ad-4935-41a1-aa62-f4f8d08f1a0f req-89ed38e2-7f38-4757-b853-a538badcc355 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:01.039398 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-4b5994ad-4935-41a1-aa62-f4f8d08f1a0f req-89ed38e2-7f38-4757-b853-a538badcc355 tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.31 "DELETE /v2.0/ports/ead426a5-6e3c-4c72-9116-5b7ec9652c55 HTTP/1.1" status: 204 len: 173 time: 0.4366395 Dec 09 22:39:01.039878 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b334211c-1c1f-458f-b95a-8a52d4bae7b7', 'name': 'network-vif-deleted', 'tag': 'ead426a5-6e3c-4c72-9116-5b7ec9652c55'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:39:01.042139 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4ec56e34-7694-4ec9-9fa0-f09807e40870" -d '{"events": [{"server_uuid": "b334211c-1c1f-458f-b95a-8a52d4bae7b7", "name": "network-vif-deleted", "tag": "ead426a5-6e3c-4c72-9116-5b7ec9652c55"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:39:01.080091 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:39:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-33ccda6c-083f-4620-9d86-212ca629d4ba x-openstack-request-id: req-33ccda6c-083f-4620-9d86-212ca629d4ba {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:39:01.080392 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b334211c-1c1f-458f-b95a-8a52d4bae7b7", "name": "network-vif-deleted", "tag": "ead426a5-6e3c-4c72-9116-5b7ec9652c55", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:39:01.080648 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-33ccda6c-083f-4620-9d86-212ca629d4ba {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:39:01.081060 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b334211c-1c1f-458f-b95a-8a52d4bae7b7', 'name': 'network-vif-deleted', 'tag': 'ead426a5-6e3c-4c72-9116-5b7ec9652c55', 'status': 'completed', 'code': 200} Dec 09 22:39:01.543335 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-312411aa-7b87-4435-ab51-48611221062f req-56908dbf-9475-45fb-b31c-df345cc0702b tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 210 time: 0.0255423 Dec 09 22:39:02.649997 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d6f3540d-eb72-4357-b6b3-03951af9f0a9 req-43b876d2-d2b6-4ab9-8442-696d0648606c tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 210 time: 0.0309520 Dec 09 22:39:03.124755 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-804f8081-c7e2-4e3c-8105-06f021770fd8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:03.754895 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-9756c8c0-5076-4a71-b8fe-d4fe741d14f3 req-25c5c00b-06be-4b88-86dd-9a5903ae9dab tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 210 time: 0.0303335 Dec 09 22:39:04.855571 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2c376136-827c-4af8-8311-1af3a6a3eea8 req-972e3bfb-db3d-4004-bc33-a9d7cbead55d tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "GET /v2.0/ports?device_id=b334211c-1c1f-458f-b95a-8a52d4bae7b7 HTTP/1.1" status: 200 len: 210 time: 0.0286362 Dec 09 22:39:05.130865 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device ead426a5-6e3c-4c72-9116-5b7ec9652c55 no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:39:05.152179 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: ead426a5-6e3c-4c72-9116-5b7ec9652c55 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:39:05.152512 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device ead426a5-6e3c-4c72-9116-5b7ec9652c55 not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:39:05.705919 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5696d457-7fc8-4ccc-949f-69a848461d28 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:05.925484 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35750) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:05.984422 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-91230a97-5e67-4fb4-9708-f9b7f780d43a tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:06.010290 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-91230a97-5e67-4fb4-9708-f9b7f780d43a tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:06.075979 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-91230a97-5e67-4fb4-9708-f9b7f780d43a tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:06.079031 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-91230a97-5e67-4fb4-9708-f9b7f780d43a tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:06.080333 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-91230a97-5e67-4fb4-9708-f9b7f780d43a tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] 10.222.0.13 "DELETE /v2.0/security-groups/0481a8d1-09e1-4f35-a1cc-a21989877565 HTTP/1.1" status: 204 len: 168 time: 0.1538389 Dec 09 22:39:06.089556 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91230a97-5e67-4fb4-9708-f9b7f780d43a tempest-TestShelveInstance-1040842959 tempest-TestShelveInstance-1040842959-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0481a8d1-09e1-4f35-a1cc-a21989877565,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:06.138846 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35754) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:06.600007 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-541bc657-485c-4efb-ab5d-97fd0d3a5cfa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:06.849952 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-541bc657-485c-4efb-ab5d-97fd0d3a5cfa admin admin] Deleting port d79bdb0d-daf1-4af3-967c-0210fc9a4e20 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:39:06.850343 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-541bc657-485c-4efb-ab5d-97fd0d3a5cfa admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:06.935836 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-541bc657-485c-4efb-ab5d-97fd0d3a5cfa admin admin] For port d79bdb0d-daf1-4af3-967c-0210fc9a4e20, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=d79bdb0d-daf1-4af3-967c-0210fc9a4e20,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:39:06.936481 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-541bc657-485c-4efb-ab5d-97fd0d3a5cfa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:06.955268 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-541bc657-485c-4efb-ab5d-97fd0d3a5cfa admin admin] Calling delete_port for d79bdb0d-daf1-4af3-967c-0210fc9a4e20 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:39:06.983914 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:07.156153 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-541bc657-485c-4efb-ab5d-97fd0d3a5cfa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:07.185826 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-541bc657-485c-4efb-ab5d-97fd0d3a5cfa admin admin] Pushing event deleted for resources: {'Port': ['ID=d79bdb0d-daf1-4af3-967c-0210fc9a4e20,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:07.739346 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-541bc657-485c-4efb-ab5d-97fd0d3a5cfa admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:07.962109 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-541bc657-485c-4efb-ab5d-97fd0d3a5cfa admin admin] Router 4310b7c2-6f1e-4838-bdb6-245416900ec5 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:39:08.077627 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-541bc657-485c-4efb-ab5d-97fd0d3a5cfa admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:39:08.084044 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-541bc657-485c-4efb-ab5d-97fd0d3a5cfa admin admin] 10.222.0.13 "PUT /v2.0/routers/4310b7c2-6f1e-4838-bdb6-245416900ec5/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9430535 Dec 09 22:39:08.085409 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35758) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:08.088595 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-636a17cb-e09b-4076-a86d-b0d04b40d590 None None] Sync routers for ids ['4310b7c2-6f1e-4838-bdb6-245416900ec5'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:39:08.099664 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-636a17cb-e09b-4076-a86d-b0d04b40d590 None None] Routers {'4310b7c2-6f1e-4838-bdb6-245416900ec5'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:39:08.100271 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-636a17cb-e09b-4076-a86d-b0d04b40d590 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:39:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4310b7c2-6f1e-4838-bdb6-245416900ec5'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:08.198948 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ba99b21-2a48-493d-b34c-855ab9db43c0 admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:08.311752 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-636a17cb-e09b-4076-a86d-b0d04b40d590 None None] Set router 4310b7c2-6f1e-4838-bdb6-245416900ec5 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:39:08.314696 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ba99b21-2a48-493d-b34c-855ab9db43c0 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:08.319697 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:08.373380 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-8ba99b21-2a48-493d-b34c-855ab9db43c0 admin admin] Deleting port ab7589e3-3ac4-499f-a5a9-620c6efa7f0b {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:39:08.373722 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ba99b21-2a48-493d-b34c-855ab9db43c0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:08.461253 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-8ba99b21-2a48-493d-b34c-855ab9db43c0 admin admin] For port ab7589e3-3ac4-499f-a5a9-620c6efa7f0b, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=ab7589e3-3ac4-499f-a5a9-620c6efa7f0b,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:39:08.461700 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ba99b21-2a48-493d-b34c-855ab9db43c0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:08.473700 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-8ba99b21-2a48-493d-b34c-855ab9db43c0 admin admin] Calling delete_port for ab7589e3-3ac4-499f-a5a9-620c6efa7f0b owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:39:08.501781 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-636a17cb-e09b-4076-a86d-b0d04b40d590 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'name': 'tempest-TestShelveInstance-1687017519-router', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169'}], 'enable_snat': True}, 'gw_port_id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:39:07Z', 'revision_number': 5, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'gw_port': {'id': 'ab7589e3-3ac4-499f-a5a9-620c6efa7f0b', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:d1:7a:c9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4313, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:30:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:08.534356 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-636a17cb-e09b-4076-a86d-b0d04b40d590 None None] Checking router: 4310b7c2-6f1e-4838-bdb6-245416900ec5 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:39:08.546381 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-636a17cb-e09b-4076-a86d-b0d04b40d590 None None] Routers {'4310b7c2-6f1e-4838-bdb6-245416900ec5'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:39:08.547000 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-636a17cb-e09b-4076-a86d-b0d04b40d590 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:39:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['4310b7c2-6f1e-4838-bdb6-245416900ec5'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:08.636703 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-636a17cb-e09b-4076-a86d-b0d04b40d590 None None] Set router 4310b7c2-6f1e-4838-bdb6-245416900ec5 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:39:08.647180 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ba99b21-2a48-493d-b34c-855ab9db43c0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:08.676933 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ba99b21-2a48-493d-b34c-855ab9db43c0 admin admin] Pushing event deleted for resources: {'Port': ['ID=ab7589e3-3ac4-499f-a5a9-620c6efa7f0b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:08.695918 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-17f8758e-cbe0-4d27-aa7a-15d58f158b8b None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:39:08.698516 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-636a17cb-e09b-4076-a86d-b0d04b40d590 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'name': 'tempest-TestShelveInstance-1687017519-router', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:39:08Z', 'revision_number': 6, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:08.725510 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-636a17cb-e09b-4076-a86d-b0d04b40d590 None None] The sync data for ids ['4310b7c2-6f1e-4838-bdb6-245416900ec5'] in n-d-713301-27 is: [{'id': '4310b7c2-6f1e-4838-bdb6-245416900ec5', 'name': 'tempest-TestShelveInstance-1687017519-router', 'tenant_id': '2f75126e83f04a8eb56e531ea19960e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:13Z', 'updated_at': '2021-12-09T22:39:08Z', 'revision_number': 6, 'project_id': '2f75126e83f04a8eb56e531ea19960e3', 'gw_port_host': None}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:39:08.758591 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ba99b21-2a48-493d-b34c-855ab9db43c0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:08.856240 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ba99b21-2a48-493d-b34c-855ab9db43c0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:08.858395 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ba99b21-2a48-493d-b34c-855ab9db43c0 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:08.905294 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ba99b21-2a48-493d-b34c-855ab9db43c0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:08.905882 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8ba99b21-2a48-493d-b34c-855ab9db43c0 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4310b7c2-6f1e-4838-bdb6-245416900ec5 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 22:39:08.910759 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-8ba99b21-2a48-493d-b34c-855ab9db43c0 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:08.911984 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-8ba99b21-2a48-493d-b34c-855ab9db43c0 admin admin] 10.222.0.13 "DELETE /v2.0/routers/4310b7c2-6f1e-4838-bdb6-245416900ec5 HTTP/1.1" status: 204 len: 168 time: 0.8246813 Dec 09 22:39:08.914766 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35760) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:08.960605 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-7ba2e449-5154-4a14-8b79-c16cf2e20eff admin admin] Deleting subnet 34856fdf-2a32-48b3-9f67-7cd8c8d39875 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:39:08.963856 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ba2e449-5154-4a14-8b79-c16cf2e20eff admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:08.998617 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ba2e449-5154-4a14-8b79-c16cf2e20eff admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:09.093178 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ba2e449-5154-4a14-8b79-c16cf2e20eff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:09.164821 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ba2e449-5154-4a14-8b79-c16cf2e20eff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:09.193422 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ba2e449-5154-4a14-8b79-c16cf2e20eff admin admin] Pushing event deleted for resources: {'Subnet': ['ID=34856fdf-2a32-48b3-9f67-7cd8c8d39875,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:09.197188 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7ba2e449-5154-4a14-8b79-c16cf2e20eff admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:09.200410 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7ba2e449-5154-4a14-8b79-c16cf2e20eff admin admin] 10.222.0.13 "DELETE /v2.0/subnets/34856fdf-2a32-48b3-9f67-7cd8c8d39875 HTTP/1.1" status: 204 len: 168 time: 0.2845881 Dec 09 22:39:09.203157 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35762) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:09.204596 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb1587ee-8f47-4311-a724-1db37045bde8 None None] Network dddb6458-4699-45f3-afbf-66e168e093fa requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:39:09.240693 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d79bdb0d-daf1-4af3-967c-0210fc9a4e20 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:39:09.275178 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: d79bdb0d-daf1-4af3-967c-0210fc9a4e20 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:39:09.275526 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device d79bdb0d-daf1-4af3-967c-0210fc9a4e20 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:39:09.291232 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68480c7d-9ab9-4dcd-9305-36e75c38fde4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:09.347611 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-68480c7d-9ab9-4dcd-9305-36e75c38fde4 admin admin] Deleting port 22d2cda2-1aee-4741-aaa9-f376a689c587 {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:39:09.348021 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68480c7d-9ab9-4dcd-9305-36e75c38fde4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:09.415330 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-68480c7d-9ab9-4dcd-9305-36e75c38fde4 admin admin] For port 22d2cda2-1aee-4741-aaa9-f376a689c587, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=22d2cda2-1aee-4741-aaa9-f376a689c587,segment=NetworkSegment(4fd32693-bdb8-493a-a8d8-5bd83c6f9f80),segment_id=4fd32693-bdb8-493a-a8d8-5bd83c6f9f80)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:39:09.415618 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68480c7d-9ab9-4dcd-9305-36e75c38fde4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:09.433128 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-68480c7d-9ab9-4dcd-9305-36e75c38fde4 admin admin] Calling delete_port for 22d2cda2-1aee-4741-aaa9-f376a689c587 owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:39:09.515737 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68480c7d-9ab9-4dcd-9305-36e75c38fde4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:09.543641 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68480c7d-9ab9-4dcd-9305-36e75c38fde4 admin admin] Pushing event deleted for resources: {'Port': ['ID=22d2cda2-1aee-4741-aaa9-f376a689c587,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:09.545488 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68480c7d-9ab9-4dcd-9305-36e75c38fde4 admin admin] No DVR routers for this DVR port 22d2cda2-1aee-4741-aaa9-f376a689c587 on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:39:09.588640 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cc8930ad-8d28-4b22-9055-263c2dcebd65 None None] DHCP port deletion for dddb6458-4699-45f3-afbf-66e168e093fa request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:39:09.626686 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68480c7d-9ab9-4dcd-9305-36e75c38fde4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:09.647391 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-68480c7d-9ab9-4dcd-9305-36e75c38fde4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['dddb6458-4699-45f3-afbf-66e168e093fa']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:09.656406 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-68480c7d-9ab9-4dcd-9305-36e75c38fde4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4fd32693-bdb8-493a-a8d8-5bd83c6f9f80') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:09.656698 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-68480c7d-9ab9-4dcd-9305-36e75c38fde4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4fd32693-bdb8-493a-a8d8-5bd83c6f9f80') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:09.665971 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68480c7d-9ab9-4dcd-9305-36e75c38fde4 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:09.679048 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68480c7d-9ab9-4dcd-9305-36e75c38fde4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:09.685808 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-68480c7d-9ab9-4dcd-9305-36e75c38fde4 admin admin] Releasing vlan 106 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:39:09.686219 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68480c7d-9ab9-4dcd-9305-36e75c38fde4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: timer() Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:39:09.688318 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:39:09.735024 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:09.749109 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68480c7d-9ab9-4dcd-9305-36e75c38fde4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:09.754948 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-68480c7d-9ab9-4dcd-9305-36e75c38fde4 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:09.758369 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-68480c7d-9ab9-4dcd-9305-36e75c38fde4 admin admin] 10.222.0.13 "DELETE /v2.0/networks/dddb6458-4699-45f3-afbf-66e168e093fa HTTP/1.1" status: 204 len: 168 time: 0.5534296 Dec 09 22:39:09.761638 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35764) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:09.772039 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68480c7d-9ab9-4dcd-9305-36e75c38fde4 admin admin] Pushing event deleted for resources: {'Network': ['ID=dddb6458-4699-45f3-afbf-66e168e093fa,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:10.148754 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1f6a71ed-a05c-4a46-a9e9-bd477c7bcb45 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:10.401766 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1f6a71ed-a05c-4a46-a9e9-bd477c7bcb45 admin admin] Deleting port f3ac5e98-37d0-48ca-9851-ec4831fdf253 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:39:10.402440 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1f6a71ed-a05c-4a46-a9e9-bd477c7bcb45 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:10.481840 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-1f6a71ed-a05c-4a46-a9e9-bd477c7bcb45 admin admin] For port f3ac5e98-37d0-48ca-9851-ec4831fdf253, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=f3ac5e98-37d0-48ca-9851-ec4831fdf253,segment=NetworkSegment(05593618-d741-4754-9d4e-6f1c26ff7d96),segment_id=05593618-d741-4754-9d4e-6f1c26ff7d96)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:39:10.482177 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1f6a71ed-a05c-4a46-a9e9-bd477c7bcb45 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:10.495669 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1f6a71ed-a05c-4a46-a9e9-bd477c7bcb45 admin admin] Calling delete_port for f3ac5e98-37d0-48ca-9851-ec4831fdf253 owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:39:10.691820 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1f6a71ed-a05c-4a46-a9e9-bd477c7bcb45 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:10.718012 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f6a71ed-a05c-4a46-a9e9-bd477c7bcb45 admin admin] Pushing event deleted for resources: {'Port': ['ID=f3ac5e98-37d0-48ca-9851-ec4831fdf253,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:10.888239 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1f6a71ed-a05c-4a46-a9e9-bd477c7bcb45 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:10.954248 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 22d2cda2-1aee-4741-aaa9-f376a689c587 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:39:10.973443 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 22d2cda2-1aee-4741-aaa9-f376a689c587 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:39:10.973784 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 22d2cda2-1aee-4741-aaa9-f376a689c587 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:39:10.974191 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device ab7589e3-3ac4-499f-a5a9-620c6efa7f0b no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:39:10.992866 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: ab7589e3-3ac4-499f-a5a9-620c6efa7f0b {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:39:10.993069 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device ab7589e3-3ac4-499f-a5a9-620c6efa7f0b not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:39:11.110550 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1f6a71ed-a05c-4a46-a9e9-bd477c7bcb45 admin admin] Router 37786c5f-ddff-4682-92be-b41ee0fdaeb8 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:39:11.241637 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1f6a71ed-a05c-4a46-a9e9-bd477c7bcb45 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:39:11.250088 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1f6a71ed-a05c-4a46-a9e9-bd477c7bcb45 admin admin] 10.222.0.13 "PUT /v2.0/routers/37786c5f-ddff-4682-92be-b41ee0fdaeb8/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4872196 Dec 09 22:39:11.252967 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35766) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:11.253976 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-269e3126-2f30-4eac-b773-f1fcfa05ec43 None None] Sync routers for ids ['37786c5f-ddff-4682-92be-b41ee0fdaeb8'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:39:11.265605 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-269e3126-2f30-4eac-b773-f1fcfa05ec43 None None] Routers {'37786c5f-ddff-4682-92be-b41ee0fdaeb8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:39:11.266458 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-269e3126-2f30-4eac-b773-f1fcfa05ec43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:39:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['37786c5f-ddff-4682-92be-b41ee0fdaeb8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:11.357883 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a6820fa-9686-4704-b0cd-20c6e6c4f774 admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:11.372021 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-269e3126-2f30-4eac-b773-f1fcfa05ec43 None None] Set router 37786c5f-ddff-4682-92be-b41ee0fdaeb8 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:39:11.460567 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a6820fa-9686-4704-b0cd-20c6e6c4f774 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:11.514672 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-7a6820fa-9686-4704-b0cd-20c6e6c4f774 admin admin] Deleting port 79b66d9f-11c7-4910-9824-df5cfda46c13 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:39:11.514972 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a6820fa-9686-4704-b0cd-20c6e6c4f774 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:11.556961 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-269e3126-2f30-4eac-b773-f1fcfa05ec43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '37786c5f-ddff-4682-92be-b41ee0fdaeb8', 'name': 'tempest-TestShelveInstance-805458701-router', 'tenant_id': '80979eed9a074d9a890d6761b2538311', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.209'}], 'enable_snat': True}, 'gw_port_id': '79b66d9f-11c7-4910-9824-df5cfda46c13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:18Z', 'updated_at': '2021-12-09T22:39:10Z', 'revision_number': 5, 'project_id': '80979eed9a074d9a890d6761b2538311', 'gw_port': {'id': '79b66d9f-11c7-4910-9824-df5cfda46c13', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:cf:03', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '37786c5f-ddff-4682-92be-b41ee0fdaeb8', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4325, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:30:18Z', 'updated_at': '2021-12-09T22:30:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:11.584646 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-269e3126-2f30-4eac-b773-f1fcfa05ec43 None None] Checking router: 37786c5f-ddff-4682-92be-b41ee0fdaeb8 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:39:11.593498 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-269e3126-2f30-4eac-b773-f1fcfa05ec43 None None] Routers {'37786c5f-ddff-4682-92be-b41ee0fdaeb8'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:39:11.594167 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-269e3126-2f30-4eac-b773-f1fcfa05ec43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:39:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['37786c5f-ddff-4682-92be-b41ee0fdaeb8'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:11.597341 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-7a6820fa-9686-4704-b0cd-20c6e6c4f774 admin admin] For port 79b66d9f-11c7-4910-9824-df5cfda46c13, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=79b66d9f-11c7-4910-9824-df5cfda46c13,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:39:11.597709 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a6820fa-9686-4704-b0cd-20c6e6c4f774 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:11.609609 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-7a6820fa-9686-4704-b0cd-20c6e6c4f774 admin admin] Calling delete_port for 79b66d9f-11c7-4910-9824-df5cfda46c13 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:39:11.679559 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-269e3126-2f30-4eac-b773-f1fcfa05ec43 None None] Set router 37786c5f-ddff-4682-92be-b41ee0fdaeb8 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:39:11.732897 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-269e3126-2f30-4eac-b773-f1fcfa05ec43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '37786c5f-ddff-4682-92be-b41ee0fdaeb8', 'name': 'tempest-TestShelveInstance-805458701-router', 'tenant_id': '80979eed9a074d9a890d6761b2538311', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:18Z', 'updated_at': '2021-12-09T22:39:11Z', 'revision_number': 6, 'project_id': '80979eed9a074d9a890d6761b2538311', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:11.759388 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-269e3126-2f30-4eac-b773-f1fcfa05ec43 None None] The sync data for ids ['37786c5f-ddff-4682-92be-b41ee0fdaeb8'] in n-d-713301-27 is: [{'id': '37786c5f-ddff-4682-92be-b41ee0fdaeb8', 'name': 'tempest-TestShelveInstance-805458701-router', 'tenant_id': '80979eed9a074d9a890d6761b2538311', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:30:18Z', 'updated_at': '2021-12-09T22:39:11Z', 'revision_number': 6, 'project_id': '80979eed9a074d9a890d6761b2538311', 'gw_port_host': None}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:39:11.780785 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a6820fa-9686-4704-b0cd-20c6e6c4f774 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:11.808149 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a6820fa-9686-4704-b0cd-20c6e6c4f774 admin admin] Pushing event deleted for resources: {'Port': ['ID=79b66d9f-11c7-4910-9824-df5cfda46c13,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:11.821394 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1af1a44-c4f0-46c7-8721-8f4707d66122 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:39:11.865559 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a6820fa-9686-4704-b0cd-20c6e6c4f774 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:11.954674 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a6820fa-9686-4704-b0cd-20c6e6c4f774 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:11.957996 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a6820fa-9686-4704-b0cd-20c6e6c4f774 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:12.006269 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a6820fa-9686-4704-b0cd-20c6e6c4f774 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:12.007014 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7a6820fa-9686-4704-b0cd-20c6e6c4f774 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 37786c5f-ddff-4682-92be-b41ee0fdaeb8 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 22:39:12.011377 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a6820fa-9686-4704-b0cd-20c6e6c4f774 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:12.012555 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7a6820fa-9686-4704-b0cd-20c6e6c4f774 admin admin] 10.222.0.13 "DELETE /v2.0/routers/37786c5f-ddff-4682-92be-b41ee0fdaeb8 HTTP/1.1" status: 204 len: 168 time: 0.7586803 Dec 09 22:39:12.015737 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35768) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:12.061162 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-1e9a731e-bede-4bf7-9815-ab565ed751d0 admin admin] Deleting subnet 5d9f7177-37b6-464b-8d56-4689fcfa7eae {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:39:12.064520 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e9a731e-bede-4bf7-9815-ab565ed751d0 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:12.102459 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e9a731e-bede-4bf7-9815-ab565ed751d0 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:12.189256 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e9a731e-bede-4bf7-9815-ab565ed751d0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:12.242017 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e9a731e-bede-4bf7-9815-ab565ed751d0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:12.266387 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e9a731e-bede-4bf7-9815-ab565ed751d0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5d9f7177-37b6-464b-8d56-4689fcfa7eae,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:12.270208 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e9a731e-bede-4bf7-9815-ab565ed751d0 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:12.274077 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1e9a731e-bede-4bf7-9815-ab565ed751d0 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/5d9f7177-37b6-464b-8d56-4689fcfa7eae HTTP/1.1" status: 204 len: 168 time: 0.2574286 Dec 09 22:39:12.276988 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35770) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:12.280247 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a1b712c5-b523-49d3-8872-352cfa718978 None None] Network 49f82d18-7db3-40ef-89a6-99a393947ef5 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:39:12.349655 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-536e772c-7638-4ded-b33e-8eecb39b2af0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:12.403296 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-536e772c-7638-4ded-b33e-8eecb39b2af0 admin admin] Deleting port 3553343e-0d39-4956-98fd-56646fa7305d {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:39:12.403669 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-536e772c-7638-4ded-b33e-8eecb39b2af0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:12.465319 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-536e772c-7638-4ded-b33e-8eecb39b2af0 admin admin] For port 3553343e-0d39-4956-98fd-56646fa7305d, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=3553343e-0d39-4956-98fd-56646fa7305d,segment=NetworkSegment(05593618-d741-4754-9d4e-6f1c26ff7d96),segment_id=05593618-d741-4754-9d4e-6f1c26ff7d96)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:39:12.465990 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-536e772c-7638-4ded-b33e-8eecb39b2af0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:12.478087 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-536e772c-7638-4ded-b33e-8eecb39b2af0 admin admin] Calling delete_port for 3553343e-0d39-4956-98fd-56646fa7305d owned by network:dhcp {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:39:12.523751 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-412c5e95-3100-4454-8f71-2d6646fd30c4 None None] DHCP port deletion for 49f82d18-7db3-40ef-89a6-99a393947ef5 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:39:12.570763 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-536e772c-7638-4ded-b33e-8eecb39b2af0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:12.576022 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-412c5e95-3100-4454-8f71-2d6646fd30c4 None None] Deleting port 3553343e-0d39-4956-98fd-56646fa7305d {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:39:12.576416 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-412c5e95-3100-4454-8f71-2d6646fd30c4 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:12.598636 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-536e772c-7638-4ded-b33e-8eecb39b2af0 admin admin] No DVR routers for this DVR port 3553343e-0d39-4956-98fd-56646fa7305d on host n-d-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:39:12.603070 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536e772c-7638-4ded-b33e-8eecb39b2af0 admin admin] Pushing event deleted for resources: {'Port': ['ID=3553343e-0d39-4956-98fd-56646fa7305d,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:12.644963 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-412c5e95-3100-4454-8f71-2d6646fd30c4 None None] For port 3553343e-0d39-4956-98fd-56646fa7305d, host n-d-713301-27, got binding levels [] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:39:12.645367 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-412c5e95-3100-4454-8f71-2d6646fd30c4 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:12.665452 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-412c5e95-3100-4454-8f71-2d6646fd30c4 None None] Calling delete_port for 3553343e-0d39-4956-98fd-56646fa7305d owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:39:12.668182 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.ipam_backend_mixin [None req-412c5e95-3100-4454-8f71-2d6646fd30c4 None None] Port 3553343e-0d39-4956-98fd-56646fa7305d was not found and therefore no delete operation was performed {{(pid=103439) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 09 22:39:12.669435 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-412c5e95-3100-4454-8f71-2d6646fd30c4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:12.682988 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-536e772c-7638-4ded-b33e-8eecb39b2af0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:12.695290 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-412c5e95-3100-4454-8f71-2d6646fd30c4 None None] Pushing event deleted for resources: {'Port': ['ID=3553343e-0d39-4956-98fd-56646fa7305d,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:12.699906 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-412c5e95-3100-4454-8f71-2d6646fd30c4 None None] No DVR routers for this DVR port 3553343e-0d39-4956-98fd-56646fa7305d on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:39:12.704925 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-536e772c-7638-4ded-b33e-8eecb39b2af0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['49f82d18-7db3-40ef-89a6-99a393947ef5']}} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:12.709921 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-412c5e95-3100-4454-8f71-2d6646fd30c4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:12.710272 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-412c5e95-3100-4454-8f71-2d6646fd30c4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:12.710612 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-412c5e95-3100-4454-8f71-2d6646fd30c4 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:12.710946 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-412c5e95-3100-4454-8f71-2d6646fd30c4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:12.711279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-412c5e95-3100-4454-8f71-2d6646fd30c4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:12.711660 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-412c5e95-3100-4454-8f71-2d6646fd30c4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:12.711968 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-412c5e95-3100-4454-8f71-2d6646fd30c4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:12.712290 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-412c5e95-3100-4454-8f71-2d6646fd30c4 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:12.712616 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-412c5e95-3100-4454-8f71-2d6646fd30c4 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:12.712937 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-412c5e95-3100-4454-8f71-2d6646fd30c4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:12.713254 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-412c5e95-3100-4454-8f71-2d6646fd30c4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:12.713576 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-412c5e95-3100-4454-8f71-2d6646fd30c4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:12.713894 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-412c5e95-3100-4454-8f71-2d6646fd30c4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:12.723228 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-536e772c-7638-4ded-b33e-8eecb39b2af0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '05593618-d741-4754-9d4e-6f1c26ff7d96') {'for_net_delete': True} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:12.723563 n-d-713301-27 neutron-server[103437]: DEBUG neutron.services.segments.db [None req-536e772c-7638-4ded-b33e-8eecb39b2af0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '05593618-d741-4754-9d4e-6f1c26ff7d96') {} {{(pid=103437) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:12.733478 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-536e772c-7638-4ded-b33e-8eecb39b2af0 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8622022'] for segment, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:12.747540 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-536e772c-7638-4ded-b33e-8eecb39b2af0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:12.753569 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-536e772c-7638-4ded-b33e-8eecb39b2af0 admin admin] Releasing vlan 126 on physical network physnet1 to pool {{(pid=103437) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:39:12.753959 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-536e772c-7638-4ded-b33e-8eecb39b2af0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8621583'] for segment, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: Traceback (most recent call last): Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: timer() Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: cb(*args, **kw) Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: return func(*args, **kwargs) Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: self._notify() Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: self.callback(batched_events) Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: event.method(event) Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: return f(self, *a, **k) Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: return self._get(url).json() Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: return self.request(url, 'GET', **kwargs) Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:39:12.755635 n-d-713301-27 neutron-server[103437]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:39:12.813244 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-536e772c-7638-4ded-b33e-8eecb39b2af0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:12.819275 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-536e772c-7638-4ded-b33e-8eecb39b2af0 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:12.822713 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-536e772c-7638-4ded-b33e-8eecb39b2af0 admin admin] 10.222.0.13 "DELETE /v2.0/networks/49f82d18-7db3-40ef-89a6-99a393947ef5 HTTP/1.1" status: 204 len: 168 time: 0.5448813 Dec 09 22:39:12.849312 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536e772c-7638-4ded-b33e-8eecb39b2af0 admin admin] Pushing event deleted for resources: {'Network': ['ID=49f82d18-7db3-40ef-89a6-99a393947ef5,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:12.906710 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 3553343e-0d39-4956-98fd-56646fa7305d no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:39:12.928222 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 3553343e-0d39-4956-98fd-56646fa7305d {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:39:12.928659 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 3553343e-0d39-4956-98fd-56646fa7305d not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:39:12.929137 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f3ac5e98-37d0-48ca-9851-ec4831fdf253 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:39:12.944022 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35774) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:12.948500 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: f3ac5e98-37d0-48ca-9851-ec4831fdf253 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:39:12.948851 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device f3ac5e98-37d0-48ca-9851-ec4831fdf253 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:39:12.949263 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 79b66d9f-11c7-4910-9824-df5cfda46c13 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:39:12.969335 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 79b66d9f-11c7-4910-9824-df5cfda46c13 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:39:12.969335 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 79b66d9f-11c7-4910-9824-df5cfda46c13 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:39:12.986950 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2f340f5d-b48a-43f6-9a11-a92b194e8e5c admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=2f75126e83f04a8eb56e531ea19960e3&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0416663 Dec 09 22:39:12.989613 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35776) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:13.398090 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e1b8adc-0a24-4b1d-a57e-4bde7827e239 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:13.419430 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e1b8adc-0a24-4b1d-a57e-4bde7827e239 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:13.468652 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e1b8adc-0a24-4b1d-a57e-4bde7827e239 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:13.471252 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-3e1b8adc-0a24-4b1d-a57e-4bde7827e239 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:13.472457 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-3e1b8adc-0a24-4b1d-a57e-4bde7827e239 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/baa12905-212c-417c-8b26-c6e9b9349f43 HTTP/1.1" status: 204 len: 168 time: 0.4819000 Dec 09 22:39:13.480365 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e1b8adc-0a24-4b1d-a57e-4bde7827e239 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=baa12905-212c-417c-8b26-c6e9b9349f43,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:13.813726 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35782) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:13.856992 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-520c2d37-83e9-4e09-b7b2-220bf06a483d admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=80979eed9a074d9a890d6761b2538311&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0420380 Dec 09 22:39:13.861019 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35784) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:13.911638 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-df51363a-c6fb-48f0-a42d-d5bb8ebb8963 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:13.938969 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-df51363a-c6fb-48f0-a42d-d5bb8ebb8963 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:13.991774 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-df51363a-c6fb-48f0-a42d-d5bb8ebb8963 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:13.994427 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-df51363a-c6fb-48f0-a42d-d5bb8ebb8963 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:13.995743 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-df51363a-c6fb-48f0-a42d-d5bb8ebb8963 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/bb679aef-43f2-4619-92fd-3e97b78cffdd HTTP/1.1" status: 204 len: 168 time: 0.1336994 Dec 09 22:39:14.003826 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df51363a-c6fb-48f0-a42d-d5bb8ebb8963 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bb679aef-43f2-4619-92fd-3e97b78cffdd,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:14.707467 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35806) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:14.807857 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-15073ba3-7fc8-43ec-9e9f-bc5f8e5e5d41 admin admin] Request body: {'network': {'name': 'tempest-TestSnapshotPattern-2034929229-network', 'tenant_id': '2373ef24126c44b492884e181943f78a'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:39:14.832155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-15073ba3-7fc8-43ec-9e9f-bc5f8e5e5d41 admin admin] Made reservation on behalf of 2373ef24126c44b492884e181943f78a for: {'network': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:39:14.835524 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15073ba3-7fc8-43ec-9e9f-bc5f8e5e5d41 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:14.846752 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15073ba3-7fc8-43ec-9e9f-bc5f8e5e5d41 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:14.931360 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15073ba3-7fc8-43ec-9e9f-bc5f8e5e5d41 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:14.937203 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15073ba3-7fc8-43ec-9e9f-bc5f8e5e5d41 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:14.961192 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-15073ba3-7fc8-43ec-9e9f-bc5f8e5e5d41 admin admin] vlan segment allocate from pool success with {'vlan_id': 148, 'physical_network': 'physnet1'} {{(pid=103437) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 22:39:14.971263 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15073ba3-7fc8-43ec-9e9f-bc5f8e5e5d41 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=efcb0038-4ed7-41a8-b86e-006ba600c1fc,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:14.976073 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15073ba3-7fc8-43ec-9e9f-bc5f8e5e5d41 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:14.976414 n-d-713301-27 neutron-server[103437]: INFO neutron.db.segments_db [None req-15073ba3-7fc8-43ec-9e9f-bc5f8e5e5d41 admin admin] Added segment 2eba823c-93ea-484b-ab73-5af9237c7643 of type vlan for network 838c65be-046c-4ff2-bdb7-ede24f82dbda Dec 09 22:39:15.016165 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15073ba3-7fc8-43ec-9e9f-bc5f8e5e5d41 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:15.048814 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15073ba3-7fc8-43ec-9e9f-bc5f8e5e5d41 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:15.050470 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-15073ba3-7fc8-43ec-9e9f-bc5f8e5e5d41 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:15.051412 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-15073ba3-7fc8-43ec-9e9f-bc5f8e5e5d41 admin admin] Publish callbacks [] for network, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:15.088661 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-15073ba3-7fc8-43ec-9e9f-bc5f8e5e5d41 admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.3799660 Dec 09 22:39:15.091906 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35810) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:15.097185 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-f669954c-b3b4-4bd4-a844-d086aeae663c admin admin] Request body: {'subnet': {'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestSnapshotPattern-2034929229-subnet', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'ip_version': 4}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:39:15.120473 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f669954c-b3b4-4bd4-a844-d086aeae663c admin admin] Made reservation on behalf of 2373ef24126c44b492884e181943f78a for: {'subnet': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:39:15.120706 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15073ba3-7fc8-43ec-9e9f-bc5f8e5e5d41 admin admin] Pushing event updated for resources: {'Network': ['ID=838c65be-046c-4ff2-bdb7-ede24f82dbda,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:15.122798 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f669954c-b3b4-4bd4-a844-d086aeae663c admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8592462'] for subnet, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:15.131144 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 838c65be-046c-4ff2-bdb7-ede24f82dbda details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 22:39:15.300723 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f669954c-b3b4-4bd4-a844-d086aeae663c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8811952', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9191588'] for subnet, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:15.354865 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f669954c-b3b4-4bd4-a844-d086aeae663c admin admin] Pushing event updated for resources: {'Subnet': ['ID=9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:15.371464 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f669954c-b3b4-4bd4-a844-d086aeae663c admin admin] Checking segment: {'id': '2eba823c-93ea-484b-ab73-5af9237c7643', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103438) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:39:15.372020 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f669954c-b3b4-4bd4-a844-d086aeae663c admin admin] Network hostable DHCP agents. Network: 838c65be-046c-4ff2-bdb7-ede24f82dbda, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103438) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 22:39:15.372411 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:39:15.394689 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f669954c-b3b4-4bd4-a844-d086aeae663c admin admin] Network 838c65be-046c-4ff2-bdb7-ede24f82dbda is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103438) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 22:39:15.404809 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-f669954c-b3b4-4bd4-a844-d086aeae663c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 838c65be-046c-4ff2-bdb7-ede24f82dbda) {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:39:15.408962 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f669954c-b3b4-4bd4-a844-d086aeae663c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:15.409588 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-f669954c-b3b4-4bd4-a844-d086aeae663c admin admin] Publish callbacks [] for subnet, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:15.414590 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ae1ca43-e5c7-44ef-9a16-8b8a708c8344 None None] Network 838c65be-046c-4ff2-bdb7-ede24f82dbda requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:39:15.429079 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-f669954c-b3b4-4bd4-a844-d086aeae663c admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.3332295 Dec 09 22:39:15.429300 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35812) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:15.433677 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-496661ce-10f2-4ba3-8d26-967b4b63cee4 admin admin] Request body: {'router': {'name': 'tempest-TestSnapshotPattern-2034929229-router', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:39:15.456278 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-496661ce-10f2-4ba3-8d26-967b4b63cee4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:15.457289 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-496661ce-10f2-4ba3-8d26-967b4b63cee4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:15.512366 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-496661ce-10f2-4ba3-8d26-967b4b63cee4 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:15.519739 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2bf6d893-6b16-42c3-88d8-2880e65bf9e4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-838c65be-046c-4ff2-bdb7-ede24f82dbda', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'project_id': '2373ef24126c44b492884e181943f78a', 'fixed_ips': [{'subnet_id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 22:39:15.520703 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2bf6d893-6b16-42c3-88d8-2880e65bf9e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:15.653816 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-496661ce-10f2-4ba3-8d26-967b4b63cee4 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:15.659143 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-2bf6d893-6b16-42c3-88d8-2880e65bf9e4 None None] Allocated IP 172.20.0.2 (838c65be-046c-4ff2-bdb7-ede24f82dbda/9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1/591164fc-106b-426b-86ac-26781269c30e) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:39:15.795958 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2bf6d893-6b16-42c3-88d8-2880e65bf9e4 None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:15.801592 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2bf6d893-6b16-42c3-88d8-2880e65bf9e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:15.845668 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2bf6d893-6b16-42c3-88d8-2880e65bf9e4 None None] Network 838c65be-046c-4ff2-bdb7-ede24f82dbda is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:39:15.850899 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-2bf6d893-6b16-42c3-88d8-2880e65bf9e4 None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:39:15.852135 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-496661ce-10f2-4ba3-8d26-967b4b63cee4 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:15.855330 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2bf6d893-6b16-42c3-88d8-2880e65bf9e4 None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:39:15.858440 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bf6d893-6b16-42c3-88d8-2880e65bf9e4 None None] Pushing event updated for resources: {'Port': ['ID=591164fc-106b-426b-86ac-26781269c30e,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:15.871374 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-496661ce-10f2-4ba3-8d26-967b4b63cee4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:15.911455 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2bf6d893-6b16-42c3-88d8-2880e65bf9e4 None None] Attempting to bind port 591164fc-106b-426b-86ac-26781269c30e on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:39:15.911879 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2bf6d893-6b16-42c3-88d8-2880e65bf9e4 None None] Attempting to bind port 591164fc-106b-426b-86ac-26781269c30e by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '2eba823c-93ea-484b-ab73-5af9237c7643', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:39:15.912236 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bf6d893-6b16-42c3-88d8-2880e65bf9e4 None None] Attempting to bind port 591164fc-106b-426b-86ac-26781269c30e on network 838c65be-046c-4ff2-bdb7-ede24f82dbda {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:39:15.917595 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bf6d893-6b16-42c3-88d8-2880e65bf9e4 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 39, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:39:15.917927 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bf6d893-6b16-42c3-88d8-2880e65bf9e4 None None] Checking segment: {'id': '2eba823c-93ea-484b-ab73-5af9237c7643', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:39:15.918362 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2bf6d893-6b16-42c3-88d8-2880e65bf9e4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:15.918747 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bf6d893-6b16-42c3-88d8-2880e65bf9e4 None None] Bound using segment: {'id': '2eba823c-93ea-484b-ab73-5af9237c7643', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:39:15.919229 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-2bf6d893-6b16-42c3-88d8-2880e65bf9e4 None None] Bound port: 591164fc-106b-426b-86ac-26781269c30e, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2eba823c-93ea-484b-ab73-5af9237c7643', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:39:15.919875 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2bf6d893-6b16-42c3-88d8-2880e65bf9e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:15.979771 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-496661ce-10f2-4ba3-8d26-967b4b63cee4 admin admin] Allocated IP 172.25.3.141 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/e89a3aa7-436f-4a4a-b261-ace3f89966be) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:39:15.982604 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2bf6d893-6b16-42c3-88d8-2880e65bf9e4 None None] For port 591164fc-106b-426b-86ac-26781269c30e, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:39:15.986220 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-2bf6d893-6b16-42c3-88d8-2880e65bf9e4 None None] For port 591164fc-106b-426b-86ac-26781269c30e, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=591164fc-106b-426b-86ac-26781269c30e,segment=NetworkSegment(2eba823c-93ea-484b-ab73-5af9237c7643),segment_id=2eba823c-93ea-484b-ab73-5af9237c7643)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:39:15.990413 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2bf6d893-6b16-42c3-88d8-2880e65bf9e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:16.054841 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bf6d893-6b16-42c3-88d8-2880e65bf9e4 None None] Pushing event updated for resources: {'Port': ['ID=591164fc-106b-426b-86ac-26781269c30e,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:16.088868 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-496661ce-10f2-4ba3-8d26-967b4b63cee4 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:16.123169 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-496661ce-10f2-4ba3-8d26-967b4b63cee4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:16.490849 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-496661ce-10f2-4ba3-8d26-967b4b63cee4 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:39:16.495221 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-496661ce-10f2-4ba3-8d26-967b4b63cee4 admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:39:16.501302 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-496661ce-10f2-4ba3-8d26-967b4b63cee4 admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:39:16.506739 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-496661ce-10f2-4ba3-8d26-967b4b63cee4 admin admin] Pushing event updated for resources: {'Port': ['ID=e89a3aa7-436f-4a4a-b261-ace3f89966be,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:16.508007 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-baf00445-e081-48ec-8640-4349c85cf586 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:39:16.633427 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7e32e74-3837-4063-a332-a64a7ae65f0a None None] Provisioning complete for port e89a3aa7-436f-4a4a-b261-ace3f89966be triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:16.633803 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7e32e74-3837-4063-a332-a64a7ae65f0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:16.673465 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7e32e74-3837-4063-a332-a64a7ae65f0a None None] Port e89a3aa7-436f-4a4a-b261-ace3f89966be cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:39:16.760197 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-496661ce-10f2-4ba3-8d26-967b4b63cee4 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:16.928144 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 591164fc-106b-426b-86ac-26781269c30e up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:39:16.980058 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-496661ce-10f2-4ba3-8d26-967b4b63cee4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:16.983884 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 591164fc-106b-426b-86ac-26781269c30e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:16.984532 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:16.989035 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8685a97a-077f-4d05-a7e1-254e13d85aad None None] Network 838c65be-046c-4ff2-bdb7-ede24f82dbda requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:39:17.085867 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-a3bfacf0-dbaf-4720-b9cb-2f224a71a9c3 None None] Provisioning complete for port 591164fc-106b-426b-86ac-26781269c30e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:17.086241 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a3bfacf0-dbaf-4720-b9cb-2f224a71a9c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:17.111247 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-496661ce-10f2-4ba3-8d26-967b4b63cee4 admin admin] Router a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103438) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 22:39:17.231375 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-496661ce-10f2-4ba3-8d26-967b4b63cee4 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:39:17.245670 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27de3524-4329-46da-9964-587c2494ae45 None None] Sync routers for ids ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:39:17.253598 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-496661ce-10f2-4ba3-8d26-967b4b63cee4 admin admin] Publish callbacks [] for router, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:17.258787 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35814) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:17.259547 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-496661ce-10f2-4ba3-8d26-967b4b63cee4 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 1.8288038 Dec 09 22:39:17.260772 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27de3524-4329-46da-9964-587c2494ae45 None None] Routers {'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:39:17.261303 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-27de3524-4329-46da-9964-587c2494ae45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:39:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:17.369560 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:17.401695 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-27de3524-4329-46da-9964-587c2494ae45 None None] Set router a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:39:17.441888 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] For port 591164fc-106b-426b-86ac-26781269c30e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=591164fc-106b-426b-86ac-26781269c30e,segment=NetworkSegment(2eba823c-93ea-484b-ab73-5af9237c7643),segment_id=2eba823c-93ea-484b-ab73-5af9237c7643)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:39:17.442993 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a3bfacf0-dbaf-4720-b9cb-2f224a71a9c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:17.452811 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:17.547332 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Pushing event updated for resources: {'Port': ['ID=591164fc-106b-426b-86ac-26781269c30e,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:17.554514 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.db.api [None req-a3bfacf0-dbaf-4720-b9cb-2f224a71a9c3 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103439) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 22:39:17.554870 n-d-713301-27 neutron-server[103439]: DEBUG oslo_db.api [None req-a3bfacf0-dbaf-4720-b9cb-2f224a71a9c3 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 22:39:17.615078 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-27de3524-4329-46da-9964-587c2494ae45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'name': 'tempest-TestSnapshotPattern-2034929229-router', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141'}], 'enable_snat': True}, 'gw_port_id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:16Z', 'revision_number': 3, 'project_id': '2373ef24126c44b492884e181943f78a', 'gw_port': {'id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:7a:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4361, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:15Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:17.643588 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27de3524-4329-46da-9964-587c2494ae45 None None] Checking router: a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:39:17.643964 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27de3524-4329-46da-9964-587c2494ae45 None None] Updating router a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 port e89a3aa7-436f-4a4a-b261-ace3f89966be binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:39:17.668778 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-27de3524-4329-46da-9964-587c2494ae45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:17.754147 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-631db918-7286-4ae7-9ab3-1e242de96284 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:17.912155 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-631db918-7286-4ae7-9ab3-1e242de96284 admin admin] Allocated IP 172.20.0.1 (838c65be-046c-4ff2-bdb7-ede24f82dbda/9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1/bfa73955-6300-4749-8500-d4c22f8e54be) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:39:17.916740 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-27de3524-4329-46da-9964-587c2494ae45 None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:17.925825 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-27de3524-4329-46da-9964-587c2494ae45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:17.968768 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69745c26-4486-418b-854c-59b366ec5e8b None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:39:17.979112 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-27de3524-4329-46da-9964-587c2494ae45 None None] Attempting to bind port e89a3aa7-436f-4a4a-b261-ace3f89966be on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:39:17.979511 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-27de3524-4329-46da-9964-587c2494ae45 None None] Attempting to bind port e89a3aa7-436f-4a4a-b261-ace3f89966be by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:39:17.979880 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-27de3524-4329-46da-9964-587c2494ae45 None None] Attempting to bind port e89a3aa7-436f-4a4a-b261-ace3f89966be on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:39:17.989498 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-27de3524-4329-46da-9964-587c2494ae45 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 39, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:39:17.989939 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-27de3524-4329-46da-9964-587c2494ae45 None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:39:17.990347 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-27de3524-4329-46da-9964-587c2494ae45 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:17.990791 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-27de3524-4329-46da-9964-587c2494ae45 None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:39:17.991297 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-27de3524-4329-46da-9964-587c2494ae45 None None] Bound port: e89a3aa7-436f-4a4a-b261-ace3f89966be, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:39:17.991707 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-27de3524-4329-46da-9964-587c2494ae45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:18.017071 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-631db918-7286-4ae7-9ab3-1e242de96284 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:18.017506 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1107f0af-5fff-4937-8f14-e214e9c20ac1 None None] Pushing event updated for resources: {'Port': ['ID=e89a3aa7-436f-4a4a-b261-ace3f89966be,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:18.029347 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1107f0af-5fff-4937-8f14-e214e9c20ac1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:18.029685 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1107f0af-5fff-4937-8f14-e214e9c20ac1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:18.030399 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1107f0af-5fff-4937-8f14-e214e9c20ac1 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:18.030678 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1107f0af-5fff-4937-8f14-e214e9c20ac1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:18.031200 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1107f0af-5fff-4937-8f14-e214e9c20ac1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:18.031548 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1107f0af-5fff-4937-8f14-e214e9c20ac1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:18.031886 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1107f0af-5fff-4937-8f14-e214e9c20ac1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:18.032211 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1107f0af-5fff-4937-8f14-e214e9c20ac1 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:18.032540 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1107f0af-5fff-4937-8f14-e214e9c20ac1 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:18.032860 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1107f0af-5fff-4937-8f14-e214e9c20ac1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:18.033167 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1107f0af-5fff-4937-8f14-e214e9c20ac1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:18.033500 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1107f0af-5fff-4937-8f14-e214e9c20ac1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:18.033800 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1107f0af-5fff-4937-8f14-e214e9c20ac1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103440) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:39:18.051494 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-631db918-7286-4ae7-9ab3-1e242de96284 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:18.061406 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-27de3524-4329-46da-9964-587c2494ae45 None None] For port e89a3aa7-436f-4a4a-b261-ace3f89966be, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:39:18.065185 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-27de3524-4329-46da-9964-587c2494ae45 None None] For port e89a3aa7-436f-4a4a-b261-ace3f89966be, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e89a3aa7-436f-4a4a-b261-ace3f89966be,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:39:18.069782 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-27de3524-4329-46da-9964-587c2494ae45 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:18.091733 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-631db918-7286-4ae7-9ab3-1e242de96284 admin admin] Network 838c65be-046c-4ff2-bdb7-ede24f82dbda is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:39:18.100124 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-631db918-7286-4ae7-9ab3-1e242de96284 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:39:18.102423 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-631db918-7286-4ae7-9ab3-1e242de96284 admin admin] Pushing event updated for resources: {'Port': ['ID=bfa73955-6300-4749-8500-d4c22f8e54be,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:18.104922 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-631db918-7286-4ae7-9ab3-1e242de96284 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:39:18.119662 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27de3524-4329-46da-9964-587c2494ae45 None None] Routers {'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:39:18.120292 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-27de3524-4329-46da-9964-587c2494ae45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:39:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:18.148033 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-631db918-7286-4ae7-9ab3-1e242de96284 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:18.149005 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-091410dd-1798-4734-9646-4f0bd21618fc None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:39:18.177445 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1107f0af-5fff-4937-8f14-e214e9c20ac1 None None] Pushing event updated for resources: {'Port': ['ID=e89a3aa7-436f-4a4a-b261-ace3f89966be,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:18.219284 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-765aff92-1e87-4e77-8166-31b42e10b1a4 None None] Provisioning complete for port e89a3aa7-436f-4a4a-b261-ace3f89966be triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:18.219988 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-765aff92-1e87-4e77-8166-31b42e10b1a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:18.251868 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-27de3524-4329-46da-9964-587c2494ae45 None None] Set router a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:39:18.295932 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-631db918-7286-4ae7-9ab3-1e242de96284 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:18.334174 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-765aff92-1e87-4e77-8166-31b42e10b1a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:18.362013 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-765aff92-1e87-4e77-8166-31b42e10b1a4 None None] For port e89a3aa7-436f-4a4a-b261-ace3f89966be, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e89a3aa7-436f-4a4a-b261-ace3f89966be,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:39:18.367349 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-765aff92-1e87-4e77-8166-31b42e10b1a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:18.403118 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-765aff92-1e87-4e77-8166-31b42e10b1a4 None None] Provisioning complete for port 591164fc-106b-426b-86ac-26781269c30e triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:18.403520 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-765aff92-1e87-4e77-8166-31b42e10b1a4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:18.447999 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-27de3524-4329-46da-9964-587c2494ae45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'name': 'tempest-TestSnapshotPattern-2034929229-router', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141'}], 'enable_snat': True}, 'gw_port_id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:16Z', 'revision_number': 3, 'project_id': '2373ef24126c44b492884e181943f78a', 'gw_port': {'id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:7a:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4361, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:18.451009 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-765aff92-1e87-4e77-8166-31b42e10b1a4 None None] Pushing event updated for resources: {'Port': ['ID=e89a3aa7-436f-4a4a-b261-ace3f89966be,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:18.477050 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-27de3524-4329-46da-9964-587c2494ae45 None None] The sync data for ids ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'] in n-d-713301-27 is: [{'id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'name': 'tempest-TestSnapshotPattern-2034929229-router', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141'}], 'enable_snat': True}, 'gw_port_id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:16Z', 'revision_number': 3, 'project_id': '2373ef24126c44b492884e181943f78a', 'gw_port': {'id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:7a:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4361, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:39:18.492101 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-631db918-7286-4ae7-9ab3-1e242de96284 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:18.503252 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-631db918-7286-4ae7-9ab3-1e242de96284 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:18.584130 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-631db918-7286-4ae7-9ab3-1e242de96284 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:18.585972 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-631db918-7286-4ae7-9ab3-1e242de96284 admin admin] Pushing event updated for resources: {'Port': ['ID=bfa73955-6300-4749-8500-d4c22f8e54be,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:18.627632 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-5f1ddcc3-ec0f-490b-9053-e9f29704b30c None None] Provisioning complete for port bfa73955-6300-4749-8500-d4c22f8e54be triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:18.628636 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5f1ddcc3-ec0f-490b-9053-e9f29704b30c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:18.667076 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-5f1ddcc3-ec0f-490b-9053-e9f29704b30c None None] Port bfa73955-6300-4749-8500-d4c22f8e54be cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:39:18.688543 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-631db918-7286-4ae7-9ab3-1e242de96284 admin admin] Network 838c65be-046c-4ff2-bdb7-ede24f82dbda is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:39:18.690306 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-631db918-7286-4ae7-9ab3-1e242de96284 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:39:18.816122 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-631db918-7286-4ae7-9ab3-1e242de96284 admin admin] Router a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:39:18.965663 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-631db918-7286-4ae7-9ab3-1e242de96284 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:39:18.971464 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-631db918-7286-4ae7-9ab3-1e242de96284 admin admin] 10.222.0.13 "PUT /v2.0/routers/a72c0417-48f5-4a99-bfd5-b416fe1c9dd0/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7110574 Dec 09 22:39:18.993247 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f2420e7a-e8ea-42e9-af7e-1e1d8ddbb27c None None] Provisioning complete for port bfa73955-6300-4749-8500-d4c22f8e54be triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:18.993620 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f2420e7a-e8ea-42e9-af7e-1e1d8ddbb27c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:19.024759 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e89a3aa7-436f-4a4a-b261-ace3f89966be up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:39:19.056559 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f2420e7a-e8ea-42e9-af7e-1e1d8ddbb27c None None] Port bfa73955-6300-4749-8500-d4c22f8e54be cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:39:19.095634 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port e89a3aa7-436f-4a4a-b261-ace3f89966be triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:19.095755 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:19.183077 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 591164fc-106b-426b-86ac-26781269c30e up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:39:19.237209 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 591164fc-106b-426b-86ac-26781269c30e triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:19.237714 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:19.501405 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35830) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:19.506607 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-b1a0639f-c7a0-4f36-904c-69039dbfd33b admin admin] Request body: {'network': {'name': 'tempest-TestSnapshotPattern-1721515629-network', 'tenant_id': '3382e60685be4fbb8bdbbf26852a44e1'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:39:19.529702 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b1a0639f-c7a0-4f36-904c-69039dbfd33b admin admin] Made reservation on behalf of 3382e60685be4fbb8bdbbf26852a44e1 for: {'network': 1} {{(pid=103438) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:39:19.532707 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b1a0639f-c7a0-4f36-904c-69039dbfd33b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for network, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:19.541480 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b1a0639f-c7a0-4f36-904c-69039dbfd33b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:19.620112 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b1a0639f-c7a0-4f36-904c-69039dbfd33b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:19.625363 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b1a0639f-c7a0-4f36-904c-69039dbfd33b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:19.646805 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b1a0639f-c7a0-4f36-904c-69039dbfd33b admin admin] vlan segment allocate from pool success with {'vlan_id': 135, 'physical_network': 'physnet1'} {{(pid=103438) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 22:39:19.660680 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1a0639f-c7a0-4f36-904c-69039dbfd33b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3558625e-7bf6-4bfc-a0c1-5770e2147362,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:19.667046 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b1a0639f-c7a0-4f36-904c-69039dbfd33b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:19.667392 n-d-713301-27 neutron-server[103438]: INFO neutron.db.segments_db [None req-b1a0639f-c7a0-4f36-904c-69039dbfd33b admin admin] Added segment 71eac29e-4486-46a6-94a8-8db81722f2b0 of type vlan for network 31429689-de66-4d83-b930-16c23409a587 Dec 09 22:39:19.710585 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b1a0639f-c7a0-4f36-904c-69039dbfd33b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8731649708135'] for network, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:19.737790 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b1a0639f-c7a0-4f36-904c-69039dbfd33b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741'] for network, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:19.738804 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b1a0639f-c7a0-4f36-904c-69039dbfd33b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:19.739390 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b1a0639f-c7a0-4f36-904c-69039dbfd33b admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:19.770694 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b1a0639f-c7a0-4f36-904c-69039dbfd33b admin admin] 10.222.0.13 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.2681260 Dec 09 22:39:19.773685 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35832) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:19.779596 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-495d4ef1-767b-46f2-a713-c1342ba6eace admin admin] Request body: {'subnet': {'network_id': '31429689-de66-4d83-b930-16c23409a587', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestSnapshotPattern-1721515629-subnet', 'tenant_id': '3382e60685be4fbb8bdbbf26852a44e1', 'ip_version': 4}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:39:19.802046 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-495d4ef1-767b-46f2-a713-c1342ba6eace admin admin] Made reservation on behalf of 3382e60685be4fbb8bdbbf26852a44e1 for: {'subnet': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:39:19.804823 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-495d4ef1-767b-46f2-a713-c1342ba6eace admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8601291'] for subnet, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:19.806083 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1a0639f-c7a0-4f36-904c-69039dbfd33b admin admin] Pushing event updated for resources: {'Network': ['ID=31429689-de66-4d83-b930-16c23409a587,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:19.816551 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Network 31429689-de66-4d83-b930-16c23409a587 details requested by agent ovs-agent-n-d-713301-27 with host n-d-713301-27 {{(pid=103439) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 22:39:19.979545 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-495d4ef1-767b-46f2-a713-c1342ba6eace admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8621750', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9200161'] for subnet, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:20.030167 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-495d4ef1-767b-46f2-a713-c1342ba6eace admin admin] Pushing event updated for resources: {'Subnet': ['ID=9293130c-edee-4951-bdc3-4b9011e76435,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:20.046215 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-495d4ef1-767b-46f2-a713-c1342ba6eace admin admin] Checking segment: {'id': '71eac29e-4486-46a6-94a8-8db81722f2b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '31429689-de66-4d83-b930-16c23409a587'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:39:20.046777 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-495d4ef1-767b-46f2-a713-c1342ba6eace admin admin] Network hostable DHCP agents. Network: 31429689-de66-4d83-b930-16c23409a587, hostable agents: ['05180752-3a78-469e-8204-bc6af7fe05ab'], hosted agents: [] {{(pid=103437) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 22:39:20.065085 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-495d4ef1-767b-46f2-a713-c1342ba6eace admin admin] Network 31429689-de66-4d83-b930-16c23409a587 is scheduled to be hosted by DHCP agent 05180752-3a78-469e-8204-bc6af7fe05ab with binding_index 1 {{(pid=103437) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 22:39:20.073629 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-495d4ef1-767b-46f2-a713-c1342ba6eace admin admin] Resources bound (agent type, host, resource id): (DHCP agent, n-d-713301-27, 31429689-de66-4d83-b930-16c23409a587) {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:39:20.077888 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-495d4ef1-767b-46f2-a713-c1342ba6eace admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:20.078496 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-495d4ef1-767b-46f2-a713-c1342ba6eace admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:20.082614 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4af2dd92-2e0d-4bc9-adc4-9da6ff366eba None None] Network 31429689-de66-4d83-b930-16c23409a587 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:39:20.099308 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-495d4ef1-767b-46f2-a713-c1342ba6eace admin admin] 10.222.0.13 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.3213940 Dec 09 22:39:20.100204 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35834) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:20.105175 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-e3bf0fa2-e454-479b-92fb-f63f4f707110 admin admin] Request body: {'router': {'name': 'tempest-TestSnapshotPattern-1721515629-router', 'tenant_id': '3382e60685be4fbb8bdbbf26852a44e1', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:39:20.126841 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3bf0fa2-e454-479b-92fb-f63f4f707110 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-635365', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-104268'] for router, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:20.128057 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3bf0fa2-e454-479b-92fb-f63f4f707110 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-635257', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-632104', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-536037', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-104263'] for router, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:20.184730 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3bf0fa2-e454-479b-92fb-f63f4f707110 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:20.195312 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] Sync routers for ids ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:39:20.208460 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c300971-620d-40ab-96e5-7695440593fe None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1fb80d3a-b7d6-53cb-84ca-3bd054dc1ca9-31429689-de66-4d83-b930-16c23409a587', 'network_id': '31429689-de66-4d83-b930-16c23409a587', 'project_id': '3382e60685be4fbb8bdbbf26852a44e1', 'fixed_ips': [{'subnet_id': '9293130c-edee-4951-bdc3-4b9011e76435'}]}} from n-d-713301-27. {{(pid=103439) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 22:39:20.209307 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8c300971-620d-40ab-96e5-7695440593fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:20.222462 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] Routers {'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:39:20.223105 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:39:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:20.325564 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3bf0fa2-e454-479b-92fb-f63f4f707110 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:20.423352 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] Set router a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:39:20.467034 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.db_base_plugin_common [None req-8c300971-620d-40ab-96e5-7695440593fe None None] Allocated IP 172.20.0.2 (31429689-de66-4d83-b930-16c23409a587/9293130c-edee-4951-bdc3-4b9011e76435/dd1f2e52-a39d-441e-9a5b-165c7b45f1ed) {{(pid=103439) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:39:20.524988 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3bf0fa2-e454-479b-92fb-f63f4f707110 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:20.546434 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3bf0fa2-e454-479b-92fb-f63f4f707110 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:20.656020 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [None req-e3bf0fa2-e454-479b-92fb-f63f4f707110 admin admin] Allocated IP 172.25.3.232 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/0ec2516c-da47-46b1-ad5d-7e65df05ce36) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:39:20.739092 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8c300971-620d-40ab-96e5-7695440593fe None None] Publish callbacks [] for port, precommit_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:20.749408 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8c300971-620d-40ab-96e5-7695440593fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204'] for port, after_create {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:20.761145 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3bf0fa2-e454-479b-92fb-f63f4f707110 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:20.784023 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'name': 'tempest-TestSnapshotPattern-2034929229-router', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141'}], 'enable_snat': True}, 'gw_port_id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '2373ef24126c44b492884e181943f78a', 'gw_port': {'id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:7a:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4361, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'bfa73955-6300-4749-8500-d4c22f8e54be', 'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'mac_address': 'fa:16:3e:e8:dd:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_interface', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:17Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 2, 'project_id': '2373ef24126c44b492884e181943f78a', 'subnets': [{'id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:20.799800 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3bf0fa2-e454-479b-92fb-f63f4f707110 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:20.825532 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] Checking router: a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:39:20.825997 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] Updating router a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 port bfa73955-6300-4749-8500-d4c22f8e54be binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:39:20.829901 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c300971-620d-40ab-96e5-7695440593fe None None] Network 31429689-de66-4d83-b930-16c23409a587 is already hosted by enough agents. {{(pid=103439) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:39:20.851028 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e3bf0fa2-e454-479b-92fb-f63f4f707110 admin admin] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:39:20.852627 n-d-713301-27 neutron-server[103439]: DEBUG neutron.scheduler.base_scheduler [None req-8c300971-620d-40ab-96e5-7695440593fe None None] Resources bound (agent type, host, resource id): {{(pid=103439) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:39:20.854901 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3bf0fa2-e454-479b-92fb-f63f4f707110 admin admin] Pushing event updated for resources: {'Port': ['ID=0ec2516c-da47-46b1-ad5d-7e65df05ce36,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:20.855080 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c300971-620d-40ab-96e5-7695440593fe None None] Received port after_create {{(pid=103439) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:39:20.857807 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [None req-e3bf0fa2-e454-479b-92fb-f63f4f707110 admin admin] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:39:20.859816 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3bf0fa2-e454-479b-92fb-f63f4f707110 admin admin] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:39:20.868109 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:20.877115 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c300971-620d-40ab-96e5-7695440593fe None None] Pushing event updated for resources: {'Port': ['ID=dd1f2e52-a39d-441e-9a5b-165c7b45f1ed,revision_number=1']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:20.883261 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5170895-48d7-4a89-89f1-6e623432fb2b None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:39:21.028443 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-8c300971-620d-40ab-96e5-7695440593fe None None] Attempting to bind port dd1f2e52-a39d-441e-9a5b-165c7b45f1ed on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:39:21.028701 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-8c300971-620d-40ab-96e5-7695440593fe None None] Attempting to bind port dd1f2e52-a39d-441e-9a5b-165c7b45f1ed by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '71eac29e-4486-46a6-94a8-8db81722f2b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '31429689-de66-4d83-b930-16c23409a587'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:39:21.029054 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c300971-620d-40ab-96e5-7695440593fe None None] Attempting to bind port dd1f2e52-a39d-441e-9a5b-165c7b45f1ed on network 31429689-de66-4d83-b930-16c23409a587 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:39:21.043272 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c300971-620d-40ab-96e5-7695440593fe None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 39, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:39:21.043643 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c300971-620d-40ab-96e5-7695440593fe None None] Checking segment: {'id': '71eac29e-4486-46a6-94a8-8db81722f2b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '31429689-de66-4d83-b930-16c23409a587'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:39:21.044044 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8c300971-620d-40ab-96e5-7695440593fe None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:21.044434 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c300971-620d-40ab-96e5-7695440593fe None None] Bound using segment: {'id': '71eac29e-4486-46a6-94a8-8db81722f2b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '31429689-de66-4d83-b930-16c23409a587'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:39:21.044899 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-8c300971-620d-40ab-96e5-7695440593fe None None] Bound port: dd1f2e52-a39d-441e-9a5b-165c7b45f1ed, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71eac29e-4486-46a6-94a8-8db81722f2b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '31429689-de66-4d83-b930-16c23409a587'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:39:21.045275 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8c300971-620d-40ab-96e5-7695440593fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:21.065000 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-2cb19202-70c0-49c0-a5ae-4cd35e54af8b None None] Provisioning complete for port 0ec2516c-da47-46b1-ad5d-7e65df05ce36 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:21.065336 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2cb19202-70c0-49c0-a5ae-4cd35e54af8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:21.110298 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3bf0fa2-e454-479b-92fb-f63f4f707110 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:21.155791 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-2cb19202-70c0-49c0-a5ae-4cd35e54af8b None None] Port 0ec2516c-da47-46b1-ad5d-7e65df05ce36 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:39:21.209043 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-8c300971-620d-40ab-96e5-7695440593fe None None] For port dd1f2e52-a39d-441e-9a5b-165c7b45f1ed, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:39:21.213168 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-8c300971-620d-40ab-96e5-7695440593fe None None] For port dd1f2e52-a39d-441e-9a5b-165c7b45f1ed, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=dd1f2e52-a39d-441e-9a5b-165c7b45f1ed,segment=NetworkSegment(71eac29e-4486-46a6-94a8-8db81722f2b0),segment_id=71eac29e-4486-46a6-94a8-8db81722f2b0)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:39:21.220499 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8c300971-620d-40ab-96e5-7695440593fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:21.313277 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3bf0fa2-e454-479b-92fb-f63f4f707110 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-635248', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-640503'] for router, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:21.313546 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c300971-620d-40ab-96e5-7695440593fe None None] Pushing event updated for resources: {'Port': ['ID=dd1f2e52-a39d-441e-9a5b-165c7b45f1ed,revision_number=2']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:21.362010 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:21.369092 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:21.424330 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2089447f-82a1-4d0b-89eb-04cbb681dfc6 None None] Pushing event updated for resources: {'Port': ['ID=bfa73955-6300-4749-8500-d4c22f8e54be,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:21.464953 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e3bf0fa2-e454-479b-92fb-f63f4f707110 admin admin] Router 80a6d605-9a70-40a2-b9ed-008b8372f195 is scheduled to L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 with binding_index 1 {{(pid=103437) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 22:39:21.501789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] Attempting to bind port bfa73955-6300-4749-8500-d4c22f8e54be on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:39:21.502189 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] Attempting to bind port bfa73955-6300-4749-8500-d4c22f8e54be by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '2eba823c-93ea-484b-ab73-5af9237c7643', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:39:21.502573 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] Attempting to bind port bfa73955-6300-4749-8500-d4c22f8e54be on network 838c65be-046c-4ff2-bdb7-ede24f82dbda {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:39:21.507965 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 39, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:39:21.508333 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] Checking segment: {'id': '2eba823c-93ea-484b-ab73-5af9237c7643', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:39:21.508728 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:21.509113 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] Bound using segment: {'id': '2eba823c-93ea-484b-ab73-5af9237c7643', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:39:21.509569 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] Bound port: bfa73955-6300-4749-8500-d4c22f8e54be, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2eba823c-93ea-484b-ab73-5af9237c7643', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:39:21.509944 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:21.603288 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e3bf0fa2-e454-479b-92fb-f63f4f707110 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:39:21.614881 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] Sync routers for ids ['80a6d605-9a70-40a2-b9ed-008b8372f195'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:39:21.629998 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-e3bf0fa2-e454-479b-92fb-f63f4f707110 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:21.631961 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-e3bf0fa2-e454-479b-92fb-f63f4f707110 admin admin] 10.222.0.13 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 1.5309951 Dec 09 22:39:21.633085 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] Routers {'80a6d605-9a70-40a2-b9ed-008b8372f195'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:39:21.633795 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:39:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['80a6d605-9a70-40a2-b9ed-008b8372f195'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:21.634842 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35836) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:21.812904 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] For port bfa73955-6300-4749-8500-d4c22f8e54be, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:39:21.816661 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] For port bfa73955-6300-4749-8500-d4c22f8e54be, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=bfa73955-6300-4749-8500-d4c22f8e54be,segment=NetworkSegment(2eba823c-93ea-484b-ab73-5af9237c7643),segment_id=2eba823c-93ea-484b-ab73-5af9237c7643)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:39:21.829499 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:21.897221 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] Routers {'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:39:21.899013 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:39:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:21.913830 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] Set router 80a6d605-9a70-40a2-b9ed-008b8372f195 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:39:21.960921 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2089447f-82a1-4d0b-89eb-04cbb681dfc6 None None] Pushing event updated for resources: {'Port': ['ID=bfa73955-6300-4749-8500-d4c22f8e54be,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:21.981360 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-99e1e0ba-1ffc-43e6-807e-30cf7dccdad7 None None] Provisioning complete for port bfa73955-6300-4749-8500-d4c22f8e54be triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:21.981360 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-99e1e0ba-1ffc-43e6-807e-30cf7dccdad7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:22.068971 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] Set router a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:39:22.171326 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cc8bc804-15df-4721-9523-44f37781430e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:22.189591 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '80a6d605-9a70-40a2-b9ed-008b8372f195', 'name': 'tempest-TestSnapshotPattern-1721515629-router', 'tenant_id': '3382e60685be4fbb8bdbbf26852a44e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.232'}], 'enable_snat': True}, 'gw_port_id': '0ec2516c-da47-46b1-ad5d-7e65df05ce36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:20Z', 'updated_at': '2021-12-09T22:39:21Z', 'revision_number': 3, 'project_id': '3382e60685be4fbb8bdbbf26852a44e1', 'gw_port': {'id': '0ec2516c-da47-46b1-ad5d-7e65df05ce36', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:3d:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80a6d605-9a70-40a2-b9ed-008b8372f195', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4373, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.232', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:20Z', 'updated_at': '2021-12-09T22:39:20Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:22.221010 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] Checking router: 80a6d605-9a70-40a2-b9ed-008b8372f195 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:39:22.221662 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] Updating router 80a6d605-9a70-40a2-b9ed-008b8372f195 port 0ec2516c-da47-46b1-ad5d-7e65df05ce36 binding host n-d-713301-27 {{(pid=103440) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:39:22.224173 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-99e1e0ba-1ffc-43e6-807e-30cf7dccdad7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:22.253767 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:22.318210 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-99e1e0ba-1ffc-43e6-807e-30cf7dccdad7 None None] For port bfa73955-6300-4749-8500-d4c22f8e54be, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=bfa73955-6300-4749-8500-d4c22f8e54be,segment=NetworkSegment(2eba823c-93ea-484b-ab73-5af9237c7643),segment_id=2eba823c-93ea-484b-ab73-5af9237c7643)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:39:22.327968 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-99e1e0ba-1ffc-43e6-807e-30cf7dccdad7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:22.389865 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-cc8bc804-15df-4721-9523-44f37781430e admin admin] Allocated IP 172.20.0.1 (31429689-de66-4d83-b930-16c23409a587/9293130c-edee-4951-bdc3-4b9011e76435/e5ca8248-b1c1-4803-82f9-5956a0b7bc3a) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:39:22.429878 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99e1e0ba-1ffc-43e6-807e-30cf7dccdad7 None None] Pushing event updated for resources: {'Port': ['ID=bfa73955-6300-4749-8500-d4c22f8e54be,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:22.465420 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-75ef39be-f8e2-40bf-a3b8-0c2f9706c907 None None] Provisioning complete for port bfa73955-6300-4749-8500-d4c22f8e54be triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:22.465790 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-75ef39be-f8e2-40bf-a3b8-0c2f9706c907 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:22.469733 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'name': 'tempest-TestSnapshotPattern-2034929229-router', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141'}], 'enable_snat': True}, 'gw_port_id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '2373ef24126c44b492884e181943f78a', 'gw_port': {'id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:7a:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4361, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'bfa73955-6300-4749-8500-d4c22f8e54be', 'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'mac_address': 'fa:16:3e:e8:dd:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_interface', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:17Z', 'updated_at': '2021-12-09T22:39:21Z', 'revision_number': 4, 'project_id': '2373ef24126c44b492884e181943f78a', 'subnets': [{'id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:22.514672 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cc8bc804-15df-4721-9523-44f37781430e admin admin] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:22.525251 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a8a1fc38-497c-465c-967b-94aca9fdff16 None None] The sync data for ids ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'] in n-d-713301-27 is: [{'id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'name': 'tempest-TestSnapshotPattern-2034929229-router', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141'}], 'enable_snat': True}, 'gw_port_id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '2373ef24126c44b492884e181943f78a', 'gw_port': {'id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:7a:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4361, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'bfa73955-6300-4749-8500-d4c22f8e54be', 'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'mac_address': 'fa:16:3e:e8:dd:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_interface', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:17Z', 'updated_at': '2021-12-09T22:39:21Z', 'revision_number': 4, 'project_id': '2373ef24126c44b492884e181943f78a', 'subnets': [{'id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:39:22.571665 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cc8bc804-15df-4721-9523-44f37781430e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:22.586708 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] Publish callbacks [] for port, precommit_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:22.600910 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:22.622005 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22bd8051-7038-45af-84ee-58f5b44b2f2d None None] Network 31429689-de66-4d83-b930-16c23409a587 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:39:22.626931 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc8bc804-15df-4721-9523-44f37781430e admin admin] Network 31429689-de66-4d83-b930-16c23409a587 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:39:22.633463 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-cc8bc804-15df-4721-9523-44f37781430e admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:39:22.640926 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc8bc804-15df-4721-9523-44f37781430e admin admin] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:39:22.661256 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] Attempting to bind port 0ec2516c-da47-46b1-ad5d-7e65df05ce36 on host n-d-713301-27 for vnic_type normal with profile {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:39:22.661831 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] Attempting to bind port 0ec2516c-da47-46b1-ad5d-7e65df05ce36 by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:39:22.661958 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] Attempting to bind port 0ec2516c-da47-46b1-ad5d-7e65df05ce36 on network 97925a19-460a-4476-8208-41db134b6c83 {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:39:22.669696 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2525c3ab-1b28-456d-beec-25f02d7f4d2f None None] Pushing event updated for resources: {'Port': ['ID=0ec2516c-da47-46b1-ad5d-7e65df05ce36,revision_number=2']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:22.672185 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d5e1aff-65ad-4eff-a216-9d0bc2b5a97b None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:39:22.674238 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 39, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:39:22.674620 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] Checking segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103440) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:39:22.675016 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:22.675401 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] Bound using segment: {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'} {{(pid=103440) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:39:22.675906 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.managers [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] Bound port: 0ec2516c-da47-46b1-ad5d-7e65df05ce36, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f99e21fd-7aae-414e-91b6-df0c4cab3a19', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '97925a19-460a-4476-8208-41db134b6c83'}}] {{(pid=103440) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:39:22.676283 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:22.682472 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc8bc804-15df-4721-9523-44f37781430e admin admin] Pushing event updated for resources: {'Port': ['ID=e5ca8248-b1c1-4803-82f9-5956a0b7bc3a,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:22.708096 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cc8bc804-15df-4721-9523-44f37781430e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-640296'] for router_interface, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:22.736087 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] For port 0ec2516c-da47-46b1-ad5d-7e65df05ce36, host n-d-713301-27, cleared binding levels {{(pid=103440) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:39:22.740078 n-d-713301-27 neutron-server[103440]: DEBUG neutron.plugins.ml2.db [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] For port 0ec2516c-da47-46b1-ad5d-7e65df05ce36, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=0ec2516c-da47-46b1-ad5d-7e65df05ce36,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103440) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:39:22.746823 n-d-713301-27 neutron-server[103440]: DEBUG neutron_lib.callbacks.manager [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103440) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:22.772442 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-38480cc1-326f-4fcc-8174-e5e201d0c9bf None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:39:22.833901 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] Routers {'80a6d605-9a70-40a2-b9ed-008b8372f195'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:39:22.834603 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:39:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['80a6d605-9a70-40a2-b9ed-008b8372f195'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:22.862462 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-97e72ea1-12f0-4f7e-a898-322f8e206752 None None] Provisioning complete for port 0ec2516c-da47-46b1-ad5d-7e65df05ce36 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:22.863685 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-97e72ea1-12f0-4f7e-a898-322f8e206752 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:22.959920 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cc8bc804-15df-4721-9523-44f37781430e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:22.983869 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2525c3ab-1b28-456d-beec-25f02d7f4d2f None None] Pushing event updated for resources: {'Port': ['ID=0ec2516c-da47-46b1-ad5d-7e65df05ce36,revision_number=3']} {{(pid=103440) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:23.017906 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] Set router 80a6d605-9a70-40a2-b9ed-008b8372f195 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:39:23.041209 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-97e72ea1-12f0-4f7e-a898-322f8e206752 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:23.091815 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device bfa73955-6300-4749-8500-d4c22f8e54be up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:39:23.154184 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-97e72ea1-12f0-4f7e-a898-322f8e206752 None None] For port 0ec2516c-da47-46b1-ad5d-7e65df05ce36, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=0ec2516c-da47-46b1-ad5d-7e65df05ce36,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:39:23.163536 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-97e72ea1-12f0-4f7e-a898-322f8e206752 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:23.224468 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port bfa73955-6300-4749-8500-d4c22f8e54be triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:23.224846 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:23.269822 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-97e72ea1-12f0-4f7e-a898-322f8e206752 None None] Provisioning complete for port dd1f2e52-a39d-441e-9a5b-165c7b45f1ed triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:23.270197 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-97e72ea1-12f0-4f7e-a898-322f8e206752 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:23.284163 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cc8bc804-15df-4721-9523-44f37781430e admin admin] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:23.295228 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cc8bc804-15df-4721-9523-44f37781430e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:23.319391 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97e72ea1-12f0-4f7e-a898-322f8e206752 None None] Pushing event updated for resources: {'Port': ['ID=0ec2516c-da47-46b1-ad5d-7e65df05ce36,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:23.337805 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '80a6d605-9a70-40a2-b9ed-008b8372f195', 'name': 'tempest-TestSnapshotPattern-1721515629-router', 'tenant_id': '3382e60685be4fbb8bdbbf26852a44e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.232'}], 'enable_snat': True}, 'gw_port_id': '0ec2516c-da47-46b1-ad5d-7e65df05ce36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:20Z', 'updated_at': '2021-12-09T22:39:21Z', 'revision_number': 3, 'project_id': '3382e60685be4fbb8bdbbf26852a44e1', 'gw_port': {'id': '0ec2516c-da47-46b1-ad5d-7e65df05ce36', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:3d:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80a6d605-9a70-40a2-b9ed-008b8372f195', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4373, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.232', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:20Z', 'updated_at': '2021-12-09T22:39:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:23.375940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc8bc804-15df-4721-9523-44f37781430e admin admin] Pushing event updated for resources: {'Port': ['ID=e5ca8248-b1c1-4803-82f9-5956a0b7bc3a,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:23.382549 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-cc8bc804-15df-4721-9523-44f37781430e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-560727', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-637368'] for router_interface, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:23.384824 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18003475-42bd-4a60-a478-2e4db363a4dd None None] The sync data for ids ['80a6d605-9a70-40a2-b9ed-008b8372f195'] in n-d-713301-27 is: [{'id': '80a6d605-9a70-40a2-b9ed-008b8372f195', 'name': 'tempest-TestSnapshotPattern-1721515629-router', 'tenant_id': '3382e60685be4fbb8bdbbf26852a44e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.232'}], 'enable_snat': True}, 'gw_port_id': '0ec2516c-da47-46b1-ad5d-7e65df05ce36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:20Z', 'updated_at': '2021-12-09T22:39:21Z', 'revision_number': 3, 'project_id': '3382e60685be4fbb8bdbbf26852a44e1', 'gw_port': {'id': '0ec2516c-da47-46b1-ad5d-7e65df05ce36', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:3d:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80a6d605-9a70-40a2-b9ed-008b8372f195', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4373, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.232', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:20Z', 'updated_at': '2021-12-09T22:39:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:39:23.454997 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device dd1f2e52-a39d-441e-9a5b-165c7b45f1ed up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:39:23.494372 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc8bc804-15df-4721-9523-44f37781430e admin admin] Network 31429689-de66-4d83-b930-16c23409a587 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:39:23.496054 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-cc8bc804-15df-4721-9523-44f37781430e admin admin] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:39:23.498134 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-97e72ea1-12f0-4f7e-a898-322f8e206752 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:23.550755 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-97e72ea1-12f0-4f7e-a898-322f8e206752 None None] For port dd1f2e52-a39d-441e-9a5b-165c7b45f1ed, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=dd1f2e52-a39d-441e-9a5b-165c7b45f1ed,segment=NetworkSegment(71eac29e-4486-46a6-94a8-8db81722f2b0),segment_id=71eac29e-4486-46a6-94a8-8db81722f2b0)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:39:23.553583 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port dd1f2e52-a39d-441e-9a5b-165c7b45f1ed triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:23.553973 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:23.580711 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-97e72ea1-12f0-4f7e-a898-322f8e206752 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:23.646505 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cc8bc804-15df-4721-9523-44f37781430e admin admin] Router 80a6d605-9a70-40a2-b9ed-008b8372f195 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:39:23.661498 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97e72ea1-12f0-4f7e-a898-322f8e206752 None None] Pushing event updated for resources: {'Port': ['ID=dd1f2e52-a39d-441e-9a5b-165c7b45f1ed,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:23.729819 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c89ffbf0-0184-4e7d-b692-ba28c1bc1171 None None] Provisioning complete for port e5ca8248-b1c1-4803-82f9-5956a0b7bc3a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:23.730275 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c89ffbf0-0184-4e7d-b692-ba28c1bc1171 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:23.788292 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-c89ffbf0-0184-4e7d-b692-ba28c1bc1171 None None] Port e5ca8248-b1c1-4803-82f9-5956a0b7bc3a cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:39:23.801593 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-c89ffbf0-0184-4e7d-b692-ba28c1bc1171 None None] Provisioning complete for port dd1f2e52-a39d-441e-9a5b-165c7b45f1ed triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:23.801935 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c89ffbf0-0184-4e7d-b692-ba28c1bc1171 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:23.819769 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cc8bc804-15df-4721-9523-44f37781430e admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:39:23.835090 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-cc8bc804-15df-4721-9523-44f37781430e admin admin] 10.222.0.13 "PUT /v2.0/routers/80a6d605-9a70-40a2-b9ed-008b8372f195/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1990142 Dec 09 22:39:24.043603 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-1f0743c2-c5b1-4b08-abe2-a150dda10e2d None None] Provisioning complete for port e5ca8248-b1c1-4803-82f9-5956a0b7bc3a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:24.044177 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1f0743c2-c5b1-4b08-abe2-a150dda10e2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:24.083618 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-1f0743c2-c5b1-4b08-abe2-a150dda10e2d None None] Port e5ca8248-b1c1-4803-82f9-5956a0b7bc3a cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:39:24.400397 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35844) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:24.405497 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-84ed4362-f57a-4c8d-a800-3dfd53e9dd73 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-2053090513', 'description': 'tempest-secgroup-smoke-2053090513 description', 'project_id': '2373ef24126c44b492884e181943f78a'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:39:24.428801 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84ed4362-f57a-4c8d-a800-3dfd53e9dd73 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for security_group, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:24.501428 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84ed4362-f57a-4c8d-a800-3dfd53e9dd73 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for security_group, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:24.506181 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84ed4362-f57a-4c8d-a800-3dfd53e9dd73 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:24.535604 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84ed4362-f57a-4c8d-a800-3dfd53e9dd73 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9b64c43a-5dd8-40a0-87a1-15e388a59102,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:24.540018 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-84ed4362-f57a-4c8d-a800-3dfd53e9dd73 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for security_group, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:24.544054 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-84ed4362-f57a-4c8d-a800-3dfd53e9dd73 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1813 time: 0.1398244 Dec 09 22:39:24.545150 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35846) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:24.549199 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-984227d3-14f0-47a8-855f-3e5bb74921ce tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Request body: {'security_group_rule': {'security_group_id': '9b64c43a-5dd8-40a0-87a1-15e388a59102', 'project_id': '2373ef24126c44b492884e181943f78a', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:39:24.580143 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-984227d3-14f0-47a8-855f-3e5bb74921ce tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:24.637801 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-984227d3-14f0-47a8-855f-3e5bb74921ce tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:24.642492 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-984227d3-14f0-47a8-855f-3e5bb74921ce tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:24.661929 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-984227d3-14f0-47a8-855f-3e5bb74921ce tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fc5d5e82-da59-4967-b835-508bd5100885,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:24.671552 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-984227d3-14f0-47a8-855f-3e5bb74921ce tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:24.675882 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35848) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:24.676382 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-984227d3-14f0-47a8-855f-3e5bb74921ce tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1303265 Dec 09 22:39:24.681530 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-29eae2e0-91a9-4d71-a064-f51763bcdea1 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Request body: {'security_group_rule': {'security_group_id': '9b64c43a-5dd8-40a0-87a1-15e388a59102', 'project_id': '2373ef24126c44b492884e181943f78a', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:39:24.714305 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-29eae2e0-91a9-4d71-a064-f51763bcdea1 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:24.772282 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-29eae2e0-91a9-4d71-a064-f51763bcdea1 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:24.777824 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-29eae2e0-91a9-4d71-a064-f51763bcdea1 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:24.794651 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29eae2e0-91a9-4d71-a064-f51763bcdea1 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1b84b535-ad54-4a8c-aaec-c97c0e995fe2,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:24.803897 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-29eae2e0-91a9-4d71-a064-f51763bcdea1 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:24.805099 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-29eae2e0-91a9-4d71-a064-f51763bcdea1 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1273999 Dec 09 22:39:24.807814 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35850) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:24.812761 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-535a1e8e-7bc0-4508-a353-951f0d526500 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Request body: {'security_group_rule': {'security_group_id': '9b64c43a-5dd8-40a0-87a1-15e388a59102', 'project_id': '2373ef24126c44b492884e181943f78a', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:39:24.839560 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-535a1e8e-7bc0-4508-a353-951f0d526500 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:24.903051 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-535a1e8e-7bc0-4508-a353-951f0d526500 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:24.907080 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-535a1e8e-7bc0-4508-a353-951f0d526500 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:24.924404 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-535a1e8e-7bc0-4508-a353-951f0d526500 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e3c1fcd0-4dba-406d-b89b-54b4dbadcf09,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:24.942380 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-535a1e8e-7bc0-4508-a353-951f0d526500 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:24.943774 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-535a1e8e-7bc0-4508-a353-951f0d526500 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1350212 Dec 09 22:39:24.946468 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35852) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:24.950747 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-af5e453c-6320-4e07-8047-c20db5a42ced tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Request body: {'security_group_rule': {'security_group_id': '9b64c43a-5dd8-40a0-87a1-15e388a59102', 'project_id': '2373ef24126c44b492884e181943f78a', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:39:24.969975 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0ec2516c-da47-46b1-ad5d-7e65df05ce36 up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:39:24.978977 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af5e453c-6320-4e07-8047-c20db5a42ced tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:25.018813 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port 0ec2516c-da47-46b1-ad5d-7e65df05ce36 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:25.019230 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:25.043181 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af5e453c-6320-4e07-8047-c20db5a42ced tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:25.047625 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af5e453c-6320-4e07-8047-c20db5a42ced tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:25.065530 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af5e453c-6320-4e07-8047-c20db5a42ced tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f4cd2dbc-41ee-4c71-bd19-7420bd91d321,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:25.074623 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-af5e453c-6320-4e07-8047-c20db5a42ced tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:25.075855 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-af5e453c-6320-4e07-8047-c20db5a42ced tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1284385 Dec 09 22:39:25.078710 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 35854) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:25.083063 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [None req-688d0d31-7946-46b5-aaad-e5a7cf6480cd tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Request body: {'security_group_rule': {'security_group_id': '9b64c43a-5dd8-40a0-87a1-15e388a59102', 'project_id': '2373ef24126c44b492884e181943f78a', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:39:25.104826 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device dd1f2e52-a39d-441e-9a5b-165c7b45f1ed up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:39:25.105394 n-d-713301-27 neutron-server[103437]: INFO neutron.db.securitygroups_db [None req-688d0d31-7946-46b5-aaad-e5a7cf6480cd tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Project 2373ef24126c44b492884e181943f78a added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 22:39:25.110433 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-688d0d31-7946-46b5-aaad-e5a7cf6480cd tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:25.150767 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port dd1f2e52-a39d-441e-9a5b-165c7b45f1ed triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:25.151139 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:25.167721 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-688d0d31-7946-46b5-aaad-e5a7cf6480cd tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:25.171880 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-688d0d31-7946-46b5-aaad-e5a7cf6480cd tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:25.189242 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-688d0d31-7946-46b5-aaad-e5a7cf6480cd tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5ada08c9-319a-4efe-8752-ce7f90a74f74,revision_number=0']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:25.199285 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-688d0d31-7946-46b5-aaad-e5a7cf6480cd tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:25.203170 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-688d0d31-7946-46b5-aaad-e5a7cf6480cd tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1208677 Dec 09 22:39:25.203568 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35856) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:25.208249 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-2a2ad179-0c78-4cb4-82ae-957b760cbbd3 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Request body: {'security_group_rule': {'security_group_id': '9b64c43a-5dd8-40a0-87a1-15e388a59102', 'project_id': '2373ef24126c44b492884e181943f78a', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:39:25.238128 n-d-713301-27 neutron-server[103438]: INFO neutron.db.securitygroups_db [None req-2a2ad179-0c78-4cb4-82ae-957b760cbbd3 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Project 2373ef24126c44b492884e181943f78a added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 22:39:25.243312 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2a2ad179-0c78-4cb4-82ae-957b760cbbd3 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:25.322118 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2a2ad179-0c78-4cb4-82ae-957b760cbbd3 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:25.329549 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2a2ad179-0c78-4cb4-82ae-957b760cbbd3 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-533467'] for security_group_rule, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:25.350751 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a2ad179-0c78-4cb4-82ae-957b760cbbd3 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f9083d6d-6ff6-40a4-9502-ca479e08e48c,revision_number=0']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:25.356535 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-2a2ad179-0c78-4cb4-82ae-957b760cbbd3 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:25.357723 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-2a2ad179-0c78-4cb4-82ae-957b760cbbd3 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1531532 Dec 09 22:39:25.523464 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-f40a513d-2d37-4f05-983c-a5b009de8a17 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2053090513&fields=id&tenant_id=2373ef24126c44b492884e181943f78a HTTP/1.1" status: 200 len: 267 time: 0.0469608 Dec 09 22:39:25.631989 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-063f304f-68f1-4857-97a1-102b123847b0 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:25.633455 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-063f304f-68f1-4857-97a1-102b123847b0 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/networks?id=838c65be-046c-4ff2-bdb7-ede24f82dbda HTTP/1.1" status: 200 len: 810 time: 0.1028447 Dec 09 22:39:25.648990 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-64ed7755-c894-4aec-806c-3034c760c3f3 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/quotas/2373ef24126c44b492884e181943f78a HTTP/1.1" status: 200 len: 375 time: 0.0095546 Dec 09 22:39:25.713219 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-42460e37-a74b-45c1-b43c-ff9a7ee2e814 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=2373ef24126c44b492884e181943f78a&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0588660 Dec 09 22:39:25.811719 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-9c48daed-6f53-4df0-bedf-b4fb87902beb service neutron] 10.222.0.13 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0854397 Dec 09 22:39:25.905481 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-c17ebd97-9ec5-48e5-9991-246fe7ad1fbb service neutron] 10.222.0.13 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0874832 Dec 09 22:39:25.998692 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] Sync routers for ids ['80a6d605-9a70-40a2-b9ed-008b8372f195'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:39:26.010227 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] Routers {'80a6d605-9a70-40a2-b9ed-008b8372f195'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:39:26.010837 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:39:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['80a6d605-9a70-40a2-b9ed-008b8372f195'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:26.077927 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-759bfdb2-3370-42f1-a282-c3d7f5b372ee req-39c30c36-420d-4197-b80b-3a68c2ca2dd6 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 210 time: 0.0295131 Dec 09 22:39:26.130329 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] Set router 80a6d605-9a70-40a2-b9ed-008b8372f195 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:39:26.343017 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '80a6d605-9a70-40a2-b9ed-008b8372f195', 'name': 'tempest-TestSnapshotPattern-1721515629-router', 'tenant_id': '3382e60685be4fbb8bdbbf26852a44e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.232'}], 'enable_snat': True}, 'gw_port_id': '0ec2516c-da47-46b1-ad5d-7e65df05ce36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:20Z', 'updated_at': '2021-12-09T22:39:22Z', 'revision_number': 4, 'project_id': '3382e60685be4fbb8bdbbf26852a44e1', 'gw_port': {'id': '0ec2516c-da47-46b1-ad5d-7e65df05ce36', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:3d:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80a6d605-9a70-40a2-b9ed-008b8372f195', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4373, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.232', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:20Z', 'updated_at': '2021-12-09T22:39:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'e5ca8248-b1c1-4803-82f9-5956a0b7bc3a', 'name': '', 'network_id': '31429689-de66-4d83-b930-16c23409a587', 'tenant_id': '3382e60685be4fbb8bdbbf26852a44e1', 'mac_address': 'fa:16:3e:0e:7f:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80a6d605-9a70-40a2-b9ed-008b8372f195', 'device_owner': 'network:router_interface', 'standard_attr_id': 4374, 'fixed_ips': [{'subnet_id': '9293130c-edee-4951-bdc3-4b9011e76435', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:22Z', 'updated_at': '2021-12-09T22:39:23Z', 'revision_number': 2, 'project_id': '3382e60685be4fbb8bdbbf26852a44e1', 'subnets': [{'id': '9293130c-edee-4951-bdc3-4b9011e76435', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:26.372606 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] Checking router: 80a6d605-9a70-40a2-b9ed-008b8372f195 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:39:26.372964 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] Updating router 80a6d605-9a70-40a2-b9ed-008b8372f195 port e5ca8248-b1c1-4803-82f9-5956a0b7bc3a binding host n-d-713301-27 {{(pid=103439) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 22:39:26.399252 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:26.677292 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] Publish callbacks [] for port, precommit_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:26.683624 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:26.757330 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a129f3f4-54f4-44cd-b789-a31346ce98f2 None None] Pushing event updated for resources: {'Port': ['ID=e5ca8248-b1c1-4803-82f9-5956a0b7bc3a,revision_number=3']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:26.790971 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] Attempting to bind port e5ca8248-b1c1-4803-82f9-5956a0b7bc3a on host n-d-713301-27 for vnic_type normal with profile {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:39:26.791322 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] Attempting to bind port e5ca8248-b1c1-4803-82f9-5956a0b7bc3a by drivers openvswitch,hyperv on host n-d-713301-27 at level 0 using segments [{'id': '71eac29e-4486-46a6-94a8-8db81722f2b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '31429689-de66-4d83-b930-16c23409a587'}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:39:26.791643 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] Attempting to bind port e5ca8248-b1c1-4803-82f9-5956a0b7bc3a on network 31429689-de66-4d83-b930-16c23409a587 {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:39:26.796891 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] Checking agent: {'id': '99982671-3c24-4747-bd57-dd2000ec27be', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'n-d-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 7, 39), 'started_at': datetime.datetime(2021, 12, 9, 21, 8, 9), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 39, 10), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'n-d-713301-27'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:39:26.797265 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] Checking segment: {'id': '71eac29e-4486-46a6-94a8-8db81722f2b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '31429689-de66-4d83-b930-16c23409a587'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103439) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:39:26.797663 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:26.798049 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] Bound using segment: {'id': '71eac29e-4486-46a6-94a8-8db81722f2b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '31429689-de66-4d83-b930-16c23409a587'} {{(pid=103439) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:39:26.798530 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.managers [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] Bound port: e5ca8248-b1c1-4803-82f9-5956a0b7bc3a, host: n-d-713301-27, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71eac29e-4486-46a6-94a8-8db81722f2b0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 135, 'network_id': '31429689-de66-4d83-b930-16c23409a587'}}] {{(pid=103439) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:39:26.798906 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:26.865695 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] For port e5ca8248-b1c1-4803-82f9-5956a0b7bc3a, host n-d-713301-27, cleared binding levels {{(pid=103439) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:39:26.868840 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] For port e5ca8248-b1c1-4803-82f9-5956a0b7bc3a, host n-d-713301-27, set binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e5ca8248-b1c1-4803-82f9-5956a0b7bc3a,segment=NetworkSegment(71eac29e-4486-46a6-94a8-8db81722f2b0),segment_id=71eac29e-4486-46a6-94a8-8db81722f2b0)] {{(pid=103439) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:39:26.873212 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:26.939986 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] Routers {'80a6d605-9a70-40a2-b9ed-008b8372f195'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:39:26.940625 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:39:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['80a6d605-9a70-40a2-b9ed-008b8372f195'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:27.140344 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-5f2e14b8-2589-4c88-ae50-b62e9745f4f3 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:27.141994 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-5f2e14b8-2589-4c88-ae50-b62e9745f4f3 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.10 "GET /v2.0/networks?id=838c65be-046c-4ff2-bdb7-ede24f82dbda HTTP/1.1" status: 200 len: 810 time: 0.1634245 Dec 09 22:39:27.164051 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a129f3f4-54f4-44cd-b789-a31346ce98f2 None None] Pushing event updated for resources: {'Port': ['ID=e5ca8248-b1c1-4803-82f9-5956a0b7bc3a,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:27.176275 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-eb3e8063-26f8-4de7-8898-dc067632c807 None None] Provisioning complete for port e5ca8248-b1c1-4803-82f9-5956a0b7bc3a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:27.176625 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb3e8063-26f8-4de7-8898-dc067632c807 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:27.213303 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-42ded501-020b-469d-a3b3-c9f67352b8da req-486f6656-5d11-4db3-bf64-795a79e23550 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 210 time: 0.0286531 Dec 09 22:39:27.220808 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-60ecc7db-0a55-4408-b4eb-b77d2e378958 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.10 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2373ef24126c44b492884e181943f78a HTTP/1.1" status: 200 len: 380 time: 0.0662646 Dec 09 22:39:27.235297 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-249e9810-74bb-484e-b813-54395c5e8aed tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Request body: {'port': {'device_id': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'admin_state_up': True, 'tenant_id': '2373ef24126c44b492884e181943f78a', 'security_groups': ['9b64c43a-5dd8-40a0-87a1-15e388a59102']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:39:27.271355 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] Set router 80a6d605-9a70-40a2-b9ed-008b8372f195 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:39:27.349493 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-249e9810-74bb-484e-b813-54395c5e8aed tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Made reservation on behalf of 2373ef24126c44b492884e181943f78a for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:39:27.353159 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-249e9810-74bb-484e-b813-54395c5e8aed tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:27.385108 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb3e8063-26f8-4de7-8898-dc067632c807 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:27.463616 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-eb3e8063-26f8-4de7-8898-dc067632c807 None None] For port e5ca8248-b1c1-4803-82f9-5956a0b7bc3a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e5ca8248-b1c1-4803-82f9-5956a0b7bc3a,segment=NetworkSegment(71eac29e-4486-46a6-94a8-8db81722f2b0),segment_id=71eac29e-4486-46a6-94a8-8db81722f2b0)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:39:27.471087 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-eb3e8063-26f8-4de7-8898-dc067632c807 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:27.484545 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-249e9810-74bb-484e-b813-54395c5e8aed tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Allocated IP 172.20.0.5 (838c65be-046c-4ff2-bdb7-ede24f82dbda/9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1/1c4bbb1a-bd7f-4f83-9a15-6c267e295116) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:39:27.547095 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb3e8063-26f8-4de7-8898-dc067632c807 None None] Pushing event updated for resources: {'Port': ['ID=e5ca8248-b1c1-4803-82f9-5956a0b7bc3a,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:27.565706 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '80a6d605-9a70-40a2-b9ed-008b8372f195', 'name': 'tempest-TestSnapshotPattern-1721515629-router', 'tenant_id': '3382e60685be4fbb8bdbbf26852a44e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.232'}], 'enable_snat': True}, 'gw_port_id': '0ec2516c-da47-46b1-ad5d-7e65df05ce36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:20Z', 'updated_at': '2021-12-09T22:39:22Z', 'revision_number': 4, 'project_id': '3382e60685be4fbb8bdbbf26852a44e1', 'gw_port': {'id': '0ec2516c-da47-46b1-ad5d-7e65df05ce36', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:3d:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80a6d605-9a70-40a2-b9ed-008b8372f195', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4373, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.232', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:20Z', 'updated_at': '2021-12-09T22:39:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'e5ca8248-b1c1-4803-82f9-5956a0b7bc3a', 'name': '', 'network_id': '31429689-de66-4d83-b930-16c23409a587', 'tenant_id': '3382e60685be4fbb8bdbbf26852a44e1', 'mac_address': 'fa:16:3e:0e:7f:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80a6d605-9a70-40a2-b9ed-008b8372f195', 'device_owner': 'network:router_interface', 'standard_attr_id': 4374, 'fixed_ips': [{'subnet_id': '9293130c-edee-4951-bdc3-4b9011e76435', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:22Z', 'updated_at': '2021-12-09T22:39:26Z', 'revision_number': 4, 'project_id': '3382e60685be4fbb8bdbbf26852a44e1', 'subnets': [{'id': '9293130c-edee-4951-bdc3-4b9011e76435', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:27.595324 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fac9f79b-5554-4cb1-9fe3-71eede0b18ed None None] The sync data for ids ['80a6d605-9a70-40a2-b9ed-008b8372f195'] in n-d-713301-27 is: [{'id': '80a6d605-9a70-40a2-b9ed-008b8372f195', 'name': 'tempest-TestSnapshotPattern-1721515629-router', 'tenant_id': '3382e60685be4fbb8bdbbf26852a44e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.232'}], 'enable_snat': True}, 'gw_port_id': '0ec2516c-da47-46b1-ad5d-7e65df05ce36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:20Z', 'updated_at': '2021-12-09T22:39:22Z', 'revision_number': 4, 'project_id': '3382e60685be4fbb8bdbbf26852a44e1', 'gw_port': {'id': '0ec2516c-da47-46b1-ad5d-7e65df05ce36', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:3d:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80a6d605-9a70-40a2-b9ed-008b8372f195', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4373, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.232', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:20Z', 'updated_at': '2021-12-09T22:39:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'e5ca8248-b1c1-4803-82f9-5956a0b7bc3a', 'name': '', 'network_id': '31429689-de66-4d83-b930-16c23409a587', 'tenant_id': '3382e60685be4fbb8bdbbf26852a44e1', 'mac_address': 'fa:16:3e:0e:7f:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '80a6d605-9a70-40a2-b9ed-008b8372f195', 'device_owner': 'network:router_interface', 'standard_attr_id': 4374, 'fixed_ips': [{'subnet_id': '9293130c-edee-4951-bdc3-4b9011e76435', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:22Z', 'updated_at': '2021-12-09T22:39:26Z', 'revision_number': 4, 'project_id': '3382e60685be4fbb8bdbbf26852a44e1', 'subnets': [{'id': '9293130c-edee-4951-bdc3-4b9011e76435', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:39:27.606333 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-87b5e4a5-8702-403c-b480-cc2eed5a8c6b None None] Provisioning complete for port e5ca8248-b1c1-4803-82f9-5956a0b7bc3a triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:27.606705 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-87b5e4a5-8702-403c-b480-cc2eed5a8c6b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:27.646341 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-249e9810-74bb-484e-b813-54395c5e8aed tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:27.937050 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:27.990813 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:28.085489 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-249e9810-74bb-484e-b813-54395c5e8aed tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:28.132325 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-249e9810-74bb-484e-b813-54395c5e8aed tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Network 838c65be-046c-4ff2-bdb7-ede24f82dbda is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:39:28.135360 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-249e9810-74bb-484e-b813-54395c5e8aed tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:39:28.141573 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-249e9810-74bb-484e-b813-54395c5e8aed tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:39:28.170264 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-249e9810-74bb-484e-b813-54395c5e8aed tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Pushing event updated for resources: {'Port': ['ID=1c4bbb1a-bd7f-4f83-9a15-6c267e295116,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:28.206234 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-249e9810-74bb-484e-b813-54395c5e8aed tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:28.207036 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-249e9810-74bb-484e-b813-54395c5e8aed tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:28.225059 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-249e9810-74bb-484e-b813-54395c5e8aed tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.10 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9973438 Dec 09 22:39:28.346177 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a203490-406f-4dd0-b4e6-028e21481fb1 req-80715e22-8f91-4c94-b97e-528bb3623f30 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:28.347056 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-61b93d7c-180b-4b95-a1a7-f3c6369a464d service neutron] Request body: {'port': {'device_id': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h2-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:39:28.347715 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2a203490-406f-4dd0-b4e6-028e21481fb1 req-80715e22-8f91-4c94-b97e-528bb3623f30 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 931 time: 0.0542920 Dec 09 22:39:28.415692 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-2a203490-406f-4dd0-b4e6-028e21481fb1 req-9a70749a-d145-4150-8488-d9c5d15ebc5d tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0616155 Dec 09 22:39:28.426532 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-61b93d7c-180b-4b95-a1a7-f3c6369a464d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:28.452048 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-9b805002-05f2-449f-b188-dab09f9536cb None None] Provisioning complete for port 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:28.453193 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9b805002-05f2-449f-b188-dab09f9536cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:28.490510 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-9b805002-05f2-449f-b188-dab09f9536cb None None] Port 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:39:28.708504 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-61b93d7c-180b-4b95-a1a7-f3c6369a464d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:39:28.715968 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-61b93d7c-180b-4b95-a1a7-f3c6369a464d service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:28.730697 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-61b93d7c-180b-4b95-a1a7-f3c6369a464d service neutron] Transition to ACTIVE for port object 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:39:28.736127 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-61b93d7c-180b-4b95-a1a7-f3c6369a464d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:28.788525 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61b93d7c-180b-4b95-a1a7-f3c6369a464d service neutron] Pushing event updated for resources: {'Port': ['ID=1c4bbb1a-bd7f-4f83-9a15-6c267e295116,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:28.862806 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-61b93d7c-180b-4b95-a1a7-f3c6369a464d service neutron] Attempting to bind port 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 on host n-h2-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:39:28.863150 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-61b93d7c-180b-4b95-a1a7-f3c6369a464d service neutron] Attempting to bind port 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 by drivers openvswitch,hyperv on host n-h2-713301-27 at level 0 using segments [{'id': '2eba823c-93ea-484b-ab73-5af9237c7643', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:39:28.863513 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-61b93d7c-180b-4b95-a1a7-f3c6369a464d service neutron] Attempting to bind port 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 on network 838c65be-046c-4ff2-bdb7-ede24f82dbda {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:39:28.868798 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-61b93d7c-180b-4b95-a1a7-f3c6369a464d service neutron] Port 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 on network 838c65be-046c-4ff2-bdb7-ede24f82dbda not bound, no agent of type Open vSwitch agent registered on host n-h2-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:39:28.868798 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-61b93d7c-180b-4b95-a1a7-f3c6369a464d service neutron] Attempting to bind port 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 on network 838c65be-046c-4ff2-bdb7-ede24f82dbda {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:39:28.874537 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-61b93d7c-180b-4b95-a1a7-f3c6369a464d service neutron] Checking agent: {'id': '2996daaa-98c9-4ce5-a636-b96fb7044b74', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h2-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 39, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:39:28.874885 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-61b93d7c-180b-4b95-a1a7-f3c6369a464d service neutron] Checking segment: {'id': '2eba823c-93ea-484b-ab73-5af9237c7643', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:39:28.875271 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-61b93d7c-180b-4b95-a1a7-f3c6369a464d service neutron] Bound using segment: {'id': '2eba823c-93ea-484b-ab73-5af9237c7643', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:39:28.875799 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-61b93d7c-180b-4b95-a1a7-f3c6369a464d service neutron] Bound port: 1c4bbb1a-bd7f-4f83-9a15-6c267e295116, host: n-h2-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2eba823c-93ea-484b-ab73-5af9237c7643', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:39:28.876166 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-61b93d7c-180b-4b95-a1a7-f3c6369a464d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:28.945863 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e5ca8248-b1c1-4803-82f9-5956a0b7bc3a up at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:39:28.947336 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-61b93d7c-180b-4b95-a1a7-f3c6369a464d service neutron] For port 1c4bbb1a-bd7f-4f83-9a15-6c267e295116, host n-h2-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:39:28.950580 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-61b93d7c-180b-4b95-a1a7-f3c6369a464d service neutron] For port 1c4bbb1a-bd7f-4f83-9a15-6c267e295116, host n-h2-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1c4bbb1a-bd7f-4f83-9a15-6c267e295116,segment=NetworkSegment(2eba823c-93ea-484b-ab73-5af9237c7643),segment_id=2eba823c-93ea-484b-ab73-5af9237c7643)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:39:28.958036 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-61b93d7c-180b-4b95-a1a7-f3c6369a464d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:28.991091 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-61b93d7c-180b-4b95-a1a7-f3c6369a464d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:28.991631 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-61b93d7c-180b-4b95-a1a7-f3c6369a464d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:28.993158 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-61b93d7c-180b-4b95-a1a7-f3c6369a464d service neutron] 10.222.0.10 "PUT /v2.0/ports/1c4bbb1a-bd7f-4f83-9a15-6c267e295116 HTTP/1.1" status: 200 len: 1092 time: 0.7594080 Dec 09 22:39:28.993628 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'tag': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:39:28.995945 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bddf6d95-dad8-48e4-9d0e-691bb4fdd2e2" -d '{"events": [{"name": "network-changed", "server_uuid": "b4853f31-7021-4de4-b857-0d1715fc7a87", "tag": "1c4bbb1a-bd7f-4f83-9a15-6c267e295116"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:39:28.996408 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Provisioning complete for port e5ca8248-b1c1-4803-82f9-5956a0b7bc3a triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:28.997165 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:29.070977 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61b93d7c-180b-4b95-a1a7-f3c6369a464d service neutron] Pushing event updated for resources: {'Port': ['ID=1c4bbb1a-bd7f-4f83-9a15-6c267e295116,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:29.107163 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-c9afdee8-1a20-4f5e-9600-51664423c0d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:29.108945 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-c9afdee8-1a20-4f5e-9600-51664423c0d5 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=2373ef24126c44b492884e181943f78a&device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 1095 time: 0.0749187 Dec 09 22:39:29.168178 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:39:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-561286b6-e68e-4596-bdf9-e0c745e7e9f0 x-openstack-request-id: req-561286b6-e68e-4596-bdf9-e0c745e7e9f0 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:39:29.168883 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b4853f31-7021-4de4-b857-0d1715fc7a87", "tag": "1c4bbb1a-bd7f-4f83-9a15-6c267e295116", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:39:29.168883 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-561286b6-e68e-4596-bdf9-e0c745e7e9f0 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:39:29.169110 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'tag': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116', 'status': 'completed', 'code': 200} Dec 09 22:39:29.170681 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-de255193-2453-4ff2-abee-20d880afcdf1 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=1c4bbb1a-bd7f-4f83-9a15-6c267e295116 HTTP/1.1" status: 200 len: 217 time: 0.0520093 Dec 09 22:39:29.221034 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-24a262ff-bdce-42ad-91e2-84e0ea6f8ff2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:29.222473 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-24a262ff-bdce-42ad-91e2-84e0ea6f8ff2 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1 HTTP/1.1" status: 200 len: 849 time: 0.0450320 Dec 09 22:39:29.267228 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-22b09a8f-bdd1-4dda-a9ce-177e09981c45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:29.268792 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-22b09a8f-bdd1-4dda-a9ce-177e09981c45 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=838c65be-046c-4ff2-bdb7-ede24f82dbda&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0395305 Dec 09 22:39:29.374317 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-3833fc54-6f02-4605-b03a-a25d00c75ece service neutron] 10.222.0.10 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0929530 Dec 09 22:39:29.477820 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-46f39b90-f565-4673-913d-dc9f3c295d14 req-54043438-8ac3-456f-a93e-366f983ed33f service neutron] 10.222.0.10 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0951433 Dec 09 22:39:29.549815 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef82cd75-b797-4925-957f-ae59e184378a req-f35b016c-fd4b-4694-9f80-933cab97555b tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:29.551325 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef82cd75-b797-4925-957f-ae59e184378a req-f35b016c-fd4b-4694-9f80-933cab97555b tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 943 time: 0.0535603 Dec 09 22:39:29.568955 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bddf6d95-dad8-48e4-9d0e-691bb4fdd2e2 req-982f7f8b-d7c0-407b-97f2-c03be4fac8bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:29.570499 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bddf6d95-dad8-48e4-9d0e-691bb4fdd2e2 req-982f7f8b-d7c0-407b-97f2-c03be4fac8bd service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=2373ef24126c44b492884e181943f78a&device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 1095 time: 0.0422900 Dec 09 22:39:29.602798 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ef82cd75-b797-4925-957f-ae59e184378a req-30c950e9-396d-4ee6-801f-f7ba47dfbbc1 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449698 Dec 09 22:39:29.660696 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bddf6d95-dad8-48e4-9d0e-691bb4fdd2e2 req-b559f542-e139-4b19-9066-53029c968686 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:29.662204 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bddf6d95-dad8-48e4-9d0e-691bb4fdd2e2 req-b559f542-e139-4b19-9066-53029c968686 service neutron] 10.222.0.10 "GET /v2.0/networks?id=838c65be-046c-4ff2-bdb7-ede24f82dbda HTTP/1.1" status: 200 len: 911 time: 0.0847731 Dec 09 22:39:29.708796 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bddf6d95-dad8-48e4-9d0e-691bb4fdd2e2 req-79a070e9-3ac7-479a-9b61-8e1d9034757b service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=1c4bbb1a-bd7f-4f83-9a15-6c267e295116 HTTP/1.1" status: 200 len: 217 time: 0.0383177 Dec 09 22:39:29.759358 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bddf6d95-dad8-48e4-9d0e-691bb4fdd2e2 req-a6d13449-1a61-46fe-b9de-107c55502374 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:29.760797 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bddf6d95-dad8-48e4-9d0e-691bb4fdd2e2 req-a6d13449-1a61-46fe-b9de-107c55502374 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1 HTTP/1.1" status: 200 len: 849 time: 0.0447183 Dec 09 22:39:29.812432 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bddf6d95-dad8-48e4-9d0e-691bb4fdd2e2 req-d202e817-19af-42ce-a2a4-28548a855362 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:29.814001 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bddf6d95-dad8-48e4-9d0e-691bb4fdd2e2 req-d202e817-19af-42ce-a2a4-28548a855362 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=838c65be-046c-4ff2-bdb7-ede24f82dbda&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0441675 Dec 09 22:39:29.917032 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bddf6d95-dad8-48e4-9d0e-691bb4fdd2e2 req-7a043ee0-02c0-4141-aae6-6948cbb9f7cd service neutron] 10.222.0.10 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0943246 Dec 09 22:39:30.015261 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-bddf6d95-dad8-48e4-9d0e-691bb4fdd2e2 req-eab214cc-967c-49eb-9072-1159afd27c05 service neutron] 10.222.0.10 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0896416 Dec 09 22:39:30.733333 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-006d2ede-980a-453d-8573-9be957fe8d01 req-5466617e-bb6c-45f2-b1ca-ee1671315ab6 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:30.734853 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-006d2ede-980a-453d-8573-9be957fe8d01 req-5466617e-bb6c-45f2-b1ca-ee1671315ab6 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 943 time: 0.0515952 Dec 09 22:39:30.790519 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-006d2ede-980a-453d-8573-9be957fe8d01 req-8538846c-1ef7-46f5-b914-a20125c742c7 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0495386 Dec 09 22:39:31.928260 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d30c4744-6435-4d3a-9d65-e4e259f4bbec req-d37105a2-a81e-4208-b82c-729688a3b915 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:31.929750 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d30c4744-6435-4d3a-9d65-e4e259f4bbec req-d37105a2-a81e-4208-b82c-729688a3b915 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 943 time: 0.0616639 Dec 09 22:39:31.984237 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d30c4744-6435-4d3a-9d65-e4e259f4bbec req-27b82451-d7f8-41b6-a0f3-fdf44d7812b3 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457411 Dec 09 22:39:32.685129 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:39:32.795717 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1c4bbb1a-bd7f-4f83-9a15-6c267e295116, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1c4bbb1a-bd7f-4f83-9a15-6c267e295116,segment=NetworkSegment(2eba823c-93ea-484b-ab73-5af9237c7643),segment_id=2eba823c-93ea-484b-ab73-5af9237c7643)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:39:32.815102 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'port_id': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116', 'mac_address': 'fa:16:3e:a0:41:13', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 148, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:39:32.855014 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:32.868118 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:39:32.889072 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1c4bbb1a-bd7f-4f83-9a15-6c267e295116, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1c4bbb1a-bd7f-4f83-9a15-6c267e295116,segment=NetworkSegment(2eba823c-93ea-484b-ab73-5af9237c7643),segment_id=2eba823c-93ea-484b-ab73-5af9237c7643)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:39:32.894860 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:32.946552 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=1c4bbb1a-bd7f-4f83-9a15-6c267e295116,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:33.107283 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4ee5f35-b4b9-4e9a-a130-de3ffb76f603 req-0b015721-44c8-41fd-9c56-161d2fc9a954 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:33.108802 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4ee5f35-b4b9-4e9a-a130-de3ffb76f603 req-0b015721-44c8-41fd-9c56-161d2fc9a954 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 944 time: 0.0526078 Dec 09 22:39:33.124672 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-439759d1-33f1-4cef-a5f2-7af95a356935 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:33.128767 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['1c4bbb1a-bd7f-4f83-9a15-6c267e295116'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:39:33.161011 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f4ee5f35-b4b9-4e9a-a130-de3ffb76f603 req-846ec852-0798-47b9-8baf-2588b2d66599 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458567 Dec 09 22:39:34.290114 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51d72e78-93db-4ca7-a2fc-f941fae9dd30 req-3a5ed8b0-ea44-4ea0-9e38-af2e319bfa10 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:34.291674 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51d72e78-93db-4ca7-a2fc-f941fae9dd30 req-3a5ed8b0-ea44-4ea0-9e38-af2e319bfa10 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 944 time: 0.0563183 Dec 09 22:39:34.659017 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-51d72e78-93db-4ca7-a2fc-f941fae9dd30 req-9115db30-cf7a-4a97-bb8c-32dfe194eb5b tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3612387 Dec 09 22:39:34.692685 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:39:34.754478 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning for port 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:39:34.759617 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:39:34.760020 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:34.847893 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:34.871067 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:39:34.873382 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-14bccbea-4b74-43d2-980d-4e2271afa4d7" -d '{"events": [{"server_uuid": "b4853f31-7021-4de4-b857-0d1715fc7a87", "name": "network-vif-plugged", "status": "completed", "tag": "1c4bbb1a-bd7f-4f83-9a15-6c267e295116"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:39:34.889325 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1c4bbb1a-bd7f-4f83-9a15-6c267e295116, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1c4bbb1a-bd7f-4f83-9a15-6c267e295116,segment=NetworkSegment(2eba823c-93ea-484b-ab73-5af9237c7643),segment_id=2eba823c-93ea-484b-ab73-5af9237c7643)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:39:34.894912 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:34.917557 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:39:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8590eba2-46a4-45f4-8c32-2fc7e529cbcf x-openstack-request-id: req-8590eba2-46a4-45f4-8c32-2fc7e529cbcf {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:39:34.917856 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b4853f31-7021-4de4-b857-0d1715fc7a87", "name": "network-vif-plugged", "status": "completed", "tag": "1c4bbb1a-bd7f-4f83-9a15-6c267e295116", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:39:34.918110 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-8590eba2-46a4-45f4-8c32-2fc7e529cbcf {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:39:34.918502 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116', 'code': 200} Dec 09 22:39:34.944216 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=1c4bbb1a-bd7f-4f83-9a15-6c267e295116,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:35.011375 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52e9cc4-8cce-4d9c-afc9-146b289de689 req-8b6044c9-d8f5-44df-b381-49107f0ce677 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:35.012920 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a52e9cc4-8cce-4d9c-afc9-146b289de689 req-8b6044c9-d8f5-44df-b381-49107f0ce677 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 1097 time: 0.0412092 Dec 09 22:39:35.061567 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-a52e9cc4-8cce-4d9c-afc9-146b289de689 req-48a86968-137e-42e2-b0a8-e331eeb2cba6 service neutron] 10.222.0.10 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399811 Dec 09 22:39:35.715194 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b8ba8887-dad4-45e0-8e27-bf6f80dc79eb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:35.795016 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8baf60b7-e50f-4ea3-ad5e-2ef23f8dc821 req-73b45ae8-3ca8-48de-882e-26d5bd653012 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:35.796522 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8baf60b7-e50f-4ea3-ad5e-2ef23f8dc821 req-73b45ae8-3ca8-48de-882e-26d5bd653012 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 945 time: 0.0529382 Dec 09 22:39:35.848733 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8baf60b7-e50f-4ea3-ad5e-2ef23f8dc821 req-94e1f73d-6cb9-4824-a46c-60b9c67aade1 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458677 Dec 09 22:39:36.970365 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61d349a6-6aff-4dd0-9c3d-b7fe0ee154a0 req-7734fa18-c818-46cb-8d98-aa55940d570a tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:36.971943 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-61d349a6-6aff-4dd0-9c3d-b7fe0ee154a0 req-7734fa18-c818-46cb-8d98-aa55940d570a tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 945 time: 0.0506890 Dec 09 22:39:36.983559 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:37.025991 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-61d349a6-6aff-4dd0-9c3d-b7fe0ee154a0 req-78510226-0bb3-45ab-bfd8-fc1885f47a7d tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0480034 Dec 09 22:39:37.144688 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2ba9134-22b0-4c41-96a1-c95f36278312 req-4ac39799-19c8-4718-abd2-bbed1489077c tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:37.146153 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c2ba9134-22b0-4c41-96a1-c95f36278312 req-4ac39799-19c8-4718-abd2-bbed1489077c tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 945 time: 0.0522583 Dec 09 22:39:37.199887 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-c2ba9134-22b0-4c41-96a1-c95f36278312 req-9c8beb2f-1865-4c32-bb62-0e87095be82d tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447748 Dec 09 22:39:37.222760 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35912) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:37.310731 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d20054c6-7a41-4d7d-8c20-988a17dd8b25 tempest-TestSnapshotPattern-1709520249 tempest-TestSnapshotPattern-1709520249-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:37.312298 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-d20054c6-7a41-4d7d-8c20-988a17dd8b25 tempest-TestSnapshotPattern-1709520249 tempest-TestSnapshotPattern-1709520249-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 1092 time: 0.0885689 Dec 09 22:39:37.315709 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 35916) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:39:37.320041 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-52e452bd-b9b4-47a1-b09a-db81f7165ddb tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'fixed_ip_address': '172.20.0.5'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:39:37.344402 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-52e452bd-b9b4-47a1-b09a-db81f7165ddb tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:37.454559 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-52e452bd-b9b4-47a1-b09a-db81f7165ddb tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:37.556167 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-52e452bd-b9b4-47a1-b09a-db81f7165ddb tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Allocated IP 172.25.3.246 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/6f317b45-3c10-4580-93ea-89c097dcecaf) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:39:37.662159 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-52e452bd-b9b4-47a1-b09a-db81f7165ddb tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:37.698075 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-52e452bd-b9b4-47a1-b09a-db81f7165ddb tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:37.736096 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-52e452bd-b9b4-47a1-b09a-db81f7165ddb tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:39:37.739092 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-52e452bd-b9b4-47a1-b09a-db81f7165ddb tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:39:37.744943 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52e452bd-b9b4-47a1-b09a-db81f7165ddb tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:39:37.770694 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52e452bd-b9b4-47a1-b09a-db81f7165ddb tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Pushing event updated for resources: {'Port': ['ID=6f317b45-3c10-4580-93ea-89c097dcecaf,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:38.125262 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-52e452bd-b9b4-47a1-b09a-db81f7165ddb tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:38.199693 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-52e452bd-b9b4-47a1-b09a-db81f7165ddb tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:38.322120 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:38.361981 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-52e452bd-b9b4-47a1-b09a-db81f7165ddb tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:38.367783 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-52e452bd-b9b4-47a1-b09a-db81f7165ddb tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:38.440850 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52e452bd-b9b4-47a1-b09a-db81f7165ddb tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Pushing event updated for resources: {'Port': ['ID=6f317b45-3c10-4580-93ea-89c097dcecaf,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:39:38.453967 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-52e452bd-b9b4-47a1-b09a-db81f7165ddb tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:38.560582 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-52e452bd-b9b4-47a1-b09a-db81f7165ddb tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Floating IP c0d66b7f-e021-45bb-af5e-0cd30aaed5de associated. External IP: 172.25.3.246, port: 1c4bbb1a-bd7f-4f83-9a15-6c267e295116. Dec 09 22:39:38.770849 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-52e452bd-b9b4-47a1-b09a-db81f7165ddb tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Router a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:39:38.882253 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-52e452bd-b9b4-47a1-b09a-db81f7165ddb tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:39:38.893335 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-098bef3c-c4cd-4c23-980f-78ae80bb6566 None None] Sync routers for ids ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:39:38.902201 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-52e452bd-b9b4-47a1-b09a-db81f7165ddb tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:38.904218 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-098bef3c-c4cd-4c23-980f-78ae80bb6566 None None] Routers {'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:39:38.904897 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-098bef3c-c4cd-4c23-980f-78ae80bb6566 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:39:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:38.930423 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-52e452bd-b9b4-47a1-b09a-db81f7165ddb tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.6135802 Dec 09 22:39:38.931276 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'tag': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:39:38.933875 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c2cabfef-0bdd-441f-9259-1acb4f49ee04" -d '{"events": [{"name": "network-changed", "server_uuid": "b4853f31-7021-4de4-b857-0d1715fc7a87", "tag": "1c4bbb1a-bd7f-4f83-9a15-6c267e295116"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:39:38.974586 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:39:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-85c5791a-2b0a-4a79-bdf4-8f9fe12f514b x-openstack-request-id: req-85c5791a-2b0a-4a79-bdf4-8f9fe12f514b {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:39:38.975001 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b4853f31-7021-4de4-b857-0d1715fc7a87", "tag": "1c4bbb1a-bd7f-4f83-9a15-6c267e295116", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:39:38.975285 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-85c5791a-2b0a-4a79-bdf4-8f9fe12f514b {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:39:38.975727 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'tag': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116', 'status': 'completed', 'code': 200} Dec 09 22:39:39.009968 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-098bef3c-c4cd-4c23-980f-78ae80bb6566 None None] Set router a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:39:39.036633 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2cabfef-0bdd-441f-9259-1acb4f49ee04 req-ead127ec-42a0-48ba-89a7-15ebddc40ce4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:39.038102 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c2cabfef-0bdd-441f-9259-1acb4f49ee04 req-ead127ec-42a0-48ba-89a7-15ebddc40ce4 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=2373ef24126c44b492884e181943f78a&device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 1097 time: 0.0400186 Dec 09 22:39:39.131031 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2cabfef-0bdd-441f-9259-1acb4f49ee04 req-74cb7922-ca7a-4b6e-b16b-200c754a699d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:39.132593 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c2cabfef-0bdd-441f-9259-1acb4f49ee04 req-74cb7922-ca7a-4b6e-b16b-200c754a699d service neutron] 10.222.0.10 "GET /v2.0/networks?id=838c65be-046c-4ff2-bdb7-ede24f82dbda HTTP/1.1" status: 200 len: 911 time: 0.0873322 Dec 09 22:39:39.199828 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c2cabfef-0bdd-441f-9259-1acb4f49ee04 req-3a701c3d-9e58-4ec2-8e41-77d1c07d2e67 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=1c4bbb1a-bd7f-4f83-9a15-6c267e295116 HTTP/1.1" status: 200 len: 999 time: 0.0601506 Dec 09 22:39:39.236342 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-098bef3c-c4cd-4c23-980f-78ae80bb6566 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'name': 'tempest-TestSnapshotPattern-2034929229-router', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141'}], 'enable_snat': True}, 'gw_port_id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '2373ef24126c44b492884e181943f78a', 'gw_port': {'id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:7a:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4361, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'c0d66b7f-e021-45bb-af5e-0cd30aaed5de', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'floating_ip_address': '172.25.3.246', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'port_id': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 4386, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'mac_address': 'fa:16:3e:a0:41:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:39:37Z', 'updated_at': '2021-12-09T22:39:37Z', 'revision_number': 0, 'project_id': '2373ef24126c44b492884e181943f78a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'bfa73955-6300-4749-8500-d4c22f8e54be', 'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'mac_address': 'fa:16:3e:e8:dd:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_interface', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:17Z', 'updated_at': '2021-12-09T22:39:22Z', 'revision_number': 5, 'project_id': '2373ef24126c44b492884e181943f78a', 'subnets': [{'id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:39.255983 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2cabfef-0bdd-441f-9259-1acb4f49ee04 req-95440d32-9971-4f47-8be1-cdbff68d2258 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:39.257619 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c2cabfef-0bdd-441f-9259-1acb4f49ee04 req-95440d32-9971-4f47-8be1-cdbff68d2258 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1 HTTP/1.1" status: 200 len: 849 time: 0.0505748 Dec 09 22:39:39.307329 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2cabfef-0bdd-441f-9259-1acb4f49ee04 req-0fc6387f-7f11-4bae-b421-06a58afa81df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:39:39.308846 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c2cabfef-0bdd-441f-9259-1acb4f49ee04 req-0fc6387f-7f11-4bae-b421-06a58afa81df service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=838c65be-046c-4ff2-bdb7-ede24f82dbda&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0441835 Dec 09 22:39:39.363868 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-098bef3c-c4cd-4c23-980f-78ae80bb6566 None None] Checking router: a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:39:39.372644 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-098bef3c-c4cd-4c23-980f-78ae80bb6566 None None] Routers {'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:39:39.373239 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-098bef3c-c4cd-4c23-980f-78ae80bb6566 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:39:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:39.405419 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c2cabfef-0bdd-441f-9259-1acb4f49ee04 req-2232b8a8-7f58-40ae-b62f-c52b1a8e5722 service neutron] 10.222.0.10 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0881870 Dec 09 22:39:39.479247 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-098bef3c-c4cd-4c23-980f-78ae80bb6566 None None] Set router a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:39:39.500453 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-c2cabfef-0bdd-441f-9259-1acb4f49ee04 req-7da4824f-3749-45cd-b87f-2f18a94c417d service neutron] 10.222.0.10 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0875893 Dec 09 22:39:39.718506 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-098bef3c-c4cd-4c23-980f-78ae80bb6566 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'name': 'tempest-TestSnapshotPattern-2034929229-router', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141'}], 'enable_snat': True}, 'gw_port_id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '2373ef24126c44b492884e181943f78a', 'gw_port': {'id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:7a:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4361, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'c0d66b7f-e021-45bb-af5e-0cd30aaed5de', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'floating_ip_address': '172.25.3.246', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'port_id': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 4386, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'mac_address': 'fa:16:3e:a0:41:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:39:37Z', 'updated_at': '2021-12-09T22:39:37Z', 'revision_number': 0, 'project_id': '2373ef24126c44b492884e181943f78a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'bfa73955-6300-4749-8500-d4c22f8e54be', 'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'mac_address': 'fa:16:3e:e8:dd:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_interface', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:17Z', 'updated_at': '2021-12-09T22:39:22Z', 'revision_number': 5, 'project_id': '2373ef24126c44b492884e181943f78a', 'subnets': [{'id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:39:39.722331 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:39.748316 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-098bef3c-c4cd-4c23-980f-78ae80bb6566 None None] The sync data for ids ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'] in n-d-713301-27 is: [{'id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'name': 'tempest-TestSnapshotPattern-2034929229-router', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141'}], 'enable_snat': True}, 'gw_port_id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '2373ef24126c44b492884e181943f78a', 'gw_port': {'id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:7a:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4361, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'c0d66b7f-e021-45bb-af5e-0cd30aaed5de', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'floating_ip_address': '172.25.3.246', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'port_id': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 4386, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'mac_address': 'fa:16:3e:a0:41:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:39:37Z', 'updated_at': '2021-12-09T22:39:37Z', 'revision_number': 0, 'project_id': '2373ef24126c44b492884e181943f78a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'bfa73955-6300-4749-8500-d4c22f8e54be', 'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'mac_address': 'fa:16:3e:e8:dd:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_interface', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:17Z', 'updated_at': '2021-12-09T22:39:22Z', 'revision_number': 5, 'project_id': '2373ef24126c44b492884e181943f78a', 'subnets': [{'id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:39:39.954782 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a48ea436-86b5-4a0c-956c-d245fb02ff85 None None] New status for floating IP c0d66b7f-e021-45bb-af5e-0cd30aaed5de: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:39:52.371514 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:39:57.938349 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:39:57.994723 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:40:03.135983 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b935ee85-945c-4066-a80e-562bb628a59e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:40:05.711642 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-740ebbe2-41d8-4325-9379-99455d8ac4e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:40:06.992906 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:40:08.334803 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:40:09.720331 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:40:21.369125 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-05d25757-c603-4bb5-86f1-5e37cb0a4b71 req-3f1063a2-30a4-40f9-b52c-0f489e09c89e service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=b4853f31-7021-4de4-b857-0d1715fc7a87&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0434885 Dec 09 22:40:21.459460 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05d25757-c603-4bb5-86f1-5e37cb0a4b71 req-bb63927e-5690-44ac-8caf-b63d5f7b7b72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:40:21.461648 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-05d25757-c603-4bb5-86f1-5e37cb0a4b71 req-bb63927e-5690-44ac-8caf-b63d5f7b7b72 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=2373ef24126c44b492884e181943f78a&device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 1097 time: 0.0480106 Dec 09 22:40:21.585399 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05d25757-c603-4bb5-86f1-5e37cb0a4b71 req-34882cf4-e043-4ee8-ab47-e9c25017d929 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:40:21.586923 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-05d25757-c603-4bb5-86f1-5e37cb0a4b71 req-34882cf4-e043-4ee8-ab47-e9c25017d929 service neutron] 10.222.0.10 "GET /v2.0/networks?id=838c65be-046c-4ff2-bdb7-ede24f82dbda HTTP/1.1" status: 200 len: 911 time: 0.1007354 Dec 09 22:40:21.653487 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-05d25757-c603-4bb5-86f1-5e37cb0a4b71 req-57deffb7-b68e-44cd-868f-d17892690bb4 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=1c4bbb1a-bd7f-4f83-9a15-6c267e295116 HTTP/1.1" status: 200 len: 1001 time: 0.0587416 Dec 09 22:40:21.710600 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05d25757-c603-4bb5-86f1-5e37cb0a4b71 req-c6f49e0a-1753-48fa-96b4-077d77516d7f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:40:21.712085 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-05d25757-c603-4bb5-86f1-5e37cb0a4b71 req-c6f49e0a-1753-48fa-96b4-077d77516d7f service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1 HTTP/1.1" status: 200 len: 849 time: 0.0507584 Dec 09 22:40:21.763715 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05d25757-c603-4bb5-86f1-5e37cb0a4b71 req-4b9bb895-766e-49ce-91ba-6ce54637a838 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:40:21.765304 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-05d25757-c603-4bb5-86f1-5e37cb0a4b71 req-4b9bb895-766e-49ce-91ba-6ce54637a838 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=838c65be-046c-4ff2-bdb7-ede24f82dbda&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0461316 Dec 09 22:40:21.865024 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-05d25757-c603-4bb5-86f1-5e37cb0a4b71 req-7b91b07c-f0b8-4948-b8e1-0301916953e5 service neutron] 10.222.0.10 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0918858 Dec 09 22:40:21.960712 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-05d25757-c603-4bb5-86f1-5e37cb0a4b71 req-f006ead0-d17c-48b4-8ebb-419ebb27a7bf service neutron] 10.222.0.10 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0879350 Dec 09 22:40:27.929161 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:40:28.003133 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:40:29.376080 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:40:33.129369 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0ae9b386-54d7-4797-99e4-ccbe434e56dd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:40:35.712017 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-50fe596d-88d7-41a8-8c77-5f6b9e8b1703 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:40:37.001244 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:40:38.330874 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:40:39.726447 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:40:57.928161 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:40:58.002973 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:03.130234 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5286385b-485f-43cd-b7d0-9c696a24ab25 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:05.710874 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-21cab32b-e02b-422b-8af1-e36e9e8d926e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:06.378597 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:41:06.994889 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:08.332282 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:09.716432 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:22.394335 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ebe30eb1-1fd6-4dfe-8a3b-840376befa01 req-6c3dd0ba-c28f-4436-8c27-0834ee8559ec service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=b4853f31-7021-4de4-b857-0d1715fc7a87&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0462813 Dec 09 22:41:22.483391 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe30eb1-1fd6-4dfe-8a3b-840376befa01 req-a8a0047b-c4ac-4003-b754-8bca2bf09022 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:41:22.485017 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ebe30eb1-1fd6-4dfe-8a3b-840376befa01 req-a8a0047b-c4ac-4003-b754-8bca2bf09022 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=2373ef24126c44b492884e181943f78a&device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 1097 time: 0.0450563 Dec 09 22:41:22.604724 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe30eb1-1fd6-4dfe-8a3b-840376befa01 req-f1f316a1-746b-472c-b51a-c282dd937844 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:41:22.606257 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ebe30eb1-1fd6-4dfe-8a3b-840376befa01 req-f1f316a1-746b-472c-b51a-c282dd937844 service neutron] 10.222.0.10 "GET /v2.0/networks?id=838c65be-046c-4ff2-bdb7-ede24f82dbda HTTP/1.1" status: 200 len: 911 time: 0.1013227 Dec 09 22:41:22.675865 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ebe30eb1-1fd6-4dfe-8a3b-840376befa01 req-c9ef8e9c-e207-42ae-bb07-783b07382ded service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=1c4bbb1a-bd7f-4f83-9a15-6c267e295116 HTTP/1.1" status: 200 len: 1001 time: 0.0621681 Dec 09 22:41:22.725905 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe30eb1-1fd6-4dfe-8a3b-840376befa01 req-f77f6bad-4026-4f34-8bfa-4998281b77f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:41:22.727375 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ebe30eb1-1fd6-4dfe-8a3b-840376befa01 req-f77f6bad-4026-4f34-8bfa-4998281b77f9 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1 HTTP/1.1" status: 200 len: 849 time: 0.0441117 Dec 09 22:41:22.775734 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe30eb1-1fd6-4dfe-8a3b-840376befa01 req-84b4d9c6-011c-4ea3-a2b1-69cbb31700cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:41:22.777331 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ebe30eb1-1fd6-4dfe-8a3b-840376befa01 req-84b4d9c6-011c-4ea3-a2b1-69cbb31700cb service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=838c65be-046c-4ff2-bdb7-ede24f82dbda&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0427198 Dec 09 22:41:22.880695 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ebe30eb1-1fd6-4dfe-8a3b-840376befa01 req-e02731d4-2644-414d-b88d-ccd0b4fc79db service neutron] 10.222.0.10 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0962822 Dec 09 22:41:22.975985 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-ebe30eb1-1fd6-4dfe-8a3b-840376befa01 req-1713926e-9eff-448b-b71d-2fdda367bfc2 service neutron] 10.222.0.10 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0874026 Dec 09 22:41:27.957969 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:28.001917 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:33.127996 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7a662af9-092a-426b-9128-a26f72b920fe None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:35.711837 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-311f8ff0-fc46-416f-b963-aa2d6079ea82 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:37.002343 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:37.261976 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 details requested by agent hyperv_n-h2-713301-27 with host n-h2-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:41:37.364401 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1c4bbb1a-bd7f-4f83-9a15-6c267e295116, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1c4bbb1a-bd7f-4f83-9a15-6c267e295116,segment=NetworkSegment(2eba823c-93ea-484b-ab73-5af9237c7643),segment_id=2eba823c-93ea-484b-ab73-5af9237c7643)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:41:37.377002 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Returning: {'device': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'port_id': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116', 'mac_address': 'fa:16:3e:a0:41:13', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 148, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:41:37.422138 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:37.436918 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:41:37.463317 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1c4bbb1a-bd7f-4f83-9a15-6c267e295116, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1c4bbb1a-bd7f-4f83-9a15-6c267e295116,segment=NetworkSegment(2eba823c-93ea-484b-ab73-5af9237c7643),segment_id=2eba823c-93ea-484b-ab73-5af9237c7643)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:41:37.469060 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:37.533085 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=1c4bbb1a-bd7f-4f83-9a15-6c267e295116,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:41:37.546808 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] get_ports_and_sgs() called for port_ids ['1c4bbb1a-bd7f-4f83-9a15-6c267e295116'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:41:37.550878 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:37.551231 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:37.551602 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:37.551943 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:37.552279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:37.552610 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:37.552941 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:37.553302 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:37.553594 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:37.553919 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:37.554241 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:37.554564 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:37.554885 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:38.336826 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:39.274678 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 up at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:41:39.334585 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Provisioning complete for port 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:41:39.334972 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:39.421383 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:39.446729 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:41:39.449013 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-68111e0e-c340-40d3-b6d8-be37b429e7ac" -d '{"events": [{"server_uuid": "b4853f31-7021-4de4-b857-0d1715fc7a87", "name": "network-vif-plugged", "status": "completed", "tag": "1c4bbb1a-bd7f-4f83-9a15-6c267e295116"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:41:39.464509 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1c4bbb1a-bd7f-4f83-9a15-6c267e295116, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1c4bbb1a-bd7f-4f83-9a15-6c267e295116,segment=NetworkSegment(2eba823c-93ea-484b-ab73-5af9237c7643),segment_id=2eba823c-93ea-484b-ab73-5af9237c7643)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:41:39.491627 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:39.550487 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=1c4bbb1a-bd7f-4f83-9a15-6c267e295116,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:41:39.604419 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:41:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3656cfd2-ce9b-4afc-b9a9-b54e17dec556 x-openstack-request-id: req-3656cfd2-ce9b-4afc-b9a9-b54e17dec556 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:41:39.604951 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b4853f31-7021-4de4-b857-0d1715fc7a87", "name": "network-vif-plugged", "status": "completed", "tag": "1c4bbb1a-bd7f-4f83-9a15-6c267e295116", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:41:39.605518 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-3656cfd2-ce9b-4afc-b9a9-b54e17dec556 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:41:39.606103 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116', 'code': 200} Dec 09 22:41:39.711665 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:43.378379 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:41:47.114487 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-e6898681-6ef8-4f48-bfbd-357f56c12f6a tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2053090513&fields=id&tenant_id=2373ef24126c44b492884e181943f78a HTTP/1.1" status: 200 len: 267 time: 0.0474739 Dec 09 22:41:47.228558 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-591292d7-8a37-488a-8e3e-0b361e479aec tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:41:47.230009 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-591292d7-8a37-488a-8e3e-0b361e479aec tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/networks?id=838c65be-046c-4ff2-bdb7-ede24f82dbda HTTP/1.1" status: 200 len: 810 time: 0.1072028 Dec 09 22:41:47.248510 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-b26c7342-d122-42b5-8a4a-b86c37559da1 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/quotas/2373ef24126c44b492884e181943f78a HTTP/1.1" status: 200 len: 375 time: 0.0094814 Dec 09 22:41:47.314107 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-f71804ce-1fd5-4f96-a595-d55cf48d11ea tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?tenant_id=2373ef24126c44b492884e181943f78a&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0589406 Dec 09 22:41:47.466712 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-50189f4e-1bf0-4f11-af24-9c9ba2fc37f8 service neutron] 10.222.0.13 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1352620 Dec 09 22:41:47.563352 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-0d4355f4-2f5d-405e-acd8-ecacb5774e93 service neutron] 10.222.0.13 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0875232 Dec 09 22:41:48.767872 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-fef819e7-a85f-462b-8fa2-76bc73adcd99 req-1270eb7d-5e81-44e2-b613-e61c90e16965 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 210 time: 0.0288918 Dec 09 22:41:49.769572 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-aaf35b74-8f8a-48ce-8919-de305c60f056 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:41:49.771078 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-aaf35b74-8f8a-48ce-8919-de305c60f056 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.31 "GET /v2.0/networks?id=838c65be-046c-4ff2-bdb7-ede24f82dbda HTTP/1.1" status: 200 len: 810 time: 0.1131241 Dec 09 22:41:49.846336 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-201bd8eb-db31-4deb-81e9-ca839d559092 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.31 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=2373ef24126c44b492884e181943f78a HTTP/1.1" status: 200 len: 380 time: 0.0647941 Dec 09 22:41:49.856401 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Request body: {'port': {'device_id': 'ebb00d32-ca5d-4a5d-923e-75d9299fc918', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'admin_state_up': True, 'tenant_id': '2373ef24126c44b492884e181943f78a', 'security_groups': ['9b64c43a-5dd8-40a0-87a1-15e388a59102']}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:41:49.869255 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-82773f67-2465-4f57-9d67-19e063c19dde req-6230e8a5-9bf5-42a5-9e80-a08bbb591b3b tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 210 time: 0.0298700 Dec 09 22:41:49.970104 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Made reservation on behalf of 2373ef24126c44b492884e181943f78a for: {'port': 1} {{(pid=103437) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 22:41:49.973801 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:50.140381 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_common [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Allocated IP 172.20.0.9 (838c65be-046c-4ff2-bdb7-ede24f82dbda/9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1/2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f) {{(pid=103437) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:41:50.336450 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for port, precommit_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:50.373564 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_create {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:50.422604 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Network 838c65be-046c-4ff2-bdb7-ede24f82dbda is already hosted by enough agents. {{(pid=103437) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:41:50.425979 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.base_scheduler [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Resources bound (agent type, host, resource id): {{(pid=103437) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:41:50.436135 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Received port after_create {{(pid=103437) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:41:50.477673 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Pushing event updated for resources: {'Port': ['ID=2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f,revision_number=1']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:41:50.493076 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:50.493426 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:50.493760 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:50.494097 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:50.494435 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:50.494771 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:50.495096 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:50.495424 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:50.495799 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:50.496098 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:50.496424 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:50.496768 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:50.497099 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:41:50.540240 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:41:50.540912 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:50.560057 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-df3cd1de-a8fd-41ef-ab0e-2ace41ad4331 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.31 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7071407 Dec 09 22:41:50.752920 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-81735e31-b9a0-4101-b055-940543293cf3 None None] Provisioning complete for port 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f triggered by entity DHCP. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:41:50.753524 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-81735e31-b9a0-4101-b055-940543293cf3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:50.789321 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-81735e31-b9a0-4101-b055-940543293cf3 None None] Port 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f cannot update to ACTIVE because it is not bound. {{(pid=103439) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 22:41:50.997102 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-217eaf3e-6c2e-45fd-b555-454e17f9f1b3 req-44af4f81-91bd-43e5-aa13-0e113bc6e523 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:41:50.998599 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-217eaf3e-6c2e-45fd-b555-454e17f9f1b3 req-44af4f81-91bd-43e5-aa13-0e113bc6e523 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 931 time: 0.0507567 Dec 09 22:41:51.055286 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-217eaf3e-6c2e-45fd-b555-454e17f9f1b3 req-2eab8d00-0461-4744-9188-faea21ec3a6f tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0499477 Dec 09 22:41:51.298147 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:41:51.378953 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:51.403789 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:41:51.406050 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6c750332-9f5f-4d3f-b69a-b7f3204df55c" -d '{"events": [{"server_uuid": "b4853f31-7021-4de4-b857-0d1715fc7a87", "name": "network-vif-unplugged", "status": "completed", "tag": "1c4bbb1a-bd7f-4f83-9a15-6c267e295116"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:41:51.419180 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] For port 1c4bbb1a-bd7f-4f83-9a15-6c267e295116, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1c4bbb1a-bd7f-4f83-9a15-6c267e295116,segment=NetworkSegment(2eba823c-93ea-484b-ab73-5af9237c7643),segment_id=2eba823c-93ea-484b-ab73-5af9237c7643)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:41:51.424810 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:51.451886 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 22:41:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-54ae132f-a982-4a6a-bf49-3e5ce89aeace x-openstack-request-id: req-54ae132f-a982-4a6a-bf49-3e5ce89aeace {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:41:51.452098 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b4853f31-7021-4de4-b857-0d1715fc7a87", "name": "network-vif-unplugged", "status": "completed", "tag": "1c4bbb1a-bd7f-4f83-9a15-6c267e295116", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:41:51.452378 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-54ae132f-a982-4a6a-bf49-3e5ce89aeace {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:41:51.452870 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116', 'code': 200} Dec 09 22:41:51.479279 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Pushing event updated for resources: {'Port': ['ID=1c4bbb1a-bd7f-4f83-9a15-6c267e295116,revision_number=8']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:41:52.178429 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d542743b-3f9a-443f-b5b2-20ce30796136 req-f973f483-b798-4187-9ace-a7af122d4220 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:41:52.180115 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d542743b-3f9a-443f-b5b2-20ce30796136 req-f973f483-b798-4187-9ace-a7af122d4220 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 931 time: 0.0513587 Dec 09 22:41:52.233480 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-d542743b-3f9a-443f-b5b2-20ce30796136 req-3ff70613-f1a9-4b0a-811d-9c6b7db2716c tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465970 Dec 09 22:41:53.355086 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25537f18-2c73-481c-82c2-ced91916ab5a req-08693e18-1d34-438d-bf38-f5bf38f9804b tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:41:53.356708 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25537f18-2c73-481c-82c2-ced91916ab5a req-08693e18-1d34-438d-bf38-f5bf38f9804b tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 931 time: 0.0527036 Dec 09 22:41:53.408791 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-25537f18-2c73-481c-82c2-ced91916ab5a req-078d1c56-2ead-4445-b2de-c961c9453cab tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458395 Dec 09 22:41:54.532378 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-057547a0-2bb3-4530-90e1-74390c0434de req-34172a57-6f2e-4b43-89c7-8d6fa80cf891 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:41:54.533994 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-057547a0-2bb3-4530-90e1-74390c0434de req-34172a57-6f2e-4b43-89c7-8d6fa80cf891 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 931 time: 0.0538690 Dec 09 22:41:54.588607 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-057547a0-2bb3-4530-90e1-74390c0434de req-77d66397-de60-497d-96fc-b784c2fc0465 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483499 Dec 09 22:41:55.715650 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e35f571-2ec3-4ef3-b636-5a08f44f475d req-7688d69b-7c11-49e2-a251-2da8b2448dd5 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:41:55.717370 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e35f571-2ec3-4ef3-b636-5a08f44f475d req-7688d69b-7c11-49e2-a251-2da8b2448dd5 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 931 time: 0.0509217 Dec 09 22:41:55.770815 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-7e35f571-2ec3-4ef3-b636-5a08f44f475d req-7d9ce1e7-e8d1-454d-b955-51a95d78be8f tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455029 Dec 09 22:41:56.897613 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0e5fabf-2038-411a-a85b-40f87e499905 req-e8a88925-580b-46bc-8597-6d869cf05433 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:41:56.899166 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b0e5fabf-2038-411a-a85b-40f87e499905 req-e8a88925-580b-46bc-8597-6d869cf05433 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 931 time: 0.0564606 Dec 09 22:41:56.952180 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b0e5fabf-2038-411a-a85b-40f87e499905 req-b7f5f9bf-6742-4f84-8281-a1eb41d37c06 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468998 Dec 09 22:41:57.946983 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:58.049638 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:41:58.082574 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45d1acd4-3fab-4c62-9f4b-db401beb1f53 req-91e00acc-d190-416d-ae6f-d97d9ee96f79 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:41:58.084354 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-45d1acd4-3fab-4c62-9f4b-db401beb1f53 req-91e00acc-d190-416d-ae6f-d97d9ee96f79 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 931 time: 0.0525136 Dec 09 22:41:58.137479 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-45d1acd4-3fab-4c62-9f4b-db401beb1f53 req-fcbda16e-501e-4306-a2bd-ca36480a7e7a tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461721 Dec 09 22:41:59.272198 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f21212b3-bb58-49fe-8a41-fc5ca707f1f6 req-525a288a-20ed-4fe4-9ba4-3f0f949dbbc2 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:41:59.273734 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f21212b3-bb58-49fe-8a41-fc5ca707f1f6 req-525a288a-20ed-4fe4-9ba4-3f0f949dbbc2 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 931 time: 0.0498571 Dec 09 22:41:59.330390 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f21212b3-bb58-49fe-8a41-fc5ca707f1f6 req-cc92b9da-ca9a-4712-8baf-6095e6f7f72b tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0503967 Dec 09 22:41:59.859646 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.v2.base [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-70e7ae21-1fd6-433e-b1c8-1fed8c10a322 service neutron] Request body: {'port': {'device_id': 'ebb00d32-ca5d-4a5d-923e-75d9299fc918', 'device_owner': 'compute:nova', 'binding:host_id': 'n-h1-713301-27'}} {{(pid=103437) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:41:59.924868 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-70e7ae21-1fd6-433e-b1c8-1fed8c10a322 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:00.181953 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-70e7ae21-1fd6-433e-b1c8-1fed8c10a322 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f {{(pid=103437) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:42:00.189883 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-70e7ae21-1fd6-433e-b1c8-1fed8c10a322 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:00.201833 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.provisioning_blocks [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-70e7ae21-1fd6-433e-b1c8-1fed8c10a322 service neutron] Transition to ACTIVE for port object 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f will not be triggered until provisioned by entity L2. {{(pid=103437) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 22:42:00.209043 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-70e7ae21-1fd6-433e-b1c8-1fed8c10a322 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:00.258081 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70e7ae21-1fd6-433e-b1c8-1fed8c10a322 service neutron] Pushing event updated for resources: {'Port': ['ID=2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f,revision_number=2']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:42:00.330039 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-70e7ae21-1fd6-433e-b1c8-1fed8c10a322 service neutron] Attempting to bind port 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f on host n-h1-713301-27 for vnic_type normal with profile {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 22:42:00.330377 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-70e7ae21-1fd6-433e-b1c8-1fed8c10a322 service neutron] Attempting to bind port 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f by drivers openvswitch,hyperv on host n-h1-713301-27 at level 0 using segments [{'id': '2eba823c-93ea-484b-ab73-5af9237c7643', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda'}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 22:42:00.330739 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-70e7ae21-1fd6-433e-b1c8-1fed8c10a322 service neutron] Attempting to bind port 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f on network 838c65be-046c-4ff2-bdb7-ede24f82dbda {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:42:00.335704 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-70e7ae21-1fd6-433e-b1c8-1fed8c10a322 service neutron] Port 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f on network 838c65be-046c-4ff2-bdb7-ede24f82dbda not bound, no agent of type Open vSwitch agent registered on host n-h1-713301-27 {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 22:42:00.336024 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-70e7ae21-1fd6-433e-b1c8-1fed8c10a322 service neutron] Attempting to bind port 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f on network 838c65be-046c-4ff2-bdb7-ede24f82dbda {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 22:42:00.341198 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-70e7ae21-1fd6-433e-b1c8-1fed8c10a322 service neutron] Checking agent: {'id': '59b4db69-804b-4fd7-a499-e606071917f7', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'n-h1-713301-27', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'started_at': datetime.datetime(2021, 12, 9, 21, 14, 57), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 22, 41, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 22:42:00.341541 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-70e7ae21-1fd6-433e-b1c8-1fed8c10a322 service neutron] Checking segment: {'id': '2eba823c-93ea-484b-ab73-5af9237c7643', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103437) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 22:42:00.341926 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-70e7ae21-1fd6-433e-b1c8-1fed8c10a322 service neutron] Bound using segment: {'id': '2eba823c-93ea-484b-ab73-5af9237c7643', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda'} {{(pid=103437) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 22:42:00.342355 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.managers [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-70e7ae21-1fd6-433e-b1c8-1fed8c10a322 service neutron] Bound port: 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f, host: n-h1-713301-27, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2eba823c-93ea-484b-ab73-5af9237c7643', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 148, 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda'}}] {{(pid=103437) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 22:42:00.342716 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-70e7ae21-1fd6-433e-b1c8-1fed8c10a322 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:00.418213 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-70e7ae21-1fd6-433e-b1c8-1fed8c10a322 service neutron] For port 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f, host n-h1-713301-27, cleared binding levels {{(pid=103437) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 22:42:00.421535 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-70e7ae21-1fd6-433e-b1c8-1fed8c10a322 service neutron] For port 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f, host n-h1-713301-27, set binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f,segment=NetworkSegment(2eba823c-93ea-484b-ab73-5af9237c7643),segment_id=2eba823c-93ea-484b-ab73-5af9237c7643)] {{(pid=103437) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 22:42:00.426766 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-70e7ae21-1fd6-433e-b1c8-1fed8c10a322 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8621611'] for port, after_update {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:00.451295 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84247587-8378-4cd1-b287-0c82370cfb2b req-2634f632-48a3-478f-b2b2-9ef2b905cce4 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:00.452918 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84247587-8378-4cd1-b287-0c82370cfb2b req-2634f632-48a3-478f-b2b2-9ef2b905cce4 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 943 time: 0.0493307 Dec 09 22:42:00.463759 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-70e7ae21-1fd6-433e-b1c8-1fed8c10a322 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:00.464394 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-70e7ae21-1fd6-433e-b1c8-1fed8c10a322 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:00.465845 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-70e7ae21-1fd6-433e-b1c8-1fed8c10a322 service neutron] 10.222.0.31 "PUT /v2.0/ports/2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f HTTP/1.1" status: 200 len: 1092 time: 0.6589131 Dec 09 22:42:00.466298 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ebb00d32-ca5d-4a5d-923e-75d9299fc918', 'tag': '2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:42:00.468622 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-655047bd-4338-4eb3-97bc-d1cec4f6918a" -d '{"events": [{"name": "network-changed", "server_uuid": "ebb00d32-ca5d-4a5d-923e-75d9299fc918", "tag": "2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:42:00.498927 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70e7ae21-1fd6-433e-b1c8-1fed8c10a322 service neutron] Pushing event updated for resources: {'Port': ['ID=2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f,revision_number=3']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:42:00.522646 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-84247587-8378-4cd1-b287-0c82370cfb2b req-ee017245-5061-4187-8cba-7e926ec8a2cb tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0565677 Dec 09 22:42:00.575508 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-8d5bb745-5282-4b43-a83c-7003be5afdc7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:00.577253 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-8d5bb745-5282-4b43-a83c-7003be5afdc7 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2373ef24126c44b492884e181943f78a&device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 1095 time: 0.0575061 Dec 09 22:42:00.579113 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:42:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4e5ed229-2c5a-44f4-98d9-292655780c7c x-openstack-request-id: req-4e5ed229-2c5a-44f4-98d9-292655780c7c {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:42:00.579471 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ebb00d32-ca5d-4a5d-923e-75d9299fc918", "tag": "2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:42:00.579815 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-4e5ed229-2c5a-44f4-98d9-292655780c7c {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:42:00.580277 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ebb00d32-ca5d-4a5d-923e-75d9299fc918', 'tag': '2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f', 'status': 'completed', 'code': 200} Dec 09 22:42:00.626381 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-f9551acd-275c-4c44-8dab-5337eb812baa service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f HTTP/1.1" status: 200 len: 217 time: 0.0402842 Dec 09 22:42:00.676571 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-5c9179dc-5555-4f9a-bb2b-b4ecb03656e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:00.678176 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-5c9179dc-5555-4f9a-bb2b-b4ecb03656e8 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1 HTTP/1.1" status: 200 len: 849 time: 0.0450699 Dec 09 22:42:00.726743 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-c671906d-9c1b-4d59-8203-0de13e1f33e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:00.728210 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-c671906d-9c1b-4d59-8203-0de13e1f33e3 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=838c65be-046c-4ff2-bdb7-ede24f82dbda&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0421500 Dec 09 22:42:00.831424 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-6ad74288-02b9-4329-a6dd-437a8d68d708 service neutron] 10.222.0.31 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0962870 Dec 09 22:42:00.933234 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-41ea8dba-7eb0-4ff7-abc9-fc8033fcd777 req-ec2f495b-dfa4-47dc-beb4-86ba7a662d39 service neutron] 10.222.0.31 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0944810 Dec 09 22:42:01.028010 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-655047bd-4338-4eb3-97bc-d1cec4f6918a req-29910c48-1e82-4cc5-81b7-870951e22b13 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:01.029450 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-655047bd-4338-4eb3-97bc-d1cec4f6918a req-29910c48-1e82-4cc5-81b7-870951e22b13 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2373ef24126c44b492884e181943f78a&device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 1095 time: 0.0437732 Dec 09 22:42:01.134112 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-655047bd-4338-4eb3-97bc-d1cec4f6918a req-12ff7c91-b8e8-45fa-90c3-2a7056577c3a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:01.135733 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-655047bd-4338-4eb3-97bc-d1cec4f6918a req-12ff7c91-b8e8-45fa-90c3-2a7056577c3a service neutron] 10.222.0.31 "GET /v2.0/networks?id=838c65be-046c-4ff2-bdb7-ede24f82dbda HTTP/1.1" status: 200 len: 911 time: 0.0995636 Dec 09 22:42:01.181277 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-655047bd-4338-4eb3-97bc-d1cec4f6918a req-309a9947-8ac2-48df-859a-8e3c965bde7d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f HTTP/1.1" status: 200 len: 217 time: 0.0339017 Dec 09 22:42:01.242082 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-655047bd-4338-4eb3-97bc-d1cec4f6918a req-f4953ecc-a98b-4548-9af1-e602beec187b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:01.244510 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-655047bd-4338-4eb3-97bc-d1cec4f6918a req-f4953ecc-a98b-4548-9af1-e602beec187b service neutron] 10.222.0.31 "GET /v2.0/subnets?id=9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1 HTTP/1.1" status: 200 len: 849 time: 0.0547214 Dec 09 22:42:01.294800 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-655047bd-4338-4eb3-97bc-d1cec4f6918a req-cff30f41-77ee-404e-bb4d-08ab7ed0c572 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:01.296232 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-655047bd-4338-4eb3-97bc-d1cec4f6918a req-cff30f41-77ee-404e-bb4d-08ab7ed0c572 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=838c65be-046c-4ff2-bdb7-ede24f82dbda&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0435779 Dec 09 22:42:01.401747 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-655047bd-4338-4eb3-97bc-d1cec4f6918a req-58cc432c-0683-474c-98af-85638cdc93fc service neutron] 10.222.0.31 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0970318 Dec 09 22:42:01.497608 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-655047bd-4338-4eb3-97bc-d1cec4f6918a req-86013627-7e56-4abc-b2f9-0d3db799f774 service neutron] 10.222.0.31 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0876000 Dec 09 22:42:01.651284 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b418c24a-435d-4908-bde6-5a18f3aa54f4 req-3a700e3e-3f6a-4d3a-9167-ae397246e968 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:01.652787 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b418c24a-435d-4908-bde6-5a18f3aa54f4 req-3a700e3e-3f6a-4d3a-9167-ae397246e968 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 943 time: 0.0508647 Dec 09 22:42:01.701479 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-b418c24a-435d-4908-bde6-5a18f3aa54f4 req-0b4057c0-0f94-4fc2-925f-a843a71b2e0b tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426495 Dec 09 22:42:02.840967 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f96d386-9d7b-48aa-a6f2-bce8ef15db15 req-dee77c7f-b1f8-4b56-92a5-d795b225ad47 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:02.842498 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f96d386-9d7b-48aa-a6f2-bce8ef15db15 req-dee77c7f-b1f8-4b56-92a5-d795b225ad47 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 943 time: 0.0583024 Dec 09 22:42:02.896865 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6f96d386-9d7b-48aa-a6f2-bce8ef15db15 req-48d8b7ec-418c-4a0d-8c16-2175439db80b tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481799 Dec 09 22:42:03.129011 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-650660a3-8232-4817-852e-4c5df2dd8b71 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:04.038383 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6762611-48be-45e0-ade7-0510b6164256 req-bc282da9-ed41-4ae3-a442-514821df2dd1 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:04.040210 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6762611-48be-45e0-ade7-0510b6164256 req-bc282da9-ed41-4ae3-a442-514821df2dd1 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 943 time: 0.0529704 Dec 09 22:42:04.105263 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-f6762611-48be-45e0-ade7-0510b6164256 req-9b770d37-737c-4824-894a-129062df971f tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0559561 Dec 09 22:42:04.142202 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:42:04.423072 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f,segment=NetworkSegment(2eba823c-93ea-484b-ab73-5af9237c7643),segment_id=2eba823c-93ea-484b-ab73-5af9237c7643)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:42:04.436752 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'port_id': '2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f', 'mac_address': 'fa:16:3e:3d:88:79', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 148, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:42:04.473477 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:04.494055 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:42:04.520980 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f,segment=NetworkSegment(2eba823c-93ea-484b-ab73-5af9237c7643),segment_id=2eba823c-93ea-484b-ab73-5af9237c7643)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:42:04.528221 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:04.578148 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f,revision_number=4']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:42:04.765668 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:42:05.229733 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0be9e320-5353-44d5-8d1a-67e3857263dc req-6d3d66cd-839c-4508-896c-ff4c467bdbc3 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:05.231208 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0be9e320-5353-44d5-8d1a-67e3857263dc req-6d3d66cd-839c-4508-896c-ff4c467bdbc3 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 944 time: 0.0546007 Dec 09 22:42:05.285409 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-0be9e320-5353-44d5-8d1a-67e3857263dc req-414da72c-a36e-4562-84f2-9506e6183d83 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481005 Dec 09 22:42:05.710224 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c2b8b6a4-5dda-47c9-bcfa-945a4208b39b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:06.156366 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:42:06.221341 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning for port 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f completed by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 22:42:06.226788 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:42:06.227300 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:06.318633 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:06.342757 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ebb00d32-ca5d-4a5d-923e-75d9299fc918', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:42:06.345191 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c8e08b7e-3b83-4f71-a75f-0cc87128de74" -d '{"events": [{"server_uuid": "ebb00d32-ca5d-4a5d-923e-75d9299fc918", "name": "network-vif-plugged", "status": "completed", "tag": "2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:42:06.358133 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f,segment=NetworkSegment(2eba823c-93ea-484b-ab73-5af9237c7643),segment_id=2eba823c-93ea-484b-ab73-5af9237c7643)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:42:06.364144 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:06.405940 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d8ccc99-62d1-4e82-ae7d-25277bd24c20 req-6a07d35e-112e-4dd2-ac43-ad6ab1e9bd1e tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:06.407533 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d8ccc99-62d1-4e82-ae7d-25277bd24c20 req-6a07d35e-112e-4dd2-ac43-ad6ab1e9bd1e tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 945 time: 0.0510688 Dec 09 22:42:06.411133 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f,revision_number=5']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:42:06.458754 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-6d8ccc99-62d1-4e82-ae7d-25277bd24c20 req-7791e157-46de-46ed-9f0f-2932676df313 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444841 Dec 09 22:42:06.501667 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:42:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5364165d-656f-4933-9b78-03bb0266ca18 x-openstack-request-id: req-5364165d-656f-4933-9b78-03bb0266ca18 {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:42:06.501931 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ebb00d32-ca5d-4a5d-923e-75d9299fc918", "name": "network-vif-plugged", "status": "completed", "tag": "2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:42:06.502383 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-5364165d-656f-4933-9b78-03bb0266ca18 {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:42:06.502798 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ebb00d32-ca5d-4a5d-923e-75d9299fc918', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f', 'code': 200} Dec 09 22:42:06.603316 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd710461-8d5e-42e7-b12a-102ab540b5f2 req-732e309c-4e50-461d-81e7-f78629245d85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:06.605061 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cd710461-8d5e-42e7-b12a-102ab540b5f2 req-732e309c-4e50-461d-81e7-f78629245d85 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 1097 time: 0.0426996 Dec 09 22:42:06.662386 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-cd710461-8d5e-42e7-b12a-102ab540b5f2 req-99482b77-22b2-4611-978b-b9ce3affe3b8 service neutron] 10.222.0.31 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0489683 Dec 09 22:42:06.995291 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:07.593728 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5e7c482-8872-417c-90d3-4830f989add7 req-f80ba973-648d-4b9e-b20c-605a6e8d5042 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:07.595403 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5e7c482-8872-417c-90d3-4830f989add7 req-f80ba973-648d-4b9e-b20c-605a6e8d5042 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 945 time: 0.0574005 Dec 09 22:42:07.657895 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-a5e7c482-8872-417c-90d3-4830f989add7 req-bc955bbf-8ce7-4f47-bd56-6e49e8b5885a tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0552609 Dec 09 22:42:08.344842 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:08.800125 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95092580-a820-4183-a06f-8116056cdd6a req-cee076d0-3f38-4c1b-a87f-ee0e44a3cfd2 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:08.801677 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-95092580-a820-4183-a06f-8116056cdd6a req-cee076d0-3f38-4c1b-a87f-ee0e44a3cfd2 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 945 time: 0.0549209 Dec 09 22:42:08.855677 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-95092580-a820-4183-a06f-8116056cdd6a req-e78c5fa2-7bd5-432f-9596-0245f6139b0a tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442505 Dec 09 22:42:08.973481 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccbb7330-3659-47cc-a8b3-1d007cbf0c8a req-40faabb6-4040-44fe-b226-47b6e0074b4f tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:08.974936 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ccbb7330-3659-47cc-a8b3-1d007cbf0c8a req-40faabb6-4040-44fe-b226-47b6e0074b4f tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 945 time: 0.0515995 Dec 09 22:42:09.025278 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-ccbb7330-3659-47cc-a8b3-1d007cbf0c8a req-152b4ab7-2660-4d37-8519-b6b9ef7e8a46 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435073 Dec 09 22:42:09.047605 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36178) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:42:09.093211 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e7a741b-ce2d-47f7-8683-f33d8cf88a71 tempest-TestSnapshotPattern-1709520249 tempest-TestSnapshotPattern-1709520249-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:09.094750 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-8e7a741b-ce2d-47f7-8683-f33d8cf88a71 tempest-TestSnapshotPattern-1709520249 tempest-TestSnapshotPattern-1709520249-project-admin] 10.222.0.13 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 1092 time: 0.0461743 Dec 09 22:42:09.099126 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36180) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:42:09.103547 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.v2.base [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Request body: {'floatingip': {'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'port_id': '2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'fixed_ip_address': '172.20.0.9'}} {{(pid=103438) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 22:42:09.129715 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for floatingip, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:09.228421 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:09.348205 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.db_base_plugin_common [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Allocated IP 172.25.3.204 (97925a19-460a-4476-8208-41db134b6c83/a8035714-7788-4046-9aac-8912c882c128/c1ce881e-56e3-4ee3-957e-c597c2290e4b) {{(pid=103438) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 22:42:09.454007 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for port, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:09.488011 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8731649715204', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:09.530289 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Network 97925a19-460a-4476-8208-41db134b6c83 is already hosted by enough agents. {{(pid=103438) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 22:42:09.537628 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.base_scheduler [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Resources bound (agent type, host, resource id): {{(pid=103438) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 22:42:09.539931 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Pushing event updated for resources: {'Port': ['ID=c1ce881e-56e3-4ee3-957e-c597c2290e4b,revision_number=1']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:42:09.542062 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Received port after_create {{(pid=103438) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 22:42:09.566334 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:42:09.566683 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:42:09.567029 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:42:09.567367 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:42:09.567737 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:42:09.568070 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:42:09.568401 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:42:09.568751 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:42:09.569075 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:42:09.569401 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:42:09.569751 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:42:09.570067 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:42:09.570386 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:42:09.717027 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:09.924215 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:10.003106 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:10.153907 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for port, precommit_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:10.159400 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8811821'] for port, after_update {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:10.225428 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Pushing event updated for resources: {'Port': ['ID=c1ce881e-56e3-4ee3-957e-c597c2290e4b,revision_number=2']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:42:10.239342 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-640349'] for floatingip, after_create {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:10.663688 n-d-713301-27 neutron-server[103438]: INFO neutron.db.l3_db [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Floating IP 570aa5b3-340f-4592-bbdb-6d442e0d7c99 associated. External IP: 172.25.3.204, port: 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f. Dec 09 22:42:10.883019 n-d-713301-27 neutron-server[103438]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Router a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103438) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:42:10.995534 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103438) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:42:11.005715 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4110b21-4c7e-4c81-93e2-c68269f94a09 None None] Sync routers for ids ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:42:11.015972 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:11.016844 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4110b21-4c7e-4c81-93e2-c68269f94a09 None None] Routers {'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:42:11.017447 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c4110b21-4c7e-4c81-93e2-c68269f94a09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:42:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:42:11.043611 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-9988b6bb-1458-470a-ab65-c2cd68956681 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.9434197 Dec 09 22:42:11.044197 n-d-713301-27 neutron-server[103438]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ebb00d32-ca5d-4a5d-923e-75d9299fc918', 'tag': '2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f'}] {{(pid=103438) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:42:11.046450 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}eb4e4ae5482cb224b183bfac0ede6820022051fdb1f33a9917a166c89c254da1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-484c749e-01fa-422c-9c97-59b38616fa00" -d '{"events": [{"name": "network-changed", "server_uuid": "ebb00d32-ca5d-4a5d-923e-75d9299fc918", "tag": "2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f"}]}' {{(pid=103438) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:42:11.122546 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-c4110b21-4c7e-4c81-93e2-c68269f94a09 None None] Set router a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:42:11.145390 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:42:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-af6d098d-7c22-483b-8f61-70dd986cfdb3 x-openstack-request-id: req-af6d098d-7c22-483b-8f61-70dd986cfdb3 {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:42:11.145692 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ebb00d32-ca5d-4a5d-923e-75d9299fc918", "tag": "2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f", "status": "completed", "code": 200}]} {{(pid=103438) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:42:11.145949 n-d-713301-27 neutron-server[103438]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-af6d098d-7c22-483b-8f61-70dd986cfdb3 {{(pid=103438) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:42:11.146357 n-d-713301-27 neutron-server[103438]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ebb00d32-ca5d-4a5d-923e-75d9299fc918', 'tag': '2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f', 'status': 'completed', 'code': 200} Dec 09 22:42:11.208901 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-484c749e-01fa-422c-9c97-59b38616fa00 req-7e29dae8-eb45-44f4-be83-6aed2db8e341 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:11.210511 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-484c749e-01fa-422c-9c97-59b38616fa00 req-7e29dae8-eb45-44f4-be83-6aed2db8e341 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2373ef24126c44b492884e181943f78a&device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 1097 time: 0.0417311 Dec 09 22:42:11.301853 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-484c749e-01fa-422c-9c97-59b38616fa00 req-fcc8272f-7039-4a15-a319-41428cdc441e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:11.303368 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-484c749e-01fa-422c-9c97-59b38616fa00 req-fcc8272f-7039-4a15-a319-41428cdc441e service neutron] 10.222.0.31 "GET /v2.0/networks?id=838c65be-046c-4ff2-bdb7-ede24f82dbda HTTP/1.1" status: 200 len: 911 time: 0.0858595 Dec 09 22:42:11.355541 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c4110b21-4c7e-4c81-93e2-c68269f94a09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'name': 'tempest-TestSnapshotPattern-2034929229-router', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141'}], 'enable_snat': True}, 'gw_port_id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '2373ef24126c44b492884e181943f78a', 'gw_port': {'id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:7a:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4361, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '570aa5b3-340f-4592-bbdb-6d442e0d7c99', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'floating_ip_address': '172.25.3.204', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'port_id': '2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 4389, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'mac_address': 'fa:16:3e:3d:88:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ebb00d32-ca5d-4a5d-923e-75d9299fc918', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:42:09Z', 'updated_at': '2021-12-09T22:42:09Z', 'revision_number': 0, 'project_id': '2373ef24126c44b492884e181943f78a', 'fixed_ip_address_scope': None}, {'id': 'c0d66b7f-e021-45bb-af5e-0cd30aaed5de', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'floating_ip_address': '172.25.3.246', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'port_id': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 4386, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'mac_address': 'fa:16:3e:a0:41:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:39:37Z', 'updated_at': '2021-12-09T22:39:40Z', 'revision_number': 1, 'project_id': '2373ef24126c44b492884e181943f78a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'bfa73955-6300-4749-8500-d4c22f8e54be', 'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'mac_address': 'fa:16:3e:e8:dd:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_interface', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:17Z', 'updated_at': '2021-12-09T22:39:22Z', 'revision_number': 5, 'project_id': '2373ef24126c44b492884e181943f78a', 'subnets': [{'id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:42:11.373093 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-484c749e-01fa-422c-9c97-59b38616fa00 req-08ba1163-86ba-4364-9b2a-c52678d80317 service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f HTTP/1.1" status: 200 len: 999 time: 0.0620632 Dec 09 22:42:11.382063 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4110b21-4c7e-4c81-93e2-c68269f94a09 None None] Checking router: a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:42:11.391599 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c4110b21-4c7e-4c81-93e2-c68269f94a09 None None] Routers {'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:42:11.392215 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c4110b21-4c7e-4c81-93e2-c68269f94a09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:42:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:42:11.421977 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-484c749e-01fa-422c-9c97-59b38616fa00 req-dff95fa1-7a0f-431a-bc57-0b730552bfe1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:11.423605 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-484c749e-01fa-422c-9c97-59b38616fa00 req-dff95fa1-7a0f-431a-bc57-0b730552bfe1 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1 HTTP/1.1" status: 200 len: 849 time: 0.0438929 Dec 09 22:42:11.475002 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-484c749e-01fa-422c-9c97-59b38616fa00 req-8c161f27-48bf-4462-844c-4a9a3eccf952 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:11.476567 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-484c749e-01fa-422c-9c97-59b38616fa00 req-8c161f27-48bf-4462-844c-4a9a3eccf952 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=838c65be-046c-4ff2-bdb7-ede24f82dbda&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0449896 Dec 09 22:42:11.572501 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-484c749e-01fa-422c-9c97-59b38616fa00 req-24fbff75-8199-44e7-8ae2-89a78fc93bf6 service neutron] 10.222.0.31 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0879297 Dec 09 22:42:11.592423 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-c4110b21-4c7e-4c81-93e2-c68269f94a09 None None] Set router a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:42:11.663024 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-484c749e-01fa-422c-9c97-59b38616fa00 req-b09a1c67-f88c-420a-a175-fde99b40ebbb service neutron] 10.222.0.31 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0832236 Dec 09 22:42:11.825559 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-c4110b21-4c7e-4c81-93e2-c68269f94a09 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'name': 'tempest-TestSnapshotPattern-2034929229-router', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141'}], 'enable_snat': True}, 'gw_port_id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '2373ef24126c44b492884e181943f78a', 'gw_port': {'id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:7a:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4361, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '570aa5b3-340f-4592-bbdb-6d442e0d7c99', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'floating_ip_address': '172.25.3.204', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'port_id': '2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 4389, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'mac_address': 'fa:16:3e:3d:88:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ebb00d32-ca5d-4a5d-923e-75d9299fc918', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:42:09Z', 'updated_at': '2021-12-09T22:42:09Z', 'revision_number': 0, 'project_id': '2373ef24126c44b492884e181943f78a', 'fixed_ip_address_scope': None}, {'id': 'c0d66b7f-e021-45bb-af5e-0cd30aaed5de', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'floating_ip_address': '172.25.3.246', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'port_id': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 4386, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'mac_address': 'fa:16:3e:a0:41:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:39:37Z', 'updated_at': '2021-12-09T22:39:40Z', 'revision_number': 1, 'project_id': '2373ef24126c44b492884e181943f78a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'bfa73955-6300-4749-8500-d4c22f8e54be', 'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'mac_address': 'fa:16:3e:e8:dd:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_interface', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:17Z', 'updated_at': '2021-12-09T22:39:22Z', 'revision_number': 5, 'project_id': '2373ef24126c44b492884e181943f78a', 'subnets': [{'id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:42:11.850905 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c4110b21-4c7e-4c81-93e2-c68269f94a09 None None] The sync data for ids ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'] in n-d-713301-27 is: [{'id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'name': 'tempest-TestSnapshotPattern-2034929229-router', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141'}], 'enable_snat': True}, 'gw_port_id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '2373ef24126c44b492884e181943f78a', 'gw_port': {'id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:7a:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4361, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': '570aa5b3-340f-4592-bbdb-6d442e0d7c99', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'floating_ip_address': '172.25.3.204', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'port_id': '2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 4389, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'mac_address': 'fa:16:3e:3d:88:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ebb00d32-ca5d-4a5d-923e-75d9299fc918', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:42:09Z', 'updated_at': '2021-12-09T22:42:09Z', 'revision_number': 0, 'project_id': '2373ef24126c44b492884e181943f78a', 'fixed_ip_address_scope': None}, {'id': 'c0d66b7f-e021-45bb-af5e-0cd30aaed5de', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'floating_ip_address': '172.25.3.246', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'port_id': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 4386, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'mac_address': 'fa:16:3e:a0:41:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:39:37Z', 'updated_at': '2021-12-09T22:39:40Z', 'revision_number': 1, 'project_id': '2373ef24126c44b492884e181943f78a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'bfa73955-6300-4749-8500-d4c22f8e54be', 'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'mac_address': 'fa:16:3e:e8:dd:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_interface', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:17Z', 'updated_at': '2021-12-09T22:39:22Z', 'revision_number': 5, 'project_id': '2373ef24126c44b492884e181943f78a', 'subnets': [{'id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:42:12.058938 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-994200b1-0b24-4fc6-b161-3ca98ad315be None None] New status for floating IP 570aa5b3-340f-4592-bbdb-6d442e0d7c99: ACTIVE {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:42:20.379262 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:42:22.518360 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33785e0c-59df-4aa4-8388-9afa6ead66c2 req-00145883-702f-40c7-ac5f-cfeb8b85a4c5 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=b4853f31-7021-4de4-b857-0d1715fc7a87&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0499616 Dec 09 22:42:22.602193 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33785e0c-59df-4aa4-8388-9afa6ead66c2 req-cc6b3261-c118-4b2b-a46d-d7ae240ddc70 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:22.603623 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33785e0c-59df-4aa4-8388-9afa6ead66c2 req-cc6b3261-c118-4b2b-a46d-d7ae240ddc70 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=2373ef24126c44b492884e181943f78a&device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 1095 time: 0.0421479 Dec 09 22:42:22.714238 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33785e0c-59df-4aa4-8388-9afa6ead66c2 req-f679f200-61f2-41cf-b425-548b654dc0a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:22.715747 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33785e0c-59df-4aa4-8388-9afa6ead66c2 req-f679f200-61f2-41cf-b425-548b654dc0a0 service neutron] 10.222.0.10 "GET /v2.0/networks?id=838c65be-046c-4ff2-bdb7-ede24f82dbda HTTP/1.1" status: 200 len: 911 time: 0.0915253 Dec 09 22:42:22.788502 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33785e0c-59df-4aa4-8388-9afa6ead66c2 req-c2a85c92-772e-4f03-a4e1-9b750a3f7178 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=1c4bbb1a-bd7f-4f83-9a15-6c267e295116 HTTP/1.1" status: 200 len: 999 time: 0.0651588 Dec 09 22:42:22.849295 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33785e0c-59df-4aa4-8388-9afa6ead66c2 req-b7bc1709-ce55-4258-8f4a-7319ad3cdc66 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:22.850791 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33785e0c-59df-4aa4-8388-9afa6ead66c2 req-b7bc1709-ce55-4258-8f4a-7319ad3cdc66 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1 HTTP/1.1" status: 200 len: 849 time: 0.0551012 Dec 09 22:42:22.909789 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33785e0c-59df-4aa4-8388-9afa6ead66c2 req-76866e29-4555-4d70-b27d-aaf9028d8080 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:22.911282 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33785e0c-59df-4aa4-8388-9afa6ead66c2 req-76866e29-4555-4d70-b27d-aaf9028d8080 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=838c65be-046c-4ff2-bdb7-ede24f82dbda&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0519340 Dec 09 22:42:23.001634 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33785e0c-59df-4aa4-8388-9afa6ead66c2 req-ac648110-7db1-477b-9a0a-b5ec9cb81849 service neutron] 10.222.0.10 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0826809 Dec 09 22:42:23.098803 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-33785e0c-59df-4aa4-8388-9afa6ead66c2 req-babe503d-c962-4f01-8d76-09b22051bc40 service neutron] 10.222.0.10 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0903168 Dec 09 22:42:27.948926 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:28.054453 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:32.318213 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f9810970-439c-4217-a806-091f872d4973 req-07889cf3-0700-4ddc-9166-f1677c632a59 service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0449045 Dec 09 22:42:32.405684 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9810970-439c-4217-a806-091f872d4973 req-8aeff321-8f0d-4a76-8ec9-fa542788b5a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:32.407190 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f9810970-439c-4217-a806-091f872d4973 req-8aeff321-8f0d-4a76-8ec9-fa542788b5a3 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2373ef24126c44b492884e181943f78a&device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 1097 time: 0.0412679 Dec 09 22:42:32.864358 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9810970-439c-4217-a806-091f872d4973 req-f3cbed8c-9f49-4d1d-aeaf-93d7b81c0979 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:32.865840 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f9810970-439c-4217-a806-091f872d4973 req-f3cbed8c-9f49-4d1d-aeaf-93d7b81c0979 service neutron] 10.222.0.31 "GET /v2.0/networks?id=838c65be-046c-4ff2-bdb7-ede24f82dbda HTTP/1.1" status: 200 len: 911 time: 0.4383852 Dec 09 22:42:32.932835 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f9810970-439c-4217-a806-091f872d4973 req-66615484-7d45-4a5a-8588-0f0d9df20a6d service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f HTTP/1.1" status: 200 len: 1001 time: 0.0589440 Dec 09 22:42:32.984305 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9810970-439c-4217-a806-091f872d4973 req-4c1760a6-4ab2-4a7d-a138-b582a50e6ea6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:32.985754 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f9810970-439c-4217-a806-091f872d4973 req-4c1760a6-4ab2-4a7d-a138-b582a50e6ea6 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1 HTTP/1.1" status: 200 len: 849 time: 0.0460606 Dec 09 22:42:33.033028 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9810970-439c-4217-a806-091f872d4973 req-8446c858-18a3-4c12-8ef8-3eec3c6e1e72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:42:33.034581 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f9810970-439c-4217-a806-091f872d4973 req-8446c858-18a3-4c12-8ef8-3eec3c6e1e72 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=838c65be-046c-4ff2-bdb7-ede24f82dbda&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0418916 Dec 09 22:42:33.123520 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d1b15c5e-257e-452d-a77e-1d27e5ae6d1d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:33.126195 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f9810970-439c-4217-a806-091f872d4973 req-4d8d452a-9140-4341-b061-f094c56b9dfd service neutron] 10.222.0.31 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0840852 Dec 09 22:42:33.219305 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-f9810970-439c-4217-a806-091f872d4973 req-e2264e6a-21dd-4787-8f1f-c83689d4b142 service neutron] 10.222.0.31 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860343 Dec 09 22:42:35.710834 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-57314689-4014-466d-ac23-091d2020758a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:36.998771 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:38.346576 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:39.728551 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:57.387005 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:42:57.953019 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:42:58.049662 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:03.128082 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-158baec5-45d1-4452-ad79-357f0d186d97 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:05.705670 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-25482203-7596-4d4b-ae1c-8ec8df387ecf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:07.001306 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:08.346617 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:09.728806 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:23.852178 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-64479018-cc76-498a-aad4-d0d23de612cb req-55be43ff-d6ef-4e38-a51e-8a04257d6f38 service neutron] 10.222.0.10 "GET /v2.0/ports?device_id=b4853f31-7021-4de4-b857-0d1715fc7a87&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0409503 Dec 09 22:43:23.947599 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64479018-cc76-498a-aad4-d0d23de612cb req-cdc3613f-0602-4cda-b768-3bb413939475 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:43:23.949100 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-64479018-cc76-498a-aad4-d0d23de612cb req-cdc3613f-0602-4cda-b768-3bb413939475 service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=2373ef24126c44b492884e181943f78a&device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 1095 time: 0.0517216 Dec 09 22:43:24.061030 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64479018-cc76-498a-aad4-d0d23de612cb req-e62a46a5-3e74-4342-abc7-2f5adf9d2977 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:43:24.062585 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-64479018-cc76-498a-aad4-d0d23de612cb req-e62a46a5-3e74-4342-abc7-2f5adf9d2977 service neutron] 10.222.0.10 "GET /v2.0/networks?id=838c65be-046c-4ff2-bdb7-ede24f82dbda HTTP/1.1" status: 200 len: 911 time: 0.0931280 Dec 09 22:43:24.128232 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-64479018-cc76-498a-aad4-d0d23de612cb req-a4227ff7-4175-4e02-bb30-eaa998c05621 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=1c4bbb1a-bd7f-4f83-9a15-6c267e295116 HTTP/1.1" status: 200 len: 999 time: 0.0582931 Dec 09 22:43:24.183276 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64479018-cc76-498a-aad4-d0d23de612cb req-16f140ff-e1e9-4395-b58f-36791060f962 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:43:24.185121 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-64479018-cc76-498a-aad4-d0d23de612cb req-16f140ff-e1e9-4395-b58f-36791060f962 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1 HTTP/1.1" status: 200 len: 849 time: 0.0495152 Dec 09 22:43:24.233047 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64479018-cc76-498a-aad4-d0d23de612cb req-9b49e437-bd3c-4092-b6a0-34d8a17c0505 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:43:24.234602 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-64479018-cc76-498a-aad4-d0d23de612cb req-9b49e437-bd3c-4092-b6a0-34d8a17c0505 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=838c65be-046c-4ff2-bdb7-ede24f82dbda&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0417094 Dec 09 22:43:24.245819 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-64479018-cc76-498a-aad4-d0d23de612cb req-9ae8100f-9bcd-467b-bd3f-b1cf15d259c2 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 22:43:24.246766 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-64479018-cc76-498a-aad4-d0d23de612cb req-9ae8100f-9bcd-467b-bd3f-b1cf15d259c2 service neutron] 10.222.0.10 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0049603 Dec 09 22:43:24.346546 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-64479018-cc76-498a-aad4-d0d23de612cb req-12951bbc-41b6-4635-b87d-43452bd75286 service neutron] 10.222.0.10 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0916874 Dec 09 22:43:24.439877 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-64479018-cc76-498a-aad4-d0d23de612cb req-31b3b166-74a6-424b-bc06-cb2a09fdf8be service neutron] 10.222.0.10 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860515 Dec 09 22:43:27.987729 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:28.045494 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:33.129596 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dfd59705-fa31-4ed0-883e-186d1469ada0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:33.277082 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8bb79fe8-9876-474f-95ac-56dcb60e6314 req-6fd1187e-d8bd-48d1-b048-9de9de901eaf service neutron] 10.222.0.31 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 274 time: 0.0419848 Dec 09 22:43:33.368566 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bb79fe8-9876-474f-95ac-56dcb60e6314 req-87da2ef5-2a19-4bf2-bdda-da3ebbf06a12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:43:33.370121 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8bb79fe8-9876-474f-95ac-56dcb60e6314 req-87da2ef5-2a19-4bf2-bdda-da3ebbf06a12 service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2373ef24126c44b492884e181943f78a&device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 1097 time: 0.0490973 Dec 09 22:43:33.478917 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bb79fe8-9876-474f-95ac-56dcb60e6314 req-756ba0af-c9cf-4330-a994-0f405de6fff8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:43:33.480448 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8bb79fe8-9876-474f-95ac-56dcb60e6314 req-756ba0af-c9cf-4330-a994-0f405de6fff8 service neutron] 10.222.0.31 "GET /v2.0/networks?id=838c65be-046c-4ff2-bdb7-ede24f82dbda HTTP/1.1" status: 200 len: 911 time: 0.0872805 Dec 09 22:43:33.553749 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8bb79fe8-9876-474f-95ac-56dcb60e6314 req-9109cceb-b799-4620-8f67-17c86408f52e service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f HTTP/1.1" status: 200 len: 1001 time: 0.0660415 Dec 09 22:43:33.604874 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bb79fe8-9876-474f-95ac-56dcb60e6314 req-d89255a7-d542-484f-a209-3efd8bc15bd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:43:33.606318 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8bb79fe8-9876-474f-95ac-56dcb60e6314 req-d89255a7-d542-484f-a209-3efd8bc15bd3 service neutron] 10.222.0.31 "GET /v2.0/subnets?id=9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1 HTTP/1.1" status: 200 len: 849 time: 0.0454237 Dec 09 22:43:33.653072 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bb79fe8-9876-474f-95ac-56dcb60e6314 req-ec0f4b30-f883-41f4-82c4-01a931afae23 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:43:33.654594 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8bb79fe8-9876-474f-95ac-56dcb60e6314 req-ec0f4b30-f883-41f4-82c4-01a931afae23 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=838c65be-046c-4ff2-bdb7-ede24f82dbda&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0407135 Dec 09 22:43:33.666080 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-8bb79fe8-9876-474f-95ac-56dcb60e6314 req-d2d5a201-1a6c-4b99-9ece-9db312c1ebf0 service neutron] http://10.222.0.13:9696/v2.0/extensions returned with HTTP 200 {{(pid=103437) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 22:43:33.667035 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8bb79fe8-9876-474f-95ac-56dcb60e6314 req-d2d5a201-1a6c-4b99-9ece-9db312c1ebf0 service neutron] 10.222.0.31 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0054624 Dec 09 22:43:33.761117 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8bb79fe8-9876-474f-95ac-56dcb60e6314 req-0bfc1f80-04d8-43eb-9ae1-a31b965a1f17 service neutron] 10.222.0.31 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0865324 Dec 09 22:43:33.863700 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8bb79fe8-9876-474f-95ac-56dcb60e6314 req-1bbd3062-1be0-4770-bba3-8446c837042b service neutron] 10.222.0.31 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0947235 Dec 09 22:43:34.381621 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:43:35.717025 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-10ef2a16-6a21-4694-bd07-aa58a27a6cc2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:37.012970 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:38.348967 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:39.729746 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:42.588555 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f details requested by agent hyperv_n-h1-713301-27 with host n-h1-713301-27 {{(pid=103439) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 22:43:42.697529 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f,segment=NetworkSegment(2eba823c-93ea-484b-ab73-5af9237c7643),segment_id=2eba823c-93ea-484b-ab73-5af9237c7643)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:43:42.709285 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Returning: {'device': '2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'port_id': '2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f', 'mac_address': 'fa:16:3e:3d:88:79', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 148, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103439) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 22:43:42.751469 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:42.767198 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f {{(pid=103439) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 22:43:42.796629 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f,segment=NetworkSegment(2eba823c-93ea-484b-ab73-5af9237c7643),segment_id=2eba823c-93ea-484b-ab73-5af9237c7643)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:43:42.816938 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:42.890169 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f,revision_number=6']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:43:42.899070 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:42.899598 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:42.901034 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:42.901477 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:42.901899 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:42.902407 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:42.902753 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:42.903083 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:42.903415 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:42.903878 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:42.904301 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:42.904707 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:42.905040 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103439) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:42.920360 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] get_ports_and_sgs() called for port_ids ['2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f'] {{(pid=103439) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 22:43:44.598478 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f up at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 22:43:44.655603 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.provisioning_blocks [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Provisioning complete for port 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f triggered by entity L2. {{(pid=103439) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 22:43:44.656217 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1456331'] for port, provisioning_complete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:44.746163 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1594006'] for port, before_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:44.773303 n-d-713301-27 neutron-server[103439]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ebb00d32-ca5d-4a5d-923e-75d9299fc918', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f'}] {{(pid=103439) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:43:44.775933 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}98e048cf4a210097ced3a0ed7cf7483a3b4b95858d3f8584ae51f589c5faebd7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ea313929-9b4d-4cc7-8e9e-da0318925781" -d '{"events": [{"server_uuid": "ebb00d32-ca5d-4a5d-923e-75d9299fc918", "name": "network-vif-plugged", "status": "completed", "tag": "2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f"}]}' {{(pid=103439) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:43:44.805198 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] For port 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f,segment=NetworkSegment(2eba823c-93ea-484b-ab73-5af9237c7643),segment_id=2eba823c-93ea-484b-ab73-5af9237c7643)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:43:44.818144 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8731650215473', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8731649715222', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8731649715240'] for port, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:44.838344 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:43:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-37309270-19eb-4dad-a7a1-6222245eb77d x-openstack-request-id: req-37309270-19eb-4dad-a7a1-6222245eb77d {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:43:44.838344 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ebb00d32-ca5d-4a5d-923e-75d9299fc918", "name": "network-vif-plugged", "status": "completed", "tag": "2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f", "code": 200}]} {{(pid=103439) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:43:44.838344 n-d-713301-27 neutron-server[103439]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-37309270-19eb-4dad-a7a1-6222245eb77d {{(pid=103439) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:43:44.838344 n-d-713301-27 neutron-server[103439]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ebb00d32-ca5d-4a5d-923e-75d9299fc918', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f', 'code': 200} Dec 09 22:43:44.866030 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Pushing event updated for resources: {'Port': ['ID=2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f,revision_number=7']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:43:51.627774 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36386) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:43:51.798205 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Deleting port c1ce881e-56e3-4ee3-957e-c597c2290e4b {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:43:51.798552 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:51.876164 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:51.876424 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:51.888984 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Calling delete_port for c1ce881e-56e3-4ee3-957e-c597c2290e4b owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:43:52.059330 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:52.084633 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Pushing event deleted for resources: {'Port': ['ID=c1ce881e-56e3-4ee3-957e-c597c2290e4b,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:43:52.096669 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:52.097045 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:52.097374 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:52.097717 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:52.098059 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:52.098398 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:52.098729 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:52.099060 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:52.099390 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:52.099744 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:52.100078 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:52.100408 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:52.100756 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103437) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:43:52.157520 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:52.157841 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Floating IP 570aa5b3-340f-4592-bbdb-6d442e0d7c99 disassociated (deleted). External IP: 172.25.3.204, port: 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f. Dec 09 22:43:52.376538 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Router a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:43:52.490579 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:43:52.496034 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:52.502745 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4cbc8ce-355e-4757-becf-b271e18c609e None None] Sync routers for ids ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:43:52.514024 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4cbc8ce-355e-4757-becf-b271e18c609e None None] Routers {'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:43:52.514639 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e4cbc8ce-355e-4757-becf-b271e18c609e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:43:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:43:52.526557 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f139f475-f8c6-415e-bf76-57305cf99d35 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "DELETE /v2.0/floatingips/570aa5b3-340f-4592-bbdb-6d442e0d7c99 HTTP/1.1" status: 204 len: 168 time: 0.8976049 Dec 09 22:43:52.527170 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ebb00d32-ca5d-4a5d-923e-75d9299fc918', 'tag': '2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:43:52.529570 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-259307e3-08ea-4d40-b2e5-82dc3da321d4" -d '{"events": [{"name": "network-changed", "server_uuid": "ebb00d32-ca5d-4a5d-923e-75d9299fc918", "tag": "2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:43:52.620485 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-e4cbc8ce-355e-4757-becf-b271e18c609e None None] Set router a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:43:52.688395 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:43:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b5f84e7c-5510-40fd-a3e3-068388b1c595 x-openstack-request-id: req-b5f84e7c-5510-40fd-a3e3-068388b1c595 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:43:52.688934 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ebb00d32-ca5d-4a5d-923e-75d9299fc918", "tag": "2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:43:52.689116 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-b5f84e7c-5510-40fd-a3e3-068388b1c595 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:43:52.689621 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ebb00d32-ca5d-4a5d-923e-75d9299fc918', 'tag': '2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f', 'status': 'completed', 'code': 200} Dec 09 22:43:52.756411 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-259307e3-08ea-4d40-b2e5-82dc3da321d4 req-c8341b7b-3da3-4d0e-8e30-e7c16940c32a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:43:52.758435 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-259307e3-08ea-4d40-b2e5-82dc3da321d4 req-c8341b7b-3da3-4d0e-8e30-e7c16940c32a service neutron] 10.222.0.31 "GET /v2.0/ports?tenant_id=2373ef24126c44b492884e181943f78a&device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 1097 time: 0.0429537 Dec 09 22:43:52.786111 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c92c8f8-d11d-4c5f-b003-aa58a9a6ac3d req-d8a09768-1fa4-47b1-8115-e6a09e15c675 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:43:52.788404 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c92c8f8-d11d-4c5f-b003-aa58a9a6ac3d req-d8a09768-1fa4-47b1-8115-e6a09e15c675 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 945 time: 0.0543284 Dec 09 22:43:52.844096 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-5c92c8f8-d11d-4c5f-b003-aa58a9a6ac3d req-7baaf1dd-6a4d-45b0-b62f-2ecca9c4e808 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493565 Dec 09 22:43:52.853690 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-259307e3-08ea-4d40-b2e5-82dc3da321d4 req-bf9642fc-9d56-4860-89c9-fb6ea2ff62c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:43:52.855516 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-259307e3-08ea-4d40-b2e5-82dc3da321d4 req-bf9642fc-9d56-4860-89c9-fb6ea2ff62c6 service neutron] 10.222.0.31 "GET /v2.0/networks?id=838c65be-046c-4ff2-bdb7-ede24f82dbda HTTP/1.1" status: 200 len: 911 time: 0.0881665 Dec 09 22:43:52.858632 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e4cbc8ce-355e-4757-becf-b271e18c609e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'name': 'tempest-TestSnapshotPattern-2034929229-router', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141'}], 'enable_snat': True}, 'gw_port_id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '2373ef24126c44b492884e181943f78a', 'gw_port': {'id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:7a:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4361, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'c0d66b7f-e021-45bb-af5e-0cd30aaed5de', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'floating_ip_address': '172.25.3.246', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'port_id': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 4386, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'mac_address': 'fa:16:3e:a0:41:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:39:37Z', 'updated_at': '2021-12-09T22:39:40Z', 'revision_number': 1, 'project_id': '2373ef24126c44b492884e181943f78a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'bfa73955-6300-4749-8500-d4c22f8e54be', 'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'mac_address': 'fa:16:3e:e8:dd:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_interface', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:17Z', 'updated_at': '2021-12-09T22:39:22Z', 'revision_number': 5, 'project_id': '2373ef24126c44b492884e181943f78a', 'subnets': [{'id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:43:52.888690 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4cbc8ce-355e-4757-becf-b271e18c609e None None] Checking router: a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:43:52.896939 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4cbc8ce-355e-4757-becf-b271e18c609e None None] Routers {'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:43:52.897543 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e4cbc8ce-355e-4757-becf-b271e18c609e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:43:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:43:52.900738 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-259307e3-08ea-4d40-b2e5-82dc3da321d4 req-9f7eff8c-b427-4733-bb9a-a74cfe9645ff service neutron] 10.222.0.31 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f HTTP/1.1" status: 200 len: 217 time: 0.0379753 Dec 09 22:43:52.952590 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-259307e3-08ea-4d40-b2e5-82dc3da321d4 req-2e19d213-7e99-4085-90b6-e644788399ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:43:52.954088 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-259307e3-08ea-4d40-b2e5-82dc3da321d4 req-2e19d213-7e99-4085-90b6-e644788399ba service neutron] 10.222.0.31 "GET /v2.0/subnets?id=9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1 HTTP/1.1" status: 200 len: 849 time: 0.0457020 Dec 09 22:43:53.002989 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-259307e3-08ea-4d40-b2e5-82dc3da321d4 req-61a8c81d-48ca-4c74-bcfa-d0b93a21b894 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:43:53.004624 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-259307e3-08ea-4d40-b2e5-82dc3da321d4 req-61a8c81d-48ca-4c74-bcfa-d0b93a21b894 service neutron] 10.222.0.31 "GET /v2.0/ports?network_id=838c65be-046c-4ff2-bdb7-ede24f82dbda&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0418255 Dec 09 22:43:53.007136 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-e4cbc8ce-355e-4757-becf-b271e18c609e None None] Set router a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:43:53.104295 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-259307e3-08ea-4d40-b2e5-82dc3da321d4 req-ccb8c9b6-d451-40f9-9b9d-74659433f404 service neutron] 10.222.0.31 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0912969 Dec 09 22:43:53.194994 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-259307e3-08ea-4d40-b2e5-82dc3da321d4 req-f64cd409-a6e9-467b-9377-e54b74e63ee2 service neutron] 10.222.0.31 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0828938 Dec 09 22:43:53.235107 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-e4cbc8ce-355e-4757-becf-b271e18c609e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'name': 'tempest-TestSnapshotPattern-2034929229-router', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141'}], 'enable_snat': True}, 'gw_port_id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '2373ef24126c44b492884e181943f78a', 'gw_port': {'id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:7a:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4361, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'c0d66b7f-e021-45bb-af5e-0cd30aaed5de', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'floating_ip_address': '172.25.3.246', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'port_id': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 4386, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'mac_address': 'fa:16:3e:a0:41:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:39:37Z', 'updated_at': '2021-12-09T22:39:40Z', 'revision_number': 1, 'project_id': '2373ef24126c44b492884e181943f78a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'bfa73955-6300-4749-8500-d4c22f8e54be', 'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'mac_address': 'fa:16:3e:e8:dd:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_interface', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:17Z', 'updated_at': '2021-12-09T22:39:22Z', 'revision_number': 5, 'project_id': '2373ef24126c44b492884e181943f78a', 'subnets': [{'id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:43:53.355342 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4cbc8ce-355e-4757-becf-b271e18c609e None None] The sync data for ids ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'] in n-d-713301-27 is: [{'id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'name': 'tempest-TestSnapshotPattern-2034929229-router', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141'}], 'enable_snat': True}, 'gw_port_id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '2373ef24126c44b492884e181943f78a', 'gw_port': {'id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:7a:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4361, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_floatingips': [{'id': 'c0d66b7f-e021-45bb-af5e-0cd30aaed5de', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'floating_ip_address': '172.25.3.246', 'floating_network_id': '97925a19-460a-4476-8208-41db134b6c83', 'router_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'port_id': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 4386, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'mac_address': 'fa:16:3e:a0:41:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T22:39:37Z', 'updated_at': '2021-12-09T22:39:40Z', 'revision_number': 1, 'project_id': '2373ef24126c44b492884e181943f78a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'bfa73955-6300-4749-8500-d4c22f8e54be', 'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'mac_address': 'fa:16:3e:e8:dd:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_interface', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:17Z', 'updated_at': '2021-12-09T22:39:22Z', 'revision_number': 5, 'project_id': '2373ef24126c44b492884e181943f78a', 'subnets': [{'id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:43:53.604568 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-912f6082-5881-4754-b397-818022a7a62e None None] New status for floating IP 570aa5b3-340f-4592-bbdb-6d442e0d7c99: DOWN {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:43:53.982586 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c7ac675-5a5f-4a43-b243-4eec9f264e56 req-3f526621-c241-43d1-9aa0-0fe22b1f9184 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:43:53.983952 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c7ac675-5a5f-4a43-b243-4eec9f264e56 req-3f526621-c241-43d1-9aa0-0fe22b1f9184 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 945 time: 0.0538850 Dec 09 22:43:54.038414 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-8c7ac675-5a5f-4a43-b243-4eec9f264e56 req-4daff2fd-7277-4e03-a4df-a4a0cadf6563 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454221 Dec 09 22:43:54.242314 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-873d269b-ed59-4ec2-be84-bfd69a322ce9 req-8bd4222d-2ca1-42d1-8946-16ce1ef2d3b7 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:43:54.243907 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-873d269b-ed59-4ec2-be84-bfd69a322ce9 req-8bd4222d-2ca1-42d1-8946-16ce1ef2d3b7 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.31 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 945 time: 0.0554898 Dec 09 22:43:54.335200 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-873d269b-ed59-4ec2-be84-bfd69a322ce9 req-913851e3-436e-4e25-a0ef-2ce8ec09d489 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Deleting port 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:43:54.335544 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-873d269b-ed59-4ec2-be84-bfd69a322ce9 req-913851e3-436e-4e25-a0ef-2ce8ec09d489 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:54.431132 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-873d269b-ed59-4ec2-be84-bfd69a322ce9 req-913851e3-436e-4e25-a0ef-2ce8ec09d489 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] For port 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f, host n-h1-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h1-713301-27',level=0,port_id=2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f,segment=NetworkSegment(2eba823c-93ea-484b-ab73-5af9237c7643),segment_id=2eba823c-93ea-484b-ab73-5af9237c7643)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:43:54.431550 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-873d269b-ed59-4ec2-be84-bfd69a322ce9 req-913851e3-436e-4e25-a0ef-2ce8ec09d489 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:54.444762 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-873d269b-ed59-4ec2-be84-bfd69a322ce9 req-913851e3-436e-4e25-a0ef-2ce8ec09d489 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Calling delete_port for 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:43:54.588137 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-873d269b-ed59-4ec2-be84-bfd69a322ce9 req-913851e3-436e-4e25-a0ef-2ce8ec09d489 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:54.623028 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-913851e3-436e-4e25-a0ef-2ce8ec09d489 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Pushing event deleted for resources: {'Port': ['ID=2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:43:54.639571 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:43:54.662110 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:43:54.662462 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:43:54.671699 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-873d269b-ed59-4ec2-be84-bfd69a322ce9 req-913851e3-436e-4e25-a0ef-2ce8ec09d489 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] No DVR routers for this DVR port 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f on host n-h1-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:43:54.674424 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-873d269b-ed59-4ec2-be84-bfd69a322ce9 req-913851e3-436e-4e25-a0ef-2ce8ec09d489 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:54.677840 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-873d269b-ed59-4ec2-be84-bfd69a322ce9 req-913851e3-436e-4e25-a0ef-2ce8ec09d489 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.31 "DELETE /v2.0/ports/2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f HTTP/1.1" status: 204 len: 173 time: 0.4278874 Dec 09 22:43:54.690572 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ebb00d32-ca5d-4a5d-923e-75d9299fc918', 'name': 'network-vif-deleted', 'tag': '2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:43:54.693072 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-098be14c-e3bf-4e5d-8268-44c071f00b6f" -d '{"events": [{"server_uuid": "ebb00d32-ca5d-4a5d-923e-75d9299fc918", "name": "network-vif-deleted", "tag": "2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:43:54.729027 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:43:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-92cb2a9d-c60d-4431-a27a-7273bfb0c355 x-openstack-request-id: req-92cb2a9d-c60d-4431-a27a-7273bfb0c355 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:43:54.729327 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ebb00d32-ca5d-4a5d-923e-75d9299fc918", "name": "network-vif-deleted", "tag": "2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:43:54.729584 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-92cb2a9d-c60d-4431-a27a-7273bfb0c355 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:43:54.729999 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ebb00d32-ca5d-4a5d-923e-75d9299fc918', 'name': 'network-vif-deleted', 'tag': '2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f', 'status': 'completed', 'code': 200} Dec 09 22:43:55.160168 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-e3c274b1-3872-4276-bc9c-2a703da60a59 req-ca30a090-b2da-4923-9843-5e790fbf73ef tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=ebb00d32-ca5d-4a5d-923e-75d9299fc918 HTTP/1.1" status: 200 len: 210 time: 0.0280738 Dec 09 22:43:56.782046 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36444) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:43:56.948829 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-488ed3d9-2f9e-467b-900c-40e71e1cbccf tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Deleting port 6f317b45-3c10-4580-93ea-89c097dcecaf {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:43:56.949775 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-488ed3d9-2f9e-467b-900c-40e71e1cbccf tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:57.028546 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-488ed3d9-2f9e-467b-900c-40e71e1cbccf tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:57.028770 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-488ed3d9-2f9e-467b-900c-40e71e1cbccf tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:57.040344 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-488ed3d9-2f9e-467b-900c-40e71e1cbccf tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Calling delete_port for 6f317b45-3c10-4580-93ea-89c097dcecaf owned by network:floatingip {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:43:57.204671 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-488ed3d9-2f9e-467b-900c-40e71e1cbccf tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:57.242740 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-488ed3d9-2f9e-467b-900c-40e71e1cbccf tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Pushing event deleted for resources: {'Port': ['ID=6f317b45-3c10-4580-93ea-89c097dcecaf,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:43:57.302793 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-488ed3d9-2f9e-467b-900c-40e71e1cbccf tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for floatingip, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:57.303015 n-d-713301-27 neutron-server[103437]: INFO neutron.db.l3_db [None req-488ed3d9-2f9e-467b-900c-40e71e1cbccf tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Floating IP c0d66b7f-e021-45bb-af5e-0cd30aaed5de disassociated (deleted). External IP: 172.25.3.246, port: 1c4bbb1a-bd7f-4f83-9a15-6c267e295116. Dec 09 22:43:57.526260 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-488ed3d9-2f9e-467b-900c-40e71e1cbccf tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Router a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:43:57.638914 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-488ed3d9-2f9e-467b-900c-40e71e1cbccf tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:43:57.643894 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-488ed3d9-2f9e-467b-900c-40e71e1cbccf tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for floatingip, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:57.650722 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af6ed65e-411f-4ec0-b194-2bfc817faf35 None None] Sync routers for ids ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:43:57.661492 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af6ed65e-411f-4ec0-b194-2bfc817faf35 None None] Routers {'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:43:57.662116 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-af6ed65e-411f-4ec0-b194-2bfc817faf35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:43:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:43:57.670425 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-488ed3d9-2f9e-467b-900c-40e71e1cbccf tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "DELETE /v2.0/floatingips/c0d66b7f-e021-45bb-af5e-0cd30aaed5de HTTP/1.1" status: 204 len: 168 time: 0.8872912 Dec 09 22:43:57.671129 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'tag': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:43:57.673514 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8444d16c-f99b-4f30-91be-a4249343ccb1" -d '{"events": [{"name": "network-changed", "server_uuid": "b4853f31-7021-4de4-b857-0d1715fc7a87", "tag": "1c4bbb1a-bd7f-4f83-9a15-6c267e295116"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:43:57.777273 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-af6ed65e-411f-4ec0-b194-2bfc817faf35 None None] Set router a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:43:57.841220 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 22:43:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9b3eded1-0eba-4112-9823-61fa04d06456 x-openstack-request-id: req-9b3eded1-0eba-4112-9823-61fa04d06456 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:43:57.841722 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b4853f31-7021-4de4-b857-0d1715fc7a87", "tag": "1c4bbb1a-bd7f-4f83-9a15-6c267e295116", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:43:57.841820 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-9b3eded1-0eba-4112-9823-61fa04d06456 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:43:57.842263 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'tag': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116', 'status': 'completed', 'code': 200} Dec 09 22:43:57.912473 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8444d16c-f99b-4f30-91be-a4249343ccb1 req-0f1ebdc5-3feb-41d0-89a4-2dc65c7467da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:43:57.914320 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8444d16c-f99b-4f30-91be-a4249343ccb1 req-0f1ebdc5-3feb-41d0-89a4-2dc65c7467da service neutron] 10.222.0.10 "GET /v2.0/ports?tenant_id=2373ef24126c44b492884e181943f78a&device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 1095 time: 0.0499406 Dec 09 22:43:57.935536 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10cd7447-c341-448b-8a8b-7acf7012d79c req-1f1bd249-fc8f-41aa-9b77-cfded041d2fd tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:43:57.937114 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-10cd7447-c341-448b-8a8b-7acf7012d79c req-1f1bd249-fc8f-41aa-9b77-cfded041d2fd tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 943 time: 0.0507309 Dec 09 22:43:57.986034 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-af6ed65e-411f-4ec0-b194-2bfc817faf35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'name': 'tempest-TestSnapshotPattern-2034929229-router', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141'}], 'enable_snat': True}, 'gw_port_id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '2373ef24126c44b492884e181943f78a', 'gw_port': {'id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:7a:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4361, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'bfa73955-6300-4749-8500-d4c22f8e54be', 'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'mac_address': 'fa:16:3e:e8:dd:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_interface', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:17Z', 'updated_at': '2021-12-09T22:39:22Z', 'revision_number': 5, 'project_id': '2373ef24126c44b492884e181943f78a', 'subnets': [{'id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:43:57.999300 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-10cd7447-c341-448b-8a8b-7acf7012d79c req-283acef2-6df8-4b39-b896-5442088e9dbe tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0552323 Dec 09 22:43:58.000213 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:58.020149 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af6ed65e-411f-4ec0-b194-2bfc817faf35 None None] Checking router: a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:43:58.025315 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af6ed65e-411f-4ec0-b194-2bfc817faf35 None None] Routers {'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:43:58.025958 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-af6ed65e-411f-4ec0-b194-2bfc817faf35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:43:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:43:58.030932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8444d16c-f99b-4f30-91be-a4249343ccb1 req-f8ed255a-afbd-4318-a7d0-379df53469e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:43:58.032446 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8444d16c-f99b-4f30-91be-a4249343ccb1 req-f8ed255a-afbd-4318-a7d0-379df53469e0 service neutron] 10.222.0.10 "GET /v2.0/networks?id=838c65be-046c-4ff2-bdb7-ede24f82dbda HTTP/1.1" status: 200 len: 911 time: 0.1100924 Dec 09 22:43:58.059387 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:58.083096 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8444d16c-f99b-4f30-91be-a4249343ccb1 req-2d014149-793a-4c50-a369-6895f7a11d38 service neutron] 10.222.0.10 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=1c4bbb1a-bd7f-4f83-9a15-6c267e295116 HTTP/1.1" status: 200 len: 217 time: 0.0416858 Dec 09 22:43:58.132968 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-af6ed65e-411f-4ec0-b194-2bfc817faf35 None None] Set router a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:43:58.139232 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8444d16c-f99b-4f30-91be-a4249343ccb1 req-bc13fe5c-5c07-4456-8bd2-c9f06412d727 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:43:58.140843 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8444d16c-f99b-4f30-91be-a4249343ccb1 req-bc13fe5c-5c07-4456-8bd2-c9f06412d727 service neutron] 10.222.0.10 "GET /v2.0/subnets?id=9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1 HTTP/1.1" status: 200 len: 849 time: 0.0497561 Dec 09 22:43:58.187944 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8444d16c-f99b-4f30-91be-a4249343ccb1 req-a92e1a06-9607-4f76-8c40-472ffca4f382 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:43:58.189377 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8444d16c-f99b-4f30-91be-a4249343ccb1 req-a92e1a06-9607-4f76-8c40-472ffca4f382 service neutron] 10.222.0.10 "GET /v2.0/ports?network_id=838c65be-046c-4ff2-bdb7-ede24f82dbda&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1164 time: 0.0411272 Dec 09 22:43:58.282287 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8444d16c-f99b-4f30-91be-a4249343ccb1 req-b24d6be4-c197-46be-a5ac-aee719683c0e service neutron] 10.222.0.10 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844972 Dec 09 22:43:58.327483 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-af6ed65e-411f-4ec0-b194-2bfc817faf35 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'name': 'tempest-TestSnapshotPattern-2034929229-router', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141'}], 'enable_snat': True}, 'gw_port_id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '2373ef24126c44b492884e181943f78a', 'gw_port': {'id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:7a:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4361, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'bfa73955-6300-4749-8500-d4c22f8e54be', 'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'mac_address': 'fa:16:3e:e8:dd:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_interface', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:17Z', 'updated_at': '2021-12-09T22:39:22Z', 'revision_number': 5, 'project_id': '2373ef24126c44b492884e181943f78a', 'subnets': [{'id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:43:58.353047 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af6ed65e-411f-4ec0-b194-2bfc817faf35 None None] The sync data for ids ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'] in n-d-713301-27 is: [{'id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'name': 'tempest-TestSnapshotPattern-2034929229-router', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141'}], 'enable_snat': True}, 'gw_port_id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '2373ef24126c44b492884e181943f78a', 'gw_port': {'id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:7a:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4361, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27', '_interfaces': [{'id': 'bfa73955-6300-4749-8500-d4c22f8e54be', 'name': '', 'network_id': '838c65be-046c-4ff2-bdb7-ede24f82dbda', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'mac_address': 'fa:16:3e:e8:dd:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_interface', 'standard_attr_id': 4362, 'fixed_ips': [{'subnet_id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:17Z', 'updated_at': '2021-12-09T22:39:22Z', 'revision_number': 5, 'project_id': '2373ef24126c44b492884e181943f78a', 'subnets': [{'id': '9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:43:58.381532 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-8444d16c-f99b-4f30-91be-a4249343ccb1 req-74af4728-c19d-4d06-bb48-5631176e11d4 service neutron] 10.222.0.10 "GET /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0898750 Dec 09 22:43:58.582337 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4daee8ba-9ad2-4b51-8baa-5d25c53b2435 None None] New status for floating IP c0d66b7f-e021-45bb-af5e-0cd30aaed5de: DOWN {{(pid=103439) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 22:43:58.643063 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f no longer exists at agent hyperv_n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:43:58.664453 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] No Port match for: 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:43:58.664798 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Device 2a49cc2f-43cf-46cd-b1c3-4c4e7e69c30f not bound to the agent host n-h1-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:43:59.126365 n-d-713301-27 neutron-server[103438]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f35f4bf-f24a-422a-bdf9-e837c18ebb34 req-30b92f53-961d-4f38-9ed8-5f110c782bfc tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103438) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:43:59.127770 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f35f4bf-f24a-422a-bdf9-e837c18ebb34 req-30b92f53-961d-4f38-9ed8-5f110c782bfc tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 943 time: 0.0546677 Dec 09 22:43:59.187769 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-3f35f4bf-f24a-422a-bdf9-e837c18ebb34 req-db0f4b8c-dc04-4489-9a17-0f4036532116 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/security-groups?id=9b64c43a-5dd8-40a0-87a1-15e388a59102&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0504870 Dec 09 22:43:59.420822 n-d-713301-27 neutron-server[103437]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2caff226-bb02-4999-bbdc-b45795314218 req-17f0b509-7e1d-42ca-bb7e-cdb301f7f29b tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103437) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 22:43:59.422315 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2caff226-bb02-4999-bbdc-b45795314218 req-17f0b509-7e1d-42ca-bb7e-cdb301f7f29b tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.10 "GET /v2.0/ports?device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 943 time: 0.0551360 Dec 09 22:43:59.520352 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-2caff226-bb02-4999-bbdc-b45795314218 req-e2dcef12-a17f-4bdf-9b17-4e2c2290fb08 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Deleting port 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:43:59.520730 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2caff226-bb02-4999-bbdc-b45795314218 req-e2dcef12-a17f-4bdf-9b17-4e2c2290fb08 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:59.614427 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [req-2caff226-bb02-4999-bbdc-b45795314218 req-e2dcef12-a17f-4bdf-9b17-4e2c2290fb08 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] For port 1c4bbb1a-bd7f-4f83-9a15-6c267e295116, host n-h2-713301-27, got binding levels [PortBindingLevel(driver='hyperv',host='n-h2-713301-27',level=0,port_id=1c4bbb1a-bd7f-4f83-9a15-6c267e295116,segment=NetworkSegment(2eba823c-93ea-484b-ab73-5af9237c7643),segment_id=2eba823c-93ea-484b-ab73-5af9237c7643)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:43:59.614766 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2caff226-bb02-4999-bbdc-b45795314218 req-e2dcef12-a17f-4bdf-9b17-4e2c2290fb08 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:59.631377 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [req-2caff226-bb02-4999-bbdc-b45795314218 req-e2dcef12-a17f-4bdf-9b17-4e2c2290fb08 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Calling delete_port for 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 owned by compute:nova {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:43:59.782769 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2caff226-bb02-4999-bbdc-b45795314218 req-e2dcef12-a17f-4bdf-9b17-4e2c2290fb08 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:59.814274 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2dcef12-a17f-4bdf-9b17-4e2c2290fb08 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Pushing event deleted for resources: {'Port': ['ID=1c4bbb1a-bd7f-4f83-9a15-6c267e295116,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:43:59.858475 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.l3_dvrscheduler_db [req-2caff226-bb02-4999-bbdc-b45795314218 req-e2dcef12-a17f-4bdf-9b17-4e2c2290fb08 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] No DVR routers for this DVR port 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 on host n-h2-713301-27 {{(pid=103437) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:43:59.860919 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [req-2caff226-bb02-4999-bbdc-b45795314218 req-e2dcef12-a17f-4bdf-9b17-4e2c2290fb08 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-1041796'] for port, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:43:59.864455 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [req-2caff226-bb02-4999-bbdc-b45795314218 req-e2dcef12-a17f-4bdf-9b17-4e2c2290fb08 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.10 "DELETE /v2.0/ports/1c4bbb1a-bd7f-4f83-9a15-6c267e295116 HTTP/1.1" status: 204 len: 173 time: 0.4350507 Dec 09 22:43:59.864898 n-d-713301-27 neutron-server[103437]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'name': 'network-vif-deleted', 'tag': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116'}] {{(pid=103437) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 22:43:59.867219 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.13/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}53fcdbf6c978788ad5435ea0f902050eb4ac31262583aa395ead75fd55038806" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e0dc7c26-6c0f-4f88-a582-547e28bbefb9" -d '{"events": [{"server_uuid": "b4853f31-7021-4de4-b857-0d1715fc7a87", "name": "network-vif-deleted", "tag": "1c4bbb1a-bd7f-4f83-9a15-6c267e295116"}]}' {{(pid=103437) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 22:43:59.905224 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 22:43:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d99e93fd-2135-4449-9144-91682c5dbaa1 x-openstack-request-id: req-d99e93fd-2135-4449-9144-91682c5dbaa1 {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 22:43:59.905522 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b4853f31-7021-4de4-b857-0d1715fc7a87", "name": "network-vif-deleted", "tag": "1c4bbb1a-bd7f-4f83-9a15-6c267e295116", "status": "completed", "code": 200}]} {{(pid=103437) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 22:43:59.905776 n-d-713301-27 neutron-server[103437]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.13/compute/v2.1/os-server-external-events used request id req-d99e93fd-2135-4449-9144-91682c5dbaa1 {{(pid=103437) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 22:43:59.906190 n-d-713301-27 neutron-server[103437]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b4853f31-7021-4de4-b857-0d1715fc7a87', 'name': 'network-vif-deleted', 'tag': '1c4bbb1a-bd7f-4f83-9a15-6c267e295116', 'status': 'completed', 'code': 200} Dec 09 22:44:00.309830 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [req-37ec0e3c-7c58-4e00-b180-2d39f9ed2258 req-f7f26282-b70a-4ae8-b848-b78f93a8e077 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "GET /v2.0/ports?device_id=b4853f31-7021-4de4-b857-0d1715fc7a87 HTTP/1.1" status: 200 len: 210 time: 0.0281458 Dec 09 22:44:01.378524 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36460) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:44:01.455428 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eac36ddb-2545-40b5-9623-4210400df560 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:01.491887 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eac36ddb-2545-40b5-9623-4210400df560 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:01.556241 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eac36ddb-2545-40b5-9623-4210400df560 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:01.558853 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-eac36ddb-2545-40b5-9623-4210400df560 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:01.560442 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-eac36ddb-2545-40b5-9623-4210400df560 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] 10.222.0.13 "DELETE /v2.0/security-groups/9b64c43a-5dd8-40a0-87a1-15e388a59102 HTTP/1.1" status: 204 len: 168 time: 0.1808400 Dec 09 22:44:01.569263 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eac36ddb-2545-40b5-9623-4210400df560 tempest-TestSnapshotPattern-571101073 tempest-TestSnapshotPattern-571101073-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9b64c43a-5dd8-40a0-87a1-15e388a59102,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:44:01.611063 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36464) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:44:02.332316 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30b6f604-ea5a-4201-ad25-cc7b52271a52 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:02.591187 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-30b6f604-ea5a-4201-ad25-cc7b52271a52 admin admin] Deleting port bfa73955-6300-4749-8500-d4c22f8e54be {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:44:02.591959 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30b6f604-ea5a-4201-ad25-cc7b52271a52 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:02.670285 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-30b6f604-ea5a-4201-ad25-cc7b52271a52 admin admin] For port bfa73955-6300-4749-8500-d4c22f8e54be, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=bfa73955-6300-4749-8500-d4c22f8e54be,segment=NetworkSegment(2eba823c-93ea-484b-ab73-5af9237c7643),segment_id=2eba823c-93ea-484b-ab73-5af9237c7643)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:44:02.670643 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30b6f604-ea5a-4201-ad25-cc7b52271a52 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:02.683768 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-30b6f604-ea5a-4201-ad25-cc7b52271a52 admin admin] Calling delete_port for bfa73955-6300-4749-8500-d4c22f8e54be owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:44:02.876261 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30b6f604-ea5a-4201-ad25-cc7b52271a52 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:02.908567 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30b6f604-ea5a-4201-ad25-cc7b52271a52 admin admin] Pushing event deleted for resources: {'Port': ['ID=bfa73955-6300-4749-8500-d4c22f8e54be,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:44:03.088561 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-30b6f604-ea5a-4201-ad25-cc7b52271a52 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:03.122832 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9ae862ab-ebe2-4d08-b311-5332fc85b3fd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:03.307547 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-30b6f604-ea5a-4201-ad25-cc7b52271a52 admin admin] Router a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:44:03.415277 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-30b6f604-ea5a-4201-ad25-cc7b52271a52 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:44:03.422365 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-30b6f604-ea5a-4201-ad25-cc7b52271a52 admin admin] 10.222.0.13 "PUT /v2.0/routers/a72c0417-48f5-4a99-bfd5-b416fe1c9dd0/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8085141 Dec 09 22:44:03.423581 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36466) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:44:03.424432 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af21d100-f314-426b-a977-61091176a685 None None] Sync routers for ids ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'] in n-d-713301-27 {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:44:03.436202 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af21d100-f314-426b-a977-61091176a685 None None] Routers {'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:44:03.436825 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-af21d100-f314-426b-a977-61091176a685 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:43:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:44:03.527674 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e67a29e-5cdb-400f-bba7-4c046102cd06 admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:03.543582 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-af21d100-f314-426b-a977-61091176a685 None None] Set router a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 gateway port host: n-d-713301-27 {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:44:03.646459 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e67a29e-5cdb-400f-bba7-4c046102cd06 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:03.701992 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1e67a29e-5cdb-400f-bba7-4c046102cd06 admin admin] Deleting port e89a3aa7-436f-4a4a-b261-ace3f89966be {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:44:03.702297 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e67a29e-5cdb-400f-bba7-4c046102cd06 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:03.734693 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-af21d100-f314-426b-a977-61091176a685 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'name': 'tempest-TestSnapshotPattern-2034929229-router', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141'}], 'enable_snat': True}, 'gw_port_id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:44:02Z', 'revision_number': 5, 'project_id': '2373ef24126c44b492884e181943f78a', 'gw_port': {'id': 'e89a3aa7-436f-4a4a-b261-ace3f89966be', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:09:7a:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4361, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.141', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:39:18Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:44:03.760660 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af21d100-f314-426b-a977-61091176a685 None None] Checking router: a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 for host: n-d-713301-27 {{(pid=103440) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:44:03.772859 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af21d100-f314-426b-a977-61091176a685 None None] Routers {'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'} bound to L3 agent in host n-d-713301-27 {{(pid=103440) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:44:03.773923 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-af21d100-f314-426b-a977-61091176a685 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:43:36Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'], 'active': True} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:44:03.788647 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-1e67a29e-5cdb-400f-bba7-4c046102cd06 admin admin] For port e89a3aa7-436f-4a4a-b261-ace3f89966be, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e89a3aa7-436f-4a4a-b261-ace3f89966be,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:44:03.789021 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e67a29e-5cdb-400f-bba7-4c046102cd06 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:03.801532 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-1e67a29e-5cdb-400f-bba7-4c046102cd06 admin admin] Calling delete_port for e89a3aa7-436f-4a4a-b261-ace3f89966be owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:44:03.866120 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_dvr_db [None req-af21d100-f314-426b-a977-61091176a685 None None] Set router a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 gateway port host: None {{(pid=103440) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:44:03.919623 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 no longer exists at agent hyperv_n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:44:03.921535 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.l3_hamode_db [None req-af21d100-f314-426b-a977-61091176a685 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'name': 'tempest-TestSnapshotPattern-2034929229-router', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:44:03Z', 'revision_number': 6, 'project_id': '2373ef24126c44b492884e181943f78a', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103440) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:44:03.942477 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] No Port match for: 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:44:03.942903 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Device 1c4bbb1a-bd7f-4f83-9a15-6c267e295116 not bound to the agent host n-h2-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:44:03.949298 n-d-713301-27 neutron-server[103440]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af21d100-f314-426b-a977-61091176a685 None None] The sync data for ids ['a72c0417-48f5-4a99-bfd5-b416fe1c9dd0'] in n-d-713301-27 is: [{'id': 'a72c0417-48f5-4a99-bfd5-b416fe1c9dd0', 'name': 'tempest-TestSnapshotPattern-2034929229-router', 'tenant_id': '2373ef24126c44b492884e181943f78a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:15Z', 'updated_at': '2021-12-09T22:44:03Z', 'revision_number': 6, 'project_id': '2373ef24126c44b492884e181943f78a', 'gw_port_host': None}] {{(pid=103440) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:44:03.981626 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e67a29e-5cdb-400f-bba7-4c046102cd06 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:04.007925 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e67a29e-5cdb-400f-bba7-4c046102cd06 admin admin] Pushing event deleted for resources: {'Port': ['ID=e89a3aa7-436f-4a4a-b261-ace3f89966be,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:44:04.025069 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a67ad33-2dbe-405b-b4dc-f28204c93787 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:44:04.074289 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e67a29e-5cdb-400f-bba7-4c046102cd06 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:04.164430 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e67a29e-5cdb-400f-bba7-4c046102cd06 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:04.166606 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e67a29e-5cdb-400f-bba7-4c046102cd06 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:04.212536 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e67a29e-5cdb-400f-bba7-4c046102cd06 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:04.212969 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1e67a29e-5cdb-400f-bba7-4c046102cd06 admin admin] Fanout notify agent at l3_agent the message router_deleted on router a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 22:44:04.218650 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-1e67a29e-5cdb-400f-bba7-4c046102cd06 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:04.219847 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-1e67a29e-5cdb-400f-bba7-4c046102cd06 admin admin] 10.222.0.13 "DELETE /v2.0/routers/a72c0417-48f5-4a99-bfd5-b416fe1c9dd0 HTTP/1.1" status: 204 len: 168 time: 0.7953598 Dec 09 22:44:04.222484 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36468) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:44:04.268338 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-7a3bb485-064b-4c61-baad-b332065d4acf admin admin] Deleting subnet 9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:44:04.272158 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a3bb485-064b-4c61-baad-b332065d4acf admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:04.313129 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a3bb485-064b-4c61-baad-b332065d4acf admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:04.397317 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a3bb485-064b-4c61-baad-b332065d4acf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:04.454578 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a3bb485-064b-4c61-baad-b332065d4acf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:04.479189 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a3bb485-064b-4c61-baad-b332065d4acf admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:44:04.483521 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-7a3bb485-064b-4c61-baad-b332065d4acf admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:04.486748 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-7a3bb485-064b-4c61-baad-b332065d4acf admin admin] 10.222.0.13 "DELETE /v2.0/subnets/9ed99aeb-50e6-45ae-b2ec-a4d7fd89e6c1 HTTP/1.1" status: 204 len: 168 time: 0.2632906 Dec 09 22:44:04.489551 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36470) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:44:04.491349 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a70fefe7-76ac-4da5-bb91-47c7b34de502 None None] Network 838c65be-046c-4ff2-bdb7-ede24f82dbda requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:44:04.562667 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:04.617509 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Deleting port 591164fc-106b-426b-86ac-26781269c30e {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:44:04.617877 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:04.680520 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] For port 591164fc-106b-426b-86ac-26781269c30e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=591164fc-106b-426b-86ac-26781269c30e,segment=NetworkSegment(2eba823c-93ea-484b-ab73-5af9237c7643),segment_id=2eba823c-93ea-484b-ab73-5af9237c7643)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:44:04.680880 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:04.698217 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Calling delete_port for 591164fc-106b-426b-86ac-26781269c30e owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:44:04.719880 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-126a88f7-c849-4eac-9ec5-85bcc4f3a607 None None] DHCP port deletion for 838c65be-046c-4ff2-bdb7-ede24f82dbda request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:44:04.769860 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-126a88f7-c849-4eac-9ec5-85bcc4f3a607 None None] Deleting port 591164fc-106b-426b-86ac-26781269c30e {{(pid=103439) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:44:04.770233 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-126a88f7-c849-4eac-9ec5-85bcc4f3a607 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:04.795258 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:04.804321 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] No DVR routers for this DVR port 591164fc-106b-426b-86ac-26781269c30e on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:44:04.832041 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Pushing event deleted for resources: {'Port': ['ID=591164fc-106b-426b-86ac-26781269c30e,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:44:04.842698 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.db [None req-126a88f7-c849-4eac-9ec5-85bcc4f3a607 None None] For port 591164fc-106b-426b-86ac-26781269c30e, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=591164fc-106b-426b-86ac-26781269c30e,segment=NetworkSegment(2eba823c-93ea-484b-ab73-5af9237c7643),segment_id=2eba823c-93ea-484b-ab73-5af9237c7643)] {{(pid=103439) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:44:04.843099 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-126a88f7-c849-4eac-9ec5-85bcc4f3a607 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:04.856299 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-126a88f7-c849-4eac-9ec5-85bcc4f3a607 None None] Calling delete_port for 591164fc-106b-426b-86ac-26781269c30e owned by network:dhcp {{(pid=103439) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:44:04.857157 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:44:04.857504 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:44:04.857837 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:44:04.858166 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:44:04.858493 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:44:04.858814 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:44:04.859162 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:44:04.859469 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:44:04.859791 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:44:04.860108 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:44:04.860427 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:44:04.860738 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:44:04.861052 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@n-d-713301-27 {{(pid=103438) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 22:44:04.913438 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:04.934812 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['838c65be-046c-4ff2-bdb7-ede24f82dbda']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:44:04.938487 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-126a88f7-c849-4eac-9ec5-85bcc4f3a607 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213'] for port, after_delete {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:04.946370 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2eba823c-93ea-484b-ab73-5af9237c7643') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:44:04.946621 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2eba823c-93ea-484b-ab73-5af9237c7643') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:44:04.957465 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:04.961452 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-126a88f7-c849-4eac-9ec5-85bcc4f3a607 None None] Pushing event deleted for resources: {'Port': ['ID=591164fc-106b-426b-86ac-26781269c30e,revision_number=None']} {{(pid=103439) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:44:04.967816 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-126a88f7-c849-4eac-9ec5-85bcc4f3a607 None None] No DVR routers for this DVR port 591164fc-106b-426b-86ac-26781269c30e on host n-d-713301-27 {{(pid=103439) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:44:04.973638 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:04.984369 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Releasing vlan 148 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:44:04.984844 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: timer() Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:44:04.986660 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:44:05.048436 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:05.056294 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:05.060292 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] 10.222.0.13 "DELETE /v2.0/networks/838c65be-046c-4ff2-bdb7-ede24f82dbda HTTP/1.1" status: 204 len: 168 time: 0.5696278 Dec 09 22:44:05.063392 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36472) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:44:05.070330 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device bfa73955-6300-4749-8500-d4c22f8e54be no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:44:05.071476 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0a8d088-d4dd-46f0-944d-56984467d116 admin admin] Pushing event deleted for resources: {'Network': ['ID=838c65be-046c-4ff2-bdb7-ede24f82dbda,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:44:05.094750 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: bfa73955-6300-4749-8500-d4c22f8e54be {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:44:05.095101 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device bfa73955-6300-4749-8500-d4c22f8e54be not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:44:05.095544 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e89a3aa7-436f-4a4a-b261-ace3f89966be no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:44:05.115038 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: e89a3aa7-436f-4a4a-b261-ace3f89966be {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:44:05.115386 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e89a3aa7-436f-4a4a-b261-ace3f89966be not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:44:05.115825 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 591164fc-106b-426b-86ac-26781269c30e no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:44:05.134526 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 591164fc-106b-426b-86ac-26781269c30e {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:44:05.134873 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 591164fc-106b-426b-86ac-26781269c30e not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:44:05.419672 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f474a331-c297-47c9-8040-48af5e096059 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-637277'] for router_interface, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:05.670481 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-f474a331-c297-47c9-8040-48af5e096059 admin admin] Deleting port e5ca8248-b1c1-4803-82f9-5956a0b7bc3a {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:44:05.670742 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f474a331-c297-47c9-8040-48af5e096059 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:05.711775 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ac289b58-7d4d-4b1a-8ab8-b63636c87a60 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:05.752932 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-f474a331-c297-47c9-8040-48af5e096059 admin admin] For port e5ca8248-b1c1-4803-82f9-5956a0b7bc3a, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=e5ca8248-b1c1-4803-82f9-5956a0b7bc3a,segment=NetworkSegment(71eac29e-4486-46a6-94a8-8db81722f2b0),segment_id=71eac29e-4486-46a6-94a8-8db81722f2b0)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:44:05.753300 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f474a331-c297-47c9-8040-48af5e096059 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:05.765746 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-f474a331-c297-47c9-8040-48af5e096059 admin admin] Calling delete_port for e5ca8248-b1c1-4803-82f9-5956a0b7bc3a owned by network:router_interface {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:44:05.962134 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f474a331-c297-47c9-8040-48af5e096059 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:05.992165 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f474a331-c297-47c9-8040-48af5e096059 admin admin] Pushing event deleted for resources: {'Port': ['ID=e5ca8248-b1c1-4803-82f9-5956a0b7bc3a,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:44:06.155263 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-f474a331-c297-47c9-8040-48af5e096059 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-560748', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-637233'] for router_interface, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:06.374307 n-d-713301-27 neutron-server[103437]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f474a331-c297-47c9-8040-48af5e096059 admin admin] Router 80a6d605-9a70-40a2-b9ed-008b8372f195 has already been hosted by L3 agent bdbebc99-692f-4e00-8340-43ba1a188d25 {{(pid=103437) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 22:44:06.830409 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f474a331-c297-47c9-8040-48af5e096059 admin admin] Notify agent at l3_agent.n-d-713301-27 the message routers_updated {{(pid=103437) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 22:44:06.835489 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-f474a331-c297-47c9-8040-48af5e096059 admin admin] 10.222.0.13 "PUT /v2.0/routers/80a6d605-9a70-40a2-b9ed-008b8372f195/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7708557 Dec 09 22:44:06.838229 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36474) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:44:06.840877 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2eebd32d-2ff0-44fe-ae56-2778aea6b9e6 None None] Sync routers for ids ['80a6d605-9a70-40a2-b9ed-008b8372f195'] in n-d-713301-27 {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 22:44:06.851817 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2eebd32d-2ff0-44fe-ae56-2778aea6b9e6 None None] Routers {'80a6d605-9a70-40a2-b9ed-008b8372f195'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:44:06.852866 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-2eebd32d-2ff0-44fe-ae56-2778aea6b9e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:44:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['80a6d605-9a70-40a2-b9ed-008b8372f195'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:44:06.943988 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f1c998d-1396-48f6-9f93-9511ce6d7481 admin admin] Publish callbacks [] for router, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:06.960503 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-2eebd32d-2ff0-44fe-ae56-2778aea6b9e6 None None] Set router 80a6d605-9a70-40a2-b9ed-008b8372f195 gateway port host: n-d-713301-27 {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:44:07.055734 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:07.059895 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f1c998d-1396-48f6-9f93-9511ce6d7481 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:07.122727 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-2f1c998d-1396-48f6-9f93-9511ce6d7481 admin admin] Deleting port 0ec2516c-da47-46b1-ad5d-7e65df05ce36 {{(pid=103437) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:44:07.122727 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f1c998d-1396-48f6-9f93-9511ce6d7481 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:07.170344 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-2eebd32d-2ff0-44fe-ae56-2778aea6b9e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '80a6d605-9a70-40a2-b9ed-008b8372f195', 'name': 'tempest-TestSnapshotPattern-1721515629-router', 'tenant_id': '3382e60685be4fbb8bdbbf26852a44e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'external_fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.232'}], 'enable_snat': True}, 'gw_port_id': '0ec2516c-da47-46b1-ad5d-7e65df05ce36', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:20Z', 'updated_at': '2021-12-09T22:44:05Z', 'revision_number': 5, 'project_id': '3382e60685be4fbb8bdbbf26852a44e1', 'gw_port': {'id': '0ec2516c-da47-46b1-ad5d-7e65df05ce36', 'name': '', 'network_id': '97925a19-460a-4476-8208-41db134b6c83', 'tenant_id': '', 'mac_address': 'fa:16:3e:ab:3d:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '80a6d605-9a70-40a2-b9ed-008b8372f195', 'device_owner': 'network:router_gateway', 'standard_attr_id': 4373, 'fixed_ips': [{'subnet_id': 'a8035714-7788-4046-9aac-8912c882c128', 'ip_address': '172.25.3.232', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'n-d-713301-27', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T22:39:20Z', 'updated_at': '2021-12-09T22:39:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'a8035714-7788-4046-9aac-8912c882c128', 'cidr': '172.25.3.0/24', 'gateway_ip': '172.25.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'n-d-713301-27'}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:44:07.197831 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2eebd32d-2ff0-44fe-ae56-2778aea6b9e6 None None] Checking router: 80a6d605-9a70-40a2-b9ed-008b8372f195 for host: n-d-713301-27 {{(pid=103439) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 22:44:07.206531 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2eebd32d-2ff0-44fe-ae56-2778aea6b9e6 None None] Routers {'80a6d605-9a70-40a2-b9ed-008b8372f195'} bound to L3 agent in host n-d-713301-27 {{(pid=103439) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 22:44:07.207133 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-2eebd32d-2ff0-44fe-ae56-2778aea6b9e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'n-d-713301-27', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-09T21:07:35Z,description=,heartbeat_timestamp=2021-12-09T22:44:06Z,host='n-d-713301-27',id=bdbebc99-692f-4e00-8340-43ba1a188d25,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T21:07:35Z,topic='l3_agent')) {'router_ids': ['80a6d605-9a70-40a2-b9ed-008b8372f195'], 'active': True} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:44:07.207759 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.db [None req-2f1c998d-1396-48f6-9f93-9511ce6d7481 admin admin] For port 0ec2516c-da47-46b1-ad5d-7e65df05ce36, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=0ec2516c-da47-46b1-ad5d-7e65df05ce36,segment=NetworkSegment(f99e21fd-7aae-414e-91b6-df0c4cab3a19),segment_id=f99e21fd-7aae-414e-91b6-df0c4cab3a19)] {{(pid=103437) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:44:07.208276 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f1c998d-1396-48f6-9f93-9511ce6d7481 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:07.221898 n-d-713301-27 neutron-server[103437]: DEBUG neutron.plugins.ml2.plugin [None req-2f1c998d-1396-48f6-9f93-9511ce6d7481 admin admin] Calling delete_port for 0ec2516c-da47-46b1-ad5d-7e65df05ce36 owned by network:router_gateway {{(pid=103437) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:44:07.398960 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f1c998d-1396-48f6-9f93-9511ce6d7481 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8621602'] for port, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:07.430364 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f1c998d-1396-48f6-9f93-9511ce6d7481 admin admin] Pushing event deleted for resources: {'Port': ['ID=0ec2516c-da47-46b1-ad5d-7e65df05ce36,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:44:07.447682 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dbbc864f-f89d-4cdf-812a-08fdd1302861 None None] DHCP port deletion for 97925a19-460a-4476-8208-41db134b6c83 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:44:07.470267 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_dvr_db [None req-2eebd32d-2ff0-44fe-ae56-2778aea6b9e6 None None] Set router 80a6d605-9a70-40a2-b9ed-008b8372f195 gateway port host: None {{(pid=103439) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 22:44:07.497404 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f1c998d-1396-48f6-9f93-9511ce6d7481 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-640403'] for router_gateway, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:07.527495 n-d-713301-27 neutron-server[103439]: DEBUG neutron.db.l3_hamode_db [None req-2eebd32d-2ff0-44fe-ae56-2778aea6b9e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '80a6d605-9a70-40a2-b9ed-008b8372f195', 'name': 'tempest-TestSnapshotPattern-1721515629-router', 'tenant_id': '3382e60685be4fbb8bdbbf26852a44e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:20Z', 'updated_at': '2021-12-09T22:44:07Z', 'revision_number': 6, 'project_id': '3382e60685be4fbb8bdbbf26852a44e1', 'gw_port_host': None}], 'n-d-713301-27', False) {} {{(pid=103439) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:44:07.558299 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2eebd32d-2ff0-44fe-ae56-2778aea6b9e6 None None] The sync data for ids ['80a6d605-9a70-40a2-b9ed-008b8372f195'] in n-d-713301-27 is: [{'id': '80a6d605-9a70-40a2-b9ed-008b8372f195', 'name': 'tempest-TestSnapshotPattern-1721515629-router', 'tenant_id': '3382e60685be4fbb8bdbbf26852a44e1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T22:39:20Z', 'updated_at': '2021-12-09T22:44:07Z', 'revision_number': 6, 'project_id': '3382e60685be4fbb8bdbbf26852a44e1', 'gw_port_host': None}] {{(pid=103439) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 22:44:07.595859 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f1c998d-1396-48f6-9f93-9511ce6d7481 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-635139', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-104318'] for router, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:07.598161 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f1c998d-1396-48f6-9f93-9511ce6d7481 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:07.654639 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f1c998d-1396-48f6-9f93-9511ce6d7481 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-635194'] for router, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:07.655253 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2f1c998d-1396-48f6-9f93-9511ce6d7481 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 80a6d605-9a70-40a2-b9ed-008b8372f195 {{(pid=103437) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 22:44:07.659699 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-2f1c998d-1396-48f6-9f93-9511ce6d7481 admin admin] Publish callbacks [] for router, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:07.660889 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-2f1c998d-1396-48f6-9f93-9511ce6d7481 admin admin] 10.222.0.13 "DELETE /v2.0/routers/80a6d605-9a70-40a2-b9ed-008b8372f195 HTTP/1.1" status: 204 len: 168 time: 0.8215563 Dec 09 22:44:07.663499 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36476) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:44:07.710251 n-d-713301-27 neutron-server[103437]: DEBUG neutron.db.db_base_plugin_v2 [None req-4c57690d-5b54-4167-9328-3a6336927253 admin admin] Deleting subnet 9293130c-edee-4951-bdc3-4b9011e76435 {{(pid=103437) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 22:44:07.713566 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c57690d-5b54-4167-9328-3a6336927253 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:07.749216 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c57690d-5b54-4167-9328-3a6336927253 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-8622029'] for subnet, precommit_delete_associations {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:07.829456 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c57690d-5b54-4167-9328-3a6336927253 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1445589'] for subnet, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:07.892307 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c57690d-5b54-4167-9328-3a6336927253 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1445422', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-557652', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8621813', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9200168'] for subnet, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:07.920170 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c57690d-5b54-4167-9328-3a6336927253 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9293130c-edee-4951-bdc3-4b9011e76435,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:44:07.922249 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-4c57690d-5b54-4167-9328-3a6336927253 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:07.928506 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-4c57690d-5b54-4167-9328-3a6336927253 admin admin] 10.222.0.13 "DELETE /v2.0/subnets/9293130c-edee-4951-bdc3-4b9011e76435 HTTP/1.1" status: 204 len: 168 time: 0.2614286 Dec 09 22:44:07.928755 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [-] (103438) accepted ('10.222.0.13', 36478) {{(pid=103438) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:44:07.939369 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e906094c-d4a5-4a03-a8be-79f7f5edd335 None None] Network 31429689-de66-4d83-b930-16c23409a587 requested from n-d-713301-27 {{(pid=103439) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 22:44:08.014296 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6000bb2b-5a0c-47d5-9bce-d34f4f47b5bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1569924'] for network, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:08.075070 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-6000bb2b-5a0c-47d5-9bce-d34f4f47b5bf admin admin] Deleting port dd1f2e52-a39d-441e-9a5b-165c7b45f1ed {{(pid=103438) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 22:44:08.075421 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6000bb2b-5a0c-47d5-9bce-d34f4f47b5bf admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8731650208952'] for port, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:08.146061 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.db [None req-6000bb2b-5a0c-47d5-9bce-d34f4f47b5bf admin admin] For port dd1f2e52-a39d-441e-9a5b-165c7b45f1ed, host n-d-713301-27, got binding levels [PortBindingLevel(driver='openvswitch',host='n-d-713301-27',level=0,port_id=dd1f2e52-a39d-441e-9a5b-165c7b45f1ed,segment=NetworkSegment(71eac29e-4486-46a6-94a8-8db81722f2b0),segment_id=71eac29e-4486-46a6-94a8-8db81722f2b0)] {{(pid=103438) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 22:44:08.146451 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6000bb2b-5a0c-47d5-9bce-d34f4f47b5bf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-634350'] for port, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:08.161253 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.plugin [None req-6000bb2b-5a0c-47d5-9bce-d34f4f47b5bf admin admin] Calling delete_port for dd1f2e52-a39d-441e-9a5b-165c7b45f1ed owned by network:dhcp {{(pid=103438) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 22:44:08.251729 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6000bb2b-5a0c-47d5-9bce-d34f4f47b5bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1594069', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-92955', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8731650215455', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8731649715213', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8811812'] for port, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:08.276728 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6000bb2b-5a0c-47d5-9bce-d34f4f47b5bf admin admin] Pushing event deleted for resources: {'Port': ['ID=dd1f2e52-a39d-441e-9a5b-165c7b45f1ed,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:44:08.281830 n-d-713301-27 neutron-server[103438]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6000bb2b-5a0c-47d5-9bce-d34f4f47b5bf admin admin] No DVR routers for this DVR port dd1f2e52-a39d-441e-9a5b-165c7b45f1ed on host n-d-713301-27 {{(pid=103438) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 22:44:08.349097 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:08.356017 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6000bb2b-5a0c-47d5-9bce-d34f4f47b5bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1454402', 'neutron.services.segments.db._delete_segments_for_network-8731650051018'] for network, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:08.375846 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-6000bb2b-5a0c-47d5-9bce-d34f4f47b5bf admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['31429689-de66-4d83-b930-16c23409a587']}} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:44:08.385652 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-6000bb2b-5a0c-47d5-9bce-d34f4f47b5bf admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '71eac29e-4486-46a6-94a8-8db81722f2b0') {'for_net_delete': True} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:44:08.385960 n-d-713301-27 neutron-server[103438]: DEBUG neutron.services.segments.db [None req-6000bb2b-5a0c-47d5-9bce-d34f4f47b5bf admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '71eac29e-4486-46a6-94a8-8db81722f2b0') {} {{(pid=103438) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 22:44:08.396793 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6000bb2b-5a0c-47d5-9bce-d34f4f47b5bf admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8731650237907', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-8811538'] for segment, before_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:08.402299 n-d-713301-27 neutron-server[103439]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f8a6ad26-24a2-4d34-b8e6-3130338cc7ff None None] DHCP port deletion for 31429689-de66-4d83-b930-16c23409a587 request from n-d-713301-27 {{(pid=103439) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 22:44:08.413445 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6000bb2b-5a0c-47d5-9bce-d34f4f47b5bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960'] for segment, precommit_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:08.425170 n-d-713301-27 neutron-server[103438]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6000bb2b-5a0c-47d5-9bce-d34f4f47b5bf admin admin] Releasing vlan 135 on physical network physnet1 to pool {{(pid=103438) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 22:44:08.425581 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6000bb2b-5a0c-47d5-9bce-d34f4f47b5bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1441960', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8811785'] for segment, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: Traceback (most recent call last): Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: timer() Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: cb(*args, **kw) Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: return func(*args, **kwargs) Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: self._notify() Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: self.callback(batched_events) Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: event.method(event) Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: return f(self, *a, **k) Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: return self._get(url).json() Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: return self.request(url, 'GET', **kwargs) Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 22:44:08.427311 n-d-713301-27 neutron-server[103438]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 22:44:08.488063 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6000bb2b-5a0c-47d5-9bce-d34f4f47b5bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1454427', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534973', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-560741', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-640431'] for network, after_delete {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:08.496217 n-d-713301-27 neutron-server[103438]: DEBUG neutron_lib.callbacks.manager [None req-6000bb2b-5a0c-47d5-9bce-d34f4f47b5bf admin admin] Publish callbacks [] for network, before_response {{(pid=103438) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:08.498695 n-d-713301-27 neutron-server[103438]: INFO neutron.wsgi [None req-6000bb2b-5a0c-47d5-9bce-d34f4f47b5bf admin admin] 10.222.0.13 "DELETE /v2.0/networks/31429689-de66-4d83-b930-16c23409a587 HTTP/1.1" status: 204 len: 168 time: 0.5689878 Dec 09 22:44:08.512172 n-d-713301-27 neutron-server[103438]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6000bb2b-5a0c-47d5-9bce-d34f4f47b5bf admin admin] Pushing event deleted for resources: {'Network': ['ID=31429689-de66-4d83-b930-16c23409a587,revision_number=None']} {{(pid=103438) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:44:08.690691 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36482) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:44:08.731667 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-d61c17ab-4a35-4ad0-8593-123958354be0 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=2373ef24126c44b492884e181943f78a&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0397360 Dec 09 22:44:08.734322 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36484) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:44:08.785291 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6ece27e1-a43a-41ea-ade8-c9c52639f68c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:08.808584 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6ece27e1-a43a-41ea-ade8-c9c52639f68c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:08.856575 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6ece27e1-a43a-41ea-ade8-c9c52639f68c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:08.859198 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-6ece27e1-a43a-41ea-ade8-c9c52639f68c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:08.860411 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-6ece27e1-a43a-41ea-ade8-c9c52639f68c admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/efcb0038-4ed7-41a8-b86e-006ba600c1fc HTTP/1.1" status: 204 len: 168 time: 0.1252096 Dec 09 22:44:08.868420 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ece27e1-a43a-41ea-ade8-c9c52639f68c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=efcb0038-4ed7-41a8-b86e-006ba600c1fc,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:44:09.059195 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0ec2516c-da47-46b1-ad5d-7e65df05ce36 no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:44:09.080926 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: 0ec2516c-da47-46b1-ad5d-7e65df05ce36 {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:44:09.081356 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device 0ec2516c-da47-46b1-ad5d-7e65df05ce36 not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:44:09.081817 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device dd1f2e52-a39d-441e-9a5b-165c7b45f1ed no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:44:09.100230 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: dd1f2e52-a39d-441e-9a5b-165c7b45f1ed {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:44:09.100574 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device dd1f2e52-a39d-441e-9a5b-165c7b45f1ed not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:44:09.100973 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e5ca8248-b1c1-4803-82f9-5956a0b7bc3a no longer exists at agent ovs-agent-n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 22:44:09.123014 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.plugin [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] No Port match for: e5ca8248-b1c1-4803-82f9-5956a0b7bc3a {{(pid=103439) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 22:44:09.123361 n-d-713301-27 neutron-server[103439]: DEBUG neutron.plugins.ml2.rpc [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Device e5ca8248-b1c1-4803-82f9-5956a0b7bc3a not bound to the agent host n-d-713301-27 {{(pid=103439) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 22:44:09.215571 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36490) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:44:09.260526 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-fcdba543-f1f6-4e1d-8f87-12ed81939b21 admin admin] 10.222.0.13 "GET /v2.0/security-groups?tenant_id=3382e60685be4fbb8bdbbf26852a44e1&name=default HTTP/1.1" status: 200 len: 3000 time: 0.0435584 Dec 09 22:44:09.264051 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [-] (103437) accepted ('10.222.0.13', 36492) {{(pid=103437) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 22:44:09.313965 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8a8d377-3e55-4c80-ab8e-d67393e96972 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:09.338614 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8a8d377-3e55-4c80-ab8e-d67393e96972 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:09.390668 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8a8d377-3e55-4c80-ab8e-d67393e96972 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-534894'] for security_group, after_delete {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:09.394454 n-d-713301-27 neutron-server[103437]: DEBUG neutron_lib.callbacks.manager [None req-c8a8d377-3e55-4c80-ab8e-d67393e96972 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103437) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:09.395707 n-d-713301-27 neutron-server[103437]: INFO neutron.wsgi [None req-c8a8d377-3e55-4c80-ab8e-d67393e96972 admin admin] 10.222.0.13 "DELETE /v2.0/security-groups/3558625e-7bf6-4bfc-a0c1-5770e2147362 HTTP/1.1" status: 204 len: 168 time: 0.1307044 Dec 09 22:44:09.404199 n-d-713301-27 neutron-server[103437]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8a8d377-3e55-4c80-ab8e-d67393e96972 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3558625e-7bf6-4bfc-a0c1-5770e2147362,revision_number=None']} {{(pid=103437) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 22:44:09.726350 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:11.384306 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:44:28.017770 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:28.077985 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:33.135808 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-49736665-a0b3-4d8a-a876-45f96803da3d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:35.719651 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-1cd8d375-c89b-4997-86c6-7f4267734db0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:37.016730 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:38.354399 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:39.725817 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:48.384666 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:44:58.026707 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:44:58.088058 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:45:03.131159 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-daf09b31-39e9-475a-960d-e512ae6a304c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:45:05.724009 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-85408874-c35a-4e99-aecd-149251243b97 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:45:07.014941 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:45:08.357499 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:45:09.726612 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:45:25.390373 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:45:28.023135 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:45:28.079258 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:45:33.142533 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-6bfc6ebf-078e-42db-971c-3a4fe0982370 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:45:35.720116 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-5fddab9f-ac1d-4a63-a145-c96d4dccd871 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:45:37.023393 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:45:38.360738 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:45:39.733533 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:45:58.035939 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:45:58.088981 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:46:02.395951 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:46:03.147020 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-4b259b42-cb17-4e38-84d9-38d5eb5e654e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:46:05.725954 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-dd8bd6c7-c467-4d8c-a93f-53a061ea2696 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:46:07.024063 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:46:08.363407 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:46:09.723783 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:46:28.034487 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:46:28.096087 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:46:33.142162 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-03bc89cc-060f-4366-88d1-f34bc520563e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:46:35.719844 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-912516ec-9012-4df3-bf6d-58750546d9ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:46:37.029957 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:46:38.369216 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:46:39.400977 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:46:39.730153 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:46:58.044730 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:46:58.107840 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:47:03.150436 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7f0fe3cf-ed06-4987-959a-3fe1616c4df1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:47:05.719399 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-7b50bdb5-09bd-4d4b-a766-194b6d741f0e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:47:07.028248 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:47:08.374214 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:47:09.718362 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:47:16.406400 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:47:28.045018 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:47:28.103629 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:47:33.145055 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-0c7dc9f9-d742-40f5-a50a-f7bfe51ac5da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:47:35.720119 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-26d08480-9b15-45f1-be82-815360c79111 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:47:37.031382 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:47:38.376830 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:47:39.723324 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:47:53.406402 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:47:58.059943 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:47:58.127072 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:48:03.159659 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d8edc6a1-73ae-44a8-bf7e-5f906f58ff86 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:48:05.727480 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-953cd1f3-8340-47df-847c-3365b02c4382 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:48:07.034333 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:48:08.379544 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:48:09.721832 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:48:15.435234 n-d-713301-27 neutron-server[103438]: DEBUG neutron.wsgi [req-3fecae4b-7000-4b43-bf3e-b5e2d8a3d112 req-94ac44f5-4d11-4aa7-a71a-a7180911627b service neutron] (103438) timed out ('10.222.0.10', 63574) {{(pid=103438) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 09 22:48:28.071202 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:48:28.124934 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:48:30.412614 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:48:33.154776 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b2112c4a-1001-4c94-bf7b-be856ab56cbe None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:48:35.712237 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-d03477bc-205f-4e00-a30a-479197d6f5cb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:48:37.043658 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:48:38.383937 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:48:39.723663 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:48:58.088984 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:48:58.129611 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:49:03.159200 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-361f6f09-6dcf-47ce-a599-04728601c30a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:49:05.721934 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-b22cb691-3c2f-4a99-8559-ca6085fb7964 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:49:07.040504 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:49:07.411308 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:49:08.386172 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:49:09.732053 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:49:28.076785 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:49:28.153959 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:49:33.173066 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-473c2686-f356-4a06-a60b-d306e37a580e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:49:35.720425 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-2999db02-a0d5-4aee-a717-340a2b4e9b2f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:49:37.045375 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:49:38.388042 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:49:39.731960 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:49:44.405659 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:49:58.084411 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:49:58.149962 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:50:03.179629 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-a865adc8-c22c-42d4-909e-656e789fe723 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:50:05.720526 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f0432a13-dc98-455f-b9b9-8c4fdbe00ea7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:50:07.046488 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:50:08.390105 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:50:09.723417 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:50:21.410004 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:50:28.099204 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:50:28.163808 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:50:33.165413 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-3e7f3cf8-bf45-49af-aabf-74e3ce849f99 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:50:35.715998 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ff962301-55f7-4499-b205-dc444757e34c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:50:37.054241 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:50:38.392550 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:50:39.725825 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:50:58.117304 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:50:58.183327 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:50:58.416003 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:51:03.168337 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c67eb87f-4bb1-4cd8-a2ca-7caab84905cc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:51:05.714070 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-43d43501-f485-4a45-8bff-0e3cca6efb34 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:51:07.052540 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:51:08.399730 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:51:09.730201 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:51:28.110405 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:51:28.181205 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:51:33.176203 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-8e74cf95-aa03-4df2-a2c2-a88f61ddd4f3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:51:35.418448 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:51:35.714826 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-523aa2c1-0bb4-4c29-a1b4-0304b46bb044 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:51:37.060307 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:51:38.403349 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:51:39.733656 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:51:58.105737 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:51:58.196183 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:52:03.171675 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-9ed58990-2de7-4b65-8ebf-574c1495ba5f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:52:05.716822 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca95f3ba-bbea-4989-8f37-ea9abe2b69cc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:52:07.061209 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:52:08.404952 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:52:09.741159 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:52:12.423423 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:52:25.932450 n-d-713301-27 neutron-server[103437]: DEBUG neutron.wsgi [req-7bff0693-dec6-4542-acac-4f24a69e8c36 req-12e17635-839b-4a12-93f6-57faf9e26fa1 service neutron] (103437) timed out ('10.222.0.13', 34402) {{(pid=103437) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 09 22:52:28.123696 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:52:28.201782 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:52:33.181553 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c70fb76f-19b8-4c89-9c2d-f1b3aa6c0c1b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:52:35.713977 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f6370d48-bcb3-450e-80e7-77fda0f04141 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:52:37.065867 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-c6744ece-2d69-4630-ac35-bb3949526a73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:52:38.418182 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-41d365fb-aa5a-4b73-9fb8-aaafbc189ffc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:52:39.726845 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-f7520ed5-dcfc-47f6-9253-3772232b7d80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:52:49.424082 n-d-713301-27 neutron-server[103440]: DEBUG neutron.db.agents_db [None req-86df14f1-25c9-4083-b583-2ffe2091c5d0 None None] Agent healthcheck: found 7 active agents {{(pid=103440) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 22:52:58.127538 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-ca604631-0a23-47cd-9ace-6a1f51a728b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 22:52:58.193810 n-d-713301-27 neutron-server[103439]: DEBUG neutron_lib.callbacks.manager [None req-786fb575-4782-4598-90f8-2d836d6e83de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8731650050973', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1456148'] for agent, after_update {{(pid=103439) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}}